2024-09-20T21:50:58.420 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-20T21:50:58.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T21:50:58.521 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7912981 branch: squid description: orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} email: ceph-qa@ceph.com first_in_suite: false job_id: '7912981' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - MON_DOWN - mons down - mon down - out of quorum log-only-match: - CEPHADM_ sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - mon.a - mgr.a - osd.0 - - host.b - mon.b - mgr.b - osd.1 - - host.c - mon.c - osd.2 seed: 9344 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 56/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0L88uZNUFgU8GNaJIDX9M+AccNBVvNfA4Nhb+JMG5qCPQ9BmSRPWsNI6b+l136RyWxouP/RoiIxRlkQ+yHG6c= smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD20cmjcZunk7qWiIf9kFlE0VQRUhmkxZj8PhoNOJ//0ANp7rikFWZC32noTS+2I+kUXu0YREbLe0vrXxCTBioQ= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtsxLN+0bo8W69fBu+QOCSRSOwlMAOZipq1YSxc59zAo0KAQYNWUmZrkpFzz14gWw1fXgQB1Sbq49eqtIeBjSY= tasks: - install: null - cephadm: null - cephadm.shell: host.a: - ceph mgr module enable rgw - rgw_module.apply: specs: - rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 - cephadm.shell: host.a: - 'set -e set -x while true; do TOKEN=$(ceph rgw realm tokens | jq -r ''.[0].token''); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done TOKENS=$(ceph rgw realm tokens) echo $TOKENS | jq --exit-status ''.[0].realm == "myrealm1"'' echo $TOKENS | jq --exit-status ''.[0].token'' TOKEN_JSON=$(ceph rgw realm tokens | jq -r ''.[0].token'' | base64 --decode) echo $TOKEN_JSON | jq --exit-status ''.realm_name == "myrealm1"'' echo $TOKEN_JSON | jq --exit-status ''.endpoint | test("http://.+:\\d+")'' echo $TOKEN_JSON | jq --exit-status ''.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'' echo $TOKEN_JSON | jq --exit-status ''.access_key'' echo $TOKEN_JSON | jq --exit-status ''.secret'' ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-20T21:50:58.522 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-20T21:50:58.522 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-20T21:50:58.522 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-20T21:50:58.524 INFO:teuthology.task.internal:Checking packages... 2024-09-20T21:50:58.542 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-20T21:50:58.542 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T21:50:58.543 INFO:teuthology.packaging:ref: None 2024-09-20T21:50:58.543 INFO:teuthology.packaging:tag: None 2024-09-20T21:50:58.543 INFO:teuthology.packaging:branch: squid 2024-09-20T21:50:58.543 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T21:50:58.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-20T21:50:58.761 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373-g4e45e6b4-1jammy 2024-09-20T21:50:58.762 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-20T21:50:58.769 INFO:teuthology.task.internal:no buildpackages task found 2024-09-20T21:50:58.769 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-20T21:50:58.776 INFO:teuthology.task.internal:Saving configuration 2024-09-20T21:50:58.787 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-20T21:50:58.800 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-20T21:50:58.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7912981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 21:43:53.824109', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN7CfkyvPsR9EtwUOq95ABuGgcnsXJsDVxnUpO1YHqyM'} 2024-09-20T21:50:58.851 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7912981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 21:43:53.826915', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINgZLoQWJ3JNGEdgDvzwh9R6wGJqdj8d0aYwST0yXHZl'} 2024-09-20T21:50:58.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:08:02-orch-squid-distro-default-smithi/7912981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 21:43:53.825681', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPW3nBoK7pHdzsxGv/tMbMbqfbm4i8g/Sdshrq/bxsTj'} 2024-09-20T21:50:58.873 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-20T21:50:58.879 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.a', 'osd.0'] 2024-09-20T21:50:58.879 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['host.b', 'mon.b', 'mgr.b', 'osd.1'] 2024-09-20T21:50:58.879 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.2'] 2024-09-20T21:50:58.879 INFO:teuthology.run_tasks:Running task console_log... 2024-09-20T21:50:58.965 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ae7dd7490>, signals=[15]) 2024-09-20T21:50:58.965 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-20T21:50:58.971 INFO:teuthology.task.internal:Opening connections... 2024-09-20T21:50:58.971 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-20T21:50:58.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:50:59.053 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-09-20T21:50:59.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:50:59.131 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-09-20T21:50:59.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:50:59.207 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-20T21:50:59.213 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-20T21:50:59.220 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-20T21:50:59.220 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04" 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2024-09-20T21:50:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T21:50:59.268 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T21:50:59.268 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T21:50:59.268 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T21:50:59.268 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy 2024-09-20T21:50:59.268 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-20T21:50:59.300 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-09-20T21:50:59.306 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-09-20T21:50:59.306 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="22.04" 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=jammy 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T21:50:59.355 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T21:50:59.356 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T21:50:59.356 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=jammy 2024-09-20T21:50:59.356 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-09-20T21:50:59.375 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-09-20T21:50:59.382 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-09-20T21:50:59.382 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-09-20T21:50:59.429 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T21:50:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2024-09-20T21:50:59.431 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-09-20T21:50:59.450 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-20T21:50:59.459 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-20T21:50:59.488 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-20T21:50:59.489 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-20T21:50:59.491 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-09-20T21:50:59.493 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-09-20T21:50:59.498 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-20T21:50:59.504 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-20T21:50:59.504 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-20T21:50:59.540 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-09-20T21:50:59.542 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-09-20T21:50:59.559 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-20T21:50:59.634 INFO:teuthology.run_tasks:Running task kernel... 2024-09-20T21:50:59.648 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-20T21:50:59.648 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}, 'host.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-20T21:50:59.648 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T21:50:59.649 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T21:50:59.649 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T21:50:59.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:50:59.654 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-20T21:50:59.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:50:59.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T21:50:59.656 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-20T21:50:59.656 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-20T21:50:59.702 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-56-generic 2024-09-20T21:50:59.702 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.15.0-56-generic 2024-09-20T21:50:59.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-09-20T21:50:59.703 INFO:teuthology.orchestra.run.smithi049.stdout:5.15.0-56-generic 2024-09-20T21:50:59.704 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-56-generic 2024-09-20T21:50:59.704 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.15.0-56-generic 2024-09-20T21:50:59.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get clean 2024-09-20T21:50:59.704 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.15.0-56-generic 2024-09-20T21:50:59.704 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-09-20T21:50:59.819 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-09-20T21:50:59.831 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-09-20T21:50:59.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-09-20T21:50:59.985 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T21:50:59.993 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T21:50:59.993 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T21:51:00.025 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T21:51:00.068 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T21:51:00.102 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T21:51:00.103 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T21:51:00.130 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T21:51:00.167 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T21:51:00.212 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T21:51:00.246 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T21:51:00.246 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T21:51:00.325 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T21:51:00.325 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T21:51:00.349 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T21:51:00.355 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T21:51:00.358 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T21:51:00.358 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T21:51:00.358 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T21:51:00.362 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T21:51:00.365 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T21:51:00.369 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T21:51:00.369 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T21:51:00.378 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T21:51:00.382 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T21:51:00.382 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T21:51:00.384 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T21:51:00.387 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T21:51:00.388 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T21:51:00.388 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T21:51:00.394 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T21:51:00.394 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T21:51:00.396 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T21:51:00.396 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T21:51:00.396 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T21:51:00.396 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T21:51:00.398 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T21:51:00.399 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T21:51:00.399 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T21:51:00.399 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T21:51:00.410 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T21:51:00.440 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T21:51:00.440 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T21:51:00.441 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T21:51:00.447 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T21:51:00.450 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T21:51:00.451 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T21:51:00.471 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T21:51:00.471 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T21:51:00.475 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T21:51:00.475 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T21:51:00.481 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T21:51:00.485 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T21:51:00.487 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T21:51:00.487 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T21:51:00.487 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T21:51:00.506 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T21:51:00.506 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T21:51:00.506 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T21:51:00.507 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T21:51:00.507 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T21:51:00.517 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T21:51:00.517 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T21:51:00.517 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T21:51:00.524 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T21:51:00.534 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T21:51:00.534 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T21:51:00.555 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T21:51:00.566 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T21:51:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T21:51:00.704 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T21:51:00.851 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T21:51:00.899 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T21:51:00.986 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T21:51:01.021 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T21:51:01.025 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T21:51:01.036 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T21:51:01.036 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T21:51:01.038 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T21:51:01.039 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T21:51:01.059 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T21:51:01.073 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T21:51:01.074 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T21:51:01.106 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T21:51:01.110 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T21:51:01.124 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T21:51:01.125 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T21:51:01.126 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T21:51:01.143 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T21:51:01.148 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T21:51:01.162 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T21:51:01.163 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T21:51:01.180 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T21:51:01.180 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T21:51:01.180 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T21:51:01.185 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T21:51:01.192 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T21:51:01.199 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T21:51:01.207 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T21:51:01.210 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T21:51:01.211 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T21:51:01.212 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T21:51:01.212 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T21:51:01.213 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T21:51:01.217 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T21:51:01.218 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T21:51:01.218 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T21:51:01.219 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T21:51:01.223 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T21:51:01.224 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T21:51:01.234 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T21:51:01.234 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T21:51:01.273 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T21:51:01.273 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T21:51:01.295 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T21:51:01.296 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T21:51:01.296 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T21:51:01.298 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T21:51:01.299 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T21:51:01.301 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T21:51:01.302 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T21:51:01.304 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T21:51:01.304 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T21:51:01.305 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T21:51:01.305 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T21:51:01.305 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T21:51:01.305 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T21:51:01.315 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T21:51:01.316 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T21:51:01.316 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T21:51:01.386 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T21:51:01.386 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T21:51:06.695 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 16.3 MB in 2s (7,475 kB/s) 2024-09-20T21:51:07.128 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 16.3 MB in 2s (7,209 kB/s) 2024-09-20T21:51:07.699 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 16.3 MB in 3s (5,623 kB/s) 2024-09-20T21:51:08.303 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-20T21:51:08.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T21:51:08.385 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-20T21:51:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-09-20T21:51:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-09-20T21:51:08.653 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-09-20T21:51:08.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T21:51:08.736 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-09-20T21:51:08.787 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:51:08.787 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:51:08.787 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:51:08.788 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:51:08.788 INFO:teuthology.orchestra.run.smithi179.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T21:51:08.788 INFO:teuthology.orchestra.run.smithi179.stdout: python2.7-minimal 2024-09-20T21:51:08.788 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:51:08.789 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-09-20T21:51:08.789 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T21:51:08.789 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T21:51:08.790 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T21:51:08.791 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-09-20T21:51:08.791 INFO:teuthology.orchestra.run.smithi179.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T21:51:08.791 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-09-20T21:51:08.791 INFO:teuthology.orchestra.run.smithi179.stdout: thermald 2024-09-20T21:51:08.847 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-09-20T21:51:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T21:51:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T21:51:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T21:51:08.848 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages will be upgraded: 2024-09-20T21:51:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T21:51:08.952 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-09-20T21:51:08.952 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-09-20T21:51:09.028 INFO:teuthology.orchestra.run.smithi179.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T21:51:09.029 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 113 MB of archives. 2024-09-20T21:51:09.029 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T21:51:09.029 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T21:51:09.152 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:51:09.152 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:51:09.152 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:51:09.153 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:51:09.153 INFO:teuthology.orchestra.run.smithi049.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T21:51:09.153 INFO:teuthology.orchestra.run.smithi049.stdout: python2.7-minimal 2024-09-20T21:51:09.153 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:51:09.155 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-09-20T21:51:09.155 INFO:teuthology.orchestra.run.smithi049.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T21:51:09.155 INFO:teuthology.orchestra.run.smithi049.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T21:51:09.155 INFO:teuthology.orchestra.run.smithi049.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T21:51:09.157 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-09-20T21:51:09.157 INFO:teuthology.orchestra.run.smithi049.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T21:51:09.157 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2024-09-20T21:51:09.157 INFO:teuthology.orchestra.run.smithi049.stdout: thermald 2024-09-20T21:51:09.195 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-20T21:51:09.206 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-09-20T21:51:09.206 INFO:teuthology.orchestra.run.smithi049.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T21:51:09.206 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T21:51:09.207 INFO:teuthology.orchestra.run.smithi049.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T21:51:09.208 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2024-09-20T21:51:09.209 INFO:teuthology.orchestra.run.smithi049.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T21:51:09.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T21:51:09.261 INFO:teuthology.orchestra.run.smithi049.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T21:51:09.261 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 113 MB of archives. 2024-09-20T21:51:09.261 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T21:51:09.261 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T21:51:09.280 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-20T21:51:09.500 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-20T21:51:09.501 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-20T21:51:09.657 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T21:51:09.697 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:51:09.698 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:51:09.698 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:51:09.698 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:51:09.698 INFO:teuthology.orchestra.run.smithi044.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T21:51:09.699 INFO:teuthology.orchestra.run.smithi044.stdout: python2.7-minimal 2024-09-20T21:51:09.699 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:51:09.700 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-09-20T21:51:09.700 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T21:51:09.700 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T21:51:09.701 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T21:51:09.703 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-09-20T21:51:09.703 INFO:teuthology.orchestra.run.smithi044.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T21:51:09.703 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-09-20T21:51:09.703 INFO:teuthology.orchestra.run.smithi044.stdout: thermald 2024-09-20T21:51:09.753 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T21:51:09.759 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-09-20T21:51:09.759 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T21:51:09.759 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T21:51:09.760 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T21:51:09.761 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-09-20T21:51:09.762 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T21:51:09.817 INFO:teuthology.orchestra.run.smithi044.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T21:51:09.817 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 113 MB of archives. 2024-09-20T21:51:09.817 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T21:51:09.817 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T21:51:10.277 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T21:51:10.374 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T21:51:10.419 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T21:51:10.572 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T21:51:10.573 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T21:51:10.573 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T21:51:10.704 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T21:51:10.727 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T21:51:10.767 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T21:51:11.133 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 113 MB in 2s (75.0 MB/s) 2024-09-20T21:51:11.207 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T21:51:11.207 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T21:51:11.207 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T21:51:11.322 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T21:51:11.334 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T21:51:11.356 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T21:51:11.832 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 113 MB in 2s (68.7 MB/s) 2024-09-20T21:51:12.000 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T21:51:12.955 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T21:51:12.955 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T21:51:12.956 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T21:51:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T21:51:13.351 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:13.425 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T21:51:13.445 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:13.507 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T21:51:13.915 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-09-20T21:51:13.993 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T21:51:13.998 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:14.111 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T21:51:16.132 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T21:51:16.153 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:16.225 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T21:51:16.230 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:16.232 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:16.367 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:16.613 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T21:51:16.635 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:16.668 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T21:51:16.689 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:16.712 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:16.718 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:17.208 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T21:51:17.229 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:17.266 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:18.652 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T21:51:18.673 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:18.750 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:19.222 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T21:51:19.242 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:19.304 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:23.468 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:23.561 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:23.570 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:23.704 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:23.912 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:24.037 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:24.040 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:24.183 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:24.343 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T21:51:24.365 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T21:51:24.409 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T21:51:24.485 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T21:51:24.508 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T21:51:24.543 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T21:51:26.332 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:26.482 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:26.856 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:27.002 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:27.455 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T21:51:27.477 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T21:51:27.513 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T21:51:30.309 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T21:51:30.346 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:30.392 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:30.408 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T21:51:30.445 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:30.482 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:33.297 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:33.320 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:33.419 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:33.762 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T21:51:33.778 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T21:51:33.866 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:33.907 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:33.992 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T21:51:34.033 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T21:51:34.121 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:34.164 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:34.939 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T21:51:34.976 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T21:51:35.039 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:35.592 INFO:teuthology.orchestra.run.smithi044.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:51:35.592 INFO:teuthology.orchestra.run.smithi044.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T21:51:35.592 INFO:teuthology.orchestra.run.smithi044.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:51:35.592 INFO:teuthology.orchestra.run.smithi044.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:35.612 INFO:teuthology.orchestra.run.smithi049.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:51:35.612 INFO:teuthology.orchestra.run.smithi049.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T21:51:35.612 INFO:teuthology.orchestra.run.smithi049.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:51:35.612 INFO:teuthology.orchestra.run.smithi049.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:36.440 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:36.515 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:37.883 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T21:51:37.933 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T21:51:37.992 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T21:51:38.058 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T21:51:38.102 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:38.161 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T21:51:38.184 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:38.317 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T21:51:38.684 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T21:51:38.831 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:38.982 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T21:51:39.111 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:39.537 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:39.595 INFO:teuthology.orchestra.run.smithi049.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T21:51:39.595 INFO:teuthology.orchestra.run.smithi049.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T21:51:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:40.479 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:51:40.479 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T21:51:40.479 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:51:40.479 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:40.662 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:42.055 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T21:51:42.615 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T21:51:43.092 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:44.518 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T21:51:44.589 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T21:51:44.589 INFO:teuthology.orchestra.run.smithi179.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:53.951 INFO:teuthology.orchestra.run.smithi049.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T21:51:53.951 INFO:teuthology.orchestra.run.smithi049.stdout:Sourcing file `/etc/default/grub' 2024-09-20T21:51:53.957 INFO:teuthology.orchestra.run.smithi049.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T21:51:53.973 INFO:teuthology.orchestra.run.smithi049.stdout:Generating grub configuration file ... 2024-09-20T21:51:54.237 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:51:54.262 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:54.390 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T21:51:54.390 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub' 2024-09-20T21:51:54.404 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T21:51:54.431 INFO:teuthology.orchestra.run.smithi044.stdout:Generating grub configuration file ... 2024-09-20T21:51:54.526 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:51:54.532 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T21:51:54.595 INFO:teuthology.orchestra.run.smithi049.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T21:51:54.600 INFO:teuthology.orchestra.run.smithi049.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T21:51:54.694 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:51:54.710 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:54.782 INFO:teuthology.orchestra.run.smithi049.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T21:51:54.782 INFO:teuthology.orchestra.run.smithi049.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T21:51:54.782 INFO:teuthology.orchestra.run.smithi049.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T21:51:54.813 INFO:teuthology.orchestra.run.smithi049.stdout:done 2024-09-20T21:51:55.004 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:51:55.010 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T21:51:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T21:51:55.088 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T21:51:55.244 INFO:teuthology.orchestra.run.smithi044.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T21:51:55.245 INFO:teuthology.orchestra.run.smithi044.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T21:51:55.245 INFO:teuthology.orchestra.run.smithi044.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T21:51:55.282 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-09-20T21:51:55.319 DEBUG:teuthology.orchestra.run.smithi049:> dpkg -s linux-image-generic 2024-09-20T21:51:55.337 INFO:teuthology.orchestra.run.smithi049.stdout:Package: linux-image-generic 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Status: install ok installed 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Priority: optional 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Section: kernel 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Installed-Size: 21 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: amd64 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Source: linux-meta 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Version: 5.15.0.122.122 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Recommends: thermald 2024-09-20T21:51:55.338 INFO:teuthology.orchestra.run.smithi049.stdout:Description: Generic Linux kernel image 2024-09-20T21:51:55.339 INFO:teuthology.orchestra.run.smithi049.stdout: This package will always depend on the latest generic kernel image 2024-09-20T21:51:55.339 INFO:teuthology.orchestra.run.smithi049.stdout: available. 2024-09-20T21:51:55.339 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T21:51:55.339 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T21:51:55.339 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T21:51:55.339 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-20T21:51:55.339 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T21:51:55.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get clean 2024-09-20T21:51:55.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-09-20T21:51:55.672 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T21:51:55.792 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T21:51:55.808 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-09-20T21:51:55.832 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-09-20T21:51:55.832 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-09-20T21:51:55.832 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-09-20T21:51:55.832 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-09-20T21:51:55.832 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 21 2024-09-20T21:51:55.832 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T21:51:55.832 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.15.0.122.122 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-09-20T21:51:55.833 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-09-20T21:51:55.833 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T21:51:55.833 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T21:51:55.834 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T21:51:55.834 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-20T21:51:55.834 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T21:51:55.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-09-20T21:51:55.876 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T21:51:55.963 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T21:51:56.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-09-20T21:51:56.217 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T21:51:56.225 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T21:51:56.243 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T21:51:56.342 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T21:51:57.151 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-09-20T21:51:57.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T21:51:57.234 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-09-20T21:51:57.449 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-09-20T21:51:57.449 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-09-20T21:51:57.647 INFO:teuthology.orchestra.run.smithi049.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T21:51:57.647 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:51:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:51:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:51:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:51:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T21:51:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T21:51:57.648 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:51:57.695 INFO:teuthology.orchestra.run.smithi049.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T21:51:57.697 DEBUG:teuthology.orchestra.run.smithi049:> dpkg -s linux-image-generic 2024-09-20T21:51:57.710 INFO:teuthology.orchestra.run.smithi049.stdout:Package: linux-image-generic 2024-09-20T21:51:57.710 INFO:teuthology.orchestra.run.smithi049.stdout:Status: install ok installed 2024-09-20T21:51:57.710 INFO:teuthology.orchestra.run.smithi049.stdout:Priority: optional 2024-09-20T21:51:57.710 INFO:teuthology.orchestra.run.smithi049.stdout:Section: kernel 2024-09-20T21:51:57.710 INFO:teuthology.orchestra.run.smithi049.stdout:Installed-Size: 21 2024-09-20T21:51:57.710 INFO:teuthology.orchestra.run.smithi049.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: amd64 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Source: linux-meta 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Version: 5.15.0.122.122 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Recommends: thermald 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout:Description: Generic Linux kernel image 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: This package will always depend on the latest generic kernel image 2024-09-20T21:51:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: available. 2024-09-20T21:51:57.711 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-09-20T21:51:57.741 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-20T21:51:57.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T21:51:57.761 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.UCyJCqXluo 2024-09-20T21:51:57.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub/grub.cfg /tmp/tmp.UCyJCqXluo 2024-09-20T21:51:57.815 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-20T21:51:57.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.UCyJCqXluo 2024-09-20T21:51:57.943 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.UCyJCqXluo is 10KB 2024-09-20T21:51:57.956 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.UCyJCqXluo 2024-09-20T21:51:57.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T21:51:58.007 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-20T21:51:58.007 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-20T21:51:58.018 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T21:51:58.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T21:51:58.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T21:51:58.097 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T21:51:58.098 DEBUG:teuthology.orchestra.run.smithi049:> sudo update-grub 2024-09-20T21:51:58.182 INFO:teuthology.orchestra.run.smithi044.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T21:51:58.182 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:51:58.182 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:51:58.182 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:51:58.182 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:51:58.183 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T21:51:58.183 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T21:51:58.183 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:51:58.225 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T21:51:58.226 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-09-20T21:51:58.285 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-09-20T21:51:58.285 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-09-20T21:51:58.285 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-09-20T21:51:58.285 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-09-20T21:51:58.285 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 21 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.15.0.122.122 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-09-20T21:51:58.286 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-09-20T21:51:58.286 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-20T21:51:58.330 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.slt0VOzfUc 2024-09-20T21:51:58.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub/grub.cfg /tmp/tmp.slt0VOzfUc 2024-09-20T21:51:58.386 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.slt0VOzfUc 2024-09-20T21:51:58.508 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.slt0VOzfUc is 10KB 2024-09-20T21:51:58.521 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.slt0VOzfUc 2024-09-20T21:51:58.526 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T21:51:58.586 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T21:51:58.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T21:51:58.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T21:51:58.665 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T21:51:58.665 DEBUG:teuthology.orchestra.run.smithi044:> sudo update-grub 2024-09-20T21:51:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T21:51:58.731 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub' 2024-09-20T21:51:58.753 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T21:51:58.777 INFO:teuthology.orchestra.run.smithi179.stdout:Generating grub configuration file ... 2024-09-20T21:51:59.119 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:51:59.140 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:59.412 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2024-09-20T21:51:59.413 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T21:51:59.415 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-09-20T21:51:59.497 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:51:59.503 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T21:51:59.574 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T21:51:59.579 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T21:51:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:51:59.605 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:51:59.743 INFO:teuthology.orchestra.run.smithi179.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T21:51:59.743 INFO:teuthology.orchestra.run.smithi179.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T21:51:59.743 INFO:teuthology.orchestra.run.smithi179.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T21:51:59.789 INFO:teuthology.orchestra.run.smithi179.stdout:done 2024-09-20T21:51:59.841 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:51:59.846 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T21:51:59.883 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T21:51:59.888 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T21:51:59.914 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-09-20T21:51:59.915 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T21:51:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-09-20T21:52:00.007 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T21:52:00.007 INFO:teuthology.orchestra.run.smithi049.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T21:52:00.007 INFO:teuthology.orchestra.run.smithi049.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T21:52:00.017 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-09-20T21:52:00.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-09-20T21:52:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:52:00.102 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:52:00.293 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-09-20T21:52:00.312 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-09-20T21:52:00.312 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-09-20T21:52:00.312 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-09-20T21:52:00.312 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-09-20T21:52:00.312 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-09-20T21:52:00.312 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T21:52:00.312 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.122.122 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-09-20T21:52:00.313 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-09-20T21:52:00.313 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T21:52:00.314 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T21:52:00.314 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T21:52:00.314 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2024-09-20T21:52:00.314 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T21:52:00.314 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-09-20T21:52:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:52:00.318 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T21:52:00.361 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T21:52:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T21:52:00.434 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-09-20T21:52:00.490 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T21:52:00.490 INFO:teuthology.orchestra.run.smithi044.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T21:52:00.491 INFO:teuthology.orchestra.run.smithi044.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T21:52:00.513 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-09-20T21:52:00.531 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-09-20T21:52:00.546 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T21:52:00.546 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T21:52:00.556 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T21:52:00.573 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T21:52:01.937 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-20T21:52:01.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T21:52:02.024 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-20T21:52:02.223 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-09-20T21:52:02.224 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-09-20T21:52:02.389 INFO:teuthology.orchestra.run.smithi179.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T21:52:02.390 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T21:52:02.390 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T21:52:02.390 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T21:52:02.390 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T21:52:02.391 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T21:52:02.391 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T21:52:02.391 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T21:52:02.428 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T21:52:02.430 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-09-20T21:52:02.442 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.122.122 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T21:52:02.443 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T21:52:02.444 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-09-20T21:52:02.444 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-09-20T21:52:02.444 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-09-20T21:52:02.444 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-09-20T21:52:02.444 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-20T21:52:02.487 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.mAGXeYpa8i 2024-09-20T21:52:02.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mAGXeYpa8i 2024-09-20T21:52:02.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.mAGXeYpa8i 2024-09-20T21:52:02.660 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.mAGXeYpa8i is 10KB 2024-09-20T21:52:02.672 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.mAGXeYpa8i 2024-09-20T21:52:02.678 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T21:52:02.731 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T21:52:02.731 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T21:52:02.731 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T21:52:02.821 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T21:52:02.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo update-grub 2024-09-20T21:52:04.308 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub' 2024-09-20T21:52:04.309 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T21:52:04.313 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-09-20T21:52:04.513 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T21:52:04.519 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T21:52:04.799 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T21:52:04.804 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T21:52:04.845 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T21:52:04.850 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T21:52:05.004 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T21:52:05.004 INFO:teuthology.orchestra.run.smithi179.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T21:52:05.005 INFO:teuthology.orchestra.run.smithi179.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T21:52:05.026 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-09-20T21:52:05.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-09-20T21:52:30.059 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-20T21:52:30.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T21:52:30.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:52:30.534 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-20T21:52:30.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-20T21:52:30.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:52:35.042 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2024-09-20T21:52:35.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-20T21:52:35.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:52:48.623 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-20T21:52:48.879 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-09-20T21:52:50.535 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-20T21:52:54.607 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-20T21:52:57.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T21:52:57.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:52:57.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-20T21:52:57.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:53:00.686 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-20T21:53:00.943 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-09-20T21:53:01.684 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-20T21:53:12.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T21:53:12.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:53:12.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-20T21:53:12.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:53:15.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-20T21:53:27.149 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-20T21:53:30.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T21:53:30.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:53:33.843 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-20T21:53:40.219 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-20T21:53:51.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T21:53:51.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:53:56.269 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:MeTJxDeYyFnQC6ZYWA+SnFkSQkrEM7D97Ph5kCDypBs), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPW3nBoK7pHdzsxGv/tMbMbqfbm4i8g/Sdshrq/bxsTj', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-20T21:54:12.946 DEBUG:teuthology.orchestra.remote:timed out 2024-09-20T21:54:15.294 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:MeTJxDeYyFnQC6ZYWA+SnFkSQkrEM7D97Ph5kCDypBs), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPW3nBoK7pHdzsxGv/tMbMbqfbm4i8g/Sdshrq/bxsTj', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-20T21:54:27.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-20T21:54:27.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:54:28.183 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-20T21:54:28.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-20T21:54:28.777 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-122-generic"... 2024-09-20T21:54:28.777 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-20T21:54:28.824 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-122-generic 2024-09-20T21:54:28.824 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T21:54:28.824 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T21:54:28.824 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T21:54:29.825 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-20T21:54:29.825 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T21:54:29.907 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-09-20T21:54:29.961 DEBUG:teuthology.parallel:result is None 2024-09-20T21:54:37.318 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:MeTJxDeYyFnQC6ZYWA+SnFkSQkrEM7D97Ph5kCDypBs), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPW3nBoK7pHdzsxGv/tMbMbqfbm4i8g/Sdshrq/bxsTj', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-20T21:54:51.847 DEBUG:teuthology.orchestra.remote:timed out 2024-09-20T21:55:02.342 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:MeTJxDeYyFnQC6ZYWA+SnFkSQkrEM7D97Ph5kCDypBs), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPW3nBoK7pHdzsxGv/tMbMbqfbm4i8g/Sdshrq/bxsTj', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-20T21:55:12.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T21:55:12.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:55:12.981 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-20T21:55:13.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T21:55:13.519 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.15.0-122-generic"... 2024-09-20T21:55:13.519 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-20T21:55:13.567 INFO:teuthology.orchestra.run.smithi049.stdout:5.15.0-122-generic 2024-09-20T21:55:13.568 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T21:55:13.568 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T21:55:13.568 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T21:55:14.569 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-20T21:55:14.569 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T21:55:14.631 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2024-09-20T21:55:14.661 DEBUG:teuthology.parallel:result is None 2024-09-20T21:55:30.367 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:MeTJxDeYyFnQC6ZYWA+SnFkSQkrEM7D97Ph5kCDypBs), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPW3nBoK7pHdzsxGv/tMbMbqfbm4i8g/Sdshrq/bxsTj', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-20T21:55:30.368 DEBUG:teuthology.orchestra.remote:'connect to smithi179.front.sepia.ceph.com' reached maximum tries (10) after waiting for 145 seconds 2024-09-20T21:55:39.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-20T21:55:39.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T21:55:39.630 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-20T21:55:40.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-20T21:55:40.228 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.15.0-122-generic"... 2024-09-20T21:55:40.228 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-20T21:55:40.275 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-122-generic 2024-09-20T21:55:40.275 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T21:55:40.275 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T21:55:40.275 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T21:55:41.276 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2024-09-20T21:55:41.276 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T21:55:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-09-20T21:55:41.684 DEBUG:teuthology.parallel:result is None 2024-09-20T21:55:41.684 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-20T21:55:41.699 INFO:teuthology.task.internal:Creating test directory... 2024-09-20T21:55:41.700 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T21:55:41.702 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T21:55:41.705 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T21:55:41.711 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-20T21:55:41.729 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-20T21:55:41.759 INFO:teuthology.task.internal:Creating archive directory... 2024-09-20T21:55:41.759 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T21:55:41.761 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T21:55:41.764 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T21:55:41.795 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-20T21:55:41.804 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-20T21:55:41.804 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T21:55:41.816 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T21:55:41.824 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T21:55:41.837 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T21:55:41.845 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T21:55:41.846 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T21:55:41.856 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T21:55:41.862 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T21:55:41.870 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T21:55:41.872 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-20T21:55:41.880 INFO:teuthology.task.internal:Configuring sudo... 2024-09-20T21:55:41.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T21:55:41.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T21:55:41.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T21:55:41.925 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-20T21:55:41.934 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-20T21:55:41.934 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T21:55:41.948 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T21:55:41.956 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T21:55:41.974 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T21:55:41.999 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T21:55:42.047 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T21:55:42.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T21:55:42.109 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T21:55:42.115 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T21:55:42.164 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T21:55:42.164 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T21:55:42.227 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T21:55:42.232 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T21:55:42.278 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T21:55:42.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T21:55:42.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-20T21:55:42.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-09-20T21:55:42.352 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-09-20T21:55:42.419 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-20T21:55:42.426 INFO:teuthology.task.internal:Starting timer... 2024-09-20T21:55:42.426 INFO:teuthology.run_tasks:Running task pcp... 2024-09-20T21:55:42.480 INFO:teuthology.run_tasks:Running task selinux... 2024-09-20T21:55:42.490 DEBUG:teuthology.task.selinux:Excluding smithi044: OS 'ubuntu' does not support SELinux 2024-09-20T21:55:42.490 DEBUG:teuthology.task.selinux:Excluding smithi049: OS 'ubuntu' does not support SELinux 2024-09-20T21:55:42.490 DEBUG:teuthology.task.selinux:Excluding smithi179: OS 'ubuntu' does not support SELinux 2024-09-20T21:55:42.490 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-20T21:55:42.490 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-20T21:55:42.490 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-20T21:55:42.490 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-20T21:55:42.500 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-20T21:55:42.503 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-20T21:55:42.602 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-20T21:55:42.612 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-20T21:55:42.612 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi049.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-20T22:03:16.603 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-09-20T22:03:16.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-20T22:03:16.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T22:03:16.691 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-20T22:03:16.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-20T22:03:16.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T22:03:16.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T22:03:16.856 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-20T22:03:16.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-20T22:03:16.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-20T22:03:16.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T22:03:17.008 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-20T22:03:17.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-20T22:03:17.083 INFO:teuthology.run_tasks:Running task clock... 2024-09-20T22:03:17.093 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-20T22:03:17.093 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T22:03:17.094 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T22:03:17.097 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T22:03:17.097 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T22:03:17.100 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T22:03:17.100 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T22:03:17.124 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T22:03:17.124 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Command line: ntpd -gq 2024-09-20T22:03:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: ---------------------------------------------------- 2024-09-20T22:03:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T22:03:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T22:03:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: corporation. Support and training for ntp-4 are 2024-09-20T22:03:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: available at https://www.nwtime.org/support 2024-09-20T22:03:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: ---------------------------------------------------- 2024-09-20T22:03:17.125 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: proto: precision = 0.046 usec (-24) 2024-09-20T22:03:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: basedate set to 2022-02-04 2024-09-20T22:03:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: gps base set to 2022-02-06 (week 2196) 2024-09-20T22:03:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T22:03:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T22:03:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T22:03:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T22:03:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T22:03:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T22:03:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T22:03:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Listen normally on 3 ens1f0 172.21.15.44:123 2024-09-20T22:03:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Listen normally on 4 lo [::1]:123 2024-09-20T22:03:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1572%4]:123 2024-09-20T22:03:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:17 ntpd[18365]: Listening on routing socket on fd #22 for interface updates 2024-09-20T22:03:17.132 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T22:03:17.133 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Command line: ntpd -gq 2024-09-20T22:03:17.133 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: ---------------------------------------------------- 2024-09-20T22:03:17.133 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T22:03:17.133 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T22:03:17.133 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: corporation. Support and training for ntp-4 are 2024-09-20T22:03:17.133 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: available at https://www.nwtime.org/support 2024-09-20T22:03:17.133 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: ---------------------------------------------------- 2024-09-20T22:03:17.134 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: proto: precision = 0.047 usec (-24) 2024-09-20T22:03:17.134 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: basedate set to 2022-02-04 2024-09-20T22:03:17.134 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: gps base set to 2022-02-06 (week 2196) 2024-09-20T22:03:17.134 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T22:03:17.134 INFO:teuthology.orchestra.run.smithi049.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T22:03:17.134 INFO:teuthology.orchestra.run.smithi049.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T22:03:17.135 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T22:03:17.135 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T22:03:17.136 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T22:03:17.136 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T22:03:17.136 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Listen normally on 3 ens1f0 172.21.15.49:123 2024-09-20T22:03:17.136 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Listen normally on 4 lo [::1]:123 2024-09-20T22:03:17.136 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1566%4]:123 2024-09-20T22:03:17.136 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:17 ntpd[18452]: Listening on routing socket on fd #22 for interface updates 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Command line: ntpd -gq 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: ---------------------------------------------------- 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: corporation. Support and training for ntp-4 are 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: available at https://www.nwtime.org/support 2024-09-20T22:03:17.156 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: ---------------------------------------------------- 2024-09-20T22:03:17.157 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: proto: precision = 0.046 usec (-24) 2024-09-20T22:03:17.157 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: basedate set to 2022-02-04 2024-09-20T22:03:17.157 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: gps base set to 2022-02-06 (week 2196) 2024-09-20T22:03:17.157 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T22:03:17.157 INFO:teuthology.orchestra.run.smithi179.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T22:03:17.158 INFO:teuthology.orchestra.run.smithi179.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T22:03:17.158 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T22:03:17.159 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T22:03:17.159 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T22:03:17.159 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T22:03:17.159 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Listen normally on 3 enp3s0f1 172.21.15.179:123 2024-09-20T22:03:17.159 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Listen normally on 4 lo [::1]:123 2024-09-20T22:03:17.159 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:725b%5]:123 2024-09-20T22:03:17.159 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:17 ntpd[18475]: Listening on routing socket on fd #22 for interface updates 2024-09-20T22:03:18.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:18 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:18 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:18 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:18 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:18 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:18 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:18.156 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:18 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:18.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:18 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:18.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:18 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:18.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:18 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:18.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:18 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:18.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:18 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:19 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:19 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:19 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:19.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:19 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:19.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:19 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:19.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:19 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:19 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:19 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:19 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:19 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:19 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:19 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:19.156 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:19 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:19.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:19 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:19.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:19 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:19.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:19 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:19.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:19 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:19.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:19 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:20 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:20 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:20.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:20 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:20.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:20 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:20.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:20 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:20.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:20 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:20.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:20 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:20.156 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:20 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:20.156 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:20 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:20.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:20 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:20.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:20 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:20.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:20 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:20.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:20 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:21.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:21 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:21 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:21 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:21 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:21 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:21 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:21.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:21 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:21 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:21 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:21 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:21 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:21.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:21 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:21.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:21.158 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:21 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:22.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:22.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:22.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:22 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:22.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:22 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:22.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:22 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:23 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:23 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:23 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:23 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:23 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:23.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:23 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:23.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:23 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:23 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:23 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:23 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:23 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:23.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:23 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:23.158 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:23 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:24.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:24 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:24.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.133 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:24.134 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:24.134 INFO:teuthology.orchestra.run.smithi049.stdout:20 Sep 22:03:24 ntpd[18452]: ntpd: time slew -0.001425 s 2024-09-20T22:03:24.134 INFO:teuthology.orchestra.run.smithi049.stdout:ntpd: time slew -0.001425s 2024-09-20T22:03:24.135 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T22:03:24.135 INFO:teuthology.orchestra.run.smithi049.stderr:20 Sep 22:03:24 ntpd[18452]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T22:03:24.156 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.156 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:24.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:24.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:24.157 INFO:teuthology.orchestra.run.smithi179.stdout:20 Sep 22:03:24 ntpd[18475]: ntpd: time slew -0.001781 s 2024-09-20T22:03:24.157 INFO:teuthology.orchestra.run.smithi179.stdout:ntpd: time slew -0.001781s 2024-09-20T22:03:24.157 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:24.158 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T22:03:24.158 INFO:teuthology.orchestra.run.smithi179.stderr:20 Sep 22:03:24 ntpd[18475]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T22:03:24.180 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T22:03:24.180 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2024-09-20T22:03:24.180 INFO:teuthology.orchestra.run.smithi049.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:24.180 INFO:teuthology.orchestra.run.smithi049.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:24.180 INFO:teuthology.orchestra.run.smithi049.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:24.180 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T22:03:24.210 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2024-09-20T22:03:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:25.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:25.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:25.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T22:03:25.125 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T22:03:25.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T22:03:25.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T22:03:25.126 INFO:teuthology.orchestra.run.smithi044.stdout:20 Sep 22:03:25 ntpd[18365]: ntpd: time slew -0.002216 s 2024-09-20T22:03:25.126 INFO:teuthology.orchestra.run.smithi044.stdout:ntpd: time slew -0.002216s 2024-09-20T22:03:25.126 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T22:03:25.127 INFO:teuthology.orchestra.run.smithi044.stderr:20 Sep 22:03:25 ntpd[18365]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T22:03:25.171 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T22:03:25.171 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-09-20T22:03:25.171 INFO:teuthology.orchestra.run.smithi044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:25.171 INFO:teuthology.orchestra.run.smithi044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:25.171 INFO:teuthology.orchestra.run.smithi044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:25.171 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T22:03:25.172 INFO:teuthology.run_tasks:Running task install... 2024-09-20T22:03:25.196 DEBUG:teuthology.task.install:project ceph 2024-09-20T22:03:25.197 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}} 2024-09-20T22:03:25.197 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-20T22:03:25.197 INFO:teuthology.task.install:Using flavor: default 2024-09-20T22:03:25.202 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-20T22:03:25.202 INFO:teuthology.task.install:extra packages: [] 2024-09-20T22:03:25.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-key list | grep Ceph 2024-09-20T22:03:25.203 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-key list | grep Ceph 2024-09-20T22:03:25.204 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-key list | grep Ceph 2024-09-20T22:03:25.265 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T22:03:25.271 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T22:03:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T22:03:25.293 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T22:03:25.293 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T22:03:25.294 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T22:03:25.294 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:03:25.302 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T22:03:25.302 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T22:03:25.303 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T22:03:25.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:03:25.307 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T22:03:25.307 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T22:03:25.308 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T22:03:25.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:03:25.433 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T22:03:25.434 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:03:25.447 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T22:03:25.447 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:03:25.450 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T22:03:25.450 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:03:25.543 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:03:25.543 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T22:03:25.555 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:03:25.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T22:03:25.557 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-09-20T22:03:25.561 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:03:25.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T22:03:25.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-09-20T22:03:25.575 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-09-20T22:03:25.725 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T22:03:25.750 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T22:03:25.758 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T22:03:25.776 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T22:03:25.787 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T22:03:25.797 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T22:03:25.800 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T22:03:25.808 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T22:03:25.818 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T22:03:25.821 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T22:03:25.830 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T22:03:25.841 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T22:03:25.843 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T22:03:25.844 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T22:03:25.851 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T22:03:25.863 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T22:03:25.870 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T22:03:25.871 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T22:03:25.871 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T22:03:25.872 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T22:03:25.879 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T22:03:25.891 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T22:03:25.902 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T22:03:25.926 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T22:03:25.944 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T22:03:26.008 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T22:03:26.026 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T22:03:26.136 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 28.3 kB in 0s (76.3 kB/s) 2024-09-20T22:03:26.150 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 28.3 kB in 0s (68.5 kB/s) 2024-09-20T22:03:26.277 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 28.3 kB in 1s (55.0 kB/s) 2024-09-20T22:03:27.140 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-20T22:03:27.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:03:27.210 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-20T22:03:27.231 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-20T22:03:27.246 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:03:27.311 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-20T22:03:27.339 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-09-20T22:03:27.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:03:27.397 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-09-20T22:03:27.398 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-09-20T22:03:27.424 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-09-20T22:03:27.527 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-20T22:03:27.527 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-20T22:03:27.586 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T22:03:27.586 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T22:03:27.586 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T22:03:27.587 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T22:03:27.587 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T22:03:27.587 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T22:03:27.587 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T22:03:27.588 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-09-20T22:03:27.588 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T22:03:27.589 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T22:03:27.589 INFO:teuthology.orchestra.run.smithi179.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T22:03:27.589 INFO:teuthology.orchestra.run.smithi179.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T22:03:27.589 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T22:03:27.589 INFO:teuthology.orchestra.run.smithi179.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T22:03:27.589 INFO:teuthology.orchestra.run.smithi179.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T22:03:27.590 INFO:teuthology.orchestra.run.smithi179.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet zip 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T22:03:27.591 INFO:teuthology.orchestra.run.smithi179.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T22:03:27.592 INFO:teuthology.orchestra.run.smithi179.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T22:03:27.592 INFO:teuthology.orchestra.run.smithi179.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T22:03:27.592 INFO:teuthology.orchestra.run.smithi179.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T22:03:27.592 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-09-20T22:03:27.592 INFO:teuthology.orchestra.run.smithi179.stdout: btrfs-tools 2024-09-20T22:03:27.638 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-09-20T22:03:27.639 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-09-20T22:03:27.694 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-09-20T22:03:27.694 INFO:teuthology.orchestra.run.smithi179.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T22:03:27.694 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T22:03:27.694 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T22:03:27.696 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T22:03:27.697 INFO:teuthology.orchestra.run.smithi179.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T22:03:27.747 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T22:03:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T22:03:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T22:03:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T22:03:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T22:03:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T22:03:27.748 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T22:03:27.748 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-09-20T22:03:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T22:03:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T22:03:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T22:03:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T22:03:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T22:03:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet zip 2024-09-20T22:03:27.753 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T22:03:27.753 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 181 MB of archives. 2024-09-20T22:03:27.753 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T22:03:27.753 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T22:03:27.753 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-09-20T22:03:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: btrfs-tools 2024-09-20T22:03:27.837 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T22:03:27.840 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T22:03:27.842 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T22:03:27.857 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T22:03:27.857 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T22:03:27.857 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T22:03:27.857 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T22:03:27.858 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T22:03:27.858 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T22:03:27.858 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T22:03:27.859 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-09-20T22:03:27.859 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T22:03:27.859 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T22:03:27.861 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T22:03:27.862 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T22:03:27.863 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T22:03:27.863 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet zip 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2024-09-20T22:03:27.864 INFO:teuthology.orchestra.run.smithi049.stdout: btrfs-tools 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T22:03:27.866 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T22:03:27.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T22:03:27.868 INFO:teuthology.orchestra.run.smithi044.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T22:03:27.917 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T22:03:27.922 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T22:03:27.922 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T22:03:27.923 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 181 MB of archives. 2024-09-20T22:03:27.923 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T22:03:27.923 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T22:03:27.934 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T22:03:27.938 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T22:03:27.939 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T22:03:27.940 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T22:03:27.948 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T22:03:27.950 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T22:03:27.953 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T22:03:27.954 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T22:03:27.955 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T22:03:27.957 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T22:03:27.970 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-09-20T22:03:27.970 INFO:teuthology.orchestra.run.smithi049.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T22:03:27.970 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T22:03:27.972 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T22:03:27.972 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T22:03:27.972 INFO:teuthology.orchestra.run.smithi049.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T22:03:27.972 INFO:teuthology.orchestra.run.smithi049.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T22:03:27.973 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T22:03:27.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T22:03:27.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T22:03:27.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T22:03:27.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T22:03:27.974 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T22:03:27.974 INFO:teuthology.orchestra.run.smithi049.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T22:03:27.975 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T22:03:27.975 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T22:03:27.975 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T22:03:27.975 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T22:03:27.976 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T22:03:27.976 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T22:03:27.976 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T22:03:27.977 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T22:03:27.988 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T22:03:27.989 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T22:03:28.006 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T22:03:28.008 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T22:03:28.009 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T22:03:28.010 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T22:03:28.010 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T22:03:28.010 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T22:03:28.011 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T22:03:28.011 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T22:03:28.011 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T22:03:28.012 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T22:03:28.012 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T22:03:28.022 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T22:03:28.023 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T22:03:28.025 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T22:03:28.029 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T22:03:28.031 INFO:teuthology.orchestra.run.smithi049.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T22:03:28.031 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 181 MB of archives. 2024-09-20T22:03:28.031 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T22:03:28.032 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T22:03:28.039 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T22:03:28.045 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T22:03:28.045 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T22:03:28.045 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T22:03:28.046 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T22:03:28.047 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T22:03:28.049 INFO:teuthology.orchestra.run.smithi179.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T22:03:28.050 INFO:teuthology.orchestra.run.smithi179.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T22:03:28.056 INFO:teuthology.orchestra.run.smithi179.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T22:03:28.057 INFO:teuthology.orchestra.run.smithi179.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T22:03:28.071 INFO:teuthology.orchestra.run.smithi179.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T22:03:28.073 INFO:teuthology.orchestra.run.smithi179.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T22:03:28.073 INFO:teuthology.orchestra.run.smithi179.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T22:03:28.074 INFO:teuthology.orchestra.run.smithi179.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T22:03:28.077 INFO:teuthology.orchestra.run.smithi179.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T22:03:28.083 INFO:teuthology.orchestra.run.smithi179.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T22:03:28.087 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T22:03:28.088 INFO:teuthology.orchestra.run.smithi179.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T22:03:28.089 INFO:teuthology.orchestra.run.smithi179.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T22:03:28.092 INFO:teuthology.orchestra.run.smithi179.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T22:03:28.092 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T22:03:28.093 INFO:teuthology.orchestra.run.smithi179.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T22:03:28.099 INFO:teuthology.orchestra.run.smithi179.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T22:03:28.105 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T22:03:28.109 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T22:03:28.110 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T22:03:28.111 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T22:03:28.120 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T22:03:28.120 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T22:03:28.122 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T22:03:28.123 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T22:03:28.125 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T22:03:28.126 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T22:03:28.126 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T22:03:28.128 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T22:03:28.129 INFO:teuthology.orchestra.run.smithi179.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T22:03:28.130 INFO:teuthology.orchestra.run.smithi179.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T22:03:28.132 INFO:teuthology.orchestra.run.smithi179.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T22:03:28.132 INFO:teuthology.orchestra.run.smithi179.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T22:03:28.133 INFO:teuthology.orchestra.run.smithi179.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T22:03:28.140 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T22:03:28.143 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T22:03:28.145 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T22:03:28.145 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T22:03:28.146 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T22:03:28.147 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T22:03:28.150 INFO:teuthology.orchestra.run.smithi179.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T22:03:28.152 INFO:teuthology.orchestra.run.smithi179.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T22:03:28.152 INFO:teuthology.orchestra.run.smithi179.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T22:03:28.160 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T22:03:28.160 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T22:03:28.160 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T22:03:28.161 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T22:03:28.161 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T22:03:28.166 INFO:teuthology.orchestra.run.smithi179.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T22:03:28.166 INFO:teuthology.orchestra.run.smithi179.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T22:03:28.167 INFO:teuthology.orchestra.run.smithi179.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T22:03:28.167 INFO:teuthology.orchestra.run.smithi179.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T22:03:28.168 INFO:teuthology.orchestra.run.smithi179.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T22:03:28.168 INFO:teuthology.orchestra.run.smithi179.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T22:03:28.177 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T22:03:28.179 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T22:03:28.180 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T22:03:28.180 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T22:03:28.181 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T22:03:28.181 INFO:teuthology.orchestra.run.smithi179.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T22:03:28.182 INFO:teuthology.orchestra.run.smithi179.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T22:03:28.185 INFO:teuthology.orchestra.run.smithi179.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T22:03:28.193 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T22:03:28.194 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T22:03:28.194 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T22:03:28.195 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T22:03:28.196 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T22:03:28.198 INFO:teuthology.orchestra.run.smithi179.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T22:03:28.199 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T22:03:28.199 INFO:teuthology.orchestra.run.smithi179.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T22:03:28.199 INFO:teuthology.orchestra.run.smithi179.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T22:03:28.202 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T22:03:28.203 INFO:teuthology.orchestra.run.smithi179.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T22:03:28.203 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T22:03:28.205 INFO:teuthology.orchestra.run.smithi179.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T22:03:28.205 INFO:teuthology.orchestra.run.smithi179.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T22:03:28.206 INFO:teuthology.orchestra.run.smithi179.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T22:03:28.210 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T22:03:28.214 INFO:teuthology.orchestra.run.smithi179.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T22:03:28.215 INFO:teuthology.orchestra.run.smithi179.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T22:03:28.216 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T22:03:28.216 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T22:03:28.216 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T22:03:28.217 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T22:03:28.217 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T22:03:28.218 INFO:teuthology.orchestra.run.smithi179.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T22:03:28.218 INFO:teuthology.orchestra.run.smithi179.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T22:03:28.219 INFO:teuthology.orchestra.run.smithi179.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T22:03:28.221 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T22:03:28.221 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T22:03:28.222 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T22:03:28.226 INFO:teuthology.orchestra.run.smithi179.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T22:03:28.227 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T22:03:28.229 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T22:03:28.230 INFO:teuthology.orchestra.run.smithi044.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T22:03:28.231 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T22:03:28.231 INFO:teuthology.orchestra.run.smithi179.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T22:03:28.232 INFO:teuthology.orchestra.run.smithi044.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T22:03:28.232 INFO:teuthology.orchestra.run.smithi179.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T22:03:28.232 INFO:teuthology.orchestra.run.smithi179.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T22:03:28.233 INFO:teuthology.orchestra.run.smithi044.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T22:03:28.233 INFO:teuthology.orchestra.run.smithi179.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T22:03:28.234 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T22:03:28.234 INFO:teuthology.orchestra.run.smithi179.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T22:03:28.236 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T22:03:28.237 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T22:03:28.238 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T22:03:28.240 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T22:03:28.240 INFO:teuthology.orchestra.run.smithi179.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T22:03:28.241 INFO:teuthology.orchestra.run.smithi179.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T22:03:28.244 INFO:teuthology.orchestra.run.smithi044.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T22:03:28.245 INFO:teuthology.orchestra.run.smithi044.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T22:03:28.246 INFO:teuthology.orchestra.run.smithi044.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T22:03:28.248 INFO:teuthology.orchestra.run.smithi179.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T22:03:28.248 INFO:teuthology.orchestra.run.smithi044.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T22:03:28.250 INFO:teuthology.orchestra.run.smithi179.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T22:03:28.250 INFO:teuthology.orchestra.run.smithi179.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T22:03:28.255 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T22:03:28.256 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T22:03:28.257 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T22:03:28.257 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T22:03:28.259 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T22:03:28.259 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T22:03:28.272 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T22:03:28.272 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T22:03:28.273 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T22:03:28.273 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T22:03:28.289 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T22:03:28.292 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T22:03:28.292 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T22:03:28.293 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T22:03:28.293 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T22:03:28.294 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T22:03:28.301 INFO:teuthology.orchestra.run.smithi044.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T22:03:28.302 INFO:teuthology.orchestra.run.smithi044.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T22:03:28.303 INFO:teuthology.orchestra.run.smithi044.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T22:03:28.303 INFO:teuthology.orchestra.run.smithi044.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T22:03:28.304 INFO:teuthology.orchestra.run.smithi044.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T22:03:28.306 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T22:03:28.307 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T22:03:28.308 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T22:03:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T22:03:28.323 INFO:teuthology.orchestra.run.smithi044.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T22:03:28.324 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T22:03:28.324 INFO:teuthology.orchestra.run.smithi044.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T22:03:28.325 INFO:teuthology.orchestra.run.smithi044.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T22:03:28.329 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T22:03:28.329 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T22:03:28.329 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T22:03:28.330 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T22:03:28.331 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T22:03:28.339 INFO:teuthology.orchestra.run.smithi044.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T22:03:28.339 INFO:teuthology.orchestra.run.smithi044.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T22:03:28.340 INFO:teuthology.orchestra.run.smithi044.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T22:03:28.340 INFO:teuthology.orchestra.run.smithi044.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T22:03:28.341 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T22:03:28.341 INFO:teuthology.orchestra.run.smithi044.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T22:03:28.341 INFO:teuthology.orchestra.run.smithi044.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T22:03:28.342 INFO:teuthology.orchestra.run.smithi049.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T22:03:28.343 INFO:teuthology.orchestra.run.smithi049.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T22:03:28.344 INFO:teuthology.orchestra.run.smithi049.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T22:03:28.354 INFO:teuthology.orchestra.run.smithi044.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T22:03:28.355 INFO:teuthology.orchestra.run.smithi044.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T22:03:28.358 INFO:teuthology.orchestra.run.smithi049.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T22:03:28.358 INFO:teuthology.orchestra.run.smithi044.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T22:03:28.358 INFO:teuthology.orchestra.run.smithi049.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T22:03:28.359 INFO:teuthology.orchestra.run.smithi049.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T22:03:28.361 INFO:teuthology.orchestra.run.smithi049.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T22:03:28.371 INFO:teuthology.orchestra.run.smithi044.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T22:03:28.372 INFO:teuthology.orchestra.run.smithi044.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T22:03:28.372 INFO:teuthology.orchestra.run.smithi044.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T22:03:28.376 INFO:teuthology.orchestra.run.smithi044.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T22:03:28.378 INFO:teuthology.orchestra.run.smithi044.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T22:03:28.379 INFO:teuthology.orchestra.run.smithi044.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T22:03:28.379 INFO:teuthology.orchestra.run.smithi044.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T22:03:28.387 INFO:teuthology.orchestra.run.smithi044.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T22:03:28.388 INFO:teuthology.orchestra.run.smithi044.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T22:03:28.391 INFO:teuthology.orchestra.run.smithi044.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T22:03:28.404 INFO:teuthology.orchestra.run.smithi044.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T22:03:28.405 INFO:teuthology.orchestra.run.smithi044.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T22:03:28.405 INFO:teuthology.orchestra.run.smithi044.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T22:03:28.406 INFO:teuthology.orchestra.run.smithi044.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T22:03:28.407 INFO:teuthology.orchestra.run.smithi044.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T22:03:28.413 INFO:teuthology.orchestra.run.smithi044.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T22:03:28.413 INFO:teuthology.orchestra.run.smithi044.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T22:03:28.414 INFO:teuthology.orchestra.run.smithi049.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T22:03:28.415 INFO:teuthology.orchestra.run.smithi049.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T22:03:28.417 INFO:teuthology.orchestra.run.smithi049.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T22:03:28.417 INFO:teuthology.orchestra.run.smithi049.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T22:03:28.418 INFO:teuthology.orchestra.run.smithi049.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T22:03:28.421 INFO:teuthology.orchestra.run.smithi044.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T22:03:28.423 INFO:teuthology.orchestra.run.smithi044.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T22:03:28.423 INFO:teuthology.orchestra.run.smithi044.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T22:03:28.436 INFO:teuthology.orchestra.run.smithi049.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T22:03:28.438 INFO:teuthology.orchestra.run.smithi049.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T22:03:28.438 INFO:teuthology.orchestra.run.smithi049.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T22:03:28.452 INFO:teuthology.orchestra.run.smithi049.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T22:03:28.452 INFO:teuthology.orchestra.run.smithi049.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T22:03:28.453 INFO:teuthology.orchestra.run.smithi049.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T22:03:28.453 INFO:teuthology.orchestra.run.smithi049.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T22:03:28.454 INFO:teuthology.orchestra.run.smithi049.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T22:03:28.454 INFO:teuthology.orchestra.run.smithi049.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T22:03:28.468 INFO:teuthology.orchestra.run.smithi049.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T22:03:28.469 INFO:teuthology.orchestra.run.smithi049.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T22:03:28.472 INFO:teuthology.orchestra.run.smithi049.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T22:03:28.486 INFO:teuthology.orchestra.run.smithi049.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T22:03:28.487 INFO:teuthology.orchestra.run.smithi049.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T22:03:28.488 INFO:teuthology.orchestra.run.smithi049.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T22:03:28.490 INFO:teuthology.orchestra.run.smithi049.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T22:03:28.493 INFO:teuthology.orchestra.run.smithi049.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T22:03:28.493 INFO:teuthology.orchestra.run.smithi049.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T22:03:28.494 INFO:teuthology.orchestra.run.smithi049.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T22:03:28.503 INFO:teuthology.orchestra.run.smithi049.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T22:03:28.503 INFO:teuthology.orchestra.run.smithi049.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T22:03:28.506 INFO:teuthology.orchestra.run.smithi049.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T22:03:28.520 INFO:teuthology.orchestra.run.smithi049.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T22:03:28.521 INFO:teuthology.orchestra.run.smithi049.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T22:03:28.521 INFO:teuthology.orchestra.run.smithi049.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T22:03:28.522 INFO:teuthology.orchestra.run.smithi049.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T22:03:28.523 INFO:teuthology.orchestra.run.smithi049.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T22:03:28.529 INFO:teuthology.orchestra.run.smithi049.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T22:03:28.529 INFO:teuthology.orchestra.run.smithi049.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T22:03:28.537 INFO:teuthology.orchestra.run.smithi049.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T22:03:28.539 INFO:teuthology.orchestra.run.smithi049.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T22:03:28.539 INFO:teuthology.orchestra.run.smithi049.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T22:03:28.756 INFO:teuthology.orchestra.run.smithi179.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T22:03:28.814 INFO:teuthology.orchestra.run.smithi179.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T22:03:28.816 INFO:teuthology.orchestra.run.smithi179.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T22:03:28.818 INFO:teuthology.orchestra.run.smithi179.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T22:03:28.832 INFO:teuthology.orchestra.run.smithi179.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T22:03:28.947 INFO:teuthology.orchestra.run.smithi179.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T22:03:29.208 INFO:teuthology.orchestra.run.smithi044.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T22:03:29.418 INFO:teuthology.orchestra.run.smithi049.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T22:03:29.477 INFO:teuthology.orchestra.run.smithi179.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T22:03:29.518 INFO:teuthology.orchestra.run.smithi179.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T22:03:29.535 INFO:teuthology.orchestra.run.smithi179.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T22:03:29.540 INFO:teuthology.orchestra.run.smithi044.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T22:03:29.577 INFO:teuthology.orchestra.run.smithi179.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T22:03:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T22:03:29.587 INFO:teuthology.orchestra.run.smithi179.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T22:03:29.589 INFO:teuthology.orchestra.run.smithi179.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T22:03:29.611 INFO:teuthology.orchestra.run.smithi179.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T22:03:29.619 INFO:teuthology.orchestra.run.smithi044.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T22:03:29.620 INFO:teuthology.orchestra.run.smithi044.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T22:03:29.626 INFO:teuthology.orchestra.run.smithi044.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T22:03:29.638 INFO:teuthology.orchestra.run.smithi044.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T22:03:29.664 INFO:teuthology.orchestra.run.smithi049.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T22:03:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T22:03:29.792 INFO:teuthology.orchestra.run.smithi049.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T22:03:29.801 INFO:teuthology.orchestra.run.smithi179.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T22:03:29.801 INFO:teuthology.orchestra.run.smithi179.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T22:03:29.856 INFO:teuthology.orchestra.run.smithi049.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T22:03:29.857 INFO:teuthology.orchestra.run.smithi049.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T22:03:29.862 INFO:teuthology.orchestra.run.smithi049.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T22:03:29.864 INFO:teuthology.orchestra.run.smithi049.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T22:03:29.927 INFO:teuthology.orchestra.run.smithi049.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T22:03:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T22:03:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T22:03:30.476 INFO:teuthology.orchestra.run.smithi044.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T22:03:30.676 INFO:teuthology.orchestra.run.smithi049.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T22:03:30.734 INFO:teuthology.orchestra.run.smithi049.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T22:03:30.826 INFO:teuthology.orchestra.run.smithi049.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T22:03:31.320 INFO:teuthology.orchestra.run.smithi179.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T22:03:31.323 INFO:teuthology.orchestra.run.smithi179.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T22:03:31.324 INFO:teuthology.orchestra.run.smithi179.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T22:03:31.643 INFO:teuthology.orchestra.run.smithi179.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T22:03:31.967 INFO:teuthology.orchestra.run.smithi044.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T22:03:32.082 INFO:teuthology.orchestra.run.smithi044.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T22:03:32.087 INFO:teuthology.orchestra.run.smithi044.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T22:03:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T22:03:32.129 INFO:teuthology.orchestra.run.smithi044.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T22:03:32.134 INFO:teuthology.orchestra.run.smithi049.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T22:03:32.223 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 181 MB in 4s (46.0 MB/s) 2024-09-20T22:03:32.271 INFO:teuthology.orchestra.run.smithi049.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T22:03:32.277 INFO:teuthology.orchestra.run.smithi049.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T22:03:32.280 INFO:teuthology.orchestra.run.smithi049.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T22:03:32.316 INFO:teuthology.orchestra.run.smithi044.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T22:03:32.331 INFO:teuthology.orchestra.run.smithi049.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T22:03:32.387 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T22:03:32.484 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T22:03:32.489 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T22:03:32.553 INFO:teuthology.orchestra.run.smithi049.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T22:03:32.577 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T22:03:32.922 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T22:03:32.949 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T22:03:32.989 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T22:03:33.223 INFO:teuthology.orchestra.run.smithi044.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T22:03:33.224 INFO:teuthology.orchestra.run.smithi044.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T22:03:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T22:03:33.284 INFO:teuthology.orchestra.run.smithi044.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T22:03:33.292 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T22:03:33.295 INFO:teuthology.orchestra.run.smithi044.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T22:03:33.297 INFO:teuthology.orchestra.run.smithi044.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T22:03:33.318 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T22:03:33.321 INFO:teuthology.orchestra.run.smithi044.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T22:03:33.350 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T22:03:33.383 INFO:teuthology.orchestra.run.smithi049.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T22:03:33.384 INFO:teuthology.orchestra.run.smithi049.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T22:03:33.401 INFO:teuthology.orchestra.run.smithi049.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T22:03:33.453 INFO:teuthology.orchestra.run.smithi049.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T22:03:33.480 INFO:teuthology.orchestra.run.smithi049.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T22:03:33.483 INFO:teuthology.orchestra.run.smithi049.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T22:03:33.562 INFO:teuthology.orchestra.run.smithi044.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T22:03:33.563 INFO:teuthology.orchestra.run.smithi044.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T22:03:33.567 INFO:teuthology.orchestra.run.smithi049.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T22:03:33.770 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T22:03:33.797 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:33.844 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:33.868 INFO:teuthology.orchestra.run.smithi049.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T22:03:33.869 INFO:teuthology.orchestra.run.smithi049.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T22:03:34.215 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T22:03:34.241 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:34.281 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:34.635 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T22:03:34.661 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:34.701 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:35.046 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T22:03:35.072 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T22:03:35.112 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T22:03:35.416 INFO:teuthology.orchestra.run.smithi044.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T22:03:35.419 INFO:teuthology.orchestra.run.smithi044.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T22:03:35.420 INFO:teuthology.orchestra.run.smithi044.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T22:03:35.424 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librados2. 2024-09-20T22:03:35.450 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:35.490 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:35.690 INFO:teuthology.orchestra.run.smithi044.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T22:03:35.799 INFO:teuthology.orchestra.run.smithi049.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T22:03:35.802 INFO:teuthology.orchestra.run.smithi049.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T22:03:35.803 INFO:teuthology.orchestra.run.smithi049.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T22:03:35.935 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librbd1. 2024-09-20T22:03:35.961 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:36.001 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:36.070 INFO:teuthology.orchestra.run.smithi049.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T22:03:36.293 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 181 MB in 8s (23.2 MB/s) 2024-09-20T22:03:36.456 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T22:03:36.530 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T22:03:36.555 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:36.556 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T22:03:36.562 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T22:03:36.596 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:36.647 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T22:03:36.674 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 181 MB in 8s (22.4 MB/s) 2024-09-20T22:03:36.839 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T22:03:36.865 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rados. 2024-09-20T22:03:36.880 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:36.915 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:36.942 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T22:03:36.947 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T22:03:37.008 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T22:03:37.035 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T22:03:37.054 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T22:03:37.075 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T22:03:37.201 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T22:03:37.227 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:03:37.268 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:37.336 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T22:03:37.363 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T22:03:37.400 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T22:03:37.411 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T22:03:37.426 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T22:03:37.466 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T22:03:37.520 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T22:03:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:37.794 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T22:03:37.821 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T22:03:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T22:03:37.861 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T22:03:37.867 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:37.890 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T22:03:37.915 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:37.916 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:03:37.956 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:38.222 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T22:03:38.249 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:38.268 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T22:03:38.294 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T22:03:38.297 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:38.334 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T22:03:38.427 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T22:03:38.453 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:38.493 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:38.645 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T22:03:38.673 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T22:03:38.703 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T22:03:38.712 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T22:03:38.729 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:38.769 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:38.804 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T22:03:38.831 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:38.863 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:38.973 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T22:03:39.001 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:39.039 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T22:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T22:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:03:39.199 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T22:03:39.226 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T22:03:39.266 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T22:03:39.351 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T22:03:39.378 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T22:03:39.409 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T22:03:39.492 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T22:03:39.518 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T22:03:39.558 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T22:03:39.577 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librados2. 2024-09-20T22:03:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:39.687 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T22:03:39.702 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T22:03:39.744 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T22:03:40.030 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librados2. 2024-09-20T22:03:40.040 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T22:03:40.055 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:40.055 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T22:03:40.094 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:40.098 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T22:03:40.338 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librbd1. 2024-09-20T22:03:40.365 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:40.401 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua5.1. 2024-09-20T22:03:40.405 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:40.428 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T22:03:40.468 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T22:03:40.489 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librbd1. 2024-09-20T22:03:40.505 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:40.539 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:40.762 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-any. 2024-09-20T22:03:40.789 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T22:03:40.829 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T22:03:40.832 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T22:03:40.859 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:40.899 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:40.966 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T22:03:40.993 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:41.033 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:41.090 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package zip. 2024-09-20T22:03:41.105 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T22:03:41.148 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T22:03:41.177 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rados. 2024-09-20T22:03:41.192 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:41.227 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:41.327 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rados. 2024-09-20T22:03:41.354 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:41.394 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:41.451 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package unzip. 2024-09-20T22:03:41.478 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T22:03:41.513 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T22:03:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T22:03:41.540 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:03:41.579 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:41.713 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T22:03:41.740 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:03:41.780 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:41.832 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T22:03:41.848 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:41.855 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package luarocks. 2024-09-20T22:03:41.882 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T22:03:41.890 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:41.913 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T22:03:42.032 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T22:03:42.059 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:42.099 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:42.210 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T22:03:42.237 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:03:42.277 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:42.313 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librgw2. 2024-09-20T22:03:42.339 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:42.379 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:42.402 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T22:03:42.429 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:03:42.468 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:42.604 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T22:03:42.631 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T22:03:42.671 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T22:03:42.755 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T22:03:42.782 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T22:03:42.813 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T22:03:42.924 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T22:03:42.940 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T22:03:42.949 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T22:03:42.974 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T22:03:42.975 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:43.015 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:43.124 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T22:03:43.151 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T22:03:43.190 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T22:03:43.218 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T22:03:43.234 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:43.276 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:43.343 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T22:03:43.370 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T22:03:43.401 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T22:03:43.451 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T22:03:43.467 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:43.543 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:43.629 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T22:03:43.656 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T22:03:43.696 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T22:03:43.704 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T22:03:43.730 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:43.770 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:43.888 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T22:03:43.915 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T22:03:43.954 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T22:03:43.965 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T22:03:43.981 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T22:03:44.015 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T22:03:44.168 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-common. 2024-09-20T22:03:44.195 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:44.207 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T22:03:44.233 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T22:03:44.234 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:44.259 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T22:03:44.265 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T22:03:44.272 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T22:03:44.301 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T22:03:44.622 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua5.1. 2024-09-20T22:03:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T22:03:44.670 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T22:03:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T22:03:44.697 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T22:03:44.818 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T22:03:45.008 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-any. 2024-09-20T22:03:45.024 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T22:03:45.066 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T22:03:45.155 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua5.1. 2024-09-20T22:03:45.181 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T22:03:45.221 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T22:03:45.302 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package zip. 2024-09-20T22:03:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T22:03:45.352 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T22:03:45.508 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-any. 2024-09-20T22:03:45.534 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T22:03:45.566 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T22:03:45.656 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package unzip. 2024-09-20T22:03:45.682 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T22:03:45.722 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T22:03:45.818 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package zip. 2024-09-20T22:03:45.845 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T22:03:45.885 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T22:03:45.923 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-base. 2024-09-20T22:03:45.950 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:45.991 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:46.109 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package luarocks. 2024-09-20T22:03:46.136 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T22:03:46.176 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T22:03:46.213 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package unzip. 2024-09-20T22:03:46.240 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T22:03:46.279 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T22:03:46.534 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librgw2. 2024-09-20T22:03:46.549 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:46.578 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T22:03:46.583 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:46.605 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T22:03:46.645 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T22:03:46.667 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package luarocks. 2024-09-20T22:03:46.693 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T22:03:46.733 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T22:03:46.948 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T22:03:46.975 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T22:03:47.015 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T22:03:47.074 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librgw2. 2024-09-20T22:03:47.101 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:47.145 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T22:03:47.149 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:47.171 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:47.211 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:47.318 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T22:03:47.333 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T22:03:47.401 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T22:03:47.541 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T22:03:47.568 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T22:03:47.608 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T22:03:47.668 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T22:03:47.680 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T22:03:47.684 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:47.706 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T22:03:47.726 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:47.746 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T22:03:47.877 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T22:03:47.904 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:47.935 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:48.049 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T22:03:48.076 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T22:03:48.088 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T22:03:48.115 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T22:03:48.116 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T22:03:48.154 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T22:03:48.347 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-common. 2024-09-20T22:03:48.374 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:48.394 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T22:03:48.413 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:48.421 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T22:03:48.440 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T22:03:48.461 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T22:03:48.467 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:48.507 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:48.697 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-portend. 2024-09-20T22:03:48.712 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T22:03:48.747 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T22:03:48.902 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-common. 2024-09-20T22:03:48.929 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:48.968 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:49.051 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T22:03:49.077 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T22:03:49.117 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T22:03:49.420 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T22:03:49.436 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T22:03:49.479 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T22:03:49.824 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T22:03:49.851 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T22:03:49.891 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T22:03:49.960 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-base. 2024-09-20T22:03:49.987 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:50.036 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:50.178 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T22:03:50.204 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T22:03:50.244 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T22:03:50.407 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-base. 2024-09-20T22:03:50.434 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:50.475 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:50.522 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T22:03:50.549 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T22:03:50.589 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T22:03:50.798 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T22:03:50.825 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T22:03:50.865 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T22:03:50.917 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-mako. 2024-09-20T22:03:50.944 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T22:03:50.984 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T22:03:51.053 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T22:03:51.080 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T22:03:51.119 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T22:03:51.142 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T22:03:51.169 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T22:03:51.209 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T22:03:51.329 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T22:03:51.356 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T22:03:51.396 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T22:03:51.422 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T22:03:51.449 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T22:03:51.489 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T22:03:51.512 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T22:03:51.539 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T22:03:51.579 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T22:03:51.732 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T22:03:51.758 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T22:03:51.799 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T22:03:51.806 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T22:03:51.808 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T22:03:51.822 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T22:03:51.835 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T22:03:51.865 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T22:03:51.875 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T22:03:52.077 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webob. 2024-09-20T22:03:52.103 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T22:03:52.144 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T22:03:52.159 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T22:03:52.178 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T22:03:52.186 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T22:03:52.205 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T22:03:52.226 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T22:03:52.244 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T22:03:52.497 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T22:03:52.514 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T22:03:52.524 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T22:03:52.539 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T22:03:52.567 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T22:03:52.570 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T22:03:52.580 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T22:03:52.597 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T22:03:52.637 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T22:03:52.850 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T22:03:52.858 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T22:03:52.877 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T22:03:52.885 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T22:03:52.906 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-portend. 2024-09-20T22:03:52.917 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T22:03:52.922 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T22:03:52.925 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T22:03:52.965 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T22:03:53.203 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-paste. 2024-09-20T22:03:53.211 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-portend. 2024-09-20T22:03:53.219 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T22:03:53.226 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T22:03:53.238 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T22:03:53.253 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T22:03:53.253 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T22:03:53.277 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T22:03:53.293 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T22:03:53.574 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T22:03:53.580 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T22:03:53.589 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T22:03:53.595 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T22:03:53.607 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T22:03:53.611 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T22:03:53.632 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T22:03:53.647 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T22:03:53.654 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T22:03:53.917 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T22:03:53.927 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T22:03:53.943 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T22:03:53.953 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T22:03:53.974 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T22:03:53.985 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T22:03:54.008 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T22:03:54.035 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T22:03:54.074 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T22:03:54.280 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T22:03:54.307 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T22:03:54.346 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T22:03:54.346 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T22:03:54.372 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T22:03:54.411 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T22:03:54.411 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T22:03:54.438 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T22:03:54.477 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T22:03:54.658 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T22:03:54.685 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T22:03:54.706 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T22:03:54.725 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T22:03:54.733 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T22:03:54.773 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T22:03:54.780 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T22:03:54.807 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T22:03:54.846 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T22:03:55.080 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T22:03:55.091 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-mako. 2024-09-20T22:03:55.107 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T22:03:55.118 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T22:03:55.147 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T22:03:55.158 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T22:03:55.259 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T22:03:55.286 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T22:03:55.325 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T22:03:55.475 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-idna. 2024-09-20T22:03:55.478 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T22:03:55.502 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T22:03:55.504 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T22:03:55.544 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T22:03:55.566 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T22:03:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-mako. 2024-09-20T22:03:55.638 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T22:03:55.670 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T22:03:55.864 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T22:03:55.878 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T22:03:55.891 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T22:03:55.905 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T22:03:55.930 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T22:03:55.945 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T22:03:56.031 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T22:03:56.058 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T22:03:56.098 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T22:03:56.233 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webob. 2024-09-20T22:03:56.248 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests. 2024-09-20T22:03:56.249 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T22:03:56.275 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T22:03:56.283 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T22:03:56.315 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T22:03:56.359 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T22:03:56.386 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T22:03:56.425 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T22:03:56.585 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T22:03:56.611 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T22:03:56.636 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T22:03:56.651 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T22:03:56.663 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T22:03:56.706 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T22:03:56.736 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webob. 2024-09-20T22:03:56.764 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T22:03:56.803 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T22:03:56.938 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T22:03:56.953 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:03:56.996 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:57.014 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T22:03:57.041 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T22:03:57.081 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T22:03:57.114 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T22:03:57.130 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T22:03:57.168 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T22:03:57.367 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-paste. 2024-09-20T22:03:57.369 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T22:03:57.383 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T22:03:57.395 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:57.417 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T22:03:57.435 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:57.450 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T22:03:57.478 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T22:03:57.517 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T22:03:57.720 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T22:03:57.722 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T22:03:57.736 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T22:03:57.748 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T22:03:57.788 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T22:03:57.803 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T22:03:57.828 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-paste. 2024-09-20T22:03:57.855 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T22:03:57.912 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T22:03:58.081 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T22:03:58.091 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T22:03:58.108 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T22:03:58.118 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T22:03:58.139 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T22:03:58.158 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T22:03:58.231 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T22:03:58.259 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T22:03:58.298 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T22:03:58.401 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T22:03:58.428 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T22:03:58.468 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T22:03:58.503 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T22:03:58.530 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:58.570 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:58.575 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T22:03:58.592 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T22:03:58.634 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T22:03:58.779 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T22:03:58.806 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T22:03:58.845 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T22:03:58.937 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T22:03:58.964 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T22:03:58.982 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T22:03:59.004 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T22:03:59.008 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:59.048 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:59.200 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T22:03:59.227 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T22:03:59.267 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T22:03:59.315 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T22:03:59.342 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T22:03:59.381 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T22:03:59.586 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-idna. 2024-09-20T22:03:59.613 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T22:03:59.653 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T22:03:59.677 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T22:03:59.704 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:03:59.744 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:03:59.770 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T22:03:59.797 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T22:03:59.836 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T22:03:59.964 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T22:03:59.991 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T22:04:00.031 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T22:04:00.245 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-idna. 2024-09-20T22:04:00.273 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T22:04:00.342 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests. 2024-09-20T22:04:00.366 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T22:04:00.401 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T22:04:00.622 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T22:04:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T22:04:00.678 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T22:04:00.712 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T22:04:00.981 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T22:04:00.997 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:01.031 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:01.284 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T22:04:01.311 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T22:04:01.350 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T22:04:01.712 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests. 2024-09-20T22:04:01.739 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T22:04:01.778 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T22:04:01.831 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph. 2024-09-20T22:04:01.858 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:01.897 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:02.089 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T22:04:02.117 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T22:04:02.156 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T22:04:02.209 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T22:04:02.236 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:02.267 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:02.270 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T22:04:02.297 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:02.336 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:02.442 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T22:04:02.469 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:02.509 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:02.621 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T22:04:02.647 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T22:04:02.648 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:02.675 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T22:04:02.687 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:02.714 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T22:04:02.889 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T22:04:02.916 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:02.955 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:02.958 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T22:04:02.986 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T22:04:03.017 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T22:04:03.082 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephadm. 2024-09-20T22:04:03.109 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:03.148 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:03.216 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T22:04:03.244 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T22:04:03.283 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T22:04:03.345 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T22:04:03.372 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:03.411 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T22:04:03.453 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T22:04:03.493 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T22:04:03.585 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T22:04:03.613 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T22:04:03.652 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T22:04:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T22:04:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T22:04:03.814 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T22:04:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:03.872 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:04.005 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T22:04:04.032 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:04.072 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:04.425 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T22:04:04.426 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T22:04:04.452 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:04.453 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:04.483 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:04.484 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:04.861 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-babel. 2024-09-20T22:04:04.887 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T22:04:04.927 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:05.120 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T22:04:05.147 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:05.186 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:05.230 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T22:04:05.257 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T22:04:05.296 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T22:04:05.613 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph. 2024-09-20T22:04:05.633 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T22:04:05.640 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:05.660 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:05.679 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:05.700 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:06.045 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T22:04:06.072 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T22:04:06.112 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T22:04:06.199 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T22:04:06.226 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:06.264 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph. 2024-09-20T22:04:06.265 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:06.292 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:06.331 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:06.415 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-routes. 2024-09-20T22:04:06.442 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T22:04:06.481 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T22:04:06.600 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T22:04:06.602 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T22:04:06.618 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:06.627 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:06.652 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:06.658 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:06.860 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T22:04:06.887 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:06.927 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:06.987 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T22:04:07.014 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:07.053 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:07.055 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephadm. 2024-09-20T22:04:07.082 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:07.121 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:07.432 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T22:04:07.456 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephadm. 2024-09-20T22:04:07.460 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T22:04:07.483 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:07.499 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T22:04:07.522 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:07.802 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T22:04:07.809 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T22:04:07.829 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T22:04:07.836 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T22:04:07.868 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:07.875 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T22:04:08.174 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T22:04:08.190 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T22:04:08.194 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T22:04:08.222 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T22:04:08.232 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T22:04:08.261 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:08.728 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T22:04:08.755 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T22:04:08.795 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T22:04:08.898 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-babel. 2024-09-20T22:04:08.926 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T22:04:08.965 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:09.165 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T22:04:09.192 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T22:04:09.232 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T22:04:09.276 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T22:04:09.303 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T22:04:09.316 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-babel. 2024-09-20T22:04:09.343 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T22:04:09.344 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T22:04:09.382 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:09.518 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T22:04:09.545 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T22:04:09.584 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T22:04:09.696 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T22:04:09.710 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T22:04:09.723 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:09.738 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T22:04:09.762 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:09.776 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T22:04:10.107 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T22:04:10.122 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T22:04:10.134 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T22:04:10.149 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:10.173 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T22:04:10.188 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:10.269 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T22:04:10.297 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:10.422 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:10.426 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-routes. 2024-09-20T22:04:10.451 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T22:04:10.485 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T22:04:10.533 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T22:04:10.561 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T22:04:10.599 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T22:04:10.788 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T22:04:10.804 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:10.838 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:11.111 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-routes. 2024-09-20T22:04:11.138 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T22:04:11.202 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T22:04:11.350 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T22:04:11.377 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T22:04:11.417 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T22:04:11.531 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T22:04:11.558 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:11.597 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:11.907 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T22:04:11.934 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T22:04:11.987 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T22:04:12.060 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T22:04:12.088 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T22:04:12.152 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T22:04:12.307 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T22:04:12.334 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T22:04:12.374 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T22:04:12.621 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T22:04:12.649 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T22:04:12.685 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T22:04:12.688 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T22:04:12.712 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T22:04:12.752 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T22:04:12.852 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T22:04:12.868 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T22:04:12.910 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T22:04:13.033 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T22:04:13.060 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T22:04:13.064 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T22:04:13.092 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T22:04:13.100 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T22:04:13.131 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T22:04:13.403 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T22:04:13.422 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T22:04:13.430 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T22:04:13.434 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T22:04:13.449 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T22:04:13.462 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T22:04:13.469 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T22:04:13.488 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T22:04:13.492 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T22:04:13.788 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T22:04:13.800 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T22:04:13.815 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T22:04:13.828 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T22:04:13.854 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T22:04:13.866 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T22:04:14.128 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T22:04:14.156 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:14.166 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T22:04:14.169 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T22:04:14.193 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T22:04:14.197 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T22:04:14.233 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T22:04:14.236 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T22:04:14.271 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:14.881 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T22:04:14.906 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:14.936 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T22:04:14.947 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:14.964 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:15.096 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:15.250 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T22:04:15.275 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T22:04:15.278 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T22:04:15.303 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T22:04:15.325 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T22:04:15.342 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T22:04:15.603 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T22:04:15.630 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T22:04:15.661 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T22:04:15.679 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T22:04:15.706 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T22:04:15.745 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T22:04:15.939 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T22:04:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T22:04:15.982 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package jq. 2024-09-20T22:04:15.989 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T22:04:15.997 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T22:04:16.073 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T22:04:16.075 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T22:04:16.103 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T22:04:16.141 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T22:04:16.335 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T22:04:16.360 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package socat. 2024-09-20T22:04:16.362 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T22:04:16.376 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T22:04:16.401 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T22:04:16.418 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T22:04:16.444 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T22:04:16.472 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T22:04:16.511 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T22:04:16.705 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T22:04:16.732 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T22:04:16.763 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T22:04:16.780 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T22:04:16.797 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T22:04:16.839 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T22:04:16.913 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T22:04:16.940 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T22:04:16.979 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T22:04:17.125 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T22:04:17.153 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T22:04:17.192 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T22:04:17.244 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-test. 2024-09-20T22:04:17.271 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:17.299 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T22:04:17.310 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:17.327 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T22:04:17.366 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T22:04:17.506 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T22:04:17.533 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T22:04:17.572 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T22:04:17.652 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T22:04:17.680 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T22:04:17.710 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T22:04:17.867 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T22:04:17.895 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T22:04:17.934 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T22:04:17.988 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T22:04:18.005 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T22:04:18.047 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T22:04:18.287 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T22:04:18.315 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T22:04:18.353 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T22:04:18.657 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T22:04:18.661 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T22:04:18.678 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:18.685 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T22:04:18.719 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:18.723 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T22:04:18.980 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T22:04:19.009 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T22:04:19.038 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T22:04:19.400 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T22:04:19.428 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T22:04:19.466 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T22:04:19.479 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T22:04:19.496 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:19.498 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T22:04:19.514 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:19.537 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:19.556 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:19.744 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package jq. 2024-09-20T22:04:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T22:04:19.802 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T22:04:19.840 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T22:04:19.844 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T22:04:19.860 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:19.868 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T22:04:19.894 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:19.906 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T22:04:20.047 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package socat. 2024-09-20T22:04:20.063 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T22:04:20.096 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T22:04:20.218 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T22:04:20.239 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T22:04:20.246 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T22:04:20.266 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T22:04:20.285 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T22:04:20.305 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T22:04:20.375 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T22:04:20.392 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T22:04:20.424 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T22:04:20.537 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package jq. 2024-09-20T22:04:20.565 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T22:04:20.604 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T22:04:20.636 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T22:04:20.663 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T22:04:20.702 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T22:04:20.779 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-test. 2024-09-20T22:04:20.796 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:20.837 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:21.015 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T22:04:21.023 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package socat. 2024-09-20T22:04:21.042 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T22:04:21.051 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T22:04:21.073 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T22:04:21.090 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T22:04:21.401 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T22:04:21.418 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T22:04:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T22:04:21.638 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package pkg-config. 2024-09-20T22:04:21.666 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T22:04:21.704 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T22:04:21.822 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-test. 2024-09-20T22:04:21.839 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:21.881 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:21.957 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T22:04:21.973 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T22:04:22.015 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T22:04:22.427 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T22:04:22.455 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T22:04:22.485 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T22:04:22.774 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T22:04:22.802 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T22:04:22.840 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T22:04:23.144 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T22:04:23.172 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T22:04:23.210 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T22:04:23.492 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T22:04:23.505 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T22:04:23.520 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:23.533 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T22:04:23.558 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:23.572 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T22:04:23.837 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T22:04:23.854 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:23.884 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-py. 2024-09-20T22:04:23.887 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:23.911 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T22:04:23.950 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T22:04:24.185 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T22:04:24.198 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T22:04:24.213 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T22:04:24.226 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T22:04:24.251 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:24.264 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T22:04:24.287 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T22:04:24.315 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T22:04:24.353 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T22:04:24.555 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T22:04:24.572 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:24.595 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T22:04:24.614 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:24.623 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T22:04:24.661 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T22:04:24.767 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T22:04:24.794 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T22:04:24.825 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T22:04:24.933 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T22:04:24.961 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T22:04:24.990 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T22:04:24.999 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T22:04:25.018 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T22:04:25.056 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T22:04:25.136 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-toml. 2024-09-20T22:04:25.164 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T22:04:25.203 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T22:04:25.330 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T22:04:25.357 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T22:04:25.396 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T22:04:25.428 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pkg-config. 2024-09-20T22:04:25.457 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T22:04:25.486 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T22:04:25.514 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T22:04:25.542 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T22:04:25.581 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T22:04:25.722 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T22:04:25.733 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T22:04:25.739 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T22:04:25.761 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T22:04:25.781 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T22:04:25.791 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T22:04:25.943 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T22:04:25.971 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T22:04:26.009 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T22:04:26.209 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T22:04:26.213 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package pkg-config. 2024-09-20T22:04:26.237 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T22:04:26.242 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T22:04:26.275 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T22:04:26.279 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T22:04:26.307 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T22:04:26.346 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T22:04:26.380 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T22:04:26.597 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T22:04:26.625 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T22:04:26.663 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T22:04:26.775 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T22:04:26.803 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T22:04:26.833 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T22:04:26.984 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T22:04:27.012 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T22:04:27.050 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T22:04:27.075 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package radosgw. 2024-09-20T22:04:27.103 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:27.142 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:27.253 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T22:04:27.281 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T22:04:27.319 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T22:04:27.361 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T22:04:27.390 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T22:04:27.436 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T22:04:27.589 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T22:04:27.617 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T22:04:27.655 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T22:04:27.790 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-py. 2024-09-20T22:04:27.818 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T22:04:27.864 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T22:04:27.950 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T22:04:27.979 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T22:04:28.017 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T22:04:28.143 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T22:04:28.145 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T22:04:28.162 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:28.171 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T22:04:28.203 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:28.209 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T22:04:28.286 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T22:04:28.314 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T22:04:28.352 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T22:04:28.542 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T22:04:28.655 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T22:04:28.684 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T22:04:28.698 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-py. 2024-09-20T22:04:28.721 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T22:04:28.726 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T22:04:28.764 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T22:04:28.851 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T22:04:28.977 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T22:04:29.008 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-toml. 2024-09-20T22:04:29.036 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T22:04:29.074 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T22:04:29.092 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T22:04:29.121 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T22:04:29.159 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T22:04:29.237 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T22:04:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T22:04:29.355 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T22:04:29.393 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T22:04:29.552 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T22:04:29.613 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T22:04:29.642 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T22:04:29.679 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T22:04:29.714 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T22:04:29.730 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T22:04:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T22:04:29.969 INFO:teuthology.orchestra.run.smithi179.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T22:04:29.999 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-toml. 2024-09-20T22:04:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T22:04:30.027 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T22:04:30.046 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:30.052 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T22:04:30.065 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T22:04:30.091 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T22:04:30.402 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T22:04:30.430 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T22:04:30.468 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T22:04:30.563 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user cephadm....done 2024-09-20T22:04:30.719 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T22:04:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package radosgw. 2024-09-20T22:04:30.832 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:30.872 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T22:04:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:30.901 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T22:04:30.938 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T22:04:31.004 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T22:04:31.191 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T22:04:31.219 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T22:04:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T22:04:31.272 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T22:04:31.399 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T22:04:31.658 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T22:04:31.815 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T22:04:31.832 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:31.909 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T22:04:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package radosgw. 2024-09-20T22:04:32.032 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:32.036 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T22:04:32.070 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:32.354 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T22:04:32.378 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T22:04:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T22:04:32.749 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T22:04:32.771 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T22:04:32.873 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T22:04:32.890 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T22:04:32.923 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:33.016 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T22:04:33.027 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T22:04:33.220 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T22:04:33.285 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T22:04:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T22:04:33.528 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T22:04:33.586 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T22:04:33.637 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T22:04:33.807 INFO:teuthology.orchestra.run.smithi044.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T22:04:33.846 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T22:04:33.922 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T22:04:33.981 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:34.114 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T22:04:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T22:04:34.365 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:34.489 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user cephadm....done 2024-09-20T22:04:34.646 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T22:04:34.649 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T22:04:34.714 INFO:teuthology.orchestra.run.smithi049.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T22:04:34.759 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T22:04:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:34.868 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T22:04:34.922 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T22:04:34.994 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T22:04:35.148 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T22:04:35.249 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T22:04:35.254 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T22:04:35.314 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user cephadm....done 2024-09-20T22:04:35.446 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T22:04:35.542 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T22:04:35.692 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T22:04:35.705 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T22:04:35.728 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T22:04:35.799 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T22:04:35.801 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T22:04:35.926 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T22:04:35.927 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T22:04:35.965 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T22:04:36.091 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T22:04:36.263 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T22:04:36.285 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:36.350 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T22:04:36.411 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T22:04:36.610 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T22:04:36.623 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T22:04:36.704 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T22:04:36.736 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T22:04:36.883 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T22:04:36.956 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T22:04:37.029 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T22:04:37.142 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T22:04:37.248 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T22:04:37.375 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T22:04:37.382 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T22:04:37.429 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T22:04:37.641 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T22:04:37.870 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T22:04:37.917 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T22:04:38.060 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T22:04:38.129 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T22:04:38.202 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T22:04:38.320 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T22:04:38.364 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:38.446 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T22:04:38.453 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T22:04:38.580 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T22:04:38.607 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T22:04:38.712 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T22:04:38.733 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T22:04:38.859 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T22:04:38.873 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T22:04:38.947 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:38.985 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T22:04:39.223 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T22:04:39.261 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T22:04:39.266 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T22:04:39.349 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T22:04:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T22:04:39.509 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T22:04:39.601 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T22:04:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T22:04:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T22:04:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T22:04:39.807 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T22:04:39.860 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T22:04:39.869 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T22:04:40.154 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T22:04:40.167 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:40.285 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T22:04:40.293 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T22:04:40.317 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T22:04:40.381 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T22:04:40.506 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T22:04:40.507 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T22:04:40.569 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T22:04:40.782 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T22:04:40.837 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T22:04:40.891 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:40.900 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:41.017 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T22:04:41.130 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T22:04:41.185 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T22:04:41.240 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T22:04:41.285 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T22:04:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T22:04:41.553 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T22:04:41.854 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T22:04:41.942 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T22:04:42.201 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T22:04:42.255 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T22:04:42.327 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T22:04:42.462 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T22:04:42.676 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T22:04:42.754 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T22:04:42.911 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:42.915 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T22:04:43.045 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T22:04:43.148 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T22:04:43.183 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T22:04:43.305 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T22:04:43.309 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T22:04:43.382 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T22:04:43.435 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T22:04:43.531 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T22:04:43.736 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T22:04:43.767 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T22:04:43.849 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T22:04:44.085 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T22:04:44.112 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T22:04:44.142 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T22:04:44.355 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T22:04:44.385 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T22:04:44.436 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T22:04:44.636 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T22:04:44.757 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T22:04:44.787 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T22:04:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:45.050 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T22:04:45.089 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T22:04:45.107 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T22:04:45.357 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T22:04:45.416 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T22:04:45.418 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T22:04:45.633 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T22:04:45.669 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T22:04:45.795 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:45.876 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T22:04:46.096 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T22:04:46.110 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T22:04:46.378 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T22:04:46.414 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T22:04:46.505 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T22:04:46.647 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T22:04:46.815 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T22:04:46.865 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:46.941 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T22:04:46.975 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T22:04:47.242 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T22:04:47.243 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T22:04:47.369 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T22:04:47.495 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T22:04:47.535 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T22:04:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T22:04:47.778 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T22:04:47.796 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T22:04:47.895 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T22:04:47.896 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:48.056 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T22:04:48.085 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T22:04:48.156 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T22:04:48.323 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T22:04:48.324 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T22:04:48.390 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:48.450 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T22:04:48.450 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T22:04:48.492 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T22:04:48.559 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T22:04:48.793 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T22:04:48.843 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T22:04:48.852 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T22:04:49.053 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T22:04:49.094 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T22:04:49.111 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T22:04:49.220 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T22:04:49.321 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T22:04:49.362 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:49.472 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T22:04:49.480 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:49.571 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T22:04:49.615 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T22:04:49.790 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T22:04:49.814 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T22:04:49.933 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T22:04:50.049 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T22:04:50.082 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T22:04:50.183 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T22:04:50.250 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T22:04:50.309 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T22:04:50.460 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T22:04:50.527 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T22:04:50.552 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T22:04:50.586 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T22:04:50.636 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T22:04:50.803 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T22:04:50.896 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T22:04:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T22:04:51.062 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T22:04:51.155 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T22:04:51.196 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T22:04:51.221 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T22:04:51.456 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T22:04:51.481 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T22:04:51.501 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T22:04:51.615 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T22:04:51.632 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T22:04:51.733 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:51.806 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T22:04:51.878 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T22:04:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T22:04:52.060 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T22:04:52.146 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T22:04:52.186 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T22:04:52.234 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T22:04:52.491 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T22:04:52.494 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T22:04:52.579 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T22:04:52.617 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:52.620 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T22:04:52.743 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:52.746 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T22:04:52.839 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T22:04:52.844 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T22:04:52.870 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T22:04:52.940 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T22:04:53.106 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T22:04:53.183 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:53.231 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:53.232 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T22:04:53.309 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T22:04:53.357 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:53.484 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T22:04:53.625 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T22:04:53.626 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T22:04:53.785 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:53.876 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T22:04:53.903 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:53.936 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T22:04:54.002 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T22:04:54.029 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:54.212 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T22:04:54.244 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T22:04:54.244 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T22:04:54.278 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T22:04:54.338 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T22:04:54.404 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T22:04:54.631 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T22:04:54.739 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T22:04:54.756 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:54.891 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:54.899 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T22:04:55.048 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T22:04:55.059 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:55.185 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T22:04:55.236 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T22:04:55.341 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T22:04:55.467 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T22:04:55.638 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T22:04:55.735 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T22:04:55.931 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T22:04:56.011 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T22:04:56.250 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T22:04:56.356 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T22:04:56.376 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:56.482 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:56.485 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:56.587 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T22:04:56.608 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:56.726 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:56.750 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T22:04:56.844 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:56.915 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:56.953 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:57.041 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:57.059 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T22:04:57.167 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T22:04:57.420 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T22:04:57.452 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:57.530 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:57.546 INFO:teuthology.orchestra.run.smithi179.stdout:Adding group ceph....done 2024-09-20T22:04:57.578 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:57.656 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:57.712 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:57.782 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T22:04:57.924 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user ceph....done 2024-09-20T22:04:57.932 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T22:04:57.932 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T22:04:58.093 INFO:teuthology.orchestra.run.smithi179.stdout:Setting system user ceph properties....done 2024-09-20T22:04:58.110 INFO:teuthology.orchestra.run.smithi179.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T22:04:58.118 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:58.244 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:58.244 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T22:04:58.362 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T22:04:58.422 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:58.531 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:58.561 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T22:04:58.632 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:58.647 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:58.759 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T22:04:58.795 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:58.924 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:59.137 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T22:04:59.138 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T22:04:59.180 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:59.574 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:59.609 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:59.735 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:59.861 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:59.971 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:04:59.986 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T22:05:00.076 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T22:05:00.076 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T22:05:00.097 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:00.207 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:00.307 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:00.409 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:00.517 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:00.843 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T22:05:00.944 INFO:teuthology.orchestra.run.smithi044.stdout:Adding group ceph....done 2024-09-20T22:05:01.232 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:01.303 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:01.358 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:01.379 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user ceph....done 2024-09-20T22:05:01.484 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:01.523 INFO:teuthology.orchestra.run.smithi044.stdout:Setting system user ceph properties....done 2024-09-20T22:05:01.536 INFO:teuthology.orchestra.run.smithi044.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T22:05:01.546 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T22:05:01.546 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T22:05:01.610 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:01.680 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T22:05:01.736 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:01.989 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T22:05:02.005 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:02.221 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T22:05:02.221 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T22:05:02.255 INFO:teuthology.orchestra.run.smithi049.stdout:Adding group ceph....done 2024-09-20T22:05:02.469 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:02.629 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:02.639 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user ceph....done 2024-09-20T22:05:02.715 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:02.765 INFO:teuthology.orchestra.run.smithi049.stdout:Setting system user ceph properties....done 2024-09-20T22:05:02.782 INFO:teuthology.orchestra.run.smithi049.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T22:05:02.925 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T22:05:03.006 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T22:05:03.006 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T22:05:03.108 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T22:05:03.108 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T22:05:03.231 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T22:05:03.525 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:03.634 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:03.649 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:03.688 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:03.817 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:03.971 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T22:05:03.972 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T22:05:03.972 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T22:05:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T22:05:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T22:05:04.451 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:04.463 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:04.614 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:04.684 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T22:05:04.684 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T22:05:04.717 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:04.749 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:04.900 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:05.079 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T22:05:05.170 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:05.395 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T22:05:05.399 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T22:05:05.399 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T22:05:05.496 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T22:05:05.536 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:05.648 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T22:05:05.764 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T22:05:05.764 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T22:05:05.921 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:06.215 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T22:05:06.215 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T22:05:06.246 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T22:05:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T22:05:06.723 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:06.751 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T22:05:06.849 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:06.947 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:07.000 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:07.218 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T22:05:07.218 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T22:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T22:05:07.234 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T22:05:07.387 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T22:05:07.392 DEBUG:teuthology.parallel:result is None 2024-09-20T22:05:07.710 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:07.716 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:07.844 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:07.970 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:08.026 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:08.096 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:08.177 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:08.394 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T22:05:08.394 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T22:05:08.500 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T22:05:08.617 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T22:05:08.836 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:08.987 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:09.113 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:09.273 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T22:05:09.326 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T22:05:09.634 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T22:05:09.734 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T22:05:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T22:05:10.543 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T22:05:10.988 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T22:05:11.198 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T22:05:11.202 DEBUG:teuthology.parallel:result is None 2024-09-20T22:05:11.651 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T22:05:11.655 DEBUG:teuthology.parallel:result is None 2024-09-20T22:05:11.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:05:11.801 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-query -W -f '${Version}' ceph 2024-09-20T22:05:11.820 INFO:teuthology.orchestra.run.smithi044.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:05:11.821 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:05:11.821 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T22:05:11.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:05:11.967 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-query -W -f '${Version}' ceph 2024-09-20T22:05:11.987 INFO:teuthology.orchestra.run.smithi049.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:05:11.988 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:05:11.988 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T22:05:11.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:05:12.131 DEBUG:teuthology.orchestra.run.smithi179:> dpkg-query -W -f '${Version}' ceph 2024-09-20T22:05:12.152 INFO:teuthology.orchestra.run.smithi179.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:05:12.152 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T22:05:12.153 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T22:05:12.155 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-20T22:05:12.156 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:05:12.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T22:05:12.171 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:05:12.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T22:05:12.186 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:05:12.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T22:05:12.208 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-20T22:05:12.209 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:05:12.209 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T22:05:12.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T22:05:12.281 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:05:12.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T22:05:12.296 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T22:05:12.351 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:05:12.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T22:05:12.365 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T22:05:12.418 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-20T22:05:12.418 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:05:12.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T22:05:12.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T22:05:12.486 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:05:12.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T22:05:12.500 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T22:05:12.555 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:05:12.555 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T22:05:12.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T22:05:12.622 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-20T22:05:12.622 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:05:12.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T22:05:12.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T22:05:12.694 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:05:12.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T22:05:12.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T22:05:12.764 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:05:12.764 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T22:05:12.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T22:05:12.830 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-20T22:05:12.930 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum'], 'log-only-match': ['CEPHADM_'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-20T22:05:12.931 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:05:12.931 INFO:tasks.cephadm:Cluster fsid is 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:05:12.931 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-20T22:05:12.932 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.44', 'mon.b': '172.21.15.49', 'mon.c': '172.21.15.179'} 2024-09-20T22:05:12.932 INFO:tasks.cephadm:First mon is mon.a on smithi044 2024-09-20T22:05:12.932 INFO:tasks.cephadm:First mgr is a 2024-09-20T22:05:12.932 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-20T22:05:12.932 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-09-20T22:05:12.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2024-09-20T22:05:12.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname $(hostname -s) 2024-09-20T22:05:12.975 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-20T22:05:12.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:05:13.115 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/56118/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-367-g9e2ac70b', 'node_name': '172.21.2.13+braggi13', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-367-g9e2ac70b-1jammy'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-19 21:18:27.544930', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-20T22:05:13.257 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 9e2ac70bb7aea67d34f0d50002344abbe7803736 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:05:13.258 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-20T22:05:13.258 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-20T22:05:13.259 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:13.703 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791890 Sep 20 22:05 /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:13.703 DEBUG:teuthology.orchestra.run.smithi049:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:14.147 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791890 Sep 20 22:05 /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:14.147 DEBUG:teuthology.orchestra.run.smithi179:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:14.586 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791890 Sep 20 22:05 /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:14.587 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:14.595 DEBUG:teuthology.orchestra.run.smithi049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:14.603 DEBUG:teuthology.orchestra.run.smithi179:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T22:05:14.621 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 on all hosts... 2024-09-20T22:05:14.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 pull 2024-09-20T22:05:14.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 pull 2024-09-20T22:05:14.648 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 pull 2024-09-20T22:05:14.827 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736... 2024-09-20T22:05:14.838 INFO:teuthology.orchestra.run.smithi179.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736... 2024-09-20T22:05:14.838 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736... 2024-09-20T22:06:26.636 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-20T22:06:26.636 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)", 2024-09-20T22:06:26.636 INFO:teuthology.orchestra.run.smithi179.stdout: "image_id": "cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd", 2024-09-20T22:06:26.636 INFO:teuthology.orchestra.run.smithi179.stdout: "repo_digests": [ 2024-09-20T22:06:26.636 INFO:teuthology.orchestra.run.smithi179.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5" 2024-09-20T22:06:26.637 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-20T22:06:26.637 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-20T22:07:57.590 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-20T22:07:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)", 2024-09-20T22:07:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd", 2024-09-20T22:07:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-09-20T22:07:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5" 2024-09-20T22:07:57.590 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-20T22:07:57.591 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-20T22:08:08.382 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-20T22:08:08.382 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)", 2024-09-20T22:08:08.382 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "cc9251b744a3faafca7c3095f79bfff81873afe823f31a03a11e015a34abcdbd", 2024-09-20T22:08:08.383 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2024-09-20T22:08:08.383 INFO:teuthology.orchestra.run.smithi049.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5" 2024-09-20T22:08:08.383 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-20T22:08:08.383 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-20T22:08:08.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-09-20T22:08:08.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2024-09-20T22:08:08.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph 2024-09-20T22:08:08.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-09-20T22:08:08.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2024-09-20T22:08:08.516 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /etc/ceph 2024-09-20T22:08:08.531 INFO:tasks.cephadm:Writing seed config... 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-20T22:08:08.532 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-20T22:08:08.533 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:08:08.533 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-20T22:08:08.550 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 68d7421e-779c-11ef-baf5-efdc52797490 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-20T22:08:08.550 DEBUG:teuthology.orchestra.run.smithi044:mon.a> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.a.service 2024-09-20T22:08:08.595 DEBUG:teuthology.orchestra.run.smithi044:mgr.a> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@mgr.a.service 2024-09-20T22:08:08.638 INFO:tasks.cephadm:Bootstrapping... 2024-09-20T22:08:08.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 -v bootstrap --fsid 68d7421e-779c-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.44 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-20T22:08:08.867 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-20T22:08:08.867 INFO:teuthology.orchestra.run.smithi044.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736', '-v', 'bootstrap', '--fsid', '68d7421e-779c-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.44', '--skip-admin-label'] 2024-09-20T22:08:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-20T22:08:08.868 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying podman|docker is present... 2024-09-20T22:08:08.868 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying lvm2 is present... 2024-09-20T22:08:08.868 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying time synchronization is in place... 2024-09-20T22:08:08.873 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-20T22:08:08.873 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T22:08:08.878 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-20T22:08:08.878 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.882 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-20T22:08:08.882 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-20T22:08:08.885 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-20T22:08:08.885 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.889 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-20T22:08:08.889 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout masked 2024-09-20T22:08:08.893 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-20T22:08:08.893 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.898 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-20T22:08:08.898 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-20T22:08:08.901 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-20T22:08:08.902 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.906 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-09-20T22:08:08.910 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-09-20T22:08:08.910 INFO:teuthology.orchestra.run.smithi044.stdout:Unit ntp.service is enabled and running 2024-09-20T22:08:08.911 INFO:teuthology.orchestra.run.smithi044.stdout:Repeating the final host check... 2024-09-20T22:08:08.911 INFO:teuthology.orchestra.run.smithi044.stdout:docker (/usr/bin/docker) is present 2024-09-20T22:08:08.911 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl is present 2024-09-20T22:08:08.911 INFO:teuthology.orchestra.run.smithi044.stdout:lvcreate is present 2024-09-20T22:08:08.914 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-20T22:08:08.915 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T22:08:08.919 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-20T22:08:08.919 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.923 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-20T22:08:08.923 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-20T22:08:08.927 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-20T22:08:08.927 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.930 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-20T22:08:08.930 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout masked 2024-09-20T22:08:08.934 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-20T22:08:08.934 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.938 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-20T22:08:08.938 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-20T22:08:08.942 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-20T22:08:08.942 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-09-20T22:08:08.946 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-09-20T22:08:08.950 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Unit ntp.service is enabled and running 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Host looks OK 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Cluster fsid: 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Acquiring lock 140603580414800 on /run/cephadm/68d7421e-779c-11ef-baf5-efdc52797490.lock 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Lock 140603580414800 acquired on /run/cephadm/68d7421e-779c-11ef-baf5-efdc52797490.lock 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 3300 ... 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 6789 ... 2024-09-20T22:08:08.951 INFO:teuthology.orchestra.run.smithi044.stdout:Base mon IP(s) is [172.21.15.44:3300, 172.21.15.44:6789], mon addrv is [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-09-20T22:08:08.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-09-20T22:08:08.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-20T22:08:08.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.44 2024-09-20T22:08:08.956 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-20T22:08:08.957 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-20T22:08:08.957 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-09-20T22:08:08.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-20T22:08:08.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-20T22:08:08.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-20T22:08:08.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-20T22:08:08.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-20T22:08:08.959 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-20T22:08:08.960 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-09-20T22:08:08.960 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-09-20T22:08:08.960 INFO:teuthology.orchestra.run.smithi044.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-20T22:08:08.961 INFO:teuthology.orchestra.run.smithi044.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-20T22:08:08.962 INFO:teuthology.orchestra.run.smithi044.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736... 2024-09-20T22:08:09.267 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/docker: stdout 9e2ac70bb7aea67d34f0d50002344abbe7803736: Pulling from ceph-ci/ceph 2024-09-20T22:08:09.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/docker: stdout Digest: sha256:07c2c7a2cb9ca9b41c609b2ddfb8539abdc0283fbb4aebf87c70eeaf670bffe5 2024-09-20T22:08:09.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:08:09.268 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T22:08:10.950 INFO:teuthology.orchestra.run.smithi044.stdout:ceph: stdout ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable) 2024-09-20T22:08:10.951 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph version: ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable) 2024-09-20T22:08:10.951 INFO:teuthology.orchestra.run.smithi044.stdout:Extracting ceph user uid/gid from container image... 2024-09-20T22:08:12.491 INFO:teuthology.orchestra.run.smithi044.stdout:stat: stdout 167 167 2024-09-20T22:08:12.491 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial keys... 2024-09-20T22:08:13.880 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQBN8u1mnK01ExAARBixUpYtV+mus4ifpq82CQ== 2024-09-20T22:08:15.411 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQBO8u1mZXK/MhAAbyNpeReUlDdRJIP8bi4Tww== 2024-09-20T22:08:16.800 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQBQ8u1mJFvPEBAAdMPTbWsbYmIYiBxu2ciJwg== 2024-09-20T22:08:16.800 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial monmap... 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool for a [v2:172.21.15.44:3300,v1:172.21.15.44:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: set fsid to 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T22:08:18.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:08:18.332 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mon... 2024-09-20T22:08:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.161+0000 7f4b34d8dc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-20T22:08:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.161+0000 7f4b34d8dc80 1 imported monmap: 2024-09-20T22:08:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-20T22:08:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-20T22:08:17.833594+0000 2024-09-20T22:08:19.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:08:19.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-09-20T22:08:19.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-20T22:08:19.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:08:19.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.648 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.161+0000 7f4b34d8dc80 0 /usr/bin/ceph-mon: set fsid to 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:19.669 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: RocksDB version: 7.9.2 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Git sha 0 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: DB SUMMARY 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: DB Session ID: 5FMPP7U4M8D46LO9I1BG 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.error_if_exists: 0 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.create_if_missing: 1 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.paranoid_checks: 1 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.env: 0x55d451f80940 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.info_log: 0x55d453dc4bc0 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.statistics: (nil) 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.use_fsync: 0 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_log_file_size: 0 2024-09-20T22:08:19.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.allow_fallocate: 1 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.use_direct_reads: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.db_log_dir: 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.wal_dir: 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T22:08:19.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.write_buffer_manager: 0x55d453dcb4a0 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-20T22:08:19.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.unordered_write: 0 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.row_cache: None 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.wal_filter: None 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.two_write_queues: 0 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.wal_compression: 0 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.atomic_flush: 0 2024-09-20T22:08:19.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.log_readahead_size: 0 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_background_jobs: 2 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_background_compactions: -1 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_subcompactions: 1 2024-09-20T22:08:19.675 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_open_files: -1 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_background_flushes: -1 2024-09-20T22:08:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Compression algorithms supported: 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kZSTD supported: 0 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kXpressCompression supported: 0 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kBZip2Compression supported: 0 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kLZ4Compression supported: 1 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kZlibCompression supported: 1 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: kSnappyCompression supported: 1 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-20T22:08:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.merge_operator: 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_filter: None 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d453dc4800) 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-20T22:08:19.678 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x55d453daf1f0 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-20T22:08:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-20T22:08:19.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression: NoCompression 2024-09-20T22:08:19.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.num_levels: 7 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T22:08:19.682 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T22:08:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T22:08:19.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T22:08:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T22:08:19.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T22:08:19.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T22:08:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.inplace_update_support: 0 2024-09-20T22:08:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T22:08:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T22:08:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T22:08:19.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.bloom_locality: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.max_successive_merges: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.ttl: 2592000 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.enable_blob_files: false 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.min_blob_size: 0 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T22:08:19.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d92169f6-aeed-412b-8876-b24a5e957c6a 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.165+0000 7f4b34d8dc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.169+0000 7f4b34d8dc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d453ddce00 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.169+0000 7f4b34d8dc80 4 rocksdb: DB pointer 0x55d453eb6000 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.169+0000 7f4b2c518640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.169+0000 7f4b2c518640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:08:19.695 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T22:08:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T22:08:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T22:08:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.696 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-20T22:08:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:08:19.697 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T22:08:19.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x55d453daf1f0#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.169+0000 7f4b34d8dc80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.169+0000 7f4b34d8dc80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-20T22:08:19.169+0000 7f4b34d8dc80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-20T22:08:19.699 INFO:teuthology.orchestra.run.smithi044.stdout:create mon.a on 2024-09-20T22:08:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-09-20T22:08:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-20T22:08:20.364 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-68d7421e-779c-11ef-baf5-efdc52797490.target -> /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490.target. 2024-09-20T22:08:20.364 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-68d7421e-779c-11ef-baf5-efdc52797490.target -> /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490.target. 2024-09-20T22:08:20.638 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.a 2024-09-20T22:08:20.638 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-20T22:08:20.837 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490.target.wants/ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.a.service -> /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service. 2024-09-20T22:08:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld does not appear to be present 2024-09-20T22:08:20.847 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-09-20T22:08:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon to start... 2024-09-20T22:08:20.848 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon... 2024-09-20T22:08:20.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:20 smithi044 systemd[1]: Started Ceph mon.a for 68d7421e-779c-11ef-baf5-efdc52797490. 2024-09-20T22:08:22.468 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:22 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.262748+0000 mon.a (mon.0) 0 : cluster [INF] mkfs 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:22.469 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:22 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.241695+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-20T22:08:23.009 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout cluster: 2024-09-20T22:08:23.009 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout id: 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout services: 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.194877s) 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout data: 2024-09-20T22:08:23.010 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-20T22:08:23.011 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-20T22:08:23.011 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-20T22:08:23.011 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pgs: 2024-09-20T22:08:23.011 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:23.011 INFO:teuthology.orchestra.run.smithi044.stdout:mon is available 2024-09-20T22:08:23.011 INFO:teuthology.orchestra.run.smithi044.stdout:Assimilating anything we can from ceph.conf... 2024-09-20T22:08:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261680+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-20T22:08:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261893+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261904+0000 mon.a (mon.0) 4 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261913+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-20T22:08:17.833594+0000 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261921+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261929+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261937+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.261945+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.264383+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.266883+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: cluster 2024-09-20T22:08:22.267374+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-20T22:08:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:23 smithi044 bash[22199]: audit 2024-09-20T22:08:22.456496+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.44:0/4023289987' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-20T22:08:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:24 smithi044 bash[22199]: audit 2024-09-20T22:08:24.132120+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.44:0/3470447483' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T22:08:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:24 smithi044 bash[22199]: audit 2024-09-20T22:08:24.136203+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.44:0/3470447483' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-20T22:08:24.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:24.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-09-20T22:08:24.683 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = True 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:24.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-09-20T22:08:24.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-20T22:08:24.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-20T22:08:24.685 INFO:teuthology.orchestra.run.smithi044.stdout:Generating new minimal ceph.conf... 2024-09-20T22:08:26.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:25 smithi044 bash[22199]: audit 2024-09-20T22:08:25.776299+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.44:0/1142118466' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:08:26.264 INFO:teuthology.orchestra.run.smithi044.stdout:Restarting the monitor... 2024-09-20T22:08:26.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:26 smithi044 systemd[1]: Stopping Ceph mon.a for 68d7421e-779c-11ef-baf5-efdc52797490... 2024-09-20T22:08:26.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:26 smithi044 bash[22199]: debug 2024-09-20T22:08:26.413+0000 7fec49394640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-20T22:08:26.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:26 smithi044 bash[22199]: debug 2024-09-20T22:08:26.413+0000 7fec49394640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-20T22:08:27.029 INFO:teuthology.orchestra.run.smithi044.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-20T22:08:27.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:26 smithi044 bash[22581]: ceph-68d7421e-779c-11ef-baf5-efdc52797490-mon-a 2024-09-20T22:08:27.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:27 smithi044 bash[22641]: Error response from daemon: No such container: ceph-68d7421e-779c-11ef-baf5-efdc52797490-mon-a 2024-09-20T22:08:27.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:27 smithi044 systemd[1]: ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-20T22:08:27.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:27 smithi044 systemd[1]: Stopped Ceph mon.a for 68d7421e-779c-11ef-baf5-efdc52797490. 2024-09-20T22:08:27.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:27 smithi044 systemd[1]: Started Ceph mon.a for 68d7421e-779c-11ef-baf5-efdc52797490. 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.548+0000 7f8f621e5c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.548+0000 7f8f621e5c80 0 ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 7 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.548+0000 7f8f621e5c80 0 pidfile_write: ignore empty --pid-file 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 0 load: jerasure load: lrc 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Git sha 0 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: DB SUMMARY 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: DB Session ID: NTI9LTNVY2H2ZJNT18PB 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: CURRENT file: CURRENT 2024-09-20T22:08:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88783 ; 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.error_if_exists: 0 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.create_if_missing: 0 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.env: 0x5579277d0940 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.info_log: 0x557928df76e0 2024-09-20T22:08:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.statistics: (nil) 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.use_fsync: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T22:08:28.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.db_log_dir: 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.wal_dir: 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.write_buffer_manager: 0x557928e06dc0 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T22:08:28.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.unordered_write: 0 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.row_cache: None 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.wal_filter: None 2024-09-20T22:08:28.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.two_write_queues: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.wal_compression: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.atomic_flush: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T22:08:28.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_open_files: -1 2024-09-20T22:08:28.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Compression algorithms supported: 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kZSTD supported: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kXpressCompression supported: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kZlibCompression supported: 1 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-20T22:08:28.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-20T22:08:28.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T22:08:28.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T22:08:28.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-20T22:08:28.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T22:08:28.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T22:08:28.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.merge_operator: 2024-09-20T22:08:28.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_filter: None 2024-09-20T22:08:28.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-20T22:08:28.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-20T22:08:28.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557928df7320) 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cache_index_and_filter_blocks: 1 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: pin_top_level_index_and_filter: 1 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: index_type: 0 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: data_block_index_type: 0 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: index_shortening: 1 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: data_block_hash_table_util_ratio: 0.750000 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: checksum: 4 2024-09-20T22:08:28.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: no_block_cache: 0 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_cache: 0x557928ded1f0 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_cache_name: BinnedLRUCache 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_cache_options: 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: capacity : 536870912 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: num_shard_bits : 4 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: strict_capacity_limit : 0 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: high_pri_pool_ratio: 0.000 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_cache_compressed: (nil) 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: persistent_cache: (nil) 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_size: 4096 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_size_deviation: 10 2024-09-20T22:08:28.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_restart_interval: 16 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: index_block_restart_interval: 1 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: metadata_block_size: 4096 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: partition_filters: 0 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: use_delta_encoding: 1 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: filter_policy: bloomfilter 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: whole_key_filtering: 1 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: verify_compression: 0 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: read_amp_bytes_per_bit: 0 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: format_version: 5 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: enable_index_compression: 1 2024-09-20T22:08:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: block_align: 0 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: max_auto_readahead_size: 262144 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: prepopulate_block_cache: 0 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: initial_auto_readahead_size: 8192 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: num_file_reads_for_auto_readahead: 2 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression: NoCompression 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.num_levels: 7 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T22:08:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T22:08:28.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T22:08:28.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T22:08:28.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T22:08:28.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.bloom_locality: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.ttl: 2592000 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.enable_blob_files: false 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.min_blob_size: 0 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T22:08:28.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d92169f6-aeed-412b-8876-b24a5e957c6a 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870108556553, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.552+0000 7f8f621e5c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f621e5c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870108557580, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85400, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 258, "table_properties": {"data_size": 83547, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10201, "raw_average_key_size": 47, "raw_value_size": 77754, "raw_average_value_size": 358, "num_data_blocks": 11, "num_entries": 217, "num_filter_entries": 217, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726870108, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d92169f6-aeed-412b-8876-b24a5e957c6a", "db_session_id": "NTI9LTNVY2H2ZJNT18PB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f621e5c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870108557714, "job": 1, "event": "recovery_finished"} 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f621e5c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f621e5c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T22:08:28.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f621e5c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557928e18e00 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f621e5c80 4 rocksdb: DB pointer 0x557928f18000 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f57fae640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f57fae640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: ** DB Stats ** 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: ** Compaction Stats [default] ** 2024-09-20T22:08:28.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: L0 2/0 85.26 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Sum 2/0 85.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: ** Compaction Stats [default] ** 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 124.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: AddFile(Keys): cumulative 0, interval 0 2024-09-20T22:08:28.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Cumulative compaction: 0.00 GB write, 20.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Interval compaction: 0.00 GB write, 20.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Block cache BinnedLRUCache@0x557928ded1f0#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: ** File Read Latency Histogram By Level [default] ** 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.556+0000 7f8f621e5c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] at bind addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 1 mon.a@-1(???) e1 preinit fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 0 mon.a@-1(???).mds e1 new map 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 0 mon.a@-1(???).mds e1 print_map 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: e1 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: btime 2024-09-20T22:08:22:262326+0000 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: legacy client fscid: -1 2024-09-20T22:08:28.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: No filesystems configured 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: debug 2024-09-20T22:08:28.560+0000 7f8f621e5c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.565888+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.565996+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566013+0000 mon.a (mon.0) 3 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566027+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-20T22:08:17.833594+0000 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566065+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566082+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566095+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-20T22:08:28.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566128+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:08:28.763 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566758+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-20T22:08:28.763 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.566827+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-20T22:08:28.763 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:28 smithi044 bash[22676]: cluster 2024-09-20T22:08:28.567397+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-20T22:08:29.309 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-20T22:08:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-20T22:08:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mgr... 2024-09-20T22:08:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-20T22:08:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-20T22:08:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-68d7421e-779c-11ef-baf5-efdc52797490@mgr.a 2024-09-20T22:08:29.627 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-68d7421e-779c-11ef-baf5-efdc52797490@mgr.a.service: Unit ceph-68d7421e-779c-11ef-baf5-efdc52797490@mgr.a.service not loaded. 2024-09-20T22:08:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:29 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:08:29.833 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490.target.wants/ceph-68d7421e-779c-11ef-baf5-efdc52797490@mgr.a.service -> /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service. 2024-09-20T22:08:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld does not appear to be present 2024-09-20T22:08:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-09-20T22:08:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld does not appear to be present 2024-09-20T22:08:29.841 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-20T22:08:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr to start... 2024-09-20T22:08:29.842 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr... 2024-09-20T22:08:30.026 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:29 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:08:30.026 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:29 smithi044 bash[22676]: audit 2024-09-20T22:08:28.771045+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.44:0/3958029167' entity='client.admin' 2024-09-20T22:08:31.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:31 smithi044 bash[22930]: debug 2024-09-20T22:08:31.364+0000 7fda74134040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T22:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:31 smithi044 bash[22676]: audit 2024-09-20T22:08:31.512153+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.44:0/1618076700' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T22:08:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-09-20T22:08:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "68d7421e-779c-11ef-baf5-efdc52797490", 2024-09-20T22:08:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T22:08:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T22:08:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T22:08:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T22:08:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:32.060 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T22:08:32.061 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T22:08:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T22:08:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T22:08:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T22:08:32.064 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T22:08:22:262326+0000", 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-20T22:08:32.065 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T22:08:22.263194+0000", 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-09-20T22:08:32.066 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (1/15)... 2024-09-20T22:08:32.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:32 smithi044 bash[22930]: debug 2024-09-20T22:08:32.616+0000 7fda74134040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T22:08:32.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:32 smithi044 bash[22930]: debug 2024-09-20T22:08:32.684+0000 7fda74134040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T22:08:32.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:32 smithi044 bash[22930]: debug 2024-09-20T22:08:32.840+0000 7fda74134040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T22:08:33.865 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:33 smithi044 bash[22930]: debug 2024-09-20T22:08:33.524+0000 7fda74134040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T22:08:33.865 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:33 smithi044 bash[22930]: debug 2024-09-20T22:08:33.596+0000 7fda74134040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T22:08:33.865 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:33 smithi044 bash[22930]: debug 2024-09-20T22:08:33.668+0000 7fda74134040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T22:08:33.865 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:33 smithi044 bash[22930]: debug 2024-09-20T22:08:33.860+0000 7fda74134040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T22:08:34.167 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:33 smithi044 bash[22930]: debug 2024-09-20T22:08:33.940+0000 7fda74134040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T22:08:34.167 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:34 smithi044 bash[22930]: debug 2024-09-20T22:08:34.012+0000 7fda74134040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T22:08:34.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:34 smithi044 bash[22930]: debug 2024-09-20T22:08:34.280+0000 7fda74134040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T22:08:34.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:34 smithi044 bash[22930]: debug 2024-09-20T22:08:34.348+0000 7fda74134040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T22:08:34.902 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:34 smithi044 bash[22930]: debug 2024-09-20T22:08:34.552+0000 7fda74134040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T22:08:34.902 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:34 smithi044 bash[22930]: debug 2024-09-20T22:08:34.636+0000 7fda74134040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T22:08:35.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:34 smithi044 bash[22930]: debug 2024-09-20T22:08:34.896+0000 7fda74134040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T22:08:35.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:35 smithi044 bash[22930]: debug 2024-09-20T22:08:35.088+0000 7fda74134040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:08:35.536 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:35 smithi044 bash[22676]: audit 2024-09-20T22:08:35.261316+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.44:0/2070565804' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T22:08:35.537 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:35 smithi044 bash[22930]: debug 2024-09-20T22:08:35.260+0000 7fda74134040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T22:08:35.537 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:35 smithi044 bash[22930]: debug 2024-09-20T22:08:35.344+0000 7fda74134040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "68d7421e-779c-11ef-baf5-efdc52797490", 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:35.782 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T22:08:35.783 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:35.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T22:08:35.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T22:08:35.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T22:08:35.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T22:08:35.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T22:08:35.784 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T22:08:35.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:35.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T22:08:35.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T22:08:35.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T22:08:35.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T22:08:22:262326+0000", 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:35.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T22:08:22.263194+0000", 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T22:08:35.790 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-09-20T22:08:35.790 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (2/15)... 2024-09-20T22:08:36.691 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:35 smithi044 bash[22930]: debug 2024-09-20T22:08:35.532+0000 7fda74134040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:08:36.691 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:36 smithi044 bash[22930]: debug 2024-09-20T22:08:36.376+0000 7fda74134040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T22:08:36.691 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:36 smithi044 bash[22930]: debug 2024-09-20T22:08:36.452+0000 7fda74134040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T22:08:36.691 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:36 smithi044 bash[22930]: debug 2024-09-20T22:08:36.688+0000 7fda74134040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T22:08:36.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:36 smithi044 bash[22930]: debug 2024-09-20T22:08:36.764+0000 7fda74134040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T22:08:37.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22930]: debug 2024-09-20T22:08:37.168+0000 7fda74134040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T22:08:37.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22930]: debug 2024-09-20T22:08:37.252+0000 7fda74134040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T22:08:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: cluster 2024-09-20T22:08:37.275637+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon a 2024-09-20T22:08:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: cluster 2024-09-20T22:08:37.279169+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: a(active, starting, since 0.00373891s) 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.283161+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.283688+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.284139+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.284588+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.285035+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: cluster 2024-09-20T22:08:37.307234+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon a is now available 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.319086+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.321062+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-20T22:08:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:37 smithi044 bash[22676]: audit 2024-09-20T22:08:37.323369+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' 2024-09-20T22:08:38.678 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:38 smithi044 bash[22676]: audit 2024-09-20T22:08:37.328724+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' 2024-09-20T22:08:38.678 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:38 smithi044 bash[22676]: audit 2024-09-20T22:08:37.339002+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.44:0/1493890156' entity='mgr.a' 2024-09-20T22:08:38.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:38 smithi044 bash[22676]: cluster 2024-09-20T22:08:38.291457+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: a(active, since 1.01601s) 2024-09-20T22:08:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "68d7421e-779c-11ef-baf5-efdc52797490", 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:39.858 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-20T22:08:39.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T22:08:39.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T22:08:39.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:39.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T22:08:39.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T22:08:39.864 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T22:08:22:262326+0000", 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T22:08:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:39.866 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T22:08:39.867 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T22:08:39.867 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T22:08:22.263194+0000", 2024-09-20T22:08:39.867 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T22:08:39.867 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-09-20T22:08:39.867 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T22:08:39.867 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-09-20T22:08:39.867 INFO:teuthology.orchestra.run.smithi044.stdout:mgr is available 2024-09-20T22:08:40.656 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:40 smithi044 bash[22676]: cluster 2024-09-20T22:08:39.343194+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e4: a(active, since 2s) 2024-09-20T22:08:40.656 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:40 smithi044 bash[22676]: audit 2024-09-20T22:08:39.343423+0000 mon.a (mon.0) 30 : audit [DBG] from='client.? 172.21.15.44:0/3061847692' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T22:08:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:41 smithi044 bash[22676]: audit 2024-09-20T22:08:41.180129+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.44:0/1613929440' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T22:08:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:41 smithi044 bash[22676]: audit 2024-09-20T22:08:41.184228+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.44:0/1613929440' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-20T22:08:41.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:41.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-09-20T22:08:41.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:41.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-09-20T22:08:41.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-20T22:08:41.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-20T22:08:41.680 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-20T22:08:41.681 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling cephadm module... 2024-09-20T22:08:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:43 smithi044 bash[22676]: audit 2024-09-20T22:08:43.073933+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.44:0/188224560' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-20T22:08:43.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:43 smithi044 bash[22930]: ignoring --setuser ceph since I am not root 2024-09-20T22:08:43.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:43 smithi044 bash[22930]: ignoring --setgroup ceph since I am not root 2024-09-20T22:08:43.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:43 smithi044 bash[22930]: debug 2024-09-20T22:08:43.280+0000 7f9a00cbf040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T22:08:44.384 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:44 smithi044 bash[22676]: audit 2024-09-20T22:08:43.125807+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.44:0/188224560' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-20T22:08:44.385 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:44 smithi044 bash[22676]: cluster 2024-09-20T22:08:43.130911+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: a(active, since 5s) 2024-09-20T22:08:44.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:44 smithi044 bash[22930]: debug 2024-09-20T22:08:44.520+0000 7f9a00cbf040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T22:08:44.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:44 smithi044 bash[22930]: debug 2024-09-20T22:08:44.592+0000 7f9a00cbf040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T22:08:45.009 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:44 smithi044 bash[22930]: debug 2024-09-20T22:08:44.748+0000 7f9a00cbf040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T22:08:45.432 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:45 smithi044 bash[22676]: audit 2024-09-20T22:08:44.996214+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.15.44:0/1586840468' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T22:08:45.457 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-09-20T22:08:45.457 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-20T22:08:45.457 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T22:08:45.457 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-09-20T22:08:45.457 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-20T22:08:45.457 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-09-20T22:08:45.458 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-09-20T22:08:45.458 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 5... 2024-09-20T22:08:45.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:45 smithi044 bash[22930]: debug 2024-09-20T22:08:45.428+0000 7f9a00cbf040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T22:08:45.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:45 smithi044 bash[22930]: debug 2024-09-20T22:08:45.504+0000 7f9a00cbf040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T22:08:45.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:45 smithi044 bash[22930]: debug 2024-09-20T22:08:45.576+0000 7f9a00cbf040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T22:08:46.193 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:45 smithi044 bash[22930]: debug 2024-09-20T22:08:45.768+0000 7f9a00cbf040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T22:08:46.193 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:45 smithi044 bash[22930]: debug 2024-09-20T22:08:45.848+0000 7f9a00cbf040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T22:08:46.193 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:45 smithi044 bash[22930]: debug 2024-09-20T22:08:45.920+0000 7f9a00cbf040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T22:08:46.454 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:46 smithi044 bash[22930]: debug 2024-09-20T22:08:46.188+0000 7f9a00cbf040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T22:08:46.454 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:46 smithi044 bash[22930]: debug 2024-09-20T22:08:46.260+0000 7f9a00cbf040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T22:08:46.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:46 smithi044 bash[22930]: debug 2024-09-20T22:08:46.468+0000 7f9a00cbf040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T22:08:46.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:46 smithi044 bash[22930]: debug 2024-09-20T22:08:46.552+0000 7f9a00cbf040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T22:08:47.173 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:46 smithi044 bash[22930]: debug 2024-09-20T22:08:46.816+0000 7f9a00cbf040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T22:08:47.174 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:47 smithi044 bash[22930]: debug 2024-09-20T22:08:47.000+0000 7f9a00cbf040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:08:47.174 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:47 smithi044 bash[22930]: debug 2024-09-20T22:08:47.168+0000 7f9a00cbf040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T22:08:47.443 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:47 smithi044 bash[22930]: debug 2024-09-20T22:08:47.252+0000 7f9a00cbf040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T22:08:47.444 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:47 smithi044 bash[22930]: debug 2024-09-20T22:08:47.440+0000 7f9a00cbf040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:08:48.594 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:48 smithi044 bash[22930]: debug 2024-09-20T22:08:48.276+0000 7f9a00cbf040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T22:08:48.594 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:48 smithi044 bash[22930]: debug 2024-09-20T22:08:48.356+0000 7f9a00cbf040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T22:08:48.594 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:48 smithi044 bash[22930]: debug 2024-09-20T22:08:48.588+0000 7f9a00cbf040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T22:08:48.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:48 smithi044 bash[22930]: debug 2024-09-20T22:08:48.668+0000 7f9a00cbf040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T22:08:49.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22930]: debug 2024-09-20T22:08:49.076+0000 7f9a00cbf040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T22:08:49.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22930]: debug 2024-09-20T22:08:49.156+0000 7f9a00cbf040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T22:08:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: cluster 2024-09-20T22:08:49.178984+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon a restarted 2024-09-20T22:08:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: cluster 2024-09-20T22:08:49.179726+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon a 2024-09-20T22:08:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: cluster 2024-09-20T22:08:49.188717+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-20T22:08:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: cluster 2024-09-20T22:08:49.188948+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: a(active, starting, since 0.00954571s) 2024-09-20T22:08:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: audit 2024-09-20T22:08:49.189856+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:08:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: audit 2024-09-20T22:08:49.191942+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-20T22:08:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: audit 2024-09-20T22:08:49.192722+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T22:08:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: audit 2024-09-20T22:08:49.192856+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T22:08:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: audit 2024-09-20T22:08:49.192988+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T22:08:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:49 smithi044 bash[22676]: cluster 2024-09-20T22:08:49.215539+0000 mon.a (mon.0) 46 : cluster [INF] Manager daemon a is now available 2024-09-20T22:08:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: cephadm 2024-09-20T22:08:49.227644+0000 mgr.a (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-20T22:08:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:49.232493+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:49.243755+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:49.248838+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:49.252123+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:08:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:49.255287+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:08:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:49.265379+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-20T22:08:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:49.267937+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-20T22:08:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:50.139561+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: audit 2024-09-20T22:08:50.143408+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:50 smithi044 bash[22676]: cluster 2024-09-20T22:08:50.190885+0000 mon.a (mon.0) 56 : cluster [DBG] mgrmap e7: a(active, since 1.01147s) 2024-09-20T22:08:50.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-09-20T22:08:50.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-20T22:08:50.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-20T22:08:50.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-09-20T22:08:50.773 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 5 is available 2024-09-20T22:08:50.773 INFO:teuthology.orchestra.run.smithi044.stdout:Setting orchestrator backend to cephadm... 2024-09-20T22:08:51.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22676]: audit 2024-09-20T22:08:50.191352+0000 mgr.a (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-20T22:08:51.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22676]: audit 2024-09-20T22:08:50.205856+0000 mgr.a (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-20T22:08:51.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: debug 2024-09-20T22:08:51.600+0000 7f9967ffe640 -1 log_channel(cephadm) log [ERR] : [20/Sep/2024:22:08:51] ENGINE Error in HTTPServer.serve 2024-09-20T22:08:51.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: Traceback (most recent call last): 2024-09-20T22:08:51.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:08:51.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: self._connections.run(self.expiration_interval) 2024-09-20T22:08:51.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:08:51.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: self._run(expiration_interval) 2024-09-20T22:08:51.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:08:51.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:08:51.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:08:51.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:08:51.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:08:51.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: s = self.context.wrap_socket( 2024-09-20T22:08:51.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:08:51.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: return self.sslsocket_class._create( 2024-09-20T22:08:51.991 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:08:51.991 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: self.do_handshake() 2024-09-20T22:08:51.991 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:08:51.991 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: self._sslobj.do_handshake() 2024-09-20T22:08:51.991 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:51 smithi044 bash[22930]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: cluster 2024-09-20T22:08:51.241174+0000 mon.a (mon.0) 57 : cluster [DBG] mgrmap e8: a(active, since 2s) 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: cephadm 2024-09-20T22:08:51.373379+0000 mgr.a (mgr.14118) 4 : cephadm [INF] [20/Sep/2024:22:08:51] ENGINE Bus STARTING 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: cephadm 2024-09-20T22:08:51.474971+0000 mgr.a (mgr.14118) 5 : cephadm [INF] [20/Sep/2024:22:08:51] ENGINE Serving on http://172.21.15.44:8765 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: cephadm 2024-09-20T22:08:51.600015+0000 mgr.a (mgr.14118) 6 : cephadm [INF] [20/Sep/2024:22:08:51] ENGINE Serving on https://172.21.15.44:7150 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: cephadm 2024-09-20T22:08:51.600105+0000 mgr.a (mgr.14118) 7 : cephadm [INF] [20/Sep/2024:22:08:51] ENGINE Bus STARTED 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: audit 2024-09-20T22:08:51.600861+0000 mon.a (mon.0) 58 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: cephadm 2024-09-20T22:08:51.602238+0000 mgr.a (mgr.14118) 8 : cephadm [ERR] [20/Sep/2024:22:08:51] ENGINE Error in HTTPServer.serve 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: Traceback (most recent call last): 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: self._connections.run(self.expiration_interval) 2024-09-20T22:08:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: self._run(expiration_interval) 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: s = self.context.wrap_socket( 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: return self.sslsocket_class._create( 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: self.do_handshake() 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:08:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: self._sslobj.do_handshake() 2024-09-20T22:08:52.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:08:52.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: audit 2024-09-20T22:08:52.087480+0000 mgr.a (mgr.14118) 9 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:08:52.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: audit 2024-09-20T22:08:52.095240+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:52.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:52 smithi044 bash[22676]: audit 2024-09-20T22:08:52.113306+0000 mon.a (mon.0) 60 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:08:54.411 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-20T22:08:54.412 INFO:teuthology.orchestra.run.smithi044.stdout:Generating ssh key... 2024-09-20T22:08:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:54 smithi044 bash[22676]: audit 2024-09-20T22:08:53.875936+0000 mgr.a (mgr.14118) 10 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:08:56.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: Generating public/private rsa key pair. 2024-09-20T22:08:56.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: Your identification has been saved in /tmp/tmpi1cwkcxf/key 2024-09-20T22:08:56.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: Your public key has been saved in /tmp/tmpi1cwkcxf/key.pub 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: The key fingerprint is: 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: SHA256:hC9Lg7VntHNCOs1TpXWdHu806LYAQnttJZnCYVgqWBA ceph-68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: The key's randomart image is: 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: +---[RSA 3072]----+ 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | Eo. ++. = ...| 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | o +oo B o o.| 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | . .+.= = o o o| 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | o.% = o . oo| 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | . B S + . o.| 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | . B = . o .| 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | . o . | 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | . | 2024-09-20T22:08:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: | | 2024-09-20T22:08:56.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:08:55 smithi044 bash[22930]: +----[SHA256]-----+ 2024-09-20T22:08:57.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:56 smithi044 bash[22676]: audit 2024-09-20T22:08:55.792389+0000 mgr.a (mgr.14118) 11 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:08:57.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:56 smithi044 bash[22676]: cephadm 2024-09-20T22:08:55.792633+0000 mgr.a (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-20T22:08:57.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:56 smithi044 bash[22676]: audit 2024-09-20T22:08:55.942481+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:57.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:56 smithi044 bash[22676]: audit 2024-09-20T22:08:55.947006+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:08:58.341 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnombJV5aQUZBhg8EcxsDBQ6FAGFTSLMnCmGKWI+qiDUC707vAaQ1o68m+bEyhRKkR00IOgci5IlZH9mulZHItcWUiJZ/pe3Xa4Y477Q0J6O+yHAaG+Yji4HFgH998pwDqX1ziQGFJuwBYNDrqxg/Lvjm/aEko2sj1rY8ZbwdlLJlph1wTMiVrkq9yIBvFK7OLYxIh6WmOukAFOmd3kPVsxhRF1/ATVpnkjDcy8MmJ5Bz0tEN3g4I0mwM7uIB8LCFDvBSyd4/BQ6lS0FFGyu3wyrkfHsIGzxW/LVWGDEgELPFifztEe38IAPk3+sNng4SE3GLT/7b+p2UqStBXNd+FYblB9q1xe092ekN7QJ7Dpl+6ED8CYKur+FR+ccWFzdqzG4BYQyDOydxtYIFJAFpIUQyyJBLkP4uc06NirF//s+NgKvZ0cMr3f+V2w736cbUbsmPBsCKWl8gY+A13qO0o+LLhZCwJp68G1x3cTj2FZPsYobhKqh6dzkT7c544dKM= ceph-68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:08:58.342 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-20T22:08:58.342 INFO:teuthology.orchestra.run.smithi044.stdout:Adding key to root@localhost authorized_keys... 2024-09-20T22:08:58.342 INFO:teuthology.orchestra.run.smithi044.stdout:Adding host smithi044... 2024-09-20T22:08:58.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:08:58 smithi044 bash[22676]: audit 2024-09-20T22:08:57.815416+0000 mgr.a (mgr.14118) 13 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:00 smithi044 bash[22676]: audit 2024-09-20T22:08:59.769268+0000 mgr.a (mgr.14118) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "addr": "172.21.15.44", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:01 smithi044 bash[22676]: cephadm 2024-09-20T22:09:01.065911+0000 mgr.a (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi044 2024-09-20T22:09:05.249 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Added host 'smithi044' with addr '172.21.15.44' 2024-09-20T22:09:05.249 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mon service... 2024-09-20T22:09:05.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:05 smithi044 bash[22676]: audit 2024-09-20T22:09:04.638088+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:09:05.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:05 smithi044 bash[22676]: cephadm 2024-09-20T22:09:04.638470+0000 mgr.a (mgr.14118) 16 : cephadm [INF] Added host smithi044 2024-09-20T22:09:05.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:05 smithi044 bash[22676]: audit 2024-09-20T22:09:04.638927+0000 mon.a (mon.0) 64 : audit [DBG] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:09:07.954 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-20T22:09:07.954 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mgr service... 2024-09-20T22:09:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:08 smithi044 bash[22676]: audit 2024-09-20T22:09:07.284235+0000 mgr.a (mgr.14118) 17 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:08 smithi044 bash[22676]: cephadm 2024-09-20T22:09:07.287277+0000 mgr.a (mgr.14118) 18 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-20T22:09:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:08 smithi044 bash[22676]: audit 2024-09-20T22:09:07.290968+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:09:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:08 smithi044 bash[22676]: audit 2024-09-20T22:09:07.685158+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:09:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:08 smithi044 bash[22676]: audit 2024-09-20T22:09:08.267472+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:09:09.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-20T22:09:10.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:10 smithi044 bash[22676]: cluster 2024-09-20T22:09:09.194281+0000 mgr.a (mgr.14118) 19 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:10.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:10 smithi044 bash[22676]: audit 2024-09-20T22:09:09.321044+0000 mgr.a (mgr.14118) 20 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:10.650 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:10 smithi044 bash[22676]: cephadm 2024-09-20T22:09:09.323314+0000 mgr.a (mgr.14118) 21 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-20T22:09:10.650 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:10 smithi044 bash[22676]: audit 2024-09-20T22:09:09.327875+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14118 172.21.15.44:0/674705969' entity='mgr.a' 2024-09-20T22:09:12.449 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:12 smithi044 bash[22676]: cluster 2024-09-20T22:09:11.194540+0000 mgr.a (mgr.14118) 22 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:12.449 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:12 smithi044 bash[22676]: audit 2024-09-20T22:09:11.196455+0000 mon.a (mon.0) 69 : audit [INF] from='client.? 172.21.15.44:0/2934219734' entity='client.admin' 2024-09-20T22:09:13.515 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling the dashboard module... 2024-09-20T22:09:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:13 smithi044 bash[22676]: audit 2024-09-20T22:09:12.974716+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.44:0/862549638' entity='client.admin' 2024-09-20T22:09:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:14 smithi044 bash[22676]: cluster 2024-09-20T22:09:13.194834+0000 mgr.a (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:14 smithi044 bash[22676]: audit 2024-09-20T22:09:14.950220+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.44:0/4210517474' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-20T22:09:15.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:15 smithi044 bash[22930]: ignoring --setuser ceph since I am not root 2024-09-20T22:09:15.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:15 smithi044 bash[22930]: ignoring --setgroup ceph since I am not root 2024-09-20T22:09:15.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:15 smithi044 bash[22930]: debug 2024-09-20T22:09:15.156+0000 7f5bab98b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T22:09:16.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:15 smithi044 bash[22676]: audit 2024-09-20T22:09:14.990030+0000 mon.a (mon.0) 72 : audit [INF] from='client.? 172.21.15.44:0/4210517474' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-20T22:09:16.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:15 smithi044 bash[22676]: cluster 2024-09-20T22:09:14.995176+0000 mon.a (mon.0) 73 : cluster [DBG] mgrmap e9: a(active, since 25s) 2024-09-20T22:09:16.651 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:16 smithi044 bash[22930]: debug 2024-09-20T22:09:16.412+0000 7f5bab98b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T22:09:16.652 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:16 smithi044 bash[22930]: debug 2024-09-20T22:09:16.484+0000 7f5bab98b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T22:09:16.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:16 smithi044 bash[22930]: debug 2024-09-20T22:09:16.648+0000 7f5bab98b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T22:09:17.337 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:17 smithi044 bash[22676]: audit 2024-09-20T22:09:17.035352+0000 mon.a (mon.0) 74 : audit [DBG] from='client.? 172.21.15.44:0/1835805214' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-09-20T22:09:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 9... 2024-09-20T22:09:17.656 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:17 smithi044 bash[22930]: debug 2024-09-20T22:09:17.332+0000 7f5bab98b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T22:09:17.657 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:17 smithi044 bash[22930]: debug 2024-09-20T22:09:17.408+0000 7f5bab98b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T22:09:17.657 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:17 smithi044 bash[22930]: debug 2024-09-20T22:09:17.480+0000 7f5bab98b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T22:09:17.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:17 smithi044 bash[22930]: debug 2024-09-20T22:09:17.680+0000 7f5bab98b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T22:09:17.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:17 smithi044 bash[22930]: debug 2024-09-20T22:09:17.760+0000 7f5bab98b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T22:09:17.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:17 smithi044 bash[22930]: debug 2024-09-20T22:09:17.832+0000 7f5bab98b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T22:09:18.381 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:18 smithi044 bash[22930]: debug 2024-09-20T22:09:18.100+0000 7f5bab98b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T22:09:18.381 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:18 smithi044 bash[22930]: debug 2024-09-20T22:09:18.172+0000 7f5bab98b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T22:09:18.730 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:18 smithi044 bash[22930]: debug 2024-09-20T22:09:18.376+0000 7f5bab98b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T22:09:18.730 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:18 smithi044 bash[22930]: debug 2024-09-20T22:09:18.460+0000 7f5bab98b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T22:09:18.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:18 smithi044 bash[22930]: debug 2024-09-20T22:09:18.728+0000 7f5bab98b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T22:09:18.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:18 smithi044 bash[22930]: debug 2024-09-20T22:09:18.912+0000 7f5bab98b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:09:19.354 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:19 smithi044 bash[22930]: debug 2024-09-20T22:09:19.080+0000 7f5bab98b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T22:09:19.354 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:19 smithi044 bash[22930]: debug 2024-09-20T22:09:19.164+0000 7f5bab98b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T22:09:20.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:19 smithi044 bash[22930]: debug 2024-09-20T22:09:19.348+0000 7f5bab98b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:09:20.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:20 smithi044 bash[22930]: debug 2024-09-20T22:09:20.204+0000 7f5bab98b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T22:09:20.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:20 smithi044 bash[22930]: debug 2024-09-20T22:09:20.284+0000 7f5bab98b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T22:09:20.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:20 smithi044 bash[22930]: debug 2024-09-20T22:09:20.516+0000 7f5bab98b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T22:09:20.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:20 smithi044 bash[22930]: debug 2024-09-20T22:09:20.592+0000 7f5bab98b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T22:09:21.359 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22930]: debug 2024-09-20T22:09:21.004+0000 7f5bab98b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T22:09:21.359 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22930]: debug 2024-09-20T22:09:21.084+0000 7f5bab98b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T22:09:21.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: cluster 2024-09-20T22:09:21.107729+0000 mon.a (mon.0) 75 : cluster [INF] Active manager daemon a restarted 2024-09-20T22:09:21.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: cluster 2024-09-20T22:09:21.108464+0000 mon.a (mon.0) 76 : cluster [INF] Activating manager daemon a 2024-09-20T22:09:21.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: cluster 2024-09-20T22:09:21.116194+0000 mon.a (mon.0) 77 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-20T22:09:21.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: cluster 2024-09-20T22:09:21.116347+0000 mon.a (mon.0) 78 : cluster [DBG] mgrmap e10: a(active, starting, since 0.00822526s) 2024-09-20T22:09:21.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: audit 2024-09-20T22:09:21.117811+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:09:21.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: audit 2024-09-20T22:09:21.118841+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-20T22:09:21.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: audit 2024-09-20T22:09:21.119771+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T22:09:21.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: audit 2024-09-20T22:09:21.120055+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T22:09:21.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: audit 2024-09-20T22:09:21.120312+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T22:09:21.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: cluster 2024-09-20T22:09:21.143183+0000 mon.a (mon.0) 84 : cluster [INF] Manager daemon a is now available 2024-09-20T22:09:21.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:21 smithi044 bash[22676]: audit 2024-09-20T22:09:21.159902+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:22 smithi044 bash[22676]: audit 2024-09-20T22:09:21.163945+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:09:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:22 smithi044 bash[22676]: audit 2024-09-20T22:09:21.180065+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-20T22:09:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:22 smithi044 bash[22676]: audit 2024-09-20T22:09:21.182667+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-20T22:09:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:22 smithi044 bash[22676]: cluster 2024-09-20T22:09:22.117314+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e11: a(active, since 1.00919s) 2024-09-20T22:09:22.712 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-09-20T22:09:22.712 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-20T22:09:22.712 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-20T22:09:22.712 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-09-20T22:09:22.712 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 9 is available 2024-09-20T22:09:22.712 INFO:teuthology.orchestra.run.smithi044.stdout:Generating a dashboard self-signed certificate... 2024-09-20T22:09:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22676]: cephadm 2024-09-20T22:09:22.985016+0000 mgr.a (mgr.14150) 3 : cephadm [INF] [20/Sep/2024:22:09:22] ENGINE Bus STARTING 2024-09-20T22:09:23.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: debug 2024-09-20T22:09:23.112+0000 7f5b16c92640 -1 log_channel(cephadm) log [ERR] : [20/Sep/2024:22:09:23] ENGINE Error in HTTPServer.serve 2024-09-20T22:09:23.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: Traceback (most recent call last): 2024-09-20T22:09:23.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:09:23.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: self._connections.run(self.expiration_interval) 2024-09-20T22:09:23.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: self._run(expiration_interval) 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: s = self.context.wrap_socket( 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: return self.sslsocket_class._create( 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: self.do_handshake() 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: self._sslobj.do_handshake() 2024-09-20T22:09:23.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:23 smithi044 bash[22930]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:09:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: cephadm 2024-09-20T22:09:23.109889+0000 mgr.a (mgr.14150) 4 : cephadm [INF] [20/Sep/2024:22:09:23] ENGINE Serving on https://172.21.15.44:7150 2024-09-20T22:09:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: cephadm 2024-09-20T22:09:23.113762+0000 mgr.a (mgr.14150) 5 : cephadm [ERR] [20/Sep/2024:22:09:23] ENGINE Error in HTTPServer.serve 2024-09-20T22:09:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: Traceback (most recent call last): 2024-09-20T22:09:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: self._connections.run(self.expiration_interval) 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: self._run(expiration_interval) 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: s = self.context.wrap_socket( 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: return self.sslsocket_class._create( 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: self.do_handshake() 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: self._sslobj.do_handshake() 2024-09-20T22:09:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:09:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: cluster 2024-09-20T22:09:23.168132+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e12: a(active, since 2s) 2024-09-20T22:09:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: cephadm 2024-09-20T22:09:23.211333+0000 mgr.a (mgr.14150) 6 : cephadm [INF] [20/Sep/2024:22:09:23] ENGINE Serving on http://172.21.15.44:8765 2024-09-20T22:09:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: cephadm 2024-09-20T22:09:23.211456+0000 mgr.a (mgr.14150) 7 : cephadm [INF] [20/Sep/2024:22:09:23] ENGINE Bus STARTED 2024-09-20T22:09:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: audit 2024-09-20T22:09:24.041044+0000 mgr.a (mgr.14150) 8 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: audit 2024-09-20T22:09:24.115952+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:24 smithi044 bash[22676]: audit 2024-09-20T22:09:24.118760+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:24.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-20T22:09:24.652 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial admin user... 2024-09-20T22:09:26.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:26 smithi044 bash[22676]: audit 2024-09-20T22:09:26.000831+0000 mgr.a (mgr.14150) 9 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:26.793 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$.7W6jNwgxayfInaBg.GsFudxzLewIvxPQXj9RFC2RBkpVB6YtjZfm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726870166, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-20T22:09:26.794 INFO:teuthology.orchestra.run.smithi044.stdout:Fetching dashboard port number... 2024-09-20T22:09:27.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:27 smithi044 bash[22676]: audit 2024-09-20T22:09:26.255263+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:28 smithi044 bash[22676]: cluster 2024-09-20T22:09:27.264228+0000 mon.a (mon.0) 94 : cluster [DBG] mgrmap e13: a(active, since 6s) 2024-09-20T22:09:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:28 smithi044 bash[22676]: audit 2024-09-20T22:09:27.872043+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:28 smithi044 bash[22676]: audit 2024-09-20T22:09:27.872677+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:09:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:28 smithi044 bash[22676]: audit 2024-09-20T22:09:27.875770+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:28 smithi044 bash[22676]: audit 2024-09-20T22:09:27.877073+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]: dispatch 2024-09-20T22:09:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:28 smithi044 bash[22676]: audit 2024-09-20T22:09:27.877658+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]': finished 2024-09-20T22:09:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:28 smithi044 bash[22676]: audit 2024-09-20T22:09:28.198184+0000 mon.a (mon.0) 100 : audit [DBG] from='client.? 172.21.15.44:0/186737516' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-20T22:09:28.708 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 8443 2024-09-20T22:09:28.708 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld does not appear to be present 2024-09-20T22:09:28.708 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-20T22:09:28.711 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph Dashboard is now available at: 2024-09-20T22:09:28.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:28.711 INFO:teuthology.orchestra.run.smithi044.stdout: URL: https://smithi044.front.sepia.ceph.com:8443/ 2024-09-20T22:09:28.712 INFO:teuthology.orchestra.run.smithi044.stdout: User: admin 2024-09-20T22:09:28.712 INFO:teuthology.orchestra.run.smithi044.stdout: Password: watbr5p1zx 2024-09-20T22:09:28.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:28.712 INFO:teuthology.orchestra.run.smithi044.stdout:Saving cluster configuration to /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config directory 2024-09-20T22:09:30.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:30 smithi044 bash[22676]: cephadm 2024-09-20T22:09:29.194342+0000 mgr.a (mgr.14150) 10 : cephadm [INF] Deploying daemon agent.smithi044 on smithi044 2024-09-20T22:09:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:Or, if you are only running a single cluster on this host: 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-20T22:09:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.783 INFO:teuthology.orchestra.run.smithi044.stdout: ceph telemetry on 2024-09-20T22:09:30.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:For more information see: 2024-09-20T22:09:30.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.783 INFO:teuthology.orchestra.run.smithi044.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-20T22:09:30.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:09:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:Bootstrap complete. 2024-09-20T22:09:30.827 INFO:tasks.cephadm:Fetching config... 2024-09-20T22:09:30.827 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:09:30.828 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-20T22:09:30.833 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-20T22:09:30.833 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:09:30.833 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-20T22:09:30.885 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-20T22:09:30.885 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:09:30.886 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-20T22:09:30.942 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-20T22:09:30.942 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:09:30.942 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-20T22:09:30.993 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-20T22:09:30.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnombJV5aQUZBhg8EcxsDBQ6FAGFTSLMnCmGKWI+qiDUC707vAaQ1o68m+bEyhRKkR00IOgci5IlZH9mulZHItcWUiJZ/pe3Xa4Y477Q0J6O+yHAaG+Yji4HFgH998pwDqX1ziQGFJuwBYNDrqxg/Lvjm/aEko2sj1rY8ZbwdlLJlph1wTMiVrkq9yIBvFK7OLYxIh6WmOukAFOmd3kPVsxhRF1/ATVpnkjDcy8MmJ5Bz0tEN3g4I0mwM7uIB8LCFDvBSyd4/BQ6lS0FFGyu3wyrkfHsIGzxW/LVWGDEgELPFifztEe38IAPk3+sNng4SE3GLT/7b+p2UqStBXNd+FYblB9q1xe092ekN7QJ7Dpl+6ED8CYKur+FR+ccWFzdqzG4BYQyDOydxtYIFJAFpIUQyyJBLkP4uc06NirF//s+NgKvZ0cMr3f+V2w736cbUbsmPBsCKWl8gY+A13qO0o+LLhZCwJp68G1x3cTj2FZPsYobhKqh6dzkT7c544dKM= ceph-68d7421e-779c-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T22:09:31.047 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnombJV5aQUZBhg8EcxsDBQ6FAGFTSLMnCmGKWI+qiDUC707vAaQ1o68m+bEyhRKkR00IOgci5IlZH9mulZHItcWUiJZ/pe3Xa4Y477Q0J6O+yHAaG+Yji4HFgH998pwDqX1ziQGFJuwBYNDrqxg/Lvjm/aEko2sj1rY8ZbwdlLJlph1wTMiVrkq9yIBvFK7OLYxIh6WmOukAFOmd3kPVsxhRF1/ATVpnkjDcy8MmJ5Bz0tEN3g4I0mwM7uIB8LCFDvBSyd4/BQ6lS0FFGyu3wyrkfHsIGzxW/LVWGDEgELPFifztEe38IAPk3+sNng4SE3GLT/7b+p2UqStBXNd+FYblB9q1xe092ekN7QJ7Dpl+6ED8CYKur+FR+ccWFzdqzG4BYQyDOydxtYIFJAFpIUQyyJBLkP4uc06NirF//s+NgKvZ0cMr3f+V2w736cbUbsmPBsCKWl8gY+A13qO0o+LLhZCwJp68G1x3cTj2FZPsYobhKqh6dzkT7c544dKM= ceph-68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:09:31.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnombJV5aQUZBhg8EcxsDBQ6FAGFTSLMnCmGKWI+qiDUC707vAaQ1o68m+bEyhRKkR00IOgci5IlZH9mulZHItcWUiJZ/pe3Xa4Y477Q0J6O+yHAaG+Yji4HFgH998pwDqX1ziQGFJuwBYNDrqxg/Lvjm/aEko2sj1rY8ZbwdlLJlph1wTMiVrkq9yIBvFK7OLYxIh6WmOukAFOmd3kPVsxhRF1/ATVpnkjDcy8MmJ5Bz0tEN3g4I0mwM7uIB8LCFDvBSyd4/BQ6lS0FFGyu3wyrkfHsIGzxW/LVWGDEgELPFifztEe38IAPk3+sNng4SE3GLT/7b+p2UqStBXNd+FYblB9q1xe092ekN7QJ7Dpl+6ED8CYKur+FR+ccWFzdqzG4BYQyDOydxtYIFJAFpIUQyyJBLkP4uc06NirF//s+NgKvZ0cMr3f+V2w736cbUbsmPBsCKWl8gY+A13qO0o+LLhZCwJp68G1x3cTj2FZPsYobhKqh6dzkT7c544dKM= ceph-68d7421e-779c-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T22:09:31.078 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnombJV5aQUZBhg8EcxsDBQ6FAGFTSLMnCmGKWI+qiDUC707vAaQ1o68m+bEyhRKkR00IOgci5IlZH9mulZHItcWUiJZ/pe3Xa4Y477Q0J6O+yHAaG+Yji4HFgH998pwDqX1ziQGFJuwBYNDrqxg/Lvjm/aEko2sj1rY8ZbwdlLJlph1wTMiVrkq9yIBvFK7OLYxIh6WmOukAFOmd3kPVsxhRF1/ATVpnkjDcy8MmJ5Bz0tEN3g4I0mwM7uIB8LCFDvBSyd4/BQ6lS0FFGyu3wyrkfHsIGzxW/LVWGDEgELPFifztEe38IAPk3+sNng4SE3GLT/7b+p2UqStBXNd+FYblB9q1xe092ekN7QJ7Dpl+6ED8CYKur+FR+ccWFzdqzG4BYQyDOydxtYIFJAFpIUQyyJBLkP4uc06NirF//s+NgKvZ0cMr3f+V2w736cbUbsmPBsCKWl8gY+A13qO0o+LLhZCwJp68G1x3cTj2FZPsYobhKqh6dzkT7c544dKM= ceph-68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:09:31.083 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:30 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:09:31.083 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:30 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:09:31.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnombJV5aQUZBhg8EcxsDBQ6FAGFTSLMnCmGKWI+qiDUC707vAaQ1o68m+bEyhRKkR00IOgci5IlZH9mulZHItcWUiJZ/pe3Xa4Y477Q0J6O+yHAaG+Yji4HFgH998pwDqX1ziQGFJuwBYNDrqxg/Lvjm/aEko2sj1rY8ZbwdlLJlph1wTMiVrkq9yIBvFK7OLYxIh6WmOukAFOmd3kPVsxhRF1/ATVpnkjDcy8MmJ5Bz0tEN3g4I0mwM7uIB8LCFDvBSyd4/BQ6lS0FFGyu3wyrkfHsIGzxW/LVWGDEgELPFifztEe38IAPk3+sNng4SE3GLT/7b+p2UqStBXNd+FYblB9q1xe092ekN7QJ7Dpl+6ED8CYKur+FR+ccWFzdqzG4BYQyDOydxtYIFJAFpIUQyyJBLkP4uc06NirF//s+NgKvZ0cMr3f+V2w736cbUbsmPBsCKWl8gY+A13qO0o+LLhZCwJp68G1x3cTj2FZPsYobhKqh6dzkT7c544dKM= ceph-68d7421e-779c-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T22:09:31.113 INFO:teuthology.orchestra.run.smithi179.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnombJV5aQUZBhg8EcxsDBQ6FAGFTSLMnCmGKWI+qiDUC707vAaQ1o68m+bEyhRKkR00IOgci5IlZH9mulZHItcWUiJZ/pe3Xa4Y477Q0J6O+yHAaG+Yji4HFgH998pwDqX1ziQGFJuwBYNDrqxg/Lvjm/aEko2sj1rY8ZbwdlLJlph1wTMiVrkq9yIBvFK7OLYxIh6WmOukAFOmd3kPVsxhRF1/ATVpnkjDcy8MmJ5Bz0tEN3g4I0mwM7uIB8LCFDvBSyd4/BQ6lS0FFGyu3wyrkfHsIGzxW/LVWGDEgELPFifztEe38IAPk3+sNng4SE3GLT/7b+p2UqStBXNd+FYblB9q1xe092ekN7QJ7Dpl+6ED8CYKur+FR+ccWFzdqzG4BYQyDOydxtYIFJAFpIUQyyJBLkP4uc06NirF//s+NgKvZ0cMr3f+V2w736cbUbsmPBsCKWl8gY+A13qO0o+LLhZCwJp68G1x3cTj2FZPsYobhKqh6dzkT7c544dKM= ceph-68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:09:31.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-20T22:09:31.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:09:31 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:09:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:31 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:09:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:31 smithi044 bash[22676]: audit 2024-09-20T22:09:30.285410+0000 mon.a (mon.0) 101 : audit [INF] from='client.? 172.21.15.44:0/47774720' entity='client.admin' 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.338887+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.341461+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.343693+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.357691+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.362213+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.364147+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.366047+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.367914+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.371746+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.386703+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:09:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.391824+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:32 smithi044 bash[22676]: audit 2024-09-20T22:09:31.876431+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:35.850 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:09:37.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:37 smithi044 bash[22676]: audit 2024-09-20T22:09:36.178195+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:37.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:37 smithi044 bash[22676]: audit 2024-09-20T22:09:36.206358+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:37.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:37 smithi044 bash[22676]: audit 2024-09-20T22:09:36.210356+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:37.912 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-20T22:09:37.912 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-20T22:09:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:38 smithi044 bash[22676]: audit 2024-09-20T22:09:37.351497+0000 mon.a (mon.0) 117 : audit [INF] from='client.? 172.21.15.44:0/1246468282' entity='client.admin' 2024-09-20T22:09:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:38 smithi044 bash[22676]: audit 2024-09-20T22:09:37.368415+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:09:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:38 smithi044 bash[22676]: audit 2024-09-20T22:09:37.373297+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:41.967 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:42 smithi044 bash[22676]: cluster 2024-09-20T22:09:41.121244+0000 mgr.a (mgr.14150) 11 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:44.479 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi049 2024-09-20T22:09:44.479 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:09:44.479 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/etc/ceph/ceph.conf 2024-09-20T22:09:44.485 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:09:44.485 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:09:44.533 INFO:tasks.cephadm:Adding host smithi049 to orchestrator... 2024-09-20T22:09:44.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch host add smithi049 2024-09-20T22:09:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: cluster 2024-09-20T22:09:43.121656+0000 mgr.a (mgr.14150) 12 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: audit 2024-09-20T22:09:43.531443+0000 mgr.a (mgr.14150) 13 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: audit 2024-09-20T22:09:43.533977+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: audit 2024-09-20T22:09:43.534644+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: audit 2024-09-20T22:09:43.536371+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: audit 2024-09-20T22:09:43.537012+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: cephadm 2024-09-20T22:09:43.537943+0000 mgr.a (mgr.14150) 14 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: cephadm 2024-09-20T22:09:43.626078+0000 mgr.a (mgr.14150) 15 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: cephadm 2024-09-20T22:09:43.710756+0000 mgr.a (mgr.14150) 16 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: cephadm 2024-09-20T22:09:43.799801+0000 mgr.a (mgr.14150) 17 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: audit 2024-09-20T22:09:43.990656+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:44 smithi044 bash[22676]: audit 2024-09-20T22:09:43.994289+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:45 smithi044 bash[22676]: audit 2024-09-20T22:09:44.563079+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:45 smithi044 bash[22676]: audit 2024-09-20T22:09:44.567098+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:46 smithi044 bash[22676]: cluster 2024-09-20T22:09:45.122104+0000 mgr.a (mgr.14150) 18 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:48 smithi044 bash[22676]: cluster 2024-09-20T22:09:47.122547+0000 mgr.a (mgr.14150) 19 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:49.262 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:09:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:50 smithi044 bash[22676]: cluster 2024-09-20T22:09:49.122966+0000 mgr.a (mgr.14150) 20 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:51 smithi044 bash[22676]: audit 2024-09-20T22:09:50.574196+0000 mgr.a (mgr.14150) 21 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:09:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:52 smithi044 bash[22676]: cluster 2024-09-20T22:09:51.123370+0000 mgr.a (mgr.14150) 22 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:52 smithi044 bash[22676]: cephadm 2024-09-20T22:09:51.889892+0000 mgr.a (mgr.14150) 23 : cephadm [INF] Deploying cephadm binary to smithi049 2024-09-20T22:09:54.832 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:54 smithi044 bash[22676]: cluster 2024-09-20T22:09:53.123786+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:55.601 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi049' with addr '172.21.15.49' 2024-09-20T22:09:56.083 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:55 smithi044 bash[22676]: audit 2024-09-20T22:09:54.789616+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:56.083 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:55 smithi044 bash[22676]: audit 2024-09-20T22:09:54.792621+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:56.083 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:55 smithi044 bash[22676]: audit 2024-09-20T22:09:54.796568+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:56.083 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:55 smithi044 bash[22676]: audit 2024-09-20T22:09:55.598899+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:56.083 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:55 smithi044 bash[22676]: audit 2024-09-20T22:09:55.600369+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:09:56.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-20T22:09:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:56 smithi044 bash[22676]: cluster 2024-09-20T22:09:55.124180+0000 mgr.a (mgr.14150) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:56 smithi044 bash[22676]: cephadm 2024-09-20T22:09:55.599694+0000 mgr.a (mgr.14150) 26 : cephadm [INF] Added host smithi049 2024-09-20T22:09:57.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:56 smithi044 bash[22676]: audit 2024-09-20T22:09:56.137713+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: cluster 2024-09-20T22:09:57.124562+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:57.682044+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:57.687602+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:57.689194+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:57.691448+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:57.693397+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: cephadm 2024-09-20T22:09:57.696079+0000 mgr.a (mgr.14150) 28 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: cephadm 2024-09-20T22:09:57.880401+0000 mgr.a (mgr.14150) 29 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: cephadm 2024-09-20T22:09:58.043428+0000 mgr.a (mgr.14150) 30 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:09:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:58.347236+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:58.352151+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:09:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:58.355179+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]: dispatch 2024-09-20T22:09:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:58 smithi044 bash[22676]: audit 2024-09-20T22:09:58.356497+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]': finished 2024-09-20T22:09:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:09:59 smithi044 bash[22676]: cephadm 2024-09-20T22:09:58.195778+0000 mgr.a (mgr.14150) 31 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: cluster 2024-09-20T22:09:59.124926+0000 mgr.a (mgr.14150) 32 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: cephadm 2024-09-20T22:09:59.368781+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Deploying daemon agent.smithi049 on smithi049 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.495617+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.501797+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.507700+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.565166+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.568887+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.570385+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.579109+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.637479+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.641499+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.643369+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:00 smithi044 bash[22676]: audit 2024-09-20T22:10:00.651938+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:01.161 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:10:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:02 smithi044 bash[22676]: audit 2024-09-20T22:10:01.048333+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:02 smithi044 bash[22676]: audit 2024-09-20T22:10:01.183364+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:02.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:10:02.523 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}] 2024-09-20T22:10:03.098 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi179 2024-09-20T22:10:03.098 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:10:03.098 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.conf 2024-09-20T22:10:03.104 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:10:03.104 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:10:03.151 INFO:tasks.cephadm:Adding host smithi179 to orchestrator... 2024-09-20T22:10:03.152 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch host add smithi179 2024-09-20T22:10:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:03 smithi044 bash[22676]: cluster 2024-09-20T22:10:01.125328+0000 mgr.a (mgr.14150) 34 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:03 smithi044 bash[22676]: audit 2024-09-20T22:10:02.131844+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:03 smithi044 bash[22676]: audit 2024-09-20T22:10:02.139504+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:04 smithi044 bash[22676]: audit 2024-09-20T22:10:02.521911+0000 mgr.a (mgr.14150) 35 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:10:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:05 smithi044 bash[22676]: cluster 2024-09-20T22:10:03.125723+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:07 smithi044 bash[22676]: cluster 2024-09-20T22:10:05.126079+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:07.887 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:10:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:08 smithi044 bash[22676]: cluster 2024-09-20T22:10:07.126483+0000 mgr.a (mgr.14150) 38 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:10 smithi044 bash[22676]: cluster 2024-09-20T22:10:09.126923+0000 mgr.a (mgr.14150) 39 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:10 smithi044 bash[22676]: audit 2024-09-20T22:10:09.682770+0000 mgr.a (mgr.14150) 40 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:11 smithi044 bash[22676]: cephadm 2024-09-20T22:10:11.004456+0000 mgr.a (mgr.14150) 41 : cephadm [INF] Deploying cephadm binary to smithi179 2024-09-20T22:10:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:12 smithi044 bash[22676]: cluster 2024-09-20T22:10:11.127308+0000 mgr.a (mgr.14150) 42 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:14 smithi044 bash[22676]: cluster 2024-09-20T22:10:13.127738+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:14.696 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi179' with addr '172.21.15.179' 2024-09-20T22:10:15.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:14.693995+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: cephadm 2024-09-20T22:10:14.694812+0000 mgr.a (mgr.14150) 44 : cephadm [INF] Added host smithi179 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:14.695656+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:14.904902+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:14.908648+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:14.912704+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:15.188046+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:15.196231+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:15 smithi044 bash[22676]: audit 2024-09-20T22:10:15.202502+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:16 smithi044 bash[22676]: cluster 2024-09-20T22:10:15.128190+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:16 smithi044 bash[22676]: audit 2024-09-20T22:10:16.769499+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:16 smithi044 bash[22676]: audit 2024-09-20T22:10:16.775679+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:16 smithi044 bash[22676]: audit 2024-09-20T22:10:16.777182+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:10:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:16 smithi044 bash[22676]: audit 2024-09-20T22:10:16.779587+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:16 smithi044 bash[22676]: audit 2024-09-20T22:10:16.781476+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:17 smithi044 bash[22676]: cephadm 2024-09-20T22:10:16.784319+0000 mgr.a (mgr.14150) 46 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:17 smithi044 bash[22676]: cephadm 2024-09-20T22:10:16.967243+0000 mgr.a (mgr.14150) 47 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:17 smithi044 bash[22676]: audit 2024-09-20T22:10:17.428793+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:17 smithi044 bash[22676]: audit 2024-09-20T22:10:17.435415+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:17 smithi044 bash[22676]: audit 2024-09-20T22:10:17.438588+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-20T22:10:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:17 smithi044 bash[22676]: audit 2024-09-20T22:10:17.440670+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]': finished 2024-09-20T22:10:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:18 smithi044 bash[22676]: cephadm 2024-09-20T22:10:17.126917+0000 mgr.a (mgr.14150) 48 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:10:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:18 smithi044 bash[22676]: cluster 2024-09-20T22:10:17.128623+0000 mgr.a (mgr.14150) 49 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:18 smithi044 bash[22676]: cephadm 2024-09-20T22:10:17.277387+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:10:20.038 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:10:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: cluster 2024-09-20T22:10:19.129005+0000 mgr.a (mgr.14150) 51 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: cephadm 2024-09-20T22:10:19.705309+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Deploying daemon agent.smithi179 on smithi179 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: audit 2024-09-20T22:10:20.811046+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: audit 2024-09-20T22:10:20.816455+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: audit 2024-09-20T22:10:20.821710+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: audit 2024-09-20T22:10:20.891496+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: audit 2024-09-20T22:10:20.895937+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: audit 2024-09-20T22:10:20.898091+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:20 smithi044 bash[22676]: audit 2024-09-20T22:10:20.906088+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:21.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:10:21.350 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}] 2024-09-20T22:10:21.915 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-20T22:10:21.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-20T22:10:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:20.984329+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:20.988524+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:20.990331+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:20.997365+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:21.187897+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:21.354337+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:21.695437+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:21.700820+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:21 smithi044 bash[22676]: audit 2024-09-20T22:10:21.708204+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:22 smithi044 bash[22676]: cluster 2024-09-20T22:10:21.129269+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:22 smithi044 bash[22676]: audit 2024-09-20T22:10:21.349188+0000 mgr.a (mgr.14150) 54 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:10:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:22 smithi044 bash[22676]: audit 2024-09-20T22:10:22.424683+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:22 smithi044 bash[22676]: audit 2024-09-20T22:10:22.431811+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:24 smithi044 bash[22676]: cluster 2024-09-20T22:10:23.129609+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:10:27.278 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:27 smithi044 bash[22676]: cluster 2024-09-20T22:10:25.130016+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:29.003 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-09-20T22:10:29.309 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:29 smithi044 bash[22676]: cluster 2024-09-20T22:10:27.130365+0000 mgr.a (mgr.14150) 57 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:29.309 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:29 smithi044 bash[22676]: audit 2024-09-20T22:10:28.123701+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.15.44:0/3132774907' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-20T22:10:29.656 INFO:tasks.cephadm:Adding mon.a on smithi044 2024-09-20T22:10:29.657 INFO:tasks.cephadm:Adding mon.b on smithi049 2024-09-20T22:10:29.657 INFO:tasks.cephadm:Adding mon.c on smithi179 2024-09-20T22:10:29.657 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi044:172.21.15.44=a;smithi049:172.21.15.49=b;smithi179:172.21.15.179=c' 2024-09-20T22:10:30.284 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:30 smithi044 bash[22676]: audit 2024-09-20T22:10:29.002479+0000 mon.a (mon.0) 194 : audit [INF] from='client.? 172.21.15.44:0/3132774907' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-20T22:10:30.284 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:30 smithi044 bash[22676]: cluster 2024-09-20T22:10:29.006916+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:30.867 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:31 smithi044 bash[22676]: cluster 2024-09-20T22:10:29.130674+0000 mgr.a (mgr.14150) 58 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:32.706 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled mon update... 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: cluster 2024-09-20T22:10:31.131044+0000 mgr.a (mgr.14150) 59 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: audit 2024-09-20T22:10:32.704823+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: audit 2024-09-20T22:10:32.706477+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: audit 2024-09-20T22:10:32.711626+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: audit 2024-09-20T22:10:32.713165+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: audit 2024-09-20T22:10:32.721299+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: audit 2024-09-20T22:10:32.726637+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:33 smithi044 bash[22676]: audit 2024-09-20T22:10:32.728567+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:33.656 DEBUG:teuthology.orchestra.run.smithi049:mon.b> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.b.service 2024-09-20T22:10:33.659 DEBUG:teuthology.orchestra.run.smithi179:mon.c> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@mon.c.service 2024-09-20T22:10:33.661 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-20T22:10:33.661 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T22:10:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:34 smithi044 bash[22676]: audit 2024-09-20T22:10:32.694351+0000 mgr.a (mgr.14150) 60 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi049:172.21.15.49=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:34 smithi044 bash[22676]: cephadm 2024-09-20T22:10:32.699468+0000 mgr.a (mgr.14150) 61 : cephadm [INF] Saving service mon spec with placement smithi044:172.21.15.44=a;smithi049:172.21.15.49=b;smithi179:172.21.15.179=c;count:3 2024-09-20T22:10:34.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:34 smithi044 bash[22676]: cephadm 2024-09-20T22:10:32.730684+0000 mgr.a (mgr.14150) 62 : cephadm [INF] Deploying daemon mon.c on smithi179 2024-09-20T22:10:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:35 smithi044 bash[22676]: cluster 2024-09-20T22:10:33.131479+0000 mgr.a (mgr.14150) 63 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:36 smithi044 bash[22676]: audit 2024-09-20T22:10:35.111598+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:36.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:36 smithi044 bash[22676]: audit 2024-09-20T22:10:35.119712+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:36.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:36 smithi044 bash[22676]: audit 2024-09-20T22:10:35.127442+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:36.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:36 smithi044 bash[22676]: cluster 2024-09-20T22:10:35.131887+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:36.668 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-20T22:10:36.668 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":1,"fsid":"68d7421e-779c-11ef-baf5-efdc52797490","modified":"2024-09-20T22:08:17.833594Z","created":"2024-09-20T22:08:17.833594Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T22:10:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 1 2024-09-20T22:10:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:37 smithi044 bash[22676]: audit 2024-09-20T22:10:36.667100+0000 mon.a (mon.0) 206 : audit [DBG] from='client.? 172.21.15.179:0/809244092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T22:10:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:38 smithi044 bash[22676]: cluster 2024-09-20T22:10:37.132300+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:38.514 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-20T22:10:38.514 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T22:10:39.740 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.c/config 2024-09-20T22:10:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:39 smithi044 bash[22676]: audit 2024-09-20T22:10:38.848736+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:39 smithi044 bash[22676]: audit 2024-09-20T22:10:38.854811+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:39 smithi044 bash[22676]: audit 2024-09-20T22:10:38.856140+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:39 smithi044 bash[22676]: audit 2024-09-20T22:10:38.857829+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:39 smithi044 bash[22676]: cephadm 2024-09-20T22:10:38.859725+0000 mgr.a (mgr.14150) 66 : cephadm [INF] Deploying daemon mon.b on smithi049 2024-09-20T22:10:41.086 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T22:10:41.086 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T22:10:41.086 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T22:10:41.086 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T22:10:41.086 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.bloom_locality: 0 2024-09-20T22:10:41.087 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-20T22:10:41.087 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T22:10:41.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-20T22:10:41.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-20T22:10:41.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-20T22:10:41.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.ttl: 2592000 2024-09-20T22:10:41.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T22:10:41.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.enable_blob_files: false 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.min_blob_size: 0 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T22:10:41.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.073+0000 7f6d073b0c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4603881a-67ff-4c4c-ae12-408e8218780a 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870241079664, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870241080092, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726870241, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4603881a-67ff-4c4c-ae12-408e8218780a", "db_session_id": "HUM8Y2SFI1IUAFH4CQ8U", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870241080212, "job": 1, "event": "recovery_finished"} 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d47470ee00 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 4 rocksdb: DB pointer 0x55d47480e000 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6cfd179640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6cfd179640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: ** DB Stats ** 2024-09-20T22:10:41.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: ** Compaction Stats [default] ** 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:41.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: ** Compaction Stats [default] ** 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: AddFile(Keys): cumulative 0, interval 0 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Cumulative compaction: 0.00 GB write, 0.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:10:41.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Interval compaction: 0.00 GB write, 0.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Block cache BinnedLRUCache@0x55d4746e31f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: ** File Read Latency Histogram By Level [default] ** 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 0 using public_addr v2:172.21.15.179:0/0 -> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 0 starting mon.c rank -1 at public addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] at bind addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.077+0000 7f6d073b0c80 1 mon.c@-1(???) e0 preinit fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 0 mon.c@-1(synchronizing).mds e1 new map 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: e1 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: btime 2024-09-20T22:08:22:262326+0000 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T22:10:41.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: legacy client fscid: -1 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: No filesystems configured 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:50.574196+0000 mgr.a (mgr.14150) 21 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:41.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:09:51.123370+0000 mgr.a (mgr.14150) 22 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:09:51.889892+0000 mgr.a (mgr.14150) 23 : cephadm [INF] Deploying cephadm binary to smithi049 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:09:53.123786+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:54.789616+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:54.792621+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:54.796568+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:55.598899+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:55.600369+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:09:55.124180+0000 mgr.a (mgr.14150) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.183 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:09:55.599694+0000 mgr.a (mgr.14150) 26 : cephadm [INF] Added host smithi049 2024-09-20T22:10:41.183 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:56.137713+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.183 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:09:57.124562+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.183 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:57.682044+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.183 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:57.687602+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.183 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:57.689194+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:10:41.183 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:57.691448+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:57.693397+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:09:57.696079+0000 mgr.a (mgr.14150) 28 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:09:57.880401+0000 mgr.a (mgr.14150) 29 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:09:58.043428+0000 mgr.a (mgr.14150) 30 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:58.347236+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:58.352151+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:58.355179+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]: dispatch 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:09:58.356497+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]': finished 2024-09-20T22:10:41.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:09:58.195778+0000 mgr.a (mgr.14150) 31 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:10:41.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:09:59.124926+0000 mgr.a (mgr.14150) 32 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:09:59.368781+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Deploying daemon agent.smithi049 on smithi049 2024-09-20T22:10:41.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.495617+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.501797+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.507700+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.565166+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.568887+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.570385+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:41.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.579109+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.637479+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.641499+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.643369+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:41.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:00.651938+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:01.048333+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:01.183364+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:01.125328+0000 mgr.a (mgr.14150) 34 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:02.131844+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:02.139504+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:02.521911+0000 mgr.a (mgr.14150) 35 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:10:41.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:03.125723+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:05.126079+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:07.126483+0000 mgr.a (mgr.14150) 38 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:09.126923+0000 mgr.a (mgr.14150) 39 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:09.682770+0000 mgr.a (mgr.14150) 40 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:41.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:11.004456+0000 mgr.a (mgr.14150) 41 : cephadm [INF] Deploying cephadm binary to smithi179 2024-09-20T22:10:41.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:11.127308+0000 mgr.a (mgr.14150) 42 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:13.127738+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:14.693995+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.189 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:14.694812+0000 mgr.a (mgr.14150) 44 : cephadm [INF] Added host smithi179 2024-09-20T22:10:41.189 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:14.695656+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.189 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:14.904902+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.189 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:14.908648+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.189 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:14.912704+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.189 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:15.188046+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:15.196231+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:15.202502+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:15.128190+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:16.769499+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:16.775679+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:16.777182+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:10:41.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:16.779587+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:16.781476+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:41.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:16.784319+0000 mgr.a (mgr.14150) 46 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:41.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:16.967243+0000 mgr.a (mgr.14150) 47 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:41.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:17.428793+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:17.435415+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.192 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:17.438588+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-20T22:10:41.192 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:17.440670+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]': finished 2024-09-20T22:10:41.192 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:17.126917+0000 mgr.a (mgr.14150) 48 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:10:41.192 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:17.128623+0000 mgr.a (mgr.14150) 49 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.192 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:17.277387+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:10:41.192 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:19.129005+0000 mgr.a (mgr.14150) 51 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.193 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:19.705309+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Deploying daemon agent.smithi179 on smithi179 2024-09-20T22:10:41.193 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.811046+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.193 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.816455+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.193 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.821710+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.193 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.891496+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.193 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.895937+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.193 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.898091+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:41.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.906088+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.984329+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.988524+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.990331+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:41.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:20.997365+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:21.187897+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:21.354337+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:21.695437+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:21.700820+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:21.708204+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:21.129269+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:21.349188+0000 mgr.a (mgr.14150) 54 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:10:41.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:22.424683+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:22.431811+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:23.129609+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:25.130016+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:27.130365+0000 mgr.a (mgr.14150) 57 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:28.123701+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.15.44:0/3132774907' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-20T22:10:41.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:29.002479+0000 mon.a (mon.0) 194 : audit [INF] from='client.? 172.21.15.44:0/3132774907' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-20T22:10:41.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:29.006916+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:41.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:29.130674+0000 mgr.a (mgr.14150) 58 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:31.131044+0000 mgr.a (mgr.14150) 59 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.704823+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.706477+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.711626+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.713165+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:41.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.721299+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.726637+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:41.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.728567+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:32.694351+0000 mgr.a (mgr.14150) 60 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi049:172.21.15.49=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:41.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:32.699468+0000 mgr.a (mgr.14150) 61 : cephadm [INF] Saving service mon spec with placement smithi044:172.21.15.44=a;smithi049:172.21.15.49=b;smithi179:172.21.15.179=c;count:3 2024-09-20T22:10:41.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:32.730684+0000 mgr.a (mgr.14150) 62 : cephadm [INF] Deploying daemon mon.c on smithi179 2024-09-20T22:10:41.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:33.131479+0000 mgr.a (mgr.14150) 63 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:35.111598+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:35.119712+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:35.127442+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:35.131887+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:36.667100+0000 mon.a (mon.0) 206 : audit [DBG] from='client.? 172.21.15.179:0/809244092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T22:10:41.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:37.132300+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:38.848736+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:38.854811+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:41.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:38.856140+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:41.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: audit 2024-09-20T22:10:38.857829+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:41.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cephadm 2024-09-20T22:10:38.859725+0000 mgr.a (mgr.14150) 66 : cephadm [INF] Deploying daemon mon.b on smithi049 2024-09-20T22:10:41.201 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: cluster 2024-09-20T22:10:39.132722+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:41.201 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:41 smithi179 bash[23186]: debug 2024-09-20T22:10:41.109+0000 7f6d0017f640 1 mon.c@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-09-20T22:10:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:40 smithi044 bash[22676]: cluster 2024-09-20T22:10:39.132722+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:44 smithi049 systemd[1]: Started Ceph mon.b for 68d7421e-779c-11ef-baf5-efdc52797490. 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.794+0000 7f9c9dcebc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.794+0000 7f9c9dcebc80 0 ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable), process ceph-mon, pid 7 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.794+0000 7f9c9dcebc80 0 pidfile_write: ignore empty --pid-file 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 0 load: jerasure load: lrc 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: RocksDB version: 7.9.2 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Git sha 0 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Compile date 2024-09-19 18:20:48 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: DB SUMMARY 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: DB Session ID: 1QP6L73D3NX0V2XYF1OB 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: CURRENT file: CURRENT 2024-09-20T22:10:45.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.error_if_exists: 0 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.create_if_missing: 0 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.paranoid_checks: 1 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.env: 0x558706a7b940 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.info_log: 0x5587076116e0 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.statistics: (nil) 2024-09-20T22:10:45.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.use_fsync: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_log_file_size: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.allow_fallocate: 1 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.use_direct_reads: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.db_log_dir: 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.wal_dir: 2024-09-20T22:10:45.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.write_buffer_manager: 0x558707620dc0 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-20T22:10:45.821 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.unordered_write: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.row_cache: None 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.wal_filter: None 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.two_write_queues: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.wal_compression: 0 2024-09-20T22:10:45.822 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.atomic_flush: 0 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.log_readahead_size: 0 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_background_jobs: 2 2024-09-20T22:10:45.823 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_background_compactions: -1 2024-09-20T22:10:45.824 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_subcompactions: 1 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_open_files: -1 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-20T22:10:45.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_background_flushes: -1 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Compression algorithms supported: 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kZSTD supported: 0 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kXpressCompression supported: 0 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kBZip2Compression supported: 0 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kLZ4Compression supported: 1 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kZlibCompression supported: 1 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: kSnappyCompression supported: 1 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-20T22:10:45.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.merge_operator: 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_filter: None 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558707611320) 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cache_index_and_filter_blocks: 1 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: pin_top_level_index_and_filter: 1 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: index_type: 0 2024-09-20T22:10:45.827 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: data_block_index_type: 0 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: index_shortening: 1 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: data_block_hash_table_util_ratio: 0.750000 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: checksum: 4 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: no_block_cache: 0 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_cache: 0x5587076071f0 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_cache_name: BinnedLRUCache 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_cache_options: 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: capacity : 536870912 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: num_shard_bits : 4 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: strict_capacity_limit : 0 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: high_pri_pool_ratio: 0.000 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_cache_compressed: (nil) 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: persistent_cache: (nil) 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_size: 4096 2024-09-20T22:10:45.828 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_size_deviation: 10 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_restart_interval: 16 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: index_block_restart_interval: 1 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: metadata_block_size: 4096 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: partition_filters: 0 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: use_delta_encoding: 1 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: filter_policy: bloomfilter 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: whole_key_filtering: 1 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: verify_compression: 0 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: read_amp_bytes_per_bit: 0 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: format_version: 5 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: enable_index_compression: 1 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: block_align: 0 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: max_auto_readahead_size: 262144 2024-09-20T22:10:45.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: prepopulate_block_cache: 0 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: initial_auto_readahead_size: 8192 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: num_file_reads_for_auto_readahead: 2 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.798+0000 7f9c9dcebc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression: NoCompression 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.num_levels: 7 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T22:10:45.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T22:10:45.831 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T22:10:45.832 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T22:10:45.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.inplace_update_support: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.bloom_locality: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.max_successive_merges: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-20T22:10:45.834 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.ttl: 2592000 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.enable_blob_files: false 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.min_blob_size: 0 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T22:10:45.835 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 559f0a65-eeac-46ce-936a-2db5a85775d8 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870245805074, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870245805577, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726870245, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "559f0a65-eeac-46ce-936a-2db5a85775d8", "db_session_id": "1QP6L73D3NX0V2XYF1OB", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726870245805711, "job": 1, "event": "recovery_finished"} 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558707632e00 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 4 rocksdb: DB pointer 0x558707732000 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c93ab4640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c93ab4640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T22:10:45.836 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: ** DB Stats ** 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: ** Compaction Stats [default] ** 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:45.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: ** Compaction Stats [default] ** 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: AddFile(Keys): cumulative 0, interval 0 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Interval compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T22:10:45.838 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T22:10:45.839 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Block cache BinnedLRUCache@0x5587076071f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-20T22:10:45.839 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-20T22:10:45.839 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: ** File Read Latency Histogram By Level [default] ** 2024-09-20T22:10:45.839 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-20T22:10:45.839 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.802+0000 7f9c9dcebc80 0 using public_addr v2:172.21.15.49:0/0 -> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] 2024-09-20T22:10:45.839 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.806+0000 7f9c9dcebc80 0 starting mon.b rank -1 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:45.839 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.806+0000 7f9c9dcebc80 1 mon.b@-1(???) e0 preinit fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 0 mon.b@-1(synchronizing).mds e1 new map 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 0 mon.b@-1(synchronizing).mds e1 print_map 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: e1 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: btime 2024-09-20T22:08:22:262326+0000 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: legacy client fscid: -1 2024-09-20T22:10:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: No filesystems configured 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:50.574196+0000 mgr.a (mgr.14150) 21 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:09:51.123370+0000 mgr.a (mgr.14150) 22 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:09:51.889892+0000 mgr.a (mgr.14150) 23 : cephadm [INF] Deploying cephadm binary to smithi049 2024-09-20T22:10:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:09:53.123786+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:54.789616+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:54.792621+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:54.796568+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:55.598899+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:55.600369+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:09:55.124180+0000 mgr.a (mgr.14150) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:09:55.599694+0000 mgr.a (mgr.14150) 26 : cephadm [INF] Added host smithi049 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:56.137713+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:09:57.124562+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:57.682044+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:57.687602+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:57.689194+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:57.691448+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:57.693397+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:09:57.696079+0000 mgr.a (mgr.14150) 28 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:09:57.880401+0000 mgr.a (mgr.14150) 29 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:46.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:09:58.043428+0000 mgr.a (mgr.14150) 30 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:58.347236+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:58.352151+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:58.355179+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]: dispatch 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:09:58.356497+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]': finished 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:09:58.195778+0000 mgr.a (mgr.14150) 31 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:09:59.124926+0000 mgr.a (mgr.14150) 32 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:09:59.368781+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Deploying daemon agent.smithi049 on smithi049 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.495617+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.501797+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.507700+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.565166+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.568887+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.570385+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.579109+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.637479+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.057 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.641499+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.643369+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:00.651938+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:01.048333+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:01.183364+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:01.125328+0000 mgr.a (mgr.14150) 34 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:02.131844+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:02.139504+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:02.521911+0000 mgr.a (mgr.14150) 35 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:03.125723+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:05.126079+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:07.126483+0000 mgr.a (mgr.14150) 38 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:09.126923+0000 mgr.a (mgr.14150) 39 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:09.682770+0000 mgr.a (mgr.14150) 40 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:11.004456+0000 mgr.a (mgr.14150) 41 : cephadm [INF] Deploying cephadm binary to smithi179 2024-09-20T22:10:46.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:11.127308+0000 mgr.a (mgr.14150) 42 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:13.127738+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:14.693995+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:14.694812+0000 mgr.a (mgr.14150) 44 : cephadm [INF] Added host smithi179 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:14.695656+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:14.904902+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:14.908648+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:14.912704+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:15.188046+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:15.196231+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:15.202502+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:15.128190+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:16.769499+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:16.775679+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:16.777182+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:10:46.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:16.779587+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:16.781476+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:16.784319+0000 mgr.a (mgr.14150) 46 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:16.967243+0000 mgr.a (mgr.14150) 47 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:17.428793+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:17.435415+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:17.438588+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:17.440670+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]': finished 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:17.126917+0000 mgr.a (mgr.14150) 48 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:17.128623+0000 mgr.a (mgr.14150) 49 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:17.277387+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:19.129005+0000 mgr.a (mgr.14150) 51 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:19.705309+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Deploying daemon agent.smithi179 on smithi179 2024-09-20T22:10:46.060 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.811046+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.816455+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.821710+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.891496+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.895937+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.898091+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.906088+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.984329+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.988524+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.990331+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:20.997365+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:21.187897+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:21.354337+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:21.695437+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.061 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:21.700820+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:21.708204+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:21.129269+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:21.349188+0000 mgr.a (mgr.14150) 54 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:22.424683+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:22.431811+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:23.129609+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:25.130016+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:27.130365+0000 mgr.a (mgr.14150) 57 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:28.123701+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.15.44:0/3132774907' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:29.002479+0000 mon.a (mon.0) 194 : audit [INF] from='client.? 172.21.15.44:0/3132774907' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:29.006916+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:29.130674+0000 mgr.a (mgr.14150) 58 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:31.131044+0000 mgr.a (mgr.14150) 59 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.704823+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.706477+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.711626+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.713165+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.721299+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.726637+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.728567+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:32.694351+0000 mgr.a (mgr.14150) 60 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi049:172.21.15.49=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:10:46.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:32.699468+0000 mgr.a (mgr.14150) 61 : cephadm [INF] Saving service mon spec with placement smithi044:172.21.15.44=a;smithi049:172.21.15.49=b;smithi179:172.21.15.179=c;count:3 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:32.730684+0000 mgr.a (mgr.14150) 62 : cephadm [INF] Deploying daemon mon.c on smithi179 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:33.131479+0000 mgr.a (mgr.14150) 63 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:35.111598+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:35.119712+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:35.127442+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:35.131887+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:36.667100+0000 mon.a (mon.0) 206 : audit [DBG] from='client.? 172.21.15.179:0/809244092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:37.132300+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:38.848736+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:38.854811+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:38.856140+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: audit 2024-09-20T22:10:38.857829+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cephadm 2024-09-20T22:10:38.859725+0000 mgr.a (mgr.14150) 66 : cephadm [INF] Deploying daemon mon.b on smithi049 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: cluster 2024-09-20T22:10:39.132722+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.064 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:45 smithi049 bash[23528]: debug 2024-09-20T22:10:45.830+0000 7f9c96aba640 1 mon.b@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:41.126956+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:41.127423+0000 mon.a (mon.0) 213 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:41.133178+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:41.146678+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:42.120078+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:43.120097+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:43.121507+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:43.133524+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:44.120195+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:45.120085+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:45.133950+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:45.839980+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:46.120357+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.169116+0000 mon.a (mon.0) 221 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175179+0000 mon.a (mon.0) 222 : cluster [DBG] monmap epoch 2 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175227+0000 mon.a (mon.0) 223 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175262+0000 mon.a (mon.0) 224 : cluster [DBG] last_changed 2024-09-20T22:10:41.119641+0000 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175298+0000 mon.a (mon.0) 225 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175337+0000 mon.a (mon.0) 226 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175379+0000 mon.a (mon.0) 227 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175419+0000 mon.a (mon.0) 228 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.175457+0000 mon.a (mon.0) 229 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.176507+0000 mon.a (mon.0) 230 : cluster [DBG] fsmap 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.176599+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.176919+0000 mon.a (mon.0) 232 : cluster [DBG] mgrmap e13: a(active, since 85s) 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: cluster 2024-09-20T22:10:46.177243+0000 mon.a (mon.0) 233 : cluster [INF] overall HEALTH_OK 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:46.196497+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:46.201977+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:46.207739+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:46.213331+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:46.218692+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:46 smithi179 bash[23186]: audit 2024-09-20T22:10:46.224172+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.718 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:41.126956+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:10:46.718 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:41.127423+0000 mon.a (mon.0) 213 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:46.718 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:41.133178+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.718 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:41.146678+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:42.120078+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:43.120097+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:43.121507+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:43.133524+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:44.120195+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:45.120085+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:45.133950+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:45.839980+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:46.120357+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.169116+0000 mon.a (mon.0) 221 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175179+0000 mon.a (mon.0) 222 : cluster [DBG] monmap epoch 2 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175227+0000 mon.a (mon.0) 223 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175262+0000 mon.a (mon.0) 224 : cluster [DBG] last_changed 2024-09-20T22:10:41.119641+0000 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175298+0000 mon.a (mon.0) 225 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175337+0000 mon.a (mon.0) 226 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175379+0000 mon.a (mon.0) 227 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175419+0000 mon.a (mon.0) 228 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.175457+0000 mon.a (mon.0) 229 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.176507+0000 mon.a (mon.0) 230 : cluster [DBG] fsmap 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.176599+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.176919+0000 mon.a (mon.0) 232 : cluster [DBG] mgrmap e13: a(active, since 85s) 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: cluster 2024-09-20T22:10:46.177243+0000 mon.a (mon.0) 233 : cluster [INF] overall HEALTH_OK 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:46.196497+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:46.201977+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:46.207739+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:46.213331+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:46.218692+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:46.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:46 smithi044 bash[22676]: audit 2024-09-20T22:10:46.224172+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.229583+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.235529+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.251595+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.318769+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.322718+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.323929+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.325880+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.326232+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.326467+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.406656+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.411112+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.415627+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.544991+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.545225+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.557721+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.733861+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.738284+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.742439+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.746544+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.750634+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.754525+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.758328+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.758682+0000 mgr.a (mgr.14150) 77 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.801974+0000 mgr.a (mgr.14150) 78 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.802322+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.802996+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.803584+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: cephadm 2024-09-20T22:10:46.804257+0000 mgr.a (mgr.14150) 79 : cephadm [INF] Reconfiguring daemon mon.a on smithi044 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:46.839553+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:47 smithi179 bash[23186]: audit 2024-09-20T22:10:47.120301+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:47.565 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-20T22:10:47.565 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":2,"fsid":"68d7421e-779c-11ef-baf5-efdc52797490","modified":"2024-09-20T22:10:41.119641Z","created":"2024-09-20T22:08:17.833594Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-20T22:10:47.566 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 2 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.229583+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.235529+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.251595+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.318769+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.322718+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.323929+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.325880+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:10:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.326232+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.326467+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.406656+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.411112+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.415627+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.544991+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.545225+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.557721+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.733861+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.738284+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.742439+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.746544+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.750634+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.754525+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.758328+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.758682+0000 mgr.a (mgr.14150) 77 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.801974+0000 mgr.a (mgr.14150) 78 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.802322+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.802996+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.803584+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: cephadm 2024-09-20T22:10:46.804257+0000 mgr.a (mgr.14150) 79 : cephadm [INF] Reconfiguring daemon mon.a on smithi044 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:46.839553+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:47 smithi044 bash[22676]: audit 2024-09-20T22:10:47.120301+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:41.126956+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:10:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:41.127423+0000 mon.a (mon.0) 213 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:41.133178+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:41.146678+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:42.120078+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:43.120097+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:43.121507+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:43.133524+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:44.120195+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:45.120085+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:45.133950+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:45.839980+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.120357+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.169116+0000 mon.a (mon.0) 221 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175179+0000 mon.a (mon.0) 222 : cluster [DBG] monmap epoch 2 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175227+0000 mon.a (mon.0) 223 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175262+0000 mon.a (mon.0) 224 : cluster [DBG] last_changed 2024-09-20T22:10:41.119641+0000 2024-09-20T22:10:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175298+0000 mon.a (mon.0) 225 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175337+0000 mon.a (mon.0) 226 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175379+0000 mon.a (mon.0) 227 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175419+0000 mon.a (mon.0) 228 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.175457+0000 mon.a (mon.0) 229 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.176507+0000 mon.a (mon.0) 230 : cluster [DBG] fsmap 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.176599+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.176919+0000 mon.a (mon.0) 232 : cluster [DBG] mgrmap e13: a(active, since 85s) 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cluster 2024-09-20T22:10:46.177243+0000 mon.a (mon.0) 233 : cluster [INF] overall HEALTH_OK 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.196497+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.201977+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.207739+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.213331+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.218692+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.224172+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.229583+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.235529+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.251595+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.318769+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.322718+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.323929+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.325880+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.326232+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.326467+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.406656+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.411112+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.415627+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.544991+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:48.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.545225+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.557721+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.733861+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.738284+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.742439+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.746544+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.750634+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.754525+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.758328+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.758682+0000 mgr.a (mgr.14150) 77 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.801974+0000 mgr.a (mgr.14150) 78 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.802322+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:48.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.802996+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:48.308 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.803584+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:48.308 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: cephadm 2024-09-20T22:10:46.804257+0000 mgr.a (mgr.14150) 79 : cephadm [INF] Reconfiguring daemon mon.a on smithi044 2024-09-20T22:10:48.308 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:46.839553+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:48.308 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:47 smithi049 bash[23528]: audit 2024-09-20T22:10:47.120301+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:49.630 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-20T22:10:49.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T22:10:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:47.134380+0000 mgr.a (mgr.14150) 80 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:47.860297+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:10:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:47.860919+0000 mon.a (mon.0) 264 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:47.861095+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:47.882962+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:47.883250+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:48.840139+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:49.134852+0000 mgr.a (mgr.14150) 81 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:49.840801+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:50.840656+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:51.135313+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:51.841164+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:52.841125+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.882899+0000 mon.a (mon.0) 272 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888734+0000 mon.a (mon.0) 273 : cluster [DBG] monmap epoch 3 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888766+0000 mon.a (mon.0) 274 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888806+0000 mon.a (mon.0) 275 : cluster [DBG] last_changed 2024-09-20T22:10:47.853730+0000 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888843+0000 mon.a (mon.0) 276 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888878+0000 mon.a (mon.0) 277 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888912+0000 mon.a (mon.0) 278 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888944+0000 mon.a (mon.0) 279 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.888979+0000 mon.a (mon.0) 280 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.889011+0000 mon.a (mon.0) 281 : cluster [DBG] 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.890117+0000 mon.a (mon.0) 282 : cluster [DBG] fsmap 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.890194+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.890476+0000 mon.a (mon.0) 284 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.890796+0000 mon.a (mon.0) 285 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.908954+0000 mon.a (mon.0) 286 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.908984+0000 mon.a (mon.0) 287 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: cluster 2024-09-20T22:10:52.909006+0000 mon.a (mon.0) 288 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] is down (out of quorum) 2024-09-20T22:10:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:52.913936+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:52.919386+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:52.925870+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:52.932532+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:52 smithi044 bash[22676]: audit 2024-09-20T22:10:52.938234+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:47.134380+0000 mgr.a (mgr.14150) 80 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:47.860297+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:47.860919+0000 mon.a (mon.0) 264 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:47.861095+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:47.882962+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:47.883250+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:48.840139+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:49.134852+0000 mgr.a (mgr.14150) 81 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:49.840801+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:50.840656+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:51.135313+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:51.841164+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:52.841125+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.882899+0000 mon.a (mon.0) 272 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888734+0000 mon.a (mon.0) 273 : cluster [DBG] monmap epoch 3 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888766+0000 mon.a (mon.0) 274 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888806+0000 mon.a (mon.0) 275 : cluster [DBG] last_changed 2024-09-20T22:10:47.853730+0000 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888843+0000 mon.a (mon.0) 276 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888878+0000 mon.a (mon.0) 277 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888912+0000 mon.a (mon.0) 278 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888944+0000 mon.a (mon.0) 279 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.888979+0000 mon.a (mon.0) 280 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.889011+0000 mon.a (mon.0) 281 : cluster [DBG] 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.890117+0000 mon.a (mon.0) 282 : cluster [DBG] fsmap 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.890194+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.890476+0000 mon.a (mon.0) 284 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.890796+0000 mon.a (mon.0) 285 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.908954+0000 mon.a (mon.0) 286 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.908984+0000 mon.a (mon.0) 287 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: cluster 2024-09-20T22:10:52.909006+0000 mon.a (mon.0) 288 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] is down (out of quorum) 2024-09-20T22:10:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:52.913936+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:52.919386+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:52.925870+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:52.932532+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:53.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:52 smithi179 bash[23186]: audit 2024-09-20T22:10:52.938234+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.104 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.c/config 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: cephadm 2024-09-20T22:10:52.941793+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:52.942633+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:52.944487+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:52.955793+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: cephadm 2024-09-20T22:10:52.957900+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.b on smithi049 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:53.103179+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:53.111215+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:53.121545+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:53.596583+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:53.604959+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:53.615317+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:53 smithi044 bash[22676]: audit 2024-09-20T22:10:53.841478+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: cephadm 2024-09-20T22:10:52.941793+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:52.942633+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:52.944487+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:52.955793+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: cephadm 2024-09-20T22:10:52.957900+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.b on smithi049 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:53.103179+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:53.111215+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:53.121545+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:53.596583+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:53.604959+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:53.615317+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:54.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:53 smithi179 bash[23186]: audit 2024-09-20T22:10:53.841478+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:47.134380+0000 mgr.a (mgr.14150) 80 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:47.860297+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:10:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:47.860919+0000 mon.a (mon.0) 264 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:47.861095+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:47.882962+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:47.883250+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:48.840139+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:49.134852+0000 mgr.a (mgr.14150) 81 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:49.840801+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:50.840656+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:51.135313+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:51.841164+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.841125+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.882899+0000 mon.a (mon.0) 272 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888734+0000 mon.a (mon.0) 273 : cluster [DBG] monmap epoch 3 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888766+0000 mon.a (mon.0) 274 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888806+0000 mon.a (mon.0) 275 : cluster [DBG] last_changed 2024-09-20T22:10:47.853730+0000 2024-09-20T22:10:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888843+0000 mon.a (mon.0) 276 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888878+0000 mon.a (mon.0) 277 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888912+0000 mon.a (mon.0) 278 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888944+0000 mon.a (mon.0) 279 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.888979+0000 mon.a (mon.0) 280 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.889011+0000 mon.a (mon.0) 281 : cluster [DBG] 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.890117+0000 mon.a (mon.0) 282 : cluster [DBG] fsmap 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.890194+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.890476+0000 mon.a (mon.0) 284 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.890796+0000 mon.a (mon.0) 285 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-20T22:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.908954+0000 mon.a (mon.0) 286 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.908984+0000 mon.a (mon.0) 287 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cluster 2024-09-20T22:10:52.909006+0000 mon.a (mon.0) 288 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] is down (out of quorum) 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.913936+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.919386+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.925870+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.932532+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.938234+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cephadm 2024-09-20T22:10:52.941793+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.942633+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.944487+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:52.955793+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: cephadm 2024-09-20T22:10:52.957900+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.b on smithi049 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:53.103179+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:53.111215+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:53.121545+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:53.596583+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:53.604959+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:53.615317+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:54 smithi049 bash[23528]: audit 2024-09-20T22:10:53.841478+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:49.855763+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-20T22:10:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.886540+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-20T22:10:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.886740+0000 mon.a (mon.0) 305 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.887143+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.910050+0000 mon.a (mon.0) 306 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T22:10:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916293+0000 mon.a (mon.0) 307 : cluster [DBG] monmap epoch 3 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916324+0000 mon.a (mon.0) 308 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916340+0000 mon.a (mon.0) 309 : cluster [DBG] last_changed 2024-09-20T22:10:47.853730+0000 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916357+0000 mon.a (mon.0) 310 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916374+0000 mon.a (mon.0) 311 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916390+0000 mon.a (mon.0) 312 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916408+0000 mon.a (mon.0) 313 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916431+0000 mon.a (mon.0) 314 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.916450+0000 mon.a (mon.0) 315 : cluster [DBG] 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.917466+0000 mon.a (mon.0) 316 : cluster [DBG] fsmap 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.917520+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.917782+0000 mon.a (mon.0) 318 : cluster [DBG] mgrmap e13: a(active, since 93s) 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.918058+0000 mon.a (mon.0) 319 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T22:10:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.918093+0000 mon.a (mon.0) 320 : cluster [INF] Cluster is now healthy 2024-09-20T22:10:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: cluster 2024-09-20T22:10:54.923459+0000 mon.a (mon.0) 321 : cluster [INF] overall HEALTH_OK 2024-09-20T22:10:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: audit 2024-09-20T22:10:55.059581+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: audit 2024-09-20T22:10:55.066123+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: audit 2024-09-20T22:10:55.069170+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: audit 2024-09-20T22:10:55.074035+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:55 smithi179 bash[23186]: audit 2024-09-20T22:10:55.075848+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:55.413 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 3 2024-09-20T22:10:55.414 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-20T22:10:55.414 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":3,"fsid":"68d7421e-779c-11ef-baf5-efdc52797490","modified":"2024-09-20T22:10:47.853730Z","created":"2024-09-20T22:08:17.833594Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:49.855763+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.886540+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.886740+0000 mon.a (mon.0) 305 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.887143+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.910050+0000 mon.a (mon.0) 306 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916293+0000 mon.a (mon.0) 307 : cluster [DBG] monmap epoch 3 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916324+0000 mon.a (mon.0) 308 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916340+0000 mon.a (mon.0) 309 : cluster [DBG] last_changed 2024-09-20T22:10:47.853730+0000 2024-09-20T22:10:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916357+0000 mon.a (mon.0) 310 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916374+0000 mon.a (mon.0) 311 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916390+0000 mon.a (mon.0) 312 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916408+0000 mon.a (mon.0) 313 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916431+0000 mon.a (mon.0) 314 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.916450+0000 mon.a (mon.0) 315 : cluster [DBG] 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.917466+0000 mon.a (mon.0) 316 : cluster [DBG] fsmap 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.917520+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.917782+0000 mon.a (mon.0) 318 : cluster [DBG] mgrmap e13: a(active, since 93s) 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.918058+0000 mon.a (mon.0) 319 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.918093+0000 mon.a (mon.0) 320 : cluster [INF] Cluster is now healthy 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: cluster 2024-09-20T22:10:54.923459+0000 mon.a (mon.0) 321 : cluster [INF] overall HEALTH_OK 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: audit 2024-09-20T22:10:55.059581+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: audit 2024-09-20T22:10:55.066123+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: audit 2024-09-20T22:10:55.069170+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: audit 2024-09-20T22:10:55.074035+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:55 smithi044 bash[22676]: audit 2024-09-20T22:10:55.075848+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:49.855763+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.886540+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.886740+0000 mon.a (mon.0) 305 : cluster [INF] mon.a calling monitor election 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.887143+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.910050+0000 mon.a (mon.0) 306 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916293+0000 mon.a (mon.0) 307 : cluster [DBG] monmap epoch 3 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916324+0000 mon.a (mon.0) 308 : cluster [DBG] fsid 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:10:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916340+0000 mon.a (mon.0) 309 : cluster [DBG] last_changed 2024-09-20T22:10:47.853730+0000 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916357+0000 mon.a (mon.0) 310 : cluster [DBG] created 2024-09-20T22:08:17.833594+0000 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916374+0000 mon.a (mon.0) 311 : cluster [DBG] min_mon_release 19 (squid) 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916390+0000 mon.a (mon.0) 312 : cluster [DBG] election_strategy: 1 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916408+0000 mon.a (mon.0) 313 : cluster [DBG] 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916431+0000 mon.a (mon.0) 314 : cluster [DBG] 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.916450+0000 mon.a (mon.0) 315 : cluster [DBG] 2: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.917466+0000 mon.a (mon.0) 316 : cluster [DBG] fsmap 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.917520+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.917782+0000 mon.a (mon.0) 318 : cluster [DBG] mgrmap e13: a(active, since 93s) 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.918058+0000 mon.a (mon.0) 319 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.918093+0000 mon.a (mon.0) 320 : cluster [INF] Cluster is now healthy 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: cluster 2024-09-20T22:10:54.923459+0000 mon.a (mon.0) 321 : cluster [INF] overall HEALTH_OK 2024-09-20T22:10:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: audit 2024-09-20T22:10:55.059581+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: audit 2024-09-20T22:10:55.066123+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: audit 2024-09-20T22:10:55.069170+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:10:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: audit 2024-09-20T22:10:55.074035+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:55 smithi049 bash[23528]: audit 2024-09-20T22:10:55.075848+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:10:55.970 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-20T22:10:55.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.078164+0000 mgr.a (mgr.14150) 86 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.078757+0000 mgr.a (mgr.14150) 87 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.080603+0000 mgr.a (mgr.14150) 88 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cluster 2024-09-20T22:10:55.136001+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.283485+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.288589+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.294606+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.332382+0000 mgr.a (mgr.14150) 90 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.332697+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.333297+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.413231+0000 mon.a (mon.0) 330 : audit [DBG] from='client.? 172.21.15.179:0/1080309359' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.527215+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.534010+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.538607+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.545329+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.550325+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.554487+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.558882+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.609671+0000 mgr.a (mgr.14150) 93 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.610175+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.611277+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.612123+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: cephadm 2024-09-20T22:10:55.613042+0000 mgr.a (mgr.14150) 94 : cephadm [INF] Reconfiguring daemon mon.a on smithi044 2024-09-20T22:10:56.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:56 smithi049 bash[23528]: audit 2024-09-20T22:10:55.841675+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.078164+0000 mgr.a (mgr.14150) 86 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.078757+0000 mgr.a (mgr.14150) 87 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.080603+0000 mgr.a (mgr.14150) 88 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cluster 2024-09-20T22:10:55.136001+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.283485+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.288589+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.294606+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.332382+0000 mgr.a (mgr.14150) 90 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.332697+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.333297+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.413231+0000 mon.a (mon.0) 330 : audit [DBG] from='client.? 172.21.15.179:0/1080309359' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.527215+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.534010+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.538607+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.545329+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.550325+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.554487+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.558882+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.609671+0000 mgr.a (mgr.14150) 93 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.610175+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.611277+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.612123+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: cephadm 2024-09-20T22:10:55.613042+0000 mgr.a (mgr.14150) 94 : cephadm [INF] Reconfiguring daemon mon.a on smithi044 2024-09-20T22:10:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:56 smithi044 bash[22676]: audit 2024-09-20T22:10:55.841675+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.078164+0000 mgr.a (mgr.14150) 86 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:10:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.078757+0000 mgr.a (mgr.14150) 87 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:10:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.080603+0000 mgr.a (mgr.14150) 88 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cluster 2024-09-20T22:10:55.136001+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.283485+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.288589+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.294606+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.332382+0000 mgr.a (mgr.14150) 90 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.332697+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.333297+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.413231+0000 mon.a (mon.0) 330 : audit [DBG] from='client.? 172.21.15.179:0/1080309359' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.527215+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.534010+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.538607+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.545329+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.550325+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.554487+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.558882+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.609671+0000 mgr.a (mgr.14150) 93 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.610175+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.611277+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.612123+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: cephadm 2024-09-20T22:10:55.613042+0000 mgr.a (mgr.14150) 94 : cephadm [INF] Reconfiguring daemon mon.a on smithi044 2024-09-20T22:10:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:56 smithi179 bash[23186]: audit 2024-09-20T22:10:55.841675+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:10:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: cluster 2024-09-20T22:10:57.136377+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: audit 2024-09-20T22:10:57.972538+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: audit 2024-09-20T22:10:57.979032+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: cephadm 2024-09-20T22:10:57.981636+0000 mgr.a (mgr.14150) 96 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-20T22:10:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: audit 2024-09-20T22:10:57.982122+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: audit 2024-09-20T22:10:57.983619+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: audit 2024-09-20T22:10:57.985022+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:10:58 smithi044 bash[22676]: cephadm 2024-09-20T22:10:57.986645+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring daemon mon.c on smithi179 2024-09-20T22:10:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: cluster 2024-09-20T22:10:57.136377+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: audit 2024-09-20T22:10:57.972538+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: audit 2024-09-20T22:10:57.979032+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: cephadm 2024-09-20T22:10:57.981636+0000 mgr.a (mgr.14150) 96 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-20T22:10:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: audit 2024-09-20T22:10:57.982122+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: audit 2024-09-20T22:10:57.983619+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: audit 2024-09-20T22:10:57.985022+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:10:58 smithi179 bash[23186]: cephadm 2024-09-20T22:10:57.986645+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring daemon mon.c on smithi179 2024-09-20T22:10:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: cluster 2024-09-20T22:10:57.136377+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:10:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: audit 2024-09-20T22:10:57.972538+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: audit 2024-09-20T22:10:57.979032+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:10:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: cephadm 2024-09-20T22:10:57.981636+0000 mgr.a (mgr.14150) 96 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-20T22:10:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: audit 2024-09-20T22:10:57.982122+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T22:10:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: audit 2024-09-20T22:10:57.983619+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T22:10:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: audit 2024-09-20T22:10:57.985022+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:10:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:10:58 smithi049 bash[23528]: cephadm 2024-09-20T22:10:57.986645+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring daemon mon.c on smithi179 2024-09-20T22:11:00.701 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:11:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:00 smithi044 bash[22676]: cluster 2024-09-20T22:10:59.136781+0000 mgr.a (mgr.14150) 98 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:00 smithi044 bash[22676]: audit 2024-09-20T22:11:00.198648+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:00 smithi044 bash[22676]: audit 2024-09-20T22:11:00.205341+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:00 smithi179 bash[23186]: cluster 2024-09-20T22:10:59.136781+0000 mgr.a (mgr.14150) 98 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:00 smithi179 bash[23186]: audit 2024-09-20T22:11:00.198648+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:00 smithi179 bash[23186]: audit 2024-09-20T22:11:00.205341+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:00 smithi049 bash[23528]: cluster 2024-09-20T22:10:59.136781+0000 mgr.a (mgr.14150) 98 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:00 smithi049 bash[23528]: audit 2024-09-20T22:11:00.198648+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:00 smithi049 bash[23528]: audit 2024-09-20T22:11:00.205341+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:02.052 INFO:teuthology.orchestra.run.smithi044.stdout:# minimal ceph.conf for 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:11:02.052 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-20T22:11:02.052 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 68d7421e-779c-11ef-baf5-efdc52797490 2024-09-20T22:11:02.052 INFO:teuthology.orchestra.run.smithi044.stdout: mon_host = [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-09-20T22:11:02.583 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-20T22:11:02.583 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:11:02.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T22:11:02.599 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:11:02.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:11:02.653 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:11:02.654 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T22:11:02.669 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:11:02.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:11:02.725 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:11:02.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T22:11:02.867 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:11:02.867 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:11:02.878 INFO:tasks.cephadm:Adding mgr.a on smithi044 2024-09-20T22:11:02.879 INFO:tasks.cephadm:Adding mgr.b on smithi049 2024-09-20T22:11:02.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch apply mgr '2;smithi044=a;smithi049=b' 2024-09-20T22:11:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:02 smithi179 bash[23186]: cluster 2024-09-20T22:11:01.137212+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:02 smithi179 bash[23186]: audit 2024-09-20T22:11:02.051965+0000 mon.a (mon.0) 349 : audit [DBG] from='client.? 172.21.15.44:0/3230592597' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:02 smithi044 bash[22676]: cluster 2024-09-20T22:11:01.137212+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:02 smithi044 bash[22676]: audit 2024-09-20T22:11:02.051965+0000 mon.a (mon.0) 349 : audit [DBG] from='client.? 172.21.15.44:0/3230592597' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:02 smithi049 bash[23528]: cluster 2024-09-20T22:11:01.137212+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:02 smithi049 bash[23528]: audit 2024-09-20T22:11:02.051965+0000 mon.a (mon.0) 349 : audit [DBG] from='client.? 172.21.15.44:0/3230592597' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:04 smithi044 bash[22676]: cluster 2024-09-20T22:11:03.137594+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:04 smithi179 bash[23186]: cluster 2024-09-20T22:11:03.137594+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:04 smithi049 bash[23528]: cluster 2024-09-20T22:11:03.137594+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:06.643 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.c/config 2024-09-20T22:11:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:06 smithi179 bash[23186]: cluster 2024-09-20T22:11:05.137929+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:06 smithi049 bash[23528]: cluster 2024-09-20T22:11:05.137929+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:06 smithi044 bash[22676]: cluster 2024-09-20T22:11:05.137929+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:07.869 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled mgr update... 2024-09-20T22:11:08.403 DEBUG:teuthology.orchestra.run.smithi049:mgr.b> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@mgr.b.service 2024-09-20T22:11:08.406 INFO:tasks.cephadm:Deploying OSDs... 2024-09-20T22:11:08.406 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-20T22:11:08.406 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T22:11:08.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T22:11:08.413 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-20T22:11:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T22:11:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:08.462 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-20T22:11:08.462 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:08.462 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-20 21:59:42.893897729 +0000 2024-09-20T22:11:08.463 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-20 21:59:42.645899945 +0000 2024-09-20T22:11:08.463 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-20 21:59:42.645899945 +0000 2024-09-20T22:11:08.463 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-20T22:11:08.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T22:11:08.514 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-20T22:11:08.514 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-20T22:11:08.514 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000287512 s, 1.8 MB/s 2024-09-20T22:11:08.515 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T22:11:08.562 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-20T22:11:08.613 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T22:11:08.613 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:08.613 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-20T22:11:08.613 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:08.613 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-20 21:59:43.369893477 +0000 2024-09-20T22:11:08.614 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-20 21:59:43.137895549 +0000 2024-09-20T22:11:08.614 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-20 21:59:43.137895549 +0000 2024-09-20T22:11:08.614 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-20T22:11:08.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T22:11:08.666 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-20T22:11:08.666 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-20T22:11:08.666 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000285673 s, 1.8 MB/s 2024-09-20T22:11:08.667 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T22:11:08.715 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-20 21:59:43.869889012 +0000 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-20 21:59:43.601891405 +0000 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-20 21:59:43.601891405 +0000 2024-09-20T22:11:08.765 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-20T22:11:08.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T22:11:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-20T22:11:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-20T22:11:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000302864 s, 1.7 MB/s 2024-09-20T22:11:08.821 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T22:11:08.872 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-20T22:11:08.921 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T22:11:08.921 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:08.921 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-20T22:11:08.921 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:08.922 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-20 21:59:44.393884330 +0000 2024-09-20T22:11:08.922 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-20 21:59:44.129886688 +0000 2024-09-20T22:11:08.922 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-20 21:59:44.129886688 +0000 2024-09-20T22:11:08.922 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-09-20T22:11:08.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T22:11:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-20T22:11:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-20T22:11:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000311536 s, 1.6 MB/s 2024-09-20T22:11:08.979 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T22:11:09.028 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-20T22:11:09.028 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T22:11:09.034 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T22:11:09.034 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-09-20T22:11:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: cluster 2024-09-20T22:11:07.138325+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.859180+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi044=a;smithi049=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:11:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: cephadm 2024-09-20T22:11:07.862260+0000 mgr.a (mgr.14150) 104 : cephadm [INF] Saving service mgr spec with placement smithi044=a;smithi049=b;count:2 2024-09-20T22:11:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.868476+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.870245+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.875415+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.877175+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.886737+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.890733+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.894790+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.899270+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: audit 2024-09-20T22:11:07.901498+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:08 smithi049 bash[23528]: cephadm 2024-09-20T22:11:07.903601+0000 mgr.a (mgr.14150) 105 : cephadm [INF] Deploying daemon mgr.b on smithi049 2024-09-20T22:11:09.058 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T22:11:09.058 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:09.058 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-20T22:11:09.058 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:09.058 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-20 21:59:45.522504836 +0000 2024-09-20T22:11:09.059 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-20 21:59:45.266507122 +0000 2024-09-20T22:11:09.059 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-20 21:59:45.266507122 +0000 2024-09-20T22:11:09.059 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-09-20T22:11:09.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T22:11:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-20T22:11:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-20T22:11:09.111 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000343919 s, 1.5 MB/s 2024-09-20T22:11:09.112 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T22:11:09.161 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-20 21:59:45.774502585 +0000 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-20 21:59:45.770502621 +0000 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-20 21:59:45.770502621 +0000 2024-09-20T22:11:09.208 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-09-20T22:11:09.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T22:11:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: cluster 2024-09-20T22:11:07.138325+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.859180+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi044=a;smithi049=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: cephadm 2024-09-20T22:11:07.862260+0000 mgr.a (mgr.14150) 104 : cephadm [INF] Saving service mgr spec with placement smithi044=a;smithi049=b;count:2 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.868476+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.870245+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.875415+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.877175+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.886737+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.890733+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T22:11:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.894790+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T22:11:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.899270+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T22:11:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: audit 2024-09-20T22:11:07.901498+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:08 smithi044 bash[22676]: cephadm 2024-09-20T22:11:07.903601+0000 mgr.a (mgr.14150) 105 : cephadm [INF] Deploying daemon mgr.b on smithi049 2024-09-20T22:11:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: cluster 2024-09-20T22:11:07.138325+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.859180+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi044=a;smithi049=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:11:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: cephadm 2024-09-20T22:11:07.862260+0000 mgr.a (mgr.14150) 104 : cephadm [INF] Saving service mgr spec with placement smithi044=a;smithi049=b;count:2 2024-09-20T22:11:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.868476+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.870245+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.875415+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.877175+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.886737+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.890733+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T22:11:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.894790+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T22:11:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.899270+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T22:11:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: audit 2024-09-20T22:11:07.901498+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:08 smithi179 bash[23186]: cephadm 2024-09-20T22:11:07.903601+0000 mgr.a (mgr.14150) 105 : cephadm [INF] Deploying daemon mgr.b on smithi049 2024-09-20T22:11:09.262 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-20T22:11:09.262 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-20T22:11:09.262 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000295302 s, 1.7 MB/s 2024-09-20T22:11:09.263 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T22:11:09.313 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-20 21:59:46.518495939 +0000 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-20 21:59:46.254498297 +0000 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-20 21:59:46.254498297 +0000 2024-09-20T22:11:09.360 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-09-20T22:11:09.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T22:11:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-20T22:11:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-20T22:11:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000304318 s, 1.7 MB/s 2024-09-20T22:11:09.415 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T22:11:09.470 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-20 21:59:47.038491295 +0000 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-20 21:59:46.766493724 +0000 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-20 21:59:46.766493724 +0000 2024-09-20T22:11:09.516 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-09-20T22:11:09.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T22:11:09.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-20T22:11:09.575 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-20T22:11:09.575 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000307261 s, 1.7 MB/s 2024-09-20T22:11:09.576 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T22:11:09.625 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-20T22:11:09.626 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T22:11:09.632 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T22:11:09.632 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-20 21:59:42.880409205 +0000 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-20 21:59:42.636411384 +0000 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-20 21:59:42.636411384 +0000 2024-09-20T22:11:09.680 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-20T22:11:09.681 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T22:11:09.734 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-20T22:11:09.735 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-20T22:11:09.735 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000439414 s, 1.2 MB/s 2024-09-20T22:11:09.736 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T22:11:09.786 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-20 21:59:43.096407276 +0000 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-20 21:59:43.092407311 +0000 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-20 21:59:43.092407311 +0000 2024-09-20T22:11:09.832 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-20T22:11:09.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T22:11:09.886 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-20T22:11:09.887 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-20T22:11:09.887 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000386957 s, 1.3 MB/s 2024-09-20T22:11:09.888 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T22:11:09.937 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-09-20T22:11:09.983 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T22:11:09.984 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:09.984 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-20T22:11:09.984 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:09.984 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-20 21:59:43.824400772 +0000 2024-09-20T22:11:09.984 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-20 21:59:43.564403096 +0000 2024-09-20T22:11:09.984 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-20 21:59:43.564403096 +0000 2024-09-20T22:11:09.984 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-20T22:11:09.984 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T22:11:10.039 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-20T22:11:10.039 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-20T22:11:10.039 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000419566 s, 1.2 MB/s 2024-09-20T22:11:10.040 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T22:11:10.089 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-09-20T22:11:10.137 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T22:11:10.137 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T22:11:10.137 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-20T22:11:10.137 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T22:11:10.137 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-20 21:59:44.304396486 +0000 2024-09-20T22:11:10.138 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-20 21:59:44.072398557 +0000 2024-09-20T22:11:10.138 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-20 21:59:44.072398557 +0000 2024-09-20T22:11:10.138 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-20T22:11:10.138 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T22:11:10.190 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-20T22:11:10.190 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-20T22:11:10.190 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.00039439 s, 1.3 MB/s 2024-09-20T22:11:10.191 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T22:11:10.241 INFO:tasks.cephadm:Deploying osd.0 on smithi044 with /dev/vg_nvme/lv_4... 2024-09-20T22:11:10.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T22:11:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:10 smithi179 bash[23186]: cluster 2024-09-20T22:11:09.138772+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:10 smithi044 bash[22676]: cluster 2024-09-20T22:11:09.138772+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:10 smithi049 bash[23528]: cluster 2024-09-20T22:11:09.138772+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:11.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:11 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:11.701 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:11 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:11.701 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:11 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:11.701 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:11 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:12.004 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:11 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:12.004 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:11 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:12.004 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:11 smithi049 systemd[1]: Started Ceph mgr.b for 68d7421e-779c-11ef-baf5-efdc52797490. 2024-09-20T22:11:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: cluster 2024-09-20T22:11:11.139216+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:11.328839+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:11.336115+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:11.345273+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:11.973414+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:11.980870+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:11.988494+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:11.995111+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:12.080703+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:12.084925+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:12.086345+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:12.095285+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:12.175344+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:12.176817+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T22:11:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:12 smithi044 bash[22676]: audit 2024-09-20T22:11:12.177971+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: cluster 2024-09-20T22:11:11.139216+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:11.328839+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:11.336115+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:11.345273+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:11.973414+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:11.980870+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:11.988494+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:11.995111+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:12.080703+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:12.084925+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:12.086345+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:12.095285+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:12.175344+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:12.176817+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T22:11:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:12 smithi179 bash[23186]: audit 2024-09-20T22:11:12.177971+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: cluster 2024-09-20T22:11:11.139216+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:11.328839+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:11.336115+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:11.345273+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:11.973414+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:11.980870+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:11.988494+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:11.995111+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:12.080703+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:12.084925+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:12.086345+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:12.095285+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:12.175344+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:12.176817+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T22:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:12 smithi049 bash[23528]: audit 2024-09-20T22:11:12.177971+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:13.552 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[24416]: debug 2024-09-20T22:11:13.338+0000 7fcceffc2640 1 -- 172.21.15.49:0/1063996687 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c927f010e0 con 0x55c927f03800 2024-09-20T22:11:13.552 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[24416]: debug 2024-09-20T22:11:13.458+0000 7fccf282c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T22:11:13.981 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[23528]: cephadm 2024-09-20T22:11:12.096012+0000 mgr.a (mgr.14150) 108 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:11:13.982 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[23528]: cephadm 2024-09-20T22:11:12.174844+0000 mgr.a (mgr.14150) 109 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-20T22:11:13.982 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[23528]: cephadm 2024-09-20T22:11:12.179434+0000 mgr.a (mgr.14150) 110 : cephadm [INF] Reconfiguring daemon mgr.a on smithi044 2024-09-20T22:11:13.982 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[23528]: audit 2024-09-20T22:11:12.933158+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:13.982 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[23528]: audit 2024-09-20T22:11:13.721892+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:13.982 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[23528]: audit 2024-09-20T22:11:13.725831+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:13.982 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:13 smithi049 bash[23528]: audit 2024-09-20T22:11:13.729882+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:13 smithi044 bash[22676]: cephadm 2024-09-20T22:11:12.096012+0000 mgr.a (mgr.14150) 108 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:11:14.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:13 smithi044 bash[22676]: cephadm 2024-09-20T22:11:12.174844+0000 mgr.a (mgr.14150) 109 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-20T22:11:14.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:13 smithi044 bash[22676]: cephadm 2024-09-20T22:11:12.179434+0000 mgr.a (mgr.14150) 110 : cephadm [INF] Reconfiguring daemon mgr.a on smithi044 2024-09-20T22:11:14.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:13 smithi044 bash[22676]: audit 2024-09-20T22:11:12.933158+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:13 smithi044 bash[22676]: audit 2024-09-20T22:11:13.721892+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:13 smithi044 bash[22676]: audit 2024-09-20T22:11:13.725831+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:13 smithi044 bash[22676]: audit 2024-09-20T22:11:13.729882+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:13 smithi179 bash[23186]: cephadm 2024-09-20T22:11:12.096012+0000 mgr.a (mgr.14150) 108 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:11:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:13 smithi179 bash[23186]: cephadm 2024-09-20T22:11:12.174844+0000 mgr.a (mgr.14150) 109 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-20T22:11:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:13 smithi179 bash[23186]: cephadm 2024-09-20T22:11:12.179434+0000 mgr.a (mgr.14150) 110 : cephadm [INF] Reconfiguring daemon mgr.a on smithi044 2024-09-20T22:11:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:13 smithi179 bash[23186]: audit 2024-09-20T22:11:12.933158+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:13 smithi179 bash[23186]: audit 2024-09-20T22:11:13.721892+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:13 smithi179 bash[23186]: audit 2024-09-20T22:11:13.725831+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:13 smithi179 bash[23186]: audit 2024-09-20T22:11:13.729882+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.962 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[23528]: cluster 2024-09-20T22:11:13.139519+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:14.962 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[23528]: audit 2024-09-20T22:11:14.284691+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.962 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[23528]: audit 2024-09-20T22:11:14.289496+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.962 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[23528]: audit 2024-09-20T22:11:14.292868+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:14.962 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[23528]: audit 2024-09-20T22:11:14.296207+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:14.963 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[23528]: audit 2024-09-20T22:11:14.297370+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:14.963 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[23528]: audit 2024-09-20T22:11:14.306106+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:14.963 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[24416]: debug 2024-09-20T22:11:14.734+0000 7fccf282c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T22:11:14.963 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[24416]: debug 2024-09-20T22:11:14.802+0000 7fccf282c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T22:11:14.963 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:14 smithi049 bash[24416]: debug 2024-09-20T22:11:14.958+0000 7fccf282c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T22:11:15.135 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:11:15.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:14 smithi044 bash[22676]: cluster 2024-09-20T22:11:13.139519+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:15.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:14 smithi044 bash[22676]: audit 2024-09-20T22:11:14.284691+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:15.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:14 smithi044 bash[22676]: audit 2024-09-20T22:11:14.289496+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:15.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:14 smithi044 bash[22676]: audit 2024-09-20T22:11:14.292868+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:15.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:14 smithi044 bash[22676]: audit 2024-09-20T22:11:14.296207+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:15.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:14 smithi044 bash[22676]: audit 2024-09-20T22:11:14.297370+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:15.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:14 smithi044 bash[22676]: audit 2024-09-20T22:11:14.306106+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:14 smithi179 bash[23186]: cluster 2024-09-20T22:11:13.139519+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:14 smithi179 bash[23186]: audit 2024-09-20T22:11:14.284691+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:14 smithi179 bash[23186]: audit 2024-09-20T22:11:14.289496+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:14 smithi179 bash[23186]: audit 2024-09-20T22:11:14.292868+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:14 smithi179 bash[23186]: audit 2024-09-20T22:11:14.296207+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:14 smithi179 bash[23186]: audit 2024-09-20T22:11:14.297370+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:14 smithi179 bash[23186]: audit 2024-09-20T22:11:14.306106+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:15.802 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[24416]: debug 2024-09-20T22:11:15.650+0000 7fccf282c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T22:11:15.802 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[24416]: debug 2024-09-20T22:11:15.726+0000 7fccf282c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T22:11:16.077 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[24416]: debug 2024-09-20T22:11:15.798+0000 7fccf282c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T22:11:16.078 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[24416]: debug 2024-09-20T22:11:15.994+0000 7fccf282c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T22:11:16.078 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[23528]: cephadm 2024-09-20T22:11:14.306848+0000 mgr.a (mgr.14150) 112 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:11:16.078 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[23528]: audit 2024-09-20T22:11:15.493678+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.078 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[23528]: audit 2024-09-20T22:11:15.500874+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.078 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:15 smithi049 bash[23528]: audit 2024-09-20T22:11:15.511406+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:15 smithi044 bash[22676]: cephadm 2024-09-20T22:11:14.306848+0000 mgr.a (mgr.14150) 112 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:11:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:15 smithi044 bash[22676]: audit 2024-09-20T22:11:15.493678+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:15 smithi044 bash[22676]: audit 2024-09-20T22:11:15.500874+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:15 smithi044 bash[22676]: audit 2024-09-20T22:11:15.511406+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:15 smithi179 bash[23186]: cephadm 2024-09-20T22:11:14.306848+0000 mgr.a (mgr.14150) 112 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:11:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:15 smithi179 bash[23186]: audit 2024-09-20T22:11:15.493678+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:15 smithi179 bash[23186]: audit 2024-09-20T22:11:15.500874+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:15 smithi179 bash[23186]: audit 2024-09-20T22:11:15.511406+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:16.418 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:16 smithi049 bash[24416]: debug 2024-09-20T22:11:16.074+0000 7fccf282c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T22:11:16.419 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:16 smithi049 bash[24416]: debug 2024-09-20T22:11:16.146+0000 7fccf282c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T22:11:16.419 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:16 smithi049 bash[24416]: debug 2024-09-20T22:11:16.414+0000 7fccf282c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T22:11:16.695 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:16 smithi049 bash[24416]: debug 2024-09-20T22:11:16.486+0000 7fccf282c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T22:11:16.951 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:16 smithi049 bash[24416]: debug 2024-09-20T22:11:16.690+0000 7fccf282c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T22:11:16.951 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:16 smithi049 bash[24416]: debug 2024-09-20T22:11:16.774+0000 7fccf282c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T22:11:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:16 smithi044 bash[22676]: cluster 2024-09-20T22:11:15.139896+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:16 smithi179 bash[23186]: cluster 2024-09-20T22:11:15.139896+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:17.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:16 smithi049 bash[23528]: cluster 2024-09-20T22:11:15.139896+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:17.254 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:17 smithi049 bash[24416]: debug 2024-09-20T22:11:17.038+0000 7fccf282c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T22:11:17.524 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:17 smithi049 bash[24416]: debug 2024-09-20T22:11:17.250+0000 7fccf282c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:11:17.524 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:17 smithi049 bash[24416]: debug 2024-09-20T22:11:17.434+0000 7fccf282c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T22:11:17.802 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:17 smithi049 bash[24416]: debug 2024-09-20T22:11:17.522+0000 7fccf282c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T22:11:17.802 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:17 smithi049 bash[24416]: debug 2024-09-20T22:11:17.718+0000 7fccf282c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:11:18.654 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:18 smithi049 bash[24416]: debug 2024-09-20T22:11:18.570+0000 7fccf282c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T22:11:18.654 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:18 smithi049 bash[23528]: cluster 2024-09-20T22:11:17.140322+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:18.654 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:18 smithi049 bash[23528]: audit 2024-09-20T22:11:17.396709+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:18 smithi044 bash[22676]: cluster 2024-09-20T22:11:17.140322+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:18 smithi044 bash[22676]: audit 2024-09-20T22:11:17.396709+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:18.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:11:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:18 smithi179 bash[23186]: cluster 2024-09-20T22:11:17.140322+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:18 smithi179 bash[23186]: audit 2024-09-20T22:11:17.396709+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:18.791 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-09-20T22:11:18.963 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:18 smithi049 bash[24416]: debug 2024-09-20T22:11:18.650+0000 7fccf282c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T22:11:18.963 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:18 smithi049 bash[24416]: debug 2024-09-20T22:11:18.882+0000 7fccf282c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T22:11:19.302 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:18 smithi049 bash[24416]: debug 2024-09-20T22:11:18.958+0000 7fccf282c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T22:11:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:18.450751+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:19.187778+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:19.195413+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:19.200507+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:19.204813+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:19.210583+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:19.212210+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:19 smithi044 bash[22676]: audit 2024-09-20T22:11:19.220959+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:18.450751+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:19.187778+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:19.195413+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:19.200507+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:19.204813+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:19.210583+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:19.212210+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:19 smithi179 bash[23186]: audit 2024-09-20T22:11:19.220959+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.802 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[24416]: debug 2024-09-20T22:11:19.374+0000 7fccf282c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T22:11:19.802 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[24416]: debug 2024-09-20T22:11:19.458+0000 7fccf282c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:18.450751+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:19.187778+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:19.195413+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:19.200507+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:19.204813+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:19.210583+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:19.212210+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:19 smithi049 bash[23528]: audit 2024-09-20T22:11:19.220959+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:20 smithi044 bash[22676]: cluster 2024-09-20T22:11:19.140725+0000 mgr.a (mgr.14150) 115 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:20 smithi044 bash[22676]: cluster 2024-09-20T22:11:19.483872+0000 mon.a (mon.0) 395 : cluster [DBG] Standby manager daemon b started 2024-09-20T22:11:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:20 smithi044 bash[22676]: audit 2024-09-20T22:11:19.486997+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-20T22:11:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:20 smithi044 bash[22676]: audit 2024-09-20T22:11:19.487782+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T22:11:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:20 smithi044 bash[22676]: audit 2024-09-20T22:11:19.489154+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-20T22:11:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:20 smithi044 bash[22676]: audit 2024-09-20T22:11:19.489914+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T22:11:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:20 smithi179 bash[23186]: cluster 2024-09-20T22:11:19.140725+0000 mgr.a (mgr.14150) 115 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:20 smithi179 bash[23186]: cluster 2024-09-20T22:11:19.483872+0000 mon.a (mon.0) 395 : cluster [DBG] Standby manager daemon b started 2024-09-20T22:11:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:20 smithi179 bash[23186]: audit 2024-09-20T22:11:19.486997+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-20T22:11:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:20 smithi179 bash[23186]: audit 2024-09-20T22:11:19.487782+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T22:11:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:20 smithi179 bash[23186]: audit 2024-09-20T22:11:19.489154+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-20T22:11:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:20 smithi179 bash[23186]: audit 2024-09-20T22:11:19.489914+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T22:11:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:20 smithi049 bash[23528]: cluster 2024-09-20T22:11:19.140725+0000 mgr.a (mgr.14150) 115 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:20 smithi049 bash[23528]: cluster 2024-09-20T22:11:19.483872+0000 mon.a (mon.0) 395 : cluster [DBG] Standby manager daemon b started 2024-09-20T22:11:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:20 smithi049 bash[23528]: audit 2024-09-20T22:11:19.486997+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-20T22:11:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:20 smithi049 bash[23528]: audit 2024-09-20T22:11:19.487782+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T22:11:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:20 smithi049 bash[23528]: audit 2024-09-20T22:11:19.489154+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-20T22:11:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:20 smithi049 bash[23528]: audit 2024-09-20T22:11:19.489914+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.49:0/474632826' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T22:11:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:21 smithi044 bash[22676]: cluster 2024-09-20T22:11:20.475176+0000 mon.a (mon.0) 396 : cluster [DBG] mgrmap e14: a(active, since 119s), standbys: b 2024-09-20T22:11:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:21 smithi044 bash[22676]: audit 2024-09-20T22:11:20.475477+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-20T22:11:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:21 smithi179 bash[23186]: cluster 2024-09-20T22:11:20.475176+0000 mon.a (mon.0) 396 : cluster [DBG] mgrmap e14: a(active, since 119s), standbys: b 2024-09-20T22:11:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:21 smithi179 bash[23186]: audit 2024-09-20T22:11:20.475477+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-20T22:11:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:21 smithi049 bash[23528]: cluster 2024-09-20T22:11:20.475176+0000 mon.a (mon.0) 396 : cluster [DBG] mgrmap e14: a(active, since 119s), standbys: b 2024-09-20T22:11:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:21 smithi049 bash[23528]: audit 2024-09-20T22:11:20.475477+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-20T22:11:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:22 smithi044 bash[22676]: cluster 2024-09-20T22:11:21.141134+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:22 smithi179 bash[23186]: cluster 2024-09-20T22:11:21.141134+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:22 smithi049 bash[23528]: cluster 2024-09-20T22:11:21.141134+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:11:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:24 smithi044 bash[22676]: cluster 2024-09-20T22:11:23.141504+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:24 smithi179 bash[23186]: cluster 2024-09-20T22:11:23.141504+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:24 smithi049 bash[23528]: cluster 2024-09-20T22:11:23.141504+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:25 smithi179 bash[23186]: audit 2024-09-20T22:11:24.833080+0000 mgr.a (mgr.14150) 118 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:11:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:25 smithi179 bash[23186]: audit 2024-09-20T22:11:24.837057+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:11:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:25 smithi179 bash[23186]: audit 2024-09-20T22:11:24.839966+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:11:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:25 smithi179 bash[23186]: audit 2024-09-20T22:11:24.840901+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:25 smithi049 bash[23528]: audit 2024-09-20T22:11:24.833080+0000 mgr.a (mgr.14150) 118 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:11:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:25 smithi049 bash[23528]: audit 2024-09-20T22:11:24.837057+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:11:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:25 smithi049 bash[23528]: audit 2024-09-20T22:11:24.839966+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:11:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:25 smithi049 bash[23528]: audit 2024-09-20T22:11:24.840901+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:25 smithi044 bash[22676]: audit 2024-09-20T22:11:24.833080+0000 mgr.a (mgr.14150) 118 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:11:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:25 smithi044 bash[22676]: audit 2024-09-20T22:11:24.837057+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:11:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:25 smithi044 bash[22676]: audit 2024-09-20T22:11:24.839966+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:11:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:25 smithi044 bash[22676]: audit 2024-09-20T22:11:24.840901+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:26 smithi179 bash[23186]: cluster 2024-09-20T22:11:25.141910+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:26 smithi049 bash[23528]: cluster 2024-09-20T22:11:25.141910+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:26 smithi044 bash[22676]: cluster 2024-09-20T22:11:25.141910+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:28 smithi179 bash[23186]: cluster 2024-09-20T22:11:27.142387+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:28 smithi049 bash[23528]: cluster 2024-09-20T22:11:27.142387+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:28.818 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:28 smithi044 bash[22676]: cluster 2024-09-20T22:11:27.142387+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:30 smithi179 bash[23186]: cluster 2024-09-20T22:11:29.142763+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:30 smithi049 bash[23528]: cluster 2024-09-20T22:11:29.142763+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:30.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:30 smithi044 bash[22676]: cluster 2024-09-20T22:11:29.142763+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:31 smithi049 bash[23528]: audit 2024-09-20T22:11:30.537881+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:31 smithi049 bash[23528]: audit 2024-09-20T22:11:30.542718+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:31 smithi049 bash[23528]: audit 2024-09-20T22:11:30.548503+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:31 smithi044 bash[22676]: audit 2024-09-20T22:11:30.537881+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:31 smithi044 bash[22676]: audit 2024-09-20T22:11:30.542718+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:31 smithi044 bash[22676]: audit 2024-09-20T22:11:30.548503+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:31 smithi179 bash[23186]: audit 2024-09-20T22:11:30.537881+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:31 smithi179 bash[23186]: audit 2024-09-20T22:11:30.542718+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:31 smithi179 bash[23186]: audit 2024-09-20T22:11:30.548503+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:32 smithi049 bash[23528]: cluster 2024-09-20T22:11:31.143156+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:32.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:32 smithi044 bash[22676]: cluster 2024-09-20T22:11:31.143156+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:32 smithi179 bash[23186]: cluster 2024-09-20T22:11:31.143156+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:34 smithi049 bash[23528]: cluster 2024-09-20T22:11:33.143443+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:34 smithi049 bash[23528]: audit 2024-09-20T22:11:33.703941+0000 mon.a (mon.0) 404 : audit [INF] from='client.? 172.21.15.44:0/1011493129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c085c15d-7b80-41dc-9070-0b563482e65f"}]: dispatch 2024-09-20T22:11:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:34 smithi049 bash[23528]: audit 2024-09-20T22:11:33.705936+0000 mon.a (mon.0) 405 : audit [INF] from='client.? 172.21.15.44:0/1011493129' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c085c15d-7b80-41dc-9070-0b563482e65f"}]': finished 2024-09-20T22:11:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:34 smithi049 bash[23528]: cluster 2024-09-20T22:11:33.709144+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-20T22:11:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:34 smithi049 bash[23528]: audit 2024-09-20T22:11:33.709378+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:11:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:34 smithi049 bash[23528]: audit 2024-09-20T22:11:34.345237+0000 mon.a (mon.0) 408 : audit [DBG] from='client.? 172.21.15.44:0/1168856275' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:11:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:34 smithi044 bash[22676]: cluster 2024-09-20T22:11:33.143443+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:34 smithi044 bash[22676]: audit 2024-09-20T22:11:33.703941+0000 mon.a (mon.0) 404 : audit [INF] from='client.? 172.21.15.44:0/1011493129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c085c15d-7b80-41dc-9070-0b563482e65f"}]: dispatch 2024-09-20T22:11:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:34 smithi044 bash[22676]: audit 2024-09-20T22:11:33.705936+0000 mon.a (mon.0) 405 : audit [INF] from='client.? 172.21.15.44:0/1011493129' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c085c15d-7b80-41dc-9070-0b563482e65f"}]': finished 2024-09-20T22:11:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:34 smithi044 bash[22676]: cluster 2024-09-20T22:11:33.709144+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-20T22:11:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:34 smithi044 bash[22676]: audit 2024-09-20T22:11:33.709378+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:11:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:34 smithi044 bash[22676]: audit 2024-09-20T22:11:34.345237+0000 mon.a (mon.0) 408 : audit [DBG] from='client.? 172.21.15.44:0/1168856275' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:11:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:34 smithi179 bash[23186]: cluster 2024-09-20T22:11:33.143443+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:34 smithi179 bash[23186]: audit 2024-09-20T22:11:33.703941+0000 mon.a (mon.0) 404 : audit [INF] from='client.? 172.21.15.44:0/1011493129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c085c15d-7b80-41dc-9070-0b563482e65f"}]: dispatch 2024-09-20T22:11:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:34 smithi179 bash[23186]: audit 2024-09-20T22:11:33.705936+0000 mon.a (mon.0) 405 : audit [INF] from='client.? 172.21.15.44:0/1011493129' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c085c15d-7b80-41dc-9070-0b563482e65f"}]': finished 2024-09-20T22:11:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:34 smithi179 bash[23186]: cluster 2024-09-20T22:11:33.709144+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-20T22:11:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:34 smithi179 bash[23186]: audit 2024-09-20T22:11:33.709378+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:11:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:34 smithi179 bash[23186]: audit 2024-09-20T22:11:34.345237+0000 mon.a (mon.0) 408 : audit [DBG] from='client.? 172.21.15.44:0/1168856275' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:11:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:36 smithi044 bash[22676]: cluster 2024-09-20T22:11:35.143830+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:36 smithi044 bash[22676]: audit 2024-09-20T22:11:35.692533+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:36 smithi044 bash[22676]: audit 2024-09-20T22:11:35.699271+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:36 smithi044 bash[22676]: audit 2024-09-20T22:11:35.704962+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:36 smithi179 bash[23186]: cluster 2024-09-20T22:11:35.143830+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:36 smithi179 bash[23186]: audit 2024-09-20T22:11:35.692533+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:36 smithi179 bash[23186]: audit 2024-09-20T22:11:35.699271+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:36 smithi179 bash[23186]: audit 2024-09-20T22:11:35.704962+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:36 smithi049 bash[23528]: cluster 2024-09-20T22:11:35.143830+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:36 smithi049 bash[23528]: audit 2024-09-20T22:11:35.692533+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:36 smithi049 bash[23528]: audit 2024-09-20T22:11:35.699271+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:36 smithi049 bash[23528]: audit 2024-09-20T22:11:35.704962+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:38 smithi044 bash[22676]: cluster 2024-09-20T22:11:37.144279+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:38 smithi179 bash[23186]: cluster 2024-09-20T22:11:37.144279+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:38 smithi049 bash[23528]: cluster 2024-09-20T22:11:37.144279+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:40 smithi044 bash[22676]: cluster 2024-09-20T22:11:39.144714+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:40 smithi044 bash[22676]: audit 2024-09-20T22:11:39.419609+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:40 smithi044 bash[22676]: audit 2024-09-20T22:11:39.427283+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:40 smithi044 bash[22676]: audit 2024-09-20T22:11:39.436511+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:40 smithi179 bash[23186]: cluster 2024-09-20T22:11:39.144714+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:40 smithi179 bash[23186]: audit 2024-09-20T22:11:39.419609+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:40 smithi179 bash[23186]: audit 2024-09-20T22:11:39.427283+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:40 smithi179 bash[23186]: audit 2024-09-20T22:11:39.436511+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:40 smithi049 bash[23528]: cluster 2024-09-20T22:11:39.144714+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:40 smithi049 bash[23528]: audit 2024-09-20T22:11:39.419609+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:40 smithi049 bash[23528]: audit 2024-09-20T22:11:39.427283+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:40 smithi049 bash[23528]: audit 2024-09-20T22:11:39.436511+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:42 smithi044 bash[22676]: cluster 2024-09-20T22:11:41.145141+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:42 smithi179 bash[23186]: cluster 2024-09-20T22:11:41.145141+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:42 smithi049 bash[23528]: cluster 2024-09-20T22:11:41.145141+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:44.701 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:44 smithi179 bash[23186]: cluster 2024-09-20T22:11:43.145570+0000 mgr.a (mgr.14150) 128 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:44 smithi044 bash[22676]: cluster 2024-09-20T22:11:43.145570+0000 mgr.a (mgr.14150) 128 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:44 smithi049 bash[23528]: cluster 2024-09-20T22:11:43.145570+0000 mgr.a (mgr.14150) 128 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:46 smithi179 bash[23186]: cluster 2024-09-20T22:11:45.145953+0000 mgr.a (mgr.14150) 129 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:46 smithi044 bash[22676]: cluster 2024-09-20T22:11:45.145953+0000 mgr.a (mgr.14150) 129 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:46 smithi049 bash[23528]: cluster 2024-09-20T22:11:45.145953+0000 mgr.a (mgr.14150) 129 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:47 smithi044 bash[22676]: audit 2024-09-20T22:11:46.608617+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T22:11:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:47 smithi044 bash[22676]: audit 2024-09-20T22:11:46.610284+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:47 smithi044 bash[22676]: cephadm 2024-09-20T22:11:46.611735+0000 mgr.a (mgr.14150) 130 : cephadm [INF] Deploying daemon osd.0 on smithi044 2024-09-20T22:11:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:47 smithi179 bash[23186]: audit 2024-09-20T22:11:46.608617+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T22:11:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:47 smithi179 bash[23186]: audit 2024-09-20T22:11:46.610284+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:47 smithi179 bash[23186]: cephadm 2024-09-20T22:11:46.611735+0000 mgr.a (mgr.14150) 130 : cephadm [INF] Deploying daemon osd.0 on smithi044 2024-09-20T22:11:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:47 smithi049 bash[23528]: audit 2024-09-20T22:11:46.608617+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T22:11:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:47 smithi049 bash[23528]: audit 2024-09-20T22:11:46.610284+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:47 smithi049 bash[23528]: cephadm 2024-09-20T22:11:46.611735+0000 mgr.a (mgr.14150) 130 : cephadm [INF] Deploying daemon osd.0 on smithi044 2024-09-20T22:11:48.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:48 smithi044 bash[22676]: cluster 2024-09-20T22:11:47.146233+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:48 smithi179 bash[23186]: cluster 2024-09-20T22:11:47.146233+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:48 smithi049 bash[23528]: cluster 2024-09-20T22:11:47.146233+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:50 smithi044 bash[22676]: cluster 2024-09-20T22:11:49.146631+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:50 smithi179 bash[23186]: cluster 2024-09-20T22:11:49.146631+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:50 smithi049 bash[23528]: cluster 2024-09-20T22:11:49.146631+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:51.974 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:11:51 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:51.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:51 smithi044 bash[22676]: audit 2024-09-20T22:11:50.737772+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:51.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:51 smithi044 bash[22676]: audit 2024-09-20T22:11:50.744402+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:51.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:51 smithi044 bash[22676]: audit 2024-09-20T22:11:50.750215+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:51.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:51 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:51 smithi179 bash[23186]: audit 2024-09-20T22:11:50.737772+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:51 smithi179 bash[23186]: audit 2024-09-20T22:11:50.744402+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:51 smithi179 bash[23186]: audit 2024-09-20T22:11:50.750215+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:51 smithi049 bash[23528]: audit 2024-09-20T22:11:50.737772+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:51 smithi049 bash[23528]: audit 2024-09-20T22:11:50.744402+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:51 smithi049 bash[23528]: audit 2024-09-20T22:11:50.750215+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:11:52 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:11:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 bash[22676]: cluster 2024-09-20T22:11:51.147060+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 bash[22676]: audit 2024-09-20T22:11:52.251359+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 bash[22676]: audit 2024-09-20T22:11:52.255731+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 bash[22676]: audit 2024-09-20T22:11:52.256769+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 bash[22676]: audit 2024-09-20T22:11:52.258192+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 bash[22676]: audit 2024-09-20T22:11:52.260632+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:52 smithi044 bash[22676]: audit 2024-09-20T22:11:52.265155+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:52 smithi179 bash[23186]: cluster 2024-09-20T22:11:51.147060+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:52 smithi179 bash[23186]: audit 2024-09-20T22:11:52.251359+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:52 smithi179 bash[23186]: audit 2024-09-20T22:11:52.255731+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:52 smithi179 bash[23186]: audit 2024-09-20T22:11:52.256769+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:52 smithi179 bash[23186]: audit 2024-09-20T22:11:52.258192+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:52 smithi179 bash[23186]: audit 2024-09-20T22:11:52.260632+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:52 smithi179 bash[23186]: audit 2024-09-20T22:11:52.265155+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:52 smithi049 bash[23528]: cluster 2024-09-20T22:11:51.147060+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:52 smithi049 bash[23528]: audit 2024-09-20T22:11:52.251359+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:52 smithi049 bash[23528]: audit 2024-09-20T22:11:52.255731+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:52 smithi049 bash[23528]: audit 2024-09-20T22:11:52.256769+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:52 smithi049 bash[23528]: audit 2024-09-20T22:11:52.258192+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:52 smithi049 bash[23528]: audit 2024-09-20T22:11:52.260632+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:52 smithi049 bash[23528]: audit 2024-09-20T22:11:52.265155+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:54 smithi049 bash[23528]: cluster 2024-09-20T22:11:53.147506+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:54 smithi044 bash[22676]: cluster 2024-09-20T22:11:53.147506+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:54 smithi179 bash[23186]: cluster 2024-09-20T22:11:53.147506+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:57.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: cluster 2024-09-20T22:11:55.148003+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:57.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: audit 2024-09-20T22:11:55.868937+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: audit 2024-09-20T22:11:55.873465+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: cephadm 2024-09-20T22:11:55.874608+0000 mgr.a (mgr.14150) 136 : cephadm [INF] Detected new or changed devices on smithi044 2024-09-20T22:11:57.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: audit 2024-09-20T22:11:55.875455+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:57.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: audit 2024-09-20T22:11:55.878226+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: audit 2024-09-20T22:11:55.878570+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:57.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: audit 2024-09-20T22:11:55.879429+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:57.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:56 smithi044 bash[22676]: audit 2024-09-20T22:11:55.884241+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: cluster 2024-09-20T22:11:55.148003+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: audit 2024-09-20T22:11:55.868937+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: audit 2024-09-20T22:11:55.873465+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: cephadm 2024-09-20T22:11:55.874608+0000 mgr.a (mgr.14150) 136 : cephadm [INF] Detected new or changed devices on smithi044 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: audit 2024-09-20T22:11:55.875455+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: audit 2024-09-20T22:11:55.878226+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: audit 2024-09-20T22:11:55.878570+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:57.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: audit 2024-09-20T22:11:55.879429+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:57.210 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:56 smithi049 bash[23528]: audit 2024-09-20T22:11:55.884241+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: cluster 2024-09-20T22:11:55.148003+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: audit 2024-09-20T22:11:55.868937+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: audit 2024-09-20T22:11:55.873465+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: cephadm 2024-09-20T22:11:55.874608+0000 mgr.a (mgr.14150) 136 : cephadm [INF] Detected new or changed devices on smithi044 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: audit 2024-09-20T22:11:55.875455+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: audit 2024-09-20T22:11:55.878226+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: audit 2024-09-20T22:11:55.878570+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: audit 2024-09-20T22:11:55.879429+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:11:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:56 smithi179 bash[23186]: audit 2024-09-20T22:11:55.884241+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:11:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:11:58 smithi044 bash[22676]: cluster 2024-09-20T22:11:57.148441+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:11:58 smithi179 bash[23186]: cluster 2024-09-20T22:11:57.148441+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:11:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:11:58 smithi049 bash[23528]: cluster 2024-09-20T22:11:57.148441+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:00 smithi044 bash[22676]: cluster 2024-09-20T22:11:59.148865+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:00 smithi044 bash[22676]: audit 2024-09-20T22:11:59.645910+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:00 smithi044 bash[22676]: audit 2024-09-20T22:11:59.654291+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:00 smithi044 bash[22676]: audit 2024-09-20T22:11:59.663672+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:00 smithi179 bash[23186]: cluster 2024-09-20T22:11:59.148865+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:00 smithi179 bash[23186]: audit 2024-09-20T22:11:59.645910+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:00 smithi179 bash[23186]: audit 2024-09-20T22:11:59.654291+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:00 smithi179 bash[23186]: audit 2024-09-20T22:11:59.663672+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:00 smithi049 bash[23528]: cluster 2024-09-20T22:11:59.148865+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:00 smithi049 bash[23528]: audit 2024-09-20T22:11:59.645910+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:00 smithi049 bash[23528]: audit 2024-09-20T22:11:59.654291+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:00 smithi049 bash[23528]: audit 2024-09-20T22:11:59.663672+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: cluster 2024-09-20T22:12:01.149155+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:02.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:01.314799+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:01.320575+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:01.322785+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:02.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:01.325817+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:01.326063+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:02.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:01.326876+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:02.564 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:01.331742+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.564 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:02 smithi044 bash[22676]: audit 2024-09-20T22:12:02.258508+0000 mon.a (mon.0) 443 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T22:12:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: cluster 2024-09-20T22:12:01.149155+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:01.314799+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:01.320575+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:01.322785+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:01.325817+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:01.326063+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:01.326876+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:01.331742+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:02 smithi179 bash[23186]: audit 2024-09-20T22:12:02.258508+0000 mon.a (mon.0) 443 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T22:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: cluster 2024-09-20T22:12:01.149155+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:01.314799+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:01.320575+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:01.322785+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:01.325817+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:01.326063+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:01.326876+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:01.331742+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:02 smithi049 bash[23528]: audit 2024-09-20T22:12:02.258508+0000 mon.a (mon.0) 443 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T22:12:03.208 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 0 on host 'smithi044' 2024-09-20T22:12:03.778 DEBUG:teuthology.orchestra.run.smithi044:osd.0> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@osd.0.service 2024-09-20T22:12:03.780 INFO:tasks.cephadm:Deploying osd.1 on smithi049 with /dev/vg_nvme/lv_4... 2024-09-20T22:12:03.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T22:12:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:02.647483+0000 mon.a (mon.0) 444 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T22:12:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: cluster 2024-09-20T22:12:02.650237+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-20T22:12:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:02.650581+0000 mon.a (mon.0) 446 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:02.650816+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.192838+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.200009+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.200694+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.206764+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.212288+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.215298+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.216488+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:03 smithi044 bash[22676]: audit 2024-09-20T22:12:03.223852+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:02.647483+0000 mon.a (mon.0) 444 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: cluster 2024-09-20T22:12:02.650237+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:02.650581+0000 mon.a (mon.0) 446 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:02.650816+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.192838+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.200009+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.200694+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.206764+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.212288+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.215298+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.216488+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:03 smithi179 bash[23186]: audit 2024-09-20T22:12:03.223852+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:02.647483+0000 mon.a (mon.0) 444 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: cluster 2024-09-20T22:12:02.650237+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:02.650581+0000 mon.a (mon.0) 446 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:02.650816+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.192838+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.200009+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.200694+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.206764+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.212288+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.215298+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.216488+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:03 smithi049 bash[23528]: audit 2024-09-20T22:12:03.223852+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:04 smithi044 bash[22676]: cluster 2024-09-20T22:12:03.149507+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:04 smithi044 bash[22676]: cephadm 2024-09-20T22:12:03.203258+0000 mgr.a (mgr.14150) 141 : cephadm [INF] Adjusting osd_memory_target on smithi044 to 16245M 2024-09-20T22:12:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:04 smithi044 bash[22676]: audit 2024-09-20T22:12:03.650020+0000 mon.a (mon.0) 456 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-20T22:12:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:04 smithi044 bash[22676]: cluster 2024-09-20T22:12:03.655257+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-20T22:12:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:04 smithi044 bash[22676]: audit 2024-09-20T22:12:03.656714+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:04 smithi044 bash[22676]: audit 2024-09-20T22:12:03.665916+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:04 smithi179 bash[23186]: cluster 2024-09-20T22:12:03.149507+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:04 smithi179 bash[23186]: cephadm 2024-09-20T22:12:03.203258+0000 mgr.a (mgr.14150) 141 : cephadm [INF] Adjusting osd_memory_target on smithi044 to 16245M 2024-09-20T22:12:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:04 smithi179 bash[23186]: audit 2024-09-20T22:12:03.650020+0000 mon.a (mon.0) 456 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-20T22:12:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:04 smithi179 bash[23186]: cluster 2024-09-20T22:12:03.655257+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-20T22:12:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:04 smithi179 bash[23186]: audit 2024-09-20T22:12:03.656714+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:04 smithi179 bash[23186]: audit 2024-09-20T22:12:03.665916+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:04 smithi049 bash[23528]: cluster 2024-09-20T22:12:03.149507+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:04 smithi049 bash[23528]: cephadm 2024-09-20T22:12:03.203258+0000 mgr.a (mgr.14150) 141 : cephadm [INF] Adjusting osd_memory_target on smithi044 to 16245M 2024-09-20T22:12:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:04 smithi049 bash[23528]: audit 2024-09-20T22:12:03.650020+0000 mon.a (mon.0) 456 : audit [INF] from='osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-20T22:12:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:04 smithi049 bash[23528]: cluster 2024-09-20T22:12:03.655257+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-20T22:12:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:04 smithi049 bash[23528]: audit 2024-09-20T22:12:03.656714+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:04 smithi049 bash[23528]: audit 2024-09-20T22:12:03.665916+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:05 smithi044 bash[22676]: cluster 2024-09-20T22:12:03.293044+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:12:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:05 smithi044 bash[22676]: cluster 2024-09-20T22:12:03.293156+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:12:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:05 smithi044 bash[22676]: cluster 2024-09-20T22:12:04.665615+0000 mon.a (mon.0) 460 : cluster [INF] osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976] boot 2024-09-20T22:12:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:05 smithi044 bash[22676]: cluster 2024-09-20T22:12:04.665701+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-20T22:12:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:05 smithi044 bash[22676]: audit 2024-09-20T22:12:04.666383+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:05 smithi179 bash[23186]: cluster 2024-09-20T22:12:03.293044+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:12:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:05 smithi179 bash[23186]: cluster 2024-09-20T22:12:03.293156+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:12:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:05 smithi179 bash[23186]: cluster 2024-09-20T22:12:04.665615+0000 mon.a (mon.0) 460 : cluster [INF] osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976] boot 2024-09-20T22:12:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:05 smithi179 bash[23186]: cluster 2024-09-20T22:12:04.665701+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-20T22:12:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:05 smithi179 bash[23186]: audit 2024-09-20T22:12:04.666383+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:05 smithi049 bash[23528]: cluster 2024-09-20T22:12:03.293044+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:12:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:05 smithi049 bash[23528]: cluster 2024-09-20T22:12:03.293156+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:12:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:05 smithi049 bash[23528]: cluster 2024-09-20T22:12:04.665615+0000 mon.a (mon.0) 460 : cluster [INF] osd.0 [v2:172.21.15.44:6802/2371582976,v1:172.21.15.44:6803/2371582976] boot 2024-09-20T22:12:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:05 smithi049 bash[23528]: cluster 2024-09-20T22:12:04.665701+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-20T22:12:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:05 smithi049 bash[23528]: audit 2024-09-20T22:12:04.666383+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:12:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:06 smithi044 bash[22676]: cluster 2024-09-20T22:12:05.149948+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:06 smithi044 bash[22676]: cluster 2024-09-20T22:12:05.681690+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-20T22:12:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:06 smithi179 bash[23186]: cluster 2024-09-20T22:12:05.149948+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:06 smithi179 bash[23186]: cluster 2024-09-20T22:12:05.681690+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-20T22:12:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:06 smithi049 bash[23528]: cluster 2024-09-20T22:12:05.149948+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T22:12:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:06 smithi049 bash[23528]: cluster 2024-09-20T22:12:05.681690+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-20T22:12:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.b/config 2024-09-20T22:12:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:08 smithi044 bash[22676]: cluster 2024-09-20T22:12:07.150449+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:08 smithi179 bash[23186]: cluster 2024-09-20T22:12:07.150449+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:08 smithi049 bash[23528]: cluster 2024-09-20T22:12:07.150449+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:10.973 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:10 smithi179 bash[23186]: cluster 2024-09-20T22:12:09.150902+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:10 smithi044 bash[22676]: cluster 2024-09-20T22:12:09.150902+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:11.011 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:10 smithi049 bash[23528]: cluster 2024-09-20T22:12:09.150902+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:12.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-20T22:12:12.190 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2024-09-20T22:12:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:11 smithi044 bash[22676]: audit 2024-09-20T22:12:10.954609+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:11 smithi044 bash[22676]: audit 2024-09-20T22:12:10.962317+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:11 smithi044 bash[22676]: audit 2024-09-20T22:12:10.971693+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:11 smithi179 bash[23186]: audit 2024-09-20T22:12:10.954609+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:11 smithi179 bash[23186]: audit 2024-09-20T22:12:10.962317+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:11 smithi179 bash[23186]: audit 2024-09-20T22:12:10.971693+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:11 smithi049 bash[23528]: audit 2024-09-20T22:12:10.954609+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:11 smithi049 bash[23528]: audit 2024-09-20T22:12:10.962317+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:11 smithi049 bash[23528]: audit 2024-09-20T22:12:10.971693+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:12 smithi044 bash[22676]: cluster 2024-09-20T22:12:11.151225+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:12 smithi179 bash[23186]: cluster 2024-09-20T22:12:11.151225+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:12 smithi049 bash[23528]: cluster 2024-09-20T22:12:11.151225+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:14 smithi044 bash[22676]: cluster 2024-09-20T22:12:13.151514+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:14 smithi179 bash[23186]: cluster 2024-09-20T22:12:13.151514+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:14 smithi049 bash[23528]: cluster 2024-09-20T22:12:13.151514+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:16.918 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.b/config 2024-09-20T22:12:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:16 smithi044 bash[22676]: cluster 2024-09-20T22:12:15.151940+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:16 smithi179 bash[23186]: cluster 2024-09-20T22:12:15.151940+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:16 smithi049 bash[23528]: cluster 2024-09-20T22:12:15.151940+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:18 smithi044 bash[22676]: cluster 2024-09-20T22:12:17.152398+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:18 smithi044 bash[22676]: audit 2024-09-20T22:12:18.481500+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:12:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:18 smithi044 bash[22676]: audit 2024-09-20T22:12:18.487599+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:12:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:18 smithi044 bash[22676]: audit 2024-09-20T22:12:18.489347+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:18 smithi179 bash[23186]: cluster 2024-09-20T22:12:17.152398+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:18 smithi179 bash[23186]: audit 2024-09-20T22:12:18.481500+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:12:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:18 smithi179 bash[23186]: audit 2024-09-20T22:12:18.487599+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:12:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:18 smithi179 bash[23186]: audit 2024-09-20T22:12:18.489347+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:18 smithi049 bash[23528]: cluster 2024-09-20T22:12:17.152398+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:18 smithi049 bash[23528]: audit 2024-09-20T22:12:18.481500+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:12:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:18 smithi049 bash[23528]: audit 2024-09-20T22:12:18.487599+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:12:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:18 smithi049 bash[23528]: audit 2024-09-20T22:12:18.489347+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:19 smithi044 bash[22676]: audit 2024-09-20T22:12:18.474757+0000 mgr.a (mgr.14150) 149 : audit [DBG] from='client.24128 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:12:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:19 smithi044 bash[22676]: audit 2024-09-20T22:12:19.848432+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:19 smithi044 bash[22676]: audit 2024-09-20T22:12:19.853687+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:19 smithi044 bash[22676]: audit 2024-09-20T22:12:19.858683+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:19 smithi044 bash[22676]: audit 2024-09-20T22:12:19.925333+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:19 smithi044 bash[22676]: audit 2024-09-20T22:12:19.930121+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:19 smithi044 bash[22676]: audit 2024-09-20T22:12:19.936091+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:19 smithi179 bash[23186]: audit 2024-09-20T22:12:18.474757+0000 mgr.a (mgr.14150) 149 : audit [DBG] from='client.24128 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:12:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:19 smithi179 bash[23186]: audit 2024-09-20T22:12:19.848432+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:19 smithi179 bash[23186]: audit 2024-09-20T22:12:19.853687+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:19 smithi179 bash[23186]: audit 2024-09-20T22:12:19.858683+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:19 smithi179 bash[23186]: audit 2024-09-20T22:12:19.925333+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:19 smithi179 bash[23186]: audit 2024-09-20T22:12:19.930121+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:19 smithi179 bash[23186]: audit 2024-09-20T22:12:19.936091+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:19 smithi049 bash[23528]: audit 2024-09-20T22:12:18.474757+0000 mgr.a (mgr.14150) 149 : audit [DBG] from='client.24128 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:12:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:19 smithi049 bash[23528]: audit 2024-09-20T22:12:19.848432+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:19 smithi049 bash[23528]: audit 2024-09-20T22:12:19.853687+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:19 smithi049 bash[23528]: audit 2024-09-20T22:12:19.858683+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:19 smithi049 bash[23528]: audit 2024-09-20T22:12:19.925333+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:19 smithi049 bash[23528]: audit 2024-09-20T22:12:19.930121+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:19 smithi049 bash[23528]: audit 2024-09-20T22:12:19.936091+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:20 smithi179 bash[23186]: cluster 2024-09-20T22:12:19.152809+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:20 smithi049 bash[23528]: cluster 2024-09-20T22:12:19.152809+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:20 smithi044 bash[22676]: cluster 2024-09-20T22:12:19.152809+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:23 smithi049 bash[23528]: cluster 2024-09-20T22:12:21.153209+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:23 smithi044 bash[22676]: cluster 2024-09-20T22:12:21.153209+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:23 smithi179 bash[23186]: cluster 2024-09-20T22:12:21.153209+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:25 smithi179 bash[23186]: cluster 2024-09-20T22:12:23.153618+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:25 smithi049 bash[23528]: cluster 2024-09-20T22:12:23.153618+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:25 smithi044 bash[22676]: cluster 2024-09-20T22:12:23.153618+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:27 smithi049 bash[23528]: cluster 2024-09-20T22:12:25.154060+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:27 smithi049 bash[23528]: audit 2024-09-20T22:12:26.996101+0000 mon.a (mon.0) 476 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]: dispatch 2024-09-20T22:12:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:27 smithi049 bash[23528]: audit 2024-09-20T22:12:26.996174+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.49:0/1642629626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]: dispatch 2024-09-20T22:12:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:27 smithi049 bash[23528]: audit 2024-09-20T22:12:26.999292+0000 mon.a (mon.0) 477 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]': finished 2024-09-20T22:12:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:27 smithi049 bash[23528]: cluster 2024-09-20T22:12:27.004558+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-20T22:12:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:27 smithi049 bash[23528]: audit 2024-09-20T22:12:27.005102+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:12:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:27 smithi044 bash[22676]: cluster 2024-09-20T22:12:25.154060+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:27 smithi044 bash[22676]: audit 2024-09-20T22:12:26.996101+0000 mon.a (mon.0) 476 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]: dispatch 2024-09-20T22:12:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:27 smithi044 bash[22676]: audit 2024-09-20T22:12:26.996174+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.49:0/1642629626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]: dispatch 2024-09-20T22:12:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:27 smithi044 bash[22676]: audit 2024-09-20T22:12:26.999292+0000 mon.a (mon.0) 477 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]': finished 2024-09-20T22:12:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:27 smithi044 bash[22676]: cluster 2024-09-20T22:12:27.004558+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-20T22:12:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:27 smithi044 bash[22676]: audit 2024-09-20T22:12:27.005102+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:12:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:27 smithi179 bash[23186]: cluster 2024-09-20T22:12:25.154060+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:27 smithi179 bash[23186]: audit 2024-09-20T22:12:26.996101+0000 mon.a (mon.0) 476 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]: dispatch 2024-09-20T22:12:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:27 smithi179 bash[23186]: audit 2024-09-20T22:12:26.996174+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.49:0/1642629626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]: dispatch 2024-09-20T22:12:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:27 smithi179 bash[23186]: audit 2024-09-20T22:12:26.999292+0000 mon.a (mon.0) 477 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9070c041-a3b4-4ba7-b744-9f03bbf3e0c9"}]': finished 2024-09-20T22:12:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:27 smithi179 bash[23186]: cluster 2024-09-20T22:12:27.004558+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-20T22:12:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:27 smithi179 bash[23186]: audit 2024-09-20T22:12:27.005102+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:12:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:28 smithi179 bash[23186]: audit 2024-09-20T22:12:27.619117+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.49:0/2393297999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:12:28.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:28 smithi049 bash[23528]: audit 2024-09-20T22:12:27.619117+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.49:0/2393297999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:12:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:28 smithi044 bash[22676]: audit 2024-09-20T22:12:27.619117+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.49:0/2393297999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:12:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:29 smithi049 bash[23528]: cluster 2024-09-20T22:12:27.154512+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:29 smithi044 bash[22676]: cluster 2024-09-20T22:12:27.154512+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:29 smithi179 bash[23186]: cluster 2024-09-20T22:12:27.154512+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:31 smithi049 bash[23528]: cluster 2024-09-20T22:12:29.154979+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:31 smithi044 bash[22676]: cluster 2024-09-20T22:12:29.154979+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:31 smithi179 bash[23186]: cluster 2024-09-20T22:12:29.154979+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:32 smithi044 bash[22676]: cluster 2024-09-20T22:12:31.155408+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:32 smithi044 bash[22676]: audit 2024-09-20T22:12:31.166552+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:32 smithi044 bash[22676]: audit 2024-09-20T22:12:31.172049+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:32 smithi044 bash[22676]: audit 2024-09-20T22:12:31.177178+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:32 smithi179 bash[23186]: cluster 2024-09-20T22:12:31.155408+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:32 smithi179 bash[23186]: audit 2024-09-20T22:12:31.166552+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:32 smithi179 bash[23186]: audit 2024-09-20T22:12:31.172049+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:32 smithi179 bash[23186]: audit 2024-09-20T22:12:31.177178+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:32 smithi049 bash[23528]: cluster 2024-09-20T22:12:31.155408+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:32 smithi049 bash[23528]: audit 2024-09-20T22:12:31.166552+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:32 smithi049 bash[23528]: audit 2024-09-20T22:12:31.172049+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:32 smithi049 bash[23528]: audit 2024-09-20T22:12:31.177178+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:34 smithi044 bash[22676]: cluster 2024-09-20T22:12:33.155853+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:34 smithi179 bash[23186]: cluster 2024-09-20T22:12:33.155853+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:34 smithi049 bash[23528]: cluster 2024-09-20T22:12:33.155853+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:36 smithi049 bash[23528]: cluster 2024-09-20T22:12:35.156380+0000 mgr.a (mgr.14150) 158 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:36 smithi044 bash[22676]: cluster 2024-09-20T22:12:35.156380+0000 mgr.a (mgr.14150) 158 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:36 smithi179 bash[23186]: cluster 2024-09-20T22:12:35.156380+0000 mgr.a (mgr.14150) 158 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:38.473 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:38 smithi049 bash[23528]: cluster 2024-09-20T22:12:37.156970+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:38 smithi044 bash[22676]: cluster 2024-09-20T22:12:37.156970+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:38 smithi179 bash[23186]: cluster 2024-09-20T22:12:37.156970+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:40 smithi179 bash[23186]: cluster 2024-09-20T22:12:39.157554+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:40 smithi179 bash[23186]: audit 2024-09-20T22:12:39.997566+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:40 smithi179 bash[23186]: audit 2024-09-20T22:12:40.002168+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:40 smithi179 bash[23186]: audit 2024-09-20T22:12:40.011768+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:40 smithi179 bash[23186]: audit 2024-09-20T22:12:40.153692+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:40 smithi179 bash[23186]: audit 2024-09-20T22:12:40.161492+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:40 smithi179 bash[23186]: audit 2024-09-20T22:12:40.171499+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:40 smithi049 bash[23528]: cluster 2024-09-20T22:12:39.157554+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:40 smithi049 bash[23528]: audit 2024-09-20T22:12:39.997566+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:40 smithi049 bash[23528]: audit 2024-09-20T22:12:40.002168+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:40 smithi049 bash[23528]: audit 2024-09-20T22:12:40.011768+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:40 smithi049 bash[23528]: audit 2024-09-20T22:12:40.153692+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:40 smithi049 bash[23528]: audit 2024-09-20T22:12:40.161492+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:40 smithi049 bash[23528]: audit 2024-09-20T22:12:40.171499+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:40 smithi044 bash[22676]: cluster 2024-09-20T22:12:39.157554+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:40 smithi044 bash[22676]: audit 2024-09-20T22:12:39.997566+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:40 smithi044 bash[22676]: audit 2024-09-20T22:12:40.002168+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:40 smithi044 bash[22676]: audit 2024-09-20T22:12:40.011768+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:40 smithi044 bash[22676]: audit 2024-09-20T22:12:40.153692+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:40 smithi044 bash[22676]: audit 2024-09-20T22:12:40.161492+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:40 smithi044 bash[22676]: audit 2024-09-20T22:12:40.171499+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:43 smithi179 bash[23186]: cluster 2024-09-20T22:12:41.158137+0000 mgr.a (mgr.14150) 161 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:43 smithi049 bash[23528]: cluster 2024-09-20T22:12:41.158137+0000 mgr.a (mgr.14150) 161 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:43 smithi044 bash[22676]: cluster 2024-09-20T22:12:41.158137+0000 mgr.a (mgr.14150) 161 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:44 smithi049 bash[23528]: audit 2024-09-20T22:12:43.084900+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T22:12:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:44 smithi049 bash[23528]: audit 2024-09-20T22:12:43.086796+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:44 smithi049 bash[23528]: cephadm 2024-09-20T22:12:43.088363+0000 mgr.a (mgr.14150) 162 : cephadm [INF] Deploying daemon osd.1 on smithi049 2024-09-20T22:12:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:44 smithi044 bash[22676]: audit 2024-09-20T22:12:43.084900+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T22:12:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:44 smithi044 bash[22676]: audit 2024-09-20T22:12:43.086796+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:44 smithi044 bash[22676]: cephadm 2024-09-20T22:12:43.088363+0000 mgr.a (mgr.14150) 162 : cephadm [INF] Deploying daemon osd.1 on smithi049 2024-09-20T22:12:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:44 smithi179 bash[23186]: audit 2024-09-20T22:12:43.084900+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T22:12:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:44 smithi179 bash[23186]: audit 2024-09-20T22:12:43.086796+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:44 smithi179 bash[23186]: cephadm 2024-09-20T22:12:43.088363+0000 mgr.a (mgr.14150) 162 : cephadm [INF] Deploying daemon osd.1 on smithi049 2024-09-20T22:12:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:45 smithi049 bash[23528]: cluster 2024-09-20T22:12:43.158626+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:45 smithi044 bash[22676]: cluster 2024-09-20T22:12:43.158626+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:45 smithi179 bash[23186]: cluster 2024-09-20T22:12:43.158626+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:47 smithi049 bash[23528]: cluster 2024-09-20T22:12:45.159178+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:47 smithi044 bash[22676]: cluster 2024-09-20T22:12:45.159178+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:47 smithi179 bash[23186]: cluster 2024-09-20T22:12:45.159178+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:47.576 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:47 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:12:47.577 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:12:47 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:12:47.913 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:47 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:12:47.913 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:12:47 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:12:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:48 smithi179 bash[23186]: audit 2024-09-20T22:12:47.847382+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:48 smithi179 bash[23186]: audit 2024-09-20T22:12:47.855114+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:48 smithi179 bash[23186]: audit 2024-09-20T22:12:47.855744+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:48 smithi179 bash[23186]: audit 2024-09-20T22:12:47.858261+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:48 smithi179 bash[23186]: audit 2024-09-20T22:12:47.863288+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:48 smithi179 bash[23186]: audit 2024-09-20T22:12:47.870370+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:48 smithi049 bash[23528]: audit 2024-09-20T22:12:47.847382+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:48 smithi049 bash[23528]: audit 2024-09-20T22:12:47.855114+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:48 smithi049 bash[23528]: audit 2024-09-20T22:12:47.855744+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:48 smithi049 bash[23528]: audit 2024-09-20T22:12:47.858261+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:48 smithi049 bash[23528]: audit 2024-09-20T22:12:47.863288+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:48 smithi049 bash[23528]: audit 2024-09-20T22:12:47.870370+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:48 smithi044 bash[22676]: audit 2024-09-20T22:12:47.847382+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:48 smithi044 bash[22676]: audit 2024-09-20T22:12:47.855114+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:48 smithi044 bash[22676]: audit 2024-09-20T22:12:47.855744+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:48 smithi044 bash[22676]: audit 2024-09-20T22:12:47.858261+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:48 smithi044 bash[22676]: audit 2024-09-20T22:12:47.863288+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:48 smithi044 bash[22676]: audit 2024-09-20T22:12:47.870370+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:49 smithi049 bash[23528]: cluster 2024-09-20T22:12:47.159747+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:49 smithi044 bash[22676]: cluster 2024-09-20T22:12:47.159747+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:49 smithi179 bash[23186]: cluster 2024-09-20T22:12:47.159747+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:51 smithi049 bash[23528]: cluster 2024-09-20T22:12:49.160221+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:51.398 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:51 smithi179 bash[23186]: cluster 2024-09-20T22:12:49.160221+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:51 smithi044 bash[22676]: cluster 2024-09-20T22:12:49.160221+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:52 smithi049 bash[23528]: cluster 2024-09-20T22:12:51.160707+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:52 smithi049 bash[23528]: audit 2024-09-20T22:12:51.379544+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:52 smithi049 bash[23528]: audit 2024-09-20T22:12:51.387090+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:52 smithi049 bash[23528]: audit 2024-09-20T22:12:51.396331+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.646 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:52 smithi044 bash[22676]: cluster 2024-09-20T22:12:51.160707+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:52.646 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:52 smithi044 bash[22676]: audit 2024-09-20T22:12:51.379544+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.646 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:52 smithi044 bash[22676]: audit 2024-09-20T22:12:51.387090+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.646 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:52 smithi044 bash[22676]: audit 2024-09-20T22:12:51.396331+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:52 smithi179 bash[23186]: cluster 2024-09-20T22:12:51.160707+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:52 smithi179 bash[23186]: audit 2024-09-20T22:12:51.379544+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:52 smithi179 bash[23186]: audit 2024-09-20T22:12:51.387090+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:52 smithi179 bash[23186]: audit 2024-09-20T22:12:51.396331+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:54 smithi044 bash[22676]: cluster 2024-09-20T22:12:53.161272+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:54 smithi179 bash[23186]: cluster 2024-09-20T22:12:53.161272+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:54 smithi049 bash[23528]: cluster 2024-09-20T22:12:53.161272+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:56 smithi044 bash[22676]: cluster 2024-09-20T22:12:55.161843+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:56 smithi179 bash[23186]: cluster 2024-09-20T22:12:55.161843+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:56 smithi049 bash[23528]: cluster 2024-09-20T22:12:55.161843+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:58 smithi044 bash[22676]: cluster 2024-09-20T22:12:57.162427+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:58 smithi044 bash[22676]: audit 2024-09-20T22:12:57.785732+0000 mon.a (mon.0) 500 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T22:12:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:58 smithi044 bash[22676]: audit 2024-09-20T22:12:57.786246+0000 mon.b (mon.2) 8 : audit [INF] from='osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T22:12:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:58 smithi179 bash[23186]: cluster 2024-09-20T22:12:57.162427+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:58 smithi179 bash[23186]: audit 2024-09-20T22:12:57.785732+0000 mon.a (mon.0) 500 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T22:12:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:58 smithi179 bash[23186]: audit 2024-09-20T22:12:57.786246+0000 mon.b (mon.2) 8 : audit [INF] from='osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T22:12:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:58 smithi049 bash[23528]: cluster 2024-09-20T22:12:57.162427+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:12:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:58 smithi049 bash[23528]: audit 2024-09-20T22:12:57.785732+0000 mon.a (mon.0) 500 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T22:12:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:58 smithi049 bash[23528]: audit 2024-09-20T22:12:57.786246+0000 mon.b (mon.2) 8 : audit [INF] from='osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T22:12:58.977 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 1 on host 'smithi049' 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.397989+0000 mon.a (mon.0) 501 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: cluster 2024-09-20T22:12:58.402482+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.402920+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.403786+0000 mon.a (mon.0) 504 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.404315+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.962466+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.968138+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.969077+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:12:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: cephadm 2024-09-20T22:12:58.971520+0000 mgr.a (mgr.14150) 171 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 16241M 2024-09-20T22:12:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.975993+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.982869+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.987292+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.989082+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:12:59 smithi044 bash[22676]: audit 2024-09-20T22:12:58.998735+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.397989+0000 mon.a (mon.0) 501 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: cluster 2024-09-20T22:12:58.402482+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.402920+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.403786+0000 mon.a (mon.0) 504 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.404315+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.962466+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.968138+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.969077+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: cephadm 2024-09-20T22:12:58.971520+0000 mgr.a (mgr.14150) 171 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 16241M 2024-09-20T22:12:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.975993+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.982869+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.987292+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.989082+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:12:59 smithi179 bash[23186]: audit 2024-09-20T22:12:58.998735+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.397989+0000 mon.a (mon.0) 501 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T22:12:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: cluster 2024-09-20T22:12:58.402482+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-20T22:12:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.402920+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:12:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.403786+0000 mon.a (mon.0) 504 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-20T22:12:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.404315+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.962466+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.968138+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.969077+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: cephadm 2024-09-20T22:12:58.971520+0000 mgr.a (mgr.14150) 171 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 16241M 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.975993+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.982869+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.987292+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.989082+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:12:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:12:59 smithi049 bash[23528]: audit 2024-09-20T22:12:58.998735+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.206 DEBUG:teuthology.orchestra.run.smithi049:osd.1> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@osd.1.service 2024-09-20T22:13:00.208 INFO:tasks.cephadm:Deploying osd.2 on smithi179 with /dev/vg_nvme/lv_4... 2024-09-20T22:13:00.209 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T22:13:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: cluster 2024-09-20T22:12:59.162886+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:13:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:12:59.400529+0000 mon.a (mon.0) 513 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-20T22:13:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: cluster 2024-09-20T22:12:59.405814+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-20T22:13:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:12:59.406760+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:12:59.416315+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.151206+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.160412+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.165111+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.171651+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.172275+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.174132+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.184669+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.340555+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.346877+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:00 smithi179 bash[23186]: audit 2024-09-20T22:13:00.353979+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: cluster 2024-09-20T22:12:59.162886+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:13:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:12:59.400529+0000 mon.a (mon.0) 513 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-20T22:13:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: cluster 2024-09-20T22:12:59.405814+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-20T22:13:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:12:59.406760+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:12:59.416315+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.151206+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.160412+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.165111+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.171651+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.172275+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.174132+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.184669+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.340555+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.346877+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:00 smithi049 bash[23528]: audit 2024-09-20T22:13:00.353979+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: cluster 2024-09-20T22:12:59.162886+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:13:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:12:59.400529+0000 mon.a (mon.0) 513 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-20T22:13:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: cluster 2024-09-20T22:12:59.405814+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-20T22:13:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:12:59.406760+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:12:59.416315+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.151206+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.160412+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.165111+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.171651+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.172275+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.174132+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.184669+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.340555+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.346877+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:00 smithi044 bash[22676]: audit 2024-09-20T22:13:00.353979+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:01 smithi049 bash[23528]: cluster 2024-09-20T22:12:58.757622+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:13:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:01 smithi049 bash[23528]: cluster 2024-09-20T22:12:58.757729+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:13:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:01 smithi049 bash[23528]: cephadm 2024-09-20T22:13:00.163087+0000 mgr.a (mgr.14150) 173 : cephadm [INF] Detected new or changed devices on smithi049 2024-09-20T22:13:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:01 smithi049 bash[23528]: cluster 2024-09-20T22:13:00.416951+0000 mon.a (mon.0) 527 : cluster [INF] osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085] boot 2024-09-20T22:13:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:01 smithi049 bash[23528]: cluster 2024-09-20T22:13:00.417059+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-20T22:13:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:01 smithi049 bash[23528]: audit 2024-09-20T22:13:00.417688+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:01.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:01 smithi044 bash[22676]: cluster 2024-09-20T22:12:58.757622+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:13:01.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:01 smithi044 bash[22676]: cluster 2024-09-20T22:12:58.757729+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:13:01.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:01 smithi044 bash[22676]: cephadm 2024-09-20T22:13:00.163087+0000 mgr.a (mgr.14150) 173 : cephadm [INF] Detected new or changed devices on smithi049 2024-09-20T22:13:01.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:01 smithi044 bash[22676]: cluster 2024-09-20T22:13:00.416951+0000 mon.a (mon.0) 527 : cluster [INF] osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085] boot 2024-09-20T22:13:01.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:01 smithi044 bash[22676]: cluster 2024-09-20T22:13:00.417059+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-20T22:13:01.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:01 smithi044 bash[22676]: audit 2024-09-20T22:13:00.417688+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:01 smithi179 bash[23186]: cluster 2024-09-20T22:12:58.757622+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:13:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:01 smithi179 bash[23186]: cluster 2024-09-20T22:12:58.757729+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:13:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:01 smithi179 bash[23186]: cephadm 2024-09-20T22:13:00.163087+0000 mgr.a (mgr.14150) 173 : cephadm [INF] Detected new or changed devices on smithi049 2024-09-20T22:13:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:01 smithi179 bash[23186]: cluster 2024-09-20T22:13:00.416951+0000 mon.a (mon.0) 527 : cluster [INF] osd.1 [v2:172.21.15.49:6800/2754466085,v1:172.21.15.49:6801/2754466085] boot 2024-09-20T22:13:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:01 smithi179 bash[23186]: cluster 2024-09-20T22:13:00.417059+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-20T22:13:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:01 smithi179 bash[23186]: audit 2024-09-20T22:13:00.417688+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:13:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:02 smithi044 bash[22676]: cluster 2024-09-20T22:13:01.163348+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:13:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:02 smithi044 bash[22676]: cluster 2024-09-20T22:13:01.436464+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-20T22:13:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:02 smithi179 bash[23186]: cluster 2024-09-20T22:13:01.163348+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:13:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:02 smithi179 bash[23186]: cluster 2024-09-20T22:13:01.436464+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-20T22:13:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:02 smithi049 bash[23528]: cluster 2024-09-20T22:13:01.163348+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-20T22:13:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:02 smithi049 bash[23528]: cluster 2024-09-20T22:13:01.436464+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-20T22:13:03.928 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.c/config 2024-09-20T22:13:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:04 smithi044 bash[22676]: cluster 2024-09-20T22:13:03.163784+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:04 smithi179 bash[23186]: cluster 2024-09-20T22:13:03.163784+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:04 smithi049 bash[23528]: cluster 2024-09-20T22:13:03.163784+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:05 smithi044 bash[22676]: audit 2024-09-20T22:13:04.896733+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:05 smithi044 bash[22676]: audit 2024-09-20T22:13:04.907306+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:05 smithi044 bash[22676]: audit 2024-09-20T22:13:04.912126+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:05 smithi044 bash[22676]: audit 2024-09-20T22:13:04.919622+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:05 smithi044 bash[22676]: audit 2024-09-20T22:13:04.920194+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:05 smithi044 bash[22676]: audit 2024-09-20T22:13:04.922369+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:05 smithi044 bash[22676]: audit 2024-09-20T22:13:04.931837+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:05 smithi179 bash[23186]: audit 2024-09-20T22:13:04.896733+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:05 smithi179 bash[23186]: audit 2024-09-20T22:13:04.907306+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:05 smithi179 bash[23186]: audit 2024-09-20T22:13:04.912126+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:05 smithi179 bash[23186]: audit 2024-09-20T22:13:04.919622+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:05 smithi179 bash[23186]: audit 2024-09-20T22:13:04.920194+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:05 smithi179 bash[23186]: audit 2024-09-20T22:13:04.922369+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:05 smithi179 bash[23186]: audit 2024-09-20T22:13:04.931837+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:05 smithi049 bash[23528]: audit 2024-09-20T22:13:04.896733+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:05 smithi049 bash[23528]: audit 2024-09-20T22:13:04.907306+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:05 smithi049 bash[23528]: audit 2024-09-20T22:13:04.912126+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:05 smithi049 bash[23528]: audit 2024-09-20T22:13:04.919622+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:05 smithi049 bash[23528]: audit 2024-09-20T22:13:04.920194+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:05 smithi049 bash[23528]: audit 2024-09-20T22:13:04.922369+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:05 smithi049 bash[23528]: audit 2024-09-20T22:13:04.931837+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:06 smithi044 bash[22676]: cluster 2024-09-20T22:13:05.164328+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:07.244 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:06 smithi179 bash[23186]: cluster 2024-09-20T22:13:05.164328+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:06 smithi049 bash[23528]: cluster 2024-09-20T22:13:05.164328+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:08.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-20T22:13:08.354 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi179:vg_nvme/lv_4 2024-09-20T22:13:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:08 smithi044 bash[22676]: cluster 2024-09-20T22:13:07.164955+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:08 smithi179 bash[23186]: cluster 2024-09-20T22:13:07.164955+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:08 smithi049 bash[23528]: cluster 2024-09-20T22:13:07.164955+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:11.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:10 smithi044 bash[22676]: cluster 2024-09-20T22:13:09.165567+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:10 smithi179 bash[23186]: cluster 2024-09-20T22:13:09.165567+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:10 smithi049 bash[23528]: cluster 2024-09-20T22:13:09.165567+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:12.061 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.c/config 2024-09-20T22:13:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:12 smithi044 bash[22676]: cluster 2024-09-20T22:13:11.166089+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:12 smithi044 bash[22676]: audit 2024-09-20T22:13:11.602631+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:12 smithi044 bash[22676]: audit 2024-09-20T22:13:11.610701+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:12 smithi044 bash[22676]: audit 2024-09-20T22:13:11.620386+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:12.988 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:12 smithi179 bash[23186]: cluster 2024-09-20T22:13:11.166089+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:12.988 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:12 smithi179 bash[23186]: audit 2024-09-20T22:13:11.602631+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:12.988 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:12 smithi179 bash[23186]: audit 2024-09-20T22:13:11.610701+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:12.988 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:12 smithi179 bash[23186]: audit 2024-09-20T22:13:11.620386+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:12 smithi049 bash[23528]: cluster 2024-09-20T22:13:11.166089+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:12 smithi049 bash[23528]: audit 2024-09-20T22:13:11.602631+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:12 smithi049 bash[23528]: audit 2024-09-20T22:13:11.610701+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:12 smithi049 bash[23528]: audit 2024-09-20T22:13:11.620386+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:13 smithi044 bash[22676]: audit 2024-09-20T22:13:13.348479+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:13:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:13 smithi044 bash[22676]: audit 2024-09-20T22:13:13.351342+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:13:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:13 smithi044 bash[22676]: audit 2024-09-20T22:13:13.352094+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:13 smithi179 bash[23186]: audit 2024-09-20T22:13:13.348479+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:13:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:13 smithi179 bash[23186]: audit 2024-09-20T22:13:13.351342+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:13:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:13 smithi179 bash[23186]: audit 2024-09-20T22:13:13.352094+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:14.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:13 smithi049 bash[23528]: audit 2024-09-20T22:13:13.348479+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T22:13:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:13 smithi049 bash[23528]: audit 2024-09-20T22:13:13.351342+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T22:13:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:13 smithi049 bash[23528]: audit 2024-09-20T22:13:13.352094+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:14 smithi044 bash[22676]: cluster 2024-09-20T22:13:13.166371+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:14 smithi044 bash[22676]: audit 2024-09-20T22:13:13.345332+0000 mgr.a (mgr.14150) 181 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:13:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:14 smithi179 bash[23186]: cluster 2024-09-20T22:13:13.166371+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:14 smithi179 bash[23186]: audit 2024-09-20T22:13:13.345332+0000 mgr.a (mgr.14150) 181 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:13:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:14 smithi049 bash[23528]: cluster 2024-09-20T22:13:13.166371+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:14 smithi049 bash[23528]: audit 2024-09-20T22:13:13.345332+0000 mgr.a (mgr.14150) 181 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:13:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:16 smithi044 bash[22676]: cluster 2024-09-20T22:13:15.166789+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:16 smithi179 bash[23186]: cluster 2024-09-20T22:13:15.166789+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:16 smithi049 bash[23528]: cluster 2024-09-20T22:13:15.166789+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:18 smithi179 bash[23186]: cluster 2024-09-20T22:13:17.167292+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:18.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:18 smithi049 bash[23528]: cluster 2024-09-20T22:13:17.167292+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:18 smithi044 bash[22676]: cluster 2024-09-20T22:13:17.167292+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:20.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:20 smithi179 bash[23186]: cluster 2024-09-20T22:13:19.167755+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:20.875 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:20 smithi179 bash[23186]: audit 2024-09-20T22:13:20.566161+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:20.875 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:20 smithi179 bash[23186]: audit 2024-09-20T22:13:20.573659+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:20.875 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:20 smithi179 bash[23186]: audit 2024-09-20T22:13:20.583111+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:20 smithi044 bash[22676]: cluster 2024-09-20T22:13:19.167755+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:20 smithi044 bash[22676]: audit 2024-09-20T22:13:20.566161+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:20 smithi044 bash[22676]: audit 2024-09-20T22:13:20.573659+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:20 smithi044 bash[22676]: audit 2024-09-20T22:13:20.583111+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:21.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:20 smithi049 bash[23528]: cluster 2024-09-20T22:13:19.167755+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:21.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:20 smithi049 bash[23528]: audit 2024-09-20T22:13:20.566161+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:20 smithi049 bash[23528]: audit 2024-09-20T22:13:20.573659+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:20 smithi049 bash[23528]: audit 2024-09-20T22:13:20.583111+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:22 smithi044 bash[22676]: cluster 2024-09-20T22:13:21.168232+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:22 smithi044 bash[22676]: audit 2024-09-20T22:13:21.635259+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]: dispatch 2024-09-20T22:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:22 smithi044 bash[22676]: audit 2024-09-20T22:13:21.635412+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.179:0/3678668703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]: dispatch 2024-09-20T22:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:22 smithi044 bash[22676]: audit 2024-09-20T22:13:21.638500+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]': finished 2024-09-20T22:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:22 smithi044 bash[22676]: cluster 2024-09-20T22:13:21.643376+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-20T22:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:22 smithi044 bash[22676]: audit 2024-09-20T22:13:21.643812+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:22 smithi044 bash[22676]: audit 2024-09-20T22:13:22.278110+0000 mon.c (mon.1) 6 : audit [DBG] from='client.? 172.21.15.179:0/4182382538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:13:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:22 smithi179 bash[23186]: cluster 2024-09-20T22:13:21.168232+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:22 smithi179 bash[23186]: audit 2024-09-20T22:13:21.635259+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]: dispatch 2024-09-20T22:13:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:22 smithi179 bash[23186]: audit 2024-09-20T22:13:21.635412+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.179:0/3678668703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]: dispatch 2024-09-20T22:13:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:22 smithi179 bash[23186]: audit 2024-09-20T22:13:21.638500+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]': finished 2024-09-20T22:13:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:22 smithi179 bash[23186]: cluster 2024-09-20T22:13:21.643376+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-20T22:13:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:22 smithi179 bash[23186]: audit 2024-09-20T22:13:21.643812+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:22 smithi179 bash[23186]: audit 2024-09-20T22:13:22.278110+0000 mon.c (mon.1) 6 : audit [DBG] from='client.? 172.21.15.179:0/4182382538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:13:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:22 smithi049 bash[23528]: cluster 2024-09-20T22:13:21.168232+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:22 smithi049 bash[23528]: audit 2024-09-20T22:13:21.635259+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]: dispatch 2024-09-20T22:13:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:22 smithi049 bash[23528]: audit 2024-09-20T22:13:21.635412+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.179:0/3678668703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]: dispatch 2024-09-20T22:13:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:22 smithi049 bash[23528]: audit 2024-09-20T22:13:21.638500+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75f0f7be-d47d-4744-9735-e14503d6bb28"}]': finished 2024-09-20T22:13:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:22 smithi049 bash[23528]: cluster 2024-09-20T22:13:21.643376+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-20T22:13:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:22 smithi049 bash[23528]: audit 2024-09-20T22:13:21.643812+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:22 smithi049 bash[23528]: audit 2024-09-20T22:13:22.278110+0000 mon.c (mon.1) 6 : audit [DBG] from='client.? 172.21.15.179:0/4182382538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T22:13:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:24 smithi049 bash[23528]: cluster 2024-09-20T22:13:23.168724+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:24 smithi049 bash[23528]: audit 2024-09-20T22:13:23.512383+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:24 smithi049 bash[23528]: audit 2024-09-20T22:13:23.520673+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:24 smithi049 bash[23528]: audit 2024-09-20T22:13:23.530109+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:24 smithi044 bash[22676]: cluster 2024-09-20T22:13:23.168724+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:24 smithi044 bash[22676]: audit 2024-09-20T22:13:23.512383+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:24 smithi044 bash[22676]: audit 2024-09-20T22:13:23.520673+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:24 smithi044 bash[22676]: audit 2024-09-20T22:13:23.530109+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:24 smithi179 bash[23186]: cluster 2024-09-20T22:13:23.168724+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:24 smithi179 bash[23186]: audit 2024-09-20T22:13:23.512383+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:24 smithi179 bash[23186]: audit 2024-09-20T22:13:23.520673+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:24 smithi179 bash[23186]: audit 2024-09-20T22:13:23.530109+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:26 smithi049 bash[23528]: cluster 2024-09-20T22:13:25.169193+0000 mgr.a (mgr.14150) 187 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:26 smithi044 bash[22676]: cluster 2024-09-20T22:13:25.169193+0000 mgr.a (mgr.14150) 187 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:26 smithi179 bash[23186]: cluster 2024-09-20T22:13:25.169193+0000 mgr.a (mgr.14150) 187 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:28 smithi179 bash[23186]: cluster 2024-09-20T22:13:27.169775+0000 mgr.a (mgr.14150) 188 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:28 smithi049 bash[23528]: cluster 2024-09-20T22:13:27.169775+0000 mgr.a (mgr.14150) 188 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:28 smithi044 bash[22676]: cluster 2024-09-20T22:13:27.169775+0000 mgr.a (mgr.14150) 188 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:30 smithi049 bash[23528]: cluster 2024-09-20T22:13:29.170279+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:30.827 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:30 smithi179 bash[23186]: cluster 2024-09-20T22:13:29.170279+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:30.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:30 smithi044 bash[22676]: cluster 2024-09-20T22:13:29.170279+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:32 smithi179 bash[23186]: cluster 2024-09-20T22:13:31.170787+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:32 smithi179 bash[23186]: audit 2024-09-20T22:13:31.810269+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:32 smithi179 bash[23186]: audit 2024-09-20T22:13:31.815377+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:32 smithi179 bash[23186]: cephadm 2024-09-20T22:13:31.816761+0000 mgr.a (mgr.14150) 191 : cephadm [INF] Detected new or changed devices on smithi179 2024-09-20T22:13:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:32 smithi179 bash[23186]: audit 2024-09-20T22:13:31.820729+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:32 smithi044 bash[22676]: cluster 2024-09-20T22:13:31.170787+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:32 smithi044 bash[22676]: audit 2024-09-20T22:13:31.810269+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:32 smithi044 bash[22676]: audit 2024-09-20T22:13:31.815377+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:32 smithi044 bash[22676]: cephadm 2024-09-20T22:13:31.816761+0000 mgr.a (mgr.14150) 191 : cephadm [INF] Detected new or changed devices on smithi179 2024-09-20T22:13:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:32 smithi044 bash[22676]: audit 2024-09-20T22:13:31.820729+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:32 smithi049 bash[23528]: cluster 2024-09-20T22:13:31.170787+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:32 smithi049 bash[23528]: audit 2024-09-20T22:13:31.810269+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:32 smithi049 bash[23528]: audit 2024-09-20T22:13:31.815377+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:32 smithi049 bash[23528]: cephadm 2024-09-20T22:13:31.816761+0000 mgr.a (mgr.14150) 191 : cephadm [INF] Detected new or changed devices on smithi179 2024-09-20T22:13:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:32 smithi049 bash[23528]: audit 2024-09-20T22:13:31.820729+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:34 smithi044 bash[22676]: cluster 2024-09-20T22:13:33.171279+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:34 smithi179 bash[23186]: cluster 2024-09-20T22:13:33.171279+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:34 smithi049 bash[23528]: cluster 2024-09-20T22:13:33.171279+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:35 smithi044 bash[22676]: audit 2024-09-20T22:13:35.341904+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T22:13:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:35 smithi044 bash[22676]: audit 2024-09-20T22:13:35.343883+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:35 smithi179 bash[23186]: audit 2024-09-20T22:13:35.341904+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T22:13:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:35 smithi179 bash[23186]: audit 2024-09-20T22:13:35.343883+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:36.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:35 smithi049 bash[23528]: audit 2024-09-20T22:13:35.341904+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T22:13:36.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:35 smithi049 bash[23528]: audit 2024-09-20T22:13:35.343883+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:37.119 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:36 smithi179 bash[23186]: cluster 2024-09-20T22:13:35.171794+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:37.119 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:36 smithi179 bash[23186]: cephadm 2024-09-20T22:13:35.345645+0000 mgr.a (mgr.14150) 194 : cephadm [INF] Deploying daemon osd.2 on smithi179 2024-09-20T22:13:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:36 smithi044 bash[22676]: cluster 2024-09-20T22:13:35.171794+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:36 smithi044 bash[22676]: cephadm 2024-09-20T22:13:35.345645+0000 mgr.a (mgr.14150) 194 : cephadm [INF] Deploying daemon osd.2 on smithi179 2024-09-20T22:13:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:36 smithi049 bash[23528]: cluster 2024-09-20T22:13:35.171794+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:36 smithi049 bash[23528]: cephadm 2024-09-20T22:13:35.345645+0000 mgr.a (mgr.14150) 194 : cephadm [INF] Deploying daemon osd.2 on smithi179 2024-09-20T22:13:38.969 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:38 smithi179 bash[23186]: cluster 2024-09-20T22:13:37.172284+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:38 smithi049 bash[23528]: cluster 2024-09-20T22:13:37.172284+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:38 smithi044 bash[22676]: cluster 2024-09-20T22:13:37.172284+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:39.580 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:39 smithi179 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:13:39.934 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:39 smithi179 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:13:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: cluster 2024-09-20T22:13:39.172777+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:39.869379+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:39.877176+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:39.877855+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:39.880052+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:39.885823+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:39.892265+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:40.794890+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:40.802888+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:40 smithi179 bash[23186]: audit 2024-09-20T22:13:40.812240+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.133 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: cluster 2024-09-20T22:13:39.172777+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:41.133 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:39.869379+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:41.133 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:39.877176+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:39.877855+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:41.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:39.880052+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:41.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:39.885823+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:39.892265+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:40.794890+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:40.802888+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:40 smithi049 bash[23528]: audit 2024-09-20T22:13:40.812240+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: cluster 2024-09-20T22:13:39.172777+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:39.869379+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:39.877176+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:39.877855+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:39.880052+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:39.885823+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:39.892265+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:40.794890+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:40.802888+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:40 smithi044 bash[22676]: audit 2024-09-20T22:13:40.812240+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:42 smithi179 bash[23186]: cluster 2024-09-20T22:13:41.173294+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:42 smithi044 bash[22676]: cluster 2024-09-20T22:13:41.173294+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:42 smithi049 bash[23528]: cluster 2024-09-20T22:13:41.173294+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:44 smithi044 bash[22676]: cluster 2024-09-20T22:13:43.173822+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:44 smithi044 bash[22676]: audit 2024-09-20T22:13:43.737408+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:44 smithi044 bash[22676]: audit 2024-09-20T22:13:43.745614+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:44 smithi044 bash[22676]: audit 2024-09-20T22:13:43.755414+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:44 smithi179 bash[23186]: cluster 2024-09-20T22:13:43.173822+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:44 smithi179 bash[23186]: audit 2024-09-20T22:13:43.737408+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:44 smithi179 bash[23186]: audit 2024-09-20T22:13:43.745614+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:44 smithi179 bash[23186]: audit 2024-09-20T22:13:43.755414+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:44 smithi049 bash[23528]: cluster 2024-09-20T22:13:43.173822+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:44 smithi049 bash[23528]: audit 2024-09-20T22:13:43.737408+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:44 smithi049 bash[23528]: audit 2024-09-20T22:13:43.745614+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:44 smithi049 bash[23528]: audit 2024-09-20T22:13:43.755414+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:46 smithi179 bash[23186]: cluster 2024-09-20T22:13:45.174332+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:47.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:46 smithi049 bash[23528]: cluster 2024-09-20T22:13:45.174332+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:46 smithi044 bash[22676]: cluster 2024-09-20T22:13:45.174332+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:48 smithi179 bash[23186]: cluster 2024-09-20T22:13:47.174813+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:49.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:48 smithi049 bash[23528]: cluster 2024-09-20T22:13:47.174813+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:48 smithi044 bash[22676]: cluster 2024-09-20T22:13:47.174813+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:49 smithi179 bash[23186]: audit 2024-09-20T22:13:49.349796+0000 mon.a (mon.0) 571 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T22:13:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:49 smithi179 bash[23186]: audit 2024-09-20T22:13:49.350310+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T22:13:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:49 smithi049 bash[23528]: audit 2024-09-20T22:13:49.349796+0000 mon.a (mon.0) 571 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T22:13:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:49 smithi049 bash[23528]: audit 2024-09-20T22:13:49.350310+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T22:13:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:49 smithi044 bash[22676]: audit 2024-09-20T22:13:49.349796+0000 mon.a (mon.0) 571 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T22:13:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:49 smithi044 bash[22676]: audit 2024-09-20T22:13:49.350310+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T22:13:50.692 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 2 on host 'smithi179' 2024-09-20T22:13:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: cluster 2024-09-20T22:13:49.175267+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:49.752879+0000 mon.a (mon.0) 572 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T22:13:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:49.756977+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-20T22:13:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: cluster 2024-09-20T22:13:49.757389+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:49.757793+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:49.758490+0000 mon.a (mon.0) 575 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.676268+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.684243+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.685083+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.691793+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.697606+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.701671+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.703621+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:50 smithi179 bash[23186]: audit 2024-09-20T22:13:50.713307+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: cluster 2024-09-20T22:13:49.175267+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:49.752879+0000 mon.a (mon.0) 572 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T22:13:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:49.756977+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-20T22:13:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: cluster 2024-09-20T22:13:49.757389+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-20T22:13:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:49.757793+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:49.758490+0000 mon.a (mon.0) 575 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.676268+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.684243+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.685083+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.691793+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.697606+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.701671+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.703621+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:50 smithi049 bash[23528]: audit 2024-09-20T22:13:50.713307+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: cluster 2024-09-20T22:13:49.175267+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:49.752879+0000 mon.a (mon.0) 572 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:49.756977+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: cluster 2024-09-20T22:13:49.757389+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:49.757793+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:49.758490+0000 mon.a (mon.0) 575 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.676268+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.684243+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.685083+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:13:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.691793+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.697606+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.701671+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.703621+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:50 smithi044 bash[22676]: audit 2024-09-20T22:13:50.713307+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:51.720 DEBUG:teuthology.orchestra.run.smithi179:osd.2> sudo journalctl -f -n 0 -u ceph-68d7421e-779c-11ef-baf5-efdc52797490@osd.2.service 2024-09-20T22:13:51.723 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2024-09-20T22:13:51.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T22:13:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:51 smithi044 bash[22676]: cephadm 2024-09-20T22:13:50.687606+0000 mgr.a (mgr.14150) 202 : cephadm [INF] Adjusting osd_memory_target on smithi179 to 20337M 2024-09-20T22:13:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:51 smithi044 bash[22676]: audit 2024-09-20T22:13:50.755261+0000 mon.a (mon.0) 584 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-20T22:13:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:51 smithi044 bash[22676]: cluster 2024-09-20T22:13:50.760384+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-20T22:13:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:51 smithi044 bash[22676]: audit 2024-09-20T22:13:50.761183+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:51 smithi044 bash[22676]: audit 2024-09-20T22:13:50.769738+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:51 smithi179 bash[23186]: cephadm 2024-09-20T22:13:50.687606+0000 mgr.a (mgr.14150) 202 : cephadm [INF] Adjusting osd_memory_target on smithi179 to 20337M 2024-09-20T22:13:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:51 smithi179 bash[23186]: audit 2024-09-20T22:13:50.755261+0000 mon.a (mon.0) 584 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-20T22:13:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:51 smithi179 bash[23186]: cluster 2024-09-20T22:13:50.760384+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-20T22:13:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:51 smithi179 bash[23186]: audit 2024-09-20T22:13:50.761183+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:51 smithi179 bash[23186]: audit 2024-09-20T22:13:50.769738+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:52.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:51 smithi049 bash[23528]: cephadm 2024-09-20T22:13:50.687606+0000 mgr.a (mgr.14150) 202 : cephadm [INF] Adjusting osd_memory_target on smithi179 to 20337M 2024-09-20T22:13:52.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:51 smithi049 bash[23528]: audit 2024-09-20T22:13:50.755261+0000 mon.a (mon.0) 584 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-20T22:13:52.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:51 smithi049 bash[23528]: cluster 2024-09-20T22:13:50.760384+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-20T22:13:52.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:51 smithi049 bash[23528]: audit 2024-09-20T22:13:50.761183+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:52.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:51 smithi049 bash[23528]: audit 2024-09-20T22:13:50.769738+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:52.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: cluster 2024-09-20T22:13:50.367343+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:13:52.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: cluster 2024-09-20T22:13:50.367436+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:13:52.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: cluster 2024-09-20T22:13:51.175731+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:52.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:51.763531+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:52.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: cluster 2024-09-20T22:13:51.770501+0000 mon.a (mon.0) 589 : cluster [INF] osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687] boot 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: cluster 2024-09-20T22:13:51.770614+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:51.771340+0000 mon.a (mon.0) 591 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:52.029902+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:52.036696+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:52.039278+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:52.045126+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:52.045973+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:52.048341+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:52.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:52 smithi044 bash[22676]: audit 2024-09-20T22:13:52.058069+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: cluster 2024-09-20T22:13:50.367343+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:13:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: cluster 2024-09-20T22:13:50.367436+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:13:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: cluster 2024-09-20T22:13:51.175731+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:51.763531+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: cluster 2024-09-20T22:13:51.770501+0000 mon.a (mon.0) 589 : cluster [INF] osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687] boot 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: cluster 2024-09-20T22:13:51.770614+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:51.771340+0000 mon.a (mon.0) 591 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:52.029902+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:52.036696+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:52.039278+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:52.045126+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:52.045973+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:52.048341+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:52 smithi049 bash[23528]: audit 2024-09-20T22:13:52.058069+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: cluster 2024-09-20T22:13:50.367343+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: cluster 2024-09-20T22:13:50.367436+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: cluster 2024-09-20T22:13:51.175731+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:51.763531+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: cluster 2024-09-20T22:13:51.770501+0000 mon.a (mon.0) 589 : cluster [INF] osd.2 [v2:172.21.15.179:6800/548390687,v1:172.21.15.179:6801/548390687] boot 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: cluster 2024-09-20T22:13:51.770614+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:51.771340+0000 mon.a (mon.0) 591 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:52.029902+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:52.036696+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:52.039278+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:52.045126+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:52.045973+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:52.048341+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:13:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:52 smithi179 bash[23186]: audit 2024-09-20T22:13:52.058069+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:54 smithi044 bash[22676]: cluster 2024-09-20T22:13:53.062371+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-20T22:13:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:54 smithi044 bash[22676]: audit 2024-09-20T22:13:53.301648+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-20T22:13:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:54 smithi179 bash[23186]: cluster 2024-09-20T22:13:53.062371+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-20T22:13:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:54 smithi179 bash[23186]: audit 2024-09-20T22:13:53.301648+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-20T22:13:54.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:54 smithi049 bash[23528]: cluster 2024-09-20T22:13:53.062371+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-20T22:13:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:54 smithi049 bash[23528]: audit 2024-09-20T22:13:53.301648+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-20T22:13:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:55 smithi044 bash[22676]: cluster 2024-09-20T22:13:53.176202+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v145: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:55 smithi044 bash[22676]: audit 2024-09-20T22:13:54.066693+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-20T22:13:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:55 smithi044 bash[22676]: cluster 2024-09-20T22:13:54.073063+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-20T22:13:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:55 smithi044 bash[22676]: audit 2024-09-20T22:13:54.074603+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T22:13:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:55 smithi179 bash[23186]: cluster 2024-09-20T22:13:53.176202+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v145: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:55 smithi179 bash[23186]: audit 2024-09-20T22:13:54.066693+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-20T22:13:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:55 smithi179 bash[23186]: cluster 2024-09-20T22:13:54.073063+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-20T22:13:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:55 smithi179 bash[23186]: audit 2024-09-20T22:13:54.074603+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T22:13:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:55 smithi049 bash[23528]: cluster 2024-09-20T22:13:53.176202+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v145: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:55 smithi049 bash[23528]: audit 2024-09-20T22:13:54.066693+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-20T22:13:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:55 smithi049 bash[23528]: cluster 2024-09-20T22:13:54.073063+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-20T22:13:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:55 smithi049 bash[23528]: audit 2024-09-20T22:13:54.074603+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T22:13:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:56 smithi044 bash[22676]: audit 2024-09-20T22:13:55.069234+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T22:13:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:56 smithi044 bash[22676]: cluster 2024-09-20T22:13:55.075255+0000 mon.a (mon.0) 605 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-20T22:13:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:56 smithi044 bash[22676]: cluster 2024-09-20T22:13:56.075929+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-20T22:13:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:56 smithi179 bash[23186]: audit 2024-09-20T22:13:55.069234+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T22:13:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:56 smithi179 bash[23186]: cluster 2024-09-20T22:13:55.075255+0000 mon.a (mon.0) 605 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-20T22:13:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:56 smithi179 bash[23186]: cluster 2024-09-20T22:13:56.075929+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-20T22:13:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:56 smithi049 bash[23528]: audit 2024-09-20T22:13:55.069234+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T22:13:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:56 smithi049 bash[23528]: cluster 2024-09-20T22:13:55.075255+0000 mon.a (mon.0) 605 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-20T22:13:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:56 smithi049 bash[23528]: cluster 2024-09-20T22:13:56.075929+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-20T22:13:56.992 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:13:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:57 smithi044 bash[22676]: cluster 2024-09-20T22:13:55.176689+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v148: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:57 smithi044 bash[22676]: cluster 2024-09-20T22:13:56.099274+0000 mon.a (mon.0) 607 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-20T22:13:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:57 smithi044 bash[22676]: audit 2024-09-20T22:13:56.248680+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:57 smithi179 bash[23186]: cluster 2024-09-20T22:13:55.176689+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v148: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:57 smithi179 bash[23186]: cluster 2024-09-20T22:13:56.099274+0000 mon.a (mon.0) 607 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-20T22:13:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:57 smithi179 bash[23186]: audit 2024-09-20T22:13:56.248680+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:57 smithi049 bash[23528]: cluster 2024-09-20T22:13:55.176689+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v148: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:57 smithi049 bash[23528]: cluster 2024-09-20T22:13:56.099274+0000 mon.a (mon.0) 607 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-20T22:13:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:57 smithi049 bash[23528]: audit 2024-09-20T22:13:56.248680+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:59.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:13:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:59 smithi049 bash[23528]: cluster 2024-09-20T22:13:57.177218+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:59 smithi049 bash[23528]: audit 2024-09-20T22:13:57.227796+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:59 smithi049 bash[23528]: audit 2024-09-20T22:13:58.172762+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:13:59 smithi049 bash[23528]: audit 2024-09-20T22:13:58.175510+0000 mon.a (mon.0) 611 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:13:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:59 smithi044 bash[22676]: cluster 2024-09-20T22:13:57.177218+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:59 smithi044 bash[22676]: audit 2024-09-20T22:13:57.227796+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:59 smithi044 bash[22676]: audit 2024-09-20T22:13:58.172762+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:13:59 smithi044 bash[22676]: audit 2024-09-20T22:13:58.175510+0000 mon.a (mon.0) 611 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:13:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:59 smithi179 bash[23186]: cluster 2024-09-20T22:13:57.177218+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:13:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:59 smithi179 bash[23186]: audit 2024-09-20T22:13:57.227796+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:59 smithi179 bash[23186]: audit 2024-09-20T22:13:58.172762+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:13:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:13:59 smithi179 bash[23186]: audit 2024-09-20T22:13:58.175510+0000 mon.a (mon.0) 611 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:13:59.724 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":22,"num_osds":3,"num_up_osds":3,"osd_up_since":1726870431,"num_in_osds":3,"osd_in_since":1726870401,"num_remapped_pgs":0} 2024-09-20T22:13:59.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T22:14:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.109084+0000 mon.a (mon.0) 612 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.110955+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.115336+0000 mon.a (mon.0) 614 : audit [DBG] from='client.? 172.21.15.44:0/3759900239' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T22:14:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.115549+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.115690+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.120700+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:14:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.121736+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.122001+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.122204+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:13:59.122355+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: cluster 2024-09-20T22:13:59.177632+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.023084+0000 mon.c (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.030271+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.030945+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.031552+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.031911+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.035497+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.039928+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:14:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:00 smithi044 bash[22676]: audit 2024-09-20T22:14:00.041816+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:14:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.109084+0000 mon.a (mon.0) 612 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.110955+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.115336+0000 mon.a (mon.0) 614 : audit [DBG] from='client.? 172.21.15.44:0/3759900239' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.115549+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.115690+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.120700+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.121736+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.122001+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.122204+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:13:59.122355+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: cluster 2024-09-20T22:13:59.177632+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.023084+0000 mon.c (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.030271+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.030945+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.031552+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.031911+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.035497+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:14:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.039928+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:14:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:00 smithi179 bash[23186]: audit 2024-09-20T22:14:00.041816+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:14:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.109084+0000 mon.a (mon.0) 612 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.110955+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.115336+0000 mon.a (mon.0) 614 : audit [DBG] from='client.? 172.21.15.44:0/3759900239' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T22:14:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.115549+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.115690+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.120700+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:14:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.121736+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.122001+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.122204+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:13:59.122355+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: cluster 2024-09-20T22:13:59.177632+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.023084+0000 mon.c (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.030271+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.030945+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.031552+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.031911+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.035497+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.039928+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:14:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:00 smithi049 bash[23528]: audit 2024-09-20T22:14:00.041816+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:14:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:01 smithi044 bash[22676]: audit 2024-09-20T22:14:00.028217+0000 mon.b (mon.2) 10 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:14:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:01 smithi044 bash[22676]: audit 2024-09-20T22:14:00.938666+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:01 smithi044 bash[22676]: audit 2024-09-20T22:14:00.945943+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:01 smithi044 bash[22676]: audit 2024-09-20T22:14:00.953742+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:01 smithi044 bash[22676]: audit 2024-09-20T22:14:00.997055+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:01 smithi044 bash[22676]: audit 2024-09-20T22:14:01.001934+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:01 smithi044 bash[22676]: audit 2024-09-20T22:14:01.007166+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:01 smithi179 bash[23186]: audit 2024-09-20T22:14:00.028217+0000 mon.b (mon.2) 10 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:14:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:01 smithi179 bash[23186]: audit 2024-09-20T22:14:00.938666+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:01 smithi179 bash[23186]: audit 2024-09-20T22:14:00.945943+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:01 smithi179 bash[23186]: audit 2024-09-20T22:14:00.953742+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:01 smithi179 bash[23186]: audit 2024-09-20T22:14:00.997055+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:01 smithi179 bash[23186]: audit 2024-09-20T22:14:01.001934+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:01 smithi179 bash[23186]: audit 2024-09-20T22:14:01.007166+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:01 smithi049 bash[23528]: audit 2024-09-20T22:14:00.028217+0000 mon.b (mon.2) 10 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T22:14:02.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:01 smithi049 bash[23528]: audit 2024-09-20T22:14:00.938666+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T22:14:02.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:01 smithi049 bash[23528]: audit 2024-09-20T22:14:00.945943+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:01 smithi049 bash[23528]: audit 2024-09-20T22:14:00.953742+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:01 smithi049 bash[23528]: audit 2024-09-20T22:14:00.997055+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:01 smithi049 bash[23528]: audit 2024-09-20T22:14:01.001934+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:02.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:01 smithi049 bash[23528]: audit 2024-09-20T22:14:01.007166+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:03 smithi049 bash[23528]: cluster 2024-09-20T22:14:01.178204+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:03 smithi044 bash[22676]: cluster 2024-09-20T22:14:01.178204+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:03 smithi179 bash[23186]: cluster 2024-09-20T22:14:01.178204+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:04.470 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:04 smithi044 bash[22676]: cluster 2024-09-20T22:14:03.178841+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-20T22:14:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:04 smithi044 bash[22676]: audit 2024-09-20T22:14:03.964312+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:04 smithi044 bash[22676]: audit 2024-09-20T22:14:03.971869+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:04 smithi044 bash[22676]: audit 2024-09-20T22:14:03.981179+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:04 smithi179 bash[23186]: cluster 2024-09-20T22:14:03.178841+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-20T22:14:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:04 smithi179 bash[23186]: audit 2024-09-20T22:14:03.964312+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:04 smithi179 bash[23186]: audit 2024-09-20T22:14:03.971869+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:04 smithi179 bash[23186]: audit 2024-09-20T22:14:03.981179+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:04 smithi049 bash[23528]: cluster 2024-09-20T22:14:03.178841+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-20T22:14:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:04 smithi049 bash[23528]: audit 2024-09-20T22:14:03.964312+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:04 smithi049 bash[23528]: audit 2024-09-20T22:14:03.971869+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:04 smithi049 bash[23528]: audit 2024-09-20T22:14:03.981179+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:05.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:14:05.846 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":22,"fsid":"68d7421e-779c-11ef-baf5-efdc52797490","created":"2024-09-20T22:08:22.262592+0000","modified":"2024-09-20T22:13:56.068983+0000","last_up_change":"2024-09-20T22:13:51.762325+0000","last_in_change":"2024-09-20T22:13:21.636163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T22:13:53.750019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c085c15d-7b80-41dc-9070-0b563482e65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6803","nonce":2371582976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6805","nonce":2371582976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6809","nonce":2371582976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6807","nonce":2371582976}]},"public_addr":"172.21.15.44:6803/2371582976","cluster_addr":"172.21.15.44:6805/2371582976","heartbeat_back_addr":"172.21.15.44:6809/2371582976","heartbeat_front_addr":"172.21.15.44:6807/2371582976","state":["exists","up"]},{"osd":1,"uuid":"9070c041-a3b4-4ba7-b744-9f03bbf3e0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6801","nonce":2754466085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6803","nonce":2754466085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6807","nonce":2754466085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6805","nonce":2754466085}]},"public_addr":"172.21.15.49:6801/2754466085","cluster_addr":"172.21.15.49:6803/2754466085","heartbeat_back_addr":"172.21.15.49:6807/2754466085","heartbeat_front_addr":"172.21.15.49:6805/2754466085","state":["exists","up"]},{"osd":2,"uuid":"75f0f7be-d47d-4744-9735-e14503d6bb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6801","nonce":548390687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6803","nonce":548390687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6807","nonce":548390687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6805","nonce":548390687}]},"public_addr":"172.21.15.179:6801/548390687","cluster_addr":"172.21.15.179:6803/548390687","heartbeat_back_addr":"172.21.15.179:6807/548390687","heartbeat_front_addr":"172.21.15.179:6805/548390687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:12:03.293159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:12:58.757735+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:13:50.367439+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6801/1850824930":"2024-09-21T22:09:21.107778+0000","172.21.15.44:6800/1850824930":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/2124431582":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/1869800843":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/3048476988":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/3732305067":"2024-09-21T22:08:49.179042+0000","172.21.15.44:0/4169664150":"2024-09-21T22:08:49.179042+0000","172.21.15.44:6800/1338427463":"2024-09-21T22:08:49.179042+0000","172.21.15.44:6801/1338427463":"2024-09-21T22:08:49.179042+0000","172.21.15.44:0/1696614170":"2024-09-21T22:08:49.179042+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T22:14:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:05 smithi044 bash[22676]: audit 2024-09-20T22:14:05.846549+0000 mon.a (mon.0) 636 : audit [DBG] from='client.? 172.21.15.44:0/2301470937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:05 smithi179 bash[23186]: audit 2024-09-20T22:14:05.846549+0000 mon.a (mon.0) 636 : audit [DBG] from='client.? 172.21.15.44:0/2301470937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:05 smithi049 bash[23528]: audit 2024-09-20T22:14:05.846549+0000 mon.a (mon.0) 636 : audit [DBG] from='client.? 172.21.15.44:0/2301470937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:06.433 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T22:13:53.750019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-20T22:14:06.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-20T22:14:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:06 smithi044 bash[22676]: cluster 2024-09-20T22:14:05.179382+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-20T22:14:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:06 smithi179 bash[23186]: cluster 2024-09-20T22:14:05.179382+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-20T22:14:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:06 smithi049 bash[23528]: cluster 2024-09-20T22:14:05.179382+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-20T22:14:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:08 smithi044 bash[22676]: cluster 2024-09-20T22:14:07.179958+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-20T22:14:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:08 smithi179 bash[23186]: cluster 2024-09-20T22:14:07.179958+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-20T22:14:09.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:08 smithi049 bash[23528]: cluster 2024-09-20T22:14:07.179958+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-20T22:14:11.172 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:10 smithi044 bash[22676]: cluster 2024-09-20T22:14:09.180369+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:11.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:10 smithi179 bash[23186]: cluster 2024-09-20T22:14:09.180369+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:10 smithi049 bash[23528]: cluster 2024-09-20T22:14:09.180369+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:12.524 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-20T22:14:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:12 smithi044 bash[22676]: cluster 2024-09-20T22:14:11.180799+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:12 smithi044 bash[22676]: audit 2024-09-20T22:14:12.525413+0000 mon.a (mon.0) 637 : audit [DBG] from='client.? 172.21.15.44:0/1599367477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T22:14:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:12 smithi179 bash[23186]: cluster 2024-09-20T22:14:11.180799+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:12 smithi179 bash[23186]: audit 2024-09-20T22:14:12.525413+0000 mon.a (mon.0) 637 : audit [DBG] from='client.? 172.21.15.44:0/1599367477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T22:14:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:12 smithi049 bash[23528]: cluster 2024-09-20T22:14:11.180799+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:12 smithi049 bash[23528]: audit 2024-09-20T22:14:12.525413+0000 mon.a (mon.0) 637 : audit [DBG] from='client.? 172.21.15.44:0/1599367477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T22:14:13.676 INFO:tasks.cephadm:Setting up client nodes... 2024-09-20T22:14:13.676 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-20T22:14:13.676 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-20T22:14:13.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-20T22:14:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:14 smithi044 bash[22676]: cluster 2024-09-20T22:14:13.181366+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:15.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:14 smithi179 bash[23186]: cluster 2024-09-20T22:14:13.181366+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:15.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:14 smithi049 bash[23528]: cluster 2024-09-20T22:14:13.181366+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-20T22:14:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:16 smithi179 bash[23186]: cluster 2024-09-20T22:14:15.181918+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:17.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:16 smithi049 bash[23528]: cluster 2024-09-20T22:14:15.181918+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:16 smithi044 bash[22676]: cluster 2024-09-20T22:14:15.181918+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:19.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:19 smithi049 bash[23528]: cluster 2024-09-20T22:14:17.182595+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:19.381 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:19 smithi049 bash[23528]: audit 2024-09-20T22:14:18.074616+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.381 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:19 smithi049 bash[23528]: audit 2024-09-20T22:14:18.082311+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.381 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:19 smithi049 bash[23528]: audit 2024-09-20T22:14:18.091444+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.431 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:19 smithi044 bash[22676]: cluster 2024-09-20T22:14:17.182595+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:19 smithi044 bash[22676]: audit 2024-09-20T22:14:18.074616+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:19 smithi044 bash[22676]: audit 2024-09-20T22:14:18.082311+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:19 smithi044 bash[22676]: audit 2024-09-20T22:14:18.091444+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:19 smithi179 bash[23186]: cluster 2024-09-20T22:14:17.182595+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:19 smithi179 bash[23186]: audit 2024-09-20T22:14:18.074616+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:19 smithi179 bash[23186]: audit 2024-09-20T22:14:18.082311+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:19 smithi179 bash[23186]: audit 2024-09-20T22:14:18.091444+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:20.746 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:14:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:21 smithi049 bash[23528]: cluster 2024-09-20T22:14:19.183170+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:21 smithi049 bash[23528]: audit 2024-09-20T22:14:20.737500+0000 mon.a (mon.0) 641 : audit [DBG] from='client.? 172.21.15.44:0/1880937386' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T22:14:21.311 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1455650908},{"type":"v1","addr":"172.21.15.44:6801","nonce":1455650908}]},"active_addr":"172.21.15.44:6801/1455650908","active_change":"2024-09-20T22:09:21.108109+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24110,"name":"b","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.44:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2759255762}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3714898108}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":1578517537}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2293991173}]}]} 2024-09-20T22:14:21.314 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-20T22:14:21.314 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-20T22:14:21.315 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T22:14:21.338 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:21 smithi044 bash[22676]: cluster 2024-09-20T22:14:19.183170+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:21.338 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:21 smithi044 bash[22676]: audit 2024-09-20T22:14:20.737500+0000 mon.a (mon.0) 641 : audit [DBG] from='client.? 172.21.15.44:0/1880937386' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T22:14:21.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:21 smithi179 bash[23186]: cluster 2024-09-20T22:14:19.183170+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:21 smithi179 bash[23186]: audit 2024-09-20T22:14:20.737500+0000 mon.a (mon.0) 641 : audit [DBG] from='client.? 172.21.15.44:0/1880937386' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T22:14:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:22 smithi044 bash[22676]: cluster 2024-09-20T22:14:21.183633+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:22 smithi044 bash[22676]: audit 2024-09-20T22:14:21.209784+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:22 smithi044 bash[22676]: audit 2024-09-20T22:14:21.219028+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:22 smithi044 bash[22676]: audit 2024-09-20T22:14:21.228642+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:22 smithi179 bash[23186]: cluster 2024-09-20T22:14:21.183633+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:22 smithi179 bash[23186]: audit 2024-09-20T22:14:21.209784+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:22 smithi179 bash[23186]: audit 2024-09-20T22:14:21.219028+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:22 smithi179 bash[23186]: audit 2024-09-20T22:14:21.228642+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:22 smithi049 bash[23528]: cluster 2024-09-20T22:14:21.183633+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:22 smithi049 bash[23528]: audit 2024-09-20T22:14:21.209784+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:22 smithi049 bash[23528]: audit 2024-09-20T22:14:21.219028+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:22 smithi049 bash[23528]: audit 2024-09-20T22:14:21.228642+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:24 smithi044 bash[22676]: cluster 2024-09-20T22:14:23.184183+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:24 smithi044 bash[22676]: audit 2024-09-20T22:14:24.194759+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:24 smithi044 bash[22676]: audit 2024-09-20T22:14:24.203180+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:24.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:24 smithi179 bash[23186]: cluster 2024-09-20T22:14:23.184183+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:24 smithi179 bash[23186]: audit 2024-09-20T22:14:24.194759+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:24 smithi179 bash[23186]: audit 2024-09-20T22:14:24.203180+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:24.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:24 smithi049 bash[23528]: cluster 2024-09-20T22:14:23.184183+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:24.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:24 smithi049 bash[23528]: audit 2024-09-20T22:14:24.194759+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:24.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:24 smithi049 bash[23528]: audit 2024-09-20T22:14:24.203180+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:25 smithi044 bash[22676]: audit 2024-09-20T22:14:24.212857+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:25.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:25 smithi179 bash[23186]: audit 2024-09-20T22:14:24.212857+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:25.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:25 smithi049 bash[23528]: audit 2024-09-20T22:14:24.212857+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:26.061 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:26 smithi044 bash[22676]: cluster 2024-09-20T22:14:25.184707+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:26.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:26 smithi179 bash[23186]: cluster 2024-09-20T22:14:25.184707+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:26 smithi049 bash[23528]: cluster 2024-09-20T22:14:25.184707+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:27.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:14:27.413 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":22,"fsid":"68d7421e-779c-11ef-baf5-efdc52797490","created":"2024-09-20T22:08:22.262592+0000","modified":"2024-09-20T22:13:56.068983+0000","last_up_change":"2024-09-20T22:13:51.762325+0000","last_in_change":"2024-09-20T22:13:21.636163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T22:13:53.750019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c085c15d-7b80-41dc-9070-0b563482e65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6803","nonce":2371582976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6805","nonce":2371582976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6809","nonce":2371582976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6807","nonce":2371582976}]},"public_addr":"172.21.15.44:6803/2371582976","cluster_addr":"172.21.15.44:6805/2371582976","heartbeat_back_addr":"172.21.15.44:6809/2371582976","heartbeat_front_addr":"172.21.15.44:6807/2371582976","state":["exists","up"]},{"osd":1,"uuid":"9070c041-a3b4-4ba7-b744-9f03bbf3e0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6801","nonce":2754466085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6803","nonce":2754466085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6807","nonce":2754466085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6805","nonce":2754466085}]},"public_addr":"172.21.15.49:6801/2754466085","cluster_addr":"172.21.15.49:6803/2754466085","heartbeat_back_addr":"172.21.15.49:6807/2754466085","heartbeat_front_addr":"172.21.15.49:6805/2754466085","state":["exists","up"]},{"osd":2,"uuid":"75f0f7be-d47d-4744-9735-e14503d6bb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6801","nonce":548390687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6803","nonce":548390687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6807","nonce":548390687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6805","nonce":548390687}]},"public_addr":"172.21.15.179:6801/548390687","cluster_addr":"172.21.15.179:6803/548390687","heartbeat_back_addr":"172.21.15.179:6807/548390687","heartbeat_front_addr":"172.21.15.179:6805/548390687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:12:03.293159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:12:58.757735+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:13:50.367439+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6801/1850824930":"2024-09-21T22:09:21.107778+0000","172.21.15.44:6800/1850824930":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/2124431582":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/1869800843":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/3048476988":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/3732305067":"2024-09-21T22:08:49.179042+0000","172.21.15.44:0/4169664150":"2024-09-21T22:08:49.179042+0000","172.21.15.44:6800/1338427463":"2024-09-21T22:08:49.179042+0000","172.21.15.44:6801/1338427463":"2024-09-21T22:08:49.179042+0000","172.21.15.44:0/1696614170":"2024-09-21T22:08:49.179042+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T22:14:28.012 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-20T22:14:28.012 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T22:14:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:28 smithi044 bash[22676]: cluster 2024-09-20T22:14:27.185157+0000 mgr.a (mgr.14150) 221 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:28 smithi044 bash[22676]: audit 2024-09-20T22:14:27.413580+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.44:0/725894561' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:28.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:28 smithi179 bash[23186]: cluster 2024-09-20T22:14:27.185157+0000 mgr.a (mgr.14150) 221 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:28.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:28 smithi179 bash[23186]: audit 2024-09-20T22:14:27.413580+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.44:0/725894561' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:28.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:28 smithi049 bash[23528]: cluster 2024-09-20T22:14:27.185157+0000 mgr.a (mgr.14150) 221 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:28.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:28 smithi049 bash[23528]: audit 2024-09-20T22:14:27.413580+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.44:0/725894561' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:30 smithi044 bash[22676]: cluster 2024-09-20T22:14:29.185667+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:30.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:30 smithi179 bash[23186]: cluster 2024-09-20T22:14:29.185667+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:30.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:30 smithi049 bash[23528]: cluster 2024-09-20T22:14:29.185667+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:32.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:32 smithi179 bash[23186]: cluster 2024-09-20T22:14:31.186316+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:32.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:32 smithi049 bash[23528]: cluster 2024-09-20T22:14:31.186316+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:32 smithi044 bash[22676]: cluster 2024-09-20T22:14:31.186316+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:32.798 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:34.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:14:34.147 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":22,"fsid":"68d7421e-779c-11ef-baf5-efdc52797490","created":"2024-09-20T22:08:22.262592+0000","modified":"2024-09-20T22:13:56.068983+0000","last_up_change":"2024-09-20T22:13:51.762325+0000","last_in_change":"2024-09-20T22:13:21.636163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T22:13:53.750019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c085c15d-7b80-41dc-9070-0b563482e65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6803","nonce":2371582976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6805","nonce":2371582976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6809","nonce":2371582976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2371582976},{"type":"v1","addr":"172.21.15.44:6807","nonce":2371582976}]},"public_addr":"172.21.15.44:6803/2371582976","cluster_addr":"172.21.15.44:6805/2371582976","heartbeat_back_addr":"172.21.15.44:6809/2371582976","heartbeat_front_addr":"172.21.15.44:6807/2371582976","state":["exists","up"]},{"osd":1,"uuid":"9070c041-a3b4-4ba7-b744-9f03bbf3e0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6801","nonce":2754466085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6803","nonce":2754466085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6807","nonce":2754466085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2754466085},{"type":"v1","addr":"172.21.15.49:6805","nonce":2754466085}]},"public_addr":"172.21.15.49:6801/2754466085","cluster_addr":"172.21.15.49:6803/2754466085","heartbeat_back_addr":"172.21.15.49:6807/2754466085","heartbeat_front_addr":"172.21.15.49:6805/2754466085","state":["exists","up"]},{"osd":2,"uuid":"75f0f7be-d47d-4744-9735-e14503d6bb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6801","nonce":548390687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6803","nonce":548390687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6807","nonce":548390687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":548390687},{"type":"v1","addr":"172.21.15.179:6805","nonce":548390687}]},"public_addr":"172.21.15.179:6801/548390687","cluster_addr":"172.21.15.179:6803/548390687","heartbeat_back_addr":"172.21.15.179:6807/548390687","heartbeat_front_addr":"172.21.15.179:6805/548390687","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:12:03.293159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:12:58.757735+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T22:13:50.367439+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6801/1850824930":"2024-09-21T22:09:21.107778+0000","172.21.15.44:6800/1850824930":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/2124431582":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/1869800843":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/3048476988":"2024-09-21T22:09:21.107778+0000","172.21.15.44:0/3732305067":"2024-09-21T22:08:49.179042+0000","172.21.15.44:0/4169664150":"2024-09-21T22:08:49.179042+0000","172.21.15.44:6800/1338427463":"2024-09-21T22:08:49.179042+0000","172.21.15.44:6801/1338427463":"2024-09-21T22:08:49.179042+0000","172.21.15.44:0/1696614170":"2024-09-21T22:08:49.179042+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T22:14:34.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:34 smithi044 bash[22676]: cluster 2024-09-20T22:14:33.186910+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:34.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:34 smithi044 bash[22676]: audit 2024-09-20T22:14:34.146799+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.44:0/3931062553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:34.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:34 smithi179 bash[23186]: cluster 2024-09-20T22:14:33.186910+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:34.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:34 smithi179 bash[23186]: audit 2024-09-20T22:14:34.146799+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.44:0/3931062553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:34.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:34 smithi049 bash[23528]: cluster 2024-09-20T22:14:33.186910+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:34.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:34 smithi049 bash[23528]: audit 2024-09-20T22:14:34.146799+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.44:0/3931062553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T22:14:34.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-20T22:14:34.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-20T22:14:34.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-20T22:14:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:36 smithi179 bash[23186]: cluster 2024-09-20T22:14:35.187231+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:36.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:36 smithi049 bash[23528]: cluster 2024-09-20T22:14:35.187231+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:36.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:36 smithi044 bash[22676]: cluster 2024-09-20T22:14:35.187231+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:38.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:38 smithi179 bash[23186]: cluster 2024-09-20T22:14:37.187632+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:38.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:38 smithi049 bash[23528]: cluster 2024-09-20T22:14:37.187632+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:38 smithi044 bash[22676]: cluster 2024-09-20T22:14:37.187632+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:39 smithi049 bash[23528]: audit 2024-09-20T22:14:38.297659+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:39 smithi049 bash[23528]: audit 2024-09-20T22:14:38.306961+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:39 smithi049 bash[23528]: audit 2024-09-20T22:14:38.317612+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:39 smithi044 bash[22676]: audit 2024-09-20T22:14:38.297659+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:39 smithi044 bash[22676]: audit 2024-09-20T22:14:38.306961+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:39 smithi044 bash[22676]: audit 2024-09-20T22:14:38.317612+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:39 smithi179 bash[23186]: audit 2024-09-20T22:14:38.297659+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:39 smithi179 bash[23186]: audit 2024-09-20T22:14:38.306961+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:39 smithi179 bash[23186]: audit 2024-09-20T22:14:38.317612+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:40.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:40 smithi049 bash[23528]: cluster 2024-09-20T22:14:39.188239+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:40 smithi044 bash[22676]: cluster 2024-09-20T22:14:39.188239+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:40.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:40 smithi179 bash[23186]: cluster 2024-09-20T22:14:39.188239+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:42.732 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:42 smithi049 bash[23528]: cluster 2024-09-20T22:14:41.188826+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:42.732 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:42 smithi049 bash[23528]: audit 2024-09-20T22:14:41.444946+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.732 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:42 smithi049 bash[23528]: audit 2024-09-20T22:14:41.453466+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.732 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:42 smithi049 bash[23528]: audit 2024-09-20T22:14:41.463038+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:42 smithi044 bash[22676]: cluster 2024-09-20T22:14:41.188826+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:42 smithi044 bash[22676]: audit 2024-09-20T22:14:41.444946+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:42 smithi044 bash[22676]: audit 2024-09-20T22:14:41.453466+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:42 smithi044 bash[22676]: audit 2024-09-20T22:14:41.463038+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:42 smithi179 bash[23186]: cluster 2024-09-20T22:14:41.188826+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:42.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:42 smithi179 bash[23186]: audit 2024-09-20T22:14:41.444946+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:42 smithi179 bash[23186]: audit 2024-09-20T22:14:41.453466+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:42.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:42 smithi179 bash[23186]: audit 2024-09-20T22:14:41.463038+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:43.546 INFO:teuthology.orchestra.run.smithi044.stdout:34359738403 2024-09-20T22:14:43.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-20T22:14:43.860 INFO:teuthology.orchestra.run.smithi044.stdout:77309411341 2024-09-20T22:14:43.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-20T22:14:43.931 INFO:teuthology.orchestra.run.smithi044.stdout:55834574871 2024-09-20T22:14:43.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-20T22:14:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:44 smithi044 bash[22676]: cluster 2024-09-20T22:14:43.189425+0000 mgr.a (mgr.14150) 229 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:44 smithi044 bash[22676]: audit 2024-09-20T22:14:44.426820+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:44 smithi044 bash[22676]: audit 2024-09-20T22:14:44.434855+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:44.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:44 smithi179 bash[23186]: cluster 2024-09-20T22:14:43.189425+0000 mgr.a (mgr.14150) 229 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:44.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:44 smithi179 bash[23186]: audit 2024-09-20T22:14:44.426820+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:44.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:44 smithi179 bash[23186]: audit 2024-09-20T22:14:44.434855+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:44.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:44 smithi049 bash[23528]: cluster 2024-09-20T22:14:43.189425+0000 mgr.a (mgr.14150) 229 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:44.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:44 smithi049 bash[23528]: audit 2024-09-20T22:14:44.426820+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:44.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:44 smithi049 bash[23528]: audit 2024-09-20T22:14:44.434855+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:45 smithi044 bash[22676]: audit 2024-09-20T22:14:44.445861+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:45.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:45 smithi179 bash[23186]: audit 2024-09-20T22:14:44.445861+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:45.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:45 smithi049 bash[23528]: audit 2024-09-20T22:14:44.445861+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:46 smithi044 bash[22676]: cluster 2024-09-20T22:14:45.189949+0000 mgr.a (mgr.14150) 230 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:46 smithi179 bash[23186]: cluster 2024-09-20T22:14:45.189949+0000 mgr.a (mgr.14150) 230 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:46.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:46 smithi049 bash[23528]: cluster 2024-09-20T22:14:45.189949+0000 mgr.a (mgr.14150) 230 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:48.288 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:48.288 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:48.289 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:48 smithi044 bash[22676]: cluster 2024-09-20T22:14:47.190468+0000 mgr.a (mgr.14150) 231 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:48.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:48 smithi179 bash[23186]: cluster 2024-09-20T22:14:47.190468+0000 mgr.a (mgr.14150) 231 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:48.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:48 smithi049 bash[23528]: cluster 2024-09-20T22:14:47.190468+0000 mgr.a (mgr.14150) 231 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:50.258 INFO:teuthology.orchestra.run.smithi044.stdout:55834574872 2024-09-20T22:14:50.335 INFO:teuthology.orchestra.run.smithi044.stdout:77309411343 2024-09-20T22:14:50.341 INFO:teuthology.orchestra.run.smithi044.stdout:34359738404 2024-09-20T22:14:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:50 smithi044 bash[22676]: cluster 2024-09-20T22:14:49.190977+0000 mgr.a (mgr.14150) 232 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:50 smithi044 bash[22676]: audit 2024-09-20T22:14:50.259267+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? 172.21.15.44:0/3344727358' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T22:14:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:50 smithi044 bash[22676]: audit 2024-09-20T22:14:50.336439+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.44:0/3262022617' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T22:14:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:50 smithi044 bash[22676]: audit 2024-09-20T22:14:50.343919+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.44:0/1604446899' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T22:14:50.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:50 smithi179 bash[23186]: cluster 2024-09-20T22:14:49.190977+0000 mgr.a (mgr.14150) 232 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:50.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:50 smithi179 bash[23186]: audit 2024-09-20T22:14:50.259267+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? 172.21.15.44:0/3344727358' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T22:14:50.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:50 smithi179 bash[23186]: audit 2024-09-20T22:14:50.336439+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.44:0/3262022617' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T22:14:50.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:50 smithi179 bash[23186]: audit 2024-09-20T22:14:50.343919+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.44:0/1604446899' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T22:14:50.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:50 smithi049 bash[23528]: cluster 2024-09-20T22:14:49.190977+0000 mgr.a (mgr.14150) 232 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:50.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:50 smithi049 bash[23528]: audit 2024-09-20T22:14:50.259267+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? 172.21.15.44:0/3344727358' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T22:14:50.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:50 smithi049 bash[23528]: audit 2024-09-20T22:14:50.336439+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.44:0/3262022617' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T22:14:50.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:50 smithi049 bash[23528]: audit 2024-09-20T22:14:50.343919+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.44:0/1604446899' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T22:14:51.185 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574871 got 55834574872 for osd.1 2024-09-20T22:14:51.186 DEBUG:teuthology.parallel:result is None 2024-09-20T22:14:51.521 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738403 got 34359738404 for osd.0 2024-09-20T22:14:51.521 DEBUG:teuthology.parallel:result is None 2024-09-20T22:14:51.585 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411341 got 77309411343 for osd.2 2024-09-20T22:14:51.586 DEBUG:teuthology.parallel:result is None 2024-09-20T22:14:51.586 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-20T22:14:51.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T22:14:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:52 smithi044 bash[22676]: cluster 2024-09-20T22:14:51.191533+0000 mgr.a (mgr.14150) 233 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:52.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:52 smithi179 bash[23186]: cluster 2024-09-20T22:14:51.191533+0000 mgr.a (mgr.14150) 233 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:52.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:52 smithi049 bash[23528]: cluster 2024-09-20T22:14:51.191533+0000 mgr.a (mgr.14150) 233 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:54 smithi044 bash[22676]: cluster 2024-09-20T22:14:53.192124+0000 mgr.a (mgr.14150) 234 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:54.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:54 smithi179 bash[23186]: cluster 2024-09-20T22:14:53.192124+0000 mgr.a (mgr.14150) 234 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:54.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:54 smithi049 bash[23528]: cluster 2024-09-20T22:14:53.192124+0000 mgr.a (mgr.14150) 234 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:56.327 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:14:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:56 smithi044 bash[22676]: cluster 2024-09-20T22:14:55.192663+0000 mgr.a (mgr.14150) 235 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:56.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:56 smithi179 bash[23186]: cluster 2024-09-20T22:14:55.192663+0000 mgr.a (mgr.14150) 235 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:56.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:56 smithi049 bash[23528]: cluster 2024-09-20T22:14:55.192663+0000 mgr.a (mgr.14150) 235 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:58.054 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:14:58.055 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-20T22:14:58.615 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-20T22:14:57.192932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":84612,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":281150844,"statfs":{"total":287985106944,"available":287898464256,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-20T22:14:00.957194+0000","last_change":"2024-09-20T22:13:55.078423+0000","last_active":"2024-09-20T22:14:00.957194+0000","last_peered":"2024-09-20T22:14:00.957194+0000","last_clean":"2024-09-20T22:14:00.957194+0000","last_became_active":"2024-09-20T22:13:55.077646+0000","last_became_peered":"2024-09-20T22:13:55.077646+0000","last_unstale":"2024-09-20T22:14:00.957194+0000","last_undegraded":"2024-09-20T22:14:00.957194+0000","last_fullsized":"2024-09-20T22:14:00.957194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T22:13:54.057643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T22:13:54.057643+0000","last_clean_scrub_stamp":"2024-09-20T22:13:54.057643+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:08:06.653046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411344,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T22:14:58.616 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T22:14:58.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:58 smithi049 bash[23528]: cluster 2024-09-20T22:14:57.193199+0000 mgr.a (mgr.14150) 236 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:58.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:58 smithi049 bash[23528]: audit 2024-09-20T22:14:57.513886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:58.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:58 smithi049 bash[23528]: audit 2024-09-20T22:14:57.521243+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:58.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:58 smithi049 bash[23528]: audit 2024-09-20T22:14:57.530285+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:58.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:14:58 smithi049 bash[23528]: audit 2024-09-20T22:14:58.054222+0000 mgr.a (mgr.14150) 237 : audit [DBG] from='client.14364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:14:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:58 smithi044 bash[22676]: cluster 2024-09-20T22:14:57.193199+0000 mgr.a (mgr.14150) 236 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:58 smithi044 bash[22676]: audit 2024-09-20T22:14:57.513886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:58 smithi044 bash[22676]: audit 2024-09-20T22:14:57.521243+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:58 smithi044 bash[22676]: audit 2024-09-20T22:14:57.530285+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:14:58 smithi044 bash[22676]: audit 2024-09-20T22:14:58.054222+0000 mgr.a (mgr.14150) 237 : audit [DBG] from='client.14364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:14:59.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:58 smithi179 bash[23186]: cluster 2024-09-20T22:14:57.193199+0000 mgr.a (mgr.14150) 236 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:14:59.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:58 smithi179 bash[23186]: audit 2024-09-20T22:14:57.513886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:59.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:58 smithi179 bash[23186]: audit 2024-09-20T22:14:57.521243+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:59.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:58 smithi179 bash[23186]: audit 2024-09-20T22:14:57.530285+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:14:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:14:58 smithi179 bash[23186]: audit 2024-09-20T22:14:58.054222+0000 mgr.a (mgr.14150) 237 : audit [DBG] from='client.14364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:15:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:00 smithi044 bash[22676]: cluster 2024-09-20T22:14:59.193710+0000 mgr.a (mgr.14150) 238 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:00.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:00 smithi179 bash[23186]: cluster 2024-09-20T22:14:59.193710+0000 mgr.a (mgr.14150) 238 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:00.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:00 smithi049 bash[23528]: cluster 2024-09-20T22:14:59.193710+0000 mgr.a (mgr.14150) 238 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:01.387 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:01 smithi049 bash[23528]: audit 2024-09-20T22:15:01.020469+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:01.387 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:01 smithi049 bash[23528]: audit 2024-09-20T22:15:01.025539+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:01.387 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:01 smithi049 bash[23528]: audit 2024-09-20T22:15:01.027370+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:01.387 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:01 smithi049 bash[23528]: audit 2024-09-20T22:15:01.037503+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:01 smithi044 bash[22676]: audit 2024-09-20T22:15:01.020469+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:01 smithi044 bash[22676]: audit 2024-09-20T22:15:01.025539+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:01 smithi044 bash[22676]: audit 2024-09-20T22:15:01.027370+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:01 smithi044 bash[22676]: audit 2024-09-20T22:15:01.037503+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:01.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:01 smithi179 bash[23186]: audit 2024-09-20T22:15:01.020469+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:01.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:01 smithi179 bash[23186]: audit 2024-09-20T22:15:01.025539+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:01.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:01 smithi179 bash[23186]: audit 2024-09-20T22:15:01.027370+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:01.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:01 smithi179 bash[23186]: audit 2024-09-20T22:15:01.037503+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:02.364 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:15:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:02 smithi044 bash[22676]: cluster 2024-09-20T22:15:01.194303+0000 mgr.a (mgr.14150) 239 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:02 smithi044 bash[22676]: audit 2024-09-20T22:15:01.675029+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:02 smithi044 bash[22676]: audit 2024-09-20T22:15:01.680855+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:02 smithi044 bash[22676]: audit 2024-09-20T22:15:01.689734+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:02.974 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:02 smithi049 bash[23528]: cluster 2024-09-20T22:15:01.194303+0000 mgr.a (mgr.14150) 239 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:02.974 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:02 smithi049 bash[23528]: audit 2024-09-20T22:15:01.675029+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:02.975 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:02 smithi049 bash[23528]: audit 2024-09-20T22:15:01.680855+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:02.975 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:02 smithi049 bash[23528]: audit 2024-09-20T22:15:01.689734+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:03.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:02 smithi179 bash[23186]: cluster 2024-09-20T22:15:01.194303+0000 mgr.a (mgr.14150) 239 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:03.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:02 smithi179 bash[23186]: audit 2024-09-20T22:15:01.675029+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:03.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:02 smithi179 bash[23186]: audit 2024-09-20T22:15:01.680855+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:03.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:02 smithi179 bash[23186]: audit 2024-09-20T22:15:01.689734+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:03.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:15:03.762 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-20T22:15:04.314 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-20T22:15:03.194616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":84612,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":281150844,"statfs":{"total":287985106944,"available":287898464256,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003352"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-20T22:14:00.957194+0000","last_change":"2024-09-20T22:13:55.078423+0000","last_active":"2024-09-20T22:14:00.957194+0000","last_peered":"2024-09-20T22:14:00.957194+0000","last_clean":"2024-09-20T22:14:00.957194+0000","last_became_active":"2024-09-20T22:13:55.077646+0000","last_became_peered":"2024-09-20T22:13:55.077646+0000","last_unstale":"2024-09-20T22:14:00.957194+0000","last_undegraded":"2024-09-20T22:14:00.957194+0000","last_fullsized":"2024-09-20T22:14:00.957194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T22:13:54.057643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T22:13:54.057643+0000","last_clean_scrub_stamp":"2024-09-20T22:13:54.057643+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:08:06.653046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T22:15:04.314 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-20T22:15:04.314 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-20T22:15:04.314 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-20T22:15:04.315 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-20T22:15:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:04 smithi044 bash[22676]: cluster 2024-09-20T22:15:03.194889+0000 mgr.a (mgr.14150) 240 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:04 smithi044 bash[22676]: audit 2024-09-20T22:15:03.761561+0000 mgr.a (mgr.14150) 241 : audit [DBG] from='client.14370 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:15:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:04 smithi044 bash[22676]: audit 2024-09-20T22:15:04.653013+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:04 smithi044 bash[22676]: audit 2024-09-20T22:15:04.661030+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:04 smithi044 bash[22676]: audit 2024-09-20T22:15:04.670015+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:05.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:04 smithi179 bash[23186]: cluster 2024-09-20T22:15:03.194889+0000 mgr.a (mgr.14150) 240 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:05.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:04 smithi179 bash[23186]: audit 2024-09-20T22:15:03.761561+0000 mgr.a (mgr.14150) 241 : audit [DBG] from='client.14370 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:15:05.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:04 smithi179 bash[23186]: audit 2024-09-20T22:15:04.653013+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:05.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:04 smithi179 bash[23186]: audit 2024-09-20T22:15:04.661030+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:05.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:04 smithi179 bash[23186]: audit 2024-09-20T22:15:04.670015+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:05.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:04 smithi049 bash[23528]: cluster 2024-09-20T22:15:03.194889+0000 mgr.a (mgr.14150) 240 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:04 smithi049 bash[23528]: audit 2024-09-20T22:15:03.761561+0000 mgr.a (mgr.14150) 241 : audit [DBG] from='client.14370 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T22:15:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:04 smithi049 bash[23528]: audit 2024-09-20T22:15:04.653013+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:04 smithi049 bash[23528]: audit 2024-09-20T22:15:04.661030+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:04 smithi049 bash[23528]: audit 2024-09-20T22:15:04.670015+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:06 smithi044 bash[22676]: cluster 2024-09-20T22:15:05.195394+0000 mgr.a (mgr.14150) 242 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:07.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:06 smithi179 bash[23186]: cluster 2024-09-20T22:15:05.195394+0000 mgr.a (mgr.14150) 242 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:07.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:06 smithi049 bash[23528]: cluster 2024-09-20T22:15:05.195394+0000 mgr.a (mgr.14150) 242 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:08 smithi044 bash[22676]: cluster 2024-09-20T22:15:07.196051+0000 mgr.a (mgr.14150) 243 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:09.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:08 smithi179 bash[23186]: cluster 2024-09-20T22:15:07.196051+0000 mgr.a (mgr.14150) 243 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:09.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:08 smithi049 bash[23528]: cluster 2024-09-20T22:15:07.196051+0000 mgr.a (mgr.14150) 243 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:15:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-20T22:15:10.596 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-20T22:15:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:10 smithi044 bash[22676]: cluster 2024-09-20T22:15:09.196610+0000 mgr.a (mgr.14150) 244 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:10 smithi044 bash[22676]: audit 2024-09-20T22:15:10.597269+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.44:0/2832446675' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T22:15:11.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:10 smithi179 bash[23186]: cluster 2024-09-20T22:15:09.196610+0000 mgr.a (mgr.14150) 244 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:11.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:10 smithi179 bash[23186]: audit 2024-09-20T22:15:10.597269+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.44:0/2832446675' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T22:15:11.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:10 smithi049 bash[23528]: cluster 2024-09-20T22:15:09.196610+0000 mgr.a (mgr.14150) 244 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:11.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:10 smithi049 bash[23528]: audit 2024-09-20T22:15:10.597269+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.44:0/2832446675' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T22:15:11.196 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-20T22:15:11.196 INFO:tasks.cephadm:Setup complete, yielding 2024-09-20T22:15:11.196 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T22:15:11.205 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi044.front.sepia.ceph.com 2024-09-20T22:15:11.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- bash -c 'ceph mgr module enable rgw' 2024-09-20T22:15:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:12 smithi044 bash[22676]: cluster 2024-09-20T22:15:11.197063+0000 mgr.a (mgr.14150) 245 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:13.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:12 smithi179 bash[23186]: cluster 2024-09-20T22:15:11.197063+0000 mgr.a (mgr.14150) 245 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:13.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:12 smithi049 bash[23528]: cluster 2024-09-20T22:15:11.197063+0000 mgr.a (mgr.14150) 245 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:14.980 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:14 smithi044 bash[22676]: cluster 2024-09-20T22:15:13.197600+0000 mgr.a (mgr.14150) 246 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:15.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:14 smithi179 bash[23186]: cluster 2024-09-20T22:15:13.197600+0000 mgr.a (mgr.14150) 246 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:15.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:14 smithi049 bash[23528]: cluster 2024-09-20T22:15:13.197600+0000 mgr.a (mgr.14150) 246 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:15.951 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:15:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:16 smithi044 bash[22676]: cluster 2024-09-20T22:15:15.198123+0000 mgr.a (mgr.14150) 247 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:17.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:16 smithi179 bash[23186]: cluster 2024-09-20T22:15:15.198123+0000 mgr.a (mgr.14150) 247 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:17.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:16 smithi049 bash[23528]: cluster 2024-09-20T22:15:15.198123+0000 mgr.a (mgr.14150) 247 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:17.980 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:17 smithi044 bash[22676]: audit 2024-09-20T22:15:17.399964+0000 mon.a (mon.0) 675 : audit [INF] from='client.? 172.21.15.44:0/2532814842' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-20T22:15:17.981 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:17 smithi044 bash[22930]: ignoring --setuser ceph since I am not root 2024-09-20T22:15:17.981 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:17 smithi044 bash[22930]: ignoring --setgroup ceph since I am not root 2024-09-20T22:15:17.981 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:17 smithi044 bash[22930]: debug 2024-09-20T22:15:17.892+0000 7f4c74b37040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T22:15:18.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:17 smithi179 bash[23186]: audit 2024-09-20T22:15:17.399964+0000 mon.a (mon.0) 675 : audit [INF] from='client.? 172.21.15.44:0/2532814842' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-20T22:15:18.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:17 smithi049 bash[23528]: audit 2024-09-20T22:15:17.399964+0000 mon.a (mon.0) 675 : audit [INF] from='client.? 172.21.15.44:0/2532814842' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-20T22:15:18.048 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:17 smithi049 bash[24416]: ignoring --setuser ceph since I am not root 2024-09-20T22:15:18.048 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:17 smithi049 bash[24416]: ignoring --setgroup ceph since I am not root 2024-09-20T22:15:18.048 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:17 smithi049 bash[24416]: debug 2024-09-20T22:15:17.807+0000 7f8c039cb640 1 -- 172.21.15.49:0/1971111779 <== mon.2 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5650d067d0e0 con 0x5650d067e800 2024-09-20T22:15:18.048 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:17 smithi049 bash[24416]: debug 2024-09-20T22:15:17.931+0000 7f8c06227040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T22:15:18.373 INFO:teuthology.run_tasks:Running task rgw_module.apply... 2024-09-20T22:15:18.392 INFO:tasks.rgw_module:Applying spec(s): rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 2024-09-20T22:15:18.392 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- ceph rgw realm bootstrap -i - 2024-09-20T22:15:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:18 smithi044 bash[22676]: audit 2024-09-20T22:15:17.722367+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.44:0/2532814842' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-20T22:15:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:18 smithi044 bash[22676]: cluster 2024-09-20T22:15:17.730998+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-20T22:15:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:18 smithi044 bash[22676]: audit 2024-09-20T22:15:17.736288+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:19.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:18 smithi179 bash[23186]: audit 2024-09-20T22:15:17.722367+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.44:0/2532814842' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-20T22:15:19.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:18 smithi179 bash[23186]: cluster 2024-09-20T22:15:17.730998+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-20T22:15:19.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:18 smithi179 bash[23186]: audit 2024-09-20T22:15:17.736288+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:19.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:18 smithi049 bash[23528]: audit 2024-09-20T22:15:17.722367+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.44:0/2532814842' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-20T22:15:19.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:18 smithi049 bash[23528]: cluster 2024-09-20T22:15:17.730998+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-20T22:15:19.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:18 smithi049 bash[23528]: audit 2024-09-20T22:15:17.736288+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14150 172.21.15.44:0/231673131' entity='mgr.a' 2024-09-20T22:15:19.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:19 smithi044 bash[22930]: debug 2024-09-20T22:15:19.144+0000 7f4c74b37040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T22:15:19.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:19 smithi044 bash[22930]: debug 2024-09-20T22:15:19.212+0000 7f4c74b37040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T22:15:19.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:19 smithi044 bash[22930]: debug 2024-09-20T22:15:19.372+0000 7f4c74b37040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T22:15:19.548 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:19 smithi049 bash[24416]: debug 2024-09-20T22:15:19.175+0000 7f8c06227040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-20T22:15:19.548 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:19 smithi049 bash[24416]: debug 2024-09-20T22:15:19.239+0000 7f8c06227040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T22:15:19.548 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:19 smithi049 bash[24416]: debug 2024-09-20T22:15:19.399+0000 7f8c06227040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T22:15:20.194 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.048+0000 7f4c74b37040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T22:15:20.194 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.120+0000 7f4c74b37040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T22:15:20.414 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.075+0000 7f8c06227040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T22:15:20.414 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.147+0000 7f8c06227040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T22:15:20.414 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.219+0000 7f8c06227040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T22:15:20.414 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.415+0000 7f8c06227040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T22:15:20.468 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.192+0000 7f4c74b37040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T22:15:20.468 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.388+0000 7f4c74b37040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-20T22:15:20.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.468+0000 7f4c74b37040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T22:15:20.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.536+0000 7f4c74b37040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T22:15:20.798 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.495+0000 7f8c06227040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T22:15:20.798 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.567+0000 7f8c06227040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T22:15:21.080 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.804+0000 7f4c74b37040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T22:15:21.081 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:20 smithi044 bash[22930]: debug 2024-09-20T22:15:20.876+0000 7f4c74b37040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T22:15:21.106 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.831+0000 7f8c06227040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T22:15:21.106 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:20 smithi049 bash[24416]: debug 2024-09-20T22:15:20.903+0000 7f8c06227040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T22:15:21.106 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:21 smithi049 bash[24416]: debug 2024-09-20T22:15:21.107+0000 7f8c06227040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T22:15:21.422 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:21 smithi044 bash[22930]: debug 2024-09-20T22:15:21.080+0000 7f4c74b37040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T22:15:21.423 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:21 smithi044 bash[22930]: debug 2024-09-20T22:15:21.160+0000 7f4c74b37040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T22:15:21.450 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:21 smithi049 bash[24416]: debug 2024-09-20T22:15:21.187+0000 7f8c06227040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T22:15:21.735 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:21 smithi044 bash[22930]: debug 2024-09-20T22:15:21.420+0000 7f4c74b37040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T22:15:21.735 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:21 smithi044 bash[22930]: debug 2024-09-20T22:15:21.604+0000 7f4c74b37040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:15:21.798 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:21 smithi049 bash[24416]: debug 2024-09-20T22:15:21.451+0000 7f8c06227040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T22:15:21.798 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:21 smithi049 bash[24416]: debug 2024-09-20T22:15:21.635+0000 7f8c06227040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:15:22.047 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:21 smithi044 bash[22930]: debug 2024-09-20T22:15:21.776+0000 7f4c74b37040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T22:15:22.047 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:21 smithi044 bash[22930]: debug 2024-09-20T22:15:21.860+0000 7f4c74b37040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T22:15:22.076 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:21 smithi049 bash[24416]: debug 2024-09-20T22:15:21.807+0000 7f8c06227040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T22:15:22.076 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:21 smithi049 bash[24416]: debug 2024-09-20T22:15:21.887+0000 7f8c06227040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T22:15:22.375 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:22 smithi049 bash[24416]: debug 2024-09-20T22:15:22.079+0000 7f8c06227040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:15:22.485 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:22 smithi044 bash[22930]: debug 2024-09-20T22:15:22.044+0000 7f4c74b37040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T22:15:22.871 INFO:teuthology.orchestra.run.smithi044.stdout:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:15:23.221 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:22 smithi044 bash[22930]: debug 2024-09-20T22:15:22.908+0000 7f4c74b37040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T22:15:23.221 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:22 smithi044 bash[22930]: debug 2024-09-20T22:15:22.988+0000 7f4c74b37040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T22:15:23.234 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:22 smithi049 bash[24416]: debug 2024-09-20T22:15:22.919+0000 7f8c06227040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T22:15:23.234 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[24416]: debug 2024-09-20T22:15:22.999+0000 7f8c06227040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T22:15:23.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22930]: debug 2024-09-20T22:15:23.220+0000 7f4c74b37040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T22:15:23.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22930]: debug 2024-09-20T22:15:23.296+0000 7f4c74b37040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T22:15:23.526 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[24416]: debug 2024-09-20T22:15:23.235+0000 7f8c06227040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T22:15:23.526 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[24416]: debug 2024-09-20T22:15:23.311+0000 7f8c06227040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T22:15:23.798 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[24416]: debug 2024-09-20T22:15:23.727+0000 7f8c06227040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T22:15:23.985 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22930]: debug 2024-09-20T22:15:23.704+0000 7f4c74b37040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22930]: debug 2024-09-20T22:15:23.788+0000 7f4c74b37040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: cluster 2024-09-20T22:15:23.811035+0000 mon.a (mon.0) 679 : cluster [INF] Active manager daemon a restarted 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: cluster 2024-09-20T22:15:23.811919+0000 mon.a (mon.0) 680 : cluster [INF] Activating manager daemon a 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: cluster 2024-09-20T22:15:23.824384+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: cluster 2024-09-20T22:15:23.824894+0000 mon.a (mon.0) 682 : cluster [DBG] mgrmap e17: a(active, starting, since 0.0133138s), standbys: b 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.827703+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.827889+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: cluster 2024-09-20T22:15:23.828079+0000 mon.a (mon.0) 685 : cluster [DBG] Standby manager daemon b restarted 2024-09-20T22:15:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: cluster 2024-09-20T22:15:23.828173+0000 mon.a (mon.0) 686 : cluster [DBG] Standby manager daemon b started 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.828428+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.830913+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.831077+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.831445+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.831756+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.832033+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.832329+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.832595+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.832691+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.832827+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.833279+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.834526+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: audit 2024-09-20T22:15:23.835097+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T22:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:23 smithi044 bash[22676]: cluster 2024-09-20T22:15:23.859704+0000 mon.a (mon.0) 696 : cluster [INF] Manager daemon a is now available 2024-09-20T22:15:24.129 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[24416]: debug 2024-09-20T22:15:23.807+0000 7f8c06227040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T22:15:24.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: cluster 2024-09-20T22:15:23.811035+0000 mon.a (mon.0) 679 : cluster [INF] Active manager daemon a restarted 2024-09-20T22:15:24.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: cluster 2024-09-20T22:15:23.811919+0000 mon.a (mon.0) 680 : cluster [INF] Activating manager daemon a 2024-09-20T22:15:24.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: cluster 2024-09-20T22:15:23.824384+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-20T22:15:24.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: cluster 2024-09-20T22:15:23.824894+0000 mon.a (mon.0) 682 : cluster [DBG] mgrmap e17: a(active, starting, since 0.0133138s), standbys: b 2024-09-20T22:15:24.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.827703+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:15:24.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.827889+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: cluster 2024-09-20T22:15:23.828079+0000 mon.a (mon.0) 685 : cluster [DBG] Standby manager daemon b restarted 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: cluster 2024-09-20T22:15:23.828173+0000 mon.a (mon.0) 686 : cluster [DBG] Standby manager daemon b started 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.828428+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.830913+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.831077+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.831445+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.831756+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.832033+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.832329+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.832595+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.832691+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.832827+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.833279+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.834526+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: audit 2024-09-20T22:15:23.835097+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T22:15:24.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:23 smithi049 bash[23528]: cluster 2024-09-20T22:15:23.859704+0000 mon.a (mon.0) 696 : cluster [INF] Manager daemon a is now available 2024-09-20T22:15:24.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: cluster 2024-09-20T22:15:23.811035+0000 mon.a (mon.0) 679 : cluster [INF] Active manager daemon a restarted 2024-09-20T22:15:24.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: cluster 2024-09-20T22:15:23.811919+0000 mon.a (mon.0) 680 : cluster [INF] Activating manager daemon a 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: cluster 2024-09-20T22:15:23.824384+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: cluster 2024-09-20T22:15:23.824894+0000 mon.a (mon.0) 682 : cluster [DBG] mgrmap e17: a(active, starting, since 0.0133138s), standbys: b 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.827703+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.827889+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: cluster 2024-09-20T22:15:23.828079+0000 mon.a (mon.0) 685 : cluster [DBG] Standby manager daemon b restarted 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: cluster 2024-09-20T22:15:23.828173+0000 mon.a (mon.0) 686 : cluster [DBG] Standby manager daemon b started 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.828428+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.830913+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.831077+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.831445+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.831756+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.832033+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.832329+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.832595+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T22:15:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.832691+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-20T22:15:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.832827+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T22:15:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.833279+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T22:15:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.834526+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-20T22:15:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: audit 2024-09-20T22:15:23.835097+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.49:0/3359701395' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T22:15:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:23 smithi179 bash[23186]: cluster 2024-09-20T22:15:23.859704+0000 mon.a (mon.0) 696 : cluster [INF] Manager daemon a is now available 2024-09-20T22:15:25.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.885329+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:25.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.888242+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:25.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.891986+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.892395+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.895040+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.897868+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.904926+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.911497+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.915348+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.916695+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.918241+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cephadm 2024-09-20T22:15:23.920436+0000 mgr.a (mgr.14388) 1 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cephadm 2024-09-20T22:15:23.922383+0000 mgr.a (mgr.14388) 2 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cephadm 2024-09-20T22:15:23.923157+0000 mgr.a (mgr.14388) 3 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: audit 2024-09-20T22:15:23.923796+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cephadm 2024-09-20T22:15:24.601930+0000 mgr.a (mgr.14388) 4 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cephadm 2024-09-20T22:15:24.635640+0000 mgr.a (mgr.14388) 5 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cephadm 2024-09-20T22:15:24.636410+0000 mgr.a (mgr.14388) 6 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cephadm 2024-09-20T22:15:24.766813+0000 mgr.a (mgr.14388) 7 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:25.059 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:24 smithi049 bash[23528]: cluster 2024-09-20T22:15:24.829169+0000 mon.a (mon.0) 709 : cluster [DBG] mgrmap e18: a(active, since 1.0176s), standbys: b 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.885329+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.888242+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.891986+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.892395+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.895040+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.897868+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.904926+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.911497+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.915348+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.916695+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.918241+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cephadm 2024-09-20T22:15:23.920436+0000 mgr.a (mgr.14388) 1 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cephadm 2024-09-20T22:15:23.922383+0000 mgr.a (mgr.14388) 2 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cephadm 2024-09-20T22:15:23.923157+0000 mgr.a (mgr.14388) 3 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: audit 2024-09-20T22:15:23.923796+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cephadm 2024-09-20T22:15:24.601930+0000 mgr.a (mgr.14388) 4 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cephadm 2024-09-20T22:15:24.635640+0000 mgr.a (mgr.14388) 5 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cephadm 2024-09-20T22:15:24.636410+0000 mgr.a (mgr.14388) 6 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cephadm 2024-09-20T22:15:24.766813+0000 mgr.a (mgr.14388) 7 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:24 smithi044 bash[22676]: cluster 2024-09-20T22:15:24.829169+0000 mon.a (mon.0) 709 : cluster [DBG] mgrmap e18: a(active, since 1.0176s), standbys: b 2024-09-20T22:15:25.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.885329+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:25.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.888242+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:25.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.891986+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.892395+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.895040+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.897868+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.904926+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.911497+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]': finished 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.915348+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.916695+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.918241+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cephadm 2024-09-20T22:15:23.920436+0000 mgr.a (mgr.14388) 1 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.conf 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cephadm 2024-09-20T22:15:23.922383+0000 mgr.a (mgr.14388) 2 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cephadm 2024-09-20T22:15:23.923157+0000 mgr.a (mgr.14388) 3 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.conf 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: audit 2024-09-20T22:15:23.923796+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cephadm 2024-09-20T22:15:24.601930+0000 mgr.a (mgr.14388) 4 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cephadm 2024-09-20T22:15:24.635640+0000 mgr.a (mgr.14388) 5 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cephadm 2024-09-20T22:15:24.636410+0000 mgr.a (mgr.14388) 6 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T22:15:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cephadm 2024-09-20T22:15:24.766813+0000 mgr.a (mgr.14388) 7 : cephadm [INF] Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:24 smithi179 bash[23186]: cluster 2024-09-20T22:15:24.829169+0000 mon.a (mon.0) 709 : cluster [DBG] mgrmap e18: a(active, since 1.0176s), standbys: b 2024-09-20T22:15:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: cephadm 2024-09-20T22:15:24.814227+0000 mgr.a (mgr.14388) 8 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: cephadm 2024-09-20T22:15:24.816235+0000 mgr.a (mgr.14388) 9 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:24.829306+0000 mgr.a (mgr.14388) 10 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: cluster 2024-09-20T22:15:24.840745+0000 mgr.a (mgr.14388) 11 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: cephadm 2024-09-20T22:15:24.964857+0000 mgr.a (mgr.14388) 12 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: cephadm 2024-09-20T22:15:25.009724+0000 mgr.a (mgr.14388) 13 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: cephadm 2024-09-20T22:15:25.011708+0000 mgr.a (mgr.14388) 14 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.331956+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.337405+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.342104+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.346947+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.351508+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.358627+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.366738+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.375040+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.426768+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.429663+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.430400+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.437826+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: cluster 2024-09-20T22:15:25.891328+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-20T22:15:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22676]: audit 2024-09-20T22:15:25.893601+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.44:0/566460687' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T22:15:26.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: cephadm 2024-09-20T22:15:24.814227+0000 mgr.a (mgr.14388) 8 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:26.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: cephadm 2024-09-20T22:15:24.816235+0000 mgr.a (mgr.14388) 9 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:26.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:24.829306+0000 mgr.a (mgr.14388) 10 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:26.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: cluster 2024-09-20T22:15:24.840745+0000 mgr.a (mgr.14388) 11 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: cephadm 2024-09-20T22:15:24.964857+0000 mgr.a (mgr.14388) 12 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: cephadm 2024-09-20T22:15:25.009724+0000 mgr.a (mgr.14388) 13 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: cephadm 2024-09-20T22:15:25.011708+0000 mgr.a (mgr.14388) 14 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.331956+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.337405+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.342104+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.346947+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.351508+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.358627+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.366738+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.375040+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.426768+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.429663+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.430400+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.437826+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: cluster 2024-09-20T22:15:25.891328+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-20T22:15:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:26 smithi179 bash[23186]: audit 2024-09-20T22:15:25.893601+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.44:0/566460687' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: cephadm 2024-09-20T22:15:24.814227+0000 mgr.a (mgr.14388) 8 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: cephadm 2024-09-20T22:15:24.816235+0000 mgr.a (mgr.14388) 9 : cephadm [INF] Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:24.829306+0000 mgr.a (mgr.14388) 10 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: cluster 2024-09-20T22:15:24.840745+0000 mgr.a (mgr.14388) 11 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: cephadm 2024-09-20T22:15:24.964857+0000 mgr.a (mgr.14388) 12 : cephadm [INF] Updating smithi044:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: cephadm 2024-09-20T22:15:25.009724+0000 mgr.a (mgr.14388) 13 : cephadm [INF] Updating smithi049:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: cephadm 2024-09-20T22:15:25.011708+0000 mgr.a (mgr.14388) 14 : cephadm [INF] Updating smithi179:/var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.331956+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.337405+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.342104+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.346947+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.351508+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.358627+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.366738+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.375040+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.426768+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.429663+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.430400+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.437826+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: cluster 2024-09-20T22:15:25.891328+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-20T22:15:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:26 smithi049 bash[23528]: audit 2024-09-20T22:15:25.893601+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.44:0/566460687' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: debug 2024-09-20T22:15:26.884+0000 7f4bcd369640 -1 log_channel(cephadm) log [ERR] : [20/Sep/2024:22:15:26] ENGINE Error in HTTPServer.serve 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: Traceback (most recent call last): 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: self._connections.run(self.expiration_interval) 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: self._run(expiration_interval) 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:15:27.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: s = self.context.wrap_socket( 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: return self.sslsocket_class._create( 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: self.do_handshake() 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: self._sslobj.do_handshake() 2024-09-20T22:15:27.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:26 smithi044 bash[22930]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: cluster 2024-09-20T22:15:25.832546+0000 mgr.a (mgr.14388) 15 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: cephadm 2024-09-20T22:15:26.660265+0000 mgr.a (mgr.14388) 16 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Bus STARTING 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: cephadm 2024-09-20T22:15:26.762269+0000 mgr.a (mgr.14388) 17 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Serving on http://172.21.15.44:8765 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: cluster 2024-09-20T22:15:26.847419+0000 mon.a (mon.0) 724 : cluster [DBG] mgrmap e19: a(active, since 3s), standbys: b 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: audit 2024-09-20T22:15:26.887718+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: audit 2024-09-20T22:15:26.889159+0000 mon.a (mon.0) 726 : audit [INF] from='client.? 172.21.15.44:0/566460687' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: cluster 2024-09-20T22:15:26.896783+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-20T22:15:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: audit 2024-09-20T22:15:26.897768+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]: dispatch 2024-09-20T22:15:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: audit 2024-09-20T22:15:26.898274+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]: dispatch 2024-09-20T22:15:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:27 smithi044 bash[22676]: audit 2024-09-20T22:15:26.898705+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: cluster 2024-09-20T22:15:25.832546+0000 mgr.a (mgr.14388) 15 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: cephadm 2024-09-20T22:15:26.660265+0000 mgr.a (mgr.14388) 16 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Bus STARTING 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: cephadm 2024-09-20T22:15:26.762269+0000 mgr.a (mgr.14388) 17 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Serving on http://172.21.15.44:8765 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: cluster 2024-09-20T22:15:26.847419+0000 mon.a (mon.0) 724 : cluster [DBG] mgrmap e19: a(active, since 3s), standbys: b 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: audit 2024-09-20T22:15:26.887718+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: audit 2024-09-20T22:15:26.889159+0000 mon.a (mon.0) 726 : audit [INF] from='client.? 172.21.15.44:0/566460687' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: cluster 2024-09-20T22:15:26.896783+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: audit 2024-09-20T22:15:26.897768+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]: dispatch 2024-09-20T22:15:27.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: audit 2024-09-20T22:15:26.898274+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]: dispatch 2024-09-20T22:15:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:27 smithi179 bash[23186]: audit 2024-09-20T22:15:26.898705+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-20T22:15:27.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: cluster 2024-09-20T22:15:25.832546+0000 mgr.a (mgr.14388) 15 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:27.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: cephadm 2024-09-20T22:15:26.660265+0000 mgr.a (mgr.14388) 16 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Bus STARTING 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: cephadm 2024-09-20T22:15:26.762269+0000 mgr.a (mgr.14388) 17 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Serving on http://172.21.15.44:8765 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: cluster 2024-09-20T22:15:26.847419+0000 mon.a (mon.0) 724 : cluster [DBG] mgrmap e19: a(active, since 3s), standbys: b 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: audit 2024-09-20T22:15:26.887718+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: audit 2024-09-20T22:15:26.889159+0000 mon.a (mon.0) 726 : audit [INF] from='client.? 172.21.15.44:0/566460687' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: cluster 2024-09-20T22:15:26.896783+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: audit 2024-09-20T22:15:26.897768+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi049", "caps": []}]: dispatch 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: audit 2024-09-20T22:15:26.898274+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]: dispatch 2024-09-20T22:15:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:27 smithi049 bash[23528]: audit 2024-09-20T22:15:26.898705+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: cephadm 2024-09-20T22:15:26.885964+0000 mgr.a (mgr.14388) 18 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Serving on https://172.21.15.44:7151 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: cephadm 2024-09-20T22:15:26.886118+0000 mgr.a (mgr.14388) 19 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Bus STARTED 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: cephadm 2024-09-20T22:15:26.889236+0000 mgr.a (mgr.14388) 20 : cephadm [ERR] [20/Sep/2024:22:15:26] ENGINE Error in HTTPServer.serve 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: Traceback (most recent call last): 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: self._connections.run(self.expiration_interval) 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: self._run(expiration_interval) 2024-09-20T22:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: s = self.context.wrap_socket( 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: return self.sslsocket_class._create( 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: self.do_handshake() 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: self._sslobj.do_handshake() 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:28 smithi044 bash[22676]: cluster 2024-09-20T22:15:27.893231+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-20T22:15:28.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: cephadm 2024-09-20T22:15:26.885964+0000 mgr.a (mgr.14388) 18 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Serving on https://172.21.15.44:7151 2024-09-20T22:15:28.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: cephadm 2024-09-20T22:15:26.886118+0000 mgr.a (mgr.14388) 19 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Bus STARTED 2024-09-20T22:15:28.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: cephadm 2024-09-20T22:15:26.889236+0000 mgr.a (mgr.14388) 20 : cephadm [ERR] [20/Sep/2024:22:15:26] ENGINE Error in HTTPServer.serve 2024-09-20T22:15:28.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: Traceback (most recent call last): 2024-09-20T22:15:28.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: self._connections.run(self.expiration_interval) 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: self._run(expiration_interval) 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: s = self.context.wrap_socket( 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: return self.sslsocket_class._create( 2024-09-20T22:15:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:15:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: self.do_handshake() 2024-09-20T22:15:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:15:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: self._sslobj.do_handshake() 2024-09-20T22:15:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:15:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:28 smithi179 bash[23186]: cluster 2024-09-20T22:15:27.893231+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-20T22:15:28.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: cephadm 2024-09-20T22:15:26.885964+0000 mgr.a (mgr.14388) 18 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Serving on https://172.21.15.44:7151 2024-09-20T22:15:28.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: cephadm 2024-09-20T22:15:26.886118+0000 mgr.a (mgr.14388) 19 : cephadm [INF] [20/Sep/2024:22:15:26] ENGINE Bus STARTED 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: cephadm 2024-09-20T22:15:26.889236+0000 mgr.a (mgr.14388) 20 : cephadm [ERR] [20/Sep/2024:22:15:26] ENGINE Error in HTTPServer.serve 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: Traceback (most recent call last): 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: self._connections.run(self.expiration_interval) 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: self._run(expiration_interval) 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: s = self.context.wrap_socket( 2024-09-20T22:15:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T22:15:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: return self.sslsocket_class._create( 2024-09-20T22:15:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T22:15:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: self.do_handshake() 2024-09-20T22:15:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T22:15:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: self._sslobj.do_handshake() 2024-09-20T22:15:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T22:15:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:28 smithi049 bash[23528]: cluster 2024-09-20T22:15:27.893231+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: cluster 2024-09-20T22:15:27.832938+0000 mgr.a (mgr.14388) 21 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.353593+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.357860+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: cluster 2024-09-20T22:15:28.370676+0000 mon.a (mon.0) 734 : cluster [DBG] mgrmap e20: a(active, since 4s), standbys: b 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.376711+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: cephadm 2024-09-20T22:15:28.377337+0000 mgr.a (mgr.14388) 22 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.428803+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]: dispatch 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.832618+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: cluster 2024-09-20T22:15:28.896912+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.903869+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:29.435 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.947330+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:28.967678+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:29.073173+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:29.086935+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:29.206263+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:29.219637+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:29 smithi044 bash[22676]: audit 2024-09-20T22:15:29.314911+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: cluster 2024-09-20T22:15:27.832938+0000 mgr.a (mgr.14388) 21 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:29.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.353593+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:29.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.357860+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:29.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: cluster 2024-09-20T22:15:28.370676+0000 mon.a (mon.0) 734 : cluster [DBG] mgrmap e20: a(active, since 4s), standbys: b 2024-09-20T22:15:29.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.376711+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: cephadm 2024-09-20T22:15:28.377337+0000 mgr.a (mgr.14388) 22 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.428803+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]: dispatch 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.832618+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: cluster 2024-09-20T22:15:28.896912+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.903869+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.947330+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:28.967678+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:29.073173+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:29.086935+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:29.206263+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:29.219637+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:29 smithi179 bash[23186]: audit 2024-09-20T22:15:29.314911+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: cluster 2024-09-20T22:15:27.832938+0000 mgr.a (mgr.14388) 21 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-20T22:15:29.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.353593+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:29.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.357860+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: cluster 2024-09-20T22:15:28.370676+0000 mon.a (mon.0) 734 : cluster [DBG] mgrmap e20: a(active, since 4s), standbys: b 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.376711+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: cephadm 2024-09-20T22:15:28.377337+0000 mgr.a (mgr.14388) 22 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.428803+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi044", "caps": []}]: dispatch 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.832618+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: cluster 2024-09-20T22:15:28.896912+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.903869+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.947330+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:28.967678+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:29.073173+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:29.086935+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:29.206263+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:29.219637+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:29 smithi049 bash[23528]: audit 2024-09-20T22:15:29.314911+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:30.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:30 smithi049 bash[23528]: audit 2024-09-20T22:15:29.435270+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:30.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:30 smithi049 bash[23528]: audit 2024-09-20T22:15:29.895965+0000 mon.a (mon.0) 748 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-20T22:15:30.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:30 smithi049 bash[23528]: cluster 2024-09-20T22:15:29.899395+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-20T22:15:30.553 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:30 smithi044 bash[22676]: audit 2024-09-20T22:15:29.435270+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:30.553 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:30 smithi044 bash[22676]: audit 2024-09-20T22:15:29.895965+0000 mon.a (mon.0) 748 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-20T22:15:30.553 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:30 smithi044 bash[22676]: cluster 2024-09-20T22:15:29.899395+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-20T22:15:30.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:30 smithi179 bash[23186]: audit 2024-09-20T22:15:29.435270+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:30.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:30 smithi179 bash[23186]: audit 2024-09-20T22:15:29.895965+0000 mon.a (mon.0) 748 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-20T22:15:30.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:30 smithi179 bash[23186]: cluster 2024-09-20T22:15:29.899395+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-20T22:15:31.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:31 smithi049 bash[23528]: cluster 2024-09-20T22:15:29.833403+0000 mgr.a (mgr.14388) 23 : cluster [DBG] pgmap v10: 65 pgs: 23 creating+peering, 19 active+clean, 23 unknown; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 2.5 KiB/s wr, 37 op/s 2024-09-20T22:15:31.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:31 smithi049 bash[23528]: cluster 2024-09-20T22:15:30.433525+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-20T22:15:31.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:31 smithi049 bash[23528]: cluster 2024-09-20T22:15:30.904918+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-20T22:15:31.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:31 smithi049 bash[23528]: audit 2024-09-20T22:15:30.908150+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:31.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:31 smithi049 bash[23528]: audit 2024-09-20T22:15:31.033464+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:31.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:31 smithi049 bash[23528]: audit 2024-09-20T22:15:31.091651+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:31.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:31 smithi044 bash[22676]: cluster 2024-09-20T22:15:29.833403+0000 mgr.a (mgr.14388) 23 : cluster [DBG] pgmap v10: 65 pgs: 23 creating+peering, 19 active+clean, 23 unknown; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 2.5 KiB/s wr, 37 op/s 2024-09-20T22:15:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:31 smithi044 bash[22676]: cluster 2024-09-20T22:15:30.433525+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-20T22:15:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:31 smithi044 bash[22676]: cluster 2024-09-20T22:15:30.904918+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-20T22:15:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:31 smithi044 bash[22676]: audit 2024-09-20T22:15:30.908150+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:31 smithi044 bash[22676]: audit 2024-09-20T22:15:31.033464+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:31 smithi044 bash[22676]: audit 2024-09-20T22:15:31.091651+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:31.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:31 smithi179 bash[23186]: cluster 2024-09-20T22:15:29.833403+0000 mgr.a (mgr.14388) 23 : cluster [DBG] pgmap v10: 65 pgs: 23 creating+peering, 19 active+clean, 23 unknown; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 2.5 KiB/s wr, 37 op/s 2024-09-20T22:15:31.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:31 smithi179 bash[23186]: cluster 2024-09-20T22:15:30.433525+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-20T22:15:31.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:31 smithi179 bash[23186]: cluster 2024-09-20T22:15:30.904918+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-20T22:15:31.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:31 smithi179 bash[23186]: audit 2024-09-20T22:15:30.908150+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:31.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:31 smithi179 bash[23186]: audit 2024-09-20T22:15:31.033464+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:31.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:31 smithi179 bash[23186]: audit 2024-09-20T22:15:31.091651+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:32 smithi044 bash[22676]: audit 2024-09-20T22:15:31.532712+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:32 smithi044 bash[22676]: audit 2024-09-20T22:15:31.662301+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:32 smithi044 bash[22676]: audit 2024-09-20T22:15:31.872183+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:32 smithi044 bash[22676]: audit 2024-09-20T22:15:31.880309+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:32 smithi044 bash[22676]: audit 2024-09-20T22:15:31.900050+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:32 smithi044 bash[22676]: audit 2024-09-20T22:15:31.903868+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-20T22:15:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:32 smithi044 bash[22676]: cluster 2024-09-20T22:15:31.909734+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-20T22:15:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:32 smithi179 bash[23186]: audit 2024-09-20T22:15:31.532712+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:32 smithi179 bash[23186]: audit 2024-09-20T22:15:31.662301+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:32 smithi179 bash[23186]: audit 2024-09-20T22:15:31.872183+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:32 smithi179 bash[23186]: audit 2024-09-20T22:15:31.880309+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:32 smithi179 bash[23186]: audit 2024-09-20T22:15:31.900050+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:32 smithi179 bash[23186]: audit 2024-09-20T22:15:31.903868+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-20T22:15:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:32 smithi179 bash[23186]: cluster 2024-09-20T22:15:31.909734+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-20T22:15:32.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:32 smithi049 bash[23528]: audit 2024-09-20T22:15:31.532712+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:32 smithi049 bash[23528]: audit 2024-09-20T22:15:31.662301+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:32 smithi049 bash[23528]: audit 2024-09-20T22:15:31.872183+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:32 smithi049 bash[23528]: audit 2024-09-20T22:15:31.880309+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:32 smithi049 bash[23528]: audit 2024-09-20T22:15:31.900050+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:32.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:32 smithi049 bash[23528]: audit 2024-09-20T22:15:31.903868+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-20T22:15:32.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:32 smithi049 bash[23528]: cluster 2024-09-20T22:15:31.909734+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: cluster 2024-09-20T22:15:31.833739+0000 mgr.a (mgr.14388) 24 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: cluster 2024-09-20T22:15:32.914205+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: audit 2024-09-20T22:15:32.915837+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: audit 2024-09-20T22:15:32.936895+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: audit 2024-09-20T22:15:33.129729+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: audit 2024-09-20T22:15:33.147572+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: audit 2024-09-20T22:15:33.570731+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: audit 2024-09-20T22:15:33.577169+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.925 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:33 smithi049 bash[23528]: audit 2024-09-20T22:15:33.585285+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: cluster 2024-09-20T22:15:31.833739+0000 mgr.a (mgr.14388) 24 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-20T22:15:33.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: cluster 2024-09-20T22:15:32.914205+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-20T22:15:33.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: audit 2024-09-20T22:15:32.915837+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:33.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: audit 2024-09-20T22:15:32.936895+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: audit 2024-09-20T22:15:33.129729+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: audit 2024-09-20T22:15:33.147572+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: audit 2024-09-20T22:15:33.570731+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.929 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: audit 2024-09-20T22:15:33.577169+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.929 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:33 smithi179 bash[23186]: audit 2024-09-20T22:15:33.585285+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: cluster 2024-09-20T22:15:31.833739+0000 mgr.a (mgr.14388) 24 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-20T22:15:33.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: cluster 2024-09-20T22:15:32.914205+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-20T22:15:33.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: audit 2024-09-20T22:15:32.915837+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:33.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: audit 2024-09-20T22:15:32.936895+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: audit 2024-09-20T22:15:33.129729+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: audit 2024-09-20T22:15:33.147572+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: audit 2024-09-20T22:15:33.570731+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: audit 2024-09-20T22:15:33.577169+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:33.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:33 smithi044 bash[22676]: audit 2024-09-20T22:15:33.585285+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:34 smithi044 bash[22676]: audit 2024-09-20T22:15:33.675963+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:34 smithi044 bash[22676]: audit 2024-09-20T22:15:33.684405+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:34 smithi044 bash[22676]: audit 2024-09-20T22:15:33.693035+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:34 smithi044 bash[22676]: audit 2024-09-20T22:15:33.909305+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:34 smithi044 bash[22676]: cluster 2024-09-20T22:15:33.912362+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-20T22:15:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:34 smithi044 bash[22676]: audit 2024-09-20T22:15:33.916341+0000 mon.a (mon.0) 775 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:35.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:34 smithi179 bash[23186]: audit 2024-09-20T22:15:33.675963+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:35.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:34 smithi179 bash[23186]: audit 2024-09-20T22:15:33.684405+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:35.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:34 smithi179 bash[23186]: audit 2024-09-20T22:15:33.693035+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:35.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:34 smithi179 bash[23186]: audit 2024-09-20T22:15:33.909305+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:35.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:34 smithi179 bash[23186]: cluster 2024-09-20T22:15:33.912362+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-20T22:15:35.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:34 smithi179 bash[23186]: audit 2024-09-20T22:15:33.916341+0000 mon.a (mon.0) 775 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:34 smithi049 bash[23528]: audit 2024-09-20T22:15:33.675963+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:34 smithi049 bash[23528]: audit 2024-09-20T22:15:33.684405+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:34 smithi049 bash[23528]: audit 2024-09-20T22:15:33.693035+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:34 smithi049 bash[23528]: audit 2024-09-20T22:15:33.909305+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:34 smithi049 bash[23528]: cluster 2024-09-20T22:15:33.912362+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-20T22:15:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:34 smithi049 bash[23528]: audit 2024-09-20T22:15:33.916341+0000 mon.a (mon.0) 775 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:35.773 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:35 smithi044 bash[22676]: cluster 2024-09-20T22:15:33.834252+0000 mgr.a (mgr.14388) 25 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-20T22:15:35.773 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:35 smithi044 bash[22676]: audit 2024-09-20T22:15:34.911960+0000 mon.a (mon.0) 776 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:35.773 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:35 smithi044 bash[22676]: cluster 2024-09-20T22:15:34.919085+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-20T22:15:35.774 INFO:teuthology.orchestra.run.smithi044.stdout:Realm(s) created correctly. Please, use 'ceph rgw realm tokens' to get the token. 2024-09-20T22:15:35.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:35 smithi179 bash[23186]: cluster 2024-09-20T22:15:33.834252+0000 mgr.a (mgr.14388) 25 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-20T22:15:36.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:35 smithi179 bash[23186]: audit 2024-09-20T22:15:34.911960+0000 mon.a (mon.0) 776 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:36.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:35 smithi179 bash[23186]: cluster 2024-09-20T22:15:34.919085+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-20T22:15:36.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:35 smithi049 bash[23528]: cluster 2024-09-20T22:15:33.834252+0000 mgr.a (mgr.14388) 25 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-20T22:15:36.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:35 smithi049 bash[23528]: audit 2024-09-20T22:15:34.911960+0000 mon.a (mon.0) 776 : audit [INF] from='client.? 172.21.15.44:0/3162882712' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:36.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:35 smithi049 bash[23528]: cluster 2024-09-20T22:15:34.919085+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-20T22:15:36.546 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T22:15:36.555 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi044.front.sepia.ceph.com 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9e2ac70bb7aea67d34f0d50002344abbe7803736 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68d7421e-779c-11ef-baf5-efdc52797490 -- bash -c 'set -e 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> set -x 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> while true; do TOKEN=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"'); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> TOKENS=$(ceph rgw realm tokens) 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> echo $TOKENS | jq --exit-status '"'"'.[0].realm == "myrealm1"'"'"' 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> echo $TOKENS | jq --exit-status '"'"'.[0].token'"'"' 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> TOKEN_JSON=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"' | base64 --decode) 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_name == "myrealm1"'"'"' 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> echo $TOKEN_JSON | jq --exit-status '"'"'.endpoint | test("http://.+:\\d+")'"'"' 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'"'"' 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> echo $TOKEN_JSON | jq --exit-status '"'"'.access_key'"'"' 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> echo $TOKEN_JSON | jq --exit-status '"'"'.secret'"'"' 2024-09-20T22:15:36.556 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-20T22:15:36.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: cephadm 2024-09-20T22:15:35.770967+0000 mgr.a (mgr.14388) 26 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-20T22:15:36.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.775375+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:36.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.776626+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:36.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.779576+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:36.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.780493+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:36.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.786088+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:36.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.894482+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.898223+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.900740+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.903160+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.905814+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.906549+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.911004+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.913937+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi049.ahpqvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.915771+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi049.ahpqvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.921694+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:36.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:36 smithi044 bash[22676]: audit 2024-09-20T22:15:35.923178+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:37.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: cephadm 2024-09-20T22:15:35.770967+0000 mgr.a (mgr.14388) 26 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-20T22:15:37.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.775375+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.776626+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:37.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.779576+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:37.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.780493+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.786088+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.894482+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.898223+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.900740+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.903160+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.905814+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.906549+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.911004+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.913937+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi049.ahpqvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T22:15:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.915771+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi049.ahpqvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.921694+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:36 smithi049 bash[23528]: audit 2024-09-20T22:15:35.923178+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: cephadm 2024-09-20T22:15:35.770967+0000 mgr.a (mgr.14388) 26 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.775375+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.776626+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.779576+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.780493+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.786088+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.894482+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.898223+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.900740+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.903160+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.905814+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.906549+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.911004+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.913937+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi049.ahpqvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.915771+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi049.ahpqvq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.921694+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:37.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:36 smithi179 bash[23186]: audit 2024-09-20T22:15:35.923178+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:38.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: cephadm 2024-09-20T22:15:35.788908+0000 mgr.a (mgr.14388) 27 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:38.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: cluster 2024-09-20T22:15:35.834762+0000 mgr.a (mgr.14388) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-09-20T22:15:38.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: cephadm 2024-09-20T22:15:35.924064+0000 mgr.a (mgr.14388) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi049.ahpqvq on smithi049 2024-09-20T22:15:38.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: cluster 2024-09-20T22:15:36.783822+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-20T22:15:38.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: cluster 2024-09-20T22:15:36.783842+0000 mon.a (mon.0) 795 : cluster [INF] Cluster is now healthy 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:36.907503+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:36.913122+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:36.918285+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:37.000437+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:37.008277+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:37.020347+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:37.028555+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:37.037884+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:37 smithi049 bash[23528]: audit 2024-09-20T22:15:37.049061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: cephadm 2024-09-20T22:15:35.788908+0000 mgr.a (mgr.14388) 27 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: cluster 2024-09-20T22:15:35.834762+0000 mgr.a (mgr.14388) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-09-20T22:15:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: cephadm 2024-09-20T22:15:35.924064+0000 mgr.a (mgr.14388) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi049.ahpqvq on smithi049 2024-09-20T22:15:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: cluster 2024-09-20T22:15:36.783822+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-20T22:15:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: cluster 2024-09-20T22:15:36.783842+0000 mon.a (mon.0) 795 : cluster [INF] Cluster is now healthy 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:36.907503+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:36.913122+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:36.918285+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:37.000437+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:37.008277+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:37.020347+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:37.028555+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:37.037884+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:37 smithi044 bash[22676]: audit 2024-09-20T22:15:37.049061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: cephadm 2024-09-20T22:15:35.788908+0000 mgr.a (mgr.14388) 27 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: cluster 2024-09-20T22:15:35.834762+0000 mgr.a (mgr.14388) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: cephadm 2024-09-20T22:15:35.924064+0000 mgr.a (mgr.14388) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi049.ahpqvq on smithi049 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: cluster 2024-09-20T22:15:36.783822+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: cluster 2024-09-20T22:15:36.783842+0000 mon.a (mon.0) 795 : cluster [INF] Cluster is now healthy 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:36.907503+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:36.913122+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:36.918285+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:37.000437+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:37.008277+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:37.020347+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:37.028555+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:37.037884+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:37 smithi179 bash[23186]: audit 2024-09-20T22:15:37.049061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:38.923 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:38 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:38.924 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:38 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:38.924 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 20 22:15:38 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:39.268 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:39.269 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 20 22:15:39 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:39.269 INFO:journalctl@ceph.mgr.b.smithi049.stdout:Sep 20 22:15:39 smithi049 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: cluster 2024-09-20T22:15:37.835416+0000 mgr.a (mgr.14388) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 172 B/s rd, 345 B/s wr, 1 op/s 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: audit 2024-09-20T22:15:39.213792+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: audit 2024-09-20T22:15:39.222223+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: audit 2024-09-20T22:15:39.230161+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: audit 2024-09-20T22:15:39.231615+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi179.qzbgld", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: audit 2024-09-20T22:15:39.234550+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi179.qzbgld", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: audit 2024-09-20T22:15:39.246332+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:39 smithi049 bash[23528]: audit 2024-09-20T22:15:39.250060+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: cluster 2024-09-20T22:15:37.835416+0000 mgr.a (mgr.14388) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 172 B/s rd, 345 B/s wr, 1 op/s 2024-09-20T22:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: audit 2024-09-20T22:15:39.213792+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: audit 2024-09-20T22:15:39.222223+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: audit 2024-09-20T22:15:39.230161+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: audit 2024-09-20T22:15:39.231615+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi179.qzbgld", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T22:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: audit 2024-09-20T22:15:39.234550+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi179.qzbgld", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T22:15:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: audit 2024-09-20T22:15:39.246332+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:39 smithi044 bash[22676]: audit 2024-09-20T22:15:39.250060+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: cluster 2024-09-20T22:15:37.835416+0000 mgr.a (mgr.14388) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 579 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 172 B/s rd, 345 B/s wr, 1 op/s 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: audit 2024-09-20T22:15:39.213792+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: audit 2024-09-20T22:15:39.222223+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: audit 2024-09-20T22:15:39.230161+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: audit 2024-09-20T22:15:39.231615+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi179.qzbgld", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: audit 2024-09-20T22:15:39.234550+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi179.qzbgld", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: audit 2024-09-20T22:15:39.246332+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:40.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:39 smithi179 bash[23186]: audit 2024-09-20T22:15:39.250060+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:40.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:40 smithi179 bash[23186]: cephadm 2024-09-20T22:15:39.251996+0000 mgr.a (mgr.14388) 31 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi179.qzbgld on smithi179 2024-09-20T22:15:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:40 smithi044 bash[22676]: cephadm 2024-09-20T22:15:39.251996+0000 mgr.a (mgr.14388) 31 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi179.qzbgld on smithi179 2024-09-20T22:15:41.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:40 smithi049 bash[23528]: cephadm 2024-09-20T22:15:39.251996+0000 mgr.a (mgr.14388) 31 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi179.qzbgld on smithi179 2024-09-20T22:15:41.304 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/68d7421e-779c-11ef-baf5-efdc52797490/mon.a/config 2024-09-20T22:15:41.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:41 smithi179 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:41.757 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 20 22:15:41 smithi179 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:42.121 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 20 22:15:41 smithi179 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:42.121 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:41 smithi179 bash[23186]: cluster 2024-09-20T22:15:39.836651+0000 mgr.a (mgr.14388) 32 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 581 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-20T22:15:42.121 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:41 smithi179 bash[23186]: cluster 2024-09-20T22:15:40.868848+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-20T22:15:42.121 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:41 smithi179 bash[23186]: audit 2024-09-20T22:15:40.875030+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:42.121 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:41 smithi179 bash[23186]: audit 2024-09-20T22:15:40.875311+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:42.121 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:41 smithi179 systemd[1]: /etc/systemd/system/ceph-68d7421e-779c-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-20T22:15:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:41 smithi044 bash[22676]: cluster 2024-09-20T22:15:39.836651+0000 mgr.a (mgr.14388) 32 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 581 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-20T22:15:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:41 smithi044 bash[22676]: cluster 2024-09-20T22:15:40.868848+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-20T22:15:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:41 smithi044 bash[22676]: audit 2024-09-20T22:15:40.875030+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:41 smithi044 bash[22676]: audit 2024-09-20T22:15:40.875311+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:42.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:41 smithi049 bash[23528]: cluster 2024-09-20T22:15:39.836651+0000 mgr.a (mgr.14388) 32 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 581 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-20T22:15:42.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:41 smithi049 bash[23528]: cluster 2024-09-20T22:15:40.868848+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-20T22:15:42.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:41 smithi049 bash[23528]: audit 2024-09-20T22:15:40.875030+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:42.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:41 smithi049 bash[23528]: audit 2024-09-20T22:15:40.875311+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-20T22:15:42.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:15:42.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:15:42.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:15:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: cluster 2024-09-20T22:15:41.837425+0000 mgr.a (mgr.14388) 33 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 583 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-09-20T22:15:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: audit 2024-09-20T22:15:41.867260+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-20T22:15:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: cluster 2024-09-20T22:15:41.874640+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-20T22:15:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: audit 2024-09-20T22:15:42.369900+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: audit 2024-09-20T22:15:42.377532+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: audit 2024-09-20T22:15:42.385299+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: audit 2024-09-20T22:15:42.386410+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: audit 2024-09-20T22:15:42.388726+0000 mgr.a (mgr.14388) 34 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:42 smithi044 bash[22676]: cluster 2024-09-20T22:15:42.821324+0000 mon.a (mon.0) 820 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-20T22:15:43.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: cluster 2024-09-20T22:15:41.837425+0000 mgr.a (mgr.14388) 33 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 583 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: audit 2024-09-20T22:15:41.867260+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: cluster 2024-09-20T22:15:41.874640+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: audit 2024-09-20T22:15:42.369900+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: audit 2024-09-20T22:15:42.377532+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: audit 2024-09-20T22:15:42.385299+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: audit 2024-09-20T22:15:42.386410+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: audit 2024-09-20T22:15:42.388726+0000 mgr.a (mgr.14388) 34 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:43.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:42 smithi179 bash[23186]: cluster 2024-09-20T22:15:42.821324+0000 mon.a (mon.0) 820 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-20T22:15:43.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: cluster 2024-09-20T22:15:41.837425+0000 mgr.a (mgr.14388) 33 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 583 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-09-20T22:15:43.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: audit 2024-09-20T22:15:41.867260+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-20T22:15:43.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: cluster 2024-09-20T22:15:41.874640+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-20T22:15:43.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: audit 2024-09-20T22:15:42.369900+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: audit 2024-09-20T22:15:42.377532+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: audit 2024-09-20T22:15:42.385299+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:43.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: audit 2024-09-20T22:15:42.386410+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: audit 2024-09-20T22:15:42.388726+0000 mgr.a (mgr.14388) 34 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:42 smithi049 bash[23528]: cluster 2024-09-20T22:15:42.821324+0000 mon.a (mon.0) 820 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-20T22:15:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:43 smithi044 bash[22676]: audit 2024-09-20T22:15:42.829766+0000 mgr.a (mgr.14388) 35 : audit [DBG] from='client.14709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:43 smithi044 bash[22676]: cluster 2024-09-20T22:15:42.871927+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-20T22:15:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:43 smithi044 bash[22676]: audit 2024-09-20T22:15:42.880203+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:43 smithi044 bash[22676]: audit 2024-09-20T22:15:42.884875+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:44.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:43 smithi179 bash[23186]: audit 2024-09-20T22:15:42.829766+0000 mgr.a (mgr.14388) 35 : audit [DBG] from='client.14709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:44.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:43 smithi179 bash[23186]: cluster 2024-09-20T22:15:42.871927+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-20T22:15:44.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:43 smithi179 bash[23186]: audit 2024-09-20T22:15:42.880203+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:44.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:43 smithi179 bash[23186]: audit 2024-09-20T22:15:42.884875+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:44.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:43 smithi049 bash[23528]: audit 2024-09-20T22:15:42.829766+0000 mgr.a (mgr.14388) 35 : audit [DBG] from='client.14709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:44.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:43 smithi049 bash[23528]: cluster 2024-09-20T22:15:42.871927+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-20T22:15:44.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:43 smithi049 bash[23528]: audit 2024-09-20T22:15:42.880203+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:44.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:43 smithi049 bash[23528]: audit 2024-09-20T22:15:42.884875+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-20T22:15:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:44 smithi044 bash[22676]: audit 2024-09-20T22:15:43.887153+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-20T22:15:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:44 smithi044 bash[22676]: cluster 2024-09-20T22:15:43.894263+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-20T22:15:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:44 smithi179 bash[23186]: audit 2024-09-20T22:15:43.887153+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-20T22:15:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:44 smithi179 bash[23186]: cluster 2024-09-20T22:15:43.894263+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-20T22:15:45.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:44 smithi049 bash[23528]: audit 2024-09-20T22:15:43.887153+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-20T22:15:45.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:44 smithi049 bash[23528]: cluster 2024-09-20T22:15:43.894263+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: cluster 2024-09-20T22:15:43.838445+0000 mgr.a (mgr.14388) 36 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 583 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 3.8 KiB/s wr, 17 op/s 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: cluster 2024-09-20T22:15:44.963420+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: audit 2024-09-20T22:15:44.966424+0000 mon.a (mon.0) 826 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: audit 2024-09-20T22:15:44.967924+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.179:0/4230716999' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: audit 2024-09-20T22:15:44.969396+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: audit 2024-09-20T22:15:44.975015+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: audit 2024-09-20T22:15:44.975581+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: audit 2024-09-20T22:15:45.957940+0000 mon.a (mon.0) 829 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:45 smithi044 bash[22676]: audit 2024-09-20T22:15:45.958057+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: cluster 2024-09-20T22:15:43.838445+0000 mgr.a (mgr.14388) 36 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 583 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 3.8 KiB/s wr, 17 op/s 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: cluster 2024-09-20T22:15:44.963420+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: audit 2024-09-20T22:15:44.966424+0000 mon.a (mon.0) 826 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: audit 2024-09-20T22:15:44.967924+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.179:0/4230716999' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: audit 2024-09-20T22:15:44.969396+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: audit 2024-09-20T22:15:44.975015+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: audit 2024-09-20T22:15:44.975581+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: audit 2024-09-20T22:15:45.957940+0000 mon.a (mon.0) 829 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:46.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:45 smithi179 bash[23186]: audit 2024-09-20T22:15:45.958057+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:46.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: cluster 2024-09-20T22:15:43.838445+0000 mgr.a (mgr.14388) 36 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 583 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 3.8 KiB/s wr, 17 op/s 2024-09-20T22:15:46.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: cluster 2024-09-20T22:15:44.963420+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-20T22:15:46.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: audit 2024-09-20T22:15:44.966424+0000 mon.a (mon.0) 826 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: audit 2024-09-20T22:15:44.967924+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.179:0/4230716999' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: audit 2024-09-20T22:15:44.969396+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: audit 2024-09-20T22:15:44.975015+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: audit 2024-09-20T22:15:44.975581+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-20T22:15:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: audit 2024-09-20T22:15:45.957940+0000 mon.a (mon.0) 829 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:45 smithi049 bash[23528]: audit 2024-09-20T22:15:45.958057+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:47.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:47 smithi044 bash[22930]: debug 2024-09-20T22:15:47.056+0000 7f4bede1a640 -1 mgr.server reply reply (152) Unknown error 152 2024-09-20T22:15:47.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:47 smithi044 bash[22930]: debug 2024-09-20T22:15:47.068+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: 2024-09-20T22:15:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: cluster 2024-09-20T22:15:45.839334+0000 mgr.a (mgr.14388) 37 : cluster [DBG] pgmap v29: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 2.7 KiB/s wr, 25 op/s 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:45.958150+0000 mon.a (mon.0) 831 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: cluster 2024-09-20T22:15:45.966376+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:45.969994+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:45.970884+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:45.971302+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.179:0/4230716999' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:45.979739+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:45.980558+0000 mon.a (mon.0) 835 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:46.960613+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:46.960793+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: audit 2024-09-20T22:15:46.960938+0000 mon.a (mon.0) 838 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:46 smithi044 bash[22676]: cluster 2024-09-20T22:15:46.967354+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e40: 3 total, 3 up, 3 in 2024-09-20T22:15:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: cluster 2024-09-20T22:15:45.839334+0000 mgr.a (mgr.14388) 37 : cluster [DBG] pgmap v29: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 2.7 KiB/s wr, 25 op/s 2024-09-20T22:15:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:45.958150+0000 mon.a (mon.0) 831 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: cluster 2024-09-20T22:15:45.966376+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-20T22:15:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:45.969994+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:45.970884+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:45.971302+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.179:0/4230716999' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:45.979739+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:45.980558+0000 mon.a (mon.0) 835 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:46.960613+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:46.960793+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: audit 2024-09-20T22:15:46.960938+0000 mon.a (mon.0) 838 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:46 smithi179 bash[23186]: cluster 2024-09-20T22:15:46.967354+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e40: 3 total, 3 up, 3 in 2024-09-20T22:15:47.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: cluster 2024-09-20T22:15:45.839334+0000 mgr.a (mgr.14388) 37 : cluster [DBG] pgmap v29: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 2.7 KiB/s wr, 25 op/s 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:45.958150+0000 mon.a (mon.0) 831 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: cluster 2024-09-20T22:15:45.966376+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:45.969994+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:45.970884+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.49:0/3377190923' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:45.971302+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.179:0/4230716999' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:45.979739+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:45.980558+0000 mon.a (mon.0) 835 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:46.960613+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi049.ahpqvq' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:46.960793+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi179.qzbgld' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: audit 2024-09-20T22:15:46.960938+0000 mon.a (mon.0) 838 : audit [INF] from='client.? 172.21.15.44:0/3903869895' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-20T22:15:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:46 smithi049 bash[23528]: cluster 2024-09-20T22:15:46.967354+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e40: 3 total, 3 up, 3 in 2024-09-20T22:15:47.659 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:15:47.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:15:47.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:15:47.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:15:47.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:15:48.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: cephadm 2024-09-20T22:15:47.072846+0000 mgr.a (mgr.14388) 38 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: cluster 2024-09-20T22:15:47.074338+0000 mgr.a (mgr.14388) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 3.4 KiB/s wr, 32 op/s 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.081554+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.088446+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.094697+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: cephadm 2024-09-20T22:15:47.096750+0000 mgr.a (mgr.14388) 40 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.100835+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.107557+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.167542+0000 mon.a (mon.0) 845 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.172580+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.173803+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: cephadm 2024-09-20T22:15:47.184069+0000 mgr.a (mgr.14388) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-20T22:15:48.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.748423+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.755980+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.763409+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: cephadm 2024-09-20T22:15:47.763865+0000 mgr.a (mgr.14388) 42 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.829175+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.831891+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: audit 2024-09-20T22:15:47.832974+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: cluster 2024-09-20T22:15:47.983548+0000 mon.a (mon.0) 854 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-20T22:15:48.423 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:48 smithi049 bash[23528]: cluster 2024-09-20T22:15:47.983591+0000 mon.a (mon.0) 855 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-20T22:15:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: cephadm 2024-09-20T22:15:47.072846+0000 mgr.a (mgr.14388) 38 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-20T22:15:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: cluster 2024-09-20T22:15:47.074338+0000 mgr.a (mgr.14388) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 3.4 KiB/s wr, 32 op/s 2024-09-20T22:15:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.081554+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.088446+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.094697+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: cephadm 2024-09-20T22:15:47.096750+0000 mgr.a (mgr.14388) 40 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.100835+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.107557+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.167542+0000 mon.a (mon.0) 845 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.172580+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.173803+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: cephadm 2024-09-20T22:15:47.184069+0000 mgr.a (mgr.14388) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.748423+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.755980+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.763409+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: cephadm 2024-09-20T22:15:47.763865+0000 mgr.a (mgr.14388) 42 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.829175+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.831891+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: audit 2024-09-20T22:15:47.832974+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: cluster 2024-09-20T22:15:47.983548+0000 mon.a (mon.0) 854 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-20T22:15:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:48 smithi044 bash[22676]: cluster 2024-09-20T22:15:47.983591+0000 mon.a (mon.0) 855 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: cephadm 2024-09-20T22:15:47.072846+0000 mgr.a (mgr.14388) 38 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: cluster 2024-09-20T22:15:47.074338+0000 mgr.a (mgr.14388) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 3.4 KiB/s wr, 32 op/s 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.081554+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.088446+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.094697+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: cephadm 2024-09-20T22:15:47.096750+0000 mgr.a (mgr.14388) 40 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.100835+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.107557+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.167542+0000 mon.a (mon.0) 845 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.172580+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.173803+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: cephadm 2024-09-20T22:15:47.184069+0000 mgr.a (mgr.14388) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.748423+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.755980+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.763409+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: cephadm 2024-09-20T22:15:47.763865+0000 mgr.a (mgr.14388) 42 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.829175+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.831891+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: audit 2024-09-20T22:15:47.832974+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: cluster 2024-09-20T22:15:47.983548+0000 mon.a (mon.0) 854 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-20T22:15:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:48 smithi179 bash[23186]: cluster 2024-09-20T22:15:47.983591+0000 mon.a (mon.0) 855 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-20T22:15:49.376 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:49 smithi179 bash[23186]: cephadm 2024-09-20T22:15:47.838619+0000 mgr.a (mgr.14388) 43 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-20T22:15:49.376 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:49 smithi179 bash[23186]: audit 2024-09-20T22:15:48.118135+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:49.376 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:49 smithi179 bash[23186]: cephadm 2024-09-20T22:15:48.118577+0000 mgr.a (mgr.14388) 44 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:49.376 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:49 smithi179 bash[23186]: audit 2024-09-20T22:15:48.932280+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:49 smithi044 bash[22676]: cephadm 2024-09-20T22:15:47.838619+0000 mgr.a (mgr.14388) 43 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-20T22:15:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:49 smithi044 bash[22676]: audit 2024-09-20T22:15:48.118135+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:49 smithi044 bash[22676]: cephadm 2024-09-20T22:15:48.118577+0000 mgr.a (mgr.14388) 44 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:49 smithi044 bash[22676]: audit 2024-09-20T22:15:48.932280+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:49.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:49 smithi049 bash[23528]: cephadm 2024-09-20T22:15:47.838619+0000 mgr.a (mgr.14388) 43 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-20T22:15:49.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:49 smithi049 bash[23528]: audit 2024-09-20T22:15:48.118135+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:49.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:49 smithi049 bash[23528]: cephadm 2024-09-20T22:15:48.118577+0000 mgr.a (mgr.14388) 44 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-20T22:15:49.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:49 smithi049 bash[23528]: audit 2024-09-20T22:15:48.932280+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:50.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:50 smithi049 bash[23528]: cluster 2024-09-20T22:15:49.075328+0000 mgr.a (mgr.14388) 45 : cluster [DBG] pgmap v33: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 2.1 KiB/s wr, 20 op/s 2024-09-20T22:15:50.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:50 smithi044 bash[22676]: cluster 2024-09-20T22:15:49.075328+0000 mgr.a (mgr.14388) 45 : cluster [DBG] pgmap v33: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 2.1 KiB/s wr, 20 op/s 2024-09-20T22:15:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:50 smithi179 bash[23186]: cluster 2024-09-20T22:15:49.075328+0000 mgr.a (mgr.14388) 45 : cluster [DBG] pgmap v33: 225 pgs: 32 unknown, 193 active+clean; 585 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 2.1 KiB/s wr, 20 op/s 2024-09-20T22:15:52.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:52 smithi049 bash[23528]: cluster 2024-09-20T22:15:51.077520+0000 mgr.a (mgr.14388) 46 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 154 KiB/s rd, 6.0 KiB/s wr, 296 op/s 2024-09-20T22:15:52.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:52 smithi044 bash[22676]: cluster 2024-09-20T22:15:51.077520+0000 mgr.a (mgr.14388) 46 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 154 KiB/s rd, 6.0 KiB/s wr, 296 op/s 2024-09-20T22:15:52.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:52 smithi179 bash[23186]: cluster 2024-09-20T22:15:51.077520+0000 mgr.a (mgr.14388) 46 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 154 KiB/s rd, 6.0 KiB/s wr, 296 op/s 2024-09-20T22:15:52.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:15:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:15:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:15:53.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:15:53.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:15:53.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:15:53.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:15:53.439 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:15:53.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:53 smithi044 bash[22676]: audit 2024-09-20T22:15:52.190764+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:53.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:53 smithi044 bash[22676]: audit 2024-09-20T22:15:52.806313+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:53.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:53 smithi179 bash[23186]: audit 2024-09-20T22:15:52.190764+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:53.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:53 smithi179 bash[23186]: audit 2024-09-20T22:15:52.806313+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:53.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:53 smithi049 bash[23528]: audit 2024-09-20T22:15:52.190764+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:53.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:53 smithi049 bash[23528]: audit 2024-09-20T22:15:52.806313+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:54 smithi044 bash[22676]: audit 2024-09-20T22:15:53.003137+0000 mgr.a (mgr.14388) 47 : audit [DBG] from='client.14964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:54 smithi044 bash[22676]: cluster 2024-09-20T22:15:53.078127+0000 mgr.a (mgr.14388) 48 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 131 KiB/s rd, 5.1 KiB/s wr, 250 op/s 2024-09-20T22:15:54.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:54 smithi179 bash[23186]: audit 2024-09-20T22:15:53.003137+0000 mgr.a (mgr.14388) 47 : audit [DBG] from='client.14964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:54.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:54 smithi179 bash[23186]: cluster 2024-09-20T22:15:53.078127+0000 mgr.a (mgr.14388) 48 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 131 KiB/s rd, 5.1 KiB/s wr, 250 op/s 2024-09-20T22:15:54.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:54 smithi049 bash[23528]: audit 2024-09-20T22:15:53.003137+0000 mgr.a (mgr.14388) 47 : audit [DBG] from='client.14964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:54.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:54 smithi049 bash[23528]: cluster 2024-09-20T22:15:53.078127+0000 mgr.a (mgr.14388) 48 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 131 KiB/s rd, 5.1 KiB/s wr, 250 op/s 2024-09-20T22:15:56.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: cluster 2024-09-20T22:15:55.079319+0000 mgr.a (mgr.14388) 49 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 105 KiB/s rd, 4.1 KiB/s wr, 200 op/s 2024-09-20T22:15:56.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.107643+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.113302+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.119704+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.610340+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.617862+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.621699+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:56.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.627200+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.627793+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:56.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.629553+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:56.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.637459+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.640532+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:56.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22676]: audit 2024-09-20T22:15:55.641549+0000 mgr.a (mgr.14388) 50 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:56.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: cluster 2024-09-20T22:15:55.079319+0000 mgr.a (mgr.14388) 49 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 105 KiB/s rd, 4.1 KiB/s wr, 200 op/s 2024-09-20T22:15:56.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.107643+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.113302+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.119704+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.610340+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.617862+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.621699+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.627200+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.627793+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.629553+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.637459+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.640532+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:56 smithi179 bash[23186]: audit 2024-09-20T22:15:55.641549+0000 mgr.a (mgr.14388) 50 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: cluster 2024-09-20T22:15:55.079319+0000 mgr.a (mgr.14388) 49 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 105 KiB/s rd, 4.1 KiB/s wr, 200 op/s 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.107643+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.113302+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.119704+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.610340+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.617862+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.621699+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.627200+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.627793+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:15:56.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.629553+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:15:56.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.637459+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:56.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.640532+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:56.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:56 smithi049 bash[23528]: audit 2024-09-20T22:15:55.641549+0000 mgr.a (mgr.14388) 50 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:15:56.735 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22930]: debug 2024-09-20T22:15:56.388+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:15:56.735 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:15:56 smithi044 bash[22930]: debug 2024-09-20T22:15:56.392+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:15:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:57 smithi044 bash[22676]: audit 2024-09-20T22:15:56.392062+0000 mgr.a (mgr.14388) 51 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:15:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:57 smithi044 bash[22676]: cephadm 2024-09-20T22:15:56.393349+0000 mgr.a (mgr.14388) 52 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:15:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:57 smithi044 bash[22676]: cluster 2024-09-20T22:15:56.393824+0000 mgr.a (mgr.14388) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 101 KiB/s rd, 3.9 KiB/s wr, 193 op/s 2024-09-20T22:15:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:57 smithi044 bash[22676]: audit 2024-09-20T22:15:57.055712+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:57 smithi044 bash[22676]: audit 2024-09-20T22:15:57.062067+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:57 smithi044 bash[22676]: audit 2024-09-20T22:15:57.070320+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:57 smithi179 bash[23186]: audit 2024-09-20T22:15:56.392062+0000 mgr.a (mgr.14388) 51 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:15:57.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:57 smithi179 bash[23186]: cephadm 2024-09-20T22:15:56.393349+0000 mgr.a (mgr.14388) 52 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:15:57.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:57 smithi179 bash[23186]: cluster 2024-09-20T22:15:56.393824+0000 mgr.a (mgr.14388) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 101 KiB/s rd, 3.9 KiB/s wr, 193 op/s 2024-09-20T22:15:57.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:57 smithi179 bash[23186]: audit 2024-09-20T22:15:57.055712+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:57 smithi179 bash[23186]: audit 2024-09-20T22:15:57.062067+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:57 smithi179 bash[23186]: audit 2024-09-20T22:15:57.070320+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:57 smithi049 bash[23528]: audit 2024-09-20T22:15:56.392062+0000 mgr.a (mgr.14388) 51 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:15:57.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:57 smithi049 bash[23528]: cephadm 2024-09-20T22:15:56.393349+0000 mgr.a (mgr.14388) 52 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:15:57.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:57 smithi049 bash[23528]: cluster 2024-09-20T22:15:56.393824+0000 mgr.a (mgr.14388) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 101 KiB/s rd, 3.9 KiB/s wr, 193 op/s 2024-09-20T22:15:57.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:57 smithi049 bash[23528]: audit 2024-09-20T22:15:57.055712+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:57 smithi049 bash[23528]: audit 2024-09-20T22:15:57.062067+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:57.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:57 smithi049 bash[23528]: audit 2024-09-20T22:15:57.070320+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:58.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:15:58.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:15:58.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:15:59.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:15:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:15:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:15:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:15:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:15:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:59 smithi044 bash[22676]: cluster 2024-09-20T22:15:58.394553+0000 mgr.a (mgr.14388) 54 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 84 KiB/s rd, 3.3 KiB/s wr, 161 op/s 2024-09-20T22:15:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:59 smithi044 bash[22676]: audit 2024-09-20T22:15:58.781547+0000 mgr.a (mgr.14388) 55 : audit [DBG] from='client.15147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:15:59 smithi044 bash[22676]: audit 2024-09-20T22:15:58.943087+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:59.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:59 smithi179 bash[23186]: cluster 2024-09-20T22:15:58.394553+0000 mgr.a (mgr.14388) 54 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 84 KiB/s rd, 3.3 KiB/s wr, 161 op/s 2024-09-20T22:15:59.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:59 smithi179 bash[23186]: audit 2024-09-20T22:15:58.781547+0000 mgr.a (mgr.14388) 55 : audit [DBG] from='client.15147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:59.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:15:59 smithi179 bash[23186]: audit 2024-09-20T22:15:58.943087+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:15:59.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:59 smithi049 bash[23528]: cluster 2024-09-20T22:15:58.394553+0000 mgr.a (mgr.14388) 54 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 84 KiB/s rd, 3.3 KiB/s wr, 161 op/s 2024-09-20T22:15:59.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:59 smithi049 bash[23528]: audit 2024-09-20T22:15:58.781547+0000 mgr.a (mgr.14388) 55 : audit [DBG] from='client.15147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:15:59.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:15:59 smithi049 bash[23528]: audit 2024-09-20T22:15:58.943087+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:01.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:01 smithi044 bash[22676]: cluster 2024-09-20T22:16:00.396815+0000 mgr.a (mgr.14388) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 3.7 KiB/s wr, 167 op/s 2024-09-20T22:16:01.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:01 smithi179 bash[23186]: cluster 2024-09-20T22:16:00.396815+0000 mgr.a (mgr.14388) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 3.7 KiB/s wr, 167 op/s 2024-09-20T22:16:01.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:01 smithi049 bash[23528]: cluster 2024-09-20T22:16:00.396815+0000 mgr.a (mgr.14388) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 3.7 KiB/s wr, 167 op/s 2024-09-20T22:16:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:03 smithi044 bash[22676]: cluster 2024-09-20T22:16:02.397682+0000 mgr.a (mgr.14388) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 452 B/s wr, 7 op/s 2024-09-20T22:16:03.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:03 smithi179 bash[23186]: cluster 2024-09-20T22:16:02.397682+0000 mgr.a (mgr.14388) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 452 B/s wr, 7 op/s 2024-09-20T22:16:03.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:03 smithi049 bash[23528]: cluster 2024-09-20T22:16:02.397682+0000 mgr.a (mgr.14388) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 452 B/s wr, 7 op/s 2024-09-20T22:16:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:04.963 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:04.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:04.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:04.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:04.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:05.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:05 smithi044 bash[22676]: cluster 2024-09-20T22:16:04.398471+0000 mgr.a (mgr.14388) 58 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 452 B/s wr, 7 op/s 2024-09-20T22:16:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:05 smithi044 bash[22676]: audit 2024-09-20T22:16:04.551852+0000 mgr.a (mgr.14388) 59 : audit [DBG] from='client.15225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:05.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:05 smithi179 bash[23186]: cluster 2024-09-20T22:16:04.398471+0000 mgr.a (mgr.14388) 58 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 452 B/s wr, 7 op/s 2024-09-20T22:16:05.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:05 smithi179 bash[23186]: audit 2024-09-20T22:16:04.551852+0000 mgr.a (mgr.14388) 59 : audit [DBG] from='client.15225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:05 smithi049 bash[23528]: cluster 2024-09-20T22:16:04.398471+0000 mgr.a (mgr.14388) 58 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 452 B/s wr, 7 op/s 2024-09-20T22:16:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:05 smithi049 bash[23528]: audit 2024-09-20T22:16:04.551852+0000 mgr.a (mgr.14388) 59 : audit [DBG] from='client.15225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:07.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:07 smithi044 bash[22676]: cluster 2024-09-20T22:16:06.401059+0000 mgr.a (mgr.14388) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 452 B/s wr, 6 op/s 2024-09-20T22:16:07.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:07 smithi179 bash[23186]: cluster 2024-09-20T22:16:06.401059+0000 mgr.a (mgr.14388) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 452 B/s wr, 6 op/s 2024-09-20T22:16:07.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:07 smithi049 bash[23528]: cluster 2024-09-20T22:16:06.401059+0000 mgr.a (mgr.14388) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 452 B/s wr, 6 op/s 2024-09-20T22:16:09.731 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:09 smithi049 bash[23528]: cluster 2024-09-20T22:16:08.401879+0000 mgr.a (mgr.14388) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:16:09.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:09 smithi044 bash[22676]: cluster 2024-09-20T22:16:08.401879+0000 mgr.a (mgr.14388) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:16:09.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:09 smithi179 bash[23186]: cluster 2024-09-20T22:16:08.401879+0000 mgr.a (mgr.14388) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:16:09.964 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:09.965 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:09.965 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:10.738 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:11.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:11 smithi044 bash[22676]: audit 2024-09-20T22:16:10.306973+0000 mgr.a (mgr.14388) 62 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:11.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:11 smithi044 bash[22676]: cluster 2024-09-20T22:16:10.403110+0000 mgr.a (mgr.14388) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:16:11.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:11 smithi179 bash[23186]: audit 2024-09-20T22:16:10.306973+0000 mgr.a (mgr.14388) 62 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:11.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:11 smithi179 bash[23186]: cluster 2024-09-20T22:16:10.403110+0000 mgr.a (mgr.14388) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:16:11.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:11 smithi049 bash[23528]: audit 2024-09-20T22:16:10.306973+0000 mgr.a (mgr.14388) 62 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:11.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:11 smithi049 bash[23528]: cluster 2024-09-20T22:16:10.403110+0000 mgr.a (mgr.14388) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:16:13.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:13 smithi044 bash[22676]: cluster 2024-09-20T22:16:12.403952+0000 mgr.a (mgr.14388) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:13.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:13 smithi179 bash[23186]: cluster 2024-09-20T22:16:12.403952+0000 mgr.a (mgr.14388) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:13.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:13 smithi049 bash[23528]: cluster 2024-09-20T22:16:12.403952+0000 mgr.a (mgr.14388) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:15.998 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:15 smithi044 bash[22676]: cluster 2024-09-20T22:16:14.404607+0000 mgr.a (mgr.14388) 65 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:15.998 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:15 smithi044 bash[22676]: audit 2024-09-20T22:16:14.746877+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.998 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:15 smithi044 bash[22676]: audit 2024-09-20T22:16:14.755568+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.998 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:15 smithi044 bash[22676]: audit 2024-09-20T22:16:14.765495+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.998 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:15 smithi044 bash[22676]: audit 2024-09-20T22:16:15.223751+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:15 smithi044 bash[22676]: audit 2024-09-20T22:16:15.232394+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:15 smithi044 bash[22676]: audit 2024-09-20T22:16:15.242410+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:15 smithi179 bash[23186]: cluster 2024-09-20T22:16:14.404607+0000 mgr.a (mgr.14388) 65 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:15 smithi179 bash[23186]: audit 2024-09-20T22:16:14.746877+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:15 smithi179 bash[23186]: audit 2024-09-20T22:16:14.755568+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:15 smithi179 bash[23186]: audit 2024-09-20T22:16:14.765495+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:15 smithi179 bash[23186]: audit 2024-09-20T22:16:15.223751+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:15 smithi179 bash[23186]: audit 2024-09-20T22:16:15.232394+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:15 smithi179 bash[23186]: audit 2024-09-20T22:16:15.242410+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:15 smithi049 bash[23528]: cluster 2024-09-20T22:16:14.404607+0000 mgr.a (mgr.14388) 65 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:15 smithi049 bash[23528]: audit 2024-09-20T22:16:14.746877+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:15 smithi049 bash[23528]: audit 2024-09-20T22:16:14.755568+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:15 smithi049 bash[23528]: audit 2024-09-20T22:16:14.765495+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:15 smithi049 bash[23528]: audit 2024-09-20T22:16:15.223751+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:15 smithi049 bash[23528]: audit 2024-09-20T22:16:15.232394+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:15 smithi049 bash[23528]: audit 2024-09-20T22:16:15.242410+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:16.485 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:16.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:16.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:18.012 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:17 smithi044 bash[22676]: audit 2024-09-20T22:16:16.068126+0000 mgr.a (mgr.14388) 66 : audit [DBG] from='client.15381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:18.012 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:17 smithi044 bash[22676]: cluster 2024-09-20T22:16:16.405838+0000 mgr.a (mgr.14388) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:18.012 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:17 smithi044 bash[22676]: audit 2024-09-20T22:16:17.240612+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.012 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:17 smithi044 bash[22676]: audit 2024-09-20T22:16:17.247793+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.012 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:17 smithi044 bash[22676]: audit 2024-09-20T22:16:17.256099+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:17 smithi049 bash[23528]: audit 2024-09-20T22:16:16.068126+0000 mgr.a (mgr.14388) 66 : audit [DBG] from='client.15381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:18.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:17 smithi049 bash[23528]: cluster 2024-09-20T22:16:16.405838+0000 mgr.a (mgr.14388) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:18.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:17 smithi049 bash[23528]: audit 2024-09-20T22:16:17.240612+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:17 smithi049 bash[23528]: audit 2024-09-20T22:16:17.247793+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:17 smithi049 bash[23528]: audit 2024-09-20T22:16:17.256099+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:17 smithi179 bash[23186]: audit 2024-09-20T22:16:16.068126+0000 mgr.a (mgr.14388) 66 : audit [DBG] from='client.15381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:17 smithi179 bash[23186]: cluster 2024-09-20T22:16:16.405838+0000 mgr.a (mgr.14388) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:17 smithi179 bash[23186]: audit 2024-09-20T22:16:17.240612+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:17 smithi179 bash[23186]: audit 2024-09-20T22:16:17.247793+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:17 smithi179 bash[23186]: audit 2024-09-20T22:16:17.256099+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:20.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:19 smithi049 bash[23528]: cluster 2024-09-20T22:16:18.406606+0000 mgr.a (mgr.14388) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:16:20.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:19 smithi044 bash[22676]: cluster 2024-09-20T22:16:18.406606+0000 mgr.a (mgr.14388) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:16:20.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:19 smithi179 bash[23186]: cluster 2024-09-20T22:16:18.406606+0000 mgr.a (mgr.14388) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:16:21.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:21.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:21.488 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:22.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:21 smithi049 bash[23528]: cluster 2024-09-20T22:16:20.408652+0000 mgr.a (mgr.14388) 69 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:16:22.226 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:22.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:22.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:22.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:22.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:22.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:21 smithi044 bash[22676]: cluster 2024-09-20T22:16:20.408652+0000 mgr.a (mgr.14388) 69 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:16:22.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:21 smithi179 bash[23186]: cluster 2024-09-20T22:16:20.408652+0000 mgr.a (mgr.14388) 69 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:16:24.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:23 smithi049 bash[23528]: audit 2024-09-20T22:16:21.821154+0000 mgr.a (mgr.14388) 70 : audit [DBG] from='client.15459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:24.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:23 smithi049 bash[23528]: cluster 2024-09-20T22:16:22.409556+0000 mgr.a (mgr.14388) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:24.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:23 smithi044 bash[22676]: audit 2024-09-20T22:16:21.821154+0000 mgr.a (mgr.14388) 70 : audit [DBG] from='client.15459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:24.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:23 smithi044 bash[22676]: cluster 2024-09-20T22:16:22.409556+0000 mgr.a (mgr.14388) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:24.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:23 smithi179 bash[23186]: audit 2024-09-20T22:16:21.821154+0000 mgr.a (mgr.14388) 70 : audit [DBG] from='client.15459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:24.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:23 smithi179 bash[23186]: cluster 2024-09-20T22:16:22.409556+0000 mgr.a (mgr.14388) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:26.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:25 smithi049 bash[23528]: cluster 2024-09-20T22:16:24.410335+0000 mgr.a (mgr.14388) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:26.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:25 smithi044 bash[22676]: cluster 2024-09-20T22:16:24.410335+0000 mgr.a (mgr.14388) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:26.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:25 smithi179 bash[23186]: cluster 2024-09-20T22:16:24.410335+0000 mgr.a (mgr.14388) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:27.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:27.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:27.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:28.001 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:28.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:28.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:28.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:28.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:28.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:27 smithi049 bash[23528]: cluster 2024-09-20T22:16:26.412624+0000 mgr.a (mgr.14388) 73 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:28.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:27 smithi044 bash[22676]: cluster 2024-09-20T22:16:26.412624+0000 mgr.a (mgr.14388) 73 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:28.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:27 smithi179 bash[23186]: cluster 2024-09-20T22:16:26.412624+0000 mgr.a (mgr.14388) 73 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:29.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:28 smithi049 bash[23528]: audit 2024-09-20T22:16:27.567776+0000 mgr.a (mgr.14388) 74 : audit [DBG] from='client.15534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:29.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:28 smithi044 bash[22676]: audit 2024-09-20T22:16:27.567776+0000 mgr.a (mgr.14388) 74 : audit [DBG] from='client.15534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:29.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:28 smithi179 bash[23186]: audit 2024-09-20T22:16:27.567776+0000 mgr.a (mgr.14388) 74 : audit [DBG] from='client.15534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:29.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:29 smithi179 bash[23186]: cluster 2024-09-20T22:16:28.413543+0000 mgr.a (mgr.14388) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:30.039 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:29 smithi049 bash[23528]: cluster 2024-09-20T22:16:28.413543+0000 mgr.a (mgr.14388) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:30.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:29 smithi044 bash[22676]: cluster 2024-09-20T22:16:28.413543+0000 mgr.a (mgr.14388) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:32.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:31 smithi049 bash[23528]: cluster 2024-09-20T22:16:30.415737+0000 mgr.a (mgr.14388) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:32.201 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:31 smithi179 bash[23186]: cluster 2024-09-20T22:16:30.415737+0000 mgr.a (mgr.14388) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:32.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:31 smithi044 bash[22676]: cluster 2024-09-20T22:16:30.415737+0000 mgr.a (mgr.14388) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:33.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:33.003 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:33.003 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:33.772 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:34.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:33 smithi049 bash[23528]: cluster 2024-09-20T22:16:32.416496+0000 mgr.a (mgr.14388) 77 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:34.162 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:33 smithi179 bash[23186]: cluster 2024-09-20T22:16:32.416496+0000 mgr.a (mgr.14388) 77 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:34.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:33 smithi044 bash[22676]: cluster 2024-09-20T22:16:32.416496+0000 mgr.a (mgr.14388) 77 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:35.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:34 smithi049 bash[23528]: audit 2024-09-20T22:16:33.338486+0000 mgr.a (mgr.14388) 78 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:35.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:34 smithi044 bash[22676]: audit 2024-09-20T22:16:33.338486+0000 mgr.a (mgr.14388) 78 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:35.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:34 smithi179 bash[23186]: audit 2024-09-20T22:16:33.338486+0000 mgr.a (mgr.14388) 78 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:35.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:35 smithi044 bash[22676]: cluster 2024-09-20T22:16:34.417460+0000 mgr.a (mgr.14388) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:35 smithi044 bash[22676]: audit 2024-09-20T22:16:34.973456+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:35 smithi044 bash[22676]: audit 2024-09-20T22:16:34.983061+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:35 smithi044 bash[22676]: audit 2024-09-20T22:16:34.991544+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:35 smithi044 bash[22676]: audit 2024-09-20T22:16:35.451089+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:35 smithi044 bash[22676]: audit 2024-09-20T22:16:35.459969+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:35 smithi044 bash[22676]: audit 2024-09-20T22:16:35.470239+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:35 smithi179 bash[23186]: cluster 2024-09-20T22:16:34.417460+0000 mgr.a (mgr.14388) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:35 smithi179 bash[23186]: audit 2024-09-20T22:16:34.973456+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:35 smithi179 bash[23186]: audit 2024-09-20T22:16:34.983061+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:35 smithi179 bash[23186]: audit 2024-09-20T22:16:34.991544+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:35 smithi179 bash[23186]: audit 2024-09-20T22:16:35.451089+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:35 smithi179 bash[23186]: audit 2024-09-20T22:16:35.459969+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:35 smithi179 bash[23186]: audit 2024-09-20T22:16:35.470239+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:35 smithi049 bash[23528]: cluster 2024-09-20T22:16:34.417460+0000 mgr.a (mgr.14388) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:36.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:35 smithi049 bash[23528]: audit 2024-09-20T22:16:34.973456+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:35 smithi049 bash[23528]: audit 2024-09-20T22:16:34.983061+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:35 smithi049 bash[23528]: audit 2024-09-20T22:16:34.991544+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:35 smithi049 bash[23528]: audit 2024-09-20T22:16:35.451089+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:35 smithi049 bash[23528]: audit 2024-09-20T22:16:35.459969+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:36.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:35 smithi049 bash[23528]: audit 2024-09-20T22:16:35.470239+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:37 smithi044 bash[22676]: cluster 2024-09-20T22:16:36.419721+0000 mgr.a (mgr.14388) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:37 smithi044 bash[22676]: audit 2024-09-20T22:16:37.403754+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:37 smithi044 bash[22676]: audit 2024-09-20T22:16:37.411061+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:37 smithi044 bash[22676]: audit 2024-09-20T22:16:37.418802+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:38.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:37 smithi179 bash[23186]: cluster 2024-09-20T22:16:36.419721+0000 mgr.a (mgr.14388) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:38.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:37 smithi179 bash[23186]: audit 2024-09-20T22:16:37.403754+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:38.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:37 smithi179 bash[23186]: audit 2024-09-20T22:16:37.411061+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:38.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:37 smithi179 bash[23186]: audit 2024-09-20T22:16:37.418802+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:38.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:37 smithi049 bash[23528]: cluster 2024-09-20T22:16:36.419721+0000 mgr.a (mgr.14388) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:38.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:37 smithi049 bash[23528]: audit 2024-09-20T22:16:37.403754+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:38.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:37 smithi049 bash[23528]: audit 2024-09-20T22:16:37.411061+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:38.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:37 smithi049 bash[23528]: audit 2024-09-20T22:16:37.418802+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:38.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:38.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:38.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:39.538 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:39.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:39.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:39.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:39.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:39 smithi044 bash[22676]: cluster 2024-09-20T22:16:38.420500+0000 mgr.a (mgr.14388) 81 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:39 smithi179 bash[23186]: cluster 2024-09-20T22:16:38.420500+0000 mgr.a (mgr.14388) 81 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:40.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:39 smithi049 bash[23528]: cluster 2024-09-20T22:16:38.420500+0000 mgr.a (mgr.14388) 81 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:41.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:40 smithi044 bash[22676]: audit 2024-09-20T22:16:39.102535+0000 mgr.a (mgr.14388) 82 : audit [DBG] from='client.15678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:41.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:40 smithi044 bash[22676]: cluster 2024-09-20T22:16:40.422882+0000 mgr.a (mgr.14388) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:41.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:40 smithi179 bash[23186]: audit 2024-09-20T22:16:39.102535+0000 mgr.a (mgr.14388) 82 : audit [DBG] from='client.15678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:41.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:40 smithi179 bash[23186]: cluster 2024-09-20T22:16:40.422882+0000 mgr.a (mgr.14388) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:41.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:40 smithi049 bash[23528]: audit 2024-09-20T22:16:39.102535+0000 mgr.a (mgr.14388) 82 : audit [DBG] from='client.15678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:41.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:40 smithi049 bash[23528]: cluster 2024-09-20T22:16:40.422882+0000 mgr.a (mgr.14388) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:16:43.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:43 smithi044 bash[22676]: cluster 2024-09-20T22:16:42.423680+0000 mgr.a (mgr.14388) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:43.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:43 smithi179 bash[23186]: cluster 2024-09-20T22:16:42.423680+0000 mgr.a (mgr.14388) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:43.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:43 smithi049 bash[23528]: cluster 2024-09-20T22:16:42.423680+0000 mgr.a (mgr.14388) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:44.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:44.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:45.278 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:45.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:45 smithi044 bash[22676]: cluster 2024-09-20T22:16:44.424559+0000 mgr.a (mgr.14388) 85 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:45.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:45 smithi179 bash[23186]: cluster 2024-09-20T22:16:44.424559+0000 mgr.a (mgr.14388) 85 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:45.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:45 smithi049 bash[23528]: cluster 2024-09-20T22:16:44.424559+0000 mgr.a (mgr.14388) 85 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:46 smithi179 bash[23186]: audit 2024-09-20T22:16:44.872329+0000 mgr.a (mgr.14388) 86 : audit [DBG] from='client.15756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:46.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:46 smithi049 bash[23528]: audit 2024-09-20T22:16:44.872329+0000 mgr.a (mgr.14388) 86 : audit [DBG] from='client.15756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:46.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:46 smithi044 bash[22676]: audit 2024-09-20T22:16:44.872329+0000 mgr.a (mgr.14388) 86 : audit [DBG] from='client.15756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:47 smithi179 bash[23186]: cluster 2024-09-20T22:16:46.427318+0000 mgr.a (mgr.14388) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:47.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:47 smithi049 bash[23528]: cluster 2024-09-20T22:16:46.427318+0000 mgr.a (mgr.14388) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:47.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:47 smithi044 bash[22676]: cluster 2024-09-20T22:16:46.427318+0000 mgr.a (mgr.14388) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:49.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:49 smithi049 bash[23528]: cluster 2024-09-20T22:16:48.428132+0000 mgr.a (mgr.14388) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:16:49.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:49 smithi044 bash[22676]: cluster 2024-09-20T22:16:48.428132+0000 mgr.a (mgr.14388) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:16:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:49 smithi179 bash[23186]: cluster 2024-09-20T22:16:48.428132+0000 mgr.a (mgr.14388) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:16:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:51.051 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:51.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:51 smithi179 bash[23186]: cluster 2024-09-20T22:16:50.429338+0000 mgr.a (mgr.14388) 89 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:51.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:51 smithi179 bash[23186]: audit 2024-09-20T22:16:50.608908+0000 mgr.a (mgr.14388) 90 : audit [DBG] from='client.15831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:51.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:51 smithi049 bash[23528]: cluster 2024-09-20T22:16:50.429338+0000 mgr.a (mgr.14388) 89 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:51.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:51 smithi049 bash[23528]: audit 2024-09-20T22:16:50.608908+0000 mgr.a (mgr.14388) 90 : audit [DBG] from='client.15831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:51.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:51 smithi044 bash[22676]: cluster 2024-09-20T22:16:50.429338+0000 mgr.a (mgr.14388) 89 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:51.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:51 smithi044 bash[22676]: audit 2024-09-20T22:16:50.608908+0000 mgr.a (mgr.14388) 90 : audit [DBG] from='client.15831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:53.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:53 smithi049 bash[23528]: cluster 2024-09-20T22:16:52.430246+0000 mgr.a (mgr.14388) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:16:53.883 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:53 smithi179 bash[23186]: cluster 2024-09-20T22:16:52.430246+0000 mgr.a (mgr.14388) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:16:53.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:53 smithi044 bash[22676]: cluster 2024-09-20T22:16:52.430246+0000 mgr.a (mgr.14388) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:16:55.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:55 smithi049 bash[23528]: cluster 2024-09-20T22:16:54.431046+0000 mgr.a (mgr.14388) 92 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:55.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:55 smithi049 bash[23528]: audit 2024-09-20T22:16:55.204745+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:55 smithi049 bash[23528]: audit 2024-09-20T22:16:55.213069+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:55 smithi049 bash[23528]: audit 2024-09-20T22:16:55.223190+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:55 smithi044 bash[22676]: cluster 2024-09-20T22:16:54.431046+0000 mgr.a (mgr.14388) 92 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:55 smithi044 bash[22676]: audit 2024-09-20T22:16:55.204745+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:55 smithi044 bash[22676]: audit 2024-09-20T22:16:55.213069+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:55 smithi044 bash[22676]: audit 2024-09-20T22:16:55.223190+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:55 smithi179 bash[23186]: cluster 2024-09-20T22:16:54.431046+0000 mgr.a (mgr.14388) 92 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:16:55.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:55 smithi179 bash[23186]: audit 2024-09-20T22:16:55.204745+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:55 smithi179 bash[23186]: audit 2024-09-20T22:16:55.213069+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:55.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:55 smithi179 bash[23186]: audit 2024-09-20T22:16:55.223190+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:16:56.054 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:16:56.054 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:16:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:55.657094+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:55.665774+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:55.676087+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:56.446420+0000 mon.a (mon.0) 899 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:16:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:56.449463+0000 mon.a (mon.0) 900 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:16:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:56.450238+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:16:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:56.457415+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:56 smithi044 bash[22676]: audit 2024-09-20T22:16:56.460311+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:16:56.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:16:56.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:16:56.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:16:56.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:16:56.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:55.657094+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:55.665774+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:55.676087+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:56.446420+0000 mon.a (mon.0) 899 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:56.449463+0000 mon.a (mon.0) 900 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:56.450238+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:56.457415+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:56.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:56 smithi179 bash[23186]: audit 2024-09-20T22:16:56.460311+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:16:57.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:55.657094+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:55.665774+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:55.676087+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:56.446420+0000 mon.a (mon.0) 899 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:16:57.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:56.449463+0000 mon.a (mon.0) 900 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:16:57.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:56.450238+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:16:57.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:56.457415+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:56 smithi049 bash[23528]: audit 2024-09-20T22:16:56.460311+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:16:57.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22676]: audit 2024-09-20T22:16:56.394288+0000 mgr.a (mgr.14388) 93 : audit [DBG] from='client.15906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:57.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22676]: cluster 2024-09-20T22:16:56.433070+0000 mgr.a (mgr.14388) 94 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:57.677 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22930]: debug 2024-09-20T22:16:57.515+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:16:57.677 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22930]: debug 2024-09-20T22:16:57.515+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:16:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22676]: audit 2024-09-20T22:16:56.461367+0000 mgr.a (mgr.14388) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:16:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22676]: audit 2024-09-20T22:16:57.548316+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22676]: audit 2024-09-20T22:16:57.554095+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:57 smithi044 bash[22676]: audit 2024-09-20T22:16:57.560133+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:57 smithi179 bash[23186]: audit 2024-09-20T22:16:56.394288+0000 mgr.a (mgr.14388) 93 : audit [DBG] from='client.15906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:57.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:57 smithi179 bash[23186]: cluster 2024-09-20T22:16:56.433070+0000 mgr.a (mgr.14388) 94 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:57.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:57 smithi179 bash[23186]: audit 2024-09-20T22:16:56.461367+0000 mgr.a (mgr.14388) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:16:57.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:57 smithi179 bash[23186]: audit 2024-09-20T22:16:57.548316+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:57 smithi179 bash[23186]: audit 2024-09-20T22:16:57.554095+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:57.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:57 smithi179 bash[23186]: audit 2024-09-20T22:16:57.560133+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:58.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:57 smithi049 bash[23528]: audit 2024-09-20T22:16:56.394288+0000 mgr.a (mgr.14388) 93 : audit [DBG] from='client.15906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:16:58.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:57 smithi049 bash[23528]: cluster 2024-09-20T22:16:56.433070+0000 mgr.a (mgr.14388) 94 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:58.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:57 smithi049 bash[23528]: audit 2024-09-20T22:16:56.461367+0000 mgr.a (mgr.14388) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:16:58.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:57 smithi049 bash[23528]: audit 2024-09-20T22:16:57.548316+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:58.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:57 smithi049 bash[23528]: audit 2024-09-20T22:16:57.554095+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:58.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:57 smithi049 bash[23528]: audit 2024-09-20T22:16:57.560133+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:16:58.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:58 smithi044 bash[22676]: audit 2024-09-20T22:16:57.517946+0000 mgr.a (mgr.14388) 96 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:16:58.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:58 smithi044 bash[22676]: cephadm 2024-09-20T22:16:57.519124+0000 mgr.a (mgr.14388) 97 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:16:58.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:58 smithi179 bash[23186]: audit 2024-09-20T22:16:57.517946+0000 mgr.a (mgr.14388) 96 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:16:58.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:58 smithi179 bash[23186]: cephadm 2024-09-20T22:16:57.519124+0000 mgr.a (mgr.14388) 97 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:16:59.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:58 smithi049 bash[23528]: audit 2024-09-20T22:16:57.517946+0000 mgr.a (mgr.14388) 96 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:16:59.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:58 smithi049 bash[23528]: cephadm 2024-09-20T22:16:57.519124+0000 mgr.a (mgr.14388) 97 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:16:59.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:16:59 smithi044 bash[22676]: cluster 2024-09-20T22:16:58.434020+0000 mgr.a (mgr.14388) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:16:59.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:16:59 smithi179 bash[23186]: cluster 2024-09-20T22:16:58.434020+0000 mgr.a (mgr.14388) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:00.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:16:59 smithi049 bash[23528]: cluster 2024-09-20T22:16:58.434020+0000 mgr.a (mgr.14388) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:01.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:01.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:01.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:01.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:01 smithi044 bash[22676]: cluster 2024-09-20T22:17:00.436275+0000 mgr.a (mgr.14388) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:01 smithi179 bash[23186]: cluster 2024-09-20T22:17:00.436275+0000 mgr.a (mgr.14388) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:02.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:01 smithi049 bash[23528]: cluster 2024-09-20T22:17:00.436275+0000 mgr.a (mgr.14388) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:02.577 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:02.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:02.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:02.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:02.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:03.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:03 smithi044 bash[22676]: audit 2024-09-20T22:17:02.156440+0000 mgr.a (mgr.14388) 100 : audit [DBG] from='client.16086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:03.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:03 smithi044 bash[22676]: cluster 2024-09-20T22:17:02.436842+0000 mgr.a (mgr.14388) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:03.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:03 smithi179 bash[23186]: audit 2024-09-20T22:17:02.156440+0000 mgr.a (mgr.14388) 100 : audit [DBG] from='client.16086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:03.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:03 smithi179 bash[23186]: cluster 2024-09-20T22:17:02.436842+0000 mgr.a (mgr.14388) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:04.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:03 smithi049 bash[23528]: audit 2024-09-20T22:17:02.156440+0000 mgr.a (mgr.14388) 100 : audit [DBG] from='client.16086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:04.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:03 smithi049 bash[23528]: cluster 2024-09-20T22:17:02.436842+0000 mgr.a (mgr.14388) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:05.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:05 smithi044 bash[22676]: cluster 2024-09-20T22:17:04.437751+0000 mgr.a (mgr.14388) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:05.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:05 smithi179 bash[23186]: cluster 2024-09-20T22:17:04.437751+0000 mgr.a (mgr.14388) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:06.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:05 smithi049 bash[23528]: cluster 2024-09-20T22:17:04.437751+0000 mgr.a (mgr.14388) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:07.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:07 smithi044 bash[22676]: cluster 2024-09-20T22:17:06.440018+0000 mgr.a (mgr.14388) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:07.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:07 smithi179 bash[23186]: cluster 2024-09-20T22:17:06.440018+0000 mgr.a (mgr.14388) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:08.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:07 smithi049 bash[23528]: cluster 2024-09-20T22:17:06.440018+0000 mgr.a (mgr.14388) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:08.345 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:08.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:08.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:08.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:08.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:09.978 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:09 smithi049 bash[23528]: audit 2024-09-20T22:17:07.922048+0000 mgr.a (mgr.14388) 104 : audit [DBG] from='client.16161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:09.978 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:09 smithi049 bash[23528]: cluster 2024-09-20T22:17:08.440994+0000 mgr.a (mgr.14388) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:09 smithi044 bash[22676]: audit 2024-09-20T22:17:07.922048+0000 mgr.a (mgr.14388) 104 : audit [DBG] from='client.16161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:09 smithi044 bash[22676]: cluster 2024-09-20T22:17:08.440994+0000 mgr.a (mgr.14388) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:09.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:09 smithi179 bash[23186]: audit 2024-09-20T22:17:07.922048+0000 mgr.a (mgr.14388) 104 : audit [DBG] from='client.16161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:09.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:09 smithi179 bash[23186]: cluster 2024-09-20T22:17:08.440994+0000 mgr.a (mgr.14388) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:11 smithi044 bash[22676]: cluster 2024-09-20T22:17:10.443254+0000 mgr.a (mgr.14388) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:11.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:11 smithi179 bash[23186]: cluster 2024-09-20T22:17:10.443254+0000 mgr.a (mgr.14388) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:12.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:11 smithi049 bash[23528]: cluster 2024-09-20T22:17:10.443254+0000 mgr.a (mgr.14388) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:17:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:13.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:13 smithi044 bash[22676]: cluster 2024-09-20T22:17:12.444024+0000 mgr.a (mgr.14388) 107 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:13.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:13 smithi179 bash[23186]: cluster 2024-09-20T22:17:12.444024+0000 mgr.a (mgr.14388) 107 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:14.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:13 smithi049 bash[23528]: cluster 2024-09-20T22:17:12.444024+0000 mgr.a (mgr.14388) 107 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:14.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:14.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:14 smithi044 bash[22676]: audit 2024-09-20T22:17:13.688585+0000 mgr.a (mgr.14388) 108 : audit [DBG] from='client.16239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:14.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:14 smithi179 bash[23186]: audit 2024-09-20T22:17:13.688585+0000 mgr.a (mgr.14388) 108 : audit [DBG] from='client.16239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:15.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:14 smithi049 bash[23528]: audit 2024-09-20T22:17:13.688585+0000 mgr.a (mgr.14388) 108 : audit [DBG] from='client.16239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:15 smithi044 bash[22676]: cluster 2024-09-20T22:17:14.445020+0000 mgr.a (mgr.14388) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:15 smithi044 bash[22676]: audit 2024-09-20T22:17:15.434391+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:15 smithi044 bash[22676]: audit 2024-09-20T22:17:15.443037+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:15 smithi044 bash[22676]: audit 2024-09-20T22:17:15.453528+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:15.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:15 smithi179 bash[23186]: cluster 2024-09-20T22:17:14.445020+0000 mgr.a (mgr.14388) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:15.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:15 smithi179 bash[23186]: audit 2024-09-20T22:17:15.434391+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:15.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:15 smithi179 bash[23186]: audit 2024-09-20T22:17:15.443037+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:15.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:15 smithi179 bash[23186]: audit 2024-09-20T22:17:15.453528+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:16.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:15 smithi049 bash[23528]: cluster 2024-09-20T22:17:14.445020+0000 mgr.a (mgr.14388) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:16.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:15 smithi049 bash[23528]: audit 2024-09-20T22:17:15.434391+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:16.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:15 smithi049 bash[23528]: audit 2024-09-20T22:17:15.443037+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:16.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:15 smithi049 bash[23528]: audit 2024-09-20T22:17:15.453528+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:16 smithi044 bash[22676]: audit 2024-09-20T22:17:15.886817+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:16 smithi044 bash[22676]: audit 2024-09-20T22:17:15.895229+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:16 smithi044 bash[22676]: audit 2024-09-20T22:17:15.905229+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:16 smithi044 bash[22676]: cluster 2024-09-20T22:17:16.447250+0000 mgr.a (mgr.14388) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:16 smithi179 bash[23186]: audit 2024-09-20T22:17:15.886817+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:16 smithi179 bash[23186]: audit 2024-09-20T22:17:15.895229+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:16 smithi179 bash[23186]: audit 2024-09-20T22:17:15.905229+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:16 smithi179 bash[23186]: cluster 2024-09-20T22:17:16.447250+0000 mgr.a (mgr.14388) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:17.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:16 smithi049 bash[23528]: audit 2024-09-20T22:17:15.886817+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:16 smithi049 bash[23528]: audit 2024-09-20T22:17:15.895229+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:16 smithi049 bash[23528]: audit 2024-09-20T22:17:15.905229+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:17.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:16 smithi049 bash[23528]: cluster 2024-09-20T22:17:16.447250+0000 mgr.a (mgr.14388) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:19.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:18 smithi049 bash[23528]: audit 2024-09-20T22:17:17.777772+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:18 smithi049 bash[23528]: audit 2024-09-20T22:17:17.783522+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:18 smithi049 bash[23528]: audit 2024-09-20T22:17:17.791040+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:19.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:19.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:18 smithi044 bash[22676]: audit 2024-09-20T22:17:17.777772+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:18 smithi044 bash[22676]: audit 2024-09-20T22:17:17.783522+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:18 smithi044 bash[22676]: audit 2024-09-20T22:17:17.791040+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:18 smithi179 bash[23186]: audit 2024-09-20T22:17:17.777772+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:18 smithi179 bash[23186]: audit 2024-09-20T22:17:17.783522+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:18 smithi179 bash[23186]: audit 2024-09-20T22:17:17.791040+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:19.913 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:19.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:19.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:19.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:19.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:19 smithi044 bash[22676]: cluster 2024-09-20T22:17:18.448062+0000 mgr.a (mgr.14388) 111 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:20.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:19 smithi049 bash[23528]: cluster 2024-09-20T22:17:18.448062+0000 mgr.a (mgr.14388) 111 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:19 smithi179 bash[23186]: cluster 2024-09-20T22:17:18.448062+0000 mgr.a (mgr.14388) 111 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:21.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:20 smithi044 bash[22676]: audit 2024-09-20T22:17:19.469800+0000 mgr.a (mgr.14388) 112 : audit [DBG] from='client.16314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:21.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:20 smithi179 bash[23186]: audit 2024-09-20T22:17:19.469800+0000 mgr.a (mgr.14388) 112 : audit [DBG] from='client.16314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:21.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:20 smithi049 bash[23528]: audit 2024-09-20T22:17:19.469800+0000 mgr.a (mgr.14388) 112 : audit [DBG] from='client.16314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:22.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:21 smithi044 bash[22676]: cluster 2024-09-20T22:17:20.449846+0000 mgr.a (mgr.14388) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:17:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:21 smithi179 bash[23186]: cluster 2024-09-20T22:17:20.449846+0000 mgr.a (mgr.14388) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:17:22.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:21 smithi049 bash[23528]: cluster 2024-09-20T22:17:20.449846+0000 mgr.a (mgr.14388) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:17:24.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:23 smithi044 bash[22676]: cluster 2024-09-20T22:17:22.450582+0000 mgr.a (mgr.14388) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:17:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:23 smithi179 bash[23186]: cluster 2024-09-20T22:17:22.450582+0000 mgr.a (mgr.14388) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:17:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:23 smithi049 bash[23528]: cluster 2024-09-20T22:17:22.450582+0000 mgr.a (mgr.14388) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:17:24.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:24.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:24.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:25.651 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:26.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:25 smithi044 bash[22676]: cluster 2024-09-20T22:17:24.451342+0000 mgr.a (mgr.14388) 115 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:17:26.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:25 smithi179 bash[23186]: cluster 2024-09-20T22:17:24.451342+0000 mgr.a (mgr.14388) 115 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:17:26.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:25 smithi049 bash[23528]: cluster 2024-09-20T22:17:24.451342+0000 mgr.a (mgr.14388) 115 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:17:27.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:26 smithi044 bash[22676]: audit 2024-09-20T22:17:25.246452+0000 mgr.a (mgr.14388) 116 : audit [DBG] from='client.16389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:27.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:26 smithi179 bash[23186]: audit 2024-09-20T22:17:25.246452+0000 mgr.a (mgr.14388) 116 : audit [DBG] from='client.16389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:27.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:26 smithi049 bash[23528]: audit 2024-09-20T22:17:25.246452+0000 mgr.a (mgr.14388) 116 : audit [DBG] from='client.16389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:28.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:27 smithi044 bash[22676]: cluster 2024-09-20T22:17:26.454099+0000 mgr.a (mgr.14388) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:28.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:27 smithi179 bash[23186]: cluster 2024-09-20T22:17:26.454099+0000 mgr.a (mgr.14388) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:28.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:27 smithi049 bash[23528]: cluster 2024-09-20T22:17:26.454099+0000 mgr.a (mgr.14388) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:30.162 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:29 smithi049 bash[23528]: cluster 2024-09-20T22:17:28.454909+0000 mgr.a (mgr.14388) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:17:30.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:29 smithi044 bash[22676]: cluster 2024-09-20T22:17:28.454909+0000 mgr.a (mgr.14388) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:17:30.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:29 smithi179 bash[23186]: cluster 2024-09-20T22:17:28.454909+0000 mgr.a (mgr.14388) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:17:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:30.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:30.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:31.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:31.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:31.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:31.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:32.204 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:31 smithi049 bash[23528]: cluster 2024-09-20T22:17:30.456880+0000 mgr.a (mgr.14388) 119 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:32.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:31 smithi044 bash[22676]: cluster 2024-09-20T22:17:30.456880+0000 mgr.a (mgr.14388) 119 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:32.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:31 smithi179 bash[23186]: cluster 2024-09-20T22:17:30.456880+0000 mgr.a (mgr.14388) 119 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:33.107 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:32 smithi179 bash[23186]: audit 2024-09-20T22:17:30.982211+0000 mgr.a (mgr.14388) 120 : audit [DBG] from='client.16467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:33.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:32 smithi044 bash[22676]: audit 2024-09-20T22:17:30.982211+0000 mgr.a (mgr.14388) 120 : audit [DBG] from='client.16467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:33.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:32 smithi049 bash[23528]: audit 2024-09-20T22:17:30.982211+0000 mgr.a (mgr.14388) 120 : audit [DBG] from='client.16467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:34.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:33 smithi044 bash[22676]: cluster 2024-09-20T22:17:32.457880+0000 mgr.a (mgr.14388) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:17:34.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:33 smithi179 bash[23186]: cluster 2024-09-20T22:17:32.457880+0000 mgr.a (mgr.14388) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:17:34.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:33 smithi049 bash[23528]: cluster 2024-09-20T22:17:32.457880+0000 mgr.a (mgr.14388) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:17:35.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:34 smithi044 bash[22676]: cluster 2024-09-20T22:17:34.458640+0000 mgr.a (mgr.14388) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:17:35.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:34 smithi179 bash[23186]: cluster 2024-09-20T22:17:34.458640+0000 mgr.a (mgr.14388) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:17:35.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:34 smithi049 bash[23528]: cluster 2024-09-20T22:17:34.458640+0000 mgr.a (mgr.14388) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:17:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:36 smithi044 bash[22676]: audit 2024-09-20T22:17:35.640018+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:36 smithi044 bash[22676]: audit 2024-09-20T22:17:35.648823+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:36 smithi044 bash[22676]: audit 2024-09-20T22:17:35.659670+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:36 smithi044 bash[22676]: audit 2024-09-20T22:17:36.059115+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:36 smithi044 bash[22676]: audit 2024-09-20T22:17:36.068131+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:36 smithi044 bash[22676]: audit 2024-09-20T22:17:36.078142+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:36 smithi179 bash[23186]: audit 2024-09-20T22:17:35.640018+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:36 smithi179 bash[23186]: audit 2024-09-20T22:17:35.648823+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:36 smithi179 bash[23186]: audit 2024-09-20T22:17:35.659670+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:36 smithi179 bash[23186]: audit 2024-09-20T22:17:36.059115+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:36 smithi179 bash[23186]: audit 2024-09-20T22:17:36.068131+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:36.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:36 smithi179 bash[23186]: audit 2024-09-20T22:17:36.078142+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:37.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:36 smithi049 bash[23528]: audit 2024-09-20T22:17:35.640018+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:37.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:36 smithi049 bash[23528]: audit 2024-09-20T22:17:35.648823+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:37.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:36 smithi049 bash[23528]: audit 2024-09-20T22:17:35.659670+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:37.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:36 smithi049 bash[23528]: audit 2024-09-20T22:17:36.059115+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:37.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:36 smithi049 bash[23528]: audit 2024-09-20T22:17:36.068131+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:37.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:36 smithi049 bash[23528]: audit 2024-09-20T22:17:36.078142+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:37.171 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:37 smithi044 bash[22676]: cluster 2024-09-20T22:17:36.460650+0000 mgr.a (mgr.14388) 123 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:17:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:37 smithi044 bash[22676]: audit 2024-09-20T22:17:36.730779+0000 mgr.a (mgr.14388) 124 : audit [DBG] from='client.16545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:37 smithi179 bash[23186]: cluster 2024-09-20T22:17:36.460650+0000 mgr.a (mgr.14388) 123 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:17:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:37 smithi179 bash[23186]: audit 2024-09-20T22:17:36.730779+0000 mgr.a (mgr.14388) 124 : audit [DBG] from='client.16545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:38.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:37 smithi049 bash[23528]: cluster 2024-09-20T22:17:36.460650+0000 mgr.a (mgr.14388) 123 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:17:38.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:37 smithi049 bash[23528]: audit 2024-09-20T22:17:36.730779+0000 mgr.a (mgr.14388) 124 : audit [DBG] from='client.16545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:39.228 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:38 smithi044 bash[22676]: audit 2024-09-20T22:17:37.977449+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:38 smithi044 bash[22676]: audit 2024-09-20T22:17:37.982250+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:38 smithi044 bash[22676]: audit 2024-09-20T22:17:37.987670+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:38 smithi044 bash[22676]: cluster 2024-09-20T22:17:38.461601+0000 mgr.a (mgr.14388) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:39.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:38 smithi179 bash[23186]: audit 2024-09-20T22:17:37.977449+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:38 smithi179 bash[23186]: audit 2024-09-20T22:17:37.982250+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:38 smithi179 bash[23186]: audit 2024-09-20T22:17:37.987670+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:38 smithi179 bash[23186]: cluster 2024-09-20T22:17:38.461601+0000 mgr.a (mgr.14388) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:39.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:38 smithi049 bash[23528]: audit 2024-09-20T22:17:37.977449+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:38 smithi049 bash[23528]: audit 2024-09-20T22:17:37.982250+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:38 smithi049 bash[23528]: audit 2024-09-20T22:17:37.987670+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:39.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:38 smithi049 bash[23528]: cluster 2024-09-20T22:17:38.461601+0000 mgr.a (mgr.14388) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:41.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:41 smithi049 bash[23528]: cluster 2024-09-20T22:17:40.463126+0000 mgr.a (mgr.14388) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:41.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:41 smithi044 bash[22676]: cluster 2024-09-20T22:17:40.463126+0000 mgr.a (mgr.14388) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:41.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:41 smithi179 bash[23186]: cluster 2024-09-20T22:17:40.463126+0000 mgr.a (mgr.14388) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:42.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:42.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:42.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:42.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:42.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:43.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:43 smithi049 bash[23528]: cluster 2024-09-20T22:17:42.463842+0000 mgr.a (mgr.14388) 127 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:43.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:43 smithi049 bash[23528]: audit 2024-09-20T22:17:42.507639+0000 mgr.a (mgr.14388) 128 : audit [DBG] from='client.16623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:43.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:43 smithi044 bash[22676]: cluster 2024-09-20T22:17:42.463842+0000 mgr.a (mgr.14388) 127 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:43.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:43 smithi044 bash[22676]: audit 2024-09-20T22:17:42.507639+0000 mgr.a (mgr.14388) 128 : audit [DBG] from='client.16623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:43.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:43 smithi179 bash[23186]: cluster 2024-09-20T22:17:42.463842+0000 mgr.a (mgr.14388) 127 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:43.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:43 smithi179 bash[23186]: audit 2024-09-20T22:17:42.507639+0000 mgr.a (mgr.14388) 128 : audit [DBG] from='client.16623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:45.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:45 smithi049 bash[23528]: cluster 2024-09-20T22:17:44.464740+0000 mgr.a (mgr.14388) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:45.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:45 smithi044 bash[22676]: cluster 2024-09-20T22:17:44.464740+0000 mgr.a (mgr.14388) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:45.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:45 smithi179 bash[23186]: cluster 2024-09-20T22:17:44.464740+0000 mgr.a (mgr.14388) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:47.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:47 smithi049 bash[23528]: cluster 2024-09-20T22:17:46.467090+0000 mgr.a (mgr.14388) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:47.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:47.933 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:47.933 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:47.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:47 smithi044 bash[22676]: cluster 2024-09-20T22:17:46.467090+0000 mgr.a (mgr.14388) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:47.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:47 smithi179 bash[23186]: cluster 2024-09-20T22:17:46.467090+0000 mgr.a (mgr.14388) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:48.684 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:49.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:49 smithi049 bash[23528]: audit 2024-09-20T22:17:48.266063+0000 mgr.a (mgr.14388) 131 : audit [DBG] from='client.16701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:49.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:49 smithi049 bash[23528]: cluster 2024-09-20T22:17:48.467680+0000 mgr.a (mgr.14388) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:49.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:49 smithi044 bash[22676]: audit 2024-09-20T22:17:48.266063+0000 mgr.a (mgr.14388) 131 : audit [DBG] from='client.16701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:49.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:49 smithi044 bash[22676]: cluster 2024-09-20T22:17:48.467680+0000 mgr.a (mgr.14388) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:49 smithi179 bash[23186]: audit 2024-09-20T22:17:48.266063+0000 mgr.a (mgr.14388) 131 : audit [DBG] from='client.16701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:49 smithi179 bash[23186]: cluster 2024-09-20T22:17:48.467680+0000 mgr.a (mgr.14388) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:51.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:51 smithi049 bash[23528]: cluster 2024-09-20T22:17:50.470028+0000 mgr.a (mgr.14388) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:51.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:51 smithi044 bash[22676]: cluster 2024-09-20T22:17:50.470028+0000 mgr.a (mgr.14388) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:51.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:51 smithi179 bash[23186]: cluster 2024-09-20T22:17:50.470028+0000 mgr.a (mgr.14388) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:53.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:53.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:53.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:53.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:53 smithi179 bash[23186]: cluster 2024-09-20T22:17:52.470828+0000 mgr.a (mgr.14388) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:53.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:53 smithi049 bash[23528]: cluster 2024-09-20T22:17:52.470828+0000 mgr.a (mgr.14388) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:53.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:53 smithi044 bash[22676]: cluster 2024-09-20T22:17:52.470828+0000 mgr.a (mgr.14388) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:54.456 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:17:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:17:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:17:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:17:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:17:55.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:55 smithi179 bash[23186]: audit 2024-09-20T22:17:54.027907+0000 mgr.a (mgr.14388) 135 : audit [DBG] from='client.16779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:55.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:55 smithi179 bash[23186]: cluster 2024-09-20T22:17:54.471453+0000 mgr.a (mgr.14388) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:55 smithi044 bash[22676]: audit 2024-09-20T22:17:54.027907+0000 mgr.a (mgr.14388) 135 : audit [DBG] from='client.16779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:55 smithi044 bash[22676]: cluster 2024-09-20T22:17:54.471453+0000 mgr.a (mgr.14388) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:56.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:55 smithi049 bash[23528]: audit 2024-09-20T22:17:54.027907+0000 mgr.a (mgr.14388) 135 : audit [DBG] from='client.16779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:17:56.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:55 smithi049 bash[23528]: cluster 2024-09-20T22:17:54.471453+0000 mgr.a (mgr.14388) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:56 smithi044 bash[22676]: audit 2024-09-20T22:17:55.842484+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:56 smithi044 bash[22676]: audit 2024-09-20T22:17:55.850856+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:56 smithi044 bash[22676]: audit 2024-09-20T22:17:55.861358+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:56 smithi044 bash[22676]: audit 2024-09-20T22:17:56.270239+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:56 smithi044 bash[22676]: audit 2024-09-20T22:17:56.278971+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:56 smithi044 bash[22676]: audit 2024-09-20T22:17:56.288665+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:56 smithi044 bash[22676]: cluster 2024-09-20T22:17:56.473739+0000 mgr.a (mgr.14388) 137 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:56 smithi179 bash[23186]: audit 2024-09-20T22:17:55.842484+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:56 smithi179 bash[23186]: audit 2024-09-20T22:17:55.850856+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:56 smithi179 bash[23186]: audit 2024-09-20T22:17:55.861358+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:56 smithi179 bash[23186]: audit 2024-09-20T22:17:56.270239+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:56 smithi179 bash[23186]: audit 2024-09-20T22:17:56.278971+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:56 smithi179 bash[23186]: audit 2024-09-20T22:17:56.288665+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:56 smithi179 bash[23186]: cluster 2024-09-20T22:17:56.473739+0000 mgr.a (mgr.14388) 137 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:56 smithi049 bash[23528]: audit 2024-09-20T22:17:55.842484+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:56 smithi049 bash[23528]: audit 2024-09-20T22:17:55.850856+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:56 smithi049 bash[23528]: audit 2024-09-20T22:17:55.861358+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:56 smithi049 bash[23528]: audit 2024-09-20T22:17:56.270239+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:56 smithi049 bash[23528]: audit 2024-09-20T22:17:56.278971+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:56 smithi049 bash[23528]: audit 2024-09-20T22:17:56.288665+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:56 smithi049 bash[23528]: cluster 2024-09-20T22:17:56.473739+0000 mgr.a (mgr.14388) 137 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:17:58.484 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22930]: debug 2024-09-20T22:17:58.367+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22930]: debug 2024-09-20T22:17:58.367+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:57.575082+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:57.581356+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:57.583249+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:57.593929+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:57.600174+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:57.602434+0000 mgr.a (mgr.14388) 138 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:17:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:58.119844+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:58.125444+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:58 smithi044 bash[22676]: audit 2024-09-20T22:17:58.131421+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:57.575082+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:17:58.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:57.581356+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:17:58.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:57.583249+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:17:58.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:57.593929+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:57.600174+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:17:58.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:57.602434+0000 mgr.a (mgr.14388) 138 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:17:58.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:58.119844+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:58.125444+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:58 smithi049 bash[23528]: audit 2024-09-20T22:17:58.131421+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:57.575082+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:17:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:57.581356+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:17:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:57.583249+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:17:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:57.593929+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:57.600174+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:17:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:57.602434+0000 mgr.a (mgr.14388) 138 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:17:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:58.119844+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:58.125444+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:58.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:58 smithi179 bash[23186]: audit 2024-09-20T22:17:58.131421+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:17:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:17:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:17:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:17:59.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:59 smithi044 bash[22676]: audit 2024-09-20T22:17:58.371128+0000 mgr.a (mgr.14388) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:17:59.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:59 smithi044 bash[22676]: cephadm 2024-09-20T22:17:58.372412+0000 mgr.a (mgr.14388) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:17:59.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:17:59 smithi044 bash[22676]: cluster 2024-09-20T22:17:58.474655+0000 mgr.a (mgr.14388) 141 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:59 smithi179 bash[23186]: audit 2024-09-20T22:17:58.371128+0000 mgr.a (mgr.14388) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:17:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:59 smithi179 bash[23186]: cephadm 2024-09-20T22:17:58.372412+0000 mgr.a (mgr.14388) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:17:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:17:59 smithi179 bash[23186]: cluster 2024-09-20T22:17:58.474655+0000 mgr.a (mgr.14388) 141 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:17:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:59 smithi049 bash[23528]: audit 2024-09-20T22:17:58.371128+0000 mgr.a (mgr.14388) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:17:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:59 smithi049 bash[23528]: cephadm 2024-09-20T22:17:58.372412+0000 mgr.a (mgr.14388) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:17:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:17:59 smithi049 bash[23528]: cluster 2024-09-20T22:17:58.474655+0000 mgr.a (mgr.14388) 141 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:00.240 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:00.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:00.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:00.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:00.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:00.683 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:00 smithi044 bash[22676]: audit 2024-09-20T22:17:59.798508+0000 mgr.a (mgr.14388) 142 : audit [DBG] from='client.16962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:00.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:00 smithi179 bash[23186]: audit 2024-09-20T22:17:59.798508+0000 mgr.a (mgr.14388) 142 : audit [DBG] from='client.16962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:00.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:00 smithi049 bash[23528]: audit 2024-09-20T22:17:59.798508+0000 mgr.a (mgr.14388) 142 : audit [DBG] from='client.16962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:01.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:01 smithi044 bash[22676]: cluster 2024-09-20T22:18:00.477351+0000 mgr.a (mgr.14388) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:01.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:01 smithi179 bash[23186]: cluster 2024-09-20T22:18:00.477351+0000 mgr.a (mgr.14388) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:01.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:01 smithi049 bash[23528]: cluster 2024-09-20T22:18:00.477351+0000 mgr.a (mgr.14388) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:03.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:03 smithi049 bash[23528]: cluster 2024-09-20T22:18:02.478163+0000 mgr.a (mgr.14388) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:03.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:03 smithi044 bash[22676]: cluster 2024-09-20T22:18:02.478163+0000 mgr.a (mgr.14388) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:03.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:03 smithi179 bash[23186]: cluster 2024-09-20T22:18:02.478163+0000 mgr.a (mgr.14388) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:05.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:05.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:05 smithi049 bash[23528]: cluster 2024-09-20T22:18:04.478966+0000 mgr.a (mgr.14388) 145 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:05.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:05 smithi044 bash[22676]: cluster 2024-09-20T22:18:04.478966+0000 mgr.a (mgr.14388) 145 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:05.989 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:05.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:05 smithi179 bash[23186]: cluster 2024-09-20T22:18:04.478966+0000 mgr.a (mgr.14388) 145 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:06.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:06 smithi049 bash[23528]: audit 2024-09-20T22:18:05.576516+0000 mgr.a (mgr.14388) 146 : audit [DBG] from='client.17040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:06 smithi044 bash[22676]: audit 2024-09-20T22:18:05.576516+0000 mgr.a (mgr.14388) 146 : audit [DBG] from='client.17040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:06.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:06 smithi179 bash[23186]: audit 2024-09-20T22:18:05.576516+0000 mgr.a (mgr.14388) 146 : audit [DBG] from='client.17040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:07.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:07 smithi044 bash[22676]: cluster 2024-09-20T22:18:06.481719+0000 mgr.a (mgr.14388) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:07.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:07 smithi179 bash[23186]: cluster 2024-09-20T22:18:06.481719+0000 mgr.a (mgr.14388) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:08.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:07 smithi049 bash[23528]: cluster 2024-09-20T22:18:06.481719+0000 mgr.a (mgr.14388) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:09 smithi044 bash[22676]: cluster 2024-09-20T22:18:08.482537+0000 mgr.a (mgr.14388) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:09.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:09 smithi179 bash[23186]: cluster 2024-09-20T22:18:08.482537+0000 mgr.a (mgr.14388) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:10.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:09 smithi049 bash[23528]: cluster 2024-09-20T22:18:08.482537+0000 mgr.a (mgr.14388) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:18:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:10.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:11.735 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:11.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:11 smithi049 bash[23528]: cluster 2024-09-20T22:18:10.484499+0000 mgr.a (mgr.14388) 149 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:11.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:11 smithi044 bash[22676]: cluster 2024-09-20T22:18:10.484499+0000 mgr.a (mgr.14388) 149 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:11.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:11 smithi179 bash[23186]: cluster 2024-09-20T22:18:10.484499+0000 mgr.a (mgr.14388) 149 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:18:12.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:12 smithi044 bash[22676]: audit 2024-09-20T22:18:11.322887+0000 mgr.a (mgr.14388) 150 : audit [DBG] from='client.17115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:12.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:12 smithi179 bash[23186]: audit 2024-09-20T22:18:11.322887+0000 mgr.a (mgr.14388) 150 : audit [DBG] from='client.17115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:13.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:12 smithi049 bash[23528]: audit 2024-09-20T22:18:11.322887+0000 mgr.a (mgr.14388) 150 : audit [DBG] from='client.17115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:13.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:13 smithi049 bash[23528]: cluster 2024-09-20T22:18:12.485472+0000 mgr.a (mgr.14388) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:13.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:13 smithi044 bash[22676]: cluster 2024-09-20T22:18:12.485472+0000 mgr.a (mgr.14388) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:13.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:13 smithi179 bash[23186]: cluster 2024-09-20T22:18:12.485472+0000 mgr.a (mgr.14388) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:15.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:15 smithi179 bash[23186]: cluster 2024-09-20T22:18:14.486252+0000 mgr.a (mgr.14388) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:15 smithi044 bash[22676]: cluster 2024-09-20T22:18:14.486252+0000 mgr.a (mgr.14388) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:16.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:15 smithi049 bash[23528]: cluster 2024-09-20T22:18:14.486252+0000 mgr.a (mgr.14388) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:16.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:16.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:16.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:17 smithi179 bash[23186]: audit 2024-09-20T22:18:16.032829+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:17 smithi179 bash[23186]: audit 2024-09-20T22:18:16.041535+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:17 smithi179 bash[23186]: audit 2024-09-20T22:18:16.051966+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:17 smithi179 bash[23186]: audit 2024-09-20T22:18:16.426257+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:17 smithi179 bash[23186]: audit 2024-09-20T22:18:16.434743+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:17 smithi179 bash[23186]: audit 2024-09-20T22:18:16.444682+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:17 smithi179 bash[23186]: cluster 2024-09-20T22:18:16.488479+0000 mgr.a (mgr.14388) 153 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:17.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:17 smithi049 bash[23528]: audit 2024-09-20T22:18:16.032829+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:17 smithi049 bash[23528]: audit 2024-09-20T22:18:16.041535+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:17 smithi049 bash[23528]: audit 2024-09-20T22:18:16.051966+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:17 smithi049 bash[23528]: audit 2024-09-20T22:18:16.426257+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:17 smithi049 bash[23528]: audit 2024-09-20T22:18:16.434743+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:17 smithi049 bash[23528]: audit 2024-09-20T22:18:16.444682+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:17 smithi049 bash[23528]: cluster 2024-09-20T22:18:16.488479+0000 mgr.a (mgr.14388) 153 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:17.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:17 smithi044 bash[22676]: audit 2024-09-20T22:18:16.032829+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:17 smithi044 bash[22676]: audit 2024-09-20T22:18:16.041535+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:17 smithi044 bash[22676]: audit 2024-09-20T22:18:16.051966+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:17 smithi044 bash[22676]: audit 2024-09-20T22:18:16.426257+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:17 smithi044 bash[22676]: audit 2024-09-20T22:18:16.434743+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:17 smithi044 bash[22676]: audit 2024-09-20T22:18:16.444682+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:17.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:17 smithi044 bash[22676]: cluster 2024-09-20T22:18:16.488479+0000 mgr.a (mgr.14388) 153 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:17.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:18.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:18 smithi044 bash[22676]: audit 2024-09-20T22:18:17.074571+0000 mgr.a (mgr.14388) 154 : audit [DBG] from='client.17193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:18.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:18 smithi044 bash[22676]: audit 2024-09-20T22:18:18.347691+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:18 smithi044 bash[22676]: audit 2024-09-20T22:18:18.355343+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:18 smithi044 bash[22676]: audit 2024-09-20T22:18:18.365315+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:18 smithi179 bash[23186]: audit 2024-09-20T22:18:17.074571+0000 mgr.a (mgr.14388) 154 : audit [DBG] from='client.17193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:18.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:18 smithi179 bash[23186]: audit 2024-09-20T22:18:18.347691+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:18 smithi179 bash[23186]: audit 2024-09-20T22:18:18.355343+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:18 smithi179 bash[23186]: audit 2024-09-20T22:18:18.365315+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:18 smithi049 bash[23528]: audit 2024-09-20T22:18:17.074571+0000 mgr.a (mgr.14388) 154 : audit [DBG] from='client.17193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:18.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:18 smithi049 bash[23528]: audit 2024-09-20T22:18:18.347691+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:18 smithi049 bash[23528]: audit 2024-09-20T22:18:18.355343+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:18.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:18 smithi049 bash[23528]: audit 2024-09-20T22:18:18.365315+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:19.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:19 smithi044 bash[22676]: cluster 2024-09-20T22:18:18.489373+0000 mgr.a (mgr.14388) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:19 smithi179 bash[23186]: cluster 2024-09-20T22:18:18.489373+0000 mgr.a (mgr.14388) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:19.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:19 smithi049 bash[23528]: cluster 2024-09-20T22:18:18.489373+0000 mgr.a (mgr.14388) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:21.891 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:21 smithi044 bash[22676]: cluster 2024-09-20T22:18:20.491556+0000 mgr.a (mgr.14388) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:21.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:21 smithi179 bash[23186]: cluster 2024-09-20T22:18:20.491556+0000 mgr.a (mgr.14388) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:21 smithi049 bash[23528]: cluster 2024-09-20T22:18:20.491556+0000 mgr.a (mgr.14388) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:22.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:22.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:22.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:23.275 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:23.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:23 smithi044 bash[22676]: cluster 2024-09-20T22:18:22.492376+0000 mgr.a (mgr.14388) 157 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:23.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:23 smithi044 bash[22676]: audit 2024-09-20T22:18:22.837193+0000 mgr.a (mgr.14388) 158 : audit [DBG] from='client.17265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:23 smithi179 bash[23186]: cluster 2024-09-20T22:18:22.492376+0000 mgr.a (mgr.14388) 157 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:23 smithi179 bash[23186]: audit 2024-09-20T22:18:22.837193+0000 mgr.a (mgr.14388) 158 : audit [DBG] from='client.17265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:24.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:23 smithi049 bash[23528]: cluster 2024-09-20T22:18:22.492376+0000 mgr.a (mgr.14388) 157 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:24.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:23 smithi049 bash[23528]: audit 2024-09-20T22:18:22.837193+0000 mgr.a (mgr.14388) 158 : audit [DBG] from='client.17265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:25.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:25 smithi044 bash[22676]: cluster 2024-09-20T22:18:24.493351+0000 mgr.a (mgr.14388) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:25.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:25 smithi179 bash[23186]: cluster 2024-09-20T22:18:24.493351+0000 mgr.a (mgr.14388) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:26.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:25 smithi049 bash[23528]: cluster 2024-09-20T22:18:24.493351+0000 mgr.a (mgr.14388) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:27.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:27 smithi044 bash[22676]: cluster 2024-09-20T22:18:26.495622+0000 mgr.a (mgr.14388) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:27.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:27 smithi179 bash[23186]: cluster 2024-09-20T22:18:26.495622+0000 mgr.a (mgr.14388) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:28.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:27 smithi049 bash[23528]: cluster 2024-09-20T22:18:26.495622+0000 mgr.a (mgr.14388) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:28.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:28.277 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:28.277 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:29.058 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:29.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:29 smithi044 bash[22676]: cluster 2024-09-20T22:18:28.496393+0000 mgr.a (mgr.14388) 161 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:29.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:29 smithi044 bash[22676]: audit 2024-09-20T22:18:28.623579+0000 mgr.a (mgr.14388) 162 : audit [DBG] from='client.17337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:29.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:29 smithi179 bash[23186]: cluster 2024-09-20T22:18:28.496393+0000 mgr.a (mgr.14388) 161 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:29.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:29 smithi179 bash[23186]: audit 2024-09-20T22:18:28.623579+0000 mgr.a (mgr.14388) 162 : audit [DBG] from='client.17337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:30.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:29 smithi049 bash[23528]: cluster 2024-09-20T22:18:28.496393+0000 mgr.a (mgr.14388) 161 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:30.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:29 smithi049 bash[23528]: audit 2024-09-20T22:18:28.623579+0000 mgr.a (mgr.14388) 162 : audit [DBG] from='client.17337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:31.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:31 smithi044 bash[22676]: cluster 2024-09-20T22:18:30.498667+0000 mgr.a (mgr.14388) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:31.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:31 smithi179 bash[23186]: cluster 2024-09-20T22:18:30.498667+0000 mgr.a (mgr.14388) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:32.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:31 smithi049 bash[23528]: cluster 2024-09-20T22:18:30.498667+0000 mgr.a (mgr.14388) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:33.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:33 smithi049 bash[23528]: cluster 2024-09-20T22:18:32.499425+0000 mgr.a (mgr.14388) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:33.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:33 smithi044 bash[22676]: cluster 2024-09-20T22:18:32.499425+0000 mgr.a (mgr.14388) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:33.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:33 smithi179 bash[23186]: cluster 2024-09-20T22:18:32.499425+0000 mgr.a (mgr.14388) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:34.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:34.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:34.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:34.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:34.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:34.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:34.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:34.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:35.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:35 smithi179 bash[23186]: audit 2024-09-20T22:18:34.397772+0000 mgr.a (mgr.14388) 165 : audit [DBG] from='client.17412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:35.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:35 smithi179 bash[23186]: cluster 2024-09-20T22:18:34.499986+0000 mgr.a (mgr.14388) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:35.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:35 smithi044 bash[22676]: audit 2024-09-20T22:18:34.397772+0000 mgr.a (mgr.14388) 165 : audit [DBG] from='client.17412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:35.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:35 smithi044 bash[22676]: cluster 2024-09-20T22:18:34.499986+0000 mgr.a (mgr.14388) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:36.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:35 smithi049 bash[23528]: audit 2024-09-20T22:18:34.397772+0000 mgr.a (mgr.14388) 165 : audit [DBG] from='client.17412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:36.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:35 smithi049 bash[23528]: cluster 2024-09-20T22:18:34.499986+0000 mgr.a (mgr.14388) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:37 smithi044 bash[22676]: audit 2024-09-20T22:18:36.183558+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:37 smithi044 bash[22676]: audit 2024-09-20T22:18:36.192222+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:37 smithi044 bash[22676]: audit 2024-09-20T22:18:36.203021+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:37 smithi044 bash[22676]: cluster 2024-09-20T22:18:36.502256+0000 mgr.a (mgr.14388) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:37.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:37 smithi044 bash[22676]: audit 2024-09-20T22:18:36.635030+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:37 smithi044 bash[22676]: audit 2024-09-20T22:18:36.643756+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:37 smithi044 bash[22676]: audit 2024-09-20T22:18:36.655456+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:37 smithi179 bash[23186]: audit 2024-09-20T22:18:36.183558+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:37 smithi179 bash[23186]: audit 2024-09-20T22:18:36.192222+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:37 smithi179 bash[23186]: audit 2024-09-20T22:18:36.203021+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:37 smithi179 bash[23186]: cluster 2024-09-20T22:18:36.502256+0000 mgr.a (mgr.14388) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:37 smithi179 bash[23186]: audit 2024-09-20T22:18:36.635030+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:37 smithi179 bash[23186]: audit 2024-09-20T22:18:36.643756+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:37 smithi179 bash[23186]: audit 2024-09-20T22:18:36.655456+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:37 smithi049 bash[23528]: audit 2024-09-20T22:18:36.183558+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:37 smithi049 bash[23528]: audit 2024-09-20T22:18:36.192222+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:37 smithi049 bash[23528]: audit 2024-09-20T22:18:36.203021+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:37 smithi049 bash[23528]: cluster 2024-09-20T22:18:36.502256+0000 mgr.a (mgr.14388) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:37 smithi049 bash[23528]: audit 2024-09-20T22:18:36.635030+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:37 smithi049 bash[23528]: audit 2024-09-20T22:18:36.643756+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:37 smithi049 bash[23528]: audit 2024-09-20T22:18:36.655456+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:39.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:39.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:39.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:39 smithi044 bash[22676]: cluster 2024-09-20T22:18:38.503153+0000 mgr.a (mgr.14388) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:39.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:39 smithi044 bash[22676]: audit 2024-09-20T22:18:38.557953+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:39.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:39 smithi044 bash[22676]: audit 2024-09-20T22:18:38.571567+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:39.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:39 smithi044 bash[22676]: audit 2024-09-20T22:18:38.581433+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:39 smithi179 bash[23186]: cluster 2024-09-20T22:18:38.503153+0000 mgr.a (mgr.14388) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:39 smithi179 bash[23186]: audit 2024-09-20T22:18:38.557953+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:39 smithi179 bash[23186]: audit 2024-09-20T22:18:38.571567+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:39 smithi179 bash[23186]: audit 2024-09-20T22:18:38.581433+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:39 smithi049 bash[23528]: cluster 2024-09-20T22:18:38.503153+0000 mgr.a (mgr.14388) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:39 smithi049 bash[23528]: audit 2024-09-20T22:18:38.557953+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:39 smithi049 bash[23528]: audit 2024-09-20T22:18:38.571567+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:40.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:39 smithi049 bash[23528]: audit 2024-09-20T22:18:38.581433+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:40.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:40.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:40.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:40.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:40.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:41.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:41 smithi179 bash[23186]: audit 2024-09-20T22:18:40.171416+0000 mgr.a (mgr.14388) 169 : audit [DBG] from='client.17484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:41.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:41 smithi179 bash[23186]: cluster 2024-09-20T22:18:40.504456+0000 mgr.a (mgr.14388) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:41 smithi044 bash[22676]: audit 2024-09-20T22:18:40.171416+0000 mgr.a (mgr.14388) 169 : audit [DBG] from='client.17484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:41 smithi044 bash[22676]: cluster 2024-09-20T22:18:40.504456+0000 mgr.a (mgr.14388) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:42.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:41 smithi049 bash[23528]: audit 2024-09-20T22:18:40.171416+0000 mgr.a (mgr.14388) 169 : audit [DBG] from='client.17484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:42.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:41 smithi049 bash[23528]: cluster 2024-09-20T22:18:40.504456+0000 mgr.a (mgr.14388) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:43.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:43 smithi044 bash[22676]: cluster 2024-09-20T22:18:42.505182+0000 mgr.a (mgr.14388) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:18:43.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:43 smithi179 bash[23186]: cluster 2024-09-20T22:18:42.505182+0000 mgr.a (mgr.14388) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:18:44.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:43 smithi049 bash[23528]: cluster 2024-09-20T22:18:42.505182+0000 mgr.a (mgr.14388) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:18:45.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:45.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:45.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:45.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:45 smithi044 bash[22676]: cluster 2024-09-20T22:18:44.506004+0000 mgr.a (mgr.14388) 172 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:18:45.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:45 smithi179 bash[23186]: cluster 2024-09-20T22:18:44.506004+0000 mgr.a (mgr.14388) 172 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:18:46.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:45 smithi049 bash[23528]: cluster 2024-09-20T22:18:44.506004+0000 mgr.a (mgr.14388) 172 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:18:46.330 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:46.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:46.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:46.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:46.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:47.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:47 smithi044 bash[22676]: audit 2024-09-20T22:18:45.926997+0000 mgr.a (mgr.14388) 173 : audit [DBG] from='client.17556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:47.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:47 smithi044 bash[22676]: cluster 2024-09-20T22:18:46.508649+0000 mgr.a (mgr.14388) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:47.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:47 smithi179 bash[23186]: audit 2024-09-20T22:18:45.926997+0000 mgr.a (mgr.14388) 173 : audit [DBG] from='client.17556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:47.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:47 smithi179 bash[23186]: cluster 2024-09-20T22:18:46.508649+0000 mgr.a (mgr.14388) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:48.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:47 smithi049 bash[23528]: audit 2024-09-20T22:18:45.926997+0000 mgr.a (mgr.14388) 173 : audit [DBG] from='client.17556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:48.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:47 smithi049 bash[23528]: cluster 2024-09-20T22:18:46.508649+0000 mgr.a (mgr.14388) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:49.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:49 smithi044 bash[22676]: cluster 2024-09-20T22:18:48.509609+0000 mgr.a (mgr.14388) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:18:49.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:49 smithi179 bash[23186]: cluster 2024-09-20T22:18:48.509609+0000 mgr.a (mgr.14388) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:18:50.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:49 smithi049 bash[23528]: cluster 2024-09-20T22:18:48.509609+0000 mgr.a (mgr.14388) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:18:51.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:51.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:51.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:51.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:51 smithi044 bash[22676]: cluster 2024-09-20T22:18:50.511802+0000 mgr.a (mgr.14388) 176 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:51.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:51 smithi179 bash[23186]: cluster 2024-09-20T22:18:50.511802+0000 mgr.a (mgr.14388) 176 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:52.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:51 smithi049 bash[23528]: cluster 2024-09-20T22:18:50.511802+0000 mgr.a (mgr.14388) 176 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:52.103 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:52.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:52.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:52.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:52 smithi044 bash[22676]: audit 2024-09-20T22:18:51.667765+0000 mgr.a (mgr.14388) 177 : audit [DBG] from='client.17634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:52.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:52 smithi179 bash[23186]: audit 2024-09-20T22:18:51.667765+0000 mgr.a (mgr.14388) 177 : audit [DBG] from='client.17634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:53.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:52 smithi049 bash[23528]: audit 2024-09-20T22:18:51.667765+0000 mgr.a (mgr.14388) 177 : audit [DBG] from='client.17634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:53.898 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:53 smithi049 bash[23528]: cluster 2024-09-20T22:18:52.512761+0000 mgr.a (mgr.14388) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:53.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:53 smithi044 bash[22676]: cluster 2024-09-20T22:18:52.512761+0000 mgr.a (mgr.14388) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:53.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:53 smithi179 bash[23186]: cluster 2024-09-20T22:18:52.512761+0000 mgr.a (mgr.14388) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:55.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:55 smithi049 bash[23528]: cluster 2024-09-20T22:18:54.513579+0000 mgr.a (mgr.14388) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:55.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:55 smithi179 bash[23186]: cluster 2024-09-20T22:18:54.513579+0000 mgr.a (mgr.14388) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:55.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:55 smithi044 bash[22676]: cluster 2024-09-20T22:18:54.513579+0000 mgr.a (mgr.14388) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:57.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:18:57.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:18:57.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:18:57.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:57 smithi044 bash[22676]: audit 2024-09-20T22:18:56.421333+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:57 smithi044 bash[22676]: audit 2024-09-20T22:18:56.429760+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:57 smithi044 bash[22676]: audit 2024-09-20T22:18:56.440107+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:57 smithi044 bash[22676]: cluster 2024-09-20T22:18:56.515791+0000 mgr.a (mgr.14388) 180 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:57.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:57 smithi044 bash[22676]: audit 2024-09-20T22:18:56.838924+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:57 smithi044 bash[22676]: audit 2024-09-20T22:18:56.847408+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:57 smithi044 bash[22676]: audit 2024-09-20T22:18:56.857312+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:57 smithi179 bash[23186]: audit 2024-09-20T22:18:56.421333+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:57 smithi179 bash[23186]: audit 2024-09-20T22:18:56.429760+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:57 smithi179 bash[23186]: audit 2024-09-20T22:18:56.440107+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:57 smithi179 bash[23186]: cluster 2024-09-20T22:18:56.515791+0000 mgr.a (mgr.14388) 180 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:57.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:57 smithi179 bash[23186]: audit 2024-09-20T22:18:56.838924+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:57 smithi179 bash[23186]: audit 2024-09-20T22:18:56.847408+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:57 smithi179 bash[23186]: audit 2024-09-20T22:18:56.857312+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:57 smithi049 bash[23528]: audit 2024-09-20T22:18:56.421333+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:57 smithi049 bash[23528]: audit 2024-09-20T22:18:56.429760+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:57 smithi049 bash[23528]: audit 2024-09-20T22:18:56.440107+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:57 smithi049 bash[23528]: cluster 2024-09-20T22:18:56.515791+0000 mgr.a (mgr.14388) 180 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:18:57.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:57 smithi049 bash[23528]: audit 2024-09-20T22:18:56.838924+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:57 smithi049 bash[23528]: audit 2024-09-20T22:18:56.847408+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:57 smithi049 bash[23528]: audit 2024-09-20T22:18:56.857312+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:57.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:18:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:18:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:18:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:18:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:18:58.730 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:58 smithi044 bash[22676]: audit 2024-09-20T22:18:57.441198+0000 mgr.a (mgr.14388) 181 : audit [DBG] from='client.17712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:58.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:58 smithi179 bash[23186]: audit 2024-09-20T22:18:57.441198+0000 mgr.a (mgr.14388) 181 : audit [DBG] from='client.17712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:58.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:58 smithi049 bash[23528]: audit 2024-09-20T22:18:57.441198+0000 mgr.a (mgr.14388) 181 : audit [DBG] from='client.17712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:18:59.442 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22930]: debug 2024-09-20T22:18:59.174+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:18:59.442 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22930]: debug 2024-09-20T22:18:59.178+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:18:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.440186+0000 mon.a (mon.0) 963 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:18:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.452483+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:18:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.454381+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:18:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.465158+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.471700+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:18:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.474141+0000 mgr.a (mgr.14388) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:18:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: cluster 2024-09-20T22:18:58.516599+0000 mgr.a (mgr.14388) 183 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.719607+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.724769+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:18:59 smithi044 bash[22676]: audit 2024-09-20T22:18:58.731862+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.440186+0000 mon.a (mon.0) 963 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:18:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.452483+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:18:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.454381+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:18:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.465158+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.471700+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:18:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.474141+0000 mgr.a (mgr.14388) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:18:59.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: cluster 2024-09-20T22:18:58.516599+0000 mgr.a (mgr.14388) 183 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:59.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.719607+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.724769+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:18:59 smithi179 bash[23186]: audit 2024-09-20T22:18:58.731862+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.440186+0000 mon.a (mon.0) 963 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:18:59.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.452483+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:18:59.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.454381+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:18:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.465158+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.471700+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:18:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.474141+0000 mgr.a (mgr.14388) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:18:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: cluster 2024-09-20T22:18:58.516599+0000 mgr.a (mgr.14388) 183 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:18:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.719607+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.724769+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:18:59.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:18:59 smithi049 bash[23528]: audit 2024-09-20T22:18:58.731862+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:00.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:00 smithi044 bash[22676]: audit 2024-09-20T22:18:59.180224+0000 mgr.a (mgr.14388) 184 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:19:00.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:00 smithi044 bash[22676]: cephadm 2024-09-20T22:18:59.181511+0000 mgr.a (mgr.14388) 185 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:19:00.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:00 smithi179 bash[23186]: audit 2024-09-20T22:18:59.180224+0000 mgr.a (mgr.14388) 184 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:19:00.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:00 smithi179 bash[23186]: cephadm 2024-09-20T22:18:59.181511+0000 mgr.a (mgr.14388) 185 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:19:00.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:00 smithi049 bash[23528]: audit 2024-09-20T22:18:59.180224+0000 mgr.a (mgr.14388) 184 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:19:00.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:00 smithi049 bash[23528]: cephadm 2024-09-20T22:18:59.181511+0000 mgr.a (mgr.14388) 185 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:19:01.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:01 smithi044 bash[22676]: cluster 2024-09-20T22:19:00.518947+0000 mgr.a (mgr.14388) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:01.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:01 smithi179 bash[23186]: cluster 2024-09-20T22:19:00.518947+0000 mgr.a (mgr.14388) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:01.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:01 smithi049 bash[23528]: cluster 2024-09-20T22:19:00.518947+0000 mgr.a (mgr.14388) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:02.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:02.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:02.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:03.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:03.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:03.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:03.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:03.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:03.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:03 smithi044 bash[22676]: cluster 2024-09-20T22:19:02.519756+0000 mgr.a (mgr.14388) 187 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:03.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:03 smithi179 bash[23186]: cluster 2024-09-20T22:19:02.519756+0000 mgr.a (mgr.14388) 187 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:04.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:03 smithi049 bash[23528]: cluster 2024-09-20T22:19:02.519756+0000 mgr.a (mgr.14388) 187 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:04.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:04 smithi044 bash[22676]: audit 2024-09-20T22:19:03.189416+0000 mgr.a (mgr.14388) 188 : audit [DBG] from='client.17898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:04.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:04 smithi179 bash[23186]: audit 2024-09-20T22:19:03.189416+0000 mgr.a (mgr.14388) 188 : audit [DBG] from='client.17898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:05.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:04 smithi049 bash[23528]: audit 2024-09-20T22:19:03.189416+0000 mgr.a (mgr.14388) 188 : audit [DBG] from='client.17898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:05.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:05 smithi044 bash[22676]: cluster 2024-09-20T22:19:04.520690+0000 mgr.a (mgr.14388) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:05.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:05 smithi179 bash[23186]: cluster 2024-09-20T22:19:04.520690+0000 mgr.a (mgr.14388) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:06.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:05 smithi049 bash[23528]: cluster 2024-09-20T22:19:04.520690+0000 mgr.a (mgr.14388) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:07.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:07 smithi044 bash[22676]: cluster 2024-09-20T22:19:06.523044+0000 mgr.a (mgr.14388) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:07.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:07 smithi179 bash[23186]: cluster 2024-09-20T22:19:06.523044+0000 mgr.a (mgr.14388) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:08.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:07 smithi049 bash[23528]: cluster 2024-09-20T22:19:06.523044+0000 mgr.a (mgr.14388) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:08.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:08.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:08.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:09.400 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:09.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:09.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:09.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:09.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:09 smithi044 bash[22676]: cluster 2024-09-20T22:19:08.523994+0000 mgr.a (mgr.14388) 191 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:09.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:09 smithi179 bash[23186]: cluster 2024-09-20T22:19:08.523994+0000 mgr.a (mgr.14388) 191 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:10.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:09 smithi049 bash[23528]: cluster 2024-09-20T22:19:08.523994+0000 mgr.a (mgr.14388) 191 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:10.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:10 smithi044 bash[22676]: audit 2024-09-20T22:19:08.965445+0000 mgr.a (mgr.14388) 192 : audit [DBG] from='client.17973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:10.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:10 smithi179 bash[23186]: audit 2024-09-20T22:19:08.965445+0000 mgr.a (mgr.14388) 192 : audit [DBG] from='client.17973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:11.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:10 smithi049 bash[23528]: audit 2024-09-20T22:19:08.965445+0000 mgr.a (mgr.14388) 192 : audit [DBG] from='client.17973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:11 smithi044 bash[22676]: cluster 2024-09-20T22:19:10.526381+0000 mgr.a (mgr.14388) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:11.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:11 smithi179 bash[23186]: cluster 2024-09-20T22:19:10.526381+0000 mgr.a (mgr.14388) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:12.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:11 smithi049 bash[23528]: cluster 2024-09-20T22:19:10.526381+0000 mgr.a (mgr.14388) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:19:13.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:13 smithi044 bash[22676]: cluster 2024-09-20T22:19:12.527165+0000 mgr.a (mgr.14388) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:13.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:13 smithi179 bash[23186]: cluster 2024-09-20T22:19:12.527165+0000 mgr.a (mgr.14388) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:14.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:13 smithi049 bash[23528]: cluster 2024-09-20T22:19:12.527165+0000 mgr.a (mgr.14388) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:14.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:14.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:14.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:15.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:15.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:15 smithi049 bash[23528]: cluster 2024-09-20T22:19:14.527618+0000 mgr.a (mgr.14388) 195 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:15.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:15 smithi049 bash[23528]: audit 2024-09-20T22:19:14.741803+0000 mgr.a (mgr.14388) 196 : audit [DBG] from='client.18051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:15 smithi044 bash[22676]: cluster 2024-09-20T22:19:14.527618+0000 mgr.a (mgr.14388) 195 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:15 smithi044 bash[22676]: audit 2024-09-20T22:19:14.741803+0000 mgr.a (mgr.14388) 196 : audit [DBG] from='client.18051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:15.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:15 smithi179 bash[23186]: cluster 2024-09-20T22:19:14.527618+0000 mgr.a (mgr.14388) 195 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:15.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:15 smithi179 bash[23186]: audit 2024-09-20T22:19:14.741803+0000 mgr.a (mgr.14388) 196 : audit [DBG] from='client.18051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:17.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:17 smithi179 bash[23186]: cluster 2024-09-20T22:19:16.530264+0000 mgr.a (mgr.14388) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:17.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:17 smithi179 bash[23186]: audit 2024-09-20T22:19:16.612840+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:17 smithi179 bash[23186]: audit 2024-09-20T22:19:16.619765+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:17 smithi179 bash[23186]: audit 2024-09-20T22:19:16.632960+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:17 smithi179 bash[23186]: audit 2024-09-20T22:19:17.023312+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:17 smithi179 bash[23186]: audit 2024-09-20T22:19:17.033125+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:17 smithi179 bash[23186]: audit 2024-09-20T22:19:17.043194+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:17 smithi044 bash[22676]: cluster 2024-09-20T22:19:16.530264+0000 mgr.a (mgr.14388) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:17 smithi044 bash[22676]: audit 2024-09-20T22:19:16.612840+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:17 smithi044 bash[22676]: audit 2024-09-20T22:19:16.619765+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:17 smithi044 bash[22676]: audit 2024-09-20T22:19:16.632960+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:17 smithi044 bash[22676]: audit 2024-09-20T22:19:17.023312+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:17 smithi044 bash[22676]: audit 2024-09-20T22:19:17.033125+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:17 smithi044 bash[22676]: audit 2024-09-20T22:19:17.043194+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:18.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:17 smithi049 bash[23528]: cluster 2024-09-20T22:19:16.530264+0000 mgr.a (mgr.14388) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:18.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:17 smithi049 bash[23528]: audit 2024-09-20T22:19:16.612840+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:18.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:17 smithi049 bash[23528]: audit 2024-09-20T22:19:16.619765+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:18.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:17 smithi049 bash[23528]: audit 2024-09-20T22:19:16.632960+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:18.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:17 smithi049 bash[23528]: audit 2024-09-20T22:19:17.023312+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:18.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:17 smithi049 bash[23528]: audit 2024-09-20T22:19:17.033125+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:18.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:17 smithi049 bash[23528]: audit 2024-09-20T22:19:17.043194+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:19 smithi179 bash[23186]: cluster 2024-09-20T22:19:18.531070+0000 mgr.a (mgr.14388) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:19 smithi179 bash[23186]: audit 2024-09-20T22:19:18.952755+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:19 smithi179 bash[23186]: audit 2024-09-20T22:19:18.960775+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:19 smithi179 bash[23186]: audit 2024-09-20T22:19:18.970685+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:19 smithi044 bash[22676]: cluster 2024-09-20T22:19:18.531070+0000 mgr.a (mgr.14388) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:19 smithi044 bash[22676]: audit 2024-09-20T22:19:18.952755+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:19 smithi044 bash[22676]: audit 2024-09-20T22:19:18.960775+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:19 smithi044 bash[22676]: audit 2024-09-20T22:19:18.970685+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:19 smithi049 bash[23528]: cluster 2024-09-20T22:19:18.531070+0000 mgr.a (mgr.14388) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:19 smithi049 bash[23528]: audit 2024-09-20T22:19:18.952755+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:19 smithi049 bash[23528]: audit 2024-09-20T22:19:18.960775+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:19 smithi049 bash[23528]: audit 2024-09-20T22:19:18.970685+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:20.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:20.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:20.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:20.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:20.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:20.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:20.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:20.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:21 smithi044 bash[22676]: audit 2024-09-20T22:19:20.516570+0000 mgr.a (mgr.14388) 199 : audit [DBG] from='client.18129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:21 smithi044 bash[22676]: cluster 2024-09-20T22:19:20.534135+0000 mgr.a (mgr.14388) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:21.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:21 smithi179 bash[23186]: audit 2024-09-20T22:19:20.516570+0000 mgr.a (mgr.14388) 199 : audit [DBG] from='client.18129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:21.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:21 smithi179 bash[23186]: cluster 2024-09-20T22:19:20.534135+0000 mgr.a (mgr.14388) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:21 smithi049 bash[23528]: audit 2024-09-20T22:19:20.516570+0000 mgr.a (mgr.14388) 199 : audit [DBG] from='client.18129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:21 smithi049 bash[23528]: cluster 2024-09-20T22:19:20.534135+0000 mgr.a (mgr.14388) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:23.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:23 smithi044 bash[22676]: cluster 2024-09-20T22:19:22.535017+0000 mgr.a (mgr.14388) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:23 smithi179 bash[23186]: cluster 2024-09-20T22:19:22.535017+0000 mgr.a (mgr.14388) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:24.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:23 smithi049 bash[23528]: cluster 2024-09-20T22:19:22.535017+0000 mgr.a (mgr.14388) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:25.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:25.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:25 smithi044 bash[22676]: cluster 2024-09-20T22:19:24.535576+0000 mgr.a (mgr.14388) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:25.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:25 smithi179 bash[23186]: cluster 2024-09-20T22:19:24.535576+0000 mgr.a (mgr.14388) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:26.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:25 smithi049 bash[23528]: cluster 2024-09-20T22:19:24.535576+0000 mgr.a (mgr.14388) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:26.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:27.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:27 smithi044 bash[22676]: audit 2024-09-20T22:19:26.271421+0000 mgr.a (mgr.14388) 203 : audit [DBG] from='client.18207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:27.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:27 smithi044 bash[22676]: cluster 2024-09-20T22:19:26.537143+0000 mgr.a (mgr.14388) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:27.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:27 smithi179 bash[23186]: audit 2024-09-20T22:19:26.271421+0000 mgr.a (mgr.14388) 203 : audit [DBG] from='client.18207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:27.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:27 smithi179 bash[23186]: cluster 2024-09-20T22:19:26.537143+0000 mgr.a (mgr.14388) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:28.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:27 smithi049 bash[23528]: audit 2024-09-20T22:19:26.271421+0000 mgr.a (mgr.14388) 203 : audit [DBG] from='client.18207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:28.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:27 smithi049 bash[23528]: cluster 2024-09-20T22:19:26.537143+0000 mgr.a (mgr.14388) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:29.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:29 smithi044 bash[22676]: cluster 2024-09-20T22:19:28.538002+0000 mgr.a (mgr.14388) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:29.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:29 smithi179 bash[23186]: cluster 2024-09-20T22:19:28.538002+0000 mgr.a (mgr.14388) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:30.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:29 smithi049 bash[23528]: cluster 2024-09-20T22:19:28.538002+0000 mgr.a (mgr.14388) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:31.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:31.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:31.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:31 smithi044 bash[22676]: cluster 2024-09-20T22:19:30.540319+0000 mgr.a (mgr.14388) 206 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:31.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:31 smithi179 bash[23186]: cluster 2024-09-20T22:19:30.540319+0000 mgr.a (mgr.14388) 206 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:32.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:31 smithi049 bash[23528]: cluster 2024-09-20T22:19:30.540319+0000 mgr.a (mgr.14388) 206 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:32.471 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:33.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:33 smithi044 bash[22676]: audit 2024-09-20T22:19:32.035195+0000 mgr.a (mgr.14388) 207 : audit [DBG] from='client.18285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:33.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:33 smithi044 bash[22676]: cluster 2024-09-20T22:19:32.541079+0000 mgr.a (mgr.14388) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:33.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:33 smithi179 bash[23186]: audit 2024-09-20T22:19:32.035195+0000 mgr.a (mgr.14388) 207 : audit [DBG] from='client.18285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:33.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:33 smithi179 bash[23186]: cluster 2024-09-20T22:19:32.541079+0000 mgr.a (mgr.14388) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:34.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:33 smithi049 bash[23528]: audit 2024-09-20T22:19:32.035195+0000 mgr.a (mgr.14388) 207 : audit [DBG] from='client.18285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:34.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:33 smithi049 bash[23528]: cluster 2024-09-20T22:19:32.541079+0000 mgr.a (mgr.14388) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:35.782 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:35 smithi049 bash[23528]: cluster 2024-09-20T22:19:34.541823+0000 mgr.a (mgr.14388) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:35.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:35 smithi044 bash[22676]: cluster 2024-09-20T22:19:34.541823+0000 mgr.a (mgr.14388) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:35.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:35 smithi179 bash[23186]: cluster 2024-09-20T22:19:34.541823+0000 mgr.a (mgr.14388) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:37.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:37.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:37.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:37 smithi179 bash[23186]: cluster 2024-09-20T22:19:36.544038+0000 mgr.a (mgr.14388) 210 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:37 smithi179 bash[23186]: audit 2024-09-20T22:19:36.846718+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:37 smithi179 bash[23186]: audit 2024-09-20T22:19:36.855240+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:37 smithi179 bash[23186]: audit 2024-09-20T22:19:36.866016+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:37 smithi179 bash[23186]: audit 2024-09-20T22:19:37.225750+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:37 smithi179 bash[23186]: audit 2024-09-20T22:19:37.234515+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:37 smithi179 bash[23186]: audit 2024-09-20T22:19:37.244741+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.234 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:37 smithi044 bash[22676]: cluster 2024-09-20T22:19:36.544038+0000 mgr.a (mgr.14388) 210 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:37 smithi044 bash[22676]: audit 2024-09-20T22:19:36.846718+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:37 smithi044 bash[22676]: audit 2024-09-20T22:19:36.855240+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:37 smithi044 bash[22676]: audit 2024-09-20T22:19:36.866016+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:37 smithi044 bash[22676]: audit 2024-09-20T22:19:37.225750+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:37 smithi044 bash[22676]: audit 2024-09-20T22:19:37.234515+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:37 smithi044 bash[22676]: audit 2024-09-20T22:19:37.244741+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:38.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:38.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:38.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:38.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:38.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:37 smithi049 bash[23528]: cluster 2024-09-20T22:19:36.544038+0000 mgr.a (mgr.14388) 210 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:38.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:37 smithi049 bash[23528]: audit 2024-09-20T22:19:36.846718+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:37 smithi049 bash[23528]: audit 2024-09-20T22:19:36.855240+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:37 smithi049 bash[23528]: audit 2024-09-20T22:19:36.866016+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:37 smithi049 bash[23528]: audit 2024-09-20T22:19:37.225750+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:37 smithi049 bash[23528]: audit 2024-09-20T22:19:37.234515+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:37 smithi049 bash[23528]: audit 2024-09-20T22:19:37.244741+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:38.909 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:38 smithi179 bash[23186]: audit 2024-09-20T22:19:37.817111+0000 mgr.a (mgr.14388) 211 : audit [DBG] from='client.18360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:39.207 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:38 smithi044 bash[22676]: audit 2024-09-20T22:19:37.817111+0000 mgr.a (mgr.14388) 211 : audit [DBG] from='client.18360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:39.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:38 smithi049 bash[23528]: audit 2024-09-20T22:19:37.817111+0000 mgr.a (mgr.14388) 211 : audit [DBG] from='client.18360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:40.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:39 smithi179 bash[23186]: cluster 2024-09-20T22:19:38.544993+0000 mgr.a (mgr.14388) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:40.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:39 smithi179 bash[23186]: audit 2024-09-20T22:19:39.186959+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:39 smithi179 bash[23186]: audit 2024-09-20T22:19:39.195342+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:39 smithi179 bash[23186]: audit 2024-09-20T22:19:39.207051+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:39 smithi044 bash[22676]: cluster 2024-09-20T22:19:38.544993+0000 mgr.a (mgr.14388) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:39 smithi044 bash[22676]: audit 2024-09-20T22:19:39.186959+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:39 smithi044 bash[22676]: audit 2024-09-20T22:19:39.195342+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:39 smithi044 bash[22676]: audit 2024-09-20T22:19:39.207051+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:39 smithi049 bash[23528]: cluster 2024-09-20T22:19:38.544993+0000 mgr.a (mgr.14388) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:40.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:39 smithi049 bash[23528]: audit 2024-09-20T22:19:39.186959+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:39 smithi049 bash[23528]: audit 2024-09-20T22:19:39.195342+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:40.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:39 smithi049 bash[23528]: audit 2024-09-20T22:19:39.207051+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:41 smithi044 bash[22676]: cluster 2024-09-20T22:19:40.547161+0000 mgr.a (mgr.14388) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:42.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:41 smithi179 bash[23186]: cluster 2024-09-20T22:19:40.547161+0000 mgr.a (mgr.14388) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:41 smithi049 bash[23528]: cluster 2024-09-20T22:19:40.547161+0000 mgr.a (mgr.14388) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:43.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:43.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:43.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:43.996 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:43.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:43.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:44.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:43 smithi044 bash[22676]: cluster 2024-09-20T22:19:42.547949+0000 mgr.a (mgr.14388) 214 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:44.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:43 smithi179 bash[23186]: cluster 2024-09-20T22:19:42.547949+0000 mgr.a (mgr.14388) 214 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:44.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:43 smithi049 bash[23528]: cluster 2024-09-20T22:19:42.547949+0000 mgr.a (mgr.14388) 214 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:45.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:44 smithi044 bash[22676]: audit 2024-09-20T22:19:43.596457+0000 mgr.a (mgr.14388) 215 : audit [DBG] from='client.18438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:45.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:44 smithi179 bash[23186]: audit 2024-09-20T22:19:43.596457+0000 mgr.a (mgr.14388) 215 : audit [DBG] from='client.18438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:45.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:44 smithi049 bash[23528]: audit 2024-09-20T22:19:43.596457+0000 mgr.a (mgr.14388) 215 : audit [DBG] from='client.18438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:45.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:45 smithi044 bash[22676]: cluster 2024-09-20T22:19:44.549027+0000 mgr.a (mgr.14388) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:46.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:45 smithi179 bash[23186]: cluster 2024-09-20T22:19:44.549027+0000 mgr.a (mgr.14388) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:46.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:45 smithi049 bash[23528]: cluster 2024-09-20T22:19:44.549027+0000 mgr.a (mgr.14388) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:47.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:46 smithi044 bash[22676]: cluster 2024-09-20T22:19:46.551329+0000 mgr.a (mgr.14388) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:47.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:46 smithi179 bash[23186]: cluster 2024-09-20T22:19:46.551329+0000 mgr.a (mgr.14388) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:47.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:46 smithi049 bash[23528]: cluster 2024-09-20T22:19:46.551329+0000 mgr.a (mgr.14388) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:48.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:48.998 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:48.999 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:49.765 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:49.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:49 smithi044 bash[22676]: cluster 2024-09-20T22:19:48.552079+0000 mgr.a (mgr.14388) 218 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:49.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:49 smithi179 bash[23186]: cluster 2024-09-20T22:19:48.552079+0000 mgr.a (mgr.14388) 218 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:50.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:49 smithi049 bash[23528]: cluster 2024-09-20T22:19:48.552079+0000 mgr.a (mgr.14388) 218 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:50.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:50 smithi044 bash[22676]: audit 2024-09-20T22:19:49.341030+0000 mgr.a (mgr.14388) 219 : audit [DBG] from='client.18516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:50.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:50 smithi179 bash[23186]: audit 2024-09-20T22:19:49.341030+0000 mgr.a (mgr.14388) 219 : audit [DBG] from='client.18516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:51.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:50 smithi049 bash[23528]: audit 2024-09-20T22:19:49.341030+0000 mgr.a (mgr.14388) 219 : audit [DBG] from='client.18516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:51.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:51 smithi044 bash[22676]: cluster 2024-09-20T22:19:50.554469+0000 mgr.a (mgr.14388) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:51.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:51 smithi179 bash[23186]: cluster 2024-09-20T22:19:50.554469+0000 mgr.a (mgr.14388) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:52.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:51 smithi049 bash[23528]: cluster 2024-09-20T22:19:50.554469+0000 mgr.a (mgr.14388) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:19:53.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:53 smithi044 bash[22676]: cluster 2024-09-20T22:19:52.555265+0000 mgr.a (mgr.14388) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:53.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:53 smithi179 bash[23186]: cluster 2024-09-20T22:19:52.555265+0000 mgr.a (mgr.14388) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:53 smithi049 bash[23528]: cluster 2024-09-20T22:19:52.555265+0000 mgr.a (mgr.14388) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:54.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:19:54.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:19:54.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:19:55.523 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:19:55.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:19:55.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:19:55.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:19:55.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:19:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:55 smithi044 bash[22676]: cluster 2024-09-20T22:19:54.556014+0000 mgr.a (mgr.14388) 222 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:55.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:55 smithi179 bash[23186]: cluster 2024-09-20T22:19:54.556014+0000 mgr.a (mgr.14388) 222 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:56.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:55 smithi049 bash[23528]: cluster 2024-09-20T22:19:54.556014+0000 mgr.a (mgr.14388) 222 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:56.879 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:56 smithi049 bash[23528]: audit 2024-09-20T22:19:55.107370+0000 mgr.a (mgr.14388) 223 : audit [DBG] from='client.18594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:56.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:56 smithi044 bash[22676]: audit 2024-09-20T22:19:55.107370+0000 mgr.a (mgr.14388) 223 : audit [DBG] from='client.18594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:56.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:56 smithi179 bash[23186]: audit 2024-09-20T22:19:55.107370+0000 mgr.a (mgr.14388) 223 : audit [DBG] from='client.18594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:19:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:57 smithi044 bash[22676]: cluster 2024-09-20T22:19:56.558689+0000 mgr.a (mgr.14388) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:57 smithi044 bash[22676]: audit 2024-09-20T22:19:57.078099+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:57 smithi044 bash[22676]: audit 2024-09-20T22:19:57.086800+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:57 smithi044 bash[22676]: audit 2024-09-20T22:19:57.097324+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:57 smithi044 bash[22676]: audit 2024-09-20T22:19:57.403668+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:57 smithi044 bash[22676]: audit 2024-09-20T22:19:57.412785+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:57 smithi044 bash[22676]: audit 2024-09-20T22:19:57.424058+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:57 smithi179 bash[23186]: cluster 2024-09-20T22:19:56.558689+0000 mgr.a (mgr.14388) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:57 smithi179 bash[23186]: audit 2024-09-20T22:19:57.078099+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:57 smithi179 bash[23186]: audit 2024-09-20T22:19:57.086800+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:57 smithi179 bash[23186]: audit 2024-09-20T22:19:57.097324+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:57 smithi179 bash[23186]: audit 2024-09-20T22:19:57.403668+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:57 smithi179 bash[23186]: audit 2024-09-20T22:19:57.412785+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:57 smithi179 bash[23186]: audit 2024-09-20T22:19:57.424058+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:57 smithi049 bash[23528]: cluster 2024-09-20T22:19:56.558689+0000 mgr.a (mgr.14388) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:19:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:57 smithi049 bash[23528]: audit 2024-09-20T22:19:57.078099+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:57 smithi049 bash[23528]: audit 2024-09-20T22:19:57.086800+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:57 smithi049 bash[23528]: audit 2024-09-20T22:19:57.097324+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:57 smithi049 bash[23528]: audit 2024-09-20T22:19:57.403668+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:57 smithi049 bash[23528]: audit 2024-09-20T22:19:57.412785+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:57 smithi049 bash[23528]: audit 2024-09-20T22:19:57.424058+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:59.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:59 smithi044 bash[22676]: cluster 2024-09-20T22:19:58.559490+0000 mgr.a (mgr.14388) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:59.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:59 smithi044 bash[22676]: audit 2024-09-20T22:19:59.239182+0000 mon.a (mon.0) 995 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:19:59.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:59 smithi044 bash[22676]: audit 2024-09-20T22:19:59.368042+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:59.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:59 smithi044 bash[22676]: audit 2024-09-20T22:19:59.374957+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:59.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:19:59 smithi044 bash[22676]: audit 2024-09-20T22:19:59.383993+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:59.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:59 smithi179 bash[23186]: cluster 2024-09-20T22:19:58.559490+0000 mgr.a (mgr.14388) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:19:59.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:59 smithi179 bash[23186]: audit 2024-09-20T22:19:59.239182+0000 mon.a (mon.0) 995 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:19:59.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:59 smithi179 bash[23186]: audit 2024-09-20T22:19:59.368042+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:59.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:59 smithi179 bash[23186]: audit 2024-09-20T22:19:59.374957+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:19:59.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:19:59 smithi179 bash[23186]: audit 2024-09-20T22:19:59.383993+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:00.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:59 smithi049 bash[23528]: cluster 2024-09-20T22:19:58.559490+0000 mgr.a (mgr.14388) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:20:00.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:59 smithi049 bash[23528]: audit 2024-09-20T22:19:59.239182+0000 mon.a (mon.0) 995 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:20:00.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:59 smithi049 bash[23528]: audit 2024-09-20T22:19:59.368042+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:00.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:59 smithi049 bash[23528]: audit 2024-09-20T22:19:59.374957+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:00.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:19:59 smithi049 bash[23528]: audit 2024-09-20T22:19:59.383993+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:00.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:00.525 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:00.525 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:00.837 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22930]: debug 2024-09-20T22:20:00.553+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:00.837 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22930]: debug 2024-09-20T22:20:00.557+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:01.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.839128+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.845188+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.852373+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.857824+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.859320+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:20:01.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.860454+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:20:01.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.866741+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: audit 2024-09-20T22:19:59.869782+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:20:01.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: cluster 2024-09-20T22:20:00.000130+0000 mon.a (mon.0) 1007 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:20:01.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: cluster 2024-09-20T22:20:00.000151+0000 mon.a (mon.0) 1008 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-20T22:20:01.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:00 smithi179 bash[23186]: cluster 2024-09-20T22:20:00.000157+0000 mon.a (mon.0) 1009 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.839128+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.845188+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.852373+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.857824+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.859320+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.860454+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.866741+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: audit 2024-09-20T22:19:59.869782+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: cluster 2024-09-20T22:20:00.000130+0000 mon.a (mon.0) 1007 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:20:01.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: cluster 2024-09-20T22:20:00.000151+0000 mon.a (mon.0) 1008 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-20T22:20:01.186 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:00 smithi049 bash[23528]: cluster 2024-09-20T22:20:00.000157+0000 mon.a (mon.0) 1009 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:01.222 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.839128+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.845188+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.852373+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.857824+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.859320+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.860454+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.866741+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: audit 2024-09-20T22:19:59.869782+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: cluster 2024-09-20T22:20:00.000130+0000 mon.a (mon.0) 1007 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: cluster 2024-09-20T22:20:00.000151+0000 mon.a (mon.0) 1008 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-20T22:20:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:00 smithi044 bash[22676]: cluster 2024-09-20T22:20:00.000157+0000 mon.a (mon.0) 1009 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:01 smithi044 bash[22676]: audit 2024-09-20T22:19:59.870592+0000 mgr.a (mgr.14388) 226 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:20:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:01 smithi044 bash[22676]: audit 2024-09-20T22:20:00.557063+0000 mgr.a (mgr.14388) 227 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:20:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:01 smithi044 bash[22676]: cephadm 2024-09-20T22:20:00.558253+0000 mgr.a (mgr.14388) 228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:01 smithi044 bash[22676]: cluster 2024-09-20T22:20:00.560627+0000 mgr.a (mgr.14388) 229 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:01 smithi044 bash[22676]: audit 2024-09-20T22:20:00.833860+0000 mgr.a (mgr.14388) 230 : audit [DBG] from='client.18777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:01 smithi179 bash[23186]: audit 2024-09-20T22:19:59.870592+0000 mgr.a (mgr.14388) 226 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:20:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:01 smithi179 bash[23186]: audit 2024-09-20T22:20:00.557063+0000 mgr.a (mgr.14388) 227 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:20:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:01 smithi179 bash[23186]: cephadm 2024-09-20T22:20:00.558253+0000 mgr.a (mgr.14388) 228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:01 smithi179 bash[23186]: cluster 2024-09-20T22:20:00.560627+0000 mgr.a (mgr.14388) 229 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:01 smithi179 bash[23186]: audit 2024-09-20T22:20:00.833860+0000 mgr.a (mgr.14388) 230 : audit [DBG] from='client.18777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:02.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:01 smithi049 bash[23528]: audit 2024-09-20T22:19:59.870592+0000 mgr.a (mgr.14388) 226 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:20:02.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:01 smithi049 bash[23528]: audit 2024-09-20T22:20:00.557063+0000 mgr.a (mgr.14388) 227 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:20:02.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:01 smithi049 bash[23528]: cephadm 2024-09-20T22:20:00.558253+0000 mgr.a (mgr.14388) 228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:20:02.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:01 smithi049 bash[23528]: cluster 2024-09-20T22:20:00.560627+0000 mgr.a (mgr.14388) 229 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:02.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:01 smithi049 bash[23528]: audit 2024-09-20T22:20:00.833860+0000 mgr.a (mgr.14388) 230 : audit [DBG] from='client.18777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:03.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:02 smithi044 bash[22676]: cluster 2024-09-20T22:20:02.561479+0000 mgr.a (mgr.14388) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:20:03.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:02 smithi179 bash[23186]: cluster 2024-09-20T22:20:02.561479+0000 mgr.a (mgr.14388) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:20:03.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:02 smithi049 bash[23528]: cluster 2024-09-20T22:20:02.561479+0000 mgr.a (mgr.14388) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:20:05.800 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:05 smithi044 bash[22676]: cluster 2024-09-20T22:20:04.562062+0000 mgr.a (mgr.14388) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:20:05.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:05 smithi179 bash[23186]: cluster 2024-09-20T22:20:04.562062+0000 mgr.a (mgr.14388) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:20:06.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:05 smithi049 bash[23528]: cluster 2024-09-20T22:20:04.562062+0000 mgr.a (mgr.14388) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:20:06.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:06.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:06.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:07.029 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:07.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:07 smithi044 bash[22676]: cluster 2024-09-20T22:20:06.563408+0000 mgr.a (mgr.14388) 233 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:07.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:07 smithi044 bash[22676]: audit 2024-09-20T22:20:06.591147+0000 mgr.a (mgr.14388) 234 : audit [DBG] from='client.18855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:07.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:07 smithi179 bash[23186]: cluster 2024-09-20T22:20:06.563408+0000 mgr.a (mgr.14388) 233 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:07.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:07 smithi179 bash[23186]: audit 2024-09-20T22:20:06.591147+0000 mgr.a (mgr.14388) 234 : audit [DBG] from='client.18855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:08.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:07 smithi049 bash[23528]: cluster 2024-09-20T22:20:06.563408+0000 mgr.a (mgr.14388) 233 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:08.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:07 smithi049 bash[23528]: audit 2024-09-20T22:20:06.591147+0000 mgr.a (mgr.14388) 234 : audit [DBG] from='client.18855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:09 smithi044 bash[22676]: cluster 2024-09-20T22:20:08.564310+0000 mgr.a (mgr.14388) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:09.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:09 smithi179 bash[23186]: cluster 2024-09-20T22:20:08.564310+0000 mgr.a (mgr.14388) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:10.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:09 smithi049 bash[23528]: cluster 2024-09-20T22:20:08.564310+0000 mgr.a (mgr.14388) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:11 smithi044 bash[22676]: cluster 2024-09-20T22:20:10.566547+0000 mgr.a (mgr.14388) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:11.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:11 smithi179 bash[23186]: cluster 2024-09-20T22:20:10.566547+0000 mgr.a (mgr.14388) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:12.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:12.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:12.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:12.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:11 smithi049 bash[23528]: cluster 2024-09-20T22:20:10.566547+0000 mgr.a (mgr.14388) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:12.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:13.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:13 smithi044 bash[22676]: audit 2024-09-20T22:20:12.367645+0000 mgr.a (mgr.14388) 237 : audit [DBG] from='client.18933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:13.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:13 smithi044 bash[22676]: cluster 2024-09-20T22:20:12.567107+0000 mgr.a (mgr.14388) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:13.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:13 smithi179 bash[23186]: audit 2024-09-20T22:20:12.367645+0000 mgr.a (mgr.14388) 237 : audit [DBG] from='client.18933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:13.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:13 smithi179 bash[23186]: cluster 2024-09-20T22:20:12.567107+0000 mgr.a (mgr.14388) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:14.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:13 smithi049 bash[23528]: audit 2024-09-20T22:20:12.367645+0000 mgr.a (mgr.14388) 237 : audit [DBG] from='client.18933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:14.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:13 smithi049 bash[23528]: cluster 2024-09-20T22:20:12.567107+0000 mgr.a (mgr.14388) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:15 smithi044 bash[22676]: cluster 2024-09-20T22:20:14.568088+0000 mgr.a (mgr.14388) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:15.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:15 smithi179 bash[23186]: cluster 2024-09-20T22:20:14.568088+0000 mgr.a (mgr.14388) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:16.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:15 smithi049 bash[23528]: cluster 2024-09-20T22:20:14.568088+0000 mgr.a (mgr.14388) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:17.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:17.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:17.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:17 smithi049 bash[23528]: cluster 2024-09-20T22:20:16.570409+0000 mgr.a (mgr.14388) 240 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:17 smithi049 bash[23528]: audit 2024-09-20T22:20:17.291865+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:17 smithi049 bash[23528]: audit 2024-09-20T22:20:17.301936+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:17 smithi049 bash[23528]: audit 2024-09-20T22:20:17.313630+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:17 smithi049 bash[23528]: audit 2024-09-20T22:20:17.581558+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:17 smithi049 bash[23528]: audit 2024-09-20T22:20:17.591668+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:17 smithi049 bash[23528]: audit 2024-09-20T22:20:17.603093+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:17 smithi044 bash[22676]: cluster 2024-09-20T22:20:16.570409+0000 mgr.a (mgr.14388) 240 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:17 smithi044 bash[22676]: audit 2024-09-20T22:20:17.291865+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:17 smithi044 bash[22676]: audit 2024-09-20T22:20:17.301936+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:17 smithi044 bash[22676]: audit 2024-09-20T22:20:17.313630+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:17 smithi044 bash[22676]: audit 2024-09-20T22:20:17.581558+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:17 smithi044 bash[22676]: audit 2024-09-20T22:20:17.591668+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:17 smithi044 bash[22676]: audit 2024-09-20T22:20:17.603093+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:17 smithi179 bash[23186]: cluster 2024-09-20T22:20:16.570409+0000 mgr.a (mgr.14388) 240 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:20:17.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:17 smithi179 bash[23186]: audit 2024-09-20T22:20:17.291865+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:17 smithi179 bash[23186]: audit 2024-09-20T22:20:17.301936+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:17 smithi179 bash[23186]: audit 2024-09-20T22:20:17.313630+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:17 smithi179 bash[23186]: audit 2024-09-20T22:20:17.581558+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:17 smithi179 bash[23186]: audit 2024-09-20T22:20:17.591668+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:17.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:17 smithi179 bash[23186]: audit 2024-09-20T22:20:17.603093+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:18.537 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:18.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:18.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:18.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:18.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:19 smithi179 bash[23186]: audit 2024-09-20T22:20:18.122507+0000 mgr.a (mgr.14388) 241 : audit [DBG] from='client.19008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:19 smithi179 bash[23186]: cluster 2024-09-20T22:20:18.571035+0000 mgr.a (mgr.14388) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:19 smithi179 bash[23186]: audit 2024-09-20T22:20:19.579962+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:19 smithi179 bash[23186]: audit 2024-09-20T22:20:19.587386+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:19.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:19 smithi179 bash[23186]: audit 2024-09-20T22:20:19.593422+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:19 smithi044 bash[22676]: audit 2024-09-20T22:20:18.122507+0000 mgr.a (mgr.14388) 241 : audit [DBG] from='client.19008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:19 smithi044 bash[22676]: cluster 2024-09-20T22:20:18.571035+0000 mgr.a (mgr.14388) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:19 smithi044 bash[22676]: audit 2024-09-20T22:20:19.579962+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:19 smithi044 bash[22676]: audit 2024-09-20T22:20:19.587386+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:19 smithi044 bash[22676]: audit 2024-09-20T22:20:19.593422+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:19 smithi049 bash[23528]: audit 2024-09-20T22:20:18.122507+0000 mgr.a (mgr.14388) 241 : audit [DBG] from='client.19008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:19 smithi049 bash[23528]: cluster 2024-09-20T22:20:18.571035+0000 mgr.a (mgr.14388) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:19 smithi049 bash[23528]: audit 2024-09-20T22:20:19.579962+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:19 smithi049 bash[23528]: audit 2024-09-20T22:20:19.587386+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:19 smithi049 bash[23528]: audit 2024-09-20T22:20:19.593422+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:21.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:21 smithi179 bash[23186]: cluster 2024-09-20T22:20:20.573163+0000 mgr.a (mgr.14388) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:21 smithi044 bash[22676]: cluster 2024-09-20T22:20:20.573163+0000 mgr.a (mgr.14388) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:21 smithi049 bash[23528]: cluster 2024-09-20T22:20:20.573163+0000 mgr.a (mgr.14388) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:23.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:23 smithi044 bash[22676]: cluster 2024-09-20T22:20:22.573916+0000 mgr.a (mgr.14388) 244 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:23 smithi179 bash[23186]: cluster 2024-09-20T22:20:22.573916+0000 mgr.a (mgr.14388) 244 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:24.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:23 smithi049 bash[23528]: cluster 2024-09-20T22:20:22.573916+0000 mgr.a (mgr.14388) 244 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:24.302 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:24.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:24.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:24.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:24.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:24.943 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:24 smithi044 bash[22676]: audit 2024-09-20T22:20:23.871180+0000 mgr.a (mgr.14388) 245 : audit [DBG] from='client.19083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:24.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:24 smithi179 bash[23186]: audit 2024-09-20T22:20:23.871180+0000 mgr.a (mgr.14388) 245 : audit [DBG] from='client.19083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:25.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:24 smithi049 bash[23528]: audit 2024-09-20T22:20:23.871180+0000 mgr.a (mgr.14388) 245 : audit [DBG] from='client.19083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:25.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:25 smithi044 bash[22676]: cluster 2024-09-20T22:20:24.574871+0000 mgr.a (mgr.14388) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:25.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:25 smithi179 bash[23186]: cluster 2024-09-20T22:20:24.574871+0000 mgr.a (mgr.14388) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:26.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:25 smithi049 bash[23528]: cluster 2024-09-20T22:20:24.574871+0000 mgr.a (mgr.14388) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:27.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:27 smithi044 bash[22676]: cluster 2024-09-20T22:20:26.577183+0000 mgr.a (mgr.14388) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:27.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:27 smithi179 bash[23186]: cluster 2024-09-20T22:20:26.577183+0000 mgr.a (mgr.14388) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:28.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:27 smithi049 bash[23528]: cluster 2024-09-20T22:20:26.577183+0000 mgr.a (mgr.14388) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:29.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:29.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:29.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:29.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:29 smithi044 bash[22676]: cluster 2024-09-20T22:20:28.578051+0000 mgr.a (mgr.14388) 248 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:29.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:29 smithi179 bash[23186]: cluster 2024-09-20T22:20:28.578051+0000 mgr.a (mgr.14388) 248 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:30.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:29 smithi049 bash[23528]: cluster 2024-09-20T22:20:28.578051+0000 mgr.a (mgr.14388) 248 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:30.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:30 smithi044 bash[22676]: audit 2024-09-20T22:20:29.646495+0000 mgr.a (mgr.14388) 249 : audit [DBG] from='client.19161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:30.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:30 smithi179 bash[23186]: audit 2024-09-20T22:20:29.646495+0000 mgr.a (mgr.14388) 249 : audit [DBG] from='client.19161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:31.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:30 smithi049 bash[23528]: audit 2024-09-20T22:20:29.646495+0000 mgr.a (mgr.14388) 249 : audit [DBG] from='client.19161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:31.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:31 smithi044 bash[22676]: cluster 2024-09-20T22:20:30.580820+0000 mgr.a (mgr.14388) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:20:31.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:31 smithi179 bash[23186]: cluster 2024-09-20T22:20:30.580820+0000 mgr.a (mgr.14388) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:20:32.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:31 smithi049 bash[23528]: cluster 2024-09-20T22:20:30.580820+0000 mgr.a (mgr.14388) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:20:33.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:33 smithi044 bash[22676]: cluster 2024-09-20T22:20:32.581691+0000 mgr.a (mgr.14388) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:20:33.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:33 smithi179 bash[23186]: cluster 2024-09-20T22:20:32.581691+0000 mgr.a (mgr.14388) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:20:34.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:33 smithi049 bash[23528]: cluster 2024-09-20T22:20:32.581691+0000 mgr.a (mgr.14388) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:20:35.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:35.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:35.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:35.860 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:35.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:35.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:35.974 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:35 smithi049 bash[23528]: cluster 2024-09-20T22:20:34.582466+0000 mgr.a (mgr.14388) 252 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:20:35.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:35 smithi044 bash[22676]: cluster 2024-09-20T22:20:34.582466+0000 mgr.a (mgr.14388) 252 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:20:35.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:35 smithi179 bash[23186]: cluster 2024-09-20T22:20:34.582466+0000 mgr.a (mgr.14388) 252 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:20:36.970 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:36 smithi049 bash[23528]: audit 2024-09-20T22:20:35.416663+0000 mgr.a (mgr.14388) 253 : audit [DBG] from='client.19239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:36 smithi044 bash[22676]: audit 2024-09-20T22:20:35.416663+0000 mgr.a (mgr.14388) 253 : audit [DBG] from='client.19239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:36.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:36 smithi179 bash[23186]: audit 2024-09-20T22:20:35.416663+0000 mgr.a (mgr.14388) 253 : audit [DBG] from='client.19239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:37 smithi044 bash[22676]: cluster 2024-09-20T22:20:36.585209+0000 mgr.a (mgr.14388) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:37 smithi044 bash[22676]: audit 2024-09-20T22:20:37.525094+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:37 smithi044 bash[22676]: audit 2024-09-20T22:20:37.534061+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:37 smithi044 bash[22676]: audit 2024-09-20T22:20:37.544634+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:37.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:37 smithi179 bash[23186]: cluster 2024-09-20T22:20:36.585209+0000 mgr.a (mgr.14388) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:37 smithi179 bash[23186]: audit 2024-09-20T22:20:37.525094+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:37 smithi179 bash[23186]: audit 2024-09-20T22:20:37.534061+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:37 smithi179 bash[23186]: audit 2024-09-20T22:20:37.544634+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:38.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:37 smithi049 bash[23528]: cluster 2024-09-20T22:20:36.585209+0000 mgr.a (mgr.14388) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:38.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:37 smithi049 bash[23528]: audit 2024-09-20T22:20:37.525094+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:38.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:37 smithi049 bash[23528]: audit 2024-09-20T22:20:37.534061+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:38.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:37 smithi049 bash[23528]: audit 2024-09-20T22:20:37.544634+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:38 smithi049 bash[23528]: audit 2024-09-20T22:20:37.785055+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:38 smithi049 bash[23528]: audit 2024-09-20T22:20:37.794268+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:38 smithi049 bash[23528]: audit 2024-09-20T22:20:37.804414+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:38 smithi044 bash[22676]: audit 2024-09-20T22:20:37.785055+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:38 smithi044 bash[22676]: audit 2024-09-20T22:20:37.794268+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:38 smithi044 bash[22676]: audit 2024-09-20T22:20:37.804414+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:38 smithi179 bash[23186]: audit 2024-09-20T22:20:37.785055+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:38 smithi179 bash[23186]: audit 2024-09-20T22:20:37.794268+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:39.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:38 smithi179 bash[23186]: audit 2024-09-20T22:20:37.804414+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:40.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:39 smithi179 bash[23186]: cluster 2024-09-20T22:20:38.586027+0000 mgr.a (mgr.14388) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:20:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:39 smithi044 bash[22676]: cluster 2024-09-20T22:20:38.586027+0000 mgr.a (mgr.14388) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:20:40.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:39 smithi049 bash[23528]: cluster 2024-09-20T22:20:38.586027+0000 mgr.a (mgr.14388) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:20:40.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:40.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:40.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:41.079 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:40 smithi179 bash[23186]: audit 2024-09-20T22:20:39.808831+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.080 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:40 smithi179 bash[23186]: audit 2024-09-20T22:20:39.826322+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.080 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:40 smithi179 bash[23186]: audit 2024-09-20T22:20:39.835987+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:40 smithi044 bash[22676]: audit 2024-09-20T22:20:39.808831+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:40 smithi044 bash[22676]: audit 2024-09-20T22:20:39.826322+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:40 smithi044 bash[22676]: audit 2024-09-20T22:20:39.835987+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:40 smithi049 bash[23528]: audit 2024-09-20T22:20:39.808831+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:40 smithi049 bash[23528]: audit 2024-09-20T22:20:39.826322+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:40 smithi049 bash[23528]: audit 2024-09-20T22:20:39.835987+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:41.627 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:41.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:41 smithi044 bash[22676]: cluster 2024-09-20T22:20:40.587976+0000 mgr.a (mgr.14388) 256 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:42.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:41 smithi179 bash[23186]: cluster 2024-09-20T22:20:40.587976+0000 mgr.a (mgr.14388) 256 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:41 smithi049 bash[23528]: cluster 2024-09-20T22:20:40.587976+0000 mgr.a (mgr.14388) 256 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:43.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:42 smithi044 bash[22676]: audit 2024-09-20T22:20:41.195622+0000 mgr.a (mgr.14388) 257 : audit [DBG] from='client.19317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:43.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:42 smithi179 bash[23186]: audit 2024-09-20T22:20:41.195622+0000 mgr.a (mgr.14388) 257 : audit [DBG] from='client.19317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:43.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:42 smithi049 bash[23528]: audit 2024-09-20T22:20:41.195622+0000 mgr.a (mgr.14388) 257 : audit [DBG] from='client.19317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:44.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:43 smithi044 bash[22676]: cluster 2024-09-20T22:20:42.588929+0000 mgr.a (mgr.14388) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:20:44.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:43 smithi179 bash[23186]: cluster 2024-09-20T22:20:42.588929+0000 mgr.a (mgr.14388) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:20:44.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:43 smithi049 bash[23528]: cluster 2024-09-20T22:20:42.588929+0000 mgr.a (mgr.14388) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:20:46.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:45 smithi044 bash[22676]: cluster 2024-09-20T22:20:44.589573+0000 mgr.a (mgr.14388) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:20:46.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:45 smithi179 bash[23186]: cluster 2024-09-20T22:20:44.589573+0000 mgr.a (mgr.14388) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:20:46.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:45 smithi049 bash[23528]: cluster 2024-09-20T22:20:44.589573+0000 mgr.a (mgr.14388) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:20:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:47.384 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:47.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:47.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:47.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:47.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:48.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:47 smithi044 bash[22676]: cluster 2024-09-20T22:20:46.591827+0000 mgr.a (mgr.14388) 260 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:20:48.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:47 smithi179 bash[23186]: cluster 2024-09-20T22:20:46.591827+0000 mgr.a (mgr.14388) 260 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:20:48.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:47 smithi049 bash[23528]: cluster 2024-09-20T22:20:46.591827+0000 mgr.a (mgr.14388) 260 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:20:49.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:48 smithi044 bash[22676]: audit 2024-09-20T22:20:46.963616+0000 mgr.a (mgr.14388) 261 : audit [DBG] from='client.19389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:49.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:48 smithi179 bash[23186]: audit 2024-09-20T22:20:46.963616+0000 mgr.a (mgr.14388) 261 : audit [DBG] from='client.19389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:49.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:48 smithi049 bash[23528]: audit 2024-09-20T22:20:46.963616+0000 mgr.a (mgr.14388) 261 : audit [DBG] from='client.19389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:50.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:49 smithi044 bash[22676]: cluster 2024-09-20T22:20:48.592872+0000 mgr.a (mgr.14388) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:50.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:49 smithi179 bash[23186]: cluster 2024-09-20T22:20:48.592872+0000 mgr.a (mgr.14388) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:50.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:49 smithi049 bash[23528]: cluster 2024-09-20T22:20:48.592872+0000 mgr.a (mgr.14388) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:52.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:51 smithi044 bash[22676]: cluster 2024-09-20T22:20:50.595276+0000 mgr.a (mgr.14388) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:52.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:51 smithi179 bash[23186]: cluster 2024-09-20T22:20:50.595276+0000 mgr.a (mgr.14388) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:52.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:51 smithi049 bash[23528]: cluster 2024-09-20T22:20:50.595276+0000 mgr.a (mgr.14388) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:52.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:53.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:53.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:54.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:53 smithi044 bash[22676]: cluster 2024-09-20T22:20:52.596052+0000 mgr.a (mgr.14388) 264 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:54.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:53 smithi044 bash[22676]: audit 2024-09-20T22:20:52.729398+0000 mgr.a (mgr.14388) 265 : audit [DBG] from='client.19464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:54.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:53 smithi179 bash[23186]: cluster 2024-09-20T22:20:52.596052+0000 mgr.a (mgr.14388) 264 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:54.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:53 smithi179 bash[23186]: audit 2024-09-20T22:20:52.729398+0000 mgr.a (mgr.14388) 265 : audit [DBG] from='client.19464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:54.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:53 smithi049 bash[23528]: cluster 2024-09-20T22:20:52.596052+0000 mgr.a (mgr.14388) 264 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:54.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:53 smithi049 bash[23528]: audit 2024-09-20T22:20:52.729398+0000 mgr.a (mgr.14388) 265 : audit [DBG] from='client.19464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:56.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:55 smithi044 bash[22676]: cluster 2024-09-20T22:20:54.597064+0000 mgr.a (mgr.14388) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:56.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:55 smithi179 bash[23186]: cluster 2024-09-20T22:20:54.597064+0000 mgr.a (mgr.14388) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:56.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:55 smithi049 bash[23528]: cluster 2024-09-20T22:20:54.597064+0000 mgr.a (mgr.14388) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:58.000 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:57 smithi049 bash[23528]: cluster 2024-09-20T22:20:56.599442+0000 mgr.a (mgr.14388) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:58.001 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:57 smithi049 bash[23528]: audit 2024-09-20T22:20:57.756580+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.001 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:57 smithi049 bash[23528]: audit 2024-09-20T22:20:57.765402+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.001 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:57 smithi049 bash[23528]: audit 2024-09-20T22:20:57.776107+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:20:58.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:20:58.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:20:58.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:57 smithi044 bash[22676]: cluster 2024-09-20T22:20:56.599442+0000 mgr.a (mgr.14388) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:58.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:57 smithi044 bash[22676]: audit 2024-09-20T22:20:57.756580+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:57 smithi044 bash[22676]: audit 2024-09-20T22:20:57.765402+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:57 smithi044 bash[22676]: audit 2024-09-20T22:20:57.776107+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:57 smithi179 bash[23186]: cluster 2024-09-20T22:20:56.599442+0000 mgr.a (mgr.14388) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:20:58.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:57 smithi179 bash[23186]: audit 2024-09-20T22:20:57.756580+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:57 smithi179 bash[23186]: audit 2024-09-20T22:20:57.765402+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:57 smithi179 bash[23186]: audit 2024-09-20T22:20:57.776107+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:58.938 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:20:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:20:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:20:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:20:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:20:59.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:58 smithi044 bash[22676]: audit 2024-09-20T22:20:57.981062+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:58 smithi044 bash[22676]: audit 2024-09-20T22:20:57.990197+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:58 smithi044 bash[22676]: audit 2024-09-20T22:20:58.000076+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:58 smithi044 bash[22676]: audit 2024-09-20T22:20:58.511561+0000 mgr.a (mgr.14388) 268 : audit [DBG] from='client.19539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:59.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:20:58 smithi044 bash[22676]: cluster 2024-09-20T22:20:58.600015+0000 mgr.a (mgr.14388) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:59.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:58 smithi179 bash[23186]: audit 2024-09-20T22:20:57.981062+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:58 smithi179 bash[23186]: audit 2024-09-20T22:20:57.990197+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:58 smithi179 bash[23186]: audit 2024-09-20T22:20:58.000076+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:58 smithi179 bash[23186]: audit 2024-09-20T22:20:58.511561+0000 mgr.a (mgr.14388) 268 : audit [DBG] from='client.19539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:59.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:20:58 smithi179 bash[23186]: cluster 2024-09-20T22:20:58.600015+0000 mgr.a (mgr.14388) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:20:59.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:58 smithi049 bash[23528]: audit 2024-09-20T22:20:57.981062+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:58 smithi049 bash[23528]: audit 2024-09-20T22:20:57.990197+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:58 smithi049 bash[23528]: audit 2024-09-20T22:20:58.000076+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:20:59.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:58 smithi049 bash[23528]: audit 2024-09-20T22:20:58.511561+0000 mgr.a (mgr.14388) 268 : audit [DBG] from='client.19539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:20:59.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:20:58 smithi049 bash[23528]: cluster 2024-09-20T22:20:58.600015+0000 mgr.a (mgr.14388) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:01.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:01 smithi049 bash[23528]: audit 2024-09-20T22:21:00.016521+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:01 smithi049 bash[23528]: audit 2024-09-20T22:21:00.023800+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:01 smithi049 bash[23528]: audit 2024-09-20T22:21:00.031952+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:01 smithi049 bash[23528]: cluster 2024-09-20T22:21:00.602373+0000 mgr.a (mgr.14388) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:01.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:01 smithi049 bash[23528]: audit 2024-09-20T22:21:00.610308+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:21:01.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:01 smithi044 bash[22676]: audit 2024-09-20T22:21:00.016521+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:01 smithi044 bash[22676]: audit 2024-09-20T22:21:00.023800+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:01 smithi044 bash[22676]: audit 2024-09-20T22:21:00.031952+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:01 smithi044 bash[22676]: cluster 2024-09-20T22:21:00.602373+0000 mgr.a (mgr.14388) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:01.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:01 smithi044 bash[22676]: audit 2024-09-20T22:21:00.610308+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:21:01.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:01 smithi179 bash[23186]: audit 2024-09-20T22:21:00.016521+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:01 smithi179 bash[23186]: audit 2024-09-20T22:21:00.023800+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:01 smithi179 bash[23186]: audit 2024-09-20T22:21:00.031952+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:01.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:01 smithi179 bash[23186]: cluster 2024-09-20T22:21:00.602373+0000 mgr.a (mgr.14388) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:01.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:01 smithi179 bash[23186]: audit 2024-09-20T22:21:00.610308+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:21:02.230 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:02 smithi179 bash[23186]: audit 2024-09-20T22:21:01.169442+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.230 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:02 smithi179 bash[23186]: audit 2024-09-20T22:21:01.177691+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.230 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:02 smithi179 bash[23186]: audit 2024-09-20T22:21:01.180283+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:21:02.231 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:02 smithi179 bash[23186]: audit 2024-09-20T22:21:01.182156+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:21:02.231 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:02 smithi179 bash[23186]: audit 2024-09-20T22:21:01.192284+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.231 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:02 smithi179 bash[23186]: audit 2024-09-20T22:21:01.198435+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:21:02.231 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:02 smithi179 bash[23186]: audit 2024-09-20T22:21:01.200813+0000 mgr.a (mgr.14388) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:21:01 smithi044 bash[22930]: debug 2024-09-20T22:21:01.960+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:21:01 smithi044 bash[22930]: debug 2024-09-20T22:21:01.960+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:02 smithi044 bash[22676]: audit 2024-09-20T22:21:01.169442+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:02 smithi044 bash[22676]: audit 2024-09-20T22:21:01.177691+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:02 smithi044 bash[22676]: audit 2024-09-20T22:21:01.180283+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:02 smithi044 bash[22676]: audit 2024-09-20T22:21:01.182156+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:02 smithi044 bash[22676]: audit 2024-09-20T22:21:01.192284+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:02 smithi044 bash[22676]: audit 2024-09-20T22:21:01.198435+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:21:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:02 smithi044 bash[22676]: audit 2024-09-20T22:21:01.200813+0000 mgr.a (mgr.14388) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:21:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:02 smithi049 bash[23528]: audit 2024-09-20T22:21:01.169442+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:02 smithi049 bash[23528]: audit 2024-09-20T22:21:01.177691+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:02 smithi049 bash[23528]: audit 2024-09-20T22:21:01.180283+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:21:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:02 smithi049 bash[23528]: audit 2024-09-20T22:21:01.182156+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:21:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:02 smithi049 bash[23528]: audit 2024-09-20T22:21:01.192284+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:02 smithi049 bash[23528]: audit 2024-09-20T22:21:01.198435+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:21:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:02 smithi049 bash[23528]: audit 2024-09-20T22:21:01.200813+0000 mgr.a (mgr.14388) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:21:03.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:03 smithi044 bash[22676]: audit 2024-09-20T22:21:01.962055+0000 mgr.a (mgr.14388) 272 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:21:03.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:03 smithi044 bash[22676]: cephadm 2024-09-20T22:21:01.963756+0000 mgr.a (mgr.14388) 273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:21:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:03 smithi044 bash[22676]: cluster 2024-09-20T22:21:02.603271+0000 mgr.a (mgr.14388) 274 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:03.497 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:03 smithi179 bash[23186]: audit 2024-09-20T22:21:01.962055+0000 mgr.a (mgr.14388) 272 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:21:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:03 smithi179 bash[23186]: cephadm 2024-09-20T22:21:01.963756+0000 mgr.a (mgr.14388) 273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:21:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:03 smithi179 bash[23186]: cluster 2024-09-20T22:21:02.603271+0000 mgr.a (mgr.14388) 274 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:03.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:03 smithi049 bash[23528]: audit 2024-09-20T22:21:01.962055+0000 mgr.a (mgr.14388) 272 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:21:03.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:03 smithi049 bash[23528]: cephadm 2024-09-20T22:21:01.963756+0000 mgr.a (mgr.14388) 273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:21:03.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:03 smithi049 bash[23528]: cluster 2024-09-20T22:21:02.603271+0000 mgr.a (mgr.14388) 274 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:03.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:03.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:03.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:04.720 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:05.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:05 smithi044 bash[22676]: audit 2024-09-20T22:21:04.280328+0000 mgr.a (mgr.14388) 275 : audit [DBG] from='client.19719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:05.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:05 smithi044 bash[22676]: cluster 2024-09-20T22:21:04.603806+0000 mgr.a (mgr.14388) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:05.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:05 smithi179 bash[23186]: audit 2024-09-20T22:21:04.280328+0000 mgr.a (mgr.14388) 275 : audit [DBG] from='client.19719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:05.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:05 smithi179 bash[23186]: cluster 2024-09-20T22:21:04.603806+0000 mgr.a (mgr.14388) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:06.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:05 smithi049 bash[23528]: audit 2024-09-20T22:21:04.280328+0000 mgr.a (mgr.14388) 275 : audit [DBG] from='client.19719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:06.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:05 smithi049 bash[23528]: cluster 2024-09-20T22:21:04.603806+0000 mgr.a (mgr.14388) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:07.931 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:07 smithi044 bash[22676]: cluster 2024-09-20T22:21:06.606212+0000 mgr.a (mgr.14388) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:07.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:07 smithi179 bash[23186]: cluster 2024-09-20T22:21:06.606212+0000 mgr.a (mgr.14388) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:08.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:07 smithi049 bash[23528]: cluster 2024-09-20T22:21:06.606212+0000 mgr.a (mgr.14388) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:09.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:09 smithi044 bash[22676]: cluster 2024-09-20T22:21:08.606872+0000 mgr.a (mgr.14388) 278 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:09.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:09 smithi179 bash[23186]: cluster 2024-09-20T22:21:08.606872+0000 mgr.a (mgr.14388) 278 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:10.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:09 smithi049 bash[23528]: cluster 2024-09-20T22:21:08.606872+0000 mgr.a (mgr.14388) 278 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:10.504 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:11 smithi044 bash[22676]: audit 2024-09-20T22:21:10.066047+0000 mgr.a (mgr.14388) 279 : audit [DBG] from='client.19794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:11 smithi044 bash[22676]: cluster 2024-09-20T22:21:10.609641+0000 mgr.a (mgr.14388) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:11.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:11 smithi179 bash[23186]: audit 2024-09-20T22:21:10.066047+0000 mgr.a (mgr.14388) 279 : audit [DBG] from='client.19794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:11.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:11 smithi179 bash[23186]: cluster 2024-09-20T22:21:10.609641+0000 mgr.a (mgr.14388) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:12.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:11 smithi049 bash[23528]: audit 2024-09-20T22:21:10.066047+0000 mgr.a (mgr.14388) 279 : audit [DBG] from='client.19794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:12.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:11 smithi049 bash[23528]: cluster 2024-09-20T22:21:10.609641+0000 mgr.a (mgr.14388) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:13.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:13 smithi044 bash[22676]: cluster 2024-09-20T22:21:12.610440+0000 mgr.a (mgr.14388) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:21:13.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:13 smithi179 bash[23186]: cluster 2024-09-20T22:21:12.610440+0000 mgr.a (mgr.14388) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:21:14.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:13 smithi049 bash[23528]: cluster 2024-09-20T22:21:12.610440+0000 mgr.a (mgr.14388) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:21:15.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:15.507 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:15.507 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:15.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:15 smithi044 bash[22676]: cluster 2024-09-20T22:21:14.611210+0000 mgr.a (mgr.14388) 282 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:21:15.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:15 smithi179 bash[23186]: cluster 2024-09-20T22:21:14.611210+0000 mgr.a (mgr.14388) 282 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:21:16.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:15 smithi049 bash[23528]: cluster 2024-09-20T22:21:14.611210+0000 mgr.a (mgr.14388) 282 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:21:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:16.977 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:16 smithi049 bash[23528]: audit 2024-09-20T22:21:15.846465+0000 mgr.a (mgr.14388) 283 : audit [DBG] from='client.19872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:16.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:16 smithi044 bash[22676]: audit 2024-09-20T22:21:15.846465+0000 mgr.a (mgr.14388) 283 : audit [DBG] from='client.19872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:16.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:16 smithi179 bash[23186]: audit 2024-09-20T22:21:15.846465+0000 mgr.a (mgr.14388) 283 : audit [DBG] from='client.19872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:17 smithi044 bash[22676]: cluster 2024-09-20T22:21:16.613931+0000 mgr.a (mgr.14388) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:17.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:17 smithi179 bash[23186]: cluster 2024-09-20T22:21:16.613931+0000 mgr.a (mgr.14388) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:18.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:17 smithi049 bash[23528]: cluster 2024-09-20T22:21:16.613931+0000 mgr.a (mgr.14388) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:21:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:18 smithi044 bash[22676]: audit 2024-09-20T22:21:17.988703+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:18 smithi044 bash[22676]: audit 2024-09-20T22:21:17.998736+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:18 smithi044 bash[22676]: audit 2024-09-20T22:21:18.009520+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:18 smithi044 bash[22676]: audit 2024-09-20T22:21:18.173306+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:18 smithi044 bash[22676]: audit 2024-09-20T22:21:18.182273+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:18 smithi044 bash[22676]: audit 2024-09-20T22:21:18.192748+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:18 smithi044 bash[22676]: cluster 2024-09-20T22:21:18.614837+0000 mgr.a (mgr.14388) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:21:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:18 smithi179 bash[23186]: audit 2024-09-20T22:21:17.988703+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:18 smithi179 bash[23186]: audit 2024-09-20T22:21:17.998736+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:18 smithi179 bash[23186]: audit 2024-09-20T22:21:18.009520+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:18 smithi179 bash[23186]: audit 2024-09-20T22:21:18.173306+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:18 smithi179 bash[23186]: audit 2024-09-20T22:21:18.182273+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:18 smithi179 bash[23186]: audit 2024-09-20T22:21:18.192748+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:18 smithi179 bash[23186]: cluster 2024-09-20T22:21:18.614837+0000 mgr.a (mgr.14388) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:21:19.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:18 smithi049 bash[23528]: audit 2024-09-20T22:21:17.988703+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:18 smithi049 bash[23528]: audit 2024-09-20T22:21:17.998736+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:18 smithi049 bash[23528]: audit 2024-09-20T22:21:18.009520+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:18 smithi049 bash[23528]: audit 2024-09-20T22:21:18.173306+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:18 smithi049 bash[23528]: audit 2024-09-20T22:21:18.182273+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:18 smithi049 bash[23528]: audit 2024-09-20T22:21:18.192748+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:19.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:18 smithi049 bash[23528]: cluster 2024-09-20T22:21:18.614837+0000 mgr.a (mgr.14388) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:21:21.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:21.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:21 smithi179 bash[23186]: audit 2024-09-20T22:21:20.250022+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:21 smithi179 bash[23186]: audit 2024-09-20T22:21:20.258318+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:21 smithi179 bash[23186]: audit 2024-09-20T22:21:20.268646+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:21 smithi179 bash[23186]: cluster 2024-09-20T22:21:20.616853+0000 mgr.a (mgr.14388) 286 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:21.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:21 smithi049 bash[23528]: audit 2024-09-20T22:21:20.250022+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:21 smithi049 bash[23528]: audit 2024-09-20T22:21:20.258318+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:21 smithi049 bash[23528]: audit 2024-09-20T22:21:20.268646+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:21 smithi049 bash[23528]: cluster 2024-09-20T22:21:20.616853+0000 mgr.a (mgr.14388) 286 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:21.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:21 smithi044 bash[22676]: audit 2024-09-20T22:21:20.250022+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:21 smithi044 bash[22676]: audit 2024-09-20T22:21:20.258318+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:21 smithi044 bash[22676]: audit 2024-09-20T22:21:20.268646+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:21.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:21 smithi044 bash[22676]: cluster 2024-09-20T22:21:20.616853+0000 mgr.a (mgr.14388) 286 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:22.010 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:22.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:22.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:22.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:22.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:22.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:22 smithi049 bash[23528]: audit 2024-09-20T22:21:21.595227+0000 mgr.a (mgr.14388) 287 : audit [DBG] from='client.19944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:22.699 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:22 smithi179 bash[23186]: audit 2024-09-20T22:21:21.595227+0000 mgr.a (mgr.14388) 287 : audit [DBG] from='client.19944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:22.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:22 smithi044 bash[22676]: audit 2024-09-20T22:21:21.595227+0000 mgr.a (mgr.14388) 287 : audit [DBG] from='client.19944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:23.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:23 smithi049 bash[23528]: cluster 2024-09-20T22:21:22.617852+0000 mgr.a (mgr.14388) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:23.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:23 smithi044 bash[22676]: cluster 2024-09-20T22:21:22.617852+0000 mgr.a (mgr.14388) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:23.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:23 smithi179 bash[23186]: cluster 2024-09-20T22:21:22.617852+0000 mgr.a (mgr.14388) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:25.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:25 smithi044 bash[22676]: cluster 2024-09-20T22:21:24.618616+0000 mgr.a (mgr.14388) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:25.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:25 smithi179 bash[23186]: cluster 2024-09-20T22:21:24.618616+0000 mgr.a (mgr.14388) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:26.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:25 smithi049 bash[23528]: cluster 2024-09-20T22:21:24.618616+0000 mgr.a (mgr.14388) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:27.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:27.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:27.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:27.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:27 smithi044 bash[22676]: cluster 2024-09-20T22:21:26.620865+0000 mgr.a (mgr.14388) 290 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:27.763 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:27.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:27.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:27.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:27.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:27.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:27 smithi179 bash[23186]: cluster 2024-09-20T22:21:26.620865+0000 mgr.a (mgr.14388) 290 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:28.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:27 smithi049 bash[23528]: cluster 2024-09-20T22:21:26.620865+0000 mgr.a (mgr.14388) 290 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:28.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:28 smithi044 bash[22676]: audit 2024-09-20T22:21:27.357702+0000 mgr.a (mgr.14388) 291 : audit [DBG] from='client.20013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:28.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:28 smithi179 bash[23186]: audit 2024-09-20T22:21:27.357702+0000 mgr.a (mgr.14388) 291 : audit [DBG] from='client.20013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:29.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:28 smithi049 bash[23528]: audit 2024-09-20T22:21:27.357702+0000 mgr.a (mgr.14388) 291 : audit [DBG] from='client.20013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:29.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:29 smithi044 bash[22676]: cluster 2024-09-20T22:21:28.621924+0000 mgr.a (mgr.14388) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:29.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:29 smithi179 bash[23186]: cluster 2024-09-20T22:21:28.621924+0000 mgr.a (mgr.14388) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:30.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:29 smithi049 bash[23528]: cluster 2024-09-20T22:21:28.621924+0000 mgr.a (mgr.14388) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:31.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:31 smithi044 bash[22676]: cluster 2024-09-20T22:21:30.624166+0000 mgr.a (mgr.14388) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:31.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:31 smithi179 bash[23186]: cluster 2024-09-20T22:21:30.624166+0000 mgr.a (mgr.14388) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:32.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:31 smithi049 bash[23528]: cluster 2024-09-20T22:21:30.624166+0000 mgr.a (mgr.14388) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:32.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:32.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:32.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:33.545 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:33.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:33 smithi044 bash[22676]: cluster 2024-09-20T22:21:32.625040+0000 mgr.a (mgr.14388) 294 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:33.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:33 smithi179 bash[23186]: cluster 2024-09-20T22:21:32.625040+0000 mgr.a (mgr.14388) 294 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:34.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:33 smithi049 bash[23528]: cluster 2024-09-20T22:21:32.625040+0000 mgr.a (mgr.14388) 294 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:34.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:34 smithi044 bash[22676]: audit 2024-09-20T22:21:33.103681+0000 mgr.a (mgr.14388) 295 : audit [DBG] from='client.20088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:34.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:34 smithi179 bash[23186]: audit 2024-09-20T22:21:33.103681+0000 mgr.a (mgr.14388) 295 : audit [DBG] from='client.20088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:35.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:34 smithi049 bash[23528]: audit 2024-09-20T22:21:33.103681+0000 mgr.a (mgr.14388) 295 : audit [DBG] from='client.20088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:35.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:35 smithi044 bash[22676]: cluster 2024-09-20T22:21:34.626037+0000 mgr.a (mgr.14388) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:35.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:35 smithi179 bash[23186]: cluster 2024-09-20T22:21:34.626037+0000 mgr.a (mgr.14388) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:36.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:35 smithi049 bash[23528]: cluster 2024-09-20T22:21:34.626037+0000 mgr.a (mgr.14388) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:37 smithi044 bash[22676]: cluster 2024-09-20T22:21:36.628357+0000 mgr.a (mgr.14388) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:37.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:37 smithi179 bash[23186]: cluster 2024-09-20T22:21:36.628357+0000 mgr.a (mgr.14388) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:38.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:37 smithi049 bash[23528]: cluster 2024-09-20T22:21:36.628357+0000 mgr.a (mgr.14388) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:38.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:38.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:38.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:39.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:39.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: audit 2024-09-20T22:21:38.220136+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: audit 2024-09-20T22:21:38.228320+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: audit 2024-09-20T22:21:38.238671+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: audit 2024-09-20T22:21:38.360546+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: audit 2024-09-20T22:21:38.368978+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: audit 2024-09-20T22:21:38.379026+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: cluster 2024-09-20T22:21:38.629142+0000 mgr.a (mgr.14388) 298 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:39 smithi044 bash[22676]: audit 2024-09-20T22:21:38.884215+0000 mgr.a (mgr.14388) 299 : audit [DBG] from='client.20166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:39.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: audit 2024-09-20T22:21:38.220136+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: audit 2024-09-20T22:21:38.228320+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: audit 2024-09-20T22:21:38.238671+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: audit 2024-09-20T22:21:38.360546+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: audit 2024-09-20T22:21:38.368978+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: audit 2024-09-20T22:21:38.379026+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: cluster 2024-09-20T22:21:38.629142+0000 mgr.a (mgr.14388) 298 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:39.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:39 smithi179 bash[23186]: audit 2024-09-20T22:21:38.884215+0000 mgr.a (mgr.14388) 299 : audit [DBG] from='client.20166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:39.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: audit 2024-09-20T22:21:38.220136+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: audit 2024-09-20T22:21:38.228320+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: audit 2024-09-20T22:21:38.238671+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: audit 2024-09-20T22:21:38.360546+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: audit 2024-09-20T22:21:38.368978+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: audit 2024-09-20T22:21:38.379026+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:39.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: cluster 2024-09-20T22:21:38.629142+0000 mgr.a (mgr.14388) 298 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:39.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:39 smithi049 bash[23528]: audit 2024-09-20T22:21:38.884215+0000 mgr.a (mgr.14388) 299 : audit [DBG] from='client.20166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:41.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:41 smithi044 bash[22676]: audit 2024-09-20T22:21:40.474597+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:41 smithi044 bash[22676]: audit 2024-09-20T22:21:40.482863+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:41 smithi044 bash[22676]: audit 2024-09-20T22:21:40.493006+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:41 smithi044 bash[22676]: cluster 2024-09-20T22:21:40.631522+0000 mgr.a (mgr.14388) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:41 smithi179 bash[23186]: audit 2024-09-20T22:21:40.474597+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:41 smithi179 bash[23186]: audit 2024-09-20T22:21:40.482863+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:41 smithi179 bash[23186]: audit 2024-09-20T22:21:40.493006+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:41 smithi179 bash[23186]: cluster 2024-09-20T22:21:40.631522+0000 mgr.a (mgr.14388) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:41.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:41 smithi049 bash[23528]: audit 2024-09-20T22:21:40.474597+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:41 smithi049 bash[23528]: audit 2024-09-20T22:21:40.482863+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:41 smithi049 bash[23528]: audit 2024-09-20T22:21:40.493006+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:41.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:41 smithi049 bash[23528]: cluster 2024-09-20T22:21:40.631522+0000 mgr.a (mgr.14388) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:21:43.840 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:43 smithi179 bash[23186]: cluster 2024-09-20T22:21:42.632347+0000 mgr.a (mgr.14388) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:43.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:43 smithi044 bash[22676]: cluster 2024-09-20T22:21:42.632347+0000 mgr.a (mgr.14388) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:44.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:43 smithi049 bash[23528]: cluster 2024-09-20T22:21:42.632347+0000 mgr.a (mgr.14388) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:44.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:44.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:44.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:45.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:45.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:45.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:45.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:45.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:45.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:45 smithi044 bash[22676]: cluster 2024-09-20T22:21:44.633125+0000 mgr.a (mgr.14388) 302 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:45.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:45 smithi044 bash[22676]: audit 2024-09-20T22:21:44.657357+0000 mgr.a (mgr.14388) 303 : audit [DBG] from='client.20238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:45.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:45 smithi179 bash[23186]: cluster 2024-09-20T22:21:44.633125+0000 mgr.a (mgr.14388) 302 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:45.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:45 smithi179 bash[23186]: audit 2024-09-20T22:21:44.657357+0000 mgr.a (mgr.14388) 303 : audit [DBG] from='client.20238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:46.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:45 smithi049 bash[23528]: cluster 2024-09-20T22:21:44.633125+0000 mgr.a (mgr.14388) 302 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:46.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:45 smithi049 bash[23528]: audit 2024-09-20T22:21:44.657357+0000 mgr.a (mgr.14388) 303 : audit [DBG] from='client.20238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:47.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:47 smithi044 bash[22676]: cluster 2024-09-20T22:21:46.635871+0000 mgr.a (mgr.14388) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:21:47.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:47 smithi179 bash[23186]: cluster 2024-09-20T22:21:46.635871+0000 mgr.a (mgr.14388) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:21:48.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:47 smithi049 bash[23528]: cluster 2024-09-20T22:21:46.635871+0000 mgr.a (mgr.14388) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:21:49.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:49 smithi044 bash[22676]: cluster 2024-09-20T22:21:48.636692+0000 mgr.a (mgr.14388) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:21:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:49 smithi179 bash[23186]: cluster 2024-09-20T22:21:48.636692+0000 mgr.a (mgr.14388) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:21:50.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:49 smithi049 bash[23528]: cluster 2024-09-20T22:21:48.636692+0000 mgr.a (mgr.14388) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:21:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:50.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:50.830 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:51.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:51 smithi044 bash[22676]: audit 2024-09-20T22:21:50.401230+0000 mgr.a (mgr.14388) 306 : audit [DBG] from='client.20313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:51 smithi044 bash[22676]: cluster 2024-09-20T22:21:50.638492+0000 mgr.a (mgr.14388) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:51.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:51 smithi179 bash[23186]: audit 2024-09-20T22:21:50.401230+0000 mgr.a (mgr.14388) 306 : audit [DBG] from='client.20313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:51.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:51 smithi179 bash[23186]: cluster 2024-09-20T22:21:50.638492+0000 mgr.a (mgr.14388) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:52.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:51 smithi049 bash[23528]: audit 2024-09-20T22:21:50.401230+0000 mgr.a (mgr.14388) 306 : audit [DBG] from='client.20313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:52.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:51 smithi049 bash[23528]: cluster 2024-09-20T22:21:50.638492+0000 mgr.a (mgr.14388) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:53.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:53 smithi044 bash[22676]: cluster 2024-09-20T22:21:52.639383+0000 mgr.a (mgr.14388) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:21:53.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:53 smithi179 bash[23186]: cluster 2024-09-20T22:21:52.639383+0000 mgr.a (mgr.14388) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:21:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:53 smithi049 bash[23528]: cluster 2024-09-20T22:21:52.639383+0000 mgr.a (mgr.14388) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:21:55.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:21:55.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:21:55.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:21:55.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:55 smithi044 bash[22676]: cluster 2024-09-20T22:21:54.640198+0000 mgr.a (mgr.14388) 309 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:21:55.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:55 smithi179 bash[23186]: cluster 2024-09-20T22:21:54.640198+0000 mgr.a (mgr.14388) 309 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:21:56.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:55 smithi049 bash[23528]: cluster 2024-09-20T22:21:54.640198+0000 mgr.a (mgr.14388) 309 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:21:56.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:21:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:21:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:21:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:21:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:21:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:57 smithi044 bash[22676]: audit 2024-09-20T22:21:56.165375+0000 mgr.a (mgr.14388) 310 : audit [DBG] from='client.20391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:57.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:57 smithi044 bash[22676]: cluster 2024-09-20T22:21:56.641621+0000 mgr.a (mgr.14388) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:57 smithi179 bash[23186]: audit 2024-09-20T22:21:56.165375+0000 mgr.a (mgr.14388) 310 : audit [DBG] from='client.20391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:57.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:57 smithi179 bash[23186]: cluster 2024-09-20T22:21:56.641621+0000 mgr.a (mgr.14388) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:57 smithi049 bash[23528]: audit 2024-09-20T22:21:56.165375+0000 mgr.a (mgr.14388) 310 : audit [DBG] from='client.20391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:21:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:57 smithi049 bash[23528]: cluster 2024-09-20T22:21:56.641621+0000 mgr.a (mgr.14388) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:21:59.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:59 smithi049 bash[23528]: audit 2024-09-20T22:21:58.448791+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:59 smithi049 bash[23528]: audit 2024-09-20T22:21:58.457135+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:59 smithi049 bash[23528]: audit 2024-09-20T22:21:58.468685+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:59 smithi049 bash[23528]: audit 2024-09-20T22:21:58.563403+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:59 smithi049 bash[23528]: audit 2024-09-20T22:21:58.571886+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:59 smithi049 bash[23528]: audit 2024-09-20T22:21:58.581612+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:21:59 smithi049 bash[23528]: cluster 2024-09-20T22:21:58.642350+0000 mgr.a (mgr.14388) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:21:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:59 smithi044 bash[22676]: audit 2024-09-20T22:21:58.448791+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:59 smithi044 bash[22676]: audit 2024-09-20T22:21:58.457135+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:59 smithi044 bash[22676]: audit 2024-09-20T22:21:58.468685+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:59 smithi044 bash[22676]: audit 2024-09-20T22:21:58.563403+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:59 smithi044 bash[22676]: audit 2024-09-20T22:21:58.571886+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:59 smithi044 bash[22676]: audit 2024-09-20T22:21:58.581612+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:21:59 smithi044 bash[22676]: cluster 2024-09-20T22:21:58.642350+0000 mgr.a (mgr.14388) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:21:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:59 smithi179 bash[23186]: audit 2024-09-20T22:21:58.448791+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:59 smithi179 bash[23186]: audit 2024-09-20T22:21:58.457135+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:59 smithi179 bash[23186]: audit 2024-09-20T22:21:58.468685+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:59 smithi179 bash[23186]: audit 2024-09-20T22:21:58.563403+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:59 smithi179 bash[23186]: audit 2024-09-20T22:21:58.571886+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:59 smithi179 bash[23186]: audit 2024-09-20T22:21:58.581612+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:21:59.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:21:59 smithi179 bash[23186]: cluster 2024-09-20T22:21:58.642350+0000 mgr.a (mgr.14388) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:22:01.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:01.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:01.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:01.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:01 smithi044 bash[22676]: cluster 2024-09-20T22:22:00.643970+0000 mgr.a (mgr.14388) 313 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:22:01.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:01 smithi044 bash[22676]: audit 2024-09-20T22:22:00.709211+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:01 smithi044 bash[22676]: audit 2024-09-20T22:22:00.721398+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:01 smithi044 bash[22676]: audit 2024-09-20T22:22:00.730664+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:01 smithi179 bash[23186]: cluster 2024-09-20T22:22:00.643970+0000 mgr.a (mgr.14388) 313 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:22:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:01 smithi179 bash[23186]: audit 2024-09-20T22:22:00.709211+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:01 smithi179 bash[23186]: audit 2024-09-20T22:22:00.721398+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:01 smithi179 bash[23186]: audit 2024-09-20T22:22:00.730664+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:02.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:01 smithi049 bash[23528]: cluster 2024-09-20T22:22:00.643970+0000 mgr.a (mgr.14388) 313 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:22:02.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:01 smithi049 bash[23528]: audit 2024-09-20T22:22:00.709211+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:02.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:01 smithi049 bash[23528]: audit 2024-09-20T22:22:00.721398+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:02.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:01 smithi049 bash[23528]: audit 2024-09-20T22:22:00.730664+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:02.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:02.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:02 smithi044 bash[22676]: audit 2024-09-20T22:22:02.026141+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:02 smithi044 bash[22676]: audit 2024-09-20T22:22:02.029554+0000 mon.a (mon.0) 1072 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:02 smithi044 bash[22676]: audit 2024-09-20T22:22:02.030732+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:02 smithi044 bash[22676]: audit 2024-09-20T22:22:02.037711+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:02 smithi044 bash[22676]: audit 2024-09-20T22:22:02.040235+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:22:02.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:02 smithi179 bash[23186]: audit 2024-09-20T22:22:02.026141+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:22:02.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:02 smithi179 bash[23186]: audit 2024-09-20T22:22:02.029554+0000 mon.a (mon.0) 1072 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:22:02.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:02 smithi179 bash[23186]: audit 2024-09-20T22:22:02.030732+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:22:02.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:02 smithi179 bash[23186]: audit 2024-09-20T22:22:02.037711+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:02.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:02 smithi179 bash[23186]: audit 2024-09-20T22:22:02.040235+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:22:03.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:02 smithi049 bash[23528]: audit 2024-09-20T22:22:02.026141+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:22:03.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:02 smithi049 bash[23528]: audit 2024-09-20T22:22:02.029554+0000 mon.a (mon.0) 1072 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:22:03.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:02 smithi049 bash[23528]: audit 2024-09-20T22:22:02.030732+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:22:03.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:02 smithi049 bash[23528]: audit 2024-09-20T22:22:02.037711+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:03.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:02 smithi049 bash[23528]: audit 2024-09-20T22:22:02.040235+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:22:03.485 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:22:03 smithi044 bash[22930]: debug 2024-09-20T22:22:03.006+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:22:03.485 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:22:03 smithi044 bash[22930]: debug 2024-09-20T22:22:03.006+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:22:03.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:03 smithi044 bash[22676]: audit 2024-09-20T22:22:01.915291+0000 mgr.a (mgr.14388) 314 : audit [DBG] from='client.20469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:03.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:03 smithi044 bash[22676]: audit 2024-09-20T22:22:02.050005+0000 mgr.a (mgr.14388) 315 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:22:03.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:03 smithi044 bash[22676]: cluster 2024-09-20T22:22:02.644597+0000 mgr.a (mgr.14388) 316 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:03.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:03 smithi179 bash[23186]: audit 2024-09-20T22:22:01.915291+0000 mgr.a (mgr.14388) 314 : audit [DBG] from='client.20469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:03.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:03 smithi179 bash[23186]: audit 2024-09-20T22:22:02.050005+0000 mgr.a (mgr.14388) 315 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:22:03.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:03 smithi179 bash[23186]: cluster 2024-09-20T22:22:02.644597+0000 mgr.a (mgr.14388) 316 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:04.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:03 smithi049 bash[23528]: audit 2024-09-20T22:22:01.915291+0000 mgr.a (mgr.14388) 314 : audit [DBG] from='client.20469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:04.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:03 smithi049 bash[23528]: audit 2024-09-20T22:22:02.050005+0000 mgr.a (mgr.14388) 315 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:22:04.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:03 smithi049 bash[23528]: cluster 2024-09-20T22:22:02.644597+0000 mgr.a (mgr.14388) 316 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:04.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:04 smithi044 bash[22676]: audit 2024-09-20T22:22:03.009703+0000 mgr.a (mgr.14388) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:22:04.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:04 smithi044 bash[22676]: cephadm 2024-09-20T22:22:03.010988+0000 mgr.a (mgr.14388) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:22:04.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:04 smithi179 bash[23186]: audit 2024-09-20T22:22:03.009703+0000 mgr.a (mgr.14388) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:22:04.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:04 smithi179 bash[23186]: cephadm 2024-09-20T22:22:03.010988+0000 mgr.a (mgr.14388) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:22:05.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:04 smithi049 bash[23528]: audit 2024-09-20T22:22:03.009703+0000 mgr.a (mgr.14388) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:22:05.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:04 smithi049 bash[23528]: cephadm 2024-09-20T22:22:03.010988+0000 mgr.a (mgr.14388) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:22:05.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:05 smithi044 bash[22676]: cluster 2024-09-20T22:22:04.645627+0000 mgr.a (mgr.14388) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:05.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:05 smithi179 bash[23186]: cluster 2024-09-20T22:22:04.645627+0000 mgr.a (mgr.14388) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:06.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:05 smithi049 bash[23528]: cluster 2024-09-20T22:22:04.645627+0000 mgr.a (mgr.14388) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:07.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:07.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:07 smithi044 bash[22676]: cluster 2024-09-20T22:22:06.648006+0000 mgr.a (mgr.14388) 320 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:07.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:07 smithi179 bash[23186]: cluster 2024-09-20T22:22:06.648006+0000 mgr.a (mgr.14388) 320 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:08.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:07 smithi049 bash[23528]: cluster 2024-09-20T22:22:06.648006+0000 mgr.a (mgr.14388) 320 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:08.091 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:08.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:08.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:08.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:08.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:08.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:08 smithi044 bash[22676]: audit 2024-09-20T22:22:07.664039+0000 mgr.a (mgr.14388) 321 : audit [DBG] from='client.20646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:08.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:08 smithi179 bash[23186]: audit 2024-09-20T22:22:07.664039+0000 mgr.a (mgr.14388) 321 : audit [DBG] from='client.20646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:09.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:08 smithi049 bash[23528]: audit 2024-09-20T22:22:07.664039+0000 mgr.a (mgr.14388) 321 : audit [DBG] from='client.20646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:09 smithi044 bash[22676]: cluster 2024-09-20T22:22:08.648747+0000 mgr.a (mgr.14388) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:09.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:09 smithi179 bash[23186]: cluster 2024-09-20T22:22:08.648747+0000 mgr.a (mgr.14388) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:10.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:09 smithi049 bash[23528]: cluster 2024-09-20T22:22:08.648747+0000 mgr.a (mgr.14388) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:11.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:11 smithi179 bash[23186]: cluster 2024-09-20T22:22:10.651082+0000 mgr.a (mgr.14388) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:12.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:11 smithi049 bash[23528]: cluster 2024-09-20T22:22:10.651082+0000 mgr.a (mgr.14388) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:12.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:11 smithi044 bash[22676]: cluster 2024-09-20T22:22:10.651082+0000 mgr.a (mgr.14388) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:13.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:13.093 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:13.093 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:13.868 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:13.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:13.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:13 smithi179 bash[23186]: cluster 2024-09-20T22:22:12.652005+0000 mgr.a (mgr.14388) 324 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:14.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:13 smithi049 bash[23528]: cluster 2024-09-20T22:22:12.652005+0000 mgr.a (mgr.14388) 324 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:14.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:13 smithi044 bash[22676]: cluster 2024-09-20T22:22:12.652005+0000 mgr.a (mgr.14388) 324 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:14.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:14 smithi179 bash[23186]: audit 2024-09-20T22:22:13.428596+0000 mgr.a (mgr.14388) 325 : audit [DBG] from='client.20724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:15.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:14 smithi049 bash[23528]: audit 2024-09-20T22:22:13.428596+0000 mgr.a (mgr.14388) 325 : audit [DBG] from='client.20724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:15.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:14 smithi044 bash[22676]: audit 2024-09-20T22:22:13.428596+0000 mgr.a (mgr.14388) 325 : audit [DBG] from='client.20724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:16.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:15 smithi049 bash[23528]: cluster 2024-09-20T22:22:14.653013+0000 mgr.a (mgr.14388) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:16.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:15 smithi044 bash[22676]: cluster 2024-09-20T22:22:14.653013+0000 mgr.a (mgr.14388) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:16.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:15 smithi179 bash[23186]: cluster 2024-09-20T22:22:14.653013+0000 mgr.a (mgr.14388) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:17.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:17 smithi049 bash[23528]: cluster 2024-09-20T22:22:16.655351+0000 mgr.a (mgr.14388) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:18.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:17 smithi044 bash[22676]: cluster 2024-09-20T22:22:16.655351+0000 mgr.a (mgr.14388) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:18.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:17 smithi179 bash[23186]: cluster 2024-09-20T22:22:16.655351+0000 mgr.a (mgr.14388) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:22:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:19.634 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:19.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:19.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:19.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:19.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:19 smithi044 bash[22676]: cluster 2024-09-20T22:22:18.656111+0000 mgr.a (mgr.14388) 328 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:19.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:19 smithi044 bash[22676]: audit 2024-09-20T22:22:18.680533+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:19 smithi044 bash[22676]: audit 2024-09-20T22:22:18.689199+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:19 smithi044 bash[22676]: audit 2024-09-20T22:22:18.699610+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:19 smithi044 bash[22676]: audit 2024-09-20T22:22:18.792888+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:19 smithi044 bash[22676]: audit 2024-09-20T22:22:18.801668+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:19 smithi044 bash[22676]: audit 2024-09-20T22:22:18.811650+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:19 smithi179 bash[23186]: cluster 2024-09-20T22:22:18.656111+0000 mgr.a (mgr.14388) 328 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:19.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:19 smithi179 bash[23186]: audit 2024-09-20T22:22:18.680533+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:19 smithi179 bash[23186]: audit 2024-09-20T22:22:18.689199+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:19 smithi179 bash[23186]: audit 2024-09-20T22:22:18.699610+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:19 smithi179 bash[23186]: audit 2024-09-20T22:22:18.792888+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:19 smithi179 bash[23186]: audit 2024-09-20T22:22:18.801668+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:19.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:19 smithi179 bash[23186]: audit 2024-09-20T22:22:18.811650+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:19 smithi049 bash[23528]: cluster 2024-09-20T22:22:18.656111+0000 mgr.a (mgr.14388) 328 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:19 smithi049 bash[23528]: audit 2024-09-20T22:22:18.680533+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:19 smithi049 bash[23528]: audit 2024-09-20T22:22:18.689199+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:19 smithi049 bash[23528]: audit 2024-09-20T22:22:18.699610+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:19 smithi049 bash[23528]: audit 2024-09-20T22:22:18.792888+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:19 smithi049 bash[23528]: audit 2024-09-20T22:22:18.801668+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:20.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:19 smithi049 bash[23528]: audit 2024-09-20T22:22:18.811650+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:20.952 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:20 smithi044 bash[22676]: audit 2024-09-20T22:22:19.213279+0000 mgr.a (mgr.14388) 329 : audit [DBG] from='client.20802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:20.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:20 smithi179 bash[23186]: audit 2024-09-20T22:22:19.213279+0000 mgr.a (mgr.14388) 329 : audit [DBG] from='client.20802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:21.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:20 smithi049 bash[23528]: audit 2024-09-20T22:22:19.213279+0000 mgr.a (mgr.14388) 329 : audit [DBG] from='client.20802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:21 smithi044 bash[22676]: cluster 2024-09-20T22:22:20.658488+0000 mgr.a (mgr.14388) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:21 smithi044 bash[22676]: audit 2024-09-20T22:22:20.933161+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:21 smithi044 bash[22676]: audit 2024-09-20T22:22:20.941165+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:21 smithi044 bash[22676]: audit 2024-09-20T22:22:20.951593+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:21.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:21 smithi179 bash[23186]: cluster 2024-09-20T22:22:20.658488+0000 mgr.a (mgr.14388) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:21.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:21 smithi179 bash[23186]: audit 2024-09-20T22:22:20.933161+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:21.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:21 smithi179 bash[23186]: audit 2024-09-20T22:22:20.941165+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:21.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:21 smithi179 bash[23186]: audit 2024-09-20T22:22:20.951593+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:21 smithi049 bash[23528]: cluster 2024-09-20T22:22:20.658488+0000 mgr.a (mgr.14388) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:21 smithi049 bash[23528]: audit 2024-09-20T22:22:20.933161+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:21 smithi049 bash[23528]: audit 2024-09-20T22:22:20.941165+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:21 smithi049 bash[23528]: audit 2024-09-20T22:22:20.951593+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:23.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:23 smithi044 bash[22676]: cluster 2024-09-20T22:22:22.659421+0000 mgr.a (mgr.14388) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:23 smithi179 bash[23186]: cluster 2024-09-20T22:22:22.659421+0000 mgr.a (mgr.14388) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:24.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:23 smithi049 bash[23528]: cluster 2024-09-20T22:22:22.659421+0000 mgr.a (mgr.14388) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:24.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:24.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:24.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:25.405 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:25.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:25.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:25.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:25.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:25.984 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:25 smithi179 bash[23186]: cluster 2024-09-20T22:22:24.660190+0000 mgr.a (mgr.14388) 332 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:25.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:25 smithi044 bash[22676]: cluster 2024-09-20T22:22:24.660190+0000 mgr.a (mgr.14388) 332 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:26.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:25 smithi049 bash[23528]: cluster 2024-09-20T22:22:24.660190+0000 mgr.a (mgr.14388) 332 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:26.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:26 smithi044 bash[22676]: audit 2024-09-20T22:22:24.971833+0000 mgr.a (mgr.14388) 333 : audit [DBG] from='client.20877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:26.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:26 smithi179 bash[23186]: audit 2024-09-20T22:22:24.971833+0000 mgr.a (mgr.14388) 333 : audit [DBG] from='client.20877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:27.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:26 smithi049 bash[23528]: audit 2024-09-20T22:22:24.971833+0000 mgr.a (mgr.14388) 333 : audit [DBG] from='client.20877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:27.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:27 smithi044 bash[22676]: cluster 2024-09-20T22:22:26.662897+0000 mgr.a (mgr.14388) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:27.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:27 smithi179 bash[23186]: cluster 2024-09-20T22:22:26.662897+0000 mgr.a (mgr.14388) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:28.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:27 smithi049 bash[23528]: cluster 2024-09-20T22:22:26.662897+0000 mgr.a (mgr.14388) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:29.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:29 smithi044 bash[22676]: cluster 2024-09-20T22:22:28.663710+0000 mgr.a (mgr.14388) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:22:29.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:29 smithi179 bash[23186]: cluster 2024-09-20T22:22:28.663710+0000 mgr.a (mgr.14388) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:22:30.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:29 smithi049 bash[23528]: cluster 2024-09-20T22:22:28.663710+0000 mgr.a (mgr.14388) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:22:30.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:30.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:30.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:31.150 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:31.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:31.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:31 smithi044 bash[22676]: cluster 2024-09-20T22:22:30.665677+0000 mgr.a (mgr.14388) 336 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:31.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:31 smithi044 bash[22676]: audit 2024-09-20T22:22:30.733489+0000 mgr.a (mgr.14388) 337 : audit [DBG] from='client.20955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:31.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:31 smithi179 bash[23186]: cluster 2024-09-20T22:22:30.665677+0000 mgr.a (mgr.14388) 336 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:31.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:31 smithi179 bash[23186]: audit 2024-09-20T22:22:30.733489+0000 mgr.a (mgr.14388) 337 : audit [DBG] from='client.20955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:32.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:31 smithi049 bash[23528]: cluster 2024-09-20T22:22:30.665677+0000 mgr.a (mgr.14388) 336 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:32.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:31 smithi049 bash[23528]: audit 2024-09-20T22:22:30.733489+0000 mgr.a (mgr.14388) 337 : audit [DBG] from='client.20955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:33.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:33 smithi044 bash[22676]: cluster 2024-09-20T22:22:32.666565+0000 mgr.a (mgr.14388) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:22:33.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:33 smithi179 bash[23186]: cluster 2024-09-20T22:22:32.666565+0000 mgr.a (mgr.14388) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:22:34.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:33 smithi049 bash[23528]: cluster 2024-09-20T22:22:32.666565+0000 mgr.a (mgr.14388) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:22:35.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:35 smithi044 bash[22676]: cluster 2024-09-20T22:22:34.667373+0000 mgr.a (mgr.14388) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:22:35.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:35 smithi179 bash[23186]: cluster 2024-09-20T22:22:34.667373+0000 mgr.a (mgr.14388) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:22:36.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:35 smithi049 bash[23528]: cluster 2024-09-20T22:22:34.667373+0000 mgr.a (mgr.14388) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:22:36.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:36.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:36.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:36.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:36.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:36.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:36.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:37.777 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:37 smithi049 bash[23528]: audit 2024-09-20T22:22:36.487422+0000 mgr.a (mgr.14388) 340 : audit [DBG] from='client.21033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:37.777 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:37 smithi049 bash[23528]: cluster 2024-09-20T22:22:36.668702+0000 mgr.a (mgr.14388) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:37 smithi044 bash[22676]: audit 2024-09-20T22:22:36.487422+0000 mgr.a (mgr.14388) 340 : audit [DBG] from='client.21033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:37 smithi044 bash[22676]: cluster 2024-09-20T22:22:36.668702+0000 mgr.a (mgr.14388) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:37 smithi179 bash[23186]: audit 2024-09-20T22:22:36.487422+0000 mgr.a (mgr.14388) 340 : audit [DBG] from='client.21033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:37.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:37 smithi179 bash[23186]: cluster 2024-09-20T22:22:36.668702+0000 mgr.a (mgr.14388) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:39 smithi049 bash[23528]: cluster 2024-09-20T22:22:38.669602+0000 mgr.a (mgr.14388) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:39 smithi049 bash[23528]: audit 2024-09-20T22:22:38.913181+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:39 smithi049 bash[23528]: audit 2024-09-20T22:22:38.921496+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:39 smithi049 bash[23528]: audit 2024-09-20T22:22:38.932982+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:39 smithi049 bash[23528]: audit 2024-09-20T22:22:39.002149+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:39 smithi049 bash[23528]: audit 2024-09-20T22:22:39.010911+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:39 smithi049 bash[23528]: audit 2024-09-20T22:22:39.021552+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:39 smithi044 bash[22676]: cluster 2024-09-20T22:22:38.669602+0000 mgr.a (mgr.14388) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:39 smithi044 bash[22676]: audit 2024-09-20T22:22:38.913181+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:39 smithi044 bash[22676]: audit 2024-09-20T22:22:38.921496+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:39 smithi044 bash[22676]: audit 2024-09-20T22:22:38.932982+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:39 smithi044 bash[22676]: audit 2024-09-20T22:22:39.002149+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:39 smithi044 bash[22676]: audit 2024-09-20T22:22:39.010911+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:39 smithi044 bash[22676]: audit 2024-09-20T22:22:39.021552+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:39 smithi179 bash[23186]: cluster 2024-09-20T22:22:38.669602+0000 mgr.a (mgr.14388) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:39 smithi179 bash[23186]: audit 2024-09-20T22:22:38.913181+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:39 smithi179 bash[23186]: audit 2024-09-20T22:22:38.921496+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:39 smithi179 bash[23186]: audit 2024-09-20T22:22:38.932982+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:39 smithi179 bash[23186]: audit 2024-09-20T22:22:39.002149+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:39 smithi179 bash[23186]: audit 2024-09-20T22:22:39.010911+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:40.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:39 smithi179 bash[23186]: audit 2024-09-20T22:22:39.021552+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:41.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:41 smithi044 bash[22676]: cluster 2024-09-20T22:22:40.671739+0000 mgr.a (mgr.14388) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:41 smithi044 bash[22676]: audit 2024-09-20T22:22:41.164327+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:41 smithi044 bash[22676]: audit 2024-09-20T22:22:41.172228+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:41 smithi044 bash[22676]: audit 2024-09-20T22:22:41.182130+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:41 smithi179 bash[23186]: cluster 2024-09-20T22:22:40.671739+0000 mgr.a (mgr.14388) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:41 smithi179 bash[23186]: audit 2024-09-20T22:22:41.164327+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:41 smithi179 bash[23186]: audit 2024-09-20T22:22:41.172228+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:41 smithi179 bash[23186]: audit 2024-09-20T22:22:41.182130+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:41 smithi049 bash[23528]: cluster 2024-09-20T22:22:40.671739+0000 mgr.a (mgr.14388) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:41 smithi049 bash[23528]: audit 2024-09-20T22:22:41.164327+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:41 smithi049 bash[23528]: audit 2024-09-20T22:22:41.172228+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:41 smithi049 bash[23528]: audit 2024-09-20T22:22:41.182130+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:22:42.684 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:42.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:42.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:42.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:42.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:43.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:42 smithi044 bash[22676]: audit 2024-09-20T22:22:42.242645+0000 mgr.a (mgr.14388) 344 : audit [DBG] from='client.21111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:43.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:42 smithi044 bash[22676]: cluster 2024-09-20T22:22:42.672269+0000 mgr.a (mgr.14388) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:43.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:42 smithi179 bash[23186]: audit 2024-09-20T22:22:42.242645+0000 mgr.a (mgr.14388) 344 : audit [DBG] from='client.21111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:43.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:42 smithi179 bash[23186]: cluster 2024-09-20T22:22:42.672269+0000 mgr.a (mgr.14388) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:43.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:42 smithi049 bash[23528]: audit 2024-09-20T22:22:42.242645+0000 mgr.a (mgr.14388) 344 : audit [DBG] from='client.21111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:43.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:42 smithi049 bash[23528]: cluster 2024-09-20T22:22:42.672269+0000 mgr.a (mgr.14388) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:45.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:45 smithi044 bash[22676]: cluster 2024-09-20T22:22:44.673019+0000 mgr.a (mgr.14388) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:45.989 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:45 smithi179 bash[23186]: cluster 2024-09-20T22:22:44.673019+0000 mgr.a (mgr.14388) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:46.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:45 smithi049 bash[23528]: cluster 2024-09-20T22:22:44.673019+0000 mgr.a (mgr.14388) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:47.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:47.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:47.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:47.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:47 smithi044 bash[22676]: cluster 2024-09-20T22:22:46.675250+0000 mgr.a (mgr.14388) 347 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:47.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:47 smithi179 bash[23186]: cluster 2024-09-20T22:22:46.675250+0000 mgr.a (mgr.14388) 347 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:48.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:47 smithi049 bash[23528]: cluster 2024-09-20T22:22:46.675250+0000 mgr.a (mgr.14388) 347 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:48.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:48.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:48.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:48.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:48.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:49 smithi179 bash[23186]: audit 2024-09-20T22:22:48.017746+0000 mgr.a (mgr.14388) 348 : audit [DBG] from='client.21183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:49 smithi179 bash[23186]: cluster 2024-09-20T22:22:48.676163+0000 mgr.a (mgr.14388) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:50.036 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:49 smithi044 bash[22676]: audit 2024-09-20T22:22:48.017746+0000 mgr.a (mgr.14388) 348 : audit [DBG] from='client.21183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:50.036 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:49 smithi044 bash[22676]: cluster 2024-09-20T22:22:48.676163+0000 mgr.a (mgr.14388) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:50.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:49 smithi049 bash[23528]: audit 2024-09-20T22:22:48.017746+0000 mgr.a (mgr.14388) 348 : audit [DBG] from='client.21183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:50.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:49 smithi049 bash[23528]: cluster 2024-09-20T22:22:48.676163+0000 mgr.a (mgr.14388) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:51.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:51 smithi179 bash[23186]: cluster 2024-09-20T22:22:50.678530+0000 mgr.a (mgr.14388) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:52.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:51 smithi049 bash[23528]: cluster 2024-09-20T22:22:50.678530+0000 mgr.a (mgr.14388) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:52.088 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:51 smithi044 bash[22676]: cluster 2024-09-20T22:22:50.678530+0000 mgr.a (mgr.14388) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:53.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:53.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:53.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:53.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:53 smithi179 bash[23186]: cluster 2024-09-20T22:22:52.679318+0000 mgr.a (mgr.14388) 351 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:53 smithi049 bash[23528]: cluster 2024-09-20T22:22:52.679318+0000 mgr.a (mgr.14388) 351 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:54.179 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:22:54.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:53 smithi044 bash[22676]: cluster 2024-09-20T22:22:52.679318+0000 mgr.a (mgr.14388) 351 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:54.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:54 smithi179 bash[23186]: audit 2024-09-20T22:22:53.748134+0000 mgr.a (mgr.14388) 352 : audit [DBG] from='client.21261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:55.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:54 smithi049 bash[23528]: audit 2024-09-20T22:22:53.748134+0000 mgr.a (mgr.14388) 352 : audit [DBG] from='client.21261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:55.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:54 smithi044 bash[22676]: audit 2024-09-20T22:22:53.748134+0000 mgr.a (mgr.14388) 352 : audit [DBG] from='client.21261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:22:56.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:55 smithi049 bash[23528]: cluster 2024-09-20T22:22:54.680299+0000 mgr.a (mgr.14388) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:56.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:55 smithi044 bash[22676]: cluster 2024-09-20T22:22:54.680299+0000 mgr.a (mgr.14388) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:56.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:55 smithi179 bash[23186]: cluster 2024-09-20T22:22:54.680299+0000 mgr.a (mgr.14388) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:22:58.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:57 smithi049 bash[23528]: cluster 2024-09-20T22:22:56.682576+0000 mgr.a (mgr.14388) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:58.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:57 smithi044 bash[22676]: cluster 2024-09-20T22:22:56.682576+0000 mgr.a (mgr.14388) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:58.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:57 smithi179 bash[23186]: cluster 2024-09-20T22:22:56.682576+0000 mgr.a (mgr.14388) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:22:59.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:22:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:22:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:22:59.970 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:22:59.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:22:59.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:22:59.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:22:59.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:00.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:59 smithi049 bash[23528]: cluster 2024-09-20T22:22:58.683347+0000 mgr.a (mgr.14388) 355 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:00.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:59 smithi049 bash[23528]: audit 2024-09-20T22:22:59.144755+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:59 smithi049 bash[23528]: audit 2024-09-20T22:22:59.154617+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:59 smithi049 bash[23528]: audit 2024-09-20T22:22:59.165347+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:59 smithi049 bash[23528]: audit 2024-09-20T22:22:59.196110+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:59 smithi049 bash[23528]: audit 2024-09-20T22:22:59.201955+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:22:59 smithi049 bash[23528]: audit 2024-09-20T22:22:59.209556+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:59 smithi044 bash[22676]: cluster 2024-09-20T22:22:58.683347+0000 mgr.a (mgr.14388) 355 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:00.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:59 smithi044 bash[22676]: audit 2024-09-20T22:22:59.144755+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:59 smithi044 bash[22676]: audit 2024-09-20T22:22:59.154617+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:59 smithi044 bash[22676]: audit 2024-09-20T22:22:59.165347+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:59 smithi044 bash[22676]: audit 2024-09-20T22:22:59.196110+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:59 smithi044 bash[22676]: audit 2024-09-20T22:22:59.201955+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:22:59 smithi044 bash[22676]: audit 2024-09-20T22:22:59.209556+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:59 smithi179 bash[23186]: cluster 2024-09-20T22:22:58.683347+0000 mgr.a (mgr.14388) 355 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:59 smithi179 bash[23186]: audit 2024-09-20T22:22:59.144755+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:59 smithi179 bash[23186]: audit 2024-09-20T22:22:59.154617+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:59 smithi179 bash[23186]: audit 2024-09-20T22:22:59.165347+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:59 smithi179 bash[23186]: audit 2024-09-20T22:22:59.196110+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:59 smithi179 bash[23186]: audit 2024-09-20T22:22:59.201955+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:22:59 smithi179 bash[23186]: audit 2024-09-20T22:22:59.209556+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:01.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:00 smithi049 bash[23528]: audit 2024-09-20T22:22:59.522387+0000 mgr.a (mgr.14388) 356 : audit [DBG] from='client.21336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:01.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:00 smithi044 bash[22676]: audit 2024-09-20T22:22:59.522387+0000 mgr.a (mgr.14388) 356 : audit [DBG] from='client.21336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:01.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:00 smithi179 bash[23186]: audit 2024-09-20T22:22:59.522387+0000 mgr.a (mgr.14388) 356 : audit [DBG] from='client.21336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:02.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:01 smithi049 bash[23528]: cluster 2024-09-20T22:23:00.685735+0000 mgr.a (mgr.14388) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:23:02.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:01 smithi049 bash[23528]: audit 2024-09-20T22:23:01.397216+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:01 smithi049 bash[23528]: audit 2024-09-20T22:23:01.405734+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:01 smithi049 bash[23528]: audit 2024-09-20T22:23:01.416248+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:01 smithi044 bash[22676]: cluster 2024-09-20T22:23:00.685735+0000 mgr.a (mgr.14388) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:23:02.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:01 smithi044 bash[22676]: audit 2024-09-20T22:23:01.397216+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:01 smithi044 bash[22676]: audit 2024-09-20T22:23:01.405734+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:01 smithi044 bash[22676]: audit 2024-09-20T22:23:01.416248+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:01 smithi179 bash[23186]: cluster 2024-09-20T22:23:00.685735+0000 mgr.a (mgr.14388) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:23:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:01 smithi179 bash[23186]: audit 2024-09-20T22:23:01.397216+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:01 smithi179 bash[23186]: audit 2024-09-20T22:23:01.405734+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:01 smithi179 bash[23186]: audit 2024-09-20T22:23:01.416248+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:04.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:03 smithi049 bash[23528]: cluster 2024-09-20T22:23:02.686478+0000 mgr.a (mgr.14388) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:23:04.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:03 smithi049 bash[23528]: audit 2024-09-20T22:23:03.070186+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:23:04.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:03 smithi049 bash[23528]: audit 2024-09-20T22:23:03.077076+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:23:04.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:03 smithi049 bash[23528]: audit 2024-09-20T22:23:03.078965+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:23:04.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:03 smithi049 bash[23528]: audit 2024-09-20T22:23:03.091408+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:04.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:03 smithi049 bash[23528]: audit 2024-09-20T22:23:03.097792+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:23:04.235 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22930]: debug 2024-09-20T22:23:03.825+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:23:04.235 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22930]: debug 2024-09-20T22:23:03.825+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:23:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22676]: cluster 2024-09-20T22:23:02.686478+0000 mgr.a (mgr.14388) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:23:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22676]: audit 2024-09-20T22:23:03.070186+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:23:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22676]: audit 2024-09-20T22:23:03.077076+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:23:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22676]: audit 2024-09-20T22:23:03.078965+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:23:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22676]: audit 2024-09-20T22:23:03.091408+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:03 smithi044 bash[22676]: audit 2024-09-20T22:23:03.097792+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:23:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:03 smithi179 bash[23186]: cluster 2024-09-20T22:23:02.686478+0000 mgr.a (mgr.14388) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:23:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:03 smithi179 bash[23186]: audit 2024-09-20T22:23:03.070186+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:23:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:03 smithi179 bash[23186]: audit 2024-09-20T22:23:03.077076+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:23:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:03 smithi179 bash[23186]: audit 2024-09-20T22:23:03.078965+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:23:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:03 smithi179 bash[23186]: audit 2024-09-20T22:23:03.091408+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:03 smithi179 bash[23186]: audit 2024-09-20T22:23:03.097792+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:23:04.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:04.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:04.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:05.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:04 smithi049 bash[23528]: audit 2024-09-20T22:23:03.100101+0000 mgr.a (mgr.14388) 359 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:23:05.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:04 smithi049 bash[23528]: audit 2024-09-20T22:23:03.831893+0000 mgr.a (mgr.14388) 360 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:23:05.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:04 smithi049 bash[23528]: cephadm 2024-09-20T22:23:03.833046+0000 mgr.a (mgr.14388) 361 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:23:05.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:04 smithi044 bash[22676]: audit 2024-09-20T22:23:03.100101+0000 mgr.a (mgr.14388) 359 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:23:05.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:04 smithi044 bash[22676]: audit 2024-09-20T22:23:03.831893+0000 mgr.a (mgr.14388) 360 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:23:05.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:04 smithi044 bash[22676]: cephadm 2024-09-20T22:23:03.833046+0000 mgr.a (mgr.14388) 361 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:23:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:04 smithi179 bash[23186]: audit 2024-09-20T22:23:03.100101+0000 mgr.a (mgr.14388) 359 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:23:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:04 smithi179 bash[23186]: audit 2024-09-20T22:23:03.831893+0000 mgr.a (mgr.14388) 360 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:23:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:04 smithi179 bash[23186]: cephadm 2024-09-20T22:23:03.833046+0000 mgr.a (mgr.14388) 361 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:23:05.746 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:05.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:05.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:05.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:05.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:05.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:05 smithi179 bash[23186]: cluster 2024-09-20T22:23:04.687290+0000 mgr.a (mgr.14388) 362 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:23:06.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:05 smithi049 bash[23528]: cluster 2024-09-20T22:23:04.687290+0000 mgr.a (mgr.14388) 362 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:23:06.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:05 smithi044 bash[22676]: cluster 2024-09-20T22:23:04.687290+0000 mgr.a (mgr.14388) 362 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:23:06.954 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:06 smithi179 bash[23186]: audit 2024-09-20T22:23:05.312916+0000 mgr.a (mgr.14388) 363 : audit [DBG] from='client.21522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:07.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:06 smithi044 bash[22676]: audit 2024-09-20T22:23:05.312916+0000 mgr.a (mgr.14388) 363 : audit [DBG] from='client.21522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:07.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:06 smithi049 bash[23528]: audit 2024-09-20T22:23:05.312916+0000 mgr.a (mgr.14388) 363 : audit [DBG] from='client.21522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:08.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:07 smithi044 bash[22676]: cluster 2024-09-20T22:23:06.689938+0000 mgr.a (mgr.14388) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:08.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:07 smithi179 bash[23186]: cluster 2024-09-20T22:23:06.689938+0000 mgr.a (mgr.14388) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:08.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:07 smithi049 bash[23528]: cluster 2024-09-20T22:23:06.689938+0000 mgr.a (mgr.14388) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:09.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:09 smithi044 bash[22676]: cluster 2024-09-20T22:23:08.690732+0000 mgr.a (mgr.14388) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:10.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:09 smithi179 bash[23186]: cluster 2024-09-20T22:23:08.690732+0000 mgr.a (mgr.14388) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:10.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:09 smithi049 bash[23528]: cluster 2024-09-20T22:23:08.690732+0000 mgr.a (mgr.14388) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:10.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:10.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:10.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:11.483 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:11.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:12.052 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:11 smithi044 bash[22676]: cluster 2024-09-20T22:23:10.692140+0000 mgr.a (mgr.14388) 366 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:12.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:11 smithi179 bash[23186]: cluster 2024-09-20T22:23:10.692140+0000 mgr.a (mgr.14388) 366 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:12.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:11 smithi049 bash[23528]: cluster 2024-09-20T22:23:10.692140+0000 mgr.a (mgr.14388) 366 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:12.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:12 smithi044 bash[22676]: audit 2024-09-20T22:23:11.071257+0000 mgr.a (mgr.14388) 367 : audit [DBG] from='client.21600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:13.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:12 smithi179 bash[23186]: audit 2024-09-20T22:23:11.071257+0000 mgr.a (mgr.14388) 367 : audit [DBG] from='client.21600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:13.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:12 smithi049 bash[23528]: audit 2024-09-20T22:23:11.071257+0000 mgr.a (mgr.14388) 367 : audit [DBG] from='client.21600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:14.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:13 smithi044 bash[22676]: cluster 2024-09-20T22:23:12.692684+0000 mgr.a (mgr.14388) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:14.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:13 smithi179 bash[23186]: cluster 2024-09-20T22:23:12.692684+0000 mgr.a (mgr.14388) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:14.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:13 smithi049 bash[23528]: cluster 2024-09-20T22:23:12.692684+0000 mgr.a (mgr.14388) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:16.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:15 smithi044 bash[22676]: cluster 2024-09-20T22:23:14.693422+0000 mgr.a (mgr.14388) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:16.322 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:15 smithi049 bash[23528]: cluster 2024-09-20T22:23:14.693422+0000 mgr.a (mgr.14388) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:16.322 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:15 smithi179 bash[23186]: cluster 2024-09-20T22:23:14.693422+0000 mgr.a (mgr.14388) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:23:16.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:16.485 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:16.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:17.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:18.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:17 smithi044 bash[22676]: cluster 2024-09-20T22:23:16.695508+0000 mgr.a (mgr.14388) 370 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:18.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:17 smithi044 bash[22676]: audit 2024-09-20T22:23:16.820541+0000 mgr.a (mgr.14388) 371 : audit [DBG] from='client.21678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:18.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:17 smithi179 bash[23186]: cluster 2024-09-20T22:23:16.695508+0000 mgr.a (mgr.14388) 370 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:18.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:17 smithi179 bash[23186]: audit 2024-09-20T22:23:16.820541+0000 mgr.a (mgr.14388) 371 : audit [DBG] from='client.21678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:18.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:17 smithi049 bash[23528]: cluster 2024-09-20T22:23:16.695508+0000 mgr.a (mgr.14388) 370 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:23:18.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:17 smithi049 bash[23528]: audit 2024-09-20T22:23:16.820541+0000 mgr.a (mgr.14388) 371 : audit [DBG] from='client.21678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:19 smithi049 bash[23528]: cluster 2024-09-20T22:23:18.696517+0000 mgr.a (mgr.14388) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:19 smithi049 bash[23528]: audit 2024-09-20T22:23:19.379861+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:19 smithi049 bash[23528]: audit 2024-09-20T22:23:19.388355+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:19 smithi049 bash[23528]: audit 2024-09-20T22:23:19.399452+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:19 smithi049 bash[23528]: audit 2024-09-20T22:23:19.407870+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:19 smithi049 bash[23528]: audit 2024-09-20T22:23:19.416864+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:19 smithi049 bash[23528]: audit 2024-09-20T22:23:19.427180+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:19 smithi044 bash[22676]: cluster 2024-09-20T22:23:18.696517+0000 mgr.a (mgr.14388) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:19 smithi044 bash[22676]: audit 2024-09-20T22:23:19.379861+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:19 smithi044 bash[22676]: audit 2024-09-20T22:23:19.388355+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:19 smithi044 bash[22676]: audit 2024-09-20T22:23:19.399452+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:19 smithi044 bash[22676]: audit 2024-09-20T22:23:19.407870+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:19 smithi044 bash[22676]: audit 2024-09-20T22:23:19.416864+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:19 smithi044 bash[22676]: audit 2024-09-20T22:23:19.427180+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:19 smithi179 bash[23186]: cluster 2024-09-20T22:23:18.696517+0000 mgr.a (mgr.14388) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:19 smithi179 bash[23186]: audit 2024-09-20T22:23:19.379861+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:19 smithi179 bash[23186]: audit 2024-09-20T22:23:19.388355+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:19 smithi179 bash[23186]: audit 2024-09-20T22:23:19.399452+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:19 smithi179 bash[23186]: audit 2024-09-20T22:23:19.407870+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:19 smithi179 bash[23186]: audit 2024-09-20T22:23:19.416864+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:19 smithi179 bash[23186]: audit 2024-09-20T22:23:19.427180+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:21 smithi044 bash[22676]: cluster 2024-09-20T22:23:20.698758+0000 mgr.a (mgr.14388) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:21.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:21 smithi044 bash[22676]: audit 2024-09-20T22:23:21.635485+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:21 smithi044 bash[22676]: audit 2024-09-20T22:23:21.644382+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:21 smithi044 bash[22676]: audit 2024-09-20T22:23:21.654829+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:21 smithi049 bash[23528]: cluster 2024-09-20T22:23:20.698758+0000 mgr.a (mgr.14388) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:21 smithi049 bash[23528]: audit 2024-09-20T22:23:21.635485+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:21 smithi049 bash[23528]: audit 2024-09-20T22:23:21.644382+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:22.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:21 smithi049 bash[23528]: audit 2024-09-20T22:23:21.654829+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:22.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:21 smithi179 bash[23186]: cluster 2024-09-20T22:23:20.698758+0000 mgr.a (mgr.14388) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:21 smithi179 bash[23186]: audit 2024-09-20T22:23:21.635485+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:21 smithi179 bash[23186]: audit 2024-09-20T22:23:21.644382+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:21 smithi179 bash[23186]: audit 2024-09-20T22:23:21.654829+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:23.021 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:23.022 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:23.022 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:23.022 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:23.022 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:24.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:23 smithi044 bash[22676]: audit 2024-09-20T22:23:22.582640+0000 mgr.a (mgr.14388) 374 : audit [DBG] from='client.21756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:24.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:23 smithi044 bash[22676]: cluster 2024-09-20T22:23:22.699367+0000 mgr.a (mgr.14388) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:23 smithi179 bash[23186]: audit 2024-09-20T22:23:22.582640+0000 mgr.a (mgr.14388) 374 : audit [DBG] from='client.21756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:23 smithi179 bash[23186]: cluster 2024-09-20T22:23:22.699367+0000 mgr.a (mgr.14388) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:24.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:23 smithi049 bash[23528]: audit 2024-09-20T22:23:22.582640+0000 mgr.a (mgr.14388) 374 : audit [DBG] from='client.21756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:24.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:23 smithi049 bash[23528]: cluster 2024-09-20T22:23:22.699367+0000 mgr.a (mgr.14388) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:26.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:25 smithi044 bash[22676]: cluster 2024-09-20T22:23:24.700202+0000 mgr.a (mgr.14388) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:26.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:25 smithi179 bash[23186]: cluster 2024-09-20T22:23:24.700202+0000 mgr.a (mgr.14388) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:26.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:25 smithi049 bash[23528]: cluster 2024-09-20T22:23:24.700202+0000 mgr.a (mgr.14388) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:27.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:27 smithi179 bash[23186]: cluster 2024-09-20T22:23:26.702407+0000 mgr.a (mgr.14388) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:28.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:28.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:28.024 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:28.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:27 smithi044 bash[22676]: cluster 2024-09-20T22:23:26.702407+0000 mgr.a (mgr.14388) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:28.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:27 smithi049 bash[23528]: cluster 2024-09-20T22:23:26.702407+0000 mgr.a (mgr.14388) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:28.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:28.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:30.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:29 smithi044 bash[22676]: audit 2024-09-20T22:23:28.361165+0000 mgr.a (mgr.14388) 378 : audit [DBG] from='client.21834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:30.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:29 smithi044 bash[22676]: cluster 2024-09-20T22:23:28.703041+0000 mgr.a (mgr.14388) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:30.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:29 smithi179 bash[23186]: audit 2024-09-20T22:23:28.361165+0000 mgr.a (mgr.14388) 378 : audit [DBG] from='client.21834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:30.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:29 smithi179 bash[23186]: cluster 2024-09-20T22:23:28.703041+0000 mgr.a (mgr.14388) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:30.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:29 smithi049 bash[23528]: audit 2024-09-20T22:23:28.361165+0000 mgr.a (mgr.14388) 378 : audit [DBG] from='client.21834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:30.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:29 smithi049 bash[23528]: cluster 2024-09-20T22:23:28.703041+0000 mgr.a (mgr.14388) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:32.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:31 smithi044 bash[22676]: cluster 2024-09-20T22:23:30.705243+0000 mgr.a (mgr.14388) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:32.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:31 smithi179 bash[23186]: cluster 2024-09-20T22:23:30.705243+0000 mgr.a (mgr.14388) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:32.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:31 smithi049 bash[23528]: cluster 2024-09-20T22:23:30.705243+0000 mgr.a (mgr.14388) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:33.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:33.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:33.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:33.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:33 smithi044 bash[22676]: cluster 2024-09-20T22:23:32.706022+0000 mgr.a (mgr.14388) 381 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:34.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:33 smithi179 bash[23186]: cluster 2024-09-20T22:23:32.706022+0000 mgr.a (mgr.14388) 381 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:34.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:33 smithi049 bash[23528]: cluster 2024-09-20T22:23:32.706022+0000 mgr.a (mgr.14388) 381 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:34.565 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:34.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:34.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:34.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:34.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:36.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:35 smithi044 bash[22676]: audit 2024-09-20T22:23:34.123818+0000 mgr.a (mgr.14388) 382 : audit [DBG] from='client.21912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:36.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:35 smithi044 bash[22676]: cluster 2024-09-20T22:23:34.706972+0000 mgr.a (mgr.14388) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:36.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:35 smithi179 bash[23186]: audit 2024-09-20T22:23:34.123818+0000 mgr.a (mgr.14388) 382 : audit [DBG] from='client.21912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:36.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:35 smithi179 bash[23186]: cluster 2024-09-20T22:23:34.706972+0000 mgr.a (mgr.14388) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:36.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:35 smithi049 bash[23528]: audit 2024-09-20T22:23:34.123818+0000 mgr.a (mgr.14388) 382 : audit [DBG] from='client.21912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:36.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:35 smithi049 bash[23528]: cluster 2024-09-20T22:23:34.706972+0000 mgr.a (mgr.14388) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:37 smithi044 bash[22676]: cluster 2024-09-20T22:23:36.709285+0000 mgr.a (mgr.14388) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:38.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:37 smithi179 bash[23186]: cluster 2024-09-20T22:23:36.709285+0000 mgr.a (mgr.14388) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:38.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:37 smithi049 bash[23528]: cluster 2024-09-20T22:23:36.709285+0000 mgr.a (mgr.14388) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:39 smithi179 bash[23186]: cluster 2024-09-20T22:23:38.710065+0000 mgr.a (mgr.14388) 385 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:39 smithi179 bash[23186]: audit 2024-09-20T22:23:39.609974+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:39 smithi179 bash[23186]: audit 2024-09-20T22:23:39.618574+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:39 smithi179 bash[23186]: audit 2024-09-20T22:23:39.630010+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:39.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:39 smithi179 bash[23186]: audit 2024-09-20T22:23:39.638309+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:39.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:39 smithi179 bash[23186]: audit 2024-09-20T22:23:39.646466+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:39.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:39 smithi179 bash[23186]: audit 2024-09-20T22:23:39.655519+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:39 smithi049 bash[23528]: cluster 2024-09-20T22:23:38.710065+0000 mgr.a (mgr.14388) 385 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:39 smithi049 bash[23528]: audit 2024-09-20T22:23:39.609974+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:39 smithi049 bash[23528]: audit 2024-09-20T22:23:39.618574+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:39 smithi049 bash[23528]: audit 2024-09-20T22:23:39.630010+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:39 smithi049 bash[23528]: audit 2024-09-20T22:23:39.638309+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:39 smithi049 bash[23528]: audit 2024-09-20T22:23:39.646466+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:39 smithi049 bash[23528]: audit 2024-09-20T22:23:39.655519+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:39 smithi044 bash[22676]: cluster 2024-09-20T22:23:38.710065+0000 mgr.a (mgr.14388) 385 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:39 smithi044 bash[22676]: audit 2024-09-20T22:23:39.609974+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:39 smithi044 bash[22676]: audit 2024-09-20T22:23:39.618574+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:39 smithi044 bash[22676]: audit 2024-09-20T22:23:39.630010+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:39 smithi044 bash[22676]: audit 2024-09-20T22:23:39.638309+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:39 smithi044 bash[22676]: audit 2024-09-20T22:23:39.646466+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:39 smithi044 bash[22676]: audit 2024-09-20T22:23:39.655519+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:40.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:41.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:40 smithi049 bash[23528]: audit 2024-09-20T22:23:39.907577+0000 mgr.a (mgr.14388) 386 : audit [DBG] from='client.21990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:41.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:40 smithi044 bash[22676]: audit 2024-09-20T22:23:39.907577+0000 mgr.a (mgr.14388) 386 : audit [DBG] from='client.21990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:41.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:40 smithi179 bash[23186]: audit 2024-09-20T22:23:39.907577+0000 mgr.a (mgr.14388) 386 : audit [DBG] from='client.21990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:42.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:41 smithi044 bash[22676]: cluster 2024-09-20T22:23:40.712703+0000 mgr.a (mgr.14388) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:41 smithi044 bash[22676]: audit 2024-09-20T22:23:41.877660+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:41 smithi179 bash[23186]: cluster 2024-09-20T22:23:40.712703+0000 mgr.a (mgr.14388) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:41 smithi179 bash[23186]: audit 2024-09-20T22:23:41.877660+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:41 smithi049 bash[23528]: cluster 2024-09-20T22:23:40.712703+0000 mgr.a (mgr.14388) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:42.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:41 smithi049 bash[23528]: audit 2024-09-20T22:23:41.877660+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:42 smithi044 bash[22676]: audit 2024-09-20T22:23:41.886013+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:42 smithi044 bash[22676]: audit 2024-09-20T22:23:41.903016+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:43.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:42 smithi179 bash[23186]: audit 2024-09-20T22:23:41.886013+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:43.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:42 smithi179 bash[23186]: audit 2024-09-20T22:23:41.903016+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:43.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:42 smithi049 bash[23528]: audit 2024-09-20T22:23:41.886013+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:43.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:42 smithi049 bash[23528]: audit 2024-09-20T22:23:41.903016+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:23:44.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:43 smithi044 bash[22676]: cluster 2024-09-20T22:23:42.713510+0000 mgr.a (mgr.14388) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:23:44.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:43 smithi179 bash[23186]: cluster 2024-09-20T22:23:42.713510+0000 mgr.a (mgr.14388) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:23:44.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:43 smithi049 bash[23528]: cluster 2024-09-20T22:23:42.713510+0000 mgr.a (mgr.14388) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:23:45.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:45.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:45.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:46.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:46.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:46.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:46.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:46.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:45 smithi044 bash[22676]: cluster 2024-09-20T22:23:44.714282+0000 mgr.a (mgr.14388) 389 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:23:46.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:45 smithi179 bash[23186]: cluster 2024-09-20T22:23:44.714282+0000 mgr.a (mgr.14388) 389 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:23:46.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:45 smithi049 bash[23528]: cluster 2024-09-20T22:23:44.714282+0000 mgr.a (mgr.14388) 389 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:23:47.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:46 smithi044 bash[22676]: audit 2024-09-20T22:23:45.693772+0000 mgr.a (mgr.14388) 390 : audit [DBG] from='client.22068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:47.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:46 smithi179 bash[23186]: audit 2024-09-20T22:23:45.693772+0000 mgr.a (mgr.14388) 390 : audit [DBG] from='client.22068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:47.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:46 smithi049 bash[23528]: audit 2024-09-20T22:23:45.693772+0000 mgr.a (mgr.14388) 390 : audit [DBG] from='client.22068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:48.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:47 smithi044 bash[22676]: cluster 2024-09-20T22:23:46.716947+0000 mgr.a (mgr.14388) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:48.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:47 smithi179 bash[23186]: cluster 2024-09-20T22:23:46.716947+0000 mgr.a (mgr.14388) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:48.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:47 smithi049 bash[23528]: cluster 2024-09-20T22:23:46.716947+0000 mgr.a (mgr.14388) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:49 smithi179 bash[23186]: cluster 2024-09-20T22:23:48.717748+0000 mgr.a (mgr.14388) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:23:50.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:49 smithi044 bash[22676]: cluster 2024-09-20T22:23:48.717748+0000 mgr.a (mgr.14388) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:23:50.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:49 smithi049 bash[23528]: cluster 2024-09-20T22:23:48.717748+0000 mgr.a (mgr.14388) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:23:51.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:51.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:51.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:51.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:51.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:51.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:52.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:51 smithi044 bash[22676]: cluster 2024-09-20T22:23:50.719836+0000 mgr.a (mgr.14388) 393 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:52.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:51 smithi179 bash[23186]: cluster 2024-09-20T22:23:50.719836+0000 mgr.a (mgr.14388) 393 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:52.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:51 smithi049 bash[23528]: cluster 2024-09-20T22:23:50.719836+0000 mgr.a (mgr.14388) 393 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:53.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:52 smithi044 bash[22676]: audit 2024-09-20T22:23:51.485727+0000 mgr.a (mgr.14388) 394 : audit [DBG] from='client.22146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:53.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:52 smithi179 bash[23186]: audit 2024-09-20T22:23:51.485727+0000 mgr.a (mgr.14388) 394 : audit [DBG] from='client.22146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:53.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:52 smithi049 bash[23528]: audit 2024-09-20T22:23:51.485727+0000 mgr.a (mgr.14388) 394 : audit [DBG] from='client.22146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:54.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:53 smithi044 bash[22676]: cluster 2024-09-20T22:23:52.720784+0000 mgr.a (mgr.14388) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:54.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:53 smithi179 bash[23186]: cluster 2024-09-20T22:23:52.720784+0000 mgr.a (mgr.14388) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:54.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:53 smithi049 bash[23528]: cluster 2024-09-20T22:23:52.720784+0000 mgr.a (mgr.14388) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:56.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:55 smithi044 bash[22676]: cluster 2024-09-20T22:23:54.721603+0000 mgr.a (mgr.14388) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:56.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:55 smithi179 bash[23186]: cluster 2024-09-20T22:23:54.721603+0000 mgr.a (mgr.14388) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:56.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:55 smithi049 bash[23528]: cluster 2024-09-20T22:23:54.721603+0000 mgr.a (mgr.14388) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:56.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:23:56.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:23:56.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:23:57.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:56 smithi044 bash[22676]: cluster 2024-09-20T22:23:56.723780+0000 mgr.a (mgr.14388) 397 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:56 smithi179 bash[23186]: cluster 2024-09-20T22:23:56.723780+0000 mgr.a (mgr.14388) 397 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:57.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:56 smithi049 bash[23528]: cluster 2024-09-20T22:23:56.723780+0000 mgr.a (mgr.14388) 397 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:23:57.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:23:57.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:23:57.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:23:57.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:23:57.683 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:23:58.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:57 smithi044 bash[22676]: audit 2024-09-20T22:23:57.267909+0000 mgr.a (mgr.14388) 398 : audit [DBG] from='client.22224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:58.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:57 smithi179 bash[23186]: audit 2024-09-20T22:23:57.267909+0000 mgr.a (mgr.14388) 398 : audit [DBG] from='client.22224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:58.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:57 smithi049 bash[23528]: audit 2024-09-20T22:23:57.267909+0000 mgr.a (mgr.14388) 398 : audit [DBG] from='client.22224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:23:59.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:23:58 smithi044 bash[22676]: cluster 2024-09-20T22:23:58.724664+0000 mgr.a (mgr.14388) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:59.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:23:58 smithi179 bash[23186]: cluster 2024-09-20T22:23:58.724664+0000 mgr.a (mgr.14388) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:23:59.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:23:58 smithi049 bash[23528]: cluster 2024-09-20T22:23:58.724664+0000 mgr.a (mgr.14388) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:01.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:00 smithi049 bash[23528]: audit 2024-09-20T22:23:59.846526+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:00 smithi049 bash[23528]: audit 2024-09-20T22:23:59.855641+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:00 smithi049 bash[23528]: audit 2024-09-20T22:23:59.867872+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:00 smithi049 bash[23528]: audit 2024-09-20T22:23:59.876714+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:00 smithi049 bash[23528]: audit 2024-09-20T22:23:59.886406+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:00 smithi049 bash[23528]: audit 2024-09-20T22:23:59.896329+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:00 smithi044 bash[22676]: audit 2024-09-20T22:23:59.846526+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:00 smithi044 bash[22676]: audit 2024-09-20T22:23:59.855641+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:00 smithi044 bash[22676]: audit 2024-09-20T22:23:59.867872+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:00 smithi044 bash[22676]: audit 2024-09-20T22:23:59.876714+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:00 smithi044 bash[22676]: audit 2024-09-20T22:23:59.886406+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:00 smithi044 bash[22676]: audit 2024-09-20T22:23:59.896329+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:00 smithi179 bash[23186]: audit 2024-09-20T22:23:59.846526+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:00 smithi179 bash[23186]: audit 2024-09-20T22:23:59.855641+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:00 smithi179 bash[23186]: audit 2024-09-20T22:23:59.867872+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:00 smithi179 bash[23186]: audit 2024-09-20T22:23:59.876714+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:00 smithi179 bash[23186]: audit 2024-09-20T22:23:59.886406+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:01.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:00 smithi179 bash[23186]: audit 2024-09-20T22:23:59.896329+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:02.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:01 smithi049 bash[23528]: cluster 2024-09-20T22:24:00.726870+0000 mgr.a (mgr.14388) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:01 smithi044 bash[22676]: cluster 2024-09-20T22:24:00.726870+0000 mgr.a (mgr.14388) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:01 smithi179 bash[23186]: cluster 2024-09-20T22:24:00.726870+0000 mgr.a (mgr.14388) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:02.686 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:02.686 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:03.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:03.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:03.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:03.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:03.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:03.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:03 smithi044 bash[22676]: audit 2024-09-20T22:24:02.111700+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:03 smithi044 bash[22676]: audit 2024-09-20T22:24:02.121437+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:03 smithi044 bash[22676]: audit 2024-09-20T22:24:02.132464+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:03 smithi044 bash[22676]: cluster 2024-09-20T22:24:02.727628+0000 mgr.a (mgr.14388) 401 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:03 smithi179 bash[23186]: audit 2024-09-20T22:24:02.111700+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:03 smithi179 bash[23186]: audit 2024-09-20T22:24:02.121437+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:03 smithi179 bash[23186]: audit 2024-09-20T22:24:02.132464+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:03 smithi179 bash[23186]: cluster 2024-09-20T22:24:02.727628+0000 mgr.a (mgr.14388) 401 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:03.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:03 smithi049 bash[23528]: audit 2024-09-20T22:24:02.111700+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:03 smithi049 bash[23528]: audit 2024-09-20T22:24:02.121437+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:03 smithi049 bash[23528]: audit 2024-09-20T22:24:02.132464+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:03.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:03 smithi049 bash[23528]: cluster 2024-09-20T22:24:02.727628+0000 mgr.a (mgr.14388) 401 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:04.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22676]: audit 2024-09-20T22:24:03.013004+0000 mgr.a (mgr.14388) 402 : audit [DBG] from='client.22302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22676]: audit 2024-09-20T22:24:03.885876+0000 mon.a (mon.0) 1135 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:24:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22676]: audit 2024-09-20T22:24:03.893184+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:24:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22676]: audit 2024-09-20T22:24:03.895076+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:24:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22676]: audit 2024-09-20T22:24:03.906344+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22676]: audit 2024-09-20T22:24:03.912796+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:24:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22676]: audit 2024-09-20T22:24:03.915512+0000 mgr.a (mgr.14388) 403 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:24:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:04 smithi179 bash[23186]: audit 2024-09-20T22:24:03.013004+0000 mgr.a (mgr.14388) 402 : audit [DBG] from='client.22302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:04 smithi179 bash[23186]: audit 2024-09-20T22:24:03.885876+0000 mon.a (mon.0) 1135 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:24:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:04 smithi179 bash[23186]: audit 2024-09-20T22:24:03.893184+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:24:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:04 smithi179 bash[23186]: audit 2024-09-20T22:24:03.895076+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:24:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:04 smithi179 bash[23186]: audit 2024-09-20T22:24:03.906344+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:04 smithi179 bash[23186]: audit 2024-09-20T22:24:03.912796+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:24:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:04 smithi179 bash[23186]: audit 2024-09-20T22:24:03.915512+0000 mgr.a (mgr.14388) 403 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:24:04.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:04 smithi049 bash[23528]: audit 2024-09-20T22:24:03.013004+0000 mgr.a (mgr.14388) 402 : audit [DBG] from='client.22302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:04.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:04 smithi049 bash[23528]: audit 2024-09-20T22:24:03.885876+0000 mon.a (mon.0) 1135 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:24:04.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:04 smithi049 bash[23528]: audit 2024-09-20T22:24:03.893184+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:24:04.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:04 smithi049 bash[23528]: audit 2024-09-20T22:24:03.895076+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:24:04.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:04 smithi049 bash[23528]: audit 2024-09-20T22:24:03.906344+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:04.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:04 smithi049 bash[23528]: audit 2024-09-20T22:24:03.912796+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:24:04.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:04 smithi049 bash[23528]: audit 2024-09-20T22:24:03.915512+0000 mgr.a (mgr.14388) 403 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:24:04.985 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22930]: debug 2024-09-20T22:24:04.648+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:24:04.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:24:04 smithi044 bash[22930]: debug 2024-09-20T22:24:04.652+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:24:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:05 smithi044 bash[22676]: audit 2024-09-20T22:24:04.653106+0000 mgr.a (mgr.14388) 404 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:24:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:05 smithi044 bash[22676]: cephadm 2024-09-20T22:24:04.654606+0000 mgr.a (mgr.14388) 405 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:24:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:05 smithi044 bash[22676]: cluster 2024-09-20T22:24:04.728526+0000 mgr.a (mgr.14388) 406 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:05.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:05 smithi179 bash[23186]: audit 2024-09-20T22:24:04.653106+0000 mgr.a (mgr.14388) 404 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:24:05.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:05 smithi179 bash[23186]: cephadm 2024-09-20T22:24:04.654606+0000 mgr.a (mgr.14388) 405 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:24:05.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:05 smithi179 bash[23186]: cluster 2024-09-20T22:24:04.728526+0000 mgr.a (mgr.14388) 406 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:05.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:05 smithi049 bash[23528]: audit 2024-09-20T22:24:04.653106+0000 mgr.a (mgr.14388) 404 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:24:05.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:05 smithi049 bash[23528]: cephadm 2024-09-20T22:24:04.654606+0000 mgr.a (mgr.14388) 405 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:24:05.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:05 smithi049 bash[23528]: cluster 2024-09-20T22:24:04.728526+0000 mgr.a (mgr.14388) 406 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:08.042 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:07 smithi049 bash[23528]: cluster 2024-09-20T22:24:06.730851+0000 mgr.a (mgr.14388) 407 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:08.049 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:07 smithi179 bash[23186]: cluster 2024-09-20T22:24:06.730851+0000 mgr.a (mgr.14388) 407 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:08.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:07 smithi044 bash[22676]: cluster 2024-09-20T22:24:06.730851+0000 mgr.a (mgr.14388) 407 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:08.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:08.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:08.437 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:09.201 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:09.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:09.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:09 smithi179 bash[23186]: cluster 2024-09-20T22:24:08.731597+0000 mgr.a (mgr.14388) 408 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:09.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:09 smithi179 bash[23186]: audit 2024-09-20T22:24:08.774797+0000 mgr.a (mgr.14388) 409 : audit [DBG] from='client.22479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:10.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:09 smithi049 bash[23528]: cluster 2024-09-20T22:24:08.731597+0000 mgr.a (mgr.14388) 408 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:10.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:09 smithi049 bash[23528]: audit 2024-09-20T22:24:08.774797+0000 mgr.a (mgr.14388) 409 : audit [DBG] from='client.22479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:09 smithi044 bash[22676]: cluster 2024-09-20T22:24:08.731597+0000 mgr.a (mgr.14388) 408 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:09 smithi044 bash[22676]: audit 2024-09-20T22:24:08.774797+0000 mgr.a (mgr.14388) 409 : audit [DBG] from='client.22479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:12.129 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:11 smithi044 bash[22676]: cluster 2024-09-20T22:24:10.734008+0000 mgr.a (mgr.14388) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:12.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:11 smithi179 bash[23186]: cluster 2024-09-20T22:24:10.734008+0000 mgr.a (mgr.14388) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:12.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:11 smithi049 bash[23528]: cluster 2024-09-20T22:24:10.734008+0000 mgr.a (mgr.14388) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:13.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:13 smithi044 bash[22676]: cluster 2024-09-20T22:24:12.734831+0000 mgr.a (mgr.14388) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:14.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:13 smithi179 bash[23186]: cluster 2024-09-20T22:24:12.734831+0000 mgr.a (mgr.14388) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:14.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:13 smithi049 bash[23528]: cluster 2024-09-20T22:24:12.734831+0000 mgr.a (mgr.14388) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:14.982 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:16.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:15 smithi044 bash[22676]: audit 2024-09-20T22:24:14.548152+0000 mgr.a (mgr.14388) 412 : audit [DBG] from='client.22557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:15 smithi044 bash[22676]: cluster 2024-09-20T22:24:14.735386+0000 mgr.a (mgr.14388) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:16.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:15 smithi179 bash[23186]: audit 2024-09-20T22:24:14.548152+0000 mgr.a (mgr.14388) 412 : audit [DBG] from='client.22557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:16.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:15 smithi179 bash[23186]: cluster 2024-09-20T22:24:14.735386+0000 mgr.a (mgr.14388) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:16.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:15 smithi049 bash[23528]: audit 2024-09-20T22:24:14.548152+0000 mgr.a (mgr.14388) 412 : audit [DBG] from='client.22557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:16.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:15 smithi049 bash[23528]: cluster 2024-09-20T22:24:14.735386+0000 mgr.a (mgr.14388) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:17 smithi044 bash[22676]: cluster 2024-09-20T22:24:16.737841+0000 mgr.a (mgr.14388) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:18.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:17 smithi179 bash[23186]: cluster 2024-09-20T22:24:16.737841+0000 mgr.a (mgr.14388) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:18.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:17 smithi049 bash[23528]: cluster 2024-09-20T22:24:16.737841+0000 mgr.a (mgr.14388) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:24:19.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:19.985 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:19.985 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:20.080 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:19 smithi179 bash[23186]: cluster 2024-09-20T22:24:18.738616+0000 mgr.a (mgr.14388) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:24:20.111 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:19 smithi049 bash[23528]: cluster 2024-09-20T22:24:18.738616+0000 mgr.a (mgr.14388) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:24:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:19 smithi044 bash[22676]: cluster 2024-09-20T22:24:18.738616+0000 mgr.a (mgr.14388) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:24:20.741 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:20.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:20.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:20.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:20.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:21.343 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: audit 2024-09-20T22:24:20.068456+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.343 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: audit 2024-09-20T22:24:20.074245+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.343 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: audit 2024-09-20T22:24:20.080070+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.344 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: audit 2024-09-20T22:24:20.101498+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.344 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: audit 2024-09-20T22:24:20.106329+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.344 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: audit 2024-09-20T22:24:20.111273+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.344 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: audit 2024-09-20T22:24:20.321771+0000 mgr.a (mgr.14388) 416 : audit [DBG] from='client.22635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:21.344 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:21 smithi049 bash[23528]: cluster 2024-09-20T22:24:20.740147+0000 mgr.a (mgr.14388) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: audit 2024-09-20T22:24:20.068456+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: audit 2024-09-20T22:24:20.074245+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: audit 2024-09-20T22:24:20.080070+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: audit 2024-09-20T22:24:20.101498+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: audit 2024-09-20T22:24:20.106329+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: audit 2024-09-20T22:24:20.111273+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: audit 2024-09-20T22:24:20.321771+0000 mgr.a (mgr.14388) 416 : audit [DBG] from='client.22635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:21 smithi044 bash[22676]: cluster 2024-09-20T22:24:20.740147+0000 mgr.a (mgr.14388) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: audit 2024-09-20T22:24:20.068456+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: audit 2024-09-20T22:24:20.074245+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: audit 2024-09-20T22:24:20.080070+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: audit 2024-09-20T22:24:20.101498+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: audit 2024-09-20T22:24:20.106329+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: audit 2024-09-20T22:24:20.111273+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: audit 2024-09-20T22:24:20.321771+0000 mgr.a (mgr.14388) 416 : audit [DBG] from='client.22635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:21.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:21 smithi179 bash[23186]: cluster 2024-09-20T22:24:20.740147+0000 mgr.a (mgr.14388) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:23 smithi044 bash[22676]: audit 2024-09-20T22:24:22.349000+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:23 smithi044 bash[22676]: audit 2024-09-20T22:24:22.356736+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:23 smithi044 bash[22676]: audit 2024-09-20T22:24:22.367614+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:23 smithi044 bash[22676]: cluster 2024-09-20T22:24:22.740883+0000 mgr.a (mgr.14388) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:24:23.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:23 smithi179 bash[23186]: audit 2024-09-20T22:24:22.349000+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:23 smithi179 bash[23186]: audit 2024-09-20T22:24:22.356736+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:23 smithi179 bash[23186]: audit 2024-09-20T22:24:22.367614+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:23 smithi179 bash[23186]: cluster 2024-09-20T22:24:22.740883+0000 mgr.a (mgr.14388) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:24:23.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:23 smithi049 bash[23528]: audit 2024-09-20T22:24:22.349000+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:23 smithi049 bash[23528]: audit 2024-09-20T22:24:22.356736+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:23 smithi049 bash[23528]: audit 2024-09-20T22:24:22.367614+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:23.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:23 smithi049 bash[23528]: cluster 2024-09-20T22:24:22.740883+0000 mgr.a (mgr.14388) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:24:25.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:25.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:25.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:26.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:25 smithi044 bash[22676]: cluster 2024-09-20T22:24:24.741662+0000 mgr.a (mgr.14388) 419 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:24:26.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:25 smithi179 bash[23186]: cluster 2024-09-20T22:24:24.741662+0000 mgr.a (mgr.14388) 419 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:24:26.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:25 smithi049 bash[23528]: cluster 2024-09-20T22:24:24.741662+0000 mgr.a (mgr.14388) 419 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:24:26.527 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:26.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:26.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:26.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:26.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:28.132 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:27 smithi049 bash[23528]: audit 2024-09-20T22:24:26.085204+0000 mgr.a (mgr.14388) 420 : audit [DBG] from='client.22713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:28.132 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:27 smithi049 bash[23528]: cluster 2024-09-20T22:24:26.744441+0000 mgr.a (mgr.14388) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:28.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:27 smithi044 bash[22676]: audit 2024-09-20T22:24:26.085204+0000 mgr.a (mgr.14388) 420 : audit [DBG] from='client.22713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:27 smithi044 bash[22676]: cluster 2024-09-20T22:24:26.744441+0000 mgr.a (mgr.14388) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:28.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:27 smithi179 bash[23186]: audit 2024-09-20T22:24:26.085204+0000 mgr.a (mgr.14388) 420 : audit [DBG] from='client.22713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:28.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:27 smithi179 bash[23186]: cluster 2024-09-20T22:24:26.744441+0000 mgr.a (mgr.14388) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:29 smithi044 bash[22676]: cluster 2024-09-20T22:24:28.745241+0000 mgr.a (mgr.14388) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T22:24:30.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:29 smithi179 bash[23186]: cluster 2024-09-20T22:24:28.745241+0000 mgr.a (mgr.14388) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T22:24:30.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:29 smithi049 bash[23528]: cluster 2024-09-20T22:24:28.745241+0000 mgr.a (mgr.14388) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T22:24:31.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:31.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:31.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:32.125 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:31 smithi179 bash[23186]: cluster 2024-09-20T22:24:30.747188+0000 mgr.a (mgr.14388) 423 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:24:32.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:31 smithi044 bash[22676]: cluster 2024-09-20T22:24:30.747188+0000 mgr.a (mgr.14388) 423 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:24:32.283 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:32.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:32.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:32.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:32.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:32.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:31 smithi049 bash[23528]: cluster 2024-09-20T22:24:30.747188+0000 mgr.a (mgr.14388) 423 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:24:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:32 smithi044 bash[22676]: audit 2024-09-20T22:24:31.860792+0000 mgr.a (mgr.14388) 424 : audit [DBG] from='client.22788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:33.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:32 smithi179 bash[23186]: audit 2024-09-20T22:24:31.860792+0000 mgr.a (mgr.14388) 424 : audit [DBG] from='client.22788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:33.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:32 smithi049 bash[23528]: audit 2024-09-20T22:24:31.860792+0000 mgr.a (mgr.14388) 424 : audit [DBG] from='client.22788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:33.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:33 smithi044 bash[22676]: cluster 2024-09-20T22:24:32.748205+0000 mgr.a (mgr.14388) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:34.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:33 smithi179 bash[23186]: cluster 2024-09-20T22:24:32.748205+0000 mgr.a (mgr.14388) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:34.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:33 smithi049 bash[23528]: cluster 2024-09-20T22:24:32.748205+0000 mgr.a (mgr.14388) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:35 smithi044 bash[22676]: cluster 2024-09-20T22:24:34.749056+0000 mgr.a (mgr.14388) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:36.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:35 smithi179 bash[23186]: cluster 2024-09-20T22:24:34.749056+0000 mgr.a (mgr.14388) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:36.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:35 smithi049 bash[23528]: cluster 2024-09-20T22:24:34.749056+0000 mgr.a (mgr.14388) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:37.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:37.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:37.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:38.072 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:38.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:37 smithi044 bash[22676]: cluster 2024-09-20T22:24:36.751309+0000 mgr.a (mgr.14388) 427 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:37 smithi179 bash[23186]: cluster 2024-09-20T22:24:36.751309+0000 mgr.a (mgr.14388) 427 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:38.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:37 smithi049 bash[23528]: cluster 2024-09-20T22:24:36.751309+0000 mgr.a (mgr.14388) 427 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:38 smithi044 bash[22676]: audit 2024-09-20T22:24:37.624030+0000 mgr.a (mgr.14388) 428 : audit [DBG] from='client.22866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:39.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:38 smithi179 bash[23186]: audit 2024-09-20T22:24:37.624030+0000 mgr.a (mgr.14388) 428 : audit [DBG] from='client.22866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:39.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:38 smithi049 bash[23528]: audit 2024-09-20T22:24:37.624030+0000 mgr.a (mgr.14388) 428 : audit [DBG] from='client.22866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:39 smithi044 bash[22676]: cluster 2024-09-20T22:24:38.752311+0000 mgr.a (mgr.14388) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:40.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:39 smithi179 bash[23186]: cluster 2024-09-20T22:24:38.752311+0000 mgr.a (mgr.14388) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:40.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:39 smithi049 bash[23528]: cluster 2024-09-20T22:24:38.752311+0000 mgr.a (mgr.14388) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:41.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:41 smithi049 bash[23528]: audit 2024-09-20T22:24:40.295474+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:41 smithi049 bash[23528]: audit 2024-09-20T22:24:40.307032+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:41 smithi049 bash[23528]: audit 2024-09-20T22:24:40.332067+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:41 smithi049 bash[23528]: audit 2024-09-20T22:24:40.340313+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:41 smithi049 bash[23528]: audit 2024-09-20T22:24:40.356015+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:41 smithi049 bash[23528]: audit 2024-09-20T22:24:40.366417+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:41 smithi049 bash[23528]: cluster 2024-09-20T22:24:40.754568+0000 mgr.a (mgr.14388) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:41 smithi044 bash[22676]: audit 2024-09-20T22:24:40.295474+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:41 smithi044 bash[22676]: audit 2024-09-20T22:24:40.307032+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:41 smithi044 bash[22676]: audit 2024-09-20T22:24:40.332067+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:41 smithi044 bash[22676]: audit 2024-09-20T22:24:40.340313+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:41 smithi044 bash[22676]: audit 2024-09-20T22:24:40.356015+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:41 smithi044 bash[22676]: audit 2024-09-20T22:24:40.366417+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:41 smithi044 bash[22676]: cluster 2024-09-20T22:24:40.754568+0000 mgr.a (mgr.14388) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:41 smithi179 bash[23186]: audit 2024-09-20T22:24:40.295474+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:41 smithi179 bash[23186]: audit 2024-09-20T22:24:40.307032+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:41 smithi179 bash[23186]: audit 2024-09-20T22:24:40.332067+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:41 smithi179 bash[23186]: audit 2024-09-20T22:24:40.340313+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:41 smithi179 bash[23186]: audit 2024-09-20T22:24:40.356015+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:41 smithi179 bash[23186]: audit 2024-09-20T22:24:40.366417+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:41.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:41 smithi179 bash[23186]: cluster 2024-09-20T22:24:40.754568+0000 mgr.a (mgr.14388) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:43.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:43.074 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:43.074 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:43.825 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:43.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:43.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:43.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:43.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:43 smithi044 bash[22676]: audit 2024-09-20T22:24:42.585766+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:43 smithi044 bash[22676]: audit 2024-09-20T22:24:42.594137+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:43 smithi044 bash[22676]: audit 2024-09-20T22:24:42.604008+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:43 smithi044 bash[22676]: cluster 2024-09-20T22:24:42.755333+0000 mgr.a (mgr.14388) 431 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:43.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:43 smithi179 bash[23186]: audit 2024-09-20T22:24:42.585766+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:43.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:43 smithi179 bash[23186]: audit 2024-09-20T22:24:42.594137+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:43.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:43 smithi179 bash[23186]: audit 2024-09-20T22:24:42.604008+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:43.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:43 smithi179 bash[23186]: cluster 2024-09-20T22:24:42.755333+0000 mgr.a (mgr.14388) 431 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:44.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:43 smithi049 bash[23528]: audit 2024-09-20T22:24:42.585766+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:44.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:43 smithi049 bash[23528]: audit 2024-09-20T22:24:42.594137+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:44.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:43 smithi049 bash[23528]: audit 2024-09-20T22:24:42.604008+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:24:44.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:43 smithi049 bash[23528]: cluster 2024-09-20T22:24:42.755333+0000 mgr.a (mgr.14388) 431 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:44 smithi044 bash[22676]: audit 2024-09-20T22:24:43.412617+0000 mgr.a (mgr.14388) 432 : audit [DBG] from='client.22944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:44.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:44 smithi179 bash[23186]: audit 2024-09-20T22:24:43.412617+0000 mgr.a (mgr.14388) 432 : audit [DBG] from='client.22944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:45.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:44 smithi049 bash[23528]: audit 2024-09-20T22:24:43.412617+0000 mgr.a (mgr.14388) 432 : audit [DBG] from='client.22944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:45 smithi044 bash[22676]: cluster 2024-09-20T22:24:44.756292+0000 mgr.a (mgr.14388) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:45.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:45 smithi179 bash[23186]: cluster 2024-09-20T22:24:44.756292+0000 mgr.a (mgr.14388) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:46.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:45 smithi049 bash[23528]: cluster 2024-09-20T22:24:44.756292+0000 mgr.a (mgr.14388) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:47 smithi044 bash[22676]: cluster 2024-09-20T22:24:46.758581+0000 mgr.a (mgr.14388) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:48.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:47 smithi179 bash[23186]: cluster 2024-09-20T22:24:46.758581+0000 mgr.a (mgr.14388) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:48.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:47 smithi049 bash[23528]: cluster 2024-09-20T22:24:46.758581+0000 mgr.a (mgr.14388) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:48.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:48.827 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:48.827 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:49.592 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:49.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:49 smithi179 bash[23186]: cluster 2024-09-20T22:24:48.759342+0000 mgr.a (mgr.14388) 435 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:49 smithi044 bash[22676]: cluster 2024-09-20T22:24:48.759342+0000 mgr.a (mgr.14388) 435 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:50.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:49 smithi049 bash[23528]: cluster 2024-09-20T22:24:48.759342+0000 mgr.a (mgr.14388) 435 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:50.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:50 smithi179 bash[23186]: audit 2024-09-20T22:24:49.162078+0000 mgr.a (mgr.14388) 436 : audit [DBG] from='client.23022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:50 smithi044 bash[22676]: audit 2024-09-20T22:24:49.162078+0000 mgr.a (mgr.14388) 436 : audit [DBG] from='client.23022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:51.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:50 smithi049 bash[23528]: audit 2024-09-20T22:24:49.162078+0000 mgr.a (mgr.14388) 436 : audit [DBG] from='client.23022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:52.085 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:51 smithi179 bash[23186]: cluster 2024-09-20T22:24:50.761790+0000 mgr.a (mgr.14388) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:51 smithi044 bash[22676]: cluster 2024-09-20T22:24:50.761790+0000 mgr.a (mgr.14388) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:52.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:51 smithi049 bash[23528]: cluster 2024-09-20T22:24:50.761790+0000 mgr.a (mgr.14388) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:24:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:53 smithi044 bash[22676]: cluster 2024-09-20T22:24:52.762562+0000 mgr.a (mgr.14388) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:54.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:53 smithi179 bash[23186]: cluster 2024-09-20T22:24:52.762562+0000 mgr.a (mgr.14388) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:54.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:53 smithi049 bash[23528]: cluster 2024-09-20T22:24:52.762562+0000 mgr.a (mgr.14388) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:24:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:24:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:24:55.348 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:24:55.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:24:55.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:24:55.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:24:55.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:24:56.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:55 smithi044 bash[22676]: cluster 2024-09-20T22:24:54.763303+0000 mgr.a (mgr.14388) 439 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:55 smithi044 bash[22676]: audit 2024-09-20T22:24:54.940189+0000 mgr.a (mgr.14388) 440 : audit [DBG] from='client.23097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:56.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:55 smithi179 bash[23186]: cluster 2024-09-20T22:24:54.763303+0000 mgr.a (mgr.14388) 439 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:56.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:55 smithi179 bash[23186]: audit 2024-09-20T22:24:54.940189+0000 mgr.a (mgr.14388) 440 : audit [DBG] from='client.23097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:56.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:55 smithi049 bash[23528]: cluster 2024-09-20T22:24:54.763303+0000 mgr.a (mgr.14388) 439 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:56.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:55 smithi049 bash[23528]: audit 2024-09-20T22:24:54.940189+0000 mgr.a (mgr.14388) 440 : audit [DBG] from='client.23097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:24:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:57 smithi044 bash[22676]: cluster 2024-09-20T22:24:56.766122+0000 mgr.a (mgr.14388) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:58.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:57 smithi179 bash[23186]: cluster 2024-09-20T22:24:56.766122+0000 mgr.a (mgr.14388) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:24:58.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:57 smithi049 bash[23528]: cluster 2024-09-20T22:24:56.766122+0000 mgr.a (mgr.14388) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:24:59 smithi044 bash[22676]: cluster 2024-09-20T22:24:58.766927+0000 mgr.a (mgr.14388) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:24:59 smithi179 bash[23186]: cluster 2024-09-20T22:24:58.766927+0000 mgr.a (mgr.14388) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:00.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:24:59 smithi049 bash[23528]: cluster 2024-09-20T22:24:58.766927+0000 mgr.a (mgr.14388) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:00.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:00.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:00.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:01.134 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:01.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: audit 2024-09-20T22:25:00.544126+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: audit 2024-09-20T22:25:00.551546+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: audit 2024-09-20T22:25:00.561588+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: audit 2024-09-20T22:25:00.577763+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: audit 2024-09-20T22:25:00.585755+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: audit 2024-09-20T22:25:00.595117+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: audit 2024-09-20T22:25:00.690032+0000 mgr.a (mgr.14388) 443 : audit [DBG] from='client.23172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:01.594 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:01 smithi049 bash[23528]: cluster 2024-09-20T22:25:00.768250+0000 mgr.a (mgr.14388) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: audit 2024-09-20T22:25:00.544126+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: audit 2024-09-20T22:25:00.551546+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: audit 2024-09-20T22:25:00.561588+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: audit 2024-09-20T22:25:00.577763+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: audit 2024-09-20T22:25:00.585755+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: audit 2024-09-20T22:25:00.595117+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: audit 2024-09-20T22:25:00.690032+0000 mgr.a (mgr.14388) 443 : audit [DBG] from='client.23172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:01 smithi044 bash[22676]: cluster 2024-09-20T22:25:00.768250+0000 mgr.a (mgr.14388) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: audit 2024-09-20T22:25:00.544126+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: audit 2024-09-20T22:25:00.551546+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: audit 2024-09-20T22:25:00.561588+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: audit 2024-09-20T22:25:00.577763+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: audit 2024-09-20T22:25:00.585755+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: audit 2024-09-20T22:25:00.595117+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: audit 2024-09-20T22:25:00.690032+0000 mgr.a (mgr.14388) 443 : audit [DBG] from='client.23172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:01.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:01 smithi179 bash[23186]: cluster 2024-09-20T22:25:00.768250+0000 mgr.a (mgr.14388) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:04.107 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:03 smithi049 bash[23528]: cluster 2024-09-20T22:25:02.769104+0000 mgr.a (mgr.14388) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:04.107 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:03 smithi049 bash[23528]: audit 2024-09-20T22:25:02.814052+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.108 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:03 smithi049 bash[23528]: audit 2024-09-20T22:25:02.823892+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.108 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:03 smithi049 bash[23528]: audit 2024-09-20T22:25:02.838830+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:03 smithi044 bash[22676]: cluster 2024-09-20T22:25:02.769104+0000 mgr.a (mgr.14388) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:03 smithi044 bash[22676]: audit 2024-09-20T22:25:02.814052+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:03 smithi044 bash[22676]: audit 2024-09-20T22:25:02.823892+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:03 smithi044 bash[22676]: audit 2024-09-20T22:25:02.838830+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:03 smithi179 bash[23186]: cluster 2024-09-20T22:25:02.769104+0000 mgr.a (mgr.14388) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:03 smithi179 bash[23186]: audit 2024-09-20T22:25:02.814052+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:03 smithi179 bash[23186]: audit 2024-09-20T22:25:02.823892+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:03 smithi179 bash[23186]: audit 2024-09-20T22:25:02.838830+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:05.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:04 smithi049 bash[23528]: audit 2024-09-20T22:25:04.720195+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:25:05.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:04 smithi049 bash[23528]: audit 2024-09-20T22:25:04.726233+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:25:05.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:04 smithi049 bash[23528]: audit 2024-09-20T22:25:04.728104+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:25:05.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:04 smithi049 bash[23528]: audit 2024-09-20T22:25:04.739312+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:05.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:04 smithi049 bash[23528]: audit 2024-09-20T22:25:04.745562+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:25:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:04 smithi044 bash[22676]: audit 2024-09-20T22:25:04.720195+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:25:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:04 smithi044 bash[22676]: audit 2024-09-20T22:25:04.726233+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:25:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:04 smithi044 bash[22676]: audit 2024-09-20T22:25:04.728104+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:25:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:04 smithi044 bash[22676]: audit 2024-09-20T22:25:04.739312+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:04 smithi044 bash[22676]: audit 2024-09-20T22:25:04.745562+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:25:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:04 smithi179 bash[23186]: audit 2024-09-20T22:25:04.720195+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:25:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:04 smithi179 bash[23186]: audit 2024-09-20T22:25:04.726233+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:25:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:04 smithi179 bash[23186]: audit 2024-09-20T22:25:04.728104+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:25:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:04 smithi179 bash[23186]: audit 2024-09-20T22:25:04.739312+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:05.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:04 smithi179 bash[23186]: audit 2024-09-20T22:25:04.745562+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:25:05.815 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:25:05 smithi044 bash[22930]: debug 2024-09-20T22:25:05.495+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:25:05.815 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:25:05 smithi044 bash[22930]: debug 2024-09-20T22:25:05.495+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:25:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:05 smithi044 bash[22676]: audit 2024-09-20T22:25:04.747955+0000 mgr.a (mgr.14388) 446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:25:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:05 smithi044 bash[22676]: cluster 2024-09-20T22:25:04.770829+0000 mgr.a (mgr.14388) 447 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:25:06.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:05 smithi179 bash[23186]: audit 2024-09-20T22:25:04.747955+0000 mgr.a (mgr.14388) 446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:25:06.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:05 smithi179 bash[23186]: cluster 2024-09-20T22:25:04.770829+0000 mgr.a (mgr.14388) 447 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:25:06.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:05 smithi049 bash[23528]: audit 2024-09-20T22:25:04.747955+0000 mgr.a (mgr.14388) 446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:25:06.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:05 smithi049 bash[23528]: cluster 2024-09-20T22:25:04.770829+0000 mgr.a (mgr.14388) 447 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:25:06.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:06.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:06.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:06.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:06.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:06 smithi044 bash[22676]: audit 2024-09-20T22:25:05.499390+0000 mgr.a (mgr.14388) 448 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:25:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:06 smithi044 bash[22676]: cephadm 2024-09-20T22:25:05.500817+0000 mgr.a (mgr.14388) 449 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:25:07.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:06 smithi179 bash[23186]: audit 2024-09-20T22:25:05.499390+0000 mgr.a (mgr.14388) 448 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:25:07.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:06 smithi179 bash[23186]: cephadm 2024-09-20T22:25:05.500817+0000 mgr.a (mgr.14388) 449 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:25:07.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:06 smithi049 bash[23528]: audit 2024-09-20T22:25:05.499390+0000 mgr.a (mgr.14388) 448 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:25:07.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:06 smithi049 bash[23528]: cephadm 2024-09-20T22:25:05.500817+0000 mgr.a (mgr.14388) 449 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:25:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:07 smithi044 bash[22676]: audit 2024-09-20T22:25:06.473453+0000 mgr.a (mgr.14388) 450 : audit [DBG] from='client.23352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:07 smithi044 bash[22676]: cluster 2024-09-20T22:25:06.772460+0000 mgr.a (mgr.14388) 451 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:25:08.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:07 smithi179 bash[23186]: audit 2024-09-20T22:25:06.473453+0000 mgr.a (mgr.14388) 450 : audit [DBG] from='client.23352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:08.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:07 smithi179 bash[23186]: cluster 2024-09-20T22:25:06.772460+0000 mgr.a (mgr.14388) 451 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:25:08.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:07 smithi049 bash[23528]: audit 2024-09-20T22:25:06.473453+0000 mgr.a (mgr.14388) 450 : audit [DBG] from='client.23352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:08.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:07 smithi049 bash[23528]: cluster 2024-09-20T22:25:06.772460+0000 mgr.a (mgr.14388) 451 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:25:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:09 smithi044 bash[22676]: cluster 2024-09-20T22:25:08.773331+0000 mgr.a (mgr.14388) 452 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:25:10.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:09 smithi179 bash[23186]: cluster 2024-09-20T22:25:08.773331+0000 mgr.a (mgr.14388) 452 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:25:10.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:09 smithi049 bash[23528]: cluster 2024-09-20T22:25:08.773331+0000 mgr.a (mgr.14388) 452 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:25:11.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:11.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:11.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:12.119 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:11 smithi179 bash[23186]: cluster 2024-09-20T22:25:10.775522+0000 mgr.a (mgr.14388) 453 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:11 smithi044 bash[22676]: cluster 2024-09-20T22:25:10.775522+0000 mgr.a (mgr.14388) 453 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:12.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:11 smithi049 bash[23528]: cluster 2024-09-20T22:25:10.775522+0000 mgr.a (mgr.14388) 453 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:12.689 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:12.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:12.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:12.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:12.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:13.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:13 smithi179 bash[23186]: audit 2024-09-20T22:25:12.253042+0000 mgr.a (mgr.14388) 454 : audit [DBG] from='client.23427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:13.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:13 smithi179 bash[23186]: cluster 2024-09-20T22:25:12.776478+0000 mgr.a (mgr.14388) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:14.104 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:13 smithi044 bash[22676]: audit 2024-09-20T22:25:12.253042+0000 mgr.a (mgr.14388) 454 : audit [DBG] from='client.23427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:14.104 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:13 smithi044 bash[22676]: cluster 2024-09-20T22:25:12.776478+0000 mgr.a (mgr.14388) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:14.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:13 smithi049 bash[23528]: audit 2024-09-20T22:25:12.253042+0000 mgr.a (mgr.14388) 454 : audit [DBG] from='client.23427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:14.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:13 smithi049 bash[23528]: cluster 2024-09-20T22:25:12.776478+0000 mgr.a (mgr.14388) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:16.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:15 smithi044 bash[22676]: cluster 2024-09-20T22:25:14.777463+0000 mgr.a (mgr.14388) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:16.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:15 smithi179 bash[23186]: cluster 2024-09-20T22:25:14.777463+0000 mgr.a (mgr.14388) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:16.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:15 smithi049 bash[23528]: cluster 2024-09-20T22:25:14.777463+0000 mgr.a (mgr.14388) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:17.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:17.691 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:17.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:17 smithi044 bash[22676]: cluster 2024-09-20T22:25:16.778905+0000 mgr.a (mgr.14388) 457 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:18.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:17 smithi179 bash[23186]: cluster 2024-09-20T22:25:16.778905+0000 mgr.a (mgr.14388) 457 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:18.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:17 smithi049 bash[23528]: cluster 2024-09-20T22:25:16.778905+0000 mgr.a (mgr.14388) 457 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:18.466 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:18.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:19 smithi044 bash[22676]: audit 2024-09-20T22:25:18.031233+0000 mgr.a (mgr.14388) 458 : audit [DBG] from='client.23505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:19 smithi044 bash[22676]: cluster 2024-09-20T22:25:18.779857+0000 mgr.a (mgr.14388) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:25:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:19 smithi179 bash[23186]: audit 2024-09-20T22:25:18.031233+0000 mgr.a (mgr.14388) 458 : audit [DBG] from='client.23505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:19 smithi179 bash[23186]: cluster 2024-09-20T22:25:18.779857+0000 mgr.a (mgr.14388) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:25:20.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:19 smithi049 bash[23528]: audit 2024-09-20T22:25:18.031233+0000 mgr.a (mgr.14388) 458 : audit [DBG] from='client.23505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:20.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:19 smithi049 bash[23528]: cluster 2024-09-20T22:25:18.779857+0000 mgr.a (mgr.14388) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:25:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:21 smithi049 bash[23528]: audit 2024-09-20T22:25:20.776822+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:21 smithi049 bash[23528]: cluster 2024-09-20T22:25:20.782484+0000 mgr.a (mgr.14388) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:21 smithi049 bash[23528]: audit 2024-09-20T22:25:20.786603+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:21 smithi049 bash[23528]: audit 2024-09-20T22:25:20.797715+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:21 smithi049 bash[23528]: audit 2024-09-20T22:25:20.815052+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:21 smithi049 bash[23528]: audit 2024-09-20T22:25:20.823491+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:21 smithi049 bash[23528]: audit 2024-09-20T22:25:20.833319+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:21 smithi044 bash[22676]: audit 2024-09-20T22:25:20.776822+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:21 smithi044 bash[22676]: cluster 2024-09-20T22:25:20.782484+0000 mgr.a (mgr.14388) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:21 smithi044 bash[22676]: audit 2024-09-20T22:25:20.786603+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:21 smithi044 bash[22676]: audit 2024-09-20T22:25:20.797715+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:21 smithi044 bash[22676]: audit 2024-09-20T22:25:20.815052+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:21 smithi044 bash[22676]: audit 2024-09-20T22:25:20.823491+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:21 smithi044 bash[22676]: audit 2024-09-20T22:25:20.833319+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:21 smithi179 bash[23186]: audit 2024-09-20T22:25:20.776822+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:21 smithi179 bash[23186]: cluster 2024-09-20T22:25:20.782484+0000 mgr.a (mgr.14388) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:25:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:21 smithi179 bash[23186]: audit 2024-09-20T22:25:20.786603+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:21 smithi179 bash[23186]: audit 2024-09-20T22:25:20.797715+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:21 smithi179 bash[23186]: audit 2024-09-20T22:25:20.815052+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:21 smithi179 bash[23186]: audit 2024-09-20T22:25:20.823491+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:21 smithi179 bash[23186]: audit 2024-09-20T22:25:20.833319+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:24.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:23 smithi044 bash[22676]: cluster 2024-09-20T22:25:22.783302+0000 mgr.a (mgr.14388) 461 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:23 smithi044 bash[22676]: audit 2024-09-20T22:25:23.059642+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:23 smithi044 bash[22676]: audit 2024-09-20T22:25:23.068781+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:23 smithi044 bash[22676]: audit 2024-09-20T22:25:23.078401+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.242 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:24.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:24.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:24.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:24.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:23 smithi179 bash[23186]: cluster 2024-09-20T22:25:22.783302+0000 mgr.a (mgr.14388) 461 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:23 smithi179 bash[23186]: audit 2024-09-20T22:25:23.059642+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:23 smithi179 bash[23186]: audit 2024-09-20T22:25:23.068781+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:23 smithi179 bash[23186]: audit 2024-09-20T22:25:23.078401+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:23 smithi049 bash[23528]: cluster 2024-09-20T22:25:22.783302+0000 mgr.a (mgr.14388) 461 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:24.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:23 smithi049 bash[23528]: audit 2024-09-20T22:25:23.059642+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:23 smithi049 bash[23528]: audit 2024-09-20T22:25:23.068781+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:24.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:23 smithi049 bash[23528]: audit 2024-09-20T22:25:23.078401+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:24 smithi044 bash[22676]: audit 2024-09-20T22:25:23.805481+0000 mgr.a (mgr.14388) 462 : audit [DBG] from='client.23577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:25.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:24 smithi179 bash[23186]: audit 2024-09-20T22:25:23.805481+0000 mgr.a (mgr.14388) 462 : audit [DBG] from='client.23577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:25.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:24 smithi049 bash[23528]: audit 2024-09-20T22:25:23.805481+0000 mgr.a (mgr.14388) 462 : audit [DBG] from='client.23577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:25 smithi044 bash[22676]: cluster 2024-09-20T22:25:24.784282+0000 mgr.a (mgr.14388) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:26.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:25 smithi179 bash[23186]: cluster 2024-09-20T22:25:24.784282+0000 mgr.a (mgr.14388) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:26.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:25 smithi049 bash[23528]: cluster 2024-09-20T22:25:24.784282+0000 mgr.a (mgr.14388) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:27 smithi044 bash[22676]: cluster 2024-09-20T22:25:26.786532+0000 mgr.a (mgr.14388) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:25:28.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:27 smithi179 bash[23186]: cluster 2024-09-20T22:25:26.786532+0000 mgr.a (mgr.14388) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:25:28.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:27 smithi049 bash[23528]: cluster 2024-09-20T22:25:26.786532+0000 mgr.a (mgr.14388) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:25:29.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:29.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:29.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:30.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:30.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:30.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:30.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:30.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:29 smithi044 bash[22676]: cluster 2024-09-20T22:25:28.787317+0000 mgr.a (mgr.14388) 465 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:30.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:29 smithi179 bash[23186]: cluster 2024-09-20T22:25:28.787317+0000 mgr.a (mgr.14388) 465 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:30.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:29 smithi049 bash[23528]: cluster 2024-09-20T22:25:28.787317+0000 mgr.a (mgr.14388) 465 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:30 smithi044 bash[22676]: audit 2024-09-20T22:25:29.582675+0000 mgr.a (mgr.14388) 466 : audit [DBG] from='client.23655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:31.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:30 smithi179 bash[23186]: audit 2024-09-20T22:25:29.582675+0000 mgr.a (mgr.14388) 466 : audit [DBG] from='client.23655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:31.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:30 smithi049 bash[23528]: audit 2024-09-20T22:25:29.582675+0000 mgr.a (mgr.14388) 466 : audit [DBG] from='client.23655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:32.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:31 smithi179 bash[23186]: cluster 2024-09-20T22:25:30.789739+0000 mgr.a (mgr.14388) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:25:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:31 smithi044 bash[22676]: cluster 2024-09-20T22:25:30.789739+0000 mgr.a (mgr.14388) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:25:32.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:31 smithi049 bash[23528]: cluster 2024-09-20T22:25:30.789739+0000 mgr.a (mgr.14388) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:25:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:33 smithi044 bash[22676]: cluster 2024-09-20T22:25:32.790534+0000 mgr.a (mgr.14388) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:25:34.236 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:33 smithi179 bash[23186]: cluster 2024-09-20T22:25:32.790534+0000 mgr.a (mgr.14388) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:25:34.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:33 smithi049 bash[23528]: cluster 2024-09-20T22:25:32.790534+0000 mgr.a (mgr.14388) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:25:35.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:35.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:35.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:35.812 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:35.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:35.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:35.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:35.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:35 smithi044 bash[22676]: cluster 2024-09-20T22:25:34.791308+0000 mgr.a (mgr.14388) 469 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:25:36.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:35 smithi179 bash[23186]: cluster 2024-09-20T22:25:34.791308+0000 mgr.a (mgr.14388) 469 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:25:36.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:35 smithi049 bash[23528]: cluster 2024-09-20T22:25:34.791308+0000 mgr.a (mgr.14388) 469 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:25:37.190 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:36 smithi044 bash[22676]: audit 2024-09-20T22:25:35.366741+0000 mgr.a (mgr.14388) 470 : audit [DBG] from='client.23730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:37.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:36 smithi179 bash[23186]: audit 2024-09-20T22:25:35.366741+0000 mgr.a (mgr.14388) 470 : audit [DBG] from='client.23730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:37.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:36 smithi049 bash[23528]: audit 2024-09-20T22:25:35.366741+0000 mgr.a (mgr.14388) 470 : audit [DBG] from='client.23730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:37 smithi044 bash[22676]: cluster 2024-09-20T22:25:36.794191+0000 mgr.a (mgr.14388) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:38.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:37 smithi179 bash[23186]: cluster 2024-09-20T22:25:36.794191+0000 mgr.a (mgr.14388) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:38.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:37 smithi049 bash[23528]: cluster 2024-09-20T22:25:36.794191+0000 mgr.a (mgr.14388) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:39 smithi044 bash[22676]: cluster 2024-09-20T22:25:38.795181+0000 mgr.a (mgr.14388) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:39 smithi179 bash[23186]: cluster 2024-09-20T22:25:38.795181+0000 mgr.a (mgr.14388) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:40.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:39 smithi049 bash[23528]: cluster 2024-09-20T22:25:38.795181+0000 mgr.a (mgr.14388) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:25:40.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:40.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:40.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:41.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:41 smithi044 bash[22676]: cluster 2024-09-20T22:25:40.797148+0000 mgr.a (mgr.14388) 473 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:41 smithi044 bash[22676]: audit 2024-09-20T22:25:41.003250+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:41 smithi044 bash[22676]: audit 2024-09-20T22:25:41.011835+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:41 smithi044 bash[22676]: audit 2024-09-20T22:25:41.022167+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:41 smithi044 bash[22676]: audit 2024-09-20T22:25:41.038041+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:41 smithi044 bash[22676]: audit 2024-09-20T22:25:41.046450+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:41 smithi044 bash[22676]: audit 2024-09-20T22:25:41.056368+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:41 smithi179 bash[23186]: cluster 2024-09-20T22:25:40.797148+0000 mgr.a (mgr.14388) 473 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:41 smithi179 bash[23186]: audit 2024-09-20T22:25:41.003250+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:41 smithi179 bash[23186]: audit 2024-09-20T22:25:41.011835+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:41 smithi179 bash[23186]: audit 2024-09-20T22:25:41.022167+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:41 smithi179 bash[23186]: audit 2024-09-20T22:25:41.038041+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:41 smithi179 bash[23186]: audit 2024-09-20T22:25:41.046450+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:41 smithi179 bash[23186]: audit 2024-09-20T22:25:41.056368+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:41 smithi049 bash[23528]: cluster 2024-09-20T22:25:40.797148+0000 mgr.a (mgr.14388) 473 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:42.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:41 smithi049 bash[23528]: audit 2024-09-20T22:25:41.003250+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:41 smithi049 bash[23528]: audit 2024-09-20T22:25:41.011835+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:41 smithi049 bash[23528]: audit 2024-09-20T22:25:41.022167+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:41 smithi049 bash[23528]: audit 2024-09-20T22:25:41.038041+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:41 smithi049 bash[23528]: audit 2024-09-20T22:25:41.046450+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:42.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:41 smithi049 bash[23528]: audit 2024-09-20T22:25:41.056368+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:43.214 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:42 smithi049 bash[23528]: audit 2024-09-20T22:25:41.171398+0000 mgr.a (mgr.14388) 474 : audit [DBG] from='client.23808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:42 smithi044 bash[22676]: audit 2024-09-20T22:25:41.171398+0000 mgr.a (mgr.14388) 474 : audit [DBG] from='client.23808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:43.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:42 smithi179 bash[23186]: audit 2024-09-20T22:25:41.171398+0000 mgr.a (mgr.14388) 474 : audit [DBG] from='client.23808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:44.188 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:43 smithi049 bash[23528]: cluster 2024-09-20T22:25:42.798028+0000 mgr.a (mgr.14388) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:25:44.188 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:43 smithi049 bash[23528]: audit 2024-09-20T22:25:43.289342+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.188 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:43 smithi049 bash[23528]: audit 2024-09-20T22:25:43.297663+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.188 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:43 smithi049 bash[23528]: audit 2024-09-20T22:25:43.308188+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:43 smithi044 bash[22676]: cluster 2024-09-20T22:25:42.798028+0000 mgr.a (mgr.14388) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:25:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:43 smithi044 bash[22676]: audit 2024-09-20T22:25:43.289342+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:43 smithi044 bash[22676]: audit 2024-09-20T22:25:43.297663+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:43 smithi044 bash[22676]: audit 2024-09-20T22:25:43.308188+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:43 smithi179 bash[23186]: cluster 2024-09-20T22:25:42.798028+0000 mgr.a (mgr.14388) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:25:44.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:43 smithi179 bash[23186]: audit 2024-09-20T22:25:43.289342+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:43 smithi179 bash[23186]: audit 2024-09-20T22:25:43.297663+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:44.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:43 smithi179 bash[23186]: audit 2024-09-20T22:25:43.308188+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:25:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:45 smithi044 bash[22676]: cluster 2024-09-20T22:25:44.798823+0000 mgr.a (mgr.14388) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:25:46.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:45 smithi179 bash[23186]: cluster 2024-09-20T22:25:44.798823+0000 mgr.a (mgr.14388) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:25:46.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:45 smithi049 bash[23528]: cluster 2024-09-20T22:25:44.798823+0000 mgr.a (mgr.14388) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:25:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:47.374 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:47 smithi044 bash[22676]: cluster 2024-09-20T22:25:46.800948+0000 mgr.a (mgr.14388) 477 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:47 smithi044 bash[22676]: audit 2024-09-20T22:25:46.946988+0000 mgr.a (mgr.14388) 478 : audit [DBG] from='client.23883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:48.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:47 smithi179 bash[23186]: cluster 2024-09-20T22:25:46.800948+0000 mgr.a (mgr.14388) 477 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:25:48.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:47 smithi179 bash[23186]: audit 2024-09-20T22:25:46.946988+0000 mgr.a (mgr.14388) 478 : audit [DBG] from='client.23883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:48.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:47 smithi049 bash[23528]: cluster 2024-09-20T22:25:46.800948+0000 mgr.a (mgr.14388) 477 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:25:48.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:47 smithi049 bash[23528]: audit 2024-09-20T22:25:46.946988+0000 mgr.a (mgr.14388) 478 : audit [DBG] from='client.23883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:49 smithi044 bash[22676]: cluster 2024-09-20T22:25:48.801906+0000 mgr.a (mgr.14388) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:50.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:49 smithi179 bash[23186]: cluster 2024-09-20T22:25:48.801906+0000 mgr.a (mgr.14388) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:50.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:49 smithi049 bash[23528]: cluster 2024-09-20T22:25:48.801906+0000 mgr.a (mgr.14388) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:25:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:51 smithi044 bash[22676]: cluster 2024-09-20T22:25:50.804162+0000 mgr.a (mgr.14388) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:25:52.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:51 smithi179 bash[23186]: cluster 2024-09-20T22:25:50.804162+0000 mgr.a (mgr.14388) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:25:52.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:51 smithi049 bash[23528]: cluster 2024-09-20T22:25:50.804162+0000 mgr.a (mgr.14388) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:25:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:53.133 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:53.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:53.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:53.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:53.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:25:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:53 smithi044 bash[22676]: audit 2024-09-20T22:25:52.710834+0000 mgr.a (mgr.14388) 481 : audit [DBG] from='client.23961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:53 smithi044 bash[22676]: cluster 2024-09-20T22:25:52.804724+0000 mgr.a (mgr.14388) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:25:54.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:53 smithi179 bash[23186]: audit 2024-09-20T22:25:52.710834+0000 mgr.a (mgr.14388) 481 : audit [DBG] from='client.23961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:54.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:53 smithi179 bash[23186]: cluster 2024-09-20T22:25:52.804724+0000 mgr.a (mgr.14388) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:25:54.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:53 smithi049 bash[23528]: audit 2024-09-20T22:25:52.710834+0000 mgr.a (mgr.14388) 481 : audit [DBG] from='client.23961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:25:54.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:53 smithi049 bash[23528]: cluster 2024-09-20T22:25:52.804724+0000 mgr.a (mgr.14388) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:25:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:55 smithi044 bash[22676]: cluster 2024-09-20T22:25:54.805646+0000 mgr.a (mgr.14388) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:25:56.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:55 smithi179 bash[23186]: cluster 2024-09-20T22:25:54.805646+0000 mgr.a (mgr.14388) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:25:56.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:55 smithi049 bash[23528]: cluster 2024-09-20T22:25:54.805646+0000 mgr.a (mgr.14388) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:25:58.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:25:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:25:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:25:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:57 smithi044 bash[22676]: cluster 2024-09-20T22:25:56.807895+0000 mgr.a (mgr.14388) 484 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:25:58.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:57 smithi179 bash[23186]: cluster 2024-09-20T22:25:56.807895+0000 mgr.a (mgr.14388) 484 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:25:58.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:57 smithi049 bash[23528]: cluster 2024-09-20T22:25:56.807895+0000 mgr.a (mgr.14388) 484 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:25:58.869 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:25:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:25:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:25:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:25:58.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:59 smithi044 bash[22676]: audit 2024-09-20T22:25:58.462952+0000 mgr.a (mgr.14388) 485 : audit [DBG] from='client.24039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:25:59 smithi044 bash[22676]: cluster 2024-09-20T22:25:58.808425+0000 mgr.a (mgr.14388) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:26:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:59 smithi179 bash[23186]: audit 2024-09-20T22:25:58.462952+0000 mgr.a (mgr.14388) 485 : audit [DBG] from='client.24039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:25:59 smithi179 bash[23186]: cluster 2024-09-20T22:25:58.808425+0000 mgr.a (mgr.14388) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:26:00.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:59 smithi049 bash[23528]: audit 2024-09-20T22:25:58.462952+0000 mgr.a (mgr.14388) 485 : audit [DBG] from='client.24039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:00.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:25:59 smithi049 bash[23528]: cluster 2024-09-20T22:25:58.808425+0000 mgr.a (mgr.14388) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-20T22:26:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:01 smithi044 bash[22676]: cluster 2024-09-20T22:26:00.810596+0000 mgr.a (mgr.14388) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:26:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:01 smithi044 bash[22676]: audit 2024-09-20T22:26:01.236359+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:01 smithi044 bash[22676]: audit 2024-09-20T22:26:01.244824+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:01 smithi044 bash[22676]: audit 2024-09-20T22:26:01.255264+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:01 smithi044 bash[22676]: audit 2024-09-20T22:26:01.271522+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:01 smithi044 bash[22676]: audit 2024-09-20T22:26:01.280238+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:01 smithi044 bash[22676]: audit 2024-09-20T22:26:01.290234+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:01 smithi179 bash[23186]: cluster 2024-09-20T22:26:00.810596+0000 mgr.a (mgr.14388) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:26:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:01 smithi179 bash[23186]: audit 2024-09-20T22:26:01.236359+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:01 smithi179 bash[23186]: audit 2024-09-20T22:26:01.244824+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:01 smithi179 bash[23186]: audit 2024-09-20T22:26:01.255264+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:01 smithi179 bash[23186]: audit 2024-09-20T22:26:01.271522+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:01 smithi179 bash[23186]: audit 2024-09-20T22:26:01.280238+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:01 smithi179 bash[23186]: audit 2024-09-20T22:26:01.290234+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:01 smithi049 bash[23528]: cluster 2024-09-20T22:26:00.810596+0000 mgr.a (mgr.14388) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 86 op/s 2024-09-20T22:26:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:01 smithi049 bash[23528]: audit 2024-09-20T22:26:01.236359+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:01 smithi049 bash[23528]: audit 2024-09-20T22:26:01.244824+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:01 smithi049 bash[23528]: audit 2024-09-20T22:26:01.255264+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:01 smithi049 bash[23528]: audit 2024-09-20T22:26:01.271522+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:01 smithi049 bash[23528]: audit 2024-09-20T22:26:01.280238+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:01 smithi049 bash[23528]: audit 2024-09-20T22:26:01.290234+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:03.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:03.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:03.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:04.224 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:03 smithi049 bash[23528]: cluster 2024-09-20T22:26:02.811487+0000 mgr.a (mgr.14388) 488 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:04.224 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:03 smithi049 bash[23528]: audit 2024-09-20T22:26:03.531023+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.224 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:03 smithi049 bash[23528]: audit 2024-09-20T22:26:03.538599+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.224 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:03 smithi049 bash[23528]: audit 2024-09-20T22:26:03.546785+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:03 smithi044 bash[22676]: cluster 2024-09-20T22:26:02.811487+0000 mgr.a (mgr.14388) 488 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:03 smithi044 bash[22676]: audit 2024-09-20T22:26:03.531023+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:03 smithi044 bash[22676]: audit 2024-09-20T22:26:03.538599+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:03 smithi044 bash[22676]: audit 2024-09-20T22:26:03.546785+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:03 smithi179 bash[23186]: cluster 2024-09-20T22:26:02.811487+0000 mgr.a (mgr.14388) 488 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:03 smithi179 bash[23186]: audit 2024-09-20T22:26:03.531023+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:03 smithi179 bash[23186]: audit 2024-09-20T22:26:03.538599+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:03 smithi179 bash[23186]: audit 2024-09-20T22:26:03.546785+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:04.609 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:04.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:04.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:04.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:04.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:04.202668+0000 mgr.a (mgr.14388) 489 : audit [DBG] from='client.24117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: cluster 2024-09-20T22:26:04.812513+0000 mgr.a (mgr.14388) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.581393+0000 mon.a (mon.0) 1199 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.588846+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.590755+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.594217+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.599193+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.607099+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.617092+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.621507+0000 mon.a (mon.0) 1206 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:26:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.623637+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:26:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.634800+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:05 smithi044 bash[22676]: audit 2024-09-20T22:26:05.641013+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:26:06.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:04.202668+0000 mgr.a (mgr.14388) 489 : audit [DBG] from='client.24117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:06.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: cluster 2024-09-20T22:26:04.812513+0000 mgr.a (mgr.14388) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.581393+0000 mon.a (mon.0) 1199 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.588846+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.590755+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.594217+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.599193+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.607099+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.617092+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.621507+0000 mon.a (mon.0) 1206 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.623637+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.634800+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:05 smithi179 bash[23186]: audit 2024-09-20T22:26:05.641013+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:04.202668+0000 mgr.a (mgr.14388) 489 : audit [DBG] from='client.24117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: cluster 2024-09-20T22:26:04.812513+0000 mgr.a (mgr.14388) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.581393+0000 mon.a (mon.0) 1199 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.588846+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.590755+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.594217+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.599193+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.607099+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.617092+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.621507+0000 mon.a (mon.0) 1206 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:26:06.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.623637+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:26:06.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.634800+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:06.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:05 smithi049 bash[23528]: audit 2024-09-20T22:26:05.641013+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:26:06.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:26:06 smithi044 bash[22930]: debug 2024-09-20T22:26:06.362+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:26:06.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:26:06 smithi044 bash[22930]: debug 2024-09-20T22:26:06.362+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:26:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:06 smithi044 bash[22676]: cephadm 2024-09-20T22:26:05.592379+0000 mgr.a (mgr.14388) 491 : cephadm [INF] Adjusting osd_memory_target on smithi179 to 19313M 2024-09-20T22:26:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:06 smithi044 bash[22676]: cephadm 2024-09-20T22:26:05.593043+0000 mgr.a (mgr.14388) 492 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 15217M 2024-09-20T22:26:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:06 smithi044 bash[22676]: cephadm 2024-09-20T22:26:05.611009+0000 mgr.a (mgr.14388) 493 : cephadm [INF] Adjusting osd_memory_target on smithi044 to 16245M 2024-09-20T22:26:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:06 smithi044 bash[22676]: audit 2024-09-20T22:26:05.643461+0000 mgr.a (mgr.14388) 494 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:26:07.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:06 smithi179 bash[23186]: cephadm 2024-09-20T22:26:05.592379+0000 mgr.a (mgr.14388) 491 : cephadm [INF] Adjusting osd_memory_target on smithi179 to 19313M 2024-09-20T22:26:07.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:06 smithi179 bash[23186]: cephadm 2024-09-20T22:26:05.593043+0000 mgr.a (mgr.14388) 492 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 15217M 2024-09-20T22:26:07.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:06 smithi179 bash[23186]: cephadm 2024-09-20T22:26:05.611009+0000 mgr.a (mgr.14388) 493 : cephadm [INF] Adjusting osd_memory_target on smithi044 to 16245M 2024-09-20T22:26:07.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:06 smithi179 bash[23186]: audit 2024-09-20T22:26:05.643461+0000 mgr.a (mgr.14388) 494 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:26:07.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:06 smithi049 bash[23528]: cephadm 2024-09-20T22:26:05.592379+0000 mgr.a (mgr.14388) 491 : cephadm [INF] Adjusting osd_memory_target on smithi179 to 19313M 2024-09-20T22:26:07.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:06 smithi049 bash[23528]: cephadm 2024-09-20T22:26:05.593043+0000 mgr.a (mgr.14388) 492 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 15217M 2024-09-20T22:26:07.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:06 smithi049 bash[23528]: cephadm 2024-09-20T22:26:05.611009+0000 mgr.a (mgr.14388) 493 : cephadm [INF] Adjusting osd_memory_target on smithi044 to 16245M 2024-09-20T22:26:07.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:06 smithi049 bash[23528]: audit 2024-09-20T22:26:05.643461+0000 mgr.a (mgr.14388) 494 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:26:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:07 smithi044 bash[22676]: audit 2024-09-20T22:26:06.366279+0000 mgr.a (mgr.14388) 495 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:26:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:07 smithi044 bash[22676]: cephadm 2024-09-20T22:26:06.367487+0000 mgr.a (mgr.14388) 496 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:26:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:07 smithi044 bash[22676]: cluster 2024-09-20T22:26:06.815284+0000 mgr.a (mgr.14388) 497 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:08.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:07 smithi179 bash[23186]: audit 2024-09-20T22:26:06.366279+0000 mgr.a (mgr.14388) 495 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:26:08.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:07 smithi179 bash[23186]: cephadm 2024-09-20T22:26:06.367487+0000 mgr.a (mgr.14388) 496 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:26:08.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:07 smithi179 bash[23186]: cluster 2024-09-20T22:26:06.815284+0000 mgr.a (mgr.14388) 497 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:08.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:07 smithi049 bash[23528]: audit 2024-09-20T22:26:06.366279+0000 mgr.a (mgr.14388) 495 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:26:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:07 smithi049 bash[23528]: cephadm 2024-09-20T22:26:06.367487+0000 mgr.a (mgr.14388) 496 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:26:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:07 smithi049 bash[23528]: cluster 2024-09-20T22:26:06.815284+0000 mgr.a (mgr.14388) 497 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:09.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:09 smithi049 bash[23528]: cluster 2024-09-20T22:26:08.816070+0000 mgr.a (mgr.14388) 498 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:09 smithi044 bash[22676]: cluster 2024-09-20T22:26:08.816070+0000 mgr.a (mgr.14388) 498 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:09.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:09 smithi179 bash[23186]: cluster 2024-09-20T22:26:08.816070+0000 mgr.a (mgr.14388) 498 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:09.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:09.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:09.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:10.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:10 smithi049 bash[23528]: audit 2024-09-20T22:26:09.946535+0000 mgr.a (mgr.14388) 499 : audit [DBG] from='client.24303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:10.350 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:10.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:10.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:10.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:10.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:10 smithi044 bash[22676]: audit 2024-09-20T22:26:09.946535+0000 mgr.a (mgr.14388) 499 : audit [DBG] from='client.24303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:10.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:10 smithi179 bash[23186]: audit 2024-09-20T22:26:09.946535+0000 mgr.a (mgr.14388) 499 : audit [DBG] from='client.24303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:11.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:11 smithi049 bash[23528]: cluster 2024-09-20T22:26:10.818912+0000 mgr.a (mgr.14388) 500 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:11 smithi044 bash[22676]: cluster 2024-09-20T22:26:10.818912+0000 mgr.a (mgr.14388) 500 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:11.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:11 smithi179 bash[23186]: cluster 2024-09-20T22:26:10.818912+0000 mgr.a (mgr.14388) 500 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:14.115 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:13 smithi179 bash[23186]: cluster 2024-09-20T22:26:12.819762+0000 mgr.a (mgr.14388) 501 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:13 smithi044 bash[22676]: cluster 2024-09-20T22:26:12.819762+0000 mgr.a (mgr.14388) 501 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:14.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:13 smithi049 bash[23528]: cluster 2024-09-20T22:26:12.819762+0000 mgr.a (mgr.14388) 501 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:15.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:15.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:15.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:16.105 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:16.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:15 smithi179 bash[23186]: cluster 2024-09-20T22:26:14.820529+0000 mgr.a (mgr.14388) 502 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:16.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:15 smithi044 bash[22676]: cluster 2024-09-20T22:26:14.820529+0000 mgr.a (mgr.14388) 502 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:16.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:15 smithi049 bash[23528]: cluster 2024-09-20T22:26:14.820529+0000 mgr.a (mgr.14388) 502 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:16 smithi044 bash[22676]: audit 2024-09-20T22:26:15.696082+0000 mgr.a (mgr.14388) 503 : audit [DBG] from='client.24381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:16 smithi179 bash[23186]: audit 2024-09-20T22:26:15.696082+0000 mgr.a (mgr.14388) 503 : audit [DBG] from='client.24381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:17.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:16 smithi049 bash[23528]: audit 2024-09-20T22:26:15.696082+0000 mgr.a (mgr.14388) 503 : audit [DBG] from='client.24381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:17 smithi044 bash[22676]: cluster 2024-09-20T22:26:16.823344+0000 mgr.a (mgr.14388) 504 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:18.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:17 smithi179 bash[23186]: cluster 2024-09-20T22:26:16.823344+0000 mgr.a (mgr.14388) 504 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:18.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:17 smithi049 bash[23528]: cluster 2024-09-20T22:26:16.823344+0000 mgr.a (mgr.14388) 504 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:19 smithi044 bash[22676]: cluster 2024-09-20T22:26:18.824095+0000 mgr.a (mgr.14388) 505 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:20.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:19 smithi179 bash[23186]: cluster 2024-09-20T22:26:18.824095+0000 mgr.a (mgr.14388) 505 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:20.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:19 smithi049 bash[23528]: cluster 2024-09-20T22:26:18.824095+0000 mgr.a (mgr.14388) 505 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:26:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:21.869 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:21.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:21.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:21.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:21.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:21 smithi044 bash[22676]: cluster 2024-09-20T22:26:20.826112+0000 mgr.a (mgr.14388) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:21 smithi044 bash[22676]: audit 2024-09-20T22:26:21.486620+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:21 smithi044 bash[22676]: audit 2024-09-20T22:26:21.493257+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:21 smithi044 bash[22676]: audit 2024-09-20T22:26:21.501548+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:21 smithi044 bash[22676]: audit 2024-09-20T22:26:21.513050+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:21 smithi044 bash[22676]: audit 2024-09-20T22:26:21.518480+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:21 smithi044 bash[22676]: audit 2024-09-20T22:26:21.523665+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:21 smithi179 bash[23186]: cluster 2024-09-20T22:26:20.826112+0000 mgr.a (mgr.14388) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:21 smithi179 bash[23186]: audit 2024-09-20T22:26:21.486620+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:21 smithi179 bash[23186]: audit 2024-09-20T22:26:21.493257+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:21 smithi179 bash[23186]: audit 2024-09-20T22:26:21.501548+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:21 smithi179 bash[23186]: audit 2024-09-20T22:26:21.513050+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:21 smithi179 bash[23186]: audit 2024-09-20T22:26:21.518480+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:21 smithi179 bash[23186]: audit 2024-09-20T22:26:21.523665+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:21 smithi049 bash[23528]: cluster 2024-09-20T22:26:20.826112+0000 mgr.a (mgr.14388) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:26:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:21 smithi049 bash[23528]: audit 2024-09-20T22:26:21.486620+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:21 smithi049 bash[23528]: audit 2024-09-20T22:26:21.493257+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:21 smithi049 bash[23528]: audit 2024-09-20T22:26:21.501548+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:21 smithi049 bash[23528]: audit 2024-09-20T22:26:21.513050+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:21 smithi049 bash[23528]: audit 2024-09-20T22:26:21.518480+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:21 smithi049 bash[23528]: audit 2024-09-20T22:26:21.523665+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:22 smithi044 bash[22676]: audit 2024-09-20T22:26:21.448529+0000 mgr.a (mgr.14388) 507 : audit [DBG] from='client.24453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:23.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:22 smithi179 bash[23186]: audit 2024-09-20T22:26:21.448529+0000 mgr.a (mgr.14388) 507 : audit [DBG] from='client.24453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:23.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:22 smithi049 bash[23528]: audit 2024-09-20T22:26:21.448529+0000 mgr.a (mgr.14388) 507 : audit [DBG] from='client.24453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:24.168 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:23 smithi049 bash[23528]: cluster 2024-09-20T22:26:22.826987+0000 mgr.a (mgr.14388) 508 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:24.168 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:23 smithi049 bash[23528]: audit 2024-09-20T22:26:23.756135+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.168 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:23 smithi049 bash[23528]: audit 2024-09-20T22:26:23.763951+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.168 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:23 smithi049 bash[23528]: audit 2024-09-20T22:26:23.774008+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:23 smithi044 bash[22676]: cluster 2024-09-20T22:26:22.826987+0000 mgr.a (mgr.14388) 508 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:23 smithi044 bash[22676]: audit 2024-09-20T22:26:23.756135+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:23 smithi044 bash[22676]: audit 2024-09-20T22:26:23.763951+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:23 smithi044 bash[22676]: audit 2024-09-20T22:26:23.774008+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:23 smithi179 bash[23186]: cluster 2024-09-20T22:26:22.826987+0000 mgr.a (mgr.14388) 508 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:23 smithi179 bash[23186]: audit 2024-09-20T22:26:23.756135+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:23 smithi179 bash[23186]: audit 2024-09-20T22:26:23.763951+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:24.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:23 smithi179 bash[23186]: audit 2024-09-20T22:26:23.774008+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:26.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:25 smithi049 bash[23528]: cluster 2024-09-20T22:26:24.827775+0000 mgr.a (mgr.14388) 509 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:25 smithi044 bash[22676]: cluster 2024-09-20T22:26:24.827775+0000 mgr.a (mgr.14388) 509 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:26.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:25 smithi179 bash[23186]: cluster 2024-09-20T22:26:24.827775+0000 mgr.a (mgr.14388) 509 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:26.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:26.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:26.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:27.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:27.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:27.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:27.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:27.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:27 smithi044 bash[22676]: cluster 2024-09-20T22:26:26.830002+0000 mgr.a (mgr.14388) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:28.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:27 smithi179 bash[23186]: cluster 2024-09-20T22:26:26.830002+0000 mgr.a (mgr.14388) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:28.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:27 smithi049 bash[23528]: cluster 2024-09-20T22:26:26.830002+0000 mgr.a (mgr.14388) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:28 smithi044 bash[22676]: audit 2024-09-20T22:26:27.206126+0000 mgr.a (mgr.14388) 511 : audit [DBG] from='client.24531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:29.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:28 smithi179 bash[23186]: audit 2024-09-20T22:26:27.206126+0000 mgr.a (mgr.14388) 511 : audit [DBG] from='client.24531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:29.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:28 smithi049 bash[23528]: audit 2024-09-20T22:26:27.206126+0000 mgr.a (mgr.14388) 511 : audit [DBG] from='client.24531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:29 smithi044 bash[22676]: cluster 2024-09-20T22:26:28.830914+0000 mgr.a (mgr.14388) 512 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:30.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:29 smithi179 bash[23186]: cluster 2024-09-20T22:26:28.830914+0000 mgr.a (mgr.14388) 512 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:30.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:29 smithi049 bash[23528]: cluster 2024-09-20T22:26:28.830914+0000 mgr.a (mgr.14388) 512 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:31 smithi044 bash[22676]: cluster 2024-09-20T22:26:30.833070+0000 mgr.a (mgr.14388) 513 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:32.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:31 smithi179 bash[23186]: cluster 2024-09-20T22:26:30.833070+0000 mgr.a (mgr.14388) 513 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:32.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:31 smithi049 bash[23528]: cluster 2024-09-20T22:26:30.833070+0000 mgr.a (mgr.14388) 513 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:32.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:32.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:32.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:33.355 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:33 smithi044 bash[22676]: cluster 2024-09-20T22:26:32.833821+0000 mgr.a (mgr.14388) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:33 smithi044 bash[22676]: audit 2024-09-20T22:26:32.949317+0000 mgr.a (mgr.14388) 515 : audit [DBG] from='client.24609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:34.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:33 smithi179 bash[23186]: cluster 2024-09-20T22:26:32.833821+0000 mgr.a (mgr.14388) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:34.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:33 smithi179 bash[23186]: audit 2024-09-20T22:26:32.949317+0000 mgr.a (mgr.14388) 515 : audit [DBG] from='client.24609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:34.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:33 smithi049 bash[23528]: cluster 2024-09-20T22:26:32.833821+0000 mgr.a (mgr.14388) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:34.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:33 smithi049 bash[23528]: audit 2024-09-20T22:26:32.949317+0000 mgr.a (mgr.14388) 515 : audit [DBG] from='client.24609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:35.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:35 smithi179 bash[23186]: cluster 2024-09-20T22:26:34.834748+0000 mgr.a (mgr.14388) 516 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:35 smithi044 bash[22676]: cluster 2024-09-20T22:26:34.834748+0000 mgr.a (mgr.14388) 516 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:36.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:35 smithi049 bash[23528]: cluster 2024-09-20T22:26:34.834748+0000 mgr.a (mgr.14388) 516 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:38.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:37 smithi044 bash[22676]: cluster 2024-09-20T22:26:36.837054+0000 mgr.a (mgr.14388) 517 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:38.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:37 smithi179 bash[23186]: cluster 2024-09-20T22:26:36.837054+0000 mgr.a (mgr.14388) 517 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:38.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:37 smithi049 bash[23528]: cluster 2024-09-20T22:26:36.837054+0000 mgr.a (mgr.14388) 517 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:38.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:38.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:38.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:39.112 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:39.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:39.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:39.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:39.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:39 smithi044 bash[22676]: audit 2024-09-20T22:26:38.683173+0000 mgr.a (mgr.14388) 518 : audit [DBG] from='client.24684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:39 smithi044 bash[22676]: cluster 2024-09-20T22:26:38.837645+0000 mgr.a (mgr.14388) 519 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:40.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:39 smithi179 bash[23186]: audit 2024-09-20T22:26:38.683173+0000 mgr.a (mgr.14388) 518 : audit [DBG] from='client.24684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:40.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:39 smithi179 bash[23186]: cluster 2024-09-20T22:26:38.837645+0000 mgr.a (mgr.14388) 519 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:40.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:39 smithi049 bash[23528]: audit 2024-09-20T22:26:38.683173+0000 mgr.a (mgr.14388) 518 : audit [DBG] from='client.24684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:40.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:39 smithi049 bash[23528]: cluster 2024-09-20T22:26:38.837645+0000 mgr.a (mgr.14388) 519 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:41.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:41 smithi179 bash[23186]: cluster 2024-09-20T22:26:40.840192+0000 mgr.a (mgr.14388) 520 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:41.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:41 smithi179 bash[23186]: audit 2024-09-20T22:26:41.718709+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:41.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:41 smithi179 bash[23186]: audit 2024-09-20T22:26:41.731235+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:41.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:41 smithi179 bash[23186]: audit 2024-09-20T22:26:41.741779+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:41.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:41 smithi179 bash[23186]: audit 2024-09-20T22:26:41.751525+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:41.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:41 smithi179 bash[23186]: audit 2024-09-20T22:26:41.759817+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:41.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:41 smithi179 bash[23186]: audit 2024-09-20T22:26:41.770014+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:41 smithi049 bash[23528]: cluster 2024-09-20T22:26:40.840192+0000 mgr.a (mgr.14388) 520 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:42.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:41 smithi049 bash[23528]: audit 2024-09-20T22:26:41.718709+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:41 smithi049 bash[23528]: audit 2024-09-20T22:26:41.731235+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:41 smithi049 bash[23528]: audit 2024-09-20T22:26:41.741779+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:41 smithi049 bash[23528]: audit 2024-09-20T22:26:41.751525+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:41 smithi049 bash[23528]: audit 2024-09-20T22:26:41.759817+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:41 smithi049 bash[23528]: audit 2024-09-20T22:26:41.770014+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:41 smithi044 bash[22676]: cluster 2024-09-20T22:26:40.840192+0000 mgr.a (mgr.14388) 520 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:41 smithi044 bash[22676]: audit 2024-09-20T22:26:41.718709+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:41 smithi044 bash[22676]: audit 2024-09-20T22:26:41.731235+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:41 smithi044 bash[22676]: audit 2024-09-20T22:26:41.741779+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:41 smithi044 bash[22676]: audit 2024-09-20T22:26:41.751525+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:41 smithi044 bash[22676]: audit 2024-09-20T22:26:41.759817+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:41 smithi044 bash[22676]: audit 2024-09-20T22:26:41.770014+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:44.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:44.115 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:44.115 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:43 smithi044 bash[22676]: cluster 2024-09-20T22:26:42.840957+0000 mgr.a (mgr.14388) 521 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:44.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:43 smithi179 bash[23186]: cluster 2024-09-20T22:26:42.840957+0000 mgr.a (mgr.14388) 521 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:44.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:43 smithi049 bash[23528]: cluster 2024-09-20T22:26:42.840957+0000 mgr.a (mgr.14388) 521 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:44.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:44.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:44.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:44.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:44.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:45.245 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:44 smithi049 bash[23528]: audit 2024-09-20T22:26:43.992407+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.245 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:44 smithi049 bash[23528]: audit 2024-09-20T22:26:44.000907+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.245 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:44 smithi049 bash[23528]: audit 2024-09-20T22:26:44.011071+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.245 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:44 smithi049 bash[23528]: audit 2024-09-20T22:26:44.447226+0000 mgr.a (mgr.14388) 522 : audit [DBG] from='client.24762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:45.245 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:44 smithi049 bash[23528]: cluster 2024-09-20T22:26:44.841604+0000 mgr.a (mgr.14388) 523 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:45.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:44 smithi179 bash[23186]: audit 2024-09-20T22:26:43.992407+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:44 smithi179 bash[23186]: audit 2024-09-20T22:26:44.000907+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:44 smithi179 bash[23186]: audit 2024-09-20T22:26:44.011071+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:44 smithi179 bash[23186]: audit 2024-09-20T22:26:44.447226+0000 mgr.a (mgr.14388) 522 : audit [DBG] from='client.24762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:44 smithi179 bash[23186]: cluster 2024-09-20T22:26:44.841604+0000 mgr.a (mgr.14388) 523 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:44 smithi044 bash[22676]: audit 2024-09-20T22:26:43.992407+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:44 smithi044 bash[22676]: audit 2024-09-20T22:26:44.000907+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:44 smithi044 bash[22676]: audit 2024-09-20T22:26:44.011071+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:26:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:44 smithi044 bash[22676]: audit 2024-09-20T22:26:44.447226+0000 mgr.a (mgr.14388) 522 : audit [DBG] from='client.24762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:44 smithi044 bash[22676]: cluster 2024-09-20T22:26:44.841604+0000 mgr.a (mgr.14388) 523 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:47 smithi044 bash[22676]: cluster 2024-09-20T22:26:46.843890+0000 mgr.a (mgr.14388) 524 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:48.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:47 smithi179 bash[23186]: cluster 2024-09-20T22:26:46.843890+0000 mgr.a (mgr.14388) 524 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:48.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:47 smithi049 bash[23528]: cluster 2024-09-20T22:26:46.843890+0000 mgr.a (mgr.14388) 524 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:26:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:49 smithi044 bash[22676]: cluster 2024-09-20T22:26:48.844823+0000 mgr.a (mgr.14388) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:50.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:49 smithi179 bash[23186]: cluster 2024-09-20T22:26:48.844823+0000 mgr.a (mgr.14388) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:50.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:49 smithi049 bash[23528]: cluster 2024-09-20T22:26:48.844823+0000 mgr.a (mgr.14388) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:50.632 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:51 smithi044 bash[22676]: audit 2024-09-20T22:26:50.216067+0000 mgr.a (mgr.14388) 526 : audit [DBG] from='client.24837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:51 smithi044 bash[22676]: cluster 2024-09-20T22:26:50.847491+0000 mgr.a (mgr.14388) 527 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:52.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:51 smithi179 bash[23186]: audit 2024-09-20T22:26:50.216067+0000 mgr.a (mgr.14388) 526 : audit [DBG] from='client.24837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:52.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:51 smithi179 bash[23186]: cluster 2024-09-20T22:26:50.847491+0000 mgr.a (mgr.14388) 527 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:52.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:51 smithi049 bash[23528]: audit 2024-09-20T22:26:50.216067+0000 mgr.a (mgr.14388) 526 : audit [DBG] from='client.24837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:52.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:51 smithi049 bash[23528]: cluster 2024-09-20T22:26:50.847491+0000 mgr.a (mgr.14388) 527 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:53 smithi044 bash[22676]: cluster 2024-09-20T22:26:52.848279+0000 mgr.a (mgr.14388) 528 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:26:54.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:53 smithi179 bash[23186]: cluster 2024-09-20T22:26:52.848279+0000 mgr.a (mgr.14388) 528 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:26:54.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:53 smithi049 bash[23528]: cluster 2024-09-20T22:26:52.848279+0000 mgr.a (mgr.14388) 528 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:26:55.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:26:55.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:26:55.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:26:56.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:55 smithi179 bash[23186]: cluster 2024-09-20T22:26:54.849037+0000 mgr.a (mgr.14388) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:26:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:55 smithi044 bash[22676]: cluster 2024-09-20T22:26:54.849037+0000 mgr.a (mgr.14388) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:26:56.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:55 smithi049 bash[23528]: cluster 2024-09-20T22:26:54.849037+0000 mgr.a (mgr.14388) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:26:56.382 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:26:56.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:26:56.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:26:56.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:26:56.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:26:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:56 smithi044 bash[22676]: audit 2024-09-20T22:26:55.970303+0000 mgr.a (mgr.14388) 530 : audit [DBG] from='client.24915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:56 smithi179 bash[23186]: audit 2024-09-20T22:26:55.970303+0000 mgr.a (mgr.14388) 530 : audit [DBG] from='client.24915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:56 smithi049 bash[23528]: audit 2024-09-20T22:26:55.970303+0000 mgr.a (mgr.14388) 530 : audit [DBG] from='client.24915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:26:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:57 smithi044 bash[22676]: cluster 2024-09-20T22:26:56.851690+0000 mgr.a (mgr.14388) 531 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:58.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:57 smithi179 bash[23186]: cluster 2024-09-20T22:26:56.851690+0000 mgr.a (mgr.14388) 531 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:26:58.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:57 smithi049 bash[23528]: cluster 2024-09-20T22:26:56.851690+0000 mgr.a (mgr.14388) 531 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:26:59 smithi044 bash[22676]: cluster 2024-09-20T22:26:58.852508+0000 mgr.a (mgr.14388) 532 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:27:00.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:26:59 smithi179 bash[23186]: cluster 2024-09-20T22:26:58.852508+0000 mgr.a (mgr.14388) 532 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:27:00.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:26:59 smithi049 bash[23528]: cluster 2024-09-20T22:26:58.852508+0000 mgr.a (mgr.14388) 532 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:27:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:02.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:02.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:02.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:02.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:02.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:01 smithi044 bash[22676]: cluster 2024-09-20T22:27:00.854520+0000 mgr.a (mgr.14388) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:01 smithi179 bash[23186]: cluster 2024-09-20T22:27:00.854520+0000 mgr.a (mgr.14388) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:01 smithi049 bash[23528]: cluster 2024-09-20T22:27:00.854520+0000 mgr.a (mgr.14388) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:02 smithi044 bash[22676]: audit 2024-09-20T22:27:01.719501+0000 mgr.a (mgr.14388) 534 : audit [DBG] from='client.24993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:02 smithi044 bash[22676]: audit 2024-09-20T22:27:01.944012+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:02 smithi044 bash[22676]: audit 2024-09-20T22:27:01.950429+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:02 smithi044 bash[22676]: audit 2024-09-20T22:27:01.956071+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:02 smithi044 bash[22676]: audit 2024-09-20T22:27:01.967508+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:02 smithi044 bash[22676]: audit 2024-09-20T22:27:01.972938+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:02 smithi044 bash[22676]: audit 2024-09-20T22:27:01.977889+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:02 smithi179 bash[23186]: audit 2024-09-20T22:27:01.719501+0000 mgr.a (mgr.14388) 534 : audit [DBG] from='client.24993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:03.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:02 smithi179 bash[23186]: audit 2024-09-20T22:27:01.944012+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:02 smithi179 bash[23186]: audit 2024-09-20T22:27:01.950429+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:02 smithi179 bash[23186]: audit 2024-09-20T22:27:01.956071+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:02 smithi179 bash[23186]: audit 2024-09-20T22:27:01.967508+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:02 smithi179 bash[23186]: audit 2024-09-20T22:27:01.972938+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:02 smithi179 bash[23186]: audit 2024-09-20T22:27:01.977889+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:02 smithi049 bash[23528]: audit 2024-09-20T22:27:01.719501+0000 mgr.a (mgr.14388) 534 : audit [DBG] from='client.24993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:03.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:02 smithi049 bash[23528]: audit 2024-09-20T22:27:01.944012+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:02 smithi049 bash[23528]: audit 2024-09-20T22:27:01.950429+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:02 smithi049 bash[23528]: audit 2024-09-20T22:27:01.956071+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:02 smithi049 bash[23528]: audit 2024-09-20T22:27:01.967508+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:02 smithi049 bash[23528]: audit 2024-09-20T22:27:01.972938+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:03.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:02 smithi049 bash[23528]: audit 2024-09-20T22:27:01.977889+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:03 smithi044 bash[22676]: cluster 2024-09-20T22:27:02.855545+0000 mgr.a (mgr.14388) 535 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:04.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:03 smithi179 bash[23186]: cluster 2024-09-20T22:27:02.855545+0000 mgr.a (mgr.14388) 535 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:03 smithi049 bash[23528]: cluster 2024-09-20T22:27:02.855545+0000 mgr.a (mgr.14388) 535 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:05 smithi044 bash[22676]: audit 2024-09-20T22:27:04.229122+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:05 smithi044 bash[22676]: audit 2024-09-20T22:27:04.236823+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:05 smithi044 bash[22676]: audit 2024-09-20T22:27:04.248500+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:05 smithi044 bash[22676]: cluster 2024-09-20T22:27:04.856472+0000 mgr.a (mgr.14388) 536 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:05.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:05 smithi179 bash[23186]: audit 2024-09-20T22:27:04.229122+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:05 smithi179 bash[23186]: audit 2024-09-20T22:27:04.236823+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:05 smithi179 bash[23186]: audit 2024-09-20T22:27:04.248500+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:05 smithi179 bash[23186]: cluster 2024-09-20T22:27:04.856472+0000 mgr.a (mgr.14388) 536 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:05.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:05 smithi049 bash[23528]: audit 2024-09-20T22:27:04.229122+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:05 smithi049 bash[23528]: audit 2024-09-20T22:27:04.236823+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:05 smithi049 bash[23528]: audit 2024-09-20T22:27:04.248500+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:05.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:05 smithi049 bash[23528]: cluster 2024-09-20T22:27:04.856472+0000 mgr.a (mgr.14388) 536 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:06.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:06 smithi179 bash[23186]: audit 2024-09-20T22:27:06.440223+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:27:06.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:06 smithi179 bash[23186]: audit 2024-09-20T22:27:06.447074+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:27:06.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:06 smithi179 bash[23186]: audit 2024-09-20T22:27:06.449162+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:27:06.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:06 smithi179 bash[23186]: audit 2024-09-20T22:27:06.461959+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:06.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:06 smithi179 bash[23186]: audit 2024-09-20T22:27:06.468226+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:27:06.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:06 smithi049 bash[23528]: audit 2024-09-20T22:27:06.440223+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:27:06.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:06 smithi049 bash[23528]: audit 2024-09-20T22:27:06.447074+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:27:06.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:06 smithi049 bash[23528]: audit 2024-09-20T22:27:06.449162+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:27:06.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:06 smithi049 bash[23528]: audit 2024-09-20T22:27:06.461959+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:06.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:06 smithi049 bash[23528]: audit 2024-09-20T22:27:06.468226+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:27:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:06 smithi044 bash[22676]: audit 2024-09-20T22:27:06.440223+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:27:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:06 smithi044 bash[22676]: audit 2024-09-20T22:27:06.447074+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:27:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:06 smithi044 bash[22676]: audit 2024-09-20T22:27:06.449162+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:27:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:06 smithi044 bash[22676]: audit 2024-09-20T22:27:06.461959+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:06 smithi044 bash[22676]: audit 2024-09-20T22:27:06.468226+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:27:07.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:07.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:07.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:07.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:27:07 smithi044 bash[22930]: debug 2024-09-20T22:27:07.217+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:27:07.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:27:07 smithi044 bash[22930]: debug 2024-09-20T22:27:07.217+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:27:07.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:07 smithi049 bash[23528]: audit 2024-09-20T22:27:06.470540+0000 mgr.a (mgr.14388) 537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:27:07.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:07 smithi049 bash[23528]: cluster 2024-09-20T22:27:06.857885+0000 mgr.a (mgr.14388) 538 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:07.861 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:07 smithi044 bash[22676]: audit 2024-09-20T22:27:06.470540+0000 mgr.a (mgr.14388) 537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:27:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:07 smithi044 bash[22676]: cluster 2024-09-20T22:27:06.857885+0000 mgr.a (mgr.14388) 538 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:07.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:07 smithi179 bash[23186]: audit 2024-09-20T22:27:06.470540+0000 mgr.a (mgr.14388) 537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:27:07.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:07 smithi179 bash[23186]: cluster 2024-09-20T22:27:06.857885+0000 mgr.a (mgr.14388) 538 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:08.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:08 smithi049 bash[23528]: audit 2024-09-20T22:27:07.223688+0000 mgr.a (mgr.14388) 539 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:27:08.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:08 smithi049 bash[23528]: cephadm 2024-09-20T22:27:07.225091+0000 mgr.a (mgr.14388) 540 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:27:08.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:08 smithi049 bash[23528]: audit 2024-09-20T22:27:07.463332+0000 mgr.a (mgr.14388) 541 : audit [DBG] from='client.25173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:08 smithi044 bash[22676]: audit 2024-09-20T22:27:07.223688+0000 mgr.a (mgr.14388) 539 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:27:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:08 smithi044 bash[22676]: cephadm 2024-09-20T22:27:07.225091+0000 mgr.a (mgr.14388) 540 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:27:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:08 smithi044 bash[22676]: audit 2024-09-20T22:27:07.463332+0000 mgr.a (mgr.14388) 541 : audit [DBG] from='client.25173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:08.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:08 smithi179 bash[23186]: audit 2024-09-20T22:27:07.223688+0000 mgr.a (mgr.14388) 539 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:27:08.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:08 smithi179 bash[23186]: cephadm 2024-09-20T22:27:07.225091+0000 mgr.a (mgr.14388) 540 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:27:08.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:08 smithi179 bash[23186]: audit 2024-09-20T22:27:07.463332+0000 mgr.a (mgr.14388) 541 : audit [DBG] from='client.25173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:09.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:09 smithi049 bash[23528]: cluster 2024-09-20T22:27:08.858776+0000 mgr.a (mgr.14388) 542 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:09 smithi044 bash[22676]: cluster 2024-09-20T22:27:08.858776+0000 mgr.a (mgr.14388) 542 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:09.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:09 smithi179 bash[23186]: cluster 2024-09-20T22:27:08.858776+0000 mgr.a (mgr.14388) 542 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:11 smithi044 bash[22676]: cluster 2024-09-20T22:27:10.860899+0000 mgr.a (mgr.14388) 543 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:12.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:11 smithi179 bash[23186]: cluster 2024-09-20T22:27:10.860899+0000 mgr.a (mgr.14388) 543 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:12.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:11 smithi049 bash[23528]: cluster 2024-09-20T22:27:10.860899+0000 mgr.a (mgr.14388) 543 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:12.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:12.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:13.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:13.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:13.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:13.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:13.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:13 smithi044 bash[22676]: cluster 2024-09-20T22:27:12.861717+0000 mgr.a (mgr.14388) 544 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:14.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:13 smithi179 bash[23186]: cluster 2024-09-20T22:27:12.861717+0000 mgr.a (mgr.14388) 544 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:14.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:13 smithi049 bash[23528]: cluster 2024-09-20T22:27:12.861717+0000 mgr.a (mgr.14388) 544 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:14 smithi044 bash[22676]: audit 2024-09-20T22:27:13.198883+0000 mgr.a (mgr.14388) 545 : audit [DBG] from='client.25251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:15.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:14 smithi179 bash[23186]: audit 2024-09-20T22:27:13.198883+0000 mgr.a (mgr.14388) 545 : audit [DBG] from='client.25251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:15.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:14 smithi049 bash[23528]: audit 2024-09-20T22:27:13.198883+0000 mgr.a (mgr.14388) 545 : audit [DBG] from='client.25251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:15 smithi044 bash[22676]: cluster 2024-09-20T22:27:14.862635+0000 mgr.a (mgr.14388) 546 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:16.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:15 smithi179 bash[23186]: cluster 2024-09-20T22:27:14.862635+0000 mgr.a (mgr.14388) 546 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:16.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:15 smithi049 bash[23528]: cluster 2024-09-20T22:27:14.862635+0000 mgr.a (mgr.14388) 546 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:17 smithi044 bash[22676]: cluster 2024-09-20T22:27:16.864889+0000 mgr.a (mgr.14388) 547 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:17 smithi179 bash[23186]: cluster 2024-09-20T22:27:16.864889+0000 mgr.a (mgr.14388) 547 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:18.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:17 smithi049 bash[23528]: cluster 2024-09-20T22:27:16.864889+0000 mgr.a (mgr.14388) 547 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:18.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:18.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:18.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:19.383 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:19.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:20.137 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:19 smithi044 bash[22676]: cluster 2024-09-20T22:27:18.865659+0000 mgr.a (mgr.14388) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:20.137 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:19 smithi044 bash[22676]: audit 2024-09-20T22:27:18.983102+0000 mgr.a (mgr.14388) 549 : audit [DBG] from='client.25326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:20.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:19 smithi179 bash[23186]: cluster 2024-09-20T22:27:18.865659+0000 mgr.a (mgr.14388) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:20.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:19 smithi179 bash[23186]: audit 2024-09-20T22:27:18.983102+0000 mgr.a (mgr.14388) 549 : audit [DBG] from='client.25326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:20.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:19 smithi049 bash[23528]: cluster 2024-09-20T22:27:18.865659+0000 mgr.a (mgr.14388) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:20.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:19 smithi049 bash[23528]: audit 2024-09-20T22:27:18.983102+0000 mgr.a (mgr.14388) 549 : audit [DBG] from='client.25326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:22.226 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:21 smithi049 bash[23528]: cluster 2024-09-20T22:27:20.867098+0000 mgr.a (mgr.14388) 550 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:21 smithi044 bash[22676]: cluster 2024-09-20T22:27:20.867098+0000 mgr.a (mgr.14388) 550 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:22.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:21 smithi179 bash[23186]: cluster 2024-09-20T22:27:20.867098+0000 mgr.a (mgr.14388) 550 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:27:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:23 smithi044 bash[22676]: audit 2024-09-20T22:27:22.176972+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:23 smithi044 bash[22676]: audit 2024-09-20T22:27:22.186041+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:23 smithi044 bash[22676]: audit 2024-09-20T22:27:22.196728+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:23 smithi044 bash[22676]: audit 2024-09-20T22:27:22.206381+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:23 smithi044 bash[22676]: audit 2024-09-20T22:27:22.215156+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:23 smithi044 bash[22676]: audit 2024-09-20T22:27:22.225337+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:23 smithi044 bash[22676]: cluster 2024-09-20T22:27:22.867832+0000 mgr.a (mgr.14388) 551 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:23 smithi179 bash[23186]: audit 2024-09-20T22:27:22.176972+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:23 smithi179 bash[23186]: audit 2024-09-20T22:27:22.186041+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:23 smithi179 bash[23186]: audit 2024-09-20T22:27:22.196728+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:23 smithi179 bash[23186]: audit 2024-09-20T22:27:22.206381+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:23 smithi179 bash[23186]: audit 2024-09-20T22:27:22.215156+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:23 smithi179 bash[23186]: audit 2024-09-20T22:27:22.225337+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:23 smithi179 bash[23186]: cluster 2024-09-20T22:27:22.867832+0000 mgr.a (mgr.14388) 551 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:23 smithi049 bash[23528]: audit 2024-09-20T22:27:22.176972+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:23 smithi049 bash[23528]: audit 2024-09-20T22:27:22.186041+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:23 smithi049 bash[23528]: audit 2024-09-20T22:27:22.196728+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:23 smithi049 bash[23528]: audit 2024-09-20T22:27:22.206381+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:23 smithi049 bash[23528]: audit 2024-09-20T22:27:22.215156+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:23 smithi049 bash[23528]: audit 2024-09-20T22:27:22.225337+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:23 smithi049 bash[23528]: cluster 2024-09-20T22:27:22.867832+0000 mgr.a (mgr.14388) 551 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:24.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:24.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:24.385 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:25.157 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:25 smithi044 bash[22676]: audit 2024-09-20T22:27:24.431078+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:25 smithi044 bash[22676]: audit 2024-09-20T22:27:24.437132+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:25 smithi044 bash[22676]: audit 2024-09-20T22:27:24.443722+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:25 smithi044 bash[22676]: audit 2024-09-20T22:27:24.721388+0000 mgr.a (mgr.14388) 552 : audit [DBG] from='client.25401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:25 smithi044 bash[22676]: cluster 2024-09-20T22:27:24.868396+0000 mgr.a (mgr.14388) 553 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:25.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:25 smithi179 bash[23186]: audit 2024-09-20T22:27:24.431078+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:25 smithi179 bash[23186]: audit 2024-09-20T22:27:24.437132+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:25 smithi179 bash[23186]: audit 2024-09-20T22:27:24.443722+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:25 smithi179 bash[23186]: audit 2024-09-20T22:27:24.721388+0000 mgr.a (mgr.14388) 552 : audit [DBG] from='client.25401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:25.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:25 smithi179 bash[23186]: cluster 2024-09-20T22:27:24.868396+0000 mgr.a (mgr.14388) 553 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:25.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:25 smithi049 bash[23528]: audit 2024-09-20T22:27:24.431078+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:25 smithi049 bash[23528]: audit 2024-09-20T22:27:24.437132+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:25 smithi049 bash[23528]: audit 2024-09-20T22:27:24.443722+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:25.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:25 smithi049 bash[23528]: audit 2024-09-20T22:27:24.721388+0000 mgr.a (mgr.14388) 552 : audit [DBG] from='client.25401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:25.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:25 smithi049 bash[23528]: cluster 2024-09-20T22:27:24.868396+0000 mgr.a (mgr.14388) 553 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:27 smithi044 bash[22676]: cluster 2024-09-20T22:27:26.870974+0000 mgr.a (mgr.14388) 554 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:27:28.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:27 smithi179 bash[23186]: cluster 2024-09-20T22:27:26.870974+0000 mgr.a (mgr.14388) 554 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:27:28.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:27 smithi049 bash[23528]: cluster 2024-09-20T22:27:26.870974+0000 mgr.a (mgr.14388) 554 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:27:30.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:30.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:30.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:29 smithi044 bash[22676]: cluster 2024-09-20T22:27:28.871772+0000 mgr.a (mgr.14388) 555 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:27:30.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:29 smithi179 bash[23186]: cluster 2024-09-20T22:27:28.871772+0000 mgr.a (mgr.14388) 555 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:27:30.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:29 smithi049 bash[23528]: cluster 2024-09-20T22:27:28.871772+0000 mgr.a (mgr.14388) 555 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:27:30.907 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:30.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:31 smithi044 bash[22676]: audit 2024-09-20T22:27:30.485909+0000 mgr.a (mgr.14388) 556 : audit [DBG] from='client.25479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:31 smithi044 bash[22676]: cluster 2024-09-20T22:27:30.873165+0000 mgr.a (mgr.14388) 557 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:32.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:31 smithi179 bash[23186]: audit 2024-09-20T22:27:30.485909+0000 mgr.a (mgr.14388) 556 : audit [DBG] from='client.25479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:32.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:31 smithi179 bash[23186]: cluster 2024-09-20T22:27:30.873165+0000 mgr.a (mgr.14388) 557 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:32.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:31 smithi049 bash[23528]: audit 2024-09-20T22:27:30.485909+0000 mgr.a (mgr.14388) 556 : audit [DBG] from='client.25479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:32.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:31 smithi049 bash[23528]: cluster 2024-09-20T22:27:30.873165+0000 mgr.a (mgr.14388) 557 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:33 smithi044 bash[22676]: cluster 2024-09-20T22:27:32.873896+0000 mgr.a (mgr.14388) 558 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:27:34.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:33 smithi179 bash[23186]: cluster 2024-09-20T22:27:32.873896+0000 mgr.a (mgr.14388) 558 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:27:34.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:33 smithi049 bash[23528]: cluster 2024-09-20T22:27:32.873896+0000 mgr.a (mgr.14388) 558 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:27:35.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:35.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:35.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:36.232 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:35 smithi179 bash[23186]: cluster 2024-09-20T22:27:34.874649+0000 mgr.a (mgr.14388) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:27:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:35 smithi044 bash[22676]: cluster 2024-09-20T22:27:34.874649+0000 mgr.a (mgr.14388) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:27:36.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:35 smithi049 bash[23528]: cluster 2024-09-20T22:27:34.874649+0000 mgr.a (mgr.14388) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:27:36.663 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:36.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:36.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:36.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:36.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:38.223 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:37 smithi179 bash[23186]: audit 2024-09-20T22:27:36.245261+0000 mgr.a (mgr.14388) 560 : audit [DBG] from='client.25557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:38.223 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:37 smithi179 bash[23186]: cluster 2024-09-20T22:27:36.877239+0000 mgr.a (mgr.14388) 561 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:37 smithi044 bash[22676]: audit 2024-09-20T22:27:36.245261+0000 mgr.a (mgr.14388) 560 : audit [DBG] from='client.25557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:37 smithi044 bash[22676]: cluster 2024-09-20T22:27:36.877239+0000 mgr.a (mgr.14388) 561 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:38.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:37 smithi049 bash[23528]: audit 2024-09-20T22:27:36.245261+0000 mgr.a (mgr.14388) 560 : audit [DBG] from='client.25557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:38.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:37 smithi049 bash[23528]: cluster 2024-09-20T22:27:36.877239+0000 mgr.a (mgr.14388) 561 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:39 smithi044 bash[22676]: cluster 2024-09-20T22:27:38.877991+0000 mgr.a (mgr.14388) 562 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:27:40.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:39 smithi179 bash[23186]: cluster 2024-09-20T22:27:38.877991+0000 mgr.a (mgr.14388) 562 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:27:40.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:39 smithi049 bash[23528]: cluster 2024-09-20T22:27:38.877991+0000 mgr.a (mgr.14388) 562 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:27:41.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:41.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:41.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:41 smithi044 bash[22676]: cluster 2024-09-20T22:27:40.879991+0000 mgr.a (mgr.14388) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:27:42.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:41 smithi179 bash[23186]: cluster 2024-09-20T22:27:40.879991+0000 mgr.a (mgr.14388) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:27:42.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:41 smithi049 bash[23528]: cluster 2024-09-20T22:27:40.879991+0000 mgr.a (mgr.14388) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:27:42.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:42.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:42.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:42.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:42.423 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: audit 2024-09-20T22:27:41.999101+0000 mgr.a (mgr.14388) 564 : audit [DBG] from='client.25632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: audit 2024-09-20T22:27:42.388848+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: audit 2024-09-20T22:27:42.394941+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: audit 2024-09-20T22:27:42.403427+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: audit 2024-09-20T22:27:42.421398+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: audit 2024-09-20T22:27:42.427255+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: audit 2024-09-20T22:27:42.433489+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:43 smithi044 bash[22676]: cluster 2024-09-20T22:27:42.880842+0000 mgr.a (mgr.14388) 565 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:43.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: audit 2024-09-20T22:27:41.999101+0000 mgr.a (mgr.14388) 564 : audit [DBG] from='client.25632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:43.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: audit 2024-09-20T22:27:42.388848+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: audit 2024-09-20T22:27:42.394941+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: audit 2024-09-20T22:27:42.403427+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: audit 2024-09-20T22:27:42.421398+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: audit 2024-09-20T22:27:42.427255+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: audit 2024-09-20T22:27:42.433489+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:43 smithi179 bash[23186]: cluster 2024-09-20T22:27:42.880842+0000 mgr.a (mgr.14388) 565 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:43.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: audit 2024-09-20T22:27:41.999101+0000 mgr.a (mgr.14388) 564 : audit [DBG] from='client.25632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:43.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: audit 2024-09-20T22:27:42.388848+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: audit 2024-09-20T22:27:42.394941+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: audit 2024-09-20T22:27:42.403427+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: audit 2024-09-20T22:27:42.421398+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: audit 2024-09-20T22:27:42.427255+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: audit 2024-09-20T22:27:42.433489+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:43.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:43 smithi049 bash[23528]: cluster 2024-09-20T22:27:42.880842+0000 mgr.a (mgr.14388) 565 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:45 smithi044 bash[22676]: audit 2024-09-20T22:27:44.669045+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:45 smithi044 bash[22676]: audit 2024-09-20T22:27:44.676330+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:45 smithi044 bash[22676]: audit 2024-09-20T22:27:44.685647+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:45 smithi044 bash[22676]: cluster 2024-09-20T22:27:44.881765+0000 mgr.a (mgr.14388) 566 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:45 smithi179 bash[23186]: audit 2024-09-20T22:27:44.669045+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:45 smithi179 bash[23186]: audit 2024-09-20T22:27:44.676330+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:45 smithi179 bash[23186]: audit 2024-09-20T22:27:44.685647+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:45 smithi179 bash[23186]: cluster 2024-09-20T22:27:44.881765+0000 mgr.a (mgr.14388) 566 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:46.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:45 smithi049 bash[23528]: audit 2024-09-20T22:27:44.669045+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:46.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:45 smithi049 bash[23528]: audit 2024-09-20T22:27:44.676330+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:46.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:45 smithi049 bash[23528]: audit 2024-09-20T22:27:44.685647+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:27:46.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:45 smithi049 bash[23528]: cluster 2024-09-20T22:27:44.881765+0000 mgr.a (mgr.14388) 566 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:48.205 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:48.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:48.225 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:47 smithi049 bash[23528]: cluster 2024-09-20T22:27:46.883989+0000 mgr.a (mgr.14388) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:47 smithi044 bash[22676]: cluster 2024-09-20T22:27:46.883989+0000 mgr.a (mgr.14388) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:48.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:47 smithi179 bash[23186]: cluster 2024-09-20T22:27:46.883989+0000 mgr.a (mgr.14388) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:48 smithi044 bash[22676]: audit 2024-09-20T22:27:47.760761+0000 mgr.a (mgr.14388) 568 : audit [DBG] from='client.25704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:49.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:48 smithi179 bash[23186]: audit 2024-09-20T22:27:47.760761+0000 mgr.a (mgr.14388) 568 : audit [DBG] from='client.25704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:49.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:48 smithi049 bash[23528]: audit 2024-09-20T22:27:47.760761+0000 mgr.a (mgr.14388) 568 : audit [DBG] from='client.25704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:49 smithi044 bash[22676]: cluster 2024-09-20T22:27:48.884829+0000 mgr.a (mgr.14388) 569 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:50.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:49 smithi179 bash[23186]: cluster 2024-09-20T22:27:48.884829+0000 mgr.a (mgr.14388) 569 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:50.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:49 smithi049 bash[23528]: cluster 2024-09-20T22:27:48.884829+0000 mgr.a (mgr.14388) 569 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:51 smithi044 bash[22676]: cluster 2024-09-20T22:27:50.887088+0000 mgr.a (mgr.14388) 570 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:52.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:51 smithi179 bash[23186]: cluster 2024-09-20T22:27:50.887088+0000 mgr.a (mgr.14388) 570 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:52.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:51 smithi049 bash[23528]: cluster 2024-09-20T22:27:50.887088+0000 mgr.a (mgr.14388) 570 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:53.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:53.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:53.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:53.990 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:53.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:53.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:53.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:53.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:27:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:53 smithi044 bash[22676]: cluster 2024-09-20T22:27:52.887843+0000 mgr.a (mgr.14388) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:54.238 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:53 smithi049 bash[23528]: cluster 2024-09-20T22:27:52.887843+0000 mgr.a (mgr.14388) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:54.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:53 smithi179 bash[23186]: cluster 2024-09-20T22:27:52.887843+0000 mgr.a (mgr.14388) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:54 smithi044 bash[22676]: audit 2024-09-20T22:27:53.545727+0000 mgr.a (mgr.14388) 572 : audit [DBG] from='client.25782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:55.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:54 smithi179 bash[23186]: audit 2024-09-20T22:27:53.545727+0000 mgr.a (mgr.14388) 572 : audit [DBG] from='client.25782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:55.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:54 smithi049 bash[23528]: audit 2024-09-20T22:27:53.545727+0000 mgr.a (mgr.14388) 572 : audit [DBG] from='client.25782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:27:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:55 smithi044 bash[22676]: cluster 2024-09-20T22:27:54.888804+0000 mgr.a (mgr.14388) 573 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:56.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:55 smithi179 bash[23186]: cluster 2024-09-20T22:27:54.888804+0000 mgr.a (mgr.14388) 573 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:56.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:55 smithi049 bash[23528]: cluster 2024-09-20T22:27:54.888804+0000 mgr.a (mgr.14388) 573 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:27:58.170 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:57 smithi179 bash[23186]: cluster 2024-09-20T22:27:56.891109+0000 mgr.a (mgr.14388) 574 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:57 smithi044 bash[22676]: cluster 2024-09-20T22:27:56.891109+0000 mgr.a (mgr.14388) 574 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:58.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:57 smithi049 bash[23528]: cluster 2024-09-20T22:27:56.891109+0000 mgr.a (mgr.14388) 574 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:27:58.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:27:58.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:27:58.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:27:59.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:27:59.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:27:59.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:27:59.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:27:59.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:27:59 smithi044 bash[22676]: cluster 2024-09-20T22:27:58.891922+0000 mgr.a (mgr.14388) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:00.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:27:59 smithi179 bash[23186]: cluster 2024-09-20T22:27:58.891922+0000 mgr.a (mgr.14388) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:00.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:27:59 smithi049 bash[23528]: cluster 2024-09-20T22:27:58.891922+0000 mgr.a (mgr.14388) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:00 smithi044 bash[22676]: audit 2024-09-20T22:27:59.323295+0000 mgr.a (mgr.14388) 576 : audit [DBG] from='client.25857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:01.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:00 smithi179 bash[23186]: audit 2024-09-20T22:27:59.323295+0000 mgr.a (mgr.14388) 576 : audit [DBG] from='client.25857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:01.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:00 smithi049 bash[23528]: audit 2024-09-20T22:27:59.323295+0000 mgr.a (mgr.14388) 576 : audit [DBG] from='client.25857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:02.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:01 smithi179 bash[23186]: cluster 2024-09-20T22:28:00.894396+0000 mgr.a (mgr.14388) 577 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:01 smithi049 bash[23528]: cluster 2024-09-20T22:28:00.894396+0000 mgr.a (mgr.14388) 577 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:02.339 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:01 smithi044 bash[22676]: cluster 2024-09-20T22:28:00.894396+0000 mgr.a (mgr.14388) 577 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:03 smithi044 bash[22676]: audit 2024-09-20T22:28:02.624585+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:03 smithi044 bash[22676]: audit 2024-09-20T22:28:02.633112+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:03 smithi044 bash[22676]: audit 2024-09-20T22:28:02.644003+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:03 smithi044 bash[22676]: audit 2024-09-20T22:28:02.653973+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:03 smithi044 bash[22676]: audit 2024-09-20T22:28:02.663900+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:03 smithi044 bash[22676]: audit 2024-09-20T22:28:02.673068+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:03 smithi044 bash[22676]: cluster 2024-09-20T22:28:02.895183+0000 mgr.a (mgr.14388) 578 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:03.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:03 smithi179 bash[23186]: audit 2024-09-20T22:28:02.624585+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:03 smithi179 bash[23186]: audit 2024-09-20T22:28:02.633112+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:03 smithi179 bash[23186]: audit 2024-09-20T22:28:02.644003+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:03 smithi179 bash[23186]: audit 2024-09-20T22:28:02.653973+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:03.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:03 smithi179 bash[23186]: audit 2024-09-20T22:28:02.663900+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:03 smithi179 bash[23186]: audit 2024-09-20T22:28:02.673068+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:03 smithi179 bash[23186]: cluster 2024-09-20T22:28:02.895183+0000 mgr.a (mgr.14388) 578 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:04.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:03 smithi049 bash[23528]: audit 2024-09-20T22:28:02.624585+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:03 smithi049 bash[23528]: audit 2024-09-20T22:28:02.633112+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:03 smithi049 bash[23528]: audit 2024-09-20T22:28:02.644003+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:03 smithi049 bash[23528]: audit 2024-09-20T22:28:02.653973+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:03 smithi049 bash[23528]: audit 2024-09-20T22:28:02.663900+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:03 smithi049 bash[23528]: audit 2024-09-20T22:28:02.673068+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:04.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:03 smithi049 bash[23528]: cluster 2024-09-20T22:28:02.895183+0000 mgr.a (mgr.14388) 578 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:05.487 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:05.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:05.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:05.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:05.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:05 smithi044 bash[22676]: audit 2024-09-20T22:28:04.866038+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:05 smithi044 bash[22676]: audit 2024-09-20T22:28:04.871772+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:05 smithi044 bash[22676]: audit 2024-09-20T22:28:04.877987+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:05 smithi044 bash[22676]: cluster 2024-09-20T22:28:04.895614+0000 mgr.a (mgr.14388) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:05 smithi179 bash[23186]: audit 2024-09-20T22:28:04.866038+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:05 smithi179 bash[23186]: audit 2024-09-20T22:28:04.871772+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:05 smithi179 bash[23186]: audit 2024-09-20T22:28:04.877987+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:05 smithi179 bash[23186]: cluster 2024-09-20T22:28:04.895614+0000 mgr.a (mgr.14388) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:05 smithi049 bash[23528]: audit 2024-09-20T22:28:04.866038+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:05 smithi049 bash[23528]: audit 2024-09-20T22:28:04.871772+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:05 smithi049 bash[23528]: audit 2024-09-20T22:28:04.877987+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:05 smithi049 bash[23528]: cluster 2024-09-20T22:28:04.895614+0000 mgr.a (mgr.14388) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:06 smithi044 bash[22676]: audit 2024-09-20T22:28:05.065911+0000 mgr.a (mgr.14388) 580 : audit [DBG] from='client.25935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:07.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:06 smithi179 bash[23186]: audit 2024-09-20T22:28:05.065911+0000 mgr.a (mgr.14388) 580 : audit [DBG] from='client.25935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:07.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:06 smithi049 bash[23528]: audit 2024-09-20T22:28:05.065911+0000 mgr.a (mgr.14388) 580 : audit [DBG] from='client.25935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:08.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:28:08 smithi044 bash[22930]: debug 2024-09-20T22:28:08.052+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:28:08.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:28:08 smithi044 bash[22930]: debug 2024-09-20T22:28:08.052+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:28:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:07 smithi044 bash[22676]: cluster 2024-09-20T22:28:06.898461+0000 mgr.a (mgr.14388) 581 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:07 smithi044 bash[22676]: audit 2024-09-20T22:28:07.274752+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:28:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:07 smithi044 bash[22676]: audit 2024-09-20T22:28:07.281859+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:28:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:07 smithi044 bash[22676]: audit 2024-09-20T22:28:07.283951+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:28:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:07 smithi044 bash[22676]: audit 2024-09-20T22:28:07.295390+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:07 smithi044 bash[22676]: audit 2024-09-20T22:28:07.301826+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:28:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:07 smithi179 bash[23186]: cluster 2024-09-20T22:28:06.898461+0000 mgr.a (mgr.14388) 581 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:07 smithi179 bash[23186]: audit 2024-09-20T22:28:07.274752+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:28:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:07 smithi179 bash[23186]: audit 2024-09-20T22:28:07.281859+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:28:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:07 smithi179 bash[23186]: audit 2024-09-20T22:28:07.283951+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:28:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:07 smithi179 bash[23186]: audit 2024-09-20T22:28:07.295390+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:07 smithi179 bash[23186]: audit 2024-09-20T22:28:07.301826+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:28:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:07 smithi049 bash[23528]: cluster 2024-09-20T22:28:06.898461+0000 mgr.a (mgr.14388) 581 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:07 smithi049 bash[23528]: audit 2024-09-20T22:28:07.274752+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:28:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:07 smithi049 bash[23528]: audit 2024-09-20T22:28:07.281859+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:28:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:07 smithi049 bash[23528]: audit 2024-09-20T22:28:07.283951+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:28:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:07 smithi049 bash[23528]: audit 2024-09-20T22:28:07.295390+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:07 smithi049 bash[23528]: audit 2024-09-20T22:28:07.301826+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:28:09.162 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:08 smithi049 bash[23528]: audit 2024-09-20T22:28:07.304281+0000 mgr.a (mgr.14388) 582 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:28:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:08 smithi044 bash[22676]: audit 2024-09-20T22:28:07.304281+0000 mgr.a (mgr.14388) 582 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:28:09.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:08 smithi179 bash[23186]: audit 2024-09-20T22:28:07.304281+0000 mgr.a (mgr.14388) 582 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:28:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:09 smithi044 bash[22676]: audit 2024-09-20T22:28:08.054463+0000 mgr.a (mgr.14388) 583 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:28:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:09 smithi044 bash[22676]: cephadm 2024-09-20T22:28:08.055661+0000 mgr.a (mgr.14388) 584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:28:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:09 smithi044 bash[22676]: cluster 2024-09-20T22:28:08.899436+0000 mgr.a (mgr.14388) 585 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:28:10.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:09 smithi179 bash[23186]: audit 2024-09-20T22:28:08.054463+0000 mgr.a (mgr.14388) 583 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:28:10.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:09 smithi179 bash[23186]: cephadm 2024-09-20T22:28:08.055661+0000 mgr.a (mgr.14388) 584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:28:10.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:09 smithi179 bash[23186]: cluster 2024-09-20T22:28:08.899436+0000 mgr.a (mgr.14388) 585 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:28:10.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:09 smithi049 bash[23528]: audit 2024-09-20T22:28:08.054463+0000 mgr.a (mgr.14388) 583 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:28:10.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:09 smithi049 bash[23528]: cephadm 2024-09-20T22:28:08.055661+0000 mgr.a (mgr.14388) 584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:28:10.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:09 smithi049 bash[23528]: cluster 2024-09-20T22:28:08.899436+0000 mgr.a (mgr.14388) 585 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:28:10.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:10.489 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:10.489 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:11.258 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:11 smithi044 bash[22676]: audit 2024-09-20T22:28:10.817499+0000 mgr.a (mgr.14388) 586 : audit [DBG] from='client.26121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:11 smithi044 bash[22676]: cluster 2024-09-20T22:28:10.901218+0000 mgr.a (mgr.14388) 587 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:12.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:11 smithi179 bash[23186]: audit 2024-09-20T22:28:10.817499+0000 mgr.a (mgr.14388) 586 : audit [DBG] from='client.26121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:12.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:11 smithi179 bash[23186]: cluster 2024-09-20T22:28:10.901218+0000 mgr.a (mgr.14388) 587 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:12.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:11 smithi049 bash[23528]: audit 2024-09-20T22:28:10.817499+0000 mgr.a (mgr.14388) 586 : audit [DBG] from='client.26121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:12.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:11 smithi049 bash[23528]: cluster 2024-09-20T22:28:10.901218+0000 mgr.a (mgr.14388) 587 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:13 smithi044 bash[22676]: cluster 2024-09-20T22:28:12.902192+0000 mgr.a (mgr.14388) 588 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:28:14.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:13 smithi179 bash[23186]: cluster 2024-09-20T22:28:12.902192+0000 mgr.a (mgr.14388) 588 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:28:14.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:13 smithi049 bash[23528]: cluster 2024-09-20T22:28:12.902192+0000 mgr.a (mgr.14388) 588 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:28:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:15 smithi044 bash[22676]: cluster 2024-09-20T22:28:14.902975+0000 mgr.a (mgr.14388) 589 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:28:16.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:15 smithi179 bash[23186]: cluster 2024-09-20T22:28:14.902975+0000 mgr.a (mgr.14388) 589 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:28:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:16.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:15 smithi049 bash[23528]: cluster 2024-09-20T22:28:14.902975+0000 mgr.a (mgr.14388) 589 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:28:17.027 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:17.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:17.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:17.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:17.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:17 smithi044 bash[22676]: audit 2024-09-20T22:28:16.599462+0000 mgr.a (mgr.14388) 590 : audit [DBG] from='client.26199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:17 smithi044 bash[22676]: cluster 2024-09-20T22:28:16.904411+0000 mgr.a (mgr.14388) 591 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:17 smithi179 bash[23186]: audit 2024-09-20T22:28:16.599462+0000 mgr.a (mgr.14388) 590 : audit [DBG] from='client.26199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:18.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:17 smithi179 bash[23186]: cluster 2024-09-20T22:28:16.904411+0000 mgr.a (mgr.14388) 591 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:18.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:17 smithi049 bash[23528]: audit 2024-09-20T22:28:16.599462+0000 mgr.a (mgr.14388) 590 : audit [DBG] from='client.26199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:18.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:17 smithi049 bash[23528]: cluster 2024-09-20T22:28:16.904411+0000 mgr.a (mgr.14388) 591 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:19 smithi044 bash[22676]: cluster 2024-09-20T22:28:18.905326+0000 mgr.a (mgr.14388) 592 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:20.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:19 smithi179 bash[23186]: cluster 2024-09-20T22:28:18.905326+0000 mgr.a (mgr.14388) 592 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:20.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:19 smithi049 bash[23528]: cluster 2024-09-20T22:28:18.905326+0000 mgr.a (mgr.14388) 592 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:22.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:22.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:22.217 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:21 smithi044 bash[22676]: cluster 2024-09-20T22:28:20.907536+0000 mgr.a (mgr.14388) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:22.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:21 smithi179 bash[23186]: cluster 2024-09-20T22:28:20.907536+0000 mgr.a (mgr.14388) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:22.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:21 smithi049 bash[23528]: cluster 2024-09-20T22:28:20.907536+0000 mgr.a (mgr.14388) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:28:22.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:22.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:22.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:22.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:22.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: audit 2024-09-20T22:28:22.370982+0000 mgr.a (mgr.14388) 594 : audit [DBG] from='client.26274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: audit 2024-09-20T22:28:22.816565+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: audit 2024-09-20T22:28:22.822748+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: audit 2024-09-20T22:28:22.829969+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: audit 2024-09-20T22:28:22.860934+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: audit 2024-09-20T22:28:22.866997+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: audit 2024-09-20T22:28:22.873415+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:23 smithi044 bash[22676]: cluster 2024-09-20T22:28:22.908030+0000 mgr.a (mgr.14388) 595 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:24.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: audit 2024-09-20T22:28:22.370982+0000 mgr.a (mgr.14388) 594 : audit [DBG] from='client.26274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:24.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: audit 2024-09-20T22:28:22.816565+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: audit 2024-09-20T22:28:22.822748+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: audit 2024-09-20T22:28:22.829969+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: audit 2024-09-20T22:28:22.860934+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: audit 2024-09-20T22:28:22.866997+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: audit 2024-09-20T22:28:22.873415+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:23 smithi179 bash[23186]: cluster 2024-09-20T22:28:22.908030+0000 mgr.a (mgr.14388) 595 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: audit 2024-09-20T22:28:22.370982+0000 mgr.a (mgr.14388) 594 : audit [DBG] from='client.26274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: audit 2024-09-20T22:28:22.816565+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: audit 2024-09-20T22:28:22.822748+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: audit 2024-09-20T22:28:22.829969+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: audit 2024-09-20T22:28:22.860934+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: audit 2024-09-20T22:28:22.866997+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: audit 2024-09-20T22:28:22.873415+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:23 smithi049 bash[23528]: cluster 2024-09-20T22:28:22.908030+0000 mgr.a (mgr.14388) 595 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:25 smithi044 bash[22676]: cluster 2024-09-20T22:28:24.908730+0000 mgr.a (mgr.14388) 596 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:25 smithi044 bash[22676]: audit 2024-09-20T22:28:25.042779+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:25 smithi044 bash[22676]: audit 2024-09-20T22:28:25.049030+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:25 smithi044 bash[22676]: audit 2024-09-20T22:28:25.058543+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:25 smithi179 bash[23186]: cluster 2024-09-20T22:28:24.908730+0000 mgr.a (mgr.14388) 596 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:26.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:25 smithi179 bash[23186]: audit 2024-09-20T22:28:25.042779+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:25 smithi179 bash[23186]: audit 2024-09-20T22:28:25.049030+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:25 smithi179 bash[23186]: audit 2024-09-20T22:28:25.058543+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:25 smithi049 bash[23528]: cluster 2024-09-20T22:28:24.908730+0000 mgr.a (mgr.14388) 596 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:25 smithi049 bash[23528]: audit 2024-09-20T22:28:25.042779+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:25 smithi049 bash[23528]: audit 2024-09-20T22:28:25.049030+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:25 smithi049 bash[23528]: audit 2024-09-20T22:28:25.058543+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:27.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:27.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:27.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:27 smithi044 bash[22676]: cluster 2024-09-20T22:28:26.910914+0000 mgr.a (mgr.14388) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:28.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:27 smithi179 bash[23186]: cluster 2024-09-20T22:28:26.910914+0000 mgr.a (mgr.14388) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:28.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:27 smithi049 bash[23528]: cluster 2024-09-20T22:28:26.910914+0000 mgr.a (mgr.14388) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:28.560 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:30.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:29 smithi049 bash[23528]: audit 2024-09-20T22:28:28.156710+0000 mgr.a (mgr.14388) 598 : audit [DBG] from='client.26352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:30.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:29 smithi049 bash[23528]: cluster 2024-09-20T22:28:28.911874+0000 mgr.a (mgr.14388) 599 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:29 smithi044 bash[22676]: audit 2024-09-20T22:28:28.156710+0000 mgr.a (mgr.14388) 598 : audit [DBG] from='client.26352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:29 smithi044 bash[22676]: cluster 2024-09-20T22:28:28.911874+0000 mgr.a (mgr.14388) 599 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:30.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:29 smithi179 bash[23186]: audit 2024-09-20T22:28:28.156710+0000 mgr.a (mgr.14388) 598 : audit [DBG] from='client.26352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:30.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:29 smithi179 bash[23186]: cluster 2024-09-20T22:28:28.911874+0000 mgr.a (mgr.14388) 599 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:31 smithi044 bash[22676]: cluster 2024-09-20T22:28:30.914170+0000 mgr.a (mgr.14388) 600 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:32.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:31 smithi179 bash[23186]: cluster 2024-09-20T22:28:30.914170+0000 mgr.a (mgr.14388) 600 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:32.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:31 smithi049 bash[23528]: cluster 2024-09-20T22:28:30.914170+0000 mgr.a (mgr.14388) 600 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:33 smithi044 bash[22676]: cluster 2024-09-20T22:28:32.914987+0000 mgr.a (mgr.14388) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:34.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:33 smithi179 bash[23186]: cluster 2024-09-20T22:28:32.914987+0000 mgr.a (mgr.14388) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:34.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:33 smithi049 bash[23528]: cluster 2024-09-20T22:28:32.914987+0000 mgr.a (mgr.14388) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:34.309 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:34.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:34.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:34.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:34.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:35.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:34 smithi179 bash[23186]: audit 2024-09-20T22:28:33.887840+0000 mgr.a (mgr.14388) 602 : audit [DBG] from='client.26430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:35.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:34 smithi049 bash[23528]: audit 2024-09-20T22:28:33.887840+0000 mgr.a (mgr.14388) 602 : audit [DBG] from='client.26430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:34 smithi044 bash[22676]: audit 2024-09-20T22:28:33.887840+0000 mgr.a (mgr.14388) 602 : audit [DBG] from='client.26430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:36.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:35 smithi179 bash[23186]: cluster 2024-09-20T22:28:34.915959+0000 mgr.a (mgr.14388) 603 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:36.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:35 smithi049 bash[23528]: cluster 2024-09-20T22:28:34.915959+0000 mgr.a (mgr.14388) 603 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:35 smithi044 bash[22676]: cluster 2024-09-20T22:28:34.915959+0000 mgr.a (mgr.14388) 603 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:38.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:37 smithi179 bash[23186]: cluster 2024-09-20T22:28:36.918199+0000 mgr.a (mgr.14388) 604 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:38.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:38 smithi049 bash[23528]: cluster 2024-09-20T22:28:36.918199+0000 mgr.a (mgr.14388) 604 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:37 smithi044 bash[22676]: cluster 2024-09-20T22:28:36.918199+0000 mgr.a (mgr.14388) 604 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:28:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:39.312 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:39.312 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:40.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:40.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:40.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:40.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:40.054 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:40.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:40 smithi179 bash[23186]: cluster 2024-09-20T22:28:38.918970+0000 mgr.a (mgr.14388) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:40.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:40 smithi049 bash[23528]: cluster 2024-09-20T22:28:38.918970+0000 mgr.a (mgr.14388) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:39 smithi044 bash[22676]: cluster 2024-09-20T22:28:38.918970+0000 mgr.a (mgr.14388) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:41 smithi179 bash[23186]: audit 2024-09-20T22:28:39.639920+0000 mgr.a (mgr.14388) 606 : audit [DBG] from='client.26508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:41.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:41 smithi049 bash[23528]: audit 2024-09-20T22:28:39.639920+0000 mgr.a (mgr.14388) 606 : audit [DBG] from='client.26508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:41 smithi044 bash[22676]: audit 2024-09-20T22:28:39.639920+0000 mgr.a (mgr.14388) 606 : audit [DBG] from='client.26508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:42.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:42 smithi179 bash[23186]: cluster 2024-09-20T22:28:40.921450+0000 mgr.a (mgr.14388) 607 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:28:42.259 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:42 smithi044 bash[22676]: cluster 2024-09-20T22:28:40.921450+0000 mgr.a (mgr.14388) 607 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:28:42.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:42 smithi049 bash[23528]: cluster 2024-09-20T22:28:40.921450+0000 mgr.a (mgr.14388) 607 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:28:44.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:44 smithi049 bash[23528]: cluster 2024-09-20T22:28:42.922268+0000 mgr.a (mgr.14388) 608 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:28:44.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:44 smithi049 bash[23528]: audit 2024-09-20T22:28:43.007376+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:44 smithi049 bash[23528]: audit 2024-09-20T22:28:43.013187+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:44 smithi049 bash[23528]: audit 2024-09-20T22:28:43.025672+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:44 smithi049 bash[23528]: audit 2024-09-20T22:28:43.075214+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:44 smithi049 bash[23528]: audit 2024-09-20T22:28:43.085407+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:44 smithi049 bash[23528]: audit 2024-09-20T22:28:43.097020+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.332 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:44 smithi044 bash[22676]: cluster 2024-09-20T22:28:42.922268+0000 mgr.a (mgr.14388) 608 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:28:44.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:44 smithi044 bash[22676]: audit 2024-09-20T22:28:43.007376+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:44 smithi044 bash[22676]: audit 2024-09-20T22:28:43.013187+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:44 smithi044 bash[22676]: audit 2024-09-20T22:28:43.025672+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:44 smithi044 bash[22676]: audit 2024-09-20T22:28:43.075214+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:44 smithi044 bash[22676]: audit 2024-09-20T22:28:43.085407+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:44 smithi044 bash[22676]: audit 2024-09-20T22:28:43.097020+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:44 smithi179 bash[23186]: cluster 2024-09-20T22:28:42.922268+0000 mgr.a (mgr.14388) 608 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:28:44.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:44 smithi179 bash[23186]: audit 2024-09-20T22:28:43.007376+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:44 smithi179 bash[23186]: audit 2024-09-20T22:28:43.013187+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:44 smithi179 bash[23186]: audit 2024-09-20T22:28:43.025672+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:44 smithi179 bash[23186]: audit 2024-09-20T22:28:43.075214+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:44 smithi179 bash[23186]: audit 2024-09-20T22:28:43.085407+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:44.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:44 smithi179 bash[23186]: audit 2024-09-20T22:28:43.097020+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:45.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:45.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:45.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:45.844 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:46.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:46 smithi049 bash[23528]: cluster 2024-09-20T22:28:44.923035+0000 mgr.a (mgr.14388) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:28:46.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:46 smithi049 bash[23528]: audit 2024-09-20T22:28:45.260652+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:46 smithi049 bash[23528]: audit 2024-09-20T22:28:45.266683+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:46 smithi049 bash[23528]: audit 2024-09-20T22:28:45.275903+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:46 smithi044 bash[22676]: cluster 2024-09-20T22:28:44.923035+0000 mgr.a (mgr.14388) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:28:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:46 smithi044 bash[22676]: audit 2024-09-20T22:28:45.260652+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:46 smithi044 bash[22676]: audit 2024-09-20T22:28:45.266683+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:46 smithi044 bash[22676]: audit 2024-09-20T22:28:45.275903+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:46 smithi179 bash[23186]: cluster 2024-09-20T22:28:44.923035+0000 mgr.a (mgr.14388) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:28:46.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:46 smithi179 bash[23186]: audit 2024-09-20T22:28:45.260652+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:46 smithi179 bash[23186]: audit 2024-09-20T22:28:45.266683+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:46.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:46 smithi179 bash[23186]: audit 2024-09-20T22:28:45.275903+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:28:47.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:47 smithi049 bash[23528]: audit 2024-09-20T22:28:45.397545+0000 mgr.a (mgr.14388) 610 : audit [DBG] from='client.26583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:47 smithi044 bash[22676]: audit 2024-09-20T22:28:45.397545+0000 mgr.a (mgr.14388) 610 : audit [DBG] from='client.26583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:47 smithi179 bash[23186]: audit 2024-09-20T22:28:45.397545+0000 mgr.a (mgr.14388) 610 : audit [DBG] from='client.26583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:48.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:48 smithi049 bash[23528]: cluster 2024-09-20T22:28:46.925842+0000 mgr.a (mgr.14388) 611 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:48 smithi044 bash[22676]: cluster 2024-09-20T22:28:46.925842+0000 mgr.a (mgr.14388) 611 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:48.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:48 smithi179 bash[23186]: cluster 2024-09-20T22:28:46.925842+0000 mgr.a (mgr.14388) 611 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:49.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:49 smithi049 bash[23528]: cluster 2024-09-20T22:28:48.926617+0000 mgr.a (mgr.14388) 612 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:28:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:49 smithi044 bash[22676]: cluster 2024-09-20T22:28:48.926617+0000 mgr.a (mgr.14388) 612 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:28:49.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:49 smithi179 bash[23186]: cluster 2024-09-20T22:28:48.926617+0000 mgr.a (mgr.14388) 612 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:28:50.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:51.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:51.626 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:52.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:51 smithi049 bash[23528]: cluster 2024-09-20T22:28:50.928546+0000 mgr.a (mgr.14388) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:51 smithi044 bash[22676]: cluster 2024-09-20T22:28:50.928546+0000 mgr.a (mgr.14388) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:52.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:51 smithi179 bash[23186]: cluster 2024-09-20T22:28:50.928546+0000 mgr.a (mgr.14388) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:28:53.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:52 smithi179 bash[23186]: audit 2024-09-20T22:28:51.184392+0000 mgr.a (mgr.14388) 614 : audit [DBG] from='client.26661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:53.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:52 smithi049 bash[23528]: audit 2024-09-20T22:28:51.184392+0000 mgr.a (mgr.14388) 614 : audit [DBG] from='client.26661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:52 smithi044 bash[22676]: audit 2024-09-20T22:28:51.184392+0000 mgr.a (mgr.14388) 614 : audit [DBG] from='client.26661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:54.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:53 smithi179 bash[23186]: cluster 2024-09-20T22:28:52.929675+0000 mgr.a (mgr.14388) 615 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:28:54.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:54 smithi049 bash[23528]: cluster 2024-09-20T22:28:52.929675+0000 mgr.a (mgr.14388) 615 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:28:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:53 smithi044 bash[22676]: cluster 2024-09-20T22:28:52.929675+0000 mgr.a (mgr.14388) 615 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:28:56.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:56 smithi179 bash[23186]: cluster 2024-09-20T22:28:54.930625+0000 mgr.a (mgr.14388) 616 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:28:56.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:56 smithi049 bash[23528]: cluster 2024-09-20T22:28:54.930625+0000 mgr.a (mgr.14388) 616 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:28:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:55 smithi044 bash[22676]: cluster 2024-09-20T22:28:54.930625+0000 mgr.a (mgr.14388) 616 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:28:56.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:28:56.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:28:56.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:28:57.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:28:57.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:28:57.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:28:57.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:28:57.385 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:28:58.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:58 smithi049 bash[23528]: cluster 2024-09-20T22:28:56.932734+0000 mgr.a (mgr.14388) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:28:58.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:28:58 smithi049 bash[23528]: audit 2024-09-20T22:28:56.958370+0000 mgr.a (mgr.14388) 618 : audit [DBG] from='client.26736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:58 smithi044 bash[22676]: cluster 2024-09-20T22:28:56.932734+0000 mgr.a (mgr.14388) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:28:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:28:58 smithi044 bash[22676]: audit 2024-09-20T22:28:56.958370+0000 mgr.a (mgr.14388) 618 : audit [DBG] from='client.26736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:28:58.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:58 smithi179 bash[23186]: cluster 2024-09-20T22:28:56.932734+0000 mgr.a (mgr.14388) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:28:58.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:28:58 smithi179 bash[23186]: audit 2024-09-20T22:28:56.958370+0000 mgr.a (mgr.14388) 618 : audit [DBG] from='client.26736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:00.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:00 smithi049 bash[23528]: cluster 2024-09-20T22:28:58.933682+0000 mgr.a (mgr.14388) 619 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:00 smithi044 bash[22676]: cluster 2024-09-20T22:28:58.933682+0000 mgr.a (mgr.14388) 619 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:00.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:00 smithi179 bash[23186]: cluster 2024-09-20T22:28:58.933682+0000 mgr.a (mgr.14388) 619 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:02 smithi044 bash[22676]: cluster 2024-09-20T22:29:00.935914+0000 mgr.a (mgr.14388) 620 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:02.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:02 smithi049 bash[23528]: cluster 2024-09-20T22:29:00.935914+0000 mgr.a (mgr.14388) 620 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:02.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:02 smithi179 bash[23186]: cluster 2024-09-20T22:29:00.935914+0000 mgr.a (mgr.14388) 620 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:03.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:03.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:03.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:03.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:03.133 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: audit 2024-09-20T22:29:02.718271+0000 mgr.a (mgr.14388) 621 : audit [DBG] from='client.26811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: cluster 2024-09-20T22:29:02.944637+0000 mgr.a (mgr.14388) 622 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: audit 2024-09-20T22:29:03.220607+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: audit 2024-09-20T22:29:03.229673+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: audit 2024-09-20T22:29:03.239348+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: audit 2024-09-20T22:29:03.304621+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: audit 2024-09-20T22:29:03.311034+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:04 smithi044 bash[22676]: audit 2024-09-20T22:29:03.318873+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: audit 2024-09-20T22:29:02.718271+0000 mgr.a (mgr.14388) 621 : audit [DBG] from='client.26811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: cluster 2024-09-20T22:29:02.944637+0000 mgr.a (mgr.14388) 622 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: audit 2024-09-20T22:29:03.220607+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: audit 2024-09-20T22:29:03.229673+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: audit 2024-09-20T22:29:03.239348+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: audit 2024-09-20T22:29:03.304621+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: audit 2024-09-20T22:29:03.311034+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:04 smithi049 bash[23528]: audit 2024-09-20T22:29:03.318873+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: audit 2024-09-20T22:29:02.718271+0000 mgr.a (mgr.14388) 621 : audit [DBG] from='client.26811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:04.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: cluster 2024-09-20T22:29:02.944637+0000 mgr.a (mgr.14388) 622 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:04.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: audit 2024-09-20T22:29:03.220607+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: audit 2024-09-20T22:29:03.229673+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: audit 2024-09-20T22:29:03.239348+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: audit 2024-09-20T22:29:03.304621+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: audit 2024-09-20T22:29:03.311034+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:04.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:04 smithi179 bash[23186]: audit 2024-09-20T22:29:03.318873+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:06 smithi049 bash[23528]: cluster 2024-09-20T22:29:04.945225+0000 mgr.a (mgr.14388) 623 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:06 smithi049 bash[23528]: audit 2024-09-20T22:29:05.492317+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:06 smithi049 bash[23528]: audit 2024-09-20T22:29:05.500498+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:06 smithi049 bash[23528]: audit 2024-09-20T22:29:05.511180+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:06 smithi044 bash[22676]: cluster 2024-09-20T22:29:04.945225+0000 mgr.a (mgr.14388) 623 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:06 smithi044 bash[22676]: audit 2024-09-20T22:29:05.492317+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:06 smithi044 bash[22676]: audit 2024-09-20T22:29:05.500498+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:06 smithi044 bash[22676]: audit 2024-09-20T22:29:05.511180+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:06 smithi179 bash[23186]: cluster 2024-09-20T22:29:04.945225+0000 mgr.a (mgr.14388) 623 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:06.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:06 smithi179 bash[23186]: audit 2024-09-20T22:29:05.492317+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:06 smithi179 bash[23186]: audit 2024-09-20T22:29:05.500498+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:06.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:06 smithi179 bash[23186]: audit 2024-09-20T22:29:05.511180+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:07 smithi044 bash[22676]: cluster 2024-09-20T22:29:06.947442+0000 mgr.a (mgr.14388) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:07 smithi179 bash[23186]: cluster 2024-09-20T22:29:06.947442+0000 mgr.a (mgr.14388) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:07.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:07 smithi049 bash[23528]: cluster 2024-09-20T22:29:06.947442+0000 mgr.a (mgr.14388) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:08.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:08.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:08.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:08 smithi044 bash[22676]: audit 2024-09-20T22:29:08.114091+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:29:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:08 smithi044 bash[22676]: audit 2024-09-20T22:29:08.120470+0000 mon.a (mon.0) 1302 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:29:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:08 smithi044 bash[22676]: audit 2024-09-20T22:29:08.122321+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:29:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:08 smithi044 bash[22676]: audit 2024-09-20T22:29:08.133492+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:08 smithi044 bash[22676]: audit 2024-09-20T22:29:08.140207+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:29:08.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:08 smithi179 bash[23186]: audit 2024-09-20T22:29:08.114091+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:29:08.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:08 smithi179 bash[23186]: audit 2024-09-20T22:29:08.120470+0000 mon.a (mon.0) 1302 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:29:08.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:08 smithi179 bash[23186]: audit 2024-09-20T22:29:08.122321+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:29:08.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:08 smithi179 bash[23186]: audit 2024-09-20T22:29:08.133492+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:08.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:08 smithi179 bash[23186]: audit 2024-09-20T22:29:08.140207+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:29:08.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:08 smithi049 bash[23528]: audit 2024-09-20T22:29:08.114091+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:29:08.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:08 smithi049 bash[23528]: audit 2024-09-20T22:29:08.120470+0000 mon.a (mon.0) 1302 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:29:08.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:08 smithi049 bash[23528]: audit 2024-09-20T22:29:08.122321+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:29:08.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:08 smithi049 bash[23528]: audit 2024-09-20T22:29:08.133492+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:08.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:08 smithi049 bash[23528]: audit 2024-09-20T22:29:08.140207+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:29:09.173 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:29:08 smithi044 bash[22930]: debug 2024-09-20T22:29:08.883+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:29:09.173 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:29:08 smithi044 bash[22930]: debug 2024-09-20T22:29:08.895+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:29:09.293 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:09.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:09.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:09.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:09.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:09 smithi044 bash[22676]: audit 2024-09-20T22:29:08.141662+0000 mgr.a (mgr.14388) 625 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:29:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:09 smithi044 bash[22676]: audit 2024-09-20T22:29:08.492708+0000 mgr.a (mgr.14388) 626 : audit [DBG] from='client.26907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:09 smithi044 bash[22676]: audit 2024-09-20T22:29:08.886615+0000 mgr.a (mgr.14388) 627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:29:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:09 smithi044 bash[22676]: cephadm 2024-09-20T22:29:08.897808+0000 mgr.a (mgr.14388) 628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:29:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:09 smithi044 bash[22676]: cluster 2024-09-20T22:29:08.947987+0000 mgr.a (mgr.14388) 629 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:09.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:09 smithi179 bash[23186]: audit 2024-09-20T22:29:08.141662+0000 mgr.a (mgr.14388) 625 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:29:09.511 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:09 smithi179 bash[23186]: audit 2024-09-20T22:29:08.492708+0000 mgr.a (mgr.14388) 626 : audit [DBG] from='client.26907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:09.511 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:09 smithi179 bash[23186]: audit 2024-09-20T22:29:08.886615+0000 mgr.a (mgr.14388) 627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:29:09.511 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:09 smithi179 bash[23186]: cephadm 2024-09-20T22:29:08.897808+0000 mgr.a (mgr.14388) 628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:29:09.511 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:09 smithi179 bash[23186]: cluster 2024-09-20T22:29:08.947987+0000 mgr.a (mgr.14388) 629 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:09.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:09 smithi049 bash[23528]: audit 2024-09-20T22:29:08.141662+0000 mgr.a (mgr.14388) 625 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:29:09.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:09 smithi049 bash[23528]: audit 2024-09-20T22:29:08.492708+0000 mgr.a (mgr.14388) 626 : audit [DBG] from='client.26907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:09.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:09 smithi049 bash[23528]: audit 2024-09-20T22:29:08.886615+0000 mgr.a (mgr.14388) 627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:29:09.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:09 smithi049 bash[23528]: cephadm 2024-09-20T22:29:08.897808+0000 mgr.a (mgr.14388) 628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:29:09.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:09 smithi049 bash[23528]: cluster 2024-09-20T22:29:08.947987+0000 mgr.a (mgr.14388) 629 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:12.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:12 smithi049 bash[23528]: cluster 2024-09-20T22:29:10.950284+0000 mgr.a (mgr.14388) 630 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:12 smithi044 bash[22676]: cluster 2024-09-20T22:29:10.950284+0000 mgr.a (mgr.14388) 630 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:12 smithi179 bash[23186]: cluster 2024-09-20T22:29:10.950284+0000 mgr.a (mgr.14388) 630 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:14.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:14 smithi049 bash[23528]: cluster 2024-09-20T22:29:12.951070+0000 mgr.a (mgr.14388) 631 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:14.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:14.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:14.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:14 smithi044 bash[22676]: cluster 2024-09-20T22:29:12.951070+0000 mgr.a (mgr.14388) 631 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:14.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:14 smithi179 bash[23186]: cluster 2024-09-20T22:29:12.951070+0000 mgr.a (mgr.14388) 631 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:15.049 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:15.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:15.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:15.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:15.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:16.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:16 smithi049 bash[23528]: audit 2024-09-20T22:29:14.628633+0000 mgr.a (mgr.14388) 632 : audit [DBG] from='client.27072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:16.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:16 smithi049 bash[23528]: cluster 2024-09-20T22:29:14.951791+0000 mgr.a (mgr.14388) 633 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:16 smithi044 bash[22676]: audit 2024-09-20T22:29:14.628633+0000 mgr.a (mgr.14388) 632 : audit [DBG] from='client.27072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:16 smithi044 bash[22676]: cluster 2024-09-20T22:29:14.951791+0000 mgr.a (mgr.14388) 633 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:16.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:16 smithi179 bash[23186]: audit 2024-09-20T22:29:14.628633+0000 mgr.a (mgr.14388) 632 : audit [DBG] from='client.27072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:16.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:16 smithi179 bash[23186]: cluster 2024-09-20T22:29:14.951791+0000 mgr.a (mgr.14388) 633 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:18.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:18 smithi049 bash[23528]: cluster 2024-09-20T22:29:16.954072+0000 mgr.a (mgr.14388) 634 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:18 smithi044 bash[22676]: cluster 2024-09-20T22:29:16.954072+0000 mgr.a (mgr.14388) 634 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:18.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:18 smithi179 bash[23186]: cluster 2024-09-20T22:29:16.954072+0000 mgr.a (mgr.14388) 634 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:20.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:20.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:20.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:20 smithi049 bash[23528]: cluster 2024-09-20T22:29:18.955663+0000 mgr.a (mgr.14388) 635 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:29:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:20 smithi044 bash[22676]: cluster 2024-09-20T22:29:18.955663+0000 mgr.a (mgr.14388) 635 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:29:20.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:20 smithi179 bash[23186]: cluster 2024-09-20T22:29:18.955663+0000 mgr.a (mgr.14388) 635 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:29:20.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:20.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:20.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:20.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:20.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:21.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:21 smithi049 bash[23528]: audit 2024-09-20T22:29:20.385870+0000 mgr.a (mgr.14388) 636 : audit [DBG] from='client.27150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:21.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:21 smithi049 bash[23528]: cluster 2024-09-20T22:29:20.958699+0000 mgr.a (mgr.14388) 637 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:21.297 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:21 smithi179 bash[23186]: audit 2024-09-20T22:29:20.385870+0000 mgr.a (mgr.14388) 636 : audit [DBG] from='client.27150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:21.297 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:21 smithi179 bash[23186]: cluster 2024-09-20T22:29:20.958699+0000 mgr.a (mgr.14388) 637 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:21 smithi044 bash[22676]: audit 2024-09-20T22:29:20.385870+0000 mgr.a (mgr.14388) 636 : audit [DBG] from='client.27150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:21 smithi044 bash[22676]: cluster 2024-09-20T22:29:20.958699+0000 mgr.a (mgr.14388) 637 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:29:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:24 smithi049 bash[23528]: cluster 2024-09-20T22:29:22.959562+0000 mgr.a (mgr.14388) 638 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:24 smithi049 bash[23528]: audit 2024-09-20T22:29:23.392667+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:24 smithi049 bash[23528]: audit 2024-09-20T22:29:23.401063+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:24 smithi049 bash[23528]: audit 2024-09-20T22:29:23.411781+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:24 smithi049 bash[23528]: audit 2024-09-20T22:29:23.510058+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:24 smithi049 bash[23528]: audit 2024-09-20T22:29:23.515699+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:24 smithi049 bash[23528]: audit 2024-09-20T22:29:23.521929+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:24 smithi044 bash[22676]: cluster 2024-09-20T22:29:22.959562+0000 mgr.a (mgr.14388) 638 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:24 smithi044 bash[22676]: audit 2024-09-20T22:29:23.392667+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:24 smithi044 bash[22676]: audit 2024-09-20T22:29:23.401063+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:24 smithi044 bash[22676]: audit 2024-09-20T22:29:23.411781+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:24 smithi044 bash[22676]: audit 2024-09-20T22:29:23.510058+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:24 smithi044 bash[22676]: audit 2024-09-20T22:29:23.515699+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:24 smithi044 bash[22676]: audit 2024-09-20T22:29:23.521929+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:24 smithi179 bash[23186]: cluster 2024-09-20T22:29:22.959562+0000 mgr.a (mgr.14388) 638 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:24.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:24 smithi179 bash[23186]: audit 2024-09-20T22:29:23.392667+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:24 smithi179 bash[23186]: audit 2024-09-20T22:29:23.401063+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:24 smithi179 bash[23186]: audit 2024-09-20T22:29:23.411781+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:24 smithi179 bash[23186]: audit 2024-09-20T22:29:23.510058+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:24 smithi179 bash[23186]: audit 2024-09-20T22:29:23.515699+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:24.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:24 smithi179 bash[23186]: audit 2024-09-20T22:29:23.521929+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:25.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:25.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:26 smithi049 bash[23528]: cluster 2024-09-20T22:29:24.960328+0000 mgr.a (mgr.14388) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:26 smithi049 bash[23528]: audit 2024-09-20T22:29:25.679867+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:26 smithi049 bash[23528]: audit 2024-09-20T22:29:25.686830+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:26 smithi049 bash[23528]: audit 2024-09-20T22:29:25.694706+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:26 smithi044 bash[22676]: cluster 2024-09-20T22:29:24.960328+0000 mgr.a (mgr.14388) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:26 smithi044 bash[22676]: audit 2024-09-20T22:29:25.679867+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:26 smithi044 bash[22676]: audit 2024-09-20T22:29:25.686830+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:26 smithi044 bash[22676]: audit 2024-09-20T22:29:25.694706+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:26 smithi179 bash[23186]: cluster 2024-09-20T22:29:24.960328+0000 mgr.a (mgr.14388) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:26.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:26 smithi179 bash[23186]: audit 2024-09-20T22:29:25.679867+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:26 smithi179 bash[23186]: audit 2024-09-20T22:29:25.686830+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:26 smithi179 bash[23186]: audit 2024-09-20T22:29:25.694706+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:26.560 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:26.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:26.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:26.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:26.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:27 smithi044 bash[22676]: audit 2024-09-20T22:29:26.128022+0000 mgr.a (mgr.14388) 640 : audit [DBG] from='client.27225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:27 smithi044 bash[22676]: cluster 2024-09-20T22:29:26.963104+0000 mgr.a (mgr.14388) 641 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:27 smithi179 bash[23186]: audit 2024-09-20T22:29:26.128022+0000 mgr.a (mgr.14388) 640 : audit [DBG] from='client.27225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:27 smithi179 bash[23186]: cluster 2024-09-20T22:29:26.963104+0000 mgr.a (mgr.14388) 641 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:27.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:27 smithi049 bash[23528]: audit 2024-09-20T22:29:26.128022+0000 mgr.a (mgr.14388) 640 : audit [DBG] from='client.27225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:27.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:27 smithi049 bash[23528]: cluster 2024-09-20T22:29:26.963104+0000 mgr.a (mgr.14388) 641 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:30.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:30 smithi049 bash[23528]: cluster 2024-09-20T22:29:28.963952+0000 mgr.a (mgr.14388) 642 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T22:29:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:30 smithi044 bash[22676]: cluster 2024-09-20T22:29:28.963952+0000 mgr.a (mgr.14388) 642 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T22:29:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:30 smithi179 bash[23186]: cluster 2024-09-20T22:29:28.963952+0000 mgr.a (mgr.14388) 642 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T22:29:31.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:31.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:31.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:32.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:32 smithi049 bash[23528]: cluster 2024-09-20T22:29:30.966050+0000 mgr.a (mgr.14388) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:29:32.337 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:32 smithi044 bash[22676]: cluster 2024-09-20T22:29:30.966050+0000 mgr.a (mgr.14388) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:29:32.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:32 smithi179 bash[23186]: cluster 2024-09-20T22:29:30.966050+0000 mgr.a (mgr.14388) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:29:33.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:33 smithi049 bash[23528]: audit 2024-09-20T22:29:31.901508+0000 mgr.a (mgr.14388) 644 : audit [DBG] from='client.27300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:33.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:33 smithi049 bash[23528]: cluster 2024-09-20T22:29:32.967106+0000 mgr.a (mgr.14388) 645 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:33 smithi044 bash[22676]: audit 2024-09-20T22:29:31.901508+0000 mgr.a (mgr.14388) 644 : audit [DBG] from='client.27300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:33 smithi044 bash[22676]: cluster 2024-09-20T22:29:32.967106+0000 mgr.a (mgr.14388) 645 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:33.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:33 smithi179 bash[23186]: audit 2024-09-20T22:29:31.901508+0000 mgr.a (mgr.14388) 644 : audit [DBG] from='client.27300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:33.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:33 smithi179 bash[23186]: cluster 2024-09-20T22:29:32.967106+0000 mgr.a (mgr.14388) 645 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:36.281 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:36 smithi049 bash[23528]: cluster 2024-09-20T22:29:34.967936+0000 mgr.a (mgr.14388) 646 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:36 smithi044 bash[22676]: cluster 2024-09-20T22:29:34.967936+0000 mgr.a (mgr.14388) 646 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:36.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:36 smithi179 bash[23186]: cluster 2024-09-20T22:29:34.967936+0000 mgr.a (mgr.14388) 646 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:37.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:37.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:37.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:37 smithi044 bash[22676]: cluster 2024-09-20T22:29:36.970211+0000 mgr.a (mgr.14388) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:37.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:37 smithi179 bash[23186]: cluster 2024-09-20T22:29:36.970211+0000 mgr.a (mgr.14388) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:37 smithi049 bash[23528]: cluster 2024-09-20T22:29:36.970211+0000 mgr.a (mgr.14388) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:38.094 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:38.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:38.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:38.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:38.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:38 smithi044 bash[22676]: audit 2024-09-20T22:29:37.673985+0000 mgr.a (mgr.14388) 648 : audit [DBG] from='client.27375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:38.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:38 smithi179 bash[23186]: audit 2024-09-20T22:29:37.673985+0000 mgr.a (mgr.14388) 648 : audit [DBG] from='client.27375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:38.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:38 smithi049 bash[23528]: audit 2024-09-20T22:29:37.673985+0000 mgr.a (mgr.14388) 648 : audit [DBG] from='client.27375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:39 smithi044 bash[22676]: cluster 2024-09-20T22:29:38.971315+0000 mgr.a (mgr.14388) 649 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:39.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:39 smithi179 bash[23186]: cluster 2024-09-20T22:29:38.971315+0000 mgr.a (mgr.14388) 649 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:39.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:39 smithi049 bash[23528]: cluster 2024-09-20T22:29:38.971315+0000 mgr.a (mgr.14388) 649 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:41 smithi044 bash[22676]: cluster 2024-09-20T22:29:40.973751+0000 mgr.a (mgr.14388) 650 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:41.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:41 smithi179 bash[23186]: cluster 2024-09-20T22:29:40.973751+0000 mgr.a (mgr.14388) 650 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:41.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:41 smithi049 bash[23528]: cluster 2024-09-20T22:29:40.973751+0000 mgr.a (mgr.14388) 650 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:43.232 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:43 smithi179 bash[23186]: cluster 2024-09-20T22:29:42.974686+0000 mgr.a (mgr.14388) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:43 smithi044 bash[22676]: cluster 2024-09-20T22:29:42.974686+0000 mgr.a (mgr.14388) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:43.544 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:43 smithi049 bash[23528]: cluster 2024-09-20T22:29:42.974686+0000 mgr.a (mgr.14388) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:43.842 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:43.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:43.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:44.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:44 smithi044 bash[22676]: audit 2024-09-20T22:29:43.425454+0000 mgr.a (mgr.14388) 652 : audit [DBG] from='client.27450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:44.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:44 smithi044 bash[22676]: audit 2024-09-20T22:29:43.569782+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:44 smithi044 bash[22676]: audit 2024-09-20T22:29:43.574098+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:44 smithi044 bash[22676]: audit 2024-09-20T22:29:43.579152+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:44 smithi044 bash[22676]: audit 2024-09-20T22:29:43.710442+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:44 smithi044 bash[22676]: audit 2024-09-20T22:29:43.715739+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:44 smithi044 bash[22676]: audit 2024-09-20T22:29:43.723110+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:44 smithi179 bash[23186]: audit 2024-09-20T22:29:43.425454+0000 mgr.a (mgr.14388) 652 : audit [DBG] from='client.27450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:44.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:44 smithi179 bash[23186]: audit 2024-09-20T22:29:43.569782+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:44 smithi179 bash[23186]: audit 2024-09-20T22:29:43.574098+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:44 smithi179 bash[23186]: audit 2024-09-20T22:29:43.579152+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:44 smithi179 bash[23186]: audit 2024-09-20T22:29:43.710442+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:44 smithi179 bash[23186]: audit 2024-09-20T22:29:43.715739+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:44.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:44 smithi179 bash[23186]: audit 2024-09-20T22:29:43.723110+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:44 smithi049 bash[23528]: audit 2024-09-20T22:29:43.425454+0000 mgr.a (mgr.14388) 652 : audit [DBG] from='client.27450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:44 smithi049 bash[23528]: audit 2024-09-20T22:29:43.569782+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:44 smithi049 bash[23528]: audit 2024-09-20T22:29:43.574098+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:44 smithi049 bash[23528]: audit 2024-09-20T22:29:43.579152+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:44 smithi049 bash[23528]: audit 2024-09-20T22:29:43.710442+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:44 smithi049 bash[23528]: audit 2024-09-20T22:29:43.715739+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:44 smithi049 bash[23528]: audit 2024-09-20T22:29:43.723110+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:45.774 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:45 smithi044 bash[22676]: cluster 2024-09-20T22:29:44.975840+0000 mgr.a (mgr.14388) 653 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:45 smithi179 bash[23186]: cluster 2024-09-20T22:29:44.975840+0000 mgr.a (mgr.14388) 653 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:46.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:45 smithi049 bash[23528]: cluster 2024-09-20T22:29:44.975840+0000 mgr.a (mgr.14388) 653 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:46 smithi044 bash[22676]: audit 2024-09-20T22:29:45.841675+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:46 smithi044 bash[22676]: audit 2024-09-20T22:29:45.847556+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:46 smithi044 bash[22676]: audit 2024-09-20T22:29:45.854348+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:46 smithi179 bash[23186]: audit 2024-09-20T22:29:45.841675+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:46 smithi179 bash[23186]: audit 2024-09-20T22:29:45.847556+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:46 smithi179 bash[23186]: audit 2024-09-20T22:29:45.854348+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:46 smithi049 bash[23528]: audit 2024-09-20T22:29:45.841675+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:46 smithi049 bash[23528]: audit 2024-09-20T22:29:45.847556+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:47.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:46 smithi049 bash[23528]: audit 2024-09-20T22:29:45.854348+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:29:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:47 smithi044 bash[22676]: cluster 2024-09-20T22:29:46.977373+0000 mgr.a (mgr.14388) 654 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:48.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:47 smithi179 bash[23186]: cluster 2024-09-20T22:29:46.977373+0000 mgr.a (mgr.14388) 654 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:48.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:47 smithi049 bash[23528]: cluster 2024-09-20T22:29:46.977373+0000 mgr.a (mgr.14388) 654 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:48.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:49 smithi044 bash[22676]: cluster 2024-09-20T22:29:48.977791+0000 mgr.a (mgr.14388) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:49.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:49 smithi179 bash[23186]: cluster 2024-09-20T22:29:48.977791+0000 mgr.a (mgr.14388) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:49.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:49 smithi049 bash[23528]: cluster 2024-09-20T22:29:48.977791+0000 mgr.a (mgr.14388) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:49.608 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:49.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:49.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:49.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:49.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:50.446 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:50 smithi049 bash[23528]: audit 2024-09-20T22:29:49.180155+0000 mgr.a (mgr.14388) 656 : audit [DBG] from='client.27525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:50 smithi044 bash[22676]: audit 2024-09-20T22:29:49.180155+0000 mgr.a (mgr.14388) 656 : audit [DBG] from='client.27525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:50.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:50 smithi179 bash[23186]: audit 2024-09-20T22:29:49.180155+0000 mgr.a (mgr.14388) 656 : audit [DBG] from='client.27525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:51.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:51 smithi049 bash[23528]: cluster 2024-09-20T22:29:50.980112+0000 mgr.a (mgr.14388) 657 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:51 smithi044 bash[22676]: cluster 2024-09-20T22:29:50.980112+0000 mgr.a (mgr.14388) 657 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:51.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:51 smithi179 bash[23186]: cluster 2024-09-20T22:29:50.980112+0000 mgr.a (mgr.14388) 657 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:29:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:53 smithi044 bash[22676]: cluster 2024-09-20T22:29:52.980886+0000 mgr.a (mgr.14388) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:53.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:53 smithi179 bash[23186]: cluster 2024-09-20T22:29:52.980886+0000 mgr.a (mgr.14388) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:53.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:53 smithi049 bash[23528]: cluster 2024-09-20T22:29:52.980886+0000 mgr.a (mgr.14388) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:54.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:29:54.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:29:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:29:55.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:29:55.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:29:55.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:29:55.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:29:55.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:29:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:55 smithi044 bash[22676]: audit 2024-09-20T22:29:54.941465+0000 mgr.a (mgr.14388) 659 : audit [DBG] from='client.27603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:55 smithi044 bash[22676]: cluster 2024-09-20T22:29:54.982058+0000 mgr.a (mgr.14388) 660 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:55.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:55 smithi179 bash[23186]: audit 2024-09-20T22:29:54.941465+0000 mgr.a (mgr.14388) 659 : audit [DBG] from='client.27603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:55.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:55 smithi179 bash[23186]: cluster 2024-09-20T22:29:54.982058+0000 mgr.a (mgr.14388) 660 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:55.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:55 smithi049 bash[23528]: audit 2024-09-20T22:29:54.941465+0000 mgr.a (mgr.14388) 659 : audit [DBG] from='client.27603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:29:55.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:55 smithi049 bash[23528]: cluster 2024-09-20T22:29:54.982058+0000 mgr.a (mgr.14388) 660 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:57.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:57 smithi049 bash[23528]: cluster 2024-09-20T22:29:56.984799+0000 mgr.a (mgr.14388) 661 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:57 smithi044 bash[22676]: cluster 2024-09-20T22:29:56.984799+0000 mgr.a (mgr.14388) 661 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:57.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:57 smithi179 bash[23186]: cluster 2024-09-20T22:29:56.984799+0000 mgr.a (mgr.14388) 661 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:29:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:29:59 smithi044 bash[22676]: cluster 2024-09-20T22:29:58.985595+0000 mgr.a (mgr.14388) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:59.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:29:59 smithi179 bash[23186]: cluster 2024-09-20T22:29:58.985595+0000 mgr.a (mgr.14388) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:29:59.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:29:59 smithi049 bash[23528]: cluster 2024-09-20T22:29:58.985595+0000 mgr.a (mgr.14388) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:30:00.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:00.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:00.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:00 smithi044 bash[22676]: cluster 2024-09-20T22:30:00.000153+0000 mon.a (mon.0) 1324 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:30:00.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:00 smithi179 bash[23186]: cluster 2024-09-20T22:30:00.000153+0000 mon.a (mon.0) 1324 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:30:00.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:00 smithi049 bash[23528]: cluster 2024-09-20T22:30:00.000153+0000 mon.a (mon.0) 1324 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:30:01.132 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:01 smithi044 bash[22676]: audit 2024-09-20T22:30:00.689573+0000 mgr.a (mgr.14388) 663 : audit [DBG] from='client.27678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:01 smithi044 bash[22676]: cluster 2024-09-20T22:30:00.986915+0000 mgr.a (mgr.14388) 664 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:01.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:01 smithi179 bash[23186]: audit 2024-09-20T22:30:00.689573+0000 mgr.a (mgr.14388) 663 : audit [DBG] from='client.27678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:01.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:01 smithi179 bash[23186]: cluster 2024-09-20T22:30:00.986915+0000 mgr.a (mgr.14388) 664 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:01.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:01 smithi049 bash[23528]: audit 2024-09-20T22:30:00.689573+0000 mgr.a (mgr.14388) 663 : audit [DBG] from='client.27678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:01.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:01 smithi049 bash[23528]: cluster 2024-09-20T22:30:00.986915+0000 mgr.a (mgr.14388) 664 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:03.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:03 smithi179 bash[23186]: cluster 2024-09-20T22:30:02.987763+0000 mgr.a (mgr.14388) 665 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:30:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:03 smithi044 bash[22676]: cluster 2024-09-20T22:30:02.987763+0000 mgr.a (mgr.14388) 665 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:30:03.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:03 smithi049 bash[23528]: cluster 2024-09-20T22:30:02.987763+0000 mgr.a (mgr.14388) 665 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:30:04.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:04 smithi179 bash[23186]: audit 2024-09-20T22:30:03.742529+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:04.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:04 smithi179 bash[23186]: audit 2024-09-20T22:30:03.752131+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:04.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:04 smithi179 bash[23186]: audit 2024-09-20T22:30:03.763649+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:04.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:04 smithi179 bash[23186]: audit 2024-09-20T22:30:03.936741+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:04.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:04 smithi179 bash[23186]: audit 2024-09-20T22:30:03.945365+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:04.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:04 smithi179 bash[23186]: audit 2024-09-20T22:30:03.955512+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:04 smithi044 bash[22676]: audit 2024-09-20T22:30:03.742529+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:04 smithi044 bash[22676]: audit 2024-09-20T22:30:03.752131+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:04 smithi044 bash[22676]: audit 2024-09-20T22:30:03.763649+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:04 smithi044 bash[22676]: audit 2024-09-20T22:30:03.936741+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:04 smithi044 bash[22676]: audit 2024-09-20T22:30:03.945365+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:04 smithi044 bash[22676]: audit 2024-09-20T22:30:03.955512+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:04 smithi049 bash[23528]: audit 2024-09-20T22:30:03.742529+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:04 smithi049 bash[23528]: audit 2024-09-20T22:30:03.752131+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:04 smithi049 bash[23528]: audit 2024-09-20T22:30:03.763649+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:04 smithi049 bash[23528]: audit 2024-09-20T22:30:03.936741+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:04 smithi049 bash[23528]: audit 2024-09-20T22:30:03.945365+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:04 smithi049 bash[23528]: audit 2024-09-20T22:30:03.955512+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:05.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:05 smithi179 bash[23186]: cluster 2024-09-20T22:30:04.988330+0000 mgr.a (mgr.14388) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:30:06.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:05 smithi044 bash[22676]: cluster 2024-09-20T22:30:04.988330+0000 mgr.a (mgr.14388) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:30:06.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:05 smithi049 bash[23528]: cluster 2024-09-20T22:30:04.988330+0000 mgr.a (mgr.14388) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:30:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:06.935 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:07 smithi044 bash[22676]: audit 2024-09-20T22:30:06.022281+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:07 smithi044 bash[22676]: audit 2024-09-20T22:30:06.027594+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:07 smithi044 bash[22676]: audit 2024-09-20T22:30:06.033297+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:07 smithi049 bash[23528]: audit 2024-09-20T22:30:06.022281+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:07 smithi049 bash[23528]: audit 2024-09-20T22:30:06.027594+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:07 smithi049 bash[23528]: audit 2024-09-20T22:30:06.033297+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:07 smithi179 bash[23186]: audit 2024-09-20T22:30:06.022281+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:07 smithi179 bash[23186]: audit 2024-09-20T22:30:06.027594+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:07 smithi179 bash[23186]: audit 2024-09-20T22:30:06.033297+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:08 smithi049 bash[23528]: audit 2024-09-20T22:30:06.477314+0000 mgr.a (mgr.14388) 667 : audit [DBG] from='client.27753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:08.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:08 smithi049 bash[23528]: cluster 2024-09-20T22:30:06.991018+0000 mgr.a (mgr.14388) 668 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:08 smithi044 bash[22676]: audit 2024-09-20T22:30:06.477314+0000 mgr.a (mgr.14388) 667 : audit [DBG] from='client.27753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:08 smithi044 bash[22676]: cluster 2024-09-20T22:30:06.991018+0000 mgr.a (mgr.14388) 668 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:08.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:08 smithi179 bash[23186]: audit 2024-09-20T22:30:06.477314+0000 mgr.a (mgr.14388) 667 : audit [DBG] from='client.27753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:08.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:08 smithi179 bash[23186]: cluster 2024-09-20T22:30:06.991018+0000 mgr.a (mgr.14388) 668 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:09.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:09 smithi049 bash[23528]: audit 2024-09-20T22:30:08.957145+0000 mon.a (mon.0) 1334 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:30:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:09 smithi044 bash[22676]: audit 2024-09-20T22:30:08.957145+0000 mon.a (mon.0) 1334 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:30:09.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:09 smithi179 bash[23186]: audit 2024-09-20T22:30:08.957145+0000 mon.a (mon.0) 1334 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:30:10.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: cluster 2024-09-20T22:30:08.991620+0000 mgr.a (mgr.14388) 669 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:10.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.564058+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.569644+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.573777+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.578748+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.580046+0000 mon.a (mon.0) 1339 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:30:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.580808+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:30:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.588721+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:10 smithi049 bash[23528]: audit 2024-09-20T22:30:09.591524+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:30:10.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22930]: debug 2024-09-20T22:30:10.266+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:30:10.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22930]: debug 2024-09-20T22:30:10.266+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:30:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: cluster 2024-09-20T22:30:08.991620+0000 mgr.a (mgr.14388) 669 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.564058+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.569644+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.573777+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.578748+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.580046+0000 mon.a (mon.0) 1339 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.580808+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.588721+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:10 smithi044 bash[22676]: audit 2024-09-20T22:30:09.591524+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:30:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: cluster 2024-09-20T22:30:08.991620+0000 mgr.a (mgr.14388) 669 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.564058+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.569644+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.573777+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.578748+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.580046+0000 mon.a (mon.0) 1339 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:30:10.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.580808+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:30:10.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.588721+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:10.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:10 smithi179 bash[23186]: audit 2024-09-20T22:30:09.591524+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:30:11.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:11 smithi049 bash[23528]: audit 2024-09-20T22:30:09.593644+0000 mgr.a (mgr.14388) 670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:30:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:11 smithi044 bash[22676]: audit 2024-09-20T22:30:09.593644+0000 mgr.a (mgr.14388) 670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:30:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:11 smithi179 bash[23186]: audit 2024-09-20T22:30:09.593644+0000 mgr.a (mgr.14388) 670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:30:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:11.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:11.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:12.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:12 smithi049 bash[23528]: audit 2024-09-20T22:30:10.270756+0000 mgr.a (mgr.14388) 671 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:30:12.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:12 smithi049 bash[23528]: cephadm 2024-09-20T22:30:10.271940+0000 mgr.a (mgr.14388) 672 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:30:12.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:12 smithi049 bash[23528]: cluster 2024-09-20T22:30:10.994374+0000 mgr.a (mgr.14388) 673 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:30:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:12 smithi044 bash[22676]: audit 2024-09-20T22:30:10.270756+0000 mgr.a (mgr.14388) 671 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:30:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:12 smithi044 bash[22676]: cephadm 2024-09-20T22:30:10.271940+0000 mgr.a (mgr.14388) 672 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:30:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:12 smithi044 bash[22676]: cluster 2024-09-20T22:30:10.994374+0000 mgr.a (mgr.14388) 673 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:30:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:12 smithi179 bash[23186]: audit 2024-09-20T22:30:10.270756+0000 mgr.a (mgr.14388) 671 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:30:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:12 smithi179 bash[23186]: cephadm 2024-09-20T22:30:10.271940+0000 mgr.a (mgr.14388) 672 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:30:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:12 smithi179 bash[23186]: cluster 2024-09-20T22:30:10.994374+0000 mgr.a (mgr.14388) 673 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:30:12.680 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:13 smithi044 bash[22676]: audit 2024-09-20T22:30:12.269837+0000 mgr.a (mgr.14388) 674 : audit [DBG] from='client.27936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:13 smithi044 bash[22676]: cluster 2024-09-20T22:30:12.995383+0000 mgr.a (mgr.14388) 675 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T22:30:13.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:13 smithi179 bash[23186]: audit 2024-09-20T22:30:12.269837+0000 mgr.a (mgr.14388) 674 : audit [DBG] from='client.27936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:13.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:13 smithi179 bash[23186]: cluster 2024-09-20T22:30:12.995383+0000 mgr.a (mgr.14388) 675 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T22:30:13.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:13 smithi049 bash[23528]: audit 2024-09-20T22:30:12.269837+0000 mgr.a (mgr.14388) 674 : audit [DBG] from='client.27936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:13.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:13 smithi049 bash[23528]: cluster 2024-09-20T22:30:12.995383+0000 mgr.a (mgr.14388) 675 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T22:30:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:15 smithi044 bash[22676]: cluster 2024-09-20T22:30:14.996166+0000 mgr.a (mgr.14388) 676 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T22:30:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:15 smithi179 bash[23186]: cluster 2024-09-20T22:30:14.996166+0000 mgr.a (mgr.14388) 676 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T22:30:15.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:15 smithi049 bash[23528]: cluster 2024-09-20T22:30:14.996166+0000 mgr.a (mgr.14388) 676 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T22:30:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:17 smithi044 bash[22676]: cluster 2024-09-20T22:30:16.998438+0000 mgr.a (mgr.14388) 677 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:17.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:17 smithi179 bash[23186]: cluster 2024-09-20T22:30:16.998438+0000 mgr.a (mgr.14388) 677 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:17.499 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:17 smithi049 bash[23528]: cluster 2024-09-20T22:30:16.998438+0000 mgr.a (mgr.14388) 677 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:17.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:17.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:17.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:18 smithi044 bash[22676]: audit 2024-09-20T22:30:18.020807+0000 mgr.a (mgr.14388) 678 : audit [DBG] from='client.28014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:18.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:18 smithi179 bash[23186]: audit 2024-09-20T22:30:18.020807+0000 mgr.a (mgr.14388) 678 : audit [DBG] from='client.28014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:18.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:18 smithi049 bash[23528]: audit 2024-09-20T22:30:18.020807+0000 mgr.a (mgr.14388) 678 : audit [DBG] from='client.28014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:19 smithi044 bash[22676]: cluster 2024-09-20T22:30:18.999419+0000 mgr.a (mgr.14388) 679 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:19.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:19 smithi179 bash[23186]: cluster 2024-09-20T22:30:18.999419+0000 mgr.a (mgr.14388) 679 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:19.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:19 smithi049 bash[23528]: cluster 2024-09-20T22:30:18.999419+0000 mgr.a (mgr.14388) 679 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:21 smithi044 bash[22676]: cluster 2024-09-20T22:30:21.001692+0000 mgr.a (mgr.14388) 680 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:21.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:21 smithi179 bash[23186]: cluster 2024-09-20T22:30:21.001692+0000 mgr.a (mgr.14388) 680 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:21.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:21 smithi049 bash[23528]: cluster 2024-09-20T22:30:21.001692+0000 mgr.a (mgr.14388) 680 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:30:23.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:23 smithi179 bash[23186]: cluster 2024-09-20T22:30:23.002446+0000 mgr.a (mgr.14388) 681 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:30:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:23.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:23.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:23 smithi044 bash[22676]: cluster 2024-09-20T22:30:23.002446+0000 mgr.a (mgr.14388) 681 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:30:23.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:23 smithi049 bash[23528]: cluster 2024-09-20T22:30:23.002446+0000 mgr.a (mgr.14388) 681 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:30:24.242 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:24.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:24.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:24.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:24.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:24 smithi179 bash[23186]: audit 2024-09-20T22:30:23.801402+0000 mgr.a (mgr.14388) 682 : audit [DBG] from='client.28092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:24 smithi179 bash[23186]: audit 2024-09-20T22:30:23.905117+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:24 smithi179 bash[23186]: audit 2024-09-20T22:30:23.910643+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:24 smithi179 bash[23186]: audit 2024-09-20T22:30:23.917106+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:24 smithi179 bash[23186]: audit 2024-09-20T22:30:24.152404+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:24 smithi179 bash[23186]: audit 2024-09-20T22:30:24.158772+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:24 smithi179 bash[23186]: audit 2024-09-20T22:30:24.169393+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:24 smithi044 bash[22676]: audit 2024-09-20T22:30:23.801402+0000 mgr.a (mgr.14388) 682 : audit [DBG] from='client.28092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:24 smithi044 bash[22676]: audit 2024-09-20T22:30:23.905117+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:24 smithi044 bash[22676]: audit 2024-09-20T22:30:23.910643+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:24 smithi044 bash[22676]: audit 2024-09-20T22:30:23.917106+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:24 smithi044 bash[22676]: audit 2024-09-20T22:30:24.152404+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:24 smithi044 bash[22676]: audit 2024-09-20T22:30:24.158772+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:24 smithi044 bash[22676]: audit 2024-09-20T22:30:24.169393+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:24 smithi049 bash[23528]: audit 2024-09-20T22:30:23.801402+0000 mgr.a (mgr.14388) 682 : audit [DBG] from='client.28092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:25.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:24 smithi049 bash[23528]: audit 2024-09-20T22:30:23.905117+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:24 smithi049 bash[23528]: audit 2024-09-20T22:30:23.910643+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:24 smithi049 bash[23528]: audit 2024-09-20T22:30:23.917106+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:24 smithi049 bash[23528]: audit 2024-09-20T22:30:24.152404+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:24 smithi049 bash[23528]: audit 2024-09-20T22:30:24.158772+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:25.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:24 smithi049 bash[23528]: audit 2024-09-20T22:30:24.169393+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:26.156 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:25 smithi044 bash[22676]: cluster 2024-09-20T22:30:25.004678+0000 mgr.a (mgr.14388) 683 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:30:26.212 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:25 smithi179 bash[23186]: cluster 2024-09-20T22:30:25.004678+0000 mgr.a (mgr.14388) 683 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:30:26.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:25 smithi049 bash[23528]: cluster 2024-09-20T22:30:25.004678+0000 mgr.a (mgr.14388) 683 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:30:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:27 smithi044 bash[22676]: audit 2024-09-20T22:30:26.144967+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:27 smithi044 bash[22676]: audit 2024-09-20T22:30:26.150493+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:27 smithi044 bash[22676]: audit 2024-09-20T22:30:26.155892+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:27 smithi044 bash[22676]: cluster 2024-09-20T22:30:27.005551+0000 mgr.a (mgr.14388) 684 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:30:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:27 smithi179 bash[23186]: audit 2024-09-20T22:30:26.144967+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:27 smithi179 bash[23186]: audit 2024-09-20T22:30:26.150493+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:27 smithi179 bash[23186]: audit 2024-09-20T22:30:26.155892+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:27 smithi179 bash[23186]: cluster 2024-09-20T22:30:27.005551+0000 mgr.a (mgr.14388) 684 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:30:27.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:27 smithi049 bash[23528]: audit 2024-09-20T22:30:26.144967+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:27 smithi049 bash[23528]: audit 2024-09-20T22:30:26.150493+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:27 smithi049 bash[23528]: audit 2024-09-20T22:30:26.155892+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:27.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:27 smithi049 bash[23528]: cluster 2024-09-20T22:30:27.005551+0000 mgr.a (mgr.14388) 684 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:30:29.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:29.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:29.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:29 smithi044 bash[22676]: cluster 2024-09-20T22:30:29.006377+0000 mgr.a (mgr.14388) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:29.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:29 smithi179 bash[23186]: cluster 2024-09-20T22:30:29.006377+0000 mgr.a (mgr.14388) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:29.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:29 smithi049 bash[23528]: cluster 2024-09-20T22:30:29.006377+0000 mgr.a (mgr.14388) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:30.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:30.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:30.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:30.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:30.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:30 smithi044 bash[22676]: audit 2024-09-20T22:30:29.580511+0000 mgr.a (mgr.14388) 686 : audit [DBG] from='client.28170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:30 smithi179 bash[23186]: audit 2024-09-20T22:30:29.580511+0000 mgr.a (mgr.14388) 686 : audit [DBG] from='client.28170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:30.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:30 smithi049 bash[23528]: audit 2024-09-20T22:30:29.580511+0000 mgr.a (mgr.14388) 686 : audit [DBG] from='client.28170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:31.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:31 smithi049 bash[23528]: cluster 2024-09-20T22:30:31.009122+0000 mgr.a (mgr.14388) 687 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:30:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:31 smithi044 bash[22676]: cluster 2024-09-20T22:30:31.009122+0000 mgr.a (mgr.14388) 687 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:30:31.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:31 smithi179 bash[23186]: cluster 2024-09-20T22:30:31.009122+0000 mgr.a (mgr.14388) 687 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:30:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:33 smithi044 bash[22676]: cluster 2024-09-20T22:30:33.009902+0000 mgr.a (mgr.14388) 688 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:30:33.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:33 smithi179 bash[23186]: cluster 2024-09-20T22:30:33.009902+0000 mgr.a (mgr.14388) 688 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:30:33.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:33 smithi049 bash[23528]: cluster 2024-09-20T22:30:33.009902+0000 mgr.a (mgr.14388) 688 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:30:35.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:35.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:35.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:35 smithi044 bash[22676]: cluster 2024-09-20T22:30:35.011781+0000 mgr.a (mgr.14388) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:35.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:35 smithi179 bash[23186]: cluster 2024-09-20T22:30:35.011781+0000 mgr.a (mgr.14388) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:35.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:35 smithi049 bash[23528]: cluster 2024-09-20T22:30:35.011781+0000 mgr.a (mgr.14388) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:35.789 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:35.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:35.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:35.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:35.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:36 smithi044 bash[22676]: audit 2024-09-20T22:30:35.362055+0000 mgr.a (mgr.14388) 690 : audit [DBG] from='client.28242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:36.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:36 smithi179 bash[23186]: audit 2024-09-20T22:30:35.362055+0000 mgr.a (mgr.14388) 690 : audit [DBG] from='client.28242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:36.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:36 smithi049 bash[23528]: audit 2024-09-20T22:30:35.362055+0000 mgr.a (mgr.14388) 690 : audit [DBG] from='client.28242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:37 smithi044 bash[22676]: cluster 2024-09-20T22:30:37.012673+0000 mgr.a (mgr.14388) 691 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:30:37.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:37 smithi179 bash[23186]: cluster 2024-09-20T22:30:37.012673+0000 mgr.a (mgr.14388) 691 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:30:37.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:37 smithi049 bash[23528]: cluster 2024-09-20T22:30:37.012673+0000 mgr.a (mgr.14388) 691 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:30:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:39 smithi044 bash[22676]: cluster 2024-09-20T22:30:39.013481+0000 mgr.a (mgr.14388) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:30:39.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:39 smithi179 bash[23186]: cluster 2024-09-20T22:30:39.013481+0000 mgr.a (mgr.14388) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:30:39.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:39 smithi049 bash[23528]: cluster 2024-09-20T22:30:39.013481+0000 mgr.a (mgr.14388) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:30:40.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:40.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:41 smithi044 bash[22676]: cluster 2024-09-20T22:30:41.015580+0000 mgr.a (mgr.14388) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:41.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:41 smithi179 bash[23186]: cluster 2024-09-20T22:30:41.015580+0000 mgr.a (mgr.14388) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:41.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:41.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:41.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:41.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:41.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:41.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:41 smithi049 bash[23528]: cluster 2024-09-20T22:30:41.015580+0000 mgr.a (mgr.14388) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:42 smithi044 bash[22676]: audit 2024-09-20T22:30:41.122222+0000 mgr.a (mgr.14388) 694 : audit [DBG] from='client.28320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:42.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:42 smithi179 bash[23186]: audit 2024-09-20T22:30:41.122222+0000 mgr.a (mgr.14388) 694 : audit [DBG] from='client.28320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:42.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:42 smithi049 bash[23528]: audit 2024-09-20T22:30:41.122222+0000 mgr.a (mgr.14388) 694 : audit [DBG] from='client.28320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:43 smithi044 bash[22676]: cluster 2024-09-20T22:30:43.016473+0000 mgr.a (mgr.14388) 695 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:30:43.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:43 smithi179 bash[23186]: cluster 2024-09-20T22:30:43.016473+0000 mgr.a (mgr.14388) 695 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:30:43.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:43 smithi049 bash[23528]: cluster 2024-09-20T22:30:43.016473+0000 mgr.a (mgr.14388) 695 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:30:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:45 smithi044 bash[22676]: audit 2024-09-20T22:30:44.116498+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:45 smithi044 bash[22676]: audit 2024-09-20T22:30:44.125017+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:45 smithi044 bash[22676]: audit 2024-09-20T22:30:44.135215+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:45 smithi044 bash[22676]: audit 2024-09-20T22:30:44.382795+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:45 smithi044 bash[22676]: audit 2024-09-20T22:30:44.391371+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:45 smithi044 bash[22676]: audit 2024-09-20T22:30:44.401871+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:45 smithi044 bash[22676]: cluster 2024-09-20T22:30:45.018727+0000 mgr.a (mgr.14388) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:30:45.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:45 smithi179 bash[23186]: audit 2024-09-20T22:30:44.116498+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:45 smithi179 bash[23186]: audit 2024-09-20T22:30:44.125017+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:45 smithi179 bash[23186]: audit 2024-09-20T22:30:44.135215+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:45 smithi179 bash[23186]: audit 2024-09-20T22:30:44.382795+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:45 smithi179 bash[23186]: audit 2024-09-20T22:30:44.391371+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:45 smithi179 bash[23186]: audit 2024-09-20T22:30:44.401871+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:45 smithi179 bash[23186]: cluster 2024-09-20T22:30:45.018727+0000 mgr.a (mgr.14388) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:30:45.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:45 smithi049 bash[23528]: audit 2024-09-20T22:30:44.116498+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:45 smithi049 bash[23528]: audit 2024-09-20T22:30:44.125017+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:45 smithi049 bash[23528]: audit 2024-09-20T22:30:44.135215+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:45 smithi049 bash[23528]: audit 2024-09-20T22:30:44.382795+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:45 smithi049 bash[23528]: audit 2024-09-20T22:30:44.391371+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:45 smithi049 bash[23528]: audit 2024-09-20T22:30:44.401871+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:45.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:45 smithi049 bash[23528]: cluster 2024-09-20T22:30:45.018727+0000 mgr.a (mgr.14388) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:30:46.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:46.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:46.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:47.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:47 smithi179 bash[23186]: audit 2024-09-20T22:30:46.313734+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:47 smithi179 bash[23186]: audit 2024-09-20T22:30:46.319534+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:47 smithi179 bash[23186]: audit 2024-09-20T22:30:46.327027+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:47 smithi179 bash[23186]: audit 2024-09-20T22:30:46.877121+0000 mgr.a (mgr.14388) 697 : audit [DBG] from='client.28398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:47 smithi179 bash[23186]: cluster 2024-09-20T22:30:47.019329+0000 mgr.a (mgr.14388) 698 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:47 smithi044 bash[22676]: audit 2024-09-20T22:30:46.313734+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:47 smithi044 bash[22676]: audit 2024-09-20T22:30:46.319534+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:47 smithi044 bash[22676]: audit 2024-09-20T22:30:46.327027+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:47 smithi044 bash[22676]: audit 2024-09-20T22:30:46.877121+0000 mgr.a (mgr.14388) 697 : audit [DBG] from='client.28398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:47 smithi044 bash[22676]: cluster 2024-09-20T22:30:47.019329+0000 mgr.a (mgr.14388) 698 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:47.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:47 smithi049 bash[23528]: audit 2024-09-20T22:30:46.313734+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:47 smithi049 bash[23528]: audit 2024-09-20T22:30:46.319534+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:47 smithi049 bash[23528]: audit 2024-09-20T22:30:46.327027+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:30:47.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:47 smithi049 bash[23528]: audit 2024-09-20T22:30:46.877121+0000 mgr.a (mgr.14388) 697 : audit [DBG] from='client.28398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:47.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:47 smithi049 bash[23528]: cluster 2024-09-20T22:30:47.019329+0000 mgr.a (mgr.14388) 698 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:49 smithi044 bash[22676]: cluster 2024-09-20T22:30:49.019915+0000 mgr.a (mgr.14388) 699 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:49.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:49 smithi179 bash[23186]: cluster 2024-09-20T22:30:49.019915+0000 mgr.a (mgr.14388) 699 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:49.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:49 smithi049 bash[23528]: cluster 2024-09-20T22:30:49.019915+0000 mgr.a (mgr.14388) 699 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:51 smithi044 bash[22676]: cluster 2024-09-20T22:30:51.022142+0000 mgr.a (mgr.14388) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:30:51.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:51 smithi179 bash[23186]: cluster 2024-09-20T22:30:51.022142+0000 mgr.a (mgr.14388) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:30:51.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:51 smithi049 bash[23528]: cluster 2024-09-20T22:30:51.022142+0000 mgr.a (mgr.14388) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:30:52.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:52.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:52.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:53.085 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:53.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:53.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:53.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:53.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:53 smithi044 bash[22676]: audit 2024-09-20T22:30:52.653286+0000 mgr.a (mgr.14388) 701 : audit [DBG] from='client.28473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:53 smithi044 bash[22676]: cluster 2024-09-20T22:30:53.023142+0000 mgr.a (mgr.14388) 702 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:53.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:53 smithi179 bash[23186]: audit 2024-09-20T22:30:52.653286+0000 mgr.a (mgr.14388) 701 : audit [DBG] from='client.28473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:53.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:53 smithi179 bash[23186]: cluster 2024-09-20T22:30:53.023142+0000 mgr.a (mgr.14388) 702 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:53.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:53 smithi049 bash[23528]: audit 2024-09-20T22:30:52.653286+0000 mgr.a (mgr.14388) 701 : audit [DBG] from='client.28473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:53.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:53 smithi049 bash[23528]: cluster 2024-09-20T22:30:53.023142+0000 mgr.a (mgr.14388) 702 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:55 smithi044 bash[22676]: cluster 2024-09-20T22:30:55.025240+0000 mgr.a (mgr.14388) 703 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:30:55.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:55 smithi179 bash[23186]: cluster 2024-09-20T22:30:55.025240+0000 mgr.a (mgr.14388) 703 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:30:55.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:55 smithi049 bash[23528]: cluster 2024-09-20T22:30:55.025240+0000 mgr.a (mgr.14388) 703 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:30:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:57 smithi044 bash[22676]: cluster 2024-09-20T22:30:57.026042+0000 mgr.a (mgr.14388) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:57.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:57 smithi179 bash[23186]: cluster 2024-09-20T22:30:57.026042+0000 mgr.a (mgr.14388) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:57.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:57 smithi049 bash[23528]: cluster 2024-09-20T22:30:57.026042+0000 mgr.a (mgr.14388) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:58.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:30:58.087 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:30:58.087 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:30:58.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:30:58.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:30:58.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:30:58.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:30:58.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:30:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:59 smithi044 bash[22676]: audit 2024-09-20T22:30:58.417390+0000 mgr.a (mgr.14388) 705 : audit [DBG] from='client.28551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:30:59 smithi044 bash[22676]: cluster 2024-09-20T22:30:59.027021+0000 mgr.a (mgr.14388) 706 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:59.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:59 smithi179 bash[23186]: audit 2024-09-20T22:30:58.417390+0000 mgr.a (mgr.14388) 705 : audit [DBG] from='client.28551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:59.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:30:59 smithi179 bash[23186]: cluster 2024-09-20T22:30:59.027021+0000 mgr.a (mgr.14388) 706 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:30:59.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:59 smithi049 bash[23528]: audit 2024-09-20T22:30:58.417390+0000 mgr.a (mgr.14388) 705 : audit [DBG] from='client.28551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:30:59.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:30:59 smithi049 bash[23528]: cluster 2024-09-20T22:30:59.027021+0000 mgr.a (mgr.14388) 706 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:01 smithi044 bash[22676]: cluster 2024-09-20T22:31:01.029297+0000 mgr.a (mgr.14388) 707 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:01.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:01 smithi179 bash[23186]: cluster 2024-09-20T22:31:01.029297+0000 mgr.a (mgr.14388) 707 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:01.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:01 smithi049 bash[23528]: cluster 2024-09-20T22:31:01.029297+0000 mgr.a (mgr.14388) 707 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:03 smithi044 bash[22676]: cluster 2024-09-20T22:31:03.030062+0000 mgr.a (mgr.14388) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:03.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:03 smithi179 bash[23186]: cluster 2024-09-20T22:31:03.030062+0000 mgr.a (mgr.14388) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:03.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:03 smithi049 bash[23528]: cluster 2024-09-20T22:31:03.030062+0000 mgr.a (mgr.14388) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:03.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:04.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:04.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:05.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: audit 2024-09-20T22:31:04.163514+0000 mgr.a (mgr.14388) 709 : audit [DBG] from='client.28626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:05.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: audit 2024-09-20T22:31:04.258939+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: audit 2024-09-20T22:31:04.264644+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: audit 2024-09-20T22:31:04.269717+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: audit 2024-09-20T22:31:04.594856+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: audit 2024-09-20T22:31:04.600417+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: audit 2024-09-20T22:31:04.606737+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:05 smithi049 bash[23528]: cluster 2024-09-20T22:31:05.032305+0000 mgr.a (mgr.14388) 710 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: audit 2024-09-20T22:31:04.163514+0000 mgr.a (mgr.14388) 709 : audit [DBG] from='client.28626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: audit 2024-09-20T22:31:04.258939+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: audit 2024-09-20T22:31:04.264644+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: audit 2024-09-20T22:31:04.269717+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: audit 2024-09-20T22:31:04.594856+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: audit 2024-09-20T22:31:04.600417+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: audit 2024-09-20T22:31:04.606737+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:05 smithi179 bash[23186]: cluster 2024-09-20T22:31:05.032305+0000 mgr.a (mgr.14388) 710 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: audit 2024-09-20T22:31:04.163514+0000 mgr.a (mgr.14388) 709 : audit [DBG] from='client.28626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: audit 2024-09-20T22:31:04.258939+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: audit 2024-09-20T22:31:04.264644+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: audit 2024-09-20T22:31:04.269717+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: audit 2024-09-20T22:31:04.594856+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: audit 2024-09-20T22:31:04.600417+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: audit 2024-09-20T22:31:04.606737+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:05 smithi044 bash[22676]: cluster 2024-09-20T22:31:05.032305+0000 mgr.a (mgr.14388) 710 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:07.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:07 smithi044 bash[22676]: audit 2024-09-20T22:31:06.521146+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:07 smithi044 bash[22676]: audit 2024-09-20T22:31:06.526275+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:07 smithi044 bash[22676]: audit 2024-09-20T22:31:06.531571+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:07 smithi044 bash[22676]: cluster 2024-09-20T22:31:07.032851+0000 mgr.a (mgr.14388) 711 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:07.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:07 smithi179 bash[23186]: audit 2024-09-20T22:31:06.521146+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:07 smithi179 bash[23186]: audit 2024-09-20T22:31:06.526275+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:07 smithi179 bash[23186]: audit 2024-09-20T22:31:06.531571+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:07 smithi179 bash[23186]: cluster 2024-09-20T22:31:07.032851+0000 mgr.a (mgr.14388) 711 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:07.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:07 smithi049 bash[23528]: audit 2024-09-20T22:31:06.521146+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:07 smithi049 bash[23528]: audit 2024-09-20T22:31:06.526275+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:07 smithi049 bash[23528]: audit 2024-09-20T22:31:06.531571+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:07.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:07 smithi049 bash[23528]: cluster 2024-09-20T22:31:07.032851+0000 mgr.a (mgr.14388) 711 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:09.483 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:09 smithi044 bash[22676]: cluster 2024-09-20T22:31:09.033491+0000 mgr.a (mgr.14388) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:09.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:09 smithi179 bash[23186]: cluster 2024-09-20T22:31:09.033491+0000 mgr.a (mgr.14388) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:09.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:09 smithi049 bash[23528]: cluster 2024-09-20T22:31:09.033491+0000 mgr.a (mgr.14388) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:10.361 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:10 smithi044 bash[22676]: audit 2024-09-20T22:31:09.914269+0000 mgr.a (mgr.14388) 713 : audit [DBG] from='client.28701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:10 smithi179 bash[23186]: audit 2024-09-20T22:31:09.914269+0000 mgr.a (mgr.14388) 713 : audit [DBG] from='client.28701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:10.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:10 smithi049 bash[23528]: audit 2024-09-20T22:31:09.914269+0000 mgr.a (mgr.14388) 713 : audit [DBG] from='client.28701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.320651+0000 mon.a (mon.0) 1370 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:31:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.877474+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.886448+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.888791+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:31:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.890755+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:31:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.901891+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.908937+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:31:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: audit 2024-09-20T22:31:10.911445+0000 mgr.a (mgr.14388) 714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:31:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22676]: cluster 2024-09-20T22:31:11.034786+0000 mgr.a (mgr.14388) 715 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.320651+0000 mon.a (mon.0) 1370 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:31:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.877474+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.886448+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.888791+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:31:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.890755+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:31:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.901891+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.908937+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:31:11.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: audit 2024-09-20T22:31:10.911445+0000 mgr.a (mgr.14388) 714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:31:11.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:11 smithi179 bash[23186]: cluster 2024-09-20T22:31:11.034786+0000 mgr.a (mgr.14388) 715 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:11.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.320651+0000 mon.a (mon.0) 1370 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.877474+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.886448+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.888791+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.890755+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.901891+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.908937+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: audit 2024-09-20T22:31:10.911445+0000 mgr.a (mgr.14388) 714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:31:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:11 smithi049 bash[23528]: cluster 2024-09-20T22:31:11.034786+0000 mgr.a (mgr.14388) 715 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:11.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22930]: debug 2024-09-20T22:31:11.697+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:31:11.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:31:11 smithi044 bash[22930]: debug 2024-09-20T22:31:11.701+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:31:13.206 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:12 smithi049 bash[23528]: audit 2024-09-20T22:31:11.704036+0000 mgr.a (mgr.14388) 716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:31:13.206 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:12 smithi049 bash[23528]: cephadm 2024-09-20T22:31:11.705960+0000 mgr.a (mgr.14388) 717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:31:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:12 smithi044 bash[22676]: audit 2024-09-20T22:31:11.704036+0000 mgr.a (mgr.14388) 716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:31:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:12 smithi044 bash[22676]: cephadm 2024-09-20T22:31:11.705960+0000 mgr.a (mgr.14388) 717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:31:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:12 smithi179 bash[23186]: audit 2024-09-20T22:31:11.704036+0000 mgr.a (mgr.14388) 716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:31:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:12 smithi179 bash[23186]: cephadm 2024-09-20T22:31:11.705960+0000 mgr.a (mgr.14388) 717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:31:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:13 smithi044 bash[22676]: cluster 2024-09-20T22:31:13.035671+0000 mgr.a (mgr.14388) 718 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:31:14.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:13 smithi179 bash[23186]: cluster 2024-09-20T22:31:13.035671+0000 mgr.a (mgr.14388) 718 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:31:14.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:13 smithi049 bash[23528]: cluster 2024-09-20T22:31:13.035671+0000 mgr.a (mgr.14388) 718 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:31:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:15.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:15.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:15.430 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:15 smithi049 bash[23528]: cluster 2024-09-20T22:31:15.037975+0000 mgr.a (mgr.14388) 719 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:15 smithi044 bash[22676]: cluster 2024-09-20T22:31:15.037975+0000 mgr.a (mgr.14388) 719 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:15 smithi179 bash[23186]: cluster 2024-09-20T22:31:15.037975+0000 mgr.a (mgr.14388) 719 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:16.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:16.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:16 smithi044 bash[22676]: audit 2024-09-20T22:31:15.701387+0000 mgr.a (mgr.14388) 720 : audit [DBG] from='client.28884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:16.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:16 smithi179 bash[23186]: audit 2024-09-20T22:31:15.701387+0000 mgr.a (mgr.14388) 720 : audit [DBG] from='client.28884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:16.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:16 smithi049 bash[23528]: audit 2024-09-20T22:31:15.701387+0000 mgr.a (mgr.14388) 720 : audit [DBG] from='client.28884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:17 smithi044 bash[22676]: cluster 2024-09-20T22:31:17.039063+0000 mgr.a (mgr.14388) 721 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:31:17.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:17 smithi179 bash[23186]: cluster 2024-09-20T22:31:17.039063+0000 mgr.a (mgr.14388) 721 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:31:17.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:17 smithi049 bash[23528]: cluster 2024-09-20T22:31:17.039063+0000 mgr.a (mgr.14388) 721 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:31:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:19 smithi044 bash[22676]: cluster 2024-09-20T22:31:19.040082+0000 mgr.a (mgr.14388) 722 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:31:19.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:19 smithi179 bash[23186]: cluster 2024-09-20T22:31:19.040082+0000 mgr.a (mgr.14388) 722 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:31:19.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:19 smithi049 bash[23528]: cluster 2024-09-20T22:31:19.040082+0000 mgr.a (mgr.14388) 722 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:31:21.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:21.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:21.154 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:21 smithi044 bash[22676]: cluster 2024-09-20T22:31:21.042451+0000 mgr.a (mgr.14388) 723 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:21.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:21 smithi179 bash[23186]: cluster 2024-09-20T22:31:21.042451+0000 mgr.a (mgr.14388) 723 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:21.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:21 smithi049 bash[23528]: cluster 2024-09-20T22:31:21.042451+0000 mgr.a (mgr.14388) 723 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:21.904 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:21.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:21.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:21.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:21.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:22 smithi044 bash[22676]: audit 2024-09-20T22:31:21.487108+0000 mgr.a (mgr.14388) 724 : audit [DBG] from='client.28959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:22.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:22 smithi179 bash[23186]: audit 2024-09-20T22:31:21.487108+0000 mgr.a (mgr.14388) 724 : audit [DBG] from='client.28959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:22.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:22 smithi049 bash[23528]: audit 2024-09-20T22:31:21.487108+0000 mgr.a (mgr.14388) 724 : audit [DBG] from='client.28959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:23 smithi044 bash[22676]: cluster 2024-09-20T22:31:23.043402+0000 mgr.a (mgr.14388) 725 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:23 smithi179 bash[23186]: cluster 2024-09-20T22:31:23.043402+0000 mgr.a (mgr.14388) 725 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:23.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:23 smithi049 bash[23528]: cluster 2024-09-20T22:31:23.043402+0000 mgr.a (mgr.14388) 725 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:25.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:25 smithi179 bash[23186]: audit 2024-09-20T22:31:24.475688+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:25 smithi179 bash[23186]: audit 2024-09-20T22:31:24.484769+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:25 smithi179 bash[23186]: audit 2024-09-20T22:31:24.495479+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:25 smithi179 bash[23186]: audit 2024-09-20T22:31:24.814944+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:25 smithi179 bash[23186]: audit 2024-09-20T22:31:24.823294+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:25 smithi179 bash[23186]: audit 2024-09-20T22:31:24.833120+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:25 smithi179 bash[23186]: cluster 2024-09-20T22:31:25.045669+0000 mgr.a (mgr.14388) 726 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:25 smithi044 bash[22676]: audit 2024-09-20T22:31:24.475688+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:25 smithi044 bash[22676]: audit 2024-09-20T22:31:24.484769+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:25 smithi044 bash[22676]: audit 2024-09-20T22:31:24.495479+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:25 smithi044 bash[22676]: audit 2024-09-20T22:31:24.814944+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:25 smithi044 bash[22676]: audit 2024-09-20T22:31:24.823294+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:25 smithi044 bash[22676]: audit 2024-09-20T22:31:24.833120+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:25 smithi044 bash[22676]: cluster 2024-09-20T22:31:25.045669+0000 mgr.a (mgr.14388) 726 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:25.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:25 smithi049 bash[23528]: audit 2024-09-20T22:31:24.475688+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:25 smithi049 bash[23528]: audit 2024-09-20T22:31:24.484769+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:25 smithi049 bash[23528]: audit 2024-09-20T22:31:24.495479+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:25 smithi049 bash[23528]: audit 2024-09-20T22:31:24.814944+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:25 smithi049 bash[23528]: audit 2024-09-20T22:31:24.823294+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:25 smithi049 bash[23528]: audit 2024-09-20T22:31:24.833120+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:25.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:25 smithi049 bash[23528]: cluster 2024-09-20T22:31:25.045669+0000 mgr.a (mgr.14388) 726 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:31:26.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:27.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:27.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:27.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:27.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:27.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:27.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:27 smithi179 bash[23186]: audit 2024-09-20T22:31:26.665422+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:27.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:27 smithi179 bash[23186]: audit 2024-09-20T22:31:26.670558+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:27.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:27 smithi179 bash[23186]: audit 2024-09-20T22:31:26.677509+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:27.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:27 smithi179 bash[23186]: cluster 2024-09-20T22:31:27.046116+0000 mgr.a (mgr.14388) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:27.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:27 smithi044 bash[22676]: audit 2024-09-20T22:31:26.665422+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:27.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:27 smithi044 bash[22676]: audit 2024-09-20T22:31:26.670558+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:27.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:27 smithi044 bash[22676]: audit 2024-09-20T22:31:26.677509+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:27.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:27 smithi044 bash[22676]: cluster 2024-09-20T22:31:27.046116+0000 mgr.a (mgr.14388) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:28.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:27 smithi049 bash[23528]: audit 2024-09-20T22:31:26.665422+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:28.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:27 smithi049 bash[23528]: audit 2024-09-20T22:31:26.670558+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:28.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:27 smithi049 bash[23528]: audit 2024-09-20T22:31:26.677509+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:28.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:27 smithi049 bash[23528]: cluster 2024-09-20T22:31:27.046116+0000 mgr.a (mgr.14388) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:28.950 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:28 smithi179 bash[23186]: audit 2024-09-20T22:31:27.242232+0000 mgr.a (mgr.14388) 728 : audit [DBG] from='client.29034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:28 smithi044 bash[22676]: audit 2024-09-20T22:31:27.242232+0000 mgr.a (mgr.14388) 728 : audit [DBG] from='client.29034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:29.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:28 smithi049 bash[23528]: audit 2024-09-20T22:31:27.242232+0000 mgr.a (mgr.14388) 728 : audit [DBG] from='client.29034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:29 smithi044 bash[22676]: cluster 2024-09-20T22:31:29.046961+0000 mgr.a (mgr.14388) 729 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:29.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:29 smithi179 bash[23186]: cluster 2024-09-20T22:31:29.046961+0000 mgr.a (mgr.14388) 729 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:30.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:29 smithi049 bash[23528]: cluster 2024-09-20T22:31:29.046961+0000 mgr.a (mgr.14388) 729 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:31 smithi044 bash[22676]: cluster 2024-09-20T22:31:31.049218+0000 mgr.a (mgr.14388) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:31.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:31 smithi179 bash[23186]: cluster 2024-09-20T22:31:31.049218+0000 mgr.a (mgr.14388) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:31.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:31 smithi049 bash[23528]: cluster 2024-09-20T22:31:31.049218+0000 mgr.a (mgr.14388) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:32.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:32.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:32.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:33.220 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:33 smithi049 bash[23528]: audit 2024-09-20T22:31:33.004737+0000 mgr.a (mgr.14388) 731 : audit [DBG] from='client.29112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:33.221 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:33 smithi049 bash[23528]: cluster 2024-09-20T22:31:33.050263+0000 mgr.a (mgr.14388) 732 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:33.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:33.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:33.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:33.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:33 smithi044 bash[22676]: audit 2024-09-20T22:31:33.004737+0000 mgr.a (mgr.14388) 731 : audit [DBG] from='client.29112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:33 smithi044 bash[22676]: cluster 2024-09-20T22:31:33.050263+0000 mgr.a (mgr.14388) 732 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:33.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:33 smithi179 bash[23186]: audit 2024-09-20T22:31:33.004737+0000 mgr.a (mgr.14388) 731 : audit [DBG] from='client.29112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:33.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:33 smithi179 bash[23186]: cluster 2024-09-20T22:31:33.050263+0000 mgr.a (mgr.14388) 732 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:35.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:35 smithi049 bash[23528]: cluster 2024-09-20T22:31:35.052675+0000 mgr.a (mgr.14388) 733 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:35 smithi044 bash[22676]: cluster 2024-09-20T22:31:35.052675+0000 mgr.a (mgr.14388) 733 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:35.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:35 smithi179 bash[23186]: cluster 2024-09-20T22:31:35.052675+0000 mgr.a (mgr.14388) 733 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:37 smithi044 bash[22676]: cluster 2024-09-20T22:31:37.053635+0000 mgr.a (mgr.14388) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:37.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:37 smithi179 bash[23186]: cluster 2024-09-20T22:31:37.053635+0000 mgr.a (mgr.14388) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:37.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:37 smithi049 bash[23528]: cluster 2024-09-20T22:31:37.053635+0000 mgr.a (mgr.14388) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:39.162 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:39.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:39.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:39.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:39.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:39 smithi044 bash[22676]: audit 2024-09-20T22:31:38.747618+0000 mgr.a (mgr.14388) 735 : audit [DBG] from='client.29187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:39 smithi044 bash[22676]: cluster 2024-09-20T22:31:39.061287+0000 mgr.a (mgr.14388) 736 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:39.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:39 smithi179 bash[23186]: audit 2024-09-20T22:31:38.747618+0000 mgr.a (mgr.14388) 735 : audit [DBG] from='client.29187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:39.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:39 smithi179 bash[23186]: cluster 2024-09-20T22:31:39.061287+0000 mgr.a (mgr.14388) 736 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:39.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:39 smithi049 bash[23528]: audit 2024-09-20T22:31:38.747618+0000 mgr.a (mgr.14388) 735 : audit [DBG] from='client.29187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:39.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:39 smithi049 bash[23528]: cluster 2024-09-20T22:31:39.061287+0000 mgr.a (mgr.14388) 736 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:42 smithi044 bash[22676]: cluster 2024-09-20T22:31:41.063460+0000 mgr.a (mgr.14388) 737 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:42.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:42 smithi179 bash[23186]: cluster 2024-09-20T22:31:41.063460+0000 mgr.a (mgr.14388) 737 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:42.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:42 smithi049 bash[23528]: cluster 2024-09-20T22:31:41.063460+0000 mgr.a (mgr.14388) 737 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:31:44.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:44.164 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:44.164 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:44 smithi044 bash[22676]: cluster 2024-09-20T22:31:43.064245+0000 mgr.a (mgr.14388) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:44 smithi179 bash[23186]: cluster 2024-09-20T22:31:43.064245+0000 mgr.a (mgr.14388) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:44.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:44 smithi049 bash[23528]: cluster 2024-09-20T22:31:43.064245+0000 mgr.a (mgr.14388) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:44.905 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:44.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:44.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:44.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:44.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:45 smithi044 bash[22676]: audit 2024-09-20T22:31:44.492190+0000 mgr.a (mgr.14388) 739 : audit [DBG] from='client.29265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:45 smithi044 bash[22676]: audit 2024-09-20T22:31:44.666294+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:45 smithi044 bash[22676]: audit 2024-09-20T22:31:44.671725+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:45 smithi044 bash[22676]: audit 2024-09-20T22:31:44.676771+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:45 smithi044 bash[22676]: audit 2024-09-20T22:31:45.042026+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:45 smithi044 bash[22676]: audit 2024-09-20T22:31:45.050319+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:45 smithi044 bash[22676]: audit 2024-09-20T22:31:45.063283+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:45 smithi179 bash[23186]: audit 2024-09-20T22:31:44.492190+0000 mgr.a (mgr.14388) 739 : audit [DBG] from='client.29265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:45 smithi179 bash[23186]: audit 2024-09-20T22:31:44.666294+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:45 smithi179 bash[23186]: audit 2024-09-20T22:31:44.671725+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:45 smithi179 bash[23186]: audit 2024-09-20T22:31:44.676771+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:45 smithi179 bash[23186]: audit 2024-09-20T22:31:45.042026+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:45 smithi179 bash[23186]: audit 2024-09-20T22:31:45.050319+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:45.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:45 smithi179 bash[23186]: audit 2024-09-20T22:31:45.063283+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:46.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:45 smithi049 bash[23528]: audit 2024-09-20T22:31:44.492190+0000 mgr.a (mgr.14388) 739 : audit [DBG] from='client.29265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:46.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:45 smithi049 bash[23528]: audit 2024-09-20T22:31:44.666294+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:46.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:45 smithi049 bash[23528]: audit 2024-09-20T22:31:44.671725+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:46.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:45 smithi049 bash[23528]: audit 2024-09-20T22:31:44.676771+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:46.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:45 smithi049 bash[23528]: audit 2024-09-20T22:31:45.042026+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:46.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:45 smithi049 bash[23528]: audit 2024-09-20T22:31:45.050319+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:46.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:45 smithi049 bash[23528]: audit 2024-09-20T22:31:45.063283+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:47 smithi044 bash[22676]: cluster 2024-09-20T22:31:45.066817+0000 mgr.a (mgr.14388) 740 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:31:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:47 smithi044 bash[22676]: audit 2024-09-20T22:31:46.892985+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:47 smithi044 bash[22676]: audit 2024-09-20T22:31:46.901576+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:47 smithi044 bash[22676]: audit 2024-09-20T22:31:46.911494+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:47 smithi179 bash[23186]: cluster 2024-09-20T22:31:45.066817+0000 mgr.a (mgr.14388) 740 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:31:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:47 smithi179 bash[23186]: audit 2024-09-20T22:31:46.892985+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:47 smithi179 bash[23186]: audit 2024-09-20T22:31:46.901576+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:47 smithi179 bash[23186]: audit 2024-09-20T22:31:46.911494+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:47 smithi049 bash[23528]: cluster 2024-09-20T22:31:45.066817+0000 mgr.a (mgr.14388) 740 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:31:47.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:47 smithi049 bash[23528]: audit 2024-09-20T22:31:46.892985+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:47 smithi049 bash[23528]: audit 2024-09-20T22:31:46.901576+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:47.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:47 smithi049 bash[23528]: audit 2024-09-20T22:31:46.911494+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:31:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:48 smithi044 bash[22676]: cluster 2024-09-20T22:31:47.067587+0000 mgr.a (mgr.14388) 741 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:31:48.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:48 smithi179 bash[23186]: cluster 2024-09-20T22:31:47.067587+0000 mgr.a (mgr.14388) 741 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:31:48.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:48 smithi049 bash[23528]: cluster 2024-09-20T22:31:47.067587+0000 mgr.a (mgr.14388) 741 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:31:49.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:49.907 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:49.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:50 smithi044 bash[22676]: cluster 2024-09-20T22:31:49.068405+0000 mgr.a (mgr.14388) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:31:50.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:50 smithi179 bash[23186]: cluster 2024-09-20T22:31:49.068405+0000 mgr.a (mgr.14388) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:31:50.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:50 smithi049 bash[23528]: cluster 2024-09-20T22:31:49.068405+0000 mgr.a (mgr.14388) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:31:50.649 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:50.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:51 smithi044 bash[22676]: audit 2024-09-20T22:31:50.234279+0000 mgr.a (mgr.14388) 743 : audit [DBG] from='client.29343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:51.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:51 smithi179 bash[23186]: audit 2024-09-20T22:31:50.234279+0000 mgr.a (mgr.14388) 743 : audit [DBG] from='client.29343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:51.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:51 smithi049 bash[23528]: audit 2024-09-20T22:31:50.234279+0000 mgr.a (mgr.14388) 743 : audit [DBG] from='client.29343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:52 smithi044 bash[22676]: cluster 2024-09-20T22:31:51.071096+0000 mgr.a (mgr.14388) 744 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:52.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:52 smithi179 bash[23186]: cluster 2024-09-20T22:31:51.071096+0000 mgr.a (mgr.14388) 744 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:52.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:52 smithi049 bash[23528]: cluster 2024-09-20T22:31:51.071096+0000 mgr.a (mgr.14388) 744 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:54 smithi044 bash[22676]: cluster 2024-09-20T22:31:53.071895+0000 mgr.a (mgr.14388) 745 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:31:54.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:54 smithi179 bash[23186]: cluster 2024-09-20T22:31:53.071895+0000 mgr.a (mgr.14388) 745 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:31:54.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:54 smithi049 bash[23528]: cluster 2024-09-20T22:31:53.071895+0000 mgr.a (mgr.14388) 745 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:31:55.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:31:55.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:31:55.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:31:56.390 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:31:56.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:31:56.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:31:56.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:31:56.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:31:56.400 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:56 smithi049 bash[23528]: cluster 2024-09-20T22:31:55.073822+0000 mgr.a (mgr.14388) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:56.401 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:56 smithi049 bash[23528]: audit 2024-09-20T22:31:55.975499+0000 mgr.a (mgr.14388) 747 : audit [DBG] from='client.29418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:56 smithi044 bash[22676]: cluster 2024-09-20T22:31:55.073822+0000 mgr.a (mgr.14388) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:56 smithi044 bash[22676]: audit 2024-09-20T22:31:55.975499+0000 mgr.a (mgr.14388) 747 : audit [DBG] from='client.29418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:56.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:56 smithi179 bash[23186]: cluster 2024-09-20T22:31:55.073822+0000 mgr.a (mgr.14388) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:31:56.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:56 smithi179 bash[23186]: audit 2024-09-20T22:31:55.975499+0000 mgr.a (mgr.14388) 747 : audit [DBG] from='client.29418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:31:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:31:58 smithi044 bash[22676]: cluster 2024-09-20T22:31:57.074830+0000 mgr.a (mgr.14388) 748 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:31:58.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:31:58 smithi179 bash[23186]: cluster 2024-09-20T22:31:57.074830+0000 mgr.a (mgr.14388) 748 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:31:58.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:31:58 smithi049 bash[23528]: cluster 2024-09-20T22:31:57.074830+0000 mgr.a (mgr.14388) 748 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:32:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:00 smithi044 bash[22676]: cluster 2024-09-20T22:31:59.075650+0000 mgr.a (mgr.14388) 749 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:32:00.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:00 smithi179 bash[23186]: cluster 2024-09-20T22:31:59.075650+0000 mgr.a (mgr.14388) 749 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:32:00.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:00 smithi049 bash[23528]: cluster 2024-09-20T22:31:59.075650+0000 mgr.a (mgr.14388) 749 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:32:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:01.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:01.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:02.152 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:02.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:02.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:02.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:02.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:02 smithi044 bash[22676]: cluster 2024-09-20T22:32:01.078017+0000 mgr.a (mgr.14388) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:32:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:02 smithi044 bash[22676]: audit 2024-09-20T22:32:01.720100+0000 mgr.a (mgr.14388) 751 : audit [DBG] from='client.29496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:02.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:02 smithi179 bash[23186]: cluster 2024-09-20T22:32:01.078017+0000 mgr.a (mgr.14388) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:32:02.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:02 smithi179 bash[23186]: audit 2024-09-20T22:32:01.720100+0000 mgr.a (mgr.14388) 751 : audit [DBG] from='client.29496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:02.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:02 smithi049 bash[23528]: cluster 2024-09-20T22:32:01.078017+0000 mgr.a (mgr.14388) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:32:02.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:02 smithi049 bash[23528]: audit 2024-09-20T22:32:01.720100+0000 mgr.a (mgr.14388) 751 : audit [DBG] from='client.29496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:04 smithi044 bash[22676]: cluster 2024-09-20T22:32:03.079132+0000 mgr.a (mgr.14388) 752 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:04 smithi179 bash[23186]: cluster 2024-09-20T22:32:03.079132+0000 mgr.a (mgr.14388) 752 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:04.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:04 smithi049 bash[23528]: cluster 2024-09-20T22:32:03.079132+0000 mgr.a (mgr.14388) 752 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:05 smithi044 bash[22676]: audit 2024-09-20T22:32:04.885071+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:05 smithi044 bash[22676]: audit 2024-09-20T22:32:04.894964+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:05 smithi044 bash[22676]: audit 2024-09-20T22:32:04.905604+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:05 smithi044 bash[22676]: audit 2024-09-20T22:32:05.271800+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:05 smithi044 bash[22676]: audit 2024-09-20T22:32:05.280380+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:05 smithi044 bash[22676]: audit 2024-09-20T22:32:05.290685+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:05 smithi179 bash[23186]: audit 2024-09-20T22:32:04.885071+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:05 smithi179 bash[23186]: audit 2024-09-20T22:32:04.894964+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:05 smithi179 bash[23186]: audit 2024-09-20T22:32:04.905604+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:05 smithi179 bash[23186]: audit 2024-09-20T22:32:05.271800+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:05 smithi179 bash[23186]: audit 2024-09-20T22:32:05.280380+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:05 smithi179 bash[23186]: audit 2024-09-20T22:32:05.290685+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:05 smithi049 bash[23528]: audit 2024-09-20T22:32:04.885071+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:05 smithi049 bash[23528]: audit 2024-09-20T22:32:04.894964+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:05 smithi049 bash[23528]: audit 2024-09-20T22:32:04.905604+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:05 smithi049 bash[23528]: audit 2024-09-20T22:32:05.271800+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:05 smithi049 bash[23528]: audit 2024-09-20T22:32:05.280380+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:06.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:05 smithi049 bash[23528]: audit 2024-09-20T22:32:05.290685+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:07.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:07.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:07.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:06 smithi044 bash[22676]: cluster 2024-09-20T22:32:05.081454+0000 mgr.a (mgr.14388) 753 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:07.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:06 smithi179 bash[23186]: cluster 2024-09-20T22:32:05.081454+0000 mgr.a (mgr.14388) 753 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:07.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:06 smithi049 bash[23528]: cluster 2024-09-20T22:32:05.081454+0000 mgr.a (mgr.14388) 753 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:07.907 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:07.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:07.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:07.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:07.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:08.481 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:08 smithi179 bash[23186]: cluster 2024-09-20T22:32:07.082357+0000 mgr.a (mgr.14388) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:08.481 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:08 smithi179 bash[23186]: audit 2024-09-20T22:32:07.122210+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.481 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:08 smithi179 bash[23186]: audit 2024-09-20T22:32:07.129522+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.481 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:08 smithi179 bash[23186]: audit 2024-09-20T22:32:07.137783+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.482 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:08 smithi179 bash[23186]: audit 2024-09-20T22:32:07.483121+0000 mgr.a (mgr.14388) 755 : audit [DBG] from='client.29574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:08 smithi044 bash[22676]: cluster 2024-09-20T22:32:07.082357+0000 mgr.a (mgr.14388) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:08 smithi044 bash[22676]: audit 2024-09-20T22:32:07.122210+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:08 smithi044 bash[22676]: audit 2024-09-20T22:32:07.129522+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:08 smithi044 bash[22676]: audit 2024-09-20T22:32:07.137783+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:08 smithi044 bash[22676]: audit 2024-09-20T22:32:07.483121+0000 mgr.a (mgr.14388) 755 : audit [DBG] from='client.29574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:08.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:08 smithi049 bash[23528]: cluster 2024-09-20T22:32:07.082357+0000 mgr.a (mgr.14388) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:08.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:08 smithi049 bash[23528]: audit 2024-09-20T22:32:07.122210+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:08 smithi049 bash[23528]: audit 2024-09-20T22:32:07.129522+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:08 smithi049 bash[23528]: audit 2024-09-20T22:32:07.137783+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:08.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:08 smithi049 bash[23528]: audit 2024-09-20T22:32:07.483121+0000 mgr.a (mgr.14388) 755 : audit [DBG] from='client.29574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:10 smithi044 bash[22676]: cluster 2024-09-20T22:32:09.083393+0000 mgr.a (mgr.14388) 756 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:10.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:10 smithi179 bash[23186]: cluster 2024-09-20T22:32:09.083393+0000 mgr.a (mgr.14388) 756 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:10.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:10 smithi049 bash[23528]: cluster 2024-09-20T22:32:09.083393+0000 mgr.a (mgr.14388) 756 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22676]: cluster 2024-09-20T22:32:11.084574+0000 mgr.a (mgr.14388) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22676]: audit 2024-09-20T22:32:11.784475+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:32:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22676]: audit 2024-09-20T22:32:11.791849+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:32:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22676]: audit 2024-09-20T22:32:11.793735+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:32:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22676]: audit 2024-09-20T22:32:11.805022+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22676]: audit 2024-09-20T22:32:11.811404+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:32:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22676]: audit 2024-09-20T22:32:11.813801+0000 mgr.a (mgr.14388) 758 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:32:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:12 smithi179 bash[23186]: cluster 2024-09-20T22:32:11.084574+0000 mgr.a (mgr.14388) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:12 smithi179 bash[23186]: audit 2024-09-20T22:32:11.784475+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:32:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:12 smithi179 bash[23186]: audit 2024-09-20T22:32:11.791849+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:32:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:12 smithi179 bash[23186]: audit 2024-09-20T22:32:11.793735+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:32:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:12 smithi179 bash[23186]: audit 2024-09-20T22:32:11.805022+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:12 smithi179 bash[23186]: audit 2024-09-20T22:32:11.811404+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:32:12.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:12 smithi179 bash[23186]: audit 2024-09-20T22:32:11.813801+0000 mgr.a (mgr.14388) 758 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:32:12.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:12 smithi049 bash[23528]: cluster 2024-09-20T22:32:11.084574+0000 mgr.a (mgr.14388) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:12.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:12 smithi049 bash[23528]: audit 2024-09-20T22:32:11.784475+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:32:12.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:12 smithi049 bash[23528]: audit 2024-09-20T22:32:11.791849+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:32:12.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:12 smithi049 bash[23528]: audit 2024-09-20T22:32:11.793735+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:32:12.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:12 smithi049 bash[23528]: audit 2024-09-20T22:32:11.805022+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:12.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:12 smithi049 bash[23528]: audit 2024-09-20T22:32:11.811404+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:32:12.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:12 smithi049 bash[23528]: audit 2024-09-20T22:32:11.813801+0000 mgr.a (mgr.14388) 758 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:32:12.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:12.909 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:12.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:12.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22930]: debug 2024-09-20T22:32:12.588+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:32:12.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:32:12 smithi044 bash[22930]: debug 2024-09-20T22:32:12.588+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:32:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:13 smithi044 bash[22676]: audit 2024-09-20T22:32:12.589849+0000 mgr.a (mgr.14388) 759 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:32:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:13 smithi044 bash[22676]: cephadm 2024-09-20T22:32:12.591706+0000 mgr.a (mgr.14388) 760 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:32:13.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:13 smithi179 bash[23186]: audit 2024-09-20T22:32:12.589849+0000 mgr.a (mgr.14388) 759 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:32:13.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:13 smithi179 bash[23186]: cephadm 2024-09-20T22:32:12.591706+0000 mgr.a (mgr.14388) 760 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:32:13.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:13 smithi049 bash[23528]: audit 2024-09-20T22:32:12.589849+0000 mgr.a (mgr.14388) 759 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:32:13.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:13 smithi049 bash[23528]: cephadm 2024-09-20T22:32:12.591706+0000 mgr.a (mgr.14388) 760 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:32:13.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:13.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:13.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:13.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:13.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:14 smithi044 bash[22676]: cluster 2024-09-20T22:32:13.085487+0000 mgr.a (mgr.14388) 761 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:14 smithi044 bash[22676]: audit 2024-09-20T22:32:13.253115+0000 mgr.a (mgr.14388) 762 : audit [DBG] from='client.29751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:14.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:14 smithi179 bash[23186]: cluster 2024-09-20T22:32:13.085487+0000 mgr.a (mgr.14388) 761 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:14.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:14 smithi179 bash[23186]: audit 2024-09-20T22:32:13.253115+0000 mgr.a (mgr.14388) 762 : audit [DBG] from='client.29751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:14.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:14 smithi049 bash[23528]: cluster 2024-09-20T22:32:13.085487+0000 mgr.a (mgr.14388) 761 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:14.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:14 smithi049 bash[23528]: audit 2024-09-20T22:32:13.253115+0000 mgr.a (mgr.14388) 762 : audit [DBG] from='client.29751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:16 smithi044 bash[22676]: cluster 2024-09-20T22:32:15.087809+0000 mgr.a (mgr.14388) 763 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:16.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:16 smithi179 bash[23186]: cluster 2024-09-20T22:32:15.087809+0000 mgr.a (mgr.14388) 763 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:16.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:16 smithi049 bash[23528]: cluster 2024-09-20T22:32:15.087809+0000 mgr.a (mgr.14388) 763 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:18 smithi044 bash[22676]: cluster 2024-09-20T22:32:17.088604+0000 mgr.a (mgr.14388) 764 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:18.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:18 smithi179 bash[23186]: cluster 2024-09-20T22:32:17.088604+0000 mgr.a (mgr.14388) 764 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:18.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:18 smithi049 bash[23528]: cluster 2024-09-20T22:32:17.088604+0000 mgr.a (mgr.14388) 764 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:18.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:18.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:18.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:19.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:19 smithi044 bash[22676]: audit 2024-09-20T22:32:19.030463+0000 mgr.a (mgr.14388) 765 : audit [DBG] from='client.29829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:19.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:19 smithi179 bash[23186]: audit 2024-09-20T22:32:19.030463+0000 mgr.a (mgr.14388) 765 : audit [DBG] from='client.29829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:19.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:19 smithi049 bash[23528]: audit 2024-09-20T22:32:19.030463+0000 mgr.a (mgr.14388) 765 : audit [DBG] from='client.29829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:20 smithi044 bash[22676]: cluster 2024-09-20T22:32:19.089151+0000 mgr.a (mgr.14388) 766 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:20.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:20 smithi179 bash[23186]: cluster 2024-09-20T22:32:19.089151+0000 mgr.a (mgr.14388) 766 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:20.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:20 smithi049 bash[23528]: cluster 2024-09-20T22:32:19.089151+0000 mgr.a (mgr.14388) 766 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:22 smithi044 bash[22676]: cluster 2024-09-20T22:32:21.091466+0000 mgr.a (mgr.14388) 767 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:22.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:22 smithi179 bash[23186]: cluster 2024-09-20T22:32:21.091466+0000 mgr.a (mgr.14388) 767 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:22.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:22 smithi049 bash[23528]: cluster 2024-09-20T22:32:21.091466+0000 mgr.a (mgr.14388) 767 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:24.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:24.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:24 smithi044 bash[22676]: cluster 2024-09-20T22:32:23.092240+0000 mgr.a (mgr.14388) 768 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:24.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:24 smithi179 bash[23186]: cluster 2024-09-20T22:32:23.092240+0000 mgr.a (mgr.14388) 768 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:24.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:24 smithi049 bash[23528]: cluster 2024-09-20T22:32:23.092240+0000 mgr.a (mgr.14388) 768 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:25.219 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:25.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:25 smithi044 bash[22676]: audit 2024-09-20T22:32:24.792897+0000 mgr.a (mgr.14388) 769 : audit [DBG] from='client.29901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:25 smithi044 bash[22676]: audit 2024-09-20T22:32:25.099011+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:25 smithi044 bash[22676]: audit 2024-09-20T22:32:25.105020+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:25 smithi044 bash[22676]: audit 2024-09-20T22:32:25.120702+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:25 smithi179 bash[23186]: audit 2024-09-20T22:32:24.792897+0000 mgr.a (mgr.14388) 769 : audit [DBG] from='client.29901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:25.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:25 smithi179 bash[23186]: audit 2024-09-20T22:32:25.099011+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:25 smithi179 bash[23186]: audit 2024-09-20T22:32:25.105020+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:25 smithi179 bash[23186]: audit 2024-09-20T22:32:25.120702+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.519 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:25 smithi049 bash[23528]: audit 2024-09-20T22:32:24.792897+0000 mgr.a (mgr.14388) 769 : audit [DBG] from='client.29901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:25.519 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:25 smithi049 bash[23528]: audit 2024-09-20T22:32:25.099011+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.519 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:25 smithi049 bash[23528]: audit 2024-09-20T22:32:25.105020+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:25.519 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:25 smithi049 bash[23528]: audit 2024-09-20T22:32:25.120702+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:26 smithi179 bash[23186]: cluster 2024-09-20T22:32:25.093735+0000 mgr.a (mgr.14388) 770 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:26.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:26 smithi179 bash[23186]: audit 2024-09-20T22:32:25.499649+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:26 smithi179 bash[23186]: audit 2024-09-20T22:32:25.507879+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:26 smithi179 bash[23186]: audit 2024-09-20T22:32:25.517627+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:26 smithi049 bash[23528]: cluster 2024-09-20T22:32:25.093735+0000 mgr.a (mgr.14388) 770 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:26.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:26 smithi049 bash[23528]: audit 2024-09-20T22:32:25.499649+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:26 smithi049 bash[23528]: audit 2024-09-20T22:32:25.507879+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:26 smithi049 bash[23528]: audit 2024-09-20T22:32:25.517627+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:26 smithi044 bash[22676]: cluster 2024-09-20T22:32:25.093735+0000 mgr.a (mgr.14388) 770 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:32:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:26 smithi044 bash[22676]: audit 2024-09-20T22:32:25.499649+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:26 smithi044 bash[22676]: audit 2024-09-20T22:32:25.507879+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:26 smithi044 bash[22676]: audit 2024-09-20T22:32:25.517627+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:28 smithi044 bash[22676]: cluster 2024-09-20T22:32:27.094585+0000 mgr.a (mgr.14388) 771 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:32:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:28 smithi044 bash[22676]: audit 2024-09-20T22:32:27.327105+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:28 smithi044 bash[22676]: audit 2024-09-20T22:32:27.332726+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:28 smithi044 bash[22676]: audit 2024-09-20T22:32:27.339215+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:28 smithi179 bash[23186]: cluster 2024-09-20T22:32:27.094585+0000 mgr.a (mgr.14388) 771 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:32:28.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:28 smithi179 bash[23186]: audit 2024-09-20T22:32:27.327105+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:28 smithi179 bash[23186]: audit 2024-09-20T22:32:27.332726+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:28 smithi179 bash[23186]: audit 2024-09-20T22:32:27.339215+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:28 smithi049 bash[23528]: cluster 2024-09-20T22:32:27.094585+0000 mgr.a (mgr.14388) 771 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:32:28.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:28 smithi049 bash[23528]: audit 2024-09-20T22:32:27.327105+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:28 smithi049 bash[23528]: audit 2024-09-20T22:32:27.332726+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:28.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:28 smithi049 bash[23528]: audit 2024-09-20T22:32:27.339215+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:30.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:30 smithi179 bash[23186]: cluster 2024-09-20T22:32:29.095374+0000 mgr.a (mgr.14388) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:32:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:30 smithi044 bash[22676]: cluster 2024-09-20T22:32:29.095374+0000 mgr.a (mgr.14388) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:32:30.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:30 smithi049 bash[23528]: cluster 2024-09-20T22:32:29.095374+0000 mgr.a (mgr.14388) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:32:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:30.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:31.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:31 smithi044 bash[22676]: audit 2024-09-20T22:32:30.549484+0000 mgr.a (mgr.14388) 773 : audit [DBG] from='client.29976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:31.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:31 smithi179 bash[23186]: audit 2024-09-20T22:32:30.549484+0000 mgr.a (mgr.14388) 773 : audit [DBG] from='client.29976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:31.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:31 smithi049 bash[23528]: audit 2024-09-20T22:32:30.549484+0000 mgr.a (mgr.14388) 773 : audit [DBG] from='client.29976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:32.596 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:32 smithi044 bash[22676]: cluster 2024-09-20T22:32:31.098102+0000 mgr.a (mgr.14388) 774 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:32.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:32 smithi179 bash[23186]: cluster 2024-09-20T22:32:31.098102+0000 mgr.a (mgr.14388) 774 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:32.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:32 smithi049 bash[23528]: cluster 2024-09-20T22:32:31.098102+0000 mgr.a (mgr.14388) 774 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:34 smithi044 bash[22676]: cluster 2024-09-20T22:32:33.098912+0000 mgr.a (mgr.14388) 775 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:32:34.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:34 smithi179 bash[23186]: cluster 2024-09-20T22:32:33.098912+0000 mgr.a (mgr.14388) 775 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:32:34.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:34 smithi049 bash[23528]: cluster 2024-09-20T22:32:33.098912+0000 mgr.a (mgr.14388) 775 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:32:35.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:36.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:36 smithi049 bash[23528]: cluster 2024-09-20T22:32:35.100806+0000 mgr.a (mgr.14388) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:36 smithi044 bash[22676]: cluster 2024-09-20T22:32:35.100806+0000 mgr.a (mgr.14388) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:36.743 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:36.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:36 smithi179 bash[23186]: cluster 2024-09-20T22:32:35.100806+0000 mgr.a (mgr.14388) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:37.615 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:37 smithi049 bash[23528]: audit 2024-09-20T22:32:36.291658+0000 mgr.a (mgr.14388) 777 : audit [DBG] from='client.30054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:37 smithi044 bash[22676]: audit 2024-09-20T22:32:36.291658+0000 mgr.a (mgr.14388) 777 : audit [DBG] from='client.30054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:37.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:37 smithi179 bash[23186]: audit 2024-09-20T22:32:36.291658+0000 mgr.a (mgr.14388) 777 : audit [DBG] from='client.30054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:38 smithi044 bash[22676]: cluster 2024-09-20T22:32:37.101821+0000 mgr.a (mgr.14388) 778 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:38.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:38 smithi179 bash[23186]: cluster 2024-09-20T22:32:37.101821+0000 mgr.a (mgr.14388) 778 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:38.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:38 smithi049 bash[23528]: cluster 2024-09-20T22:32:37.101821+0000 mgr.a (mgr.14388) 778 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:40 smithi044 bash[22676]: cluster 2024-09-20T22:32:39.102879+0000 mgr.a (mgr.14388) 779 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:40.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:40 smithi179 bash[23186]: cluster 2024-09-20T22:32:39.102879+0000 mgr.a (mgr.14388) 779 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:40.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:40 smithi049 bash[23528]: cluster 2024-09-20T22:32:39.102879+0000 mgr.a (mgr.14388) 779 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:41.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:41.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:41.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:42.537 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:42.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:42.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:42.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:42.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:42 smithi044 bash[22676]: cluster 2024-09-20T22:32:41.105123+0000 mgr.a (mgr.14388) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:42.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:42 smithi179 bash[23186]: cluster 2024-09-20T22:32:41.105123+0000 mgr.a (mgr.14388) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:42.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:42 smithi049 bash[23528]: cluster 2024-09-20T22:32:41.105123+0000 mgr.a (mgr.14388) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:43 smithi044 bash[22676]: audit 2024-09-20T22:32:42.086676+0000 mgr.a (mgr.14388) 781 : audit [DBG] from='client.30132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:43.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:43 smithi179 bash[23186]: audit 2024-09-20T22:32:42.086676+0000 mgr.a (mgr.14388) 781 : audit [DBG] from='client.30132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:43.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:43 smithi049 bash[23528]: audit 2024-09-20T22:32:42.086676+0000 mgr.a (mgr.14388) 781 : audit [DBG] from='client.30132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:44 smithi044 bash[22676]: cluster 2024-09-20T22:32:43.106093+0000 mgr.a (mgr.14388) 782 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:44.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:44 smithi179 bash[23186]: cluster 2024-09-20T22:32:43.106093+0000 mgr.a (mgr.14388) 782 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:44.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:44 smithi049 bash[23528]: cluster 2024-09-20T22:32:43.106093+0000 mgr.a (mgr.14388) 782 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:46 smithi044 bash[22676]: cluster 2024-09-20T22:32:45.108276+0000 mgr.a (mgr.14388) 783 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:46 smithi044 bash[22676]: audit 2024-09-20T22:32:45.332375+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:46 smithi044 bash[22676]: audit 2024-09-20T22:32:45.341172+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:46 smithi044 bash[22676]: audit 2024-09-20T22:32:45.351398+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:46 smithi044 bash[22676]: audit 2024-09-20T22:32:45.707654+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:46 smithi044 bash[22676]: audit 2024-09-20T22:32:45.716253+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:46 smithi044 bash[22676]: audit 2024-09-20T22:32:45.726251+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:46 smithi179 bash[23186]: cluster 2024-09-20T22:32:45.108276+0000 mgr.a (mgr.14388) 783 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:46 smithi179 bash[23186]: audit 2024-09-20T22:32:45.332375+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:46 smithi179 bash[23186]: audit 2024-09-20T22:32:45.341172+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:46 smithi179 bash[23186]: audit 2024-09-20T22:32:45.351398+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:46 smithi179 bash[23186]: audit 2024-09-20T22:32:45.707654+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:46 smithi179 bash[23186]: audit 2024-09-20T22:32:45.716253+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:46 smithi179 bash[23186]: audit 2024-09-20T22:32:45.726251+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:46 smithi049 bash[23528]: cluster 2024-09-20T22:32:45.108276+0000 mgr.a (mgr.14388) 783 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:46.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:46 smithi049 bash[23528]: audit 2024-09-20T22:32:45.332375+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:46 smithi049 bash[23528]: audit 2024-09-20T22:32:45.341172+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:46 smithi049 bash[23528]: audit 2024-09-20T22:32:45.351398+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:46 smithi049 bash[23528]: audit 2024-09-20T22:32:45.707654+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:46 smithi049 bash[23528]: audit 2024-09-20T22:32:45.716253+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:46.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:46 smithi049 bash[23528]: audit 2024-09-20T22:32:45.726251+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:47.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:47.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:47.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:48.314 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:48 smithi044 bash[22676]: cluster 2024-09-20T22:32:47.109013+0000 mgr.a (mgr.14388) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:48 smithi044 bash[22676]: audit 2024-09-20T22:32:47.554607+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:48 smithi044 bash[22676]: audit 2024-09-20T22:32:47.560307+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:48 smithi044 bash[22676]: audit 2024-09-20T22:32:47.567772+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:48 smithi044 bash[22676]: audit 2024-09-20T22:32:47.881556+0000 mgr.a (mgr.14388) 785 : audit [DBG] from='client.30210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:48.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:48 smithi179 bash[23186]: cluster 2024-09-20T22:32:47.109013+0000 mgr.a (mgr.14388) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:48.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:48 smithi179 bash[23186]: audit 2024-09-20T22:32:47.554607+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:48.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:48 smithi179 bash[23186]: audit 2024-09-20T22:32:47.560307+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:48.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:48 smithi179 bash[23186]: audit 2024-09-20T22:32:47.567772+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:48.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:48 smithi179 bash[23186]: audit 2024-09-20T22:32:47.881556+0000 mgr.a (mgr.14388) 785 : audit [DBG] from='client.30210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:49.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:48 smithi049 bash[23528]: cluster 2024-09-20T22:32:47.109013+0000 mgr.a (mgr.14388) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:49.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:48 smithi049 bash[23528]: audit 2024-09-20T22:32:47.554607+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:49.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:48 smithi049 bash[23528]: audit 2024-09-20T22:32:47.560307+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:49.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:48 smithi049 bash[23528]: audit 2024-09-20T22:32:47.567772+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:32:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:48 smithi049 bash[23528]: audit 2024-09-20T22:32:47.881556+0000 mgr.a (mgr.14388) 785 : audit [DBG] from='client.30210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:50.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:50 smithi179 bash[23186]: cluster 2024-09-20T22:32:49.110106+0000 mgr.a (mgr.14388) 786 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:50.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:50 smithi044 bash[22676]: cluster 2024-09-20T22:32:49.110106+0000 mgr.a (mgr.14388) 786 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:51.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:50 smithi049 bash[23528]: cluster 2024-09-20T22:32:49.110106+0000 mgr.a (mgr.14388) 786 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:52 smithi044 bash[22676]: cluster 2024-09-20T22:32:51.111459+0000 mgr.a (mgr.14388) 787 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:52.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:52 smithi179 bash[23186]: cluster 2024-09-20T22:32:51.111459+0000 mgr.a (mgr.14388) 787 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:53.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:52 smithi049 bash[23528]: cluster 2024-09-20T22:32:51.111459+0000 mgr.a (mgr.14388) 787 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:53.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:53.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:53.317 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:54.111 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:54.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:54.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:54.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:54.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:32:54.910 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:54 smithi049 bash[23528]: cluster 2024-09-20T22:32:53.112119+0000 mgr.a (mgr.14388) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:54.911 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:54 smithi049 bash[23528]: audit 2024-09-20T22:32:53.655523+0000 mgr.a (mgr.14388) 789 : audit [DBG] from='client.30285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:54 smithi044 bash[22676]: cluster 2024-09-20T22:32:53.112119+0000 mgr.a (mgr.14388) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:54 smithi044 bash[22676]: audit 2024-09-20T22:32:53.655523+0000 mgr.a (mgr.14388) 789 : audit [DBG] from='client.30285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:54.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:54 smithi179 bash[23186]: cluster 2024-09-20T22:32:53.112119+0000 mgr.a (mgr.14388) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:54.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:54 smithi179 bash[23186]: audit 2024-09-20T22:32:53.655523+0000 mgr.a (mgr.14388) 789 : audit [DBG] from='client.30285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:32:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:56 smithi044 bash[22676]: cluster 2024-09-20T22:32:55.114512+0000 mgr.a (mgr.14388) 790 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:56.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:56 smithi179 bash[23186]: cluster 2024-09-20T22:32:55.114512+0000 mgr.a (mgr.14388) 790 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:57.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:56 smithi049 bash[23528]: cluster 2024-09-20T22:32:55.114512+0000 mgr.a (mgr.14388) 790 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:32:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:32:58 smithi044 bash[22676]: cluster 2024-09-20T22:32:57.115407+0000 mgr.a (mgr.14388) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:58.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:32:58 smithi179 bash[23186]: cluster 2024-09-20T22:32:57.115407+0000 mgr.a (mgr.14388) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:59.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:32:58 smithi049 bash[23528]: cluster 2024-09-20T22:32:57.115407+0000 mgr.a (mgr.14388) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:32:59.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:32:59.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:32:59.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:32:59.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:32:59.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:32:59.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:32:59.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:32:59.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:00 smithi044 bash[22676]: cluster 2024-09-20T22:32:59.116087+0000 mgr.a (mgr.14388) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:00 smithi044 bash[22676]: audit 2024-09-20T22:32:59.443843+0000 mgr.a (mgr.14388) 793 : audit [DBG] from='client.30363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:00.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:00 smithi179 bash[23186]: cluster 2024-09-20T22:32:59.116087+0000 mgr.a (mgr.14388) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:00.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:00 smithi179 bash[23186]: audit 2024-09-20T22:32:59.443843+0000 mgr.a (mgr.14388) 793 : audit [DBG] from='client.30363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:01.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:00 smithi049 bash[23528]: cluster 2024-09-20T22:32:59.116087+0000 mgr.a (mgr.14388) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:01.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:00 smithi049 bash[23528]: audit 2024-09-20T22:32:59.443843+0000 mgr.a (mgr.14388) 793 : audit [DBG] from='client.30363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:02.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:02 smithi049 bash[23528]: cluster 2024-09-20T22:33:01.118541+0000 mgr.a (mgr.14388) 794 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:02 smithi044 bash[22676]: cluster 2024-09-20T22:33:01.118541+0000 mgr.a (mgr.14388) 794 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:02.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:02 smithi179 bash[23186]: cluster 2024-09-20T22:33:01.118541+0000 mgr.a (mgr.14388) 794 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:04.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:04.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:04.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:04 smithi044 bash[22676]: cluster 2024-09-20T22:33:03.119370+0000 mgr.a (mgr.14388) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:04.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:04 smithi179 bash[23186]: cluster 2024-09-20T22:33:03.119370+0000 mgr.a (mgr.14388) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:05.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:04 smithi049 bash[23528]: cluster 2024-09-20T22:33:03.119370+0000 mgr.a (mgr.14388) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:05.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:05.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:05.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:05.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:05.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: cluster 2024-09-20T22:33:05.121329+0000 mgr.a (mgr.14388) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: audit 2024-09-20T22:33:05.215290+0000 mgr.a (mgr.14388) 797 : audit [DBG] from='client.30435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: audit 2024-09-20T22:33:05.553013+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: audit 2024-09-20T22:33:05.561866+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: audit 2024-09-20T22:33:05.571153+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: audit 2024-09-20T22:33:05.911540+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: audit 2024-09-20T22:33:05.920316+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:06 smithi044 bash[22676]: audit 2024-09-20T22:33:05.930337+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: cluster 2024-09-20T22:33:05.121329+0000 mgr.a (mgr.14388) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:06.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: audit 2024-09-20T22:33:05.215290+0000 mgr.a (mgr.14388) 797 : audit [DBG] from='client.30435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:06.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: audit 2024-09-20T22:33:05.553013+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: audit 2024-09-20T22:33:05.561866+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: audit 2024-09-20T22:33:05.571153+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: audit 2024-09-20T22:33:05.911540+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: audit 2024-09-20T22:33:05.920316+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:06.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:06 smithi179 bash[23186]: audit 2024-09-20T22:33:05.930337+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:07.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: cluster 2024-09-20T22:33:05.121329+0000 mgr.a (mgr.14388) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:07.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: audit 2024-09-20T22:33:05.215290+0000 mgr.a (mgr.14388) 797 : audit [DBG] from='client.30435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:07.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: audit 2024-09-20T22:33:05.553013+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:07.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: audit 2024-09-20T22:33:05.561866+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:07.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: audit 2024-09-20T22:33:05.571153+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:07.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: audit 2024-09-20T22:33:05.911540+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:07.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: audit 2024-09-20T22:33:05.920316+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:07.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:06 smithi049 bash[23528]: audit 2024-09-20T22:33:05.930337+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:08 smithi049 bash[23528]: cluster 2024-09-20T22:33:07.122230+0000 mgr.a (mgr.14388) 798 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:09.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:08 smithi049 bash[23528]: audit 2024-09-20T22:33:07.782739+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:08 smithi049 bash[23528]: audit 2024-09-20T22:33:07.792530+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:08 smithi049 bash[23528]: audit 2024-09-20T22:33:07.804054+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:08 smithi044 bash[22676]: cluster 2024-09-20T22:33:07.122230+0000 mgr.a (mgr.14388) 798 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:08 smithi044 bash[22676]: audit 2024-09-20T22:33:07.782739+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:08 smithi044 bash[22676]: audit 2024-09-20T22:33:07.792530+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:08 smithi044 bash[22676]: audit 2024-09-20T22:33:07.804054+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:08 smithi179 bash[23186]: cluster 2024-09-20T22:33:07.122230+0000 mgr.a (mgr.14388) 798 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:09.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:08 smithi179 bash[23186]: audit 2024-09-20T22:33:07.782739+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:08 smithi179 bash[23186]: audit 2024-09-20T22:33:07.792530+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:09.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:08 smithi179 bash[23186]: audit 2024-09-20T22:33:07.804054+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:10.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:11.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:10 smithi049 bash[23528]: cluster 2024-09-20T22:33:09.123032+0000 mgr.a (mgr.14388) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:11.079 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:10 smithi179 bash[23186]: cluster 2024-09-20T22:33:09.123032+0000 mgr.a (mgr.14388) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:10 smithi044 bash[22676]: cluster 2024-09-20T22:33:09.123032+0000 mgr.a (mgr.14388) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:11.404 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:11.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:11.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:11.974 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:11 smithi044 bash[22676]: audit 2024-09-20T22:33:10.970317+0000 mgr.a (mgr.14388) 800 : audit [DBG] from='client.30513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:12.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:11 smithi049 bash[23528]: audit 2024-09-20T22:33:10.970317+0000 mgr.a (mgr.14388) 800 : audit [DBG] from='client.30513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:12.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:11 smithi179 bash[23186]: audit 2024-09-20T22:33:10.970317+0000 mgr.a (mgr.14388) 800 : audit [DBG] from='client.30513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:12.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:12 smithi044 bash[22676]: cluster 2024-09-20T22:33:11.124791+0000 mgr.a (mgr.14388) 801 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:12.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:12 smithi044 bash[22676]: audit 2024-09-20T22:33:12.670597+0000 mon.a (mon.0) 1436 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:33:12.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:12 smithi044 bash[22676]: audit 2024-09-20T22:33:12.677896+0000 mon.a (mon.0) 1437 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:33:12.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:12 smithi044 bash[22676]: audit 2024-09-20T22:33:12.679594+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:33:12.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:12 smithi044 bash[22676]: audit 2024-09-20T22:33:12.689899+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:12.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:12 smithi044 bash[22676]: audit 2024-09-20T22:33:12.696395+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:33:13.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:12 smithi049 bash[23528]: cluster 2024-09-20T22:33:11.124791+0000 mgr.a (mgr.14388) 801 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:13.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:12 smithi049 bash[23528]: audit 2024-09-20T22:33:12.670597+0000 mon.a (mon.0) 1436 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:33:13.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:12 smithi049 bash[23528]: audit 2024-09-20T22:33:12.677896+0000 mon.a (mon.0) 1437 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:33:13.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:12 smithi049 bash[23528]: audit 2024-09-20T22:33:12.679594+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:33:13.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:12 smithi049 bash[23528]: audit 2024-09-20T22:33:12.689899+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:13.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:12 smithi049 bash[23528]: audit 2024-09-20T22:33:12.696395+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:33:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:12 smithi179 bash[23186]: cluster 2024-09-20T22:33:11.124791+0000 mgr.a (mgr.14388) 801 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:12 smithi179 bash[23186]: audit 2024-09-20T22:33:12.670597+0000 mon.a (mon.0) 1436 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:33:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:12 smithi179 bash[23186]: audit 2024-09-20T22:33:12.677896+0000 mon.a (mon.0) 1437 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:33:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:12 smithi179 bash[23186]: audit 2024-09-20T22:33:12.679594+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:33:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:12 smithi179 bash[23186]: audit 2024-09-20T22:33:12.689899+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:12 smithi179 bash[23186]: audit 2024-09-20T22:33:12.696395+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:33:13.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:33:13 smithi044 bash[22930]: debug 2024-09-20T22:33:13.427+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:33:13.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:33:13 smithi044 bash[22930]: debug 2024-09-20T22:33:13.427+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:33:14.190 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:13 smithi044 bash[22676]: audit 2024-09-20T22:33:12.698934+0000 mgr.a (mgr.14388) 802 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:33:14.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:13 smithi179 bash[23186]: audit 2024-09-20T22:33:12.698934+0000 mgr.a (mgr.14388) 802 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:33:14.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:13 smithi049 bash[23528]: audit 2024-09-20T22:33:12.698934+0000 mgr.a (mgr.14388) 802 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:33:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:14 smithi044 bash[22676]: cluster 2024-09-20T22:33:13.125276+0000 mgr.a (mgr.14388) 803 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:14 smithi044 bash[22676]: audit 2024-09-20T22:33:13.429449+0000 mgr.a (mgr.14388) 804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:33:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:14 smithi044 bash[22676]: cephadm 2024-09-20T22:33:13.430637+0000 mgr.a (mgr.14388) 805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:33:15.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:14 smithi179 bash[23186]: cluster 2024-09-20T22:33:13.125276+0000 mgr.a (mgr.14388) 803 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:15.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:14 smithi179 bash[23186]: audit 2024-09-20T22:33:13.429449+0000 mgr.a (mgr.14388) 804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:33:15.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:14 smithi179 bash[23186]: cephadm 2024-09-20T22:33:13.430637+0000 mgr.a (mgr.14388) 805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:33:15.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:14 smithi049 bash[23528]: cluster 2024-09-20T22:33:13.125276+0000 mgr.a (mgr.14388) 803 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:15.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:14 smithi049 bash[23528]: audit 2024-09-20T22:33:13.429449+0000 mgr.a (mgr.14388) 804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:33:15.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:14 smithi049 bash[23528]: cephadm 2024-09-20T22:33:13.430637+0000 mgr.a (mgr.14388) 805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:33:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:16.978 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:16 smithi049 bash[23528]: cluster 2024-09-20T22:33:15.127445+0000 mgr.a (mgr.14388) 806 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:16 smithi044 bash[22676]: cluster 2024-09-20T22:33:15.127445+0000 mgr.a (mgr.14388) 806 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:17.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:16 smithi179 bash[23186]: cluster 2024-09-20T22:33:15.127445+0000 mgr.a (mgr.14388) 806 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:17 smithi044 bash[22676]: audit 2024-09-20T22:33:16.738276+0000 mgr.a (mgr.14388) 807 : audit [DBG] from='client.30690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:18.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:17 smithi179 bash[23186]: audit 2024-09-20T22:33:16.738276+0000 mgr.a (mgr.14388) 807 : audit [DBG] from='client.30690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:18.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:17 smithi049 bash[23528]: audit 2024-09-20T22:33:16.738276+0000 mgr.a (mgr.14388) 807 : audit [DBG] from='client.30690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:19.203 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:18 smithi049 bash[23528]: cluster 2024-09-20T22:33:17.127969+0000 mgr.a (mgr.14388) 808 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:18 smithi044 bash[22676]: cluster 2024-09-20T22:33:17.127969+0000 mgr.a (mgr.14388) 808 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:19.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:18 smithi179 bash[23186]: cluster 2024-09-20T22:33:17.127969+0000 mgr.a (mgr.14388) 808 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:20 smithi044 bash[22676]: cluster 2024-09-20T22:33:19.128831+0000 mgr.a (mgr.14388) 809 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:21.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:20 smithi179 bash[23186]: cluster 2024-09-20T22:33:19.128831+0000 mgr.a (mgr.14388) 809 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:21.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:20 smithi049 bash[23528]: cluster 2024-09-20T22:33:19.128831+0000 mgr.a (mgr.14388) 809 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:22.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:22.908 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:22 smithi044 bash[22676]: cluster 2024-09-20T22:33:21.131076+0000 mgr.a (mgr.14388) 810 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:23.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:22 smithi179 bash[23186]: cluster 2024-09-20T22:33:21.131076+0000 mgr.a (mgr.14388) 810 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:23.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:22 smithi049 bash[23528]: cluster 2024-09-20T22:33:21.131076+0000 mgr.a (mgr.14388) 810 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:23 smithi044 bash[22676]: audit 2024-09-20T22:33:22.475951+0000 mgr.a (mgr.14388) 811 : audit [DBG] from='client.30765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:24.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:23 smithi179 bash[23186]: audit 2024-09-20T22:33:22.475951+0000 mgr.a (mgr.14388) 811 : audit [DBG] from='client.30765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:24.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:23 smithi049 bash[23528]: audit 2024-09-20T22:33:22.475951+0000 mgr.a (mgr.14388) 811 : audit [DBG] from='client.30765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:24 smithi044 bash[22676]: cluster 2024-09-20T22:33:23.132046+0000 mgr.a (mgr.14388) 812 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:25.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:24 smithi179 bash[23186]: cluster 2024-09-20T22:33:23.132046+0000 mgr.a (mgr.14388) 812 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:25.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:24 smithi049 bash[23528]: cluster 2024-09-20T22:33:23.132046+0000 mgr.a (mgr.14388) 812 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:27.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:26 smithi049 bash[23528]: cluster 2024-09-20T22:33:25.134216+0000 mgr.a (mgr.14388) 813 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:27.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:26 smithi049 bash[23528]: audit 2024-09-20T22:33:25.762694+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:26 smithi049 bash[23528]: audit 2024-09-20T22:33:25.771493+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:26 smithi049 bash[23528]: audit 2024-09-20T22:33:25.781873+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:26 smithi049 bash[23528]: audit 2024-09-20T22:33:26.147130+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:26 smithi049 bash[23528]: audit 2024-09-20T22:33:26.156112+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:26 smithi049 bash[23528]: audit 2024-09-20T22:33:26.166141+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:26 smithi044 bash[22676]: cluster 2024-09-20T22:33:25.134216+0000 mgr.a (mgr.14388) 813 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:26 smithi044 bash[22676]: audit 2024-09-20T22:33:25.762694+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:26 smithi044 bash[22676]: audit 2024-09-20T22:33:25.771493+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:26 smithi044 bash[22676]: audit 2024-09-20T22:33:25.781873+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:26 smithi044 bash[22676]: audit 2024-09-20T22:33:26.147130+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:26 smithi044 bash[22676]: audit 2024-09-20T22:33:26.156112+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:26 smithi044 bash[22676]: audit 2024-09-20T22:33:26.166141+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:26 smithi179 bash[23186]: cluster 2024-09-20T22:33:25.134216+0000 mgr.a (mgr.14388) 813 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:33:27.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:26 smithi179 bash[23186]: audit 2024-09-20T22:33:25.762694+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:26 smithi179 bash[23186]: audit 2024-09-20T22:33:25.771493+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:26 smithi179 bash[23186]: audit 2024-09-20T22:33:25.781873+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:26 smithi179 bash[23186]: audit 2024-09-20T22:33:26.147130+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:26 smithi179 bash[23186]: audit 2024-09-20T22:33:26.156112+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:26 smithi179 bash[23186]: audit 2024-09-20T22:33:26.166141+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:27.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:27.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:27.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:28.692 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:29.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:29 smithi049 bash[23528]: cluster 2024-09-20T22:33:27.135134+0000 mgr.a (mgr.14388) 814 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:29.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:29 smithi049 bash[23528]: audit 2024-09-20T22:33:28.003145+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:29 smithi049 bash[23528]: audit 2024-09-20T22:33:28.010047+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:29 smithi049 bash[23528]: audit 2024-09-20T22:33:28.017174+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:29 smithi044 bash[22676]: cluster 2024-09-20T22:33:27.135134+0000 mgr.a (mgr.14388) 814 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:29 smithi044 bash[22676]: audit 2024-09-20T22:33:28.003145+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:29 smithi044 bash[22676]: audit 2024-09-20T22:33:28.010047+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:29 smithi044 bash[22676]: audit 2024-09-20T22:33:28.017174+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:29 smithi179 bash[23186]: cluster 2024-09-20T22:33:27.135134+0000 mgr.a (mgr.14388) 814 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:29 smithi179 bash[23186]: audit 2024-09-20T22:33:28.003145+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:29 smithi179 bash[23186]: audit 2024-09-20T22:33:28.010047+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:29 smithi179 bash[23186]: audit 2024-09-20T22:33:28.017174+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:30.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:30 smithi049 bash[23528]: audit 2024-09-20T22:33:28.252192+0000 mgr.a (mgr.14388) 815 : audit [DBG] from='client.30843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:30 smithi044 bash[22676]: audit 2024-09-20T22:33:28.252192+0000 mgr.a (mgr.14388) 815 : audit [DBG] from='client.30843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:30.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:30 smithi179 bash[23186]: audit 2024-09-20T22:33:28.252192+0000 mgr.a (mgr.14388) 815 : audit [DBG] from='client.30843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:31.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:31 smithi049 bash[23528]: cluster 2024-09-20T22:33:29.136138+0000 mgr.a (mgr.14388) 816 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:31 smithi044 bash[22676]: cluster 2024-09-20T22:33:29.136138+0000 mgr.a (mgr.14388) 816 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:31.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:31 smithi179 bash[23186]: cluster 2024-09-20T22:33:29.136138+0000 mgr.a (mgr.14388) 816 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:33.164 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:33 smithi179 bash[23186]: cluster 2024-09-20T22:33:31.138453+0000 mgr.a (mgr.14388) 817 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:33.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:33 smithi049 bash[23528]: cluster 2024-09-20T22:33:31.138453+0000 mgr.a (mgr.14388) 817 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:33 smithi044 bash[22676]: cluster 2024-09-20T22:33:31.138453+0000 mgr.a (mgr.14388) 817 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:33.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:33.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:33.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:34.466 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:35.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:35 smithi049 bash[23528]: cluster 2024-09-20T22:33:33.139146+0000 mgr.a (mgr.14388) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:35.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:35 smithi049 bash[23528]: audit 2024-09-20T22:33:34.031739+0000 mgr.a (mgr.14388) 819 : audit [DBG] from='client.30918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:35 smithi044 bash[22676]: cluster 2024-09-20T22:33:33.139146+0000 mgr.a (mgr.14388) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:35 smithi044 bash[22676]: audit 2024-09-20T22:33:34.031739+0000 mgr.a (mgr.14388) 819 : audit [DBG] from='client.30918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:35.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:35 smithi179 bash[23186]: cluster 2024-09-20T22:33:33.139146+0000 mgr.a (mgr.14388) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:35.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:35 smithi179 bash[23186]: audit 2024-09-20T22:33:34.031739+0000 mgr.a (mgr.14388) 819 : audit [DBG] from='client.30918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:37.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:37 smithi049 bash[23528]: cluster 2024-09-20T22:33:35.141545+0000 mgr.a (mgr.14388) 820 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:37 smithi044 bash[22676]: cluster 2024-09-20T22:33:35.141545+0000 mgr.a (mgr.14388) 820 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:37.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:37 smithi179 bash[23186]: cluster 2024-09-20T22:33:35.141545+0000 mgr.a (mgr.14388) 820 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:39.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:39 smithi049 bash[23528]: cluster 2024-09-20T22:33:37.142312+0000 mgr.a (mgr.14388) 821 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:39.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:39.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:39.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:39 smithi044 bash[22676]: cluster 2024-09-20T22:33:37.142312+0000 mgr.a (mgr.14388) 821 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:39.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:39 smithi179 bash[23186]: cluster 2024-09-20T22:33:37.142312+0000 mgr.a (mgr.14388) 821 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:40.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:40.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:40.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:40.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:41.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:41 smithi049 bash[23528]: cluster 2024-09-20T22:33:39.143057+0000 mgr.a (mgr.14388) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:41.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:41 smithi049 bash[23528]: audit 2024-09-20T22:33:39.802193+0000 mgr.a (mgr.14388) 823 : audit [DBG] from='client.30996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:41 smithi044 bash[22676]: cluster 2024-09-20T22:33:39.143057+0000 mgr.a (mgr.14388) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:41 smithi044 bash[22676]: audit 2024-09-20T22:33:39.802193+0000 mgr.a (mgr.14388) 823 : audit [DBG] from='client.30996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:41.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:41 smithi179 bash[23186]: cluster 2024-09-20T22:33:39.143057+0000 mgr.a (mgr.14388) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:41.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:41 smithi179 bash[23186]: audit 2024-09-20T22:33:39.802193+0000 mgr.a (mgr.14388) 823 : audit [DBG] from='client.30996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:43.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:43 smithi049 bash[23528]: cluster 2024-09-20T22:33:41.145933+0000 mgr.a (mgr.14388) 824 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:43 smithi044 bash[22676]: cluster 2024-09-20T22:33:41.145933+0000 mgr.a (mgr.14388) 824 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:43.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:43 smithi179 bash[23186]: cluster 2024-09-20T22:33:41.145933+0000 mgr.a (mgr.14388) 824 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:45.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:45.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:45.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:45.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:45 smithi049 bash[23528]: cluster 2024-09-20T22:33:43.146748+0000 mgr.a (mgr.14388) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:45 smithi044 bash[22676]: cluster 2024-09-20T22:33:43.146748+0000 mgr.a (mgr.14388) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:45.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:45 smithi179 bash[23186]: cluster 2024-09-20T22:33:43.146748+0000 mgr.a (mgr.14388) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:45.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: cluster 2024-09-20T22:33:45.148712+0000 mgr.a (mgr.14388) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: audit 2024-09-20T22:33:45.571967+0000 mgr.a (mgr.14388) 827 : audit [DBG] from='client.31065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: audit 2024-09-20T22:33:45.971604+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: audit 2024-09-20T22:33:45.977202+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: audit 2024-09-20T22:33:45.983278+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: audit 2024-09-20T22:33:46.378439+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: audit 2024-09-20T22:33:46.388084+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:46 smithi044 bash[22676]: audit 2024-09-20T22:33:46.399402+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: cluster 2024-09-20T22:33:45.148712+0000 mgr.a (mgr.14388) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:47.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: audit 2024-09-20T22:33:45.571967+0000 mgr.a (mgr.14388) 827 : audit [DBG] from='client.31065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:47.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: audit 2024-09-20T22:33:45.971604+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: audit 2024-09-20T22:33:45.977202+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: audit 2024-09-20T22:33:45.983278+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: audit 2024-09-20T22:33:46.378439+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: audit 2024-09-20T22:33:46.388084+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:46 smithi179 bash[23186]: audit 2024-09-20T22:33:46.399402+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: cluster 2024-09-20T22:33:45.148712+0000 mgr.a (mgr.14388) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: audit 2024-09-20T22:33:45.571967+0000 mgr.a (mgr.14388) 827 : audit [DBG] from='client.31065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: audit 2024-09-20T22:33:45.971604+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: audit 2024-09-20T22:33:45.977202+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: audit 2024-09-20T22:33:45.983278+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: audit 2024-09-20T22:33:46.378439+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: audit 2024-09-20T22:33:46.388084+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:47.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:46 smithi049 bash[23528]: audit 2024-09-20T22:33:46.399402+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:48 smithi044 bash[22676]: cluster 2024-09-20T22:33:47.149594+0000 mgr.a (mgr.14388) 828 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:48 smithi044 bash[22676]: audit 2024-09-20T22:33:48.224048+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:48 smithi044 bash[22676]: audit 2024-09-20T22:33:48.232906+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:48 smithi044 bash[22676]: audit 2024-09-20T22:33:48.241117+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:48 smithi179 bash[23186]: cluster 2024-09-20T22:33:47.149594+0000 mgr.a (mgr.14388) 828 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:49.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:48 smithi179 bash[23186]: audit 2024-09-20T22:33:48.224048+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:48 smithi179 bash[23186]: audit 2024-09-20T22:33:48.232906+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:48 smithi179 bash[23186]: audit 2024-09-20T22:33:48.241117+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:48 smithi049 bash[23528]: cluster 2024-09-20T22:33:47.149594+0000 mgr.a (mgr.14388) 828 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:33:49.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:48 smithi049 bash[23528]: audit 2024-09-20T22:33:48.224048+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:48 smithi049 bash[23528]: audit 2024-09-20T22:33:48.232906+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:49.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:48 smithi049 bash[23528]: audit 2024-09-20T22:33:48.241117+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:33:50.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:50 smithi044 bash[22676]: cluster 2024-09-20T22:33:49.150362+0000 mgr.a (mgr.14388) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:51.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:50 smithi179 bash[23186]: cluster 2024-09-20T22:33:49.150362+0000 mgr.a (mgr.14388) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:51.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:50 smithi049 bash[23528]: cluster 2024-09-20T22:33:49.150362+0000 mgr.a (mgr.14388) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:33:51.748 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:51.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:51.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:51.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:51.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:53.161 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:52 smithi179 bash[23186]: cluster 2024-09-20T22:33:51.152505+0000 mgr.a (mgr.14388) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:53.162 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:52 smithi179 bash[23186]: audit 2024-09-20T22:33:51.326808+0000 mgr.a (mgr.14388) 831 : audit [DBG] from='client.31140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:53.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:52 smithi044 bash[22676]: cluster 2024-09-20T22:33:51.152505+0000 mgr.a (mgr.14388) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:53.234 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:52 smithi044 bash[22676]: audit 2024-09-20T22:33:51.326808+0000 mgr.a (mgr.14388) 831 : audit [DBG] from='client.31140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:53.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:52 smithi049 bash[23528]: cluster 2024-09-20T22:33:51.152505+0000 mgr.a (mgr.14388) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:53.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:52 smithi049 bash[23528]: audit 2024-09-20T22:33:51.326808+0000 mgr.a (mgr.14388) 831 : audit [DBG] from='client.31140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:54 smithi044 bash[22676]: cluster 2024-09-20T22:33:53.153426+0000 mgr.a (mgr.14388) 832 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:55.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:54 smithi179 bash[23186]: cluster 2024-09-20T22:33:53.153426+0000 mgr.a (mgr.14388) 832 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:55.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:54 smithi049 bash[23528]: cluster 2024-09-20T22:33:53.153426+0000 mgr.a (mgr.14388) 832 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:56.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:33:56.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:33:56.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:33:57.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:56 smithi179 bash[23186]: cluster 2024-09-20T22:33:55.155969+0000 mgr.a (mgr.14388) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:57.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:56 smithi049 bash[23528]: cluster 2024-09-20T22:33:55.155969+0000 mgr.a (mgr.14388) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:56 smithi044 bash[22676]: cluster 2024-09-20T22:33:55.155969+0000 mgr.a (mgr.14388) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:33:57.500 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:33:57.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:33:57.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:33:57.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:33:57.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:33:58.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:58 smithi049 bash[23528]: audit 2024-09-20T22:33:57.083879+0000 mgr.a (mgr.14388) 834 : audit [DBG] from='client.31218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:58 smithi044 bash[22676]: audit 2024-09-20T22:33:57.083879+0000 mgr.a (mgr.14388) 834 : audit [DBG] from='client.31218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:58.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:58 smithi179 bash[23186]: audit 2024-09-20T22:33:57.083879+0000 mgr.a (mgr.14388) 834 : audit [DBG] from='client.31218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:33:59.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:33:59 smithi049 bash[23528]: cluster 2024-09-20T22:33:57.156533+0000 mgr.a (mgr.14388) 835 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:33:59 smithi044 bash[22676]: cluster 2024-09-20T22:33:57.156533+0000 mgr.a (mgr.14388) 835 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:33:59.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:33:59 smithi179 bash[23186]: cluster 2024-09-20T22:33:57.156533+0000 mgr.a (mgr.14388) 835 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:01.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:01 smithi049 bash[23528]: cluster 2024-09-20T22:33:59.157532+0000 mgr.a (mgr.14388) 836 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:01 smithi044 bash[22676]: cluster 2024-09-20T22:33:59.157532+0000 mgr.a (mgr.14388) 836 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:01.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:01 smithi179 bash[23186]: cluster 2024-09-20T22:33:59.157532+0000 mgr.a (mgr.14388) 836 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:02.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:02.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:03.283 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:03.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:03.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:03.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:03.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:03.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:03 smithi049 bash[23528]: cluster 2024-09-20T22:34:01.159861+0000 mgr.a (mgr.14388) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:03 smithi044 bash[22676]: cluster 2024-09-20T22:34:01.159861+0000 mgr.a (mgr.14388) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:03 smithi179 bash[23186]: cluster 2024-09-20T22:34:01.159861+0000 mgr.a (mgr.14388) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:04.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:04 smithi049 bash[23528]: audit 2024-09-20T22:34:02.842981+0000 mgr.a (mgr.14388) 838 : audit [DBG] from='client.31296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:04 smithi044 bash[22676]: audit 2024-09-20T22:34:02.842981+0000 mgr.a (mgr.14388) 838 : audit [DBG] from='client.31296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:04.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:04 smithi179 bash[23186]: audit 2024-09-20T22:34:02.842981+0000 mgr.a (mgr.14388) 838 : audit [DBG] from='client.31296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:05.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:05 smithi049 bash[23528]: cluster 2024-09-20T22:34:03.160578+0000 mgr.a (mgr.14388) 839 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:05 smithi044 bash[22676]: cluster 2024-09-20T22:34:03.160578+0000 mgr.a (mgr.14388) 839 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:05.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:05 smithi179 bash[23186]: cluster 2024-09-20T22:34:03.160578+0000 mgr.a (mgr.14388) 839 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:07 smithi049 bash[23528]: cluster 2024-09-20T22:34:05.162816+0000 mgr.a (mgr.14388) 840 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:07 smithi049 bash[23528]: audit 2024-09-20T22:34:06.197321+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:07 smithi049 bash[23528]: audit 2024-09-20T22:34:06.207190+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:07 smithi049 bash[23528]: audit 2024-09-20T22:34:06.219250+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:07 smithi049 bash[23528]: audit 2024-09-20T22:34:06.612557+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:07 smithi049 bash[23528]: audit 2024-09-20T22:34:06.622433+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:07 smithi049 bash[23528]: audit 2024-09-20T22:34:06.634154+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:07 smithi044 bash[22676]: cluster 2024-09-20T22:34:05.162816+0000 mgr.a (mgr.14388) 840 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:07 smithi044 bash[22676]: audit 2024-09-20T22:34:06.197321+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:07 smithi044 bash[22676]: audit 2024-09-20T22:34:06.207190+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:07 smithi044 bash[22676]: audit 2024-09-20T22:34:06.219250+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:07 smithi044 bash[22676]: audit 2024-09-20T22:34:06.612557+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:07 smithi044 bash[22676]: audit 2024-09-20T22:34:06.622433+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:07 smithi044 bash[22676]: audit 2024-09-20T22:34:06.634154+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:07 smithi179 bash[23186]: cluster 2024-09-20T22:34:05.162816+0000 mgr.a (mgr.14388) 840 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:07.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:07 smithi179 bash[23186]: audit 2024-09-20T22:34:06.197321+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:07 smithi179 bash[23186]: audit 2024-09-20T22:34:06.207190+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:07 smithi179 bash[23186]: audit 2024-09-20T22:34:06.219250+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:07 smithi179 bash[23186]: audit 2024-09-20T22:34:06.612557+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:07 smithi179 bash[23186]: audit 2024-09-20T22:34:06.622433+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:07 smithi179 bash[23186]: audit 2024-09-20T22:34:06.634154+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:08.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:08.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:08.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:09.084 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:09.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:09 smithi049 bash[23528]: cluster 2024-09-20T22:34:07.163579+0000 mgr.a (mgr.14388) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:09 smithi049 bash[23528]: audit 2024-09-20T22:34:08.425975+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:09 smithi049 bash[23528]: audit 2024-09-20T22:34:08.432410+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:09 smithi049 bash[23528]: audit 2024-09-20T22:34:08.440086+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:09 smithi044 bash[22676]: cluster 2024-09-20T22:34:07.163579+0000 mgr.a (mgr.14388) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:09 smithi044 bash[22676]: audit 2024-09-20T22:34:08.425975+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:09 smithi044 bash[22676]: audit 2024-09-20T22:34:08.432410+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:09 smithi044 bash[22676]: audit 2024-09-20T22:34:08.440086+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:09 smithi179 bash[23186]: cluster 2024-09-20T22:34:07.163579+0000 mgr.a (mgr.14388) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:09.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:09 smithi179 bash[23186]: audit 2024-09-20T22:34:08.425975+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:09 smithi179 bash[23186]: audit 2024-09-20T22:34:08.432410+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:09.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:09 smithi179 bash[23186]: audit 2024-09-20T22:34:08.440086+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:10.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:10 smithi049 bash[23528]: audit 2024-09-20T22:34:08.630207+0000 mgr.a (mgr.14388) 842 : audit [DBG] from='client.31374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:10 smithi044 bash[22676]: audit 2024-09-20T22:34:08.630207+0000 mgr.a (mgr.14388) 842 : audit [DBG] from='client.31374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:10.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:10 smithi179 bash[23186]: audit 2024-09-20T22:34:08.630207+0000 mgr.a (mgr.14388) 842 : audit [DBG] from='client.31374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:11.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:11 smithi049 bash[23528]: cluster 2024-09-20T22:34:09.164136+0000 mgr.a (mgr.14388) 843 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:11 smithi044 bash[22676]: cluster 2024-09-20T22:34:09.164136+0000 mgr.a (mgr.14388) 843 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:11.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:11 smithi179 bash[23186]: cluster 2024-09-20T22:34:09.164136+0000 mgr.a (mgr.14388) 843 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:13 smithi044 bash[22676]: cluster 2024-09-20T22:34:11.166347+0000 mgr.a (mgr.14388) 844 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:13.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:13 smithi179 bash[23186]: cluster 2024-09-20T22:34:11.166347+0000 mgr.a (mgr.14388) 844 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:13.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:13 smithi049 bash[23528]: cluster 2024-09-20T22:34:11.166347+0000 mgr.a (mgr.14388) 844 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:14 smithi044 bash[22676]: audit 2024-09-20T22:34:13.479235+0000 mon.a (mon.0) 1468 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:34:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:14 smithi044 bash[22676]: audit 2024-09-20T22:34:13.486520+0000 mon.a (mon.0) 1469 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:34:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:14 smithi044 bash[22676]: audit 2024-09-20T22:34:13.488512+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:34:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:14 smithi044 bash[22676]: audit 2024-09-20T22:34:13.500262+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:14 smithi044 bash[22676]: audit 2024-09-20T22:34:13.506645+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:34:14.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:14 smithi179 bash[23186]: audit 2024-09-20T22:34:13.479235+0000 mon.a (mon.0) 1468 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:34:14.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:14 smithi179 bash[23186]: audit 2024-09-20T22:34:13.486520+0000 mon.a (mon.0) 1469 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:34:14.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:14 smithi179 bash[23186]: audit 2024-09-20T22:34:13.488512+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:34:14.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:14 smithi179 bash[23186]: audit 2024-09-20T22:34:13.500262+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:14.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:14 smithi179 bash[23186]: audit 2024-09-20T22:34:13.506645+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:34:14.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:14 smithi049 bash[23528]: audit 2024-09-20T22:34:13.479235+0000 mon.a (mon.0) 1468 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:34:14.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:14 smithi049 bash[23528]: audit 2024-09-20T22:34:13.486520+0000 mon.a (mon.0) 1469 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:34:14.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:14 smithi049 bash[23528]: audit 2024-09-20T22:34:13.488512+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:34:14.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:14 smithi049 bash[23528]: audit 2024-09-20T22:34:13.500262+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:14.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:14 smithi049 bash[23528]: audit 2024-09-20T22:34:13.506645+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:34:14.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:34:14 smithi044 bash[22930]: debug 2024-09-20T22:34:14.246+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:34:14.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:34:14 smithi044 bash[22930]: debug 2024-09-20T22:34:14.246+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:34:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:14.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:14.803 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:15.364 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:15 smithi179 bash[23186]: cluster 2024-09-20T22:34:13.167203+0000 mgr.a (mgr.14388) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:15.364 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:15 smithi179 bash[23186]: audit 2024-09-20T22:34:13.509025+0000 mgr.a (mgr.14388) 846 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:34:15.397 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:15 smithi044 bash[22676]: cluster 2024-09-20T22:34:13.167203+0000 mgr.a (mgr.14388) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:15.397 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:15 smithi044 bash[22676]: audit 2024-09-20T22:34:13.509025+0000 mgr.a (mgr.14388) 846 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:34:15.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:15 smithi049 bash[23528]: cluster 2024-09-20T22:34:13.167203+0000 mgr.a (mgr.14388) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:15 smithi049 bash[23528]: audit 2024-09-20T22:34:13.509025+0000 mgr.a (mgr.14388) 846 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:34:16.423 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:16 smithi044 bash[22676]: audit 2024-09-20T22:34:14.251086+0000 mgr.a (mgr.14388) 847 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:34:16.423 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:16 smithi044 bash[22676]: cephadm 2024-09-20T22:34:14.252304+0000 mgr.a (mgr.14388) 848 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:34:16.423 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:16 smithi044 bash[22676]: audit 2024-09-20T22:34:14.407148+0000 mgr.a (mgr.14388) 849 : audit [DBG] from='client.31554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:16.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:16 smithi179 bash[23186]: audit 2024-09-20T22:34:14.251086+0000 mgr.a (mgr.14388) 847 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:34:16.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:16 smithi179 bash[23186]: cephadm 2024-09-20T22:34:14.252304+0000 mgr.a (mgr.14388) 848 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:34:16.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:16 smithi179 bash[23186]: audit 2024-09-20T22:34:14.407148+0000 mgr.a (mgr.14388) 849 : audit [DBG] from='client.31554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:16.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:16 smithi049 bash[23528]: audit 2024-09-20T22:34:14.251086+0000 mgr.a (mgr.14388) 847 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:34:16.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:16 smithi049 bash[23528]: cephadm 2024-09-20T22:34:14.252304+0000 mgr.a (mgr.14388) 848 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:34:16.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:16 smithi049 bash[23528]: audit 2024-09-20T22:34:14.407148+0000 mgr.a (mgr.14388) 849 : audit [DBG] from='client.31554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:17 smithi044 bash[22676]: cluster 2024-09-20T22:34:15.168826+0000 mgr.a (mgr.14388) 850 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:17.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:17 smithi179 bash[23186]: cluster 2024-09-20T22:34:15.168826+0000 mgr.a (mgr.14388) 850 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:17.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:17 smithi049 bash[23528]: cluster 2024-09-20T22:34:15.168826+0000 mgr.a (mgr.14388) 850 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:19.479 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:19 smithi049 bash[23528]: cluster 2024-09-20T22:34:17.169604+0000 mgr.a (mgr.14388) 851 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:19 smithi044 bash[22676]: cluster 2024-09-20T22:34:17.169604+0000 mgr.a (mgr.14388) 851 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:19.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:19 smithi179 bash[23186]: cluster 2024-09-20T22:34:17.169604+0000 mgr.a (mgr.14388) 851 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:19.804 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:19.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:19.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:20.570 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:20.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:20.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:20.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:20.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:21 smithi044 bash[22676]: cluster 2024-09-20T22:34:19.170365+0000 mgr.a (mgr.14388) 852 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:21.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:21 smithi179 bash[23186]: cluster 2024-09-20T22:34:19.170365+0000 mgr.a (mgr.14388) 852 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:21.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:21 smithi049 bash[23528]: cluster 2024-09-20T22:34:19.170365+0000 mgr.a (mgr.14388) 852 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:22.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:22 smithi049 bash[23528]: audit 2024-09-20T22:34:20.146853+0000 mgr.a (mgr.14388) 853 : audit [DBG] from='client.31629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:22 smithi044 bash[22676]: audit 2024-09-20T22:34:20.146853+0000 mgr.a (mgr.14388) 853 : audit [DBG] from='client.31629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:22.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:22 smithi179 bash[23186]: audit 2024-09-20T22:34:20.146853+0000 mgr.a (mgr.14388) 853 : audit [DBG] from='client.31629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:23 smithi044 bash[22676]: cluster 2024-09-20T22:34:21.173090+0000 mgr.a (mgr.14388) 854 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:23.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:23 smithi179 bash[23186]: cluster 2024-09-20T22:34:21.173090+0000 mgr.a (mgr.14388) 854 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:23.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:23 smithi049 bash[23528]: cluster 2024-09-20T22:34:21.173090+0000 mgr.a (mgr.14388) 854 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:25 smithi044 bash[22676]: cluster 2024-09-20T22:34:23.173915+0000 mgr.a (mgr.14388) 855 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:34:25.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:25 smithi179 bash[23186]: cluster 2024-09-20T22:34:23.173915+0000 mgr.a (mgr.14388) 855 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:34:25.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:25 smithi049 bash[23528]: cluster 2024-09-20T22:34:23.173915+0000 mgr.a (mgr.14388) 855 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:34:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:25.573 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:25.573 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:26.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:26.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:26.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:26.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:26.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: cluster 2024-09-20T22:34:25.175856+0000 mgr.a (mgr.14388) 856 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: audit 2024-09-20T22:34:25.911843+0000 mgr.a (mgr.14388) 857 : audit [DBG] from='client.31704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: audit 2024-09-20T22:34:26.369434+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: audit 2024-09-20T22:34:26.374268+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: audit 2024-09-20T22:34:26.379452+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: audit 2024-09-20T22:34:26.845971+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: audit 2024-09-20T22:34:26.854728+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:27 smithi049 bash[23528]: audit 2024-09-20T22:34:26.864709+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: cluster 2024-09-20T22:34:25.175856+0000 mgr.a (mgr.14388) 856 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: audit 2024-09-20T22:34:25.911843+0000 mgr.a (mgr.14388) 857 : audit [DBG] from='client.31704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: audit 2024-09-20T22:34:26.369434+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: audit 2024-09-20T22:34:26.374268+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: audit 2024-09-20T22:34:26.379452+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: audit 2024-09-20T22:34:26.845971+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: audit 2024-09-20T22:34:26.854728+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:27 smithi044 bash[22676]: audit 2024-09-20T22:34:26.864709+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: cluster 2024-09-20T22:34:25.175856+0000 mgr.a (mgr.14388) 856 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:34:27.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: audit 2024-09-20T22:34:25.911843+0000 mgr.a (mgr.14388) 857 : audit [DBG] from='client.31704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:27.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: audit 2024-09-20T22:34:26.369434+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: audit 2024-09-20T22:34:26.374268+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: audit 2024-09-20T22:34:26.379452+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: audit 2024-09-20T22:34:26.845971+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: audit 2024-09-20T22:34:26.854728+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:27 smithi179 bash[23186]: audit 2024-09-20T22:34:26.864709+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:29 smithi044 bash[22676]: cluster 2024-09-20T22:34:27.176735+0000 mgr.a (mgr.14388) 858 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:34:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:29 smithi044 bash[22676]: audit 2024-09-20T22:34:28.631649+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:29 smithi044 bash[22676]: audit 2024-09-20T22:34:28.639191+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:29 smithi044 bash[22676]: audit 2024-09-20T22:34:28.648965+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:29 smithi179 bash[23186]: cluster 2024-09-20T22:34:27.176735+0000 mgr.a (mgr.14388) 858 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:34:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:29 smithi179 bash[23186]: audit 2024-09-20T22:34:28.631649+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:29 smithi179 bash[23186]: audit 2024-09-20T22:34:28.639191+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:29 smithi179 bash[23186]: audit 2024-09-20T22:34:28.648965+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:29 smithi049 bash[23528]: cluster 2024-09-20T22:34:27.176735+0000 mgr.a (mgr.14388) 858 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:34:29.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:29 smithi049 bash[23528]: audit 2024-09-20T22:34:28.631649+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:29 smithi049 bash[23528]: audit 2024-09-20T22:34:28.639191+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:29.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:29 smithi049 bash[23528]: audit 2024-09-20T22:34:28.648965+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:31.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:31 smithi044 bash[22676]: cluster 2024-09-20T22:34:29.177490+0000 mgr.a (mgr.14388) 859 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:34:31.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:31 smithi179 bash[23186]: cluster 2024-09-20T22:34:29.177490+0000 mgr.a (mgr.14388) 859 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:34:31.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:31 smithi049 bash[23528]: cluster 2024-09-20T22:34:29.177490+0000 mgr.a (mgr.14388) 859 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:34:32.132 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:32.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:32.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:32.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:32.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:32 smithi044 bash[22676]: cluster 2024-09-20T22:34:31.179689+0000 mgr.a (mgr.14388) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:32 smithi044 bash[22676]: audit 2024-09-20T22:34:31.688047+0000 mgr.a (mgr.14388) 861 : audit [DBG] from='client.31779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:32.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:32 smithi179 bash[23186]: cluster 2024-09-20T22:34:31.179689+0000 mgr.a (mgr.14388) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:32.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:32 smithi179 bash[23186]: audit 2024-09-20T22:34:31.688047+0000 mgr.a (mgr.14388) 861 : audit [DBG] from='client.31779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:32.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:32 smithi049 bash[23528]: cluster 2024-09-20T22:34:31.179689+0000 mgr.a (mgr.14388) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:32.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:32 smithi049 bash[23528]: audit 2024-09-20T22:34:31.688047+0000 mgr.a (mgr.14388) 861 : audit [DBG] from='client.31779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:34 smithi044 bash[22676]: cluster 2024-09-20T22:34:33.180595+0000 mgr.a (mgr.14388) 862 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:34.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:34 smithi179 bash[23186]: cluster 2024-09-20T22:34:33.180595+0000 mgr.a (mgr.14388) 862 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:34.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:34 smithi049 bash[23528]: cluster 2024-09-20T22:34:33.180595+0000 mgr.a (mgr.14388) 862 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:36.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:36 smithi179 bash[23186]: cluster 2024-09-20T22:34:35.182806+0000 mgr.a (mgr.14388) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:36.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:36 smithi049 bash[23528]: cluster 2024-09-20T22:34:35.182806+0000 mgr.a (mgr.14388) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:36 smithi044 bash[22676]: cluster 2024-09-20T22:34:35.182806+0000 mgr.a (mgr.14388) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:37.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:37.893 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:38.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:38 smithi179 bash[23186]: cluster 2024-09-20T22:34:37.183286+0000 mgr.a (mgr.14388) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:38.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:38 smithi179 bash[23186]: audit 2024-09-20T22:34:37.467152+0000 mgr.a (mgr.14388) 865 : audit [DBG] from='client.31854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:38.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:38 smithi049 bash[23528]: cluster 2024-09-20T22:34:37.183286+0000 mgr.a (mgr.14388) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:38.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:38 smithi049 bash[23528]: audit 2024-09-20T22:34:37.467152+0000 mgr.a (mgr.14388) 865 : audit [DBG] from='client.31854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:38 smithi044 bash[22676]: cluster 2024-09-20T22:34:37.183286+0000 mgr.a (mgr.14388) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:38 smithi044 bash[22676]: audit 2024-09-20T22:34:37.467152+0000 mgr.a (mgr.14388) 865 : audit [DBG] from='client.31854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:40.537 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:40 smithi049 bash[23528]: cluster 2024-09-20T22:34:39.184142+0000 mgr.a (mgr.14388) 866 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:40 smithi044 bash[22676]: cluster 2024-09-20T22:34:39.184142+0000 mgr.a (mgr.14388) 866 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:40.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:40 smithi179 bash[23186]: cluster 2024-09-20T22:34:39.184142+0000 mgr.a (mgr.14388) 866 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:42.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:42 smithi049 bash[23528]: cluster 2024-09-20T22:34:41.186404+0000 mgr.a (mgr.14388) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:42 smithi044 bash[22676]: cluster 2024-09-20T22:34:41.186404+0000 mgr.a (mgr.14388) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:42.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:42 smithi179 bash[23186]: cluster 2024-09-20T22:34:41.186404+0000 mgr.a (mgr.14388) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:42.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:42.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:42.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:43.680 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:44.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:44 smithi049 bash[23528]: cluster 2024-09-20T22:34:43.187116+0000 mgr.a (mgr.14388) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:44.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:44 smithi049 bash[23528]: audit 2024-09-20T22:34:43.232488+0000 mgr.a (mgr.14388) 869 : audit [DBG] from='client.31932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:44 smithi044 bash[22676]: cluster 2024-09-20T22:34:43.187116+0000 mgr.a (mgr.14388) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:44 smithi044 bash[22676]: audit 2024-09-20T22:34:43.232488+0000 mgr.a (mgr.14388) 869 : audit [DBG] from='client.31932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:44.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:44 smithi179 bash[23186]: cluster 2024-09-20T22:34:43.187116+0000 mgr.a (mgr.14388) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:44.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:44 smithi179 bash[23186]: audit 2024-09-20T22:34:43.232488+0000 mgr.a (mgr.14388) 869 : audit [DBG] from='client.31932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:46.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:46 smithi049 bash[23528]: cluster 2024-09-20T22:34:45.189359+0000 mgr.a (mgr.14388) 870 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:46.608 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:46 smithi179 bash[23186]: cluster 2024-09-20T22:34:45.189359+0000 mgr.a (mgr.14388) 870 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:46 smithi044 bash[22676]: cluster 2024-09-20T22:34:45.189359+0000 mgr.a (mgr.14388) 870 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:47 smithi044 bash[22676]: audit 2024-09-20T22:34:46.587392+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:47 smithi044 bash[22676]: audit 2024-09-20T22:34:46.595840+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:47 smithi044 bash[22676]: audit 2024-09-20T22:34:46.606133+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:47 smithi044 bash[22676]: audit 2024-09-20T22:34:47.078566+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:47 smithi044 bash[22676]: audit 2024-09-20T22:34:47.087421+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:47 smithi044 bash[22676]: audit 2024-09-20T22:34:47.097573+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:47 smithi179 bash[23186]: audit 2024-09-20T22:34:46.587392+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:47 smithi179 bash[23186]: audit 2024-09-20T22:34:46.595840+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:47 smithi179 bash[23186]: audit 2024-09-20T22:34:46.606133+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:47 smithi179 bash[23186]: audit 2024-09-20T22:34:47.078566+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:47 smithi179 bash[23186]: audit 2024-09-20T22:34:47.087421+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:47.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:47 smithi179 bash[23186]: audit 2024-09-20T22:34:47.097573+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:48.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:47 smithi049 bash[23528]: audit 2024-09-20T22:34:46.587392+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:48.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:47 smithi049 bash[23528]: audit 2024-09-20T22:34:46.595840+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:48.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:47 smithi049 bash[23528]: audit 2024-09-20T22:34:46.606133+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:48.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:47 smithi049 bash[23528]: audit 2024-09-20T22:34:47.078566+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:48.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:47 smithi049 bash[23528]: audit 2024-09-20T22:34:47.087421+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:48.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:47 smithi049 bash[23528]: audit 2024-09-20T22:34:47.097573+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:48.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:48.682 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:48.682 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:49.438 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:49.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:49.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:49.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:49.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:49 smithi044 bash[22676]: cluster 2024-09-20T22:34:47.190134+0000 mgr.a (mgr.14388) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:49 smithi044 bash[22676]: audit 2024-09-20T22:34:48.817601+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:49 smithi044 bash[22676]: audit 2024-09-20T22:34:48.822950+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:49 smithi044 bash[22676]: audit 2024-09-20T22:34:48.828273+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:49 smithi179 bash[23186]: cluster 2024-09-20T22:34:47.190134+0000 mgr.a (mgr.14388) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:49.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:49 smithi179 bash[23186]: audit 2024-09-20T22:34:48.817601+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:49 smithi179 bash[23186]: audit 2024-09-20T22:34:48.822950+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:49 smithi179 bash[23186]: audit 2024-09-20T22:34:48.828273+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:49 smithi049 bash[23528]: cluster 2024-09-20T22:34:47.190134+0000 mgr.a (mgr.14388) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:49.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:49 smithi049 bash[23528]: audit 2024-09-20T22:34:48.817601+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:49 smithi049 bash[23528]: audit 2024-09-20T22:34:48.822950+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:49.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:49 smithi049 bash[23528]: audit 2024-09-20T22:34:48.828273+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:34:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:50 smithi044 bash[22676]: audit 2024-09-20T22:34:49.021227+0000 mgr.a (mgr.14388) 872 : audit [DBG] from='client.32010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:50.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:50 smithi179 bash[23186]: audit 2024-09-20T22:34:49.021227+0000 mgr.a (mgr.14388) 872 : audit [DBG] from='client.32010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:50.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:50 smithi049 bash[23528]: audit 2024-09-20T22:34:49.021227+0000 mgr.a (mgr.14388) 872 : audit [DBG] from='client.32010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:51 smithi044 bash[22676]: cluster 2024-09-20T22:34:49.190771+0000 mgr.a (mgr.14388) 873 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:51.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:51 smithi179 bash[23186]: cluster 2024-09-20T22:34:49.190771+0000 mgr.a (mgr.14388) 873 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:51.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:51 smithi049 bash[23528]: cluster 2024-09-20T22:34:49.190771+0000 mgr.a (mgr.14388) 873 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:52 smithi044 bash[22676]: cluster 2024-09-20T22:34:51.193089+0000 mgr.a (mgr.14388) 874 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:52.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:52 smithi179 bash[23186]: cluster 2024-09-20T22:34:51.193089+0000 mgr.a (mgr.14388) 874 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:52.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:52 smithi049 bash[23528]: cluster 2024-09-20T22:34:51.193089+0000 mgr.a (mgr.14388) 874 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:34:54.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:34:54.440 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:34:54.440 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:34:54.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:54 smithi049 bash[23528]: cluster 2024-09-20T22:34:53.193856+0000 mgr.a (mgr.14388) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:54.582 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:54 smithi179 bash[23186]: cluster 2024-09-20T22:34:53.193856+0000 mgr.a (mgr.14388) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:54.691 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:54 smithi044 bash[22676]: cluster 2024-09-20T22:34:53.193856+0000 mgr.a (mgr.14388) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:55.191 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:34:55.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:34:55.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:34:55.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:34:55.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:34:55.512 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:55 smithi044 bash[22676]: audit 2024-09-20T22:34:54.765353+0000 mgr.a (mgr.14388) 876 : audit [DBG] from='client.32088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:55.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:55 smithi179 bash[23186]: audit 2024-09-20T22:34:54.765353+0000 mgr.a (mgr.14388) 876 : audit [DBG] from='client.32088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:55.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:55 smithi049 bash[23528]: audit 2024-09-20T22:34:54.765353+0000 mgr.a (mgr.14388) 876 : audit [DBG] from='client.32088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:34:56.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:56 smithi049 bash[23528]: cluster 2024-09-20T22:34:55.195225+0000 mgr.a (mgr.14388) 877 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:56.637 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:56 smithi179 bash[23186]: cluster 2024-09-20T22:34:55.195225+0000 mgr.a (mgr.14388) 877 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:56 smithi044 bash[22676]: cluster 2024-09-20T22:34:55.195225+0000 mgr.a (mgr.14388) 877 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:34:58.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:34:58 smithi049 bash[23528]: cluster 2024-09-20T22:34:57.195651+0000 mgr.a (mgr.14388) 878 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:34:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:34:58 smithi044 bash[22676]: cluster 2024-09-20T22:34:57.195651+0000 mgr.a (mgr.14388) 878 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:34:58.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:34:58 smithi179 bash[23186]: cluster 2024-09-20T22:34:57.195651+0000 mgr.a (mgr.14388) 878 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:00.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:00.194 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:00.194 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:00.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:00 smithi049 bash[23528]: cluster 2024-09-20T22:34:59.196387+0000 mgr.a (mgr.14388) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:00 smithi044 bash[22676]: cluster 2024-09-20T22:34:59.196387+0000 mgr.a (mgr.14388) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:00.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:00 smithi179 bash[23186]: cluster 2024-09-20T22:34:59.196387+0000 mgr.a (mgr.14388) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:00.985 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:01.494 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:01 smithi049 bash[23528]: audit 2024-09-20T22:35:00.547927+0000 mgr.a (mgr.14388) 880 : audit [DBG] from='client.32166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:01.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:01 smithi179 bash[23186]: audit 2024-09-20T22:35:00.547927+0000 mgr.a (mgr.14388) 880 : audit [DBG] from='client.32166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:01 smithi044 bash[22676]: audit 2024-09-20T22:35:00.547927+0000 mgr.a (mgr.14388) 880 : audit [DBG] from='client.32166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:02.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:02 smithi049 bash[23528]: cluster 2024-09-20T22:35:01.199010+0000 mgr.a (mgr.14388) 881 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:02 smithi044 bash[22676]: cluster 2024-09-20T22:35:01.199010+0000 mgr.a (mgr.14388) 881 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:02.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:02 smithi179 bash[23186]: cluster 2024-09-20T22:35:01.199010+0000 mgr.a (mgr.14388) 881 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:04.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:04 smithi049 bash[23528]: cluster 2024-09-20T22:35:03.199762+0000 mgr.a (mgr.14388) 882 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:04 smithi044 bash[22676]: cluster 2024-09-20T22:35:03.199762+0000 mgr.a (mgr.14388) 882 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:04.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:04 smithi179 bash[23186]: cluster 2024-09-20T22:35:03.199762+0000 mgr.a (mgr.14388) 882 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:05.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:06.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:06 smithi049 bash[23528]: cluster 2024-09-20T22:35:05.201664+0000 mgr.a (mgr.14388) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:06 smithi044 bash[22676]: cluster 2024-09-20T22:35:05.201664+0000 mgr.a (mgr.14388) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:06.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:06 smithi179 bash[23186]: cluster 2024-09-20T22:35:05.201664+0000 mgr.a (mgr.14388) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:06.766 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:06.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:07 smithi044 bash[22676]: audit 2024-09-20T22:35:06.326734+0000 mgr.a (mgr.14388) 884 : audit [DBG] from='client.32244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:07 smithi044 bash[22676]: audit 2024-09-20T22:35:06.798481+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:07 smithi044 bash[22676]: audit 2024-09-20T22:35:06.803707+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:07 smithi044 bash[22676]: audit 2024-09-20T22:35:06.808748+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:07 smithi044 bash[22676]: audit 2024-09-20T22:35:07.304996+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:07 smithi044 bash[22676]: audit 2024-09-20T22:35:07.313755+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:07 smithi044 bash[22676]: audit 2024-09-20T22:35:07.323736+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:07 smithi179 bash[23186]: audit 2024-09-20T22:35:06.326734+0000 mgr.a (mgr.14388) 884 : audit [DBG] from='client.32244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:07 smithi179 bash[23186]: audit 2024-09-20T22:35:06.798481+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:07 smithi179 bash[23186]: audit 2024-09-20T22:35:06.803707+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:07 smithi179 bash[23186]: audit 2024-09-20T22:35:06.808748+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:07 smithi179 bash[23186]: audit 2024-09-20T22:35:07.304996+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:07 smithi179 bash[23186]: audit 2024-09-20T22:35:07.313755+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:07 smithi179 bash[23186]: audit 2024-09-20T22:35:07.323736+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:07 smithi049 bash[23528]: audit 2024-09-20T22:35:06.326734+0000 mgr.a (mgr.14388) 884 : audit [DBG] from='client.32244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:08.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:07 smithi049 bash[23528]: audit 2024-09-20T22:35:06.798481+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:07 smithi049 bash[23528]: audit 2024-09-20T22:35:06.803707+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:07 smithi049 bash[23528]: audit 2024-09-20T22:35:06.808748+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:07 smithi049 bash[23528]: audit 2024-09-20T22:35:07.304996+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:07 smithi049 bash[23528]: audit 2024-09-20T22:35:07.313755+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:08.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:07 smithi049 bash[23528]: audit 2024-09-20T22:35:07.323736+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:08 smithi044 bash[22676]: cluster 2024-09-20T22:35:07.202601+0000 mgr.a (mgr.14388) 885 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:09.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:08 smithi179 bash[23186]: cluster 2024-09-20T22:35:07.202601+0000 mgr.a (mgr.14388) 885 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:09.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:08 smithi049 bash[23528]: cluster 2024-09-20T22:35:07.202601+0000 mgr.a (mgr.14388) 885 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:10.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:10 smithi049 bash[23528]: audit 2024-09-20T22:35:09.036503+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:10 smithi049 bash[23528]: audit 2024-09-20T22:35:09.041652+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:10 smithi049 bash[23528]: audit 2024-09-20T22:35:09.049388+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:10 smithi044 bash[22676]: audit 2024-09-20T22:35:09.036503+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:10 smithi044 bash[22676]: audit 2024-09-20T22:35:09.041652+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:10 smithi044 bash[22676]: audit 2024-09-20T22:35:09.049388+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:10 smithi179 bash[23186]: audit 2024-09-20T22:35:09.036503+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:10 smithi179 bash[23186]: audit 2024-09-20T22:35:09.041652+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:10 smithi179 bash[23186]: audit 2024-09-20T22:35:09.049388+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:11 smithi044 bash[22676]: cluster 2024-09-20T22:35:09.203558+0000 mgr.a (mgr.14388) 886 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:11.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:11 smithi179 bash[23186]: cluster 2024-09-20T22:35:09.203558+0000 mgr.a (mgr.14388) 886 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:11.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:11 smithi049 bash[23528]: cluster 2024-09-20T22:35:09.203558+0000 mgr.a (mgr.14388) 886 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:11.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:11.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:12.553 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:13 smithi044 bash[22676]: cluster 2024-09-20T22:35:11.205916+0000 mgr.a (mgr.14388) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:35:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:13 smithi044 bash[22676]: audit 2024-09-20T22:35:12.110245+0000 mgr.a (mgr.14388) 888 : audit [DBG] from='client.32316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:13.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:13 smithi179 bash[23186]: cluster 2024-09-20T22:35:11.205916+0000 mgr.a (mgr.14388) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:35:13.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:13 smithi179 bash[23186]: audit 2024-09-20T22:35:12.110245+0000 mgr.a (mgr.14388) 888 : audit [DBG] from='client.32316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:13.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:13 smithi049 bash[23528]: cluster 2024-09-20T22:35:11.205916+0000 mgr.a (mgr.14388) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:35:13.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:13 smithi049 bash[23528]: audit 2024-09-20T22:35:12.110245+0000 mgr.a (mgr.14388) 888 : audit [DBG] from='client.32316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:15.395 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22930]: debug 2024-09-20T22:35:15.089+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:35:15.395 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22930]: debug 2024-09-20T22:35:15.089+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:35:15.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22676]: cluster 2024-09-20T22:35:13.206859+0000 mgr.a (mgr.14388) 889 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:15.396 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22676]: audit 2024-09-20T22:35:14.303359+0000 mon.a (mon.0) 1500 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:35:15.396 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22676]: audit 2024-09-20T22:35:14.310390+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:35:15.396 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22676]: audit 2024-09-20T22:35:14.312163+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:35:15.396 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22676]: audit 2024-09-20T22:35:14.323212+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:15.396 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:15 smithi044 bash[22676]: audit 2024-09-20T22:35:14.329643+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:35:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:15 smithi179 bash[23186]: cluster 2024-09-20T22:35:13.206859+0000 mgr.a (mgr.14388) 889 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:15 smithi179 bash[23186]: audit 2024-09-20T22:35:14.303359+0000 mon.a (mon.0) 1500 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:35:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:15 smithi179 bash[23186]: audit 2024-09-20T22:35:14.310390+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:35:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:15 smithi179 bash[23186]: audit 2024-09-20T22:35:14.312163+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:35:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:15 smithi179 bash[23186]: audit 2024-09-20T22:35:14.323212+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:15.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:15 smithi179 bash[23186]: audit 2024-09-20T22:35:14.329643+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:35:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:15 smithi049 bash[23528]: cluster 2024-09-20T22:35:13.206859+0000 mgr.a (mgr.14388) 889 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:15 smithi049 bash[23528]: audit 2024-09-20T22:35:14.303359+0000 mon.a (mon.0) 1500 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:35:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:15 smithi049 bash[23528]: audit 2024-09-20T22:35:14.310390+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:35:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:15 smithi049 bash[23528]: audit 2024-09-20T22:35:14.312163+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:35:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:15 smithi049 bash[23528]: audit 2024-09-20T22:35:14.323212+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:15 smithi049 bash[23528]: audit 2024-09-20T22:35:14.329643+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:35:16.313 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:16 smithi044 bash[22676]: audit 2024-09-20T22:35:14.332159+0000 mgr.a (mgr.14388) 890 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:35:16.313 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:16 smithi044 bash[22676]: audit 2024-09-20T22:35:15.093676+0000 mgr.a (mgr.14388) 891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:35:16.313 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:16 smithi044 bash[22676]: cephadm 2024-09-20T22:35:15.094827+0000 mgr.a (mgr.14388) 892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:35:16.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:16 smithi179 bash[23186]: audit 2024-09-20T22:35:14.332159+0000 mgr.a (mgr.14388) 890 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:35:16.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:16 smithi179 bash[23186]: audit 2024-09-20T22:35:15.093676+0000 mgr.a (mgr.14388) 891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:35:16.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:16 smithi179 bash[23186]: cephadm 2024-09-20T22:35:15.094827+0000 mgr.a (mgr.14388) 892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:35:16.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:16 smithi049 bash[23528]: audit 2024-09-20T22:35:14.332159+0000 mgr.a (mgr.14388) 890 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:35:16.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:16 smithi049 bash[23528]: audit 2024-09-20T22:35:15.093676+0000 mgr.a (mgr.14388) 891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:35:16.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:16 smithi049 bash[23528]: cephadm 2024-09-20T22:35:15.094827+0000 mgr.a (mgr.14388) 892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:35:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:17 smithi044 bash[22676]: cluster 2024-09-20T22:35:15.209194+0000 mgr.a (mgr.14388) 893 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:17.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:17 smithi179 bash[23186]: cluster 2024-09-20T22:35:15.209194+0000 mgr.a (mgr.14388) 893 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:17.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:17 smithi049 bash[23528]: cluster 2024-09-20T22:35:15.209194+0000 mgr.a (mgr.14388) 893 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:17.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:17.555 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:17.555 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:18.310 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:19 smithi044 bash[22676]: cluster 2024-09-20T22:35:17.209735+0000 mgr.a (mgr.14388) 894 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:19 smithi044 bash[22676]: audit 2024-09-20T22:35:17.893427+0000 mgr.a (mgr.14388) 895 : audit [DBG] from='client.32484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:19.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:19 smithi179 bash[23186]: cluster 2024-09-20T22:35:17.209735+0000 mgr.a (mgr.14388) 894 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:19.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:19 smithi179 bash[23186]: audit 2024-09-20T22:35:17.893427+0000 mgr.a (mgr.14388) 895 : audit [DBG] from='client.32484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:19.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:19 smithi049 bash[23528]: cluster 2024-09-20T22:35:17.209735+0000 mgr.a (mgr.14388) 894 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:19.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:19 smithi049 bash[23528]: audit 2024-09-20T22:35:17.893427+0000 mgr.a (mgr.14388) 895 : audit [DBG] from='client.32484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:21.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:21 smithi049 bash[23528]: cluster 2024-09-20T22:35:19.210629+0000 mgr.a (mgr.14388) 896 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:21 smithi044 bash[22676]: cluster 2024-09-20T22:35:19.210629+0000 mgr.a (mgr.14388) 896 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:21.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:21 smithi179 bash[23186]: cluster 2024-09-20T22:35:19.210629+0000 mgr.a (mgr.14388) 896 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T22:35:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:23 smithi044 bash[22676]: cluster 2024-09-20T22:35:21.212860+0000 mgr.a (mgr.14388) 897 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:23.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:23 smithi179 bash[23186]: cluster 2024-09-20T22:35:21.212860+0000 mgr.a (mgr.14388) 897 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:23.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:23 smithi049 bash[23528]: cluster 2024-09-20T22:35:21.212860+0000 mgr.a (mgr.14388) 897 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:24.067 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:25 smithi044 bash[22676]: cluster 2024-09-20T22:35:23.213637+0000 mgr.a (mgr.14388) 898 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:25 smithi044 bash[22676]: audit 2024-09-20T22:35:23.645878+0000 mgr.a (mgr.14388) 899 : audit [DBG] from='client.32562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:25.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:25 smithi179 bash[23186]: cluster 2024-09-20T22:35:23.213637+0000 mgr.a (mgr.14388) 898 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:25.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:25 smithi179 bash[23186]: audit 2024-09-20T22:35:23.645878+0000 mgr.a (mgr.14388) 899 : audit [DBG] from='client.32562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:25.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:25 smithi049 bash[23528]: cluster 2024-09-20T22:35:23.213637+0000 mgr.a (mgr.14388) 898 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:25.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:25 smithi049 bash[23528]: audit 2024-09-20T22:35:23.645878+0000 mgr.a (mgr.14388) 899 : audit [DBG] from='client.32562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:27.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:27 smithi049 bash[23528]: cluster 2024-09-20T22:35:25.215852+0000 mgr.a (mgr.14388) 900 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:27 smithi049 bash[23528]: audit 2024-09-20T22:35:27.017220+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:27 smithi049 bash[23528]: audit 2024-09-20T22:35:27.025551+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:27 smithi049 bash[23528]: audit 2024-09-20T22:35:27.035620+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:27 smithi044 bash[22676]: cluster 2024-09-20T22:35:25.215852+0000 mgr.a (mgr.14388) 900 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:27 smithi044 bash[22676]: audit 2024-09-20T22:35:27.017220+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:27 smithi044 bash[22676]: audit 2024-09-20T22:35:27.025551+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:27 smithi044 bash[22676]: audit 2024-09-20T22:35:27.035620+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:27 smithi179 bash[23186]: cluster 2024-09-20T22:35:25.215852+0000 mgr.a (mgr.14388) 900 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:35:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:27 smithi179 bash[23186]: audit 2024-09-20T22:35:27.017220+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:27 smithi179 bash[23186]: audit 2024-09-20T22:35:27.025551+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:27.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:27 smithi179 bash[23186]: audit 2024-09-20T22:35:27.035620+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:28 smithi049 bash[23528]: cluster 2024-09-20T22:35:27.216616+0000 mgr.a (mgr.14388) 901 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:35:28.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:28 smithi049 bash[23528]: audit 2024-09-20T22:35:27.504636+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:28 smithi049 bash[23528]: audit 2024-09-20T22:35:27.513146+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:28 smithi049 bash[23528]: audit 2024-09-20T22:35:27.523138+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:28 smithi044 bash[22676]: cluster 2024-09-20T22:35:27.216616+0000 mgr.a (mgr.14388) 901 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:35:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:28 smithi044 bash[22676]: audit 2024-09-20T22:35:27.504636+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:28 smithi044 bash[22676]: audit 2024-09-20T22:35:27.513146+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:28 smithi044 bash[22676]: audit 2024-09-20T22:35:27.523138+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:28 smithi179 bash[23186]: cluster 2024-09-20T22:35:27.216616+0000 mgr.a (mgr.14388) 901 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:35:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:28 smithi179 bash[23186]: audit 2024-09-20T22:35:27.504636+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:28 smithi179 bash[23186]: audit 2024-09-20T22:35:27.513146+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:28 smithi179 bash[23186]: audit 2024-09-20T22:35:27.523138+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:29.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:29.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:29.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:29.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:30 smithi044 bash[22676]: audit 2024-09-20T22:35:29.200736+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:30 smithi044 bash[22676]: audit 2024-09-20T22:35:29.205867+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:30 smithi044 bash[22676]: audit 2024-09-20T22:35:29.211907+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:30 smithi044 bash[22676]: cluster 2024-09-20T22:35:29.217035+0000 mgr.a (mgr.14388) 902 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:35:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:30 smithi044 bash[22676]: audit 2024-09-20T22:35:29.408447+0000 mgr.a (mgr.14388) 903 : audit [DBG] from='client.32640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:30 smithi179 bash[23186]: audit 2024-09-20T22:35:29.200736+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:30 smithi179 bash[23186]: audit 2024-09-20T22:35:29.205867+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:30 smithi179 bash[23186]: audit 2024-09-20T22:35:29.211907+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:30 smithi179 bash[23186]: cluster 2024-09-20T22:35:29.217035+0000 mgr.a (mgr.14388) 902 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:35:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:30 smithi179 bash[23186]: audit 2024-09-20T22:35:29.408447+0000 mgr.a (mgr.14388) 903 : audit [DBG] from='client.32640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:30.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:30 smithi049 bash[23528]: audit 2024-09-20T22:35:29.200736+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:30 smithi049 bash[23528]: audit 2024-09-20T22:35:29.205867+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:30 smithi049 bash[23528]: audit 2024-09-20T22:35:29.211907+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:30.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:30 smithi049 bash[23528]: cluster 2024-09-20T22:35:29.217035+0000 mgr.a (mgr.14388) 902 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T22:35:30.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:30 smithi049 bash[23528]: audit 2024-09-20T22:35:29.408447+0000 mgr.a (mgr.14388) 903 : audit [DBG] from='client.32640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:32 smithi044 bash[22676]: cluster 2024-09-20T22:35:31.219398+0000 mgr.a (mgr.14388) 904 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:35:32.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:32 smithi179 bash[23186]: cluster 2024-09-20T22:35:31.219398+0000 mgr.a (mgr.14388) 904 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:35:32.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:32 smithi049 bash[23528]: cluster 2024-09-20T22:35:31.219398+0000 mgr.a (mgr.14388) 904 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T22:35:34.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:34 smithi179 bash[23186]: cluster 2024-09-20T22:35:33.220154+0000 mgr.a (mgr.14388) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:34.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:34 smithi049 bash[23528]: cluster 2024-09-20T22:35:33.220154+0000 mgr.a (mgr.14388) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:34 smithi044 bash[22676]: cluster 2024-09-20T22:35:33.220154+0000 mgr.a (mgr.14388) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:34.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:34.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:35.607 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:35.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:35.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:35.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:35.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:36 smithi044 bash[22676]: audit 2024-09-20T22:35:35.187574+0000 mgr.a (mgr.14388) 906 : audit [DBG] from='client.32718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:36.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:36 smithi044 bash[22676]: cluster 2024-09-20T22:35:35.221851+0000 mgr.a (mgr.14388) 907 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:36.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:36 smithi179 bash[23186]: audit 2024-09-20T22:35:35.187574+0000 mgr.a (mgr.14388) 906 : audit [DBG] from='client.32718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:36.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:36 smithi179 bash[23186]: cluster 2024-09-20T22:35:35.221851+0000 mgr.a (mgr.14388) 907 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:36.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:36 smithi049 bash[23528]: audit 2024-09-20T22:35:35.187574+0000 mgr.a (mgr.14388) 906 : audit [DBG] from='client.32718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:36.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:36 smithi049 bash[23528]: cluster 2024-09-20T22:35:35.221851+0000 mgr.a (mgr.14388) 907 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:38.358 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:38 smithi179 bash[23186]: cluster 2024-09-20T22:35:37.222924+0000 mgr.a (mgr.14388) 908 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:38 smithi044 bash[22676]: cluster 2024-09-20T22:35:37.222924+0000 mgr.a (mgr.14388) 908 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:38.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:38 smithi049 bash[23528]: cluster 2024-09-20T22:35:37.222924+0000 mgr.a (mgr.14388) 908 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:40.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:40 smithi049 bash[23528]: cluster 2024-09-20T22:35:39.223843+0000 mgr.a (mgr.14388) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:40.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:40.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:40.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:40 smithi044 bash[22676]: cluster 2024-09-20T22:35:39.223843+0000 mgr.a (mgr.14388) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:40.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:40 smithi179 bash[23186]: cluster 2024-09-20T22:35:39.223843+0000 mgr.a (mgr.14388) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:41.400 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:41.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:41.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:41.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:41.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:41.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:41 smithi049 bash[23528]: audit 2024-09-20T22:35:40.943959+0000 mgr.a (mgr.14388) 910 : audit [DBG] from='client.32796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:41 smithi044 bash[22676]: audit 2024-09-20T22:35:40.943959+0000 mgr.a (mgr.14388) 910 : audit [DBG] from='client.32796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:41.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:41 smithi179 bash[23186]: audit 2024-09-20T22:35:40.943959+0000 mgr.a (mgr.14388) 910 : audit [DBG] from='client.32796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:42.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:42 smithi049 bash[23528]: cluster 2024-09-20T22:35:41.225081+0000 mgr.a (mgr.14388) 911 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:42 smithi044 bash[22676]: cluster 2024-09-20T22:35:41.225081+0000 mgr.a (mgr.14388) 911 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:42.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:42 smithi179 bash[23186]: cluster 2024-09-20T22:35:41.225081+0000 mgr.a (mgr.14388) 911 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:44.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:44 smithi049 bash[23528]: cluster 2024-09-20T22:35:43.226026+0000 mgr.a (mgr.14388) 912 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:44 smithi044 bash[22676]: cluster 2024-09-20T22:35:43.226026+0000 mgr.a (mgr.14388) 912 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:44.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:44 smithi179 bash[23186]: cluster 2024-09-20T22:35:43.226026+0000 mgr.a (mgr.14388) 912 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:35:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:46.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:46 smithi049 bash[23528]: cluster 2024-09-20T22:35:45.228166+0000 mgr.a (mgr.14388) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:46 smithi044 bash[22676]: cluster 2024-09-20T22:35:45.228166+0000 mgr.a (mgr.14388) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:46 smithi179 bash[23186]: cluster 2024-09-20T22:35:45.228166+0000 mgr.a (mgr.14388) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:47.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:47.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:47.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:47.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:47.146 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:47.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:47 smithi049 bash[23528]: audit 2024-09-20T22:35:46.730450+0000 mgr.a (mgr.14388) 914 : audit [DBG] from='client.32871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:47.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:47 smithi049 bash[23528]: audit 2024-09-20T22:35:47.244346+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:47 smithi049 bash[23528]: audit 2024-09-20T22:35:47.253134+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:47 smithi049 bash[23528]: audit 2024-09-20T22:35:47.263682+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:47 smithi044 bash[22676]: audit 2024-09-20T22:35:46.730450+0000 mgr.a (mgr.14388) 914 : audit [DBG] from='client.32871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:47 smithi044 bash[22676]: audit 2024-09-20T22:35:47.244346+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:47 smithi044 bash[22676]: audit 2024-09-20T22:35:47.253134+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:47 smithi044 bash[22676]: audit 2024-09-20T22:35:47.263682+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:47 smithi179 bash[23186]: audit 2024-09-20T22:35:46.730450+0000 mgr.a (mgr.14388) 914 : audit [DBG] from='client.32871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:47 smithi179 bash[23186]: audit 2024-09-20T22:35:47.244346+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:47 smithi179 bash[23186]: audit 2024-09-20T22:35:47.253134+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:47 smithi179 bash[23186]: audit 2024-09-20T22:35:47.263682+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:48 smithi044 bash[22676]: cluster 2024-09-20T22:35:47.229324+0000 mgr.a (mgr.14388) 915 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:48 smithi044 bash[22676]: audit 2024-09-20T22:35:47.731589+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:48 smithi044 bash[22676]: audit 2024-09-20T22:35:47.740464+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:48 smithi044 bash[22676]: audit 2024-09-20T22:35:47.750720+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:48.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:48 smithi179 bash[23186]: cluster 2024-09-20T22:35:47.229324+0000 mgr.a (mgr.14388) 915 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:48.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:48 smithi179 bash[23186]: audit 2024-09-20T22:35:47.731589+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:48.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:48 smithi179 bash[23186]: audit 2024-09-20T22:35:47.740464+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:48.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:48 smithi179 bash[23186]: audit 2024-09-20T22:35:47.750720+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:49.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:48 smithi049 bash[23528]: cluster 2024-09-20T22:35:47.229324+0000 mgr.a (mgr.14388) 915 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:49.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:48 smithi049 bash[23528]: audit 2024-09-20T22:35:47.731589+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:48 smithi049 bash[23528]: audit 2024-09-20T22:35:47.740464+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:48 smithi049 bash[23528]: audit 2024-09-20T22:35:47.750720+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:50 smithi044 bash[22676]: cluster 2024-09-20T22:35:49.229955+0000 mgr.a (mgr.14388) 916 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:50 smithi044 bash[22676]: audit 2024-09-20T22:35:49.372080+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:50 smithi044 bash[22676]: audit 2024-09-20T22:35:49.377980+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:50 smithi044 bash[22676]: audit 2024-09-20T22:35:49.384744+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:50 smithi179 bash[23186]: cluster 2024-09-20T22:35:49.229955+0000 mgr.a (mgr.14388) 916 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:50.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:50 smithi179 bash[23186]: audit 2024-09-20T22:35:49.372080+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:50 smithi179 bash[23186]: audit 2024-09-20T22:35:49.377980+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:50 smithi179 bash[23186]: audit 2024-09-20T22:35:49.384744+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:50 smithi049 bash[23528]: cluster 2024-09-20T22:35:49.229955+0000 mgr.a (mgr.14388) 916 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:35:50.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:50 smithi049 bash[23528]: audit 2024-09-20T22:35:49.372080+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:50 smithi049 bash[23528]: audit 2024-09-20T22:35:49.377980+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:50.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:50 smithi049 bash[23528]: audit 2024-09-20T22:35:49.384744+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:35:52.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:52.148 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:52.149 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:52 smithi044 bash[22676]: cluster 2024-09-20T22:35:51.232136+0000 mgr.a (mgr.14388) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:35:52.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:52 smithi179 bash[23186]: cluster 2024-09-20T22:35:51.232136+0000 mgr.a (mgr.14388) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:35:52.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:52 smithi049 bash[23528]: cluster 2024-09-20T22:35:51.232136+0000 mgr.a (mgr.14388) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:35:52.903 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:52.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:52.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:52.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:52.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:53 smithi044 bash[22676]: audit 2024-09-20T22:35:52.482139+0000 mgr.a (mgr.14388) 918 : audit [DBG] from='client.32946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:53.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:53 smithi179 bash[23186]: audit 2024-09-20T22:35:52.482139+0000 mgr.a (mgr.14388) 918 : audit [DBG] from='client.32946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:53.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:53 smithi049 bash[23528]: audit 2024-09-20T22:35:52.482139+0000 mgr.a (mgr.14388) 918 : audit [DBG] from='client.32946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:54 smithi044 bash[22676]: cluster 2024-09-20T22:35:53.233091+0000 mgr.a (mgr.14388) 919 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:35:54.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:54 smithi179 bash[23186]: cluster 2024-09-20T22:35:53.233091+0000 mgr.a (mgr.14388) 919 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:35:54.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:54 smithi049 bash[23528]: cluster 2024-09-20T22:35:53.233091+0000 mgr.a (mgr.14388) 919 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:35:56.716 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:56 smithi044 bash[22676]: cluster 2024-09-20T22:35:55.235258+0000 mgr.a (mgr.14388) 920 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:35:56.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:56 smithi179 bash[23186]: cluster 2024-09-20T22:35:55.235258+0000 mgr.a (mgr.14388) 920 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:35:56.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:56 smithi049 bash[23528]: cluster 2024-09-20T22:35:55.235258+0000 mgr.a (mgr.14388) 920 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:35:57.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:35:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:35:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:35:58.649 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:35:58.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:35:58.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:35:58.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:35:58.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:35:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:58 smithi044 bash[22676]: cluster 2024-09-20T22:35:57.236028+0000 mgr.a (mgr.14388) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:35:58.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:58 smithi179 bash[23186]: cluster 2024-09-20T22:35:57.236028+0000 mgr.a (mgr.14388) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:35:58.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:58 smithi049 bash[23528]: cluster 2024-09-20T22:35:57.236028+0000 mgr.a (mgr.14388) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:35:59.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:35:59 smithi179 bash[23186]: audit 2024-09-20T22:35:58.244215+0000 mgr.a (mgr.14388) 922 : audit [DBG] from='client.33024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:35:59 smithi044 bash[22676]: audit 2024-09-20T22:35:58.244215+0000 mgr.a (mgr.14388) 922 : audit [DBG] from='client.33024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:35:59.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:35:59 smithi049 bash[23528]: audit 2024-09-20T22:35:58.244215+0000 mgr.a (mgr.14388) 922 : audit [DBG] from='client.33024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:00.686 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:00 smithi179 bash[23186]: cluster 2024-09-20T22:35:59.236571+0000 mgr.a (mgr.14388) 923 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:36:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:00 smithi044 bash[22676]: cluster 2024-09-20T22:35:59.236571+0000 mgr.a (mgr.14388) 923 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:36:00.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:00 smithi049 bash[23528]: cluster 2024-09-20T22:35:59.236571+0000 mgr.a (mgr.14388) 923 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-20T22:36:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:02 smithi044 bash[22676]: cluster 2024-09-20T22:36:01.238955+0000 mgr.a (mgr.14388) 924 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:36:02.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:02 smithi179 bash[23186]: cluster 2024-09-20T22:36:01.238955+0000 mgr.a (mgr.14388) 924 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:36:02.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:02 smithi049 bash[23528]: cluster 2024-09-20T22:36:01.238955+0000 mgr.a (mgr.14388) 924 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-20T22:36:03.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:03.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:03.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:04.391 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:04.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:04.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:04.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:04.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:04.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:04 smithi049 bash[23528]: cluster 2024-09-20T22:36:03.239729+0000 mgr.a (mgr.14388) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:04.509 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:04 smithi049 bash[23528]: audit 2024-09-20T22:36:03.982361+0000 mgr.a (mgr.14388) 926 : audit [DBG] from='client.33102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:04 smithi044 bash[22676]: cluster 2024-09-20T22:36:03.239729+0000 mgr.a (mgr.14388) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:04 smithi044 bash[22676]: audit 2024-09-20T22:36:03.982361+0000 mgr.a (mgr.14388) 926 : audit [DBG] from='client.33102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:04.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:04 smithi179 bash[23186]: cluster 2024-09-20T22:36:03.239729+0000 mgr.a (mgr.14388) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:04.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:04 smithi179 bash[23186]: audit 2024-09-20T22:36:03.982361+0000 mgr.a (mgr.14388) 926 : audit [DBG] from='client.33102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:06 smithi044 bash[22676]: cluster 2024-09-20T22:36:05.242030+0000 mgr.a (mgr.14388) 927 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:06.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:06 smithi179 bash[23186]: cluster 2024-09-20T22:36:05.242030+0000 mgr.a (mgr.14388) 927 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:06.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:06 smithi049 bash[23528]: cluster 2024-09-20T22:36:05.242030+0000 mgr.a (mgr.14388) 927 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:08 smithi044 bash[22676]: cluster 2024-09-20T22:36:07.242779+0000 mgr.a (mgr.14388) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:08 smithi044 bash[22676]: audit 2024-09-20T22:36:07.476626+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:08 smithi044 bash[22676]: audit 2024-09-20T22:36:07.484989+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:08 smithi044 bash[22676]: audit 2024-09-20T22:36:07.495346+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:08 smithi044 bash[22676]: audit 2024-09-20T22:36:07.959444+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:08 smithi044 bash[22676]: audit 2024-09-20T22:36:07.969321+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:08 smithi044 bash[22676]: audit 2024-09-20T22:36:07.980537+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:08 smithi179 bash[23186]: cluster 2024-09-20T22:36:07.242779+0000 mgr.a (mgr.14388) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:08 smithi179 bash[23186]: audit 2024-09-20T22:36:07.476626+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:08 smithi179 bash[23186]: audit 2024-09-20T22:36:07.484989+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:08 smithi179 bash[23186]: audit 2024-09-20T22:36:07.495346+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:08 smithi179 bash[23186]: audit 2024-09-20T22:36:07.959444+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:08 smithi179 bash[23186]: audit 2024-09-20T22:36:07.969321+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:08 smithi179 bash[23186]: audit 2024-09-20T22:36:07.980537+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:08 smithi049 bash[23528]: cluster 2024-09-20T22:36:07.242779+0000 mgr.a (mgr.14388) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:08.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:08 smithi049 bash[23528]: audit 2024-09-20T22:36:07.476626+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:08 smithi049 bash[23528]: audit 2024-09-20T22:36:07.484989+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:08 smithi049 bash[23528]: audit 2024-09-20T22:36:07.495346+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:08 smithi049 bash[23528]: audit 2024-09-20T22:36:07.959444+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:08 smithi049 bash[23528]: audit 2024-09-20T22:36:07.969321+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:08.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:08 smithi049 bash[23528]: audit 2024-09-20T22:36:07.980537+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:10.186 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:10.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:10.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:10.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:10.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:10.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:10 smithi049 bash[23528]: cluster 2024-09-20T22:36:09.243545+0000 mgr.a (mgr.14388) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:10.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:10 smithi049 bash[23528]: audit 2024-09-20T22:36:09.538468+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:10 smithi049 bash[23528]: audit 2024-09-20T22:36:09.544981+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:10 smithi049 bash[23528]: audit 2024-09-20T22:36:09.552067+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:10 smithi049 bash[23528]: audit 2024-09-20T22:36:09.742055+0000 mgr.a (mgr.14388) 930 : audit [DBG] from='client.33177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:10 smithi044 bash[22676]: cluster 2024-09-20T22:36:09.243545+0000 mgr.a (mgr.14388) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:10 smithi044 bash[22676]: audit 2024-09-20T22:36:09.538468+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:10 smithi044 bash[22676]: audit 2024-09-20T22:36:09.544981+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:10 smithi044 bash[22676]: audit 2024-09-20T22:36:09.552067+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:10 smithi044 bash[22676]: audit 2024-09-20T22:36:09.742055+0000 mgr.a (mgr.14388) 930 : audit [DBG] from='client.33177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:10.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:10 smithi179 bash[23186]: cluster 2024-09-20T22:36:09.243545+0000 mgr.a (mgr.14388) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:10.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:10 smithi179 bash[23186]: audit 2024-09-20T22:36:09.538468+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:10 smithi179 bash[23186]: audit 2024-09-20T22:36:09.544981+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:10 smithi179 bash[23186]: audit 2024-09-20T22:36:09.552067+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:10.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:10 smithi179 bash[23186]: audit 2024-09-20T22:36:09.742055+0000 mgr.a (mgr.14388) 930 : audit [DBG] from='client.33177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:12.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:12 smithi049 bash[23528]: cluster 2024-09-20T22:36:11.246349+0000 mgr.a (mgr.14388) 931 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:12 smithi044 bash[22676]: cluster 2024-09-20T22:36:11.246349+0000 mgr.a (mgr.14388) 931 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:12.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:12 smithi179 bash[23186]: cluster 2024-09-20T22:36:11.246349+0000 mgr.a (mgr.14388) 931 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:14 smithi044 bash[22676]: cluster 2024-09-20T22:36:13.247141+0000 mgr.a (mgr.14388) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:14.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:14 smithi179 bash[23186]: cluster 2024-09-20T22:36:13.247141+0000 mgr.a (mgr.14388) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:15.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:14 smithi049 bash[23528]: cluster 2024-09-20T22:36:13.247141+0000 mgr.a (mgr.14388) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:15.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:15.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:15 smithi044 bash[22676]: audit 2024-09-20T22:36:15.151773+0000 mon.a (mon.0) 1532 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:36:15.934 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:15 smithi044 bash[22676]: audit 2024-09-20T22:36:15.163240+0000 mon.a (mon.0) 1533 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:36:15.934 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:15 smithi044 bash[22676]: audit 2024-09-20T22:36:15.165110+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:36:15.934 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:15 smithi044 bash[22676]: audit 2024-09-20T22:36:15.176354+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:15.934 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:15 smithi044 bash[22676]: audit 2024-09-20T22:36:15.182647+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:36:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:15 smithi179 bash[23186]: audit 2024-09-20T22:36:15.151773+0000 mon.a (mon.0) 1532 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:36:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:15 smithi179 bash[23186]: audit 2024-09-20T22:36:15.163240+0000 mon.a (mon.0) 1533 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:36:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:15 smithi179 bash[23186]: audit 2024-09-20T22:36:15.165110+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:36:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:15 smithi179 bash[23186]: audit 2024-09-20T22:36:15.176354+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:15.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:15 smithi179 bash[23186]: audit 2024-09-20T22:36:15.182647+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:36:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:15 smithi049 bash[23528]: audit 2024-09-20T22:36:15.151773+0000 mon.a (mon.0) 1532 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:36:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:15 smithi049 bash[23528]: audit 2024-09-20T22:36:15.163240+0000 mon.a (mon.0) 1533 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:36:16.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:15 smithi049 bash[23528]: audit 2024-09-20T22:36:15.165110+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:36:16.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:15 smithi049 bash[23528]: audit 2024-09-20T22:36:15.176354+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:16.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:15 smithi049 bash[23528]: audit 2024-09-20T22:36:15.182647+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:36:16.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:36:15 smithi044 bash[22930]: debug 2024-09-20T22:36:15.932+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:36:16.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:36:15 smithi044 bash[22930]: debug 2024-09-20T22:36:15.944+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:36:16.357 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:16 smithi044 bash[22676]: audit 2024-09-20T22:36:15.185066+0000 mgr.a (mgr.14388) 933 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:36:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:16 smithi044 bash[22676]: cluster 2024-09-20T22:36:15.248563+0000 mgr.a (mgr.14388) 934 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:16 smithi044 bash[22676]: audit 2024-09-20T22:36:15.541147+0000 mgr.a (mgr.14388) 935 : audit [DBG] from='client.33273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:16 smithi044 bash[22676]: audit 2024-09-20T22:36:15.934288+0000 mgr.a (mgr.14388) 936 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:36:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:16 smithi044 bash[22676]: cephadm 2024-09-20T22:36:15.947270+0000 mgr.a (mgr.14388) 937 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:36:16.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:16 smithi179 bash[23186]: audit 2024-09-20T22:36:15.185066+0000 mgr.a (mgr.14388) 933 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:36:16.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:16 smithi179 bash[23186]: cluster 2024-09-20T22:36:15.248563+0000 mgr.a (mgr.14388) 934 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:16.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:16 smithi179 bash[23186]: audit 2024-09-20T22:36:15.541147+0000 mgr.a (mgr.14388) 935 : audit [DBG] from='client.33273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:16.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:16 smithi179 bash[23186]: audit 2024-09-20T22:36:15.934288+0000 mgr.a (mgr.14388) 936 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:36:17.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:16 smithi179 bash[23186]: cephadm 2024-09-20T22:36:15.947270+0000 mgr.a (mgr.14388) 937 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:36:17.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:16 smithi049 bash[23528]: audit 2024-09-20T22:36:15.185066+0000 mgr.a (mgr.14388) 933 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:36:17.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:16 smithi049 bash[23528]: cluster 2024-09-20T22:36:15.248563+0000 mgr.a (mgr.14388) 934 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:17.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:16 smithi049 bash[23528]: audit 2024-09-20T22:36:15.541147+0000 mgr.a (mgr.14388) 935 : audit [DBG] from='client.33273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:17.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:16 smithi049 bash[23528]: audit 2024-09-20T22:36:15.934288+0000 mgr.a (mgr.14388) 936 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:36:17.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:16 smithi049 bash[23528]: cephadm 2024-09-20T22:36:15.947270+0000 mgr.a (mgr.14388) 937 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:36:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:18 smithi044 bash[22676]: cluster 2024-09-20T22:36:17.249629+0000 mgr.a (mgr.14388) 938 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:18.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:18 smithi179 bash[23186]: cluster 2024-09-20T22:36:17.249629+0000 mgr.a (mgr.14388) 938 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:19.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:18 smithi049 bash[23528]: cluster 2024-09-20T22:36:17.249629+0000 mgr.a (mgr.14388) 938 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:20.663 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:20 smithi179 bash[23186]: cluster 2024-09-20T22:36:19.250405+0000 mgr.a (mgr.14388) 939 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:20 smithi044 bash[22676]: cluster 2024-09-20T22:36:19.250405+0000 mgr.a (mgr.14388) 939 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:21.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:20 smithi049 bash[23528]: cluster 2024-09-20T22:36:19.250405+0000 mgr.a (mgr.14388) 939 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:21.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:21.359 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:21.359 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:22.122 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:22 smithi044 bash[22676]: cluster 2024-09-20T22:36:21.252633+0000 mgr.a (mgr.14388) 940 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:22 smithi044 bash[22676]: audit 2024-09-20T22:36:21.691412+0000 mgr.a (mgr.14388) 941 : audit [DBG] from='client.33438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:22.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:22 smithi179 bash[23186]: cluster 2024-09-20T22:36:21.252633+0000 mgr.a (mgr.14388) 940 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:22.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:22 smithi179 bash[23186]: audit 2024-09-20T22:36:21.691412+0000 mgr.a (mgr.14388) 941 : audit [DBG] from='client.33438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:23.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:22 smithi049 bash[23528]: cluster 2024-09-20T22:36:21.252633+0000 mgr.a (mgr.14388) 940 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:23.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:22 smithi049 bash[23528]: audit 2024-09-20T22:36:21.691412+0000 mgr.a (mgr.14388) 941 : audit [DBG] from='client.33438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:24 smithi044 bash[22676]: cluster 2024-09-20T22:36:23.253633+0000 mgr.a (mgr.14388) 942 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:24.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:24 smithi179 bash[23186]: cluster 2024-09-20T22:36:23.253633+0000 mgr.a (mgr.14388) 942 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:25.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:24 smithi049 bash[23528]: cluster 2024-09-20T22:36:23.253633+0000 mgr.a (mgr.14388) 942 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:26.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:26 smithi049 bash[23528]: cluster 2024-09-20T22:36:25.255752+0000 mgr.a (mgr.14388) 943 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:26 smithi044 bash[22676]: cluster 2024-09-20T22:36:25.255752+0000 mgr.a (mgr.14388) 943 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:26.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:26 smithi179 bash[23186]: cluster 2024-09-20T22:36:25.255752+0000 mgr.a (mgr.14388) 943 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:27.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:27.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:27.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: cluster 2024-09-20T22:36:27.256440+0000 mgr.a (mgr.14388) 944 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: audit 2024-09-20T22:36:27.467859+0000 mgr.a (mgr.14388) 945 : audit [DBG] from='client.33513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: audit 2024-09-20T22:36:27.695958+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: audit 2024-09-20T22:36:27.709518+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: audit 2024-09-20T22:36:27.715848+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: audit 2024-09-20T22:36:28.150104+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: audit 2024-09-20T22:36:28.158424+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:28 smithi044 bash[22676]: audit 2024-09-20T22:36:28.168161+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: cluster 2024-09-20T22:36:27.256440+0000 mgr.a (mgr.14388) 944 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: audit 2024-09-20T22:36:27.467859+0000 mgr.a (mgr.14388) 945 : audit [DBG] from='client.33513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: audit 2024-09-20T22:36:27.695958+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: audit 2024-09-20T22:36:27.709518+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: audit 2024-09-20T22:36:27.715848+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: audit 2024-09-20T22:36:28.150104+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: audit 2024-09-20T22:36:28.158424+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:28 smithi179 bash[23186]: audit 2024-09-20T22:36:28.168161+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: cluster 2024-09-20T22:36:27.256440+0000 mgr.a (mgr.14388) 944 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:29.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: audit 2024-09-20T22:36:27.467859+0000 mgr.a (mgr.14388) 945 : audit [DBG] from='client.33513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:29.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: audit 2024-09-20T22:36:27.695958+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: audit 2024-09-20T22:36:27.709518+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: audit 2024-09-20T22:36:27.715848+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: audit 2024-09-20T22:36:28.150104+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: audit 2024-09-20T22:36:28.158424+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:29.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:28 smithi049 bash[23528]: audit 2024-09-20T22:36:28.168161+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:30 smithi049 bash[23528]: cluster 2024-09-20T22:36:29.257408+0000 mgr.a (mgr.14388) 946 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:31.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:30 smithi049 bash[23528]: audit 2024-09-20T22:36:29.762527+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:30 smithi049 bash[23528]: audit 2024-09-20T22:36:29.770367+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:30 smithi049 bash[23528]: audit 2024-09-20T22:36:29.778810+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:30 smithi044 bash[22676]: cluster 2024-09-20T22:36:29.257408+0000 mgr.a (mgr.14388) 946 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:30 smithi044 bash[22676]: audit 2024-09-20T22:36:29.762527+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:30 smithi044 bash[22676]: audit 2024-09-20T22:36:29.770367+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:30 smithi044 bash[22676]: audit 2024-09-20T22:36:29.778810+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:30 smithi179 bash[23186]: cluster 2024-09-20T22:36:29.257408+0000 mgr.a (mgr.14388) 946 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:31.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:30 smithi179 bash[23186]: audit 2024-09-20T22:36:29.762527+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:30 smithi179 bash[23186]: audit 2024-09-20T22:36:29.770367+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:31.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:30 smithi179 bash[23186]: audit 2024-09-20T22:36:29.778810+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:32.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:32.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:33.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:32 smithi049 bash[23528]: cluster 2024-09-20T22:36:31.259698+0000 mgr.a (mgr.14388) 947 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:32 smithi044 bash[22676]: cluster 2024-09-20T22:36:31.259698+0000 mgr.a (mgr.14388) 947 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:33.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:32 smithi179 bash[23186]: cluster 2024-09-20T22:36:31.259698+0000 mgr.a (mgr.14388) 947 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:36:33.649 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:33.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:33.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:33.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:33.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:35.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:34 smithi049 bash[23528]: audit 2024-09-20T22:36:33.233109+0000 mgr.a (mgr.14388) 948 : audit [DBG] from='client.33591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:35.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:34 smithi049 bash[23528]: cluster 2024-09-20T22:36:33.260761+0000 mgr.a (mgr.14388) 949 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:34 smithi044 bash[22676]: audit 2024-09-20T22:36:33.233109+0000 mgr.a (mgr.14388) 948 : audit [DBG] from='client.33591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:34 smithi044 bash[22676]: cluster 2024-09-20T22:36:33.260761+0000 mgr.a (mgr.14388) 949 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:35.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:34 smithi179 bash[23186]: audit 2024-09-20T22:36:33.233109+0000 mgr.a (mgr.14388) 948 : audit [DBG] from='client.33591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:35.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:34 smithi179 bash[23186]: cluster 2024-09-20T22:36:33.260761+0000 mgr.a (mgr.14388) 949 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:37.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:36 smithi049 bash[23528]: cluster 2024-09-20T22:36:35.263097+0000 mgr.a (mgr.14388) 950 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:36 smithi044 bash[22676]: cluster 2024-09-20T22:36:35.263097+0000 mgr.a (mgr.14388) 950 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:37.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:36 smithi179 bash[23186]: cluster 2024-09-20T22:36:35.263097+0000 mgr.a (mgr.14388) 950 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:38.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:38.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:38.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:39.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:38 smithi044 bash[22676]: cluster 2024-09-20T22:36:37.263876+0000 mgr.a (mgr.14388) 951 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:39.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:38 smithi049 bash[23528]: cluster 2024-09-20T22:36:37.263876+0000 mgr.a (mgr.14388) 951 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:39.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:38 smithi179 bash[23186]: cluster 2024-09-20T22:36:37.263876+0000 mgr.a (mgr.14388) 951 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:39.421 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:39.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:39 smithi044 bash[22676]: audit 2024-09-20T22:36:38.991490+0000 mgr.a (mgr.14388) 952 : audit [DBG] from='client.33669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:40.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:39 smithi049 bash[23528]: audit 2024-09-20T22:36:38.991490+0000 mgr.a (mgr.14388) 952 : audit [DBG] from='client.33669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:40.153 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:39 smithi179 bash[23186]: audit 2024-09-20T22:36:38.991490+0000 mgr.a (mgr.14388) 952 : audit [DBG] from='client.33669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:40.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:40 smithi179 bash[23186]: cluster 2024-09-20T22:36:39.264448+0000 mgr.a (mgr.14388) 953 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:41.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:40 smithi049 bash[23528]: cluster 2024-09-20T22:36:39.264448+0000 mgr.a (mgr.14388) 953 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:41.106 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:40 smithi044 bash[22676]: cluster 2024-09-20T22:36:39.264448+0000 mgr.a (mgr.14388) 953 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:43.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:42 smithi049 bash[23528]: cluster 2024-09-20T22:36:41.266862+0000 mgr.a (mgr.14388) 954 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:42 smithi044 bash[22676]: cluster 2024-09-20T22:36:41.266862+0000 mgr.a (mgr.14388) 954 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:43.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:42 smithi179 bash[23186]: cluster 2024-09-20T22:36:41.266862+0000 mgr.a (mgr.14388) 954 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:36:44.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:44.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:44.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:45.209 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:45.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:45.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:45.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:45.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:44 smithi044 bash[22676]: cluster 2024-09-20T22:36:43.267667+0000 mgr.a (mgr.14388) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:44 smithi179 bash[23186]: cluster 2024-09-20T22:36:43.267667+0000 mgr.a (mgr.14388) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:45.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:44 smithi049 bash[23528]: cluster 2024-09-20T22:36:43.267667+0000 mgr.a (mgr.14388) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:46.104 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:45 smithi049 bash[23528]: audit 2024-09-20T22:36:44.761871+0000 mgr.a (mgr.14388) 956 : audit [DBG] from='client.33744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:45 smithi044 bash[22676]: audit 2024-09-20T22:36:44.761871+0000 mgr.a (mgr.14388) 956 : audit [DBG] from='client.33744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:46.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:45 smithi179 bash[23186]: audit 2024-09-20T22:36:44.761871+0000 mgr.a (mgr.14388) 956 : audit [DBG] from='client.33744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:46 smithi044 bash[22676]: cluster 2024-09-20T22:36:45.269183+0000 mgr.a (mgr.14388) 957 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:46 smithi179 bash[23186]: cluster 2024-09-20T22:36:45.269183+0000 mgr.a (mgr.14388) 957 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:47.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:46 smithi049 bash[23528]: cluster 2024-09-20T22:36:45.269183+0000 mgr.a (mgr.14388) 957 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:49.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:48 smithi049 bash[23528]: cluster 2024-09-20T22:36:47.269909+0000 mgr.a (mgr.14388) 958 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:48 smithi049 bash[23528]: audit 2024-09-20T22:36:47.903667+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:48 smithi049 bash[23528]: audit 2024-09-20T22:36:47.912301+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:48 smithi049 bash[23528]: audit 2024-09-20T22:36:47.922584+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:48 smithi049 bash[23528]: audit 2024-09-20T22:36:48.320965+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:48 smithi049 bash[23528]: audit 2024-09-20T22:36:48.329622+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:48 smithi049 bash[23528]: audit 2024-09-20T22:36:48.339639+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:48 smithi044 bash[22676]: cluster 2024-09-20T22:36:47.269909+0000 mgr.a (mgr.14388) 958 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:48 smithi044 bash[22676]: audit 2024-09-20T22:36:47.903667+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:48 smithi044 bash[22676]: audit 2024-09-20T22:36:47.912301+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:48 smithi044 bash[22676]: audit 2024-09-20T22:36:47.922584+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:48 smithi044 bash[22676]: audit 2024-09-20T22:36:48.320965+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:48 smithi044 bash[22676]: audit 2024-09-20T22:36:48.329622+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:48 smithi044 bash[22676]: audit 2024-09-20T22:36:48.339639+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:48 smithi179 bash[23186]: cluster 2024-09-20T22:36:47.269909+0000 mgr.a (mgr.14388) 958 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:49.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:48 smithi179 bash[23186]: audit 2024-09-20T22:36:47.903667+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:48 smithi179 bash[23186]: audit 2024-09-20T22:36:47.912301+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:48 smithi179 bash[23186]: audit 2024-09-20T22:36:47.922584+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:48 smithi179 bash[23186]: audit 2024-09-20T22:36:48.320965+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:48 smithi179 bash[23186]: audit 2024-09-20T22:36:48.329622+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:49.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:48 smithi179 bash[23186]: audit 2024-09-20T22:36:48.339639+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:50.211 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:50.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:50.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:51.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:50 smithi179 bash[23186]: cluster 2024-09-20T22:36:49.270673+0000 mgr.a (mgr.14388) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:51.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:50 smithi179 bash[23186]: audit 2024-09-20T22:36:49.989287+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:50 smithi179 bash[23186]: audit 2024-09-20T22:36:49.994439+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:50 smithi179 bash[23186]: audit 2024-09-20T22:36:50.004387+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:50 smithi049 bash[23528]: cluster 2024-09-20T22:36:49.270673+0000 mgr.a (mgr.14388) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:51.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:50 smithi049 bash[23528]: audit 2024-09-20T22:36:49.989287+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:50 smithi049 bash[23528]: audit 2024-09-20T22:36:49.994439+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:50 smithi049 bash[23528]: audit 2024-09-20T22:36:50.004387+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:50 smithi044 bash[22676]: cluster 2024-09-20T22:36:49.270673+0000 mgr.a (mgr.14388) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:36:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:50 smithi044 bash[22676]: audit 2024-09-20T22:36:49.989287+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:50 smithi044 bash[22676]: audit 2024-09-20T22:36:49.994439+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:50 smithi044 bash[22676]: audit 2024-09-20T22:36:50.004387+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:36:52.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:52 smithi179 bash[23186]: audit 2024-09-20T22:36:50.547618+0000 mgr.a (mgr.14388) 960 : audit [DBG] from='client.33822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:52.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:52 smithi049 bash[23528]: audit 2024-09-20T22:36:50.547618+0000 mgr.a (mgr.14388) 960 : audit [DBG] from='client.33822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:51 smithi044 bash[22676]: audit 2024-09-20T22:36:50.547618+0000 mgr.a (mgr.14388) 960 : audit [DBG] from='client.33822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:53.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:53 smithi049 bash[23528]: cluster 2024-09-20T22:36:51.273399+0000 mgr.a (mgr.14388) 961 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:53 smithi044 bash[22676]: cluster 2024-09-20T22:36:51.273399+0000 mgr.a (mgr.14388) 961 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:53.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:53 smithi179 bash[23186]: cluster 2024-09-20T22:36:51.273399+0000 mgr.a (mgr.14388) 961 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:55.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:55 smithi049 bash[23528]: cluster 2024-09-20T22:36:53.274185+0000 mgr.a (mgr.14388) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:55 smithi044 bash[22676]: cluster 2024-09-20T22:36:53.274185+0000 mgr.a (mgr.14388) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:55.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:55 smithi179 bash[23186]: cluster 2024-09-20T22:36:53.274185+0000 mgr.a (mgr.14388) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:36:55.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:36:55.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:36:55.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:36:56.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:36:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:36:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:36:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:36:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:36:57.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:57 smithi049 bash[23528]: cluster 2024-09-20T22:36:55.276158+0000 mgr.a (mgr.14388) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:57 smithi044 bash[22676]: cluster 2024-09-20T22:36:55.276158+0000 mgr.a (mgr.14388) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:57.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:57 smithi179 bash[23186]: cluster 2024-09-20T22:36:55.276158+0000 mgr.a (mgr.14388) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:58.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:58 smithi049 bash[23528]: audit 2024-09-20T22:36:56.312678+0000 mgr.a (mgr.14388) 964 : audit [DBG] from='client.33900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:58 smithi044 bash[22676]: audit 2024-09-20T22:36:56.312678+0000 mgr.a (mgr.14388) 964 : audit [DBG] from='client.33900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:58.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:58 smithi179 bash[23186]: audit 2024-09-20T22:36:56.312678+0000 mgr.a (mgr.14388) 964 : audit [DBG] from='client.33900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:36:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:36:59 smithi044 bash[22676]: cluster 2024-09-20T22:36:57.277106+0000 mgr.a (mgr.14388) 965 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:59.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:36:59 smithi049 bash[23528]: cluster 2024-09-20T22:36:57.277106+0000 mgr.a (mgr.14388) 965 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:36:59.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:36:59 smithi179 bash[23186]: cluster 2024-09-20T22:36:57.277106+0000 mgr.a (mgr.14388) 965 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:01 smithi044 bash[22676]: cluster 2024-09-20T22:36:59.277906+0000 mgr.a (mgr.14388) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:01.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:01 smithi179 bash[23186]: cluster 2024-09-20T22:36:59.277906+0000 mgr.a (mgr.14388) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:01.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:01 smithi049 bash[23528]: cluster 2024-09-20T22:36:59.277906+0000 mgr.a (mgr.14388) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:02.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:03.289 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:03 smithi179 bash[23186]: cluster 2024-09-20T22:37:01.280076+0000 mgr.a (mgr.14388) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:03.289 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:03 smithi179 bash[23186]: audit 2024-09-20T22:37:02.072823+0000 mgr.a (mgr.14388) 968 : audit [DBG] from='client.33978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:03.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:03 smithi049 bash[23528]: cluster 2024-09-20T22:37:01.280076+0000 mgr.a (mgr.14388) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:03.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:03 smithi049 bash[23528]: audit 2024-09-20T22:37:02.072823+0000 mgr.a (mgr.14388) 968 : audit [DBG] from='client.33978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:03 smithi044 bash[22676]: cluster 2024-09-20T22:37:01.280076+0000 mgr.a (mgr.14388) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:03 smithi044 bash[22676]: audit 2024-09-20T22:37:02.072823+0000 mgr.a (mgr.14388) 968 : audit [DBG] from='client.33978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:05.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:05 smithi049 bash[23528]: cluster 2024-09-20T22:37:03.281194+0000 mgr.a (mgr.14388) 969 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:05 smithi044 bash[22676]: cluster 2024-09-20T22:37:03.281194+0000 mgr.a (mgr.14388) 969 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:05.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:05 smithi179 bash[23186]: cluster 2024-09-20T22:37:03.281194+0000 mgr.a (mgr.14388) 969 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:07.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:07 smithi049 bash[23528]: cluster 2024-09-20T22:37:05.283499+0000 mgr.a (mgr.14388) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:07 smithi044 bash[22676]: cluster 2024-09-20T22:37:05.283499+0000 mgr.a (mgr.14388) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:07 smithi179 bash[23186]: cluster 2024-09-20T22:37:05.283499+0000 mgr.a (mgr.14388) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:07.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:07.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:07.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:08.255 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:08.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:08.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:08.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:08.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:09.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: cluster 2024-09-20T22:37:07.284262+0000 mgr.a (mgr.14388) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:09.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: audit 2024-09-20T22:37:07.831494+0000 mgr.a (mgr.14388) 972 : audit [DBG] from='client.34056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:09.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: audit 2024-09-20T22:37:08.130990+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: audit 2024-09-20T22:37:08.139128+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: audit 2024-09-20T22:37:08.144959+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: audit 2024-09-20T22:37:08.536722+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: audit 2024-09-20T22:37:08.545221+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.397 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:09 smithi049 bash[23528]: audit 2024-09-20T22:37:08.556061+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: cluster 2024-09-20T22:37:07.284262+0000 mgr.a (mgr.14388) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: audit 2024-09-20T22:37:07.831494+0000 mgr.a (mgr.14388) 972 : audit [DBG] from='client.34056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: audit 2024-09-20T22:37:08.130990+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: audit 2024-09-20T22:37:08.139128+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: audit 2024-09-20T22:37:08.144959+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: audit 2024-09-20T22:37:08.536722+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: audit 2024-09-20T22:37:08.545221+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:09 smithi044 bash[22676]: audit 2024-09-20T22:37:08.556061+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: cluster 2024-09-20T22:37:07.284262+0000 mgr.a (mgr.14388) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:09.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: audit 2024-09-20T22:37:07.831494+0000 mgr.a (mgr.14388) 972 : audit [DBG] from='client.34056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:09.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: audit 2024-09-20T22:37:08.130990+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: audit 2024-09-20T22:37:08.139128+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: audit 2024-09-20T22:37:08.144959+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: audit 2024-09-20T22:37:08.536722+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: audit 2024-09-20T22:37:08.545221+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:09.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:09 smithi179 bash[23186]: audit 2024-09-20T22:37:08.556061+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.465 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:11 smithi049 bash[23528]: cluster 2024-09-20T22:37:09.285129+0000 mgr.a (mgr.14388) 973 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:11.465 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:11 smithi049 bash[23528]: audit 2024-09-20T22:37:10.189560+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.466 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:11 smithi049 bash[23528]: audit 2024-09-20T22:37:10.199123+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.466 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:11 smithi049 bash[23528]: audit 2024-09-20T22:37:10.210494+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:11 smithi044 bash[22676]: cluster 2024-09-20T22:37:09.285129+0000 mgr.a (mgr.14388) 973 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:11 smithi044 bash[22676]: audit 2024-09-20T22:37:10.189560+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:11 smithi044 bash[22676]: audit 2024-09-20T22:37:10.199123+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:11 smithi044 bash[22676]: audit 2024-09-20T22:37:10.210494+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:11 smithi179 bash[23186]: cluster 2024-09-20T22:37:09.285129+0000 mgr.a (mgr.14388) 973 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:11 smithi179 bash[23186]: audit 2024-09-20T22:37:10.189560+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:11 smithi179 bash[23186]: audit 2024-09-20T22:37:10.199123+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:11 smithi179 bash[23186]: audit 2024-09-20T22:37:10.210494+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:13.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:13 smithi044 bash[22676]: cluster 2024-09-20T22:37:11.287269+0000 mgr.a (mgr.14388) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:13.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:13 smithi179 bash[23186]: cluster 2024-09-20T22:37:11.287269+0000 mgr.a (mgr.14388) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:13.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:13 smithi049 bash[23528]: cluster 2024-09-20T22:37:11.287269+0000 mgr.a (mgr.14388) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:14.038 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:14.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:14.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:14.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:14.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:15 smithi044 bash[22676]: cluster 2024-09-20T22:37:13.287907+0000 mgr.a (mgr.14388) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:15 smithi044 bash[22676]: audit 2024-09-20T22:37:13.598355+0000 mgr.a (mgr.14388) 976 : audit [DBG] from='client.34134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:15 smithi179 bash[23186]: cluster 2024-09-20T22:37:13.287907+0000 mgr.a (mgr.14388) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:15.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:15 smithi179 bash[23186]: audit 2024-09-20T22:37:13.598355+0000 mgr.a (mgr.14388) 976 : audit [DBG] from='client.34134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:15.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:15 smithi049 bash[23528]: cluster 2024-09-20T22:37:13.287907+0000 mgr.a (mgr.14388) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:15.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:15 smithi049 bash[23528]: audit 2024-09-20T22:37:13.598355+0000 mgr.a (mgr.14388) 976 : audit [DBG] from='client.34134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:16 smithi044 bash[22676]: audit 2024-09-20T22:37:16.016856+0000 mon.a (mon.0) 1564 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:37:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:16 smithi044 bash[22676]: audit 2024-09-20T22:37:16.023720+0000 mon.a (mon.0) 1565 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:37:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:16 smithi044 bash[22676]: audit 2024-09-20T22:37:16.025553+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:37:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:16 smithi044 bash[22676]: audit 2024-09-20T22:37:16.036832+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:16 smithi044 bash[22676]: audit 2024-09-20T22:37:16.043216+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:16 smithi179 bash[23186]: audit 2024-09-20T22:37:16.016856+0000 mon.a (mon.0) 1564 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:37:16.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:16 smithi179 bash[23186]: audit 2024-09-20T22:37:16.023720+0000 mon.a (mon.0) 1565 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:37:16.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:16 smithi179 bash[23186]: audit 2024-09-20T22:37:16.025553+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:37:16.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:16 smithi179 bash[23186]: audit 2024-09-20T22:37:16.036832+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:16.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:16 smithi179 bash[23186]: audit 2024-09-20T22:37:16.043216+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:37:16.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:16 smithi049 bash[23528]: audit 2024-09-20T22:37:16.016856+0000 mon.a (mon.0) 1564 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:37:16.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:16 smithi049 bash[23528]: audit 2024-09-20T22:37:16.023720+0000 mon.a (mon.0) 1565 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:37:16.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:16 smithi049 bash[23528]: audit 2024-09-20T22:37:16.025553+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:37:16.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:16 smithi049 bash[23528]: audit 2024-09-20T22:37:16.036832+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:16.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:16 smithi049 bash[23528]: audit 2024-09-20T22:37:16.043216+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:37:17.154 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:37:16 smithi044 bash[22930]: debug 2024-09-20T22:37:16.819+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:37:17.154 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:37:16 smithi044 bash[22930]: debug 2024-09-20T22:37:16.823+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:37:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:17 smithi044 bash[22676]: cluster 2024-09-20T22:37:15.290182+0000 mgr.a (mgr.14388) 977 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:17 smithi044 bash[22676]: audit 2024-09-20T22:37:16.045608+0000 mgr.a (mgr.14388) 978 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:37:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:17 smithi044 bash[22676]: audit 2024-09-20T22:37:16.824576+0000 mgr.a (mgr.14388) 979 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:37:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:17 smithi044 bash[22676]: cephadm 2024-09-20T22:37:16.825974+0000 mgr.a (mgr.14388) 980 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:37:17.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:17 smithi179 bash[23186]: cluster 2024-09-20T22:37:15.290182+0000 mgr.a (mgr.14388) 977 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:17.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:17 smithi179 bash[23186]: audit 2024-09-20T22:37:16.045608+0000 mgr.a (mgr.14388) 978 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:37:17.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:17 smithi179 bash[23186]: audit 2024-09-20T22:37:16.824576+0000 mgr.a (mgr.14388) 979 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:37:17.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:17 smithi179 bash[23186]: cephadm 2024-09-20T22:37:16.825974+0000 mgr.a (mgr.14388) 980 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:37:17.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:17 smithi049 bash[23528]: cluster 2024-09-20T22:37:15.290182+0000 mgr.a (mgr.14388) 977 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:17.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:17 smithi049 bash[23528]: audit 2024-09-20T22:37:16.045608+0000 mgr.a (mgr.14388) 978 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:37:17.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:17 smithi049 bash[23528]: audit 2024-09-20T22:37:16.824576+0000 mgr.a (mgr.14388) 979 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:37:17.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:17 smithi049 bash[23528]: cephadm 2024-09-20T22:37:16.825974+0000 mgr.a (mgr.14388) 980 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:37:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:18 smithi044 bash[22676]: cluster 2024-09-20T22:37:17.291102+0000 mgr.a (mgr.14388) 981 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:18.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:18 smithi179 bash[23186]: cluster 2024-09-20T22:37:17.291102+0000 mgr.a (mgr.14388) 981 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:18.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:18 smithi049 bash[23528]: cluster 2024-09-20T22:37:17.291102+0000 mgr.a (mgr.14388) 981 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:19.041 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:19.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:19.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:19.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:19.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:20.684 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:20 smithi044 bash[22676]: cluster 2024-09-20T22:37:19.291850+0000 mgr.a (mgr.14388) 982 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:20.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:20 smithi044 bash[22676]: audit 2024-09-20T22:37:19.378089+0000 mgr.a (mgr.14388) 983 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:20.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:20 smithi179 bash[23186]: cluster 2024-09-20T22:37:19.291850+0000 mgr.a (mgr.14388) 982 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:20.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:20 smithi179 bash[23186]: audit 2024-09-20T22:37:19.378089+0000 mgr.a (mgr.14388) 983 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:20.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:20 smithi049 bash[23528]: cluster 2024-09-20T22:37:19.291850+0000 mgr.a (mgr.14388) 982 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:20.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:20 smithi049 bash[23528]: audit 2024-09-20T22:37:19.378089+0000 mgr.a (mgr.14388) 983 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:22.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:22 smithi179 bash[23186]: cluster 2024-09-20T22:37:21.294294+0000 mgr.a (mgr.14388) 984 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:22.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:22 smithi044 bash[22676]: cluster 2024-09-20T22:37:21.294294+0000 mgr.a (mgr.14388) 984 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:22.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:22 smithi049 bash[23528]: cluster 2024-09-20T22:37:21.294294+0000 mgr.a (mgr.14388) 984 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:24 smithi044 bash[22676]: cluster 2024-09-20T22:37:23.295103+0000 mgr.a (mgr.14388) 985 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:24.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:24 smithi179 bash[23186]: cluster 2024-09-20T22:37:23.295103+0000 mgr.a (mgr.14388) 985 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:24.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:24 smithi049 bash[23528]: cluster 2024-09-20T22:37:23.295103+0000 mgr.a (mgr.14388) 985 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:25.600 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:25.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:25.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:25.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:25.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:26 smithi044 bash[22676]: audit 2024-09-20T22:37:25.152303+0000 mgr.a (mgr.14388) 986 : audit [DBG] from='client.34392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:26 smithi044 bash[22676]: cluster 2024-09-20T22:37:25.300518+0000 mgr.a (mgr.14388) 987 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:26.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:26 smithi179 bash[23186]: audit 2024-09-20T22:37:25.152303+0000 mgr.a (mgr.14388) 986 : audit [DBG] from='client.34392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:26.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:26 smithi179 bash[23186]: cluster 2024-09-20T22:37:25.300518+0000 mgr.a (mgr.14388) 987 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:26.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:26 smithi049 bash[23528]: audit 2024-09-20T22:37:25.152303+0000 mgr.a (mgr.14388) 986 : audit [DBG] from='client.34392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:26.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:26 smithi049 bash[23528]: cluster 2024-09-20T22:37:25.300518+0000 mgr.a (mgr.14388) 987 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:28 smithi044 bash[22676]: cluster 2024-09-20T22:37:27.301454+0000 mgr.a (mgr.14388) 988 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:37:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:28 smithi044 bash[22676]: audit 2024-09-20T22:37:28.351477+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:28 smithi044 bash[22676]: audit 2024-09-20T22:37:28.360414+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:28.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:28 smithi179 bash[23186]: cluster 2024-09-20T22:37:27.301454+0000 mgr.a (mgr.14388) 988 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:37:28.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:28 smithi179 bash[23186]: audit 2024-09-20T22:37:28.351477+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:28.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:28 smithi179 bash[23186]: audit 2024-09-20T22:37:28.360414+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:28.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:28 smithi049 bash[23528]: cluster 2024-09-20T22:37:27.301454+0000 mgr.a (mgr.14388) 988 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:37:28.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:28 smithi049 bash[23528]: audit 2024-09-20T22:37:28.351477+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:28.777 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:28 smithi049 bash[23528]: audit 2024-09-20T22:37:28.360414+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:29 smithi049 bash[23528]: audit 2024-09-20T22:37:28.376415+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:29 smithi049 bash[23528]: audit 2024-09-20T22:37:28.755587+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:29 smithi049 bash[23528]: audit 2024-09-20T22:37:28.764749+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:29 smithi049 bash[23528]: audit 2024-09-20T22:37:28.775210+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:29 smithi044 bash[22676]: audit 2024-09-20T22:37:28.376415+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:29 smithi044 bash[22676]: audit 2024-09-20T22:37:28.755587+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:29 smithi044 bash[22676]: audit 2024-09-20T22:37:28.764749+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:29 smithi044 bash[22676]: audit 2024-09-20T22:37:28.775210+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:29 smithi179 bash[23186]: audit 2024-09-20T22:37:28.376415+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:29 smithi179 bash[23186]: audit 2024-09-20T22:37:28.755587+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:29 smithi179 bash[23186]: audit 2024-09-20T22:37:28.764749+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:29.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:29 smithi179 bash[23186]: audit 2024-09-20T22:37:28.775210+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:31.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:30 smithi049 bash[23528]: cluster 2024-09-20T22:37:29.302259+0000 mgr.a (mgr.14388) 989 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:37:31.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:30 smithi049 bash[23528]: audit 2024-09-20T22:37:30.406770+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:30 smithi049 bash[23528]: audit 2024-09-20T22:37:30.416257+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:30 smithi049 bash[23528]: audit 2024-09-20T22:37:30.427385+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:30 smithi044 bash[22676]: cluster 2024-09-20T22:37:29.302259+0000 mgr.a (mgr.14388) 989 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:37:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:30 smithi044 bash[22676]: audit 2024-09-20T22:37:30.406770+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:30 smithi044 bash[22676]: audit 2024-09-20T22:37:30.416257+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:30 smithi044 bash[22676]: audit 2024-09-20T22:37:30.427385+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:30 smithi179 bash[23186]: cluster 2024-09-20T22:37:29.302259+0000 mgr.a (mgr.14388) 989 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:37:31.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:30 smithi179 bash[23186]: audit 2024-09-20T22:37:30.406770+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:30 smithi179 bash[23186]: audit 2024-09-20T22:37:30.416257+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:30 smithi179 bash[23186]: audit 2024-09-20T22:37:30.427385+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:31.393 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:31.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:31.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:31.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:31.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:32.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:31 smithi049 bash[23528]: audit 2024-09-20T22:37:30.941486+0000 mgr.a (mgr.14388) 990 : audit [DBG] from='client.34467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:31 smithi044 bash[22676]: audit 2024-09-20T22:37:30.941486+0000 mgr.a (mgr.14388) 990 : audit [DBG] from='client.34467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:32.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:31 smithi179 bash[23186]: audit 2024-09-20T22:37:30.941486+0000 mgr.a (mgr.14388) 990 : audit [DBG] from='client.34467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:33.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:32 smithi049 bash[23528]: cluster 2024-09-20T22:37:31.304071+0000 mgr.a (mgr.14388) 991 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:32 smithi044 bash[22676]: cluster 2024-09-20T22:37:31.304071+0000 mgr.a (mgr.14388) 991 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:33.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:32 smithi179 bash[23186]: cluster 2024-09-20T22:37:31.304071+0000 mgr.a (mgr.14388) 991 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:37:35.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:34 smithi049 bash[23528]: cluster 2024-09-20T22:37:33.304801+0000 mgr.a (mgr.14388) 992 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:37:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:34 smithi044 bash[22676]: cluster 2024-09-20T22:37:33.304801+0000 mgr.a (mgr.14388) 992 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:37:35.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:34 smithi179 bash[23186]: cluster 2024-09-20T22:37:33.304801+0000 mgr.a (mgr.14388) 992 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:37:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:37.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:36 smithi049 bash[23528]: cluster 2024-09-20T22:37:35.306733+0000 mgr.a (mgr.14388) 993 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:37.170 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:36 smithi044 bash[22676]: cluster 2024-09-20T22:37:35.306733+0000 mgr.a (mgr.14388) 993 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:37.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:36 smithi179 bash[23186]: cluster 2024-09-20T22:37:35.306733+0000 mgr.a (mgr.14388) 993 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:37 smithi044 bash[22676]: audit 2024-09-20T22:37:36.734134+0000 mgr.a (mgr.14388) 994 : audit [DBG] from='client.34542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:38.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:37 smithi179 bash[23186]: audit 2024-09-20T22:37:36.734134+0000 mgr.a (mgr.14388) 994 : audit [DBG] from='client.34542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:38.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:37 smithi049 bash[23528]: audit 2024-09-20T22:37:36.734134+0000 mgr.a (mgr.14388) 994 : audit [DBG] from='client.34542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:38 smithi044 bash[22676]: cluster 2024-09-20T22:37:37.307660+0000 mgr.a (mgr.14388) 995 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:39.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:38 smithi179 bash[23186]: cluster 2024-09-20T22:37:37.307660+0000 mgr.a (mgr.14388) 995 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:39.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:38 smithi049 bash[23528]: cluster 2024-09-20T22:37:37.307660+0000 mgr.a (mgr.14388) 995 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:41.089 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:40 smithi044 bash[22676]: cluster 2024-09-20T22:37:39.308460+0000 mgr.a (mgr.14388) 996 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:41.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:40 smithi179 bash[23186]: cluster 2024-09-20T22:37:39.308460+0000 mgr.a (mgr.14388) 996 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:41.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:40 smithi049 bash[23528]: cluster 2024-09-20T22:37:39.308460+0000 mgr.a (mgr.14388) 996 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:42.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:42.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:42.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:42.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:42.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:42.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:42 smithi179 bash[23186]: cluster 2024-09-20T22:37:41.310050+0000 mgr.a (mgr.14388) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:43.143 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:42 smithi044 bash[22676]: cluster 2024-09-20T22:37:41.310050+0000 mgr.a (mgr.14388) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:43.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:42 smithi049 bash[23528]: cluster 2024-09-20T22:37:41.310050+0000 mgr.a (mgr.14388) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:44.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:43 smithi179 bash[23186]: audit 2024-09-20T22:37:42.503790+0000 mgr.a (mgr.14388) 998 : audit [DBG] from='client.34617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:43 smithi044 bash[22676]: audit 2024-09-20T22:37:42.503790+0000 mgr.a (mgr.14388) 998 : audit [DBG] from='client.34617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:44.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:43 smithi049 bash[23528]: audit 2024-09-20T22:37:42.503790+0000 mgr.a (mgr.14388) 998 : audit [DBG] from='client.34617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:44 smithi044 bash[22676]: cluster 2024-09-20T22:37:43.310953+0000 mgr.a (mgr.14388) 999 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:44 smithi179 bash[23186]: cluster 2024-09-20T22:37:43.310953+0000 mgr.a (mgr.14388) 999 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:45.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:44 smithi049 bash[23528]: cluster 2024-09-20T22:37:43.310953+0000 mgr.a (mgr.14388) 999 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:46 smithi044 bash[22676]: cluster 2024-09-20T22:37:45.313087+0000 mgr.a (mgr.14388) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:47.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:46 smithi179 bash[23186]: cluster 2024-09-20T22:37:45.313087+0000 mgr.a (mgr.14388) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:47.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:46 smithi049 bash[23528]: cluster 2024-09-20T22:37:45.313087+0000 mgr.a (mgr.14388) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:47.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:47.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:47.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:48.710 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:48.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:48.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:48.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:48.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:49.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:48 smithi049 bash[23528]: cluster 2024-09-20T22:37:47.313812+0000 mgr.a (mgr.14388) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:49.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:48 smithi049 bash[23528]: audit 2024-09-20T22:37:48.567428+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:48 smithi049 bash[23528]: audit 2024-09-20T22:37:48.574174+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.209 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:48 smithi049 bash[23528]: audit 2024-09-20T22:37:48.580888+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:48 smithi044 bash[22676]: cluster 2024-09-20T22:37:47.313812+0000 mgr.a (mgr.14388) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:48 smithi044 bash[22676]: audit 2024-09-20T22:37:48.567428+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:48 smithi044 bash[22676]: audit 2024-09-20T22:37:48.574174+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:48 smithi044 bash[22676]: audit 2024-09-20T22:37:48.580888+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:48 smithi179 bash[23186]: cluster 2024-09-20T22:37:47.313812+0000 mgr.a (mgr.14388) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:49.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:48 smithi179 bash[23186]: audit 2024-09-20T22:37:48.567428+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:48 smithi179 bash[23186]: audit 2024-09-20T22:37:48.574174+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:49.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:48 smithi179 bash[23186]: audit 2024-09-20T22:37:48.580888+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:49 smithi049 bash[23528]: audit 2024-09-20T22:37:48.265969+0000 mgr.a (mgr.14388) 1002 : audit [DBG] from='client.34695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:50.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:49 smithi049 bash[23528]: audit 2024-09-20T22:37:48.977446+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:49 smithi049 bash[23528]: audit 2024-09-20T22:37:48.986087+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:49 smithi049 bash[23528]: audit 2024-09-20T22:37:48.996432+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:49 smithi044 bash[22676]: audit 2024-09-20T22:37:48.265969+0000 mgr.a (mgr.14388) 1002 : audit [DBG] from='client.34695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:49 smithi044 bash[22676]: audit 2024-09-20T22:37:48.977446+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:49 smithi044 bash[22676]: audit 2024-09-20T22:37:48.986087+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:49 smithi044 bash[22676]: audit 2024-09-20T22:37:48.996432+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:49 smithi179 bash[23186]: audit 2024-09-20T22:37:48.265969+0000 mgr.a (mgr.14388) 1002 : audit [DBG] from='client.34695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:50.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:49 smithi179 bash[23186]: audit 2024-09-20T22:37:48.977446+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:49 smithi179 bash[23186]: audit 2024-09-20T22:37:48.986087+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:50.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:49 smithi179 bash[23186]: audit 2024-09-20T22:37:48.996432+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:51 smithi179 bash[23186]: cluster 2024-09-20T22:37:49.314723+0000 mgr.a (mgr.14388) 1003 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:51 smithi179 bash[23186]: audit 2024-09-20T22:37:50.623468+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:51 smithi179 bash[23186]: audit 2024-09-20T22:37:50.631727+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:51 smithi179 bash[23186]: audit 2024-09-20T22:37:50.641650+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:51 smithi049 bash[23528]: cluster 2024-09-20T22:37:49.314723+0000 mgr.a (mgr.14388) 1003 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:51.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:51 smithi049 bash[23528]: audit 2024-09-20T22:37:50.623468+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:51 smithi049 bash[23528]: audit 2024-09-20T22:37:50.631727+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:51 smithi049 bash[23528]: audit 2024-09-20T22:37:50.641650+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:50 smithi044 bash[22676]: cluster 2024-09-20T22:37:49.314723+0000 mgr.a (mgr.14388) 1003 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:50 smithi044 bash[22676]: audit 2024-09-20T22:37:50.623468+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:50 smithi044 bash[22676]: audit 2024-09-20T22:37:50.631727+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:50 smithi044 bash[22676]: audit 2024-09-20T22:37:50.641650+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:37:53.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:53 smithi049 bash[23528]: cluster 2024-09-20T22:37:51.316941+0000 mgr.a (mgr.14388) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:53 smithi044 bash[22676]: cluster 2024-09-20T22:37:51.316941+0000 mgr.a (mgr.14388) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:53.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:53 smithi179 bash[23186]: cluster 2024-09-20T22:37:51.316941+0000 mgr.a (mgr.14388) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:53.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:53.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:53.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:54.454 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:37:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:37:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:37:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:37:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:37:55.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:55 smithi049 bash[23528]: cluster 2024-09-20T22:37:53.317728+0000 mgr.a (mgr.14388) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:55.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:55 smithi049 bash[23528]: audit 2024-09-20T22:37:54.044918+0000 mgr.a (mgr.14388) 1006 : audit [DBG] from='client.34773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:55 smithi044 bash[22676]: cluster 2024-09-20T22:37:53.317728+0000 mgr.a (mgr.14388) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:55 smithi044 bash[22676]: audit 2024-09-20T22:37:54.044918+0000 mgr.a (mgr.14388) 1006 : audit [DBG] from='client.34773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:55.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:55 smithi179 bash[23186]: cluster 2024-09-20T22:37:53.317728+0000 mgr.a (mgr.14388) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:55.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:55 smithi179 bash[23186]: audit 2024-09-20T22:37:54.044918+0000 mgr.a (mgr.14388) 1006 : audit [DBG] from='client.34773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:37:57.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:57 smithi049 bash[23528]: cluster 2024-09-20T22:37:55.320020+0000 mgr.a (mgr.14388) 1007 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:57 smithi044 bash[22676]: cluster 2024-09-20T22:37:55.320020+0000 mgr.a (mgr.14388) 1007 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:57.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:57 smithi179 bash[23186]: cluster 2024-09-20T22:37:55.320020+0000 mgr.a (mgr.14388) 1007 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:37:59.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:37:59 smithi049 bash[23528]: cluster 2024-09-20T22:37:57.320814+0000 mgr.a (mgr.14388) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:37:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:37:59 smithi044 bash[22676]: cluster 2024-09-20T22:37:57.320814+0000 mgr.a (mgr.14388) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:37:59.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:37:59 smithi179 bash[23186]: cluster 2024-09-20T22:37:57.320814+0000 mgr.a (mgr.14388) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:00.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:00.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:00.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:00.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:00.227 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:01.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:01 smithi179 bash[23186]: cluster 2024-09-20T22:37:59.321588+0000 mgr.a (mgr.14388) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:01.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:01 smithi179 bash[23186]: audit 2024-09-20T22:37:59.789751+0000 mgr.a (mgr.14388) 1010 : audit [DBG] from='client.34851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:01.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:01 smithi049 bash[23528]: cluster 2024-09-20T22:37:59.321588+0000 mgr.a (mgr.14388) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:01.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:01 smithi049 bash[23528]: audit 2024-09-20T22:37:59.789751+0000 mgr.a (mgr.14388) 1010 : audit [DBG] from='client.34851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:01 smithi044 bash[22676]: cluster 2024-09-20T22:37:59.321588+0000 mgr.a (mgr.14388) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:01 smithi044 bash[22676]: audit 2024-09-20T22:37:59.789751+0000 mgr.a (mgr.14388) 1010 : audit [DBG] from='client.34851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:03.097 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:03 smithi044 bash[22676]: cluster 2024-09-20T22:38:01.324276+0000 mgr.a (mgr.14388) 1011 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:03.297 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:03 smithi049 bash[23528]: cluster 2024-09-20T22:38:01.324276+0000 mgr.a (mgr.14388) 1011 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:03.299 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:03 smithi179 bash[23186]: cluster 2024-09-20T22:38:01.324276+0000 mgr.a (mgr.14388) 1011 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:05.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:05.229 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:05.229 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:05.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:05 smithi049 bash[23528]: cluster 2024-09-20T22:38:03.325106+0000 mgr.a (mgr.14388) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:05 smithi044 bash[22676]: cluster 2024-09-20T22:38:03.325106+0000 mgr.a (mgr.14388) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:05.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:05 smithi179 bash[23186]: cluster 2024-09-20T22:38:03.325106+0000 mgr.a (mgr.14388) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:05.993 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:05.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:05.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:05.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:05.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:07.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:07 smithi049 bash[23528]: cluster 2024-09-20T22:38:05.326293+0000 mgr.a (mgr.14388) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:07.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:07 smithi049 bash[23528]: audit 2024-09-20T22:38:05.562061+0000 mgr.a (mgr.14388) 1014 : audit [DBG] from='client.34926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:07 smithi044 bash[22676]: cluster 2024-09-20T22:38:05.326293+0000 mgr.a (mgr.14388) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:07 smithi044 bash[22676]: audit 2024-09-20T22:38:05.562061+0000 mgr.a (mgr.14388) 1014 : audit [DBG] from='client.34926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:07 smithi179 bash[23186]: cluster 2024-09-20T22:38:05.326293+0000 mgr.a (mgr.14388) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:07.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:07 smithi179 bash[23186]: audit 2024-09-20T22:38:05.562061+0000 mgr.a (mgr.14388) 1014 : audit [DBG] from='client.34926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:09.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:09 smithi179 bash[23186]: cluster 2024-09-20T22:38:07.327156+0000 mgr.a (mgr.14388) 1015 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:38:09.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:09 smithi179 bash[23186]: audit 2024-09-20T22:38:08.791236+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:09 smithi179 bash[23186]: audit 2024-09-20T22:38:08.799773+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:09 smithi179 bash[23186]: audit 2024-09-20T22:38:08.810506+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:09 smithi049 bash[23528]: cluster 2024-09-20T22:38:07.327156+0000 mgr.a (mgr.14388) 1015 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:38:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:09 smithi049 bash[23528]: audit 2024-09-20T22:38:08.791236+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:09 smithi049 bash[23528]: audit 2024-09-20T22:38:08.799773+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:09 smithi049 bash[23528]: audit 2024-09-20T22:38:08.810506+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:09 smithi044 bash[22676]: cluster 2024-09-20T22:38:07.327156+0000 mgr.a (mgr.14388) 1015 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:38:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:09 smithi044 bash[22676]: audit 2024-09-20T22:38:08.791236+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:09 smithi044 bash[22676]: audit 2024-09-20T22:38:08.799773+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:09 smithi044 bash[22676]: audit 2024-09-20T22:38:08.810506+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:10 smithi049 bash[23528]: audit 2024-09-20T22:38:09.168689+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:10 smithi049 bash[23528]: audit 2024-09-20T22:38:09.177659+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:10 smithi049 bash[23528]: audit 2024-09-20T22:38:09.187638+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:10 smithi049 bash[23528]: cluster 2024-09-20T22:38:09.327937+0000 mgr.a (mgr.14388) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:38:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:10 smithi044 bash[22676]: audit 2024-09-20T22:38:09.168689+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:10 smithi044 bash[22676]: audit 2024-09-20T22:38:09.177659+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:10 smithi044 bash[22676]: audit 2024-09-20T22:38:09.187638+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:10 smithi044 bash[22676]: cluster 2024-09-20T22:38:09.327937+0000 mgr.a (mgr.14388) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:38:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:10 smithi179 bash[23186]: audit 2024-09-20T22:38:09.168689+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:10 smithi179 bash[23186]: audit 2024-09-20T22:38:09.177659+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:10 smithi179 bash[23186]: audit 2024-09-20T22:38:09.187638+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:10.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:10 smithi179 bash[23186]: cluster 2024-09-20T22:38:09.327937+0000 mgr.a (mgr.14388) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:38:10.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:10.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:10.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:11.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:11.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:12.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:11 smithi049 bash[23528]: audit 2024-09-20T22:38:10.826029+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:11 smithi049 bash[23528]: audit 2024-09-20T22:38:10.833810+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:11 smithi049 bash[23528]: audit 2024-09-20T22:38:10.840979+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:11 smithi044 bash[22676]: audit 2024-09-20T22:38:10.826029+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:11 smithi044 bash[22676]: audit 2024-09-20T22:38:10.833810+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:11 smithi044 bash[22676]: audit 2024-09-20T22:38:10.840979+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:11 smithi179 bash[23186]: audit 2024-09-20T22:38:10.826029+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:11 smithi179 bash[23186]: audit 2024-09-20T22:38:10.833810+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:12.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:11 smithi179 bash[23186]: audit 2024-09-20T22:38:10.840979+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:12 smithi044 bash[22676]: audit 2024-09-20T22:38:11.329089+0000 mgr.a (mgr.14388) 1017 : audit [DBG] from='client.35001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:12 smithi044 bash[22676]: cluster 2024-09-20T22:38:11.339095+0000 mgr.a (mgr.14388) 1018 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:12 smithi179 bash[23186]: audit 2024-09-20T22:38:11.329089+0000 mgr.a (mgr.14388) 1017 : audit [DBG] from='client.35001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:13.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:12 smithi179 bash[23186]: cluster 2024-09-20T22:38:11.339095+0000 mgr.a (mgr.14388) 1018 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:13.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:12 smithi049 bash[23528]: audit 2024-09-20T22:38:11.329089+0000 mgr.a (mgr.14388) 1017 : audit [DBG] from='client.35001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:13.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:12 smithi049 bash[23528]: cluster 2024-09-20T22:38:11.339095+0000 mgr.a (mgr.14388) 1018 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:14 smithi044 bash[22676]: cluster 2024-09-20T22:38:13.340013+0000 mgr.a (mgr.14388) 1019 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:15.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:14 smithi179 bash[23186]: cluster 2024-09-20T22:38:13.340013+0000 mgr.a (mgr.14388) 1019 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:15.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:14 smithi049 bash[23528]: cluster 2024-09-20T22:38:13.340013+0000 mgr.a (mgr.14388) 1019 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:16.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:16.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:16 smithi044 bash[22676]: cluster 2024-09-20T22:38:15.342222+0000 mgr.a (mgr.14388) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:17.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:16 smithi179 bash[23186]: cluster 2024-09-20T22:38:15.342222+0000 mgr.a (mgr.14388) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:17.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:16 smithi049 bash[23528]: cluster 2024-09-20T22:38:15.342222+0000 mgr.a (mgr.14388) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:17.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22930]: debug 2024-09-20T22:38:17.643+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:38:17.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22930]: debug 2024-09-20T22:38:17.659+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:38:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22676]: audit 2024-09-20T22:38:16.880433+0000 mon.a (mon.0) 1596 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:38:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22676]: audit 2024-09-20T22:38:16.884576+0000 mon.a (mon.0) 1597 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:38:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22676]: audit 2024-09-20T22:38:16.885742+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:38:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22676]: audit 2024-09-20T22:38:16.893671+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22676]: audit 2024-09-20T22:38:16.898810+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:38:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22676]: audit 2024-09-20T22:38:16.900541+0000 mgr.a (mgr.14388) 1021 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:38:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:17 smithi044 bash[22676]: audit 2024-09-20T22:38:17.105279+0000 mgr.a (mgr.14388) 1022 : audit [DBG] from='client.35070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:18.058 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:18.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:18.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:18.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:18.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:18.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:17 smithi179 bash[23186]: audit 2024-09-20T22:38:16.880433+0000 mon.a (mon.0) 1596 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:38:18.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:17 smithi179 bash[23186]: audit 2024-09-20T22:38:16.884576+0000 mon.a (mon.0) 1597 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:38:18.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:17 smithi179 bash[23186]: audit 2024-09-20T22:38:16.885742+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:38:18.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:17 smithi179 bash[23186]: audit 2024-09-20T22:38:16.893671+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:18.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:17 smithi179 bash[23186]: audit 2024-09-20T22:38:16.898810+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:38:18.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:17 smithi179 bash[23186]: audit 2024-09-20T22:38:16.900541+0000 mgr.a (mgr.14388) 1021 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:38:18.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:17 smithi179 bash[23186]: audit 2024-09-20T22:38:17.105279+0000 mgr.a (mgr.14388) 1022 : audit [DBG] from='client.35070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:18.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:17 smithi049 bash[23528]: audit 2024-09-20T22:38:16.880433+0000 mon.a (mon.0) 1596 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:38:18.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:17 smithi049 bash[23528]: audit 2024-09-20T22:38:16.884576+0000 mon.a (mon.0) 1597 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:38:18.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:17 smithi049 bash[23528]: audit 2024-09-20T22:38:16.885742+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:38:18.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:17 smithi049 bash[23528]: audit 2024-09-20T22:38:16.893671+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:18.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:17 smithi049 bash[23528]: audit 2024-09-20T22:38:16.898810+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:38:18.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:17 smithi049 bash[23528]: audit 2024-09-20T22:38:16.900541+0000 mgr.a (mgr.14388) 1021 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:38:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:17 smithi049 bash[23528]: audit 2024-09-20T22:38:17.105279+0000 mgr.a (mgr.14388) 1022 : audit [DBG] from='client.35070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:18 smithi044 bash[22676]: cluster 2024-09-20T22:38:17.343074+0000 mgr.a (mgr.14388) 1023 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:18 smithi044 bash[22676]: audit 2024-09-20T22:38:17.648710+0000 mgr.a (mgr.14388) 1024 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:38:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:18 smithi044 bash[22676]: cephadm 2024-09-20T22:38:17.661759+0000 mgr.a (mgr.14388) 1025 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:38:19.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:18 smithi179 bash[23186]: cluster 2024-09-20T22:38:17.343074+0000 mgr.a (mgr.14388) 1023 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:19.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:18 smithi179 bash[23186]: audit 2024-09-20T22:38:17.648710+0000 mgr.a (mgr.14388) 1024 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:38:19.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:18 smithi179 bash[23186]: cephadm 2024-09-20T22:38:17.661759+0000 mgr.a (mgr.14388) 1025 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:38:19.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:18 smithi049 bash[23528]: cluster 2024-09-20T22:38:17.343074+0000 mgr.a (mgr.14388) 1023 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:19.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:18 smithi049 bash[23528]: audit 2024-09-20T22:38:17.648710+0000 mgr.a (mgr.14388) 1024 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:38:19.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:18 smithi049 bash[23528]: cephadm 2024-09-20T22:38:17.661759+0000 mgr.a (mgr.14388) 1025 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:38:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:20 smithi044 bash[22676]: cluster 2024-09-20T22:38:19.344063+0000 mgr.a (mgr.14388) 1026 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:21.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:20 smithi179 bash[23186]: cluster 2024-09-20T22:38:19.344063+0000 mgr.a (mgr.14388) 1026 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:21.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:20 smithi049 bash[23528]: cluster 2024-09-20T22:38:19.344063+0000 mgr.a (mgr.14388) 1026 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:23.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:23.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:23.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:22 smithi044 bash[22676]: cluster 2024-09-20T22:38:21.345364+0000 mgr.a (mgr.14388) 1027 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:23.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:22 smithi179 bash[23186]: cluster 2024-09-20T22:38:21.345364+0000 mgr.a (mgr.14388) 1027 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:23.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:22 smithi049 bash[23528]: cluster 2024-09-20T22:38:21.345364+0000 mgr.a (mgr.14388) 1027 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:23.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:23.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:23.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:23.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:23.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:24 smithi044 bash[22676]: cluster 2024-09-20T22:38:23.346027+0000 mgr.a (mgr.14388) 1028 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:24 smithi044 bash[22676]: audit 2024-09-20T22:38:23.395513+0000 mgr.a (mgr.14388) 1029 : audit [DBG] from='client.35256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:25.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:24 smithi179 bash[23186]: cluster 2024-09-20T22:38:23.346027+0000 mgr.a (mgr.14388) 1028 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:25.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:24 smithi179 bash[23186]: audit 2024-09-20T22:38:23.395513+0000 mgr.a (mgr.14388) 1029 : audit [DBG] from='client.35256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:25.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:24 smithi049 bash[23528]: cluster 2024-09-20T22:38:23.346027+0000 mgr.a (mgr.14388) 1028 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:25.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:24 smithi049 bash[23528]: audit 2024-09-20T22:38:23.395513+0000 mgr.a (mgr.14388) 1029 : audit [DBG] from='client.35256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:26 smithi044 bash[22676]: cluster 2024-09-20T22:38:25.348254+0000 mgr.a (mgr.14388) 1030 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:27.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:26 smithi179 bash[23186]: cluster 2024-09-20T22:38:25.348254+0000 mgr.a (mgr.14388) 1030 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:26 smithi049 bash[23528]: cluster 2024-09-20T22:38:25.348254+0000 mgr.a (mgr.14388) 1030 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:28.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:28 smithi044 bash[22676]: cluster 2024-09-20T22:38:27.349026+0000 mgr.a (mgr.14388) 1031 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:29.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:28 smithi179 bash[23186]: cluster 2024-09-20T22:38:27.349026+0000 mgr.a (mgr.14388) 1031 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:29.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:28 smithi049 bash[23528]: cluster 2024-09-20T22:38:27.349026+0000 mgr.a (mgr.14388) 1031 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:29.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:29.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:29.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:29.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:29.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:30.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:30 smithi049 bash[23528]: audit 2024-09-20T22:38:29.020982+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:30 smithi049 bash[23528]: audit 2024-09-20T22:38:29.029306+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:30 smithi049 bash[23528]: audit 2024-09-20T22:38:29.039227+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:30 smithi049 bash[23528]: audit 2024-09-20T22:38:29.136971+0000 mgr.a (mgr.14388) 1032 : audit [DBG] from='client.35334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:30.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:30 smithi049 bash[23528]: audit 2024-09-20T22:38:29.382160+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:30 smithi049 bash[23528]: audit 2024-09-20T22:38:29.389561+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:30 smithi049 bash[23528]: audit 2024-09-20T22:38:29.394947+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:30 smithi044 bash[22676]: audit 2024-09-20T22:38:29.020982+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:30 smithi044 bash[22676]: audit 2024-09-20T22:38:29.029306+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:30 smithi044 bash[22676]: audit 2024-09-20T22:38:29.039227+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:30 smithi044 bash[22676]: audit 2024-09-20T22:38:29.136971+0000 mgr.a (mgr.14388) 1032 : audit [DBG] from='client.35334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:30 smithi044 bash[22676]: audit 2024-09-20T22:38:29.382160+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:30 smithi044 bash[22676]: audit 2024-09-20T22:38:29.389561+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:30 smithi044 bash[22676]: audit 2024-09-20T22:38:29.394947+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:30 smithi179 bash[23186]: audit 2024-09-20T22:38:29.020982+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:30 smithi179 bash[23186]: audit 2024-09-20T22:38:29.029306+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:30 smithi179 bash[23186]: audit 2024-09-20T22:38:29.039227+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:30 smithi179 bash[23186]: audit 2024-09-20T22:38:29.136971+0000 mgr.a (mgr.14388) 1032 : audit [DBG] from='client.35334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:30.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:30 smithi179 bash[23186]: audit 2024-09-20T22:38:29.382160+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:30 smithi179 bash[23186]: audit 2024-09-20T22:38:29.389561+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:30.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:30 smithi179 bash[23186]: audit 2024-09-20T22:38:29.394947+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:31.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:31 smithi049 bash[23528]: cluster 2024-09-20T22:38:29.353260+0000 mgr.a (mgr.14388) 1033 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:31 smithi044 bash[22676]: cluster 2024-09-20T22:38:29.353260+0000 mgr.a (mgr.14388) 1033 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:31.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:31 smithi179 bash[23186]: cluster 2024-09-20T22:38:29.353260+0000 mgr.a (mgr.14388) 1033 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:32.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:32 smithi049 bash[23528]: audit 2024-09-20T22:38:31.039315+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:32 smithi049 bash[23528]: audit 2024-09-20T22:38:31.054411+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:32 smithi049 bash[23528]: audit 2024-09-20T22:38:31.065391+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:32 smithi044 bash[22676]: audit 2024-09-20T22:38:31.039315+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:32 smithi044 bash[22676]: audit 2024-09-20T22:38:31.054411+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:32 smithi044 bash[22676]: audit 2024-09-20T22:38:31.065391+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:32 smithi179 bash[23186]: audit 2024-09-20T22:38:31.039315+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:32 smithi179 bash[23186]: audit 2024-09-20T22:38:31.054411+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:32.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:32 smithi179 bash[23186]: audit 2024-09-20T22:38:31.065391+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:33 smithi044 bash[22676]: cluster 2024-09-20T22:38:31.355627+0000 mgr.a (mgr.14388) 1034 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:33.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:33 smithi179 bash[23186]: cluster 2024-09-20T22:38:31.355627+0000 mgr.a (mgr.14388) 1034 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:33.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:33 smithi049 bash[23528]: cluster 2024-09-20T22:38:31.355627+0000 mgr.a (mgr.14388) 1034 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:38:34.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:34.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:34.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:35.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:35.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:35.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:35.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:35.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:35 smithi044 bash[22676]: cluster 2024-09-20T22:38:33.356414+0000 mgr.a (mgr.14388) 1035 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:35.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:35 smithi179 bash[23186]: cluster 2024-09-20T22:38:33.356414+0000 mgr.a (mgr.14388) 1035 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:35.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:35 smithi049 bash[23528]: cluster 2024-09-20T22:38:33.356414+0000 mgr.a (mgr.14388) 1035 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:36 smithi044 bash[22676]: audit 2024-09-20T22:38:34.884451+0000 mgr.a (mgr.14388) 1036 : audit [DBG] from='client.35412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:36.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:36 smithi179 bash[23186]: audit 2024-09-20T22:38:34.884451+0000 mgr.a (mgr.14388) 1036 : audit [DBG] from='client.35412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:36.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:36 smithi049 bash[23528]: audit 2024-09-20T22:38:34.884451+0000 mgr.a (mgr.14388) 1036 : audit [DBG] from='client.35412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:37 smithi044 bash[22676]: cluster 2024-09-20T22:38:35.357959+0000 mgr.a (mgr.14388) 1037 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:37.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:37 smithi179 bash[23186]: cluster 2024-09-20T22:38:35.357959+0000 mgr.a (mgr.14388) 1037 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:37.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:37 smithi049 bash[23528]: cluster 2024-09-20T22:38:35.357959+0000 mgr.a (mgr.14388) 1037 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:39 smithi044 bash[22676]: cluster 2024-09-20T22:38:37.358811+0000 mgr.a (mgr.14388) 1038 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:39.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:39 smithi179 bash[23186]: cluster 2024-09-20T22:38:37.358811+0000 mgr.a (mgr.14388) 1038 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:39.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:39 smithi049 bash[23528]: cluster 2024-09-20T22:38:37.358811+0000 mgr.a (mgr.14388) 1038 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:40.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:40.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:41.094 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:41.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:41.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:41.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:41.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:41 smithi044 bash[22676]: cluster 2024-09-20T22:38:39.359761+0000 mgr.a (mgr.14388) 1039 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:41.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:41 smithi179 bash[23186]: cluster 2024-09-20T22:38:39.359761+0000 mgr.a (mgr.14388) 1039 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:41.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:41 smithi049 bash[23528]: cluster 2024-09-20T22:38:39.359761+0000 mgr.a (mgr.14388) 1039 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:42 smithi044 bash[22676]: audit 2024-09-20T22:38:40.654714+0000 mgr.a (mgr.14388) 1040 : audit [DBG] from='client.35487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:42.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:42 smithi179 bash[23186]: audit 2024-09-20T22:38:40.654714+0000 mgr.a (mgr.14388) 1040 : audit [DBG] from='client.35487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:42.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:42 smithi049 bash[23528]: audit 2024-09-20T22:38:40.654714+0000 mgr.a (mgr.14388) 1040 : audit [DBG] from='client.35487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:43 smithi044 bash[22676]: cluster 2024-09-20T22:38:41.362709+0000 mgr.a (mgr.14388) 1041 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:43.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:43 smithi179 bash[23186]: cluster 2024-09-20T22:38:41.362709+0000 mgr.a (mgr.14388) 1041 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:43.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:43 smithi049 bash[23528]: cluster 2024-09-20T22:38:41.362709+0000 mgr.a (mgr.14388) 1041 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:45.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:45 smithi179 bash[23186]: cluster 2024-09-20T22:38:43.363537+0000 mgr.a (mgr.14388) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:45 smithi044 bash[22676]: cluster 2024-09-20T22:38:43.363537+0000 mgr.a (mgr.14388) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:45.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:45 smithi049 bash[23528]: cluster 2024-09-20T22:38:43.363537+0000 mgr.a (mgr.14388) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:38:46.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:46.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:46.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:46.856 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:46.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:46.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:46.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:46.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:47 smithi044 bash[22676]: cluster 2024-09-20T22:38:45.365599+0000 mgr.a (mgr.14388) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:47.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:47 smithi179 bash[23186]: cluster 2024-09-20T22:38:45.365599+0000 mgr.a (mgr.14388) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:47.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:47 smithi049 bash[23528]: cluster 2024-09-20T22:38:45.365599+0000 mgr.a (mgr.14388) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:48 smithi044 bash[22676]: audit 2024-09-20T22:38:46.423102+0000 mgr.a (mgr.14388) 1044 : audit [DBG] from='client.35565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:48.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:48 smithi179 bash[23186]: audit 2024-09-20T22:38:46.423102+0000 mgr.a (mgr.14388) 1044 : audit [DBG] from='client.35565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:48.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:48 smithi049 bash[23528]: audit 2024-09-20T22:38:46.423102+0000 mgr.a (mgr.14388) 1044 : audit [DBG] from='client.35565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:49.445 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:49 smithi049 bash[23528]: cluster 2024-09-20T22:38:47.366496+0000 mgr.a (mgr.14388) 1045 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:49 smithi044 bash[22676]: cluster 2024-09-20T22:38:47.366496+0000 mgr.a (mgr.14388) 1045 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:49.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:49 smithi179 bash[23186]: cluster 2024-09-20T22:38:47.366496+0000 mgr.a (mgr.14388) 1045 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:50.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:50 smithi179 bash[23186]: audit 2024-09-20T22:38:49.245238+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:50 smithi179 bash[23186]: audit 2024-09-20T22:38:49.254293+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:50 smithi179 bash[23186]: audit 2024-09-20T22:38:49.265110+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:50 smithi179 bash[23186]: cluster 2024-09-20T22:38:49.367284+0000 mgr.a (mgr.14388) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:50.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:50 smithi179 bash[23186]: audit 2024-09-20T22:38:49.587864+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:50 smithi179 bash[23186]: audit 2024-09-20T22:38:49.597050+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:50 smithi179 bash[23186]: audit 2024-09-20T22:38:49.607395+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:50 smithi049 bash[23528]: audit 2024-09-20T22:38:49.245238+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:50 smithi049 bash[23528]: audit 2024-09-20T22:38:49.254293+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:50 smithi049 bash[23528]: audit 2024-09-20T22:38:49.265110+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:50 smithi049 bash[23528]: cluster 2024-09-20T22:38:49.367284+0000 mgr.a (mgr.14388) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:50 smithi049 bash[23528]: audit 2024-09-20T22:38:49.587864+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:50 smithi049 bash[23528]: audit 2024-09-20T22:38:49.597050+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:50 smithi049 bash[23528]: audit 2024-09-20T22:38:49.607395+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:50 smithi044 bash[22676]: audit 2024-09-20T22:38:49.245238+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:50 smithi044 bash[22676]: audit 2024-09-20T22:38:49.254293+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:50 smithi044 bash[22676]: audit 2024-09-20T22:38:49.265110+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:50 smithi044 bash[22676]: cluster 2024-09-20T22:38:49.367284+0000 mgr.a (mgr.14388) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:50 smithi044 bash[22676]: audit 2024-09-20T22:38:49.587864+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:50 smithi044 bash[22676]: audit 2024-09-20T22:38:49.597050+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:50 smithi044 bash[22676]: audit 2024-09-20T22:38:49.607395+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:51.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:52.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:52 smithi049 bash[23528]: audit 2024-09-20T22:38:51.260950+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:52 smithi049 bash[23528]: audit 2024-09-20T22:38:51.266259+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:52 smithi049 bash[23528]: audit 2024-09-20T22:38:51.272772+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:52 smithi049 bash[23528]: cluster 2024-09-20T22:38:51.369488+0000 mgr.a (mgr.14388) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:52.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:52.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:52 smithi044 bash[22676]: audit 2024-09-20T22:38:51.260950+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:52 smithi044 bash[22676]: audit 2024-09-20T22:38:51.266259+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:52 smithi044 bash[22676]: audit 2024-09-20T22:38:51.272772+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:52 smithi044 bash[22676]: cluster 2024-09-20T22:38:51.369488+0000 mgr.a (mgr.14388) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:52.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:52 smithi179 bash[23186]: audit 2024-09-20T22:38:51.260950+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:52 smithi179 bash[23186]: audit 2024-09-20T22:38:51.266259+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:52 smithi179 bash[23186]: audit 2024-09-20T22:38:51.272772+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:38:52.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:52 smithi179 bash[23186]: cluster 2024-09-20T22:38:51.369488+0000 mgr.a (mgr.14388) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:53.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:53 smithi049 bash[23528]: audit 2024-09-20T22:38:52.193299+0000 mgr.a (mgr.14388) 1048 : audit [DBG] from='client.35643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:53 smithi044 bash[22676]: audit 2024-09-20T22:38:52.193299+0000 mgr.a (mgr.14388) 1048 : audit [DBG] from='client.35643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:53.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:53 smithi179 bash[23186]: audit 2024-09-20T22:38:52.193299+0000 mgr.a (mgr.14388) 1048 : audit [DBG] from='client.35643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:54.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:54 smithi049 bash[23528]: cluster 2024-09-20T22:38:53.370417+0000 mgr.a (mgr.14388) 1049 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:54 smithi044 bash[22676]: cluster 2024-09-20T22:38:53.370417+0000 mgr.a (mgr.14388) 1049 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:54.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:54 smithi179 bash[23186]: cluster 2024-09-20T22:38:53.370417+0000 mgr.a (mgr.14388) 1049 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:56 smithi044 bash[22676]: cluster 2024-09-20T22:38:55.372579+0000 mgr.a (mgr.14388) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:56.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:56 smithi179 bash[23186]: cluster 2024-09-20T22:38:55.372579+0000 mgr.a (mgr.14388) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:56.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:56 smithi049 bash[23528]: cluster 2024-09-20T22:38:55.372579+0000 mgr.a (mgr.14388) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:38:57.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:38:57.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:38:57.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:38:58.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:38:58.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:38:58.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:38:58.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:38:58.403 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:38:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:58 smithi044 bash[22676]: cluster 2024-09-20T22:38:57.373392+0000 mgr.a (mgr.14388) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:38:58 smithi044 bash[22676]: audit 2024-09-20T22:38:57.954825+0000 mgr.a (mgr.14388) 1052 : audit [DBG] from='client.35721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:58.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:58 smithi179 bash[23186]: cluster 2024-09-20T22:38:57.373392+0000 mgr.a (mgr.14388) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:58.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:38:58 smithi179 bash[23186]: audit 2024-09-20T22:38:57.954825+0000 mgr.a (mgr.14388) 1052 : audit [DBG] from='client.35721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:38:58.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:58 smithi049 bash[23528]: cluster 2024-09-20T22:38:57.373392+0000 mgr.a (mgr.14388) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:38:58.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:38:58 smithi049 bash[23528]: audit 2024-09-20T22:38:57.954825+0000 mgr.a (mgr.14388) 1052 : audit [DBG] from='client.35721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:00 smithi044 bash[22676]: cluster 2024-09-20T22:38:59.374334+0000 mgr.a (mgr.14388) 1053 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:00.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:00 smithi179 bash[23186]: cluster 2024-09-20T22:38:59.374334+0000 mgr.a (mgr.14388) 1053 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:00.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:00 smithi049 bash[23528]: cluster 2024-09-20T22:38:59.374334+0000 mgr.a (mgr.14388) 1053 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:02 smithi044 bash[22676]: cluster 2024-09-20T22:39:01.376560+0000 mgr.a (mgr.14388) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:02.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:02 smithi179 bash[23186]: cluster 2024-09-20T22:39:01.376560+0000 mgr.a (mgr.14388) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:02.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:02 smithi049 bash[23528]: cluster 2024-09-20T22:39:01.376560+0000 mgr.a (mgr.14388) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:03.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:03.405 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:03.405 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:04.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:04.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:04.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:04.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:04.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:04 smithi044 bash[22676]: cluster 2024-09-20T22:39:03.377384+0000 mgr.a (mgr.14388) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:04 smithi044 bash[22676]: audit 2024-09-20T22:39:03.742274+0000 mgr.a (mgr.14388) 1056 : audit [DBG] from='client.35799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:04.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:04 smithi179 bash[23186]: cluster 2024-09-20T22:39:03.377384+0000 mgr.a (mgr.14388) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:04.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:04 smithi179 bash[23186]: audit 2024-09-20T22:39:03.742274+0000 mgr.a (mgr.14388) 1056 : audit [DBG] from='client.35799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:04.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:04 smithi049 bash[23528]: cluster 2024-09-20T22:39:03.377384+0000 mgr.a (mgr.14388) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:04.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:04 smithi049 bash[23528]: audit 2024-09-20T22:39:03.742274+0000 mgr.a (mgr.14388) 1056 : audit [DBG] from='client.35799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:06 smithi044 bash[22676]: cluster 2024-09-20T22:39:05.379683+0000 mgr.a (mgr.14388) 1057 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:06.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:06 smithi179 bash[23186]: cluster 2024-09-20T22:39:05.379683+0000 mgr.a (mgr.14388) 1057 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:06.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:06 smithi049 bash[23528]: cluster 2024-09-20T22:39:05.379683+0000 mgr.a (mgr.14388) 1057 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:08 smithi044 bash[22676]: cluster 2024-09-20T22:39:07.380440+0000 mgr.a (mgr.14388) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:08.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:08 smithi179 bash[23186]: cluster 2024-09-20T22:39:07.380440+0000 mgr.a (mgr.14388) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:08.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:08 smithi049 bash[23528]: cluster 2024-09-20T22:39:07.380440+0000 mgr.a (mgr.14388) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:09.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:09.963 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:10.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: cluster 2024-09-20T22:39:09.381188+0000 mgr.a (mgr.14388) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:10.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: audit 2024-09-20T22:39:09.479576+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: audit 2024-09-20T22:39:09.487517+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: audit 2024-09-20T22:39:09.497411+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: audit 2024-09-20T22:39:09.513892+0000 mgr.a (mgr.14388) 1060 : audit [DBG] from='client.35877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:10.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: audit 2024-09-20T22:39:09.769600+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: audit 2024-09-20T22:39:09.774791+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:10 smithi049 bash[23528]: audit 2024-09-20T22:39:09.779971+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: cluster 2024-09-20T22:39:09.381188+0000 mgr.a (mgr.14388) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: audit 2024-09-20T22:39:09.479576+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: audit 2024-09-20T22:39:09.487517+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: audit 2024-09-20T22:39:09.497411+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: audit 2024-09-20T22:39:09.513892+0000 mgr.a (mgr.14388) 1060 : audit [DBG] from='client.35877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: audit 2024-09-20T22:39:09.769600+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: audit 2024-09-20T22:39:09.774791+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:10 smithi044 bash[22676]: audit 2024-09-20T22:39:09.779971+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: cluster 2024-09-20T22:39:09.381188+0000 mgr.a (mgr.14388) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:10.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: audit 2024-09-20T22:39:09.479576+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: audit 2024-09-20T22:39:09.487517+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: audit 2024-09-20T22:39:09.497411+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: audit 2024-09-20T22:39:09.513892+0000 mgr.a (mgr.14388) 1060 : audit [DBG] from='client.35877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:10.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: audit 2024-09-20T22:39:09.769600+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: audit 2024-09-20T22:39:09.774791+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:10.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:10 smithi179 bash[23186]: audit 2024-09-20T22:39:09.779971+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:12 smithi044 bash[22676]: cluster 2024-09-20T22:39:11.383628+0000 mgr.a (mgr.14388) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:12 smithi044 bash[22676]: audit 2024-09-20T22:39:11.484848+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:12 smithi044 bash[22676]: audit 2024-09-20T22:39:11.496709+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:12 smithi044 bash[22676]: audit 2024-09-20T22:39:11.507127+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:12 smithi179 bash[23186]: cluster 2024-09-20T22:39:11.383628+0000 mgr.a (mgr.14388) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:12.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:12 smithi179 bash[23186]: audit 2024-09-20T22:39:11.484848+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:12 smithi179 bash[23186]: audit 2024-09-20T22:39:11.496709+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:12 smithi179 bash[23186]: audit 2024-09-20T22:39:11.507127+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.765 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:12 smithi049 bash[23528]: cluster 2024-09-20T22:39:11.383628+0000 mgr.a (mgr.14388) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:12.765 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:12 smithi049 bash[23528]: audit 2024-09-20T22:39:11.484848+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.765 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:12 smithi049 bash[23528]: audit 2024-09-20T22:39:11.496709+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:12.765 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:12 smithi049 bash[23528]: audit 2024-09-20T22:39:11.507127+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:14.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:14 smithi179 bash[23186]: cluster 2024-09-20T22:39:13.384451+0000 mgr.a (mgr.14388) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:14.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:14 smithi049 bash[23528]: cluster 2024-09-20T22:39:13.384451+0000 mgr.a (mgr.14388) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:14 smithi044 bash[22676]: cluster 2024-09-20T22:39:13.384451+0000 mgr.a (mgr.14388) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:15.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:16.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:16 smithi179 bash[23186]: audit 2024-09-20T22:39:15.306872+0000 mgr.a (mgr.14388) 1063 : audit [DBG] from='client.35955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:16.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:16 smithi179 bash[23186]: cluster 2024-09-20T22:39:15.385817+0000 mgr.a (mgr.14388) 1064 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:16.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:16 smithi049 bash[23528]: audit 2024-09-20T22:39:15.306872+0000 mgr.a (mgr.14388) 1063 : audit [DBG] from='client.35955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:16.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:16 smithi049 bash[23528]: cluster 2024-09-20T22:39:15.385817+0000 mgr.a (mgr.14388) 1064 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:16 smithi044 bash[22676]: audit 2024-09-20T22:39:15.306872+0000 mgr.a (mgr.14388) 1063 : audit [DBG] from='client.35955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:16 smithi044 bash[22676]: cluster 2024-09-20T22:39:15.385817+0000 mgr.a (mgr.14388) 1064 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:18.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:18 smithi179 bash[23186]: cluster 2024-09-20T22:39:17.386660+0000 mgr.a (mgr.14388) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:39:18.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:18 smithi179 bash[23186]: audit 2024-09-20T22:39:17.718194+0000 mon.a (mon.0) 1628 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:39:18.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:18 smithi179 bash[23186]: audit 2024-09-20T22:39:17.725226+0000 mon.a (mon.0) 1629 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:39:18.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:18 smithi179 bash[23186]: audit 2024-09-20T22:39:17.727157+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:39:18.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:18 smithi179 bash[23186]: audit 2024-09-20T22:39:17.738209+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:18.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:18 smithi179 bash[23186]: audit 2024-09-20T22:39:17.745110+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:39:18.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:18 smithi179 bash[23186]: audit 2024-09-20T22:39:17.747652+0000 mgr.a (mgr.14388) 1066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:39:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:18 smithi049 bash[23528]: cluster 2024-09-20T22:39:17.386660+0000 mgr.a (mgr.14388) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:39:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:18 smithi049 bash[23528]: audit 2024-09-20T22:39:17.718194+0000 mon.a (mon.0) 1628 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:39:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:18 smithi049 bash[23528]: audit 2024-09-20T22:39:17.725226+0000 mon.a (mon.0) 1629 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:39:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:18 smithi049 bash[23528]: audit 2024-09-20T22:39:17.727157+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:39:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:18 smithi049 bash[23528]: audit 2024-09-20T22:39:17.738209+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:18 smithi049 bash[23528]: audit 2024-09-20T22:39:17.745110+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:39:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:18 smithi049 bash[23528]: audit 2024-09-20T22:39:17.747652+0000 mgr.a (mgr.14388) 1066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:39:18.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22930]: debug 2024-09-20T22:39:18.490+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:39:18.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22930]: debug 2024-09-20T22:39:18.494+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:39:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22676]: cluster 2024-09-20T22:39:17.386660+0000 mgr.a (mgr.14388) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:39:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22676]: audit 2024-09-20T22:39:17.718194+0000 mon.a (mon.0) 1628 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:39:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22676]: audit 2024-09-20T22:39:17.725226+0000 mon.a (mon.0) 1629 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:39:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22676]: audit 2024-09-20T22:39:17.727157+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:39:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22676]: audit 2024-09-20T22:39:17.738209+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22676]: audit 2024-09-20T22:39:17.745110+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:39:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:18 smithi044 bash[22676]: audit 2024-09-20T22:39:17.747652+0000 mgr.a (mgr.14388) 1066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:39:19.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:19 smithi049 bash[23528]: audit 2024-09-20T22:39:18.494216+0000 mgr.a (mgr.14388) 1067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:39:19.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:19 smithi049 bash[23528]: cephadm 2024-09-20T22:39:18.497679+0000 mgr.a (mgr.14388) 1068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:39:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:19 smithi044 bash[22676]: audit 2024-09-20T22:39:18.494216+0000 mgr.a (mgr.14388) 1067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:39:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:19 smithi044 bash[22676]: cephadm 2024-09-20T22:39:18.497679+0000 mgr.a (mgr.14388) 1068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:39:19.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:19 smithi179 bash[23186]: audit 2024-09-20T22:39:18.494216+0000 mgr.a (mgr.14388) 1067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:39:19.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:19 smithi179 bash[23186]: cephadm 2024-09-20T22:39:18.497679+0000 mgr.a (mgr.14388) 1068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:39:20.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:20.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:20.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:20 smithi049 bash[23528]: cluster 2024-09-20T22:39:19.387582+0000 mgr.a (mgr.14388) 1069 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:39:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:20 smithi044 bash[22676]: cluster 2024-09-20T22:39:19.387582+0000 mgr.a (mgr.14388) 1069 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:39:20.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:20 smithi179 bash[23186]: cluster 2024-09-20T22:39:19.387582+0000 mgr.a (mgr.14388) 1069 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:39:21.479 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:21.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:21.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:21.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:21.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:21.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:21 smithi049 bash[23528]: audit 2024-09-20T22:39:21.075257+0000 mgr.a (mgr.14388) 1070 : audit [DBG] from='client.36138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:21 smithi044 bash[22676]: audit 2024-09-20T22:39:21.075257+0000 mgr.a (mgr.14388) 1070 : audit [DBG] from='client.36138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:21.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:21 smithi179 bash[23186]: audit 2024-09-20T22:39:21.075257+0000 mgr.a (mgr.14388) 1070 : audit [DBG] from='client.36138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:22.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:22 smithi049 bash[23528]: cluster 2024-09-20T22:39:21.389187+0000 mgr.a (mgr.14388) 1071 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:22 smithi044 bash[22676]: cluster 2024-09-20T22:39:21.389187+0000 mgr.a (mgr.14388) 1071 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:22.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:22 smithi179 bash[23186]: cluster 2024-09-20T22:39:21.389187+0000 mgr.a (mgr.14388) 1071 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:24.718 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:24 smithi044 bash[22676]: cluster 2024-09-20T22:39:23.389898+0000 mgr.a (mgr.14388) 1072 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:39:24.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:24 smithi179 bash[23186]: cluster 2024-09-20T22:39:23.389898+0000 mgr.a (mgr.14388) 1072 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:39:24.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:24 smithi049 bash[23528]: cluster 2024-09-20T22:39:23.389898+0000 mgr.a (mgr.14388) 1072 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:39:26.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:26.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:26.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:26.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:26 smithi179 bash[23186]: cluster 2024-09-20T22:39:25.391893+0000 mgr.a (mgr.14388) 1073 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:26.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:26 smithi049 bash[23528]: cluster 2024-09-20T22:39:25.391893+0000 mgr.a (mgr.14388) 1073 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:26.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:26 smithi044 bash[22676]: cluster 2024-09-20T22:39:25.391893+0000 mgr.a (mgr.14388) 1073 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:27.233 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:27.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:27.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:27.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:27.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:27.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:27 smithi049 bash[23528]: audit 2024-09-20T22:39:26.813909+0000 mgr.a (mgr.14388) 1074 : audit [DBG] from='client.36213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:27 smithi044 bash[22676]: audit 2024-09-20T22:39:26.813909+0000 mgr.a (mgr.14388) 1074 : audit [DBG] from='client.36213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:27.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:27 smithi179 bash[23186]: audit 2024-09-20T22:39:26.813909+0000 mgr.a (mgr.14388) 1074 : audit [DBG] from='client.36213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:28.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:28 smithi049 bash[23528]: cluster 2024-09-20T22:39:27.392881+0000 mgr.a (mgr.14388) 1075 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:28 smithi044 bash[22676]: cluster 2024-09-20T22:39:27.392881+0000 mgr.a (mgr.14388) 1075 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:28.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:28 smithi179 bash[23186]: cluster 2024-09-20T22:39:27.392881+0000 mgr.a (mgr.14388) 1075 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:30 smithi044 bash[22676]: cluster 2024-09-20T22:39:29.393700+0000 mgr.a (mgr.14388) 1076 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:30 smithi044 bash[22676]: audit 2024-09-20T22:39:29.711356+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:30 smithi044 bash[22676]: audit 2024-09-20T22:39:29.720969+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:30 smithi044 bash[22676]: audit 2024-09-20T22:39:29.732794+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:30 smithi044 bash[22676]: audit 2024-09-20T22:39:29.960229+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:30 smithi044 bash[22676]: audit 2024-09-20T22:39:29.970782+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:30 smithi044 bash[22676]: audit 2024-09-20T22:39:29.982583+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:30.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:30 smithi179 bash[23186]: cluster 2024-09-20T22:39:29.393700+0000 mgr.a (mgr.14388) 1076 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:30.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:30 smithi179 bash[23186]: audit 2024-09-20T22:39:29.711356+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:30.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:30 smithi179 bash[23186]: audit 2024-09-20T22:39:29.720969+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:30 smithi179 bash[23186]: audit 2024-09-20T22:39:29.732794+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:30 smithi179 bash[23186]: audit 2024-09-20T22:39:29.960229+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:30 smithi179 bash[23186]: audit 2024-09-20T22:39:29.970782+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:30 smithi179 bash[23186]: audit 2024-09-20T22:39:29.982583+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:30 smithi049 bash[23528]: cluster 2024-09-20T22:39:29.393700+0000 mgr.a (mgr.14388) 1076 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:31.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:30 smithi049 bash[23528]: audit 2024-09-20T22:39:29.711356+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:30 smithi049 bash[23528]: audit 2024-09-20T22:39:29.720969+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:30 smithi049 bash[23528]: audit 2024-09-20T22:39:29.732794+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:30 smithi049 bash[23528]: audit 2024-09-20T22:39:29.960229+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:30 smithi049 bash[23528]: audit 2024-09-20T22:39:29.970782+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:31.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:30 smithi049 bash[23528]: audit 2024-09-20T22:39:29.982583+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:32.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:32.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:32.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:32 smithi044 bash[22676]: cluster 2024-09-20T22:39:31.395894+0000 mgr.a (mgr.14388) 1077 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:32 smithi044 bash[22676]: audit 2024-09-20T22:39:31.716802+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:32 smithi044 bash[22676]: audit 2024-09-20T22:39:31.728413+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:32 smithi044 bash[22676]: audit 2024-09-20T22:39:31.738318+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:32.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:32 smithi179 bash[23186]: cluster 2024-09-20T22:39:31.395894+0000 mgr.a (mgr.14388) 1077 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:32.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:32 smithi179 bash[23186]: audit 2024-09-20T22:39:31.716802+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:32.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:32 smithi179 bash[23186]: audit 2024-09-20T22:39:31.728413+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:33.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:32 smithi179 bash[23186]: audit 2024-09-20T22:39:31.738318+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:33.000 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:32 smithi049 bash[23528]: cluster 2024-09-20T22:39:31.395894+0000 mgr.a (mgr.14388) 1077 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:39:33.000 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:32 smithi049 bash[23528]: audit 2024-09-20T22:39:31.716802+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:33.000 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:32 smithi049 bash[23528]: audit 2024-09-20T22:39:31.728413+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:33.000 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:32 smithi049 bash[23528]: audit 2024-09-20T22:39:31.738318+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:33.015 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:33.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:33.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:33.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:33.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:33 smithi044 bash[22676]: audit 2024-09-20T22:39:32.576934+0000 mgr.a (mgr.14388) 1078 : audit [DBG] from='client.36288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:33.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:33 smithi179 bash[23186]: audit 2024-09-20T22:39:32.576934+0000 mgr.a (mgr.14388) 1078 : audit [DBG] from='client.36288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:34.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:33 smithi049 bash[23528]: audit 2024-09-20T22:39:32.576934+0000 mgr.a (mgr.14388) 1078 : audit [DBG] from='client.36288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:34 smithi044 bash[22676]: cluster 2024-09-20T22:39:33.396855+0000 mgr.a (mgr.14388) 1079 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:34.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:34 smithi179 bash[23186]: cluster 2024-09-20T22:39:33.396855+0000 mgr.a (mgr.14388) 1079 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:34 smithi049 bash[23528]: cluster 2024-09-20T22:39:33.396855+0000 mgr.a (mgr.14388) 1079 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:36 smithi044 bash[22676]: cluster 2024-09-20T22:39:35.399036+0000 mgr.a (mgr.14388) 1080 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:36.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:36 smithi179 bash[23186]: cluster 2024-09-20T22:39:35.399036+0000 mgr.a (mgr.14388) 1080 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:37.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:36 smithi049 bash[23528]: cluster 2024-09-20T22:39:35.399036+0000 mgr.a (mgr.14388) 1080 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:38.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:38.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:38.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:38.800 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:38.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:38.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:38.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:38.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:38 smithi044 bash[22676]: cluster 2024-09-20T22:39:37.399821+0000 mgr.a (mgr.14388) 1081 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:38.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:38 smithi179 bash[23186]: cluster 2024-09-20T22:39:37.399821+0000 mgr.a (mgr.14388) 1081 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:39.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:38 smithi049 bash[23528]: cluster 2024-09-20T22:39:37.399821+0000 mgr.a (mgr.14388) 1081 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:39.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:39 smithi179 bash[23186]: audit 2024-09-20T22:39:38.358261+0000 mgr.a (mgr.14388) 1082 : audit [DBG] from='client.36360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:39 smithi049 bash[23528]: audit 2024-09-20T22:39:38.358261+0000 mgr.a (mgr.14388) 1082 : audit [DBG] from='client.36360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:39 smithi044 bash[22676]: audit 2024-09-20T22:39:38.358261+0000 mgr.a (mgr.14388) 1082 : audit [DBG] from='client.36360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:41.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:40 smithi179 bash[23186]: cluster 2024-09-20T22:39:39.400810+0000 mgr.a (mgr.14388) 1083 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:41.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:40 smithi049 bash[23528]: cluster 2024-09-20T22:39:39.400810+0000 mgr.a (mgr.14388) 1083 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:40 smithi044 bash[22676]: cluster 2024-09-20T22:39:39.400810+0000 mgr.a (mgr.14388) 1083 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:42.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:42 smithi179 bash[23186]: cluster 2024-09-20T22:39:41.403108+0000 mgr.a (mgr.14388) 1084 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:43.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:42 smithi049 bash[23528]: cluster 2024-09-20T22:39:41.403108+0000 mgr.a (mgr.14388) 1084 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:42 smithi044 bash[22676]: cluster 2024-09-20T22:39:41.403108+0000 mgr.a (mgr.14388) 1084 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:43.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:43.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:43.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:44.564 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:44.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:45.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:44 smithi049 bash[23528]: cluster 2024-09-20T22:39:43.403890+0000 mgr.a (mgr.14388) 1085 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:44 smithi049 bash[23528]: audit 2024-09-20T22:39:44.137024+0000 mgr.a (mgr.14388) 1086 : audit [DBG] from='client.36438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:45.195 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:44 smithi044 bash[22676]: cluster 2024-09-20T22:39:43.403890+0000 mgr.a (mgr.14388) 1085 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:45.195 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:44 smithi044 bash[22676]: audit 2024-09-20T22:39:44.137024+0000 mgr.a (mgr.14388) 1086 : audit [DBG] from='client.36438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:45.207 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:44 smithi179 bash[23186]: cluster 2024-09-20T22:39:43.403890+0000 mgr.a (mgr.14388) 1085 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:45.208 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:44 smithi179 bash[23186]: audit 2024-09-20T22:39:44.137024+0000 mgr.a (mgr.14388) 1086 : audit [DBG] from='client.36438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:47.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:46 smithi049 bash[23528]: cluster 2024-09-20T22:39:45.405867+0000 mgr.a (mgr.14388) 1087 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:47.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:46 smithi179 bash[23186]: cluster 2024-09-20T22:39:45.405867+0000 mgr.a (mgr.14388) 1087 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:46 smithi044 bash[22676]: cluster 2024-09-20T22:39:45.405867+0000 mgr.a (mgr.14388) 1087 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:39:49.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:48 smithi049 bash[23528]: cluster 2024-09-20T22:39:47.406564+0000 mgr.a (mgr.14388) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:48 smithi044 bash[22676]: cluster 2024-09-20T22:39:47.406564+0000 mgr.a (mgr.14388) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:49.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:48 smithi179 bash[23186]: cluster 2024-09-20T22:39:47.406564+0000 mgr.a (mgr.14388) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:49.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:50.343 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: cluster 2024-09-20T22:39:49.407305+0000 mgr.a (mgr.14388) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: audit 2024-09-20T22:39:49.901983+0000 mgr.a (mgr.14388) 1090 : audit [DBG] from='client.36513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: audit 2024-09-20T22:39:49.960493+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: audit 2024-09-20T22:39:49.966043+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: audit 2024-09-20T22:39:49.972417+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: audit 2024-09-20T22:39:50.160577+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: audit 2024-09-20T22:39:50.167046+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:50 smithi044 bash[22676]: audit 2024-09-20T22:39:50.174757+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: cluster 2024-09-20T22:39:49.407305+0000 mgr.a (mgr.14388) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: audit 2024-09-20T22:39:49.901983+0000 mgr.a (mgr.14388) 1090 : audit [DBG] from='client.36513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: audit 2024-09-20T22:39:49.960493+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: audit 2024-09-20T22:39:49.966043+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: audit 2024-09-20T22:39:49.972417+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: audit 2024-09-20T22:39:50.160577+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: audit 2024-09-20T22:39:50.167046+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:50 smithi179 bash[23186]: audit 2024-09-20T22:39:50.174757+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: cluster 2024-09-20T22:39:49.407305+0000 mgr.a (mgr.14388) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: audit 2024-09-20T22:39:49.901983+0000 mgr.a (mgr.14388) 1090 : audit [DBG] from='client.36513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: audit 2024-09-20T22:39:49.960493+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: audit 2024-09-20T22:39:49.966043+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: audit 2024-09-20T22:39:49.972417+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: audit 2024-09-20T22:39:50.160577+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: audit 2024-09-20T22:39:50.167046+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:50 smithi049 bash[23528]: audit 2024-09-20T22:39:50.174757+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:52 smithi044 bash[22676]: cluster 2024-09-20T22:39:51.410127+0000 mgr.a (mgr.14388) 1091 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:52 smithi044 bash[22676]: audit 2024-09-20T22:39:51.952870+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:52 smithi044 bash[22676]: audit 2024-09-20T22:39:51.962585+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:52 smithi044 bash[22676]: audit 2024-09-20T22:39:51.976567+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:52 smithi179 bash[23186]: cluster 2024-09-20T22:39:51.410127+0000 mgr.a (mgr.14388) 1091 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:53.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:52 smithi179 bash[23186]: audit 2024-09-20T22:39:51.952870+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:52 smithi179 bash[23186]: audit 2024-09-20T22:39:51.962585+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:52 smithi179 bash[23186]: audit 2024-09-20T22:39:51.976567+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:52 smithi049 bash[23528]: cluster 2024-09-20T22:39:51.410127+0000 mgr.a (mgr.14388) 1091 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:53.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:52 smithi049 bash[23528]: audit 2024-09-20T22:39:51.952870+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:52 smithi049 bash[23528]: audit 2024-09-20T22:39:51.962585+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:52 smithi049 bash[23528]: audit 2024-09-20T22:39:51.976567+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:39:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:54 smithi044 bash[22676]: cluster 2024-09-20T22:39:53.410908+0000 mgr.a (mgr.14388) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:39:55.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:54 smithi179 bash[23186]: cluster 2024-09-20T22:39:53.410908+0000 mgr.a (mgr.14388) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:39:55.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:54 smithi049 bash[23528]: cluster 2024-09-20T22:39:53.410908+0000 mgr.a (mgr.14388) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:39:55.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:39:55.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:39:55.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:39:56.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:39:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:39:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:39:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:39:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:39:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:56 smithi044 bash[22676]: cluster 2024-09-20T22:39:55.412706+0000 mgr.a (mgr.14388) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:56 smithi044 bash[22676]: audit 2024-09-20T22:39:55.684787+0000 mgr.a (mgr.14388) 1094 : audit [DBG] from='client.36591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:57.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:56 smithi179 bash[23186]: cluster 2024-09-20T22:39:55.412706+0000 mgr.a (mgr.14388) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:57.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:56 smithi179 bash[23186]: audit 2024-09-20T22:39:55.684787+0000 mgr.a (mgr.14388) 1094 : audit [DBG] from='client.36591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:57.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:56 smithi049 bash[23528]: cluster 2024-09-20T22:39:55.412706+0000 mgr.a (mgr.14388) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:39:57.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:56 smithi049 bash[23528]: audit 2024-09-20T22:39:55.684787+0000 mgr.a (mgr.14388) 1094 : audit [DBG] from='client.36591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:39:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:39:58 smithi044 bash[22676]: cluster 2024-09-20T22:39:57.413665+0000 mgr.a (mgr.14388) 1095 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:39:59.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:39:58 smithi179 bash[23186]: cluster 2024-09-20T22:39:57.413665+0000 mgr.a (mgr.14388) 1095 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:39:59.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:39:58 smithi049 bash[23528]: cluster 2024-09-20T22:39:57.413665+0000 mgr.a (mgr.14388) 1095 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:40:01.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:00 smithi044 bash[22676]: cluster 2024-09-20T22:39:59.414459+0000 mgr.a (mgr.14388) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:40:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:00 smithi044 bash[22676]: cluster 2024-09-20T22:40:00.000147+0000 mon.a (mon.0) 1651 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:40:01.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:00 smithi179 bash[23186]: cluster 2024-09-20T22:39:59.414459+0000 mgr.a (mgr.14388) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:40:01.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:00 smithi179 bash[23186]: cluster 2024-09-20T22:40:00.000147+0000 mon.a (mon.0) 1651 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:40:01.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:00 smithi049 bash[23528]: cluster 2024-09-20T22:39:59.414459+0000 mgr.a (mgr.14388) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:40:01.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:00 smithi049 bash[23528]: cluster 2024-09-20T22:40:00.000147+0000 mon.a (mon.0) 1651 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:40:01.918 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:01.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:01.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:01.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:01.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:02 smithi044 bash[22676]: cluster 2024-09-20T22:40:01.415809+0000 mgr.a (mgr.14388) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:02 smithi044 bash[22676]: audit 2024-09-20T22:40:01.469274+0000 mgr.a (mgr.14388) 1098 : audit [DBG] from='client.36669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:03.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:02 smithi179 bash[23186]: cluster 2024-09-20T22:40:01.415809+0000 mgr.a (mgr.14388) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:03.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:02 smithi179 bash[23186]: audit 2024-09-20T22:40:01.469274+0000 mgr.a (mgr.14388) 1098 : audit [DBG] from='client.36669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:03.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:02 smithi049 bash[23528]: cluster 2024-09-20T22:40:01.415809+0000 mgr.a (mgr.14388) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:02 smithi049 bash[23528]: audit 2024-09-20T22:40:01.469274+0000 mgr.a (mgr.14388) 1098 : audit [DBG] from='client.36669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:04 smithi044 bash[22676]: cluster 2024-09-20T22:40:03.416753+0000 mgr.a (mgr.14388) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:05.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:04 smithi179 bash[23186]: cluster 2024-09-20T22:40:03.416753+0000 mgr.a (mgr.14388) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:05.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:04 smithi049 bash[23528]: cluster 2024-09-20T22:40:03.416753+0000 mgr.a (mgr.14388) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:06.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:06.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:06.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:06 smithi044 bash[22676]: cluster 2024-09-20T22:40:05.419047+0000 mgr.a (mgr.14388) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:07.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:06 smithi179 bash[23186]: cluster 2024-09-20T22:40:05.419047+0000 mgr.a (mgr.14388) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:07.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:06 smithi049 bash[23528]: cluster 2024-09-20T22:40:05.419047+0000 mgr.a (mgr.14388) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:07.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:07.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:07.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:07.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:07.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:08 smithi044 bash[22676]: audit 2024-09-20T22:40:07.255541+0000 mgr.a (mgr.14388) 1101 : audit [DBG] from='client.36747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:08 smithi044 bash[22676]: cluster 2024-09-20T22:40:07.419576+0000 mgr.a (mgr.14388) 1102 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:09.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:08 smithi179 bash[23186]: audit 2024-09-20T22:40:07.255541+0000 mgr.a (mgr.14388) 1101 : audit [DBG] from='client.36747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:09.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:08 smithi179 bash[23186]: cluster 2024-09-20T22:40:07.419576+0000 mgr.a (mgr.14388) 1102 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:08 smithi049 bash[23528]: audit 2024-09-20T22:40:07.255541+0000 mgr.a (mgr.14388) 1101 : audit [DBG] from='client.36747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:09.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:08 smithi049 bash[23528]: cluster 2024-09-20T22:40:07.419576+0000 mgr.a (mgr.14388) 1102 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:11 smithi044 bash[22676]: cluster 2024-09-20T22:40:09.420458+0000 mgr.a (mgr.14388) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:11 smithi044 bash[22676]: audit 2024-09-20T22:40:10.151754+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:11 smithi044 bash[22676]: audit 2024-09-20T22:40:10.160761+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:11 smithi044 bash[22676]: audit 2024-09-20T22:40:10.171599+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:11 smithi044 bash[22676]: audit 2024-09-20T22:40:10.384561+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:11 smithi044 bash[22676]: audit 2024-09-20T22:40:10.393745+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:11 smithi044 bash[22676]: audit 2024-09-20T22:40:10.404295+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:11 smithi179 bash[23186]: cluster 2024-09-20T22:40:09.420458+0000 mgr.a (mgr.14388) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:11 smithi179 bash[23186]: audit 2024-09-20T22:40:10.151754+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:11 smithi179 bash[23186]: audit 2024-09-20T22:40:10.160761+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:11 smithi179 bash[23186]: audit 2024-09-20T22:40:10.171599+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:11 smithi179 bash[23186]: audit 2024-09-20T22:40:10.384561+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:11 smithi179 bash[23186]: audit 2024-09-20T22:40:10.393745+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:11 smithi179 bash[23186]: audit 2024-09-20T22:40:10.404295+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:11 smithi049 bash[23528]: cluster 2024-09-20T22:40:09.420458+0000 mgr.a (mgr.14388) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:11 smithi049 bash[23528]: audit 2024-09-20T22:40:10.151754+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:11 smithi049 bash[23528]: audit 2024-09-20T22:40:10.160761+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:11 smithi049 bash[23528]: audit 2024-09-20T22:40:10.171599+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:11 smithi049 bash[23528]: audit 2024-09-20T22:40:10.384561+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:11 smithi049 bash[23528]: audit 2024-09-20T22:40:10.393745+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:11 smithi049 bash[23528]: audit 2024-09-20T22:40:10.404295+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:13.445 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:13.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:13.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:13.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:13.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:13 smithi044 bash[22676]: cluster 2024-09-20T22:40:11.422660+0000 mgr.a (mgr.14388) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:13 smithi044 bash[22676]: audit 2024-09-20T22:40:12.141189+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:13 smithi044 bash[22676]: audit 2024-09-20T22:40:12.147177+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:13 smithi044 bash[22676]: audit 2024-09-20T22:40:12.160531+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:13 smithi179 bash[23186]: cluster 2024-09-20T22:40:11.422660+0000 mgr.a (mgr.14388) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:13.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:13 smithi179 bash[23186]: audit 2024-09-20T22:40:12.141189+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:13 smithi179 bash[23186]: audit 2024-09-20T22:40:12.147177+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:13 smithi179 bash[23186]: audit 2024-09-20T22:40:12.160531+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:13 smithi049 bash[23528]: cluster 2024-09-20T22:40:11.422660+0000 mgr.a (mgr.14388) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:13.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:13 smithi049 bash[23528]: audit 2024-09-20T22:40:12.141189+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:13 smithi049 bash[23528]: audit 2024-09-20T22:40:12.147177+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:13.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:13 smithi049 bash[23528]: audit 2024-09-20T22:40:12.160531+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:14.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:14 smithi049 bash[23528]: audit 2024-09-20T22:40:13.002549+0000 mgr.a (mgr.14388) 1105 : audit [DBG] from='client.36822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:14 smithi044 bash[22676]: audit 2024-09-20T22:40:13.002549+0000 mgr.a (mgr.14388) 1105 : audit [DBG] from='client.36822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:14.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:14 smithi179 bash[23186]: audit 2024-09-20T22:40:13.002549+0000 mgr.a (mgr.14388) 1105 : audit [DBG] from='client.36822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:15 smithi044 bash[22676]: cluster 2024-09-20T22:40:13.423278+0000 mgr.a (mgr.14388) 1106 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:15.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:15 smithi179 bash[23186]: cluster 2024-09-20T22:40:13.423278+0000 mgr.a (mgr.14388) 1106 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:15.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:15 smithi049 bash[23528]: cluster 2024-09-20T22:40:13.423278+0000 mgr.a (mgr.14388) 1106 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:17 smithi044 bash[22676]: cluster 2024-09-20T22:40:15.425466+0000 mgr.a (mgr.14388) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:17.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:17 smithi179 bash[23186]: cluster 2024-09-20T22:40:15.425466+0000 mgr.a (mgr.14388) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:17.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:17 smithi049 bash[23528]: cluster 2024-09-20T22:40:15.425466+0000 mgr.a (mgr.14388) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:18.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:19.214 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: cluster 2024-09-20T22:40:17.426254+0000 mgr.a (mgr.14388) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:18.547477+0000 mon.a (mon.0) 1661 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:40:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:19.122659+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:19.128103+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:19.132736+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:19.137591+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:19.139036+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:40:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:19.139872+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:40:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22676]: audit 2024-09-20T22:40:19.155426+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: cluster 2024-09-20T22:40:17.426254+0000 mgr.a (mgr.14388) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:19.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:18.547477+0000 mon.a (mon.0) 1661 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:40:19.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:19.122659+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:19.128103+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:19.132736+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:19.137591+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:19.139036+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:40:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:19.139872+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:40:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:19 smithi179 bash[23186]: audit 2024-09-20T22:40:19.155426+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: cluster 2024-09-20T22:40:17.426254+0000 mgr.a (mgr.14388) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:18.547477+0000 mon.a (mon.0) 1661 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:19.122659+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:19.128103+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:19.132736+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:19.137591+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:19.139036+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:19.139872+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:40:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:19 smithi049 bash[23528]: audit 2024-09-20T22:40:19.155426+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:20.169 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22930]: debug 2024-09-20T22:40:19.889+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:40:20.170 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:40:19 smithi044 bash[22930]: debug 2024-09-20T22:40:19.889+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:40:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:20 smithi044 bash[22676]: audit 2024-09-20T22:40:18.786275+0000 mgr.a (mgr.14388) 1109 : audit [DBG] from='client.36900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:20.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:20 smithi044 bash[22676]: audit 2024-09-20T22:40:19.163670+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:40:20.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:20 smithi044 bash[22676]: audit 2024-09-20T22:40:19.164799+0000 mgr.a (mgr.14388) 1110 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:40:20.514 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:20 smithi179 bash[23186]: audit 2024-09-20T22:40:18.786275+0000 mgr.a (mgr.14388) 1109 : audit [DBG] from='client.36900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:20.514 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:20 smithi179 bash[23186]: audit 2024-09-20T22:40:19.163670+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:40:20.514 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:20 smithi179 bash[23186]: audit 2024-09-20T22:40:19.164799+0000 mgr.a (mgr.14388) 1110 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:40:20.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:20 smithi049 bash[23528]: audit 2024-09-20T22:40:18.786275+0000 mgr.a (mgr.14388) 1109 : audit [DBG] from='client.36900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:20.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:20 smithi049 bash[23528]: audit 2024-09-20T22:40:19.163670+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:40:20.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:20 smithi049 bash[23528]: audit 2024-09-20T22:40:19.164799+0000 mgr.a (mgr.14388) 1110 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:40:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:21 smithi044 bash[22676]: cluster 2024-09-20T22:40:19.426787+0000 mgr.a (mgr.14388) 1111 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:21 smithi044 bash[22676]: audit 2024-09-20T22:40:19.890102+0000 mgr.a (mgr.14388) 1112 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:40:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:21 smithi044 bash[22676]: cephadm 2024-09-20T22:40:19.891577+0000 mgr.a (mgr.14388) 1113 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:40:21.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:21 smithi179 bash[23186]: cluster 2024-09-20T22:40:19.426787+0000 mgr.a (mgr.14388) 1111 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:21.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:21 smithi179 bash[23186]: audit 2024-09-20T22:40:19.890102+0000 mgr.a (mgr.14388) 1112 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:40:21.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:21 smithi179 bash[23186]: cephadm 2024-09-20T22:40:19.891577+0000 mgr.a (mgr.14388) 1113 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:40:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:21 smithi049 bash[23528]: cluster 2024-09-20T22:40:19.426787+0000 mgr.a (mgr.14388) 1111 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:21 smithi049 bash[23528]: audit 2024-09-20T22:40:19.890102+0000 mgr.a (mgr.14388) 1112 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:40:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:21 smithi049 bash[23528]: cephadm 2024-09-20T22:40:19.891577+0000 mgr.a (mgr.14388) 1113 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:40:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:23 smithi044 bash[22676]: cluster 2024-09-20T22:40:21.429080+0000 mgr.a (mgr.14388) 1114 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:23.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:23 smithi179 bash[23186]: cluster 2024-09-20T22:40:21.429080+0000 mgr.a (mgr.14388) 1114 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:23 smithi049 bash[23528]: cluster 2024-09-20T22:40:21.429080+0000 mgr.a (mgr.14388) 1114 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:24.984 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:25 smithi044 bash[22676]: cluster 2024-09-20T22:40:23.429857+0000 mgr.a (mgr.14388) 1115 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:25.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:25 smithi179 bash[23186]: cluster 2024-09-20T22:40:23.429857+0000 mgr.a (mgr.14388) 1115 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:25.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:25 smithi049 bash[23528]: cluster 2024-09-20T22:40:23.429857+0000 mgr.a (mgr.14388) 1115 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:26 smithi044 bash[22676]: audit 2024-09-20T22:40:24.549170+0000 mgr.a (mgr.14388) 1116 : audit [DBG] from='client.37086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:26.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:26 smithi179 bash[23186]: audit 2024-09-20T22:40:24.549170+0000 mgr.a (mgr.14388) 1116 : audit [DBG] from='client.37086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:26.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:26 smithi049 bash[23528]: audit 2024-09-20T22:40:24.549170+0000 mgr.a (mgr.14388) 1116 : audit [DBG] from='client.37086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:27.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:27 smithi179 bash[23186]: cluster 2024-09-20T22:40:25.432253+0000 mgr.a (mgr.14388) 1117 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:27.409 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:27 smithi044 bash[22676]: cluster 2024-09-20T22:40:25.432253+0000 mgr.a (mgr.14388) 1117 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:27.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:27 smithi049 bash[23528]: cluster 2024-09-20T22:40:25.432253+0000 mgr.a (mgr.14388) 1117 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:28 smithi044 bash[22676]: cluster 2024-09-20T22:40:27.433042+0000 mgr.a (mgr.14388) 1118 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:28.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:28 smithi179 bash[23186]: cluster 2024-09-20T22:40:27.433042+0000 mgr.a (mgr.14388) 1118 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:28.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:28 smithi049 bash[23528]: cluster 2024-09-20T22:40:27.433042+0000 mgr.a (mgr.14388) 1118 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:30.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:30 smithi179 bash[23186]: cluster 2024-09-20T22:40:29.433864+0000 mgr.a (mgr.14388) 1119 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:30.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:30 smithi179 bash[23186]: audit 2024-09-20T22:40:30.307409+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:30 smithi179 bash[23186]: audit 2024-09-20T22:40:30.315000+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:30 smithi179 bash[23186]: audit 2024-09-20T22:40:30.323641+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:30.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:30.784 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:30.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:30 smithi049 bash[23528]: cluster 2024-09-20T22:40:29.433864+0000 mgr.a (mgr.14388) 1119 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:30.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:30 smithi049 bash[23528]: audit 2024-09-20T22:40:30.307409+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:30 smithi049 bash[23528]: audit 2024-09-20T22:40:30.315000+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:30 smithi049 bash[23528]: audit 2024-09-20T22:40:30.323641+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:30 smithi044 bash[22676]: cluster 2024-09-20T22:40:29.433864+0000 mgr.a (mgr.14388) 1119 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:30 smithi044 bash[22676]: audit 2024-09-20T22:40:30.307409+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:30 smithi044 bash[22676]: audit 2024-09-20T22:40:30.315000+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:30 smithi044 bash[22676]: audit 2024-09-20T22:40:30.323641+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:31 smithi044 bash[22676]: audit 2024-09-20T22:40:30.339014+0000 mgr.a (mgr.14388) 1120 : audit [DBG] from='client.37164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:31 smithi044 bash[22676]: audit 2024-09-20T22:40:30.564994+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:31 smithi044 bash[22676]: audit 2024-09-20T22:40:30.570386+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:31 smithi044 bash[22676]: audit 2024-09-20T22:40:30.585920+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:31 smithi179 bash[23186]: audit 2024-09-20T22:40:30.339014+0000 mgr.a (mgr.14388) 1120 : audit [DBG] from='client.37164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:32.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:31 smithi179 bash[23186]: audit 2024-09-20T22:40:30.564994+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:31 smithi179 bash[23186]: audit 2024-09-20T22:40:30.570386+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:31 smithi179 bash[23186]: audit 2024-09-20T22:40:30.585920+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:31 smithi049 bash[23528]: audit 2024-09-20T22:40:30.339014+0000 mgr.a (mgr.14388) 1120 : audit [DBG] from='client.37164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:31 smithi049 bash[23528]: audit 2024-09-20T22:40:30.564994+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:31 smithi049 bash[23528]: audit 2024-09-20T22:40:30.570386+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:31 smithi049 bash[23528]: audit 2024-09-20T22:40:30.585920+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:32 smithi044 bash[22676]: cluster 2024-09-20T22:40:31.436668+0000 mgr.a (mgr.14388) 1121 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:32 smithi044 bash[22676]: audit 2024-09-20T22:40:32.381104+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:32 smithi044 bash[22676]: audit 2024-09-20T22:40:32.389232+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:32 smithi044 bash[22676]: audit 2024-09-20T22:40:32.399389+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:32 smithi049 bash[23528]: cluster 2024-09-20T22:40:31.436668+0000 mgr.a (mgr.14388) 1121 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:32.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:32 smithi049 bash[23528]: audit 2024-09-20T22:40:32.381104+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:32 smithi049 bash[23528]: audit 2024-09-20T22:40:32.389232+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:32.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:32 smithi049 bash[23528]: audit 2024-09-20T22:40:32.399389+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:33.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:32 smithi179 bash[23186]: cluster 2024-09-20T22:40:31.436668+0000 mgr.a (mgr.14388) 1121 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:40:33.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:32 smithi179 bash[23186]: audit 2024-09-20T22:40:32.381104+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:33.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:32 smithi179 bash[23186]: audit 2024-09-20T22:40:32.389232+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:33.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:32 smithi179 bash[23186]: audit 2024-09-20T22:40:32.399389+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:34 smithi044 bash[22676]: cluster 2024-09-20T22:40:33.437470+0000 mgr.a (mgr.14388) 1122 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:40:35.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:34 smithi179 bash[23186]: cluster 2024-09-20T22:40:33.437470+0000 mgr.a (mgr.14388) 1122 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:40:35.010 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:34 smithi049 bash[23528]: cluster 2024-09-20T22:40:33.437470+0000 mgr.a (mgr.14388) 1122 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:40:35.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:35.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:35.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:36.523 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:36.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:36.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:36.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:36.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:36 smithi044 bash[22676]: cluster 2024-09-20T22:40:35.439423+0000 mgr.a (mgr.14388) 1123 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:36 smithi044 bash[22676]: audit 2024-09-20T22:40:36.117974+0000 mgr.a (mgr.14388) 1124 : audit [DBG] from='client.37242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:37.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:36 smithi179 bash[23186]: cluster 2024-09-20T22:40:35.439423+0000 mgr.a (mgr.14388) 1123 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:37.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:36 smithi179 bash[23186]: audit 2024-09-20T22:40:36.117974+0000 mgr.a (mgr.14388) 1124 : audit [DBG] from='client.37242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:36 smithi049 bash[23528]: cluster 2024-09-20T22:40:35.439423+0000 mgr.a (mgr.14388) 1123 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:36 smithi049 bash[23528]: audit 2024-09-20T22:40:36.117974+0000 mgr.a (mgr.14388) 1124 : audit [DBG] from='client.37242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:38 smithi044 bash[22676]: cluster 2024-09-20T22:40:37.440374+0000 mgr.a (mgr.14388) 1125 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:40:39.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:38 smithi179 bash[23186]: cluster 2024-09-20T22:40:37.440374+0000 mgr.a (mgr.14388) 1125 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:40:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:38 smithi049 bash[23528]: cluster 2024-09-20T22:40:37.440374+0000 mgr.a (mgr.14388) 1125 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:40:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:40 smithi044 bash[22676]: cluster 2024-09-20T22:40:39.441179+0000 mgr.a (mgr.14388) 1126 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:40:41.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:40 smithi179 bash[23186]: cluster 2024-09-20T22:40:39.441179+0000 mgr.a (mgr.14388) 1126 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:40:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:40 smithi049 bash[23528]: cluster 2024-09-20T22:40:39.441179+0000 mgr.a (mgr.14388) 1126 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:40:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:42.253 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:42.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:42.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:42.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:42.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:42 smithi044 bash[22676]: cluster 2024-09-20T22:40:41.443423+0000 mgr.a (mgr.14388) 1127 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:42 smithi044 bash[22676]: audit 2024-09-20T22:40:41.848279+0000 mgr.a (mgr.14388) 1128 : audit [DBG] from='client.37317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:43.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:42 smithi179 bash[23186]: cluster 2024-09-20T22:40:41.443423+0000 mgr.a (mgr.14388) 1127 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:43.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:42 smithi179 bash[23186]: audit 2024-09-20T22:40:41.848279+0000 mgr.a (mgr.14388) 1128 : audit [DBG] from='client.37317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:43.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:42 smithi049 bash[23528]: cluster 2024-09-20T22:40:41.443423+0000 mgr.a (mgr.14388) 1127 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:43.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:42 smithi049 bash[23528]: audit 2024-09-20T22:40:41.848279+0000 mgr.a (mgr.14388) 1128 : audit [DBG] from='client.37317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:44 smithi044 bash[22676]: cluster 2024-09-20T22:40:43.444393+0000 mgr.a (mgr.14388) 1129 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:45.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:44 smithi179 bash[23186]: cluster 2024-09-20T22:40:43.444393+0000 mgr.a (mgr.14388) 1129 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:44 smithi049 bash[23528]: cluster 2024-09-20T22:40:43.444393+0000 mgr.a (mgr.14388) 1129 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:46.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:46 smithi044 bash[22676]: cluster 2024-09-20T22:40:45.446588+0000 mgr.a (mgr.14388) 1130 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:47.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:46 smithi179 bash[23186]: cluster 2024-09-20T22:40:45.446588+0000 mgr.a (mgr.14388) 1130 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:47.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:46 smithi049 bash[23528]: cluster 2024-09-20T22:40:45.446588+0000 mgr.a (mgr.14388) 1130 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:47.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:47.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:47.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:48.013 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:48.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:48.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:48.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:48.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:48.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:48 smithi179 bash[23186]: cluster 2024-09-20T22:40:47.447332+0000 mgr.a (mgr.14388) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:48.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:48 smithi179 bash[23186]: audit 2024-09-20T22:40:47.592536+0000 mgr.a (mgr.14388) 1132 : audit [DBG] from='client.37392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:48.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:48 smithi044 bash[22676]: cluster 2024-09-20T22:40:47.447332+0000 mgr.a (mgr.14388) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:48.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:48 smithi044 bash[22676]: audit 2024-09-20T22:40:47.592536+0000 mgr.a (mgr.14388) 1132 : audit [DBG] from='client.37392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:49.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:48 smithi049 bash[23528]: cluster 2024-09-20T22:40:47.447332+0000 mgr.a (mgr.14388) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:49.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:48 smithi049 bash[23528]: audit 2024-09-20T22:40:47.592536+0000 mgr.a (mgr.14388) 1132 : audit [DBG] from='client.37392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:50.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:50 smithi179 bash[23186]: cluster 2024-09-20T22:40:49.448230+0000 mgr.a (mgr.14388) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:50.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:50 smithi179 bash[23186]: audit 2024-09-20T22:40:50.508391+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:50.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:50 smithi179 bash[23186]: audit 2024-09-20T22:40:50.516924+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:50 smithi179 bash[23186]: audit 2024-09-20T22:40:50.527261+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:50 smithi044 bash[22676]: cluster 2024-09-20T22:40:49.448230+0000 mgr.a (mgr.14388) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:50 smithi044 bash[22676]: audit 2024-09-20T22:40:50.508391+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:50 smithi044 bash[22676]: audit 2024-09-20T22:40:50.516924+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:50 smithi044 bash[22676]: audit 2024-09-20T22:40:50.527261+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:50 smithi049 bash[23528]: cluster 2024-09-20T22:40:49.448230+0000 mgr.a (mgr.14388) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:50 smithi049 bash[23528]: audit 2024-09-20T22:40:50.508391+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:50 smithi049 bash[23528]: audit 2024-09-20T22:40:50.516924+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:50 smithi049 bash[23528]: audit 2024-09-20T22:40:50.527261+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:51 smithi049 bash[23528]: audit 2024-09-20T22:40:50.797425+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:51 smithi049 bash[23528]: audit 2024-09-20T22:40:50.805779+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:51 smithi049 bash[23528]: audit 2024-09-20T22:40:50.815820+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:51 smithi044 bash[22676]: audit 2024-09-20T22:40:50.797425+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:51 smithi044 bash[22676]: audit 2024-09-20T22:40:50.805779+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:51 smithi044 bash[22676]: audit 2024-09-20T22:40:50.815820+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:51 smithi179 bash[23186]: audit 2024-09-20T22:40:50.797425+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:51 smithi179 bash[23186]: audit 2024-09-20T22:40:50.805779+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:51 smithi179 bash[23186]: audit 2024-09-20T22:40:50.815820+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:52 smithi044 bash[22676]: cluster 2024-09-20T22:40:51.450522+0000 mgr.a (mgr.14388) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:52 smithi044 bash[22676]: audit 2024-09-20T22:40:52.619714+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:52 smithi044 bash[22676]: audit 2024-09-20T22:40:52.627763+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:52 smithi044 bash[22676]: audit 2024-09-20T22:40:52.637615+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:53.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:53.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:53.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:53.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:52 smithi179 bash[23186]: cluster 2024-09-20T22:40:51.450522+0000 mgr.a (mgr.14388) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:52 smithi179 bash[23186]: audit 2024-09-20T22:40:52.619714+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:52 smithi179 bash[23186]: audit 2024-09-20T22:40:52.627763+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:52 smithi179 bash[23186]: audit 2024-09-20T22:40:52.637615+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:52 smithi049 bash[23528]: cluster 2024-09-20T22:40:51.450522+0000 mgr.a (mgr.14388) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:52 smithi049 bash[23528]: audit 2024-09-20T22:40:52.619714+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:52 smithi049 bash[23528]: audit 2024-09-20T22:40:52.627763+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:52 smithi049 bash[23528]: audit 2024-09-20T22:40:52.637615+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:40:53.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:53.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:53.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:53.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:40:53.790 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:54 smithi044 bash[22676]: audit 2024-09-20T22:40:53.354168+0000 mgr.a (mgr.14388) 1135 : audit [DBG] from='client.37464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:54 smithi044 bash[22676]: cluster 2024-09-20T22:40:53.451085+0000 mgr.a (mgr.14388) 1136 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:55.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:54 smithi179 bash[23186]: audit 2024-09-20T22:40:53.354168+0000 mgr.a (mgr.14388) 1135 : audit [DBG] from='client.37464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:55.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:54 smithi179 bash[23186]: cluster 2024-09-20T22:40:53.451085+0000 mgr.a (mgr.14388) 1136 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:55.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:54 smithi049 bash[23528]: audit 2024-09-20T22:40:53.354168+0000 mgr.a (mgr.14388) 1135 : audit [DBG] from='client.37464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:40:55.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:54 smithi049 bash[23528]: cluster 2024-09-20T22:40:53.451085+0000 mgr.a (mgr.14388) 1136 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:57.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:56 smithi049 bash[23528]: cluster 2024-09-20T22:40:55.453412+0000 mgr.a (mgr.14388) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:56 smithi044 bash[22676]: cluster 2024-09-20T22:40:55.453412+0000 mgr.a (mgr.14388) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:57.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:56 smithi179 bash[23186]: cluster 2024-09-20T22:40:55.453412+0000 mgr.a (mgr.14388) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:40:58.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:40:58.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:40:58.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:40:59.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:58 smithi049 bash[23528]: cluster 2024-09-20T22:40:57.454153+0000 mgr.a (mgr.14388) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:58 smithi044 bash[22676]: cluster 2024-09-20T22:40:57.454153+0000 mgr.a (mgr.14388) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:58 smithi179 bash[23186]: cluster 2024-09-20T22:40:57.454153+0000 mgr.a (mgr.14388) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:40:59.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:40:59.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:40:59.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:40:59.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:40:59.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:40:59 smithi044 bash[22676]: audit 2024-09-20T22:40:59.128053+0000 mgr.a (mgr.14388) 1139 : audit [DBG] from='client.37542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:00.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:40:59 smithi179 bash[23186]: audit 2024-09-20T22:40:59.128053+0000 mgr.a (mgr.14388) 1139 : audit [DBG] from='client.37542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:00.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:40:59 smithi049 bash[23528]: audit 2024-09-20T22:40:59.128053+0000 mgr.a (mgr.14388) 1139 : audit [DBG] from='client.37542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:00 smithi044 bash[22676]: cluster 2024-09-20T22:40:59.454674+0000 mgr.a (mgr.14388) 1140 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:01.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:00 smithi179 bash[23186]: cluster 2024-09-20T22:40:59.454674+0000 mgr.a (mgr.14388) 1140 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:00 smithi049 bash[23528]: cluster 2024-09-20T22:40:59.454674+0000 mgr.a (mgr.14388) 1140 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:02 smithi044 bash[22676]: cluster 2024-09-20T22:41:01.456958+0000 mgr.a (mgr.14388) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:03.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:02 smithi179 bash[23186]: cluster 2024-09-20T22:41:01.456958+0000 mgr.a (mgr.14388) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:02 smithi049 bash[23528]: cluster 2024-09-20T22:41:01.456958+0000 mgr.a (mgr.14388) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:04.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:04.569 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:04.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:04 smithi044 bash[22676]: cluster 2024-09-20T22:41:03.457816+0000 mgr.a (mgr.14388) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:05.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:04 smithi179 bash[23186]: cluster 2024-09-20T22:41:03.457816+0000 mgr.a (mgr.14388) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:04 smithi049 bash[23528]: cluster 2024-09-20T22:41:03.457816+0000 mgr.a (mgr.14388) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:05.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:05.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:05.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:05.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:05.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:05 smithi044 bash[22676]: audit 2024-09-20T22:41:04.900613+0000 mgr.a (mgr.14388) 1143 : audit [DBG] from='client.37620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:06.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:05 smithi179 bash[23186]: audit 2024-09-20T22:41:04.900613+0000 mgr.a (mgr.14388) 1143 : audit [DBG] from='client.37620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:05 smithi049 bash[23528]: audit 2024-09-20T22:41:04.900613+0000 mgr.a (mgr.14388) 1143 : audit [DBG] from='client.37620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:06 smithi044 bash[22676]: cluster 2024-09-20T22:41:05.460464+0000 mgr.a (mgr.14388) 1144 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:07.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:06 smithi179 bash[23186]: cluster 2024-09-20T22:41:05.460464+0000 mgr.a (mgr.14388) 1144 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:06 smithi049 bash[23528]: cluster 2024-09-20T22:41:05.460464+0000 mgr.a (mgr.14388) 1144 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:08 smithi044 bash[22676]: cluster 2024-09-20T22:41:07.461268+0000 mgr.a (mgr.14388) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:09.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:08 smithi179 bash[23186]: cluster 2024-09-20T22:41:07.461268+0000 mgr.a (mgr.14388) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:09.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:08 smithi049 bash[23528]: cluster 2024-09-20T22:41:07.461268+0000 mgr.a (mgr.14388) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:10.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:10.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:10.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:10.981 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:10 smithi179 bash[23186]: cluster 2024-09-20T22:41:09.462068+0000 mgr.a (mgr.14388) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:10.981 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:10 smithi179 bash[23186]: audit 2024-09-20T22:41:10.678808+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:10.981 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:10 smithi179 bash[23186]: audit 2024-09-20T22:41:10.685082+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:10.981 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:10 smithi179 bash[23186]: audit 2024-09-20T22:41:10.690037+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:11.059 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:11.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:11.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:11.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:11.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:10 smithi044 bash[22676]: cluster 2024-09-20T22:41:09.462068+0000 mgr.a (mgr.14388) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:10 smithi044 bash[22676]: audit 2024-09-20T22:41:10.678808+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:10 smithi044 bash[22676]: audit 2024-09-20T22:41:10.685082+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:10 smithi044 bash[22676]: audit 2024-09-20T22:41:10.690037+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:10 smithi049 bash[23528]: cluster 2024-09-20T22:41:09.462068+0000 mgr.a (mgr.14388) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:10 smithi049 bash[23528]: audit 2024-09-20T22:41:10.678808+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:10 smithi049 bash[23528]: audit 2024-09-20T22:41:10.685082+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:10 smithi049 bash[23528]: audit 2024-09-20T22:41:10.690037+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:12 smithi049 bash[23528]: audit 2024-09-20T22:41:10.637803+0000 mgr.a (mgr.14388) 1147 : audit [DBG] from='client.37698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:12.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:12 smithi049 bash[23528]: audit 2024-09-20T22:41:11.008977+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:12 smithi049 bash[23528]: audit 2024-09-20T22:41:11.012972+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:12 smithi049 bash[23528]: audit 2024-09-20T22:41:11.020113+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.306 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:12 smithi179 bash[23186]: audit 2024-09-20T22:41:10.637803+0000 mgr.a (mgr.14388) 1147 : audit [DBG] from='client.37698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:12.306 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:12 smithi179 bash[23186]: audit 2024-09-20T22:41:11.008977+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.306 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:12 smithi179 bash[23186]: audit 2024-09-20T22:41:11.012972+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.306 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:12 smithi179 bash[23186]: audit 2024-09-20T22:41:11.020113+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:12 smithi044 bash[22676]: audit 2024-09-20T22:41:10.637803+0000 mgr.a (mgr.14388) 1147 : audit [DBG] from='client.37698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:12 smithi044 bash[22676]: audit 2024-09-20T22:41:11.008977+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:12 smithi044 bash[22676]: audit 2024-09-20T22:41:11.012972+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:12 smithi044 bash[22676]: audit 2024-09-20T22:41:11.020113+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:13 smithi044 bash[22676]: cluster 2024-09-20T22:41:11.464809+0000 mgr.a (mgr.14388) 1148 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:13 smithi044 bash[22676]: audit 2024-09-20T22:41:12.854661+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:13 smithi044 bash[22676]: audit 2024-09-20T22:41:12.863097+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:13 smithi044 bash[22676]: audit 2024-09-20T22:41:12.873360+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:13 smithi049 bash[23528]: cluster 2024-09-20T22:41:11.464809+0000 mgr.a (mgr.14388) 1148 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:13 smithi049 bash[23528]: audit 2024-09-20T22:41:12.854661+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:13 smithi049 bash[23528]: audit 2024-09-20T22:41:12.863097+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:13 smithi049 bash[23528]: audit 2024-09-20T22:41:12.873360+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:13 smithi179 bash[23186]: cluster 2024-09-20T22:41:11.464809+0000 mgr.a (mgr.14388) 1148 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:13 smithi179 bash[23186]: audit 2024-09-20T22:41:12.854661+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:13 smithi179 bash[23186]: audit 2024-09-20T22:41:12.863097+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:13 smithi179 bash[23186]: audit 2024-09-20T22:41:12.873360+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:15.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:15 smithi049 bash[23528]: cluster 2024-09-20T22:41:13.465740+0000 mgr.a (mgr.14388) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:15 smithi044 bash[22676]: cluster 2024-09-20T22:41:13.465740+0000 mgr.a (mgr.14388) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:15.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:15 smithi179 bash[23186]: cluster 2024-09-20T22:41:13.465740+0000 mgr.a (mgr.14388) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:16.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:16.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:16.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:16.844 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:16.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:16.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:16.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:16.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:17.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:17 smithi049 bash[23528]: cluster 2024-09-20T22:41:15.467848+0000 mgr.a (mgr.14388) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:17 smithi044 bash[22676]: cluster 2024-09-20T22:41:15.467848+0000 mgr.a (mgr.14388) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:17.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:17 smithi179 bash[23186]: cluster 2024-09-20T22:41:15.467848+0000 mgr.a (mgr.14388) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:18 smithi049 bash[23528]: audit 2024-09-20T22:41:16.400496+0000 mgr.a (mgr.14388) 1151 : audit [DBG] from='client.37776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:18 smithi044 bash[22676]: audit 2024-09-20T22:41:16.400496+0000 mgr.a (mgr.14388) 1151 : audit [DBG] from='client.37776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:18.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:18 smithi179 bash[23186]: audit 2024-09-20T22:41:16.400496+0000 mgr.a (mgr.14388) 1151 : audit [DBG] from='client.37776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:19 smithi049 bash[23528]: cluster 2024-09-20T22:41:17.468963+0000 mgr.a (mgr.14388) 1152 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:19 smithi044 bash[22676]: cluster 2024-09-20T22:41:17.468963+0000 mgr.a (mgr.14388) 1152 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:19.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:19 smithi179 bash[23186]: cluster 2024-09-20T22:41:17.468963+0000 mgr.a (mgr.14388) 1152 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:20 smithi044 bash[22676]: audit 2024-09-20T22:41:19.968398+0000 mon.a (mon.0) 1697 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:41:20.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:20 smithi179 bash[23186]: audit 2024-09-20T22:41:19.968398+0000 mon.a (mon.0) 1697 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:41:20.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:20 smithi049 bash[23528]: audit 2024-09-20T22:41:19.968398+0000 mon.a (mon.0) 1697 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:41:21.331 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22676]: cluster 2024-09-20T22:41:19.469839+0000 mgr.a (mgr.14388) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:21.331 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22676]: audit 2024-09-20T22:41:20.534635+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.331 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22676]: audit 2024-09-20T22:41:20.543299+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.331 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22676]: audit 2024-09-20T22:41:20.545875+0000 mon.a (mon.0) 1700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:41:21.331 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22676]: audit 2024-09-20T22:41:20.547703+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:41:21.332 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22676]: audit 2024-09-20T22:41:20.558061+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.332 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22676]: audit 2024-09-20T22:41:20.564379+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:41:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:21 smithi179 bash[23186]: cluster 2024-09-20T22:41:19.469839+0000 mgr.a (mgr.14388) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:21 smithi179 bash[23186]: audit 2024-09-20T22:41:20.534635+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:21 smithi179 bash[23186]: audit 2024-09-20T22:41:20.543299+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:21 smithi179 bash[23186]: audit 2024-09-20T22:41:20.545875+0000 mon.a (mon.0) 1700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:41:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:21 smithi179 bash[23186]: audit 2024-09-20T22:41:20.547703+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:41:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:21 smithi179 bash[23186]: audit 2024-09-20T22:41:20.558061+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:21 smithi179 bash[23186]: audit 2024-09-20T22:41:20.564379+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:41:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:21 smithi049 bash[23528]: cluster 2024-09-20T22:41:19.469839+0000 mgr.a (mgr.14388) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:21 smithi049 bash[23528]: audit 2024-09-20T22:41:20.534635+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:21 smithi049 bash[23528]: audit 2024-09-20T22:41:20.543299+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:21 smithi049 bash[23528]: audit 2024-09-20T22:41:20.545875+0000 mon.a (mon.0) 1700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:21 smithi049 bash[23528]: audit 2024-09-20T22:41:20.547703+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:21 smithi049 bash[23528]: audit 2024-09-20T22:41:20.558061+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:21 smithi049 bash[23528]: audit 2024-09-20T22:41:20.564379+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:41:21.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22930]: debug 2024-09-20T22:41:21.328+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:41:21.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:41:21 smithi044 bash[22930]: debug 2024-09-20T22:41:21.332+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:41:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:22 smithi044 bash[22676]: audit 2024-09-20T22:41:20.566796+0000 mgr.a (mgr.14388) 1154 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:41:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:22 smithi179 bash[23186]: audit 2024-09-20T22:41:20.566796+0000 mgr.a (mgr.14388) 1154 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:41:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:22 smithi049 bash[23528]: audit 2024-09-20T22:41:20.566796+0000 mgr.a (mgr.14388) 1154 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:41:22.590 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:22.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:23 smithi044 bash[22676]: audit 2024-09-20T22:41:21.332034+0000 mgr.a (mgr.14388) 1155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:41:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:23 smithi044 bash[22676]: cephadm 2024-09-20T22:41:21.333398+0000 mgr.a (mgr.14388) 1156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:41:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:23 smithi044 bash[22676]: cluster 2024-09-20T22:41:21.472551+0000 mgr.a (mgr.14388) 1157 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:23 smithi044 bash[22676]: audit 2024-09-20T22:41:22.179922+0000 mgr.a (mgr.14388) 1158 : audit [DBG] from='client.37956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:23 smithi179 bash[23186]: audit 2024-09-20T22:41:21.332034+0000 mgr.a (mgr.14388) 1155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:41:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:23 smithi179 bash[23186]: cephadm 2024-09-20T22:41:21.333398+0000 mgr.a (mgr.14388) 1156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:41:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:23 smithi179 bash[23186]: cluster 2024-09-20T22:41:21.472551+0000 mgr.a (mgr.14388) 1157 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:23 smithi179 bash[23186]: audit 2024-09-20T22:41:22.179922+0000 mgr.a (mgr.14388) 1158 : audit [DBG] from='client.37956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:23 smithi049 bash[23528]: audit 2024-09-20T22:41:21.332034+0000 mgr.a (mgr.14388) 1155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:41:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:23 smithi049 bash[23528]: cephadm 2024-09-20T22:41:21.333398+0000 mgr.a (mgr.14388) 1156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:41:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:23 smithi049 bash[23528]: cluster 2024-09-20T22:41:21.472551+0000 mgr.a (mgr.14388) 1157 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:23 smithi049 bash[23528]: audit 2024-09-20T22:41:22.179922+0000 mgr.a (mgr.14388) 1158 : audit [DBG] from='client.37956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:25 smithi044 bash[22676]: cluster 2024-09-20T22:41:23.473486+0000 mgr.a (mgr.14388) 1159 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:25 smithi179 bash[23186]: cluster 2024-09-20T22:41:23.473486+0000 mgr.a (mgr.14388) 1159 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:25.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:25 smithi049 bash[23528]: cluster 2024-09-20T22:41:23.473486+0000 mgr.a (mgr.14388) 1159 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:26 smithi044 bash[22676]: cluster 2024-09-20T22:41:25.475691+0000 mgr.a (mgr.14388) 1160 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:26.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:26 smithi179 bash[23186]: cluster 2024-09-20T22:41:25.475691+0000 mgr.a (mgr.14388) 1160 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:26 smithi049 bash[23528]: cluster 2024-09-20T22:41:25.475691+0000 mgr.a (mgr.14388) 1160 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:27.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:27.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:27.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:28.333 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:28.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:28.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:28.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:28.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:28 smithi044 bash[22676]: cluster 2024-09-20T22:41:27.476461+0000 mgr.a (mgr.14388) 1161 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:28 smithi044 bash[22676]: audit 2024-09-20T22:41:27.916120+0000 mgr.a (mgr.14388) 1162 : audit [DBG] from='client.38031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:28 smithi049 bash[23528]: cluster 2024-09-20T22:41:27.476461+0000 mgr.a (mgr.14388) 1161 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:28 smithi049 bash[23528]: audit 2024-09-20T22:41:27.916120+0000 mgr.a (mgr.14388) 1162 : audit [DBG] from='client.38031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:28 smithi179 bash[23186]: cluster 2024-09-20T22:41:27.476461+0000 mgr.a (mgr.14388) 1161 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:28 smithi179 bash[23186]: audit 2024-09-20T22:41:27.916120+0000 mgr.a (mgr.14388) 1162 : audit [DBG] from='client.38031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:30.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:30 smithi044 bash[22676]: cluster 2024-09-20T22:41:29.477453+0000 mgr.a (mgr.14388) 1163 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:30.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:30 smithi049 bash[23528]: cluster 2024-09-20T22:41:29.477453+0000 mgr.a (mgr.14388) 1163 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:30.821 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:30 smithi179 bash[23186]: cluster 2024-09-20T22:41:29.477453+0000 mgr.a (mgr.14388) 1163 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:31.952 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:31 smithi179 bash[23186]: audit 2024-09-20T22:41:30.832204+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:31.953 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:31 smithi179 bash[23186]: audit 2024-09-20T22:41:30.837341+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:31.953 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:31 smithi179 bash[23186]: audit 2024-09-20T22:41:30.844501+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:31.953 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:31 smithi179 bash[23186]: audit 2024-09-20T22:41:31.184378+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:31.953 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:31 smithi179 bash[23186]: audit 2024-09-20T22:41:31.190106+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:31.953 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:31 smithi179 bash[23186]: audit 2024-09-20T22:41:31.196660+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:31 smithi044 bash[22676]: audit 2024-09-20T22:41:30.832204+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:31 smithi044 bash[22676]: audit 2024-09-20T22:41:30.837341+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:31 smithi044 bash[22676]: audit 2024-09-20T22:41:30.844501+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:31 smithi044 bash[22676]: audit 2024-09-20T22:41:31.184378+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:31 smithi044 bash[22676]: audit 2024-09-20T22:41:31.190106+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:31 smithi044 bash[22676]: audit 2024-09-20T22:41:31.196660+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:31 smithi049 bash[23528]: audit 2024-09-20T22:41:30.832204+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:31 smithi049 bash[23528]: audit 2024-09-20T22:41:30.837341+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:31 smithi049 bash[23528]: audit 2024-09-20T22:41:30.844501+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:31 smithi049 bash[23528]: audit 2024-09-20T22:41:31.184378+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:31 smithi049 bash[23528]: audit 2024-09-20T22:41:31.190106+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:31 smithi049 bash[23528]: audit 2024-09-20T22:41:31.196660+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:33.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:33.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:33 smithi044 bash[22676]: cluster 2024-09-20T22:41:31.479703+0000 mgr.a (mgr.14388) 1164 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:33 smithi044 bash[22676]: audit 2024-09-20T22:41:33.089913+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:33 smithi044 bash[22676]: audit 2024-09-20T22:41:33.098393+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:33 smithi044 bash[22676]: audit 2024-09-20T22:41:33.108577+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:33 smithi179 bash[23186]: cluster 2024-09-20T22:41:31.479703+0000 mgr.a (mgr.14388) 1164 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:33 smithi179 bash[23186]: audit 2024-09-20T22:41:33.089913+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:33 smithi179 bash[23186]: audit 2024-09-20T22:41:33.098393+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:33 smithi179 bash[23186]: audit 2024-09-20T22:41:33.108577+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:33 smithi049 bash[23528]: cluster 2024-09-20T22:41:31.479703+0000 mgr.a (mgr.14388) 1164 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:33 smithi049 bash[23528]: audit 2024-09-20T22:41:33.089913+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:33 smithi049 bash[23528]: audit 2024-09-20T22:41:33.098393+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:33 smithi049 bash[23528]: audit 2024-09-20T22:41:33.108577+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:34.086 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:34 smithi044 bash[22676]: cluster 2024-09-20T22:41:33.480455+0000 mgr.a (mgr.14388) 1165 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:34 smithi044 bash[22676]: audit 2024-09-20T22:41:33.667877+0000 mgr.a (mgr.14388) 1166 : audit [DBG] from='client.38109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:34 smithi179 bash[23186]: cluster 2024-09-20T22:41:33.480455+0000 mgr.a (mgr.14388) 1165 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:34 smithi179 bash[23186]: audit 2024-09-20T22:41:33.667877+0000 mgr.a (mgr.14388) 1166 : audit [DBG] from='client.38109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:34.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:34 smithi049 bash[23528]: cluster 2024-09-20T22:41:33.480455+0000 mgr.a (mgr.14388) 1165 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:34.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:34 smithi049 bash[23528]: audit 2024-09-20T22:41:33.667877+0000 mgr.a (mgr.14388) 1166 : audit [DBG] from='client.38109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:36.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:36 smithi049 bash[23528]: cluster 2024-09-20T22:41:35.482799+0000 mgr.a (mgr.14388) 1167 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:36 smithi044 bash[22676]: cluster 2024-09-20T22:41:35.482799+0000 mgr.a (mgr.14388) 1167 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:36 smithi179 bash[23186]: cluster 2024-09-20T22:41:35.482799+0000 mgr.a (mgr.14388) 1167 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:41:38.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:38 smithi049 bash[23528]: cluster 2024-09-20T22:41:37.483576+0000 mgr.a (mgr.14388) 1168 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:38 smithi044 bash[22676]: cluster 2024-09-20T22:41:37.483576+0000 mgr.a (mgr.14388) 1168 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:38 smithi179 bash[23186]: cluster 2024-09-20T22:41:37.483576+0000 mgr.a (mgr.14388) 1168 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:39.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:39.876 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:39.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:39.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:39.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:39.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:40.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:40 smithi049 bash[23528]: audit 2024-09-20T22:41:39.429975+0000 mgr.a (mgr.14388) 1169 : audit [DBG] from='client.38181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:40.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:40 smithi049 bash[23528]: cluster 2024-09-20T22:41:39.484614+0000 mgr.a (mgr.14388) 1170 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:40 smithi044 bash[22676]: audit 2024-09-20T22:41:39.429975+0000 mgr.a (mgr.14388) 1169 : audit [DBG] from='client.38181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:40 smithi044 bash[22676]: cluster 2024-09-20T22:41:39.484614+0000 mgr.a (mgr.14388) 1170 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:40 smithi179 bash[23186]: audit 2024-09-20T22:41:39.429975+0000 mgr.a (mgr.14388) 1169 : audit [DBG] from='client.38181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:40 smithi179 bash[23186]: cluster 2024-09-20T22:41:39.484614+0000 mgr.a (mgr.14388) 1170 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:42 smithi044 bash[22676]: cluster 2024-09-20T22:41:41.487033+0000 mgr.a (mgr.14388) 1171 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:42 smithi179 bash[23186]: cluster 2024-09-20T22:41:41.487033+0000 mgr.a (mgr.14388) 1171 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:43.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:42 smithi049 bash[23528]: cluster 2024-09-20T22:41:41.487033+0000 mgr.a (mgr.14388) 1171 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:41:44.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:44.879 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:44.879 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:44 smithi044 bash[22676]: cluster 2024-09-20T22:41:43.487818+0000 mgr.a (mgr.14388) 1172 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:44 smithi179 bash[23186]: cluster 2024-09-20T22:41:43.487818+0000 mgr.a (mgr.14388) 1172 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:44 smithi049 bash[23528]: cluster 2024-09-20T22:41:43.487818+0000 mgr.a (mgr.14388) 1172 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:45.638 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:45.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:46 smithi044 bash[22676]: audit 2024-09-20T22:41:45.214754+0000 mgr.a (mgr.14388) 1173 : audit [DBG] from='client.38256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:46 smithi044 bash[22676]: cluster 2024-09-20T22:41:45.489086+0000 mgr.a (mgr.14388) 1174 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:46 smithi179 bash[23186]: audit 2024-09-20T22:41:45.214754+0000 mgr.a (mgr.14388) 1173 : audit [DBG] from='client.38256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:46 smithi179 bash[23186]: cluster 2024-09-20T22:41:45.489086+0000 mgr.a (mgr.14388) 1174 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:47.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:46 smithi049 bash[23528]: audit 2024-09-20T22:41:45.214754+0000 mgr.a (mgr.14388) 1173 : audit [DBG] from='client.38256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:47.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:46 smithi049 bash[23528]: cluster 2024-09-20T22:41:45.489086+0000 mgr.a (mgr.14388) 1174 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:48 smithi044 bash[22676]: cluster 2024-09-20T22:41:47.489961+0000 mgr.a (mgr.14388) 1175 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:48 smithi179 bash[23186]: cluster 2024-09-20T22:41:47.489961+0000 mgr.a (mgr.14388) 1175 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:49.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:48 smithi049 bash[23528]: cluster 2024-09-20T22:41:47.489961+0000 mgr.a (mgr.14388) 1175 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:41:50.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:50.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:50.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:50 smithi044 bash[22676]: cluster 2024-09-20T22:41:49.490776+0000 mgr.a (mgr.14388) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:51.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:50 smithi179 bash[23186]: cluster 2024-09-20T22:41:49.490776+0000 mgr.a (mgr.14388) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:50 smithi049 bash[23528]: cluster 2024-09-20T22:41:49.490776+0000 mgr.a (mgr.14388) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:51.380 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:51.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:51.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:51.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:51.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:52 smithi179 bash[23186]: audit 2024-09-20T22:41:50.969362+0000 mgr.a (mgr.14388) 1177 : audit [DBG] from='client.38334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:52 smithi179 bash[23186]: audit 2024-09-20T22:41:51.024802+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:52 smithi179 bash[23186]: audit 2024-09-20T22:41:51.030651+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:52 smithi179 bash[23186]: audit 2024-09-20T22:41:51.035901+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:52 smithi179 bash[23186]: audit 2024-09-20T22:41:51.384483+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:52 smithi179 bash[23186]: audit 2024-09-20T22:41:51.390094+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:52 smithi179 bash[23186]: audit 2024-09-20T22:41:51.395187+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:52 smithi049 bash[23528]: audit 2024-09-20T22:41:50.969362+0000 mgr.a (mgr.14388) 1177 : audit [DBG] from='client.38334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:52 smithi049 bash[23528]: audit 2024-09-20T22:41:51.024802+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:52 smithi049 bash[23528]: audit 2024-09-20T22:41:51.030651+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:52 smithi049 bash[23528]: audit 2024-09-20T22:41:51.035901+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:52 smithi049 bash[23528]: audit 2024-09-20T22:41:51.384483+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:52 smithi049 bash[23528]: audit 2024-09-20T22:41:51.390094+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:52 smithi049 bash[23528]: audit 2024-09-20T22:41:51.395187+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:52 smithi044 bash[22676]: audit 2024-09-20T22:41:50.969362+0000 mgr.a (mgr.14388) 1177 : audit [DBG] from='client.38334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:52.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:52 smithi044 bash[22676]: audit 2024-09-20T22:41:51.024802+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:52 smithi044 bash[22676]: audit 2024-09-20T22:41:51.030651+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:52 smithi044 bash[22676]: audit 2024-09-20T22:41:51.035901+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:52 smithi044 bash[22676]: audit 2024-09-20T22:41:51.384483+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:52 smithi044 bash[22676]: audit 2024-09-20T22:41:51.390094+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:52.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:52 smithi044 bash[22676]: audit 2024-09-20T22:41:51.395187+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:53 smithi179 bash[23186]: cluster 2024-09-20T22:41:51.492070+0000 mgr.a (mgr.14388) 1178 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:53 smithi049 bash[23528]: cluster 2024-09-20T22:41:51.492070+0000 mgr.a (mgr.14388) 1178 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:53.348 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:53 smithi044 bash[22676]: cluster 2024-09-20T22:41:51.492070+0000 mgr.a (mgr.14388) 1178 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:54.601 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:54 smithi049 bash[23528]: audit 2024-09-20T22:41:53.328170+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.601 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:54 smithi049 bash[23528]: audit 2024-09-20T22:41:53.336708+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.601 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:54 smithi049 bash[23528]: audit 2024-09-20T22:41:53.346854+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.602 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:54 smithi049 bash[23528]: cluster 2024-09-20T22:41:53.492930+0000 mgr.a (mgr.14388) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:54 smithi044 bash[22676]: audit 2024-09-20T22:41:53.328170+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:54 smithi044 bash[22676]: audit 2024-09-20T22:41:53.336708+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:54 smithi044 bash[22676]: audit 2024-09-20T22:41:53.346854+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:54 smithi044 bash[22676]: cluster 2024-09-20T22:41:53.492930+0000 mgr.a (mgr.14388) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:54 smithi179 bash[23186]: audit 2024-09-20T22:41:53.328170+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:54 smithi179 bash[23186]: audit 2024-09-20T22:41:53.336708+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:54 smithi179 bash[23186]: audit 2024-09-20T22:41:53.346854+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:41:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:54 smithi179 bash[23186]: cluster 2024-09-20T22:41:53.492930+0000 mgr.a (mgr.14388) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:41:56.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:41:56.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:41:56.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:41:56.965 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:56 smithi049 bash[23528]: cluster 2024-09-20T22:41:55.494882+0000 mgr.a (mgr.14388) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:56 smithi044 bash[22676]: cluster 2024-09-20T22:41:55.494882+0000 mgr.a (mgr.14388) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:56 smithi179 bash[23186]: cluster 2024-09-20T22:41:55.494882+0000 mgr.a (mgr.14388) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:57.141 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:41:57.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:41:57.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:41:57.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:41:57.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:41:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:57 smithi044 bash[22676]: audit 2024-09-20T22:41:56.717460+0000 mgr.a (mgr.14388) 1181 : audit [DBG] from='client.38406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:57 smithi179 bash[23186]: audit 2024-09-20T22:41:56.717460+0000 mgr.a (mgr.14388) 1181 : audit [DBG] from='client.38406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:58.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:57 smithi049 bash[23528]: audit 2024-09-20T22:41:56.717460+0000 mgr.a (mgr.14388) 1181 : audit [DBG] from='client.38406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:41:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:41:58 smithi044 bash[22676]: cluster 2024-09-20T22:41:57.495798+0000 mgr.a (mgr.14388) 1182 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:41:58 smithi179 bash[23186]: cluster 2024-09-20T22:41:57.495798+0000 mgr.a (mgr.14388) 1182 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:41:59.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:41:58 smithi049 bash[23528]: cluster 2024-09-20T22:41:57.495798+0000 mgr.a (mgr.14388) 1182 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:00 smithi044 bash[22676]: cluster 2024-09-20T22:41:59.496589+0000 mgr.a (mgr.14388) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:00 smithi179 bash[23186]: cluster 2024-09-20T22:41:59.496589+0000 mgr.a (mgr.14388) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:01.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:00 smithi049 bash[23528]: cluster 2024-09-20T22:41:59.496589+0000 mgr.a (mgr.14388) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:02.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:02.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:02.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:02.882 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:02 smithi044 bash[22676]: cluster 2024-09-20T22:42:01.498829+0000 mgr.a (mgr.14388) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:02 smithi179 bash[23186]: cluster 2024-09-20T22:42:01.498829+0000 mgr.a (mgr.14388) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:03.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:02 smithi049 bash[23528]: cluster 2024-09-20T22:42:01.498829+0000 mgr.a (mgr.14388) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:03 smithi044 bash[22676]: audit 2024-09-20T22:42:02.473408+0000 mgr.a (mgr.14388) 1185 : audit [DBG] from='client.38484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:03 smithi179 bash[23186]: audit 2024-09-20T22:42:02.473408+0000 mgr.a (mgr.14388) 1185 : audit [DBG] from='client.38484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:04.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:03 smithi049 bash[23528]: audit 2024-09-20T22:42:02.473408+0000 mgr.a (mgr.14388) 1185 : audit [DBG] from='client.38484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:04 smithi044 bash[22676]: cluster 2024-09-20T22:42:03.499888+0000 mgr.a (mgr.14388) 1186 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:04 smithi179 bash[23186]: cluster 2024-09-20T22:42:03.499888+0000 mgr.a (mgr.14388) 1186 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:04 smithi049 bash[23528]: cluster 2024-09-20T22:42:03.499888+0000 mgr.a (mgr.14388) 1186 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:06 smithi044 bash[22676]: cluster 2024-09-20T22:42:05.502238+0000 mgr.a (mgr.14388) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:06 smithi179 bash[23186]: cluster 2024-09-20T22:42:05.502238+0000 mgr.a (mgr.14388) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:06 smithi049 bash[23528]: cluster 2024-09-20T22:42:05.502238+0000 mgr.a (mgr.14388) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:07.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:08.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:08 smithi044 bash[22676]: cluster 2024-09-20T22:42:07.503158+0000 mgr.a (mgr.14388) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:08 smithi179 bash[23186]: cluster 2024-09-20T22:42:07.503158+0000 mgr.a (mgr.14388) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:08 smithi049 bash[23528]: cluster 2024-09-20T22:42:07.503158+0000 mgr.a (mgr.14388) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:09 smithi044 bash[22676]: audit 2024-09-20T22:42:08.220417+0000 mgr.a (mgr.14388) 1189 : audit [DBG] from='client.38562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:09 smithi179 bash[23186]: audit 2024-09-20T22:42:08.220417+0000 mgr.a (mgr.14388) 1189 : audit [DBG] from='client.38562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:09 smithi049 bash[23528]: audit 2024-09-20T22:42:08.220417+0000 mgr.a (mgr.14388) 1189 : audit [DBG] from='client.38562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:10 smithi044 bash[22676]: cluster 2024-09-20T22:42:09.504102+0000 mgr.a (mgr.14388) 1190 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:10 smithi179 bash[23186]: cluster 2024-09-20T22:42:09.504102+0000 mgr.a (mgr.14388) 1190 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:10 smithi049 bash[23528]: cluster 2024-09-20T22:42:09.504102+0000 mgr.a (mgr.14388) 1190 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:12 smithi044 bash[22676]: audit 2024-09-20T22:42:11.226974+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:12 smithi044 bash[22676]: audit 2024-09-20T22:42:11.232195+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:12 smithi044 bash[22676]: audit 2024-09-20T22:42:11.239070+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:12 smithi044 bash[22676]: cluster 2024-09-20T22:42:11.506431+0000 mgr.a (mgr.14388) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:12 smithi044 bash[22676]: audit 2024-09-20T22:42:11.609785+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:12 smithi044 bash[22676]: audit 2024-09-20T22:42:11.618566+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:12 smithi044 bash[22676]: audit 2024-09-20T22:42:11.630878+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:12 smithi179 bash[23186]: audit 2024-09-20T22:42:11.226974+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:12 smithi179 bash[23186]: audit 2024-09-20T22:42:11.232195+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:12 smithi179 bash[23186]: audit 2024-09-20T22:42:11.239070+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:12 smithi179 bash[23186]: cluster 2024-09-20T22:42:11.506431+0000 mgr.a (mgr.14388) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:12 smithi179 bash[23186]: audit 2024-09-20T22:42:11.609785+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:12 smithi179 bash[23186]: audit 2024-09-20T22:42:11.618566+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:12 smithi179 bash[23186]: audit 2024-09-20T22:42:11.630878+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:12 smithi049 bash[23528]: audit 2024-09-20T22:42:11.226974+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:12 smithi049 bash[23528]: audit 2024-09-20T22:42:11.232195+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:12 smithi049 bash[23528]: audit 2024-09-20T22:42:11.239070+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:12 smithi049 bash[23528]: cluster 2024-09-20T22:42:11.506431+0000 mgr.a (mgr.14388) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:12 smithi049 bash[23528]: audit 2024-09-20T22:42:11.609785+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:12 smithi049 bash[23528]: audit 2024-09-20T22:42:11.618566+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:12 smithi049 bash[23528]: audit 2024-09-20T22:42:11.630878+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:13.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:13.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:13.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:14.427 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:14.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:14.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:14.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:14.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:14 smithi049 bash[23528]: cluster 2024-09-20T22:42:13.507284+0000 mgr.a (mgr.14388) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:14 smithi049 bash[23528]: audit 2024-09-20T22:42:13.550788+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:14 smithi049 bash[23528]: audit 2024-09-20T22:42:13.559632+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:14 smithi049 bash[23528]: audit 2024-09-20T22:42:13.572817+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:14 smithi049 bash[23528]: audit 2024-09-20T22:42:13.982606+0000 mgr.a (mgr.14388) 1193 : audit [DBG] from='client.38631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:14.805 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:14 smithi179 bash[23186]: cluster 2024-09-20T22:42:13.507284+0000 mgr.a (mgr.14388) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:14.805 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:14 smithi179 bash[23186]: audit 2024-09-20T22:42:13.550788+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.805 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:14 smithi179 bash[23186]: audit 2024-09-20T22:42:13.559632+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.805 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:14 smithi179 bash[23186]: audit 2024-09-20T22:42:13.572817+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.805 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:14 smithi179 bash[23186]: audit 2024-09-20T22:42:13.982606+0000 mgr.a (mgr.14388) 1193 : audit [DBG] from='client.38631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:14 smithi044 bash[22676]: cluster 2024-09-20T22:42:13.507284+0000 mgr.a (mgr.14388) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:14 smithi044 bash[22676]: audit 2024-09-20T22:42:13.550788+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:14 smithi044 bash[22676]: audit 2024-09-20T22:42:13.559632+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:14 smithi044 bash[22676]: audit 2024-09-20T22:42:13.572817+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:14 smithi044 bash[22676]: audit 2024-09-20T22:42:13.982606+0000 mgr.a (mgr.14388) 1193 : audit [DBG] from='client.38631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:16.888 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:16 smithi049 bash[23528]: cluster 2024-09-20T22:42:15.509546+0000 mgr.a (mgr.14388) 1194 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:16 smithi044 bash[22676]: cluster 2024-09-20T22:42:15.509546+0000 mgr.a (mgr.14388) 1194 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:16 smithi179 bash[23186]: cluster 2024-09-20T22:42:15.509546+0000 mgr.a (mgr.14388) 1194 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:18 smithi044 bash[22676]: cluster 2024-09-20T22:42:17.510286+0000 mgr.a (mgr.14388) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:18 smithi179 bash[23186]: cluster 2024-09-20T22:42:17.510286+0000 mgr.a (mgr.14388) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:19.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:18 smithi049 bash[23528]: cluster 2024-09-20T22:42:17.510286+0000 mgr.a (mgr.14388) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:19.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:19.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:19.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:20 smithi044 bash[22676]: cluster 2024-09-20T22:42:19.511023+0000 mgr.a (mgr.14388) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:20 smithi044 bash[22676]: audit 2024-09-20T22:42:19.758925+0000 mgr.a (mgr.14388) 1197 : audit [DBG] from='client.38709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:20 smithi179 bash[23186]: cluster 2024-09-20T22:42:19.511023+0000 mgr.a (mgr.14388) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:20 smithi179 bash[23186]: audit 2024-09-20T22:42:19.758925+0000 mgr.a (mgr.14388) 1197 : audit [DBG] from='client.38709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:21.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:20 smithi049 bash[23528]: cluster 2024-09-20T22:42:19.511023+0000 mgr.a (mgr.14388) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:21.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:20 smithi049 bash[23528]: audit 2024-09-20T22:42:19.758925+0000 mgr.a (mgr.14388) 1197 : audit [DBG] from='client.38709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:21 smithi044 bash[22676]: audit 2024-09-20T22:42:21.390130+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:42:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:21 smithi044 bash[22676]: audit 2024-09-20T22:42:21.396985+0000 mon.a (mon.0) 1732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:42:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:21 smithi044 bash[22676]: audit 2024-09-20T22:42:21.398849+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:42:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:21 smithi044 bash[22676]: audit 2024-09-20T22:42:21.410291+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:21 smithi044 bash[22676]: audit 2024-09-20T22:42:21.416601+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:42:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:21 smithi179 bash[23186]: audit 2024-09-20T22:42:21.390130+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:42:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:21 smithi179 bash[23186]: audit 2024-09-20T22:42:21.396985+0000 mon.a (mon.0) 1732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:42:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:21 smithi179 bash[23186]: audit 2024-09-20T22:42:21.398849+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:42:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:21 smithi179 bash[23186]: audit 2024-09-20T22:42:21.410291+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:21 smithi179 bash[23186]: audit 2024-09-20T22:42:21.416601+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:42:22.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:21 smithi049 bash[23528]: audit 2024-09-20T22:42:21.390130+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:42:22.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:21 smithi049 bash[23528]: audit 2024-09-20T22:42:21.396985+0000 mon.a (mon.0) 1732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:42:22.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:21 smithi049 bash[23528]: audit 2024-09-20T22:42:21.398849+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:42:22.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:21 smithi049 bash[23528]: audit 2024-09-20T22:42:21.410291+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:22.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:21 smithi049 bash[23528]: audit 2024-09-20T22:42:21.416601+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:42:22.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:42:22 smithi044 bash[22930]: debug 2024-09-20T22:42:22.179+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:42:22.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:42:22 smithi044 bash[22930]: debug 2024-09-20T22:42:22.179+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:42:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:22 smithi044 bash[22676]: audit 2024-09-20T22:42:21.419150+0000 mgr.a (mgr.14388) 1198 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:42:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:22 smithi044 bash[22676]: cluster 2024-09-20T22:42:21.512368+0000 mgr.a (mgr.14388) 1199 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:42:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:22 smithi044 bash[22676]: audit 2024-09-20T22:42:22.181970+0000 mgr.a (mgr.14388) 1200 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:42:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:22 smithi044 bash[22676]: cephadm 2024-09-20T22:42:22.183390+0000 mgr.a (mgr.14388) 1201 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:42:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:22 smithi179 bash[23186]: audit 2024-09-20T22:42:21.419150+0000 mgr.a (mgr.14388) 1198 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:42:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:22 smithi179 bash[23186]: cluster 2024-09-20T22:42:21.512368+0000 mgr.a (mgr.14388) 1199 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:42:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:22 smithi179 bash[23186]: audit 2024-09-20T22:42:22.181970+0000 mgr.a (mgr.14388) 1200 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:42:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:22 smithi179 bash[23186]: cephadm 2024-09-20T22:42:22.183390+0000 mgr.a (mgr.14388) 1201 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:42:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:22 smithi049 bash[23528]: audit 2024-09-20T22:42:21.419150+0000 mgr.a (mgr.14388) 1198 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:42:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:22 smithi049 bash[23528]: cluster 2024-09-20T22:42:21.512368+0000 mgr.a (mgr.14388) 1199 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:42:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:22 smithi049 bash[23528]: audit 2024-09-20T22:42:22.181970+0000 mgr.a (mgr.14388) 1200 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:42:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:22 smithi049 bash[23528]: cephadm 2024-09-20T22:42:22.183390+0000 mgr.a (mgr.14388) 1201 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:42:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:24 smithi044 bash[22676]: cluster 2024-09-20T22:42:23.513226+0000 mgr.a (mgr.14388) 1202 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:42:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:24 smithi179 bash[23186]: cluster 2024-09-20T22:42:23.513226+0000 mgr.a (mgr.14388) 1202 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:42:25.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:24 smithi049 bash[23528]: cluster 2024-09-20T22:42:23.513226+0000 mgr.a (mgr.14388) 1202 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:42:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:25.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:25.960 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:25.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:25.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:25.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:25.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:26 smithi044 bash[22676]: cluster 2024-09-20T22:42:25.515224+0000 mgr.a (mgr.14388) 1203 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:26 smithi044 bash[22676]: audit 2024-09-20T22:42:25.523926+0000 mgr.a (mgr.14388) 1204 : audit [DBG] from='client.38886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:26 smithi179 bash[23186]: cluster 2024-09-20T22:42:25.515224+0000 mgr.a (mgr.14388) 1203 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:26 smithi179 bash[23186]: audit 2024-09-20T22:42:25.523926+0000 mgr.a (mgr.14388) 1204 : audit [DBG] from='client.38886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:26 smithi049 bash[23528]: cluster 2024-09-20T22:42:25.515224+0000 mgr.a (mgr.14388) 1203 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:26 smithi049 bash[23528]: audit 2024-09-20T22:42:25.523926+0000 mgr.a (mgr.14388) 1204 : audit [DBG] from='client.38886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:28 smithi044 bash[22676]: cluster 2024-09-20T22:42:27.516150+0000 mgr.a (mgr.14388) 1205 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:28 smithi179 bash[23186]: cluster 2024-09-20T22:42:27.516150+0000 mgr.a (mgr.14388) 1205 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:28 smithi049 bash[23528]: cluster 2024-09-20T22:42:27.516150+0000 mgr.a (mgr.14388) 1205 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:30 smithi044 bash[22676]: cluster 2024-09-20T22:42:29.516926+0000 mgr.a (mgr.14388) 1206 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:30.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:30.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:30 smithi179 bash[23186]: cluster 2024-09-20T22:42:29.516926+0000 mgr.a (mgr.14388) 1206 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:30 smithi049 bash[23528]: cluster 2024-09-20T22:42:29.516926+0000 mgr.a (mgr.14388) 1206 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:31.735 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:31.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:31.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:31.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:31.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: audit 2024-09-20T22:42:31.305632+0000 mgr.a (mgr.14388) 1207 : audit [DBG] from='client.38958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: audit 2024-09-20T22:42:31.446934+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: audit 2024-09-20T22:42:31.452997+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: audit 2024-09-20T22:42:31.458736+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: cluster 2024-09-20T22:42:31.518138+0000 mgr.a (mgr.14388) 1208 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: audit 2024-09-20T22:42:31.821922+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: audit 2024-09-20T22:42:31.826786+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:32 smithi044 bash[22676]: audit 2024-09-20T22:42:31.836209+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: audit 2024-09-20T22:42:31.305632+0000 mgr.a (mgr.14388) 1207 : audit [DBG] from='client.38958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: audit 2024-09-20T22:42:31.446934+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: audit 2024-09-20T22:42:31.452997+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: audit 2024-09-20T22:42:31.458736+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: cluster 2024-09-20T22:42:31.518138+0000 mgr.a (mgr.14388) 1208 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: audit 2024-09-20T22:42:31.821922+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: audit 2024-09-20T22:42:31.826786+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:32 smithi179 bash[23186]: audit 2024-09-20T22:42:31.836209+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: audit 2024-09-20T22:42:31.305632+0000 mgr.a (mgr.14388) 1207 : audit [DBG] from='client.38958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: audit 2024-09-20T22:42:31.446934+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: audit 2024-09-20T22:42:31.452997+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: audit 2024-09-20T22:42:31.458736+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: cluster 2024-09-20T22:42:31.518138+0000 mgr.a (mgr.14388) 1208 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: audit 2024-09-20T22:42:31.821922+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: audit 2024-09-20T22:42:31.826786+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:32 smithi049 bash[23528]: audit 2024-09-20T22:42:31.836209+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:34.901 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:34 smithi179 bash[23186]: cluster 2024-09-20T22:42:33.518731+0000 mgr.a (mgr.14388) 1209 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:34.901 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:34 smithi179 bash[23186]: audit 2024-09-20T22:42:33.719367+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:34.901 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:34 smithi179 bash[23186]: audit 2024-09-20T22:42:33.726624+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:34.901 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:34 smithi179 bash[23186]: audit 2024-09-20T22:42:33.735298+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:34 smithi044 bash[22676]: cluster 2024-09-20T22:42:33.518731+0000 mgr.a (mgr.14388) 1209 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:34 smithi044 bash[22676]: audit 2024-09-20T22:42:33.719367+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:34 smithi044 bash[22676]: audit 2024-09-20T22:42:33.726624+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:34 smithi044 bash[22676]: audit 2024-09-20T22:42:33.735298+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:34 smithi049 bash[23528]: cluster 2024-09-20T22:42:33.518731+0000 mgr.a (mgr.14388) 1209 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:42:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:34 smithi049 bash[23528]: audit 2024-09-20T22:42:33.719367+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:34 smithi049 bash[23528]: audit 2024-09-20T22:42:33.726624+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:34 smithi049 bash[23528]: audit 2024-09-20T22:42:33.735298+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:36.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:36 smithi044 bash[22676]: cluster 2024-09-20T22:42:35.520834+0000 mgr.a (mgr.14388) 1210 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:36 smithi179 bash[23186]: cluster 2024-09-20T22:42:35.520834+0000 mgr.a (mgr.14388) 1210 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:36 smithi049 bash[23528]: cluster 2024-09-20T22:42:35.520834+0000 mgr.a (mgr.14388) 1210 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:42:37.493 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:37 smithi044 bash[22676]: audit 2024-09-20T22:42:37.071985+0000 mgr.a (mgr.14388) 1211 : audit [DBG] from='client.39036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:37 smithi179 bash[23186]: audit 2024-09-20T22:42:37.071985+0000 mgr.a (mgr.14388) 1211 : audit [DBG] from='client.39036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:37 smithi049 bash[23528]: audit 2024-09-20T22:42:37.071985+0000 mgr.a (mgr.14388) 1211 : audit [DBG] from='client.39036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:38 smithi044 bash[22676]: cluster 2024-09-20T22:42:37.521455+0000 mgr.a (mgr.14388) 1212 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:38 smithi179 bash[23186]: cluster 2024-09-20T22:42:37.521455+0000 mgr.a (mgr.14388) 1212 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:38 smithi049 bash[23528]: cluster 2024-09-20T22:42:37.521455+0000 mgr.a (mgr.14388) 1212 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:40 smithi179 bash[23186]: cluster 2024-09-20T22:42:39.522252+0000 mgr.a (mgr.14388) 1213 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:41.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:40 smithi049 bash[23528]: cluster 2024-09-20T22:42:39.522252+0000 mgr.a (mgr.14388) 1213 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:40 smithi044 bash[22676]: cluster 2024-09-20T22:42:39.522252+0000 mgr.a (mgr.14388) 1213 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:42.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:42.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:42.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:42 smithi179 bash[23186]: cluster 2024-09-20T22:42:41.524539+0000 mgr.a (mgr.14388) 1214 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:43.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:42 smithi049 bash[23528]: cluster 2024-09-20T22:42:41.524539+0000 mgr.a (mgr.14388) 1214 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:42 smithi044 bash[22676]: cluster 2024-09-20T22:42:41.524539+0000 mgr.a (mgr.14388) 1214 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:43.280 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:43.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:43.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:43.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:43.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:43 smithi179 bash[23186]: audit 2024-09-20T22:42:42.832163+0000 mgr.a (mgr.14388) 1215 : audit [DBG] from='client.39114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:44.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:43 smithi049 bash[23528]: audit 2024-09-20T22:42:42.832163+0000 mgr.a (mgr.14388) 1215 : audit [DBG] from='client.39114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:43 smithi044 bash[22676]: audit 2024-09-20T22:42:42.832163+0000 mgr.a (mgr.14388) 1215 : audit [DBG] from='client.39114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:44 smithi049 bash[23528]: cluster 2024-09-20T22:42:43.525514+0000 mgr.a (mgr.14388) 1216 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:44 smithi044 bash[22676]: cluster 2024-09-20T22:42:43.525514+0000 mgr.a (mgr.14388) 1216 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:44 smithi179 bash[23186]: cluster 2024-09-20T22:42:43.525514+0000 mgr.a (mgr.14388) 1216 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:47.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:46 smithi049 bash[23528]: cluster 2024-09-20T22:42:45.527687+0000 mgr.a (mgr.14388) 1217 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:46 smithi044 bash[22676]: cluster 2024-09-20T22:42:45.527687+0000 mgr.a (mgr.14388) 1217 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:46 smithi179 bash[23186]: cluster 2024-09-20T22:42:45.527687+0000 mgr.a (mgr.14388) 1217 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:48.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:48.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:48.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:49.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:48 smithi049 bash[23528]: cluster 2024-09-20T22:42:47.528435+0000 mgr.a (mgr.14388) 1218 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:49.058 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:49.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:49.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:49.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:49.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:48 smithi044 bash[22676]: cluster 2024-09-20T22:42:47.528435+0000 mgr.a (mgr.14388) 1218 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:49.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:48 smithi179 bash[23186]: cluster 2024-09-20T22:42:47.528435+0000 mgr.a (mgr.14388) 1218 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:49 smithi049 bash[23528]: audit 2024-09-20T22:42:48.618446+0000 mgr.a (mgr.14388) 1219 : audit [DBG] from='client.39186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:49 smithi044 bash[22676]: audit 2024-09-20T22:42:48.618446+0000 mgr.a (mgr.14388) 1219 : audit [DBG] from='client.39186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:49 smithi179 bash[23186]: audit 2024-09-20T22:42:48.618446+0000 mgr.a (mgr.14388) 1219 : audit [DBG] from='client.39186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:50 smithi049 bash[23528]: cluster 2024-09-20T22:42:49.529337+0000 mgr.a (mgr.14388) 1220 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:51.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:50 smithi044 bash[22676]: cluster 2024-09-20T22:42:49.529337+0000 mgr.a (mgr.14388) 1220 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:50 smithi179 bash[23186]: cluster 2024-09-20T22:42:49.529337+0000 mgr.a (mgr.14388) 1220 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:52 smithi044 bash[22676]: cluster 2024-09-20T22:42:51.531512+0000 mgr.a (mgr.14388) 1221 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:52 smithi044 bash[22676]: audit 2024-09-20T22:42:51.667914+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:52 smithi044 bash[22676]: audit 2024-09-20T22:42:51.676311+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:52 smithi044 bash[22676]: audit 2024-09-20T22:42:51.686761+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:52 smithi044 bash[22676]: audit 2024-09-20T22:42:52.027582+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:52 smithi044 bash[22676]: audit 2024-09-20T22:42:52.033859+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:52 smithi044 bash[22676]: audit 2024-09-20T22:42:52.054685+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:52 smithi179 bash[23186]: cluster 2024-09-20T22:42:51.531512+0000 mgr.a (mgr.14388) 1221 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:52 smithi179 bash[23186]: audit 2024-09-20T22:42:51.667914+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:52 smithi179 bash[23186]: audit 2024-09-20T22:42:51.676311+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:52 smithi179 bash[23186]: audit 2024-09-20T22:42:51.686761+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:52 smithi179 bash[23186]: audit 2024-09-20T22:42:52.027582+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:52 smithi179 bash[23186]: audit 2024-09-20T22:42:52.033859+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:52 smithi179 bash[23186]: audit 2024-09-20T22:42:52.054685+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:52 smithi049 bash[23528]: cluster 2024-09-20T22:42:51.531512+0000 mgr.a (mgr.14388) 1221 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:52 smithi049 bash[23528]: audit 2024-09-20T22:42:51.667914+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:52 smithi049 bash[23528]: audit 2024-09-20T22:42:51.676311+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:52 smithi049 bash[23528]: audit 2024-09-20T22:42:51.686761+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:52 smithi049 bash[23528]: audit 2024-09-20T22:42:52.027582+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:52 smithi049 bash[23528]: audit 2024-09-20T22:42:52.033859+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:52 smithi049 bash[23528]: audit 2024-09-20T22:42:52.054685+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:54.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:54.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:42:54.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:54.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:42:54.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:42:54.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:42:54.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:42:54.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:42:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:54 smithi044 bash[22676]: cluster 2024-09-20T22:42:53.531994+0000 mgr.a (mgr.14388) 1222 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:54 smithi044 bash[22676]: audit 2024-09-20T22:42:53.936630+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:54 smithi044 bash[22676]: audit 2024-09-20T22:42:53.943271+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:54 smithi044 bash[22676]: audit 2024-09-20T22:42:53.953576+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:54 smithi179 bash[23186]: cluster 2024-09-20T22:42:53.531994+0000 mgr.a (mgr.14388) 1222 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:54 smithi179 bash[23186]: audit 2024-09-20T22:42:53.936630+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:54 smithi179 bash[23186]: audit 2024-09-20T22:42:53.943271+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:54 smithi179 bash[23186]: audit 2024-09-20T22:42:53.953576+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:54 smithi049 bash[23528]: cluster 2024-09-20T22:42:53.531994+0000 mgr.a (mgr.14388) 1222 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:55.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:54 smithi049 bash[23528]: audit 2024-09-20T22:42:53.936630+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:54 smithi049 bash[23528]: audit 2024-09-20T22:42:53.943271+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:55.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:54 smithi049 bash[23528]: audit 2024-09-20T22:42:53.953576+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:42:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:55 smithi044 bash[22676]: audit 2024-09-20T22:42:54.388123+0000 mgr.a (mgr.14388) 1223 : audit [DBG] from='client.39261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:55 smithi179 bash[23186]: audit 2024-09-20T22:42:54.388123+0000 mgr.a (mgr.14388) 1223 : audit [DBG] from='client.39261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:55 smithi049 bash[23528]: audit 2024-09-20T22:42:54.388123+0000 mgr.a (mgr.14388) 1223 : audit [DBG] from='client.39261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:42:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:56 smithi044 bash[22676]: cluster 2024-09-20T22:42:55.534238+0000 mgr.a (mgr.14388) 1224 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:56 smithi179 bash[23186]: cluster 2024-09-20T22:42:55.534238+0000 mgr.a (mgr.14388) 1224 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:56 smithi049 bash[23528]: cluster 2024-09-20T22:42:55.534238+0000 mgr.a (mgr.14388) 1224 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:42:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:42:58 smithi044 bash[22676]: cluster 2024-09-20T22:42:57.535145+0000 mgr.a (mgr.14388) 1225 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:42:58 smithi179 bash[23186]: cluster 2024-09-20T22:42:57.535145+0000 mgr.a (mgr.14388) 1225 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:42:58 smithi049 bash[23528]: cluster 2024-09-20T22:42:57.535145+0000 mgr.a (mgr.14388) 1225 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:42:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:42:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:42:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:00.593 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:00.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:00 smithi044 bash[22676]: cluster 2024-09-20T22:42:59.536038+0000 mgr.a (mgr.14388) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:00 smithi044 bash[22676]: audit 2024-09-20T22:43:00.142420+0000 mgr.a (mgr.14388) 1227 : audit [DBG] from='client.39333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:00 smithi179 bash[23186]: cluster 2024-09-20T22:42:59.536038+0000 mgr.a (mgr.14388) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:00 smithi179 bash[23186]: audit 2024-09-20T22:43:00.142420+0000 mgr.a (mgr.14388) 1227 : audit [DBG] from='client.39333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:00 smithi049 bash[23528]: cluster 2024-09-20T22:42:59.536038+0000 mgr.a (mgr.14388) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:00 smithi049 bash[23528]: audit 2024-09-20T22:43:00.142420+0000 mgr.a (mgr.14388) 1227 : audit [DBG] from='client.39333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:02 smithi044 bash[22676]: cluster 2024-09-20T22:43:01.538877+0000 mgr.a (mgr.14388) 1228 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:02 smithi179 bash[23186]: cluster 2024-09-20T22:43:01.538877+0000 mgr.a (mgr.14388) 1228 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:02 smithi049 bash[23528]: cluster 2024-09-20T22:43:01.538877+0000 mgr.a (mgr.14388) 1228 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:04 smithi044 bash[22676]: cluster 2024-09-20T22:43:03.539719+0000 mgr.a (mgr.14388) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:04 smithi179 bash[23186]: cluster 2024-09-20T22:43:03.539719+0000 mgr.a (mgr.14388) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:04 smithi049 bash[23528]: cluster 2024-09-20T22:43:03.539719+0000 mgr.a (mgr.14388) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:05.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:05.595 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:05.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:06.338 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:06.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:06.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:06.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:06.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:06 smithi044 bash[22676]: cluster 2024-09-20T22:43:05.541682+0000 mgr.a (mgr.14388) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:06 smithi044 bash[22676]: audit 2024-09-20T22:43:05.926049+0000 mgr.a (mgr.14388) 1231 : audit [DBG] from='client.39408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:06 smithi179 bash[23186]: cluster 2024-09-20T22:43:05.541682+0000 mgr.a (mgr.14388) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:06 smithi179 bash[23186]: audit 2024-09-20T22:43:05.926049+0000 mgr.a (mgr.14388) 1231 : audit [DBG] from='client.39408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:06 smithi049 bash[23528]: cluster 2024-09-20T22:43:05.541682+0000 mgr.a (mgr.14388) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:06 smithi049 bash[23528]: audit 2024-09-20T22:43:05.926049+0000 mgr.a (mgr.14388) 1231 : audit [DBG] from='client.39408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:08 smithi044 bash[22676]: cluster 2024-09-20T22:43:07.542523+0000 mgr.a (mgr.14388) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:08 smithi179 bash[23186]: cluster 2024-09-20T22:43:07.542523+0000 mgr.a (mgr.14388) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:08 smithi049 bash[23528]: cluster 2024-09-20T22:43:07.542523+0000 mgr.a (mgr.14388) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:10 smithi044 bash[22676]: cluster 2024-09-20T22:43:09.543316+0000 mgr.a (mgr.14388) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:43:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:10 smithi179 bash[23186]: cluster 2024-09-20T22:43:09.543316+0000 mgr.a (mgr.14388) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:43:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:10 smithi049 bash[23528]: cluster 2024-09-20T22:43:09.543316+0000 mgr.a (mgr.14388) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:43:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:11.341 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:12.106 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:12.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:12.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:12.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:12.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: cluster 2024-09-20T22:43:11.545462+0000 mgr.a (mgr.14388) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: audit 2024-09-20T22:43:11.679934+0000 mgr.a (mgr.14388) 1235 : audit [DBG] from='client.39486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: audit 2024-09-20T22:43:11.880717+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: audit 2024-09-20T22:43:11.886712+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: audit 2024-09-20T22:43:11.893506+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: audit 2024-09-20T22:43:12.224654+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: audit 2024-09-20T22:43:12.232261+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:12 smithi044 bash[22676]: audit 2024-09-20T22:43:12.241413+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: cluster 2024-09-20T22:43:11.545462+0000 mgr.a (mgr.14388) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: audit 2024-09-20T22:43:11.679934+0000 mgr.a (mgr.14388) 1235 : audit [DBG] from='client.39486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: audit 2024-09-20T22:43:11.880717+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: audit 2024-09-20T22:43:11.886712+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: audit 2024-09-20T22:43:11.893506+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: audit 2024-09-20T22:43:12.224654+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: audit 2024-09-20T22:43:12.232261+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:12 smithi179 bash[23186]: audit 2024-09-20T22:43:12.241413+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: cluster 2024-09-20T22:43:11.545462+0000 mgr.a (mgr.14388) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: audit 2024-09-20T22:43:11.679934+0000 mgr.a (mgr.14388) 1235 : audit [DBG] from='client.39486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: audit 2024-09-20T22:43:11.880717+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: audit 2024-09-20T22:43:11.886712+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: audit 2024-09-20T22:43:11.893506+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: audit 2024-09-20T22:43:12.224654+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: audit 2024-09-20T22:43:12.232261+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:12 smithi049 bash[23528]: audit 2024-09-20T22:43:12.241413+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.455 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:15 smithi179 bash[23186]: cluster 2024-09-20T22:43:13.546398+0000 mgr.a (mgr.14388) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:15.455 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:15 smithi179 bash[23186]: audit 2024-09-20T22:43:14.117599+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:15 smithi179 bash[23186]: audit 2024-09-20T22:43:14.122842+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:15 smithi179 bash[23186]: audit 2024-09-20T22:43:14.129873+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:15 smithi044 bash[22676]: cluster 2024-09-20T22:43:13.546398+0000 mgr.a (mgr.14388) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:15 smithi044 bash[22676]: audit 2024-09-20T22:43:14.117599+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:15 smithi044 bash[22676]: audit 2024-09-20T22:43:14.122842+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:15 smithi044 bash[22676]: audit 2024-09-20T22:43:14.129873+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:15 smithi049 bash[23528]: cluster 2024-09-20T22:43:13.546398+0000 mgr.a (mgr.14388) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:15 smithi049 bash[23528]: audit 2024-09-20T22:43:14.117599+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:15 smithi049 bash[23528]: audit 2024-09-20T22:43:14.122842+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:15 smithi049 bash[23528]: audit 2024-09-20T22:43:14.129873+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:17.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:17.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:17.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:17 smithi049 bash[23528]: cluster 2024-09-20T22:43:15.548744+0000 mgr.a (mgr.14388) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:17.394 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:17 smithi179 bash[23186]: cluster 2024-09-20T22:43:15.548744+0000 mgr.a (mgr.14388) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:17 smithi044 bash[22676]: cluster 2024-09-20T22:43:15.548744+0000 mgr.a (mgr.14388) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:17.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:17.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:17.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:17.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:17.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:19 smithi044 bash[22676]: audit 2024-09-20T22:43:17.439291+0000 mgr.a (mgr.14388) 1238 : audit [DBG] from='client.39561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:19 smithi044 bash[22676]: cluster 2024-09-20T22:43:17.549359+0000 mgr.a (mgr.14388) 1239 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:19 smithi179 bash[23186]: audit 2024-09-20T22:43:17.439291+0000 mgr.a (mgr.14388) 1238 : audit [DBG] from='client.39561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:19 smithi179 bash[23186]: cluster 2024-09-20T22:43:17.549359+0000 mgr.a (mgr.14388) 1239 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:19 smithi049 bash[23528]: audit 2024-09-20T22:43:17.439291+0000 mgr.a (mgr.14388) 1238 : audit [DBG] from='client.39561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:19 smithi049 bash[23528]: cluster 2024-09-20T22:43:17.549359+0000 mgr.a (mgr.14388) 1239 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:21 smithi044 bash[22676]: cluster 2024-09-20T22:43:19.550308+0000 mgr.a (mgr.14388) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:21 smithi179 bash[23186]: cluster 2024-09-20T22:43:19.550308+0000 mgr.a (mgr.14388) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:21 smithi049 bash[23528]: cluster 2024-09-20T22:43:19.550308+0000 mgr.a (mgr.14388) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:22.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:22.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:22.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:23 smithi049 bash[23528]: cluster 2024-09-20T22:43:21.552548+0000 mgr.a (mgr.14388) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:23 smithi049 bash[23528]: audit 2024-09-20T22:43:22.247510+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:43:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:23 smithi049 bash[23528]: audit 2024-09-20T22:43:22.254277+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:43:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:23 smithi049 bash[23528]: audit 2024-09-20T22:43:22.256113+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:43:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:23 smithi049 bash[23528]: audit 2024-09-20T22:43:22.267662+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:23 smithi049 bash[23528]: audit 2024-09-20T22:43:22.274123+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:43:23.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22930]: debug 2024-09-20T22:43:23.025+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:43:23.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22930]: debug 2024-09-20T22:43:23.029+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:43:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22676]: cluster 2024-09-20T22:43:21.552548+0000 mgr.a (mgr.14388) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22676]: audit 2024-09-20T22:43:22.247510+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:43:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22676]: audit 2024-09-20T22:43:22.254277+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:43:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22676]: audit 2024-09-20T22:43:22.256113+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:43:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22676]: audit 2024-09-20T22:43:22.267662+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:23 smithi044 bash[22676]: audit 2024-09-20T22:43:22.274123+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:43:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:23 smithi179 bash[23186]: cluster 2024-09-20T22:43:21.552548+0000 mgr.a (mgr.14388) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:23 smithi179 bash[23186]: audit 2024-09-20T22:43:22.247510+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:43:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:23 smithi179 bash[23186]: audit 2024-09-20T22:43:22.254277+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:43:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:23 smithi179 bash[23186]: audit 2024-09-20T22:43:22.256113+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:43:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:23 smithi179 bash[23186]: audit 2024-09-20T22:43:22.267662+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:23 smithi179 bash[23186]: audit 2024-09-20T22:43:22.274123+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:43:23.586 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:23.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:23.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:23.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:23.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:24 smithi044 bash[22676]: audit 2024-09-20T22:43:22.276497+0000 mgr.a (mgr.14388) 1242 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:43:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:24 smithi044 bash[22676]: audit 2024-09-20T22:43:23.032582+0000 mgr.a (mgr.14388) 1243 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:43:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:24 smithi044 bash[22676]: cephadm 2024-09-20T22:43:23.033868+0000 mgr.a (mgr.14388) 1244 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:43:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:24 smithi044 bash[22676]: audit 2024-09-20T22:43:23.174261+0000 mgr.a (mgr.14388) 1245 : audit [DBG] from='client.39744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:24 smithi179 bash[23186]: audit 2024-09-20T22:43:22.276497+0000 mgr.a (mgr.14388) 1242 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:43:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:24 smithi179 bash[23186]: audit 2024-09-20T22:43:23.032582+0000 mgr.a (mgr.14388) 1243 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:43:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:24 smithi179 bash[23186]: cephadm 2024-09-20T22:43:23.033868+0000 mgr.a (mgr.14388) 1244 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:43:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:24 smithi179 bash[23186]: audit 2024-09-20T22:43:23.174261+0000 mgr.a (mgr.14388) 1245 : audit [DBG] from='client.39744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:24.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:24 smithi049 bash[23528]: audit 2024-09-20T22:43:22.276497+0000 mgr.a (mgr.14388) 1242 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:43:24.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:24 smithi049 bash[23528]: audit 2024-09-20T22:43:23.032582+0000 mgr.a (mgr.14388) 1243 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:43:24.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:24 smithi049 bash[23528]: cephadm 2024-09-20T22:43:23.033868+0000 mgr.a (mgr.14388) 1244 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:43:24.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:24 smithi049 bash[23528]: audit 2024-09-20T22:43:23.174261+0000 mgr.a (mgr.14388) 1245 : audit [DBG] from='client.39744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:25 smithi044 bash[22676]: cluster 2024-09-20T22:43:23.553083+0000 mgr.a (mgr.14388) 1246 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:25 smithi179 bash[23186]: cluster 2024-09-20T22:43:23.553083+0000 mgr.a (mgr.14388) 1246 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:25.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:25 smithi049 bash[23528]: cluster 2024-09-20T22:43:23.553083+0000 mgr.a (mgr.14388) 1246 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:27 smithi044 bash[22676]: cluster 2024-09-20T22:43:25.555237+0000 mgr.a (mgr.14388) 1247 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:27 smithi179 bash[23186]: cluster 2024-09-20T22:43:25.555237+0000 mgr.a (mgr.14388) 1247 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:27.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:27 smithi049 bash[23528]: cluster 2024-09-20T22:43:25.555237+0000 mgr.a (mgr.14388) 1247 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:28.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:28.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:28.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:29.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:29.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:29.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:29.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:29 smithi044 bash[22676]: cluster 2024-09-20T22:43:27.556007+0000 mgr.a (mgr.14388) 1248 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:29 smithi179 bash[23186]: cluster 2024-09-20T22:43:27.556007+0000 mgr.a (mgr.14388) 1248 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:29.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:29 smithi049 bash[23528]: cluster 2024-09-20T22:43:27.556007+0000 mgr.a (mgr.14388) 1248 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:30 smithi044 bash[22676]: audit 2024-09-20T22:43:28.918723+0000 mgr.a (mgr.14388) 1249 : audit [DBG] from='client.39822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:30 smithi179 bash[23186]: audit 2024-09-20T22:43:28.918723+0000 mgr.a (mgr.14388) 1249 : audit [DBG] from='client.39822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:30.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:30 smithi049 bash[23528]: audit 2024-09-20T22:43:28.918723+0000 mgr.a (mgr.14388) 1249 : audit [DBG] from='client.39822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:31 smithi044 bash[22676]: cluster 2024-09-20T22:43:29.556941+0000 mgr.a (mgr.14388) 1250 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:31 smithi179 bash[23186]: cluster 2024-09-20T22:43:29.556941+0000 mgr.a (mgr.14388) 1250 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:31 smithi049 bash[23528]: cluster 2024-09-20T22:43:29.556941+0000 mgr.a (mgr.14388) 1250 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:33.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:33 smithi044 bash[22676]: cluster 2024-09-20T22:43:31.559204+0000 mgr.a (mgr.14388) 1251 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:33.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:33 smithi044 bash[22676]: audit 2024-09-20T22:43:32.089006+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:33 smithi044 bash[22676]: audit 2024-09-20T22:43:32.098152+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:33 smithi044 bash[22676]: audit 2024-09-20T22:43:32.108663+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:33 smithi044 bash[22676]: audit 2024-09-20T22:43:32.460872+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:33 smithi044 bash[22676]: audit 2024-09-20T22:43:32.469531+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:33 smithi044 bash[22676]: audit 2024-09-20T22:43:32.479383+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:33 smithi179 bash[23186]: cluster 2024-09-20T22:43:31.559204+0000 mgr.a (mgr.14388) 1251 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:33 smithi179 bash[23186]: audit 2024-09-20T22:43:32.089006+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:33 smithi179 bash[23186]: audit 2024-09-20T22:43:32.098152+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:33 smithi179 bash[23186]: audit 2024-09-20T22:43:32.108663+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:33 smithi179 bash[23186]: audit 2024-09-20T22:43:32.460872+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:33 smithi179 bash[23186]: audit 2024-09-20T22:43:32.469531+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:33 smithi179 bash[23186]: audit 2024-09-20T22:43:32.479383+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:33 smithi049 bash[23528]: cluster 2024-09-20T22:43:31.559204+0000 mgr.a (mgr.14388) 1251 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:33 smithi049 bash[23528]: audit 2024-09-20T22:43:32.089006+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:33 smithi049 bash[23528]: audit 2024-09-20T22:43:32.098152+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:33 smithi049 bash[23528]: audit 2024-09-20T22:43:32.108663+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:33 smithi049 bash[23528]: audit 2024-09-20T22:43:32.460872+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:33 smithi049 bash[23528]: audit 2024-09-20T22:43:32.469531+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:33 smithi049 bash[23528]: audit 2024-09-20T22:43:32.479383+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:35.098 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:35.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:35.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:35 smithi044 bash[22676]: cluster 2024-09-20T22:43:33.560122+0000 mgr.a (mgr.14388) 1252 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:35.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:35 smithi044 bash[22676]: audit 2024-09-20T22:43:34.296559+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:35 smithi044 bash[22676]: audit 2024-09-20T22:43:34.301374+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:35 smithi044 bash[22676]: audit 2024-09-20T22:43:34.308916+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:35 smithi179 bash[23186]: cluster 2024-09-20T22:43:33.560122+0000 mgr.a (mgr.14388) 1252 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:35 smithi179 bash[23186]: audit 2024-09-20T22:43:34.296559+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:35 smithi179 bash[23186]: audit 2024-09-20T22:43:34.301374+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:35 smithi179 bash[23186]: audit 2024-09-20T22:43:34.308916+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:35 smithi049 bash[23528]: cluster 2024-09-20T22:43:33.560122+0000 mgr.a (mgr.14388) 1252 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:35.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:35 smithi049 bash[23528]: audit 2024-09-20T22:43:34.296559+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:35 smithi049 bash[23528]: audit 2024-09-20T22:43:34.301374+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:35.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:35 smithi049 bash[23528]: audit 2024-09-20T22:43:34.308916+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:36 smithi179 bash[23186]: audit 2024-09-20T22:43:34.660758+0000 mgr.a (mgr.14388) 1253 : audit [DBG] from='client.39900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:36 smithi044 bash[22676]: audit 2024-09-20T22:43:34.660758+0000 mgr.a (mgr.14388) 1253 : audit [DBG] from='client.39900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:36 smithi049 bash[23528]: audit 2024-09-20T22:43:34.660758+0000 mgr.a (mgr.14388) 1253 : audit [DBG] from='client.39900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:37.408 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:37 smithi049 bash[23528]: cluster 2024-09-20T22:43:35.562674+0000 mgr.a (mgr.14388) 1254 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:37 smithi044 bash[22676]: cluster 2024-09-20T22:43:35.562674+0000 mgr.a (mgr.14388) 1254 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:37 smithi179 bash[23186]: cluster 2024-09-20T22:43:35.562674+0000 mgr.a (mgr.14388) 1254 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:43:39.438 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:39 smithi049 bash[23528]: cluster 2024-09-20T22:43:37.563443+0000 mgr.a (mgr.14388) 1255 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:43:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:39 smithi044 bash[22676]: cluster 2024-09-20T22:43:37.563443+0000 mgr.a (mgr.14388) 1255 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:43:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:39 smithi179 bash[23186]: cluster 2024-09-20T22:43:37.563443+0000 mgr.a (mgr.14388) 1255 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:43:40.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:40.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:40.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:40.869 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:40.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:41 smithi044 bash[22676]: cluster 2024-09-20T22:43:39.564225+0000 mgr.a (mgr.14388) 1256 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:43:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:41 smithi179 bash[23186]: cluster 2024-09-20T22:43:39.564225+0000 mgr.a (mgr.14388) 1256 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:43:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:41 smithi049 bash[23528]: cluster 2024-09-20T22:43:39.564225+0000 mgr.a (mgr.14388) 1256 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:43:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:42 smithi044 bash[22676]: audit 2024-09-20T22:43:40.438604+0000 mgr.a (mgr.14388) 1257 : audit [DBG] from='client.39978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:42 smithi179 bash[23186]: audit 2024-09-20T22:43:40.438604+0000 mgr.a (mgr.14388) 1257 : audit [DBG] from='client.39978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:42.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:42 smithi049 bash[23528]: audit 2024-09-20T22:43:40.438604+0000 mgr.a (mgr.14388) 1257 : audit [DBG] from='client.39978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:43 smithi044 bash[22676]: cluster 2024-09-20T22:43:41.567079+0000 mgr.a (mgr.14388) 1258 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:43 smithi179 bash[23186]: cluster 2024-09-20T22:43:41.567079+0000 mgr.a (mgr.14388) 1258 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:43.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:43 smithi049 bash[23528]: cluster 2024-09-20T22:43:41.567079+0000 mgr.a (mgr.14388) 1258 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:45 smithi044 bash[22676]: cluster 2024-09-20T22:43:43.567893+0000 mgr.a (mgr.14388) 1259 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:45 smithi179 bash[23186]: cluster 2024-09-20T22:43:43.567893+0000 mgr.a (mgr.14388) 1259 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:45 smithi049 bash[23528]: cluster 2024-09-20T22:43:43.567893+0000 mgr.a (mgr.14388) 1259 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:43:45.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:45.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:45.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:46.617 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:47 smithi044 bash[22676]: cluster 2024-09-20T22:43:45.569902+0000 mgr.a (mgr.14388) 1260 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:47 smithi044 bash[22676]: audit 2024-09-20T22:43:46.202553+0000 mgr.a (mgr.14388) 1261 : audit [DBG] from='client.40053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:47 smithi179 bash[23186]: cluster 2024-09-20T22:43:45.569902+0000 mgr.a (mgr.14388) 1260 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:47 smithi179 bash[23186]: audit 2024-09-20T22:43:46.202553+0000 mgr.a (mgr.14388) 1261 : audit [DBG] from='client.40053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:47 smithi049 bash[23528]: cluster 2024-09-20T22:43:45.569902+0000 mgr.a (mgr.14388) 1260 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:47 smithi049 bash[23528]: audit 2024-09-20T22:43:46.202553+0000 mgr.a (mgr.14388) 1261 : audit [DBG] from='client.40053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:49 smithi044 bash[22676]: cluster 2024-09-20T22:43:47.570999+0000 mgr.a (mgr.14388) 1262 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:43:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:49 smithi179 bash[23186]: cluster 2024-09-20T22:43:47.570999+0000 mgr.a (mgr.14388) 1262 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:43:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:49 smithi049 bash[23528]: cluster 2024-09-20T22:43:47.570999+0000 mgr.a (mgr.14388) 1262 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:43:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:51 smithi044 bash[22676]: cluster 2024-09-20T22:43:49.571997+0000 mgr.a (mgr.14388) 1263 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:43:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:51 smithi179 bash[23186]: cluster 2024-09-20T22:43:49.571997+0000 mgr.a (mgr.14388) 1263 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:43:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:51 smithi049 bash[23528]: cluster 2024-09-20T22:43:49.571997+0000 mgr.a (mgr.14388) 1263 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:43:51.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:51.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:51.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:52.404 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:52.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:52.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:52.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:52.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: cluster 2024-09-20T22:43:51.574300+0000 mgr.a (mgr.14388) 1264 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: audit 2024-09-20T22:43:51.956509+0000 mgr.a (mgr.14388) 1265 : audit [DBG] from='client.40128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: audit 2024-09-20T22:43:52.311073+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: audit 2024-09-20T22:43:52.319843+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: audit 2024-09-20T22:43:52.328376+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: audit 2024-09-20T22:43:52.667334+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: audit 2024-09-20T22:43:52.676455+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:53 smithi044 bash[22676]: audit 2024-09-20T22:43:52.686985+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: cluster 2024-09-20T22:43:51.574300+0000 mgr.a (mgr.14388) 1264 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: audit 2024-09-20T22:43:51.956509+0000 mgr.a (mgr.14388) 1265 : audit [DBG] from='client.40128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: audit 2024-09-20T22:43:52.311073+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: audit 2024-09-20T22:43:52.319843+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: audit 2024-09-20T22:43:52.328376+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: audit 2024-09-20T22:43:52.667334+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: audit 2024-09-20T22:43:52.676455+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:53 smithi179 bash[23186]: audit 2024-09-20T22:43:52.686985+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: cluster 2024-09-20T22:43:51.574300+0000 mgr.a (mgr.14388) 1264 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:43:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: audit 2024-09-20T22:43:51.956509+0000 mgr.a (mgr.14388) 1265 : audit [DBG] from='client.40128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: audit 2024-09-20T22:43:52.311073+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: audit 2024-09-20T22:43:52.319843+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: audit 2024-09-20T22:43:52.328376+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: audit 2024-09-20T22:43:52.667334+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: audit 2024-09-20T22:43:52.676455+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:53 smithi049 bash[23528]: audit 2024-09-20T22:43:52.686985+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:55 smithi044 bash[22676]: cluster 2024-09-20T22:43:53.575231+0000 mgr.a (mgr.14388) 1266 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:55.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:55 smithi044 bash[22676]: audit 2024-09-20T22:43:54.493360+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:55 smithi044 bash[22676]: audit 2024-09-20T22:43:54.501989+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:55 smithi044 bash[22676]: audit 2024-09-20T22:43:54.512150+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:55 smithi179 bash[23186]: cluster 2024-09-20T22:43:53.575231+0000 mgr.a (mgr.14388) 1266 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:55 smithi179 bash[23186]: audit 2024-09-20T22:43:54.493360+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:55 smithi179 bash[23186]: audit 2024-09-20T22:43:54.501989+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:55 smithi179 bash[23186]: audit 2024-09-20T22:43:54.512150+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:55 smithi049 bash[23528]: cluster 2024-09-20T22:43:53.575231+0000 mgr.a (mgr.14388) 1266 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:55 smithi049 bash[23528]: audit 2024-09-20T22:43:54.493360+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:55 smithi049 bash[23528]: audit 2024-09-20T22:43:54.501989+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:55 smithi049 bash[23528]: audit 2024-09-20T22:43:54.512150+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:43:57.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:43:57.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:43:57.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:43:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:57 smithi044 bash[22676]: cluster 2024-09-20T22:43:55.576339+0000 mgr.a (mgr.14388) 1267 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:57 smithi179 bash[23186]: cluster 2024-09-20T22:43:55.576339+0000 mgr.a (mgr.14388) 1267 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:57 smithi049 bash[23528]: cluster 2024-09-20T22:43:55.576339+0000 mgr.a (mgr.14388) 1267 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:43:58.187 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:43:58.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:43:58.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:43:58.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:43:58.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:43:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:59 smithi044 bash[22676]: cluster 2024-09-20T22:43:57.577068+0000 mgr.a (mgr.14388) 1268 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:43:59 smithi044 bash[22676]: audit 2024-09-20T22:43:57.741882+0000 mgr.a (mgr.14388) 1269 : audit [DBG] from='client.40206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:59 smithi179 bash[23186]: cluster 2024-09-20T22:43:57.577068+0000 mgr.a (mgr.14388) 1268 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:43:59 smithi179 bash[23186]: audit 2024-09-20T22:43:57.741882+0000 mgr.a (mgr.14388) 1269 : audit [DBG] from='client.40206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:43:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:59 smithi049 bash[23528]: cluster 2024-09-20T22:43:57.577068+0000 mgr.a (mgr.14388) 1268 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:43:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:43:59 smithi049 bash[23528]: audit 2024-09-20T22:43:57.741882+0000 mgr.a (mgr.14388) 1269 : audit [DBG] from='client.40206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:01 smithi044 bash[22676]: cluster 2024-09-20T22:43:59.578201+0000 mgr.a (mgr.14388) 1270 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:01 smithi179 bash[23186]: cluster 2024-09-20T22:43:59.578201+0000 mgr.a (mgr.14388) 1270 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:01 smithi049 bash[23528]: cluster 2024-09-20T22:43:59.578201+0000 mgr.a (mgr.14388) 1270 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:03.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:03.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:03 smithi044 bash[22676]: cluster 2024-09-20T22:44:01.580599+0000 mgr.a (mgr.14388) 1271 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:03 smithi179 bash[23186]: cluster 2024-09-20T22:44:01.580599+0000 mgr.a (mgr.14388) 1271 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:03 smithi049 bash[23528]: cluster 2024-09-20T22:44:01.580599+0000 mgr.a (mgr.14388) 1271 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:03.973 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:03.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:03.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:03.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:03.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:05 smithi044 bash[22676]: audit 2024-09-20T22:44:03.523129+0000 mgr.a (mgr.14388) 1272 : audit [DBG] from='client.40281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:05 smithi044 bash[22676]: cluster 2024-09-20T22:44:03.581353+0000 mgr.a (mgr.14388) 1273 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:05 smithi179 bash[23186]: audit 2024-09-20T22:44:03.523129+0000 mgr.a (mgr.14388) 1272 : audit [DBG] from='client.40281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:05 smithi179 bash[23186]: cluster 2024-09-20T22:44:03.581353+0000 mgr.a (mgr.14388) 1273 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:05 smithi049 bash[23528]: audit 2024-09-20T22:44:03.523129+0000 mgr.a (mgr.14388) 1272 : audit [DBG] from='client.40281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:05 smithi049 bash[23528]: cluster 2024-09-20T22:44:03.581353+0000 mgr.a (mgr.14388) 1273 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:07 smithi044 bash[22676]: cluster 2024-09-20T22:44:05.583652+0000 mgr.a (mgr.14388) 1274 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:07 smithi179 bash[23186]: cluster 2024-09-20T22:44:05.583652+0000 mgr.a (mgr.14388) 1274 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:07.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:07 smithi049 bash[23528]: cluster 2024-09-20T22:44:05.583652+0000 mgr.a (mgr.14388) 1274 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:08.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:09 smithi044 bash[22676]: cluster 2024-09-20T22:44:07.584423+0000 mgr.a (mgr.14388) 1275 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:09 smithi179 bash[23186]: cluster 2024-09-20T22:44:07.584423+0000 mgr.a (mgr.14388) 1275 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:09 smithi049 bash[23528]: cluster 2024-09-20T22:44:07.584423+0000 mgr.a (mgr.14388) 1275 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:09.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:09.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:09.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:09.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:09.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:11 smithi044 bash[22676]: audit 2024-09-20T22:44:09.315833+0000 mgr.a (mgr.14388) 1276 : audit [DBG] from='client.40356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:11 smithi044 bash[22676]: cluster 2024-09-20T22:44:09.584963+0000 mgr.a (mgr.14388) 1277 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:11 smithi179 bash[23186]: audit 2024-09-20T22:44:09.315833+0000 mgr.a (mgr.14388) 1276 : audit [DBG] from='client.40356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:11 smithi179 bash[23186]: cluster 2024-09-20T22:44:09.584963+0000 mgr.a (mgr.14388) 1277 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:11.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:11 smithi049 bash[23528]: audit 2024-09-20T22:44:09.315833+0000 mgr.a (mgr.14388) 1276 : audit [DBG] from='client.40356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:11.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:11 smithi049 bash[23528]: cluster 2024-09-20T22:44:09.584963+0000 mgr.a (mgr.14388) 1277 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:13 smithi044 bash[22676]: cluster 2024-09-20T22:44:11.587300+0000 mgr.a (mgr.14388) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:13 smithi044 bash[22676]: audit 2024-09-20T22:44:12.539995+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:13 smithi044 bash[22676]: audit 2024-09-20T22:44:12.549827+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:13 smithi044 bash[22676]: audit 2024-09-20T22:44:12.560009+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:13 smithi044 bash[22676]: audit 2024-09-20T22:44:12.878495+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:13 smithi044 bash[22676]: audit 2024-09-20T22:44:12.887140+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:13 smithi044 bash[22676]: audit 2024-09-20T22:44:12.897003+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:13 smithi179 bash[23186]: cluster 2024-09-20T22:44:11.587300+0000 mgr.a (mgr.14388) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:13 smithi179 bash[23186]: audit 2024-09-20T22:44:12.539995+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:13 smithi179 bash[23186]: audit 2024-09-20T22:44:12.549827+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:13 smithi179 bash[23186]: audit 2024-09-20T22:44:12.560009+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:13 smithi179 bash[23186]: audit 2024-09-20T22:44:12.878495+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:13 smithi179 bash[23186]: audit 2024-09-20T22:44:12.887140+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:13 smithi179 bash[23186]: audit 2024-09-20T22:44:12.897003+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:13 smithi049 bash[23528]: cluster 2024-09-20T22:44:11.587300+0000 mgr.a (mgr.14388) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:13 smithi049 bash[23528]: audit 2024-09-20T22:44:12.539995+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:13 smithi049 bash[23528]: audit 2024-09-20T22:44:12.549827+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:13 smithi049 bash[23528]: audit 2024-09-20T22:44:12.560009+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:13 smithi049 bash[23528]: audit 2024-09-20T22:44:12.878495+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:13 smithi049 bash[23528]: audit 2024-09-20T22:44:12.887140+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:13 smithi049 bash[23528]: audit 2024-09-20T22:44:12.897003+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:15 smithi044 bash[22676]: cluster 2024-09-20T22:44:13.588063+0000 mgr.a (mgr.14388) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:15 smithi044 bash[22676]: audit 2024-09-20T22:44:14.678017+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:15 smithi044 bash[22676]: audit 2024-09-20T22:44:14.682758+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:15 smithi044 bash[22676]: audit 2024-09-20T22:44:14.687426+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.501 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:15.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:15.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:15.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:15.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:15 smithi179 bash[23186]: cluster 2024-09-20T22:44:13.588063+0000 mgr.a (mgr.14388) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:15 smithi179 bash[23186]: audit 2024-09-20T22:44:14.678017+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:15 smithi179 bash[23186]: audit 2024-09-20T22:44:14.682758+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:15 smithi179 bash[23186]: audit 2024-09-20T22:44:14.687426+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:15 smithi049 bash[23528]: cluster 2024-09-20T22:44:13.588063+0000 mgr.a (mgr.14388) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:15 smithi049 bash[23528]: audit 2024-09-20T22:44:14.678017+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:15 smithi049 bash[23528]: audit 2024-09-20T22:44:14.682758+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:15 smithi049 bash[23528]: audit 2024-09-20T22:44:14.687426+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:16 smithi044 bash[22676]: audit 2024-09-20T22:44:15.070189+0000 mgr.a (mgr.14388) 1280 : audit [DBG] from='client.40434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:16 smithi179 bash[23186]: audit 2024-09-20T22:44:15.070189+0000 mgr.a (mgr.14388) 1280 : audit [DBG] from='client.40434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:16 smithi049 bash[23528]: audit 2024-09-20T22:44:15.070189+0000 mgr.a (mgr.14388) 1280 : audit [DBG] from='client.40434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:17 smithi044 bash[22676]: cluster 2024-09-20T22:44:15.589465+0000 mgr.a (mgr.14388) 1281 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:17 smithi179 bash[23186]: cluster 2024-09-20T22:44:15.589465+0000 mgr.a (mgr.14388) 1281 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:17.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:17 smithi049 bash[23528]: cluster 2024-09-20T22:44:15.589465+0000 mgr.a (mgr.14388) 1281 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:19 smithi044 bash[22676]: cluster 2024-09-20T22:44:17.590364+0000 mgr.a (mgr.14388) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:44:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:19 smithi179 bash[23186]: cluster 2024-09-20T22:44:17.590364+0000 mgr.a (mgr.14388) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:44:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:19 smithi049 bash[23528]: cluster 2024-09-20T22:44:17.590364+0000 mgr.a (mgr.14388) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:44:20.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:20.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:20.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:21.255 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:21 smithi044 bash[22676]: cluster 2024-09-20T22:44:19.591296+0000 mgr.a (mgr.14388) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:44:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:21 smithi179 bash[23186]: cluster 2024-09-20T22:44:19.591296+0000 mgr.a (mgr.14388) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:44:21.534 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:21 smithi049 bash[23528]: cluster 2024-09-20T22:44:19.591296+0000 mgr.a (mgr.14388) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:44:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:22 smithi044 bash[22676]: audit 2024-09-20T22:44:20.835424+0000 mgr.a (mgr.14388) 1284 : audit [DBG] from='client.40509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:22 smithi179 bash[23186]: audit 2024-09-20T22:44:20.835424+0000 mgr.a (mgr.14388) 1284 : audit [DBG] from='client.40509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:22 smithi049 bash[23528]: audit 2024-09-20T22:44:20.835424+0000 mgr.a (mgr.14388) 1284 : audit [DBG] from='client.40509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22676]: cluster 2024-09-20T22:44:21.594097+0000 mgr.a (mgr.14388) 1285 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22676]: audit 2024-09-20T22:44:23.104515+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:44:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22676]: audit 2024-09-20T22:44:23.111623+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:44:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22676]: audit 2024-09-20T22:44:23.113488+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:44:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22676]: audit 2024-09-20T22:44:23.124963+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22676]: audit 2024-09-20T22:44:23.131289+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:44:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:23 smithi179 bash[23186]: cluster 2024-09-20T22:44:21.594097+0000 mgr.a (mgr.14388) 1285 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:23 smithi179 bash[23186]: audit 2024-09-20T22:44:23.104515+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:44:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:23 smithi179 bash[23186]: audit 2024-09-20T22:44:23.111623+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:44:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:23 smithi179 bash[23186]: audit 2024-09-20T22:44:23.113488+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:44:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:23 smithi179 bash[23186]: audit 2024-09-20T22:44:23.124963+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:23 smithi179 bash[23186]: audit 2024-09-20T22:44:23.131289+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:44:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:23 smithi049 bash[23528]: cluster 2024-09-20T22:44:21.594097+0000 mgr.a (mgr.14388) 1285 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:23 smithi049 bash[23528]: audit 2024-09-20T22:44:23.104515+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:44:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:23 smithi049 bash[23528]: audit 2024-09-20T22:44:23.111623+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:44:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:23 smithi049 bash[23528]: audit 2024-09-20T22:44:23.113488+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:44:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:23 smithi049 bash[23528]: audit 2024-09-20T22:44:23.124963+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:23 smithi049 bash[23528]: audit 2024-09-20T22:44:23.131289+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:44:24.230 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22930]: debug 2024-09-20T22:44:23.896+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:44:24.230 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:44:23 smithi044 bash[22930]: debug 2024-09-20T22:44:23.896+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:44:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:24 smithi044 bash[22676]: audit 2024-09-20T22:44:23.133808+0000 mgr.a (mgr.14388) 1286 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:44:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:24 smithi179 bash[23186]: audit 2024-09-20T22:44:23.133808+0000 mgr.a (mgr.14388) 1286 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:44:24.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:24 smithi049 bash[23528]: audit 2024-09-20T22:44:23.133808+0000 mgr.a (mgr.14388) 1286 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:44:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:25 smithi044 bash[22676]: cluster 2024-09-20T22:44:23.594722+0000 mgr.a (mgr.14388) 1287 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:44:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:25 smithi044 bash[22676]: audit 2024-09-20T22:44:23.898254+0000 mgr.a (mgr.14388) 1288 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:44:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:25 smithi044 bash[22676]: cephadm 2024-09-20T22:44:23.899691+0000 mgr.a (mgr.14388) 1289 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:44:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:25 smithi179 bash[23186]: cluster 2024-09-20T22:44:23.594722+0000 mgr.a (mgr.14388) 1287 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:44:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:25 smithi179 bash[23186]: audit 2024-09-20T22:44:23.898254+0000 mgr.a (mgr.14388) 1288 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:44:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:25 smithi179 bash[23186]: cephadm 2024-09-20T22:44:23.899691+0000 mgr.a (mgr.14388) 1289 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:44:25.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:25 smithi049 bash[23528]: cluster 2024-09-20T22:44:23.594722+0000 mgr.a (mgr.14388) 1287 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:44:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:25 smithi049 bash[23528]: audit 2024-09-20T22:44:23.898254+0000 mgr.a (mgr.14388) 1288 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:44:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:25 smithi049 bash[23528]: cephadm 2024-09-20T22:44:23.899691+0000 mgr.a (mgr.14388) 1289 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:44:26.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:26.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:26.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:26 smithi044 bash[22676]: cluster 2024-09-20T22:44:25.596969+0000 mgr.a (mgr.14388) 1290 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:26 smithi179 bash[23186]: cluster 2024-09-20T22:44:25.596969+0000 mgr.a (mgr.14388) 1290 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:26 smithi049 bash[23528]: cluster 2024-09-20T22:44:25.596969+0000 mgr.a (mgr.14388) 1290 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:27.019 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:27 smithi044 bash[22676]: audit 2024-09-20T22:44:26.593414+0000 mgr.a (mgr.14388) 1291 : audit [DBG] from='client.40692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:27 smithi179 bash[23186]: audit 2024-09-20T22:44:26.593414+0000 mgr.a (mgr.14388) 1291 : audit [DBG] from='client.40692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:27 smithi049 bash[23528]: audit 2024-09-20T22:44:26.593414+0000 mgr.a (mgr.14388) 1291 : audit [DBG] from='client.40692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:28 smithi044 bash[22676]: cluster 2024-09-20T22:44:27.597972+0000 mgr.a (mgr.14388) 1292 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:28 smithi179 bash[23186]: cluster 2024-09-20T22:44:27.597972+0000 mgr.a (mgr.14388) 1292 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:28 smithi049 bash[23528]: cluster 2024-09-20T22:44:27.597972+0000 mgr.a (mgr.14388) 1292 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:30 smithi044 bash[22676]: cluster 2024-09-20T22:44:29.598765+0000 mgr.a (mgr.14388) 1293 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:30 smithi179 bash[23186]: cluster 2024-09-20T22:44:29.598765+0000 mgr.a (mgr.14388) 1293 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:30 smithi049 bash[23528]: cluster 2024-09-20T22:44:29.598765+0000 mgr.a (mgr.14388) 1293 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:32.770 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:32.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:32.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:32.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:32.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:32 smithi044 bash[22676]: cluster 2024-09-20T22:44:31.600992+0000 mgr.a (mgr.14388) 1294 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:32 smithi179 bash[23186]: cluster 2024-09-20T22:44:31.600992+0000 mgr.a (mgr.14388) 1294 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:32 smithi049 bash[23528]: cluster 2024-09-20T22:44:31.600992+0000 mgr.a (mgr.14388) 1294 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:33 smithi049 bash[23528]: audit 2024-09-20T22:44:32.351302+0000 mgr.a (mgr.14388) 1295 : audit [DBG] from='client.40770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:33 smithi049 bash[23528]: audit 2024-09-20T22:44:32.756547+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:33 smithi049 bash[23528]: audit 2024-09-20T22:44:32.761680+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:33 smithi049 bash[23528]: audit 2024-09-20T22:44:32.766802+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:33 smithi049 bash[23528]: audit 2024-09-20T22:44:33.088222+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:33 smithi049 bash[23528]: audit 2024-09-20T22:44:33.097053+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:33 smithi049 bash[23528]: audit 2024-09-20T22:44:33.107386+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:33 smithi044 bash[22676]: audit 2024-09-20T22:44:32.351302+0000 mgr.a (mgr.14388) 1295 : audit [DBG] from='client.40770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:33 smithi044 bash[22676]: audit 2024-09-20T22:44:32.756547+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:33 smithi044 bash[22676]: audit 2024-09-20T22:44:32.761680+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:33 smithi044 bash[22676]: audit 2024-09-20T22:44:32.766802+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:33 smithi044 bash[22676]: audit 2024-09-20T22:44:33.088222+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:33 smithi044 bash[22676]: audit 2024-09-20T22:44:33.097053+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:33 smithi044 bash[22676]: audit 2024-09-20T22:44:33.107386+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:33 smithi179 bash[23186]: audit 2024-09-20T22:44:32.351302+0000 mgr.a (mgr.14388) 1295 : audit [DBG] from='client.40770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:33 smithi179 bash[23186]: audit 2024-09-20T22:44:32.756547+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:33 smithi179 bash[23186]: audit 2024-09-20T22:44:32.761680+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:33 smithi179 bash[23186]: audit 2024-09-20T22:44:32.766802+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:33 smithi179 bash[23186]: audit 2024-09-20T22:44:33.088222+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:33 smithi179 bash[23186]: audit 2024-09-20T22:44:33.097053+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:33 smithi179 bash[23186]: audit 2024-09-20T22:44:33.107386+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:35 smithi044 bash[22676]: cluster 2024-09-20T22:44:33.601916+0000 mgr.a (mgr.14388) 1296 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:35.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:35 smithi044 bash[22676]: audit 2024-09-20T22:44:34.904079+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:35 smithi044 bash[22676]: audit 2024-09-20T22:44:34.911991+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:35 smithi044 bash[22676]: audit 2024-09-20T22:44:34.922293+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:35 smithi179 bash[23186]: cluster 2024-09-20T22:44:33.601916+0000 mgr.a (mgr.14388) 1296 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:35 smithi179 bash[23186]: audit 2024-09-20T22:44:34.904079+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:35 smithi179 bash[23186]: audit 2024-09-20T22:44:34.911991+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:35 smithi179 bash[23186]: audit 2024-09-20T22:44:34.922293+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:35 smithi049 bash[23528]: cluster 2024-09-20T22:44:33.601916+0000 mgr.a (mgr.14388) 1296 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:35.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:35 smithi049 bash[23528]: audit 2024-09-20T22:44:34.904079+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:35 smithi049 bash[23528]: audit 2024-09-20T22:44:34.911991+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:35 smithi049 bash[23528]: audit 2024-09-20T22:44:34.922293+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:37.477 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:37 smithi044 bash[22676]: cluster 2024-09-20T22:44:35.604183+0000 mgr.a (mgr.14388) 1297 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:37 smithi179 bash[23186]: cluster 2024-09-20T22:44:35.604183+0000 mgr.a (mgr.14388) 1297 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:37 smithi049 bash[23528]: cluster 2024-09-20T22:44:35.604183+0000 mgr.a (mgr.14388) 1297 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:44:37.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:38.544 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:38.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:38.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:38.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:38.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:39 smithi049 bash[23528]: cluster 2024-09-20T22:44:37.605030+0000 mgr.a (mgr.14388) 1298 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:39 smithi049 bash[23528]: audit 2024-09-20T22:44:38.114952+0000 mgr.a (mgr.14388) 1299 : audit [DBG] from='client.40848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:39 smithi044 bash[22676]: cluster 2024-09-20T22:44:37.605030+0000 mgr.a (mgr.14388) 1298 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:39 smithi044 bash[22676]: audit 2024-09-20T22:44:38.114952+0000 mgr.a (mgr.14388) 1299 : audit [DBG] from='client.40848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:39 smithi179 bash[23186]: cluster 2024-09-20T22:44:37.605030+0000 mgr.a (mgr.14388) 1298 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:39 smithi179 bash[23186]: audit 2024-09-20T22:44:38.114952+0000 mgr.a (mgr.14388) 1299 : audit [DBG] from='client.40848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:41 smithi179 bash[23186]: cluster 2024-09-20T22:44:39.605980+0000 mgr.a (mgr.14388) 1300 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:41 smithi044 bash[22676]: cluster 2024-09-20T22:44:39.605980+0000 mgr.a (mgr.14388) 1300 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:41 smithi049 bash[23528]: cluster 2024-09-20T22:44:39.605980+0000 mgr.a (mgr.14388) 1300 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:43 smithi044 bash[22676]: cluster 2024-09-20T22:44:41.608208+0000 mgr.a (mgr.14388) 1301 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:43 smithi179 bash[23186]: cluster 2024-09-20T22:44:41.608208+0000 mgr.a (mgr.14388) 1301 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:43.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:43.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:43.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:43.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:43 smithi049 bash[23528]: cluster 2024-09-20T22:44:41.608208+0000 mgr.a (mgr.14388) 1301 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:44.302 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:45.450 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:45 smithi049 bash[23528]: cluster 2024-09-20T22:44:43.608960+0000 mgr.a (mgr.14388) 1302 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:45.450 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:45 smithi049 bash[23528]: audit 2024-09-20T22:44:43.878915+0000 mgr.a (mgr.14388) 1303 : audit [DBG] from='client.40926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:45 smithi044 bash[22676]: cluster 2024-09-20T22:44:43.608960+0000 mgr.a (mgr.14388) 1302 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:45 smithi044 bash[22676]: audit 2024-09-20T22:44:43.878915+0000 mgr.a (mgr.14388) 1303 : audit [DBG] from='client.40926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:45 smithi179 bash[23186]: cluster 2024-09-20T22:44:43.608960+0000 mgr.a (mgr.14388) 1302 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:45 smithi179 bash[23186]: audit 2024-09-20T22:44:43.878915+0000 mgr.a (mgr.14388) 1303 : audit [DBG] from='client.40926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:47 smithi044 bash[22676]: cluster 2024-09-20T22:44:45.611265+0000 mgr.a (mgr.14388) 1304 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:47 smithi179 bash[23186]: cluster 2024-09-20T22:44:45.611265+0000 mgr.a (mgr.14388) 1304 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:47 smithi049 bash[23528]: cluster 2024-09-20T22:44:45.611265+0000 mgr.a (mgr.14388) 1304 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:49.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:49.304 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:49.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:49 smithi044 bash[22676]: cluster 2024-09-20T22:44:47.612049+0000 mgr.a (mgr.14388) 1305 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:49 smithi179 bash[23186]: cluster 2024-09-20T22:44:47.612049+0000 mgr.a (mgr.14388) 1305 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:49 smithi049 bash[23528]: cluster 2024-09-20T22:44:47.612049+0000 mgr.a (mgr.14388) 1305 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:50.062 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:51 smithi044 bash[22676]: cluster 2024-09-20T22:44:49.612772+0000 mgr.a (mgr.14388) 1306 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:51 smithi044 bash[22676]: audit 2024-09-20T22:44:49.633143+0000 mgr.a (mgr.14388) 1307 : audit [DBG] from='client.41004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:51 smithi179 bash[23186]: cluster 2024-09-20T22:44:49.612772+0000 mgr.a (mgr.14388) 1306 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:51 smithi179 bash[23186]: audit 2024-09-20T22:44:49.633143+0000 mgr.a (mgr.14388) 1307 : audit [DBG] from='client.41004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:51 smithi049 bash[23528]: cluster 2024-09-20T22:44:49.612772+0000 mgr.a (mgr.14388) 1306 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:51 smithi049 bash[23528]: audit 2024-09-20T22:44:49.633143+0000 mgr.a (mgr.14388) 1307 : audit [DBG] from='client.41004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:53 smithi044 bash[22676]: cluster 2024-09-20T22:44:51.615171+0000 mgr.a (mgr.14388) 1308 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:53 smithi044 bash[22676]: audit 2024-09-20T22:44:52.977674+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:53 smithi044 bash[22676]: audit 2024-09-20T22:44:52.987594+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:53 smithi044 bash[22676]: audit 2024-09-20T22:44:52.999062+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:53 smithi179 bash[23186]: cluster 2024-09-20T22:44:51.615171+0000 mgr.a (mgr.14388) 1308 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:53 smithi179 bash[23186]: audit 2024-09-20T22:44:52.977674+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:53 smithi179 bash[23186]: audit 2024-09-20T22:44:52.987594+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:53 smithi179 bash[23186]: audit 2024-09-20T22:44:52.999062+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:53 smithi049 bash[23528]: cluster 2024-09-20T22:44:51.615171+0000 mgr.a (mgr.14388) 1308 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:44:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:53 smithi049 bash[23528]: audit 2024-09-20T22:44:52.977674+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:53 smithi049 bash[23528]: audit 2024-09-20T22:44:52.987594+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:53 smithi049 bash[23528]: audit 2024-09-20T22:44:52.999062+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:54 smithi044 bash[22676]: audit 2024-09-20T22:44:53.301940+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:54 smithi044 bash[22676]: audit 2024-09-20T22:44:53.310493+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:54 smithi044 bash[22676]: audit 2024-09-20T22:44:53.320538+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:54 smithi044 bash[22676]: cluster 2024-09-20T22:44:53.615960+0000 mgr.a (mgr.14388) 1309 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:54 smithi179 bash[23186]: audit 2024-09-20T22:44:53.301940+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:54 smithi179 bash[23186]: audit 2024-09-20T22:44:53.310493+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:54 smithi179 bash[23186]: audit 2024-09-20T22:44:53.320538+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:54 smithi179 bash[23186]: cluster 2024-09-20T22:44:53.615960+0000 mgr.a (mgr.14388) 1309 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:54 smithi049 bash[23528]: audit 2024-09-20T22:44:53.301940+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:54 smithi049 bash[23528]: audit 2024-09-20T22:44:53.310493+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:54 smithi049 bash[23528]: audit 2024-09-20T22:44:53.320538+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:54 smithi049 bash[23528]: cluster 2024-09-20T22:44:53.615960+0000 mgr.a (mgr.14388) 1309 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:44:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:44:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:44:55.814 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:44:55.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:44:55.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:44:55.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:44:55.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:44:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:56 smithi044 bash[22676]: audit 2024-09-20T22:44:55.100181+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:56 smithi044 bash[22676]: audit 2024-09-20T22:44:55.105314+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:56 smithi044 bash[22676]: audit 2024-09-20T22:44:55.110440+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:56 smithi179 bash[23186]: audit 2024-09-20T22:44:55.100181+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:56 smithi179 bash[23186]: audit 2024-09-20T22:44:55.105314+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:56 smithi179 bash[23186]: audit 2024-09-20T22:44:55.110440+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:56 smithi049 bash[23528]: audit 2024-09-20T22:44:55.100181+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:56 smithi049 bash[23528]: audit 2024-09-20T22:44:55.105314+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:56 smithi049 bash[23528]: audit 2024-09-20T22:44:55.110440+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:44:57.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:57 smithi044 bash[22676]: audit 2024-09-20T22:44:55.388602+0000 mgr.a (mgr.14388) 1310 : audit [DBG] from='client.41082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:57.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:57 smithi044 bash[22676]: cluster 2024-09-20T22:44:55.625142+0000 mgr.a (mgr.14388) 1311 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:57 smithi179 bash[23186]: audit 2024-09-20T22:44:55.388602+0000 mgr.a (mgr.14388) 1310 : audit [DBG] from='client.41082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:57 smithi179 bash[23186]: cluster 2024-09-20T22:44:55.625142+0000 mgr.a (mgr.14388) 1311 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:57 smithi049 bash[23528]: audit 2024-09-20T22:44:55.388602+0000 mgr.a (mgr.14388) 1310 : audit [DBG] from='client.41082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:44:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:57 smithi049 bash[23528]: cluster 2024-09-20T22:44:55.625142+0000 mgr.a (mgr.14388) 1311 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:44:59.412 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:44:59 smithi179 bash[23186]: cluster 2024-09-20T22:44:57.625636+0000 mgr.a (mgr.14388) 1312 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:44:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:44:59 smithi044 bash[22676]: cluster 2024-09-20T22:44:57.625636+0000 mgr.a (mgr.14388) 1312 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:44:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:44:59 smithi049 bash[23528]: cluster 2024-09-20T22:44:57.625636+0000 mgr.a (mgr.14388) 1312 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:45:00.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:01.244 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:01 smithi049 bash[23528]: cluster 2024-09-20T22:44:59.626386+0000 mgr.a (mgr.14388) 1313 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:45:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:01 smithi179 bash[23186]: cluster 2024-09-20T22:44:59.626386+0000 mgr.a (mgr.14388) 1313 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:45:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:01 smithi044 bash[22676]: cluster 2024-09-20T22:44:59.626386+0000 mgr.a (mgr.14388) 1313 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:45:01.596 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:02 smithi044 bash[22676]: audit 2024-09-20T22:45:01.149961+0000 mgr.a (mgr.14388) 1314 : audit [DBG] from='client.41157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:02 smithi179 bash[23186]: audit 2024-09-20T22:45:01.149961+0000 mgr.a (mgr.14388) 1314 : audit [DBG] from='client.41157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:02.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:02 smithi049 bash[23528]: audit 2024-09-20T22:45:01.149961+0000 mgr.a (mgr.14388) 1314 : audit [DBG] from='client.41157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:03.458 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:03 smithi049 bash[23528]: cluster 2024-09-20T22:45:01.627895+0000 mgr.a (mgr.14388) 1315 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:03 smithi044 bash[22676]: cluster 2024-09-20T22:45:01.627895+0000 mgr.a (mgr.14388) 1315 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:03 smithi179 bash[23186]: cluster 2024-09-20T22:45:01.627895+0000 mgr.a (mgr.14388) 1315 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:05 smithi044 bash[22676]: cluster 2024-09-20T22:45:03.628633+0000 mgr.a (mgr.14388) 1316 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:45:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:05 smithi179 bash[23186]: cluster 2024-09-20T22:45:03.628633+0000 mgr.a (mgr.14388) 1316 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:45:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:05 smithi049 bash[23528]: cluster 2024-09-20T22:45:03.628633+0000 mgr.a (mgr.14388) 1316 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:45:06.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:06.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:06.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:07.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:07 smithi044 bash[22676]: cluster 2024-09-20T22:45:05.630659+0000 mgr.a (mgr.14388) 1317 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:07 smithi179 bash[23186]: cluster 2024-09-20T22:45:05.630659+0000 mgr.a (mgr.14388) 1317 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:07.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:07 smithi049 bash[23528]: cluster 2024-09-20T22:45:05.630659+0000 mgr.a (mgr.14388) 1317 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:08 smithi044 bash[22676]: audit 2024-09-20T22:45:06.934603+0000 mgr.a (mgr.14388) 1318 : audit [DBG] from='client.41235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:08 smithi179 bash[23186]: audit 2024-09-20T22:45:06.934603+0000 mgr.a (mgr.14388) 1318 : audit [DBG] from='client.41235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:08.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:08 smithi049 bash[23528]: audit 2024-09-20T22:45:06.934603+0000 mgr.a (mgr.14388) 1318 : audit [DBG] from='client.41235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:09 smithi044 bash[22676]: cluster 2024-09-20T22:45:07.631688+0000 mgr.a (mgr.14388) 1319 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:09 smithi179 bash[23186]: cluster 2024-09-20T22:45:07.631688+0000 mgr.a (mgr.14388) 1319 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:09 smithi049 bash[23528]: cluster 2024-09-20T22:45:07.631688+0000 mgr.a (mgr.14388) 1319 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:11.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:11 smithi044 bash[22676]: cluster 2024-09-20T22:45:09.632491+0000 mgr.a (mgr.14388) 1320 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:11 smithi179 bash[23186]: cluster 2024-09-20T22:45:09.632491+0000 mgr.a (mgr.14388) 1320 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:11 smithi049 bash[23528]: cluster 2024-09-20T22:45:09.632491+0000 mgr.a (mgr.14388) 1320 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:12.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:12.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:12.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:13.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:13 smithi044 bash[22676]: cluster 2024-09-20T22:45:11.634717+0000 mgr.a (mgr.14388) 1321 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:13 smithi179 bash[23186]: cluster 2024-09-20T22:45:11.634717+0000 mgr.a (mgr.14388) 1321 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:13.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:13 smithi049 bash[23528]: cluster 2024-09-20T22:45:11.634717+0000 mgr.a (mgr.14388) 1321 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:14 smithi044 bash[22676]: audit 2024-09-20T22:45:12.726122+0000 mgr.a (mgr.14388) 1322 : audit [DBG] from='client.41310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:14 smithi044 bash[22676]: audit 2024-09-20T22:45:13.185360+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:14 smithi044 bash[22676]: audit 2024-09-20T22:45:13.190510+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:14 smithi044 bash[22676]: audit 2024-09-20T22:45:13.195427+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:14 smithi044 bash[22676]: audit 2024-09-20T22:45:13.525912+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:14 smithi044 bash[22676]: audit 2024-09-20T22:45:13.534094+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:14 smithi044 bash[22676]: audit 2024-09-20T22:45:13.543857+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:14 smithi179 bash[23186]: audit 2024-09-20T22:45:12.726122+0000 mgr.a (mgr.14388) 1322 : audit [DBG] from='client.41310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:14 smithi179 bash[23186]: audit 2024-09-20T22:45:13.185360+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:14 smithi179 bash[23186]: audit 2024-09-20T22:45:13.190510+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:14 smithi179 bash[23186]: audit 2024-09-20T22:45:13.195427+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:14 smithi179 bash[23186]: audit 2024-09-20T22:45:13.525912+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:14 smithi179 bash[23186]: audit 2024-09-20T22:45:13.534094+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:14 smithi179 bash[23186]: audit 2024-09-20T22:45:13.543857+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:14 smithi049 bash[23528]: audit 2024-09-20T22:45:12.726122+0000 mgr.a (mgr.14388) 1322 : audit [DBG] from='client.41310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:14 smithi049 bash[23528]: audit 2024-09-20T22:45:13.185360+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:14 smithi049 bash[23528]: audit 2024-09-20T22:45:13.190510+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:14 smithi049 bash[23528]: audit 2024-09-20T22:45:13.195427+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:14 smithi049 bash[23528]: audit 2024-09-20T22:45:13.525912+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:14 smithi049 bash[23528]: audit 2024-09-20T22:45:13.534094+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:14 smithi049 bash[23528]: audit 2024-09-20T22:45:13.543857+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:15 smithi044 bash[22676]: cluster 2024-09-20T22:45:13.635708+0000 mgr.a (mgr.14388) 1323 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:15 smithi179 bash[23186]: cluster 2024-09-20T22:45:13.635708+0000 mgr.a (mgr.14388) 1323 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:15 smithi049 bash[23528]: cluster 2024-09-20T22:45:13.635708+0000 mgr.a (mgr.14388) 1323 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:16 smithi179 bash[23186]: audit 2024-09-20T22:45:15.236662+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:16 smithi179 bash[23186]: audit 2024-09-20T22:45:15.241063+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:16 smithi179 bash[23186]: audit 2024-09-20T22:45:15.246094+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:16 smithi049 bash[23528]: audit 2024-09-20T22:45:15.236662+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:16 smithi049 bash[23528]: audit 2024-09-20T22:45:15.241063+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:16 smithi049 bash[23528]: audit 2024-09-20T22:45:15.246094+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.660 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:16 smithi044 bash[22676]: audit 2024-09-20T22:45:15.236662+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.660 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:16 smithi044 bash[22676]: audit 2024-09-20T22:45:15.241063+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:16.660 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:16 smithi044 bash[22676]: audit 2024-09-20T22:45:15.246094+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:17 smithi179 bash[23186]: cluster 2024-09-20T22:45:15.637943+0000 mgr.a (mgr.14388) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:17.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:17 smithi049 bash[23528]: cluster 2024-09-20T22:45:15.637943+0000 mgr.a (mgr.14388) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:17 smithi044 bash[22676]: cluster 2024-09-20T22:45:15.637943+0000 mgr.a (mgr.14388) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:18.903 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:18.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:18.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:19 smithi179 bash[23186]: cluster 2024-09-20T22:45:17.638737+0000 mgr.a (mgr.14388) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:19 smithi049 bash[23528]: cluster 2024-09-20T22:45:17.638737+0000 mgr.a (mgr.14388) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:19 smithi044 bash[22676]: cluster 2024-09-20T22:45:17.638737+0000 mgr.a (mgr.14388) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:20.487 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:20 smithi179 bash[23186]: audit 2024-09-20T22:45:18.481872+0000 mgr.a (mgr.14388) 1326 : audit [DBG] from='client.41388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:20.487 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:20 smithi179 bash[23186]: cluster 2024-09-20T22:45:19.639661+0000 mgr.a (mgr.14388) 1327 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:20.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:20 smithi049 bash[23528]: audit 2024-09-20T22:45:18.481872+0000 mgr.a (mgr.14388) 1326 : audit [DBG] from='client.41388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:20.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:20 smithi049 bash[23528]: cluster 2024-09-20T22:45:19.639661+0000 mgr.a (mgr.14388) 1327 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:20 smithi044 bash[22676]: audit 2024-09-20T22:45:18.481872+0000 mgr.a (mgr.14388) 1326 : audit [DBG] from='client.41388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:20 smithi044 bash[22676]: cluster 2024-09-20T22:45:19.639661+0000 mgr.a (mgr.14388) 1327 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:22 smithi179 bash[23186]: cluster 2024-09-20T22:45:21.641911+0000 mgr.a (mgr.14388) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:22 smithi044 bash[22676]: cluster 2024-09-20T22:45:21.641911+0000 mgr.a (mgr.14388) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:22 smithi049 bash[23528]: cluster 2024-09-20T22:45:21.641911+0000 mgr.a (mgr.14388) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:23.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:23.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:24.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22930]: debug 2024-09-20T22:45:24.711+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:45:24.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22930]: debug 2024-09-20T22:45:24.723+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:45:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22676]: cluster 2024-09-20T22:45:23.642679+0000 mgr.a (mgr.14388) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22676]: audit 2024-09-20T22:45:23.957955+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:45:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22676]: audit 2024-09-20T22:45:23.964091+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:45:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22676]: audit 2024-09-20T22:45:23.965848+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:45:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22676]: audit 2024-09-20T22:45:23.976925+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22676]: audit 2024-09-20T22:45:23.983157+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:45:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:24 smithi044 bash[22676]: audit 2024-09-20T22:45:23.984751+0000 mgr.a (mgr.14388) 1330 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:45:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:24 smithi179 bash[23186]: cluster 2024-09-20T22:45:23.642679+0000 mgr.a (mgr.14388) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:24 smithi179 bash[23186]: audit 2024-09-20T22:45:23.957955+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:45:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:24 smithi179 bash[23186]: audit 2024-09-20T22:45:23.964091+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:45:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:24 smithi179 bash[23186]: audit 2024-09-20T22:45:23.965848+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:45:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:24 smithi179 bash[23186]: audit 2024-09-20T22:45:23.976925+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:24 smithi179 bash[23186]: audit 2024-09-20T22:45:23.983157+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:45:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:24 smithi179 bash[23186]: audit 2024-09-20T22:45:23.984751+0000 mgr.a (mgr.14388) 1330 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:45:25.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:24 smithi049 bash[23528]: cluster 2024-09-20T22:45:23.642679+0000 mgr.a (mgr.14388) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:24 smithi049 bash[23528]: audit 2024-09-20T22:45:23.957955+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:45:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:24 smithi049 bash[23528]: audit 2024-09-20T22:45:23.964091+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:45:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:24 smithi049 bash[23528]: audit 2024-09-20T22:45:23.965848+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:45:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:24 smithi049 bash[23528]: audit 2024-09-20T22:45:23.976925+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:24 smithi049 bash[23528]: audit 2024-09-20T22:45:23.983157+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:45:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:24 smithi049 bash[23528]: audit 2024-09-20T22:45:23.984751+0000 mgr.a (mgr.14388) 1330 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:45:25.122 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:25 smithi044 bash[22676]: audit 2024-09-20T22:45:24.251959+0000 mgr.a (mgr.14388) 1331 : audit [DBG] from='client.41466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:25 smithi044 bash[22676]: audit 2024-09-20T22:45:24.715419+0000 mgr.a (mgr.14388) 1332 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:45:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:25 smithi044 bash[22676]: cephadm 2024-09-20T22:45:24.728165+0000 mgr.a (mgr.14388) 1333 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:45:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:25 smithi179 bash[23186]: audit 2024-09-20T22:45:24.251959+0000 mgr.a (mgr.14388) 1331 : audit [DBG] from='client.41466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:25 smithi179 bash[23186]: audit 2024-09-20T22:45:24.715419+0000 mgr.a (mgr.14388) 1332 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:45:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:25 smithi179 bash[23186]: cephadm 2024-09-20T22:45:24.728165+0000 mgr.a (mgr.14388) 1333 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:45:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:25 smithi049 bash[23528]: audit 2024-09-20T22:45:24.251959+0000 mgr.a (mgr.14388) 1331 : audit [DBG] from='client.41466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:25 smithi049 bash[23528]: audit 2024-09-20T22:45:24.715419+0000 mgr.a (mgr.14388) 1332 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:45:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:25 smithi049 bash[23528]: cephadm 2024-09-20T22:45:24.728165+0000 mgr.a (mgr.14388) 1333 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:45:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:26 smithi044 bash[22676]: cluster 2024-09-20T22:45:25.645558+0000 mgr.a (mgr.14388) 1334 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:26 smithi179 bash[23186]: cluster 2024-09-20T22:45:25.645558+0000 mgr.a (mgr.14388) 1334 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:27.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:26 smithi049 bash[23528]: cluster 2024-09-20T22:45:25.645558+0000 mgr.a (mgr.14388) 1334 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:28 smithi044 bash[22676]: cluster 2024-09-20T22:45:27.646346+0000 mgr.a (mgr.14388) 1335 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:28 smithi179 bash[23186]: cluster 2024-09-20T22:45:27.646346+0000 mgr.a (mgr.14388) 1335 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:28 smithi049 bash[23528]: cluster 2024-09-20T22:45:27.646346+0000 mgr.a (mgr.14388) 1335 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:30.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:30.894 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:30 smithi044 bash[22676]: cluster 2024-09-20T22:45:29.647146+0000 mgr.a (mgr.14388) 1336 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:30 smithi179 bash[23186]: cluster 2024-09-20T22:45:29.647146+0000 mgr.a (mgr.14388) 1336 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:30 smithi049 bash[23528]: cluster 2024-09-20T22:45:29.647146+0000 mgr.a (mgr.14388) 1336 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:31 smithi044 bash[22676]: audit 2024-09-20T22:45:30.457394+0000 mgr.a (mgr.14388) 1337 : audit [DBG] from='client.41652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:31 smithi179 bash[23186]: audit 2024-09-20T22:45:30.457394+0000 mgr.a (mgr.14388) 1337 : audit [DBG] from='client.41652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:32.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:31 smithi049 bash[23528]: audit 2024-09-20T22:45:30.457394+0000 mgr.a (mgr.14388) 1337 : audit [DBG] from='client.41652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:32 smithi044 bash[22676]: cluster 2024-09-20T22:45:31.649921+0000 mgr.a (mgr.14388) 1338 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:32 smithi179 bash[23186]: cluster 2024-09-20T22:45:31.649921+0000 mgr.a (mgr.14388) 1338 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:32 smithi049 bash[23528]: cluster 2024-09-20T22:45:31.649921+0000 mgr.a (mgr.14388) 1338 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:34 smithi044 bash[22676]: audit 2024-09-20T22:45:33.406601+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:34 smithi044 bash[22676]: audit 2024-09-20T22:45:33.414948+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:34 smithi044 bash[22676]: audit 2024-09-20T22:45:33.425331+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:34 smithi044 bash[22676]: cluster 2024-09-20T22:45:33.650703+0000 mgr.a (mgr.14388) 1339 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:34 smithi044 bash[22676]: audit 2024-09-20T22:45:33.730975+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:34 smithi044 bash[22676]: audit 2024-09-20T22:45:33.739653+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:34 smithi044 bash[22676]: audit 2024-09-20T22:45:33.749722+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:34 smithi179 bash[23186]: audit 2024-09-20T22:45:33.406601+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:34 smithi179 bash[23186]: audit 2024-09-20T22:45:33.414948+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:34 smithi179 bash[23186]: audit 2024-09-20T22:45:33.425331+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:34 smithi179 bash[23186]: cluster 2024-09-20T22:45:33.650703+0000 mgr.a (mgr.14388) 1339 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:34 smithi179 bash[23186]: audit 2024-09-20T22:45:33.730975+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:34 smithi179 bash[23186]: audit 2024-09-20T22:45:33.739653+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:34 smithi179 bash[23186]: audit 2024-09-20T22:45:33.749722+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:34 smithi049 bash[23528]: audit 2024-09-20T22:45:33.406601+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:34 smithi049 bash[23528]: audit 2024-09-20T22:45:33.414948+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:34 smithi049 bash[23528]: audit 2024-09-20T22:45:33.425331+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:34 smithi049 bash[23528]: cluster 2024-09-20T22:45:33.650703+0000 mgr.a (mgr.14388) 1339 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:45:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:34 smithi049 bash[23528]: audit 2024-09-20T22:45:33.730975+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:34 smithi049 bash[23528]: audit 2024-09-20T22:45:33.739653+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:34 smithi049 bash[23528]: audit 2024-09-20T22:45:33.749722+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:35.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:35.895 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:35.895 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:36.639 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:36.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:36.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:36.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:36.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:36 smithi044 bash[22676]: audit 2024-09-20T22:45:35.454565+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:36 smithi044 bash[22676]: audit 2024-09-20T22:45:35.462656+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:36 smithi044 bash[22676]: audit 2024-09-20T22:45:35.472705+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:36 smithi044 bash[22676]: cluster 2024-09-20T22:45:35.652697+0000 mgr.a (mgr.14388) 1340 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:36 smithi044 bash[22676]: audit 2024-09-20T22:45:36.214663+0000 mgr.a (mgr.14388) 1341 : audit [DBG] from='client.41724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:36 smithi179 bash[23186]: audit 2024-09-20T22:45:35.454565+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:36 smithi179 bash[23186]: audit 2024-09-20T22:45:35.462656+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:36 smithi179 bash[23186]: audit 2024-09-20T22:45:35.472705+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:36 smithi179 bash[23186]: cluster 2024-09-20T22:45:35.652697+0000 mgr.a (mgr.14388) 1340 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:36 smithi179 bash[23186]: audit 2024-09-20T22:45:36.214663+0000 mgr.a (mgr.14388) 1341 : audit [DBG] from='client.41724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:36 smithi049 bash[23528]: audit 2024-09-20T22:45:35.454565+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:36 smithi049 bash[23528]: audit 2024-09-20T22:45:35.462656+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:36 smithi049 bash[23528]: audit 2024-09-20T22:45:35.472705+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:36 smithi049 bash[23528]: cluster 2024-09-20T22:45:35.652697+0000 mgr.a (mgr.14388) 1340 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:45:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:36 smithi049 bash[23528]: audit 2024-09-20T22:45:36.214663+0000 mgr.a (mgr.14388) 1341 : audit [DBG] from='client.41724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:38 smithi044 bash[22676]: cluster 2024-09-20T22:45:37.653663+0000 mgr.a (mgr.14388) 1342 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:38 smithi179 bash[23186]: cluster 2024-09-20T22:45:37.653663+0000 mgr.a (mgr.14388) 1342 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:38 smithi049 bash[23528]: cluster 2024-09-20T22:45:37.653663+0000 mgr.a (mgr.14388) 1342 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:40.975 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:40 smithi179 bash[23186]: cluster 2024-09-20T22:45:39.654383+0000 mgr.a (mgr.14388) 1343 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:40 smithi044 bash[22676]: cluster 2024-09-20T22:45:39.654383+0000 mgr.a (mgr.14388) 1343 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:41.042 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:40 smithi049 bash[23528]: cluster 2024-09-20T22:45:39.654383+0000 mgr.a (mgr.14388) 1343 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:41.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:41.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:41.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:42.417 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:42.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:42.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:42.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:42.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:42 smithi044 bash[22676]: cluster 2024-09-20T22:45:41.655937+0000 mgr.a (mgr.14388) 1344 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:42 smithi044 bash[22676]: audit 2024-09-20T22:45:41.977200+0000 mgr.a (mgr.14388) 1345 : audit [DBG] from='client.41799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:42 smithi179 bash[23186]: cluster 2024-09-20T22:45:41.655937+0000 mgr.a (mgr.14388) 1344 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:42 smithi179 bash[23186]: audit 2024-09-20T22:45:41.977200+0000 mgr.a (mgr.14388) 1345 : audit [DBG] from='client.41799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:43.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:42 smithi049 bash[23528]: cluster 2024-09-20T22:45:41.655937+0000 mgr.a (mgr.14388) 1344 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:43.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:42 smithi049 bash[23528]: audit 2024-09-20T22:45:41.977200+0000 mgr.a (mgr.14388) 1345 : audit [DBG] from='client.41799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:44 smithi044 bash[22676]: cluster 2024-09-20T22:45:43.656834+0000 mgr.a (mgr.14388) 1346 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:44 smithi179 bash[23186]: cluster 2024-09-20T22:45:43.656834+0000 mgr.a (mgr.14388) 1346 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:44 smithi049 bash[23528]: cluster 2024-09-20T22:45:43.656834+0000 mgr.a (mgr.14388) 1346 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:46 smithi044 bash[22676]: cluster 2024-09-20T22:45:45.659028+0000 mgr.a (mgr.14388) 1347 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:46 smithi179 bash[23186]: cluster 2024-09-20T22:45:45.659028+0000 mgr.a (mgr.14388) 1347 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:47.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:46 smithi049 bash[23528]: cluster 2024-09-20T22:45:45.659028+0000 mgr.a (mgr.14388) 1347 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:45:47.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:47.419 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:47.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:48.208 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:48.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:48 smithi044 bash[22676]: cluster 2024-09-20T22:45:47.659788+0000 mgr.a (mgr.14388) 1348 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:48 smithi044 bash[22676]: audit 2024-09-20T22:45:47.758852+0000 mgr.a (mgr.14388) 1349 : audit [DBG] from='client.41874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:48 smithi179 bash[23186]: cluster 2024-09-20T22:45:47.659788+0000 mgr.a (mgr.14388) 1348 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:48 smithi179 bash[23186]: audit 2024-09-20T22:45:47.758852+0000 mgr.a (mgr.14388) 1349 : audit [DBG] from='client.41874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:49.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:48 smithi049 bash[23528]: cluster 2024-09-20T22:45:47.659788+0000 mgr.a (mgr.14388) 1348 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:49.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:48 smithi049 bash[23528]: audit 2024-09-20T22:45:47.758852+0000 mgr.a (mgr.14388) 1349 : audit [DBG] from='client.41874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:50 smithi044 bash[22676]: cluster 2024-09-20T22:45:49.660838+0000 mgr.a (mgr.14388) 1350 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:50 smithi179 bash[23186]: cluster 2024-09-20T22:45:49.660838+0000 mgr.a (mgr.14388) 1350 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:50 smithi049 bash[23528]: cluster 2024-09-20T22:45:49.660838+0000 mgr.a (mgr.14388) 1350 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:45:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:52 smithi179 bash[23186]: cluster 2024-09-20T22:45:51.663084+0000 mgr.a (mgr.14388) 1351 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:45:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:52 smithi049 bash[23528]: cluster 2024-09-20T22:45:51.663084+0000 mgr.a (mgr.14388) 1351 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:45:53.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:53.211 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:53.211 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:52 smithi044 bash[22676]: cluster 2024-09-20T22:45:51.663084+0000 mgr.a (mgr.14388) 1351 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:45:53.959 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:53.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:45:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: audit 2024-09-20T22:45:53.541640+0000 mgr.a (mgr.14388) 1352 : audit [DBG] from='client.41952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: audit 2024-09-20T22:45:53.614660+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: audit 2024-09-20T22:45:53.620278+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: audit 2024-09-20T22:45:53.625791+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: cluster 2024-09-20T22:45:53.663664+0000 mgr.a (mgr.14388) 1353 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:45:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: audit 2024-09-20T22:45:53.943978+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: audit 2024-09-20T22:45:53.951307+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:54 smithi044 bash[22676]: audit 2024-09-20T22:45:53.957815+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: audit 2024-09-20T22:45:53.541640+0000 mgr.a (mgr.14388) 1352 : audit [DBG] from='client.41952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: audit 2024-09-20T22:45:53.614660+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: audit 2024-09-20T22:45:53.620278+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: audit 2024-09-20T22:45:53.625791+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: cluster 2024-09-20T22:45:53.663664+0000 mgr.a (mgr.14388) 1353 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: audit 2024-09-20T22:45:53.943978+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: audit 2024-09-20T22:45:53.951307+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:54 smithi179 bash[23186]: audit 2024-09-20T22:45:53.957815+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: audit 2024-09-20T22:45:53.541640+0000 mgr.a (mgr.14388) 1352 : audit [DBG] from='client.41952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: audit 2024-09-20T22:45:53.614660+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: audit 2024-09-20T22:45:53.620278+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: audit 2024-09-20T22:45:53.625791+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: cluster 2024-09-20T22:45:53.663664+0000 mgr.a (mgr.14388) 1353 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: audit 2024-09-20T22:45:53.943978+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: audit 2024-09-20T22:45:53.951307+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:54 smithi049 bash[23528]: audit 2024-09-20T22:45:53.957815+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:56 smithi044 bash[22676]: cluster 2024-09-20T22:45:55.665997+0000 mgr.a (mgr.14388) 1354 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:45:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:56 smithi044 bash[22676]: audit 2024-09-20T22:45:55.679412+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:56 smithi044 bash[22676]: audit 2024-09-20T22:45:55.687094+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:56 smithi044 bash[22676]: audit 2024-09-20T22:45:55.696892+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:56 smithi179 bash[23186]: cluster 2024-09-20T22:45:55.665997+0000 mgr.a (mgr.14388) 1354 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:45:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:56 smithi179 bash[23186]: audit 2024-09-20T22:45:55.679412+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:56 smithi179 bash[23186]: audit 2024-09-20T22:45:55.687094+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:56 smithi179 bash[23186]: audit 2024-09-20T22:45:55.696892+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:56 smithi049 bash[23528]: cluster 2024-09-20T22:45:55.665997+0000 mgr.a (mgr.14388) 1354 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:45:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:56 smithi049 bash[23528]: audit 2024-09-20T22:45:55.679412+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:56 smithi049 bash[23528]: audit 2024-09-20T22:45:55.687094+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:56 smithi049 bash[23528]: audit 2024-09-20T22:45:55.696892+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:45:58.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:45:58.961 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:45:58.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:45:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:45:58 smithi044 bash[22676]: cluster 2024-09-20T22:45:57.666810+0000 mgr.a (mgr.14388) 1355 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:45:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:45:58 smithi179 bash[23186]: cluster 2024-09-20T22:45:57.666810+0000 mgr.a (mgr.14388) 1355 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:45:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:45:58 smithi049 bash[23528]: cluster 2024-09-20T22:45:57.666810+0000 mgr.a (mgr.14388) 1355 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:45:59.723 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:45:59.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:45:59.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:45:59.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:45:59.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:00 smithi044 bash[22676]: audit 2024-09-20T22:45:59.305789+0000 mgr.a (mgr.14388) 1356 : audit [DBG] from='client.42027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:00 smithi044 bash[22676]: cluster 2024-09-20T22:45:59.667327+0000 mgr.a (mgr.14388) 1357 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:46:00.963 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:00 smithi179 bash[23186]: audit 2024-09-20T22:45:59.305789+0000 mgr.a (mgr.14388) 1356 : audit [DBG] from='client.42027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:00.963 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:00 smithi179 bash[23186]: cluster 2024-09-20T22:45:59.667327+0000 mgr.a (mgr.14388) 1357 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:46:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:00 smithi049 bash[23528]: audit 2024-09-20T22:45:59.305789+0000 mgr.a (mgr.14388) 1356 : audit [DBG] from='client.42027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:00 smithi049 bash[23528]: cluster 2024-09-20T22:45:59.667327+0000 mgr.a (mgr.14388) 1357 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:46:02.951 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:02 smithi049 bash[23528]: cluster 2024-09-20T22:46:01.669571+0000 mgr.a (mgr.14388) 1358 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:46:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:02 smithi044 bash[22676]: cluster 2024-09-20T22:46:01.669571+0000 mgr.a (mgr.14388) 1358 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:46:02.995 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:02 smithi179 bash[23186]: cluster 2024-09-20T22:46:01.669571+0000 mgr.a (mgr.14388) 1358 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T22:46:04.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:04.726 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:04.726 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:04 smithi044 bash[22676]: cluster 2024-09-20T22:46:03.670340+0000 mgr.a (mgr.14388) 1359 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:04 smithi179 bash[23186]: cluster 2024-09-20T22:46:03.670340+0000 mgr.a (mgr.14388) 1359 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:04 smithi049 bash[23528]: cluster 2024-09-20T22:46:03.670340+0000 mgr.a (mgr.14388) 1359 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:05.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:05.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:05.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:05.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:05.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:05 smithi044 bash[22676]: audit 2024-09-20T22:46:05.056767+0000 mgr.a (mgr.14388) 1360 : audit [DBG] from='client.42105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:05 smithi179 bash[23186]: audit 2024-09-20T22:46:05.056767+0000 mgr.a (mgr.14388) 1360 : audit [DBG] from='client.42105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:05 smithi049 bash[23528]: audit 2024-09-20T22:46:05.056767+0000 mgr.a (mgr.14388) 1360 : audit [DBG] from='client.42105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:06 smithi044 bash[22676]: cluster 2024-09-20T22:46:05.673084+0000 mgr.a (mgr.14388) 1361 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:06 smithi179 bash[23186]: cluster 2024-09-20T22:46:05.673084+0000 mgr.a (mgr.14388) 1361 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:06 smithi049 bash[23528]: cluster 2024-09-20T22:46:05.673084+0000 mgr.a (mgr.14388) 1361 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:08 smithi044 bash[22676]: cluster 2024-09-20T22:46:07.673925+0000 mgr.a (mgr.14388) 1362 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:08 smithi179 bash[23186]: cluster 2024-09-20T22:46:07.673925+0000 mgr.a (mgr.14388) 1362 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:08 smithi049 bash[23528]: cluster 2024-09-20T22:46:07.673925+0000 mgr.a (mgr.14388) 1362 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:10 smithi044 bash[22676]: cluster 2024-09-20T22:46:09.674685+0000 mgr.a (mgr.14388) 1363 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:10 smithi179 bash[23186]: cluster 2024-09-20T22:46:09.674685+0000 mgr.a (mgr.14388) 1363 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:10 smithi049 bash[23528]: cluster 2024-09-20T22:46:09.674685+0000 mgr.a (mgr.14388) 1363 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:11.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:11.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:11.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:11.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:11.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:11 smithi044 bash[22676]: audit 2024-09-20T22:46:10.801164+0000 mgr.a (mgr.14388) 1364 : audit [DBG] from='client.42180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:11 smithi179 bash[23186]: audit 2024-09-20T22:46:10.801164+0000 mgr.a (mgr.14388) 1364 : audit [DBG] from='client.42180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:11 smithi049 bash[23528]: audit 2024-09-20T22:46:10.801164+0000 mgr.a (mgr.14388) 1364 : audit [DBG] from='client.42180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:12 smithi044 bash[22676]: cluster 2024-09-20T22:46:11.677491+0000 mgr.a (mgr.14388) 1365 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:12 smithi179 bash[23186]: cluster 2024-09-20T22:46:11.677491+0000 mgr.a (mgr.14388) 1365 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:12 smithi049 bash[23528]: cluster 2024-09-20T22:46:11.677491+0000 mgr.a (mgr.14388) 1365 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:14 smithi044 bash[22676]: cluster 2024-09-20T22:46:13.678434+0000 mgr.a (mgr.14388) 1366 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:14 smithi044 bash[22676]: audit 2024-09-20T22:46:13.835605+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:14 smithi044 bash[22676]: audit 2024-09-20T22:46:13.844174+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:14 smithi044 bash[22676]: audit 2024-09-20T22:46:13.854532+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:14 smithi044 bash[22676]: audit 2024-09-20T22:46:14.123708+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:14 smithi044 bash[22676]: audit 2024-09-20T22:46:14.132345+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:14 smithi044 bash[22676]: audit 2024-09-20T22:46:14.142558+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:14 smithi179 bash[23186]: cluster 2024-09-20T22:46:13.678434+0000 mgr.a (mgr.14388) 1366 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:14 smithi179 bash[23186]: audit 2024-09-20T22:46:13.835605+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:14 smithi179 bash[23186]: audit 2024-09-20T22:46:13.844174+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:14 smithi179 bash[23186]: audit 2024-09-20T22:46:13.854532+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:14 smithi179 bash[23186]: audit 2024-09-20T22:46:14.123708+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:14 smithi179 bash[23186]: audit 2024-09-20T22:46:14.132345+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:14 smithi179 bash[23186]: audit 2024-09-20T22:46:14.142558+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:14 smithi049 bash[23528]: cluster 2024-09-20T22:46:13.678434+0000 mgr.a (mgr.14388) 1366 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:14 smithi049 bash[23528]: audit 2024-09-20T22:46:13.835605+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:14 smithi049 bash[23528]: audit 2024-09-20T22:46:13.844174+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:14 smithi049 bash[23528]: audit 2024-09-20T22:46:13.854532+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:14 smithi049 bash[23528]: audit 2024-09-20T22:46:14.123708+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:14 smithi049 bash[23528]: audit 2024-09-20T22:46:14.132345+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:14 smithi049 bash[23528]: audit 2024-09-20T22:46:14.142558+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:16.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:16.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:16.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:17.038 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:17.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:16 smithi044 bash[22676]: cluster 2024-09-20T22:46:15.680545+0000 mgr.a (mgr.14388) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:16 smithi044 bash[22676]: audit 2024-09-20T22:46:15.923089+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:16 smithi044 bash[22676]: audit 2024-09-20T22:46:15.932178+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:16 smithi044 bash[22676]: audit 2024-09-20T22:46:15.942185+0000 mon.a (mon.0) 1858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:16 smithi179 bash[23186]: cluster 2024-09-20T22:46:15.680545+0000 mgr.a (mgr.14388) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:16 smithi179 bash[23186]: audit 2024-09-20T22:46:15.923089+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:16 smithi179 bash[23186]: audit 2024-09-20T22:46:15.932178+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:16 smithi179 bash[23186]: audit 2024-09-20T22:46:15.942185+0000 mon.a (mon.0) 1858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:16 smithi049 bash[23528]: cluster 2024-09-20T22:46:15.680545+0000 mgr.a (mgr.14388) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:16 smithi049 bash[23528]: audit 2024-09-20T22:46:15.923089+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:16 smithi049 bash[23528]: audit 2024-09-20T22:46:15.932178+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:16 smithi049 bash[23528]: audit 2024-09-20T22:46:15.942185+0000 mon.a (mon.0) 1858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:17 smithi044 bash[22676]: audit 2024-09-20T22:46:16.584853+0000 mgr.a (mgr.14388) 1368 : audit [DBG] from='client.42258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:17 smithi179 bash[23186]: audit 2024-09-20T22:46:16.584853+0000 mgr.a (mgr.14388) 1368 : audit [DBG] from='client.42258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:18.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:17 smithi049 bash[23528]: audit 2024-09-20T22:46:16.584853+0000 mgr.a (mgr.14388) 1368 : audit [DBG] from='client.42258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:19.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:18 smithi044 bash[22676]: cluster 2024-09-20T22:46:17.681444+0000 mgr.a (mgr.14388) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:18 smithi179 bash[23186]: cluster 2024-09-20T22:46:17.681444+0000 mgr.a (mgr.14388) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:18 smithi049 bash[23528]: cluster 2024-09-20T22:46:17.681444+0000 mgr.a (mgr.14388) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:21.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:20 smithi044 bash[22676]: cluster 2024-09-20T22:46:19.682222+0000 mgr.a (mgr.14388) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:21.242 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:20 smithi049 bash[23528]: cluster 2024-09-20T22:46:19.682222+0000 mgr.a (mgr.14388) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:20 smithi179 bash[23186]: cluster 2024-09-20T22:46:19.682222+0000 mgr.a (mgr.14388) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:22.041 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:22.041 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:22.814 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:22.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:22.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:22.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:22.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:22 smithi044 bash[22676]: cluster 2024-09-20T22:46:21.684472+0000 mgr.a (mgr.14388) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:22 smithi179 bash[23186]: cluster 2024-09-20T22:46:21.684472+0000 mgr.a (mgr.14388) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:22 smithi049 bash[23528]: cluster 2024-09-20T22:46:21.684472+0000 mgr.a (mgr.14388) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:23 smithi044 bash[22676]: audit 2024-09-20T22:46:22.377398+0000 mgr.a (mgr.14388) 1372 : audit [DBG] from='client.42330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:23 smithi179 bash[23186]: audit 2024-09-20T22:46:22.377398+0000 mgr.a (mgr.14388) 1372 : audit [DBG] from='client.42330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:24.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:23 smithi049 bash[23528]: audit 2024-09-20T22:46:22.377398+0000 mgr.a (mgr.14388) 1372 : audit [DBG] from='client.42330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:25.211 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:24 smithi179 bash[23186]: cluster 2024-09-20T22:46:23.685396+0000 mgr.a (mgr.14388) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:25.212 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:24 smithi179 bash[23186]: audit 2024-09-20T22:46:24.790024+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:46:25.212 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:24 smithi179 bash[23186]: audit 2024-09-20T22:46:24.801021+0000 mon.a (mon.0) 1860 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:46:25.212 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:24 smithi179 bash[23186]: audit 2024-09-20T22:46:24.802879+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:46:25.212 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:24 smithi179 bash[23186]: audit 2024-09-20T22:46:24.814310+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:25.212 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:24 smithi179 bash[23186]: audit 2024-09-20T22:46:24.820747+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:46:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:24 smithi044 bash[22676]: cluster 2024-09-20T22:46:23.685396+0000 mgr.a (mgr.14388) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:24 smithi044 bash[22676]: audit 2024-09-20T22:46:24.790024+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:46:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:24 smithi044 bash[22676]: audit 2024-09-20T22:46:24.801021+0000 mon.a (mon.0) 1860 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:46:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:24 smithi044 bash[22676]: audit 2024-09-20T22:46:24.802879+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:46:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:24 smithi044 bash[22676]: audit 2024-09-20T22:46:24.814310+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:24 smithi044 bash[22676]: audit 2024-09-20T22:46:24.820747+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:46:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:24 smithi049 bash[23528]: cluster 2024-09-20T22:46:23.685396+0000 mgr.a (mgr.14388) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:24 smithi049 bash[23528]: audit 2024-09-20T22:46:24.790024+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:46:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:24 smithi049 bash[23528]: audit 2024-09-20T22:46:24.801021+0000 mon.a (mon.0) 1860 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:46:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:24 smithi049 bash[23528]: audit 2024-09-20T22:46:24.802879+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:46:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:24 smithi049 bash[23528]: audit 2024-09-20T22:46:24.814310+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:24 smithi049 bash[23528]: audit 2024-09-20T22:46:24.820747+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:46:25.958 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:46:25 smithi044 bash[22930]: debug 2024-09-20T22:46:25.578+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:46:25.958 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:46:25 smithi044 bash[22930]: debug 2024-09-20T22:46:25.578+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:46:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:25 smithi044 bash[22676]: audit 2024-09-20T22:46:24.823238+0000 mgr.a (mgr.14388) 1374 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:46:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:25 smithi179 bash[23186]: audit 2024-09-20T22:46:24.823238+0000 mgr.a (mgr.14388) 1374 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:46:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:25 smithi049 bash[23528]: audit 2024-09-20T22:46:24.823238+0000 mgr.a (mgr.14388) 1374 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:46:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:26 smithi044 bash[22676]: audit 2024-09-20T22:46:25.582477+0000 mgr.a (mgr.14388) 1375 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:46:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:26 smithi044 bash[22676]: cephadm 2024-09-20T22:46:25.584074+0000 mgr.a (mgr.14388) 1376 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:46:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:26 smithi044 bash[22676]: cluster 2024-09-20T22:46:25.688208+0000 mgr.a (mgr.14388) 1377 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:26 smithi179 bash[23186]: audit 2024-09-20T22:46:25.582477+0000 mgr.a (mgr.14388) 1375 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:46:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:26 smithi179 bash[23186]: cephadm 2024-09-20T22:46:25.584074+0000 mgr.a (mgr.14388) 1376 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:46:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:26 smithi179 bash[23186]: cluster 2024-09-20T22:46:25.688208+0000 mgr.a (mgr.14388) 1377 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:26 smithi049 bash[23528]: audit 2024-09-20T22:46:25.582477+0000 mgr.a (mgr.14388) 1375 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:46:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:26 smithi049 bash[23528]: cephadm 2024-09-20T22:46:25.584074+0000 mgr.a (mgr.14388) 1376 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:46:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:26 smithi049 bash[23528]: cluster 2024-09-20T22:46:25.688208+0000 mgr.a (mgr.14388) 1377 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:27.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:27.817 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:27.817 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:28.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:28.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:28.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:28.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:28.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:28 smithi044 bash[22676]: cluster 2024-09-20T22:46:27.689017+0000 mgr.a (mgr.14388) 1378 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:28 smithi044 bash[22676]: audit 2024-09-20T22:46:28.153983+0000 mgr.a (mgr.14388) 1379 : audit [DBG] from='client.42516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:28 smithi179 bash[23186]: cluster 2024-09-20T22:46:27.689017+0000 mgr.a (mgr.14388) 1378 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:28 smithi179 bash[23186]: audit 2024-09-20T22:46:28.153983+0000 mgr.a (mgr.14388) 1379 : audit [DBG] from='client.42516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:28 smithi049 bash[23528]: cluster 2024-09-20T22:46:27.689017+0000 mgr.a (mgr.14388) 1378 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:28 smithi049 bash[23528]: audit 2024-09-20T22:46:28.153983+0000 mgr.a (mgr.14388) 1379 : audit [DBG] from='client.42516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:30 smithi044 bash[22676]: cluster 2024-09-20T22:46:29.689975+0000 mgr.a (mgr.14388) 1380 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:30 smithi179 bash[23186]: cluster 2024-09-20T22:46:29.689975+0000 mgr.a (mgr.14388) 1380 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:30 smithi049 bash[23528]: cluster 2024-09-20T22:46:29.689975+0000 mgr.a (mgr.14388) 1380 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:32 smithi044 bash[22676]: cluster 2024-09-20T22:46:31.692190+0000 mgr.a (mgr.14388) 1381 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:32 smithi179 bash[23186]: cluster 2024-09-20T22:46:31.692190+0000 mgr.a (mgr.14388) 1381 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:32 smithi049 bash[23528]: cluster 2024-09-20T22:46:31.692190+0000 mgr.a (mgr.14388) 1381 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:33.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:34.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:34.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:34.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:34.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:34.337 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: cluster 2024-09-20T22:46:33.692682+0000 mgr.a (mgr.14388) 1382 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: audit 2024-09-20T22:46:33.922077+0000 mgr.a (mgr.14388) 1383 : audit [DBG] from='client.42594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: audit 2024-09-20T22:46:34.040468+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: audit 2024-09-20T22:46:34.044853+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: audit 2024-09-20T22:46:34.059424+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: audit 2024-09-20T22:46:34.335841+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: audit 2024-09-20T22:46:34.341299+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:35 smithi049 bash[23528]: audit 2024-09-20T22:46:34.345742+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: cluster 2024-09-20T22:46:33.692682+0000 mgr.a (mgr.14388) 1382 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: audit 2024-09-20T22:46:33.922077+0000 mgr.a (mgr.14388) 1383 : audit [DBG] from='client.42594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: audit 2024-09-20T22:46:34.040468+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: audit 2024-09-20T22:46:34.044853+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: audit 2024-09-20T22:46:34.059424+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: audit 2024-09-20T22:46:34.335841+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: audit 2024-09-20T22:46:34.341299+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:35 smithi044 bash[22676]: audit 2024-09-20T22:46:34.345742+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: cluster 2024-09-20T22:46:33.692682+0000 mgr.a (mgr.14388) 1382 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: audit 2024-09-20T22:46:33.922077+0000 mgr.a (mgr.14388) 1383 : audit [DBG] from='client.42594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: audit 2024-09-20T22:46:34.040468+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: audit 2024-09-20T22:46:34.044853+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: audit 2024-09-20T22:46:34.059424+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: audit 2024-09-20T22:46:34.335841+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: audit 2024-09-20T22:46:34.341299+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:35 smithi179 bash[23186]: audit 2024-09-20T22:46:34.345742+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:37 smithi044 bash[22676]: cluster 2024-09-20T22:46:35.694963+0000 mgr.a (mgr.14388) 1384 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:37 smithi044 bash[22676]: audit 2024-09-20T22:46:36.106052+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:37 smithi044 bash[22676]: audit 2024-09-20T22:46:36.112023+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:37 smithi044 bash[22676]: audit 2024-09-20T22:46:36.120108+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:37 smithi179 bash[23186]: cluster 2024-09-20T22:46:35.694963+0000 mgr.a (mgr.14388) 1384 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:37 smithi179 bash[23186]: audit 2024-09-20T22:46:36.106052+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:37 smithi179 bash[23186]: audit 2024-09-20T22:46:36.112023+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:37 smithi179 bash[23186]: audit 2024-09-20T22:46:36.120108+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:37 smithi049 bash[23528]: cluster 2024-09-20T22:46:35.694963+0000 mgr.a (mgr.14388) 1384 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:37 smithi049 bash[23528]: audit 2024-09-20T22:46:36.106052+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:37 smithi049 bash[23528]: audit 2024-09-20T22:46:36.112023+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:37 smithi049 bash[23528]: audit 2024-09-20T22:46:36.120108+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:39.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:39.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:39.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:39 smithi044 bash[22676]: cluster 2024-09-20T22:46:37.695735+0000 mgr.a (mgr.14388) 1385 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:39 smithi179 bash[23186]: cluster 2024-09-20T22:46:37.695735+0000 mgr.a (mgr.14388) 1385 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:39 smithi049 bash[23528]: cluster 2024-09-20T22:46:37.695735+0000 mgr.a (mgr.14388) 1385 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:40.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:40.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:41 smithi044 bash[22676]: audit 2024-09-20T22:46:39.679516+0000 mgr.a (mgr.14388) 1386 : audit [DBG] from='client.42672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:41 smithi044 bash[22676]: cluster 2024-09-20T22:46:39.696420+0000 mgr.a (mgr.14388) 1387 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:41 smithi179 bash[23186]: audit 2024-09-20T22:46:39.679516+0000 mgr.a (mgr.14388) 1386 : audit [DBG] from='client.42672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:41 smithi179 bash[23186]: cluster 2024-09-20T22:46:39.696420+0000 mgr.a (mgr.14388) 1387 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:41 smithi049 bash[23528]: audit 2024-09-20T22:46:39.679516+0000 mgr.a (mgr.14388) 1386 : audit [DBG] from='client.42672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:41 smithi049 bash[23528]: cluster 2024-09-20T22:46:39.696420+0000 mgr.a (mgr.14388) 1387 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:43 smithi179 bash[23186]: cluster 2024-09-20T22:46:41.698101+0000 mgr.a (mgr.14388) 1388 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:43 smithi049 bash[23528]: cluster 2024-09-20T22:46:41.698101+0000 mgr.a (mgr.14388) 1388 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:43 smithi044 bash[22676]: cluster 2024-09-20T22:46:41.698101+0000 mgr.a (mgr.14388) 1388 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:46:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:45 smithi044 bash[22676]: cluster 2024-09-20T22:46:43.698841+0000 mgr.a (mgr.14388) 1389 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:45 smithi179 bash[23186]: cluster 2024-09-20T22:46:43.698841+0000 mgr.a (mgr.14388) 1389 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:45 smithi049 bash[23528]: cluster 2024-09-20T22:46:43.698841+0000 mgr.a (mgr.14388) 1389 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:45.871 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:47 smithi044 bash[22676]: audit 2024-09-20T22:46:45.448893+0000 mgr.a (mgr.14388) 1390 : audit [DBG] from='client.42750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:47 smithi044 bash[22676]: cluster 2024-09-20T22:46:45.701391+0000 mgr.a (mgr.14388) 1391 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:47 smithi179 bash[23186]: audit 2024-09-20T22:46:45.448893+0000 mgr.a (mgr.14388) 1390 : audit [DBG] from='client.42750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:47 smithi179 bash[23186]: cluster 2024-09-20T22:46:45.701391+0000 mgr.a (mgr.14388) 1391 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:47 smithi049 bash[23528]: audit 2024-09-20T22:46:45.448893+0000 mgr.a (mgr.14388) 1390 : audit [DBG] from='client.42750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:47 smithi049 bash[23528]: cluster 2024-09-20T22:46:45.701391+0000 mgr.a (mgr.14388) 1391 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:49 smithi044 bash[22676]: cluster 2024-09-20T22:46:47.702445+0000 mgr.a (mgr.14388) 1392 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:49 smithi179 bash[23186]: cluster 2024-09-20T22:46:47.702445+0000 mgr.a (mgr.14388) 1392 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:49 smithi049 bash[23528]: cluster 2024-09-20T22:46:47.702445+0000 mgr.a (mgr.14388) 1392 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:46:50.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:50.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:50.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:51 smithi044 bash[22676]: cluster 2024-09-20T22:46:49.703227+0000 mgr.a (mgr.14388) 1393 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:51 smithi179 bash[23186]: cluster 2024-09-20T22:46:49.703227+0000 mgr.a (mgr.14388) 1393 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:51 smithi049 bash[23528]: cluster 2024-09-20T22:46:49.703227+0000 mgr.a (mgr.14388) 1393 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:46:51.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:51.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:51.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:51.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:51.661 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:52 smithi044 bash[22676]: audit 2024-09-20T22:46:51.209608+0000 mgr.a (mgr.14388) 1394 : audit [DBG] from='client.42825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:52 smithi179 bash[23186]: audit 2024-09-20T22:46:51.209608+0000 mgr.a (mgr.14388) 1394 : audit [DBG] from='client.42825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:52 smithi049 bash[23528]: audit 2024-09-20T22:46:51.209608+0000 mgr.a (mgr.14388) 1394 : audit [DBG] from='client.42825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:53 smithi044 bash[22676]: cluster 2024-09-20T22:46:51.705745+0000 mgr.a (mgr.14388) 1395 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:53 smithi179 bash[23186]: cluster 2024-09-20T22:46:51.705745+0000 mgr.a (mgr.14388) 1395 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:53 smithi049 bash[23528]: cluster 2024-09-20T22:46:51.705745+0000 mgr.a (mgr.14388) 1395 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:55 smithi044 bash[22676]: cluster 2024-09-20T22:46:53.706643+0000 mgr.a (mgr.14388) 1396 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:55 smithi044 bash[22676]: audit 2024-09-20T22:46:54.271189+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:55 smithi044 bash[22676]: audit 2024-09-20T22:46:54.279708+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:55 smithi044 bash[22676]: audit 2024-09-20T22:46:54.290130+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:55 smithi044 bash[22676]: audit 2024-09-20T22:46:54.553406+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:55 smithi044 bash[22676]: audit 2024-09-20T22:46:54.561868+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:55 smithi044 bash[22676]: audit 2024-09-20T22:46:54.572010+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:55 smithi179 bash[23186]: cluster 2024-09-20T22:46:53.706643+0000 mgr.a (mgr.14388) 1396 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:55 smithi179 bash[23186]: audit 2024-09-20T22:46:54.271189+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:55 smithi179 bash[23186]: audit 2024-09-20T22:46:54.279708+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:55 smithi179 bash[23186]: audit 2024-09-20T22:46:54.290130+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:55 smithi179 bash[23186]: audit 2024-09-20T22:46:54.553406+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:55 smithi179 bash[23186]: audit 2024-09-20T22:46:54.561868+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:55 smithi179 bash[23186]: audit 2024-09-20T22:46:54.572010+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:55 smithi049 bash[23528]: cluster 2024-09-20T22:46:53.706643+0000 mgr.a (mgr.14388) 1396 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:55 smithi049 bash[23528]: audit 2024-09-20T22:46:54.271189+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:55 smithi049 bash[23528]: audit 2024-09-20T22:46:54.279708+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:55 smithi049 bash[23528]: audit 2024-09-20T22:46:54.290130+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:55 smithi049 bash[23528]: audit 2024-09-20T22:46:54.553406+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:55 smithi049 bash[23528]: audit 2024-09-20T22:46:54.561868+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:55 smithi049 bash[23528]: audit 2024-09-20T22:46:54.572010+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:56.662 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:46:56.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:46:56.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:46:57.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:46:57.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:46:57.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:46:57.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:46:57.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:46:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:57 smithi044 bash[22676]: cluster 2024-09-20T22:46:55.708772+0000 mgr.a (mgr.14388) 1397 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:57 smithi044 bash[22676]: audit 2024-09-20T22:46:56.335622+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:57 smithi044 bash[22676]: audit 2024-09-20T22:46:56.344892+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:57 smithi044 bash[22676]: audit 2024-09-20T22:46:56.354894+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:57 smithi179 bash[23186]: cluster 2024-09-20T22:46:55.708772+0000 mgr.a (mgr.14388) 1397 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:57 smithi179 bash[23186]: audit 2024-09-20T22:46:56.335622+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:57 smithi179 bash[23186]: audit 2024-09-20T22:46:56.344892+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:57 smithi179 bash[23186]: audit 2024-09-20T22:46:56.354894+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:57 smithi049 bash[23528]: cluster 2024-09-20T22:46:55.708772+0000 mgr.a (mgr.14388) 1397 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:46:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:57 smithi049 bash[23528]: audit 2024-09-20T22:46:56.335622+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:57 smithi049 bash[23528]: audit 2024-09-20T22:46:56.344892+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:57 smithi049 bash[23528]: audit 2024-09-20T22:46:56.354894+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:46:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:58 smithi044 bash[22676]: audit 2024-09-20T22:46:56.986684+0000 mgr.a (mgr.14388) 1398 : audit [DBG] from='client.42900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:58 smithi179 bash[23186]: audit 2024-09-20T22:46:56.986684+0000 mgr.a (mgr.14388) 1398 : audit [DBG] from='client.42900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:58 smithi049 bash[23528]: audit 2024-09-20T22:46:56.986684+0000 mgr.a (mgr.14388) 1398 : audit [DBG] from='client.42900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:46:59.434 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:46:59 smithi044 bash[22676]: cluster 2024-09-20T22:46:57.709822+0000 mgr.a (mgr.14388) 1399 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:46:59 smithi179 bash[23186]: cluster 2024-09-20T22:46:57.709822+0000 mgr.a (mgr.14388) 1399 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:46:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:46:59 smithi049 bash[23528]: cluster 2024-09-20T22:46:57.709822+0000 mgr.a (mgr.14388) 1399 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:01.367 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:01 smithi044 bash[22676]: cluster 2024-09-20T22:46:59.710644+0000 mgr.a (mgr.14388) 1400 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:01 smithi179 bash[23186]: cluster 2024-09-20T22:46:59.710644+0000 mgr.a (mgr.14388) 1400 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:01 smithi049 bash[23528]: cluster 2024-09-20T22:46:59.710644+0000 mgr.a (mgr.14388) 1400 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:02.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:02.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:02.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:03.184 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:03.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:03 smithi044 bash[22676]: cluster 2024-09-20T22:47:01.712985+0000 mgr.a (mgr.14388) 1401 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:03 smithi179 bash[23186]: cluster 2024-09-20T22:47:01.712985+0000 mgr.a (mgr.14388) 1401 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:03 smithi049 bash[23528]: cluster 2024-09-20T22:47:01.712985+0000 mgr.a (mgr.14388) 1401 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:04 smithi179 bash[23186]: audit 2024-09-20T22:47:02.757055+0000 mgr.a (mgr.14388) 1402 : audit [DBG] from='client.42972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:04 smithi044 bash[22676]: audit 2024-09-20T22:47:02.757055+0000 mgr.a (mgr.14388) 1402 : audit [DBG] from='client.42972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:04.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:04 smithi049 bash[23528]: audit 2024-09-20T22:47:02.757055+0000 mgr.a (mgr.14388) 1402 : audit [DBG] from='client.42972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:05 smithi044 bash[22676]: cluster 2024-09-20T22:47:03.714014+0000 mgr.a (mgr.14388) 1403 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:05 smithi179 bash[23186]: cluster 2024-09-20T22:47:03.714014+0000 mgr.a (mgr.14388) 1403 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:05 smithi049 bash[23528]: cluster 2024-09-20T22:47:03.714014+0000 mgr.a (mgr.14388) 1403 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:07 smithi044 bash[22676]: cluster 2024-09-20T22:47:05.716251+0000 mgr.a (mgr.14388) 1404 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:07 smithi179 bash[23186]: cluster 2024-09-20T22:47:05.716251+0000 mgr.a (mgr.14388) 1404 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:07.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:07 smithi049 bash[23528]: cluster 2024-09-20T22:47:05.716251+0000 mgr.a (mgr.14388) 1404 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:08.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:08.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:08.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:08.973 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:09 smithi044 bash[22676]: cluster 2024-09-20T22:47:07.717023+0000 mgr.a (mgr.14388) 1405 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:09 smithi179 bash[23186]: cluster 2024-09-20T22:47:07.717023+0000 mgr.a (mgr.14388) 1405 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:09 smithi049 bash[23528]: cluster 2024-09-20T22:47:07.717023+0000 mgr.a (mgr.14388) 1405 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:10 smithi044 bash[22676]: audit 2024-09-20T22:47:08.527977+0000 mgr.a (mgr.14388) 1406 : audit [DBG] from='client.43050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:10 smithi179 bash[23186]: audit 2024-09-20T22:47:08.527977+0000 mgr.a (mgr.14388) 1406 : audit [DBG] from='client.43050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:10.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:10 smithi049 bash[23528]: audit 2024-09-20T22:47:08.527977+0000 mgr.a (mgr.14388) 1406 : audit [DBG] from='client.43050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:11 smithi044 bash[22676]: cluster 2024-09-20T22:47:09.718034+0000 mgr.a (mgr.14388) 1407 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:11 smithi179 bash[23186]: cluster 2024-09-20T22:47:09.718034+0000 mgr.a (mgr.14388) 1407 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:11.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:11 smithi049 bash[23528]: cluster 2024-09-20T22:47:09.718034+0000 mgr.a (mgr.14388) 1407 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:13 smithi044 bash[22676]: cluster 2024-09-20T22:47:11.720285+0000 mgr.a (mgr.14388) 1408 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:13 smithi179 bash[23186]: cluster 2024-09-20T22:47:11.720285+0000 mgr.a (mgr.14388) 1408 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:13 smithi049 bash[23528]: cluster 2024-09-20T22:47:11.720285+0000 mgr.a (mgr.14388) 1408 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:13.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:13.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:13.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:14.726 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:14.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:14.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:14.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:14.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:15 smithi044 bash[22676]: cluster 2024-09-20T22:47:13.721052+0000 mgr.a (mgr.14388) 1409 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:15 smithi044 bash[22676]: audit 2024-09-20T22:47:14.477213+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:15 smithi044 bash[22676]: audit 2024-09-20T22:47:14.482738+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:15 smithi044 bash[22676]: audit 2024-09-20T22:47:14.488015+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:15 smithi044 bash[22676]: audit 2024-09-20T22:47:14.763331+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:15 smithi044 bash[22676]: audit 2024-09-20T22:47:14.768952+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:15 smithi044 bash[22676]: audit 2024-09-20T22:47:14.775593+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:15 smithi179 bash[23186]: cluster 2024-09-20T22:47:13.721052+0000 mgr.a (mgr.14388) 1409 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:15 smithi179 bash[23186]: audit 2024-09-20T22:47:14.477213+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:15 smithi179 bash[23186]: audit 2024-09-20T22:47:14.482738+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:15 smithi179 bash[23186]: audit 2024-09-20T22:47:14.488015+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:15 smithi179 bash[23186]: audit 2024-09-20T22:47:14.763331+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:15 smithi179 bash[23186]: audit 2024-09-20T22:47:14.768952+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:15 smithi179 bash[23186]: audit 2024-09-20T22:47:14.775593+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:15 smithi049 bash[23528]: cluster 2024-09-20T22:47:13.721052+0000 mgr.a (mgr.14388) 1409 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:15 smithi049 bash[23528]: audit 2024-09-20T22:47:14.477213+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:15 smithi049 bash[23528]: audit 2024-09-20T22:47:14.482738+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:15 smithi049 bash[23528]: audit 2024-09-20T22:47:14.488015+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:15 smithi049 bash[23528]: audit 2024-09-20T22:47:14.763331+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:15 smithi049 bash[23528]: audit 2024-09-20T22:47:14.768952+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:15 smithi049 bash[23528]: audit 2024-09-20T22:47:14.775593+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:16 smithi044 bash[22676]: audit 2024-09-20T22:47:14.307796+0000 mgr.a (mgr.14388) 1410 : audit [DBG] from='client.43128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:16 smithi179 bash[23186]: audit 2024-09-20T22:47:14.307796+0000 mgr.a (mgr.14388) 1410 : audit [DBG] from='client.43128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:16 smithi049 bash[23528]: audit 2024-09-20T22:47:14.307796+0000 mgr.a (mgr.14388) 1410 : audit [DBG] from='client.43128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:17 smithi044 bash[22676]: cluster 2024-09-20T22:47:15.723374+0000 mgr.a (mgr.14388) 1411 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:17 smithi044 bash[22676]: audit 2024-09-20T22:47:16.556225+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:17 smithi044 bash[22676]: audit 2024-09-20T22:47:16.562271+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:17 smithi044 bash[22676]: audit 2024-09-20T22:47:16.571317+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:17 smithi179 bash[23186]: cluster 2024-09-20T22:47:15.723374+0000 mgr.a (mgr.14388) 1411 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:17 smithi179 bash[23186]: audit 2024-09-20T22:47:16.556225+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:17 smithi179 bash[23186]: audit 2024-09-20T22:47:16.562271+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:17 smithi179 bash[23186]: audit 2024-09-20T22:47:16.571317+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:17 smithi049 bash[23528]: cluster 2024-09-20T22:47:15.723374+0000 mgr.a (mgr.14388) 1411 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:17.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:17 smithi049 bash[23528]: audit 2024-09-20T22:47:16.556225+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:17 smithi049 bash[23528]: audit 2024-09-20T22:47:16.562271+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:17 smithi049 bash[23528]: audit 2024-09-20T22:47:16.571317+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:19 smithi044 bash[22676]: cluster 2024-09-20T22:47:17.724144+0000 mgr.a (mgr.14388) 1412 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:19 smithi179 bash[23186]: cluster 2024-09-20T22:47:17.724144+0000 mgr.a (mgr.14388) 1412 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:19 smithi049 bash[23528]: cluster 2024-09-20T22:47:17.724144+0000 mgr.a (mgr.14388) 1412 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:20.513 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:20.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:20.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:20.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:20.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:21.347 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:21 smithi044 bash[22676]: cluster 2024-09-20T22:47:19.724932+0000 mgr.a (mgr.14388) 1413 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:21.348 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:21 smithi044 bash[22676]: audit 2024-09-20T22:47:20.069161+0000 mgr.a (mgr.14388) 1414 : audit [DBG] from='client.43206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:21 smithi179 bash[23186]: cluster 2024-09-20T22:47:19.724932+0000 mgr.a (mgr.14388) 1413 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:21 smithi179 bash[23186]: audit 2024-09-20T22:47:20.069161+0000 mgr.a (mgr.14388) 1414 : audit [DBG] from='client.43206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:21 smithi049 bash[23528]: cluster 2024-09-20T22:47:19.724932+0000 mgr.a (mgr.14388) 1413 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:21 smithi049 bash[23528]: audit 2024-09-20T22:47:20.069161+0000 mgr.a (mgr.14388) 1414 : audit [DBG] from='client.43206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:23.354 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:23 smithi049 bash[23528]: cluster 2024-09-20T22:47:21.726645+0000 mgr.a (mgr.14388) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:23 smithi179 bash[23186]: cluster 2024-09-20T22:47:21.726645+0000 mgr.a (mgr.14388) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:23 smithi044 bash[22676]: cluster 2024-09-20T22:47:21.726645+0000 mgr.a (mgr.14388) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:25 smithi179 bash[23186]: cluster 2024-09-20T22:47:23.727431+0000 mgr.a (mgr.14388) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:47:25.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:25.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:25.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:25.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:25 smithi049 bash[23528]: cluster 2024-09-20T22:47:23.727431+0000 mgr.a (mgr.14388) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:47:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:25 smithi044 bash[22676]: cluster 2024-09-20T22:47:23.727431+0000 mgr.a (mgr.14388) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:47:26.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:26 smithi179 bash[23186]: audit 2024-09-20T22:47:25.647570+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:47:26.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:26 smithi179 bash[23186]: audit 2024-09-20T22:47:25.650624+0000 mon.a (mon.0) 1892 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:47:26.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:26 smithi179 bash[23186]: audit 2024-09-20T22:47:25.651352+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:47:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:26 smithi179 bash[23186]: audit 2024-09-20T22:47:25.657824+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:26 smithi179 bash[23186]: audit 2024-09-20T22:47:25.661407+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:47:26.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:26 smithi049 bash[23528]: audit 2024-09-20T22:47:25.647570+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:47:26.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:26 smithi049 bash[23528]: audit 2024-09-20T22:47:25.650624+0000 mon.a (mon.0) 1892 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:47:26.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:26 smithi049 bash[23528]: audit 2024-09-20T22:47:25.651352+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:47:26.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:26 smithi049 bash[23528]: audit 2024-09-20T22:47:25.657824+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:26 smithi049 bash[23528]: audit 2024-09-20T22:47:25.661407+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:47:26.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:47:26 smithi044 bash[22930]: debug 2024-09-20T22:47:26.361+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:47:26.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:47:26 smithi044 bash[22930]: debug 2024-09-20T22:47:26.373+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:47:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:26 smithi044 bash[22676]: audit 2024-09-20T22:47:25.647570+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:47:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:26 smithi044 bash[22676]: audit 2024-09-20T22:47:25.650624+0000 mon.a (mon.0) 1892 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:47:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:26 smithi044 bash[22676]: audit 2024-09-20T22:47:25.651352+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:47:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:26 smithi044 bash[22676]: audit 2024-09-20T22:47:25.657824+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:26 smithi044 bash[22676]: audit 2024-09-20T22:47:25.661407+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:47:26.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:26.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:26.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:26.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:26.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:27 smithi179 bash[23186]: audit 2024-09-20T22:47:25.662362+0000 mgr.a (mgr.14388) 1417 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:47:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:27 smithi179 bash[23186]: cluster 2024-09-20T22:47:25.728810+0000 mgr.a (mgr.14388) 1418 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:27 smithi179 bash[23186]: audit 2024-09-20T22:47:25.858718+0000 mgr.a (mgr.14388) 1419 : audit [DBG] from='client.43278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:27.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:27 smithi049 bash[23528]: audit 2024-09-20T22:47:25.662362+0000 mgr.a (mgr.14388) 1417 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:47:27.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:27 smithi049 bash[23528]: cluster 2024-09-20T22:47:25.728810+0000 mgr.a (mgr.14388) 1418 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:27.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:27 smithi049 bash[23528]: audit 2024-09-20T22:47:25.858718+0000 mgr.a (mgr.14388) 1419 : audit [DBG] from='client.43278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:27 smithi044 bash[22676]: audit 2024-09-20T22:47:25.662362+0000 mgr.a (mgr.14388) 1417 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:47:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:27 smithi044 bash[22676]: cluster 2024-09-20T22:47:25.728810+0000 mgr.a (mgr.14388) 1418 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:27 smithi044 bash[22676]: audit 2024-09-20T22:47:25.858718+0000 mgr.a (mgr.14388) 1419 : audit [DBG] from='client.43278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:28 smithi179 bash[23186]: audit 2024-09-20T22:47:26.369100+0000 mgr.a (mgr.14388) 1420 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:47:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:28 smithi179 bash[23186]: cephadm 2024-09-20T22:47:26.379577+0000 mgr.a (mgr.14388) 1421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:47:28.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:28 smithi049 bash[23528]: audit 2024-09-20T22:47:26.369100+0000 mgr.a (mgr.14388) 1420 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:47:28.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:28 smithi049 bash[23528]: cephadm 2024-09-20T22:47:26.379577+0000 mgr.a (mgr.14388) 1421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:47:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:28 smithi044 bash[22676]: audit 2024-09-20T22:47:26.369100+0000 mgr.a (mgr.14388) 1420 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:47:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:28 smithi044 bash[22676]: cephadm 2024-09-20T22:47:26.379577+0000 mgr.a (mgr.14388) 1421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:47:29.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:29 smithi049 bash[23528]: cluster 2024-09-20T22:47:27.729772+0000 mgr.a (mgr.14388) 1422 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:47:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:29 smithi044 bash[22676]: cluster 2024-09-20T22:47:27.729772+0000 mgr.a (mgr.14388) 1422 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:47:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:29 smithi179 bash[23186]: cluster 2024-09-20T22:47:27.729772+0000 mgr.a (mgr.14388) 1422 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:47:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:31 smithi049 bash[23528]: cluster 2024-09-20T22:47:29.730568+0000 mgr.a (mgr.14388) 1423 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:47:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:31 smithi044 bash[22676]: cluster 2024-09-20T22:47:29.730568+0000 mgr.a (mgr.14388) 1423 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:47:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:31 smithi179 bash[23186]: cluster 2024-09-20T22:47:29.730568+0000 mgr.a (mgr.14388) 1423 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:47:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:31.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:31.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:32.548 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:32.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:32.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:32.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:32.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:33 smithi049 bash[23528]: cluster 2024-09-20T22:47:31.732788+0000 mgr.a (mgr.14388) 1424 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:33 smithi049 bash[23528]: audit 2024-09-20T22:47:32.108418+0000 mgr.a (mgr.14388) 1425 : audit [DBG] from='client.43461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:33 smithi044 bash[22676]: cluster 2024-09-20T22:47:31.732788+0000 mgr.a (mgr.14388) 1424 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:33 smithi044 bash[22676]: audit 2024-09-20T22:47:32.108418+0000 mgr.a (mgr.14388) 1425 : audit [DBG] from='client.43461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:33 smithi179 bash[23186]: cluster 2024-09-20T22:47:31.732788+0000 mgr.a (mgr.14388) 1424 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:33 smithi179 bash[23186]: audit 2024-09-20T22:47:32.108418+0000 mgr.a (mgr.14388) 1425 : audit [DBG] from='client.43461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:34.684 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:34 smithi179 bash[23186]: cluster 2024-09-20T22:47:33.733811+0000 mgr.a (mgr.14388) 1426 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:34 smithi044 bash[22676]: cluster 2024-09-20T22:47:33.733811+0000 mgr.a (mgr.14388) 1426 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:34 smithi049 bash[23528]: cluster 2024-09-20T22:47:33.733811+0000 mgr.a (mgr.14388) 1426 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:35 smithi044 bash[22676]: audit 2024-09-20T22:47:34.662410+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:35 smithi044 bash[22676]: audit 2024-09-20T22:47:34.671132+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:35 smithi044 bash[22676]: audit 2024-09-20T22:47:34.681677+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:35 smithi044 bash[22676]: audit 2024-09-20T22:47:34.988253+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:35 smithi044 bash[22676]: audit 2024-09-20T22:47:34.997126+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:35 smithi044 bash[22676]: audit 2024-09-20T22:47:35.008674+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:35 smithi179 bash[23186]: audit 2024-09-20T22:47:34.662410+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:35 smithi179 bash[23186]: audit 2024-09-20T22:47:34.671132+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:35 smithi179 bash[23186]: audit 2024-09-20T22:47:34.681677+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:35 smithi179 bash[23186]: audit 2024-09-20T22:47:34.988253+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:35 smithi179 bash[23186]: audit 2024-09-20T22:47:34.997126+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:35 smithi179 bash[23186]: audit 2024-09-20T22:47:35.008674+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:35 smithi049 bash[23528]: audit 2024-09-20T22:47:34.662410+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:35 smithi049 bash[23528]: audit 2024-09-20T22:47:34.671132+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:35 smithi049 bash[23528]: audit 2024-09-20T22:47:34.681677+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:35 smithi049 bash[23528]: audit 2024-09-20T22:47:34.988253+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:35 smithi049 bash[23528]: audit 2024-09-20T22:47:34.997126+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:35 smithi049 bash[23528]: audit 2024-09-20T22:47:35.008674+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:36 smithi044 bash[22676]: cluster 2024-09-20T22:47:35.736077+0000 mgr.a (mgr.14388) 1427 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:36 smithi179 bash[23186]: cluster 2024-09-20T22:47:35.736077+0000 mgr.a (mgr.14388) 1427 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:36 smithi049 bash[23528]: cluster 2024-09-20T22:47:35.736077+0000 mgr.a (mgr.14388) 1427 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:37.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:37.550 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:37.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:37 smithi049 bash[23528]: audit 2024-09-20T22:47:36.794224+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:37 smithi049 bash[23528]: audit 2024-09-20T22:47:36.803470+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:37 smithi049 bash[23528]: audit 2024-09-20T22:47:36.814983+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:37 smithi044 bash[22676]: audit 2024-09-20T22:47:36.794224+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:37 smithi044 bash[22676]: audit 2024-09-20T22:47:36.803470+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:37 smithi044 bash[22676]: audit 2024-09-20T22:47:36.814983+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:37 smithi179 bash[23186]: audit 2024-09-20T22:47:36.794224+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:37 smithi179 bash[23186]: audit 2024-09-20T22:47:36.803470+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:37 smithi179 bash[23186]: audit 2024-09-20T22:47:36.814983+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:38.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:38.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:38.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:38.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:38.315 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:38 smithi044 bash[22676]: cluster 2024-09-20T22:47:37.736811+0000 mgr.a (mgr.14388) 1428 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:38 smithi044 bash[22676]: audit 2024-09-20T22:47:37.887388+0000 mgr.a (mgr.14388) 1429 : audit [DBG] from='client.43539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:38 smithi179 bash[23186]: cluster 2024-09-20T22:47:37.736811+0000 mgr.a (mgr.14388) 1428 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:38 smithi179 bash[23186]: audit 2024-09-20T22:47:37.887388+0000 mgr.a (mgr.14388) 1429 : audit [DBG] from='client.43539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:38 smithi049 bash[23528]: cluster 2024-09-20T22:47:37.736811+0000 mgr.a (mgr.14388) 1428 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:38 smithi049 bash[23528]: audit 2024-09-20T22:47:37.887388+0000 mgr.a (mgr.14388) 1429 : audit [DBG] from='client.43539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:40 smithi044 bash[22676]: cluster 2024-09-20T22:47:39.737799+0000 mgr.a (mgr.14388) 1430 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:40 smithi179 bash[23186]: cluster 2024-09-20T22:47:39.737799+0000 mgr.a (mgr.14388) 1430 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:40 smithi049 bash[23528]: cluster 2024-09-20T22:47:39.737799+0000 mgr.a (mgr.14388) 1430 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:42 smithi044 bash[22676]: cluster 2024-09-20T22:47:41.738933+0000 mgr.a (mgr.14388) 1431 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:42 smithi179 bash[23186]: cluster 2024-09-20T22:47:41.738933+0000 mgr.a (mgr.14388) 1431 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:42 smithi049 bash[23528]: cluster 2024-09-20T22:47:41.738933+0000 mgr.a (mgr.14388) 1431 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:47:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:44.051 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:44 smithi044 bash[22676]: audit 2024-09-20T22:47:43.640262+0000 mgr.a (mgr.14388) 1432 : audit [DBG] from='client.43617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:44 smithi044 bash[22676]: cluster 2024-09-20T22:47:43.739551+0000 mgr.a (mgr.14388) 1433 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:44 smithi179 bash[23186]: audit 2024-09-20T22:47:43.640262+0000 mgr.a (mgr.14388) 1432 : audit [DBG] from='client.43617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:44 smithi179 bash[23186]: cluster 2024-09-20T22:47:43.739551+0000 mgr.a (mgr.14388) 1433 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:44 smithi049 bash[23528]: audit 2024-09-20T22:47:43.640262+0000 mgr.a (mgr.14388) 1432 : audit [DBG] from='client.43617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:44 smithi049 bash[23528]: cluster 2024-09-20T22:47:43.739551+0000 mgr.a (mgr.14388) 1433 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:46 smithi044 bash[22676]: cluster 2024-09-20T22:47:45.741716+0000 mgr.a (mgr.14388) 1434 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:46 smithi179 bash[23186]: cluster 2024-09-20T22:47:45.741716+0000 mgr.a (mgr.14388) 1434 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:46 smithi049 bash[23528]: cluster 2024-09-20T22:47:45.741716+0000 mgr.a (mgr.14388) 1434 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:49.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:49.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:49.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:48 smithi044 bash[22676]: cluster 2024-09-20T22:47:47.742498+0000 mgr.a (mgr.14388) 1435 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:48 smithi179 bash[23186]: cluster 2024-09-20T22:47:47.742498+0000 mgr.a (mgr.14388) 1435 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:48 smithi049 bash[23528]: cluster 2024-09-20T22:47:47.742498+0000 mgr.a (mgr.14388) 1435 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:49.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:49.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:50 smithi044 bash[22676]: audit 2024-09-20T22:47:49.385120+0000 mgr.a (mgr.14388) 1436 : audit [DBG] from='client.43695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:50 smithi044 bash[22676]: cluster 2024-09-20T22:47:49.743416+0000 mgr.a (mgr.14388) 1437 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:50 smithi179 bash[23186]: audit 2024-09-20T22:47:49.385120+0000 mgr.a (mgr.14388) 1436 : audit [DBG] from='client.43695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:50 smithi179 bash[23186]: cluster 2024-09-20T22:47:49.743416+0000 mgr.a (mgr.14388) 1437 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:50 smithi049 bash[23528]: audit 2024-09-20T22:47:49.385120+0000 mgr.a (mgr.14388) 1436 : audit [DBG] from='client.43695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:50 smithi049 bash[23528]: cluster 2024-09-20T22:47:49.743416+0000 mgr.a (mgr.14388) 1437 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:52 smithi044 bash[22676]: cluster 2024-09-20T22:47:51.745716+0000 mgr.a (mgr.14388) 1438 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:52 smithi179 bash[23186]: cluster 2024-09-20T22:47:51.745716+0000 mgr.a (mgr.14388) 1438 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:52 smithi049 bash[23528]: cluster 2024-09-20T22:47:51.745716+0000 mgr.a (mgr.14388) 1438 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:47:54.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:47:54.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:47:54.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:47:55.213 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:54 smithi049 bash[23528]: cluster 2024-09-20T22:47:53.746448+0000 mgr.a (mgr.14388) 1439 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:54 smithi044 bash[22676]: cluster 2024-09-20T22:47:53.746448+0000 mgr.a (mgr.14388) 1439 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:54 smithi179 bash[23186]: cluster 2024-09-20T22:47:53.746448+0000 mgr.a (mgr.14388) 1439 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:47:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:47:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:47:55.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:47:55.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:47:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:55 smithi044 bash[22676]: audit 2024-09-20T22:47:54.869519+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:55 smithi044 bash[22676]: audit 2024-09-20T22:47:54.876038+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:55 smithi044 bash[22676]: audit 2024-09-20T22:47:54.885658+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:55 smithi044 bash[22676]: audit 2024-09-20T22:47:55.161077+0000 mgr.a (mgr.14388) 1440 : audit [DBG] from='client.43770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:56.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:55 smithi044 bash[22676]: audit 2024-09-20T22:47:55.196963+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:55 smithi044 bash[22676]: audit 2024-09-20T22:47:55.204335+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:55 smithi044 bash[22676]: audit 2024-09-20T22:47:55.211410+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:55 smithi179 bash[23186]: audit 2024-09-20T22:47:54.869519+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:55 smithi179 bash[23186]: audit 2024-09-20T22:47:54.876038+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:55 smithi179 bash[23186]: audit 2024-09-20T22:47:54.885658+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:55 smithi179 bash[23186]: audit 2024-09-20T22:47:55.161077+0000 mgr.a (mgr.14388) 1440 : audit [DBG] from='client.43770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:55 smithi179 bash[23186]: audit 2024-09-20T22:47:55.196963+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:55 smithi179 bash[23186]: audit 2024-09-20T22:47:55.204335+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:55 smithi179 bash[23186]: audit 2024-09-20T22:47:55.211410+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:55 smithi049 bash[23528]: audit 2024-09-20T22:47:54.869519+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:55 smithi049 bash[23528]: audit 2024-09-20T22:47:54.876038+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:55 smithi049 bash[23528]: audit 2024-09-20T22:47:54.885658+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:55 smithi049 bash[23528]: audit 2024-09-20T22:47:55.161077+0000 mgr.a (mgr.14388) 1440 : audit [DBG] from='client.43770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:47:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:55 smithi049 bash[23528]: audit 2024-09-20T22:47:55.196963+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:55 smithi049 bash[23528]: audit 2024-09-20T22:47:55.204335+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:55 smithi049 bash[23528]: audit 2024-09-20T22:47:55.211410+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:57 smithi044 bash[22676]: cluster 2024-09-20T22:47:55.749195+0000 mgr.a (mgr.14388) 1441 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:57 smithi044 bash[22676]: audit 2024-09-20T22:47:57.027349+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:57 smithi044 bash[22676]: audit 2024-09-20T22:47:57.033038+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:57 smithi044 bash[22676]: audit 2024-09-20T22:47:57.040826+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:57 smithi179 bash[23186]: cluster 2024-09-20T22:47:55.749195+0000 mgr.a (mgr.14388) 1441 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:57 smithi179 bash[23186]: audit 2024-09-20T22:47:57.027349+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:57 smithi179 bash[23186]: audit 2024-09-20T22:47:57.033038+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:57 smithi179 bash[23186]: audit 2024-09-20T22:47:57.040826+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:57 smithi049 bash[23528]: cluster 2024-09-20T22:47:55.749195+0000 mgr.a (mgr.14388) 1441 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:47:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:57 smithi049 bash[23528]: audit 2024-09-20T22:47:57.027349+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:57 smithi049 bash[23528]: audit 2024-09-20T22:47:57.033038+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:57 smithi049 bash[23528]: audit 2024-09-20T22:47:57.040826+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:47:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:47:59 smithi044 bash[22676]: cluster 2024-09-20T22:47:57.750031+0000 mgr.a (mgr.14388) 1442 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:47:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:47:59 smithi179 bash[23186]: cluster 2024-09-20T22:47:57.750031+0000 mgr.a (mgr.14388) 1442 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:47:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:47:59 smithi049 bash[23528]: cluster 2024-09-20T22:47:57.750031+0000 mgr.a (mgr.14388) 1442 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:48:00.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:01.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:01.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:01.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:01.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:01.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:01 smithi044 bash[22676]: cluster 2024-09-20T22:47:59.750850+0000 mgr.a (mgr.14388) 1443 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:48:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:01 smithi179 bash[23186]: cluster 2024-09-20T22:47:59.750850+0000 mgr.a (mgr.14388) 1443 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:48:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:01 smithi049 bash[23528]: cluster 2024-09-20T22:47:59.750850+0000 mgr.a (mgr.14388) 1443 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:48:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:02 smithi044 bash[22676]: audit 2024-09-20T22:48:00.906253+0000 mgr.a (mgr.14388) 1444 : audit [DBG] from='client.43848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:02 smithi179 bash[23186]: audit 2024-09-20T22:48:00.906253+0000 mgr.a (mgr.14388) 1444 : audit [DBG] from='client.43848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:02 smithi049 bash[23528]: audit 2024-09-20T22:48:00.906253+0000 mgr.a (mgr.14388) 1444 : audit [DBG] from='client.43848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:03 smithi044 bash[22676]: cluster 2024-09-20T22:48:01.753740+0000 mgr.a (mgr.14388) 1445 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:03 smithi179 bash[23186]: cluster 2024-09-20T22:48:01.753740+0000 mgr.a (mgr.14388) 1445 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:03 smithi049 bash[23528]: cluster 2024-09-20T22:48:01.753740+0000 mgr.a (mgr.14388) 1445 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:05 smithi179 bash[23186]: cluster 2024-09-20T22:48:03.754563+0000 mgr.a (mgr.14388) 1446 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:48:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:05 smithi049 bash[23528]: cluster 2024-09-20T22:48:03.754563+0000 mgr.a (mgr.14388) 1446 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:48:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:05 smithi044 bash[22676]: cluster 2024-09-20T22:48:03.754563+0000 mgr.a (mgr.14388) 1446 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:48:06.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:06.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:06.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:07.115 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:07.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:07.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:07.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:07.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:07.497 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:07 smithi049 bash[23528]: cluster 2024-09-20T22:48:05.756593+0000 mgr.a (mgr.14388) 1447 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:07 smithi179 bash[23186]: cluster 2024-09-20T22:48:05.756593+0000 mgr.a (mgr.14388) 1447 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:07 smithi044 bash[22676]: cluster 2024-09-20T22:48:05.756593+0000 mgr.a (mgr.14388) 1447 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:08.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:08 smithi049 bash[23528]: audit 2024-09-20T22:48:06.670230+0000 mgr.a (mgr.14388) 1448 : audit [DBG] from='client.43920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:08 smithi044 bash[22676]: audit 2024-09-20T22:48:06.670230+0000 mgr.a (mgr.14388) 1448 : audit [DBG] from='client.43920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:08 smithi179 bash[23186]: audit 2024-09-20T22:48:06.670230+0000 mgr.a (mgr.14388) 1448 : audit [DBG] from='client.43920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:09 smithi179 bash[23186]: cluster 2024-09-20T22:48:07.757603+0000 mgr.a (mgr.14388) 1449 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:09 smithi049 bash[23528]: cluster 2024-09-20T22:48:07.757603+0000 mgr.a (mgr.14388) 1449 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:09 smithi044 bash[22676]: cluster 2024-09-20T22:48:07.757603+0000 mgr.a (mgr.14388) 1449 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:11.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:11 smithi049 bash[23528]: cluster 2024-09-20T22:48:09.758393+0000 mgr.a (mgr.14388) 1450 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:11 smithi044 bash[22676]: cluster 2024-09-20T22:48:09.758393+0000 mgr.a (mgr.14388) 1450 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:11 smithi179 bash[23186]: cluster 2024-09-20T22:48:09.758393+0000 mgr.a (mgr.14388) 1450 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:12.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:12.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:12.890 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:12.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:12.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:12.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:12.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:13 smithi049 bash[23528]: cluster 2024-09-20T22:48:11.760592+0000 mgr.a (mgr.14388) 1451 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:13 smithi044 bash[22676]: cluster 2024-09-20T22:48:11.760592+0000 mgr.a (mgr.14388) 1451 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:13 smithi179 bash[23186]: cluster 2024-09-20T22:48:11.760592+0000 mgr.a (mgr.14388) 1451 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:14 smithi049 bash[23528]: audit 2024-09-20T22:48:12.454863+0000 mgr.a (mgr.14388) 1452 : audit [DBG] from='client.43998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:14 smithi044 bash[22676]: audit 2024-09-20T22:48:12.454863+0000 mgr.a (mgr.14388) 1452 : audit [DBG] from='client.43998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:14 smithi179 bash[23186]: audit 2024-09-20T22:48:12.454863+0000 mgr.a (mgr.14388) 1452 : audit [DBG] from='client.43998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:15 smithi179 bash[23186]: cluster 2024-09-20T22:48:13.761604+0000 mgr.a (mgr.14388) 1453 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:15 smithi179 bash[23186]: audit 2024-09-20T22:48:15.096895+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:15 smithi179 bash[23186]: audit 2024-09-20T22:48:15.105649+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:15 smithi179 bash[23186]: audit 2024-09-20T22:48:15.115932+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:15 smithi049 bash[23528]: cluster 2024-09-20T22:48:13.761604+0000 mgr.a (mgr.14388) 1453 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:15 smithi049 bash[23528]: audit 2024-09-20T22:48:15.096895+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:15 smithi049 bash[23528]: audit 2024-09-20T22:48:15.105649+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:15 smithi049 bash[23528]: audit 2024-09-20T22:48:15.115932+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:15 smithi044 bash[22676]: cluster 2024-09-20T22:48:13.761604+0000 mgr.a (mgr.14388) 1453 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:15 smithi044 bash[22676]: audit 2024-09-20T22:48:15.096895+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:15 smithi044 bash[22676]: audit 2024-09-20T22:48:15.105649+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:15 smithi044 bash[22676]: audit 2024-09-20T22:48:15.115932+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:16 smithi044 bash[22676]: audit 2024-09-20T22:48:15.419973+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:16 smithi044 bash[22676]: audit 2024-09-20T22:48:15.428831+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:16 smithi044 bash[22676]: audit 2024-09-20T22:48:15.438860+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:16 smithi044 bash[22676]: cluster 2024-09-20T22:48:15.763831+0000 mgr.a (mgr.14388) 1454 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:16 smithi179 bash[23186]: audit 2024-09-20T22:48:15.419973+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:16 smithi179 bash[23186]: audit 2024-09-20T22:48:15.428831+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:16 smithi179 bash[23186]: audit 2024-09-20T22:48:15.438860+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:16 smithi179 bash[23186]: cluster 2024-09-20T22:48:15.763831+0000 mgr.a (mgr.14388) 1454 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:16.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:16 smithi049 bash[23528]: audit 2024-09-20T22:48:15.419973+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:16 smithi049 bash[23528]: audit 2024-09-20T22:48:15.428831+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:16 smithi049 bash[23528]: audit 2024-09-20T22:48:15.438860+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:16.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:16 smithi049 bash[23528]: cluster 2024-09-20T22:48:15.763831+0000 mgr.a (mgr.14388) 1454 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:17.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:17.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:17.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:18 smithi044 bash[22676]: audit 2024-09-20T22:48:17.238384+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:18 smithi044 bash[22676]: audit 2024-09-20T22:48:17.247050+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:18 smithi044 bash[22676]: audit 2024-09-20T22:48:17.257405+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:18 smithi179 bash[23186]: audit 2024-09-20T22:48:17.238384+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:18 smithi179 bash[23186]: audit 2024-09-20T22:48:17.247050+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:18 smithi179 bash[23186]: audit 2024-09-20T22:48:17.257405+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:18 smithi049 bash[23528]: audit 2024-09-20T22:48:17.238384+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:18 smithi049 bash[23528]: audit 2024-09-20T22:48:17.247050+0000 mon.a (mon.0) 1921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:18 smithi049 bash[23528]: audit 2024-09-20T22:48:17.257405+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:18.679 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:18.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:18.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:18.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:18.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:19 smithi049 bash[23528]: cluster 2024-09-20T22:48:17.764646+0000 mgr.a (mgr.14388) 1455 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:19 smithi049 bash[23528]: audit 2024-09-20T22:48:18.236354+0000 mgr.a (mgr.14388) 1456 : audit [DBG] from='client.44073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:19 smithi044 bash[22676]: cluster 2024-09-20T22:48:17.764646+0000 mgr.a (mgr.14388) 1455 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:19 smithi044 bash[22676]: audit 2024-09-20T22:48:18.236354+0000 mgr.a (mgr.14388) 1456 : audit [DBG] from='client.44073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:19 smithi179 bash[23186]: cluster 2024-09-20T22:48:17.764646+0000 mgr.a (mgr.14388) 1455 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:19 smithi179 bash[23186]: audit 2024-09-20T22:48:18.236354+0000 mgr.a (mgr.14388) 1456 : audit [DBG] from='client.44073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:21 smithi049 bash[23528]: cluster 2024-09-20T22:48:19.765589+0000 mgr.a (mgr.14388) 1457 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:21 smithi044 bash[22676]: cluster 2024-09-20T22:48:19.765589+0000 mgr.a (mgr.14388) 1457 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:21 smithi179 bash[23186]: cluster 2024-09-20T22:48:19.765589+0000 mgr.a (mgr.14388) 1457 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:23 smithi044 bash[22676]: cluster 2024-09-20T22:48:21.767834+0000 mgr.a (mgr.14388) 1458 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:23.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:23 smithi049 bash[23528]: cluster 2024-09-20T22:48:21.767834+0000 mgr.a (mgr.14388) 1458 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:23.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:23.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:23 smithi179 bash[23186]: cluster 2024-09-20T22:48:21.767834+0000 mgr.a (mgr.14388) 1458 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:24.474 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:24.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:24.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:24.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:24.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:25.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:25 smithi049 bash[23528]: cluster 2024-09-20T22:48:23.768341+0000 mgr.a (mgr.14388) 1459 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:25.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:25 smithi049 bash[23528]: audit 2024-09-20T22:48:24.025913+0000 mgr.a (mgr.14388) 1460 : audit [DBG] from='client.44151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:25.591 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:25 smithi044 bash[22676]: cluster 2024-09-20T22:48:23.768341+0000 mgr.a (mgr.14388) 1459 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:25.591 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:25 smithi044 bash[22676]: audit 2024-09-20T22:48:24.025913+0000 mgr.a (mgr.14388) 1460 : audit [DBG] from='client.44151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:25 smithi179 bash[23186]: cluster 2024-09-20T22:48:23.768341+0000 mgr.a (mgr.14388) 1459 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:25 smithi179 bash[23186]: audit 2024-09-20T22:48:24.025913+0000 mgr.a (mgr.14388) 1460 : audit [DBG] from='client.44151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:26 smithi044 bash[22676]: cluster 2024-09-20T22:48:25.770643+0000 mgr.a (mgr.14388) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:26 smithi179 bash[23186]: cluster 2024-09-20T22:48:25.770643+0000 mgr.a (mgr.14388) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:26 smithi049 bash[23528]: cluster 2024-09-20T22:48:25.770643+0000 mgr.a (mgr.14388) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:27.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22930]: debug 2024-09-20T22:48:27.248+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:48:27.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22930]: debug 2024-09-20T22:48:27.248+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: audit 2024-09-20T22:48:26.432900+0000 mon.a (mon.0) 1923 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: audit 2024-09-20T22:48:26.445936+0000 mon.a (mon.0) 1924 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: audit 2024-09-20T22:48:26.447943+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: audit 2024-09-20T22:48:26.460225+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: audit 2024-09-20T22:48:26.466778+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: audit 2024-09-20T22:48:26.469147+0000 mgr.a (mgr.14388) 1462 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: audit 2024-09-20T22:48:27.251261+0000 mgr.a (mgr.14388) 1463 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:48:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:27 smithi044 bash[22676]: cephadm 2024-09-20T22:48:27.252965+0000 mgr.a (mgr.14388) 1464 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: audit 2024-09-20T22:48:26.432900+0000 mon.a (mon.0) 1923 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: audit 2024-09-20T22:48:26.445936+0000 mon.a (mon.0) 1924 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: audit 2024-09-20T22:48:26.447943+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: audit 2024-09-20T22:48:26.460225+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: audit 2024-09-20T22:48:26.466778+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: audit 2024-09-20T22:48:26.469147+0000 mgr.a (mgr.14388) 1462 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: audit 2024-09-20T22:48:27.251261+0000 mgr.a (mgr.14388) 1463 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:48:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:27 smithi179 bash[23186]: cephadm 2024-09-20T22:48:27.252965+0000 mgr.a (mgr.14388) 1464 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: audit 2024-09-20T22:48:26.432900+0000 mon.a (mon.0) 1923 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: audit 2024-09-20T22:48:26.445936+0000 mon.a (mon.0) 1924 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: audit 2024-09-20T22:48:26.447943+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: audit 2024-09-20T22:48:26.460225+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: audit 2024-09-20T22:48:26.466778+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: audit 2024-09-20T22:48:26.469147+0000 mgr.a (mgr.14388) 1462 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: audit 2024-09-20T22:48:27.251261+0000 mgr.a (mgr.14388) 1463 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:27 smithi049 bash[23528]: cephadm 2024-09-20T22:48:27.252965+0000 mgr.a (mgr.14388) 1464 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:48:28.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:28 smithi049 bash[23528]: cluster 2024-09-20T22:48:27.771603+0000 mgr.a (mgr.14388) 1465 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:28.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:28 smithi179 bash[23186]: cluster 2024-09-20T22:48:27.771603+0000 mgr.a (mgr.14388) 1465 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:28 smithi044 bash[22676]: cluster 2024-09-20T22:48:27.771603+0000 mgr.a (mgr.14388) 1465 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:29.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:30.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:30.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:30.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:30.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:30.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:30 smithi179 bash[23186]: cluster 2024-09-20T22:48:29.772376+0000 mgr.a (mgr.14388) 1466 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:30 smithi179 bash[23186]: audit 2024-09-20T22:48:29.806130+0000 mgr.a (mgr.14388) 1467 : audit [DBG] from='client.44331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:30 smithi044 bash[22676]: cluster 2024-09-20T22:48:29.772376+0000 mgr.a (mgr.14388) 1466 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:30 smithi044 bash[22676]: audit 2024-09-20T22:48:29.806130+0000 mgr.a (mgr.14388) 1467 : audit [DBG] from='client.44331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:30 smithi049 bash[23528]: cluster 2024-09-20T22:48:29.772376+0000 mgr.a (mgr.14388) 1466 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:30 smithi049 bash[23528]: audit 2024-09-20T22:48:29.806130+0000 mgr.a (mgr.14388) 1467 : audit [DBG] from='client.44331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:32 smithi044 bash[22676]: cluster 2024-09-20T22:48:31.775057+0000 mgr.a (mgr.14388) 1468 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:32 smithi179 bash[23186]: cluster 2024-09-20T22:48:31.775057+0000 mgr.a (mgr.14388) 1468 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:32 smithi049 bash[23528]: cluster 2024-09-20T22:48:31.775057+0000 mgr.a (mgr.14388) 1468 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:34 smithi044 bash[22676]: cluster 2024-09-20T22:48:33.775857+0000 mgr.a (mgr.14388) 1469 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:35.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:35.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:35.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:34 smithi179 bash[23186]: cluster 2024-09-20T22:48:33.775857+0000 mgr.a (mgr.14388) 1469 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:34 smithi049 bash[23528]: cluster 2024-09-20T22:48:33.775857+0000 mgr.a (mgr.14388) 1469 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:36.010 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:36.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:36.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:36.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:36.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:36 smithi049 bash[23528]: audit 2024-09-20T22:48:35.275829+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:36 smithi049 bash[23528]: audit 2024-09-20T22:48:35.283965+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:36 smithi049 bash[23528]: audit 2024-09-20T22:48:35.293345+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:36 smithi049 bash[23528]: audit 2024-09-20T22:48:35.646777+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:36 smithi049 bash[23528]: audit 2024-09-20T22:48:35.653075+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:36 smithi049 bash[23528]: audit 2024-09-20T22:48:35.660948+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:36 smithi044 bash[22676]: audit 2024-09-20T22:48:35.275829+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:36 smithi044 bash[22676]: audit 2024-09-20T22:48:35.283965+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:36 smithi044 bash[22676]: audit 2024-09-20T22:48:35.293345+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:36 smithi044 bash[22676]: audit 2024-09-20T22:48:35.646777+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:36 smithi044 bash[22676]: audit 2024-09-20T22:48:35.653075+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:36 smithi044 bash[22676]: audit 2024-09-20T22:48:35.660948+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:36 smithi179 bash[23186]: audit 2024-09-20T22:48:35.275829+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:36 smithi179 bash[23186]: audit 2024-09-20T22:48:35.283965+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:36 smithi179 bash[23186]: audit 2024-09-20T22:48:35.293345+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:36 smithi179 bash[23186]: audit 2024-09-20T22:48:35.646777+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:36 smithi179 bash[23186]: audit 2024-09-20T22:48:35.653075+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:36 smithi179 bash[23186]: audit 2024-09-20T22:48:35.660948+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:37 smithi049 bash[23528]: audit 2024-09-20T22:48:35.574291+0000 mgr.a (mgr.14388) 1470 : audit [DBG] from='client.44409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:37 smithi049 bash[23528]: cluster 2024-09-20T22:48:35.777381+0000 mgr.a (mgr.14388) 1471 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:37 smithi044 bash[22676]: audit 2024-09-20T22:48:35.574291+0000 mgr.a (mgr.14388) 1470 : audit [DBG] from='client.44409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:37 smithi044 bash[22676]: cluster 2024-09-20T22:48:35.777381+0000 mgr.a (mgr.14388) 1471 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:37 smithi179 bash[23186]: audit 2024-09-20T22:48:35.574291+0000 mgr.a (mgr.14388) 1470 : audit [DBG] from='client.44409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:37 smithi179 bash[23186]: cluster 2024-09-20T22:48:35.777381+0000 mgr.a (mgr.14388) 1471 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:38 smithi044 bash[22676]: audit 2024-09-20T22:48:37.468622+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:38 smithi044 bash[22676]: audit 2024-09-20T22:48:37.476107+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:38 smithi044 bash[22676]: audit 2024-09-20T22:48:37.486784+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:38 smithi044 bash[22676]: cluster 2024-09-20T22:48:37.778258+0000 mgr.a (mgr.14388) 1472 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:38 smithi179 bash[23186]: audit 2024-09-20T22:48:37.468622+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:38 smithi179 bash[23186]: audit 2024-09-20T22:48:37.476107+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:38 smithi179 bash[23186]: audit 2024-09-20T22:48:37.486784+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:38 smithi179 bash[23186]: cluster 2024-09-20T22:48:37.778258+0000 mgr.a (mgr.14388) 1472 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:38 smithi049 bash[23528]: audit 2024-09-20T22:48:37.468622+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:38 smithi049 bash[23528]: audit 2024-09-20T22:48:37.476107+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:38 smithi049 bash[23528]: audit 2024-09-20T22:48:37.486784+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:38 smithi049 bash[23528]: cluster 2024-09-20T22:48:37.778258+0000 mgr.a (mgr.14388) 1472 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:40 smithi044 bash[22676]: cluster 2024-09-20T22:48:39.779062+0000 mgr.a (mgr.14388) 1473 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:40 smithi179 bash[23186]: cluster 2024-09-20T22:48:39.779062+0000 mgr.a (mgr.14388) 1473 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:40 smithi049 bash[23528]: cluster 2024-09-20T22:48:39.779062+0000 mgr.a (mgr.14388) 1473 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:48:41.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:41.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:41.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:41.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:41.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:42 smithi044 bash[22676]: audit 2024-09-20T22:48:41.341431+0000 mgr.a (mgr.14388) 1474 : audit [DBG] from='client.44487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:42 smithi044 bash[22676]: cluster 2024-09-20T22:48:41.780316+0000 mgr.a (mgr.14388) 1475 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:42 smithi179 bash[23186]: audit 2024-09-20T22:48:41.341431+0000 mgr.a (mgr.14388) 1474 : audit [DBG] from='client.44487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:42 smithi179 bash[23186]: cluster 2024-09-20T22:48:41.780316+0000 mgr.a (mgr.14388) 1475 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:42 smithi049 bash[23528]: audit 2024-09-20T22:48:41.341431+0000 mgr.a (mgr.14388) 1474 : audit [DBG] from='client.44487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:42 smithi049 bash[23528]: cluster 2024-09-20T22:48:41.780316+0000 mgr.a (mgr.14388) 1475 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:48:45.229 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:44 smithi049 bash[23528]: cluster 2024-09-20T22:48:43.781066+0000 mgr.a (mgr.14388) 1476 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:44 smithi044 bash[22676]: cluster 2024-09-20T22:48:43.781066+0000 mgr.a (mgr.14388) 1476 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:44 smithi179 bash[23186]: cluster 2024-09-20T22:48:43.781066+0000 mgr.a (mgr.14388) 1476 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:46.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:46.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:46.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:46 smithi044 bash[22676]: cluster 2024-09-20T22:48:45.782229+0000 mgr.a (mgr.14388) 1477 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:46 smithi179 bash[23186]: cluster 2024-09-20T22:48:45.782229+0000 mgr.a (mgr.14388) 1477 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:46 smithi049 bash[23528]: cluster 2024-09-20T22:48:45.782229+0000 mgr.a (mgr.14388) 1477 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:47.535 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:47.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:47.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:47.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:47.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:48.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:47 smithi049 bash[23528]: audit 2024-09-20T22:48:47.107434+0000 mgr.a (mgr.14388) 1478 : audit [DBG] from='client.44559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:47 smithi044 bash[22676]: audit 2024-09-20T22:48:47.107434+0000 mgr.a (mgr.14388) 1478 : audit [DBG] from='client.44559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:47 smithi179 bash[23186]: audit 2024-09-20T22:48:47.107434+0000 mgr.a (mgr.14388) 1478 : audit [DBG] from='client.44559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:49.119 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:48 smithi179 bash[23186]: cluster 2024-09-20T22:48:47.783180+0000 mgr.a (mgr.14388) 1479 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:48 smithi044 bash[22676]: cluster 2024-09-20T22:48:47.783180+0000 mgr.a (mgr.14388) 1479 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:48 smithi049 bash[23528]: cluster 2024-09-20T22:48:47.783180+0000 mgr.a (mgr.14388) 1479 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:50 smithi179 bash[23186]: cluster 2024-09-20T22:48:49.783987+0000 mgr.a (mgr.14388) 1480 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:50 smithi044 bash[22676]: cluster 2024-09-20T22:48:49.783987+0000 mgr.a (mgr.14388) 1480 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:50 smithi049 bash[23528]: cluster 2024-09-20T22:48:49.783987+0000 mgr.a (mgr.14388) 1480 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:52.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:52.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:52.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:52 smithi049 bash[23528]: cluster 2024-09-20T22:48:51.786214+0000 mgr.a (mgr.14388) 1481 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:52 smithi044 bash[22676]: cluster 2024-09-20T22:48:51.786214+0000 mgr.a (mgr.14388) 1481 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:52 smithi179 bash[23186]: cluster 2024-09-20T22:48:51.786214+0000 mgr.a (mgr.14388) 1481 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:53.280 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:53.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:53.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:53.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:53.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:53 smithi044 bash[22676]: audit 2024-09-20T22:48:52.865188+0000 mgr.a (mgr.14388) 1482 : audit [DBG] from='client.44637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:53 smithi179 bash[23186]: audit 2024-09-20T22:48:52.865188+0000 mgr.a (mgr.14388) 1482 : audit [DBG] from='client.44637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:53 smithi049 bash[23528]: audit 2024-09-20T22:48:52.865188+0000 mgr.a (mgr.14388) 1482 : audit [DBG] from='client.44637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:48:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:54 smithi044 bash[22676]: cluster 2024-09-20T22:48:53.787202+0000 mgr.a (mgr.14388) 1483 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:54 smithi179 bash[23186]: cluster 2024-09-20T22:48:53.787202+0000 mgr.a (mgr.14388) 1483 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:54 smithi049 bash[23528]: cluster 2024-09-20T22:48:53.787202+0000 mgr.a (mgr.14388) 1483 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:56 smithi049 bash[23528]: audit 2024-09-20T22:48:55.504256+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:56 smithi049 bash[23528]: audit 2024-09-20T22:48:55.513867+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:56 smithi049 bash[23528]: audit 2024-09-20T22:48:55.525220+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:56 smithi049 bash[23528]: cluster 2024-09-20T22:48:55.789604+0000 mgr.a (mgr.14388) 1484 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:56 smithi049 bash[23528]: audit 2024-09-20T22:48:55.874573+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:56 smithi049 bash[23528]: audit 2024-09-20T22:48:55.884361+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:56 smithi049 bash[23528]: audit 2024-09-20T22:48:55.894378+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:56 smithi044 bash[22676]: audit 2024-09-20T22:48:55.504256+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:56 smithi044 bash[22676]: audit 2024-09-20T22:48:55.513867+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:56 smithi044 bash[22676]: audit 2024-09-20T22:48:55.525220+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:56 smithi044 bash[22676]: cluster 2024-09-20T22:48:55.789604+0000 mgr.a (mgr.14388) 1484 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:56 smithi044 bash[22676]: audit 2024-09-20T22:48:55.874573+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:56 smithi044 bash[22676]: audit 2024-09-20T22:48:55.884361+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:56 smithi044 bash[22676]: audit 2024-09-20T22:48:55.894378+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:56 smithi179 bash[23186]: audit 2024-09-20T22:48:55.504256+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:56 smithi179 bash[23186]: audit 2024-09-20T22:48:55.513867+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:56 smithi179 bash[23186]: audit 2024-09-20T22:48:55.525220+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:56 smithi179 bash[23186]: cluster 2024-09-20T22:48:55.789604+0000 mgr.a (mgr.14388) 1484 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:56 smithi179 bash[23186]: audit 2024-09-20T22:48:55.874573+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:56 smithi179 bash[23186]: audit 2024-09-20T22:48:55.884361+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:56 smithi179 bash[23186]: audit 2024-09-20T22:48:55.894378+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:58.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:48:58.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:48:58.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:48:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:58 smithi044 bash[22676]: audit 2024-09-20T22:48:57.694914+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:58 smithi044 bash[22676]: audit 2024-09-20T22:48:57.703136+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:58 smithi044 bash[22676]: audit 2024-09-20T22:48:57.713004+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:58 smithi044 bash[22676]: cluster 2024-09-20T22:48:57.790384+0000 mgr.a (mgr.14388) 1485 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:58 smithi179 bash[23186]: audit 2024-09-20T22:48:57.694914+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:58 smithi179 bash[23186]: audit 2024-09-20T22:48:57.703136+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:58 smithi179 bash[23186]: audit 2024-09-20T22:48:57.713004+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:58 smithi179 bash[23186]: cluster 2024-09-20T22:48:57.790384+0000 mgr.a (mgr.14388) 1485 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:58 smithi049 bash[23528]: audit 2024-09-20T22:48:57.694914+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:58 smithi049 bash[23528]: audit 2024-09-20T22:48:57.703136+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:58 smithi049 bash[23528]: audit 2024-09-20T22:48:57.713004+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:48:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:58 smithi049 bash[23528]: cluster 2024-09-20T22:48:57.790384+0000 mgr.a (mgr.14388) 1485 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:48:59.054 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:48:59.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:48:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:48:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:48:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:48:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:48:59 smithi044 bash[22676]: audit 2024-09-20T22:48:58.615600+0000 mgr.a (mgr.14388) 1486 : audit [DBG] from='client.44715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:48:59 smithi179 bash[23186]: audit 2024-09-20T22:48:58.615600+0000 mgr.a (mgr.14388) 1486 : audit [DBG] from='client.44715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:00.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:48:59 smithi049 bash[23528]: audit 2024-09-20T22:48:58.615600+0000 mgr.a (mgr.14388) 1486 : audit [DBG] from='client.44715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:00 smithi044 bash[22676]: cluster 2024-09-20T22:48:59.791298+0000 mgr.a (mgr.14388) 1487 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:00 smithi179 bash[23186]: cluster 2024-09-20T22:48:59.791298+0000 mgr.a (mgr.14388) 1487 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:00 smithi049 bash[23528]: cluster 2024-09-20T22:48:59.791298+0000 mgr.a (mgr.14388) 1487 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:02 smithi044 bash[22676]: cluster 2024-09-20T22:49:01.793547+0000 mgr.a (mgr.14388) 1488 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:02 smithi179 bash[23186]: cluster 2024-09-20T22:49:01.793547+0000 mgr.a (mgr.14388) 1488 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:02 smithi049 bash[23528]: cluster 2024-09-20T22:49:01.793547+0000 mgr.a (mgr.14388) 1488 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:04.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:04.056 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:04.057 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:04.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:04.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:05.101 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:04 smithi044 bash[22676]: cluster 2024-09-20T22:49:03.794309+0000 mgr.a (mgr.14388) 1489 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:04 smithi179 bash[23186]: cluster 2024-09-20T22:49:03.794309+0000 mgr.a (mgr.14388) 1489 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:04 smithi049 bash[23528]: cluster 2024-09-20T22:49:03.794309+0000 mgr.a (mgr.14388) 1489 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:06.110 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:05 smithi049 bash[23528]: audit 2024-09-20T22:49:04.387056+0000 mgr.a (mgr.14388) 1490 : audit [DBG] from='client.44790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:05 smithi044 bash[22676]: audit 2024-09-20T22:49:04.387056+0000 mgr.a (mgr.14388) 1490 : audit [DBG] from='client.44790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:06.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:05 smithi179 bash[23186]: audit 2024-09-20T22:49:04.387056+0000 mgr.a (mgr.14388) 1490 : audit [DBG] from='client.44790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:07.201 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:06 smithi044 bash[22676]: cluster 2024-09-20T22:49:05.796711+0000 mgr.a (mgr.14388) 1491 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:06 smithi179 bash[23186]: cluster 2024-09-20T22:49:05.796711+0000 mgr.a (mgr.14388) 1491 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:06 smithi049 bash[23528]: cluster 2024-09-20T22:49:05.796711+0000 mgr.a (mgr.14388) 1491 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:08 smithi179 bash[23186]: cluster 2024-09-20T22:49:07.797552+0000 mgr.a (mgr.14388) 1492 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:08 smithi044 bash[22676]: cluster 2024-09-20T22:49:07.797552+0000 mgr.a (mgr.14388) 1492 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:08 smithi049 bash[23528]: cluster 2024-09-20T22:49:07.797552+0000 mgr.a (mgr.14388) 1492 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:09.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:09.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:09.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:10.593 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:10.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:10.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:10.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:10.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:10 smithi179 bash[23186]: cluster 2024-09-20T22:49:09.798333+0000 mgr.a (mgr.14388) 1493 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:10 smithi179 bash[23186]: audit 2024-09-20T22:49:10.151271+0000 mgr.a (mgr.14388) 1494 : audit [DBG] from='client.44868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:10 smithi044 bash[22676]: cluster 2024-09-20T22:49:09.798333+0000 mgr.a (mgr.14388) 1493 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:10 smithi044 bash[22676]: audit 2024-09-20T22:49:10.151271+0000 mgr.a (mgr.14388) 1494 : audit [DBG] from='client.44868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:10 smithi049 bash[23528]: cluster 2024-09-20T22:49:09.798333+0000 mgr.a (mgr.14388) 1493 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:10 smithi049 bash[23528]: audit 2024-09-20T22:49:10.151271+0000 mgr.a (mgr.14388) 1494 : audit [DBG] from='client.44868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:12 smithi044 bash[22676]: cluster 2024-09-20T22:49:11.801123+0000 mgr.a (mgr.14388) 1495 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:12 smithi179 bash[23186]: cluster 2024-09-20T22:49:11.801123+0000 mgr.a (mgr.14388) 1495 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:12 smithi049 bash[23528]: cluster 2024-09-20T22:49:11.801123+0000 mgr.a (mgr.14388) 1495 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:14 smithi044 bash[22676]: cluster 2024-09-20T22:49:13.802103+0000 mgr.a (mgr.14388) 1496 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:14 smithi179 bash[23186]: cluster 2024-09-20T22:49:13.802103+0000 mgr.a (mgr.14388) 1496 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:14 smithi049 bash[23528]: cluster 2024-09-20T22:49:13.802103+0000 mgr.a (mgr.14388) 1496 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:15.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:15.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:15.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:16.386 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: audit 2024-09-20T22:49:15.721313+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: audit 2024-09-20T22:49:15.728437+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: audit 2024-09-20T22:49:15.735171+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: cluster 2024-09-20T22:49:15.804077+0000 mgr.a (mgr.14388) 1497 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: audit 2024-09-20T22:49:15.936859+0000 mgr.a (mgr.14388) 1498 : audit [DBG] from='client.44946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: audit 2024-09-20T22:49:16.087847+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: audit 2024-09-20T22:49:16.095350+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:16 smithi044 bash[22676]: audit 2024-09-20T22:49:16.101046+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: audit 2024-09-20T22:49:15.721313+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: audit 2024-09-20T22:49:15.728437+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: audit 2024-09-20T22:49:15.735171+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: cluster 2024-09-20T22:49:15.804077+0000 mgr.a (mgr.14388) 1497 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: audit 2024-09-20T22:49:15.936859+0000 mgr.a (mgr.14388) 1498 : audit [DBG] from='client.44946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: audit 2024-09-20T22:49:16.087847+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: audit 2024-09-20T22:49:16.095350+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:16 smithi179 bash[23186]: audit 2024-09-20T22:49:16.101046+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: audit 2024-09-20T22:49:15.721313+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: audit 2024-09-20T22:49:15.728437+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: audit 2024-09-20T22:49:15.735171+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: cluster 2024-09-20T22:49:15.804077+0000 mgr.a (mgr.14388) 1497 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: audit 2024-09-20T22:49:15.936859+0000 mgr.a (mgr.14388) 1498 : audit [DBG] from='client.44946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: audit 2024-09-20T22:49:16.087847+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: audit 2024-09-20T22:49:16.095350+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:16 smithi049 bash[23528]: audit 2024-09-20T22:49:16.101046+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:18 smithi044 bash[22676]: cluster 2024-09-20T22:49:17.804909+0000 mgr.a (mgr.14388) 1499 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:18 smithi044 bash[22676]: audit 2024-09-20T22:49:17.905542+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:18 smithi044 bash[22676]: audit 2024-09-20T22:49:17.913075+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:18 smithi044 bash[22676]: audit 2024-09-20T22:49:17.922256+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:18 smithi179 bash[23186]: cluster 2024-09-20T22:49:17.804909+0000 mgr.a (mgr.14388) 1499 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:18 smithi179 bash[23186]: audit 2024-09-20T22:49:17.905542+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:18 smithi179 bash[23186]: audit 2024-09-20T22:49:17.913075+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:18 smithi179 bash[23186]: audit 2024-09-20T22:49:17.922256+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:18 smithi049 bash[23528]: cluster 2024-09-20T22:49:17.804909+0000 mgr.a (mgr.14388) 1499 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:18 smithi049 bash[23528]: audit 2024-09-20T22:49:17.905542+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:18 smithi049 bash[23528]: audit 2024-09-20T22:49:17.913075+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:18 smithi049 bash[23528]: audit 2024-09-20T22:49:17.922256+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:20 smithi044 bash[22676]: cluster 2024-09-20T22:49:19.805718+0000 mgr.a (mgr.14388) 1500 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:49:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:20 smithi179 bash[23186]: cluster 2024-09-20T22:49:19.805718+0000 mgr.a (mgr.14388) 1500 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:49:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:20 smithi049 bash[23528]: cluster 2024-09-20T22:49:19.805718+0000 mgr.a (mgr.14388) 1500 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:49:21.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:21.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:21.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:22.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:22.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:22 smithi044 bash[22676]: audit 2024-09-20T22:49:21.726233+0000 mgr.a (mgr.14388) 1501 : audit [DBG] from='client.45021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:22 smithi044 bash[22676]: cluster 2024-09-20T22:49:21.807077+0000 mgr.a (mgr.14388) 1502 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:22 smithi179 bash[23186]: audit 2024-09-20T22:49:21.726233+0000 mgr.a (mgr.14388) 1501 : audit [DBG] from='client.45021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:22 smithi179 bash[23186]: cluster 2024-09-20T22:49:21.807077+0000 mgr.a (mgr.14388) 1502 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:22 smithi049 bash[23528]: audit 2024-09-20T22:49:21.726233+0000 mgr.a (mgr.14388) 1501 : audit [DBG] from='client.45021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:22 smithi049 bash[23528]: cluster 2024-09-20T22:49:21.807077+0000 mgr.a (mgr.14388) 1502 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:24 smithi044 bash[22676]: cluster 2024-09-20T22:49:23.807990+0000 mgr.a (mgr.14388) 1503 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:24 smithi179 bash[23186]: cluster 2024-09-20T22:49:23.807990+0000 mgr.a (mgr.14388) 1503 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:24 smithi049 bash[23528]: cluster 2024-09-20T22:49:23.807990+0000 mgr.a (mgr.14388) 1503 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:26 smithi044 bash[22676]: cluster 2024-09-20T22:49:25.810274+0000 mgr.a (mgr.14388) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:27.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:27.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:26 smithi179 bash[23186]: cluster 2024-09-20T22:49:25.810274+0000 mgr.a (mgr.14388) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:26 smithi049 bash[23528]: cluster 2024-09-20T22:49:25.810274+0000 mgr.a (mgr.14388) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:49:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:27 smithi044 bash[22676]: audit 2024-09-20T22:49:27.316274+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:49:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:27 smithi044 bash[22676]: audit 2024-09-20T22:49:27.320887+0000 mon.a (mon.0) 1956 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:49:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:27 smithi044 bash[22676]: audit 2024-09-20T22:49:27.322205+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:49:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:27 smithi044 bash[22676]: audit 2024-09-20T22:49:27.330973+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:27 smithi044 bash[22676]: audit 2024-09-20T22:49:27.334954+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:49:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:27 smithi179 bash[23186]: audit 2024-09-20T22:49:27.316274+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:49:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:27 smithi179 bash[23186]: audit 2024-09-20T22:49:27.320887+0000 mon.a (mon.0) 1956 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:49:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:27 smithi179 bash[23186]: audit 2024-09-20T22:49:27.322205+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:49:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:27 smithi179 bash[23186]: audit 2024-09-20T22:49:27.330973+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:27 smithi179 bash[23186]: audit 2024-09-20T22:49:27.334954+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:49:28.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:27 smithi049 bash[23528]: audit 2024-09-20T22:49:27.316274+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:49:28.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:27 smithi049 bash[23528]: audit 2024-09-20T22:49:27.320887+0000 mon.a (mon.0) 1956 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:49:28.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:27 smithi049 bash[23528]: audit 2024-09-20T22:49:27.322205+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:49:28.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:27 smithi049 bash[23528]: audit 2024-09-20T22:49:27.330973+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:28.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:27 smithi049 bash[23528]: audit 2024-09-20T22:49:27.334954+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:49:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:28.431 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:28.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:49:28 smithi044 bash[22930]: debug 2024-09-20T22:49:28.043+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:49:28.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:49:28 smithi044 bash[22930]: debug 2024-09-20T22:49:28.051+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:49:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:28 smithi044 bash[22676]: audit 2024-09-20T22:49:27.336404+0000 mgr.a (mgr.14388) 1505 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:49:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:28 smithi044 bash[22676]: audit 2024-09-20T22:49:27.511308+0000 mgr.a (mgr.14388) 1506 : audit [DBG] from='client.45099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:28 smithi044 bash[22676]: cluster 2024-09-20T22:49:27.810842+0000 mgr.a (mgr.14388) 1507 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:29.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:28 smithi044 bash[22676]: audit 2024-09-20T22:49:28.046106+0000 mgr.a (mgr.14388) 1508 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:49:29.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:28 smithi044 bash[22676]: cephadm 2024-09-20T22:49:28.056963+0000 mgr.a (mgr.14388) 1509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:49:29.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:28 smithi179 bash[23186]: audit 2024-09-20T22:49:27.336404+0000 mgr.a (mgr.14388) 1505 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:49:29.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:28 smithi179 bash[23186]: audit 2024-09-20T22:49:27.511308+0000 mgr.a (mgr.14388) 1506 : audit [DBG] from='client.45099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:29.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:28 smithi179 bash[23186]: cluster 2024-09-20T22:49:27.810842+0000 mgr.a (mgr.14388) 1507 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:28 smithi179 bash[23186]: audit 2024-09-20T22:49:28.046106+0000 mgr.a (mgr.14388) 1508 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:49:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:28 smithi179 bash[23186]: cephadm 2024-09-20T22:49:28.056963+0000 mgr.a (mgr.14388) 1509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:49:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:28 smithi049 bash[23528]: audit 2024-09-20T22:49:27.336404+0000 mgr.a (mgr.14388) 1505 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:49:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:28 smithi049 bash[23528]: audit 2024-09-20T22:49:27.511308+0000 mgr.a (mgr.14388) 1506 : audit [DBG] from='client.45099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:28 smithi049 bash[23528]: cluster 2024-09-20T22:49:27.810842+0000 mgr.a (mgr.14388) 1507 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:28 smithi049 bash[23528]: audit 2024-09-20T22:49:28.046106+0000 mgr.a (mgr.14388) 1508 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:49:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:28 smithi049 bash[23528]: cephadm 2024-09-20T22:49:28.056963+0000 mgr.a (mgr.14388) 1509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:49:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:30 smithi044 bash[22676]: cluster 2024-09-20T22:49:29.811743+0000 mgr.a (mgr.14388) 1510 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:30 smithi179 bash[23186]: cluster 2024-09-20T22:49:29.811743+0000 mgr.a (mgr.14388) 1510 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:30 smithi049 bash[23528]: cluster 2024-09-20T22:49:29.811743+0000 mgr.a (mgr.14388) 1510 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:32 smithi044 bash[22676]: cluster 2024-09-20T22:49:31.814013+0000 mgr.a (mgr.14388) 1511 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:33 smithi179 bash[23186]: cluster 2024-09-20T22:49:31.814013+0000 mgr.a (mgr.14388) 1511 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:32 smithi049 bash[23528]: cluster 2024-09-20T22:49:31.814013+0000 mgr.a (mgr.14388) 1511 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:33.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:33.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:33.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:34.186 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:34.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:34.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:34.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:34.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:34 smithi044 bash[22676]: audit 2024-09-20T22:49:33.766313+0000 mgr.a (mgr.14388) 1512 : audit [DBG] from='client.45279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:34 smithi044 bash[22676]: cluster 2024-09-20T22:49:33.815048+0000 mgr.a (mgr.14388) 1513 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:34 smithi179 bash[23186]: audit 2024-09-20T22:49:33.766313+0000 mgr.a (mgr.14388) 1512 : audit [DBG] from='client.45279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:34 smithi179 bash[23186]: cluster 2024-09-20T22:49:33.815048+0000 mgr.a (mgr.14388) 1513 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:34 smithi049 bash[23528]: audit 2024-09-20T22:49:33.766313+0000 mgr.a (mgr.14388) 1512 : audit [DBG] from='client.45279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:34 smithi049 bash[23528]: cluster 2024-09-20T22:49:33.815048+0000 mgr.a (mgr.14388) 1513 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:36 smithi044 bash[22676]: cluster 2024-09-20T22:49:35.817435+0000 mgr.a (mgr.14388) 1514 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:36 smithi044 bash[22676]: audit 2024-09-20T22:49:35.945397+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:36 smithi044 bash[22676]: audit 2024-09-20T22:49:35.958343+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:36 smithi044 bash[22676]: audit 2024-09-20T22:49:35.968589+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:36 smithi044 bash[22676]: audit 2024-09-20T22:49:36.286975+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:36 smithi044 bash[22676]: audit 2024-09-20T22:49:36.296947+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:36 smithi044 bash[22676]: audit 2024-09-20T22:49:36.308410+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:36 smithi179 bash[23186]: cluster 2024-09-20T22:49:35.817435+0000 mgr.a (mgr.14388) 1514 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:36 smithi179 bash[23186]: audit 2024-09-20T22:49:35.945397+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:36 smithi179 bash[23186]: audit 2024-09-20T22:49:35.958343+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:36 smithi179 bash[23186]: audit 2024-09-20T22:49:35.968589+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:36 smithi179 bash[23186]: audit 2024-09-20T22:49:36.286975+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:36 smithi179 bash[23186]: audit 2024-09-20T22:49:36.296947+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:36 smithi179 bash[23186]: audit 2024-09-20T22:49:36.308410+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:36 smithi049 bash[23528]: cluster 2024-09-20T22:49:35.817435+0000 mgr.a (mgr.14388) 1514 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:36 smithi049 bash[23528]: audit 2024-09-20T22:49:35.945397+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:36 smithi049 bash[23528]: audit 2024-09-20T22:49:35.958343+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:36 smithi049 bash[23528]: audit 2024-09-20T22:49:35.968589+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:36 smithi049 bash[23528]: audit 2024-09-20T22:49:36.286975+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:36 smithi049 bash[23528]: audit 2024-09-20T22:49:36.296947+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:36 smithi049 bash[23528]: audit 2024-09-20T22:49:36.308410+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:39.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:39.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:39 smithi044 bash[22676]: cluster 2024-09-20T22:49:37.818206+0000 mgr.a (mgr.14388) 1515 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:39 smithi044 bash[22676]: audit 2024-09-20T22:49:38.085584+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:39 smithi044 bash[22676]: audit 2024-09-20T22:49:38.093763+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:39 smithi044 bash[22676]: audit 2024-09-20T22:49:38.102957+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:39 smithi179 bash[23186]: cluster 2024-09-20T22:49:37.818206+0000 mgr.a (mgr.14388) 1515 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:39 smithi179 bash[23186]: audit 2024-09-20T22:49:38.085584+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:39 smithi179 bash[23186]: audit 2024-09-20T22:49:38.093763+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:39 smithi179 bash[23186]: audit 2024-09-20T22:49:38.102957+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:39 smithi049 bash[23528]: cluster 2024-09-20T22:49:37.818206+0000 mgr.a (mgr.14388) 1515 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:39 smithi049 bash[23528]: audit 2024-09-20T22:49:38.085584+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:39 smithi049 bash[23528]: audit 2024-09-20T22:49:38.093763+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:39 smithi049 bash[23528]: audit 2024-09-20T22:49:38.102957+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:39.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:39.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:39.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:39.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:39.951 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:41 smithi044 bash[22676]: audit 2024-09-20T22:49:39.522256+0000 mgr.a (mgr.14388) 1516 : audit [DBG] from='client.45357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:41 smithi044 bash[22676]: cluster 2024-09-20T22:49:39.818761+0000 mgr.a (mgr.14388) 1517 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:41 smithi179 bash[23186]: audit 2024-09-20T22:49:39.522256+0000 mgr.a (mgr.14388) 1516 : audit [DBG] from='client.45357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:41 smithi179 bash[23186]: cluster 2024-09-20T22:49:39.818761+0000 mgr.a (mgr.14388) 1517 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:41 smithi049 bash[23528]: audit 2024-09-20T22:49:39.522256+0000 mgr.a (mgr.14388) 1516 : audit [DBG] from='client.45357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:41 smithi049 bash[23528]: cluster 2024-09-20T22:49:39.818761+0000 mgr.a (mgr.14388) 1517 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:43 smithi044 bash[22676]: cluster 2024-09-20T22:49:41.821035+0000 mgr.a (mgr.14388) 1518 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:43 smithi179 bash[23186]: cluster 2024-09-20T22:49:41.821035+0000 mgr.a (mgr.14388) 1518 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:43.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:43 smithi049 bash[23528]: cluster 2024-09-20T22:49:41.821035+0000 mgr.a (mgr.14388) 1518 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:49:44.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:44.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:44.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:45.347 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:45 smithi044 bash[22676]: cluster 2024-09-20T22:49:43.821897+0000 mgr.a (mgr.14388) 1519 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:49:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:45 smithi179 bash[23186]: cluster 2024-09-20T22:49:43.821897+0000 mgr.a (mgr.14388) 1519 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:49:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:45 smithi049 bash[23528]: cluster 2024-09-20T22:49:43.821897+0000 mgr.a (mgr.14388) 1519 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:49:45.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:45.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:45.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:45.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:45.712 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:46.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:46 smithi049 bash[23528]: audit 2024-09-20T22:49:45.290036+0000 mgr.a (mgr.14388) 1520 : audit [DBG] from='client.45435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:46.479 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:46 smithi044 bash[22676]: audit 2024-09-20T22:49:45.290036+0000 mgr.a (mgr.14388) 1520 : audit [DBG] from='client.45435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:46 smithi179 bash[23186]: audit 2024-09-20T22:49:45.290036+0000 mgr.a (mgr.14388) 1520 : audit [DBG] from='client.45435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:47 smithi044 bash[22676]: cluster 2024-09-20T22:49:45.824593+0000 mgr.a (mgr.14388) 1521 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:47.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:47 smithi049 bash[23528]: cluster 2024-09-20T22:49:45.824593+0000 mgr.a (mgr.14388) 1521 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:47 smithi179 bash[23186]: cluster 2024-09-20T22:49:45.824593+0000 mgr.a (mgr.14388) 1521 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:49.453 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:49 smithi049 bash[23528]: cluster 2024-09-20T22:49:47.825096+0000 mgr.a (mgr.14388) 1522 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:49 smithi044 bash[22676]: cluster 2024-09-20T22:49:47.825096+0000 mgr.a (mgr.14388) 1522 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:49 smithi179 bash[23186]: cluster 2024-09-20T22:49:47.825096+0000 mgr.a (mgr.14388) 1522 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:49:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:50.715 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:50.715 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:51.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:51 smithi179 bash[23186]: cluster 2024-09-20T22:49:49.825794+0000 mgr.a (mgr.14388) 1523 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:49:51.471 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:51.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:51.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:51.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:51 smithi044 bash[22676]: cluster 2024-09-20T22:49:49.825794+0000 mgr.a (mgr.14388) 1523 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:49:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:51 smithi049 bash[23528]: cluster 2024-09-20T22:49:49.825794+0000 mgr.a (mgr.14388) 1523 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:49:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:52 smithi044 bash[22676]: audit 2024-09-20T22:49:51.047191+0000 mgr.a (mgr.14388) 1524 : audit [DBG] from='client.45513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:52 smithi179 bash[23186]: audit 2024-09-20T22:49:51.047191+0000 mgr.a (mgr.14388) 1524 : audit [DBG] from='client.45513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:52 smithi049 bash[23528]: audit 2024-09-20T22:49:51.047191+0000 mgr.a (mgr.14388) 1524 : audit [DBG] from='client.45513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:53 smithi044 bash[22676]: cluster 2024-09-20T22:49:51.828383+0000 mgr.a (mgr.14388) 1525 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:53 smithi179 bash[23186]: cluster 2024-09-20T22:49:51.828383+0000 mgr.a (mgr.14388) 1525 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:53 smithi049 bash[23528]: cluster 2024-09-20T22:49:51.828383+0000 mgr.a (mgr.14388) 1525 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:55 smithi044 bash[22676]: cluster 2024-09-20T22:49:53.829171+0000 mgr.a (mgr.14388) 1526 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:49:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:55 smithi179 bash[23186]: cluster 2024-09-20T22:49:53.829171+0000 mgr.a (mgr.14388) 1526 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:49:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:55 smithi049 bash[23528]: cluster 2024-09-20T22:49:53.829171+0000 mgr.a (mgr.14388) 1526 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:49:56.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:49:56.473 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:49:56.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:49:57.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:49:57.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:49:57.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:49:57.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:49:57.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:49:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:57 smithi044 bash[22676]: cluster 2024-09-20T22:49:55.831163+0000 mgr.a (mgr.14388) 1527 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:49:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:57 smithi044 bash[22676]: audit 2024-09-20T22:49:56.185570+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:57 smithi044 bash[22676]: audit 2024-09-20T22:49:56.194270+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:57 smithi044 bash[22676]: audit 2024-09-20T22:49:56.204601+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:57 smithi044 bash[22676]: audit 2024-09-20T22:49:56.492026+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:57 smithi044 bash[22676]: audit 2024-09-20T22:49:56.499456+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:57 smithi044 bash[22676]: audit 2024-09-20T22:49:56.508163+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:57 smithi179 bash[23186]: cluster 2024-09-20T22:49:55.831163+0000 mgr.a (mgr.14388) 1527 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:49:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:57 smithi179 bash[23186]: audit 2024-09-20T22:49:56.185570+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:57 smithi179 bash[23186]: audit 2024-09-20T22:49:56.194270+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:57 smithi179 bash[23186]: audit 2024-09-20T22:49:56.204601+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:57 smithi179 bash[23186]: audit 2024-09-20T22:49:56.492026+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:57 smithi179 bash[23186]: audit 2024-09-20T22:49:56.499456+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:57 smithi179 bash[23186]: audit 2024-09-20T22:49:56.508163+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:57 smithi049 bash[23528]: cluster 2024-09-20T22:49:55.831163+0000 mgr.a (mgr.14388) 1527 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:49:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:57 smithi049 bash[23528]: audit 2024-09-20T22:49:56.185570+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:57 smithi049 bash[23528]: audit 2024-09-20T22:49:56.194270+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:57 smithi049 bash[23528]: audit 2024-09-20T22:49:56.204601+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:57 smithi049 bash[23528]: audit 2024-09-20T22:49:56.492026+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:57 smithi049 bash[23528]: audit 2024-09-20T22:49:56.499456+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:57 smithi049 bash[23528]: audit 2024-09-20T22:49:56.508163+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:58 smithi044 bash[22676]: audit 2024-09-20T22:49:56.811792+0000 mgr.a (mgr.14388) 1528 : audit [DBG] from='client.45588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:58 smithi179 bash[23186]: audit 2024-09-20T22:49:56.811792+0000 mgr.a (mgr.14388) 1528 : audit [DBG] from='client.45588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:58 smithi049 bash[23528]: audit 2024-09-20T22:49:56.811792+0000 mgr.a (mgr.14388) 1528 : audit [DBG] from='client.45588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:49:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:59 smithi049 bash[23528]: cluster 2024-09-20T22:49:57.832063+0000 mgr.a (mgr.14388) 1529 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:59 smithi049 bash[23528]: audit 2024-09-20T22:49:58.274757+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:59 smithi049 bash[23528]: audit 2024-09-20T22:49:58.280612+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:49:59 smithi049 bash[23528]: audit 2024-09-20T22:49:58.288162+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:59 smithi044 bash[22676]: cluster 2024-09-20T22:49:57.832063+0000 mgr.a (mgr.14388) 1529 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:59 smithi044 bash[22676]: audit 2024-09-20T22:49:58.274757+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:59 smithi044 bash[22676]: audit 2024-09-20T22:49:58.280612+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:49:59 smithi044 bash[22676]: audit 2024-09-20T22:49:58.288162+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:59 smithi179 bash[23186]: cluster 2024-09-20T22:49:57.832063+0000 mgr.a (mgr.14388) 1529 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:49:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:59 smithi179 bash[23186]: audit 2024-09-20T22:49:58.274757+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:59 smithi179 bash[23186]: audit 2024-09-20T22:49:58.280612+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:49:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:49:59 smithi179 bash[23186]: audit 2024-09-20T22:49:58.288162+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:00 smithi049 bash[23528]: cluster 2024-09-20T22:50:00.000153+0000 mon.a (mon.0) 1978 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:50:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:00 smithi044 bash[22676]: cluster 2024-09-20T22:50:00.000153+0000 mon.a (mon.0) 1978 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:50:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:00 smithi179 bash[23186]: cluster 2024-09-20T22:50:00.000153+0000 mon.a (mon.0) 1978 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T22:50:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:01 smithi049 bash[23528]: cluster 2024-09-20T22:49:59.832972+0000 mgr.a (mgr.14388) 1530 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:01 smithi044 bash[22676]: cluster 2024-09-20T22:49:59.832972+0000 mgr.a (mgr.14388) 1530 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:01 smithi179 bash[23186]: cluster 2024-09-20T22:49:59.832972+0000 mgr.a (mgr.14388) 1530 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:02.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:02.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:02.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:03.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:03 smithi049 bash[23528]: cluster 2024-09-20T22:50:01.835289+0000 mgr.a (mgr.14388) 1531 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:03 smithi044 bash[22676]: cluster 2024-09-20T22:50:01.835289+0000 mgr.a (mgr.14388) 1531 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:03 smithi179 bash[23186]: cluster 2024-09-20T22:50:01.835289+0000 mgr.a (mgr.14388) 1531 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:04.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:04 smithi049 bash[23528]: audit 2024-09-20T22:50:02.596612+0000 mgr.a (mgr.14388) 1532 : audit [DBG] from='client.45666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:04 smithi044 bash[22676]: audit 2024-09-20T22:50:02.596612+0000 mgr.a (mgr.14388) 1532 : audit [DBG] from='client.45666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:04 smithi179 bash[23186]: audit 2024-09-20T22:50:02.596612+0000 mgr.a (mgr.14388) 1532 : audit [DBG] from='client.45666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:05 smithi044 bash[22676]: cluster 2024-09-20T22:50:03.836201+0000 mgr.a (mgr.14388) 1533 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:05 smithi179 bash[23186]: cluster 2024-09-20T22:50:03.836201+0000 mgr.a (mgr.14388) 1533 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:05 smithi049 bash[23528]: cluster 2024-09-20T22:50:03.836201+0000 mgr.a (mgr.14388) 1533 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:07 smithi044 bash[22676]: cluster 2024-09-20T22:50:05.838458+0000 mgr.a (mgr.14388) 1534 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:07 smithi179 bash[23186]: cluster 2024-09-20T22:50:05.838458+0000 mgr.a (mgr.14388) 1534 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:07 smithi049 bash[23528]: cluster 2024-09-20T22:50:05.838458+0000 mgr.a (mgr.14388) 1534 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:08.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:08.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:08.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:08 smithi044 bash[22676]: cluster 2024-09-20T22:50:07.839289+0000 mgr.a (mgr.14388) 1535 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:08.705 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:08 smithi049 bash[23528]: cluster 2024-09-20T22:50:07.839289+0000 mgr.a (mgr.14388) 1535 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:08 smithi179 bash[23186]: cluster 2024-09-20T22:50:07.839289+0000 mgr.a (mgr.14388) 1535 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:08.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:08.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:08.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:08.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:08.807 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:09.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:09 smithi049 bash[23528]: audit 2024-09-20T22:50:08.369849+0000 mgr.a (mgr.14388) 1536 : audit [DBG] from='client.45741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:09 smithi044 bash[22676]: audit 2024-09-20T22:50:08.369849+0000 mgr.a (mgr.14388) 1536 : audit [DBG] from='client.45741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:09 smithi179 bash[23186]: audit 2024-09-20T22:50:08.369849+0000 mgr.a (mgr.14388) 1536 : audit [DBG] from='client.45741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:10 smithi044 bash[22676]: cluster 2024-09-20T22:50:09.840243+0000 mgr.a (mgr.14388) 1537 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:10 smithi179 bash[23186]: cluster 2024-09-20T22:50:09.840243+0000 mgr.a (mgr.14388) 1537 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:10 smithi049 bash[23528]: cluster 2024-09-20T22:50:09.840243+0000 mgr.a (mgr.14388) 1537 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:12 smithi044 bash[22676]: cluster 2024-09-20T22:50:11.842477+0000 mgr.a (mgr.14388) 1538 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:12 smithi179 bash[23186]: cluster 2024-09-20T22:50:11.842477+0000 mgr.a (mgr.14388) 1538 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:12 smithi049 bash[23528]: cluster 2024-09-20T22:50:11.842477+0000 mgr.a (mgr.14388) 1538 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:13.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:13.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:13.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:14.542 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:15.224 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:14 smithi049 bash[23528]: cluster 2024-09-20T22:50:13.843043+0000 mgr.a (mgr.14388) 1539 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:15.224 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:14 smithi049 bash[23528]: audit 2024-09-20T22:50:14.143811+0000 mgr.a (mgr.14388) 1540 : audit [DBG] from='client.45816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:14 smithi044 bash[22676]: cluster 2024-09-20T22:50:13.843043+0000 mgr.a (mgr.14388) 1539 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:14 smithi044 bash[22676]: audit 2024-09-20T22:50:14.143811+0000 mgr.a (mgr.14388) 1540 : audit [DBG] from='client.45816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:14 smithi179 bash[23186]: cluster 2024-09-20T22:50:13.843043+0000 mgr.a (mgr.14388) 1539 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:14 smithi179 bash[23186]: audit 2024-09-20T22:50:14.143811+0000 mgr.a (mgr.14388) 1540 : audit [DBG] from='client.45816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:16 smithi049 bash[23528]: cluster 2024-09-20T22:50:15.845358+0000 mgr.a (mgr.14388) 1541 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:16 smithi049 bash[23528]: audit 2024-09-20T22:50:16.416410+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:16 smithi049 bash[23528]: audit 2024-09-20T22:50:16.426187+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:16 smithi049 bash[23528]: audit 2024-09-20T22:50:16.437735+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:16 smithi049 bash[23528]: audit 2024-09-20T22:50:16.716661+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:16 smithi049 bash[23528]: audit 2024-09-20T22:50:16.726135+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:16 smithi049 bash[23528]: audit 2024-09-20T22:50:16.737553+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:16 smithi044 bash[22676]: cluster 2024-09-20T22:50:15.845358+0000 mgr.a (mgr.14388) 1541 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:16 smithi044 bash[22676]: audit 2024-09-20T22:50:16.416410+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:16 smithi044 bash[22676]: audit 2024-09-20T22:50:16.426187+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:16 smithi044 bash[22676]: audit 2024-09-20T22:50:16.437735+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:16 smithi044 bash[22676]: audit 2024-09-20T22:50:16.716661+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:16 smithi044 bash[22676]: audit 2024-09-20T22:50:16.726135+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:16 smithi044 bash[22676]: audit 2024-09-20T22:50:16.737553+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:16 smithi179 bash[23186]: cluster 2024-09-20T22:50:15.845358+0000 mgr.a (mgr.14388) 1541 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:16 smithi179 bash[23186]: audit 2024-09-20T22:50:16.416410+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:16 smithi179 bash[23186]: audit 2024-09-20T22:50:16.426187+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:16 smithi179 bash[23186]: audit 2024-09-20T22:50:16.437735+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:16 smithi179 bash[23186]: audit 2024-09-20T22:50:16.716661+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:16 smithi179 bash[23186]: audit 2024-09-20T22:50:16.726135+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:16 smithi179 bash[23186]: audit 2024-09-20T22:50:16.737553+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:18 smithi044 bash[22676]: cluster 2024-09-20T22:50:17.846108+0000 mgr.a (mgr.14388) 1542 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:18 smithi044 bash[22676]: audit 2024-09-20T22:50:18.501150+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:18 smithi044 bash[22676]: audit 2024-09-20T22:50:18.509210+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:18 smithi044 bash[22676]: audit 2024-09-20T22:50:18.518952+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:18 smithi179 bash[23186]: cluster 2024-09-20T22:50:17.846108+0000 mgr.a (mgr.14388) 1542 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:18 smithi179 bash[23186]: audit 2024-09-20T22:50:18.501150+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:18 smithi179 bash[23186]: audit 2024-09-20T22:50:18.509210+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:18 smithi179 bash[23186]: audit 2024-09-20T22:50:18.518952+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:18 smithi049 bash[23528]: cluster 2024-09-20T22:50:17.846108+0000 mgr.a (mgr.14388) 1542 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:18 smithi049 bash[23528]: audit 2024-09-20T22:50:18.501150+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:18 smithi049 bash[23528]: audit 2024-09-20T22:50:18.509210+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:18 smithi049 bash[23528]: audit 2024-09-20T22:50:18.518952+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:19.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:19.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:19.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:20.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:20.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:20.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:20.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:20.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:20 smithi044 bash[22676]: cluster 2024-09-20T22:50:19.846837+0000 mgr.a (mgr.14388) 1543 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:20 smithi044 bash[22676]: audit 2024-09-20T22:50:19.878837+0000 mgr.a (mgr.14388) 1544 : audit [DBG] from='client.45894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:20 smithi179 bash[23186]: cluster 2024-09-20T22:50:19.846837+0000 mgr.a (mgr.14388) 1543 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:20 smithi179 bash[23186]: audit 2024-09-20T22:50:19.878837+0000 mgr.a (mgr.14388) 1544 : audit [DBG] from='client.45894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:20 smithi049 bash[23528]: cluster 2024-09-20T22:50:19.846837+0000 mgr.a (mgr.14388) 1543 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:20 smithi049 bash[23528]: audit 2024-09-20T22:50:19.878837+0000 mgr.a (mgr.14388) 1544 : audit [DBG] from='client.45894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:22 smithi044 bash[22676]: cluster 2024-09-20T22:50:21.849533+0000 mgr.a (mgr.14388) 1545 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:22 smithi179 bash[23186]: cluster 2024-09-20T22:50:21.849533+0000 mgr.a (mgr.14388) 1545 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:22 smithi049 bash[23528]: cluster 2024-09-20T22:50:21.849533+0000 mgr.a (mgr.14388) 1545 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:24 smithi044 bash[22676]: cluster 2024-09-20T22:50:23.850302+0000 mgr.a (mgr.14388) 1546 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:50:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:24 smithi179 bash[23186]: cluster 2024-09-20T22:50:23.850302+0000 mgr.a (mgr.14388) 1546 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:50:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:24 smithi049 bash[23528]: cluster 2024-09-20T22:50:23.850302+0000 mgr.a (mgr.14388) 1546 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:50:25.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:25.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:25.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:26.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:26.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:26.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:26.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:26.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:26 smithi044 bash[22676]: audit 2024-09-20T22:50:25.644344+0000 mgr.a (mgr.14388) 1547 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:26 smithi044 bash[22676]: cluster 2024-09-20T22:50:25.851588+0000 mgr.a (mgr.14388) 1548 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:26 smithi179 bash[23186]: audit 2024-09-20T22:50:25.644344+0000 mgr.a (mgr.14388) 1547 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:26 smithi179 bash[23186]: cluster 2024-09-20T22:50:25.851588+0000 mgr.a (mgr.14388) 1548 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:26 smithi049 bash[23528]: audit 2024-09-20T22:50:25.644344+0000 mgr.a (mgr.14388) 1547 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:26 smithi049 bash[23528]: cluster 2024-09-20T22:50:25.851588+0000 mgr.a (mgr.14388) 1548 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: cluster 2024-09-20T22:50:27.852084+0000 mgr.a (mgr.14388) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.110921+0000 mon.a (mon.0) 1988 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.717174+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.723245+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.729328+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.734144+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.735134+0000 mon.a (mon.0) 1993 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.735920+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.740728+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:28 smithi049 bash[23528]: audit 2024-09-20T22:50:28.743393+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: cluster 2024-09-20T22:50:27.852084+0000 mgr.a (mgr.14388) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.110921+0000 mon.a (mon.0) 1988 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.717174+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.723245+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.729328+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.734144+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.735134+0000 mon.a (mon.0) 1993 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.735920+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.740728+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:28 smithi044 bash[22676]: audit 2024-09-20T22:50:28.743393+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:50:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: cluster 2024-09-20T22:50:27.852084+0000 mgr.a (mgr.14388) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:50:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.110921+0000 mon.a (mon.0) 1988 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:50:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.717174+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.723245+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.729328+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.734144+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.735134+0000 mon.a (mon.0) 1993 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:50:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.735920+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:50:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.740728+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:28 smithi179 bash[23186]: audit 2024-09-20T22:50:28.743393+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:50:29.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:50:29 smithi044 bash[22930]: debug 2024-09-20T22:50:29.434+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:50:29.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:50:29 smithi044 bash[22930]: debug 2024-09-20T22:50:29.434+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:50:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:29 smithi044 bash[22676]: audit 2024-09-20T22:50:28.744419+0000 mgr.a (mgr.14388) 1550 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:50:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:29 smithi179 bash[23186]: audit 2024-09-20T22:50:28.744419+0000 mgr.a (mgr.14388) 1550 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:50:30.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:29 smithi049 bash[23528]: audit 2024-09-20T22:50:28.744419+0000 mgr.a (mgr.14388) 1550 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:50:31.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:31.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:30 smithi044 bash[22676]: audit 2024-09-20T22:50:29.439643+0000 mgr.a (mgr.14388) 1551 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:50:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:30 smithi044 bash[22676]: cephadm 2024-09-20T22:50:29.440906+0000 mgr.a (mgr.14388) 1552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:50:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:30 smithi044 bash[22676]: cluster 2024-09-20T22:50:29.852689+0000 mgr.a (mgr.14388) 1553 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:50:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:30 smithi179 bash[23186]: audit 2024-09-20T22:50:29.439643+0000 mgr.a (mgr.14388) 1551 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:50:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:30 smithi179 bash[23186]: cephadm 2024-09-20T22:50:29.440906+0000 mgr.a (mgr.14388) 1552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:50:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:30 smithi179 bash[23186]: cluster 2024-09-20T22:50:29.852689+0000 mgr.a (mgr.14388) 1553 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:50:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:30 smithi049 bash[23528]: audit 2024-09-20T22:50:29.439643+0000 mgr.a (mgr.14388) 1551 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:50:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:30 smithi049 bash[23528]: cephadm 2024-09-20T22:50:29.440906+0000 mgr.a (mgr.14388) 1552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:50:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:30 smithi049 bash[23528]: cluster 2024-09-20T22:50:29.852689+0000 mgr.a (mgr.14388) 1553 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:50:31.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:31.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:31.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:31.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:31.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:33.214 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:32 smithi179 bash[23186]: audit 2024-09-20T22:50:31.408547+0000 mgr.a (mgr.14388) 1554 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:33.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:32 smithi179 bash[23186]: cluster 2024-09-20T22:50:31.853946+0000 mgr.a (mgr.14388) 1555 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:32 smithi044 bash[22676]: audit 2024-09-20T22:50:31.408547+0000 mgr.a (mgr.14388) 1554 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:32 smithi044 bash[22676]: cluster 2024-09-20T22:50:31.853946+0000 mgr.a (mgr.14388) 1555 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:32 smithi049 bash[23528]: audit 2024-09-20T22:50:31.408547+0000 mgr.a (mgr.14388) 1554 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:32 smithi049 bash[23528]: cluster 2024-09-20T22:50:31.853946+0000 mgr.a (mgr.14388) 1555 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:34 smithi044 bash[22676]: cluster 2024-09-20T22:50:33.854635+0000 mgr.a (mgr.14388) 1556 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:34 smithi179 bash[23186]: cluster 2024-09-20T22:50:33.854635+0000 mgr.a (mgr.14388) 1556 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:34 smithi049 bash[23528]: cluster 2024-09-20T22:50:33.854635+0000 mgr.a (mgr.14388) 1556 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:36 smithi044 bash[22676]: cluster 2024-09-20T22:50:35.856632+0000 mgr.a (mgr.14388) 1557 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:36 smithi044 bash[22676]: audit 2024-09-20T22:50:36.650849+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:36 smithi044 bash[22676]: audit 2024-09-20T22:50:36.659695+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:36 smithi044 bash[22676]: audit 2024-09-20T22:50:36.670190+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:36 smithi044 bash[22676]: audit 2024-09-20T22:50:36.941449+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:36 smithi044 bash[22676]: audit 2024-09-20T22:50:36.951132+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:36 smithi179 bash[23186]: cluster 2024-09-20T22:50:35.856632+0000 mgr.a (mgr.14388) 1557 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:36 smithi179 bash[23186]: audit 2024-09-20T22:50:36.650849+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:36 smithi179 bash[23186]: audit 2024-09-20T22:50:36.659695+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:36 smithi179 bash[23186]: audit 2024-09-20T22:50:36.670190+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:36 smithi179 bash[23186]: audit 2024-09-20T22:50:36.941449+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:36 smithi179 bash[23186]: audit 2024-09-20T22:50:36.951132+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:36 smithi049 bash[23528]: cluster 2024-09-20T22:50:35.856632+0000 mgr.a (mgr.14388) 1557 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:36 smithi049 bash[23528]: audit 2024-09-20T22:50:36.650849+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:36 smithi049 bash[23528]: audit 2024-09-20T22:50:36.659695+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:36 smithi049 bash[23528]: audit 2024-09-20T22:50:36.670190+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:36 smithi049 bash[23528]: audit 2024-09-20T22:50:36.941449+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:36 smithi049 bash[23528]: audit 2024-09-20T22:50:36.951132+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:37.620 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:37.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:37 smithi044 bash[22676]: audit 2024-09-20T22:50:36.956456+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:37 smithi044 bash[22676]: audit 2024-09-20T22:50:37.176417+0000 mgr.a (mgr.14388) 1558 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:37 smithi179 bash[23186]: audit 2024-09-20T22:50:36.956456+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:37 smithi179 bash[23186]: audit 2024-09-20T22:50:37.176417+0000 mgr.a (mgr.14388) 1558 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:38.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:37 smithi049 bash[23528]: audit 2024-09-20T22:50:36.956456+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:38.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:37 smithi049 bash[23528]: audit 2024-09-20T22:50:37.176417+0000 mgr.a (mgr.14388) 1558 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:38 smithi044 bash[22676]: cluster 2024-09-20T22:50:37.857760+0000 mgr.a (mgr.14388) 1559 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:38 smithi044 bash[22676]: audit 2024-09-20T22:50:38.723275+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:38 smithi044 bash[22676]: audit 2024-09-20T22:50:38.732063+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:38 smithi044 bash[22676]: audit 2024-09-20T22:50:38.744015+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:38 smithi179 bash[23186]: cluster 2024-09-20T22:50:37.857760+0000 mgr.a (mgr.14388) 1559 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:38 smithi179 bash[23186]: audit 2024-09-20T22:50:38.723275+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:38 smithi179 bash[23186]: audit 2024-09-20T22:50:38.732063+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:38 smithi179 bash[23186]: audit 2024-09-20T22:50:38.744015+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:38 smithi049 bash[23528]: cluster 2024-09-20T22:50:37.857760+0000 mgr.a (mgr.14388) 1559 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:38 smithi049 bash[23528]: audit 2024-09-20T22:50:38.723275+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:38 smithi049 bash[23528]: audit 2024-09-20T22:50:38.732063+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:38 smithi049 bash[23528]: audit 2024-09-20T22:50:38.744015+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:40 smithi044 bash[22676]: cluster 2024-09-20T22:50:39.858565+0000 mgr.a (mgr.14388) 1560 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:40 smithi179 bash[23186]: cluster 2024-09-20T22:50:39.858565+0000 mgr.a (mgr.14388) 1560 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:40 smithi049 bash[23528]: cluster 2024-09-20T22:50:39.858565+0000 mgr.a (mgr.14388) 1560 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:42.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:42.622 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:42.622 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:42 smithi044 bash[22676]: cluster 2024-09-20T22:50:41.860766+0000 mgr.a (mgr.14388) 1561 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:42 smithi179 bash[23186]: cluster 2024-09-20T22:50:41.860766+0000 mgr.a (mgr.14388) 1561 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:42 smithi049 bash[23528]: cluster 2024-09-20T22:50:41.860766+0000 mgr.a (mgr.14388) 1561 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:50:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:44.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:44 smithi049 bash[23528]: audit 2024-09-20T22:50:42.955171+0000 mgr.a (mgr.14388) 1562 : audit [DBG] from='client.46293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:44 smithi044 bash[22676]: audit 2024-09-20T22:50:42.955171+0000 mgr.a (mgr.14388) 1562 : audit [DBG] from='client.46293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:44 smithi179 bash[23186]: audit 2024-09-20T22:50:42.955171+0000 mgr.a (mgr.14388) 1562 : audit [DBG] from='client.46293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:45 smithi049 bash[23528]: cluster 2024-09-20T22:50:43.861782+0000 mgr.a (mgr.14388) 1563 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:45 smithi044 bash[22676]: cluster 2024-09-20T22:50:43.861782+0000 mgr.a (mgr.14388) 1563 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:45 smithi179 bash[23186]: cluster 2024-09-20T22:50:43.861782+0000 mgr.a (mgr.14388) 1563 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:47 smithi049 bash[23528]: cluster 2024-09-20T22:50:45.864052+0000 mgr.a (mgr.14388) 1564 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:47 smithi044 bash[22676]: cluster 2024-09-20T22:50:45.864052+0000 mgr.a (mgr.14388) 1564 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:47 smithi179 bash[23186]: cluster 2024-09-20T22:50:45.864052+0000 mgr.a (mgr.14388) 1564 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:48.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:48.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:49.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:49.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:49.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:49.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:49.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:49 smithi044 bash[22676]: cluster 2024-09-20T22:50:47.864833+0000 mgr.a (mgr.14388) 1565 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:49 smithi049 bash[23528]: cluster 2024-09-20T22:50:47.864833+0000 mgr.a (mgr.14388) 1565 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:49 smithi179 bash[23186]: cluster 2024-09-20T22:50:47.864833+0000 mgr.a (mgr.14388) 1565 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:50 smithi049 bash[23528]: audit 2024-09-20T22:50:48.754917+0000 mgr.a (mgr.14388) 1566 : audit [DBG] from='client.46371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:50 smithi044 bash[22676]: audit 2024-09-20T22:50:48.754917+0000 mgr.a (mgr.14388) 1566 : audit [DBG] from='client.46371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:50 smithi179 bash[23186]: audit 2024-09-20T22:50:48.754917+0000 mgr.a (mgr.14388) 1566 : audit [DBG] from='client.46371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:51 smithi044 bash[22676]: cluster 2024-09-20T22:50:49.865879+0000 mgr.a (mgr.14388) 1567 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:51 smithi049 bash[23528]: cluster 2024-09-20T22:50:49.865879+0000 mgr.a (mgr.14388) 1567 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:51 smithi179 bash[23186]: cluster 2024-09-20T22:50:49.865879+0000 mgr.a (mgr.14388) 1567 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:53 smithi049 bash[23528]: cluster 2024-09-20T22:50:51.868122+0000 mgr.a (mgr.14388) 1568 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:53 smithi044 bash[22676]: cluster 2024-09-20T22:50:51.868122+0000 mgr.a (mgr.14388) 1568 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:53 smithi179 bash[23186]: cluster 2024-09-20T22:50:51.868122+0000 mgr.a (mgr.14388) 1568 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:50:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:54.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:50:54.965 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:50:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:55 smithi179 bash[23186]: cluster 2024-09-20T22:50:53.868897+0000 mgr.a (mgr.14388) 1569 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:55 smithi049 bash[23528]: cluster 2024-09-20T22:50:53.868897+0000 mgr.a (mgr.14388) 1569 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:55 smithi044 bash[22676]: cluster 2024-09-20T22:50:53.868897+0000 mgr.a (mgr.14388) 1569 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:50:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:56 smithi049 bash[23528]: audit 2024-09-20T22:50:54.513335+0000 mgr.a (mgr.14388) 1570 : audit [DBG] from='client.46443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:56.315 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:56 smithi179 bash[23186]: audit 2024-09-20T22:50:54.513335+0000 mgr.a (mgr.14388) 1570 : audit [DBG] from='client.46443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:56 smithi044 bash[22676]: audit 2024-09-20T22:50:54.513335+0000 mgr.a (mgr.14388) 1570 : audit [DBG] from='client.46443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:50:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:57 smithi179 bash[23186]: cluster 2024-09-20T22:50:55.871354+0000 mgr.a (mgr.14388) 1571 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:50:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:57 smithi179 bash[23186]: audit 2024-09-20T22:50:56.883992+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:57 smithi179 bash[23186]: audit 2024-09-20T22:50:56.894315+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:57 smithi179 bash[23186]: audit 2024-09-20T22:50:56.906419+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:57 smithi049 bash[23528]: cluster 2024-09-20T22:50:55.871354+0000 mgr.a (mgr.14388) 1571 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:50:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:57 smithi049 bash[23528]: audit 2024-09-20T22:50:56.883992+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:57 smithi049 bash[23528]: audit 2024-09-20T22:50:56.894315+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:57 smithi049 bash[23528]: audit 2024-09-20T22:50:56.906419+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:57 smithi044 bash[22676]: cluster 2024-09-20T22:50:55.871354+0000 mgr.a (mgr.14388) 1571 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:50:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:57 smithi044 bash[22676]: audit 2024-09-20T22:50:56.883992+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:57 smithi044 bash[22676]: audit 2024-09-20T22:50:56.894315+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:57 smithi044 bash[22676]: audit 2024-09-20T22:50:56.906419+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:58 smithi044 bash[22676]: audit 2024-09-20T22:50:57.173879+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:58 smithi044 bash[22676]: audit 2024-09-20T22:50:57.183647+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:58 smithi044 bash[22676]: audit 2024-09-20T22:50:57.193659+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:58 smithi179 bash[23186]: audit 2024-09-20T22:50:57.173879+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:58 smithi179 bash[23186]: audit 2024-09-20T22:50:57.183647+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:58 smithi179 bash[23186]: audit 2024-09-20T22:50:57.193659+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:58 smithi049 bash[23528]: audit 2024-09-20T22:50:57.173879+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:58 smithi049 bash[23528]: audit 2024-09-20T22:50:57.183647+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:58 smithi049 bash[23528]: audit 2024-09-20T22:50:57.193659+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:59 smithi044 bash[22676]: cluster 2024-09-20T22:50:57.872252+0000 mgr.a (mgr.14388) 1572 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:50:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:59 smithi044 bash[22676]: audit 2024-09-20T22:50:58.961594+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:59 smithi044 bash[22676]: audit 2024-09-20T22:50:58.969833+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:50:59 smithi044 bash[22676]: audit 2024-09-20T22:50:58.979707+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:59 smithi179 bash[23186]: cluster 2024-09-20T22:50:57.872252+0000 mgr.a (mgr.14388) 1572 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:50:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:59 smithi179 bash[23186]: audit 2024-09-20T22:50:58.961594+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:59 smithi179 bash[23186]: audit 2024-09-20T22:50:58.969833+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:50:59 smithi179 bash[23186]: audit 2024-09-20T22:50:58.979707+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:59 smithi049 bash[23528]: cluster 2024-09-20T22:50:57.872252+0000 mgr.a (mgr.14388) 1572 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:50:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:59 smithi049 bash[23528]: audit 2024-09-20T22:50:58.961594+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:59 smithi049 bash[23528]: audit 2024-09-20T22:50:58.969833+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:50:59 smithi049 bash[23528]: audit 2024-09-20T22:50:58.979707+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:50:59.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:50:59.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:50:59.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:00.750 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:00.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:00.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:00.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:00.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:01 smithi044 bash[22676]: cluster 2024-09-20T22:50:59.873046+0000 mgr.a (mgr.14388) 1573 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:51:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:01 smithi044 bash[22676]: audit 2024-09-20T22:51:00.302196+0000 mgr.a (mgr.14388) 1574 : audit [DBG] from='client.46521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:01 smithi179 bash[23186]: cluster 2024-09-20T22:50:59.873046+0000 mgr.a (mgr.14388) 1573 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:51:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:01 smithi179 bash[23186]: audit 2024-09-20T22:51:00.302196+0000 mgr.a (mgr.14388) 1574 : audit [DBG] from='client.46521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:01 smithi049 bash[23528]: cluster 2024-09-20T22:50:59.873046+0000 mgr.a (mgr.14388) 1573 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:51:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:01 smithi049 bash[23528]: audit 2024-09-20T22:51:00.302196+0000 mgr.a (mgr.14388) 1574 : audit [DBG] from='client.46521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:03 smithi044 bash[22676]: cluster 2024-09-20T22:51:01.875836+0000 mgr.a (mgr.14388) 1575 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:03 smithi179 bash[23186]: cluster 2024-09-20T22:51:01.875836+0000 mgr.a (mgr.14388) 1575 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:03 smithi049 bash[23528]: cluster 2024-09-20T22:51:01.875836+0000 mgr.a (mgr.14388) 1575 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:05 smithi044 bash[22676]: cluster 2024-09-20T22:51:03.876626+0000 mgr.a (mgr.14388) 1576 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:51:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:05 smithi179 bash[23186]: cluster 2024-09-20T22:51:03.876626+0000 mgr.a (mgr.14388) 1576 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:51:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:05 smithi049 bash[23528]: cluster 2024-09-20T22:51:03.876626+0000 mgr.a (mgr.14388) 1576 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:51:05.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:05.752 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:05.752 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:06.494 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:07 smithi044 bash[22676]: cluster 2024-09-20T22:51:05.878070+0000 mgr.a (mgr.14388) 1577 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:07 smithi044 bash[22676]: audit 2024-09-20T22:51:06.079972+0000 mgr.a (mgr.14388) 1578 : audit [DBG] from='client.46593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:07 smithi179 bash[23186]: cluster 2024-09-20T22:51:05.878070+0000 mgr.a (mgr.14388) 1577 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:07 smithi179 bash[23186]: audit 2024-09-20T22:51:06.079972+0000 mgr.a (mgr.14388) 1578 : audit [DBG] from='client.46593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:07.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:07 smithi049 bash[23528]: cluster 2024-09-20T22:51:05.878070+0000 mgr.a (mgr.14388) 1577 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:07.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:07 smithi049 bash[23528]: audit 2024-09-20T22:51:06.079972+0000 mgr.a (mgr.14388) 1578 : audit [DBG] from='client.46593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:09 smithi049 bash[23528]: cluster 2024-09-20T22:51:07.879044+0000 mgr.a (mgr.14388) 1579 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:51:09.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:09 smithi044 bash[22676]: cluster 2024-09-20T22:51:07.879044+0000 mgr.a (mgr.14388) 1579 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:51:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:09 smithi179 bash[23186]: cluster 2024-09-20T22:51:07.879044+0000 mgr.a (mgr.14388) 1579 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:51:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:11 smithi044 bash[22676]: cluster 2024-09-20T22:51:09.879856+0000 mgr.a (mgr.14388) 1580 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:51:11.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:11.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:11.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:11 smithi179 bash[23186]: cluster 2024-09-20T22:51:09.879856+0000 mgr.a (mgr.14388) 1580 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:51:11.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:11 smithi049 bash[23528]: cluster 2024-09-20T22:51:09.879856+0000 mgr.a (mgr.14388) 1580 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:51:12.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:13 smithi044 bash[22676]: audit 2024-09-20T22:51:11.821270+0000 mgr.a (mgr.14388) 1581 : audit [DBG] from='client.46671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:13 smithi044 bash[22676]: cluster 2024-09-20T22:51:11.882110+0000 mgr.a (mgr.14388) 1582 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:51:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:13 smithi179 bash[23186]: audit 2024-09-20T22:51:11.821270+0000 mgr.a (mgr.14388) 1581 : audit [DBG] from='client.46671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:13 smithi179 bash[23186]: cluster 2024-09-20T22:51:11.882110+0000 mgr.a (mgr.14388) 1582 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:51:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:13 smithi049 bash[23528]: audit 2024-09-20T22:51:11.821270+0000 mgr.a (mgr.14388) 1581 : audit [DBG] from='client.46671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:13 smithi049 bash[23528]: cluster 2024-09-20T22:51:11.882110+0000 mgr.a (mgr.14388) 1582 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:51:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:15 smithi044 bash[22676]: cluster 2024-09-20T22:51:13.882982+0000 mgr.a (mgr.14388) 1583 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:15 smithi179 bash[23186]: cluster 2024-09-20T22:51:13.882982+0000 mgr.a (mgr.14388) 1583 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:15 smithi049 bash[23528]: cluster 2024-09-20T22:51:13.882982+0000 mgr.a (mgr.14388) 1583 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:17.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:17.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:17.407 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:17 smithi049 bash[23528]: cluster 2024-09-20T22:51:15.885198+0000 mgr.a (mgr.14388) 1584 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:17.407 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:17 smithi049 bash[23528]: audit 2024-09-20T22:51:17.081050+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.407 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:17 smithi049 bash[23528]: audit 2024-09-20T22:51:17.090373+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.407 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:17 smithi049 bash[23528]: audit 2024-09-20T22:51:17.101718+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:17 smithi044 bash[22676]: cluster 2024-09-20T22:51:15.885198+0000 mgr.a (mgr.14388) 1584 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:17 smithi044 bash[22676]: audit 2024-09-20T22:51:17.081050+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:17 smithi044 bash[22676]: audit 2024-09-20T22:51:17.090373+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:17 smithi044 bash[22676]: audit 2024-09-20T22:51:17.101718+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:17 smithi179 bash[23186]: cluster 2024-09-20T22:51:15.885198+0000 mgr.a (mgr.14388) 1584 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:17 smithi179 bash[23186]: audit 2024-09-20T22:51:17.081050+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:17 smithi179 bash[23186]: audit 2024-09-20T22:51:17.090373+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:17 smithi179 bash[23186]: audit 2024-09-20T22:51:17.101718+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:18.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:18.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:18.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:18.029 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:18 smithi044 bash[22676]: audit 2024-09-20T22:51:17.389071+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:18 smithi044 bash[22676]: audit 2024-09-20T22:51:17.396023+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:18 smithi044 bash[22676]: audit 2024-09-20T22:51:17.404867+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:18 smithi044 bash[22676]: audit 2024-09-20T22:51:17.584050+0000 mgr.a (mgr.14388) 1585 : audit [DBG] from='client.46746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:18 smithi044 bash[22676]: cluster 2024-09-20T22:51:17.885736+0000 mgr.a (mgr.14388) 1586 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:18 smithi179 bash[23186]: audit 2024-09-20T22:51:17.389071+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:18 smithi179 bash[23186]: audit 2024-09-20T22:51:17.396023+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:18 smithi179 bash[23186]: audit 2024-09-20T22:51:17.404867+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:18 smithi179 bash[23186]: audit 2024-09-20T22:51:17.584050+0000 mgr.a (mgr.14388) 1585 : audit [DBG] from='client.46746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:18 smithi179 bash[23186]: cluster 2024-09-20T22:51:17.885736+0000 mgr.a (mgr.14388) 1586 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:18 smithi049 bash[23528]: audit 2024-09-20T22:51:17.389071+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:18 smithi049 bash[23528]: audit 2024-09-20T22:51:17.396023+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:18 smithi049 bash[23528]: audit 2024-09-20T22:51:17.404867+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:18 smithi049 bash[23528]: audit 2024-09-20T22:51:17.584050+0000 mgr.a (mgr.14388) 1585 : audit [DBG] from='client.46746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:18 smithi049 bash[23528]: cluster 2024-09-20T22:51:17.885736+0000 mgr.a (mgr.14388) 1586 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:20 smithi044 bash[22676]: audit 2024-09-20T22:51:19.178299+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:20 smithi044 bash[22676]: audit 2024-09-20T22:51:19.186481+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:20 smithi044 bash[22676]: audit 2024-09-20T22:51:19.196815+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:20 smithi179 bash[23186]: audit 2024-09-20T22:51:19.178299+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:20 smithi179 bash[23186]: audit 2024-09-20T22:51:19.186481+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:20 smithi179 bash[23186]: audit 2024-09-20T22:51:19.196815+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:20 smithi049 bash[23528]: audit 2024-09-20T22:51:19.178299+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:20 smithi049 bash[23528]: audit 2024-09-20T22:51:19.186481+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:20 smithi049 bash[23528]: audit 2024-09-20T22:51:19.196815+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:21 smithi044 bash[22676]: cluster 2024-09-20T22:51:19.886585+0000 mgr.a (mgr.14388) 1587 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:21 smithi179 bash[23186]: cluster 2024-09-20T22:51:19.886585+0000 mgr.a (mgr.14388) 1587 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:21 smithi049 bash[23528]: cluster 2024-09-20T22:51:19.886585+0000 mgr.a (mgr.14388) 1587 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:23.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:23 smithi044 bash[22676]: cluster 2024-09-20T22:51:21.888783+0000 mgr.a (mgr.14388) 1588 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:23 smithi179 bash[23186]: cluster 2024-09-20T22:51:21.888783+0000 mgr.a (mgr.14388) 1588 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:23.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:23 smithi049 bash[23528]: cluster 2024-09-20T22:51:21.888783+0000 mgr.a (mgr.14388) 1588 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:23.808 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:23.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:23.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:23.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:23.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:25 smithi044 bash[22676]: audit 2024-09-20T22:51:23.367677+0000 mgr.a (mgr.14388) 1589 : audit [DBG] from='client.46821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:25 smithi044 bash[22676]: cluster 2024-09-20T22:51:23.889518+0000 mgr.a (mgr.14388) 1590 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:25 smithi179 bash[23186]: audit 2024-09-20T22:51:23.367677+0000 mgr.a (mgr.14388) 1589 : audit [DBG] from='client.46821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:25 smithi179 bash[23186]: cluster 2024-09-20T22:51:23.889518+0000 mgr.a (mgr.14388) 1590 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:25.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:25 smithi049 bash[23528]: audit 2024-09-20T22:51:23.367677+0000 mgr.a (mgr.14388) 1589 : audit [DBG] from='client.46821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:25.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:25 smithi049 bash[23528]: cluster 2024-09-20T22:51:23.889518+0000 mgr.a (mgr.14388) 1590 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:27 smithi044 bash[22676]: cluster 2024-09-20T22:51:25.891676+0000 mgr.a (mgr.14388) 1591 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:27 smithi179 bash[23186]: cluster 2024-09-20T22:51:25.891676+0000 mgr.a (mgr.14388) 1591 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:27.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:27 smithi049 bash[23528]: cluster 2024-09-20T22:51:25.891676+0000 mgr.a (mgr.14388) 1591 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:29 smithi049 bash[23528]: cluster 2024-09-20T22:51:27.892462+0000 mgr.a (mgr.14388) 1592 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:29 smithi044 bash[22676]: cluster 2024-09-20T22:51:27.892462+0000 mgr.a (mgr.14388) 1592 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:29 smithi179 bash[23186]: cluster 2024-09-20T22:51:27.892462+0000 mgr.a (mgr.14388) 1592 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:29.597 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:29.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:30.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:29.152909+0000 mgr.a (mgr.14388) 1593 : audit [DBG] from='client.46896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:29.492741+0000 mon.a (mon.0) 2024 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:51:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:30.036361+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:30.044847+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:30.046254+0000 mon.a (mon.0) 2027 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:51:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:30.047238+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:51:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:30.056418+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22676]: audit 2024-09-20T22:51:30.059587+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:29.152909+0000 mgr.a (mgr.14388) 1593 : audit [DBG] from='client.46896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:29.492741+0000 mon.a (mon.0) 2024 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:30.036361+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:30.044847+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:30.046254+0000 mon.a (mon.0) 2027 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:30.047238+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:30.056418+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:30 smithi179 bash[23186]: audit 2024-09-20T22:51:30.059587+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:51:30.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:29.152909+0000 mgr.a (mgr.14388) 1593 : audit [DBG] from='client.46896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:29.492741+0000 mon.a (mon.0) 2024 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:51:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:30.036361+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:30.044847+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:30.046254+0000 mon.a (mon.0) 2027 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:51:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:30.047238+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:51:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:30.056418+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:30 smithi049 bash[23528]: audit 2024-09-20T22:51:30.059587+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:51:31.217 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22930]: debug 2024-09-20T22:51:30.765+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:51:31.218 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:51:30 smithi044 bash[22930]: debug 2024-09-20T22:51:30.765+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:51:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:31 smithi044 bash[22676]: cluster 2024-09-20T22:51:29.893450+0000 mgr.a (mgr.14388) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:31 smithi044 bash[22676]: audit 2024-09-20T22:51:30.060643+0000 mgr.a (mgr.14388) 1595 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:51:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:31 smithi179 bash[23186]: cluster 2024-09-20T22:51:29.893450+0000 mgr.a (mgr.14388) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:31 smithi179 bash[23186]: audit 2024-09-20T22:51:30.060643+0000 mgr.a (mgr.14388) 1595 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:51:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:31 smithi049 bash[23528]: cluster 2024-09-20T22:51:29.893450+0000 mgr.a (mgr.14388) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:31 smithi049 bash[23528]: audit 2024-09-20T22:51:30.060643+0000 mgr.a (mgr.14388) 1595 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:51:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:32 smithi044 bash[22676]: audit 2024-09-20T22:51:30.770276+0000 mgr.a (mgr.14388) 1596 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:51:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:32 smithi044 bash[22676]: cephadm 2024-09-20T22:51:30.771394+0000 mgr.a (mgr.14388) 1597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:51:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:32 smithi179 bash[23186]: audit 2024-09-20T22:51:30.770276+0000 mgr.a (mgr.14388) 1596 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:51:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:32 smithi179 bash[23186]: cephadm 2024-09-20T22:51:30.771394+0000 mgr.a (mgr.14388) 1597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:51:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:32 smithi049 bash[23528]: audit 2024-09-20T22:51:30.770276+0000 mgr.a (mgr.14388) 1596 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:51:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:32 smithi049 bash[23528]: cephadm 2024-09-20T22:51:30.771394+0000 mgr.a (mgr.14388) 1597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:51:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:33 smithi179 bash[23186]: cluster 2024-09-20T22:51:31.896076+0000 mgr.a (mgr.14388) 1598 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:33 smithi049 bash[23528]: cluster 2024-09-20T22:51:31.896076+0000 mgr.a (mgr.14388) 1598 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:33 smithi044 bash[22676]: cluster 2024-09-20T22:51:31.896076+0000 mgr.a (mgr.14388) 1598 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:34.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:34.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:34.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:35.371 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:35.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:35.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:35.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:35 smithi179 bash[23186]: cluster 2024-09-20T22:51:33.896862+0000 mgr.a (mgr.14388) 1599 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:35 smithi049 bash[23528]: cluster 2024-09-20T22:51:33.896862+0000 mgr.a (mgr.14388) 1599 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:35 smithi044 bash[22676]: cluster 2024-09-20T22:51:33.896862+0000 mgr.a (mgr.14388) 1599 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:36 smithi179 bash[23186]: audit 2024-09-20T22:51:34.937845+0000 mgr.a (mgr.14388) 1600 : audit [DBG] from='client.47079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:36 smithi049 bash[23528]: audit 2024-09-20T22:51:34.937845+0000 mgr.a (mgr.14388) 1600 : audit [DBG] from='client.47079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:36 smithi044 bash[22676]: audit 2024-09-20T22:51:34.937845+0000 mgr.a (mgr.14388) 1600 : audit [DBG] from='client.47079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:37 smithi049 bash[23528]: cluster 2024-09-20T22:51:35.899713+0000 mgr.a (mgr.14388) 1601 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:37 smithi044 bash[22676]: cluster 2024-09-20T22:51:35.899713+0000 mgr.a (mgr.14388) 1601 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:37 smithi179 bash[23186]: cluster 2024-09-20T22:51:35.899713+0000 mgr.a (mgr.14388) 1601 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:38 smithi044 bash[22676]: audit 2024-09-20T22:51:37.319401+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:38 smithi044 bash[22676]: audit 2024-09-20T22:51:37.329079+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:38 smithi044 bash[22676]: audit 2024-09-20T22:51:37.340990+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:38 smithi044 bash[22676]: audit 2024-09-20T22:51:37.615623+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:38 smithi044 bash[22676]: audit 2024-09-20T22:51:37.625615+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:38 smithi044 bash[22676]: audit 2024-09-20T22:51:37.636953+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:38 smithi179 bash[23186]: audit 2024-09-20T22:51:37.319401+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:38 smithi179 bash[23186]: audit 2024-09-20T22:51:37.329079+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:38 smithi179 bash[23186]: audit 2024-09-20T22:51:37.340990+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:38 smithi179 bash[23186]: audit 2024-09-20T22:51:37.615623+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:38 smithi179 bash[23186]: audit 2024-09-20T22:51:37.625615+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:38 smithi179 bash[23186]: audit 2024-09-20T22:51:37.636953+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:38 smithi049 bash[23528]: audit 2024-09-20T22:51:37.319401+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:38 smithi049 bash[23528]: audit 2024-09-20T22:51:37.329079+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:38 smithi049 bash[23528]: audit 2024-09-20T22:51:37.340990+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:38 smithi049 bash[23528]: audit 2024-09-20T22:51:37.615623+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:38 smithi049 bash[23528]: audit 2024-09-20T22:51:37.625615+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:38 smithi049 bash[23528]: audit 2024-09-20T22:51:37.636953+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:39 smithi044 bash[22676]: cluster 2024-09-20T22:51:37.900486+0000 mgr.a (mgr.14388) 1602 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:39 smithi179 bash[23186]: cluster 2024-09-20T22:51:37.900486+0000 mgr.a (mgr.14388) 1602 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:39.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:39 smithi049 bash[23528]: cluster 2024-09-20T22:51:37.900486+0000 mgr.a (mgr.14388) 1602 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:40 smithi044 bash[22676]: audit 2024-09-20T22:51:39.405536+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:40 smithi044 bash[22676]: audit 2024-09-20T22:51:39.414109+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:40 smithi044 bash[22676]: audit 2024-09-20T22:51:39.424220+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:40 smithi044 bash[22676]: cluster 2024-09-20T22:51:39.901413+0000 mgr.a (mgr.14388) 1603 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:40 smithi179 bash[23186]: audit 2024-09-20T22:51:39.405536+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:40 smithi179 bash[23186]: audit 2024-09-20T22:51:39.414109+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:40 smithi179 bash[23186]: audit 2024-09-20T22:51:39.424220+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:40 smithi179 bash[23186]: cluster 2024-09-20T22:51:39.901413+0000 mgr.a (mgr.14388) 1603 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:40 smithi049 bash[23528]: audit 2024-09-20T22:51:39.405536+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:40 smithi049 bash[23528]: audit 2024-09-20T22:51:39.414109+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:40 smithi049 bash[23528]: audit 2024-09-20T22:51:39.424220+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:40 smithi049 bash[23528]: cluster 2024-09-20T22:51:39.901413+0000 mgr.a (mgr.14388) 1603 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:41.157 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:41.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:41.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:41.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:41.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:41 smithi044 bash[22676]: audit 2024-09-20T22:51:40.713089+0000 mgr.a (mgr.14388) 1604 : audit [DBG] from='client.47151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:41 smithi179 bash[23186]: audit 2024-09-20T22:51:40.713089+0000 mgr.a (mgr.14388) 1604 : audit [DBG] from='client.47151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:41 smithi049 bash[23528]: audit 2024-09-20T22:51:40.713089+0000 mgr.a (mgr.14388) 1604 : audit [DBG] from='client.47151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:42 smithi044 bash[22676]: cluster 2024-09-20T22:51:41.904198+0000 mgr.a (mgr.14388) 1605 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:42 smithi179 bash[23186]: cluster 2024-09-20T22:51:41.904198+0000 mgr.a (mgr.14388) 1605 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:42 smithi049 bash[23528]: cluster 2024-09-20T22:51:41.904198+0000 mgr.a (mgr.14388) 1605 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:44 smithi044 bash[22676]: cluster 2024-09-20T22:51:43.904984+0000 mgr.a (mgr.14388) 1606 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:44 smithi179 bash[23186]: cluster 2024-09-20T22:51:43.904984+0000 mgr.a (mgr.14388) 1606 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:44 smithi049 bash[23528]: cluster 2024-09-20T22:51:43.904984+0000 mgr.a (mgr.14388) 1606 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:51:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:46.948 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:46.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:46.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:46.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:46.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:46 smithi044 bash[22676]: cluster 2024-09-20T22:51:45.907011+0000 mgr.a (mgr.14388) 1607 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:46 smithi179 bash[23186]: cluster 2024-09-20T22:51:45.907011+0000 mgr.a (mgr.14388) 1607 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:46 smithi049 bash[23528]: cluster 2024-09-20T22:51:45.907011+0000 mgr.a (mgr.14388) 1607 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:51:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:47 smithi044 bash[22676]: audit 2024-09-20T22:51:46.496477+0000 mgr.a (mgr.14388) 1608 : audit [DBG] from='client.47223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:47 smithi179 bash[23186]: audit 2024-09-20T22:51:46.496477+0000 mgr.a (mgr.14388) 1608 : audit [DBG] from='client.47223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:48.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:47 smithi049 bash[23528]: audit 2024-09-20T22:51:46.496477+0000 mgr.a (mgr.14388) 1608 : audit [DBG] from='client.47223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:48 smithi044 bash[22676]: cluster 2024-09-20T22:51:47.907961+0000 mgr.a (mgr.14388) 1609 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:48 smithi179 bash[23186]: cluster 2024-09-20T22:51:47.907961+0000 mgr.a (mgr.14388) 1609 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:48 smithi049 bash[23528]: cluster 2024-09-20T22:51:47.907961+0000 mgr.a (mgr.14388) 1609 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:51.179 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:50 smithi044 bash[22676]: cluster 2024-09-20T22:51:49.908746+0000 mgr.a (mgr.14388) 1610 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:50 smithi179 bash[23186]: cluster 2024-09-20T22:51:49.908746+0000 mgr.a (mgr.14388) 1610 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:50 smithi049 bash[23528]: cluster 2024-09-20T22:51:49.908746+0000 mgr.a (mgr.14388) 1610 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:51.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:51.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:52.724 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:52.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:52 smithi044 bash[22676]: cluster 2024-09-20T22:51:51.910968+0000 mgr.a (mgr.14388) 1611 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:52 smithi044 bash[22676]: audit 2024-09-20T22:51:52.296155+0000 mgr.a (mgr.14388) 1612 : audit [DBG] from='client.47301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:52 smithi179 bash[23186]: cluster 2024-09-20T22:51:51.910968+0000 mgr.a (mgr.14388) 1611 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:52 smithi179 bash[23186]: audit 2024-09-20T22:51:52.296155+0000 mgr.a (mgr.14388) 1612 : audit [DBG] from='client.47301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:52 smithi049 bash[23528]: cluster 2024-09-20T22:51:51.910968+0000 mgr.a (mgr.14388) 1611 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:52 smithi049 bash[23528]: audit 2024-09-20T22:51:52.296155+0000 mgr.a (mgr.14388) 1612 : audit [DBG] from='client.47301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:54 smithi179 bash[23186]: cluster 2024-09-20T22:51:53.911922+0000 mgr.a (mgr.14388) 1613 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:54 smithi049 bash[23528]: cluster 2024-09-20T22:51:53.911922+0000 mgr.a (mgr.14388) 1613 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:54 smithi044 bash[22676]: cluster 2024-09-20T22:51:53.911922+0000 mgr.a (mgr.14388) 1613 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:56 smithi179 bash[23186]: cluster 2024-09-20T22:51:55.914190+0000 mgr.a (mgr.14388) 1614 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:56 smithi049 bash[23528]: cluster 2024-09-20T22:51:55.914190+0000 mgr.a (mgr.14388) 1614 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:56 smithi044 bash[22676]: cluster 2024-09-20T22:51:55.914190+0000 mgr.a (mgr.14388) 1614 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:51:57.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:51:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:51:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:51:58.513 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:51:58.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:51:58.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:51:58.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:51:58.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: audit 2024-09-20T22:51:57.521410+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: audit 2024-09-20T22:51:57.531081+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: audit 2024-09-20T22:51:57.542527+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: audit 2024-09-20T22:51:57.826177+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: audit 2024-09-20T22:51:57.832495+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: audit 2024-09-20T22:51:57.841331+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: cluster 2024-09-20T22:51:57.914925+0000 mgr.a (mgr.14388) 1615 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:51:58 smithi049 bash[23528]: audit 2024-09-20T22:51:58.066123+0000 mgr.a (mgr.14388) 1616 : audit [DBG] from='client.47379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: audit 2024-09-20T22:51:57.521410+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: audit 2024-09-20T22:51:57.531081+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: audit 2024-09-20T22:51:57.542527+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: audit 2024-09-20T22:51:57.826177+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: audit 2024-09-20T22:51:57.832495+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: audit 2024-09-20T22:51:57.841331+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: cluster 2024-09-20T22:51:57.914925+0000 mgr.a (mgr.14388) 1615 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:58.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:51:58 smithi179 bash[23186]: audit 2024-09-20T22:51:58.066123+0000 mgr.a (mgr.14388) 1616 : audit [DBG] from='client.47379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:51:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: audit 2024-09-20T22:51:57.521410+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: audit 2024-09-20T22:51:57.531081+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: audit 2024-09-20T22:51:57.542527+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: audit 2024-09-20T22:51:57.826177+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: audit 2024-09-20T22:51:57.832495+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: audit 2024-09-20T22:51:57.841331+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:51:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: cluster 2024-09-20T22:51:57.914925+0000 mgr.a (mgr.14388) 1615 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:51:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:51:58 smithi044 bash[22676]: audit 2024-09-20T22:51:58.066123+0000 mgr.a (mgr.14388) 1616 : audit [DBG] from='client.47379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:00 smithi044 bash[22676]: audit 2024-09-20T22:51:59.646350+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:00 smithi044 bash[22676]: audit 2024-09-20T22:51:59.655090+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:00 smithi044 bash[22676]: audit 2024-09-20T22:51:59.665829+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:00 smithi044 bash[22676]: cluster 2024-09-20T22:51:59.915809+0000 mgr.a (mgr.14388) 1617 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:00 smithi179 bash[23186]: audit 2024-09-20T22:51:59.646350+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:00 smithi179 bash[23186]: audit 2024-09-20T22:51:59.655090+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:00 smithi179 bash[23186]: audit 2024-09-20T22:51:59.665829+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:00 smithi179 bash[23186]: cluster 2024-09-20T22:51:59.915809+0000 mgr.a (mgr.14388) 1617 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:00 smithi049 bash[23528]: audit 2024-09-20T22:51:59.646350+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:00 smithi049 bash[23528]: audit 2024-09-20T22:51:59.655090+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:00 smithi049 bash[23528]: audit 2024-09-20T22:51:59.665829+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:00 smithi049 bash[23528]: cluster 2024-09-20T22:51:59.915809+0000 mgr.a (mgr.14388) 1617 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:02 smithi044 bash[22676]: cluster 2024-09-20T22:52:01.918017+0000 mgr.a (mgr.14388) 1618 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:02 smithi179 bash[23186]: cluster 2024-09-20T22:52:01.918017+0000 mgr.a (mgr.14388) 1618 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:02 smithi049 bash[23528]: cluster 2024-09-20T22:52:01.918017+0000 mgr.a (mgr.14388) 1618 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:03.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:04.288 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:04.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:04.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:04.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:04.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:04 smithi044 bash[22676]: audit 2024-09-20T22:52:03.853495+0000 mgr.a (mgr.14388) 1619 : audit [DBG] from='client.47457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:04 smithi044 bash[22676]: cluster 2024-09-20T22:52:03.918729+0000 mgr.a (mgr.14388) 1620 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:04 smithi179 bash[23186]: audit 2024-09-20T22:52:03.853495+0000 mgr.a (mgr.14388) 1619 : audit [DBG] from='client.47457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:04 smithi179 bash[23186]: cluster 2024-09-20T22:52:03.918729+0000 mgr.a (mgr.14388) 1620 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:04 smithi049 bash[23528]: audit 2024-09-20T22:52:03.853495+0000 mgr.a (mgr.14388) 1619 : audit [DBG] from='client.47457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:04 smithi049 bash[23528]: cluster 2024-09-20T22:52:03.918729+0000 mgr.a (mgr.14388) 1620 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:06 smithi044 bash[22676]: cluster 2024-09-20T22:52:05.921049+0000 mgr.a (mgr.14388) 1621 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:06 smithi179 bash[23186]: cluster 2024-09-20T22:52:05.921049+0000 mgr.a (mgr.14388) 1621 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:06 smithi049 bash[23528]: cluster 2024-09-20T22:52:05.921049+0000 mgr.a (mgr.14388) 1621 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:08 smithi179 bash[23186]: cluster 2024-09-20T22:52:07.921857+0000 mgr.a (mgr.14388) 1622 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:09.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:09.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:09.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:08 smithi049 bash[23528]: cluster 2024-09-20T22:52:07.921857+0000 mgr.a (mgr.14388) 1622 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:08 smithi044 bash[22676]: cluster 2024-09-20T22:52:07.921857+0000 mgr.a (mgr.14388) 1622 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:10.043 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:11.188 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:10 smithi049 bash[23528]: audit 2024-09-20T22:52:09.618253+0000 mgr.a (mgr.14388) 1623 : audit [DBG] from='client.47535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:11.188 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:10 smithi049 bash[23528]: cluster 2024-09-20T22:52:09.922311+0000 mgr.a (mgr.14388) 1624 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:10 smithi044 bash[22676]: audit 2024-09-20T22:52:09.618253+0000 mgr.a (mgr.14388) 1623 : audit [DBG] from='client.47535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:10 smithi044 bash[22676]: cluster 2024-09-20T22:52:09.922311+0000 mgr.a (mgr.14388) 1624 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:10 smithi179 bash[23186]: audit 2024-09-20T22:52:09.618253+0000 mgr.a (mgr.14388) 1623 : audit [DBG] from='client.47535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:10 smithi179 bash[23186]: cluster 2024-09-20T22:52:09.922311+0000 mgr.a (mgr.14388) 1624 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:13.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:12 smithi044 bash[22676]: cluster 2024-09-20T22:52:11.924569+0000 mgr.a (mgr.14388) 1625 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:52:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:12 smithi179 bash[23186]: cluster 2024-09-20T22:52:11.924569+0000 mgr.a (mgr.14388) 1625 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:52:13.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:12 smithi049 bash[23528]: cluster 2024-09-20T22:52:11.924569+0000 mgr.a (mgr.14388) 1625 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:52:15.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:15.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:15.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:15 smithi179 bash[23186]: cluster 2024-09-20T22:52:13.925346+0000 mgr.a (mgr.14388) 1626 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:52:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:15 smithi049 bash[23528]: cluster 2024-09-20T22:52:13.925346+0000 mgr.a (mgr.14388) 1626 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:52:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:15 smithi044 bash[22676]: cluster 2024-09-20T22:52:13.925346+0000 mgr.a (mgr.14388) 1626 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:52:15.826 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:15.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:15.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:15.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:15.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:17 smithi049 bash[23528]: audit 2024-09-20T22:52:15.381706+0000 mgr.a (mgr.14388) 1627 : audit [DBG] from='client.47613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:17 smithi049 bash[23528]: cluster 2024-09-20T22:52:15.928122+0000 mgr.a (mgr.14388) 1628 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:17.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:17 smithi179 bash[23186]: audit 2024-09-20T22:52:15.381706+0000 mgr.a (mgr.14388) 1627 : audit [DBG] from='client.47613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:17.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:17 smithi179 bash[23186]: cluster 2024-09-20T22:52:15.928122+0000 mgr.a (mgr.14388) 1628 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:17 smithi044 bash[22676]: audit 2024-09-20T22:52:15.381706+0000 mgr.a (mgr.14388) 1627 : audit [DBG] from='client.47613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:17 smithi044 bash[22676]: cluster 2024-09-20T22:52:15.928122+0000 mgr.a (mgr.14388) 1628 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:18 smithi044 bash[22676]: audit 2024-09-20T22:52:17.671993+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:18 smithi044 bash[22676]: audit 2024-09-20T22:52:17.681698+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:18 smithi044 bash[22676]: audit 2024-09-20T22:52:17.693190+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:18 smithi044 bash[22676]: cluster 2024-09-20T22:52:17.928906+0000 mgr.a (mgr.14388) 1629 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:18 smithi044 bash[22676]: audit 2024-09-20T22:52:18.058550+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:18 smithi044 bash[22676]: audit 2024-09-20T22:52:18.068455+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:18 smithi044 bash[22676]: audit 2024-09-20T22:52:18.078405+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:18 smithi179 bash[23186]: audit 2024-09-20T22:52:17.671993+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:18 smithi179 bash[23186]: audit 2024-09-20T22:52:17.681698+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:18 smithi179 bash[23186]: audit 2024-09-20T22:52:17.693190+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:18 smithi179 bash[23186]: cluster 2024-09-20T22:52:17.928906+0000 mgr.a (mgr.14388) 1629 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:18 smithi179 bash[23186]: audit 2024-09-20T22:52:18.058550+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:18 smithi179 bash[23186]: audit 2024-09-20T22:52:18.068455+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:18 smithi179 bash[23186]: audit 2024-09-20T22:52:18.078405+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:18 smithi049 bash[23528]: audit 2024-09-20T22:52:17.671993+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:18 smithi049 bash[23528]: audit 2024-09-20T22:52:17.681698+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:18 smithi049 bash[23528]: audit 2024-09-20T22:52:17.693190+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:18 smithi049 bash[23528]: cluster 2024-09-20T22:52:17.928906+0000 mgr.a (mgr.14388) 1629 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:18 smithi049 bash[23528]: audit 2024-09-20T22:52:18.058550+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:18 smithi049 bash[23528]: audit 2024-09-20T22:52:18.068455+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:18 smithi049 bash[23528]: audit 2024-09-20T22:52:18.078405+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:20.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:20 smithi044 bash[22676]: audit 2024-09-20T22:52:19.879864+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:20 smithi044 bash[22676]: audit 2024-09-20T22:52:19.889202+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:20 smithi044 bash[22676]: audit 2024-09-20T22:52:19.899098+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:20 smithi044 bash[22676]: cluster 2024-09-20T22:52:19.929724+0000 mgr.a (mgr.14388) 1630 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:52:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:20 smithi179 bash[23186]: audit 2024-09-20T22:52:19.879864+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:20 smithi179 bash[23186]: audit 2024-09-20T22:52:19.889202+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:20 smithi179 bash[23186]: audit 2024-09-20T22:52:19.899098+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:20 smithi179 bash[23186]: cluster 2024-09-20T22:52:19.929724+0000 mgr.a (mgr.14388) 1630 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:52:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:20 smithi049 bash[23528]: audit 2024-09-20T22:52:19.879864+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:20 smithi049 bash[23528]: audit 2024-09-20T22:52:19.889202+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:20 smithi049 bash[23528]: audit 2024-09-20T22:52:19.899098+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:20 smithi049 bash[23528]: cluster 2024-09-20T22:52:19.929724+0000 mgr.a (mgr.14388) 1630 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:52:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:21.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:21.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:21.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:21.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:21 smithi044 bash[22676]: audit 2024-09-20T22:52:21.164530+0000 mgr.a (mgr.14388) 1631 : audit [DBG] from='client.47691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:21 smithi179 bash[23186]: audit 2024-09-20T22:52:21.164530+0000 mgr.a (mgr.14388) 1631 : audit [DBG] from='client.47691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:21 smithi049 bash[23528]: audit 2024-09-20T22:52:21.164530+0000 mgr.a (mgr.14388) 1631 : audit [DBG] from='client.47691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:22 smithi044 bash[22676]: cluster 2024-09-20T22:52:21.932479+0000 mgr.a (mgr.14388) 1632 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:22 smithi179 bash[23186]: cluster 2024-09-20T22:52:21.932479+0000 mgr.a (mgr.14388) 1632 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:22 smithi049 bash[23528]: cluster 2024-09-20T22:52:21.932479+0000 mgr.a (mgr.14388) 1632 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:24 smithi179 bash[23186]: cluster 2024-09-20T22:52:23.933306+0000 mgr.a (mgr.14388) 1633 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:52:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:24 smithi049 bash[23528]: cluster 2024-09-20T22:52:23.933306+0000 mgr.a (mgr.14388) 1633 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:52:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:24 smithi044 bash[22676]: cluster 2024-09-20T22:52:23.933306+0000 mgr.a (mgr.14388) 1633 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:52:26.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:26.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:26.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:26 smithi179 bash[23186]: cluster 2024-09-20T22:52:25.935298+0000 mgr.a (mgr.14388) 1634 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:52:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:26 smithi049 bash[23528]: cluster 2024-09-20T22:52:25.935298+0000 mgr.a (mgr.14388) 1634 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:52:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:26 smithi044 bash[22676]: cluster 2024-09-20T22:52:25.935298+0000 mgr.a (mgr.14388) 1634 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:52:27.373 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:27.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:27.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:27.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:27.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:27 smithi179 bash[23186]: audit 2024-09-20T22:52:26.949609+0000 mgr.a (mgr.14388) 1635 : audit [DBG] from='client.47769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:27 smithi049 bash[23528]: audit 2024-09-20T22:52:26.949609+0000 mgr.a (mgr.14388) 1635 : audit [DBG] from='client.47769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:27 smithi044 bash[22676]: audit 2024-09-20T22:52:26.949609+0000 mgr.a (mgr.14388) 1635 : audit [DBG] from='client.47769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:28 smithi049 bash[23528]: cluster 2024-09-20T22:52:27.936279+0000 mgr.a (mgr.14388) 1636 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:28 smithi044 bash[22676]: cluster 2024-09-20T22:52:27.936279+0000 mgr.a (mgr.14388) 1636 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:28 smithi179 bash[23186]: cluster 2024-09-20T22:52:27.936279+0000 mgr.a (mgr.14388) 1636 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:30 smithi179 bash[23186]: cluster 2024-09-20T22:52:29.937474+0000 mgr.a (mgr.14388) 1637 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:30 smithi179 bash[23186]: audit 2024-09-20T22:52:30.818662+0000 mon.a (mon.0) 2058 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:30 smithi179 bash[23186]: audit 2024-09-20T22:52:30.825770+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:30 smithi179 bash[23186]: audit 2024-09-20T22:52:30.827790+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:30 smithi179 bash[23186]: audit 2024-09-20T22:52:30.839786+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:30 smithi179 bash[23186]: audit 2024-09-20T22:52:30.846127+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:52:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:31 smithi049 bash[23528]: cluster 2024-09-20T22:52:29.937474+0000 mgr.a (mgr.14388) 1637 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:31 smithi049 bash[23528]: audit 2024-09-20T22:52:30.818662+0000 mon.a (mon.0) 2058 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:52:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:31 smithi049 bash[23528]: audit 2024-09-20T22:52:30.825770+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:52:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:31 smithi049 bash[23528]: audit 2024-09-20T22:52:30.827790+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:52:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:31 smithi049 bash[23528]: audit 2024-09-20T22:52:30.839786+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:31 smithi049 bash[23528]: audit 2024-09-20T22:52:30.846127+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:52:31.443 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:30 smithi044 bash[22676]: cluster 2024-09-20T22:52:29.937474+0000 mgr.a (mgr.14388) 1637 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:31.443 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:30 smithi044 bash[22676]: audit 2024-09-20T22:52:30.818662+0000 mon.a (mon.0) 2058 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:52:31.444 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:30 smithi044 bash[22676]: audit 2024-09-20T22:52:30.825770+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:52:31.444 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:30 smithi044 bash[22676]: audit 2024-09-20T22:52:30.827790+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:52:31.444 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:30 smithi044 bash[22676]: audit 2024-09-20T22:52:30.839786+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:31.444 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:30 smithi044 bash[22676]: audit 2024-09-20T22:52:30.846127+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:52:31.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:52:31 smithi044 bash[22930]: debug 2024-09-20T22:52:31.584+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:52:31.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:52:31 smithi044 bash[22930]: debug 2024-09-20T22:52:31.584+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:52:32.202 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:32 smithi049 bash[23528]: audit 2024-09-20T22:52:30.848581+0000 mgr.a (mgr.14388) 1638 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:52:32.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:32 smithi044 bash[22676]: audit 2024-09-20T22:52:30.848581+0000 mgr.a (mgr.14388) 1638 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:52:32.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:32 smithi179 bash[23186]: audit 2024-09-20T22:52:30.848581+0000 mgr.a (mgr.14388) 1638 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:52:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:33 smithi049 bash[23528]: audit 2024-09-20T22:52:31.587699+0000 mgr.a (mgr.14388) 1639 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:52:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:33 smithi049 bash[23528]: cephadm 2024-09-20T22:52:31.588864+0000 mgr.a (mgr.14388) 1640 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:52:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:33 smithi049 bash[23528]: cluster 2024-09-20T22:52:31.940235+0000 mgr.a (mgr.14388) 1641 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:33.112 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:33.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:33 smithi044 bash[22676]: audit 2024-09-20T22:52:31.587699+0000 mgr.a (mgr.14388) 1639 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:52:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:33 smithi044 bash[22676]: cephadm 2024-09-20T22:52:31.588864+0000 mgr.a (mgr.14388) 1640 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:52:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:33 smithi044 bash[22676]: cluster 2024-09-20T22:52:31.940235+0000 mgr.a (mgr.14388) 1641 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:33 smithi179 bash[23186]: audit 2024-09-20T22:52:31.587699+0000 mgr.a (mgr.14388) 1639 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:52:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:33 smithi179 bash[23186]: cephadm 2024-09-20T22:52:31.588864+0000 mgr.a (mgr.14388) 1640 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:52:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:33 smithi179 bash[23186]: cluster 2024-09-20T22:52:31.940235+0000 mgr.a (mgr.14388) 1641 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:52:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:34 smithi049 bash[23528]: audit 2024-09-20T22:52:32.695721+0000 mgr.a (mgr.14388) 1642 : audit [DBG] from='client.47952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:34 smithi044 bash[22676]: audit 2024-09-20T22:52:32.695721+0000 mgr.a (mgr.14388) 1642 : audit [DBG] from='client.47952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:34 smithi179 bash[23186]: audit 2024-09-20T22:52:32.695721+0000 mgr.a (mgr.14388) 1642 : audit [DBG] from='client.47952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:35 smithi044 bash[22676]: cluster 2024-09-20T22:52:33.941317+0000 mgr.a (mgr.14388) 1643 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:35 smithi049 bash[23528]: cluster 2024-09-20T22:52:33.941317+0000 mgr.a (mgr.14388) 1643 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:35 smithi179 bash[23186]: cluster 2024-09-20T22:52:33.941317+0000 mgr.a (mgr.14388) 1643 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:37 smithi049 bash[23528]: cluster 2024-09-20T22:52:35.943585+0000 mgr.a (mgr.14388) 1644 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:37.408 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:37 smithi179 bash[23186]: cluster 2024-09-20T22:52:35.943585+0000 mgr.a (mgr.14388) 1644 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:37 smithi044 bash[22676]: cluster 2024-09-20T22:52:35.943585+0000 mgr.a (mgr.14388) 1644 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:38.115 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:38.890 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:38.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:38.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:38.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:38.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:38 smithi044 bash[22676]: audit 2024-09-20T22:52:37.903093+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:38 smithi044 bash[22676]: audit 2024-09-20T22:52:37.911753+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:38 smithi044 bash[22676]: audit 2024-09-20T22:52:37.922277+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:38 smithi044 bash[22676]: cluster 2024-09-20T22:52:37.944362+0000 mgr.a (mgr.14388) 1645 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:38 smithi044 bash[22676]: audit 2024-09-20T22:52:38.291133+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:38 smithi044 bash[22676]: audit 2024-09-20T22:52:38.299488+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:38 smithi044 bash[22676]: audit 2024-09-20T22:52:38.309328+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:38 smithi179 bash[23186]: audit 2024-09-20T22:52:37.903093+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:38 smithi179 bash[23186]: audit 2024-09-20T22:52:37.911753+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:38 smithi179 bash[23186]: audit 2024-09-20T22:52:37.922277+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:38 smithi179 bash[23186]: cluster 2024-09-20T22:52:37.944362+0000 mgr.a (mgr.14388) 1645 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:38 smithi179 bash[23186]: audit 2024-09-20T22:52:38.291133+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:38 smithi179 bash[23186]: audit 2024-09-20T22:52:38.299488+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:38 smithi179 bash[23186]: audit 2024-09-20T22:52:38.309328+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:38 smithi049 bash[23528]: audit 2024-09-20T22:52:37.903093+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:38 smithi049 bash[23528]: audit 2024-09-20T22:52:37.911753+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:38 smithi049 bash[23528]: audit 2024-09-20T22:52:37.922277+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:38 smithi049 bash[23528]: cluster 2024-09-20T22:52:37.944362+0000 mgr.a (mgr.14388) 1645 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:38 smithi049 bash[23528]: audit 2024-09-20T22:52:38.291133+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:38 smithi049 bash[23528]: audit 2024-09-20T22:52:38.299488+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:38 smithi049 bash[23528]: audit 2024-09-20T22:52:38.309328+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:39 smithi044 bash[22676]: audit 2024-09-20T22:52:38.448313+0000 mgr.a (mgr.14388) 1646 : audit [DBG] from='client.48027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:39 smithi179 bash[23186]: audit 2024-09-20T22:52:38.448313+0000 mgr.a (mgr.14388) 1646 : audit [DBG] from='client.48027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:39 smithi049 bash[23528]: audit 2024-09-20T22:52:38.448313+0000 mgr.a (mgr.14388) 1646 : audit [DBG] from='client.48027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:41 smithi044 bash[22676]: cluster 2024-09-20T22:52:39.945426+0000 mgr.a (mgr.14388) 1647 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:41 smithi044 bash[22676]: audit 2024-09-20T22:52:40.116304+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:41 smithi044 bash[22676]: audit 2024-09-20T22:52:40.123643+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:41 smithi044 bash[22676]: audit 2024-09-20T22:52:40.131992+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:41 smithi179 bash[23186]: cluster 2024-09-20T22:52:39.945426+0000 mgr.a (mgr.14388) 1647 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:41 smithi179 bash[23186]: audit 2024-09-20T22:52:40.116304+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:41 smithi179 bash[23186]: audit 2024-09-20T22:52:40.123643+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:41 smithi179 bash[23186]: audit 2024-09-20T22:52:40.131992+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:41 smithi049 bash[23528]: cluster 2024-09-20T22:52:39.945426+0000 mgr.a (mgr.14388) 1647 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:41 smithi049 bash[23528]: audit 2024-09-20T22:52:40.116304+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:41 smithi049 bash[23528]: audit 2024-09-20T22:52:40.123643+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:41 smithi049 bash[23528]: audit 2024-09-20T22:52:40.131992+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:43 smithi044 bash[22676]: cluster 2024-09-20T22:52:41.947020+0000 mgr.a (mgr.14388) 1648 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:43 smithi179 bash[23186]: cluster 2024-09-20T22:52:41.947020+0000 mgr.a (mgr.14388) 1648 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:43 smithi049 bash[23528]: cluster 2024-09-20T22:52:41.947020+0000 mgr.a (mgr.14388) 1648 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:43.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:43.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:43.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:44.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:44.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:44.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:44.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:45 smithi044 bash[22676]: cluster 2024-09-20T22:52:43.947599+0000 mgr.a (mgr.14388) 1649 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:45 smithi044 bash[22676]: audit 2024-09-20T22:52:44.228918+0000 mgr.a (mgr.14388) 1650 : audit [DBG] from='client.48105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:45 smithi179 bash[23186]: cluster 2024-09-20T22:52:43.947599+0000 mgr.a (mgr.14388) 1649 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:45 smithi179 bash[23186]: audit 2024-09-20T22:52:44.228918+0000 mgr.a (mgr.14388) 1650 : audit [DBG] from='client.48105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:45 smithi049 bash[23528]: cluster 2024-09-20T22:52:43.947599+0000 mgr.a (mgr.14388) 1649 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:45 smithi049 bash[23528]: audit 2024-09-20T22:52:44.228918+0000 mgr.a (mgr.14388) 1650 : audit [DBG] from='client.48105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:47 smithi044 bash[22676]: cluster 2024-09-20T22:52:45.949955+0000 mgr.a (mgr.14388) 1651 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:47 smithi179 bash[23186]: cluster 2024-09-20T22:52:45.949955+0000 mgr.a (mgr.14388) 1651 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:47 smithi049 bash[23528]: cluster 2024-09-20T22:52:45.949955+0000 mgr.a (mgr.14388) 1651 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:52:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:49 smithi044 bash[22676]: cluster 2024-09-20T22:52:47.950735+0000 mgr.a (mgr.14388) 1652 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:49 smithi179 bash[23186]: cluster 2024-09-20T22:52:47.950735+0000 mgr.a (mgr.14388) 1652 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:49 smithi049 bash[23528]: cluster 2024-09-20T22:52:47.950735+0000 mgr.a (mgr.14388) 1652 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:49.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:50.439 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:50.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:50.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:50.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:50.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:51 smithi044 bash[22676]: cluster 2024-09-20T22:52:49.951850+0000 mgr.a (mgr.14388) 1653 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:51 smithi044 bash[22676]: audit 2024-09-20T22:52:50.024000+0000 mgr.a (mgr.14388) 1654 : audit [DBG] from='client.48180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:51 smithi179 bash[23186]: cluster 2024-09-20T22:52:49.951850+0000 mgr.a (mgr.14388) 1653 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:51 smithi179 bash[23186]: audit 2024-09-20T22:52:50.024000+0000 mgr.a (mgr.14388) 1654 : audit [DBG] from='client.48180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:51 smithi049 bash[23528]: cluster 2024-09-20T22:52:49.951850+0000 mgr.a (mgr.14388) 1653 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:51 smithi049 bash[23528]: audit 2024-09-20T22:52:50.024000+0000 mgr.a (mgr.14388) 1654 : audit [DBG] from='client.48180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:53.396 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:53 smithi044 bash[22676]: cluster 2024-09-20T22:52:51.954144+0000 mgr.a (mgr.14388) 1655 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:52:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:53 smithi179 bash[23186]: cluster 2024-09-20T22:52:51.954144+0000 mgr.a (mgr.14388) 1655 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:52:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:53 smithi049 bash[23528]: cluster 2024-09-20T22:52:51.954144+0000 mgr.a (mgr.14388) 1655 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:52:55.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:52:55.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:52:55.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:52:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:55 smithi044 bash[22676]: cluster 2024-09-20T22:52:53.954935+0000 mgr.a (mgr.14388) 1656 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:55 smithi179 bash[23186]: cluster 2024-09-20T22:52:53.954935+0000 mgr.a (mgr.14388) 1656 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:55 smithi049 bash[23528]: cluster 2024-09-20T22:52:53.954935+0000 mgr.a (mgr.14388) 1656 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:56.210 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:52:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:52:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:52:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:52:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:52:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:57 smithi044 bash[22676]: audit 2024-09-20T22:52:55.773657+0000 mgr.a (mgr.14388) 1657 : audit [DBG] from='client.48258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:57 smithi044 bash[22676]: cluster 2024-09-20T22:52:55.956843+0000 mgr.a (mgr.14388) 1658 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:57 smithi179 bash[23186]: audit 2024-09-20T22:52:55.773657+0000 mgr.a (mgr.14388) 1657 : audit [DBG] from='client.48258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:57 smithi179 bash[23186]: cluster 2024-09-20T22:52:55.956843+0000 mgr.a (mgr.14388) 1658 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:57 smithi049 bash[23528]: audit 2024-09-20T22:52:55.773657+0000 mgr.a (mgr.14388) 1657 : audit [DBG] from='client.48258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:52:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:57 smithi049 bash[23528]: cluster 2024-09-20T22:52:55.956843+0000 mgr.a (mgr.14388) 1658 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:52:59.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:59 smithi179 bash[23186]: cluster 2024-09-20T22:52:57.957749+0000 mgr.a (mgr.14388) 1659 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:59.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:59 smithi179 bash[23186]: audit 2024-09-20T22:52:58.131806+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:59 smithi179 bash[23186]: audit 2024-09-20T22:52:58.140204+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:59 smithi179 bash[23186]: audit 2024-09-20T22:52:58.150604+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:59 smithi179 bash[23186]: audit 2024-09-20T22:52:58.524404+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:59 smithi179 bash[23186]: audit 2024-09-20T22:52:58.533190+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:52:59 smithi179 bash[23186]: audit 2024-09-20T22:52:58.543343+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:59 smithi044 bash[22676]: cluster 2024-09-20T22:52:57.957749+0000 mgr.a (mgr.14388) 1659 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:59 smithi044 bash[22676]: audit 2024-09-20T22:52:58.131806+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:59 smithi044 bash[22676]: audit 2024-09-20T22:52:58.140204+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:59 smithi044 bash[22676]: audit 2024-09-20T22:52:58.150604+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:59 smithi044 bash[22676]: audit 2024-09-20T22:52:58.524404+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:59 smithi044 bash[22676]: audit 2024-09-20T22:52:58.533190+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:52:59 smithi044 bash[22676]: audit 2024-09-20T22:52:58.543343+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:59 smithi049 bash[23528]: cluster 2024-09-20T22:52:57.957749+0000 mgr.a (mgr.14388) 1659 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:52:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:59 smithi049 bash[23528]: audit 2024-09-20T22:52:58.131806+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:59 smithi049 bash[23528]: audit 2024-09-20T22:52:58.140204+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:59 smithi049 bash[23528]: audit 2024-09-20T22:52:58.150604+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:59 smithi049 bash[23528]: audit 2024-09-20T22:52:58.524404+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:59 smithi049 bash[23528]: audit 2024-09-20T22:52:58.533190+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:52:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:52:59 smithi049 bash[23528]: audit 2024-09-20T22:52:58.543343+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:01.213 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:01.213 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:01.595 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:01 smithi179 bash[23186]: cluster 2024-09-20T22:52:59.959583+0000 mgr.a (mgr.14388) 1660 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:53:01.596 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:01 smithi179 bash[23186]: audit 2024-09-20T22:53:00.339329+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.596 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:01 smithi179 bash[23186]: audit 2024-09-20T22:53:00.346737+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.596 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:01 smithi179 bash[23186]: audit 2024-09-20T22:53:00.357800+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:01 smithi044 bash[22676]: cluster 2024-09-20T22:52:59.959583+0000 mgr.a (mgr.14388) 1660 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:53:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:01 smithi044 bash[22676]: audit 2024-09-20T22:53:00.339329+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:01 smithi044 bash[22676]: audit 2024-09-20T22:53:00.346737+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:01 smithi044 bash[22676]: audit 2024-09-20T22:53:00.357800+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:01 smithi049 bash[23528]: cluster 2024-09-20T22:52:59.959583+0000 mgr.a (mgr.14388) 1660 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T22:53:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:01 smithi049 bash[23528]: audit 2024-09-20T22:53:00.339329+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:01 smithi049 bash[23528]: audit 2024-09-20T22:53:00.346737+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:01 smithi049 bash[23528]: audit 2024-09-20T22:53:00.357800+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:01.957 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:01.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:03 smithi044 bash[22676]: audit 2024-09-20T22:53:01.546769+0000 mgr.a (mgr.14388) 1661 : audit [DBG] from='client.48336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:03 smithi044 bash[22676]: cluster 2024-09-20T22:53:01.960663+0000 mgr.a (mgr.14388) 1662 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:03 smithi179 bash[23186]: audit 2024-09-20T22:53:01.546769+0000 mgr.a (mgr.14388) 1661 : audit [DBG] from='client.48336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:03 smithi179 bash[23186]: cluster 2024-09-20T22:53:01.960663+0000 mgr.a (mgr.14388) 1662 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:03 smithi049 bash[23528]: audit 2024-09-20T22:53:01.546769+0000 mgr.a (mgr.14388) 1661 : audit [DBG] from='client.48336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:03 smithi049 bash[23528]: cluster 2024-09-20T22:53:01.960663+0000 mgr.a (mgr.14388) 1662 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:05 smithi044 bash[22676]: cluster 2024-09-20T22:53:03.961566+0000 mgr.a (mgr.14388) 1663 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:05 smithi179 bash[23186]: cluster 2024-09-20T22:53:03.961566+0000 mgr.a (mgr.14388) 1663 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:05 smithi049 bash[23528]: cluster 2024-09-20T22:53:03.961566+0000 mgr.a (mgr.14388) 1663 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:06 smithi044 bash[22676]: cluster 2024-09-20T22:53:05.963762+0000 mgr.a (mgr.14388) 1664 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:06 smithi179 bash[23186]: cluster 2024-09-20T22:53:05.963762+0000 mgr.a (mgr.14388) 1664 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:06 smithi049 bash[23528]: cluster 2024-09-20T22:53:05.963762+0000 mgr.a (mgr.14388) 1664 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:06.960 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:06.960 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:07.699 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:07.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:07.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:07.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:07.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:07 smithi044 bash[22676]: audit 2024-09-20T22:53:07.287833+0000 mgr.a (mgr.14388) 1665 : audit [DBG] from='client.48411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:07 smithi179 bash[23186]: audit 2024-09-20T22:53:07.287833+0000 mgr.a (mgr.14388) 1665 : audit [DBG] from='client.48411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:07 smithi049 bash[23528]: audit 2024-09-20T22:53:07.287833+0000 mgr.a (mgr.14388) 1665 : audit [DBG] from='client.48411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:08 smithi044 bash[22676]: cluster 2024-09-20T22:53:07.964775+0000 mgr.a (mgr.14388) 1666 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:08 smithi179 bash[23186]: cluster 2024-09-20T22:53:07.964775+0000 mgr.a (mgr.14388) 1666 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:08 smithi049 bash[23528]: cluster 2024-09-20T22:53:07.964775+0000 mgr.a (mgr.14388) 1666 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:11.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:11 smithi049 bash[23528]: cluster 2024-09-20T22:53:09.966976+0000 mgr.a (mgr.14388) 1667 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:11 smithi044 bash[22676]: cluster 2024-09-20T22:53:09.966976+0000 mgr.a (mgr.14388) 1667 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:11 smithi179 bash[23186]: cluster 2024-09-20T22:53:09.966976+0000 mgr.a (mgr.14388) 1667 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:12.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:12.701 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:12.702 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:13 smithi049 bash[23528]: cluster 2024-09-20T22:53:11.967896+0000 mgr.a (mgr.14388) 1668 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:53:13.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:13.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:13.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:13.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:13.453 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:13 smithi044 bash[22676]: cluster 2024-09-20T22:53:11.967896+0000 mgr.a (mgr.14388) 1668 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:53:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:13 smithi179 bash[23186]: cluster 2024-09-20T22:53:11.967896+0000 mgr.a (mgr.14388) 1668 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T22:53:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:14 smithi049 bash[23528]: audit 2024-09-20T22:53:13.036093+0000 mgr.a (mgr.14388) 1669 : audit [DBG] from='client.48489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:14.332 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:14 smithi044 bash[22676]: audit 2024-09-20T22:53:13.036093+0000 mgr.a (mgr.14388) 1669 : audit [DBG] from='client.48489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:14 smithi179 bash[23186]: audit 2024-09-20T22:53:13.036093+0000 mgr.a (mgr.14388) 1669 : audit [DBG] from='client.48489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:15 smithi049 bash[23528]: cluster 2024-09-20T22:53:13.968958+0000 mgr.a (mgr.14388) 1670 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:15 smithi044 bash[22676]: cluster 2024-09-20T22:53:13.968958+0000 mgr.a (mgr.14388) 1670 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:15 smithi179 bash[23186]: cluster 2024-09-20T22:53:13.968958+0000 mgr.a (mgr.14388) 1670 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:17 smithi049 bash[23528]: cluster 2024-09-20T22:53:15.971209+0000 mgr.a (mgr.14388) 1671 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:17 smithi044 bash[22676]: cluster 2024-09-20T22:53:15.971209+0000 mgr.a (mgr.14388) 1671 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:17 smithi179 bash[23186]: cluster 2024-09-20T22:53:15.971209+0000 mgr.a (mgr.14388) 1671 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:18.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:18.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:18.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:19.250 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:19.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:19 smithi049 bash[23528]: cluster 2024-09-20T22:53:17.972019+0000 mgr.a (mgr.14388) 1672 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:19 smithi049 bash[23528]: audit 2024-09-20T22:53:18.361600+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:19 smithi049 bash[23528]: audit 2024-09-20T22:53:18.369677+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:19 smithi049 bash[23528]: audit 2024-09-20T22:53:18.380411+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:19 smithi049 bash[23528]: audit 2024-09-20T22:53:18.725162+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:19 smithi049 bash[23528]: audit 2024-09-20T22:53:18.732738+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:19 smithi049 bash[23528]: audit 2024-09-20T22:53:18.741867+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:19 smithi044 bash[22676]: cluster 2024-09-20T22:53:17.972019+0000 mgr.a (mgr.14388) 1672 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:19 smithi044 bash[22676]: audit 2024-09-20T22:53:18.361600+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:19 smithi044 bash[22676]: audit 2024-09-20T22:53:18.369677+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:19 smithi044 bash[22676]: audit 2024-09-20T22:53:18.380411+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:19 smithi044 bash[22676]: audit 2024-09-20T22:53:18.725162+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:19 smithi044 bash[22676]: audit 2024-09-20T22:53:18.732738+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:19 smithi044 bash[22676]: audit 2024-09-20T22:53:18.741867+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:19 smithi179 bash[23186]: cluster 2024-09-20T22:53:17.972019+0000 mgr.a (mgr.14388) 1672 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:19 smithi179 bash[23186]: audit 2024-09-20T22:53:18.361600+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:19 smithi179 bash[23186]: audit 2024-09-20T22:53:18.369677+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:19 smithi179 bash[23186]: audit 2024-09-20T22:53:18.380411+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:19 smithi179 bash[23186]: audit 2024-09-20T22:53:18.725162+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:19 smithi179 bash[23186]: audit 2024-09-20T22:53:18.732738+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:19 smithi179 bash[23186]: audit 2024-09-20T22:53:18.741867+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:20.409 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:20 smithi179 bash[23186]: audit 2024-09-20T22:53:18.802275+0000 mgr.a (mgr.14388) 1673 : audit [DBG] from='client.48564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:20 smithi044 bash[22676]: audit 2024-09-20T22:53:18.802275+0000 mgr.a (mgr.14388) 1673 : audit [DBG] from='client.48564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:20 smithi049 bash[23528]: audit 2024-09-20T22:53:18.802275+0000 mgr.a (mgr.14388) 1673 : audit [DBG] from='client.48564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:21 smithi179 bash[23186]: cluster 2024-09-20T22:53:19.974277+0000 mgr.a (mgr.14388) 1674 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:21 smithi179 bash[23186]: audit 2024-09-20T22:53:20.569546+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:21 smithi179 bash[23186]: audit 2024-09-20T22:53:20.577637+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:21 smithi179 bash[23186]: audit 2024-09-20T22:53:20.587870+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:21 smithi044 bash[22676]: cluster 2024-09-20T22:53:19.974277+0000 mgr.a (mgr.14388) 1674 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:21 smithi044 bash[22676]: audit 2024-09-20T22:53:20.569546+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:21 smithi044 bash[22676]: audit 2024-09-20T22:53:20.577637+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:21 smithi044 bash[22676]: audit 2024-09-20T22:53:20.587870+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:21 smithi049 bash[23528]: cluster 2024-09-20T22:53:19.974277+0000 mgr.a (mgr.14388) 1674 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:21 smithi049 bash[23528]: audit 2024-09-20T22:53:20.569546+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:21 smithi049 bash[23528]: audit 2024-09-20T22:53:20.577637+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:21 smithi049 bash[23528]: audit 2024-09-20T22:53:20.587870+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:23 smithi044 bash[22676]: cluster 2024-09-20T22:53:21.975045+0000 mgr.a (mgr.14388) 1675 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:23 smithi179 bash[23186]: cluster 2024-09-20T22:53:21.975045+0000 mgr.a (mgr.14388) 1675 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:23 smithi049 bash[23528]: cluster 2024-09-20T22:53:21.975045+0000 mgr.a (mgr.14388) 1675 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:24.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:25.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:25.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:25.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:25.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:25.038 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:25 smithi044 bash[22676]: cluster 2024-09-20T22:53:23.975826+0000 mgr.a (mgr.14388) 1676 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:25 smithi179 bash[23186]: cluster 2024-09-20T22:53:23.975826+0000 mgr.a (mgr.14388) 1676 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:25 smithi049 bash[23528]: cluster 2024-09-20T22:53:23.975826+0000 mgr.a (mgr.14388) 1676 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:26 smithi044 bash[22676]: audit 2024-09-20T22:53:24.588756+0000 mgr.a (mgr.14388) 1677 : audit [DBG] from='client.48639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:26 smithi179 bash[23186]: audit 2024-09-20T22:53:24.588756+0000 mgr.a (mgr.14388) 1677 : audit [DBG] from='client.48639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:26 smithi049 bash[23528]: audit 2024-09-20T22:53:24.588756+0000 mgr.a (mgr.14388) 1677 : audit [DBG] from='client.48639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:27 smithi044 bash[22676]: cluster 2024-09-20T22:53:25.978131+0000 mgr.a (mgr.14388) 1678 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:53:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:27 smithi179 bash[23186]: cluster 2024-09-20T22:53:25.978131+0000 mgr.a (mgr.14388) 1678 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:53:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:27 smithi049 bash[23528]: cluster 2024-09-20T22:53:25.978131+0000 mgr.a (mgr.14388) 1678 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:53:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:29 smithi044 bash[22676]: cluster 2024-09-20T22:53:27.978943+0000 mgr.a (mgr.14388) 1679 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:53:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:29 smithi179 bash[23186]: cluster 2024-09-20T22:53:27.978943+0000 mgr.a (mgr.14388) 1679 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:53:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:29 smithi049 bash[23528]: cluster 2024-09-20T22:53:27.978943+0000 mgr.a (mgr.14388) 1679 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:53:30.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:30.040 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:30.040 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:31 smithi044 bash[22676]: cluster 2024-09-20T22:53:29.980819+0000 mgr.a (mgr.14388) 1680 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:31 smithi179 bash[23186]: cluster 2024-09-20T22:53:29.980819+0000 mgr.a (mgr.14388) 1680 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:31 smithi049 bash[23528]: cluster 2024-09-20T22:53:29.980819+0000 mgr.a (mgr.14388) 1680 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:32.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22676]: audit 2024-09-20T22:53:30.388617+0000 mgr.a (mgr.14388) 1681 : audit [DBG] from='client.48717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:32.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22676]: audit 2024-09-20T22:53:31.646183+0000 mon.a (mon.0) 2090 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:53:32.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22676]: audit 2024-09-20T22:53:31.653673+0000 mon.a (mon.0) 2091 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:53:32.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22676]: audit 2024-09-20T22:53:31.655600+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:53:32.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22676]: audit 2024-09-20T22:53:31.666993+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:32.430 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22676]: audit 2024-09-20T22:53:31.674195+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:53:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:32 smithi179 bash[23186]: audit 2024-09-20T22:53:30.388617+0000 mgr.a (mgr.14388) 1681 : audit [DBG] from='client.48717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:32 smithi179 bash[23186]: audit 2024-09-20T22:53:31.646183+0000 mon.a (mon.0) 2090 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:53:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:32 smithi179 bash[23186]: audit 2024-09-20T22:53:31.653673+0000 mon.a (mon.0) 2091 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:53:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:32 smithi179 bash[23186]: audit 2024-09-20T22:53:31.655600+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:53:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:32 smithi179 bash[23186]: audit 2024-09-20T22:53:31.666993+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:32 smithi179 bash[23186]: audit 2024-09-20T22:53:31.674195+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:53:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:32 smithi049 bash[23528]: audit 2024-09-20T22:53:30.388617+0000 mgr.a (mgr.14388) 1681 : audit [DBG] from='client.48717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:32 smithi049 bash[23528]: audit 2024-09-20T22:53:31.646183+0000 mon.a (mon.0) 2090 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:53:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:32 smithi049 bash[23528]: audit 2024-09-20T22:53:31.653673+0000 mon.a (mon.0) 2091 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:53:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:32 smithi049 bash[23528]: audit 2024-09-20T22:53:31.655600+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:53:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:32 smithi049 bash[23528]: audit 2024-09-20T22:53:31.666993+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:32 smithi049 bash[23528]: audit 2024-09-20T22:53:31.674195+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:53:32.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22930]: debug 2024-09-20T22:53:32.427+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:53:32.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:53:32 smithi044 bash[22930]: debug 2024-09-20T22:53:32.427+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:53:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:33 smithi049 bash[23528]: audit 2024-09-20T22:53:31.676760+0000 mgr.a (mgr.14388) 1682 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:53:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:33 smithi049 bash[23528]: cluster 2024-09-20T22:53:31.981491+0000 mgr.a (mgr.14388) 1683 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:53:33.455 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:33 smithi044 bash[22676]: audit 2024-09-20T22:53:31.676760+0000 mgr.a (mgr.14388) 1682 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:53:33.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:33 smithi044 bash[22676]: cluster 2024-09-20T22:53:31.981491+0000 mgr.a (mgr.14388) 1683 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:53:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:33 smithi179 bash[23186]: audit 2024-09-20T22:53:31.676760+0000 mgr.a (mgr.14388) 1682 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:53:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:33 smithi179 bash[23186]: cluster 2024-09-20T22:53:31.981491+0000 mgr.a (mgr.14388) 1683 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:53:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:34 smithi049 bash[23528]: audit 2024-09-20T22:53:32.429531+0000 mgr.a (mgr.14388) 1684 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:53:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:34 smithi049 bash[23528]: cephadm 2024-09-20T22:53:32.430774+0000 mgr.a (mgr.14388) 1685 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:53:34.397 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:34 smithi044 bash[22676]: audit 2024-09-20T22:53:32.429531+0000 mgr.a (mgr.14388) 1684 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:53:34.397 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:34 smithi044 bash[22676]: cephadm 2024-09-20T22:53:32.430774+0000 mgr.a (mgr.14388) 1685 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:53:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:34 smithi179 bash[23186]: audit 2024-09-20T22:53:32.429531+0000 mgr.a (mgr.14388) 1684 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:53:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:34 smithi179 bash[23186]: cephadm 2024-09-20T22:53:32.430774+0000 mgr.a (mgr.14388) 1685 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:53:35.467 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:35 smithi049 bash[23528]: cluster 2024-09-20T22:53:33.982427+0000 mgr.a (mgr.14388) 1686 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:53:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:35 smithi044 bash[22676]: cluster 2024-09-20T22:53:33.982427+0000 mgr.a (mgr.14388) 1686 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:53:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:35 smithi179 bash[23186]: cluster 2024-09-20T22:53:33.982427+0000 mgr.a (mgr.14388) 1686 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:53:35.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:35.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:35.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:36.579 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:36.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:36.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:36.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:36.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:37 smithi044 bash[22676]: cluster 2024-09-20T22:53:35.984587+0000 mgr.a (mgr.14388) 1687 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:37 smithi044 bash[22676]: audit 2024-09-20T22:53:36.168237+0000 mgr.a (mgr.14388) 1688 : audit [DBG] from='client.48900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:37 smithi179 bash[23186]: cluster 2024-09-20T22:53:35.984587+0000 mgr.a (mgr.14388) 1687 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:37 smithi179 bash[23186]: audit 2024-09-20T22:53:36.168237+0000 mgr.a (mgr.14388) 1688 : audit [DBG] from='client.48900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:37 smithi049 bash[23528]: cluster 2024-09-20T22:53:35.984587+0000 mgr.a (mgr.14388) 1687 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:37 smithi049 bash[23528]: audit 2024-09-20T22:53:36.168237+0000 mgr.a (mgr.14388) 1688 : audit [DBG] from='client.48900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:39 smithi049 bash[23528]: cluster 2024-09-20T22:53:37.985637+0000 mgr.a (mgr.14388) 1689 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:53:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:39 smithi049 bash[23528]: audit 2024-09-20T22:53:38.592142+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:39 smithi049 bash[23528]: audit 2024-09-20T22:53:38.602086+0000 mon.a (mon.0) 2096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:39 smithi049 bash[23528]: audit 2024-09-20T22:53:38.613904+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:39 smithi049 bash[23528]: audit 2024-09-20T22:53:38.909293+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:39 smithi049 bash[23528]: audit 2024-09-20T22:53:38.919113+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:39 smithi049 bash[23528]: audit 2024-09-20T22:53:38.930635+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:39 smithi044 bash[22676]: cluster 2024-09-20T22:53:37.985637+0000 mgr.a (mgr.14388) 1689 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:53:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:39 smithi044 bash[22676]: audit 2024-09-20T22:53:38.592142+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:39 smithi044 bash[22676]: audit 2024-09-20T22:53:38.602086+0000 mon.a (mon.0) 2096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:39 smithi044 bash[22676]: audit 2024-09-20T22:53:38.613904+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:39 smithi044 bash[22676]: audit 2024-09-20T22:53:38.909293+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:39 smithi044 bash[22676]: audit 2024-09-20T22:53:38.919113+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:39 smithi044 bash[22676]: audit 2024-09-20T22:53:38.930635+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:39 smithi179 bash[23186]: cluster 2024-09-20T22:53:37.985637+0000 mgr.a (mgr.14388) 1689 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:53:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:39 smithi179 bash[23186]: audit 2024-09-20T22:53:38.592142+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:39 smithi179 bash[23186]: audit 2024-09-20T22:53:38.602086+0000 mon.a (mon.0) 2096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:39 smithi179 bash[23186]: audit 2024-09-20T22:53:38.613904+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:39 smithi179 bash[23186]: audit 2024-09-20T22:53:38.909293+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:39 smithi179 bash[23186]: audit 2024-09-20T22:53:38.919113+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:39 smithi179 bash[23186]: audit 2024-09-20T22:53:38.930635+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.365 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:41 smithi179 bash[23186]: cluster 2024-09-20T22:53:39.987798+0000 mgr.a (mgr.14388) 1690 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:41.365 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:41 smithi179 bash[23186]: audit 2024-09-20T22:53:40.789192+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.365 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:41 smithi179 bash[23186]: audit 2024-09-20T22:53:40.794772+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.365 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:41 smithi179 bash[23186]: audit 2024-09-20T22:53:40.801923+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:41 smithi044 bash[22676]: cluster 2024-09-20T22:53:39.987798+0000 mgr.a (mgr.14388) 1690 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:41 smithi044 bash[22676]: audit 2024-09-20T22:53:40.789192+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:41 smithi044 bash[22676]: audit 2024-09-20T22:53:40.794772+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:41 smithi044 bash[22676]: audit 2024-09-20T22:53:40.801923+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:41 smithi049 bash[23528]: cluster 2024-09-20T22:53:39.987798+0000 mgr.a (mgr.14388) 1690 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:41 smithi049 bash[23528]: audit 2024-09-20T22:53:40.789192+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:41 smithi049 bash[23528]: audit 2024-09-20T22:53:40.794772+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:41 smithi049 bash[23528]: audit 2024-09-20T22:53:40.801923+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:42.362 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:42.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:42.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:42.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:43 smithi044 bash[22676]: audit 2024-09-20T22:53:41.916447+0000 mgr.a (mgr.14388) 1691 : audit [DBG] from='client.48969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:43 smithi044 bash[22676]: cluster 2024-09-20T22:53:41.988465+0000 mgr.a (mgr.14388) 1692 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:43.496 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:43 smithi179 bash[23186]: audit 2024-09-20T22:53:41.916447+0000 mgr.a (mgr.14388) 1691 : audit [DBG] from='client.48969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:43.496 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:43 smithi179 bash[23186]: cluster 2024-09-20T22:53:41.988465+0000 mgr.a (mgr.14388) 1692 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:43 smithi049 bash[23528]: audit 2024-09-20T22:53:41.916447+0000 mgr.a (mgr.14388) 1691 : audit [DBG] from='client.48969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:43 smithi049 bash[23528]: cluster 2024-09-20T22:53:41.988465+0000 mgr.a (mgr.14388) 1692 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:45 smithi044 bash[22676]: cluster 2024-09-20T22:53:43.989355+0000 mgr.a (mgr.14388) 1693 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:45 smithi179 bash[23186]: cluster 2024-09-20T22:53:43.989355+0000 mgr.a (mgr.14388) 1693 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:45 smithi049 bash[23528]: cluster 2024-09-20T22:53:43.989355+0000 mgr.a (mgr.14388) 1693 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:47.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:47.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:47.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:47 smithi044 bash[22676]: cluster 2024-09-20T22:53:45.991559+0000 mgr.a (mgr.14388) 1694 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:47 smithi179 bash[23186]: cluster 2024-09-20T22:53:45.991559+0000 mgr.a (mgr.14388) 1694 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:47 smithi049 bash[23528]: cluster 2024-09-20T22:53:45.991559+0000 mgr.a (mgr.14388) 1694 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:53:48.142 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:48.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:48.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:48.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:48.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:49 smithi044 bash[22676]: audit 2024-09-20T22:53:47.698696+0000 mgr.a (mgr.14388) 1695 : audit [DBG] from='client.49047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:49 smithi044 bash[22676]: cluster 2024-09-20T22:53:47.992166+0000 mgr.a (mgr.14388) 1696 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:49 smithi179 bash[23186]: audit 2024-09-20T22:53:47.698696+0000 mgr.a (mgr.14388) 1695 : audit [DBG] from='client.49047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:49 smithi179 bash[23186]: cluster 2024-09-20T22:53:47.992166+0000 mgr.a (mgr.14388) 1696 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:49 smithi049 bash[23528]: audit 2024-09-20T22:53:47.698696+0000 mgr.a (mgr.14388) 1695 : audit [DBG] from='client.49047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:49 smithi049 bash[23528]: cluster 2024-09-20T22:53:47.992166+0000 mgr.a (mgr.14388) 1696 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:51 smithi044 bash[22676]: cluster 2024-09-20T22:53:49.994432+0000 mgr.a (mgr.14388) 1697 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:51 smithi179 bash[23186]: cluster 2024-09-20T22:53:49.994432+0000 mgr.a (mgr.14388) 1697 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:51 smithi049 bash[23528]: cluster 2024-09-20T22:53:49.994432+0000 mgr.a (mgr.14388) 1697 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:53.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:53.360 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:53 smithi049 bash[23528]: cluster 2024-09-20T22:53:51.995197+0000 mgr.a (mgr.14388) 1698 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:53 smithi044 bash[22676]: cluster 2024-09-20T22:53:51.995197+0000 mgr.a (mgr.14388) 1698 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:53 smithi179 bash[23186]: cluster 2024-09-20T22:53:51.995197+0000 mgr.a (mgr.14388) 1698 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:53.910 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:53.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:53.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:53.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:53.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:53:55.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:55 smithi044 bash[22676]: audit 2024-09-20T22:53:53.483252+0000 mgr.a (mgr.14388) 1699 : audit [DBG] from='client.49125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:55.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:55 smithi044 bash[22676]: cluster 2024-09-20T22:53:53.996173+0000 mgr.a (mgr.14388) 1700 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:55 smithi179 bash[23186]: audit 2024-09-20T22:53:53.483252+0000 mgr.a (mgr.14388) 1699 : audit [DBG] from='client.49125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:55 smithi179 bash[23186]: cluster 2024-09-20T22:53:53.996173+0000 mgr.a (mgr.14388) 1700 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:55.534 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:55 smithi049 bash[23528]: audit 2024-09-20T22:53:53.483252+0000 mgr.a (mgr.14388) 1699 : audit [DBG] from='client.49125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:53:55.535 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:55 smithi049 bash[23528]: cluster 2024-09-20T22:53:53.996173+0000 mgr.a (mgr.14388) 1700 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:57 smithi179 bash[23186]: cluster 2024-09-20T22:53:55.998382+0000 mgr.a (mgr.14388) 1701 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:57 smithi044 bash[22676]: cluster 2024-09-20T22:53:55.998382+0000 mgr.a (mgr.14388) 1701 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:57 smithi049 bash[23528]: cluster 2024-09-20T22:53:55.998382+0000 mgr.a (mgr.14388) 1701 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:53:58.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:53:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:53:58.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:59 smithi044 bash[22676]: cluster 2024-09-20T22:53:57.999192+0000 mgr.a (mgr.14388) 1702 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:59 smithi044 bash[22676]: audit 2024-09-20T22:53:58.820991+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:59 smithi044 bash[22676]: audit 2024-09-20T22:53:58.831298+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:59 smithi044 bash[22676]: audit 2024-09-20T22:53:58.843220+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:59 smithi044 bash[22676]: audit 2024-09-20T22:53:59.137701+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:53:59 smithi044 bash[22676]: audit 2024-09-20T22:53:59.145854+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:59 smithi179 bash[23186]: cluster 2024-09-20T22:53:57.999192+0000 mgr.a (mgr.14388) 1702 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:59 smithi179 bash[23186]: audit 2024-09-20T22:53:58.820991+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:59 smithi179 bash[23186]: audit 2024-09-20T22:53:58.831298+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:59 smithi179 bash[23186]: audit 2024-09-20T22:53:58.843220+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:59 smithi179 bash[23186]: audit 2024-09-20T22:53:59.137701+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:53:59 smithi179 bash[23186]: audit 2024-09-20T22:53:59.145854+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:59 smithi049 bash[23528]: cluster 2024-09-20T22:53:57.999192+0000 mgr.a (mgr.14388) 1702 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:53:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:59 smithi049 bash[23528]: audit 2024-09-20T22:53:58.820991+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:59 smithi049 bash[23528]: audit 2024-09-20T22:53:58.831298+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:59 smithi049 bash[23528]: audit 2024-09-20T22:53:58.843220+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:59 smithi049 bash[23528]: audit 2024-09-20T22:53:59.137701+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:53:59 smithi049 bash[23528]: audit 2024-09-20T22:53:59.145854+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:53:59.704 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:53:59.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:53:59.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:53:59.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:53:59.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:00 smithi044 bash[22676]: audit 2024-09-20T22:53:59.153957+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:00 smithi044 bash[22676]: audit 2024-09-20T22:53:59.254522+0000 mgr.a (mgr.14388) 1703 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:00 smithi179 bash[23186]: audit 2024-09-20T22:53:59.153957+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:00 smithi179 bash[23186]: audit 2024-09-20T22:53:59.254522+0000 mgr.a (mgr.14388) 1703 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:00 smithi049 bash[23528]: audit 2024-09-20T22:53:59.153957+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:00 smithi049 bash[23528]: audit 2024-09-20T22:53:59.254522+0000 mgr.a (mgr.14388) 1703 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:01 smithi044 bash[22676]: cluster 2024-09-20T22:54:00.001458+0000 mgr.a (mgr.14388) 1704 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:01 smithi044 bash[22676]: audit 2024-09-20T22:54:01.009946+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:01 smithi044 bash[22676]: audit 2024-09-20T22:54:01.018460+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:01 smithi044 bash[22676]: audit 2024-09-20T22:54:01.029050+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:01 smithi179 bash[23186]: cluster 2024-09-20T22:54:00.001458+0000 mgr.a (mgr.14388) 1704 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:01 smithi179 bash[23186]: audit 2024-09-20T22:54:01.009946+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:01 smithi179 bash[23186]: audit 2024-09-20T22:54:01.018460+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:01 smithi179 bash[23186]: audit 2024-09-20T22:54:01.029050+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:01 smithi049 bash[23528]: cluster 2024-09-20T22:54:00.001458+0000 mgr.a (mgr.14388) 1704 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:01 smithi049 bash[23528]: audit 2024-09-20T22:54:01.009946+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:01 smithi049 bash[23528]: audit 2024-09-20T22:54:01.018460+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:01 smithi049 bash[23528]: audit 2024-09-20T22:54:01.029050+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:03 smithi179 bash[23186]: cluster 2024-09-20T22:54:02.002212+0000 mgr.a (mgr.14388) 1705 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:03 smithi044 bash[22676]: cluster 2024-09-20T22:54:02.002212+0000 mgr.a (mgr.14388) 1705 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:03 smithi049 bash[23528]: cluster 2024-09-20T22:54:02.002212+0000 mgr.a (mgr.14388) 1705 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:04.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:04.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:04.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:05.450 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:05.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:05.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:05 smithi044 bash[22676]: cluster 2024-09-20T22:54:04.002978+0000 mgr.a (mgr.14388) 1706 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:05 smithi179 bash[23186]: cluster 2024-09-20T22:54:04.002978+0000 mgr.a (mgr.14388) 1706 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:05 smithi049 bash[23528]: cluster 2024-09-20T22:54:04.002978+0000 mgr.a (mgr.14388) 1706 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:06 smithi044 bash[22676]: audit 2024-09-20T22:54:05.038066+0000 mgr.a (mgr.14388) 1707 : audit [DBG] from='client.49275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:06 smithi179 bash[23186]: audit 2024-09-20T22:54:05.038066+0000 mgr.a (mgr.14388) 1707 : audit [DBG] from='client.49275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:06 smithi049 bash[23528]: audit 2024-09-20T22:54:05.038066+0000 mgr.a (mgr.14388) 1707 : audit [DBG] from='client.49275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:07 smithi044 bash[22676]: cluster 2024-09-20T22:54:06.005676+0000 mgr.a (mgr.14388) 1708 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:07 smithi179 bash[23186]: cluster 2024-09-20T22:54:06.005676+0000 mgr.a (mgr.14388) 1708 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:07 smithi049 bash[23528]: cluster 2024-09-20T22:54:06.005676+0000 mgr.a (mgr.14388) 1708 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:09 smithi044 bash[22676]: cluster 2024-09-20T22:54:08.006414+0000 mgr.a (mgr.14388) 1709 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:09 smithi179 bash[23186]: cluster 2024-09-20T22:54:08.006414+0000 mgr.a (mgr.14388) 1709 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:09 smithi049 bash[23528]: cluster 2024-09-20T22:54:08.006414+0000 mgr.a (mgr.14388) 1709 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:11.194 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:11.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:11.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:11.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:11.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:11 smithi044 bash[22676]: cluster 2024-09-20T22:54:10.008295+0000 mgr.a (mgr.14388) 1710 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:11 smithi179 bash[23186]: cluster 2024-09-20T22:54:10.008295+0000 mgr.a (mgr.14388) 1710 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:11 smithi049 bash[23528]: cluster 2024-09-20T22:54:10.008295+0000 mgr.a (mgr.14388) 1710 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:12 smithi044 bash[22676]: audit 2024-09-20T22:54:10.782827+0000 mgr.a (mgr.14388) 1711 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:12 smithi179 bash[23186]: audit 2024-09-20T22:54:10.782827+0000 mgr.a (mgr.14388) 1711 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:12 smithi049 bash[23528]: audit 2024-09-20T22:54:10.782827+0000 mgr.a (mgr.14388) 1711 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:13.468 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:13 smithi049 bash[23528]: cluster 2024-09-20T22:54:12.009147+0000 mgr.a (mgr.14388) 1712 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:13 smithi044 bash[22676]: cluster 2024-09-20T22:54:12.009147+0000 mgr.a (mgr.14388) 1712 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:13 smithi179 bash[23186]: cluster 2024-09-20T22:54:12.009147+0000 mgr.a (mgr.14388) 1712 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:15.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:15 smithi049 bash[23528]: cluster 2024-09-20T22:54:14.009891+0000 mgr.a (mgr.14388) 1713 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:15 smithi044 bash[22676]: cluster 2024-09-20T22:54:14.009891+0000 mgr.a (mgr.14388) 1713 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:15 smithi179 bash[23186]: cluster 2024-09-20T22:54:14.009891+0000 mgr.a (mgr.14388) 1713 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:16.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:16.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:16.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:17 smithi044 bash[22676]: cluster 2024-09-20T22:54:16.012138+0000 mgr.a (mgr.14388) 1714 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:17 smithi179 bash[23186]: cluster 2024-09-20T22:54:16.012138+0000 mgr.a (mgr.14388) 1714 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:17 smithi049 bash[23528]: cluster 2024-09-20T22:54:16.012138+0000 mgr.a (mgr.14388) 1714 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:18.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:18 smithi044 bash[22676]: audit 2024-09-20T22:54:16.521303+0000 mgr.a (mgr.14388) 1715 : audit [DBG] from='client.49428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:18 smithi179 bash[23186]: audit 2024-09-20T22:54:16.521303+0000 mgr.a (mgr.14388) 1715 : audit [DBG] from='client.49428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:18 smithi049 bash[23528]: audit 2024-09-20T22:54:16.521303+0000 mgr.a (mgr.14388) 1715 : audit [DBG] from='client.49428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:19 smithi044 bash[22676]: cluster 2024-09-20T22:54:18.012718+0000 mgr.a (mgr.14388) 1716 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:19 smithi044 bash[22676]: audit 2024-09-20T22:54:19.053416+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:19 smithi044 bash[22676]: audit 2024-09-20T22:54:19.061694+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:19 smithi044 bash[22676]: audit 2024-09-20T22:54:19.070746+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:19 smithi179 bash[23186]: cluster 2024-09-20T22:54:18.012718+0000 mgr.a (mgr.14388) 1716 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:19 smithi179 bash[23186]: audit 2024-09-20T22:54:19.053416+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:19 smithi179 bash[23186]: audit 2024-09-20T22:54:19.061694+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:19 smithi179 bash[23186]: audit 2024-09-20T22:54:19.070746+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:19 smithi049 bash[23528]: cluster 2024-09-20T22:54:18.012718+0000 mgr.a (mgr.14388) 1716 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:19 smithi049 bash[23528]: audit 2024-09-20T22:54:19.053416+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:19 smithi049 bash[23528]: audit 2024-09-20T22:54:19.061694+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:19 smithi049 bash[23528]: audit 2024-09-20T22:54:19.070746+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:20 smithi044 bash[22676]: audit 2024-09-20T22:54:19.364915+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:20 smithi044 bash[22676]: audit 2024-09-20T22:54:19.373667+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:20 smithi044 bash[22676]: audit 2024-09-20T22:54:19.384073+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:20 smithi044 bash[22676]: cluster 2024-09-20T22:54:20.014790+0000 mgr.a (mgr.14388) 1717 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:20 smithi179 bash[23186]: audit 2024-09-20T22:54:19.364915+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:20 smithi179 bash[23186]: audit 2024-09-20T22:54:19.373667+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:20 smithi179 bash[23186]: audit 2024-09-20T22:54:19.384073+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:20 smithi179 bash[23186]: cluster 2024-09-20T22:54:20.014790+0000 mgr.a (mgr.14388) 1717 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:20 smithi049 bash[23528]: audit 2024-09-20T22:54:19.364915+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:20 smithi049 bash[23528]: audit 2024-09-20T22:54:19.373667+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:20 smithi049 bash[23528]: audit 2024-09-20T22:54:19.384073+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:20 smithi049 bash[23528]: cluster 2024-09-20T22:54:20.014790+0000 mgr.a (mgr.14388) 1717 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:22 smithi179 bash[23186]: audit 2024-09-20T22:54:21.249222+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:22 smithi179 bash[23186]: audit 2024-09-20T22:54:21.257700+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:22 smithi179 bash[23186]: audit 2024-09-20T22:54:21.267698+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:22 smithi049 bash[23528]: audit 2024-09-20T22:54:21.249222+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:22 smithi049 bash[23528]: audit 2024-09-20T22:54:21.257700+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:22 smithi049 bash[23528]: audit 2024-09-20T22:54:21.267698+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:22.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:22.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:22.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:22.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:22 smithi044 bash[22676]: audit 2024-09-20T22:54:21.249222+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:22 smithi044 bash[22676]: audit 2024-09-20T22:54:21.257700+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:22 smithi044 bash[22676]: audit 2024-09-20T22:54:21.267698+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:23.367 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:23 smithi179 bash[23186]: cluster 2024-09-20T22:54:22.015642+0000 mgr.a (mgr.14388) 1718 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:23.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:23 smithi179 bash[23186]: audit 2024-09-20T22:54:22.279958+0000 mgr.a (mgr.14388) 1719 : audit [DBG] from='client.49506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:23 smithi049 bash[23528]: cluster 2024-09-20T22:54:22.015642+0000 mgr.a (mgr.14388) 1718 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:23 smithi049 bash[23528]: audit 2024-09-20T22:54:22.279958+0000 mgr.a (mgr.14388) 1719 : audit [DBG] from='client.49506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:23 smithi044 bash[22676]: cluster 2024-09-20T22:54:22.015642+0000 mgr.a (mgr.14388) 1718 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:23 smithi044 bash[22676]: audit 2024-09-20T22:54:22.279958+0000 mgr.a (mgr.14388) 1719 : audit [DBG] from='client.49506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:25 smithi049 bash[23528]: cluster 2024-09-20T22:54:24.016518+0000 mgr.a (mgr.14388) 1720 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:25 smithi044 bash[22676]: cluster 2024-09-20T22:54:24.016518+0000 mgr.a (mgr.14388) 1720 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:25 smithi179 bash[23186]: cluster 2024-09-20T22:54:24.016518+0000 mgr.a (mgr.14388) 1720 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:27 smithi049 bash[23528]: cluster 2024-09-20T22:54:26.018757+0000 mgr.a (mgr.14388) 1721 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:27.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:27 smithi044 bash[22676]: cluster 2024-09-20T22:54:26.018757+0000 mgr.a (mgr.14388) 1721 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:27 smithi179 bash[23186]: cluster 2024-09-20T22:54:26.018757+0000 mgr.a (mgr.14388) 1721 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:28.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:29 smithi049 bash[23528]: cluster 2024-09-20T22:54:28.019472+0000 mgr.a (mgr.14388) 1722 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:29 smithi049 bash[23528]: audit 2024-09-20T22:54:28.030724+0000 mgr.a (mgr.14388) 1723 : audit [DBG] from='client.49581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:29 smithi044 bash[22676]: cluster 2024-09-20T22:54:28.019472+0000 mgr.a (mgr.14388) 1722 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:29 smithi044 bash[22676]: audit 2024-09-20T22:54:28.030724+0000 mgr.a (mgr.14388) 1723 : audit [DBG] from='client.49581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:29 smithi179 bash[23186]: cluster 2024-09-20T22:54:28.019472+0000 mgr.a (mgr.14388) 1722 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:29 smithi179 bash[23186]: audit 2024-09-20T22:54:28.030724+0000 mgr.a (mgr.14388) 1723 : audit [DBG] from='client.49581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:31 smithi049 bash[23528]: cluster 2024-09-20T22:54:30.021801+0000 mgr.a (mgr.14388) 1724 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:31 smithi044 bash[22676]: cluster 2024-09-20T22:54:30.021801+0000 mgr.a (mgr.14388) 1724 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:31 smithi179 bash[23186]: cluster 2024-09-20T22:54:30.021801+0000 mgr.a (mgr.14388) 1724 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:54:33.424 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:33 smithi049 bash[23528]: cluster 2024-09-20T22:54:32.022579+0000 mgr.a (mgr.14388) 1725 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:33.424 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:33 smithi049 bash[23528]: audit 2024-09-20T22:54:32.481031+0000 mon.a (mon.0) 2122 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:54:33.425 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:33 smithi049 bash[23528]: audit 2024-09-20T22:54:32.487963+0000 mon.a (mon.0) 2123 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:54:33.425 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:33 smithi049 bash[23528]: audit 2024-09-20T22:54:32.489791+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:54:33.425 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:33 smithi049 bash[23528]: audit 2024-09-20T22:54:32.500869+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:33.425 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:33 smithi049 bash[23528]: audit 2024-09-20T22:54:32.508026+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:54:33.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:33.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:33.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:33.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22930]: debug 2024-09-20T22:54:33.247+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:54:33.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22930]: debug 2024-09-20T22:54:33.251+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:54:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22676]: cluster 2024-09-20T22:54:32.022579+0000 mgr.a (mgr.14388) 1725 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22676]: audit 2024-09-20T22:54:32.481031+0000 mon.a (mon.0) 2122 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:54:33.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22676]: audit 2024-09-20T22:54:32.487963+0000 mon.a (mon.0) 2123 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:54:33.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22676]: audit 2024-09-20T22:54:32.489791+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:54:33.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22676]: audit 2024-09-20T22:54:32.500869+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:33.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:33 smithi044 bash[22676]: audit 2024-09-20T22:54:32.508026+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:33 smithi179 bash[23186]: cluster 2024-09-20T22:54:32.022579+0000 mgr.a (mgr.14388) 1725 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:33 smithi179 bash[23186]: audit 2024-09-20T22:54:32.481031+0000 mon.a (mon.0) 2122 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:33 smithi179 bash[23186]: audit 2024-09-20T22:54:32.487963+0000 mon.a (mon.0) 2123 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:33 smithi179 bash[23186]: audit 2024-09-20T22:54:32.489791+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:33 smithi179 bash[23186]: audit 2024-09-20T22:54:32.500869+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:33 smithi179 bash[23186]: audit 2024-09-20T22:54:32.508026+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:54:34.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:34.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:34.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:34.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:34.239 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:34 smithi049 bash[23528]: audit 2024-09-20T22:54:32.510412+0000 mgr.a (mgr.14388) 1726 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:54:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:34 smithi049 bash[23528]: audit 2024-09-20T22:54:33.252281+0000 mgr.a (mgr.14388) 1727 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:54:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:34 smithi049 bash[23528]: cephadm 2024-09-20T22:54:33.253635+0000 mgr.a (mgr.14388) 1728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:54:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:34 smithi044 bash[22676]: audit 2024-09-20T22:54:32.510412+0000 mgr.a (mgr.14388) 1726 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:54:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:34 smithi044 bash[22676]: audit 2024-09-20T22:54:33.252281+0000 mgr.a (mgr.14388) 1727 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:54:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:34 smithi044 bash[22676]: cephadm 2024-09-20T22:54:33.253635+0000 mgr.a (mgr.14388) 1728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:54:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:34 smithi179 bash[23186]: audit 2024-09-20T22:54:32.510412+0000 mgr.a (mgr.14388) 1726 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:54:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:34 smithi179 bash[23186]: audit 2024-09-20T22:54:33.252281+0000 mgr.a (mgr.14388) 1727 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:54:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:34 smithi179 bash[23186]: cephadm 2024-09-20T22:54:33.253635+0000 mgr.a (mgr.14388) 1728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:54:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:35 smithi049 bash[23528]: audit 2024-09-20T22:54:33.788790+0000 mgr.a (mgr.14388) 1729 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:35 smithi049 bash[23528]: cluster 2024-09-20T22:54:34.023087+0000 mgr.a (mgr.14388) 1730 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:35 smithi044 bash[22676]: audit 2024-09-20T22:54:33.788790+0000 mgr.a (mgr.14388) 1729 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:35 smithi044 bash[22676]: cluster 2024-09-20T22:54:34.023087+0000 mgr.a (mgr.14388) 1730 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:35 smithi179 bash[23186]: audit 2024-09-20T22:54:33.788790+0000 mgr.a (mgr.14388) 1729 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:35 smithi179 bash[23186]: cluster 2024-09-20T22:54:34.023087+0000 mgr.a (mgr.14388) 1730 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:37 smithi044 bash[22676]: cluster 2024-09-20T22:54:36.025391+0000 mgr.a (mgr.14388) 1731 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:37 smithi179 bash[23186]: cluster 2024-09-20T22:54:36.025391+0000 mgr.a (mgr.14388) 1731 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:37 smithi049 bash[23528]: cluster 2024-09-20T22:54:36.025391+0000 mgr.a (mgr.14388) 1731 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:39.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:39.241 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:39.241 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:39 smithi044 bash[22676]: cluster 2024-09-20T22:54:38.026168+0000 mgr.a (mgr.14388) 1732 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:39 smithi044 bash[22676]: audit 2024-09-20T22:54:39.249373+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:39 smithi044 bash[22676]: audit 2024-09-20T22:54:39.254435+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:39 smithi044 bash[22676]: audit 2024-09-20T22:54:39.260867+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.629 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:39 smithi049 bash[23528]: cluster 2024-09-20T22:54:38.026168+0000 mgr.a (mgr.14388) 1732 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:39.629 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:39 smithi049 bash[23528]: audit 2024-09-20T22:54:39.249373+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.629 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:39 smithi049 bash[23528]: audit 2024-09-20T22:54:39.254435+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.629 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:39 smithi049 bash[23528]: audit 2024-09-20T22:54:39.260867+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:39 smithi179 bash[23186]: cluster 2024-09-20T22:54:38.026168+0000 mgr.a (mgr.14388) 1732 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:39 smithi179 bash[23186]: audit 2024-09-20T22:54:39.249373+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:39 smithi179 bash[23186]: audit 2024-09-20T22:54:39.254435+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:39 smithi179 bash[23186]: audit 2024-09-20T22:54:39.260867+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:39.998 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:40 smithi044 bash[22676]: audit 2024-09-20T22:54:39.575999+0000 mgr.a (mgr.14388) 1733 : audit [DBG] from='client.49839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:40 smithi044 bash[22676]: audit 2024-09-20T22:54:39.610602+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:40 smithi044 bash[22676]: audit 2024-09-20T22:54:39.618453+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:40 smithi044 bash[22676]: audit 2024-09-20T22:54:39.627016+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:40 smithi044 bash[22676]: cluster 2024-09-20T22:54:40.027489+0000 mgr.a (mgr.14388) 1734 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:40 smithi179 bash[23186]: audit 2024-09-20T22:54:39.575999+0000 mgr.a (mgr.14388) 1733 : audit [DBG] from='client.49839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:40 smithi179 bash[23186]: audit 2024-09-20T22:54:39.610602+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:40 smithi179 bash[23186]: audit 2024-09-20T22:54:39.618453+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:40 smithi179 bash[23186]: audit 2024-09-20T22:54:39.627016+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:40 smithi179 bash[23186]: cluster 2024-09-20T22:54:40.027489+0000 mgr.a (mgr.14388) 1734 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:40 smithi049 bash[23528]: audit 2024-09-20T22:54:39.575999+0000 mgr.a (mgr.14388) 1733 : audit [DBG] from='client.49839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:40 smithi049 bash[23528]: audit 2024-09-20T22:54:39.610602+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:40 smithi049 bash[23528]: audit 2024-09-20T22:54:39.618453+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:40 smithi049 bash[23528]: audit 2024-09-20T22:54:39.627016+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:40 smithi049 bash[23528]: cluster 2024-09-20T22:54:40.027489+0000 mgr.a (mgr.14388) 1734 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:42 smithi179 bash[23186]: audit 2024-09-20T22:54:41.492951+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:42 smithi179 bash[23186]: audit 2024-09-20T22:54:41.500533+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:42 smithi179 bash[23186]: audit 2024-09-20T22:54:41.510522+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:42 smithi179 bash[23186]: cluster 2024-09-20T22:54:42.028204+0000 mgr.a (mgr.14388) 1735 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:42 smithi049 bash[23528]: audit 2024-09-20T22:54:41.492951+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:42 smithi049 bash[23528]: audit 2024-09-20T22:54:41.500533+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:42 smithi049 bash[23528]: audit 2024-09-20T22:54:41.510522+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:42 smithi049 bash[23528]: cluster 2024-09-20T22:54:42.028204+0000 mgr.a (mgr.14388) 1735 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:42 smithi044 bash[22676]: audit 2024-09-20T22:54:41.492951+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:42 smithi044 bash[22676]: audit 2024-09-20T22:54:41.500533+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:42 smithi044 bash[22676]: audit 2024-09-20T22:54:41.510522+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:54:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:42 smithi044 bash[22676]: cluster 2024-09-20T22:54:42.028204+0000 mgr.a (mgr.14388) 1735 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:45.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:45.001 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:45.001 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:45.454 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:45 smithi179 bash[23186]: cluster 2024-09-20T22:54:44.028968+0000 mgr.a (mgr.14388) 1736 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:45 smithi044 bash[22676]: cluster 2024-09-20T22:54:44.028968+0000 mgr.a (mgr.14388) 1736 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:45 smithi049 bash[23528]: cluster 2024-09-20T22:54:44.028968+0000 mgr.a (mgr.14388) 1736 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:45.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:45.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:45.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:45.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:45.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:46 smithi044 bash[22676]: audit 2024-09-20T22:54:45.333468+0000 mgr.a (mgr.14388) 1737 : audit [DBG] from='client.49917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:46 smithi179 bash[23186]: audit 2024-09-20T22:54:45.333468+0000 mgr.a (mgr.14388) 1737 : audit [DBG] from='client.49917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:46 smithi049 bash[23528]: audit 2024-09-20T22:54:45.333468+0000 mgr.a (mgr.14388) 1737 : audit [DBG] from='client.49917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:47 smithi044 bash[22676]: cluster 2024-09-20T22:54:46.031719+0000 mgr.a (mgr.14388) 1738 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:47 smithi179 bash[23186]: cluster 2024-09-20T22:54:46.031719+0000 mgr.a (mgr.14388) 1738 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:47 smithi049 bash[23528]: cluster 2024-09-20T22:54:46.031719+0000 mgr.a (mgr.14388) 1738 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:54:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:49 smithi044 bash[22676]: cluster 2024-09-20T22:54:48.032514+0000 mgr.a (mgr.14388) 1739 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:49 smithi179 bash[23186]: cluster 2024-09-20T22:54:48.032514+0000 mgr.a (mgr.14388) 1739 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:49 smithi049 bash[23528]: cluster 2024-09-20T22:54:48.032514+0000 mgr.a (mgr.14388) 1739 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:54:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:51 smithi044 bash[22676]: cluster 2024-09-20T22:54:50.034479+0000 mgr.a (mgr.14388) 1740 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:51 smithi179 bash[23186]: cluster 2024-09-20T22:54:50.034479+0000 mgr.a (mgr.14388) 1740 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:51.545 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:51.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:51.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:51.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:51.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:51 smithi049 bash[23528]: cluster 2024-09-20T22:54:50.034479+0000 mgr.a (mgr.14388) 1740 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:52 smithi044 bash[22676]: audit 2024-09-20T22:54:51.102335+0000 mgr.a (mgr.14388) 1741 : audit [DBG] from='client.49995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:52 smithi179 bash[23186]: audit 2024-09-20T22:54:51.102335+0000 mgr.a (mgr.14388) 1741 : audit [DBG] from='client.49995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:52 smithi049 bash[23528]: audit 2024-09-20T22:54:51.102335+0000 mgr.a (mgr.14388) 1741 : audit [DBG] from='client.49995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:53.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:53 smithi049 bash[23528]: cluster 2024-09-20T22:54:52.035464+0000 mgr.a (mgr.14388) 1742 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:53 smithi044 bash[22676]: cluster 2024-09-20T22:54:52.035464+0000 mgr.a (mgr.14388) 1742 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:53 smithi179 bash[23186]: cluster 2024-09-20T22:54:52.035464+0000 mgr.a (mgr.14388) 1742 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:55 smithi044 bash[22676]: cluster 2024-09-20T22:54:54.036249+0000 mgr.a (mgr.14388) 1743 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:55 smithi179 bash[23186]: cluster 2024-09-20T22:54:54.036249+0000 mgr.a (mgr.14388) 1743 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:55.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:55 smithi049 bash[23528]: cluster 2024-09-20T22:54:54.036249+0000 mgr.a (mgr.14388) 1743 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:54:56.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:54:56.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:54:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:54:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:57 smithi044 bash[22676]: cluster 2024-09-20T22:54:56.038475+0000 mgr.a (mgr.14388) 1744 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:57.283 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:54:57.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:54:57.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:54:57.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:54:57.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:54:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:57 smithi179 bash[23186]: cluster 2024-09-20T22:54:56.038475+0000 mgr.a (mgr.14388) 1744 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:57 smithi049 bash[23528]: cluster 2024-09-20T22:54:56.038475+0000 mgr.a (mgr.14388) 1744 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:58 smithi044 bash[22676]: audit 2024-09-20T22:54:56.876074+0000 mgr.a (mgr.14388) 1745 : audit [DBG] from='client.50073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:58 smithi179 bash[23186]: audit 2024-09-20T22:54:56.876074+0000 mgr.a (mgr.14388) 1745 : audit [DBG] from='client.50073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:58 smithi049 bash[23528]: audit 2024-09-20T22:54:56.876074+0000 mgr.a (mgr.14388) 1745 : audit [DBG] from='client.50073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:54:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:54:59 smithi044 bash[22676]: cluster 2024-09-20T22:54:58.039279+0000 mgr.a (mgr.14388) 1746 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:59.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:54:59 smithi179 bash[23186]: cluster 2024-09-20T22:54:58.039279+0000 mgr.a (mgr.14388) 1746 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:54:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:54:59 smithi049 bash[23528]: cluster 2024-09-20T22:54:58.039279+0000 mgr.a (mgr.14388) 1746 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:00 smithi044 bash[22676]: audit 2024-09-20T22:54:59.429604+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:00 smithi044 bash[22676]: audit 2024-09-20T22:54:59.436541+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:00 smithi044 bash[22676]: audit 2024-09-20T22:54:59.444974+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:00 smithi044 bash[22676]: audit 2024-09-20T22:54:59.836247+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:00 smithi044 bash[22676]: audit 2024-09-20T22:54:59.844766+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:00 smithi044 bash[22676]: audit 2024-09-20T22:54:59.853822+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:00 smithi044 bash[22676]: cluster 2024-09-20T22:55:00.040614+0000 mgr.a (mgr.14388) 1747 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:00 smithi179 bash[23186]: audit 2024-09-20T22:54:59.429604+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:00 smithi179 bash[23186]: audit 2024-09-20T22:54:59.436541+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:00 smithi179 bash[23186]: audit 2024-09-20T22:54:59.444974+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:00 smithi179 bash[23186]: audit 2024-09-20T22:54:59.836247+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:00 smithi179 bash[23186]: audit 2024-09-20T22:54:59.844766+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:00 smithi179 bash[23186]: audit 2024-09-20T22:54:59.853822+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:00 smithi179 bash[23186]: cluster 2024-09-20T22:55:00.040614+0000 mgr.a (mgr.14388) 1747 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:00 smithi049 bash[23528]: audit 2024-09-20T22:54:59.429604+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:00 smithi049 bash[23528]: audit 2024-09-20T22:54:59.436541+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:00 smithi049 bash[23528]: audit 2024-09-20T22:54:59.444974+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:00 smithi049 bash[23528]: audit 2024-09-20T22:54:59.836247+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:00 smithi049 bash[23528]: audit 2024-09-20T22:54:59.844766+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:00 smithi049 bash[23528]: audit 2024-09-20T22:54:59.853822+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:00 smithi049 bash[23528]: cluster 2024-09-20T22:55:00.040614+0000 mgr.a (mgr.14388) 1747 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:02.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:02.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:02.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:02 smithi044 bash[22676]: audit 2024-09-20T22:55:01.731255+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:02 smithi044 bash[22676]: audit 2024-09-20T22:55:01.740722+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:02 smithi044 bash[22676]: audit 2024-09-20T22:55:01.750450+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:02 smithi044 bash[22676]: cluster 2024-09-20T22:55:02.041352+0000 mgr.a (mgr.14388) 1748 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:02 smithi179 bash[23186]: audit 2024-09-20T22:55:01.731255+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:02 smithi179 bash[23186]: audit 2024-09-20T22:55:01.740722+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:02 smithi179 bash[23186]: audit 2024-09-20T22:55:01.750450+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:02 smithi179 bash[23186]: cluster 2024-09-20T22:55:02.041352+0000 mgr.a (mgr.14388) 1748 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:02 smithi049 bash[23528]: audit 2024-09-20T22:55:01.731255+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:02 smithi049 bash[23528]: audit 2024-09-20T22:55:01.740722+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:02 smithi049 bash[23528]: audit 2024-09-20T22:55:01.750450+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:02 smithi049 bash[23528]: cluster 2024-09-20T22:55:02.041352+0000 mgr.a (mgr.14388) 1748 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:03.066 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:03.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:03.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:03.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:03.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:03 smithi179 bash[23186]: audit 2024-09-20T22:55:02.622358+0000 mgr.a (mgr.14388) 1749 : audit [DBG] from='client.50148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:03 smithi049 bash[23528]: audit 2024-09-20T22:55:02.622358+0000 mgr.a (mgr.14388) 1749 : audit [DBG] from='client.50148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:03 smithi044 bash[22676]: audit 2024-09-20T22:55:02.622358+0000 mgr.a (mgr.14388) 1749 : audit [DBG] from='client.50148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:04 smithi179 bash[23186]: cluster 2024-09-20T22:55:04.042549+0000 mgr.a (mgr.14388) 1750 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:05.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:04 smithi049 bash[23528]: cluster 2024-09-20T22:55:04.042549+0000 mgr.a (mgr.14388) 1750 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:04 smithi044 bash[22676]: cluster 2024-09-20T22:55:04.042549+0000 mgr.a (mgr.14388) 1750 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:07 smithi179 bash[23186]: cluster 2024-09-20T22:55:06.044755+0000 mgr.a (mgr.14388) 1751 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:07 smithi044 bash[22676]: cluster 2024-09-20T22:55:06.044755+0000 mgr.a (mgr.14388) 1751 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:07 smithi049 bash[23528]: cluster 2024-09-20T22:55:06.044755+0000 mgr.a (mgr.14388) 1751 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:08.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:08.841 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:09 smithi044 bash[22676]: cluster 2024-09-20T22:55:08.045585+0000 mgr.a (mgr.14388) 1752 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:09 smithi179 bash[23186]: cluster 2024-09-20T22:55:08.045585+0000 mgr.a (mgr.14388) 1752 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:09 smithi049 bash[23528]: cluster 2024-09-20T22:55:08.045585+0000 mgr.a (mgr.14388) 1752 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:10 smithi044 bash[22676]: audit 2024-09-20T22:55:08.403229+0000 mgr.a (mgr.14388) 1753 : audit [DBG] from='client.50226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:10 smithi179 bash[23186]: audit 2024-09-20T22:55:08.403229+0000 mgr.a (mgr.14388) 1753 : audit [DBG] from='client.50226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:10 smithi049 bash[23528]: audit 2024-09-20T22:55:08.403229+0000 mgr.a (mgr.14388) 1753 : audit [DBG] from='client.50226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:11 smithi044 bash[22676]: cluster 2024-09-20T22:55:10.047870+0000 mgr.a (mgr.14388) 1754 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:11 smithi179 bash[23186]: cluster 2024-09-20T22:55:10.047870+0000 mgr.a (mgr.14388) 1754 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:11 smithi049 bash[23528]: cluster 2024-09-20T22:55:10.047870+0000 mgr.a (mgr.14388) 1754 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:13 smithi044 bash[22676]: cluster 2024-09-20T22:55:12.048621+0000 mgr.a (mgr.14388) 1755 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:13 smithi179 bash[23186]: cluster 2024-09-20T22:55:12.048621+0000 mgr.a (mgr.14388) 1755 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:13 smithi049 bash[23528]: cluster 2024-09-20T22:55:12.048621+0000 mgr.a (mgr.14388) 1755 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:13.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:13.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:13.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:14.633 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:14.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:14.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:14.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:14.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:15 smithi044 bash[22676]: cluster 2024-09-20T22:55:14.049625+0000 mgr.a (mgr.14388) 1756 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:15.542 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:15 smithi044 bash[22676]: audit 2024-09-20T22:55:14.182743+0000 mgr.a (mgr.14388) 1757 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:15.543 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:15 smithi179 bash[23186]: cluster 2024-09-20T22:55:14.049625+0000 mgr.a (mgr.14388) 1756 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:15.543 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:15 smithi179 bash[23186]: audit 2024-09-20T22:55:14.182743+0000 mgr.a (mgr.14388) 1757 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:15 smithi049 bash[23528]: cluster 2024-09-20T22:55:14.049625+0000 mgr.a (mgr.14388) 1756 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:15 smithi049 bash[23528]: audit 2024-09-20T22:55:14.182743+0000 mgr.a (mgr.14388) 1757 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:17 smithi044 bash[22676]: cluster 2024-09-20T22:55:16.052823+0000 mgr.a (mgr.14388) 1758 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:17 smithi179 bash[23186]: cluster 2024-09-20T22:55:16.052823+0000 mgr.a (mgr.14388) 1758 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:17 smithi049 bash[23528]: cluster 2024-09-20T22:55:16.052823+0000 mgr.a (mgr.14388) 1758 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:55:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:19 smithi044 bash[22676]: cluster 2024-09-20T22:55:18.053528+0000 mgr.a (mgr.14388) 1759 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:19 smithi179 bash[23186]: cluster 2024-09-20T22:55:18.053528+0000 mgr.a (mgr.14388) 1759 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:19 smithi049 bash[23528]: cluster 2024-09-20T22:55:18.053528+0000 mgr.a (mgr.14388) 1759 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:19.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:19.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:19.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:20.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:20.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:20.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: audit 2024-09-20T22:55:19.594266+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: audit 2024-09-20T22:55:19.602666+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: audit 2024-09-20T22:55:19.613122+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: audit 2024-09-20T22:55:19.984794+0000 mgr.a (mgr.14388) 1760 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: audit 2024-09-20T22:55:20.048814+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: audit 2024-09-20T22:55:20.054403+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: cluster 2024-09-20T22:55:20.054661+0000 mgr.a (mgr.14388) 1761 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:20 smithi044 bash[22676]: audit 2024-09-20T22:55:20.059775+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: audit 2024-09-20T22:55:19.594266+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: audit 2024-09-20T22:55:19.602666+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: audit 2024-09-20T22:55:19.613122+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: audit 2024-09-20T22:55:19.984794+0000 mgr.a (mgr.14388) 1760 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: audit 2024-09-20T22:55:20.048814+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: audit 2024-09-20T22:55:20.054403+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: cluster 2024-09-20T22:55:20.054661+0000 mgr.a (mgr.14388) 1761 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:20 smithi179 bash[23186]: audit 2024-09-20T22:55:20.059775+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: audit 2024-09-20T22:55:19.594266+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: audit 2024-09-20T22:55:19.602666+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: audit 2024-09-20T22:55:19.613122+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: audit 2024-09-20T22:55:19.984794+0000 mgr.a (mgr.14388) 1760 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: audit 2024-09-20T22:55:20.048814+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: audit 2024-09-20T22:55:20.054403+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: cluster 2024-09-20T22:55:20.054661+0000 mgr.a (mgr.14388) 1761 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:20 smithi049 bash[23528]: audit 2024-09-20T22:55:20.059775+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:22 smithi044 bash[22676]: audit 2024-09-20T22:55:21.965440+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:22 smithi044 bash[22676]: audit 2024-09-20T22:55:21.973839+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:22 smithi044 bash[22676]: audit 2024-09-20T22:55:21.984574+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:22 smithi044 bash[22676]: cluster 2024-09-20T22:55:22.055479+0000 mgr.a (mgr.14388) 1762 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:55:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:22 smithi179 bash[23186]: audit 2024-09-20T22:55:21.965440+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:22 smithi179 bash[23186]: audit 2024-09-20T22:55:21.973839+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:22 smithi179 bash[23186]: audit 2024-09-20T22:55:21.984574+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:22 smithi179 bash[23186]: cluster 2024-09-20T22:55:22.055479+0000 mgr.a (mgr.14388) 1762 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:55:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:22 smithi049 bash[23528]: audit 2024-09-20T22:55:21.965440+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:22 smithi049 bash[23528]: audit 2024-09-20T22:55:21.973839+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:22 smithi049 bash[23528]: audit 2024-09-20T22:55:21.984574+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:22 smithi049 bash[23528]: cluster 2024-09-20T22:55:22.055479+0000 mgr.a (mgr.14388) 1762 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:55:25.422 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:25 smithi179 bash[23186]: cluster 2024-09-20T22:55:24.056269+0000 mgr.a (mgr.14388) 1763 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:55:25.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:25.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:25.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:25 smithi044 bash[22676]: cluster 2024-09-20T22:55:24.056269+0000 mgr.a (mgr.14388) 1763 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:55:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:25 smithi049 bash[23528]: cluster 2024-09-20T22:55:24.056269+0000 mgr.a (mgr.14388) 1763 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:55:26.225 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:26.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:26.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:26.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:26.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:27 smithi044 bash[22676]: audit 2024-09-20T22:55:25.776334+0000 mgr.a (mgr.14388) 1764 : audit [DBG] from='client.50451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:27 smithi044 bash[22676]: cluster 2024-09-20T22:55:26.057868+0000 mgr.a (mgr.14388) 1765 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:27 smithi179 bash[23186]: audit 2024-09-20T22:55:25.776334+0000 mgr.a (mgr.14388) 1764 : audit [DBG] from='client.50451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:27 smithi179 bash[23186]: cluster 2024-09-20T22:55:26.057868+0000 mgr.a (mgr.14388) 1765 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:27 smithi049 bash[23528]: audit 2024-09-20T22:55:25.776334+0000 mgr.a (mgr.14388) 1764 : audit [DBG] from='client.50451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:27 smithi049 bash[23528]: cluster 2024-09-20T22:55:26.057868+0000 mgr.a (mgr.14388) 1765 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:29 smithi044 bash[22676]: cluster 2024-09-20T22:55:28.058692+0000 mgr.a (mgr.14388) 1766 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:55:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:29 smithi179 bash[23186]: cluster 2024-09-20T22:55:28.058692+0000 mgr.a (mgr.14388) 1766 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:55:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:29 smithi049 bash[23528]: cluster 2024-09-20T22:55:28.058692+0000 mgr.a (mgr.14388) 1766 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:55:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:31.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:31.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:31 smithi044 bash[22676]: cluster 2024-09-20T22:55:30.060835+0000 mgr.a (mgr.14388) 1767 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:31 smithi179 bash[23186]: cluster 2024-09-20T22:55:30.060835+0000 mgr.a (mgr.14388) 1767 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:31 smithi049 bash[23528]: cluster 2024-09-20T22:55:30.060835+0000 mgr.a (mgr.14388) 1767 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:33 smithi044 bash[22676]: audit 2024-09-20T22:55:31.565229+0000 mgr.a (mgr.14388) 1768 : audit [DBG] from='client.50526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:33 smithi044 bash[22676]: cluster 2024-09-20T22:55:32.061755+0000 mgr.a (mgr.14388) 1769 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:33 smithi179 bash[23186]: audit 2024-09-20T22:55:31.565229+0000 mgr.a (mgr.14388) 1768 : audit [DBG] from='client.50526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:33 smithi179 bash[23186]: cluster 2024-09-20T22:55:32.061755+0000 mgr.a (mgr.14388) 1769 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:33 smithi049 bash[23528]: audit 2024-09-20T22:55:31.565229+0000 mgr.a (mgr.14388) 1768 : audit [DBG] from='client.50526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:33 smithi049 bash[23528]: cluster 2024-09-20T22:55:32.061755+0000 mgr.a (mgr.14388) 1769 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:34.414 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:34 smithi049 bash[23528]: audit 2024-09-20T22:55:33.313535+0000 mon.a (mon.0) 2154 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:55:34.414 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:34 smithi049 bash[23528]: audit 2024-09-20T22:55:33.320774+0000 mon.a (mon.0) 2155 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:55:34.414 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:34 smithi049 bash[23528]: audit 2024-09-20T22:55:33.322712+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:55:34.414 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:34 smithi049 bash[23528]: audit 2024-09-20T22:55:33.334192+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:34.414 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:34 smithi049 bash[23528]: audit 2024-09-20T22:55:33.341271+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:55:34.414 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:34 smithi049 bash[23528]: audit 2024-09-20T22:55:33.343738+0000 mgr.a (mgr.14388) 1770 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:55:34.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22930]: debug 2024-09-20T22:55:34.062+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:55:34.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22930]: debug 2024-09-20T22:55:34.062+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:55:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22676]: audit 2024-09-20T22:55:33.313535+0000 mon.a (mon.0) 2154 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:55:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22676]: audit 2024-09-20T22:55:33.320774+0000 mon.a (mon.0) 2155 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:55:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22676]: audit 2024-09-20T22:55:33.322712+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:55:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22676]: audit 2024-09-20T22:55:33.334192+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22676]: audit 2024-09-20T22:55:33.341271+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:55:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:34 smithi044 bash[22676]: audit 2024-09-20T22:55:33.343738+0000 mgr.a (mgr.14388) 1770 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:55:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:34 smithi179 bash[23186]: audit 2024-09-20T22:55:33.313535+0000 mon.a (mon.0) 2154 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:55:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:34 smithi179 bash[23186]: audit 2024-09-20T22:55:33.320774+0000 mon.a (mon.0) 2155 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:55:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:34 smithi179 bash[23186]: audit 2024-09-20T22:55:33.322712+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:55:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:34 smithi179 bash[23186]: audit 2024-09-20T22:55:33.334192+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:34 smithi179 bash[23186]: audit 2024-09-20T22:55:33.341271+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:55:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:34 smithi179 bash[23186]: audit 2024-09-20T22:55:33.343738+0000 mgr.a (mgr.14388) 1770 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:55:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:35 smithi044 bash[22676]: cluster 2024-09-20T22:55:34.062326+0000 mgr.a (mgr.14388) 1771 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:35 smithi044 bash[22676]: audit 2024-09-20T22:55:34.067788+0000 mgr.a (mgr.14388) 1772 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:55:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:35 smithi044 bash[22676]: cephadm 2024-09-20T22:55:34.069062+0000 mgr.a (mgr.14388) 1773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:55:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:35 smithi179 bash[23186]: cluster 2024-09-20T22:55:34.062326+0000 mgr.a (mgr.14388) 1771 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:35 smithi179 bash[23186]: audit 2024-09-20T22:55:34.067788+0000 mgr.a (mgr.14388) 1772 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:55:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:35 smithi179 bash[23186]: cephadm 2024-09-20T22:55:34.069062+0000 mgr.a (mgr.14388) 1773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:55:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:35 smithi049 bash[23528]: cluster 2024-09-20T22:55:34.062326+0000 mgr.a (mgr.14388) 1771 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:35 smithi049 bash[23528]: audit 2024-09-20T22:55:34.067788+0000 mgr.a (mgr.14388) 1772 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:55:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:35 smithi049 bash[23528]: cephadm 2024-09-20T22:55:34.069062+0000 mgr.a (mgr.14388) 1773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:55:36.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:36.999 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:36.999 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:37 smithi044 bash[22676]: cluster 2024-09-20T22:55:36.064456+0000 mgr.a (mgr.14388) 1774 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:37 smithi179 bash[23186]: cluster 2024-09-20T22:55:36.064456+0000 mgr.a (mgr.14388) 1774 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:37 smithi049 bash[23528]: cluster 2024-09-20T22:55:36.064456+0000 mgr.a (mgr.14388) 1774 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:38 smithi044 bash[22676]: audit 2024-09-20T22:55:37.335098+0000 mgr.a (mgr.14388) 1775 : audit [DBG] from='client.50706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:38 smithi179 bash[23186]: audit 2024-09-20T22:55:37.335098+0000 mgr.a (mgr.14388) 1775 : audit [DBG] from='client.50706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:38 smithi049 bash[23528]: audit 2024-09-20T22:55:37.335098+0000 mgr.a (mgr.14388) 1775 : audit [DBG] from='client.50706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:39.663 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:39 smithi044 bash[22676]: cluster 2024-09-20T22:55:38.065468+0000 mgr.a (mgr.14388) 1776 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:39 smithi179 bash[23186]: cluster 2024-09-20T22:55:38.065468+0000 mgr.a (mgr.14388) 1776 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:39 smithi049 bash[23528]: cluster 2024-09-20T22:55:38.065468+0000 mgr.a (mgr.14388) 1776 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:40 smithi044 bash[22676]: audit 2024-09-20T22:55:39.800756+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:40 smithi044 bash[22676]: audit 2024-09-20T22:55:39.807069+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:40 smithi044 bash[22676]: audit 2024-09-20T22:55:39.814122+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:40 smithi044 bash[22676]: cluster 2024-09-20T22:55:40.067502+0000 mgr.a (mgr.14388) 1777 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:40 smithi044 bash[22676]: audit 2024-09-20T22:55:40.253325+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:40 smithi044 bash[22676]: audit 2024-09-20T22:55:40.262257+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:40 smithi044 bash[22676]: audit 2024-09-20T22:55:40.272265+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:40 smithi179 bash[23186]: audit 2024-09-20T22:55:39.800756+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:40 smithi179 bash[23186]: audit 2024-09-20T22:55:39.807069+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:40 smithi179 bash[23186]: audit 2024-09-20T22:55:39.814122+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:40 smithi179 bash[23186]: cluster 2024-09-20T22:55:40.067502+0000 mgr.a (mgr.14388) 1777 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:40 smithi179 bash[23186]: audit 2024-09-20T22:55:40.253325+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:40 smithi179 bash[23186]: audit 2024-09-20T22:55:40.262257+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:40 smithi179 bash[23186]: audit 2024-09-20T22:55:40.272265+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:40 smithi049 bash[23528]: audit 2024-09-20T22:55:39.800756+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:40 smithi049 bash[23528]: audit 2024-09-20T22:55:39.807069+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:40 smithi049 bash[23528]: audit 2024-09-20T22:55:39.814122+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:40 smithi049 bash[23528]: cluster 2024-09-20T22:55:40.067502+0000 mgr.a (mgr.14388) 1777 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:40 smithi049 bash[23528]: audit 2024-09-20T22:55:40.253325+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:40 smithi049 bash[23528]: audit 2024-09-20T22:55:40.262257+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:40 smithi049 bash[23528]: audit 2024-09-20T22:55:40.272265+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:42.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:42.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:43.124 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:43 smithi049 bash[23528]: cluster 2024-09-20T22:55:42.068159+0000 mgr.a (mgr.14388) 1778 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:43.124 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:43 smithi049 bash[23528]: audit 2024-09-20T22:55:42.122424+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:43 smithi049 bash[23528]: audit 2024-09-20T22:55:42.132354+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.125 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:43 smithi049 bash[23528]: audit 2024-09-20T22:55:42.139969+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:43 smithi044 bash[22676]: cluster 2024-09-20T22:55:42.068159+0000 mgr.a (mgr.14388) 1778 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:43 smithi044 bash[22676]: audit 2024-09-20T22:55:42.122424+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:43 smithi044 bash[22676]: audit 2024-09-20T22:55:42.132354+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:43 smithi044 bash[22676]: audit 2024-09-20T22:55:42.139969+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:43 smithi179 bash[23186]: cluster 2024-09-20T22:55:42.068159+0000 mgr.a (mgr.14388) 1778 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:43 smithi179 bash[23186]: audit 2024-09-20T22:55:42.122424+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:43 smithi179 bash[23186]: audit 2024-09-20T22:55:42.132354+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:43 smithi179 bash[23186]: audit 2024-09-20T22:55:42.139969+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:55:43.560 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:44 smithi044 bash[22676]: audit 2024-09-20T22:55:43.112243+0000 mgr.a (mgr.14388) 1779 : audit [DBG] from='client.50778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:44 smithi179 bash[23186]: audit 2024-09-20T22:55:43.112243+0000 mgr.a (mgr.14388) 1779 : audit [DBG] from='client.50778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:44 smithi049 bash[23528]: audit 2024-09-20T22:55:43.112243+0000 mgr.a (mgr.14388) 1779 : audit [DBG] from='client.50778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:45 smithi049 bash[23528]: cluster 2024-09-20T22:55:44.069154+0000 mgr.a (mgr.14388) 1780 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:45.461 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:45 smithi179 bash[23186]: cluster 2024-09-20T22:55:44.069154+0000 mgr.a (mgr.14388) 1780 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:45 smithi044 bash[22676]: cluster 2024-09-20T22:55:44.069154+0000 mgr.a (mgr.14388) 1780 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:47 smithi044 bash[22676]: cluster 2024-09-20T22:55:46.071442+0000 mgr.a (mgr.14388) 1781 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:47 smithi179 bash[23186]: cluster 2024-09-20T22:55:46.071442+0000 mgr.a (mgr.14388) 1781 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:47 smithi049 bash[23528]: cluster 2024-09-20T22:55:46.071442+0000 mgr.a (mgr.14388) 1781 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:55:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:49.354 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:49.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:49.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:49.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:49 smithi044 bash[22676]: cluster 2024-09-20T22:55:48.072244+0000 mgr.a (mgr.14388) 1782 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:49 smithi179 bash[23186]: cluster 2024-09-20T22:55:48.072244+0000 mgr.a (mgr.14388) 1782 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:49 smithi049 bash[23528]: cluster 2024-09-20T22:55:48.072244+0000 mgr.a (mgr.14388) 1782 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:55:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:50 smithi044 bash[22676]: audit 2024-09-20T22:55:48.901807+0000 mgr.a (mgr.14388) 1783 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:50 smithi179 bash[23186]: audit 2024-09-20T22:55:48.901807+0000 mgr.a (mgr.14388) 1783 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:50 smithi049 bash[23528]: audit 2024-09-20T22:55:48.901807+0000 mgr.a (mgr.14388) 1783 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:51 smithi044 bash[22676]: cluster 2024-09-20T22:55:50.074800+0000 mgr.a (mgr.14388) 1784 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-20T22:55:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:51 smithi179 bash[23186]: cluster 2024-09-20T22:55:50.074800+0000 mgr.a (mgr.14388) 1784 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-20T22:55:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:51 smithi049 bash[23528]: cluster 2024-09-20T22:55:50.074800+0000 mgr.a (mgr.14388) 1784 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-20T22:55:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:53 smithi044 bash[22676]: cluster 2024-09-20T22:55:52.075626+0000 mgr.a (mgr.14388) 1785 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-20T22:55:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:53 smithi179 bash[23186]: cluster 2024-09-20T22:55:52.075626+0000 mgr.a (mgr.14388) 1785 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-20T22:55:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:53 smithi049 bash[23528]: cluster 2024-09-20T22:55:52.075626+0000 mgr.a (mgr.14388) 1785 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-20T22:55:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:55:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:55:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:55:55.118 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:55:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:55:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:55:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:55:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:55:55.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:55 smithi049 bash[23528]: cluster 2024-09-20T22:55:54.076440+0000 mgr.a (mgr.14388) 1786 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-20T22:55:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:55 smithi044 bash[22676]: cluster 2024-09-20T22:55:54.076440+0000 mgr.a (mgr.14388) 1786 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-20T22:55:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:55 smithi179 bash[23186]: cluster 2024-09-20T22:55:54.076440+0000 mgr.a (mgr.14388) 1786 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-20T22:55:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:56 smithi049 bash[23528]: audit 2024-09-20T22:55:54.685336+0000 mgr.a (mgr.14388) 1787 : audit [DBG] from='client.50934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:56 smithi044 bash[22676]: audit 2024-09-20T22:55:54.685336+0000 mgr.a (mgr.14388) 1787 : audit [DBG] from='client.50934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:56 smithi179 bash[23186]: audit 2024-09-20T22:55:54.685336+0000 mgr.a (mgr.14388) 1787 : audit [DBG] from='client.50934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:55:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:57 smithi044 bash[22676]: cluster 2024-09-20T22:55:56.079388+0000 mgr.a (mgr.14388) 1788 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:55:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:57 smithi179 bash[23186]: cluster 2024-09-20T22:55:56.079388+0000 mgr.a (mgr.14388) 1788 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:55:57.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:57 smithi049 bash[23528]: cluster 2024-09-20T22:55:56.079388+0000 mgr.a (mgr.14388) 1788 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-20T22:55:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:55:59 smithi044 bash[22676]: cluster 2024-09-20T22:55:58.080385+0000 mgr.a (mgr.14388) 1789 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T22:55:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:55:59 smithi179 bash[23186]: cluster 2024-09-20T22:55:58.080385+0000 mgr.a (mgr.14388) 1789 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T22:55:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:55:59 smithi049 bash[23528]: cluster 2024-09-20T22:55:58.080385+0000 mgr.a (mgr.14388) 1789 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T22:56:00.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:00.121 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:00.121 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:00.888 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:00.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:00.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:00.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:00.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:01 smithi044 bash[22676]: audit 2024-09-20T22:56:00.023055+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:01 smithi044 bash[22676]: audit 2024-09-20T22:56:00.030989+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:01 smithi044 bash[22676]: audit 2024-09-20T22:56:00.053177+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:01 smithi044 bash[22676]: cluster 2024-09-20T22:56:00.081509+0000 mgr.a (mgr.14388) 1790 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T22:56:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:01 smithi044 bash[22676]: audit 2024-09-20T22:56:00.459280+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:01 smithi044 bash[22676]: audit 2024-09-20T22:56:00.479441+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:01 smithi044 bash[22676]: audit 2024-09-20T22:56:00.490793+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:01 smithi049 bash[23528]: audit 2024-09-20T22:56:00.023055+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:01 smithi049 bash[23528]: audit 2024-09-20T22:56:00.030989+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:01 smithi049 bash[23528]: audit 2024-09-20T22:56:00.053177+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:01 smithi049 bash[23528]: cluster 2024-09-20T22:56:00.081509+0000 mgr.a (mgr.14388) 1790 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T22:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:01 smithi049 bash[23528]: audit 2024-09-20T22:56:00.459280+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:01 smithi049 bash[23528]: audit 2024-09-20T22:56:00.479441+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:01 smithi049 bash[23528]: audit 2024-09-20T22:56:00.490793+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:01 smithi179 bash[23186]: audit 2024-09-20T22:56:00.023055+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:01 smithi179 bash[23186]: audit 2024-09-20T22:56:00.030989+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:01 smithi179 bash[23186]: audit 2024-09-20T22:56:00.053177+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:01 smithi179 bash[23186]: cluster 2024-09-20T22:56:00.081509+0000 mgr.a (mgr.14388) 1790 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T22:56:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:01 smithi179 bash[23186]: audit 2024-09-20T22:56:00.459280+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:01 smithi179 bash[23186]: audit 2024-09-20T22:56:00.479441+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:01 smithi179 bash[23186]: audit 2024-09-20T22:56:00.490793+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:02 smithi044 bash[22676]: audit 2024-09-20T22:56:00.451535+0000 mgr.a (mgr.14388) 1791 : audit [DBG] from='client.51012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:02 smithi179 bash[23186]: audit 2024-09-20T22:56:00.451535+0000 mgr.a (mgr.14388) 1791 : audit [DBG] from='client.51012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:02 smithi049 bash[23528]: audit 2024-09-20T22:56:00.451535+0000 mgr.a (mgr.14388) 1791 : audit [DBG] from='client.51012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:03 smithi044 bash[22676]: cluster 2024-09-20T22:56:02.082372+0000 mgr.a (mgr.14388) 1792 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T22:56:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:03 smithi044 bash[22676]: audit 2024-09-20T22:56:02.301969+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:03 smithi044 bash[22676]: audit 2024-09-20T22:56:02.308759+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:03 smithi044 bash[22676]: audit 2024-09-20T22:56:02.316093+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:03 smithi179 bash[23186]: cluster 2024-09-20T22:56:02.082372+0000 mgr.a (mgr.14388) 1792 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T22:56:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:03 smithi179 bash[23186]: audit 2024-09-20T22:56:02.301969+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:03 smithi179 bash[23186]: audit 2024-09-20T22:56:02.308759+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:03 smithi179 bash[23186]: audit 2024-09-20T22:56:02.316093+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:03 smithi049 bash[23528]: cluster 2024-09-20T22:56:02.082372+0000 mgr.a (mgr.14388) 1792 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T22:56:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:03 smithi049 bash[23528]: audit 2024-09-20T22:56:02.301969+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:03 smithi049 bash[23528]: audit 2024-09-20T22:56:02.308759+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:03 smithi049 bash[23528]: audit 2024-09-20T22:56:02.316093+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:05.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:05 smithi049 bash[23528]: cluster 2024-09-20T22:56:04.083221+0000 mgr.a (mgr.14388) 1793 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T22:56:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:05 smithi044 bash[22676]: cluster 2024-09-20T22:56:04.083221+0000 mgr.a (mgr.14388) 1793 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T22:56:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:05 smithi179 bash[23186]: cluster 2024-09-20T22:56:04.083221+0000 mgr.a (mgr.14388) 1793 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-20T22:56:05.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:05.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:05.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:06.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:06.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:06.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:06.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:06.649 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:06 smithi179 bash[23186]: cluster 2024-09-20T22:56:06.084619+0000 mgr.a (mgr.14388) 1794 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 40 op/s 2024-09-20T22:56:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:06 smithi179 bash[23186]: audit 2024-09-20T22:56:06.222411+0000 mgr.a (mgr.14388) 1795 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:06 smithi049 bash[23528]: cluster 2024-09-20T22:56:06.084619+0000 mgr.a (mgr.14388) 1794 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 40 op/s 2024-09-20T22:56:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:06 smithi049 bash[23528]: audit 2024-09-20T22:56:06.222411+0000 mgr.a (mgr.14388) 1795 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:06 smithi044 bash[22676]: cluster 2024-09-20T22:56:06.084619+0000 mgr.a (mgr.14388) 1794 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 40 op/s 2024-09-20T22:56:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:06 smithi044 bash[22676]: audit 2024-09-20T22:56:06.222411+0000 mgr.a (mgr.14388) 1795 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:09 smithi044 bash[22676]: cluster 2024-09-20T22:56:08.085524+0000 mgr.a (mgr.14388) 1796 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:56:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:09 smithi179 bash[23186]: cluster 2024-09-20T22:56:08.085524+0000 mgr.a (mgr.14388) 1796 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:56:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:09 smithi049 bash[23528]: cluster 2024-09-20T22:56:08.085524+0000 mgr.a (mgr.14388) 1796 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:56:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:11 smithi044 bash[22676]: cluster 2024-09-20T22:56:10.087673+0000 mgr.a (mgr.14388) 1797 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:56:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:11 smithi179 bash[23186]: cluster 2024-09-20T22:56:10.087673+0000 mgr.a (mgr.14388) 1797 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:56:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:11 smithi049 bash[23528]: cluster 2024-09-20T22:56:10.087673+0000 mgr.a (mgr.14388) 1797 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:56:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:11.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:11.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:12.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:13 smithi044 bash[22676]: audit 2024-09-20T22:56:11.984358+0000 mgr.a (mgr.14388) 1798 : audit [DBG] from='client.51165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:13 smithi044 bash[22676]: cluster 2024-09-20T22:56:12.088480+0000 mgr.a (mgr.14388) 1799 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:13 smithi179 bash[23186]: audit 2024-09-20T22:56:11.984358+0000 mgr.a (mgr.14388) 1798 : audit [DBG] from='client.51165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:13 smithi179 bash[23186]: cluster 2024-09-20T22:56:12.088480+0000 mgr.a (mgr.14388) 1799 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:13 smithi049 bash[23528]: audit 2024-09-20T22:56:11.984358+0000 mgr.a (mgr.14388) 1798 : audit [DBG] from='client.51165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:13 smithi049 bash[23528]: cluster 2024-09-20T22:56:12.088480+0000 mgr.a (mgr.14388) 1799 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:15.398 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:15 smithi049 bash[23528]: cluster 2024-09-20T22:56:14.089386+0000 mgr.a (mgr.14388) 1800 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:15 smithi044 bash[22676]: cluster 2024-09-20T22:56:14.089386+0000 mgr.a (mgr.14388) 1800 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:15 smithi179 bash[23186]: cluster 2024-09-20T22:56:14.089386+0000 mgr.a (mgr.14388) 1800 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:17.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:17.437 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:17 smithi044 bash[22676]: cluster 2024-09-20T22:56:16.091634+0000 mgr.a (mgr.14388) 1801 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:17 smithi179 bash[23186]: cluster 2024-09-20T22:56:16.091634+0000 mgr.a (mgr.14388) 1801 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:17.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:17 smithi049 bash[23528]: cluster 2024-09-20T22:56:16.091634+0000 mgr.a (mgr.14388) 1801 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:18.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:18.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:18.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:18.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:18.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:19 smithi044 bash[22676]: audit 2024-09-20T22:56:17.773924+0000 mgr.a (mgr.14388) 1802 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:19 smithi044 bash[22676]: cluster 2024-09-20T22:56:18.092240+0000 mgr.a (mgr.14388) 1803 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:19 smithi179 bash[23186]: audit 2024-09-20T22:56:17.773924+0000 mgr.a (mgr.14388) 1802 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:19 smithi179 bash[23186]: cluster 2024-09-20T22:56:18.092240+0000 mgr.a (mgr.14388) 1803 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:19 smithi049 bash[23528]: audit 2024-09-20T22:56:17.773924+0000 mgr.a (mgr.14388) 1802 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:19 smithi049 bash[23528]: cluster 2024-09-20T22:56:18.092240+0000 mgr.a (mgr.14388) 1803 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:21 smithi179 bash[23186]: cluster 2024-09-20T22:56:20.094517+0000 mgr.a (mgr.14388) 1804 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:21 smithi179 bash[23186]: audit 2024-09-20T22:56:20.265985+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:21 smithi179 bash[23186]: audit 2024-09-20T22:56:20.274486+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:21 smithi179 bash[23186]: audit 2024-09-20T22:56:20.284869+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:21 smithi179 bash[23186]: audit 2024-09-20T22:56:20.683729+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:21 smithi179 bash[23186]: audit 2024-09-20T22:56:20.690221+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:21 smithi179 bash[23186]: audit 2024-09-20T22:56:20.696245+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:21 smithi044 bash[22676]: cluster 2024-09-20T22:56:20.094517+0000 mgr.a (mgr.14388) 1804 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:21 smithi044 bash[22676]: audit 2024-09-20T22:56:20.265985+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:21 smithi044 bash[22676]: audit 2024-09-20T22:56:20.274486+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:21 smithi044 bash[22676]: audit 2024-09-20T22:56:20.284869+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:21 smithi044 bash[22676]: audit 2024-09-20T22:56:20.683729+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:21 smithi044 bash[22676]: audit 2024-09-20T22:56:20.690221+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:21 smithi044 bash[22676]: audit 2024-09-20T22:56:20.696245+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:21 smithi049 bash[23528]: cluster 2024-09-20T22:56:20.094517+0000 mgr.a (mgr.14388) 1804 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:21 smithi049 bash[23528]: audit 2024-09-20T22:56:20.265985+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:21 smithi049 bash[23528]: audit 2024-09-20T22:56:20.274486+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:21 smithi049 bash[23528]: audit 2024-09-20T22:56:20.284869+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:21 smithi049 bash[23528]: audit 2024-09-20T22:56:20.683729+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:21 smithi049 bash[23528]: audit 2024-09-20T22:56:20.690221+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:21 smithi049 bash[23528]: audit 2024-09-20T22:56:20.696245+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:23.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:23.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:23 smithi044 bash[22676]: cluster 2024-09-20T22:56:22.095314+0000 mgr.a (mgr.14388) 1805 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:23 smithi044 bash[22676]: audit 2024-09-20T22:56:22.451558+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:23 smithi044 bash[22676]: audit 2024-09-20T22:56:22.457717+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:23 smithi044 bash[22676]: audit 2024-09-20T22:56:22.462982+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:23 smithi049 bash[23528]: cluster 2024-09-20T22:56:22.095314+0000 mgr.a (mgr.14388) 1805 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:23.558 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:23 smithi049 bash[23528]: audit 2024-09-20T22:56:22.451558+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.558 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:23 smithi049 bash[23528]: audit 2024-09-20T22:56:22.457717+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.558 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:23 smithi049 bash[23528]: audit 2024-09-20T22:56:22.462982+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:23 smithi179 bash[23186]: cluster 2024-09-20T22:56:22.095314+0000 mgr.a (mgr.14388) 1805 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:23 smithi179 bash[23186]: audit 2024-09-20T22:56:22.451558+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:23 smithi179 bash[23186]: audit 2024-09-20T22:56:22.457717+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:23 smithi179 bash[23186]: audit 2024-09-20T22:56:22.462982+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:23.990 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:23.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:23.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:23.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:23.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:25 smithi049 bash[23528]: audit 2024-09-20T22:56:23.549672+0000 mgr.a (mgr.14388) 1806 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:25 smithi049 bash[23528]: cluster 2024-09-20T22:56:24.096302+0000 mgr.a (mgr.14388) 1807 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:25 smithi044 bash[22676]: audit 2024-09-20T22:56:23.549672+0000 mgr.a (mgr.14388) 1806 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:25 smithi044 bash[22676]: cluster 2024-09-20T22:56:24.096302+0000 mgr.a (mgr.14388) 1807 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:25 smithi179 bash[23186]: audit 2024-09-20T22:56:23.549672+0000 mgr.a (mgr.14388) 1806 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:25 smithi179 bash[23186]: cluster 2024-09-20T22:56:24.096302+0000 mgr.a (mgr.14388) 1807 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:26 smithi044 bash[22676]: cluster 2024-09-20T22:56:26.098579+0000 mgr.a (mgr.14388) 1808 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:26 smithi179 bash[23186]: cluster 2024-09-20T22:56:26.098579+0000 mgr.a (mgr.14388) 1808 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:26 smithi049 bash[23528]: cluster 2024-09-20T22:56:26.098579+0000 mgr.a (mgr.14388) 1808 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:28.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:28.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:28.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:29 smithi044 bash[22676]: cluster 2024-09-20T22:56:28.099356+0000 mgr.a (mgr.14388) 1809 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:29 smithi179 bash[23186]: cluster 2024-09-20T22:56:28.099356+0000 mgr.a (mgr.14388) 1809 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:29 smithi049 bash[23528]: cluster 2024-09-20T22:56:28.099356+0000 mgr.a (mgr.14388) 1809 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:29.758 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:30 smithi044 bash[22676]: audit 2024-09-20T22:56:29.327768+0000 mgr.a (mgr.14388) 1810 : audit [DBG] from='client.51390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:30 smithi179 bash[23186]: audit 2024-09-20T22:56:29.327768+0000 mgr.a (mgr.14388) 1810 : audit [DBG] from='client.51390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:30 smithi049 bash[23528]: audit 2024-09-20T22:56:29.327768+0000 mgr.a (mgr.14388) 1810 : audit [DBG] from='client.51390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:31 smithi044 bash[22676]: cluster 2024-09-20T22:56:30.101733+0000 mgr.a (mgr.14388) 1811 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:31 smithi179 bash[23186]: cluster 2024-09-20T22:56:30.101733+0000 mgr.a (mgr.14388) 1811 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:31 smithi049 bash[23528]: cluster 2024-09-20T22:56:30.101733+0000 mgr.a (mgr.14388) 1811 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:33 smithi044 bash[22676]: cluster 2024-09-20T22:56:32.102503+0000 mgr.a (mgr.14388) 1812 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:33 smithi179 bash[23186]: cluster 2024-09-20T22:56:32.102503+0000 mgr.a (mgr.14388) 1812 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:33 smithi049 bash[23528]: cluster 2024-09-20T22:56:32.102503+0000 mgr.a (mgr.14388) 1812 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:34 smithi044 bash[22676]: audit 2024-09-20T22:56:34.122597+0000 mon.a (mon.0) 2186 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:56:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:34 smithi044 bash[22676]: audit 2024-09-20T22:56:34.134209+0000 mon.a (mon.0) 2187 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:56:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:34 smithi044 bash[22676]: audit 2024-09-20T22:56:34.136171+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:56:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:34 smithi044 bash[22676]: audit 2024-09-20T22:56:34.147779+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:34 smithi044 bash[22676]: audit 2024-09-20T22:56:34.154115+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:56:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:34 smithi179 bash[23186]: audit 2024-09-20T22:56:34.122597+0000 mon.a (mon.0) 2186 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:56:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:34 smithi179 bash[23186]: audit 2024-09-20T22:56:34.134209+0000 mon.a (mon.0) 2187 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:56:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:34 smithi179 bash[23186]: audit 2024-09-20T22:56:34.136171+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:56:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:34 smithi179 bash[23186]: audit 2024-09-20T22:56:34.147779+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:34 smithi179 bash[23186]: audit 2024-09-20T22:56:34.154115+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:56:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:34 smithi049 bash[23528]: audit 2024-09-20T22:56:34.122597+0000 mon.a (mon.0) 2186 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:56:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:34 smithi049 bash[23528]: audit 2024-09-20T22:56:34.134209+0000 mon.a (mon.0) 2187 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:56:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:34 smithi049 bash[23528]: audit 2024-09-20T22:56:34.136171+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:56:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:34 smithi049 bash[23528]: audit 2024-09-20T22:56:34.147779+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:34 smithi049 bash[23528]: audit 2024-09-20T22:56:34.154115+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:56:34.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:34.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:34.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:35.182 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:56:34 smithi044 bash[22930]: debug 2024-09-20T22:56:34.913+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:56:35.182 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:56:34 smithi044 bash[22930]: debug 2024-09-20T22:56:34.913+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:56:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:35 smithi049 bash[23528]: cluster 2024-09-20T22:56:34.103299+0000 mgr.a (mgr.14388) 1813 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:35 smithi049 bash[23528]: audit 2024-09-20T22:56:34.156498+0000 mgr.a (mgr.14388) 1814 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:56:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:35 smithi044 bash[22676]: cluster 2024-09-20T22:56:34.103299+0000 mgr.a (mgr.14388) 1813 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:35 smithi044 bash[22676]: audit 2024-09-20T22:56:34.156498+0000 mgr.a (mgr.14388) 1814 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:56:35.500 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:35 smithi179 bash[23186]: cluster 2024-09-20T22:56:34.103299+0000 mgr.a (mgr.14388) 1813 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:35 smithi179 bash[23186]: audit 2024-09-20T22:56:34.156498+0000 mgr.a (mgr.14388) 1814 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:56:36.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:36 smithi049 bash[23528]: audit 2024-09-20T22:56:34.919054+0000 mgr.a (mgr.14388) 1815 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:56:36.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:36 smithi049 bash[23528]: cephadm 2024-09-20T22:56:34.920202+0000 mgr.a (mgr.14388) 1816 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:56:36.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:36 smithi049 bash[23528]: audit 2024-09-20T22:56:35.075471+0000 mgr.a (mgr.14388) 1817 : audit [DBG] from='client.51573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:36 smithi044 bash[22676]: audit 2024-09-20T22:56:34.919054+0000 mgr.a (mgr.14388) 1815 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:56:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:36 smithi044 bash[22676]: cephadm 2024-09-20T22:56:34.920202+0000 mgr.a (mgr.14388) 1816 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:56:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:36 smithi044 bash[22676]: audit 2024-09-20T22:56:35.075471+0000 mgr.a (mgr.14388) 1817 : audit [DBG] from='client.51573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:36 smithi179 bash[23186]: audit 2024-09-20T22:56:34.919054+0000 mgr.a (mgr.14388) 1815 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:56:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:36 smithi179 bash[23186]: cephadm 2024-09-20T22:56:34.920202+0000 mgr.a (mgr.14388) 1816 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:56:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:36 smithi179 bash[23186]: audit 2024-09-20T22:56:35.075471+0000 mgr.a (mgr.14388) 1817 : audit [DBG] from='client.51573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:37 smithi044 bash[22676]: cluster 2024-09-20T22:56:36.106313+0000 mgr.a (mgr.14388) 1818 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:37 smithi179 bash[23186]: cluster 2024-09-20T22:56:36.106313+0000 mgr.a (mgr.14388) 1818 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:37 smithi049 bash[23528]: cluster 2024-09-20T22:56:36.106313+0000 mgr.a (mgr.14388) 1818 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:39 smithi044 bash[22676]: cluster 2024-09-20T22:56:38.107160+0000 mgr.a (mgr.14388) 1819 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:39 smithi179 bash[23186]: cluster 2024-09-20T22:56:38.107160+0000 mgr.a (mgr.14388) 1819 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:39 smithi049 bash[23528]: cluster 2024-09-20T22:56:38.107160+0000 mgr.a (mgr.14388) 1819 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:40.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:40.503 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:41.277 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:41 smithi044 bash[22676]: cluster 2024-09-20T22:56:40.109286+0000 mgr.a (mgr.14388) 1820 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:41 smithi044 bash[22676]: audit 2024-09-20T22:56:40.500601+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:41 smithi044 bash[22676]: audit 2024-09-20T22:56:40.510011+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:41 smithi044 bash[22676]: audit 2024-09-20T22:56:40.519995+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:41 smithi044 bash[22676]: audit 2024-09-20T22:56:40.894587+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:41 smithi044 bash[22676]: audit 2024-09-20T22:56:40.902854+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:41 smithi044 bash[22676]: audit 2024-09-20T22:56:40.910410+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:41 smithi179 bash[23186]: cluster 2024-09-20T22:56:40.109286+0000 mgr.a (mgr.14388) 1820 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:41 smithi179 bash[23186]: audit 2024-09-20T22:56:40.500601+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:41 smithi179 bash[23186]: audit 2024-09-20T22:56:40.510011+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:41 smithi179 bash[23186]: audit 2024-09-20T22:56:40.519995+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:41 smithi179 bash[23186]: audit 2024-09-20T22:56:40.894587+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:41 smithi179 bash[23186]: audit 2024-09-20T22:56:40.902854+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:41 smithi179 bash[23186]: audit 2024-09-20T22:56:40.910410+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:41 smithi049 bash[23528]: cluster 2024-09-20T22:56:40.109286+0000 mgr.a (mgr.14388) 1820 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:41 smithi049 bash[23528]: audit 2024-09-20T22:56:40.500601+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:41 smithi049 bash[23528]: audit 2024-09-20T22:56:40.510011+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:41 smithi049 bash[23528]: audit 2024-09-20T22:56:40.519995+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:41 smithi049 bash[23528]: audit 2024-09-20T22:56:40.894587+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:41 smithi049 bash[23528]: audit 2024-09-20T22:56:40.902854+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:41 smithi049 bash[23528]: audit 2024-09-20T22:56:40.910410+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:42.477 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:42 smithi044 bash[22676]: audit 2024-09-20T22:56:40.842138+0000 mgr.a (mgr.14388) 1821 : audit [DBG] from='client.51651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:42 smithi179 bash[23186]: audit 2024-09-20T22:56:40.842138+0000 mgr.a (mgr.14388) 1821 : audit [DBG] from='client.51651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:42 smithi049 bash[23528]: audit 2024-09-20T22:56:40.842138+0000 mgr.a (mgr.14388) 1821 : audit [DBG] from='client.51651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:43 smithi044 bash[22676]: cluster 2024-09-20T22:56:42.110223+0000 mgr.a (mgr.14388) 1822 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:43 smithi044 bash[22676]: audit 2024-09-20T22:56:42.573047+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:43 smithi044 bash[22676]: audit 2024-09-20T22:56:42.577684+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:43 smithi044 bash[22676]: audit 2024-09-20T22:56:42.582698+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:43 smithi179 bash[23186]: cluster 2024-09-20T22:56:42.110223+0000 mgr.a (mgr.14388) 1822 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:43 smithi179 bash[23186]: audit 2024-09-20T22:56:42.573047+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:43 smithi179 bash[23186]: audit 2024-09-20T22:56:42.577684+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:43 smithi179 bash[23186]: audit 2024-09-20T22:56:42.582698+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:43 smithi049 bash[23528]: cluster 2024-09-20T22:56:42.110223+0000 mgr.a (mgr.14388) 1822 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:43 smithi049 bash[23528]: audit 2024-09-20T22:56:42.573047+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:43 smithi049 bash[23528]: audit 2024-09-20T22:56:42.577684+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:43 smithi049 bash[23528]: audit 2024-09-20T22:56:42.582698+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:56:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:45 smithi044 bash[22676]: cluster 2024-09-20T22:56:44.110901+0000 mgr.a (mgr.14388) 1823 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:45 smithi179 bash[23186]: cluster 2024-09-20T22:56:44.110901+0000 mgr.a (mgr.14388) 1823 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:45 smithi049 bash[23528]: cluster 2024-09-20T22:56:44.110901+0000 mgr.a (mgr.14388) 1823 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:56:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:47.051 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:47.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:47.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:47.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:47.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:47 smithi044 bash[22676]: cluster 2024-09-20T22:56:46.113106+0000 mgr.a (mgr.14388) 1824 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:47 smithi049 bash[23528]: cluster 2024-09-20T22:56:46.113106+0000 mgr.a (mgr.14388) 1824 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:48 smithi044 bash[22676]: audit 2024-09-20T22:56:46.612447+0000 mgr.a (mgr.14388) 1825 : audit [DBG] from='client.51726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:47 smithi179 bash[23186]: cluster 2024-09-20T22:56:46.113106+0000 mgr.a (mgr.14388) 1824 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:56:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:48 smithi179 bash[23186]: audit 2024-09-20T22:56:46.612447+0000 mgr.a (mgr.14388) 1825 : audit [DBG] from='client.51726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:48 smithi049 bash[23528]: audit 2024-09-20T22:56:46.612447+0000 mgr.a (mgr.14388) 1825 : audit [DBG] from='client.51726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:49 smithi179 bash[23186]: cluster 2024-09-20T22:56:48.114014+0000 mgr.a (mgr.14388) 1826 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:49 smithi049 bash[23528]: cluster 2024-09-20T22:56:48.114014+0000 mgr.a (mgr.14388) 1826 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:49 smithi044 bash[22676]: cluster 2024-09-20T22:56:48.114014+0000 mgr.a (mgr.14388) 1826 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:51 smithi179 bash[23186]: cluster 2024-09-20T22:56:50.117141+0000 mgr.a (mgr.14388) 1827 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:51 smithi049 bash[23528]: cluster 2024-09-20T22:56:50.117141+0000 mgr.a (mgr.14388) 1827 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:51 smithi044 bash[22676]: cluster 2024-09-20T22:56:50.117141+0000 mgr.a (mgr.14388) 1827 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:52.054 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:52.054 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:52.805 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:52.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:53 smithi179 bash[23186]: cluster 2024-09-20T22:56:52.117914+0000 mgr.a (mgr.14388) 1828 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:53.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:53 smithi179 bash[23186]: audit 2024-09-20T22:56:52.385737+0000 mgr.a (mgr.14388) 1829 : audit [DBG] from='client.51804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:53 smithi049 bash[23528]: cluster 2024-09-20T22:56:52.117914+0000 mgr.a (mgr.14388) 1828 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:53 smithi049 bash[23528]: audit 2024-09-20T22:56:52.385737+0000 mgr.a (mgr.14388) 1829 : audit [DBG] from='client.51804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:53 smithi044 bash[22676]: cluster 2024-09-20T22:56:52.117914+0000 mgr.a (mgr.14388) 1828 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:53 smithi044 bash[22676]: audit 2024-09-20T22:56:52.385737+0000 mgr.a (mgr.14388) 1829 : audit [DBG] from='client.51804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:55 smithi049 bash[23528]: cluster 2024-09-20T22:56:54.118851+0000 mgr.a (mgr.14388) 1830 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:55 smithi044 bash[22676]: cluster 2024-09-20T22:56:54.118851+0000 mgr.a (mgr.14388) 1830 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:55 smithi179 bash[23186]: cluster 2024-09-20T22:56:54.118851+0000 mgr.a (mgr.14388) 1830 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:57 smithi049 bash[23528]: cluster 2024-09-20T22:56:56.121107+0000 mgr.a (mgr.14388) 1831 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:57 smithi044 bash[22676]: cluster 2024-09-20T22:56:56.121107+0000 mgr.a (mgr.14388) 1831 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:57 smithi179 bash[23186]: cluster 2024-09-20T22:56:56.121107+0000 mgr.a (mgr.14388) 1831 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:56:57.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:56:57.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:56:57.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:56:58.586 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:56:58.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:56:58.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:56:58.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:56:58.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:56:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:59 smithi049 bash[23528]: cluster 2024-09-20T22:56:58.121827+0000 mgr.a (mgr.14388) 1832 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:56:59 smithi049 bash[23528]: audit 2024-09-20T22:56:58.145360+0000 mgr.a (mgr.14388) 1833 : audit [DBG] from='client.51882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:59 smithi044 bash[22676]: cluster 2024-09-20T22:56:58.121827+0000 mgr.a (mgr.14388) 1832 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:56:59 smithi044 bash[22676]: audit 2024-09-20T22:56:58.145360+0000 mgr.a (mgr.14388) 1833 : audit [DBG] from='client.51882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:56:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:59 smithi179 bash[23186]: cluster 2024-09-20T22:56:58.121827+0000 mgr.a (mgr.14388) 1832 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:56:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:56:59 smithi179 bash[23186]: audit 2024-09-20T22:56:58.145360+0000 mgr.a (mgr.14388) 1833 : audit [DBG] from='client.51882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:01 smithi049 bash[23528]: cluster 2024-09-20T22:57:00.124127+0000 mgr.a (mgr.14388) 1834 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:01 smithi049 bash[23528]: audit 2024-09-20T22:57:00.724931+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:01 smithi049 bash[23528]: audit 2024-09-20T22:57:00.734495+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:01 smithi049 bash[23528]: audit 2024-09-20T22:57:00.746470+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:01 smithi049 bash[23528]: audit 2024-09-20T22:57:01.119027+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:01 smithi049 bash[23528]: audit 2024-09-20T22:57:01.128754+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:01 smithi049 bash[23528]: audit 2024-09-20T22:57:01.140070+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:01 smithi044 bash[22676]: cluster 2024-09-20T22:57:00.124127+0000 mgr.a (mgr.14388) 1834 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:01 smithi044 bash[22676]: audit 2024-09-20T22:57:00.724931+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:01 smithi044 bash[22676]: audit 2024-09-20T22:57:00.734495+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:01 smithi044 bash[22676]: audit 2024-09-20T22:57:00.746470+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:01 smithi044 bash[22676]: audit 2024-09-20T22:57:01.119027+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:01 smithi044 bash[22676]: audit 2024-09-20T22:57:01.128754+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:01 smithi044 bash[22676]: audit 2024-09-20T22:57:01.140070+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:01 smithi179 bash[23186]: cluster 2024-09-20T22:57:00.124127+0000 mgr.a (mgr.14388) 1834 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:01 smithi179 bash[23186]: audit 2024-09-20T22:57:00.724931+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:01 smithi179 bash[23186]: audit 2024-09-20T22:57:00.734495+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:01 smithi179 bash[23186]: audit 2024-09-20T22:57:00.746470+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:01 smithi179 bash[23186]: audit 2024-09-20T22:57:01.119027+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:01 smithi179 bash[23186]: audit 2024-09-20T22:57:01.128754+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:01 smithi179 bash[23186]: audit 2024-09-20T22:57:01.140070+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:03 smithi044 bash[22676]: cluster 2024-09-20T22:57:02.124669+0000 mgr.a (mgr.14388) 1835 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:03.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:03 smithi044 bash[22676]: audit 2024-09-20T22:57:02.784196+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:03 smithi044 bash[22676]: audit 2024-09-20T22:57:02.792519+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:03 smithi044 bash[22676]: audit 2024-09-20T22:57:02.802324+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:03 smithi049 bash[23528]: cluster 2024-09-20T22:57:02.124669+0000 mgr.a (mgr.14388) 1835 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:03 smithi049 bash[23528]: audit 2024-09-20T22:57:02.784196+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:03 smithi049 bash[23528]: audit 2024-09-20T22:57:02.792519+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:03 smithi049 bash[23528]: audit 2024-09-20T22:57:02.802324+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:03 smithi179 bash[23186]: cluster 2024-09-20T22:57:02.124669+0000 mgr.a (mgr.14388) 1835 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:03 smithi179 bash[23186]: audit 2024-09-20T22:57:02.784196+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:03 smithi179 bash[23186]: audit 2024-09-20T22:57:02.792519+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:03 smithi179 bash[23186]: audit 2024-09-20T22:57:02.802324+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:04.371 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:04.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:04.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:04.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:04.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:05 smithi049 bash[23528]: audit 2024-09-20T22:57:03.928427+0000 mgr.a (mgr.14388) 1836 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:05 smithi049 bash[23528]: cluster 2024-09-20T22:57:04.125222+0000 mgr.a (mgr.14388) 1837 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:05.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:05 smithi044 bash[22676]: audit 2024-09-20T22:57:03.928427+0000 mgr.a (mgr.14388) 1836 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:05.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:05 smithi044 bash[22676]: cluster 2024-09-20T22:57:04.125222+0000 mgr.a (mgr.14388) 1837 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:05 smithi179 bash[23186]: audit 2024-09-20T22:57:03.928427+0000 mgr.a (mgr.14388) 1836 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:05 smithi179 bash[23186]: cluster 2024-09-20T22:57:04.125222+0000 mgr.a (mgr.14388) 1837 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:07 smithi049 bash[23528]: cluster 2024-09-20T22:57:06.127481+0000 mgr.a (mgr.14388) 1838 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:07 smithi044 bash[22676]: cluster 2024-09-20T22:57:06.127481+0000 mgr.a (mgr.14388) 1838 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:07 smithi179 bash[23186]: cluster 2024-09-20T22:57:06.127481+0000 mgr.a (mgr.14388) 1838 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:09.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:09.373 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:09.373 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:09 smithi179 bash[23186]: cluster 2024-09-20T22:57:08.128262+0000 mgr.a (mgr.14388) 1839 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:09 smithi049 bash[23528]: cluster 2024-09-20T22:57:08.128262+0000 mgr.a (mgr.14388) 1839 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:09 smithi044 bash[22676]: cluster 2024-09-20T22:57:08.128262+0000 mgr.a (mgr.14388) 1839 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:10.143 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:11 smithi049 bash[23528]: audit 2024-09-20T22:57:09.709457+0000 mgr.a (mgr.14388) 1840 : audit [DBG] from='client.52038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:11 smithi049 bash[23528]: cluster 2024-09-20T22:57:10.129519+0000 mgr.a (mgr.14388) 1841 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:57:11.701 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:11 smithi179 bash[23186]: audit 2024-09-20T22:57:09.709457+0000 mgr.a (mgr.14388) 1840 : audit [DBG] from='client.52038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:11.701 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:11 smithi179 bash[23186]: cluster 2024-09-20T22:57:10.129519+0000 mgr.a (mgr.14388) 1841 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:57:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:11 smithi044 bash[22676]: audit 2024-09-20T22:57:09.709457+0000 mgr.a (mgr.14388) 1840 : audit [DBG] from='client.52038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:11 smithi044 bash[22676]: cluster 2024-09-20T22:57:10.129519+0000 mgr.a (mgr.14388) 1841 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:57:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:13 smithi049 bash[23528]: cluster 2024-09-20T22:57:12.130395+0000 mgr.a (mgr.14388) 1842 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:57:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:13 smithi044 bash[22676]: cluster 2024-09-20T22:57:12.130395+0000 mgr.a (mgr.14388) 1842 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:57:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:13 smithi179 bash[23186]: cluster 2024-09-20T22:57:12.130395+0000 mgr.a (mgr.14388) 1842 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:57:15.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:15.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:15.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:15 smithi049 bash[23528]: cluster 2024-09-20T22:57:14.131154+0000 mgr.a (mgr.14388) 1843 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:57:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:15 smithi044 bash[22676]: cluster 2024-09-20T22:57:14.131154+0000 mgr.a (mgr.14388) 1843 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:57:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:15 smithi179 bash[23186]: cluster 2024-09-20T22:57:14.131154+0000 mgr.a (mgr.14388) 1843 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:57:15.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:15.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:17 smithi044 bash[22676]: audit 2024-09-20T22:57:15.482802+0000 mgr.a (mgr.14388) 1844 : audit [DBG] from='client.52116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:17 smithi044 bash[22676]: cluster 2024-09-20T22:57:16.134007+0000 mgr.a (mgr.14388) 1845 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:17 smithi179 bash[23186]: audit 2024-09-20T22:57:15.482802+0000 mgr.a (mgr.14388) 1844 : audit [DBG] from='client.52116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:17 smithi179 bash[23186]: cluster 2024-09-20T22:57:16.134007+0000 mgr.a (mgr.14388) 1845 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:17 smithi049 bash[23528]: audit 2024-09-20T22:57:15.482802+0000 mgr.a (mgr.14388) 1844 : audit [DBG] from='client.52116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:17 smithi049 bash[23528]: cluster 2024-09-20T22:57:16.134007+0000 mgr.a (mgr.14388) 1845 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:19.650 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:19 smithi049 bash[23528]: cluster 2024-09-20T22:57:18.134969+0000 mgr.a (mgr.14388) 1846 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:57:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:19 smithi044 bash[22676]: cluster 2024-09-20T22:57:18.134969+0000 mgr.a (mgr.14388) 1846 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:57:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:19 smithi179 bash[23186]: cluster 2024-09-20T22:57:18.134969+0000 mgr.a (mgr.14388) 1846 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:57:20.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:20.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:21.702 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:21.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:21.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:21.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:21.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:21 smithi044 bash[22676]: cluster 2024-09-20T22:57:20.136906+0000 mgr.a (mgr.14388) 1847 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:21 smithi044 bash[22676]: audit 2024-09-20T22:57:20.950228+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:21 smithi044 bash[22676]: audit 2024-09-20T22:57:20.958440+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:21 smithi044 bash[22676]: audit 2024-09-20T22:57:20.969678+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:21 smithi179 bash[23186]: cluster 2024-09-20T22:57:20.136906+0000 mgr.a (mgr.14388) 1847 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:21 smithi179 bash[23186]: audit 2024-09-20T22:57:20.950228+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:21 smithi179 bash[23186]: audit 2024-09-20T22:57:20.958440+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:21 smithi179 bash[23186]: audit 2024-09-20T22:57:20.969678+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:21 smithi049 bash[23528]: cluster 2024-09-20T22:57:20.136906+0000 mgr.a (mgr.14388) 1847 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:21 smithi049 bash[23528]: audit 2024-09-20T22:57:20.950228+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:21 smithi049 bash[23528]: audit 2024-09-20T22:57:20.958440+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:21 smithi049 bash[23528]: audit 2024-09-20T22:57:20.969678+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:22 smithi044 bash[22676]: audit 2024-09-20T22:57:21.247714+0000 mgr.a (mgr.14388) 1848 : audit [DBG] from='client.52194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:22 smithi044 bash[22676]: audit 2024-09-20T22:57:21.333883+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:22 smithi044 bash[22676]: audit 2024-09-20T22:57:21.340125+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:22 smithi044 bash[22676]: audit 2024-09-20T22:57:21.347435+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:22 smithi179 bash[23186]: audit 2024-09-20T22:57:21.247714+0000 mgr.a (mgr.14388) 1848 : audit [DBG] from='client.52194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:22 smithi179 bash[23186]: audit 2024-09-20T22:57:21.333883+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:22 smithi179 bash[23186]: audit 2024-09-20T22:57:21.340125+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:22 smithi179 bash[23186]: audit 2024-09-20T22:57:21.347435+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:22 smithi049 bash[23528]: audit 2024-09-20T22:57:21.247714+0000 mgr.a (mgr.14388) 1848 : audit [DBG] from='client.52194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:22 smithi049 bash[23528]: audit 2024-09-20T22:57:21.333883+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:22 smithi049 bash[23528]: audit 2024-09-20T22:57:21.340125+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:22 smithi049 bash[23528]: audit 2024-09-20T22:57:21.347435+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:23 smithi044 bash[22676]: cluster 2024-09-20T22:57:22.137869+0000 mgr.a (mgr.14388) 1849 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:57:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:23 smithi044 bash[22676]: audit 2024-09-20T22:57:23.016650+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:23 smithi044 bash[22676]: audit 2024-09-20T22:57:23.022741+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:23 smithi044 bash[22676]: audit 2024-09-20T22:57:23.029555+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:23 smithi179 bash[23186]: cluster 2024-09-20T22:57:22.137869+0000 mgr.a (mgr.14388) 1849 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:57:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:23 smithi179 bash[23186]: audit 2024-09-20T22:57:23.016650+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:23 smithi179 bash[23186]: audit 2024-09-20T22:57:23.022741+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:23 smithi179 bash[23186]: audit 2024-09-20T22:57:23.029555+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:23 smithi049 bash[23528]: cluster 2024-09-20T22:57:22.137869+0000 mgr.a (mgr.14388) 1849 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:57:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:23 smithi049 bash[23528]: audit 2024-09-20T22:57:23.016650+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:23 smithi049 bash[23528]: audit 2024-09-20T22:57:23.022741+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:23 smithi049 bash[23528]: audit 2024-09-20T22:57:23.029555+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:25 smithi044 bash[22676]: cluster 2024-09-20T22:57:24.138664+0000 mgr.a (mgr.14388) 1850 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:57:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:25 smithi179 bash[23186]: cluster 2024-09-20T22:57:24.138664+0000 mgr.a (mgr.14388) 1850 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:57:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:25 smithi049 bash[23528]: cluster 2024-09-20T22:57:24.138664+0000 mgr.a (mgr.14388) 1850 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:57:26.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:26.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:26.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:26 smithi044 bash[22676]: cluster 2024-09-20T22:57:26.140848+0000 mgr.a (mgr.14388) 1851 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:57:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:26 smithi179 bash[23186]: cluster 2024-09-20T22:57:26.140848+0000 mgr.a (mgr.14388) 1851 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:57:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:26 smithi049 bash[23528]: cluster 2024-09-20T22:57:26.140848+0000 mgr.a (mgr.14388) 1851 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T22:57:27.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:27 smithi044 bash[22676]: audit 2024-09-20T22:57:27.041217+0000 mgr.a (mgr.14388) 1852 : audit [DBG] from='client.52272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:27 smithi179 bash[23186]: audit 2024-09-20T22:57:27.041217+0000 mgr.a (mgr.14388) 1852 : audit [DBG] from='client.52272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:28.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:27 smithi049 bash[23528]: audit 2024-09-20T22:57:27.041217+0000 mgr.a (mgr.14388) 1852 : audit [DBG] from='client.52272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:28 smithi044 bash[22676]: cluster 2024-09-20T22:57:28.141780+0000 mgr.a (mgr.14388) 1853 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:28 smithi179 bash[23186]: cluster 2024-09-20T22:57:28.141780+0000 mgr.a (mgr.14388) 1853 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:28 smithi049 bash[23528]: cluster 2024-09-20T22:57:28.141780+0000 mgr.a (mgr.14388) 1853 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:31 smithi044 bash[22676]: cluster 2024-09-20T22:57:30.144058+0000 mgr.a (mgr.14388) 1854 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:31 smithi179 bash[23186]: cluster 2024-09-20T22:57:30.144058+0000 mgr.a (mgr.14388) 1854 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:31 smithi049 bash[23528]: cluster 2024-09-20T22:57:30.144058+0000 mgr.a (mgr.14388) 1854 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:32.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:32.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:32.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:33.219 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:33.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:33.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:33.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:33.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:33 smithi044 bash[22676]: cluster 2024-09-20T22:57:32.144862+0000 mgr.a (mgr.14388) 1855 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:33 smithi179 bash[23186]: cluster 2024-09-20T22:57:32.144862+0000 mgr.a (mgr.14388) 1855 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:33 smithi049 bash[23528]: cluster 2024-09-20T22:57:32.144862+0000 mgr.a (mgr.14388) 1855 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:34 smithi044 bash[22676]: audit 2024-09-20T22:57:32.807465+0000 mgr.a (mgr.14388) 1856 : audit [DBG] from='client.52350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:34 smithi179 bash[23186]: audit 2024-09-20T22:57:32.807465+0000 mgr.a (mgr.14388) 1856 : audit [DBG] from='client.52350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:34 smithi049 bash[23528]: audit 2024-09-20T22:57:32.807465+0000 mgr.a (mgr.14388) 1856 : audit [DBG] from='client.52350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22676]: cluster 2024-09-20T22:57:34.145785+0000 mgr.a (mgr.14388) 1857 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22676]: audit 2024-09-20T22:57:34.970191+0000 mon.a (mon.0) 2218 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:57:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22676]: audit 2024-09-20T22:57:34.976584+0000 mon.a (mon.0) 2219 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:57:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22676]: audit 2024-09-20T22:57:34.978415+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:57:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22676]: audit 2024-09-20T22:57:34.989608+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22676]: audit 2024-09-20T22:57:34.996051+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:57:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:35 smithi179 bash[23186]: cluster 2024-09-20T22:57:34.145785+0000 mgr.a (mgr.14388) 1857 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:35 smithi179 bash[23186]: audit 2024-09-20T22:57:34.970191+0000 mon.a (mon.0) 2218 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:57:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:35 smithi179 bash[23186]: audit 2024-09-20T22:57:34.976584+0000 mon.a (mon.0) 2219 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:57:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:35 smithi179 bash[23186]: audit 2024-09-20T22:57:34.978415+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:57:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:35 smithi179 bash[23186]: audit 2024-09-20T22:57:34.989608+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:35 smithi179 bash[23186]: audit 2024-09-20T22:57:34.996051+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:57:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:35 smithi049 bash[23528]: cluster 2024-09-20T22:57:34.145785+0000 mgr.a (mgr.14388) 1857 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:35 smithi049 bash[23528]: audit 2024-09-20T22:57:34.970191+0000 mon.a (mon.0) 2218 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:57:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:35 smithi049 bash[23528]: audit 2024-09-20T22:57:34.976584+0000 mon.a (mon.0) 2219 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:57:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:35 smithi049 bash[23528]: audit 2024-09-20T22:57:34.978415+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:57:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:35 smithi049 bash[23528]: audit 2024-09-20T22:57:34.989608+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:35 smithi049 bash[23528]: audit 2024-09-20T22:57:34.996051+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:57:36.225 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22930]: debug 2024-09-20T22:57:35.748+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:57:36.225 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:57:35 smithi044 bash[22930]: debug 2024-09-20T22:57:35.748+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:57:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:36 smithi044 bash[22676]: audit 2024-09-20T22:57:34.998538+0000 mgr.a (mgr.14388) 1858 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:57:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:36 smithi179 bash[23186]: audit 2024-09-20T22:57:34.998538+0000 mgr.a (mgr.14388) 1858 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:57:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:36 smithi049 bash[23528]: audit 2024-09-20T22:57:34.998538+0000 mgr.a (mgr.14388) 1858 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:57:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:37 smithi044 bash[22676]: audit 2024-09-20T22:57:35.749896+0000 mgr.a (mgr.14388) 1859 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:57:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:37 smithi044 bash[22676]: cephadm 2024-09-20T22:57:35.751459+0000 mgr.a (mgr.14388) 1860 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:57:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:37 smithi044 bash[22676]: cluster 2024-09-20T22:57:36.148511+0000 mgr.a (mgr.14388) 1861 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:37 smithi179 bash[23186]: audit 2024-09-20T22:57:35.749896+0000 mgr.a (mgr.14388) 1859 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:57:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:37 smithi179 bash[23186]: cephadm 2024-09-20T22:57:35.751459+0000 mgr.a (mgr.14388) 1860 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:57:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:37 smithi179 bash[23186]: cluster 2024-09-20T22:57:36.148511+0000 mgr.a (mgr.14388) 1861 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:37 smithi049 bash[23528]: audit 2024-09-20T22:57:35.749896+0000 mgr.a (mgr.14388) 1859 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:57:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:37 smithi049 bash[23528]: cephadm 2024-09-20T22:57:35.751459+0000 mgr.a (mgr.14388) 1860 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:57:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:37 smithi049 bash[23528]: cluster 2024-09-20T22:57:36.148511+0000 mgr.a (mgr.14388) 1861 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:57:38.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:38.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:38.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:39.007 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:39 smithi044 bash[22676]: cluster 2024-09-20T22:57:38.149321+0000 mgr.a (mgr.14388) 1862 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:39 smithi179 bash[23186]: cluster 2024-09-20T22:57:38.149321+0000 mgr.a (mgr.14388) 1862 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:39 smithi049 bash[23528]: cluster 2024-09-20T22:57:38.149321+0000 mgr.a (mgr.14388) 1862 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:40 smithi179 bash[23186]: audit 2024-09-20T22:57:38.558876+0000 mgr.a (mgr.14388) 1863 : audit [DBG] from='client.52533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:40 smithi049 bash[23528]: audit 2024-09-20T22:57:38.558876+0000 mgr.a (mgr.14388) 1863 : audit [DBG] from='client.52533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:40 smithi044 bash[22676]: audit 2024-09-20T22:57:38.558876+0000 mgr.a (mgr.14388) 1863 : audit [DBG] from='client.52533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:41 smithi179 bash[23186]: cluster 2024-09-20T22:57:40.151486+0000 mgr.a (mgr.14388) 1864 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:41 smithi179 bash[23186]: audit 2024-09-20T22:57:41.120505+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:41 smithi179 bash[23186]: audit 2024-09-20T22:57:41.128833+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:41 smithi179 bash[23186]: audit 2024-09-20T22:57:41.139236+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.512 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:41 smithi049 bash[23528]: cluster 2024-09-20T22:57:40.151486+0000 mgr.a (mgr.14388) 1864 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:41.513 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:41 smithi049 bash[23528]: audit 2024-09-20T22:57:41.120505+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.513 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:41 smithi049 bash[23528]: audit 2024-09-20T22:57:41.128833+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.513 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:41 smithi049 bash[23528]: audit 2024-09-20T22:57:41.139236+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:41 smithi044 bash[22676]: cluster 2024-09-20T22:57:40.151486+0000 mgr.a (mgr.14388) 1864 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:41 smithi044 bash[22676]: audit 2024-09-20T22:57:41.120505+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:41 smithi044 bash[22676]: audit 2024-09-20T22:57:41.128833+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:41 smithi044 bash[22676]: audit 2024-09-20T22:57:41.139236+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:42 smithi179 bash[23186]: audit 2024-09-20T22:57:41.492568+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:42 smithi179 bash[23186]: audit 2024-09-20T22:57:41.501166+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:42 smithi179 bash[23186]: audit 2024-09-20T22:57:41.510858+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:42 smithi179 bash[23186]: cluster 2024-09-20T22:57:42.152269+0000 mgr.a (mgr.14388) 1865 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:42 smithi049 bash[23528]: audit 2024-09-20T22:57:41.492568+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:42 smithi049 bash[23528]: audit 2024-09-20T22:57:41.501166+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:42 smithi049 bash[23528]: audit 2024-09-20T22:57:41.510858+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:42 smithi049 bash[23528]: cluster 2024-09-20T22:57:42.152269+0000 mgr.a (mgr.14388) 1865 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:42 smithi044 bash[22676]: audit 2024-09-20T22:57:41.492568+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:42 smithi044 bash[22676]: audit 2024-09-20T22:57:41.501166+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:42 smithi044 bash[22676]: audit 2024-09-20T22:57:41.510858+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:42 smithi044 bash[22676]: cluster 2024-09-20T22:57:42.152269+0000 mgr.a (mgr.14388) 1865 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:44.009 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:44.009 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:44 smithi044 bash[22676]: audit 2024-09-20T22:57:43.234190+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:44 smithi044 bash[22676]: audit 2024-09-20T22:57:43.239741+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:44 smithi044 bash[22676]: audit 2024-09-20T22:57:43.247150+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:44 smithi179 bash[23186]: audit 2024-09-20T22:57:43.234190+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:44 smithi179 bash[23186]: audit 2024-09-20T22:57:43.239741+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:44 smithi179 bash[23186]: audit 2024-09-20T22:57:43.247150+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:44 smithi049 bash[23528]: audit 2024-09-20T22:57:43.234190+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:44 smithi049 bash[23528]: audit 2024-09-20T22:57:43.239741+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:44 smithi049 bash[23528]: audit 2024-09-20T22:57:43.247150+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:57:44.745 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:44.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:44.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:44.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:44.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:45 smithi179 bash[23186]: cluster 2024-09-20T22:57:44.152824+0000 mgr.a (mgr.14388) 1866 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:45 smithi179 bash[23186]: audit 2024-09-20T22:57:44.335833+0000 mgr.a (mgr.14388) 1867 : audit [DBG] from='client.52611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:45 smithi049 bash[23528]: cluster 2024-09-20T22:57:44.152824+0000 mgr.a (mgr.14388) 1866 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:45 smithi049 bash[23528]: audit 2024-09-20T22:57:44.335833+0000 mgr.a (mgr.14388) 1867 : audit [DBG] from='client.52611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:45 smithi044 bash[22676]: cluster 2024-09-20T22:57:44.152824+0000 mgr.a (mgr.14388) 1866 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:45 smithi044 bash[22676]: audit 2024-09-20T22:57:44.335833+0000 mgr.a (mgr.14388) 1867 : audit [DBG] from='client.52611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:47.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:47 smithi044 bash[22676]: cluster 2024-09-20T22:57:46.155214+0000 mgr.a (mgr.14388) 1868 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:47 smithi049 bash[23528]: cluster 2024-09-20T22:57:46.155214+0000 mgr.a (mgr.14388) 1868 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:47 smithi179 bash[23186]: cluster 2024-09-20T22:57:46.155214+0000 mgr.a (mgr.14388) 1868 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:49 smithi049 bash[23528]: cluster 2024-09-20T22:57:48.156152+0000 mgr.a (mgr.14388) 1869 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:49 smithi044 bash[22676]: cluster 2024-09-20T22:57:48.156152+0000 mgr.a (mgr.14388) 1869 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:49.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:49.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:49 smithi179 bash[23186]: cluster 2024-09-20T22:57:48.156152+0000 mgr.a (mgr.14388) 1869 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:50.509 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:50.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:50.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:50.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:50.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:51 smithi049 bash[23528]: audit 2024-09-20T22:57:50.086228+0000 mgr.a (mgr.14388) 1870 : audit [DBG] from='client.52689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:51 smithi049 bash[23528]: cluster 2024-09-20T22:57:50.157550+0000 mgr.a (mgr.14388) 1871 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:51 smithi044 bash[22676]: audit 2024-09-20T22:57:50.086228+0000 mgr.a (mgr.14388) 1870 : audit [DBG] from='client.52689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:51 smithi044 bash[22676]: cluster 2024-09-20T22:57:50.157550+0000 mgr.a (mgr.14388) 1871 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:51 smithi179 bash[23186]: audit 2024-09-20T22:57:50.086228+0000 mgr.a (mgr.14388) 1870 : audit [DBG] from='client.52689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:51 smithi179 bash[23186]: cluster 2024-09-20T22:57:50.157550+0000 mgr.a (mgr.14388) 1871 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:57:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:53 smithi049 bash[23528]: cluster 2024-09-20T22:57:52.158421+0000 mgr.a (mgr.14388) 1872 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:53 smithi044 bash[22676]: cluster 2024-09-20T22:57:52.158421+0000 mgr.a (mgr.14388) 1872 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:53 smithi179 bash[23186]: cluster 2024-09-20T22:57:52.158421+0000 mgr.a (mgr.14388) 1872 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:57:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:57:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:57:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:55 smithi049 bash[23528]: cluster 2024-09-20T22:57:54.159246+0000 mgr.a (mgr.14388) 1873 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:55 smithi044 bash[22676]: cluster 2024-09-20T22:57:54.159246+0000 mgr.a (mgr.14388) 1873 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:55 smithi179 bash[23186]: cluster 2024-09-20T22:57:54.159246+0000 mgr.a (mgr.14388) 1873 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:56.278 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:57:56.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:57:56.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:57:56.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:57:56.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:57:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:57 smithi049 bash[23528]: audit 2024-09-20T22:57:55.848206+0000 mgr.a (mgr.14388) 1874 : audit [DBG] from='client.52767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:57 smithi049 bash[23528]: cluster 2024-09-20T22:57:56.160586+0000 mgr.a (mgr.14388) 1875 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:57 smithi044 bash[22676]: audit 2024-09-20T22:57:55.848206+0000 mgr.a (mgr.14388) 1874 : audit [DBG] from='client.52767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:57 smithi044 bash[22676]: cluster 2024-09-20T22:57:56.160586+0000 mgr.a (mgr.14388) 1875 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:57 smithi179 bash[23186]: audit 2024-09-20T22:57:55.848206+0000 mgr.a (mgr.14388) 1874 : audit [DBG] from='client.52767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:57:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:57 smithi179 bash[23186]: cluster 2024-09-20T22:57:56.160586+0000 mgr.a (mgr.14388) 1875 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:57:59.472 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:57:59 smithi049 bash[23528]: cluster 2024-09-20T22:57:58.161492+0000 mgr.a (mgr.14388) 1876 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:57:59 smithi044 bash[22676]: cluster 2024-09-20T22:57:58.161492+0000 mgr.a (mgr.14388) 1876 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:57:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:57:59 smithi179 bash[23186]: cluster 2024-09-20T22:57:58.161492+0000 mgr.a (mgr.14388) 1876 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:58:01.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:01.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:01.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:01 smithi049 bash[23528]: cluster 2024-09-20T22:58:00.163618+0000 mgr.a (mgr.14388) 1877 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:01 smithi044 bash[22676]: cluster 2024-09-20T22:58:00.163618+0000 mgr.a (mgr.14388) 1877 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:01 smithi179 bash[23186]: cluster 2024-09-20T22:58:00.163618+0000 mgr.a (mgr.14388) 1877 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:02.028 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:02.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:02.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:02.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:02 smithi044 bash[22676]: audit 2024-09-20T22:58:01.347313+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:02 smithi044 bash[22676]: audit 2024-09-20T22:58:01.355754+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:02 smithi044 bash[22676]: audit 2024-09-20T22:58:01.366573+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:02 smithi044 bash[22676]: audit 2024-09-20T22:58:01.672811+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:02 smithi044 bash[22676]: audit 2024-09-20T22:58:01.680554+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:02 smithi044 bash[22676]: audit 2024-09-20T22:58:01.687374+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:02 smithi179 bash[23186]: audit 2024-09-20T22:58:01.347313+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:02 smithi179 bash[23186]: audit 2024-09-20T22:58:01.355754+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:02 smithi179 bash[23186]: audit 2024-09-20T22:58:01.366573+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:02 smithi179 bash[23186]: audit 2024-09-20T22:58:01.672811+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:02 smithi179 bash[23186]: audit 2024-09-20T22:58:01.680554+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:02 smithi179 bash[23186]: audit 2024-09-20T22:58:01.687374+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:02 smithi049 bash[23528]: audit 2024-09-20T22:58:01.347313+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:02 smithi049 bash[23528]: audit 2024-09-20T22:58:01.355754+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:02 smithi049 bash[23528]: audit 2024-09-20T22:58:01.366573+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:02 smithi049 bash[23528]: audit 2024-09-20T22:58:01.672811+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:02 smithi049 bash[23528]: audit 2024-09-20T22:58:01.680554+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:02 smithi049 bash[23528]: audit 2024-09-20T22:58:01.687374+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:03 smithi044 bash[22676]: audit 2024-09-20T22:58:01.614636+0000 mgr.a (mgr.14388) 1878 : audit [DBG] from='client.52845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:03 smithi044 bash[22676]: cluster 2024-09-20T22:58:02.164512+0000 mgr.a (mgr.14388) 1879 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:03 smithi179 bash[23186]: audit 2024-09-20T22:58:01.614636+0000 mgr.a (mgr.14388) 1878 : audit [DBG] from='client.52845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:03 smithi179 bash[23186]: cluster 2024-09-20T22:58:02.164512+0000 mgr.a (mgr.14388) 1879 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:03 smithi049 bash[23528]: audit 2024-09-20T22:58:01.614636+0000 mgr.a (mgr.14388) 1878 : audit [DBG] from='client.52845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:03 smithi049 bash[23528]: cluster 2024-09-20T22:58:02.164512+0000 mgr.a (mgr.14388) 1879 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:04 smithi044 bash[22676]: audit 2024-09-20T22:58:03.446388+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:04 smithi044 bash[22676]: audit 2024-09-20T22:58:03.454169+0000 mon.a (mon.0) 2239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:04 smithi044 bash[22676]: audit 2024-09-20T22:58:03.465599+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:04 smithi044 bash[22676]: cluster 2024-09-20T22:58:04.165331+0000 mgr.a (mgr.14388) 1880 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:04 smithi179 bash[23186]: audit 2024-09-20T22:58:03.446388+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:04 smithi179 bash[23186]: audit 2024-09-20T22:58:03.454169+0000 mon.a (mon.0) 2239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:04 smithi179 bash[23186]: audit 2024-09-20T22:58:03.465599+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:04 smithi179 bash[23186]: cluster 2024-09-20T22:58:04.165331+0000 mgr.a (mgr.14388) 1880 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:04 smithi049 bash[23528]: audit 2024-09-20T22:58:03.446388+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:04 smithi049 bash[23528]: audit 2024-09-20T22:58:03.454169+0000 mon.a (mon.0) 2239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:04 smithi049 bash[23528]: audit 2024-09-20T22:58:03.465599+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:04 smithi049 bash[23528]: cluster 2024-09-20T22:58:04.165331+0000 mgr.a (mgr.14388) 1880 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:07 smithi044 bash[22676]: cluster 2024-09-20T22:58:06.166470+0000 mgr.a (mgr.14388) 1881 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:07 smithi179 bash[23186]: cluster 2024-09-20T22:58:06.166470+0000 mgr.a (mgr.14388) 1881 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:07 smithi049 bash[23528]: cluster 2024-09-20T22:58:06.166470+0000 mgr.a (mgr.14388) 1881 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:07.817 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:07.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:08 smithi044 bash[22676]: audit 2024-09-20T22:58:07.374168+0000 mgr.a (mgr.14388) 1882 : audit [DBG] from='client.52923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:08 smithi179 bash[23186]: audit 2024-09-20T22:58:07.374168+0000 mgr.a (mgr.14388) 1882 : audit [DBG] from='client.52923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:08 smithi049 bash[23528]: audit 2024-09-20T22:58:07.374168+0000 mgr.a (mgr.14388) 1882 : audit [DBG] from='client.52923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:09 smithi044 bash[22676]: cluster 2024-09-20T22:58:08.166949+0000 mgr.a (mgr.14388) 1883 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:09 smithi179 bash[23186]: cluster 2024-09-20T22:58:08.166949+0000 mgr.a (mgr.14388) 1883 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:09 smithi049 bash[23528]: cluster 2024-09-20T22:58:08.166949+0000 mgr.a (mgr.14388) 1883 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:11 smithi044 bash[22676]: cluster 2024-09-20T22:58:10.169147+0000 mgr.a (mgr.14388) 1884 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:11 smithi179 bash[23186]: cluster 2024-09-20T22:58:10.169147+0000 mgr.a (mgr.14388) 1884 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:11 smithi049 bash[23528]: cluster 2024-09-20T22:58:10.169147+0000 mgr.a (mgr.14388) 1884 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:12.819 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:12.819 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:13 smithi179 bash[23186]: cluster 2024-09-20T22:58:12.170099+0000 mgr.a (mgr.14388) 1885 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:13 smithi049 bash[23528]: cluster 2024-09-20T22:58:12.170099+0000 mgr.a (mgr.14388) 1885 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:13.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:13.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:13.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:13.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:13.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:13 smithi044 bash[22676]: cluster 2024-09-20T22:58:12.170099+0000 mgr.a (mgr.14388) 1885 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:14 smithi179 bash[23186]: audit 2024-09-20T22:58:13.157210+0000 mgr.a (mgr.14388) 1886 : audit [DBG] from='client.52998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:14 smithi049 bash[23528]: audit 2024-09-20T22:58:13.157210+0000 mgr.a (mgr.14388) 1886 : audit [DBG] from='client.52998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:14 smithi044 bash[22676]: audit 2024-09-20T22:58:13.157210+0000 mgr.a (mgr.14388) 1886 : audit [DBG] from='client.52998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:15 smithi049 bash[23528]: cluster 2024-09-20T22:58:14.171062+0000 mgr.a (mgr.14388) 1887 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:15 smithi044 bash[22676]: cluster 2024-09-20T22:58:14.171062+0000 mgr.a (mgr.14388) 1887 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:15 smithi179 bash[23186]: cluster 2024-09-20T22:58:14.171062+0000 mgr.a (mgr.14388) 1887 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:17 smithi049 bash[23528]: cluster 2024-09-20T22:58:16.173309+0000 mgr.a (mgr.14388) 1888 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:17 smithi044 bash[22676]: cluster 2024-09-20T22:58:16.173309+0000 mgr.a (mgr.14388) 1888 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:17 smithi179 bash[23186]: cluster 2024-09-20T22:58:16.173309+0000 mgr.a (mgr.14388) 1888 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:18.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:18.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:18.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:19.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:19.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:19.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:19.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:19 smithi049 bash[23528]: cluster 2024-09-20T22:58:18.174062+0000 mgr.a (mgr.14388) 1889 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:19 smithi044 bash[22676]: cluster 2024-09-20T22:58:18.174062+0000 mgr.a (mgr.14388) 1889 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:19 smithi179 bash[23186]: cluster 2024-09-20T22:58:18.174062+0000 mgr.a (mgr.14388) 1889 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:20 smithi049 bash[23528]: audit 2024-09-20T22:58:18.937090+0000 mgr.a (mgr.14388) 1890 : audit [DBG] from='client.53076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:20 smithi044 bash[22676]: audit 2024-09-20T22:58:18.937090+0000 mgr.a (mgr.14388) 1890 : audit [DBG] from='client.53076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:20 smithi179 bash[23186]: audit 2024-09-20T22:58:18.937090+0000 mgr.a (mgr.14388) 1890 : audit [DBG] from='client.53076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:21 smithi049 bash[23528]: cluster 2024-09-20T22:58:20.176391+0000 mgr.a (mgr.14388) 1891 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:21.597 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:21 smithi179 bash[23186]: cluster 2024-09-20T22:58:20.176391+0000 mgr.a (mgr.14388) 1891 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:21 smithi044 bash[22676]: cluster 2024-09-20T22:58:20.176391+0000 mgr.a (mgr.14388) 1891 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:22 smithi044 bash[22676]: audit 2024-09-20T22:58:21.575444+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:22 smithi044 bash[22676]: audit 2024-09-20T22:58:21.584079+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:22 smithi044 bash[22676]: audit 2024-09-20T22:58:21.594846+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:22 smithi044 bash[22676]: audit 2024-09-20T22:58:21.846597+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:22 smithi044 bash[22676]: audit 2024-09-20T22:58:21.855300+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:22 smithi044 bash[22676]: audit 2024-09-20T22:58:21.865429+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:22 smithi044 bash[22676]: cluster 2024-09-20T22:58:22.177164+0000 mgr.a (mgr.14388) 1892 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:22 smithi179 bash[23186]: audit 2024-09-20T22:58:21.575444+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:22 smithi179 bash[23186]: audit 2024-09-20T22:58:21.584079+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:22 smithi179 bash[23186]: audit 2024-09-20T22:58:21.594846+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:22 smithi179 bash[23186]: audit 2024-09-20T22:58:21.846597+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:22 smithi179 bash[23186]: audit 2024-09-20T22:58:21.855300+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:22 smithi179 bash[23186]: audit 2024-09-20T22:58:21.865429+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:22 smithi179 bash[23186]: cluster 2024-09-20T22:58:22.177164+0000 mgr.a (mgr.14388) 1892 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:22 smithi049 bash[23528]: audit 2024-09-20T22:58:21.575444+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:22 smithi049 bash[23528]: audit 2024-09-20T22:58:21.584079+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:22 smithi049 bash[23528]: audit 2024-09-20T22:58:21.594846+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:22 smithi049 bash[23528]: audit 2024-09-20T22:58:21.846597+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:22 smithi049 bash[23528]: audit 2024-09-20T22:58:21.855300+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:22 smithi049 bash[23528]: audit 2024-09-20T22:58:21.865429+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:22 smithi049 bash[23528]: cluster 2024-09-20T22:58:22.177164+0000 mgr.a (mgr.14388) 1892 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:24.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:24.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:24.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:24 smithi044 bash[22676]: audit 2024-09-20T22:58:23.675223+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:24 smithi044 bash[22676]: audit 2024-09-20T22:58:23.683200+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:24 smithi044 bash[22676]: audit 2024-09-20T22:58:23.694945+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:24 smithi044 bash[22676]: cluster 2024-09-20T22:58:24.177925+0000 mgr.a (mgr.14388) 1893 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:24 smithi179 bash[23186]: audit 2024-09-20T22:58:23.675223+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:24 smithi179 bash[23186]: audit 2024-09-20T22:58:23.683200+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:24 smithi179 bash[23186]: audit 2024-09-20T22:58:23.694945+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:24 smithi179 bash[23186]: cluster 2024-09-20T22:58:24.177925+0000 mgr.a (mgr.14388) 1893 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:24 smithi049 bash[23528]: audit 2024-09-20T22:58:23.675223+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:24 smithi049 bash[23528]: audit 2024-09-20T22:58:23.683200+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:24 smithi049 bash[23528]: audit 2024-09-20T22:58:23.694945+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:24 smithi049 bash[23528]: cluster 2024-09-20T22:58:24.177925+0000 mgr.a (mgr.14388) 1893 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:25.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:25.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:25.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:25.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:25.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:25 smithi044 bash[22676]: audit 2024-09-20T22:58:24.723650+0000 mgr.a (mgr.14388) 1894 : audit [DBG] from='client.53154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:25 smithi179 bash[23186]: audit 2024-09-20T22:58:24.723650+0000 mgr.a (mgr.14388) 1894 : audit [DBG] from='client.53154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:25 smithi049 bash[23528]: audit 2024-09-20T22:58:24.723650+0000 mgr.a (mgr.14388) 1894 : audit [DBG] from='client.53154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:26 smithi044 bash[22676]: cluster 2024-09-20T22:58:26.180676+0000 mgr.a (mgr.14388) 1895 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:58:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:26 smithi179 bash[23186]: cluster 2024-09-20T22:58:26.180676+0000 mgr.a (mgr.14388) 1895 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:58:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:26 smithi049 bash[23528]: cluster 2024-09-20T22:58:26.180676+0000 mgr.a (mgr.14388) 1895 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T22:58:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:29 smithi044 bash[22676]: cluster 2024-09-20T22:58:28.181353+0000 mgr.a (mgr.14388) 1896 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:58:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:29 smithi179 bash[23186]: cluster 2024-09-20T22:58:28.181353+0000 mgr.a (mgr.14388) 1896 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:58:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:29 smithi049 bash[23528]: cluster 2024-09-20T22:58:28.181353+0000 mgr.a (mgr.14388) 1896 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T22:58:30.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:30.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:30.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:31 smithi179 bash[23186]: cluster 2024-09-20T22:58:30.183032+0000 mgr.a (mgr.14388) 1897 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:31 smithi049 bash[23528]: cluster 2024-09-20T22:58:30.183032+0000 mgr.a (mgr.14388) 1897 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:31 smithi044 bash[22676]: cluster 2024-09-20T22:58:30.183032+0000 mgr.a (mgr.14388) 1897 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:32 smithi179 bash[23186]: audit 2024-09-20T22:58:30.513032+0000 mgr.a (mgr.14388) 1898 : audit [DBG] from='client.53226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:32 smithi049 bash[23528]: audit 2024-09-20T22:58:30.513032+0000 mgr.a (mgr.14388) 1898 : audit [DBG] from='client.53226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:32 smithi044 bash[22676]: audit 2024-09-20T22:58:30.513032+0000 mgr.a (mgr.14388) 1898 : audit [DBG] from='client.53226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:33 smithi179 bash[23186]: cluster 2024-09-20T22:58:32.184027+0000 mgr.a (mgr.14388) 1899 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:58:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:33 smithi049 bash[23528]: cluster 2024-09-20T22:58:32.184027+0000 mgr.a (mgr.14388) 1899 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:58:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:33 smithi044 bash[22676]: cluster 2024-09-20T22:58:32.184027+0000 mgr.a (mgr.14388) 1899 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:58:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:35 smithi179 bash[23186]: cluster 2024-09-20T22:58:34.184834+0000 mgr.a (mgr.14388) 1900 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:58:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:35 smithi049 bash[23528]: cluster 2024-09-20T22:58:34.184834+0000 mgr.a (mgr.14388) 1900 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:58:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:35 smithi044 bash[22676]: cluster 2024-09-20T22:58:34.184834+0000 mgr.a (mgr.14388) 1900 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T22:58:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:36 smithi049 bash[23528]: audit 2024-09-20T22:58:35.819102+0000 mon.a (mon.0) 2250 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:58:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:36 smithi049 bash[23528]: audit 2024-09-20T22:58:35.826300+0000 mon.a (mon.0) 2251 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:58:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:36 smithi049 bash[23528]: audit 2024-09-20T22:58:35.828263+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:58:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:36 smithi049 bash[23528]: audit 2024-09-20T22:58:35.839725+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:36 smithi049 bash[23528]: audit 2024-09-20T22:58:35.853979+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:58:36.626 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:36 smithi044 bash[22676]: audit 2024-09-20T22:58:35.819102+0000 mon.a (mon.0) 2250 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:58:36.627 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:36 smithi044 bash[22676]: audit 2024-09-20T22:58:35.826300+0000 mon.a (mon.0) 2251 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:58:36.627 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:36 smithi044 bash[22676]: audit 2024-09-20T22:58:35.828263+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:58:36.627 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:36 smithi044 bash[22676]: audit 2024-09-20T22:58:35.839725+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:36.627 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:36 smithi044 bash[22676]: audit 2024-09-20T22:58:35.853979+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:58:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:36 smithi179 bash[23186]: audit 2024-09-20T22:58:35.819102+0000 mon.a (mon.0) 2250 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:58:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:36 smithi179 bash[23186]: audit 2024-09-20T22:58:35.826300+0000 mon.a (mon.0) 2251 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:58:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:36 smithi179 bash[23186]: audit 2024-09-20T22:58:35.828263+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:58:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:36 smithi179 bash[23186]: audit 2024-09-20T22:58:35.839725+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:36 smithi179 bash[23186]: audit 2024-09-20T22:58:35.853979+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:58:36.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:58:36 smithi044 bash[22930]: debug 2024-09-20T22:58:36.623+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:58:36.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:58:36 smithi044 bash[22930]: debug 2024-09-20T22:58:36.635+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:58:37.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:37.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:37 smithi049 bash[23528]: audit 2024-09-20T22:58:35.856501+0000 mgr.a (mgr.14388) 1901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:58:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:37 smithi049 bash[23528]: cluster 2024-09-20T22:58:36.186482+0000 mgr.a (mgr.14388) 1902 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:37 smithi049 bash[23528]: audit 2024-09-20T22:58:36.283632+0000 mgr.a (mgr.14388) 1903 : audit [DBG] from='client.53319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:37 smithi044 bash[22676]: audit 2024-09-20T22:58:35.856501+0000 mgr.a (mgr.14388) 1901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:58:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:37 smithi044 bash[22676]: cluster 2024-09-20T22:58:36.186482+0000 mgr.a (mgr.14388) 1902 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:37 smithi044 bash[22676]: audit 2024-09-20T22:58:36.283632+0000 mgr.a (mgr.14388) 1903 : audit [DBG] from='client.53319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:37 smithi179 bash[23186]: audit 2024-09-20T22:58:35.856501+0000 mgr.a (mgr.14388) 1901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:58:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:37 smithi179 bash[23186]: cluster 2024-09-20T22:58:36.186482+0000 mgr.a (mgr.14388) 1902 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:37 smithi179 bash[23186]: audit 2024-09-20T22:58:36.283632+0000 mgr.a (mgr.14388) 1903 : audit [DBG] from='client.53319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:38 smithi049 bash[23528]: audit 2024-09-20T22:58:36.626852+0000 mgr.a (mgr.14388) 1904 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:58:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:38 smithi049 bash[23528]: cephadm 2024-09-20T22:58:36.638210+0000 mgr.a (mgr.14388) 1905 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:58:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:38 smithi044 bash[22676]: audit 2024-09-20T22:58:36.626852+0000 mgr.a (mgr.14388) 1904 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:58:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:38 smithi044 bash[22676]: cephadm 2024-09-20T22:58:36.638210+0000 mgr.a (mgr.14388) 1905 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:58:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:38 smithi179 bash[23186]: audit 2024-09-20T22:58:36.626852+0000 mgr.a (mgr.14388) 1904 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:58:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:38 smithi179 bash[23186]: cephadm 2024-09-20T22:58:36.638210+0000 mgr.a (mgr.14388) 1905 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:58:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:39 smithi049 bash[23528]: cluster 2024-09-20T22:58:38.187433+0000 mgr.a (mgr.14388) 1906 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:58:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:39 smithi044 bash[22676]: cluster 2024-09-20T22:58:38.187433+0000 mgr.a (mgr.14388) 1906 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:58:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:39 smithi179 bash[23186]: cluster 2024-09-20T22:58:38.187433+0000 mgr.a (mgr.14388) 1906 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T22:58:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:41 smithi049 bash[23528]: cluster 2024-09-20T22:58:40.189590+0000 mgr.a (mgr.14388) 1907 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:41 smithi044 bash[22676]: cluster 2024-09-20T22:58:40.189590+0000 mgr.a (mgr.14388) 1907 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:41 smithi179 bash[23186]: cluster 2024-09-20T22:58:40.189590+0000 mgr.a (mgr.14388) 1907 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:42.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:42.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:42.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:42.770 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: audit 2024-09-20T22:58:41.801056+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: audit 2024-09-20T22:58:41.809379+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: audit 2024-09-20T22:58:41.819641+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: audit 2024-09-20T22:58:42.053982+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: audit 2024-09-20T22:58:42.063769+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: audit 2024-09-20T22:58:42.075498+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: cluster 2024-09-20T22:58:42.190037+0000 mgr.a (mgr.14388) 1908 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:42 smithi049 bash[23528]: audit 2024-09-20T22:58:42.361297+0000 mgr.a (mgr.14388) 1909 : audit [DBG] from='client.53481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: audit 2024-09-20T22:58:41.801056+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: audit 2024-09-20T22:58:41.809379+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: audit 2024-09-20T22:58:41.819641+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: audit 2024-09-20T22:58:42.053982+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: audit 2024-09-20T22:58:42.063769+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: audit 2024-09-20T22:58:42.075498+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: cluster 2024-09-20T22:58:42.190037+0000 mgr.a (mgr.14388) 1908 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:42 smithi044 bash[22676]: audit 2024-09-20T22:58:42.361297+0000 mgr.a (mgr.14388) 1909 : audit [DBG] from='client.53481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: audit 2024-09-20T22:58:41.801056+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: audit 2024-09-20T22:58:41.809379+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: audit 2024-09-20T22:58:41.819641+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: audit 2024-09-20T22:58:42.053982+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: audit 2024-09-20T22:58:42.063769+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: audit 2024-09-20T22:58:42.075498+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: cluster 2024-09-20T22:58:42.190037+0000 mgr.a (mgr.14388) 1908 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:42 smithi179 bash[23186]: audit 2024-09-20T22:58:42.361297+0000 mgr.a (mgr.14388) 1909 : audit [DBG] from='client.53481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:44 smithi044 bash[22676]: audit 2024-09-20T22:58:43.892502+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:44 smithi044 bash[22676]: audit 2024-09-20T22:58:43.901367+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:44 smithi044 bash[22676]: audit 2024-09-20T22:58:43.912759+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:44 smithi044 bash[22676]: cluster 2024-09-20T22:58:44.190947+0000 mgr.a (mgr.14388) 1910 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:44 smithi179 bash[23186]: audit 2024-09-20T22:58:43.892502+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:44 smithi179 bash[23186]: audit 2024-09-20T22:58:43.901367+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:44 smithi179 bash[23186]: audit 2024-09-20T22:58:43.912759+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:44 smithi179 bash[23186]: cluster 2024-09-20T22:58:44.190947+0000 mgr.a (mgr.14388) 1910 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:44 smithi049 bash[23528]: audit 2024-09-20T22:58:43.892502+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:44 smithi049 bash[23528]: audit 2024-09-20T22:58:43.901367+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:44 smithi049 bash[23528]: audit 2024-09-20T22:58:43.912759+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:58:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:44 smithi049 bash[23528]: cluster 2024-09-20T22:58:44.190947+0000 mgr.a (mgr.14388) 1910 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:47 smithi179 bash[23186]: cluster 2024-09-20T22:58:46.193117+0000 mgr.a (mgr.14388) 1911 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:47 smithi049 bash[23528]: cluster 2024-09-20T22:58:46.193117+0000 mgr.a (mgr.14388) 1911 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:47 smithi044 bash[22676]: cluster 2024-09-20T22:58:46.193117+0000 mgr.a (mgr.14388) 1911 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:47.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:47.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:47.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:48.538 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:48.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:48.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:48.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:48.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:49.406 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:49 smithi044 bash[22676]: audit 2024-09-20T22:58:48.128454+0000 mgr.a (mgr.14388) 1912 : audit [DBG] from='client.53559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:49.406 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:49 smithi044 bash[22676]: cluster 2024-09-20T22:58:48.193718+0000 mgr.a (mgr.14388) 1913 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:49 smithi049 bash[23528]: audit 2024-09-20T22:58:48.128454+0000 mgr.a (mgr.14388) 1912 : audit [DBG] from='client.53559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:49 smithi049 bash[23528]: cluster 2024-09-20T22:58:48.193718+0000 mgr.a (mgr.14388) 1913 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:49 smithi179 bash[23186]: audit 2024-09-20T22:58:48.128454+0000 mgr.a (mgr.14388) 1912 : audit [DBG] from='client.53559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:49 smithi179 bash[23186]: cluster 2024-09-20T22:58:48.193718+0000 mgr.a (mgr.14388) 1913 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:51 smithi049 bash[23528]: cluster 2024-09-20T22:58:50.194894+0000 mgr.a (mgr.14388) 1914 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:51 smithi044 bash[22676]: cluster 2024-09-20T22:58:50.194894+0000 mgr.a (mgr.14388) 1914 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:51 smithi179 bash[23186]: cluster 2024-09-20T22:58:50.194894+0000 mgr.a (mgr.14388) 1914 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:58:53.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:53.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:53.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:53 smithi049 bash[23528]: cluster 2024-09-20T22:58:52.195651+0000 mgr.a (mgr.14388) 1915 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:53 smithi044 bash[22676]: cluster 2024-09-20T22:58:52.195651+0000 mgr.a (mgr.14388) 1915 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:53 smithi179 bash[23186]: cluster 2024-09-20T22:58:52.195651+0000 mgr.a (mgr.14388) 1915 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:54.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:58:54.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:58:54.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:58:54.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:58:54.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:58:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:55 smithi179 bash[23186]: audit 2024-09-20T22:58:53.879379+0000 mgr.a (mgr.14388) 1916 : audit [DBG] from='client.53637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:55 smithi179 bash[23186]: cluster 2024-09-20T22:58:54.196257+0000 mgr.a (mgr.14388) 1917 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:55 smithi049 bash[23528]: audit 2024-09-20T22:58:53.879379+0000 mgr.a (mgr.14388) 1916 : audit [DBG] from='client.53637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:55 smithi049 bash[23528]: cluster 2024-09-20T22:58:54.196257+0000 mgr.a (mgr.14388) 1917 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:55 smithi044 bash[22676]: audit 2024-09-20T22:58:53.879379+0000 mgr.a (mgr.14388) 1916 : audit [DBG] from='client.53637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:58:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:55 smithi044 bash[22676]: cluster 2024-09-20T22:58:54.196257+0000 mgr.a (mgr.14388) 1917 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:57 smithi049 bash[23528]: cluster 2024-09-20T22:58:56.198605+0000 mgr.a (mgr.14388) 1918 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:57 smithi044 bash[22676]: cluster 2024-09-20T22:58:56.198605+0000 mgr.a (mgr.14388) 1918 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:57 smithi179 bash[23186]: cluster 2024-09-20T22:58:56.198605+0000 mgr.a (mgr.14388) 1918 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:58:59.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:58:59.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:58:59.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:58:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:58:59 smithi049 bash[23528]: cluster 2024-09-20T22:58:58.199365+0000 mgr.a (mgr.14388) 1919 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:58:59 smithi044 bash[22676]: cluster 2024-09-20T22:58:58.199365+0000 mgr.a (mgr.14388) 1919 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:58:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:58:59 smithi179 bash[23186]: cluster 2024-09-20T22:58:58.199365+0000 mgr.a (mgr.14388) 1919 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:00.087 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:01 smithi049 bash[23528]: audit 2024-09-20T22:58:59.647731+0000 mgr.a (mgr.14388) 1920 : audit [DBG] from='client.53715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:01 smithi049 bash[23528]: cluster 2024-09-20T22:59:00.201738+0000 mgr.a (mgr.14388) 1921 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:59:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:01 smithi044 bash[22676]: audit 2024-09-20T22:58:59.647731+0000 mgr.a (mgr.14388) 1920 : audit [DBG] from='client.53715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:01 smithi044 bash[22676]: cluster 2024-09-20T22:59:00.201738+0000 mgr.a (mgr.14388) 1921 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:59:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:01 smithi179 bash[23186]: audit 2024-09-20T22:58:59.647731+0000 mgr.a (mgr.14388) 1920 : audit [DBG] from='client.53715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:01 smithi179 bash[23186]: cluster 2024-09-20T22:59:00.201738+0000 mgr.a (mgr.14388) 1921 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T22:59:03.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:03 smithi049 bash[23528]: audit 2024-09-20T22:59:02.027400+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:03 smithi049 bash[23528]: audit 2024-09-20T22:59:02.039456+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:03 smithi049 bash[23528]: audit 2024-09-20T22:59:02.051092+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:03 smithi049 bash[23528]: cluster 2024-09-20T22:59:02.202529+0000 mgr.a (mgr.14388) 1922 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:59:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:03 smithi049 bash[23528]: audit 2024-09-20T22:59:02.286616+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:03 smithi049 bash[23528]: audit 2024-09-20T22:59:02.295214+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:03 smithi049 bash[23528]: audit 2024-09-20T22:59:02.305096+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:03 smithi044 bash[22676]: audit 2024-09-20T22:59:02.027400+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:03 smithi044 bash[22676]: audit 2024-09-20T22:59:02.039456+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:03 smithi044 bash[22676]: audit 2024-09-20T22:59:02.051092+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:03 smithi044 bash[22676]: cluster 2024-09-20T22:59:02.202529+0000 mgr.a (mgr.14388) 1922 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:59:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:03 smithi044 bash[22676]: audit 2024-09-20T22:59:02.286616+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:03 smithi044 bash[22676]: audit 2024-09-20T22:59:02.295214+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:03 smithi044 bash[22676]: audit 2024-09-20T22:59:02.305096+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:03 smithi179 bash[23186]: audit 2024-09-20T22:59:02.027400+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:03 smithi179 bash[23186]: audit 2024-09-20T22:59:02.039456+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:03 smithi179 bash[23186]: audit 2024-09-20T22:59:02.051092+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:03 smithi179 bash[23186]: cluster 2024-09-20T22:59:02.202529+0000 mgr.a (mgr.14388) 1922 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:59:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:03 smithi179 bash[23186]: audit 2024-09-20T22:59:02.286616+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:03 smithi179 bash[23186]: audit 2024-09-20T22:59:02.295214+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:03 smithi179 bash[23186]: audit 2024-09-20T22:59:02.305096+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:05 smithi044 bash[22676]: audit 2024-09-20T22:59:04.136196+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:05 smithi044 bash[22676]: audit 2024-09-20T22:59:04.145426+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:05 smithi044 bash[22676]: audit 2024-09-20T22:59:04.155208+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:05 smithi044 bash[22676]: cluster 2024-09-20T22:59:04.203294+0000 mgr.a (mgr.14388) 1923 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:59:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:05 smithi179 bash[23186]: audit 2024-09-20T22:59:04.136196+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:05 smithi179 bash[23186]: audit 2024-09-20T22:59:04.145426+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:05 smithi179 bash[23186]: audit 2024-09-20T22:59:04.155208+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:05 smithi179 bash[23186]: cluster 2024-09-20T22:59:04.203294+0000 mgr.a (mgr.14388) 1923 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:59:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:05 smithi049 bash[23528]: audit 2024-09-20T22:59:04.136196+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:05 smithi049 bash[23528]: audit 2024-09-20T22:59:04.145426+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:05 smithi049 bash[23528]: audit 2024-09-20T22:59:04.155208+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:05 smithi049 bash[23528]: cluster 2024-09-20T22:59:04.203294+0000 mgr.a (mgr.14388) 1923 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T22:59:05.872 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:05.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:06 smithi044 bash[22676]: audit 2024-09-20T22:59:05.424598+0000 mgr.a (mgr.14388) 1924 : audit [DBG] from='client.53793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:06 smithi179 bash[23186]: audit 2024-09-20T22:59:05.424598+0000 mgr.a (mgr.14388) 1924 : audit [DBG] from='client.53793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:06 smithi049 bash[23528]: audit 2024-09-20T22:59:05.424598+0000 mgr.a (mgr.14388) 1924 : audit [DBG] from='client.53793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:07 smithi044 bash[22676]: cluster 2024-09-20T22:59:06.206123+0000 mgr.a (mgr.14388) 1925 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:07 smithi179 bash[23186]: cluster 2024-09-20T22:59:06.206123+0000 mgr.a (mgr.14388) 1925 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:07 smithi049 bash[23528]: cluster 2024-09-20T22:59:06.206123+0000 mgr.a (mgr.14388) 1925 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:09 smithi049 bash[23528]: cluster 2024-09-20T22:59:08.206988+0000 mgr.a (mgr.14388) 1926 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:59:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:09 smithi044 bash[22676]: cluster 2024-09-20T22:59:08.206988+0000 mgr.a (mgr.14388) 1926 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:59:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:09 smithi179 bash[23186]: cluster 2024-09-20T22:59:08.206988+0000 mgr.a (mgr.14388) 1926 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T22:59:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:10.875 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:11 smithi049 bash[23528]: cluster 2024-09-20T22:59:10.208535+0000 mgr.a (mgr.14388) 1927 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:11.651 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:11.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:11.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:11.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:11.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:11 smithi044 bash[22676]: cluster 2024-09-20T22:59:10.208535+0000 mgr.a (mgr.14388) 1927 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:11 smithi179 bash[23186]: cluster 2024-09-20T22:59:10.208535+0000 mgr.a (mgr.14388) 1927 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:12 smithi049 bash[23528]: audit 2024-09-20T22:59:11.205348+0000 mgr.a (mgr.14388) 1928 : audit [DBG] from='client.53871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:12 smithi044 bash[22676]: audit 2024-09-20T22:59:11.205348+0000 mgr.a (mgr.14388) 1928 : audit [DBG] from='client.53871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:12 smithi179 bash[23186]: audit 2024-09-20T22:59:11.205348+0000 mgr.a (mgr.14388) 1928 : audit [DBG] from='client.53871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:13 smithi049 bash[23528]: cluster 2024-09-20T22:59:12.209561+0000 mgr.a (mgr.14388) 1929 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:59:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:13 smithi044 bash[22676]: cluster 2024-09-20T22:59:12.209561+0000 mgr.a (mgr.14388) 1929 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:59:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:13 smithi179 bash[23186]: cluster 2024-09-20T22:59:12.209561+0000 mgr.a (mgr.14388) 1929 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:59:15.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:15 smithi179 bash[23186]: cluster 2024-09-20T22:59:14.210373+0000 mgr.a (mgr.14388) 1930 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:59:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:15 smithi049 bash[23528]: cluster 2024-09-20T22:59:14.210373+0000 mgr.a (mgr.14388) 1930 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:59:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:15 smithi044 bash[22676]: cluster 2024-09-20T22:59:14.210373+0000 mgr.a (mgr.14388) 1930 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T22:59:16.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:16.654 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:16.654 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:17.399 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:17.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:17 smithi049 bash[23528]: cluster 2024-09-20T22:59:16.212581+0000 mgr.a (mgr.14388) 1931 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:59:17.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:17 smithi179 bash[23186]: cluster 2024-09-20T22:59:16.212581+0000 mgr.a (mgr.14388) 1931 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:59:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:17 smithi044 bash[22676]: cluster 2024-09-20T22:59:16.212581+0000 mgr.a (mgr.14388) 1931 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T22:59:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:18 smithi049 bash[23528]: audit 2024-09-20T22:59:16.985214+0000 mgr.a (mgr.14388) 1932 : audit [DBG] from='client.53946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:18 smithi044 bash[22676]: audit 2024-09-20T22:59:16.985214+0000 mgr.a (mgr.14388) 1932 : audit [DBG] from='client.53946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:18 smithi179 bash[23186]: audit 2024-09-20T22:59:16.985214+0000 mgr.a (mgr.14388) 1932 : audit [DBG] from='client.53946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:19 smithi049 bash[23528]: cluster 2024-09-20T22:59:18.213705+0000 mgr.a (mgr.14388) 1933 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:19 smithi044 bash[22676]: cluster 2024-09-20T22:59:18.213705+0000 mgr.a (mgr.14388) 1933 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:19 smithi179 bash[23186]: cluster 2024-09-20T22:59:18.213705+0000 mgr.a (mgr.14388) 1933 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:21 smithi049 bash[23528]: cluster 2024-09-20T22:59:20.216011+0000 mgr.a (mgr.14388) 1934 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:21 smithi044 bash[22676]: cluster 2024-09-20T22:59:20.216011+0000 mgr.a (mgr.14388) 1934 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:21 smithi179 bash[23186]: cluster 2024-09-20T22:59:20.216011+0000 mgr.a (mgr.14388) 1934 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:22.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:22.402 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:22.402 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:23.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:23.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:23.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:23.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:23.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:23 smithi049 bash[23528]: cluster 2024-09-20T22:59:22.216971+0000 mgr.a (mgr.14388) 1935 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:23 smithi049 bash[23528]: audit 2024-09-20T22:59:22.259478+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:23 smithi049 bash[23528]: audit 2024-09-20T22:59:22.267887+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:23 smithi049 bash[23528]: audit 2024-09-20T22:59:22.278167+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:23 smithi049 bash[23528]: audit 2024-09-20T22:59:22.476962+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:23 smithi049 bash[23528]: audit 2024-09-20T22:59:22.485326+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:23 smithi049 bash[23528]: audit 2024-09-20T22:59:22.494719+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:23 smithi044 bash[22676]: cluster 2024-09-20T22:59:22.216971+0000 mgr.a (mgr.14388) 1935 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:23 smithi044 bash[22676]: audit 2024-09-20T22:59:22.259478+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:23 smithi044 bash[22676]: audit 2024-09-20T22:59:22.267887+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:23 smithi044 bash[22676]: audit 2024-09-20T22:59:22.278167+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:23 smithi044 bash[22676]: audit 2024-09-20T22:59:22.476962+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:23 smithi044 bash[22676]: audit 2024-09-20T22:59:22.485326+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:23 smithi044 bash[22676]: audit 2024-09-20T22:59:22.494719+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:23 smithi179 bash[23186]: cluster 2024-09-20T22:59:22.216971+0000 mgr.a (mgr.14388) 1935 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:23 smithi179 bash[23186]: audit 2024-09-20T22:59:22.259478+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:23 smithi179 bash[23186]: audit 2024-09-20T22:59:22.267887+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:23 smithi179 bash[23186]: audit 2024-09-20T22:59:22.278167+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:23 smithi179 bash[23186]: audit 2024-09-20T22:59:22.476962+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:23 smithi179 bash[23186]: audit 2024-09-20T22:59:22.485326+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:23 smithi179 bash[23186]: audit 2024-09-20T22:59:22.494719+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:24 smithi049 bash[23528]: audit 2024-09-20T22:59:22.740083+0000 mgr.a (mgr.14388) 1936 : audit [DBG] from='client.54021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:24 smithi044 bash[22676]: audit 2024-09-20T22:59:22.740083+0000 mgr.a (mgr.14388) 1936 : audit [DBG] from='client.54021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:24 smithi179 bash[23186]: audit 2024-09-20T22:59:22.740083+0000 mgr.a (mgr.14388) 1936 : audit [DBG] from='client.54021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:25 smithi044 bash[22676]: cluster 2024-09-20T22:59:24.218229+0000 mgr.a (mgr.14388) 1937 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:25 smithi044 bash[22676]: audit 2024-09-20T22:59:24.377166+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:25 smithi044 bash[22676]: audit 2024-09-20T22:59:24.387031+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:25 smithi044 bash[22676]: audit 2024-09-20T22:59:24.398644+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:25 smithi179 bash[23186]: cluster 2024-09-20T22:59:24.218229+0000 mgr.a (mgr.14388) 1937 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:25 smithi179 bash[23186]: audit 2024-09-20T22:59:24.377166+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:25 smithi179 bash[23186]: audit 2024-09-20T22:59:24.387031+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:25 smithi179 bash[23186]: audit 2024-09-20T22:59:24.398644+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:25 smithi049 bash[23528]: cluster 2024-09-20T22:59:24.218229+0000 mgr.a (mgr.14388) 1937 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:25 smithi049 bash[23528]: audit 2024-09-20T22:59:24.377166+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:25 smithi049 bash[23528]: audit 2024-09-20T22:59:24.387031+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:25 smithi049 bash[23528]: audit 2024-09-20T22:59:24.398644+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:27 smithi044 bash[22676]: cluster 2024-09-20T22:59:26.220599+0000 mgr.a (mgr.14388) 1938 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:27 smithi179 bash[23186]: cluster 2024-09-20T22:59:26.220599+0000 mgr.a (mgr.14388) 1938 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:27 smithi049 bash[23528]: cluster 2024-09-20T22:59:26.220599+0000 mgr.a (mgr.14388) 1938 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:28.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:28.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:28.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:28.948 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:28.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:29.645 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:29 smithi044 bash[22676]: cluster 2024-09-20T22:59:28.221450+0000 mgr.a (mgr.14388) 1939 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:29 smithi179 bash[23186]: cluster 2024-09-20T22:59:28.221450+0000 mgr.a (mgr.14388) 1939 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:29 smithi049 bash[23528]: cluster 2024-09-20T22:59:28.221450+0000 mgr.a (mgr.14388) 1939 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:30.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:30 smithi044 bash[22676]: audit 2024-09-20T22:59:28.512663+0000 mgr.a (mgr.14388) 1940 : audit [DBG] from='client.54096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:30 smithi179 bash[23186]: audit 2024-09-20T22:59:28.512663+0000 mgr.a (mgr.14388) 1940 : audit [DBG] from='client.54096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:30.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:30 smithi049 bash[23528]: audit 2024-09-20T22:59:28.512663+0000 mgr.a (mgr.14388) 1940 : audit [DBG] from='client.54096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:31.698 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:31 smithi049 bash[23528]: cluster 2024-09-20T22:59:30.223735+0000 mgr.a (mgr.14388) 1941 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:31.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:31 smithi044 bash[22676]: cluster 2024-09-20T22:59:30.223735+0000 mgr.a (mgr.14388) 1941 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:31 smithi179 bash[23186]: cluster 2024-09-20T22:59:30.223735+0000 mgr.a (mgr.14388) 1941 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:33 smithi044 bash[22676]: cluster 2024-09-20T22:59:32.224555+0000 mgr.a (mgr.14388) 1942 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:33 smithi179 bash[23186]: cluster 2024-09-20T22:59:32.224555+0000 mgr.a (mgr.14388) 1942 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:33 smithi049 bash[23528]: cluster 2024-09-20T22:59:32.224555+0000 mgr.a (mgr.14388) 1942 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:33.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:33.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:33.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:34.702 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:35 smithi044 bash[22676]: cluster 2024-09-20T22:59:34.225475+0000 mgr.a (mgr.14388) 1943 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:35 smithi044 bash[22676]: audit 2024-09-20T22:59:34.280080+0000 mgr.a (mgr.14388) 1944 : audit [DBG] from='client.54171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:35 smithi179 bash[23186]: cluster 2024-09-20T22:59:34.225475+0000 mgr.a (mgr.14388) 1943 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:35 smithi179 bash[23186]: audit 2024-09-20T22:59:34.280080+0000 mgr.a (mgr.14388) 1944 : audit [DBG] from='client.54171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:35 smithi049 bash[23528]: cluster 2024-09-20T22:59:34.225475+0000 mgr.a (mgr.14388) 1943 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:35 smithi049 bash[23528]: audit 2024-09-20T22:59:34.280080+0000 mgr.a (mgr.14388) 1944 : audit [DBG] from='client.54171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22930]: debug 2024-09-20T22:59:37.458+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22930]: debug 2024-09-20T22:59:37.458+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22676]: cluster 2024-09-20T22:59:36.227896+0000 mgr.a (mgr.14388) 1945 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22676]: audit 2024-09-20T22:59:36.696387+0000 mon.a (mon.0) 2282 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22676]: audit 2024-09-20T22:59:36.703321+0000 mon.a (mon.0) 2283 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22676]: audit 2024-09-20T22:59:36.705353+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22676]: audit 2024-09-20T22:59:36.716820+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:37 smithi044 bash[22676]: audit 2024-09-20T22:59:36.724012+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:59:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:37 smithi179 bash[23186]: cluster 2024-09-20T22:59:36.227896+0000 mgr.a (mgr.14388) 1945 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:37 smithi179 bash[23186]: audit 2024-09-20T22:59:36.696387+0000 mon.a (mon.0) 2282 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:59:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:37 smithi179 bash[23186]: audit 2024-09-20T22:59:36.703321+0000 mon.a (mon.0) 2283 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:59:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:37 smithi179 bash[23186]: audit 2024-09-20T22:59:36.705353+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:59:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:37 smithi179 bash[23186]: audit 2024-09-20T22:59:36.716820+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:37 smithi179 bash[23186]: audit 2024-09-20T22:59:36.724012+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:59:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:37 smithi049 bash[23528]: cluster 2024-09-20T22:59:36.227896+0000 mgr.a (mgr.14388) 1945 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:37 smithi049 bash[23528]: audit 2024-09-20T22:59:36.696387+0000 mon.a (mon.0) 2282 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T22:59:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:37 smithi049 bash[23528]: audit 2024-09-20T22:59:36.703321+0000 mon.a (mon.0) 2283 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T22:59:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:37 smithi049 bash[23528]: audit 2024-09-20T22:59:36.705353+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T22:59:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:37 smithi049 bash[23528]: audit 2024-09-20T22:59:36.716820+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:37 smithi049 bash[23528]: audit 2024-09-20T22:59:36.724012+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:59:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:38 smithi044 bash[22676]: audit 2024-09-20T22:59:36.726499+0000 mgr.a (mgr.14388) 1946 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:59:38.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:38 smithi179 bash[23186]: audit 2024-09-20T22:59:36.726499+0000 mgr.a (mgr.14388) 1946 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:59:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:38 smithi049 bash[23528]: audit 2024-09-20T22:59:36.726499+0000 mgr.a (mgr.14388) 1946 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T22:59:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:39 smithi044 bash[22676]: audit 2024-09-20T22:59:37.461989+0000 mgr.a (mgr.14388) 1947 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:59:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:39 smithi044 bash[22676]: cephadm 2024-09-20T22:59:37.463017+0000 mgr.a (mgr.14388) 1948 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:59:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:39 smithi044 bash[22676]: cluster 2024-09-20T22:59:38.229045+0000 mgr.a (mgr.14388) 1949 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:39 smithi179 bash[23186]: audit 2024-09-20T22:59:37.461989+0000 mgr.a (mgr.14388) 1947 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:59:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:39 smithi179 bash[23186]: cephadm 2024-09-20T22:59:37.463017+0000 mgr.a (mgr.14388) 1948 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:59:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:39 smithi179 bash[23186]: cluster 2024-09-20T22:59:38.229045+0000 mgr.a (mgr.14388) 1949 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:39 smithi049 bash[23528]: audit 2024-09-20T22:59:37.461989+0000 mgr.a (mgr.14388) 1947 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T22:59:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:39 smithi049 bash[23528]: cephadm 2024-09-20T22:59:37.463017+0000 mgr.a (mgr.14388) 1948 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T22:59:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:39 smithi049 bash[23528]: cluster 2024-09-20T22:59:38.229045+0000 mgr.a (mgr.14388) 1949 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:40.458 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:41 smithi049 bash[23528]: audit 2024-09-20T22:59:40.038498+0000 mgr.a (mgr.14388) 1950 : audit [DBG] from='client.54351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:41 smithi049 bash[23528]: cluster 2024-09-20T22:59:40.230714+0000 mgr.a (mgr.14388) 1951 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:41 smithi044 bash[22676]: audit 2024-09-20T22:59:40.038498+0000 mgr.a (mgr.14388) 1950 : audit [DBG] from='client.54351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:41 smithi044 bash[22676]: cluster 2024-09-20T22:59:40.230714+0000 mgr.a (mgr.14388) 1951 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:41 smithi179 bash[23186]: audit 2024-09-20T22:59:40.038498+0000 mgr.a (mgr.14388) 1950 : audit [DBG] from='client.54351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:41 smithi179 bash[23186]: cluster 2024-09-20T22:59:40.230714+0000 mgr.a (mgr.14388) 1951 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:43 smithi044 bash[22676]: cluster 2024-09-20T22:59:42.231594+0000 mgr.a (mgr.14388) 1952 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:43 smithi044 bash[22676]: audit 2024-09-20T22:59:42.488406+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:43 smithi044 bash[22676]: audit 2024-09-20T22:59:42.497218+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:43 smithi044 bash[22676]: audit 2024-09-20T22:59:42.508297+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:43 smithi044 bash[22676]: audit 2024-09-20T22:59:42.646708+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:43 smithi044 bash[22676]: audit 2024-09-20T22:59:42.655876+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:43 smithi044 bash[22676]: audit 2024-09-20T22:59:42.666467+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:43 smithi179 bash[23186]: cluster 2024-09-20T22:59:42.231594+0000 mgr.a (mgr.14388) 1952 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:43 smithi179 bash[23186]: audit 2024-09-20T22:59:42.488406+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:43 smithi179 bash[23186]: audit 2024-09-20T22:59:42.497218+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:43 smithi179 bash[23186]: audit 2024-09-20T22:59:42.508297+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:43 smithi179 bash[23186]: audit 2024-09-20T22:59:42.646708+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:43 smithi179 bash[23186]: audit 2024-09-20T22:59:42.655876+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:43 smithi179 bash[23186]: audit 2024-09-20T22:59:42.666467+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:43 smithi049 bash[23528]: cluster 2024-09-20T22:59:42.231594+0000 mgr.a (mgr.14388) 1952 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:43 smithi049 bash[23528]: audit 2024-09-20T22:59:42.488406+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:43 smithi049 bash[23528]: audit 2024-09-20T22:59:42.497218+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:43 smithi049 bash[23528]: audit 2024-09-20T22:59:42.508297+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:43 smithi049 bash[23528]: audit 2024-09-20T22:59:42.646708+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:43 smithi049 bash[23528]: audit 2024-09-20T22:59:42.655876+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:43 smithi049 bash[23528]: audit 2024-09-20T22:59:42.666467+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:45.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:45 smithi044 bash[22676]: cluster 2024-09-20T22:59:44.232526+0000 mgr.a (mgr.14388) 1953 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:45 smithi044 bash[22676]: audit 2024-09-20T22:59:44.595375+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:45 smithi044 bash[22676]: audit 2024-09-20T22:59:44.603348+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:45 smithi044 bash[22676]: audit 2024-09-20T22:59:44.613329+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:45 smithi179 bash[23186]: cluster 2024-09-20T22:59:44.232526+0000 mgr.a (mgr.14388) 1953 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:45 smithi179 bash[23186]: audit 2024-09-20T22:59:44.595375+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:45 smithi179 bash[23186]: audit 2024-09-20T22:59:44.603348+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:45 smithi179 bash[23186]: audit 2024-09-20T22:59:44.613329+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:45 smithi049 bash[23528]: cluster 2024-09-20T22:59:44.232526+0000 mgr.a (mgr.14388) 1953 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:45 smithi049 bash[23528]: audit 2024-09-20T22:59:44.595375+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:45 smithi049 bash[23528]: audit 2024-09-20T22:59:44.603348+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:45 smithi049 bash[23528]: audit 2024-09-20T22:59:44.613329+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T22:59:46.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:47 smithi044 bash[22676]: audit 2024-09-20T22:59:45.797454+0000 mgr.a (mgr.14388) 1954 : audit [DBG] from='client.54429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:47 smithi044 bash[22676]: cluster 2024-09-20T22:59:46.233857+0000 mgr.a (mgr.14388) 1955 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:47 smithi179 bash[23186]: audit 2024-09-20T22:59:45.797454+0000 mgr.a (mgr.14388) 1954 : audit [DBG] from='client.54429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:47 smithi179 bash[23186]: cluster 2024-09-20T22:59:46.233857+0000 mgr.a (mgr.14388) 1955 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:47 smithi049 bash[23528]: audit 2024-09-20T22:59:45.797454+0000 mgr.a (mgr.14388) 1954 : audit [DBG] from='client.54429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:47 smithi049 bash[23528]: cluster 2024-09-20T22:59:46.233857+0000 mgr.a (mgr.14388) 1955 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:49 smithi044 bash[22676]: cluster 2024-09-20T22:59:48.234626+0000 mgr.a (mgr.14388) 1956 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:49 smithi179 bash[23186]: cluster 2024-09-20T22:59:48.234626+0000 mgr.a (mgr.14388) 1956 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:49 smithi049 bash[23528]: cluster 2024-09-20T22:59:48.234626+0000 mgr.a (mgr.14388) 1956 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T22:59:51.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:51.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:51.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:51 smithi044 bash[22676]: cluster 2024-09-20T22:59:50.236029+0000 mgr.a (mgr.14388) 1957 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:51 smithi179 bash[23186]: cluster 2024-09-20T22:59:50.236029+0000 mgr.a (mgr.14388) 1957 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:51 smithi049 bash[23528]: cluster 2024-09-20T22:59:50.236029+0000 mgr.a (mgr.14388) 1957 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T22:59:52.035 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:52.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:52.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:52.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:52.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:53 smithi044 bash[22676]: audit 2024-09-20T22:59:51.585500+0000 mgr.a (mgr.14388) 1958 : audit [DBG] from='client.54507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:53 smithi044 bash[22676]: cluster 2024-09-20T22:59:52.236809+0000 mgr.a (mgr.14388) 1959 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:53 smithi179 bash[23186]: audit 2024-09-20T22:59:51.585500+0000 mgr.a (mgr.14388) 1958 : audit [DBG] from='client.54507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:53 smithi179 bash[23186]: cluster 2024-09-20T22:59:52.236809+0000 mgr.a (mgr.14388) 1959 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:53 smithi049 bash[23528]: audit 2024-09-20T22:59:51.585500+0000 mgr.a (mgr.14388) 1958 : audit [DBG] from='client.54507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:53 smithi049 bash[23528]: cluster 2024-09-20T22:59:52.236809+0000 mgr.a (mgr.14388) 1959 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:55 smithi044 bash[22676]: cluster 2024-09-20T22:59:54.237646+0000 mgr.a (mgr.14388) 1960 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:55 smithi179 bash[23186]: cluster 2024-09-20T22:59:54.237646+0000 mgr.a (mgr.14388) 1960 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:55 smithi049 bash[23528]: cluster 2024-09-20T22:59:54.237646+0000 mgr.a (mgr.14388) 1960 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:57.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T22:59:57.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T22:59:57.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T22:59:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:57 smithi044 bash[22676]: cluster 2024-09-20T22:59:56.240005+0000 mgr.a (mgr.14388) 1961 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:57 smithi179 bash[23186]: cluster 2024-09-20T22:59:56.240005+0000 mgr.a (mgr.14388) 1961 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:57.780 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T22:59:57.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T22:59:57.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T22:59:57.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T22:59:57.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T22:59:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:57 smithi049 bash[23528]: cluster 2024-09-20T22:59:56.240005+0000 mgr.a (mgr.14388) 1961 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T22:59:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:58 smithi044 bash[22676]: audit 2024-09-20T22:59:57.367811+0000 mgr.a (mgr.14388) 1962 : audit [DBG] from='client.54585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:58 smithi179 bash[23186]: audit 2024-09-20T22:59:57.367811+0000 mgr.a (mgr.14388) 1962 : audit [DBG] from='client.54585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:58 smithi049 bash[23528]: audit 2024-09-20T22:59:57.367811+0000 mgr.a (mgr.14388) 1962 : audit [DBG] from='client.54585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T22:59:59.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 22:59:59 smithi179 bash[23186]: cluster 2024-09-20T22:59:58.241052+0000 mgr.a (mgr.14388) 1963 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 22:59:59 smithi044 bash[22676]: cluster 2024-09-20T22:59:58.241052+0000 mgr.a (mgr.14388) 1963 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T22:59:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 22:59:59 smithi049 bash[23528]: cluster 2024-09-20T22:59:58.241052+0000 mgr.a (mgr.14388) 1963 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:00 smithi044 bash[22676]: cluster 2024-09-20T23:00:00.000153+0000 mon.a (mon.0) 2296 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:00:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:00 smithi044 bash[22676]: cluster 2024-09-20T23:00:00.243261+0000 mgr.a (mgr.14388) 1964 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:00 smithi179 bash[23186]: cluster 2024-09-20T23:00:00.000153+0000 mon.a (mon.0) 2296 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:00:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:00 smithi179 bash[23186]: cluster 2024-09-20T23:00:00.243261+0000 mgr.a (mgr.14388) 1964 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:00 smithi049 bash[23528]: cluster 2024-09-20T23:00:00.000153+0000 mon.a (mon.0) 2296 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:00:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:00 smithi049 bash[23528]: cluster 2024-09-20T23:00:00.243261+0000 mgr.a (mgr.14388) 1964 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:02.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:02.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:02.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:03.538 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:03.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:03.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:03.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:03.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:03.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:03 smithi049 bash[23528]: cluster 2024-09-20T23:00:02.244042+0000 mgr.a (mgr.14388) 1965 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:03.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:03 smithi049 bash[23528]: audit 2024-09-20T23:00:02.720173+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.627 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:03 smithi049 bash[23528]: audit 2024-09-20T23:00:02.729992+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.627 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:03 smithi049 bash[23528]: audit 2024-09-20T23:00:02.741606+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.627 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:03 smithi049 bash[23528]: audit 2024-09-20T23:00:02.817437+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.627 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:03 smithi049 bash[23528]: audit 2024-09-20T23:00:02.825280+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.627 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:03 smithi049 bash[23528]: audit 2024-09-20T23:00:02.834962+0000 mon.a (mon.0) 2302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:03 smithi044 bash[22676]: cluster 2024-09-20T23:00:02.244042+0000 mgr.a (mgr.14388) 1965 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:03 smithi044 bash[22676]: audit 2024-09-20T23:00:02.720173+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:03 smithi044 bash[22676]: audit 2024-09-20T23:00:02.729992+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:03 smithi044 bash[22676]: audit 2024-09-20T23:00:02.741606+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:03 smithi044 bash[22676]: audit 2024-09-20T23:00:02.817437+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:03 smithi044 bash[22676]: audit 2024-09-20T23:00:02.825280+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:03 smithi044 bash[22676]: audit 2024-09-20T23:00:02.834962+0000 mon.a (mon.0) 2302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:03 smithi179 bash[23186]: cluster 2024-09-20T23:00:02.244042+0000 mgr.a (mgr.14388) 1965 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:03 smithi179 bash[23186]: audit 2024-09-20T23:00:02.720173+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:03 smithi179 bash[23186]: audit 2024-09-20T23:00:02.729992+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:03 smithi179 bash[23186]: audit 2024-09-20T23:00:02.741606+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:03 smithi179 bash[23186]: audit 2024-09-20T23:00:02.817437+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:03 smithi179 bash[23186]: audit 2024-09-20T23:00:02.825280+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:03 smithi179 bash[23186]: audit 2024-09-20T23:00:02.834962+0000 mon.a (mon.0) 2302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:04 smithi044 bash[22676]: audit 2024-09-20T23:00:03.118766+0000 mgr.a (mgr.14388) 1966 : audit [DBG] from='client.54663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:04 smithi179 bash[23186]: audit 2024-09-20T23:00:03.118766+0000 mgr.a (mgr.14388) 1966 : audit [DBG] from='client.54663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:04 smithi049 bash[23528]: audit 2024-09-20T23:00:03.118766+0000 mgr.a (mgr.14388) 1966 : audit [DBG] from='client.54663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:05 smithi044 bash[22676]: cluster 2024-09-20T23:00:04.245028+0000 mgr.a (mgr.14388) 1967 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:05 smithi044 bash[22676]: audit 2024-09-20T23:00:04.822302+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:05 smithi044 bash[22676]: audit 2024-09-20T23:00:04.828886+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:05 smithi044 bash[22676]: audit 2024-09-20T23:00:04.837615+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:05 smithi179 bash[23186]: cluster 2024-09-20T23:00:04.245028+0000 mgr.a (mgr.14388) 1967 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:05 smithi179 bash[23186]: audit 2024-09-20T23:00:04.822302+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:05 smithi179 bash[23186]: audit 2024-09-20T23:00:04.828886+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:05 smithi179 bash[23186]: audit 2024-09-20T23:00:04.837615+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:05 smithi049 bash[23528]: cluster 2024-09-20T23:00:04.245028+0000 mgr.a (mgr.14388) 1967 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:05 smithi049 bash[23528]: audit 2024-09-20T23:00:04.822302+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:05 smithi049 bash[23528]: audit 2024-09-20T23:00:04.828886+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:05 smithi049 bash[23528]: audit 2024-09-20T23:00:04.837615+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:07.651 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:07 smithi179 bash[23186]: cluster 2024-09-20T23:00:06.247274+0000 mgr.a (mgr.14388) 1968 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:07 smithi044 bash[22676]: cluster 2024-09-20T23:00:06.247274+0000 mgr.a (mgr.14388) 1968 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:07 smithi049 bash[23528]: cluster 2024-09-20T23:00:06.247274+0000 mgr.a (mgr.14388) 1968 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:09.321 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:09.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:09.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:09.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:09.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:09 smithi044 bash[22676]: cluster 2024-09-20T23:00:08.248036+0000 mgr.a (mgr.14388) 1969 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:09 smithi179 bash[23186]: cluster 2024-09-20T23:00:08.248036+0000 mgr.a (mgr.14388) 1969 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:09.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:09 smithi049 bash[23528]: cluster 2024-09-20T23:00:08.248036+0000 mgr.a (mgr.14388) 1969 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:10 smithi044 bash[22676]: audit 2024-09-20T23:00:08.881592+0000 mgr.a (mgr.14388) 1970 : audit [DBG] from='client.54741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:10 smithi179 bash[23186]: audit 2024-09-20T23:00:08.881592+0000 mgr.a (mgr.14388) 1970 : audit [DBG] from='client.54741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:10 smithi049 bash[23528]: audit 2024-09-20T23:00:08.881592+0000 mgr.a (mgr.14388) 1970 : audit [DBG] from='client.54741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:11 smithi044 bash[22676]: cluster 2024-09-20T23:00:10.250408+0000 mgr.a (mgr.14388) 1971 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:11 smithi179 bash[23186]: cluster 2024-09-20T23:00:10.250408+0000 mgr.a (mgr.14388) 1971 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:11 smithi049 bash[23528]: cluster 2024-09-20T23:00:10.250408+0000 mgr.a (mgr.14388) 1971 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:13 smithi044 bash[22676]: cluster 2024-09-20T23:00:12.251236+0000 mgr.a (mgr.14388) 1972 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:13 smithi179 bash[23186]: cluster 2024-09-20T23:00:12.251236+0000 mgr.a (mgr.14388) 1972 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:13 smithi049 bash[23528]: cluster 2024-09-20T23:00:12.251236+0000 mgr.a (mgr.14388) 1972 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:14.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:14.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:14.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:15.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:15.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:15.067 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:15 smithi044 bash[22676]: cluster 2024-09-20T23:00:14.252018+0000 mgr.a (mgr.14388) 1973 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:15 smithi179 bash[23186]: cluster 2024-09-20T23:00:14.252018+0000 mgr.a (mgr.14388) 1973 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:15 smithi049 bash[23528]: cluster 2024-09-20T23:00:14.252018+0000 mgr.a (mgr.14388) 1973 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:16 smithi044 bash[22676]: audit 2024-09-20T23:00:14.658149+0000 mgr.a (mgr.14388) 1974 : audit [DBG] from='client.54816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:16 smithi179 bash[23186]: audit 2024-09-20T23:00:14.658149+0000 mgr.a (mgr.14388) 1974 : audit [DBG] from='client.54816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:16.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:16 smithi049 bash[23528]: audit 2024-09-20T23:00:14.658149+0000 mgr.a (mgr.14388) 1974 : audit [DBG] from='client.54816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:17 smithi044 bash[22676]: cluster 2024-09-20T23:00:16.254381+0000 mgr.a (mgr.14388) 1975 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:17 smithi179 bash[23186]: cluster 2024-09-20T23:00:16.254381+0000 mgr.a (mgr.14388) 1975 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:17 smithi049 bash[23528]: cluster 2024-09-20T23:00:16.254381+0000 mgr.a (mgr.14388) 1975 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:19.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:19 smithi179 bash[23186]: cluster 2024-09-20T23:00:18.255180+0000 mgr.a (mgr.14388) 1976 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:19 smithi044 bash[22676]: cluster 2024-09-20T23:00:18.255180+0000 mgr.a (mgr.14388) 1976 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:19 smithi049 bash[23528]: cluster 2024-09-20T23:00:18.255180+0000 mgr.a (mgr.14388) 1976 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:20.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:20.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:20.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:20.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:21 smithi044 bash[22676]: cluster 2024-09-20T23:00:20.257137+0000 mgr.a (mgr.14388) 1977 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:21 smithi044 bash[22676]: audit 2024-09-20T23:00:20.398158+0000 mgr.a (mgr.14388) 1978 : audit [DBG] from='client.54894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:21 smithi179 bash[23186]: cluster 2024-09-20T23:00:20.257137+0000 mgr.a (mgr.14388) 1977 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:21 smithi179 bash[23186]: audit 2024-09-20T23:00:20.398158+0000 mgr.a (mgr.14388) 1978 : audit [DBG] from='client.54894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:21 smithi049 bash[23528]: cluster 2024-09-20T23:00:20.257137+0000 mgr.a (mgr.14388) 1977 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:21 smithi049 bash[23528]: audit 2024-09-20T23:00:20.398158+0000 mgr.a (mgr.14388) 1978 : audit [DBG] from='client.54894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:23 smithi044 bash[22676]: cluster 2024-09-20T23:00:22.258152+0000 mgr.a (mgr.14388) 1979 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:00:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:23 smithi044 bash[22676]: audit 2024-09-20T23:00:22.955072+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:23 smithi044 bash[22676]: audit 2024-09-20T23:00:22.963532+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:23 smithi044 bash[22676]: audit 2024-09-20T23:00:22.975520+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:23 smithi044 bash[22676]: audit 2024-09-20T23:00:23.021665+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:23 smithi044 bash[22676]: audit 2024-09-20T23:00:23.031563+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:23 smithi044 bash[22676]: audit 2024-09-20T23:00:23.042792+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:23 smithi179 bash[23186]: cluster 2024-09-20T23:00:22.258152+0000 mgr.a (mgr.14388) 1979 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:00:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:23 smithi179 bash[23186]: audit 2024-09-20T23:00:22.955072+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:23 smithi179 bash[23186]: audit 2024-09-20T23:00:22.963532+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:23 smithi179 bash[23186]: audit 2024-09-20T23:00:22.975520+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:23 smithi179 bash[23186]: audit 2024-09-20T23:00:23.021665+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:23 smithi179 bash[23186]: audit 2024-09-20T23:00:23.031563+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:23 smithi179 bash[23186]: audit 2024-09-20T23:00:23.042792+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:23 smithi049 bash[23528]: cluster 2024-09-20T23:00:22.258152+0000 mgr.a (mgr.14388) 1979 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:00:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:23 smithi049 bash[23528]: audit 2024-09-20T23:00:22.955072+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:23 smithi049 bash[23528]: audit 2024-09-20T23:00:22.963532+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:23 smithi049 bash[23528]: audit 2024-09-20T23:00:22.975520+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:23 smithi049 bash[23528]: audit 2024-09-20T23:00:23.021665+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:23 smithi049 bash[23528]: audit 2024-09-20T23:00:23.031563+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:23 smithi049 bash[23528]: audit 2024-09-20T23:00:23.042792+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:25 smithi044 bash[22676]: cluster 2024-09-20T23:00:24.258942+0000 mgr.a (mgr.14388) 1980 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:00:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:25 smithi044 bash[22676]: audit 2024-09-20T23:00:25.017158+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:25 smithi044 bash[22676]: audit 2024-09-20T23:00:25.025511+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:25 smithi044 bash[22676]: audit 2024-09-20T23:00:25.036547+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:25 smithi179 bash[23186]: cluster 2024-09-20T23:00:24.258942+0000 mgr.a (mgr.14388) 1980 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:00:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:25 smithi179 bash[23186]: audit 2024-09-20T23:00:25.017158+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:25 smithi179 bash[23186]: audit 2024-09-20T23:00:25.025511+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:25 smithi179 bash[23186]: audit 2024-09-20T23:00:25.036547+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:25 smithi049 bash[23528]: cluster 2024-09-20T23:00:24.258942+0000 mgr.a (mgr.14388) 1980 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:00:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:25 smithi049 bash[23528]: audit 2024-09-20T23:00:25.017158+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:25 smithi049 bash[23528]: audit 2024-09-20T23:00:25.025511+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:25 smithi049 bash[23528]: audit 2024-09-20T23:00:25.036547+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:25.833 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:25.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:25.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:26.615 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:26.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:26.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:26.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:26.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:26 smithi044 bash[22676]: audit 2024-09-20T23:00:26.172423+0000 mgr.a (mgr.14388) 1981 : audit [DBG] from='client.54972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:26 smithi044 bash[22676]: cluster 2024-09-20T23:00:26.260394+0000 mgr.a (mgr.14388) 1982 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:26 smithi179 bash[23186]: audit 2024-09-20T23:00:26.172423+0000 mgr.a (mgr.14388) 1981 : audit [DBG] from='client.54972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:26 smithi179 bash[23186]: cluster 2024-09-20T23:00:26.260394+0000 mgr.a (mgr.14388) 1982 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:26 smithi049 bash[23528]: audit 2024-09-20T23:00:26.172423+0000 mgr.a (mgr.14388) 1981 : audit [DBG] from='client.54972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:26 smithi049 bash[23528]: cluster 2024-09-20T23:00:26.260394+0000 mgr.a (mgr.14388) 1982 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:29 smithi044 bash[22676]: cluster 2024-09-20T23:00:28.261267+0000 mgr.a (mgr.14388) 1983 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:00:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:29 smithi179 bash[23186]: cluster 2024-09-20T23:00:28.261267+0000 mgr.a (mgr.14388) 1983 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:00:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:29 smithi049 bash[23528]: cluster 2024-09-20T23:00:28.261267+0000 mgr.a (mgr.14388) 1983 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:00:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:31 smithi044 bash[22676]: cluster 2024-09-20T23:00:30.263510+0000 mgr.a (mgr.14388) 1984 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:31.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:31.618 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:31.618 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:31 smithi179 bash[23186]: cluster 2024-09-20T23:00:30.263510+0000 mgr.a (mgr.14388) 1984 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:31 smithi049 bash[23528]: cluster 2024-09-20T23:00:30.263510+0000 mgr.a (mgr.14388) 1984 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:32.384 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:33.560 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:33 smithi044 bash[22676]: audit 2024-09-20T23:00:31.955225+0000 mgr.a (mgr.14388) 1985 : audit [DBG] from='client.55050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:33.560 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:33 smithi044 bash[22676]: cluster 2024-09-20T23:00:32.264112+0000 mgr.a (mgr.14388) 1986 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:33 smithi179 bash[23186]: audit 2024-09-20T23:00:31.955225+0000 mgr.a (mgr.14388) 1985 : audit [DBG] from='client.55050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:33 smithi179 bash[23186]: cluster 2024-09-20T23:00:32.264112+0000 mgr.a (mgr.14388) 1986 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:33 smithi049 bash[23528]: audit 2024-09-20T23:00:31.955225+0000 mgr.a (mgr.14388) 1985 : audit [DBG] from='client.55050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:33 smithi049 bash[23528]: cluster 2024-09-20T23:00:32.264112+0000 mgr.a (mgr.14388) 1986 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:35 smithi044 bash[22676]: cluster 2024-09-20T23:00:34.264931+0000 mgr.a (mgr.14388) 1987 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:35 smithi179 bash[23186]: cluster 2024-09-20T23:00:34.264931+0000 mgr.a (mgr.14388) 1987 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:35 smithi049 bash[23528]: cluster 2024-09-20T23:00:34.264931+0000 mgr.a (mgr.14388) 1987 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:37.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:37.386 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:37.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:37 smithi044 bash[22676]: cluster 2024-09-20T23:00:36.267158+0000 mgr.a (mgr.14388) 1988 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:37 smithi179 bash[23186]: cluster 2024-09-20T23:00:36.267158+0000 mgr.a (mgr.14388) 1988 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:37 smithi049 bash[23528]: cluster 2024-09-20T23:00:36.267158+0000 mgr.a (mgr.14388) 1988 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:00:38.153 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:38.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:38.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:38.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:38.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:37.514848+0000 mon.a (mon.0) 2315 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:00:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.067302+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.072942+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.081752+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.087557+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.088653+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:00:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.089392+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:00:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.094268+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:38 smithi179 bash[23186]: audit 2024-09-20T23:00:38.097261+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:00:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:37.514848+0000 mon.a (mon.0) 2315 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:00:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.067302+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.072942+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.081752+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.087557+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.088653+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:00:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.089392+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:00:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.094268+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22676]: audit 2024-09-20T23:00:38.097261+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:00:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:37.514848+0000 mon.a (mon.0) 2315 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:00:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.067302+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.072942+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.081752+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.087557+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.088653+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:00:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.089392+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:00:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.094268+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:38 smithi049 bash[23528]: audit 2024-09-20T23:00:38.097261+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:00:39.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22930]: debug 2024-09-20T23:00:38.817+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:00:39.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:00:38 smithi044 bash[22930]: debug 2024-09-20T23:00:38.817+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:00:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:39 smithi044 bash[22676]: audit 2024-09-20T23:00:37.721625+0000 mgr.a (mgr.14388) 1989 : audit [DBG] from='client.55128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:39 smithi044 bash[22676]: audit 2024-09-20T23:00:38.098960+0000 mgr.a (mgr.14388) 1990 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:00:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:39 smithi044 bash[22676]: cluster 2024-09-20T23:00:38.267695+0000 mgr.a (mgr.14388) 1991 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:39 smithi179 bash[23186]: audit 2024-09-20T23:00:37.721625+0000 mgr.a (mgr.14388) 1989 : audit [DBG] from='client.55128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:39 smithi179 bash[23186]: audit 2024-09-20T23:00:38.098960+0000 mgr.a (mgr.14388) 1990 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:00:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:39 smithi179 bash[23186]: cluster 2024-09-20T23:00:38.267695+0000 mgr.a (mgr.14388) 1991 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:39 smithi049 bash[23528]: audit 2024-09-20T23:00:37.721625+0000 mgr.a (mgr.14388) 1989 : audit [DBG] from='client.55128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:39 smithi049 bash[23528]: audit 2024-09-20T23:00:38.098960+0000 mgr.a (mgr.14388) 1990 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:00:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:39 smithi049 bash[23528]: cluster 2024-09-20T23:00:38.267695+0000 mgr.a (mgr.14388) 1991 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:40.703 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:40 smithi179 bash[23186]: audit 2024-09-20T23:00:38.823643+0000 mgr.a (mgr.14388) 1992 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:00:40.703 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:40 smithi179 bash[23186]: cephadm 2024-09-20T23:00:38.825112+0000 mgr.a (mgr.14388) 1993 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:00:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:40 smithi044 bash[22676]: audit 2024-09-20T23:00:38.823643+0000 mgr.a (mgr.14388) 1992 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:00:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:40 smithi044 bash[22676]: cephadm 2024-09-20T23:00:38.825112+0000 mgr.a (mgr.14388) 1993 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:00:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:40 smithi049 bash[23528]: audit 2024-09-20T23:00:38.823643+0000 mgr.a (mgr.14388) 1992 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:00:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:40 smithi049 bash[23528]: cephadm 2024-09-20T23:00:38.825112+0000 mgr.a (mgr.14388) 1993 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:00:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:41 smithi044 bash[22676]: cluster 2024-09-20T23:00:40.269946+0000 mgr.a (mgr.14388) 1994 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:41 smithi179 bash[23186]: cluster 2024-09-20T23:00:40.269946+0000 mgr.a (mgr.14388) 1994 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:41 smithi049 bash[23528]: cluster 2024-09-20T23:00:40.269946+0000 mgr.a (mgr.14388) 1994 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:43.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:43.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:43.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:43 smithi179 bash[23186]: cluster 2024-09-20T23:00:42.270728+0000 mgr.a (mgr.14388) 1995 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:43 smithi179 bash[23186]: audit 2024-09-20T23:00:43.187741+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:43 smithi179 bash[23186]: audit 2024-09-20T23:00:43.193855+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:43 smithi179 bash[23186]: audit 2024-09-20T23:00:43.201217+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:43 smithi179 bash[23186]: audit 2024-09-20T23:00:43.254072+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:43 smithi179 bash[23186]: audit 2024-09-20T23:00:43.261079+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:43 smithi179 bash[23186]: audit 2024-09-20T23:00:43.273650+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:43 smithi049 bash[23528]: cluster 2024-09-20T23:00:42.270728+0000 mgr.a (mgr.14388) 1995 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:43 smithi049 bash[23528]: audit 2024-09-20T23:00:43.187741+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:43 smithi049 bash[23528]: audit 2024-09-20T23:00:43.193855+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:43 smithi049 bash[23528]: audit 2024-09-20T23:00:43.201217+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:43 smithi049 bash[23528]: audit 2024-09-20T23:00:43.254072+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:43 smithi049 bash[23528]: audit 2024-09-20T23:00:43.261079+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:43 smithi049 bash[23528]: audit 2024-09-20T23:00:43.273650+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:43 smithi044 bash[22676]: cluster 2024-09-20T23:00:42.270728+0000 mgr.a (mgr.14388) 1995 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:43 smithi044 bash[22676]: audit 2024-09-20T23:00:43.187741+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:43 smithi044 bash[22676]: audit 2024-09-20T23:00:43.193855+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:43 smithi044 bash[22676]: audit 2024-09-20T23:00:43.201217+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:43 smithi044 bash[22676]: audit 2024-09-20T23:00:43.254072+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:43 smithi044 bash[22676]: audit 2024-09-20T23:00:43.261079+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:43 smithi044 bash[22676]: audit 2024-09-20T23:00:43.273650+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:43.943 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:45 smithi044 bash[22676]: audit 2024-09-20T23:00:43.500009+0000 mgr.a (mgr.14388) 1996 : audit [DBG] from='client.36665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:45 smithi044 bash[22676]: cluster 2024-09-20T23:00:44.271758+0000 mgr.a (mgr.14388) 1997 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:45 smithi044 bash[22676]: audit 2024-09-20T23:00:45.252263+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:45 smithi044 bash[22676]: audit 2024-09-20T23:00:45.260642+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:45 smithi044 bash[22676]: audit 2024-09-20T23:00:45.270740+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:45 smithi179 bash[23186]: audit 2024-09-20T23:00:43.500009+0000 mgr.a (mgr.14388) 1996 : audit [DBG] from='client.36665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:45 smithi179 bash[23186]: cluster 2024-09-20T23:00:44.271758+0000 mgr.a (mgr.14388) 1997 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:45 smithi179 bash[23186]: audit 2024-09-20T23:00:45.252263+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:45 smithi179 bash[23186]: audit 2024-09-20T23:00:45.260642+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:45 smithi179 bash[23186]: audit 2024-09-20T23:00:45.270740+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:45 smithi049 bash[23528]: audit 2024-09-20T23:00:43.500009+0000 mgr.a (mgr.14388) 1996 : audit [DBG] from='client.36665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:45 smithi049 bash[23528]: cluster 2024-09-20T23:00:44.271758+0000 mgr.a (mgr.14388) 1997 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:45 smithi049 bash[23528]: audit 2024-09-20T23:00:45.252263+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:45 smithi049 bash[23528]: audit 2024-09-20T23:00:45.260642+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:45 smithi049 bash[23528]: audit 2024-09-20T23:00:45.270740+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:00:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:47 smithi044 bash[22676]: cluster 2024-09-20T23:00:46.274085+0000 mgr.a (mgr.14388) 1998 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:47 smithi179 bash[23186]: cluster 2024-09-20T23:00:46.274085+0000 mgr.a (mgr.14388) 1998 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:47 smithi049 bash[23528]: cluster 2024-09-20T23:00:46.274085+0000 mgr.a (mgr.14388) 1998 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:48.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:48.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:48.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:49.687 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:49.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:49 smithi044 bash[22676]: cluster 2024-09-20T23:00:48.274855+0000 mgr.a (mgr.14388) 1999 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:49 smithi179 bash[23186]: cluster 2024-09-20T23:00:48.274855+0000 mgr.a (mgr.14388) 1999 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:49 smithi049 bash[23528]: cluster 2024-09-20T23:00:48.274855+0000 mgr.a (mgr.14388) 1999 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:50 smithi044 bash[22676]: audit 2024-09-20T23:00:49.276757+0000 mgr.a (mgr.14388) 2000 : audit [DBG] from='client.55383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:50 smithi179 bash[23186]: audit 2024-09-20T23:00:49.276757+0000 mgr.a (mgr.14388) 2000 : audit [DBG] from='client.55383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:50 smithi049 bash[23528]: audit 2024-09-20T23:00:49.276757+0000 mgr.a (mgr.14388) 2000 : audit [DBG] from='client.55383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:51 smithi044 bash[22676]: cluster 2024-09-20T23:00:50.277239+0000 mgr.a (mgr.14388) 2001 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:51 smithi179 bash[23186]: cluster 2024-09-20T23:00:50.277239+0000 mgr.a (mgr.14388) 2001 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:51 smithi049 bash[23528]: cluster 2024-09-20T23:00:50.277239+0000 mgr.a (mgr.14388) 2001 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:00:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:53 smithi044 bash[22676]: cluster 2024-09-20T23:00:52.278071+0000 mgr.a (mgr.14388) 2002 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:53 smithi179 bash[23186]: cluster 2024-09-20T23:00:52.278071+0000 mgr.a (mgr.14388) 2002 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:53 smithi049 bash[23528]: cluster 2024-09-20T23:00:52.278071+0000 mgr.a (mgr.14388) 2002 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:54.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:00:54.689 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:00:54.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:00:55.426 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:00:55.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:00:55.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:00:55.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:00:55.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:00:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:55 smithi044 bash[22676]: cluster 2024-09-20T23:00:54.278878+0000 mgr.a (mgr.14388) 2003 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:55 smithi179 bash[23186]: cluster 2024-09-20T23:00:54.278878+0000 mgr.a (mgr.14388) 2003 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:55 smithi049 bash[23528]: cluster 2024-09-20T23:00:54.278878+0000 mgr.a (mgr.14388) 2003 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:56 smithi044 bash[22676]: audit 2024-09-20T23:00:55.007851+0000 mgr.a (mgr.14388) 2004 : audit [DBG] from='client.55458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:56 smithi179 bash[23186]: audit 2024-09-20T23:00:55.007851+0000 mgr.a (mgr.14388) 2004 : audit [DBG] from='client.55458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:56 smithi049 bash[23528]: audit 2024-09-20T23:00:55.007851+0000 mgr.a (mgr.14388) 2004 : audit [DBG] from='client.55458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:00:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:57 smithi044 bash[22676]: cluster 2024-09-20T23:00:56.281648+0000 mgr.a (mgr.14388) 2005 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:57 smithi179 bash[23186]: cluster 2024-09-20T23:00:56.281648+0000 mgr.a (mgr.14388) 2005 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:57 smithi049 bash[23528]: cluster 2024-09-20T23:00:56.281648+0000 mgr.a (mgr.14388) 2005 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:00:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:00:59 smithi044 bash[22676]: cluster 2024-09-20T23:00:58.282423+0000 mgr.a (mgr.14388) 2006 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:00:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:00:59 smithi179 bash[23186]: cluster 2024-09-20T23:00:58.282423+0000 mgr.a (mgr.14388) 2006 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:00:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:00:59 smithi049 bash[23528]: cluster 2024-09-20T23:00:58.282423+0000 mgr.a (mgr.14388) 2006 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:01:00.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:01.200 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:01.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:01.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:01.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:01.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:01.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:01 smithi049 bash[23528]: cluster 2024-09-20T23:01:00.284373+0000 mgr.a (mgr.14388) 2007 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:01 smithi044 bash[22676]: cluster 2024-09-20T23:01:00.284373+0000 mgr.a (mgr.14388) 2007 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:01 smithi179 bash[23186]: cluster 2024-09-20T23:01:00.284373+0000 mgr.a (mgr.14388) 2007 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:02.699 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:02 smithi049 bash[23528]: audit 2024-09-20T23:01:00.763189+0000 mgr.a (mgr.14388) 2008 : audit [DBG] from='client.55536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:02 smithi044 bash[22676]: audit 2024-09-20T23:01:00.763189+0000 mgr.a (mgr.14388) 2008 : audit [DBG] from='client.55536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:02 smithi179 bash[23186]: audit 2024-09-20T23:01:00.763189+0000 mgr.a (mgr.14388) 2008 : audit [DBG] from='client.55536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:03 smithi044 bash[22676]: cluster 2024-09-20T23:01:02.285308+0000 mgr.a (mgr.14388) 2009 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:01:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:03 smithi044 bash[22676]: audit 2024-09-20T23:01:03.414199+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:03 smithi179 bash[23186]: cluster 2024-09-20T23:01:02.285308+0000 mgr.a (mgr.14388) 2009 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:01:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:03 smithi179 bash[23186]: audit 2024-09-20T23:01:03.414199+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:03 smithi049 bash[23528]: cluster 2024-09-20T23:01:02.285308+0000 mgr.a (mgr.14388) 2009 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:01:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:03 smithi049 bash[23528]: audit 2024-09-20T23:01:03.414199+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:04 smithi044 bash[22676]: audit 2024-09-20T23:01:03.437369+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:04 smithi044 bash[22676]: audit 2024-09-20T23:01:03.449620+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:04 smithi044 bash[22676]: audit 2024-09-20T23:01:03.460803+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:04 smithi044 bash[22676]: audit 2024-09-20T23:01:03.470718+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:04 smithi044 bash[22676]: audit 2024-09-20T23:01:03.480963+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:04 smithi179 bash[23186]: audit 2024-09-20T23:01:03.437369+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:04 smithi179 bash[23186]: audit 2024-09-20T23:01:03.449620+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:04 smithi179 bash[23186]: audit 2024-09-20T23:01:03.460803+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:04 smithi179 bash[23186]: audit 2024-09-20T23:01:03.470718+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:04 smithi179 bash[23186]: audit 2024-09-20T23:01:03.480963+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:04 smithi049 bash[23528]: audit 2024-09-20T23:01:03.437369+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:04 smithi049 bash[23528]: audit 2024-09-20T23:01:03.449620+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:04 smithi049 bash[23528]: audit 2024-09-20T23:01:03.460803+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:04 smithi049 bash[23528]: audit 2024-09-20T23:01:03.470718+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:04 smithi049 bash[23528]: audit 2024-09-20T23:01:03.480963+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:05 smithi044 bash[22676]: cluster 2024-09-20T23:01:04.286034+0000 mgr.a (mgr.14388) 2010 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:01:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:05 smithi179 bash[23186]: cluster 2024-09-20T23:01:04.286034+0000 mgr.a (mgr.14388) 2010 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:01:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:05 smithi049 bash[23528]: cluster 2024-09-20T23:01:04.286034+0000 mgr.a (mgr.14388) 2010 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:01:06.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:06.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:06.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:06 smithi179 bash[23186]: audit 2024-09-20T23:01:05.489537+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:06 smithi179 bash[23186]: audit 2024-09-20T23:01:05.497765+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:06 smithi179 bash[23186]: audit 2024-09-20T23:01:05.507747+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:06 smithi179 bash[23186]: cluster 2024-09-20T23:01:06.288824+0000 mgr.a (mgr.14388) 2011 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:06 smithi049 bash[23528]: audit 2024-09-20T23:01:05.489537+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:06 smithi049 bash[23528]: audit 2024-09-20T23:01:05.497765+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:06 smithi049 bash[23528]: audit 2024-09-20T23:01:05.507747+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:06 smithi049 bash[23528]: cluster 2024-09-20T23:01:06.288824+0000 mgr.a (mgr.14388) 2011 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:06.965 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:06 smithi044 bash[22676]: audit 2024-09-20T23:01:05.489537+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:06 smithi044 bash[22676]: audit 2024-09-20T23:01:05.497765+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:06 smithi044 bash[22676]: audit 2024-09-20T23:01:05.507747+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:06 smithi044 bash[22676]: cluster 2024-09-20T23:01:06.288824+0000 mgr.a (mgr.14388) 2011 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:07 smithi049 bash[23528]: audit 2024-09-20T23:01:06.545521+0000 mgr.a (mgr.14388) 2012 : audit [DBG] from='client.55614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:07 smithi044 bash[22676]: audit 2024-09-20T23:01:06.545521+0000 mgr.a (mgr.14388) 2012 : audit [DBG] from='client.55614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:07 smithi179 bash[23186]: audit 2024-09-20T23:01:06.545521+0000 mgr.a (mgr.14388) 2012 : audit [DBG] from='client.55614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:08 smithi049 bash[23528]: cluster 2024-09-20T23:01:08.289799+0000 mgr.a (mgr.14388) 2013 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:08 smithi044 bash[22676]: cluster 2024-09-20T23:01:08.289799+0000 mgr.a (mgr.14388) 2013 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:08 smithi179 bash[23186]: cluster 2024-09-20T23:01:08.289799+0000 mgr.a (mgr.14388) 2013 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:11 smithi044 bash[22676]: cluster 2024-09-20T23:01:10.292035+0000 mgr.a (mgr.14388) 2014 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:11 smithi179 bash[23186]: cluster 2024-09-20T23:01:10.292035+0000 mgr.a (mgr.14388) 2014 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:11 smithi049 bash[23528]: cluster 2024-09-20T23:01:10.292035+0000 mgr.a (mgr.14388) 2014 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:11.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:11.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:11.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:12.715 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:13.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:13 smithi044 bash[22676]: audit 2024-09-20T23:01:12.291703+0000 mgr.a (mgr.14388) 2015 : audit [DBG] from='client.55692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:13.633 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:13 smithi044 bash[22676]: cluster 2024-09-20T23:01:12.307163+0000 mgr.a (mgr.14388) 2016 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:13 smithi179 bash[23186]: audit 2024-09-20T23:01:12.291703+0000 mgr.a (mgr.14388) 2015 : audit [DBG] from='client.55692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:13 smithi179 bash[23186]: cluster 2024-09-20T23:01:12.307163+0000 mgr.a (mgr.14388) 2016 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:13 smithi049 bash[23528]: audit 2024-09-20T23:01:12.291703+0000 mgr.a (mgr.14388) 2015 : audit [DBG] from='client.55692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:13 smithi049 bash[23528]: cluster 2024-09-20T23:01:12.307163+0000 mgr.a (mgr.14388) 2016 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:15 smithi044 bash[22676]: cluster 2024-09-20T23:01:14.308246+0000 mgr.a (mgr.14388) 2017 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:15 smithi179 bash[23186]: cluster 2024-09-20T23:01:14.308246+0000 mgr.a (mgr.14388) 2017 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:15 smithi049 bash[23528]: cluster 2024-09-20T23:01:14.308246+0000 mgr.a (mgr.14388) 2017 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:17.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:17.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:17.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:17 smithi044 bash[22676]: cluster 2024-09-20T23:01:16.310693+0000 mgr.a (mgr.14388) 2018 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:17 smithi179 bash[23186]: cluster 2024-09-20T23:01:16.310693+0000 mgr.a (mgr.14388) 2018 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:17 smithi049 bash[23528]: cluster 2024-09-20T23:01:16.310693+0000 mgr.a (mgr.14388) 2018 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:18.484 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:18.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:19 smithi044 bash[22676]: audit 2024-09-20T23:01:18.055865+0000 mgr.a (mgr.14388) 2019 : audit [DBG] from='client.55770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:19 smithi044 bash[22676]: cluster 2024-09-20T23:01:18.311288+0000 mgr.a (mgr.14388) 2020 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:19 smithi179 bash[23186]: audit 2024-09-20T23:01:18.055865+0000 mgr.a (mgr.14388) 2019 : audit [DBG] from='client.55770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:19 smithi179 bash[23186]: cluster 2024-09-20T23:01:18.311288+0000 mgr.a (mgr.14388) 2020 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:19 smithi049 bash[23528]: audit 2024-09-20T23:01:18.055865+0000 mgr.a (mgr.14388) 2019 : audit [DBG] from='client.55770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:19 smithi049 bash[23528]: cluster 2024-09-20T23:01:18.311288+0000 mgr.a (mgr.14388) 2020 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:21 smithi179 bash[23186]: cluster 2024-09-20T23:01:20.313576+0000 mgr.a (mgr.14388) 2021 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:21 smithi044 bash[22676]: cluster 2024-09-20T23:01:20.313576+0000 mgr.a (mgr.14388) 2021 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:21 smithi049 bash[23528]: cluster 2024-09-20T23:01:20.313576+0000 mgr.a (mgr.14388) 2021 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:23.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:23.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:23.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:23 smithi179 bash[23186]: cluster 2024-09-20T23:01:22.314375+0000 mgr.a (mgr.14388) 2022 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:23.708 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:23 smithi049 bash[23528]: cluster 2024-09-20T23:01:22.314375+0000 mgr.a (mgr.14388) 2022 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:23 smithi044 bash[22676]: cluster 2024-09-20T23:01:22.314375+0000 mgr.a (mgr.14388) 2022 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:24.248 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: audit 2024-09-20T23:01:23.663567+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: audit 2024-09-20T23:01:23.671921+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: audit 2024-09-20T23:01:23.685235+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: audit 2024-09-20T23:01:23.690910+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: audit 2024-09-20T23:01:23.698842+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: audit 2024-09-20T23:01:23.707490+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: audit 2024-09-20T23:01:23.825771+0000 mgr.a (mgr.14388) 2023 : audit [DBG] from='client.55848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:24 smithi044 bash[22676]: cluster 2024-09-20T23:01:24.315089+0000 mgr.a (mgr.14388) 2024 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: audit 2024-09-20T23:01:23.663567+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: audit 2024-09-20T23:01:23.671921+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: audit 2024-09-20T23:01:23.685235+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: audit 2024-09-20T23:01:23.690910+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: audit 2024-09-20T23:01:23.698842+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: audit 2024-09-20T23:01:23.707490+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: audit 2024-09-20T23:01:23.825771+0000 mgr.a (mgr.14388) 2023 : audit [DBG] from='client.55848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:24 smithi179 bash[23186]: cluster 2024-09-20T23:01:24.315089+0000 mgr.a (mgr.14388) 2024 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: audit 2024-09-20T23:01:23.663567+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: audit 2024-09-20T23:01:23.671921+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: audit 2024-09-20T23:01:23.685235+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: audit 2024-09-20T23:01:23.690910+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: audit 2024-09-20T23:01:23.698842+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: audit 2024-09-20T23:01:23.707490+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: audit 2024-09-20T23:01:23.825771+0000 mgr.a (mgr.14388) 2023 : audit [DBG] from='client.55848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:24 smithi049 bash[23528]: cluster 2024-09-20T23:01:24.315089+0000 mgr.a (mgr.14388) 2024 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:26 smithi044 bash[22676]: audit 2024-09-20T23:01:25.733086+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:26 smithi044 bash[22676]: audit 2024-09-20T23:01:25.743012+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:26 smithi044 bash[22676]: audit 2024-09-20T23:01:25.754688+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:26 smithi044 bash[22676]: cluster 2024-09-20T23:01:26.317520+0000 mgr.a (mgr.14388) 2025 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:26 smithi179 bash[23186]: audit 2024-09-20T23:01:25.733086+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:26 smithi179 bash[23186]: audit 2024-09-20T23:01:25.743012+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:26 smithi179 bash[23186]: audit 2024-09-20T23:01:25.754688+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:26 smithi179 bash[23186]: cluster 2024-09-20T23:01:26.317520+0000 mgr.a (mgr.14388) 2025 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:26 smithi049 bash[23528]: audit 2024-09-20T23:01:25.733086+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:26 smithi049 bash[23528]: audit 2024-09-20T23:01:25.743012+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:26 smithi049 bash[23528]: audit 2024-09-20T23:01:25.754688+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:26 smithi049 bash[23528]: cluster 2024-09-20T23:01:26.317520+0000 mgr.a (mgr.14388) 2025 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:01:29.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:29.250 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:29.250 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:29 smithi044 bash[22676]: cluster 2024-09-20T23:01:28.318317+0000 mgr.a (mgr.14388) 2026 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:29 smithi179 bash[23186]: cluster 2024-09-20T23:01:28.318317+0000 mgr.a (mgr.14388) 2026 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:29 smithi049 bash[23528]: cluster 2024-09-20T23:01:28.318317+0000 mgr.a (mgr.14388) 2026 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:31 smithi044 bash[22676]: audit 2024-09-20T23:01:29.579373+0000 mgr.a (mgr.14388) 2027 : audit [DBG] from='client.55923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:31 smithi044 bash[22676]: cluster 2024-09-20T23:01:30.320964+0000 mgr.a (mgr.14388) 2028 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:01:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:31 smithi179 bash[23186]: audit 2024-09-20T23:01:29.579373+0000 mgr.a (mgr.14388) 2027 : audit [DBG] from='client.55923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:31 smithi179 bash[23186]: cluster 2024-09-20T23:01:30.320964+0000 mgr.a (mgr.14388) 2028 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:01:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:31 smithi049 bash[23528]: audit 2024-09-20T23:01:29.579373+0000 mgr.a (mgr.14388) 2027 : audit [DBG] from='client.55923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:31 smithi049 bash[23528]: cluster 2024-09-20T23:01:30.320964+0000 mgr.a (mgr.14388) 2028 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:01:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:33 smithi044 bash[22676]: cluster 2024-09-20T23:01:32.321773+0000 mgr.a (mgr.14388) 2029 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:01:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:33 smithi179 bash[23186]: cluster 2024-09-20T23:01:32.321773+0000 mgr.a (mgr.14388) 2029 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:01:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:33 smithi049 bash[23528]: cluster 2024-09-20T23:01:32.321773+0000 mgr.a (mgr.14388) 2029 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:01:35.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:35.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:35.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:35.626 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:35 smithi044 bash[22676]: cluster 2024-09-20T23:01:34.322565+0000 mgr.a (mgr.14388) 2030 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:01:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:35 smithi179 bash[23186]: cluster 2024-09-20T23:01:34.322565+0000 mgr.a (mgr.14388) 2030 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:01:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:35 smithi049 bash[23528]: cluster 2024-09-20T23:01:34.322565+0000 mgr.a (mgr.14388) 2030 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:01:35.806 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:35.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:35.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:35.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:35.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:36 smithi044 bash[22676]: audit 2024-09-20T23:01:35.354636+0000 mgr.a (mgr.14388) 2031 : audit [DBG] from='client.55998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:36 smithi179 bash[23186]: audit 2024-09-20T23:01:35.354636+0000 mgr.a (mgr.14388) 2031 : audit [DBG] from='client.55998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:36 smithi049 bash[23528]: audit 2024-09-20T23:01:35.354636+0000 mgr.a (mgr.14388) 2031 : audit [DBG] from='client.55998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:37 smithi044 bash[22676]: cluster 2024-09-20T23:01:36.323930+0000 mgr.a (mgr.14388) 2032 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:37 smithi179 bash[23186]: cluster 2024-09-20T23:01:36.323930+0000 mgr.a (mgr.14388) 2032 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:37 smithi049 bash[23528]: cluster 2024-09-20T23:01:36.323930+0000 mgr.a (mgr.14388) 2032 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:39 smithi044 bash[22676]: cluster 2024-09-20T23:01:38.324665+0000 mgr.a (mgr.14388) 2033 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:01:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:39 smithi044 bash[22676]: audit 2024-09-20T23:01:38.888810+0000 mon.a (mon.0) 2351 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:01:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:39 smithi179 bash[23186]: cluster 2024-09-20T23:01:38.324665+0000 mgr.a (mgr.14388) 2033 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:01:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:39 smithi179 bash[23186]: audit 2024-09-20T23:01:38.888810+0000 mon.a (mon.0) 2351 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:01:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:39 smithi049 bash[23528]: cluster 2024-09-20T23:01:38.324665+0000 mgr.a (mgr.14388) 2033 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:01:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:39 smithi049 bash[23528]: audit 2024-09-20T23:01:38.888810+0000 mon.a (mon.0) 2351 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:01:40.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22930]: debug 2024-09-20T23:01:40.245+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:01:40.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22930]: debug 2024-09-20T23:01:40.245+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:01:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22676]: audit 2024-09-20T23:01:39.461232+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22676]: audit 2024-09-20T23:01:39.470929+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22676]: audit 2024-09-20T23:01:39.473350+0000 mon.a (mon.0) 2354 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:01:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22676]: audit 2024-09-20T23:01:39.475131+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:01:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22676]: audit 2024-09-20T23:01:39.485283+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:40 smithi044 bash[22676]: audit 2024-09-20T23:01:39.491563+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:01:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:40 smithi179 bash[23186]: audit 2024-09-20T23:01:39.461232+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:40 smithi179 bash[23186]: audit 2024-09-20T23:01:39.470929+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:40 smithi179 bash[23186]: audit 2024-09-20T23:01:39.473350+0000 mon.a (mon.0) 2354 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:01:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:40 smithi179 bash[23186]: audit 2024-09-20T23:01:39.475131+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:01:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:40 smithi179 bash[23186]: audit 2024-09-20T23:01:39.485283+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:40 smithi179 bash[23186]: audit 2024-09-20T23:01:39.491563+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:01:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:40 smithi049 bash[23528]: audit 2024-09-20T23:01:39.461232+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:40 smithi049 bash[23528]: audit 2024-09-20T23:01:39.470929+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:40 smithi049 bash[23528]: audit 2024-09-20T23:01:39.473350+0000 mon.a (mon.0) 2354 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:01:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:40 smithi049 bash[23528]: audit 2024-09-20T23:01:39.475131+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:01:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:40 smithi049 bash[23528]: audit 2024-09-20T23:01:39.485283+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:40 smithi049 bash[23528]: audit 2024-09-20T23:01:39.491563+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:01:40.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:40.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:40.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:41.594 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:41.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:41 smithi179 bash[23186]: audit 2024-09-20T23:01:39.494048+0000 mgr.a (mgr.14388) 2034 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:01:41.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:41 smithi179 bash[23186]: audit 2024-09-20T23:01:40.247063+0000 mgr.a (mgr.14388) 2035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:01:41.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:41 smithi179 bash[23186]: cephadm 2024-09-20T23:01:40.248699+0000 mgr.a (mgr.14388) 2036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:01:41.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:41 smithi179 bash[23186]: cluster 2024-09-20T23:01:40.326317+0000 mgr.a (mgr.14388) 2037 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:41 smithi044 bash[22676]: audit 2024-09-20T23:01:39.494048+0000 mgr.a (mgr.14388) 2034 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:01:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:41 smithi044 bash[22676]: audit 2024-09-20T23:01:40.247063+0000 mgr.a (mgr.14388) 2035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:01:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:41 smithi044 bash[22676]: cephadm 2024-09-20T23:01:40.248699+0000 mgr.a (mgr.14388) 2036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:01:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:41 smithi044 bash[22676]: cluster 2024-09-20T23:01:40.326317+0000 mgr.a (mgr.14388) 2037 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:41 smithi049 bash[23528]: audit 2024-09-20T23:01:39.494048+0000 mgr.a (mgr.14388) 2034 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:01:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:41 smithi049 bash[23528]: audit 2024-09-20T23:01:40.247063+0000 mgr.a (mgr.14388) 2035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:01:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:41 smithi049 bash[23528]: cephadm 2024-09-20T23:01:40.248699+0000 mgr.a (mgr.14388) 2036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:01:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:41 smithi049 bash[23528]: cluster 2024-09-20T23:01:40.326317+0000 mgr.a (mgr.14388) 2037 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:42 smithi044 bash[22676]: audit 2024-09-20T23:01:41.143386+0000 mgr.a (mgr.14388) 2038 : audit [DBG] from='client.56181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:42 smithi179 bash[23186]: audit 2024-09-20T23:01:41.143386+0000 mgr.a (mgr.14388) 2038 : audit [DBG] from='client.56181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:42 smithi049 bash[23528]: audit 2024-09-20T23:01:41.143386+0000 mgr.a (mgr.14388) 2038 : audit [DBG] from='client.56181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:43 smithi044 bash[22676]: cluster 2024-09-20T23:01:42.327193+0000 mgr.a (mgr.14388) 2039 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:43 smithi179 bash[23186]: cluster 2024-09-20T23:01:42.327193+0000 mgr.a (mgr.14388) 2039 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:43.753 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:43 smithi049 bash[23528]: cluster 2024-09-20T23:01:42.327193+0000 mgr.a (mgr.14388) 2039 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:44 smithi049 bash[23528]: audit 2024-09-20T23:01:43.834023+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:44 smithi049 bash[23528]: audit 2024-09-20T23:01:43.842284+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:44 smithi049 bash[23528]: audit 2024-09-20T23:01:43.852440+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:44 smithi049 bash[23528]: audit 2024-09-20T23:01:43.868079+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:44 smithi049 bash[23528]: audit 2024-09-20T23:01:43.876461+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:44 smithi049 bash[23528]: audit 2024-09-20T23:01:43.886621+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:44 smithi049 bash[23528]: cluster 2024-09-20T23:01:44.327947+0000 mgr.a (mgr.14388) 2040 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:44 smithi044 bash[22676]: audit 2024-09-20T23:01:43.834023+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:44 smithi044 bash[22676]: audit 2024-09-20T23:01:43.842284+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:44 smithi044 bash[22676]: audit 2024-09-20T23:01:43.852440+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:44 smithi044 bash[22676]: audit 2024-09-20T23:01:43.868079+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:44 smithi044 bash[22676]: audit 2024-09-20T23:01:43.876461+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:44 smithi044 bash[22676]: audit 2024-09-20T23:01:43.886621+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:44 smithi044 bash[22676]: cluster 2024-09-20T23:01:44.327947+0000 mgr.a (mgr.14388) 2040 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:44 smithi179 bash[23186]: audit 2024-09-20T23:01:43.834023+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:44 smithi179 bash[23186]: audit 2024-09-20T23:01:43.842284+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:44 smithi179 bash[23186]: audit 2024-09-20T23:01:43.852440+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:44 smithi179 bash[23186]: audit 2024-09-20T23:01:43.868079+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:44 smithi179 bash[23186]: audit 2024-09-20T23:01:43.876461+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:44 smithi179 bash[23186]: audit 2024-09-20T23:01:43.886621+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:44 smithi179 bash[23186]: cluster 2024-09-20T23:01:44.327947+0000 mgr.a (mgr.14388) 2040 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:01:46.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:46 smithi044 bash[22676]: audit 2024-09-20T23:01:45.970806+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:46 smithi044 bash[22676]: audit 2024-09-20T23:01:45.979136+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:46 smithi044 bash[22676]: audit 2024-09-20T23:01:45.988998+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:46 smithi044 bash[22676]: cluster 2024-09-20T23:01:46.330179+0000 mgr.a (mgr.14388) 2041 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:46 smithi179 bash[23186]: audit 2024-09-20T23:01:45.970806+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:46 smithi179 bash[23186]: audit 2024-09-20T23:01:45.979136+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:46 smithi179 bash[23186]: audit 2024-09-20T23:01:45.988998+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:46 smithi179 bash[23186]: cluster 2024-09-20T23:01:46.330179+0000 mgr.a (mgr.14388) 2041 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:46 smithi049 bash[23528]: audit 2024-09-20T23:01:45.970806+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:46 smithi049 bash[23528]: audit 2024-09-20T23:01:45.979136+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:46 smithi049 bash[23528]: audit 2024-09-20T23:01:45.988998+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:01:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:46 smithi049 bash[23528]: cluster 2024-09-20T23:01:46.330179+0000 mgr.a (mgr.14388) 2041 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:47.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:47.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:47 smithi179 bash[23186]: audit 2024-09-20T23:01:46.930518+0000 mgr.a (mgr.14388) 2042 : audit [DBG] from='client.56259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:47 smithi049 bash[23528]: audit 2024-09-20T23:01:46.930518+0000 mgr.a (mgr.14388) 2042 : audit [DBG] from='client.56259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:47 smithi044 bash[22676]: audit 2024-09-20T23:01:46.930518+0000 mgr.a (mgr.14388) 2042 : audit [DBG] from='client.56259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:48 smithi179 bash[23186]: cluster 2024-09-20T23:01:48.331244+0000 mgr.a (mgr.14388) 2043 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:49 smithi049 bash[23528]: cluster 2024-09-20T23:01:48.331244+0000 mgr.a (mgr.14388) 2043 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:48 smithi044 bash[22676]: cluster 2024-09-20T23:01:48.331244+0000 mgr.a (mgr.14388) 2043 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:51 smithi044 bash[22676]: cluster 2024-09-20T23:01:50.333668+0000 mgr.a (mgr.14388) 2044 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:51 smithi179 bash[23186]: cluster 2024-09-20T23:01:50.333668+0000 mgr.a (mgr.14388) 2044 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:51 smithi049 bash[23528]: cluster 2024-09-20T23:01:50.333668+0000 mgr.a (mgr.14388) 2044 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:01:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:52.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:53.153 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:53.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:53 smithi044 bash[22676]: cluster 2024-09-20T23:01:52.334581+0000 mgr.a (mgr.14388) 2045 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:53 smithi179 bash[23186]: cluster 2024-09-20T23:01:52.334581+0000 mgr.a (mgr.14388) 2045 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:53 smithi049 bash[23528]: cluster 2024-09-20T23:01:52.334581+0000 mgr.a (mgr.14388) 2045 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:54 smithi044 bash[22676]: audit 2024-09-20T23:01:52.713083+0000 mgr.a (mgr.14388) 2046 : audit [DBG] from='client.56337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:54 smithi179 bash[23186]: audit 2024-09-20T23:01:52.713083+0000 mgr.a (mgr.14388) 2046 : audit [DBG] from='client.56337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:54 smithi049 bash[23528]: audit 2024-09-20T23:01:52.713083+0000 mgr.a (mgr.14388) 2046 : audit [DBG] from='client.56337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:01:55.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:55 smithi044 bash[22676]: cluster 2024-09-20T23:01:54.335514+0000 mgr.a (mgr.14388) 2047 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:55 smithi179 bash[23186]: cluster 2024-09-20T23:01:54.335514+0000 mgr.a (mgr.14388) 2047 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:55 smithi049 bash[23528]: cluster 2024-09-20T23:01:54.335514+0000 mgr.a (mgr.14388) 2047 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:57.690 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:57 smithi044 bash[22676]: cluster 2024-09-20T23:01:56.337812+0000 mgr.a (mgr.14388) 2048 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:57 smithi179 bash[23186]: cluster 2024-09-20T23:01:56.337812+0000 mgr.a (mgr.14388) 2048 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:57 smithi049 bash[23528]: cluster 2024-09-20T23:01:56.337812+0000 mgr.a (mgr.14388) 2048 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:01:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:01:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:01:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:01:58.935 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:01:58.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:01:58.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:01:58.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:01:58.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:01:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:01:59 smithi044 bash[22676]: cluster 2024-09-20T23:01:58.338272+0000 mgr.a (mgr.14388) 2049 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:01:59 smithi179 bash[23186]: cluster 2024-09-20T23:01:58.338272+0000 mgr.a (mgr.14388) 2049 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:01:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:01:59 smithi049 bash[23528]: cluster 2024-09-20T23:01:58.338272+0000 mgr.a (mgr.14388) 2049 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:00 smithi044 bash[22676]: audit 2024-09-20T23:01:58.491402+0000 mgr.a (mgr.14388) 2050 : audit [DBG] from='client.56415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:00 smithi179 bash[23186]: audit 2024-09-20T23:01:58.491402+0000 mgr.a (mgr.14388) 2050 : audit [DBG] from='client.56415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:00 smithi049 bash[23528]: audit 2024-09-20T23:01:58.491402+0000 mgr.a (mgr.14388) 2050 : audit [DBG] from='client.56415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:01 smithi044 bash[22676]: cluster 2024-09-20T23:02:00.340632+0000 mgr.a (mgr.14388) 2051 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:01 smithi179 bash[23186]: cluster 2024-09-20T23:02:00.340632+0000 mgr.a (mgr.14388) 2051 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:01 smithi049 bash[23528]: cluster 2024-09-20T23:02:00.340632+0000 mgr.a (mgr.14388) 2051 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:03 smithi044 bash[22676]: cluster 2024-09-20T23:02:02.341597+0000 mgr.a (mgr.14388) 2052 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:03 smithi179 bash[23186]: cluster 2024-09-20T23:02:02.341597+0000 mgr.a (mgr.14388) 2052 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:03 smithi049 bash[23528]: cluster 2024-09-20T23:02:02.341597+0000 mgr.a (mgr.14388) 2052 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:03.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:03.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:04.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: audit 2024-09-20T23:02:04.029741+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: audit 2024-09-20T23:02:04.034400+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: audit 2024-09-20T23:02:04.040672+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: audit 2024-09-20T23:02:04.056363+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: audit 2024-09-20T23:02:04.060978+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: audit 2024-09-20T23:02:04.065776+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: audit 2024-09-20T23:02:04.280116+0000 mgr.a (mgr.14388) 2053 : audit [DBG] from='client.56490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:05 smithi179 bash[23186]: cluster 2024-09-20T23:02:04.342151+0000 mgr.a (mgr.14388) 2054 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: audit 2024-09-20T23:02:04.029741+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: audit 2024-09-20T23:02:04.034400+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: audit 2024-09-20T23:02:04.040672+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: audit 2024-09-20T23:02:04.056363+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: audit 2024-09-20T23:02:04.060978+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: audit 2024-09-20T23:02:04.065776+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: audit 2024-09-20T23:02:04.280116+0000 mgr.a (mgr.14388) 2053 : audit [DBG] from='client.56490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:05 smithi049 bash[23528]: cluster 2024-09-20T23:02:04.342151+0000 mgr.a (mgr.14388) 2054 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: audit 2024-09-20T23:02:04.029741+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: audit 2024-09-20T23:02:04.034400+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: audit 2024-09-20T23:02:04.040672+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: audit 2024-09-20T23:02:04.056363+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: audit 2024-09-20T23:02:04.060978+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: audit 2024-09-20T23:02:04.065776+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: audit 2024-09-20T23:02:04.280116+0000 mgr.a (mgr.14388) 2053 : audit [DBG] from='client.56490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:05 smithi044 bash[22676]: cluster 2024-09-20T23:02:04.342151+0000 mgr.a (mgr.14388) 2054 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:07 smithi044 bash[22676]: audit 2024-09-20T23:02:06.201901+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:07 smithi044 bash[22676]: audit 2024-09-20T23:02:06.209828+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:07 smithi044 bash[22676]: audit 2024-09-20T23:02:06.220332+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:07 smithi044 bash[22676]: cluster 2024-09-20T23:02:06.344440+0000 mgr.a (mgr.14388) 2055 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:07 smithi179 bash[23186]: audit 2024-09-20T23:02:06.201901+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:07 smithi179 bash[23186]: audit 2024-09-20T23:02:06.209828+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:07 smithi179 bash[23186]: audit 2024-09-20T23:02:06.220332+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:07 smithi179 bash[23186]: cluster 2024-09-20T23:02:06.344440+0000 mgr.a (mgr.14388) 2055 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:07 smithi049 bash[23528]: audit 2024-09-20T23:02:06.201901+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:07 smithi049 bash[23528]: audit 2024-09-20T23:02:06.209828+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:07 smithi049 bash[23528]: audit 2024-09-20T23:02:06.220332+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:07 smithi049 bash[23528]: cluster 2024-09-20T23:02:06.344440+0000 mgr.a (mgr.14388) 2055 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:09.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:09.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:09.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:09 smithi044 bash[22676]: cluster 2024-09-20T23:02:08.345210+0000 mgr.a (mgr.14388) 2056 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:09 smithi179 bash[23186]: cluster 2024-09-20T23:02:08.345210+0000 mgr.a (mgr.14388) 2056 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:09.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:09 smithi049 bash[23528]: cluster 2024-09-20T23:02:08.345210+0000 mgr.a (mgr.14388) 2056 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:10.457 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:11 smithi179 bash[23186]: audit 2024-09-20T23:02:10.036372+0000 mgr.a (mgr.14388) 2057 : audit [DBG] from='client.56568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:11 smithi179 bash[23186]: cluster 2024-09-20T23:02:10.346420+0000 mgr.a (mgr.14388) 2058 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:11 smithi044 bash[22676]: audit 2024-09-20T23:02:10.036372+0000 mgr.a (mgr.14388) 2057 : audit [DBG] from='client.56568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:11 smithi044 bash[22676]: cluster 2024-09-20T23:02:10.346420+0000 mgr.a (mgr.14388) 2058 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:11 smithi049 bash[23528]: audit 2024-09-20T23:02:10.036372+0000 mgr.a (mgr.14388) 2057 : audit [DBG] from='client.56568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:11 smithi049 bash[23528]: cluster 2024-09-20T23:02:10.346420+0000 mgr.a (mgr.14388) 2058 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:13 smithi044 bash[22676]: cluster 2024-09-20T23:02:12.347310+0000 mgr.a (mgr.14388) 2059 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:13 smithi179 bash[23186]: cluster 2024-09-20T23:02:12.347310+0000 mgr.a (mgr.14388) 2059 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:13 smithi049 bash[23528]: cluster 2024-09-20T23:02:12.347310+0000 mgr.a (mgr.14388) 2059 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:15.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:15 smithi044 bash[22676]: cluster 2024-09-20T23:02:14.348147+0000 mgr.a (mgr.14388) 2060 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:15 smithi179 bash[23186]: cluster 2024-09-20T23:02:14.348147+0000 mgr.a (mgr.14388) 2060 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:15 smithi049 bash[23528]: cluster 2024-09-20T23:02:14.348147+0000 mgr.a (mgr.14388) 2060 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:16.225 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:16.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:17 smithi044 bash[22676]: audit 2024-09-20T23:02:15.796692+0000 mgr.a (mgr.14388) 2061 : audit [DBG] from='client.56643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:17 smithi044 bash[22676]: cluster 2024-09-20T23:02:16.349359+0000 mgr.a (mgr.14388) 2062 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:17 smithi179 bash[23186]: audit 2024-09-20T23:02:15.796692+0000 mgr.a (mgr.14388) 2061 : audit [DBG] from='client.56643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:17 smithi179 bash[23186]: cluster 2024-09-20T23:02:16.349359+0000 mgr.a (mgr.14388) 2062 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:17 smithi049 bash[23528]: audit 2024-09-20T23:02:15.796692+0000 mgr.a (mgr.14388) 2061 : audit [DBG] from='client.56643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:17 smithi049 bash[23528]: cluster 2024-09-20T23:02:16.349359+0000 mgr.a (mgr.14388) 2062 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:19 smithi044 bash[22676]: cluster 2024-09-20T23:02:18.350101+0000 mgr.a (mgr.14388) 2063 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:19 smithi179 bash[23186]: cluster 2024-09-20T23:02:18.350101+0000 mgr.a (mgr.14388) 2063 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:19 smithi049 bash[23528]: cluster 2024-09-20T23:02:18.350101+0000 mgr.a (mgr.14388) 2063 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:02:21.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:21.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:21.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:21 smithi044 bash[22676]: cluster 2024-09-20T23:02:20.352062+0000 mgr.a (mgr.14388) 2064 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:21 smithi179 bash[23186]: cluster 2024-09-20T23:02:20.352062+0000 mgr.a (mgr.14388) 2064 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:21 smithi049 bash[23528]: cluster 2024-09-20T23:02:20.352062+0000 mgr.a (mgr.14388) 2064 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:21.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:21.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:21.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:21.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:21.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:23 smithi049 bash[23528]: audit 2024-09-20T23:02:21.558494+0000 mgr.a (mgr.14388) 2065 : audit [DBG] from='client.56718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:23 smithi049 bash[23528]: cluster 2024-09-20T23:02:22.353082+0000 mgr.a (mgr.14388) 2066 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:23.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:23 smithi179 bash[23186]: audit 2024-09-20T23:02:21.558494+0000 mgr.a (mgr.14388) 2065 : audit [DBG] from='client.56718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:23.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:23 smithi179 bash[23186]: cluster 2024-09-20T23:02:22.353082+0000 mgr.a (mgr.14388) 2066 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:23 smithi044 bash[22676]: audit 2024-09-20T23:02:21.558494+0000 mgr.a (mgr.14388) 2065 : audit [DBG] from='client.56718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:23 smithi044 bash[22676]: cluster 2024-09-20T23:02:22.353082+0000 mgr.a (mgr.14388) 2066 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:25 smithi049 bash[23528]: audit 2024-09-20T23:02:24.220446+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:25 smithi049 bash[23528]: audit 2024-09-20T23:02:24.230674+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:25 smithi049 bash[23528]: audit 2024-09-20T23:02:24.242790+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:25 smithi049 bash[23528]: audit 2024-09-20T23:02:24.251696+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:25 smithi049 bash[23528]: audit 2024-09-20T23:02:24.260358+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:25 smithi049 bash[23528]: audit 2024-09-20T23:02:24.272009+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:25 smithi049 bash[23528]: cluster 2024-09-20T23:02:24.353855+0000 mgr.a (mgr.14388) 2067 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:25 smithi044 bash[22676]: audit 2024-09-20T23:02:24.220446+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:25 smithi044 bash[22676]: audit 2024-09-20T23:02:24.230674+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:25 smithi044 bash[22676]: audit 2024-09-20T23:02:24.242790+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:25 smithi044 bash[22676]: audit 2024-09-20T23:02:24.251696+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:25 smithi044 bash[22676]: audit 2024-09-20T23:02:24.260358+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:25 smithi044 bash[22676]: audit 2024-09-20T23:02:24.272009+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:25 smithi044 bash[22676]: cluster 2024-09-20T23:02:24.353855+0000 mgr.a (mgr.14388) 2067 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:25 smithi179 bash[23186]: audit 2024-09-20T23:02:24.220446+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:25 smithi179 bash[23186]: audit 2024-09-20T23:02:24.230674+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:25 smithi179 bash[23186]: audit 2024-09-20T23:02:24.242790+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:25 smithi179 bash[23186]: audit 2024-09-20T23:02:24.251696+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:25 smithi179 bash[23186]: audit 2024-09-20T23:02:24.260358+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:25 smithi179 bash[23186]: audit 2024-09-20T23:02:24.272009+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:25 smithi179 bash[23186]: cluster 2024-09-20T23:02:24.353855+0000 mgr.a (mgr.14388) 2067 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:26.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:26.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:26.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:27 smithi044 bash[22676]: cluster 2024-09-20T23:02:26.356176+0000 mgr.a (mgr.14388) 2068 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:27 smithi044 bash[22676]: audit 2024-09-20T23:02:26.428963+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:27 smithi044 bash[22676]: audit 2024-09-20T23:02:26.434778+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:27 smithi044 bash[22676]: audit 2024-09-20T23:02:26.444390+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:27 smithi179 bash[23186]: cluster 2024-09-20T23:02:26.356176+0000 mgr.a (mgr.14388) 2068 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:27 smithi179 bash[23186]: audit 2024-09-20T23:02:26.428963+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:27 smithi179 bash[23186]: audit 2024-09-20T23:02:26.434778+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:27 smithi179 bash[23186]: audit 2024-09-20T23:02:26.444390+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.778 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:27 smithi049 bash[23528]: cluster 2024-09-20T23:02:26.356176+0000 mgr.a (mgr.14388) 2068 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:27 smithi049 bash[23528]: audit 2024-09-20T23:02:26.428963+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:27 smithi049 bash[23528]: audit 2024-09-20T23:02:26.434778+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:27 smithi049 bash[23528]: audit 2024-09-20T23:02:26.444390+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:28 smithi044 bash[22676]: audit 2024-09-20T23:02:27.333713+0000 mgr.a (mgr.14388) 2069 : audit [DBG] from='client.56796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:28 smithi179 bash[23186]: audit 2024-09-20T23:02:27.333713+0000 mgr.a (mgr.14388) 2069 : audit [DBG] from='client.56796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:28 smithi049 bash[23528]: audit 2024-09-20T23:02:27.333713+0000 mgr.a (mgr.14388) 2069 : audit [DBG] from='client.56796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:29 smithi044 bash[22676]: cluster 2024-09-20T23:02:28.357181+0000 mgr.a (mgr.14388) 2070 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:29 smithi179 bash[23186]: cluster 2024-09-20T23:02:28.357181+0000 mgr.a (mgr.14388) 2070 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:29 smithi049 bash[23528]: cluster 2024-09-20T23:02:28.357181+0000 mgr.a (mgr.14388) 2070 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:31 smithi044 bash[22676]: cluster 2024-09-20T23:02:30.359403+0000 mgr.a (mgr.14388) 2071 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:31 smithi179 bash[23186]: cluster 2024-09-20T23:02:30.359403+0000 mgr.a (mgr.14388) 2071 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:31 smithi049 bash[23528]: cluster 2024-09-20T23:02:30.359403+0000 mgr.a (mgr.14388) 2071 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:32.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:32.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:32.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:33.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:33 smithi044 bash[22676]: cluster 2024-09-20T23:02:32.360155+0000 mgr.a (mgr.14388) 2072 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:33 smithi179 bash[23186]: cluster 2024-09-20T23:02:32.360155+0000 mgr.a (mgr.14388) 2072 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:33 smithi049 bash[23528]: cluster 2024-09-20T23:02:32.360155+0000 mgr.a (mgr.14388) 2072 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:34 smithi044 bash[22676]: audit 2024-09-20T23:02:33.118531+0000 mgr.a (mgr.14388) 2073 : audit [DBG] from='client.56874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:34 smithi179 bash[23186]: audit 2024-09-20T23:02:33.118531+0000 mgr.a (mgr.14388) 2073 : audit [DBG] from='client.56874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:34 smithi049 bash[23528]: audit 2024-09-20T23:02:33.118531+0000 mgr.a (mgr.14388) 2073 : audit [DBG] from='client.56874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:35 smithi044 bash[22676]: cluster 2024-09-20T23:02:34.361131+0000 mgr.a (mgr.14388) 2074 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:35 smithi179 bash[23186]: cluster 2024-09-20T23:02:34.361131+0000 mgr.a (mgr.14388) 2074 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:35 smithi049 bash[23528]: cluster 2024-09-20T23:02:34.361131+0000 mgr.a (mgr.14388) 2074 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:37 smithi044 bash[22676]: cluster 2024-09-20T23:02:36.363526+0000 mgr.a (mgr.14388) 2075 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:37 smithi179 bash[23186]: cluster 2024-09-20T23:02:36.363526+0000 mgr.a (mgr.14388) 2075 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:37 smithi049 bash[23528]: cluster 2024-09-20T23:02:36.363526+0000 mgr.a (mgr.14388) 2075 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:38.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:39.331 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:39.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:39.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:39.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:39.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:39 smithi044 bash[22676]: cluster 2024-09-20T23:02:38.364163+0000 mgr.a (mgr.14388) 2076 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:39 smithi179 bash[23186]: cluster 2024-09-20T23:02:38.364163+0000 mgr.a (mgr.14388) 2076 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:39 smithi049 bash[23528]: cluster 2024-09-20T23:02:38.364163+0000 mgr.a (mgr.14388) 2076 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:40 smithi044 bash[22676]: audit 2024-09-20T23:02:38.889477+0000 mgr.a (mgr.14388) 2077 : audit [DBG] from='client.56952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:40 smithi044 bash[22676]: audit 2024-09-20T23:02:40.303612+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:02:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:40 smithi044 bash[22676]: audit 2024-09-20T23:02:40.310683+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:02:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:40 smithi044 bash[22676]: audit 2024-09-20T23:02:40.312625+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:02:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:40 smithi044 bash[22676]: audit 2024-09-20T23:02:40.324143+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:40 smithi044 bash[22676]: audit 2024-09-20T23:02:40.330461+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:02:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:40 smithi179 bash[23186]: audit 2024-09-20T23:02:38.889477+0000 mgr.a (mgr.14388) 2077 : audit [DBG] from='client.56952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:40 smithi179 bash[23186]: audit 2024-09-20T23:02:40.303612+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:02:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:40 smithi179 bash[23186]: audit 2024-09-20T23:02:40.310683+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:02:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:40 smithi179 bash[23186]: audit 2024-09-20T23:02:40.312625+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:02:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:40 smithi179 bash[23186]: audit 2024-09-20T23:02:40.324143+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:40 smithi179 bash[23186]: audit 2024-09-20T23:02:40.330461+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:02:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:40 smithi049 bash[23528]: audit 2024-09-20T23:02:38.889477+0000 mgr.a (mgr.14388) 2077 : audit [DBG] from='client.56952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:40 smithi049 bash[23528]: audit 2024-09-20T23:02:40.303612+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:02:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:40 smithi049 bash[23528]: audit 2024-09-20T23:02:40.310683+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:02:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:40 smithi049 bash[23528]: audit 2024-09-20T23:02:40.312625+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:02:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:40 smithi049 bash[23528]: audit 2024-09-20T23:02:40.324143+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:40 smithi049 bash[23528]: audit 2024-09-20T23:02:40.330461+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:02:41.470 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:02:41 smithi044 bash[22930]: debug 2024-09-20T23:02:41.076+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:02:41.470 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:02:41 smithi044 bash[22930]: debug 2024-09-20T23:02:41.080+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:02:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:41 smithi044 bash[22676]: audit 2024-09-20T23:02:40.333007+0000 mgr.a (mgr.14388) 2078 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:02:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:41 smithi044 bash[22676]: cluster 2024-09-20T23:02:40.367272+0000 mgr.a (mgr.14388) 2079 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:41 smithi179 bash[23186]: audit 2024-09-20T23:02:40.333007+0000 mgr.a (mgr.14388) 2078 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:02:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:41 smithi179 bash[23186]: cluster 2024-09-20T23:02:40.367272+0000 mgr.a (mgr.14388) 2079 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:41 smithi049 bash[23528]: audit 2024-09-20T23:02:40.333007+0000 mgr.a (mgr.14388) 2078 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:02:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:41 smithi049 bash[23528]: cluster 2024-09-20T23:02:40.367272+0000 mgr.a (mgr.14388) 2079 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:02:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:42 smithi044 bash[22676]: audit 2024-09-20T23:02:41.080883+0000 mgr.a (mgr.14388) 2080 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:02:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:42 smithi044 bash[22676]: cephadm 2024-09-20T23:02:41.082185+0000 mgr.a (mgr.14388) 2081 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:02:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:42 smithi179 bash[23186]: audit 2024-09-20T23:02:41.080883+0000 mgr.a (mgr.14388) 2080 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:02:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:42 smithi179 bash[23186]: cephadm 2024-09-20T23:02:41.082185+0000 mgr.a (mgr.14388) 2081 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:02:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:42 smithi049 bash[23528]: audit 2024-09-20T23:02:41.080883+0000 mgr.a (mgr.14388) 2080 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:02:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:42 smithi049 bash[23528]: cephadm 2024-09-20T23:02:41.082185+0000 mgr.a (mgr.14388) 2081 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:02:43.717 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:43 smithi049 bash[23528]: cluster 2024-09-20T23:02:42.368313+0000 mgr.a (mgr.14388) 2082 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:43 smithi044 bash[22676]: cluster 2024-09-20T23:02:42.368313+0000 mgr.a (mgr.14388) 2082 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:43 smithi179 bash[23186]: cluster 2024-09-20T23:02:42.368313+0000 mgr.a (mgr.14388) 2082 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:44.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:45.099 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:45.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:45.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:45.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:45.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:45 smithi179 bash[23186]: cluster 2024-09-20T23:02:44.368893+0000 mgr.a (mgr.14388) 2083 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:45 smithi179 bash[23186]: audit 2024-09-20T23:02:44.414251+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:45 smithi179 bash[23186]: audit 2024-09-20T23:02:44.422337+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:45 smithi179 bash[23186]: audit 2024-09-20T23:02:44.436783+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:45 smithi179 bash[23186]: audit 2024-09-20T23:02:44.443408+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:45 smithi179 bash[23186]: audit 2024-09-20T23:02:44.454640+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:45 smithi179 bash[23186]: audit 2024-09-20T23:02:44.463388+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:45 smithi049 bash[23528]: cluster 2024-09-20T23:02:44.368893+0000 mgr.a (mgr.14388) 2083 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:45.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:45 smithi049 bash[23528]: audit 2024-09-20T23:02:44.414251+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.669 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:45 smithi049 bash[23528]: audit 2024-09-20T23:02:44.422337+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.669 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:45 smithi049 bash[23528]: audit 2024-09-20T23:02:44.436783+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.669 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:45 smithi049 bash[23528]: audit 2024-09-20T23:02:44.443408+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.669 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:45 smithi049 bash[23528]: audit 2024-09-20T23:02:44.454640+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.669 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:45 smithi049 bash[23528]: audit 2024-09-20T23:02:44.463388+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:45 smithi044 bash[22676]: cluster 2024-09-20T23:02:44.368893+0000 mgr.a (mgr.14388) 2083 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:02:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:45 smithi044 bash[22676]: audit 2024-09-20T23:02:44.414251+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:45 smithi044 bash[22676]: audit 2024-09-20T23:02:44.422337+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:45 smithi044 bash[22676]: audit 2024-09-20T23:02:44.436783+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:45 smithi044 bash[22676]: audit 2024-09-20T23:02:44.443408+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:45 smithi044 bash[22676]: audit 2024-09-20T23:02:44.454640+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:45 smithi044 bash[22676]: audit 2024-09-20T23:02:44.463388+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:46.673 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:46 smithi044 bash[22676]: audit 2024-09-20T23:02:44.675679+0000 mgr.a (mgr.14388) 2084 : audit [DBG] from='client.57135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:46 smithi179 bash[23186]: audit 2024-09-20T23:02:44.675679+0000 mgr.a (mgr.14388) 2084 : audit [DBG] from='client.57135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:46 smithi049 bash[23528]: audit 2024-09-20T23:02:44.675679+0000 mgr.a (mgr.14388) 2084 : audit [DBG] from='client.57135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:47 smithi044 bash[22676]: cluster 2024-09-20T23:02:46.371642+0000 mgr.a (mgr.14388) 2085 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:47 smithi044 bash[22676]: audit 2024-09-20T23:02:46.653065+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:47 smithi044 bash[22676]: audit 2024-09-20T23:02:46.660754+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:47 smithi044 bash[22676]: audit 2024-09-20T23:02:46.671024+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:47 smithi179 bash[23186]: cluster 2024-09-20T23:02:46.371642+0000 mgr.a (mgr.14388) 2085 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:47 smithi179 bash[23186]: audit 2024-09-20T23:02:46.653065+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:47 smithi179 bash[23186]: audit 2024-09-20T23:02:46.660754+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:47 smithi179 bash[23186]: audit 2024-09-20T23:02:46.671024+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:47 smithi049 bash[23528]: cluster 2024-09-20T23:02:46.371642+0000 mgr.a (mgr.14388) 2085 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:47 smithi049 bash[23528]: audit 2024-09-20T23:02:46.653065+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:47 smithi049 bash[23528]: audit 2024-09-20T23:02:46.660754+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:47 smithi049 bash[23528]: audit 2024-09-20T23:02:46.671024+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:02:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:49 smithi044 bash[22676]: cluster 2024-09-20T23:02:48.372578+0000 mgr.a (mgr.14388) 2086 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:49 smithi179 bash[23186]: cluster 2024-09-20T23:02:48.372578+0000 mgr.a (mgr.14388) 2086 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:49 smithi049 bash[23528]: cluster 2024-09-20T23:02:48.372578+0000 mgr.a (mgr.14388) 2086 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:50.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:50.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:50.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:50.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:51 smithi044 bash[22676]: cluster 2024-09-20T23:02:50.374656+0000 mgr.a (mgr.14388) 2087 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:51 smithi044 bash[22676]: audit 2024-09-20T23:02:50.429910+0000 mgr.a (mgr.14388) 2088 : audit [DBG] from='client.57213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:51 smithi179 bash[23186]: cluster 2024-09-20T23:02:50.374656+0000 mgr.a (mgr.14388) 2087 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:51 smithi179 bash[23186]: audit 2024-09-20T23:02:50.429910+0000 mgr.a (mgr.14388) 2088 : audit [DBG] from='client.57213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:51 smithi049 bash[23528]: cluster 2024-09-20T23:02:50.374656+0000 mgr.a (mgr.14388) 2087 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:51 smithi049 bash[23528]: audit 2024-09-20T23:02:50.429910+0000 mgr.a (mgr.14388) 2088 : audit [DBG] from='client.57213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:53 smithi044 bash[22676]: cluster 2024-09-20T23:02:52.375743+0000 mgr.a (mgr.14388) 2089 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:53 smithi179 bash[23186]: cluster 2024-09-20T23:02:52.375743+0000 mgr.a (mgr.14388) 2089 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:53 smithi049 bash[23528]: cluster 2024-09-20T23:02:52.375743+0000 mgr.a (mgr.14388) 2089 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:55 smithi044 bash[22676]: cluster 2024-09-20T23:02:54.376728+0000 mgr.a (mgr.14388) 2090 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:55 smithi179 bash[23186]: cluster 2024-09-20T23:02:54.376728+0000 mgr.a (mgr.14388) 2090 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:55 smithi049 bash[23528]: cluster 2024-09-20T23:02:54.376728+0000 mgr.a (mgr.14388) 2090 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:02:55.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:02:55.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:02:55.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:02:56.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:02:56.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:02:56.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:02:56.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:02:56.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:02:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:56 smithi044 bash[22676]: audit 2024-09-20T23:02:56.195994+0000 mgr.a (mgr.14388) 2091 : audit [DBG] from='client.57291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:56 smithi044 bash[22676]: cluster 2024-09-20T23:02:56.378089+0000 mgr.a (mgr.14388) 2092 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:56 smithi179 bash[23186]: audit 2024-09-20T23:02:56.195994+0000 mgr.a (mgr.14388) 2091 : audit [DBG] from='client.57291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:56 smithi179 bash[23186]: cluster 2024-09-20T23:02:56.378089+0000 mgr.a (mgr.14388) 2092 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:56 smithi049 bash[23528]: audit 2024-09-20T23:02:56.195994+0000 mgr.a (mgr.14388) 2091 : audit [DBG] from='client.57291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:02:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:56 smithi049 bash[23528]: cluster 2024-09-20T23:02:56.378089+0000 mgr.a (mgr.14388) 2092 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:02:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:02:59 smithi044 bash[22676]: cluster 2024-09-20T23:02:58.379027+0000 mgr.a (mgr.14388) 2093 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:02:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:02:59 smithi179 bash[23186]: cluster 2024-09-20T23:02:58.379027+0000 mgr.a (mgr.14388) 2093 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:02:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:02:59 smithi049 bash[23528]: cluster 2024-09-20T23:02:58.379027+0000 mgr.a (mgr.14388) 2093 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:03:01.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:01.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:01.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:01 smithi044 bash[22676]: cluster 2024-09-20T23:03:00.381421+0000 mgr.a (mgr.14388) 2094 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:03:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:01 smithi179 bash[23186]: cluster 2024-09-20T23:03:00.381421+0000 mgr.a (mgr.14388) 2094 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:03:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:01 smithi049 bash[23528]: cluster 2024-09-20T23:03:00.381421+0000 mgr.a (mgr.14388) 2094 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:03:02.428 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:03 smithi044 bash[22676]: audit 2024-09-20T23:03:01.980655+0000 mgr.a (mgr.14388) 2095 : audit [DBG] from='client.57366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:03 smithi044 bash[22676]: cluster 2024-09-20T23:03:02.381997+0000 mgr.a (mgr.14388) 2096 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:03 smithi179 bash[23186]: audit 2024-09-20T23:03:01.980655+0000 mgr.a (mgr.14388) 2095 : audit [DBG] from='client.57366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:03 smithi179 bash[23186]: cluster 2024-09-20T23:03:02.381997+0000 mgr.a (mgr.14388) 2096 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:03 smithi049 bash[23528]: audit 2024-09-20T23:03:01.980655+0000 mgr.a (mgr.14388) 2095 : audit [DBG] from='client.57366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:03 smithi049 bash[23528]: cluster 2024-09-20T23:03:02.381997+0000 mgr.a (mgr.14388) 2096 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:05.584 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:05 smithi179 bash[23186]: cluster 2024-09-20T23:03:04.382712+0000 mgr.a (mgr.14388) 2097 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:05.584 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:05 smithi179 bash[23186]: audit 2024-09-20T23:03:04.645828+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.585 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:05 smithi179 bash[23186]: audit 2024-09-20T23:03:04.656114+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.585 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:05 smithi179 bash[23186]: audit 2024-09-20T23:03:04.668663+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.585 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:05 smithi179 bash[23186]: audit 2024-09-20T23:03:04.675438+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.585 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:05 smithi179 bash[23186]: audit 2024-09-20T23:03:04.683887+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.585 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:05 smithi179 bash[23186]: audit 2024-09-20T23:03:04.693912+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:05 smithi044 bash[22676]: cluster 2024-09-20T23:03:04.382712+0000 mgr.a (mgr.14388) 2097 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:05 smithi044 bash[22676]: audit 2024-09-20T23:03:04.645828+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:05 smithi044 bash[22676]: audit 2024-09-20T23:03:04.656114+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:05 smithi044 bash[22676]: audit 2024-09-20T23:03:04.668663+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:05 smithi044 bash[22676]: audit 2024-09-20T23:03:04.675438+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:05 smithi044 bash[22676]: audit 2024-09-20T23:03:04.683887+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:05 smithi044 bash[22676]: audit 2024-09-20T23:03:04.693912+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:05 smithi049 bash[23528]: cluster 2024-09-20T23:03:04.382712+0000 mgr.a (mgr.14388) 2097 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:05 smithi049 bash[23528]: audit 2024-09-20T23:03:04.645828+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:05 smithi049 bash[23528]: audit 2024-09-20T23:03:04.656114+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:05 smithi049 bash[23528]: audit 2024-09-20T23:03:04.668663+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:05 smithi049 bash[23528]: audit 2024-09-20T23:03:04.675438+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:05 smithi049 bash[23528]: audit 2024-09-20T23:03:04.683887+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:05.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:05 smithi049 bash[23528]: audit 2024-09-20T23:03:04.693912+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:07.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:07.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:07 smithi044 bash[22676]: cluster 2024-09-20T23:03:06.384926+0000 mgr.a (mgr.14388) 2098 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:07 smithi044 bash[22676]: audit 2024-09-20T23:03:06.885495+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:07 smithi044 bash[22676]: audit 2024-09-20T23:03:06.892190+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:07 smithi044 bash[22676]: audit 2024-09-20T23:03:06.902524+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:07 smithi179 bash[23186]: cluster 2024-09-20T23:03:06.384926+0000 mgr.a (mgr.14388) 2098 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:07 smithi179 bash[23186]: audit 2024-09-20T23:03:06.885495+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:07 smithi179 bash[23186]: audit 2024-09-20T23:03:06.892190+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:07 smithi179 bash[23186]: audit 2024-09-20T23:03:06.902524+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:07 smithi049 bash[23528]: cluster 2024-09-20T23:03:06.384926+0000 mgr.a (mgr.14388) 2098 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:07 smithi049 bash[23528]: audit 2024-09-20T23:03:06.885495+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:07 smithi049 bash[23528]: audit 2024-09-20T23:03:06.892190+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:07 smithi049 bash[23528]: audit 2024-09-20T23:03:06.902524+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:08.204 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:09 smithi044 bash[22676]: audit 2024-09-20T23:03:07.762746+0000 mgr.a (mgr.14388) 2099 : audit [DBG] from='client.57444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:09 smithi044 bash[22676]: cluster 2024-09-20T23:03:08.385934+0000 mgr.a (mgr.14388) 2100 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:09 smithi179 bash[23186]: audit 2024-09-20T23:03:07.762746+0000 mgr.a (mgr.14388) 2099 : audit [DBG] from='client.57444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:09 smithi179 bash[23186]: cluster 2024-09-20T23:03:08.385934+0000 mgr.a (mgr.14388) 2100 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:09.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:09 smithi049 bash[23528]: audit 2024-09-20T23:03:07.762746+0000 mgr.a (mgr.14388) 2099 : audit [DBG] from='client.57444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:09.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:09 smithi049 bash[23528]: cluster 2024-09-20T23:03:08.385934+0000 mgr.a (mgr.14388) 2100 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:11 smithi044 bash[22676]: cluster 2024-09-20T23:03:10.388144+0000 mgr.a (mgr.14388) 2101 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:11 smithi179 bash[23186]: cluster 2024-09-20T23:03:10.388144+0000 mgr.a (mgr.14388) 2101 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:11 smithi049 bash[23528]: cluster 2024-09-20T23:03:10.388144+0000 mgr.a (mgr.14388) 2101 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:13.207 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:13 smithi044 bash[22676]: cluster 2024-09-20T23:03:12.388911+0000 mgr.a (mgr.14388) 2102 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:13 smithi179 bash[23186]: cluster 2024-09-20T23:03:12.388911+0000 mgr.a (mgr.14388) 2102 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:13 smithi049 bash[23528]: cluster 2024-09-20T23:03:12.388911+0000 mgr.a (mgr.14388) 2102 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:13.960 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:15 smithi044 bash[22676]: audit 2024-09-20T23:03:13.538426+0000 mgr.a (mgr.14388) 2103 : audit [DBG] from='client.57522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:15 smithi044 bash[22676]: cluster 2024-09-20T23:03:14.389936+0000 mgr.a (mgr.14388) 2104 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:15 smithi179 bash[23186]: audit 2024-09-20T23:03:13.538426+0000 mgr.a (mgr.14388) 2103 : audit [DBG] from='client.57522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:15 smithi179 bash[23186]: cluster 2024-09-20T23:03:14.389936+0000 mgr.a (mgr.14388) 2104 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:15 smithi049 bash[23528]: audit 2024-09-20T23:03:13.538426+0000 mgr.a (mgr.14388) 2103 : audit [DBG] from='client.57522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:15 smithi049 bash[23528]: cluster 2024-09-20T23:03:14.389936+0000 mgr.a (mgr.14388) 2104 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:17 smithi044 bash[22676]: cluster 2024-09-20T23:03:16.392202+0000 mgr.a (mgr.14388) 2105 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:17 smithi179 bash[23186]: cluster 2024-09-20T23:03:16.392202+0000 mgr.a (mgr.14388) 2105 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:17 smithi049 bash[23528]: cluster 2024-09-20T23:03:16.392202+0000 mgr.a (mgr.14388) 2105 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:18.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:19.711 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:19 smithi044 bash[22676]: cluster 2024-09-20T23:03:18.393021+0000 mgr.a (mgr.14388) 2106 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:19 smithi179 bash[23186]: cluster 2024-09-20T23:03:18.393021+0000 mgr.a (mgr.14388) 2106 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:19 smithi049 bash[23528]: cluster 2024-09-20T23:03:18.393021+0000 mgr.a (mgr.14388) 2106 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:20 smithi044 bash[22676]: audit 2024-09-20T23:03:19.294150+0000 mgr.a (mgr.14388) 2107 : audit [DBG] from='client.57597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:20 smithi179 bash[23186]: audit 2024-09-20T23:03:19.294150+0000 mgr.a (mgr.14388) 2107 : audit [DBG] from='client.57597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:20 smithi049 bash[23528]: audit 2024-09-20T23:03:19.294150+0000 mgr.a (mgr.14388) 2107 : audit [DBG] from='client.57597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:21 smithi179 bash[23186]: cluster 2024-09-20T23:03:20.395562+0000 mgr.a (mgr.14388) 2108 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:21 smithi049 bash[23528]: cluster 2024-09-20T23:03:20.395562+0000 mgr.a (mgr.14388) 2108 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:21 smithi044 bash[22676]: cluster 2024-09-20T23:03:20.395562+0000 mgr.a (mgr.14388) 2108 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:23 smithi179 bash[23186]: cluster 2024-09-20T23:03:22.396371+0000 mgr.a (mgr.14388) 2109 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:23 smithi049 bash[23528]: cluster 2024-09-20T23:03:22.396371+0000 mgr.a (mgr.14388) 2109 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:23 smithi044 bash[22676]: cluster 2024-09-20T23:03:22.396371+0000 mgr.a (mgr.14388) 2109 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:24.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:24.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:24.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:25.480 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:25 smithi179 bash[23186]: cluster 2024-09-20T23:03:24.397274+0000 mgr.a (mgr.14388) 2110 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:25 smithi179 bash[23186]: audit 2024-09-20T23:03:24.861385+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:25 smithi179 bash[23186]: audit 2024-09-20T23:03:24.868749+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:25 smithi179 bash[23186]: audit 2024-09-20T23:03:24.874890+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:25 smithi179 bash[23186]: audit 2024-09-20T23:03:24.879754+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:25 smithi179 bash[23186]: audit 2024-09-20T23:03:24.885578+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:25 smithi179 bash[23186]: audit 2024-09-20T23:03:24.894098+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:25 smithi049 bash[23528]: cluster 2024-09-20T23:03:24.397274+0000 mgr.a (mgr.14388) 2110 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:25 smithi049 bash[23528]: audit 2024-09-20T23:03:24.861385+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:25 smithi049 bash[23528]: audit 2024-09-20T23:03:24.868749+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:25 smithi049 bash[23528]: audit 2024-09-20T23:03:24.874890+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:25 smithi049 bash[23528]: audit 2024-09-20T23:03:24.879754+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:25 smithi049 bash[23528]: audit 2024-09-20T23:03:24.885578+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:25 smithi049 bash[23528]: audit 2024-09-20T23:03:24.894098+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:25 smithi044 bash[22676]: cluster 2024-09-20T23:03:24.397274+0000 mgr.a (mgr.14388) 2110 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:25 smithi044 bash[22676]: audit 2024-09-20T23:03:24.861385+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:25 smithi044 bash[22676]: audit 2024-09-20T23:03:24.868749+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:25 smithi044 bash[22676]: audit 2024-09-20T23:03:24.874890+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:25 smithi044 bash[22676]: audit 2024-09-20T23:03:24.879754+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:25 smithi044 bash[22676]: audit 2024-09-20T23:03:24.885578+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:25 smithi044 bash[22676]: audit 2024-09-20T23:03:24.894098+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:26 smithi179 bash[23186]: audit 2024-09-20T23:03:25.062144+0000 mgr.a (mgr.14388) 2111 : audit [DBG] from='client.57675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:26 smithi179 bash[23186]: cluster 2024-09-20T23:03:26.400166+0000 mgr.a (mgr.14388) 2112 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:26 smithi049 bash[23528]: audit 2024-09-20T23:03:25.062144+0000 mgr.a (mgr.14388) 2111 : audit [DBG] from='client.57675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:26 smithi049 bash[23528]: cluster 2024-09-20T23:03:26.400166+0000 mgr.a (mgr.14388) 2112 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:26 smithi044 bash[22676]: audit 2024-09-20T23:03:25.062144+0000 mgr.a (mgr.14388) 2111 : audit [DBG] from='client.57675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:26 smithi044 bash[22676]: cluster 2024-09-20T23:03:26.400166+0000 mgr.a (mgr.14388) 2112 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:28 smithi044 bash[22676]: audit 2024-09-20T23:03:27.097364+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:28 smithi044 bash[22676]: audit 2024-09-20T23:03:27.104521+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:28 smithi044 bash[22676]: audit 2024-09-20T23:03:27.115981+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:28 smithi179 bash[23186]: audit 2024-09-20T23:03:27.097364+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:28 smithi179 bash[23186]: audit 2024-09-20T23:03:27.104521+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:28 smithi179 bash[23186]: audit 2024-09-20T23:03:27.115981+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:28 smithi049 bash[23528]: audit 2024-09-20T23:03:27.097364+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:28 smithi049 bash[23528]: audit 2024-09-20T23:03:27.104521+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:28 smithi049 bash[23528]: audit 2024-09-20T23:03:27.115981+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:29 smithi044 bash[22676]: cluster 2024-09-20T23:03:28.400968+0000 mgr.a (mgr.14388) 2113 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:03:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:29 smithi179 bash[23186]: cluster 2024-09-20T23:03:28.400968+0000 mgr.a (mgr.14388) 2113 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:03:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:29 smithi049 bash[23528]: cluster 2024-09-20T23:03:28.400968+0000 mgr.a (mgr.14388) 2113 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:03:30.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:31.238 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:31.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:31.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:31.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:31.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:31 smithi044 bash[22676]: cluster 2024-09-20T23:03:30.402934+0000 mgr.a (mgr.14388) 2114 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:31 smithi179 bash[23186]: cluster 2024-09-20T23:03:30.402934+0000 mgr.a (mgr.14388) 2114 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:31 smithi049 bash[23528]: cluster 2024-09-20T23:03:30.402934+0000 mgr.a (mgr.14388) 2114 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:32 smithi044 bash[22676]: audit 2024-09-20T23:03:30.817191+0000 mgr.a (mgr.14388) 2115 : audit [DBG] from='client.57750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:32 smithi179 bash[23186]: audit 2024-09-20T23:03:30.817191+0000 mgr.a (mgr.14388) 2115 : audit [DBG] from='client.57750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:32 smithi049 bash[23528]: audit 2024-09-20T23:03:30.817191+0000 mgr.a (mgr.14388) 2115 : audit [DBG] from='client.57750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:33 smithi044 bash[22676]: cluster 2024-09-20T23:03:32.403867+0000 mgr.a (mgr.14388) 2116 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:03:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:33 smithi179 bash[23186]: cluster 2024-09-20T23:03:32.403867+0000 mgr.a (mgr.14388) 2116 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:03:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:33 smithi049 bash[23528]: cluster 2024-09-20T23:03:32.403867+0000 mgr.a (mgr.14388) 2116 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:03:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:35 smithi044 bash[22676]: cluster 2024-09-20T23:03:34.404696+0000 mgr.a (mgr.14388) 2117 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:03:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:35 smithi179 bash[23186]: cluster 2024-09-20T23:03:34.404696+0000 mgr.a (mgr.14388) 2117 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:03:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:35 smithi049 bash[23528]: cluster 2024-09-20T23:03:34.404696+0000 mgr.a (mgr.14388) 2117 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:03:36.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:36.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:36.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:37.022 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:37.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:37.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:37.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:37.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:37 smithi044 bash[22676]: cluster 2024-09-20T23:03:36.406855+0000 mgr.a (mgr.14388) 2118 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:37 smithi179 bash[23186]: cluster 2024-09-20T23:03:36.406855+0000 mgr.a (mgr.14388) 2118 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:37 smithi049 bash[23528]: cluster 2024-09-20T23:03:36.406855+0000 mgr.a (mgr.14388) 2118 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:38 smithi179 bash[23186]: audit 2024-09-20T23:03:36.578089+0000 mgr.a (mgr.14388) 2119 : audit [DBG] from='client.57822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:38.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:38 smithi044 bash[22676]: audit 2024-09-20T23:03:36.578089+0000 mgr.a (mgr.14388) 2119 : audit [DBG] from='client.57822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:38 smithi049 bash[23528]: audit 2024-09-20T23:03:36.578089+0000 mgr.a (mgr.14388) 2119 : audit [DBG] from='client.57822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:39.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:39 smithi044 bash[22676]: cluster 2024-09-20T23:03:38.407827+0000 mgr.a (mgr.14388) 2120 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:39 smithi179 bash[23186]: cluster 2024-09-20T23:03:38.407827+0000 mgr.a (mgr.14388) 2120 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:39 smithi049 bash[23528]: cluster 2024-09-20T23:03:38.407827+0000 mgr.a (mgr.14388) 2120 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:41 smithi179 bash[23186]: cluster 2024-09-20T23:03:40.409039+0000 mgr.a (mgr.14388) 2121 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:41 smithi179 bash[23186]: audit 2024-09-20T23:03:41.160619+0000 mon.a (mon.0) 2417 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:03:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:41 smithi179 bash[23186]: audit 2024-09-20T23:03:41.167061+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:03:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:41 smithi179 bash[23186]: audit 2024-09-20T23:03:41.168975+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:03:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:41 smithi179 bash[23186]: audit 2024-09-20T23:03:41.179705+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:41 smithi179 bash[23186]: audit 2024-09-20T23:03:41.183331+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:03:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:41 smithi049 bash[23528]: cluster 2024-09-20T23:03:40.409039+0000 mgr.a (mgr.14388) 2121 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:41 smithi049 bash[23528]: audit 2024-09-20T23:03:41.160619+0000 mon.a (mon.0) 2417 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:03:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:41 smithi049 bash[23528]: audit 2024-09-20T23:03:41.167061+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:03:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:41 smithi049 bash[23528]: audit 2024-09-20T23:03:41.168975+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:03:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:41 smithi049 bash[23528]: audit 2024-09-20T23:03:41.179705+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:41 smithi049 bash[23528]: audit 2024-09-20T23:03:41.183331+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:03:41.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22676]: cluster 2024-09-20T23:03:40.409039+0000 mgr.a (mgr.14388) 2121 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:03:41.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22676]: audit 2024-09-20T23:03:41.160619+0000 mon.a (mon.0) 2417 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:03:41.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22676]: audit 2024-09-20T23:03:41.167061+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:03:41.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22676]: audit 2024-09-20T23:03:41.168975+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:03:41.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22676]: audit 2024-09-20T23:03:41.179705+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:41.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22676]: audit 2024-09-20T23:03:41.183331+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:03:42.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:42.024 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:42.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:42.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22930]: debug 2024-09-20T23:03:41.943+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:03:42.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:03:41 smithi044 bash[22930]: debug 2024-09-20T23:03:41.943+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:03:42.757 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:42.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:42.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:42.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:42.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:42 smithi049 bash[23528]: audit 2024-09-20T23:03:41.186092+0000 mgr.a (mgr.14388) 2122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:03:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:42 smithi044 bash[22676]: audit 2024-09-20T23:03:41.186092+0000 mgr.a (mgr.14388) 2122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:03:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:42 smithi179 bash[23186]: audit 2024-09-20T23:03:41.186092+0000 mgr.a (mgr.14388) 2122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:03:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:43 smithi049 bash[23528]: audit 2024-09-20T23:03:41.947901+0000 mgr.a (mgr.14388) 2123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:03:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:43 smithi049 bash[23528]: cephadm 2024-09-20T23:03:41.949150+0000 mgr.a (mgr.14388) 2124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:03:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:43 smithi049 bash[23528]: audit 2024-09-20T23:03:42.339525+0000 mgr.a (mgr.14388) 2125 : audit [DBG] from='client.58005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:43 smithi049 bash[23528]: cluster 2024-09-20T23:03:42.409640+0000 mgr.a (mgr.14388) 2126 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:43 smithi044 bash[22676]: audit 2024-09-20T23:03:41.947901+0000 mgr.a (mgr.14388) 2123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:03:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:43 smithi044 bash[22676]: cephadm 2024-09-20T23:03:41.949150+0000 mgr.a (mgr.14388) 2124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:03:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:43 smithi044 bash[22676]: audit 2024-09-20T23:03:42.339525+0000 mgr.a (mgr.14388) 2125 : audit [DBG] from='client.58005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:43 smithi044 bash[22676]: cluster 2024-09-20T23:03:42.409640+0000 mgr.a (mgr.14388) 2126 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:43 smithi179 bash[23186]: audit 2024-09-20T23:03:41.947901+0000 mgr.a (mgr.14388) 2123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:03:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:43 smithi179 bash[23186]: cephadm 2024-09-20T23:03:41.949150+0000 mgr.a (mgr.14388) 2124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:03:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:43 smithi179 bash[23186]: audit 2024-09-20T23:03:42.339525+0000 mgr.a (mgr.14388) 2125 : audit [DBG] from='client.58005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:43 smithi179 bash[23186]: cluster 2024-09-20T23:03:42.409640+0000 mgr.a (mgr.14388) 2126 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:44.773 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:44 smithi049 bash[23528]: cluster 2024-09-20T23:03:44.410554+0000 mgr.a (mgr.14388) 2127 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:44 smithi044 bash[22676]: cluster 2024-09-20T23:03:44.410554+0000 mgr.a (mgr.14388) 2127 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:45.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:44 smithi179 bash[23186]: cluster 2024-09-20T23:03:44.410554+0000 mgr.a (mgr.14388) 2127 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:46 smithi044 bash[22676]: audit 2024-09-20T23:03:45.080893+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:46 smithi044 bash[22676]: audit 2024-09-20T23:03:45.089781+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:46 smithi044 bash[22676]: audit 2024-09-20T23:03:45.100415+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:46 smithi044 bash[22676]: audit 2024-09-20T23:03:45.113448+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:46 smithi044 bash[22676]: audit 2024-09-20T23:03:45.121814+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:46 smithi044 bash[22676]: audit 2024-09-20T23:03:45.140072+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:46 smithi179 bash[23186]: audit 2024-09-20T23:03:45.080893+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:46 smithi179 bash[23186]: audit 2024-09-20T23:03:45.089781+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:46 smithi179 bash[23186]: audit 2024-09-20T23:03:45.100415+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:46 smithi179 bash[23186]: audit 2024-09-20T23:03:45.113448+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:46 smithi179 bash[23186]: audit 2024-09-20T23:03:45.121814+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:46 smithi179 bash[23186]: audit 2024-09-20T23:03:45.140072+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:46 smithi049 bash[23528]: audit 2024-09-20T23:03:45.080893+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:46 smithi049 bash[23528]: audit 2024-09-20T23:03:45.089781+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:46 smithi049 bash[23528]: audit 2024-09-20T23:03:45.100415+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:46 smithi049 bash[23528]: audit 2024-09-20T23:03:45.113448+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:46 smithi049 bash[23528]: audit 2024-09-20T23:03:45.121814+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:46 smithi049 bash[23528]: audit 2024-09-20T23:03:45.140072+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:47 smithi049 bash[23528]: cluster 2024-09-20T23:03:46.412896+0000 mgr.a (mgr.14388) 2128 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:47.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:47 smithi044 bash[22676]: cluster 2024-09-20T23:03:46.412896+0000 mgr.a (mgr.14388) 2128 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:47.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:47 smithi179 bash[23186]: cluster 2024-09-20T23:03:46.412896+0000 mgr.a (mgr.14388) 2128 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:47.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:47.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:48.551 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:48.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:48.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:48.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:48.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:48.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:48 smithi179 bash[23186]: audit 2024-09-20T23:03:47.334565+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:48 smithi179 bash[23186]: audit 2024-09-20T23:03:47.343178+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:48 smithi179 bash[23186]: audit 2024-09-20T23:03:47.351822+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:48 smithi044 bash[22676]: audit 2024-09-20T23:03:47.334565+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:48 smithi044 bash[22676]: audit 2024-09-20T23:03:47.343178+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:48 smithi044 bash[22676]: audit 2024-09-20T23:03:47.351822+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:48 smithi049 bash[23528]: audit 2024-09-20T23:03:47.334565+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:48 smithi049 bash[23528]: audit 2024-09-20T23:03:47.343178+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:48 smithi049 bash[23528]: audit 2024-09-20T23:03:47.351822+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:03:49.635 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:49 smithi179 bash[23186]: audit 2024-09-20T23:03:48.102554+0000 mgr.a (mgr.14388) 2129 : audit [DBG] from='client.58083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:49.636 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:49 smithi179 bash[23186]: cluster 2024-09-20T23:03:48.413522+0000 mgr.a (mgr.14388) 2130 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:49 smithi044 bash[22676]: audit 2024-09-20T23:03:48.102554+0000 mgr.a (mgr.14388) 2129 : audit [DBG] from='client.58083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:49 smithi044 bash[22676]: cluster 2024-09-20T23:03:48.413522+0000 mgr.a (mgr.14388) 2130 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:49 smithi049 bash[23528]: audit 2024-09-20T23:03:48.102554+0000 mgr.a (mgr.14388) 2129 : audit [DBG] from='client.58083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:49 smithi049 bash[23528]: cluster 2024-09-20T23:03:48.413522+0000 mgr.a (mgr.14388) 2130 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:51 smithi044 bash[22676]: cluster 2024-09-20T23:03:50.415831+0000 mgr.a (mgr.14388) 2131 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:51 smithi179 bash[23186]: cluster 2024-09-20T23:03:50.415831+0000 mgr.a (mgr.14388) 2131 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:51 smithi049 bash[23528]: cluster 2024-09-20T23:03:50.415831+0000 mgr.a (mgr.14388) 2131 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:53.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:53.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:53.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:53 smithi044 bash[22676]: cluster 2024-09-20T23:03:52.416650+0000 mgr.a (mgr.14388) 2132 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:53 smithi179 bash[23186]: cluster 2024-09-20T23:03:52.416650+0000 mgr.a (mgr.14388) 2132 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:53 smithi049 bash[23528]: cluster 2024-09-20T23:03:52.416650+0000 mgr.a (mgr.14388) 2132 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:54.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:03:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:03:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:03:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:03:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:03:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:55 smithi044 bash[22676]: audit 2024-09-20T23:03:53.890583+0000 mgr.a (mgr.14388) 2133 : audit [DBG] from='client.58155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:55 smithi044 bash[22676]: cluster 2024-09-20T23:03:54.417669+0000 mgr.a (mgr.14388) 2134 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:55 smithi179 bash[23186]: audit 2024-09-20T23:03:53.890583+0000 mgr.a (mgr.14388) 2133 : audit [DBG] from='client.58155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:55 smithi179 bash[23186]: cluster 2024-09-20T23:03:54.417669+0000 mgr.a (mgr.14388) 2134 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:55 smithi049 bash[23528]: audit 2024-09-20T23:03:53.890583+0000 mgr.a (mgr.14388) 2133 : audit [DBG] from='client.58155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:03:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:55 smithi049 bash[23528]: cluster 2024-09-20T23:03:54.417669+0000 mgr.a (mgr.14388) 2134 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:57 smithi044 bash[22676]: cluster 2024-09-20T23:03:56.419931+0000 mgr.a (mgr.14388) 2135 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:57 smithi179 bash[23186]: cluster 2024-09-20T23:03:56.419931+0000 mgr.a (mgr.14388) 2135 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:57 smithi049 bash[23528]: cluster 2024-09-20T23:03:56.419931+0000 mgr.a (mgr.14388) 2135 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:03:59.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:03:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:03:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:03:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:03:59 smithi179 bash[23186]: cluster 2024-09-20T23:03:58.420709+0000 mgr.a (mgr.14388) 2136 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:03:59 smithi049 bash[23528]: cluster 2024-09-20T23:03:58.420709+0000 mgr.a (mgr.14388) 2136 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:03:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:03:59 smithi044 bash[22676]: cluster 2024-09-20T23:03:58.420709+0000 mgr.a (mgr.14388) 2136 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:00.122 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:00.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:00.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:00.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:00.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:01 smithi179 bash[23186]: audit 2024-09-20T23:03:59.682201+0000 mgr.a (mgr.14388) 2137 : audit [DBG] from='client.58233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:01 smithi179 bash[23186]: cluster 2024-09-20T23:04:00.422021+0000 mgr.a (mgr.14388) 2138 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:04:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:01 smithi049 bash[23528]: audit 2024-09-20T23:03:59.682201+0000 mgr.a (mgr.14388) 2137 : audit [DBG] from='client.58233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:01 smithi049 bash[23528]: cluster 2024-09-20T23:04:00.422021+0000 mgr.a (mgr.14388) 2138 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:04:01.817 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:01 smithi044 bash[22676]: audit 2024-09-20T23:03:59.682201+0000 mgr.a (mgr.14388) 2137 : audit [DBG] from='client.58233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:01.817 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:01 smithi044 bash[22676]: cluster 2024-09-20T23:04:00.422021+0000 mgr.a (mgr.14388) 2138 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:04:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:03 smithi179 bash[23186]: cluster 2024-09-20T23:04:02.422779+0000 mgr.a (mgr.14388) 2139 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:04:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:03 smithi049 bash[23528]: cluster 2024-09-20T23:04:02.422779+0000 mgr.a (mgr.14388) 2139 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:04:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:03 smithi044 bash[22676]: cluster 2024-09-20T23:04:02.422779+0000 mgr.a (mgr.14388) 2139 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:04:05.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:05.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:05 smithi179 bash[23186]: cluster 2024-09-20T23:04:04.423571+0000 mgr.a (mgr.14388) 2140 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:04:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:05 smithi179 bash[23186]: audit 2024-09-20T23:04:05.308939+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:05 smithi179 bash[23186]: audit 2024-09-20T23:04:05.315423+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:05 smithi179 bash[23186]: audit 2024-09-20T23:04:05.324063+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:05 smithi179 bash[23186]: audit 2024-09-20T23:04:05.331841+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:05 smithi179 bash[23186]: audit 2024-09-20T23:04:05.339849+0000 mon.a (mon.0) 2435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:05 smithi179 bash[23186]: audit 2024-09-20T23:04:05.349100+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:05 smithi049 bash[23528]: cluster 2024-09-20T23:04:04.423571+0000 mgr.a (mgr.14388) 2140 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:04:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:05 smithi049 bash[23528]: audit 2024-09-20T23:04:05.308939+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:05 smithi049 bash[23528]: audit 2024-09-20T23:04:05.315423+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:05 smithi049 bash[23528]: audit 2024-09-20T23:04:05.324063+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:05 smithi049 bash[23528]: audit 2024-09-20T23:04:05.331841+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:05 smithi049 bash[23528]: audit 2024-09-20T23:04:05.339849+0000 mon.a (mon.0) 2435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:05 smithi049 bash[23528]: audit 2024-09-20T23:04:05.349100+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.866 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:05 smithi044 bash[22676]: cluster 2024-09-20T23:04:04.423571+0000 mgr.a (mgr.14388) 2140 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:04:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:05 smithi044 bash[22676]: audit 2024-09-20T23:04:05.308939+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:05 smithi044 bash[22676]: audit 2024-09-20T23:04:05.315423+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:05 smithi044 bash[22676]: audit 2024-09-20T23:04:05.324063+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:05 smithi044 bash[22676]: audit 2024-09-20T23:04:05.331841+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:05 smithi044 bash[22676]: audit 2024-09-20T23:04:05.339849+0000 mon.a (mon.0) 2435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:05 smithi044 bash[22676]: audit 2024-09-20T23:04:05.349100+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:06 smithi049 bash[23528]: audit 2024-09-20T23:04:05.459496+0000 mgr.a (mgr.14388) 2141 : audit [DBG] from='client.58305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:06 smithi044 bash[22676]: audit 2024-09-20T23:04:05.459496+0000 mgr.a (mgr.14388) 2141 : audit [DBG] from='client.58305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:06 smithi179 bash[23186]: audit 2024-09-20T23:04:05.459496+0000 mgr.a (mgr.14388) 2141 : audit [DBG] from='client.58305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:07 smithi049 bash[23528]: cluster 2024-09-20T23:04:06.426460+0000 mgr.a (mgr.14388) 2142 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:07 smithi044 bash[22676]: cluster 2024-09-20T23:04:06.426460+0000 mgr.a (mgr.14388) 2142 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:07 smithi179 bash[23186]: cluster 2024-09-20T23:04:06.426460+0000 mgr.a (mgr.14388) 2142 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:08 smithi179 bash[23186]: audit 2024-09-20T23:04:07.558712+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:08 smithi179 bash[23186]: audit 2024-09-20T23:04:07.566544+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:08 smithi179 bash[23186]: audit 2024-09-20T23:04:07.575147+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:08 smithi179 bash[23186]: cluster 2024-09-20T23:04:08.427262+0000 mgr.a (mgr.14388) 2143 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:04:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:08 smithi044 bash[22676]: audit 2024-09-20T23:04:07.558712+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:08 smithi044 bash[22676]: audit 2024-09-20T23:04:07.566544+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:08 smithi044 bash[22676]: audit 2024-09-20T23:04:07.575147+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:08 smithi044 bash[22676]: cluster 2024-09-20T23:04:08.427262+0000 mgr.a (mgr.14388) 2143 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:04:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:08 smithi049 bash[23528]: audit 2024-09-20T23:04:07.558712+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:08 smithi049 bash[23528]: audit 2024-09-20T23:04:07.566544+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:08 smithi049 bash[23528]: audit 2024-09-20T23:04:07.575147+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:08 smithi049 bash[23528]: cluster 2024-09-20T23:04:08.427262+0000 mgr.a (mgr.14388) 2143 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:04:10.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:10.868 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:11.617 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:11.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:11.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:11.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:11.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:11 smithi044 bash[22676]: cluster 2024-09-20T23:04:10.429216+0000 mgr.a (mgr.14388) 2144 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:11 smithi179 bash[23186]: cluster 2024-09-20T23:04:10.429216+0000 mgr.a (mgr.14388) 2144 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:11 smithi049 bash[23528]: cluster 2024-09-20T23:04:10.429216+0000 mgr.a (mgr.14388) 2144 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:12 smithi179 bash[23186]: audit 2024-09-20T23:04:11.202208+0000 mgr.a (mgr.14388) 2145 : audit [DBG] from='client.58377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:12 smithi049 bash[23528]: audit 2024-09-20T23:04:11.202208+0000 mgr.a (mgr.14388) 2145 : audit [DBG] from='client.58377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:12 smithi044 bash[22676]: audit 2024-09-20T23:04:11.202208+0000 mgr.a (mgr.14388) 2145 : audit [DBG] from='client.58377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:13 smithi179 bash[23186]: cluster 2024-09-20T23:04:12.430302+0000 mgr.a (mgr.14388) 2146 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:04:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:13 smithi049 bash[23528]: cluster 2024-09-20T23:04:12.430302+0000 mgr.a (mgr.14388) 2146 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:04:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:13 smithi044 bash[22676]: cluster 2024-09-20T23:04:12.430302+0000 mgr.a (mgr.14388) 2146 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:04:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:15 smithi179 bash[23186]: cluster 2024-09-20T23:04:14.431303+0000 mgr.a (mgr.14388) 2147 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:04:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:15 smithi049 bash[23528]: cluster 2024-09-20T23:04:14.431303+0000 mgr.a (mgr.14388) 2147 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:04:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:15 smithi044 bash[22676]: cluster 2024-09-20T23:04:14.431303+0000 mgr.a (mgr.14388) 2147 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:04:16.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:16.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:16.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:17.409 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:17.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:17.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:17.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:17.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:17 smithi049 bash[23528]: cluster 2024-09-20T23:04:16.433512+0000 mgr.a (mgr.14388) 2148 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:04:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:17 smithi044 bash[22676]: cluster 2024-09-20T23:04:16.433512+0000 mgr.a (mgr.14388) 2148 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:04:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:17 smithi179 bash[23186]: cluster 2024-09-20T23:04:16.433512+0000 mgr.a (mgr.14388) 2148 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:18 smithi049 bash[23528]: audit 2024-09-20T23:04:16.960336+0000 mgr.a (mgr.14388) 2149 : audit [DBG] from='client.58455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:18 smithi044 bash[22676]: audit 2024-09-20T23:04:16.960336+0000 mgr.a (mgr.14388) 2149 : audit [DBG] from='client.58455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:18 smithi179 bash[23186]: audit 2024-09-20T23:04:16.960336+0000 mgr.a (mgr.14388) 2149 : audit [DBG] from='client.58455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:19 smithi049 bash[23528]: cluster 2024-09-20T23:04:18.434419+0000 mgr.a (mgr.14388) 2150 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:19 smithi044 bash[22676]: cluster 2024-09-20T23:04:18.434419+0000 mgr.a (mgr.14388) 2150 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:19 smithi179 bash[23186]: cluster 2024-09-20T23:04:18.434419+0000 mgr.a (mgr.14388) 2150 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:20 smithi049 bash[23528]: cluster 2024-09-20T23:04:20.436688+0000 mgr.a (mgr.14388) 2151 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:20 smithi044 bash[22676]: cluster 2024-09-20T23:04:20.436688+0000 mgr.a (mgr.14388) 2151 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:20 smithi179 bash[23186]: cluster 2024-09-20T23:04:20.436688+0000 mgr.a (mgr.14388) 2151 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:22.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:23.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:23.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:23.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:23.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:23.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:23 smithi044 bash[22676]: cluster 2024-09-20T23:04:22.437242+0000 mgr.a (mgr.14388) 2152 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:23 smithi179 bash[23186]: cluster 2024-09-20T23:04:22.437242+0000 mgr.a (mgr.14388) 2152 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:23 smithi049 bash[23528]: cluster 2024-09-20T23:04:22.437242+0000 mgr.a (mgr.14388) 2152 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:24 smithi179 bash[23186]: audit 2024-09-20T23:04:22.740781+0000 mgr.a (mgr.14388) 2153 : audit [DBG] from='client.58530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:24.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:24 smithi049 bash[23528]: audit 2024-09-20T23:04:22.740781+0000 mgr.a (mgr.14388) 2153 : audit [DBG] from='client.58530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:24 smithi044 bash[22676]: audit 2024-09-20T23:04:22.740781+0000 mgr.a (mgr.14388) 2153 : audit [DBG] from='client.58530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:25 smithi179 bash[23186]: cluster 2024-09-20T23:04:24.438219+0000 mgr.a (mgr.14388) 2154 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:25 smithi049 bash[23528]: cluster 2024-09-20T23:04:24.438219+0000 mgr.a (mgr.14388) 2154 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:25 smithi044 bash[22676]: cluster 2024-09-20T23:04:24.438219+0000 mgr.a (mgr.14388) 2154 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:26 smithi049 bash[23528]: audit 2024-09-20T23:04:25.537887+0000 mon.a (mon.0) 2440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:26 smithi049 bash[23528]: audit 2024-09-20T23:04:25.547674+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:26 smithi049 bash[23528]: audit 2024-09-20T23:04:25.560091+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:26 smithi049 bash[23528]: audit 2024-09-20T23:04:25.569408+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:26 smithi049 bash[23528]: audit 2024-09-20T23:04:25.579554+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:26 smithi049 bash[23528]: audit 2024-09-20T23:04:25.590865+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:26 smithi049 bash[23528]: cluster 2024-09-20T23:04:26.440605+0000 mgr.a (mgr.14388) 2155 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:26 smithi044 bash[22676]: audit 2024-09-20T23:04:25.537887+0000 mon.a (mon.0) 2440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:26 smithi044 bash[22676]: audit 2024-09-20T23:04:25.547674+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:26 smithi044 bash[22676]: audit 2024-09-20T23:04:25.560091+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:26 smithi044 bash[22676]: audit 2024-09-20T23:04:25.569408+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:26 smithi044 bash[22676]: audit 2024-09-20T23:04:25.579554+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:26 smithi044 bash[22676]: audit 2024-09-20T23:04:25.590865+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:26 smithi044 bash[22676]: cluster 2024-09-20T23:04:26.440605+0000 mgr.a (mgr.14388) 2155 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:26 smithi179 bash[23186]: audit 2024-09-20T23:04:25.537887+0000 mon.a (mon.0) 2440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:26 smithi179 bash[23186]: audit 2024-09-20T23:04:25.547674+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:26 smithi179 bash[23186]: audit 2024-09-20T23:04:25.560091+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:26 smithi179 bash[23186]: audit 2024-09-20T23:04:25.569408+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:26 smithi179 bash[23186]: audit 2024-09-20T23:04:25.579554+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:26 smithi179 bash[23186]: audit 2024-09-20T23:04:25.590865+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:26 smithi179 bash[23186]: cluster 2024-09-20T23:04:26.440605+0000 mgr.a (mgr.14388) 2155 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:28.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:28.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:28.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:28.934 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:28.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:28.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:28.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:28.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:28 smithi049 bash[23528]: audit 2024-09-20T23:04:27.784387+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:28 smithi049 bash[23528]: audit 2024-09-20T23:04:27.790540+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:28 smithi049 bash[23528]: audit 2024-09-20T23:04:27.800414+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:28 smithi049 bash[23528]: cluster 2024-09-20T23:04:28.441505+0000 mgr.a (mgr.14388) 2156 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:28 smithi049 bash[23528]: audit 2024-09-20T23:04:28.487326+0000 mgr.a (mgr.14388) 2157 : audit [DBG] from='client.58605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:28 smithi044 bash[22676]: audit 2024-09-20T23:04:27.784387+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:28 smithi044 bash[22676]: audit 2024-09-20T23:04:27.790540+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:28 smithi044 bash[22676]: audit 2024-09-20T23:04:27.800414+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:28 smithi044 bash[22676]: cluster 2024-09-20T23:04:28.441505+0000 mgr.a (mgr.14388) 2156 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:28 smithi044 bash[22676]: audit 2024-09-20T23:04:28.487326+0000 mgr.a (mgr.14388) 2157 : audit [DBG] from='client.58605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:28 smithi179 bash[23186]: audit 2024-09-20T23:04:27.784387+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:28 smithi179 bash[23186]: audit 2024-09-20T23:04:27.790540+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:28 smithi179 bash[23186]: audit 2024-09-20T23:04:27.800414+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:28 smithi179 bash[23186]: cluster 2024-09-20T23:04:28.441505+0000 mgr.a (mgr.14388) 2156 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:28 smithi179 bash[23186]: audit 2024-09-20T23:04:28.487326+0000 mgr.a (mgr.14388) 2157 : audit [DBG] from='client.58605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:31 smithi179 bash[23186]: cluster 2024-09-20T23:04:30.443826+0000 mgr.a (mgr.14388) 2158 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:31 smithi049 bash[23528]: cluster 2024-09-20T23:04:30.443826+0000 mgr.a (mgr.14388) 2158 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:31 smithi044 bash[22676]: cluster 2024-09-20T23:04:30.443826+0000 mgr.a (mgr.14388) 2158 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:33 smithi049 bash[23528]: cluster 2024-09-20T23:04:32.444606+0000 mgr.a (mgr.14388) 2159 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:33.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:33.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:33 smithi044 bash[22676]: cluster 2024-09-20T23:04:32.444606+0000 mgr.a (mgr.14388) 2159 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:33 smithi179 bash[23186]: cluster 2024-09-20T23:04:32.444606+0000 mgr.a (mgr.14388) 2159 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:34.731 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:34.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:34.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:34.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:35 smithi179 bash[23186]: audit 2024-09-20T23:04:34.283029+0000 mgr.a (mgr.14388) 2160 : audit [DBG] from='client.58680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:35 smithi179 bash[23186]: cluster 2024-09-20T23:04:34.445164+0000 mgr.a (mgr.14388) 2161 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:35 smithi049 bash[23528]: audit 2024-09-20T23:04:34.283029+0000 mgr.a (mgr.14388) 2160 : audit [DBG] from='client.58680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:35 smithi049 bash[23528]: cluster 2024-09-20T23:04:34.445164+0000 mgr.a (mgr.14388) 2161 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:35 smithi044 bash[22676]: audit 2024-09-20T23:04:34.283029+0000 mgr.a (mgr.14388) 2160 : audit [DBG] from='client.58680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:35 smithi044 bash[22676]: cluster 2024-09-20T23:04:34.445164+0000 mgr.a (mgr.14388) 2161 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:36 smithi044 bash[22676]: cluster 2024-09-20T23:04:36.447446+0000 mgr.a (mgr.14388) 2162 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:36 smithi179 bash[23186]: cluster 2024-09-20T23:04:36.447446+0000 mgr.a (mgr.14388) 2162 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:36 smithi049 bash[23528]: cluster 2024-09-20T23:04:36.447446+0000 mgr.a (mgr.14388) 2162 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:04:39.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:39.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:39.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:39 smithi049 bash[23528]: cluster 2024-09-20T23:04:38.448193+0000 mgr.a (mgr.14388) 2163 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:39 smithi044 bash[22676]: cluster 2024-09-20T23:04:38.448193+0000 mgr.a (mgr.14388) 2163 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:39 smithi179 bash[23186]: cluster 2024-09-20T23:04:38.448193+0000 mgr.a (mgr.14388) 2163 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:40.489 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:40.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:40.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:40.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:40.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:41 smithi049 bash[23528]: audit 2024-09-20T23:04:40.069000+0000 mgr.a (mgr.14388) 2164 : audit [DBG] from='client.58755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:41 smithi049 bash[23528]: cluster 2024-09-20T23:04:40.449694+0000 mgr.a (mgr.14388) 2165 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:41.893 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:41 smithi044 bash[22676]: audit 2024-09-20T23:04:40.069000+0000 mgr.a (mgr.14388) 2164 : audit [DBG] from='client.58755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:41.893 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:41 smithi044 bash[22676]: cluster 2024-09-20T23:04:40.449694+0000 mgr.a (mgr.14388) 2165 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:41 smithi179 bash[23186]: audit 2024-09-20T23:04:40.069000+0000 mgr.a (mgr.14388) 2164 : audit [DBG] from='client.58755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:41 smithi179 bash[23186]: cluster 2024-09-20T23:04:40.449694+0000 mgr.a (mgr.14388) 2165 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:42 smithi049 bash[23528]: audit 2024-09-20T23:04:42.000087+0000 mon.a (mon.0) 2449 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:04:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:42 smithi049 bash[23528]: audit 2024-09-20T23:04:42.003749+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:04:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:42 smithi049 bash[23528]: audit 2024-09-20T23:04:42.004674+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:04:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:42 smithi049 bash[23528]: audit 2024-09-20T23:04:42.010922+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:42 smithi049 bash[23528]: audit 2024-09-20T23:04:42.013858+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:04:42.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:04:42 smithi044 bash[22930]: debug 2024-09-20T23:04:42.738+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:04:42.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:04:42 smithi044 bash[22930]: debug 2024-09-20T23:04:42.742+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:04:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:42 smithi044 bash[22676]: audit 2024-09-20T23:04:42.000087+0000 mon.a (mon.0) 2449 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:04:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:42 smithi044 bash[22676]: audit 2024-09-20T23:04:42.003749+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:04:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:42 smithi044 bash[22676]: audit 2024-09-20T23:04:42.004674+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:04:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:42 smithi044 bash[22676]: audit 2024-09-20T23:04:42.010922+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:42 smithi044 bash[22676]: audit 2024-09-20T23:04:42.013858+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:04:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:42 smithi179 bash[23186]: audit 2024-09-20T23:04:42.000087+0000 mon.a (mon.0) 2449 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:04:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:42 smithi179 bash[23186]: audit 2024-09-20T23:04:42.003749+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:04:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:42 smithi179 bash[23186]: audit 2024-09-20T23:04:42.004674+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:04:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:42 smithi179 bash[23186]: audit 2024-09-20T23:04:42.010922+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:42 smithi179 bash[23186]: audit 2024-09-20T23:04:42.013858+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:04:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:43 smithi049 bash[23528]: audit 2024-09-20T23:04:42.014894+0000 mgr.a (mgr.14388) 2166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:04:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:43 smithi049 bash[23528]: cluster 2024-09-20T23:04:42.450233+0000 mgr.a (mgr.14388) 2167 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:04:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:43 smithi044 bash[22676]: audit 2024-09-20T23:04:42.014894+0000 mgr.a (mgr.14388) 2166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:04:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:43 smithi044 bash[22676]: cluster 2024-09-20T23:04:42.450233+0000 mgr.a (mgr.14388) 2167 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:04:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:43 smithi179 bash[23186]: audit 2024-09-20T23:04:42.014894+0000 mgr.a (mgr.14388) 2166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:04:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:43 smithi179 bash[23186]: cluster 2024-09-20T23:04:42.450233+0000 mgr.a (mgr.14388) 2167 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:04:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:44 smithi044 bash[22676]: audit 2024-09-20T23:04:42.744336+0000 mgr.a (mgr.14388) 2168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:04:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:44 smithi044 bash[22676]: cephadm 2024-09-20T23:04:42.745511+0000 mgr.a (mgr.14388) 2169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:04:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:44 smithi044 bash[22676]: cluster 2024-09-20T23:04:44.451239+0000 mgr.a (mgr.14388) 2170 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:04:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:44 smithi049 bash[23528]: audit 2024-09-20T23:04:42.744336+0000 mgr.a (mgr.14388) 2168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:04:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:44 smithi049 bash[23528]: cephadm 2024-09-20T23:04:42.745511+0000 mgr.a (mgr.14388) 2169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:04:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:44 smithi049 bash[23528]: cluster 2024-09-20T23:04:44.451239+0000 mgr.a (mgr.14388) 2170 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:04:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:44 smithi179 bash[23186]: audit 2024-09-20T23:04:42.744336+0000 mgr.a (mgr.14388) 2168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:04:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:44 smithi179 bash[23186]: cephadm 2024-09-20T23:04:42.745511+0000 mgr.a (mgr.14388) 2169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:04:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:44 smithi179 bash[23186]: cluster 2024-09-20T23:04:44.451239+0000 mgr.a (mgr.14388) 2170 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:04:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:46.233 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:46.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:46.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:46.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:46.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: audit 2024-09-20T23:04:45.772176+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: audit 2024-09-20T23:04:45.780510+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: audit 2024-09-20T23:04:45.791324+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: audit 2024-09-20T23:04:45.800825+0000 mon.a (mon.0) 2457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: audit 2024-09-20T23:04:45.808617+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: audit 2024-09-20T23:04:45.817969+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: audit 2024-09-20T23:04:45.822413+0000 mgr.a (mgr.14388) 2171 : audit [DBG] from='client.58938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:46 smithi049 bash[23528]: cluster 2024-09-20T23:04:46.454048+0000 mgr.a (mgr.14388) 2172 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: audit 2024-09-20T23:04:45.772176+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: audit 2024-09-20T23:04:45.780510+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: audit 2024-09-20T23:04:45.791324+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: audit 2024-09-20T23:04:45.800825+0000 mon.a (mon.0) 2457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: audit 2024-09-20T23:04:45.808617+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: audit 2024-09-20T23:04:45.817969+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: audit 2024-09-20T23:04:45.822413+0000 mgr.a (mgr.14388) 2171 : audit [DBG] from='client.58938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:46 smithi044 bash[22676]: cluster 2024-09-20T23:04:46.454048+0000 mgr.a (mgr.14388) 2172 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: audit 2024-09-20T23:04:45.772176+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: audit 2024-09-20T23:04:45.780510+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: audit 2024-09-20T23:04:45.791324+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: audit 2024-09-20T23:04:45.800825+0000 mon.a (mon.0) 2457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: audit 2024-09-20T23:04:45.808617+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: audit 2024-09-20T23:04:45.817969+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: audit 2024-09-20T23:04:45.822413+0000 mgr.a (mgr.14388) 2171 : audit [DBG] from='client.58938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:46 smithi179 bash[23186]: cluster 2024-09-20T23:04:46.454048+0000 mgr.a (mgr.14388) 2172 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:48 smithi179 bash[23186]: audit 2024-09-20T23:04:47.995843+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:48 smithi179 bash[23186]: audit 2024-09-20T23:04:48.004436+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:48 smithi179 bash[23186]: audit 2024-09-20T23:04:48.015050+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:48 smithi179 bash[23186]: cluster 2024-09-20T23:04:48.454826+0000 mgr.a (mgr.14388) 2173 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:04:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:48 smithi049 bash[23528]: audit 2024-09-20T23:04:47.995843+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:48 smithi049 bash[23528]: audit 2024-09-20T23:04:48.004436+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:48 smithi049 bash[23528]: audit 2024-09-20T23:04:48.015050+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:48 smithi049 bash[23528]: cluster 2024-09-20T23:04:48.454826+0000 mgr.a (mgr.14388) 2173 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:04:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:48 smithi044 bash[22676]: audit 2024-09-20T23:04:47.995843+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:48 smithi044 bash[22676]: audit 2024-09-20T23:04:48.004436+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:48 smithi044 bash[22676]: audit 2024-09-20T23:04:48.015050+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:04:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:48 smithi044 bash[22676]: cluster 2024-09-20T23:04:48.454826+0000 mgr.a (mgr.14388) 2173 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:04:51.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:51.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:51.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:51 smithi179 bash[23186]: cluster 2024-09-20T23:04:50.456836+0000 mgr.a (mgr.14388) 2174 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:51 smithi049 bash[23528]: cluster 2024-09-20T23:04:50.456836+0000 mgr.a (mgr.14388) 2174 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:51.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:51.979 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:51 smithi044 bash[22676]: cluster 2024-09-20T23:04:50.456836+0000 mgr.a (mgr.14388) 2174 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:52 smithi049 bash[23528]: audit 2024-09-20T23:04:51.566259+0000 mgr.a (mgr.14388) 2175 : audit [DBG] from='client.59016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:52 smithi049 bash[23528]: cluster 2024-09-20T23:04:52.457798+0000 mgr.a (mgr.14388) 2176 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:52 smithi044 bash[22676]: audit 2024-09-20T23:04:51.566259+0000 mgr.a (mgr.14388) 2175 : audit [DBG] from='client.59016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:52 smithi044 bash[22676]: cluster 2024-09-20T23:04:52.457798+0000 mgr.a (mgr.14388) 2176 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:52 smithi179 bash[23186]: audit 2024-09-20T23:04:51.566259+0000 mgr.a (mgr.14388) 2175 : audit [DBG] from='client.59016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:52 smithi179 bash[23186]: cluster 2024-09-20T23:04:52.457798+0000 mgr.a (mgr.14388) 2176 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:55 smithi049 bash[23528]: cluster 2024-09-20T23:04:54.458602+0000 mgr.a (mgr.14388) 2177 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:55.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:55 smithi179 bash[23186]: cluster 2024-09-20T23:04:54.458602+0000 mgr.a (mgr.14388) 2177 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:55 smithi044 bash[22676]: cluster 2024-09-20T23:04:54.458602+0000 mgr.a (mgr.14388) 2177 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:56 smithi049 bash[23528]: cluster 2024-09-20T23:04:56.460808+0000 mgr.a (mgr.14388) 2178 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:56.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:04:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:04:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:04:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:56 smithi044 bash[22676]: cluster 2024-09-20T23:04:56.460808+0000 mgr.a (mgr.14388) 2178 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:56 smithi179 bash[23186]: cluster 2024-09-20T23:04:56.460808+0000 mgr.a (mgr.14388) 2178 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:04:57.778 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:04:57.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:04:57.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:04:57.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:04:57.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:04:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:57 smithi049 bash[23528]: audit 2024-09-20T23:04:57.320641+0000 mgr.a (mgr.14388) 2179 : audit [DBG] from='client.59091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:57 smithi044 bash[22676]: audit 2024-09-20T23:04:57.320641+0000 mgr.a (mgr.14388) 2179 : audit [DBG] from='client.59091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:57 smithi179 bash[23186]: audit 2024-09-20T23:04:57.320641+0000 mgr.a (mgr.14388) 2179 : audit [DBG] from='client.59091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:04:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:04:58 smithi049 bash[23528]: cluster 2024-09-20T23:04:58.461751+0000 mgr.a (mgr.14388) 2180 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:04:58 smithi044 bash[22676]: cluster 2024-09-20T23:04:58.461751+0000 mgr.a (mgr.14388) 2180 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:04:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:04:58 smithi179 bash[23186]: cluster 2024-09-20T23:04:58.461751+0000 mgr.a (mgr.14388) 2180 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:00 smithi044 bash[22676]: cluster 2024-09-20T23:05:00.463888+0000 mgr.a (mgr.14388) 2181 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:00 smithi179 bash[23186]: cluster 2024-09-20T23:05:00.463888+0000 mgr.a (mgr.14388) 2181 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:00 smithi049 bash[23528]: cluster 2024-09-20T23:05:00.463888+0000 mgr.a (mgr.14388) 2181 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:02.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:02.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:02.929 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:02 smithi044 bash[22676]: cluster 2024-09-20T23:05:02.464647+0000 mgr.a (mgr.14388) 2182 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:02 smithi179 bash[23186]: cluster 2024-09-20T23:05:02.464647+0000 mgr.a (mgr.14388) 2182 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:02 smithi049 bash[23528]: cluster 2024-09-20T23:05:02.464647+0000 mgr.a (mgr.14388) 2182 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:03.551 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:03.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:03.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:03.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:03.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:03 smithi044 bash[22676]: audit 2024-09-20T23:05:03.123573+0000 mgr.a (mgr.14388) 2183 : audit [DBG] from='client.59163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:03 smithi179 bash[23186]: audit 2024-09-20T23:05:03.123573+0000 mgr.a (mgr.14388) 2183 : audit [DBG] from='client.59163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:03 smithi049 bash[23528]: audit 2024-09-20T23:05:03.123573+0000 mgr.a (mgr.14388) 2183 : audit [DBG] from='client.59163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:04 smithi044 bash[22676]: cluster 2024-09-20T23:05:04.465621+0000 mgr.a (mgr.14388) 2184 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:04 smithi179 bash[23186]: cluster 2024-09-20T23:05:04.465621+0000 mgr.a (mgr.14388) 2184 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:04 smithi049 bash[23528]: cluster 2024-09-20T23:05:04.465621+0000 mgr.a (mgr.14388) 2184 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:07 smithi049 bash[23528]: audit 2024-09-20T23:05:06.006735+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:07 smithi049 bash[23528]: audit 2024-09-20T23:05:06.014603+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:07 smithi049 bash[23528]: audit 2024-09-20T23:05:06.031756+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:07 smithi049 bash[23528]: audit 2024-09-20T23:05:06.043289+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:07 smithi049 bash[23528]: audit 2024-09-20T23:05:06.050021+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:07 smithi049 bash[23528]: audit 2024-09-20T23:05:06.058352+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:07 smithi049 bash[23528]: cluster 2024-09-20T23:05:06.467855+0000 mgr.a (mgr.14388) 2185 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:07 smithi044 bash[22676]: audit 2024-09-20T23:05:06.006735+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:07 smithi044 bash[22676]: audit 2024-09-20T23:05:06.014603+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:07 smithi044 bash[22676]: audit 2024-09-20T23:05:06.031756+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:07 smithi044 bash[22676]: audit 2024-09-20T23:05:06.043289+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:07 smithi044 bash[22676]: audit 2024-09-20T23:05:06.050021+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:07 smithi044 bash[22676]: audit 2024-09-20T23:05:06.058352+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:07 smithi044 bash[22676]: cluster 2024-09-20T23:05:06.467855+0000 mgr.a (mgr.14388) 2185 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:07 smithi179 bash[23186]: audit 2024-09-20T23:05:06.006735+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:07 smithi179 bash[23186]: audit 2024-09-20T23:05:06.014603+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:07 smithi179 bash[23186]: audit 2024-09-20T23:05:06.031756+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:07 smithi179 bash[23186]: audit 2024-09-20T23:05:06.043289+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:07 smithi179 bash[23186]: audit 2024-09-20T23:05:06.050021+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:07 smithi179 bash[23186]: audit 2024-09-20T23:05:06.058352+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:07 smithi179 bash[23186]: cluster 2024-09-20T23:05:06.467855+0000 mgr.a (mgr.14388) 2185 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:08.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:08.554 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:08.554 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:09.336 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:09 smithi044 bash[22676]: audit 2024-09-20T23:05:08.210640+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:09 smithi044 bash[22676]: audit 2024-09-20T23:05:08.218162+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:09 smithi044 bash[22676]: audit 2024-09-20T23:05:08.228015+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:09 smithi044 bash[22676]: cluster 2024-09-20T23:05:08.468603+0000 mgr.a (mgr.14388) 2186 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:09 smithi179 bash[23186]: audit 2024-09-20T23:05:08.210640+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:09 smithi179 bash[23186]: audit 2024-09-20T23:05:08.218162+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:09 smithi179 bash[23186]: audit 2024-09-20T23:05:08.228015+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:09 smithi179 bash[23186]: cluster 2024-09-20T23:05:08.468603+0000 mgr.a (mgr.14388) 2186 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:09 smithi049 bash[23528]: audit 2024-09-20T23:05:08.210640+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:09 smithi049 bash[23528]: audit 2024-09-20T23:05:08.218162+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:09 smithi049 bash[23528]: audit 2024-09-20T23:05:08.228015+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:09 smithi049 bash[23528]: cluster 2024-09-20T23:05:08.468603+0000 mgr.a (mgr.14388) 2186 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:10.282 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:10 smithi179 bash[23186]: audit 2024-09-20T23:05:08.888980+0000 mgr.a (mgr.14388) 2187 : audit [DBG] from='client.59241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:10 smithi044 bash[22676]: audit 2024-09-20T23:05:08.888980+0000 mgr.a (mgr.14388) 2187 : audit [DBG] from='client.59241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:10 smithi049 bash[23528]: audit 2024-09-20T23:05:08.888980+0000 mgr.a (mgr.14388) 2187 : audit [DBG] from='client.59241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:11 smithi179 bash[23186]: cluster 2024-09-20T23:05:10.470964+0000 mgr.a (mgr.14388) 2188 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:11 smithi049 bash[23528]: cluster 2024-09-20T23:05:10.470964+0000 mgr.a (mgr.14388) 2188 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:11 smithi044 bash[22676]: cluster 2024-09-20T23:05:10.470964+0000 mgr.a (mgr.14388) 2188 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:12 smithi044 bash[22676]: cluster 2024-09-20T23:05:12.471763+0000 mgr.a (mgr.14388) 2189 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:12 smithi179 bash[23186]: cluster 2024-09-20T23:05:12.471763+0000 mgr.a (mgr.14388) 2189 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:12 smithi049 bash[23528]: cluster 2024-09-20T23:05:12.471763+0000 mgr.a (mgr.14388) 2189 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:14.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:14.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:14 smithi044 bash[22676]: cluster 2024-09-20T23:05:14.472216+0000 mgr.a (mgr.14388) 2190 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:14 smithi179 bash[23186]: cluster 2024-09-20T23:05:14.472216+0000 mgr.a (mgr.14388) 2190 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:14 smithi049 bash[23528]: cluster 2024-09-20T23:05:14.472216+0000 mgr.a (mgr.14388) 2190 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:15.120 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:15.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:15.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:15.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:15.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:15 smithi044 bash[22676]: audit 2024-09-20T23:05:14.675122+0000 mgr.a (mgr.14388) 2191 : audit [DBG] from='client.59319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:15 smithi179 bash[23186]: audit 2024-09-20T23:05:14.675122+0000 mgr.a (mgr.14388) 2191 : audit [DBG] from='client.59319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:15 smithi049 bash[23528]: audit 2024-09-20T23:05:14.675122+0000 mgr.a (mgr.14388) 2191 : audit [DBG] from='client.59319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:16 smithi044 bash[22676]: cluster 2024-09-20T23:05:16.474869+0000 mgr.a (mgr.14388) 2192 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:05:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:16 smithi179 bash[23186]: cluster 2024-09-20T23:05:16.474869+0000 mgr.a (mgr.14388) 2192 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:05:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:16 smithi049 bash[23528]: cluster 2024-09-20T23:05:16.474869+0000 mgr.a (mgr.14388) 2192 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:05:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:18 smithi044 bash[22676]: cluster 2024-09-20T23:05:18.475655+0000 mgr.a (mgr.14388) 2193 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:05:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:18 smithi179 bash[23186]: cluster 2024-09-20T23:05:18.475655+0000 mgr.a (mgr.14388) 2193 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:05:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:18 smithi049 bash[23528]: cluster 2024-09-20T23:05:18.475655+0000 mgr.a (mgr.14388) 2193 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:05:20.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:20.869 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:20.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:20 smithi044 bash[22676]: audit 2024-09-20T23:05:20.454581+0000 mgr.a (mgr.14388) 2194 : audit [DBG] from='client.59397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:20 smithi044 bash[22676]: cluster 2024-09-20T23:05:20.477994+0000 mgr.a (mgr.14388) 2195 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:20 smithi179 bash[23186]: audit 2024-09-20T23:05:20.454581+0000 mgr.a (mgr.14388) 2194 : audit [DBG] from='client.59397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:20 smithi179 bash[23186]: cluster 2024-09-20T23:05:20.477994+0000 mgr.a (mgr.14388) 2195 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:20 smithi049 bash[23528]: audit 2024-09-20T23:05:20.454581+0000 mgr.a (mgr.14388) 2194 : audit [DBG] from='client.59397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:20 smithi049 bash[23528]: cluster 2024-09-20T23:05:20.477994+0000 mgr.a (mgr.14388) 2195 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:22 smithi044 bash[22676]: cluster 2024-09-20T23:05:22.478833+0000 mgr.a (mgr.14388) 2196 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:05:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:22 smithi179 bash[23186]: cluster 2024-09-20T23:05:22.478833+0000 mgr.a (mgr.14388) 2196 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:05:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:22 smithi049 bash[23528]: cluster 2024-09-20T23:05:22.478833+0000 mgr.a (mgr.14388) 2196 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:05:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:24 smithi049 bash[23528]: cluster 2024-09-20T23:05:24.479731+0000 mgr.a (mgr.14388) 2197 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:05:24.828 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:24 smithi044 bash[22676]: cluster 2024-09-20T23:05:24.479731+0000 mgr.a (mgr.14388) 2197 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:05:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:24 smithi179 bash[23186]: cluster 2024-09-20T23:05:24.479731+0000 mgr.a (mgr.14388) 2197 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:05:25.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:25.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:25.872 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:26.636 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:26.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:26.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:26.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:26.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: audit 2024-09-20T23:05:26.190312+0000 mon.a (mon.0) 2472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: audit 2024-09-20T23:05:26.194076+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: audit 2024-09-20T23:05:26.206097+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: audit 2024-09-20T23:05:26.217874+0000 mgr.a (mgr.14388) 2198 : audit [DBG] from='client.59475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: audit 2024-09-20T23:05:26.247599+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: audit 2024-09-20T23:05:26.254557+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: audit 2024-09-20T23:05:26.262970+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:27 smithi044 bash[22676]: cluster 2024-09-20T23:05:26.481527+0000 mgr.a (mgr.14388) 2199 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: audit 2024-09-20T23:05:26.190312+0000 mon.a (mon.0) 2472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: audit 2024-09-20T23:05:26.194076+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: audit 2024-09-20T23:05:26.206097+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: audit 2024-09-20T23:05:26.217874+0000 mgr.a (mgr.14388) 2198 : audit [DBG] from='client.59475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: audit 2024-09-20T23:05:26.247599+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: audit 2024-09-20T23:05:26.254557+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: audit 2024-09-20T23:05:26.262970+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:27 smithi179 bash[23186]: cluster 2024-09-20T23:05:26.481527+0000 mgr.a (mgr.14388) 2199 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: audit 2024-09-20T23:05:26.190312+0000 mon.a (mon.0) 2472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: audit 2024-09-20T23:05:26.194076+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: audit 2024-09-20T23:05:26.206097+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: audit 2024-09-20T23:05:26.217874+0000 mgr.a (mgr.14388) 2198 : audit [DBG] from='client.59475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: audit 2024-09-20T23:05:26.247599+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: audit 2024-09-20T23:05:26.254557+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: audit 2024-09-20T23:05:26.262970+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:27 smithi049 bash[23528]: cluster 2024-09-20T23:05:26.481527+0000 mgr.a (mgr.14388) 2199 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:29 smithi044 bash[22676]: audit 2024-09-20T23:05:28.446891+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:29 smithi044 bash[22676]: audit 2024-09-20T23:05:28.454095+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:29 smithi044 bash[22676]: audit 2024-09-20T23:05:28.463139+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:29 smithi044 bash[22676]: cluster 2024-09-20T23:05:28.482412+0000 mgr.a (mgr.14388) 2200 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:05:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:29 smithi179 bash[23186]: audit 2024-09-20T23:05:28.446891+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:29 smithi179 bash[23186]: audit 2024-09-20T23:05:28.454095+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:29 smithi179 bash[23186]: audit 2024-09-20T23:05:28.463139+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:29 smithi179 bash[23186]: cluster 2024-09-20T23:05:28.482412+0000 mgr.a (mgr.14388) 2200 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:05:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:29 smithi049 bash[23528]: audit 2024-09-20T23:05:28.446891+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:29 smithi049 bash[23528]: audit 2024-09-20T23:05:28.454095+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:29 smithi049 bash[23528]: audit 2024-09-20T23:05:28.463139+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:29 smithi049 bash[23528]: cluster 2024-09-20T23:05:28.482412+0000 mgr.a (mgr.14388) 2200 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:05:30.868 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:30 smithi179 bash[23186]: cluster 2024-09-20T23:05:30.484577+0000 mgr.a (mgr.14388) 2201 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:05:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:30 smithi044 bash[22676]: cluster 2024-09-20T23:05:30.484577+0000 mgr.a (mgr.14388) 2201 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:05:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:30 smithi049 bash[23528]: cluster 2024-09-20T23:05:30.484577+0000 mgr.a (mgr.14388) 2201 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:05:31.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:31.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:31.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:32 smithi179 bash[23186]: audit 2024-09-20T23:05:31.979234+0000 mgr.a (mgr.14388) 2202 : audit [DBG] from='client.59553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:32 smithi179 bash[23186]: cluster 2024-09-20T23:05:32.485397+0000 mgr.a (mgr.14388) 2203 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:32 smithi044 bash[22676]: audit 2024-09-20T23:05:31.979234+0000 mgr.a (mgr.14388) 2202 : audit [DBG] from='client.59553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:32 smithi044 bash[22676]: cluster 2024-09-20T23:05:32.485397+0000 mgr.a (mgr.14388) 2203 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:32 smithi049 bash[23528]: audit 2024-09-20T23:05:31.979234+0000 mgr.a (mgr.14388) 2202 : audit [DBG] from='client.59553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:32 smithi049 bash[23528]: cluster 2024-09-20T23:05:32.485397+0000 mgr.a (mgr.14388) 2203 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:34 smithi044 bash[22676]: cluster 2024-09-20T23:05:34.486117+0000 mgr.a (mgr.14388) 2204 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:34 smithi179 bash[23186]: cluster 2024-09-20T23:05:34.486117+0000 mgr.a (mgr.14388) 2204 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:34 smithi049 bash[23528]: cluster 2024-09-20T23:05:34.486117+0000 mgr.a (mgr.14388) 2204 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:36 smithi044 bash[22676]: cluster 2024-09-20T23:05:36.488269+0000 mgr.a (mgr.14388) 2205 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:36 smithi179 bash[23186]: cluster 2024-09-20T23:05:36.488269+0000 mgr.a (mgr.14388) 2205 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:36 smithi049 bash[23528]: cluster 2024-09-20T23:05:36.488269+0000 mgr.a (mgr.14388) 2205 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:37.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:37.409 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:37.409 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:38.163 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:38.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:38.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:38.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:38.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:38 smithi044 bash[22676]: audit 2024-09-20T23:05:37.740812+0000 mgr.a (mgr.14388) 2206 : audit [DBG] from='client.59631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:38 smithi044 bash[22676]: cluster 2024-09-20T23:05:38.489137+0000 mgr.a (mgr.14388) 2207 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:38 smithi179 bash[23186]: audit 2024-09-20T23:05:37.740812+0000 mgr.a (mgr.14388) 2206 : audit [DBG] from='client.59631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:38 smithi179 bash[23186]: cluster 2024-09-20T23:05:38.489137+0000 mgr.a (mgr.14388) 2207 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:38 smithi049 bash[23528]: audit 2024-09-20T23:05:37.740812+0000 mgr.a (mgr.14388) 2206 : audit [DBG] from='client.59631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:38 smithi049 bash[23528]: cluster 2024-09-20T23:05:38.489137+0000 mgr.a (mgr.14388) 2207 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:40 smithi044 bash[22676]: cluster 2024-09-20T23:05:40.491272+0000 mgr.a (mgr.14388) 2208 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:40 smithi179 bash[23186]: cluster 2024-09-20T23:05:40.491272+0000 mgr.a (mgr.14388) 2208 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:40 smithi049 bash[23528]: cluster 2024-09-20T23:05:40.491272+0000 mgr.a (mgr.14388) 2208 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:05:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:42 smithi044 bash[22676]: cluster 2024-09-20T23:05:42.492020+0000 mgr.a (mgr.14388) 2209 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:42 smithi179 bash[23186]: cluster 2024-09-20T23:05:42.492020+0000 mgr.a (mgr.14388) 2209 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:42 smithi049 bash[23528]: cluster 2024-09-20T23:05:42.492020+0000 mgr.a (mgr.14388) 2209 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:43.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:43.164 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:43.164 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:43.956 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22930]: debug 2024-09-20T23:05:43.585+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:05:43.956 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22930]: debug 2024-09-20T23:05:43.597+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:05:43.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22676]: audit 2024-09-20T23:05:42.800769+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:05:43.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22676]: audit 2024-09-20T23:05:42.807705+0000 mon.a (mon.0) 2482 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:05:43.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22676]: audit 2024-09-20T23:05:42.809865+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:05:43.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22676]: audit 2024-09-20T23:05:42.821480+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:43.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22676]: audit 2024-09-20T23:05:42.828502+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:05:43.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22676]: audit 2024-09-20T23:05:42.830921+0000 mgr.a (mgr.14388) 2210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:05:43.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:43 smithi044 bash[22676]: audit 2024-09-20T23:05:43.503880+0000 mgr.a (mgr.14388) 2211 : audit [DBG] from='client.59769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:44.000 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:44.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:44.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:44.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:44.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:43 smithi179 bash[23186]: audit 2024-09-20T23:05:42.800769+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:05:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:43 smithi179 bash[23186]: audit 2024-09-20T23:05:42.807705+0000 mon.a (mon.0) 2482 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:05:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:43 smithi179 bash[23186]: audit 2024-09-20T23:05:42.809865+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:05:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:43 smithi179 bash[23186]: audit 2024-09-20T23:05:42.821480+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:43 smithi179 bash[23186]: audit 2024-09-20T23:05:42.828502+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:05:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:43 smithi179 bash[23186]: audit 2024-09-20T23:05:42.830921+0000 mgr.a (mgr.14388) 2210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:05:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:43 smithi179 bash[23186]: audit 2024-09-20T23:05:43.503880+0000 mgr.a (mgr.14388) 2211 : audit [DBG] from='client.59769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:43 smithi049 bash[23528]: audit 2024-09-20T23:05:42.800769+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:43 smithi049 bash[23528]: audit 2024-09-20T23:05:42.807705+0000 mon.a (mon.0) 2482 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:43 smithi049 bash[23528]: audit 2024-09-20T23:05:42.809865+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:43 smithi049 bash[23528]: audit 2024-09-20T23:05:42.821480+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:43 smithi049 bash[23528]: audit 2024-09-20T23:05:42.828502+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:43 smithi049 bash[23528]: audit 2024-09-20T23:05:42.830921+0000 mgr.a (mgr.14388) 2210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:43 smithi049 bash[23528]: audit 2024-09-20T23:05:43.503880+0000 mgr.a (mgr.14388) 2211 : audit [DBG] from='client.59769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:44 smithi049 bash[23528]: audit 2024-09-20T23:05:43.592128+0000 mgr.a (mgr.14388) 2212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:05:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:44 smithi049 bash[23528]: cephadm 2024-09-20T23:05:43.603027+0000 mgr.a (mgr.14388) 2213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:05:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:44 smithi049 bash[23528]: cluster 2024-09-20T23:05:44.492938+0000 mgr.a (mgr.14388) 2214 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:44.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:44 smithi044 bash[22676]: audit 2024-09-20T23:05:43.592128+0000 mgr.a (mgr.14388) 2212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:05:44.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:44 smithi044 bash[22676]: cephadm 2024-09-20T23:05:43.603027+0000 mgr.a (mgr.14388) 2213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:05:44.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:44 smithi044 bash[22676]: cluster 2024-09-20T23:05:44.492938+0000 mgr.a (mgr.14388) 2214 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:44 smithi179 bash[23186]: audit 2024-09-20T23:05:43.592128+0000 mgr.a (mgr.14388) 2212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:05:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:44 smithi179 bash[23186]: cephadm 2024-09-20T23:05:43.603027+0000 mgr.a (mgr.14388) 2213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:05:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:44 smithi179 bash[23186]: cluster 2024-09-20T23:05:44.492938+0000 mgr.a (mgr.14388) 2214 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:47 smithi044 bash[22676]: audit 2024-09-20T23:05:46.398486+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:47 smithi044 bash[22676]: audit 2024-09-20T23:05:46.409085+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:47 smithi044 bash[22676]: audit 2024-09-20T23:05:46.423039+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:47 smithi044 bash[22676]: audit 2024-09-20T23:05:46.431767+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:47 smithi044 bash[22676]: audit 2024-09-20T23:05:46.441808+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:47 smithi044 bash[22676]: audit 2024-09-20T23:05:46.453552+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:47 smithi044 bash[22676]: cluster 2024-09-20T23:05:46.495188+0000 mgr.a (mgr.14388) 2215 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:05:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:47 smithi049 bash[23528]: audit 2024-09-20T23:05:46.398486+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:47 smithi049 bash[23528]: audit 2024-09-20T23:05:46.409085+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:47 smithi049 bash[23528]: audit 2024-09-20T23:05:46.423039+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:47 smithi049 bash[23528]: audit 2024-09-20T23:05:46.431767+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:47 smithi049 bash[23528]: audit 2024-09-20T23:05:46.441808+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:47 smithi049 bash[23528]: audit 2024-09-20T23:05:46.453552+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:47 smithi049 bash[23528]: cluster 2024-09-20T23:05:46.495188+0000 mgr.a (mgr.14388) 2215 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:05:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:47 smithi179 bash[23186]: audit 2024-09-20T23:05:46.398486+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:47 smithi179 bash[23186]: audit 2024-09-20T23:05:46.409085+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:47 smithi179 bash[23186]: audit 2024-09-20T23:05:46.423039+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:47 smithi179 bash[23186]: audit 2024-09-20T23:05:46.431767+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:47 smithi179 bash[23186]: audit 2024-09-20T23:05:46.441808+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:47 smithi179 bash[23186]: audit 2024-09-20T23:05:46.453552+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:47 smithi179 bash[23186]: cluster 2024-09-20T23:05:46.495188+0000 mgr.a (mgr.14388) 2215 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:05:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:48 smithi044 bash[22676]: cluster 2024-09-20T23:05:48.495980+0000 mgr.a (mgr.14388) 2216 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:05:49.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:49.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:49.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:48 smithi179 bash[23186]: cluster 2024-09-20T23:05:48.495980+0000 mgr.a (mgr.14388) 2216 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:05:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:48 smithi049 bash[23528]: cluster 2024-09-20T23:05:48.495980+0000 mgr.a (mgr.14388) 2216 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:05:49.772 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:49 smithi044 bash[22676]: audit 2024-09-20T23:05:48.627485+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:49 smithi044 bash[22676]: audit 2024-09-20T23:05:48.635575+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:49 smithi044 bash[22676]: audit 2024-09-20T23:05:48.645083+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:49 smithi044 bash[22676]: audit 2024-09-20T23:05:49.337771+0000 mgr.a (mgr.14388) 2217 : audit [DBG] from='client.59892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:49 smithi179 bash[23186]: audit 2024-09-20T23:05:48.627485+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:49 smithi179 bash[23186]: audit 2024-09-20T23:05:48.635575+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:49 smithi179 bash[23186]: audit 2024-09-20T23:05:48.645083+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:49 smithi179 bash[23186]: audit 2024-09-20T23:05:49.337771+0000 mgr.a (mgr.14388) 2217 : audit [DBG] from='client.59892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:49 smithi049 bash[23528]: audit 2024-09-20T23:05:48.627485+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:49 smithi049 bash[23528]: audit 2024-09-20T23:05:48.635575+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:49 smithi049 bash[23528]: audit 2024-09-20T23:05:48.645083+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:05:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:49 smithi049 bash[23528]: audit 2024-09-20T23:05:49.337771+0000 mgr.a (mgr.14388) 2217 : audit [DBG] from='client.59892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:50 smithi044 bash[22676]: cluster 2024-09-20T23:05:50.498576+0000 mgr.a (mgr.14388) 2218 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 21 op/s 2024-09-20T23:05:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:50 smithi179 bash[23186]: cluster 2024-09-20T23:05:50.498576+0000 mgr.a (mgr.14388) 2218 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 21 op/s 2024-09-20T23:05:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:50 smithi049 bash[23528]: cluster 2024-09-20T23:05:50.498576+0000 mgr.a (mgr.14388) 2218 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 21 op/s 2024-09-20T23:05:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:52 smithi179 bash[23186]: cluster 2024-09-20T23:05:52.499349+0000 mgr.a (mgr.14388) 2219 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 426 B/s wr, 20 op/s 2024-09-20T23:05:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:52 smithi044 bash[22676]: cluster 2024-09-20T23:05:52.499349+0000 mgr.a (mgr.14388) 2219 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 426 B/s wr, 20 op/s 2024-09-20T23:05:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:52 smithi049 bash[23528]: cluster 2024-09-20T23:05:52.499349+0000 mgr.a (mgr.14388) 2219 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 426 B/s wr, 20 op/s 2024-09-20T23:05:54.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:05:54.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:05:54.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:05:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:54 smithi044 bash[22676]: cluster 2024-09-20T23:05:54.500133+0000 mgr.a (mgr.14388) 2220 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 426 B/s wr, 20 op/s 2024-09-20T23:05:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:54 smithi179 bash[23186]: cluster 2024-09-20T23:05:54.500133+0000 mgr.a (mgr.14388) 2220 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 426 B/s wr, 20 op/s 2024-09-20T23:05:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:54 smithi049 bash[23528]: cluster 2024-09-20T23:05:54.500133+0000 mgr.a (mgr.14388) 2220 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 426 B/s wr, 20 op/s 2024-09-20T23:05:55.515 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:05:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:05:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:05:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:05:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:05:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:55 smithi044 bash[22676]: audit 2024-09-20T23:05:55.101390+0000 mgr.a (mgr.14388) 2221 : audit [DBG] from='client.59970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:55 smithi179 bash[23186]: audit 2024-09-20T23:05:55.101390+0000 mgr.a (mgr.14388) 2221 : audit [DBG] from='client.59970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:55 smithi049 bash[23528]: audit 2024-09-20T23:05:55.101390+0000 mgr.a (mgr.14388) 2221 : audit [DBG] from='client.59970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:05:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:56 smithi044 bash[22676]: cluster 2024-09-20T23:05:56.502844+0000 mgr.a (mgr.14388) 2222 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-20T23:05:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:56 smithi179 bash[23186]: cluster 2024-09-20T23:05:56.502844+0000 mgr.a (mgr.14388) 2222 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-20T23:05:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:56 smithi049 bash[23528]: cluster 2024-09-20T23:05:56.502844+0000 mgr.a (mgr.14388) 2222 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-20T23:05:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:05:58 smithi044 bash[22676]: cluster 2024-09-20T23:05:58.503642+0000 mgr.a (mgr.14388) 2223 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T23:05:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:05:58 smithi179 bash[23186]: cluster 2024-09-20T23:05:58.503642+0000 mgr.a (mgr.14388) 2223 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T23:05:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:05:58 smithi049 bash[23528]: cluster 2024-09-20T23:05:58.503642+0000 mgr.a (mgr.14388) 2223 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T23:06:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:00 smithi044 bash[22676]: cluster 2024-09-20T23:06:00.505611+0000 mgr.a (mgr.14388) 2224 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T23:06:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:00 smithi179 bash[23186]: cluster 2024-09-20T23:06:00.505611+0000 mgr.a (mgr.14388) 2224 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T23:06:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:00 smithi049 bash[23528]: cluster 2024-09-20T23:06:00.505611+0000 mgr.a (mgr.14388) 2224 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-20T23:06:01.291 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:01.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:01.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:01.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:01.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:01 smithi044 bash[22676]: audit 2024-09-20T23:06:00.853370+0000 mgr.a (mgr.14388) 2225 : audit [DBG] from='client.60048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:01 smithi179 bash[23186]: audit 2024-09-20T23:06:00.853370+0000 mgr.a (mgr.14388) 2225 : audit [DBG] from='client.60048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:01 smithi049 bash[23528]: audit 2024-09-20T23:06:00.853370+0000 mgr.a (mgr.14388) 2225 : audit [DBG] from='client.60048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:02 smithi044 bash[22676]: cluster 2024-09-20T23:06:02.506600+0000 mgr.a (mgr.14388) 2226 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-20T23:06:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:02 smithi179 bash[23186]: cluster 2024-09-20T23:06:02.506600+0000 mgr.a (mgr.14388) 2226 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-20T23:06:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:02 smithi049 bash[23528]: cluster 2024-09-20T23:06:02.506600+0000 mgr.a (mgr.14388) 2226 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-20T23:06:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:04 smithi044 bash[22676]: cluster 2024-09-20T23:06:04.507426+0000 mgr.a (mgr.14388) 2227 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-20T23:06:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:04 smithi179 bash[23186]: cluster 2024-09-20T23:06:04.507426+0000 mgr.a (mgr.14388) 2227 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-20T23:06:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:04 smithi049 bash[23528]: cluster 2024-09-20T23:06:04.507426+0000 mgr.a (mgr.14388) 2227 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-20T23:06:06.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:06.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:06 smithi049 bash[23528]: cluster 2024-09-20T23:06:06.509602+0000 mgr.a (mgr.14388) 2228 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:06:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:06 smithi044 bash[22676]: cluster 2024-09-20T23:06:06.509602+0000 mgr.a (mgr.14388) 2228 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:06:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:06 smithi179 bash[23186]: cluster 2024-09-20T23:06:06.509602+0000 mgr.a (mgr.14388) 2228 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:06:07.075 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:07 smithi044 bash[22676]: audit 2024-09-20T23:06:06.631607+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:07 smithi044 bash[22676]: audit 2024-09-20T23:06:06.644002+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:07 smithi044 bash[22676]: audit 2024-09-20T23:06:06.657042+0000 mgr.a (mgr.14388) 2229 : audit [DBG] from='client.60126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:07 smithi044 bash[22676]: audit 2024-09-20T23:06:06.657494+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:07 smithi044 bash[22676]: audit 2024-09-20T23:06:06.683738+0000 mon.a (mon.0) 2498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:07 smithi044 bash[22676]: audit 2024-09-20T23:06:06.694105+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:07 smithi044 bash[22676]: audit 2024-09-20T23:06:06.703391+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:07 smithi179 bash[23186]: audit 2024-09-20T23:06:06.631607+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:07 smithi179 bash[23186]: audit 2024-09-20T23:06:06.644002+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:07 smithi179 bash[23186]: audit 2024-09-20T23:06:06.657042+0000 mgr.a (mgr.14388) 2229 : audit [DBG] from='client.60126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:07 smithi179 bash[23186]: audit 2024-09-20T23:06:06.657494+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:07 smithi179 bash[23186]: audit 2024-09-20T23:06:06.683738+0000 mon.a (mon.0) 2498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:07 smithi179 bash[23186]: audit 2024-09-20T23:06:06.694105+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:07 smithi179 bash[23186]: audit 2024-09-20T23:06:06.703391+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:07 smithi049 bash[23528]: audit 2024-09-20T23:06:06.631607+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:07 smithi049 bash[23528]: audit 2024-09-20T23:06:06.644002+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:07 smithi049 bash[23528]: audit 2024-09-20T23:06:06.657042+0000 mgr.a (mgr.14388) 2229 : audit [DBG] from='client.60126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:07 smithi049 bash[23528]: audit 2024-09-20T23:06:06.657494+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:07 smithi049 bash[23528]: audit 2024-09-20T23:06:06.683738+0000 mon.a (mon.0) 2498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:07 smithi049 bash[23528]: audit 2024-09-20T23:06:06.694105+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:07 smithi049 bash[23528]: audit 2024-09-20T23:06:06.703391+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:08 smithi044 bash[22676]: cluster 2024-09-20T23:06:08.510697+0000 mgr.a (mgr.14388) 2230 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:08 smithi179 bash[23186]: cluster 2024-09-20T23:06:08.510697+0000 mgr.a (mgr.14388) 2230 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:08 smithi049 bash[23528]: cluster 2024-09-20T23:06:08.510697+0000 mgr.a (mgr.14388) 2230 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:09 smithi044 bash[22676]: audit 2024-09-20T23:06:08.821957+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:09 smithi044 bash[22676]: audit 2024-09-20T23:06:08.830588+0000 mon.a (mon.0) 2502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:09 smithi044 bash[22676]: audit 2024-09-20T23:06:08.840278+0000 mon.a (mon.0) 2503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:09 smithi179 bash[23186]: audit 2024-09-20T23:06:08.821957+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:09 smithi179 bash[23186]: audit 2024-09-20T23:06:08.830588+0000 mon.a (mon.0) 2502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:09 smithi179 bash[23186]: audit 2024-09-20T23:06:08.840278+0000 mon.a (mon.0) 2503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:09 smithi049 bash[23528]: audit 2024-09-20T23:06:08.821957+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:09 smithi049 bash[23528]: audit 2024-09-20T23:06:08.830588+0000 mon.a (mon.0) 2502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:09 smithi049 bash[23528]: audit 2024-09-20T23:06:08.840278+0000 mon.a (mon.0) 2503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:10 smithi044 bash[22676]: cluster 2024-09-20T23:06:10.512992+0000 mgr.a (mgr.14388) 2231 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:10 smithi179 bash[23186]: cluster 2024-09-20T23:06:10.512992+0000 mgr.a (mgr.14388) 2231 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:10 smithi049 bash[23528]: cluster 2024-09-20T23:06:10.512992+0000 mgr.a (mgr.14388) 2231 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:12.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:12.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:12.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:12 smithi179 bash[23186]: audit 2024-09-20T23:06:12.405682+0000 mgr.a (mgr.14388) 2232 : audit [DBG] from='client.60201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:12 smithi179 bash[23186]: cluster 2024-09-20T23:06:12.513532+0000 mgr.a (mgr.14388) 2233 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:12.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:12.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:12.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:12.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:12.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:12 smithi044 bash[22676]: audit 2024-09-20T23:06:12.405682+0000 mgr.a (mgr.14388) 2232 : audit [DBG] from='client.60201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:12 smithi044 bash[22676]: cluster 2024-09-20T23:06:12.513532+0000 mgr.a (mgr.14388) 2233 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:12 smithi049 bash[23528]: audit 2024-09-20T23:06:12.405682+0000 mgr.a (mgr.14388) 2232 : audit [DBG] from='client.60201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:12 smithi049 bash[23528]: cluster 2024-09-20T23:06:12.513532+0000 mgr.a (mgr.14388) 2233 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:14.923 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:14 smithi179 bash[23186]: cluster 2024-09-20T23:06:14.514470+0000 mgr.a (mgr.14388) 2234 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:14 smithi044 bash[22676]: cluster 2024-09-20T23:06:14.514470+0000 mgr.a (mgr.14388) 2234 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:14 smithi049 bash[23528]: cluster 2024-09-20T23:06:14.514470+0000 mgr.a (mgr.14388) 2234 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:16 smithi044 bash[22676]: cluster 2024-09-20T23:06:16.516681+0000 mgr.a (mgr.14388) 2235 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:16 smithi179 bash[23186]: cluster 2024-09-20T23:06:16.516681+0000 mgr.a (mgr.14388) 2235 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:16 smithi049 bash[23528]: cluster 2024-09-20T23:06:16.516681+0000 mgr.a (mgr.14388) 2235 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:17.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:17.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:17.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:18.622 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:18.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:18.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:18.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:18.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:18 smithi179 bash[23186]: audit 2024-09-20T23:06:18.170952+0000 mgr.a (mgr.14388) 2236 : audit [DBG] from='client.60279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:18 smithi179 bash[23186]: cluster 2024-09-20T23:06:18.519314+0000 mgr.a (mgr.14388) 2237 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:18 smithi044 bash[22676]: audit 2024-09-20T23:06:18.170952+0000 mgr.a (mgr.14388) 2236 : audit [DBG] from='client.60279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:18 smithi044 bash[22676]: cluster 2024-09-20T23:06:18.519314+0000 mgr.a (mgr.14388) 2237 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:18 smithi049 bash[23528]: audit 2024-09-20T23:06:18.170952+0000 mgr.a (mgr.14388) 2236 : audit [DBG] from='client.60279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:18 smithi049 bash[23528]: cluster 2024-09-20T23:06:18.519314+0000 mgr.a (mgr.14388) 2237 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:20 smithi044 bash[22676]: cluster 2024-09-20T23:06:20.521564+0000 mgr.a (mgr.14388) 2238 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:20 smithi179 bash[23186]: cluster 2024-09-20T23:06:20.521564+0000 mgr.a (mgr.14388) 2238 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:20 smithi049 bash[23528]: cluster 2024-09-20T23:06:20.521564+0000 mgr.a (mgr.14388) 2238 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:22 smithi044 bash[22676]: cluster 2024-09-20T23:06:22.522380+0000 mgr.a (mgr.14388) 2239 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:22 smithi179 bash[23186]: cluster 2024-09-20T23:06:22.522380+0000 mgr.a (mgr.14388) 2239 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:22 smithi049 bash[23528]: cluster 2024-09-20T23:06:22.522380+0000 mgr.a (mgr.14388) 2239 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:24.378 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:24.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:24.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:24.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:24.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:24 smithi044 bash[22676]: audit 2024-09-20T23:06:23.958034+0000 mgr.a (mgr.14388) 2240 : audit [DBG] from='client.60357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:24 smithi044 bash[22676]: cluster 2024-09-20T23:06:24.523321+0000 mgr.a (mgr.14388) 2241 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:24 smithi179 bash[23186]: audit 2024-09-20T23:06:23.958034+0000 mgr.a (mgr.14388) 2240 : audit [DBG] from='client.60357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:24 smithi179 bash[23186]: cluster 2024-09-20T23:06:24.523321+0000 mgr.a (mgr.14388) 2241 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:24 smithi049 bash[23528]: audit 2024-09-20T23:06:23.958034+0000 mgr.a (mgr.14388) 2240 : audit [DBG] from='client.60357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:24 smithi049 bash[23528]: cluster 2024-09-20T23:06:24.523321+0000 mgr.a (mgr.14388) 2241 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:26.713 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:26 smithi044 bash[22676]: cluster 2024-09-20T23:06:26.525527+0000 mgr.a (mgr.14388) 2242 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:26 smithi049 bash[23528]: cluster 2024-09-20T23:06:26.525527+0000 mgr.a (mgr.14388) 2242 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:26.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:26 smithi179 bash[23186]: cluster 2024-09-20T23:06:26.525527+0000 mgr.a (mgr.14388) 2242 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:06:28.179 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:27 smithi049 bash[23528]: audit 2024-09-20T23:06:26.862327+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.180 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:27 smithi049 bash[23528]: audit 2024-09-20T23:06:26.867743+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.180 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:27 smithi049 bash[23528]: audit 2024-09-20T23:06:26.873196+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.180 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:27 smithi049 bash[23528]: audit 2024-09-20T23:06:26.888287+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.180 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:27 smithi049 bash[23528]: audit 2024-09-20T23:06:26.892894+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.180 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:27 smithi049 bash[23528]: audit 2024-09-20T23:06:26.897845+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:27 smithi044 bash[22676]: audit 2024-09-20T23:06:26.862327+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:27 smithi044 bash[22676]: audit 2024-09-20T23:06:26.867743+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:27 smithi044 bash[22676]: audit 2024-09-20T23:06:26.873196+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:27 smithi044 bash[22676]: audit 2024-09-20T23:06:26.888287+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:27 smithi044 bash[22676]: audit 2024-09-20T23:06:26.892894+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:27 smithi044 bash[22676]: audit 2024-09-20T23:06:26.897845+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:27 smithi179 bash[23186]: audit 2024-09-20T23:06:26.862327+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:27 smithi179 bash[23186]: audit 2024-09-20T23:06:26.867743+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:27 smithi179 bash[23186]: audit 2024-09-20T23:06:26.873196+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:27 smithi179 bash[23186]: audit 2024-09-20T23:06:26.888287+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:27 smithi179 bash[23186]: audit 2024-09-20T23:06:26.892894+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:27 smithi179 bash[23186]: audit 2024-09-20T23:06:26.897845+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:29.158 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:28 smithi044 bash[22676]: cluster 2024-09-20T23:06:28.526089+0000 mgr.a (mgr.14388) 2243 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:28 smithi179 bash[23186]: cluster 2024-09-20T23:06:28.526089+0000 mgr.a (mgr.14388) 2243 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:28 smithi049 bash[23528]: cluster 2024-09-20T23:06:28.526089+0000 mgr.a (mgr.14388) 2243 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:29.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:29.380 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:29.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:29 smithi044 bash[22676]: audit 2024-09-20T23:06:28.973297+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:29 smithi044 bash[22676]: audit 2024-09-20T23:06:28.979722+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:29 smithi044 bash[22676]: audit 2024-09-20T23:06:28.985893+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:29 smithi179 bash[23186]: audit 2024-09-20T23:06:28.973297+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:29 smithi179 bash[23186]: audit 2024-09-20T23:06:28.979722+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:29 smithi179 bash[23186]: audit 2024-09-20T23:06:28.985893+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:29 smithi049 bash[23528]: audit 2024-09-20T23:06:28.973297+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:29 smithi049 bash[23528]: audit 2024-09-20T23:06:28.979722+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:29 smithi049 bash[23528]: audit 2024-09-20T23:06:28.985893+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:30 smithi044 bash[22676]: audit 2024-09-20T23:06:29.720510+0000 mgr.a (mgr.14388) 2244 : audit [DBG] from='client.60435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:30 smithi044 bash[22676]: cluster 2024-09-20T23:06:30.528906+0000 mgr.a (mgr.14388) 2245 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:30 smithi179 bash[23186]: audit 2024-09-20T23:06:29.720510+0000 mgr.a (mgr.14388) 2244 : audit [DBG] from='client.60435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:30 smithi179 bash[23186]: cluster 2024-09-20T23:06:30.528906+0000 mgr.a (mgr.14388) 2245 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:30 smithi049 bash[23528]: audit 2024-09-20T23:06:29.720510+0000 mgr.a (mgr.14388) 2244 : audit [DBG] from='client.60435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:30 smithi049 bash[23528]: cluster 2024-09-20T23:06:30.528906+0000 mgr.a (mgr.14388) 2245 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:32 smithi179 bash[23186]: cluster 2024-09-20T23:06:32.529743+0000 mgr.a (mgr.14388) 2246 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:06:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:32 smithi044 bash[22676]: cluster 2024-09-20T23:06:32.529743+0000 mgr.a (mgr.14388) 2246 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:06:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:32 smithi049 bash[23528]: cluster 2024-09-20T23:06:32.529743+0000 mgr.a (mgr.14388) 2246 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:06:34.868 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:34 smithi179 bash[23186]: cluster 2024-09-20T23:06:34.530521+0000 mgr.a (mgr.14388) 2247 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:06:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:34 smithi044 bash[22676]: cluster 2024-09-20T23:06:34.530521+0000 mgr.a (mgr.14388) 2247 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:06:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:34 smithi049 bash[23528]: cluster 2024-09-20T23:06:34.530521+0000 mgr.a (mgr.14388) 2247 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:06:35.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:35.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:35.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:35 smithi179 bash[23186]: audit 2024-09-20T23:06:35.508454+0000 mgr.a (mgr.14388) 2248 : audit [DBG] from='client.60513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:35.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:35 smithi044 bash[22676]: audit 2024-09-20T23:06:35.508454+0000 mgr.a (mgr.14388) 2248 : audit [DBG] from='client.60513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:35 smithi049 bash[23528]: audit 2024-09-20T23:06:35.508454+0000 mgr.a (mgr.14388) 2248 : audit [DBG] from='client.60513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:37 smithi044 bash[22676]: cluster 2024-09-20T23:06:36.533419+0000 mgr.a (mgr.14388) 2249 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:37 smithi179 bash[23186]: cluster 2024-09-20T23:06:36.533419+0000 mgr.a (mgr.14388) 2249 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:37 smithi049 bash[23528]: cluster 2024-09-20T23:06:36.533419+0000 mgr.a (mgr.14388) 2249 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:39 smithi044 bash[22676]: cluster 2024-09-20T23:06:38.534205+0000 mgr.a (mgr.14388) 2250 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:39 smithi179 bash[23186]: cluster 2024-09-20T23:06:38.534205+0000 mgr.a (mgr.14388) 2250 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:39 smithi049 bash[23528]: cluster 2024-09-20T23:06:38.534205+0000 mgr.a (mgr.14388) 2250 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:06:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:40.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:40.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:41.752 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:41.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:41.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:41.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:41.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:41 smithi044 bash[22676]: cluster 2024-09-20T23:06:40.536169+0000 mgr.a (mgr.14388) 2251 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:41 smithi044 bash[22676]: audit 2024-09-20T23:06:41.297195+0000 mgr.a (mgr.14388) 2252 : audit [DBG] from='client.60591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:41 smithi179 bash[23186]: cluster 2024-09-20T23:06:40.536169+0000 mgr.a (mgr.14388) 2251 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:41 smithi179 bash[23186]: audit 2024-09-20T23:06:41.297195+0000 mgr.a (mgr.14388) 2252 : audit [DBG] from='client.60591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:41 smithi049 bash[23528]: cluster 2024-09-20T23:06:40.536169+0000 mgr.a (mgr.14388) 2251 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:41 smithi049 bash[23528]: audit 2024-09-20T23:06:41.297195+0000 mgr.a (mgr.14388) 2252 : audit [DBG] from='client.60591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:43 smithi044 bash[22676]: cluster 2024-09-20T23:06:42.537195+0000 mgr.a (mgr.14388) 2253 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:43 smithi179 bash[23186]: cluster 2024-09-20T23:06:42.537195+0000 mgr.a (mgr.14388) 2253 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:43 smithi049 bash[23528]: cluster 2024-09-20T23:06:42.537195+0000 mgr.a (mgr.14388) 2253 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:44.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22930]: debug 2024-09-20T23:06:44.452+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22930]: debug 2024-09-20T23:06:44.452+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: audit 2024-09-20T23:06:43.659031+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: audit 2024-09-20T23:06:43.671052+0000 mon.a (mon.0) 2514 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: audit 2024-09-20T23:06:43.673009+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: audit 2024-09-20T23:06:43.683837+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: audit 2024-09-20T23:06:43.690281+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: audit 2024-09-20T23:06:43.692798+0000 mgr.a (mgr.14388) 2254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: audit 2024-09-20T23:06:44.455120+0000 mgr.a (mgr.14388) 2255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:06:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:44 smithi044 bash[22676]: cephadm 2024-09-20T23:06:44.456306+0000 mgr.a (mgr.14388) 2256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:06:44.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: audit 2024-09-20T23:06:43.659031+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:06:44.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: audit 2024-09-20T23:06:43.671052+0000 mon.a (mon.0) 2514 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:06:44.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: audit 2024-09-20T23:06:43.673009+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:06:44.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: audit 2024-09-20T23:06:43.683837+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:44.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: audit 2024-09-20T23:06:43.690281+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:06:44.786 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: audit 2024-09-20T23:06:43.692798+0000 mgr.a (mgr.14388) 2254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:06:44.786 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: audit 2024-09-20T23:06:44.455120+0000 mgr.a (mgr.14388) 2255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:06:44.786 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:44 smithi049 bash[23528]: cephadm 2024-09-20T23:06:44.456306+0000 mgr.a (mgr.14388) 2256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:06:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: audit 2024-09-20T23:06:43.659031+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:06:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: audit 2024-09-20T23:06:43.671052+0000 mon.a (mon.0) 2514 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:06:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: audit 2024-09-20T23:06:43.673009+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:06:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: audit 2024-09-20T23:06:43.683837+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: audit 2024-09-20T23:06:43.690281+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:06:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: audit 2024-09-20T23:06:43.692798+0000 mgr.a (mgr.14388) 2254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:06:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: audit 2024-09-20T23:06:44.455120+0000 mgr.a (mgr.14388) 2255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:06:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:44 smithi179 bash[23186]: cephadm 2024-09-20T23:06:44.456306+0000 mgr.a (mgr.14388) 2256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:06:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:45 smithi044 bash[22676]: cluster 2024-09-20T23:06:44.538163+0000 mgr.a (mgr.14388) 2257 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:45 smithi179 bash[23186]: cluster 2024-09-20T23:06:44.538163+0000 mgr.a (mgr.14388) 2257 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:46.025 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:45 smithi049 bash[23528]: cluster 2024-09-20T23:06:44.538163+0000 mgr.a (mgr.14388) 2257 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:06:46.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:46.754 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:46.754 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:47.511 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:47.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:47.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:47.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:47.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: cluster 2024-09-20T23:06:46.540405+0000 mgr.a (mgr.14388) 2258 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: audit 2024-09-20T23:06:47.064461+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: audit 2024-09-20T23:06:47.074221+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: audit 2024-09-20T23:06:47.085359+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: audit 2024-09-20T23:06:47.095265+0000 mgr.a (mgr.14388) 2259 : audit [DBG] from='client.60771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: audit 2024-09-20T23:06:47.120089+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: audit 2024-09-20T23:06:47.126952+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:48 smithi044 bash[22676]: audit 2024-09-20T23:06:47.134337+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.426 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: cluster 2024-09-20T23:06:46.540405+0000 mgr.a (mgr.14388) 2258 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:48.427 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: audit 2024-09-20T23:06:47.064461+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.427 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: audit 2024-09-20T23:06:47.074221+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.427 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: audit 2024-09-20T23:06:47.085359+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.427 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: audit 2024-09-20T23:06:47.095265+0000 mgr.a (mgr.14388) 2259 : audit [DBG] from='client.60771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:48.427 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: audit 2024-09-20T23:06:47.120089+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.427 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: audit 2024-09-20T23:06:47.126952+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.427 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:48 smithi049 bash[23528]: audit 2024-09-20T23:06:47.134337+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: cluster 2024-09-20T23:06:46.540405+0000 mgr.a (mgr.14388) 2258 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: audit 2024-09-20T23:06:47.064461+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: audit 2024-09-20T23:06:47.074221+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: audit 2024-09-20T23:06:47.085359+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: audit 2024-09-20T23:06:47.095265+0000 mgr.a (mgr.14388) 2259 : audit [DBG] from='client.60771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: audit 2024-09-20T23:06:47.120089+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: audit 2024-09-20T23:06:47.126952+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:48 smithi179 bash[23186]: audit 2024-09-20T23:06:47.134337+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:50 smithi044 bash[22676]: cluster 2024-09-20T23:06:48.541497+0000 mgr.a (mgr.14388) 2260 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:50 smithi044 bash[22676]: audit 2024-09-20T23:06:49.163645+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:50 smithi044 bash[22676]: audit 2024-09-20T23:06:49.170964+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:50 smithi044 bash[22676]: audit 2024-09-20T23:06:49.181530+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:50 smithi179 bash[23186]: cluster 2024-09-20T23:06:48.541497+0000 mgr.a (mgr.14388) 2260 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:50 smithi179 bash[23186]: audit 2024-09-20T23:06:49.163645+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:50 smithi179 bash[23186]: audit 2024-09-20T23:06:49.170964+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:50 smithi179 bash[23186]: audit 2024-09-20T23:06:49.181530+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:50 smithi049 bash[23528]: cluster 2024-09-20T23:06:48.541497+0000 mgr.a (mgr.14388) 2260 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:50 smithi049 bash[23528]: audit 2024-09-20T23:06:49.163645+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:50 smithi049 bash[23528]: audit 2024-09-20T23:06:49.170964+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:50 smithi049 bash[23528]: audit 2024-09-20T23:06:49.181530+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:06:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:52 smithi044 bash[22676]: cluster 2024-09-20T23:06:50.543319+0000 mgr.a (mgr.14388) 2261 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:52 smithi179 bash[23186]: cluster 2024-09-20T23:06:50.543319+0000 mgr.a (mgr.14388) 2261 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:52.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:52.514 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:52.514 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:52 smithi049 bash[23528]: cluster 2024-09-20T23:06:50.543319+0000 mgr.a (mgr.14388) 2261 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:53.282 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:53.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:53.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:53.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:53.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:06:54.334 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:54 smithi179 bash[23186]: cluster 2024-09-20T23:06:52.543934+0000 mgr.a (mgr.14388) 2262 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:54.334 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:54 smithi179 bash[23186]: audit 2024-09-20T23:06:52.845765+0000 mgr.a (mgr.14388) 2263 : audit [DBG] from='client.60849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:54 smithi044 bash[22676]: cluster 2024-09-20T23:06:52.543934+0000 mgr.a (mgr.14388) 2262 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:54 smithi044 bash[22676]: audit 2024-09-20T23:06:52.845765+0000 mgr.a (mgr.14388) 2263 : audit [DBG] from='client.60849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:54 smithi049 bash[23528]: cluster 2024-09-20T23:06:52.543934+0000 mgr.a (mgr.14388) 2262 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:54 smithi049 bash[23528]: audit 2024-09-20T23:06:52.845765+0000 mgr.a (mgr.14388) 2263 : audit [DBG] from='client.60849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:06:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:56 smithi044 bash[22676]: cluster 2024-09-20T23:06:54.544917+0000 mgr.a (mgr.14388) 2264 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:56 smithi179 bash[23186]: cluster 2024-09-20T23:06:54.544917+0000 mgr.a (mgr.14388) 2264 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:56 smithi049 bash[23528]: cluster 2024-09-20T23:06:54.544917+0000 mgr.a (mgr.14388) 2264 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:58.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:06:58.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:06:58.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:06:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:06:58 smithi044 bash[22676]: cluster 2024-09-20T23:06:56.547223+0000 mgr.a (mgr.14388) 2265 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:06:58 smithi179 bash[23186]: cluster 2024-09-20T23:06:56.547223+0000 mgr.a (mgr.14388) 2265 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:06:58 smithi049 bash[23528]: cluster 2024-09-20T23:06:56.547223+0000 mgr.a (mgr.14388) 2265 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:06:59.042 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:06:59.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:06:59.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:06:59.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:06:59.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:00 smithi044 bash[22676]: cluster 2024-09-20T23:06:58.547971+0000 mgr.a (mgr.14388) 2266 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:00 smithi044 bash[22676]: audit 2024-09-20T23:06:58.619047+0000 mgr.a (mgr.14388) 2267 : audit [DBG] from='client.60927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:00 smithi179 bash[23186]: cluster 2024-09-20T23:06:58.547971+0000 mgr.a (mgr.14388) 2266 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:00 smithi179 bash[23186]: audit 2024-09-20T23:06:58.619047+0000 mgr.a (mgr.14388) 2267 : audit [DBG] from='client.60927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:00 smithi049 bash[23528]: cluster 2024-09-20T23:06:58.547971+0000 mgr.a (mgr.14388) 2266 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:00 smithi049 bash[23528]: audit 2024-09-20T23:06:58.619047+0000 mgr.a (mgr.14388) 2267 : audit [DBG] from='client.60927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:02 smithi044 bash[22676]: cluster 2024-09-20T23:07:00.550323+0000 mgr.a (mgr.14388) 2268 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:02 smithi179 bash[23186]: cluster 2024-09-20T23:07:00.550323+0000 mgr.a (mgr.14388) 2268 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:02 smithi049 bash[23528]: cluster 2024-09-20T23:07:00.550323+0000 mgr.a (mgr.14388) 2268 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:04.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:04.045 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:04.045 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:04 smithi044 bash[22676]: cluster 2024-09-20T23:07:02.551076+0000 mgr.a (mgr.14388) 2269 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:04 smithi179 bash[23186]: cluster 2024-09-20T23:07:02.551076+0000 mgr.a (mgr.14388) 2269 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:04 smithi049 bash[23528]: cluster 2024-09-20T23:07:02.551076+0000 mgr.a (mgr.14388) 2269 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:04.801 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:04.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:04.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:04.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:04.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:05 smithi049 bash[23528]: audit 2024-09-20T23:07:04.380511+0000 mgr.a (mgr.14388) 2270 : audit [DBG] from='client.61005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:05 smithi044 bash[22676]: audit 2024-09-20T23:07:04.380511+0000 mgr.a (mgr.14388) 2270 : audit [DBG] from='client.61005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:05 smithi179 bash[23186]: audit 2024-09-20T23:07:04.380511+0000 mgr.a (mgr.14388) 2270 : audit [DBG] from='client.61005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:06.281 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:06 smithi049 bash[23528]: cluster 2024-09-20T23:07:04.551639+0000 mgr.a (mgr.14388) 2271 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:06 smithi044 bash[22676]: cluster 2024-09-20T23:07:04.551639+0000 mgr.a (mgr.14388) 2271 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:06 smithi179 bash[23186]: cluster 2024-09-20T23:07:04.551639+0000 mgr.a (mgr.14388) 2271 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:08 smithi049 bash[23528]: cluster 2024-09-20T23:07:06.554011+0000 mgr.a (mgr.14388) 2272 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:08 smithi049 bash[23528]: audit 2024-09-20T23:07:07.298123+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:08 smithi049 bash[23528]: audit 2024-09-20T23:07:07.306767+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:08 smithi049 bash[23528]: audit 2024-09-20T23:07:07.317084+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:08 smithi049 bash[23528]: audit 2024-09-20T23:07:07.340727+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:08 smithi049 bash[23528]: audit 2024-09-20T23:07:07.348825+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:08 smithi049 bash[23528]: audit 2024-09-20T23:07:07.358717+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:08 smithi044 bash[22676]: cluster 2024-09-20T23:07:06.554011+0000 mgr.a (mgr.14388) 2272 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:08.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:08 smithi044 bash[22676]: audit 2024-09-20T23:07:07.298123+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:08 smithi044 bash[22676]: audit 2024-09-20T23:07:07.306767+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:08 smithi044 bash[22676]: audit 2024-09-20T23:07:07.317084+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:08 smithi044 bash[22676]: audit 2024-09-20T23:07:07.340727+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:08 smithi044 bash[22676]: audit 2024-09-20T23:07:07.348825+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:08 smithi044 bash[22676]: audit 2024-09-20T23:07:07.358717+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:08 smithi179 bash[23186]: cluster 2024-09-20T23:07:06.554011+0000 mgr.a (mgr.14388) 2272 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:08 smithi179 bash[23186]: audit 2024-09-20T23:07:07.298123+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:08 smithi179 bash[23186]: audit 2024-09-20T23:07:07.306767+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:08 smithi179 bash[23186]: audit 2024-09-20T23:07:07.317084+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:08 smithi179 bash[23186]: audit 2024-09-20T23:07:07.340727+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:08 smithi179 bash[23186]: audit 2024-09-20T23:07:07.348825+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:08.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:08 smithi179 bash[23186]: audit 2024-09-20T23:07:07.358717+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:09.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:09.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:09.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:10.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:10.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:10.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:10.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:10.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:10 smithi044 bash[22676]: cluster 2024-09-20T23:07:08.554817+0000 mgr.a (mgr.14388) 2273 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:10 smithi044 bash[22676]: audit 2024-09-20T23:07:09.343987+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:10 smithi044 bash[22676]: audit 2024-09-20T23:07:09.348503+0000 mon.a (mon.0) 2534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:10 smithi044 bash[22676]: audit 2024-09-20T23:07:09.353349+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:10 smithi179 bash[23186]: cluster 2024-09-20T23:07:08.554817+0000 mgr.a (mgr.14388) 2273 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:10 smithi179 bash[23186]: audit 2024-09-20T23:07:09.343987+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:10 smithi179 bash[23186]: audit 2024-09-20T23:07:09.348503+0000 mon.a (mon.0) 2534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:10 smithi179 bash[23186]: audit 2024-09-20T23:07:09.353349+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:10 smithi049 bash[23528]: cluster 2024-09-20T23:07:08.554817+0000 mgr.a (mgr.14388) 2273 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:10 smithi049 bash[23528]: audit 2024-09-20T23:07:09.343987+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:10 smithi049 bash[23528]: audit 2024-09-20T23:07:09.348503+0000 mon.a (mon.0) 2534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:10 smithi049 bash[23528]: audit 2024-09-20T23:07:09.353349+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:11 smithi044 bash[22676]: audit 2024-09-20T23:07:10.143550+0000 mgr.a (mgr.14388) 2274 : audit [DBG] from='client.61083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:11 smithi179 bash[23186]: audit 2024-09-20T23:07:10.143550+0000 mgr.a (mgr.14388) 2274 : audit [DBG] from='client.61083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:11 smithi049 bash[23528]: audit 2024-09-20T23:07:10.143550+0000 mgr.a (mgr.14388) 2274 : audit [DBG] from='client.61083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:12 smithi044 bash[22676]: cluster 2024-09-20T23:07:10.556040+0000 mgr.a (mgr.14388) 2275 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:12 smithi179 bash[23186]: cluster 2024-09-20T23:07:10.556040+0000 mgr.a (mgr.14388) 2275 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:12 smithi049 bash[23528]: cluster 2024-09-20T23:07:10.556040+0000 mgr.a (mgr.14388) 2275 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:14 smithi044 bash[22676]: cluster 2024-09-20T23:07:12.556781+0000 mgr.a (mgr.14388) 2276 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:07:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:14 smithi179 bash[23186]: cluster 2024-09-20T23:07:12.556781+0000 mgr.a (mgr.14388) 2276 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:07:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:14 smithi049 bash[23528]: cluster 2024-09-20T23:07:12.556781+0000 mgr.a (mgr.14388) 2276 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:07:15.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:15.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:16.369 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:16.629 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:16 smithi179 bash[23186]: cluster 2024-09-20T23:07:14.557551+0000 mgr.a (mgr.14388) 2277 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:07:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:16 smithi044 bash[22676]: cluster 2024-09-20T23:07:14.557551+0000 mgr.a (mgr.14388) 2277 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:07:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:16 smithi049 bash[23528]: cluster 2024-09-20T23:07:14.557551+0000 mgr.a (mgr.14388) 2277 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:07:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:17 smithi044 bash[22676]: audit 2024-09-20T23:07:15.926236+0000 mgr.a (mgr.14388) 2278 : audit [DBG] from='client.61161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:17 smithi179 bash[23186]: audit 2024-09-20T23:07:15.926236+0000 mgr.a (mgr.14388) 2278 : audit [DBG] from='client.61161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:17 smithi049 bash[23528]: audit 2024-09-20T23:07:15.926236+0000 mgr.a (mgr.14388) 2278 : audit [DBG] from='client.61161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:18 smithi044 bash[22676]: cluster 2024-09-20T23:07:16.560379+0000 mgr.a (mgr.14388) 2279 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:18 smithi179 bash[23186]: cluster 2024-09-20T23:07:16.560379+0000 mgr.a (mgr.14388) 2279 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:18 smithi049 bash[23528]: cluster 2024-09-20T23:07:16.560379+0000 mgr.a (mgr.14388) 2279 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:20 smithi179 bash[23186]: cluster 2024-09-20T23:07:18.561369+0000 mgr.a (mgr.14388) 2280 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:07:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:20 smithi044 bash[22676]: cluster 2024-09-20T23:07:18.561369+0000 mgr.a (mgr.14388) 2280 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:07:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:20 smithi049 bash[23528]: cluster 2024-09-20T23:07:18.561369+0000 mgr.a (mgr.14388) 2280 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:07:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:21.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:21.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:22.150 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:22 smithi044 bash[22676]: cluster 2024-09-20T23:07:20.563512+0000 mgr.a (mgr.14388) 2281 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:22 smithi179 bash[23186]: cluster 2024-09-20T23:07:20.563512+0000 mgr.a (mgr.14388) 2281 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:22 smithi049 bash[23528]: cluster 2024-09-20T23:07:20.563512+0000 mgr.a (mgr.14388) 2281 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:23 smithi044 bash[22676]: audit 2024-09-20T23:07:21.710243+0000 mgr.a (mgr.14388) 2282 : audit [DBG] from='client.61239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:23 smithi179 bash[23186]: audit 2024-09-20T23:07:21.710243+0000 mgr.a (mgr.14388) 2282 : audit [DBG] from='client.61239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:23 smithi049 bash[23528]: audit 2024-09-20T23:07:21.710243+0000 mgr.a (mgr.14388) 2282 : audit [DBG] from='client.61239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:24 smithi044 bash[22676]: cluster 2024-09-20T23:07:22.564487+0000 mgr.a (mgr.14388) 2283 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:24 smithi179 bash[23186]: cluster 2024-09-20T23:07:22.564487+0000 mgr.a (mgr.14388) 2283 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:24 smithi049 bash[23528]: cluster 2024-09-20T23:07:22.564487+0000 mgr.a (mgr.14388) 2283 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:26 smithi044 bash[22676]: cluster 2024-09-20T23:07:24.565304+0000 mgr.a (mgr.14388) 2284 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:26 smithi179 bash[23186]: cluster 2024-09-20T23:07:24.565304+0000 mgr.a (mgr.14388) 2284 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:26 smithi049 bash[23528]: cluster 2024-09-20T23:07:24.565304+0000 mgr.a (mgr.14388) 2284 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:27.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:27.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:27.920 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:27.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:27.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:27.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:27.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: cluster 2024-09-20T23:07:26.567541+0000 mgr.a (mgr.14388) 2285 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: audit 2024-09-20T23:07:27.489573+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: audit 2024-09-20T23:07:27.492348+0000 mgr.a (mgr.14388) 2286 : audit [DBG] from='client.61317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: audit 2024-09-20T23:07:27.498729+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: audit 2024-09-20T23:07:27.519300+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: audit 2024-09-20T23:07:27.564208+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: audit 2024-09-20T23:07:27.570708+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:28 smithi179 bash[23186]: audit 2024-09-20T23:07:27.576449+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: cluster 2024-09-20T23:07:26.567541+0000 mgr.a (mgr.14388) 2285 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: audit 2024-09-20T23:07:27.489573+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: audit 2024-09-20T23:07:27.492348+0000 mgr.a (mgr.14388) 2286 : audit [DBG] from='client.61317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: audit 2024-09-20T23:07:27.498729+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: audit 2024-09-20T23:07:27.519300+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: audit 2024-09-20T23:07:27.564208+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: audit 2024-09-20T23:07:27.570708+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:28 smithi049 bash[23528]: audit 2024-09-20T23:07:27.576449+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: cluster 2024-09-20T23:07:26.567541+0000 mgr.a (mgr.14388) 2285 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: audit 2024-09-20T23:07:27.489573+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: audit 2024-09-20T23:07:27.492348+0000 mgr.a (mgr.14388) 2286 : audit [DBG] from='client.61317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: audit 2024-09-20T23:07:27.498729+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: audit 2024-09-20T23:07:27.519300+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: audit 2024-09-20T23:07:27.564208+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: audit 2024-09-20T23:07:27.570708+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:28 smithi044 bash[22676]: audit 2024-09-20T23:07:27.576449+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:30 smithi044 bash[22676]: cluster 2024-09-20T23:07:28.568543+0000 mgr.a (mgr.14388) 2287 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:30 smithi044 bash[22676]: audit 2024-09-20T23:07:29.471735+0000 mon.a (mon.0) 2542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:30 smithi044 bash[22676]: audit 2024-09-20T23:07:29.477052+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:30 smithi044 bash[22676]: audit 2024-09-20T23:07:29.483842+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:30 smithi179 bash[23186]: cluster 2024-09-20T23:07:28.568543+0000 mgr.a (mgr.14388) 2287 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:30 smithi179 bash[23186]: audit 2024-09-20T23:07:29.471735+0000 mon.a (mon.0) 2542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:30 smithi179 bash[23186]: audit 2024-09-20T23:07:29.477052+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:30 smithi179 bash[23186]: audit 2024-09-20T23:07:29.483842+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:30 smithi049 bash[23528]: cluster 2024-09-20T23:07:28.568543+0000 mgr.a (mgr.14388) 2287 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:30 smithi049 bash[23528]: audit 2024-09-20T23:07:29.471735+0000 mon.a (mon.0) 2542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:30 smithi049 bash[23528]: audit 2024-09-20T23:07:29.477052+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:30 smithi049 bash[23528]: audit 2024-09-20T23:07:29.483842+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:32 smithi044 bash[22676]: cluster 2024-09-20T23:07:30.570801+0000 mgr.a (mgr.14388) 2288 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:32 smithi179 bash[23186]: cluster 2024-09-20T23:07:30.570801+0000 mgr.a (mgr.14388) 2288 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:32 smithi049 bash[23528]: cluster 2024-09-20T23:07:30.570801+0000 mgr.a (mgr.14388) 2288 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:32.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:32.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:32.923 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:33.680 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:33.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:33.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:33.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:33.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:34 smithi044 bash[22676]: cluster 2024-09-20T23:07:32.571615+0000 mgr.a (mgr.14388) 2289 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:34 smithi044 bash[22676]: audit 2024-09-20T23:07:33.257284+0000 mgr.a (mgr.14388) 2290 : audit [DBG] from='client.61386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:34 smithi179 bash[23186]: cluster 2024-09-20T23:07:32.571615+0000 mgr.a (mgr.14388) 2289 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:34 smithi179 bash[23186]: audit 2024-09-20T23:07:33.257284+0000 mgr.a (mgr.14388) 2290 : audit [DBG] from='client.61386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:34 smithi049 bash[23528]: cluster 2024-09-20T23:07:32.571615+0000 mgr.a (mgr.14388) 2289 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:34 smithi049 bash[23528]: audit 2024-09-20T23:07:33.257284+0000 mgr.a (mgr.14388) 2290 : audit [DBG] from='client.61386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:36 smithi044 bash[22676]: cluster 2024-09-20T23:07:34.572654+0000 mgr.a (mgr.14388) 2291 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:36 smithi179 bash[23186]: cluster 2024-09-20T23:07:34.572654+0000 mgr.a (mgr.14388) 2291 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:36 smithi049 bash[23528]: cluster 2024-09-20T23:07:34.572654+0000 mgr.a (mgr.14388) 2291 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:38 smithi179 bash[23186]: cluster 2024-09-20T23:07:36.574989+0000 mgr.a (mgr.14388) 2292 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:38 smithi049 bash[23528]: cluster 2024-09-20T23:07:36.574989+0000 mgr.a (mgr.14388) 2292 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:38 smithi044 bash[22676]: cluster 2024-09-20T23:07:36.574989+0000 mgr.a (mgr.14388) 2292 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:39.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:39.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:40 smithi179 bash[23186]: cluster 2024-09-20T23:07:38.575770+0000 mgr.a (mgr.14388) 2293 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:40 smithi179 bash[23186]: audit 2024-09-20T23:07:39.019653+0000 mgr.a (mgr.14388) 2294 : audit [DBG] from='client.61464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:40 smithi049 bash[23528]: cluster 2024-09-20T23:07:38.575770+0000 mgr.a (mgr.14388) 2293 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:40 smithi049 bash[23528]: audit 2024-09-20T23:07:39.019653+0000 mgr.a (mgr.14388) 2294 : audit [DBG] from='client.61464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:40 smithi044 bash[22676]: cluster 2024-09-20T23:07:38.575770+0000 mgr.a (mgr.14388) 2293 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:40 smithi044 bash[22676]: audit 2024-09-20T23:07:39.019653+0000 mgr.a (mgr.14388) 2294 : audit [DBG] from='client.61464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:42 smithi179 bash[23186]: cluster 2024-09-20T23:07:40.578274+0000 mgr.a (mgr.14388) 2295 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:42 smithi049 bash[23528]: cluster 2024-09-20T23:07:40.578274+0000 mgr.a (mgr.14388) 2295 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:42 smithi044 bash[22676]: cluster 2024-09-20T23:07:40.578274+0000 mgr.a (mgr.14388) 2295 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:07:44.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:44.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:44.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:44 smithi179 bash[23186]: cluster 2024-09-20T23:07:42.579238+0000 mgr.a (mgr.14388) 2296 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:44 smithi049 bash[23528]: cluster 2024-09-20T23:07:42.579238+0000 mgr.a (mgr.14388) 2296 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:44 smithi044 bash[22676]: cluster 2024-09-20T23:07:42.579238+0000 mgr.a (mgr.14388) 2296 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:45.684 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:45.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:45.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:45.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:45.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:45.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22930]: debug 2024-09-20T23:07:45.275+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:07:45.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22930]: debug 2024-09-20T23:07:45.287+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:07:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22676]: audit 2024-09-20T23:07:44.512278+0000 mon.a (mon.0) 2545 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:07:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22676]: audit 2024-09-20T23:07:44.518748+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:07:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22676]: audit 2024-09-20T23:07:44.520633+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:07:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22676]: audit 2024-09-20T23:07:44.530881+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22676]: audit 2024-09-20T23:07:44.534719+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:07:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:45 smithi044 bash[22676]: audit 2024-09-20T23:07:44.537003+0000 mgr.a (mgr.14388) 2297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:07:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:45 smithi049 bash[23528]: audit 2024-09-20T23:07:44.512278+0000 mon.a (mon.0) 2545 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:07:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:45 smithi049 bash[23528]: audit 2024-09-20T23:07:44.518748+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:07:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:45 smithi049 bash[23528]: audit 2024-09-20T23:07:44.520633+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:07:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:45 smithi049 bash[23528]: audit 2024-09-20T23:07:44.530881+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:45 smithi049 bash[23528]: audit 2024-09-20T23:07:44.534719+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:07:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:45 smithi049 bash[23528]: audit 2024-09-20T23:07:44.537003+0000 mgr.a (mgr.14388) 2297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:07:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:45 smithi179 bash[23186]: audit 2024-09-20T23:07:44.512278+0000 mon.a (mon.0) 2545 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:07:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:45 smithi179 bash[23186]: audit 2024-09-20T23:07:44.518748+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:07:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:45 smithi179 bash[23186]: audit 2024-09-20T23:07:44.520633+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:07:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:45 smithi179 bash[23186]: audit 2024-09-20T23:07:44.530881+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:46.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:45 smithi179 bash[23186]: audit 2024-09-20T23:07:44.534719+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:07:46.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:45 smithi179 bash[23186]: audit 2024-09-20T23:07:44.537003+0000 mgr.a (mgr.14388) 2297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:07:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:46 smithi049 bash[23528]: cluster 2024-09-20T23:07:44.579908+0000 mgr.a (mgr.14388) 2298 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:46 smithi049 bash[23528]: audit 2024-09-20T23:07:44.804962+0000 mgr.a (mgr.14388) 2299 : audit [DBG] from='client.61542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:46 smithi049 bash[23528]: audit 2024-09-20T23:07:45.277319+0000 mgr.a (mgr.14388) 2300 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:07:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:46 smithi049 bash[23528]: cephadm 2024-09-20T23:07:45.291651+0000 mgr.a (mgr.14388) 2301 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:07:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:46 smithi044 bash[22676]: cluster 2024-09-20T23:07:44.579908+0000 mgr.a (mgr.14388) 2298 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:46 smithi044 bash[22676]: audit 2024-09-20T23:07:44.804962+0000 mgr.a (mgr.14388) 2299 : audit [DBG] from='client.61542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:46 smithi044 bash[22676]: audit 2024-09-20T23:07:45.277319+0000 mgr.a (mgr.14388) 2300 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:07:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:46 smithi044 bash[22676]: cephadm 2024-09-20T23:07:45.291651+0000 mgr.a (mgr.14388) 2301 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:07:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:46 smithi179 bash[23186]: cluster 2024-09-20T23:07:44.579908+0000 mgr.a (mgr.14388) 2298 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:07:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:46 smithi179 bash[23186]: audit 2024-09-20T23:07:44.804962+0000 mgr.a (mgr.14388) 2299 : audit [DBG] from='client.61542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:46 smithi179 bash[23186]: audit 2024-09-20T23:07:45.277319+0000 mgr.a (mgr.14388) 2300 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:07:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:46 smithi179 bash[23186]: cephadm 2024-09-20T23:07:45.291651+0000 mgr.a (mgr.14388) 2301 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:07:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:48 smithi049 bash[23528]: cluster 2024-09-20T23:07:46.582712+0000 mgr.a (mgr.14388) 2302 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:07:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:48 smithi049 bash[23528]: audit 2024-09-20T23:07:47.698032+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:48 smithi049 bash[23528]: audit 2024-09-20T23:07:47.708212+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:48 smithi049 bash[23528]: audit 2024-09-20T23:07:47.720067+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:48 smithi049 bash[23528]: audit 2024-09-20T23:07:47.788421+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:48 smithi049 bash[23528]: audit 2024-09-20T23:07:47.798117+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:48 smithi049 bash[23528]: audit 2024-09-20T23:07:47.809206+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:48 smithi044 bash[22676]: cluster 2024-09-20T23:07:46.582712+0000 mgr.a (mgr.14388) 2302 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:07:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:48 smithi044 bash[22676]: audit 2024-09-20T23:07:47.698032+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:48 smithi044 bash[22676]: audit 2024-09-20T23:07:47.708212+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:48 smithi044 bash[22676]: audit 2024-09-20T23:07:47.720067+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:48 smithi044 bash[22676]: audit 2024-09-20T23:07:47.788421+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:48 smithi044 bash[22676]: audit 2024-09-20T23:07:47.798117+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:48 smithi044 bash[22676]: audit 2024-09-20T23:07:47.809206+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:48 smithi179 bash[23186]: cluster 2024-09-20T23:07:46.582712+0000 mgr.a (mgr.14388) 2302 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:07:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:48 smithi179 bash[23186]: audit 2024-09-20T23:07:47.698032+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:48 smithi179 bash[23186]: audit 2024-09-20T23:07:47.708212+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:48 smithi179 bash[23186]: audit 2024-09-20T23:07:47.720067+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:48 smithi179 bash[23186]: audit 2024-09-20T23:07:47.788421+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:48 smithi179 bash[23186]: audit 2024-09-20T23:07:47.798117+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:48 smithi179 bash[23186]: audit 2024-09-20T23:07:47.809206+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:50.686 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:50 smithi044 bash[22676]: cluster 2024-09-20T23:07:48.583517+0000 mgr.a (mgr.14388) 2303 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-20T23:07:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:50 smithi044 bash[22676]: audit 2024-09-20T23:07:49.671065+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:50 smithi044 bash[22676]: audit 2024-09-20T23:07:49.680034+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:50 smithi044 bash[22676]: audit 2024-09-20T23:07:49.690514+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:50 smithi049 bash[23528]: cluster 2024-09-20T23:07:48.583517+0000 mgr.a (mgr.14388) 2303 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-20T23:07:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:50 smithi049 bash[23528]: audit 2024-09-20T23:07:49.671065+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:50 smithi049 bash[23528]: audit 2024-09-20T23:07:49.680034+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:50 smithi049 bash[23528]: audit 2024-09-20T23:07:49.690514+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:50 smithi179 bash[23186]: cluster 2024-09-20T23:07:48.583517+0000 mgr.a (mgr.14388) 2303 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-20T23:07:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:50 smithi179 bash[23186]: audit 2024-09-20T23:07:49.671065+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:50 smithi179 bash[23186]: audit 2024-09-20T23:07:49.680034+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:50 smithi179 bash[23186]: audit 2024-09-20T23:07:49.690514+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:07:51.484 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:52 smithi049 bash[23528]: cluster 2024-09-20T23:07:50.585562+0000 mgr.a (mgr.14388) 2304 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:07:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:52 smithi049 bash[23528]: audit 2024-09-20T23:07:51.039555+0000 mgr.a (mgr.14388) 2305 : audit [DBG] from='client.61722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:52 smithi044 bash[22676]: cluster 2024-09-20T23:07:50.585562+0000 mgr.a (mgr.14388) 2304 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:07:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:52 smithi044 bash[22676]: audit 2024-09-20T23:07:51.039555+0000 mgr.a (mgr.14388) 2305 : audit [DBG] from='client.61722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:52 smithi179 bash[23186]: cluster 2024-09-20T23:07:50.585562+0000 mgr.a (mgr.14388) 2304 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:07:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:52 smithi179 bash[23186]: audit 2024-09-20T23:07:51.039555+0000 mgr.a (mgr.14388) 2305 : audit [DBG] from='client.61722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:54 smithi049 bash[23528]: cluster 2024-09-20T23:07:52.586299+0000 mgr.a (mgr.14388) 2306 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:07:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:54 smithi044 bash[22676]: cluster 2024-09-20T23:07:52.586299+0000 mgr.a (mgr.14388) 2306 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:07:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:54 smithi179 bash[23186]: cluster 2024-09-20T23:07:52.586299+0000 mgr.a (mgr.14388) 2306 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:07:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:07:56.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:07:56.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:07:56.820 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:56 smithi179 bash[23186]: cluster 2024-09-20T23:07:54.587074+0000 mgr.a (mgr.14388) 2307 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:07:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:56 smithi044 bash[22676]: cluster 2024-09-20T23:07:54.587074+0000 mgr.a (mgr.14388) 2307 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:07:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:56 smithi049 bash[23528]: cluster 2024-09-20T23:07:54.587074+0000 mgr.a (mgr.14388) 2307 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:07:57.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:07:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:07:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:07:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:07:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:07:58.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:58 smithi179 bash[23186]: cluster 2024-09-20T23:07:56.588492+0000 mgr.a (mgr.14388) 2308 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:07:58.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:58 smithi179 bash[23186]: audit 2024-09-20T23:07:56.818948+0000 mgr.a (mgr.14388) 2309 : audit [DBG] from='client.61797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:58 smithi044 bash[22676]: cluster 2024-09-20T23:07:56.588492+0000 mgr.a (mgr.14388) 2308 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:07:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:58 smithi044 bash[22676]: audit 2024-09-20T23:07:56.818948+0000 mgr.a (mgr.14388) 2309 : audit [DBG] from='client.61797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:58 smithi049 bash[23528]: cluster 2024-09-20T23:07:56.588492+0000 mgr.a (mgr.14388) 2308 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:07:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:58 smithi049 bash[23528]: audit 2024-09-20T23:07:56.818948+0000 mgr.a (mgr.14388) 2309 : audit [DBG] from='client.61797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:07:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:07:59 smithi044 bash[22676]: cluster 2024-09-20T23:07:58.589382+0000 mgr.a (mgr.14388) 2310 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:08:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:07:59 smithi179 bash[23186]: cluster 2024-09-20T23:07:58.589382+0000 mgr.a (mgr.14388) 2310 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:08:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:07:59 smithi049 bash[23528]: cluster 2024-09-20T23:07:58.589382+0000 mgr.a (mgr.14388) 2310 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:08:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:01 smithi044 bash[22676]: cluster 2024-09-20T23:08:00.591549+0000 mgr.a (mgr.14388) 2311 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:08:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:01 smithi179 bash[23186]: cluster 2024-09-20T23:08:00.591549+0000 mgr.a (mgr.14388) 2311 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:08:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:01 smithi049 bash[23528]: cluster 2024-09-20T23:08:00.591549+0000 mgr.a (mgr.14388) 2311 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:08:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:02.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:03.035 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:03.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:03.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:03.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:03.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:03 smithi044 bash[22676]: audit 2024-09-20T23:08:02.592849+0000 mgr.a (mgr.14388) 2312 : audit [DBG] from='client.61872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:03 smithi044 bash[22676]: cluster 2024-09-20T23:08:02.593165+0000 mgr.a (mgr.14388) 2313 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:03 smithi179 bash[23186]: audit 2024-09-20T23:08:02.592849+0000 mgr.a (mgr.14388) 2312 : audit [DBG] from='client.61872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:03 smithi179 bash[23186]: cluster 2024-09-20T23:08:02.593165+0000 mgr.a (mgr.14388) 2313 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:03 smithi049 bash[23528]: audit 2024-09-20T23:08:02.592849+0000 mgr.a (mgr.14388) 2312 : audit [DBG] from='client.61872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:03 smithi049 bash[23528]: cluster 2024-09-20T23:08:02.593165+0000 mgr.a (mgr.14388) 2313 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:05 smithi044 bash[22676]: cluster 2024-09-20T23:08:04.594036+0000 mgr.a (mgr.14388) 2314 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:05 smithi179 bash[23186]: cluster 2024-09-20T23:08:04.594036+0000 mgr.a (mgr.14388) 2314 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:06.086 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:05 smithi049 bash[23528]: cluster 2024-09-20T23:08:04.594036+0000 mgr.a (mgr.14388) 2314 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:07.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:07 smithi049 bash[23528]: cluster 2024-09-20T23:08:06.596290+0000 mgr.a (mgr.14388) 2315 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:07 smithi044 bash[22676]: cluster 2024-09-20T23:08:06.596290+0000 mgr.a (mgr.14388) 2315 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:07 smithi179 bash[23186]: cluster 2024-09-20T23:08:06.596290+0000 mgr.a (mgr.14388) 2315 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:08.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:08.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:08.822 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:08.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:08.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:08.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:08.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:08 smithi044 bash[22676]: audit 2024-09-20T23:08:07.908748+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:08 smithi044 bash[22676]: audit 2024-09-20T23:08:07.917877+0000 mon.a (mon.0) 2560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:08 smithi044 bash[22676]: audit 2024-09-20T23:08:07.928690+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:08 smithi044 bash[22676]: audit 2024-09-20T23:08:08.019724+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:08 smithi044 bash[22676]: audit 2024-09-20T23:08:08.029788+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:08 smithi044 bash[22676]: audit 2024-09-20T23:08:08.041459+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:08 smithi044 bash[22676]: audit 2024-09-20T23:08:08.378791+0000 mgr.a (mgr.14388) 2316 : audit [DBG] from='client.61950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:08 smithi179 bash[23186]: audit 2024-09-20T23:08:07.908748+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:08 smithi179 bash[23186]: audit 2024-09-20T23:08:07.917877+0000 mon.a (mon.0) 2560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:08 smithi179 bash[23186]: audit 2024-09-20T23:08:07.928690+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:08 smithi179 bash[23186]: audit 2024-09-20T23:08:08.019724+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:08 smithi179 bash[23186]: audit 2024-09-20T23:08:08.029788+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:08 smithi179 bash[23186]: audit 2024-09-20T23:08:08.041459+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:08 smithi179 bash[23186]: audit 2024-09-20T23:08:08.378791+0000 mgr.a (mgr.14388) 2316 : audit [DBG] from='client.61950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:08 smithi049 bash[23528]: audit 2024-09-20T23:08:07.908748+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:08 smithi049 bash[23528]: audit 2024-09-20T23:08:07.917877+0000 mon.a (mon.0) 2560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:08 smithi049 bash[23528]: audit 2024-09-20T23:08:07.928690+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:08 smithi049 bash[23528]: audit 2024-09-20T23:08:08.019724+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:08 smithi049 bash[23528]: audit 2024-09-20T23:08:08.029788+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:08 smithi049 bash[23528]: audit 2024-09-20T23:08:08.041459+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:08 smithi049 bash[23528]: audit 2024-09-20T23:08:08.378791+0000 mgr.a (mgr.14388) 2316 : audit [DBG] from='client.61950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:10 smithi044 bash[22676]: cluster 2024-09-20T23:08:08.596813+0000 mgr.a (mgr.14388) 2317 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:10 smithi044 bash[22676]: audit 2024-09-20T23:08:09.906268+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:10 smithi044 bash[22676]: audit 2024-09-20T23:08:09.914151+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:10 smithi044 bash[22676]: audit 2024-09-20T23:08:09.924286+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:10 smithi049 bash[23528]: cluster 2024-09-20T23:08:08.596813+0000 mgr.a (mgr.14388) 2317 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:10 smithi049 bash[23528]: audit 2024-09-20T23:08:09.906268+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:10 smithi049 bash[23528]: audit 2024-09-20T23:08:09.914151+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:10 smithi049 bash[23528]: audit 2024-09-20T23:08:09.924286+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:10 smithi179 bash[23186]: cluster 2024-09-20T23:08:08.596813+0000 mgr.a (mgr.14388) 2317 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:10 smithi179 bash[23186]: audit 2024-09-20T23:08:09.906268+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:10 smithi179 bash[23186]: audit 2024-09-20T23:08:09.914151+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:10 smithi179 bash[23186]: audit 2024-09-20T23:08:09.924286+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:12 smithi044 bash[22676]: cluster 2024-09-20T23:08:10.599130+0000 mgr.a (mgr.14388) 2318 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:12 smithi049 bash[23528]: cluster 2024-09-20T23:08:10.599130+0000 mgr.a (mgr.14388) 2318 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:12 smithi179 bash[23186]: cluster 2024-09-20T23:08:10.599130+0000 mgr.a (mgr.14388) 2318 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:13.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:14 smithi049 bash[23528]: cluster 2024-09-20T23:08:12.599950+0000 mgr.a (mgr.14388) 2319 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:14 smithi044 bash[22676]: cluster 2024-09-20T23:08:12.599950+0000 mgr.a (mgr.14388) 2319 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:14 smithi179 bash[23186]: cluster 2024-09-20T23:08:12.599950+0000 mgr.a (mgr.14388) 2319 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:14.609 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:14.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:14.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:14.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:14.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:15 smithi044 bash[22676]: audit 2024-09-20T23:08:14.166293+0000 mgr.a (mgr.14388) 2320 : audit [DBG] from='client.62022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:15 smithi179 bash[23186]: audit 2024-09-20T23:08:14.166293+0000 mgr.a (mgr.14388) 2320 : audit [DBG] from='client.62022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:15 smithi049 bash[23528]: audit 2024-09-20T23:08:14.166293+0000 mgr.a (mgr.14388) 2320 : audit [DBG] from='client.62022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:16 smithi044 bash[22676]: cluster 2024-09-20T23:08:14.600488+0000 mgr.a (mgr.14388) 2321 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:16 smithi179 bash[23186]: cluster 2024-09-20T23:08:14.600488+0000 mgr.a (mgr.14388) 2321 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:16 smithi049 bash[23528]: cluster 2024-09-20T23:08:14.600488+0000 mgr.a (mgr.14388) 2321 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:18.348 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:18 smithi179 bash[23186]: cluster 2024-09-20T23:08:16.602716+0000 mgr.a (mgr.14388) 2322 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:18 smithi044 bash[22676]: cluster 2024-09-20T23:08:16.602716+0000 mgr.a (mgr.14388) 2322 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:18 smithi049 bash[23528]: cluster 2024-09-20T23:08:16.602716+0000 mgr.a (mgr.14388) 2322 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:19.612 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:19.612 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:20 smithi179 bash[23186]: cluster 2024-09-20T23:08:18.603530+0000 mgr.a (mgr.14388) 2323 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:20.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:20.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:20.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:20.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:20.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:20 smithi044 bash[22676]: cluster 2024-09-20T23:08:18.603530+0000 mgr.a (mgr.14388) 2323 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:20 smithi049 bash[23528]: cluster 2024-09-20T23:08:18.603530+0000 mgr.a (mgr.14388) 2323 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:21 smithi044 bash[22676]: audit 2024-09-20T23:08:19.945371+0000 mgr.a (mgr.14388) 2324 : audit [DBG] from='client.62100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:21 smithi179 bash[23186]: audit 2024-09-20T23:08:19.945371+0000 mgr.a (mgr.14388) 2324 : audit [DBG] from='client.62100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:21 smithi049 bash[23528]: audit 2024-09-20T23:08:19.945371+0000 mgr.a (mgr.14388) 2324 : audit [DBG] from='client.62100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:22 smithi044 bash[22676]: cluster 2024-09-20T23:08:20.606268+0000 mgr.a (mgr.14388) 2325 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:22 smithi179 bash[23186]: cluster 2024-09-20T23:08:20.606268+0000 mgr.a (mgr.14388) 2325 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:22 smithi049 bash[23528]: cluster 2024-09-20T23:08:20.606268+0000 mgr.a (mgr.14388) 2325 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:24 smithi044 bash[22676]: cluster 2024-09-20T23:08:22.607078+0000 mgr.a (mgr.14388) 2326 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:08:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:24 smithi179 bash[23186]: cluster 2024-09-20T23:08:22.607078+0000 mgr.a (mgr.14388) 2326 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:08:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:24 smithi049 bash[23528]: cluster 2024-09-20T23:08:22.607078+0000 mgr.a (mgr.14388) 2326 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:08:25.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:25.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:25.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:26.126 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:26.451 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:26 smithi049 bash[23528]: cluster 2024-09-20T23:08:24.607855+0000 mgr.a (mgr.14388) 2327 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:08:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:26 smithi044 bash[22676]: cluster 2024-09-20T23:08:24.607855+0000 mgr.a (mgr.14388) 2327 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:08:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:26 smithi179 bash[23186]: cluster 2024-09-20T23:08:24.607855+0000 mgr.a (mgr.14388) 2327 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:08:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:27 smithi049 bash[23528]: audit 2024-09-20T23:08:25.696640+0000 mgr.a (mgr.14388) 2328 : audit [DBG] from='client.62178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:27 smithi044 bash[22676]: audit 2024-09-20T23:08:25.696640+0000 mgr.a (mgr.14388) 2328 : audit [DBG] from='client.62178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:27 smithi179 bash[23186]: audit 2024-09-20T23:08:25.696640+0000 mgr.a (mgr.14388) 2328 : audit [DBG] from='client.62178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:28.451 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:28 smithi049 bash[23528]: cluster 2024-09-20T23:08:26.610689+0000 mgr.a (mgr.14388) 2329 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:28 smithi044 bash[22676]: cluster 2024-09-20T23:08:26.610689+0000 mgr.a (mgr.14388) 2329 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:28 smithi179 bash[23186]: cluster 2024-09-20T23:08:26.610689+0000 mgr.a (mgr.14388) 2329 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:29 smithi044 bash[22676]: audit 2024-09-20T23:08:28.101145+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:29 smithi044 bash[22676]: audit 2024-09-20T23:08:28.117461+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:29 smithi044 bash[22676]: audit 2024-09-20T23:08:28.128024+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:29 smithi044 bash[22676]: audit 2024-09-20T23:08:28.249872+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:29 smithi044 bash[22676]: audit 2024-09-20T23:08:28.258232+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:29 smithi044 bash[22676]: audit 2024-09-20T23:08:28.268054+0000 mon.a (mon.0) 2573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:29 smithi179 bash[23186]: audit 2024-09-20T23:08:28.101145+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:29 smithi179 bash[23186]: audit 2024-09-20T23:08:28.117461+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:29 smithi179 bash[23186]: audit 2024-09-20T23:08:28.128024+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:29 smithi179 bash[23186]: audit 2024-09-20T23:08:28.249872+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:29 smithi179 bash[23186]: audit 2024-09-20T23:08:28.258232+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:29 smithi179 bash[23186]: audit 2024-09-20T23:08:28.268054+0000 mon.a (mon.0) 2573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:29 smithi049 bash[23528]: audit 2024-09-20T23:08:28.101145+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:29 smithi049 bash[23528]: audit 2024-09-20T23:08:28.117461+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:29 smithi049 bash[23528]: audit 2024-09-20T23:08:28.128024+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:29 smithi049 bash[23528]: audit 2024-09-20T23:08:28.249872+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:29 smithi049 bash[23528]: audit 2024-09-20T23:08:28.258232+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:29 smithi049 bash[23528]: audit 2024-09-20T23:08:28.268054+0000 mon.a (mon.0) 2573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:30 smithi049 bash[23528]: cluster 2024-09-20T23:08:28.611512+0000 mgr.a (mgr.14388) 2330 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:08:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:30 smithi049 bash[23528]: audit 2024-09-20T23:08:30.058236+0000 mon.a (mon.0) 2574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:30 smithi049 bash[23528]: audit 2024-09-20T23:08:30.064370+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:30 smithi049 bash[23528]: audit 2024-09-20T23:08:30.070132+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:30 smithi044 bash[22676]: cluster 2024-09-20T23:08:28.611512+0000 mgr.a (mgr.14388) 2330 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:08:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:30 smithi044 bash[22676]: audit 2024-09-20T23:08:30.058236+0000 mon.a (mon.0) 2574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:30 smithi044 bash[22676]: audit 2024-09-20T23:08:30.064370+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:30 smithi044 bash[22676]: audit 2024-09-20T23:08:30.070132+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:30 smithi179 bash[23186]: cluster 2024-09-20T23:08:28.611512+0000 mgr.a (mgr.14388) 2330 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:08:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:30 smithi179 bash[23186]: audit 2024-09-20T23:08:30.058236+0000 mon.a (mon.0) 2574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:30 smithi179 bash[23186]: audit 2024-09-20T23:08:30.064370+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:30 smithi179 bash[23186]: audit 2024-09-20T23:08:30.070132+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:31.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:31.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:31.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:31.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:31.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:31.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:31.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:31.883 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:32 smithi044 bash[22676]: cluster 2024-09-20T23:08:30.613544+0000 mgr.a (mgr.14388) 2331 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:32 smithi044 bash[22676]: audit 2024-09-20T23:08:31.458250+0000 mgr.a (mgr.14388) 2332 : audit [DBG] from='client.62256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:32 smithi049 bash[23528]: cluster 2024-09-20T23:08:30.613544+0000 mgr.a (mgr.14388) 2331 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:32 smithi049 bash[23528]: audit 2024-09-20T23:08:31.458250+0000 mgr.a (mgr.14388) 2332 : audit [DBG] from='client.62256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:32 smithi179 bash[23186]: cluster 2024-09-20T23:08:30.613544+0000 mgr.a (mgr.14388) 2331 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:32 smithi179 bash[23186]: audit 2024-09-20T23:08:31.458250+0000 mgr.a (mgr.14388) 2332 : audit [DBG] from='client.62256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:34 smithi049 bash[23528]: cluster 2024-09-20T23:08:32.614476+0000 mgr.a (mgr.14388) 2333 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:34.575 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:34 smithi044 bash[22676]: cluster 2024-09-20T23:08:32.614476+0000 mgr.a (mgr.14388) 2333 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:34 smithi179 bash[23186]: cluster 2024-09-20T23:08:32.614476+0000 mgr.a (mgr.14388) 2333 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:36 smithi049 bash[23528]: cluster 2024-09-20T23:08:34.615265+0000 mgr.a (mgr.14388) 2334 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:36 smithi044 bash[22676]: cluster 2024-09-20T23:08:34.615265+0000 mgr.a (mgr.14388) 2334 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:36 smithi179 bash[23186]: cluster 2024-09-20T23:08:34.615265+0000 mgr.a (mgr.14388) 2334 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:36.886 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:37.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:37.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:37.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:37.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:38 smithi049 bash[23528]: cluster 2024-09-20T23:08:36.617527+0000 mgr.a (mgr.14388) 2335 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:38 smithi049 bash[23528]: audit 2024-09-20T23:08:37.214456+0000 mgr.a (mgr.14388) 2336 : audit [DBG] from='client.62334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:38.571 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:38 smithi179 bash[23186]: cluster 2024-09-20T23:08:36.617527+0000 mgr.a (mgr.14388) 2335 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:38.571 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:38 smithi179 bash[23186]: audit 2024-09-20T23:08:37.214456+0000 mgr.a (mgr.14388) 2336 : audit [DBG] from='client.62334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:38 smithi044 bash[22676]: cluster 2024-09-20T23:08:36.617527+0000 mgr.a (mgr.14388) 2335 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:38 smithi044 bash[22676]: audit 2024-09-20T23:08:37.214456+0000 mgr.a (mgr.14388) 2336 : audit [DBG] from='client.62334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:40 smithi179 bash[23186]: cluster 2024-09-20T23:08:38.618439+0000 mgr.a (mgr.14388) 2337 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:40 smithi049 bash[23528]: cluster 2024-09-20T23:08:38.618439+0000 mgr.a (mgr.14388) 2337 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:40 smithi044 bash[22676]: cluster 2024-09-20T23:08:38.618439+0000 mgr.a (mgr.14388) 2337 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:42 smithi049 bash[23528]: cluster 2024-09-20T23:08:40.620654+0000 mgr.a (mgr.14388) 2338 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:42.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:42.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:42.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:42 smithi044 bash[22676]: cluster 2024-09-20T23:08:40.620654+0000 mgr.a (mgr.14388) 2338 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:42 smithi179 bash[23186]: cluster 2024-09-20T23:08:40.620654+0000 mgr.a (mgr.14388) 2338 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:43.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:43.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:43.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:43.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:43.428 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:44 smithi049 bash[23528]: cluster 2024-09-20T23:08:42.621488+0000 mgr.a (mgr.14388) 2339 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:44 smithi049 bash[23528]: audit 2024-09-20T23:08:42.983558+0000 mgr.a (mgr.14388) 2340 : audit [DBG] from='client.62412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:44 smithi044 bash[22676]: cluster 2024-09-20T23:08:42.621488+0000 mgr.a (mgr.14388) 2339 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:44 smithi044 bash[22676]: audit 2024-09-20T23:08:42.983558+0000 mgr.a (mgr.14388) 2340 : audit [DBG] from='client.62412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:44 smithi179 bash[23186]: cluster 2024-09-20T23:08:42.621488+0000 mgr.a (mgr.14388) 2339 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:44 smithi179 bash[23186]: audit 2024-09-20T23:08:42.983558+0000 mgr.a (mgr.14388) 2340 : audit [DBG] from='client.62412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:46.373 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:46 smithi049 bash[23528]: cluster 2024-09-20T23:08:44.622413+0000 mgr.a (mgr.14388) 2341 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:46.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:46 smithi049 bash[23528]: audit 2024-09-20T23:08:45.352335+0000 mon.a (mon.0) 2577 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:46.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:46 smithi049 bash[23528]: audit 2024-09-20T23:08:45.359138+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:08:46.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:46 smithi049 bash[23528]: audit 2024-09-20T23:08:45.361056+0000 mon.a (mon.0) 2579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:08:46.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:46 smithi049 bash[23528]: audit 2024-09-20T23:08:45.371861+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:46.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:46 smithi049 bash[23528]: audit 2024-09-20T23:08:45.378209+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:08:46.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:46 smithi049 bash[23528]: audit 2024-09-20T23:08:45.380640+0000 mgr.a (mgr.14388) 2342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:08:46.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22930]: debug 2024-09-20T23:08:46.110+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22930]: debug 2024-09-20T23:08:46.110+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22676]: cluster 2024-09-20T23:08:44.622413+0000 mgr.a (mgr.14388) 2341 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22676]: audit 2024-09-20T23:08:45.352335+0000 mon.a (mon.0) 2577 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22676]: audit 2024-09-20T23:08:45.359138+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22676]: audit 2024-09-20T23:08:45.361056+0000 mon.a (mon.0) 2579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22676]: audit 2024-09-20T23:08:45.371861+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22676]: audit 2024-09-20T23:08:45.378209+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:46 smithi044 bash[22676]: audit 2024-09-20T23:08:45.380640+0000 mgr.a (mgr.14388) 2342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:08:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:46 smithi179 bash[23186]: cluster 2024-09-20T23:08:44.622413+0000 mgr.a (mgr.14388) 2341 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:46 smithi179 bash[23186]: audit 2024-09-20T23:08:45.352335+0000 mon.a (mon.0) 2577 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:08:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:46 smithi179 bash[23186]: audit 2024-09-20T23:08:45.359138+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:08:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:46 smithi179 bash[23186]: audit 2024-09-20T23:08:45.361056+0000 mon.a (mon.0) 2579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:08:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:46 smithi179 bash[23186]: audit 2024-09-20T23:08:45.371861+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:46 smithi179 bash[23186]: audit 2024-09-20T23:08:45.378209+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:08:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:46 smithi179 bash[23186]: audit 2024-09-20T23:08:45.380640+0000 mgr.a (mgr.14388) 2342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:08:47.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:47 smithi049 bash[23528]: audit 2024-09-20T23:08:46.113365+0000 mgr.a (mgr.14388) 2343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:08:47.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:47 smithi049 bash[23528]: cephadm 2024-09-20T23:08:46.114694+0000 mgr.a (mgr.14388) 2344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:08:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:47 smithi044 bash[22676]: audit 2024-09-20T23:08:46.113365+0000 mgr.a (mgr.14388) 2343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:08:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:47 smithi044 bash[22676]: cephadm 2024-09-20T23:08:46.114694+0000 mgr.a (mgr.14388) 2344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:08:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:47 smithi179 bash[23186]: audit 2024-09-20T23:08:46.113365+0000 mgr.a (mgr.14388) 2343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:08:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:47 smithi179 bash[23186]: cephadm 2024-09-20T23:08:46.114694+0000 mgr.a (mgr.14388) 2344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:08:48.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:48.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:48.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:48.581 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:48 smithi049 bash[23528]: cluster 2024-09-20T23:08:46.625179+0000 mgr.a (mgr.14388) 2345 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:48 smithi044 bash[22676]: cluster 2024-09-20T23:08:46.625179+0000 mgr.a (mgr.14388) 2345 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:48 smithi179 bash[23186]: cluster 2024-09-20T23:08:46.625179+0000 mgr.a (mgr.14388) 2345 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:08:49.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:49 smithi044 bash[22676]: audit 2024-09-20T23:08:48.317150+0000 mon.a (mon.0) 2582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:49 smithi044 bash[22676]: audit 2024-09-20T23:08:48.330797+0000 mon.a (mon.0) 2583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:49 smithi044 bash[22676]: audit 2024-09-20T23:08:48.340957+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:49 smithi044 bash[22676]: audit 2024-09-20T23:08:48.466962+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:49 smithi044 bash[22676]: audit 2024-09-20T23:08:48.474379+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:49 smithi044 bash[22676]: audit 2024-09-20T23:08:48.483258+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:49 smithi179 bash[23186]: audit 2024-09-20T23:08:48.317150+0000 mon.a (mon.0) 2582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:49 smithi179 bash[23186]: audit 2024-09-20T23:08:48.330797+0000 mon.a (mon.0) 2583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:49 smithi179 bash[23186]: audit 2024-09-20T23:08:48.340957+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:49 smithi179 bash[23186]: audit 2024-09-20T23:08:48.466962+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:49 smithi179 bash[23186]: audit 2024-09-20T23:08:48.474379+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:49 smithi179 bash[23186]: audit 2024-09-20T23:08:48.483258+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:49 smithi049 bash[23528]: audit 2024-09-20T23:08:48.317150+0000 mon.a (mon.0) 2582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:49 smithi049 bash[23528]: audit 2024-09-20T23:08:48.330797+0000 mon.a (mon.0) 2583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:49 smithi049 bash[23528]: audit 2024-09-20T23:08:48.340957+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:49 smithi049 bash[23528]: audit 2024-09-20T23:08:48.466962+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:49 smithi049 bash[23528]: audit 2024-09-20T23:08:48.474379+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:49.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:49 smithi049 bash[23528]: audit 2024-09-20T23:08:48.483258+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.560 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:50 smithi044 bash[22676]: cluster 2024-09-20T23:08:48.626100+0000 mgr.a (mgr.14388) 2346 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:50.561 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:50 smithi044 bash[22676]: audit 2024-09-20T23:08:48.767853+0000 mgr.a (mgr.14388) 2347 : audit [DBG] from='client.62595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:50.561 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:50 smithi044 bash[22676]: audit 2024-09-20T23:08:50.282972+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.561 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:50 smithi044 bash[22676]: audit 2024-09-20T23:08:50.291850+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.561 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:50 smithi044 bash[22676]: audit 2024-09-20T23:08:50.302260+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:50 smithi179 bash[23186]: cluster 2024-09-20T23:08:48.626100+0000 mgr.a (mgr.14388) 2346 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:50 smithi179 bash[23186]: audit 2024-09-20T23:08:48.767853+0000 mgr.a (mgr.14388) 2347 : audit [DBG] from='client.62595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:50 smithi179 bash[23186]: audit 2024-09-20T23:08:50.282972+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:50 smithi179 bash[23186]: audit 2024-09-20T23:08:50.291850+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:50 smithi179 bash[23186]: audit 2024-09-20T23:08:50.302260+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:50 smithi049 bash[23528]: cluster 2024-09-20T23:08:48.626100+0000 mgr.a (mgr.14388) 2346 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:08:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:50 smithi049 bash[23528]: audit 2024-09-20T23:08:48.767853+0000 mgr.a (mgr.14388) 2347 : audit [DBG] from='client.62595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:50 smithi049 bash[23528]: audit 2024-09-20T23:08:50.282972+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:50 smithi049 bash[23528]: audit 2024-09-20T23:08:50.291850+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:50 smithi049 bash[23528]: audit 2024-09-20T23:08:50.302260+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:08:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:52 smithi179 bash[23186]: cluster 2024-09-20T23:08:50.627557+0000 mgr.a (mgr.14388) 2348 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:52 smithi049 bash[23528]: cluster 2024-09-20T23:08:50.627557+0000 mgr.a (mgr.14388) 2348 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:52.927 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:52 smithi044 bash[22676]: cluster 2024-09-20T23:08:50.627557+0000 mgr.a (mgr.14388) 2348 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:54.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:54.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:54.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:08:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:54 smithi179 bash[23186]: cluster 2024-09-20T23:08:52.628317+0000 mgr.a (mgr.14388) 2349 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:54 smithi049 bash[23528]: cluster 2024-09-20T23:08:52.628317+0000 mgr.a (mgr.14388) 2349 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:54 smithi044 bash[22676]: cluster 2024-09-20T23:08:52.628317+0000 mgr.a (mgr.14388) 2349 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:54.992 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:08:54.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:08:54.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:08:54.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:08:54.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:08:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:55 smithi049 bash[23528]: audit 2024-09-20T23:08:54.555472+0000 mgr.a (mgr.14388) 2350 : audit [DBG] from='client.62673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:55 smithi044 bash[22676]: audit 2024-09-20T23:08:54.555472+0000 mgr.a (mgr.14388) 2350 : audit [DBG] from='client.62673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:55 smithi179 bash[23186]: audit 2024-09-20T23:08:54.555472+0000 mgr.a (mgr.14388) 2350 : audit [DBG] from='client.62673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:08:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:56 smithi049 bash[23528]: cluster 2024-09-20T23:08:54.628928+0000 mgr.a (mgr.14388) 2351 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:56 smithi044 bash[22676]: cluster 2024-09-20T23:08:54.628928+0000 mgr.a (mgr.14388) 2351 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:56 smithi179 bash[23186]: cluster 2024-09-20T23:08:54.628928+0000 mgr.a (mgr.14388) 2351 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:08:58 smithi049 bash[23528]: cluster 2024-09-20T23:08:56.631269+0000 mgr.a (mgr.14388) 2352 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:08:58 smithi044 bash[22676]: cluster 2024-09-20T23:08:56.631269+0000 mgr.a (mgr.14388) 2352 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:08:58 smithi179 bash[23186]: cluster 2024-09-20T23:08:56.631269+0000 mgr.a (mgr.14388) 2352 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:08:59.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:08:59.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:08:59.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:00 smithi179 bash[23186]: cluster 2024-09-20T23:08:58.632057+0000 mgr.a (mgr.14388) 2353 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:00.754 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:00.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:00.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:00.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:00.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:00 smithi049 bash[23528]: cluster 2024-09-20T23:08:58.632057+0000 mgr.a (mgr.14388) 2353 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:00 smithi044 bash[22676]: cluster 2024-09-20T23:08:58.632057+0000 mgr.a (mgr.14388) 2353 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:01 smithi049 bash[23528]: audit 2024-09-20T23:09:00.332681+0000 mgr.a (mgr.14388) 2354 : audit [DBG] from='client.62751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:01.894 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:01 smithi179 bash[23186]: audit 2024-09-20T23:09:00.332681+0000 mgr.a (mgr.14388) 2354 : audit [DBG] from='client.62751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:01 smithi044 bash[22676]: audit 2024-09-20T23:09:00.332681+0000 mgr.a (mgr.14388) 2354 : audit [DBG] from='client.62751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:02 smithi049 bash[23528]: cluster 2024-09-20T23:09:00.633235+0000 mgr.a (mgr.14388) 2355 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:02 smithi044 bash[22676]: cluster 2024-09-20T23:09:00.633235+0000 mgr.a (mgr.14388) 2355 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:02 smithi179 bash[23186]: cluster 2024-09-20T23:09:00.633235+0000 mgr.a (mgr.14388) 2355 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:04 smithi049 bash[23528]: cluster 2024-09-20T23:09:02.634050+0000 mgr.a (mgr.14388) 2356 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:04 smithi044 bash[22676]: cluster 2024-09-20T23:09:02.634050+0000 mgr.a (mgr.14388) 2356 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:04 smithi179 bash[23186]: cluster 2024-09-20T23:09:02.634050+0000 mgr.a (mgr.14388) 2356 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:05.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:05.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:05.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:06.532 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:06.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:06.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:06 smithi049 bash[23528]: cluster 2024-09-20T23:09:04.634844+0000 mgr.a (mgr.14388) 2357 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:06 smithi044 bash[22676]: cluster 2024-09-20T23:09:04.634844+0000 mgr.a (mgr.14388) 2357 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:06 smithi179 bash[23186]: cluster 2024-09-20T23:09:04.634844+0000 mgr.a (mgr.14388) 2357 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:07 smithi049 bash[23528]: audit 2024-09-20T23:09:06.091360+0000 mgr.a (mgr.14388) 2358 : audit [DBG] from='client.62823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:07 smithi044 bash[22676]: audit 2024-09-20T23:09:06.091360+0000 mgr.a (mgr.14388) 2358 : audit [DBG] from='client.62823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:07 smithi179 bash[23186]: audit 2024-09-20T23:09:06.091360+0000 mgr.a (mgr.14388) 2358 : audit [DBG] from='client.62823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:08.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:08 smithi049 bash[23528]: cluster 2024-09-20T23:09:06.637594+0000 mgr.a (mgr.14388) 2359 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:08.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:08 smithi049 bash[23528]: audit 2024-09-20T23:09:08.535873+0000 mon.a (mon.0) 2591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:08.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:08 smithi049 bash[23528]: audit 2024-09-20T23:09:08.544476+0000 mon.a (mon.0) 2592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:08 smithi044 bash[22676]: cluster 2024-09-20T23:09:06.637594+0000 mgr.a (mgr.14388) 2359 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:08 smithi044 bash[22676]: audit 2024-09-20T23:09:08.535873+0000 mon.a (mon.0) 2591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:08 smithi044 bash[22676]: audit 2024-09-20T23:09:08.544476+0000 mon.a (mon.0) 2592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:08 smithi179 bash[23186]: cluster 2024-09-20T23:09:06.637594+0000 mgr.a (mgr.14388) 2359 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:08 smithi179 bash[23186]: audit 2024-09-20T23:09:08.535873+0000 mon.a (mon.0) 2591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:08 smithi179 bash[23186]: audit 2024-09-20T23:09:08.544476+0000 mon.a (mon.0) 2592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:09 smithi049 bash[23528]: audit 2024-09-20T23:09:08.555186+0000 mon.a (mon.0) 2593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:09 smithi049 bash[23528]: audit 2024-09-20T23:09:08.690212+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:09 smithi049 bash[23528]: audit 2024-09-20T23:09:08.698273+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:09 smithi049 bash[23528]: audit 2024-09-20T23:09:08.708557+0000 mon.a (mon.0) 2596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:09 smithi044 bash[22676]: audit 2024-09-20T23:09:08.555186+0000 mon.a (mon.0) 2593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:09 smithi044 bash[22676]: audit 2024-09-20T23:09:08.690212+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:09 smithi044 bash[22676]: audit 2024-09-20T23:09:08.698273+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:09 smithi044 bash[22676]: audit 2024-09-20T23:09:08.708557+0000 mon.a (mon.0) 2596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:09 smithi179 bash[23186]: audit 2024-09-20T23:09:08.555186+0000 mon.a (mon.0) 2593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:09 smithi179 bash[23186]: audit 2024-09-20T23:09:08.690212+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:09 smithi179 bash[23186]: audit 2024-09-20T23:09:08.698273+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:09 smithi179 bash[23186]: audit 2024-09-20T23:09:08.708557+0000 mon.a (mon.0) 2596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:10 smithi044 bash[22676]: cluster 2024-09-20T23:09:08.638390+0000 mgr.a (mgr.14388) 2360 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:10 smithi044 bash[22676]: audit 2024-09-20T23:09:10.495103+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:10 smithi044 bash[22676]: audit 2024-09-20T23:09:10.503368+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:10 smithi044 bash[22676]: audit 2024-09-20T23:09:10.513340+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:10 smithi179 bash[23186]: cluster 2024-09-20T23:09:08.638390+0000 mgr.a (mgr.14388) 2360 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:10 smithi179 bash[23186]: audit 2024-09-20T23:09:10.495103+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:10 smithi179 bash[23186]: audit 2024-09-20T23:09:10.503368+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:10 smithi179 bash[23186]: audit 2024-09-20T23:09:10.513340+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:10 smithi049 bash[23528]: cluster 2024-09-20T23:09:08.638390+0000 mgr.a (mgr.14388) 2360 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:10 smithi049 bash[23528]: audit 2024-09-20T23:09:10.495103+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:10 smithi049 bash[23528]: audit 2024-09-20T23:09:10.503368+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:10 smithi049 bash[23528]: audit 2024-09-20T23:09:10.513340+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:11.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:11.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:11.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:12.316 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:12.922 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:12 smithi044 bash[22676]: cluster 2024-09-20T23:09:10.640303+0000 mgr.a (mgr.14388) 2361 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:12 smithi179 bash[23186]: cluster 2024-09-20T23:09:10.640303+0000 mgr.a (mgr.14388) 2361 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:12 smithi049 bash[23528]: cluster 2024-09-20T23:09:10.640303+0000 mgr.a (mgr.14388) 2361 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:13.856 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:13 smithi044 bash[22676]: audit 2024-09-20T23:09:11.869811+0000 mgr.a (mgr.14388) 2362 : audit [DBG] from='client.62901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:13.856 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:13 smithi044 bash[22676]: cluster 2024-09-20T23:09:12.641405+0000 mgr.a (mgr.14388) 2363 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:13 smithi179 bash[23186]: audit 2024-09-20T23:09:11.869811+0000 mgr.a (mgr.14388) 2362 : audit [DBG] from='client.62901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:13 smithi179 bash[23186]: cluster 2024-09-20T23:09:12.641405+0000 mgr.a (mgr.14388) 2363 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:13 smithi049 bash[23528]: audit 2024-09-20T23:09:11.869811+0000 mgr.a (mgr.14388) 2362 : audit [DBG] from='client.62901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:13 smithi049 bash[23528]: cluster 2024-09-20T23:09:12.641405+0000 mgr.a (mgr.14388) 2363 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:15 smithi044 bash[22676]: cluster 2024-09-20T23:09:14.642311+0000 mgr.a (mgr.14388) 2364 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:15 smithi179 bash[23186]: cluster 2024-09-20T23:09:14.642311+0000 mgr.a (mgr.14388) 2364 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:15 smithi049 bash[23528]: cluster 2024-09-20T23:09:14.642311+0000 mgr.a (mgr.14388) 2364 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:17.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:17.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:17 smithi044 bash[22676]: cluster 2024-09-20T23:09:16.643725+0000 mgr.a (mgr.14388) 2365 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:17 smithi179 bash[23186]: cluster 2024-09-20T23:09:16.643725+0000 mgr.a (mgr.14388) 2365 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:17 smithi049 bash[23528]: cluster 2024-09-20T23:09:16.643725+0000 mgr.a (mgr.14388) 2365 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:18.102 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:18.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:18.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:18.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:18.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:18 smithi044 bash[22676]: audit 2024-09-20T23:09:17.653205+0000 mgr.a (mgr.14388) 2366 : audit [DBG] from='client.62976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:18 smithi179 bash[23186]: audit 2024-09-20T23:09:17.653205+0000 mgr.a (mgr.14388) 2366 : audit [DBG] from='client.62976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:18 smithi049 bash[23528]: audit 2024-09-20T23:09:17.653205+0000 mgr.a (mgr.14388) 2366 : audit [DBG] from='client.62976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:19 smithi044 bash[22676]: cluster 2024-09-20T23:09:18.644598+0000 mgr.a (mgr.14388) 2367 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:19 smithi179 bash[23186]: cluster 2024-09-20T23:09:18.644598+0000 mgr.a (mgr.14388) 2367 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:19 smithi049 bash[23528]: cluster 2024-09-20T23:09:18.644598+0000 mgr.a (mgr.14388) 2367 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:21 smithi044 bash[22676]: cluster 2024-09-20T23:09:20.646810+0000 mgr.a (mgr.14388) 2368 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:21 smithi179 bash[23186]: cluster 2024-09-20T23:09:20.646810+0000 mgr.a (mgr.14388) 2368 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:21 smithi049 bash[23528]: cluster 2024-09-20T23:09:20.646810+0000 mgr.a (mgr.14388) 2368 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:23.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:23.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:23.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:23.867 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:23.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:23.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:23.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:23.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:23 smithi044 bash[22676]: cluster 2024-09-20T23:09:22.647708+0000 mgr.a (mgr.14388) 2369 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:23 smithi044 bash[22676]: audit 2024-09-20T23:09:23.440886+0000 mgr.a (mgr.14388) 2370 : audit [DBG] from='client.63048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:23 smithi179 bash[23186]: cluster 2024-09-20T23:09:22.647708+0000 mgr.a (mgr.14388) 2369 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:23 smithi179 bash[23186]: audit 2024-09-20T23:09:23.440886+0000 mgr.a (mgr.14388) 2370 : audit [DBG] from='client.63048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:23 smithi049 bash[23528]: cluster 2024-09-20T23:09:22.647708+0000 mgr.a (mgr.14388) 2369 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:23 smithi049 bash[23528]: audit 2024-09-20T23:09:23.440886+0000 mgr.a (mgr.14388) 2370 : audit [DBG] from='client.63048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:25 smithi044 bash[22676]: cluster 2024-09-20T23:09:24.648549+0000 mgr.a (mgr.14388) 2371 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:25 smithi179 bash[23186]: cluster 2024-09-20T23:09:24.648549+0000 mgr.a (mgr.14388) 2371 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:25 smithi049 bash[23528]: cluster 2024-09-20T23:09:24.648549+0000 mgr.a (mgr.14388) 2371 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:27 smithi044 bash[22676]: cluster 2024-09-20T23:09:26.650796+0000 mgr.a (mgr.14388) 2372 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:27 smithi179 bash[23186]: cluster 2024-09-20T23:09:26.650796+0000 mgr.a (mgr.14388) 2372 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:27 smithi049 bash[23528]: cluster 2024-09-20T23:09:26.650796+0000 mgr.a (mgr.14388) 2372 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:29.639 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: cluster 2024-09-20T23:09:28.651554+0000 mgr.a (mgr.14388) 2373 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: audit 2024-09-20T23:09:28.747562+0000 mon.a (mon.0) 2600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: audit 2024-09-20T23:09:28.757380+0000 mon.a (mon.0) 2601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: audit 2024-09-20T23:09:28.767533+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: audit 2024-09-20T23:09:28.918642+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: audit 2024-09-20T23:09:28.927028+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: audit 2024-09-20T23:09:28.936568+0000 mon.a (mon.0) 2605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:29 smithi179 bash[23186]: audit 2024-09-20T23:09:29.210575+0000 mgr.a (mgr.14388) 2374 : audit [DBG] from='client.63120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: cluster 2024-09-20T23:09:28.651554+0000 mgr.a (mgr.14388) 2373 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: audit 2024-09-20T23:09:28.747562+0000 mon.a (mon.0) 2600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: audit 2024-09-20T23:09:28.757380+0000 mon.a (mon.0) 2601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: audit 2024-09-20T23:09:28.767533+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: audit 2024-09-20T23:09:28.918642+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: audit 2024-09-20T23:09:28.927028+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: audit 2024-09-20T23:09:28.936568+0000 mon.a (mon.0) 2605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:29 smithi049 bash[23528]: audit 2024-09-20T23:09:29.210575+0000 mgr.a (mgr.14388) 2374 : audit [DBG] from='client.63120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: cluster 2024-09-20T23:09:28.651554+0000 mgr.a (mgr.14388) 2373 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: audit 2024-09-20T23:09:28.747562+0000 mon.a (mon.0) 2600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: audit 2024-09-20T23:09:28.757380+0000 mon.a (mon.0) 2601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: audit 2024-09-20T23:09:28.767533+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: audit 2024-09-20T23:09:28.918642+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: audit 2024-09-20T23:09:28.927028+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: audit 2024-09-20T23:09:28.936568+0000 mon.a (mon.0) 2605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:29 smithi044 bash[22676]: audit 2024-09-20T23:09:29.210575+0000 mgr.a (mgr.14388) 2374 : audit [DBG] from='client.63120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:31 smithi044 bash[22676]: cluster 2024-09-20T23:09:30.653994+0000 mgr.a (mgr.14388) 2375 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:31 smithi044 bash[22676]: audit 2024-09-20T23:09:30.734585+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:31 smithi044 bash[22676]: audit 2024-09-20T23:09:30.743248+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:31 smithi044 bash[22676]: audit 2024-09-20T23:09:30.757791+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:31 smithi179 bash[23186]: cluster 2024-09-20T23:09:30.653994+0000 mgr.a (mgr.14388) 2375 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:31 smithi179 bash[23186]: audit 2024-09-20T23:09:30.734585+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:31 smithi179 bash[23186]: audit 2024-09-20T23:09:30.743248+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:31 smithi179 bash[23186]: audit 2024-09-20T23:09:30.757791+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:31 smithi049 bash[23528]: cluster 2024-09-20T23:09:30.653994+0000 mgr.a (mgr.14388) 2375 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:09:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:31 smithi049 bash[23528]: audit 2024-09-20T23:09:30.734585+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:31 smithi049 bash[23528]: audit 2024-09-20T23:09:30.743248+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:31 smithi049 bash[23528]: audit 2024-09-20T23:09:30.757791+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:33 smithi179 bash[23186]: cluster 2024-09-20T23:09:32.654959+0000 mgr.a (mgr.14388) 2376 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:33 smithi049 bash[23528]: cluster 2024-09-20T23:09:32.654959+0000 mgr.a (mgr.14388) 2376 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:33 smithi044 bash[22676]: cluster 2024-09-20T23:09:32.654959+0000 mgr.a (mgr.14388) 2376 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:35.389 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:35 smithi179 bash[23186]: cluster 2024-09-20T23:09:34.655537+0000 mgr.a (mgr.14388) 2377 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:35 smithi179 bash[23186]: audit 2024-09-20T23:09:34.962014+0000 mgr.a (mgr.14388) 2378 : audit [DBG] from='client.63195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:35 smithi049 bash[23528]: cluster 2024-09-20T23:09:34.655537+0000 mgr.a (mgr.14388) 2377 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:35 smithi049 bash[23528]: audit 2024-09-20T23:09:34.962014+0000 mgr.a (mgr.14388) 2378 : audit [DBG] from='client.63195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:35 smithi044 bash[22676]: cluster 2024-09-20T23:09:34.655537+0000 mgr.a (mgr.14388) 2377 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:35 smithi044 bash[22676]: audit 2024-09-20T23:09:34.962014+0000 mgr.a (mgr.14388) 2378 : audit [DBG] from='client.63195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:37 smithi179 bash[23186]: cluster 2024-09-20T23:09:36.658187+0000 mgr.a (mgr.14388) 2379 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:37 smithi049 bash[23528]: cluster 2024-09-20T23:09:36.658187+0000 mgr.a (mgr.14388) 2379 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:37 smithi044 bash[22676]: cluster 2024-09-20T23:09:36.658187+0000 mgr.a (mgr.14388) 2379 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:39 smithi179 bash[23186]: cluster 2024-09-20T23:09:38.659015+0000 mgr.a (mgr.14388) 2380 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:39 smithi049 bash[23528]: cluster 2024-09-20T23:09:38.659015+0000 mgr.a (mgr.14388) 2380 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:39 smithi044 bash[22676]: cluster 2024-09-20T23:09:38.659015+0000 mgr.a (mgr.14388) 2380 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:40.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:40.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:40.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:41.172 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:41.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:41.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:41.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:41.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:41 smithi179 bash[23186]: cluster 2024-09-20T23:09:40.660938+0000 mgr.a (mgr.14388) 2381 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:41 smithi179 bash[23186]: audit 2024-09-20T23:09:40.726673+0000 mgr.a (mgr.14388) 2382 : audit [DBG] from='client.63273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:41 smithi049 bash[23528]: cluster 2024-09-20T23:09:40.660938+0000 mgr.a (mgr.14388) 2381 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:41 smithi049 bash[23528]: audit 2024-09-20T23:09:40.726673+0000 mgr.a (mgr.14388) 2382 : audit [DBG] from='client.63273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:41 smithi044 bash[22676]: cluster 2024-09-20T23:09:40.660938+0000 mgr.a (mgr.14388) 2381 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:41 smithi044 bash[22676]: audit 2024-09-20T23:09:40.726673+0000 mgr.a (mgr.14388) 2382 : audit [DBG] from='client.63273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:43 smithi179 bash[23186]: cluster 2024-09-20T23:09:42.661931+0000 mgr.a (mgr.14388) 2383 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:43 smithi049 bash[23528]: cluster 2024-09-20T23:09:42.661931+0000 mgr.a (mgr.14388) 2383 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:43 smithi044 bash[22676]: cluster 2024-09-20T23:09:42.661931+0000 mgr.a (mgr.14388) 2383 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:09:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:45 smithi179 bash[23186]: cluster 2024-09-20T23:09:44.662648+0000 mgr.a (mgr.14388) 2384 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:45 smithi049 bash[23528]: cluster 2024-09-20T23:09:44.662648+0000 mgr.a (mgr.14388) 2384 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:46.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:46.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:46.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:45 smithi044 bash[22676]: cluster 2024-09-20T23:09:44.662648+0000 mgr.a (mgr.14388) 2384 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:09:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:46 smithi049 bash[23528]: audit 2024-09-20T23:09:46.166212+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:46 smithi049 bash[23528]: audit 2024-09-20T23:09:46.172724+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:46 smithi049 bash[23528]: audit 2024-09-20T23:09:46.174593+0000 mon.a (mon.0) 2611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:46 smithi049 bash[23528]: audit 2024-09-20T23:09:46.183426+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:46 smithi049 bash[23528]: audit 2024-09-20T23:09:46.189857+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:09:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:46 smithi049 bash[23528]: audit 2024-09-20T23:09:46.192183+0000 mgr.a (mgr.14388) 2385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:09:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:46 smithi049 bash[23528]: audit 2024-09-20T23:09:46.529002+0000 mgr.a (mgr.14388) 2386 : audit [DBG] from='client.63351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:47.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22930]: debug 2024-09-20T23:09:46.925+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:09:47.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22930]: debug 2024-09-20T23:09:46.937+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:09:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22676]: audit 2024-09-20T23:09:46.166212+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22676]: audit 2024-09-20T23:09:46.172724+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22676]: audit 2024-09-20T23:09:46.174593+0000 mon.a (mon.0) 2611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22676]: audit 2024-09-20T23:09:46.183426+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22676]: audit 2024-09-20T23:09:46.189857+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:09:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22676]: audit 2024-09-20T23:09:46.192183+0000 mgr.a (mgr.14388) 2385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:09:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:46 smithi044 bash[22676]: audit 2024-09-20T23:09:46.529002+0000 mgr.a (mgr.14388) 2386 : audit [DBG] from='client.63351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:46 smithi179 bash[23186]: audit 2024-09-20T23:09:46.166212+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:09:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:46 smithi179 bash[23186]: audit 2024-09-20T23:09:46.172724+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:09:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:46 smithi179 bash[23186]: audit 2024-09-20T23:09:46.174593+0000 mon.a (mon.0) 2611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:09:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:46 smithi179 bash[23186]: audit 2024-09-20T23:09:46.183426+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:46 smithi179 bash[23186]: audit 2024-09-20T23:09:46.189857+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:09:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:46 smithi179 bash[23186]: audit 2024-09-20T23:09:46.192183+0000 mgr.a (mgr.14388) 2385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:09:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:46 smithi179 bash[23186]: audit 2024-09-20T23:09:46.529002+0000 mgr.a (mgr.14388) 2386 : audit [DBG] from='client.63351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:47.331 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:47.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:47.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:47.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:47.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:48 smithi044 bash[22676]: cluster 2024-09-20T23:09:46.665622+0000 mgr.a (mgr.14388) 2387 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:48 smithi044 bash[22676]: audit 2024-09-20T23:09:46.930557+0000 mgr.a (mgr.14388) 2388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:09:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:48 smithi044 bash[22676]: cephadm 2024-09-20T23:09:46.942256+0000 mgr.a (mgr.14388) 2389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:09:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:48 smithi179 bash[23186]: cluster 2024-09-20T23:09:46.665622+0000 mgr.a (mgr.14388) 2387 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:48 smithi179 bash[23186]: audit 2024-09-20T23:09:46.930557+0000 mgr.a (mgr.14388) 2388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:09:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:48 smithi179 bash[23186]: cephadm 2024-09-20T23:09:46.942256+0000 mgr.a (mgr.14388) 2389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:09:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:48 smithi049 bash[23528]: cluster 2024-09-20T23:09:46.665622+0000 mgr.a (mgr.14388) 2387 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:48 smithi049 bash[23528]: audit 2024-09-20T23:09:46.930557+0000 mgr.a (mgr.14388) 2388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:09:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:48 smithi049 bash[23528]: cephadm 2024-09-20T23:09:46.942256+0000 mgr.a (mgr.14388) 2389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:49 smithi044 bash[22676]: cluster 2024-09-20T23:09:48.666616+0000 mgr.a (mgr.14388) 2390 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:49 smithi044 bash[22676]: audit 2024-09-20T23:09:48.978849+0000 mon.a (mon.0) 2614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:49 smithi044 bash[22676]: audit 2024-09-20T23:09:48.987586+0000 mon.a (mon.0) 2615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:49 smithi044 bash[22676]: audit 2024-09-20T23:09:48.997837+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:49 smithi044 bash[22676]: audit 2024-09-20T23:09:49.144999+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:49 smithi044 bash[22676]: audit 2024-09-20T23:09:49.153431+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:49 smithi044 bash[22676]: audit 2024-09-20T23:09:49.163655+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:49 smithi179 bash[23186]: cluster 2024-09-20T23:09:48.666616+0000 mgr.a (mgr.14388) 2390 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:49 smithi179 bash[23186]: audit 2024-09-20T23:09:48.978849+0000 mon.a (mon.0) 2614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:49 smithi179 bash[23186]: audit 2024-09-20T23:09:48.987586+0000 mon.a (mon.0) 2615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:49 smithi179 bash[23186]: audit 2024-09-20T23:09:48.997837+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:49 smithi179 bash[23186]: audit 2024-09-20T23:09:49.144999+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:49 smithi179 bash[23186]: audit 2024-09-20T23:09:49.153431+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:49 smithi179 bash[23186]: audit 2024-09-20T23:09:49.163655+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:49 smithi049 bash[23528]: cluster 2024-09-20T23:09:48.666616+0000 mgr.a (mgr.14388) 2390 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:09:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:49 smithi049 bash[23528]: audit 2024-09-20T23:09:48.978849+0000 mon.a (mon.0) 2614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:49 smithi049 bash[23528]: audit 2024-09-20T23:09:48.987586+0000 mon.a (mon.0) 2615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:49 smithi049 bash[23528]: audit 2024-09-20T23:09:48.997837+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:49 smithi049 bash[23528]: audit 2024-09-20T23:09:49.144999+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:49 smithi049 bash[23528]: audit 2024-09-20T23:09:49.153431+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:49 smithi049 bash[23528]: audit 2024-09-20T23:09:49.163655+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:51 smithi044 bash[22676]: cluster 2024-09-20T23:09:50.668882+0000 mgr.a (mgr.14388) 2391 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:51 smithi044 bash[22676]: audit 2024-09-20T23:09:50.912316+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:51 smithi044 bash[22676]: audit 2024-09-20T23:09:50.919274+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:51 smithi044 bash[22676]: audit 2024-09-20T23:09:50.928499+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:51 smithi179 bash[23186]: cluster 2024-09-20T23:09:50.668882+0000 mgr.a (mgr.14388) 2391 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:51 smithi179 bash[23186]: audit 2024-09-20T23:09:50.912316+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:51 smithi179 bash[23186]: audit 2024-09-20T23:09:50.919274+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:51 smithi179 bash[23186]: audit 2024-09-20T23:09:50.928499+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:51 smithi049 bash[23528]: cluster 2024-09-20T23:09:50.668882+0000 mgr.a (mgr.14388) 2391 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:51 smithi049 bash[23528]: audit 2024-09-20T23:09:50.912316+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:51 smithi049 bash[23528]: audit 2024-09-20T23:09:50.919274+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:51 smithi049 bash[23528]: audit 2024-09-20T23:09:50.928499+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:09:52.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:52.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:52.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:53.105 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:53.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:53.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:53.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:53.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:53 smithi044 bash[22676]: audit 2024-09-20T23:09:52.658377+0000 mgr.a (mgr.14388) 2392 : audit [DBG] from='client.63534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:53 smithi044 bash[22676]: cluster 2024-09-20T23:09:52.677071+0000 mgr.a (mgr.14388) 2393 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:53 smithi179 bash[23186]: audit 2024-09-20T23:09:52.658377+0000 mgr.a (mgr.14388) 2392 : audit [DBG] from='client.63534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:53 smithi179 bash[23186]: cluster 2024-09-20T23:09:52.677071+0000 mgr.a (mgr.14388) 2393 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:53 smithi049 bash[23528]: audit 2024-09-20T23:09:52.658377+0000 mgr.a (mgr.14388) 2392 : audit [DBG] from='client.63534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:53 smithi049 bash[23528]: cluster 2024-09-20T23:09:52.677071+0000 mgr.a (mgr.14388) 2393 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:55 smithi044 bash[22676]: cluster 2024-09-20T23:09:54.678140+0000 mgr.a (mgr.14388) 2394 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:55 smithi179 bash[23186]: cluster 2024-09-20T23:09:54.678140+0000 mgr.a (mgr.14388) 2394 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:55 smithi049 bash[23528]: cluster 2024-09-20T23:09:54.678140+0000 mgr.a (mgr.14388) 2394 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:58.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:09:58.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:09:58.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:09:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:57 smithi044 bash[22676]: cluster 2024-09-20T23:09:56.680408+0000 mgr.a (mgr.14388) 2395 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:57 smithi179 bash[23186]: cluster 2024-09-20T23:09:56.680408+0000 mgr.a (mgr.14388) 2395 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:57 smithi049 bash[23528]: cluster 2024-09-20T23:09:56.680408+0000 mgr.a (mgr.14388) 2395 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:09:58.896 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:09:58.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:09:58.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:09:58.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:09:58.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:09:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:58 smithi044 bash[22676]: audit 2024-09-20T23:09:58.452132+0000 mgr.a (mgr.14388) 2396 : audit [DBG] from='client.63609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:58 smithi179 bash[23186]: audit 2024-09-20T23:09:58.452132+0000 mgr.a (mgr.14388) 2396 : audit [DBG] from='client.63609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:09:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:58 smithi049 bash[23528]: audit 2024-09-20T23:09:58.452132+0000 mgr.a (mgr.14388) 2396 : audit [DBG] from='client.63609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:09:59 smithi044 bash[22676]: cluster 2024-09-20T23:09:58.680935+0000 mgr.a (mgr.14388) 2397 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:09:59 smithi179 bash[23186]: cluster 2024-09-20T23:09:58.680935+0000 mgr.a (mgr.14388) 2397 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:09:59 smithi049 bash[23528]: cluster 2024-09-20T23:09:58.680935+0000 mgr.a (mgr.14388) 2397 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:00 smithi044 bash[22676]: cluster 2024-09-20T23:10:00.000154+0000 mon.a (mon.0) 2623 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:10:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:00 smithi179 bash[23186]: cluster 2024-09-20T23:10:00.000154+0000 mon.a (mon.0) 2623 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:10:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:00 smithi049 bash[23528]: cluster 2024-09-20T23:10:00.000154+0000 mon.a (mon.0) 2623 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:10:02.232 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:01 smithi179 bash[23186]: cluster 2024-09-20T23:10:00.683249+0000 mgr.a (mgr.14388) 2398 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:01 smithi044 bash[22676]: cluster 2024-09-20T23:10:00.683249+0000 mgr.a (mgr.14388) 2398 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:01 smithi049 bash[23528]: cluster 2024-09-20T23:10:00.683249+0000 mgr.a (mgr.14388) 2398 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:03.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:03.899 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:03.899 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:03 smithi044 bash[22676]: cluster 2024-09-20T23:10:02.684073+0000 mgr.a (mgr.14388) 2399 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:03 smithi179 bash[23186]: cluster 2024-09-20T23:10:02.684073+0000 mgr.a (mgr.14388) 2399 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:03 smithi049 bash[23528]: cluster 2024-09-20T23:10:02.684073+0000 mgr.a (mgr.14388) 2399 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:04.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:04.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:04.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:04.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:04.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:04 smithi044 bash[22676]: audit 2024-09-20T23:10:04.235651+0000 mgr.a (mgr.14388) 2400 : audit [DBG] from='client.63684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:04 smithi179 bash[23186]: audit 2024-09-20T23:10:04.235651+0000 mgr.a (mgr.14388) 2400 : audit [DBG] from='client.63684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:04 smithi049 bash[23528]: audit 2024-09-20T23:10:04.235651+0000 mgr.a (mgr.14388) 2400 : audit [DBG] from='client.63684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:05 smithi044 bash[22676]: cluster 2024-09-20T23:10:04.684898+0000 mgr.a (mgr.14388) 2401 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:05 smithi179 bash[23186]: cluster 2024-09-20T23:10:04.684898+0000 mgr.a (mgr.14388) 2401 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:06.280 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:05 smithi049 bash[23528]: cluster 2024-09-20T23:10:04.684898+0000 mgr.a (mgr.14388) 2401 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:07 smithi044 bash[22676]: cluster 2024-09-20T23:10:06.687135+0000 mgr.a (mgr.14388) 2402 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:07 smithi179 bash[23186]: cluster 2024-09-20T23:10:06.687135+0000 mgr.a (mgr.14388) 2402 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:07 smithi049 bash[23528]: cluster 2024-09-20T23:10:06.687135+0000 mgr.a (mgr.14388) 2402 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:09.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:09.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:09.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:10.432 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:10.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:10.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:10.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:10.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:10 smithi044 bash[22676]: cluster 2024-09-20T23:10:08.687919+0000 mgr.a (mgr.14388) 2403 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:10 smithi044 bash[22676]: audit 2024-09-20T23:10:09.170762+0000 mon.a (mon.0) 2624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:10 smithi044 bash[22676]: audit 2024-09-20T23:10:09.179486+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:10 smithi044 bash[22676]: audit 2024-09-20T23:10:09.189757+0000 mon.a (mon.0) 2626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:10 smithi044 bash[22676]: audit 2024-09-20T23:10:09.373890+0000 mon.a (mon.0) 2627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:10 smithi044 bash[22676]: audit 2024-09-20T23:10:09.382081+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:10 smithi044 bash[22676]: audit 2024-09-20T23:10:09.391907+0000 mon.a (mon.0) 2629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:10 smithi179 bash[23186]: cluster 2024-09-20T23:10:08.687919+0000 mgr.a (mgr.14388) 2403 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:10 smithi179 bash[23186]: audit 2024-09-20T23:10:09.170762+0000 mon.a (mon.0) 2624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:10 smithi179 bash[23186]: audit 2024-09-20T23:10:09.179486+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:10 smithi179 bash[23186]: audit 2024-09-20T23:10:09.189757+0000 mon.a (mon.0) 2626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:10 smithi179 bash[23186]: audit 2024-09-20T23:10:09.373890+0000 mon.a (mon.0) 2627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:10 smithi179 bash[23186]: audit 2024-09-20T23:10:09.382081+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:10 smithi179 bash[23186]: audit 2024-09-20T23:10:09.391907+0000 mon.a (mon.0) 2629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:10 smithi049 bash[23528]: cluster 2024-09-20T23:10:08.687919+0000 mgr.a (mgr.14388) 2403 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:10 smithi049 bash[23528]: audit 2024-09-20T23:10:09.170762+0000 mon.a (mon.0) 2624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:10 smithi049 bash[23528]: audit 2024-09-20T23:10:09.179486+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:10 smithi049 bash[23528]: audit 2024-09-20T23:10:09.189757+0000 mon.a (mon.0) 2626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:10 smithi049 bash[23528]: audit 2024-09-20T23:10:09.373890+0000 mon.a (mon.0) 2627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:10 smithi049 bash[23528]: audit 2024-09-20T23:10:09.382081+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:10 smithi049 bash[23528]: audit 2024-09-20T23:10:09.391907+0000 mon.a (mon.0) 2629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:11 smithi044 bash[22676]: audit 2024-09-20T23:10:10.011400+0000 mgr.a (mgr.14388) 2404 : audit [DBG] from='client.63759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:11 smithi044 bash[22676]: audit 2024-09-20T23:10:11.144076+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:11 smithi044 bash[22676]: audit 2024-09-20T23:10:11.150506+0000 mon.a (mon.0) 2631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:11 smithi044 bash[22676]: audit 2024-09-20T23:10:11.160595+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:11 smithi179 bash[23186]: audit 2024-09-20T23:10:10.011400+0000 mgr.a (mgr.14388) 2404 : audit [DBG] from='client.63759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:11 smithi179 bash[23186]: audit 2024-09-20T23:10:11.144076+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:11 smithi179 bash[23186]: audit 2024-09-20T23:10:11.150506+0000 mon.a (mon.0) 2631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:11 smithi179 bash[23186]: audit 2024-09-20T23:10:11.160595+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:11 smithi049 bash[23528]: audit 2024-09-20T23:10:10.011400+0000 mgr.a (mgr.14388) 2404 : audit [DBG] from='client.63759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:11 smithi049 bash[23528]: audit 2024-09-20T23:10:11.144076+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:11 smithi049 bash[23528]: audit 2024-09-20T23:10:11.150506+0000 mon.a (mon.0) 2631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:11 smithi049 bash[23528]: audit 2024-09-20T23:10:11.160595+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:12 smithi044 bash[22676]: cluster 2024-09-20T23:10:10.690682+0000 mgr.a (mgr.14388) 2405 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:12 smithi179 bash[23186]: cluster 2024-09-20T23:10:10.690682+0000 mgr.a (mgr.14388) 2405 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:12 smithi049 bash[23528]: cluster 2024-09-20T23:10:10.690682+0000 mgr.a (mgr.14388) 2405 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:14 smithi044 bash[22676]: cluster 2024-09-20T23:10:12.691489+0000 mgr.a (mgr.14388) 2406 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:10:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:14 smithi179 bash[23186]: cluster 2024-09-20T23:10:12.691489+0000 mgr.a (mgr.14388) 2406 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:10:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:14 smithi049 bash[23528]: cluster 2024-09-20T23:10:12.691489+0000 mgr.a (mgr.14388) 2406 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:10:15.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:15.434 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:15.435 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:16.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:16.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:16.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:16.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:16.228 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:16.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:16 smithi044 bash[22676]: cluster 2024-09-20T23:10:14.692253+0000 mgr.a (mgr.14388) 2407 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:10:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:16 smithi179 bash[23186]: cluster 2024-09-20T23:10:14.692253+0000 mgr.a (mgr.14388) 2407 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:10:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:16 smithi049 bash[23528]: cluster 2024-09-20T23:10:14.692253+0000 mgr.a (mgr.14388) 2407 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:10:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:17 smithi044 bash[22676]: audit 2024-09-20T23:10:15.770959+0000 mgr.a (mgr.14388) 2408 : audit [DBG] from='client.63837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:17 smithi179 bash[23186]: audit 2024-09-20T23:10:15.770959+0000 mgr.a (mgr.14388) 2408 : audit [DBG] from='client.63837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:17 smithi049 bash[23528]: audit 2024-09-20T23:10:15.770959+0000 mgr.a (mgr.14388) 2408 : audit [DBG] from='client.63837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:18 smithi044 bash[22676]: cluster 2024-09-20T23:10:16.694702+0000 mgr.a (mgr.14388) 2409 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:18 smithi179 bash[23186]: cluster 2024-09-20T23:10:16.694702+0000 mgr.a (mgr.14388) 2409 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:18 smithi049 bash[23528]: cluster 2024-09-20T23:10:16.694702+0000 mgr.a (mgr.14388) 2409 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:20 smithi044 bash[22676]: cluster 2024-09-20T23:10:18.695272+0000 mgr.a (mgr.14388) 2410 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:10:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:20 smithi179 bash[23186]: cluster 2024-09-20T23:10:18.695272+0000 mgr.a (mgr.14388) 2410 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:10:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:20 smithi049 bash[23528]: cluster 2024-09-20T23:10:18.695272+0000 mgr.a (mgr.14388) 2410 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:10:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:21.230 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:21.231 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:22.001 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:22.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:22.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:22.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:22.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:22 smithi044 bash[22676]: cluster 2024-09-20T23:10:20.697412+0000 mgr.a (mgr.14388) 2411 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:22 smithi044 bash[22676]: audit 2024-09-20T23:10:21.567000+0000 mgr.a (mgr.14388) 2412 : audit [DBG] from='client.63906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:22 smithi179 bash[23186]: cluster 2024-09-20T23:10:20.697412+0000 mgr.a (mgr.14388) 2411 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:22 smithi179 bash[23186]: audit 2024-09-20T23:10:21.567000+0000 mgr.a (mgr.14388) 2412 : audit [DBG] from='client.63906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:22 smithi049 bash[23528]: cluster 2024-09-20T23:10:20.697412+0000 mgr.a (mgr.14388) 2411 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:22 smithi049 bash[23528]: audit 2024-09-20T23:10:21.567000+0000 mgr.a (mgr.14388) 2412 : audit [DBG] from='client.63906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:24 smithi044 bash[22676]: cluster 2024-09-20T23:10:22.698570+0000 mgr.a (mgr.14388) 2413 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:24 smithi179 bash[23186]: cluster 2024-09-20T23:10:22.698570+0000 mgr.a (mgr.14388) 2413 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:24 smithi049 bash[23528]: cluster 2024-09-20T23:10:22.698570+0000 mgr.a (mgr.14388) 2413 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:26 smithi044 bash[22676]: cluster 2024-09-20T23:10:24.699379+0000 mgr.a (mgr.14388) 2414 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:26 smithi179 bash[23186]: cluster 2024-09-20T23:10:24.699379+0000 mgr.a (mgr.14388) 2414 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:26 smithi049 bash[23528]: cluster 2024-09-20T23:10:24.699379+0000 mgr.a (mgr.14388) 2414 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:27.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:27.757 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:27.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:27.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:27.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:27.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:28 smithi049 bash[23528]: cluster 2024-09-20T23:10:26.701699+0000 mgr.a (mgr.14388) 2415 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:28 smithi049 bash[23528]: audit 2024-09-20T23:10:27.333658+0000 mgr.a (mgr.14388) 2416 : audit [DBG] from='client.63984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:28 smithi044 bash[22676]: cluster 2024-09-20T23:10:26.701699+0000 mgr.a (mgr.14388) 2415 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:28 smithi044 bash[22676]: audit 2024-09-20T23:10:27.333658+0000 mgr.a (mgr.14388) 2416 : audit [DBG] from='client.63984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:28 smithi179 bash[23186]: cluster 2024-09-20T23:10:26.701699+0000 mgr.a (mgr.14388) 2415 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:28 smithi179 bash[23186]: audit 2024-09-20T23:10:27.333658+0000 mgr.a (mgr.14388) 2416 : audit [DBG] from='client.63984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:30.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:30 smithi049 bash[23528]: cluster 2024-09-20T23:10:28.702853+0000 mgr.a (mgr.14388) 2417 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:30.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:30 smithi049 bash[23528]: audit 2024-09-20T23:10:29.384126+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:30 smithi049 bash[23528]: audit 2024-09-20T23:10:29.392894+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:30 smithi049 bash[23528]: audit 2024-09-20T23:10:29.403306+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:30 smithi049 bash[23528]: audit 2024-09-20T23:10:29.599243+0000 mon.a (mon.0) 2636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:30 smithi049 bash[23528]: audit 2024-09-20T23:10:29.607681+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.422 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:30 smithi049 bash[23528]: audit 2024-09-20T23:10:29.617942+0000 mon.a (mon.0) 2638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:30 smithi044 bash[22676]: cluster 2024-09-20T23:10:28.702853+0000 mgr.a (mgr.14388) 2417 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:30 smithi044 bash[22676]: audit 2024-09-20T23:10:29.384126+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:30 smithi044 bash[22676]: audit 2024-09-20T23:10:29.392894+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:30 smithi044 bash[22676]: audit 2024-09-20T23:10:29.403306+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:30 smithi044 bash[22676]: audit 2024-09-20T23:10:29.599243+0000 mon.a (mon.0) 2636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:30 smithi044 bash[22676]: audit 2024-09-20T23:10:29.607681+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:30 smithi044 bash[22676]: audit 2024-09-20T23:10:29.617942+0000 mon.a (mon.0) 2638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:30 smithi179 bash[23186]: cluster 2024-09-20T23:10:28.702853+0000 mgr.a (mgr.14388) 2417 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:30 smithi179 bash[23186]: audit 2024-09-20T23:10:29.384126+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:30 smithi179 bash[23186]: audit 2024-09-20T23:10:29.392894+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:30 smithi179 bash[23186]: audit 2024-09-20T23:10:29.403306+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:30 smithi179 bash[23186]: audit 2024-09-20T23:10:29.599243+0000 mon.a (mon.0) 2636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:30 smithi179 bash[23186]: audit 2024-09-20T23:10:29.607681+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:30 smithi179 bash[23186]: audit 2024-09-20T23:10:29.617942+0000 mon.a (mon.0) 2638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:32 smithi044 bash[22676]: cluster 2024-09-20T23:10:30.705127+0000 mgr.a (mgr.14388) 2418 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:32 smithi044 bash[22676]: audit 2024-09-20T23:10:31.381747+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:32 smithi044 bash[22676]: audit 2024-09-20T23:10:31.394518+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:32 smithi044 bash[22676]: audit 2024-09-20T23:10:31.406008+0000 mon.a (mon.0) 2641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:32 smithi179 bash[23186]: cluster 2024-09-20T23:10:30.705127+0000 mgr.a (mgr.14388) 2418 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:32 smithi179 bash[23186]: audit 2024-09-20T23:10:31.381747+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:32 smithi179 bash[23186]: audit 2024-09-20T23:10:31.394518+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:32 smithi179 bash[23186]: audit 2024-09-20T23:10:31.406008+0000 mon.a (mon.0) 2641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:32 smithi049 bash[23528]: cluster 2024-09-20T23:10:30.705127+0000 mgr.a (mgr.14388) 2418 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:32 smithi049 bash[23528]: audit 2024-09-20T23:10:31.381747+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:32 smithi049 bash[23528]: audit 2024-09-20T23:10:31.394518+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:32 smithi049 bash[23528]: audit 2024-09-20T23:10:31.406008+0000 mon.a (mon.0) 2641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:33.547 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:34 smithi044 bash[22676]: cluster 2024-09-20T23:10:32.705893+0000 mgr.a (mgr.14388) 2419 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:34 smithi044 bash[22676]: audit 2024-09-20T23:10:33.098441+0000 mgr.a (mgr.14388) 2420 : audit [DBG] from='client.64062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:34 smithi179 bash[23186]: cluster 2024-09-20T23:10:32.705893+0000 mgr.a (mgr.14388) 2419 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:34 smithi179 bash[23186]: audit 2024-09-20T23:10:33.098441+0000 mgr.a (mgr.14388) 2420 : audit [DBG] from='client.64062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:34 smithi049 bash[23528]: cluster 2024-09-20T23:10:32.705893+0000 mgr.a (mgr.14388) 2419 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:34 smithi049 bash[23528]: audit 2024-09-20T23:10:33.098441+0000 mgr.a (mgr.14388) 2420 : audit [DBG] from='client.64062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:36 smithi044 bash[22676]: cluster 2024-09-20T23:10:34.707022+0000 mgr.a (mgr.14388) 2421 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:36 smithi179 bash[23186]: cluster 2024-09-20T23:10:34.707022+0000 mgr.a (mgr.14388) 2421 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:36 smithi049 bash[23528]: cluster 2024-09-20T23:10:34.707022+0000 mgr.a (mgr.14388) 2421 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:38.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:38 smithi044 bash[22676]: cluster 2024-09-20T23:10:36.709466+0000 mgr.a (mgr.14388) 2422 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:38 smithi179 bash[23186]: cluster 2024-09-20T23:10:36.709466+0000 mgr.a (mgr.14388) 2422 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:38 smithi049 bash[23528]: cluster 2024-09-20T23:10:36.709466+0000 mgr.a (mgr.14388) 2422 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:39.298 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:40 smithi044 bash[22676]: cluster 2024-09-20T23:10:38.710212+0000 mgr.a (mgr.14388) 2423 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:40 smithi044 bash[22676]: audit 2024-09-20T23:10:38.888977+0000 mgr.a (mgr.14388) 2424 : audit [DBG] from='client.64137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:40 smithi179 bash[23186]: cluster 2024-09-20T23:10:38.710212+0000 mgr.a (mgr.14388) 2423 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:40 smithi179 bash[23186]: audit 2024-09-20T23:10:38.888977+0000 mgr.a (mgr.14388) 2424 : audit [DBG] from='client.64137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:40 smithi049 bash[23528]: cluster 2024-09-20T23:10:38.710212+0000 mgr.a (mgr.14388) 2423 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:40 smithi049 bash[23528]: audit 2024-09-20T23:10:38.888977+0000 mgr.a (mgr.14388) 2424 : audit [DBG] from='client.64137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:42 smithi044 bash[22676]: cluster 2024-09-20T23:10:40.712575+0000 mgr.a (mgr.14388) 2425 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:42 smithi179 bash[23186]: cluster 2024-09-20T23:10:40.712575+0000 mgr.a (mgr.14388) 2425 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:42 smithi049 bash[23528]: cluster 2024-09-20T23:10:40.712575+0000 mgr.a (mgr.14388) 2425 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:10:44.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:44.300 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:44.300 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:44 smithi179 bash[23186]: cluster 2024-09-20T23:10:42.713389+0000 mgr.a (mgr.14388) 2426 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:44 smithi044 bash[22676]: cluster 2024-09-20T23:10:42.713389+0000 mgr.a (mgr.14388) 2426 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:44 smithi049 bash[23528]: cluster 2024-09-20T23:10:42.713389+0000 mgr.a (mgr.14388) 2426 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:45.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:45.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:45.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:45.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:45.060 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:46 smithi044 bash[22676]: audit 2024-09-20T23:10:44.636713+0000 mgr.a (mgr.14388) 2427 : audit [DBG] from='client.64215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:46 smithi044 bash[22676]: cluster 2024-09-20T23:10:44.713951+0000 mgr.a (mgr.14388) 2428 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:46 smithi179 bash[23186]: audit 2024-09-20T23:10:44.636713+0000 mgr.a (mgr.14388) 2427 : audit [DBG] from='client.64215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:46 smithi179 bash[23186]: cluster 2024-09-20T23:10:44.713951+0000 mgr.a (mgr.14388) 2428 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:46 smithi049 bash[23528]: audit 2024-09-20T23:10:44.636713+0000 mgr.a (mgr.14388) 2427 : audit [DBG] from='client.64215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:46 smithi049 bash[23528]: cluster 2024-09-20T23:10:44.713951+0000 mgr.a (mgr.14388) 2428 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:10:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:47 smithi044 bash[22676]: audit 2024-09-20T23:10:47.003001+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:47 smithi179 bash[23186]: audit 2024-09-20T23:10:47.003001+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:47 smithi049 bash[23528]: audit 2024-09-20T23:10:47.003001+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:10:48.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22930]: debug 2024-09-20T23:10:48.356+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:10:48.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22930]: debug 2024-09-20T23:10:48.360+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: cluster 2024-09-20T23:10:46.716291+0000 mgr.a (mgr.14388) 2429 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.609944+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.614099+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.618738+0000 mon.a (mon.0) 2645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.623704+0000 mon.a (mon.0) 2646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.624644+0000 mon.a (mon.0) 2647 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.625464+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.630600+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:48 smithi044 bash[22676]: audit 2024-09-20T23:10:47.633830+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:10:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: cluster 2024-09-20T23:10:46.716291+0000 mgr.a (mgr.14388) 2429 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-20T23:10:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.609944+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.614099+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.618738+0000 mon.a (mon.0) 2645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.623704+0000 mon.a (mon.0) 2646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.624644+0000 mon.a (mon.0) 2647 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.625464+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.630600+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:48 smithi179 bash[23186]: audit 2024-09-20T23:10:47.633830+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:10:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: cluster 2024-09-20T23:10:46.716291+0000 mgr.a (mgr.14388) 2429 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-20T23:10:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.609944+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.614099+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.618738+0000 mon.a (mon.0) 2645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.623704+0000 mon.a (mon.0) 2646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.624644+0000 mon.a (mon.0) 2647 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:10:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.625464+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:10:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.630600+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:48 smithi049 bash[23528]: audit 2024-09-20T23:10:47.633830+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:10:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:49 smithi044 bash[22676]: audit 2024-09-20T23:10:47.634714+0000 mgr.a (mgr.14388) 2430 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:10:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:49 smithi044 bash[22676]: audit 2024-09-20T23:10:48.359727+0000 mgr.a (mgr.14388) 2431 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:10:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:49 smithi044 bash[22676]: cephadm 2024-09-20T23:10:48.361634+0000 mgr.a (mgr.14388) 2432 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:10:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:49 smithi179 bash[23186]: audit 2024-09-20T23:10:47.634714+0000 mgr.a (mgr.14388) 2430 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:10:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:49 smithi179 bash[23186]: audit 2024-09-20T23:10:48.359727+0000 mgr.a (mgr.14388) 2431 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:10:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:49 smithi179 bash[23186]: cephadm 2024-09-20T23:10:48.361634+0000 mgr.a (mgr.14388) 2432 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:10:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:49 smithi049 bash[23528]: audit 2024-09-20T23:10:47.634714+0000 mgr.a (mgr.14388) 2430 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:10:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:49 smithi049 bash[23528]: audit 2024-09-20T23:10:48.359727+0000 mgr.a (mgr.14388) 2431 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:10:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:49 smithi049 bash[23528]: cephadm 2024-09-20T23:10:48.361634+0000 mgr.a (mgr.14388) 2432 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:10:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:50.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:50.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:50 smithi044 bash[22676]: cluster 2024-09-20T23:10:48.717302+0000 mgr.a (mgr.14388) 2433 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-20T23:10:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:50 smithi044 bash[22676]: audit 2024-09-20T23:10:49.570828+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:50 smithi044 bash[22676]: audit 2024-09-20T23:10:49.580581+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:50 smithi044 bash[22676]: audit 2024-09-20T23:10:49.591929+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:50 smithi044 bash[22676]: audit 2024-09-20T23:10:49.808549+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:50 smithi044 bash[22676]: audit 2024-09-20T23:10:49.816878+0000 mon.a (mon.0) 2655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:50 smithi044 bash[22676]: audit 2024-09-20T23:10:49.826838+0000 mon.a (mon.0) 2656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:50 smithi179 bash[23186]: cluster 2024-09-20T23:10:48.717302+0000 mgr.a (mgr.14388) 2433 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-20T23:10:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:50 smithi179 bash[23186]: audit 2024-09-20T23:10:49.570828+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:50 smithi179 bash[23186]: audit 2024-09-20T23:10:49.580581+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:50 smithi179 bash[23186]: audit 2024-09-20T23:10:49.591929+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:50 smithi179 bash[23186]: audit 2024-09-20T23:10:49.808549+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:50 smithi179 bash[23186]: audit 2024-09-20T23:10:49.816878+0000 mon.a (mon.0) 2655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:50 smithi179 bash[23186]: audit 2024-09-20T23:10:49.826838+0000 mon.a (mon.0) 2656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:50 smithi049 bash[23528]: cluster 2024-09-20T23:10:48.717302+0000 mgr.a (mgr.14388) 2433 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-20T23:10:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:50 smithi049 bash[23528]: audit 2024-09-20T23:10:49.570828+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:50 smithi049 bash[23528]: audit 2024-09-20T23:10:49.580581+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:50 smithi049 bash[23528]: audit 2024-09-20T23:10:49.591929+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:50 smithi049 bash[23528]: audit 2024-09-20T23:10:49.808549+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:50 smithi049 bash[23528]: audit 2024-09-20T23:10:49.816878+0000 mon.a (mon.0) 2655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:50 smithi049 bash[23528]: audit 2024-09-20T23:10:49.826838+0000 mon.a (mon.0) 2656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:51.833 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:51 smithi049 bash[23528]: audit 2024-09-20T23:10:50.398437+0000 mgr.a (mgr.14388) 2434 : audit [DBG] from='client.64401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:51 smithi044 bash[22676]: audit 2024-09-20T23:10:50.398437+0000 mgr.a (mgr.14388) 2434 : audit [DBG] from='client.64401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:51 smithi179 bash[23186]: audit 2024-09-20T23:10:50.398437+0000 mgr.a (mgr.14388) 2434 : audit [DBG] from='client.64401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:52 smithi044 bash[22676]: cluster 2024-09-20T23:10:50.718551+0000 mgr.a (mgr.14388) 2435 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:52 smithi044 bash[22676]: audit 2024-09-20T23:10:51.605568+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:52 smithi044 bash[22676]: audit 2024-09-20T23:10:51.610810+0000 mon.a (mon.0) 2658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:52 smithi044 bash[22676]: audit 2024-09-20T23:10:51.615777+0000 mon.a (mon.0) 2659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:52 smithi179 bash[23186]: cluster 2024-09-20T23:10:50.718551+0000 mgr.a (mgr.14388) 2435 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:52 smithi179 bash[23186]: audit 2024-09-20T23:10:51.605568+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:52 smithi179 bash[23186]: audit 2024-09-20T23:10:51.610810+0000 mon.a (mon.0) 2658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:52 smithi179 bash[23186]: audit 2024-09-20T23:10:51.615777+0000 mon.a (mon.0) 2659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:52 smithi049 bash[23528]: cluster 2024-09-20T23:10:50.718551+0000 mgr.a (mgr.14388) 2435 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:52 smithi049 bash[23528]: audit 2024-09-20T23:10:51.605568+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:52 smithi049 bash[23528]: audit 2024-09-20T23:10:51.610810+0000 mon.a (mon.0) 2658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:52 smithi049 bash[23528]: audit 2024-09-20T23:10:51.615777+0000 mon.a (mon.0) 2659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:10:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:54 smithi044 bash[22676]: cluster 2024-09-20T23:10:52.719440+0000 mgr.a (mgr.14388) 2436 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:10:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:54 smithi179 bash[23186]: cluster 2024-09-20T23:10:52.719440+0000 mgr.a (mgr.14388) 2436 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:10:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:54 smithi049 bash[23528]: cluster 2024-09-20T23:10:52.719440+0000 mgr.a (mgr.14388) 2436 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:10:55.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:10:55.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:10:55.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:10:56.587 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:10:56.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:10:56.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:10:56.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:10:56.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:10:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:56 smithi044 bash[22676]: cluster 2024-09-20T23:10:54.720220+0000 mgr.a (mgr.14388) 2437 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:10:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:56 smithi179 bash[23186]: cluster 2024-09-20T23:10:54.720220+0000 mgr.a (mgr.14388) 2437 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:10:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:56 smithi049 bash[23528]: cluster 2024-09-20T23:10:54.720220+0000 mgr.a (mgr.14388) 2437 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:10:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:57 smithi044 bash[22676]: audit 2024-09-20T23:10:56.162964+0000 mgr.a (mgr.14388) 2438 : audit [DBG] from='client.64479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:57 smithi179 bash[23186]: audit 2024-09-20T23:10:56.162964+0000 mgr.a (mgr.14388) 2438 : audit [DBG] from='client.64479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:57 smithi049 bash[23528]: audit 2024-09-20T23:10:56.162964+0000 mgr.a (mgr.14388) 2438 : audit [DBG] from='client.64479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:10:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:10:58 smithi044 bash[22676]: cluster 2024-09-20T23:10:56.722953+0000 mgr.a (mgr.14388) 2439 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:10:58 smithi179 bash[23186]: cluster 2024-09-20T23:10:56.722953+0000 mgr.a (mgr.14388) 2439 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:10:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:10:58 smithi049 bash[23528]: cluster 2024-09-20T23:10:56.722953+0000 mgr.a (mgr.14388) 2439 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:00.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:00 smithi044 bash[22676]: cluster 2024-09-20T23:10:58.723775+0000 mgr.a (mgr.14388) 2440 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:11:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:00 smithi179 bash[23186]: cluster 2024-09-20T23:10:58.723775+0000 mgr.a (mgr.14388) 2440 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:11:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:00 smithi049 bash[23528]: cluster 2024-09-20T23:10:58.723775+0000 mgr.a (mgr.14388) 2440 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:11:01.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:01.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:01.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:01 smithi044 bash[22676]: cluster 2024-09-20T23:11:00.724875+0000 mgr.a (mgr.14388) 2441 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:01 smithi179 bash[23186]: cluster 2024-09-20T23:11:00.724875+0000 mgr.a (mgr.14388) 2441 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:01 smithi049 bash[23528]: cluster 2024-09-20T23:11:00.724875+0000 mgr.a (mgr.14388) 2441 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:02.383 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:02.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:02 smithi044 bash[22676]: audit 2024-09-20T23:11:01.928615+0000 mgr.a (mgr.14388) 2442 : audit [DBG] from='client.64557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:02 smithi179 bash[23186]: audit 2024-09-20T23:11:01.928615+0000 mgr.a (mgr.14388) 2442 : audit [DBG] from='client.64557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:02 smithi049 bash[23528]: audit 2024-09-20T23:11:01.928615+0000 mgr.a (mgr.14388) 2442 : audit [DBG] from='client.64557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:03 smithi044 bash[22676]: cluster 2024-09-20T23:11:02.725858+0000 mgr.a (mgr.14388) 2443 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:03 smithi179 bash[23186]: cluster 2024-09-20T23:11:02.725858+0000 mgr.a (mgr.14388) 2443 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:03 smithi049 bash[23528]: cluster 2024-09-20T23:11:02.725858+0000 mgr.a (mgr.14388) 2443 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:05 smithi049 bash[23528]: cluster 2024-09-20T23:11:04.726653+0000 mgr.a (mgr.14388) 2444 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:05 smithi044 bash[22676]: cluster 2024-09-20T23:11:04.726653+0000 mgr.a (mgr.14388) 2444 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:05 smithi179 bash[23186]: cluster 2024-09-20T23:11:04.726653+0000 mgr.a (mgr.14388) 2444 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:07.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:07.386 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:07.386 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:07 smithi049 bash[23528]: cluster 2024-09-20T23:11:06.728887+0000 mgr.a (mgr.14388) 2445 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:08.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:08.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:08.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:08.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:08.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:07 smithi044 bash[22676]: cluster 2024-09-20T23:11:06.728887+0000 mgr.a (mgr.14388) 2445 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:07 smithi179 bash[23186]: cluster 2024-09-20T23:11:06.728887+0000 mgr.a (mgr.14388) 2445 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:08 smithi049 bash[23528]: audit 2024-09-20T23:11:07.720733+0000 mgr.a (mgr.14388) 2446 : audit [DBG] from='client.64632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:08 smithi044 bash[22676]: audit 2024-09-20T23:11:07.720733+0000 mgr.a (mgr.14388) 2446 : audit [DBG] from='client.64632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:08 smithi179 bash[23186]: audit 2024-09-20T23:11:07.720733+0000 mgr.a (mgr.14388) 2446 : audit [DBG] from='client.64632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:09.915 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:09 smithi049 bash[23528]: cluster 2024-09-20T23:11:08.730032+0000 mgr.a (mgr.14388) 2447 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:09.915 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:09 smithi049 bash[23528]: audit 2024-09-20T23:11:09.764666+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:09.915 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:09 smithi049 bash[23528]: audit 2024-09-20T23:11:09.773564+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:09.915 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:09 smithi049 bash[23528]: audit 2024-09-20T23:11:09.785678+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:10.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:09 smithi179 bash[23186]: cluster 2024-09-20T23:11:08.730032+0000 mgr.a (mgr.14388) 2447 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:10.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:09 smithi179 bash[23186]: audit 2024-09-20T23:11:09.764666+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:10.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:09 smithi179 bash[23186]: audit 2024-09-20T23:11:09.773564+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:10.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:09 smithi179 bash[23186]: audit 2024-09-20T23:11:09.785678+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:09 smithi044 bash[22676]: cluster 2024-09-20T23:11:08.730032+0000 mgr.a (mgr.14388) 2447 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:09 smithi044 bash[22676]: audit 2024-09-20T23:11:09.764666+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:09 smithi044 bash[22676]: audit 2024-09-20T23:11:09.773564+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:09 smithi044 bash[22676]: audit 2024-09-20T23:11:09.785678+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:11 smithi049 bash[23528]: audit 2024-09-20T23:11:10.032463+0000 mon.a (mon.0) 2663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:11 smithi049 bash[23528]: audit 2024-09-20T23:11:10.042028+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:11 smithi049 bash[23528]: audit 2024-09-20T23:11:10.052027+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:11 smithi044 bash[22676]: audit 2024-09-20T23:11:10.032463+0000 mon.a (mon.0) 2663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:11 smithi044 bash[22676]: audit 2024-09-20T23:11:10.042028+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:11 smithi044 bash[22676]: audit 2024-09-20T23:11:10.052027+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:11 smithi179 bash[23186]: audit 2024-09-20T23:11:10.032463+0000 mon.a (mon.0) 2663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:11 smithi179 bash[23186]: audit 2024-09-20T23:11:10.042028+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:11 smithi179 bash[23186]: audit 2024-09-20T23:11:10.052027+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:12 smithi044 bash[22676]: cluster 2024-09-20T23:11:10.732404+0000 mgr.a (mgr.14388) 2448 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:12 smithi044 bash[22676]: audit 2024-09-20T23:11:11.817337+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:12 smithi044 bash[22676]: audit 2024-09-20T23:11:11.825142+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:12 smithi044 bash[22676]: audit 2024-09-20T23:11:11.834003+0000 mon.a (mon.0) 2668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:12 smithi049 bash[23528]: cluster 2024-09-20T23:11:10.732404+0000 mgr.a (mgr.14388) 2448 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:12 smithi049 bash[23528]: audit 2024-09-20T23:11:11.817337+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:12 smithi049 bash[23528]: audit 2024-09-20T23:11:11.825142+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:12 smithi049 bash[23528]: audit 2024-09-20T23:11:11.834003+0000 mon.a (mon.0) 2668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:12 smithi179 bash[23186]: cluster 2024-09-20T23:11:10.732404+0000 mgr.a (mgr.14388) 2448 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:12 smithi179 bash[23186]: audit 2024-09-20T23:11:11.817337+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:12 smithi179 bash[23186]: audit 2024-09-20T23:11:11.825142+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:12 smithi179 bash[23186]: audit 2024-09-20T23:11:11.834003+0000 mon.a (mon.0) 2668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:13.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:13.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:13.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:13.932 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:13.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:13.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:13.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:13.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:14 smithi044 bash[22676]: cluster 2024-09-20T23:11:12.733316+0000 mgr.a (mgr.14388) 2449 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:14 smithi044 bash[22676]: audit 2024-09-20T23:11:13.489656+0000 mgr.a (mgr.14388) 2450 : audit [DBG] from='client.64707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:14 smithi179 bash[23186]: cluster 2024-09-20T23:11:12.733316+0000 mgr.a (mgr.14388) 2449 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:14 smithi179 bash[23186]: audit 2024-09-20T23:11:13.489656+0000 mgr.a (mgr.14388) 2450 : audit [DBG] from='client.64707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:14 smithi049 bash[23528]: cluster 2024-09-20T23:11:12.733316+0000 mgr.a (mgr.14388) 2449 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:14 smithi049 bash[23528]: audit 2024-09-20T23:11:13.489656+0000 mgr.a (mgr.14388) 2450 : audit [DBG] from='client.64707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:16 smithi044 bash[22676]: cluster 2024-09-20T23:11:14.734105+0000 mgr.a (mgr.14388) 2451 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:16 smithi179 bash[23186]: cluster 2024-09-20T23:11:14.734105+0000 mgr.a (mgr.14388) 2451 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:16 smithi049 bash[23528]: cluster 2024-09-20T23:11:14.734105+0000 mgr.a (mgr.14388) 2451 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:18.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:18 smithi044 bash[22676]: cluster 2024-09-20T23:11:16.736362+0000 mgr.a (mgr.14388) 2452 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:18 smithi179 bash[23186]: cluster 2024-09-20T23:11:16.736362+0000 mgr.a (mgr.14388) 2452 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:18 smithi049 bash[23528]: cluster 2024-09-20T23:11:16.736362+0000 mgr.a (mgr.14388) 2452 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:20 smithi044 bash[22676]: cluster 2024-09-20T23:11:18.737167+0000 mgr.a (mgr.14388) 2453 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:20 smithi044 bash[22676]: audit 2024-09-20T23:11:19.275197+0000 mgr.a (mgr.14388) 2454 : audit [DBG] from='client.64782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:20 smithi179 bash[23186]: cluster 2024-09-20T23:11:18.737167+0000 mgr.a (mgr.14388) 2453 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:20 smithi179 bash[23186]: audit 2024-09-20T23:11:19.275197+0000 mgr.a (mgr.14388) 2454 : audit [DBG] from='client.64782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:20 smithi049 bash[23528]: cluster 2024-09-20T23:11:18.737167+0000 mgr.a (mgr.14388) 2453 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:20 smithi049 bash[23528]: audit 2024-09-20T23:11:19.275197+0000 mgr.a (mgr.14388) 2454 : audit [DBG] from='client.64782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:22 smithi044 bash[22676]: cluster 2024-09-20T23:11:20.739466+0000 mgr.a (mgr.14388) 2455 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:22 smithi179 bash[23186]: cluster 2024-09-20T23:11:20.739466+0000 mgr.a (mgr.14388) 2455 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:22 smithi049 bash[23528]: cluster 2024-09-20T23:11:20.739466+0000 mgr.a (mgr.14388) 2455 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:24 smithi044 bash[22676]: cluster 2024-09-20T23:11:22.740262+0000 mgr.a (mgr.14388) 2456 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:24 smithi179 bash[23186]: cluster 2024-09-20T23:11:22.740262+0000 mgr.a (mgr.14388) 2456 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:24 smithi049 bash[23528]: cluster 2024-09-20T23:11:22.740262+0000 mgr.a (mgr.14388) 2456 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:24.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:24.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:24.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:25.453 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:25.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:26 smithi179 bash[23186]: cluster 2024-09-20T23:11:24.740865+0000 mgr.a (mgr.14388) 2457 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:26 smithi179 bash[23186]: audit 2024-09-20T23:11:25.022085+0000 mgr.a (mgr.14388) 2458 : audit [DBG] from='client.64857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:26 smithi044 bash[22676]: cluster 2024-09-20T23:11:24.740865+0000 mgr.a (mgr.14388) 2457 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:26 smithi044 bash[22676]: audit 2024-09-20T23:11:25.022085+0000 mgr.a (mgr.14388) 2458 : audit [DBG] from='client.64857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:26 smithi049 bash[23528]: cluster 2024-09-20T23:11:24.740865+0000 mgr.a (mgr.14388) 2457 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:26 smithi049 bash[23528]: audit 2024-09-20T23:11:25.022085+0000 mgr.a (mgr.14388) 2458 : audit [DBG] from='client.64857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:28 smithi044 bash[22676]: cluster 2024-09-20T23:11:26.743574+0000 mgr.a (mgr.14388) 2459 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:28 smithi179 bash[23186]: cluster 2024-09-20T23:11:26.743574+0000 mgr.a (mgr.14388) 2459 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:28 smithi049 bash[23528]: cluster 2024-09-20T23:11:26.743574+0000 mgr.a (mgr.14388) 2459 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:30.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:30 smithi049 bash[23528]: cluster 2024-09-20T23:11:28.744389+0000 mgr.a (mgr.14388) 2460 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:11:30.291 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:30 smithi049 bash[23528]: audit 2024-09-20T23:11:30.000188+0000 mon.a (mon.0) 2669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.291 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:30 smithi049 bash[23528]: audit 2024-09-20T23:11:30.009464+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.291 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:30 smithi049 bash[23528]: audit 2024-09-20T23:11:30.020161+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:30.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:30.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:30 smithi044 bash[22676]: cluster 2024-09-20T23:11:28.744389+0000 mgr.a (mgr.14388) 2460 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:11:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:30 smithi044 bash[22676]: audit 2024-09-20T23:11:30.000188+0000 mon.a (mon.0) 2669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:30 smithi044 bash[22676]: audit 2024-09-20T23:11:30.009464+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:30 smithi044 bash[22676]: audit 2024-09-20T23:11:30.020161+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:30 smithi179 bash[23186]: cluster 2024-09-20T23:11:28.744389+0000 mgr.a (mgr.14388) 2460 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:11:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:30 smithi179 bash[23186]: audit 2024-09-20T23:11:30.000188+0000 mon.a (mon.0) 2669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:30 smithi179 bash[23186]: audit 2024-09-20T23:11:30.009464+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:30 smithi179 bash[23186]: audit 2024-09-20T23:11:30.020161+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.206 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:31 smithi044 bash[22676]: audit 2024-09-20T23:11:30.224451+0000 mon.a (mon.0) 2672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:31 smithi044 bash[22676]: audit 2024-09-20T23:11:30.232662+0000 mon.a (mon.0) 2673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:31 smithi044 bash[22676]: audit 2024-09-20T23:11:30.242547+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:31 smithi179 bash[23186]: audit 2024-09-20T23:11:30.224451+0000 mon.a (mon.0) 2672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:31 smithi179 bash[23186]: audit 2024-09-20T23:11:30.232662+0000 mon.a (mon.0) 2673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:31 smithi179 bash[23186]: audit 2024-09-20T23:11:30.242547+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:31 smithi049 bash[23528]: audit 2024-09-20T23:11:30.224451+0000 mon.a (mon.0) 2672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:31 smithi049 bash[23528]: audit 2024-09-20T23:11:30.232662+0000 mon.a (mon.0) 2673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:31 smithi049 bash[23528]: audit 2024-09-20T23:11:30.242547+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:32 smithi044 bash[22676]: cluster 2024-09-20T23:11:30.746337+0000 mgr.a (mgr.14388) 2461 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:32 smithi044 bash[22676]: audit 2024-09-20T23:11:30.788541+0000 mgr.a (mgr.14388) 2462 : audit [DBG] from='client.64932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:32 smithi044 bash[22676]: audit 2024-09-20T23:11:32.049435+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:32 smithi044 bash[22676]: audit 2024-09-20T23:11:32.055344+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:32 smithi044 bash[22676]: audit 2024-09-20T23:11:32.061836+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:32 smithi179 bash[23186]: cluster 2024-09-20T23:11:30.746337+0000 mgr.a (mgr.14388) 2461 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:32 smithi179 bash[23186]: audit 2024-09-20T23:11:30.788541+0000 mgr.a (mgr.14388) 2462 : audit [DBG] from='client.64932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:32 smithi179 bash[23186]: audit 2024-09-20T23:11:32.049435+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:32 smithi179 bash[23186]: audit 2024-09-20T23:11:32.055344+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:32 smithi179 bash[23186]: audit 2024-09-20T23:11:32.061836+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:32 smithi049 bash[23528]: cluster 2024-09-20T23:11:30.746337+0000 mgr.a (mgr.14388) 2461 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:32 smithi049 bash[23528]: audit 2024-09-20T23:11:30.788541+0000 mgr.a (mgr.14388) 2462 : audit [DBG] from='client.64932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:32 smithi049 bash[23528]: audit 2024-09-20T23:11:32.049435+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:32 smithi049 bash[23528]: audit 2024-09-20T23:11:32.055344+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:32 smithi049 bash[23528]: audit 2024-09-20T23:11:32.061836+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:34 smithi179 bash[23186]: cluster 2024-09-20T23:11:32.747189+0000 mgr.a (mgr.14388) 2463 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:11:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:34 smithi049 bash[23528]: cluster 2024-09-20T23:11:32.747189+0000 mgr.a (mgr.14388) 2463 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:11:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:34 smithi044 bash[22676]: cluster 2024-09-20T23:11:32.747189+0000 mgr.a (mgr.14388) 2463 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:11:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:36 smithi179 bash[23186]: cluster 2024-09-20T23:11:34.747979+0000 mgr.a (mgr.14388) 2464 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:11:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:36 smithi049 bash[23528]: cluster 2024-09-20T23:11:34.747979+0000 mgr.a (mgr.14388) 2464 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:11:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:36 smithi044 bash[22676]: cluster 2024-09-20T23:11:34.747979+0000 mgr.a (mgr.14388) 2464 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:11:36.980 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:36.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:36.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:36.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:36.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:37 smithi049 bash[23528]: audit 2024-09-20T23:11:36.553981+0000 mgr.a (mgr.14388) 2465 : audit [DBG] from='client.65007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:37 smithi044 bash[22676]: audit 2024-09-20T23:11:36.553981+0000 mgr.a (mgr.14388) 2465 : audit [DBG] from='client.65007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:37 smithi179 bash[23186]: audit 2024-09-20T23:11:36.553981+0000 mgr.a (mgr.14388) 2465 : audit [DBG] from='client.65007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:38 smithi049 bash[23528]: cluster 2024-09-20T23:11:36.749570+0000 mgr.a (mgr.14388) 2466 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:38 smithi044 bash[22676]: cluster 2024-09-20T23:11:36.749570+0000 mgr.a (mgr.14388) 2466 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:38 smithi179 bash[23186]: cluster 2024-09-20T23:11:36.749570+0000 mgr.a (mgr.14388) 2466 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:40.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:40 smithi044 bash[22676]: cluster 2024-09-20T23:11:38.750432+0000 mgr.a (mgr.14388) 2467 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:40 smithi049 bash[23528]: cluster 2024-09-20T23:11:38.750432+0000 mgr.a (mgr.14388) 2467 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:40 smithi179 bash[23186]: cluster 2024-09-20T23:11:38.750432+0000 mgr.a (mgr.14388) 2467 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:41.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:42 smithi044 bash[22676]: cluster 2024-09-20T23:11:40.751921+0000 mgr.a (mgr.14388) 2468 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:42 smithi049 bash[23528]: cluster 2024-09-20T23:11:40.751921+0000 mgr.a (mgr.14388) 2468 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:42.748 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:42 smithi179 bash[23186]: cluster 2024-09-20T23:11:40.751921+0000 mgr.a (mgr.14388) 2468 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:43 smithi049 bash[23528]: audit 2024-09-20T23:11:42.319682+0000 mgr.a (mgr.14388) 2469 : audit [DBG] from='client.65082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:43 smithi044 bash[22676]: audit 2024-09-20T23:11:42.319682+0000 mgr.a (mgr.14388) 2469 : audit [DBG] from='client.65082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:43 smithi179 bash[23186]: audit 2024-09-20T23:11:42.319682+0000 mgr.a (mgr.14388) 2469 : audit [DBG] from='client.65082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:44 smithi049 bash[23528]: cluster 2024-09-20T23:11:42.752424+0000 mgr.a (mgr.14388) 2470 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:44 smithi044 bash[22676]: cluster 2024-09-20T23:11:42.752424+0000 mgr.a (mgr.14388) 2470 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:44 smithi179 bash[23186]: cluster 2024-09-20T23:11:42.752424+0000 mgr.a (mgr.14388) 2470 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:46 smithi049 bash[23528]: cluster 2024-09-20T23:11:44.753181+0000 mgr.a (mgr.14388) 2471 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:46.605 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:46 smithi179 bash[23186]: cluster 2024-09-20T23:11:44.753181+0000 mgr.a (mgr.14388) 2471 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:46 smithi044 bash[22676]: cluster 2024-09-20T23:11:44.753181+0000 mgr.a (mgr.14388) 2471 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:47.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:47.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:48.493 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:48.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:48.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:48.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:48.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:48 smithi179 bash[23186]: cluster 2024-09-20T23:11:46.755350+0000 mgr.a (mgr.14388) 2472 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:48 smithi049 bash[23528]: cluster 2024-09-20T23:11:46.755350+0000 mgr.a (mgr.14388) 2472 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:48 smithi044 bash[22676]: cluster 2024-09-20T23:11:46.755350+0000 mgr.a (mgr.14388) 2472 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:11:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:48.081656+0000 mgr.a (mgr.14388) 2473 : audit [DBG] from='client.65160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:48.443777+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:48.982278+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:48.991267+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:48.993599+0000 mon.a (mon.0) 2681 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:48.995551+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:49.006067+0000 mon.a (mon.0) 2683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:49 smithi049 bash[23528]: audit 2024-09-20T23:11:49.012504+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:48.081656+0000 mgr.a (mgr.14388) 2473 : audit [DBG] from='client.65160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:48.443777+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:48.982278+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:48.991267+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:48.993599+0000 mon.a (mon.0) 2681 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:48.995551+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:49.006067+0000 mon.a (mon.0) 2683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22676]: audit 2024-09-20T23:11:49.012504+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:11:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:48.081656+0000 mgr.a (mgr.14388) 2473 : audit [DBG] from='client.65160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:48.443777+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:11:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:48.982278+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:48.991267+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:48.993599+0000 mon.a (mon.0) 2681 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:11:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:48.995551+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:11:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:49.006067+0000 mon.a (mon.0) 2683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:49 smithi179 bash[23186]: audit 2024-09-20T23:11:49.012504+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:11:50.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22930]: debug 2024-09-20T23:11:49.735+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:11:50.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:11:49 smithi044 bash[22930]: debug 2024-09-20T23:11:49.739+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:11:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:50 smithi049 bash[23528]: cluster 2024-09-20T23:11:48.756326+0000 mgr.a (mgr.14388) 2474 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:50 smithi049 bash[23528]: audit 2024-09-20T23:11:49.015252+0000 mgr.a (mgr.14388) 2475 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:11:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:50 smithi049 bash[23528]: audit 2024-09-20T23:11:50.217372+0000 mon.a (mon.0) 2685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:50 smithi049 bash[23528]: audit 2024-09-20T23:11:50.225886+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:50 smithi049 bash[23528]: audit 2024-09-20T23:11:50.237558+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:50 smithi044 bash[22676]: cluster 2024-09-20T23:11:48.756326+0000 mgr.a (mgr.14388) 2474 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:50 smithi044 bash[22676]: audit 2024-09-20T23:11:49.015252+0000 mgr.a (mgr.14388) 2475 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:11:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:50 smithi044 bash[22676]: audit 2024-09-20T23:11:50.217372+0000 mon.a (mon.0) 2685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:50 smithi044 bash[22676]: audit 2024-09-20T23:11:50.225886+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:50 smithi044 bash[22676]: audit 2024-09-20T23:11:50.237558+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:50 smithi179 bash[23186]: cluster 2024-09-20T23:11:48.756326+0000 mgr.a (mgr.14388) 2474 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:50 smithi179 bash[23186]: audit 2024-09-20T23:11:49.015252+0000 mgr.a (mgr.14388) 2475 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:50 smithi179 bash[23186]: audit 2024-09-20T23:11:50.217372+0000 mon.a (mon.0) 2685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:50 smithi179 bash[23186]: audit 2024-09-20T23:11:50.225886+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:50 smithi179 bash[23186]: audit 2024-09-20T23:11:50.237558+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:51 smithi044 bash[22676]: audit 2024-09-20T23:11:49.740822+0000 mgr.a (mgr.14388) 2476 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:11:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:51 smithi044 bash[22676]: cephadm 2024-09-20T23:11:49.741955+0000 mgr.a (mgr.14388) 2477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:11:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:51 smithi044 bash[22676]: audit 2024-09-20T23:11:50.455304+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:51 smithi044 bash[22676]: audit 2024-09-20T23:11:50.465179+0000 mon.a (mon.0) 2689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:51 smithi044 bash[22676]: audit 2024-09-20T23:11:50.476617+0000 mon.a (mon.0) 2690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:51 smithi179 bash[23186]: audit 2024-09-20T23:11:49.740822+0000 mgr.a (mgr.14388) 2476 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:11:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:51 smithi179 bash[23186]: cephadm 2024-09-20T23:11:49.741955+0000 mgr.a (mgr.14388) 2477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:11:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:51 smithi179 bash[23186]: audit 2024-09-20T23:11:50.455304+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:51 smithi179 bash[23186]: audit 2024-09-20T23:11:50.465179+0000 mon.a (mon.0) 2689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:51 smithi179 bash[23186]: audit 2024-09-20T23:11:50.476617+0000 mon.a (mon.0) 2690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:51 smithi049 bash[23528]: audit 2024-09-20T23:11:49.740822+0000 mgr.a (mgr.14388) 2476 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:11:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:51 smithi049 bash[23528]: cephadm 2024-09-20T23:11:49.741955+0000 mgr.a (mgr.14388) 2477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:11:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:51 smithi049 bash[23528]: audit 2024-09-20T23:11:50.455304+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:51 smithi049 bash[23528]: audit 2024-09-20T23:11:50.465179+0000 mon.a (mon.0) 2689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:51 smithi049 bash[23528]: audit 2024-09-20T23:11:50.476617+0000 mon.a (mon.0) 2690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:52 smithi044 bash[22676]: cluster 2024-09-20T23:11:50.758638+0000 mgr.a (mgr.14388) 2478 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:52 smithi044 bash[22676]: audit 2024-09-20T23:11:52.252612+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:52 smithi044 bash[22676]: audit 2024-09-20T23:11:52.262012+0000 mon.a (mon.0) 2692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:52 smithi044 bash[22676]: audit 2024-09-20T23:11:52.271725+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:52 smithi179 bash[23186]: cluster 2024-09-20T23:11:50.758638+0000 mgr.a (mgr.14388) 2478 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:52 smithi179 bash[23186]: audit 2024-09-20T23:11:52.252612+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:52 smithi179 bash[23186]: audit 2024-09-20T23:11:52.262012+0000 mon.a (mon.0) 2692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:52 smithi179 bash[23186]: audit 2024-09-20T23:11:52.271725+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:52 smithi049 bash[23528]: cluster 2024-09-20T23:11:50.758638+0000 mgr.a (mgr.14388) 2478 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:52 smithi049 bash[23528]: audit 2024-09-20T23:11:52.252612+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:52 smithi049 bash[23528]: audit 2024-09-20T23:11:52.262012+0000 mon.a (mon.0) 2692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:52 smithi049 bash[23528]: audit 2024-09-20T23:11:52.271725+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:11:53.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:53.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:53.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:11:54.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:11:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:11:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:11:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:11:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:11:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:54 smithi044 bash[22676]: cluster 2024-09-20T23:11:52.759447+0000 mgr.a (mgr.14388) 2479 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:54 smithi179 bash[23186]: cluster 2024-09-20T23:11:52.759447+0000 mgr.a (mgr.14388) 2479 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:54 smithi049 bash[23528]: cluster 2024-09-20T23:11:52.759447+0000 mgr.a (mgr.14388) 2479 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:55 smithi179 bash[23186]: audit 2024-09-20T23:11:53.826705+0000 mgr.a (mgr.14388) 2480 : audit [DBG] from='client.65343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:55 smithi049 bash[23528]: audit 2024-09-20T23:11:53.826705+0000 mgr.a (mgr.14388) 2480 : audit [DBG] from='client.65343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:55.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:55 smithi044 bash[22676]: audit 2024-09-20T23:11:53.826705+0000 mgr.a (mgr.14388) 2480 : audit [DBG] from='client.65343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:11:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:56 smithi179 bash[23186]: cluster 2024-09-20T23:11:54.760426+0000 mgr.a (mgr.14388) 2481 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:56 smithi049 bash[23528]: cluster 2024-09-20T23:11:54.760426+0000 mgr.a (mgr.14388) 2481 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:56 smithi044 bash[22676]: cluster 2024-09-20T23:11:54.760426+0000 mgr.a (mgr.14388) 2481 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:11:58 smithi179 bash[23186]: cluster 2024-09-20T23:11:56.762779+0000 mgr.a (mgr.14388) 2482 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:11:58 smithi049 bash[23528]: cluster 2024-09-20T23:11:56.762779+0000 mgr.a (mgr.14388) 2482 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:11:58 smithi044 bash[22676]: cluster 2024-09-20T23:11:56.762779+0000 mgr.a (mgr.14388) 2482 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:11:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:11:59.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:11:59.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:00.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:00.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:00.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:00.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:00.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:00 smithi179 bash[23186]: cluster 2024-09-20T23:11:58.763556+0000 mgr.a (mgr.14388) 2483 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:00 smithi179 bash[23186]: audit 2024-09-20T23:11:59.594859+0000 mgr.a (mgr.14388) 2484 : audit [DBG] from='client.65421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:00.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:00 smithi044 bash[22676]: cluster 2024-09-20T23:11:58.763556+0000 mgr.a (mgr.14388) 2483 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:00.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:00 smithi044 bash[22676]: audit 2024-09-20T23:11:59.594859+0000 mgr.a (mgr.14388) 2484 : audit [DBG] from='client.65421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:00 smithi049 bash[23528]: cluster 2024-09-20T23:11:58.763556+0000 mgr.a (mgr.14388) 2483 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:00 smithi049 bash[23528]: audit 2024-09-20T23:11:59.594859+0000 mgr.a (mgr.14388) 2484 : audit [DBG] from='client.65421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:02 smithi044 bash[22676]: cluster 2024-09-20T23:12:00.766000+0000 mgr.a (mgr.14388) 2485 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:02 smithi049 bash[23528]: cluster 2024-09-20T23:12:00.766000+0000 mgr.a (mgr.14388) 2485 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:02 smithi179 bash[23186]: cluster 2024-09-20T23:12:00.766000+0000 mgr.a (mgr.14388) 2485 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:04 smithi049 bash[23528]: cluster 2024-09-20T23:12:02.766536+0000 mgr.a (mgr.14388) 2486 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:04 smithi044 bash[22676]: cluster 2024-09-20T23:12:02.766536+0000 mgr.a (mgr.14388) 2486 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:04 smithi179 bash[23186]: cluster 2024-09-20T23:12:02.766536+0000 mgr.a (mgr.14388) 2486 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:05.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:05.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:05.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:05.761 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:05.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:05.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:05.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:05.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:06 smithi049 bash[23528]: cluster 2024-09-20T23:12:04.767282+0000 mgr.a (mgr.14388) 2487 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:06 smithi049 bash[23528]: audit 2024-09-20T23:12:05.346409+0000 mgr.a (mgr.14388) 2488 : audit [DBG] from='client.65496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:06 smithi044 bash[22676]: cluster 2024-09-20T23:12:04.767282+0000 mgr.a (mgr.14388) 2487 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:06 smithi044 bash[22676]: audit 2024-09-20T23:12:05.346409+0000 mgr.a (mgr.14388) 2488 : audit [DBG] from='client.65496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:06 smithi179 bash[23186]: cluster 2024-09-20T23:12:04.767282+0000 mgr.a (mgr.14388) 2487 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:06 smithi179 bash[23186]: audit 2024-09-20T23:12:05.346409+0000 mgr.a (mgr.14388) 2488 : audit [DBG] from='client.65496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:08 smithi179 bash[23186]: cluster 2024-09-20T23:12:06.770035+0000 mgr.a (mgr.14388) 2489 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:08.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:08 smithi049 bash[23528]: cluster 2024-09-20T23:12:06.770035+0000 mgr.a (mgr.14388) 2489 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:08 smithi044 bash[22676]: cluster 2024-09-20T23:12:06.770035+0000 mgr.a (mgr.14388) 2489 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:10.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:10.764 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:10.764 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:10 smithi049 bash[23528]: cluster 2024-09-20T23:12:08.770838+0000 mgr.a (mgr.14388) 2490 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:10 smithi049 bash[23528]: audit 2024-09-20T23:12:10.430130+0000 mon.a (mon.0) 2694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:10 smithi049 bash[23528]: audit 2024-09-20T23:12:10.440254+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:10 smithi049 bash[23528]: audit 2024-09-20T23:12:10.452361+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:10 smithi044 bash[22676]: cluster 2024-09-20T23:12:08.770838+0000 mgr.a (mgr.14388) 2490 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:10 smithi044 bash[22676]: audit 2024-09-20T23:12:10.430130+0000 mon.a (mon.0) 2694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:10 smithi044 bash[22676]: audit 2024-09-20T23:12:10.440254+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:10 smithi044 bash[22676]: audit 2024-09-20T23:12:10.452361+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:10 smithi179 bash[23186]: cluster 2024-09-20T23:12:08.770838+0000 mgr.a (mgr.14388) 2490 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:10 smithi179 bash[23186]: audit 2024-09-20T23:12:10.430130+0000 mon.a (mon.0) 2694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:10 smithi179 bash[23186]: audit 2024-09-20T23:12:10.440254+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:10 smithi179 bash[23186]: audit 2024-09-20T23:12:10.452361+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:11.545 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:11 smithi049 bash[23528]: audit 2024-09-20T23:12:10.690402+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:11 smithi049 bash[23528]: audit 2024-09-20T23:12:10.700318+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:11 smithi049 bash[23528]: audit 2024-09-20T23:12:10.711680+0000 mon.a (mon.0) 2699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:11 smithi049 bash[23528]: cluster 2024-09-20T23:12:10.772564+0000 mgr.a (mgr.14388) 2491 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:11 smithi049 bash[23528]: audit 2024-09-20T23:12:11.098994+0000 mgr.a (mgr.14388) 2492 : audit [DBG] from='client.65571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:11.980 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:11 smithi179 bash[23186]: audit 2024-09-20T23:12:10.690402+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.980 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:11 smithi179 bash[23186]: audit 2024-09-20T23:12:10.700318+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.980 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:11 smithi179 bash[23186]: audit 2024-09-20T23:12:10.711680+0000 mon.a (mon.0) 2699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.980 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:11 smithi179 bash[23186]: cluster 2024-09-20T23:12:10.772564+0000 mgr.a (mgr.14388) 2491 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:11.980 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:11 smithi179 bash[23186]: audit 2024-09-20T23:12:11.098994+0000 mgr.a (mgr.14388) 2492 : audit [DBG] from='client.65571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:11 smithi044 bash[22676]: audit 2024-09-20T23:12:10.690402+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:11 smithi044 bash[22676]: audit 2024-09-20T23:12:10.700318+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:11 smithi044 bash[22676]: audit 2024-09-20T23:12:10.711680+0000 mon.a (mon.0) 2699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:11 smithi044 bash[22676]: cluster 2024-09-20T23:12:10.772564+0000 mgr.a (mgr.14388) 2491 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:11 smithi044 bash[22676]: audit 2024-09-20T23:12:11.098994+0000 mgr.a (mgr.14388) 2492 : audit [DBG] from='client.65571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:13 smithi179 bash[23186]: audit 2024-09-20T23:12:12.497936+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:13 smithi179 bash[23186]: audit 2024-09-20T23:12:12.507398+0000 mon.a (mon.0) 2701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:13 smithi179 bash[23186]: audit 2024-09-20T23:12:12.517539+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:13 smithi049 bash[23528]: audit 2024-09-20T23:12:12.497936+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:13 smithi049 bash[23528]: audit 2024-09-20T23:12:12.507398+0000 mon.a (mon.0) 2701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:13 smithi049 bash[23528]: audit 2024-09-20T23:12:12.517539+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:13 smithi044 bash[22676]: audit 2024-09-20T23:12:12.497936+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:13 smithi044 bash[22676]: audit 2024-09-20T23:12:12.507398+0000 mon.a (mon.0) 2701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:13 smithi044 bash[22676]: audit 2024-09-20T23:12:12.517539+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:14 smithi049 bash[23528]: cluster 2024-09-20T23:12:12.773484+0000 mgr.a (mgr.14388) 2493 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:14 smithi044 bash[22676]: cluster 2024-09-20T23:12:12.773484+0000 mgr.a (mgr.14388) 2493 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:14 smithi179 bash[23186]: cluster 2024-09-20T23:12:12.773484+0000 mgr.a (mgr.14388) 2493 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:16.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:16.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:16.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:16 smithi049 bash[23528]: cluster 2024-09-20T23:12:14.774259+0000 mgr.a (mgr.14388) 2494 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:12:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:16 smithi044 bash[22676]: cluster 2024-09-20T23:12:14.774259+0000 mgr.a (mgr.14388) 2494 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:12:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:16 smithi179 bash[23186]: cluster 2024-09-20T23:12:14.774259+0000 mgr.a (mgr.14388) 2494 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:12:17.323 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:17.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:17.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:17.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:17.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:18 smithi049 bash[23528]: cluster 2024-09-20T23:12:16.776503+0000 mgr.a (mgr.14388) 2495 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:18 smithi049 bash[23528]: audit 2024-09-20T23:12:16.872016+0000 mgr.a (mgr.14388) 2496 : audit [DBG] from='client.65646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:18 smithi044 bash[22676]: cluster 2024-09-20T23:12:16.776503+0000 mgr.a (mgr.14388) 2495 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:18 smithi044 bash[22676]: audit 2024-09-20T23:12:16.872016+0000 mgr.a (mgr.14388) 2496 : audit [DBG] from='client.65646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:18 smithi179 bash[23186]: cluster 2024-09-20T23:12:16.776503+0000 mgr.a (mgr.14388) 2495 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:18 smithi179 bash[23186]: audit 2024-09-20T23:12:16.872016+0000 mgr.a (mgr.14388) 2496 : audit [DBG] from='client.65646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:20 smithi049 bash[23528]: cluster 2024-09-20T23:12:18.777448+0000 mgr.a (mgr.14388) 2497 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:20 smithi044 bash[22676]: cluster 2024-09-20T23:12:18.777448+0000 mgr.a (mgr.14388) 2497 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:20 smithi179 bash[23186]: cluster 2024-09-20T23:12:18.777448+0000 mgr.a (mgr.14388) 2497 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:22.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:22.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:22.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:22 smithi044 bash[22676]: cluster 2024-09-20T23:12:20.779724+0000 mgr.a (mgr.14388) 2498 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:22 smithi049 bash[23528]: cluster 2024-09-20T23:12:20.779724+0000 mgr.a (mgr.14388) 2498 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:22 smithi179 bash[23186]: cluster 2024-09-20T23:12:20.779724+0000 mgr.a (mgr.14388) 2498 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:23.068 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:23.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:23.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:24 smithi049 bash[23528]: audit 2024-09-20T23:12:22.657854+0000 mgr.a (mgr.14388) 2499 : audit [DBG] from='client.65721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:24 smithi049 bash[23528]: cluster 2024-09-20T23:12:22.780514+0000 mgr.a (mgr.14388) 2500 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:24 smithi044 bash[22676]: audit 2024-09-20T23:12:22.657854+0000 mgr.a (mgr.14388) 2499 : audit [DBG] from='client.65721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:24 smithi044 bash[22676]: cluster 2024-09-20T23:12:22.780514+0000 mgr.a (mgr.14388) 2500 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:24 smithi179 bash[23186]: audit 2024-09-20T23:12:22.657854+0000 mgr.a (mgr.14388) 2499 : audit [DBG] from='client.65721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:24 smithi179 bash[23186]: cluster 2024-09-20T23:12:22.780514+0000 mgr.a (mgr.14388) 2500 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:26 smithi049 bash[23528]: cluster 2024-09-20T23:12:24.781433+0000 mgr.a (mgr.14388) 2501 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:26 smithi044 bash[22676]: cluster 2024-09-20T23:12:24.781433+0000 mgr.a (mgr.14388) 2501 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:26 smithi179 bash[23186]: cluster 2024-09-20T23:12:24.781433+0000 mgr.a (mgr.14388) 2501 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:28.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:28.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:28.071 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:28.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:28 smithi179 bash[23186]: cluster 2024-09-20T23:12:26.783653+0000 mgr.a (mgr.14388) 2502 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:28 smithi049 bash[23528]: cluster 2024-09-20T23:12:26.783653+0000 mgr.a (mgr.14388) 2502 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:28.819 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:28 smithi044 bash[22676]: cluster 2024-09-20T23:12:26.783653+0000 mgr.a (mgr.14388) 2502 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:29.820 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:29 smithi049 bash[23528]: audit 2024-09-20T23:12:28.404020+0000 mgr.a (mgr.14388) 2503 : audit [DBG] from='client.65796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:29 smithi044 bash[22676]: audit 2024-09-20T23:12:28.404020+0000 mgr.a (mgr.14388) 2503 : audit [DBG] from='client.65796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:29 smithi179 bash[23186]: audit 2024-09-20T23:12:28.404020+0000 mgr.a (mgr.14388) 2503 : audit [DBG] from='client.65796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:30.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:30 smithi179 bash[23186]: cluster 2024-09-20T23:12:28.784259+0000 mgr.a (mgr.14388) 2504 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:30 smithi044 bash[22676]: cluster 2024-09-20T23:12:28.784259+0000 mgr.a (mgr.14388) 2504 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:30 smithi049 bash[23528]: cluster 2024-09-20T23:12:28.784259+0000 mgr.a (mgr.14388) 2504 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:31 smithi044 bash[22676]: audit 2024-09-20T23:12:30.611508+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:31 smithi044 bash[22676]: audit 2024-09-20T23:12:30.620136+0000 mon.a (mon.0) 2704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:31 smithi044 bash[22676]: audit 2024-09-20T23:12:30.631749+0000 mon.a (mon.0) 2705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:31 smithi044 bash[22676]: audit 2024-09-20T23:12:30.852224+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:31 smithi044 bash[22676]: audit 2024-09-20T23:12:30.862004+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:31 smithi044 bash[22676]: audit 2024-09-20T23:12:30.873012+0000 mon.a (mon.0) 2708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:31 smithi179 bash[23186]: audit 2024-09-20T23:12:30.611508+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:31 smithi179 bash[23186]: audit 2024-09-20T23:12:30.620136+0000 mon.a (mon.0) 2704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:31 smithi179 bash[23186]: audit 2024-09-20T23:12:30.631749+0000 mon.a (mon.0) 2705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:31 smithi179 bash[23186]: audit 2024-09-20T23:12:30.852224+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:31 smithi179 bash[23186]: audit 2024-09-20T23:12:30.862004+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:31 smithi179 bash[23186]: audit 2024-09-20T23:12:30.873012+0000 mon.a (mon.0) 2708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:31 smithi049 bash[23528]: audit 2024-09-20T23:12:30.611508+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:31 smithi049 bash[23528]: audit 2024-09-20T23:12:30.620136+0000 mon.a (mon.0) 2704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:31 smithi049 bash[23528]: audit 2024-09-20T23:12:30.631749+0000 mon.a (mon.0) 2705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:31 smithi049 bash[23528]: audit 2024-09-20T23:12:30.852224+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:31 smithi049 bash[23528]: audit 2024-09-20T23:12:30.862004+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:31 smithi049 bash[23528]: audit 2024-09-20T23:12:30.873012+0000 mon.a (mon.0) 2708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:32.904 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:32 smithi179 bash[23186]: cluster 2024-09-20T23:12:30.786437+0000 mgr.a (mgr.14388) 2505 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:32 smithi044 bash[22676]: cluster 2024-09-20T23:12:30.786437+0000 mgr.a (mgr.14388) 2505 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:32 smithi049 bash[23528]: cluster 2024-09-20T23:12:30.786437+0000 mgr.a (mgr.14388) 2505 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:33 smithi044 bash[22676]: audit 2024-09-20T23:12:32.690982+0000 mon.a (mon.0) 2709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:33 smithi044 bash[22676]: audit 2024-09-20T23:12:32.699274+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:33 smithi044 bash[22676]: audit 2024-09-20T23:12:32.709315+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:33 smithi044 bash[22676]: cluster 2024-09-20T23:12:32.787204+0000 mgr.a (mgr.14388) 2506 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:33 smithi179 bash[23186]: audit 2024-09-20T23:12:32.690982+0000 mon.a (mon.0) 2709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:33 smithi179 bash[23186]: audit 2024-09-20T23:12:32.699274+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:33 smithi179 bash[23186]: audit 2024-09-20T23:12:32.709315+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:33 smithi179 bash[23186]: cluster 2024-09-20T23:12:32.787204+0000 mgr.a (mgr.14388) 2506 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:33 smithi049 bash[23528]: audit 2024-09-20T23:12:32.690982+0000 mon.a (mon.0) 2709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:33 smithi049 bash[23528]: audit 2024-09-20T23:12:32.699274+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:33 smithi049 bash[23528]: audit 2024-09-20T23:12:32.709315+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:33 smithi049 bash[23528]: cluster 2024-09-20T23:12:32.787204+0000 mgr.a (mgr.14388) 2506 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:34.577 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:34 smithi044 bash[22676]: audit 2024-09-20T23:12:34.154472+0000 mgr.a (mgr.14388) 2507 : audit [DBG] from='client.65874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:34 smithi179 bash[23186]: audit 2024-09-20T23:12:34.154472+0000 mgr.a (mgr.14388) 2507 : audit [DBG] from='client.65874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:34 smithi049 bash[23528]: audit 2024-09-20T23:12:34.154472+0000 mgr.a (mgr.14388) 2507 : audit [DBG] from='client.65874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:35 smithi044 bash[22676]: cluster 2024-09-20T23:12:34.788144+0000 mgr.a (mgr.14388) 2508 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:35 smithi179 bash[23186]: cluster 2024-09-20T23:12:34.788144+0000 mgr.a (mgr.14388) 2508 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:35 smithi049 bash[23528]: cluster 2024-09-20T23:12:34.788144+0000 mgr.a (mgr.14388) 2508 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:37 smithi044 bash[22676]: cluster 2024-09-20T23:12:36.790413+0000 mgr.a (mgr.14388) 2509 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:37 smithi179 bash[23186]: cluster 2024-09-20T23:12:36.790413+0000 mgr.a (mgr.14388) 2509 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:37 smithi049 bash[23528]: cluster 2024-09-20T23:12:36.790413+0000 mgr.a (mgr.14388) 2509 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:12:39.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:39.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:39.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:39 smithi044 bash[22676]: cluster 2024-09-20T23:12:38.791192+0000 mgr.a (mgr.14388) 2510 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:39 smithi179 bash[23186]: cluster 2024-09-20T23:12:38.791192+0000 mgr.a (mgr.14388) 2510 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:39 smithi049 bash[23528]: cluster 2024-09-20T23:12:38.791192+0000 mgr.a (mgr.14388) 2510 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:40.366 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:40.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:40 smithi044 bash[22676]: audit 2024-09-20T23:12:39.918795+0000 mgr.a (mgr.14388) 2511 : audit [DBG] from='client.65949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:40 smithi179 bash[23186]: audit 2024-09-20T23:12:39.918795+0000 mgr.a (mgr.14388) 2511 : audit [DBG] from='client.65949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:40 smithi049 bash[23528]: audit 2024-09-20T23:12:39.918795+0000 mgr.a (mgr.14388) 2511 : audit [DBG] from='client.65949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:41 smithi044 bash[22676]: cluster 2024-09-20T23:12:40.793920+0000 mgr.a (mgr.14388) 2512 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:41 smithi179 bash[23186]: cluster 2024-09-20T23:12:40.793920+0000 mgr.a (mgr.14388) 2512 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:41 smithi049 bash[23528]: cluster 2024-09-20T23:12:40.793920+0000 mgr.a (mgr.14388) 2512 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:44.174 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:43 smithi044 bash[22676]: cluster 2024-09-20T23:12:42.794759+0000 mgr.a (mgr.14388) 2513 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:43 smithi179 bash[23186]: cluster 2024-09-20T23:12:42.794759+0000 mgr.a (mgr.14388) 2513 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:43 smithi049 bash[23528]: cluster 2024-09-20T23:12:42.794759+0000 mgr.a (mgr.14388) 2513 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:45.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:45.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:45.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:46.129 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:46.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:46.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:46.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:46.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:45 smithi044 bash[22676]: cluster 2024-09-20T23:12:44.795544+0000 mgr.a (mgr.14388) 2514 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:12:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:45 smithi179 bash[23186]: cluster 2024-09-20T23:12:44.795544+0000 mgr.a (mgr.14388) 2514 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:12:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:45 smithi049 bash[23528]: cluster 2024-09-20T23:12:44.795544+0000 mgr.a (mgr.14388) 2514 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:12:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:46 smithi044 bash[22676]: audit 2024-09-20T23:12:45.704889+0000 mgr.a (mgr.14388) 2515 : audit [DBG] from='client.66027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:46 smithi179 bash[23186]: audit 2024-09-20T23:12:45.704889+0000 mgr.a (mgr.14388) 2515 : audit [DBG] from='client.66027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:46 smithi049 bash[23528]: audit 2024-09-20T23:12:45.704889+0000 mgr.a (mgr.14388) 2515 : audit [DBG] from='client.66027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:47 smithi044 bash[22676]: cluster 2024-09-20T23:12:46.798303+0000 mgr.a (mgr.14388) 2516 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:47 smithi179 bash[23186]: cluster 2024-09-20T23:12:46.798303+0000 mgr.a (mgr.14388) 2516 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:47 smithi049 bash[23528]: cluster 2024-09-20T23:12:46.798303+0000 mgr.a (mgr.14388) 2516 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:12:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:49 smithi179 bash[23186]: cluster 2024-09-20T23:12:48.799095+0000 mgr.a (mgr.14388) 2517 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:49 smithi179 bash[23186]: audit 2024-09-20T23:12:49.796345+0000 mon.a (mon.0) 2712 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:49 smithi179 bash[23186]: audit 2024-09-20T23:12:49.803573+0000 mon.a (mon.0) 2713 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:49 smithi179 bash[23186]: audit 2024-09-20T23:12:49.805632+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:49 smithi179 bash[23186]: audit 2024-09-20T23:12:49.817502+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:50.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:49 smithi179 bash[23186]: audit 2024-09-20T23:12:49.823900+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:12:50.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:49 smithi049 bash[23528]: cluster 2024-09-20T23:12:48.799095+0000 mgr.a (mgr.14388) 2517 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:50.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:49 smithi049 bash[23528]: audit 2024-09-20T23:12:49.796345+0000 mon.a (mon.0) 2712 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:50.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:49 smithi049 bash[23528]: audit 2024-09-20T23:12:49.803573+0000 mon.a (mon.0) 2713 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:50.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:49 smithi049 bash[23528]: audit 2024-09-20T23:12:49.805632+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:50.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:49 smithi049 bash[23528]: audit 2024-09-20T23:12:49.817502+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:50.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:49 smithi049 bash[23528]: audit 2024-09-20T23:12:49.823900+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:12:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:49 smithi044 bash[22676]: cluster 2024-09-20T23:12:48.799095+0000 mgr.a (mgr.14388) 2517 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:12:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:49 smithi044 bash[22676]: audit 2024-09-20T23:12:49.796345+0000 mon.a (mon.0) 2712 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:12:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:49 smithi044 bash[22676]: audit 2024-09-20T23:12:49.803573+0000 mon.a (mon.0) 2713 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:12:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:49 smithi044 bash[22676]: audit 2024-09-20T23:12:49.805632+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:12:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:49 smithi044 bash[22676]: audit 2024-09-20T23:12:49.817502+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:49 smithi044 bash[22676]: audit 2024-09-20T23:12:49.823900+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:12:50.888 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22930]: debug 2024-09-20T23:12:50.586+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:12:50.889 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22930]: debug 2024-09-20T23:12:50.586+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:12:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:50 smithi049 bash[23528]: audit 2024-09-20T23:12:49.826475+0000 mgr.a (mgr.14388) 2518 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:12:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:50 smithi049 bash[23528]: audit 2024-09-20T23:12:50.590380+0000 mgr.a (mgr.14388) 2519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:12:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:50 smithi049 bash[23528]: cephadm 2024-09-20T23:12:50.591709+0000 mgr.a (mgr.14388) 2520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:12:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:50 smithi049 bash[23528]: audit 2024-09-20T23:12:50.765115+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:50 smithi049 bash[23528]: audit 2024-09-20T23:12:50.773635+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:50 smithi049 bash[23528]: audit 2024-09-20T23:12:50.783844+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:51.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:51.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:50 smithi179 bash[23186]: audit 2024-09-20T23:12:49.826475+0000 mgr.a (mgr.14388) 2518 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:12:51.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:50 smithi179 bash[23186]: audit 2024-09-20T23:12:50.590380+0000 mgr.a (mgr.14388) 2519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:12:51.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:50 smithi179 bash[23186]: cephadm 2024-09-20T23:12:50.591709+0000 mgr.a (mgr.14388) 2520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:12:51.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:50 smithi179 bash[23186]: audit 2024-09-20T23:12:50.765115+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:50 smithi179 bash[23186]: audit 2024-09-20T23:12:50.773635+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:50 smithi179 bash[23186]: audit 2024-09-20T23:12:50.783844+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22676]: audit 2024-09-20T23:12:49.826475+0000 mgr.a (mgr.14388) 2518 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:12:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22676]: audit 2024-09-20T23:12:50.590380+0000 mgr.a (mgr.14388) 2519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:12:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22676]: cephadm 2024-09-20T23:12:50.591709+0000 mgr.a (mgr.14388) 2520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:12:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22676]: audit 2024-09-20T23:12:50.765115+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22676]: audit 2024-09-20T23:12:50.773635+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:50 smithi044 bash[22676]: audit 2024-09-20T23:12:50.783844+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:51.885 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:51.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:52 smithi179 bash[23186]: cluster 2024-09-20T23:12:50.801781+0000 mgr.a (mgr.14388) 2521 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:52 smithi179 bash[23186]: audit 2024-09-20T23:12:51.035022+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:52 smithi179 bash[23186]: audit 2024-09-20T23:12:51.043328+0000 mon.a (mon.0) 2721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:52 smithi179 bash[23186]: audit 2024-09-20T23:12:51.054697+0000 mon.a (mon.0) 2722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:52 smithi179 bash[23186]: audit 2024-09-20T23:12:51.461678+0000 mgr.a (mgr.14388) 2522 : audit [DBG] from='client.66210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:52 smithi049 bash[23528]: cluster 2024-09-20T23:12:50.801781+0000 mgr.a (mgr.14388) 2521 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:52 smithi049 bash[23528]: audit 2024-09-20T23:12:51.035022+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:52 smithi049 bash[23528]: audit 2024-09-20T23:12:51.043328+0000 mon.a (mon.0) 2721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:52 smithi049 bash[23528]: audit 2024-09-20T23:12:51.054697+0000 mon.a (mon.0) 2722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:52 smithi049 bash[23528]: audit 2024-09-20T23:12:51.461678+0000 mgr.a (mgr.14388) 2522 : audit [DBG] from='client.66210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:52 smithi044 bash[22676]: cluster 2024-09-20T23:12:50.801781+0000 mgr.a (mgr.14388) 2521 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:52 smithi044 bash[22676]: audit 2024-09-20T23:12:51.035022+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:52 smithi044 bash[22676]: audit 2024-09-20T23:12:51.043328+0000 mon.a (mon.0) 2721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:52 smithi044 bash[22676]: audit 2024-09-20T23:12:51.054697+0000 mon.a (mon.0) 2722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:52 smithi044 bash[22676]: audit 2024-09-20T23:12:51.461678+0000 mgr.a (mgr.14388) 2522 : audit [DBG] from='client.66210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:53.929 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:53 smithi044 bash[22676]: cluster 2024-09-20T23:12:52.802422+0000 mgr.a (mgr.14388) 2523 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:53.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:53 smithi044 bash[22676]: audit 2024-09-20T23:12:52.929519+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:53.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:53 smithi044 bash[22676]: audit 2024-09-20T23:12:52.937178+0000 mon.a (mon.0) 2724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:53 smithi179 bash[23186]: cluster 2024-09-20T23:12:52.802422+0000 mgr.a (mgr.14388) 2523 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:53 smithi179 bash[23186]: audit 2024-09-20T23:12:52.929519+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:53 smithi179 bash[23186]: audit 2024-09-20T23:12:52.937178+0000 mon.a (mon.0) 2724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:53 smithi179 bash[23186]: audit 2024-09-20T23:12:52.948339+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:53 smithi049 bash[23528]: cluster 2024-09-20T23:12:52.802422+0000 mgr.a (mgr.14388) 2523 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:53 smithi049 bash[23528]: audit 2024-09-20T23:12:52.929519+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:53 smithi049 bash[23528]: audit 2024-09-20T23:12:52.937178+0000 mon.a (mon.0) 2724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:53 smithi049 bash[23528]: audit 2024-09-20T23:12:52.948339+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:53 smithi044 bash[22676]: audit 2024-09-20T23:12:52.948339+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:12:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:55 smithi044 bash[22676]: cluster 2024-09-20T23:12:54.803192+0000 mgr.a (mgr.14388) 2524 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:55 smithi179 bash[23186]: cluster 2024-09-20T23:12:54.803192+0000 mgr.a (mgr.14388) 2524 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:55 smithi049 bash[23528]: cluster 2024-09-20T23:12:54.803192+0000 mgr.a (mgr.14388) 2524 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:12:56.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:12:56.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:12:56.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:12:57.641 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:12:57.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:12:57.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:12:57.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:12:57.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:12:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:57 smithi044 bash[22676]: cluster 2024-09-20T23:12:56.805560+0000 mgr.a (mgr.14388) 2525 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:57 smithi044 bash[22676]: audit 2024-09-20T23:12:57.213211+0000 mgr.a (mgr.14388) 2526 : audit [DBG] from='client.66285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:57 smithi179 bash[23186]: cluster 2024-09-20T23:12:56.805560+0000 mgr.a (mgr.14388) 2525 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:57 smithi179 bash[23186]: audit 2024-09-20T23:12:57.213211+0000 mgr.a (mgr.14388) 2526 : audit [DBG] from='client.66285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:12:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:57 smithi049 bash[23528]: cluster 2024-09-20T23:12:56.805560+0000 mgr.a (mgr.14388) 2525 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:12:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:57 smithi049 bash[23528]: audit 2024-09-20T23:12:57.213211+0000 mgr.a (mgr.14388) 2526 : audit [DBG] from='client.66285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:12:59 smithi044 bash[22676]: cluster 2024-09-20T23:12:58.806615+0000 mgr.a (mgr.14388) 2527 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:12:59 smithi179 bash[23186]: cluster 2024-09-20T23:12:58.806615+0000 mgr.a (mgr.14388) 2527 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:12:59 smithi049 bash[23528]: cluster 2024-09-20T23:12:58.806615+0000 mgr.a (mgr.14388) 2527 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:01 smithi044 bash[22676]: cluster 2024-09-20T23:13:00.808995+0000 mgr.a (mgr.14388) 2528 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:01 smithi179 bash[23186]: cluster 2024-09-20T23:13:00.808995+0000 mgr.a (mgr.14388) 2528 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:01 smithi049 bash[23528]: cluster 2024-09-20T23:13:00.808995+0000 mgr.a (mgr.14388) 2528 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:02.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:02.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:03.423 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:03.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:03.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:03.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:03.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:03 smithi044 bash[22676]: cluster 2024-09-20T23:13:02.809954+0000 mgr.a (mgr.14388) 2529 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:13:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:03 smithi044 bash[22676]: audit 2024-09-20T23:13:02.981553+0000 mgr.a (mgr.14388) 2530 : audit [DBG] from='client.66363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:03 smithi179 bash[23186]: cluster 2024-09-20T23:13:02.809954+0000 mgr.a (mgr.14388) 2529 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:13:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:03 smithi179 bash[23186]: audit 2024-09-20T23:13:02.981553+0000 mgr.a (mgr.14388) 2530 : audit [DBG] from='client.66363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:03 smithi049 bash[23528]: cluster 2024-09-20T23:13:02.809954+0000 mgr.a (mgr.14388) 2529 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:13:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:03 smithi049 bash[23528]: audit 2024-09-20T23:13:02.981553+0000 mgr.a (mgr.14388) 2530 : audit [DBG] from='client.66363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:05 smithi044 bash[22676]: cluster 2024-09-20T23:13:04.811056+0000 mgr.a (mgr.14388) 2531 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:13:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:05 smithi179 bash[23186]: cluster 2024-09-20T23:13:04.811056+0000 mgr.a (mgr.14388) 2531 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:13:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:05 smithi049 bash[23528]: cluster 2024-09-20T23:13:04.811056+0000 mgr.a (mgr.14388) 2531 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:13:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:07 smithi044 bash[22676]: cluster 2024-09-20T23:13:06.813372+0000 mgr.a (mgr.14388) 2532 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:07 smithi179 bash[23186]: cluster 2024-09-20T23:13:06.813372+0000 mgr.a (mgr.14388) 2532 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:07 smithi049 bash[23528]: cluster 2024-09-20T23:13:06.813372+0000 mgr.a (mgr.14388) 2532 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:08.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:08.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:08.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:09.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:09.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:09 smithi044 bash[22676]: audit 2024-09-20T23:13:08.758739+0000 mgr.a (mgr.14388) 2533 : audit [DBG] from='client.66438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:09 smithi044 bash[22676]: cluster 2024-09-20T23:13:08.814364+0000 mgr.a (mgr.14388) 2534 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:09 smithi179 bash[23186]: audit 2024-09-20T23:13:08.758739+0000 mgr.a (mgr.14388) 2533 : audit [DBG] from='client.66438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:09 smithi179 bash[23186]: cluster 2024-09-20T23:13:08.814364+0000 mgr.a (mgr.14388) 2534 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:09 smithi049 bash[23528]: audit 2024-09-20T23:13:08.758739+0000 mgr.a (mgr.14388) 2533 : audit [DBG] from='client.66438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:09 smithi049 bash[23528]: cluster 2024-09-20T23:13:08.814364+0000 mgr.a (mgr.14388) 2534 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:11 smithi179 bash[23186]: cluster 2024-09-20T23:13:10.816746+0000 mgr.a (mgr.14388) 2535 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:11 smithi179 bash[23186]: audit 2024-09-20T23:13:11.000761+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:11 smithi179 bash[23186]: audit 2024-09-20T23:13:11.009306+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:11 smithi179 bash[23186]: audit 2024-09-20T23:13:11.019547+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:11 smithi179 bash[23186]: audit 2024-09-20T23:13:11.236393+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:11 smithi179 bash[23186]: audit 2024-09-20T23:13:11.244814+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:11 smithi179 bash[23186]: audit 2024-09-20T23:13:11.254786+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:11 smithi049 bash[23528]: cluster 2024-09-20T23:13:10.816746+0000 mgr.a (mgr.14388) 2535 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:11 smithi049 bash[23528]: audit 2024-09-20T23:13:11.000761+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:11 smithi049 bash[23528]: audit 2024-09-20T23:13:11.009306+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:11 smithi049 bash[23528]: audit 2024-09-20T23:13:11.019547+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:11 smithi049 bash[23528]: audit 2024-09-20T23:13:11.236393+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:11 smithi049 bash[23528]: audit 2024-09-20T23:13:11.244814+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:11 smithi049 bash[23528]: audit 2024-09-20T23:13:11.254786+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:11 smithi044 bash[22676]: cluster 2024-09-20T23:13:10.816746+0000 mgr.a (mgr.14388) 2535 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:11 smithi044 bash[22676]: audit 2024-09-20T23:13:11.000761+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:11 smithi044 bash[22676]: audit 2024-09-20T23:13:11.009306+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:11 smithi044 bash[22676]: audit 2024-09-20T23:13:11.019547+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:11 smithi044 bash[22676]: audit 2024-09-20T23:13:11.236393+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:12 smithi044 bash[22676]: audit 2024-09-20T23:13:11.244814+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:12.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:12 smithi044 bash[22676]: audit 2024-09-20T23:13:11.254786+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:14.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:14.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:14 smithi044 bash[22676]: cluster 2024-09-20T23:13:12.817683+0000 mgr.a (mgr.14388) 2536 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:14 smithi044 bash[22676]: audit 2024-09-20T23:13:13.158701+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:14 smithi044 bash[22676]: audit 2024-09-20T23:13:13.167204+0000 mon.a (mon.0) 2733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:14 smithi044 bash[22676]: audit 2024-09-20T23:13:13.177565+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:14 smithi179 bash[23186]: cluster 2024-09-20T23:13:12.817683+0000 mgr.a (mgr.14388) 2536 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:14 smithi179 bash[23186]: audit 2024-09-20T23:13:13.158701+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:14 smithi179 bash[23186]: audit 2024-09-20T23:13:13.167204+0000 mon.a (mon.0) 2733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:14 smithi179 bash[23186]: audit 2024-09-20T23:13:13.177565+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:14 smithi049 bash[23528]: cluster 2024-09-20T23:13:12.817683+0000 mgr.a (mgr.14388) 2536 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:14 smithi049 bash[23528]: audit 2024-09-20T23:13:13.158701+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:14 smithi049 bash[23528]: audit 2024-09-20T23:13:13.167204+0000 mon.a (mon.0) 2733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:14 smithi049 bash[23528]: audit 2024-09-20T23:13:13.177565+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:14.941 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:14.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:14.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:14.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:14.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:15 smithi179 bash[23186]: audit 2024-09-20T23:13:14.519063+0000 mgr.a (mgr.14388) 2537 : audit [DBG] from='client.66516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:15 smithi044 bash[22676]: audit 2024-09-20T23:13:14.519063+0000 mgr.a (mgr.14388) 2537 : audit [DBG] from='client.66516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:15 smithi049 bash[23528]: audit 2024-09-20T23:13:14.519063+0000 mgr.a (mgr.14388) 2537 : audit [DBG] from='client.66516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:16 smithi044 bash[22676]: cluster 2024-09-20T23:13:14.818161+0000 mgr.a (mgr.14388) 2538 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:16 smithi179 bash[23186]: cluster 2024-09-20T23:13:14.818161+0000 mgr.a (mgr.14388) 2538 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:16 smithi049 bash[23528]: cluster 2024-09-20T23:13:14.818161+0000 mgr.a (mgr.14388) 2538 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:18 smithi044 bash[22676]: cluster 2024-09-20T23:13:16.820529+0000 mgr.a (mgr.14388) 2539 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:18 smithi179 bash[23186]: cluster 2024-09-20T23:13:16.820529+0000 mgr.a (mgr.14388) 2539 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:18 smithi049 bash[23528]: cluster 2024-09-20T23:13:16.820529+0000 mgr.a (mgr.14388) 2539 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:19.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:20 smithi044 bash[22676]: cluster 2024-09-20T23:13:18.821324+0000 mgr.a (mgr.14388) 2540 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:20 smithi179 bash[23186]: cluster 2024-09-20T23:13:18.821324+0000 mgr.a (mgr.14388) 2540 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:20 smithi049 bash[23528]: cluster 2024-09-20T23:13:18.821324+0000 mgr.a (mgr.14388) 2540 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:20.688 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:20.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:21 smithi044 bash[22676]: audit 2024-09-20T23:13:20.276248+0000 mgr.a (mgr.14388) 2541 : audit [DBG] from='client.66591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:21 smithi179 bash[23186]: audit 2024-09-20T23:13:20.276248+0000 mgr.a (mgr.14388) 2541 : audit [DBG] from='client.66591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:21 smithi049 bash[23528]: audit 2024-09-20T23:13:20.276248+0000 mgr.a (mgr.14388) 2541 : audit [DBG] from='client.66591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:22 smithi044 bash[22676]: cluster 2024-09-20T23:13:20.823849+0000 mgr.a (mgr.14388) 2542 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:22 smithi179 bash[23186]: cluster 2024-09-20T23:13:20.823849+0000 mgr.a (mgr.14388) 2542 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:22 smithi049 bash[23528]: cluster 2024-09-20T23:13:20.823849+0000 mgr.a (mgr.14388) 2542 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:24.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:24 smithi044 bash[22676]: cluster 2024-09-20T23:13:22.824638+0000 mgr.a (mgr.14388) 2543 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:13:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:24 smithi179 bash[23186]: cluster 2024-09-20T23:13:22.824638+0000 mgr.a (mgr.14388) 2543 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:13:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:24 smithi049 bash[23528]: cluster 2024-09-20T23:13:22.824638+0000 mgr.a (mgr.14388) 2543 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:13:25.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:25.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:25.691 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:26 smithi044 bash[22676]: cluster 2024-09-20T23:13:24.825456+0000 mgr.a (mgr.14388) 2544 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:13:26.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:26.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:26.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:26.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:26.440 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:26 smithi179 bash[23186]: cluster 2024-09-20T23:13:24.825456+0000 mgr.a (mgr.14388) 2544 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:13:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:26 smithi049 bash[23528]: cluster 2024-09-20T23:13:24.825456+0000 mgr.a (mgr.14388) 2544 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:13:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:27 smithi044 bash[22676]: audit 2024-09-20T23:13:26.022660+0000 mgr.a (mgr.14388) 2545 : audit [DBG] from='client.66666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:27 smithi179 bash[23186]: audit 2024-09-20T23:13:26.022660+0000 mgr.a (mgr.14388) 2545 : audit [DBG] from='client.66666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:27 smithi049 bash[23528]: audit 2024-09-20T23:13:26.022660+0000 mgr.a (mgr.14388) 2545 : audit [DBG] from='client.66666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:28 smithi044 bash[22676]: cluster 2024-09-20T23:13:26.828048+0000 mgr.a (mgr.14388) 2546 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:28 smithi179 bash[23186]: cluster 2024-09-20T23:13:26.828048+0000 mgr.a (mgr.14388) 2546 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:28 smithi049 bash[23528]: cluster 2024-09-20T23:13:26.828048+0000 mgr.a (mgr.14388) 2546 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:30.465 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:30 smithi049 bash[23528]: cluster 2024-09-20T23:13:28.828811+0000 mgr.a (mgr.14388) 2547 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:13:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:30 smithi044 bash[22676]: cluster 2024-09-20T23:13:28.828811+0000 mgr.a (mgr.14388) 2547 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:13:30.487 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:30 smithi179 bash[23186]: cluster 2024-09-20T23:13:28.828811+0000 mgr.a (mgr.14388) 2547 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:13:31.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:31.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:31.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:32.196 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:32.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:32.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:32.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:32.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:32 smithi179 bash[23186]: cluster 2024-09-20T23:13:30.830850+0000 mgr.a (mgr.14388) 2548 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:32 smithi179 bash[23186]: audit 2024-09-20T23:13:31.185388+0000 mon.a (mon.0) 2735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:32 smithi179 bash[23186]: audit 2024-09-20T23:13:31.194357+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:32 smithi179 bash[23186]: audit 2024-09-20T23:13:31.204983+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:32 smithi179 bash[23186]: audit 2024-09-20T23:13:31.436320+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:32 smithi179 bash[23186]: audit 2024-09-20T23:13:31.446805+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:32 smithi179 bash[23186]: audit 2024-09-20T23:13:31.458762+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:32 smithi049 bash[23528]: cluster 2024-09-20T23:13:30.830850+0000 mgr.a (mgr.14388) 2548 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:32 smithi049 bash[23528]: audit 2024-09-20T23:13:31.185388+0000 mon.a (mon.0) 2735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:32 smithi049 bash[23528]: audit 2024-09-20T23:13:31.194357+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:32 smithi049 bash[23528]: audit 2024-09-20T23:13:31.204983+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:32 smithi049 bash[23528]: audit 2024-09-20T23:13:31.436320+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:32 smithi049 bash[23528]: audit 2024-09-20T23:13:31.446805+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:32 smithi049 bash[23528]: audit 2024-09-20T23:13:31.458762+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:32 smithi044 bash[22676]: cluster 2024-09-20T23:13:30.830850+0000 mgr.a (mgr.14388) 2548 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:32 smithi044 bash[22676]: audit 2024-09-20T23:13:31.185388+0000 mon.a (mon.0) 2735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:32 smithi044 bash[22676]: audit 2024-09-20T23:13:31.194357+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:32 smithi044 bash[22676]: audit 2024-09-20T23:13:31.204983+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:32 smithi044 bash[22676]: audit 2024-09-20T23:13:31.436320+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:32 smithi044 bash[22676]: audit 2024-09-20T23:13:31.446805+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:32 smithi044 bash[22676]: audit 2024-09-20T23:13:31.458762+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:33 smithi044 bash[22676]: audit 2024-09-20T23:13:31.777757+0000 mgr.a (mgr.14388) 2549 : audit [DBG] from='client.66744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:33 smithi179 bash[23186]: audit 2024-09-20T23:13:31.777757+0000 mgr.a (mgr.14388) 2549 : audit [DBG] from='client.66744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:33 smithi049 bash[23528]: audit 2024-09-20T23:13:31.777757+0000 mgr.a (mgr.14388) 2549 : audit [DBG] from='client.66744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:34 smithi044 bash[22676]: cluster 2024-09-20T23:13:32.831813+0000 mgr.a (mgr.14388) 2550 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:34 smithi044 bash[22676]: audit 2024-09-20T23:13:33.382387+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:34 smithi044 bash[22676]: audit 2024-09-20T23:13:33.390853+0000 mon.a (mon.0) 2742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:34 smithi044 bash[22676]: audit 2024-09-20T23:13:33.401208+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:34 smithi179 bash[23186]: cluster 2024-09-20T23:13:32.831813+0000 mgr.a (mgr.14388) 2550 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:34 smithi179 bash[23186]: audit 2024-09-20T23:13:33.382387+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:34 smithi179 bash[23186]: audit 2024-09-20T23:13:33.390853+0000 mon.a (mon.0) 2742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:34 smithi179 bash[23186]: audit 2024-09-20T23:13:33.401208+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:34 smithi049 bash[23528]: cluster 2024-09-20T23:13:32.831813+0000 mgr.a (mgr.14388) 2550 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:34 smithi049 bash[23528]: audit 2024-09-20T23:13:33.382387+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:34 smithi049 bash[23528]: audit 2024-09-20T23:13:33.390853+0000 mon.a (mon.0) 2742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:34 smithi049 bash[23528]: audit 2024-09-20T23:13:33.401208+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:36 smithi044 bash[22676]: cluster 2024-09-20T23:13:34.832589+0000 mgr.a (mgr.14388) 2551 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:36 smithi179 bash[23186]: cluster 2024-09-20T23:13:34.832589+0000 mgr.a (mgr.14388) 2551 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:36 smithi049 bash[23528]: cluster 2024-09-20T23:13:34.832589+0000 mgr.a (mgr.14388) 2551 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:37.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:37.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:37.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:37.986 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:38 smithi044 bash[22676]: cluster 2024-09-20T23:13:36.834952+0000 mgr.a (mgr.14388) 2552 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:38 smithi044 bash[22676]: audit 2024-09-20T23:13:37.538202+0000 mgr.a (mgr.14388) 2553 : audit [DBG] from='client.66822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:38 smithi179 bash[23186]: cluster 2024-09-20T23:13:36.834952+0000 mgr.a (mgr.14388) 2552 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:38 smithi179 bash[23186]: audit 2024-09-20T23:13:37.538202+0000 mgr.a (mgr.14388) 2553 : audit [DBG] from='client.66822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:38 smithi049 bash[23528]: cluster 2024-09-20T23:13:36.834952+0000 mgr.a (mgr.14388) 2552 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:38.862 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:38 smithi049 bash[23528]: audit 2024-09-20T23:13:37.538202+0000 mgr.a (mgr.14388) 2553 : audit [DBG] from='client.66822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:40 smithi044 bash[22676]: cluster 2024-09-20T23:13:38.835952+0000 mgr.a (mgr.14388) 2554 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:40 smithi179 bash[23186]: cluster 2024-09-20T23:13:38.835952+0000 mgr.a (mgr.14388) 2554 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:40 smithi049 bash[23528]: cluster 2024-09-20T23:13:38.835952+0000 mgr.a (mgr.14388) 2554 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:42 smithi044 bash[22676]: cluster 2024-09-20T23:13:40.838235+0000 mgr.a (mgr.14388) 2555 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:42 smithi179 bash[23186]: cluster 2024-09-20T23:13:40.838235+0000 mgr.a (mgr.14388) 2555 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:42 smithi049 bash[23528]: cluster 2024-09-20T23:13:40.838235+0000 mgr.a (mgr.14388) 2555 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:42.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:42.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:42.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:43.778 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:43.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:43.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:43.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:43.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:44 smithi044 bash[22676]: cluster 2024-09-20T23:13:42.839021+0000 mgr.a (mgr.14388) 2556 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:44 smithi044 bash[22676]: audit 2024-09-20T23:13:43.326297+0000 mgr.a (mgr.14388) 2557 : audit [DBG] from='client.66900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:44 smithi179 bash[23186]: cluster 2024-09-20T23:13:42.839021+0000 mgr.a (mgr.14388) 2556 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:44 smithi179 bash[23186]: audit 2024-09-20T23:13:43.326297+0000 mgr.a (mgr.14388) 2557 : audit [DBG] from='client.66900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:44 smithi049 bash[23528]: cluster 2024-09-20T23:13:42.839021+0000 mgr.a (mgr.14388) 2556 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:44 smithi049 bash[23528]: audit 2024-09-20T23:13:43.326297+0000 mgr.a (mgr.14388) 2557 : audit [DBG] from='client.66900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:46 smithi044 bash[22676]: cluster 2024-09-20T23:13:44.839717+0000 mgr.a (mgr.14388) 2558 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:46 smithi179 bash[23186]: cluster 2024-09-20T23:13:44.839717+0000 mgr.a (mgr.14388) 2558 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:46 smithi049 bash[23528]: cluster 2024-09-20T23:13:44.839717+0000 mgr.a (mgr.14388) 2558 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:48 smithi044 bash[22676]: cluster 2024-09-20T23:13:46.841140+0000 mgr.a (mgr.14388) 2559 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:48 smithi179 bash[23186]: cluster 2024-09-20T23:13:46.841140+0000 mgr.a (mgr.14388) 2559 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:48.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:48.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:48.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:48 smithi049 bash[23528]: cluster 2024-09-20T23:13:46.841140+0000 mgr.a (mgr.14388) 2559 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:49.554 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:49.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:49.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:49.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:49.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:50 smithi044 bash[22676]: cluster 2024-09-20T23:13:48.841704+0000 mgr.a (mgr.14388) 2560 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:50 smithi044 bash[22676]: audit 2024-09-20T23:13:49.115962+0000 mgr.a (mgr.14388) 2561 : audit [DBG] from='client.66978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:50 smithi179 bash[23186]: cluster 2024-09-20T23:13:48.841704+0000 mgr.a (mgr.14388) 2560 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:50 smithi179 bash[23186]: audit 2024-09-20T23:13:49.115962+0000 mgr.a (mgr.14388) 2561 : audit [DBG] from='client.66978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:50 smithi049 bash[23528]: cluster 2024-09-20T23:13:48.841704+0000 mgr.a (mgr.14388) 2560 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:50 smithi049 bash[23528]: audit 2024-09-20T23:13:49.115962+0000 mgr.a (mgr.14388) 2561 : audit [DBG] from='client.66978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:51.597 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:50.650397+0000 mon.a (mon.0) 2744 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.597 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:50.657711+0000 mon.a (mon.0) 2745 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.597 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:50.659554+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.597 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:50.670530+0000 mon.a (mon.0) 2747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.597 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:50.677074+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:13:51.598 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:51.365352+0000 mon.a (mon.0) 2749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.598 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:51.369425+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.598 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:51 smithi179 bash[23186]: audit 2024-09-20T23:13:51.377266+0000 mon.a (mon.0) 2751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22930]: debug 2024-09-20T23:13:51.397+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22930]: debug 2024-09-20T23:13:51.397+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:50.650397+0000 mon.a (mon.0) 2744 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:50.657711+0000 mon.a (mon.0) 2745 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:50.659554+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:50.670530+0000 mon.a (mon.0) 2747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:50.677074+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:51.365352+0000 mon.a (mon.0) 2749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:51.369425+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:51 smithi044 bash[22676]: audit 2024-09-20T23:13:51.377266+0000 mon.a (mon.0) 2751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:50.650397+0000 mon.a (mon.0) 2744 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:13:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:50.657711+0000 mon.a (mon.0) 2745 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:13:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:50.659554+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:13:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:50.670530+0000 mon.a (mon.0) 2747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:50.677074+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:13:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:51.365352+0000 mon.a (mon.0) 2749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:51.369425+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:51 smithi049 bash[23528]: audit 2024-09-20T23:13:51.377266+0000 mon.a (mon.0) 2751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:52 smithi049 bash[23528]: audit 2024-09-20T23:13:50.679764+0000 mgr.a (mgr.14388) 2562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:13:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:52 smithi049 bash[23528]: cluster 2024-09-20T23:13:50.843118+0000 mgr.a (mgr.14388) 2563 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:52 smithi049 bash[23528]: audit 2024-09-20T23:13:51.403872+0000 mgr.a (mgr.14388) 2564 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:13:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:52 smithi049 bash[23528]: cephadm 2024-09-20T23:13:51.404819+0000 mgr.a (mgr.14388) 2565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:13:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:52 smithi049 bash[23528]: audit 2024-09-20T23:13:51.579072+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:52 smithi049 bash[23528]: audit 2024-09-20T23:13:51.586696+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:52 smithi049 bash[23528]: audit 2024-09-20T23:13:51.595896+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.937 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:52 smithi179 bash[23186]: audit 2024-09-20T23:13:50.679764+0000 mgr.a (mgr.14388) 2562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:13:52.937 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:52 smithi179 bash[23186]: cluster 2024-09-20T23:13:50.843118+0000 mgr.a (mgr.14388) 2563 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:52.937 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:52 smithi179 bash[23186]: audit 2024-09-20T23:13:51.403872+0000 mgr.a (mgr.14388) 2564 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:13:52.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:52 smithi179 bash[23186]: cephadm 2024-09-20T23:13:51.404819+0000 mgr.a (mgr.14388) 2565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:13:52.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:52 smithi179 bash[23186]: audit 2024-09-20T23:13:51.579072+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:52 smithi179 bash[23186]: audit 2024-09-20T23:13:51.586696+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:52 smithi179 bash[23186]: audit 2024-09-20T23:13:51.595896+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:52 smithi044 bash[22676]: audit 2024-09-20T23:13:50.679764+0000 mgr.a (mgr.14388) 2562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:13:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:52 smithi044 bash[22676]: cluster 2024-09-20T23:13:50.843118+0000 mgr.a (mgr.14388) 2563 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:13:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:52 smithi044 bash[22676]: audit 2024-09-20T23:13:51.403872+0000 mgr.a (mgr.14388) 2564 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:13:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:52 smithi044 bash[22676]: cephadm 2024-09-20T23:13:51.404819+0000 mgr.a (mgr.14388) 2565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:13:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:52 smithi044 bash[22676]: audit 2024-09-20T23:13:51.579072+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:52 smithi044 bash[22676]: audit 2024-09-20T23:13:51.586696+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:52 smithi044 bash[22676]: audit 2024-09-20T23:13:51.595896+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:54.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:13:54.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:13:54.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:13:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:54 smithi044 bash[22676]: cluster 2024-09-20T23:13:52.844032+0000 mgr.a (mgr.14388) 2566 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:54 smithi044 bash[22676]: audit 2024-09-20T23:13:53.618450+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:54 smithi044 bash[22676]: audit 2024-09-20T23:13:53.626754+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:54 smithi044 bash[22676]: audit 2024-09-20T23:13:53.636598+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:54 smithi179 bash[23186]: cluster 2024-09-20T23:13:52.844032+0000 mgr.a (mgr.14388) 2566 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:54 smithi179 bash[23186]: audit 2024-09-20T23:13:53.618450+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:54 smithi179 bash[23186]: audit 2024-09-20T23:13:53.626754+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:54 smithi179 bash[23186]: audit 2024-09-20T23:13:53.636598+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:54 smithi049 bash[23528]: cluster 2024-09-20T23:13:52.844032+0000 mgr.a (mgr.14388) 2566 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:54 smithi049 bash[23528]: audit 2024-09-20T23:13:53.618450+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:54 smithi049 bash[23528]: audit 2024-09-20T23:13:53.626754+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:54 smithi049 bash[23528]: audit 2024-09-20T23:13:53.636598+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:13:55.317 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:13:55.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:13:55.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:13:55.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:13:55.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:13:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:56 smithi044 bash[22676]: cluster 2024-09-20T23:13:54.844773+0000 mgr.a (mgr.14388) 2567 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:56 smithi044 bash[22676]: audit 2024-09-20T23:13:54.891611+0000 mgr.a (mgr.14388) 2568 : audit [DBG] from='client.67158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:56 smithi179 bash[23186]: cluster 2024-09-20T23:13:54.844773+0000 mgr.a (mgr.14388) 2567 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:56 smithi179 bash[23186]: audit 2024-09-20T23:13:54.891611+0000 mgr.a (mgr.14388) 2568 : audit [DBG] from='client.67158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:56 smithi049 bash[23528]: cluster 2024-09-20T23:13:54.844773+0000 mgr.a (mgr.14388) 2567 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:13:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:56 smithi049 bash[23528]: audit 2024-09-20T23:13:54.891611+0000 mgr.a (mgr.14388) 2568 : audit [DBG] from='client.67158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:13:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:13:58 smithi044 bash[22676]: cluster 2024-09-20T23:13:56.847654+0000 mgr.a (mgr.14388) 2569 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:13:58 smithi179 bash[23186]: cluster 2024-09-20T23:13:56.847654+0000 mgr.a (mgr.14388) 2569 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:13:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:13:58 smithi049 bash[23528]: cluster 2024-09-20T23:13:56.847654+0000 mgr.a (mgr.14388) 2569 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:00.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:00.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:00 smithi044 bash[22676]: cluster 2024-09-20T23:13:58.848436+0000 mgr.a (mgr.14388) 2570 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:00 smithi179 bash[23186]: cluster 2024-09-20T23:13:58.848436+0000 mgr.a (mgr.14388) 2570 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:00 smithi049 bash[23528]: cluster 2024-09-20T23:13:58.848436+0000 mgr.a (mgr.14388) 2570 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:01.063 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:02 smithi044 bash[22676]: audit 2024-09-20T23:14:00.649476+0000 mgr.a (mgr.14388) 2571 : audit [DBG] from='client.67236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:02 smithi044 bash[22676]: cluster 2024-09-20T23:14:00.849968+0000 mgr.a (mgr.14388) 2572 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:02 smithi179 bash[23186]: audit 2024-09-20T23:14:00.649476+0000 mgr.a (mgr.14388) 2571 : audit [DBG] from='client.67236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:02 smithi179 bash[23186]: cluster 2024-09-20T23:14:00.849968+0000 mgr.a (mgr.14388) 2572 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:02 smithi049 bash[23528]: audit 2024-09-20T23:14:00.649476+0000 mgr.a (mgr.14388) 2571 : audit [DBG] from='client.67236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:02 smithi049 bash[23528]: cluster 2024-09-20T23:14:00.849968+0000 mgr.a (mgr.14388) 2572 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:03 smithi044 bash[22676]: cluster 2024-09-20T23:14:02.850826+0000 mgr.a (mgr.14388) 2573 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:03 smithi179 bash[23186]: cluster 2024-09-20T23:14:02.850826+0000 mgr.a (mgr.14388) 2573 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:03 smithi049 bash[23528]: cluster 2024-09-20T23:14:02.850826+0000 mgr.a (mgr.14388) 2573 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:06.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:06.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:06.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:06.123 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:05 smithi044 bash[22676]: cluster 2024-09-20T23:14:04.851674+0000 mgr.a (mgr.14388) 2574 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:05 smithi179 bash[23186]: cluster 2024-09-20T23:14:04.851674+0000 mgr.a (mgr.14388) 2574 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:05 smithi049 bash[23528]: cluster 2024-09-20T23:14:04.851674+0000 mgr.a (mgr.14388) 2574 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:14:06.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:06.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:06.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:06.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:06.838 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:06 smithi044 bash[22676]: audit 2024-09-20T23:14:06.407770+0000 mgr.a (mgr.14388) 2575 : audit [DBG] from='client.67314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:06 smithi179 bash[23186]: audit 2024-09-20T23:14:06.407770+0000 mgr.a (mgr.14388) 2575 : audit [DBG] from='client.67314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:06 smithi049 bash[23528]: audit 2024-09-20T23:14:06.407770+0000 mgr.a (mgr.14388) 2575 : audit [DBG] from='client.67314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:07 smithi044 bash[22676]: cluster 2024-09-20T23:14:06.853041+0000 mgr.a (mgr.14388) 2576 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:07 smithi179 bash[23186]: cluster 2024-09-20T23:14:06.853041+0000 mgr.a (mgr.14388) 2576 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:07 smithi049 bash[23528]: cluster 2024-09-20T23:14:06.853041+0000 mgr.a (mgr.14388) 2576 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:09 smithi049 bash[23528]: cluster 2024-09-20T23:14:08.853825+0000 mgr.a (mgr.14388) 2577 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:09 smithi044 bash[22676]: cluster 2024-09-20T23:14:08.853825+0000 mgr.a (mgr.14388) 2577 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:09 smithi179 bash[23186]: cluster 2024-09-20T23:14:08.853825+0000 mgr.a (mgr.14388) 2577 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:12.600 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:12.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:12.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:12.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:12.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:12 smithi179 bash[23186]: cluster 2024-09-20T23:14:10.855760+0000 mgr.a (mgr.14388) 2578 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:12 smithi179 bash[23186]: audit 2024-09-20T23:14:11.529976+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:12 smithi179 bash[23186]: audit 2024-09-20T23:14:11.538730+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:12 smithi179 bash[23186]: audit 2024-09-20T23:14:11.549282+0000 mon.a (mon.0) 2760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:12 smithi179 bash[23186]: audit 2024-09-20T23:14:11.791698+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:12 smithi179 bash[23186]: audit 2024-09-20T23:14:11.800047+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:12 smithi179 bash[23186]: audit 2024-09-20T23:14:11.810495+0000 mon.a (mon.0) 2763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:12 smithi049 bash[23528]: cluster 2024-09-20T23:14:10.855760+0000 mgr.a (mgr.14388) 2578 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:12 smithi049 bash[23528]: audit 2024-09-20T23:14:11.529976+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:12 smithi049 bash[23528]: audit 2024-09-20T23:14:11.538730+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:12 smithi049 bash[23528]: audit 2024-09-20T23:14:11.549282+0000 mon.a (mon.0) 2760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:12 smithi049 bash[23528]: audit 2024-09-20T23:14:11.791698+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:12 smithi049 bash[23528]: audit 2024-09-20T23:14:11.800047+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:12 smithi049 bash[23528]: audit 2024-09-20T23:14:11.810495+0000 mon.a (mon.0) 2763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:12 smithi044 bash[22676]: cluster 2024-09-20T23:14:10.855760+0000 mgr.a (mgr.14388) 2578 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:12 smithi044 bash[22676]: audit 2024-09-20T23:14:11.529976+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:12 smithi044 bash[22676]: audit 2024-09-20T23:14:11.538730+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:12 smithi044 bash[22676]: audit 2024-09-20T23:14:11.549282+0000 mon.a (mon.0) 2760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:12 smithi044 bash[22676]: audit 2024-09-20T23:14:11.791698+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:12 smithi044 bash[22676]: audit 2024-09-20T23:14:11.800047+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:12 smithi044 bash[22676]: audit 2024-09-20T23:14:11.810495+0000 mon.a (mon.0) 2763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:13.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:13 smithi179 bash[23186]: audit 2024-09-20T23:14:12.172387+0000 mgr.a (mgr.14388) 2579 : audit [DBG] from='client.67392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:13 smithi049 bash[23528]: audit 2024-09-20T23:14:12.172387+0000 mgr.a (mgr.14388) 2579 : audit [DBG] from='client.67392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:13.868 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:13 smithi044 bash[22676]: audit 2024-09-20T23:14:12.172387+0000 mgr.a (mgr.14388) 2579 : audit [DBG] from='client.67392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:14 smithi179 bash[23186]: cluster 2024-09-20T23:14:12.856868+0000 mgr.a (mgr.14388) 2580 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:14 smithi179 bash[23186]: audit 2024-09-20T23:14:13.850710+0000 mon.a (mon.0) 2764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:14 smithi179 bash[23186]: audit 2024-09-20T23:14:13.856590+0000 mon.a (mon.0) 2765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:14 smithi179 bash[23186]: audit 2024-09-20T23:14:13.866514+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:14 smithi049 bash[23528]: cluster 2024-09-20T23:14:12.856868+0000 mgr.a (mgr.14388) 2580 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:14 smithi049 bash[23528]: audit 2024-09-20T23:14:13.850710+0000 mon.a (mon.0) 2764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:14 smithi049 bash[23528]: audit 2024-09-20T23:14:13.856590+0000 mon.a (mon.0) 2765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:14 smithi049 bash[23528]: audit 2024-09-20T23:14:13.866514+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:14 smithi044 bash[22676]: cluster 2024-09-20T23:14:12.856868+0000 mgr.a (mgr.14388) 2580 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:14 smithi044 bash[22676]: audit 2024-09-20T23:14:13.850710+0000 mon.a (mon.0) 2764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:14 smithi044 bash[22676]: audit 2024-09-20T23:14:13.856590+0000 mon.a (mon.0) 2765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:14 smithi044 bash[22676]: audit 2024-09-20T23:14:13.866514+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:16 smithi049 bash[23528]: cluster 2024-09-20T23:14:14.857742+0000 mgr.a (mgr.14388) 2581 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:16 smithi044 bash[22676]: cluster 2024-09-20T23:14:14.857742+0000 mgr.a (mgr.14388) 2581 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:16 smithi179 bash[23186]: cluster 2024-09-20T23:14:14.857742+0000 mgr.a (mgr.14388) 2581 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:17.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:17.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:17.603 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:18.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:18.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:18.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:18.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:18 smithi049 bash[23528]: cluster 2024-09-20T23:14:16.859960+0000 mgr.a (mgr.14388) 2582 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:18 smithi044 bash[22676]: cluster 2024-09-20T23:14:16.859960+0000 mgr.a (mgr.14388) 2582 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:18 smithi179 bash[23186]: cluster 2024-09-20T23:14:16.859960+0000 mgr.a (mgr.14388) 2582 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:19 smithi044 bash[22676]: audit 2024-09-20T23:14:17.934002+0000 mgr.a (mgr.14388) 2583 : audit [DBG] from='client.67467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:19 smithi179 bash[23186]: audit 2024-09-20T23:14:17.934002+0000 mgr.a (mgr.14388) 2583 : audit [DBG] from='client.67467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:19 smithi049 bash[23528]: audit 2024-09-20T23:14:17.934002+0000 mgr.a (mgr.14388) 2583 : audit [DBG] from='client.67467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:20 smithi044 bash[22676]: cluster 2024-09-20T23:14:18.860953+0000 mgr.a (mgr.14388) 2584 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:20 smithi179 bash[23186]: cluster 2024-09-20T23:14:18.860953+0000 mgr.a (mgr.14388) 2584 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:20 smithi049 bash[23528]: cluster 2024-09-20T23:14:18.860953+0000 mgr.a (mgr.14388) 2584 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:22 smithi044 bash[22676]: cluster 2024-09-20T23:14:20.863295+0000 mgr.a (mgr.14388) 2585 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:22 smithi179 bash[23186]: cluster 2024-09-20T23:14:20.863295+0000 mgr.a (mgr.14388) 2585 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:22 smithi049 bash[23528]: cluster 2024-09-20T23:14:20.863295+0000 mgr.a (mgr.14388) 2585 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:23.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:23.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:23.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:24.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:24.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:24.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:24.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:24.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:24 smithi044 bash[22676]: cluster 2024-09-20T23:14:22.864056+0000 mgr.a (mgr.14388) 2586 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:24 smithi179 bash[23186]: cluster 2024-09-20T23:14:22.864056+0000 mgr.a (mgr.14388) 2586 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:24 smithi049 bash[23528]: cluster 2024-09-20T23:14:22.864056+0000 mgr.a (mgr.14388) 2586 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:25 smithi044 bash[22676]: audit 2024-09-20T23:14:23.726564+0000 mgr.a (mgr.14388) 2587 : audit [DBG] from='client.67539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:25 smithi179 bash[23186]: audit 2024-09-20T23:14:23.726564+0000 mgr.a (mgr.14388) 2587 : audit [DBG] from='client.67539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:25 smithi049 bash[23528]: audit 2024-09-20T23:14:23.726564+0000 mgr.a (mgr.14388) 2587 : audit [DBG] from='client.67539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:26.897 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:26 smithi044 bash[22676]: cluster 2024-09-20T23:14:24.865029+0000 mgr.a (mgr.14388) 2588 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:26 smithi179 bash[23186]: cluster 2024-09-20T23:14:24.865029+0000 mgr.a (mgr.14388) 2588 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:26 smithi049 bash[23528]: cluster 2024-09-20T23:14:24.865029+0000 mgr.a (mgr.14388) 2588 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:28 smithi044 bash[22676]: cluster 2024-09-20T23:14:26.866272+0000 mgr.a (mgr.14388) 2589 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:28 smithi179 bash[23186]: cluster 2024-09-20T23:14:26.866272+0000 mgr.a (mgr.14388) 2589 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:28 smithi049 bash[23528]: cluster 2024-09-20T23:14:26.866272+0000 mgr.a (mgr.14388) 2589 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:29.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:30 smithi049 bash[23528]: cluster 2024-09-20T23:14:28.866760+0000 mgr.a (mgr.14388) 2590 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:30 smithi049 bash[23528]: audit 2024-09-20T23:14:29.511553+0000 mgr.a (mgr.14388) 2591 : audit [DBG] from='client.67617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:30 smithi044 bash[22676]: cluster 2024-09-20T23:14:28.866760+0000 mgr.a (mgr.14388) 2590 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:30 smithi044 bash[22676]: audit 2024-09-20T23:14:29.511553+0000 mgr.a (mgr.14388) 2591 : audit [DBG] from='client.67617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:30 smithi179 bash[23186]: cluster 2024-09-20T23:14:28.866760+0000 mgr.a (mgr.14388) 2590 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:30 smithi179 bash[23186]: audit 2024-09-20T23:14:29.511553+0000 mgr.a (mgr.14388) 2591 : audit [DBG] from='client.67617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:32.860 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:32 smithi049 bash[23528]: cluster 2024-09-20T23:14:30.869159+0000 mgr.a (mgr.14388) 2592 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:32.861 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:32 smithi049 bash[23528]: audit 2024-09-20T23:14:31.744173+0000 mon.a (mon.0) 2767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.861 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:32 smithi049 bash[23528]: audit 2024-09-20T23:14:31.752736+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.861 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:32 smithi049 bash[23528]: audit 2024-09-20T23:14:31.763383+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.861 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:32 smithi049 bash[23528]: audit 2024-09-20T23:14:32.020785+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.861 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:32 smithi049 bash[23528]: audit 2024-09-20T23:14:32.029529+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.861 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:32 smithi049 bash[23528]: audit 2024-09-20T23:14:32.039646+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.981 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:32 smithi179 bash[23186]: cluster 2024-09-20T23:14:30.869159+0000 mgr.a (mgr.14388) 2592 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:32.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:32 smithi179 bash[23186]: audit 2024-09-20T23:14:31.744173+0000 mon.a (mon.0) 2767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:32 smithi179 bash[23186]: audit 2024-09-20T23:14:31.752736+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:32 smithi179 bash[23186]: audit 2024-09-20T23:14:31.763383+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:32 smithi179 bash[23186]: audit 2024-09-20T23:14:32.020785+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:32 smithi179 bash[23186]: audit 2024-09-20T23:14:32.029529+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:32 smithi179 bash[23186]: audit 2024-09-20T23:14:32.039646+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:32 smithi044 bash[22676]: cluster 2024-09-20T23:14:30.869159+0000 mgr.a (mgr.14388) 2592 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:32 smithi044 bash[22676]: audit 2024-09-20T23:14:31.744173+0000 mon.a (mon.0) 2767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:32 smithi044 bash[22676]: audit 2024-09-20T23:14:31.752736+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:32 smithi044 bash[22676]: audit 2024-09-20T23:14:31.763383+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:32 smithi044 bash[22676]: audit 2024-09-20T23:14:32.020785+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:32 smithi044 bash[22676]: audit 2024-09-20T23:14:32.029529+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:32 smithi044 bash[22676]: audit 2024-09-20T23:14:32.039646+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:34.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:34.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:34.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:34 smithi044 bash[22676]: cluster 2024-09-20T23:14:32.869939+0000 mgr.a (mgr.14388) 2593 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:34 smithi044 bash[22676]: audit 2024-09-20T23:14:34.074458+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:34 smithi044 bash[22676]: audit 2024-09-20T23:14:34.082638+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:34 smithi044 bash[22676]: audit 2024-09-20T23:14:34.092622+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:34 smithi179 bash[23186]: cluster 2024-09-20T23:14:32.869939+0000 mgr.a (mgr.14388) 2593 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:34 smithi179 bash[23186]: audit 2024-09-20T23:14:34.074458+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:34 smithi179 bash[23186]: audit 2024-09-20T23:14:34.082638+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:34 smithi179 bash[23186]: audit 2024-09-20T23:14:34.092622+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:34 smithi049 bash[23528]: cluster 2024-09-20T23:14:32.869939+0000 mgr.a (mgr.14388) 2593 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:34 smithi049 bash[23528]: audit 2024-09-20T23:14:34.074458+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:34 smithi049 bash[23528]: audit 2024-09-20T23:14:34.082638+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:34 smithi049 bash[23528]: audit 2024-09-20T23:14:34.092622+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:35.706 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:35.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:35.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:35.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:35.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:36 smithi044 bash[22676]: cluster 2024-09-20T23:14:34.870683+0000 mgr.a (mgr.14388) 2594 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:36 smithi044 bash[22676]: audit 2024-09-20T23:14:35.294584+0000 mgr.a (mgr.14388) 2595 : audit [DBG] from='client.67695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:36 smithi179 bash[23186]: cluster 2024-09-20T23:14:34.870683+0000 mgr.a (mgr.14388) 2594 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:36 smithi179 bash[23186]: audit 2024-09-20T23:14:35.294584+0000 mgr.a (mgr.14388) 2595 : audit [DBG] from='client.67695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:36 smithi049 bash[23528]: cluster 2024-09-20T23:14:34.870683+0000 mgr.a (mgr.14388) 2594 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:36 smithi049 bash[23528]: audit 2024-09-20T23:14:35.294584+0000 mgr.a (mgr.14388) 2595 : audit [DBG] from='client.67695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:38 smithi044 bash[22676]: cluster 2024-09-20T23:14:36.873576+0000 mgr.a (mgr.14388) 2596 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:38 smithi179 bash[23186]: cluster 2024-09-20T23:14:36.873576+0000 mgr.a (mgr.14388) 2596 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:38 smithi049 bash[23528]: cluster 2024-09-20T23:14:36.873576+0000 mgr.a (mgr.14388) 2596 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:40 smithi044 bash[22676]: cluster 2024-09-20T23:14:38.874392+0000 mgr.a (mgr.14388) 2597 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:14:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:40 smithi179 bash[23186]: cluster 2024-09-20T23:14:38.874392+0000 mgr.a (mgr.14388) 2597 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:14:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:40 smithi049 bash[23528]: cluster 2024-09-20T23:14:38.874392+0000 mgr.a (mgr.14388) 2597 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:14:41.487 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:41.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:41.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:41.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:41.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:42 smithi044 bash[22676]: cluster 2024-09-20T23:14:40.875323+0000 mgr.a (mgr.14388) 2598 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:42 smithi044 bash[22676]: audit 2024-09-20T23:14:41.047075+0000 mgr.a (mgr.14388) 2599 : audit [DBG] from='client.67773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:42 smithi179 bash[23186]: cluster 2024-09-20T23:14:40.875323+0000 mgr.a (mgr.14388) 2598 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:42 smithi179 bash[23186]: audit 2024-09-20T23:14:41.047075+0000 mgr.a (mgr.14388) 2599 : audit [DBG] from='client.67773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:42 smithi049 bash[23528]: cluster 2024-09-20T23:14:40.875323+0000 mgr.a (mgr.14388) 2598 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:42 smithi049 bash[23528]: audit 2024-09-20T23:14:41.047075+0000 mgr.a (mgr.14388) 2599 : audit [DBG] from='client.67773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:44 smithi044 bash[22676]: cluster 2024-09-20T23:14:42.876188+0000 mgr.a (mgr.14388) 2600 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:44 smithi179 bash[23186]: cluster 2024-09-20T23:14:42.876188+0000 mgr.a (mgr.14388) 2600 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:14:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:44 smithi049 bash[23528]: cluster 2024-09-20T23:14:42.876188+0000 mgr.a (mgr.14388) 2600 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:14:46.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:46.489 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:46.489 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:46 smithi044 bash[22676]: cluster 2024-09-20T23:14:44.877178+0000 mgr.a (mgr.14388) 2601 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:14:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:46 smithi179 bash[23186]: cluster 2024-09-20T23:14:44.877178+0000 mgr.a (mgr.14388) 2601 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:14:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:46 smithi049 bash[23528]: cluster 2024-09-20T23:14:44.877178+0000 mgr.a (mgr.14388) 2601 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:14:47.272 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:47.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:47.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:47.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:47.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:48 smithi044 bash[22676]: audit 2024-09-20T23:14:46.834098+0000 mgr.a (mgr.14388) 2602 : audit [DBG] from='client.67848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:48 smithi044 bash[22676]: cluster 2024-09-20T23:14:46.880375+0000 mgr.a (mgr.14388) 2603 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:48 smithi179 bash[23186]: audit 2024-09-20T23:14:46.834098+0000 mgr.a (mgr.14388) 2602 : audit [DBG] from='client.67848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:48 smithi179 bash[23186]: cluster 2024-09-20T23:14:46.880375+0000 mgr.a (mgr.14388) 2603 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:48 smithi049 bash[23528]: audit 2024-09-20T23:14:46.834098+0000 mgr.a (mgr.14388) 2602 : audit [DBG] from='client.67848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:48 smithi049 bash[23528]: cluster 2024-09-20T23:14:46.880375+0000 mgr.a (mgr.14388) 2603 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:50 smithi049 bash[23528]: cluster 2024-09-20T23:14:48.881385+0000 mgr.a (mgr.14388) 2604 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:50 smithi044 bash[22676]: cluster 2024-09-20T23:14:48.881385+0000 mgr.a (mgr.14388) 2604 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:50 smithi179 bash[23186]: cluster 2024-09-20T23:14:48.881385+0000 mgr.a (mgr.14388) 2604 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:51 smithi049 bash[23528]: audit 2024-09-20T23:14:51.450270+0000 mon.a (mon.0) 2776 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:14:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:51 smithi049 bash[23528]: audit 2024-09-20T23:14:51.456902+0000 mon.a (mon.0) 2777 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:14:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:51 smithi049 bash[23528]: audit 2024-09-20T23:14:51.458691+0000 mon.a (mon.0) 2778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:14:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:51 smithi049 bash[23528]: audit 2024-09-20T23:14:51.469950+0000 mon.a (mon.0) 2779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:51 smithi049 bash[23528]: audit 2024-09-20T23:14:51.476337+0000 mon.a (mon.0) 2780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:14:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:51 smithi044 bash[22676]: audit 2024-09-20T23:14:51.450270+0000 mon.a (mon.0) 2776 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:14:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:51 smithi044 bash[22676]: audit 2024-09-20T23:14:51.456902+0000 mon.a (mon.0) 2777 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:14:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:51 smithi044 bash[22676]: audit 2024-09-20T23:14:51.458691+0000 mon.a (mon.0) 2778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:14:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:51 smithi044 bash[22676]: audit 2024-09-20T23:14:51.469950+0000 mon.a (mon.0) 2779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:51 smithi044 bash[22676]: audit 2024-09-20T23:14:51.476337+0000 mon.a (mon.0) 2780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:14:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:51 smithi179 bash[23186]: audit 2024-09-20T23:14:51.450270+0000 mon.a (mon.0) 2776 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:14:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:51 smithi179 bash[23186]: audit 2024-09-20T23:14:51.456902+0000 mon.a (mon.0) 2777 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:14:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:51 smithi179 bash[23186]: audit 2024-09-20T23:14:51.458691+0000 mon.a (mon.0) 2778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:14:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:51 smithi179 bash[23186]: audit 2024-09-20T23:14:51.469950+0000 mon.a (mon.0) 2779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:51 smithi179 bash[23186]: audit 2024-09-20T23:14:51.476337+0000 mon.a (mon.0) 2780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:14:52.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:52.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:52.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:52.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22930]: debug 2024-09-20T23:14:52.216+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:14:52.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22930]: debug 2024-09-20T23:14:52.220+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:14:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: cluster 2024-09-20T23:14:50.883651+0000 mgr.a (mgr.14388) 2605 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: audit 2024-09-20T23:14:51.478686+0000 mgr.a (mgr.14388) 2606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:14:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: audit 2024-09-20T23:14:51.940009+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: audit 2024-09-20T23:14:51.947466+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: audit 2024-09-20T23:14:51.955156+0000 mon.a (mon.0) 2783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: audit 2024-09-20T23:14:52.222888+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: audit 2024-09-20T23:14:52.228097+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:52 smithi044 bash[22676]: audit 2024-09-20T23:14:52.237541+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.000 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:53.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: cluster 2024-09-20T23:14:50.883651+0000 mgr.a (mgr.14388) 2605 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: audit 2024-09-20T23:14:51.478686+0000 mgr.a (mgr.14388) 2606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:14:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: audit 2024-09-20T23:14:51.940009+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: audit 2024-09-20T23:14:51.947466+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: audit 2024-09-20T23:14:51.955156+0000 mon.a (mon.0) 2783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: audit 2024-09-20T23:14:52.222888+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: audit 2024-09-20T23:14:52.228097+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:52 smithi179 bash[23186]: audit 2024-09-20T23:14:52.237541+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: cluster 2024-09-20T23:14:50.883651+0000 mgr.a (mgr.14388) 2605 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: audit 2024-09-20T23:14:51.478686+0000 mgr.a (mgr.14388) 2606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: audit 2024-09-20T23:14:51.940009+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: audit 2024-09-20T23:14:51.947466+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: audit 2024-09-20T23:14:51.955156+0000 mon.a (mon.0) 2783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: audit 2024-09-20T23:14:52.222888+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: audit 2024-09-20T23:14:52.228097+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:52 smithi049 bash[23528]: audit 2024-09-20T23:14:52.237541+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:53.920 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:53 smithi179 bash[23186]: audit 2024-09-20T23:14:52.220750+0000 mgr.a (mgr.14388) 2607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:14:53.920 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:53 smithi179 bash[23186]: cephadm 2024-09-20T23:14:52.224646+0000 mgr.a (mgr.14388) 2608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:14:53.920 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:53 smithi179 bash[23186]: audit 2024-09-20T23:14:52.591878+0000 mgr.a (mgr.14388) 2609 : audit [DBG] from='client.68031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:53 smithi044 bash[22676]: audit 2024-09-20T23:14:52.220750+0000 mgr.a (mgr.14388) 2607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:14:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:53 smithi044 bash[22676]: cephadm 2024-09-20T23:14:52.224646+0000 mgr.a (mgr.14388) 2608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:14:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:53 smithi044 bash[22676]: audit 2024-09-20T23:14:52.591878+0000 mgr.a (mgr.14388) 2609 : audit [DBG] from='client.68031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:53 smithi049 bash[23528]: audit 2024-09-20T23:14:52.220750+0000 mgr.a (mgr.14388) 2607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:14:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:53 smithi049 bash[23528]: cephadm 2024-09-20T23:14:52.224646+0000 mgr.a (mgr.14388) 2608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:14:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:53 smithi049 bash[23528]: audit 2024-09-20T23:14:52.591878+0000 mgr.a (mgr.14388) 2609 : audit [DBG] from='client.68031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:54 smithi044 bash[22676]: cluster 2024-09-20T23:14:52.884149+0000 mgr.a (mgr.14388) 2610 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:54 smithi044 bash[22676]: audit 2024-09-20T23:14:54.311008+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:54 smithi044 bash[22676]: audit 2024-09-20T23:14:54.317504+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:54 smithi044 bash[22676]: audit 2024-09-20T23:14:54.324140+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:54 smithi179 bash[23186]: cluster 2024-09-20T23:14:52.884149+0000 mgr.a (mgr.14388) 2610 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:54 smithi179 bash[23186]: audit 2024-09-20T23:14:54.311008+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:54 smithi179 bash[23186]: audit 2024-09-20T23:14:54.317504+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:54 smithi179 bash[23186]: audit 2024-09-20T23:14:54.324140+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:54 smithi049 bash[23528]: cluster 2024-09-20T23:14:52.884149+0000 mgr.a (mgr.14388) 2610 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:54 smithi049 bash[23528]: audit 2024-09-20T23:14:54.311008+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:54 smithi049 bash[23528]: audit 2024-09-20T23:14:54.317504+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:54 smithi049 bash[23528]: audit 2024-09-20T23:14:54.324140+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:14:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:55 smithi044 bash[22676]: cluster 2024-09-20T23:14:54.884989+0000 mgr.a (mgr.14388) 2611 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:55 smithi179 bash[23186]: cluster 2024-09-20T23:14:54.884989+0000 mgr.a (mgr.14388) 2611 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:55 smithi049 bash[23528]: cluster 2024-09-20T23:14:54.884989+0000 mgr.a (mgr.14388) 2611 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:14:58.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:14:58.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:14:58.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:14:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:57 smithi044 bash[22676]: cluster 2024-09-20T23:14:56.887292+0000 mgr.a (mgr.14388) 2612 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:57 smithi179 bash[23186]: cluster 2024-09-20T23:14:56.887292+0000 mgr.a (mgr.14388) 2612 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:57 smithi049 bash[23528]: cluster 2024-09-20T23:14:56.887292+0000 mgr.a (mgr.14388) 2612 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:14:58.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:14:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:14:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:14:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:14:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:14:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:58 smithi044 bash[22676]: audit 2024-09-20T23:14:58.339812+0000 mgr.a (mgr.14388) 2613 : audit [DBG] from='client.68106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:58 smithi179 bash[23186]: audit 2024-09-20T23:14:58.339812+0000 mgr.a (mgr.14388) 2613 : audit [DBG] from='client.68106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:14:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:58 smithi049 bash[23528]: audit 2024-09-20T23:14:58.339812+0000 mgr.a (mgr.14388) 2613 : audit [DBG] from='client.68106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:14:59 smithi044 bash[22676]: cluster 2024-09-20T23:14:58.888084+0000 mgr.a (mgr.14388) 2614 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:14:59 smithi179 bash[23186]: cluster 2024-09-20T23:14:58.888084+0000 mgr.a (mgr.14388) 2614 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:14:59 smithi049 bash[23528]: cluster 2024-09-20T23:14:58.888084+0000 mgr.a (mgr.14388) 2614 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:01 smithi044 bash[22676]: cluster 2024-09-20T23:15:00.890563+0000 mgr.a (mgr.14388) 2615 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:01 smithi179 bash[23186]: cluster 2024-09-20T23:15:00.890563+0000 mgr.a (mgr.14388) 2615 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:01 smithi049 bash[23528]: cluster 2024-09-20T23:15:00.890563+0000 mgr.a (mgr.14388) 2615 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:03.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:03.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:03 smithi044 bash[22676]: cluster 2024-09-20T23:15:02.891539+0000 mgr.a (mgr.14388) 2616 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:03 smithi179 bash[23186]: cluster 2024-09-20T23:15:02.891539+0000 mgr.a (mgr.14388) 2616 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:03 smithi049 bash[23528]: cluster 2024-09-20T23:15:02.891539+0000 mgr.a (mgr.14388) 2616 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:04.537 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:04.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:04 smithi044 bash[22676]: audit 2024-09-20T23:15:04.107651+0000 mgr.a (mgr.14388) 2617 : audit [DBG] from='client.68184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:04 smithi179 bash[23186]: audit 2024-09-20T23:15:04.107651+0000 mgr.a (mgr.14388) 2617 : audit [DBG] from='client.68184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:04 smithi049 bash[23528]: audit 2024-09-20T23:15:04.107651+0000 mgr.a (mgr.14388) 2617 : audit [DBG] from='client.68184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:05 smithi044 bash[22676]: cluster 2024-09-20T23:15:04.892508+0000 mgr.a (mgr.14388) 2618 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:05 smithi179 bash[23186]: cluster 2024-09-20T23:15:04.892508+0000 mgr.a (mgr.14388) 2618 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:05 smithi049 bash[23528]: cluster 2024-09-20T23:15:04.892508+0000 mgr.a (mgr.14388) 2618 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:07 smithi044 bash[22676]: cluster 2024-09-20T23:15:06.894801+0000 mgr.a (mgr.14388) 2619 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:07 smithi179 bash[23186]: cluster 2024-09-20T23:15:06.894801+0000 mgr.a (mgr.14388) 2619 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:07 smithi049 bash[23528]: cluster 2024-09-20T23:15:06.894801+0000 mgr.a (mgr.14388) 2619 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:15:09.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:09.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:09.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:09 smithi049 bash[23528]: cluster 2024-09-20T23:15:08.895588+0000 mgr.a (mgr.14388) 2620 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:09 smithi044 bash[22676]: cluster 2024-09-20T23:15:08.895588+0000 mgr.a (mgr.14388) 2620 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:09 smithi179 bash[23186]: cluster 2024-09-20T23:15:08.895588+0000 mgr.a (mgr.14388) 2620 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:10.323 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:10.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:10.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:10.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:10.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:10 smithi179 bash[23186]: audit 2024-09-20T23:15:09.876847+0000 mgr.a (mgr.14388) 2621 : audit [DBG] from='client.68262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:10 smithi049 bash[23528]: audit 2024-09-20T23:15:09.876847+0000 mgr.a (mgr.14388) 2621 : audit [DBG] from='client.68262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:10 smithi044 bash[22676]: audit 2024-09-20T23:15:09.876847+0000 mgr.a (mgr.14388) 2621 : audit [DBG] from='client.68262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:11 smithi179 bash[23186]: cluster 2024-09-20T23:15:10.898699+0000 mgr.a (mgr.14388) 2622 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:11 smithi049 bash[23528]: cluster 2024-09-20T23:15:10.898699+0000 mgr.a (mgr.14388) 2622 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:11 smithi044 bash[22676]: cluster 2024-09-20T23:15:10.898699+0000 mgr.a (mgr.14388) 2622 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:13 smithi044 bash[22676]: audit 2024-09-20T23:15:12.168807+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:13 smithi044 bash[22676]: audit 2024-09-20T23:15:12.177569+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:13 smithi044 bash[22676]: audit 2024-09-20T23:15:12.189308+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:13 smithi044 bash[22676]: audit 2024-09-20T23:15:12.441476+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:13 smithi044 bash[22676]: audit 2024-09-20T23:15:12.449720+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:13 smithi044 bash[22676]: audit 2024-09-20T23:15:12.459753+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:13 smithi049 bash[23528]: audit 2024-09-20T23:15:12.168807+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:13 smithi049 bash[23528]: audit 2024-09-20T23:15:12.177569+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:13 smithi049 bash[23528]: audit 2024-09-20T23:15:12.189308+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:13 smithi049 bash[23528]: audit 2024-09-20T23:15:12.441476+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:13 smithi049 bash[23528]: audit 2024-09-20T23:15:12.449720+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:13 smithi049 bash[23528]: audit 2024-09-20T23:15:12.459753+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:13 smithi179 bash[23186]: audit 2024-09-20T23:15:12.168807+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:13 smithi179 bash[23186]: audit 2024-09-20T23:15:12.177569+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:13 smithi179 bash[23186]: audit 2024-09-20T23:15:12.189308+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:13 smithi179 bash[23186]: audit 2024-09-20T23:15:12.441476+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:13 smithi179 bash[23186]: audit 2024-09-20T23:15:12.449720+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:13 smithi179 bash[23186]: audit 2024-09-20T23:15:12.459753+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:14 smithi044 bash[22676]: cluster 2024-09-20T23:15:12.899473+0000 mgr.a (mgr.14388) 2623 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:14 smithi179 bash[23186]: cluster 2024-09-20T23:15:12.899473+0000 mgr.a (mgr.14388) 2623 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:14 smithi049 bash[23528]: cluster 2024-09-20T23:15:12.899473+0000 mgr.a (mgr.14388) 2623 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:15.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:15.326 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:15.326 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:15 smithi179 bash[23186]: audit 2024-09-20T23:15:14.547653+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:15 smithi179 bash[23186]: audit 2024-09-20T23:15:14.556341+0000 mon.a (mon.0) 2797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:15 smithi179 bash[23186]: audit 2024-09-20T23:15:14.566798+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:15 smithi049 bash[23528]: audit 2024-09-20T23:15:14.547653+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:15 smithi049 bash[23528]: audit 2024-09-20T23:15:14.556341+0000 mon.a (mon.0) 2797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:15 smithi049 bash[23528]: audit 2024-09-20T23:15:14.566798+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:15 smithi044 bash[22676]: audit 2024-09-20T23:15:14.547653+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:15 smithi044 bash[22676]: audit 2024-09-20T23:15:14.556341+0000 mon.a (mon.0) 2797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:15 smithi044 bash[22676]: audit 2024-09-20T23:15:14.566798+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:16.107 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:16 smithi044 bash[22676]: cluster 2024-09-20T23:15:14.900263+0000 mgr.a (mgr.14388) 2624 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:16 smithi179 bash[23186]: cluster 2024-09-20T23:15:14.900263+0000 mgr.a (mgr.14388) 2624 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:16 smithi049 bash[23528]: cluster 2024-09-20T23:15:14.900263+0000 mgr.a (mgr.14388) 2624 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:17 smithi179 bash[23186]: audit 2024-09-20T23:15:15.663437+0000 mgr.a (mgr.14388) 2625 : audit [DBG] from='client.68340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:17.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:17 smithi049 bash[23528]: audit 2024-09-20T23:15:15.663437+0000 mgr.a (mgr.14388) 2625 : audit [DBG] from='client.68340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:17 smithi044 bash[22676]: audit 2024-09-20T23:15:15.663437+0000 mgr.a (mgr.14388) 2625 : audit [DBG] from='client.68340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:18.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:18 smithi179 bash[23186]: cluster 2024-09-20T23:15:16.903179+0000 mgr.a (mgr.14388) 2626 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:18 smithi044 bash[22676]: cluster 2024-09-20T23:15:16.903179+0000 mgr.a (mgr.14388) 2626 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:18 smithi049 bash[23528]: cluster 2024-09-20T23:15:16.903179+0000 mgr.a (mgr.14388) 2626 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:20 smithi044 bash[22676]: cluster 2024-09-20T23:15:18.903960+0000 mgr.a (mgr.14388) 2627 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:20 smithi179 bash[23186]: cluster 2024-09-20T23:15:18.903960+0000 mgr.a (mgr.14388) 2627 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:20 smithi049 bash[23528]: cluster 2024-09-20T23:15:18.903960+0000 mgr.a (mgr.14388) 2627 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:15:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:21.856 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:21.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:22 smithi044 bash[22676]: cluster 2024-09-20T23:15:20.905999+0000 mgr.a (mgr.14388) 2628 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:22 smithi044 bash[22676]: audit 2024-09-20T23:15:21.443062+0000 mgr.a (mgr.14388) 2629 : audit [DBG] from='client.68412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:22 smithi179 bash[23186]: cluster 2024-09-20T23:15:20.905999+0000 mgr.a (mgr.14388) 2628 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:22 smithi179 bash[23186]: audit 2024-09-20T23:15:21.443062+0000 mgr.a (mgr.14388) 2629 : audit [DBG] from='client.68412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:22 smithi049 bash[23528]: cluster 2024-09-20T23:15:20.905999+0000 mgr.a (mgr.14388) 2628 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:22 smithi049 bash[23528]: audit 2024-09-20T23:15:21.443062+0000 mgr.a (mgr.14388) 2629 : audit [DBG] from='client.68412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:24 smithi044 bash[22676]: cluster 2024-09-20T23:15:22.906926+0000 mgr.a (mgr.14388) 2630 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:24 smithi179 bash[23186]: cluster 2024-09-20T23:15:22.906926+0000 mgr.a (mgr.14388) 2630 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:24 smithi049 bash[23528]: cluster 2024-09-20T23:15:22.906926+0000 mgr.a (mgr.14388) 2630 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:26.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:26.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:26.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:26 smithi044 bash[22676]: cluster 2024-09-20T23:15:24.908250+0000 mgr.a (mgr.14388) 2631 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:15:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:26 smithi179 bash[23186]: cluster 2024-09-20T23:15:24.908250+0000 mgr.a (mgr.14388) 2631 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:15:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:26 smithi049 bash[23528]: cluster 2024-09-20T23:15:24.908250+0000 mgr.a (mgr.14388) 2631 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:15:27.639 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:27.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:27.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:27.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:27.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:28 smithi044 bash[22676]: cluster 2024-09-20T23:15:26.909461+0000 mgr.a (mgr.14388) 2632 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:28 smithi044 bash[22676]: audit 2024-09-20T23:15:27.200616+0000 mgr.a (mgr.14388) 2633 : audit [DBG] from='client.68487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:28 smithi179 bash[23186]: cluster 2024-09-20T23:15:26.909461+0000 mgr.a (mgr.14388) 2632 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:28 smithi179 bash[23186]: audit 2024-09-20T23:15:27.200616+0000 mgr.a (mgr.14388) 2633 : audit [DBG] from='client.68487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:28 smithi049 bash[23528]: cluster 2024-09-20T23:15:26.909461+0000 mgr.a (mgr.14388) 2632 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:28 smithi049 bash[23528]: audit 2024-09-20T23:15:27.200616+0000 mgr.a (mgr.14388) 2633 : audit [DBG] from='client.68487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:30.875 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:30 smithi049 bash[23528]: cluster 2024-09-20T23:15:28.910316+0000 mgr.a (mgr.14388) 2634 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:30.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:30 smithi044 bash[22676]: cluster 2024-09-20T23:15:28.910316+0000 mgr.a (mgr.14388) 2634 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:30 smithi179 bash[23186]: cluster 2024-09-20T23:15:28.910316+0000 mgr.a (mgr.14388) 2634 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:32 smithi049 bash[23528]: cluster 2024-09-20T23:15:30.912678+0000 mgr.a (mgr.14388) 2635 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:32 smithi049 bash[23528]: audit 2024-09-20T23:15:32.400437+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:32 smithi049 bash[23528]: audit 2024-09-20T23:15:32.409728+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:32 smithi049 bash[23528]: audit 2024-09-20T23:15:32.420510+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:32 smithi044 bash[22676]: cluster 2024-09-20T23:15:30.912678+0000 mgr.a (mgr.14388) 2635 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:32 smithi044 bash[22676]: audit 2024-09-20T23:15:32.400437+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:32 smithi044 bash[22676]: audit 2024-09-20T23:15:32.409728+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:32 smithi044 bash[22676]: audit 2024-09-20T23:15:32.420510+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:32 smithi179 bash[23186]: cluster 2024-09-20T23:15:30.912678+0000 mgr.a (mgr.14388) 2635 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:32 smithi179 bash[23186]: audit 2024-09-20T23:15:32.400437+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:32 smithi179 bash[23186]: audit 2024-09-20T23:15:32.409728+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:32 smithi179 bash[23186]: audit 2024-09-20T23:15:32.420510+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:33.400 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:33.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:33.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:33.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:33.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:33 smithi044 bash[22676]: audit 2024-09-20T23:15:32.651210+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:33 smithi044 bash[22676]: audit 2024-09-20T23:15:32.657137+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:33 smithi044 bash[22676]: audit 2024-09-20T23:15:32.663954+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:33 smithi179 bash[23186]: audit 2024-09-20T23:15:32.651210+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:33 smithi179 bash[23186]: audit 2024-09-20T23:15:32.657137+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:33 smithi179 bash[23186]: audit 2024-09-20T23:15:32.663954+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:33 smithi049 bash[23528]: audit 2024-09-20T23:15:32.651210+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:33 smithi049 bash[23528]: audit 2024-09-20T23:15:32.657137+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:33 smithi049 bash[23528]: audit 2024-09-20T23:15:32.663954+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:34 smithi044 bash[22676]: cluster 2024-09-20T23:15:32.913450+0000 mgr.a (mgr.14388) 2636 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:34 smithi044 bash[22676]: audit 2024-09-20T23:15:32.982555+0000 mgr.a (mgr.14388) 2637 : audit [DBG] from='client.68565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:34 smithi179 bash[23186]: cluster 2024-09-20T23:15:32.913450+0000 mgr.a (mgr.14388) 2636 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:34 smithi179 bash[23186]: audit 2024-09-20T23:15:32.982555+0000 mgr.a (mgr.14388) 2637 : audit [DBG] from='client.68565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:34 smithi049 bash[23528]: cluster 2024-09-20T23:15:32.913450+0000 mgr.a (mgr.14388) 2636 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:34 smithi049 bash[23528]: audit 2024-09-20T23:15:32.982555+0000 mgr.a (mgr.14388) 2637 : audit [DBG] from='client.68565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:36.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:35 smithi179 bash[23186]: audit 2024-09-20T23:15:34.776587+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:35 smithi179 bash[23186]: audit 2024-09-20T23:15:34.784964+0000 mon.a (mon.0) 2806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:35 smithi179 bash[23186]: audit 2024-09-20T23:15:34.795183+0000 mon.a (mon.0) 2807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:35 smithi179 bash[23186]: cluster 2024-09-20T23:15:34.914909+0000 mgr.a (mgr.14388) 2638 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:15:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:35 smithi049 bash[23528]: audit 2024-09-20T23:15:34.776587+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:35 smithi049 bash[23528]: audit 2024-09-20T23:15:34.784964+0000 mon.a (mon.0) 2806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:35 smithi049 bash[23528]: audit 2024-09-20T23:15:34.795183+0000 mon.a (mon.0) 2807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:35 smithi049 bash[23528]: cluster 2024-09-20T23:15:34.914909+0000 mgr.a (mgr.14388) 2638 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:15:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:35 smithi044 bash[22676]: audit 2024-09-20T23:15:34.776587+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:35 smithi044 bash[22676]: audit 2024-09-20T23:15:34.784964+0000 mon.a (mon.0) 2806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:35 smithi044 bash[22676]: audit 2024-09-20T23:15:34.795183+0000 mon.a (mon.0) 2807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:35 smithi044 bash[22676]: cluster 2024-09-20T23:15:34.914909+0000 mgr.a (mgr.14388) 2638 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:15:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:37 smithi044 bash[22676]: cluster 2024-09-20T23:15:36.916604+0000 mgr.a (mgr.14388) 2639 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:15:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:37 smithi179 bash[23186]: cluster 2024-09-20T23:15:36.916604+0000 mgr.a (mgr.14388) 2639 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:15:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:37 smithi049 bash[23528]: cluster 2024-09-20T23:15:36.916604+0000 mgr.a (mgr.14388) 2639 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:15:38.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:39.163 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:39.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:39.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:39.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:39.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:39 smithi044 bash[22676]: audit 2024-09-20T23:15:38.735043+0000 mgr.a (mgr.14388) 2640 : audit [DBG] from='client.68640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:39 smithi044 bash[22676]: cluster 2024-09-20T23:15:38.917202+0000 mgr.a (mgr.14388) 2641 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:39 smithi179 bash[23186]: audit 2024-09-20T23:15:38.735043+0000 mgr.a (mgr.14388) 2640 : audit [DBG] from='client.68640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:39 smithi179 bash[23186]: cluster 2024-09-20T23:15:38.917202+0000 mgr.a (mgr.14388) 2641 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:39 smithi049 bash[23528]: audit 2024-09-20T23:15:38.735043+0000 mgr.a (mgr.14388) 2640 : audit [DBG] from='client.68640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:39 smithi049 bash[23528]: cluster 2024-09-20T23:15:38.917202+0000 mgr.a (mgr.14388) 2641 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:41 smithi044 bash[22676]: cluster 2024-09-20T23:15:40.919403+0000 mgr.a (mgr.14388) 2642 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:41 smithi179 bash[23186]: cluster 2024-09-20T23:15:40.919403+0000 mgr.a (mgr.14388) 2642 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:41 smithi049 bash[23528]: cluster 2024-09-20T23:15:40.919403+0000 mgr.a (mgr.14388) 2642 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:15:44.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:44.166 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:44.166 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:43 smithi044 bash[22676]: cluster 2024-09-20T23:15:42.920207+0000 mgr.a (mgr.14388) 2643 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:43 smithi179 bash[23186]: cluster 2024-09-20T23:15:42.920207+0000 mgr.a (mgr.14388) 2643 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:43 smithi049 bash[23528]: cluster 2024-09-20T23:15:42.920207+0000 mgr.a (mgr.14388) 2643 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:44.935 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:44.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:44.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:44.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:44.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:44 smithi179 bash[23186]: audit 2024-09-20T23:15:44.501351+0000 mgr.a (mgr.14388) 2644 : audit [DBG] from='client.68712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:44 smithi049 bash[23528]: audit 2024-09-20T23:15:44.501351+0000 mgr.a (mgr.14388) 2644 : audit [DBG] from='client.68712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:44 smithi044 bash[22676]: audit 2024-09-20T23:15:44.501351+0000 mgr.a (mgr.14388) 2644 : audit [DBG] from='client.68712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:45 smithi179 bash[23186]: cluster 2024-09-20T23:15:44.921023+0000 mgr.a (mgr.14388) 2645 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:45 smithi049 bash[23528]: cluster 2024-09-20T23:15:44.921023+0000 mgr.a (mgr.14388) 2645 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:45 smithi044 bash[22676]: cluster 2024-09-20T23:15:44.921023+0000 mgr.a (mgr.14388) 2645 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:15:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:48 smithi179 bash[23186]: cluster 2024-09-20T23:15:46.922842+0000 mgr.a (mgr.14388) 2646 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-20T23:15:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:48 smithi049 bash[23528]: cluster 2024-09-20T23:15:46.922842+0000 mgr.a (mgr.14388) 2646 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-20T23:15:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:48 smithi044 bash[22676]: cluster 2024-09-20T23:15:46.922842+0000 mgr.a (mgr.14388) 2646 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-20T23:15:49.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:49.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:50 smithi049 bash[23528]: cluster 2024-09-20T23:15:48.923795+0000 mgr.a (mgr.14388) 2647 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:15:50.375 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:50 smithi044 bash[22676]: cluster 2024-09-20T23:15:48.923795+0000 mgr.a (mgr.14388) 2647 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:50 smithi179 bash[23186]: cluster 2024-09-20T23:15:48.923795+0000 mgr.a (mgr.14388) 2647 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:15:50.718 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:50.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:50.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:50.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:50.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:51.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:51 smithi049 bash[23528]: audit 2024-09-20T23:15:50.287100+0000 mgr.a (mgr.14388) 2648 : audit [DBG] from='client.68787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:51 smithi044 bash[22676]: audit 2024-09-20T23:15:50.287100+0000 mgr.a (mgr.14388) 2648 : audit [DBG] from='client.68787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:51 smithi179 bash[23186]: audit 2024-09-20T23:15:50.287100+0000 mgr.a (mgr.14388) 2648 : audit [DBG] from='client.68787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:52 smithi049 bash[23528]: cluster 2024-09-20T23:15:50.926770+0000 mgr.a (mgr.14388) 2649 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-20T23:15:52.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:52 smithi044 bash[22676]: cluster 2024-09-20T23:15:50.926770+0000 mgr.a (mgr.14388) 2649 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-20T23:15:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:52 smithi179 bash[23186]: cluster 2024-09-20T23:15:50.926770+0000 mgr.a (mgr.14388) 2649 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-20T23:15:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.284044+0000 mon.a (mon.0) 2808 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.290719+0000 mon.a (mon.0) 2809 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.292227+0000 mon.a (mon.0) 2810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.300341+0000 mon.a (mon.0) 2811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.304607+0000 mon.a (mon.0) 2812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.306135+0000 mgr.a (mgr.14388) 2650 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.569671+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.576967+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.582401+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.866743+0000 mon.a (mon.0) 2816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.872597+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:53 smithi179 bash[23186]: audit 2024-09-20T23:15:52.879333+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.284044+0000 mon.a (mon.0) 2808 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.290719+0000 mon.a (mon.0) 2809 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.292227+0000 mon.a (mon.0) 2810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.300341+0000 mon.a (mon.0) 2811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.304607+0000 mon.a (mon.0) 2812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.306135+0000 mgr.a (mgr.14388) 2650 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.569671+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.576967+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.582401+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.866743+0000 mon.a (mon.0) 2816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.872597+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:53 smithi049 bash[23528]: audit 2024-09-20T23:15:52.879333+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22930]: debug 2024-09-20T23:15:53.063+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:15:53.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22930]: debug 2024-09-20T23:15:53.067+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.284044+0000 mon.a (mon.0) 2808 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.290719+0000 mon.a (mon.0) 2809 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.292227+0000 mon.a (mon.0) 2810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.300341+0000 mon.a (mon.0) 2811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.304607+0000 mon.a (mon.0) 2812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.306135+0000 mgr.a (mgr.14388) 2650 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.569671+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.576967+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.582401+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.866743+0000 mon.a (mon.0) 2816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.872597+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:53 smithi044 bash[22676]: audit 2024-09-20T23:15:52.879333+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:54 smithi049 bash[23528]: cluster 2024-09-20T23:15:52.927288+0000 mgr.a (mgr.14388) 2651 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-20T23:15:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:54 smithi049 bash[23528]: audit 2024-09-20T23:15:53.069065+0000 mgr.a (mgr.14388) 2652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:15:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:54 smithi049 bash[23528]: cephadm 2024-09-20T23:15:53.070535+0000 mgr.a (mgr.14388) 2653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:15:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:54 smithi044 bash[22676]: cluster 2024-09-20T23:15:52.927288+0000 mgr.a (mgr.14388) 2651 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-20T23:15:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:54 smithi044 bash[22676]: audit 2024-09-20T23:15:53.069065+0000 mgr.a (mgr.14388) 2652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:15:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:54 smithi044 bash[22676]: cephadm 2024-09-20T23:15:53.070535+0000 mgr.a (mgr.14388) 2653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:15:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:54 smithi179 bash[23186]: cluster 2024-09-20T23:15:52.927288+0000 mgr.a (mgr.14388) 2651 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-20T23:15:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:54 smithi179 bash[23186]: audit 2024-09-20T23:15:53.069065+0000 mgr.a (mgr.14388) 2652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:15:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:54 smithi179 bash[23186]: cephadm 2024-09-20T23:15:53.070535+0000 mgr.a (mgr.14388) 2653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:15:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:15:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:15:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:15:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:56 smithi179 bash[23186]: cluster 2024-09-20T23:15:54.928697+0000 mgr.a (mgr.14388) 2654 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 78 op/s 2024-09-20T23:15:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:56 smithi179 bash[23186]: audit 2024-09-20T23:15:55.001625+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:56 smithi179 bash[23186]: audit 2024-09-20T23:15:55.008296+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:56 smithi179 bash[23186]: audit 2024-09-20T23:15:55.016068+0000 mon.a (mon.0) 2821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:56 smithi049 bash[23528]: cluster 2024-09-20T23:15:54.928697+0000 mgr.a (mgr.14388) 2654 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 78 op/s 2024-09-20T23:15:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:56 smithi049 bash[23528]: audit 2024-09-20T23:15:55.001625+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:56 smithi049 bash[23528]: audit 2024-09-20T23:15:55.008296+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:56 smithi049 bash[23528]: audit 2024-09-20T23:15:55.016068+0000 mon.a (mon.0) 2821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:15:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:15:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:15:56.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:15:56.477 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:15:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:56 smithi044 bash[22676]: cluster 2024-09-20T23:15:54.928697+0000 mgr.a (mgr.14388) 2654 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 78 op/s 2024-09-20T23:15:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:56 smithi044 bash[22676]: audit 2024-09-20T23:15:55.001625+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:56 smithi044 bash[22676]: audit 2024-09-20T23:15:55.008296+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:56 smithi044 bash[22676]: audit 2024-09-20T23:15:55.016068+0000 mon.a (mon.0) 2821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:15:57.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:57 smithi179 bash[23186]: audit 2024-09-20T23:15:56.051598+0000 mgr.a (mgr.14388) 2655 : audit [DBG] from='client.68964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:57 smithi049 bash[23528]: audit 2024-09-20T23:15:56.051598+0000 mgr.a (mgr.14388) 2655 : audit [DBG] from='client.68964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:57 smithi044 bash[22676]: audit 2024-09-20T23:15:56.051598+0000 mgr.a (mgr.14388) 2655 : audit [DBG] from='client.68964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:15:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:15:58 smithi049 bash[23528]: cluster 2024-09-20T23:15:56.931090+0000 mgr.a (mgr.14388) 2656 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:15:58.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:15:58 smithi179 bash[23186]: cluster 2024-09-20T23:15:56.931090+0000 mgr.a (mgr.14388) 2656 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:15:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:15:58 smithi044 bash[22676]: cluster 2024-09-20T23:15:56.931090+0000 mgr.a (mgr.14388) 2656 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:16:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:00 smithi049 bash[23528]: cluster 2024-09-20T23:15:58.931924+0000 mgr.a (mgr.14388) 2657 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:16:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:00 smithi044 bash[22676]: cluster 2024-09-20T23:15:58.931924+0000 mgr.a (mgr.14388) 2657 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:16:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:00 smithi179 bash[23186]: cluster 2024-09-20T23:15:58.931924+0000 mgr.a (mgr.14388) 2657 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:16:01.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:01.479 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:01.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:02.234 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:02 smithi049 bash[23528]: cluster 2024-09-20T23:16:00.934263+0000 mgr.a (mgr.14388) 2658 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 92 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:16:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:02 smithi044 bash[22676]: cluster 2024-09-20T23:16:00.934263+0000 mgr.a (mgr.14388) 2658 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 92 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:16:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:02 smithi179 bash[23186]: cluster 2024-09-20T23:16:00.934263+0000 mgr.a (mgr.14388) 2658 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 92 KiB/s rd, 426 B/s wr, 145 op/s 2024-09-20T23:16:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:03 smithi049 bash[23528]: audit 2024-09-20T23:16:01.805775+0000 mgr.a (mgr.14388) 2659 : audit [DBG] from='client.69039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:03 smithi044 bash[22676]: audit 2024-09-20T23:16:01.805775+0000 mgr.a (mgr.14388) 2659 : audit [DBG] from='client.69039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:03 smithi179 bash[23186]: audit 2024-09-20T23:16:01.805775+0000 mgr.a (mgr.14388) 2659 : audit [DBG] from='client.69039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:04 smithi049 bash[23528]: cluster 2024-09-20T23:16:02.935326+0000 mgr.a (mgr.14388) 2660 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-20T23:16:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:04 smithi044 bash[22676]: cluster 2024-09-20T23:16:02.935326+0000 mgr.a (mgr.14388) 2660 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-20T23:16:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:04 smithi179 bash[23186]: cluster 2024-09-20T23:16:02.935326+0000 mgr.a (mgr.14388) 2660 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-20T23:16:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:06 smithi049 bash[23528]: cluster 2024-09-20T23:16:04.936897+0000 mgr.a (mgr.14388) 2661 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-20T23:16:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:06 smithi044 bash[22676]: cluster 2024-09-20T23:16:04.936897+0000 mgr.a (mgr.14388) 2661 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-20T23:16:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:06 smithi179 bash[23186]: cluster 2024-09-20T23:16:04.936897+0000 mgr.a (mgr.14388) 2661 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-20T23:16:07.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:07.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:07.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:07.981 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:07.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:07.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:07.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:07.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:08 smithi049 bash[23528]: cluster 2024-09-20T23:16:06.938629+0000 mgr.a (mgr.14388) 2662 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T23:16:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:08 smithi049 bash[23528]: audit 2024-09-20T23:16:07.567041+0000 mgr.a (mgr.14388) 2663 : audit [DBG] from='client.69117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:08 smithi044 bash[22676]: cluster 2024-09-20T23:16:06.938629+0000 mgr.a (mgr.14388) 2662 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T23:16:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:08 smithi044 bash[22676]: audit 2024-09-20T23:16:07.567041+0000 mgr.a (mgr.14388) 2663 : audit [DBG] from='client.69117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:08 smithi179 bash[23186]: cluster 2024-09-20T23:16:06.938629+0000 mgr.a (mgr.14388) 2662 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-20T23:16:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:08 smithi179 bash[23186]: audit 2024-09-20T23:16:07.567041+0000 mgr.a (mgr.14388) 2663 : audit [DBG] from='client.69117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:10 smithi049 bash[23528]: cluster 2024-09-20T23:16:08.939551+0000 mgr.a (mgr.14388) 2664 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:10 smithi044 bash[22676]: cluster 2024-09-20T23:16:08.939551+0000 mgr.a (mgr.14388) 2664 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:10 smithi179 bash[23186]: cluster 2024-09-20T23:16:08.939551+0000 mgr.a (mgr.14388) 2664 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:12 smithi044 bash[22676]: cluster 2024-09-20T23:16:10.940866+0000 mgr.a (mgr.14388) 2665 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:12 smithi049 bash[23528]: cluster 2024-09-20T23:16:10.940866+0000 mgr.a (mgr.14388) 2665 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:12 smithi179 bash[23186]: cluster 2024-09-20T23:16:10.940866+0000 mgr.a (mgr.14388) 2665 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:12.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:12.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:12.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:13.752 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:13.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:13.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:13.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:13.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: audit 2024-09-20T23:16:12.747816+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: audit 2024-09-20T23:16:12.753435+0000 mon.a (mon.0) 2823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: audit 2024-09-20T23:16:12.758783+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: cluster 2024-09-20T23:16:12.941502+0000 mgr.a (mgr.14388) 2666 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: audit 2024-09-20T23:16:13.076627+0000 mon.a (mon.0) 2825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: audit 2024-09-20T23:16:13.083110+0000 mon.a (mon.0) 2826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: audit 2024-09-20T23:16:13.093060+0000 mon.a (mon.0) 2827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:13 smithi044 bash[22676]: audit 2024-09-20T23:16:13.316383+0000 mgr.a (mgr.14388) 2667 : audit [DBG] from='client.69195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: audit 2024-09-20T23:16:12.747816+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: audit 2024-09-20T23:16:12.753435+0000 mon.a (mon.0) 2823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: audit 2024-09-20T23:16:12.758783+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: cluster 2024-09-20T23:16:12.941502+0000 mgr.a (mgr.14388) 2666 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: audit 2024-09-20T23:16:13.076627+0000 mon.a (mon.0) 2825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: audit 2024-09-20T23:16:13.083110+0000 mon.a (mon.0) 2826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: audit 2024-09-20T23:16:13.093060+0000 mon.a (mon.0) 2827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:13 smithi179 bash[23186]: audit 2024-09-20T23:16:13.316383+0000 mgr.a (mgr.14388) 2667 : audit [DBG] from='client.69195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: audit 2024-09-20T23:16:12.747816+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: audit 2024-09-20T23:16:12.753435+0000 mon.a (mon.0) 2823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: audit 2024-09-20T23:16:12.758783+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: cluster 2024-09-20T23:16:12.941502+0000 mgr.a (mgr.14388) 2666 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: audit 2024-09-20T23:16:13.076627+0000 mon.a (mon.0) 2825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: audit 2024-09-20T23:16:13.083110+0000 mon.a (mon.0) 2826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: audit 2024-09-20T23:16:13.093060+0000 mon.a (mon.0) 2827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:13 smithi049 bash[23528]: audit 2024-09-20T23:16:13.316383+0000 mgr.a (mgr.14388) 2667 : audit [DBG] from='client.69195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:16 smithi044 bash[22676]: cluster 2024-09-20T23:16:14.942970+0000 mgr.a (mgr.14388) 2668 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:16:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:16 smithi044 bash[22676]: audit 2024-09-20T23:16:15.228700+0000 mon.a (mon.0) 2828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:16 smithi044 bash[22676]: audit 2024-09-20T23:16:15.236544+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:16 smithi044 bash[22676]: audit 2024-09-20T23:16:15.244891+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:16 smithi179 bash[23186]: cluster 2024-09-20T23:16:14.942970+0000 mgr.a (mgr.14388) 2668 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:16:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:16 smithi179 bash[23186]: audit 2024-09-20T23:16:15.228700+0000 mon.a (mon.0) 2828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:16 smithi179 bash[23186]: audit 2024-09-20T23:16:15.236544+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:16 smithi179 bash[23186]: audit 2024-09-20T23:16:15.244891+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:16 smithi049 bash[23528]: cluster 2024-09-20T23:16:14.942970+0000 mgr.a (mgr.14388) 2668 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:16:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:16 smithi049 bash[23528]: audit 2024-09-20T23:16:15.228700+0000 mon.a (mon.0) 2828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:16 smithi049 bash[23528]: audit 2024-09-20T23:16:15.236544+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:16 smithi049 bash[23528]: audit 2024-09-20T23:16:15.244891+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:18 smithi044 bash[22676]: cluster 2024-09-20T23:16:16.944683+0000 mgr.a (mgr.14388) 2669 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:16:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:18 smithi179 bash[23186]: cluster 2024-09-20T23:16:16.944683+0000 mgr.a (mgr.14388) 2669 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:16:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:18 smithi049 bash[23528]: cluster 2024-09-20T23:16:16.944683+0000 mgr.a (mgr.14388) 2669 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:16:18.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:19.536 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:20 smithi044 bash[22676]: cluster 2024-09-20T23:16:18.945434+0000 mgr.a (mgr.14388) 2670 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:20 smithi044 bash[22676]: audit 2024-09-20T23:16:19.093932+0000 mgr.a (mgr.14388) 2671 : audit [DBG] from='client.69270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:20 smithi179 bash[23186]: cluster 2024-09-20T23:16:18.945434+0000 mgr.a (mgr.14388) 2670 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:20 smithi179 bash[23186]: audit 2024-09-20T23:16:19.093932+0000 mgr.a (mgr.14388) 2671 : audit [DBG] from='client.69270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:20 smithi049 bash[23528]: cluster 2024-09-20T23:16:18.945434+0000 mgr.a (mgr.14388) 2670 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:20 smithi049 bash[23528]: audit 2024-09-20T23:16:19.093932+0000 mgr.a (mgr.14388) 2671 : audit [DBG] from='client.69270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:22 smithi179 bash[23186]: cluster 2024-09-20T23:16:20.947822+0000 mgr.a (mgr.14388) 2672 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:22 smithi049 bash[23528]: cluster 2024-09-20T23:16:20.947822+0000 mgr.a (mgr.14388) 2672 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:22 smithi044 bash[22676]: cluster 2024-09-20T23:16:20.947822+0000 mgr.a (mgr.14388) 2672 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:24 smithi179 bash[23186]: cluster 2024-09-20T23:16:22.948600+0000 mgr.a (mgr.14388) 2673 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:24.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:24.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:24.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:24 smithi049 bash[23528]: cluster 2024-09-20T23:16:22.948600+0000 mgr.a (mgr.14388) 2673 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:24 smithi044 bash[22676]: cluster 2024-09-20T23:16:22.948600+0000 mgr.a (mgr.14388) 2673 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:25.310 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:26 smithi179 bash[23186]: audit 2024-09-20T23:16:24.876164+0000 mgr.a (mgr.14388) 2674 : audit [DBG] from='client.69348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:26 smithi179 bash[23186]: cluster 2024-09-20T23:16:24.949577+0000 mgr.a (mgr.14388) 2675 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:26 smithi049 bash[23528]: audit 2024-09-20T23:16:24.876164+0000 mgr.a (mgr.14388) 2674 : audit [DBG] from='client.69348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:26 smithi049 bash[23528]: cluster 2024-09-20T23:16:24.949577+0000 mgr.a (mgr.14388) 2675 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:26 smithi044 bash[22676]: audit 2024-09-20T23:16:24.876164+0000 mgr.a (mgr.14388) 2674 : audit [DBG] from='client.69348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:26 smithi044 bash[22676]: cluster 2024-09-20T23:16:24.949577+0000 mgr.a (mgr.14388) 2675 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:28 smithi179 bash[23186]: cluster 2024-09-20T23:16:26.951753+0000 mgr.a (mgr.14388) 2676 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:16:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:28 smithi049 bash[23528]: cluster 2024-09-20T23:16:26.951753+0000 mgr.a (mgr.14388) 2676 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:16:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:28 smithi044 bash[22676]: cluster 2024-09-20T23:16:26.951753+0000 mgr.a (mgr.14388) 2676 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:16:30.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:30.312 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:30.312 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:30 smithi049 bash[23528]: cluster 2024-09-20T23:16:28.952558+0000 mgr.a (mgr.14388) 2677 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:16:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:30 smithi044 bash[22676]: cluster 2024-09-20T23:16:28.952558+0000 mgr.a (mgr.14388) 2677 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:16:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:30 smithi179 bash[23186]: cluster 2024-09-20T23:16:28.952558+0000 mgr.a (mgr.14388) 2677 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:16:31.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:31.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:31.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:31.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:31.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:31 smithi049 bash[23528]: audit 2024-09-20T23:16:30.642881+0000 mgr.a (mgr.14388) 2678 : audit [DBG] from='client.69423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:31 smithi044 bash[22676]: audit 2024-09-20T23:16:30.642881+0000 mgr.a (mgr.14388) 2678 : audit [DBG] from='client.69423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:31 smithi179 bash[23186]: audit 2024-09-20T23:16:30.642881+0000 mgr.a (mgr.14388) 2678 : audit [DBG] from='client.69423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:32 smithi049 bash[23528]: cluster 2024-09-20T23:16:30.953792+0000 mgr.a (mgr.14388) 2679 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:32.704 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:32 smithi044 bash[22676]: cluster 2024-09-20T23:16:30.953792+0000 mgr.a (mgr.14388) 2679 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:32 smithi179 bash[23186]: cluster 2024-09-20T23:16:30.953792+0000 mgr.a (mgr.14388) 2679 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:33 smithi049 bash[23528]: audit 2024-09-20T23:16:32.906811+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:33 smithi049 bash[23528]: audit 2024-09-20T23:16:32.915350+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:33 smithi049 bash[23528]: audit 2024-09-20T23:16:32.925761+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:33 smithi049 bash[23528]: cluster 2024-09-20T23:16:32.954273+0000 mgr.a (mgr.14388) 2680 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:33 smithi049 bash[23528]: audit 2024-09-20T23:16:33.302163+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:33 smithi049 bash[23528]: audit 2024-09-20T23:16:33.309273+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:33 smithi049 bash[23528]: audit 2024-09-20T23:16:33.317679+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:33 smithi044 bash[22676]: audit 2024-09-20T23:16:32.906811+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:33 smithi044 bash[22676]: audit 2024-09-20T23:16:32.915350+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:33 smithi044 bash[22676]: audit 2024-09-20T23:16:32.925761+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:33 smithi044 bash[22676]: cluster 2024-09-20T23:16:32.954273+0000 mgr.a (mgr.14388) 2680 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:16:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:33 smithi044 bash[22676]: audit 2024-09-20T23:16:33.302163+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:33 smithi044 bash[22676]: audit 2024-09-20T23:16:33.309273+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:33 smithi044 bash[22676]: audit 2024-09-20T23:16:33.317679+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:33 smithi179 bash[23186]: audit 2024-09-20T23:16:32.906811+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:33 smithi179 bash[23186]: audit 2024-09-20T23:16:32.915350+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:33 smithi179 bash[23186]: audit 2024-09-20T23:16:32.925761+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:33 smithi179 bash[23186]: cluster 2024-09-20T23:16:32.954273+0000 mgr.a (mgr.14388) 2680 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:16:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:33 smithi179 bash[23186]: audit 2024-09-20T23:16:33.302163+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:33 smithi179 bash[23186]: audit 2024-09-20T23:16:33.309273+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:33 smithi179 bash[23186]: audit 2024-09-20T23:16:33.317679+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:36.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:36 smithi044 bash[22676]: cluster 2024-09-20T23:16:34.955576+0000 mgr.a (mgr.14388) 2681 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:16:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:36 smithi044 bash[22676]: audit 2024-09-20T23:16:35.438675+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:36 smithi044 bash[22676]: audit 2024-09-20T23:16:35.447501+0000 mon.a (mon.0) 2838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:36 smithi044 bash[22676]: audit 2024-09-20T23:16:35.457530+0000 mon.a (mon.0) 2839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:36 smithi179 bash[23186]: cluster 2024-09-20T23:16:34.955576+0000 mgr.a (mgr.14388) 2681 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:16:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:36 smithi179 bash[23186]: audit 2024-09-20T23:16:35.438675+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:36 smithi179 bash[23186]: audit 2024-09-20T23:16:35.447501+0000 mon.a (mon.0) 2838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:36 smithi179 bash[23186]: audit 2024-09-20T23:16:35.457530+0000 mon.a (mon.0) 2839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:36 smithi049 bash[23528]: cluster 2024-09-20T23:16:34.955576+0000 mgr.a (mgr.14388) 2681 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:16:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:36 smithi049 bash[23528]: audit 2024-09-20T23:16:35.438675+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:36 smithi049 bash[23528]: audit 2024-09-20T23:16:35.447501+0000 mon.a (mon.0) 2838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:36 smithi049 bash[23528]: audit 2024-09-20T23:16:35.457530+0000 mon.a (mon.0) 2839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:36.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:36.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:36.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:36.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:37 smithi044 bash[22676]: audit 2024-09-20T23:16:36.415034+0000 mgr.a (mgr.14388) 2682 : audit [DBG] from='client.69501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:37 smithi179 bash[23186]: audit 2024-09-20T23:16:36.415034+0000 mgr.a (mgr.14388) 2682 : audit [DBG] from='client.69501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:37 smithi049 bash[23528]: audit 2024-09-20T23:16:36.415034+0000 mgr.a (mgr.14388) 2682 : audit [DBG] from='client.69501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:38 smithi044 bash[22676]: cluster 2024-09-20T23:16:36.958020+0000 mgr.a (mgr.14388) 2683 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:38.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:38 smithi179 bash[23186]: cluster 2024-09-20T23:16:36.958020+0000 mgr.a (mgr.14388) 2683 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:38 smithi049 bash[23528]: cluster 2024-09-20T23:16:36.958020+0000 mgr.a (mgr.14388) 2683 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:40 smithi044 bash[22676]: cluster 2024-09-20T23:16:38.958761+0000 mgr.a (mgr.14388) 2684 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:40 smithi179 bash[23186]: cluster 2024-09-20T23:16:38.958761+0000 mgr.a (mgr.14388) 2684 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:40 smithi049 bash[23528]: cluster 2024-09-20T23:16:38.958761+0000 mgr.a (mgr.14388) 2684 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:41.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:41.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:42.599 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:42 smithi044 bash[22676]: cluster 2024-09-20T23:16:40.960754+0000 mgr.a (mgr.14388) 2685 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:42 smithi179 bash[23186]: cluster 2024-09-20T23:16:40.960754+0000 mgr.a (mgr.14388) 2685 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:42 smithi049 bash[23528]: cluster 2024-09-20T23:16:40.960754+0000 mgr.a (mgr.14388) 2685 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:43 smithi044 bash[22676]: audit 2024-09-20T23:16:42.174074+0000 mgr.a (mgr.14388) 2686 : audit [DBG] from='client.69579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:43 smithi179 bash[23186]: audit 2024-09-20T23:16:42.174074+0000 mgr.a (mgr.14388) 2686 : audit [DBG] from='client.69579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:43 smithi049 bash[23528]: audit 2024-09-20T23:16:42.174074+0000 mgr.a (mgr.14388) 2686 : audit [DBG] from='client.69579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:44 smithi044 bash[22676]: cluster 2024-09-20T23:16:42.961662+0000 mgr.a (mgr.14388) 2687 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:44 smithi179 bash[23186]: cluster 2024-09-20T23:16:42.961662+0000 mgr.a (mgr.14388) 2687 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:44 smithi049 bash[23528]: cluster 2024-09-20T23:16:42.961662+0000 mgr.a (mgr.14388) 2687 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:46 smithi044 bash[22676]: cluster 2024-09-20T23:16:44.962992+0000 mgr.a (mgr.14388) 2688 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:16:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:46 smithi179 bash[23186]: cluster 2024-09-20T23:16:44.962992+0000 mgr.a (mgr.14388) 2688 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:16:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:46 smithi049 bash[23528]: cluster 2024-09-20T23:16:44.962992+0000 mgr.a (mgr.14388) 2688 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:16:47.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:47.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:47.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:48.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:48.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:48.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:48.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:48.350 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:48 smithi044 bash[22676]: cluster 2024-09-20T23:16:46.964634+0000 mgr.a (mgr.14388) 2689 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:16:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:48 smithi179 bash[23186]: cluster 2024-09-20T23:16:46.964634+0000 mgr.a (mgr.14388) 2689 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:16:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:48 smithi049 bash[23528]: cluster 2024-09-20T23:16:46.964634+0000 mgr.a (mgr.14388) 2689 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:16:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:49 smithi044 bash[22676]: audit 2024-09-20T23:16:47.931159+0000 mgr.a (mgr.14388) 2690 : audit [DBG] from='client.69651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:49 smithi179 bash[23186]: audit 2024-09-20T23:16:47.931159+0000 mgr.a (mgr.14388) 2690 : audit [DBG] from='client.69651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:49 smithi049 bash[23528]: audit 2024-09-20T23:16:47.931159+0000 mgr.a (mgr.14388) 2690 : audit [DBG] from='client.69651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:50 smithi179 bash[23186]: cluster 2024-09-20T23:16:48.965555+0000 mgr.a (mgr.14388) 2691 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:50 smithi049 bash[23528]: cluster 2024-09-20T23:16:48.965555+0000 mgr.a (mgr.14388) 2691 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:50 smithi044 bash[22676]: cluster 2024-09-20T23:16:48.965555+0000 mgr.a (mgr.14388) 2691 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:52 smithi179 bash[23186]: cluster 2024-09-20T23:16:50.967782+0000 mgr.a (mgr.14388) 2692 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:52 smithi049 bash[23528]: cluster 2024-09-20T23:16:50.967782+0000 mgr.a (mgr.14388) 2692 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:52 smithi044 bash[22676]: cluster 2024-09-20T23:16:50.967782+0000 mgr.a (mgr.14388) 2692 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:16:53.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:53.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:16:54.091 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:16:53 smithi044 bash[22930]: debug 2024-09-20T23:16:53.870+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:16:54.091 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:16:53 smithi044 bash[22930]: debug 2024-09-20T23:16:53.878+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:16:54.270 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:16:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:16:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:16:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:16:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:16:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: cluster 2024-09-20T23:16:52.968574+0000 mgr.a (mgr.14388) 2693 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.092008+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.098934+0000 mon.a (mon.0) 2841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.105268+0000 mon.a (mon.0) 2842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.125337+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:16:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.130471+0000 mon.a (mon.0) 2844 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.131353+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.137064+0000 mon.a (mon.0) 2846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.139832+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:16:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.140790+0000 mgr.a (mgr.14388) 2694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:16:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.500687+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.512491+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:54 smithi044 bash[22676]: audit 2024-09-20T23:16:53.517489+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: cluster 2024-09-20T23:16:52.968574+0000 mgr.a (mgr.14388) 2693 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.092008+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.098934+0000 mon.a (mon.0) 2841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.105268+0000 mon.a (mon.0) 2842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.125337+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.130471+0000 mon.a (mon.0) 2844 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.131353+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.137064+0000 mon.a (mon.0) 2846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.139832+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.140790+0000 mgr.a (mgr.14388) 2694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.500687+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.512491+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:54 smithi179 bash[23186]: audit 2024-09-20T23:16:53.517489+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: cluster 2024-09-20T23:16:52.968574+0000 mgr.a (mgr.14388) 2693 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.092008+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.098934+0000 mon.a (mon.0) 2841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.105268+0000 mon.a (mon.0) 2842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.125337+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.130471+0000 mon.a (mon.0) 2844 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.131353+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.137064+0000 mon.a (mon.0) 2846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.139832+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.140790+0000 mgr.a (mgr.14388) 2694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.500687+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.512491+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:54.534 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:54 smithi049 bash[23528]: audit 2024-09-20T23:16:53.517489+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:55.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:55 smithi044 bash[22676]: audit 2024-09-20T23:16:53.692054+0000 mgr.a (mgr.14388) 2695 : audit [DBG] from='client.69780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:55.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:55 smithi044 bash[22676]: audit 2024-09-20T23:16:53.873739+0000 mgr.a (mgr.14388) 2696 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:16:55.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:55 smithi044 bash[22676]: cephadm 2024-09-20T23:16:53.884179+0000 mgr.a (mgr.14388) 2697 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:16:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:55 smithi179 bash[23186]: audit 2024-09-20T23:16:53.692054+0000 mgr.a (mgr.14388) 2695 : audit [DBG] from='client.69780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:55 smithi179 bash[23186]: audit 2024-09-20T23:16:53.873739+0000 mgr.a (mgr.14388) 2696 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:16:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:55 smithi179 bash[23186]: cephadm 2024-09-20T23:16:53.884179+0000 mgr.a (mgr.14388) 2697 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:16:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:55 smithi049 bash[23528]: audit 2024-09-20T23:16:53.692054+0000 mgr.a (mgr.14388) 2695 : audit [DBG] from='client.69780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:16:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:55 smithi049 bash[23528]: audit 2024-09-20T23:16:53.873739+0000 mgr.a (mgr.14388) 2696 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:16:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:55 smithi049 bash[23528]: cephadm 2024-09-20T23:16:53.884179+0000 mgr.a (mgr.14388) 2697 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:16:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:56 smithi044 bash[22676]: cluster 2024-09-20T23:16:54.970084+0000 mgr.a (mgr.14388) 2698 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T23:16:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:56 smithi044 bash[22676]: audit 2024-09-20T23:16:55.611407+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:56 smithi044 bash[22676]: audit 2024-09-20T23:16:55.618956+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:56 smithi044 bash[22676]: audit 2024-09-20T23:16:55.627295+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:56 smithi179 bash[23186]: cluster 2024-09-20T23:16:54.970084+0000 mgr.a (mgr.14388) 2698 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T23:16:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:56 smithi179 bash[23186]: audit 2024-09-20T23:16:55.611407+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:56 smithi179 bash[23186]: audit 2024-09-20T23:16:55.618956+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:56 smithi179 bash[23186]: audit 2024-09-20T23:16:55.627295+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:56 smithi049 bash[23528]: cluster 2024-09-20T23:16:54.970084+0000 mgr.a (mgr.14388) 2698 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T23:16:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:56 smithi049 bash[23528]: audit 2024-09-20T23:16:55.611407+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:56 smithi049 bash[23528]: audit 2024-09-20T23:16:55.618956+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:56 smithi049 bash[23528]: audit 2024-09-20T23:16:55.627295+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:16:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:16:58 smithi044 bash[22676]: cluster 2024-09-20T23:16:56.971764+0000 mgr.a (mgr.14388) 2699 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:16:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:16:58 smithi179 bash[23186]: cluster 2024-09-20T23:16:56.971764+0000 mgr.a (mgr.14388) 2699 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:16:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:16:58 smithi049 bash[23528]: cluster 2024-09-20T23:16:56.971764+0000 mgr.a (mgr.14388) 2699 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:16:59.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:16:59.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:16:59.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:00.045 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:00.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:00.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:00.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:00.978 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:00 smithi049 bash[23528]: cluster 2024-09-20T23:16:58.972535+0000 mgr.a (mgr.14388) 2700 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:00.979 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:00 smithi049 bash[23528]: audit 2024-09-20T23:16:59.609408+0000 mgr.a (mgr.14388) 2701 : audit [DBG] from='client.69915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:00 smithi044 bash[22676]: cluster 2024-09-20T23:16:58.972535+0000 mgr.a (mgr.14388) 2700 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:00 smithi044 bash[22676]: audit 2024-09-20T23:16:59.609408+0000 mgr.a (mgr.14388) 2701 : audit [DBG] from='client.69915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:00 smithi179 bash[23186]: cluster 2024-09-20T23:16:58.972535+0000 mgr.a (mgr.14388) 2700 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:00 smithi179 bash[23186]: audit 2024-09-20T23:16:59.609408+0000 mgr.a (mgr.14388) 2701 : audit [DBG] from='client.69915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:02.911 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:02 smithi179 bash[23186]: cluster 2024-09-20T23:17:00.974938+0000 mgr.a (mgr.14388) 2702 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:02 smithi044 bash[22676]: cluster 2024-09-20T23:17:00.974938+0000 mgr.a (mgr.14388) 2702 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:02 smithi049 bash[23528]: cluster 2024-09-20T23:17:00.974938+0000 mgr.a (mgr.14388) 2702 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:04.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:04 smithi044 bash[22676]: cluster 2024-09-20T23:17:02.975696+0000 mgr.a (mgr.14388) 2703 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:17:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:04 smithi179 bash[23186]: cluster 2024-09-20T23:17:02.975696+0000 mgr.a (mgr.14388) 2703 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:17:05.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:04 smithi049 bash[23528]: cluster 2024-09-20T23:17:02.975696+0000 mgr.a (mgr.14388) 2703 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:17:05.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:06 smithi044 bash[22676]: cluster 2024-09-20T23:17:04.976494+0000 mgr.a (mgr.14388) 2704 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:06 smithi044 bash[22676]: audit 2024-09-20T23:17:05.374686+0000 mgr.a (mgr.14388) 2705 : audit [DBG] from='client.69993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:06 smithi179 bash[23186]: cluster 2024-09-20T23:17:04.976494+0000 mgr.a (mgr.14388) 2704 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:06 smithi179 bash[23186]: audit 2024-09-20T23:17:05.374686+0000 mgr.a (mgr.14388) 2705 : audit [DBG] from='client.69993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:06 smithi049 bash[23528]: cluster 2024-09-20T23:17:04.976494+0000 mgr.a (mgr.14388) 2704 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:06 smithi049 bash[23528]: audit 2024-09-20T23:17:05.374686+0000 mgr.a (mgr.14388) 2705 : audit [DBG] from='client.69993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:08 smithi044 bash[22676]: cluster 2024-09-20T23:17:06.978760+0000 mgr.a (mgr.14388) 2706 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-20T23:17:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:08 smithi179 bash[23186]: cluster 2024-09-20T23:17:06.978760+0000 mgr.a (mgr.14388) 2706 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-20T23:17:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:08 smithi049 bash[23528]: cluster 2024-09-20T23:17:06.978760+0000 mgr.a (mgr.14388) 2706 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-20T23:17:10.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:10.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:10.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:10 smithi044 bash[22676]: cluster 2024-09-20T23:17:08.979581+0000 mgr.a (mgr.14388) 2707 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:10 smithi179 bash[23186]: cluster 2024-09-20T23:17:08.979581+0000 mgr.a (mgr.14388) 2707 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:10 smithi049 bash[23528]: cluster 2024-09-20T23:17:08.979581+0000 mgr.a (mgr.14388) 2707 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:11.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:12 smithi049 bash[23528]: cluster 2024-09-20T23:17:10.980909+0000 mgr.a (mgr.14388) 2708 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:12 smithi049 bash[23528]: audit 2024-09-20T23:17:11.170189+0000 mgr.a (mgr.14388) 2709 : audit [DBG] from='client.70071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:12 smithi044 bash[22676]: cluster 2024-09-20T23:17:10.980909+0000 mgr.a (mgr.14388) 2708 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:12 smithi044 bash[22676]: audit 2024-09-20T23:17:11.170189+0000 mgr.a (mgr.14388) 2709 : audit [DBG] from='client.70071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:12 smithi179 bash[23186]: cluster 2024-09-20T23:17:10.980909+0000 mgr.a (mgr.14388) 2708 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:12 smithi179 bash[23186]: audit 2024-09-20T23:17:11.170189+0000 mgr.a (mgr.14388) 2709 : audit [DBG] from='client.70071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:14 smithi044 bash[22676]: cluster 2024-09-20T23:17:12.981606+0000 mgr.a (mgr.14388) 2710 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:17:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:14 smithi044 bash[22676]: audit 2024-09-20T23:17:13.287227+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:14 smithi044 bash[22676]: audit 2024-09-20T23:17:13.293703+0000 mon.a (mon.0) 2855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:14 smithi044 bash[22676]: audit 2024-09-20T23:17:13.302024+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:14 smithi044 bash[22676]: audit 2024-09-20T23:17:13.712599+0000 mon.a (mon.0) 2857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:14 smithi044 bash[22676]: audit 2024-09-20T23:17:13.721445+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:14 smithi044 bash[22676]: audit 2024-09-20T23:17:13.731792+0000 mon.a (mon.0) 2859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:14 smithi049 bash[23528]: cluster 2024-09-20T23:17:12.981606+0000 mgr.a (mgr.14388) 2710 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:17:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:14 smithi049 bash[23528]: audit 2024-09-20T23:17:13.287227+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:14 smithi049 bash[23528]: audit 2024-09-20T23:17:13.293703+0000 mon.a (mon.0) 2855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:14 smithi049 bash[23528]: audit 2024-09-20T23:17:13.302024+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:14 smithi049 bash[23528]: audit 2024-09-20T23:17:13.712599+0000 mon.a (mon.0) 2857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:14 smithi049 bash[23528]: audit 2024-09-20T23:17:13.721445+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:14 smithi049 bash[23528]: audit 2024-09-20T23:17:13.731792+0000 mon.a (mon.0) 2859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:14 smithi179 bash[23186]: cluster 2024-09-20T23:17:12.981606+0000 mgr.a (mgr.14388) 2710 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:17:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:14 smithi179 bash[23186]: audit 2024-09-20T23:17:13.287227+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:14 smithi179 bash[23186]: audit 2024-09-20T23:17:13.293703+0000 mon.a (mon.0) 2855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:14 smithi179 bash[23186]: audit 2024-09-20T23:17:13.302024+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:14 smithi179 bash[23186]: audit 2024-09-20T23:17:13.712599+0000 mon.a (mon.0) 2857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:14 smithi179 bash[23186]: audit 2024-09-20T23:17:13.721445+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:14 smithi179 bash[23186]: audit 2024-09-20T23:17:13.731792+0000 mon.a (mon.0) 2859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:16 smithi044 bash[22676]: cluster 2024-09-20T23:17:14.982909+0000 mgr.a (mgr.14388) 2711 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-20T23:17:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:16 smithi044 bash[22676]: audit 2024-09-20T23:17:15.791159+0000 mon.a (mon.0) 2860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:16 smithi044 bash[22676]: audit 2024-09-20T23:17:15.798788+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:16 smithi044 bash[22676]: audit 2024-09-20T23:17:15.806735+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:16 smithi049 bash[23528]: cluster 2024-09-20T23:17:14.982909+0000 mgr.a (mgr.14388) 2711 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-20T23:17:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:16 smithi049 bash[23528]: audit 2024-09-20T23:17:15.791159+0000 mon.a (mon.0) 2860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:16 smithi049 bash[23528]: audit 2024-09-20T23:17:15.798788+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:16 smithi049 bash[23528]: audit 2024-09-20T23:17:15.806735+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:16.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:16 smithi179 bash[23186]: cluster 2024-09-20T23:17:14.982909+0000 mgr.a (mgr.14388) 2711 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-20T23:17:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:16 smithi179 bash[23186]: audit 2024-09-20T23:17:15.791159+0000 mon.a (mon.0) 2860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:16 smithi179 bash[23186]: audit 2024-09-20T23:17:15.798788+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:16 smithi179 bash[23186]: audit 2024-09-20T23:17:15.806735+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:17.408 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:17.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:17.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:17.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:17.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:18 smithi049 bash[23528]: audit 2024-09-20T23:17:16.961976+0000 mgr.a (mgr.14388) 2712 : audit [DBG] from='client.70149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:18 smithi049 bash[23528]: cluster 2024-09-20T23:17:16.985202+0000 mgr.a (mgr.14388) 2713 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:18 smithi044 bash[22676]: audit 2024-09-20T23:17:16.961976+0000 mgr.a (mgr.14388) 2712 : audit [DBG] from='client.70149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:18 smithi044 bash[22676]: cluster 2024-09-20T23:17:16.985202+0000 mgr.a (mgr.14388) 2713 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:18 smithi179 bash[23186]: audit 2024-09-20T23:17:16.961976+0000 mgr.a (mgr.14388) 2712 : audit [DBG] from='client.70149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:18 smithi179 bash[23186]: cluster 2024-09-20T23:17:16.985202+0000 mgr.a (mgr.14388) 2713 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:20 smithi049 bash[23528]: cluster 2024-09-20T23:17:18.986245+0000 mgr.a (mgr.14388) 2714 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:20.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:20 smithi179 bash[23186]: cluster 2024-09-20T23:17:18.986245+0000 mgr.a (mgr.14388) 2714 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:20 smithi044 bash[22676]: cluster 2024-09-20T23:17:18.986245+0000 mgr.a (mgr.14388) 2714 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:22.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:22.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:22.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:22.655 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:22 smithi179 bash[23186]: cluster 2024-09-20T23:17:20.988513+0000 mgr.a (mgr.14388) 2715 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:17:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:22 smithi044 bash[22676]: cluster 2024-09-20T23:17:20.988513+0000 mgr.a (mgr.14388) 2715 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:17:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:22 smithi049 bash[23528]: cluster 2024-09-20T23:17:20.988513+0000 mgr.a (mgr.14388) 2715 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:17:23.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:24 smithi044 bash[22676]: audit 2024-09-20T23:17:22.746314+0000 mgr.a (mgr.14388) 2716 : audit [DBG] from='client.70224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:24 smithi044 bash[22676]: cluster 2024-09-20T23:17:22.989158+0000 mgr.a (mgr.14388) 2717 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:24 smithi179 bash[23186]: audit 2024-09-20T23:17:22.746314+0000 mgr.a (mgr.14388) 2716 : audit [DBG] from='client.70224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:24 smithi179 bash[23186]: cluster 2024-09-20T23:17:22.989158+0000 mgr.a (mgr.14388) 2717 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:24 smithi049 bash[23528]: audit 2024-09-20T23:17:22.746314+0000 mgr.a (mgr.14388) 2716 : audit [DBG] from='client.70224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:24 smithi049 bash[23528]: cluster 2024-09-20T23:17:22.989158+0000 mgr.a (mgr.14388) 2717 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:26 smithi044 bash[22676]: cluster 2024-09-20T23:17:24.990624+0000 mgr.a (mgr.14388) 2718 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:17:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:26 smithi179 bash[23186]: cluster 2024-09-20T23:17:24.990624+0000 mgr.a (mgr.14388) 2718 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:17:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:26 smithi049 bash[23528]: cluster 2024-09-20T23:17:24.990624+0000 mgr.a (mgr.14388) 2718 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:17:28.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:28.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:28.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:28 smithi044 bash[22676]: cluster 2024-09-20T23:17:26.992322+0000 mgr.a (mgr.14388) 2719 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:17:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:28 smithi179 bash[23186]: cluster 2024-09-20T23:17:26.992322+0000 mgr.a (mgr.14388) 2719 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:17:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:28 smithi049 bash[23528]: cluster 2024-09-20T23:17:26.992322+0000 mgr.a (mgr.14388) 2719 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:17:28.946 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:28.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:28.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:28.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:28.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:29 smithi044 bash[22676]: audit 2024-09-20T23:17:28.508622+0000 mgr.a (mgr.14388) 2720 : audit [DBG] from='client.70302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:29 smithi179 bash[23186]: audit 2024-09-20T23:17:28.508622+0000 mgr.a (mgr.14388) 2720 : audit [DBG] from='client.70302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:29 smithi049 bash[23528]: audit 2024-09-20T23:17:28.508622+0000 mgr.a (mgr.14388) 2720 : audit [DBG] from='client.70302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:30 smithi044 bash[22676]: cluster 2024-09-20T23:17:28.992976+0000 mgr.a (mgr.14388) 2721 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:30 smithi179 bash[23186]: cluster 2024-09-20T23:17:28.992976+0000 mgr.a (mgr.14388) 2721 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:30.850 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:30 smithi049 bash[23528]: cluster 2024-09-20T23:17:28.992976+0000 mgr.a (mgr.14388) 2721 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:32 smithi049 bash[23528]: cluster 2024-09-20T23:17:30.995180+0000 mgr.a (mgr.14388) 2722 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:17:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:32 smithi044 bash[22676]: cluster 2024-09-20T23:17:30.995180+0000 mgr.a (mgr.14388) 2722 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:17:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:32 smithi179 bash[23186]: cluster 2024-09-20T23:17:30.995180+0000 mgr.a (mgr.14388) 2722 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:17:33.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:33.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:34.733 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:34.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:34.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:34.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:34.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:34 smithi044 bash[22676]: cluster 2024-09-20T23:17:32.995962+0000 mgr.a (mgr.14388) 2723 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:34 smithi044 bash[22676]: audit 2024-09-20T23:17:33.482868+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:34 smithi044 bash[22676]: audit 2024-09-20T23:17:33.491467+0000 mon.a (mon.0) 2864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:34 smithi044 bash[22676]: audit 2024-09-20T23:17:33.502033+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:34 smithi044 bash[22676]: audit 2024-09-20T23:17:33.939371+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:34 smithi044 bash[22676]: audit 2024-09-20T23:17:33.947822+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:34 smithi044 bash[22676]: audit 2024-09-20T23:17:33.959528+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:34 smithi179 bash[23186]: cluster 2024-09-20T23:17:32.995962+0000 mgr.a (mgr.14388) 2723 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:34 smithi179 bash[23186]: audit 2024-09-20T23:17:33.482868+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:34 smithi179 bash[23186]: audit 2024-09-20T23:17:33.491467+0000 mon.a (mon.0) 2864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:34 smithi179 bash[23186]: audit 2024-09-20T23:17:33.502033+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:34 smithi179 bash[23186]: audit 2024-09-20T23:17:33.939371+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:34 smithi179 bash[23186]: audit 2024-09-20T23:17:33.947822+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:34 smithi179 bash[23186]: audit 2024-09-20T23:17:33.959528+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.761 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:34 smithi049 bash[23528]: cluster 2024-09-20T23:17:32.995962+0000 mgr.a (mgr.14388) 2723 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:34.761 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:34 smithi049 bash[23528]: audit 2024-09-20T23:17:33.482868+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.761 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:34 smithi049 bash[23528]: audit 2024-09-20T23:17:33.491467+0000 mon.a (mon.0) 2864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:34 smithi049 bash[23528]: audit 2024-09-20T23:17:33.502033+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:34 smithi049 bash[23528]: audit 2024-09-20T23:17:33.939371+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:34 smithi049 bash[23528]: audit 2024-09-20T23:17:33.947822+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:34.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:34 smithi049 bash[23528]: audit 2024-09-20T23:17:33.959528+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:35 smithi179 bash[23186]: audit 2024-09-20T23:17:34.282421+0000 mgr.a (mgr.14388) 2724 : audit [DBG] from='client.70377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:35 smithi049 bash[23528]: audit 2024-09-20T23:17:34.282421+0000 mgr.a (mgr.14388) 2724 : audit [DBG] from='client.70377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:36.025 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:35 smithi044 bash[22676]: audit 2024-09-20T23:17:34.282421+0000 mgr.a (mgr.14388) 2724 : audit [DBG] from='client.70377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:36 smithi179 bash[23186]: cluster 2024-09-20T23:17:34.996950+0000 mgr.a (mgr.14388) 2725 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:17:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:36 smithi179 bash[23186]: audit 2024-09-20T23:17:35.992894+0000 mon.a (mon.0) 2869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:36 smithi179 bash[23186]: audit 2024-09-20T23:17:36.000485+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:36 smithi179 bash[23186]: audit 2024-09-20T23:17:36.008761+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:36 smithi049 bash[23528]: cluster 2024-09-20T23:17:34.996950+0000 mgr.a (mgr.14388) 2725 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:17:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:36 smithi049 bash[23528]: audit 2024-09-20T23:17:35.992894+0000 mon.a (mon.0) 2869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:36 smithi049 bash[23528]: audit 2024-09-20T23:17:36.000485+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:36 smithi049 bash[23528]: audit 2024-09-20T23:17:36.008761+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:36 smithi044 bash[22676]: cluster 2024-09-20T23:17:34.996950+0000 mgr.a (mgr.14388) 2725 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:36 smithi044 bash[22676]: audit 2024-09-20T23:17:35.992894+0000 mon.a (mon.0) 2869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:36 smithi044 bash[22676]: audit 2024-09-20T23:17:36.000485+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:36 smithi044 bash[22676]: audit 2024-09-20T23:17:36.008761+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:38 smithi179 bash[23186]: cluster 2024-09-20T23:17:36.998092+0000 mgr.a (mgr.14388) 2726 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:17:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:38 smithi049 bash[23528]: cluster 2024-09-20T23:17:36.998092+0000 mgr.a (mgr.14388) 2726 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:17:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:38 smithi044 bash[22676]: cluster 2024-09-20T23:17:36.998092+0000 mgr.a (mgr.14388) 2726 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:17:39.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:39.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:39.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:40.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:40.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:40.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:40.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:40.509 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:40 smithi179 bash[23186]: cluster 2024-09-20T23:17:38.998857+0000 mgr.a (mgr.14388) 2727 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:40 smithi049 bash[23528]: cluster 2024-09-20T23:17:38.998857+0000 mgr.a (mgr.14388) 2727 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:40 smithi044 bash[22676]: cluster 2024-09-20T23:17:38.998857+0000 mgr.a (mgr.14388) 2727 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:41.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:41 smithi179 bash[23186]: audit 2024-09-20T23:17:40.066405+0000 mgr.a (mgr.14388) 2728 : audit [DBG] from='client.70455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:41 smithi049 bash[23528]: audit 2024-09-20T23:17:40.066405+0000 mgr.a (mgr.14388) 2728 : audit [DBG] from='client.70455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:41 smithi044 bash[22676]: audit 2024-09-20T23:17:40.066405+0000 mgr.a (mgr.14388) 2728 : audit [DBG] from='client.70455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:42 smithi049 bash[23528]: cluster 2024-09-20T23:17:41.001713+0000 mgr.a (mgr.14388) 2729 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:42 smithi044 bash[22676]: cluster 2024-09-20T23:17:41.001713+0000 mgr.a (mgr.14388) 2729 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:42.989 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:42 smithi179 bash[23186]: cluster 2024-09-20T23:17:41.001713+0000 mgr.a (mgr.14388) 2729 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:44 smithi049 bash[23528]: cluster 2024-09-20T23:17:43.002544+0000 mgr.a (mgr.14388) 2730 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:44 smithi044 bash[22676]: cluster 2024-09-20T23:17:43.002544+0000 mgr.a (mgr.14388) 2730 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:44 smithi179 bash[23186]: cluster 2024-09-20T23:17:43.002544+0000 mgr.a (mgr.14388) 2730 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:45.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:45.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:45.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:46.270 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:46.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:46 smithi049 bash[23528]: cluster 2024-09-20T23:17:45.003721+0000 mgr.a (mgr.14388) 2731 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:17:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:46 smithi044 bash[22676]: cluster 2024-09-20T23:17:45.003721+0000 mgr.a (mgr.14388) 2731 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:17:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:46 smithi179 bash[23186]: cluster 2024-09-20T23:17:45.003721+0000 mgr.a (mgr.14388) 2731 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:17:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:47 smithi049 bash[23528]: audit 2024-09-20T23:17:45.846322+0000 mgr.a (mgr.14388) 2732 : audit [DBG] from='client.70530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:47 smithi044 bash[22676]: audit 2024-09-20T23:17:45.846322+0000 mgr.a (mgr.14388) 2732 : audit [DBG] from='client.70530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:47 smithi179 bash[23186]: audit 2024-09-20T23:17:45.846322+0000 mgr.a (mgr.14388) 2732 : audit [DBG] from='client.70530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:48 smithi049 bash[23528]: cluster 2024-09-20T23:17:47.006089+0000 mgr.a (mgr.14388) 2733 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:17:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:48 smithi044 bash[22676]: cluster 2024-09-20T23:17:47.006089+0000 mgr.a (mgr.14388) 2733 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:17:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:48 smithi179 bash[23186]: cluster 2024-09-20T23:17:47.006089+0000 mgr.a (mgr.14388) 2733 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:50 smithi049 bash[23528]: cluster 2024-09-20T23:17:49.006912+0000 mgr.a (mgr.14388) 2734 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:50 smithi044 bash[22676]: cluster 2024-09-20T23:17:49.006912+0000 mgr.a (mgr.14388) 2734 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:50 smithi179 bash[23186]: cluster 2024-09-20T23:17:49.006912+0000 mgr.a (mgr.14388) 2734 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:17:51.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:51.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:52.028 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:52.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:52 smithi049 bash[23528]: cluster 2024-09-20T23:17:51.008910+0000 mgr.a (mgr.14388) 2735 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:52.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:52 smithi049 bash[23528]: audit 2024-09-20T23:17:51.604868+0000 mgr.a (mgr.14388) 2736 : audit [DBG] from='client.70608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:52 smithi044 bash[22676]: cluster 2024-09-20T23:17:51.008910+0000 mgr.a (mgr.14388) 2735 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:52 smithi044 bash[22676]: audit 2024-09-20T23:17:51.604868+0000 mgr.a (mgr.14388) 2736 : audit [DBG] from='client.70608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:52 smithi179 bash[23186]: cluster 2024-09-20T23:17:51.008910+0000 mgr.a (mgr.14388) 2735 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:52 smithi179 bash[23186]: audit 2024-09-20T23:17:51.604868+0000 mgr.a (mgr.14388) 2736 : audit [DBG] from='client.70608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: cluster 2024-09-20T23:17:53.009960+0000 mgr.a (mgr.14388) 2737 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.706612+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.715140+0000 mon.a (mon.0) 2873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.725430+0000 mon.a (mon.0) 2874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.932509+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:17:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.938660+0000 mon.a (mon.0) 2876 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:17:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.940575+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:17:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.951841+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:53.958153+0000 mon.a (mon.0) 2879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:17:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:54.155192+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:54.159869+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:54 smithi049 bash[23528]: audit 2024-09-20T23:17:54.165885+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.889 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22930]: debug 2024-09-20T23:17:54.697+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22930]: debug 2024-09-20T23:17:54.697+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: cluster 2024-09-20T23:17:53.009960+0000 mgr.a (mgr.14388) 2737 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.706612+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.715140+0000 mon.a (mon.0) 2873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.725430+0000 mon.a (mon.0) 2874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.932509+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.938660+0000 mon.a (mon.0) 2876 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.940575+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.951841+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:53.958153+0000 mon.a (mon.0) 2879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:17:54.891 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:54.155192+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.891 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:54.159869+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:54.891 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:54 smithi044 bash[22676]: audit 2024-09-20T23:17:54.165885+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: cluster 2024-09-20T23:17:53.009960+0000 mgr.a (mgr.14388) 2737 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:17:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.706612+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.715140+0000 mon.a (mon.0) 2873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.725430+0000 mon.a (mon.0) 2874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.932509+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.938660+0000 mon.a (mon.0) 2876 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.940575+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.951841+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:53.958153+0000 mon.a (mon.0) 2879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:54.155192+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:54.159869+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:54 smithi179 bash[23186]: audit 2024-09-20T23:17:54.165885+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:55 smithi044 bash[22676]: audit 2024-09-20T23:17:53.960647+0000 mgr.a (mgr.14388) 2738 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:17:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:55 smithi179 bash[23186]: audit 2024-09-20T23:17:53.960647+0000 mgr.a (mgr.14388) 2738 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:17:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:55 smithi049 bash[23528]: audit 2024-09-20T23:17:53.960647+0000 mgr.a (mgr.14388) 2738 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:17:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:56 smithi044 bash[22676]: audit 2024-09-20T23:17:54.701363+0000 mgr.a (mgr.14388) 2739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:17:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:56 smithi044 bash[22676]: cephadm 2024-09-20T23:17:54.702507+0000 mgr.a (mgr.14388) 2740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:17:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:56 smithi044 bash[22676]: cluster 2024-09-20T23:17:55.010777+0000 mgr.a (mgr.14388) 2741 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T23:17:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:56 smithi044 bash[22676]: audit 2024-09-20T23:17:56.236199+0000 mon.a (mon.0) 2883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:56 smithi044 bash[22676]: audit 2024-09-20T23:17:56.243139+0000 mon.a (mon.0) 2884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:56 smithi044 bash[22676]: audit 2024-09-20T23:17:56.253490+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:56 smithi179 bash[23186]: audit 2024-09-20T23:17:54.701363+0000 mgr.a (mgr.14388) 2739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:17:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:56 smithi179 bash[23186]: cephadm 2024-09-20T23:17:54.702507+0000 mgr.a (mgr.14388) 2740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:17:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:56 smithi179 bash[23186]: cluster 2024-09-20T23:17:55.010777+0000 mgr.a (mgr.14388) 2741 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T23:17:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:56 smithi179 bash[23186]: audit 2024-09-20T23:17:56.236199+0000 mon.a (mon.0) 2883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:56 smithi179 bash[23186]: audit 2024-09-20T23:17:56.243139+0000 mon.a (mon.0) 2884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:56 smithi179 bash[23186]: audit 2024-09-20T23:17:56.253490+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:57.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:17:57.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:17:57.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:17:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:56 smithi049 bash[23528]: audit 2024-09-20T23:17:54.701363+0000 mgr.a (mgr.14388) 2739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:17:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:56 smithi049 bash[23528]: cephadm 2024-09-20T23:17:54.702507+0000 mgr.a (mgr.14388) 2740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:17:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:56 smithi049 bash[23528]: cluster 2024-09-20T23:17:55.010777+0000 mgr.a (mgr.14388) 2741 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T23:17:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:56 smithi049 bash[23528]: audit 2024-09-20T23:17:56.236199+0000 mon.a (mon.0) 2883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:56 smithi049 bash[23528]: audit 2024-09-20T23:17:56.243139+0000 mon.a (mon.0) 2884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:56 smithi049 bash[23528]: audit 2024-09-20T23:17:56.253490+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:17:57.822 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:17:57.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:17:57.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:17:57.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:17:57.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:17:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:58 smithi044 bash[22676]: cluster 2024-09-20T23:17:57.011844+0000 mgr.a (mgr.14388) 2742 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:17:58 smithi044 bash[22676]: audit 2024-09-20T23:17:57.371690+0000 mgr.a (mgr.14388) 2743 : audit [DBG] from='client.70791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:58 smithi179 bash[23186]: cluster 2024-09-20T23:17:57.011844+0000 mgr.a (mgr.14388) 2742 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:17:58 smithi179 bash[23186]: audit 2024-09-20T23:17:57.371690+0000 mgr.a (mgr.14388) 2743 : audit [DBG] from='client.70791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:17:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:58 smithi049 bash[23528]: cluster 2024-09-20T23:17:57.011844+0000 mgr.a (mgr.14388) 2742 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:17:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:17:58 smithi049 bash[23528]: audit 2024-09-20T23:17:57.371690+0000 mgr.a (mgr.14388) 2743 : audit [DBG] from='client.70791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:00 smithi044 bash[22676]: cluster 2024-09-20T23:17:59.012791+0000 mgr.a (mgr.14388) 2744 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:00 smithi179 bash[23186]: cluster 2024-09-20T23:17:59.012791+0000 mgr.a (mgr.14388) 2744 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:00 smithi049 bash[23528]: cluster 2024-09-20T23:17:59.012791+0000 mgr.a (mgr.14388) 2744 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:02.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:02.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:02 smithi044 bash[22676]: cluster 2024-09-20T23:18:01.015074+0000 mgr.a (mgr.14388) 2745 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:02 smithi179 bash[23186]: cluster 2024-09-20T23:18:01.015074+0000 mgr.a (mgr.14388) 2745 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:02 smithi049 bash[23528]: cluster 2024-09-20T23:18:01.015074+0000 mgr.a (mgr.14388) 2745 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:03.586 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:04.846 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:04 smithi179 bash[23186]: cluster 2024-09-20T23:18:03.015615+0000 mgr.a (mgr.14388) 2746 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:04.846 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:04 smithi179 bash[23186]: audit 2024-09-20T23:18:03.159302+0000 mgr.a (mgr.14388) 2747 : audit [DBG] from='client.70869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:04 smithi044 bash[22676]: cluster 2024-09-20T23:18:03.015615+0000 mgr.a (mgr.14388) 2746 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:04 smithi044 bash[22676]: audit 2024-09-20T23:18:03.159302+0000 mgr.a (mgr.14388) 2747 : audit [DBG] from='client.70869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:04 smithi049 bash[23528]: cluster 2024-09-20T23:18:03.015615+0000 mgr.a (mgr.14388) 2746 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:04 smithi049 bash[23528]: audit 2024-09-20T23:18:03.159302+0000 mgr.a (mgr.14388) 2747 : audit [DBG] from='client.70869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:06 smithi044 bash[22676]: cluster 2024-09-20T23:18:05.017127+0000 mgr.a (mgr.14388) 2748 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:06 smithi179 bash[23186]: cluster 2024-09-20T23:18:05.017127+0000 mgr.a (mgr.14388) 2748 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:06 smithi049 bash[23528]: cluster 2024-09-20T23:18:05.017127+0000 mgr.a (mgr.14388) 2748 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:18:08.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:08.588 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:08.588 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:08 smithi044 bash[22676]: cluster 2024-09-20T23:18:07.018840+0000 mgr.a (mgr.14388) 2749 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 5 op/s 2024-09-20T23:18:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:08 smithi179 bash[23186]: cluster 2024-09-20T23:18:07.018840+0000 mgr.a (mgr.14388) 2749 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 5 op/s 2024-09-20T23:18:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:08 smithi049 bash[23528]: cluster 2024-09-20T23:18:07.018840+0000 mgr.a (mgr.14388) 2749 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 5 op/s 2024-09-20T23:18:09.380 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:09.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:09.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:09.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:09.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:10 smithi044 bash[22676]: audit 2024-09-20T23:18:08.932173+0000 mgr.a (mgr.14388) 2750 : audit [DBG] from='client.70947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:10 smithi044 bash[22676]: cluster 2024-09-20T23:18:09.019497+0000 mgr.a (mgr.14388) 2751 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:10 smithi179 bash[23186]: audit 2024-09-20T23:18:08.932173+0000 mgr.a (mgr.14388) 2750 : audit [DBG] from='client.70947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:10 smithi179 bash[23186]: cluster 2024-09-20T23:18:09.019497+0000 mgr.a (mgr.14388) 2751 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:10 smithi049 bash[23528]: audit 2024-09-20T23:18:08.932173+0000 mgr.a (mgr.14388) 2750 : audit [DBG] from='client.70947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:10 smithi049 bash[23528]: cluster 2024-09-20T23:18:09.019497+0000 mgr.a (mgr.14388) 2751 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:12.845 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:12 smithi049 bash[23528]: cluster 2024-09-20T23:18:11.021868+0000 mgr.a (mgr.14388) 2752 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:12 smithi044 bash[22676]: cluster 2024-09-20T23:18:11.021868+0000 mgr.a (mgr.14388) 2752 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:12 smithi179 bash[23186]: cluster 2024-09-20T23:18:11.021868+0000 mgr.a (mgr.14388) 2752 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:14.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:14.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:14.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:14 smithi179 bash[23186]: cluster 2024-09-20T23:18:13.022647+0000 mgr.a (mgr.14388) 2753 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:14 smithi179 bash[23186]: audit 2024-09-20T23:18:13.926020+0000 mon.a (mon.0) 2886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:14 smithi179 bash[23186]: audit 2024-09-20T23:18:13.934478+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:14 smithi179 bash[23186]: audit 2024-09-20T23:18:13.944803+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:14 smithi179 bash[23186]: audit 2024-09-20T23:18:14.377024+0000 mon.a (mon.0) 2889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:14 smithi179 bash[23186]: audit 2024-09-20T23:18:14.385883+0000 mon.a (mon.0) 2890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:14 smithi179 bash[23186]: audit 2024-09-20T23:18:14.395228+0000 mon.a (mon.0) 2891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:14 smithi049 bash[23528]: cluster 2024-09-20T23:18:13.022647+0000 mgr.a (mgr.14388) 2753 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:14 smithi049 bash[23528]: audit 2024-09-20T23:18:13.926020+0000 mon.a (mon.0) 2886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:14 smithi049 bash[23528]: audit 2024-09-20T23:18:13.934478+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:14 smithi049 bash[23528]: audit 2024-09-20T23:18:13.944803+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:14 smithi049 bash[23528]: audit 2024-09-20T23:18:14.377024+0000 mon.a (mon.0) 2889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:14 smithi049 bash[23528]: audit 2024-09-20T23:18:14.385883+0000 mon.a (mon.0) 2890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:14 smithi049 bash[23528]: audit 2024-09-20T23:18:14.395228+0000 mon.a (mon.0) 2891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.961 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:14 smithi044 bash[22676]: cluster 2024-09-20T23:18:13.022647+0000 mgr.a (mgr.14388) 2753 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:14.961 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:14 smithi044 bash[22676]: audit 2024-09-20T23:18:13.926020+0000 mon.a (mon.0) 2886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.961 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:14 smithi044 bash[22676]: audit 2024-09-20T23:18:13.934478+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.962 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:14 smithi044 bash[22676]: audit 2024-09-20T23:18:13.944803+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.962 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:14 smithi044 bash[22676]: audit 2024-09-20T23:18:14.377024+0000 mon.a (mon.0) 2889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.962 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:14 smithi044 bash[22676]: audit 2024-09-20T23:18:14.385883+0000 mon.a (mon.0) 2890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:14.962 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:14 smithi044 bash[22676]: audit 2024-09-20T23:18:14.395228+0000 mon.a (mon.0) 2891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:15.157 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:15.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:15.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:15.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:15.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:16 smithi044 bash[22676]: audit 2024-09-20T23:18:14.718985+0000 mgr.a (mgr.14388) 2754 : audit [DBG] from='client.71025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:16 smithi044 bash[22676]: cluster 2024-09-20T23:18:15.023768+0000 mgr.a (mgr.14388) 2755 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:16 smithi044 bash[22676]: audit 2024-09-20T23:18:16.468068+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:16 smithi044 bash[22676]: audit 2024-09-20T23:18:16.476376+0000 mon.a (mon.0) 2893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:16 smithi044 bash[22676]: audit 2024-09-20T23:18:16.486717+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:16 smithi179 bash[23186]: audit 2024-09-20T23:18:14.718985+0000 mgr.a (mgr.14388) 2754 : audit [DBG] from='client.71025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:16 smithi179 bash[23186]: cluster 2024-09-20T23:18:15.023768+0000 mgr.a (mgr.14388) 2755 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:16 smithi179 bash[23186]: audit 2024-09-20T23:18:16.468068+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:16 smithi179 bash[23186]: audit 2024-09-20T23:18:16.476376+0000 mon.a (mon.0) 2893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:16 smithi179 bash[23186]: audit 2024-09-20T23:18:16.486717+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:16 smithi049 bash[23528]: audit 2024-09-20T23:18:14.718985+0000 mgr.a (mgr.14388) 2754 : audit [DBG] from='client.71025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:16 smithi049 bash[23528]: cluster 2024-09-20T23:18:15.023768+0000 mgr.a (mgr.14388) 2755 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:16 smithi049 bash[23528]: audit 2024-09-20T23:18:16.468068+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:16 smithi049 bash[23528]: audit 2024-09-20T23:18:16.476376+0000 mon.a (mon.0) 2893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:16 smithi049 bash[23528]: audit 2024-09-20T23:18:16.486717+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:18 smithi044 bash[22676]: cluster 2024-09-20T23:18:17.025729+0000 mgr.a (mgr.14388) 2756 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-20T23:18:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:18 smithi179 bash[23186]: cluster 2024-09-20T23:18:17.025729+0000 mgr.a (mgr.14388) 2756 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-20T23:18:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:18 smithi049 bash[23528]: cluster 2024-09-20T23:18:17.025729+0000 mgr.a (mgr.14388) 2756 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-20T23:18:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:20.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:20.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:20.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:20.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:20 smithi044 bash[22676]: cluster 2024-09-20T23:18:19.026549+0000 mgr.a (mgr.14388) 2757 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:18:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:20 smithi179 bash[23186]: cluster 2024-09-20T23:18:19.026549+0000 mgr.a (mgr.14388) 2757 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:18:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:20 smithi049 bash[23528]: cluster 2024-09-20T23:18:19.026549+0000 mgr.a (mgr.14388) 2757 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:18:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:21 smithi044 bash[22676]: audit 2024-09-20T23:18:20.490163+0000 mgr.a (mgr.14388) 2758 : audit [DBG] from='client.71100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:21 smithi179 bash[23186]: audit 2024-09-20T23:18:20.490163+0000 mgr.a (mgr.14388) 2758 : audit [DBG] from='client.71100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:21 smithi049 bash[23528]: audit 2024-09-20T23:18:20.490163+0000 mgr.a (mgr.14388) 2758 : audit [DBG] from='client.71100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:22 smithi044 bash[22676]: cluster 2024-09-20T23:18:21.029447+0000 mgr.a (mgr.14388) 2759 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:22 smithi179 bash[23186]: cluster 2024-09-20T23:18:21.029447+0000 mgr.a (mgr.14388) 2759 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:22 smithi049 bash[23528]: cluster 2024-09-20T23:18:21.029447+0000 mgr.a (mgr.14388) 2759 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:24.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:24 smithi179 bash[23186]: cluster 2024-09-20T23:18:23.030285+0000 mgr.a (mgr.14388) 2760 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:18:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:24 smithi044 bash[22676]: cluster 2024-09-20T23:18:23.030285+0000 mgr.a (mgr.14388) 2760 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:18:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:24 smithi049 bash[23528]: cluster 2024-09-20T23:18:23.030285+0000 mgr.a (mgr.14388) 2760 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:18:25.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:25.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:25.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:26.674 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:26.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:26.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:26.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:26.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:26 smithi044 bash[22676]: cluster 2024-09-20T23:18:25.031463+0000 mgr.a (mgr.14388) 2761 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:18:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:26 smithi179 bash[23186]: cluster 2024-09-20T23:18:25.031463+0000 mgr.a (mgr.14388) 2761 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:18:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:26 smithi049 bash[23528]: cluster 2024-09-20T23:18:25.031463+0000 mgr.a (mgr.14388) 2761 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:18:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:27 smithi044 bash[22676]: audit 2024-09-20T23:18:26.252703+0000 mgr.a (mgr.14388) 2762 : audit [DBG] from='client.71178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:27 smithi179 bash[23186]: audit 2024-09-20T23:18:26.252703+0000 mgr.a (mgr.14388) 2762 : audit [DBG] from='client.71178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:27 smithi049 bash[23528]: audit 2024-09-20T23:18:26.252703+0000 mgr.a (mgr.14388) 2762 : audit [DBG] from='client.71178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:28 smithi044 bash[22676]: cluster 2024-09-20T23:18:27.033802+0000 mgr.a (mgr.14388) 2763 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:28 smithi179 bash[23186]: cluster 2024-09-20T23:18:27.033802+0000 mgr.a (mgr.14388) 2763 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:28 smithi049 bash[23528]: cluster 2024-09-20T23:18:27.033802+0000 mgr.a (mgr.14388) 2763 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:30 smithi044 bash[22676]: cluster 2024-09-20T23:18:29.034613+0000 mgr.a (mgr.14388) 2764 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:18:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:30 smithi179 bash[23186]: cluster 2024-09-20T23:18:29.034613+0000 mgr.a (mgr.14388) 2764 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:18:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:30 smithi049 bash[23528]: cluster 2024-09-20T23:18:29.034613+0000 mgr.a (mgr.14388) 2764 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:18:31.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:31.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:31.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:32.435 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:32.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:32.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:32.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:32.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:32.903 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:32 smithi049 bash[23528]: cluster 2024-09-20T23:18:31.036636+0000 mgr.a (mgr.14388) 2765 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:18:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:32 smithi044 bash[22676]: cluster 2024-09-20T23:18:31.036636+0000 mgr.a (mgr.14388) 2765 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:18:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:32 smithi179 bash[23186]: cluster 2024-09-20T23:18:31.036636+0000 mgr.a (mgr.14388) 2765 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:18:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:33 smithi044 bash[22676]: audit 2024-09-20T23:18:32.005649+0000 mgr.a (mgr.14388) 2766 : audit [DBG] from='client.71256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:33 smithi179 bash[23186]: audit 2024-09-20T23:18:32.005649+0000 mgr.a (mgr.14388) 2766 : audit [DBG] from='client.71256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:33 smithi049 bash[23528]: audit 2024-09-20T23:18:32.005649+0000 mgr.a (mgr.14388) 2766 : audit [DBG] from='client.71256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:34.979 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:34 smithi044 bash[22676]: cluster 2024-09-20T23:18:33.037627+0000 mgr.a (mgr.14388) 2767 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:34.979 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:34 smithi044 bash[22676]: audit 2024-09-20T23:18:34.155775+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:34.979 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:34 smithi044 bash[22676]: audit 2024-09-20T23:18:34.164584+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:34.980 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:34 smithi044 bash[22676]: audit 2024-09-20T23:18:34.174836+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:34.980 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:34 smithi044 bash[22676]: audit 2024-09-20T23:18:34.592583+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:34.980 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:34 smithi044 bash[22676]: audit 2024-09-20T23:18:34.601996+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:34.980 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:34 smithi044 bash[22676]: audit 2024-09-20T23:18:34.613108+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:34 smithi179 bash[23186]: cluster 2024-09-20T23:18:33.037627+0000 mgr.a (mgr.14388) 2767 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:34 smithi179 bash[23186]: audit 2024-09-20T23:18:34.155775+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:34 smithi179 bash[23186]: audit 2024-09-20T23:18:34.164584+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:34 smithi179 bash[23186]: audit 2024-09-20T23:18:34.174836+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:34 smithi179 bash[23186]: audit 2024-09-20T23:18:34.592583+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:34 smithi179 bash[23186]: audit 2024-09-20T23:18:34.601996+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:34 smithi179 bash[23186]: audit 2024-09-20T23:18:34.613108+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:34 smithi049 bash[23528]: cluster 2024-09-20T23:18:33.037627+0000 mgr.a (mgr.14388) 2767 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:35.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:34 smithi049 bash[23528]: audit 2024-09-20T23:18:34.155775+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:34 smithi049 bash[23528]: audit 2024-09-20T23:18:34.164584+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:34 smithi049 bash[23528]: audit 2024-09-20T23:18:34.174836+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:34 smithi049 bash[23528]: audit 2024-09-20T23:18:34.592583+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:34 smithi049 bash[23528]: audit 2024-09-20T23:18:34.601996+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:35.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:34 smithi049 bash[23528]: audit 2024-09-20T23:18:34.613108+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:36 smithi044 bash[22676]: cluster 2024-09-20T23:18:35.039076+0000 mgr.a (mgr.14388) 2768 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:36 smithi044 bash[22676]: audit 2024-09-20T23:18:36.629758+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:36 smithi044 bash[22676]: audit 2024-09-20T23:18:36.635304+0000 mon.a (mon.0) 2902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:36 smithi044 bash[22676]: audit 2024-09-20T23:18:36.643403+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:36 smithi179 bash[23186]: cluster 2024-09-20T23:18:35.039076+0000 mgr.a (mgr.14388) 2768 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:36 smithi179 bash[23186]: audit 2024-09-20T23:18:36.629758+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:36 smithi179 bash[23186]: audit 2024-09-20T23:18:36.635304+0000 mon.a (mon.0) 2902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:36 smithi179 bash[23186]: audit 2024-09-20T23:18:36.643403+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:36 smithi049 bash[23528]: cluster 2024-09-20T23:18:35.039076+0000 mgr.a (mgr.14388) 2768 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:36 smithi049 bash[23528]: audit 2024-09-20T23:18:36.629758+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:36 smithi049 bash[23528]: audit 2024-09-20T23:18:36.635304+0000 mon.a (mon.0) 2902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:36 smithi049 bash[23528]: audit 2024-09-20T23:18:36.643403+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:37.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:37.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:37.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:38.220 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:38.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:38.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:38.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:38.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:38 smithi044 bash[22676]: cluster 2024-09-20T23:18:37.040747+0000 mgr.a (mgr.14388) 2769 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:18:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:38 smithi179 bash[23186]: cluster 2024-09-20T23:18:37.040747+0000 mgr.a (mgr.14388) 2769 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:18:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:38 smithi049 bash[23528]: cluster 2024-09-20T23:18:37.040747+0000 mgr.a (mgr.14388) 2769 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:18:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:39 smithi044 bash[22676]: audit 2024-09-20T23:18:37.780806+0000 mgr.a (mgr.14388) 2770 : audit [DBG] from='client.71334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:39 smithi179 bash[23186]: audit 2024-09-20T23:18:37.780806+0000 mgr.a (mgr.14388) 2770 : audit [DBG] from='client.71334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:39 smithi049 bash[23528]: audit 2024-09-20T23:18:37.780806+0000 mgr.a (mgr.14388) 2770 : audit [DBG] from='client.71334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:40 smithi044 bash[22676]: cluster 2024-09-20T23:18:39.041771+0000 mgr.a (mgr.14388) 2771 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:40 smithi179 bash[23186]: cluster 2024-09-20T23:18:39.041771+0000 mgr.a (mgr.14388) 2771 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:40 smithi049 bash[23528]: cluster 2024-09-20T23:18:39.041771+0000 mgr.a (mgr.14388) 2771 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:42 smithi044 bash[22676]: cluster 2024-09-20T23:18:41.044041+0000 mgr.a (mgr.14388) 2772 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:42 smithi179 bash[23186]: cluster 2024-09-20T23:18:41.044041+0000 mgr.a (mgr.14388) 2772 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:42 smithi049 bash[23528]: cluster 2024-09-20T23:18:41.044041+0000 mgr.a (mgr.14388) 2772 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:43.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:43.996 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:44 smithi044 bash[22676]: cluster 2024-09-20T23:18:43.044833+0000 mgr.a (mgr.14388) 2773 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:44 smithi044 bash[22676]: audit 2024-09-20T23:18:43.567683+0000 mgr.a (mgr.14388) 2774 : audit [DBG] from='client.71409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:44 smithi179 bash[23186]: cluster 2024-09-20T23:18:43.044833+0000 mgr.a (mgr.14388) 2773 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:44 smithi179 bash[23186]: audit 2024-09-20T23:18:43.567683+0000 mgr.a (mgr.14388) 2774 : audit [DBG] from='client.71409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:44 smithi049 bash[23528]: cluster 2024-09-20T23:18:43.044833+0000 mgr.a (mgr.14388) 2773 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:44 smithi049 bash[23528]: audit 2024-09-20T23:18:43.567683+0000 mgr.a (mgr.14388) 2774 : audit [DBG] from='client.71409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:46 smithi044 bash[22676]: cluster 2024-09-20T23:18:45.046443+0000 mgr.a (mgr.14388) 2775 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:46 smithi179 bash[23186]: cluster 2024-09-20T23:18:45.046443+0000 mgr.a (mgr.14388) 2775 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:46 smithi049 bash[23528]: cluster 2024-09-20T23:18:45.046443+0000 mgr.a (mgr.14388) 2775 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:48 smithi044 bash[22676]: cluster 2024-09-20T23:18:47.048135+0000 mgr.a (mgr.14388) 2776 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:18:48.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:48.998 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:48.998 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:48 smithi179 bash[23186]: cluster 2024-09-20T23:18:47.048135+0000 mgr.a (mgr.14388) 2776 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:18:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:48 smithi049 bash[23528]: cluster 2024-09-20T23:18:47.048135+0000 mgr.a (mgr.14388) 2776 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:18:49.760 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:49.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:49 smithi044 bash[22676]: cluster 2024-09-20T23:18:49.048913+0000 mgr.a (mgr.14388) 2777 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:49 smithi044 bash[22676]: audit 2024-09-20T23:18:49.327588+0000 mgr.a (mgr.14388) 2778 : audit [DBG] from='client.71487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:49 smithi179 bash[23186]: cluster 2024-09-20T23:18:49.048913+0000 mgr.a (mgr.14388) 2777 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:49 smithi179 bash[23186]: audit 2024-09-20T23:18:49.327588+0000 mgr.a (mgr.14388) 2778 : audit [DBG] from='client.71487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:49 smithi049 bash[23528]: cluster 2024-09-20T23:18:49.048913+0000 mgr.a (mgr.14388) 2777 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:49 smithi049 bash[23528]: audit 2024-09-20T23:18:49.327588+0000 mgr.a (mgr.14388) 2778 : audit [DBG] from='client.71487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:52 smithi044 bash[22676]: cluster 2024-09-20T23:18:51.051248+0000 mgr.a (mgr.14388) 2779 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:52 smithi179 bash[23186]: cluster 2024-09-20T23:18:51.051248+0000 mgr.a (mgr.14388) 2779 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:52 smithi049 bash[23528]: cluster 2024-09-20T23:18:51.051248+0000 mgr.a (mgr.14388) 2779 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:18:54.392 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:54 smithi049 bash[23528]: cluster 2024-09-20T23:18:53.052047+0000 mgr.a (mgr.14388) 2780 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:54 smithi044 bash[22676]: cluster 2024-09-20T23:18:53.052047+0000 mgr.a (mgr.14388) 2780 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:54 smithi179 bash[23186]: cluster 2024-09-20T23:18:53.052047+0000 mgr.a (mgr.14388) 2780 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:18:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:18:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:18:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:18:55.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22930]: debug 2024-09-20T23:18:55.536+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:18:55.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22930]: debug 2024-09-20T23:18:55.548+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.371014+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.379935+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.390719+0000 mon.a (mon.0) 2906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.756648+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.762972+0000 mon.a (mon.0) 2908 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.765211+0000 mon.a (mon.0) 2909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.775047+0000 mon.a (mon.0) 2910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.779400+0000 mon.a (mon.0) 2911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.823532+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.831511+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:55 smithi044 bash[22676]: audit 2024-09-20T23:18:54.840675+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.371014+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.379935+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.390719+0000 mon.a (mon.0) 2906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.756648+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.762972+0000 mon.a (mon.0) 2908 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.765211+0000 mon.a (mon.0) 2909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.775047+0000 mon.a (mon.0) 2910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.779400+0000 mon.a (mon.0) 2911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.823532+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.831511+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:55 smithi179 bash[23186]: audit 2024-09-20T23:18:54.840675+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.371014+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.379935+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.390719+0000 mon.a (mon.0) 2906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.756648+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.762972+0000 mon.a (mon.0) 2908 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.765211+0000 mon.a (mon.0) 2909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.775047+0000 mon.a (mon.0) 2910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.779400+0000 mon.a (mon.0) 2911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.823532+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.831511+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:55 smithi049 bash[23528]: audit 2024-09-20T23:18:54.840675+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:55.958 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:18:55.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:18:55.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:18:55.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:18:55.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:18:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:56 smithi044 bash[22676]: audit 2024-09-20T23:18:54.781338+0000 mgr.a (mgr.14388) 2781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:18:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:56 smithi044 bash[22676]: cluster 2024-09-20T23:18:55.053273+0000 mgr.a (mgr.14388) 2782 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:56 smithi044 bash[22676]: audit 2024-09-20T23:18:55.112362+0000 mgr.a (mgr.14388) 2783 : audit [DBG] from='client.71568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:56 smithi044 bash[22676]: audit 2024-09-20T23:18:55.538687+0000 mgr.a (mgr.14388) 2784 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:18:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:56 smithi044 bash[22676]: cephadm 2024-09-20T23:18:55.551171+0000 mgr.a (mgr.14388) 2785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:18:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:56 smithi179 bash[23186]: audit 2024-09-20T23:18:54.781338+0000 mgr.a (mgr.14388) 2781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:18:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:56 smithi179 bash[23186]: cluster 2024-09-20T23:18:55.053273+0000 mgr.a (mgr.14388) 2782 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:56 smithi179 bash[23186]: audit 2024-09-20T23:18:55.112362+0000 mgr.a (mgr.14388) 2783 : audit [DBG] from='client.71568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:56 smithi179 bash[23186]: audit 2024-09-20T23:18:55.538687+0000 mgr.a (mgr.14388) 2784 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:18:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:56 smithi179 bash[23186]: cephadm 2024-09-20T23:18:55.551171+0000 mgr.a (mgr.14388) 2785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:18:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:56 smithi049 bash[23528]: audit 2024-09-20T23:18:54.781338+0000 mgr.a (mgr.14388) 2781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:18:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:56 smithi049 bash[23528]: cluster 2024-09-20T23:18:55.053273+0000 mgr.a (mgr.14388) 2782 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:18:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:56 smithi049 bash[23528]: audit 2024-09-20T23:18:55.112362+0000 mgr.a (mgr.14388) 2783 : audit [DBG] from='client.71568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:18:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:56 smithi049 bash[23528]: audit 2024-09-20T23:18:55.538687+0000 mgr.a (mgr.14388) 2784 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:18:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:56 smithi049 bash[23528]: cephadm 2024-09-20T23:18:55.551171+0000 mgr.a (mgr.14388) 2785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:18:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:57 smithi044 bash[22676]: audit 2024-09-20T23:18:56.818103+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:57 smithi044 bash[22676]: audit 2024-09-20T23:18:56.822877+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:57 smithi044 bash[22676]: audit 2024-09-20T23:18:56.829504+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:18:57 smithi044 bash[22676]: cluster 2024-09-20T23:18:57.054462+0000 mgr.a (mgr.14388) 2786 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:18:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:57 smithi179 bash[23186]: audit 2024-09-20T23:18:56.818103+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:57 smithi179 bash[23186]: audit 2024-09-20T23:18:56.822877+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:57 smithi179 bash[23186]: audit 2024-09-20T23:18:56.829504+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:18:57 smithi179 bash[23186]: cluster 2024-09-20T23:18:57.054462+0000 mgr.a (mgr.14388) 2786 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:18:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:57 smithi049 bash[23528]: audit 2024-09-20T23:18:56.818103+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:57 smithi049 bash[23528]: audit 2024-09-20T23:18:56.822877+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:57 smithi049 bash[23528]: audit 2024-09-20T23:18:56.829504+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:18:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:18:57 smithi049 bash[23528]: cluster 2024-09-20T23:18:57.054462+0000 mgr.a (mgr.14388) 2786 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:19:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:00 smithi044 bash[22676]: cluster 2024-09-20T23:18:59.055210+0000 mgr.a (mgr.14388) 2787 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:19:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:00 smithi179 bash[23186]: cluster 2024-09-20T23:18:59.055210+0000 mgr.a (mgr.14388) 2787 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:19:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:00 smithi049 bash[23528]: cluster 2024-09-20T23:18:59.055210+0000 mgr.a (mgr.14388) 2787 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:19:00.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:00.961 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:00.961 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:01.720 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:02 smithi044 bash[22676]: cluster 2024-09-20T23:19:01.056776+0000 mgr.a (mgr.14388) 2788 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:02 smithi044 bash[22676]: audit 2024-09-20T23:19:01.298246+0000 mgr.a (mgr.14388) 2789 : audit [DBG] from='client.71739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:02 smithi179 bash[23186]: cluster 2024-09-20T23:19:01.056776+0000 mgr.a (mgr.14388) 2788 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:19:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:02 smithi179 bash[23186]: audit 2024-09-20T23:19:01.298246+0000 mgr.a (mgr.14388) 2789 : audit [DBG] from='client.71739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:02 smithi049 bash[23528]: cluster 2024-09-20T23:19:01.056776+0000 mgr.a (mgr.14388) 2788 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:19:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:02 smithi049 bash[23528]: audit 2024-09-20T23:19:01.298246+0000 mgr.a (mgr.14388) 2789 : audit [DBG] from='client.71739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:04.452 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:04 smithi179 bash[23186]: cluster 2024-09-20T23:19:03.057688+0000 mgr.a (mgr.14388) 2790 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:04 smithi044 bash[22676]: cluster 2024-09-20T23:19:03.057688+0000 mgr.a (mgr.14388) 2790 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:04 smithi049 bash[23528]: cluster 2024-09-20T23:19:03.057688+0000 mgr.a (mgr.14388) 2790 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:06 smithi179 bash[23186]: cluster 2024-09-20T23:19:05.059062+0000 mgr.a (mgr.14388) 2791 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:06 smithi044 bash[22676]: cluster 2024-09-20T23:19:05.059062+0000 mgr.a (mgr.14388) 2791 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:06 smithi049 bash[23528]: cluster 2024-09-20T23:19:05.059062+0000 mgr.a (mgr.14388) 2791 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:06.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:06.722 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:06.723 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:07.472 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:07.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:08 smithi044 bash[22676]: audit 2024-09-20T23:19:07.054517+0000 mgr.a (mgr.14388) 2792 : audit [DBG] from='client.71811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:08 smithi044 bash[22676]: cluster 2024-09-20T23:19:07.068183+0000 mgr.a (mgr.14388) 2793 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:08 smithi179 bash[23186]: audit 2024-09-20T23:19:07.054517+0000 mgr.a (mgr.14388) 2792 : audit [DBG] from='client.71811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:08 smithi179 bash[23186]: cluster 2024-09-20T23:19:07.068183+0000 mgr.a (mgr.14388) 2793 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:08 smithi049 bash[23528]: audit 2024-09-20T23:19:07.054517+0000 mgr.a (mgr.14388) 2792 : audit [DBG] from='client.71811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:08 smithi049 bash[23528]: cluster 2024-09-20T23:19:07.068183+0000 mgr.a (mgr.14388) 2793 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:10 smithi044 bash[22676]: cluster 2024-09-20T23:19:09.069170+0000 mgr.a (mgr.14388) 2794 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:10 smithi179 bash[23186]: cluster 2024-09-20T23:19:09.069170+0000 mgr.a (mgr.14388) 2794 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:10 smithi049 bash[23528]: cluster 2024-09-20T23:19:09.069170+0000 mgr.a (mgr.14388) 2794 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:19:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:12.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:12.475 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:12 smithi044 bash[22676]: cluster 2024-09-20T23:19:11.071429+0000 mgr.a (mgr.14388) 2795 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:19:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:12 smithi179 bash[23186]: cluster 2024-09-20T23:19:11.071429+0000 mgr.a (mgr.14388) 2795 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:19:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:12 smithi049 bash[23528]: cluster 2024-09-20T23:19:11.071429+0000 mgr.a (mgr.14388) 2795 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:19:13.269 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:13.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:14 smithi044 bash[22676]: audit 2024-09-20T23:19:12.814153+0000 mgr.a (mgr.14388) 2796 : audit [DBG] from='client.71883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:14 smithi044 bash[22676]: cluster 2024-09-20T23:19:13.071996+0000 mgr.a (mgr.14388) 2797 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:14 smithi179 bash[23186]: audit 2024-09-20T23:19:12.814153+0000 mgr.a (mgr.14388) 2796 : audit [DBG] from='client.71883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:14 smithi179 bash[23186]: cluster 2024-09-20T23:19:13.071996+0000 mgr.a (mgr.14388) 2797 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:14 smithi049 bash[23528]: audit 2024-09-20T23:19:12.814153+0000 mgr.a (mgr.14388) 2796 : audit [DBG] from='client.71883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:14 smithi049 bash[23528]: cluster 2024-09-20T23:19:13.071996+0000 mgr.a (mgr.14388) 2797 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:15 smithi049 bash[23528]: audit 2024-09-20T23:19:14.564508+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:15 smithi049 bash[23528]: audit 2024-09-20T23:19:14.573762+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:15 smithi049 bash[23528]: audit 2024-09-20T23:19:14.584757+0000 mon.a (mon.0) 2920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:15 smithi049 bash[23528]: audit 2024-09-20T23:19:15.050956+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:15 smithi049 bash[23528]: audit 2024-09-20T23:19:15.059315+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:15 smithi049 bash[23528]: audit 2024-09-20T23:19:15.069646+0000 mon.a (mon.0) 2923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:15 smithi044 bash[22676]: audit 2024-09-20T23:19:14.564508+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:15 smithi044 bash[22676]: audit 2024-09-20T23:19:14.573762+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:15 smithi044 bash[22676]: audit 2024-09-20T23:19:14.584757+0000 mon.a (mon.0) 2920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:15 smithi044 bash[22676]: audit 2024-09-20T23:19:15.050956+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:15 smithi044 bash[22676]: audit 2024-09-20T23:19:15.059315+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:15 smithi044 bash[22676]: audit 2024-09-20T23:19:15.069646+0000 mon.a (mon.0) 2923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:15 smithi179 bash[23186]: audit 2024-09-20T23:19:14.564508+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:15 smithi179 bash[23186]: audit 2024-09-20T23:19:14.573762+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:15 smithi179 bash[23186]: audit 2024-09-20T23:19:14.584757+0000 mon.a (mon.0) 2920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:15 smithi179 bash[23186]: audit 2024-09-20T23:19:15.050956+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:15 smithi179 bash[23186]: audit 2024-09-20T23:19:15.059315+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:15 smithi179 bash[23186]: audit 2024-09-20T23:19:15.069646+0000 mon.a (mon.0) 2923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:16 smithi044 bash[22676]: cluster 2024-09-20T23:19:15.073495+0000 mgr.a (mgr.14388) 2798 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:16 smithi179 bash[23186]: cluster 2024-09-20T23:19:15.073495+0000 mgr.a (mgr.14388) 2798 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:16 smithi049 bash[23528]: cluster 2024-09-20T23:19:15.073495+0000 mgr.a (mgr.14388) 2798 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:18 smithi044 bash[22676]: audit 2024-09-20T23:19:17.033730+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:18 smithi044 bash[22676]: audit 2024-09-20T23:19:17.041531+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:18 smithi044 bash[22676]: audit 2024-09-20T23:19:17.051749+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:18 smithi044 bash[22676]: cluster 2024-09-20T23:19:17.075119+0000 mgr.a (mgr.14388) 2799 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:18.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:18 smithi049 bash[23528]: audit 2024-09-20T23:19:17.033730+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:18 smithi049 bash[23528]: audit 2024-09-20T23:19:17.041531+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:18 smithi049 bash[23528]: audit 2024-09-20T23:19:17.051749+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:18 smithi049 bash[23528]: cluster 2024-09-20T23:19:17.075119+0000 mgr.a (mgr.14388) 2799 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:18.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:18 smithi179 bash[23186]: audit 2024-09-20T23:19:17.033730+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:18 smithi179 bash[23186]: audit 2024-09-20T23:19:17.041531+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:18 smithi179 bash[23186]: audit 2024-09-20T23:19:17.051749+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:18.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:18 smithi179 bash[23186]: cluster 2024-09-20T23:19:17.075119+0000 mgr.a (mgr.14388) 2799 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:19.025 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:19.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:19.324 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:19 smithi044 bash[22676]: audit 2024-09-20T23:19:18.602491+0000 mgr.a (mgr.14388) 2800 : audit [DBG] from='client.71958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:19 smithi179 bash[23186]: audit 2024-09-20T23:19:18.602491+0000 mgr.a (mgr.14388) 2800 : audit [DBG] from='client.71958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:19 smithi049 bash[23528]: audit 2024-09-20T23:19:18.602491+0000 mgr.a (mgr.14388) 2800 : audit [DBG] from='client.71958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:20 smithi044 bash[22676]: cluster 2024-09-20T23:19:19.075854+0000 mgr.a (mgr.14388) 2801 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:20 smithi179 bash[23186]: cluster 2024-09-20T23:19:19.075854+0000 mgr.a (mgr.14388) 2801 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:20 smithi049 bash[23528]: cluster 2024-09-20T23:19:19.075854+0000 mgr.a (mgr.14388) 2801 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:22 smithi044 bash[22676]: cluster 2024-09-20T23:19:21.078189+0000 mgr.a (mgr.14388) 2802 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:19:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:22 smithi179 bash[23186]: cluster 2024-09-20T23:19:21.078189+0000 mgr.a (mgr.14388) 2802 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:19:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:22 smithi049 bash[23528]: cluster 2024-09-20T23:19:21.078189+0000 mgr.a (mgr.14388) 2802 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:19:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:24.428 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:24 smithi179 bash[23186]: cluster 2024-09-20T23:19:23.079109+0000 mgr.a (mgr.14388) 2803 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:24 smithi044 bash[22676]: cluster 2024-09-20T23:19:23.079109+0000 mgr.a (mgr.14388) 2803 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:24 smithi049 bash[23528]: cluster 2024-09-20T23:19:23.079109+0000 mgr.a (mgr.14388) 2803 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:24.792 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:24.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:24.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:24.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:24.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:25 smithi044 bash[22676]: audit 2024-09-20T23:19:24.357146+0000 mgr.a (mgr.14388) 2804 : audit [DBG] from='client.72033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:25 smithi179 bash[23186]: audit 2024-09-20T23:19:24.357146+0000 mgr.a (mgr.14388) 2804 : audit [DBG] from='client.72033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:25 smithi049 bash[23528]: audit 2024-09-20T23:19:24.357146+0000 mgr.a (mgr.14388) 2804 : audit [DBG] from='client.72033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:26 smithi044 bash[22676]: cluster 2024-09-20T23:19:25.080688+0000 mgr.a (mgr.14388) 2805 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:26 smithi179 bash[23186]: cluster 2024-09-20T23:19:25.080688+0000 mgr.a (mgr.14388) 2805 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:26 smithi049 bash[23528]: cluster 2024-09-20T23:19:25.080688+0000 mgr.a (mgr.14388) 2805 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:28 smithi044 bash[22676]: cluster 2024-09-20T23:19:27.082449+0000 mgr.a (mgr.14388) 2806 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:28 smithi179 bash[23186]: cluster 2024-09-20T23:19:27.082449+0000 mgr.a (mgr.14388) 2806 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:28 smithi049 bash[23528]: cluster 2024-09-20T23:19:27.082449+0000 mgr.a (mgr.14388) 2806 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:29.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:29.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:29.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:30 smithi044 bash[22676]: cluster 2024-09-20T23:19:29.083224+0000 mgr.a (mgr.14388) 2807 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:30 smithi179 bash[23186]: cluster 2024-09-20T23:19:29.083224+0000 mgr.a (mgr.14388) 2807 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:30 smithi049 bash[23528]: cluster 2024-09-20T23:19:29.083224+0000 mgr.a (mgr.14388) 2807 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:30.579 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:30.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:30.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:30.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:30.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:31 smithi044 bash[22676]: audit 2024-09-20T23:19:30.132938+0000 mgr.a (mgr.14388) 2808 : audit [DBG] from='client.72111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:31 smithi179 bash[23186]: audit 2024-09-20T23:19:30.132938+0000 mgr.a (mgr.14388) 2808 : audit [DBG] from='client.72111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:31 smithi049 bash[23528]: audit 2024-09-20T23:19:30.132938+0000 mgr.a (mgr.14388) 2808 : audit [DBG] from='client.72111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:32 smithi044 bash[22676]: cluster 2024-09-20T23:19:31.086107+0000 mgr.a (mgr.14388) 2809 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:32 smithi179 bash[23186]: cluster 2024-09-20T23:19:31.086107+0000 mgr.a (mgr.14388) 2809 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:32 smithi049 bash[23528]: cluster 2024-09-20T23:19:31.086107+0000 mgr.a (mgr.14388) 2809 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:34 smithi049 bash[23528]: cluster 2024-09-20T23:19:33.086914+0000 mgr.a (mgr.14388) 2810 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:19:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:34 smithi044 bash[22676]: cluster 2024-09-20T23:19:33.086914+0000 mgr.a (mgr.14388) 2810 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:19:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:34 smithi179 bash[23186]: cluster 2024-09-20T23:19:33.086914+0000 mgr.a (mgr.14388) 2810 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:19:35.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:35.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:35.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:35 smithi049 bash[23528]: audit 2024-09-20T23:19:34.795420+0000 mon.a (mon.0) 2927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:35 smithi049 bash[23528]: audit 2024-09-20T23:19:34.804071+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:35 smithi049 bash[23528]: audit 2024-09-20T23:19:34.814663+0000 mon.a (mon.0) 2929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:35 smithi049 bash[23528]: cluster 2024-09-20T23:19:35.088125+0000 mgr.a (mgr.14388) 2811 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:19:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:35 smithi049 bash[23528]: audit 2024-09-20T23:19:35.280732+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:35 smithi049 bash[23528]: audit 2024-09-20T23:19:35.289337+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:35 smithi049 bash[23528]: audit 2024-09-20T23:19:35.299487+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:35 smithi044 bash[22676]: audit 2024-09-20T23:19:34.795420+0000 mon.a (mon.0) 2927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:35 smithi044 bash[22676]: audit 2024-09-20T23:19:34.804071+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:35 smithi044 bash[22676]: audit 2024-09-20T23:19:34.814663+0000 mon.a (mon.0) 2929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:35 smithi044 bash[22676]: cluster 2024-09-20T23:19:35.088125+0000 mgr.a (mgr.14388) 2811 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:19:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:35 smithi044 bash[22676]: audit 2024-09-20T23:19:35.280732+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:35 smithi044 bash[22676]: audit 2024-09-20T23:19:35.289337+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:35 smithi044 bash[22676]: audit 2024-09-20T23:19:35.299487+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:35 smithi179 bash[23186]: audit 2024-09-20T23:19:34.795420+0000 mon.a (mon.0) 2927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:35 smithi179 bash[23186]: audit 2024-09-20T23:19:34.804071+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:35 smithi179 bash[23186]: audit 2024-09-20T23:19:34.814663+0000 mon.a (mon.0) 2929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:35 smithi179 bash[23186]: cluster 2024-09-20T23:19:35.088125+0000 mgr.a (mgr.14388) 2811 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:19:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:35 smithi179 bash[23186]: audit 2024-09-20T23:19:35.280732+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:35 smithi179 bash[23186]: audit 2024-09-20T23:19:35.289337+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:35 smithi179 bash[23186]: audit 2024-09-20T23:19:35.299487+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:36.373 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:36 smithi044 bash[22676]: audit 2024-09-20T23:19:35.921406+0000 mgr.a (mgr.14388) 2812 : audit [DBG] from='client.72186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:36 smithi179 bash[23186]: audit 2024-09-20T23:19:35.921406+0000 mgr.a (mgr.14388) 2812 : audit [DBG] from='client.72186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:36 smithi049 bash[23528]: audit 2024-09-20T23:19:35.921406+0000 mgr.a (mgr.14388) 2812 : audit [DBG] from='client.72186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:38 smithi049 bash[23528]: cluster 2024-09-20T23:19:37.089871+0000 mgr.a (mgr.14388) 2813 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:19:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:38 smithi049 bash[23528]: audit 2024-09-20T23:19:37.270375+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:38 smithi049 bash[23528]: audit 2024-09-20T23:19:37.278425+0000 mon.a (mon.0) 2934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:38 smithi049 bash[23528]: audit 2024-09-20T23:19:37.285320+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:38 smithi044 bash[22676]: cluster 2024-09-20T23:19:37.089871+0000 mgr.a (mgr.14388) 2813 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:19:38.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:38 smithi044 bash[22676]: audit 2024-09-20T23:19:37.270375+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:38 smithi044 bash[22676]: audit 2024-09-20T23:19:37.278425+0000 mon.a (mon.0) 2934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:38 smithi044 bash[22676]: audit 2024-09-20T23:19:37.285320+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:38 smithi179 bash[23186]: cluster 2024-09-20T23:19:37.089871+0000 mgr.a (mgr.14388) 2813 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:19:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:38 smithi179 bash[23186]: audit 2024-09-20T23:19:37.270375+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:38 smithi179 bash[23186]: audit 2024-09-20T23:19:37.278425+0000 mon.a (mon.0) 2934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:38 smithi179 bash[23186]: audit 2024-09-20T23:19:37.285320+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:40 smithi049 bash[23528]: cluster 2024-09-20T23:19:39.090531+0000 mgr.a (mgr.14388) 2814 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:19:40.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:40 smithi044 bash[22676]: cluster 2024-09-20T23:19:39.090531+0000 mgr.a (mgr.14388) 2814 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:19:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:40 smithi179 bash[23186]: cluster 2024-09-20T23:19:39.090531+0000 mgr.a (mgr.14388) 2814 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:19:41.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:41.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:41.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:42.157 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:42.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:42.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:42.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:42.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:42 smithi049 bash[23528]: cluster 2024-09-20T23:19:41.092572+0000 mgr.a (mgr.14388) 2815 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:42 smithi044 bash[22676]: cluster 2024-09-20T23:19:41.092572+0000 mgr.a (mgr.14388) 2815 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:42 smithi179 bash[23186]: cluster 2024-09-20T23:19:41.092572+0000 mgr.a (mgr.14388) 2815 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:43 smithi049 bash[23528]: audit 2024-09-20T23:19:41.711550+0000 mgr.a (mgr.14388) 2816 : audit [DBG] from='client.72264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:43 smithi044 bash[22676]: audit 2024-09-20T23:19:41.711550+0000 mgr.a (mgr.14388) 2816 : audit [DBG] from='client.72264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:43 smithi179 bash[23186]: audit 2024-09-20T23:19:41.711550+0000 mgr.a (mgr.14388) 2816 : audit [DBG] from='client.72264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:44 smithi049 bash[23528]: cluster 2024-09-20T23:19:43.093474+0000 mgr.a (mgr.14388) 2817 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:44.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:44 smithi179 bash[23186]: cluster 2024-09-20T23:19:43.093474+0000 mgr.a (mgr.14388) 2817 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:44 smithi044 bash[22676]: cluster 2024-09-20T23:19:43.093474+0000 mgr.a (mgr.14388) 2817 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:46 smithi049 bash[23528]: cluster 2024-09-20T23:19:45.094837+0000 mgr.a (mgr.14388) 2818 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:46.679 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:46 smithi179 bash[23186]: cluster 2024-09-20T23:19:45.094837+0000 mgr.a (mgr.14388) 2818 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:46 smithi044 bash[22676]: cluster 2024-09-20T23:19:45.094837+0000 mgr.a (mgr.14388) 2818 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:47.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:47.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:47.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:47.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:47.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:48 smithi049 bash[23528]: cluster 2024-09-20T23:19:47.096509+0000 mgr.a (mgr.14388) 2819 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:48 smithi049 bash[23528]: audit 2024-09-20T23:19:47.495601+0000 mgr.a (mgr.14388) 2820 : audit [DBG] from='client.72342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:48 smithi044 bash[22676]: cluster 2024-09-20T23:19:47.096509+0000 mgr.a (mgr.14388) 2819 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:48 smithi044 bash[22676]: audit 2024-09-20T23:19:47.495601+0000 mgr.a (mgr.14388) 2820 : audit [DBG] from='client.72342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:48 smithi179 bash[23186]: cluster 2024-09-20T23:19:47.096509+0000 mgr.a (mgr.14388) 2819 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:48 smithi179 bash[23186]: audit 2024-09-20T23:19:47.495601+0000 mgr.a (mgr.14388) 2820 : audit [DBG] from='client.72342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:50 smithi049 bash[23528]: cluster 2024-09-20T23:19:49.097613+0000 mgr.a (mgr.14388) 2821 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:50 smithi044 bash[22676]: cluster 2024-09-20T23:19:49.097613+0000 mgr.a (mgr.14388) 2821 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:50 smithi179 bash[23186]: cluster 2024-09-20T23:19:49.097613+0000 mgr.a (mgr.14388) 2821 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:52 smithi044 bash[22676]: cluster 2024-09-20T23:19:51.099911+0000 mgr.a (mgr.14388) 2822 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:19:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:52 smithi179 bash[23186]: cluster 2024-09-20T23:19:51.099911+0000 mgr.a (mgr.14388) 2822 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:19:52.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:52 smithi049 bash[23528]: cluster 2024-09-20T23:19:51.099911+0000 mgr.a (mgr.14388) 2822 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:19:52.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:52.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:52.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:53.722 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:53.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:53.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:53.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:53.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:19:54.566 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:54 smithi049 bash[23528]: cluster 2024-09-20T23:19:53.100654+0000 mgr.a (mgr.14388) 2823 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:54.567 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:54 smithi049 bash[23528]: audit 2024-09-20T23:19:53.289347+0000 mgr.a (mgr.14388) 2824 : audit [DBG] from='client.72417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:54 smithi044 bash[22676]: cluster 2024-09-20T23:19:53.100654+0000 mgr.a (mgr.14388) 2823 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:54 smithi044 bash[22676]: audit 2024-09-20T23:19:53.289347+0000 mgr.a (mgr.14388) 2824 : audit [DBG] from='client.72417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:54 smithi179 bash[23186]: cluster 2024-09-20T23:19:53.100654+0000 mgr.a (mgr.14388) 2823 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:19:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:54 smithi179 bash[23186]: audit 2024-09-20T23:19:53.289347+0000 mgr.a (mgr.14388) 2824 : audit [DBG] from='client.72417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:19:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.025823+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.036039+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.047861+0000 mon.a (mon.0) 2938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: cluster 2024-09-20T23:19:55.102188+0000 mgr.a (mgr.14388) 2825 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.505723+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.515331+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.526494+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.614319+0000 mon.a (mon.0) 2942 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.621228+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.623291+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.635600+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.641858+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:19:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:56 smithi049 bash[23528]: audit 2024-09-20T23:19:55.644281+0000 mgr.a (mgr.14388) 2826 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:19:56.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.025823+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.036039+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.047861+0000 mon.a (mon.0) 2938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: cluster 2024-09-20T23:19:55.102188+0000 mgr.a (mgr.14388) 2825 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:56.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.505723+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.515331+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.526494+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.614319+0000 mon.a (mon.0) 2942 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:19:56.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.621228+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:56.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.623291+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:56.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.635600+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.641858+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:19:56.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22676]: audit 2024-09-20T23:19:55.644281+0000 mgr.a (mgr.14388) 2826 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:19:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.025823+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.036039+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.047861+0000 mon.a (mon.0) 2938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: cluster 2024-09-20T23:19:55.102188+0000 mgr.a (mgr.14388) 2825 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.505723+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.515331+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.526494+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.614319+0000 mon.a (mon.0) 2942 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.621228+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:19:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.623291+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:19:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.635600+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.641858+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:19:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:56 smithi179 bash[23186]: audit 2024-09-20T23:19:55.644281+0000 mgr.a (mgr.14388) 2826 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:19:56.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22930]: debug 2024-09-20T23:19:56.407+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:19:56.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:19:56 smithi044 bash[22930]: debug 2024-09-20T23:19:56.407+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:19:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:57 smithi049 bash[23528]: audit 2024-09-20T23:19:56.410473+0000 mgr.a (mgr.14388) 2827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:19:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:57 smithi049 bash[23528]: cephadm 2024-09-20T23:19:56.411751+0000 mgr.a (mgr.14388) 2828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:19:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:57 smithi044 bash[22676]: audit 2024-09-20T23:19:56.410473+0000 mgr.a (mgr.14388) 2827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:19:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:57 smithi044 bash[22676]: cephadm 2024-09-20T23:19:56.411751+0000 mgr.a (mgr.14388) 2828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:19:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:57 smithi179 bash[23186]: audit 2024-09-20T23:19:56.410473+0000 mgr.a (mgr.14388) 2827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:19:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:57 smithi179 bash[23186]: cephadm 2024-09-20T23:19:56.411751+0000 mgr.a (mgr.14388) 2828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:19:58.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:19:58.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:19:58.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:19:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:58 smithi044 bash[22676]: cluster 2024-09-20T23:19:57.104503+0000 mgr.a (mgr.14388) 2829 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:58 smithi044 bash[22676]: audit 2024-09-20T23:19:57.498495+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:58 smithi044 bash[22676]: audit 2024-09-20T23:19:57.506907+0000 mon.a (mon.0) 2948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:19:58 smithi044 bash[22676]: audit 2024-09-20T23:19:57.517159+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:58 smithi179 bash[23186]: cluster 2024-09-20T23:19:57.104503+0000 mgr.a (mgr.14388) 2829 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:58.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:58 smithi179 bash[23186]: audit 2024-09-20T23:19:57.498495+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:58 smithi179 bash[23186]: audit 2024-09-20T23:19:57.506907+0000 mon.a (mon.0) 2948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:19:58 smithi179 bash[23186]: audit 2024-09-20T23:19:57.517159+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:58 smithi049 bash[23528]: cluster 2024-09-20T23:19:57.104503+0000 mgr.a (mgr.14388) 2829 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:19:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:58 smithi049 bash[23528]: audit 2024-09-20T23:19:57.498495+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:58 smithi049 bash[23528]: audit 2024-09-20T23:19:57.506907+0000 mon.a (mon.0) 2948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:19:58 smithi049 bash[23528]: audit 2024-09-20T23:19:57.517159+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:19:59.509 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:19:59.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:19:59.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:19:59.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:19:59.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:00 smithi179 bash[23186]: audit 2024-09-20T23:19:59.058888+0000 mgr.a (mgr.14388) 2830 : audit [DBG] from='client.72603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:00 smithi179 bash[23186]: cluster 2024-09-20T23:19:59.105750+0000 mgr.a (mgr.14388) 2831 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:00 smithi179 bash[23186]: cluster 2024-09-20T23:20:00.000160+0000 mon.a (mon.0) 2950 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:20:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:00 smithi049 bash[23528]: audit 2024-09-20T23:19:59.058888+0000 mgr.a (mgr.14388) 2830 : audit [DBG] from='client.72603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:00 smithi049 bash[23528]: cluster 2024-09-20T23:19:59.105750+0000 mgr.a (mgr.14388) 2831 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:00 smithi049 bash[23528]: cluster 2024-09-20T23:20:00.000160+0000 mon.a (mon.0) 2950 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:20:00.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:00 smithi044 bash[22676]: audit 2024-09-20T23:19:59.058888+0000 mgr.a (mgr.14388) 2830 : audit [DBG] from='client.72603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:00.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:00 smithi044 bash[22676]: cluster 2024-09-20T23:19:59.105750+0000 mgr.a (mgr.14388) 2831 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:00.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:00 smithi044 bash[22676]: cluster 2024-09-20T23:20:00.000160+0000 mon.a (mon.0) 2950 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:20:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:02 smithi049 bash[23528]: cluster 2024-09-20T23:20:01.107369+0000 mgr.a (mgr.14388) 2832 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:02 smithi044 bash[22676]: cluster 2024-09-20T23:20:01.107369+0000 mgr.a (mgr.14388) 2832 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:02 smithi179 bash[23186]: cluster 2024-09-20T23:20:01.107369+0000 mgr.a (mgr.14388) 2832 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:04.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:04.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:04.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:04 smithi179 bash[23186]: cluster 2024-09-20T23:20:03.108098+0000 mgr.a (mgr.14388) 2833 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:04 smithi049 bash[23528]: cluster 2024-09-20T23:20:03.108098+0000 mgr.a (mgr.14388) 2833 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:04 smithi044 bash[22676]: cluster 2024-09-20T23:20:03.108098+0000 mgr.a (mgr.14388) 2833 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:05.292 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:05.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:06 smithi049 bash[23528]: audit 2024-09-20T23:20:04.850080+0000 mgr.a (mgr.14388) 2834 : audit [DBG] from='client.72681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:06 smithi049 bash[23528]: cluster 2024-09-20T23:20:05.109376+0000 mgr.a (mgr.14388) 2835 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:06.934 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:06 smithi179 bash[23186]: audit 2024-09-20T23:20:04.850080+0000 mgr.a (mgr.14388) 2834 : audit [DBG] from='client.72681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:06.934 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:06 smithi179 bash[23186]: cluster 2024-09-20T23:20:05.109376+0000 mgr.a (mgr.14388) 2835 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:06 smithi044 bash[22676]: audit 2024-09-20T23:20:04.850080+0000 mgr.a (mgr.14388) 2834 : audit [DBG] from='client.72681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:06 smithi044 bash[22676]: cluster 2024-09-20T23:20:05.109376+0000 mgr.a (mgr.14388) 2835 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:08 smithi049 bash[23528]: cluster 2024-09-20T23:20:07.111757+0000 mgr.a (mgr.14388) 2836 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:08 smithi044 bash[22676]: cluster 2024-09-20T23:20:07.111757+0000 mgr.a (mgr.14388) 2836 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:08 smithi179 bash[23186]: cluster 2024-09-20T23:20:07.111757+0000 mgr.a (mgr.14388) 2836 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:10.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:10.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:10.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:10 smithi044 bash[22676]: cluster 2024-09-20T23:20:09.112786+0000 mgr.a (mgr.14388) 2837 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:20:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:10 smithi049 bash[23528]: cluster 2024-09-20T23:20:09.112786+0000 mgr.a (mgr.14388) 2837 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:20:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:10 smithi179 bash[23186]: cluster 2024-09-20T23:20:09.112786+0000 mgr.a (mgr.14388) 2837 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:20:11.062 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:11 smithi049 bash[23528]: audit 2024-09-20T23:20:10.632579+0000 mgr.a (mgr.14388) 2838 : audit [DBG] from='client.72759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:11 smithi044 bash[22676]: audit 2024-09-20T23:20:10.632579+0000 mgr.a (mgr.14388) 2838 : audit [DBG] from='client.72759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:11 smithi179 bash[23186]: audit 2024-09-20T23:20:10.632579+0000 mgr.a (mgr.14388) 2838 : audit [DBG] from='client.72759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:12 smithi049 bash[23528]: cluster 2024-09-20T23:20:11.114087+0000 mgr.a (mgr.14388) 2839 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:12 smithi044 bash[22676]: cluster 2024-09-20T23:20:11.114087+0000 mgr.a (mgr.14388) 2839 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:12 smithi179 bash[23186]: cluster 2024-09-20T23:20:11.114087+0000 mgr.a (mgr.14388) 2839 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:20:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:14 smithi049 bash[23528]: cluster 2024-09-20T23:20:13.114928+0000 mgr.a (mgr.14388) 2840 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:20:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:14 smithi044 bash[22676]: cluster 2024-09-20T23:20:13.114928+0000 mgr.a (mgr.14388) 2840 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:20:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:14 smithi179 bash[23186]: cluster 2024-09-20T23:20:13.114928+0000 mgr.a (mgr.14388) 2840 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:20:16.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:16.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:16 smithi044 bash[22676]: cluster 2024-09-20T23:20:15.116205+0000 mgr.a (mgr.14388) 2841 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:20:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:16 smithi044 bash[22676]: audit 2024-09-20T23:20:15.215513+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:16 smithi044 bash[22676]: audit 2024-09-20T23:20:15.225405+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:16 smithi044 bash[22676]: audit 2024-09-20T23:20:15.237268+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:16 smithi044 bash[22676]: audit 2024-09-20T23:20:15.738039+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:16 smithi044 bash[22676]: audit 2024-09-20T23:20:15.747807+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:16 smithi044 bash[22676]: audit 2024-09-20T23:20:15.759224+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.490 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:16 smithi049 bash[23528]: cluster 2024-09-20T23:20:15.116205+0000 mgr.a (mgr.14388) 2841 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:20:16.490 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:16 smithi049 bash[23528]: audit 2024-09-20T23:20:15.215513+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:16 smithi049 bash[23528]: audit 2024-09-20T23:20:15.225405+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:16 smithi049 bash[23528]: audit 2024-09-20T23:20:15.237268+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:16 smithi049 bash[23528]: audit 2024-09-20T23:20:15.738039+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:16 smithi049 bash[23528]: audit 2024-09-20T23:20:15.747807+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.491 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:16 smithi049 bash[23528]: audit 2024-09-20T23:20:15.759224+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:16 smithi179 bash[23186]: cluster 2024-09-20T23:20:15.116205+0000 mgr.a (mgr.14388) 2841 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:20:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:16 smithi179 bash[23186]: audit 2024-09-20T23:20:15.215513+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:16 smithi179 bash[23186]: audit 2024-09-20T23:20:15.225405+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:16 smithi179 bash[23186]: audit 2024-09-20T23:20:15.237268+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:16 smithi179 bash[23186]: audit 2024-09-20T23:20:15.738039+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:16 smithi179 bash[23186]: audit 2024-09-20T23:20:15.747807+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:16 smithi179 bash[23186]: audit 2024-09-20T23:20:15.759224+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:16.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:16.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:16.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:16.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:16.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:17 smithi044 bash[22676]: audit 2024-09-20T23:20:16.404784+0000 mgr.a (mgr.14388) 2842 : audit [DBG] from='client.72837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:17.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:17 smithi179 bash[23186]: audit 2024-09-20T23:20:16.404784+0000 mgr.a (mgr.14388) 2842 : audit [DBG] from='client.72837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:17 smithi049 bash[23528]: audit 2024-09-20T23:20:16.404784+0000 mgr.a (mgr.14388) 2842 : audit [DBG] from='client.72837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:18 smithi044 bash[22676]: cluster 2024-09-20T23:20:17.118488+0000 mgr.a (mgr.14388) 2843 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:18 smithi044 bash[22676]: audit 2024-09-20T23:20:17.696002+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:18 smithi044 bash[22676]: audit 2024-09-20T23:20:17.702698+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:18 smithi044 bash[22676]: audit 2024-09-20T23:20:17.710163+0000 mon.a (mon.0) 2959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:18 smithi179 bash[23186]: cluster 2024-09-20T23:20:17.118488+0000 mgr.a (mgr.14388) 2843 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:18 smithi179 bash[23186]: audit 2024-09-20T23:20:17.696002+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:18 smithi179 bash[23186]: audit 2024-09-20T23:20:17.702698+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:18 smithi179 bash[23186]: audit 2024-09-20T23:20:17.710163+0000 mon.a (mon.0) 2959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:18 smithi049 bash[23528]: cluster 2024-09-20T23:20:17.118488+0000 mgr.a (mgr.14388) 2843 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:18 smithi049 bash[23528]: audit 2024-09-20T23:20:17.696002+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:18 smithi049 bash[23528]: audit 2024-09-20T23:20:17.702698+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:18 smithi049 bash[23528]: audit 2024-09-20T23:20:17.710163+0000 mon.a (mon.0) 2959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:20 smithi044 bash[22676]: cluster 2024-09-20T23:20:19.119407+0000 mgr.a (mgr.14388) 2844 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:20:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:20 smithi179 bash[23186]: cluster 2024-09-20T23:20:19.119407+0000 mgr.a (mgr.14388) 2844 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:20:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:20 smithi049 bash[23528]: cluster 2024-09-20T23:20:19.119407+0000 mgr.a (mgr.14388) 2844 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:20:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:22.590 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:22.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:22.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:22.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:22.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:22 smithi044 bash[22676]: cluster 2024-09-20T23:20:21.121509+0000 mgr.a (mgr.14388) 2845 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:20:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:22 smithi179 bash[23186]: cluster 2024-09-20T23:20:21.121509+0000 mgr.a (mgr.14388) 2845 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:20:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:22 smithi049 bash[23528]: cluster 2024-09-20T23:20:21.121509+0000 mgr.a (mgr.14388) 2845 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:20:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:23 smithi044 bash[22676]: audit 2024-09-20T23:20:22.164484+0000 mgr.a (mgr.14388) 2846 : audit [DBG] from='client.72915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:23 smithi179 bash[23186]: audit 2024-09-20T23:20:22.164484+0000 mgr.a (mgr.14388) 2846 : audit [DBG] from='client.72915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:23 smithi049 bash[23528]: audit 2024-09-20T23:20:22.164484+0000 mgr.a (mgr.14388) 2846 : audit [DBG] from='client.72915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:24 smithi044 bash[22676]: cluster 2024-09-20T23:20:23.122386+0000 mgr.a (mgr.14388) 2847 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:24 smithi179 bash[23186]: cluster 2024-09-20T23:20:23.122386+0000 mgr.a (mgr.14388) 2847 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:24 smithi049 bash[23528]: cluster 2024-09-20T23:20:23.122386+0000 mgr.a (mgr.14388) 2847 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:25 smithi049 bash[23528]: cluster 2024-09-20T23:20:25.123759+0000 mgr.a (mgr.14388) 2848 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:20:26.164 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:25 smithi179 bash[23186]: cluster 2024-09-20T23:20:25.123759+0000 mgr.a (mgr.14388) 2848 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:20:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:25 smithi044 bash[22676]: cluster 2024-09-20T23:20:25.123759+0000 mgr.a (mgr.14388) 2848 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:20:27.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:27.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:27.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:28.368 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:28.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:28.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:28.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:28.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:28.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:28 smithi179 bash[23186]: cluster 2024-09-20T23:20:27.125438+0000 mgr.a (mgr.14388) 2849 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:20:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:28 smithi044 bash[22676]: cluster 2024-09-20T23:20:27.125438+0000 mgr.a (mgr.14388) 2849 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:20:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:28 smithi049 bash[23528]: cluster 2024-09-20T23:20:27.125438+0000 mgr.a (mgr.14388) 2849 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:20:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:29 smithi044 bash[22676]: audit 2024-09-20T23:20:27.936203+0000 mgr.a (mgr.14388) 2850 : audit [DBG] from='client.72990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:29 smithi179 bash[23186]: audit 2024-09-20T23:20:27.936203+0000 mgr.a (mgr.14388) 2850 : audit [DBG] from='client.72990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:29 smithi049 bash[23528]: audit 2024-09-20T23:20:27.936203+0000 mgr.a (mgr.14388) 2850 : audit [DBG] from='client.72990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:30 smithi044 bash[22676]: cluster 2024-09-20T23:20:29.126336+0000 mgr.a (mgr.14388) 2851 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:30 smithi179 bash[23186]: cluster 2024-09-20T23:20:29.126336+0000 mgr.a (mgr.14388) 2851 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:30 smithi049 bash[23528]: cluster 2024-09-20T23:20:29.126336+0000 mgr.a (mgr.14388) 2851 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:32 smithi044 bash[22676]: cluster 2024-09-20T23:20:31.128625+0000 mgr.a (mgr.14388) 2852 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:20:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:32 smithi179 bash[23186]: cluster 2024-09-20T23:20:31.128625+0000 mgr.a (mgr.14388) 2852 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:20:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:32 smithi049 bash[23528]: cluster 2024-09-20T23:20:31.128625+0000 mgr.a (mgr.14388) 2852 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:20:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:33.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:33.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:34.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:34.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:34.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:34.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:34.119 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:34 smithi044 bash[22676]: cluster 2024-09-20T23:20:33.129419+0000 mgr.a (mgr.14388) 2853 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:34 smithi044 bash[22676]: audit 2024-09-20T23:20:33.703252+0000 mgr.a (mgr.14388) 2854 : audit [DBG] from='client.73068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:34 smithi179 bash[23186]: cluster 2024-09-20T23:20:33.129419+0000 mgr.a (mgr.14388) 2853 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:34 smithi179 bash[23186]: audit 2024-09-20T23:20:33.703252+0000 mgr.a (mgr.14388) 2854 : audit [DBG] from='client.73068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:34 smithi049 bash[23528]: cluster 2024-09-20T23:20:33.129419+0000 mgr.a (mgr.14388) 2853 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:34 smithi049 bash[23528]: audit 2024-09-20T23:20:33.703252+0000 mgr.a (mgr.14388) 2854 : audit [DBG] from='client.73068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:36 smithi044 bash[22676]: cluster 2024-09-20T23:20:35.130869+0000 mgr.a (mgr.14388) 2855 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:20:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:36 smithi044 bash[22676]: audit 2024-09-20T23:20:35.458136+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:36 smithi044 bash[22676]: audit 2024-09-20T23:20:35.468221+0000 mon.a (mon.0) 2961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:36 smithi044 bash[22676]: audit 2024-09-20T23:20:35.479858+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:36 smithi044 bash[22676]: audit 2024-09-20T23:20:35.970213+0000 mon.a (mon.0) 2963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:36 smithi044 bash[22676]: audit 2024-09-20T23:20:35.978877+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:36 smithi044 bash[22676]: audit 2024-09-20T23:20:35.989078+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:36 smithi179 bash[23186]: cluster 2024-09-20T23:20:35.130869+0000 mgr.a (mgr.14388) 2855 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:20:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:36 smithi179 bash[23186]: audit 2024-09-20T23:20:35.458136+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:36 smithi179 bash[23186]: audit 2024-09-20T23:20:35.468221+0000 mon.a (mon.0) 2961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:36 smithi179 bash[23186]: audit 2024-09-20T23:20:35.479858+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:36 smithi179 bash[23186]: audit 2024-09-20T23:20:35.970213+0000 mon.a (mon.0) 2963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:36 smithi179 bash[23186]: audit 2024-09-20T23:20:35.978877+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:36 smithi179 bash[23186]: audit 2024-09-20T23:20:35.989078+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:36 smithi049 bash[23528]: cluster 2024-09-20T23:20:35.130869+0000 mgr.a (mgr.14388) 2855 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:20:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:36 smithi049 bash[23528]: audit 2024-09-20T23:20:35.458136+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:36 smithi049 bash[23528]: audit 2024-09-20T23:20:35.468221+0000 mon.a (mon.0) 2961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:36 smithi049 bash[23528]: audit 2024-09-20T23:20:35.479858+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:36 smithi049 bash[23528]: audit 2024-09-20T23:20:35.970213+0000 mon.a (mon.0) 2963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:36 smithi049 bash[23528]: audit 2024-09-20T23:20:35.978877+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:36 smithi049 bash[23528]: audit 2024-09-20T23:20:35.989078+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:38 smithi044 bash[22676]: cluster 2024-09-20T23:20:37.132521+0000 mgr.a (mgr.14388) 2856 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:20:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:38 smithi044 bash[22676]: audit 2024-09-20T23:20:37.929869+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:38 smithi044 bash[22676]: audit 2024-09-20T23:20:37.938890+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:38 smithi044 bash[22676]: audit 2024-09-20T23:20:37.948938+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:38 smithi179 bash[23186]: cluster 2024-09-20T23:20:37.132521+0000 mgr.a (mgr.14388) 2856 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:20:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:38 smithi179 bash[23186]: audit 2024-09-20T23:20:37.929869+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:38 smithi179 bash[23186]: audit 2024-09-20T23:20:37.938890+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:38 smithi179 bash[23186]: audit 2024-09-20T23:20:37.948938+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:38 smithi049 bash[23528]: cluster 2024-09-20T23:20:37.132521+0000 mgr.a (mgr.14388) 2856 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:20:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:38 smithi049 bash[23528]: audit 2024-09-20T23:20:37.929869+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:38 smithi049 bash[23528]: audit 2024-09-20T23:20:37.938890+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:38 smithi049 bash[23528]: audit 2024-09-20T23:20:37.948938+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:39.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:39.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:39.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:39.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:39.900 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:40 smithi044 bash[22676]: cluster 2024-09-20T23:20:39.133269+0000 mgr.a (mgr.14388) 2857 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:40 smithi044 bash[22676]: audit 2024-09-20T23:20:39.458792+0000 mgr.a (mgr.14388) 2858 : audit [DBG] from='client.73146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:40 smithi179 bash[23186]: cluster 2024-09-20T23:20:39.133269+0000 mgr.a (mgr.14388) 2857 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:40 smithi179 bash[23186]: audit 2024-09-20T23:20:39.458792+0000 mgr.a (mgr.14388) 2858 : audit [DBG] from='client.73146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:40 smithi049 bash[23528]: cluster 2024-09-20T23:20:39.133269+0000 mgr.a (mgr.14388) 2857 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:40 smithi049 bash[23528]: audit 2024-09-20T23:20:39.458792+0000 mgr.a (mgr.14388) 2858 : audit [DBG] from='client.73146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:42 smithi044 bash[22676]: cluster 2024-09-20T23:20:41.134630+0000 mgr.a (mgr.14388) 2859 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:20:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:42 smithi179 bash[23186]: cluster 2024-09-20T23:20:41.134630+0000 mgr.a (mgr.14388) 2859 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:20:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:42 smithi049 bash[23528]: cluster 2024-09-20T23:20:41.134630+0000 mgr.a (mgr.14388) 2859 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:20:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:44 smithi044 bash[22676]: cluster 2024-09-20T23:20:43.135422+0000 mgr.a (mgr.14388) 2860 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:44 smithi179 bash[23186]: cluster 2024-09-20T23:20:43.135422+0000 mgr.a (mgr.14388) 2860 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:44 smithi049 bash[23528]: cluster 2024-09-20T23:20:43.135422+0000 mgr.a (mgr.14388) 2860 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:44.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:44.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:44.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:45.671 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:45.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:45.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:45.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:45.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:46 smithi044 bash[22676]: cluster 2024-09-20T23:20:45.136600+0000 mgr.a (mgr.14388) 2861 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:46 smithi044 bash[22676]: audit 2024-09-20T23:20:45.237889+0000 mgr.a (mgr.14388) 2862 : audit [DBG] from='client.73221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:46 smithi179 bash[23186]: cluster 2024-09-20T23:20:45.136600+0000 mgr.a (mgr.14388) 2861 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:46 smithi179 bash[23186]: audit 2024-09-20T23:20:45.237889+0000 mgr.a (mgr.14388) 2862 : audit [DBG] from='client.73221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:46 smithi049 bash[23528]: cluster 2024-09-20T23:20:45.136600+0000 mgr.a (mgr.14388) 2861 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:46 smithi049 bash[23528]: audit 2024-09-20T23:20:45.237889+0000 mgr.a (mgr.14388) 2862 : audit [DBG] from='client.73221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:48 smithi044 bash[22676]: cluster 2024-09-20T23:20:47.138823+0000 mgr.a (mgr.14388) 2863 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:20:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:48 smithi179 bash[23186]: cluster 2024-09-20T23:20:47.138823+0000 mgr.a (mgr.14388) 2863 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:20:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:48 smithi049 bash[23528]: cluster 2024-09-20T23:20:47.138823+0000 mgr.a (mgr.14388) 2863 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:20:50.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:50 smithi179 bash[23186]: cluster 2024-09-20T23:20:49.139618+0000 mgr.a (mgr.14388) 2864 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:20:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:50 smithi049 bash[23528]: cluster 2024-09-20T23:20:49.139618+0000 mgr.a (mgr.14388) 2864 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:20:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:50 smithi044 bash[22676]: cluster 2024-09-20T23:20:49.139618+0000 mgr.a (mgr.14388) 2864 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:20:51.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:51.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:51.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:51.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:51.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:52 smithi179 bash[23186]: audit 2024-09-20T23:20:51.008076+0000 mgr.a (mgr.14388) 2865 : audit [DBG] from='client.73296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:52 smithi179 bash[23186]: cluster 2024-09-20T23:20:51.151600+0000 mgr.a (mgr.14388) 2866 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:52 smithi049 bash[23528]: audit 2024-09-20T23:20:51.008076+0000 mgr.a (mgr.14388) 2865 : audit [DBG] from='client.73296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:52 smithi049 bash[23528]: cluster 2024-09-20T23:20:51.151600+0000 mgr.a (mgr.14388) 2866 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:52 smithi044 bash[22676]: audit 2024-09-20T23:20:51.008076+0000 mgr.a (mgr.14388) 2865 : audit [DBG] from='client.73296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:52 smithi044 bash[22676]: cluster 2024-09-20T23:20:51.151600+0000 mgr.a (mgr.14388) 2866 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:54 smithi179 bash[23186]: cluster 2024-09-20T23:20:53.152518+0000 mgr.a (mgr.14388) 2867 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:20:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:54 smithi049 bash[23528]: cluster 2024-09-20T23:20:53.152518+0000 mgr.a (mgr.14388) 2867 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:20:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:54 smithi044 bash[22676]: cluster 2024-09-20T23:20:53.152518+0000 mgr.a (mgr.14388) 2867 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:20:56.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:20:56.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:20:56.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:20:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: cluster 2024-09-20T23:20:55.154734+0000 mgr.a (mgr.14388) 2868 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: audit 2024-09-20T23:20:55.665654+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: audit 2024-09-20T23:20:55.675868+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: audit 2024-09-20T23:20:55.687709+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: audit 2024-09-20T23:20:56.199899+0000 mon.a (mon.0) 2972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: audit 2024-09-20T23:20:56.208883+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: audit 2024-09-20T23:20:56.219441+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:56 smithi044 bash[22676]: audit 2024-09-20T23:20:56.476848+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: cluster 2024-09-20T23:20:55.154734+0000 mgr.a (mgr.14388) 2868 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: audit 2024-09-20T23:20:55.665654+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: audit 2024-09-20T23:20:55.675868+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: audit 2024-09-20T23:20:55.687709+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: audit 2024-09-20T23:20:56.199899+0000 mon.a (mon.0) 2972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: audit 2024-09-20T23:20:56.208883+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: audit 2024-09-20T23:20:56.219441+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:56 smithi179 bash[23186]: audit 2024-09-20T23:20:56.476848+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: cluster 2024-09-20T23:20:55.154734+0000 mgr.a (mgr.14388) 2868 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: audit 2024-09-20T23:20:55.665654+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: audit 2024-09-20T23:20:55.675868+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: audit 2024-09-20T23:20:55.687709+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: audit 2024-09-20T23:20:56.199899+0000 mon.a (mon.0) 2972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: audit 2024-09-20T23:20:56.208883+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: audit 2024-09-20T23:20:56.219441+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:56 smithi049 bash[23528]: audit 2024-09-20T23:20:56.476848+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:20:57.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:20:57.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:20:57.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:20:57.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:20:57.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:20:58.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:20:57 smithi044 bash[22930]: debug 2024-09-20T23:20:57.934+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:20:57 smithi044 bash[22930]: debug 2024-09-20T23:20:57.934+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:56.797757+0000 mgr.a (mgr.14388) 2869 : audit [DBG] from='client.73368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.081734+0000 mon.a (mon.0) 2976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.087247+0000 mon.a (mon.0) 2977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.099697+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.104654+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.106178+0000 mon.a (mon.0) 2980 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.107022+0000 mon.a (mon.0) 2981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.116259+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.119346+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:20:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: audit 2024-09-20T23:20:57.120547+0000 mgr.a (mgr.14388) 2870 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:20:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:58 smithi044 bash[22676]: cluster 2024-09-20T23:20:57.155251+0000 mgr.a (mgr.14388) 2871 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:56.797757+0000 mgr.a (mgr.14388) 2869 : audit [DBG] from='client.73368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.081734+0000 mon.a (mon.0) 2976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.087247+0000 mon.a (mon.0) 2977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.099697+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.104654+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.106178+0000 mon.a (mon.0) 2980 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.107022+0000 mon.a (mon.0) 2981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.116259+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.119346+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:20:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: audit 2024-09-20T23:20:57.120547+0000 mgr.a (mgr.14388) 2870 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:20:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:58 smithi179 bash[23186]: cluster 2024-09-20T23:20:57.155251+0000 mgr.a (mgr.14388) 2871 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:56.797757+0000 mgr.a (mgr.14388) 2869 : audit [DBG] from='client.73368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:20:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.081734+0000 mon.a (mon.0) 2976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.087247+0000 mon.a (mon.0) 2977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.099697+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.104654+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.106178+0000 mon.a (mon.0) 2980 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:20:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.107022+0000 mon.a (mon.0) 2981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:20:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.116259+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.119346+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:20:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: audit 2024-09-20T23:20:57.120547+0000 mgr.a (mgr.14388) 2870 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:20:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:58 smithi049 bash[23528]: cluster 2024-09-20T23:20:57.155251+0000 mgr.a (mgr.14388) 2871 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:20:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:59 smithi044 bash[22676]: audit 2024-09-20T23:20:57.938599+0000 mgr.a (mgr.14388) 2872 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:20:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:59 smithi044 bash[22676]: cephadm 2024-09-20T23:20:57.939996+0000 mgr.a (mgr.14388) 2873 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:20:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:59 smithi044 bash[22676]: audit 2024-09-20T23:20:58.124047+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:59 smithi044 bash[22676]: audit 2024-09-20T23:20:58.129195+0000 mon.a (mon.0) 2985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:20:59 smithi044 bash[22676]: audit 2024-09-20T23:20:58.138205+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:59 smithi179 bash[23186]: audit 2024-09-20T23:20:57.938599+0000 mgr.a (mgr.14388) 2872 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:20:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:59 smithi179 bash[23186]: cephadm 2024-09-20T23:20:57.939996+0000 mgr.a (mgr.14388) 2873 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:20:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:59 smithi179 bash[23186]: audit 2024-09-20T23:20:58.124047+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:59 smithi179 bash[23186]: audit 2024-09-20T23:20:58.129195+0000 mon.a (mon.0) 2985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:20:59 smithi179 bash[23186]: audit 2024-09-20T23:20:58.138205+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:59 smithi049 bash[23528]: audit 2024-09-20T23:20:57.938599+0000 mgr.a (mgr.14388) 2872 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:20:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:59 smithi049 bash[23528]: cephadm 2024-09-20T23:20:57.939996+0000 mgr.a (mgr.14388) 2873 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:20:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:59 smithi049 bash[23528]: audit 2024-09-20T23:20:58.124047+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:59 smithi049 bash[23528]: audit 2024-09-20T23:20:58.129195+0000 mon.a (mon.0) 2985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:20:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:20:59 smithi049 bash[23528]: audit 2024-09-20T23:20:58.138205+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:00 smithi044 bash[22676]: cluster 2024-09-20T23:20:59.156260+0000 mgr.a (mgr.14388) 2874 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:00 smithi179 bash[23186]: cluster 2024-09-20T23:20:59.156260+0000 mgr.a (mgr.14388) 2874 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:00 smithi049 bash[23528]: cluster 2024-09-20T23:20:59.156260+0000 mgr.a (mgr.14388) 2874 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:02.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:02.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:02.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:02 smithi044 bash[22676]: cluster 2024-09-20T23:21:01.158904+0000 mgr.a (mgr.14388) 2875 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:02 smithi179 bash[23186]: cluster 2024-09-20T23:21:01.158904+0000 mgr.a (mgr.14388) 2875 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:02 smithi049 bash[23528]: cluster 2024-09-20T23:21:01.158904+0000 mgr.a (mgr.14388) 2875 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:03.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:03.016 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:03 smithi044 bash[22676]: audit 2024-09-20T23:21:02.589054+0000 mgr.a (mgr.14388) 2876 : audit [DBG] from='client.73551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:03 smithi179 bash[23186]: audit 2024-09-20T23:21:02.589054+0000 mgr.a (mgr.14388) 2876 : audit [DBG] from='client.73551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:03 smithi049 bash[23528]: audit 2024-09-20T23:21:02.589054+0000 mgr.a (mgr.14388) 2876 : audit [DBG] from='client.73551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:04 smithi044 bash[22676]: cluster 2024-09-20T23:21:03.159793+0000 mgr.a (mgr.14388) 2877 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:21:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:04 smithi179 bash[23186]: cluster 2024-09-20T23:21:03.159793+0000 mgr.a (mgr.14388) 2877 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:21:04.574 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:04 smithi049 bash[23528]: cluster 2024-09-20T23:21:03.159793+0000 mgr.a (mgr.14388) 2877 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:21:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:06 smithi044 bash[22676]: cluster 2024-09-20T23:21:05.162009+0000 mgr.a (mgr.14388) 2878 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:06 smithi179 bash[23186]: cluster 2024-09-20T23:21:05.162009+0000 mgr.a (mgr.14388) 2878 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:06 smithi049 bash[23528]: cluster 2024-09-20T23:21:05.162009+0000 mgr.a (mgr.14388) 2878 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:08.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:08.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:08.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:08 smithi179 bash[23186]: cluster 2024-09-20T23:21:07.162795+0000 mgr.a (mgr.14388) 2879 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:08 smithi044 bash[22676]: cluster 2024-09-20T23:21:07.162795+0000 mgr.a (mgr.14388) 2879 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:08 smithi049 bash[23528]: cluster 2024-09-20T23:21:07.162795+0000 mgr.a (mgr.14388) 2879 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:08.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:09 smithi044 bash[22676]: audit 2024-09-20T23:21:08.358804+0000 mgr.a (mgr.14388) 2880 : audit [DBG] from='client.46348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:09 smithi179 bash[23186]: audit 2024-09-20T23:21:08.358804+0000 mgr.a (mgr.14388) 2880 : audit [DBG] from='client.46348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:09 smithi049 bash[23528]: audit 2024-09-20T23:21:08.358804+0000 mgr.a (mgr.14388) 2880 : audit [DBG] from='client.46348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:10.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:10 smithi179 bash[23186]: cluster 2024-09-20T23:21:09.163794+0000 mgr.a (mgr.14388) 2881 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:10 smithi049 bash[23528]: cluster 2024-09-20T23:21:09.163794+0000 mgr.a (mgr.14388) 2881 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:10 smithi044 bash[22676]: cluster 2024-09-20T23:21:09.163794+0000 mgr.a (mgr.14388) 2881 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:12 smithi044 bash[22676]: cluster 2024-09-20T23:21:11.166093+0000 mgr.a (mgr.14388) 2882 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:12 smithi179 bash[23186]: cluster 2024-09-20T23:21:11.166093+0000 mgr.a (mgr.14388) 2882 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:12 smithi049 bash[23528]: cluster 2024-09-20T23:21:11.166093+0000 mgr.a (mgr.14388) 2882 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:21:13.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:13.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:13.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:14.439 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:14 smithi049 bash[23528]: cluster 2024-09-20T23:21:13.166916+0000 mgr.a (mgr.14388) 2883 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:14.559 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:14 smithi044 bash[22676]: cluster 2024-09-20T23:21:13.166916+0000 mgr.a (mgr.14388) 2883 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:14 smithi179 bash[23186]: cluster 2024-09-20T23:21:13.166916+0000 mgr.a (mgr.14388) 2883 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:15 smithi049 bash[23528]: audit 2024-09-20T23:21:14.144951+0000 mgr.a (mgr.14388) 2884 : audit [DBG] from='client.73701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:15 smithi044 bash[22676]: audit 2024-09-20T23:21:14.144951+0000 mgr.a (mgr.14388) 2884 : audit [DBG] from='client.73701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:15 smithi179 bash[23186]: audit 2024-09-20T23:21:14.144951+0000 mgr.a (mgr.14388) 2884 : audit [DBG] from='client.73701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:16 smithi049 bash[23528]: cluster 2024-09-20T23:21:15.169273+0000 mgr.a (mgr.14388) 2885 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:16 smithi049 bash[23528]: audit 2024-09-20T23:21:15.845361+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:16 smithi049 bash[23528]: audit 2024-09-20T23:21:15.854471+0000 mon.a (mon.0) 2988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:16 smithi049 bash[23528]: audit 2024-09-20T23:21:15.864983+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:16 smithi044 bash[22676]: cluster 2024-09-20T23:21:15.169273+0000 mgr.a (mgr.14388) 2885 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:16 smithi044 bash[22676]: audit 2024-09-20T23:21:15.845361+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:16 smithi044 bash[22676]: audit 2024-09-20T23:21:15.854471+0000 mon.a (mon.0) 2988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:16 smithi044 bash[22676]: audit 2024-09-20T23:21:15.864983+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:16 smithi179 bash[23186]: cluster 2024-09-20T23:21:15.169273+0000 mgr.a (mgr.14388) 2885 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:16 smithi179 bash[23186]: audit 2024-09-20T23:21:15.845361+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:16 smithi179 bash[23186]: audit 2024-09-20T23:21:15.854471+0000 mon.a (mon.0) 2988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:16 smithi179 bash[23186]: audit 2024-09-20T23:21:15.864983+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:17 smithi044 bash[22676]: audit 2024-09-20T23:21:16.433242+0000 mon.a (mon.0) 2990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:17 smithi044 bash[22676]: audit 2024-09-20T23:21:16.441763+0000 mon.a (mon.0) 2991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:17 smithi044 bash[22676]: audit 2024-09-20T23:21:16.451886+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:17 smithi179 bash[23186]: audit 2024-09-20T23:21:16.433242+0000 mon.a (mon.0) 2990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:17 smithi179 bash[23186]: audit 2024-09-20T23:21:16.441763+0000 mon.a (mon.0) 2991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:17 smithi179 bash[23186]: audit 2024-09-20T23:21:16.451886+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:17 smithi049 bash[23528]: audit 2024-09-20T23:21:16.433242+0000 mon.a (mon.0) 2990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:17 smithi049 bash[23528]: audit 2024-09-20T23:21:16.441763+0000 mon.a (mon.0) 2991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:17 smithi049 bash[23528]: audit 2024-09-20T23:21:16.451886+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:18 smithi044 bash[22676]: cluster 2024-09-20T23:21:17.170089+0000 mgr.a (mgr.14388) 2886 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:18 smithi044 bash[22676]: audit 2024-09-20T23:21:18.342396+0000 mon.a (mon.0) 2993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:18 smithi044 bash[22676]: audit 2024-09-20T23:21:18.351511+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:18 smithi044 bash[22676]: audit 2024-09-20T23:21:18.362524+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:18 smithi179 bash[23186]: cluster 2024-09-20T23:21:17.170089+0000 mgr.a (mgr.14388) 2886 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:18 smithi179 bash[23186]: audit 2024-09-20T23:21:18.342396+0000 mon.a (mon.0) 2993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:18 smithi179 bash[23186]: audit 2024-09-20T23:21:18.351511+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:18 smithi179 bash[23186]: audit 2024-09-20T23:21:18.362524+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:18 smithi049 bash[23528]: cluster 2024-09-20T23:21:17.170089+0000 mgr.a (mgr.14388) 2886 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:18 smithi049 bash[23528]: audit 2024-09-20T23:21:18.342396+0000 mon.a (mon.0) 2993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:18 smithi049 bash[23528]: audit 2024-09-20T23:21:18.351511+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:18 smithi049 bash[23528]: audit 2024-09-20T23:21:18.362524+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:19.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:19.561 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:19.561 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:20.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:20.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:20.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:20.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:20.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:20 smithi044 bash[22676]: cluster 2024-09-20T23:21:19.170897+0000 mgr.a (mgr.14388) 2887 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:20 smithi179 bash[23186]: cluster 2024-09-20T23:21:19.170897+0000 mgr.a (mgr.14388) 2887 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:20 smithi049 bash[23528]: cluster 2024-09-20T23:21:19.170897+0000 mgr.a (mgr.14388) 2887 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:21 smithi044 bash[22676]: audit 2024-09-20T23:21:19.896256+0000 mgr.a (mgr.14388) 2888 : audit [DBG] from='client.73779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:21 smithi179 bash[23186]: audit 2024-09-20T23:21:19.896256+0000 mgr.a (mgr.14388) 2888 : audit [DBG] from='client.73779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:21 smithi049 bash[23528]: audit 2024-09-20T23:21:19.896256+0000 mgr.a (mgr.14388) 2888 : audit [DBG] from='client.73779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:22 smithi044 bash[22676]: cluster 2024-09-20T23:21:21.173799+0000 mgr.a (mgr.14388) 2889 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:21:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:22 smithi179 bash[23186]: cluster 2024-09-20T23:21:21.173799+0000 mgr.a (mgr.14388) 2889 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:21:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:22 smithi049 bash[23528]: cluster 2024-09-20T23:21:21.173799+0000 mgr.a (mgr.14388) 2889 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:21:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:24 smithi044 bash[22676]: cluster 2024-09-20T23:21:23.174537+0000 mgr.a (mgr.14388) 2890 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:24 smithi179 bash[23186]: cluster 2024-09-20T23:21:23.174537+0000 mgr.a (mgr.14388) 2890 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:24 smithi049 bash[23528]: cluster 2024-09-20T23:21:23.174537+0000 mgr.a (mgr.14388) 2890 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:21:25.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:25.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:25.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:26.110 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:26.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:26.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:26.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:26.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:26 smithi044 bash[22676]: cluster 2024-09-20T23:21:25.176467+0000 mgr.a (mgr.14388) 2891 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:26 smithi044 bash[22676]: audit 2024-09-20T23:21:25.662084+0000 mgr.a (mgr.14388) 2892 : audit [DBG] from='client.73857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:26 smithi179 bash[23186]: cluster 2024-09-20T23:21:25.176467+0000 mgr.a (mgr.14388) 2891 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:26 smithi179 bash[23186]: audit 2024-09-20T23:21:25.662084+0000 mgr.a (mgr.14388) 2892 : audit [DBG] from='client.73857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:26 smithi049 bash[23528]: cluster 2024-09-20T23:21:25.176467+0000 mgr.a (mgr.14388) 2891 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:26 smithi049 bash[23528]: audit 2024-09-20T23:21:25.662084+0000 mgr.a (mgr.14388) 2892 : audit [DBG] from='client.73857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:28 smithi179 bash[23186]: cluster 2024-09-20T23:21:27.177473+0000 mgr.a (mgr.14388) 2893 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:21:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:28 smithi044 bash[22676]: cluster 2024-09-20T23:21:27.177473+0000 mgr.a (mgr.14388) 2893 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:21:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:28 smithi049 bash[23528]: cluster 2024-09-20T23:21:27.177473+0000 mgr.a (mgr.14388) 2893 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:21:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:30 smithi044 bash[22676]: cluster 2024-09-20T23:21:29.178242+0000 mgr.a (mgr.14388) 2894 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:21:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:30 smithi179 bash[23186]: cluster 2024-09-20T23:21:29.178242+0000 mgr.a (mgr.14388) 2894 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:21:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:30 smithi049 bash[23528]: cluster 2024-09-20T23:21:29.178242+0000 mgr.a (mgr.14388) 2894 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:21:31.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:31.112 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:31.112 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:31.895 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:31.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:31.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:31.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:31.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:32 smithi179 bash[23186]: cluster 2024-09-20T23:21:31.179650+0000 mgr.a (mgr.14388) 2895 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:32 smithi179 bash[23186]: audit 2024-09-20T23:21:31.449194+0000 mgr.a (mgr.14388) 2896 : audit [DBG] from='client.73935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:32.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:32 smithi044 bash[22676]: cluster 2024-09-20T23:21:31.179650+0000 mgr.a (mgr.14388) 2895 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:32.795 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:32 smithi044 bash[22676]: audit 2024-09-20T23:21:31.449194+0000 mgr.a (mgr.14388) 2896 : audit [DBG] from='client.73935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:32 smithi049 bash[23528]: cluster 2024-09-20T23:21:31.179650+0000 mgr.a (mgr.14388) 2895 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:32 smithi049 bash[23528]: audit 2024-09-20T23:21:31.449194+0000 mgr.a (mgr.14388) 2896 : audit [DBG] from='client.73935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:34 smithi179 bash[23186]: cluster 2024-09-20T23:21:33.180620+0000 mgr.a (mgr.14388) 2897 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:34 smithi049 bash[23528]: cluster 2024-09-20T23:21:33.180620+0000 mgr.a (mgr.14388) 2897 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:34 smithi044 bash[22676]: cluster 2024-09-20T23:21:33.180620+0000 mgr.a (mgr.14388) 2897 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:21:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:36 smithi179 bash[23186]: cluster 2024-09-20T23:21:35.182990+0000 mgr.a (mgr.14388) 2898 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:21:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:36 smithi179 bash[23186]: audit 2024-09-20T23:21:36.067663+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:36 smithi179 bash[23186]: audit 2024-09-20T23:21:36.076460+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:36 smithi179 bash[23186]: audit 2024-09-20T23:21:36.087102+0000 mon.a (mon.0) 2998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:36 smithi049 bash[23528]: cluster 2024-09-20T23:21:35.182990+0000 mgr.a (mgr.14388) 2898 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:21:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:36 smithi049 bash[23528]: audit 2024-09-20T23:21:36.067663+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:36 smithi049 bash[23528]: audit 2024-09-20T23:21:36.076460+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:36 smithi049 bash[23528]: audit 2024-09-20T23:21:36.087102+0000 mon.a (mon.0) 2998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:36.897 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:36.897 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:36 smithi044 bash[22676]: cluster 2024-09-20T23:21:35.182990+0000 mgr.a (mgr.14388) 2898 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:21:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:36 smithi044 bash[22676]: audit 2024-09-20T23:21:36.067663+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:36 smithi044 bash[22676]: audit 2024-09-20T23:21:36.076460+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:36 smithi044 bash[22676]: audit 2024-09-20T23:21:36.087102+0000 mon.a (mon.0) 2998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:37.689 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:37.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:37.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:37.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:37.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:37 smithi044 bash[22676]: audit 2024-09-20T23:21:36.667779+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:37 smithi044 bash[22676]: audit 2024-09-20T23:21:36.675989+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:37 smithi044 bash[22676]: audit 2024-09-20T23:21:36.686240+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:37 smithi179 bash[23186]: audit 2024-09-20T23:21:36.667779+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:37 smithi179 bash[23186]: audit 2024-09-20T23:21:36.675989+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:37 smithi179 bash[23186]: audit 2024-09-20T23:21:36.686240+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:37 smithi049 bash[23528]: audit 2024-09-20T23:21:36.667779+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:37 smithi049 bash[23528]: audit 2024-09-20T23:21:36.675989+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:37 smithi049 bash[23528]: audit 2024-09-20T23:21:36.686240+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:38 smithi044 bash[22676]: cluster 2024-09-20T23:21:37.183562+0000 mgr.a (mgr.14388) 2899 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:38 smithi044 bash[22676]: audit 2024-09-20T23:21:37.236662+0000 mgr.a (mgr.14388) 2900 : audit [DBG] from='client.74010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:38 smithi044 bash[22676]: audit 2024-09-20T23:21:38.590063+0000 mon.a (mon.0) 3002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:38 smithi044 bash[22676]: audit 2024-09-20T23:21:38.598523+0000 mon.a (mon.0) 3003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:38 smithi044 bash[22676]: audit 2024-09-20T23:21:38.609118+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:38 smithi179 bash[23186]: cluster 2024-09-20T23:21:37.183562+0000 mgr.a (mgr.14388) 2899 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:38 smithi179 bash[23186]: audit 2024-09-20T23:21:37.236662+0000 mgr.a (mgr.14388) 2900 : audit [DBG] from='client.74010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:38 smithi179 bash[23186]: audit 2024-09-20T23:21:38.590063+0000 mon.a (mon.0) 3002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:38 smithi179 bash[23186]: audit 2024-09-20T23:21:38.598523+0000 mon.a (mon.0) 3003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:38 smithi179 bash[23186]: audit 2024-09-20T23:21:38.609118+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:38 smithi049 bash[23528]: cluster 2024-09-20T23:21:37.183562+0000 mgr.a (mgr.14388) 2899 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:38 smithi049 bash[23528]: audit 2024-09-20T23:21:37.236662+0000 mgr.a (mgr.14388) 2900 : audit [DBG] from='client.74010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:38 smithi049 bash[23528]: audit 2024-09-20T23:21:38.590063+0000 mon.a (mon.0) 3002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:38 smithi049 bash[23528]: audit 2024-09-20T23:21:38.598523+0000 mon.a (mon.0) 3003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:38 smithi049 bash[23528]: audit 2024-09-20T23:21:38.609118+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:40 smithi044 bash[22676]: cluster 2024-09-20T23:21:39.184488+0000 mgr.a (mgr.14388) 2901 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:40 smithi179 bash[23186]: cluster 2024-09-20T23:21:39.184488+0000 mgr.a (mgr.14388) 2901 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:40 smithi049 bash[23528]: cluster 2024-09-20T23:21:39.184488+0000 mgr.a (mgr.14388) 2901 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:42.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:42.691 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:42.691 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:42 smithi044 bash[22676]: cluster 2024-09-20T23:21:41.186743+0000 mgr.a (mgr.14388) 2902 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:42 smithi179 bash[23186]: cluster 2024-09-20T23:21:41.186743+0000 mgr.a (mgr.14388) 2902 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:42 smithi049 bash[23528]: cluster 2024-09-20T23:21:41.186743+0000 mgr.a (mgr.14388) 2902 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:43.439 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:43.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:43.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:43.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:43.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:44 smithi044 bash[22676]: audit 2024-09-20T23:21:43.019934+0000 mgr.a (mgr.14388) 2903 : audit [DBG] from='client.74088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:44 smithi044 bash[22676]: cluster 2024-09-20T23:21:43.187291+0000 mgr.a (mgr.14388) 2904 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:44 smithi179 bash[23186]: audit 2024-09-20T23:21:43.019934+0000 mgr.a (mgr.14388) 2903 : audit [DBG] from='client.74088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:44 smithi179 bash[23186]: cluster 2024-09-20T23:21:43.187291+0000 mgr.a (mgr.14388) 2904 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:44 smithi049 bash[23528]: audit 2024-09-20T23:21:43.019934+0000 mgr.a (mgr.14388) 2903 : audit [DBG] from='client.74088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:44 smithi049 bash[23528]: cluster 2024-09-20T23:21:43.187291+0000 mgr.a (mgr.14388) 2904 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:46 smithi044 bash[22676]: cluster 2024-09-20T23:21:45.189205+0000 mgr.a (mgr.14388) 2905 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:46 smithi179 bash[23186]: cluster 2024-09-20T23:21:45.189205+0000 mgr.a (mgr.14388) 2905 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:46 smithi049 bash[23528]: cluster 2024-09-20T23:21:45.189205+0000 mgr.a (mgr.14388) 2905 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:48.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:48.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:48.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:48 smithi044 bash[22676]: cluster 2024-09-20T23:21:47.190028+0000 mgr.a (mgr.14388) 2906 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:48 smithi179 bash[23186]: cluster 2024-09-20T23:21:47.190028+0000 mgr.a (mgr.14388) 2906 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:48 smithi049 bash[23528]: cluster 2024-09-20T23:21:47.190028+0000 mgr.a (mgr.14388) 2906 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:49.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:50 smithi044 bash[22676]: audit 2024-09-20T23:21:48.775691+0000 mgr.a (mgr.14388) 2907 : audit [DBG] from='client.74166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:50 smithi044 bash[22676]: cluster 2024-09-20T23:21:49.190807+0000 mgr.a (mgr.14388) 2908 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:50 smithi179 bash[23186]: audit 2024-09-20T23:21:48.775691+0000 mgr.a (mgr.14388) 2907 : audit [DBG] from='client.74166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:50 smithi179 bash[23186]: cluster 2024-09-20T23:21:49.190807+0000 mgr.a (mgr.14388) 2908 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:50 smithi049 bash[23528]: audit 2024-09-20T23:21:48.775691+0000 mgr.a (mgr.14388) 2907 : audit [DBG] from='client.74166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:50 smithi049 bash[23528]: cluster 2024-09-20T23:21:49.190807+0000 mgr.a (mgr.14388) 2908 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:52 smithi044 bash[22676]: cluster 2024-09-20T23:21:51.193028+0000 mgr.a (mgr.14388) 2909 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:53.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:52 smithi179 bash[23186]: cluster 2024-09-20T23:21:51.193028+0000 mgr.a (mgr.14388) 2909 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:52 smithi049 bash[23528]: cluster 2024-09-20T23:21:51.193028+0000 mgr.a (mgr.14388) 2909 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:21:54.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:21:54.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:21:54.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:21:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:54 smithi044 bash[22676]: cluster 2024-09-20T23:21:53.193824+0000 mgr.a (mgr.14388) 2910 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:54 smithi179 bash[23186]: cluster 2024-09-20T23:21:53.193824+0000 mgr.a (mgr.14388) 2910 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:55.005 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:21:55.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:21:55.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:21:55.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:21:55.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:21:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:54 smithi049 bash[23528]: cluster 2024-09-20T23:21:53.193824+0000 mgr.a (mgr.14388) 2910 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:21:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:55 smithi044 bash[22676]: audit 2024-09-20T23:21:54.552745+0000 mgr.a (mgr.14388) 2911 : audit [DBG] from='client.74244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:55 smithi179 bash[23186]: audit 2024-09-20T23:21:54.552745+0000 mgr.a (mgr.14388) 2911 : audit [DBG] from='client.74244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:55 smithi049 bash[23528]: audit 2024-09-20T23:21:54.552745+0000 mgr.a (mgr.14388) 2911 : audit [DBG] from='client.74244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:21:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:56 smithi044 bash[22676]: cluster 2024-09-20T23:21:55.196207+0000 mgr.a (mgr.14388) 2912 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:21:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:56 smithi044 bash[22676]: audit 2024-09-20T23:21:56.269365+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:56 smithi044 bash[22676]: audit 2024-09-20T23:21:56.277946+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:56 smithi044 bash[22676]: audit 2024-09-20T23:21:56.288489+0000 mon.a (mon.0) 3007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:56 smithi179 bash[23186]: cluster 2024-09-20T23:21:55.196207+0000 mgr.a (mgr.14388) 2912 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:21:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:56 smithi179 bash[23186]: audit 2024-09-20T23:21:56.269365+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:56 smithi179 bash[23186]: audit 2024-09-20T23:21:56.277946+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:56 smithi179 bash[23186]: audit 2024-09-20T23:21:56.288489+0000 mon.a (mon.0) 3007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:56 smithi049 bash[23528]: cluster 2024-09-20T23:21:55.196207+0000 mgr.a (mgr.14388) 2912 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:21:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:56 smithi049 bash[23528]: audit 2024-09-20T23:21:56.269365+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:56 smithi049 bash[23528]: audit 2024-09-20T23:21:56.277946+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:56 smithi049 bash[23528]: audit 2024-09-20T23:21:56.288489+0000 mon.a (mon.0) 3007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:57 smithi044 bash[22676]: audit 2024-09-20T23:21:56.872136+0000 mon.a (mon.0) 3008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:57 smithi044 bash[22676]: audit 2024-09-20T23:21:56.880793+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:57 smithi044 bash[22676]: audit 2024-09-20T23:21:56.891167+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:57 smithi044 bash[22676]: cluster 2024-09-20T23:21:57.196983+0000 mgr.a (mgr.14388) 2913 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:21:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:57 smithi179 bash[23186]: audit 2024-09-20T23:21:56.872136+0000 mon.a (mon.0) 3008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:57 smithi179 bash[23186]: audit 2024-09-20T23:21:56.880793+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:57 smithi179 bash[23186]: audit 2024-09-20T23:21:56.891167+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:57 smithi179 bash[23186]: cluster 2024-09-20T23:21:57.196983+0000 mgr.a (mgr.14388) 2913 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:21:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:57 smithi049 bash[23528]: audit 2024-09-20T23:21:56.872136+0000 mon.a (mon.0) 3008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:57 smithi049 bash[23528]: audit 2024-09-20T23:21:56.880793+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:57 smithi049 bash[23528]: audit 2024-09-20T23:21:56.891167+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:57 smithi049 bash[23528]: cluster 2024-09-20T23:21:57.196983+0000 mgr.a (mgr.14388) 2913 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:21:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.014378+0000 mon.a (mon.0) 3011 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.591735+0000 mon.a (mon.0) 3012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.600056+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.602772+0000 mon.a (mon.0) 3014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.604686+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.615315+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.619467+0000 mon.a (mon.0) 3017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.620794+0000 mgr.a (mgr.14388) 2914 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.777080+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.782083+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:58 smithi044 bash[22676]: audit 2024-09-20T23:21:58.787282+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.014378+0000 mon.a (mon.0) 3011 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.591735+0000 mon.a (mon.0) 3012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.600056+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.602772+0000 mon.a (mon.0) 3014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.604686+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.615315+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.619467+0000 mon.a (mon.0) 3017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:21:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.620794+0000 mgr.a (mgr.14388) 2914 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:21:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.777080+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.782083+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:58 smithi179 bash[23186]: audit 2024-09-20T23:21:58.787282+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.014378+0000 mon.a (mon.0) 3011 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:21:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.591735+0000 mon.a (mon.0) 3012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.600056+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.602772+0000 mon.a (mon.0) 3014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.604686+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.615315+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.619467+0000 mon.a (mon.0) 3017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.620794+0000 mgr.a (mgr.14388) 2914 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.777080+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.782083+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:58 smithi049 bash[23528]: audit 2024-09-20T23:21:58.787282+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:21:59.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:21:59 smithi044 bash[22930]: debug 2024-09-20T23:21:59.398+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:21:59.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:21:59 smithi044 bash[22930]: debug 2024-09-20T23:21:59.398+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:22:00.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:00.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:00.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:59 smithi044 bash[22676]: cluster 2024-09-20T23:21:59.197580+0000 mgr.a (mgr.14388) 2915 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:22:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:59 smithi044 bash[22676]: audit 2024-09-20T23:21:59.402936+0000 mgr.a (mgr.14388) 2916 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:22:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:21:59 smithi044 bash[22676]: cephadm 2024-09-20T23:21:59.404142+0000 mgr.a (mgr.14388) 2917 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:22:00.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:59 smithi179 bash[23186]: cluster 2024-09-20T23:21:59.197580+0000 mgr.a (mgr.14388) 2915 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:22:00.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:59 smithi179 bash[23186]: audit 2024-09-20T23:21:59.402936+0000 mgr.a (mgr.14388) 2916 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:22:00.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:21:59 smithi179 bash[23186]: cephadm 2024-09-20T23:21:59.404142+0000 mgr.a (mgr.14388) 2917 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:22:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:59 smithi049 bash[23528]: cluster 2024-09-20T23:21:59.197580+0000 mgr.a (mgr.14388) 2915 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:22:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:59 smithi049 bash[23528]: audit 2024-09-20T23:21:59.402936+0000 mgr.a (mgr.14388) 2916 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:22:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:21:59 smithi049 bash[23528]: cephadm 2024-09-20T23:21:59.404142+0000 mgr.a (mgr.14388) 2917 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:22:00.777 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:00.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:00.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:00 smithi044 bash[22676]: audit 2024-09-20T23:22:00.342848+0000 mgr.a (mgr.14388) 2918 : audit [DBG] from='client.74430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:00 smithi179 bash[23186]: audit 2024-09-20T23:22:00.342848+0000 mgr.a (mgr.14388) 2918 : audit [DBG] from='client.74430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:00 smithi049 bash[23528]: audit 2024-09-20T23:22:00.342848+0000 mgr.a (mgr.14388) 2918 : audit [DBG] from='client.74430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:01 smithi044 bash[22676]: cluster 2024-09-20T23:22:01.200382+0000 mgr.a (mgr.14388) 2919 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:01 smithi179 bash[23186]: cluster 2024-09-20T23:22:01.200382+0000 mgr.a (mgr.14388) 2919 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:01 smithi049 bash[23528]: cluster 2024-09-20T23:22:01.200382+0000 mgr.a (mgr.14388) 2919 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:04 smithi049 bash[23528]: cluster 2024-09-20T23:22:03.201209+0000 mgr.a (mgr.14388) 2920 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:04.641 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:04 smithi044 bash[22676]: cluster 2024-09-20T23:22:03.201209+0000 mgr.a (mgr.14388) 2920 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:04 smithi179 bash[23186]: cluster 2024-09-20T23:22:03.201209+0000 mgr.a (mgr.14388) 2920 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:05.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:05.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:05.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:06 smithi044 bash[22676]: cluster 2024-09-20T23:22:05.203098+0000 mgr.a (mgr.14388) 2921 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:06 smithi049 bash[23528]: cluster 2024-09-20T23:22:05.203098+0000 mgr.a (mgr.14388) 2921 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:06.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:06.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:06 smithi179 bash[23186]: cluster 2024-09-20T23:22:05.203098+0000 mgr.a (mgr.14388) 2921 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:07 smithi049 bash[23528]: audit 2024-09-20T23:22:06.120278+0000 mgr.a (mgr.14388) 2922 : audit [DBG] from='client.74508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:07 smithi044 bash[22676]: audit 2024-09-20T23:22:06.120278+0000 mgr.a (mgr.14388) 2922 : audit [DBG] from='client.74508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:07 smithi179 bash[23186]: audit 2024-09-20T23:22:06.120278+0000 mgr.a (mgr.14388) 2922 : audit [DBG] from='client.74508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:08 smithi179 bash[23186]: cluster 2024-09-20T23:22:07.204139+0000 mgr.a (mgr.14388) 2923 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:08 smithi049 bash[23528]: cluster 2024-09-20T23:22:07.204139+0000 mgr.a (mgr.14388) 2923 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:08 smithi044 bash[22676]: cluster 2024-09-20T23:22:07.204139+0000 mgr.a (mgr.14388) 2923 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:10 smithi049 bash[23528]: cluster 2024-09-20T23:22:09.204942+0000 mgr.a (mgr.14388) 2924 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:10.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:10 smithi179 bash[23186]: cluster 2024-09-20T23:22:09.204942+0000 mgr.a (mgr.14388) 2924 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:10 smithi044 bash[22676]: cluster 2024-09-20T23:22:09.204942+0000 mgr.a (mgr.14388) 2924 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:22:11.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:11.569 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:11.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:12.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:12.543 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:12 smithi179 bash[23186]: cluster 2024-09-20T23:22:11.207144+0000 mgr.a (mgr.14388) 2925 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:12 smithi049 bash[23528]: cluster 2024-09-20T23:22:11.207144+0000 mgr.a (mgr.14388) 2925 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:12 smithi044 bash[22676]: cluster 2024-09-20T23:22:11.207144+0000 mgr.a (mgr.14388) 2925 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:22:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:13 smithi049 bash[23528]: audit 2024-09-20T23:22:11.898463+0000 mgr.a (mgr.14388) 2926 : audit [DBG] from='client.74586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:13 smithi044 bash[22676]: audit 2024-09-20T23:22:11.898463+0000 mgr.a (mgr.14388) 2926 : audit [DBG] from='client.74586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:13 smithi179 bash[23186]: audit 2024-09-20T23:22:11.898463+0000 mgr.a (mgr.14388) 2926 : audit [DBG] from='client.74586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:14 smithi049 bash[23528]: cluster 2024-09-20T23:22:13.208114+0000 mgr.a (mgr.14388) 2927 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:14 smithi044 bash[22676]: cluster 2024-09-20T23:22:13.208114+0000 mgr.a (mgr.14388) 2927 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:14 smithi179 bash[23186]: cluster 2024-09-20T23:22:13.208114+0000 mgr.a (mgr.14388) 2927 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:16 smithi049 bash[23528]: cluster 2024-09-20T23:22:15.210257+0000 mgr.a (mgr.14388) 2928 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:16 smithi044 bash[22676]: cluster 2024-09-20T23:22:15.210257+0000 mgr.a (mgr.14388) 2928 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:16 smithi179 bash[23186]: cluster 2024-09-20T23:22:15.210257+0000 mgr.a (mgr.14388) 2928 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:17.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:17.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:17.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:17 smithi044 bash[22676]: audit 2024-09-20T23:22:16.467846+0000 mon.a (mon.0) 3021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:17 smithi044 bash[22676]: audit 2024-09-20T23:22:16.476335+0000 mon.a (mon.0) 3022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:17 smithi044 bash[22676]: audit 2024-09-20T23:22:16.486796+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:17 smithi044 bash[22676]: audit 2024-09-20T23:22:17.060865+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:17 smithi044 bash[22676]: audit 2024-09-20T23:22:17.068892+0000 mon.a (mon.0) 3025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:17 smithi044 bash[22676]: audit 2024-09-20T23:22:17.078605+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:17 smithi179 bash[23186]: audit 2024-09-20T23:22:16.467846+0000 mon.a (mon.0) 3021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:17 smithi179 bash[23186]: audit 2024-09-20T23:22:16.476335+0000 mon.a (mon.0) 3022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:17 smithi179 bash[23186]: audit 2024-09-20T23:22:16.486796+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:17 smithi179 bash[23186]: audit 2024-09-20T23:22:17.060865+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:17 smithi179 bash[23186]: audit 2024-09-20T23:22:17.068892+0000 mon.a (mon.0) 3025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:17 smithi179 bash[23186]: audit 2024-09-20T23:22:17.078605+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:17 smithi049 bash[23528]: audit 2024-09-20T23:22:16.467846+0000 mon.a (mon.0) 3021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:17 smithi049 bash[23528]: audit 2024-09-20T23:22:16.476335+0000 mon.a (mon.0) 3022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:17 smithi049 bash[23528]: audit 2024-09-20T23:22:16.486796+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:17 smithi049 bash[23528]: audit 2024-09-20T23:22:17.060865+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:17 smithi049 bash[23528]: audit 2024-09-20T23:22:17.068892+0000 mon.a (mon.0) 3025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:17 smithi049 bash[23528]: audit 2024-09-20T23:22:17.078605+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:18.107 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:18.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:18.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:18.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:18.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:18 smithi044 bash[22676]: cluster 2024-09-20T23:22:17.211016+0000 mgr.a (mgr.14388) 2929 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:18 smithi044 bash[22676]: audit 2024-09-20T23:22:17.665044+0000 mgr.a (mgr.14388) 2930 : audit [DBG] from='client.74664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:18 smithi179 bash[23186]: cluster 2024-09-20T23:22:17.211016+0000 mgr.a (mgr.14388) 2929 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:18 smithi179 bash[23186]: audit 2024-09-20T23:22:17.665044+0000 mgr.a (mgr.14388) 2930 : audit [DBG] from='client.74664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:18 smithi049 bash[23528]: cluster 2024-09-20T23:22:17.211016+0000 mgr.a (mgr.14388) 2929 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:18 smithi049 bash[23528]: audit 2024-09-20T23:22:17.665044+0000 mgr.a (mgr.14388) 2930 : audit [DBG] from='client.74664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:19 smithi044 bash[22676]: audit 2024-09-20T23:22:18.983427+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:19 smithi044 bash[22676]: audit 2024-09-20T23:22:18.990524+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:19 smithi044 bash[22676]: audit 2024-09-20T23:22:19.000946+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:19 smithi044 bash[22676]: cluster 2024-09-20T23:22:19.211969+0000 mgr.a (mgr.14388) 2931 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:19 smithi179 bash[23186]: audit 2024-09-20T23:22:18.983427+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:19 smithi179 bash[23186]: audit 2024-09-20T23:22:18.990524+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:19 smithi179 bash[23186]: audit 2024-09-20T23:22:19.000946+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:19 smithi179 bash[23186]: cluster 2024-09-20T23:22:19.211969+0000 mgr.a (mgr.14388) 2931 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:19 smithi049 bash[23528]: audit 2024-09-20T23:22:18.983427+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:19 smithi049 bash[23528]: audit 2024-09-20T23:22:18.990524+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:19 smithi049 bash[23528]: audit 2024-09-20T23:22:19.000946+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:19 smithi049 bash[23528]: cluster 2024-09-20T23:22:19.211969+0000 mgr.a (mgr.14388) 2931 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:22 smithi049 bash[23528]: cluster 2024-09-20T23:22:21.214190+0000 mgr.a (mgr.14388) 2932 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:22 smithi044 bash[22676]: cluster 2024-09-20T23:22:21.214190+0000 mgr.a (mgr.14388) 2932 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:22 smithi179 bash[23186]: cluster 2024-09-20T23:22:21.214190+0000 mgr.a (mgr.14388) 2932 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:23.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:23.884 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:24 smithi049 bash[23528]: cluster 2024-09-20T23:22:23.214593+0000 mgr.a (mgr.14388) 2933 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:24 smithi049 bash[23528]: audit 2024-09-20T23:22:23.444725+0000 mgr.a (mgr.14388) 2934 : audit [DBG] from='client.74739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:24.567 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:24 smithi044 bash[22676]: cluster 2024-09-20T23:22:23.214593+0000 mgr.a (mgr.14388) 2933 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:24.568 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:24 smithi044 bash[22676]: audit 2024-09-20T23:22:23.444725+0000 mgr.a (mgr.14388) 2934 : audit [DBG] from='client.74739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:24 smithi179 bash[23186]: cluster 2024-09-20T23:22:23.214593+0000 mgr.a (mgr.14388) 2933 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:24 smithi179 bash[23186]: audit 2024-09-20T23:22:23.444725+0000 mgr.a (mgr.14388) 2934 : audit [DBG] from='client.74739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:26 smithi049 bash[23528]: cluster 2024-09-20T23:22:25.217370+0000 mgr.a (mgr.14388) 2935 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:26 smithi044 bash[22676]: cluster 2024-09-20T23:22:25.217370+0000 mgr.a (mgr.14388) 2935 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:26 smithi179 bash[23186]: cluster 2024-09-20T23:22:25.217370+0000 mgr.a (mgr.14388) 2935 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:28 smithi049 bash[23528]: cluster 2024-09-20T23:22:27.217898+0000 mgr.a (mgr.14388) 2936 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:28 smithi044 bash[22676]: cluster 2024-09-20T23:22:27.217898+0000 mgr.a (mgr.14388) 2936 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:28 smithi179 bash[23186]: cluster 2024-09-20T23:22:27.217898+0000 mgr.a (mgr.14388) 2936 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:28.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:29.668 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:30 smithi049 bash[23528]: cluster 2024-09-20T23:22:29.218600+0000 mgr.a (mgr.14388) 2937 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:30 smithi049 bash[23528]: audit 2024-09-20T23:22:29.222134+0000 mgr.a (mgr.14388) 2938 : audit [DBG] from='client.74817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:30 smithi044 bash[22676]: cluster 2024-09-20T23:22:29.218600+0000 mgr.a (mgr.14388) 2937 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:30 smithi044 bash[22676]: audit 2024-09-20T23:22:29.222134+0000 mgr.a (mgr.14388) 2938 : audit [DBG] from='client.74817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:30 smithi179 bash[23186]: cluster 2024-09-20T23:22:29.218600+0000 mgr.a (mgr.14388) 2937 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:30 smithi179 bash[23186]: audit 2024-09-20T23:22:29.222134+0000 mgr.a (mgr.14388) 2938 : audit [DBG] from='client.74817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:32 smithi049 bash[23528]: cluster 2024-09-20T23:22:31.220969+0000 mgr.a (mgr.14388) 2939 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:32.591 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:32 smithi179 bash[23186]: cluster 2024-09-20T23:22:31.220969+0000 mgr.a (mgr.14388) 2939 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:32 smithi044 bash[22676]: cluster 2024-09-20T23:22:31.220969+0000 mgr.a (mgr.14388) 2939 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:34 smithi049 bash[23528]: cluster 2024-09-20T23:22:33.221795+0000 mgr.a (mgr.14388) 2940 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:34.613 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:34 smithi044 bash[22676]: cluster 2024-09-20T23:22:33.221795+0000 mgr.a (mgr.14388) 2940 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:34.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:34.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:34.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:34 smithi179 bash[23186]: cluster 2024-09-20T23:22:33.221795+0000 mgr.a (mgr.14388) 2940 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:35.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:35.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:35.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:35.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:35.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:36.392 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:36 smithi049 bash[23528]: audit 2024-09-20T23:22:34.999310+0000 mgr.a (mgr.14388) 2941 : audit [DBG] from='client.74895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:36.392 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:36 smithi049 bash[23528]: cluster 2024-09-20T23:22:35.223037+0000 mgr.a (mgr.14388) 2942 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:36 smithi044 bash[22676]: audit 2024-09-20T23:22:34.999310+0000 mgr.a (mgr.14388) 2941 : audit [DBG] from='client.74895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:36 smithi044 bash[22676]: cluster 2024-09-20T23:22:35.223037+0000 mgr.a (mgr.14388) 2942 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:36 smithi179 bash[23186]: audit 2024-09-20T23:22:34.999310+0000 mgr.a (mgr.14388) 2941 : audit [DBG] from='client.74895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:36 smithi179 bash[23186]: cluster 2024-09-20T23:22:35.223037+0000 mgr.a (mgr.14388) 2942 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:37 smithi044 bash[22676]: audit 2024-09-20T23:22:36.704953+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:37 smithi044 bash[22676]: audit 2024-09-20T23:22:36.714761+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:37 smithi044 bash[22676]: audit 2024-09-20T23:22:36.726482+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:37 smithi044 bash[22676]: audit 2024-09-20T23:22:37.290360+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:37 smithi044 bash[22676]: audit 2024-09-20T23:22:37.298766+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:37 smithi044 bash[22676]: audit 2024-09-20T23:22:37.310001+0000 mon.a (mon.0) 3035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:37 smithi179 bash[23186]: audit 2024-09-20T23:22:36.704953+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:37 smithi179 bash[23186]: audit 2024-09-20T23:22:36.714761+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:37 smithi179 bash[23186]: audit 2024-09-20T23:22:36.726482+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:37 smithi179 bash[23186]: audit 2024-09-20T23:22:37.290360+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:37 smithi179 bash[23186]: audit 2024-09-20T23:22:37.298766+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:37 smithi179 bash[23186]: audit 2024-09-20T23:22:37.310001+0000 mon.a (mon.0) 3035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:37 smithi049 bash[23528]: audit 2024-09-20T23:22:36.704953+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:37 smithi049 bash[23528]: audit 2024-09-20T23:22:36.714761+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:37 smithi049 bash[23528]: audit 2024-09-20T23:22:36.726482+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:37 smithi049 bash[23528]: audit 2024-09-20T23:22:37.290360+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:37 smithi049 bash[23528]: audit 2024-09-20T23:22:37.298766+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:37 smithi049 bash[23528]: audit 2024-09-20T23:22:37.310001+0000 mon.a (mon.0) 3035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:38 smithi049 bash[23528]: cluster 2024-09-20T23:22:37.223891+0000 mgr.a (mgr.14388) 2943 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:38 smithi044 bash[22676]: cluster 2024-09-20T23:22:37.223891+0000 mgr.a (mgr.14388) 2943 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:38 smithi179 bash[23186]: cluster 2024-09-20T23:22:37.223891+0000 mgr.a (mgr.14388) 2943 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:40.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:40.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:40.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:40 smithi044 bash[22676]: audit 2024-09-20T23:22:39.188994+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:40 smithi044 bash[22676]: audit 2024-09-20T23:22:39.196387+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:40 smithi044 bash[22676]: audit 2024-09-20T23:22:39.206314+0000 mon.a (mon.0) 3038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:40 smithi044 bash[22676]: cluster 2024-09-20T23:22:39.224653+0000 mgr.a (mgr.14388) 2944 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:40 smithi179 bash[23186]: audit 2024-09-20T23:22:39.188994+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:40 smithi179 bash[23186]: audit 2024-09-20T23:22:39.196387+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:40 smithi179 bash[23186]: audit 2024-09-20T23:22:39.206314+0000 mon.a (mon.0) 3038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:40 smithi179 bash[23186]: cluster 2024-09-20T23:22:39.224653+0000 mgr.a (mgr.14388) 2944 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:40 smithi049 bash[23528]: audit 2024-09-20T23:22:39.188994+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:40 smithi049 bash[23528]: audit 2024-09-20T23:22:39.196387+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:40 smithi049 bash[23528]: audit 2024-09-20T23:22:39.206314+0000 mon.a (mon.0) 3038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:40 smithi049 bash[23528]: cluster 2024-09-20T23:22:39.224653+0000 mgr.a (mgr.14388) 2944 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:41.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:42 smithi049 bash[23528]: audit 2024-09-20T23:22:40.793443+0000 mgr.a (mgr.14388) 2945 : audit [DBG] from='client.74973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:42 smithi049 bash[23528]: cluster 2024-09-20T23:22:41.225948+0000 mgr.a (mgr.14388) 2946 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:42 smithi044 bash[22676]: audit 2024-09-20T23:22:40.793443+0000 mgr.a (mgr.14388) 2945 : audit [DBG] from='client.74973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:42 smithi044 bash[22676]: cluster 2024-09-20T23:22:41.225948+0000 mgr.a (mgr.14388) 2946 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:42 smithi179 bash[23186]: audit 2024-09-20T23:22:40.793443+0000 mgr.a (mgr.14388) 2945 : audit [DBG] from='client.74973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:42 smithi179 bash[23186]: cluster 2024-09-20T23:22:41.225948+0000 mgr.a (mgr.14388) 2946 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:44 smithi049 bash[23528]: cluster 2024-09-20T23:22:43.226693+0000 mgr.a (mgr.14388) 2947 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:44 smithi044 bash[22676]: cluster 2024-09-20T23:22:43.226693+0000 mgr.a (mgr.14388) 2947 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:44 smithi179 bash[23186]: cluster 2024-09-20T23:22:43.226693+0000 mgr.a (mgr.14388) 2947 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:22:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:46 smithi049 bash[23528]: cluster 2024-09-20T23:22:45.228599+0000 mgr.a (mgr.14388) 2948 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:46.606 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:46 smithi044 bash[22676]: cluster 2024-09-20T23:22:45.228599+0000 mgr.a (mgr.14388) 2948 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:46 smithi179 bash[23186]: cluster 2024-09-20T23:22:45.228599+0000 mgr.a (mgr.14388) 2948 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:47.013 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:47 smithi044 bash[22676]: audit 2024-09-20T23:22:46.582617+0000 mgr.a (mgr.14388) 2949 : audit [DBG] from='client.75048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:47 smithi049 bash[23528]: audit 2024-09-20T23:22:46.582617+0000 mgr.a (mgr.14388) 2949 : audit [DBG] from='client.75048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:47 smithi179 bash[23186]: audit 2024-09-20T23:22:46.582617+0000 mgr.a (mgr.14388) 2949 : audit [DBG] from='client.75048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:48.672 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:48 smithi044 bash[22676]: cluster 2024-09-20T23:22:47.229658+0000 mgr.a (mgr.14388) 2950 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:48 smithi179 bash[23186]: cluster 2024-09-20T23:22:47.229658+0000 mgr.a (mgr.14388) 2950 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:48 smithi049 bash[23528]: cluster 2024-09-20T23:22:47.229658+0000 mgr.a (mgr.14388) 2950 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:50.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:50 smithi179 bash[23186]: cluster 2024-09-20T23:22:49.230462+0000 mgr.a (mgr.14388) 2951 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:50 smithi044 bash[22676]: cluster 2024-09-20T23:22:49.230462+0000 mgr.a (mgr.14388) 2951 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:50 smithi049 bash[23528]: cluster 2024-09-20T23:22:49.230462+0000 mgr.a (mgr.14388) 2951 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:52 smithi044 bash[22676]: cluster 2024-09-20T23:22:51.232796+0000 mgr.a (mgr.14388) 2952 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:52 smithi179 bash[23186]: cluster 2024-09-20T23:22:51.232796+0000 mgr.a (mgr.14388) 2952 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:52.778 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:52.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:52.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:52.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:52.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:52 smithi049 bash[23528]: cluster 2024-09-20T23:22:51.232796+0000 mgr.a (mgr.14388) 2952 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:53.654 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:53 smithi179 bash[23186]: audit 2024-09-20T23:22:52.346064+0000 mgr.a (mgr.14388) 2953 : audit [DBG] from='client.75123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:53 smithi044 bash[22676]: audit 2024-09-20T23:22:52.346064+0000 mgr.a (mgr.14388) 2953 : audit [DBG] from='client.75123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:53 smithi049 bash[23528]: audit 2024-09-20T23:22:52.346064+0000 mgr.a (mgr.14388) 2953 : audit [DBG] from='client.75123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:54 smithi044 bash[22676]: cluster 2024-09-20T23:22:53.233844+0000 mgr.a (mgr.14388) 2954 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:54 smithi179 bash[23186]: cluster 2024-09-20T23:22:53.233844+0000 mgr.a (mgr.14388) 2954 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:54 smithi049 bash[23528]: cluster 2024-09-20T23:22:53.233844+0000 mgr.a (mgr.14388) 2954 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:56.430 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:56 smithi049 bash[23528]: cluster 2024-09-20T23:22:55.235145+0000 mgr.a (mgr.14388) 2955 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:56 smithi044 bash[22676]: cluster 2024-09-20T23:22:55.235145+0000 mgr.a (mgr.14388) 2955 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:56 smithi179 bash[23186]: cluster 2024-09-20T23:22:55.235145+0000 mgr.a (mgr.14388) 2955 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:22:57.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:22:57.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:22:57.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:22:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:57 smithi049 bash[23528]: audit 2024-09-20T23:22:56.949893+0000 mon.a (mon.0) 3039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:57 smithi049 bash[23528]: audit 2024-09-20T23:22:56.958500+0000 mon.a (mon.0) 3040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:57 smithi049 bash[23528]: audit 2024-09-20T23:22:56.968829+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:57 smithi049 bash[23528]: cluster 2024-09-20T23:22:57.235880+0000 mgr.a (mgr.14388) 2956 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:57 smithi049 bash[23528]: audit 2024-09-20T23:22:57.517198+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:57 smithi049 bash[23528]: audit 2024-09-20T23:22:57.525518+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:57 smithi049 bash[23528]: audit 2024-09-20T23:22:57.535513+0000 mon.a (mon.0) 3044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:57 smithi044 bash[22676]: audit 2024-09-20T23:22:56.949893+0000 mon.a (mon.0) 3039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:57 smithi044 bash[22676]: audit 2024-09-20T23:22:56.958500+0000 mon.a (mon.0) 3040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:57 smithi044 bash[22676]: audit 2024-09-20T23:22:56.968829+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:57 smithi044 bash[22676]: cluster 2024-09-20T23:22:57.235880+0000 mgr.a (mgr.14388) 2956 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:57 smithi044 bash[22676]: audit 2024-09-20T23:22:57.517198+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:57 smithi044 bash[22676]: audit 2024-09-20T23:22:57.525518+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:57 smithi044 bash[22676]: audit 2024-09-20T23:22:57.535513+0000 mon.a (mon.0) 3044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:57 smithi179 bash[23186]: audit 2024-09-20T23:22:56.949893+0000 mon.a (mon.0) 3039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:57 smithi179 bash[23186]: audit 2024-09-20T23:22:56.958500+0000 mon.a (mon.0) 3040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:57 smithi179 bash[23186]: audit 2024-09-20T23:22:56.968829+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:57 smithi179 bash[23186]: cluster 2024-09-20T23:22:57.235880+0000 mgr.a (mgr.14388) 2956 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:22:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:57 smithi179 bash[23186]: audit 2024-09-20T23:22:57.517198+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:57 smithi179 bash[23186]: audit 2024-09-20T23:22:57.525518+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:57 smithi179 bash[23186]: audit 2024-09-20T23:22:57.535513+0000 mon.a (mon.0) 3044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:22:58.556 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:22:58.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:22:58.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:22:58.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:22:58.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:22:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:22:58 smithi044 bash[22676]: audit 2024-09-20T23:22:58.115934+0000 mgr.a (mgr.14388) 2957 : audit [DBG] from='client.75201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:22:58 smithi179 bash[23186]: audit 2024-09-20T23:22:58.115934+0000 mgr.a (mgr.14388) 2957 : audit [DBG] from='client.75201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:22:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:22:58 smithi049 bash[23528]: audit 2024-09-20T23:22:58.115934+0000 mgr.a (mgr.14388) 2957 : audit [DBG] from='client.75201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22930]: debug 2024-09-20T23:23:00.277+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22930]: debug 2024-09-20T23:23:00.281+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: cluster 2024-09-20T23:22:59.236629+0000 mgr.a (mgr.14388) 2958 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.391958+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.398252+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.406678+0000 mon.a (mon.0) 3047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.477829+0000 mon.a (mon.0) 3048 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.484673+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.486963+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.499632+0000 mon.a (mon.0) 3051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.506026+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:23:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:00 smithi044 bash[22676]: audit 2024-09-20T23:22:59.508807+0000 mgr.a (mgr.14388) 2959 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:23:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: cluster 2024-09-20T23:22:59.236629+0000 mgr.a (mgr.14388) 2958 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.391958+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.398252+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.406678+0000 mon.a (mon.0) 3047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.477829+0000 mon.a (mon.0) 3048 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.484673+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.486963+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.499632+0000 mon.a (mon.0) 3051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.506026+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:23:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:00 smithi179 bash[23186]: audit 2024-09-20T23:22:59.508807+0000 mgr.a (mgr.14388) 2959 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:23:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: cluster 2024-09-20T23:22:59.236629+0000 mgr.a (mgr.14388) 2958 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.391958+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.398252+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.406678+0000 mon.a (mon.0) 3047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.477829+0000 mon.a (mon.0) 3048 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.484673+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.486963+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.499632+0000 mon.a (mon.0) 3051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.506026+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:23:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:00 smithi049 bash[23528]: audit 2024-09-20T23:22:59.508807+0000 mgr.a (mgr.14388) 2959 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:23:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:01 smithi044 bash[22676]: audit 2024-09-20T23:23:00.279783+0000 mgr.a (mgr.14388) 2960 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:23:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:01 smithi044 bash[22676]: cephadm 2024-09-20T23:23:00.281286+0000 mgr.a (mgr.14388) 2961 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:23:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:01 smithi179 bash[23186]: audit 2024-09-20T23:23:00.279783+0000 mgr.a (mgr.14388) 2960 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:23:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:01 smithi179 bash[23186]: cephadm 2024-09-20T23:23:00.281286+0000 mgr.a (mgr.14388) 2961 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:23:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:01 smithi049 bash[23528]: audit 2024-09-20T23:23:00.279783+0000 mgr.a (mgr.14388) 2960 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:23:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:01 smithi049 bash[23528]: cephadm 2024-09-20T23:23:00.281286+0000 mgr.a (mgr.14388) 2961 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:23:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:02 smithi044 bash[22676]: cluster 2024-09-20T23:23:01.239086+0000 mgr.a (mgr.14388) 2962 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:23:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:02 smithi179 bash[23186]: cluster 2024-09-20T23:23:01.239086+0000 mgr.a (mgr.14388) 2962 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:23:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:02 smithi049 bash[23528]: cluster 2024-09-20T23:23:01.239086+0000 mgr.a (mgr.14388) 2962 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:23:03.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:03.559 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:03.559 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:04.306 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:04 smithi044 bash[22676]: cluster 2024-09-20T23:23:03.239872+0000 mgr.a (mgr.14388) 2963 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:23:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:04 smithi179 bash[23186]: cluster 2024-09-20T23:23:03.239872+0000 mgr.a (mgr.14388) 2963 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:23:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:04 smithi049 bash[23528]: cluster 2024-09-20T23:23:03.239872+0000 mgr.a (mgr.14388) 2963 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:23:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:05 smithi044 bash[22676]: audit 2024-09-20T23:23:03.884039+0000 mgr.a (mgr.14388) 2964 : audit [DBG] from='client.75387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:05 smithi179 bash[23186]: audit 2024-09-20T23:23:03.884039+0000 mgr.a (mgr.14388) 2964 : audit [DBG] from='client.75387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:05 smithi049 bash[23528]: audit 2024-09-20T23:23:03.884039+0000 mgr.a (mgr.14388) 2964 : audit [DBG] from='client.75387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:06 smithi044 bash[22676]: cluster 2024-09-20T23:23:05.242209+0000 mgr.a (mgr.14388) 2965 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:06 smithi179 bash[23186]: cluster 2024-09-20T23:23:05.242209+0000 mgr.a (mgr.14388) 2965 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:06 smithi049 bash[23528]: cluster 2024-09-20T23:23:05.242209+0000 mgr.a (mgr.14388) 2965 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:08 smithi044 bash[22676]: cluster 2024-09-20T23:23:07.242965+0000 mgr.a (mgr.14388) 2966 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:08 smithi179 bash[23186]: cluster 2024-09-20T23:23:07.242965+0000 mgr.a (mgr.14388) 2966 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:08 smithi049 bash[23528]: cluster 2024-09-20T23:23:07.242965+0000 mgr.a (mgr.14388) 2966 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:09.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:09.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:09.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:10.071 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:10.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:10.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:10.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:10.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:10 smithi044 bash[22676]: cluster 2024-09-20T23:23:09.243698+0000 mgr.a (mgr.14388) 2967 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:10 smithi044 bash[22676]: audit 2024-09-20T23:23:09.637465+0000 mgr.a (mgr.14388) 2968 : audit [DBG] from='client.75465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:10 smithi179 bash[23186]: cluster 2024-09-20T23:23:09.243698+0000 mgr.a (mgr.14388) 2967 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:10 smithi179 bash[23186]: audit 2024-09-20T23:23:09.637465+0000 mgr.a (mgr.14388) 2968 : audit [DBG] from='client.75465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:10 smithi049 bash[23528]: cluster 2024-09-20T23:23:09.243698+0000 mgr.a (mgr.14388) 2967 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:10 smithi049 bash[23528]: audit 2024-09-20T23:23:09.637465+0000 mgr.a (mgr.14388) 2968 : audit [DBG] from='client.75465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:12 smithi044 bash[22676]: cluster 2024-09-20T23:23:11.246125+0000 mgr.a (mgr.14388) 2969 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:12 smithi179 bash[23186]: cluster 2024-09-20T23:23:11.246125+0000 mgr.a (mgr.14388) 2969 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:12 smithi049 bash[23528]: cluster 2024-09-20T23:23:11.246125+0000 mgr.a (mgr.14388) 2969 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:23:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:14 smithi044 bash[22676]: cluster 2024-09-20T23:23:13.246625+0000 mgr.a (mgr.14388) 2970 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:23:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:14 smithi179 bash[23186]: cluster 2024-09-20T23:23:13.246625+0000 mgr.a (mgr.14388) 2970 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:23:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:14 smithi049 bash[23528]: cluster 2024-09-20T23:23:13.246625+0000 mgr.a (mgr.14388) 2970 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:23:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:15.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:15.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:15.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:15.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:15.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:16 smithi044 bash[22676]: cluster 2024-09-20T23:23:15.248550+0000 mgr.a (mgr.14388) 2971 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:23:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:16 smithi044 bash[22676]: audit 2024-09-20T23:23:15.407374+0000 mgr.a (mgr.14388) 2972 : audit [DBG] from='client.75543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:16 smithi179 bash[23186]: cluster 2024-09-20T23:23:15.248550+0000 mgr.a (mgr.14388) 2971 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:23:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:16 smithi179 bash[23186]: audit 2024-09-20T23:23:15.407374+0000 mgr.a (mgr.14388) 2972 : audit [DBG] from='client.75543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:16 smithi049 bash[23528]: cluster 2024-09-20T23:23:15.248550+0000 mgr.a (mgr.14388) 2971 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:23:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:16 smithi049 bash[23528]: audit 2024-09-20T23:23:15.407374+0000 mgr.a (mgr.14388) 2972 : audit [DBG] from='client.75543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:18 smithi044 bash[22676]: audit 2024-09-20T23:23:17.158620+0000 mon.a (mon.0) 3053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:18 smithi044 bash[22676]: audit 2024-09-20T23:23:17.167673+0000 mon.a (mon.0) 3054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:18 smithi044 bash[22676]: audit 2024-09-20T23:23:17.178621+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:18 smithi044 bash[22676]: cluster 2024-09-20T23:23:17.249648+0000 mgr.a (mgr.14388) 2973 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:18 smithi044 bash[22676]: audit 2024-09-20T23:23:17.746340+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:18 smithi044 bash[22676]: audit 2024-09-20T23:23:17.755013+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:18 smithi044 bash[22676]: audit 2024-09-20T23:23:17.764954+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:18 smithi049 bash[23528]: audit 2024-09-20T23:23:17.158620+0000 mon.a (mon.0) 3053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:18 smithi049 bash[23528]: audit 2024-09-20T23:23:17.167673+0000 mon.a (mon.0) 3054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:18 smithi049 bash[23528]: audit 2024-09-20T23:23:17.178621+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:18 smithi049 bash[23528]: cluster 2024-09-20T23:23:17.249648+0000 mgr.a (mgr.14388) 2973 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:18.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:18 smithi049 bash[23528]: audit 2024-09-20T23:23:17.746340+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:18 smithi049 bash[23528]: audit 2024-09-20T23:23:17.755013+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:18 smithi049 bash[23528]: audit 2024-09-20T23:23:17.764954+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:18 smithi179 bash[23186]: audit 2024-09-20T23:23:17.158620+0000 mon.a (mon.0) 3053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:18 smithi179 bash[23186]: audit 2024-09-20T23:23:17.167673+0000 mon.a (mon.0) 3054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:18 smithi179 bash[23186]: audit 2024-09-20T23:23:17.178621+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:18 smithi179 bash[23186]: cluster 2024-09-20T23:23:17.249648+0000 mgr.a (mgr.14388) 2973 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:18 smithi179 bash[23186]: audit 2024-09-20T23:23:17.746340+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:18 smithi179 bash[23186]: audit 2024-09-20T23:23:17.755013+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:18 smithi179 bash[23186]: audit 2024-09-20T23:23:17.764954+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:20 smithi044 bash[22676]: cluster 2024-09-20T23:23:19.250464+0000 mgr.a (mgr.14388) 2974 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:23:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:20 smithi044 bash[22676]: audit 2024-09-20T23:23:19.615670+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:20 smithi044 bash[22676]: audit 2024-09-20T23:23:19.623212+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:20 smithi044 bash[22676]: audit 2024-09-20T23:23:19.631321+0000 mon.a (mon.0) 3061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:20 smithi179 bash[23186]: cluster 2024-09-20T23:23:19.250464+0000 mgr.a (mgr.14388) 2974 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:23:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:20 smithi179 bash[23186]: audit 2024-09-20T23:23:19.615670+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:20 smithi179 bash[23186]: audit 2024-09-20T23:23:19.623212+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:20 smithi179 bash[23186]: audit 2024-09-20T23:23:19.631321+0000 mon.a (mon.0) 3061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:20 smithi049 bash[23528]: cluster 2024-09-20T23:23:19.250464+0000 mgr.a (mgr.14388) 2974 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:23:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:20 smithi049 bash[23528]: audit 2024-09-20T23:23:19.615670+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:20 smithi049 bash[23528]: audit 2024-09-20T23:23:19.623212+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:20 smithi049 bash[23528]: audit 2024-09-20T23:23:19.631321+0000 mon.a (mon.0) 3061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:21.606 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:22 smithi044 bash[22676]: audit 2024-09-20T23:23:21.170109+0000 mgr.a (mgr.14388) 2975 : audit [DBG] from='client.75621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:22 smithi044 bash[22676]: cluster 2024-09-20T23:23:21.251910+0000 mgr.a (mgr.14388) 2976 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:22 smithi179 bash[23186]: audit 2024-09-20T23:23:21.170109+0000 mgr.a (mgr.14388) 2975 : audit [DBG] from='client.75621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:22 smithi179 bash[23186]: cluster 2024-09-20T23:23:21.251910+0000 mgr.a (mgr.14388) 2976 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:22 smithi049 bash[23528]: audit 2024-09-20T23:23:21.170109+0000 mgr.a (mgr.14388) 2975 : audit [DBG] from='client.75621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:22 smithi049 bash[23528]: cluster 2024-09-20T23:23:21.251910+0000 mgr.a (mgr.14388) 2976 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:24 smithi044 bash[22676]: cluster 2024-09-20T23:23:23.252893+0000 mgr.a (mgr.14388) 2977 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:23:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:24 smithi179 bash[23186]: cluster 2024-09-20T23:23:23.252893+0000 mgr.a (mgr.14388) 2977 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:23:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:24 smithi049 bash[23528]: cluster 2024-09-20T23:23:23.252893+0000 mgr.a (mgr.14388) 2977 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:23:26.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:26.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:26.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:26 smithi044 bash[22676]: cluster 2024-09-20T23:23:25.255297+0000 mgr.a (mgr.14388) 2978 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:23:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:26 smithi179 bash[23186]: cluster 2024-09-20T23:23:25.255297+0000 mgr.a (mgr.14388) 2978 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:23:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:26 smithi049 bash[23528]: cluster 2024-09-20T23:23:25.255297+0000 mgr.a (mgr.14388) 2978 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:23:27.389 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:27.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:27.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:27.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:27.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:28 smithi044 bash[22676]: audit 2024-09-20T23:23:26.946229+0000 mgr.a (mgr.14388) 2979 : audit [DBG] from='client.75696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:28 smithi044 bash[22676]: cluster 2024-09-20T23:23:27.256000+0000 mgr.a (mgr.14388) 2980 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:28 smithi179 bash[23186]: audit 2024-09-20T23:23:26.946229+0000 mgr.a (mgr.14388) 2979 : audit [DBG] from='client.75696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:28 smithi179 bash[23186]: cluster 2024-09-20T23:23:27.256000+0000 mgr.a (mgr.14388) 2980 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:28 smithi049 bash[23528]: audit 2024-09-20T23:23:26.946229+0000 mgr.a (mgr.14388) 2979 : audit [DBG] from='client.75696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:28 smithi049 bash[23528]: cluster 2024-09-20T23:23:27.256000+0000 mgr.a (mgr.14388) 2980 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:30 smithi044 bash[22676]: cluster 2024-09-20T23:23:29.256935+0000 mgr.a (mgr.14388) 2981 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:30 smithi179 bash[23186]: cluster 2024-09-20T23:23:29.256935+0000 mgr.a (mgr.14388) 2981 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:30 smithi049 bash[23528]: cluster 2024-09-20T23:23:29.256935+0000 mgr.a (mgr.14388) 2981 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:31 smithi044 bash[22676]: cluster 2024-09-20T23:23:31.259292+0000 mgr.a (mgr.14388) 2982 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:31 smithi179 bash[23186]: cluster 2024-09-20T23:23:31.259292+0000 mgr.a (mgr.14388) 2982 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:31 smithi049 bash[23528]: cluster 2024-09-20T23:23:31.259292+0000 mgr.a (mgr.14388) 2982 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:32.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:32.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:33.165 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:32 smithi179 bash[23186]: audit 2024-09-20T23:23:32.726304+0000 mgr.a (mgr.14388) 2983 : audit [DBG] from='client.75774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:33.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:32 smithi044 bash[22676]: audit 2024-09-20T23:23:32.726304+0000 mgr.a (mgr.14388) 2983 : audit [DBG] from='client.75774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:32 smithi049 bash[23528]: audit 2024-09-20T23:23:32.726304+0000 mgr.a (mgr.14388) 2983 : audit [DBG] from='client.75774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:33 smithi044 bash[22676]: cluster 2024-09-20T23:23:33.260292+0000 mgr.a (mgr.14388) 2984 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:34.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:33 smithi179 bash[23186]: cluster 2024-09-20T23:23:33.260292+0000 mgr.a (mgr.14388) 2984 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:33 smithi049 bash[23528]: cluster 2024-09-20T23:23:33.260292+0000 mgr.a (mgr.14388) 2984 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:36.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:36 smithi049 bash[23528]: cluster 2024-09-20T23:23:35.262557+0000 mgr.a (mgr.14388) 2985 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:36 smithi044 bash[22676]: cluster 2024-09-20T23:23:35.262557+0000 mgr.a (mgr.14388) 2985 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:36 smithi179 bash[23186]: cluster 2024-09-20T23:23:35.262557+0000 mgr.a (mgr.14388) 2985 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:38.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:38.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:38 smithi044 bash[22676]: cluster 2024-09-20T23:23:37.263325+0000 mgr.a (mgr.14388) 2986 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:38 smithi044 bash[22676]: audit 2024-09-20T23:23:37.396046+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:38 smithi044 bash[22676]: audit 2024-09-20T23:23:37.404909+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:38 smithi044 bash[22676]: audit 2024-09-20T23:23:37.415352+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:38 smithi044 bash[22676]: audit 2024-09-20T23:23:37.960576+0000 mon.a (mon.0) 3065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:38 smithi044 bash[22676]: audit 2024-09-20T23:23:37.968890+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:38 smithi044 bash[22676]: audit 2024-09-20T23:23:37.978878+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:38 smithi049 bash[23528]: cluster 2024-09-20T23:23:37.263325+0000 mgr.a (mgr.14388) 2986 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:38.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:38 smithi049 bash[23528]: audit 2024-09-20T23:23:37.396046+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:38 smithi049 bash[23528]: audit 2024-09-20T23:23:37.404909+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:38 smithi049 bash[23528]: audit 2024-09-20T23:23:37.415352+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:38 smithi049 bash[23528]: audit 2024-09-20T23:23:37.960576+0000 mon.a (mon.0) 3065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:38 smithi049 bash[23528]: audit 2024-09-20T23:23:37.968890+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:38 smithi049 bash[23528]: audit 2024-09-20T23:23:37.978878+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:38 smithi179 bash[23186]: cluster 2024-09-20T23:23:37.263325+0000 mgr.a (mgr.14388) 2986 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:38 smithi179 bash[23186]: audit 2024-09-20T23:23:37.396046+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:38 smithi179 bash[23186]: audit 2024-09-20T23:23:37.404909+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:38 smithi179 bash[23186]: audit 2024-09-20T23:23:37.415352+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:38 smithi179 bash[23186]: audit 2024-09-20T23:23:37.960576+0000 mon.a (mon.0) 3065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:38 smithi179 bash[23186]: audit 2024-09-20T23:23:37.968890+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:38 smithi179 bash[23186]: audit 2024-09-20T23:23:37.978878+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:38.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:38.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:38.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:38.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:38.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:39 smithi044 bash[22676]: audit 2024-09-20T23:23:38.511766+0000 mgr.a (mgr.14388) 2987 : audit [DBG] from='client.75852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:39 smithi179 bash[23186]: audit 2024-09-20T23:23:38.511766+0000 mgr.a (mgr.14388) 2987 : audit [DBG] from='client.75852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:39 smithi049 bash[23528]: audit 2024-09-20T23:23:38.511766+0000 mgr.a (mgr.14388) 2987 : audit [DBG] from='client.75852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:40 smithi044 bash[22676]: cluster 2024-09-20T23:23:39.264353+0000 mgr.a (mgr.14388) 2988 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:40 smithi044 bash[22676]: audit 2024-09-20T23:23:39.854360+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:40 smithi044 bash[22676]: audit 2024-09-20T23:23:39.860791+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:40 smithi044 bash[22676]: audit 2024-09-20T23:23:39.871063+0000 mon.a (mon.0) 3070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:40 smithi179 bash[23186]: cluster 2024-09-20T23:23:39.264353+0000 mgr.a (mgr.14388) 2988 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:40 smithi179 bash[23186]: audit 2024-09-20T23:23:39.854360+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:40 smithi179 bash[23186]: audit 2024-09-20T23:23:39.860791+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:40 smithi179 bash[23186]: audit 2024-09-20T23:23:39.871063+0000 mon.a (mon.0) 3070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:40 smithi049 bash[23528]: cluster 2024-09-20T23:23:39.264353+0000 mgr.a (mgr.14388) 2988 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:40 smithi049 bash[23528]: audit 2024-09-20T23:23:39.854360+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:40 smithi049 bash[23528]: audit 2024-09-20T23:23:39.860791+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:40 smithi049 bash[23528]: audit 2024-09-20T23:23:39.871063+0000 mon.a (mon.0) 3070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:42 smithi044 bash[22676]: cluster 2024-09-20T23:23:41.266644+0000 mgr.a (mgr.14388) 2989 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:42 smithi179 bash[23186]: cluster 2024-09-20T23:23:41.266644+0000 mgr.a (mgr.14388) 2989 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:42 smithi049 bash[23528]: cluster 2024-09-20T23:23:41.266644+0000 mgr.a (mgr.14388) 2989 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:43.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:43.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:43.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:44.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:44.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:44.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:44.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:44 smithi044 bash[22676]: cluster 2024-09-20T23:23:43.267385+0000 mgr.a (mgr.14388) 2990 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:44 smithi179 bash[23186]: cluster 2024-09-20T23:23:43.267385+0000 mgr.a (mgr.14388) 2990 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:44 smithi049 bash[23528]: cluster 2024-09-20T23:23:43.267385+0000 mgr.a (mgr.14388) 2990 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:45 smithi044 bash[22676]: audit 2024-09-20T23:23:44.297152+0000 mgr.a (mgr.14388) 2991 : audit [DBG] from='client.75924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:45 smithi179 bash[23186]: audit 2024-09-20T23:23:44.297152+0000 mgr.a (mgr.14388) 2991 : audit [DBG] from='client.75924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:45 smithi049 bash[23528]: audit 2024-09-20T23:23:44.297152+0000 mgr.a (mgr.14388) 2991 : audit [DBG] from='client.75924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:46 smithi044 bash[22676]: cluster 2024-09-20T23:23:45.269698+0000 mgr.a (mgr.14388) 2992 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:46 smithi179 bash[23186]: cluster 2024-09-20T23:23:45.269698+0000 mgr.a (mgr.14388) 2992 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:46 smithi049 bash[23528]: cluster 2024-09-20T23:23:45.269698+0000 mgr.a (mgr.14388) 2992 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:23:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:48 smithi044 bash[22676]: cluster 2024-09-20T23:23:47.270577+0000 mgr.a (mgr.14388) 2993 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:48 smithi179 bash[23186]: cluster 2024-09-20T23:23:47.270577+0000 mgr.a (mgr.14388) 2993 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:48 smithi049 bash[23528]: cluster 2024-09-20T23:23:47.270577+0000 mgr.a (mgr.14388) 2993 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:49.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:49.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:50.514 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:50.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:50.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:50.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:50.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:50 smithi044 bash[22676]: cluster 2024-09-20T23:23:49.271177+0000 mgr.a (mgr.14388) 2994 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:50 smithi179 bash[23186]: cluster 2024-09-20T23:23:49.271177+0000 mgr.a (mgr.14388) 2994 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:50 smithi049 bash[23528]: cluster 2024-09-20T23:23:49.271177+0000 mgr.a (mgr.14388) 2994 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:51 smithi044 bash[22676]: audit 2024-09-20T23:23:50.069014+0000 mgr.a (mgr.14388) 2995 : audit [DBG] from='client.76002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:51 smithi179 bash[23186]: audit 2024-09-20T23:23:50.069014+0000 mgr.a (mgr.14388) 2995 : audit [DBG] from='client.76002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:51 smithi049 bash[23528]: audit 2024-09-20T23:23:50.069014+0000 mgr.a (mgr.14388) 2995 : audit [DBG] from='client.76002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:52 smithi044 bash[22676]: cluster 2024-09-20T23:23:51.273920+0000 mgr.a (mgr.14388) 2996 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:52 smithi179 bash[23186]: cluster 2024-09-20T23:23:51.273920+0000 mgr.a (mgr.14388) 2996 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:52 smithi049 bash[23528]: cluster 2024-09-20T23:23:51.273920+0000 mgr.a (mgr.14388) 2996 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:54 smithi044 bash[22676]: cluster 2024-09-20T23:23:53.274720+0000 mgr.a (mgr.14388) 2997 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:54 smithi179 bash[23186]: cluster 2024-09-20T23:23:53.274720+0000 mgr.a (mgr.14388) 2997 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:54 smithi049 bash[23528]: cluster 2024-09-20T23:23:53.274720+0000 mgr.a (mgr.14388) 2997 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:23:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:23:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:23:56.262 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:23:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:23:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:23:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:23:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:23:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:56 smithi044 bash[22676]: cluster 2024-09-20T23:23:55.276629+0000 mgr.a (mgr.14388) 2998 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:56 smithi179 bash[23186]: cluster 2024-09-20T23:23:55.276629+0000 mgr.a (mgr.14388) 2998 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:56 smithi049 bash[23528]: cluster 2024-09-20T23:23:55.276629+0000 mgr.a (mgr.14388) 2998 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:23:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:57 smithi044 bash[22676]: audit 2024-09-20T23:23:55.847936+0000 mgr.a (mgr.14388) 2999 : audit [DBG] from='client.76080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:57 smithi179 bash[23186]: audit 2024-09-20T23:23:55.847936+0000 mgr.a (mgr.14388) 2999 : audit [DBG] from='client.76080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:57 smithi049 bash[23528]: audit 2024-09-20T23:23:55.847936+0000 mgr.a (mgr.14388) 2999 : audit [DBG] from='client.76080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:23:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:58 smithi049 bash[23528]: cluster 2024-09-20T23:23:57.277765+0000 mgr.a (mgr.14388) 3000 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:58 smithi049 bash[23528]: audit 2024-09-20T23:23:57.623848+0000 mon.a (mon.0) 3071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:58 smithi049 bash[23528]: audit 2024-09-20T23:23:57.632937+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:58 smithi049 bash[23528]: audit 2024-09-20T23:23:57.643585+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:58 smithi049 bash[23528]: audit 2024-09-20T23:23:58.189703+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:58 smithi049 bash[23528]: audit 2024-09-20T23:23:58.198455+0000 mon.a (mon.0) 3075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:23:58 smithi049 bash[23528]: audit 2024-09-20T23:23:58.208857+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:58 smithi044 bash[22676]: cluster 2024-09-20T23:23:57.277765+0000 mgr.a (mgr.14388) 3000 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:58 smithi044 bash[22676]: audit 2024-09-20T23:23:57.623848+0000 mon.a (mon.0) 3071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:58 smithi044 bash[22676]: audit 2024-09-20T23:23:57.632937+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:58 smithi044 bash[22676]: audit 2024-09-20T23:23:57.643585+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:58 smithi044 bash[22676]: audit 2024-09-20T23:23:58.189703+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:58 smithi044 bash[22676]: audit 2024-09-20T23:23:58.198455+0000 mon.a (mon.0) 3075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:23:58 smithi044 bash[22676]: audit 2024-09-20T23:23:58.208857+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:58 smithi179 bash[23186]: cluster 2024-09-20T23:23:57.277765+0000 mgr.a (mgr.14388) 3000 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:23:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:58 smithi179 bash[23186]: audit 2024-09-20T23:23:57.623848+0000 mon.a (mon.0) 3071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:58 smithi179 bash[23186]: audit 2024-09-20T23:23:57.632937+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:58 smithi179 bash[23186]: audit 2024-09-20T23:23:57.643585+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:58 smithi179 bash[23186]: audit 2024-09-20T23:23:58.189703+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:58 smithi179 bash[23186]: audit 2024-09-20T23:23:58.198455+0000 mon.a (mon.0) 3075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:23:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:23:58 smithi179 bash[23186]: audit 2024-09-20T23:23:58.208857+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: cluster 2024-09-20T23:23:59.278589+0000 mgr.a (mgr.14388) 3001 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.086230+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.094234+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.104052+0000 mon.a (mon.0) 3079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.343616+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.350144+0000 mon.a (mon.0) 3081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.352106+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.363494+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:00 smithi044 bash[22676]: audit 2024-09-20T23:24:00.369670+0000 mon.a (mon.0) 3084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: cluster 2024-09-20T23:23:59.278589+0000 mgr.a (mgr.14388) 3001 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.086230+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.094234+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.104052+0000 mon.a (mon.0) 3079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.343616+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.350144+0000 mon.a (mon.0) 3081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.352106+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.363494+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:00 smithi179 bash[23186]: audit 2024-09-20T23:24:00.369670+0000 mon.a (mon.0) 3084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:24:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: cluster 2024-09-20T23:23:59.278589+0000 mgr.a (mgr.14388) 3001 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:24:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.086230+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.094234+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.104052+0000 mon.a (mon.0) 3079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.343616+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:24:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.350144+0000 mon.a (mon.0) 3081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:24:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.352106+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:24:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.363494+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:00 smithi049 bash[23528]: audit 2024-09-20T23:24:00.369670+0000 mon.a (mon.0) 3084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:24:01.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:01.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:01.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:01.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:24:01 smithi044 bash[22930]: debug 2024-09-20T23:24:01.160+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:24:01.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:24:01 smithi044 bash[22930]: debug 2024-09-20T23:24:01.160+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:24:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:01 smithi044 bash[22676]: audit 2024-09-20T23:24:00.372038+0000 mgr.a (mgr.14388) 3002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:24:02.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:01 smithi179 bash[23186]: audit 2024-09-20T23:24:00.372038+0000 mgr.a (mgr.14388) 3002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:24:02.021 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:02.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:02.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:02.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:02.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:01 smithi049 bash[23528]: audit 2024-09-20T23:24:00.372038+0000 mgr.a (mgr.14388) 3002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:24:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:02 smithi044 bash[22676]: audit 2024-09-20T23:24:01.161909+0000 mgr.a (mgr.14388) 3003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:24:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:02 smithi044 bash[22676]: cephadm 2024-09-20T23:24:01.163740+0000 mgr.a (mgr.14388) 3004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:24:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:02 smithi044 bash[22676]: cluster 2024-09-20T23:24:01.280443+0000 mgr.a (mgr.14388) 3005 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:02 smithi044 bash[22676]: audit 2024-09-20T23:24:01.591222+0000 mgr.a (mgr.14388) 3006 : audit [DBG] from='client.76263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:02 smithi179 bash[23186]: audit 2024-09-20T23:24:01.161909+0000 mgr.a (mgr.14388) 3003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:24:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:02 smithi179 bash[23186]: cephadm 2024-09-20T23:24:01.163740+0000 mgr.a (mgr.14388) 3004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:24:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:02 smithi179 bash[23186]: cluster 2024-09-20T23:24:01.280443+0000 mgr.a (mgr.14388) 3005 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:02 smithi179 bash[23186]: audit 2024-09-20T23:24:01.591222+0000 mgr.a (mgr.14388) 3006 : audit [DBG] from='client.76263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:02 smithi049 bash[23528]: audit 2024-09-20T23:24:01.161909+0000 mgr.a (mgr.14388) 3003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:02 smithi049 bash[23528]: cephadm 2024-09-20T23:24:01.163740+0000 mgr.a (mgr.14388) 3004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:02 smithi049 bash[23528]: cluster 2024-09-20T23:24:01.280443+0000 mgr.a (mgr.14388) 3005 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:02 smithi049 bash[23528]: audit 2024-09-20T23:24:01.591222+0000 mgr.a (mgr.14388) 3006 : audit [DBG] from='client.76263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:04 smithi044 bash[22676]: cluster 2024-09-20T23:24:03.281395+0000 mgr.a (mgr.14388) 3007 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:04 smithi179 bash[23186]: cluster 2024-09-20T23:24:03.281395+0000 mgr.a (mgr.14388) 3007 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:04 smithi049 bash[23528]: cluster 2024-09-20T23:24:03.281395+0000 mgr.a (mgr.14388) 3007 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:06 smithi044 bash[22676]: cluster 2024-09-20T23:24:05.283528+0000 mgr.a (mgr.14388) 3008 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:06 smithi179 bash[23186]: cluster 2024-09-20T23:24:05.283528+0000 mgr.a (mgr.14388) 3008 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:07.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:07.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:07.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:06 smithi049 bash[23528]: cluster 2024-09-20T23:24:05.283528+0000 mgr.a (mgr.14388) 3008 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:07.807 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:08 smithi044 bash[22676]: cluster 2024-09-20T23:24:07.284303+0000 mgr.a (mgr.14388) 3009 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:08 smithi044 bash[22676]: audit 2024-09-20T23:24:07.357705+0000 mgr.a (mgr.14388) 3010 : audit [DBG] from='client.76341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:08 smithi179 bash[23186]: cluster 2024-09-20T23:24:07.284303+0000 mgr.a (mgr.14388) 3009 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:08 smithi179 bash[23186]: audit 2024-09-20T23:24:07.357705+0000 mgr.a (mgr.14388) 3010 : audit [DBG] from='client.76341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:08 smithi049 bash[23528]: cluster 2024-09-20T23:24:07.284303+0000 mgr.a (mgr.14388) 3009 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:08 smithi049 bash[23528]: audit 2024-09-20T23:24:07.357705+0000 mgr.a (mgr.14388) 3010 : audit [DBG] from='client.76341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:10.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:10 smithi044 bash[22676]: cluster 2024-09-20T23:24:09.285241+0000 mgr.a (mgr.14388) 3011 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:10 smithi179 bash[23186]: cluster 2024-09-20T23:24:09.285241+0000 mgr.a (mgr.14388) 3011 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:10 smithi049 bash[23528]: cluster 2024-09-20T23:24:09.285241+0000 mgr.a (mgr.14388) 3011 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:12 smithi044 bash[22676]: cluster 2024-09-20T23:24:11.287537+0000 mgr.a (mgr.14388) 3012 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:12 smithi179 bash[23186]: cluster 2024-09-20T23:24:11.287537+0000 mgr.a (mgr.14388) 3012 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:12 smithi049 bash[23528]: cluster 2024-09-20T23:24:11.287537+0000 mgr.a (mgr.14388) 3012 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:13.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:13.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:13.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:13.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:14.917 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:14 smithi179 bash[23186]: audit 2024-09-20T23:24:13.147831+0000 mgr.a (mgr.14388) 3013 : audit [DBG] from='client.76419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:14.917 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:14 smithi179 bash[23186]: cluster 2024-09-20T23:24:13.290262+0000 mgr.a (mgr.14388) 3014 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:14 smithi044 bash[22676]: audit 2024-09-20T23:24:13.147831+0000 mgr.a (mgr.14388) 3013 : audit [DBG] from='client.76419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:14 smithi044 bash[22676]: cluster 2024-09-20T23:24:13.290262+0000 mgr.a (mgr.14388) 3014 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:14 smithi049 bash[23528]: audit 2024-09-20T23:24:13.147831+0000 mgr.a (mgr.14388) 3013 : audit [DBG] from='client.76419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:14 smithi049 bash[23528]: cluster 2024-09-20T23:24:13.290262+0000 mgr.a (mgr.14388) 3014 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:16.941 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:16 smithi179 bash[23186]: cluster 2024-09-20T23:24:15.292574+0000 mgr.a (mgr.14388) 3015 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:16.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:16 smithi049 bash[23528]: cluster 2024-09-20T23:24:15.292574+0000 mgr.a (mgr.14388) 3015 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:16 smithi044 bash[22676]: cluster 2024-09-20T23:24:15.292574+0000 mgr.a (mgr.14388) 3015 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:24:18.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:18.583 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:18.583 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:18 smithi179 bash[23186]: cluster 2024-09-20T23:24:17.293359+0000 mgr.a (mgr.14388) 3016 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:18 smithi179 bash[23186]: audit 2024-09-20T23:24:17.825183+0000 mon.a (mon.0) 3085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:18 smithi179 bash[23186]: audit 2024-09-20T23:24:17.834934+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:18 smithi179 bash[23186]: audit 2024-09-20T23:24:17.845525+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:18 smithi179 bash[23186]: audit 2024-09-20T23:24:18.413976+0000 mon.a (mon.0) 3088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:18 smithi179 bash[23186]: audit 2024-09-20T23:24:18.422558+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:18 smithi179 bash[23186]: audit 2024-09-20T23:24:18.432824+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:18 smithi049 bash[23528]: cluster 2024-09-20T23:24:17.293359+0000 mgr.a (mgr.14388) 3016 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:18 smithi049 bash[23528]: audit 2024-09-20T23:24:17.825183+0000 mon.a (mon.0) 3085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:18 smithi049 bash[23528]: audit 2024-09-20T23:24:17.834934+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:18 smithi049 bash[23528]: audit 2024-09-20T23:24:17.845525+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:18 smithi049 bash[23528]: audit 2024-09-20T23:24:18.413976+0000 mon.a (mon.0) 3088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:18 smithi049 bash[23528]: audit 2024-09-20T23:24:18.422558+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:18 smithi049 bash[23528]: audit 2024-09-20T23:24:18.432824+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:18 smithi044 bash[22676]: cluster 2024-09-20T23:24:17.293359+0000 mgr.a (mgr.14388) 3016 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:18 smithi044 bash[22676]: audit 2024-09-20T23:24:17.825183+0000 mon.a (mon.0) 3085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:18 smithi044 bash[22676]: audit 2024-09-20T23:24:17.834934+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:18 smithi044 bash[22676]: audit 2024-09-20T23:24:17.845525+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:18 smithi044 bash[22676]: audit 2024-09-20T23:24:18.413976+0000 mon.a (mon.0) 3088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:18 smithi044 bash[22676]: audit 2024-09-20T23:24:18.422558+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:18 smithi044 bash[22676]: audit 2024-09-20T23:24:18.432824+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:19.367 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:20 smithi044 bash[22676]: audit 2024-09-20T23:24:18.920548+0000 mgr.a (mgr.14388) 3017 : audit [DBG] from='client.76497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:20 smithi044 bash[22676]: cluster 2024-09-20T23:24:19.294026+0000 mgr.a (mgr.14388) 3018 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:20 smithi044 bash[22676]: audit 2024-09-20T23:24:20.331019+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:20 smithi044 bash[22676]: audit 2024-09-20T23:24:20.339118+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:20 smithi044 bash[22676]: audit 2024-09-20T23:24:20.349305+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:20 smithi179 bash[23186]: audit 2024-09-20T23:24:18.920548+0000 mgr.a (mgr.14388) 3017 : audit [DBG] from='client.76497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:20 smithi179 bash[23186]: cluster 2024-09-20T23:24:19.294026+0000 mgr.a (mgr.14388) 3018 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:20 smithi179 bash[23186]: audit 2024-09-20T23:24:20.331019+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:20 smithi179 bash[23186]: audit 2024-09-20T23:24:20.339118+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:20 smithi179 bash[23186]: audit 2024-09-20T23:24:20.349305+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:20 smithi049 bash[23528]: audit 2024-09-20T23:24:18.920548+0000 mgr.a (mgr.14388) 3017 : audit [DBG] from='client.76497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:20 smithi049 bash[23528]: cluster 2024-09-20T23:24:19.294026+0000 mgr.a (mgr.14388) 3018 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:20 smithi049 bash[23528]: audit 2024-09-20T23:24:20.331019+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:20 smithi049 bash[23528]: audit 2024-09-20T23:24:20.339118+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:20 smithi049 bash[23528]: audit 2024-09-20T23:24:20.349305+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:22 smithi044 bash[22676]: cluster 2024-09-20T23:24:21.296207+0000 mgr.a (mgr.14388) 3019 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:22 smithi179 bash[23186]: cluster 2024-09-20T23:24:21.296207+0000 mgr.a (mgr.14388) 3019 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:22 smithi049 bash[23528]: cluster 2024-09-20T23:24:21.296207+0000 mgr.a (mgr.14388) 3019 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:24.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:24.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:24.370 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:24 smithi044 bash[22676]: cluster 2024-09-20T23:24:23.296953+0000 mgr.a (mgr.14388) 3020 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:24 smithi179 bash[23186]: cluster 2024-09-20T23:24:23.296953+0000 mgr.a (mgr.14388) 3020 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:24 smithi049 bash[23528]: cluster 2024-09-20T23:24:23.296953+0000 mgr.a (mgr.14388) 3020 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:25.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:25.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:25.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:25.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:25.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:25 smithi044 bash[22676]: audit 2024-09-20T23:24:24.703392+0000 mgr.a (mgr.14388) 3021 : audit [DBG] from='client.76575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:25 smithi179 bash[23186]: audit 2024-09-20T23:24:24.703392+0000 mgr.a (mgr.14388) 3021 : audit [DBG] from='client.76575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:25 smithi049 bash[23528]: audit 2024-09-20T23:24:24.703392+0000 mgr.a (mgr.14388) 3021 : audit [DBG] from='client.76575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:26 smithi044 bash[22676]: cluster 2024-09-20T23:24:25.299211+0000 mgr.a (mgr.14388) 3022 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:24:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:26 smithi179 bash[23186]: cluster 2024-09-20T23:24:25.299211+0000 mgr.a (mgr.14388) 3022 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:24:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:26 smithi049 bash[23528]: cluster 2024-09-20T23:24:25.299211+0000 mgr.a (mgr.14388) 3022 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:24:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:28 smithi044 bash[22676]: cluster 2024-09-20T23:24:27.299961+0000 mgr.a (mgr.14388) 3023 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:24:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:28 smithi179 bash[23186]: cluster 2024-09-20T23:24:27.299961+0000 mgr.a (mgr.14388) 3023 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:24:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:28 smithi049 bash[23528]: cluster 2024-09-20T23:24:27.299961+0000 mgr.a (mgr.14388) 3023 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:24:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:30.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:30.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:30 smithi044 bash[22676]: cluster 2024-09-20T23:24:29.300711+0000 mgr.a (mgr.14388) 3024 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:24:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:30 smithi179 bash[23186]: cluster 2024-09-20T23:24:29.300711+0000 mgr.a (mgr.14388) 3024 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:24:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:30 smithi049 bash[23528]: cluster 2024-09-20T23:24:29.300711+0000 mgr.a (mgr.14388) 3024 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:24:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:31 smithi044 bash[22676]: audit 2024-09-20T23:24:30.464968+0000 mgr.a (mgr.14388) 3025 : audit [DBG] from='client.76653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:31 smithi179 bash[23186]: audit 2024-09-20T23:24:30.464968+0000 mgr.a (mgr.14388) 3025 : audit [DBG] from='client.76653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:31 smithi049 bash[23528]: audit 2024-09-20T23:24:30.464968+0000 mgr.a (mgr.14388) 3025 : audit [DBG] from='client.76653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:32 smithi044 bash[22676]: cluster 2024-09-20T23:24:31.303292+0000 mgr.a (mgr.14388) 3026 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:32 smithi179 bash[23186]: cluster 2024-09-20T23:24:31.303292+0000 mgr.a (mgr.14388) 3026 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:32 smithi049 bash[23528]: cluster 2024-09-20T23:24:31.303292+0000 mgr.a (mgr.14388) 3026 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:34 smithi044 bash[22676]: cluster 2024-09-20T23:24:33.304081+0000 mgr.a (mgr.14388) 3027 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:24:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:34 smithi179 bash[23186]: cluster 2024-09-20T23:24:33.304081+0000 mgr.a (mgr.14388) 3027 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:24:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:34 smithi049 bash[23528]: cluster 2024-09-20T23:24:33.304081+0000 mgr.a (mgr.14388) 3027 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:24:35.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:35.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:35.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:36.671 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:36.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:36.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:36.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:36.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:36 smithi044 bash[22676]: cluster 2024-09-20T23:24:35.306125+0000 mgr.a (mgr.14388) 3028 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:36 smithi179 bash[23186]: cluster 2024-09-20T23:24:35.306125+0000 mgr.a (mgr.14388) 3028 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:36 smithi049 bash[23528]: cluster 2024-09-20T23:24:35.306125+0000 mgr.a (mgr.14388) 3028 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:37 smithi044 bash[22676]: audit 2024-09-20T23:24:36.224402+0000 mgr.a (mgr.14388) 3029 : audit [DBG] from='client.76731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:37 smithi179 bash[23186]: audit 2024-09-20T23:24:36.224402+0000 mgr.a (mgr.14388) 3029 : audit [DBG] from='client.76731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:38.022 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:37 smithi049 bash[23528]: audit 2024-09-20T23:24:36.224402+0000 mgr.a (mgr.14388) 3029 : audit [DBG] from='client.76731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:38 smithi049 bash[23528]: cluster 2024-09-20T23:24:37.307044+0000 mgr.a (mgr.14388) 3030 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:24:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:38 smithi049 bash[23528]: audit 2024-09-20T23:24:38.000998+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:38 smithi049 bash[23528]: audit 2024-09-20T23:24:38.010051+0000 mon.a (mon.0) 3095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:38 smithi049 bash[23528]: audit 2024-09-20T23:24:38.020835+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:38 smithi049 bash[23528]: audit 2024-09-20T23:24:38.621103+0000 mon.a (mon.0) 3097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:38 smithi049 bash[23528]: audit 2024-09-20T23:24:38.630006+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:38 smithi049 bash[23528]: audit 2024-09-20T23:24:38.640506+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:38 smithi044 bash[22676]: cluster 2024-09-20T23:24:37.307044+0000 mgr.a (mgr.14388) 3030 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:38 smithi044 bash[22676]: audit 2024-09-20T23:24:38.000998+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:38 smithi044 bash[22676]: audit 2024-09-20T23:24:38.010051+0000 mon.a (mon.0) 3095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:38 smithi044 bash[22676]: audit 2024-09-20T23:24:38.020835+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:38 smithi044 bash[22676]: audit 2024-09-20T23:24:38.621103+0000 mon.a (mon.0) 3097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:38 smithi044 bash[22676]: audit 2024-09-20T23:24:38.630006+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:38 smithi044 bash[22676]: audit 2024-09-20T23:24:38.640506+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:38 smithi179 bash[23186]: cluster 2024-09-20T23:24:37.307044+0000 mgr.a (mgr.14388) 3030 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:24:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:38 smithi179 bash[23186]: audit 2024-09-20T23:24:38.000998+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:38 smithi179 bash[23186]: audit 2024-09-20T23:24:38.010051+0000 mon.a (mon.0) 3095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:38 smithi179 bash[23186]: audit 2024-09-20T23:24:38.020835+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:38 smithi179 bash[23186]: audit 2024-09-20T23:24:38.621103+0000 mon.a (mon.0) 3097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:38 smithi179 bash[23186]: audit 2024-09-20T23:24:38.630006+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:38 smithi179 bash[23186]: audit 2024-09-20T23:24:38.640506+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:40 smithi044 bash[22676]: cluster 2024-09-20T23:24:39.307815+0000 mgr.a (mgr.14388) 3031 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:24:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:40 smithi044 bash[22676]: audit 2024-09-20T23:24:40.562489+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:40 smithi044 bash[22676]: audit 2024-09-20T23:24:40.573388+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:40 smithi044 bash[22676]: audit 2024-09-20T23:24:40.583195+0000 mon.a (mon.0) 3102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:40 smithi179 bash[23186]: cluster 2024-09-20T23:24:39.307815+0000 mgr.a (mgr.14388) 3031 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:24:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:40 smithi179 bash[23186]: audit 2024-09-20T23:24:40.562489+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:40 smithi179 bash[23186]: audit 2024-09-20T23:24:40.573388+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:40 smithi179 bash[23186]: audit 2024-09-20T23:24:40.583195+0000 mon.a (mon.0) 3102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:40 smithi049 bash[23528]: cluster 2024-09-20T23:24:39.307815+0000 mgr.a (mgr.14388) 3031 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:24:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:40 smithi049 bash[23528]: audit 2024-09-20T23:24:40.562489+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:40 smithi049 bash[23528]: audit 2024-09-20T23:24:40.573388+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:40 smithi049 bash[23528]: audit 2024-09-20T23:24:40.583195+0000 mon.a (mon.0) 3102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:41.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:41.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:41.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:41 smithi044 bash[22676]: cluster 2024-09-20T23:24:41.310036+0000 mgr.a (mgr.14388) 3032 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:24:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:41 smithi179 bash[23186]: cluster 2024-09-20T23:24:41.310036+0000 mgr.a (mgr.14388) 3032 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:24:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:41 smithi049 bash[23528]: cluster 2024-09-20T23:24:41.310036+0000 mgr.a (mgr.14388) 3032 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:24:42.430 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:42.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:42.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:42.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:42.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:42 smithi044 bash[22676]: audit 2024-09-20T23:24:42.006512+0000 mgr.a (mgr.14388) 3033 : audit [DBG] from='client.76809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:42 smithi179 bash[23186]: audit 2024-09-20T23:24:42.006512+0000 mgr.a (mgr.14388) 3033 : audit [DBG] from='client.76809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:42 smithi049 bash[23528]: audit 2024-09-20T23:24:42.006512+0000 mgr.a (mgr.14388) 3033 : audit [DBG] from='client.76809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:43 smithi179 bash[23186]: cluster 2024-09-20T23:24:43.310977+0000 mgr.a (mgr.14388) 3034 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:43 smithi049 bash[23528]: cluster 2024-09-20T23:24:43.310977+0000 mgr.a (mgr.14388) 3034 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:43 smithi044 bash[22676]: cluster 2024-09-20T23:24:43.310977+0000 mgr.a (mgr.14388) 3034 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:46 smithi044 bash[22676]: cluster 2024-09-20T23:24:45.313125+0000 mgr.a (mgr.14388) 3035 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:46 smithi179 bash[23186]: cluster 2024-09-20T23:24:45.313125+0000 mgr.a (mgr.14388) 3035 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:46 smithi049 bash[23528]: cluster 2024-09-20T23:24:45.313125+0000 mgr.a (mgr.14388) 3035 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:47.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:47.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:47.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:48.181 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:48.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:48.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:48.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:48.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:48 smithi044 bash[22676]: cluster 2024-09-20T23:24:47.313903+0000 mgr.a (mgr.14388) 3036 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:48 smithi044 bash[22676]: audit 2024-09-20T23:24:47.767381+0000 mgr.a (mgr.14388) 3037 : audit [DBG] from='client.76887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:48 smithi179 bash[23186]: cluster 2024-09-20T23:24:47.313903+0000 mgr.a (mgr.14388) 3036 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:48 smithi179 bash[23186]: audit 2024-09-20T23:24:47.767381+0000 mgr.a (mgr.14388) 3037 : audit [DBG] from='client.76887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:48 smithi049 bash[23528]: cluster 2024-09-20T23:24:47.313903+0000 mgr.a (mgr.14388) 3036 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:48 smithi049 bash[23528]: audit 2024-09-20T23:24:47.767381+0000 mgr.a (mgr.14388) 3037 : audit [DBG] from='client.76887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:50 smithi044 bash[22676]: cluster 2024-09-20T23:24:49.314899+0000 mgr.a (mgr.14388) 3038 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:50 smithi179 bash[23186]: cluster 2024-09-20T23:24:49.314899+0000 mgr.a (mgr.14388) 3038 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:50 smithi049 bash[23528]: cluster 2024-09-20T23:24:49.314899+0000 mgr.a (mgr.14388) 3038 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:52 smithi044 bash[22676]: cluster 2024-09-20T23:24:51.316265+0000 mgr.a (mgr.14388) 3039 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:52 smithi179 bash[23186]: cluster 2024-09-20T23:24:51.316265+0000 mgr.a (mgr.14388) 3039 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:52 smithi049 bash[23528]: cluster 2024-09-20T23:24:51.316265+0000 mgr.a (mgr.14388) 3039 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:53.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:53.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:53.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:53.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:53.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:24:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:54 smithi044 bash[22676]: cluster 2024-09-20T23:24:53.316738+0000 mgr.a (mgr.14388) 3040 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:54 smithi044 bash[22676]: audit 2024-09-20T23:24:53.508311+0000 mgr.a (mgr.14388) 3041 : audit [DBG] from='client.76965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:54 smithi179 bash[23186]: cluster 2024-09-20T23:24:53.316738+0000 mgr.a (mgr.14388) 3040 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:54 smithi179 bash[23186]: audit 2024-09-20T23:24:53.508311+0000 mgr.a (mgr.14388) 3041 : audit [DBG] from='client.76965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:54 smithi049 bash[23528]: cluster 2024-09-20T23:24:53.316738+0000 mgr.a (mgr.14388) 3040 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:54 smithi049 bash[23528]: audit 2024-09-20T23:24:53.508311+0000 mgr.a (mgr.14388) 3041 : audit [DBG] from='client.76965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:24:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:56 smithi179 bash[23186]: cluster 2024-09-20T23:24:55.319088+0000 mgr.a (mgr.14388) 3042 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:56 smithi049 bash[23528]: cluster 2024-09-20T23:24:55.319088+0000 mgr.a (mgr.14388) 3042 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:56 smithi044 bash[22676]: cluster 2024-09-20T23:24:55.319088+0000 mgr.a (mgr.14388) 3042 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:58 smithi049 bash[23528]: cluster 2024-09-20T23:24:57.319891+0000 mgr.a (mgr.14388) 3043 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:58 smithi049 bash[23528]: audit 2024-09-20T23:24:58.238530+0000 mon.a (mon.0) 3103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:58 smithi049 bash[23528]: audit 2024-09-20T23:24:58.247363+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:58 smithi049 bash[23528]: audit 2024-09-20T23:24:58.258227+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.719 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:58 smithi179 bash[23186]: cluster 2024-09-20T23:24:57.319891+0000 mgr.a (mgr.14388) 3043 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:58.719 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:58 smithi179 bash[23186]: audit 2024-09-20T23:24:58.238530+0000 mon.a (mon.0) 3103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.719 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:58 smithi179 bash[23186]: audit 2024-09-20T23:24:58.247363+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.719 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:58 smithi179 bash[23186]: audit 2024-09-20T23:24:58.258227+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:58 smithi044 bash[22676]: cluster 2024-09-20T23:24:57.319891+0000 mgr.a (mgr.14388) 3043 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:24:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:58 smithi044 bash[22676]: audit 2024-09-20T23:24:58.238530+0000 mon.a (mon.0) 3103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:58 smithi044 bash[22676]: audit 2024-09-20T23:24:58.247363+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:58 smithi044 bash[22676]: audit 2024-09-20T23:24:58.258227+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:24:58.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:24:58.941 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:24:58.941 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:24:59.710 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:24:59.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:24:59.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:24:59.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:24:59.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:59 smithi179 bash[23186]: audit 2024-09-20T23:24:58.775467+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:59 smithi179 bash[23186]: audit 2024-09-20T23:24:58.784087+0000 mon.a (mon.0) 3107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:24:59 smithi179 bash[23186]: audit 2024-09-20T23:24:58.791680+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:59 smithi049 bash[23528]: audit 2024-09-20T23:24:58.775467+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:59 smithi049 bash[23528]: audit 2024-09-20T23:24:58.784087+0000 mon.a (mon.0) 3107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:24:59 smithi049 bash[23528]: audit 2024-09-20T23:24:58.791680+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:59 smithi044 bash[22676]: audit 2024-09-20T23:24:58.775467+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:59 smithi044 bash[22676]: audit 2024-09-20T23:24:58.784087+0000 mon.a (mon.0) 3107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:24:59 smithi044 bash[22676]: audit 2024-09-20T23:24:58.791680+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:00 smithi049 bash[23528]: audit 2024-09-20T23:24:59.278312+0000 mgr.a (mgr.14388) 3044 : audit [DBG] from='client.77040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:00 smithi049 bash[23528]: cluster 2024-09-20T23:24:59.320495+0000 mgr.a (mgr.14388) 3045 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:00 smithi044 bash[22676]: audit 2024-09-20T23:24:59.278312+0000 mgr.a (mgr.14388) 3044 : audit [DBG] from='client.77040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:00 smithi044 bash[22676]: cluster 2024-09-20T23:24:59.320495+0000 mgr.a (mgr.14388) 3045 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:00 smithi179 bash[23186]: audit 2024-09-20T23:24:59.278312+0000 mgr.a (mgr.14388) 3044 : audit [DBG] from='client.77040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:00 smithi179 bash[23186]: cluster 2024-09-20T23:24:59.320495+0000 mgr.a (mgr.14388) 3045 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:00.807220+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:00.815167+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:00.825530+0000 mon.a (mon.0) 3111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:01.238958+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:01.245812+0000 mon.a (mon.0) 3113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:01.247845+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:01.259126+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:01.265468+0000 mon.a (mon.0) 3116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:25:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: audit 2024-09-20T23:25:01.267996+0000 mgr.a (mgr.14388) 3046 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:25:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:01 smithi049 bash[23528]: cluster 2024-09-20T23:25:01.323668+0000 mgr.a (mgr.14388) 3047 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:02.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:25:02 smithi044 bash[22930]: debug 2024-09-20T23:25:02.031+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:25:02 smithi044 bash[22930]: debug 2024-09-20T23:25:02.035+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:00.807220+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:00.815167+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:00.825530+0000 mon.a (mon.0) 3111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:01.238958+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:01.245812+0000 mon.a (mon.0) 3113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:01.247845+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:01.259126+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:01.265468+0000 mon.a (mon.0) 3116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:25:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: audit 2024-09-20T23:25:01.267996+0000 mgr.a (mgr.14388) 3046 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:25:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:01 smithi044 bash[22676]: cluster 2024-09-20T23:25:01.323668+0000 mgr.a (mgr.14388) 3047 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:00.807220+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:00.815167+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:00.825530+0000 mon.a (mon.0) 3111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:01.238958+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:25:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:01.245812+0000 mon.a (mon.0) 3113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:25:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:01.247845+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:25:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:01.259126+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:01.265468+0000 mon.a (mon.0) 3116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: audit 2024-09-20T23:25:01.267996+0000 mgr.a (mgr.14388) 3046 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:01 smithi179 bash[23186]: cluster 2024-09-20T23:25:01.323668+0000 mgr.a (mgr.14388) 3047 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:03 smithi049 bash[23528]: audit 2024-09-20T23:25:02.037052+0000 mgr.a (mgr.14388) 3048 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:25:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:03 smithi049 bash[23528]: cephadm 2024-09-20T23:25:02.038288+0000 mgr.a (mgr.14388) 3049 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:25:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:03 smithi044 bash[22676]: audit 2024-09-20T23:25:02.037052+0000 mgr.a (mgr.14388) 3048 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:25:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:03 smithi044 bash[22676]: cephadm 2024-09-20T23:25:02.038288+0000 mgr.a (mgr.14388) 3049 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:25:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:03 smithi179 bash[23186]: audit 2024-09-20T23:25:02.037052+0000 mgr.a (mgr.14388) 3048 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:25:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:03 smithi179 bash[23186]: cephadm 2024-09-20T23:25:02.038288+0000 mgr.a (mgr.14388) 3049 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:25:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:04 smithi049 bash[23528]: cluster 2024-09-20T23:25:03.324650+0000 mgr.a (mgr.14388) 3050 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:04.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:04.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:04 smithi044 bash[22676]: cluster 2024-09-20T23:25:03.324650+0000 mgr.a (mgr.14388) 3050 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:04 smithi179 bash[23186]: cluster 2024-09-20T23:25:03.324650+0000 mgr.a (mgr.14388) 3050 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:05.503 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:05.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:05.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:05.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:05.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:06 smithi044 bash[22676]: audit 2024-09-20T23:25:05.053813+0000 mgr.a (mgr.14388) 3051 : audit [DBG] from='client.77223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:06 smithi044 bash[22676]: cluster 2024-09-20T23:25:05.326031+0000 mgr.a (mgr.14388) 3052 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:06 smithi179 bash[23186]: audit 2024-09-20T23:25:05.053813+0000 mgr.a (mgr.14388) 3051 : audit [DBG] from='client.77223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:06 smithi179 bash[23186]: cluster 2024-09-20T23:25:05.326031+0000 mgr.a (mgr.14388) 3052 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:06 smithi049 bash[23528]: audit 2024-09-20T23:25:05.053813+0000 mgr.a (mgr.14388) 3051 : audit [DBG] from='client.77223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:06 smithi049 bash[23528]: cluster 2024-09-20T23:25:05.326031+0000 mgr.a (mgr.14388) 3052 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:08 smithi044 bash[22676]: cluster 2024-09-20T23:25:07.326915+0000 mgr.a (mgr.14388) 3053 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:08 smithi179 bash[23186]: cluster 2024-09-20T23:25:07.326915+0000 mgr.a (mgr.14388) 3053 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:08 smithi049 bash[23528]: cluster 2024-09-20T23:25:07.326915+0000 mgr.a (mgr.14388) 3053 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:10 smithi044 bash[22676]: cluster 2024-09-20T23:25:09.327755+0000 mgr.a (mgr.14388) 3054 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:10 smithi179 bash[23186]: cluster 2024-09-20T23:25:09.327755+0000 mgr.a (mgr.14388) 3054 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:10 smithi049 bash[23528]: cluster 2024-09-20T23:25:09.327755+0000 mgr.a (mgr.14388) 3054 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:11.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:11.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:11.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:11.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:11.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:12.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:12 smithi044 bash[22676]: audit 2024-09-20T23:25:10.834461+0000 mgr.a (mgr.14388) 3055 : audit [DBG] from='client.77301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:12.672 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:12 smithi044 bash[22676]: cluster 2024-09-20T23:25:11.330596+0000 mgr.a (mgr.14388) 3056 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:12 smithi179 bash[23186]: audit 2024-09-20T23:25:10.834461+0000 mgr.a (mgr.14388) 3055 : audit [DBG] from='client.77301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:12 smithi179 bash[23186]: cluster 2024-09-20T23:25:11.330596+0000 mgr.a (mgr.14388) 3056 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:12 smithi049 bash[23528]: audit 2024-09-20T23:25:10.834461+0000 mgr.a (mgr.14388) 3055 : audit [DBG] from='client.77301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:12 smithi049 bash[23528]: cluster 2024-09-20T23:25:11.330596+0000 mgr.a (mgr.14388) 3056 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:14 smithi044 bash[22676]: cluster 2024-09-20T23:25:13.331414+0000 mgr.a (mgr.14388) 3057 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:14 smithi179 bash[23186]: cluster 2024-09-20T23:25:13.331414+0000 mgr.a (mgr.14388) 3057 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:14 smithi049 bash[23528]: cluster 2024-09-20T23:25:13.331414+0000 mgr.a (mgr.14388) 3057 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:25:16.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:16.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:16.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:16 smithi044 bash[22676]: cluster 2024-09-20T23:25:15.333357+0000 mgr.a (mgr.14388) 3058 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:16 smithi179 bash[23186]: cluster 2024-09-20T23:25:15.333357+0000 mgr.a (mgr.14388) 3058 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:16 smithi049 bash[23528]: cluster 2024-09-20T23:25:15.333357+0000 mgr.a (mgr.14388) 3058 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:25:16.986 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:17.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:17 smithi179 bash[23186]: audit 2024-09-20T23:25:16.573800+0000 mgr.a (mgr.14388) 3059 : audit [DBG] from='client.77379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:17 smithi044 bash[22676]: audit 2024-09-20T23:25:16.573800+0000 mgr.a (mgr.14388) 3059 : audit [DBG] from='client.77379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:17 smithi049 bash[23528]: audit 2024-09-20T23:25:16.573800+0000 mgr.a (mgr.14388) 3059 : audit [DBG] from='client.77379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:18 smithi044 bash[22676]: cluster 2024-09-20T23:25:17.334486+0000 mgr.a (mgr.14388) 3060 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:18 smithi044 bash[22676]: audit 2024-09-20T23:25:18.412318+0000 mon.a (mon.0) 3117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:18 smithi179 bash[23186]: cluster 2024-09-20T23:25:17.334486+0000 mgr.a (mgr.14388) 3060 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:18 smithi179 bash[23186]: audit 2024-09-20T23:25:18.412318+0000 mon.a (mon.0) 3117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:18 smithi049 bash[23528]: cluster 2024-09-20T23:25:17.334486+0000 mgr.a (mgr.14388) 3060 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:18 smithi049 bash[23528]: audit 2024-09-20T23:25:18.412318+0000 mon.a (mon.0) 3117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:19 smithi044 bash[22676]: audit 2024-09-20T23:25:18.421113+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:19 smithi044 bash[22676]: audit 2024-09-20T23:25:18.437263+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:19 smithi044 bash[22676]: audit 2024-09-20T23:25:18.988144+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:19 smithi044 bash[22676]: audit 2024-09-20T23:25:18.996507+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:19 smithi044 bash[22676]: audit 2024-09-20T23:25:19.006765+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:19 smithi179 bash[23186]: audit 2024-09-20T23:25:18.421113+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:19 smithi179 bash[23186]: audit 2024-09-20T23:25:18.437263+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:19 smithi179 bash[23186]: audit 2024-09-20T23:25:18.988144+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:19 smithi179 bash[23186]: audit 2024-09-20T23:25:18.996507+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:19 smithi179 bash[23186]: audit 2024-09-20T23:25:19.006765+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:19 smithi049 bash[23528]: audit 2024-09-20T23:25:18.421113+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:19 smithi049 bash[23528]: audit 2024-09-20T23:25:18.437263+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:19 smithi049 bash[23528]: audit 2024-09-20T23:25:18.988144+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:19 smithi049 bash[23528]: audit 2024-09-20T23:25:18.996507+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:19 smithi049 bash[23528]: audit 2024-09-20T23:25:19.006765+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:20 smithi044 bash[22676]: cluster 2024-09-20T23:25:19.335339+0000 mgr.a (mgr.14388) 3061 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:20 smithi179 bash[23186]: cluster 2024-09-20T23:25:19.335339+0000 mgr.a (mgr.14388) 3061 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:20.764 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:20 smithi049 bash[23528]: cluster 2024-09-20T23:25:19.335339+0000 mgr.a (mgr.14388) 3061 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:21.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:21.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:21.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:22 smithi049 bash[23528]: audit 2024-09-20T23:25:21.042107+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:22 smithi049 bash[23528]: audit 2024-09-20T23:25:21.050871+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:22 smithi049 bash[23528]: audit 2024-09-20T23:25:21.061986+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:22 smithi049 bash[23528]: cluster 2024-09-20T23:25:21.337598+0000 mgr.a (mgr.14388) 3062 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:22 smithi044 bash[22676]: audit 2024-09-20T23:25:21.042107+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:22 smithi044 bash[22676]: audit 2024-09-20T23:25:21.050871+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:22 smithi044 bash[22676]: audit 2024-09-20T23:25:21.061986+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:22 smithi044 bash[22676]: cluster 2024-09-20T23:25:21.337598+0000 mgr.a (mgr.14388) 3062 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:22 smithi179 bash[23186]: audit 2024-09-20T23:25:21.042107+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:22 smithi179 bash[23186]: audit 2024-09-20T23:25:21.050871+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:22 smithi179 bash[23186]: audit 2024-09-20T23:25:21.061986+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:22 smithi179 bash[23186]: cluster 2024-09-20T23:25:21.337598+0000 mgr.a (mgr.14388) 3062 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:22.782 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:22.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:22.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:22.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:22.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:23 smithi044 bash[22676]: audit 2024-09-20T23:25:22.331646+0000 mgr.a (mgr.14388) 3063 : audit [DBG] from='client.77457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:23 smithi179 bash[23186]: audit 2024-09-20T23:25:22.331646+0000 mgr.a (mgr.14388) 3063 : audit [DBG] from='client.77457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:23 smithi049 bash[23528]: audit 2024-09-20T23:25:22.331646+0000 mgr.a (mgr.14388) 3063 : audit [DBG] from='client.77457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:24 smithi044 bash[22676]: cluster 2024-09-20T23:25:23.338705+0000 mgr.a (mgr.14388) 3064 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:24 smithi179 bash[23186]: cluster 2024-09-20T23:25:23.338705+0000 mgr.a (mgr.14388) 3064 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:24 smithi049 bash[23528]: cluster 2024-09-20T23:25:23.338705+0000 mgr.a (mgr.14388) 3064 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:26 smithi044 bash[22676]: cluster 2024-09-20T23:25:25.340921+0000 mgr.a (mgr.14388) 3065 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:26 smithi179 bash[23186]: cluster 2024-09-20T23:25:25.340921+0000 mgr.a (mgr.14388) 3065 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:26 smithi049 bash[23528]: cluster 2024-09-20T23:25:25.340921+0000 mgr.a (mgr.14388) 3065 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:27.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:27.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:27.785 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:28.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:28 smithi044 bash[22676]: cluster 2024-09-20T23:25:27.341695+0000 mgr.a (mgr.14388) 3066 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:28 smithi179 bash[23186]: cluster 2024-09-20T23:25:27.341695+0000 mgr.a (mgr.14388) 3066 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:28 smithi049 bash[23528]: cluster 2024-09-20T23:25:27.341695+0000 mgr.a (mgr.14388) 3066 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:29 smithi044 bash[22676]: audit 2024-09-20T23:25:28.122347+0000 mgr.a (mgr.14388) 3067 : audit [DBG] from='client.77529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:29 smithi179 bash[23186]: audit 2024-09-20T23:25:28.122347+0000 mgr.a (mgr.14388) 3067 : audit [DBG] from='client.77529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:29 smithi049 bash[23528]: audit 2024-09-20T23:25:28.122347+0000 mgr.a (mgr.14388) 3067 : audit [DBG] from='client.77529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:30 smithi044 bash[22676]: cluster 2024-09-20T23:25:29.342660+0000 mgr.a (mgr.14388) 3068 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:30 smithi179 bash[23186]: cluster 2024-09-20T23:25:29.342660+0000 mgr.a (mgr.14388) 3068 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:30 smithi049 bash[23528]: cluster 2024-09-20T23:25:29.342660+0000 mgr.a (mgr.14388) 3068 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:32 smithi044 bash[22676]: cluster 2024-09-20T23:25:31.344924+0000 mgr.a (mgr.14388) 3069 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:32 smithi179 bash[23186]: cluster 2024-09-20T23:25:31.344924+0000 mgr.a (mgr.14388) 3069 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:32 smithi049 bash[23528]: cluster 2024-09-20T23:25:31.344924+0000 mgr.a (mgr.14388) 3069 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:34.315 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:34 smithi044 bash[22676]: cluster 2024-09-20T23:25:33.345714+0000 mgr.a (mgr.14388) 3070 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:34 smithi179 bash[23186]: cluster 2024-09-20T23:25:33.345714+0000 mgr.a (mgr.14388) 3070 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:34 smithi049 bash[23528]: cluster 2024-09-20T23:25:33.345714+0000 mgr.a (mgr.14388) 3070 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:35 smithi044 bash[22676]: audit 2024-09-20T23:25:33.892728+0000 mgr.a (mgr.14388) 3071 : audit [DBG] from='client.77604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:35.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:35 smithi179 bash[23186]: audit 2024-09-20T23:25:33.892728+0000 mgr.a (mgr.14388) 3071 : audit [DBG] from='client.77604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:35 smithi049 bash[23528]: audit 2024-09-20T23:25:33.892728+0000 mgr.a (mgr.14388) 3071 : audit [DBG] from='client.77604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:36 smithi049 bash[23528]: cluster 2024-09-20T23:25:35.347992+0000 mgr.a (mgr.14388) 3072 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:36 smithi044 bash[22676]: cluster 2024-09-20T23:25:35.347992+0000 mgr.a (mgr.14388) 3072 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:36 smithi179 bash[23186]: cluster 2024-09-20T23:25:35.347992+0000 mgr.a (mgr.14388) 3072 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:25:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:38 smithi049 bash[23528]: cluster 2024-09-20T23:25:37.348795+0000 mgr.a (mgr.14388) 3073 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:38.597 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:38 smithi179 bash[23186]: cluster 2024-09-20T23:25:37.348795+0000 mgr.a (mgr.14388) 3073 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:38 smithi044 bash[22676]: cluster 2024-09-20T23:25:37.348795+0000 mgr.a (mgr.14388) 3073 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:39.953 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:39 smithi179 bash[23186]: audit 2024-09-20T23:25:38.587768+0000 mon.a (mon.0) 3126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.954 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:39 smithi179 bash[23186]: audit 2024-09-20T23:25:38.596609+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.954 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:39 smithi179 bash[23186]: audit 2024-09-20T23:25:38.607124+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.954 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:39 smithi179 bash[23186]: audit 2024-09-20T23:25:39.164055+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.954 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:39 smithi179 bash[23186]: audit 2024-09-20T23:25:39.172369+0000 mon.a (mon.0) 3130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.954 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:39 smithi179 bash[23186]: audit 2024-09-20T23:25:39.182593+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.982 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:39 smithi044 bash[22676]: audit 2024-09-20T23:25:38.587768+0000 mon.a (mon.0) 3126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:39 smithi044 bash[22676]: audit 2024-09-20T23:25:38.596609+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:39 smithi044 bash[22676]: audit 2024-09-20T23:25:38.607124+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:39 smithi044 bash[22676]: audit 2024-09-20T23:25:39.164055+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:39 smithi044 bash[22676]: audit 2024-09-20T23:25:39.172369+0000 mon.a (mon.0) 3130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:39.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:39 smithi044 bash[22676]: audit 2024-09-20T23:25:39.182593+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:39 smithi049 bash[23528]: audit 2024-09-20T23:25:38.587768+0000 mon.a (mon.0) 3126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:39 smithi049 bash[23528]: audit 2024-09-20T23:25:38.596609+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:39 smithi049 bash[23528]: audit 2024-09-20T23:25:38.607124+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:39 smithi049 bash[23528]: audit 2024-09-20T23:25:39.164055+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:39 smithi049 bash[23528]: audit 2024-09-20T23:25:39.172369+0000 mon.a (mon.0) 3130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:39 smithi049 bash[23528]: audit 2024-09-20T23:25:39.182593+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:40.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:40.063 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:40.841 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:40 smithi049 bash[23528]: cluster 2024-09-20T23:25:39.349419+0000 mgr.a (mgr.14388) 3074 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:40.841 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:40 smithi049 bash[23528]: audit 2024-09-20T23:25:39.646352+0000 mgr.a (mgr.14388) 3075 : audit [DBG] from='client.77679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:40.880 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:40 smithi179 bash[23186]: cluster 2024-09-20T23:25:39.349419+0000 mgr.a (mgr.14388) 3074 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:40.880 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:40 smithi179 bash[23186]: audit 2024-09-20T23:25:39.646352+0000 mgr.a (mgr.14388) 3075 : audit [DBG] from='client.77679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:40 smithi044 bash[22676]: cluster 2024-09-20T23:25:39.349419+0000 mgr.a (mgr.14388) 3074 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:40 smithi044 bash[22676]: audit 2024-09-20T23:25:39.646352+0000 mgr.a (mgr.14388) 3075 : audit [DBG] from='client.77679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:42 smithi049 bash[23528]: audit 2024-09-20T23:25:41.275161+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:42 smithi049 bash[23528]: audit 2024-09-20T23:25:41.283007+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:42 smithi049 bash[23528]: audit 2024-09-20T23:25:41.293894+0000 mon.a (mon.0) 3134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:42 smithi049 bash[23528]: cluster 2024-09-20T23:25:41.351814+0000 mgr.a (mgr.14388) 3076 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:25:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:42 smithi044 bash[22676]: audit 2024-09-20T23:25:41.275161+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:42 smithi044 bash[22676]: audit 2024-09-20T23:25:41.283007+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:42 smithi044 bash[22676]: audit 2024-09-20T23:25:41.293894+0000 mon.a (mon.0) 3134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:42 smithi044 bash[22676]: cluster 2024-09-20T23:25:41.351814+0000 mgr.a (mgr.14388) 3076 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:25:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:42 smithi179 bash[23186]: audit 2024-09-20T23:25:41.275161+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:42 smithi179 bash[23186]: audit 2024-09-20T23:25:41.283007+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:42 smithi179 bash[23186]: audit 2024-09-20T23:25:41.293894+0000 mon.a (mon.0) 3134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:25:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:42 smithi179 bash[23186]: cluster 2024-09-20T23:25:41.351814+0000 mgr.a (mgr.14388) 3076 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:25:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:44 smithi044 bash[22676]: cluster 2024-09-20T23:25:43.352602+0000 mgr.a (mgr.14388) 3077 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:25:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:44 smithi179 bash[23186]: cluster 2024-09-20T23:25:43.352602+0000 mgr.a (mgr.14388) 3077 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:25:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:44 smithi049 bash[23528]: cluster 2024-09-20T23:25:43.352602+0000 mgr.a (mgr.14388) 3077 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-20T23:25:45.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:45.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:45.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:45.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:45.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:45.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:45.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:46 smithi044 bash[22676]: cluster 2024-09-20T23:25:45.354561+0000 mgr.a (mgr.14388) 3078 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:46 smithi044 bash[22676]: audit 2024-09-20T23:25:45.402293+0000 mgr.a (mgr.14388) 3079 : audit [DBG] from='client.77757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:46 smithi179 bash[23186]: cluster 2024-09-20T23:25:45.354561+0000 mgr.a (mgr.14388) 3078 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:46 smithi179 bash[23186]: audit 2024-09-20T23:25:45.402293+0000 mgr.a (mgr.14388) 3079 : audit [DBG] from='client.77757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:46 smithi049 bash[23528]: cluster 2024-09-20T23:25:45.354561+0000 mgr.a (mgr.14388) 3078 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:25:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:46 smithi049 bash[23528]: audit 2024-09-20T23:25:45.402293+0000 mgr.a (mgr.14388) 3079 : audit [DBG] from='client.77757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:48 smithi044 bash[22676]: cluster 2024-09-20T23:25:47.355493+0000 mgr.a (mgr.14388) 3080 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:25:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:48 smithi179 bash[23186]: cluster 2024-09-20T23:25:47.355493+0000 mgr.a (mgr.14388) 3080 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:25:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:48 smithi049 bash[23528]: cluster 2024-09-20T23:25:47.355493+0000 mgr.a (mgr.14388) 3080 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:25:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:50 smithi044 bash[22676]: cluster 2024-09-20T23:25:49.356409+0000 mgr.a (mgr.14388) 3081 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:25:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:50 smithi179 bash[23186]: cluster 2024-09-20T23:25:49.356409+0000 mgr.a (mgr.14388) 3081 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:25:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:50 smithi049 bash[23528]: cluster 2024-09-20T23:25:49.356409+0000 mgr.a (mgr.14388) 3081 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:25:50.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:50.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:50.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:51.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:51.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:51.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:51.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:51.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:52.696 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:52 smithi044 bash[22676]: audit 2024-09-20T23:25:51.188194+0000 mgr.a (mgr.14388) 3082 : audit [DBG] from='client.77835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.696 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:52 smithi044 bash[22676]: cluster 2024-09-20T23:25:51.357749+0000 mgr.a (mgr.14388) 3083 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:25:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:52 smithi179 bash[23186]: audit 2024-09-20T23:25:51.188194+0000 mgr.a (mgr.14388) 3082 : audit [DBG] from='client.77835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:52 smithi179 bash[23186]: cluster 2024-09-20T23:25:51.357749+0000 mgr.a (mgr.14388) 3083 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:25:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:52 smithi049 bash[23528]: audit 2024-09-20T23:25:51.188194+0000 mgr.a (mgr.14388) 3082 : audit [DBG] from='client.77835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:52 smithi049 bash[23528]: cluster 2024-09-20T23:25:51.357749+0000 mgr.a (mgr.14388) 3083 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:25:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:54 smithi044 bash[22676]: cluster 2024-09-20T23:25:53.358424+0000 mgr.a (mgr.14388) 3084 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-20T23:25:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:54 smithi179 bash[23186]: cluster 2024-09-20T23:25:53.358424+0000 mgr.a (mgr.14388) 3084 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-20T23:25:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:54 smithi049 bash[23528]: cluster 2024-09-20T23:25:53.358424+0000 mgr.a (mgr.14388) 3084 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-20T23:25:56.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:25:56.613 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:25:56.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:25:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:56 smithi044 bash[22676]: cluster 2024-09-20T23:25:55.360545+0000 mgr.a (mgr.14388) 3085 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:25:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:56 smithi179 bash[23186]: cluster 2024-09-20T23:25:55.360545+0000 mgr.a (mgr.14388) 3085 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:25:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:56 smithi049 bash[23528]: cluster 2024-09-20T23:25:55.360545+0000 mgr.a (mgr.14388) 3085 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:25:57.409 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:25:57.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:25:57.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:25:57.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:25:57.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:25:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:58 smithi044 bash[22676]: audit 2024-09-20T23:25:56.953488+0000 mgr.a (mgr.14388) 3086 : audit [DBG] from='client.77910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:58 smithi044 bash[22676]: cluster 2024-09-20T23:25:57.361156+0000 mgr.a (mgr.14388) 3087 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:25:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:58 smithi179 bash[23186]: audit 2024-09-20T23:25:56.953488+0000 mgr.a (mgr.14388) 3086 : audit [DBG] from='client.77910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:58.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:58 smithi179 bash[23186]: cluster 2024-09-20T23:25:57.361156+0000 mgr.a (mgr.14388) 3087 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:25:58.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:58 smithi049 bash[23528]: audit 2024-09-20T23:25:56.953488+0000 mgr.a (mgr.14388) 3086 : audit [DBG] from='client.77910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:25:58.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:58 smithi049 bash[23528]: cluster 2024-09-20T23:25:57.361156+0000 mgr.a (mgr.14388) 3087 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:26:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:59 smithi179 bash[23186]: audit 2024-09-20T23:25:58.758473+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:59 smithi179 bash[23186]: audit 2024-09-20T23:25:58.766905+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:59 smithi179 bash[23186]: audit 2024-09-20T23:25:58.777220+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:59 smithi179 bash[23186]: audit 2024-09-20T23:25:59.352507+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:59 smithi179 bash[23186]: audit 2024-09-20T23:25:59.360802+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:25:59 smithi179 bash[23186]: audit 2024-09-20T23:25:59.371132+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:59 smithi049 bash[23528]: audit 2024-09-20T23:25:58.758473+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:59 smithi049 bash[23528]: audit 2024-09-20T23:25:58.766905+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:59 smithi049 bash[23528]: audit 2024-09-20T23:25:58.777220+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:59 smithi049 bash[23528]: audit 2024-09-20T23:25:59.352507+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:59 smithi049 bash[23528]: audit 2024-09-20T23:25:59.360802+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:25:59 smithi049 bash[23528]: audit 2024-09-20T23:25:59.371132+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:59 smithi044 bash[22676]: audit 2024-09-20T23:25:58.758473+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:59 smithi044 bash[22676]: audit 2024-09-20T23:25:58.766905+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:59 smithi044 bash[22676]: audit 2024-09-20T23:25:58.777220+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:59 smithi044 bash[22676]: audit 2024-09-20T23:25:59.352507+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:59 smithi044 bash[22676]: audit 2024-09-20T23:25:59.360802+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:25:59 smithi044 bash[22676]: audit 2024-09-20T23:25:59.371132+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:00 smithi044 bash[22676]: cluster 2024-09-20T23:25:59.361969+0000 mgr.a (mgr.14388) 3088 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:26:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:00 smithi049 bash[23528]: cluster 2024-09-20T23:25:59.361969+0000 mgr.a (mgr.14388) 3088 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:26:01.168 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:00 smithi179 bash[23186]: cluster 2024-09-20T23:25:59.361969+0000 mgr.a (mgr.14388) 3088 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:26:02.412 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:02.412 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:02.412 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: cluster 2024-09-20T23:26:01.364044+0000 mgr.a (mgr.14388) 3089 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:26:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:01.495912+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:01.502819+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:01.511237+0000 mon.a (mon.0) 3143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:02.100101+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:02.106085+0000 mon.a (mon.0) 3145 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:02.107900+0000 mon.a (mon.0) 3146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:02.118714+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:02 smithi179 bash[23186]: audit 2024-09-20T23:26:02.125028+0000 mon.a (mon.0) 3148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:26:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: cluster 2024-09-20T23:26:01.364044+0000 mgr.a (mgr.14388) 3089 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:26:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:01.495912+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:01.502819+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:01.511237+0000 mon.a (mon.0) 3143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:02.100101+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:02.106085+0000 mon.a (mon.0) 3145 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:02.107900+0000 mon.a (mon.0) 3146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:02.118714+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:02 smithi049 bash[23528]: audit 2024-09-20T23:26:02.125028+0000 mon.a (mon.0) 3148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: cluster 2024-09-20T23:26:01.364044+0000 mgr.a (mgr.14388) 3089 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:01.495912+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:01.502819+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:01.511237+0000 mon.a (mon.0) 3143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:02.100101+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:02.106085+0000 mon.a (mon.0) 3145 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:02.107900+0000 mon.a (mon.0) 3146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:02.118714+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22676]: audit 2024-09-20T23:26:02.125028+0000 mon.a (mon.0) 3148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:26:03.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22930]: debug 2024-09-20T23:26:02.878+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:26:03.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:26:02 smithi044 bash[22930]: debug 2024-09-20T23:26:02.890+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:26:03.287 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:03.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:03.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:03.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:03.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:03 smithi179 bash[23186]: audit 2024-09-20T23:26:02.127403+0000 mgr.a (mgr.14388) 3090 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:26:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:03 smithi179 bash[23186]: audit 2024-09-20T23:26:02.745997+0000 mgr.a (mgr.14388) 3091 : audit [DBG] from='client.78036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:03 smithi049 bash[23528]: audit 2024-09-20T23:26:02.127403+0000 mgr.a (mgr.14388) 3090 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:26:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:03 smithi049 bash[23528]: audit 2024-09-20T23:26:02.745997+0000 mgr.a (mgr.14388) 3091 : audit [DBG] from='client.78036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:03 smithi044 bash[22676]: audit 2024-09-20T23:26:02.127403+0000 mgr.a (mgr.14388) 3090 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:26:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:03 smithi044 bash[22676]: audit 2024-09-20T23:26:02.745997+0000 mgr.a (mgr.14388) 3091 : audit [DBG] from='client.78036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:04 smithi049 bash[23528]: audit 2024-09-20T23:26:02.883450+0000 mgr.a (mgr.14388) 3092 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:26:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:04 smithi049 bash[23528]: cephadm 2024-09-20T23:26:02.894758+0000 mgr.a (mgr.14388) 3093 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:26:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:04 smithi049 bash[23528]: cluster 2024-09-20T23:26:03.364655+0000 mgr.a (mgr.14388) 3094 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-20T23:26:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:04 smithi044 bash[22676]: audit 2024-09-20T23:26:02.883450+0000 mgr.a (mgr.14388) 3092 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:26:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:04 smithi044 bash[22676]: cephadm 2024-09-20T23:26:02.894758+0000 mgr.a (mgr.14388) 3093 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:26:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:04 smithi044 bash[22676]: cluster 2024-09-20T23:26:03.364655+0000 mgr.a (mgr.14388) 3094 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-20T23:26:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:04 smithi179 bash[23186]: audit 2024-09-20T23:26:02.883450+0000 mgr.a (mgr.14388) 3092 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:26:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:04 smithi179 bash[23186]: cephadm 2024-09-20T23:26:02.894758+0000 mgr.a (mgr.14388) 3093 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:26:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:04 smithi179 bash[23186]: cluster 2024-09-20T23:26:03.364655+0000 mgr.a (mgr.14388) 3094 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-20T23:26:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:06 smithi049 bash[23528]: cluster 2024-09-20T23:26:05.366799+0000 mgr.a (mgr.14388) 3095 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-20T23:26:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:06 smithi044 bash[22676]: cluster 2024-09-20T23:26:05.366799+0000 mgr.a (mgr.14388) 3095 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-20T23:26:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:06 smithi179 bash[23186]: cluster 2024-09-20T23:26:05.366799+0000 mgr.a (mgr.14388) 3095 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-20T23:26:08.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:08.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:08 smithi049 bash[23528]: cluster 2024-09-20T23:26:07.367583+0000 mgr.a (mgr.14388) 3096 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:08 smithi044 bash[22676]: cluster 2024-09-20T23:26:07.367583+0000 mgr.a (mgr.14388) 3096 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:08 smithi179 bash[23186]: cluster 2024-09-20T23:26:07.367583+0000 mgr.a (mgr.14388) 3096 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:09.064 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:09.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:09.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:09.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:09.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:09 smithi049 bash[23528]: audit 2024-09-20T23:26:08.628311+0000 mgr.a (mgr.14388) 3097 : audit [DBG] from='client.78168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:09 smithi044 bash[22676]: audit 2024-09-20T23:26:08.628311+0000 mgr.a (mgr.14388) 3097 : audit [DBG] from='client.78168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:09 smithi179 bash[23186]: audit 2024-09-20T23:26:08.628311+0000 mgr.a (mgr.14388) 3097 : audit [DBG] from='client.78168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:10 smithi049 bash[23528]: cluster 2024-09-20T23:26:09.368571+0000 mgr.a (mgr.14388) 3098 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:10 smithi044 bash[22676]: cluster 2024-09-20T23:26:09.368571+0000 mgr.a (mgr.14388) 3098 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:10 smithi179 bash[23186]: cluster 2024-09-20T23:26:09.368571+0000 mgr.a (mgr.14388) 3098 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:12 smithi049 bash[23528]: cluster 2024-09-20T23:26:11.370971+0000 mgr.a (mgr.14388) 3099 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:12 smithi044 bash[22676]: cluster 2024-09-20T23:26:11.370971+0000 mgr.a (mgr.14388) 3099 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:12 smithi179 bash[23186]: cluster 2024-09-20T23:26:11.370971+0000 mgr.a (mgr.14388) 3099 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:14.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:14.627 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:14 smithi044 bash[22676]: cluster 2024-09-20T23:26:13.371781+0000 mgr.a (mgr.14388) 3100 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:14 smithi049 bash[23528]: cluster 2024-09-20T23:26:13.371781+0000 mgr.a (mgr.14388) 3100 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:14.845 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:14.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:14.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:14.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:14.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:14 smithi179 bash[23186]: cluster 2024-09-20T23:26:13.371781+0000 mgr.a (mgr.14388) 3100 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:15 smithi049 bash[23528]: audit 2024-09-20T23:26:14.409754+0000 mgr.a (mgr.14388) 3101 : audit [DBG] from='client.78240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:15.944 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:15 smithi044 bash[22676]: audit 2024-09-20T23:26:14.409754+0000 mgr.a (mgr.14388) 3101 : audit [DBG] from='client.78240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:15 smithi179 bash[23186]: audit 2024-09-20T23:26:14.409754+0000 mgr.a (mgr.14388) 3101 : audit [DBG] from='client.78240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:16 smithi049 bash[23528]: cluster 2024-09-20T23:26:15.374190+0000 mgr.a (mgr.14388) 3102 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:16.803 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:16 smithi044 bash[22676]: cluster 2024-09-20T23:26:15.374190+0000 mgr.a (mgr.14388) 3102 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:16 smithi179 bash[23186]: cluster 2024-09-20T23:26:15.374190+0000 mgr.a (mgr.14388) 3102 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:26:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:18 smithi179 bash[23186]: cluster 2024-09-20T23:26:17.374990+0000 mgr.a (mgr.14388) 3103 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:18.780 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:18 smithi049 bash[23528]: cluster 2024-09-20T23:26:17.374990+0000 mgr.a (mgr.14388) 3103 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:18 smithi044 bash[22676]: cluster 2024-09-20T23:26:17.374990+0000 mgr.a (mgr.14388) 3103 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:19.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:19.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:19.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:19 smithi044 bash[22676]: audit 2024-09-20T23:26:18.988253+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:19 smithi044 bash[22676]: audit 2024-09-20T23:26:18.997110+0000 mon.a (mon.0) 3150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:19 smithi044 bash[22676]: audit 2024-09-20T23:26:19.009081+0000 mon.a (mon.0) 3151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:19 smithi044 bash[22676]: cluster 2024-09-20T23:26:19.375790+0000 mgr.a (mgr.14388) 3104 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:19 smithi044 bash[22676]: audit 2024-09-20T23:26:19.521187+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:19 smithi044 bash[22676]: audit 2024-09-20T23:26:19.529952+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:19 smithi044 bash[22676]: audit 2024-09-20T23:26:19.540304+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:19 smithi179 bash[23186]: audit 2024-09-20T23:26:18.988253+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:19 smithi179 bash[23186]: audit 2024-09-20T23:26:18.997110+0000 mon.a (mon.0) 3150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:19 smithi179 bash[23186]: audit 2024-09-20T23:26:19.009081+0000 mon.a (mon.0) 3151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:19 smithi179 bash[23186]: cluster 2024-09-20T23:26:19.375790+0000 mgr.a (mgr.14388) 3104 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:19 smithi179 bash[23186]: audit 2024-09-20T23:26:19.521187+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:19 smithi179 bash[23186]: audit 2024-09-20T23:26:19.529952+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:19 smithi179 bash[23186]: audit 2024-09-20T23:26:19.540304+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:19 smithi049 bash[23528]: audit 2024-09-20T23:26:18.988253+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:19 smithi049 bash[23528]: audit 2024-09-20T23:26:18.997110+0000 mon.a (mon.0) 3150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:19 smithi049 bash[23528]: audit 2024-09-20T23:26:19.009081+0000 mon.a (mon.0) 3151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:19 smithi049 bash[23528]: cluster 2024-09-20T23:26:19.375790+0000 mgr.a (mgr.14388) 3104 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:19 smithi049 bash[23528]: audit 2024-09-20T23:26:19.521187+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:19 smithi049 bash[23528]: audit 2024-09-20T23:26:19.529952+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:19 smithi049 bash[23528]: audit 2024-09-20T23:26:19.540304+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:20.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:20.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:20.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:20.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:20.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:21 smithi049 bash[23528]: audit 2024-09-20T23:26:20.190477+0000 mgr.a (mgr.14388) 3105 : audit [DBG] from='client.78318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:21 smithi044 bash[22676]: audit 2024-09-20T23:26:20.190477+0000 mgr.a (mgr.14388) 3105 : audit [DBG] from='client.78318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:21 smithi179 bash[23186]: audit 2024-09-20T23:26:20.190477+0000 mgr.a (mgr.14388) 3105 : audit [DBG] from='client.78318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:22 smithi044 bash[22676]: cluster 2024-09-20T23:26:21.378766+0000 mgr.a (mgr.14388) 3106 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:22 smithi044 bash[22676]: audit 2024-09-20T23:26:21.714065+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:22 smithi044 bash[22676]: audit 2024-09-20T23:26:21.722072+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:22 smithi044 bash[22676]: audit 2024-09-20T23:26:21.732413+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:22 smithi179 bash[23186]: cluster 2024-09-20T23:26:21.378766+0000 mgr.a (mgr.14388) 3106 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:22 smithi179 bash[23186]: audit 2024-09-20T23:26:21.714065+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:22 smithi179 bash[23186]: audit 2024-09-20T23:26:21.722072+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:22 smithi179 bash[23186]: audit 2024-09-20T23:26:21.732413+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:22 smithi049 bash[23528]: cluster 2024-09-20T23:26:21.378766+0000 mgr.a (mgr.14388) 3106 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:22 smithi049 bash[23528]: audit 2024-09-20T23:26:21.714065+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:22 smithi049 bash[23528]: audit 2024-09-20T23:26:21.722072+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:22 smithi049 bash[23528]: audit 2024-09-20T23:26:21.732413+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:24 smithi044 bash[22676]: cluster 2024-09-20T23:26:23.379655+0000 mgr.a (mgr.14388) 3107 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:24 smithi179 bash[23186]: cluster 2024-09-20T23:26:23.379655+0000 mgr.a (mgr.14388) 3107 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:24 smithi049 bash[23528]: cluster 2024-09-20T23:26:23.379655+0000 mgr.a (mgr.14388) 3107 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:26.416 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:26.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:26.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:26.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:26.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:26 smithi044 bash[22676]: cluster 2024-09-20T23:26:25.381752+0000 mgr.a (mgr.14388) 3108 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:26 smithi179 bash[23186]: cluster 2024-09-20T23:26:25.381752+0000 mgr.a (mgr.14388) 3108 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:26 smithi049 bash[23528]: cluster 2024-09-20T23:26:25.381752+0000 mgr.a (mgr.14388) 3108 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:27 smithi044 bash[22676]: audit 2024-09-20T23:26:25.966364+0000 mgr.a (mgr.14388) 3109 : audit [DBG] from='client.78396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:27 smithi179 bash[23186]: audit 2024-09-20T23:26:25.966364+0000 mgr.a (mgr.14388) 3109 : audit [DBG] from='client.78396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:27 smithi049 bash[23528]: audit 2024-09-20T23:26:25.966364+0000 mgr.a (mgr.14388) 3109 : audit [DBG] from='client.78396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:28 smithi044 bash[22676]: cluster 2024-09-20T23:26:27.382771+0000 mgr.a (mgr.14388) 3110 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:28 smithi179 bash[23186]: cluster 2024-09-20T23:26:27.382771+0000 mgr.a (mgr.14388) 3110 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:28 smithi049 bash[23528]: cluster 2024-09-20T23:26:27.382771+0000 mgr.a (mgr.14388) 3110 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:30 smithi044 bash[22676]: cluster 2024-09-20T23:26:29.383617+0000 mgr.a (mgr.14388) 3111 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:30 smithi179 bash[23186]: cluster 2024-09-20T23:26:29.383617+0000 mgr.a (mgr.14388) 3111 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:30 smithi049 bash[23528]: cluster 2024-09-20T23:26:29.383617+0000 mgr.a (mgr.14388) 3111 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:26:31.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:31.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:31.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:32.208 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:32.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:32.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:32.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:32.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:32 smithi179 bash[23186]: cluster 2024-09-20T23:26:31.385879+0000 mgr.a (mgr.14388) 3112 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:32 smithi179 bash[23186]: audit 2024-09-20T23:26:31.755388+0000 mgr.a (mgr.14388) 3113 : audit [DBG] from='client.78474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:32 smithi049 bash[23528]: cluster 2024-09-20T23:26:31.385879+0000 mgr.a (mgr.14388) 3112 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:32 smithi049 bash[23528]: audit 2024-09-20T23:26:31.755388+0000 mgr.a (mgr.14388) 3113 : audit [DBG] from='client.78474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:32 smithi044 bash[22676]: cluster 2024-09-20T23:26:31.385879+0000 mgr.a (mgr.14388) 3112 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:32 smithi044 bash[22676]: audit 2024-09-20T23:26:31.755388+0000 mgr.a (mgr.14388) 3113 : audit [DBG] from='client.78474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:34 smithi179 bash[23186]: cluster 2024-09-20T23:26:33.386776+0000 mgr.a (mgr.14388) 3114 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:34 smithi049 bash[23528]: cluster 2024-09-20T23:26:33.386776+0000 mgr.a (mgr.14388) 3114 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:35.073 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:34 smithi044 bash[22676]: cluster 2024-09-20T23:26:33.386776+0000 mgr.a (mgr.14388) 3114 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:36 smithi044 bash[22676]: cluster 2024-09-20T23:26:35.389045+0000 mgr.a (mgr.14388) 3115 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:36 smithi179 bash[23186]: cluster 2024-09-20T23:26:35.389045+0000 mgr.a (mgr.14388) 3115 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:36 smithi049 bash[23528]: cluster 2024-09-20T23:26:35.389045+0000 mgr.a (mgr.14388) 3115 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:37.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:37.210 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:37.211 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:37.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:37.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:37.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:38 smithi049 bash[23528]: cluster 2024-09-20T23:26:37.389506+0000 mgr.a (mgr.14388) 3116 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:38 smithi049 bash[23528]: audit 2024-09-20T23:26:37.543553+0000 mgr.a (mgr.14388) 3117 : audit [DBG] from='client.78549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:38 smithi179 bash[23186]: cluster 2024-09-20T23:26:37.389506+0000 mgr.a (mgr.14388) 3116 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:38 smithi179 bash[23186]: audit 2024-09-20T23:26:37.543553+0000 mgr.a (mgr.14388) 3117 : audit [DBG] from='client.78549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:38 smithi044 bash[22676]: cluster 2024-09-20T23:26:37.389506+0000 mgr.a (mgr.14388) 3116 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:38 smithi044 bash[22676]: audit 2024-09-20T23:26:37.543553+0000 mgr.a (mgr.14388) 3117 : audit [DBG] from='client.78549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:40 smithi044 bash[22676]: audit 2024-09-20T23:26:39.203277+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:40 smithi044 bash[22676]: audit 2024-09-20T23:26:39.212151+0000 mon.a (mon.0) 3159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:40 smithi044 bash[22676]: audit 2024-09-20T23:26:39.219333+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:40 smithi044 bash[22676]: cluster 2024-09-20T23:26:39.390291+0000 mgr.a (mgr.14388) 3118 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:40 smithi044 bash[22676]: audit 2024-09-20T23:26:39.678586+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:40 smithi044 bash[22676]: audit 2024-09-20T23:26:39.686970+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:40 smithi044 bash[22676]: audit 2024-09-20T23:26:39.697277+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:40 smithi179 bash[23186]: audit 2024-09-20T23:26:39.203277+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:40 smithi179 bash[23186]: audit 2024-09-20T23:26:39.212151+0000 mon.a (mon.0) 3159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:40 smithi179 bash[23186]: audit 2024-09-20T23:26:39.219333+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:40 smithi179 bash[23186]: cluster 2024-09-20T23:26:39.390291+0000 mgr.a (mgr.14388) 3118 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:40 smithi179 bash[23186]: audit 2024-09-20T23:26:39.678586+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:40 smithi179 bash[23186]: audit 2024-09-20T23:26:39.686970+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:40 smithi179 bash[23186]: audit 2024-09-20T23:26:39.697277+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:40 smithi049 bash[23528]: audit 2024-09-20T23:26:39.203277+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:40 smithi049 bash[23528]: audit 2024-09-20T23:26:39.212151+0000 mon.a (mon.0) 3159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:40 smithi049 bash[23528]: audit 2024-09-20T23:26:39.219333+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:40 smithi049 bash[23528]: cluster 2024-09-20T23:26:39.390291+0000 mgr.a (mgr.14388) 3118 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:40 smithi049 bash[23528]: audit 2024-09-20T23:26:39.678586+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:40 smithi049 bash[23528]: audit 2024-09-20T23:26:39.686970+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:40 smithi049 bash[23528]: audit 2024-09-20T23:26:39.697277+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:42 smithi044 bash[22676]: cluster 2024-09-20T23:26:41.392528+0000 mgr.a (mgr.14388) 3119 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:42 smithi044 bash[22676]: audit 2024-09-20T23:26:41.881409+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:42 smithi044 bash[22676]: audit 2024-09-20T23:26:41.887573+0000 mon.a (mon.0) 3165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:42 smithi044 bash[22676]: audit 2024-09-20T23:26:41.894457+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:42 smithi179 bash[23186]: cluster 2024-09-20T23:26:41.392528+0000 mgr.a (mgr.14388) 3119 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:42 smithi179 bash[23186]: audit 2024-09-20T23:26:41.881409+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:42 smithi179 bash[23186]: audit 2024-09-20T23:26:41.887573+0000 mon.a (mon.0) 3165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:42 smithi179 bash[23186]: audit 2024-09-20T23:26:41.894457+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:42 smithi049 bash[23528]: cluster 2024-09-20T23:26:41.392528+0000 mgr.a (mgr.14388) 3119 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:42 smithi049 bash[23528]: audit 2024-09-20T23:26:41.881409+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:42 smithi049 bash[23528]: audit 2024-09-20T23:26:41.887573+0000 mon.a (mon.0) 3165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:42 smithi049 bash[23528]: audit 2024-09-20T23:26:41.894457+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:26:42.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:42.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:42.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:43.742 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:43.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:43.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:43.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:43.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:44 smithi044 bash[22676]: audit 2024-09-20T23:26:43.314208+0000 mgr.a (mgr.14388) 3120 : audit [DBG] from='client.78621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:44 smithi044 bash[22676]: cluster 2024-09-20T23:26:43.393113+0000 mgr.a (mgr.14388) 3121 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:44 smithi179 bash[23186]: audit 2024-09-20T23:26:43.314208+0000 mgr.a (mgr.14388) 3120 : audit [DBG] from='client.78621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:44 smithi179 bash[23186]: cluster 2024-09-20T23:26:43.393113+0000 mgr.a (mgr.14388) 3121 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:44 smithi049 bash[23528]: audit 2024-09-20T23:26:43.314208+0000 mgr.a (mgr.14388) 3120 : audit [DBG] from='client.78621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:44 smithi049 bash[23528]: cluster 2024-09-20T23:26:43.393113+0000 mgr.a (mgr.14388) 3121 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:46 smithi044 bash[22676]: cluster 2024-09-20T23:26:45.395318+0000 mgr.a (mgr.14388) 3122 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:46 smithi179 bash[23186]: cluster 2024-09-20T23:26:45.395318+0000 mgr.a (mgr.14388) 3122 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:46 smithi049 bash[23528]: cluster 2024-09-20T23:26:45.395318+0000 mgr.a (mgr.14388) 3122 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:48 smithi044 bash[22676]: cluster 2024-09-20T23:26:47.396087+0000 mgr.a (mgr.14388) 3123 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:48.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:48.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:48.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:48 smithi179 bash[23186]: cluster 2024-09-20T23:26:47.396087+0000 mgr.a (mgr.14388) 3123 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:48 smithi049 bash[23528]: cluster 2024-09-20T23:26:47.396087+0000 mgr.a (mgr.14388) 3123 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:49.522 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:50 smithi044 bash[22676]: audit 2024-09-20T23:26:49.079875+0000 mgr.a (mgr.14388) 3124 : audit [DBG] from='client.78699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:50 smithi044 bash[22676]: cluster 2024-09-20T23:26:49.396666+0000 mgr.a (mgr.14388) 3125 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:50 smithi179 bash[23186]: audit 2024-09-20T23:26:49.079875+0000 mgr.a (mgr.14388) 3124 : audit [DBG] from='client.78699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:50 smithi179 bash[23186]: cluster 2024-09-20T23:26:49.396666+0000 mgr.a (mgr.14388) 3125 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:50 smithi049 bash[23528]: audit 2024-09-20T23:26:49.079875+0000 mgr.a (mgr.14388) 3124 : audit [DBG] from='client.78699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:50 smithi049 bash[23528]: cluster 2024-09-20T23:26:49.396666+0000 mgr.a (mgr.14388) 3125 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:52 smithi044 bash[22676]: cluster 2024-09-20T23:26:51.399024+0000 mgr.a (mgr.14388) 3126 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:52 smithi179 bash[23186]: cluster 2024-09-20T23:26:51.399024+0000 mgr.a (mgr.14388) 3126 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:52 smithi049 bash[23528]: cluster 2024-09-20T23:26:51.399024+0000 mgr.a (mgr.14388) 3126 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:26:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:26:54.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:26:54.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:26:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:54 smithi044 bash[22676]: cluster 2024-09-20T23:26:53.399788+0000 mgr.a (mgr.14388) 3127 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:54 smithi179 bash[23186]: cluster 2024-09-20T23:26:53.399788+0000 mgr.a (mgr.14388) 3127 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:54 smithi049 bash[23528]: cluster 2024-09-20T23:26:53.399788+0000 mgr.a (mgr.14388) 3127 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:26:55.306 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:26:55.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:26:55.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:26:55.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:26:55.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:26:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:56 smithi044 bash[22676]: audit 2024-09-20T23:26:54.861536+0000 mgr.a (mgr.14388) 3128 : audit [DBG] from='client.78777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:56 smithi044 bash[22676]: cluster 2024-09-20T23:26:55.402184+0000 mgr.a (mgr.14388) 3129 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:26:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:56 smithi179 bash[23186]: audit 2024-09-20T23:26:54.861536+0000 mgr.a (mgr.14388) 3128 : audit [DBG] from='client.78777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:56 smithi179 bash[23186]: cluster 2024-09-20T23:26:55.402184+0000 mgr.a (mgr.14388) 3129 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:26:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:56 smithi049 bash[23528]: audit 2024-09-20T23:26:54.861536+0000 mgr.a (mgr.14388) 3128 : audit [DBG] from='client.78777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:26:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:56 smithi049 bash[23528]: cluster 2024-09-20T23:26:55.402184+0000 mgr.a (mgr.14388) 3129 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:26:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:26:58 smithi044 bash[22676]: cluster 2024-09-20T23:26:57.403016+0000 mgr.a (mgr.14388) 3130 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:26:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:26:58 smithi179 bash[23186]: cluster 2024-09-20T23:26:57.403016+0000 mgr.a (mgr.14388) 3130 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:26:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:26:58 smithi049 bash[23528]: cluster 2024-09-20T23:26:57.403016+0000 mgr.a (mgr.14388) 3130 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:27:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:00.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:00.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:00 smithi049 bash[23528]: audit 2024-09-20T23:26:59.388699+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:00 smithi049 bash[23528]: audit 2024-09-20T23:26:59.399357+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:00 smithi049 bash[23528]: cluster 2024-09-20T23:26:59.403734+0000 mgr.a (mgr.14388) 3131 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:00 smithi049 bash[23528]: audit 2024-09-20T23:26:59.411514+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:00 smithi049 bash[23528]: audit 2024-09-20T23:26:59.854433+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:00 smithi049 bash[23528]: audit 2024-09-20T23:26:59.860693+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:00 smithi049 bash[23528]: audit 2024-09-20T23:26:59.869663+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:00 smithi044 bash[22676]: audit 2024-09-20T23:26:59.388699+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:00 smithi044 bash[22676]: audit 2024-09-20T23:26:59.399357+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:00 smithi044 bash[22676]: cluster 2024-09-20T23:26:59.403734+0000 mgr.a (mgr.14388) 3131 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:27:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:00 smithi044 bash[22676]: audit 2024-09-20T23:26:59.411514+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:00 smithi044 bash[22676]: audit 2024-09-20T23:26:59.854433+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:00 smithi044 bash[22676]: audit 2024-09-20T23:26:59.860693+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:00 smithi044 bash[22676]: audit 2024-09-20T23:26:59.869663+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:00 smithi179 bash[23186]: audit 2024-09-20T23:26:59.388699+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:00 smithi179 bash[23186]: audit 2024-09-20T23:26:59.399357+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:00 smithi179 bash[23186]: cluster 2024-09-20T23:26:59.403734+0000 mgr.a (mgr.14388) 3131 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:27:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:00 smithi179 bash[23186]: audit 2024-09-20T23:26:59.411514+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:00 smithi179 bash[23186]: audit 2024-09-20T23:26:59.854433+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:00 smithi179 bash[23186]: audit 2024-09-20T23:26:59.860693+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:00 smithi179 bash[23186]: audit 2024-09-20T23:26:59.869663+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:01.088 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:01.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:01 smithi179 bash[23186]: audit 2024-09-20T23:27:00.646800+0000 mgr.a (mgr.14388) 3132 : audit [DBG] from='client.78849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:01 smithi044 bash[22676]: audit 2024-09-20T23:27:00.646800+0000 mgr.a (mgr.14388) 3132 : audit [DBG] from='client.78849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:01 smithi049 bash[23528]: audit 2024-09-20T23:27:00.646800+0000 mgr.a (mgr.14388) 3132 : audit [DBG] from='client.78849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:02 smithi044 bash[22676]: cluster 2024-09-20T23:27:01.406871+0000 mgr.a (mgr.14388) 3133 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:02 smithi044 bash[22676]: audit 2024-09-20T23:27:02.080265+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:02 smithi044 bash[22676]: audit 2024-09-20T23:27:02.086249+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:02 smithi044 bash[22676]: audit 2024-09-20T23:27:02.094855+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:02 smithi179 bash[23186]: cluster 2024-09-20T23:27:01.406871+0000 mgr.a (mgr.14388) 3133 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:02 smithi179 bash[23186]: audit 2024-09-20T23:27:02.080265+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:02 smithi179 bash[23186]: audit 2024-09-20T23:27:02.086249+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:02 smithi179 bash[23186]: audit 2024-09-20T23:27:02.094855+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:02 smithi049 bash[23528]: cluster 2024-09-20T23:27:01.406871+0000 mgr.a (mgr.14388) 3133 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:02 smithi049 bash[23528]: audit 2024-09-20T23:27:02.080265+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:02 smithi049 bash[23528]: audit 2024-09-20T23:27:02.086249+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:02 smithi049 bash[23528]: audit 2024-09-20T23:27:02.094855+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:03 smithi044 bash[22676]: audit 2024-09-20T23:27:02.951449+0000 mon.a (mon.0) 3176 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:03 smithi044 bash[22676]: audit 2024-09-20T23:27:02.962252+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:03 smithi044 bash[22676]: audit 2024-09-20T23:27:02.964165+0000 mon.a (mon.0) 3178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:03 smithi044 bash[22676]: audit 2024-09-20T23:27:02.975220+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:03 smithi044 bash[22676]: audit 2024-09-20T23:27:02.981591+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:27:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:03 smithi179 bash[23186]: audit 2024-09-20T23:27:02.951449+0000 mon.a (mon.0) 3176 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:03 smithi179 bash[23186]: audit 2024-09-20T23:27:02.962252+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:03 smithi179 bash[23186]: audit 2024-09-20T23:27:02.964165+0000 mon.a (mon.0) 3178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:03 smithi179 bash[23186]: audit 2024-09-20T23:27:02.975220+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:03 smithi179 bash[23186]: audit 2024-09-20T23:27:02.981591+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:27:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:03 smithi049 bash[23528]: audit 2024-09-20T23:27:02.951449+0000 mon.a (mon.0) 3176 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:27:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:03 smithi049 bash[23528]: audit 2024-09-20T23:27:02.962252+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:27:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:03 smithi049 bash[23528]: audit 2024-09-20T23:27:02.964165+0000 mon.a (mon.0) 3178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:27:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:03 smithi049 bash[23528]: audit 2024-09-20T23:27:02.975220+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:03 smithi049 bash[23528]: audit 2024-09-20T23:27:02.981591+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:27:04.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:27:03 smithi044 bash[22930]: debug 2024-09-20T23:27:03.773+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:27:04.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:27:03 smithi044 bash[22930]: debug 2024-09-20T23:27:03.777+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:27:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:04 smithi044 bash[22676]: audit 2024-09-20T23:27:02.984125+0000 mgr.a (mgr.14388) 3134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:27:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:04 smithi044 bash[22676]: cluster 2024-09-20T23:27:03.407494+0000 mgr.a (mgr.14388) 3135 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:27:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:04 smithi044 bash[22676]: audit 2024-09-20T23:27:03.780070+0000 mgr.a (mgr.14388) 3136 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:27:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:04 smithi044 bash[22676]: cephadm 2024-09-20T23:27:03.781733+0000 mgr.a (mgr.14388) 3137 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:27:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:04 smithi179 bash[23186]: audit 2024-09-20T23:27:02.984125+0000 mgr.a (mgr.14388) 3134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:27:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:04 smithi179 bash[23186]: cluster 2024-09-20T23:27:03.407494+0000 mgr.a (mgr.14388) 3135 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:27:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:04 smithi179 bash[23186]: audit 2024-09-20T23:27:03.780070+0000 mgr.a (mgr.14388) 3136 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:27:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:04 smithi179 bash[23186]: cephadm 2024-09-20T23:27:03.781733+0000 mgr.a (mgr.14388) 3137 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:27:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:04 smithi049 bash[23528]: audit 2024-09-20T23:27:02.984125+0000 mgr.a (mgr.14388) 3134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:27:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:04 smithi049 bash[23528]: cluster 2024-09-20T23:27:03.407494+0000 mgr.a (mgr.14388) 3135 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:27:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:04 smithi049 bash[23528]: audit 2024-09-20T23:27:03.780070+0000 mgr.a (mgr.14388) 3136 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:27:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:04 smithi049 bash[23528]: cephadm 2024-09-20T23:27:03.781733+0000 mgr.a (mgr.14388) 3137 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:27:06.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:06.091 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:06.091 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:06 smithi044 bash[22676]: cluster 2024-09-20T23:27:05.409712+0000 mgr.a (mgr.14388) 3138 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:06 smithi179 bash[23186]: cluster 2024-09-20T23:27:05.409712+0000 mgr.a (mgr.14388) 3138 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:06 smithi049 bash[23528]: cluster 2024-09-20T23:27:05.409712+0000 mgr.a (mgr.14388) 3138 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:06.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:06.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:06.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:06.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:07 smithi044 bash[22676]: audit 2024-09-20T23:27:06.424767+0000 mgr.a (mgr.14388) 3139 : audit [DBG] from='client.79035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:07 smithi179 bash[23186]: audit 2024-09-20T23:27:06.424767+0000 mgr.a (mgr.14388) 3139 : audit [DBG] from='client.79035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:07 smithi049 bash[23528]: audit 2024-09-20T23:27:06.424767+0000 mgr.a (mgr.14388) 3139 : audit [DBG] from='client.79035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:08 smithi044 bash[22676]: cluster 2024-09-20T23:27:07.410718+0000 mgr.a (mgr.14388) 3140 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:27:08.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:08 smithi179 bash[23186]: cluster 2024-09-20T23:27:07.410718+0000 mgr.a (mgr.14388) 3140 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:27:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:08 smithi049 bash[23528]: cluster 2024-09-20T23:27:07.410718+0000 mgr.a (mgr.14388) 3140 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:27:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:10 smithi044 bash[22676]: cluster 2024-09-20T23:27:09.411518+0000 mgr.a (mgr.14388) 3141 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:27:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:10 smithi179 bash[23186]: cluster 2024-09-20T23:27:09.411518+0000 mgr.a (mgr.14388) 3141 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:27:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:10 smithi049 bash[23528]: cluster 2024-09-20T23:27:09.411518+0000 mgr.a (mgr.14388) 3141 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:27:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:12 smithi049 bash[23528]: cluster 2024-09-20T23:27:11.413947+0000 mgr.a (mgr.14388) 3142 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:12 smithi044 bash[22676]: cluster 2024-09-20T23:27:11.413947+0000 mgr.a (mgr.14388) 3142 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:12 smithi179 bash[23186]: cluster 2024-09-20T23:27:11.413947+0000 mgr.a (mgr.14388) 3142 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:12.620 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:12.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:12.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:12.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:12.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:13 smithi049 bash[23528]: audit 2024-09-20T23:27:12.183759+0000 mgr.a (mgr.14388) 3143 : audit [DBG] from='client.79113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:13 smithi044 bash[22676]: audit 2024-09-20T23:27:12.183759+0000 mgr.a (mgr.14388) 3143 : audit [DBG] from='client.79113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:13 smithi179 bash[23186]: audit 2024-09-20T23:27:12.183759+0000 mgr.a (mgr.14388) 3143 : audit [DBG] from='client.79113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:14 smithi049 bash[23528]: cluster 2024-09-20T23:27:13.414894+0000 mgr.a (mgr.14388) 3144 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:14 smithi044 bash[22676]: cluster 2024-09-20T23:27:13.414894+0000 mgr.a (mgr.14388) 3144 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:14.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:14 smithi179 bash[23186]: cluster 2024-09-20T23:27:13.414894+0000 mgr.a (mgr.14388) 3144 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:16 smithi044 bash[22676]: cluster 2024-09-20T23:27:15.417023+0000 mgr.a (mgr.14388) 3145 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:16 smithi179 bash[23186]: cluster 2024-09-20T23:27:15.417023+0000 mgr.a (mgr.14388) 3145 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:16 smithi049 bash[23528]: cluster 2024-09-20T23:27:15.417023+0000 mgr.a (mgr.14388) 3145 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:27:17.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:17.622 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:17.622 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:18.396 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:18.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:18.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:18.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:18.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:18 smithi179 bash[23186]: cluster 2024-09-20T23:27:17.417861+0000 mgr.a (mgr.14388) 3146 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:18.775 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:18 smithi049 bash[23528]: cluster 2024-09-20T23:27:17.417861+0000 mgr.a (mgr.14388) 3146 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:18 smithi044 bash[22676]: cluster 2024-09-20T23:27:17.417861+0000 mgr.a (mgr.14388) 3146 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:19.665 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:19 smithi179 bash[23186]: audit 2024-09-20T23:27:17.958278+0000 mgr.a (mgr.14388) 3147 : audit [DBG] from='client.79191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:19 smithi044 bash[22676]: audit 2024-09-20T23:27:17.958278+0000 mgr.a (mgr.14388) 3147 : audit [DBG] from='client.79191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:19 smithi049 bash[23528]: audit 2024-09-20T23:27:17.958278+0000 mgr.a (mgr.14388) 3147 : audit [DBG] from='client.79191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:20 smithi049 bash[23528]: cluster 2024-09-20T23:27:19.418570+0000 mgr.a (mgr.14388) 3148 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:20 smithi049 bash[23528]: audit 2024-09-20T23:27:19.581339+0000 mon.a (mon.0) 3181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:20 smithi049 bash[23528]: audit 2024-09-20T23:27:19.589742+0000 mon.a (mon.0) 3182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:20 smithi049 bash[23528]: audit 2024-09-20T23:27:19.600284+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:20 smithi049 bash[23528]: audit 2024-09-20T23:27:20.049275+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:20 smithi049 bash[23528]: audit 2024-09-20T23:27:20.057896+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:20 smithi049 bash[23528]: audit 2024-09-20T23:27:20.067965+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:20 smithi044 bash[22676]: cluster 2024-09-20T23:27:19.418570+0000 mgr.a (mgr.14388) 3148 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:20 smithi044 bash[22676]: audit 2024-09-20T23:27:19.581339+0000 mon.a (mon.0) 3181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:20 smithi044 bash[22676]: audit 2024-09-20T23:27:19.589742+0000 mon.a (mon.0) 3182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:20 smithi044 bash[22676]: audit 2024-09-20T23:27:19.600284+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:20 smithi044 bash[22676]: audit 2024-09-20T23:27:20.049275+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:20 smithi044 bash[22676]: audit 2024-09-20T23:27:20.057896+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:20 smithi044 bash[22676]: audit 2024-09-20T23:27:20.067965+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:20 smithi179 bash[23186]: cluster 2024-09-20T23:27:19.418570+0000 mgr.a (mgr.14388) 3148 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:20 smithi179 bash[23186]: audit 2024-09-20T23:27:19.581339+0000 mon.a (mon.0) 3181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:20 smithi179 bash[23186]: audit 2024-09-20T23:27:19.589742+0000 mon.a (mon.0) 3182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:20 smithi179 bash[23186]: audit 2024-09-20T23:27:19.600284+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:20 smithi179 bash[23186]: audit 2024-09-20T23:27:20.049275+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:20 smithi179 bash[23186]: audit 2024-09-20T23:27:20.057896+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:20 smithi179 bash[23186]: audit 2024-09-20T23:27:20.067965+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:22 smithi044 bash[22676]: cluster 2024-09-20T23:27:21.420748+0000 mgr.a (mgr.14388) 3149 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:22 smithi044 bash[22676]: audit 2024-09-20T23:27:22.300441+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:22 smithi044 bash[22676]: audit 2024-09-20T23:27:22.308313+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:22 smithi044 bash[22676]: audit 2024-09-20T23:27:22.317966+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:22 smithi179 bash[23186]: cluster 2024-09-20T23:27:21.420748+0000 mgr.a (mgr.14388) 3149 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:22 smithi179 bash[23186]: audit 2024-09-20T23:27:22.300441+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:22 smithi179 bash[23186]: audit 2024-09-20T23:27:22.308313+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:22 smithi179 bash[23186]: audit 2024-09-20T23:27:22.317966+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:22 smithi049 bash[23528]: cluster 2024-09-20T23:27:21.420748+0000 mgr.a (mgr.14388) 3149 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:22 smithi049 bash[23528]: audit 2024-09-20T23:27:22.300441+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:22 smithi049 bash[23528]: audit 2024-09-20T23:27:22.308313+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:22 smithi049 bash[23528]: audit 2024-09-20T23:27:22.317966+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:23.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:23.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:23.399 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:24.179 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:24 smithi044 bash[22676]: cluster 2024-09-20T23:27:23.421478+0000 mgr.a (mgr.14388) 3150 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:24 smithi044 bash[22676]: audit 2024-09-20T23:27:23.737690+0000 mgr.a (mgr.14388) 3151 : audit [DBG] from='client.79269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:24 smithi179 bash[23186]: cluster 2024-09-20T23:27:23.421478+0000 mgr.a (mgr.14388) 3150 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:24 smithi179 bash[23186]: audit 2024-09-20T23:27:23.737690+0000 mgr.a (mgr.14388) 3151 : audit [DBG] from='client.79269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:24 smithi049 bash[23528]: cluster 2024-09-20T23:27:23.421478+0000 mgr.a (mgr.14388) 3150 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:24 smithi049 bash[23528]: audit 2024-09-20T23:27:23.737690+0000 mgr.a (mgr.14388) 3151 : audit [DBG] from='client.79269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:26 smithi044 bash[22676]: cluster 2024-09-20T23:27:25.423738+0000 mgr.a (mgr.14388) 3152 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:26 smithi179 bash[23186]: cluster 2024-09-20T23:27:25.423738+0000 mgr.a (mgr.14388) 3152 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:26 smithi049 bash[23528]: cluster 2024-09-20T23:27:25.423738+0000 mgr.a (mgr.14388) 3152 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:28 smithi044 bash[22676]: cluster 2024-09-20T23:27:27.424506+0000 mgr.a (mgr.14388) 3153 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:28 smithi179 bash[23186]: cluster 2024-09-20T23:27:27.424506+0000 mgr.a (mgr.14388) 3153 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:28 smithi049 bash[23528]: cluster 2024-09-20T23:27:27.424506+0000 mgr.a (mgr.14388) 3153 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:29.957 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:30 smithi044 bash[22676]: cluster 2024-09-20T23:27:29.425270+0000 mgr.a (mgr.14388) 3154 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:30 smithi044 bash[22676]: audit 2024-09-20T23:27:29.518751+0000 mgr.a (mgr.14388) 3155 : audit [DBG] from='client.79344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:30 smithi179 bash[23186]: cluster 2024-09-20T23:27:29.425270+0000 mgr.a (mgr.14388) 3154 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:30 smithi179 bash[23186]: audit 2024-09-20T23:27:29.518751+0000 mgr.a (mgr.14388) 3155 : audit [DBG] from='client.79344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:30 smithi049 bash[23528]: cluster 2024-09-20T23:27:29.425270+0000 mgr.a (mgr.14388) 3154 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:30 smithi049 bash[23528]: audit 2024-09-20T23:27:29.518751+0000 mgr.a (mgr.14388) 3155 : audit [DBG] from='client.79344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:32 smithi044 bash[22676]: cluster 2024-09-20T23:27:31.427620+0000 mgr.a (mgr.14388) 3156 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:32 smithi179 bash[23186]: cluster 2024-09-20T23:27:31.427620+0000 mgr.a (mgr.14388) 3156 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:32 smithi049 bash[23528]: cluster 2024-09-20T23:27:31.427620+0000 mgr.a (mgr.14388) 3156 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:34.960 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:34 smithi044 bash[22676]: cluster 2024-09-20T23:27:33.428402+0000 mgr.a (mgr.14388) 3157 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:34 smithi179 bash[23186]: cluster 2024-09-20T23:27:33.428402+0000 mgr.a (mgr.14388) 3157 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:34 smithi049 bash[23528]: cluster 2024-09-20T23:27:33.428402+0000 mgr.a (mgr.14388) 3157 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:35.702 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:35.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:35.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:35.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:35.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:36 smithi044 bash[22676]: audit 2024-09-20T23:27:35.291735+0000 mgr.a (mgr.14388) 3158 : audit [DBG] from='client.79419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:36 smithi044 bash[22676]: cluster 2024-09-20T23:27:35.429821+0000 mgr.a (mgr.14388) 3159 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:36 smithi179 bash[23186]: audit 2024-09-20T23:27:35.291735+0000 mgr.a (mgr.14388) 3158 : audit [DBG] from='client.79419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:36 smithi179 bash[23186]: cluster 2024-09-20T23:27:35.429821+0000 mgr.a (mgr.14388) 3159 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:36 smithi049 bash[23528]: audit 2024-09-20T23:27:35.291735+0000 mgr.a (mgr.14388) 3158 : audit [DBG] from='client.79419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:36 smithi049 bash[23528]: cluster 2024-09-20T23:27:35.429821+0000 mgr.a (mgr.14388) 3159 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:38.883 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:38 smithi049 bash[23528]: cluster 2024-09-20T23:27:37.430756+0000 mgr.a (mgr.14388) 3160 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:38.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:38 smithi044 bash[22676]: cluster 2024-09-20T23:27:37.430756+0000 mgr.a (mgr.14388) 3160 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:39.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:38 smithi179 bash[23186]: cluster 2024-09-20T23:27:37.430756+0000 mgr.a (mgr.14388) 3160 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:40 smithi049 bash[23528]: cluster 2024-09-20T23:27:39.431585+0000 mgr.a (mgr.14388) 3161 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:40 smithi049 bash[23528]: audit 2024-09-20T23:27:39.756446+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:40 smithi049 bash[23528]: audit 2024-09-20T23:27:39.761637+0000 mon.a (mon.0) 3191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:40 smithi049 bash[23528]: audit 2024-09-20T23:27:39.766921+0000 mon.a (mon.0) 3192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:40 smithi049 bash[23528]: audit 2024-09-20T23:27:40.202715+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:40 smithi049 bash[23528]: audit 2024-09-20T23:27:40.211437+0000 mon.a (mon.0) 3194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:40 smithi049 bash[23528]: audit 2024-09-20T23:27:40.219279+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:40 smithi179 bash[23186]: cluster 2024-09-20T23:27:39.431585+0000 mgr.a (mgr.14388) 3161 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:41.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:40 smithi179 bash[23186]: audit 2024-09-20T23:27:39.756446+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:40 smithi179 bash[23186]: audit 2024-09-20T23:27:39.761637+0000 mon.a (mon.0) 3191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:40 smithi179 bash[23186]: audit 2024-09-20T23:27:39.766921+0000 mon.a (mon.0) 3192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:40 smithi179 bash[23186]: audit 2024-09-20T23:27:40.202715+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:40 smithi179 bash[23186]: audit 2024-09-20T23:27:40.211437+0000 mon.a (mon.0) 3194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:40 smithi179 bash[23186]: audit 2024-09-20T23:27:40.219279+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:40 smithi044 bash[22676]: cluster 2024-09-20T23:27:39.431585+0000 mgr.a (mgr.14388) 3161 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:40 smithi044 bash[22676]: audit 2024-09-20T23:27:39.756446+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:40 smithi044 bash[22676]: audit 2024-09-20T23:27:39.761637+0000 mon.a (mon.0) 3191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:40 smithi044 bash[22676]: audit 2024-09-20T23:27:39.766921+0000 mon.a (mon.0) 3192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:40 smithi044 bash[22676]: audit 2024-09-20T23:27:40.202715+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:40 smithi044 bash[22676]: audit 2024-09-20T23:27:40.211437+0000 mon.a (mon.0) 3194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:40 smithi044 bash[22676]: audit 2024-09-20T23:27:40.219279+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:42 smithi044 bash[22676]: audit 2024-09-20T23:27:41.040148+0000 mgr.a (mgr.14388) 3162 : audit [DBG] from='client.79497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:42 smithi044 bash[22676]: cluster 2024-09-20T23:27:41.433043+0000 mgr.a (mgr.14388) 3163 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:42 smithi044 bash[22676]: audit 2024-09-20T23:27:42.523333+0000 mon.a (mon.0) 3196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:42 smithi044 bash[22676]: audit 2024-09-20T23:27:42.529431+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:42 smithi044 bash[22676]: audit 2024-09-20T23:27:42.539361+0000 mon.a (mon.0) 3198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:42 smithi049 bash[23528]: audit 2024-09-20T23:27:41.040148+0000 mgr.a (mgr.14388) 3162 : audit [DBG] from='client.79497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:42 smithi049 bash[23528]: cluster 2024-09-20T23:27:41.433043+0000 mgr.a (mgr.14388) 3163 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:42 smithi049 bash[23528]: audit 2024-09-20T23:27:42.523333+0000 mon.a (mon.0) 3196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:42 smithi049 bash[23528]: audit 2024-09-20T23:27:42.529431+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:42 smithi049 bash[23528]: audit 2024-09-20T23:27:42.539361+0000 mon.a (mon.0) 3198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:42 smithi179 bash[23186]: audit 2024-09-20T23:27:41.040148+0000 mgr.a (mgr.14388) 3162 : audit [DBG] from='client.79497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:42 smithi179 bash[23186]: cluster 2024-09-20T23:27:41.433043+0000 mgr.a (mgr.14388) 3163 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:42 smithi179 bash[23186]: audit 2024-09-20T23:27:42.523333+0000 mon.a (mon.0) 3196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:42 smithi179 bash[23186]: audit 2024-09-20T23:27:42.529431+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:42 smithi179 bash[23186]: audit 2024-09-20T23:27:42.539361+0000 mon.a (mon.0) 3198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:27:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:44 smithi049 bash[23528]: cluster 2024-09-20T23:27:43.433833+0000 mgr.a (mgr.14388) 3164 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:44 smithi044 bash[22676]: cluster 2024-09-20T23:27:43.433833+0000 mgr.a (mgr.14388) 3164 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:44 smithi179 bash[23186]: cluster 2024-09-20T23:27:43.433833+0000 mgr.a (mgr.14388) 3164 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:46.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:46.463 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:46 smithi049 bash[23528]: cluster 2024-09-20T23:27:45.435759+0000 mgr.a (mgr.14388) 3165 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:46 smithi044 bash[22676]: cluster 2024-09-20T23:27:45.435759+0000 mgr.a (mgr.14388) 3165 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:47.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:47.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:47.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:47.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:47.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:46 smithi179 bash[23186]: cluster 2024-09-20T23:27:45.435759+0000 mgr.a (mgr.14388) 3165 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:47 smithi049 bash[23528]: audit 2024-09-20T23:27:46.800182+0000 mgr.a (mgr.14388) 3166 : audit [DBG] from='client.79575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:47 smithi044 bash[22676]: audit 2024-09-20T23:27:46.800182+0000 mgr.a (mgr.14388) 3166 : audit [DBG] from='client.79575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:47 smithi179 bash[23186]: audit 2024-09-20T23:27:46.800182+0000 mgr.a (mgr.14388) 3166 : audit [DBG] from='client.79575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:48 smithi049 bash[23528]: cluster 2024-09-20T23:27:47.436755+0000 mgr.a (mgr.14388) 3167 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:48 smithi044 bash[22676]: cluster 2024-09-20T23:27:47.436755+0000 mgr.a (mgr.14388) 3167 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:48 smithi179 bash[23186]: cluster 2024-09-20T23:27:47.436755+0000 mgr.a (mgr.14388) 3167 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:50 smithi049 bash[23528]: cluster 2024-09-20T23:27:49.437716+0000 mgr.a (mgr.14388) 3168 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:50 smithi044 bash[22676]: cluster 2024-09-20T23:27:49.437716+0000 mgr.a (mgr.14388) 3168 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:50 smithi179 bash[23186]: cluster 2024-09-20T23:27:49.437716+0000 mgr.a (mgr.14388) 3168 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:52.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:52.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:53.037 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:52 smithi049 bash[23528]: cluster 2024-09-20T23:27:51.440073+0000 mgr.a (mgr.14388) 3169 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:52 smithi044 bash[22676]: cluster 2024-09-20T23:27:51.440073+0000 mgr.a (mgr.14388) 3169 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:52 smithi179 bash[23186]: cluster 2024-09-20T23:27:51.440073+0000 mgr.a (mgr.14388) 3169 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:53 smithi049 bash[23528]: audit 2024-09-20T23:27:52.586169+0000 mgr.a (mgr.14388) 3170 : audit [DBG] from='client.79653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:53 smithi044 bash[22676]: audit 2024-09-20T23:27:52.586169+0000 mgr.a (mgr.14388) 3170 : audit [DBG] from='client.79653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:53 smithi179 bash[23186]: audit 2024-09-20T23:27:52.586169+0000 mgr.a (mgr.14388) 3170 : audit [DBG] from='client.79653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:27:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:54 smithi049 bash[23528]: cluster 2024-09-20T23:27:53.441127+0000 mgr.a (mgr.14388) 3171 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:54 smithi044 bash[22676]: cluster 2024-09-20T23:27:53.441127+0000 mgr.a (mgr.14388) 3171 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:54 smithi179 bash[23186]: cluster 2024-09-20T23:27:53.441127+0000 mgr.a (mgr.14388) 3171 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:56 smithi044 bash[22676]: cluster 2024-09-20T23:27:55.443415+0000 mgr.a (mgr.14388) 3172 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:56 smithi179 bash[23186]: cluster 2024-09-20T23:27:55.443415+0000 mgr.a (mgr.14388) 3172 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:56 smithi049 bash[23528]: cluster 2024-09-20T23:27:55.443415+0000 mgr.a (mgr.14388) 3172 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:27:58.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:27:58.039 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:27:58.039 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:27:58.787 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:27:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:27:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:27:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:27:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:27:59.068 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:58 smithi044 bash[22676]: cluster 2024-09-20T23:27:57.444353+0000 mgr.a (mgr.14388) 3173 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:59.101 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:58 smithi049 bash[23528]: cluster 2024-09-20T23:27:57.444353+0000 mgr.a (mgr.14388) 3173 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:27:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:58 smithi179 bash[23186]: cluster 2024-09-20T23:27:57.444353+0000 mgr.a (mgr.14388) 3173 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:27:59 smithi044 bash[22676]: audit 2024-09-20T23:27:58.362365+0000 mgr.a (mgr.14388) 3174 : audit [DBG] from='client.79731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:27:59 smithi179 bash[23186]: audit 2024-09-20T23:27:58.362365+0000 mgr.a (mgr.14388) 3174 : audit [DBG] from='client.79731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:27:59 smithi049 bash[23528]: audit 2024-09-20T23:27:58.362365+0000 mgr.a (mgr.14388) 3174 : audit [DBG] from='client.79731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:00 smithi044 bash[22676]: cluster 2024-09-20T23:27:59.445365+0000 mgr.a (mgr.14388) 3175 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:00 smithi044 bash[22676]: audit 2024-09-20T23:27:59.922857+0000 mon.a (mon.0) 3199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:00 smithi044 bash[22676]: audit 2024-09-20T23:27:59.931471+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:00 smithi044 bash[22676]: audit 2024-09-20T23:27:59.941714+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:00 smithi044 bash[22676]: audit 2024-09-20T23:28:00.409928+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:00 smithi044 bash[22676]: audit 2024-09-20T23:28:00.418276+0000 mon.a (mon.0) 3203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:00 smithi044 bash[22676]: audit 2024-09-20T23:28:00.428443+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:00 smithi049 bash[23528]: cluster 2024-09-20T23:27:59.445365+0000 mgr.a (mgr.14388) 3175 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:00 smithi049 bash[23528]: audit 2024-09-20T23:27:59.922857+0000 mon.a (mon.0) 3199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:00 smithi049 bash[23528]: audit 2024-09-20T23:27:59.931471+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:00 smithi049 bash[23528]: audit 2024-09-20T23:27:59.941714+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:00 smithi049 bash[23528]: audit 2024-09-20T23:28:00.409928+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:00 smithi049 bash[23528]: audit 2024-09-20T23:28:00.418276+0000 mon.a (mon.0) 3203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:00 smithi049 bash[23528]: audit 2024-09-20T23:28:00.428443+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:00 smithi179 bash[23186]: cluster 2024-09-20T23:27:59.445365+0000 mgr.a (mgr.14388) 3175 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:00 smithi179 bash[23186]: audit 2024-09-20T23:27:59.922857+0000 mon.a (mon.0) 3199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:00 smithi179 bash[23186]: audit 2024-09-20T23:27:59.931471+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:00 smithi179 bash[23186]: audit 2024-09-20T23:27:59.941714+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:00 smithi179 bash[23186]: audit 2024-09-20T23:28:00.409928+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:00 smithi179 bash[23186]: audit 2024-09-20T23:28:00.418276+0000 mon.a (mon.0) 3203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:00 smithi179 bash[23186]: audit 2024-09-20T23:28:00.428443+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:02 smithi044 bash[22676]: cluster 2024-09-20T23:28:01.446627+0000 mgr.a (mgr.14388) 3176 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:02 smithi044 bash[22676]: audit 2024-09-20T23:28:02.764576+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:02 smithi044 bash[22676]: audit 2024-09-20T23:28:02.773102+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:02 smithi044 bash[22676]: audit 2024-09-20T23:28:02.783228+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:02 smithi179 bash[23186]: cluster 2024-09-20T23:28:01.446627+0000 mgr.a (mgr.14388) 3176 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:02 smithi179 bash[23186]: audit 2024-09-20T23:28:02.764576+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:02 smithi179 bash[23186]: audit 2024-09-20T23:28:02.773102+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:02 smithi179 bash[23186]: audit 2024-09-20T23:28:02.783228+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:02 smithi049 bash[23528]: cluster 2024-09-20T23:28:01.446627+0000 mgr.a (mgr.14388) 3176 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:02 smithi049 bash[23528]: audit 2024-09-20T23:28:02.764576+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:02 smithi049 bash[23528]: audit 2024-09-20T23:28:02.773102+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:02 smithi049 bash[23528]: audit 2024-09-20T23:28:02.783228+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:04.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:03 smithi044 bash[22676]: cluster 2024-09-20T23:28:03.447369+0000 mgr.a (mgr.14388) 3177 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:04.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:03 smithi044 bash[22676]: audit 2024-09-20T23:28:03.844173+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:04.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:03 smithi044 bash[22676]: audit 2024-09-20T23:28:03.849473+0000 mon.a (mon.0) 3209 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:04.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:03 smithi044 bash[22676]: audit 2024-09-20T23:28:03.851282+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:04.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:03 smithi044 bash[22676]: audit 2024-09-20T23:28:03.861933+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:04.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:03 smithi044 bash[22676]: audit 2024-09-20T23:28:03.868604+0000 mon.a (mon.0) 3212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:28:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:03 smithi179 bash[23186]: cluster 2024-09-20T23:28:03.447369+0000 mgr.a (mgr.14388) 3177 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:03 smithi179 bash[23186]: audit 2024-09-20T23:28:03.844173+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:03 smithi179 bash[23186]: audit 2024-09-20T23:28:03.849473+0000 mon.a (mon.0) 3209 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:03 smithi179 bash[23186]: audit 2024-09-20T23:28:03.851282+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:03 smithi179 bash[23186]: audit 2024-09-20T23:28:03.861933+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:03 smithi179 bash[23186]: audit 2024-09-20T23:28:03.868604+0000 mon.a (mon.0) 3212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:28:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:03 smithi049 bash[23528]: cluster 2024-09-20T23:28:03.447369+0000 mgr.a (mgr.14388) 3177 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:03 smithi049 bash[23528]: audit 2024-09-20T23:28:03.844173+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:28:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:03 smithi049 bash[23528]: audit 2024-09-20T23:28:03.849473+0000 mon.a (mon.0) 3209 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:28:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:03 smithi049 bash[23528]: audit 2024-09-20T23:28:03.851282+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:28:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:03 smithi049 bash[23528]: audit 2024-09-20T23:28:03.861933+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:03 smithi049 bash[23528]: audit 2024-09-20T23:28:03.868604+0000 mon.a (mon.0) 3212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:28:04.875 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:28:04 smithi044 bash[22930]: debug 2024-09-20T23:28:04.616+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:28:04.875 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:28:04 smithi044 bash[22930]: debug 2024-09-20T23:28:04.628+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:28:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:05.019 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:04 smithi044 bash[22676]: audit 2024-09-20T23:28:03.869947+0000 mgr.a (mgr.14388) 3178 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:28:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:04 smithi044 bash[22676]: audit 2024-09-20T23:28:04.199100+0000 mgr.a (mgr.14388) 3179 : audit [DBG] from='client.79803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:04 smithi044 bash[22676]: audit 2024-09-20T23:28:04.620777+0000 mgr.a (mgr.14388) 3180 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:28:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:04 smithi044 bash[22676]: cephadm 2024-09-20T23:28:04.631364+0000 mgr.a (mgr.14388) 3181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:28:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:04 smithi179 bash[23186]: audit 2024-09-20T23:28:03.869947+0000 mgr.a (mgr.14388) 3178 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:28:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:04 smithi179 bash[23186]: audit 2024-09-20T23:28:04.199100+0000 mgr.a (mgr.14388) 3179 : audit [DBG] from='client.79803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:04 smithi179 bash[23186]: audit 2024-09-20T23:28:04.620777+0000 mgr.a (mgr.14388) 3180 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:28:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:04 smithi179 bash[23186]: cephadm 2024-09-20T23:28:04.631364+0000 mgr.a (mgr.14388) 3181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:28:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:04 smithi049 bash[23528]: audit 2024-09-20T23:28:03.869947+0000 mgr.a (mgr.14388) 3178 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:28:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:04 smithi049 bash[23528]: audit 2024-09-20T23:28:04.199100+0000 mgr.a (mgr.14388) 3179 : audit [DBG] from='client.79803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:04 smithi049 bash[23528]: audit 2024-09-20T23:28:04.620777+0000 mgr.a (mgr.14388) 3180 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:28:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:04 smithi049 bash[23528]: cephadm 2024-09-20T23:28:04.631364+0000 mgr.a (mgr.14388) 3181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:28:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:05 smithi044 bash[22676]: cluster 2024-09-20T23:28:05.449600+0000 mgr.a (mgr.14388) 3182 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:06.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:05 smithi179 bash[23186]: cluster 2024-09-20T23:28:05.449600+0000 mgr.a (mgr.14388) 3182 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:05 smithi049 bash[23528]: cluster 2024-09-20T23:28:05.449600+0000 mgr.a (mgr.14388) 3182 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:08 smithi049 bash[23528]: cluster 2024-09-20T23:28:07.450502+0000 mgr.a (mgr.14388) 3183 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:08 smithi044 bash[22676]: cluster 2024-09-20T23:28:07.450502+0000 mgr.a (mgr.14388) 3183 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:08 smithi179 bash[23186]: cluster 2024-09-20T23:28:07.450502+0000 mgr.a (mgr.14388) 3183 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:10 smithi049 bash[23528]: cluster 2024-09-20T23:28:09.451404+0000 mgr.a (mgr.14388) 3184 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:10.811 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:10.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:10 smithi044 bash[22676]: cluster 2024-09-20T23:28:09.451404+0000 mgr.a (mgr.14388) 3184 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:10 smithi179 bash[23186]: cluster 2024-09-20T23:28:09.451404+0000 mgr.a (mgr.14388) 3184 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:11 smithi049 bash[23528]: audit 2024-09-20T23:28:10.363184+0000 mgr.a (mgr.14388) 3185 : audit [DBG] from='client.79986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:11 smithi044 bash[22676]: audit 2024-09-20T23:28:10.363184+0000 mgr.a (mgr.14388) 3185 : audit [DBG] from='client.79986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:11 smithi179 bash[23186]: audit 2024-09-20T23:28:10.363184+0000 mgr.a (mgr.14388) 3185 : audit [DBG] from='client.79986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:12 smithi049 bash[23528]: cluster 2024-09-20T23:28:11.454209+0000 mgr.a (mgr.14388) 3186 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:12 smithi044 bash[22676]: cluster 2024-09-20T23:28:11.454209+0000 mgr.a (mgr.14388) 3186 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:12 smithi179 bash[23186]: cluster 2024-09-20T23:28:11.454209+0000 mgr.a (mgr.14388) 3186 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:14.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:14 smithi049 bash[23528]: cluster 2024-09-20T23:28:13.455043+0000 mgr.a (mgr.14388) 3187 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:28:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:14 smithi044 bash[22676]: cluster 2024-09-20T23:28:13.455043+0000 mgr.a (mgr.14388) 3187 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:28:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:14 smithi179 bash[23186]: cluster 2024-09-20T23:28:13.455043+0000 mgr.a (mgr.14388) 3187 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:28:15.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:15.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:15.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:16.596 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:16 smithi049 bash[23528]: cluster 2024-09-20T23:28:15.456970+0000 mgr.a (mgr.14388) 3188 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:16 smithi044 bash[22676]: cluster 2024-09-20T23:28:15.456970+0000 mgr.a (mgr.14388) 3188 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:16 smithi179 bash[23186]: cluster 2024-09-20T23:28:15.456970+0000 mgr.a (mgr.14388) 3188 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:28:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:17 smithi049 bash[23528]: audit 2024-09-20T23:28:16.148030+0000 mgr.a (mgr.14388) 3189 : audit [DBG] from='client.80061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:17 smithi044 bash[22676]: audit 2024-09-20T23:28:16.148030+0000 mgr.a (mgr.14388) 3189 : audit [DBG] from='client.80061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:18.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:17 smithi179 bash[23186]: audit 2024-09-20T23:28:16.148030+0000 mgr.a (mgr.14388) 3189 : audit [DBG] from='client.80061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:18 smithi049 bash[23528]: cluster 2024-09-20T23:28:17.457911+0000 mgr.a (mgr.14388) 3190 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:28:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:18 smithi044 bash[22676]: cluster 2024-09-20T23:28:17.457911+0000 mgr.a (mgr.14388) 3190 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:28:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:18 smithi179 bash[23186]: cluster 2024-09-20T23:28:17.457911+0000 mgr.a (mgr.14388) 3190 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:28:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:20 smithi179 bash[23186]: cluster 2024-09-20T23:28:19.458829+0000 mgr.a (mgr.14388) 3191 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:28:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:20 smithi179 bash[23186]: audit 2024-09-20T23:28:20.127772+0000 mon.a (mon.0) 3213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:20 smithi179 bash[23186]: audit 2024-09-20T23:28:20.135465+0000 mon.a (mon.0) 3214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:20 smithi179 bash[23186]: audit 2024-09-20T23:28:20.147480+0000 mon.a (mon.0) 3215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:20 smithi049 bash[23528]: cluster 2024-09-20T23:28:19.458829+0000 mgr.a (mgr.14388) 3191 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:28:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:20 smithi049 bash[23528]: audit 2024-09-20T23:28:20.127772+0000 mon.a (mon.0) 3213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:20 smithi049 bash[23528]: audit 2024-09-20T23:28:20.135465+0000 mon.a (mon.0) 3214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:20 smithi049 bash[23528]: audit 2024-09-20T23:28:20.147480+0000 mon.a (mon.0) 3215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:20 smithi044 bash[22676]: cluster 2024-09-20T23:28:19.458829+0000 mgr.a (mgr.14388) 3191 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:28:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:20 smithi044 bash[22676]: audit 2024-09-20T23:28:20.127772+0000 mon.a (mon.0) 3213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:20 smithi044 bash[22676]: audit 2024-09-20T23:28:20.135465+0000 mon.a (mon.0) 3214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:20 smithi044 bash[22676]: audit 2024-09-20T23:28:20.147480+0000 mon.a (mon.0) 3215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:21.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:21 smithi179 bash[23186]: audit 2024-09-20T23:28:20.593625+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:21 smithi179 bash[23186]: audit 2024-09-20T23:28:20.598881+0000 mon.a (mon.0) 3217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:21 smithi179 bash[23186]: audit 2024-09-20T23:28:20.605394+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:21 smithi044 bash[22676]: audit 2024-09-20T23:28:20.593625+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:21 smithi044 bash[22676]: audit 2024-09-20T23:28:20.598881+0000 mon.a (mon.0) 3217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:21 smithi044 bash[22676]: audit 2024-09-20T23:28:20.605394+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:21 smithi049 bash[23528]: audit 2024-09-20T23:28:20.593625+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:21 smithi049 bash[23528]: audit 2024-09-20T23:28:20.598881+0000 mon.a (mon.0) 3217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:21 smithi049 bash[23528]: audit 2024-09-20T23:28:20.605394+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:22.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:22.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:22.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:22.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:22.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:22.877 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:22 smithi179 bash[23186]: cluster 2024-09-20T23:28:21.461211+0000 mgr.a (mgr.14388) 3192 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:22 smithi044 bash[22676]: cluster 2024-09-20T23:28:21.461211+0000 mgr.a (mgr.14388) 3192 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:22 smithi049 bash[23528]: cluster 2024-09-20T23:28:21.461211+0000 mgr.a (mgr.14388) 3192 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:23.963 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:23 smithi179 bash[23186]: audit 2024-09-20T23:28:21.913884+0000 mgr.a (mgr.14388) 3193 : audit [DBG] from='client.80139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:23.964 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:23 smithi179 bash[23186]: audit 2024-09-20T23:28:23.000582+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:23.964 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:23 smithi179 bash[23186]: audit 2024-09-20T23:28:23.006304+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:23.964 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:23 smithi179 bash[23186]: audit 2024-09-20T23:28:23.014169+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:23 smithi044 bash[22676]: audit 2024-09-20T23:28:21.913884+0000 mgr.a (mgr.14388) 3193 : audit [DBG] from='client.80139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:23 smithi044 bash[22676]: audit 2024-09-20T23:28:23.000582+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:23 smithi044 bash[22676]: audit 2024-09-20T23:28:23.006304+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:23 smithi044 bash[22676]: audit 2024-09-20T23:28:23.014169+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:23 smithi049 bash[23528]: audit 2024-09-20T23:28:21.913884+0000 mgr.a (mgr.14388) 3193 : audit [DBG] from='client.80139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:23 smithi049 bash[23528]: audit 2024-09-20T23:28:23.000582+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:23 smithi049 bash[23528]: audit 2024-09-20T23:28:23.006304+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:23 smithi049 bash[23528]: audit 2024-09-20T23:28:23.014169+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:24 smithi044 bash[22676]: cluster 2024-09-20T23:28:23.462162+0000 mgr.a (mgr.14388) 3194 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:24 smithi179 bash[23186]: cluster 2024-09-20T23:28:23.462162+0000 mgr.a (mgr.14388) 3194 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:24 smithi049 bash[23528]: cluster 2024-09-20T23:28:23.462162+0000 mgr.a (mgr.14388) 3194 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:26 smithi044 bash[22676]: cluster 2024-09-20T23:28:25.464233+0000 mgr.a (mgr.14388) 3195 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:26 smithi179 bash[23186]: cluster 2024-09-20T23:28:25.464233+0000 mgr.a (mgr.14388) 3195 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:26 smithi049 bash[23528]: cluster 2024-09-20T23:28:25.464233+0000 mgr.a (mgr.14388) 3195 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:27.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:27.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:27.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:28.121 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:28.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:28.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:28.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:28.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:28 smithi044 bash[22676]: cluster 2024-09-20T23:28:27.464724+0000 mgr.a (mgr.14388) 3196 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:28 smithi044 bash[22676]: audit 2024-09-20T23:28:27.666187+0000 mgr.a (mgr.14388) 3197 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:28 smithi179 bash[23186]: cluster 2024-09-20T23:28:27.464724+0000 mgr.a (mgr.14388) 3196 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:28 smithi179 bash[23186]: audit 2024-09-20T23:28:27.666187+0000 mgr.a (mgr.14388) 3197 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:28 smithi049 bash[23528]: cluster 2024-09-20T23:28:27.464724+0000 mgr.a (mgr.14388) 3196 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:28 smithi049 bash[23528]: audit 2024-09-20T23:28:27.666187+0000 mgr.a (mgr.14388) 3197 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:30 smithi044 bash[22676]: cluster 2024-09-20T23:28:29.465625+0000 mgr.a (mgr.14388) 3198 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:30 smithi179 bash[23186]: cluster 2024-09-20T23:28:29.465625+0000 mgr.a (mgr.14388) 3198 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:30 smithi049 bash[23528]: cluster 2024-09-20T23:28:29.465625+0000 mgr.a (mgr.14388) 3198 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:32 smithi044 bash[22676]: cluster 2024-09-20T23:28:31.467795+0000 mgr.a (mgr.14388) 3199 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:32 smithi179 bash[23186]: cluster 2024-09-20T23:28:31.467795+0000 mgr.a (mgr.14388) 3199 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:32 smithi049 bash[23528]: cluster 2024-09-20T23:28:31.467795+0000 mgr.a (mgr.14388) 3199 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:33.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:33.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:33.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:33.882 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:34 smithi044 bash[22676]: audit 2024-09-20T23:28:33.454713+0000 mgr.a (mgr.14388) 3200 : audit [DBG] from='client.80292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:34 smithi044 bash[22676]: cluster 2024-09-20T23:28:33.473809+0000 mgr.a (mgr.14388) 3201 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:34 smithi179 bash[23186]: audit 2024-09-20T23:28:33.454713+0000 mgr.a (mgr.14388) 3200 : audit [DBG] from='client.80292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:34 smithi179 bash[23186]: cluster 2024-09-20T23:28:33.473809+0000 mgr.a (mgr.14388) 3201 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:34 smithi049 bash[23528]: audit 2024-09-20T23:28:33.454713+0000 mgr.a (mgr.14388) 3200 : audit [DBG] from='client.80292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:34 smithi049 bash[23528]: cluster 2024-09-20T23:28:33.473809+0000 mgr.a (mgr.14388) 3201 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:36 smithi044 bash[22676]: cluster 2024-09-20T23:28:35.476304+0000 mgr.a (mgr.14388) 3202 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:36 smithi179 bash[23186]: cluster 2024-09-20T23:28:35.476304+0000 mgr.a (mgr.14388) 3202 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:36 smithi049 bash[23528]: cluster 2024-09-20T23:28:35.476304+0000 mgr.a (mgr.14388) 3202 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:38 smithi044 bash[22676]: cluster 2024-09-20T23:28:37.477114+0000 mgr.a (mgr.14388) 3203 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:38 smithi179 bash[23186]: cluster 2024-09-20T23:28:37.477114+0000 mgr.a (mgr.14388) 3203 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:38 smithi049 bash[23528]: cluster 2024-09-20T23:28:37.477114+0000 mgr.a (mgr.14388) 3203 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:39.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:39.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:39.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:39.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:40.935 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:40 smithi044 bash[22676]: audit 2024-09-20T23:28:39.219119+0000 mgr.a (mgr.14388) 3204 : audit [DBG] from='client.80370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:40.935 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:40 smithi044 bash[22676]: cluster 2024-09-20T23:28:39.477630+0000 mgr.a (mgr.14388) 3205 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:40.935 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:40 smithi044 bash[22676]: audit 2024-09-20T23:28:40.298090+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:40.935 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:40 smithi044 bash[22676]: audit 2024-09-20T23:28:40.306111+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:40.935 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:40 smithi044 bash[22676]: audit 2024-09-20T23:28:40.316442+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:40 smithi179 bash[23186]: audit 2024-09-20T23:28:39.219119+0000 mgr.a (mgr.14388) 3204 : audit [DBG] from='client.80370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:40 smithi179 bash[23186]: cluster 2024-09-20T23:28:39.477630+0000 mgr.a (mgr.14388) 3205 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:40 smithi179 bash[23186]: audit 2024-09-20T23:28:40.298090+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:40 smithi179 bash[23186]: audit 2024-09-20T23:28:40.306111+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:40 smithi179 bash[23186]: audit 2024-09-20T23:28:40.316442+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:40 smithi049 bash[23528]: audit 2024-09-20T23:28:39.219119+0000 mgr.a (mgr.14388) 3204 : audit [DBG] from='client.80370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:40 smithi049 bash[23528]: cluster 2024-09-20T23:28:39.477630+0000 mgr.a (mgr.14388) 3205 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:40 smithi049 bash[23528]: audit 2024-09-20T23:28:40.298090+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:40 smithi049 bash[23528]: audit 2024-09-20T23:28:40.306111+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:40 smithi049 bash[23528]: audit 2024-09-20T23:28:40.316442+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.861 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:41 smithi179 bash[23186]: audit 2024-09-20T23:28:40.793385+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.861 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:41 smithi179 bash[23186]: audit 2024-09-20T23:28:40.799234+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:41.861 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:41 smithi179 bash[23186]: audit 2024-09-20T23:28:40.804354+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:41 smithi049 bash[23528]: audit 2024-09-20T23:28:40.793385+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:41 smithi049 bash[23528]: audit 2024-09-20T23:28:40.799234+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:41 smithi049 bash[23528]: audit 2024-09-20T23:28:40.804354+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:41 smithi044 bash[22676]: audit 2024-09-20T23:28:40.793385+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:41 smithi044 bash[22676]: audit 2024-09-20T23:28:40.799234+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:41 smithi044 bash[22676]: audit 2024-09-20T23:28:40.804354+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:43.059 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:42 smithi044 bash[22676]: cluster 2024-09-20T23:28:41.480047+0000 mgr.a (mgr.14388) 3206 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:43.210 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:42 smithi179 bash[23186]: cluster 2024-09-20T23:28:41.480047+0000 mgr.a (mgr.14388) 3206 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:42 smithi049 bash[23528]: cluster 2024-09-20T23:28:41.480047+0000 mgr.a (mgr.14388) 3206 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:28:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:44 smithi179 bash[23186]: audit 2024-09-20T23:28:43.160904+0000 mon.a (mon.0) 3228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:44 smithi179 bash[23186]: audit 2024-09-20T23:28:43.166443+0000 mon.a (mon.0) 3229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:44 smithi179 bash[23186]: audit 2024-09-20T23:28:43.175340+0000 mon.a (mon.0) 3230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:44 smithi179 bash[23186]: cluster 2024-09-20T23:28:43.480877+0000 mgr.a (mgr.14388) 3207 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:44 smithi044 bash[22676]: audit 2024-09-20T23:28:43.160904+0000 mon.a (mon.0) 3228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:44 smithi044 bash[22676]: audit 2024-09-20T23:28:43.166443+0000 mon.a (mon.0) 3229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:44 smithi044 bash[22676]: audit 2024-09-20T23:28:43.175340+0000 mon.a (mon.0) 3230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:44 smithi044 bash[22676]: cluster 2024-09-20T23:28:43.480877+0000 mgr.a (mgr.14388) 3207 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:44 smithi049 bash[23528]: audit 2024-09-20T23:28:43.160904+0000 mon.a (mon.0) 3228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:44 smithi049 bash[23528]: audit 2024-09-20T23:28:43.166443+0000 mon.a (mon.0) 3229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:44 smithi049 bash[23528]: audit 2024-09-20T23:28:43.175340+0000 mon.a (mon.0) 3230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:28:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:44 smithi049 bash[23528]: cluster 2024-09-20T23:28:43.480877+0000 mgr.a (mgr.14388) 3207 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:44.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:44.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:44.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:45.428 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:45.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:45.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:45.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:45.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:46 smithi049 bash[23528]: audit 2024-09-20T23:28:44.979005+0000 mgr.a (mgr.14388) 3208 : audit [DBG] from='client.80448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:46 smithi049 bash[23528]: cluster 2024-09-20T23:28:45.482309+0000 mgr.a (mgr.14388) 3209 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:28:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:46 smithi044 bash[22676]: audit 2024-09-20T23:28:44.979005+0000 mgr.a (mgr.14388) 3208 : audit [DBG] from='client.80448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:46 smithi044 bash[22676]: cluster 2024-09-20T23:28:45.482309+0000 mgr.a (mgr.14388) 3209 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:28:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:46 smithi179 bash[23186]: audit 2024-09-20T23:28:44.979005+0000 mgr.a (mgr.14388) 3208 : audit [DBG] from='client.80448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:46 smithi179 bash[23186]: cluster 2024-09-20T23:28:45.482309+0000 mgr.a (mgr.14388) 3209 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:28:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:48 smithi049 bash[23528]: cluster 2024-09-20T23:28:47.483055+0000 mgr.a (mgr.14388) 3210 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:48 smithi044 bash[22676]: cluster 2024-09-20T23:28:47.483055+0000 mgr.a (mgr.14388) 3210 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:48 smithi179 bash[23186]: cluster 2024-09-20T23:28:47.483055+0000 mgr.a (mgr.14388) 3210 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:50 smithi049 bash[23528]: cluster 2024-09-20T23:28:49.483849+0000 mgr.a (mgr.14388) 3211 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:50 smithi044 bash[22676]: cluster 2024-09-20T23:28:49.483849+0000 mgr.a (mgr.14388) 3211 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:50 smithi179 bash[23186]: cluster 2024-09-20T23:28:49.483849+0000 mgr.a (mgr.14388) 3211 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:28:51.210 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:51.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:51.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:51.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:51.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:51 smithi049 bash[23528]: audit 2024-09-20T23:28:50.772279+0000 mgr.a (mgr.14388) 3212 : audit [DBG] from='client.80523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:51 smithi044 bash[22676]: audit 2024-09-20T23:28:50.772279+0000 mgr.a (mgr.14388) 3212 : audit [DBG] from='client.80523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:51 smithi179 bash[23186]: audit 2024-09-20T23:28:50.772279+0000 mgr.a (mgr.14388) 3212 : audit [DBG] from='client.80523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:52 smithi044 bash[22676]: cluster 2024-09-20T23:28:51.486671+0000 mgr.a (mgr.14388) 3213 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:52 smithi179 bash[23186]: cluster 2024-09-20T23:28:51.486671+0000 mgr.a (mgr.14388) 3213 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:52 smithi049 bash[23528]: cluster 2024-09-20T23:28:51.486671+0000 mgr.a (mgr.14388) 3213 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:54 smithi044 bash[22676]: cluster 2024-09-20T23:28:53.487449+0000 mgr.a (mgr.14388) 3214 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:28:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:54 smithi179 bash[23186]: cluster 2024-09-20T23:28:53.487449+0000 mgr.a (mgr.14388) 3214 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:28:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:54 smithi049 bash[23528]: cluster 2024-09-20T23:28:53.487449+0000 mgr.a (mgr.14388) 3214 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:28:56.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:28:56.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:28:56.213 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:28:56.981 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:28:56.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:28:56.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:28:56.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:28:56.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:28:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:56 smithi044 bash[22676]: cluster 2024-09-20T23:28:55.489404+0000 mgr.a (mgr.14388) 3215 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:56 smithi179 bash[23186]: cluster 2024-09-20T23:28:55.489404+0000 mgr.a (mgr.14388) 3215 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:56 smithi049 bash[23528]: cluster 2024-09-20T23:28:55.489404+0000 mgr.a (mgr.14388) 3215 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:28:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:57 smithi044 bash[22676]: audit 2024-09-20T23:28:56.550488+0000 mgr.a (mgr.14388) 3216 : audit [DBG] from='client.80598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:57 smithi179 bash[23186]: audit 2024-09-20T23:28:56.550488+0000 mgr.a (mgr.14388) 3216 : audit [DBG] from='client.80598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:57 smithi049 bash[23528]: audit 2024-09-20T23:28:56.550488+0000 mgr.a (mgr.14388) 3216 : audit [DBG] from='client.80598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:28:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:28:58 smithi044 bash[22676]: cluster 2024-09-20T23:28:57.490453+0000 mgr.a (mgr.14388) 3217 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:28:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:28:58 smithi179 bash[23186]: cluster 2024-09-20T23:28:57.490453+0000 mgr.a (mgr.14388) 3217 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:28:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:28:58 smithi049 bash[23528]: cluster 2024-09-20T23:28:57.490453+0000 mgr.a (mgr.14388) 3217 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:29:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:00 smithi049 bash[23528]: cluster 2024-09-20T23:28:59.491244+0000 mgr.a (mgr.14388) 3218 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:29:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:00 smithi049 bash[23528]: audit 2024-09-20T23:29:00.463409+0000 mon.a (mon.0) 3231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:00 smithi049 bash[23528]: audit 2024-09-20T23:29:00.468816+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:00 smithi049 bash[23528]: audit 2024-09-20T23:29:00.475847+0000 mon.a (mon.0) 3233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:00 smithi044 bash[22676]: cluster 2024-09-20T23:28:59.491244+0000 mgr.a (mgr.14388) 3218 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:29:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:00 smithi044 bash[22676]: audit 2024-09-20T23:29:00.463409+0000 mon.a (mon.0) 3231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:00 smithi044 bash[22676]: audit 2024-09-20T23:29:00.468816+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:00 smithi044 bash[22676]: audit 2024-09-20T23:29:00.475847+0000 mon.a (mon.0) 3233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:00 smithi179 bash[23186]: cluster 2024-09-20T23:28:59.491244+0000 mgr.a (mgr.14388) 3218 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:29:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:00 smithi179 bash[23186]: audit 2024-09-20T23:29:00.463409+0000 mon.a (mon.0) 3231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:00 smithi179 bash[23186]: audit 2024-09-20T23:29:00.468816+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:00 smithi179 bash[23186]: audit 2024-09-20T23:29:00.475847+0000 mon.a (mon.0) 3233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:01.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:01.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:01 smithi044 bash[22676]: audit 2024-09-20T23:29:00.999976+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:01 smithi044 bash[22676]: audit 2024-09-20T23:29:01.009367+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:01 smithi044 bash[22676]: audit 2024-09-20T23:29:01.019971+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:01 smithi044 bash[22676]: cluster 2024-09-20T23:29:01.493387+0000 mgr.a (mgr.14388) 3219 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:29:02.253 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:01 smithi049 bash[23528]: audit 2024-09-20T23:29:00.999976+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.253 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:01 smithi049 bash[23528]: audit 2024-09-20T23:29:01.009367+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.253 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:01 smithi049 bash[23528]: audit 2024-09-20T23:29:01.019971+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.253 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:01 smithi049 bash[23528]: cluster 2024-09-20T23:29:01.493387+0000 mgr.a (mgr.14388) 3219 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:29:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:01 smithi179 bash[23186]: audit 2024-09-20T23:29:00.999976+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:01 smithi179 bash[23186]: audit 2024-09-20T23:29:01.009367+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:01 smithi179 bash[23186]: audit 2024-09-20T23:29:01.019971+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:01 smithi179 bash[23186]: cluster 2024-09-20T23:29:01.493387+0000 mgr.a (mgr.14388) 3219 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:29:02.758 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:02.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:02.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:02.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:02.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:03 smithi049 bash[23528]: audit 2024-09-20T23:29:02.325960+0000 mgr.a (mgr.14388) 3220 : audit [DBG] from='client.80676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:03.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:03 smithi179 bash[23186]: audit 2024-09-20T23:29:02.325960+0000 mgr.a (mgr.14388) 3220 : audit [DBG] from='client.80676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:03.332 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:03 smithi044 bash[22676]: audit 2024-09-20T23:29:02.325960+0000 mgr.a (mgr.14388) 3220 : audit [DBG] from='client.80676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:04 smithi044 bash[22676]: audit 2024-09-20T23:29:03.316936+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:04 smithi044 bash[22676]: audit 2024-09-20T23:29:03.326965+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:04 smithi044 bash[22676]: audit 2024-09-20T23:29:03.332556+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:04 smithi044 bash[22676]: cluster 2024-09-20T23:29:03.493990+0000 mgr.a (mgr.14388) 3221 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:04 smithi179 bash[23186]: audit 2024-09-20T23:29:03.316936+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:04 smithi179 bash[23186]: audit 2024-09-20T23:29:03.326965+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:04 smithi179 bash[23186]: audit 2024-09-20T23:29:03.332556+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:04 smithi179 bash[23186]: cluster 2024-09-20T23:29:03.493990+0000 mgr.a (mgr.14388) 3221 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:04 smithi049 bash[23528]: audit 2024-09-20T23:29:03.316936+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:04 smithi049 bash[23528]: audit 2024-09-20T23:29:03.326965+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:04 smithi049 bash[23528]: audit 2024-09-20T23:29:03.332556+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:04 smithi049 bash[23528]: cluster 2024-09-20T23:29:03.493990+0000 mgr.a (mgr.14388) 3221 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:05.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:05 smithi179 bash[23186]: audit 2024-09-20T23:29:04.686493+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:05 smithi179 bash[23186]: audit 2024-09-20T23:29:04.693338+0000 mon.a (mon.0) 3241 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:05 smithi179 bash[23186]: audit 2024-09-20T23:29:04.695272+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:05 smithi179 bash[23186]: audit 2024-09-20T23:29:04.706730+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:05.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:05 smithi179 bash[23186]: audit 2024-09-20T23:29:04.713029+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:29:05.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:05 smithi179 bash[23186]: audit 2024-09-20T23:29:04.715567+0000 mgr.a (mgr.14388) 3222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:29:05.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22930]: debug 2024-09-20T23:29:05.487+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:29:05.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22930]: debug 2024-09-20T23:29:05.487+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:29:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22676]: audit 2024-09-20T23:29:04.686493+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22676]: audit 2024-09-20T23:29:04.693338+0000 mon.a (mon.0) 3241 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22676]: audit 2024-09-20T23:29:04.695272+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22676]: audit 2024-09-20T23:29:04.706730+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22676]: audit 2024-09-20T23:29:04.713029+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:29:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:05 smithi044 bash[22676]: audit 2024-09-20T23:29:04.715567+0000 mgr.a (mgr.14388) 3222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:29:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:05 smithi049 bash[23528]: audit 2024-09-20T23:29:04.686493+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:29:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:05 smithi049 bash[23528]: audit 2024-09-20T23:29:04.693338+0000 mon.a (mon.0) 3241 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:29:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:05 smithi049 bash[23528]: audit 2024-09-20T23:29:04.695272+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:29:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:05 smithi049 bash[23528]: audit 2024-09-20T23:29:04.706730+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:05 smithi049 bash[23528]: audit 2024-09-20T23:29:04.713029+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:29:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:05 smithi049 bash[23528]: audit 2024-09-20T23:29:04.715567+0000 mgr.a (mgr.14388) 3222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:29:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:06 smithi044 bash[22676]: audit 2024-09-20T23:29:05.491815+0000 mgr.a (mgr.14388) 3223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:29:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:06 smithi044 bash[22676]: cephadm 2024-09-20T23:29:05.493006+0000 mgr.a (mgr.14388) 3224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:29:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:06 smithi044 bash[22676]: cluster 2024-09-20T23:29:05.495205+0000 mgr.a (mgr.14388) 3225 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:29:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:06 smithi179 bash[23186]: audit 2024-09-20T23:29:05.491815+0000 mgr.a (mgr.14388) 3223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:29:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:06 smithi179 bash[23186]: cephadm 2024-09-20T23:29:05.493006+0000 mgr.a (mgr.14388) 3224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:29:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:06 smithi179 bash[23186]: cluster 2024-09-20T23:29:05.495205+0000 mgr.a (mgr.14388) 3225 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:29:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:06 smithi049 bash[23528]: audit 2024-09-20T23:29:05.491815+0000 mgr.a (mgr.14388) 3223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:29:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:06 smithi049 bash[23528]: cephadm 2024-09-20T23:29:05.493006+0000 mgr.a (mgr.14388) 3224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:29:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:06 smithi049 bash[23528]: cluster 2024-09-20T23:29:05.495205+0000 mgr.a (mgr.14388) 3225 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:29:07.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:07.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:07.761 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:08.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:08.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:08 smithi049 bash[23528]: cluster 2024-09-20T23:29:07.495967+0000 mgr.a (mgr.14388) 3226 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:29:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:08 smithi044 bash[22676]: cluster 2024-09-20T23:29:07.495967+0000 mgr.a (mgr.14388) 3226 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:29:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:08 smithi179 bash[23186]: cluster 2024-09-20T23:29:07.495967+0000 mgr.a (mgr.14388) 3226 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:29:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:09 smithi044 bash[22676]: audit 2024-09-20T23:29:08.100641+0000 mgr.a (mgr.14388) 3227 : audit [DBG] from='client.80862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:09 smithi179 bash[23186]: audit 2024-09-20T23:29:08.100641+0000 mgr.a (mgr.14388) 3227 : audit [DBG] from='client.80862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:09 smithi049 bash[23528]: audit 2024-09-20T23:29:08.100641+0000 mgr.a (mgr.14388) 3227 : audit [DBG] from='client.80862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:10 smithi044 bash[22676]: cluster 2024-09-20T23:29:09.496982+0000 mgr.a (mgr.14388) 3228 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:29:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:10 smithi179 bash[23186]: cluster 2024-09-20T23:29:09.496982+0000 mgr.a (mgr.14388) 3228 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:29:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:10 smithi049 bash[23528]: cluster 2024-09-20T23:29:09.496982+0000 mgr.a (mgr.14388) 3228 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:29:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:12 smithi044 bash[22676]: cluster 2024-09-20T23:29:11.499261+0000 mgr.a (mgr.14388) 3229 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:12 smithi179 bash[23186]: cluster 2024-09-20T23:29:11.499261+0000 mgr.a (mgr.14388) 3229 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:12 smithi049 bash[23528]: cluster 2024-09-20T23:29:11.499261+0000 mgr.a (mgr.14388) 3229 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:13.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:13.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:13.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:14.326 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:14 smithi044 bash[22676]: cluster 2024-09-20T23:29:13.499985+0000 mgr.a (mgr.14388) 3230 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:14 smithi179 bash[23186]: cluster 2024-09-20T23:29:13.499985+0000 mgr.a (mgr.14388) 3230 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:14 smithi049 bash[23528]: cluster 2024-09-20T23:29:13.499985+0000 mgr.a (mgr.14388) 3230 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:15 smithi044 bash[22676]: audit 2024-09-20T23:29:13.878907+0000 mgr.a (mgr.14388) 3231 : audit [DBG] from='client.80937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:15 smithi179 bash[23186]: audit 2024-09-20T23:29:13.878907+0000 mgr.a (mgr.14388) 3231 : audit [DBG] from='client.80937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:15 smithi049 bash[23528]: audit 2024-09-20T23:29:13.878907+0000 mgr.a (mgr.14388) 3231 : audit [DBG] from='client.80937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:16 smithi044 bash[22676]: cluster 2024-09-20T23:29:15.502282+0000 mgr.a (mgr.14388) 3232 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:16 smithi179 bash[23186]: cluster 2024-09-20T23:29:15.502282+0000 mgr.a (mgr.14388) 3232 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:16 smithi049 bash[23528]: cluster 2024-09-20T23:29:15.502282+0000 mgr.a (mgr.14388) 3232 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:29:18.849 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:18 smithi049 bash[23528]: cluster 2024-09-20T23:29:17.503084+0000 mgr.a (mgr.14388) 3233 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:29:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:18 smithi044 bash[22676]: cluster 2024-09-20T23:29:17.503084+0000 mgr.a (mgr.14388) 3233 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:29:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:18 smithi179 bash[23186]: cluster 2024-09-20T23:29:17.503084+0000 mgr.a (mgr.14388) 3233 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:29:19.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:19.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:19.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:20.064 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:20.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:20.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:20.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:20.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:20 smithi044 bash[22676]: cluster 2024-09-20T23:29:19.503823+0000 mgr.a (mgr.14388) 3234 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:29:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:20 smithi044 bash[22676]: audit 2024-09-20T23:29:19.657468+0000 mgr.a (mgr.14388) 3235 : audit [DBG] from='client.81015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:20 smithi179 bash[23186]: cluster 2024-09-20T23:29:19.503823+0000 mgr.a (mgr.14388) 3234 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:29:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:20 smithi179 bash[23186]: audit 2024-09-20T23:29:19.657468+0000 mgr.a (mgr.14388) 3235 : audit [DBG] from='client.81015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:20 smithi049 bash[23528]: cluster 2024-09-20T23:29:19.503823+0000 mgr.a (mgr.14388) 3234 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:29:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:20 smithi049 bash[23528]: audit 2024-09-20T23:29:19.657468+0000 mgr.a (mgr.14388) 3235 : audit [DBG] from='client.81015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:21.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:21 smithi179 bash[23186]: audit 2024-09-20T23:29:20.698584+0000 mon.a (mon.0) 3245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:21 smithi179 bash[23186]: audit 2024-09-20T23:29:20.708892+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:21 smithi179 bash[23186]: audit 2024-09-20T23:29:20.720895+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:21 smithi179 bash[23186]: audit 2024-09-20T23:29:21.235827+0000 mon.a (mon.0) 3248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:21 smithi179 bash[23186]: audit 2024-09-20T23:29:21.244850+0000 mon.a (mon.0) 3249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:21 smithi179 bash[23186]: audit 2024-09-20T23:29:21.254674+0000 mon.a (mon.0) 3250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:21 smithi044 bash[22676]: audit 2024-09-20T23:29:20.698584+0000 mon.a (mon.0) 3245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:21 smithi044 bash[22676]: audit 2024-09-20T23:29:20.708892+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:21 smithi044 bash[22676]: audit 2024-09-20T23:29:20.720895+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:21 smithi044 bash[22676]: audit 2024-09-20T23:29:21.235827+0000 mon.a (mon.0) 3248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:21 smithi044 bash[22676]: audit 2024-09-20T23:29:21.244850+0000 mon.a (mon.0) 3249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:21 smithi044 bash[22676]: audit 2024-09-20T23:29:21.254674+0000 mon.a (mon.0) 3250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:21 smithi049 bash[23528]: audit 2024-09-20T23:29:20.698584+0000 mon.a (mon.0) 3245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:21 smithi049 bash[23528]: audit 2024-09-20T23:29:20.708892+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:21 smithi049 bash[23528]: audit 2024-09-20T23:29:20.720895+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:21 smithi049 bash[23528]: audit 2024-09-20T23:29:21.235827+0000 mon.a (mon.0) 3248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:21 smithi049 bash[23528]: audit 2024-09-20T23:29:21.244850+0000 mon.a (mon.0) 3249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:21 smithi049 bash[23528]: audit 2024-09-20T23:29:21.254674+0000 mon.a (mon.0) 3250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:22 smithi179 bash[23186]: cluster 2024-09-20T23:29:21.506212+0000 mgr.a (mgr.14388) 3236 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:29:22.904 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:22 smithi044 bash[22676]: cluster 2024-09-20T23:29:21.506212+0000 mgr.a (mgr.14388) 3236 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:29:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:22 smithi049 bash[23528]: cluster 2024-09-20T23:29:21.506212+0000 mgr.a (mgr.14388) 3236 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-20T23:29:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:24 smithi044 bash[22676]: audit 2024-09-20T23:29:23.476014+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:24 smithi044 bash[22676]: audit 2024-09-20T23:29:23.482195+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:24 smithi044 bash[22676]: audit 2024-09-20T23:29:23.488640+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:24 smithi044 bash[22676]: cluster 2024-09-20T23:29:23.506883+0000 mgr.a (mgr.14388) 3237 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:24 smithi179 bash[23186]: audit 2024-09-20T23:29:23.476014+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:24 smithi179 bash[23186]: audit 2024-09-20T23:29:23.482195+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:24 smithi179 bash[23186]: audit 2024-09-20T23:29:23.488640+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:24 smithi179 bash[23186]: cluster 2024-09-20T23:29:23.506883+0000 mgr.a (mgr.14388) 3237 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:24 smithi049 bash[23528]: audit 2024-09-20T23:29:23.476014+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:24 smithi049 bash[23528]: audit 2024-09-20T23:29:23.482195+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:24 smithi049 bash[23528]: audit 2024-09-20T23:29:23.488640+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:24 smithi049 bash[23528]: cluster 2024-09-20T23:29:23.506883+0000 mgr.a (mgr.14388) 3237 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:25.066 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:25.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:25.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:25.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:25.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:25.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:26 smithi044 bash[22676]: audit 2024-09-20T23:29:25.390795+0000 mgr.a (mgr.14388) 3238 : audit [DBG] from='client.81087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:26 smithi044 bash[22676]: cluster 2024-09-20T23:29:25.508312+0000 mgr.a (mgr.14388) 3239 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:26 smithi179 bash[23186]: audit 2024-09-20T23:29:25.390795+0000 mgr.a (mgr.14388) 3238 : audit [DBG] from='client.81087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:26 smithi179 bash[23186]: cluster 2024-09-20T23:29:25.508312+0000 mgr.a (mgr.14388) 3239 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:26 smithi049 bash[23528]: audit 2024-09-20T23:29:25.390795+0000 mgr.a (mgr.14388) 3238 : audit [DBG] from='client.81087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:26 smithi049 bash[23528]: cluster 2024-09-20T23:29:25.508312+0000 mgr.a (mgr.14388) 3239 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:28 smithi044 bash[22676]: cluster 2024-09-20T23:29:27.509139+0000 mgr.a (mgr.14388) 3240 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:28 smithi179 bash[23186]: cluster 2024-09-20T23:29:27.509139+0000 mgr.a (mgr.14388) 3240 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:28 smithi049 bash[23528]: cluster 2024-09-20T23:29:27.509139+0000 mgr.a (mgr.14388) 3240 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:30.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:30.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:30 smithi044 bash[22676]: cluster 2024-09-20T23:29:29.509995+0000 mgr.a (mgr.14388) 3241 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:30 smithi179 bash[23186]: cluster 2024-09-20T23:29:29.509995+0000 mgr.a (mgr.14388) 3241 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:30 smithi049 bash[23528]: cluster 2024-09-20T23:29:29.509995+0000 mgr.a (mgr.14388) 3241 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:31.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:31.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:32 smithi044 bash[22676]: audit 2024-09-20T23:29:31.159730+0000 mgr.a (mgr.14388) 3242 : audit [DBG] from='client.81162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:32 smithi044 bash[22676]: cluster 2024-09-20T23:29:31.511295+0000 mgr.a (mgr.14388) 3243 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:32 smithi179 bash[23186]: audit 2024-09-20T23:29:31.159730+0000 mgr.a (mgr.14388) 3242 : audit [DBG] from='client.81162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:32 smithi179 bash[23186]: cluster 2024-09-20T23:29:31.511295+0000 mgr.a (mgr.14388) 3243 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:32 smithi049 bash[23528]: audit 2024-09-20T23:29:31.159730+0000 mgr.a (mgr.14388) 3242 : audit [DBG] from='client.81162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:32 smithi049 bash[23528]: cluster 2024-09-20T23:29:31.511295+0000 mgr.a (mgr.14388) 3243 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:34 smithi044 bash[22676]: cluster 2024-09-20T23:29:33.512046+0000 mgr.a (mgr.14388) 3244 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:34 smithi179 bash[23186]: cluster 2024-09-20T23:29:33.512046+0000 mgr.a (mgr.14388) 3244 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:34 smithi049 bash[23528]: cluster 2024-09-20T23:29:33.512046+0000 mgr.a (mgr.14388) 3244 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:29:36.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:36 smithi044 bash[22676]: cluster 2024-09-20T23:29:35.513999+0000 mgr.a (mgr.14388) 3245 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:36 smithi179 bash[23186]: cluster 2024-09-20T23:29:35.513999+0000 mgr.a (mgr.14388) 3245 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:36 smithi049 bash[23528]: cluster 2024-09-20T23:29:35.513999+0000 mgr.a (mgr.14388) 3245 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:37.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:38 smithi044 bash[22676]: audit 2024-09-20T23:29:36.918358+0000 mgr.a (mgr.14388) 3246 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:38 smithi044 bash[22676]: cluster 2024-09-20T23:29:37.514935+0000 mgr.a (mgr.14388) 3247 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:38 smithi179 bash[23186]: audit 2024-09-20T23:29:36.918358+0000 mgr.a (mgr.14388) 3246 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:38 smithi179 bash[23186]: cluster 2024-09-20T23:29:37.514935+0000 mgr.a (mgr.14388) 3247 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:38 smithi049 bash[23528]: audit 2024-09-20T23:29:36.918358+0000 mgr.a (mgr.14388) 3246 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:38 smithi049 bash[23528]: cluster 2024-09-20T23:29:37.514935+0000 mgr.a (mgr.14388) 3247 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:40 smithi049 bash[23528]: cluster 2024-09-20T23:29:39.515753+0000 mgr.a (mgr.14388) 3248 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:40 smithi044 bash[22676]: cluster 2024-09-20T23:29:39.515753+0000 mgr.a (mgr.14388) 3248 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:40 smithi179 bash[23186]: cluster 2024-09-20T23:29:39.515753+0000 mgr.a (mgr.14388) 3248 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:41 smithi179 bash[23186]: audit 2024-09-20T23:29:40.885673+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:41 smithi179 bash[23186]: audit 2024-09-20T23:29:40.894299+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:41 smithi179 bash[23186]: audit 2024-09-20T23:29:40.904732+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:41 smithi179 bash[23186]: audit 2024-09-20T23:29:41.446144+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:41 smithi179 bash[23186]: audit 2024-09-20T23:29:41.454767+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:41 smithi179 bash[23186]: audit 2024-09-20T23:29:41.465464+0000 mon.a (mon.0) 3259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:41 smithi179 bash[23186]: cluster 2024-09-20T23:29:41.517980+0000 mgr.a (mgr.14388) 3249 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:41 smithi044 bash[22676]: audit 2024-09-20T23:29:40.885673+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:41 smithi044 bash[22676]: audit 2024-09-20T23:29:40.894299+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:41 smithi044 bash[22676]: audit 2024-09-20T23:29:40.904732+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:41 smithi044 bash[22676]: audit 2024-09-20T23:29:41.446144+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:41 smithi044 bash[22676]: audit 2024-09-20T23:29:41.454767+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:41 smithi044 bash[22676]: audit 2024-09-20T23:29:41.465464+0000 mon.a (mon.0) 3259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:41 smithi044 bash[22676]: cluster 2024-09-20T23:29:41.517980+0000 mgr.a (mgr.14388) 3249 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:41 smithi049 bash[23528]: audit 2024-09-20T23:29:40.885673+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:41 smithi049 bash[23528]: audit 2024-09-20T23:29:40.894299+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:41 smithi049 bash[23528]: audit 2024-09-20T23:29:40.904732+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:41 smithi049 bash[23528]: audit 2024-09-20T23:29:41.446144+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:41 smithi049 bash[23528]: audit 2024-09-20T23:29:41.454767+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:41 smithi049 bash[23528]: audit 2024-09-20T23:29:41.465464+0000 mon.a (mon.0) 3259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:41 smithi049 bash[23528]: cluster 2024-09-20T23:29:41.517980+0000 mgr.a (mgr.14388) 3249 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:42.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:42.352 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:43.115 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:43.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:43.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:43.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:43.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:43 smithi044 bash[22676]: audit 2024-09-20T23:29:42.695720+0000 mgr.a (mgr.14388) 3250 : audit [DBG] from='client.81312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:43 smithi179 bash[23186]: audit 2024-09-20T23:29:42.695720+0000 mgr.a (mgr.14388) 3250 : audit [DBG] from='client.81312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:43 smithi049 bash[23528]: audit 2024-09-20T23:29:42.695720+0000 mgr.a (mgr.14388) 3250 : audit [DBG] from='client.81312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:44.915 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:44 smithi179 bash[23186]: cluster 2024-09-20T23:29:43.518839+0000 mgr.a (mgr.14388) 3251 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:44.915 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:44 smithi179 bash[23186]: audit 2024-09-20T23:29:43.652770+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:44.916 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:44 smithi179 bash[23186]: audit 2024-09-20T23:29:43.659988+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:44.916 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:44 smithi179 bash[23186]: audit 2024-09-20T23:29:43.667146+0000 mon.a (mon.0) 3262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:44 smithi044 bash[22676]: cluster 2024-09-20T23:29:43.518839+0000 mgr.a (mgr.14388) 3251 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:44 smithi044 bash[22676]: audit 2024-09-20T23:29:43.652770+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:44 smithi044 bash[22676]: audit 2024-09-20T23:29:43.659988+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:44 smithi044 bash[22676]: audit 2024-09-20T23:29:43.667146+0000 mon.a (mon.0) 3262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:44 smithi049 bash[23528]: cluster 2024-09-20T23:29:43.518839+0000 mgr.a (mgr.14388) 3251 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:44 smithi049 bash[23528]: audit 2024-09-20T23:29:43.652770+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:44 smithi049 bash[23528]: audit 2024-09-20T23:29:43.659988+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:44 smithi049 bash[23528]: audit 2024-09-20T23:29:43.667146+0000 mon.a (mon.0) 3262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:29:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:46 smithi044 bash[22676]: cluster 2024-09-20T23:29:45.520073+0000 mgr.a (mgr.14388) 3252 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:46 smithi179 bash[23186]: cluster 2024-09-20T23:29:45.520073+0000 mgr.a (mgr.14388) 3252 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:46 smithi049 bash[23528]: cluster 2024-09-20T23:29:45.520073+0000 mgr.a (mgr.14388) 3252 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:48.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:48.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:48.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:48.870 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:48.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:48.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:48.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:48.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:48 smithi044 bash[22676]: cluster 2024-09-20T23:29:47.520814+0000 mgr.a (mgr.14388) 3253 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:48 smithi179 bash[23186]: cluster 2024-09-20T23:29:47.520814+0000 mgr.a (mgr.14388) 3253 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:48 smithi049 bash[23528]: cluster 2024-09-20T23:29:47.520814+0000 mgr.a (mgr.14388) 3253 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:49 smithi044 bash[22676]: audit 2024-09-20T23:29:48.448881+0000 mgr.a (mgr.14388) 3254 : audit [DBG] from='client.81390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:49 smithi179 bash[23186]: audit 2024-09-20T23:29:48.448881+0000 mgr.a (mgr.14388) 3254 : audit [DBG] from='client.81390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:49 smithi049 bash[23528]: audit 2024-09-20T23:29:48.448881+0000 mgr.a (mgr.14388) 3254 : audit [DBG] from='client.81390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:50 smithi044 bash[22676]: cluster 2024-09-20T23:29:49.521831+0000 mgr.a (mgr.14388) 3255 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:50 smithi179 bash[23186]: cluster 2024-09-20T23:29:49.521831+0000 mgr.a (mgr.14388) 3255 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:50 smithi049 bash[23528]: cluster 2024-09-20T23:29:49.521831+0000 mgr.a (mgr.14388) 3255 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:52 smithi044 bash[22676]: cluster 2024-09-20T23:29:51.524170+0000 mgr.a (mgr.14388) 3256 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:52 smithi179 bash[23186]: cluster 2024-09-20T23:29:51.524170+0000 mgr.a (mgr.14388) 3256 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:52 smithi049 bash[23528]: cluster 2024-09-20T23:29:51.524170+0000 mgr.a (mgr.14388) 3256 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:53.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:53.872 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:53.872 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:29:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:29:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:29:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:29:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:29:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:29:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:54 smithi044 bash[22676]: cluster 2024-09-20T23:29:53.524924+0000 mgr.a (mgr.14388) 3257 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:54 smithi179 bash[23186]: cluster 2024-09-20T23:29:53.524924+0000 mgr.a (mgr.14388) 3257 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:54 smithi049 bash[23528]: cluster 2024-09-20T23:29:53.524924+0000 mgr.a (mgr.14388) 3257 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:55 smithi044 bash[22676]: audit 2024-09-20T23:29:54.211698+0000 mgr.a (mgr.14388) 3258 : audit [DBG] from='client.81468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:56.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:55 smithi179 bash[23186]: audit 2024-09-20T23:29:54.211698+0000 mgr.a (mgr.14388) 3258 : audit [DBG] from='client.81468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:55 smithi049 bash[23528]: audit 2024-09-20T23:29:54.211698+0000 mgr.a (mgr.14388) 3258 : audit [DBG] from='client.81468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:29:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:56 smithi044 bash[22676]: cluster 2024-09-20T23:29:55.527228+0000 mgr.a (mgr.14388) 3259 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:57.113 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:56 smithi049 bash[23528]: cluster 2024-09-20T23:29:55.527228+0000 mgr.a (mgr.14388) 3259 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:57.113 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:56 smithi179 bash[23186]: cluster 2024-09-20T23:29:55.527228+0000 mgr.a (mgr.14388) 3259 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:29:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:29:58 smithi044 bash[22676]: cluster 2024-09-20T23:29:57.528008+0000 mgr.a (mgr.14388) 3260 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:29:58 smithi179 bash[23186]: cluster 2024-09-20T23:29:57.528008+0000 mgr.a (mgr.14388) 3260 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:29:58 smithi049 bash[23528]: cluster 2024-09-20T23:29:57.528008+0000 mgr.a (mgr.14388) 3260 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:29:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:29:59.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:29:59.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:00.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:00.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:00.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:00.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:00.422 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:00 smithi049 bash[23528]: cluster 2024-09-20T23:29:59.528805+0000 mgr.a (mgr.14388) 3261 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:00 smithi049 bash[23528]: cluster 2024-09-20T23:30:00.000103+0000 mon.a (mon.0) 3263 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:30:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:00 smithi044 bash[22676]: cluster 2024-09-20T23:29:59.528805+0000 mgr.a (mgr.14388) 3261 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:00 smithi044 bash[22676]: cluster 2024-09-20T23:30:00.000103+0000 mon.a (mon.0) 3263 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:30:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:00 smithi179 bash[23186]: cluster 2024-09-20T23:29:59.528805+0000 mgr.a (mgr.14388) 3261 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:00 smithi179 bash[23186]: cluster 2024-09-20T23:30:00.000103+0000 mon.a (mon.0) 3263 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:30:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:01 smithi179 bash[23186]: audit 2024-09-20T23:29:59.998076+0000 mgr.a (mgr.14388) 3262 : audit [DBG] from='client.81543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:01 smithi179 bash[23186]: audit 2024-09-20T23:30:01.117186+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:01 smithi179 bash[23186]: audit 2024-09-20T23:30:01.125841+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:01 smithi179 bash[23186]: audit 2024-09-20T23:30:01.136869+0000 mon.a (mon.0) 3266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:01 smithi179 bash[23186]: audit 2024-09-20T23:30:01.648129+0000 mon.a (mon.0) 3267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:01 smithi179 bash[23186]: audit 2024-09-20T23:30:01.656942+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:01 smithi179 bash[23186]: audit 2024-09-20T23:30:01.668679+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:01 smithi044 bash[22676]: audit 2024-09-20T23:29:59.998076+0000 mgr.a (mgr.14388) 3262 : audit [DBG] from='client.81543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:01 smithi044 bash[22676]: audit 2024-09-20T23:30:01.117186+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:01 smithi044 bash[22676]: audit 2024-09-20T23:30:01.125841+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:01 smithi044 bash[22676]: audit 2024-09-20T23:30:01.136869+0000 mon.a (mon.0) 3266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:01 smithi044 bash[22676]: audit 2024-09-20T23:30:01.648129+0000 mon.a (mon.0) 3267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:01 smithi044 bash[22676]: audit 2024-09-20T23:30:01.656942+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:01 smithi044 bash[22676]: audit 2024-09-20T23:30:01.668679+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:01 smithi049 bash[23528]: audit 2024-09-20T23:29:59.998076+0000 mgr.a (mgr.14388) 3262 : audit [DBG] from='client.81543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:01 smithi049 bash[23528]: audit 2024-09-20T23:30:01.117186+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:01 smithi049 bash[23528]: audit 2024-09-20T23:30:01.125841+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:01 smithi049 bash[23528]: audit 2024-09-20T23:30:01.136869+0000 mon.a (mon.0) 3266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:01 smithi049 bash[23528]: audit 2024-09-20T23:30:01.648129+0000 mon.a (mon.0) 3267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:01 smithi049 bash[23528]: audit 2024-09-20T23:30:01.656942+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:01 smithi049 bash[23528]: audit 2024-09-20T23:30:01.668679+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:02 smithi179 bash[23186]: cluster 2024-09-20T23:30:01.531480+0000 mgr.a (mgr.14388) 3263 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:30:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:02 smithi044 bash[22676]: cluster 2024-09-20T23:30:01.531480+0000 mgr.a (mgr.14388) 3263 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:30:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:02 smithi049 bash[23528]: cluster 2024-09-20T23:30:01.531480+0000 mgr.a (mgr.14388) 3263 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:30:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:04 smithi049 bash[23528]: cluster 2024-09-20T23:30:03.532269+0000 mgr.a (mgr.14388) 3264 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:04 smithi049 bash[23528]: audit 2024-09-20T23:30:03.794149+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:04 smithi049 bash[23528]: audit 2024-09-20T23:30:03.799758+0000 mon.a (mon.0) 3271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:04 smithi049 bash[23528]: audit 2024-09-20T23:30:03.804636+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:04 smithi179 bash[23186]: cluster 2024-09-20T23:30:03.532269+0000 mgr.a (mgr.14388) 3264 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:05.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:04 smithi179 bash[23186]: audit 2024-09-20T23:30:03.794149+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:04 smithi179 bash[23186]: audit 2024-09-20T23:30:03.799758+0000 mon.a (mon.0) 3271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:04 smithi179 bash[23186]: audit 2024-09-20T23:30:03.804636+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:04 smithi044 bash[22676]: cluster 2024-09-20T23:30:03.532269+0000 mgr.a (mgr.14388) 3264 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:30:05.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:04 smithi044 bash[22676]: audit 2024-09-20T23:30:03.794149+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:04 smithi044 bash[22676]: audit 2024-09-20T23:30:03.799758+0000 mon.a (mon.0) 3271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:04 smithi044 bash[22676]: audit 2024-09-20T23:30:03.804636+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:05.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:05.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:05.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:05 smithi049 bash[23528]: audit 2024-09-20T23:30:05.555221+0000 mon.a (mon.0) 3273 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:05 smithi049 bash[23528]: audit 2024-09-20T23:30:05.558917+0000 mon.a (mon.0) 3274 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:05 smithi049 bash[23528]: audit 2024-09-20T23:30:05.559693+0000 mon.a (mon.0) 3275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:05 smithi049 bash[23528]: audit 2024-09-20T23:30:05.565540+0000 mon.a (mon.0) 3276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:05 smithi049 bash[23528]: audit 2024-09-20T23:30:05.568141+0000 mon.a (mon.0) 3277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:30:06.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:05 smithi179 bash[23186]: audit 2024-09-20T23:30:05.555221+0000 mon.a (mon.0) 3273 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:06.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:05 smithi179 bash[23186]: audit 2024-09-20T23:30:05.558917+0000 mon.a (mon.0) 3274 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:06.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:05 smithi179 bash[23186]: audit 2024-09-20T23:30:05.559693+0000 mon.a (mon.0) 3275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:06.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:05 smithi179 bash[23186]: audit 2024-09-20T23:30:05.565540+0000 mon.a (mon.0) 3276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:06.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:05 smithi179 bash[23186]: audit 2024-09-20T23:30:05.568141+0000 mon.a (mon.0) 3277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:30:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:05 smithi044 bash[22676]: audit 2024-09-20T23:30:05.555221+0000 mon.a (mon.0) 3273 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:30:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:05 smithi044 bash[22676]: audit 2024-09-20T23:30:05.558917+0000 mon.a (mon.0) 3274 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:30:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:05 smithi044 bash[22676]: audit 2024-09-20T23:30:05.559693+0000 mon.a (mon.0) 3275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:30:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:05 smithi044 bash[22676]: audit 2024-09-20T23:30:05.565540+0000 mon.a (mon.0) 3276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:05 smithi044 bash[22676]: audit 2024-09-20T23:30:05.568141+0000 mon.a (mon.0) 3277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:30:06.715 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:06.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:30:06 smithi044 bash[22930]: debug 2024-09-20T23:30:06.306+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:30:06.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:30:06 smithi044 bash[22930]: debug 2024-09-20T23:30:06.318+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:30:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:06 smithi044 bash[22676]: cluster 2024-09-20T23:30:05.533336+0000 mgr.a (mgr.14388) 3265 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:06 smithi044 bash[22676]: audit 2024-09-20T23:30:05.569097+0000 mgr.a (mgr.14388) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:30:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:06 smithi044 bash[22676]: audit 2024-09-20T23:30:05.802508+0000 mgr.a (mgr.14388) 3267 : audit [DBG] from='client.81618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:06 smithi179 bash[23186]: cluster 2024-09-20T23:30:05.533336+0000 mgr.a (mgr.14388) 3265 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:06 smithi179 bash[23186]: audit 2024-09-20T23:30:05.569097+0000 mgr.a (mgr.14388) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:30:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:06 smithi179 bash[23186]: audit 2024-09-20T23:30:05.802508+0000 mgr.a (mgr.14388) 3267 : audit [DBG] from='client.81618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:06 smithi049 bash[23528]: cluster 2024-09-20T23:30:05.533336+0000 mgr.a (mgr.14388) 3265 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:06 smithi049 bash[23528]: audit 2024-09-20T23:30:05.569097+0000 mgr.a (mgr.14388) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:30:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:06 smithi049 bash[23528]: audit 2024-09-20T23:30:05.802508+0000 mgr.a (mgr.14388) 3267 : audit [DBG] from='client.81618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:07 smithi044 bash[22676]: audit 2024-09-20T23:30:06.312334+0000 mgr.a (mgr.14388) 3268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:30:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:07 smithi044 bash[22676]: cephadm 2024-09-20T23:30:06.323057+0000 mgr.a (mgr.14388) 3269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:30:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:07 smithi179 bash[23186]: audit 2024-09-20T23:30:06.312334+0000 mgr.a (mgr.14388) 3268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:30:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:07 smithi179 bash[23186]: cephadm 2024-09-20T23:30:06.323057+0000 mgr.a (mgr.14388) 3269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:30:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:07 smithi049 bash[23528]: audit 2024-09-20T23:30:06.312334+0000 mgr.a (mgr.14388) 3268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:30:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:07 smithi049 bash[23528]: cephadm 2024-09-20T23:30:06.323057+0000 mgr.a (mgr.14388) 3269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:30:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:08 smithi044 bash[22676]: cluster 2024-09-20T23:30:07.534219+0000 mgr.a (mgr.14388) 3270 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:08 smithi179 bash[23186]: cluster 2024-09-20T23:30:07.534219+0000 mgr.a (mgr.14388) 3270 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:08 smithi049 bash[23528]: cluster 2024-09-20T23:30:07.534219+0000 mgr.a (mgr.14388) 3270 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:10 smithi044 bash[22676]: cluster 2024-09-20T23:30:09.535039+0000 mgr.a (mgr.14388) 3271 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:10 smithi179 bash[23186]: cluster 2024-09-20T23:30:09.535039+0000 mgr.a (mgr.14388) 3271 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:10 smithi049 bash[23528]: cluster 2024-09-20T23:30:09.535039+0000 mgr.a (mgr.14388) 3271 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:11.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:12 smithi044 bash[22676]: cluster 2024-09-20T23:30:11.537365+0000 mgr.a (mgr.14388) 3272 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:12.499 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:12.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:12.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:12.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:12.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:12 smithi179 bash[23186]: cluster 2024-09-20T23:30:11.537365+0000 mgr.a (mgr.14388) 3272 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:12 smithi049 bash[23528]: cluster 2024-09-20T23:30:11.537365+0000 mgr.a (mgr.14388) 3272 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:13 smithi044 bash[22676]: audit 2024-09-20T23:30:12.053841+0000 mgr.a (mgr.14388) 3273 : audit [DBG] from='client.81798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:13.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:13 smithi179 bash[23186]: audit 2024-09-20T23:30:12.053841+0000 mgr.a (mgr.14388) 3273 : audit [DBG] from='client.81798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:13 smithi049 bash[23528]: audit 2024-09-20T23:30:12.053841+0000 mgr.a (mgr.14388) 3273 : audit [DBG] from='client.81798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:14 smithi044 bash[22676]: cluster 2024-09-20T23:30:13.538315+0000 mgr.a (mgr.14388) 3274 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:30:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:14 smithi179 bash[23186]: cluster 2024-09-20T23:30:13.538315+0000 mgr.a (mgr.14388) 3274 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:30:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:14 smithi049 bash[23528]: cluster 2024-09-20T23:30:13.538315+0000 mgr.a (mgr.14388) 3274 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:30:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:16 smithi044 bash[22676]: cluster 2024-09-20T23:30:15.540478+0000 mgr.a (mgr.14388) 3275 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:16 smithi179 bash[23186]: cluster 2024-09-20T23:30:15.540478+0000 mgr.a (mgr.14388) 3275 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:16 smithi049 bash[23528]: cluster 2024-09-20T23:30:15.540478+0000 mgr.a (mgr.14388) 3275 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:17.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:17.502 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:17.502 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:18.271 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:18.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:18 smithi044 bash[22676]: cluster 2024-09-20T23:30:17.541266+0000 mgr.a (mgr.14388) 3276 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:18 smithi044 bash[22676]: audit 2024-09-20T23:30:17.835131+0000 mgr.a (mgr.14388) 3277 : audit [DBG] from='client.81876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:18 smithi179 bash[23186]: cluster 2024-09-20T23:30:17.541266+0000 mgr.a (mgr.14388) 3276 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:18 smithi179 bash[23186]: audit 2024-09-20T23:30:17.835131+0000 mgr.a (mgr.14388) 3277 : audit [DBG] from='client.81876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:18 smithi049 bash[23528]: cluster 2024-09-20T23:30:17.541266+0000 mgr.a (mgr.14388) 3276 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:18 smithi049 bash[23528]: audit 2024-09-20T23:30:17.835131+0000 mgr.a (mgr.14388) 3277 : audit [DBG] from='client.81876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:20.772 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:20 smithi049 bash[23528]: cluster 2024-09-20T23:30:19.542208+0000 mgr.a (mgr.14388) 3278 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:20 smithi044 bash[22676]: cluster 2024-09-20T23:30:19.542208+0000 mgr.a (mgr.14388) 3278 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:20 smithi179 bash[23186]: cluster 2024-09-20T23:30:19.542208+0000 mgr.a (mgr.14388) 3278 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:22 smithi049 bash[23528]: audit 2024-09-20T23:30:21.322356+0000 mon.a (mon.0) 3278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:22 smithi049 bash[23528]: audit 2024-09-20T23:30:21.331142+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:22 smithi049 bash[23528]: audit 2024-09-20T23:30:21.341514+0000 mon.a (mon.0) 3280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:22 smithi049 bash[23528]: cluster 2024-09-20T23:30:21.544440+0000 mgr.a (mgr.14388) 3279 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:22 smithi049 bash[23528]: audit 2024-09-20T23:30:21.878995+0000 mon.a (mon.0) 3281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:22 smithi049 bash[23528]: audit 2024-09-20T23:30:21.887288+0000 mon.a (mon.0) 3282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:22 smithi049 bash[23528]: audit 2024-09-20T23:30:21.897567+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.658 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:22 smithi179 bash[23186]: audit 2024-09-20T23:30:21.322356+0000 mon.a (mon.0) 3278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.658 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:22 smithi179 bash[23186]: audit 2024-09-20T23:30:21.331142+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.658 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:22 smithi179 bash[23186]: audit 2024-09-20T23:30:21.341514+0000 mon.a (mon.0) 3280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.658 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:22 smithi179 bash[23186]: cluster 2024-09-20T23:30:21.544440+0000 mgr.a (mgr.14388) 3279 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:22.659 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:22 smithi179 bash[23186]: audit 2024-09-20T23:30:21.878995+0000 mon.a (mon.0) 3281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.659 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:22 smithi179 bash[23186]: audit 2024-09-20T23:30:21.887288+0000 mon.a (mon.0) 3282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.659 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:22 smithi179 bash[23186]: audit 2024-09-20T23:30:21.897567+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:22 smithi044 bash[22676]: audit 2024-09-20T23:30:21.322356+0000 mon.a (mon.0) 3278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:22 smithi044 bash[22676]: audit 2024-09-20T23:30:21.331142+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:22 smithi044 bash[22676]: audit 2024-09-20T23:30:21.341514+0000 mon.a (mon.0) 3280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:22 smithi044 bash[22676]: cluster 2024-09-20T23:30:21.544440+0000 mgr.a (mgr.14388) 3279 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:30:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:22 smithi044 bash[22676]: audit 2024-09-20T23:30:21.878995+0000 mon.a (mon.0) 3281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:22 smithi044 bash[22676]: audit 2024-09-20T23:30:21.887288+0000 mon.a (mon.0) 3282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:22 smithi044 bash[22676]: audit 2024-09-20T23:30:21.897567+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:23.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:23.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:23.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:24.055 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:24.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:24.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:24.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:24.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:24.680 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:24 smithi044 bash[22676]: cluster 2024-09-20T23:30:23.545211+0000 mgr.a (mgr.14388) 3280 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:24.680 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:24 smithi044 bash[22676]: audit 2024-09-20T23:30:23.616039+0000 mgr.a (mgr.14388) 3281 : audit [DBG] from='client.81954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:24.680 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:24 smithi044 bash[22676]: audit 2024-09-20T23:30:23.934112+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:24.680 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:24 smithi044 bash[22676]: audit 2024-09-20T23:30:23.939442+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:24.680 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:24 smithi044 bash[22676]: audit 2024-09-20T23:30:23.946737+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:24 smithi179 bash[23186]: cluster 2024-09-20T23:30:23.545211+0000 mgr.a (mgr.14388) 3280 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:24 smithi179 bash[23186]: audit 2024-09-20T23:30:23.616039+0000 mgr.a (mgr.14388) 3281 : audit [DBG] from='client.81954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:24 smithi179 bash[23186]: audit 2024-09-20T23:30:23.934112+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:24 smithi179 bash[23186]: audit 2024-09-20T23:30:23.939442+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:24 smithi179 bash[23186]: audit 2024-09-20T23:30:23.946737+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:24 smithi049 bash[23528]: cluster 2024-09-20T23:30:23.545211+0000 mgr.a (mgr.14388) 3280 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:24 smithi049 bash[23528]: audit 2024-09-20T23:30:23.616039+0000 mgr.a (mgr.14388) 3281 : audit [DBG] from='client.81954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:24 smithi049 bash[23528]: audit 2024-09-20T23:30:23.934112+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:24 smithi049 bash[23528]: audit 2024-09-20T23:30:23.939442+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:24 smithi049 bash[23528]: audit 2024-09-20T23:30:23.946737+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:26.866 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:26 smithi044 bash[22676]: cluster 2024-09-20T23:30:25.547535+0000 mgr.a (mgr.14388) 3282 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:26 smithi179 bash[23186]: cluster 2024-09-20T23:30:25.547535+0000 mgr.a (mgr.14388) 3282 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:26 smithi049 bash[23528]: cluster 2024-09-20T23:30:25.547535+0000 mgr.a (mgr.14388) 3282 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:28 smithi044 bash[22676]: cluster 2024-09-20T23:30:27.548302+0000 mgr.a (mgr.14388) 3283 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:28 smithi179 bash[23186]: cluster 2024-09-20T23:30:27.548302+0000 mgr.a (mgr.14388) 3283 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:28 smithi049 bash[23528]: cluster 2024-09-20T23:30:27.548302+0000 mgr.a (mgr.14388) 3283 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:29.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:29.057 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:29.057 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:29.836 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:30 smithi044 bash[22676]: audit 2024-09-20T23:30:29.400329+0000 mgr.a (mgr.14388) 3284 : audit [DBG] from='client.82032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:30 smithi044 bash[22676]: cluster 2024-09-20T23:30:29.548929+0000 mgr.a (mgr.14388) 3285 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:30 smithi179 bash[23186]: audit 2024-09-20T23:30:29.400329+0000 mgr.a (mgr.14388) 3284 : audit [DBG] from='client.82032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:30 smithi179 bash[23186]: cluster 2024-09-20T23:30:29.548929+0000 mgr.a (mgr.14388) 3285 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:30 smithi049 bash[23528]: audit 2024-09-20T23:30:29.400329+0000 mgr.a (mgr.14388) 3284 : audit [DBG] from='client.82032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:30 smithi049 bash[23528]: cluster 2024-09-20T23:30:29.548929+0000 mgr.a (mgr.14388) 3285 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:32 smithi044 bash[22676]: cluster 2024-09-20T23:30:31.551345+0000 mgr.a (mgr.14388) 3286 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:32 smithi179 bash[23186]: cluster 2024-09-20T23:30:31.551345+0000 mgr.a (mgr.14388) 3286 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:32 smithi049 bash[23528]: cluster 2024-09-20T23:30:31.551345+0000 mgr.a (mgr.14388) 3286 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:34.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:34.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:34.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:34 smithi044 bash[22676]: cluster 2024-09-20T23:30:33.552133+0000 mgr.a (mgr.14388) 3287 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:34 smithi179 bash[23186]: cluster 2024-09-20T23:30:33.552133+0000 mgr.a (mgr.14388) 3287 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:34 smithi049 bash[23528]: cluster 2024-09-20T23:30:33.552133+0000 mgr.a (mgr.14388) 3287 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:35.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:35.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:35.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:35.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:35.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:36 smithi044 bash[22676]: audit 2024-09-20T23:30:35.174662+0000 mgr.a (mgr.14388) 3288 : audit [DBG] from='client.82107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:36 smithi044 bash[22676]: cluster 2024-09-20T23:30:35.553507+0000 mgr.a (mgr.14388) 3289 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:36 smithi179 bash[23186]: audit 2024-09-20T23:30:35.174662+0000 mgr.a (mgr.14388) 3288 : audit [DBG] from='client.82107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:36 smithi179 bash[23186]: cluster 2024-09-20T23:30:35.553507+0000 mgr.a (mgr.14388) 3289 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:36 smithi049 bash[23528]: audit 2024-09-20T23:30:35.174662+0000 mgr.a (mgr.14388) 3288 : audit [DBG] from='client.82107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:36 smithi049 bash[23528]: cluster 2024-09-20T23:30:35.553507+0000 mgr.a (mgr.14388) 3289 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:38 smithi044 bash[22676]: cluster 2024-09-20T23:30:37.554244+0000 mgr.a (mgr.14388) 3290 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:38 smithi179 bash[23186]: cluster 2024-09-20T23:30:37.554244+0000 mgr.a (mgr.14388) 3290 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:38 smithi049 bash[23528]: cluster 2024-09-20T23:30:37.554244+0000 mgr.a (mgr.14388) 3290 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:40.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:40.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:40.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:40 smithi049 bash[23528]: cluster 2024-09-20T23:30:39.555016+0000 mgr.a (mgr.14388) 3291 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:40 smithi044 bash[22676]: cluster 2024-09-20T23:30:39.555016+0000 mgr.a (mgr.14388) 3291 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:40 smithi179 bash[23186]: cluster 2024-09-20T23:30:39.555016+0000 mgr.a (mgr.14388) 3291 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:30:41.377 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: audit 2024-09-20T23:30:40.956033+0000 mgr.a (mgr.14388) 3292 : audit [DBG] from='client.82185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: audit 2024-09-20T23:30:41.488426+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: audit 2024-09-20T23:30:41.497053+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: audit 2024-09-20T23:30:41.506976+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: cluster 2024-09-20T23:30:41.557840+0000 mgr.a (mgr.14388) 3293 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: audit 2024-09-20T23:30:42.107570+0000 mon.a (mon.0) 3290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: audit 2024-09-20T23:30:42.116207+0000 mon.a (mon.0) 3291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:42 smithi179 bash[23186]: audit 2024-09-20T23:30:42.126637+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: audit 2024-09-20T23:30:40.956033+0000 mgr.a (mgr.14388) 3292 : audit [DBG] from='client.82185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: audit 2024-09-20T23:30:41.488426+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: audit 2024-09-20T23:30:41.497053+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: audit 2024-09-20T23:30:41.506976+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: cluster 2024-09-20T23:30:41.557840+0000 mgr.a (mgr.14388) 3293 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: audit 2024-09-20T23:30:42.107570+0000 mon.a (mon.0) 3290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: audit 2024-09-20T23:30:42.116207+0000 mon.a (mon.0) 3291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:42 smithi049 bash[23528]: audit 2024-09-20T23:30:42.126637+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: audit 2024-09-20T23:30:40.956033+0000 mgr.a (mgr.14388) 3292 : audit [DBG] from='client.82185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: audit 2024-09-20T23:30:41.488426+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: audit 2024-09-20T23:30:41.497053+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: audit 2024-09-20T23:30:41.506976+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: cluster 2024-09-20T23:30:41.557840+0000 mgr.a (mgr.14388) 3293 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: audit 2024-09-20T23:30:42.107570+0000 mon.a (mon.0) 3290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: audit 2024-09-20T23:30:42.116207+0000 mon.a (mon.0) 3291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:42 smithi044 bash[22676]: audit 2024-09-20T23:30:42.126637+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:44 smithi179 bash[23186]: cluster 2024-09-20T23:30:43.558639+0000 mgr.a (mgr.14388) 3294 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:30:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:44 smithi179 bash[23186]: audit 2024-09-20T23:30:44.160383+0000 mon.a (mon.0) 3293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:44 smithi179 bash[23186]: audit 2024-09-20T23:30:44.168744+0000 mon.a (mon.0) 3294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:44 smithi179 bash[23186]: audit 2024-09-20T23:30:44.180408+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:44 smithi044 bash[22676]: cluster 2024-09-20T23:30:43.558639+0000 mgr.a (mgr.14388) 3294 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:30:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:44 smithi044 bash[22676]: audit 2024-09-20T23:30:44.160383+0000 mon.a (mon.0) 3293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:44 smithi044 bash[22676]: audit 2024-09-20T23:30:44.168744+0000 mon.a (mon.0) 3294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:44 smithi044 bash[22676]: audit 2024-09-20T23:30:44.180408+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:44 smithi049 bash[23528]: cluster 2024-09-20T23:30:43.558639+0000 mgr.a (mgr.14388) 3294 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:30:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:44 smithi049 bash[23528]: audit 2024-09-20T23:30:44.160383+0000 mon.a (mon.0) 3293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:44 smithi049 bash[23528]: audit 2024-09-20T23:30:44.168744+0000 mon.a (mon.0) 3294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:44 smithi049 bash[23528]: audit 2024-09-20T23:30:44.180408+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:30:46.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:46.380 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:46.380 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:46.981 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:46 smithi179 bash[23186]: cluster 2024-09-20T23:30:45.560162+0000 mgr.a (mgr.14388) 3295 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:46 smithi044 bash[22676]: cluster 2024-09-20T23:30:45.560162+0000 mgr.a (mgr.14388) 3295 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:46 smithi049 bash[23528]: cluster 2024-09-20T23:30:45.560162+0000 mgr.a (mgr.14388) 3295 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:47.149 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:47 smithi044 bash[22676]: audit 2024-09-20T23:30:46.710565+0000 mgr.a (mgr.14388) 3296 : audit [DBG] from='client.82260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:47 smithi179 bash[23186]: audit 2024-09-20T23:30:46.710565+0000 mgr.a (mgr.14388) 3296 : audit [DBG] from='client.82260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:47 smithi049 bash[23528]: audit 2024-09-20T23:30:46.710565+0000 mgr.a (mgr.14388) 3296 : audit [DBG] from='client.82260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:48 smithi044 bash[22676]: cluster 2024-09-20T23:30:47.561079+0000 mgr.a (mgr.14388) 3297 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:48 smithi179 bash[23186]: cluster 2024-09-20T23:30:47.561079+0000 mgr.a (mgr.14388) 3297 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:48 smithi049 bash[23528]: cluster 2024-09-20T23:30:47.561079+0000 mgr.a (mgr.14388) 3297 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:50 smithi044 bash[22676]: cluster 2024-09-20T23:30:49.561875+0000 mgr.a (mgr.14388) 3298 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:50 smithi179 bash[23186]: cluster 2024-09-20T23:30:49.561875+0000 mgr.a (mgr.14388) 3298 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:50 smithi049 bash[23528]: cluster 2024-09-20T23:30:49.561875+0000 mgr.a (mgr.14388) 3298 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:52.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:52.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:52.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:52.929 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:52.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:52.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:52.930 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:52 smithi044 bash[22676]: cluster 2024-09-20T23:30:51.564133+0000 mgr.a (mgr.14388) 3299 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:52 smithi179 bash[23186]: cluster 2024-09-20T23:30:51.564133+0000 mgr.a (mgr.14388) 3299 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:52 smithi049 bash[23528]: cluster 2024-09-20T23:30:51.564133+0000 mgr.a (mgr.14388) 3299 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:53 smithi044 bash[22676]: audit 2024-09-20T23:30:52.490721+0000 mgr.a (mgr.14388) 3300 : audit [DBG] from='client.82335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:53 smithi179 bash[23186]: audit 2024-09-20T23:30:52.490721+0000 mgr.a (mgr.14388) 3300 : audit [DBG] from='client.82335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:53 smithi049 bash[23528]: audit 2024-09-20T23:30:52.490721+0000 mgr.a (mgr.14388) 3300 : audit [DBG] from='client.82335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:30:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:54 smithi044 bash[22676]: cluster 2024-09-20T23:30:53.565054+0000 mgr.a (mgr.14388) 3301 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:54 smithi179 bash[23186]: cluster 2024-09-20T23:30:53.565054+0000 mgr.a (mgr.14388) 3301 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:54 smithi049 bash[23528]: cluster 2024-09-20T23:30:53.565054+0000 mgr.a (mgr.14388) 3301 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:56 smithi044 bash[22676]: cluster 2024-09-20T23:30:55.567264+0000 mgr.a (mgr.14388) 3302 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:56 smithi179 bash[23186]: cluster 2024-09-20T23:30:55.567264+0000 mgr.a (mgr.14388) 3302 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:56 smithi049 bash[23528]: cluster 2024-09-20T23:30:55.567264+0000 mgr.a (mgr.14388) 3302 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:30:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:30:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:30:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:30:58.700 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:30:58.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:30:58.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:30:58.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:30:58.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:30:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:58 smithi044 bash[22676]: cluster 2024-09-20T23:30:57.568006+0000 mgr.a (mgr.14388) 3303 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:58 smithi179 bash[23186]: cluster 2024-09-20T23:30:57.568006+0000 mgr.a (mgr.14388) 3303 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:58 smithi049 bash[23528]: cluster 2024-09-20T23:30:57.568006+0000 mgr.a (mgr.14388) 3303 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:30:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:30:59 smithi044 bash[22676]: audit 2024-09-20T23:30:58.268455+0000 mgr.a (mgr.14388) 3304 : audit [DBG] from='client.82410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:30:59 smithi179 bash[23186]: audit 2024-09-20T23:30:58.268455+0000 mgr.a (mgr.14388) 3304 : audit [DBG] from='client.82410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:30:59 smithi049 bash[23528]: audit 2024-09-20T23:30:58.268455+0000 mgr.a (mgr.14388) 3304 : audit [DBG] from='client.82410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:00 smithi044 bash[22676]: cluster 2024-09-20T23:30:59.568923+0000 mgr.a (mgr.14388) 3305 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:00 smithi179 bash[23186]: cluster 2024-09-20T23:30:59.568923+0000 mgr.a (mgr.14388) 3305 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:01.046 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:00 smithi049 bash[23528]: cluster 2024-09-20T23:30:59.568923+0000 mgr.a (mgr.14388) 3305 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:02 smithi044 bash[22676]: cluster 2024-09-20T23:31:01.571188+0000 mgr.a (mgr.14388) 3306 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:02 smithi044 bash[22676]: audit 2024-09-20T23:31:01.721432+0000 mon.a (mon.0) 3296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:02 smithi044 bash[22676]: audit 2024-09-20T23:31:01.730183+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:02 smithi044 bash[22676]: audit 2024-09-20T23:31:01.740984+0000 mon.a (mon.0) 3298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:02 smithi044 bash[22676]: audit 2024-09-20T23:31:02.313976+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:02 smithi044 bash[22676]: audit 2024-09-20T23:31:02.322188+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:02 smithi044 bash[22676]: audit 2024-09-20T23:31:02.332260+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:02 smithi179 bash[23186]: cluster 2024-09-20T23:31:01.571188+0000 mgr.a (mgr.14388) 3306 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:02 smithi179 bash[23186]: audit 2024-09-20T23:31:01.721432+0000 mon.a (mon.0) 3296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:02 smithi179 bash[23186]: audit 2024-09-20T23:31:01.730183+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:02 smithi179 bash[23186]: audit 2024-09-20T23:31:01.740984+0000 mon.a (mon.0) 3298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:02 smithi179 bash[23186]: audit 2024-09-20T23:31:02.313976+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:02 smithi179 bash[23186]: audit 2024-09-20T23:31:02.322188+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:02 smithi179 bash[23186]: audit 2024-09-20T23:31:02.332260+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:02 smithi049 bash[23528]: cluster 2024-09-20T23:31:01.571188+0000 mgr.a (mgr.14388) 3306 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:02 smithi049 bash[23528]: audit 2024-09-20T23:31:01.721432+0000 mon.a (mon.0) 3296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:02 smithi049 bash[23528]: audit 2024-09-20T23:31:01.730183+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:02 smithi049 bash[23528]: audit 2024-09-20T23:31:01.740984+0000 mon.a (mon.0) 3298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:02 smithi049 bash[23528]: audit 2024-09-20T23:31:02.313976+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:02 smithi049 bash[23528]: audit 2024-09-20T23:31:02.322188+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:02 smithi049 bash[23528]: audit 2024-09-20T23:31:02.332260+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:03.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:03.702 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:03.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:04.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:04.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:04 smithi044 bash[22676]: cluster 2024-09-20T23:31:03.571961+0000 mgr.a (mgr.14388) 3307 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:04 smithi044 bash[22676]: audit 2024-09-20T23:31:04.320287+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:04 smithi044 bash[22676]: audit 2024-09-20T23:31:04.326270+0000 mon.a (mon.0) 3303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:04 smithi044 bash[22676]: audit 2024-09-20T23:31:04.336898+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:04 smithi179 bash[23186]: cluster 2024-09-20T23:31:03.571961+0000 mgr.a (mgr.14388) 3307 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:04 smithi179 bash[23186]: audit 2024-09-20T23:31:04.320287+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:04 smithi179 bash[23186]: audit 2024-09-20T23:31:04.326270+0000 mon.a (mon.0) 3303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:04 smithi179 bash[23186]: audit 2024-09-20T23:31:04.336898+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:04 smithi049 bash[23528]: cluster 2024-09-20T23:31:03.571961+0000 mgr.a (mgr.14388) 3307 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:04 smithi049 bash[23528]: audit 2024-09-20T23:31:04.320287+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:04 smithi049 bash[23528]: audit 2024-09-20T23:31:04.326270+0000 mon.a (mon.0) 3303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:04 smithi049 bash[23528]: audit 2024-09-20T23:31:04.336898+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:05 smithi044 bash[22676]: audit 2024-09-20T23:31:04.041950+0000 mgr.a (mgr.14388) 3308 : audit [DBG] from='client.82485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:05 smithi179 bash[23186]: audit 2024-09-20T23:31:04.041950+0000 mgr.a (mgr.14388) 3308 : audit [DBG] from='client.82485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:05 smithi049 bash[23528]: audit 2024-09-20T23:31:04.041950+0000 mgr.a (mgr.14388) 3308 : audit [DBG] from='client.82485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:06 smithi044 bash[22676]: cluster 2024-09-20T23:31:05.574358+0000 mgr.a (mgr.14388) 3309 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:06 smithi044 bash[22676]: audit 2024-09-20T23:31:06.381397+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:06 smithi179 bash[23186]: cluster 2024-09-20T23:31:05.574358+0000 mgr.a (mgr.14388) 3309 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:06 smithi179 bash[23186]: audit 2024-09-20T23:31:06.381397+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:07.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:06 smithi049 bash[23528]: cluster 2024-09-20T23:31:05.574358+0000 mgr.a (mgr.14388) 3309 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:06 smithi049 bash[23528]: audit 2024-09-20T23:31:06.381397+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:31:07.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22930]: debug 2024-09-20T23:31:07.709+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:31:07.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22930]: debug 2024-09-20T23:31:07.709+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.925710+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.930763+0000 mon.a (mon.0) 3307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.945632+0000 mon.a (mon.0) 3308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.953209+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.954768+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.956033+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.965190+0000 mon.a (mon.0) 3312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.967854+0000 mon.a (mon.0) 3313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:06.968781+0000 mgr.a (mgr.14388) 3310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:31:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: cluster 2024-09-20T23:31:07.574865+0000 mgr.a (mgr.14388) 3311 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: audit 2024-09-20T23:31:07.713786+0000 mgr.a (mgr.14388) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:31:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:07 smithi044 bash[22676]: cephadm 2024-09-20T23:31:07.714981+0000 mgr.a (mgr.14388) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:31:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.925710+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.930763+0000 mon.a (mon.0) 3307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.945632+0000 mon.a (mon.0) 3308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.953209+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.954768+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.956033+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.965190+0000 mon.a (mon.0) 3312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.967854+0000 mon.a (mon.0) 3313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:31:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:06.968781+0000 mgr.a (mgr.14388) 3310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:31:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: cluster 2024-09-20T23:31:07.574865+0000 mgr.a (mgr.14388) 3311 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: audit 2024-09-20T23:31:07.713786+0000 mgr.a (mgr.14388) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:31:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:07 smithi179 bash[23186]: cephadm 2024-09-20T23:31:07.714981+0000 mgr.a (mgr.14388) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:31:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.925710+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.930763+0000 mon.a (mon.0) 3307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.945632+0000 mon.a (mon.0) 3308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.953209+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.954768+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:31:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.956033+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:31:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.965190+0000 mon.a (mon.0) 3312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.967854+0000 mon.a (mon.0) 3313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:31:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:06.968781+0000 mgr.a (mgr.14388) 3310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:31:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: cluster 2024-09-20T23:31:07.574865+0000 mgr.a (mgr.14388) 3311 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: audit 2024-09-20T23:31:07.713786+0000 mgr.a (mgr.14388) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:31:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:07 smithi049 bash[23528]: cephadm 2024-09-20T23:31:07.714981+0000 mgr.a (mgr.14388) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:31:09.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:09.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:09.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:10.283 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:10.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:10.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:10.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:10.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:10 smithi044 bash[22676]: cluster 2024-09-20T23:31:09.575573+0000 mgr.a (mgr.14388) 3314 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:10 smithi044 bash[22676]: audit 2024-09-20T23:31:09.835366+0000 mgr.a (mgr.14388) 3315 : audit [DBG] from='client.82668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:10 smithi179 bash[23186]: cluster 2024-09-20T23:31:09.575573+0000 mgr.a (mgr.14388) 3314 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:10 smithi179 bash[23186]: audit 2024-09-20T23:31:09.835366+0000 mgr.a (mgr.14388) 3315 : audit [DBG] from='client.82668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:10 smithi049 bash[23528]: cluster 2024-09-20T23:31:09.575573+0000 mgr.a (mgr.14388) 3314 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:10 smithi049 bash[23528]: audit 2024-09-20T23:31:09.835366+0000 mgr.a (mgr.14388) 3315 : audit [DBG] from='client.82668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:12 smithi044 bash[22676]: cluster 2024-09-20T23:31:11.578552+0000 mgr.a (mgr.14388) 3316 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:12 smithi179 bash[23186]: cluster 2024-09-20T23:31:11.578552+0000 mgr.a (mgr.14388) 3316 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:12 smithi049 bash[23528]: cluster 2024-09-20T23:31:11.578552+0000 mgr.a (mgr.14388) 3316 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:14 smithi044 bash[22676]: cluster 2024-09-20T23:31:13.579535+0000 mgr.a (mgr.14388) 3317 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:14 smithi179 bash[23186]: cluster 2024-09-20T23:31:13.579535+0000 mgr.a (mgr.14388) 3317 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:14 smithi049 bash[23528]: cluster 2024-09-20T23:31:13.579535+0000 mgr.a (mgr.14388) 3317 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:15.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:15.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:16.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:16 smithi044 bash[22676]: cluster 2024-09-20T23:31:15.581623+0000 mgr.a (mgr.14388) 3318 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:16 smithi044 bash[22676]: audit 2024-09-20T23:31:15.612587+0000 mgr.a (mgr.14388) 3319 : audit [DBG] from='client.82746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:16 smithi179 bash[23186]: cluster 2024-09-20T23:31:15.581623+0000 mgr.a (mgr.14388) 3318 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:16 smithi179 bash[23186]: audit 2024-09-20T23:31:15.612587+0000 mgr.a (mgr.14388) 3319 : audit [DBG] from='client.82746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:16 smithi049 bash[23528]: cluster 2024-09-20T23:31:15.581623+0000 mgr.a (mgr.14388) 3318 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:16 smithi049 bash[23528]: audit 2024-09-20T23:31:15.612587+0000 mgr.a (mgr.14388) 3319 : audit [DBG] from='client.82746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:18 smithi044 bash[22676]: cluster 2024-09-20T23:31:17.582665+0000 mgr.a (mgr.14388) 3320 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:19.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:18 smithi179 bash[23186]: cluster 2024-09-20T23:31:17.582665+0000 mgr.a (mgr.14388) 3320 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:18 smithi049 bash[23528]: cluster 2024-09-20T23:31:17.582665+0000 mgr.a (mgr.14388) 3320 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:20.948 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:20 smithi049 bash[23528]: cluster 2024-09-20T23:31:19.583501+0000 mgr.a (mgr.14388) 3321 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:20 smithi044 bash[22676]: cluster 2024-09-20T23:31:19.583501+0000 mgr.a (mgr.14388) 3321 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:20 smithi179 bash[23186]: cluster 2024-09-20T23:31:19.583501+0000 mgr.a (mgr.14388) 3321 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:31:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:21.022 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:21.811 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: audit 2024-09-20T23:31:21.360231+0000 mgr.a (mgr.14388) 3322 : audit [DBG] from='client.82821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: cluster 2024-09-20T23:31:21.584744+0000 mgr.a (mgr.14388) 3323 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: audit 2024-09-20T23:31:21.889093+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: audit 2024-09-20T23:31:21.897666+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: audit 2024-09-20T23:31:21.908928+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: audit 2024-09-20T23:31:22.543530+0000 mon.a (mon.0) 3317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: audit 2024-09-20T23:31:22.553265+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:22 smithi044 bash[22676]: audit 2024-09-20T23:31:22.564543+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: audit 2024-09-20T23:31:21.360231+0000 mgr.a (mgr.14388) 3322 : audit [DBG] from='client.82821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: cluster 2024-09-20T23:31:21.584744+0000 mgr.a (mgr.14388) 3323 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: audit 2024-09-20T23:31:21.889093+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: audit 2024-09-20T23:31:21.897666+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: audit 2024-09-20T23:31:21.908928+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: audit 2024-09-20T23:31:22.543530+0000 mon.a (mon.0) 3317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: audit 2024-09-20T23:31:22.553265+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:22 smithi179 bash[23186]: audit 2024-09-20T23:31:22.564543+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: audit 2024-09-20T23:31:21.360231+0000 mgr.a (mgr.14388) 3322 : audit [DBG] from='client.82821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: cluster 2024-09-20T23:31:21.584744+0000 mgr.a (mgr.14388) 3323 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: audit 2024-09-20T23:31:21.889093+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: audit 2024-09-20T23:31:21.897666+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: audit 2024-09-20T23:31:21.908928+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: audit 2024-09-20T23:31:22.543530+0000 mon.a (mon.0) 3317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: audit 2024-09-20T23:31:22.553265+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:22 smithi049 bash[23528]: audit 2024-09-20T23:31:22.564543+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:24 smithi179 bash[23186]: cluster 2024-09-20T23:31:23.585583+0000 mgr.a (mgr.14388) 3324 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:24 smithi179 bash[23186]: audit 2024-09-20T23:31:24.555155+0000 mon.a (mon.0) 3320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:24 smithi179 bash[23186]: audit 2024-09-20T23:31:24.563842+0000 mon.a (mon.0) 3321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:24 smithi179 bash[23186]: audit 2024-09-20T23:31:24.574546+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:24 smithi044 bash[22676]: cluster 2024-09-20T23:31:23.585583+0000 mgr.a (mgr.14388) 3324 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:24 smithi044 bash[22676]: audit 2024-09-20T23:31:24.555155+0000 mon.a (mon.0) 3320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:24 smithi044 bash[22676]: audit 2024-09-20T23:31:24.563842+0000 mon.a (mon.0) 3321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:24 smithi044 bash[22676]: audit 2024-09-20T23:31:24.574546+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:24 smithi049 bash[23528]: cluster 2024-09-20T23:31:23.585583+0000 mgr.a (mgr.14388) 3324 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:24 smithi049 bash[23528]: audit 2024-09-20T23:31:24.555155+0000 mon.a (mon.0) 3320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:24 smithi049 bash[23528]: audit 2024-09-20T23:31:24.563842+0000 mon.a (mon.0) 3321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:24 smithi049 bash[23528]: audit 2024-09-20T23:31:24.574546+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:26.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:26.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:26.921 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:26 smithi179 bash[23186]: cluster 2024-09-20T23:31:25.587892+0000 mgr.a (mgr.14388) 3325 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:26.964 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:26 smithi049 bash[23528]: cluster 2024-09-20T23:31:25.587892+0000 mgr.a (mgr.14388) 3325 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:26 smithi044 bash[22676]: cluster 2024-09-20T23:31:25.587892+0000 mgr.a (mgr.14388) 3325 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:27.595 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:27.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:27.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:27.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:27.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:28 smithi044 bash[22676]: audit 2024-09-20T23:31:27.151966+0000 mgr.a (mgr.14388) 3326 : audit [DBG] from='client.82896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:28 smithi044 bash[22676]: cluster 2024-09-20T23:31:27.588420+0000 mgr.a (mgr.14388) 3327 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:28 smithi179 bash[23186]: audit 2024-09-20T23:31:27.151966+0000 mgr.a (mgr.14388) 3326 : audit [DBG] from='client.82896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:28 smithi179 bash[23186]: cluster 2024-09-20T23:31:27.588420+0000 mgr.a (mgr.14388) 3327 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:28 smithi049 bash[23528]: audit 2024-09-20T23:31:27.151966+0000 mgr.a (mgr.14388) 3326 : audit [DBG] from='client.82896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:28 smithi049 bash[23528]: cluster 2024-09-20T23:31:27.588420+0000 mgr.a (mgr.14388) 3327 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:30 smithi044 bash[22676]: cluster 2024-09-20T23:31:29.589179+0000 mgr.a (mgr.14388) 3328 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:30 smithi179 bash[23186]: cluster 2024-09-20T23:31:29.589179+0000 mgr.a (mgr.14388) 3328 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:30 smithi049 bash[23528]: cluster 2024-09-20T23:31:29.589179+0000 mgr.a (mgr.14388) 3328 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:32.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:32.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:32.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:32 smithi044 bash[22676]: cluster 2024-09-20T23:31:31.590620+0000 mgr.a (mgr.14388) 3329 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:32 smithi179 bash[23186]: cluster 2024-09-20T23:31:31.590620+0000 mgr.a (mgr.14388) 3329 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:32 smithi049 bash[23528]: cluster 2024-09-20T23:31:31.590620+0000 mgr.a (mgr.14388) 3329 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:34 smithi044 bash[22676]: audit 2024-09-20T23:31:32.927625+0000 mgr.a (mgr.14388) 3330 : audit [DBG] from='client.82971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:34 smithi044 bash[22676]: cluster 2024-09-20T23:31:33.591728+0000 mgr.a (mgr.14388) 3331 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:34 smithi179 bash[23186]: audit 2024-09-20T23:31:32.927625+0000 mgr.a (mgr.14388) 3330 : audit [DBG] from='client.82971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:34 smithi179 bash[23186]: cluster 2024-09-20T23:31:33.591728+0000 mgr.a (mgr.14388) 3331 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:34 smithi049 bash[23528]: audit 2024-09-20T23:31:32.927625+0000 mgr.a (mgr.14388) 3330 : audit [DBG] from='client.82971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:34 smithi049 bash[23528]: cluster 2024-09-20T23:31:33.591728+0000 mgr.a (mgr.14388) 3331 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:36 smithi044 bash[22676]: cluster 2024-09-20T23:31:35.594137+0000 mgr.a (mgr.14388) 3332 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:36 smithi179 bash[23186]: cluster 2024-09-20T23:31:35.594137+0000 mgr.a (mgr.14388) 3332 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:36 smithi049 bash[23528]: cluster 2024-09-20T23:31:35.594137+0000 mgr.a (mgr.14388) 3332 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:38.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:38.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:38.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:38 smithi044 bash[22676]: cluster 2024-09-20T23:31:37.594918+0000 mgr.a (mgr.14388) 3333 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:38 smithi179 bash[23186]: cluster 2024-09-20T23:31:37.594918+0000 mgr.a (mgr.14388) 3333 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:38 smithi049 bash[23528]: cluster 2024-09-20T23:31:37.594918+0000 mgr.a (mgr.14388) 3333 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:39.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:39.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:39.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:39.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:39.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:39 smithi044 bash[22676]: audit 2024-09-20T23:31:38.679145+0000 mgr.a (mgr.14388) 3334 : audit [DBG] from='client.83049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:39 smithi179 bash[23186]: audit 2024-09-20T23:31:38.679145+0000 mgr.a (mgr.14388) 3334 : audit [DBG] from='client.83049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:40.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:39 smithi049 bash[23528]: audit 2024-09-20T23:31:38.679145+0000 mgr.a (mgr.14388) 3334 : audit [DBG] from='client.83049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:40 smithi044 bash[22676]: cluster 2024-09-20T23:31:39.595921+0000 mgr.a (mgr.14388) 3335 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:40 smithi179 bash[23186]: cluster 2024-09-20T23:31:39.595921+0000 mgr.a (mgr.14388) 3335 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:41.004 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:40 smithi049 bash[23528]: cluster 2024-09-20T23:31:39.595921+0000 mgr.a (mgr.14388) 3335 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:42 smithi044 bash[22676]: cluster 2024-09-20T23:31:41.598231+0000 mgr.a (mgr.14388) 3336 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:42 smithi044 bash[22676]: audit 2024-09-20T23:31:42.092825+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:42 smithi044 bash[22676]: audit 2024-09-20T23:31:42.102874+0000 mon.a (mon.0) 3324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:42 smithi044 bash[22676]: audit 2024-09-20T23:31:42.114598+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:42 smithi179 bash[23186]: cluster 2024-09-20T23:31:41.598231+0000 mgr.a (mgr.14388) 3336 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:42 smithi179 bash[23186]: audit 2024-09-20T23:31:42.092825+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:42 smithi179 bash[23186]: audit 2024-09-20T23:31:42.102874+0000 mon.a (mon.0) 3324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:42 smithi179 bash[23186]: audit 2024-09-20T23:31:42.114598+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:42 smithi049 bash[23528]: cluster 2024-09-20T23:31:41.598231+0000 mgr.a (mgr.14388) 3336 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:42 smithi049 bash[23528]: audit 2024-09-20T23:31:42.092825+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:42 smithi049 bash[23528]: audit 2024-09-20T23:31:42.102874+0000 mon.a (mon.0) 3324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:42 smithi049 bash[23528]: audit 2024-09-20T23:31:42.114598+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:43 smithi049 bash[23528]: audit 2024-09-20T23:31:42.772296+0000 mon.a (mon.0) 3326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:43 smithi049 bash[23528]: audit 2024-09-20T23:31:42.782163+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:43 smithi049 bash[23528]: audit 2024-09-20T23:31:42.793673+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:43 smithi044 bash[22676]: audit 2024-09-20T23:31:42.772296+0000 mon.a (mon.0) 3326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:43 smithi044 bash[22676]: audit 2024-09-20T23:31:42.782163+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:43 smithi044 bash[22676]: audit 2024-09-20T23:31:42.793673+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:43 smithi179 bash[23186]: audit 2024-09-20T23:31:42.772296+0000 mon.a (mon.0) 3326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:43 smithi179 bash[23186]: audit 2024-09-20T23:31:42.782163+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:43 smithi179 bash[23186]: audit 2024-09-20T23:31:42.793673+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.899 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:44.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:44.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:44.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:44.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:44 smithi044 bash[22676]: cluster 2024-09-20T23:31:43.598966+0000 mgr.a (mgr.14388) 3337 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:44 smithi044 bash[22676]: audit 2024-09-20T23:31:44.718257+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:44 smithi044 bash[22676]: audit 2024-09-20T23:31:44.724417+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:44 smithi044 bash[22676]: audit 2024-09-20T23:31:44.729947+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:44 smithi179 bash[23186]: cluster 2024-09-20T23:31:43.598966+0000 mgr.a (mgr.14388) 3337 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:44 smithi179 bash[23186]: audit 2024-09-20T23:31:44.718257+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:44 smithi179 bash[23186]: audit 2024-09-20T23:31:44.724417+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:44 smithi179 bash[23186]: audit 2024-09-20T23:31:44.729947+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:44 smithi049 bash[23528]: cluster 2024-09-20T23:31:43.598966+0000 mgr.a (mgr.14388) 3337 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:44 smithi049 bash[23528]: audit 2024-09-20T23:31:44.718257+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:44 smithi049 bash[23528]: audit 2024-09-20T23:31:44.724417+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:44 smithi049 bash[23528]: audit 2024-09-20T23:31:44.729947+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:31:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:45 smithi044 bash[22676]: audit 2024-09-20T23:31:44.467335+0000 mgr.a (mgr.14388) 3338 : audit [DBG] from='client.83127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:45 smithi179 bash[23186]: audit 2024-09-20T23:31:44.467335+0000 mgr.a (mgr.14388) 3338 : audit [DBG] from='client.83127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:45 smithi049 bash[23528]: audit 2024-09-20T23:31:44.467335+0000 mgr.a (mgr.14388) 3338 : audit [DBG] from='client.83127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:47.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:46 smithi179 bash[23186]: cluster 2024-09-20T23:31:45.601451+0000 mgr.a (mgr.14388) 3339 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:47.224 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:46 smithi044 bash[22676]: cluster 2024-09-20T23:31:45.601451+0000 mgr.a (mgr.14388) 3339 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:46 smithi049 bash[23528]: cluster 2024-09-20T23:31:45.601451+0000 mgr.a (mgr.14388) 3339 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:31:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:48 smithi044 bash[22676]: cluster 2024-09-20T23:31:47.602285+0000 mgr.a (mgr.14388) 3340 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:48 smithi179 bash[23186]: cluster 2024-09-20T23:31:47.602285+0000 mgr.a (mgr.14388) 3340 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:48 smithi049 bash[23528]: cluster 2024-09-20T23:31:47.602285+0000 mgr.a (mgr.14388) 3340 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:50.663 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:50 smithi044 bash[22676]: cluster 2024-09-20T23:31:49.602979+0000 mgr.a (mgr.14388) 3341 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:50 smithi179 bash[23186]: cluster 2024-09-20T23:31:49.602979+0000 mgr.a (mgr.14388) 3341 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:50 smithi049 bash[23528]: cluster 2024-09-20T23:31:49.602979+0000 mgr.a (mgr.14388) 3341 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:52.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:51 smithi044 bash[22676]: audit 2024-09-20T23:31:50.241307+0000 mgr.a (mgr.14388) 3342 : audit [DBG] from='client.83199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:51 smithi179 bash[23186]: audit 2024-09-20T23:31:50.241307+0000 mgr.a (mgr.14388) 3342 : audit [DBG] from='client.83199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:51 smithi049 bash[23528]: audit 2024-09-20T23:31:50.241307+0000 mgr.a (mgr.14388) 3342 : audit [DBG] from='client.83199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:52 smithi044 bash[22676]: cluster 2024-09-20T23:31:51.605727+0000 mgr.a (mgr.14388) 3343 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:52 smithi179 bash[23186]: cluster 2024-09-20T23:31:51.605727+0000 mgr.a (mgr.14388) 3343 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:52 smithi049 bash[23528]: cluster 2024-09-20T23:31:51.605727+0000 mgr.a (mgr.14388) 3343 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:54 smithi044 bash[22676]: cluster 2024-09-20T23:31:53.606482+0000 mgr.a (mgr.14388) 3344 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:31:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:54 smithi179 bash[23186]: cluster 2024-09-20T23:31:53.606482+0000 mgr.a (mgr.14388) 3344 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:31:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:54 smithi049 bash[23528]: cluster 2024-09-20T23:31:53.606482+0000 mgr.a (mgr.14388) 3344 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:31:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:31:55.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:31:55.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:31:56.446 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:31:56.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:31:56.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:31:56.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:31:56.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:31:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:56 smithi044 bash[22676]: cluster 2024-09-20T23:31:55.608414+0000 mgr.a (mgr.14388) 3345 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:56 smithi179 bash[23186]: cluster 2024-09-20T23:31:55.608414+0000 mgr.a (mgr.14388) 3345 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:56 smithi049 bash[23528]: cluster 2024-09-20T23:31:55.608414+0000 mgr.a (mgr.14388) 3345 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:31:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:57 smithi044 bash[22676]: audit 2024-09-20T23:31:55.999799+0000 mgr.a (mgr.14388) 3346 : audit [DBG] from='client.83274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:57 smithi179 bash[23186]: audit 2024-09-20T23:31:55.999799+0000 mgr.a (mgr.14388) 3346 : audit [DBG] from='client.83274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:57 smithi049 bash[23528]: audit 2024-09-20T23:31:55.999799+0000 mgr.a (mgr.14388) 3346 : audit [DBG] from='client.83274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:31:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:31:58 smithi044 bash[22676]: cluster 2024-09-20T23:31:57.609486+0000 mgr.a (mgr.14388) 3347 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:31:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:31:58 smithi179 bash[23186]: cluster 2024-09-20T23:31:57.609486+0000 mgr.a (mgr.14388) 3347 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:31:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:31:58 smithi049 bash[23528]: cluster 2024-09-20T23:31:57.609486+0000 mgr.a (mgr.14388) 3347 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:32:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:00 smithi044 bash[22676]: cluster 2024-09-20T23:31:59.610310+0000 mgr.a (mgr.14388) 3348 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:32:01.243 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:00 smithi049 bash[23528]: cluster 2024-09-20T23:31:59.610310+0000 mgr.a (mgr.14388) 3348 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:32:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:00 smithi179 bash[23186]: cluster 2024-09-20T23:31:59.610310+0000 mgr.a (mgr.14388) 3348 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:32:01.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:01.448 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:02.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:02.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:02.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:02 smithi044 bash[22676]: cluster 2024-09-20T23:32:01.612466+0000 mgr.a (mgr.14388) 3349 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:02 smithi044 bash[22676]: audit 2024-09-20T23:32:01.781770+0000 mgr.a (mgr.14388) 3350 : audit [DBG] from='client.83352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:02 smithi044 bash[22676]: audit 2024-09-20T23:32:02.279981+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:02 smithi044 bash[22676]: audit 2024-09-20T23:32:02.285114+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:02 smithi044 bash[22676]: audit 2024-09-20T23:32:02.291522+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:02 smithi179 bash[23186]: cluster 2024-09-20T23:32:01.612466+0000 mgr.a (mgr.14388) 3349 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:02 smithi179 bash[23186]: audit 2024-09-20T23:32:01.781770+0000 mgr.a (mgr.14388) 3350 : audit [DBG] from='client.83352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:02 smithi179 bash[23186]: audit 2024-09-20T23:32:02.279981+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:02 smithi179 bash[23186]: audit 2024-09-20T23:32:02.285114+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:02 smithi179 bash[23186]: audit 2024-09-20T23:32:02.291522+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:02 smithi049 bash[23528]: cluster 2024-09-20T23:32:01.612466+0000 mgr.a (mgr.14388) 3349 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:02 smithi049 bash[23528]: audit 2024-09-20T23:32:01.781770+0000 mgr.a (mgr.14388) 3350 : audit [DBG] from='client.83352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:02 smithi049 bash[23528]: audit 2024-09-20T23:32:02.279981+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:02 smithi049 bash[23528]: audit 2024-09-20T23:32:02.285114+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:02 smithi049 bash[23528]: audit 2024-09-20T23:32:02.291522+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:04 smithi179 bash[23186]: audit 2024-09-20T23:32:03.002545+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:04 smithi179 bash[23186]: audit 2024-09-20T23:32:03.011166+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:04 smithi179 bash[23186]: audit 2024-09-20T23:32:03.021279+0000 mon.a (mon.0) 3337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:04 smithi179 bash[23186]: cluster 2024-09-20T23:32:03.613368+0000 mgr.a (mgr.14388) 3351 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:04 smithi049 bash[23528]: audit 2024-09-20T23:32:03.002545+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:04 smithi049 bash[23528]: audit 2024-09-20T23:32:03.011166+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:04 smithi049 bash[23528]: audit 2024-09-20T23:32:03.021279+0000 mon.a (mon.0) 3337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:04 smithi049 bash[23528]: cluster 2024-09-20T23:32:03.613368+0000 mgr.a (mgr.14388) 3351 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:04 smithi044 bash[22676]: audit 2024-09-20T23:32:03.002545+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:04 smithi044 bash[22676]: audit 2024-09-20T23:32:03.011166+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:04 smithi044 bash[22676]: audit 2024-09-20T23:32:03.021279+0000 mon.a (mon.0) 3337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:04 smithi044 bash[22676]: cluster 2024-09-20T23:32:03.613368+0000 mgr.a (mgr.14388) 3351 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:05 smithi044 bash[22676]: audit 2024-09-20T23:32:04.916331+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:05 smithi044 bash[22676]: audit 2024-09-20T23:32:04.921993+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:05 smithi044 bash[22676]: audit 2024-09-20T23:32:04.929802+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:05 smithi044 bash[22676]: cluster 2024-09-20T23:32:05.615540+0000 mgr.a (mgr.14388) 3352 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:05 smithi179 bash[23186]: audit 2024-09-20T23:32:04.916331+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:05 smithi179 bash[23186]: audit 2024-09-20T23:32:04.921993+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:05 smithi179 bash[23186]: audit 2024-09-20T23:32:04.929802+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:05 smithi179 bash[23186]: cluster 2024-09-20T23:32:05.615540+0000 mgr.a (mgr.14388) 3352 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:05 smithi049 bash[23528]: audit 2024-09-20T23:32:04.916331+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:05 smithi049 bash[23528]: audit 2024-09-20T23:32:04.921993+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:05 smithi049 bash[23528]: audit 2024-09-20T23:32:04.929802+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:05 smithi049 bash[23528]: cluster 2024-09-20T23:32:05.615540+0000 mgr.a (mgr.14388) 3352 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:07.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:07.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:07.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:07.993 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:07.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:07.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:07.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:07.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:07.547539+0000 mgr.a (mgr.14388) 3353 : audit [DBG] from='client.83424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: cluster 2024-09-20T23:32:07.616114+0000 mgr.a (mgr.14388) 3354 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:07.772507+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:08.345718+0000 mon.a (mon.0) 3342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:08.355769+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:08.358543+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:08.360621+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:08.372740+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:08 smithi044 bash[22676]: audit 2024-09-20T23:32:08.379155+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:07.547539+0000 mgr.a (mgr.14388) 3353 : audit [DBG] from='client.83424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: cluster 2024-09-20T23:32:07.616114+0000 mgr.a (mgr.14388) 3354 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:07.772507+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:08.345718+0000 mon.a (mon.0) 3342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:08.355769+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:08.358543+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:08.360621+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:08.372740+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:08 smithi179 bash[23186]: audit 2024-09-20T23:32:08.379155+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:32:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:07.547539+0000 mgr.a (mgr.14388) 3353 : audit [DBG] from='client.83424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: cluster 2024-09-20T23:32:07.616114+0000 mgr.a (mgr.14388) 3354 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:07.772507+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:32:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:08.345718+0000 mon.a (mon.0) 3342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:08.355769+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:08.358543+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:32:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:08.360621+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:32:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:08.372740+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:08 smithi049 bash[23528]: audit 2024-09-20T23:32:08.379155+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:32:09.393 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:32:09 smithi044 bash[22930]: debug 2024-09-20T23:32:09.116+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:32:09.393 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:32:09 smithi044 bash[22930]: debug 2024-09-20T23:32:09.120+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:32:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:09 smithi044 bash[22676]: audit 2024-09-20T23:32:08.381986+0000 mgr.a (mgr.14388) 3355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:32:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:09 smithi179 bash[23186]: audit 2024-09-20T23:32:08.381986+0000 mgr.a (mgr.14388) 3355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:32:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:09 smithi049 bash[23528]: audit 2024-09-20T23:32:08.381986+0000 mgr.a (mgr.14388) 3355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:32:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:10 smithi044 bash[22676]: audit 2024-09-20T23:32:09.120321+0000 mgr.a (mgr.14388) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:32:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:10 smithi044 bash[22676]: cephadm 2024-09-20T23:32:09.121480+0000 mgr.a (mgr.14388) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:32:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:10 smithi044 bash[22676]: cluster 2024-09-20T23:32:09.616976+0000 mgr.a (mgr.14388) 3358 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:10 smithi179 bash[23186]: audit 2024-09-20T23:32:09.120321+0000 mgr.a (mgr.14388) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:32:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:10 smithi179 bash[23186]: cephadm 2024-09-20T23:32:09.121480+0000 mgr.a (mgr.14388) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:32:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:10 smithi179 bash[23186]: cluster 2024-09-20T23:32:09.616976+0000 mgr.a (mgr.14388) 3358 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:10 smithi049 bash[23528]: audit 2024-09-20T23:32:09.120321+0000 mgr.a (mgr.14388) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:32:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:10 smithi049 bash[23528]: cephadm 2024-09-20T23:32:09.121480+0000 mgr.a (mgr.14388) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:32:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:10 smithi049 bash[23528]: cluster 2024-09-20T23:32:09.616976+0000 mgr.a (mgr.14388) 3358 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:12 smithi044 bash[22676]: cluster 2024-09-20T23:32:11.619273+0000 mgr.a (mgr.14388) 3359 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:12.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:12.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:12.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:12 smithi179 bash[23186]: cluster 2024-09-20T23:32:11.619273+0000 mgr.a (mgr.14388) 3359 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:12 smithi049 bash[23528]: cluster 2024-09-20T23:32:11.619273+0000 mgr.a (mgr.14388) 3359 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:13.752 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:13.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:13.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:13.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:13.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:14 smithi044 bash[22676]: audit 2024-09-20T23:32:13.328853+0000 mgr.a (mgr.14388) 3360 : audit [DBG] from='client.83607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:14 smithi044 bash[22676]: cluster 2024-09-20T23:32:13.619783+0000 mgr.a (mgr.14388) 3361 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:14 smithi179 bash[23186]: audit 2024-09-20T23:32:13.328853+0000 mgr.a (mgr.14388) 3360 : audit [DBG] from='client.83607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:14 smithi179 bash[23186]: cluster 2024-09-20T23:32:13.619783+0000 mgr.a (mgr.14388) 3361 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:14 smithi049 bash[23528]: audit 2024-09-20T23:32:13.328853+0000 mgr.a (mgr.14388) 3360 : audit [DBG] from='client.83607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:14 smithi049 bash[23528]: cluster 2024-09-20T23:32:13.619783+0000 mgr.a (mgr.14388) 3361 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:16 smithi044 bash[22676]: cluster 2024-09-20T23:32:15.622095+0000 mgr.a (mgr.14388) 3362 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:16 smithi179 bash[23186]: cluster 2024-09-20T23:32:15.622095+0000 mgr.a (mgr.14388) 3362 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:16 smithi049 bash[23528]: cluster 2024-09-20T23:32:15.622095+0000 mgr.a (mgr.14388) 3362 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:18.754 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:18.754 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:18 smithi044 bash[22676]: cluster 2024-09-20T23:32:17.622863+0000 mgr.a (mgr.14388) 3363 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:18 smithi179 bash[23186]: cluster 2024-09-20T23:32:17.622863+0000 mgr.a (mgr.14388) 3363 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:18 smithi049 bash[23528]: cluster 2024-09-20T23:32:17.622863+0000 mgr.a (mgr.14388) 3363 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:19.542 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:20 smithi044 bash[22676]: audit 2024-09-20T23:32:19.089775+0000 mgr.a (mgr.14388) 3364 : audit [DBG] from='client.83685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:20 smithi044 bash[22676]: cluster 2024-09-20T23:32:19.623845+0000 mgr.a (mgr.14388) 3365 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:20 smithi179 bash[23186]: audit 2024-09-20T23:32:19.089775+0000 mgr.a (mgr.14388) 3364 : audit [DBG] from='client.83685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:20 smithi179 bash[23186]: cluster 2024-09-20T23:32:19.623845+0000 mgr.a (mgr.14388) 3365 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:20 smithi049 bash[23528]: audit 2024-09-20T23:32:19.089775+0000 mgr.a (mgr.14388) 3364 : audit [DBG] from='client.83685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:20 smithi049 bash[23528]: cluster 2024-09-20T23:32:19.623845+0000 mgr.a (mgr.14388) 3365 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:22 smithi044 bash[22676]: cluster 2024-09-20T23:32:21.626186+0000 mgr.a (mgr.14388) 3366 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:22 smithi044 bash[22676]: audit 2024-09-20T23:32:22.462201+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:22 smithi044 bash[22676]: audit 2024-09-20T23:32:22.470997+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:22 smithi044 bash[22676]: audit 2024-09-20T23:32:22.481634+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:22 smithi179 bash[23186]: cluster 2024-09-20T23:32:21.626186+0000 mgr.a (mgr.14388) 3366 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:22 smithi179 bash[23186]: audit 2024-09-20T23:32:22.462201+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:22 smithi179 bash[23186]: audit 2024-09-20T23:32:22.470997+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:22 smithi179 bash[23186]: audit 2024-09-20T23:32:22.481634+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:22 smithi049 bash[23528]: cluster 2024-09-20T23:32:21.626186+0000 mgr.a (mgr.14388) 3366 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:32:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:22 smithi049 bash[23528]: audit 2024-09-20T23:32:22.462201+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:22 smithi049 bash[23528]: audit 2024-09-20T23:32:22.470997+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:22 smithi049 bash[23528]: audit 2024-09-20T23:32:22.481634+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:24 smithi044 bash[22676]: audit 2024-09-20T23:32:23.234889+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:24 smithi044 bash[22676]: audit 2024-09-20T23:32:23.243259+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:24 smithi044 bash[22676]: audit 2024-09-20T23:32:23.253079+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:24 smithi044 bash[22676]: cluster 2024-09-20T23:32:23.626952+0000 mgr.a (mgr.14388) 3367 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:24 smithi179 bash[23186]: audit 2024-09-20T23:32:23.234889+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:24 smithi179 bash[23186]: audit 2024-09-20T23:32:23.243259+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:24 smithi179 bash[23186]: audit 2024-09-20T23:32:23.253079+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:24 smithi179 bash[23186]: cluster 2024-09-20T23:32:23.626952+0000 mgr.a (mgr.14388) 3367 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:24.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:24.544 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:24.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:24 smithi049 bash[23528]: audit 2024-09-20T23:32:23.234889+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:24 smithi049 bash[23528]: audit 2024-09-20T23:32:23.243259+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:24 smithi049 bash[23528]: audit 2024-09-20T23:32:23.253079+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:24 smithi049 bash[23528]: cluster 2024-09-20T23:32:23.626952+0000 mgr.a (mgr.14388) 3367 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:25.337 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:25.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:25.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:25.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:25.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:26 smithi044 bash[22676]: audit 2024-09-20T23:32:24.882485+0000 mgr.a (mgr.14388) 3368 : audit [DBG] from='client.83763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:26 smithi044 bash[22676]: audit 2024-09-20T23:32:25.083175+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:26 smithi044 bash[22676]: audit 2024-09-20T23:32:25.089267+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:26 smithi044 bash[22676]: audit 2024-09-20T23:32:25.096768+0000 mon.a (mon.0) 3356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:26 smithi044 bash[22676]: cluster 2024-09-20T23:32:25.629659+0000 mgr.a (mgr.14388) 3369 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:26 smithi179 bash[23186]: audit 2024-09-20T23:32:24.882485+0000 mgr.a (mgr.14388) 3368 : audit [DBG] from='client.83763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:26 smithi179 bash[23186]: audit 2024-09-20T23:32:25.083175+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:26 smithi179 bash[23186]: audit 2024-09-20T23:32:25.089267+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:26 smithi179 bash[23186]: audit 2024-09-20T23:32:25.096768+0000 mon.a (mon.0) 3356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:26 smithi179 bash[23186]: cluster 2024-09-20T23:32:25.629659+0000 mgr.a (mgr.14388) 3369 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:26 smithi049 bash[23528]: audit 2024-09-20T23:32:24.882485+0000 mgr.a (mgr.14388) 3368 : audit [DBG] from='client.83763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:26 smithi049 bash[23528]: audit 2024-09-20T23:32:25.083175+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:26 smithi049 bash[23528]: audit 2024-09-20T23:32:25.089267+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:26 smithi049 bash[23528]: audit 2024-09-20T23:32:25.096768+0000 mon.a (mon.0) 3356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:26 smithi049 bash[23528]: cluster 2024-09-20T23:32:25.629659+0000 mgr.a (mgr.14388) 3369 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:28.949 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:28 smithi179 bash[23186]: cluster 2024-09-20T23:32:27.630591+0000 mgr.a (mgr.14388) 3370 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:32:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:28 smithi044 bash[22676]: cluster 2024-09-20T23:32:27.630591+0000 mgr.a (mgr.14388) 3370 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:32:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:28 smithi049 bash[23528]: cluster 2024-09-20T23:32:27.630591+0000 mgr.a (mgr.14388) 3370 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:32:30.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:30.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:30.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:30 smithi044 bash[22676]: cluster 2024-09-20T23:32:29.631367+0000 mgr.a (mgr.14388) 3371 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:32:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:30 smithi179 bash[23186]: cluster 2024-09-20T23:32:29.631367+0000 mgr.a (mgr.14388) 3371 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:32:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:30 smithi049 bash[23528]: cluster 2024-09-20T23:32:29.631367+0000 mgr.a (mgr.14388) 3371 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:32:31.097 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:31 smithi044 bash[22676]: audit 2024-09-20T23:32:30.666359+0000 mgr.a (mgr.14388) 3372 : audit [DBG] from='client.83841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:31 smithi179 bash[23186]: audit 2024-09-20T23:32:30.666359+0000 mgr.a (mgr.14388) 3372 : audit [DBG] from='client.83841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:31 smithi049 bash[23528]: audit 2024-09-20T23:32:30.666359+0000 mgr.a (mgr.14388) 3372 : audit [DBG] from='client.83841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:32 smithi044 bash[22676]: cluster 2024-09-20T23:32:31.634293+0000 mgr.a (mgr.14388) 3373 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:32 smithi179 bash[23186]: cluster 2024-09-20T23:32:31.634293+0000 mgr.a (mgr.14388) 3373 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:32 smithi049 bash[23528]: cluster 2024-09-20T23:32:31.634293+0000 mgr.a (mgr.14388) 3373 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:34 smithi044 bash[22676]: cluster 2024-09-20T23:32:33.635120+0000 mgr.a (mgr.14388) 3374 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:32:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:34 smithi179 bash[23186]: cluster 2024-09-20T23:32:33.635120+0000 mgr.a (mgr.14388) 3374 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:32:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:34 smithi049 bash[23528]: cluster 2024-09-20T23:32:33.635120+0000 mgr.a (mgr.14388) 3374 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:32:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:36.887 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:36.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:36 smithi044 bash[22676]: cluster 2024-09-20T23:32:35.637069+0000 mgr.a (mgr.14388) 3375 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:36 smithi179 bash[23186]: cluster 2024-09-20T23:32:35.637069+0000 mgr.a (mgr.14388) 3375 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:36 smithi049 bash[23528]: cluster 2024-09-20T23:32:35.637069+0000 mgr.a (mgr.14388) 3375 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:37 smithi044 bash[22676]: audit 2024-09-20T23:32:36.433062+0000 mgr.a (mgr.14388) 3376 : audit [DBG] from='client.83916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:37 smithi179 bash[23186]: audit 2024-09-20T23:32:36.433062+0000 mgr.a (mgr.14388) 3376 : audit [DBG] from='client.83916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:37 smithi049 bash[23528]: audit 2024-09-20T23:32:36.433062+0000 mgr.a (mgr.14388) 3376 : audit [DBG] from='client.83916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:38 smithi044 bash[22676]: cluster 2024-09-20T23:32:37.638047+0000 mgr.a (mgr.14388) 3377 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:38 smithi179 bash[23186]: cluster 2024-09-20T23:32:37.638047+0000 mgr.a (mgr.14388) 3377 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:38 smithi049 bash[23528]: cluster 2024-09-20T23:32:37.638047+0000 mgr.a (mgr.14388) 3377 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:40 smithi044 bash[22676]: cluster 2024-09-20T23:32:39.638838+0000 mgr.a (mgr.14388) 3378 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:40 smithi179 bash[23186]: cluster 2024-09-20T23:32:39.638838+0000 mgr.a (mgr.14388) 3378 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:40 smithi049 bash[23528]: cluster 2024-09-20T23:32:39.638838+0000 mgr.a (mgr.14388) 3378 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:41.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:41.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:41.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:42.640 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:42 smithi049 bash[23528]: cluster 2024-09-20T23:32:41.641065+0000 mgr.a (mgr.14388) 3379 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:42 smithi049 bash[23528]: audit 2024-09-20T23:32:42.663719+0000 mon.a (mon.0) 3357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:42 smithi049 bash[23528]: audit 2024-09-20T23:32:42.669445+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:42 smithi049 bash[23528]: audit 2024-09-20T23:32:42.674529+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:42 smithi044 bash[22676]: cluster 2024-09-20T23:32:41.641065+0000 mgr.a (mgr.14388) 3379 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:42 smithi044 bash[22676]: audit 2024-09-20T23:32:42.663719+0000 mon.a (mon.0) 3357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:42 smithi044 bash[22676]: audit 2024-09-20T23:32:42.669445+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:42 smithi044 bash[22676]: audit 2024-09-20T23:32:42.674529+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:42 smithi179 bash[23186]: cluster 2024-09-20T23:32:41.641065+0000 mgr.a (mgr.14388) 3379 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:42 smithi179 bash[23186]: audit 2024-09-20T23:32:42.663719+0000 mon.a (mon.0) 3357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:42 smithi179 bash[23186]: audit 2024-09-20T23:32:42.669445+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:42 smithi179 bash[23186]: audit 2024-09-20T23:32:42.674529+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:43 smithi044 bash[22676]: audit 2024-09-20T23:32:42.212358+0000 mgr.a (mgr.14388) 3380 : audit [DBG] from='client.83991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:43 smithi044 bash[22676]: audit 2024-09-20T23:32:43.461014+0000 mon.a (mon.0) 3360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:43 smithi044 bash[22676]: audit 2024-09-20T23:32:43.470829+0000 mon.a (mon.0) 3361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:43 smithi044 bash[22676]: audit 2024-09-20T23:32:43.481100+0000 mon.a (mon.0) 3362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:43 smithi179 bash[23186]: audit 2024-09-20T23:32:42.212358+0000 mgr.a (mgr.14388) 3380 : audit [DBG] from='client.83991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:43 smithi179 bash[23186]: audit 2024-09-20T23:32:43.461014+0000 mon.a (mon.0) 3360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:43 smithi179 bash[23186]: audit 2024-09-20T23:32:43.470829+0000 mon.a (mon.0) 3361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:43 smithi179 bash[23186]: audit 2024-09-20T23:32:43.481100+0000 mon.a (mon.0) 3362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:43 smithi049 bash[23528]: audit 2024-09-20T23:32:42.212358+0000 mgr.a (mgr.14388) 3380 : audit [DBG] from='client.83991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:43 smithi049 bash[23528]: audit 2024-09-20T23:32:43.461014+0000 mon.a (mon.0) 3360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:43 smithi049 bash[23528]: audit 2024-09-20T23:32:43.470829+0000 mon.a (mon.0) 3361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:43 smithi049 bash[23528]: audit 2024-09-20T23:32:43.481100+0000 mon.a (mon.0) 3362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:44 smithi044 bash[22676]: cluster 2024-09-20T23:32:43.642007+0000 mgr.a (mgr.14388) 3381 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:44 smithi179 bash[23186]: cluster 2024-09-20T23:32:43.642007+0000 mgr.a (mgr.14388) 3381 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:44 smithi049 bash[23528]: cluster 2024-09-20T23:32:43.642007+0000 mgr.a (mgr.14388) 3381 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:46 smithi049 bash[23528]: audit 2024-09-20T23:32:45.268549+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:46 smithi049 bash[23528]: audit 2024-09-20T23:32:45.274864+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:46 smithi049 bash[23528]: audit 2024-09-20T23:32:45.282379+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:46 smithi049 bash[23528]: cluster 2024-09-20T23:32:45.644237+0000 mgr.a (mgr.14388) 3382 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:46.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:46 smithi179 bash[23186]: audit 2024-09-20T23:32:45.268549+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:46 smithi179 bash[23186]: audit 2024-09-20T23:32:45.274864+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:46 smithi179 bash[23186]: audit 2024-09-20T23:32:45.282379+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:46 smithi179 bash[23186]: cluster 2024-09-20T23:32:45.644237+0000 mgr.a (mgr.14388) 3382 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:46 smithi044 bash[22676]: audit 2024-09-20T23:32:45.268549+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:46 smithi044 bash[22676]: audit 2024-09-20T23:32:45.274864+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:46 smithi044 bash[22676]: audit 2024-09-20T23:32:45.282379+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:32:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:46 smithi044 bash[22676]: cluster 2024-09-20T23:32:45.644237+0000 mgr.a (mgr.14388) 3382 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:47.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:47.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:47.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:48.382 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:48.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:48.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:48.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:48.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:48.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:48 smithi044 bash[22676]: cluster 2024-09-20T23:32:47.644815+0000 mgr.a (mgr.14388) 3383 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:48 smithi179 bash[23186]: cluster 2024-09-20T23:32:47.644815+0000 mgr.a (mgr.14388) 3383 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:48 smithi049 bash[23528]: cluster 2024-09-20T23:32:47.644815+0000 mgr.a (mgr.14388) 3383 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:49 smithi044 bash[22676]: audit 2024-09-20T23:32:47.979982+0000 mgr.a (mgr.14388) 3384 : audit [DBG] from='client.84069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:49 smithi179 bash[23186]: audit 2024-09-20T23:32:47.979982+0000 mgr.a (mgr.14388) 3384 : audit [DBG] from='client.84069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:49 smithi049 bash[23528]: audit 2024-09-20T23:32:47.979982+0000 mgr.a (mgr.14388) 3384 : audit [DBG] from='client.84069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:50 smithi044 bash[22676]: cluster 2024-09-20T23:32:49.645825+0000 mgr.a (mgr.14388) 3385 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:50 smithi179 bash[23186]: cluster 2024-09-20T23:32:49.645825+0000 mgr.a (mgr.14388) 3385 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:50 smithi049 bash[23528]: cluster 2024-09-20T23:32:49.645825+0000 mgr.a (mgr.14388) 3385 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:52 smithi044 bash[22676]: cluster 2024-09-20T23:32:51.648159+0000 mgr.a (mgr.14388) 3386 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:52 smithi179 bash[23186]: cluster 2024-09-20T23:32:51.648159+0000 mgr.a (mgr.14388) 3386 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:52 smithi049 bash[23528]: cluster 2024-09-20T23:32:51.648159+0000 mgr.a (mgr.14388) 3386 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:53.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:53.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:53.385 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:54.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:32:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:54 smithi044 bash[22676]: cluster 2024-09-20T23:32:53.648915+0000 mgr.a (mgr.14388) 3387 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:54 smithi044 bash[22676]: audit 2024-09-20T23:32:53.718054+0000 mgr.a (mgr.14388) 3388 : audit [DBG] from='client.84147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:54 smithi179 bash[23186]: cluster 2024-09-20T23:32:53.648915+0000 mgr.a (mgr.14388) 3387 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:54 smithi179 bash[23186]: audit 2024-09-20T23:32:53.718054+0000 mgr.a (mgr.14388) 3388 : audit [DBG] from='client.84147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:54 smithi049 bash[23528]: cluster 2024-09-20T23:32:53.648915+0000 mgr.a (mgr.14388) 3387 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:54 smithi049 bash[23528]: audit 2024-09-20T23:32:53.718054+0000 mgr.a (mgr.14388) 3388 : audit [DBG] from='client.84147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:32:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:56 smithi044 bash[22676]: cluster 2024-09-20T23:32:55.651321+0000 mgr.a (mgr.14388) 3389 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:56 smithi179 bash[23186]: cluster 2024-09-20T23:32:55.651321+0000 mgr.a (mgr.14388) 3389 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:56 smithi049 bash[23528]: cluster 2024-09-20T23:32:55.651321+0000 mgr.a (mgr.14388) 3389 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:32:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:32:58 smithi044 bash[22676]: cluster 2024-09-20T23:32:57.652097+0000 mgr.a (mgr.14388) 3390 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:32:58 smithi179 bash[23186]: cluster 2024-09-20T23:32:57.652097+0000 mgr.a (mgr.14388) 3390 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:32:58 smithi049 bash[23528]: cluster 2024-09-20T23:32:57.652097+0000 mgr.a (mgr.14388) 3390 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:32:59.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:32:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:32:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:32:59.899 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:32:59.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:32:59.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:32:59.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:32:59.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:00 smithi044 bash[22676]: audit 2024-09-20T23:32:59.473353+0000 mgr.a (mgr.14388) 3391 : audit [DBG] from='client.84225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:00 smithi044 bash[22676]: cluster 2024-09-20T23:32:59.652711+0000 mgr.a (mgr.14388) 3392 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:00 smithi179 bash[23186]: audit 2024-09-20T23:32:59.473353+0000 mgr.a (mgr.14388) 3391 : audit [DBG] from='client.84225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:00 smithi179 bash[23186]: cluster 2024-09-20T23:32:59.652711+0000 mgr.a (mgr.14388) 3392 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:00 smithi049 bash[23528]: audit 2024-09-20T23:32:59.473353+0000 mgr.a (mgr.14388) 3391 : audit [DBG] from='client.84225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:00 smithi049 bash[23528]: cluster 2024-09-20T23:32:59.652711+0000 mgr.a (mgr.14388) 3392 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:02 smithi179 bash[23186]: cluster 2024-09-20T23:33:01.655078+0000 mgr.a (mgr.14388) 3393 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:02 smithi049 bash[23528]: cluster 2024-09-20T23:33:01.655078+0000 mgr.a (mgr.14388) 3393 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:02 smithi044 bash[22676]: cluster 2024-09-20T23:33:01.655078+0000 mgr.a (mgr.14388) 3393 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:03 smithi179 bash[23186]: audit 2024-09-20T23:33:02.815796+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:03 smithi179 bash[23186]: audit 2024-09-20T23:33:02.824318+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:03 smithi179 bash[23186]: audit 2024-09-20T23:33:02.836151+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:03 smithi179 bash[23186]: audit 2024-09-20T23:33:03.690315+0000 mon.a (mon.0) 3369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:03 smithi179 bash[23186]: audit 2024-09-20T23:33:03.699777+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:03 smithi179 bash[23186]: audit 2024-09-20T23:33:03.711105+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:03 smithi044 bash[22676]: audit 2024-09-20T23:33:02.815796+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:03 smithi044 bash[22676]: audit 2024-09-20T23:33:02.824318+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:03 smithi044 bash[22676]: audit 2024-09-20T23:33:02.836151+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:03 smithi044 bash[22676]: audit 2024-09-20T23:33:03.690315+0000 mon.a (mon.0) 3369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:03 smithi044 bash[22676]: audit 2024-09-20T23:33:03.699777+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:03 smithi044 bash[22676]: audit 2024-09-20T23:33:03.711105+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:03 smithi049 bash[23528]: audit 2024-09-20T23:33:02.815796+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:03 smithi049 bash[23528]: audit 2024-09-20T23:33:02.824318+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:03 smithi049 bash[23528]: audit 2024-09-20T23:33:02.836151+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:03 smithi049 bash[23528]: audit 2024-09-20T23:33:03.690315+0000 mon.a (mon.0) 3369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:03 smithi049 bash[23528]: audit 2024-09-20T23:33:03.699777+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:03 smithi049 bash[23528]: audit 2024-09-20T23:33:03.711105+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:04.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:04.901 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:04.901 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:04 smithi044 bash[22676]: cluster 2024-09-20T23:33:03.655849+0000 mgr.a (mgr.14388) 3394 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:04 smithi179 bash[23186]: cluster 2024-09-20T23:33:03.655849+0000 mgr.a (mgr.14388) 3394 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:04 smithi049 bash[23528]: cluster 2024-09-20T23:33:03.655849+0000 mgr.a (mgr.14388) 3394 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:05.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:06 smithi044 bash[22676]: audit 2024-09-20T23:33:05.237450+0000 mgr.a (mgr.14388) 3395 : audit [DBG] from='client.84300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:06 smithi044 bash[22676]: audit 2024-09-20T23:33:05.424481+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:06 smithi044 bash[22676]: audit 2024-09-20T23:33:05.430791+0000 mon.a (mon.0) 3373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:06 smithi044 bash[22676]: audit 2024-09-20T23:33:05.437974+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:06 smithi044 bash[22676]: cluster 2024-09-20T23:33:05.657223+0000 mgr.a (mgr.14388) 3396 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:06 smithi179 bash[23186]: audit 2024-09-20T23:33:05.237450+0000 mgr.a (mgr.14388) 3395 : audit [DBG] from='client.84300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:06 smithi179 bash[23186]: audit 2024-09-20T23:33:05.424481+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:06 smithi179 bash[23186]: audit 2024-09-20T23:33:05.430791+0000 mon.a (mon.0) 3373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:06 smithi179 bash[23186]: audit 2024-09-20T23:33:05.437974+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:06 smithi179 bash[23186]: cluster 2024-09-20T23:33:05.657223+0000 mgr.a (mgr.14388) 3396 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:06 smithi049 bash[23528]: audit 2024-09-20T23:33:05.237450+0000 mgr.a (mgr.14388) 3395 : audit [DBG] from='client.84300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:06 smithi049 bash[23528]: audit 2024-09-20T23:33:05.424481+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:06 smithi049 bash[23528]: audit 2024-09-20T23:33:05.430791+0000 mon.a (mon.0) 3373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:06 smithi049 bash[23528]: audit 2024-09-20T23:33:05.437974+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:06 smithi049 bash[23528]: cluster 2024-09-20T23:33:05.657223+0000 mgr.a (mgr.14388) 3396 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:08.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:08 smithi179 bash[23186]: cluster 2024-09-20T23:33:07.657948+0000 mgr.a (mgr.14388) 3397 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:08 smithi044 bash[22676]: cluster 2024-09-20T23:33:07.657948+0000 mgr.a (mgr.14388) 3397 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:08 smithi049 bash[23528]: cluster 2024-09-20T23:33:07.657948+0000 mgr.a (mgr.14388) 3397 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:09.966 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:09 smithi044 bash[22676]: audit 2024-09-20T23:33:09.174377+0000 mon.a (mon.0) 3375 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:09.966 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:09 smithi044 bash[22676]: audit 2024-09-20T23:33:09.181098+0000 mon.a (mon.0) 3376 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:09.967 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:09 smithi044 bash[22676]: audit 2024-09-20T23:33:09.182967+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:09.967 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:09 smithi044 bash[22676]: audit 2024-09-20T23:33:09.194405+0000 mon.a (mon.0) 3378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:09.967 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:09 smithi044 bash[22676]: audit 2024-09-20T23:33:09.200937+0000 mon.a (mon.0) 3379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:33:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:09 smithi179 bash[23186]: audit 2024-09-20T23:33:09.174377+0000 mon.a (mon.0) 3375 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:09 smithi179 bash[23186]: audit 2024-09-20T23:33:09.181098+0000 mon.a (mon.0) 3376 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:09 smithi179 bash[23186]: audit 2024-09-20T23:33:09.182967+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:09 smithi179 bash[23186]: audit 2024-09-20T23:33:09.194405+0000 mon.a (mon.0) 3378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:09 smithi179 bash[23186]: audit 2024-09-20T23:33:09.200937+0000 mon.a (mon.0) 3379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:33:10.040 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:09 smithi049 bash[23528]: audit 2024-09-20T23:33:09.174377+0000 mon.a (mon.0) 3375 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:33:10.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:09 smithi049 bash[23528]: audit 2024-09-20T23:33:09.181098+0000 mon.a (mon.0) 3376 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:33:10.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:09 smithi049 bash[23528]: audit 2024-09-20T23:33:09.182967+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:33:10.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:09 smithi049 bash[23528]: audit 2024-09-20T23:33:09.194405+0000 mon.a (mon.0) 3378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:10.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:09 smithi049 bash[23528]: audit 2024-09-20T23:33:09.200937+0000 mon.a (mon.0) 3379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:33:10.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:33:09 smithi044 bash[22930]: debug 2024-09-20T23:33:09.963+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:33:10.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:33:09 smithi044 bash[22930]: debug 2024-09-20T23:33:09.963+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:33:10.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:10.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:10.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:10 smithi044 bash[22676]: audit 2024-09-20T23:33:09.203424+0000 mgr.a (mgr.14388) 3398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:33:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:10 smithi044 bash[22676]: cluster 2024-09-20T23:33:09.660045+0000 mgr.a (mgr.14388) 3399 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:10 smithi179 bash[23186]: audit 2024-09-20T23:33:09.203424+0000 mgr.a (mgr.14388) 3398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:33:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:10 smithi179 bash[23186]: cluster 2024-09-20T23:33:09.660045+0000 mgr.a (mgr.14388) 3399 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:10 smithi049 bash[23528]: audit 2024-09-20T23:33:09.203424+0000 mgr.a (mgr.14388) 3398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:33:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:10 smithi049 bash[23528]: cluster 2024-09-20T23:33:09.660045+0000 mgr.a (mgr.14388) 3399 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:11.481 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:11.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:11.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:11.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:11.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:11 smithi044 bash[22676]: audit 2024-09-20T23:33:09.967285+0000 mgr.a (mgr.14388) 3400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:33:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:11 smithi044 bash[22676]: cephadm 2024-09-20T23:33:09.968400+0000 mgr.a (mgr.14388) 3401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:33:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:11 smithi179 bash[23186]: audit 2024-09-20T23:33:09.967285+0000 mgr.a (mgr.14388) 3400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:33:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:11 smithi179 bash[23186]: cephadm 2024-09-20T23:33:09.968400+0000 mgr.a (mgr.14388) 3401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:33:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:11 smithi049 bash[23528]: audit 2024-09-20T23:33:09.967285+0000 mgr.a (mgr.14388) 3400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:33:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:11 smithi049 bash[23528]: cephadm 2024-09-20T23:33:09.968400+0000 mgr.a (mgr.14388) 3401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:33:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:12 smithi044 bash[22676]: audit 2024-09-20T23:33:11.021939+0000 mgr.a (mgr.14388) 3402 : audit [DBG] from='client.84480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:12 smithi044 bash[22676]: cluster 2024-09-20T23:33:11.662844+0000 mgr.a (mgr.14388) 3403 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:33:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:12 smithi179 bash[23186]: audit 2024-09-20T23:33:11.021939+0000 mgr.a (mgr.14388) 3402 : audit [DBG] from='client.84480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:12 smithi179 bash[23186]: cluster 2024-09-20T23:33:11.662844+0000 mgr.a (mgr.14388) 3403 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:33:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:12 smithi049 bash[23528]: audit 2024-09-20T23:33:11.021939+0000 mgr.a (mgr.14388) 3402 : audit [DBG] from='client.84480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:12 smithi049 bash[23528]: cluster 2024-09-20T23:33:11.662844+0000 mgr.a (mgr.14388) 3403 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:33:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:14 smithi044 bash[22676]: cluster 2024-09-20T23:33:13.663658+0000 mgr.a (mgr.14388) 3404 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:33:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:14 smithi179 bash[23186]: cluster 2024-09-20T23:33:13.663658+0000 mgr.a (mgr.14388) 3404 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:33:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:14 smithi049 bash[23528]: cluster 2024-09-20T23:33:13.663658+0000 mgr.a (mgr.14388) 3404 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:33:16.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:16.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:16.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:16 smithi179 bash[23186]: cluster 2024-09-20T23:33:15.665606+0000 mgr.a (mgr.14388) 3405 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:16 smithi049 bash[23528]: cluster 2024-09-20T23:33:15.665606+0000 mgr.a (mgr.14388) 3405 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:16 smithi044 bash[22676]: cluster 2024-09-20T23:33:15.665606+0000 mgr.a (mgr.14388) 3405 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:17 smithi179 bash[23186]: audit 2024-09-20T23:33:16.817083+0000 mgr.a (mgr.14388) 3406 : audit [DBG] from='client.84558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:17 smithi049 bash[23528]: audit 2024-09-20T23:33:16.817083+0000 mgr.a (mgr.14388) 3406 : audit [DBG] from='client.84558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:17 smithi044 bash[22676]: audit 2024-09-20T23:33:16.817083+0000 mgr.a (mgr.14388) 3406 : audit [DBG] from='client.84558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:18 smithi179 bash[23186]: cluster 2024-09-20T23:33:17.666542+0000 mgr.a (mgr.14388) 3407 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:18 smithi049 bash[23528]: cluster 2024-09-20T23:33:17.666542+0000 mgr.a (mgr.14388) 3407 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:18 smithi044 bash[22676]: cluster 2024-09-20T23:33:17.666542+0000 mgr.a (mgr.14388) 3407 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:20 smithi179 bash[23186]: cluster 2024-09-20T23:33:19.667340+0000 mgr.a (mgr.14388) 3408 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:20 smithi049 bash[23528]: cluster 2024-09-20T23:33:19.667340+0000 mgr.a (mgr.14388) 3408 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:20 smithi044 bash[22676]: cluster 2024-09-20T23:33:19.667340+0000 mgr.a (mgr.14388) 3408 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:22.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:22.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:22.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:22.988 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:23.015 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:22 smithi049 bash[23528]: cluster 2024-09-20T23:33:21.669634+0000 mgr.a (mgr.14388) 3409 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:22 smithi044 bash[22676]: cluster 2024-09-20T23:33:21.669634+0000 mgr.a (mgr.14388) 3409 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:22 smithi179 bash[23186]: cluster 2024-09-20T23:33:21.669634+0000 mgr.a (mgr.14388) 3409 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:33:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:23 smithi049 bash[23528]: audit 2024-09-20T23:33:22.573185+0000 mgr.a (mgr.14388) 3410 : audit [DBG] from='client.84633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:23 smithi049 bash[23528]: audit 2024-09-20T23:33:23.004224+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:23 smithi049 bash[23528]: audit 2024-09-20T23:33:23.009480+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:23 smithi049 bash[23528]: audit 2024-09-20T23:33:23.014224+0000 mon.a (mon.0) 3382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:23 smithi044 bash[22676]: audit 2024-09-20T23:33:22.573185+0000 mgr.a (mgr.14388) 3410 : audit [DBG] from='client.84633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:23 smithi044 bash[22676]: audit 2024-09-20T23:33:23.004224+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:23 smithi044 bash[22676]: audit 2024-09-20T23:33:23.009480+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:23 smithi044 bash[22676]: audit 2024-09-20T23:33:23.014224+0000 mon.a (mon.0) 3382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:23 smithi179 bash[23186]: audit 2024-09-20T23:33:22.573185+0000 mgr.a (mgr.14388) 3410 : audit [DBG] from='client.84633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:24.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:23 smithi179 bash[23186]: audit 2024-09-20T23:33:23.004224+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:23 smithi179 bash[23186]: audit 2024-09-20T23:33:23.009480+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:24.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:23 smithi179 bash[23186]: audit 2024-09-20T23:33:23.014224+0000 mon.a (mon.0) 3382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:24 smithi049 bash[23528]: cluster 2024-09-20T23:33:23.670499+0000 mgr.a (mgr.14388) 3411 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:33:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:24 smithi049 bash[23528]: audit 2024-09-20T23:33:23.918210+0000 mon.a (mon.0) 3383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:24 smithi049 bash[23528]: audit 2024-09-20T23:33:23.926577+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:24 smithi049 bash[23528]: audit 2024-09-20T23:33:23.937223+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:24 smithi044 bash[22676]: cluster 2024-09-20T23:33:23.670499+0000 mgr.a (mgr.14388) 3411 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:33:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:24 smithi044 bash[22676]: audit 2024-09-20T23:33:23.918210+0000 mon.a (mon.0) 3383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:24 smithi044 bash[22676]: audit 2024-09-20T23:33:23.926577+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:24 smithi044 bash[22676]: audit 2024-09-20T23:33:23.937223+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:24 smithi179 bash[23186]: cluster 2024-09-20T23:33:23.670499+0000 mgr.a (mgr.14388) 3411 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:33:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:24 smithi179 bash[23186]: audit 2024-09-20T23:33:23.918210+0000 mon.a (mon.0) 3383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:24 smithi179 bash[23186]: audit 2024-09-20T23:33:23.926577+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:25.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:24 smithi179 bash[23186]: audit 2024-09-20T23:33:23.937223+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:26 smithi044 bash[22676]: audit 2024-09-20T23:33:25.658146+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:26 smithi044 bash[22676]: audit 2024-09-20T23:33:25.665765+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:26 smithi044 bash[22676]: cluster 2024-09-20T23:33:25.672663+0000 mgr.a (mgr.14388) 3412 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:33:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:26 smithi044 bash[22676]: audit 2024-09-20T23:33:25.675857+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:26 smithi179 bash[23186]: audit 2024-09-20T23:33:25.658146+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:26 smithi179 bash[23186]: audit 2024-09-20T23:33:25.665765+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:26 smithi179 bash[23186]: cluster 2024-09-20T23:33:25.672663+0000 mgr.a (mgr.14388) 3412 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:33:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:26 smithi179 bash[23186]: audit 2024-09-20T23:33:25.675857+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:26 smithi049 bash[23528]: audit 2024-09-20T23:33:25.658146+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:26 smithi049 bash[23528]: audit 2024-09-20T23:33:25.665765+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:26 smithi049 bash[23528]: cluster 2024-09-20T23:33:25.672663+0000 mgr.a (mgr.14388) 3412 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:33:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:26 smithi049 bash[23528]: audit 2024-09-20T23:33:25.675857+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:27.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:27.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:27.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:28.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:28.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:28.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:28.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:28.771 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:28 smithi044 bash[22676]: cluster 2024-09-20T23:33:27.673440+0000 mgr.a (mgr.14388) 3413 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:28 smithi179 bash[23186]: cluster 2024-09-20T23:33:27.673440+0000 mgr.a (mgr.14388) 3413 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:28 smithi049 bash[23528]: cluster 2024-09-20T23:33:27.673440+0000 mgr.a (mgr.14388) 3413 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:29 smithi179 bash[23186]: audit 2024-09-20T23:33:28.326604+0000 mgr.a (mgr.14388) 3414 : audit [DBG] from='client.84711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:29 smithi049 bash[23528]: audit 2024-09-20T23:33:28.326604+0000 mgr.a (mgr.14388) 3414 : audit [DBG] from='client.84711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:29 smithi044 bash[22676]: audit 2024-09-20T23:33:28.326604+0000 mgr.a (mgr.14388) 3414 : audit [DBG] from='client.84711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:30 smithi044 bash[22676]: cluster 2024-09-20T23:33:29.674562+0000 mgr.a (mgr.14388) 3415 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:30 smithi179 bash[23186]: cluster 2024-09-20T23:33:29.674562+0000 mgr.a (mgr.14388) 3415 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:30 smithi049 bash[23528]: cluster 2024-09-20T23:33:29.674562+0000 mgr.a (mgr.14388) 3415 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:32 smithi179 bash[23186]: cluster 2024-09-20T23:33:31.675903+0000 mgr.a (mgr.14388) 3416 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:32 smithi044 bash[22676]: cluster 2024-09-20T23:33:31.675903+0000 mgr.a (mgr.14388) 3416 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:32 smithi049 bash[23528]: cluster 2024-09-20T23:33:31.675903+0000 mgr.a (mgr.14388) 3416 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:33.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:33.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:33.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:34.538 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:34.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:34.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:34.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:34.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:34 smithi044 bash[22676]: cluster 2024-09-20T23:33:33.676684+0000 mgr.a (mgr.14388) 3417 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:34 smithi179 bash[23186]: cluster 2024-09-20T23:33:33.676684+0000 mgr.a (mgr.14388) 3417 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:34 smithi049 bash[23528]: cluster 2024-09-20T23:33:33.676684+0000 mgr.a (mgr.14388) 3417 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:35 smithi179 bash[23186]: audit 2024-09-20T23:33:34.104781+0000 mgr.a (mgr.14388) 3418 : audit [DBG] from='client.84789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:35 smithi049 bash[23528]: audit 2024-09-20T23:33:34.104781+0000 mgr.a (mgr.14388) 3418 : audit [DBG] from='client.84789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:35 smithi044 bash[22676]: audit 2024-09-20T23:33:34.104781+0000 mgr.a (mgr.14388) 3418 : audit [DBG] from='client.84789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:36 smithi179 bash[23186]: cluster 2024-09-20T23:33:35.679177+0000 mgr.a (mgr.14388) 3419 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:36 smithi049 bash[23528]: cluster 2024-09-20T23:33:35.679177+0000 mgr.a (mgr.14388) 3419 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:36 smithi044 bash[22676]: cluster 2024-09-20T23:33:35.679177+0000 mgr.a (mgr.14388) 3419 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:38 smithi179 bash[23186]: cluster 2024-09-20T23:33:37.679985+0000 mgr.a (mgr.14388) 3420 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:38 smithi049 bash[23528]: cluster 2024-09-20T23:33:37.679985+0000 mgr.a (mgr.14388) 3420 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:38 smithi044 bash[22676]: cluster 2024-09-20T23:33:37.679985+0000 mgr.a (mgr.14388) 3420 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:39.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:39.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:39.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:40.317 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:40 smithi179 bash[23186]: cluster 2024-09-20T23:33:39.680452+0000 mgr.a (mgr.14388) 3421 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:40 smithi179 bash[23186]: audit 2024-09-20T23:33:39.879620+0000 mgr.a (mgr.14388) 3422 : audit [DBG] from='client.84867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:40 smithi049 bash[23528]: cluster 2024-09-20T23:33:39.680452+0000 mgr.a (mgr.14388) 3421 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:40 smithi049 bash[23528]: audit 2024-09-20T23:33:39.879620+0000 mgr.a (mgr.14388) 3422 : audit [DBG] from='client.84867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:40 smithi044 bash[22676]: cluster 2024-09-20T23:33:39.680452+0000 mgr.a (mgr.14388) 3421 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:40 smithi044 bash[22676]: audit 2024-09-20T23:33:39.879620+0000 mgr.a (mgr.14388) 3422 : audit [DBG] from='client.84867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:42 smithi049 bash[23528]: cluster 2024-09-20T23:33:41.683235+0000 mgr.a (mgr.14388) 3423 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:42 smithi044 bash[22676]: cluster 2024-09-20T23:33:41.683235+0000 mgr.a (mgr.14388) 3423 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:42 smithi179 bash[23186]: cluster 2024-09-20T23:33:41.683235+0000 mgr.a (mgr.14388) 3423 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:44 smithi044 bash[22676]: audit 2024-09-20T23:33:43.224573+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:44 smithi044 bash[22676]: audit 2024-09-20T23:33:43.233141+0000 mon.a (mon.0) 3390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:44 smithi044 bash[22676]: audit 2024-09-20T23:33:43.245071+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:44 smithi044 bash[22676]: cluster 2024-09-20T23:33:43.684014+0000 mgr.a (mgr.14388) 3424 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:33:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:44 smithi044 bash[22676]: audit 2024-09-20T23:33:44.137426+0000 mon.a (mon.0) 3392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:44 smithi044 bash[22676]: audit 2024-09-20T23:33:44.146150+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:44 smithi044 bash[22676]: audit 2024-09-20T23:33:44.156425+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:44 smithi179 bash[23186]: audit 2024-09-20T23:33:43.224573+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:44 smithi179 bash[23186]: audit 2024-09-20T23:33:43.233141+0000 mon.a (mon.0) 3390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:44 smithi179 bash[23186]: audit 2024-09-20T23:33:43.245071+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:44 smithi179 bash[23186]: cluster 2024-09-20T23:33:43.684014+0000 mgr.a (mgr.14388) 3424 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:33:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:44 smithi179 bash[23186]: audit 2024-09-20T23:33:44.137426+0000 mon.a (mon.0) 3392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:44 smithi179 bash[23186]: audit 2024-09-20T23:33:44.146150+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:44 smithi179 bash[23186]: audit 2024-09-20T23:33:44.156425+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:44 smithi049 bash[23528]: audit 2024-09-20T23:33:43.224573+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:44 smithi049 bash[23528]: audit 2024-09-20T23:33:43.233141+0000 mon.a (mon.0) 3390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:44 smithi049 bash[23528]: audit 2024-09-20T23:33:43.245071+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:44 smithi049 bash[23528]: cluster 2024-09-20T23:33:43.684014+0000 mgr.a (mgr.14388) 3424 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:33:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:44 smithi049 bash[23528]: audit 2024-09-20T23:33:44.137426+0000 mon.a (mon.0) 3392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:44 smithi049 bash[23528]: audit 2024-09-20T23:33:44.146150+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:44 smithi049 bash[23528]: audit 2024-09-20T23:33:44.156425+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:45.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:45.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:45.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:46.078 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:46 smithi044 bash[22676]: audit 2024-09-20T23:33:45.654935+0000 mgr.a (mgr.14388) 3425 : audit [DBG] from='client.84945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:46 smithi044 bash[22676]: cluster 2024-09-20T23:33:45.685871+0000 mgr.a (mgr.14388) 3426 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:46 smithi044 bash[22676]: audit 2024-09-20T23:33:45.817818+0000 mon.a (mon.0) 3395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:46 smithi044 bash[22676]: audit 2024-09-20T23:33:45.823122+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:46 smithi044 bash[22676]: audit 2024-09-20T23:33:45.830173+0000 mon.a (mon.0) 3397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:46 smithi179 bash[23186]: audit 2024-09-20T23:33:45.654935+0000 mgr.a (mgr.14388) 3425 : audit [DBG] from='client.84945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:46 smithi179 bash[23186]: cluster 2024-09-20T23:33:45.685871+0000 mgr.a (mgr.14388) 3426 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:46 smithi179 bash[23186]: audit 2024-09-20T23:33:45.817818+0000 mon.a (mon.0) 3395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:46 smithi179 bash[23186]: audit 2024-09-20T23:33:45.823122+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:46 smithi179 bash[23186]: audit 2024-09-20T23:33:45.830173+0000 mon.a (mon.0) 3397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:46 smithi049 bash[23528]: audit 2024-09-20T23:33:45.654935+0000 mgr.a (mgr.14388) 3425 : audit [DBG] from='client.84945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:46 smithi049 bash[23528]: cluster 2024-09-20T23:33:45.685871+0000 mgr.a (mgr.14388) 3426 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:46 smithi049 bash[23528]: audit 2024-09-20T23:33:45.817818+0000 mon.a (mon.0) 3395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:46 smithi049 bash[23528]: audit 2024-09-20T23:33:45.823122+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:46 smithi049 bash[23528]: audit 2024-09-20T23:33:45.830173+0000 mon.a (mon.0) 3397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:33:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:48 smithi044 bash[22676]: cluster 2024-09-20T23:33:47.686771+0000 mgr.a (mgr.14388) 3427 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:33:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:48 smithi179 bash[23186]: cluster 2024-09-20T23:33:47.686771+0000 mgr.a (mgr.14388) 3427 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:33:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:48 smithi049 bash[23528]: cluster 2024-09-20T23:33:47.686771+0000 mgr.a (mgr.14388) 3427 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:33:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:50 smithi044 bash[22676]: cluster 2024-09-20T23:33:49.687555+0000 mgr.a (mgr.14388) 3428 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:51.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:50 smithi179 bash[23186]: cluster 2024-09-20T23:33:49.687555+0000 mgr.a (mgr.14388) 3428 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:51.262 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:50 smithi049 bash[23528]: cluster 2024-09-20T23:33:49.687555+0000 mgr.a (mgr.14388) 3428 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:33:51.839 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:51.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:52 smithi044 bash[22676]: audit 2024-09-20T23:33:51.412655+0000 mgr.a (mgr.14388) 3429 : audit [DBG] from='client.85023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:52 smithi044 bash[22676]: cluster 2024-09-20T23:33:51.688863+0000 mgr.a (mgr.14388) 3430 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:52 smithi179 bash[23186]: audit 2024-09-20T23:33:51.412655+0000 mgr.a (mgr.14388) 3429 : audit [DBG] from='client.85023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:52 smithi179 bash[23186]: cluster 2024-09-20T23:33:51.688863+0000 mgr.a (mgr.14388) 3430 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:52 smithi049 bash[23528]: audit 2024-09-20T23:33:51.412655+0000 mgr.a (mgr.14388) 3429 : audit [DBG] from='client.85023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:52 smithi049 bash[23528]: cluster 2024-09-20T23:33:51.688863+0000 mgr.a (mgr.14388) 3430 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:54 smithi044 bash[22676]: cluster 2024-09-20T23:33:53.689613+0000 mgr.a (mgr.14388) 3431 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:54 smithi179 bash[23186]: cluster 2024-09-20T23:33:53.689613+0000 mgr.a (mgr.14388) 3431 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:54 smithi049 bash[23528]: cluster 2024-09-20T23:33:53.689613+0000 mgr.a (mgr.14388) 3431 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:56.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:33:56.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:33:56.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:33:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:56 smithi044 bash[22676]: cluster 2024-09-20T23:33:55.691844+0000 mgr.a (mgr.14388) 3432 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:56 smithi179 bash[23186]: cluster 2024-09-20T23:33:55.691844+0000 mgr.a (mgr.14388) 3432 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:56 smithi049 bash[23528]: cluster 2024-09-20T23:33:55.691844+0000 mgr.a (mgr.14388) 3432 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:33:57.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:33:57.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:33:57.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:33:57.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:33:57.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:33:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:58 smithi044 bash[22676]: audit 2024-09-20T23:33:57.178408+0000 mgr.a (mgr.14388) 3433 : audit [DBG] from='client.85101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:33:58 smithi044 bash[22676]: cluster 2024-09-20T23:33:57.692450+0000 mgr.a (mgr.14388) 3434 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:58 smithi179 bash[23186]: audit 2024-09-20T23:33:57.178408+0000 mgr.a (mgr.14388) 3433 : audit [DBG] from='client.85101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:33:58 smithi179 bash[23186]: cluster 2024-09-20T23:33:57.692450+0000 mgr.a (mgr.14388) 3434 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:33:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:58 smithi049 bash[23528]: audit 2024-09-20T23:33:57.178408+0000 mgr.a (mgr.14388) 3433 : audit [DBG] from='client.85101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:33:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:33:58 smithi049 bash[23528]: cluster 2024-09-20T23:33:57.692450+0000 mgr.a (mgr.14388) 3434 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:00 smithi044 bash[22676]: cluster 2024-09-20T23:33:59.693170+0000 mgr.a (mgr.14388) 3435 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:00 smithi179 bash[23186]: cluster 2024-09-20T23:33:59.693170+0000 mgr.a (mgr.14388) 3435 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:00 smithi049 bash[23528]: cluster 2024-09-20T23:33:59.693170+0000 mgr.a (mgr.14388) 3435 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:02.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:02.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:02.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:03.069 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:02 smithi049 bash[23528]: cluster 2024-09-20T23:34:01.695349+0000 mgr.a (mgr.14388) 3436 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:02 smithi044 bash[22676]: cluster 2024-09-20T23:34:01.695349+0000 mgr.a (mgr.14388) 3436 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:02 smithi179 bash[23186]: cluster 2024-09-20T23:34:01.695349+0000 mgr.a (mgr.14388) 3436 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:03.399 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:03.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:03.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:03.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:03.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: audit 2024-09-20T23:34:02.961800+0000 mgr.a (mgr.14388) 3437 : audit [DBG] from='client.85179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: audit 2024-09-20T23:34:03.417597+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: audit 2024-09-20T23:34:03.422576+0000 mon.a (mon.0) 3399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: audit 2024-09-20T23:34:03.427641+0000 mon.a (mon.0) 3400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: cluster 2024-09-20T23:34:03.696387+0000 mgr.a (mgr.14388) 3438 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: audit 2024-09-20T23:34:04.328473+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: audit 2024-09-20T23:34:04.336921+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:04 smithi044 bash[22676]: audit 2024-09-20T23:34:04.348515+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: audit 2024-09-20T23:34:02.961800+0000 mgr.a (mgr.14388) 3437 : audit [DBG] from='client.85179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: audit 2024-09-20T23:34:03.417597+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: audit 2024-09-20T23:34:03.422576+0000 mon.a (mon.0) 3399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: audit 2024-09-20T23:34:03.427641+0000 mon.a (mon.0) 3400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: cluster 2024-09-20T23:34:03.696387+0000 mgr.a (mgr.14388) 3438 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: audit 2024-09-20T23:34:04.328473+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: audit 2024-09-20T23:34:04.336921+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:04 smithi179 bash[23186]: audit 2024-09-20T23:34:04.348515+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: audit 2024-09-20T23:34:02.961800+0000 mgr.a (mgr.14388) 3437 : audit [DBG] from='client.85179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: audit 2024-09-20T23:34:03.417597+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: audit 2024-09-20T23:34:03.422576+0000 mon.a (mon.0) 3399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: audit 2024-09-20T23:34:03.427641+0000 mon.a (mon.0) 3400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: cluster 2024-09-20T23:34:03.696387+0000 mgr.a (mgr.14388) 3438 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: audit 2024-09-20T23:34:04.328473+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: audit 2024-09-20T23:34:04.336921+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:04 smithi049 bash[23528]: audit 2024-09-20T23:34:04.348515+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:06 smithi049 bash[23528]: cluster 2024-09-20T23:34:05.698702+0000 mgr.a (mgr.14388) 3439 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:06 smithi049 bash[23528]: audit 2024-09-20T23:34:06.049687+0000 mon.a (mon.0) 3404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:06 smithi049 bash[23528]: audit 2024-09-20T23:34:06.057952+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:06 smithi049 bash[23528]: audit 2024-09-20T23:34:06.068461+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:06 smithi044 bash[22676]: cluster 2024-09-20T23:34:05.698702+0000 mgr.a (mgr.14388) 3439 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:06 smithi044 bash[22676]: audit 2024-09-20T23:34:06.049687+0000 mon.a (mon.0) 3404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:06 smithi044 bash[22676]: audit 2024-09-20T23:34:06.057952+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:06 smithi044 bash[22676]: audit 2024-09-20T23:34:06.068461+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:06 smithi179 bash[23186]: cluster 2024-09-20T23:34:05.698702+0000 mgr.a (mgr.14388) 3439 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:06 smithi179 bash[23186]: audit 2024-09-20T23:34:06.049687+0000 mon.a (mon.0) 3404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:06 smithi179 bash[23186]: audit 2024-09-20T23:34:06.057952+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:06 smithi179 bash[23186]: audit 2024-09-20T23:34:06.068461+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:08.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:08.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:08.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:08 smithi179 bash[23186]: cluster 2024-09-20T23:34:07.699488+0000 mgr.a (mgr.14388) 3440 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:08 smithi049 bash[23528]: cluster 2024-09-20T23:34:07.699488+0000 mgr.a (mgr.14388) 3440 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:09.170 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:09.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:08 smithi044 bash[22676]: cluster 2024-09-20T23:34:07.699488+0000 mgr.a (mgr.14388) 3440 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:09 smithi049 bash[23528]: audit 2024-09-20T23:34:08.734006+0000 mgr.a (mgr.14388) 3441 : audit [DBG] from='client.85257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:09 smithi044 bash[22676]: audit 2024-09-20T23:34:08.734006+0000 mgr.a (mgr.14388) 3441 : audit [DBG] from='client.85257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:09 smithi179 bash[23186]: audit 2024-09-20T23:34:08.734006+0000 mgr.a (mgr.14388) 3441 : audit [DBG] from='client.85257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:10 smithi049 bash[23528]: cluster 2024-09-20T23:34:09.700505+0000 mgr.a (mgr.14388) 3442 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:10 smithi049 bash[23528]: audit 2024-09-20T23:34:10.017233+0000 mon.a (mon.0) 3407 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:34:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:10 smithi049 bash[23528]: audit 2024-09-20T23:34:10.023327+0000 mon.a (mon.0) 3408 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:34:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:10 smithi049 bash[23528]: audit 2024-09-20T23:34:10.025172+0000 mon.a (mon.0) 3409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:34:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:10 smithi049 bash[23528]: audit 2024-09-20T23:34:10.035700+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:10 smithi049 bash[23528]: audit 2024-09-20T23:34:10.041045+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:34:11.097 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:10 smithi179 bash[23186]: cluster 2024-09-20T23:34:09.700505+0000 mgr.a (mgr.14388) 3442 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:11.097 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:10 smithi179 bash[23186]: audit 2024-09-20T23:34:10.017233+0000 mon.a (mon.0) 3407 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:34:11.097 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:10 smithi179 bash[23186]: audit 2024-09-20T23:34:10.023327+0000 mon.a (mon.0) 3408 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:34:11.097 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:10 smithi179 bash[23186]: audit 2024-09-20T23:34:10.025172+0000 mon.a (mon.0) 3409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:34:11.097 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:10 smithi179 bash[23186]: audit 2024-09-20T23:34:10.035700+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:11.097 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:10 smithi179 bash[23186]: audit 2024-09-20T23:34:10.041045+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:34:11.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22930]: debug 2024-09-20T23:34:10.790+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:34:11.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22930]: debug 2024-09-20T23:34:10.794+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:34:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22676]: cluster 2024-09-20T23:34:09.700505+0000 mgr.a (mgr.14388) 3442 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22676]: audit 2024-09-20T23:34:10.017233+0000 mon.a (mon.0) 3407 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:34:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22676]: audit 2024-09-20T23:34:10.023327+0000 mon.a (mon.0) 3408 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:34:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22676]: audit 2024-09-20T23:34:10.025172+0000 mon.a (mon.0) 3409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:34:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22676]: audit 2024-09-20T23:34:10.035700+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:10 smithi044 bash[22676]: audit 2024-09-20T23:34:10.041045+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:34:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:11 smithi049 bash[23528]: audit 2024-09-20T23:34:10.043756+0000 mgr.a (mgr.14388) 3443 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:34:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:11 smithi049 bash[23528]: audit 2024-09-20T23:34:10.796799+0000 mgr.a (mgr.14388) 3444 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:34:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:11 smithi049 bash[23528]: cephadm 2024-09-20T23:34:10.798017+0000 mgr.a (mgr.14388) 3445 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:34:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:11 smithi044 bash[22676]: audit 2024-09-20T23:34:10.043756+0000 mgr.a (mgr.14388) 3443 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:34:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:11 smithi044 bash[22676]: audit 2024-09-20T23:34:10.796799+0000 mgr.a (mgr.14388) 3444 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:34:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:11 smithi044 bash[22676]: cephadm 2024-09-20T23:34:10.798017+0000 mgr.a (mgr.14388) 3445 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:34:12.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:11 smithi179 bash[23186]: audit 2024-09-20T23:34:10.043756+0000 mgr.a (mgr.14388) 3443 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:34:12.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:11 smithi179 bash[23186]: audit 2024-09-20T23:34:10.796799+0000 mgr.a (mgr.14388) 3444 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:34:12.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:11 smithi179 bash[23186]: cephadm 2024-09-20T23:34:10.798017+0000 mgr.a (mgr.14388) 3445 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:34:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:12 smithi049 bash[23528]: cluster 2024-09-20T23:34:11.703302+0000 mgr.a (mgr.14388) 3446 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:13.058 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:12 smithi044 bash[22676]: cluster 2024-09-20T23:34:11.703302+0000 mgr.a (mgr.14388) 3446 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:12 smithi179 bash[23186]: cluster 2024-09-20T23:34:11.703302+0000 mgr.a (mgr.14388) 3446 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:14.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:14.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:14.942 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:14.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:14.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:14.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:14.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:14 smithi049 bash[23528]: cluster 2024-09-20T23:34:13.704126+0000 mgr.a (mgr.14388) 3447 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:15.134 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:14 smithi044 bash[22676]: cluster 2024-09-20T23:34:13.704126+0000 mgr.a (mgr.14388) 3447 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:14 smithi179 bash[23186]: cluster 2024-09-20T23:34:13.704126+0000 mgr.a (mgr.14388) 3447 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:15 smithi049 bash[23528]: audit 2024-09-20T23:34:14.517548+0000 mgr.a (mgr.14388) 3448 : audit [DBG] from='client.85440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:15 smithi044 bash[22676]: audit 2024-09-20T23:34:14.517548+0000 mgr.a (mgr.14388) 3448 : audit [DBG] from='client.85440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:15 smithi179 bash[23186]: audit 2024-09-20T23:34:14.517548+0000 mgr.a (mgr.14388) 3448 : audit [DBG] from='client.85440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:16 smithi049 bash[23528]: cluster 2024-09-20T23:34:15.706615+0000 mgr.a (mgr.14388) 3449 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:17.076 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:16 smithi044 bash[22676]: cluster 2024-09-20T23:34:15.706615+0000 mgr.a (mgr.14388) 3449 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:16 smithi179 bash[23186]: cluster 2024-09-20T23:34:15.706615+0000 mgr.a (mgr.14388) 3449 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:18 smithi044 bash[22676]: cluster 2024-09-20T23:34:17.707419+0000 mgr.a (mgr.14388) 3450 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:18 smithi179 bash[23186]: cluster 2024-09-20T23:34:17.707419+0000 mgr.a (mgr.14388) 3450 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:18 smithi049 bash[23528]: cluster 2024-09-20T23:34:17.707419+0000 mgr.a (mgr.14388) 3450 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:19.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:19.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:19.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:20.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:20.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:20 smithi044 bash[22676]: cluster 2024-09-20T23:34:19.708208+0000 mgr.a (mgr.14388) 3451 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:20 smithi179 bash[23186]: cluster 2024-09-20T23:34:19.708208+0000 mgr.a (mgr.14388) 3451 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:20 smithi049 bash[23528]: cluster 2024-09-20T23:34:19.708208+0000 mgr.a (mgr.14388) 3451 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:21 smithi044 bash[22676]: audit 2024-09-20T23:34:20.276688+0000 mgr.a (mgr.14388) 3452 : audit [DBG] from='client.85515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:22.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:21 smithi179 bash[23186]: audit 2024-09-20T23:34:20.276688+0000 mgr.a (mgr.14388) 3452 : audit [DBG] from='client.85515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:21 smithi049 bash[23528]: audit 2024-09-20T23:34:20.276688+0000 mgr.a (mgr.14388) 3452 : audit [DBG] from='client.85515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:23.084 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:22 smithi049 bash[23528]: cluster 2024-09-20T23:34:21.711008+0000 mgr.a (mgr.14388) 3453 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:22 smithi044 bash[22676]: cluster 2024-09-20T23:34:21.711008+0000 mgr.a (mgr.14388) 3453 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:22 smithi179 bash[23186]: cluster 2024-09-20T23:34:21.711008+0000 mgr.a (mgr.14388) 3453 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:24 smithi044 bash[22676]: audit 2024-09-20T23:34:23.638568+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:24 smithi044 bash[22676]: audit 2024-09-20T23:34:23.647207+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:24 smithi044 bash[22676]: audit 2024-09-20T23:34:23.657654+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:24 smithi044 bash[22676]: cluster 2024-09-20T23:34:23.711789+0000 mgr.a (mgr.14388) 3454 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:24 smithi044 bash[22676]: audit 2024-09-20T23:34:24.521091+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:24 smithi044 bash[22676]: audit 2024-09-20T23:34:24.529739+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:24 smithi044 bash[22676]: audit 2024-09-20T23:34:24.540168+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:24 smithi179 bash[23186]: audit 2024-09-20T23:34:23.638568+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:24 smithi179 bash[23186]: audit 2024-09-20T23:34:23.647207+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:24 smithi179 bash[23186]: audit 2024-09-20T23:34:23.657654+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:24 smithi179 bash[23186]: cluster 2024-09-20T23:34:23.711789+0000 mgr.a (mgr.14388) 3454 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:24 smithi179 bash[23186]: audit 2024-09-20T23:34:24.521091+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:24 smithi179 bash[23186]: audit 2024-09-20T23:34:24.529739+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:24 smithi179 bash[23186]: audit 2024-09-20T23:34:24.540168+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:24 smithi049 bash[23528]: audit 2024-09-20T23:34:23.638568+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:24 smithi049 bash[23528]: audit 2024-09-20T23:34:23.647207+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:24 smithi049 bash[23528]: audit 2024-09-20T23:34:23.657654+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:24 smithi049 bash[23528]: cluster 2024-09-20T23:34:23.711789+0000 mgr.a (mgr.14388) 3454 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:34:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:24 smithi049 bash[23528]: audit 2024-09-20T23:34:24.521091+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:24 smithi049 bash[23528]: audit 2024-09-20T23:34:24.529739+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:24 smithi049 bash[23528]: audit 2024-09-20T23:34:24.540168+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:25.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:25.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:25.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:26.510 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:26.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:26.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:26.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:26.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:26 smithi049 bash[23528]: cluster 2024-09-20T23:34:25.713017+0000 mgr.a (mgr.14388) 3455 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:26 smithi049 bash[23528]: audit 2024-09-20T23:34:26.237421+0000 mon.a (mon.0) 3418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:26 smithi049 bash[23528]: audit 2024-09-20T23:34:26.244366+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:26 smithi049 bash[23528]: audit 2024-09-20T23:34:26.250041+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:26 smithi044 bash[22676]: cluster 2024-09-20T23:34:25.713017+0000 mgr.a (mgr.14388) 3455 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:26 smithi044 bash[22676]: audit 2024-09-20T23:34:26.237421+0000 mon.a (mon.0) 3418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:26 smithi044 bash[22676]: audit 2024-09-20T23:34:26.244366+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:26 smithi044 bash[22676]: audit 2024-09-20T23:34:26.250041+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:26 smithi179 bash[23186]: cluster 2024-09-20T23:34:25.713017+0000 mgr.a (mgr.14388) 3455 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:34:27.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:26 smithi179 bash[23186]: audit 2024-09-20T23:34:26.237421+0000 mon.a (mon.0) 3418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:26 smithi179 bash[23186]: audit 2024-09-20T23:34:26.244366+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:27.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:26 smithi179 bash[23186]: audit 2024-09-20T23:34:26.250041+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:27 smithi049 bash[23528]: audit 2024-09-20T23:34:26.044720+0000 mgr.a (mgr.14388) 3456 : audit [DBG] from='client.85593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:27 smithi044 bash[22676]: audit 2024-09-20T23:34:26.044720+0000 mgr.a (mgr.14388) 3456 : audit [DBG] from='client.85593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:27 smithi179 bash[23186]: audit 2024-09-20T23:34:26.044720+0000 mgr.a (mgr.14388) 3456 : audit [DBG] from='client.85593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:28 smithi179 bash[23186]: cluster 2024-09-20T23:34:27.713943+0000 mgr.a (mgr.14388) 3457 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:28 smithi049 bash[23528]: cluster 2024-09-20T23:34:27.713943+0000 mgr.a (mgr.14388) 3457 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:28 smithi044 bash[22676]: cluster 2024-09-20T23:34:27.713943+0000 mgr.a (mgr.14388) 3457 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:30 smithi049 bash[23528]: cluster 2024-09-20T23:34:29.714697+0000 mgr.a (mgr.14388) 3458 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:31.102 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:30 smithi179 bash[23186]: cluster 2024-09-20T23:34:29.714697+0000 mgr.a (mgr.14388) 3458 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:30 smithi044 bash[22676]: cluster 2024-09-20T23:34:29.714697+0000 mgr.a (mgr.14388) 3458 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:34:31.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:32.292 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:32.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:32.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:32.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:32.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:32 smithi044 bash[22676]: cluster 2024-09-20T23:34:31.716860+0000 mgr.a (mgr.14388) 3459 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:34:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:32 smithi044 bash[22676]: audit 2024-09-20T23:34:31.853308+0000 mgr.a (mgr.14388) 3460 : audit [DBG] from='client.85671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:32 smithi049 bash[23528]: cluster 2024-09-20T23:34:31.716860+0000 mgr.a (mgr.14388) 3459 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:34:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:32 smithi049 bash[23528]: audit 2024-09-20T23:34:31.853308+0000 mgr.a (mgr.14388) 3460 : audit [DBG] from='client.85671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:32 smithi179 bash[23186]: cluster 2024-09-20T23:34:31.716860+0000 mgr.a (mgr.14388) 3459 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:34:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:32 smithi179 bash[23186]: audit 2024-09-20T23:34:31.853308+0000 mgr.a (mgr.14388) 3460 : audit [DBG] from='client.85671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:34 smithi049 bash[23528]: cluster 2024-09-20T23:34:33.717483+0000 mgr.a (mgr.14388) 3461 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:35.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:34 smithi044 bash[22676]: cluster 2024-09-20T23:34:33.717483+0000 mgr.a (mgr.14388) 3461 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:34 smithi179 bash[23186]: cluster 2024-09-20T23:34:33.717483+0000 mgr.a (mgr.14388) 3461 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:36 smithi049 bash[23528]: cluster 2024-09-20T23:34:35.718628+0000 mgr.a (mgr.14388) 3462 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:36 smithi044 bash[22676]: cluster 2024-09-20T23:34:35.718628+0000 mgr.a (mgr.14388) 3462 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:36 smithi179 bash[23186]: cluster 2024-09-20T23:34:35.718628+0000 mgr.a (mgr.14388) 3462 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:37.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:37.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:37.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:38.062 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:38 smithi049 bash[23528]: audit 2024-09-20T23:34:37.627087+0000 mgr.a (mgr.14388) 3463 : audit [DBG] from='client.85749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:38 smithi049 bash[23528]: cluster 2024-09-20T23:34:37.719108+0000 mgr.a (mgr.14388) 3464 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:38 smithi044 bash[22676]: audit 2024-09-20T23:34:37.627087+0000 mgr.a (mgr.14388) 3463 : audit [DBG] from='client.85749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:38 smithi044 bash[22676]: cluster 2024-09-20T23:34:37.719108+0000 mgr.a (mgr.14388) 3464 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:38 smithi179 bash[23186]: audit 2024-09-20T23:34:37.627087+0000 mgr.a (mgr.14388) 3463 : audit [DBG] from='client.85749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:38 smithi179 bash[23186]: cluster 2024-09-20T23:34:37.719108+0000 mgr.a (mgr.14388) 3464 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:40 smithi044 bash[22676]: cluster 2024-09-20T23:34:39.719966+0000 mgr.a (mgr.14388) 3465 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:40 smithi179 bash[23186]: cluster 2024-09-20T23:34:39.719966+0000 mgr.a (mgr.14388) 3465 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:40 smithi049 bash[23528]: cluster 2024-09-20T23:34:39.719966+0000 mgr.a (mgr.14388) 3465 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:43.081 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:42 smithi049 bash[23528]: cluster 2024-09-20T23:34:41.722253+0000 mgr.a (mgr.14388) 3466 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:42 smithi044 bash[22676]: cluster 2024-09-20T23:34:41.722253+0000 mgr.a (mgr.14388) 3466 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:42 smithi179 bash[23186]: cluster 2024-09-20T23:34:41.722253+0000 mgr.a (mgr.14388) 3466 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:43.846 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:43.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:43.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:43.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:43.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: audit 2024-09-20T23:34:43.401638+0000 mgr.a (mgr.14388) 3467 : audit [DBG] from='client.85827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: cluster 2024-09-20T23:34:43.722730+0000 mgr.a (mgr.14388) 3468 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: audit 2024-09-20T23:34:43.869827+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: audit 2024-09-20T23:34:43.874451+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: audit 2024-09-20T23:34:43.879343+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: audit 2024-09-20T23:34:44.750953+0000 mon.a (mon.0) 3424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: audit 2024-09-20T23:34:44.759947+0000 mon.a (mon.0) 3425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:44 smithi044 bash[22676]: audit 2024-09-20T23:34:44.770231+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: audit 2024-09-20T23:34:43.401638+0000 mgr.a (mgr.14388) 3467 : audit [DBG] from='client.85827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: cluster 2024-09-20T23:34:43.722730+0000 mgr.a (mgr.14388) 3468 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: audit 2024-09-20T23:34:43.869827+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: audit 2024-09-20T23:34:43.874451+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: audit 2024-09-20T23:34:43.879343+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: audit 2024-09-20T23:34:44.750953+0000 mon.a (mon.0) 3424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: audit 2024-09-20T23:34:44.759947+0000 mon.a (mon.0) 3425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:44 smithi179 bash[23186]: audit 2024-09-20T23:34:44.770231+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: audit 2024-09-20T23:34:43.401638+0000 mgr.a (mgr.14388) 3467 : audit [DBG] from='client.85827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: cluster 2024-09-20T23:34:43.722730+0000 mgr.a (mgr.14388) 3468 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: audit 2024-09-20T23:34:43.869827+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: audit 2024-09-20T23:34:43.874451+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: audit 2024-09-20T23:34:43.879343+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: audit 2024-09-20T23:34:44.750953+0000 mon.a (mon.0) 3424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: audit 2024-09-20T23:34:44.759947+0000 mon.a (mon.0) 3425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:44 smithi049 bash[23528]: audit 2024-09-20T23:34:44.770231+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:46 smithi044 bash[22676]: cluster 2024-09-20T23:34:45.724931+0000 mgr.a (mgr.14388) 3469 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:46 smithi044 bash[22676]: audit 2024-09-20T23:34:46.450222+0000 mon.a (mon.0) 3427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:46 smithi044 bash[22676]: audit 2024-09-20T23:34:46.456011+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:46 smithi044 bash[22676]: audit 2024-09-20T23:34:46.463903+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:46 smithi179 bash[23186]: cluster 2024-09-20T23:34:45.724931+0000 mgr.a (mgr.14388) 3469 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:46 smithi179 bash[23186]: audit 2024-09-20T23:34:46.450222+0000 mon.a (mon.0) 3427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:46 smithi179 bash[23186]: audit 2024-09-20T23:34:46.456011+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:46 smithi179 bash[23186]: audit 2024-09-20T23:34:46.463903+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:46 smithi049 bash[23528]: cluster 2024-09-20T23:34:45.724931+0000 mgr.a (mgr.14388) 3469 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:46 smithi049 bash[23528]: audit 2024-09-20T23:34:46.450222+0000 mon.a (mon.0) 3427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:46 smithi049 bash[23528]: audit 2024-09-20T23:34:46.456011+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:46 smithi049 bash[23528]: audit 2024-09-20T23:34:46.463903+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:34:48.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:48.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:48.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:48 smithi044 bash[22676]: cluster 2024-09-20T23:34:47.725751+0000 mgr.a (mgr.14388) 3470 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:48 smithi179 bash[23186]: cluster 2024-09-20T23:34:47.725751+0000 mgr.a (mgr.14388) 3470 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:48 smithi049 bash[23528]: cluster 2024-09-20T23:34:47.725751+0000 mgr.a (mgr.14388) 3470 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:49.605 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:49.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:49.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:49.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:49.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:50 smithi179 bash[23186]: audit 2024-09-20T23:34:49.178177+0000 mgr.a (mgr.14388) 3471 : audit [DBG] from='client.85902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:50 smithi179 bash[23186]: cluster 2024-09-20T23:34:49.726683+0000 mgr.a (mgr.14388) 3472 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:50 smithi044 bash[22676]: audit 2024-09-20T23:34:49.178177+0000 mgr.a (mgr.14388) 3471 : audit [DBG] from='client.85902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:50 smithi044 bash[22676]: cluster 2024-09-20T23:34:49.726683+0000 mgr.a (mgr.14388) 3472 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:50 smithi049 bash[23528]: audit 2024-09-20T23:34:49.178177+0000 mgr.a (mgr.14388) 3471 : audit [DBG] from='client.85902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:50 smithi049 bash[23528]: cluster 2024-09-20T23:34:49.726683+0000 mgr.a (mgr.14388) 3472 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:52 smithi179 bash[23186]: cluster 2024-09-20T23:34:51.728945+0000 mgr.a (mgr.14388) 3473 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:52 smithi044 bash[22676]: cluster 2024-09-20T23:34:51.728945+0000 mgr.a (mgr.14388) 3473 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:52 smithi049 bash[23528]: cluster 2024-09-20T23:34:51.728945+0000 mgr.a (mgr.14388) 3473 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:34:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:34:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:34:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:34:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:54 smithi044 bash[22676]: cluster 2024-09-20T23:34:53.729788+0000 mgr.a (mgr.14388) 3474 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:54 smithi179 bash[23186]: cluster 2024-09-20T23:34:53.729788+0000 mgr.a (mgr.14388) 3474 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:54 smithi049 bash[23528]: cluster 2024-09-20T23:34:53.729788+0000 mgr.a (mgr.14388) 3474 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:55.393 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:34:55.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:34:55.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:34:55.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:34:55.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:34:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:56 smithi044 bash[22676]: audit 2024-09-20T23:34:54.948858+0000 mgr.a (mgr.14388) 3475 : audit [DBG] from='client.85980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:56 smithi044 bash[22676]: cluster 2024-09-20T23:34:55.732710+0000 mgr.a (mgr.14388) 3476 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:56 smithi179 bash[23186]: audit 2024-09-20T23:34:54.948858+0000 mgr.a (mgr.14388) 3475 : audit [DBG] from='client.85980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:56 smithi179 bash[23186]: cluster 2024-09-20T23:34:55.732710+0000 mgr.a (mgr.14388) 3476 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:56 smithi049 bash[23528]: audit 2024-09-20T23:34:54.948858+0000 mgr.a (mgr.14388) 3475 : audit [DBG] from='client.85980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:34:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:56 smithi049 bash[23528]: cluster 2024-09-20T23:34:55.732710+0000 mgr.a (mgr.14388) 3476 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:34:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:34:58 smithi044 bash[22676]: cluster 2024-09-20T23:34:57.733545+0000 mgr.a (mgr.14388) 3477 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:34:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:34:58 smithi179 bash[23186]: cluster 2024-09-20T23:34:57.733545+0000 mgr.a (mgr.14388) 3477 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:34:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:34:58 smithi049 bash[23528]: cluster 2024-09-20T23:34:57.733545+0000 mgr.a (mgr.14388) 3477 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:35:00.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:00.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:00.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:01.181 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:01.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:01.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:01.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:01.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:00 smithi044 bash[22676]: cluster 2024-09-20T23:34:59.734289+0000 mgr.a (mgr.14388) 3478 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:00 smithi179 bash[23186]: cluster 2024-09-20T23:34:59.734289+0000 mgr.a (mgr.14388) 3478 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:00 smithi049 bash[23528]: cluster 2024-09-20T23:34:59.734289+0000 mgr.a (mgr.14388) 3478 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:01 smithi049 bash[23528]: audit 2024-09-20T23:35:00.731345+0000 mgr.a (mgr.14388) 3479 : audit [DBG] from='client.86058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:01 smithi044 bash[22676]: audit 2024-09-20T23:35:00.731345+0000 mgr.a (mgr.14388) 3479 : audit [DBG] from='client.86058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:01 smithi179 bash[23186]: audit 2024-09-20T23:35:00.731345+0000 mgr.a (mgr.14388) 3479 : audit [DBG] from='client.86058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:03.203 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:02 smithi049 bash[23528]: cluster 2024-09-20T23:35:01.737094+0000 mgr.a (mgr.14388) 3480 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:02 smithi044 bash[22676]: cluster 2024-09-20T23:35:01.737094+0000 mgr.a (mgr.14388) 3480 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:02 smithi179 bash[23186]: cluster 2024-09-20T23:35:01.737094+0000 mgr.a (mgr.14388) 3480 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:03 smithi044 bash[22676]: cluster 2024-09-20T23:35:03.737881+0000 mgr.a (mgr.14388) 3481 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:35:04.286 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:03 smithi179 bash[23186]: cluster 2024-09-20T23:35:03.737881+0000 mgr.a (mgr.14388) 3481 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:35:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:03 smithi049 bash[23528]: cluster 2024-09-20T23:35:03.737881+0000 mgr.a (mgr.14388) 3481 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:35:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:05 smithi179 bash[23186]: audit 2024-09-20T23:35:04.062034+0000 mon.a (mon.0) 3430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:05 smithi179 bash[23186]: audit 2024-09-20T23:35:04.070612+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:05 smithi179 bash[23186]: audit 2024-09-20T23:35:04.081073+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:05 smithi179 bash[23186]: audit 2024-09-20T23:35:04.965183+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:05 smithi179 bash[23186]: audit 2024-09-20T23:35:04.973389+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:05 smithi179 bash[23186]: audit 2024-09-20T23:35:04.983230+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:05 smithi044 bash[22676]: audit 2024-09-20T23:35:04.062034+0000 mon.a (mon.0) 3430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:05 smithi044 bash[22676]: audit 2024-09-20T23:35:04.070612+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:05 smithi044 bash[22676]: audit 2024-09-20T23:35:04.081073+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:05 smithi044 bash[22676]: audit 2024-09-20T23:35:04.965183+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:05 smithi044 bash[22676]: audit 2024-09-20T23:35:04.973389+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:05 smithi044 bash[22676]: audit 2024-09-20T23:35:04.983230+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:05 smithi049 bash[23528]: audit 2024-09-20T23:35:04.062034+0000 mon.a (mon.0) 3430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:05 smithi049 bash[23528]: audit 2024-09-20T23:35:04.070612+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:05 smithi049 bash[23528]: audit 2024-09-20T23:35:04.081073+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:05 smithi049 bash[23528]: audit 2024-09-20T23:35:04.965183+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:05 smithi049 bash[23528]: audit 2024-09-20T23:35:04.973389+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:05 smithi049 bash[23528]: audit 2024-09-20T23:35:04.983230+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:06.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:06.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:06.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:06 smithi044 bash[22676]: cluster 2024-09-20T23:35:05.739908+0000 mgr.a (mgr.14388) 3482 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:06 smithi179 bash[23186]: cluster 2024-09-20T23:35:05.739908+0000 mgr.a (mgr.14388) 3482 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:06 smithi049 bash[23528]: cluster 2024-09-20T23:35:05.739908+0000 mgr.a (mgr.14388) 3482 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:06.969 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:06.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:06.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:06.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:06.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:07 smithi044 bash[22676]: audit 2024-09-20T23:35:06.521836+0000 mgr.a (mgr.14388) 3483 : audit [DBG] from='client.86136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:07 smithi044 bash[22676]: audit 2024-09-20T23:35:06.636874+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:07 smithi044 bash[22676]: audit 2024-09-20T23:35:06.643504+0000 mon.a (mon.0) 3437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:07 smithi044 bash[22676]: audit 2024-09-20T23:35:06.649604+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:07 smithi179 bash[23186]: audit 2024-09-20T23:35:06.521836+0000 mgr.a (mgr.14388) 3483 : audit [DBG] from='client.86136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:07 smithi179 bash[23186]: audit 2024-09-20T23:35:06.636874+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:07 smithi179 bash[23186]: audit 2024-09-20T23:35:06.643504+0000 mon.a (mon.0) 3437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:07 smithi179 bash[23186]: audit 2024-09-20T23:35:06.649604+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:07 smithi049 bash[23528]: audit 2024-09-20T23:35:06.521836+0000 mgr.a (mgr.14388) 3483 : audit [DBG] from='client.86136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:07 smithi049 bash[23528]: audit 2024-09-20T23:35:06.636874+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:07 smithi049 bash[23528]: audit 2024-09-20T23:35:06.643504+0000 mon.a (mon.0) 3437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:07 smithi049 bash[23528]: audit 2024-09-20T23:35:06.649604+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:08 smithi044 bash[22676]: cluster 2024-09-20T23:35:07.740810+0000 mgr.a (mgr.14388) 3484 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:08 smithi179 bash[23186]: cluster 2024-09-20T23:35:07.740810+0000 mgr.a (mgr.14388) 3484 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:08 smithi049 bash[23528]: cluster 2024-09-20T23:35:07.740810+0000 mgr.a (mgr.14388) 3484 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:10 smithi049 bash[23528]: cluster 2024-09-20T23:35:09.741619+0000 mgr.a (mgr.14388) 3485 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:10 smithi044 bash[22676]: cluster 2024-09-20T23:35:09.741619+0000 mgr.a (mgr.14388) 3485 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:10 smithi179 bash[23186]: cluster 2024-09-20T23:35:09.741619+0000 mgr.a (mgr.14388) 3485 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:11.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:11.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:11.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22676]: audit 2024-09-20T23:35:10.864012+0000 mon.a (mon.0) 3439 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:35:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22676]: audit 2024-09-20T23:35:10.870375+0000 mon.a (mon.0) 3440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:35:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22676]: audit 2024-09-20T23:35:10.872428+0000 mon.a (mon.0) 3441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:35:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22676]: audit 2024-09-20T23:35:10.883636+0000 mon.a (mon.0) 3442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22676]: audit 2024-09-20T23:35:10.889985+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:35:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22676]: audit 2024-09-20T23:35:10.892338+0000 mgr.a (mgr.14388) 3486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:35:11.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22930]: debug 2024-09-20T23:35:11.621+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:35:11.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:35:11 smithi044 bash[22930]: debug 2024-09-20T23:35:11.621+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:35:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:11 smithi179 bash[23186]: audit 2024-09-20T23:35:10.864012+0000 mon.a (mon.0) 3439 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:35:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:11 smithi179 bash[23186]: audit 2024-09-20T23:35:10.870375+0000 mon.a (mon.0) 3440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:35:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:11 smithi179 bash[23186]: audit 2024-09-20T23:35:10.872428+0000 mon.a (mon.0) 3441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:35:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:11 smithi179 bash[23186]: audit 2024-09-20T23:35:10.883636+0000 mon.a (mon.0) 3442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:11 smithi179 bash[23186]: audit 2024-09-20T23:35:10.889985+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:35:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:11 smithi179 bash[23186]: audit 2024-09-20T23:35:10.892338+0000 mgr.a (mgr.14388) 3486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:35:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:11 smithi049 bash[23528]: audit 2024-09-20T23:35:10.864012+0000 mon.a (mon.0) 3439 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:35:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:11 smithi049 bash[23528]: audit 2024-09-20T23:35:10.870375+0000 mon.a (mon.0) 3440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:35:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:11 smithi049 bash[23528]: audit 2024-09-20T23:35:10.872428+0000 mon.a (mon.0) 3441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:35:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:11 smithi049 bash[23528]: audit 2024-09-20T23:35:10.883636+0000 mon.a (mon.0) 3442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:11 smithi049 bash[23528]: audit 2024-09-20T23:35:10.889985+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:35:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:11 smithi049 bash[23528]: audit 2024-09-20T23:35:10.892338+0000 mgr.a (mgr.14388) 3486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:35:12.732 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:12.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:13.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:12 smithi179 bash[23186]: audit 2024-09-20T23:35:11.626829+0000 mgr.a (mgr.14388) 3487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:35:13.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:12 smithi179 bash[23186]: cephadm 2024-09-20T23:35:11.627970+0000 mgr.a (mgr.14388) 3488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:35:13.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:12 smithi179 bash[23186]: cluster 2024-09-20T23:35:11.744421+0000 mgr.a (mgr.14388) 3489 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:35:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:12 smithi044 bash[22676]: audit 2024-09-20T23:35:11.626829+0000 mgr.a (mgr.14388) 3487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:35:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:12 smithi044 bash[22676]: cephadm 2024-09-20T23:35:11.627970+0000 mgr.a (mgr.14388) 3488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:35:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:12 smithi044 bash[22676]: cluster 2024-09-20T23:35:11.744421+0000 mgr.a (mgr.14388) 3489 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:35:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:12 smithi049 bash[23528]: audit 2024-09-20T23:35:11.626829+0000 mgr.a (mgr.14388) 3487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:35:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:12 smithi049 bash[23528]: cephadm 2024-09-20T23:35:11.627970+0000 mgr.a (mgr.14388) 3488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:35:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:12 smithi049 bash[23528]: cluster 2024-09-20T23:35:11.744421+0000 mgr.a (mgr.14388) 3489 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:35:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:13 smithi049 bash[23528]: audit 2024-09-20T23:35:12.306895+0000 mgr.a (mgr.14388) 3490 : audit [DBG] from='client.86310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:13 smithi044 bash[22676]: audit 2024-09-20T23:35:12.306895+0000 mgr.a (mgr.14388) 3490 : audit [DBG] from='client.86310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:13 smithi179 bash[23186]: audit 2024-09-20T23:35:12.306895+0000 mgr.a (mgr.14388) 3490 : audit [DBG] from='client.86310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:15.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:14 smithi044 bash[22676]: cluster 2024-09-20T23:35:13.745532+0000 mgr.a (mgr.14388) 3491 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:14 smithi179 bash[23186]: cluster 2024-09-20T23:35:13.745532+0000 mgr.a (mgr.14388) 3491 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:14 smithi049 bash[23528]: cluster 2024-09-20T23:35:13.745532+0000 mgr.a (mgr.14388) 3491 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:16 smithi044 bash[22676]: cluster 2024-09-20T23:35:15.746810+0000 mgr.a (mgr.14388) 3492 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:16 smithi179 bash[23186]: cluster 2024-09-20T23:35:15.746810+0000 mgr.a (mgr.14388) 3492 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:16 smithi049 bash[23528]: cluster 2024-09-20T23:35:15.746810+0000 mgr.a (mgr.14388) 3492 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:17.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:17.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:17.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:18.492 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:18 smithi044 bash[22676]: cluster 2024-09-20T23:35:17.747342+0000 mgr.a (mgr.14388) 3493 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:18 smithi179 bash[23186]: cluster 2024-09-20T23:35:17.747342+0000 mgr.a (mgr.14388) 3493 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:18 smithi049 bash[23528]: cluster 2024-09-20T23:35:17.747342+0000 mgr.a (mgr.14388) 3493 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:19 smithi044 bash[22676]: audit 2024-09-20T23:35:18.059131+0000 mgr.a (mgr.14388) 3494 : audit [DBG] from='client.86382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:19 smithi179 bash[23186]: audit 2024-09-20T23:35:18.059131+0000 mgr.a (mgr.14388) 3494 : audit [DBG] from='client.86382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:19 smithi049 bash[23528]: audit 2024-09-20T23:35:18.059131+0000 mgr.a (mgr.14388) 3494 : audit [DBG] from='client.86382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:20 smithi044 bash[22676]: cluster 2024-09-20T23:35:19.748217+0000 mgr.a (mgr.14388) 3495 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:20 smithi179 bash[23186]: cluster 2024-09-20T23:35:19.748217+0000 mgr.a (mgr.14388) 3495 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:20 smithi049 bash[23528]: cluster 2024-09-20T23:35:19.748217+0000 mgr.a (mgr.14388) 3495 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:21 smithi044 bash[22676]: cluster 2024-09-20T23:35:21.750445+0000 mgr.a (mgr.14388) 3496 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:22.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:21 smithi179 bash[23186]: cluster 2024-09-20T23:35:21.750445+0000 mgr.a (mgr.14388) 3496 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:21 smithi049 bash[23528]: cluster 2024-09-20T23:35:21.750445+0000 mgr.a (mgr.14388) 3496 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:23.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:23.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:24.251 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:24.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:24.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:24.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:24.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:25.221 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:24 smithi179 bash[23186]: cluster 2024-09-20T23:35:23.751179+0000 mgr.a (mgr.14388) 3497 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:25.221 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:24 smithi179 bash[23186]: audit 2024-09-20T23:35:23.824358+0000 mgr.a (mgr.14388) 3498 : audit [DBG] from='client.86460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:25.221 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:24 smithi179 bash[23186]: audit 2024-09-20T23:35:24.224613+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.221 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:24 smithi179 bash[23186]: audit 2024-09-20T23:35:24.230647+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.221 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:24 smithi179 bash[23186]: audit 2024-09-20T23:35:24.238190+0000 mon.a (mon.0) 3446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:24 smithi044 bash[22676]: cluster 2024-09-20T23:35:23.751179+0000 mgr.a (mgr.14388) 3497 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:24 smithi044 bash[22676]: audit 2024-09-20T23:35:23.824358+0000 mgr.a (mgr.14388) 3498 : audit [DBG] from='client.86460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:24 smithi044 bash[22676]: audit 2024-09-20T23:35:24.224613+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:24 smithi044 bash[22676]: audit 2024-09-20T23:35:24.230647+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:24 smithi044 bash[22676]: audit 2024-09-20T23:35:24.238190+0000 mon.a (mon.0) 3446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:24 smithi049 bash[23528]: cluster 2024-09-20T23:35:23.751179+0000 mgr.a (mgr.14388) 3497 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:24 smithi049 bash[23528]: audit 2024-09-20T23:35:23.824358+0000 mgr.a (mgr.14388) 3498 : audit [DBG] from='client.86460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:24 smithi049 bash[23528]: audit 2024-09-20T23:35:24.224613+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:24 smithi049 bash[23528]: audit 2024-09-20T23:35:24.230647+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:24 smithi049 bash[23528]: audit 2024-09-20T23:35:24.238190+0000 mon.a (mon.0) 3446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:26 smithi044 bash[22676]: audit 2024-09-20T23:35:25.198580+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:26 smithi044 bash[22676]: audit 2024-09-20T23:35:25.208370+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:26 smithi044 bash[22676]: audit 2024-09-20T23:35:25.218815+0000 mon.a (mon.0) 3449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:26 smithi044 bash[22676]: cluster 2024-09-20T23:35:25.753471+0000 mgr.a (mgr.14388) 3499 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:26 smithi179 bash[23186]: audit 2024-09-20T23:35:25.198580+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:26 smithi179 bash[23186]: audit 2024-09-20T23:35:25.208370+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:26 smithi179 bash[23186]: audit 2024-09-20T23:35:25.218815+0000 mon.a (mon.0) 3449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:26 smithi179 bash[23186]: cluster 2024-09-20T23:35:25.753471+0000 mgr.a (mgr.14388) 3499 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:26 smithi049 bash[23528]: audit 2024-09-20T23:35:25.198580+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:26 smithi049 bash[23528]: audit 2024-09-20T23:35:25.208370+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:26 smithi049 bash[23528]: audit 2024-09-20T23:35:25.218815+0000 mon.a (mon.0) 3449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:26 smithi049 bash[23528]: cluster 2024-09-20T23:35:25.753471+0000 mgr.a (mgr.14388) 3499 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:35:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:27 smithi044 bash[22676]: audit 2024-09-20T23:35:26.856085+0000 mon.a (mon.0) 3450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:27 smithi044 bash[22676]: audit 2024-09-20T23:35:26.865369+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:27 smithi044 bash[22676]: audit 2024-09-20T23:35:26.874147+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:27 smithi179 bash[23186]: audit 2024-09-20T23:35:26.856085+0000 mon.a (mon.0) 3450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:27 smithi179 bash[23186]: audit 2024-09-20T23:35:26.865369+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:27 smithi179 bash[23186]: audit 2024-09-20T23:35:26.874147+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:27 smithi049 bash[23528]: audit 2024-09-20T23:35:26.856085+0000 mon.a (mon.0) 3450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:27 smithi049 bash[23528]: audit 2024-09-20T23:35:26.865369+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:27 smithi049 bash[23528]: audit 2024-09-20T23:35:26.874147+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:28 smithi044 bash[22676]: cluster 2024-09-20T23:35:27.754231+0000 mgr.a (mgr.14388) 3500 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:29.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:29.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:29.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:28 smithi179 bash[23186]: cluster 2024-09-20T23:35:27.754231+0000 mgr.a (mgr.14388) 3500 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:28 smithi049 bash[23528]: cluster 2024-09-20T23:35:27.754231+0000 mgr.a (mgr.14388) 3500 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:30.037 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:30.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:30.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:30.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:30.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:30 smithi044 bash[22676]: audit 2024-09-20T23:35:29.596091+0000 mgr.a (mgr.14388) 3501 : audit [DBG] from='client.86535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:30 smithi044 bash[22676]: cluster 2024-09-20T23:35:29.754843+0000 mgr.a (mgr.14388) 3502 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:30 smithi179 bash[23186]: audit 2024-09-20T23:35:29.596091+0000 mgr.a (mgr.14388) 3501 : audit [DBG] from='client.86535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:30 smithi179 bash[23186]: cluster 2024-09-20T23:35:29.754843+0000 mgr.a (mgr.14388) 3502 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:30 smithi049 bash[23528]: audit 2024-09-20T23:35:29.596091+0000 mgr.a (mgr.14388) 3501 : audit [DBG] from='client.86535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:30 smithi049 bash[23528]: cluster 2024-09-20T23:35:29.754843+0000 mgr.a (mgr.14388) 3502 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:33.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:32 smithi179 bash[23186]: cluster 2024-09-20T23:35:31.757184+0000 mgr.a (mgr.14388) 3503 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:35:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:32 smithi044 bash[22676]: cluster 2024-09-20T23:35:31.757184+0000 mgr.a (mgr.14388) 3503 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:35:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:32 smithi049 bash[23528]: cluster 2024-09-20T23:35:31.757184+0000 mgr.a (mgr.14388) 3503 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:35:35.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:35.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:35.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:34 smithi044 bash[22676]: cluster 2024-09-20T23:35:33.757938+0000 mgr.a (mgr.14388) 3504 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:35:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:34 smithi179 bash[23186]: cluster 2024-09-20T23:35:33.757938+0000 mgr.a (mgr.14388) 3504 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:35:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:34 smithi049 bash[23528]: cluster 2024-09-20T23:35:33.757938+0000 mgr.a (mgr.14388) 3504 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:35:35.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:35.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:35.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:35.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:35.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:36 smithi044 bash[22676]: audit 2024-09-20T23:35:35.375263+0000 mgr.a (mgr.14388) 3505 : audit [DBG] from='client.86613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:36 smithi044 bash[22676]: cluster 2024-09-20T23:35:35.759121+0000 mgr.a (mgr.14388) 3506 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:36 smithi179 bash[23186]: audit 2024-09-20T23:35:35.375263+0000 mgr.a (mgr.14388) 3505 : audit [DBG] from='client.86613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:36 smithi179 bash[23186]: cluster 2024-09-20T23:35:35.759121+0000 mgr.a (mgr.14388) 3506 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:36 smithi049 bash[23528]: audit 2024-09-20T23:35:35.375263+0000 mgr.a (mgr.14388) 3505 : audit [DBG] from='client.86613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:36 smithi049 bash[23528]: cluster 2024-09-20T23:35:35.759121+0000 mgr.a (mgr.14388) 3506 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:38 smithi044 bash[22676]: cluster 2024-09-20T23:35:37.759849+0000 mgr.a (mgr.14388) 3507 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:38 smithi179 bash[23186]: cluster 2024-09-20T23:35:37.759849+0000 mgr.a (mgr.14388) 3507 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:38 smithi049 bash[23528]: cluster 2024-09-20T23:35:37.759849+0000 mgr.a (mgr.14388) 3507 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:40 smithi044 bash[22676]: cluster 2024-09-20T23:35:39.760625+0000 mgr.a (mgr.14388) 3508 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:40 smithi179 bash[23186]: cluster 2024-09-20T23:35:39.760625+0000 mgr.a (mgr.14388) 3508 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:40 smithi049 bash[23528]: cluster 2024-09-20T23:35:39.760625+0000 mgr.a (mgr.14388) 3508 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:35:41.550 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:41.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:41.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:41.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:41.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:43.213 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:42 smithi049 bash[23528]: audit 2024-09-20T23:35:41.116099+0000 mgr.a (mgr.14388) 3509 : audit [DBG] from='client.86688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:43.213 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:42 smithi049 bash[23528]: cluster 2024-09-20T23:35:41.763370+0000 mgr.a (mgr.14388) 3510 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:42 smithi044 bash[22676]: audit 2024-09-20T23:35:41.116099+0000 mgr.a (mgr.14388) 3509 : audit [DBG] from='client.86688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:42 smithi044 bash[22676]: cluster 2024-09-20T23:35:41.763370+0000 mgr.a (mgr.14388) 3510 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:42 smithi179 bash[23186]: audit 2024-09-20T23:35:41.116099+0000 mgr.a (mgr.14388) 3509 : audit [DBG] from='client.86688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:42 smithi179 bash[23186]: cluster 2024-09-20T23:35:41.763370+0000 mgr.a (mgr.14388) 3510 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:44 smithi044 bash[22676]: cluster 2024-09-20T23:35:43.764142+0000 mgr.a (mgr.14388) 3511 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:35:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:44 smithi044 bash[22676]: audit 2024-09-20T23:35:44.450367+0000 mon.a (mon.0) 3453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:44 smithi044 bash[22676]: audit 2024-09-20T23:35:44.459544+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:44 smithi044 bash[22676]: audit 2024-09-20T23:35:44.470328+0000 mon.a (mon.0) 3455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:44 smithi179 bash[23186]: cluster 2024-09-20T23:35:43.764142+0000 mgr.a (mgr.14388) 3511 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:35:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:44 smithi179 bash[23186]: audit 2024-09-20T23:35:44.450367+0000 mon.a (mon.0) 3453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:44 smithi179 bash[23186]: audit 2024-09-20T23:35:44.459544+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:44 smithi179 bash[23186]: audit 2024-09-20T23:35:44.470328+0000 mon.a (mon.0) 3455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:44 smithi049 bash[23528]: cluster 2024-09-20T23:35:43.764142+0000 mgr.a (mgr.14388) 3511 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:35:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:44 smithi049 bash[23528]: audit 2024-09-20T23:35:44.450367+0000 mon.a (mon.0) 3453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:44 smithi049 bash[23528]: audit 2024-09-20T23:35:44.459544+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:44 smithi049 bash[23528]: audit 2024-09-20T23:35:44.470328+0000 mon.a (mon.0) 3455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:46.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:46.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:46 smithi044 bash[22676]: audit 2024-09-20T23:35:45.422902+0000 mon.a (mon.0) 3456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:46 smithi044 bash[22676]: audit 2024-09-20T23:35:45.432605+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:46 smithi044 bash[22676]: audit 2024-09-20T23:35:45.444124+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:46 smithi044 bash[22676]: cluster 2024-09-20T23:35:45.766148+0000 mgr.a (mgr.14388) 3512 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:35:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:46 smithi179 bash[23186]: audit 2024-09-20T23:35:45.422902+0000 mon.a (mon.0) 3456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:46 smithi179 bash[23186]: audit 2024-09-20T23:35:45.432605+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:46 smithi179 bash[23186]: audit 2024-09-20T23:35:45.444124+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:46 smithi179 bash[23186]: cluster 2024-09-20T23:35:45.766148+0000 mgr.a (mgr.14388) 3512 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:35:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:46 smithi049 bash[23528]: audit 2024-09-20T23:35:45.422902+0000 mon.a (mon.0) 3456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:46 smithi049 bash[23528]: audit 2024-09-20T23:35:45.432605+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:46 smithi049 bash[23528]: audit 2024-09-20T23:35:45.444124+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:46 smithi049 bash[23528]: cluster 2024-09-20T23:35:45.766148+0000 mgr.a (mgr.14388) 3512 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:35:47.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:47.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:47.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:47.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:47.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:47 smithi044 bash[22676]: audit 2024-09-20T23:35:46.883191+0000 mgr.a (mgr.14388) 3513 : audit [DBG] from='client.86766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:47 smithi044 bash[22676]: audit 2024-09-20T23:35:47.042777+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:47 smithi044 bash[22676]: audit 2024-09-20T23:35:47.048757+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:47 smithi044 bash[22676]: audit 2024-09-20T23:35:47.055559+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:47 smithi179 bash[23186]: audit 2024-09-20T23:35:46.883191+0000 mgr.a (mgr.14388) 3513 : audit [DBG] from='client.86766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:47 smithi179 bash[23186]: audit 2024-09-20T23:35:47.042777+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:47 smithi179 bash[23186]: audit 2024-09-20T23:35:47.048757+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:47 smithi179 bash[23186]: audit 2024-09-20T23:35:47.055559+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:47 smithi049 bash[23528]: audit 2024-09-20T23:35:46.883191+0000 mgr.a (mgr.14388) 3513 : audit [DBG] from='client.86766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:47 smithi049 bash[23528]: audit 2024-09-20T23:35:47.042777+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:47 smithi049 bash[23528]: audit 2024-09-20T23:35:47.048757+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:47 smithi049 bash[23528]: audit 2024-09-20T23:35:47.055559+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:35:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:48 smithi044 bash[22676]: cluster 2024-09-20T23:35:47.767026+0000 mgr.a (mgr.14388) 3514 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:48 smithi179 bash[23186]: cluster 2024-09-20T23:35:47.767026+0000 mgr.a (mgr.14388) 3514 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:48 smithi049 bash[23528]: cluster 2024-09-20T23:35:47.767026+0000 mgr.a (mgr.14388) 3514 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:50 smithi179 bash[23186]: cluster 2024-09-20T23:35:49.767848+0000 mgr.a (mgr.14388) 3515 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:50 smithi044 bash[22676]: cluster 2024-09-20T23:35:49.767848+0000 mgr.a (mgr.14388) 3515 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:50 smithi049 bash[23528]: cluster 2024-09-20T23:35:49.767848+0000 mgr.a (mgr.14388) 3515 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:35:52.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:52.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:53.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:53.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:53.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:53.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:53.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:52 smithi044 bash[22676]: cluster 2024-09-20T23:35:51.770103+0000 mgr.a (mgr.14388) 3516 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:35:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:52 smithi179 bash[23186]: cluster 2024-09-20T23:35:51.770103+0000 mgr.a (mgr.14388) 3516 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:35:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:52 smithi049 bash[23528]: cluster 2024-09-20T23:35:51.770103+0000 mgr.a (mgr.14388) 3516 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:35:54.166 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:53 smithi179 bash[23186]: audit 2024-09-20T23:35:52.645384+0000 mgr.a (mgr.14388) 3517 : audit [DBG] from='client.86844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:53 smithi044 bash[22676]: audit 2024-09-20T23:35:52.645384+0000 mgr.a (mgr.14388) 3517 : audit [DBG] from='client.86844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:53 smithi049 bash[23528]: audit 2024-09-20T23:35:52.645384+0000 mgr.a (mgr.14388) 3517 : audit [DBG] from='client.86844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:35:55.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:54 smithi179 bash[23186]: cluster 2024-09-20T23:35:53.771055+0000 mgr.a (mgr.14388) 3518 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:35:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:54 smithi044 bash[22676]: cluster 2024-09-20T23:35:53.771055+0000 mgr.a (mgr.14388) 3518 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:35:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:54 smithi049 bash[23528]: cluster 2024-09-20T23:35:53.771055+0000 mgr.a (mgr.14388) 3518 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:35:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:56 smithi044 bash[22676]: cluster 2024-09-20T23:35:55.773189+0000 mgr.a (mgr.14388) 3519 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:35:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:56 smithi179 bash[23186]: cluster 2024-09-20T23:35:55.773189+0000 mgr.a (mgr.14388) 3519 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:35:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:56 smithi049 bash[23528]: cluster 2024-09-20T23:35:55.773189+0000 mgr.a (mgr.14388) 3519 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:35:58.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:35:58.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:35:58.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:35:58.922 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:35:58.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:35:58.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:35:58.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:35:58.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:35:59.134 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:58 smithi044 bash[22676]: cluster 2024-09-20T23:35:57.773718+0000 mgr.a (mgr.14388) 3520 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:35:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:58 smithi179 bash[23186]: cluster 2024-09-20T23:35:57.773718+0000 mgr.a (mgr.14388) 3520 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:35:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:58 smithi049 bash[23528]: cluster 2024-09-20T23:35:57.773718+0000 mgr.a (mgr.14388) 3520 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:36:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:35:59 smithi044 bash[22676]: audit 2024-09-20T23:35:58.477420+0000 mgr.a (mgr.14388) 3521 : audit [DBG] from='client.86922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:35:59 smithi179 bash[23186]: audit 2024-09-20T23:35:58.477420+0000 mgr.a (mgr.14388) 3521 : audit [DBG] from='client.86922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:35:59 smithi049 bash[23528]: audit 2024-09-20T23:35:58.477420+0000 mgr.a (mgr.14388) 3521 : audit [DBG] from='client.86922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:00 smithi044 bash[22676]: cluster 2024-09-20T23:35:59.774591+0000 mgr.a (mgr.14388) 3522 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:36:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:00 smithi179 bash[23186]: cluster 2024-09-20T23:35:59.774591+0000 mgr.a (mgr.14388) 3522 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:36:01.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:00 smithi049 bash[23528]: cluster 2024-09-20T23:35:59.774591+0000 mgr.a (mgr.14388) 3522 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:36:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:02 smithi044 bash[22676]: cluster 2024-09-20T23:36:01.776834+0000 mgr.a (mgr.14388) 3523 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:36:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:02 smithi179 bash[23186]: cluster 2024-09-20T23:36:01.776834+0000 mgr.a (mgr.14388) 3523 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:36:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:02 smithi049 bash[23528]: cluster 2024-09-20T23:36:01.776834+0000 mgr.a (mgr.14388) 3523 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-20T23:36:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:03.924 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:04.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:04.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:04.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:04.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:04.675 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:04 smithi044 bash[22676]: cluster 2024-09-20T23:36:03.777612+0000 mgr.a (mgr.14388) 3524 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-20T23:36:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:04 smithi044 bash[22676]: audit 2024-09-20T23:36:04.607019+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:04 smithi044 bash[22676]: audit 2024-09-20T23:36:04.612352+0000 mon.a (mon.0) 3463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:04 smithi044 bash[22676]: audit 2024-09-20T23:36:04.617832+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:04 smithi179 bash[23186]: cluster 2024-09-20T23:36:03.777612+0000 mgr.a (mgr.14388) 3524 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-20T23:36:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:04 smithi179 bash[23186]: audit 2024-09-20T23:36:04.607019+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:04 smithi179 bash[23186]: audit 2024-09-20T23:36:04.612352+0000 mon.a (mon.0) 3463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:04 smithi179 bash[23186]: audit 2024-09-20T23:36:04.617832+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:04 smithi049 bash[23528]: cluster 2024-09-20T23:36:03.777612+0000 mgr.a (mgr.14388) 3524 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-20T23:36:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:04 smithi049 bash[23528]: audit 2024-09-20T23:36:04.607019+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:04 smithi049 bash[23528]: audit 2024-09-20T23:36:04.612352+0000 mon.a (mon.0) 3463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:04 smithi049 bash[23528]: audit 2024-09-20T23:36:04.617832+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:05 smithi179 bash[23186]: audit 2024-09-20T23:36:04.256568+0000 mgr.a (mgr.14388) 3525 : audit [DBG] from='client.86997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:05 smithi179 bash[23186]: audit 2024-09-20T23:36:05.654693+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:05 smithi179 bash[23186]: audit 2024-09-20T23:36:05.663510+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:05 smithi179 bash[23186]: audit 2024-09-20T23:36:05.674040+0000 mon.a (mon.0) 3467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:05 smithi044 bash[22676]: audit 2024-09-20T23:36:04.256568+0000 mgr.a (mgr.14388) 3525 : audit [DBG] from='client.86997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:05 smithi044 bash[22676]: audit 2024-09-20T23:36:05.654693+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:05 smithi044 bash[22676]: audit 2024-09-20T23:36:05.663510+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:05 smithi044 bash[22676]: audit 2024-09-20T23:36:05.674040+0000 mon.a (mon.0) 3467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:05 smithi049 bash[23528]: audit 2024-09-20T23:36:04.256568+0000 mgr.a (mgr.14388) 3525 : audit [DBG] from='client.86997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:05 smithi049 bash[23528]: audit 2024-09-20T23:36:05.654693+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:05 smithi049 bash[23528]: audit 2024-09-20T23:36:05.663510+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:05 smithi049 bash[23528]: audit 2024-09-20T23:36:05.674040+0000 mon.a (mon.0) 3467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:06 smithi049 bash[23528]: cluster 2024-09-20T23:36:05.779847+0000 mgr.a (mgr.14388) 3526 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-20T23:36:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:06 smithi044 bash[22676]: cluster 2024-09-20T23:36:05.779847+0000 mgr.a (mgr.14388) 3526 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-20T23:36:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:06 smithi179 bash[23186]: cluster 2024-09-20T23:36:05.779847+0000 mgr.a (mgr.14388) 3526 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-20T23:36:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:08 smithi179 bash[23186]: audit 2024-09-20T23:36:07.242408+0000 mon.a (mon.0) 3468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:08 smithi179 bash[23186]: audit 2024-09-20T23:36:07.247924+0000 mon.a (mon.0) 3469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:08 smithi179 bash[23186]: audit 2024-09-20T23:36:07.253833+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:08 smithi179 bash[23186]: cluster 2024-09-20T23:36:07.780599+0000 mgr.a (mgr.14388) 3527 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:08 smithi049 bash[23528]: audit 2024-09-20T23:36:07.242408+0000 mon.a (mon.0) 3468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:08 smithi049 bash[23528]: audit 2024-09-20T23:36:07.247924+0000 mon.a (mon.0) 3469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:08 smithi049 bash[23528]: audit 2024-09-20T23:36:07.253833+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:08 smithi049 bash[23528]: cluster 2024-09-20T23:36:07.780599+0000 mgr.a (mgr.14388) 3527 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:08 smithi044 bash[22676]: audit 2024-09-20T23:36:07.242408+0000 mon.a (mon.0) 3468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:08 smithi044 bash[22676]: audit 2024-09-20T23:36:07.247924+0000 mon.a (mon.0) 3469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:08 smithi044 bash[22676]: audit 2024-09-20T23:36:07.253833+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:08 smithi044 bash[22676]: cluster 2024-09-20T23:36:07.780599+0000 mgr.a (mgr.14388) 3527 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:09.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:09.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:09.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:10.454 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:10 smithi179 bash[23186]: cluster 2024-09-20T23:36:09.781027+0000 mgr.a (mgr.14388) 3528 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:10 smithi044 bash[22676]: cluster 2024-09-20T23:36:09.781027+0000 mgr.a (mgr.14388) 3528 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:10 smithi049 bash[23528]: cluster 2024-09-20T23:36:09.781027+0000 mgr.a (mgr.14388) 3528 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:11 smithi179 bash[23186]: audit 2024-09-20T23:36:10.013822+0000 mgr.a (mgr.14388) 3529 : audit [DBG] from='client.87075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:11 smithi179 bash[23186]: audit 2024-09-20T23:36:11.678791+0000 mon.a (mon.0) 3471 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:36:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:11 smithi179 bash[23186]: audit 2024-09-20T23:36:11.686032+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:36:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:11 smithi179 bash[23186]: audit 2024-09-20T23:36:11.688146+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:36:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:11 smithi179 bash[23186]: audit 2024-09-20T23:36:11.699822+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:11 smithi179 bash[23186]: audit 2024-09-20T23:36:11.706928+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:36:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:11 smithi044 bash[22676]: audit 2024-09-20T23:36:10.013822+0000 mgr.a (mgr.14388) 3529 : audit [DBG] from='client.87075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:11 smithi044 bash[22676]: audit 2024-09-20T23:36:11.678791+0000 mon.a (mon.0) 3471 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:36:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:11 smithi044 bash[22676]: audit 2024-09-20T23:36:11.686032+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:36:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:11 smithi044 bash[22676]: audit 2024-09-20T23:36:11.688146+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:36:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:11 smithi044 bash[22676]: audit 2024-09-20T23:36:11.699822+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:11 smithi044 bash[22676]: audit 2024-09-20T23:36:11.706928+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:36:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:11 smithi049 bash[23528]: audit 2024-09-20T23:36:10.013822+0000 mgr.a (mgr.14388) 3529 : audit [DBG] from='client.87075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:11 smithi049 bash[23528]: audit 2024-09-20T23:36:11.678791+0000 mon.a (mon.0) 3471 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:36:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:11 smithi049 bash[23528]: audit 2024-09-20T23:36:11.686032+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:36:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:11 smithi049 bash[23528]: audit 2024-09-20T23:36:11.688146+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:36:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:11 smithi049 bash[23528]: audit 2024-09-20T23:36:11.699822+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:11 smithi049 bash[23528]: audit 2024-09-20T23:36:11.706928+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:36:12.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:36:12 smithi044 bash[22930]: debug 2024-09-20T23:36:12.452+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:36:12.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:36:12 smithi044 bash[22930]: debug 2024-09-20T23:36:12.456+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:36:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:12 smithi044 bash[22676]: audit 2024-09-20T23:36:11.709772+0000 mgr.a (mgr.14388) 3530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:36:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:12 smithi044 bash[22676]: cluster 2024-09-20T23:36:11.782372+0000 mgr.a (mgr.14388) 3531 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:12 smithi179 bash[23186]: audit 2024-09-20T23:36:11.709772+0000 mgr.a (mgr.14388) 3530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:36:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:12 smithi179 bash[23186]: cluster 2024-09-20T23:36:11.782372+0000 mgr.a (mgr.14388) 3531 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:12 smithi049 bash[23528]: audit 2024-09-20T23:36:11.709772+0000 mgr.a (mgr.14388) 3530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:36:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:12 smithi049 bash[23528]: cluster 2024-09-20T23:36:11.782372+0000 mgr.a (mgr.14388) 3531 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:14.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:13 smithi179 bash[23186]: audit 2024-09-20T23:36:12.456228+0000 mgr.a (mgr.14388) 3532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:36:14.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:13 smithi179 bash[23186]: cephadm 2024-09-20T23:36:12.457494+0000 mgr.a (mgr.14388) 3533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:36:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:13 smithi044 bash[22676]: audit 2024-09-20T23:36:12.456228+0000 mgr.a (mgr.14388) 3532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:36:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:13 smithi044 bash[22676]: cephadm 2024-09-20T23:36:12.457494+0000 mgr.a (mgr.14388) 3533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:36:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:13 smithi049 bash[23528]: audit 2024-09-20T23:36:12.456228+0000 mgr.a (mgr.14388) 3532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:36:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:13 smithi049 bash[23528]: cephadm 2024-09-20T23:36:12.457494+0000 mgr.a (mgr.14388) 3533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:36:15.145 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:14 smithi179 bash[23186]: cluster 2024-09-20T23:36:13.783324+0000 mgr.a (mgr.14388) 3534 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:36:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:14 smithi044 bash[22676]: cluster 2024-09-20T23:36:13.783324+0000 mgr.a (mgr.14388) 3534 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:36:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:14 smithi049 bash[23528]: cluster 2024-09-20T23:36:13.783324+0000 mgr.a (mgr.14388) 3534 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:36:15.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:15.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:15.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:16.248 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:16.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:16.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:16.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:16.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:16 smithi044 bash[22676]: cluster 2024-09-20T23:36:15.785478+0000 mgr.a (mgr.14388) 3535 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:16 smithi044 bash[22676]: audit 2024-09-20T23:36:15.797861+0000 mgr.a (mgr.14388) 3536 : audit [DBG] from='client.87258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:16 smithi179 bash[23186]: cluster 2024-09-20T23:36:15.785478+0000 mgr.a (mgr.14388) 3535 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:16 smithi179 bash[23186]: audit 2024-09-20T23:36:15.797861+0000 mgr.a (mgr.14388) 3536 : audit [DBG] from='client.87258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:16 smithi049 bash[23528]: cluster 2024-09-20T23:36:15.785478+0000 mgr.a (mgr.14388) 3535 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:16 smithi049 bash[23528]: audit 2024-09-20T23:36:15.797861+0000 mgr.a (mgr.14388) 3536 : audit [DBG] from='client.87258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:19.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:18 smithi044 bash[22676]: cluster 2024-09-20T23:36:17.786607+0000 mgr.a (mgr.14388) 3537 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:36:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:18 smithi179 bash[23186]: cluster 2024-09-20T23:36:17.786607+0000 mgr.a (mgr.14388) 3537 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:36:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:18 smithi049 bash[23528]: cluster 2024-09-20T23:36:17.786607+0000 mgr.a (mgr.14388) 3537 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:36:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:20 smithi044 bash[22676]: cluster 2024-09-20T23:36:19.787259+0000 mgr.a (mgr.14388) 3538 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:36:21.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:20 smithi179 bash[23186]: cluster 2024-09-20T23:36:19.787259+0000 mgr.a (mgr.14388) 3538 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:36:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:20 smithi049 bash[23528]: cluster 2024-09-20T23:36:19.787259+0000 mgr.a (mgr.14388) 3538 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:36:22.052 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:22.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:22.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:22.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:22.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:22 smithi044 bash[22676]: audit 2024-09-20T23:36:21.586638+0000 mgr.a (mgr.14388) 3539 : audit [DBG] from='client.87333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:22 smithi044 bash[22676]: cluster 2024-09-20T23:36:21.788674+0000 mgr.a (mgr.14388) 3540 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:22 smithi179 bash[23186]: audit 2024-09-20T23:36:21.586638+0000 mgr.a (mgr.14388) 3539 : audit [DBG] from='client.87333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:22 smithi179 bash[23186]: cluster 2024-09-20T23:36:21.788674+0000 mgr.a (mgr.14388) 3540 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:22 smithi049 bash[23528]: audit 2024-09-20T23:36:21.586638+0000 mgr.a (mgr.14388) 3539 : audit [DBG] from='client.87333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:22 smithi049 bash[23528]: cluster 2024-09-20T23:36:21.788674+0000 mgr.a (mgr.14388) 3540 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:24 smithi049 bash[23528]: cluster 2024-09-20T23:36:23.789637+0000 mgr.a (mgr.14388) 3541 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:24 smithi049 bash[23528]: audit 2024-09-20T23:36:24.776073+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:24 smithi049 bash[23528]: audit 2024-09-20T23:36:24.784713+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:24 smithi049 bash[23528]: audit 2024-09-20T23:36:24.795155+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:24 smithi044 bash[22676]: cluster 2024-09-20T23:36:23.789637+0000 mgr.a (mgr.14388) 3541 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:24 smithi044 bash[22676]: audit 2024-09-20T23:36:24.776073+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:24 smithi044 bash[22676]: audit 2024-09-20T23:36:24.784713+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:24 smithi044 bash[22676]: audit 2024-09-20T23:36:24.795155+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:24 smithi179 bash[23186]: cluster 2024-09-20T23:36:23.789637+0000 mgr.a (mgr.14388) 3541 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:25.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:24 smithi179 bash[23186]: audit 2024-09-20T23:36:24.776073+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:24 smithi179 bash[23186]: audit 2024-09-20T23:36:24.784713+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:25.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:24 smithi179 bash[23186]: audit 2024-09-20T23:36:24.795155+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:27.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:27.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:27.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:26 smithi049 bash[23528]: cluster 2024-09-20T23:36:25.791789+0000 mgr.a (mgr.14388) 3542 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:27.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:26 smithi049 bash[23528]: audit 2024-09-20T23:36:25.884540+0000 mon.a (mon.0) 3479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:26 smithi049 bash[23528]: audit 2024-09-20T23:36:25.892749+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:26 smithi049 bash[23528]: audit 2024-09-20T23:36:25.902713+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:26 smithi044 bash[22676]: cluster 2024-09-20T23:36:25.791789+0000 mgr.a (mgr.14388) 3542 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:26 smithi044 bash[22676]: audit 2024-09-20T23:36:25.884540+0000 mon.a (mon.0) 3479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:26 smithi044 bash[22676]: audit 2024-09-20T23:36:25.892749+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:26 smithi044 bash[22676]: audit 2024-09-20T23:36:25.902713+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:26 smithi179 bash[23186]: cluster 2024-09-20T23:36:25.791789+0000 mgr.a (mgr.14388) 3542 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:36:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:26 smithi179 bash[23186]: audit 2024-09-20T23:36:25.884540+0000 mon.a (mon.0) 3479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:26 smithi179 bash[23186]: audit 2024-09-20T23:36:25.892749+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:26 smithi179 bash[23186]: audit 2024-09-20T23:36:25.902713+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:27.828 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:27.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:27.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:27.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:27.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:28 smithi044 bash[22676]: audit 2024-09-20T23:36:27.393738+0000 mgr.a (mgr.14388) 3543 : audit [DBG] from='client.87408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:28 smithi044 bash[22676]: audit 2024-09-20T23:36:27.448540+0000 mon.a (mon.0) 3482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:28 smithi044 bash[22676]: audit 2024-09-20T23:36:27.455425+0000 mon.a (mon.0) 3483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:28 smithi044 bash[22676]: audit 2024-09-20T23:36:27.462095+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:28 smithi044 bash[22676]: cluster 2024-09-20T23:36:27.792319+0000 mgr.a (mgr.14388) 3544 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:28 smithi179 bash[23186]: audit 2024-09-20T23:36:27.393738+0000 mgr.a (mgr.14388) 3543 : audit [DBG] from='client.87408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:28 smithi179 bash[23186]: audit 2024-09-20T23:36:27.448540+0000 mon.a (mon.0) 3482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:28 smithi179 bash[23186]: audit 2024-09-20T23:36:27.455425+0000 mon.a (mon.0) 3483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:28 smithi179 bash[23186]: audit 2024-09-20T23:36:27.462095+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:28 smithi179 bash[23186]: cluster 2024-09-20T23:36:27.792319+0000 mgr.a (mgr.14388) 3544 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:28 smithi049 bash[23528]: audit 2024-09-20T23:36:27.393738+0000 mgr.a (mgr.14388) 3543 : audit [DBG] from='client.87408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:28 smithi049 bash[23528]: audit 2024-09-20T23:36:27.448540+0000 mon.a (mon.0) 3482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:28 smithi049 bash[23528]: audit 2024-09-20T23:36:27.455425+0000 mon.a (mon.0) 3483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:28 smithi049 bash[23528]: audit 2024-09-20T23:36:27.462095+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:28 smithi049 bash[23528]: cluster 2024-09-20T23:36:27.792319+0000 mgr.a (mgr.14388) 3544 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:30 smithi179 bash[23186]: cluster 2024-09-20T23:36:29.793069+0000 mgr.a (mgr.14388) 3545 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:30 smithi044 bash[22676]: cluster 2024-09-20T23:36:29.793069+0000 mgr.a (mgr.14388) 3545 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:30 smithi049 bash[23528]: cluster 2024-09-20T23:36:29.793069+0000 mgr.a (mgr.14388) 3545 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:32.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:32.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:32.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:32 smithi044 bash[22676]: cluster 2024-09-20T23:36:31.795275+0000 mgr.a (mgr.14388) 3546 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:33.243 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:32 smithi179 bash[23186]: cluster 2024-09-20T23:36:31.795275+0000 mgr.a (mgr.14388) 3546 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:32 smithi049 bash[23528]: cluster 2024-09-20T23:36:31.795275+0000 mgr.a (mgr.14388) 3546 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:33.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:33.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:33.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:33.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:34 smithi044 bash[22676]: audit 2024-09-20T23:36:33.163434+0000 mgr.a (mgr.14388) 3547 : audit [DBG] from='client.87486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:34 smithi044 bash[22676]: cluster 2024-09-20T23:36:33.796249+0000 mgr.a (mgr.14388) 3548 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:34 smithi179 bash[23186]: audit 2024-09-20T23:36:33.163434+0000 mgr.a (mgr.14388) 3547 : audit [DBG] from='client.87486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:34 smithi179 bash[23186]: cluster 2024-09-20T23:36:33.796249+0000 mgr.a (mgr.14388) 3548 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:34 smithi049 bash[23528]: audit 2024-09-20T23:36:33.163434+0000 mgr.a (mgr.14388) 3547 : audit [DBG] from='client.87486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:34 smithi049 bash[23528]: cluster 2024-09-20T23:36:33.796249+0000 mgr.a (mgr.14388) 3548 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:36 smithi044 bash[22676]: cluster 2024-09-20T23:36:35.798434+0000 mgr.a (mgr.14388) 3549 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:36 smithi179 bash[23186]: cluster 2024-09-20T23:36:35.798434+0000 mgr.a (mgr.14388) 3549 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:36 smithi049 bash[23528]: cluster 2024-09-20T23:36:35.798434+0000 mgr.a (mgr.14388) 3549 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:38.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:38.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:38.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:39.158 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:38 smithi044 bash[22676]: cluster 2024-09-20T23:36:37.799268+0000 mgr.a (mgr.14388) 3550 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:38 smithi179 bash[23186]: cluster 2024-09-20T23:36:37.799268+0000 mgr.a (mgr.14388) 3550 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:38 smithi049 bash[23528]: cluster 2024-09-20T23:36:37.799268+0000 mgr.a (mgr.14388) 3550 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:39.368 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:39.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:39.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:39.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:39.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:39 smithi044 bash[22676]: audit 2024-09-20T23:36:38.913868+0000 mgr.a (mgr.14388) 3551 : audit [DBG] from='client.87564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:39 smithi179 bash[23186]: audit 2024-09-20T23:36:38.913868+0000 mgr.a (mgr.14388) 3551 : audit [DBG] from='client.87564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:39 smithi049 bash[23528]: audit 2024-09-20T23:36:38.913868+0000 mgr.a (mgr.14388) 3551 : audit [DBG] from='client.87564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:40 smithi044 bash[22676]: cluster 2024-09-20T23:36:39.799823+0000 mgr.a (mgr.14388) 3552 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:40 smithi179 bash[23186]: cluster 2024-09-20T23:36:39.799823+0000 mgr.a (mgr.14388) 3552 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:40 smithi049 bash[23528]: cluster 2024-09-20T23:36:39.799823+0000 mgr.a (mgr.14388) 3552 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:42 smithi044 bash[22676]: cluster 2024-09-20T23:36:41.802050+0000 mgr.a (mgr.14388) 3553 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:42 smithi179 bash[23186]: cluster 2024-09-20T23:36:41.802050+0000 mgr.a (mgr.14388) 3553 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:42 smithi049 bash[23528]: cluster 2024-09-20T23:36:41.802050+0000 mgr.a (mgr.14388) 3553 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:36:44.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:44.370 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:45.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:44 smithi044 bash[22676]: cluster 2024-09-20T23:36:43.802832+0000 mgr.a (mgr.14388) 3554 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:44 smithi179 bash[23186]: cluster 2024-09-20T23:36:43.802832+0000 mgr.a (mgr.14388) 3554 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:44 smithi049 bash[23528]: cluster 2024-09-20T23:36:43.802832+0000 mgr.a (mgr.14388) 3554 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:45 smithi044 bash[22676]: audit 2024-09-20T23:36:44.708781+0000 mgr.a (mgr.14388) 3555 : audit [DBG] from='client.87642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:45 smithi044 bash[22676]: audit 2024-09-20T23:36:44.935855+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:45 smithi044 bash[22676]: audit 2024-09-20T23:36:44.950768+0000 mon.a (mon.0) 3486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:45 smithi044 bash[22676]: audit 2024-09-20T23:36:44.957852+0000 mon.a (mon.0) 3487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:45 smithi179 bash[23186]: audit 2024-09-20T23:36:44.708781+0000 mgr.a (mgr.14388) 3555 : audit [DBG] from='client.87642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:45 smithi179 bash[23186]: audit 2024-09-20T23:36:44.935855+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:45 smithi179 bash[23186]: audit 2024-09-20T23:36:44.950768+0000 mon.a (mon.0) 3486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:45 smithi179 bash[23186]: audit 2024-09-20T23:36:44.957852+0000 mon.a (mon.0) 3487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:45 smithi049 bash[23528]: audit 2024-09-20T23:36:44.708781+0000 mgr.a (mgr.14388) 3555 : audit [DBG] from='client.87642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:45 smithi049 bash[23528]: audit 2024-09-20T23:36:44.935855+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:45 smithi049 bash[23528]: audit 2024-09-20T23:36:44.950768+0000 mon.a (mon.0) 3486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:45 smithi049 bash[23528]: audit 2024-09-20T23:36:44.957852+0000 mon.a (mon.0) 3487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:46 smithi044 bash[22676]: cluster 2024-09-20T23:36:45.805742+0000 mgr.a (mgr.14388) 3556 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:36:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:46 smithi044 bash[22676]: audit 2024-09-20T23:36:46.118050+0000 mon.a (mon.0) 3488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:46 smithi044 bash[22676]: audit 2024-09-20T23:36:46.126794+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:46 smithi044 bash[22676]: audit 2024-09-20T23:36:46.137367+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:46 smithi179 bash[23186]: cluster 2024-09-20T23:36:45.805742+0000 mgr.a (mgr.14388) 3556 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:36:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:46 smithi179 bash[23186]: audit 2024-09-20T23:36:46.118050+0000 mon.a (mon.0) 3488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:46 smithi179 bash[23186]: audit 2024-09-20T23:36:46.126794+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:46 smithi179 bash[23186]: audit 2024-09-20T23:36:46.137367+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.266 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:46 smithi049 bash[23528]: cluster 2024-09-20T23:36:45.805742+0000 mgr.a (mgr.14388) 3556 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:36:47.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:46 smithi049 bash[23528]: audit 2024-09-20T23:36:46.118050+0000 mon.a (mon.0) 3488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:46 smithi049 bash[23528]: audit 2024-09-20T23:36:46.126794+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:47.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:46 smithi049 bash[23528]: audit 2024-09-20T23:36:46.137367+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:48 smithi044 bash[22676]: audit 2024-09-20T23:36:47.678773+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:48 smithi044 bash[22676]: audit 2024-09-20T23:36:47.687968+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:48 smithi044 bash[22676]: audit 2024-09-20T23:36:47.698123+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:48 smithi044 bash[22676]: cluster 2024-09-20T23:36:47.806538+0000 mgr.a (mgr.14388) 3557 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:36:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:48 smithi179 bash[23186]: audit 2024-09-20T23:36:47.678773+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:48 smithi179 bash[23186]: audit 2024-09-20T23:36:47.687968+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:48 smithi179 bash[23186]: audit 2024-09-20T23:36:47.698123+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:48 smithi179 bash[23186]: cluster 2024-09-20T23:36:47.806538+0000 mgr.a (mgr.14388) 3557 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:36:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:48 smithi049 bash[23528]: audit 2024-09-20T23:36:47.678773+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:48 smithi049 bash[23528]: audit 2024-09-20T23:36:47.687968+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:48 smithi049 bash[23528]: audit 2024-09-20T23:36:47.698123+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:36:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:48 smithi049 bash[23528]: cluster 2024-09-20T23:36:47.806538+0000 mgr.a (mgr.14388) 3557 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:36:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:50.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:50.929 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:50 smithi044 bash[22676]: cluster 2024-09-20T23:36:49.807289+0000 mgr.a (mgr.14388) 3558 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:36:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:50 smithi179 bash[23186]: cluster 2024-09-20T23:36:49.807289+0000 mgr.a (mgr.14388) 3558 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:36:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:50 smithi049 bash[23528]: cluster 2024-09-20T23:36:49.807289+0000 mgr.a (mgr.14388) 3558 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:36:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:51 smithi044 bash[22676]: audit 2024-09-20T23:36:50.477498+0000 mgr.a (mgr.14388) 3559 : audit [DBG] from='client.87720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:51 smithi179 bash[23186]: audit 2024-09-20T23:36:50.477498+0000 mgr.a (mgr.14388) 3559 : audit [DBG] from='client.87720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:51 smithi049 bash[23528]: audit 2024-09-20T23:36:50.477498+0000 mgr.a (mgr.14388) 3559 : audit [DBG] from='client.87720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:52 smithi044 bash[22676]: cluster 2024-09-20T23:36:51.810178+0000 mgr.a (mgr.14388) 3560 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:52 smithi179 bash[23186]: cluster 2024-09-20T23:36:51.810178+0000 mgr.a (mgr.14388) 3560 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:52 smithi049 bash[23528]: cluster 2024-09-20T23:36:51.810178+0000 mgr.a (mgr.14388) 3560 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:54 smithi044 bash[22676]: cluster 2024-09-20T23:36:53.810987+0000 mgr.a (mgr.14388) 3561 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:36:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:54 smithi179 bash[23186]: cluster 2024-09-20T23:36:53.810987+0000 mgr.a (mgr.14388) 3561 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:36:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:54 smithi049 bash[23528]: cluster 2024-09-20T23:36:53.810987+0000 mgr.a (mgr.14388) 3561 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:36:55.930 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:36:55.931 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:36:55.931 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:36:56.715 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:36:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:36:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:36:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:36:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:36:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:56 smithi049 bash[23528]: cluster 2024-09-20T23:36:55.812966+0000 mgr.a (mgr.14388) 3562 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:56 smithi044 bash[22676]: cluster 2024-09-20T23:36:55.812966+0000 mgr.a (mgr.14388) 3562 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:56 smithi179 bash[23186]: cluster 2024-09-20T23:36:55.812966+0000 mgr.a (mgr.14388) 3562 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:36:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:57 smithi044 bash[22676]: audit 2024-09-20T23:36:56.265502+0000 mgr.a (mgr.14388) 3563 : audit [DBG] from='client.87795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:57 smithi179 bash[23186]: audit 2024-09-20T23:36:56.265502+0000 mgr.a (mgr.14388) 3563 : audit [DBG] from='client.87795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:57 smithi049 bash[23528]: audit 2024-09-20T23:36:56.265502+0000 mgr.a (mgr.14388) 3563 : audit [DBG] from='client.87795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:36:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:36:58 smithi044 bash[22676]: cluster 2024-09-20T23:36:57.814209+0000 mgr.a (mgr.14388) 3564 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:36:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:36:58 smithi179 bash[23186]: cluster 2024-09-20T23:36:57.814209+0000 mgr.a (mgr.14388) 3564 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:36:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:36:58 smithi049 bash[23528]: cluster 2024-09-20T23:36:57.814209+0000 mgr.a (mgr.14388) 3564 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:37:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:00 smithi044 bash[22676]: cluster 2024-09-20T23:36:59.814766+0000 mgr.a (mgr.14388) 3565 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:37:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:00 smithi179 bash[23186]: cluster 2024-09-20T23:36:59.814766+0000 mgr.a (mgr.14388) 3565 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:37:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:00 smithi049 bash[23528]: cluster 2024-09-20T23:36:59.814766+0000 mgr.a (mgr.14388) 3565 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:37:01.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:01.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:01.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:02.520 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:02.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:02.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:02.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:02.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:02 smithi044 bash[22676]: cluster 2024-09-20T23:37:01.815798+0000 mgr.a (mgr.14388) 3566 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:37:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:02 smithi179 bash[23186]: cluster 2024-09-20T23:37:01.815798+0000 mgr.a (mgr.14388) 3566 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:37:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:02 smithi049 bash[23528]: cluster 2024-09-20T23:37:01.815798+0000 mgr.a (mgr.14388) 3566 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:37:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:03 smithi049 bash[23528]: audit 2024-09-20T23:37:02.073399+0000 mgr.a (mgr.14388) 3567 : audit [DBG] from='client.87870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:03 smithi044 bash[22676]: audit 2024-09-20T23:37:02.073399+0000 mgr.a (mgr.14388) 3567 : audit [DBG] from='client.87870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:03 smithi179 bash[23186]: audit 2024-09-20T23:37:02.073399+0000 mgr.a (mgr.14388) 3567 : audit [DBG] from='client.87870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:05.004 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:04 smithi049 bash[23528]: cluster 2024-09-20T23:37:03.816709+0000 mgr.a (mgr.14388) 3568 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:04 smithi044 bash[22676]: cluster 2024-09-20T23:37:03.816709+0000 mgr.a (mgr.14388) 3568 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:04 smithi179 bash[23186]: cluster 2024-09-20T23:37:03.816709+0000 mgr.a (mgr.14388) 3568 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:06 smithi044 bash[22676]: audit 2024-09-20T23:37:05.147479+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:06 smithi044 bash[22676]: audit 2024-09-20T23:37:05.155882+0000 mon.a (mon.0) 3495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:06 smithi044 bash[22676]: audit 2024-09-20T23:37:05.166202+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:06 smithi044 bash[22676]: cluster 2024-09-20T23:37:05.818950+0000 mgr.a (mgr.14388) 3569 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:06 smithi179 bash[23186]: audit 2024-09-20T23:37:05.147479+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:06 smithi179 bash[23186]: audit 2024-09-20T23:37:05.155882+0000 mon.a (mon.0) 3495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:06 smithi179 bash[23186]: audit 2024-09-20T23:37:05.166202+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:06 smithi179 bash[23186]: cluster 2024-09-20T23:37:05.818950+0000 mgr.a (mgr.14388) 3569 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:06.517 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:06 smithi049 bash[23528]: audit 2024-09-20T23:37:05.147479+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.517 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:06 smithi049 bash[23528]: audit 2024-09-20T23:37:05.155882+0000 mon.a (mon.0) 3495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.517 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:06 smithi049 bash[23528]: audit 2024-09-20T23:37:05.166202+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:06.517 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:06 smithi049 bash[23528]: cluster 2024-09-20T23:37:05.818950+0000 mgr.a (mgr.14388) 3569 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:07.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:07.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:07.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:07 smithi049 bash[23528]: audit 2024-09-20T23:37:06.326984+0000 mon.a (mon.0) 3497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:07 smithi049 bash[23528]: audit 2024-09-20T23:37:06.335523+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:07 smithi049 bash[23528]: audit 2024-09-20T23:37:06.345895+0000 mon.a (mon.0) 3499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:07 smithi044 bash[22676]: audit 2024-09-20T23:37:06.326984+0000 mon.a (mon.0) 3497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:07 smithi044 bash[22676]: audit 2024-09-20T23:37:06.335523+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:07 smithi044 bash[22676]: audit 2024-09-20T23:37:06.345895+0000 mon.a (mon.0) 3499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:07 smithi179 bash[23186]: audit 2024-09-20T23:37:06.326984+0000 mon.a (mon.0) 3497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:07 smithi179 bash[23186]: audit 2024-09-20T23:37:06.335523+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:07 smithi179 bash[23186]: audit 2024-09-20T23:37:06.345895+0000 mon.a (mon.0) 3499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:08.302 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:08.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:08.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:08.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:08.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:08 smithi044 bash[22676]: cluster 2024-09-20T23:37:07.819777+0000 mgr.a (mgr.14388) 3570 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:08 smithi044 bash[22676]: audit 2024-09-20T23:37:07.856640+0000 mgr.a (mgr.14388) 3571 : audit [DBG] from='client.87945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:08 smithi044 bash[22676]: audit 2024-09-20T23:37:07.889430+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:08 smithi044 bash[22676]: audit 2024-09-20T23:37:07.896128+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:08 smithi044 bash[22676]: audit 2024-09-20T23:37:07.903649+0000 mon.a (mon.0) 3502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:08 smithi179 bash[23186]: cluster 2024-09-20T23:37:07.819777+0000 mgr.a (mgr.14388) 3570 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:08 smithi179 bash[23186]: audit 2024-09-20T23:37:07.856640+0000 mgr.a (mgr.14388) 3571 : audit [DBG] from='client.87945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:08 smithi179 bash[23186]: audit 2024-09-20T23:37:07.889430+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:08 smithi179 bash[23186]: audit 2024-09-20T23:37:07.896128+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:08 smithi179 bash[23186]: audit 2024-09-20T23:37:07.903649+0000 mon.a (mon.0) 3502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:08 smithi049 bash[23528]: cluster 2024-09-20T23:37:07.819777+0000 mgr.a (mgr.14388) 3570 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:08 smithi049 bash[23528]: audit 2024-09-20T23:37:07.856640+0000 mgr.a (mgr.14388) 3571 : audit [DBG] from='client.87945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:08 smithi049 bash[23528]: audit 2024-09-20T23:37:07.889430+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:08 smithi049 bash[23528]: audit 2024-09-20T23:37:07.896128+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:08 smithi049 bash[23528]: audit 2024-09-20T23:37:07.903649+0000 mon.a (mon.0) 3502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:10 smithi044 bash[22676]: cluster 2024-09-20T23:37:09.820697+0000 mgr.a (mgr.14388) 3572 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:10 smithi179 bash[23186]: cluster 2024-09-20T23:37:09.820697+0000 mgr.a (mgr.14388) 3572 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:10 smithi049 bash[23528]: cluster 2024-09-20T23:37:09.820697+0000 mgr.a (mgr.14388) 3572 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:12 smithi044 bash[22676]: cluster 2024-09-20T23:37:11.823101+0000 mgr.a (mgr.14388) 3573 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:12 smithi044 bash[22676]: audit 2024-09-20T23:37:12.508616+0000 mon.a (mon.0) 3503 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:37:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:12 smithi044 bash[22676]: audit 2024-09-20T23:37:12.520058+0000 mon.a (mon.0) 3504 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:37:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:12 smithi044 bash[22676]: audit 2024-09-20T23:37:12.522229+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:37:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:12 smithi044 bash[22676]: audit 2024-09-20T23:37:12.535459+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:12 smithi044 bash[22676]: audit 2024-09-20T23:37:12.541852+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:37:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:12 smithi179 bash[23186]: cluster 2024-09-20T23:37:11.823101+0000 mgr.a (mgr.14388) 3573 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:12 smithi179 bash[23186]: audit 2024-09-20T23:37:12.508616+0000 mon.a (mon.0) 3503 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:37:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:12 smithi179 bash[23186]: audit 2024-09-20T23:37:12.520058+0000 mon.a (mon.0) 3504 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:37:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:12 smithi179 bash[23186]: audit 2024-09-20T23:37:12.522229+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:37:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:12 smithi179 bash[23186]: audit 2024-09-20T23:37:12.535459+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:12 smithi179 bash[23186]: audit 2024-09-20T23:37:12.541852+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:37:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:12 smithi049 bash[23528]: cluster 2024-09-20T23:37:11.823101+0000 mgr.a (mgr.14388) 3573 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:12 smithi049 bash[23528]: audit 2024-09-20T23:37:12.508616+0000 mon.a (mon.0) 3503 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:37:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:12 smithi049 bash[23528]: audit 2024-09-20T23:37:12.520058+0000 mon.a (mon.0) 3504 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:37:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:12 smithi049 bash[23528]: audit 2024-09-20T23:37:12.522229+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:37:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:12 smithi049 bash[23528]: audit 2024-09-20T23:37:12.535459+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:12 smithi049 bash[23528]: audit 2024-09-20T23:37:12.541852+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:37:13.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:13.304 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:13.304 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:13.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:37:13 smithi044 bash[22930]: debug 2024-09-20T23:37:13.331+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:37:13.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:37:13 smithi044 bash[22930]: debug 2024-09-20T23:37:13.331+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:37:14.067 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:13 smithi044 bash[22676]: audit 2024-09-20T23:37:12.544155+0000 mgr.a (mgr.14388) 3574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:37:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:13 smithi179 bash[23186]: audit 2024-09-20T23:37:12.544155+0000 mgr.a (mgr.14388) 3574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:37:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:13 smithi049 bash[23528]: audit 2024-09-20T23:37:12.544155+0000 mgr.a (mgr.14388) 3574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:37:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:14 smithi044 bash[22676]: audit 2024-09-20T23:37:13.333425+0000 mgr.a (mgr.14388) 3575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:37:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:14 smithi044 bash[22676]: cephadm 2024-09-20T23:37:13.334961+0000 mgr.a (mgr.14388) 3576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:37:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:14 smithi044 bash[22676]: audit 2024-09-20T23:37:13.634197+0000 mgr.a (mgr.14388) 3577 : audit [DBG] from='client.88128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:14 smithi044 bash[22676]: cluster 2024-09-20T23:37:13.823744+0000 mgr.a (mgr.14388) 3578 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:14 smithi179 bash[23186]: audit 2024-09-20T23:37:13.333425+0000 mgr.a (mgr.14388) 3575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:37:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:14 smithi179 bash[23186]: cephadm 2024-09-20T23:37:13.334961+0000 mgr.a (mgr.14388) 3576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:37:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:14 smithi179 bash[23186]: audit 2024-09-20T23:37:13.634197+0000 mgr.a (mgr.14388) 3577 : audit [DBG] from='client.88128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:14 smithi179 bash[23186]: cluster 2024-09-20T23:37:13.823744+0000 mgr.a (mgr.14388) 3578 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:14 smithi049 bash[23528]: audit 2024-09-20T23:37:13.333425+0000 mgr.a (mgr.14388) 3575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:14 smithi049 bash[23528]: cephadm 2024-09-20T23:37:13.334961+0000 mgr.a (mgr.14388) 3576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:14 smithi049 bash[23528]: audit 2024-09-20T23:37:13.634197+0000 mgr.a (mgr.14388) 3577 : audit [DBG] from='client.88128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:14 smithi049 bash[23528]: cluster 2024-09-20T23:37:13.823744+0000 mgr.a (mgr.14388) 3578 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 123 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:16 smithi044 bash[22676]: cluster 2024-09-20T23:37:15.826084+0000 mgr.a (mgr.14388) 3579 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:16 smithi179 bash[23186]: cluster 2024-09-20T23:37:15.826084+0000 mgr.a (mgr.14388) 3579 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:16 smithi049 bash[23528]: cluster 2024-09-20T23:37:15.826084+0000 mgr.a (mgr.14388) 3579 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:19.178 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:18 smithi044 bash[22676]: cluster 2024-09-20T23:37:17.826892+0000 mgr.a (mgr.14388) 3580 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:18 smithi179 bash[23186]: cluster 2024-09-20T23:37:17.826892+0000 mgr.a (mgr.14388) 3580 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:18 smithi049 bash[23528]: cluster 2024-09-20T23:37:17.826892+0000 mgr.a (mgr.14388) 3580 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:19.843 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:19.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:19.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:19.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:19.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:20 smithi044 bash[22676]: audit 2024-09-20T23:37:19.396853+0000 mgr.a (mgr.14388) 3581 : audit [DBG] from='client.88206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:20 smithi044 bash[22676]: cluster 2024-09-20T23:37:19.827410+0000 mgr.a (mgr.14388) 3582 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:20 smithi179 bash[23186]: audit 2024-09-20T23:37:19.396853+0000 mgr.a (mgr.14388) 3581 : audit [DBG] from='client.88206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:20 smithi179 bash[23186]: cluster 2024-09-20T23:37:19.827410+0000 mgr.a (mgr.14388) 3582 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:20 smithi049 bash[23528]: audit 2024-09-20T23:37:19.396853+0000 mgr.a (mgr.14388) 3581 : audit [DBG] from='client.88206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:20 smithi049 bash[23528]: cluster 2024-09-20T23:37:19.827410+0000 mgr.a (mgr.14388) 3582 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:22 smithi044 bash[22676]: cluster 2024-09-20T23:37:21.829631+0000 mgr.a (mgr.14388) 3583 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:22 smithi179 bash[23186]: cluster 2024-09-20T23:37:21.829631+0000 mgr.a (mgr.14388) 3583 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:22 smithi049 bash[23528]: cluster 2024-09-20T23:37:21.829631+0000 mgr.a (mgr.14388) 3583 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:24.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:24.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:24.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:25.227 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:24 smithi049 bash[23528]: cluster 2024-09-20T23:37:23.830409+0000 mgr.a (mgr.14388) 3584 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:24 smithi044 bash[22676]: cluster 2024-09-20T23:37:23.830409+0000 mgr.a (mgr.14388) 3584 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:24 smithi179 bash[23186]: cluster 2024-09-20T23:37:23.830409+0000 mgr.a (mgr.14388) 3584 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:25.631 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:26.633 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:26 smithi049 bash[23528]: audit 2024-09-20T23:37:25.184131+0000 mgr.a (mgr.14388) 3585 : audit [DBG] from='client.88281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:26.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:26 smithi049 bash[23528]: audit 2024-09-20T23:37:25.335590+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:26 smithi049 bash[23528]: audit 2024-09-20T23:37:25.341570+0000 mon.a (mon.0) 3509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:26 smithi049 bash[23528]: audit 2024-09-20T23:37:25.346796+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.634 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:26 smithi049 bash[23528]: cluster 2024-09-20T23:37:25.833170+0000 mgr.a (mgr.14388) 3586 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:26 smithi044 bash[22676]: audit 2024-09-20T23:37:25.184131+0000 mgr.a (mgr.14388) 3585 : audit [DBG] from='client.88281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:26 smithi044 bash[22676]: audit 2024-09-20T23:37:25.335590+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:26 smithi044 bash[22676]: audit 2024-09-20T23:37:25.341570+0000 mon.a (mon.0) 3509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:26 smithi044 bash[22676]: audit 2024-09-20T23:37:25.346796+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:26 smithi044 bash[22676]: cluster 2024-09-20T23:37:25.833170+0000 mgr.a (mgr.14388) 3586 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:26 smithi179 bash[23186]: audit 2024-09-20T23:37:25.184131+0000 mgr.a (mgr.14388) 3585 : audit [DBG] from='client.88281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:26 smithi179 bash[23186]: audit 2024-09-20T23:37:25.335590+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:26 smithi179 bash[23186]: audit 2024-09-20T23:37:25.341570+0000 mon.a (mon.0) 3509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:26 smithi179 bash[23186]: audit 2024-09-20T23:37:25.346796+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:26 smithi179 bash[23186]: cluster 2024-09-20T23:37:25.833170+0000 mgr.a (mgr.14388) 3586 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:27 smithi049 bash[23528]: audit 2024-09-20T23:37:26.556517+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:27 smithi049 bash[23528]: audit 2024-09-20T23:37:26.564944+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:27 smithi049 bash[23528]: audit 2024-09-20T23:37:26.575462+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:27 smithi044 bash[22676]: audit 2024-09-20T23:37:26.556517+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:27 smithi044 bash[22676]: audit 2024-09-20T23:37:26.564944+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:27 smithi044 bash[22676]: audit 2024-09-20T23:37:26.575462+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:27 smithi179 bash[23186]: audit 2024-09-20T23:37:26.556517+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:27 smithi179 bash[23186]: audit 2024-09-20T23:37:26.564944+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:27 smithi179 bash[23186]: audit 2024-09-20T23:37:26.575462+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:28 smithi044 bash[22676]: cluster 2024-09-20T23:37:27.833929+0000 mgr.a (mgr.14388) 3587 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:37:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:28 smithi044 bash[22676]: audit 2024-09-20T23:37:28.098416+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:28 smithi044 bash[22676]: audit 2024-09-20T23:37:28.106650+0000 mon.a (mon.0) 3515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:28 smithi044 bash[22676]: audit 2024-09-20T23:37:28.117198+0000 mon.a (mon.0) 3516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:28 smithi179 bash[23186]: cluster 2024-09-20T23:37:27.833929+0000 mgr.a (mgr.14388) 3587 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:37:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:28 smithi179 bash[23186]: audit 2024-09-20T23:37:28.098416+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:28 smithi179 bash[23186]: audit 2024-09-20T23:37:28.106650+0000 mon.a (mon.0) 3515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:28 smithi179 bash[23186]: audit 2024-09-20T23:37:28.117198+0000 mon.a (mon.0) 3516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:28 smithi049 bash[23528]: cluster 2024-09-20T23:37:27.833929+0000 mgr.a (mgr.14388) 3587 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:37:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:28 smithi049 bash[23528]: audit 2024-09-20T23:37:28.098416+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:28 smithi049 bash[23528]: audit 2024-09-20T23:37:28.106650+0000 mon.a (mon.0) 3515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:28 smithi049 bash[23528]: audit 2024-09-20T23:37:28.117198+0000 mon.a (mon.0) 3516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:30.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:30 smithi044 bash[22676]: cluster 2024-09-20T23:37:29.834689+0000 mgr.a (mgr.14388) 3588 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:37:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:30 smithi179 bash[23186]: cluster 2024-09-20T23:37:29.834689+0000 mgr.a (mgr.14388) 3588 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:37:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:30 smithi049 bash[23528]: cluster 2024-09-20T23:37:29.834689+0000 mgr.a (mgr.14388) 3588 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:37:31.419 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:31.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:31.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:31.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:31.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:32 smithi044 bash[22676]: audit 2024-09-20T23:37:30.971388+0000 mgr.a (mgr.14388) 3589 : audit [DBG] from='client.88356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:32 smithi044 bash[22676]: cluster 2024-09-20T23:37:31.837647+0000 mgr.a (mgr.14388) 3590 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:32 smithi179 bash[23186]: audit 2024-09-20T23:37:30.971388+0000 mgr.a (mgr.14388) 3589 : audit [DBG] from='client.88356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:32 smithi179 bash[23186]: cluster 2024-09-20T23:37:31.837647+0000 mgr.a (mgr.14388) 3590 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:32 smithi049 bash[23528]: audit 2024-09-20T23:37:30.971388+0000 mgr.a (mgr.14388) 3589 : audit [DBG] from='client.88356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:32 smithi049 bash[23528]: cluster 2024-09-20T23:37:31.837647+0000 mgr.a (mgr.14388) 3590 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:34 smithi044 bash[22676]: cluster 2024-09-20T23:37:33.838465+0000 mgr.a (mgr.14388) 3591 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:37:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:34 smithi179 bash[23186]: cluster 2024-09-20T23:37:33.838465+0000 mgr.a (mgr.14388) 3591 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:37:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:34 smithi049 bash[23528]: cluster 2024-09-20T23:37:33.838465+0000 mgr.a (mgr.14388) 3591 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:37:36.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:36.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:36.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:37.172 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:36 smithi044 bash[22676]: cluster 2024-09-20T23:37:35.840421+0000 mgr.a (mgr.14388) 3592 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:36 smithi179 bash[23186]: cluster 2024-09-20T23:37:35.840421+0000 mgr.a (mgr.14388) 3592 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:36 smithi049 bash[23528]: cluster 2024-09-20T23:37:35.840421+0000 mgr.a (mgr.14388) 3592 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:37 smithi044 bash[22676]: audit 2024-09-20T23:37:36.753668+0000 mgr.a (mgr.14388) 3593 : audit [DBG] from='client.88434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:37 smithi179 bash[23186]: audit 2024-09-20T23:37:36.753668+0000 mgr.a (mgr.14388) 3593 : audit [DBG] from='client.88434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:37 smithi049 bash[23528]: audit 2024-09-20T23:37:36.753668+0000 mgr.a (mgr.14388) 3593 : audit [DBG] from='client.88434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:39.174 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:38 smithi044 bash[22676]: cluster 2024-09-20T23:37:37.841467+0000 mgr.a (mgr.14388) 3594 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:38 smithi179 bash[23186]: cluster 2024-09-20T23:37:37.841467+0000 mgr.a (mgr.14388) 3594 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:38 smithi049 bash[23528]: cluster 2024-09-20T23:37:37.841467+0000 mgr.a (mgr.14388) 3594 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:40 smithi044 bash[22676]: cluster 2024-09-20T23:37:39.842264+0000 mgr.a (mgr.14388) 3595 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:40 smithi179 bash[23186]: cluster 2024-09-20T23:37:39.842264+0000 mgr.a (mgr.14388) 3595 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:40 smithi049 bash[23528]: cluster 2024-09-20T23:37:39.842264+0000 mgr.a (mgr.14388) 3595 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:42.971 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:42.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:42.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:42.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:42.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:42 smithi044 bash[22676]: cluster 2024-09-20T23:37:41.844510+0000 mgr.a (mgr.14388) 3596 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:42 smithi179 bash[23186]: cluster 2024-09-20T23:37:41.844510+0000 mgr.a (mgr.14388) 3596 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:42 smithi049 bash[23528]: cluster 2024-09-20T23:37:41.844510+0000 mgr.a (mgr.14388) 3596 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:43 smithi044 bash[22676]: audit 2024-09-20T23:37:42.512227+0000 mgr.a (mgr.14388) 3597 : audit [DBG] from='client.88509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:43 smithi179 bash[23186]: audit 2024-09-20T23:37:42.512227+0000 mgr.a (mgr.14388) 3597 : audit [DBG] from='client.88509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:43 smithi049 bash[23528]: audit 2024-09-20T23:37:42.512227+0000 mgr.a (mgr.14388) 3597 : audit [DBG] from='client.88509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:44 smithi044 bash[22676]: cluster 2024-09-20T23:37:43.845508+0000 mgr.a (mgr.14388) 3598 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:44 smithi179 bash[23186]: cluster 2024-09-20T23:37:43.845508+0000 mgr.a (mgr.14388) 3598 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:45.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:44 smithi049 bash[23528]: cluster 2024-09-20T23:37:43.845508+0000 mgr.a (mgr.14388) 3598 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:46 smithi044 bash[22676]: audit 2024-09-20T23:37:45.558686+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:46 smithi044 bash[22676]: audit 2024-09-20T23:37:45.567772+0000 mon.a (mon.0) 3518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:46 smithi044 bash[22676]: audit 2024-09-20T23:37:45.578483+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:46 smithi044 bash[22676]: cluster 2024-09-20T23:37:45.847700+0000 mgr.a (mgr.14388) 3599 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:46 smithi179 bash[23186]: audit 2024-09-20T23:37:45.558686+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:46 smithi179 bash[23186]: audit 2024-09-20T23:37:45.567772+0000 mon.a (mon.0) 3518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:46 smithi179 bash[23186]: audit 2024-09-20T23:37:45.578483+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:46 smithi179 bash[23186]: cluster 2024-09-20T23:37:45.847700+0000 mgr.a (mgr.14388) 3599 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:46 smithi049 bash[23528]: audit 2024-09-20T23:37:45.558686+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:46 smithi049 bash[23528]: audit 2024-09-20T23:37:45.567772+0000 mon.a (mon.0) 3518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:46 smithi049 bash[23528]: audit 2024-09-20T23:37:45.578483+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:46 smithi049 bash[23528]: cluster 2024-09-20T23:37:45.847700+0000 mgr.a (mgr.14388) 3599 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:47.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:47.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:47.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:47 smithi049 bash[23528]: audit 2024-09-20T23:37:46.785377+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:47 smithi049 bash[23528]: audit 2024-09-20T23:37:46.793499+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:47 smithi049 bash[23528]: audit 2024-09-20T23:37:46.803575+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:47 smithi044 bash[22676]: audit 2024-09-20T23:37:46.785377+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:47 smithi044 bash[22676]: audit 2024-09-20T23:37:46.793499+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:47 smithi044 bash[22676]: audit 2024-09-20T23:37:46.803575+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:47 smithi179 bash[23186]: audit 2024-09-20T23:37:46.785377+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:47 smithi179 bash[23186]: audit 2024-09-20T23:37:46.793499+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:47 smithi179 bash[23186]: audit 2024-09-20T23:37:46.803575+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:48.733 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:48.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:48.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:48.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:48.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:48 smithi049 bash[23528]: cluster 2024-09-20T23:37:47.848479+0000 mgr.a (mgr.14388) 3600 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:48 smithi049 bash[23528]: audit 2024-09-20T23:37:48.308118+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:48 smithi049 bash[23528]: audit 2024-09-20T23:37:48.314043+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:48 smithi049 bash[23528]: audit 2024-09-20T23:37:48.328956+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:48 smithi044 bash[22676]: cluster 2024-09-20T23:37:47.848479+0000 mgr.a (mgr.14388) 3600 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:48 smithi044 bash[22676]: audit 2024-09-20T23:37:48.308118+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:48 smithi044 bash[22676]: audit 2024-09-20T23:37:48.314043+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:48 smithi044 bash[22676]: audit 2024-09-20T23:37:48.328956+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:48 smithi179 bash[23186]: cluster 2024-09-20T23:37:47.848479+0000 mgr.a (mgr.14388) 3600 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:48 smithi179 bash[23186]: audit 2024-09-20T23:37:48.308118+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:48 smithi179 bash[23186]: audit 2024-09-20T23:37:48.314043+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:48 smithi179 bash[23186]: audit 2024-09-20T23:37:48.328956+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:37:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:49 smithi049 bash[23528]: audit 2024-09-20T23:37:48.309860+0000 mgr.a (mgr.14388) 3601 : audit [DBG] from='client.88587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:49 smithi044 bash[22676]: audit 2024-09-20T23:37:48.309860+0000 mgr.a (mgr.14388) 3601 : audit [DBG] from='client.88587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:49 smithi179 bash[23186]: audit 2024-09-20T23:37:48.309860+0000 mgr.a (mgr.14388) 3601 : audit [DBG] from='client.88587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:50 smithi049 bash[23528]: cluster 2024-09-20T23:37:49.849398+0000 mgr.a (mgr.14388) 3602 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:50 smithi044 bash[22676]: cluster 2024-09-20T23:37:49.849398+0000 mgr.a (mgr.14388) 3602 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:50 smithi179 bash[23186]: cluster 2024-09-20T23:37:49.849398+0000 mgr.a (mgr.14388) 3602 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:52 smithi044 bash[22676]: cluster 2024-09-20T23:37:51.851790+0000 mgr.a (mgr.14388) 3603 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:52 smithi179 bash[23186]: cluster 2024-09-20T23:37:51.851790+0000 mgr.a (mgr.14388) 3603 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:52 smithi049 bash[23528]: cluster 2024-09-20T23:37:51.851790+0000 mgr.a (mgr.14388) 3603 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:53.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:53.735 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:53.735 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:37:54.481 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:37:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:37:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:37:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:37:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:37:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:54 smithi044 bash[22676]: cluster 2024-09-20T23:37:53.852273+0000 mgr.a (mgr.14388) 3604 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:54 smithi179 bash[23186]: cluster 2024-09-20T23:37:53.852273+0000 mgr.a (mgr.14388) 3604 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:54 smithi049 bash[23528]: cluster 2024-09-20T23:37:53.852273+0000 mgr.a (mgr.14388) 3604 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:55 smithi044 bash[22676]: audit 2024-09-20T23:37:54.064356+0000 mgr.a (mgr.14388) 3605 : audit [DBG] from='client.88662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:55 smithi179 bash[23186]: audit 2024-09-20T23:37:54.064356+0000 mgr.a (mgr.14388) 3605 : audit [DBG] from='client.88662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:55 smithi049 bash[23528]: audit 2024-09-20T23:37:54.064356+0000 mgr.a (mgr.14388) 3605 : audit [DBG] from='client.88662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:37:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:56 smithi044 bash[22676]: cluster 2024-09-20T23:37:55.854514+0000 mgr.a (mgr.14388) 3606 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:56 smithi179 bash[23186]: cluster 2024-09-20T23:37:55.854514+0000 mgr.a (mgr.14388) 3606 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:56 smithi049 bash[23528]: cluster 2024-09-20T23:37:55.854514+0000 mgr.a (mgr.14388) 3606 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:37:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:37:58 smithi044 bash[22676]: cluster 2024-09-20T23:37:57.855292+0000 mgr.a (mgr.14388) 3607 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:37:58 smithi179 bash[23186]: cluster 2024-09-20T23:37:57.855292+0000 mgr.a (mgr.14388) 3607 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:37:58 smithi049 bash[23528]: cluster 2024-09-20T23:37:57.855292+0000 mgr.a (mgr.14388) 3607 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:37:59.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:37:59.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:37:59.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:00.250 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:00 smithi044 bash[22676]: audit 2024-09-20T23:37:59.810174+0000 mgr.a (mgr.14388) 3608 : audit [DBG] from='client.88740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:00 smithi044 bash[22676]: cluster 2024-09-20T23:37:59.856342+0000 mgr.a (mgr.14388) 3609 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:00 smithi179 bash[23186]: audit 2024-09-20T23:37:59.810174+0000 mgr.a (mgr.14388) 3608 : audit [DBG] from='client.88740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:00 smithi179 bash[23186]: cluster 2024-09-20T23:37:59.856342+0000 mgr.a (mgr.14388) 3609 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:00 smithi049 bash[23528]: audit 2024-09-20T23:37:59.810174+0000 mgr.a (mgr.14388) 3608 : audit [DBG] from='client.88740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:00 smithi049 bash[23528]: cluster 2024-09-20T23:37:59.856342+0000 mgr.a (mgr.14388) 3609 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:02 smithi044 bash[22676]: cluster 2024-09-20T23:38:01.859221+0000 mgr.a (mgr.14388) 3610 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:02 smithi179 bash[23186]: cluster 2024-09-20T23:38:01.859221+0000 mgr.a (mgr.14388) 3610 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:02 smithi049 bash[23528]: cluster 2024-09-20T23:38:01.859221+0000 mgr.a (mgr.14388) 3610 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:04 smithi044 bash[22676]: cluster 2024-09-20T23:38:03.860037+0000 mgr.a (mgr.14388) 3611 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:05.248 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:04 smithi049 bash[23528]: cluster 2024-09-20T23:38:03.860037+0000 mgr.a (mgr.14388) 3611 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:04 smithi179 bash[23186]: cluster 2024-09-20T23:38:03.860037+0000 mgr.a (mgr.14388) 3611 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:06.048 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:07.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:06 smithi179 bash[23186]: audit 2024-09-20T23:38:05.594537+0000 mgr.a (mgr.14388) 3612 : audit [DBG] from='client.88818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:07.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:06 smithi179 bash[23186]: audit 2024-09-20T23:38:05.763160+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:06 smithi179 bash[23186]: audit 2024-09-20T23:38:05.772549+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:06 smithi179 bash[23186]: audit 2024-09-20T23:38:05.782905+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:06 smithi179 bash[23186]: cluster 2024-09-20T23:38:05.861437+0000 mgr.a (mgr.14388) 3613 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:06 smithi049 bash[23528]: audit 2024-09-20T23:38:05.594537+0000 mgr.a (mgr.14388) 3612 : audit [DBG] from='client.88818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:06 smithi049 bash[23528]: audit 2024-09-20T23:38:05.763160+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:06 smithi049 bash[23528]: audit 2024-09-20T23:38:05.772549+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:06 smithi049 bash[23528]: audit 2024-09-20T23:38:05.782905+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:06 smithi049 bash[23528]: cluster 2024-09-20T23:38:05.861437+0000 mgr.a (mgr.14388) 3613 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:06 smithi044 bash[22676]: audit 2024-09-20T23:38:05.594537+0000 mgr.a (mgr.14388) 3612 : audit [DBG] from='client.88818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:06 smithi044 bash[22676]: audit 2024-09-20T23:38:05.763160+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:06 smithi044 bash[22676]: audit 2024-09-20T23:38:05.772549+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:06 smithi044 bash[22676]: audit 2024-09-20T23:38:05.782905+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:06 smithi044 bash[22676]: cluster 2024-09-20T23:38:05.861437+0000 mgr.a (mgr.14388) 3613 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:08 smithi049 bash[23528]: audit 2024-09-20T23:38:07.010443+0000 mon.a (mon.0) 3529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:08 smithi049 bash[23528]: audit 2024-09-20T23:38:07.019317+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:08 smithi049 bash[23528]: audit 2024-09-20T23:38:07.030169+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:08 smithi049 bash[23528]: cluster 2024-09-20T23:38:07.862298+0000 mgr.a (mgr.14388) 3614 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:08 smithi044 bash[22676]: audit 2024-09-20T23:38:07.010443+0000 mon.a (mon.0) 3529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:08 smithi044 bash[22676]: audit 2024-09-20T23:38:07.019317+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:08 smithi044 bash[22676]: audit 2024-09-20T23:38:07.030169+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:08 smithi044 bash[22676]: cluster 2024-09-20T23:38:07.862298+0000 mgr.a (mgr.14388) 3614 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:08 smithi179 bash[23186]: audit 2024-09-20T23:38:07.010443+0000 mon.a (mon.0) 3529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:08 smithi179 bash[23186]: audit 2024-09-20T23:38:07.019317+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:08 smithi179 bash[23186]: audit 2024-09-20T23:38:07.030169+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:08 smithi179 bash[23186]: cluster 2024-09-20T23:38:07.862298+0000 mgr.a (mgr.14388) 3614 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:09 smithi049 bash[23528]: audit 2024-09-20T23:38:08.535507+0000 mon.a (mon.0) 3532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:09 smithi049 bash[23528]: audit 2024-09-20T23:38:08.542789+0000 mon.a (mon.0) 3533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:09 smithi049 bash[23528]: audit 2024-09-20T23:38:08.551005+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:09 smithi044 bash[22676]: audit 2024-09-20T23:38:08.535507+0000 mon.a (mon.0) 3532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:09 smithi044 bash[22676]: audit 2024-09-20T23:38:08.542789+0000 mon.a (mon.0) 3533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:09 smithi044 bash[22676]: audit 2024-09-20T23:38:08.551005+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:09 smithi179 bash[23186]: audit 2024-09-20T23:38:08.535507+0000 mon.a (mon.0) 3532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:09 smithi179 bash[23186]: audit 2024-09-20T23:38:08.542789+0000 mon.a (mon.0) 3533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:09 smithi179 bash[23186]: audit 2024-09-20T23:38:08.551005+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:10 smithi049 bash[23528]: cluster 2024-09-20T23:38:09.863062+0000 mgr.a (mgr.14388) 3615 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:38:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:10 smithi044 bash[22676]: cluster 2024-09-20T23:38:09.863062+0000 mgr.a (mgr.14388) 3615 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:38:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:10 smithi179 bash[23186]: cluster 2024-09-20T23:38:09.863062+0000 mgr.a (mgr.14388) 3615 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:38:11.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:11.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:11.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:11.808 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:11.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:11.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:11.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:11.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:12 smithi044 bash[22676]: audit 2024-09-20T23:38:11.386411+0000 mgr.a (mgr.14388) 3616 : audit [DBG] from='client.88893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:12 smithi044 bash[22676]: cluster 2024-09-20T23:38:11.864508+0000 mgr.a (mgr.14388) 3617 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:12 smithi179 bash[23186]: audit 2024-09-20T23:38:11.386411+0000 mgr.a (mgr.14388) 3616 : audit [DBG] from='client.88893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:12 smithi179 bash[23186]: cluster 2024-09-20T23:38:11.864508+0000 mgr.a (mgr.14388) 3617 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:12 smithi049 bash[23528]: audit 2024-09-20T23:38:11.386411+0000 mgr.a (mgr.14388) 3616 : audit [DBG] from='client.88893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:12 smithi049 bash[23528]: cluster 2024-09-20T23:38:11.864508+0000 mgr.a (mgr.14388) 3617 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:14.176 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:13 smithi044 bash[22676]: audit 2024-09-20T23:38:13.392278+0000 mon.a (mon.0) 3535 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:38:14.176 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:13 smithi044 bash[22676]: audit 2024-09-20T23:38:13.399674+0000 mon.a (mon.0) 3536 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:38:14.176 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:13 smithi044 bash[22676]: audit 2024-09-20T23:38:13.401649+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:38:14.177 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:13 smithi044 bash[22676]: audit 2024-09-20T23:38:13.413366+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:14.177 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:13 smithi044 bash[22676]: audit 2024-09-20T23:38:13.419693+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:38:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:13 smithi179 bash[23186]: audit 2024-09-20T23:38:13.392278+0000 mon.a (mon.0) 3535 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:38:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:13 smithi179 bash[23186]: audit 2024-09-20T23:38:13.399674+0000 mon.a (mon.0) 3536 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:38:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:13 smithi179 bash[23186]: audit 2024-09-20T23:38:13.401649+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:38:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:13 smithi179 bash[23186]: audit 2024-09-20T23:38:13.413366+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:14.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:13 smithi179 bash[23186]: audit 2024-09-20T23:38:13.419693+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:38:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:13 smithi049 bash[23528]: audit 2024-09-20T23:38:13.392278+0000 mon.a (mon.0) 3535 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:38:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:13 smithi049 bash[23528]: audit 2024-09-20T23:38:13.399674+0000 mon.a (mon.0) 3536 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:38:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:13 smithi049 bash[23528]: audit 2024-09-20T23:38:13.401649+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:38:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:13 smithi049 bash[23528]: audit 2024-09-20T23:38:13.413366+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:14.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:13 smithi049 bash[23528]: audit 2024-09-20T23:38:13.419693+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:38:14.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:38:14 smithi044 bash[22930]: debug 2024-09-20T23:38:14.170+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:38:14.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:38:14 smithi044 bash[22930]: debug 2024-09-20T23:38:14.174+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:38:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:14 smithi044 bash[22676]: audit 2024-09-20T23:38:13.422290+0000 mgr.a (mgr.14388) 3618 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:38:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:14 smithi044 bash[22676]: cluster 2024-09-20T23:38:13.865187+0000 mgr.a (mgr.14388) 3619 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:14 smithi179 bash[23186]: audit 2024-09-20T23:38:13.422290+0000 mgr.a (mgr.14388) 3618 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:38:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:14 smithi179 bash[23186]: cluster 2024-09-20T23:38:13.865187+0000 mgr.a (mgr.14388) 3619 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:14 smithi049 bash[23528]: audit 2024-09-20T23:38:13.422290+0000 mgr.a (mgr.14388) 3618 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:38:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:14 smithi049 bash[23528]: cluster 2024-09-20T23:38:13.865187+0000 mgr.a (mgr.14388) 3619 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:15 smithi044 bash[22676]: audit 2024-09-20T23:38:14.177062+0000 mgr.a (mgr.14388) 3620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:38:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:15 smithi044 bash[22676]: cephadm 2024-09-20T23:38:14.178533+0000 mgr.a (mgr.14388) 3621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:38:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:15 smithi179 bash[23186]: audit 2024-09-20T23:38:14.177062+0000 mgr.a (mgr.14388) 3620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:38:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:15 smithi179 bash[23186]: cephadm 2024-09-20T23:38:14.178533+0000 mgr.a (mgr.14388) 3621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:38:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:15 smithi049 bash[23528]: audit 2024-09-20T23:38:14.177062+0000 mgr.a (mgr.14388) 3620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:38:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:15 smithi049 bash[23528]: cephadm 2024-09-20T23:38:14.178533+0000 mgr.a (mgr.14388) 3621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:38:16.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:16.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:16.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:16 smithi044 bash[22676]: cluster 2024-09-20T23:38:15.867582+0000 mgr.a (mgr.14388) 3622 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:16 smithi179 bash[23186]: cluster 2024-09-20T23:38:15.867582+0000 mgr.a (mgr.14388) 3622 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:16 smithi049 bash[23528]: cluster 2024-09-20T23:38:15.867582+0000 mgr.a (mgr.14388) 3622 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:17.570 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:17.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:17.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:17.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:17.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:19.196 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:18 smithi049 bash[23528]: audit 2024-09-20T23:38:17.140810+0000 mgr.a (mgr.14388) 3623 : audit [DBG] from='client.89073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:19.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:18 smithi049 bash[23528]: cluster 2024-09-20T23:38:17.868714+0000 mgr.a (mgr.14388) 3624 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:18 smithi044 bash[22676]: audit 2024-09-20T23:38:17.140810+0000 mgr.a (mgr.14388) 3623 : audit [DBG] from='client.89073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:18 smithi044 bash[22676]: cluster 2024-09-20T23:38:17.868714+0000 mgr.a (mgr.14388) 3624 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:18 smithi179 bash[23186]: audit 2024-09-20T23:38:17.140810+0000 mgr.a (mgr.14388) 3623 : audit [DBG] from='client.89073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:18 smithi179 bash[23186]: cluster 2024-09-20T23:38:17.868714+0000 mgr.a (mgr.14388) 3624 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:20 smithi044 bash[22676]: cluster 2024-09-20T23:38:19.869569+0000 mgr.a (mgr.14388) 3625 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:20 smithi179 bash[23186]: cluster 2024-09-20T23:38:19.869569+0000 mgr.a (mgr.14388) 3625 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:20 smithi049 bash[23528]: cluster 2024-09-20T23:38:19.869569+0000 mgr.a (mgr.14388) 3625 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:22.469 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:22 smithi044 bash[22676]: cluster 2024-09-20T23:38:21.871660+0000 mgr.a (mgr.14388) 3626 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:22 smithi179 bash[23186]: cluster 2024-09-20T23:38:21.871660+0000 mgr.a (mgr.14388) 3626 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:22 smithi049 bash[23528]: cluster 2024-09-20T23:38:21.871660+0000 mgr.a (mgr.14388) 3626 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:22.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:22.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:22.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:23.312 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:23 smithi044 bash[22676]: audit 2024-09-20T23:38:22.897079+0000 mgr.a (mgr.14388) 3627 : audit [DBG] from='client.89151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:23 smithi179 bash[23186]: audit 2024-09-20T23:38:22.897079+0000 mgr.a (mgr.14388) 3627 : audit [DBG] from='client.89151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:23 smithi049 bash[23528]: audit 2024-09-20T23:38:22.897079+0000 mgr.a (mgr.14388) 3627 : audit [DBG] from='client.89151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:24 smithi044 bash[22676]: cluster 2024-09-20T23:38:23.872670+0000 mgr.a (mgr.14388) 3628 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:24 smithi179 bash[23186]: cluster 2024-09-20T23:38:23.872670+0000 mgr.a (mgr.14388) 3628 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:24 smithi049 bash[23528]: cluster 2024-09-20T23:38:23.872670+0000 mgr.a (mgr.14388) 3628 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:26 smithi044 bash[22676]: cluster 2024-09-20T23:38:25.874855+0000 mgr.a (mgr.14388) 3629 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:26 smithi044 bash[22676]: audit 2024-09-20T23:38:26.025024+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:26 smithi044 bash[22676]: audit 2024-09-20T23:38:26.035059+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:26 smithi044 bash[22676]: audit 2024-09-20T23:38:26.046870+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:26 smithi179 bash[23186]: cluster 2024-09-20T23:38:25.874855+0000 mgr.a (mgr.14388) 3629 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:26 smithi179 bash[23186]: audit 2024-09-20T23:38:26.025024+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:26 smithi179 bash[23186]: audit 2024-09-20T23:38:26.035059+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:26 smithi179 bash[23186]: audit 2024-09-20T23:38:26.046870+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:26 smithi049 bash[23528]: cluster 2024-09-20T23:38:25.874855+0000 mgr.a (mgr.14388) 3629 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:38:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:26 smithi049 bash[23528]: audit 2024-09-20T23:38:26.025024+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:26 smithi049 bash[23528]: audit 2024-09-20T23:38:26.035059+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:26 smithi049 bash[23528]: audit 2024-09-20T23:38:26.046870+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:28 smithi179 bash[23186]: audit 2024-09-20T23:38:27.240306+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:28 smithi179 bash[23186]: audit 2024-09-20T23:38:27.249982+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:28 smithi179 bash[23186]: audit 2024-09-20T23:38:27.261293+0000 mon.a (mon.0) 3545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:28 smithi179 bash[23186]: cluster 2024-09-20T23:38:27.875603+0000 mgr.a (mgr.14388) 3630 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:28 smithi049 bash[23528]: audit 2024-09-20T23:38:27.240306+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:28 smithi049 bash[23528]: audit 2024-09-20T23:38:27.249982+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:28 smithi049 bash[23528]: audit 2024-09-20T23:38:27.261293+0000 mon.a (mon.0) 3545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:28 smithi049 bash[23528]: cluster 2024-09-20T23:38:27.875603+0000 mgr.a (mgr.14388) 3630 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:28 smithi044 bash[22676]: audit 2024-09-20T23:38:27.240306+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:28 smithi044 bash[22676]: audit 2024-09-20T23:38:27.249982+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:28 smithi044 bash[22676]: audit 2024-09-20T23:38:27.261293+0000 mon.a (mon.0) 3545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:28 smithi044 bash[22676]: cluster 2024-09-20T23:38:27.875603+0000 mgr.a (mgr.14388) 3630 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:29.067 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:29.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:29.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:29.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:29.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:29 smithi179 bash[23186]: audit 2024-09-20T23:38:28.647881+0000 mgr.a (mgr.14388) 3631 : audit [DBG] from='client.89226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:29 smithi179 bash[23186]: audit 2024-09-20T23:38:28.748464+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:29 smithi179 bash[23186]: audit 2024-09-20T23:38:28.754899+0000 mon.a (mon.0) 3547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:29 smithi179 bash[23186]: audit 2024-09-20T23:38:28.760010+0000 mon.a (mon.0) 3548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:29 smithi049 bash[23528]: audit 2024-09-20T23:38:28.647881+0000 mgr.a (mgr.14388) 3631 : audit [DBG] from='client.89226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:29 smithi049 bash[23528]: audit 2024-09-20T23:38:28.748464+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:29 smithi049 bash[23528]: audit 2024-09-20T23:38:28.754899+0000 mon.a (mon.0) 3547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:29 smithi049 bash[23528]: audit 2024-09-20T23:38:28.760010+0000 mon.a (mon.0) 3548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:29 smithi044 bash[22676]: audit 2024-09-20T23:38:28.647881+0000 mgr.a (mgr.14388) 3631 : audit [DBG] from='client.89226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:29 smithi044 bash[22676]: audit 2024-09-20T23:38:28.748464+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:29 smithi044 bash[22676]: audit 2024-09-20T23:38:28.754899+0000 mon.a (mon.0) 3547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:29 smithi044 bash[22676]: audit 2024-09-20T23:38:28.760010+0000 mon.a (mon.0) 3548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:30 smithi049 bash[23528]: cluster 2024-09-20T23:38:29.876490+0000 mgr.a (mgr.14388) 3632 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:30 smithi044 bash[22676]: cluster 2024-09-20T23:38:29.876490+0000 mgr.a (mgr.14388) 3632 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:30 smithi179 bash[23186]: cluster 2024-09-20T23:38:29.876490+0000 mgr.a (mgr.14388) 3632 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:32 smithi044 bash[22676]: cluster 2024-09-20T23:38:31.878742+0000 mgr.a (mgr.14388) 3633 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:32 smithi179 bash[23186]: cluster 2024-09-20T23:38:31.878742+0000 mgr.a (mgr.14388) 3633 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:32 smithi049 bash[23528]: cluster 2024-09-20T23:38:31.878742+0000 mgr.a (mgr.14388) 3633 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:34.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:34.857 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:34.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:34.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:34.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:34.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:34 smithi044 bash[22676]: cluster 2024-09-20T23:38:33.879515+0000 mgr.a (mgr.14388) 3634 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:34 smithi179 bash[23186]: cluster 2024-09-20T23:38:33.879515+0000 mgr.a (mgr.14388) 3634 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:34 smithi049 bash[23528]: cluster 2024-09-20T23:38:33.879515+0000 mgr.a (mgr.14388) 3634 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:35 smithi044 bash[22676]: audit 2024-09-20T23:38:34.407624+0000 mgr.a (mgr.14388) 3635 : audit [DBG] from='client.89304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:35 smithi179 bash[23186]: audit 2024-09-20T23:38:34.407624+0000 mgr.a (mgr.14388) 3635 : audit [DBG] from='client.89304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:35 smithi049 bash[23528]: audit 2024-09-20T23:38:34.407624+0000 mgr.a (mgr.14388) 3635 : audit [DBG] from='client.89304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:36 smithi044 bash[22676]: cluster 2024-09-20T23:38:35.881837+0000 mgr.a (mgr.14388) 3636 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:36 smithi179 bash[23186]: cluster 2024-09-20T23:38:35.881837+0000 mgr.a (mgr.14388) 3636 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:36 smithi049 bash[23528]: cluster 2024-09-20T23:38:35.881837+0000 mgr.a (mgr.14388) 3636 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:39.216 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:38 smithi179 bash[23186]: cluster 2024-09-20T23:38:37.882623+0000 mgr.a (mgr.14388) 3637 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:38 smithi044 bash[22676]: cluster 2024-09-20T23:38:37.882623+0000 mgr.a (mgr.14388) 3637 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:38 smithi049 bash[23528]: cluster 2024-09-20T23:38:37.882623+0000 mgr.a (mgr.14388) 3637 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:40.646 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:41.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:40 smithi044 bash[22676]: cluster 2024-09-20T23:38:39.883264+0000 mgr.a (mgr.14388) 3638 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:40 smithi179 bash[23186]: cluster 2024-09-20T23:38:39.883264+0000 mgr.a (mgr.14388) 3638 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:40 smithi049 bash[23528]: cluster 2024-09-20T23:38:39.883264+0000 mgr.a (mgr.14388) 3638 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:41 smithi044 bash[22676]: audit 2024-09-20T23:38:40.201982+0000 mgr.a (mgr.14388) 3639 : audit [DBG] from='client.89379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:41 smithi179 bash[23186]: audit 2024-09-20T23:38:40.201982+0000 mgr.a (mgr.14388) 3639 : audit [DBG] from='client.89379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:41 smithi049 bash[23528]: audit 2024-09-20T23:38:40.201982+0000 mgr.a (mgr.14388) 3639 : audit [DBG] from='client.89379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:42 smithi044 bash[22676]: cluster 2024-09-20T23:38:41.886034+0000 mgr.a (mgr.14388) 3640 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:42 smithi179 bash[23186]: cluster 2024-09-20T23:38:41.886034+0000 mgr.a (mgr.14388) 3640 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:42 smithi049 bash[23528]: cluster 2024-09-20T23:38:41.886034+0000 mgr.a (mgr.14388) 3640 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:44 smithi049 bash[23528]: cluster 2024-09-20T23:38:43.886866+0000 mgr.a (mgr.14388) 3641 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:44 smithi044 bash[22676]: cluster 2024-09-20T23:38:43.886866+0000 mgr.a (mgr.14388) 3641 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:44.511 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:44 smithi179 bash[23186]: cluster 2024-09-20T23:38:43.886866+0000 mgr.a (mgr.14388) 3641 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:45.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:45.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:45.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:46.423 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:46.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:46.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:46 smithi044 bash[22676]: cluster 2024-09-20T23:38:45.888855+0000 mgr.a (mgr.14388) 3642 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:46 smithi044 bash[22676]: audit 2024-09-20T23:38:46.214397+0000 mon.a (mon.0) 3549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:46 smithi044 bash[22676]: audit 2024-09-20T23:38:46.231322+0000 mon.a (mon.0) 3550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:46 smithi044 bash[22676]: audit 2024-09-20T23:38:46.239003+0000 mon.a (mon.0) 3551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:46 smithi179 bash[23186]: cluster 2024-09-20T23:38:45.888855+0000 mgr.a (mgr.14388) 3642 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:46 smithi179 bash[23186]: audit 2024-09-20T23:38:46.214397+0000 mon.a (mon.0) 3549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:46 smithi179 bash[23186]: audit 2024-09-20T23:38:46.231322+0000 mon.a (mon.0) 3550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:46 smithi179 bash[23186]: audit 2024-09-20T23:38:46.239003+0000 mon.a (mon.0) 3551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.276 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:46 smithi049 bash[23528]: cluster 2024-09-20T23:38:45.888855+0000 mgr.a (mgr.14388) 3642 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:47.276 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:46 smithi049 bash[23528]: audit 2024-09-20T23:38:46.214397+0000 mon.a (mon.0) 3549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.276 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:46 smithi049 bash[23528]: audit 2024-09-20T23:38:46.231322+0000 mon.a (mon.0) 3550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:47.276 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:46 smithi049 bash[23528]: audit 2024-09-20T23:38:46.239003+0000 mon.a (mon.0) 3551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:47 smithi044 bash[22676]: audit 2024-09-20T23:38:45.982581+0000 mgr.a (mgr.14388) 3643 : audit [DBG] from='client.89457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:47 smithi044 bash[22676]: audit 2024-09-20T23:38:47.483500+0000 mon.a (mon.0) 3552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:47 smithi044 bash[22676]: audit 2024-09-20T23:38:47.492072+0000 mon.a (mon.0) 3553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:47 smithi044 bash[22676]: audit 2024-09-20T23:38:47.503428+0000 mon.a (mon.0) 3554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:47 smithi179 bash[23186]: audit 2024-09-20T23:38:45.982581+0000 mgr.a (mgr.14388) 3643 : audit [DBG] from='client.89457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:47 smithi179 bash[23186]: audit 2024-09-20T23:38:47.483500+0000 mon.a (mon.0) 3552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:47 smithi179 bash[23186]: audit 2024-09-20T23:38:47.492072+0000 mon.a (mon.0) 3553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:47 smithi179 bash[23186]: audit 2024-09-20T23:38:47.503428+0000 mon.a (mon.0) 3554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.262 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:47 smithi049 bash[23528]: audit 2024-09-20T23:38:45.982581+0000 mgr.a (mgr.14388) 3643 : audit [DBG] from='client.89457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:48.262 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:47 smithi049 bash[23528]: audit 2024-09-20T23:38:47.483500+0000 mon.a (mon.0) 3552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.263 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:47 smithi049 bash[23528]: audit 2024-09-20T23:38:47.492072+0000 mon.a (mon.0) 3553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:48.263 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:47 smithi049 bash[23528]: audit 2024-09-20T23:38:47.503428+0000 mon.a (mon.0) 3554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:48 smithi044 bash[22676]: cluster 2024-09-20T23:38:47.889732+0000 mgr.a (mgr.14388) 3644 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:48 smithi179 bash[23186]: cluster 2024-09-20T23:38:47.889732+0000 mgr.a (mgr.14388) 3644 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:48 smithi049 bash[23528]: cluster 2024-09-20T23:38:47.889732+0000 mgr.a (mgr.14388) 3644 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:38:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:49 smithi044 bash[22676]: audit 2024-09-20T23:38:48.974121+0000 mon.a (mon.0) 3555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:49 smithi044 bash[22676]: audit 2024-09-20T23:38:48.982683+0000 mon.a (mon.0) 3556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:49 smithi044 bash[22676]: audit 2024-09-20T23:38:48.992952+0000 mon.a (mon.0) 3557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:49 smithi179 bash[23186]: audit 2024-09-20T23:38:48.974121+0000 mon.a (mon.0) 3555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:49 smithi179 bash[23186]: audit 2024-09-20T23:38:48.982683+0000 mon.a (mon.0) 3556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:49 smithi179 bash[23186]: audit 2024-09-20T23:38:48.992952+0000 mon.a (mon.0) 3557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:49 smithi049 bash[23528]: audit 2024-09-20T23:38:48.974121+0000 mon.a (mon.0) 3555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:49 smithi049 bash[23528]: audit 2024-09-20T23:38:48.982683+0000 mon.a (mon.0) 3556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:49 smithi049 bash[23528]: audit 2024-09-20T23:38:48.992952+0000 mon.a (mon.0) 3557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:38:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:50 smithi044 bash[22676]: cluster 2024-09-20T23:38:49.890490+0000 mgr.a (mgr.14388) 3645 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:38:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:50 smithi179 bash[23186]: cluster 2024-09-20T23:38:49.890490+0000 mgr.a (mgr.14388) 3645 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:38:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:50 smithi049 bash[23528]: cluster 2024-09-20T23:38:49.890490+0000 mgr.a (mgr.14388) 3645 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:38:51.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:51.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:51.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:52.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:52.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:52.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:52.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:52.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:51 smithi044 bash[22676]: audit 2024-09-20T23:38:51.756934+0000 mgr.a (mgr.14388) 3646 : audit [DBG] from='client.89535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:51 smithi044 bash[22676]: cluster 2024-09-20T23:38:51.901217+0000 mgr.a (mgr.14388) 3647 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:52.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:51 smithi179 bash[23186]: audit 2024-09-20T23:38:51.756934+0000 mgr.a (mgr.14388) 3646 : audit [DBG] from='client.89535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:52.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:51 smithi179 bash[23186]: cluster 2024-09-20T23:38:51.901217+0000 mgr.a (mgr.14388) 3647 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:51 smithi049 bash[23528]: audit 2024-09-20T23:38:51.756934+0000 mgr.a (mgr.14388) 3646 : audit [DBG] from='client.89535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:51 smithi049 bash[23528]: cluster 2024-09-20T23:38:51.901217+0000 mgr.a (mgr.14388) 3647 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:54 smithi044 bash[22676]: cluster 2024-09-20T23:38:53.902155+0000 mgr.a (mgr.14388) 3648 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:54 smithi179 bash[23186]: cluster 2024-09-20T23:38:53.902155+0000 mgr.a (mgr.14388) 3648 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:54 smithi049 bash[23528]: cluster 2024-09-20T23:38:53.902155+0000 mgr.a (mgr.14388) 3648 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:57.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:38:57.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:38:57.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:38:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:56 smithi044 bash[22676]: cluster 2024-09-20T23:38:55.904345+0000 mgr.a (mgr.14388) 3649 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:56 smithi179 bash[23186]: cluster 2024-09-20T23:38:55.904345+0000 mgr.a (mgr.14388) 3649 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:56 smithi049 bash[23528]: cluster 2024-09-20T23:38:55.904345+0000 mgr.a (mgr.14388) 3649 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:38:57.937 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:38:57.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:38:57.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:38:57.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:38:57.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:38:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:58 smithi044 bash[22676]: audit 2024-09-20T23:38:57.522160+0000 mgr.a (mgr.14388) 3650 : audit [DBG] from='client.89613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:38:58 smithi044 bash[22676]: cluster 2024-09-20T23:38:57.904943+0000 mgr.a (mgr.14388) 3651 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:59.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:58 smithi179 bash[23186]: audit 2024-09-20T23:38:57.522160+0000 mgr.a (mgr.14388) 3650 : audit [DBG] from='client.89613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:59.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:38:58 smithi179 bash[23186]: cluster 2024-09-20T23:38:57.904943+0000 mgr.a (mgr.14388) 3651 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:38:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:58 smithi049 bash[23528]: audit 2024-09-20T23:38:57.522160+0000 mgr.a (mgr.14388) 3650 : audit [DBG] from='client.89613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:38:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:38:58 smithi049 bash[23528]: cluster 2024-09-20T23:38:57.904943+0000 mgr.a (mgr.14388) 3651 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:00 smithi044 bash[22676]: cluster 2024-09-20T23:38:59.905721+0000 mgr.a (mgr.14388) 3652 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:00 smithi179 bash[23186]: cluster 2024-09-20T23:38:59.905721+0000 mgr.a (mgr.14388) 3652 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:00 smithi049 bash[23528]: cluster 2024-09-20T23:38:59.905721+0000 mgr.a (mgr.14388) 3652 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:02.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:02 smithi044 bash[22676]: cluster 2024-09-20T23:39:01.907135+0000 mgr.a (mgr.14388) 3653 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:02 smithi049 bash[23528]: cluster 2024-09-20T23:39:01.907135+0000 mgr.a (mgr.14388) 3653 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:02 smithi179 bash[23186]: cluster 2024-09-20T23:39:01.907135+0000 mgr.a (mgr.14388) 3653 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:02.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:02.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:02.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:03.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:03.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:03.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:03.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:04 smithi044 bash[22676]: audit 2024-09-20T23:39:03.277910+0000 mgr.a (mgr.14388) 3654 : audit [DBG] from='client.89691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:04 smithi044 bash[22676]: cluster 2024-09-20T23:39:03.908075+0000 mgr.a (mgr.14388) 3655 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:04 smithi179 bash[23186]: audit 2024-09-20T23:39:03.277910+0000 mgr.a (mgr.14388) 3654 : audit [DBG] from='client.89691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:04 smithi179 bash[23186]: cluster 2024-09-20T23:39:03.908075+0000 mgr.a (mgr.14388) 3655 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:04 smithi049 bash[23528]: audit 2024-09-20T23:39:03.277910+0000 mgr.a (mgr.14388) 3654 : audit [DBG] from='client.89691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:04 smithi049 bash[23528]: cluster 2024-09-20T23:39:03.908075+0000 mgr.a (mgr.14388) 3655 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:06 smithi044 bash[22676]: cluster 2024-09-20T23:39:05.910321+0000 mgr.a (mgr.14388) 3656 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:06 smithi044 bash[22676]: audit 2024-09-20T23:39:06.422461+0000 mon.a (mon.0) 3558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:06 smithi044 bash[22676]: audit 2024-09-20T23:39:06.431136+0000 mon.a (mon.0) 3559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:06 smithi044 bash[22676]: audit 2024-09-20T23:39:06.443177+0000 mon.a (mon.0) 3560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:06 smithi179 bash[23186]: cluster 2024-09-20T23:39:05.910321+0000 mgr.a (mgr.14388) 3656 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:06 smithi179 bash[23186]: audit 2024-09-20T23:39:06.422461+0000 mon.a (mon.0) 3558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:06 smithi179 bash[23186]: audit 2024-09-20T23:39:06.431136+0000 mon.a (mon.0) 3559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:06 smithi179 bash[23186]: audit 2024-09-20T23:39:06.443177+0000 mon.a (mon.0) 3560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:06 smithi049 bash[23528]: cluster 2024-09-20T23:39:05.910321+0000 mgr.a (mgr.14388) 3656 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:06 smithi049 bash[23528]: audit 2024-09-20T23:39:06.422461+0000 mon.a (mon.0) 3558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:06 smithi049 bash[23528]: audit 2024-09-20T23:39:06.431136+0000 mon.a (mon.0) 3559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:06 smithi049 bash[23528]: audit 2024-09-20T23:39:06.443177+0000 mon.a (mon.0) 3560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:08.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:08.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:08.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:08 smithi044 bash[22676]: audit 2024-09-20T23:39:07.709242+0000 mon.a (mon.0) 3561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:08 smithi044 bash[22676]: audit 2024-09-20T23:39:07.717644+0000 mon.a (mon.0) 3562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:08 smithi044 bash[22676]: audit 2024-09-20T23:39:07.728084+0000 mon.a (mon.0) 3563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:08 smithi044 bash[22676]: cluster 2024-09-20T23:39:07.911088+0000 mgr.a (mgr.14388) 3657 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:08 smithi179 bash[23186]: audit 2024-09-20T23:39:07.709242+0000 mon.a (mon.0) 3561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:08 smithi179 bash[23186]: audit 2024-09-20T23:39:07.717644+0000 mon.a (mon.0) 3562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:08 smithi179 bash[23186]: audit 2024-09-20T23:39:07.728084+0000 mon.a (mon.0) 3563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:08 smithi179 bash[23186]: cluster 2024-09-20T23:39:07.911088+0000 mgr.a (mgr.14388) 3657 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:08 smithi049 bash[23528]: audit 2024-09-20T23:39:07.709242+0000 mon.a (mon.0) 3561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:08 smithi049 bash[23528]: audit 2024-09-20T23:39:07.717644+0000 mon.a (mon.0) 3562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:08 smithi049 bash[23528]: audit 2024-09-20T23:39:07.728084+0000 mon.a (mon.0) 3563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:08 smithi049 bash[23528]: cluster 2024-09-20T23:39:07.911088+0000 mgr.a (mgr.14388) 3657 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:09.495 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:09.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:09.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:09.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:09.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:10 smithi044 bash[22676]: audit 2024-09-20T23:39:09.077829+0000 mgr.a (mgr.14388) 3658 : audit [DBG] from='client.89769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:10 smithi044 bash[22676]: audit 2024-09-20T23:39:09.180275+0000 mon.a (mon.0) 3564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:10 smithi044 bash[22676]: audit 2024-09-20T23:39:09.185441+0000 mon.a (mon.0) 3565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:10 smithi044 bash[22676]: audit 2024-09-20T23:39:09.191117+0000 mon.a (mon.0) 3566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:10 smithi044 bash[22676]: cluster 2024-09-20T23:39:09.911980+0000 mgr.a (mgr.14388) 3659 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:10 smithi179 bash[23186]: audit 2024-09-20T23:39:09.077829+0000 mgr.a (mgr.14388) 3658 : audit [DBG] from='client.89769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:10 smithi179 bash[23186]: audit 2024-09-20T23:39:09.180275+0000 mon.a (mon.0) 3564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:10 smithi179 bash[23186]: audit 2024-09-20T23:39:09.185441+0000 mon.a (mon.0) 3565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:10 smithi179 bash[23186]: audit 2024-09-20T23:39:09.191117+0000 mon.a (mon.0) 3566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:10 smithi179 bash[23186]: cluster 2024-09-20T23:39:09.911980+0000 mgr.a (mgr.14388) 3659 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:10 smithi049 bash[23528]: audit 2024-09-20T23:39:09.077829+0000 mgr.a (mgr.14388) 3658 : audit [DBG] from='client.89769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:10 smithi049 bash[23528]: audit 2024-09-20T23:39:09.180275+0000 mon.a (mon.0) 3564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:10 smithi049 bash[23528]: audit 2024-09-20T23:39:09.185441+0000 mon.a (mon.0) 3565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:10 smithi049 bash[23528]: audit 2024-09-20T23:39:09.191117+0000 mon.a (mon.0) 3566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:10 smithi049 bash[23528]: cluster 2024-09-20T23:39:09.911980+0000 mgr.a (mgr.14388) 3659 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:12 smithi044 bash[22676]: cluster 2024-09-20T23:39:11.914331+0000 mgr.a (mgr.14388) 3660 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:12 smithi179 bash[23186]: cluster 2024-09-20T23:39:11.914331+0000 mgr.a (mgr.14388) 3660 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:12 smithi049 bash[23528]: cluster 2024-09-20T23:39:11.914331+0000 mgr.a (mgr.14388) 3660 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:15.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:39:15 smithi044 bash[22930]: debug 2024-09-20T23:39:15.061+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:39:15.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:39:15 smithi044 bash[22930]: debug 2024-09-20T23:39:15.073+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:14 smithi044 bash[22676]: cluster 2024-09-20T23:39:13.915261+0000 mgr.a (mgr.14388) 3661 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:14 smithi044 bash[22676]: audit 2024-09-20T23:39:14.243175+0000 mon.a (mon.0) 3567 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:14 smithi044 bash[22676]: audit 2024-09-20T23:39:14.250845+0000 mon.a (mon.0) 3568 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:14 smithi044 bash[22676]: audit 2024-09-20T23:39:14.253469+0000 mon.a (mon.0) 3569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:14 smithi044 bash[22676]: audit 2024-09-20T23:39:14.265067+0000 mon.a (mon.0) 3570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:14 smithi044 bash[22676]: audit 2024-09-20T23:39:14.271385+0000 mon.a (mon.0) 3571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:39:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:14 smithi179 bash[23186]: cluster 2024-09-20T23:39:13.915261+0000 mgr.a (mgr.14388) 3661 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:14 smithi179 bash[23186]: audit 2024-09-20T23:39:14.243175+0000 mon.a (mon.0) 3567 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:39:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:14 smithi179 bash[23186]: audit 2024-09-20T23:39:14.250845+0000 mon.a (mon.0) 3568 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:39:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:14 smithi179 bash[23186]: audit 2024-09-20T23:39:14.253469+0000 mon.a (mon.0) 3569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:39:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:14 smithi179 bash[23186]: audit 2024-09-20T23:39:14.265067+0000 mon.a (mon.0) 3570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:14 smithi179 bash[23186]: audit 2024-09-20T23:39:14.271385+0000 mon.a (mon.0) 3571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:39:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:14 smithi049 bash[23528]: cluster 2024-09-20T23:39:13.915261+0000 mgr.a (mgr.14388) 3661 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:14 smithi049 bash[23528]: audit 2024-09-20T23:39:14.243175+0000 mon.a (mon.0) 3567 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:39:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:14 smithi049 bash[23528]: audit 2024-09-20T23:39:14.250845+0000 mon.a (mon.0) 3568 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:39:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:14 smithi049 bash[23528]: audit 2024-09-20T23:39:14.253469+0000 mon.a (mon.0) 3569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:39:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:14 smithi049 bash[23528]: audit 2024-09-20T23:39:14.265067+0000 mon.a (mon.0) 3570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:14 smithi049 bash[23528]: audit 2024-09-20T23:39:14.271385+0000 mon.a (mon.0) 3571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:39:15.470 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:15.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:15.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:15.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:15.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:15 smithi044 bash[22676]: audit 2024-09-20T23:39:14.273747+0000 mgr.a (mgr.14388) 3662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:39:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:15 smithi044 bash[22676]: audit 2024-09-20T23:39:14.896491+0000 mgr.a (mgr.14388) 3663 : audit [DBG] from='client.89889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:15 smithi179 bash[23186]: audit 2024-09-20T23:39:14.273747+0000 mgr.a (mgr.14388) 3662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:39:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:15 smithi179 bash[23186]: audit 2024-09-20T23:39:14.896491+0000 mgr.a (mgr.14388) 3663 : audit [DBG] from='client.89889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:15 smithi049 bash[23528]: audit 2024-09-20T23:39:14.273747+0000 mgr.a (mgr.14388) 3662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:39:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:15 smithi049 bash[23528]: audit 2024-09-20T23:39:14.896491+0000 mgr.a (mgr.14388) 3663 : audit [DBG] from='client.89889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:16 smithi044 bash[22676]: audit 2024-09-20T23:39:15.069203+0000 mgr.a (mgr.14388) 3664 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:39:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:16 smithi044 bash[22676]: cephadm 2024-09-20T23:39:15.080504+0000 mgr.a (mgr.14388) 3665 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:39:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:16 smithi044 bash[22676]: cluster 2024-09-20T23:39:15.917980+0000 mgr.a (mgr.14388) 3666 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:39:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:16 smithi179 bash[23186]: audit 2024-09-20T23:39:15.069203+0000 mgr.a (mgr.14388) 3664 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:39:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:16 smithi179 bash[23186]: cephadm 2024-09-20T23:39:15.080504+0000 mgr.a (mgr.14388) 3665 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:39:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:16 smithi179 bash[23186]: cluster 2024-09-20T23:39:15.917980+0000 mgr.a (mgr.14388) 3666 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:39:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:16 smithi049 bash[23528]: audit 2024-09-20T23:39:15.069203+0000 mgr.a (mgr.14388) 3664 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:39:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:16 smithi049 bash[23528]: cephadm 2024-09-20T23:39:15.080504+0000 mgr.a (mgr.14388) 3665 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:39:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:16 smithi049 bash[23528]: cluster 2024-09-20T23:39:15.917980+0000 mgr.a (mgr.14388) 3666 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:39:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:17 smithi179 bash[23186]: cluster 2024-09-20T23:39:17.918767+0000 mgr.a (mgr.14388) 3667 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:39:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:17 smithi049 bash[23528]: cluster 2024-09-20T23:39:17.918767+0000 mgr.a (mgr.14388) 3667 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:39:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:17 smithi044 bash[22676]: cluster 2024-09-20T23:39:17.918767+0000 mgr.a (mgr.14388) 3667 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:39:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:20 smithi044 bash[22676]: cluster 2024-09-20T23:39:19.919550+0000 mgr.a (mgr.14388) 3668 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:39:21.250 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:21.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:20 smithi179 bash[23186]: cluster 2024-09-20T23:39:19.919550+0000 mgr.a (mgr.14388) 3668 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:39:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:20 smithi049 bash[23528]: cluster 2024-09-20T23:39:19.919550+0000 mgr.a (mgr.14388) 3668 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:39:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:21 smithi044 bash[22676]: audit 2024-09-20T23:39:20.805408+0000 mgr.a (mgr.14388) 3669 : audit [DBG] from='client.90027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:22.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:21 smithi179 bash[23186]: audit 2024-09-20T23:39:20.805408+0000 mgr.a (mgr.14388) 3669 : audit [DBG] from='client.90027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:21 smithi049 bash[23528]: audit 2024-09-20T23:39:20.805408+0000 mgr.a (mgr.14388) 3669 : audit [DBG] from='client.90027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:22 smithi044 bash[22676]: cluster 2024-09-20T23:39:21.922362+0000 mgr.a (mgr.14388) 3670 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:39:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:22 smithi179 bash[23186]: cluster 2024-09-20T23:39:21.922362+0000 mgr.a (mgr.14388) 3670 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:39:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:22 smithi049 bash[23528]: cluster 2024-09-20T23:39:21.922362+0000 mgr.a (mgr.14388) 3670 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:39:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:23 smithi179 bash[23186]: cluster 2024-09-20T23:39:23.923141+0000 mgr.a (mgr.14388) 3671 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:39:24.289 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:23 smithi044 bash[22676]: cluster 2024-09-20T23:39:23.923141+0000 mgr.a (mgr.14388) 3671 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:39:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:23 smithi049 bash[23528]: cluster 2024-09-20T23:39:23.923141+0000 mgr.a (mgr.14388) 3671 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:39:26.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:26.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:26.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:26.289 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:26 smithi049 bash[23528]: cluster 2024-09-20T23:39:25.925134+0000 mgr.a (mgr.14388) 3672 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:39:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:26 smithi044 bash[22676]: cluster 2024-09-20T23:39:25.925134+0000 mgr.a (mgr.14388) 3672 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:39:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:26 smithi179 bash[23186]: cluster 2024-09-20T23:39:25.925134+0000 mgr.a (mgr.14388) 3672 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:39:26.995 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:26.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:26.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:26.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:26.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:27.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:27 smithi179 bash[23186]: audit 2024-09-20T23:39:26.582545+0000 mgr.a (mgr.14388) 3673 : audit [DBG] from='client.90102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:27.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:27 smithi179 bash[23186]: audit 2024-09-20T23:39:26.617227+0000 mon.a (mon.0) 3572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:27.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:27 smithi179 bash[23186]: audit 2024-09-20T23:39:26.624658+0000 mon.a (mon.0) 3573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:27.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:27 smithi179 bash[23186]: audit 2024-09-20T23:39:26.634502+0000 mon.a (mon.0) 3574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:27 smithi044 bash[22676]: audit 2024-09-20T23:39:26.582545+0000 mgr.a (mgr.14388) 3673 : audit [DBG] from='client.90102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:27 smithi044 bash[22676]: audit 2024-09-20T23:39:26.617227+0000 mon.a (mon.0) 3572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:27 smithi044 bash[22676]: audit 2024-09-20T23:39:26.624658+0000 mon.a (mon.0) 3573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:27 smithi044 bash[22676]: audit 2024-09-20T23:39:26.634502+0000 mon.a (mon.0) 3574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:27 smithi049 bash[23528]: audit 2024-09-20T23:39:26.582545+0000 mgr.a (mgr.14388) 3673 : audit [DBG] from='client.90102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:27 smithi049 bash[23528]: audit 2024-09-20T23:39:26.617227+0000 mon.a (mon.0) 3572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:27 smithi049 bash[23528]: audit 2024-09-20T23:39:26.624658+0000 mon.a (mon.0) 3573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:27 smithi049 bash[23528]: audit 2024-09-20T23:39:26.634502+0000 mon.a (mon.0) 3574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:28 smithi044 bash[22676]: cluster 2024-09-20T23:39:27.926321+0000 mgr.a (mgr.14388) 3674 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:28 smithi044 bash[22676]: audit 2024-09-20T23:39:27.942446+0000 mon.a (mon.0) 3575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:28 smithi044 bash[22676]: audit 2024-09-20T23:39:27.951432+0000 mon.a (mon.0) 3576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:28 smithi044 bash[22676]: audit 2024-09-20T23:39:27.963685+0000 mon.a (mon.0) 3577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:28 smithi179 bash[23186]: cluster 2024-09-20T23:39:27.926321+0000 mgr.a (mgr.14388) 3674 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:28 smithi179 bash[23186]: audit 2024-09-20T23:39:27.942446+0000 mon.a (mon.0) 3575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:28 smithi179 bash[23186]: audit 2024-09-20T23:39:27.951432+0000 mon.a (mon.0) 3576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:28 smithi179 bash[23186]: audit 2024-09-20T23:39:27.963685+0000 mon.a (mon.0) 3577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:28 smithi049 bash[23528]: cluster 2024-09-20T23:39:27.926321+0000 mgr.a (mgr.14388) 3674 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:28 smithi049 bash[23528]: audit 2024-09-20T23:39:27.942446+0000 mon.a (mon.0) 3575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:28 smithi049 bash[23528]: audit 2024-09-20T23:39:27.951432+0000 mon.a (mon.0) 3576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:28 smithi049 bash[23528]: audit 2024-09-20T23:39:27.963685+0000 mon.a (mon.0) 3577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:30 smithi044 bash[22676]: audit 2024-09-20T23:39:29.409239+0000 mon.a (mon.0) 3578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:30 smithi044 bash[22676]: audit 2024-09-20T23:39:29.418036+0000 mon.a (mon.0) 3579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:30 smithi044 bash[22676]: audit 2024-09-20T23:39:29.429694+0000 mon.a (mon.0) 3580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:30 smithi044 bash[22676]: cluster 2024-09-20T23:39:29.927138+0000 mgr.a (mgr.14388) 3675 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:30 smithi179 bash[23186]: audit 2024-09-20T23:39:29.409239+0000 mon.a (mon.0) 3578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:30 smithi179 bash[23186]: audit 2024-09-20T23:39:29.418036+0000 mon.a (mon.0) 3579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:30 smithi179 bash[23186]: audit 2024-09-20T23:39:29.429694+0000 mon.a (mon.0) 3580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:30 smithi179 bash[23186]: cluster 2024-09-20T23:39:29.927138+0000 mgr.a (mgr.14388) 3675 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:30 smithi049 bash[23528]: audit 2024-09-20T23:39:29.409239+0000 mon.a (mon.0) 3578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:30 smithi049 bash[23528]: audit 2024-09-20T23:39:29.418036+0000 mon.a (mon.0) 3579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:30 smithi049 bash[23528]: audit 2024-09-20T23:39:29.429694+0000 mon.a (mon.0) 3580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:30 smithi049 bash[23528]: cluster 2024-09-20T23:39:29.927138+0000 mgr.a (mgr.14388) 3675 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:32 smithi049 bash[23528]: cluster 2024-09-20T23:39:31.929365+0000 mgr.a (mgr.14388) 3676 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:32 smithi044 bash[22676]: cluster 2024-09-20T23:39:31.929365+0000 mgr.a (mgr.14388) 3676 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:32 smithi179 bash[23186]: cluster 2024-09-20T23:39:31.929365+0000 mgr.a (mgr.14388) 3676 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-20T23:39:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:32.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:32.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:32.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:32.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:33 smithi049 bash[23528]: audit 2024-09-20T23:39:32.339443+0000 mgr.a (mgr.14388) 3677 : audit [DBG] from='client.90177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:33 smithi044 bash[22676]: audit 2024-09-20T23:39:32.339443+0000 mgr.a (mgr.14388) 3677 : audit [DBG] from='client.90177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:33 smithi179 bash[23186]: audit 2024-09-20T23:39:32.339443+0000 mgr.a (mgr.14388) 3677 : audit [DBG] from='client.90177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:34 smithi049 bash[23528]: cluster 2024-09-20T23:39:33.930400+0000 mgr.a (mgr.14388) 3678 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:34 smithi044 bash[22676]: cluster 2024-09-20T23:39:33.930400+0000 mgr.a (mgr.14388) 3678 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:34 smithi179 bash[23186]: cluster 2024-09-20T23:39:33.930400+0000 mgr.a (mgr.14388) 3678 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:36 smithi049 bash[23528]: cluster 2024-09-20T23:39:35.932769+0000 mgr.a (mgr.14388) 3679 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:36 smithi044 bash[22676]: cluster 2024-09-20T23:39:35.932769+0000 mgr.a (mgr.14388) 3679 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:36 smithi179 bash[23186]: cluster 2024-09-20T23:39:35.932769+0000 mgr.a (mgr.14388) 3679 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:37.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:38 smithi179 bash[23186]: cluster 2024-09-20T23:39:37.933323+0000 mgr.a (mgr.14388) 3680 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:38 smithi049 bash[23528]: cluster 2024-09-20T23:39:37.933323+0000 mgr.a (mgr.14388) 3680 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:38 smithi044 bash[22676]: cluster 2024-09-20T23:39:37.933323+0000 mgr.a (mgr.14388) 3680 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:38.580 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:38.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:38.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:38.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:38.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:39 smithi049 bash[23528]: audit 2024-09-20T23:39:38.135352+0000 mgr.a (mgr.14388) 3681 : audit [DBG] from='client.90255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:39.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:39 smithi179 bash[23186]: audit 2024-09-20T23:39:38.135352+0000 mgr.a (mgr.14388) 3681 : audit [DBG] from='client.90255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:39 smithi044 bash[22676]: audit 2024-09-20T23:39:38.135352+0000 mgr.a (mgr.14388) 3681 : audit [DBG] from='client.90255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:40 smithi049 bash[23528]: cluster 2024-09-20T23:39:39.934185+0000 mgr.a (mgr.14388) 3682 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:40.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:40 smithi179 bash[23186]: cluster 2024-09-20T23:39:39.934185+0000 mgr.a (mgr.14388) 3682 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:40 smithi044 bash[22676]: cluster 2024-09-20T23:39:39.934185+0000 mgr.a (mgr.14388) 3682 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:42 smithi049 bash[23528]: cluster 2024-09-20T23:39:41.936431+0000 mgr.a (mgr.14388) 3683 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:42 smithi044 bash[22676]: cluster 2024-09-20T23:39:41.936431+0000 mgr.a (mgr.14388) 3683 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:42 smithi179 bash[23186]: cluster 2024-09-20T23:39:41.936431+0000 mgr.a (mgr.14388) 3683 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:43.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:43.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:43.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:44 smithi044 bash[22676]: audit 2024-09-20T23:39:43.897509+0000 mgr.a (mgr.14388) 3684 : audit [DBG] from='client.90333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:44 smithi044 bash[22676]: cluster 2024-09-20T23:39:43.937505+0000 mgr.a (mgr.14388) 3685 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:44 smithi049 bash[23528]: audit 2024-09-20T23:39:43.897509+0000 mgr.a (mgr.14388) 3684 : audit [DBG] from='client.90333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:44 smithi049 bash[23528]: cluster 2024-09-20T23:39:43.937505+0000 mgr.a (mgr.14388) 3685 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:44.333 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:44.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:44 smithi179 bash[23186]: audit 2024-09-20T23:39:43.897509+0000 mgr.a (mgr.14388) 3684 : audit [DBG] from='client.90333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:44 smithi179 bash[23186]: cluster 2024-09-20T23:39:43.937505+0000 mgr.a (mgr.14388) 3685 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:46 smithi049 bash[23528]: cluster 2024-09-20T23:39:45.939996+0000 mgr.a (mgr.14388) 3686 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:46 smithi044 bash[22676]: cluster 2024-09-20T23:39:45.939996+0000 mgr.a (mgr.14388) 3686 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:46 smithi179 bash[23186]: cluster 2024-09-20T23:39:45.939996+0000 mgr.a (mgr.14388) 3686 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:39:48.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:47 smithi179 bash[23186]: audit 2024-09-20T23:39:46.835907+0000 mon.a (mon.0) 3581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:47 smithi179 bash[23186]: audit 2024-09-20T23:39:46.844659+0000 mon.a (mon.0) 3582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:47 smithi179 bash[23186]: audit 2024-09-20T23:39:46.855348+0000 mon.a (mon.0) 3583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:47 smithi044 bash[22676]: audit 2024-09-20T23:39:46.835907+0000 mon.a (mon.0) 3581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:47 smithi044 bash[22676]: audit 2024-09-20T23:39:46.844659+0000 mon.a (mon.0) 3582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:47 smithi044 bash[22676]: audit 2024-09-20T23:39:46.855348+0000 mon.a (mon.0) 3583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:47 smithi049 bash[23528]: audit 2024-09-20T23:39:46.835907+0000 mon.a (mon.0) 3581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:47 smithi049 bash[23528]: audit 2024-09-20T23:39:46.844659+0000 mon.a (mon.0) 3582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:47 smithi049 bash[23528]: audit 2024-09-20T23:39:46.855348+0000 mon.a (mon.0) 3583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:48 smithi049 bash[23528]: cluster 2024-09-20T23:39:47.940647+0000 mgr.a (mgr.14388) 3687 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:48 smithi049 bash[23528]: audit 2024-09-20T23:39:48.176829+0000 mon.a (mon.0) 3584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:48 smithi049 bash[23528]: audit 2024-09-20T23:39:48.185103+0000 mon.a (mon.0) 3585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:48 smithi049 bash[23528]: audit 2024-09-20T23:39:48.195102+0000 mon.a (mon.0) 3586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:48 smithi044 bash[22676]: cluster 2024-09-20T23:39:47.940647+0000 mgr.a (mgr.14388) 3687 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:48 smithi044 bash[22676]: audit 2024-09-20T23:39:48.176829+0000 mon.a (mon.0) 3584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:48 smithi044 bash[22676]: audit 2024-09-20T23:39:48.185103+0000 mon.a (mon.0) 3585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:48 smithi044 bash[22676]: audit 2024-09-20T23:39:48.195102+0000 mon.a (mon.0) 3586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:48 smithi179 bash[23186]: cluster 2024-09-20T23:39:47.940647+0000 mgr.a (mgr.14388) 3687 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:48 smithi179 bash[23186]: audit 2024-09-20T23:39:48.176829+0000 mon.a (mon.0) 3584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:48 smithi179 bash[23186]: audit 2024-09-20T23:39:48.185103+0000 mon.a (mon.0) 3585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:48 smithi179 bash[23186]: audit 2024-09-20T23:39:48.195102+0000 mon.a (mon.0) 3586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:49.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:49.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:49.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:50.110 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:50.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:50.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:50.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:50.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:50 smithi044 bash[22676]: audit 2024-09-20T23:39:49.555146+0000 mon.a (mon.0) 3587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:50 smithi044 bash[22676]: audit 2024-09-20T23:39:49.560478+0000 mon.a (mon.0) 3588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:50 smithi044 bash[22676]: audit 2024-09-20T23:39:49.565818+0000 mon.a (mon.0) 3589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:50 smithi044 bash[22676]: audit 2024-09-20T23:39:49.673852+0000 mgr.a (mgr.14388) 3688 : audit [DBG] from='client.90411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:50 smithi044 bash[22676]: cluster 2024-09-20T23:39:49.941328+0000 mgr.a (mgr.14388) 3689 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:50 smithi179 bash[23186]: audit 2024-09-20T23:39:49.555146+0000 mon.a (mon.0) 3587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:50 smithi179 bash[23186]: audit 2024-09-20T23:39:49.560478+0000 mon.a (mon.0) 3588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:50 smithi179 bash[23186]: audit 2024-09-20T23:39:49.565818+0000 mon.a (mon.0) 3589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:50 smithi179 bash[23186]: audit 2024-09-20T23:39:49.673852+0000 mgr.a (mgr.14388) 3688 : audit [DBG] from='client.90411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:50 smithi179 bash[23186]: cluster 2024-09-20T23:39:49.941328+0000 mgr.a (mgr.14388) 3689 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:50 smithi049 bash[23528]: audit 2024-09-20T23:39:49.555146+0000 mon.a (mon.0) 3587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:50 smithi049 bash[23528]: audit 2024-09-20T23:39:49.560478+0000 mon.a (mon.0) 3588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:50 smithi049 bash[23528]: audit 2024-09-20T23:39:49.565818+0000 mon.a (mon.0) 3589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:39:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:50 smithi049 bash[23528]: audit 2024-09-20T23:39:49.673852+0000 mgr.a (mgr.14388) 3688 : audit [DBG] from='client.90411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:50 smithi049 bash[23528]: cluster 2024-09-20T23:39:49.941328+0000 mgr.a (mgr.14388) 3689 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:52 smithi049 bash[23528]: cluster 2024-09-20T23:39:51.944009+0000 mgr.a (mgr.14388) 3690 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:39:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:52 smithi044 bash[22676]: cluster 2024-09-20T23:39:51.944009+0000 mgr.a (mgr.14388) 3690 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:39:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:52 smithi179 bash[23186]: cluster 2024-09-20T23:39:51.944009+0000 mgr.a (mgr.14388) 3690 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:39:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:54 smithi049 bash[23528]: cluster 2024-09-20T23:39:53.944781+0000 mgr.a (mgr.14388) 3691 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:39:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:54 smithi044 bash[22676]: cluster 2024-09-20T23:39:53.944781+0000 mgr.a (mgr.14388) 3691 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:39:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:54 smithi179 bash[23186]: cluster 2024-09-20T23:39:53.944781+0000 mgr.a (mgr.14388) 3691 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:39:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:39:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:39:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:39:55.899 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:39:55.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:39:55.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:39:55.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:39:55.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:39:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:56 smithi049 bash[23528]: audit 2024-09-20T23:39:55.445628+0000 mgr.a (mgr.14388) 3692 : audit [DBG] from='client.90486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:56 smithi049 bash[23528]: cluster 2024-09-20T23:39:55.946036+0000 mgr.a (mgr.14388) 3693 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:56 smithi044 bash[22676]: audit 2024-09-20T23:39:55.445628+0000 mgr.a (mgr.14388) 3692 : audit [DBG] from='client.90486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:56 smithi044 bash[22676]: cluster 2024-09-20T23:39:55.946036+0000 mgr.a (mgr.14388) 3693 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:56 smithi179 bash[23186]: audit 2024-09-20T23:39:55.445628+0000 mgr.a (mgr.14388) 3692 : audit [DBG] from='client.90486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:39:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:56 smithi179 bash[23186]: cluster 2024-09-20T23:39:55.946036+0000 mgr.a (mgr.14388) 3693 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:39:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:39:58 smithi049 bash[23528]: cluster 2024-09-20T23:39:57.946758+0000 mgr.a (mgr.14388) 3694 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:39:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:39:58 smithi044 bash[22676]: cluster 2024-09-20T23:39:57.946758+0000 mgr.a (mgr.14388) 3694 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:39:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:39:58 smithi179 bash[23186]: cluster 2024-09-20T23:39:57.946758+0000 mgr.a (mgr.14388) 3694 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:00 smithi049 bash[23528]: cluster 2024-09-20T23:39:59.947656+0000 mgr.a (mgr.14388) 3695 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:00 smithi049 bash[23528]: cluster 2024-09-20T23:40:00.000161+0000 mon.a (mon.0) 3590 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:40:00.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:00 smithi179 bash[23186]: cluster 2024-09-20T23:39:59.947656+0000 mgr.a (mgr.14388) 3695 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:00.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:00 smithi179 bash[23186]: cluster 2024-09-20T23:40:00.000161+0000 mon.a (mon.0) 3590 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:40:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:00 smithi044 bash[22676]: cluster 2024-09-20T23:39:59.947656+0000 mgr.a (mgr.14388) 3695 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:00 smithi044 bash[22676]: cluster 2024-09-20T23:40:00.000161+0000 mon.a (mon.0) 3590 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:40:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:00.901 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:00.901 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:01.657 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:01.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:01.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:01.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:01.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:02 smithi049 bash[23528]: audit 2024-09-20T23:40:01.234265+0000 mgr.a (mgr.14388) 3696 : audit [DBG] from='client.90561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:02 smithi049 bash[23528]: cluster 2024-09-20T23:40:01.950522+0000 mgr.a (mgr.14388) 3697 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:02 smithi044 bash[22676]: audit 2024-09-20T23:40:01.234265+0000 mgr.a (mgr.14388) 3696 : audit [DBG] from='client.90561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:02 smithi044 bash[22676]: cluster 2024-09-20T23:40:01.950522+0000 mgr.a (mgr.14388) 3697 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:02 smithi179 bash[23186]: audit 2024-09-20T23:40:01.234265+0000 mgr.a (mgr.14388) 3696 : audit [DBG] from='client.90561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:02 smithi179 bash[23186]: cluster 2024-09-20T23:40:01.950522+0000 mgr.a (mgr.14388) 3697 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:04 smithi049 bash[23528]: cluster 2024-09-20T23:40:03.951364+0000 mgr.a (mgr.14388) 3698 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:40:04.377 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:04 smithi044 bash[22676]: cluster 2024-09-20T23:40:03.951364+0000 mgr.a (mgr.14388) 3698 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:40:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:04 smithi179 bash[23186]: cluster 2024-09-20T23:40:03.951364+0000 mgr.a (mgr.14388) 3698 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:40:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:06 smithi044 bash[22676]: cluster 2024-09-20T23:40:05.952867+0000 mgr.a (mgr.14388) 3699 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:40:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:06 smithi049 bash[23528]: cluster 2024-09-20T23:40:05.952867+0000 mgr.a (mgr.14388) 3699 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:40:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:06 smithi179 bash[23186]: cluster 2024-09-20T23:40:05.952867+0000 mgr.a (mgr.14388) 3699 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:40:06.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:06.659 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:06.659 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:07.431 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:07.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:07.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:07.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:07.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:08.337 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:08 smithi049 bash[23528]: audit 2024-09-20T23:40:06.996322+0000 mgr.a (mgr.14388) 3700 : audit [DBG] from='client.90636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:08.337 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:08 smithi049 bash[23528]: audit 2024-09-20T23:40:07.063450+0000 mon.a (mon.0) 3591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.337 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:08 smithi049 bash[23528]: audit 2024-09-20T23:40:07.068805+0000 mon.a (mon.0) 3592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.338 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:08 smithi049 bash[23528]: audit 2024-09-20T23:40:07.075589+0000 mon.a (mon.0) 3593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.338 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:08 smithi049 bash[23528]: cluster 2024-09-20T23:40:07.953750+0000 mgr.a (mgr.14388) 3701 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:08.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:08 smithi179 bash[23186]: audit 2024-09-20T23:40:06.996322+0000 mgr.a (mgr.14388) 3700 : audit [DBG] from='client.90636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:08.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:08 smithi179 bash[23186]: audit 2024-09-20T23:40:07.063450+0000 mon.a (mon.0) 3591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:08 smithi179 bash[23186]: audit 2024-09-20T23:40:07.068805+0000 mon.a (mon.0) 3592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:08 smithi179 bash[23186]: audit 2024-09-20T23:40:07.075589+0000 mon.a (mon.0) 3593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:08 smithi179 bash[23186]: cluster 2024-09-20T23:40:07.953750+0000 mgr.a (mgr.14388) 3701 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:08 smithi044 bash[22676]: audit 2024-09-20T23:40:06.996322+0000 mgr.a (mgr.14388) 3700 : audit [DBG] from='client.90636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:08 smithi044 bash[22676]: audit 2024-09-20T23:40:07.063450+0000 mon.a (mon.0) 3591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:08 smithi044 bash[22676]: audit 2024-09-20T23:40:07.068805+0000 mon.a (mon.0) 3592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:08 smithi044 bash[22676]: audit 2024-09-20T23:40:07.075589+0000 mon.a (mon.0) 3593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:08 smithi044 bash[22676]: cluster 2024-09-20T23:40:07.953750+0000 mgr.a (mgr.14388) 3701 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:09 smithi044 bash[22676]: audit 2024-09-20T23:40:08.401115+0000 mon.a (mon.0) 3594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:09 smithi044 bash[22676]: audit 2024-09-20T23:40:08.410885+0000 mon.a (mon.0) 3595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:09 smithi044 bash[22676]: audit 2024-09-20T23:40:08.422737+0000 mon.a (mon.0) 3596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:09 smithi179 bash[23186]: audit 2024-09-20T23:40:08.401115+0000 mon.a (mon.0) 3594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:09 smithi179 bash[23186]: audit 2024-09-20T23:40:08.410885+0000 mon.a (mon.0) 3595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:09 smithi179 bash[23186]: audit 2024-09-20T23:40:08.422737+0000 mon.a (mon.0) 3596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:09 smithi049 bash[23528]: audit 2024-09-20T23:40:08.401115+0000 mon.a (mon.0) 3594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:09 smithi049 bash[23528]: audit 2024-09-20T23:40:08.410885+0000 mon.a (mon.0) 3595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:09 smithi049 bash[23528]: audit 2024-09-20T23:40:08.422737+0000 mon.a (mon.0) 3596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:10 smithi049 bash[23528]: audit 2024-09-20T23:40:09.782375+0000 mon.a (mon.0) 3597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:10 smithi049 bash[23528]: audit 2024-09-20T23:40:09.790119+0000 mon.a (mon.0) 3598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:10 smithi049 bash[23528]: audit 2024-09-20T23:40:09.798564+0000 mon.a (mon.0) 3599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:10 smithi049 bash[23528]: cluster 2024-09-20T23:40:09.954574+0000 mgr.a (mgr.14388) 3702 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:10 smithi044 bash[22676]: audit 2024-09-20T23:40:09.782375+0000 mon.a (mon.0) 3597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:10 smithi044 bash[22676]: audit 2024-09-20T23:40:09.790119+0000 mon.a (mon.0) 3598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:10 smithi044 bash[22676]: audit 2024-09-20T23:40:09.798564+0000 mon.a (mon.0) 3599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:10 smithi044 bash[22676]: cluster 2024-09-20T23:40:09.954574+0000 mgr.a (mgr.14388) 3702 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:10 smithi179 bash[23186]: audit 2024-09-20T23:40:09.782375+0000 mon.a (mon.0) 3597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:10 smithi179 bash[23186]: audit 2024-09-20T23:40:09.790119+0000 mon.a (mon.0) 3598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:10 smithi179 bash[23186]: audit 2024-09-20T23:40:09.798564+0000 mon.a (mon.0) 3599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:10 smithi179 bash[23186]: cluster 2024-09-20T23:40:09.954574+0000 mgr.a (mgr.14388) 3702 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:12 smithi049 bash[23528]: cluster 2024-09-20T23:40:11.956854+0000 mgr.a (mgr.14388) 3703 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:12.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:12.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:12.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:12 smithi044 bash[22676]: cluster 2024-09-20T23:40:11.956854+0000 mgr.a (mgr.14388) 3703 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:12 smithi179 bash[23186]: cluster 2024-09-20T23:40:11.956854+0000 mgr.a (mgr.14388) 3703 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:13.204 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:13 smithi049 bash[23528]: audit 2024-09-20T23:40:12.768824+0000 mgr.a (mgr.14388) 3704 : audit [DBG] from='client.90711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:13 smithi044 bash[22676]: audit 2024-09-20T23:40:12.768824+0000 mgr.a (mgr.14388) 3704 : audit [DBG] from='client.90711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:13 smithi179 bash[23186]: audit 2024-09-20T23:40:12.768824+0000 mgr.a (mgr.14388) 3704 : audit [DBG] from='client.90711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:14 smithi049 bash[23528]: cluster 2024-09-20T23:40:13.957912+0000 mgr.a (mgr.14388) 3705 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:14 smithi044 bash[22676]: cluster 2024-09-20T23:40:13.957912+0000 mgr.a (mgr.14388) 3705 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:14 smithi179 bash[23186]: cluster 2024-09-20T23:40:13.957912+0000 mgr.a (mgr.14388) 3705 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:15 smithi044 bash[22676]: audit 2024-09-20T23:40:15.141959+0000 mon.a (mon.0) 3600 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:40:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:15 smithi044 bash[22676]: audit 2024-09-20T23:40:15.149374+0000 mon.a (mon.0) 3601 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:40:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:15 smithi044 bash[22676]: audit 2024-09-20T23:40:15.151247+0000 mon.a (mon.0) 3602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:40:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:15 smithi044 bash[22676]: audit 2024-09-20T23:40:15.162734+0000 mon.a (mon.0) 3603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:15 smithi044 bash[22676]: audit 2024-09-20T23:40:15.169241+0000 mon.a (mon.0) 3604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:40:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:15 smithi179 bash[23186]: audit 2024-09-20T23:40:15.141959+0000 mon.a (mon.0) 3600 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:40:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:15 smithi179 bash[23186]: audit 2024-09-20T23:40:15.149374+0000 mon.a (mon.0) 3601 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:40:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:15 smithi179 bash[23186]: audit 2024-09-20T23:40:15.151247+0000 mon.a (mon.0) 3602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:40:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:15 smithi179 bash[23186]: audit 2024-09-20T23:40:15.162734+0000 mon.a (mon.0) 3603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:15 smithi179 bash[23186]: audit 2024-09-20T23:40:15.169241+0000 mon.a (mon.0) 3604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:40:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:15 smithi049 bash[23528]: audit 2024-09-20T23:40:15.141959+0000 mon.a (mon.0) 3600 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:40:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:15 smithi049 bash[23528]: audit 2024-09-20T23:40:15.149374+0000 mon.a (mon.0) 3601 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:40:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:15 smithi049 bash[23528]: audit 2024-09-20T23:40:15.151247+0000 mon.a (mon.0) 3602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:40:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:15 smithi049 bash[23528]: audit 2024-09-20T23:40:15.162734+0000 mon.a (mon.0) 3603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:15 smithi049 bash[23528]: audit 2024-09-20T23:40:15.169241+0000 mon.a (mon.0) 3604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:40:16.198 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:40:15 smithi044 bash[22930]: debug 2024-09-20T23:40:15.944+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:40:16.198 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:40:15 smithi044 bash[22930]: debug 2024-09-20T23:40:15.944+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:40:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:16 smithi044 bash[22676]: audit 2024-09-20T23:40:15.171725+0000 mgr.a (mgr.14388) 3706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:40:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:16 smithi044 bash[22676]: audit 2024-09-20T23:40:15.946611+0000 mgr.a (mgr.14388) 3707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:40:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:16 smithi044 bash[22676]: cephadm 2024-09-20T23:40:15.948047+0000 mgr.a (mgr.14388) 3708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:40:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:16 smithi044 bash[22676]: cluster 2024-09-20T23:40:15.959790+0000 mgr.a (mgr.14388) 3709 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:16 smithi179 bash[23186]: audit 2024-09-20T23:40:15.171725+0000 mgr.a (mgr.14388) 3706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:40:16.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:16 smithi179 bash[23186]: audit 2024-09-20T23:40:15.946611+0000 mgr.a (mgr.14388) 3707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:40:16.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:16 smithi179 bash[23186]: cephadm 2024-09-20T23:40:15.948047+0000 mgr.a (mgr.14388) 3708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:40:16.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:16 smithi179 bash[23186]: cluster 2024-09-20T23:40:15.959790+0000 mgr.a (mgr.14388) 3709 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:16 smithi049 bash[23528]: audit 2024-09-20T23:40:15.171725+0000 mgr.a (mgr.14388) 3706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:40:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:16 smithi049 bash[23528]: audit 2024-09-20T23:40:15.946611+0000 mgr.a (mgr.14388) 3707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:40:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:16 smithi049 bash[23528]: cephadm 2024-09-20T23:40:15.948047+0000 mgr.a (mgr.14388) 3708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:40:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:16 smithi049 bash[23528]: cluster 2024-09-20T23:40:15.959790+0000 mgr.a (mgr.14388) 3709 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:18.136 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:18 smithi179 bash[23186]: cluster 2024-09-20T23:40:17.960584+0000 mgr.a (mgr.14388) 3710 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:18.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:18.207 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:18.207 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:18 smithi049 bash[23528]: cluster 2024-09-20T23:40:17.960584+0000 mgr.a (mgr.14388) 3710 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:18 smithi044 bash[22676]: cluster 2024-09-20T23:40:17.960584+0000 mgr.a (mgr.14388) 3710 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:19 smithi049 bash[23528]: audit 2024-09-20T23:40:18.558455+0000 mgr.a (mgr.14388) 3711 : audit [DBG] from='client.90894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:19 smithi044 bash[22676]: audit 2024-09-20T23:40:18.558455+0000 mgr.a (mgr.14388) 3711 : audit [DBG] from='client.90894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:19 smithi179 bash[23186]: audit 2024-09-20T23:40:18.558455+0000 mgr.a (mgr.14388) 3711 : audit [DBG] from='client.90894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:20 smithi049 bash[23528]: cluster 2024-09-20T23:40:19.961573+0000 mgr.a (mgr.14388) 3712 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:20.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:20 smithi179 bash[23186]: cluster 2024-09-20T23:40:19.961573+0000 mgr.a (mgr.14388) 3712 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:20 smithi044 bash[22676]: cluster 2024-09-20T23:40:19.961573+0000 mgr.a (mgr.14388) 3712 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:22 smithi049 bash[23528]: cluster 2024-09-20T23:40:21.963740+0000 mgr.a (mgr.14388) 3713 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:22.404 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:22 smithi179 bash[23186]: cluster 2024-09-20T23:40:21.963740+0000 mgr.a (mgr.14388) 3713 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:22 smithi044 bash[22676]: cluster 2024-09-20T23:40:21.963740+0000 mgr.a (mgr.14388) 3713 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:23.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:23.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:23.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:24 smithi049 bash[23528]: cluster 2024-09-20T23:40:23.964528+0000 mgr.a (mgr.14388) 3714 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:24.364 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:24 smithi044 bash[22676]: cluster 2024-09-20T23:40:23.964528+0000 mgr.a (mgr.14388) 3714 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:24 smithi179 bash[23186]: cluster 2024-09-20T23:40:23.964528+0000 mgr.a (mgr.14388) 3714 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:24.776 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:24.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:24.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:24.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:24.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:25 smithi049 bash[23528]: audit 2024-09-20T23:40:24.329290+0000 mgr.a (mgr.14388) 3715 : audit [DBG] from='client.90960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:25.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:25 smithi044 bash[22676]: audit 2024-09-20T23:40:24.329290+0000 mgr.a (mgr.14388) 3715 : audit [DBG] from='client.90960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:25 smithi179 bash[23186]: audit 2024-09-20T23:40:24.329290+0000 mgr.a (mgr.14388) 3715 : audit [DBG] from='client.90960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:26 smithi044 bash[22676]: cluster 2024-09-20T23:40:25.966988+0000 mgr.a (mgr.14388) 3716 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:26 smithi179 bash[23186]: cluster 2024-09-20T23:40:25.966988+0000 mgr.a (mgr.14388) 3716 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:26 smithi049 bash[23528]: cluster 2024-09-20T23:40:25.966988+0000 mgr.a (mgr.14388) 3716 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:28 smithi179 bash[23186]: audit 2024-09-20T23:40:27.238525+0000 mon.a (mon.0) 3605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:28 smithi179 bash[23186]: audit 2024-09-20T23:40:27.243846+0000 mon.a (mon.0) 3606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:28 smithi179 bash[23186]: audit 2024-09-20T23:40:27.249470+0000 mon.a (mon.0) 3607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:28 smithi179 bash[23186]: cluster 2024-09-20T23:40:27.967726+0000 mgr.a (mgr.14388) 3717 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:28 smithi049 bash[23528]: audit 2024-09-20T23:40:27.238525+0000 mon.a (mon.0) 3605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:28 smithi049 bash[23528]: audit 2024-09-20T23:40:27.243846+0000 mon.a (mon.0) 3606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:28 smithi049 bash[23528]: audit 2024-09-20T23:40:27.249470+0000 mon.a (mon.0) 3607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:28 smithi049 bash[23528]: cluster 2024-09-20T23:40:27.967726+0000 mgr.a (mgr.14388) 3717 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:28 smithi044 bash[22676]: audit 2024-09-20T23:40:27.238525+0000 mon.a (mon.0) 3605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:28 smithi044 bash[22676]: audit 2024-09-20T23:40:27.243846+0000 mon.a (mon.0) 3606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:28 smithi044 bash[22676]: audit 2024-09-20T23:40:27.249470+0000 mon.a (mon.0) 3607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:28 smithi044 bash[22676]: cluster 2024-09-20T23:40:27.967726+0000 mgr.a (mgr.14388) 3717 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:29.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:29.778 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:29.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:29.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:29 smithi044 bash[22676]: audit 2024-09-20T23:40:28.628465+0000 mon.a (mon.0) 3608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:29.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:29 smithi044 bash[22676]: audit 2024-09-20T23:40:28.637206+0000 mon.a (mon.0) 3609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:29.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:29 smithi044 bash[22676]: audit 2024-09-20T23:40:28.647459+0000 mon.a (mon.0) 3610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:29 smithi179 bash[23186]: audit 2024-09-20T23:40:28.628465+0000 mon.a (mon.0) 3608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:29 smithi179 bash[23186]: audit 2024-09-20T23:40:28.637206+0000 mon.a (mon.0) 3609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:29 smithi179 bash[23186]: audit 2024-09-20T23:40:28.647459+0000 mon.a (mon.0) 3610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:29 smithi049 bash[23528]: audit 2024-09-20T23:40:28.628465+0000 mon.a (mon.0) 3608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:29 smithi049 bash[23528]: audit 2024-09-20T23:40:28.637206+0000 mon.a (mon.0) 3609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:29 smithi049 bash[23528]: audit 2024-09-20T23:40:28.647459+0000 mon.a (mon.0) 3610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:30.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:30 smithi044 bash[22676]: audit 2024-09-20T23:40:29.951083+0000 mon.a (mon.0) 3611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:30 smithi044 bash[22676]: audit 2024-09-20T23:40:29.955788+0000 mon.a (mon.0) 3612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:30 smithi044 bash[22676]: audit 2024-09-20T23:40:29.962269+0000 mon.a (mon.0) 3613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:30 smithi044 bash[22676]: cluster 2024-09-20T23:40:29.968142+0000 mgr.a (mgr.14388) 3718 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:30 smithi179 bash[23186]: audit 2024-09-20T23:40:29.951083+0000 mon.a (mon.0) 3611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:30 smithi179 bash[23186]: audit 2024-09-20T23:40:29.955788+0000 mon.a (mon.0) 3612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:30 smithi179 bash[23186]: audit 2024-09-20T23:40:29.962269+0000 mon.a (mon.0) 3613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:30 smithi179 bash[23186]: cluster 2024-09-20T23:40:29.968142+0000 mgr.a (mgr.14388) 3718 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:30 smithi049 bash[23528]: audit 2024-09-20T23:40:29.951083+0000 mon.a (mon.0) 3611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:30 smithi049 bash[23528]: audit 2024-09-20T23:40:29.955788+0000 mon.a (mon.0) 3612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:30 smithi049 bash[23528]: audit 2024-09-20T23:40:29.962269+0000 mon.a (mon.0) 3613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:30 smithi049 bash[23528]: cluster 2024-09-20T23:40:29.968142+0000 mgr.a (mgr.14388) 3718 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:31 smithi044 bash[22676]: audit 2024-09-20T23:40:30.115577+0000 mgr.a (mgr.14388) 3719 : audit [DBG] from='client.91035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:31 smithi179 bash[23186]: audit 2024-09-20T23:40:30.115577+0000 mgr.a (mgr.14388) 3719 : audit [DBG] from='client.91035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:31 smithi049 bash[23528]: audit 2024-09-20T23:40:30.115577+0000 mgr.a (mgr.14388) 3719 : audit [DBG] from='client.91035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:32 smithi044 bash[22676]: cluster 2024-09-20T23:40:31.971031+0000 mgr.a (mgr.14388) 3720 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:32 smithi179 bash[23186]: cluster 2024-09-20T23:40:31.971031+0000 mgr.a (mgr.14388) 3720 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:32 smithi049 bash[23528]: cluster 2024-09-20T23:40:31.971031+0000 mgr.a (mgr.14388) 3720 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:40:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:34 smithi044 bash[22676]: cluster 2024-09-20T23:40:33.971833+0000 mgr.a (mgr.14388) 3721 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:40:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:34 smithi179 bash[23186]: cluster 2024-09-20T23:40:33.971833+0000 mgr.a (mgr.14388) 3721 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:40:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:34 smithi049 bash[23528]: cluster 2024-09-20T23:40:33.971833+0000 mgr.a (mgr.14388) 3721 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:40:35.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:35.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:35.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:36.281 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:36.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:36.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:36.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:36.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:36 smithi044 bash[22676]: audit 2024-09-20T23:40:35.874320+0000 mgr.a (mgr.14388) 3722 : audit [DBG] from='client.91113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:36 smithi044 bash[22676]: cluster 2024-09-20T23:40:35.973025+0000 mgr.a (mgr.14388) 3723 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:36 smithi179 bash[23186]: audit 2024-09-20T23:40:35.874320+0000 mgr.a (mgr.14388) 3722 : audit [DBG] from='client.91113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:36 smithi179 bash[23186]: cluster 2024-09-20T23:40:35.973025+0000 mgr.a (mgr.14388) 3723 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:36 smithi049 bash[23528]: audit 2024-09-20T23:40:35.874320+0000 mgr.a (mgr.14388) 3722 : audit [DBG] from='client.91113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:36 smithi049 bash[23528]: cluster 2024-09-20T23:40:35.973025+0000 mgr.a (mgr.14388) 3723 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:38 smithi179 bash[23186]: cluster 2024-09-20T23:40:37.973934+0000 mgr.a (mgr.14388) 3724 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:38 smithi044 bash[22676]: cluster 2024-09-20T23:40:37.973934+0000 mgr.a (mgr.14388) 3724 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:38 smithi049 bash[23528]: cluster 2024-09-20T23:40:37.973934+0000 mgr.a (mgr.14388) 3724 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:40 smithi179 bash[23186]: cluster 2024-09-20T23:40:39.974717+0000 mgr.a (mgr.14388) 3725 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:41.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:41.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:41.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:40 smithi049 bash[23528]: cluster 2024-09-20T23:40:39.974717+0000 mgr.a (mgr.14388) 3725 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:40 smithi044 bash[22676]: cluster 2024-09-20T23:40:39.974717+0000 mgr.a (mgr.14388) 3725 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:40:42.067 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:42.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:42.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:42.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:42.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:42 smithi049 bash[23528]: audit 2024-09-20T23:40:41.622942+0000 mgr.a (mgr.14388) 3726 : audit [DBG] from='client.91191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:42 smithi049 bash[23528]: cluster 2024-09-20T23:40:41.976052+0000 mgr.a (mgr.14388) 3727 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:42 smithi044 bash[22676]: audit 2024-09-20T23:40:41.622942+0000 mgr.a (mgr.14388) 3726 : audit [DBG] from='client.91191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:42 smithi044 bash[22676]: cluster 2024-09-20T23:40:41.976052+0000 mgr.a (mgr.14388) 3727 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:42 smithi179 bash[23186]: audit 2024-09-20T23:40:41.622942+0000 mgr.a (mgr.14388) 3726 : audit [DBG] from='client.91191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:42 smithi179 bash[23186]: cluster 2024-09-20T23:40:41.976052+0000 mgr.a (mgr.14388) 3727 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:44 smithi049 bash[23528]: cluster 2024-09-20T23:40:43.976785+0000 mgr.a (mgr.14388) 3728 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:44 smithi044 bash[22676]: cluster 2024-09-20T23:40:43.976785+0000 mgr.a (mgr.14388) 3728 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:44 smithi179 bash[23186]: cluster 2024-09-20T23:40:43.976785+0000 mgr.a (mgr.14388) 3728 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:46.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:46 smithi044 bash[22676]: cluster 2024-09-20T23:40:45.978098+0000 mgr.a (mgr.14388) 3729 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:46 smithi049 bash[23528]: cluster 2024-09-20T23:40:45.978098+0000 mgr.a (mgr.14388) 3729 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:46 smithi179 bash[23186]: cluster 2024-09-20T23:40:45.978098+0000 mgr.a (mgr.14388) 3729 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:47.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:47.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:47.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:47.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:47.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:47.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:47.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:47.825 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:48 smithi044 bash[22676]: audit 2024-09-20T23:40:47.407246+0000 mgr.a (mgr.14388) 3730 : audit [DBG] from='client.91266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:48 smithi044 bash[22676]: audit 2024-09-20T23:40:47.461235+0000 mon.a (mon.0) 3614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:48 smithi044 bash[22676]: audit 2024-09-20T23:40:47.467042+0000 mon.a (mon.0) 3615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:48 smithi044 bash[22676]: audit 2024-09-20T23:40:47.472366+0000 mon.a (mon.0) 3616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:48 smithi044 bash[22676]: cluster 2024-09-20T23:40:47.978656+0000 mgr.a (mgr.14388) 3731 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:48 smithi179 bash[23186]: audit 2024-09-20T23:40:47.407246+0000 mgr.a (mgr.14388) 3730 : audit [DBG] from='client.91266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:48 smithi179 bash[23186]: audit 2024-09-20T23:40:47.461235+0000 mon.a (mon.0) 3614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:48 smithi179 bash[23186]: audit 2024-09-20T23:40:47.467042+0000 mon.a (mon.0) 3615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:48 smithi179 bash[23186]: audit 2024-09-20T23:40:47.472366+0000 mon.a (mon.0) 3616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:48 smithi179 bash[23186]: cluster 2024-09-20T23:40:47.978656+0000 mgr.a (mgr.14388) 3731 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:48 smithi049 bash[23528]: audit 2024-09-20T23:40:47.407246+0000 mgr.a (mgr.14388) 3730 : audit [DBG] from='client.91266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:48 smithi049 bash[23528]: audit 2024-09-20T23:40:47.461235+0000 mon.a (mon.0) 3614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:48 smithi049 bash[23528]: audit 2024-09-20T23:40:47.467042+0000 mon.a (mon.0) 3615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:48 smithi049 bash[23528]: audit 2024-09-20T23:40:47.472366+0000 mon.a (mon.0) 3616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:48 smithi049 bash[23528]: cluster 2024-09-20T23:40:47.978656+0000 mgr.a (mgr.14388) 3731 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:50.173 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:49 smithi044 bash[22676]: audit 2024-09-20T23:40:48.855919+0000 mon.a (mon.0) 3617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.173 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:49 smithi044 bash[22676]: audit 2024-09-20T23:40:48.864580+0000 mon.a (mon.0) 3618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.173 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:49 smithi044 bash[22676]: audit 2024-09-20T23:40:48.875219+0000 mon.a (mon.0) 3619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:49 smithi179 bash[23186]: audit 2024-09-20T23:40:48.855919+0000 mon.a (mon.0) 3617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:49 smithi179 bash[23186]: audit 2024-09-20T23:40:48.864580+0000 mon.a (mon.0) 3618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:49 smithi179 bash[23186]: audit 2024-09-20T23:40:48.875219+0000 mon.a (mon.0) 3619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:49 smithi049 bash[23528]: audit 2024-09-20T23:40:48.855919+0000 mon.a (mon.0) 3617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:49 smithi049 bash[23528]: audit 2024-09-20T23:40:48.864580+0000 mon.a (mon.0) 3618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:49 smithi049 bash[23528]: audit 2024-09-20T23:40:48.875219+0000 mon.a (mon.0) 3619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:50 smithi044 bash[22676]: cluster 2024-09-20T23:40:49.979268+0000 mgr.a (mgr.14388) 3732 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:50 smithi044 bash[22676]: audit 2024-09-20T23:40:50.154982+0000 mon.a (mon.0) 3620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:50 smithi044 bash[22676]: audit 2024-09-20T23:40:50.162607+0000 mon.a (mon.0) 3621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:50 smithi044 bash[22676]: audit 2024-09-20T23:40:50.171111+0000 mon.a (mon.0) 3622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:50 smithi179 bash[23186]: cluster 2024-09-20T23:40:49.979268+0000 mgr.a (mgr.14388) 3732 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:50 smithi179 bash[23186]: audit 2024-09-20T23:40:50.154982+0000 mon.a (mon.0) 3620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:50 smithi179 bash[23186]: audit 2024-09-20T23:40:50.162607+0000 mon.a (mon.0) 3621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:50 smithi179 bash[23186]: audit 2024-09-20T23:40:50.171111+0000 mon.a (mon.0) 3622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:50 smithi049 bash[23528]: cluster 2024-09-20T23:40:49.979268+0000 mgr.a (mgr.14388) 3732 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:50 smithi049 bash[23528]: audit 2024-09-20T23:40:50.154982+0000 mon.a (mon.0) 3620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:50 smithi049 bash[23528]: audit 2024-09-20T23:40:50.162607+0000 mon.a (mon.0) 3621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:50 smithi049 bash[23528]: audit 2024-09-20T23:40:50.171111+0000 mon.a (mon.0) 3622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:40:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:52 smithi049 bash[23528]: cluster 2024-09-20T23:40:51.981492+0000 mgr.a (mgr.14388) 3733 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:52 smithi044 bash[22676]: cluster 2024-09-20T23:40:51.981492+0000 mgr.a (mgr.14388) 3733 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:52 smithi179 bash[23186]: cluster 2024-09-20T23:40:51.981492+0000 mgr.a (mgr.14388) 3733 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:52.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:52.827 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:52.827 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:53.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:53.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:53.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:53.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:53.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:54 smithi049 bash[23528]: audit 2024-09-20T23:40:53.157302+0000 mgr.a (mgr.14388) 3734 : audit [DBG] from='client.91344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:54 smithi049 bash[23528]: cluster 2024-09-20T23:40:53.982486+0000 mgr.a (mgr.14388) 3735 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:54 smithi044 bash[22676]: audit 2024-09-20T23:40:53.157302+0000 mgr.a (mgr.14388) 3734 : audit [DBG] from='client.91344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:54 smithi044 bash[22676]: cluster 2024-09-20T23:40:53.982486+0000 mgr.a (mgr.14388) 3735 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:54 smithi179 bash[23186]: audit 2024-09-20T23:40:53.157302+0000 mgr.a (mgr.14388) 3734 : audit [DBG] from='client.91344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:54 smithi179 bash[23186]: cluster 2024-09-20T23:40:53.982486+0000 mgr.a (mgr.14388) 3735 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:56 smithi049 bash[23528]: cluster 2024-09-20T23:40:55.984638+0000 mgr.a (mgr.14388) 3736 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:56 smithi044 bash[22676]: cluster 2024-09-20T23:40:55.984638+0000 mgr.a (mgr.14388) 3736 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:56 smithi179 bash[23186]: cluster 2024-09-20T23:40:55.984638+0000 mgr.a (mgr.14388) 3736 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:40:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:58 smithi179 bash[23186]: cluster 2024-09-20T23:40:57.985421+0000 mgr.a (mgr.14388) 3737 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:58 smithi049 bash[23528]: cluster 2024-09-20T23:40:57.985421+0000 mgr.a (mgr.14388) 3737 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:58 smithi044 bash[22676]: cluster 2024-09-20T23:40:57.985421+0000 mgr.a (mgr.14388) 3737 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:40:58.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:40:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:40:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:40:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:40:59 smithi179 bash[23186]: audit 2024-09-20T23:40:58.904515+0000 mgr.a (mgr.14388) 3738 : audit [DBG] from='client.91422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:40:59 smithi049 bash[23528]: audit 2024-09-20T23:40:58.904515+0000 mgr.a (mgr.14388) 3738 : audit [DBG] from='client.91422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:40:59.324 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:40:59.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:40:59.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:40:59.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:40:59.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:40:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:40:59 smithi044 bash[22676]: audit 2024-09-20T23:40:58.904515+0000 mgr.a (mgr.14388) 3738 : audit [DBG] from='client.91422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:00.321 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:00 smithi179 bash[23186]: cluster 2024-09-20T23:40:59.986389+0000 mgr.a (mgr.14388) 3739 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:00 smithi044 bash[22676]: cluster 2024-09-20T23:40:59.986389+0000 mgr.a (mgr.14388) 3739 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:00 smithi049 bash[23528]: cluster 2024-09-20T23:40:59.986389+0000 mgr.a (mgr.14388) 3739 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:02 smithi049 bash[23528]: cluster 2024-09-20T23:41:01.988627+0000 mgr.a (mgr.14388) 3740 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:41:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:02 smithi044 bash[22676]: cluster 2024-09-20T23:41:01.988627+0000 mgr.a (mgr.14388) 3740 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:41:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:02 smithi179 bash[23186]: cluster 2024-09-20T23:41:01.988627+0000 mgr.a (mgr.14388) 3740 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:41:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:04 smithi049 bash[23528]: cluster 2024-09-20T23:41:03.989397+0000 mgr.a (mgr.14388) 3741 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:04.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:04.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:04 smithi044 bash[22676]: cluster 2024-09-20T23:41:03.989397+0000 mgr.a (mgr.14388) 3741 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:04 smithi179 bash[23186]: cluster 2024-09-20T23:41:03.989397+0000 mgr.a (mgr.14388) 3741 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:05.108 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:05.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:05 smithi049 bash[23528]: audit 2024-09-20T23:41:04.664321+0000 mgr.a (mgr.14388) 3742 : audit [DBG] from='client.91500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:05 smithi044 bash[22676]: audit 2024-09-20T23:41:04.664321+0000 mgr.a (mgr.14388) 3742 : audit [DBG] from='client.91500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:05 smithi179 bash[23186]: audit 2024-09-20T23:41:04.664321+0000 mgr.a (mgr.14388) 3742 : audit [DBG] from='client.91500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:06 smithi044 bash[22676]: cluster 2024-09-20T23:41:05.991943+0000 mgr.a (mgr.14388) 3743 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:41:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:06 smithi049 bash[23528]: cluster 2024-09-20T23:41:05.991943+0000 mgr.a (mgr.14388) 3743 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:41:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:06 smithi179 bash[23186]: cluster 2024-09-20T23:41:05.991943+0000 mgr.a (mgr.14388) 3743 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:41:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:08 smithi044 bash[22676]: audit 2024-09-20T23:41:07.669283+0000 mon.a (mon.0) 3623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:08 smithi044 bash[22676]: audit 2024-09-20T23:41:07.679350+0000 mon.a (mon.0) 3624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:08 smithi044 bash[22676]: audit 2024-09-20T23:41:07.690377+0000 mon.a (mon.0) 3625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:08 smithi044 bash[22676]: cluster 2024-09-20T23:41:07.992777+0000 mgr.a (mgr.14388) 3744 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:41:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:08 smithi179 bash[23186]: audit 2024-09-20T23:41:07.669283+0000 mon.a (mon.0) 3623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:08 smithi179 bash[23186]: audit 2024-09-20T23:41:07.679350+0000 mon.a (mon.0) 3624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:08 smithi179 bash[23186]: audit 2024-09-20T23:41:07.690377+0000 mon.a (mon.0) 3625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:08 smithi179 bash[23186]: cluster 2024-09-20T23:41:07.992777+0000 mgr.a (mgr.14388) 3744 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:41:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:08 smithi049 bash[23528]: audit 2024-09-20T23:41:07.669283+0000 mon.a (mon.0) 3623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:08 smithi049 bash[23528]: audit 2024-09-20T23:41:07.679350+0000 mon.a (mon.0) 3624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:08 smithi049 bash[23528]: audit 2024-09-20T23:41:07.690377+0000 mon.a (mon.0) 3625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:08 smithi049 bash[23528]: cluster 2024-09-20T23:41:07.992777+0000 mgr.a (mgr.14388) 3744 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:41:10.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:10.110 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:10.110 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:10.344 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:10 smithi044 bash[22676]: audit 2024-09-20T23:41:09.084414+0000 mon.a (mon.0) 3626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.344 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:10 smithi044 bash[22676]: audit 2024-09-20T23:41:09.089774+0000 mon.a (mon.0) 3627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.344 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:10 smithi044 bash[22676]: audit 2024-09-20T23:41:09.095452+0000 mon.a (mon.0) 3628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.344 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:10 smithi044 bash[22676]: cluster 2024-09-20T23:41:09.993548+0000 mgr.a (mgr.14388) 3745 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:41:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:10 smithi179 bash[23186]: audit 2024-09-20T23:41:09.084414+0000 mon.a (mon.0) 3626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:10 smithi179 bash[23186]: audit 2024-09-20T23:41:09.089774+0000 mon.a (mon.0) 3627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:10 smithi179 bash[23186]: audit 2024-09-20T23:41:09.095452+0000 mon.a (mon.0) 3628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:10 smithi179 bash[23186]: cluster 2024-09-20T23:41:09.993548+0000 mgr.a (mgr.14388) 3745 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:41:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:10 smithi049 bash[23528]: audit 2024-09-20T23:41:09.084414+0000 mon.a (mon.0) 3626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:10 smithi049 bash[23528]: audit 2024-09-20T23:41:09.089774+0000 mon.a (mon.0) 3627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:10 smithi049 bash[23528]: audit 2024-09-20T23:41:09.095452+0000 mon.a (mon.0) 3628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:10 smithi049 bash[23528]: cluster 2024-09-20T23:41:09.993548+0000 mgr.a (mgr.14388) 3745 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:41:10.892 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:10.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:10.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:10.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:10.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:11 smithi044 bash[22676]: audit 2024-09-20T23:41:10.333222+0000 mon.a (mon.0) 3629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:11 smithi044 bash[22676]: audit 2024-09-20T23:41:10.338094+0000 mon.a (mon.0) 3630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:11 smithi044 bash[22676]: audit 2024-09-20T23:41:10.343189+0000 mon.a (mon.0) 3631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:11 smithi044 bash[22676]: audit 2024-09-20T23:41:10.464825+0000 mgr.a (mgr.14388) 3746 : audit [DBG] from='client.91578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:11 smithi179 bash[23186]: audit 2024-09-20T23:41:10.333222+0000 mon.a (mon.0) 3629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:11 smithi179 bash[23186]: audit 2024-09-20T23:41:10.338094+0000 mon.a (mon.0) 3630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:11 smithi179 bash[23186]: audit 2024-09-20T23:41:10.343189+0000 mon.a (mon.0) 3631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:11 smithi179 bash[23186]: audit 2024-09-20T23:41:10.464825+0000 mgr.a (mgr.14388) 3746 : audit [DBG] from='client.91578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:11 smithi049 bash[23528]: audit 2024-09-20T23:41:10.333222+0000 mon.a (mon.0) 3629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:11 smithi049 bash[23528]: audit 2024-09-20T23:41:10.338094+0000 mon.a (mon.0) 3630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:11 smithi049 bash[23528]: audit 2024-09-20T23:41:10.343189+0000 mon.a (mon.0) 3631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:11 smithi049 bash[23528]: audit 2024-09-20T23:41:10.464825+0000 mgr.a (mgr.14388) 3746 : audit [DBG] from='client.91578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:12 smithi044 bash[22676]: cluster 2024-09-20T23:41:11.996358+0000 mgr.a (mgr.14388) 3747 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:12 smithi179 bash[23186]: cluster 2024-09-20T23:41:11.996358+0000 mgr.a (mgr.14388) 3747 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:12 smithi049 bash[23528]: cluster 2024-09-20T23:41:11.996358+0000 mgr.a (mgr.14388) 3747 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:14 smithi044 bash[22676]: cluster 2024-09-20T23:41:13.997179+0000 mgr.a (mgr.14388) 3748 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:14 smithi179 bash[23186]: cluster 2024-09-20T23:41:13.997179+0000 mgr.a (mgr.14388) 3748 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:14 smithi049 bash[23528]: cluster 2024-09-20T23:41:13.997179+0000 mgr.a (mgr.14388) 3748 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:15.895 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:15.895 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:16 smithi044 bash[22676]: audit 2024-09-20T23:41:16.004961+0000 mon.a (mon.0) 3632 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:41:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:16 smithi179 bash[23186]: audit 2024-09-20T23:41:16.004961+0000 mon.a (mon.0) 3632 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:41:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:16 smithi049 bash[23528]: audit 2024-09-20T23:41:16.004961+0000 mon.a (mon.0) 3632 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:41:16.654 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:16.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:16.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:16.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:16.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:17.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22930]: debug 2024-09-20T23:41:17.335+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:41:17.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22930]: debug 2024-09-20T23:41:17.335+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:41:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: cluster 2024-09-20T23:41:15.998252+0000 mgr.a (mgr.14388) 3749 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.232804+0000 mgr.a (mgr.14388) 3750 : audit [DBG] from='client.91656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.565342+0000 mon.a (mon.0) 3633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.572470+0000 mon.a (mon.0) 3634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.578974+0000 mon.a (mon.0) 3635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.583837+0000 mon.a (mon.0) 3636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.584946+0000 mon.a (mon.0) 3637 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:41:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.585874+0000 mon.a (mon.0) 3638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:41:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.590608+0000 mon.a (mon.0) 3639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.592927+0000 mon.a (mon.0) 3640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:41:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:17 smithi044 bash[22676]: audit 2024-09-20T23:41:16.594034+0000 mgr.a (mgr.14388) 3751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:41:17.984 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: cluster 2024-09-20T23:41:15.998252+0000 mgr.a (mgr.14388) 3749 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.232804+0000 mgr.a (mgr.14388) 3750 : audit [DBG] from='client.91656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.565342+0000 mon.a (mon.0) 3633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.572470+0000 mon.a (mon.0) 3634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.578974+0000 mon.a (mon.0) 3635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.583837+0000 mon.a (mon.0) 3636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.584946+0000 mon.a (mon.0) 3637 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.585874+0000 mon.a (mon.0) 3638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.590608+0000 mon.a (mon.0) 3639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.592927+0000 mon.a (mon.0) 3640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:41:17.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:17 smithi179 bash[23186]: audit 2024-09-20T23:41:16.594034+0000 mgr.a (mgr.14388) 3751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: cluster 2024-09-20T23:41:15.998252+0000 mgr.a (mgr.14388) 3749 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.232804+0000 mgr.a (mgr.14388) 3750 : audit [DBG] from='client.91656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.565342+0000 mon.a (mon.0) 3633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.572470+0000 mon.a (mon.0) 3634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.578974+0000 mon.a (mon.0) 3635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.583837+0000 mon.a (mon.0) 3636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.584946+0000 mon.a (mon.0) 3637 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:41:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.585874+0000 mon.a (mon.0) 3638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:41:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.590608+0000 mon.a (mon.0) 3639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.592927+0000 mon.a (mon.0) 3640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:41:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:17 smithi049 bash[23528]: audit 2024-09-20T23:41:16.594034+0000 mgr.a (mgr.14388) 3751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:41:18.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:18 smithi179 bash[23186]: audit 2024-09-20T23:41:17.337582+0000 mgr.a (mgr.14388) 3752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:41:18.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:18 smithi179 bash[23186]: cephadm 2024-09-20T23:41:17.339002+0000 mgr.a (mgr.14388) 3753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:41:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:18 smithi044 bash[22676]: audit 2024-09-20T23:41:17.337582+0000 mgr.a (mgr.14388) 3752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:41:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:18 smithi044 bash[22676]: cephadm 2024-09-20T23:41:17.339002+0000 mgr.a (mgr.14388) 3753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:41:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:18 smithi049 bash[23528]: audit 2024-09-20T23:41:17.337582+0000 mgr.a (mgr.14388) 3752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:41:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:18 smithi049 bash[23528]: cephadm 2024-09-20T23:41:17.339002+0000 mgr.a (mgr.14388) 3753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:41:19.835 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:19 smithi179 bash[23186]: cluster 2024-09-20T23:41:17.999108+0000 mgr.a (mgr.14388) 3754 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:41:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:19 smithi044 bash[22676]: cluster 2024-09-20T23:41:17.999108+0000 mgr.a (mgr.14388) 3754 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:41:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:19 smithi049 bash[23528]: cluster 2024-09-20T23:41:17.999108+0000 mgr.a (mgr.14388) 3754 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:41:21.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:21 smithi044 bash[22676]: cluster 2024-09-20T23:41:19.999911+0000 mgr.a (mgr.14388) 3755 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:41:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:21 smithi179 bash[23186]: cluster 2024-09-20T23:41:19.999911+0000 mgr.a (mgr.14388) 3755 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:41:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:21 smithi049 bash[23528]: cluster 2024-09-20T23:41:19.999911+0000 mgr.a (mgr.14388) 3755 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:41:22.440 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:22.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:22.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:22 smithi044 bash[22676]: audit 2024-09-20T23:41:21.994467+0000 mgr.a (mgr.14388) 3756 : audit [DBG] from='client.91836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:22 smithi179 bash[23186]: audit 2024-09-20T23:41:21.994467+0000 mgr.a (mgr.14388) 3756 : audit [DBG] from='client.91836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:22 smithi049 bash[23528]: audit 2024-09-20T23:41:21.994467+0000 mgr.a (mgr.14388) 3756 : audit [DBG] from='client.91836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:23 smithi044 bash[22676]: cluster 2024-09-20T23:41:22.014141+0000 mgr.a (mgr.14388) 3757 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:41:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:23 smithi179 bash[23186]: cluster 2024-09-20T23:41:22.014141+0000 mgr.a (mgr.14388) 3757 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:41:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:23 smithi049 bash[23528]: cluster 2024-09-20T23:41:22.014141+0000 mgr.a (mgr.14388) 3757 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:41:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:25 smithi044 bash[22676]: cluster 2024-09-20T23:41:24.015112+0000 mgr.a (mgr.14388) 3758 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:25 smithi179 bash[23186]: cluster 2024-09-20T23:41:24.015112+0000 mgr.a (mgr.14388) 3758 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:25 smithi049 bash[23528]: cluster 2024-09-20T23:41:24.015112+0000 mgr.a (mgr.14388) 3758 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:27.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:27.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:27.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:27.865 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:27 smithi049 bash[23528]: cluster 2024-09-20T23:41:26.017358+0000 mgr.a (mgr.14388) 3759 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:41:27.942 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:27 smithi044 bash[22676]: cluster 2024-09-20T23:41:26.017358+0000 mgr.a (mgr.14388) 3759 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:41:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:27 smithi179 bash[23186]: cluster 2024-09-20T23:41:26.017358+0000 mgr.a (mgr.14388) 3759 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:41:28.208 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:28 smithi049 bash[23528]: audit 2024-09-20T23:41:27.782128+0000 mgr.a (mgr.14388) 3760 : audit [DBG] from='client.91914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:28 smithi049 bash[23528]: audit 2024-09-20T23:41:27.853398+0000 mon.a (mon.0) 3641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:28 smithi049 bash[23528]: audit 2024-09-20T23:41:27.858727+0000 mon.a (mon.0) 3642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:28 smithi049 bash[23528]: audit 2024-09-20T23:41:27.864418+0000 mon.a (mon.0) 3643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:28 smithi044 bash[22676]: audit 2024-09-20T23:41:27.782128+0000 mgr.a (mgr.14388) 3760 : audit [DBG] from='client.91914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:29.216 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:28 smithi044 bash[22676]: audit 2024-09-20T23:41:27.853398+0000 mon.a (mon.0) 3641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.216 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:28 smithi044 bash[22676]: audit 2024-09-20T23:41:27.858727+0000 mon.a (mon.0) 3642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.216 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:28 smithi044 bash[22676]: audit 2024-09-20T23:41:27.864418+0000 mon.a (mon.0) 3643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:28 smithi179 bash[23186]: audit 2024-09-20T23:41:27.782128+0000 mgr.a (mgr.14388) 3760 : audit [DBG] from='client.91914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:28 smithi179 bash[23186]: audit 2024-09-20T23:41:27.853398+0000 mon.a (mon.0) 3641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:28 smithi179 bash[23186]: audit 2024-09-20T23:41:27.858727+0000 mon.a (mon.0) 3642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:28 smithi179 bash[23186]: audit 2024-09-20T23:41:27.864418+0000 mon.a (mon.0) 3643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:29 smithi044 bash[22676]: cluster 2024-09-20T23:41:28.017962+0000 mgr.a (mgr.14388) 3761 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:29 smithi044 bash[22676]: audit 2024-09-20T23:41:29.282945+0000 mon.a (mon.0) 3644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:29 smithi044 bash[22676]: audit 2024-09-20T23:41:29.290075+0000 mon.a (mon.0) 3645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:29 smithi044 bash[22676]: audit 2024-09-20T23:41:29.295625+0000 mon.a (mon.0) 3646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:29 smithi179 bash[23186]: cluster 2024-09-20T23:41:28.017962+0000 mgr.a (mgr.14388) 3761 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:29 smithi179 bash[23186]: audit 2024-09-20T23:41:29.282945+0000 mon.a (mon.0) 3644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:29 smithi179 bash[23186]: audit 2024-09-20T23:41:29.290075+0000 mon.a (mon.0) 3645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:29 smithi179 bash[23186]: audit 2024-09-20T23:41:29.295625+0000 mon.a (mon.0) 3646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:29 smithi049 bash[23528]: cluster 2024-09-20T23:41:28.017962+0000 mgr.a (mgr.14388) 3761 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:29 smithi049 bash[23528]: audit 2024-09-20T23:41:29.282945+0000 mon.a (mon.0) 3644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:29 smithi049 bash[23528]: audit 2024-09-20T23:41:29.290075+0000 mon.a (mon.0) 3645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:29 smithi049 bash[23528]: audit 2024-09-20T23:41:29.295625+0000 mon.a (mon.0) 3646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:31 smithi049 bash[23528]: cluster 2024-09-20T23:41:30.019033+0000 mgr.a (mgr.14388) 3762 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:31 smithi049 bash[23528]: audit 2024-09-20T23:41:30.542393+0000 mon.a (mon.0) 3647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:31 smithi049 bash[23528]: audit 2024-09-20T23:41:30.550892+0000 mon.a (mon.0) 3648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:31 smithi049 bash[23528]: audit 2024-09-20T23:41:30.560117+0000 mon.a (mon.0) 3649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:31 smithi044 bash[22676]: cluster 2024-09-20T23:41:30.019033+0000 mgr.a (mgr.14388) 3762 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:31 smithi044 bash[22676]: audit 2024-09-20T23:41:30.542393+0000 mon.a (mon.0) 3647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:31 smithi044 bash[22676]: audit 2024-09-20T23:41:30.550892+0000 mon.a (mon.0) 3648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:31 smithi044 bash[22676]: audit 2024-09-20T23:41:30.560117+0000 mon.a (mon.0) 3649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:31 smithi179 bash[23186]: cluster 2024-09-20T23:41:30.019033+0000 mgr.a (mgr.14388) 3762 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:31 smithi179 bash[23186]: audit 2024-09-20T23:41:30.542393+0000 mon.a (mon.0) 3647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:31 smithi179 bash[23186]: audit 2024-09-20T23:41:30.550892+0000 mon.a (mon.0) 3648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:31 smithi179 bash[23186]: audit 2024-09-20T23:41:30.560117+0000 mon.a (mon.0) 3649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:33.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:33.211 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:33.211 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:33 smithi049 bash[23528]: cluster 2024-09-20T23:41:32.020064+0000 mgr.a (mgr.14388) 3763 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:33.951 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:33 smithi044 bash[22676]: cluster 2024-09-20T23:41:32.020064+0000 mgr.a (mgr.14388) 3763 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:33 smithi179 bash[23186]: cluster 2024-09-20T23:41:32.020064+0000 mgr.a (mgr.14388) 3763 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-20T23:41:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:34 smithi044 bash[22676]: audit 2024-09-20T23:41:33.537864+0000 mgr.a (mgr.14388) 3764 : audit [DBG] from='client.91992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:35.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:34 smithi179 bash[23186]: audit 2024-09-20T23:41:33.537864+0000 mgr.a (mgr.14388) 3764 : audit [DBG] from='client.91992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:34 smithi049 bash[23528]: audit 2024-09-20T23:41:33.537864+0000 mgr.a (mgr.14388) 3764 : audit [DBG] from='client.91992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:35 smithi044 bash[22676]: cluster 2024-09-20T23:41:34.021041+0000 mgr.a (mgr.14388) 3765 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:35 smithi179 bash[23186]: cluster 2024-09-20T23:41:34.021041+0000 mgr.a (mgr.14388) 3765 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:35 smithi049 bash[23528]: cluster 2024-09-20T23:41:34.021041+0000 mgr.a (mgr.14388) 3765 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:37 smithi044 bash[22676]: cluster 2024-09-20T23:41:36.023265+0000 mgr.a (mgr.14388) 3766 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:41:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:37 smithi179 bash[23186]: cluster 2024-09-20T23:41:36.023265+0000 mgr.a (mgr.14388) 3766 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:41:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:37 smithi049 bash[23528]: cluster 2024-09-20T23:41:36.023265+0000 mgr.a (mgr.14388) 3766 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:41:38.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:38.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:38.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:39.742 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:39.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:39.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:39.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:39.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:39.848 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:39 smithi179 bash[23186]: cluster 2024-09-20T23:41:38.024010+0000 mgr.a (mgr.14388) 3767 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:39 smithi044 bash[22676]: cluster 2024-09-20T23:41:38.024010+0000 mgr.a (mgr.14388) 3767 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:39 smithi049 bash[23528]: cluster 2024-09-20T23:41:38.024010+0000 mgr.a (mgr.14388) 3767 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:40 smithi179 bash[23186]: audit 2024-09-20T23:41:39.289312+0000 mgr.a (mgr.14388) 3768 : audit [DBG] from='client.92070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:40 smithi044 bash[22676]: audit 2024-09-20T23:41:39.289312+0000 mgr.a (mgr.14388) 3768 : audit [DBG] from='client.92070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:40 smithi049 bash[23528]: audit 2024-09-20T23:41:39.289312+0000 mgr.a (mgr.14388) 3768 : audit [DBG] from='client.92070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:41 smithi044 bash[22676]: cluster 2024-09-20T23:41:40.026383+0000 mgr.a (mgr.14388) 3769 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:41:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:41 smithi179 bash[23186]: cluster 2024-09-20T23:41:40.026383+0000 mgr.a (mgr.14388) 3769 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:41:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:41 smithi049 bash[23528]: cluster 2024-09-20T23:41:40.026383+0000 mgr.a (mgr.14388) 3769 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-20T23:41:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:43 smithi044 bash[22676]: cluster 2024-09-20T23:41:42.027826+0000 mgr.a (mgr.14388) 3770 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:41:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:43 smithi179 bash[23186]: cluster 2024-09-20T23:41:42.027826+0000 mgr.a (mgr.14388) 3770 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:41:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:43 smithi049 bash[23528]: cluster 2024-09-20T23:41:42.027826+0000 mgr.a (mgr.14388) 3770 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-20T23:41:44.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:44.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:44.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:45.525 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:45.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:45.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:45.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:45.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:45 smithi044 bash[22676]: cluster 2024-09-20T23:41:44.028611+0000 mgr.a (mgr.14388) 3771 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:45 smithi179 bash[23186]: cluster 2024-09-20T23:41:44.028611+0000 mgr.a (mgr.14388) 3771 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:45 smithi049 bash[23528]: cluster 2024-09-20T23:41:44.028611+0000 mgr.a (mgr.14388) 3771 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:46 smithi044 bash[22676]: audit 2024-09-20T23:41:45.081510+0000 mgr.a (mgr.14388) 3772 : audit [DBG] from='client.92145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:46 smithi179 bash[23186]: audit 2024-09-20T23:41:45.081510+0000 mgr.a (mgr.14388) 3772 : audit [DBG] from='client.92145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:46 smithi049 bash[23528]: audit 2024-09-20T23:41:45.081510+0000 mgr.a (mgr.14388) 3772 : audit [DBG] from='client.92145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:47 smithi044 bash[22676]: cluster 2024-09-20T23:41:46.031630+0000 mgr.a (mgr.14388) 3773 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:47 smithi179 bash[23186]: cluster 2024-09-20T23:41:46.031630+0000 mgr.a (mgr.14388) 3773 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:47 smithi049 bash[23528]: cluster 2024-09-20T23:41:46.031630+0000 mgr.a (mgr.14388) 3773 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:49 smithi044 bash[22676]: cluster 2024-09-20T23:41:48.032562+0000 mgr.a (mgr.14388) 3774 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:49 smithi044 bash[22676]: audit 2024-09-20T23:41:48.047149+0000 mon.a (mon.0) 3650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:49 smithi044 bash[22676]: audit 2024-09-20T23:41:48.055587+0000 mon.a (mon.0) 3651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:49 smithi044 bash[22676]: audit 2024-09-20T23:41:48.065901+0000 mon.a (mon.0) 3652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:49 smithi049 bash[23528]: cluster 2024-09-20T23:41:48.032562+0000 mgr.a (mgr.14388) 3774 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:49 smithi049 bash[23528]: audit 2024-09-20T23:41:48.047149+0000 mon.a (mon.0) 3650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:49 smithi049 bash[23528]: audit 2024-09-20T23:41:48.055587+0000 mon.a (mon.0) 3651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:49 smithi049 bash[23528]: audit 2024-09-20T23:41:48.065901+0000 mon.a (mon.0) 3652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:49 smithi179 bash[23186]: cluster 2024-09-20T23:41:48.032562+0000 mgr.a (mgr.14388) 3774 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:49.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:49 smithi179 bash[23186]: audit 2024-09-20T23:41:48.047149+0000 mon.a (mon.0) 3650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:49 smithi179 bash[23186]: audit 2024-09-20T23:41:48.055587+0000 mon.a (mon.0) 3651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:49.489 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:49 smithi179 bash[23186]: audit 2024-09-20T23:41:48.065901+0000 mon.a (mon.0) 3652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:50 smithi044 bash[22676]: audit 2024-09-20T23:41:49.466247+0000 mon.a (mon.0) 3653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:50 smithi044 bash[22676]: audit 2024-09-20T23:41:49.475121+0000 mon.a (mon.0) 3654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:50 smithi044 bash[22676]: audit 2024-09-20T23:41:49.485566+0000 mon.a (mon.0) 3655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:50 smithi179 bash[23186]: audit 2024-09-20T23:41:49.466247+0000 mon.a (mon.0) 3653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:50 smithi179 bash[23186]: audit 2024-09-20T23:41:49.475121+0000 mon.a (mon.0) 3654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:50 smithi179 bash[23186]: audit 2024-09-20T23:41:49.485566+0000 mon.a (mon.0) 3655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:50 smithi049 bash[23528]: audit 2024-09-20T23:41:49.466247+0000 mon.a (mon.0) 3653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:50 smithi049 bash[23528]: audit 2024-09-20T23:41:49.475121+0000 mon.a (mon.0) 3654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:50 smithi049 bash[23528]: audit 2024-09-20T23:41:49.485566+0000 mon.a (mon.0) 3655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:51.294 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:51 smithi044 bash[22676]: cluster 2024-09-20T23:41:50.034463+0000 mgr.a (mgr.14388) 3775 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:51 smithi044 bash[22676]: audit 2024-09-20T23:41:50.690865+0000 mon.a (mon.0) 3656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:51 smithi044 bash[22676]: audit 2024-09-20T23:41:50.697003+0000 mon.a (mon.0) 3657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:51 smithi044 bash[22676]: audit 2024-09-20T23:41:50.703815+0000 mon.a (mon.0) 3658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:51 smithi044 bash[22676]: audit 2024-09-20T23:41:50.867589+0000 mgr.a (mgr.14388) 3776 : audit [DBG] from='client.92223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:51 smithi179 bash[23186]: cluster 2024-09-20T23:41:50.034463+0000 mgr.a (mgr.14388) 3775 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:51 smithi179 bash[23186]: audit 2024-09-20T23:41:50.690865+0000 mon.a (mon.0) 3656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:51 smithi179 bash[23186]: audit 2024-09-20T23:41:50.697003+0000 mon.a (mon.0) 3657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:51 smithi179 bash[23186]: audit 2024-09-20T23:41:50.703815+0000 mon.a (mon.0) 3658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:51 smithi179 bash[23186]: audit 2024-09-20T23:41:50.867589+0000 mgr.a (mgr.14388) 3776 : audit [DBG] from='client.92223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:51 smithi049 bash[23528]: cluster 2024-09-20T23:41:50.034463+0000 mgr.a (mgr.14388) 3775 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:51 smithi049 bash[23528]: audit 2024-09-20T23:41:50.690865+0000 mon.a (mon.0) 3656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:51 smithi049 bash[23528]: audit 2024-09-20T23:41:50.697003+0000 mon.a (mon.0) 3657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:51 smithi049 bash[23528]: audit 2024-09-20T23:41:50.703815+0000 mon.a (mon.0) 3658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:41:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:51 smithi049 bash[23528]: audit 2024-09-20T23:41:50.867589+0000 mgr.a (mgr.14388) 3776 : audit [DBG] from='client.92223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:53 smithi044 bash[22676]: cluster 2024-09-20T23:41:52.035575+0000 mgr.a (mgr.14388) 3777 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:41:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:53 smithi179 bash[23186]: cluster 2024-09-20T23:41:52.035575+0000 mgr.a (mgr.14388) 3777 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:41:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:53 smithi049 bash[23528]: cluster 2024-09-20T23:41:52.035575+0000 mgr.a (mgr.14388) 3777 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-20T23:41:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:55 smithi044 bash[22676]: cluster 2024-09-20T23:41:54.036415+0000 mgr.a (mgr.14388) 3778 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:55 smithi179 bash[23186]: cluster 2024-09-20T23:41:54.036415+0000 mgr.a (mgr.14388) 3778 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:55 smithi049 bash[23528]: cluster 2024-09-20T23:41:54.036415+0000 mgr.a (mgr.14388) 3778 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:41:56.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:41:56.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:41:56.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:41:57.050 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:41:57.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:41:57.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:41:57.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:41:57.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:41:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:57 smithi044 bash[22676]: cluster 2024-09-20T23:41:56.038626+0000 mgr.a (mgr.14388) 3779 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:57 smithi044 bash[22676]: audit 2024-09-20T23:41:56.622591+0000 mgr.a (mgr.14388) 3780 : audit [DBG] from='client.92298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:57 smithi179 bash[23186]: cluster 2024-09-20T23:41:56.038626+0000 mgr.a (mgr.14388) 3779 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:57 smithi179 bash[23186]: audit 2024-09-20T23:41:56.622591+0000 mgr.a (mgr.14388) 3780 : audit [DBG] from='client.92298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:57 smithi049 bash[23528]: cluster 2024-09-20T23:41:56.038626+0000 mgr.a (mgr.14388) 3779 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:41:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:57 smithi049 bash[23528]: audit 2024-09-20T23:41:56.622591+0000 mgr.a (mgr.14388) 3780 : audit [DBG] from='client.92298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:41:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:41:59 smithi044 bash[22676]: cluster 2024-09-20T23:41:58.039465+0000 mgr.a (mgr.14388) 3781 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:41:59 smithi179 bash[23186]: cluster 2024-09-20T23:41:58.039465+0000 mgr.a (mgr.14388) 3781 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:41:59 smithi049 bash[23528]: cluster 2024-09-20T23:41:58.039465+0000 mgr.a (mgr.14388) 3781 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:01 smithi044 bash[22676]: cluster 2024-09-20T23:42:00.041615+0000 mgr.a (mgr.14388) 3782 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:01 smithi179 bash[23186]: cluster 2024-09-20T23:42:00.041615+0000 mgr.a (mgr.14388) 3782 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:01 smithi049 bash[23528]: cluster 2024-09-20T23:42:00.041615+0000 mgr.a (mgr.14388) 3782 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:02.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:02.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:02.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:02.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:02.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:02.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:02.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:03 smithi044 bash[22676]: cluster 2024-09-20T23:42:02.042411+0000 mgr.a (mgr.14388) 3783 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:03 smithi044 bash[22676]: audit 2024-09-20T23:42:02.384585+0000 mgr.a (mgr.14388) 3784 : audit [DBG] from='client.92376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:03 smithi179 bash[23186]: cluster 2024-09-20T23:42:02.042411+0000 mgr.a (mgr.14388) 3783 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:03 smithi179 bash[23186]: audit 2024-09-20T23:42:02.384585+0000 mgr.a (mgr.14388) 3784 : audit [DBG] from='client.92376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:03 smithi049 bash[23528]: cluster 2024-09-20T23:42:02.042411+0000 mgr.a (mgr.14388) 3783 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:03 smithi049 bash[23528]: audit 2024-09-20T23:42:02.384585+0000 mgr.a (mgr.14388) 3784 : audit [DBG] from='client.92376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:05 smithi044 bash[22676]: cluster 2024-09-20T23:42:04.043459+0000 mgr.a (mgr.14388) 3785 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:05 smithi179 bash[23186]: cluster 2024-09-20T23:42:04.043459+0000 mgr.a (mgr.14388) 3785 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:05 smithi049 bash[23528]: cluster 2024-09-20T23:42:04.043459+0000 mgr.a (mgr.14388) 3785 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:07.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:07.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:07.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:07 smithi044 bash[22676]: cluster 2024-09-20T23:42:06.045782+0000 mgr.a (mgr.14388) 3786 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:07 smithi179 bash[23186]: cluster 2024-09-20T23:42:06.045782+0000 mgr.a (mgr.14388) 3786 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:07 smithi049 bash[23528]: cluster 2024-09-20T23:42:06.045782+0000 mgr.a (mgr.14388) 3786 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:08.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:08.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:08.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:08.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:08.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:09 smithi044 bash[22676]: cluster 2024-09-20T23:42:08.046499+0000 mgr.a (mgr.14388) 3787 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:09 smithi044 bash[22676]: audit 2024-09-20T23:42:08.143738+0000 mgr.a (mgr.14388) 3788 : audit [DBG] from='client.92451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:09 smithi044 bash[22676]: audit 2024-09-20T23:42:08.225588+0000 mon.a (mon.0) 3659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:09 smithi044 bash[22676]: audit 2024-09-20T23:42:08.231220+0000 mon.a (mon.0) 3660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:09 smithi044 bash[22676]: audit 2024-09-20T23:42:08.237675+0000 mon.a (mon.0) 3661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:09 smithi179 bash[23186]: cluster 2024-09-20T23:42:08.046499+0000 mgr.a (mgr.14388) 3787 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:09 smithi179 bash[23186]: audit 2024-09-20T23:42:08.143738+0000 mgr.a (mgr.14388) 3788 : audit [DBG] from='client.92451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:09 smithi179 bash[23186]: audit 2024-09-20T23:42:08.225588+0000 mon.a (mon.0) 3659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:09 smithi179 bash[23186]: audit 2024-09-20T23:42:08.231220+0000 mon.a (mon.0) 3660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:09 smithi179 bash[23186]: audit 2024-09-20T23:42:08.237675+0000 mon.a (mon.0) 3661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:09 smithi049 bash[23528]: cluster 2024-09-20T23:42:08.046499+0000 mgr.a (mgr.14388) 3787 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:09 smithi049 bash[23528]: audit 2024-09-20T23:42:08.143738+0000 mgr.a (mgr.14388) 3788 : audit [DBG] from='client.92451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:09 smithi049 bash[23528]: audit 2024-09-20T23:42:08.225588+0000 mon.a (mon.0) 3659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:09 smithi049 bash[23528]: audit 2024-09-20T23:42:08.231220+0000 mon.a (mon.0) 3660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:09 smithi049 bash[23528]: audit 2024-09-20T23:42:08.237675+0000 mon.a (mon.0) 3661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:10 smithi044 bash[22676]: audit 2024-09-20T23:42:09.700657+0000 mon.a (mon.0) 3662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:10 smithi044 bash[22676]: audit 2024-09-20T23:42:09.710250+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:10 smithi044 bash[22676]: audit 2024-09-20T23:42:09.720813+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:10 smithi179 bash[23186]: audit 2024-09-20T23:42:09.700657+0000 mon.a (mon.0) 3662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:10 smithi179 bash[23186]: audit 2024-09-20T23:42:09.710250+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:10 smithi179 bash[23186]: audit 2024-09-20T23:42:09.720813+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:10 smithi049 bash[23528]: audit 2024-09-20T23:42:09.700657+0000 mon.a (mon.0) 3662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:10 smithi049 bash[23528]: audit 2024-09-20T23:42:09.710250+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:10 smithi049 bash[23528]: audit 2024-09-20T23:42:09.720813+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:11 smithi044 bash[22676]: cluster 2024-09-20T23:42:10.048684+0000 mgr.a (mgr.14388) 3789 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:11 smithi044 bash[22676]: audit 2024-09-20T23:42:10.866314+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:11 smithi044 bash[22676]: audit 2024-09-20T23:42:10.871147+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:11 smithi044 bash[22676]: audit 2024-09-20T23:42:10.876573+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:11 smithi179 bash[23186]: cluster 2024-09-20T23:42:10.048684+0000 mgr.a (mgr.14388) 3789 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:11 smithi179 bash[23186]: audit 2024-09-20T23:42:10.866314+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:11 smithi179 bash[23186]: audit 2024-09-20T23:42:10.871147+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:11 smithi179 bash[23186]: audit 2024-09-20T23:42:10.876573+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:11 smithi049 bash[23528]: cluster 2024-09-20T23:42:10.048684+0000 mgr.a (mgr.14388) 3789 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:11 smithi049 bash[23528]: audit 2024-09-20T23:42:10.866314+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:11 smithi049 bash[23528]: audit 2024-09-20T23:42:10.871147+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:11 smithi049 bash[23528]: audit 2024-09-20T23:42:10.876573+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:13.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:13.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:13.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:13 smithi044 bash[22676]: cluster 2024-09-20T23:42:12.049502+0000 mgr.a (mgr.14388) 3790 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:13 smithi179 bash[23186]: cluster 2024-09-20T23:42:12.049502+0000 mgr.a (mgr.14388) 3790 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:13 smithi049 bash[23528]: cluster 2024-09-20T23:42:12.049502+0000 mgr.a (mgr.14388) 3790 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:14.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:14 smithi044 bash[22676]: audit 2024-09-20T23:42:13.942464+0000 mgr.a (mgr.14388) 3791 : audit [DBG] from='client.92529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:14 smithi179 bash[23186]: audit 2024-09-20T23:42:13.942464+0000 mgr.a (mgr.14388) 3791 : audit [DBG] from='client.92529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:14 smithi049 bash[23528]: audit 2024-09-20T23:42:13.942464+0000 mgr.a (mgr.14388) 3791 : audit [DBG] from='client.92529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:15 smithi044 bash[22676]: cluster 2024-09-20T23:42:14.050054+0000 mgr.a (mgr.14388) 3792 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:15 smithi179 bash[23186]: cluster 2024-09-20T23:42:14.050054+0000 mgr.a (mgr.14388) 3792 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:15 smithi049 bash[23528]: cluster 2024-09-20T23:42:14.050054+0000 mgr.a (mgr.14388) 3792 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:17 smithi044 bash[22676]: cluster 2024-09-20T23:42:16.052357+0000 mgr.a (mgr.14388) 3793 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:17 smithi044 bash[22676]: audit 2024-09-20T23:42:17.401561+0000 mon.a (mon.0) 3668 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:42:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:17 smithi179 bash[23186]: cluster 2024-09-20T23:42:16.052357+0000 mgr.a (mgr.14388) 3793 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:17 smithi179 bash[23186]: audit 2024-09-20T23:42:17.401561+0000 mon.a (mon.0) 3668 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:42:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:17 smithi049 bash[23528]: cluster 2024-09-20T23:42:16.052357+0000 mgr.a (mgr.14388) 3793 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:17 smithi049 bash[23528]: audit 2024-09-20T23:42:17.401561+0000 mon.a (mon.0) 3668 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:42:19.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22930]: debug 2024-09-20T23:42:18.782+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:42:19.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22930]: debug 2024-09-20T23:42:18.786+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:42:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22676]: audit 2024-09-20T23:42:17.993517+0000 mon.a (mon.0) 3669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22676]: audit 2024-09-20T23:42:18.003536+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22676]: audit 2024-09-20T23:42:18.006017+0000 mon.a (mon.0) 3671 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:42:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22676]: audit 2024-09-20T23:42:18.007895+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:42:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22676]: audit 2024-09-20T23:42:18.020177+0000 mon.a (mon.0) 3673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:18 smithi044 bash[22676]: audit 2024-09-20T23:42:18.026593+0000 mon.a (mon.0) 3674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:42:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:18 smithi179 bash[23186]: audit 2024-09-20T23:42:17.993517+0000 mon.a (mon.0) 3669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:18 smithi179 bash[23186]: audit 2024-09-20T23:42:18.003536+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:18 smithi179 bash[23186]: audit 2024-09-20T23:42:18.006017+0000 mon.a (mon.0) 3671 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:42:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:18 smithi179 bash[23186]: audit 2024-09-20T23:42:18.007895+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:42:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:18 smithi179 bash[23186]: audit 2024-09-20T23:42:18.020177+0000 mon.a (mon.0) 3673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:18 smithi179 bash[23186]: audit 2024-09-20T23:42:18.026593+0000 mon.a (mon.0) 3674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:42:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:18 smithi049 bash[23528]: audit 2024-09-20T23:42:17.993517+0000 mon.a (mon.0) 3669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:18 smithi049 bash[23528]: audit 2024-09-20T23:42:18.003536+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:18 smithi049 bash[23528]: audit 2024-09-20T23:42:18.006017+0000 mon.a (mon.0) 3671 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:42:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:18 smithi049 bash[23528]: audit 2024-09-20T23:42:18.007895+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:42:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:18 smithi049 bash[23528]: audit 2024-09-20T23:42:18.020177+0000 mon.a (mon.0) 3673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:18 smithi049 bash[23528]: audit 2024-09-20T23:42:18.026593+0000 mon.a (mon.0) 3674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:42:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:19.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:19.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:20.164 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:20 smithi179 bash[23186]: audit 2024-09-20T23:42:18.029143+0000 mgr.a (mgr.14388) 3794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:42:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:20 smithi179 bash[23186]: cluster 2024-09-20T23:42:18.054013+0000 mgr.a (mgr.14388) 3795 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:20 smithi179 bash[23186]: audit 2024-09-20T23:42:18.788160+0000 mgr.a (mgr.14388) 3796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:42:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:20 smithi179 bash[23186]: cephadm 2024-09-20T23:42:18.789394+0000 mgr.a (mgr.14388) 3797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:20 smithi049 bash[23528]: audit 2024-09-20T23:42:18.029143+0000 mgr.a (mgr.14388) 3794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:20 smithi049 bash[23528]: cluster 2024-09-20T23:42:18.054013+0000 mgr.a (mgr.14388) 3795 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:20 smithi049 bash[23528]: audit 2024-09-20T23:42:18.788160+0000 mgr.a (mgr.14388) 3796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:20 smithi049 bash[23528]: cephadm 2024-09-20T23:42:18.789394+0000 mgr.a (mgr.14388) 3797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:42:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:20 smithi044 bash[22676]: audit 2024-09-20T23:42:18.029143+0000 mgr.a (mgr.14388) 3794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:42:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:20 smithi044 bash[22676]: cluster 2024-09-20T23:42:18.054013+0000 mgr.a (mgr.14388) 3795 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:20 smithi044 bash[22676]: audit 2024-09-20T23:42:18.788160+0000 mgr.a (mgr.14388) 3796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:42:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:20 smithi044 bash[22676]: cephadm 2024-09-20T23:42:18.789394+0000 mgr.a (mgr.14388) 3797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:42:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:21 smithi049 bash[23528]: audit 2024-09-20T23:42:19.715842+0000 mgr.a (mgr.14388) 3798 : audit [DBG] from='client.92712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:21.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:21 smithi179 bash[23186]: audit 2024-09-20T23:42:19.715842+0000 mgr.a (mgr.14388) 3798 : audit [DBG] from='client.92712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:21 smithi044 bash[22676]: audit 2024-09-20T23:42:19.715842+0000 mgr.a (mgr.14388) 3798 : audit [DBG] from='client.92712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:22 smithi049 bash[23528]: cluster 2024-09-20T23:42:20.059518+0000 mgr.a (mgr.14388) 3799 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:22 smithi044 bash[22676]: cluster 2024-09-20T23:42:20.059518+0000 mgr.a (mgr.14388) 3799 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:22 smithi179 bash[23186]: cluster 2024-09-20T23:42:20.059518+0000 mgr.a (mgr.14388) 3799 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:23 smithi049 bash[23528]: cluster 2024-09-20T23:42:22.060305+0000 mgr.a (mgr.14388) 3800 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:23 smithi044 bash[22676]: cluster 2024-09-20T23:42:22.060305+0000 mgr.a (mgr.14388) 3800 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:23 smithi179 bash[23186]: cluster 2024-09-20T23:42:22.060305+0000 mgr.a (mgr.14388) 3800 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:25.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:25.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:25.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:25 smithi179 bash[23186]: cluster 2024-09-20T23:42:24.061080+0000 mgr.a (mgr.14388) 3801 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:25 smithi044 bash[22676]: cluster 2024-09-20T23:42:24.061080+0000 mgr.a (mgr.14388) 3801 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:25 smithi049 bash[23528]: cluster 2024-09-20T23:42:24.061080+0000 mgr.a (mgr.14388) 3801 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:25.943 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:26 smithi044 bash[22676]: audit 2024-09-20T23:42:25.501971+0000 mgr.a (mgr.14388) 3802 : audit [DBG] from='client.92784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:26 smithi179 bash[23186]: audit 2024-09-20T23:42:25.501971+0000 mgr.a (mgr.14388) 3802 : audit [DBG] from='client.92784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:26.518 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:26 smithi049 bash[23528]: audit 2024-09-20T23:42:25.501971+0000 mgr.a (mgr.14388) 3802 : audit [DBG] from='client.92784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:27.429 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:27 smithi049 bash[23528]: cluster 2024-09-20T23:42:26.063847+0000 mgr.a (mgr.14388) 3803 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:27 smithi044 bash[22676]: cluster 2024-09-20T23:42:26.063847+0000 mgr.a (mgr.14388) 3803 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:27 smithi179 bash[23186]: cluster 2024-09-20T23:42:26.063847+0000 mgr.a (mgr.14388) 3803 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:29 smithi049 bash[23528]: cluster 2024-09-20T23:42:28.064619+0000 mgr.a (mgr.14388) 3804 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:29 smithi049 bash[23528]: audit 2024-09-20T23:42:28.367392+0000 mon.a (mon.0) 3675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:29 smithi049 bash[23528]: audit 2024-09-20T23:42:28.376181+0000 mon.a (mon.0) 3676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:29 smithi049 bash[23528]: audit 2024-09-20T23:42:28.386685+0000 mon.a (mon.0) 3677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.641 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:29 smithi044 bash[22676]: cluster 2024-09-20T23:42:28.064619+0000 mgr.a (mgr.14388) 3804 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:29.641 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:29 smithi044 bash[22676]: audit 2024-09-20T23:42:28.367392+0000 mon.a (mon.0) 3675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.641 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:29 smithi044 bash[22676]: audit 2024-09-20T23:42:28.376181+0000 mon.a (mon.0) 3676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.641 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:29 smithi044 bash[22676]: audit 2024-09-20T23:42:28.386685+0000 mon.a (mon.0) 3677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:29 smithi179 bash[23186]: cluster 2024-09-20T23:42:28.064619+0000 mgr.a (mgr.14388) 3804 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:42:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:29 smithi179 bash[23186]: audit 2024-09-20T23:42:28.367392+0000 mon.a (mon.0) 3675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:29 smithi179 bash[23186]: audit 2024-09-20T23:42:28.376181+0000 mon.a (mon.0) 3676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:29 smithi179 bash[23186]: audit 2024-09-20T23:42:28.386685+0000 mon.a (mon.0) 3677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:31.084 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:30 smithi044 bash[22676]: audit 2024-09-20T23:42:29.926101+0000 mon.a (mon.0) 3678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.084 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:30 smithi044 bash[22676]: audit 2024-09-20T23:42:29.934356+0000 mon.a (mon.0) 3679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.084 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:30 smithi044 bash[22676]: audit 2024-09-20T23:42:29.944230+0000 mon.a (mon.0) 3680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:30 smithi179 bash[23186]: audit 2024-09-20T23:42:29.926101+0000 mon.a (mon.0) 3678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:30 smithi179 bash[23186]: audit 2024-09-20T23:42:29.934356+0000 mon.a (mon.0) 3679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:30 smithi179 bash[23186]: audit 2024-09-20T23:42:29.944230+0000 mon.a (mon.0) 3680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:30 smithi049 bash[23528]: audit 2024-09-20T23:42:29.926101+0000 mon.a (mon.0) 3678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:30 smithi049 bash[23528]: audit 2024-09-20T23:42:29.934356+0000 mon.a (mon.0) 3679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:30 smithi049 bash[23528]: audit 2024-09-20T23:42:29.944230+0000 mon.a (mon.0) 3680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:31.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:31 smithi044 bash[22676]: cluster 2024-09-20T23:42:30.066648+0000 mgr.a (mgr.14388) 3805 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:31 smithi044 bash[22676]: audit 2024-09-20T23:42:31.072409+0000 mon.a (mon.0) 3681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:31 smithi044 bash[22676]: audit 2024-09-20T23:42:31.077370+0000 mon.a (mon.0) 3682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:31 smithi044 bash[22676]: audit 2024-09-20T23:42:31.083087+0000 mon.a (mon.0) 3683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:31 smithi179 bash[23186]: cluster 2024-09-20T23:42:30.066648+0000 mgr.a (mgr.14388) 3805 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:31 smithi179 bash[23186]: audit 2024-09-20T23:42:31.072409+0000 mon.a (mon.0) 3681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:31 smithi179 bash[23186]: audit 2024-09-20T23:42:31.077370+0000 mon.a (mon.0) 3682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:31 smithi179 bash[23186]: audit 2024-09-20T23:42:31.083087+0000 mon.a (mon.0) 3683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:31 smithi049 bash[23528]: cluster 2024-09-20T23:42:30.066648+0000 mgr.a (mgr.14388) 3805 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:42:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:31 smithi049 bash[23528]: audit 2024-09-20T23:42:31.072409+0000 mon.a (mon.0) 3681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:31 smithi049 bash[23528]: audit 2024-09-20T23:42:31.077370+0000 mon.a (mon.0) 3682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:31 smithi049 bash[23528]: audit 2024-09-20T23:42:31.083087+0000 mon.a (mon.0) 3683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:32 smithi044 bash[22676]: audit 2024-09-20T23:42:31.297850+0000 mgr.a (mgr.14388) 3806 : audit [DBG] from='client.92862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:32 smithi179 bash[23186]: audit 2024-09-20T23:42:31.297850+0000 mgr.a (mgr.14388) 3806 : audit [DBG] from='client.92862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:32 smithi049 bash[23528]: audit 2024-09-20T23:42:31.297850+0000 mgr.a (mgr.14388) 3806 : audit [DBG] from='client.92862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:33 smithi044 bash[22676]: cluster 2024-09-20T23:42:32.067344+0000 mgr.a (mgr.14388) 3807 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:42:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:33 smithi179 bash[23186]: cluster 2024-09-20T23:42:32.067344+0000 mgr.a (mgr.14388) 3807 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:42:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:33 smithi049 bash[23528]: cluster 2024-09-20T23:42:32.067344+0000 mgr.a (mgr.14388) 3807 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:42:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:35 smithi044 bash[22676]: cluster 2024-09-20T23:42:34.068252+0000 mgr.a (mgr.14388) 3808 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:42:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:35 smithi179 bash[23186]: cluster 2024-09-20T23:42:34.068252+0000 mgr.a (mgr.14388) 3808 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:42:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:35 smithi049 bash[23528]: cluster 2024-09-20T23:42:34.068252+0000 mgr.a (mgr.14388) 3808 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:42:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:37.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:37.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:37.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:37.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:37.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:37 smithi044 bash[22676]: cluster 2024-09-20T23:42:36.070678+0000 mgr.a (mgr.14388) 3809 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:42:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:37 smithi179 bash[23186]: cluster 2024-09-20T23:42:36.070678+0000 mgr.a (mgr.14388) 3809 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:42:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:37 smithi049 bash[23528]: cluster 2024-09-20T23:42:36.070678+0000 mgr.a (mgr.14388) 3809 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:42:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:38 smithi044 bash[22676]: audit 2024-09-20T23:42:37.082158+0000 mgr.a (mgr.14388) 3810 : audit [DBG] from='client.92937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:38 smithi179 bash[23186]: audit 2024-09-20T23:42:37.082158+0000 mgr.a (mgr.14388) 3810 : audit [DBG] from='client.92937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:38 smithi049 bash[23528]: audit 2024-09-20T23:42:37.082158+0000 mgr.a (mgr.14388) 3810 : audit [DBG] from='client.92937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:39 smithi044 bash[22676]: cluster 2024-09-20T23:42:38.071611+0000 mgr.a (mgr.14388) 3811 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:39 smithi179 bash[23186]: cluster 2024-09-20T23:42:38.071611+0000 mgr.a (mgr.14388) 3811 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:39 smithi049 bash[23528]: cluster 2024-09-20T23:42:38.071611+0000 mgr.a (mgr.14388) 3811 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:41 smithi044 bash[22676]: cluster 2024-09-20T23:42:40.073763+0000 mgr.a (mgr.14388) 3812 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:41 smithi179 bash[23186]: cluster 2024-09-20T23:42:40.073763+0000 mgr.a (mgr.14388) 3812 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:41 smithi049 bash[23528]: cluster 2024-09-20T23:42:40.073763+0000 mgr.a (mgr.14388) 3812 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:42.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:42.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:43.294 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:43.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:43.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:43.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:43.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:43 smithi044 bash[22676]: cluster 2024-09-20T23:42:42.074537+0000 mgr.a (mgr.14388) 3813 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:43 smithi044 bash[22676]: audit 2024-09-20T23:42:42.843177+0000 mgr.a (mgr.14388) 3814 : audit [DBG] from='client.93015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:43 smithi179 bash[23186]: cluster 2024-09-20T23:42:42.074537+0000 mgr.a (mgr.14388) 3813 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:43 smithi179 bash[23186]: audit 2024-09-20T23:42:42.843177+0000 mgr.a (mgr.14388) 3814 : audit [DBG] from='client.93015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:43 smithi049 bash[23528]: cluster 2024-09-20T23:42:42.074537+0000 mgr.a (mgr.14388) 3813 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:43 smithi049 bash[23528]: audit 2024-09-20T23:42:42.843177+0000 mgr.a (mgr.14388) 3814 : audit [DBG] from='client.93015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:46.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:45 smithi179 bash[23186]: cluster 2024-09-20T23:42:44.075459+0000 mgr.a (mgr.14388) 3815 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:45 smithi049 bash[23528]: cluster 2024-09-20T23:42:44.075459+0000 mgr.a (mgr.14388) 3815 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:45 smithi044 bash[22676]: cluster 2024-09-20T23:42:44.075459+0000 mgr.a (mgr.14388) 3815 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:47 smithi179 bash[23186]: cluster 2024-09-20T23:42:46.077674+0000 mgr.a (mgr.14388) 3816 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:48.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:47 smithi049 bash[23528]: cluster 2024-09-20T23:42:46.077674+0000 mgr.a (mgr.14388) 3816 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:48.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:48.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:48.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:47 smithi044 bash[22676]: cluster 2024-09-20T23:42:46.077674+0000 mgr.a (mgr.14388) 3816 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:49.094 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:49.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:49.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:49.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:49.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:49 smithi044 bash[22676]: cluster 2024-09-20T23:42:48.078419+0000 mgr.a (mgr.14388) 3817 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:49 smithi044 bash[22676]: audit 2024-09-20T23:42:48.601042+0000 mon.a (mon.0) 3684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:49 smithi044 bash[22676]: audit 2024-09-20T23:42:48.608677+0000 mon.a (mon.0) 3685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:49 smithi044 bash[22676]: audit 2024-09-20T23:42:48.615984+0000 mon.a (mon.0) 3686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:49 smithi044 bash[22676]: audit 2024-09-20T23:42:48.637549+0000 mgr.a (mgr.14388) 3818 : audit [DBG] from='client.93093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:49 smithi179 bash[23186]: cluster 2024-09-20T23:42:48.078419+0000 mgr.a (mgr.14388) 3817 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:49 smithi179 bash[23186]: audit 2024-09-20T23:42:48.601042+0000 mon.a (mon.0) 3684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:49 smithi179 bash[23186]: audit 2024-09-20T23:42:48.608677+0000 mon.a (mon.0) 3685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:49 smithi179 bash[23186]: audit 2024-09-20T23:42:48.615984+0000 mon.a (mon.0) 3686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:49 smithi179 bash[23186]: audit 2024-09-20T23:42:48.637549+0000 mgr.a (mgr.14388) 3818 : audit [DBG] from='client.93093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:50.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:49 smithi049 bash[23528]: cluster 2024-09-20T23:42:48.078419+0000 mgr.a (mgr.14388) 3817 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:50.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:49 smithi049 bash[23528]: audit 2024-09-20T23:42:48.601042+0000 mon.a (mon.0) 3684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:50.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:49 smithi049 bash[23528]: audit 2024-09-20T23:42:48.608677+0000 mon.a (mon.0) 3685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:50.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:49 smithi049 bash[23528]: audit 2024-09-20T23:42:48.615984+0000 mon.a (mon.0) 3686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:50.041 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:49 smithi049 bash[23528]: audit 2024-09-20T23:42:48.637549+0000 mgr.a (mgr.14388) 3818 : audit [DBG] from='client.93093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:51 smithi044 bash[22676]: cluster 2024-09-20T23:42:50.080702+0000 mgr.a (mgr.14388) 3819 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:51 smithi044 bash[22676]: audit 2024-09-20T23:42:50.157520+0000 mon.a (mon.0) 3687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:51 smithi044 bash[22676]: audit 2024-09-20T23:42:50.167409+0000 mon.a (mon.0) 3688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:51 smithi044 bash[22676]: audit 2024-09-20T23:42:50.179422+0000 mon.a (mon.0) 3689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:51 smithi179 bash[23186]: cluster 2024-09-20T23:42:50.080702+0000 mgr.a (mgr.14388) 3819 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:51 smithi179 bash[23186]: audit 2024-09-20T23:42:50.157520+0000 mon.a (mon.0) 3687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:51 smithi179 bash[23186]: audit 2024-09-20T23:42:50.167409+0000 mon.a (mon.0) 3688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:51 smithi179 bash[23186]: audit 2024-09-20T23:42:50.179422+0000 mon.a (mon.0) 3689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:51 smithi049 bash[23528]: cluster 2024-09-20T23:42:50.080702+0000 mgr.a (mgr.14388) 3819 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:51 smithi049 bash[23528]: audit 2024-09-20T23:42:50.157520+0000 mon.a (mon.0) 3687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:51 smithi049 bash[23528]: audit 2024-09-20T23:42:50.167409+0000 mon.a (mon.0) 3688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:51 smithi049 bash[23528]: audit 2024-09-20T23:42:50.179422+0000 mon.a (mon.0) 3689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:52 smithi044 bash[22676]: audit 2024-09-20T23:42:51.260252+0000 mon.a (mon.0) 3690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:52 smithi044 bash[22676]: audit 2024-09-20T23:42:51.266305+0000 mon.a (mon.0) 3691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:52 smithi044 bash[22676]: audit 2024-09-20T23:42:51.271241+0000 mon.a (mon.0) 3692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:52 smithi049 bash[23528]: audit 2024-09-20T23:42:51.260252+0000 mon.a (mon.0) 3690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:52 smithi049 bash[23528]: audit 2024-09-20T23:42:51.266305+0000 mon.a (mon.0) 3691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:52 smithi049 bash[23528]: audit 2024-09-20T23:42:51.271241+0000 mon.a (mon.0) 3692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:52 smithi179 bash[23186]: audit 2024-09-20T23:42:51.260252+0000 mon.a (mon.0) 3690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:52 smithi179 bash[23186]: audit 2024-09-20T23:42:51.266305+0000 mon.a (mon.0) 3691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:52 smithi179 bash[23186]: audit 2024-09-20T23:42:51.271241+0000 mon.a (mon.0) 3692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:42:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:53 smithi049 bash[23528]: cluster 2024-09-20T23:42:52.081512+0000 mgr.a (mgr.14388) 3820 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:53 smithi044 bash[22676]: cluster 2024-09-20T23:42:52.081512+0000 mgr.a (mgr.14388) 3820 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:53 smithi179 bash[23186]: cluster 2024-09-20T23:42:52.081512+0000 mgr.a (mgr.14388) 3820 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:54.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:42:54.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:42:54.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:42:54.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:42:54.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:42:54.859 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:42:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:55 smithi049 bash[23528]: cluster 2024-09-20T23:42:54.082220+0000 mgr.a (mgr.14388) 3821 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:55 smithi049 bash[23528]: audit 2024-09-20T23:42:54.433909+0000 mgr.a (mgr.14388) 3822 : audit [DBG] from='client.93171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:55 smithi044 bash[22676]: cluster 2024-09-20T23:42:54.082220+0000 mgr.a (mgr.14388) 3821 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:55 smithi044 bash[22676]: audit 2024-09-20T23:42:54.433909+0000 mgr.a (mgr.14388) 3822 : audit [DBG] from='client.93171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:55 smithi179 bash[23186]: cluster 2024-09-20T23:42:54.082220+0000 mgr.a (mgr.14388) 3821 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:55 smithi179 bash[23186]: audit 2024-09-20T23:42:54.433909+0000 mgr.a (mgr.14388) 3822 : audit [DBG] from='client.93171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:42:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:57 smithi049 bash[23528]: cluster 2024-09-20T23:42:56.084544+0000 mgr.a (mgr.14388) 3823 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:57 smithi044 bash[22676]: cluster 2024-09-20T23:42:56.084544+0000 mgr.a (mgr.14388) 3823 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:57 smithi179 bash[23186]: cluster 2024-09-20T23:42:56.084544+0000 mgr.a (mgr.14388) 3823 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:42:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:42:59 smithi049 bash[23528]: cluster 2024-09-20T23:42:58.085298+0000 mgr.a (mgr.14388) 3824 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:42:59 smithi044 bash[22676]: cluster 2024-09-20T23:42:58.085298+0000 mgr.a (mgr.14388) 3824 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:42:59 smithi179 bash[23186]: cluster 2024-09-20T23:42:58.085298+0000 mgr.a (mgr.14388) 3824 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:42:59.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:42:59.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:42:59.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:00.642 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:00.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:00.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:00.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:00.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:01 smithi049 bash[23528]: cluster 2024-09-20T23:43:00.087107+0000 mgr.a (mgr.14388) 3825 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:01 smithi049 bash[23528]: audit 2024-09-20T23:43:00.194032+0000 mgr.a (mgr.14388) 3826 : audit [DBG] from='client.93249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:01 smithi044 bash[22676]: cluster 2024-09-20T23:43:00.087107+0000 mgr.a (mgr.14388) 3825 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:01 smithi044 bash[22676]: audit 2024-09-20T23:43:00.194032+0000 mgr.a (mgr.14388) 3826 : audit [DBG] from='client.93249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:01 smithi179 bash[23186]: cluster 2024-09-20T23:43:00.087107+0000 mgr.a (mgr.14388) 3825 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:01 smithi179 bash[23186]: audit 2024-09-20T23:43:00.194032+0000 mgr.a (mgr.14388) 3826 : audit [DBG] from='client.93249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:03 smithi049 bash[23528]: cluster 2024-09-20T23:43:02.088005+0000 mgr.a (mgr.14388) 3827 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:43:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:03 smithi044 bash[22676]: cluster 2024-09-20T23:43:02.088005+0000 mgr.a (mgr.14388) 3827 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:43:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:03 smithi179 bash[23186]: cluster 2024-09-20T23:43:02.088005+0000 mgr.a (mgr.14388) 3827 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:43:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:05 smithi049 bash[23528]: cluster 2024-09-20T23:43:04.088805+0000 mgr.a (mgr.14388) 3828 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:05.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:05.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:05.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:05 smithi044 bash[22676]: cluster 2024-09-20T23:43:04.088805+0000 mgr.a (mgr.14388) 3828 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:05 smithi179 bash[23186]: cluster 2024-09-20T23:43:04.088805+0000 mgr.a (mgr.14388) 3828 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:06.392 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:06.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:06.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:06.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:06.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:06 smithi179 bash[23186]: audit 2024-09-20T23:43:05.976523+0000 mgr.a (mgr.14388) 3829 : audit [DBG] from='client.93327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:06 smithi049 bash[23528]: audit 2024-09-20T23:43:05.976523+0000 mgr.a (mgr.14388) 3829 : audit [DBG] from='client.93327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:06 smithi044 bash[22676]: audit 2024-09-20T23:43:05.976523+0000 mgr.a (mgr.14388) 3829 : audit [DBG] from='client.93327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:07 smithi044 bash[22676]: cluster 2024-09-20T23:43:06.090294+0000 mgr.a (mgr.14388) 3830 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:07.737 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:07 smithi049 bash[23528]: cluster 2024-09-20T23:43:06.090294+0000 mgr.a (mgr.14388) 3830 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:07 smithi179 bash[23186]: cluster 2024-09-20T23:43:06.090294+0000 mgr.a (mgr.14388) 3830 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:09 smithi049 bash[23528]: cluster 2024-09-20T23:43:08.091159+0000 mgr.a (mgr.14388) 3831 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:09 smithi049 bash[23528]: audit 2024-09-20T23:43:08.781956+0000 mon.a (mon.0) 3693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:09 smithi049 bash[23528]: audit 2024-09-20T23:43:08.790695+0000 mon.a (mon.0) 3694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:09 smithi049 bash[23528]: audit 2024-09-20T23:43:08.800915+0000 mon.a (mon.0) 3695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:09 smithi044 bash[22676]: cluster 2024-09-20T23:43:08.091159+0000 mgr.a (mgr.14388) 3831 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:09 smithi044 bash[22676]: audit 2024-09-20T23:43:08.781956+0000 mon.a (mon.0) 3693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:09 smithi044 bash[22676]: audit 2024-09-20T23:43:08.790695+0000 mon.a (mon.0) 3694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:09 smithi044 bash[22676]: audit 2024-09-20T23:43:08.800915+0000 mon.a (mon.0) 3695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:09 smithi179 bash[23186]: cluster 2024-09-20T23:43:08.091159+0000 mgr.a (mgr.14388) 3831 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:09 smithi179 bash[23186]: audit 2024-09-20T23:43:08.781956+0000 mon.a (mon.0) 3693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:09 smithi179 bash[23186]: audit 2024-09-20T23:43:08.790695+0000 mon.a (mon.0) 3694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:09 smithi179 bash[23186]: audit 2024-09-20T23:43:08.800915+0000 mon.a (mon.0) 3695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:11.556 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:11 smithi044 bash[22676]: cluster 2024-09-20T23:43:10.093271+0000 mgr.a (mgr.14388) 3832 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:11.556 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:11 smithi044 bash[22676]: audit 2024-09-20T23:43:10.388513+0000 mon.a (mon.0) 3696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.556 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:11 smithi044 bash[22676]: audit 2024-09-20T23:43:10.397614+0000 mon.a (mon.0) 3697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.556 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:11 smithi044 bash[22676]: audit 2024-09-20T23:43:10.408381+0000 mon.a (mon.0) 3698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:11 smithi179 bash[23186]: cluster 2024-09-20T23:43:10.093271+0000 mgr.a (mgr.14388) 3832 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:11 smithi179 bash[23186]: audit 2024-09-20T23:43:10.388513+0000 mon.a (mon.0) 3696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:11 smithi179 bash[23186]: audit 2024-09-20T23:43:10.397614+0000 mon.a (mon.0) 3697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:11 smithi179 bash[23186]: audit 2024-09-20T23:43:10.408381+0000 mon.a (mon.0) 3698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:11 smithi049 bash[23528]: cluster 2024-09-20T23:43:10.093271+0000 mgr.a (mgr.14388) 3832 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:11 smithi049 bash[23528]: audit 2024-09-20T23:43:10.388513+0000 mon.a (mon.0) 3696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:11 smithi049 bash[23528]: audit 2024-09-20T23:43:10.397614+0000 mon.a (mon.0) 3697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:11 smithi049 bash[23528]: audit 2024-09-20T23:43:10.408381+0000 mon.a (mon.0) 3698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:12.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:12.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:12.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:12.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:12 smithi044 bash[22676]: audit 2024-09-20T23:43:11.401118+0000 mon.a (mon.0) 3699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:12 smithi044 bash[22676]: audit 2024-09-20T23:43:11.406983+0000 mon.a (mon.0) 3700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:12 smithi044 bash[22676]: audit 2024-09-20T23:43:11.412438+0000 mon.a (mon.0) 3701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:12 smithi044 bash[22676]: audit 2024-09-20T23:43:11.709284+0000 mgr.a (mgr.14388) 3833 : audit [DBG] from='client.93402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:12 smithi179 bash[23186]: audit 2024-09-20T23:43:11.401118+0000 mon.a (mon.0) 3699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:12 smithi179 bash[23186]: audit 2024-09-20T23:43:11.406983+0000 mon.a (mon.0) 3700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:12 smithi179 bash[23186]: audit 2024-09-20T23:43:11.412438+0000 mon.a (mon.0) 3701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:12 smithi179 bash[23186]: audit 2024-09-20T23:43:11.709284+0000 mgr.a (mgr.14388) 3833 : audit [DBG] from='client.93402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:12 smithi049 bash[23528]: audit 2024-09-20T23:43:11.401118+0000 mon.a (mon.0) 3699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:12 smithi049 bash[23528]: audit 2024-09-20T23:43:11.406983+0000 mon.a (mon.0) 3700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:12 smithi049 bash[23528]: audit 2024-09-20T23:43:11.412438+0000 mon.a (mon.0) 3701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:12 smithi049 bash[23528]: audit 2024-09-20T23:43:11.709284+0000 mgr.a (mgr.14388) 3833 : audit [DBG] from='client.93402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:13.689 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:13 smithi044 bash[22676]: cluster 2024-09-20T23:43:12.093762+0000 mgr.a (mgr.14388) 3834 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:13 smithi179 bash[23186]: cluster 2024-09-20T23:43:12.093762+0000 mgr.a (mgr.14388) 3834 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:13 smithi049 bash[23528]: cluster 2024-09-20T23:43:12.093762+0000 mgr.a (mgr.14388) 3834 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:15 smithi044 bash[22676]: cluster 2024-09-20T23:43:14.094474+0000 mgr.a (mgr.14388) 3835 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:15 smithi179 bash[23186]: cluster 2024-09-20T23:43:14.094474+0000 mgr.a (mgr.14388) 3835 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:15 smithi049 bash[23528]: cluster 2024-09-20T23:43:14.094474+0000 mgr.a (mgr.14388) 3835 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:17.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:17 smithi044 bash[22676]: cluster 2024-09-20T23:43:16.096677+0000 mgr.a (mgr.14388) 3836 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:43:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:17 smithi179 bash[23186]: cluster 2024-09-20T23:43:16.096677+0000 mgr.a (mgr.14388) 3836 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:43:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:17 smithi049 bash[23528]: cluster 2024-09-20T23:43:16.096677+0000 mgr.a (mgr.14388) 3836 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:43:17.913 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:17.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:17.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:17.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:17.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:18 smithi044 bash[22676]: audit 2024-09-20T23:43:17.472318+0000 mgr.a (mgr.14388) 3837 : audit [DBG] from='client.93480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:18 smithi179 bash[23186]: audit 2024-09-20T23:43:17.472318+0000 mgr.a (mgr.14388) 3837 : audit [DBG] from='client.93480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:18 smithi049 bash[23528]: audit 2024-09-20T23:43:17.472318+0000 mgr.a (mgr.14388) 3837 : audit [DBG] from='client.93480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:19.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22930]: debug 2024-09-20T23:43:19.641+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:43:19.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22930]: debug 2024-09-20T23:43:19.641+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:43:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22676]: cluster 2024-09-20T23:43:18.097738+0000 mgr.a (mgr.14388) 3838 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22676]: audit 2024-09-20T23:43:18.846668+0000 mon.a (mon.0) 3702 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:43:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22676]: audit 2024-09-20T23:43:18.854253+0000 mon.a (mon.0) 3703 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:43:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22676]: audit 2024-09-20T23:43:18.856059+0000 mon.a (mon.0) 3704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:43:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22676]: audit 2024-09-20T23:43:18.867341+0000 mon.a (mon.0) 3705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22676]: audit 2024-09-20T23:43:18.873842+0000 mon.a (mon.0) 3706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:43:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:19 smithi044 bash[22676]: audit 2024-09-20T23:43:18.876413+0000 mgr.a (mgr.14388) 3839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:43:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:19 smithi179 bash[23186]: cluster 2024-09-20T23:43:18.097738+0000 mgr.a (mgr.14388) 3838 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:19 smithi179 bash[23186]: audit 2024-09-20T23:43:18.846668+0000 mon.a (mon.0) 3702 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:43:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:19 smithi179 bash[23186]: audit 2024-09-20T23:43:18.854253+0000 mon.a (mon.0) 3703 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:43:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:19 smithi179 bash[23186]: audit 2024-09-20T23:43:18.856059+0000 mon.a (mon.0) 3704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:43:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:19 smithi179 bash[23186]: audit 2024-09-20T23:43:18.867341+0000 mon.a (mon.0) 3705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:19 smithi179 bash[23186]: audit 2024-09-20T23:43:18.873842+0000 mon.a (mon.0) 3706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:43:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:19 smithi179 bash[23186]: audit 2024-09-20T23:43:18.876413+0000 mgr.a (mgr.14388) 3839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:19 smithi049 bash[23528]: cluster 2024-09-20T23:43:18.097738+0000 mgr.a (mgr.14388) 3838 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:19 smithi049 bash[23528]: audit 2024-09-20T23:43:18.846668+0000 mon.a (mon.0) 3702 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:19 smithi049 bash[23528]: audit 2024-09-20T23:43:18.854253+0000 mon.a (mon.0) 3703 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:19 smithi049 bash[23528]: audit 2024-09-20T23:43:18.856059+0000 mon.a (mon.0) 3704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:19 smithi049 bash[23528]: audit 2024-09-20T23:43:18.867341+0000 mon.a (mon.0) 3705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:19 smithi049 bash[23528]: audit 2024-09-20T23:43:18.873842+0000 mon.a (mon.0) 3706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:19 smithi049 bash[23528]: audit 2024-09-20T23:43:18.876413+0000 mgr.a (mgr.14388) 3839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:43:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:20 smithi044 bash[22676]: audit 2024-09-20T23:43:19.647836+0000 mgr.a (mgr.14388) 3840 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:43:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:20 smithi044 bash[22676]: cephadm 2024-09-20T23:43:19.649125+0000 mgr.a (mgr.14388) 3841 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:43:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:20 smithi179 bash[23186]: audit 2024-09-20T23:43:19.647836+0000 mgr.a (mgr.14388) 3840 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:43:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:20 smithi179 bash[23186]: cephadm 2024-09-20T23:43:19.649125+0000 mgr.a (mgr.14388) 3841 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:43:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:20 smithi049 bash[23528]: audit 2024-09-20T23:43:19.647836+0000 mgr.a (mgr.14388) 3840 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:43:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:20 smithi049 bash[23528]: cephadm 2024-09-20T23:43:19.649125+0000 mgr.a (mgr.14388) 3841 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:43:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:21 smithi044 bash[22676]: cluster 2024-09-20T23:43:20.100003+0000 mgr.a (mgr.14388) 3842 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:21 smithi179 bash[23186]: cluster 2024-09-20T23:43:20.100003+0000 mgr.a (mgr.14388) 3842 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:21 smithi049 bash[23528]: cluster 2024-09-20T23:43:20.100003+0000 mgr.a (mgr.14388) 3842 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:23.674 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:23.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:23.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:23 smithi044 bash[22676]: cluster 2024-09-20T23:43:22.100807+0000 mgr.a (mgr.14388) 3843 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:23 smithi179 bash[23186]: cluster 2024-09-20T23:43:22.100807+0000 mgr.a (mgr.14388) 3843 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:23 smithi049 bash[23528]: cluster 2024-09-20T23:43:22.100807+0000 mgr.a (mgr.14388) 3843 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:24 smithi044 bash[22676]: audit 2024-09-20T23:43:23.248725+0000 mgr.a (mgr.14388) 3844 : audit [DBG] from='client.93660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:24 smithi179 bash[23186]: audit 2024-09-20T23:43:23.248725+0000 mgr.a (mgr.14388) 3844 : audit [DBG] from='client.93660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:24 smithi049 bash[23528]: audit 2024-09-20T23:43:23.248725+0000 mgr.a (mgr.14388) 3844 : audit [DBG] from='client.93660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:25 smithi044 bash[22676]: cluster 2024-09-20T23:43:24.101741+0000 mgr.a (mgr.14388) 3845 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:25 smithi179 bash[23186]: cluster 2024-09-20T23:43:24.101741+0000 mgr.a (mgr.14388) 3845 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:25 smithi049 bash[23528]: cluster 2024-09-20T23:43:24.101741+0000 mgr.a (mgr.14388) 3845 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:27 smithi044 bash[22676]: cluster 2024-09-20T23:43:26.103950+0000 mgr.a (mgr.14388) 3846 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:27 smithi179 bash[23186]: cluster 2024-09-20T23:43:26.103950+0000 mgr.a (mgr.14388) 3846 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:27 smithi049 bash[23528]: cluster 2024-09-20T23:43:26.103950+0000 mgr.a (mgr.14388) 3846 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:28.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:28.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:30 smithi179 bash[23186]: cluster 2024-09-20T23:43:28.104732+0000 mgr.a (mgr.14388) 3847 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:30 smithi179 bash[23186]: audit 2024-09-20T23:43:29.002018+0000 mon.a (mon.0) 3707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:30 smithi179 bash[23186]: audit 2024-09-20T23:43:29.011163+0000 mgr.a (mgr.14388) 3848 : audit [DBG] from='client.93738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:30 smithi179 bash[23186]: audit 2024-09-20T23:43:29.011598+0000 mon.a (mon.0) 3708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:30 smithi179 bash[23186]: audit 2024-09-20T23:43:29.041459+0000 mon.a (mon.0) 3709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:30 smithi049 bash[23528]: cluster 2024-09-20T23:43:28.104732+0000 mgr.a (mgr.14388) 3847 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:30 smithi049 bash[23528]: audit 2024-09-20T23:43:29.002018+0000 mon.a (mon.0) 3707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:30 smithi049 bash[23528]: audit 2024-09-20T23:43:29.011163+0000 mgr.a (mgr.14388) 3848 : audit [DBG] from='client.93738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:30 smithi049 bash[23528]: audit 2024-09-20T23:43:29.011598+0000 mon.a (mon.0) 3708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:30 smithi049 bash[23528]: audit 2024-09-20T23:43:29.041459+0000 mon.a (mon.0) 3709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:30 smithi044 bash[22676]: cluster 2024-09-20T23:43:28.104732+0000 mgr.a (mgr.14388) 3847 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:30 smithi044 bash[22676]: audit 2024-09-20T23:43:29.002018+0000 mon.a (mon.0) 3707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:30 smithi044 bash[22676]: audit 2024-09-20T23:43:29.011163+0000 mgr.a (mgr.14388) 3848 : audit [DBG] from='client.93738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:30 smithi044 bash[22676]: audit 2024-09-20T23:43:29.011598+0000 mon.a (mon.0) 3708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:30 smithi044 bash[22676]: audit 2024-09-20T23:43:29.041459+0000 mon.a (mon.0) 3709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:31 smithi044 bash[22676]: cluster 2024-09-20T23:43:30.107012+0000 mgr.a (mgr.14388) 3849 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:31 smithi044 bash[22676]: audit 2024-09-20T23:43:30.620595+0000 mon.a (mon.0) 3710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:31 smithi044 bash[22676]: audit 2024-09-20T23:43:30.630483+0000 mon.a (mon.0) 3711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:31 smithi044 bash[22676]: audit 2024-09-20T23:43:30.641114+0000 mon.a (mon.0) 3712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:31 smithi179 bash[23186]: cluster 2024-09-20T23:43:30.107012+0000 mgr.a (mgr.14388) 3849 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:31 smithi179 bash[23186]: audit 2024-09-20T23:43:30.620595+0000 mon.a (mon.0) 3710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:31 smithi179 bash[23186]: audit 2024-09-20T23:43:30.630483+0000 mon.a (mon.0) 3711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:31 smithi179 bash[23186]: audit 2024-09-20T23:43:30.641114+0000 mon.a (mon.0) 3712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:31 smithi049 bash[23528]: cluster 2024-09-20T23:43:30.107012+0000 mgr.a (mgr.14388) 3849 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:43:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:31 smithi049 bash[23528]: audit 2024-09-20T23:43:30.620595+0000 mon.a (mon.0) 3710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:31 smithi049 bash[23528]: audit 2024-09-20T23:43:30.630483+0000 mon.a (mon.0) 3711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:31 smithi049 bash[23528]: audit 2024-09-20T23:43:30.641114+0000 mon.a (mon.0) 3712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:32 smithi044 bash[22676]: audit 2024-09-20T23:43:31.629604+0000 mon.a (mon.0) 3713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:32 smithi044 bash[22676]: audit 2024-09-20T23:43:31.637053+0000 mon.a (mon.0) 3714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:32 smithi044 bash[22676]: audit 2024-09-20T23:43:31.646530+0000 mon.a (mon.0) 3715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:32 smithi179 bash[23186]: audit 2024-09-20T23:43:31.629604+0000 mon.a (mon.0) 3713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:32 smithi179 bash[23186]: audit 2024-09-20T23:43:31.637053+0000 mon.a (mon.0) 3714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:32 smithi179 bash[23186]: audit 2024-09-20T23:43:31.646530+0000 mon.a (mon.0) 3715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:32 smithi049 bash[23528]: audit 2024-09-20T23:43:31.629604+0000 mon.a (mon.0) 3713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:32 smithi049 bash[23528]: audit 2024-09-20T23:43:31.637053+0000 mon.a (mon.0) 3714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:32 smithi049 bash[23528]: audit 2024-09-20T23:43:31.646530+0000 mon.a (mon.0) 3715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:33.898 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:33 smithi044 bash[22676]: cluster 2024-09-20T23:43:32.107623+0000 mgr.a (mgr.14388) 3850 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:33 smithi179 bash[23186]: cluster 2024-09-20T23:43:32.107623+0000 mgr.a (mgr.14388) 3850 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:33 smithi049 bash[23528]: cluster 2024-09-20T23:43:32.107623+0000 mgr.a (mgr.14388) 3850 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:35.255 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:35.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:35 smithi044 bash[22676]: cluster 2024-09-20T23:43:34.108194+0000 mgr.a (mgr.14388) 3851 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:35 smithi044 bash[22676]: audit 2024-09-20T23:43:34.808159+0000 mgr.a (mgr.14388) 3852 : audit [DBG] from='client.93813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:35 smithi179 bash[23186]: cluster 2024-09-20T23:43:34.108194+0000 mgr.a (mgr.14388) 3851 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:35 smithi179 bash[23186]: audit 2024-09-20T23:43:34.808159+0000 mgr.a (mgr.14388) 3852 : audit [DBG] from='client.93813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:35 smithi049 bash[23528]: cluster 2024-09-20T23:43:34.108194+0000 mgr.a (mgr.14388) 3851 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:35 smithi049 bash[23528]: audit 2024-09-20T23:43:34.808159+0000 mgr.a (mgr.14388) 3852 : audit [DBG] from='client.93813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:37 smithi044 bash[22676]: cluster 2024-09-20T23:43:36.110919+0000 mgr.a (mgr.14388) 3853 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:43:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:37 smithi179 bash[23186]: cluster 2024-09-20T23:43:36.110919+0000 mgr.a (mgr.14388) 3853 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:43:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:37 smithi049 bash[23528]: cluster 2024-09-20T23:43:36.110919+0000 mgr.a (mgr.14388) 3853 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:43:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:39 smithi044 bash[22676]: cluster 2024-09-20T23:43:38.111710+0000 mgr.a (mgr.14388) 3854 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:43:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:39 smithi179 bash[23186]: cluster 2024-09-20T23:43:38.111710+0000 mgr.a (mgr.14388) 3854 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:43:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:39 smithi049 bash[23528]: cluster 2024-09-20T23:43:38.111710+0000 mgr.a (mgr.14388) 3854 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:43:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:40.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:40.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:41.010 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:41 smithi044 bash[22676]: cluster 2024-09-20T23:43:40.113657+0000 mgr.a (mgr.14388) 3855 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:41 smithi044 bash[22676]: audit 2024-09-20T23:43:40.588423+0000 mgr.a (mgr.14388) 3856 : audit [DBG] from='client.93891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:41 smithi179 bash[23186]: cluster 2024-09-20T23:43:40.113657+0000 mgr.a (mgr.14388) 3855 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:41 smithi179 bash[23186]: audit 2024-09-20T23:43:40.588423+0000 mgr.a (mgr.14388) 3856 : audit [DBG] from='client.93891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:41 smithi049 bash[23528]: cluster 2024-09-20T23:43:40.113657+0000 mgr.a (mgr.14388) 3855 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:41 smithi049 bash[23528]: audit 2024-09-20T23:43:40.588423+0000 mgr.a (mgr.14388) 3856 : audit [DBG] from='client.93891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:43.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:43 smithi179 bash[23186]: cluster 2024-09-20T23:43:42.114730+0000 mgr.a (mgr.14388) 3857 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:43:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:43 smithi044 bash[22676]: cluster 2024-09-20T23:43:42.114730+0000 mgr.a (mgr.14388) 3857 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:43:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:43 smithi049 bash[23528]: cluster 2024-09-20T23:43:42.114730+0000 mgr.a (mgr.14388) 3857 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:43:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:45 smithi179 bash[23186]: cluster 2024-09-20T23:43:44.115621+0000 mgr.a (mgr.14388) 3858 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:45 smithi044 bash[22676]: cluster 2024-09-20T23:43:44.115621+0000 mgr.a (mgr.14388) 3858 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:46.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:46.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:46.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:45 smithi049 bash[23528]: cluster 2024-09-20T23:43:44.115621+0000 mgr.a (mgr.14388) 3858 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:43:46.773 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:46.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:46.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:46.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:46.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:47 smithi044 bash[22676]: cluster 2024-09-20T23:43:46.116649+0000 mgr.a (mgr.14388) 3859 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:47 smithi044 bash[22676]: audit 2024-09-20T23:43:46.347899+0000 mgr.a (mgr.14388) 3860 : audit [DBG] from='client.93969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:47 smithi179 bash[23186]: cluster 2024-09-20T23:43:46.116649+0000 mgr.a (mgr.14388) 3859 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:47 smithi179 bash[23186]: audit 2024-09-20T23:43:46.347899+0000 mgr.a (mgr.14388) 3860 : audit [DBG] from='client.93969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:47 smithi049 bash[23528]: cluster 2024-09-20T23:43:46.116649+0000 mgr.a (mgr.14388) 3859 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:47 smithi049 bash[23528]: audit 2024-09-20T23:43:46.347899+0000 mgr.a (mgr.14388) 3860 : audit [DBG] from='client.93969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:49.967 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:49 smithi049 bash[23528]: cluster 2024-09-20T23:43:48.117609+0000 mgr.a (mgr.14388) 3861 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:43:49.968 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:49 smithi049 bash[23528]: audit 2024-09-20T23:43:49.231622+0000 mon.a (mon.0) 3716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:49.968 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:49 smithi049 bash[23528]: audit 2024-09-20T23:43:49.240435+0000 mon.a (mon.0) 3717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:49.968 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:49 smithi049 bash[23528]: audit 2024-09-20T23:43:49.251099+0000 mon.a (mon.0) 3718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:49 smithi044 bash[22676]: cluster 2024-09-20T23:43:48.117609+0000 mgr.a (mgr.14388) 3861 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:43:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:49 smithi044 bash[22676]: audit 2024-09-20T23:43:49.231622+0000 mon.a (mon.0) 3716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:49 smithi044 bash[22676]: audit 2024-09-20T23:43:49.240435+0000 mon.a (mon.0) 3717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:49 smithi044 bash[22676]: audit 2024-09-20T23:43:49.251099+0000 mon.a (mon.0) 3718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:49 smithi179 bash[23186]: cluster 2024-09-20T23:43:48.117609+0000 mgr.a (mgr.14388) 3861 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:43:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:49 smithi179 bash[23186]: audit 2024-09-20T23:43:49.231622+0000 mon.a (mon.0) 3716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:49 smithi179 bash[23186]: audit 2024-09-20T23:43:49.240435+0000 mon.a (mon.0) 3717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:49 smithi179 bash[23186]: audit 2024-09-20T23:43:49.251099+0000 mon.a (mon.0) 3718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:51.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:51.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:51.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:51 smithi044 bash[22676]: cluster 2024-09-20T23:43:50.119702+0000 mgr.a (mgr.14388) 3862 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:43:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:51 smithi044 bash[22676]: audit 2024-09-20T23:43:50.853863+0000 mon.a (mon.0) 3719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:51 smithi044 bash[22676]: audit 2024-09-20T23:43:50.863607+0000 mon.a (mon.0) 3720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:51 smithi044 bash[22676]: audit 2024-09-20T23:43:50.875073+0000 mon.a (mon.0) 3721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:51 smithi044 bash[22676]: audit 2024-09-20T23:43:51.841724+0000 mon.a (mon.0) 3722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:51 smithi179 bash[23186]: cluster 2024-09-20T23:43:50.119702+0000 mgr.a (mgr.14388) 3862 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:43:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:51 smithi179 bash[23186]: audit 2024-09-20T23:43:50.853863+0000 mon.a (mon.0) 3719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:51 smithi179 bash[23186]: audit 2024-09-20T23:43:50.863607+0000 mon.a (mon.0) 3720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:51 smithi179 bash[23186]: audit 2024-09-20T23:43:50.875073+0000 mon.a (mon.0) 3721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:51 smithi179 bash[23186]: audit 2024-09-20T23:43:51.841724+0000 mon.a (mon.0) 3722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:51 smithi049 bash[23528]: cluster 2024-09-20T23:43:50.119702+0000 mgr.a (mgr.14388) 3862 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:43:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:51 smithi049 bash[23528]: audit 2024-09-20T23:43:50.853863+0000 mon.a (mon.0) 3719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:51 smithi049 bash[23528]: audit 2024-09-20T23:43:50.863607+0000 mon.a (mon.0) 3720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:51 smithi049 bash[23528]: audit 2024-09-20T23:43:50.875073+0000 mon.a (mon.0) 3721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:51 smithi049 bash[23528]: audit 2024-09-20T23:43:51.841724+0000 mon.a (mon.0) 3722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:52.535 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:52.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:52.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:52.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:52.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:53.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:52 smithi044 bash[22676]: audit 2024-09-20T23:43:51.850478+0000 mon.a (mon.0) 3723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:53.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:52 smithi044 bash[22676]: audit 2024-09-20T23:43:51.864817+0000 mon.a (mon.0) 3724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:52 smithi179 bash[23186]: audit 2024-09-20T23:43:51.850478+0000 mon.a (mon.0) 3723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:52 smithi179 bash[23186]: audit 2024-09-20T23:43:51.864817+0000 mon.a (mon.0) 3724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:52 smithi049 bash[23528]: audit 2024-09-20T23:43:51.850478+0000 mon.a (mon.0) 3723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:52 smithi049 bash[23528]: audit 2024-09-20T23:43:51.864817+0000 mon.a (mon.0) 3724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:43:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:53 smithi044 bash[22676]: audit 2024-09-20T23:43:52.098410+0000 mgr.a (mgr.14388) 3863 : audit [DBG] from='client.94044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:53 smithi044 bash[22676]: cluster 2024-09-20T23:43:52.120827+0000 mgr.a (mgr.14388) 3864 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:53 smithi179 bash[23186]: audit 2024-09-20T23:43:52.098410+0000 mgr.a (mgr.14388) 3863 : audit [DBG] from='client.94044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:53 smithi179 bash[23186]: cluster 2024-09-20T23:43:52.120827+0000 mgr.a (mgr.14388) 3864 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:53 smithi049 bash[23528]: audit 2024-09-20T23:43:52.098410+0000 mgr.a (mgr.14388) 3863 : audit [DBG] from='client.94044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:53 smithi049 bash[23528]: cluster 2024-09-20T23:43:52.120827+0000 mgr.a (mgr.14388) 3864 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:55 smithi044 bash[22676]: cluster 2024-09-20T23:43:54.121890+0000 mgr.a (mgr.14388) 3865 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:55 smithi179 bash[23186]: cluster 2024-09-20T23:43:54.121890+0000 mgr.a (mgr.14388) 3865 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:55 smithi049 bash[23528]: cluster 2024-09-20T23:43:54.121890+0000 mgr.a (mgr.14388) 3865 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:43:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:43:57.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:43:57.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:43:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:57 smithi044 bash[22676]: cluster 2024-09-20T23:43:56.124151+0000 mgr.a (mgr.14388) 3866 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:43:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:57 smithi179 bash[23186]: cluster 2024-09-20T23:43:56.124151+0000 mgr.a (mgr.14388) 3866 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:43:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:57 smithi049 bash[23528]: cluster 2024-09-20T23:43:56.124151+0000 mgr.a (mgr.14388) 3866 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:43:58.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:43:58.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:43:58.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:43:58.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:43:58.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:43:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:58 smithi044 bash[22676]: audit 2024-09-20T23:43:57.880249+0000 mgr.a (mgr.14388) 3867 : audit [DBG] from='client.94122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:58 smithi179 bash[23186]: audit 2024-09-20T23:43:57.880249+0000 mgr.a (mgr.14388) 3867 : audit [DBG] from='client.94122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:43:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:58 smithi049 bash[23528]: audit 2024-09-20T23:43:57.880249+0000 mgr.a (mgr.14388) 3867 : audit [DBG] from='client.94122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:43:59 smithi044 bash[22676]: cluster 2024-09-20T23:43:58.124792+0000 mgr.a (mgr.14388) 3868 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:43:59 smithi179 bash[23186]: cluster 2024-09-20T23:43:58.124792+0000 mgr.a (mgr.14388) 3868 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:43:59 smithi049 bash[23528]: cluster 2024-09-20T23:43:58.124792+0000 mgr.a (mgr.14388) 3868 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:01 smithi044 bash[22676]: cluster 2024-09-20T23:44:00.127064+0000 mgr.a (mgr.14388) 3869 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:01 smithi179 bash[23186]: cluster 2024-09-20T23:44:00.127064+0000 mgr.a (mgr.14388) 3869 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:01 smithi049 bash[23528]: cluster 2024-09-20T23:44:00.127064+0000 mgr.a (mgr.14388) 3869 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:03.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:03.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:04.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:04.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:04.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:04.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:04.073 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:04.151 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:03 smithi179 bash[23186]: cluster 2024-09-20T23:44:02.127992+0000 mgr.a (mgr.14388) 3870 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:03 smithi044 bash[22676]: cluster 2024-09-20T23:44:02.127992+0000 mgr.a (mgr.14388) 3870 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:03 smithi049 bash[23528]: cluster 2024-09-20T23:44:02.127992+0000 mgr.a (mgr.14388) 3870 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:04 smithi044 bash[22676]: audit 2024-09-20T23:44:03.652125+0000 mgr.a (mgr.14388) 3871 : audit [DBG] from='client.94197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:04 smithi179 bash[23186]: audit 2024-09-20T23:44:03.652125+0000 mgr.a (mgr.14388) 3871 : audit [DBG] from='client.94197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:04 smithi049 bash[23528]: audit 2024-09-20T23:44:03.652125+0000 mgr.a (mgr.14388) 3871 : audit [DBG] from='client.94197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:05 smithi044 bash[22676]: cluster 2024-09-20T23:44:04.128835+0000 mgr.a (mgr.14388) 3872 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:05 smithi179 bash[23186]: cluster 2024-09-20T23:44:04.128835+0000 mgr.a (mgr.14388) 3872 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:05 smithi049 bash[23528]: cluster 2024-09-20T23:44:04.128835+0000 mgr.a (mgr.14388) 3872 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:07 smithi044 bash[22676]: cluster 2024-09-20T23:44:06.131160+0000 mgr.a (mgr.14388) 3873 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:07 smithi179 bash[23186]: cluster 2024-09-20T23:44:06.131160+0000 mgr.a (mgr.14388) 3873 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:07 smithi049 bash[23528]: cluster 2024-09-20T23:44:06.131160+0000 mgr.a (mgr.14388) 3873 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:09.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:09.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:09.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:09.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:09.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:09.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:09.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:09.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:09 smithi044 bash[22676]: cluster 2024-09-20T23:44:08.131912+0000 mgr.a (mgr.14388) 3874 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:09 smithi044 bash[22676]: audit 2024-09-20T23:44:09.465033+0000 mon.a (mon.0) 3725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:09 smithi044 bash[22676]: audit 2024-09-20T23:44:09.470225+0000 mon.a (mon.0) 3726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:09 smithi044 bash[22676]: audit 2024-09-20T23:44:09.475621+0000 mon.a (mon.0) 3727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:09 smithi179 bash[23186]: cluster 2024-09-20T23:44:08.131912+0000 mgr.a (mgr.14388) 3874 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:09 smithi179 bash[23186]: audit 2024-09-20T23:44:09.465033+0000 mon.a (mon.0) 3725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:09 smithi179 bash[23186]: audit 2024-09-20T23:44:09.470225+0000 mon.a (mon.0) 3726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:09 smithi179 bash[23186]: audit 2024-09-20T23:44:09.475621+0000 mon.a (mon.0) 3727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:09 smithi049 bash[23528]: cluster 2024-09-20T23:44:08.131912+0000 mgr.a (mgr.14388) 3874 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:09 smithi049 bash[23528]: audit 2024-09-20T23:44:09.465033+0000 mon.a (mon.0) 3725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:09 smithi049 bash[23528]: audit 2024-09-20T23:44:09.470225+0000 mon.a (mon.0) 3726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:09 smithi049 bash[23528]: audit 2024-09-20T23:44:09.475621+0000 mon.a (mon.0) 3727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:10 smithi044 bash[22676]: audit 2024-09-20T23:44:09.406142+0000 mgr.a (mgr.14388) 3875 : audit [DBG] from='client.94275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:10 smithi179 bash[23186]: audit 2024-09-20T23:44:09.406142+0000 mgr.a (mgr.14388) 3875 : audit [DBG] from='client.94275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:10 smithi049 bash[23528]: audit 2024-09-20T23:44:09.406142+0000 mgr.a (mgr.14388) 3875 : audit [DBG] from='client.94275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:11 smithi044 bash[22676]: cluster 2024-09-20T23:44:10.134255+0000 mgr.a (mgr.14388) 3876 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:11 smithi044 bash[22676]: audit 2024-09-20T23:44:11.090004+0000 mon.a (mon.0) 3728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:11 smithi044 bash[22676]: audit 2024-09-20T23:44:11.099413+0000 mon.a (mon.0) 3729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:11 smithi044 bash[22676]: audit 2024-09-20T23:44:11.111218+0000 mon.a (mon.0) 3730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:11 smithi179 bash[23186]: cluster 2024-09-20T23:44:10.134255+0000 mgr.a (mgr.14388) 3876 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:11 smithi179 bash[23186]: audit 2024-09-20T23:44:11.090004+0000 mon.a (mon.0) 3728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:11 smithi179 bash[23186]: audit 2024-09-20T23:44:11.099413+0000 mon.a (mon.0) 3729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:11 smithi179 bash[23186]: audit 2024-09-20T23:44:11.111218+0000 mon.a (mon.0) 3730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:11 smithi049 bash[23528]: cluster 2024-09-20T23:44:10.134255+0000 mgr.a (mgr.14388) 3876 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:11 smithi049 bash[23528]: audit 2024-09-20T23:44:11.090004+0000 mon.a (mon.0) 3728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:11 smithi049 bash[23528]: audit 2024-09-20T23:44:11.099413+0000 mon.a (mon.0) 3729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:11 smithi049 bash[23528]: audit 2024-09-20T23:44:11.111218+0000 mon.a (mon.0) 3730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.346 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:13 smithi044 bash[22676]: audit 2024-09-20T23:44:12.085880+0000 mon.a (mon.0) 3731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.346 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:13 smithi044 bash[22676]: audit 2024-09-20T23:44:12.095626+0000 mon.a (mon.0) 3732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.346 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:13 smithi044 bash[22676]: audit 2024-09-20T23:44:12.107111+0000 mon.a (mon.0) 3733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.346 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:13 smithi044 bash[22676]: cluster 2024-09-20T23:44:12.135004+0000 mgr.a (mgr.14388) 3877 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:13 smithi179 bash[23186]: audit 2024-09-20T23:44:12.085880+0000 mon.a (mon.0) 3731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:13 smithi179 bash[23186]: audit 2024-09-20T23:44:12.095626+0000 mon.a (mon.0) 3732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:13 smithi179 bash[23186]: audit 2024-09-20T23:44:12.107111+0000 mon.a (mon.0) 3733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:13 smithi179 bash[23186]: cluster 2024-09-20T23:44:12.135004+0000 mgr.a (mgr.14388) 3877 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:13 smithi049 bash[23528]: audit 2024-09-20T23:44:12.085880+0000 mon.a (mon.0) 3731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:13 smithi049 bash[23528]: audit 2024-09-20T23:44:12.095626+0000 mon.a (mon.0) 3732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:13 smithi049 bash[23528]: audit 2024-09-20T23:44:12.107111+0000 mon.a (mon.0) 3733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:13 smithi049 bash[23528]: cluster 2024-09-20T23:44:12.135004+0000 mgr.a (mgr.14388) 3877 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:14.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:14.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:14.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:15 smithi044 bash[22676]: cluster 2024-09-20T23:44:14.135800+0000 mgr.a (mgr.14388) 3878 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:15 smithi179 bash[23186]: cluster 2024-09-20T23:44:14.135800+0000 mgr.a (mgr.14388) 3878 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:15 smithi049 bash[23528]: cluster 2024-09-20T23:44:14.135800+0000 mgr.a (mgr.14388) 3878 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:15.573 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:15.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:15.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:15.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:15.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:16 smithi044 bash[22676]: audit 2024-09-20T23:44:15.157072+0000 mgr.a (mgr.14388) 3879 : audit [DBG] from='client.94353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:16 smithi179 bash[23186]: audit 2024-09-20T23:44:15.157072+0000 mgr.a (mgr.14388) 3879 : audit [DBG] from='client.94353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:16 smithi049 bash[23528]: audit 2024-09-20T23:44:15.157072+0000 mgr.a (mgr.14388) 3879 : audit [DBG] from='client.94353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:17.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:17 smithi044 bash[22676]: cluster 2024-09-20T23:44:16.138665+0000 mgr.a (mgr.14388) 3880 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:17 smithi179 bash[23186]: cluster 2024-09-20T23:44:16.138665+0000 mgr.a (mgr.14388) 3880 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:17 smithi049 bash[23528]: cluster 2024-09-20T23:44:16.138665+0000 mgr.a (mgr.14388) 3880 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:19 smithi044 bash[22676]: cluster 2024-09-20T23:44:18.139611+0000 mgr.a (mgr.14388) 3881 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:44:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:19 smithi179 bash[23186]: cluster 2024-09-20T23:44:18.139611+0000 mgr.a (mgr.14388) 3881 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:44:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:19 smithi049 bash[23528]: cluster 2024-09-20T23:44:18.139611+0000 mgr.a (mgr.14388) 3881 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:44:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22676]: audit 2024-09-20T23:44:19.705699+0000 mon.a (mon.0) 3734 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:44:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22676]: audit 2024-09-20T23:44:19.712593+0000 mon.a (mon.0) 3735 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:44:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22676]: audit 2024-09-20T23:44:19.714387+0000 mon.a (mon.0) 3736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:44:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22676]: audit 2024-09-20T23:44:19.725563+0000 mon.a (mon.0) 3737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22676]: audit 2024-09-20T23:44:19.731925+0000 mon.a (mon.0) 3738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:44:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22676]: audit 2024-09-20T23:44:19.734522+0000 mgr.a (mgr.14388) 3882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:20 smithi179 bash[23186]: audit 2024-09-20T23:44:19.705699+0000 mon.a (mon.0) 3734 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:20 smithi179 bash[23186]: audit 2024-09-20T23:44:19.712593+0000 mon.a (mon.0) 3735 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:20 smithi179 bash[23186]: audit 2024-09-20T23:44:19.714387+0000 mon.a (mon.0) 3736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:20 smithi179 bash[23186]: audit 2024-09-20T23:44:19.725563+0000 mon.a (mon.0) 3737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:20 smithi179 bash[23186]: audit 2024-09-20T23:44:19.731925+0000 mon.a (mon.0) 3738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:20 smithi179 bash[23186]: audit 2024-09-20T23:44:19.734522+0000 mgr.a (mgr.14388) 3882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:44:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:20 smithi049 bash[23528]: audit 2024-09-20T23:44:19.705699+0000 mon.a (mon.0) 3734 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:44:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:20 smithi049 bash[23528]: audit 2024-09-20T23:44:19.712593+0000 mon.a (mon.0) 3735 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:44:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:20 smithi049 bash[23528]: audit 2024-09-20T23:44:19.714387+0000 mon.a (mon.0) 3736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:44:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:20 smithi049 bash[23528]: audit 2024-09-20T23:44:19.725563+0000 mon.a (mon.0) 3737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:20 smithi049 bash[23528]: audit 2024-09-20T23:44:19.731925+0000 mon.a (mon.0) 3738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:44:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:20 smithi049 bash[23528]: audit 2024-09-20T23:44:19.734522+0000 mgr.a (mgr.14388) 3882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:44:20.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:20.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:20.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:20.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22930]: debug 2024-09-20T23:44:20.512+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:44:20.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:44:20 smithi044 bash[22930]: debug 2024-09-20T23:44:20.512+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:44:21.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:21.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:21.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:21.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:21.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:21 smithi044 bash[22676]: cluster 2024-09-20T23:44:20.141062+0000 mgr.a (mgr.14388) 3883 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-20T23:44:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:21 smithi044 bash[22676]: audit 2024-09-20T23:44:20.513758+0000 mgr.a (mgr.14388) 3884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:44:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:21 smithi044 bash[22676]: cephadm 2024-09-20T23:44:20.515039+0000 mgr.a (mgr.14388) 3885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:44:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:21 smithi044 bash[22676]: audit 2024-09-20T23:44:20.906432+0000 mgr.a (mgr.14388) 3886 : audit [DBG] from='client.94539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:21 smithi179 bash[23186]: cluster 2024-09-20T23:44:20.141062+0000 mgr.a (mgr.14388) 3883 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-20T23:44:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:21 smithi179 bash[23186]: audit 2024-09-20T23:44:20.513758+0000 mgr.a (mgr.14388) 3884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:44:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:21 smithi179 bash[23186]: cephadm 2024-09-20T23:44:20.515039+0000 mgr.a (mgr.14388) 3885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:44:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:21 smithi179 bash[23186]: audit 2024-09-20T23:44:20.906432+0000 mgr.a (mgr.14388) 3886 : audit [DBG] from='client.94539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:21 smithi049 bash[23528]: cluster 2024-09-20T23:44:20.141062+0000 mgr.a (mgr.14388) 3883 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-20T23:44:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:21 smithi049 bash[23528]: audit 2024-09-20T23:44:20.513758+0000 mgr.a (mgr.14388) 3884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:44:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:21 smithi049 bash[23528]: cephadm 2024-09-20T23:44:20.515039+0000 mgr.a (mgr.14388) 3885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:44:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:21 smithi049 bash[23528]: audit 2024-09-20T23:44:20.906432+0000 mgr.a (mgr.14388) 3886 : audit [DBG] from='client.94539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:23 smithi044 bash[22676]: cluster 2024-09-20T23:44:22.142030+0000 mgr.a (mgr.14388) 3887 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-20T23:44:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:23 smithi179 bash[23186]: cluster 2024-09-20T23:44:22.142030+0000 mgr.a (mgr.14388) 3887 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-20T23:44:24.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:23 smithi049 bash[23528]: cluster 2024-09-20T23:44:22.142030+0000 mgr.a (mgr.14388) 3887 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-20T23:44:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:25 smithi044 bash[22676]: cluster 2024-09-20T23:44:24.142847+0000 mgr.a (mgr.14388) 3888 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-20T23:44:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:25 smithi179 bash[23186]: cluster 2024-09-20T23:44:24.142847+0000 mgr.a (mgr.14388) 3888 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-20T23:44:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:25 smithi049 bash[23528]: cluster 2024-09-20T23:44:24.142847+0000 mgr.a (mgr.14388) 3888 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-20T23:44:26.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:26.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:26.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:27.175 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:27 smithi179 bash[23186]: cluster 2024-09-20T23:44:26.145040+0000 mgr.a (mgr.14388) 3889 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:27 smithi179 bash[23186]: audit 2024-09-20T23:44:26.687264+0000 mgr.a (mgr.14388) 3890 : audit [DBG] from='client.94614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:27 smithi049 bash[23528]: cluster 2024-09-20T23:44:26.145040+0000 mgr.a (mgr.14388) 3889 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:27 smithi049 bash[23528]: audit 2024-09-20T23:44:26.687264+0000 mgr.a (mgr.14388) 3890 : audit [DBG] from='client.94614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:27 smithi044 bash[22676]: cluster 2024-09-20T23:44:26.145040+0000 mgr.a (mgr.14388) 3889 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:27 smithi044 bash[22676]: audit 2024-09-20T23:44:26.687264+0000 mgr.a (mgr.14388) 3890 : audit [DBG] from='client.94614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:29 smithi179 bash[23186]: cluster 2024-09-20T23:44:28.146165+0000 mgr.a (mgr.14388) 3891 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:29 smithi179 bash[23186]: audit 2024-09-20T23:44:29.692755+0000 mon.a (mon.0) 3739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:29 smithi179 bash[23186]: audit 2024-09-20T23:44:29.701629+0000 mon.a (mon.0) 3740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:29 smithi179 bash[23186]: audit 2024-09-20T23:44:29.711860+0000 mon.a (mon.0) 3741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:29 smithi049 bash[23528]: cluster 2024-09-20T23:44:28.146165+0000 mgr.a (mgr.14388) 3891 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:29 smithi049 bash[23528]: audit 2024-09-20T23:44:29.692755+0000 mon.a (mon.0) 3739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:29 smithi049 bash[23528]: audit 2024-09-20T23:44:29.701629+0000 mon.a (mon.0) 3740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:29 smithi049 bash[23528]: audit 2024-09-20T23:44:29.711860+0000 mon.a (mon.0) 3741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:29 smithi044 bash[22676]: cluster 2024-09-20T23:44:28.146165+0000 mgr.a (mgr.14388) 3891 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:29 smithi044 bash[22676]: audit 2024-09-20T23:44:29.692755+0000 mon.a (mon.0) 3739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:29 smithi044 bash[22676]: audit 2024-09-20T23:44:29.701629+0000 mon.a (mon.0) 3740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:29 smithi044 bash[22676]: audit 2024-09-20T23:44:29.711860+0000 mon.a (mon.0) 3741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:31 smithi179 bash[23186]: cluster 2024-09-20T23:44:30.148353+0000 mgr.a (mgr.14388) 3892 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:31 smithi179 bash[23186]: audit 2024-09-20T23:44:31.310958+0000 mon.a (mon.0) 3742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:31 smithi179 bash[23186]: audit 2024-09-20T23:44:31.320732+0000 mon.a (mon.0) 3743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:31 smithi179 bash[23186]: audit 2024-09-20T23:44:31.330543+0000 mon.a (mon.0) 3744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:31 smithi049 bash[23528]: cluster 2024-09-20T23:44:30.148353+0000 mgr.a (mgr.14388) 3892 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:31 smithi049 bash[23528]: audit 2024-09-20T23:44:31.310958+0000 mon.a (mon.0) 3742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:31 smithi049 bash[23528]: audit 2024-09-20T23:44:31.320732+0000 mon.a (mon.0) 3743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:31 smithi049 bash[23528]: audit 2024-09-20T23:44:31.330543+0000 mon.a (mon.0) 3744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:32.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:32.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:31 smithi044 bash[22676]: cluster 2024-09-20T23:44:30.148353+0000 mgr.a (mgr.14388) 3892 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:44:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:31 smithi044 bash[22676]: audit 2024-09-20T23:44:31.310958+0000 mon.a (mon.0) 3742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:31 smithi044 bash[22676]: audit 2024-09-20T23:44:31.320732+0000 mon.a (mon.0) 3743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:31 smithi044 bash[22676]: audit 2024-09-20T23:44:31.330543+0000 mon.a (mon.0) 3744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:32.971 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:32.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:32.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:32.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:32.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:33 smithi049 bash[23528]: cluster 2024-09-20T23:44:32.148921+0000 mgr.a (mgr.14388) 3893 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:44:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:33 smithi049 bash[23528]: audit 2024-09-20T23:44:32.292865+0000 mon.a (mon.0) 3745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:33 smithi049 bash[23528]: audit 2024-09-20T23:44:32.298694+0000 mon.a (mon.0) 3746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:33 smithi049 bash[23528]: audit 2024-09-20T23:44:32.304564+0000 mon.a (mon.0) 3747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:33 smithi049 bash[23528]: audit 2024-09-20T23:44:32.522596+0000 mgr.a (mgr.14388) 3894 : audit [DBG] from='client.94692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:33 smithi044 bash[22676]: cluster 2024-09-20T23:44:32.148921+0000 mgr.a (mgr.14388) 3893 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:44:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:33 smithi044 bash[22676]: audit 2024-09-20T23:44:32.292865+0000 mon.a (mon.0) 3745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:33 smithi044 bash[22676]: audit 2024-09-20T23:44:32.298694+0000 mon.a (mon.0) 3746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:33 smithi044 bash[22676]: audit 2024-09-20T23:44:32.304564+0000 mon.a (mon.0) 3747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:33 smithi044 bash[22676]: audit 2024-09-20T23:44:32.522596+0000 mgr.a (mgr.14388) 3894 : audit [DBG] from='client.94692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:33 smithi179 bash[23186]: cluster 2024-09-20T23:44:32.148921+0000 mgr.a (mgr.14388) 3893 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:44:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:33 smithi179 bash[23186]: audit 2024-09-20T23:44:32.292865+0000 mon.a (mon.0) 3745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:33 smithi179 bash[23186]: audit 2024-09-20T23:44:32.298694+0000 mon.a (mon.0) 3746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:33 smithi179 bash[23186]: audit 2024-09-20T23:44:32.304564+0000 mon.a (mon.0) 3747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:33 smithi179 bash[23186]: audit 2024-09-20T23:44:32.522596+0000 mgr.a (mgr.14388) 3894 : audit [DBG] from='client.94692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:35 smithi049 bash[23528]: cluster 2024-09-20T23:44:34.149609+0000 mgr.a (mgr.14388) 3895 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:44:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:35 smithi044 bash[22676]: cluster 2024-09-20T23:44:34.149609+0000 mgr.a (mgr.14388) 3895 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:44:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:35 smithi179 bash[23186]: cluster 2024-09-20T23:44:34.149609+0000 mgr.a (mgr.14388) 3895 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-20T23:44:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:37 smithi044 bash[22676]: cluster 2024-09-20T23:44:36.151517+0000 mgr.a (mgr.14388) 3896 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-20T23:44:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:37 smithi179 bash[23186]: cluster 2024-09-20T23:44:36.151517+0000 mgr.a (mgr.14388) 3896 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-20T23:44:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:37 smithi049 bash[23528]: cluster 2024-09-20T23:44:36.151517+0000 mgr.a (mgr.14388) 3896 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-20T23:44:37.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:37.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:37.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:38.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:39 smithi044 bash[22676]: cluster 2024-09-20T23:44:38.152052+0000 mgr.a (mgr.14388) 3897 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:39 smithi044 bash[22676]: audit 2024-09-20T23:44:38.321961+0000 mgr.a (mgr.14388) 3898 : audit [DBG] from='client.94770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:39 smithi179 bash[23186]: cluster 2024-09-20T23:44:38.152052+0000 mgr.a (mgr.14388) 3897 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:39 smithi179 bash[23186]: audit 2024-09-20T23:44:38.321961+0000 mgr.a (mgr.14388) 3898 : audit [DBG] from='client.94770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:39 smithi049 bash[23528]: cluster 2024-09-20T23:44:38.152052+0000 mgr.a (mgr.14388) 3897 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:39 smithi049 bash[23528]: audit 2024-09-20T23:44:38.321961+0000 mgr.a (mgr.14388) 3898 : audit [DBG] from='client.94770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:41 smithi044 bash[22676]: cluster 2024-09-20T23:44:40.154274+0000 mgr.a (mgr.14388) 3899 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:41 smithi179 bash[23186]: cluster 2024-09-20T23:44:40.154274+0000 mgr.a (mgr.14388) 3899 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:41 smithi049 bash[23528]: cluster 2024-09-20T23:44:40.154274+0000 mgr.a (mgr.14388) 3899 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:43 smithi179 bash[23186]: cluster 2024-09-20T23:44:42.155063+0000 mgr.a (mgr.14388) 3900 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:43 smithi044 bash[22676]: cluster 2024-09-20T23:44:42.155063+0000 mgr.a (mgr.14388) 3900 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:43 smithi049 bash[23528]: cluster 2024-09-20T23:44:42.155063+0000 mgr.a (mgr.14388) 3900 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:44.504 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:44.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:44.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:44.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:44.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:45 smithi044 bash[22676]: audit 2024-09-20T23:44:44.065789+0000 mgr.a (mgr.14388) 3901 : audit [DBG] from='client.94848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:45 smithi044 bash[22676]: cluster 2024-09-20T23:44:44.155691+0000 mgr.a (mgr.14388) 3902 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:45 smithi179 bash[23186]: audit 2024-09-20T23:44:44.065789+0000 mgr.a (mgr.14388) 3901 : audit [DBG] from='client.94848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:45 smithi179 bash[23186]: cluster 2024-09-20T23:44:44.155691+0000 mgr.a (mgr.14388) 3902 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:45 smithi049 bash[23528]: audit 2024-09-20T23:44:44.065789+0000 mgr.a (mgr.14388) 3901 : audit [DBG] from='client.94848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:45 smithi049 bash[23528]: cluster 2024-09-20T23:44:44.155691+0000 mgr.a (mgr.14388) 3902 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:47 smithi044 bash[22676]: cluster 2024-09-20T23:44:46.158134+0000 mgr.a (mgr.14388) 3903 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:47 smithi179 bash[23186]: cluster 2024-09-20T23:44:46.158134+0000 mgr.a (mgr.14388) 3903 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:47 smithi049 bash[23528]: cluster 2024-09-20T23:44:46.158134+0000 mgr.a (mgr.14388) 3903 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:44:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:49.507 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:49 smithi044 bash[22676]: cluster 2024-09-20T23:44:48.159084+0000 mgr.a (mgr.14388) 3904 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:49 smithi179 bash[23186]: cluster 2024-09-20T23:44:48.159084+0000 mgr.a (mgr.14388) 3904 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:49 smithi049 bash[23528]: cluster 2024-09-20T23:44:48.159084+0000 mgr.a (mgr.14388) 3904 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:50.276 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:50.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:51.153 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:50 smithi049 bash[23528]: audit 2024-09-20T23:44:49.836740+0000 mgr.a (mgr.14388) 3905 : audit [DBG] from='client.94923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:51.153 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:50 smithi049 bash[23528]: audit 2024-09-20T23:44:49.900339+0000 mon.a (mon.0) 3748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.153 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:50 smithi049 bash[23528]: audit 2024-09-20T23:44:49.905287+0000 mon.a (mon.0) 3749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.153 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:50 smithi049 bash[23528]: audit 2024-09-20T23:44:49.910719+0000 mon.a (mon.0) 3750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:50 smithi044 bash[22676]: audit 2024-09-20T23:44:49.836740+0000 mgr.a (mgr.14388) 3905 : audit [DBG] from='client.94923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:50 smithi044 bash[22676]: audit 2024-09-20T23:44:49.900339+0000 mon.a (mon.0) 3748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:50 smithi044 bash[22676]: audit 2024-09-20T23:44:49.905287+0000 mon.a (mon.0) 3749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:50 smithi044 bash[22676]: audit 2024-09-20T23:44:49.910719+0000 mon.a (mon.0) 3750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:50 smithi179 bash[23186]: audit 2024-09-20T23:44:49.836740+0000 mgr.a (mgr.14388) 3905 : audit [DBG] from='client.94923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:50 smithi179 bash[23186]: audit 2024-09-20T23:44:49.900339+0000 mon.a (mon.0) 3748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:50 smithi179 bash[23186]: audit 2024-09-20T23:44:49.905287+0000 mon.a (mon.0) 3749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:50 smithi179 bash[23186]: audit 2024-09-20T23:44:49.910719+0000 mon.a (mon.0) 3750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:51 smithi044 bash[22676]: cluster 2024-09-20T23:44:50.160446+0000 mgr.a (mgr.14388) 3906 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:44:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:51 smithi044 bash[22676]: audit 2024-09-20T23:44:51.547670+0000 mon.a (mon.0) 3751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:51 smithi044 bash[22676]: audit 2024-09-20T23:44:51.556619+0000 mon.a (mon.0) 3752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:51 smithi044 bash[22676]: audit 2024-09-20T23:44:51.567563+0000 mon.a (mon.0) 3753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:51 smithi179 bash[23186]: cluster 2024-09-20T23:44:50.160446+0000 mgr.a (mgr.14388) 3906 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:44:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:51 smithi179 bash[23186]: audit 2024-09-20T23:44:51.547670+0000 mon.a (mon.0) 3751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:51 smithi179 bash[23186]: audit 2024-09-20T23:44:51.556619+0000 mon.a (mon.0) 3752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:51 smithi179 bash[23186]: audit 2024-09-20T23:44:51.567563+0000 mon.a (mon.0) 3753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:51 smithi049 bash[23528]: cluster 2024-09-20T23:44:50.160446+0000 mgr.a (mgr.14388) 3906 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:44:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:51 smithi049 bash[23528]: audit 2024-09-20T23:44:51.547670+0000 mon.a (mon.0) 3751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:51 smithi049 bash[23528]: audit 2024-09-20T23:44:51.556619+0000 mon.a (mon.0) 3752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:51 smithi049 bash[23528]: audit 2024-09-20T23:44:51.567563+0000 mon.a (mon.0) 3753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:53 smithi049 bash[23528]: cluster 2024-09-20T23:44:52.161311+0000 mgr.a (mgr.14388) 3907 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:44:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:53 smithi049 bash[23528]: audit 2024-09-20T23:44:52.521191+0000 mon.a (mon.0) 3754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:53 smithi049 bash[23528]: audit 2024-09-20T23:44:52.528424+0000 mon.a (mon.0) 3755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:53 smithi049 bash[23528]: audit 2024-09-20T23:44:52.536915+0000 mon.a (mon.0) 3756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:53.841 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:53 smithi044 bash[22676]: cluster 2024-09-20T23:44:52.161311+0000 mgr.a (mgr.14388) 3907 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:44:53.841 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:53 smithi044 bash[22676]: audit 2024-09-20T23:44:52.521191+0000 mon.a (mon.0) 3754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:53.841 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:53 smithi044 bash[22676]: audit 2024-09-20T23:44:52.528424+0000 mon.a (mon.0) 3755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:53.841 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:53 smithi044 bash[22676]: audit 2024-09-20T23:44:52.536915+0000 mon.a (mon.0) 3756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:53 smithi179 bash[23186]: cluster 2024-09-20T23:44:52.161311+0000 mgr.a (mgr.14388) 3907 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:44:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:53 smithi179 bash[23186]: audit 2024-09-20T23:44:52.521191+0000 mon.a (mon.0) 3754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:53 smithi179 bash[23186]: audit 2024-09-20T23:44:52.528424+0000 mon.a (mon.0) 3755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:53 smithi179 bash[23186]: audit 2024-09-20T23:44:52.536915+0000 mon.a (mon.0) 3756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:44:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:44:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:44:55.279 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:44:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:55 smithi049 bash[23528]: cluster 2024-09-20T23:44:54.162316+0000 mgr.a (mgr.14388) 3908 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:44:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:55 smithi044 bash[22676]: cluster 2024-09-20T23:44:54.162316+0000 mgr.a (mgr.14388) 3908 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:44:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:55 smithi179 bash[23186]: cluster 2024-09-20T23:44:54.162316+0000 mgr.a (mgr.14388) 3908 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:44:56.061 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:44:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:44:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:44:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:44:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:44:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:56 smithi044 bash[22676]: audit 2024-09-20T23:44:55.618173+0000 mgr.a (mgr.14388) 3909 : audit [DBG] from='client.95001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:56 smithi049 bash[23528]: audit 2024-09-20T23:44:55.618173+0000 mgr.a (mgr.14388) 3909 : audit [DBG] from='client.95001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:56 smithi179 bash[23186]: audit 2024-09-20T23:44:55.618173+0000 mgr.a (mgr.14388) 3909 : audit [DBG] from='client.95001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:44:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:57 smithi049 bash[23528]: cluster 2024-09-20T23:44:56.165300+0000 mgr.a (mgr.14388) 3910 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:57 smithi044 bash[22676]: cluster 2024-09-20T23:44:56.165300+0000 mgr.a (mgr.14388) 3910 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:57 smithi179 bash[23186]: cluster 2024-09-20T23:44:56.165300+0000 mgr.a (mgr.14388) 3910 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:44:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:44:59 smithi049 bash[23528]: cluster 2024-09-20T23:44:58.166117+0000 mgr.a (mgr.14388) 3911 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:44:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:44:59 smithi044 bash[22676]: cluster 2024-09-20T23:44:58.166117+0000 mgr.a (mgr.14388) 3911 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:45:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:44:59 smithi179 bash[23186]: cluster 2024-09-20T23:44:58.166117+0000 mgr.a (mgr.14388) 3911 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:45:01.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:01.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:01 smithi179 bash[23186]: cluster 2024-09-20T23:45:00.168010+0000 mgr.a (mgr.14388) 3912 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:01 smithi049 bash[23528]: cluster 2024-09-20T23:45:00.168010+0000 mgr.a (mgr.14388) 3912 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:01.816 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:01 smithi044 bash[22676]: cluster 2024-09-20T23:45:00.168010+0000 mgr.a (mgr.14388) 3912 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:01.852 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:02 smithi044 bash[22676]: audit 2024-09-20T23:45:01.402860+0000 mgr.a (mgr.14388) 3913 : audit [DBG] from='client.95079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:02 smithi179 bash[23186]: audit 2024-09-20T23:45:01.402860+0000 mgr.a (mgr.14388) 3913 : audit [DBG] from='client.95079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:02 smithi049 bash[23528]: audit 2024-09-20T23:45:01.402860+0000 mgr.a (mgr.14388) 3913 : audit [DBG] from='client.95079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:03 smithi179 bash[23186]: cluster 2024-09-20T23:45:02.168930+0000 mgr.a (mgr.14388) 3914 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:03 smithi044 bash[22676]: cluster 2024-09-20T23:45:02.168930+0000 mgr.a (mgr.14388) 3914 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:03 smithi049 bash[23528]: cluster 2024-09-20T23:45:02.168930+0000 mgr.a (mgr.14388) 3914 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:05 smithi044 bash[22676]: cluster 2024-09-20T23:45:04.169767+0000 mgr.a (mgr.14388) 3915 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:05 smithi179 bash[23186]: cluster 2024-09-20T23:45:04.169767+0000 mgr.a (mgr.14388) 3915 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:05 smithi049 bash[23528]: cluster 2024-09-20T23:45:04.169767+0000 mgr.a (mgr.14388) 3915 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:06.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:06.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:06.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:07.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:07 smithi044 bash[22676]: cluster 2024-09-20T23:45:06.172022+0000 mgr.a (mgr.14388) 3916 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:45:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:07 smithi179 bash[23186]: cluster 2024-09-20T23:45:06.172022+0000 mgr.a (mgr.14388) 3916 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:45:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:07 smithi049 bash[23528]: cluster 2024-09-20T23:45:06.172022+0000 mgr.a (mgr.14388) 3916 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:45:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:08 smithi049 bash[23528]: audit 2024-09-20T23:45:07.190451+0000 mgr.a (mgr.14388) 3917 : audit [DBG] from='client.95154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:08 smithi044 bash[22676]: audit 2024-09-20T23:45:07.190451+0000 mgr.a (mgr.14388) 3917 : audit [DBG] from='client.95154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:08 smithi179 bash[23186]: audit 2024-09-20T23:45:07.190451+0000 mgr.a (mgr.14388) 3917 : audit [DBG] from='client.95154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:09.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:09 smithi049 bash[23528]: cluster 2024-09-20T23:45:08.173007+0000 mgr.a (mgr.14388) 3918 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:09.893 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:09 smithi179 bash[23186]: cluster 2024-09-20T23:45:08.173007+0000 mgr.a (mgr.14388) 3918 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:09 smithi044 bash[22676]: cluster 2024-09-20T23:45:08.173007+0000 mgr.a (mgr.14388) 3918 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:11.349 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:11 smithi049 bash[23528]: audit 2024-09-20T23:45:10.098362+0000 mon.a (mon.0) 3757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.349 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:11 smithi049 bash[23528]: audit 2024-09-20T23:45:10.107176+0000 mon.a (mon.0) 3758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.349 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:11 smithi049 bash[23528]: audit 2024-09-20T23:45:10.117783+0000 mon.a (mon.0) 3759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.349 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:11 smithi049 bash[23528]: cluster 2024-09-20T23:45:10.175254+0000 mgr.a (mgr.14388) 3919 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:11 smithi044 bash[22676]: audit 2024-09-20T23:45:10.098362+0000 mon.a (mon.0) 3757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:11 smithi044 bash[22676]: audit 2024-09-20T23:45:10.107176+0000 mon.a (mon.0) 3758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:11 smithi044 bash[22676]: audit 2024-09-20T23:45:10.117783+0000 mon.a (mon.0) 3759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:11 smithi044 bash[22676]: cluster 2024-09-20T23:45:10.175254+0000 mgr.a (mgr.14388) 3919 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:11 smithi179 bash[23186]: audit 2024-09-20T23:45:10.098362+0000 mon.a (mon.0) 3757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:11 smithi179 bash[23186]: audit 2024-09-20T23:45:10.107176+0000 mon.a (mon.0) 3758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:11 smithi179 bash[23186]: audit 2024-09-20T23:45:10.117783+0000 mon.a (mon.0) 3759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:11 smithi179 bash[23186]: cluster 2024-09-20T23:45:10.175254+0000 mgr.a (mgr.14388) 3919 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:12.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:12.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:12.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:12 smithi044 bash[22676]: audit 2024-09-20T23:45:11.777402+0000 mon.a (mon.0) 3760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:12 smithi044 bash[22676]: audit 2024-09-20T23:45:11.785736+0000 mon.a (mon.0) 3761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:12 smithi044 bash[22676]: audit 2024-09-20T23:45:11.795626+0000 mon.a (mon.0) 3762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:12 smithi044 bash[22676]: audit 2024-09-20T23:45:12.718045+0000 mon.a (mon.0) 3763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:12 smithi044 bash[22676]: audit 2024-09-20T23:45:12.723260+0000 mon.a (mon.0) 3764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:12 smithi044 bash[22676]: audit 2024-09-20T23:45:12.729354+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:12 smithi049 bash[23528]: audit 2024-09-20T23:45:11.777402+0000 mon.a (mon.0) 3760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:12 smithi049 bash[23528]: audit 2024-09-20T23:45:11.785736+0000 mon.a (mon.0) 3761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:12 smithi049 bash[23528]: audit 2024-09-20T23:45:11.795626+0000 mon.a (mon.0) 3762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:12 smithi049 bash[23528]: audit 2024-09-20T23:45:12.718045+0000 mon.a (mon.0) 3763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:12 smithi049 bash[23528]: audit 2024-09-20T23:45:12.723260+0000 mon.a (mon.0) 3764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:12 smithi049 bash[23528]: audit 2024-09-20T23:45:12.729354+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:12 smithi179 bash[23186]: audit 2024-09-20T23:45:11.777402+0000 mon.a (mon.0) 3760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:12 smithi179 bash[23186]: audit 2024-09-20T23:45:11.785736+0000 mon.a (mon.0) 3761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:12 smithi179 bash[23186]: audit 2024-09-20T23:45:11.795626+0000 mon.a (mon.0) 3762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:12 smithi179 bash[23186]: audit 2024-09-20T23:45:12.718045+0000 mon.a (mon.0) 3763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:12 smithi179 bash[23186]: audit 2024-09-20T23:45:12.723260+0000 mon.a (mon.0) 3764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:12 smithi179 bash[23186]: audit 2024-09-20T23:45:12.729354+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:13.432 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:13.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:13.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:13.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:13.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:13 smithi049 bash[23528]: cluster 2024-09-20T23:45:12.176024+0000 mgr.a (mgr.14388) 3920 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:13 smithi049 bash[23528]: audit 2024-09-20T23:45:12.988986+0000 mgr.a (mgr.14388) 3921 : audit [DBG] from='client.95229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:13 smithi044 bash[22676]: cluster 2024-09-20T23:45:12.176024+0000 mgr.a (mgr.14388) 3920 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:13 smithi044 bash[22676]: audit 2024-09-20T23:45:12.988986+0000 mgr.a (mgr.14388) 3921 : audit [DBG] from='client.95229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:13 smithi179 bash[23186]: cluster 2024-09-20T23:45:12.176024+0000 mgr.a (mgr.14388) 3920 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:13 smithi179 bash[23186]: audit 2024-09-20T23:45:12.988986+0000 mgr.a (mgr.14388) 3921 : audit [DBG] from='client.95229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:15.972 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:15 smithi044 bash[22676]: cluster 2024-09-20T23:45:14.176967+0000 mgr.a (mgr.14388) 3922 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:15 smithi049 bash[23528]: cluster 2024-09-20T23:45:14.176967+0000 mgr.a (mgr.14388) 3922 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:15 smithi179 bash[23186]: cluster 2024-09-20T23:45:14.176967+0000 mgr.a (mgr.14388) 3922 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:18.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:17 smithi044 bash[22676]: cluster 2024-09-20T23:45:16.179298+0000 mgr.a (mgr.14388) 3923 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:17 smithi179 bash[23186]: cluster 2024-09-20T23:45:16.179298+0000 mgr.a (mgr.14388) 3923 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:17 smithi049 bash[23528]: cluster 2024-09-20T23:45:16.179298+0000 mgr.a (mgr.14388) 3923 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:18.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:18.435 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:18.435 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:19.225 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:19.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:19 smithi044 bash[22676]: cluster 2024-09-20T23:45:18.180114+0000 mgr.a (mgr.14388) 3924 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:19 smithi044 bash[22676]: audit 2024-09-20T23:45:18.773118+0000 mgr.a (mgr.14388) 3925 : audit [DBG] from='client.95307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:19 smithi179 bash[23186]: cluster 2024-09-20T23:45:18.180114+0000 mgr.a (mgr.14388) 3924 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:19 smithi179 bash[23186]: audit 2024-09-20T23:45:18.773118+0000 mgr.a (mgr.14388) 3925 : audit [DBG] from='client.95307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:19 smithi049 bash[23528]: cluster 2024-09-20T23:45:18.180114+0000 mgr.a (mgr.14388) 3924 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:19 smithi049 bash[23528]: audit 2024-09-20T23:45:18.773118+0000 mgr.a (mgr.14388) 3925 : audit [DBG] from='client.95307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:20 smithi044 bash[22676]: audit 2024-09-20T23:45:20.569847+0000 mon.a (mon.0) 3766 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:20 smithi044 bash[22676]: audit 2024-09-20T23:45:20.576780+0000 mon.a (mon.0) 3767 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:20 smithi044 bash[22676]: audit 2024-09-20T23:45:20.578761+0000 mon.a (mon.0) 3768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:20 smithi044 bash[22676]: audit 2024-09-20T23:45:20.590814+0000 mon.a (mon.0) 3769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:20 smithi044 bash[22676]: audit 2024-09-20T23:45:20.597406+0000 mon.a (mon.0) 3770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:45:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:20 smithi179 bash[23186]: audit 2024-09-20T23:45:20.569847+0000 mon.a (mon.0) 3766 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:45:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:20 smithi179 bash[23186]: audit 2024-09-20T23:45:20.576780+0000 mon.a (mon.0) 3767 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:45:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:20 smithi179 bash[23186]: audit 2024-09-20T23:45:20.578761+0000 mon.a (mon.0) 3768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:45:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:20 smithi179 bash[23186]: audit 2024-09-20T23:45:20.590814+0000 mon.a (mon.0) 3769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:20 smithi179 bash[23186]: audit 2024-09-20T23:45:20.597406+0000 mon.a (mon.0) 3770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:45:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:20 smithi049 bash[23528]: audit 2024-09-20T23:45:20.569847+0000 mon.a (mon.0) 3766 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:45:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:20 smithi049 bash[23528]: audit 2024-09-20T23:45:20.576780+0000 mon.a (mon.0) 3767 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:45:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:20 smithi049 bash[23528]: audit 2024-09-20T23:45:20.578761+0000 mon.a (mon.0) 3768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:45:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:20 smithi049 bash[23528]: audit 2024-09-20T23:45:20.590814+0000 mon.a (mon.0) 3769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:20 smithi049 bash[23528]: audit 2024-09-20T23:45:20.597406+0000 mon.a (mon.0) 3770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:45:21.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:45:21 smithi044 bash[22930]: debug 2024-09-20T23:45:21.375+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:45:21.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:45:21 smithi044 bash[22930]: debug 2024-09-20T23:45:21.379+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:21 smithi044 bash[22676]: cluster 2024-09-20T23:45:20.182617+0000 mgr.a (mgr.14388) 3926 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:21 smithi044 bash[22676]: audit 2024-09-20T23:45:20.599991+0000 mgr.a (mgr.14388) 3927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:21 smithi179 bash[23186]: cluster 2024-09-20T23:45:20.182617+0000 mgr.a (mgr.14388) 3926 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:21 smithi179 bash[23186]: audit 2024-09-20T23:45:20.599991+0000 mgr.a (mgr.14388) 3927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:45:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:21 smithi049 bash[23528]: cluster 2024-09-20T23:45:20.182617+0000 mgr.a (mgr.14388) 3926 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:21 smithi049 bash[23528]: audit 2024-09-20T23:45:20.599991+0000 mgr.a (mgr.14388) 3927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:45:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:22 smithi044 bash[22676]: audit 2024-09-20T23:45:21.380111+0000 mgr.a (mgr.14388) 3928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:45:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:22 smithi044 bash[22676]: cephadm 2024-09-20T23:45:21.381536+0000 mgr.a (mgr.14388) 3929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:45:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:22 smithi179 bash[23186]: audit 2024-09-20T23:45:21.380111+0000 mgr.a (mgr.14388) 3928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:45:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:22 smithi179 bash[23186]: cephadm 2024-09-20T23:45:21.381536+0000 mgr.a (mgr.14388) 3929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:45:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:22 smithi049 bash[23528]: audit 2024-09-20T23:45:21.380111+0000 mgr.a (mgr.14388) 3928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:45:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:22 smithi049 bash[23528]: cephadm 2024-09-20T23:45:21.381536+0000 mgr.a (mgr.14388) 3929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:45:24.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:24.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:24.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:23 smithi044 bash[22676]: cluster 2024-09-20T23:45:22.183618+0000 mgr.a (mgr.14388) 3930 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:23 smithi179 bash[23186]: cluster 2024-09-20T23:45:22.183618+0000 mgr.a (mgr.14388) 3930 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:23 smithi049 bash[23528]: cluster 2024-09-20T23:45:22.183618+0000 mgr.a (mgr.14388) 3930 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:25.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:25.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:25.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:25.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:25.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:26.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:25 smithi179 bash[23186]: cluster 2024-09-20T23:45:24.184397+0000 mgr.a (mgr.14388) 3931 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:26.099 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:25 smithi179 bash[23186]: audit 2024-09-20T23:45:24.565833+0000 mgr.a (mgr.14388) 3932 : audit [DBG] from='client.95490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:25 smithi044 bash[22676]: cluster 2024-09-20T23:45:24.184397+0000 mgr.a (mgr.14388) 3931 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:25 smithi044 bash[22676]: audit 2024-09-20T23:45:24.565833+0000 mgr.a (mgr.14388) 3932 : audit [DBG] from='client.95490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:25 smithi049 bash[23528]: cluster 2024-09-20T23:45:24.184397+0000 mgr.a (mgr.14388) 3931 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:25 smithi049 bash[23528]: audit 2024-09-20T23:45:24.565833+0000 mgr.a (mgr.14388) 3932 : audit [DBG] from='client.95490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:27 smithi044 bash[22676]: cluster 2024-09-20T23:45:26.187917+0000 mgr.a (mgr.14388) 3933 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:27 smithi179 bash[23186]: cluster 2024-09-20T23:45:26.187917+0000 mgr.a (mgr.14388) 3933 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:28.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:27 smithi049 bash[23528]: cluster 2024-09-20T23:45:26.187917+0000 mgr.a (mgr.14388) 3933 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:30.012 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:29 smithi049 bash[23528]: cluster 2024-09-20T23:45:28.188726+0000 mgr.a (mgr.14388) 3934 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:29 smithi044 bash[22676]: cluster 2024-09-20T23:45:28.188726+0000 mgr.a (mgr.14388) 3934 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:29 smithi179 bash[23186]: cluster 2024-09-20T23:45:28.188726+0000 mgr.a (mgr.14388) 3934 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:30.771 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:31.588 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:31 smithi049 bash[23528]: cluster 2024-09-20T23:45:30.190672+0000 mgr.a (mgr.14388) 3935 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:31.589 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:31 smithi049 bash[23528]: audit 2024-09-20T23:45:30.308999+0000 mon.a (mon.0) 3771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.589 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:31 smithi049 bash[23528]: audit 2024-09-20T23:45:30.317669+0000 mon.a (mon.0) 3772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.589 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:31 smithi049 bash[23528]: audit 2024-09-20T23:45:30.327794+0000 mon.a (mon.0) 3773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.589 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:31 smithi049 bash[23528]: audit 2024-09-20T23:45:30.353956+0000 mgr.a (mgr.14388) 3936 : audit [DBG] from='client.95565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:31 smithi044 bash[22676]: cluster 2024-09-20T23:45:30.190672+0000 mgr.a (mgr.14388) 3935 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:31 smithi044 bash[22676]: audit 2024-09-20T23:45:30.308999+0000 mon.a (mon.0) 3771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:31 smithi044 bash[22676]: audit 2024-09-20T23:45:30.317669+0000 mon.a (mon.0) 3772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:31 smithi044 bash[22676]: audit 2024-09-20T23:45:30.327794+0000 mon.a (mon.0) 3773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:31 smithi044 bash[22676]: audit 2024-09-20T23:45:30.353956+0000 mgr.a (mgr.14388) 3936 : audit [DBG] from='client.95565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:31 smithi179 bash[23186]: cluster 2024-09-20T23:45:30.190672+0000 mgr.a (mgr.14388) 3935 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:31 smithi179 bash[23186]: audit 2024-09-20T23:45:30.308999+0000 mon.a (mon.0) 3771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:31 smithi179 bash[23186]: audit 2024-09-20T23:45:30.317669+0000 mon.a (mon.0) 3772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:31 smithi179 bash[23186]: audit 2024-09-20T23:45:30.327794+0000 mon.a (mon.0) 3773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:31 smithi179 bash[23186]: audit 2024-09-20T23:45:30.353956+0000 mgr.a (mgr.14388) 3936 : audit [DBG] from='client.95565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:33 smithi044 bash[22676]: audit 2024-09-20T23:45:32.006345+0000 mon.a (mon.0) 3774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:33 smithi044 bash[22676]: audit 2024-09-20T23:45:32.015977+0000 mon.a (mon.0) 3775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:33 smithi044 bash[22676]: audit 2024-09-20T23:45:32.027599+0000 mon.a (mon.0) 3776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:33 smithi044 bash[22676]: audit 2024-09-20T23:45:32.938349+0000 mon.a (mon.0) 3777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:33 smithi044 bash[22676]: audit 2024-09-20T23:45:32.946776+0000 mon.a (mon.0) 3778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:33 smithi044 bash[22676]: audit 2024-09-20T23:45:32.956731+0000 mon.a (mon.0) 3779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:33 smithi049 bash[23528]: audit 2024-09-20T23:45:32.006345+0000 mon.a (mon.0) 3774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:33 smithi049 bash[23528]: audit 2024-09-20T23:45:32.015977+0000 mon.a (mon.0) 3775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:33 smithi049 bash[23528]: audit 2024-09-20T23:45:32.027599+0000 mon.a (mon.0) 3776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:33 smithi049 bash[23528]: audit 2024-09-20T23:45:32.938349+0000 mon.a (mon.0) 3777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:33 smithi049 bash[23528]: audit 2024-09-20T23:45:32.946776+0000 mon.a (mon.0) 3778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:33 smithi049 bash[23528]: audit 2024-09-20T23:45:32.956731+0000 mon.a (mon.0) 3779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:33 smithi179 bash[23186]: audit 2024-09-20T23:45:32.006345+0000 mon.a (mon.0) 3774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:33 smithi179 bash[23186]: audit 2024-09-20T23:45:32.015977+0000 mon.a (mon.0) 3775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:33 smithi179 bash[23186]: audit 2024-09-20T23:45:32.027599+0000 mon.a (mon.0) 3776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:33 smithi179 bash[23186]: audit 2024-09-20T23:45:32.938349+0000 mon.a (mon.0) 3777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:33 smithi179 bash[23186]: audit 2024-09-20T23:45:32.946776+0000 mon.a (mon.0) 3778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:33 smithi179 bash[23186]: audit 2024-09-20T23:45:32.956731+0000 mon.a (mon.0) 3779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:34 smithi049 bash[23528]: cluster 2024-09-20T23:45:32.191581+0000 mgr.a (mgr.14388) 3937 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:34 smithi044 bash[22676]: cluster 2024-09-20T23:45:32.191581+0000 mgr.a (mgr.14388) 3937 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:34 smithi179 bash[23186]: cluster 2024-09-20T23:45:32.191581+0000 mgr.a (mgr.14388) 3937 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:35.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:35.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:35.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:36 smithi049 bash[23528]: cluster 2024-09-20T23:45:34.192490+0000 mgr.a (mgr.14388) 3938 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:36.464 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:36 smithi044 bash[22676]: cluster 2024-09-20T23:45:34.192490+0000 mgr.a (mgr.14388) 3938 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:36 smithi179 bash[23186]: cluster 2024-09-20T23:45:34.192490+0000 mgr.a (mgr.14388) 3938 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:45:36.534 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:36.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:36.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:38 smithi049 bash[23528]: audit 2024-09-20T23:45:36.108012+0000 mgr.a (mgr.14388) 3939 : audit [DBG] from='client.95643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:38 smithi049 bash[23528]: cluster 2024-09-20T23:45:36.193772+0000 mgr.a (mgr.14388) 3940 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:38 smithi044 bash[22676]: audit 2024-09-20T23:45:36.108012+0000 mgr.a (mgr.14388) 3939 : audit [DBG] from='client.95643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:38 smithi044 bash[22676]: cluster 2024-09-20T23:45:36.193772+0000 mgr.a (mgr.14388) 3940 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:38 smithi179 bash[23186]: audit 2024-09-20T23:45:36.108012+0000 mgr.a (mgr.14388) 3939 : audit [DBG] from='client.95643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:38 smithi179 bash[23186]: cluster 2024-09-20T23:45:36.193772+0000 mgr.a (mgr.14388) 3940 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:45:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:40 smithi049 bash[23528]: cluster 2024-09-20T23:45:38.194624+0000 mgr.a (mgr.14388) 3941 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:40 smithi044 bash[22676]: cluster 2024-09-20T23:45:38.194624+0000 mgr.a (mgr.14388) 3941 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:40 smithi179 bash[23186]: cluster 2024-09-20T23:45:38.194624+0000 mgr.a (mgr.14388) 3941 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:45:41.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:41.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:41.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:42 smithi049 bash[23528]: cluster 2024-09-20T23:45:40.196812+0000 mgr.a (mgr.14388) 3942 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:45:42.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:42.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:42.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:42.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:42.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:42 smithi044 bash[22676]: cluster 2024-09-20T23:45:40.196812+0000 mgr.a (mgr.14388) 3942 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:45:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:42 smithi179 bash[23186]: cluster 2024-09-20T23:45:40.196812+0000 mgr.a (mgr.14388) 3942 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:45:43.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:43 smithi179 bash[23186]: audit 2024-09-20T23:45:41.874569+0000 mgr.a (mgr.14388) 3943 : audit [DBG] from='client.95721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:43 smithi044 bash[22676]: audit 2024-09-20T23:45:41.874569+0000 mgr.a (mgr.14388) 3943 : audit [DBG] from='client.95721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:43 smithi049 bash[23528]: audit 2024-09-20T23:45:41.874569+0000 mgr.a (mgr.14388) 3943 : audit [DBG] from='client.95721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:44.404 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:44 smithi179 bash[23186]: cluster 2024-09-20T23:45:42.197375+0000 mgr.a (mgr.14388) 3944 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:44 smithi044 bash[22676]: cluster 2024-09-20T23:45:42.197375+0000 mgr.a (mgr.14388) 3944 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:44 smithi049 bash[23528]: cluster 2024-09-20T23:45:42.197375+0000 mgr.a (mgr.14388) 3944 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:46 smithi044 bash[22676]: cluster 2024-09-20T23:45:44.198390+0000 mgr.a (mgr.14388) 3945 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:46 smithi179 bash[23186]: cluster 2024-09-20T23:45:44.198390+0000 mgr.a (mgr.14388) 3945 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:46 smithi049 bash[23528]: cluster 2024-09-20T23:45:44.198390+0000 mgr.a (mgr.14388) 3945 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:47.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:47.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:48.083 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:48.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:48.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:48.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:48.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:48 smithi044 bash[22676]: cluster 2024-09-20T23:45:46.200814+0000 mgr.a (mgr.14388) 3946 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:48 smithi179 bash[23186]: cluster 2024-09-20T23:45:46.200814+0000 mgr.a (mgr.14388) 3946 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:48 smithi049 bash[23528]: cluster 2024-09-20T23:45:46.200814+0000 mgr.a (mgr.14388) 3946 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:45:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:49 smithi049 bash[23528]: audit 2024-09-20T23:45:47.654217+0000 mgr.a (mgr.14388) 3947 : audit [DBG] from='client.95799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:49 smithi044 bash[22676]: audit 2024-09-20T23:45:47.654217+0000 mgr.a (mgr.14388) 3947 : audit [DBG] from='client.95799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:49 smithi179 bash[23186]: audit 2024-09-20T23:45:47.654217+0000 mgr.a (mgr.14388) 3947 : audit [DBG] from='client.95799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:50.432 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:50 smithi049 bash[23528]: cluster 2024-09-20T23:45:48.201792+0000 mgr.a (mgr.14388) 3948 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:50 smithi044 bash[22676]: cluster 2024-09-20T23:45:48.201792+0000 mgr.a (mgr.14388) 3948 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:50 smithi179 bash[23186]: cluster 2024-09-20T23:45:48.201792+0000 mgr.a (mgr.14388) 3948 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:45:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:51 smithi179 bash[23186]: cluster 2024-09-20T23:45:50.204064+0000 mgr.a (mgr.14388) 3949 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:45:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:51 smithi179 bash[23186]: audit 2024-09-20T23:45:50.497589+0000 mon.a (mon.0) 3780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:51 smithi179 bash[23186]: audit 2024-09-20T23:45:50.506281+0000 mon.a (mon.0) 3781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:51 smithi179 bash[23186]: audit 2024-09-20T23:45:50.516582+0000 mon.a (mon.0) 3782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:51 smithi049 bash[23528]: cluster 2024-09-20T23:45:50.204064+0000 mgr.a (mgr.14388) 3949 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:45:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:51 smithi049 bash[23528]: audit 2024-09-20T23:45:50.497589+0000 mon.a (mon.0) 3780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:51 smithi049 bash[23528]: audit 2024-09-20T23:45:50.506281+0000 mon.a (mon.0) 3781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:51 smithi049 bash[23528]: audit 2024-09-20T23:45:50.516582+0000 mon.a (mon.0) 3782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:51 smithi044 bash[22676]: cluster 2024-09-20T23:45:50.204064+0000 mgr.a (mgr.14388) 3949 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:45:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:51 smithi044 bash[22676]: audit 2024-09-20T23:45:50.497589+0000 mon.a (mon.0) 3780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:51 smithi044 bash[22676]: audit 2024-09-20T23:45:50.506281+0000 mon.a (mon.0) 3781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:51 smithi044 bash[22676]: audit 2024-09-20T23:45:50.516582+0000 mon.a (mon.0) 3782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:53.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:53.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:53 smithi044 bash[22676]: cluster 2024-09-20T23:45:52.204833+0000 mgr.a (mgr.14388) 3950 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:45:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:53 smithi044 bash[22676]: audit 2024-09-20T23:45:52.239580+0000 mon.a (mon.0) 3783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:53 smithi044 bash[22676]: audit 2024-09-20T23:45:52.247778+0000 mon.a (mon.0) 3784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:53 smithi044 bash[22676]: audit 2024-09-20T23:45:52.258455+0000 mon.a (mon.0) 3785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:53 smithi044 bash[22676]: audit 2024-09-20T23:45:53.140111+0000 mon.a (mon.0) 3786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:53 smithi044 bash[22676]: audit 2024-09-20T23:45:53.148158+0000 mon.a (mon.0) 3787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:53 smithi044 bash[22676]: audit 2024-09-20T23:45:53.156701+0000 mon.a (mon.0) 3788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:53 smithi179 bash[23186]: cluster 2024-09-20T23:45:52.204833+0000 mgr.a (mgr.14388) 3950 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:45:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:53 smithi179 bash[23186]: audit 2024-09-20T23:45:52.239580+0000 mon.a (mon.0) 3783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:53 smithi179 bash[23186]: audit 2024-09-20T23:45:52.247778+0000 mon.a (mon.0) 3784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:53 smithi179 bash[23186]: audit 2024-09-20T23:45:52.258455+0000 mon.a (mon.0) 3785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:53 smithi179 bash[23186]: audit 2024-09-20T23:45:53.140111+0000 mon.a (mon.0) 3786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:53 smithi179 bash[23186]: audit 2024-09-20T23:45:53.148158+0000 mon.a (mon.0) 3787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:53 smithi179 bash[23186]: audit 2024-09-20T23:45:53.156701+0000 mon.a (mon.0) 3788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:53 smithi049 bash[23528]: cluster 2024-09-20T23:45:52.204833+0000 mgr.a (mgr.14388) 3950 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:45:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:53 smithi049 bash[23528]: audit 2024-09-20T23:45:52.239580+0000 mon.a (mon.0) 3783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:53 smithi049 bash[23528]: audit 2024-09-20T23:45:52.247778+0000 mon.a (mon.0) 3784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:53 smithi049 bash[23528]: audit 2024-09-20T23:45:52.258455+0000 mon.a (mon.0) 3785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:53 smithi049 bash[23528]: audit 2024-09-20T23:45:53.140111+0000 mon.a (mon.0) 3786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:53 smithi049 bash[23528]: audit 2024-09-20T23:45:53.148158+0000 mon.a (mon.0) 3787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:53 smithi049 bash[23528]: audit 2024-09-20T23:45:53.156701+0000 mon.a (mon.0) 3788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:45:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:53.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:53.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:53.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:53.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:54.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:54 smithi049 bash[23528]: audit 2024-09-20T23:45:53.444935+0000 mgr.a (mgr.14388) 3951 : audit [DBG] from='client.95877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:54 smithi179 bash[23186]: audit 2024-09-20T23:45:53.444935+0000 mgr.a (mgr.14388) 3951 : audit [DBG] from='client.95877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:54 smithi044 bash[22676]: audit 2024-09-20T23:45:53.444935+0000 mgr.a (mgr.14388) 3951 : audit [DBG] from='client.95877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:45:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:55 smithi179 bash[23186]: cluster 2024-09-20T23:45:54.205992+0000 mgr.a (mgr.14388) 3952 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:45:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:55 smithi049 bash[23528]: cluster 2024-09-20T23:45:54.205992+0000 mgr.a (mgr.14388) 3952 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:45:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:55 smithi044 bash[22676]: cluster 2024-09-20T23:45:54.205992+0000 mgr.a (mgr.14388) 3952 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:45:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:57 smithi179 bash[23186]: cluster 2024-09-20T23:45:56.208394+0000 mgr.a (mgr.14388) 3953 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 0 B/s wr, 111 op/s 2024-09-20T23:45:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:57 smithi049 bash[23528]: cluster 2024-09-20T23:45:56.208394+0000 mgr.a (mgr.14388) 3953 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 0 B/s wr, 111 op/s 2024-09-20T23:45:57.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:57 smithi044 bash[22676]: cluster 2024-09-20T23:45:56.208394+0000 mgr.a (mgr.14388) 3953 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 0 B/s wr, 111 op/s 2024-09-20T23:45:58.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:45:58.942 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:45:58.942 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:45:59.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:45:59 smithi044 bash[22676]: cluster 2024-09-20T23:45:58.209385+0000 mgr.a (mgr.14388) 3954 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 110 op/s 2024-09-20T23:45:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:45:59 smithi049 bash[23528]: cluster 2024-09-20T23:45:58.209385+0000 mgr.a (mgr.14388) 3954 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 110 op/s 2024-09-20T23:45:59.679 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:45:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:45:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:45:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:45:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:45:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:45:59 smithi179 bash[23186]: cluster 2024-09-20T23:45:58.209385+0000 mgr.a (mgr.14388) 3954 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 110 op/s 2024-09-20T23:46:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:00 smithi049 bash[23528]: audit 2024-09-20T23:45:59.259931+0000 mgr.a (mgr.14388) 3955 : audit [DBG] from='client.95955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:00 smithi044 bash[22676]: audit 2024-09-20T23:45:59.259931+0000 mgr.a (mgr.14388) 3955 : audit [DBG] from='client.95955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:00 smithi179 bash[23186]: audit 2024-09-20T23:45:59.259931+0000 mgr.a (mgr.14388) 3955 : audit [DBG] from='client.95955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:01 smithi049 bash[23528]: cluster 2024-09-20T23:46:00.211832+0000 mgr.a (mgr.14388) 3956 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 0 B/s wr, 111 op/s 2024-09-20T23:46:01.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:01 smithi044 bash[22676]: cluster 2024-09-20T23:46:00.211832+0000 mgr.a (mgr.14388) 3956 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 0 B/s wr, 111 op/s 2024-09-20T23:46:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:01 smithi179 bash[23186]: cluster 2024-09-20T23:46:00.211832+0000 mgr.a (mgr.14388) 3956 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 0 B/s wr, 111 op/s 2024-09-20T23:46:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:03 smithi049 bash[23528]: cluster 2024-09-20T23:46:02.212630+0000 mgr.a (mgr.14388) 3957 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:03 smithi044 bash[22676]: cluster 2024-09-20T23:46:02.212630+0000 mgr.a (mgr.14388) 3957 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:03 smithi179 bash[23186]: cluster 2024-09-20T23:46:02.212630+0000 mgr.a (mgr.14388) 3957 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:04.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:05.476 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:05.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:05.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:05.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:05.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:05 smithi049 bash[23528]: cluster 2024-09-20T23:46:04.213482+0000 mgr.a (mgr.14388) 3958 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:05 smithi049 bash[23528]: audit 2024-09-20T23:46:05.020504+0000 mgr.a (mgr.14388) 3959 : audit [DBG] from='client.96033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:05 smithi044 bash[22676]: cluster 2024-09-20T23:46:04.213482+0000 mgr.a (mgr.14388) 3958 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:05 smithi044 bash[22676]: audit 2024-09-20T23:46:05.020504+0000 mgr.a (mgr.14388) 3959 : audit [DBG] from='client.96033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:05 smithi179 bash[23186]: cluster 2024-09-20T23:46:04.213482+0000 mgr.a (mgr.14388) 3958 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:05 smithi179 bash[23186]: audit 2024-09-20T23:46:05.020504+0000 mgr.a (mgr.14388) 3959 : audit [DBG] from='client.96033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:07 smithi049 bash[23528]: cluster 2024-09-20T23:46:06.216294+0000 mgr.a (mgr.14388) 3960 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:07 smithi044 bash[22676]: cluster 2024-09-20T23:46:06.216294+0000 mgr.a (mgr.14388) 3960 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:07 smithi179 bash[23186]: cluster 2024-09-20T23:46:06.216294+0000 mgr.a (mgr.14388) 3960 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 63 KiB/s rd, 0 B/s wr, 103 op/s 2024-09-20T23:46:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:09 smithi049 bash[23528]: cluster 2024-09-20T23:46:08.217209+0000 mgr.a (mgr.14388) 3961 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:09 smithi044 bash[22676]: cluster 2024-09-20T23:46:08.217209+0000 mgr.a (mgr.14388) 3961 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:09 smithi179 bash[23186]: cluster 2024-09-20T23:46:08.217209+0000 mgr.a (mgr.14388) 3961 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:10.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:10.478 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:10.478 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:11.266 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:11 smithi044 bash[22676]: cluster 2024-09-20T23:46:10.219227+0000 mgr.a (mgr.14388) 3962 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:11 smithi044 bash[22676]: audit 2024-09-20T23:46:10.630367+0000 mon.a (mon.0) 3789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:11 smithi044 bash[22676]: audit 2024-09-20T23:46:10.640024+0000 mon.a (mon.0) 3790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:11 smithi044 bash[22676]: audit 2024-09-20T23:46:10.649181+0000 mon.a (mon.0) 3791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:11 smithi044 bash[22676]: audit 2024-09-20T23:46:10.818662+0000 mgr.a (mgr.14388) 3963 : audit [DBG] from='client.96108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:11 smithi179 bash[23186]: cluster 2024-09-20T23:46:10.219227+0000 mgr.a (mgr.14388) 3962 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:11 smithi179 bash[23186]: audit 2024-09-20T23:46:10.630367+0000 mon.a (mon.0) 3789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:11 smithi179 bash[23186]: audit 2024-09-20T23:46:10.640024+0000 mon.a (mon.0) 3790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:11 smithi179 bash[23186]: audit 2024-09-20T23:46:10.649181+0000 mon.a (mon.0) 3791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:11 smithi179 bash[23186]: audit 2024-09-20T23:46:10.818662+0000 mgr.a (mgr.14388) 3963 : audit [DBG] from='client.96108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:11 smithi049 bash[23528]: cluster 2024-09-20T23:46:10.219227+0000 mgr.a (mgr.14388) 3962 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:11 smithi049 bash[23528]: audit 2024-09-20T23:46:10.630367+0000 mon.a (mon.0) 3789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:11 smithi049 bash[23528]: audit 2024-09-20T23:46:10.640024+0000 mon.a (mon.0) 3790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:11 smithi049 bash[23528]: audit 2024-09-20T23:46:10.649181+0000 mon.a (mon.0) 3791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:11 smithi049 bash[23528]: audit 2024-09-20T23:46:10.818662+0000 mgr.a (mgr.14388) 3963 : audit [DBG] from='client.96108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:13 smithi044 bash[22676]: cluster 2024-09-20T23:46:12.220137+0000 mgr.a (mgr.14388) 3964 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:13 smithi044 bash[22676]: audit 2024-09-20T23:46:12.473331+0000 mon.a (mon.0) 3792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:13 smithi044 bash[22676]: audit 2024-09-20T23:46:12.481694+0000 mon.a (mon.0) 3793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:13 smithi044 bash[22676]: audit 2024-09-20T23:46:12.492017+0000 mon.a (mon.0) 3794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:13 smithi044 bash[22676]: audit 2024-09-20T23:46:13.368827+0000 mon.a (mon.0) 3795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:13 smithi044 bash[22676]: audit 2024-09-20T23:46:13.377689+0000 mon.a (mon.0) 3796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:13 smithi044 bash[22676]: audit 2024-09-20T23:46:13.387631+0000 mon.a (mon.0) 3797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:13 smithi179 bash[23186]: cluster 2024-09-20T23:46:12.220137+0000 mgr.a (mgr.14388) 3964 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:13 smithi179 bash[23186]: audit 2024-09-20T23:46:12.473331+0000 mon.a (mon.0) 3792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:13 smithi179 bash[23186]: audit 2024-09-20T23:46:12.481694+0000 mon.a (mon.0) 3793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:13 smithi179 bash[23186]: audit 2024-09-20T23:46:12.492017+0000 mon.a (mon.0) 3794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:13 smithi179 bash[23186]: audit 2024-09-20T23:46:13.368827+0000 mon.a (mon.0) 3795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:13 smithi179 bash[23186]: audit 2024-09-20T23:46:13.377689+0000 mon.a (mon.0) 3796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:13 smithi179 bash[23186]: audit 2024-09-20T23:46:13.387631+0000 mon.a (mon.0) 3797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:13 smithi049 bash[23528]: cluster 2024-09-20T23:46:12.220137+0000 mgr.a (mgr.14388) 3964 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:13 smithi049 bash[23528]: audit 2024-09-20T23:46:12.473331+0000 mon.a (mon.0) 3792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:13 smithi049 bash[23528]: audit 2024-09-20T23:46:12.481694+0000 mon.a (mon.0) 3793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:13 smithi049 bash[23528]: audit 2024-09-20T23:46:12.492017+0000 mon.a (mon.0) 3794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:13 smithi049 bash[23528]: audit 2024-09-20T23:46:13.368827+0000 mon.a (mon.0) 3795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:13 smithi049 bash[23528]: audit 2024-09-20T23:46:13.377689+0000 mon.a (mon.0) 3796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:13 smithi049 bash[23528]: audit 2024-09-20T23:46:13.387631+0000 mon.a (mon.0) 3797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:15 smithi044 bash[22676]: cluster 2024-09-20T23:46:14.220935+0000 mgr.a (mgr.14388) 3965 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:46:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:15 smithi179 bash[23186]: cluster 2024-09-20T23:46:14.220935+0000 mgr.a (mgr.14388) 3965 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:46:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:15 smithi049 bash[23528]: cluster 2024-09-20T23:46:14.220935+0000 mgr.a (mgr.14388) 3965 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:46:16.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:17.046 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:17.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:17.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:17.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:17.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:17 smithi044 bash[22676]: cluster 2024-09-20T23:46:16.223349+0000 mgr.a (mgr.14388) 3966 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:17 smithi044 bash[22676]: audit 2024-09-20T23:46:16.603910+0000 mgr.a (mgr.14388) 3967 : audit [DBG] from='client.96183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:17 smithi179 bash[23186]: cluster 2024-09-20T23:46:16.223349+0000 mgr.a (mgr.14388) 3966 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:17 smithi179 bash[23186]: audit 2024-09-20T23:46:16.603910+0000 mgr.a (mgr.14388) 3967 : audit [DBG] from='client.96183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:17 smithi049 bash[23528]: cluster 2024-09-20T23:46:16.223349+0000 mgr.a (mgr.14388) 3966 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:17 smithi049 bash[23528]: audit 2024-09-20T23:46:16.603910+0000 mgr.a (mgr.14388) 3967 : audit [DBG] from='client.96183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:19 smithi044 bash[22676]: cluster 2024-09-20T23:46:18.224009+0000 mgr.a (mgr.14388) 3968 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:19 smithi179 bash[23186]: cluster 2024-09-20T23:46:18.224009+0000 mgr.a (mgr.14388) 3968 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:19 smithi049 bash[23528]: cluster 2024-09-20T23:46:18.224009+0000 mgr.a (mgr.14388) 3968 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:21 smithi179 bash[23186]: cluster 2024-09-20T23:46:20.227097+0000 mgr.a (mgr.14388) 3969 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:46:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:21 smithi179 bash[23186]: audit 2024-09-20T23:46:21.444637+0000 mon.a (mon.0) 3798 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:46:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:21 smithi179 bash[23186]: audit 2024-09-20T23:46:21.452145+0000 mon.a (mon.0) 3799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:46:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:21 smithi179 bash[23186]: audit 2024-09-20T23:46:21.454133+0000 mon.a (mon.0) 3800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:46:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:21 smithi179 bash[23186]: audit 2024-09-20T23:46:21.465566+0000 mon.a (mon.0) 3801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:21 smithi179 bash[23186]: audit 2024-09-20T23:46:21.471898+0000 mon.a (mon.0) 3802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:46:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:21 smithi049 bash[23528]: cluster 2024-09-20T23:46:20.227097+0000 mgr.a (mgr.14388) 3969 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:46:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:21 smithi049 bash[23528]: audit 2024-09-20T23:46:21.444637+0000 mon.a (mon.0) 3798 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:46:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:21 smithi049 bash[23528]: audit 2024-09-20T23:46:21.452145+0000 mon.a (mon.0) 3799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:46:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:21 smithi049 bash[23528]: audit 2024-09-20T23:46:21.454133+0000 mon.a (mon.0) 3800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:46:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:21 smithi049 bash[23528]: audit 2024-09-20T23:46:21.465566+0000 mon.a (mon.0) 3801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:21 smithi049 bash[23528]: audit 2024-09-20T23:46:21.471898+0000 mon.a (mon.0) 3802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:46:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:21 smithi044 bash[22676]: cluster 2024-09-20T23:46:20.227097+0000 mgr.a (mgr.14388) 3969 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:46:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:21 smithi044 bash[22676]: audit 2024-09-20T23:46:21.444637+0000 mon.a (mon.0) 3798 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:46:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:21 smithi044 bash[22676]: audit 2024-09-20T23:46:21.452145+0000 mon.a (mon.0) 3799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:46:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:21 smithi044 bash[22676]: audit 2024-09-20T23:46:21.454133+0000 mon.a (mon.0) 3800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:46:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:21 smithi044 bash[22676]: audit 2024-09-20T23:46:21.465566+0000 mon.a (mon.0) 3801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:21 smithi044 bash[22676]: audit 2024-09-20T23:46:21.471898+0000 mon.a (mon.0) 3802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:46:22.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:22.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:22.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:22.492 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:46:22 smithi044 bash[22930]: debug 2024-09-20T23:46:22.234+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:46:22.493 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:46:22 smithi044 bash[22930]: debug 2024-09-20T23:46:22.238+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:22 smithi179 bash[23186]: audit 2024-09-20T23:46:21.474252+0000 mgr.a (mgr.14388) 3970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:46:22.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:22.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:22.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:22.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:22.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:22 smithi049 bash[23528]: audit 2024-09-20T23:46:21.474252+0000 mgr.a (mgr.14388) 3970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:46:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:22 smithi044 bash[22676]: audit 2024-09-20T23:46:21.474252+0000 mgr.a (mgr.14388) 3970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:46:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:23 smithi049 bash[23528]: cluster 2024-09-20T23:46:22.227720+0000 mgr.a (mgr.14388) 3971 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:23 smithi049 bash[23528]: audit 2024-09-20T23:46:22.240571+0000 mgr.a (mgr.14388) 3972 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:46:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:23 smithi049 bash[23528]: cephadm 2024-09-20T23:46:22.241733+0000 mgr.a (mgr.14388) 3973 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:46:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:23 smithi049 bash[23528]: audit 2024-09-20T23:46:22.372384+0000 mgr.a (mgr.14388) 3974 : audit [DBG] from='client.96366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:23 smithi044 bash[22676]: cluster 2024-09-20T23:46:22.227720+0000 mgr.a (mgr.14388) 3971 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:23 smithi044 bash[22676]: audit 2024-09-20T23:46:22.240571+0000 mgr.a (mgr.14388) 3972 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:46:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:23 smithi044 bash[22676]: cephadm 2024-09-20T23:46:22.241733+0000 mgr.a (mgr.14388) 3973 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:46:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:23 smithi044 bash[22676]: audit 2024-09-20T23:46:22.372384+0000 mgr.a (mgr.14388) 3974 : audit [DBG] from='client.96366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:23 smithi179 bash[23186]: cluster 2024-09-20T23:46:22.227720+0000 mgr.a (mgr.14388) 3971 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:23 smithi179 bash[23186]: audit 2024-09-20T23:46:22.240571+0000 mgr.a (mgr.14388) 3972 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:46:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:23 smithi179 bash[23186]: cephadm 2024-09-20T23:46:22.241733+0000 mgr.a (mgr.14388) 3973 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:46:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:23 smithi179 bash[23186]: audit 2024-09-20T23:46:22.372384+0000 mgr.a (mgr.14388) 3974 : audit [DBG] from='client.96366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:25 smithi179 bash[23186]: cluster 2024-09-20T23:46:24.228578+0000 mgr.a (mgr.14388) 3975 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:25 smithi049 bash[23528]: cluster 2024-09-20T23:46:24.228578+0000 mgr.a (mgr.14388) 3975 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:25 smithi044 bash[22676]: cluster 2024-09-20T23:46:24.228578+0000 mgr.a (mgr.14388) 3975 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:27.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:27.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:27.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:27 smithi049 bash[23528]: cluster 2024-09-20T23:46:26.231287+0000 mgr.a (mgr.14388) 3976 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:27 smithi044 bash[22676]: cluster 2024-09-20T23:46:26.231287+0000 mgr.a (mgr.14388) 3976 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:27 smithi179 bash[23186]: cluster 2024-09-20T23:46:26.231287+0000 mgr.a (mgr.14388) 3976 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:28.562 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:29 smithi049 bash[23528]: audit 2024-09-20T23:46:28.131730+0000 mgr.a (mgr.14388) 3977 : audit [DBG] from='client.96441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:29 smithi049 bash[23528]: cluster 2024-09-20T23:46:28.231752+0000 mgr.a (mgr.14388) 3978 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:29 smithi044 bash[22676]: audit 2024-09-20T23:46:28.131730+0000 mgr.a (mgr.14388) 3977 : audit [DBG] from='client.96441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:29 smithi044 bash[22676]: cluster 2024-09-20T23:46:28.231752+0000 mgr.a (mgr.14388) 3978 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:29 smithi179 bash[23186]: audit 2024-09-20T23:46:28.131730+0000 mgr.a (mgr.14388) 3977 : audit [DBG] from='client.96441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:29 smithi179 bash[23186]: cluster 2024-09-20T23:46:28.231752+0000 mgr.a (mgr.14388) 3978 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:31 smithi049 bash[23528]: cluster 2024-09-20T23:46:30.234033+0000 mgr.a (mgr.14388) 3979 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:31 smithi049 bash[23528]: audit 2024-09-20T23:46:30.797349+0000 mon.a (mon.0) 3803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:31 smithi049 bash[23528]: audit 2024-09-20T23:46:30.805849+0000 mon.a (mon.0) 3804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:31 smithi049 bash[23528]: audit 2024-09-20T23:46:30.816441+0000 mon.a (mon.0) 3805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:31 smithi044 bash[22676]: cluster 2024-09-20T23:46:30.234033+0000 mgr.a (mgr.14388) 3979 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:31 smithi044 bash[22676]: audit 2024-09-20T23:46:30.797349+0000 mon.a (mon.0) 3803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:31 smithi044 bash[22676]: audit 2024-09-20T23:46:30.805849+0000 mon.a (mon.0) 3804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:31 smithi044 bash[22676]: audit 2024-09-20T23:46:30.816441+0000 mon.a (mon.0) 3805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:31 smithi179 bash[23186]: cluster 2024-09-20T23:46:30.234033+0000 mgr.a (mgr.14388) 3979 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:31 smithi179 bash[23186]: audit 2024-09-20T23:46:30.797349+0000 mon.a (mon.0) 3803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:31 smithi179 bash[23186]: audit 2024-09-20T23:46:30.805849+0000 mon.a (mon.0) 3804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:31 smithi179 bash[23186]: audit 2024-09-20T23:46:30.816441+0000 mon.a (mon.0) 3805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:33.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:33.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:33 smithi044 bash[22676]: cluster 2024-09-20T23:46:32.234793+0000 mgr.a (mgr.14388) 3980 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:33 smithi044 bash[22676]: audit 2024-09-20T23:46:32.700538+0000 mon.a (mon.0) 3806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:33 smithi044 bash[22676]: audit 2024-09-20T23:46:32.709102+0000 mon.a (mon.0) 3807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:33 smithi044 bash[22676]: audit 2024-09-20T23:46:32.719164+0000 mon.a (mon.0) 3808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:33 smithi044 bash[22676]: audit 2024-09-20T23:46:33.606672+0000 mon.a (mon.0) 3809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:33 smithi044 bash[22676]: audit 2024-09-20T23:46:33.613506+0000 mon.a (mon.0) 3810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:33 smithi044 bash[22676]: audit 2024-09-20T23:46:33.621830+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:33 smithi179 bash[23186]: cluster 2024-09-20T23:46:32.234793+0000 mgr.a (mgr.14388) 3980 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:33 smithi179 bash[23186]: audit 2024-09-20T23:46:32.700538+0000 mon.a (mon.0) 3806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:33 smithi179 bash[23186]: audit 2024-09-20T23:46:32.709102+0000 mon.a (mon.0) 3807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:33 smithi179 bash[23186]: audit 2024-09-20T23:46:32.719164+0000 mon.a (mon.0) 3808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:33 smithi179 bash[23186]: audit 2024-09-20T23:46:33.606672+0000 mon.a (mon.0) 3809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:33 smithi179 bash[23186]: audit 2024-09-20T23:46:33.613506+0000 mon.a (mon.0) 3810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:33 smithi179 bash[23186]: audit 2024-09-20T23:46:33.621830+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:33 smithi049 bash[23528]: cluster 2024-09-20T23:46:32.234793+0000 mgr.a (mgr.14388) 3980 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:33 smithi049 bash[23528]: audit 2024-09-20T23:46:32.700538+0000 mon.a (mon.0) 3806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:33 smithi049 bash[23528]: audit 2024-09-20T23:46:32.709102+0000 mon.a (mon.0) 3807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:33 smithi049 bash[23528]: audit 2024-09-20T23:46:32.719164+0000 mon.a (mon.0) 3808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:33 smithi049 bash[23528]: audit 2024-09-20T23:46:33.606672+0000 mon.a (mon.0) 3809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:33 smithi049 bash[23528]: audit 2024-09-20T23:46:33.613506+0000 mon.a (mon.0) 3810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:33 smithi049 bash[23528]: audit 2024-09-20T23:46:33.621830+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:34.348 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:34.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:34.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:34.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:34.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:34 smithi044 bash[22676]: audit 2024-09-20T23:46:33.899488+0000 mgr.a (mgr.14388) 3981 : audit [DBG] from='client.96516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:34 smithi179 bash[23186]: audit 2024-09-20T23:46:33.899488+0000 mgr.a (mgr.14388) 3981 : audit [DBG] from='client.96516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:34 smithi049 bash[23528]: audit 2024-09-20T23:46:33.899488+0000 mgr.a (mgr.14388) 3981 : audit [DBG] from='client.96516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:35 smithi044 bash[22676]: cluster 2024-09-20T23:46:34.235310+0000 mgr.a (mgr.14388) 3982 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:35 smithi179 bash[23186]: cluster 2024-09-20T23:46:34.235310+0000 mgr.a (mgr.14388) 3982 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:35 smithi049 bash[23528]: cluster 2024-09-20T23:46:34.235310+0000 mgr.a (mgr.14388) 3982 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:37 smithi044 bash[22676]: cluster 2024-09-20T23:46:36.237615+0000 mgr.a (mgr.14388) 3983 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:37 smithi179 bash[23186]: cluster 2024-09-20T23:46:36.237615+0000 mgr.a (mgr.14388) 3983 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:37 smithi049 bash[23528]: cluster 2024-09-20T23:46:36.237615+0000 mgr.a (mgr.14388) 3983 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:46:39.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:39.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:39.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:39 smithi044 bash[22676]: cluster 2024-09-20T23:46:38.238434+0000 mgr.a (mgr.14388) 3984 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:39 smithi179 bash[23186]: cluster 2024-09-20T23:46:38.238434+0000 mgr.a (mgr.14388) 3984 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:39 smithi049 bash[23528]: cluster 2024-09-20T23:46:38.238434+0000 mgr.a (mgr.14388) 3984 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:40.129 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:40 smithi044 bash[22676]: audit 2024-09-20T23:46:39.689452+0000 mgr.a (mgr.14388) 3985 : audit [DBG] from='client.96594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:40 smithi179 bash[23186]: audit 2024-09-20T23:46:39.689452+0000 mgr.a (mgr.14388) 3985 : audit [DBG] from='client.96594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:40 smithi049 bash[23528]: audit 2024-09-20T23:46:39.689452+0000 mgr.a (mgr.14388) 3985 : audit [DBG] from='client.96594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:41 smithi044 bash[22676]: cluster 2024-09-20T23:46:40.241336+0000 mgr.a (mgr.14388) 3986 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:41 smithi179 bash[23186]: cluster 2024-09-20T23:46:40.241336+0000 mgr.a (mgr.14388) 3986 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:41 smithi049 bash[23528]: cluster 2024-09-20T23:46:40.241336+0000 mgr.a (mgr.14388) 3986 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:43 smithi044 bash[22676]: cluster 2024-09-20T23:46:42.242129+0000 mgr.a (mgr.14388) 3987 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:43 smithi179 bash[23186]: cluster 2024-09-20T23:46:42.242129+0000 mgr.a (mgr.14388) 3987 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:43 smithi049 bash[23528]: cluster 2024-09-20T23:46:42.242129+0000 mgr.a (mgr.14388) 3987 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:45.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:45.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:45.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:45.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:45 smithi179 bash[23186]: cluster 2024-09-20T23:46:44.242901+0000 mgr.a (mgr.14388) 3988 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:46:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:45 smithi049 bash[23528]: cluster 2024-09-20T23:46:44.242901+0000 mgr.a (mgr.14388) 3988 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:46:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:45 smithi044 bash[22676]: cluster 2024-09-20T23:46:44.242901+0000 mgr.a (mgr.14388) 3988 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:46:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:46 smithi179 bash[23186]: audit 2024-09-20T23:46:45.467183+0000 mgr.a (mgr.14388) 3989 : audit [DBG] from='client.96669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:46 smithi049 bash[23528]: audit 2024-09-20T23:46:45.467183+0000 mgr.a (mgr.14388) 3989 : audit [DBG] from='client.96669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:46 smithi044 bash[22676]: audit 2024-09-20T23:46:45.467183+0000 mgr.a (mgr.14388) 3989 : audit [DBG] from='client.96669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:47 smithi179 bash[23186]: cluster 2024-09-20T23:46:46.245703+0000 mgr.a (mgr.14388) 3990 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:47 smithi049 bash[23528]: cluster 2024-09-20T23:46:46.245703+0000 mgr.a (mgr.14388) 3990 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:47 smithi044 bash[22676]: cluster 2024-09-20T23:46:46.245703+0000 mgr.a (mgr.14388) 3990 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:49 smithi049 bash[23528]: cluster 2024-09-20T23:46:48.246519+0000 mgr.a (mgr.14388) 3991 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:49 smithi044 bash[22676]: cluster 2024-09-20T23:46:48.246519+0000 mgr.a (mgr.14388) 3991 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:49 smithi179 bash[23186]: cluster 2024-09-20T23:46:48.246519+0000 mgr.a (mgr.14388) 3991 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:46:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:50.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:50.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:51.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:51.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:51.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:51.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:51.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:51 smithi044 bash[22676]: cluster 2024-09-20T23:46:50.248511+0000 mgr.a (mgr.14388) 3992 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:51 smithi044 bash[22676]: audit 2024-09-20T23:46:50.945692+0000 mon.a (mon.0) 3812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:51 smithi044 bash[22676]: audit 2024-09-20T23:46:50.955741+0000 mon.a (mon.0) 3813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:51 smithi044 bash[22676]: audit 2024-09-20T23:46:50.967254+0000 mon.a (mon.0) 3814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:51 smithi179 bash[23186]: cluster 2024-09-20T23:46:50.248511+0000 mgr.a (mgr.14388) 3992 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:51 smithi179 bash[23186]: audit 2024-09-20T23:46:50.945692+0000 mon.a (mon.0) 3812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:51 smithi179 bash[23186]: audit 2024-09-20T23:46:50.955741+0000 mon.a (mon.0) 3813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:51 smithi179 bash[23186]: audit 2024-09-20T23:46:50.967254+0000 mon.a (mon.0) 3814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:51 smithi049 bash[23528]: cluster 2024-09-20T23:46:50.248511+0000 mgr.a (mgr.14388) 3992 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:51 smithi049 bash[23528]: audit 2024-09-20T23:46:50.945692+0000 mon.a (mon.0) 3812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:51 smithi049 bash[23528]: audit 2024-09-20T23:46:50.955741+0000 mon.a (mon.0) 3813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:51 smithi049 bash[23528]: audit 2024-09-20T23:46:50.967254+0000 mon.a (mon.0) 3814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:52 smithi044 bash[22676]: audit 2024-09-20T23:46:51.259038+0000 mgr.a (mgr.14388) 3993 : audit [DBG] from='client.96744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:52 smithi044 bash[22676]: audit 2024-09-20T23:46:52.920125+0000 mon.a (mon.0) 3815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:52 smithi044 bash[22676]: audit 2024-09-20T23:46:52.928240+0000 mon.a (mon.0) 3816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:52 smithi044 bash[22676]: audit 2024-09-20T23:46:52.938581+0000 mon.a (mon.0) 3817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:52 smithi179 bash[23186]: audit 2024-09-20T23:46:51.259038+0000 mgr.a (mgr.14388) 3993 : audit [DBG] from='client.96744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:52 smithi179 bash[23186]: audit 2024-09-20T23:46:52.920125+0000 mon.a (mon.0) 3815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:52 smithi179 bash[23186]: audit 2024-09-20T23:46:52.928240+0000 mon.a (mon.0) 3816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:52 smithi179 bash[23186]: audit 2024-09-20T23:46:52.938581+0000 mon.a (mon.0) 3817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:52 smithi049 bash[23528]: audit 2024-09-20T23:46:51.259038+0000 mgr.a (mgr.14388) 3993 : audit [DBG] from='client.96744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:52 smithi049 bash[23528]: audit 2024-09-20T23:46:52.920125+0000 mon.a (mon.0) 3815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:52 smithi049 bash[23528]: audit 2024-09-20T23:46:52.928240+0000 mon.a (mon.0) 3816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:52 smithi049 bash[23528]: audit 2024-09-20T23:46:52.938581+0000 mon.a (mon.0) 3817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:53 smithi044 bash[22676]: cluster 2024-09-20T23:46:52.249422+0000 mgr.a (mgr.14388) 3994 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:53 smithi044 bash[22676]: audit 2024-09-20T23:46:53.839106+0000 mon.a (mon.0) 3818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:53 smithi044 bash[22676]: audit 2024-09-20T23:46:53.847402+0000 mon.a (mon.0) 3819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:53 smithi044 bash[22676]: audit 2024-09-20T23:46:53.857517+0000 mon.a (mon.0) 3820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:53 smithi179 bash[23186]: cluster 2024-09-20T23:46:52.249422+0000 mgr.a (mgr.14388) 3994 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:53 smithi179 bash[23186]: audit 2024-09-20T23:46:53.839106+0000 mon.a (mon.0) 3818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:53 smithi179 bash[23186]: audit 2024-09-20T23:46:53.847402+0000 mon.a (mon.0) 3819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:53 smithi179 bash[23186]: audit 2024-09-20T23:46:53.857517+0000 mon.a (mon.0) 3820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:53 smithi049 bash[23528]: cluster 2024-09-20T23:46:52.249422+0000 mgr.a (mgr.14388) 3994 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:53 smithi049 bash[23528]: audit 2024-09-20T23:46:53.839106+0000 mon.a (mon.0) 3818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:53 smithi049 bash[23528]: audit 2024-09-20T23:46:53.847402+0000 mon.a (mon.0) 3819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:53 smithi049 bash[23528]: audit 2024-09-20T23:46:53.857517+0000 mon.a (mon.0) 3820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:46:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:55 smithi049 bash[23528]: cluster 2024-09-20T23:46:54.250190+0000 mgr.a (mgr.14388) 3995 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:55 smithi044 bash[22676]: cluster 2024-09-20T23:46:54.250190+0000 mgr.a (mgr.14388) 3995 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:55 smithi179 bash[23186]: cluster 2024-09-20T23:46:54.250190+0000 mgr.a (mgr.14388) 3995 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:46:56.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:46:56.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:46:56.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:46:57.492 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:46:57.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:46:57.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:46:57.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:46:57.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:46:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:57 smithi044 bash[22676]: cluster 2024-09-20T23:46:56.252391+0000 mgr.a (mgr.14388) 3996 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:46:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:57 smithi044 bash[22676]: audit 2024-09-20T23:46:57.037653+0000 mgr.a (mgr.14388) 3997 : audit [DBG] from='client.96819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:57 smithi179 bash[23186]: cluster 2024-09-20T23:46:56.252391+0000 mgr.a (mgr.14388) 3996 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:46:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:57 smithi179 bash[23186]: audit 2024-09-20T23:46:57.037653+0000 mgr.a (mgr.14388) 3997 : audit [DBG] from='client.96819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:46:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:57 smithi049 bash[23528]: cluster 2024-09-20T23:46:56.252391+0000 mgr.a (mgr.14388) 3996 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:46:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:57 smithi049 bash[23528]: audit 2024-09-20T23:46:57.037653+0000 mgr.a (mgr.14388) 3997 : audit [DBG] from='client.96819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:00.176 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:46:59 smithi044 bash[22676]: cluster 2024-09-20T23:46:58.253296+0000 mgr.a (mgr.14388) 3998 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:46:59 smithi179 bash[23186]: cluster 2024-09-20T23:46:58.253296+0000 mgr.a (mgr.14388) 3998 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:46:59 smithi049 bash[23528]: cluster 2024-09-20T23:46:58.253296+0000 mgr.a (mgr.14388) 3998 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:01 smithi044 bash[22676]: cluster 2024-09-20T23:47:00.255548+0000 mgr.a (mgr.14388) 3999 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:01 smithi179 bash[23186]: cluster 2024-09-20T23:47:00.255548+0000 mgr.a (mgr.14388) 3999 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:01 smithi049 bash[23528]: cluster 2024-09-20T23:47:00.255548+0000 mgr.a (mgr.14388) 3999 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:02.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:02.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:02.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:03.262 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:03.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:03.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:03.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:03.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:04.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:03 smithi044 bash[22676]: cluster 2024-09-20T23:47:02.256353+0000 mgr.a (mgr.14388) 4000 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:04.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:03 smithi044 bash[22676]: audit 2024-09-20T23:47:02.833562+0000 mgr.a (mgr.14388) 4001 : audit [DBG] from='client.96897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:03 smithi179 bash[23186]: cluster 2024-09-20T23:47:02.256353+0000 mgr.a (mgr.14388) 4000 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:03 smithi179 bash[23186]: audit 2024-09-20T23:47:02.833562+0000 mgr.a (mgr.14388) 4001 : audit [DBG] from='client.96897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:03 smithi049 bash[23528]: cluster 2024-09-20T23:47:02.256353+0000 mgr.a (mgr.14388) 4000 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:03 smithi049 bash[23528]: audit 2024-09-20T23:47:02.833562+0000 mgr.a (mgr.14388) 4001 : audit [DBG] from='client.96897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:05 smithi044 bash[22676]: cluster 2024-09-20T23:47:04.257118+0000 mgr.a (mgr.14388) 4002 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:05 smithi179 bash[23186]: cluster 2024-09-20T23:47:04.257118+0000 mgr.a (mgr.14388) 4002 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:05 smithi049 bash[23528]: cluster 2024-09-20T23:47:04.257118+0000 mgr.a (mgr.14388) 4002 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:07 smithi044 bash[22676]: cluster 2024-09-20T23:47:06.259342+0000 mgr.a (mgr.14388) 4003 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:07 smithi179 bash[23186]: cluster 2024-09-20T23:47:06.259342+0000 mgr.a (mgr.14388) 4003 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:08.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:07 smithi049 bash[23528]: cluster 2024-09-20T23:47:06.259342+0000 mgr.a (mgr.14388) 4003 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:09.035 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:09.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:09.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:09 smithi179 bash[23186]: cluster 2024-09-20T23:47:08.260100+0000 mgr.a (mgr.14388) 4004 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:09 smithi179 bash[23186]: audit 2024-09-20T23:47:08.602243+0000 mgr.a (mgr.14388) 4005 : audit [DBG] from='client.96975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:09 smithi049 bash[23528]: cluster 2024-09-20T23:47:08.260100+0000 mgr.a (mgr.14388) 4004 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:09 smithi049 bash[23528]: audit 2024-09-20T23:47:08.602243+0000 mgr.a (mgr.14388) 4005 : audit [DBG] from='client.96975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:09 smithi044 bash[22676]: cluster 2024-09-20T23:47:08.260100+0000 mgr.a (mgr.14388) 4004 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:09 smithi044 bash[22676]: audit 2024-09-20T23:47:08.602243+0000 mgr.a (mgr.14388) 4005 : audit [DBG] from='client.96975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:11 smithi179 bash[23186]: cluster 2024-09-20T23:47:10.262599+0000 mgr.a (mgr.14388) 4006 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:11 smithi179 bash[23186]: audit 2024-09-20T23:47:11.130107+0000 mon.a (mon.0) 3821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:11 smithi179 bash[23186]: audit 2024-09-20T23:47:11.138830+0000 mon.a (mon.0) 3822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:11 smithi179 bash[23186]: audit 2024-09-20T23:47:11.149349+0000 mon.a (mon.0) 3823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:11 smithi049 bash[23528]: cluster 2024-09-20T23:47:10.262599+0000 mgr.a (mgr.14388) 4006 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:11 smithi049 bash[23528]: audit 2024-09-20T23:47:11.130107+0000 mon.a (mon.0) 3821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:11 smithi049 bash[23528]: audit 2024-09-20T23:47:11.138830+0000 mon.a (mon.0) 3822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:11 smithi049 bash[23528]: audit 2024-09-20T23:47:11.149349+0000 mon.a (mon.0) 3823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:11 smithi044 bash[22676]: cluster 2024-09-20T23:47:10.262599+0000 mgr.a (mgr.14388) 4006 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:11 smithi044 bash[22676]: audit 2024-09-20T23:47:11.130107+0000 mon.a (mon.0) 3821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:11 smithi044 bash[22676]: audit 2024-09-20T23:47:11.138830+0000 mon.a (mon.0) 3822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:11 smithi044 bash[22676]: audit 2024-09-20T23:47:11.149349+0000 mon.a (mon.0) 3823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:14.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:14.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:13 smithi179 bash[23186]: cluster 2024-09-20T23:47:12.263556+0000 mgr.a (mgr.14388) 4007 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:13 smithi179 bash[23186]: audit 2024-09-20T23:47:13.148279+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:13 smithi179 bash[23186]: audit 2024-09-20T23:47:13.156955+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:13 smithi179 bash[23186]: audit 2024-09-20T23:47:13.167440+0000 mon.a (mon.0) 3826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:13 smithi049 bash[23528]: cluster 2024-09-20T23:47:12.263556+0000 mgr.a (mgr.14388) 4007 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:13 smithi049 bash[23528]: audit 2024-09-20T23:47:13.148279+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:13 smithi049 bash[23528]: audit 2024-09-20T23:47:13.156955+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:13 smithi049 bash[23528]: audit 2024-09-20T23:47:13.167440+0000 mon.a (mon.0) 3826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:13 smithi044 bash[22676]: cluster 2024-09-20T23:47:12.263556+0000 mgr.a (mgr.14388) 4007 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:13 smithi044 bash[22676]: audit 2024-09-20T23:47:13.148279+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:13 smithi044 bash[22676]: audit 2024-09-20T23:47:13.156955+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:13 smithi044 bash[22676]: audit 2024-09-20T23:47:13.167440+0000 mon.a (mon.0) 3826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:14.787 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:14.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:14.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:14.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:14.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:15 smithi044 bash[22676]: audit 2024-09-20T23:47:14.062905+0000 mon.a (mon.0) 3827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:15 smithi044 bash[22676]: audit 2024-09-20T23:47:14.069741+0000 mon.a (mon.0) 3828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:15 smithi044 bash[22676]: audit 2024-09-20T23:47:14.079306+0000 mon.a (mon.0) 3829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:15 smithi179 bash[23186]: audit 2024-09-20T23:47:14.062905+0000 mon.a (mon.0) 3827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:15 smithi179 bash[23186]: audit 2024-09-20T23:47:14.069741+0000 mon.a (mon.0) 3828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:15 smithi179 bash[23186]: audit 2024-09-20T23:47:14.079306+0000 mon.a (mon.0) 3829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:15 smithi049 bash[23528]: audit 2024-09-20T23:47:14.062905+0000 mon.a (mon.0) 3827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:15 smithi049 bash[23528]: audit 2024-09-20T23:47:14.069741+0000 mon.a (mon.0) 3828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:15 smithi049 bash[23528]: audit 2024-09-20T23:47:14.079306+0000 mon.a (mon.0) 3829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:16.352 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:16 smithi049 bash[23528]: cluster 2024-09-20T23:47:14.264320+0000 mgr.a (mgr.14388) 4008 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:16.352 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:16 smithi049 bash[23528]: audit 2024-09-20T23:47:14.371714+0000 mgr.a (mgr.14388) 4009 : audit [DBG] from='client.97050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:16 smithi044 bash[22676]: cluster 2024-09-20T23:47:14.264320+0000 mgr.a (mgr.14388) 4008 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:16 smithi044 bash[22676]: audit 2024-09-20T23:47:14.371714+0000 mgr.a (mgr.14388) 4009 : audit [DBG] from='client.97050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:16 smithi179 bash[23186]: cluster 2024-09-20T23:47:14.264320+0000 mgr.a (mgr.14388) 4008 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:16 smithi179 bash[23186]: audit 2024-09-20T23:47:14.371714+0000 mgr.a (mgr.14388) 4009 : audit [DBG] from='client.97050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:18 smithi044 bash[22676]: cluster 2024-09-20T23:47:16.266696+0000 mgr.a (mgr.14388) 4010 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:18 smithi179 bash[23186]: cluster 2024-09-20T23:47:16.266696+0000 mgr.a (mgr.14388) 4010 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:18 smithi049 bash[23528]: cluster 2024-09-20T23:47:16.266696+0000 mgr.a (mgr.14388) 4010 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:19.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:19.789 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:19.789 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:20 smithi044 bash[22676]: cluster 2024-09-20T23:47:18.267489+0000 mgr.a (mgr.14388) 4011 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:20 smithi179 bash[23186]: cluster 2024-09-20T23:47:18.267489+0000 mgr.a (mgr.14388) 4011 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:20.530 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:20.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:20.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:20.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:20.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:20 smithi049 bash[23528]: cluster 2024-09-20T23:47:18.267489+0000 mgr.a (mgr.14388) 4011 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:21 smithi044 bash[22676]: audit 2024-09-20T23:47:20.117796+0000 mgr.a (mgr.14388) 4012 : audit [DBG] from='client.97125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:21 smithi044 bash[22676]: cluster 2024-09-20T23:47:20.269115+0000 mgr.a (mgr.14388) 4013 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:21 smithi179 bash[23186]: audit 2024-09-20T23:47:20.117796+0000 mgr.a (mgr.14388) 4012 : audit [DBG] from='client.97125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:21 smithi179 bash[23186]: cluster 2024-09-20T23:47:20.269115+0000 mgr.a (mgr.14388) 4013 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:21 smithi049 bash[23528]: audit 2024-09-20T23:47:20.117796+0000 mgr.a (mgr.14388) 4012 : audit [DBG] from='client.97125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:21 smithi049 bash[23528]: cluster 2024-09-20T23:47:20.269115+0000 mgr.a (mgr.14388) 4013 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:22 smithi044 bash[22676]: audit 2024-09-20T23:47:22.292022+0000 mon.a (mon.0) 3830 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:47:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:22 smithi044 bash[22676]: audit 2024-09-20T23:47:22.298616+0000 mon.a (mon.0) 3831 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:47:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:22 smithi044 bash[22676]: audit 2024-09-20T23:47:22.299629+0000 mon.a (mon.0) 3832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:47:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:22 smithi044 bash[22676]: audit 2024-09-20T23:47:22.309285+0000 mon.a (mon.0) 3833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:22 smithi044 bash[22676]: audit 2024-09-20T23:47:22.312494+0000 mon.a (mon.0) 3834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:47:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:22 smithi179 bash[23186]: audit 2024-09-20T23:47:22.292022+0000 mon.a (mon.0) 3830 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:47:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:22 smithi179 bash[23186]: audit 2024-09-20T23:47:22.298616+0000 mon.a (mon.0) 3831 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:47:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:22 smithi179 bash[23186]: audit 2024-09-20T23:47:22.299629+0000 mon.a (mon.0) 3832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:47:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:22 smithi179 bash[23186]: audit 2024-09-20T23:47:22.309285+0000 mon.a (mon.0) 3833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:22 smithi179 bash[23186]: audit 2024-09-20T23:47:22.312494+0000 mon.a (mon.0) 3834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:47:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:22 smithi049 bash[23528]: audit 2024-09-20T23:47:22.292022+0000 mon.a (mon.0) 3830 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:22 smithi049 bash[23528]: audit 2024-09-20T23:47:22.298616+0000 mon.a (mon.0) 3831 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:22 smithi049 bash[23528]: audit 2024-09-20T23:47:22.299629+0000 mon.a (mon.0) 3832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:22 smithi049 bash[23528]: audit 2024-09-20T23:47:22.309285+0000 mon.a (mon.0) 3833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:22 smithi049 bash[23528]: audit 2024-09-20T23:47:22.312494+0000 mon.a (mon.0) 3834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:47:23.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:47:23 smithi044 bash[22930]: debug 2024-09-20T23:47:23.029+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:47:23.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:47:23 smithi044 bash[22930]: debug 2024-09-20T23:47:23.029+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:47:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:23 smithi044 bash[22676]: cluster 2024-09-20T23:47:22.269755+0000 mgr.a (mgr.14388) 4014 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:47:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:23 smithi044 bash[22676]: audit 2024-09-20T23:47:22.313592+0000 mgr.a (mgr.14388) 4015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:47:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:23 smithi044 bash[22676]: audit 2024-09-20T23:47:23.035816+0000 mgr.a (mgr.14388) 4016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:47:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:23 smithi044 bash[22676]: cephadm 2024-09-20T23:47:23.036925+0000 mgr.a (mgr.14388) 4017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:47:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:23 smithi179 bash[23186]: cluster 2024-09-20T23:47:22.269755+0000 mgr.a (mgr.14388) 4014 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:47:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:23 smithi179 bash[23186]: audit 2024-09-20T23:47:22.313592+0000 mgr.a (mgr.14388) 4015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:47:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:23 smithi179 bash[23186]: audit 2024-09-20T23:47:23.035816+0000 mgr.a (mgr.14388) 4016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:47:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:23 smithi179 bash[23186]: cephadm 2024-09-20T23:47:23.036925+0000 mgr.a (mgr.14388) 4017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:47:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:23 smithi049 bash[23528]: cluster 2024-09-20T23:47:22.269755+0000 mgr.a (mgr.14388) 4014 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:47:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:23 smithi049 bash[23528]: audit 2024-09-20T23:47:22.313592+0000 mgr.a (mgr.14388) 4015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:47:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:23 smithi049 bash[23528]: audit 2024-09-20T23:47:23.035816+0000 mgr.a (mgr.14388) 4016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:47:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:23 smithi049 bash[23528]: cephadm 2024-09-20T23:47:23.036925+0000 mgr.a (mgr.14388) 4017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:47:25.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:25.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:25 smithi044 bash[22676]: cluster 2024-09-20T23:47:24.270625+0000 mgr.a (mgr.14388) 4018 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:47:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:25 smithi179 bash[23186]: cluster 2024-09-20T23:47:24.270625+0000 mgr.a (mgr.14388) 4018 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:47:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:25 smithi049 bash[23528]: cluster 2024-09-20T23:47:24.270625+0000 mgr.a (mgr.14388) 4018 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:47:26.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:26.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:26.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:26.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:26.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:26.640 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:26 smithi179 bash[23186]: audit 2024-09-20T23:47:25.871229+0000 mgr.a (mgr.14388) 4019 : audit [DBG] from='client.97308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:26 smithi044 bash[22676]: audit 2024-09-20T23:47:25.871229+0000 mgr.a (mgr.14388) 4019 : audit [DBG] from='client.97308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:26 smithi049 bash[23528]: audit 2024-09-20T23:47:25.871229+0000 mgr.a (mgr.14388) 4019 : audit [DBG] from='client.97308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:27 smithi044 bash[22676]: cluster 2024-09-20T23:47:26.271905+0000 mgr.a (mgr.14388) 4020 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:27 smithi179 bash[23186]: cluster 2024-09-20T23:47:26.271905+0000 mgr.a (mgr.14388) 4020 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:27 smithi049 bash[23528]: cluster 2024-09-20T23:47:26.271905+0000 mgr.a (mgr.14388) 4020 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:29 smithi044 bash[22676]: cluster 2024-09-20T23:47:28.272607+0000 mgr.a (mgr.14388) 4021 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:47:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:29 smithi179 bash[23186]: cluster 2024-09-20T23:47:28.272607+0000 mgr.a (mgr.14388) 4021 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:47:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:29 smithi049 bash[23528]: cluster 2024-09-20T23:47:28.272607+0000 mgr.a (mgr.14388) 4021 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:47:31.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:31.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:31.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:31 smithi044 bash[22676]: cluster 2024-09-20T23:47:30.274557+0000 mgr.a (mgr.14388) 4022 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:31 smithi044 bash[22676]: audit 2024-09-20T23:47:31.297289+0000 mon.a (mon.0) 3835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:31 smithi044 bash[22676]: audit 2024-09-20T23:47:31.307173+0000 mon.a (mon.0) 3836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:31 smithi044 bash[22676]: audit 2024-09-20T23:47:31.318997+0000 mon.a (mon.0) 3837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:31 smithi179 bash[23186]: cluster 2024-09-20T23:47:30.274557+0000 mgr.a (mgr.14388) 4022 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:31 smithi179 bash[23186]: audit 2024-09-20T23:47:31.297289+0000 mon.a (mon.0) 3835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:31 smithi179 bash[23186]: audit 2024-09-20T23:47:31.307173+0000 mon.a (mon.0) 3836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:31 smithi179 bash[23186]: audit 2024-09-20T23:47:31.318997+0000 mon.a (mon.0) 3837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:31 smithi049 bash[23528]: cluster 2024-09-20T23:47:30.274557+0000 mgr.a (mgr.14388) 4022 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:31 smithi049 bash[23528]: audit 2024-09-20T23:47:31.297289+0000 mon.a (mon.0) 3835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:31 smithi049 bash[23528]: audit 2024-09-20T23:47:31.307173+0000 mon.a (mon.0) 3836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:31 smithi049 bash[23528]: audit 2024-09-20T23:47:31.318997+0000 mon.a (mon.0) 3837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:32.096 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:32.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:32.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:32.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:32.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:32 smithi044 bash[22676]: audit 2024-09-20T23:47:31.672713+0000 mgr.a (mgr.14388) 4023 : audit [DBG] from='client.97386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:32 smithi179 bash[23186]: audit 2024-09-20T23:47:31.672713+0000 mgr.a (mgr.14388) 4023 : audit [DBG] from='client.97386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:32 smithi049 bash[23528]: audit 2024-09-20T23:47:31.672713+0000 mgr.a (mgr.14388) 4023 : audit [DBG] from='client.97386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:33.725 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:33 smithi049 bash[23528]: cluster 2024-09-20T23:47:32.275673+0000 mgr.a (mgr.14388) 4024 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:33.725 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:33 smithi049 bash[23528]: audit 2024-09-20T23:47:33.350409+0000 mon.a (mon.0) 3838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.725 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:33 smithi049 bash[23528]: audit 2024-09-20T23:47:33.358746+0000 mon.a (mon.0) 3839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.726 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:33 smithi049 bash[23528]: audit 2024-09-20T23:47:33.369091+0000 mon.a (mon.0) 3840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:33 smithi044 bash[22676]: cluster 2024-09-20T23:47:32.275673+0000 mgr.a (mgr.14388) 4024 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:33 smithi044 bash[22676]: audit 2024-09-20T23:47:33.350409+0000 mon.a (mon.0) 3838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:33 smithi044 bash[22676]: audit 2024-09-20T23:47:33.358746+0000 mon.a (mon.0) 3839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:33 smithi044 bash[22676]: audit 2024-09-20T23:47:33.369091+0000 mon.a (mon.0) 3840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:33 smithi179 bash[23186]: cluster 2024-09-20T23:47:32.275673+0000 mgr.a (mgr.14388) 4024 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:33 smithi179 bash[23186]: audit 2024-09-20T23:47:33.350409+0000 mon.a (mon.0) 3838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:33 smithi179 bash[23186]: audit 2024-09-20T23:47:33.358746+0000 mon.a (mon.0) 3839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:33 smithi179 bash[23186]: audit 2024-09-20T23:47:33.369091+0000 mon.a (mon.0) 3840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:35 smithi049 bash[23528]: cluster 2024-09-20T23:47:34.276238+0000 mgr.a (mgr.14388) 4025 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:35 smithi049 bash[23528]: audit 2024-09-20T23:47:34.277184+0000 mon.a (mon.0) 3841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:35 smithi049 bash[23528]: audit 2024-09-20T23:47:34.285642+0000 mon.a (mon.0) 3842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:35 smithi049 bash[23528]: audit 2024-09-20T23:47:34.294263+0000 mon.a (mon.0) 3843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:35 smithi044 bash[22676]: cluster 2024-09-20T23:47:34.276238+0000 mgr.a (mgr.14388) 4025 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:35 smithi044 bash[22676]: audit 2024-09-20T23:47:34.277184+0000 mon.a (mon.0) 3841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:35 smithi044 bash[22676]: audit 2024-09-20T23:47:34.285642+0000 mon.a (mon.0) 3842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:35 smithi044 bash[22676]: audit 2024-09-20T23:47:34.294263+0000 mon.a (mon.0) 3843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:35 smithi179 bash[23186]: cluster 2024-09-20T23:47:34.276238+0000 mgr.a (mgr.14388) 4025 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:35 smithi179 bash[23186]: audit 2024-09-20T23:47:34.277184+0000 mon.a (mon.0) 3841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:35 smithi179 bash[23186]: audit 2024-09-20T23:47:34.285642+0000 mon.a (mon.0) 3842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:35 smithi179 bash[23186]: audit 2024-09-20T23:47:34.294263+0000 mon.a (mon.0) 3843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:37 smithi049 bash[23528]: cluster 2024-09-20T23:47:36.278425+0000 mgr.a (mgr.14388) 4026 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:37 smithi044 bash[22676]: cluster 2024-09-20T23:47:36.278425+0000 mgr.a (mgr.14388) 4026 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:37 smithi179 bash[23186]: cluster 2024-09-20T23:47:36.278425+0000 mgr.a (mgr.14388) 4026 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:47:37.859 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:37.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:37.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:37.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:37.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:38 smithi049 bash[23528]: audit 2024-09-20T23:47:37.434624+0000 mgr.a (mgr.14388) 4027 : audit [DBG] from='client.97464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:38 smithi044 bash[22676]: audit 2024-09-20T23:47:37.434624+0000 mgr.a (mgr.14388) 4027 : audit [DBG] from='client.97464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:38 smithi179 bash[23186]: audit 2024-09-20T23:47:37.434624+0000 mgr.a (mgr.14388) 4027 : audit [DBG] from='client.97464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:39 smithi044 bash[22676]: cluster 2024-09-20T23:47:38.279692+0000 mgr.a (mgr.14388) 4028 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:39 smithi179 bash[23186]: cluster 2024-09-20T23:47:38.279692+0000 mgr.a (mgr.14388) 4028 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:39 smithi049 bash[23528]: cluster 2024-09-20T23:47:38.279692+0000 mgr.a (mgr.14388) 4028 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:41.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:41 smithi044 bash[22676]: cluster 2024-09-20T23:47:40.281967+0000 mgr.a (mgr.14388) 4029 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:41 smithi179 bash[23186]: cluster 2024-09-20T23:47:40.281967+0000 mgr.a (mgr.14388) 4029 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:41 smithi049 bash[23528]: cluster 2024-09-20T23:47:40.281967+0000 mgr.a (mgr.14388) 4029 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:42.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:42.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:42.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:43 smithi044 bash[22676]: cluster 2024-09-20T23:47:42.282731+0000 mgr.a (mgr.14388) 4030 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:43.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:43 smithi179 bash[23186]: cluster 2024-09-20T23:47:42.282731+0000 mgr.a (mgr.14388) 4030 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:43 smithi049 bash[23528]: cluster 2024-09-20T23:47:42.282731+0000 mgr.a (mgr.14388) 4030 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:44 smithi044 bash[22676]: audit 2024-09-20T23:47:43.197626+0000 mgr.a (mgr.14388) 4031 : audit [DBG] from='client.97542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:44 smithi179 bash[23186]: audit 2024-09-20T23:47:43.197626+0000 mgr.a (mgr.14388) 4031 : audit [DBG] from='client.97542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:44 smithi049 bash[23528]: audit 2024-09-20T23:47:43.197626+0000 mgr.a (mgr.14388) 4031 : audit [DBG] from='client.97542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:45 smithi044 bash[22676]: cluster 2024-09-20T23:47:44.283689+0000 mgr.a (mgr.14388) 4032 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:45 smithi179 bash[23186]: cluster 2024-09-20T23:47:44.283689+0000 mgr.a (mgr.14388) 4032 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:45 smithi049 bash[23528]: cluster 2024-09-20T23:47:44.283689+0000 mgr.a (mgr.14388) 4032 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:47.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:47 smithi179 bash[23186]: cluster 2024-09-20T23:47:46.285986+0000 mgr.a (mgr.14388) 4033 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:47 smithi044 bash[22676]: cluster 2024-09-20T23:47:46.285986+0000 mgr.a (mgr.14388) 4033 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:47 smithi049 bash[23528]: cluster 2024-09-20T23:47:46.285986+0000 mgr.a (mgr.14388) 4033 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:48.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:48.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:48.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:49.410 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:49.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:49 smithi179 bash[23186]: cluster 2024-09-20T23:47:48.286733+0000 mgr.a (mgr.14388) 4034 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:49.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:49 smithi179 bash[23186]: audit 2024-09-20T23:47:48.967669+0000 mgr.a (mgr.14388) 4035 : audit [DBG] from='client.97614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:49 smithi044 bash[22676]: cluster 2024-09-20T23:47:48.286733+0000 mgr.a (mgr.14388) 4034 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:49 smithi044 bash[22676]: audit 2024-09-20T23:47:48.967669+0000 mgr.a (mgr.14388) 4035 : audit [DBG] from='client.97614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:49 smithi049 bash[23528]: cluster 2024-09-20T23:47:48.286733+0000 mgr.a (mgr.14388) 4034 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:49 smithi049 bash[23528]: audit 2024-09-20T23:47:48.967669+0000 mgr.a (mgr.14388) 4035 : audit [DBG] from='client.97614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:51.420 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:51 smithi049 bash[23528]: cluster 2024-09-20T23:47:50.289166+0000 mgr.a (mgr.14388) 4036 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:51 smithi044 bash[22676]: cluster 2024-09-20T23:47:50.289166+0000 mgr.a (mgr.14388) 4036 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:51 smithi179 bash[23186]: cluster 2024-09-20T23:47:50.289166+0000 mgr.a (mgr.14388) 4036 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:47:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:52 smithi044 bash[22676]: audit 2024-09-20T23:47:51.484846+0000 mon.a (mon.0) 3844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:52 smithi044 bash[22676]: audit 2024-09-20T23:47:51.495132+0000 mon.a (mon.0) 3845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:52 smithi044 bash[22676]: audit 2024-09-20T23:47:51.506858+0000 mon.a (mon.0) 3846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:52 smithi179 bash[23186]: audit 2024-09-20T23:47:51.484846+0000 mon.a (mon.0) 3844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:52 smithi179 bash[23186]: audit 2024-09-20T23:47:51.495132+0000 mon.a (mon.0) 3845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:52 smithi179 bash[23186]: audit 2024-09-20T23:47:51.506858+0000 mon.a (mon.0) 3846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:52 smithi049 bash[23528]: audit 2024-09-20T23:47:51.484846+0000 mon.a (mon.0) 3844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:52 smithi049 bash[23528]: audit 2024-09-20T23:47:51.495132+0000 mon.a (mon.0) 3845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:52 smithi049 bash[23528]: audit 2024-09-20T23:47:51.506858+0000 mon.a (mon.0) 3846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:53 smithi049 bash[23528]: cluster 2024-09-20T23:47:52.289916+0000 mgr.a (mgr.14388) 4037 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:53 smithi044 bash[22676]: cluster 2024-09-20T23:47:52.289916+0000 mgr.a (mgr.14388) 4037 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:53 smithi179 bash[23186]: cluster 2024-09-20T23:47:52.289916+0000 mgr.a (mgr.14388) 4037 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:54.412 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:47:54.412 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:47:54.413 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:47:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:54 smithi044 bash[22676]: audit 2024-09-20T23:47:53.573454+0000 mon.a (mon.0) 3847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:54 smithi044 bash[22676]: audit 2024-09-20T23:47:53.581689+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:54 smithi044 bash[22676]: audit 2024-09-20T23:47:53.591699+0000 mon.a (mon.0) 3849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:54 smithi044 bash[22676]: audit 2024-09-20T23:47:54.488128+0000 mon.a (mon.0) 3850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:54 smithi044 bash[22676]: audit 2024-09-20T23:47:54.495627+0000 mon.a (mon.0) 3851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:54 smithi044 bash[22676]: audit 2024-09-20T23:47:54.504593+0000 mon.a (mon.0) 3852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:54 smithi179 bash[23186]: audit 2024-09-20T23:47:53.573454+0000 mon.a (mon.0) 3847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:54 smithi179 bash[23186]: audit 2024-09-20T23:47:53.581689+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:54 smithi179 bash[23186]: audit 2024-09-20T23:47:53.591699+0000 mon.a (mon.0) 3849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:54 smithi179 bash[23186]: audit 2024-09-20T23:47:54.488128+0000 mon.a (mon.0) 3850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:54 smithi179 bash[23186]: audit 2024-09-20T23:47:54.495627+0000 mon.a (mon.0) 3851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:54 smithi179 bash[23186]: audit 2024-09-20T23:47:54.504593+0000 mon.a (mon.0) 3852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:54 smithi049 bash[23528]: audit 2024-09-20T23:47:53.573454+0000 mon.a (mon.0) 3847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:54 smithi049 bash[23528]: audit 2024-09-20T23:47:53.581689+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:54 smithi049 bash[23528]: audit 2024-09-20T23:47:53.591699+0000 mon.a (mon.0) 3849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:54 smithi049 bash[23528]: audit 2024-09-20T23:47:54.488128+0000 mon.a (mon.0) 3850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:54 smithi049 bash[23528]: audit 2024-09-20T23:47:54.495627+0000 mon.a (mon.0) 3851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:54 smithi049 bash[23528]: audit 2024-09-20T23:47:54.504593+0000 mon.a (mon.0) 3852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:47:55.220 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:47:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:47:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:47:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:47:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:47:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:55 smithi044 bash[22676]: cluster 2024-09-20T23:47:54.290671+0000 mgr.a (mgr.14388) 4038 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:55 smithi044 bash[22676]: audit 2024-09-20T23:47:54.764176+0000 mgr.a (mgr.14388) 4039 : audit [DBG] from='client.97692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:55 smithi179 bash[23186]: cluster 2024-09-20T23:47:54.290671+0000 mgr.a (mgr.14388) 4038 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:55 smithi179 bash[23186]: audit 2024-09-20T23:47:54.764176+0000 mgr.a (mgr.14388) 4039 : audit [DBG] from='client.97692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:55 smithi049 bash[23528]: cluster 2024-09-20T23:47:54.290671+0000 mgr.a (mgr.14388) 4038 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:55 smithi049 bash[23528]: audit 2024-09-20T23:47:54.764176+0000 mgr.a (mgr.14388) 4039 : audit [DBG] from='client.97692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:47:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:57 smithi044 bash[22676]: cluster 2024-09-20T23:47:56.293675+0000 mgr.a (mgr.14388) 4040 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:57 smithi179 bash[23186]: cluster 2024-09-20T23:47:56.293675+0000 mgr.a (mgr.14388) 4040 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:57 smithi049 bash[23528]: cluster 2024-09-20T23:47:56.293675+0000 mgr.a (mgr.14388) 4040 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:47:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:47:59 smithi044 bash[22676]: cluster 2024-09-20T23:47:58.294627+0000 mgr.a (mgr.14388) 4041 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:47:59 smithi179 bash[23186]: cluster 2024-09-20T23:47:58.294627+0000 mgr.a (mgr.14388) 4041 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:47:59 smithi049 bash[23528]: cluster 2024-09-20T23:47:58.294627+0000 mgr.a (mgr.14388) 4041 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:00.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:00.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:00.979 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:00.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:00.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:00.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:00.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:01 smithi044 bash[22676]: cluster 2024-09-20T23:48:00.296743+0000 mgr.a (mgr.14388) 4042 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:01 smithi044 bash[22676]: audit 2024-09-20T23:48:00.556617+0000 mgr.a (mgr.14388) 4043 : audit [DBG] from='client.97767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:01 smithi179 bash[23186]: cluster 2024-09-20T23:48:00.296743+0000 mgr.a (mgr.14388) 4042 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:01 smithi179 bash[23186]: audit 2024-09-20T23:48:00.556617+0000 mgr.a (mgr.14388) 4043 : audit [DBG] from='client.97767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:01 smithi049 bash[23528]: cluster 2024-09-20T23:48:00.296743+0000 mgr.a (mgr.14388) 4042 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:01 smithi049 bash[23528]: audit 2024-09-20T23:48:00.556617+0000 mgr.a (mgr.14388) 4043 : audit [DBG] from='client.97767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:03 smithi044 bash[22676]: cluster 2024-09-20T23:48:02.297809+0000 mgr.a (mgr.14388) 4044 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:03 smithi179 bash[23186]: cluster 2024-09-20T23:48:02.297809+0000 mgr.a (mgr.14388) 4044 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:03 smithi049 bash[23528]: cluster 2024-09-20T23:48:02.297809+0000 mgr.a (mgr.14388) 4044 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:05 smithi044 bash[22676]: cluster 2024-09-20T23:48:04.298375+0000 mgr.a (mgr.14388) 4045 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:05 smithi179 bash[23186]: cluster 2024-09-20T23:48:04.298375+0000 mgr.a (mgr.14388) 4045 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:05 smithi049 bash[23528]: cluster 2024-09-20T23:48:04.298375+0000 mgr.a (mgr.14388) 4045 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:06.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:06.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:06.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:06.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:06.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:07 smithi179 bash[23186]: cluster 2024-09-20T23:48:06.300492+0000 mgr.a (mgr.14388) 4046 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:07 smithi179 bash[23186]: audit 2024-09-20T23:48:06.324273+0000 mgr.a (mgr.14388) 4047 : audit [DBG] from='client.97845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:07 smithi044 bash[22676]: cluster 2024-09-20T23:48:06.300492+0000 mgr.a (mgr.14388) 4046 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:07 smithi044 bash[22676]: audit 2024-09-20T23:48:06.324273+0000 mgr.a (mgr.14388) 4047 : audit [DBG] from='client.97845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:07 smithi049 bash[23528]: cluster 2024-09-20T23:48:06.300492+0000 mgr.a (mgr.14388) 4046 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:07 smithi049 bash[23528]: audit 2024-09-20T23:48:06.324273+0000 mgr.a (mgr.14388) 4047 : audit [DBG] from='client.97845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:09 smithi044 bash[22676]: cluster 2024-09-20T23:48:08.301563+0000 mgr.a (mgr.14388) 4048 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:09 smithi179 bash[23186]: cluster 2024-09-20T23:48:08.301563+0000 mgr.a (mgr.14388) 4048 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:09 smithi049 bash[23528]: cluster 2024-09-20T23:48:08.301563+0000 mgr.a (mgr.14388) 4048 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:11.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:11.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:11.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:11 smithi044 bash[22676]: cluster 2024-09-20T23:48:10.303964+0000 mgr.a (mgr.14388) 4049 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:11 smithi179 bash[23186]: cluster 2024-09-20T23:48:10.303964+0000 mgr.a (mgr.14388) 4049 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:11 smithi049 bash[23528]: cluster 2024-09-20T23:48:10.303964+0000 mgr.a (mgr.14388) 4049 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:12.544 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:12 smithi044 bash[22676]: audit 2024-09-20T23:48:11.655834+0000 mon.a (mon.0) 3853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:12 smithi044 bash[22676]: audit 2024-09-20T23:48:11.665955+0000 mon.a (mon.0) 3854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:12 smithi044 bash[22676]: audit 2024-09-20T23:48:11.676458+0000 mon.a (mon.0) 3855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:12 smithi179 bash[23186]: audit 2024-09-20T23:48:11.655834+0000 mon.a (mon.0) 3853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:12 smithi179 bash[23186]: audit 2024-09-20T23:48:11.665955+0000 mon.a (mon.0) 3854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:12 smithi179 bash[23186]: audit 2024-09-20T23:48:11.676458+0000 mon.a (mon.0) 3855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:12 smithi049 bash[23528]: audit 2024-09-20T23:48:11.655834+0000 mon.a (mon.0) 3853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:12 smithi049 bash[23528]: audit 2024-09-20T23:48:11.665955+0000 mon.a (mon.0) 3854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:12 smithi049 bash[23528]: audit 2024-09-20T23:48:11.676458+0000 mon.a (mon.0) 3855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:13 smithi044 bash[22676]: audit 2024-09-20T23:48:12.099964+0000 mgr.a (mgr.14388) 4050 : audit [DBG] from='client.97923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:13 smithi044 bash[22676]: cluster 2024-09-20T23:48:12.304564+0000 mgr.a (mgr.14388) 4051 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:13 smithi179 bash[23186]: audit 2024-09-20T23:48:12.099964+0000 mgr.a (mgr.14388) 4050 : audit [DBG] from='client.97923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:13 smithi179 bash[23186]: cluster 2024-09-20T23:48:12.304564+0000 mgr.a (mgr.14388) 4051 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:13 smithi049 bash[23528]: audit 2024-09-20T23:48:12.099964+0000 mgr.a (mgr.14388) 4050 : audit [DBG] from='client.97923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:13 smithi049 bash[23528]: cluster 2024-09-20T23:48:12.304564+0000 mgr.a (mgr.14388) 4051 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:14 smithi044 bash[22676]: audit 2024-09-20T23:48:13.806911+0000 mon.a (mon.0) 3856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:14 smithi044 bash[22676]: audit 2024-09-20T23:48:13.815745+0000 mon.a (mon.0) 3857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:14 smithi044 bash[22676]: audit 2024-09-20T23:48:13.826358+0000 mon.a (mon.0) 3858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:14 smithi044 bash[22676]: audit 2024-09-20T23:48:14.683870+0000 mon.a (mon.0) 3859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:14 smithi044 bash[22676]: audit 2024-09-20T23:48:14.689869+0000 mon.a (mon.0) 3860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:14 smithi044 bash[22676]: audit 2024-09-20T23:48:14.708654+0000 mon.a (mon.0) 3861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.214 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:14 smithi179 bash[23186]: audit 2024-09-20T23:48:13.806911+0000 mon.a (mon.0) 3856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:14 smithi179 bash[23186]: audit 2024-09-20T23:48:13.815745+0000 mon.a (mon.0) 3857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:14 smithi179 bash[23186]: audit 2024-09-20T23:48:13.826358+0000 mon.a (mon.0) 3858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:14 smithi179 bash[23186]: audit 2024-09-20T23:48:14.683870+0000 mon.a (mon.0) 3859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:14 smithi179 bash[23186]: audit 2024-09-20T23:48:14.689869+0000 mon.a (mon.0) 3860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:14 smithi179 bash[23186]: audit 2024-09-20T23:48:14.708654+0000 mon.a (mon.0) 3861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:14 smithi049 bash[23528]: audit 2024-09-20T23:48:13.806911+0000 mon.a (mon.0) 3856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:14 smithi049 bash[23528]: audit 2024-09-20T23:48:13.815745+0000 mon.a (mon.0) 3857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:14 smithi049 bash[23528]: audit 2024-09-20T23:48:13.826358+0000 mon.a (mon.0) 3858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:14 smithi049 bash[23528]: audit 2024-09-20T23:48:14.683870+0000 mon.a (mon.0) 3859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:14 smithi049 bash[23528]: audit 2024-09-20T23:48:14.689869+0000 mon.a (mon.0) 3860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:14 smithi049 bash[23528]: audit 2024-09-20T23:48:14.708654+0000 mon.a (mon.0) 3861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:15 smithi044 bash[22676]: cluster 2024-09-20T23:48:14.305643+0000 mgr.a (mgr.14388) 4052 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:15 smithi179 bash[23186]: cluster 2024-09-20T23:48:14.305643+0000 mgr.a (mgr.14388) 4052 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:15 smithi049 bash[23528]: cluster 2024-09-20T23:48:14.305643+0000 mgr.a (mgr.14388) 4052 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:17.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:17.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:17.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:18.182 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:17 smithi049 bash[23528]: cluster 2024-09-20T23:48:16.307930+0000 mgr.a (mgr.14388) 4053 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:17 smithi044 bash[22676]: cluster 2024-09-20T23:48:16.307930+0000 mgr.a (mgr.14388) 4053 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:17 smithi179 bash[23186]: cluster 2024-09-20T23:48:16.307930+0000 mgr.a (mgr.14388) 4053 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:18.333 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:18 smithi044 bash[22676]: audit 2024-09-20T23:48:17.885862+0000 mgr.a (mgr.14388) 4054 : audit [DBG] from='client.97998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:18 smithi179 bash[23186]: audit 2024-09-20T23:48:17.885862+0000 mgr.a (mgr.14388) 4054 : audit [DBG] from='client.97998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:18 smithi049 bash[23528]: audit 2024-09-20T23:48:17.885862+0000 mgr.a (mgr.14388) 4054 : audit [DBG] from='client.97998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:19 smithi044 bash[22676]: cluster 2024-09-20T23:48:18.308495+0000 mgr.a (mgr.14388) 4055 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:19 smithi179 bash[23186]: cluster 2024-09-20T23:48:18.308495+0000 mgr.a (mgr.14388) 4055 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:19 smithi049 bash[23528]: cluster 2024-09-20T23:48:18.308495+0000 mgr.a (mgr.14388) 4055 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:21 smithi044 bash[22676]: cluster 2024-09-20T23:48:20.310674+0000 mgr.a (mgr.14388) 4056 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:21 smithi179 bash[23186]: cluster 2024-09-20T23:48:20.310674+0000 mgr.a (mgr.14388) 4056 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:21 smithi049 bash[23528]: cluster 2024-09-20T23:48:20.310674+0000 mgr.a (mgr.14388) 4056 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22930]: debug 2024-09-20T23:48:23.901+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22930]: debug 2024-09-20T23:48:23.913+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22676]: cluster 2024-09-20T23:48:22.311462+0000 mgr.a (mgr.14388) 4057 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22676]: audit 2024-09-20T23:48:23.089712+0000 mon.a (mon.0) 3862 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22676]: audit 2024-09-20T23:48:23.096492+0000 mon.a (mon.0) 3863 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22676]: audit 2024-09-20T23:48:23.098452+0000 mon.a (mon.0) 3864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22676]: audit 2024-09-20T23:48:23.110069+0000 mon.a (mon.0) 3865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:23 smithi044 bash[22676]: audit 2024-09-20T23:48:23.116409+0000 mon.a (mon.0) 3866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:48:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:23 smithi179 bash[23186]: cluster 2024-09-20T23:48:22.311462+0000 mgr.a (mgr.14388) 4057 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:23 smithi179 bash[23186]: audit 2024-09-20T23:48:23.089712+0000 mon.a (mon.0) 3862 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:48:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:23 smithi179 bash[23186]: audit 2024-09-20T23:48:23.096492+0000 mon.a (mon.0) 3863 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:48:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:23 smithi179 bash[23186]: audit 2024-09-20T23:48:23.098452+0000 mon.a (mon.0) 3864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:48:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:23 smithi179 bash[23186]: audit 2024-09-20T23:48:23.110069+0000 mon.a (mon.0) 3865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:23 smithi179 bash[23186]: audit 2024-09-20T23:48:23.116409+0000 mon.a (mon.0) 3866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:48:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:23 smithi049 bash[23528]: cluster 2024-09-20T23:48:22.311462+0000 mgr.a (mgr.14388) 4057 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:23 smithi049 bash[23528]: audit 2024-09-20T23:48:23.089712+0000 mon.a (mon.0) 3862 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:48:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:23 smithi049 bash[23528]: audit 2024-09-20T23:48:23.096492+0000 mon.a (mon.0) 3863 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:48:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:23 smithi049 bash[23528]: audit 2024-09-20T23:48:23.098452+0000 mon.a (mon.0) 3864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:48:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:23 smithi049 bash[23528]: audit 2024-09-20T23:48:23.110069+0000 mon.a (mon.0) 3865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:23 smithi049 bash[23528]: audit 2024-09-20T23:48:23.116409+0000 mon.a (mon.0) 3866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:48:24.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:24.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:24.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:24.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:24.308 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:24 smithi044 bash[22676]: audit 2024-09-20T23:48:23.118776+0000 mgr.a (mgr.14388) 4058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:48:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:24 smithi044 bash[22676]: audit 2024-09-20T23:48:23.694273+0000 mgr.a (mgr.14388) 4059 : audit [DBG] from='client.98112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:24 smithi044 bash[22676]: audit 2024-09-20T23:48:23.901954+0000 mgr.a (mgr.14388) 4060 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:48:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:24 smithi044 bash[22676]: cephadm 2024-09-20T23:48:23.913527+0000 mgr.a (mgr.14388) 4061 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:48:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:24 smithi179 bash[23186]: audit 2024-09-20T23:48:23.118776+0000 mgr.a (mgr.14388) 4058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:48:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:24 smithi179 bash[23186]: audit 2024-09-20T23:48:23.694273+0000 mgr.a (mgr.14388) 4059 : audit [DBG] from='client.98112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:24 smithi179 bash[23186]: audit 2024-09-20T23:48:23.901954+0000 mgr.a (mgr.14388) 4060 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:48:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:24 smithi179 bash[23186]: cephadm 2024-09-20T23:48:23.913527+0000 mgr.a (mgr.14388) 4061 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:48:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:24 smithi049 bash[23528]: audit 2024-09-20T23:48:23.118776+0000 mgr.a (mgr.14388) 4058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:48:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:24 smithi049 bash[23528]: audit 2024-09-20T23:48:23.694273+0000 mgr.a (mgr.14388) 4059 : audit [DBG] from='client.98112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:24 smithi049 bash[23528]: audit 2024-09-20T23:48:23.901954+0000 mgr.a (mgr.14388) 4060 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:48:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:24 smithi049 bash[23528]: cephadm 2024-09-20T23:48:23.913527+0000 mgr.a (mgr.14388) 4061 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:48:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:25 smithi044 bash[22676]: cluster 2024-09-20T23:48:24.311985+0000 mgr.a (mgr.14388) 4062 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:25 smithi179 bash[23186]: cluster 2024-09-20T23:48:24.311985+0000 mgr.a (mgr.14388) 4062 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:25 smithi049 bash[23528]: cluster 2024-09-20T23:48:24.311985+0000 mgr.a (mgr.14388) 4062 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:27 smithi044 bash[22676]: cluster 2024-09-20T23:48:26.314239+0000 mgr.a (mgr.14388) 4063 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:27 smithi179 bash[23186]: cluster 2024-09-20T23:48:26.314239+0000 mgr.a (mgr.14388) 4063 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:27 smithi049 bash[23528]: cluster 2024-09-20T23:48:26.314239+0000 mgr.a (mgr.14388) 4063 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:29.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:29.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:29.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:29.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:29 smithi179 bash[23186]: cluster 2024-09-20T23:48:28.315004+0000 mgr.a (mgr.14388) 4064 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:29 smithi044 bash[22676]: cluster 2024-09-20T23:48:28.315004+0000 mgr.a (mgr.14388) 4064 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:29 smithi049 bash[23528]: cluster 2024-09-20T23:48:28.315004+0000 mgr.a (mgr.14388) 4064 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:30.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:30.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:30.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:30.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:30 smithi179 bash[23186]: audit 2024-09-20T23:48:29.649413+0000 mgr.a (mgr.14388) 4065 : audit [DBG] from='client.98259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:30 smithi044 bash[22676]: audit 2024-09-20T23:48:29.649413+0000 mgr.a (mgr.14388) 4065 : audit [DBG] from='client.98259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:30.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:30 smithi049 bash[23528]: audit 2024-09-20T23:48:29.649413+0000 mgr.a (mgr.14388) 4065 : audit [DBG] from='client.98259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:31.697 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:31 smithi049 bash[23528]: cluster 2024-09-20T23:48:30.317824+0000 mgr.a (mgr.14388) 4066 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:31.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:31 smithi179 bash[23186]: cluster 2024-09-20T23:48:30.317824+0000 mgr.a (mgr.14388) 4066 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:31 smithi044 bash[22676]: cluster 2024-09-20T23:48:30.317824+0000 mgr.a (mgr.14388) 4066 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:33.220 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:32 smithi049 bash[23528]: audit 2024-09-20T23:48:31.835589+0000 mon.a (mon.0) 3867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.220 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:32 smithi049 bash[23528]: audit 2024-09-20T23:48:31.844563+0000 mon.a (mon.0) 3868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.220 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:32 smithi049 bash[23528]: audit 2024-09-20T23:48:31.854858+0000 mon.a (mon.0) 3869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:32 smithi044 bash[22676]: audit 2024-09-20T23:48:31.835589+0000 mon.a (mon.0) 3867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:32 smithi044 bash[22676]: audit 2024-09-20T23:48:31.844563+0000 mon.a (mon.0) 3868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:32 smithi044 bash[22676]: audit 2024-09-20T23:48:31.854858+0000 mon.a (mon.0) 3869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:32 smithi179 bash[23186]: audit 2024-09-20T23:48:31.835589+0000 mon.a (mon.0) 3867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:32 smithi179 bash[23186]: audit 2024-09-20T23:48:31.844563+0000 mon.a (mon.0) 3868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:32 smithi179 bash[23186]: audit 2024-09-20T23:48:31.854858+0000 mon.a (mon.0) 3869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:34.114 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:33 smithi049 bash[23528]: cluster 2024-09-20T23:48:32.318587+0000 mgr.a (mgr.14388) 4067 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:48:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:33 smithi044 bash[22676]: cluster 2024-09-20T23:48:32.318587+0000 mgr.a (mgr.14388) 4067 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:48:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:33 smithi179 bash[23186]: cluster 2024-09-20T23:48:32.318587+0000 mgr.a (mgr.14388) 4067 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:48:35.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:35.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:35.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:35 smithi044 bash[22676]: audit 2024-09-20T23:48:34.010373+0000 mon.a (mon.0) 3870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:35 smithi044 bash[22676]: audit 2024-09-20T23:48:34.018493+0000 mon.a (mon.0) 3871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:35 smithi044 bash[22676]: audit 2024-09-20T23:48:34.028210+0000 mon.a (mon.0) 3872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:35 smithi044 bash[22676]: audit 2024-09-20T23:48:34.918308+0000 mon.a (mon.0) 3873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:35 smithi044 bash[22676]: audit 2024-09-20T23:48:34.923907+0000 mon.a (mon.0) 3874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:35 smithi044 bash[22676]: audit 2024-09-20T23:48:34.934751+0000 mon.a (mon.0) 3875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:35 smithi049 bash[23528]: audit 2024-09-20T23:48:34.010373+0000 mon.a (mon.0) 3870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:35 smithi049 bash[23528]: audit 2024-09-20T23:48:34.018493+0000 mon.a (mon.0) 3871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:35 smithi049 bash[23528]: audit 2024-09-20T23:48:34.028210+0000 mon.a (mon.0) 3872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:35 smithi049 bash[23528]: audit 2024-09-20T23:48:34.918308+0000 mon.a (mon.0) 3873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:35 smithi049 bash[23528]: audit 2024-09-20T23:48:34.923907+0000 mon.a (mon.0) 3874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:35 smithi049 bash[23528]: audit 2024-09-20T23:48:34.934751+0000 mon.a (mon.0) 3875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:35 smithi179 bash[23186]: audit 2024-09-20T23:48:34.010373+0000 mon.a (mon.0) 3870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:35 smithi179 bash[23186]: audit 2024-09-20T23:48:34.018493+0000 mon.a (mon.0) 3871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:35 smithi179 bash[23186]: audit 2024-09-20T23:48:34.028210+0000 mon.a (mon.0) 3872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:35 smithi179 bash[23186]: audit 2024-09-20T23:48:34.918308+0000 mon.a (mon.0) 3873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:35 smithi179 bash[23186]: audit 2024-09-20T23:48:34.923907+0000 mon.a (mon.0) 3874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:35 smithi179 bash[23186]: audit 2024-09-20T23:48:34.934751+0000 mon.a (mon.0) 3875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:35.859 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:35.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:35.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:35.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:35.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:36 smithi179 bash[23186]: cluster 2024-09-20T23:48:34.319366+0000 mgr.a (mgr.14388) 4068 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:48:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:36 smithi049 bash[23528]: cluster 2024-09-20T23:48:34.319366+0000 mgr.a (mgr.14388) 4068 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:48:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:36 smithi044 bash[22676]: cluster 2024-09-20T23:48:34.319366+0000 mgr.a (mgr.14388) 4068 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:48:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:37 smithi049 bash[23528]: audit 2024-09-20T23:48:35.413608+0000 mgr.a (mgr.14388) 4069 : audit [DBG] from='client.98337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:37 smithi044 bash[22676]: audit 2024-09-20T23:48:35.413608+0000 mgr.a (mgr.14388) 4069 : audit [DBG] from='client.98337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:37 smithi179 bash[23186]: audit 2024-09-20T23:48:35.413608+0000 mgr.a (mgr.14388) 4069 : audit [DBG] from='client.98337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:38 smithi049 bash[23528]: cluster 2024-09-20T23:48:36.322309+0000 mgr.a (mgr.14388) 4070 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:38 smithi044 bash[22676]: cluster 2024-09-20T23:48:36.322309+0000 mgr.a (mgr.14388) 4070 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:38 smithi179 bash[23186]: cluster 2024-09-20T23:48:36.322309+0000 mgr.a (mgr.14388) 4070 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:48:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:40 smithi049 bash[23528]: cluster 2024-09-20T23:48:38.323089+0000 mgr.a (mgr.14388) 4071 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:40 smithi044 bash[22676]: cluster 2024-09-20T23:48:38.323089+0000 mgr.a (mgr.14388) 4071 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:40 smithi179 bash[23186]: cluster 2024-09-20T23:48:38.323089+0000 mgr.a (mgr.14388) 4071 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:48:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:40.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:41.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:42 smithi044 bash[22676]: cluster 2024-09-20T23:48:40.325076+0000 mgr.a (mgr.14388) 4072 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:42 smithi179 bash[23186]: cluster 2024-09-20T23:48:40.325076+0000 mgr.a (mgr.14388) 4072 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:42 smithi049 bash[23528]: cluster 2024-09-20T23:48:40.325076+0000 mgr.a (mgr.14388) 4072 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:43.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:43 smithi044 bash[22676]: audit 2024-09-20T23:48:41.195418+0000 mgr.a (mgr.14388) 4073 : audit [DBG] from='client.98415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:43 smithi179 bash[23186]: audit 2024-09-20T23:48:41.195418+0000 mgr.a (mgr.14388) 4073 : audit [DBG] from='client.98415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:43 smithi049 bash[23528]: audit 2024-09-20T23:48:41.195418+0000 mgr.a (mgr.14388) 4073 : audit [DBG] from='client.98415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:44.326 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:44 smithi044 bash[22676]: cluster 2024-09-20T23:48:42.326076+0000 mgr.a (mgr.14388) 4074 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:48:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:44 smithi179 bash[23186]: cluster 2024-09-20T23:48:42.326076+0000 mgr.a (mgr.14388) 4074 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:48:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:44 smithi049 bash[23528]: cluster 2024-09-20T23:48:42.326076+0000 mgr.a (mgr.14388) 4074 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:48:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:46 smithi044 bash[22676]: cluster 2024-09-20T23:48:44.326747+0000 mgr.a (mgr.14388) 4075 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:48:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:46 smithi179 bash[23186]: cluster 2024-09-20T23:48:44.326747+0000 mgr.a (mgr.14388) 4075 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:48:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:46 smithi049 bash[23528]: cluster 2024-09-20T23:48:44.326747+0000 mgr.a (mgr.14388) 4075 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-20T23:48:46.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:46.625 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:46.625 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:47.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:47.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:47.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:47.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:47.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:48 smithi044 bash[22676]: cluster 2024-09-20T23:48:46.329215+0000 mgr.a (mgr.14388) 4076 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:48:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:48 smithi044 bash[22676]: audit 2024-09-20T23:48:46.949135+0000 mgr.a (mgr.14388) 4077 : audit [DBG] from='client.98493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:48 smithi179 bash[23186]: cluster 2024-09-20T23:48:46.329215+0000 mgr.a (mgr.14388) 4076 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:48:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:48 smithi179 bash[23186]: audit 2024-09-20T23:48:46.949135+0000 mgr.a (mgr.14388) 4077 : audit [DBG] from='client.98493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:48 smithi049 bash[23528]: cluster 2024-09-20T23:48:46.329215+0000 mgr.a (mgr.14388) 4076 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-20T23:48:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:48 smithi049 bash[23528]: audit 2024-09-20T23:48:46.949135+0000 mgr.a (mgr.14388) 4077 : audit [DBG] from='client.98493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:50.339 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:50 smithi179 bash[23186]: cluster 2024-09-20T23:48:48.330368+0000 mgr.a (mgr.14388) 4078 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:50 smithi044 bash[22676]: cluster 2024-09-20T23:48:48.330368+0000 mgr.a (mgr.14388) 4078 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:50 smithi049 bash[23528]: cluster 2024-09-20T23:48:48.330368+0000 mgr.a (mgr.14388) 4078 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:52 smithi049 bash[23528]: cluster 2024-09-20T23:48:50.332755+0000 mgr.a (mgr.14388) 4079 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:52 smithi049 bash[23528]: audit 2024-09-20T23:48:52.045168+0000 mon.a (mon.0) 3876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:52 smithi049 bash[23528]: audit 2024-09-20T23:48:52.055567+0000 mon.a (mon.0) 3877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:52 smithi049 bash[23528]: audit 2024-09-20T23:48:52.065837+0000 mon.a (mon.0) 3878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:52 smithi044 bash[22676]: cluster 2024-09-20T23:48:50.332755+0000 mgr.a (mgr.14388) 4079 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:52 smithi044 bash[22676]: audit 2024-09-20T23:48:52.045168+0000 mon.a (mon.0) 3876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:52 smithi044 bash[22676]: audit 2024-09-20T23:48:52.055567+0000 mon.a (mon.0) 3877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:52 smithi044 bash[22676]: audit 2024-09-20T23:48:52.065837+0000 mon.a (mon.0) 3878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:52 smithi179 bash[23186]: cluster 2024-09-20T23:48:50.332755+0000 mgr.a (mgr.14388) 4079 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:52 smithi179 bash[23186]: audit 2024-09-20T23:48:52.045168+0000 mon.a (mon.0) 3876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:52 smithi179 bash[23186]: audit 2024-09-20T23:48:52.055567+0000 mon.a (mon.0) 3877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:52 smithi179 bash[23186]: audit 2024-09-20T23:48:52.065837+0000 mon.a (mon.0) 3878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:53.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:53.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:53.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:53.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:53.123 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:54.353 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:54 smithi049 bash[23528]: cluster 2024-09-20T23:48:52.333585+0000 mgr.a (mgr.14388) 4080 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:54.354 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:54 smithi049 bash[23528]: audit 2024-09-20T23:48:52.705510+0000 mgr.a (mgr.14388) 4081 : audit [DBG] from='client.98571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:54 smithi044 bash[22676]: cluster 2024-09-20T23:48:52.333585+0000 mgr.a (mgr.14388) 4080 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:54 smithi044 bash[22676]: audit 2024-09-20T23:48:52.705510+0000 mgr.a (mgr.14388) 4081 : audit [DBG] from='client.98571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:54 smithi179 bash[23186]: cluster 2024-09-20T23:48:52.333585+0000 mgr.a (mgr.14388) 4080 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:54 smithi179 bash[23186]: audit 2024-09-20T23:48:52.705510+0000 mgr.a (mgr.14388) 4081 : audit [DBG] from='client.98571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:55 smithi044 bash[22676]: audit 2024-09-20T23:48:54.240759+0000 mon.a (mon.0) 3879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:55 smithi044 bash[22676]: audit 2024-09-20T23:48:54.249297+0000 mon.a (mon.0) 3880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:55 smithi044 bash[22676]: audit 2024-09-20T23:48:54.260063+0000 mon.a (mon.0) 3881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:55 smithi044 bash[22676]: cluster 2024-09-20T23:48:54.334607+0000 mgr.a (mgr.14388) 4082 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:55 smithi044 bash[22676]: audit 2024-09-20T23:48:55.148037+0000 mon.a (mon.0) 3882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:55 smithi044 bash[22676]: audit 2024-09-20T23:48:55.156251+0000 mon.a (mon.0) 3883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:55 smithi044 bash[22676]: audit 2024-09-20T23:48:55.166301+0000 mon.a (mon.0) 3884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:55 smithi179 bash[23186]: audit 2024-09-20T23:48:54.240759+0000 mon.a (mon.0) 3879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:55 smithi179 bash[23186]: audit 2024-09-20T23:48:54.249297+0000 mon.a (mon.0) 3880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:55 smithi179 bash[23186]: audit 2024-09-20T23:48:54.260063+0000 mon.a (mon.0) 3881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:55 smithi179 bash[23186]: cluster 2024-09-20T23:48:54.334607+0000 mgr.a (mgr.14388) 4082 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:55 smithi179 bash[23186]: audit 2024-09-20T23:48:55.148037+0000 mon.a (mon.0) 3882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:55 smithi179 bash[23186]: audit 2024-09-20T23:48:55.156251+0000 mon.a (mon.0) 3883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:55 smithi179 bash[23186]: audit 2024-09-20T23:48:55.166301+0000 mon.a (mon.0) 3884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:55 smithi049 bash[23528]: audit 2024-09-20T23:48:54.240759+0000 mon.a (mon.0) 3879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:55 smithi049 bash[23528]: audit 2024-09-20T23:48:54.249297+0000 mon.a (mon.0) 3880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:55 smithi049 bash[23528]: audit 2024-09-20T23:48:54.260063+0000 mon.a (mon.0) 3881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:55 smithi049 bash[23528]: cluster 2024-09-20T23:48:54.334607+0000 mgr.a (mgr.14388) 4082 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:55 smithi049 bash[23528]: audit 2024-09-20T23:48:55.148037+0000 mon.a (mon.0) 3882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:55 smithi049 bash[23528]: audit 2024-09-20T23:48:55.156251+0000 mon.a (mon.0) 3883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:55 smithi049 bash[23528]: audit 2024-09-20T23:48:55.166301+0000 mon.a (mon.0) 3884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:48:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:57 smithi044 bash[22676]: cluster 2024-09-20T23:48:56.337002+0000 mgr.a (mgr.14388) 4083 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:57 smithi179 bash[23186]: cluster 2024-09-20T23:48:56.337002+0000 mgr.a (mgr.14388) 4083 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:57 smithi049 bash[23528]: cluster 2024-09-20T23:48:56.337002+0000 mgr.a (mgr.14388) 4083 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:48:58.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:48:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:48:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:48:58.881 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:48:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:48:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:48:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:48:58.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:48:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:59 smithi044 bash[22676]: cluster 2024-09-20T23:48:58.337953+0000 mgr.a (mgr.14388) 4084 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:48:59 smithi044 bash[22676]: audit 2024-09-20T23:48:58.452030+0000 mgr.a (mgr.14388) 4085 : audit [DBG] from='client.98646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:59 smithi179 bash[23186]: cluster 2024-09-20T23:48:58.337953+0000 mgr.a (mgr.14388) 4084 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:48:59 smithi179 bash[23186]: audit 2024-09-20T23:48:58.452030+0000 mgr.a (mgr.14388) 4085 : audit [DBG] from='client.98646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:48:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:59 smithi049 bash[23528]: cluster 2024-09-20T23:48:58.337953+0000 mgr.a (mgr.14388) 4084 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:48:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:48:59 smithi049 bash[23528]: audit 2024-09-20T23:48:58.452030+0000 mgr.a (mgr.14388) 4085 : audit [DBG] from='client.98646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:01 smithi044 bash[22676]: cluster 2024-09-20T23:49:00.340234+0000 mgr.a (mgr.14388) 4086 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:01 smithi179 bash[23186]: cluster 2024-09-20T23:49:00.340234+0000 mgr.a (mgr.14388) 4086 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:01 smithi049 bash[23528]: cluster 2024-09-20T23:49:00.340234+0000 mgr.a (mgr.14388) 4086 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:03 smithi044 bash[22676]: cluster 2024-09-20T23:49:02.341008+0000 mgr.a (mgr.14388) 4087 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:03 smithi179 bash[23186]: cluster 2024-09-20T23:49:02.341008+0000 mgr.a (mgr.14388) 4087 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:03 smithi049 bash[23528]: cluster 2024-09-20T23:49:02.341008+0000 mgr.a (mgr.14388) 4087 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:03.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:03.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:03.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:04.634 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:05 smithi044 bash[22676]: audit 2024-09-20T23:49:04.215601+0000 mgr.a (mgr.14388) 4088 : audit [DBG] from='client.98724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:05 smithi044 bash[22676]: cluster 2024-09-20T23:49:04.350276+0000 mgr.a (mgr.14388) 4089 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:05 smithi179 bash[23186]: audit 2024-09-20T23:49:04.215601+0000 mgr.a (mgr.14388) 4088 : audit [DBG] from='client.98724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:05 smithi179 bash[23186]: cluster 2024-09-20T23:49:04.350276+0000 mgr.a (mgr.14388) 4089 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:05 smithi049 bash[23528]: audit 2024-09-20T23:49:04.215601+0000 mgr.a (mgr.14388) 4088 : audit [DBG] from='client.98724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:05 smithi049 bash[23528]: cluster 2024-09-20T23:49:04.350276+0000 mgr.a (mgr.14388) 4089 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:07.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:07 smithi044 bash[22676]: cluster 2024-09-20T23:49:06.352569+0000 mgr.a (mgr.14388) 4090 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:07 smithi179 bash[23186]: cluster 2024-09-20T23:49:06.352569+0000 mgr.a (mgr.14388) 4090 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:07 smithi049 bash[23528]: cluster 2024-09-20T23:49:06.352569+0000 mgr.a (mgr.14388) 4090 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:09.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:09.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:09.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:09 smithi044 bash[22676]: cluster 2024-09-20T23:49:08.353397+0000 mgr.a (mgr.14388) 4091 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:09 smithi179 bash[23186]: cluster 2024-09-20T23:49:08.353397+0000 mgr.a (mgr.14388) 4091 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:09.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:09 smithi049 bash[23528]: cluster 2024-09-20T23:49:08.353397+0000 mgr.a (mgr.14388) 4091 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:10.404 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:10.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:10.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:10.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:10.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:10.576 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:10 smithi179 bash[23186]: audit 2024-09-20T23:49:09.961172+0000 mgr.a (mgr.14388) 4092 : audit [DBG] from='client.98802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:10 smithi044 bash[22676]: audit 2024-09-20T23:49:09.961172+0000 mgr.a (mgr.14388) 4092 : audit [DBG] from='client.98802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:10 smithi049 bash[23528]: audit 2024-09-20T23:49:09.961172+0000 mgr.a (mgr.14388) 4092 : audit [DBG] from='client.98802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:11 smithi044 bash[22676]: cluster 2024-09-20T23:49:10.354826+0000 mgr.a (mgr.14388) 4093 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:11 smithi179 bash[23186]: cluster 2024-09-20T23:49:10.354826+0000 mgr.a (mgr.14388) 4093 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:11.787 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:11 smithi049 bash[23528]: cluster 2024-09-20T23:49:10.354826+0000 mgr.a (mgr.14388) 4093 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:13 smithi049 bash[23528]: audit 2024-09-20T23:49:12.282161+0000 mon.a (mon.0) 3885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:13 smithi049 bash[23528]: audit 2024-09-20T23:49:12.290699+0000 mon.a (mon.0) 3886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:13 smithi049 bash[23528]: audit 2024-09-20T23:49:12.301313+0000 mon.a (mon.0) 3887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:13 smithi049 bash[23528]: cluster 2024-09-20T23:49:12.355577+0000 mgr.a (mgr.14388) 4094 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:13 smithi044 bash[22676]: audit 2024-09-20T23:49:12.282161+0000 mon.a (mon.0) 3885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:13 smithi044 bash[22676]: audit 2024-09-20T23:49:12.290699+0000 mon.a (mon.0) 3886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:13 smithi044 bash[22676]: audit 2024-09-20T23:49:12.301313+0000 mon.a (mon.0) 3887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:13 smithi044 bash[22676]: cluster 2024-09-20T23:49:12.355577+0000 mgr.a (mgr.14388) 4094 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:13 smithi179 bash[23186]: audit 2024-09-20T23:49:12.282161+0000 mon.a (mon.0) 3885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:13 smithi179 bash[23186]: audit 2024-09-20T23:49:12.290699+0000 mon.a (mon.0) 3886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:13 smithi179 bash[23186]: audit 2024-09-20T23:49:12.301313+0000 mon.a (mon.0) 3887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:13 smithi179 bash[23186]: cluster 2024-09-20T23:49:12.355577+0000 mgr.a (mgr.14388) 4094 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:15.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:15.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:15.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:15 smithi044 bash[22676]: cluster 2024-09-20T23:49:14.356368+0000 mgr.a (mgr.14388) 4095 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:15 smithi044 bash[22676]: audit 2024-09-20T23:49:14.428692+0000 mon.a (mon.0) 3888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:15 smithi044 bash[22676]: audit 2024-09-20T23:49:14.437481+0000 mon.a (mon.0) 3889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:15 smithi044 bash[22676]: audit 2024-09-20T23:49:14.447904+0000 mon.a (mon.0) 3890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:15 smithi044 bash[22676]: audit 2024-09-20T23:49:15.377810+0000 mon.a (mon.0) 3891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:15 smithi044 bash[22676]: audit 2024-09-20T23:49:15.386418+0000 mon.a (mon.0) 3892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:15 smithi044 bash[22676]: audit 2024-09-20T23:49:15.397037+0000 mon.a (mon.0) 3893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:15 smithi179 bash[23186]: cluster 2024-09-20T23:49:14.356368+0000 mgr.a (mgr.14388) 4095 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:15 smithi179 bash[23186]: audit 2024-09-20T23:49:14.428692+0000 mon.a (mon.0) 3888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:15 smithi179 bash[23186]: audit 2024-09-20T23:49:14.437481+0000 mon.a (mon.0) 3889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:15 smithi179 bash[23186]: audit 2024-09-20T23:49:14.447904+0000 mon.a (mon.0) 3890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:15 smithi179 bash[23186]: audit 2024-09-20T23:49:15.377810+0000 mon.a (mon.0) 3891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:15 smithi179 bash[23186]: audit 2024-09-20T23:49:15.386418+0000 mon.a (mon.0) 3892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:15 smithi179 bash[23186]: audit 2024-09-20T23:49:15.397037+0000 mon.a (mon.0) 3893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:15 smithi049 bash[23528]: cluster 2024-09-20T23:49:14.356368+0000 mgr.a (mgr.14388) 4095 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:15 smithi049 bash[23528]: audit 2024-09-20T23:49:14.428692+0000 mon.a (mon.0) 3888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:15 smithi049 bash[23528]: audit 2024-09-20T23:49:14.437481+0000 mon.a (mon.0) 3889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:15 smithi049 bash[23528]: audit 2024-09-20T23:49:14.447904+0000 mon.a (mon.0) 3890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:15 smithi049 bash[23528]: audit 2024-09-20T23:49:15.377810+0000 mon.a (mon.0) 3891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:15 smithi049 bash[23528]: audit 2024-09-20T23:49:15.386418+0000 mon.a (mon.0) 3892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:15 smithi049 bash[23528]: audit 2024-09-20T23:49:15.397037+0000 mon.a (mon.0) 3893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:16.187 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:16.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:16 smithi044 bash[22676]: audit 2024-09-20T23:49:15.742011+0000 mgr.a (mgr.14388) 4096 : audit [DBG] from='client.98877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:16 smithi179 bash[23186]: audit 2024-09-20T23:49:15.742011+0000 mgr.a (mgr.14388) 4096 : audit [DBG] from='client.98877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:16.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:16 smithi049 bash[23528]: audit 2024-09-20T23:49:15.742011+0000 mgr.a (mgr.14388) 4096 : audit [DBG] from='client.98877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:17 smithi044 bash[22676]: cluster 2024-09-20T23:49:16.359207+0000 mgr.a (mgr.14388) 4097 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:17 smithi179 bash[23186]: cluster 2024-09-20T23:49:16.359207+0000 mgr.a (mgr.14388) 4097 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:17 smithi049 bash[23528]: cluster 2024-09-20T23:49:16.359207+0000 mgr.a (mgr.14388) 4097 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:19 smithi044 bash[22676]: cluster 2024-09-20T23:49:18.359967+0000 mgr.a (mgr.14388) 4098 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:19 smithi179 bash[23186]: cluster 2024-09-20T23:49:18.359967+0000 mgr.a (mgr.14388) 4098 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:19 smithi049 bash[23528]: cluster 2024-09-20T23:49:18.359967+0000 mgr.a (mgr.14388) 4098 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:21 smithi044 bash[22676]: cluster 2024-09-20T23:49:20.361931+0000 mgr.a (mgr.14388) 4099 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:21 smithi179 bash[23186]: cluster 2024-09-20T23:49:20.361931+0000 mgr.a (mgr.14388) 4099 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:21 smithi049 bash[23528]: cluster 2024-09-20T23:49:20.361931+0000 mgr.a (mgr.14388) 4099 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:21.934 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:21.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:21.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:22 smithi044 bash[22676]: audit 2024-09-20T23:49:21.522232+0000 mgr.a (mgr.14388) 4100 : audit [DBG] from='client.98955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:22 smithi179 bash[23186]: audit 2024-09-20T23:49:21.522232+0000 mgr.a (mgr.14388) 4100 : audit [DBG] from='client.98955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:22 smithi049 bash[23528]: audit 2024-09-20T23:49:21.522232+0000 mgr.a (mgr.14388) 4100 : audit [DBG] from='client.98955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:23 smithi044 bash[22676]: cluster 2024-09-20T23:49:22.362951+0000 mgr.a (mgr.14388) 4101 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:23 smithi179 bash[23186]: cluster 2024-09-20T23:49:22.362951+0000 mgr.a (mgr.14388) 4101 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:23 smithi049 bash[23528]: cluster 2024-09-20T23:49:22.362951+0000 mgr.a (mgr.14388) 4101 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22676]: audit 2024-09-20T23:49:23.967368+0000 mon.a (mon.0) 3894 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:49:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22676]: audit 2024-09-20T23:49:23.974720+0000 mon.a (mon.0) 3895 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:49:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22676]: audit 2024-09-20T23:49:23.976937+0000 mon.a (mon.0) 3896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:49:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22676]: audit 2024-09-20T23:49:23.988674+0000 mon.a (mon.0) 3897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22676]: audit 2024-09-20T23:49:23.995192+0000 mon.a (mon.0) 3898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:49:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22676]: audit 2024-09-20T23:49:23.997813+0000 mgr.a (mgr.14388) 4102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:24 smithi179 bash[23186]: audit 2024-09-20T23:49:23.967368+0000 mon.a (mon.0) 3894 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:49:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:24 smithi179 bash[23186]: audit 2024-09-20T23:49:23.974720+0000 mon.a (mon.0) 3895 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:49:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:24 smithi179 bash[23186]: audit 2024-09-20T23:49:23.976937+0000 mon.a (mon.0) 3896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:49:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:24 smithi179 bash[23186]: audit 2024-09-20T23:49:23.988674+0000 mon.a (mon.0) 3897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:24 smithi179 bash[23186]: audit 2024-09-20T23:49:23.995192+0000 mon.a (mon.0) 3898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:49:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:24 smithi179 bash[23186]: audit 2024-09-20T23:49:23.997813+0000 mgr.a (mgr.14388) 4102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:24 smithi049 bash[23528]: audit 2024-09-20T23:49:23.967368+0000 mon.a (mon.0) 3894 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:24 smithi049 bash[23528]: audit 2024-09-20T23:49:23.974720+0000 mon.a (mon.0) 3895 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:24 smithi049 bash[23528]: audit 2024-09-20T23:49:23.976937+0000 mon.a (mon.0) 3896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:24 smithi049 bash[23528]: audit 2024-09-20T23:49:23.988674+0000 mon.a (mon.0) 3897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:24 smithi049 bash[23528]: audit 2024-09-20T23:49:23.995192+0000 mon.a (mon.0) 3898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:24 smithi049 bash[23528]: audit 2024-09-20T23:49:23.997813+0000 mgr.a (mgr.14388) 4102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:49:25.206 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22930]: debug 2024-09-20T23:49:24.796+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:49:25.206 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:49:24 smithi044 bash[22930]: debug 2024-09-20T23:49:24.800+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:49:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:25 smithi179 bash[23186]: cluster 2024-09-20T23:49:24.363686+0000 mgr.a (mgr.14388) 4103 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:25 smithi179 bash[23186]: audit 2024-09-20T23:49:24.799296+0000 mgr.a (mgr.14388) 4104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:49:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:25 smithi179 bash[23186]: cephadm 2024-09-20T23:49:24.801667+0000 mgr.a (mgr.14388) 4105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:49:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:25 smithi049 bash[23528]: cluster 2024-09-20T23:49:24.363686+0000 mgr.a (mgr.14388) 4103 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:25 smithi049 bash[23528]: audit 2024-09-20T23:49:24.799296+0000 mgr.a (mgr.14388) 4104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:49:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:25 smithi049 bash[23528]: cephadm 2024-09-20T23:49:24.801667+0000 mgr.a (mgr.14388) 4105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:49:26.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:25 smithi044 bash[22676]: cluster 2024-09-20T23:49:24.363686+0000 mgr.a (mgr.14388) 4103 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:26.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:25 smithi044 bash[22676]: audit 2024-09-20T23:49:24.799296+0000 mgr.a (mgr.14388) 4104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:49:26.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:25 smithi044 bash[22676]: cephadm 2024-09-20T23:49:24.801667+0000 mgr.a (mgr.14388) 4105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:49:26.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:26.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:27 smithi044 bash[22676]: cluster 2024-09-20T23:49:26.366033+0000 mgr.a (mgr.14388) 4106 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:27.740 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:27.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:27.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:27.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:27.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:27 smithi179 bash[23186]: cluster 2024-09-20T23:49:26.366033+0000 mgr.a (mgr.14388) 4106 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:27 smithi049 bash[23528]: cluster 2024-09-20T23:49:26.366033+0000 mgr.a (mgr.14388) 4106 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:28.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:28 smithi044 bash[22676]: audit 2024-09-20T23:49:27.273368+0000 mgr.a (mgr.14388) 4107 : audit [DBG] from='client.99129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:28 smithi179 bash[23186]: audit 2024-09-20T23:49:27.273368+0000 mgr.a (mgr.14388) 4107 : audit [DBG] from='client.99129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:28 smithi049 bash[23528]: audit 2024-09-20T23:49:27.273368+0000 mgr.a (mgr.14388) 4107 : audit [DBG] from='client.99129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:29 smithi044 bash[22676]: cluster 2024-09-20T23:49:28.367028+0000 mgr.a (mgr.14388) 4108 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:29 smithi179 bash[23186]: cluster 2024-09-20T23:49:28.367028+0000 mgr.a (mgr.14388) 4108 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:29 smithi049 bash[23528]: cluster 2024-09-20T23:49:28.367028+0000 mgr.a (mgr.14388) 4108 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:31.582 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:31 smithi179 bash[23186]: cluster 2024-09-20T23:49:30.369297+0000 mgr.a (mgr.14388) 4109 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:31 smithi044 bash[22676]: cluster 2024-09-20T23:49:30.369297+0000 mgr.a (mgr.14388) 4109 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:31 smithi049 bash[23528]: cluster 2024-09-20T23:49:30.369297+0000 mgr.a (mgr.14388) 4109 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:32.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:32.742 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:32.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:33.501 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:33.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:33.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:33.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:33.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:33 smithi044 bash[22676]: cluster 2024-09-20T23:49:32.370034+0000 mgr.a (mgr.14388) 4110 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:33 smithi044 bash[22676]: audit 2024-09-20T23:49:32.478641+0000 mon.a (mon.0) 3899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:33 smithi044 bash[22676]: audit 2024-09-20T23:49:32.487677+0000 mon.a (mon.0) 3900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:33 smithi044 bash[22676]: audit 2024-09-20T23:49:32.498535+0000 mon.a (mon.0) 3901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:33 smithi044 bash[22676]: audit 2024-09-20T23:49:33.077089+0000 mgr.a (mgr.14388) 4111 : audit [DBG] from='client.99204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:33 smithi179 bash[23186]: cluster 2024-09-20T23:49:32.370034+0000 mgr.a (mgr.14388) 4110 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:33 smithi179 bash[23186]: audit 2024-09-20T23:49:32.478641+0000 mon.a (mon.0) 3899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:33 smithi179 bash[23186]: audit 2024-09-20T23:49:32.487677+0000 mon.a (mon.0) 3900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:33 smithi179 bash[23186]: audit 2024-09-20T23:49:32.498535+0000 mon.a (mon.0) 3901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:33 smithi179 bash[23186]: audit 2024-09-20T23:49:33.077089+0000 mgr.a (mgr.14388) 4111 : audit [DBG] from='client.99204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:33 smithi049 bash[23528]: cluster 2024-09-20T23:49:32.370034+0000 mgr.a (mgr.14388) 4110 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:33 smithi049 bash[23528]: audit 2024-09-20T23:49:32.478641+0000 mon.a (mon.0) 3899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:33 smithi049 bash[23528]: audit 2024-09-20T23:49:32.487677+0000 mon.a (mon.0) 3900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:33 smithi049 bash[23528]: audit 2024-09-20T23:49:32.498535+0000 mon.a (mon.0) 3901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:33 smithi049 bash[23528]: audit 2024-09-20T23:49:33.077089+0000 mgr.a (mgr.14388) 4111 : audit [DBG] from='client.99204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:35 smithi044 bash[22676]: cluster 2024-09-20T23:49:34.370967+0000 mgr.a (mgr.14388) 4112 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:35 smithi044 bash[22676]: audit 2024-09-20T23:49:34.637334+0000 mon.a (mon.0) 3902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:35 smithi044 bash[22676]: audit 2024-09-20T23:49:34.645979+0000 mon.a (mon.0) 3903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:35 smithi044 bash[22676]: audit 2024-09-20T23:49:34.656404+0000 mon.a (mon.0) 3904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:35 smithi044 bash[22676]: audit 2024-09-20T23:49:35.583849+0000 mon.a (mon.0) 3905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:35 smithi044 bash[22676]: audit 2024-09-20T23:49:35.591020+0000 mon.a (mon.0) 3906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:35 smithi044 bash[22676]: audit 2024-09-20T23:49:35.599405+0000 mon.a (mon.0) 3907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:35 smithi179 bash[23186]: cluster 2024-09-20T23:49:34.370967+0000 mgr.a (mgr.14388) 4112 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:35 smithi179 bash[23186]: audit 2024-09-20T23:49:34.637334+0000 mon.a (mon.0) 3902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:35 smithi179 bash[23186]: audit 2024-09-20T23:49:34.645979+0000 mon.a (mon.0) 3903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:35 smithi179 bash[23186]: audit 2024-09-20T23:49:34.656404+0000 mon.a (mon.0) 3904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:35 smithi179 bash[23186]: audit 2024-09-20T23:49:35.583849+0000 mon.a (mon.0) 3905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:35 smithi179 bash[23186]: audit 2024-09-20T23:49:35.591020+0000 mon.a (mon.0) 3906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:35 smithi179 bash[23186]: audit 2024-09-20T23:49:35.599405+0000 mon.a (mon.0) 3907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:35 smithi049 bash[23528]: cluster 2024-09-20T23:49:34.370967+0000 mgr.a (mgr.14388) 4112 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:35 smithi049 bash[23528]: audit 2024-09-20T23:49:34.637334+0000 mon.a (mon.0) 3902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:35 smithi049 bash[23528]: audit 2024-09-20T23:49:34.645979+0000 mon.a (mon.0) 3903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:35 smithi049 bash[23528]: audit 2024-09-20T23:49:34.656404+0000 mon.a (mon.0) 3904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:35 smithi049 bash[23528]: audit 2024-09-20T23:49:35.583849+0000 mon.a (mon.0) 3905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:35 smithi049 bash[23528]: audit 2024-09-20T23:49:35.591020+0000 mon.a (mon.0) 3906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:35 smithi049 bash[23528]: audit 2024-09-20T23:49:35.599405+0000 mon.a (mon.0) 3907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:37 smithi044 bash[22676]: cluster 2024-09-20T23:49:36.373232+0000 mgr.a (mgr.14388) 4113 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:37 smithi179 bash[23186]: cluster 2024-09-20T23:49:36.373232+0000 mgr.a (mgr.14388) 4113 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:37 smithi049 bash[23528]: cluster 2024-09-20T23:49:36.373232+0000 mgr.a (mgr.14388) 4113 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:49:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:39.257 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:39 smithi044 bash[22676]: cluster 2024-09-20T23:49:38.374013+0000 mgr.a (mgr.14388) 4114 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:39 smithi044 bash[22676]: audit 2024-09-20T23:49:38.833223+0000 mgr.a (mgr.14388) 4115 : audit [DBG] from='client.99279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:39 smithi179 bash[23186]: cluster 2024-09-20T23:49:38.374013+0000 mgr.a (mgr.14388) 4114 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:39 smithi179 bash[23186]: audit 2024-09-20T23:49:38.833223+0000 mgr.a (mgr.14388) 4115 : audit [DBG] from='client.99279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:39 smithi049 bash[23528]: cluster 2024-09-20T23:49:38.374013+0000 mgr.a (mgr.14388) 4114 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:39 smithi049 bash[23528]: audit 2024-09-20T23:49:38.833223+0000 mgr.a (mgr.14388) 4115 : audit [DBG] from='client.99279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:41 smithi044 bash[22676]: cluster 2024-09-20T23:49:40.376234+0000 mgr.a (mgr.14388) 4116 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:41 smithi179 bash[23186]: cluster 2024-09-20T23:49:40.376234+0000 mgr.a (mgr.14388) 4116 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:41 smithi049 bash[23528]: cluster 2024-09-20T23:49:40.376234+0000 mgr.a (mgr.14388) 4116 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:49:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:43 smithi044 bash[22676]: cluster 2024-09-20T23:49:42.377010+0000 mgr.a (mgr.14388) 4117 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:43 smithi179 bash[23186]: cluster 2024-09-20T23:49:42.377010+0000 mgr.a (mgr.14388) 4117 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:43 smithi049 bash[23528]: cluster 2024-09-20T23:49:42.377010+0000 mgr.a (mgr.14388) 4117 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:44.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:45.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:45 smithi044 bash[22676]: cluster 2024-09-20T23:49:44.377489+0000 mgr.a (mgr.14388) 4118 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:45 smithi044 bash[22676]: audit 2024-09-20T23:49:44.588827+0000 mgr.a (mgr.14388) 4119 : audit [DBG] from='client.99354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:45 smithi179 bash[23186]: cluster 2024-09-20T23:49:44.377489+0000 mgr.a (mgr.14388) 4118 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:45 smithi179 bash[23186]: audit 2024-09-20T23:49:44.588827+0000 mgr.a (mgr.14388) 4119 : audit [DBG] from='client.99354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:45 smithi049 bash[23528]: cluster 2024-09-20T23:49:44.377489+0000 mgr.a (mgr.14388) 4118 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:45 smithi049 bash[23528]: audit 2024-09-20T23:49:44.588827+0000 mgr.a (mgr.14388) 4119 : audit [DBG] from='client.99354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:47 smithi044 bash[22676]: cluster 2024-09-20T23:49:46.379867+0000 mgr.a (mgr.14388) 4120 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:49:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:47 smithi179 bash[23186]: cluster 2024-09-20T23:49:46.379867+0000 mgr.a (mgr.14388) 4120 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:49:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:47 smithi049 bash[23528]: cluster 2024-09-20T23:49:46.379867+0000 mgr.a (mgr.14388) 4120 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:49:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:49 smithi044 bash[22676]: cluster 2024-09-20T23:49:48.380646+0000 mgr.a (mgr.14388) 4121 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:49:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:49 smithi179 bash[23186]: cluster 2024-09-20T23:49:48.380646+0000 mgr.a (mgr.14388) 4121 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:49:50.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:50.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:50.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:49 smithi049 bash[23528]: cluster 2024-09-20T23:49:48.380646+0000 mgr.a (mgr.14388) 4121 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:49:50.789 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:50.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:51 smithi044 bash[22676]: audit 2024-09-20T23:49:50.352859+0000 mgr.a (mgr.14388) 4122 : audit [DBG] from='client.99429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:51 smithi044 bash[22676]: cluster 2024-09-20T23:49:50.382717+0000 mgr.a (mgr.14388) 4123 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:51 smithi179 bash[23186]: audit 2024-09-20T23:49:50.352859+0000 mgr.a (mgr.14388) 4122 : audit [DBG] from='client.99429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:51 smithi179 bash[23186]: cluster 2024-09-20T23:49:50.382717+0000 mgr.a (mgr.14388) 4123 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:51 smithi049 bash[23528]: audit 2024-09-20T23:49:50.352859+0000 mgr.a (mgr.14388) 4122 : audit [DBG] from='client.99429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:51 smithi049 bash[23528]: cluster 2024-09-20T23:49:50.382717+0000 mgr.a (mgr.14388) 4123 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:53 smithi044 bash[22676]: cluster 2024-09-20T23:49:52.383632+0000 mgr.a (mgr.14388) 4124 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:53 smithi044 bash[22676]: audit 2024-09-20T23:49:52.657984+0000 mon.a (mon.0) 3908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:53 smithi044 bash[22676]: audit 2024-09-20T23:49:52.666696+0000 mon.a (mon.0) 3909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:53 smithi044 bash[22676]: audit 2024-09-20T23:49:52.681301+0000 mon.a (mon.0) 3910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:53 smithi179 bash[23186]: cluster 2024-09-20T23:49:52.383632+0000 mgr.a (mgr.14388) 4124 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:53 smithi179 bash[23186]: audit 2024-09-20T23:49:52.657984+0000 mon.a (mon.0) 3908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:53 smithi179 bash[23186]: audit 2024-09-20T23:49:52.666696+0000 mon.a (mon.0) 3909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:53 smithi179 bash[23186]: audit 2024-09-20T23:49:52.681301+0000 mon.a (mon.0) 3910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:53 smithi049 bash[23528]: cluster 2024-09-20T23:49:52.383632+0000 mgr.a (mgr.14388) 4124 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:49:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:53 smithi049 bash[23528]: audit 2024-09-20T23:49:52.657984+0000 mon.a (mon.0) 3908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:53 smithi049 bash[23528]: audit 2024-09-20T23:49:52.666696+0000 mon.a (mon.0) 3909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:53 smithi049 bash[23528]: audit 2024-09-20T23:49:52.681301+0000 mon.a (mon.0) 3910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:55.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:49:55.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:49:55.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:49:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:55 smithi049 bash[23528]: cluster 2024-09-20T23:49:54.384412+0000 mgr.a (mgr.14388) 4125 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:49:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:55 smithi049 bash[23528]: audit 2024-09-20T23:49:54.786089+0000 mon.a (mon.0) 3911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:55 smithi049 bash[23528]: audit 2024-09-20T23:49:54.794261+0000 mon.a (mon.0) 3912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:55 smithi049 bash[23528]: audit 2024-09-20T23:49:54.804165+0000 mon.a (mon.0) 3913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:55 smithi044 bash[22676]: cluster 2024-09-20T23:49:54.384412+0000 mgr.a (mgr.14388) 4125 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:49:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:55 smithi044 bash[22676]: audit 2024-09-20T23:49:54.786089+0000 mon.a (mon.0) 3911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:55 smithi044 bash[22676]: audit 2024-09-20T23:49:54.794261+0000 mon.a (mon.0) 3912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:55 smithi044 bash[22676]: audit 2024-09-20T23:49:54.804165+0000 mon.a (mon.0) 3913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:55 smithi179 bash[23186]: cluster 2024-09-20T23:49:54.384412+0000 mgr.a (mgr.14388) 4125 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:49:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:55 smithi179 bash[23186]: audit 2024-09-20T23:49:54.786089+0000 mon.a (mon.0) 3911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:55 smithi179 bash[23186]: audit 2024-09-20T23:49:54.794261+0000 mon.a (mon.0) 3912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:55 smithi179 bash[23186]: audit 2024-09-20T23:49:54.804165+0000 mon.a (mon.0) 3913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:56.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:49:56.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:49:56.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:49:56.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:49:56.573 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:49:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:56 smithi049 bash[23528]: audit 2024-09-20T23:49:55.797084+0000 mon.a (mon.0) 3914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:56 smithi049 bash[23528]: audit 2024-09-20T23:49:55.805989+0000 mon.a (mon.0) 3915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:56 smithi049 bash[23528]: audit 2024-09-20T23:49:55.816412+0000 mon.a (mon.0) 3916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:56 smithi044 bash[22676]: audit 2024-09-20T23:49:55.797084+0000 mon.a (mon.0) 3914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:56 smithi044 bash[22676]: audit 2024-09-20T23:49:55.805989+0000 mon.a (mon.0) 3915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:56 smithi044 bash[22676]: audit 2024-09-20T23:49:55.816412+0000 mon.a (mon.0) 3916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:56 smithi179 bash[23186]: audit 2024-09-20T23:49:55.797084+0000 mon.a (mon.0) 3914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:56 smithi179 bash[23186]: audit 2024-09-20T23:49:55.805989+0000 mon.a (mon.0) 3915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:56 smithi179 bash[23186]: audit 2024-09-20T23:49:55.816412+0000 mon.a (mon.0) 3916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:49:58.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:57 smithi179 bash[23186]: audit 2024-09-20T23:49:56.120628+0000 mgr.a (mgr.14388) 4126 : audit [DBG] from='client.99507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:58.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:57 smithi179 bash[23186]: cluster 2024-09-20T23:49:56.385830+0000 mgr.a (mgr.14388) 4127 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:57 smithi044 bash[22676]: audit 2024-09-20T23:49:56.120628+0000 mgr.a (mgr.14388) 4126 : audit [DBG] from='client.99507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:57 smithi044 bash[22676]: cluster 2024-09-20T23:49:56.385830+0000 mgr.a (mgr.14388) 4127 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:49:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:57 smithi049 bash[23528]: audit 2024-09-20T23:49:56.120628+0000 mgr.a (mgr.14388) 4126 : audit [DBG] from='client.99507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:49:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:57 smithi049 bash[23528]: cluster 2024-09-20T23:49:56.385830+0000 mgr.a (mgr.14388) 4127 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:49:59 smithi044 bash[22676]: cluster 2024-09-20T23:49:58.386690+0000 mgr.a (mgr.14388) 4128 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:50:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:49:59 smithi179 bash[23186]: cluster 2024-09-20T23:49:58.386690+0000 mgr.a (mgr.14388) 4128 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:50:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:49:59 smithi049 bash[23528]: cluster 2024-09-20T23:49:58.386690+0000 mgr.a (mgr.14388) 4128 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:50:01.234 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:00 smithi049 bash[23528]: cluster 2024-09-20T23:50:00.000161+0000 mon.a (mon.0) 3917 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:50:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:00 smithi044 bash[22676]: cluster 2024-09-20T23:50:00.000161+0000 mon.a (mon.0) 3917 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:50:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:00 smithi179 bash[23186]: cluster 2024-09-20T23:50:00.000161+0000 mon.a (mon.0) 3917 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-20T23:50:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:01.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:01.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:01 smithi044 bash[22676]: cluster 2024-09-20T23:50:00.388886+0000 mgr.a (mgr.14388) 4129 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:50:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:01 smithi179 bash[23186]: cluster 2024-09-20T23:50:00.388886+0000 mgr.a (mgr.14388) 4129 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:50:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:01 smithi049 bash[23528]: cluster 2024-09-20T23:50:00.388886+0000 mgr.a (mgr.14388) 4129 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:50:02.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:02.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:02.373 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:02 smithi044 bash[22676]: audit 2024-09-20T23:50:01.917846+0000 mgr.a (mgr.14388) 4130 : audit [DBG] from='client.99585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:02 smithi179 bash[23186]: audit 2024-09-20T23:50:01.917846+0000 mgr.a (mgr.14388) 4130 : audit [DBG] from='client.99585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:03.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:02 smithi049 bash[23528]: audit 2024-09-20T23:50:01.917846+0000 mgr.a (mgr.14388) 4130 : audit [DBG] from='client.99585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:03 smithi044 bash[22676]: cluster 2024-09-20T23:50:02.389692+0000 mgr.a (mgr.14388) 4131 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:03 smithi179 bash[23186]: cluster 2024-09-20T23:50:02.389692+0000 mgr.a (mgr.14388) 4131 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:03 smithi049 bash[23528]: cluster 2024-09-20T23:50:02.389692+0000 mgr.a (mgr.14388) 4131 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:05 smithi044 bash[22676]: cluster 2024-09-20T23:50:04.390436+0000 mgr.a (mgr.14388) 4132 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:05 smithi179 bash[23186]: cluster 2024-09-20T23:50:04.390436+0000 mgr.a (mgr.14388) 4132 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:05 smithi049 bash[23528]: cluster 2024-09-20T23:50:04.390436+0000 mgr.a (mgr.14388) 4132 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:07.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:08.075 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:07 smithi044 bash[22676]: cluster 2024-09-20T23:50:06.392705+0000 mgr.a (mgr.14388) 4133 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:08.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:08.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:08.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:08.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:08.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:07 smithi179 bash[23186]: cluster 2024-09-20T23:50:06.392705+0000 mgr.a (mgr.14388) 4133 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:07 smithi049 bash[23528]: cluster 2024-09-20T23:50:06.392705+0000 mgr.a (mgr.14388) 4133 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:08 smithi044 bash[22676]: audit 2024-09-20T23:50:07.705900+0000 mgr.a (mgr.14388) 4134 : audit [DBG] from='client.99660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:08 smithi179 bash[23186]: audit 2024-09-20T23:50:07.705900+0000 mgr.a (mgr.14388) 4134 : audit [DBG] from='client.99660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:08 smithi049 bash[23528]: audit 2024-09-20T23:50:07.705900+0000 mgr.a (mgr.14388) 4134 : audit [DBG] from='client.99660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:10.124 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:09 smithi044 bash[22676]: cluster 2024-09-20T23:50:08.393678+0000 mgr.a (mgr.14388) 4135 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:09 smithi179 bash[23186]: cluster 2024-09-20T23:50:08.393678+0000 mgr.a (mgr.14388) 4135 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:09 smithi049 bash[23528]: cluster 2024-09-20T23:50:08.393678+0000 mgr.a (mgr.14388) 4135 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:11 smithi049 bash[23528]: cluster 2024-09-20T23:50:10.395977+0000 mgr.a (mgr.14388) 4136 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:11 smithi044 bash[22676]: cluster 2024-09-20T23:50:10.395977+0000 mgr.a (mgr.14388) 4136 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:11 smithi179 bash[23186]: cluster 2024-09-20T23:50:10.395977+0000 mgr.a (mgr.14388) 4136 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:13.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:13.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:13.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:13.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:13.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:13 smithi049 bash[23528]: cluster 2024-09-20T23:50:12.396611+0000 mgr.a (mgr.14388) 4137 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:13 smithi049 bash[23528]: audit 2024-09-20T23:50:12.834734+0000 mon.a (mon.0) 3918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:13 smithi049 bash[23528]: audit 2024-09-20T23:50:12.843363+0000 mon.a (mon.0) 3919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:13 smithi049 bash[23528]: audit 2024-09-20T23:50:12.853462+0000 mon.a (mon.0) 3920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:13 smithi044 bash[22676]: cluster 2024-09-20T23:50:12.396611+0000 mgr.a (mgr.14388) 4137 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:13 smithi044 bash[22676]: audit 2024-09-20T23:50:12.834734+0000 mon.a (mon.0) 3918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:13 smithi044 bash[22676]: audit 2024-09-20T23:50:12.843363+0000 mon.a (mon.0) 3919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:13 smithi044 bash[22676]: audit 2024-09-20T23:50:12.853462+0000 mon.a (mon.0) 3920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:13 smithi179 bash[23186]: cluster 2024-09-20T23:50:12.396611+0000 mgr.a (mgr.14388) 4137 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:13 smithi179 bash[23186]: audit 2024-09-20T23:50:12.834734+0000 mon.a (mon.0) 3918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:13 smithi179 bash[23186]: audit 2024-09-20T23:50:12.843363+0000 mon.a (mon.0) 3919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:13 smithi179 bash[23186]: audit 2024-09-20T23:50:12.853462+0000 mon.a (mon.0) 3920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:14 smithi044 bash[22676]: audit 2024-09-20T23:50:13.477565+0000 mgr.a (mgr.14388) 4138 : audit [DBG] from='client.99735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:14 smithi179 bash[23186]: audit 2024-09-20T23:50:13.477565+0000 mgr.a (mgr.14388) 4138 : audit [DBG] from='client.99735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:14 smithi049 bash[23528]: audit 2024-09-20T23:50:13.477565+0000 mgr.a (mgr.14388) 4138 : audit [DBG] from='client.99735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:15 smithi044 bash[22676]: cluster 2024-09-20T23:50:14.397536+0000 mgr.a (mgr.14388) 4139 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:15 smithi044 bash[22676]: audit 2024-09-20T23:50:14.985668+0000 mon.a (mon.0) 3921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:15 smithi044 bash[22676]: audit 2024-09-20T23:50:14.994232+0000 mon.a (mon.0) 3922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:15 smithi044 bash[22676]: audit 2024-09-20T23:50:15.006147+0000 mon.a (mon.0) 3923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:15 smithi179 bash[23186]: cluster 2024-09-20T23:50:14.397536+0000 mgr.a (mgr.14388) 4139 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:15 smithi179 bash[23186]: audit 2024-09-20T23:50:14.985668+0000 mon.a (mon.0) 3921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:15 smithi179 bash[23186]: audit 2024-09-20T23:50:14.994232+0000 mon.a (mon.0) 3922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:15 smithi179 bash[23186]: audit 2024-09-20T23:50:15.006147+0000 mon.a (mon.0) 3923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:15 smithi049 bash[23528]: cluster 2024-09-20T23:50:14.397536+0000 mgr.a (mgr.14388) 4139 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:15 smithi049 bash[23528]: audit 2024-09-20T23:50:14.985668+0000 mon.a (mon.0) 3921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:15 smithi049 bash[23528]: audit 2024-09-20T23:50:14.994232+0000 mon.a (mon.0) 3922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:15 smithi049 bash[23528]: audit 2024-09-20T23:50:15.006147+0000 mon.a (mon.0) 3923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:16 smithi179 bash[23186]: audit 2024-09-20T23:50:15.999144+0000 mon.a (mon.0) 3924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:16 smithi179 bash[23186]: audit 2024-09-20T23:50:16.008183+0000 mon.a (mon.0) 3925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:16 smithi179 bash[23186]: audit 2024-09-20T23:50:16.018267+0000 mon.a (mon.0) 3926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:16 smithi049 bash[23528]: audit 2024-09-20T23:50:15.999144+0000 mon.a (mon.0) 3924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:16 smithi049 bash[23528]: audit 2024-09-20T23:50:16.008183+0000 mon.a (mon.0) 3925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:16 smithi049 bash[23528]: audit 2024-09-20T23:50:16.018267+0000 mon.a (mon.0) 3926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:16 smithi044 bash[22676]: audit 2024-09-20T23:50:15.999144+0000 mon.a (mon.0) 3924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:16 smithi044 bash[22676]: audit 2024-09-20T23:50:16.008183+0000 mon.a (mon.0) 3925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:16 smithi044 bash[22676]: audit 2024-09-20T23:50:16.018267+0000 mon.a (mon.0) 3926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:18 smithi179 bash[23186]: cluster 2024-09-20T23:50:16.399768+0000 mgr.a (mgr.14388) 4140 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:18 smithi049 bash[23528]: cluster 2024-09-20T23:50:16.399768+0000 mgr.a (mgr.14388) 4140 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:18 smithi044 bash[22676]: cluster 2024-09-20T23:50:16.399768+0000 mgr.a (mgr.14388) 4140 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:18.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:18.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:19.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:19.712 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:20 smithi049 bash[23528]: cluster 2024-09-20T23:50:18.400541+0000 mgr.a (mgr.14388) 4141 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:20 smithi044 bash[22676]: cluster 2024-09-20T23:50:18.400541+0000 mgr.a (mgr.14388) 4141 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:20 smithi179 bash[23186]: cluster 2024-09-20T23:50:18.400541+0000 mgr.a (mgr.14388) 4141 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:21 smithi049 bash[23528]: audit 2024-09-20T23:50:19.258446+0000 mgr.a (mgr.14388) 4142 : audit [DBG] from='client.99813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:21 smithi044 bash[22676]: audit 2024-09-20T23:50:19.258446+0000 mgr.a (mgr.14388) 4142 : audit [DBG] from='client.99813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:21 smithi179 bash[23186]: audit 2024-09-20T23:50:19.258446+0000 mgr.a (mgr.14388) 4142 : audit [DBG] from='client.99813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:22 smithi049 bash[23528]: cluster 2024-09-20T23:50:20.403017+0000 mgr.a (mgr.14388) 4143 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:22 smithi044 bash[22676]: cluster 2024-09-20T23:50:20.403017+0000 mgr.a (mgr.14388) 4143 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:22 smithi179 bash[23186]: cluster 2024-09-20T23:50:20.403017+0000 mgr.a (mgr.14388) 4143 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:24 smithi049 bash[23528]: cluster 2024-09-20T23:50:22.403996+0000 mgr.a (mgr.14388) 4144 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:24 smithi044 bash[22676]: cluster 2024-09-20T23:50:22.403996+0000 mgr.a (mgr.14388) 4144 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:24 smithi179 bash[23186]: cluster 2024-09-20T23:50:22.403996+0000 mgr.a (mgr.14388) 4144 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:24.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:24.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:24.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:25 smithi049 bash[23528]: audit 2024-09-20T23:50:24.892411+0000 mon.a (mon.0) 3927 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:50:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:25 smithi049 bash[23528]: audit 2024-09-20T23:50:24.897656+0000 mon.a (mon.0) 3928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:50:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:25 smithi049 bash[23528]: audit 2024-09-20T23:50:24.899290+0000 mon.a (mon.0) 3929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:50:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:25 smithi049 bash[23528]: audit 2024-09-20T23:50:24.909749+0000 mon.a (mon.0) 3930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:25 smithi049 bash[23528]: audit 2024-09-20T23:50:24.915713+0000 mon.a (mon.0) 3931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:50:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:25 smithi044 bash[22676]: audit 2024-09-20T23:50:24.892411+0000 mon.a (mon.0) 3927 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:50:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:25 smithi044 bash[22676]: audit 2024-09-20T23:50:24.897656+0000 mon.a (mon.0) 3928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:50:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:25 smithi044 bash[22676]: audit 2024-09-20T23:50:24.899290+0000 mon.a (mon.0) 3929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:50:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:25 smithi044 bash[22676]: audit 2024-09-20T23:50:24.909749+0000 mon.a (mon.0) 3930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:25 smithi044 bash[22676]: audit 2024-09-20T23:50:24.915713+0000 mon.a (mon.0) 3931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:50:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:25 smithi179 bash[23186]: audit 2024-09-20T23:50:24.892411+0000 mon.a (mon.0) 3927 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:50:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:25 smithi179 bash[23186]: audit 2024-09-20T23:50:24.897656+0000 mon.a (mon.0) 3928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:50:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:25 smithi179 bash[23186]: audit 2024-09-20T23:50:24.899290+0000 mon.a (mon.0) 3929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:50:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:25 smithi179 bash[23186]: audit 2024-09-20T23:50:24.909749+0000 mon.a (mon.0) 3930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:25 smithi179 bash[23186]: audit 2024-09-20T23:50:24.915713+0000 mon.a (mon.0) 3931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:50:25.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:50:25 smithi044 bash[22930]: debug 2024-09-20T23:50:25.647+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:50:25.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:50:25 smithi044 bash[22930]: debug 2024-09-20T23:50:25.663+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:50:26.079 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:26.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:26.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:26.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:26.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:26 smithi049 bash[23528]: cluster 2024-09-20T23:50:24.404944+0000 mgr.a (mgr.14388) 4145 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:26 smithi049 bash[23528]: audit 2024-09-20T23:50:24.918351+0000 mgr.a (mgr.14388) 4146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:50:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:26 smithi049 bash[23528]: audit 2024-09-20T23:50:25.062259+0000 mgr.a (mgr.14388) 4147 : audit [DBG] from='client.99891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:26 smithi044 bash[22676]: cluster 2024-09-20T23:50:24.404944+0000 mgr.a (mgr.14388) 4145 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:26 smithi044 bash[22676]: audit 2024-09-20T23:50:24.918351+0000 mgr.a (mgr.14388) 4146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:50:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:26 smithi044 bash[22676]: audit 2024-09-20T23:50:25.062259+0000 mgr.a (mgr.14388) 4147 : audit [DBG] from='client.99891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:26 smithi179 bash[23186]: cluster 2024-09-20T23:50:24.404944+0000 mgr.a (mgr.14388) 4145 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:26 smithi179 bash[23186]: audit 2024-09-20T23:50:24.918351+0000 mgr.a (mgr.14388) 4146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:50:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:26 smithi179 bash[23186]: audit 2024-09-20T23:50:25.062259+0000 mgr.a (mgr.14388) 4147 : audit [DBG] from='client.99891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:27 smithi049 bash[23528]: audit 2024-09-20T23:50:25.652548+0000 mgr.a (mgr.14388) 4148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:50:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:27 smithi049 bash[23528]: cephadm 2024-09-20T23:50:25.665724+0000 mgr.a (mgr.14388) 4149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:50:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:27 smithi044 bash[22676]: audit 2024-09-20T23:50:25.652548+0000 mgr.a (mgr.14388) 4148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:50:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:27 smithi044 bash[22676]: cephadm 2024-09-20T23:50:25.665724+0000 mgr.a (mgr.14388) 4149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:50:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:27 smithi179 bash[23186]: audit 2024-09-20T23:50:25.652548+0000 mgr.a (mgr.14388) 4148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:50:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:27 smithi179 bash[23186]: cephadm 2024-09-20T23:50:25.665724+0000 mgr.a (mgr.14388) 4149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:50:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:28 smithi044 bash[22676]: cluster 2024-09-20T23:50:26.407709+0000 mgr.a (mgr.14388) 4150 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:28.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:28 smithi049 bash[23528]: cluster 2024-09-20T23:50:26.407709+0000 mgr.a (mgr.14388) 4150 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:28 smithi179 bash[23186]: cluster 2024-09-20T23:50:26.407709+0000 mgr.a (mgr.14388) 4150 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:30 smithi049 bash[23528]: cluster 2024-09-20T23:50:28.408489+0000 mgr.a (mgr.14388) 4151 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:50:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:30 smithi044 bash[22676]: cluster 2024-09-20T23:50:28.408489+0000 mgr.a (mgr.14388) 4151 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:50:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:30 smithi179 bash[23186]: cluster 2024-09-20T23:50:28.408489+0000 mgr.a (mgr.14388) 4151 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:50:31.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:31.081 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:31.081 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:31.854 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:31.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:31.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:32 smithi049 bash[23528]: cluster 2024-09-20T23:50:30.410120+0000 mgr.a (mgr.14388) 4152 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:32.341 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:32 smithi044 bash[22676]: cluster 2024-09-20T23:50:30.410120+0000 mgr.a (mgr.14388) 4152 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:32 smithi179 bash[23186]: cluster 2024-09-20T23:50:30.410120+0000 mgr.a (mgr.14388) 4152 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:33 smithi049 bash[23528]: audit 2024-09-20T23:50:31.415804+0000 mgr.a (mgr.14388) 4153 : audit [DBG] from='client.100074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:33.348 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:33 smithi179 bash[23186]: audit 2024-09-20T23:50:31.415804+0000 mgr.a (mgr.14388) 4153 : audit [DBG] from='client.100074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:33 smithi044 bash[22676]: audit 2024-09-20T23:50:31.415804+0000 mgr.a (mgr.14388) 4153 : audit [DBG] from='client.100074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:34 smithi049 bash[23528]: cluster 2024-09-20T23:50:32.410905+0000 mgr.a (mgr.14388) 4154 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:50:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:34 smithi049 bash[23528]: audit 2024-09-20T23:50:33.070265+0000 mon.a (mon.0) 3932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:34 smithi049 bash[23528]: audit 2024-09-20T23:50:33.079151+0000 mon.a (mon.0) 3933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:34 smithi049 bash[23528]: audit 2024-09-20T23:50:33.090044+0000 mon.a (mon.0) 3934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.363 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:34 smithi179 bash[23186]: cluster 2024-09-20T23:50:32.410905+0000 mgr.a (mgr.14388) 4154 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:50:34.363 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:34 smithi179 bash[23186]: audit 2024-09-20T23:50:33.070265+0000 mon.a (mon.0) 3932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.363 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:34 smithi179 bash[23186]: audit 2024-09-20T23:50:33.079151+0000 mon.a (mon.0) 3933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.363 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:34 smithi179 bash[23186]: audit 2024-09-20T23:50:33.090044+0000 mon.a (mon.0) 3934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:34 smithi044 bash[22676]: cluster 2024-09-20T23:50:32.410905+0000 mgr.a (mgr.14388) 4154 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:50:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:34 smithi044 bash[22676]: audit 2024-09-20T23:50:33.070265+0000 mon.a (mon.0) 3932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:34 smithi044 bash[22676]: audit 2024-09-20T23:50:33.079151+0000 mon.a (mon.0) 3933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:34 smithi044 bash[22676]: audit 2024-09-20T23:50:33.090044+0000 mon.a (mon.0) 3934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:36 smithi179 bash[23186]: cluster 2024-09-20T23:50:34.411670+0000 mgr.a (mgr.14388) 4155 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:50:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:36 smithi179 bash[23186]: audit 2024-09-20T23:50:35.160422+0000 mon.a (mon.0) 3935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:36 smithi179 bash[23186]: audit 2024-09-20T23:50:35.168930+0000 mon.a (mon.0) 3936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:36 smithi179 bash[23186]: audit 2024-09-20T23:50:35.179207+0000 mon.a (mon.0) 3937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:36 smithi044 bash[22676]: cluster 2024-09-20T23:50:34.411670+0000 mgr.a (mgr.14388) 4155 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:50:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:36 smithi044 bash[22676]: audit 2024-09-20T23:50:35.160422+0000 mon.a (mon.0) 3935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:36 smithi044 bash[22676]: audit 2024-09-20T23:50:35.168930+0000 mon.a (mon.0) 3936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:36 smithi044 bash[22676]: audit 2024-09-20T23:50:35.179207+0000 mon.a (mon.0) 3937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:36 smithi049 bash[23528]: cluster 2024-09-20T23:50:34.411670+0000 mgr.a (mgr.14388) 4155 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:50:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:36 smithi049 bash[23528]: audit 2024-09-20T23:50:35.160422+0000 mon.a (mon.0) 3935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:36 smithi049 bash[23528]: audit 2024-09-20T23:50:35.168930+0000 mon.a (mon.0) 3936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:36 smithi049 bash[23528]: audit 2024-09-20T23:50:35.179207+0000 mon.a (mon.0) 3937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:36.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:36.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:37 smithi044 bash[22676]: audit 2024-09-20T23:50:36.209777+0000 mon.a (mon.0) 3938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:37 smithi044 bash[22676]: audit 2024-09-20T23:50:36.217308+0000 mon.a (mon.0) 3939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:37 smithi044 bash[22676]: audit 2024-09-20T23:50:36.226900+0000 mon.a (mon.0) 3940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:37 smithi044 bash[22676]: cluster 2024-09-20T23:50:36.414076+0000 mgr.a (mgr.14388) 4156 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:37 smithi179 bash[23186]: audit 2024-09-20T23:50:36.209777+0000 mon.a (mon.0) 3938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:37 smithi179 bash[23186]: audit 2024-09-20T23:50:36.217308+0000 mon.a (mon.0) 3939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:37 smithi179 bash[23186]: audit 2024-09-20T23:50:36.226900+0000 mon.a (mon.0) 3940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:37 smithi179 bash[23186]: cluster 2024-09-20T23:50:36.414076+0000 mgr.a (mgr.14388) 4156 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:37 smithi049 bash[23528]: audit 2024-09-20T23:50:36.209777+0000 mon.a (mon.0) 3938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:37 smithi049 bash[23528]: audit 2024-09-20T23:50:36.217308+0000 mon.a (mon.0) 3939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:37 smithi049 bash[23528]: audit 2024-09-20T23:50:36.226900+0000 mon.a (mon.0) 3940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:37 smithi049 bash[23528]: cluster 2024-09-20T23:50:36.414076+0000 mgr.a (mgr.14388) 4156 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:37.626 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:37.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:38 smithi044 bash[22676]: audit 2024-09-20T23:50:37.184488+0000 mgr.a (mgr.14388) 4157 : audit [DBG] from='client.100152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:38 smithi179 bash[23186]: audit 2024-09-20T23:50:37.184488+0000 mgr.a (mgr.14388) 4157 : audit [DBG] from='client.100152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:38 smithi049 bash[23528]: audit 2024-09-20T23:50:37.184488+0000 mgr.a (mgr.14388) 4157 : audit [DBG] from='client.100152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:39 smithi179 bash[23186]: cluster 2024-09-20T23:50:38.415020+0000 mgr.a (mgr.14388) 4158 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:39 smithi049 bash[23528]: cluster 2024-09-20T23:50:38.415020+0000 mgr.a (mgr.14388) 4158 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:39 smithi044 bash[22676]: cluster 2024-09-20T23:50:38.415020+0000 mgr.a (mgr.14388) 4158 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:41 smithi044 bash[22676]: cluster 2024-09-20T23:50:40.417214+0000 mgr.a (mgr.14388) 4159 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:41 smithi179 bash[23186]: cluster 2024-09-20T23:50:40.417214+0000 mgr.a (mgr.14388) 4159 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:41 smithi049 bash[23528]: cluster 2024-09-20T23:50:40.417214+0000 mgr.a (mgr.14388) 4159 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:50:42.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:42.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:42.629 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:43.418 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:43.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:43.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:43.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:43.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:43 smithi044 bash[22676]: cluster 2024-09-20T23:50:42.417974+0000 mgr.a (mgr.14388) 4160 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:43 smithi044 bash[22676]: audit 2024-09-20T23:50:42.968771+0000 mgr.a (mgr.14388) 4161 : audit [DBG] from='client.100230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:43 smithi179 bash[23186]: cluster 2024-09-20T23:50:42.417974+0000 mgr.a (mgr.14388) 4160 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:43 smithi179 bash[23186]: audit 2024-09-20T23:50:42.968771+0000 mgr.a (mgr.14388) 4161 : audit [DBG] from='client.100230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:43 smithi049 bash[23528]: cluster 2024-09-20T23:50:42.417974+0000 mgr.a (mgr.14388) 4160 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:43 smithi049 bash[23528]: audit 2024-09-20T23:50:42.968771+0000 mgr.a (mgr.14388) 4161 : audit [DBG] from='client.100230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:45 smithi044 bash[22676]: cluster 2024-09-20T23:50:44.418870+0000 mgr.a (mgr.14388) 4162 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:45 smithi179 bash[23186]: cluster 2024-09-20T23:50:44.418870+0000 mgr.a (mgr.14388) 4162 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:45 smithi049 bash[23528]: cluster 2024-09-20T23:50:44.418870+0000 mgr.a (mgr.14388) 4162 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:47 smithi044 bash[22676]: cluster 2024-09-20T23:50:46.421139+0000 mgr.a (mgr.14388) 4163 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:47 smithi179 bash[23186]: cluster 2024-09-20T23:50:46.421139+0000 mgr.a (mgr.14388) 4163 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:47 smithi049 bash[23528]: cluster 2024-09-20T23:50:46.421139+0000 mgr.a (mgr.14388) 4163 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:48.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:48.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:48.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:49.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:49.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:49.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:49.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:49.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:49 smithi179 bash[23186]: cluster 2024-09-20T23:50:48.421785+0000 mgr.a (mgr.14388) 4164 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:49 smithi179 bash[23186]: audit 2024-09-20T23:50:48.754949+0000 mgr.a (mgr.14388) 4165 : audit [DBG] from='client.100308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:49.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:49 smithi044 bash[22676]: cluster 2024-09-20T23:50:48.421785+0000 mgr.a (mgr.14388) 4164 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:49.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:49 smithi044 bash[22676]: audit 2024-09-20T23:50:48.754949+0000 mgr.a (mgr.14388) 4165 : audit [DBG] from='client.100308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:49 smithi049 bash[23528]: cluster 2024-09-20T23:50:48.421785+0000 mgr.a (mgr.14388) 4164 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:49 smithi049 bash[23528]: audit 2024-09-20T23:50:48.754949+0000 mgr.a (mgr.14388) 4165 : audit [DBG] from='client.100308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:51 smithi044 bash[22676]: cluster 2024-09-20T23:50:50.423172+0000 mgr.a (mgr.14388) 4166 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:51 smithi179 bash[23186]: cluster 2024-09-20T23:50:50.423172+0000 mgr.a (mgr.14388) 4166 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:51 smithi049 bash[23528]: cluster 2024-09-20T23:50:50.423172+0000 mgr.a (mgr.14388) 4166 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:53 smithi179 bash[23186]: cluster 2024-09-20T23:50:52.424033+0000 mgr.a (mgr.14388) 4167 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:53 smithi179 bash[23186]: audit 2024-09-20T23:50:53.262940+0000 mon.a (mon.0) 3941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:53 smithi179 bash[23186]: audit 2024-09-20T23:50:53.273050+0000 mon.a (mon.0) 3942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:53 smithi179 bash[23186]: audit 2024-09-20T23:50:53.284786+0000 mon.a (mon.0) 3943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:53 smithi049 bash[23528]: cluster 2024-09-20T23:50:52.424033+0000 mgr.a (mgr.14388) 4167 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:53 smithi049 bash[23528]: audit 2024-09-20T23:50:53.262940+0000 mon.a (mon.0) 3941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:53 smithi049 bash[23528]: audit 2024-09-20T23:50:53.273050+0000 mon.a (mon.0) 3942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:53 smithi049 bash[23528]: audit 2024-09-20T23:50:53.284786+0000 mon.a (mon.0) 3943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:53 smithi044 bash[22676]: cluster 2024-09-20T23:50:52.424033+0000 mgr.a (mgr.14388) 4167 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:53 smithi044 bash[22676]: audit 2024-09-20T23:50:53.262940+0000 mon.a (mon.0) 3941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:53 smithi044 bash[22676]: audit 2024-09-20T23:50:53.273050+0000 mon.a (mon.0) 3942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:53 smithi044 bash[22676]: audit 2024-09-20T23:50:53.284786+0000 mon.a (mon.0) 3943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:54.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:54.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:54.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:50:54.965 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:50:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:50:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:55 smithi179 bash[23186]: cluster 2024-09-20T23:50:54.424806+0000 mgr.a (mgr.14388) 4168 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:55 smithi179 bash[23186]: audit 2024-09-20T23:50:54.515165+0000 mgr.a (mgr.14388) 4169 : audit [DBG] from='client.100386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:55 smithi179 bash[23186]: audit 2024-09-20T23:50:55.335205+0000 mon.a (mon.0) 3944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:55 smithi179 bash[23186]: audit 2024-09-20T23:50:55.344972+0000 mon.a (mon.0) 3945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:55 smithi179 bash[23186]: audit 2024-09-20T23:50:55.356552+0000 mon.a (mon.0) 3946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:55 smithi049 bash[23528]: cluster 2024-09-20T23:50:54.424806+0000 mgr.a (mgr.14388) 4168 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:55 smithi049 bash[23528]: audit 2024-09-20T23:50:54.515165+0000 mgr.a (mgr.14388) 4169 : audit [DBG] from='client.100386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:55 smithi049 bash[23528]: audit 2024-09-20T23:50:55.335205+0000 mon.a (mon.0) 3944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:55 smithi049 bash[23528]: audit 2024-09-20T23:50:55.344972+0000 mon.a (mon.0) 3945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:55 smithi049 bash[23528]: audit 2024-09-20T23:50:55.356552+0000 mon.a (mon.0) 3946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:55 smithi044 bash[22676]: cluster 2024-09-20T23:50:54.424806+0000 mgr.a (mgr.14388) 4168 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:55 smithi044 bash[22676]: audit 2024-09-20T23:50:54.515165+0000 mgr.a (mgr.14388) 4169 : audit [DBG] from='client.100386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:50:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:55 smithi044 bash[22676]: audit 2024-09-20T23:50:55.335205+0000 mon.a (mon.0) 3944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:55 smithi044 bash[22676]: audit 2024-09-20T23:50:55.344972+0000 mon.a (mon.0) 3945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:55 smithi044 bash[22676]: audit 2024-09-20T23:50:55.356552+0000 mon.a (mon.0) 3946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.679 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:57 smithi179 bash[23186]: audit 2024-09-20T23:50:56.391044+0000 mon.a (mon.0) 3947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.679 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:57 smithi179 bash[23186]: audit 2024-09-20T23:50:56.399940+0000 mon.a (mon.0) 3948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.679 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:57 smithi179 bash[23186]: audit 2024-09-20T23:50:56.408629+0000 mon.a (mon.0) 3949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.679 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:57 smithi179 bash[23186]: cluster 2024-09-20T23:50:56.427115+0000 mgr.a (mgr.14388) 4170 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:57 smithi044 bash[22676]: audit 2024-09-20T23:50:56.391044+0000 mon.a (mon.0) 3947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:57 smithi044 bash[22676]: audit 2024-09-20T23:50:56.399940+0000 mon.a (mon.0) 3948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:57 smithi044 bash[22676]: audit 2024-09-20T23:50:56.408629+0000 mon.a (mon.0) 3949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:57 smithi044 bash[22676]: cluster 2024-09-20T23:50:56.427115+0000 mgr.a (mgr.14388) 4170 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:57 smithi049 bash[23528]: audit 2024-09-20T23:50:56.391044+0000 mon.a (mon.0) 3947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:57 smithi049 bash[23528]: audit 2024-09-20T23:50:56.399940+0000 mon.a (mon.0) 3948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:57 smithi049 bash[23528]: audit 2024-09-20T23:50:56.408629+0000 mon.a (mon.0) 3949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:50:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:57 smithi049 bash[23528]: cluster 2024-09-20T23:50:56.427115+0000 mgr.a (mgr.14388) 4170 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:50:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:50:59 smithi044 bash[22676]: cluster 2024-09-20T23:50:58.427870+0000 mgr.a (mgr.14388) 4171 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:50:59 smithi179 bash[23186]: cluster 2024-09-20T23:50:58.427870+0000 mgr.a (mgr.14388) 4171 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:50:59 smithi049 bash[23528]: cluster 2024-09-20T23:50:58.427870+0000 mgr.a (mgr.14388) 4171 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:50:59.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:50:59.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:50:59.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:00.722 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:00.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:00.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:00.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:00.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:01 smithi179 bash[23186]: audit 2024-09-20T23:51:00.298355+0000 mgr.a (mgr.14388) 4172 : audit [DBG] from='client.100461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:01 smithi179 bash[23186]: cluster 2024-09-20T23:51:00.435235+0000 mgr.a (mgr.14388) 4173 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:01 smithi049 bash[23528]: audit 2024-09-20T23:51:00.298355+0000 mgr.a (mgr.14388) 4172 : audit [DBG] from='client.100461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:01 smithi049 bash[23528]: cluster 2024-09-20T23:51:00.435235+0000 mgr.a (mgr.14388) 4173 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:01 smithi044 bash[22676]: audit 2024-09-20T23:51:00.298355+0000 mgr.a (mgr.14388) 4172 : audit [DBG] from='client.100461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:01 smithi044 bash[22676]: cluster 2024-09-20T23:51:00.435235+0000 mgr.a (mgr.14388) 4173 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:03 smithi179 bash[23186]: cluster 2024-09-20T23:51:02.436142+0000 mgr.a (mgr.14388) 4174 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:03 smithi049 bash[23528]: cluster 2024-09-20T23:51:02.436142+0000 mgr.a (mgr.14388) 4174 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:03 smithi044 bash[22676]: cluster 2024-09-20T23:51:02.436142+0000 mgr.a (mgr.14388) 4174 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:05.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:05.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:05.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:05 smithi179 bash[23186]: cluster 2024-09-20T23:51:04.436927+0000 mgr.a (mgr.14388) 4175 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:05 smithi049 bash[23528]: cluster 2024-09-20T23:51:04.436927+0000 mgr.a (mgr.14388) 4175 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:05 smithi044 bash[22676]: cluster 2024-09-20T23:51:04.436927+0000 mgr.a (mgr.14388) 4175 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:06.515 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:06 smithi049 bash[23528]: audit 2024-09-20T23:51:06.062551+0000 mgr.a (mgr.14388) 4176 : audit [DBG] from='client.100536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:06 smithi044 bash[22676]: audit 2024-09-20T23:51:06.062551+0000 mgr.a (mgr.14388) 4176 : audit [DBG] from='client.100536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:06 smithi179 bash[23186]: audit 2024-09-20T23:51:06.062551+0000 mgr.a (mgr.14388) 4176 : audit [DBG] from='client.100536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:07 smithi049 bash[23528]: cluster 2024-09-20T23:51:06.438326+0000 mgr.a (mgr.14388) 4177 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:07 smithi044 bash[22676]: cluster 2024-09-20T23:51:06.438326+0000 mgr.a (mgr.14388) 4177 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:07 smithi179 bash[23186]: cluster 2024-09-20T23:51:06.438326+0000 mgr.a (mgr.14388) 4177 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:09 smithi049 bash[23528]: cluster 2024-09-20T23:51:08.439060+0000 mgr.a (mgr.14388) 4178 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:09 smithi044 bash[22676]: cluster 2024-09-20T23:51:08.439060+0000 mgr.a (mgr.14388) 4178 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:09 smithi179 bash[23186]: cluster 2024-09-20T23:51:08.439060+0000 mgr.a (mgr.14388) 4178 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:11.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:11 smithi044 bash[22676]: cluster 2024-09-20T23:51:10.441054+0000 mgr.a (mgr.14388) 4179 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:11 smithi049 bash[23528]: cluster 2024-09-20T23:51:10.441054+0000 mgr.a (mgr.14388) 4179 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:11 smithi179 bash[23186]: cluster 2024-09-20T23:51:10.441054+0000 mgr.a (mgr.14388) 4179 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:12.287 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:12 smithi049 bash[23528]: audit 2024-09-20T23:51:11.851043+0000 mgr.a (mgr.14388) 4180 : audit [DBG] from='client.100608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:12.880 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:12 smithi044 bash[22676]: audit 2024-09-20T23:51:11.851043+0000 mgr.a (mgr.14388) 4180 : audit [DBG] from='client.100608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:12 smithi179 bash[23186]: audit 2024-09-20T23:51:11.851043+0000 mgr.a (mgr.14388) 4180 : audit [DBG] from='client.100608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:13.696 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:13 smithi049 bash[23528]: cluster 2024-09-20T23:51:12.441981+0000 mgr.a (mgr.14388) 4181 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:13.696 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:13 smithi049 bash[23528]: audit 2024-09-20T23:51:13.470273+0000 mon.a (mon.0) 3950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:13.696 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:13 smithi049 bash[23528]: audit 2024-09-20T23:51:13.476518+0000 mon.a (mon.0) 3951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:13.697 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:13 smithi049 bash[23528]: audit 2024-09-20T23:51:13.485191+0000 mon.a (mon.0) 3952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:13.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:13 smithi044 bash[22676]: cluster 2024-09-20T23:51:12.441981+0000 mgr.a (mgr.14388) 4181 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:13.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:13 smithi044 bash[22676]: audit 2024-09-20T23:51:13.470273+0000 mon.a (mon.0) 3950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:13.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:13 smithi044 bash[22676]: audit 2024-09-20T23:51:13.476518+0000 mon.a (mon.0) 3951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:13.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:13 smithi044 bash[22676]: audit 2024-09-20T23:51:13.485191+0000 mon.a (mon.0) 3952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:13 smithi179 bash[23186]: cluster 2024-09-20T23:51:12.441981+0000 mgr.a (mgr.14388) 4181 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:13 smithi179 bash[23186]: audit 2024-09-20T23:51:13.470273+0000 mon.a (mon.0) 3950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:13 smithi179 bash[23186]: audit 2024-09-20T23:51:13.476518+0000 mon.a (mon.0) 3951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:13 smithi179 bash[23186]: audit 2024-09-20T23:51:13.485191+0000 mon.a (mon.0) 3952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:15 smithi049 bash[23528]: cluster 2024-09-20T23:51:14.442761+0000 mgr.a (mgr.14388) 4182 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:15 smithi044 bash[22676]: cluster 2024-09-20T23:51:14.442761+0000 mgr.a (mgr.14388) 4182 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:15 smithi179 bash[23186]: cluster 2024-09-20T23:51:14.442761+0000 mgr.a (mgr.14388) 4182 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:16.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:16 smithi049 bash[23528]: audit 2024-09-20T23:51:15.549305+0000 mon.a (mon.0) 3953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:16 smithi049 bash[23528]: audit 2024-09-20T23:51:15.558029+0000 mon.a (mon.0) 3954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:16 smithi049 bash[23528]: audit 2024-09-20T23:51:15.568381+0000 mon.a (mon.0) 3955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:16 smithi044 bash[22676]: audit 2024-09-20T23:51:15.549305+0000 mon.a (mon.0) 3953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:16 smithi044 bash[22676]: audit 2024-09-20T23:51:15.558029+0000 mon.a (mon.0) 3954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:16 smithi044 bash[22676]: audit 2024-09-20T23:51:15.568381+0000 mon.a (mon.0) 3955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.335 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:16 smithi179 bash[23186]: audit 2024-09-20T23:51:15.549305+0000 mon.a (mon.0) 3953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.335 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:16 smithi179 bash[23186]: audit 2024-09-20T23:51:15.558029+0000 mon.a (mon.0) 3954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.335 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:16 smithi179 bash[23186]: audit 2024-09-20T23:51:15.568381+0000 mon.a (mon.0) 3955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:17.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:17.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:17 smithi044 bash[22676]: cluster 2024-09-20T23:51:16.445326+0000 mgr.a (mgr.14388) 4183 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:17 smithi044 bash[22676]: audit 2024-09-20T23:51:16.615965+0000 mon.a (mon.0) 3956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:17 smithi044 bash[22676]: audit 2024-09-20T23:51:16.622127+0000 mon.a (mon.0) 3957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:17 smithi044 bash[22676]: audit 2024-09-20T23:51:16.629280+0000 mon.a (mon.0) 3958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.990 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:17 smithi179 bash[23186]: cluster 2024-09-20T23:51:16.445326+0000 mgr.a (mgr.14388) 4183 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:17.990 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:17 smithi179 bash[23186]: audit 2024-09-20T23:51:16.615965+0000 mon.a (mon.0) 3956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.990 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:17 smithi179 bash[23186]: audit 2024-09-20T23:51:16.622127+0000 mon.a (mon.0) 3957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:17.990 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:17 smithi179 bash[23186]: audit 2024-09-20T23:51:16.629280+0000 mon.a (mon.0) 3958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:17 smithi049 bash[23528]: cluster 2024-09-20T23:51:16.445326+0000 mgr.a (mgr.14388) 4183 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:17 smithi049 bash[23528]: audit 2024-09-20T23:51:16.615965+0000 mon.a (mon.0) 3956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:17 smithi049 bash[23528]: audit 2024-09-20T23:51:16.622127+0000 mon.a (mon.0) 3957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:17 smithi049 bash[23528]: audit 2024-09-20T23:51:16.629280+0000 mon.a (mon.0) 3958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:18.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:18.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:18.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:18.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:18.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:18 smithi044 bash[22676]: audit 2024-09-20T23:51:17.634151+0000 mgr.a (mgr.14388) 4184 : audit [DBG] from='client.100686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:18 smithi179 bash[23186]: audit 2024-09-20T23:51:17.634151+0000 mgr.a (mgr.14388) 4184 : audit [DBG] from='client.100686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:18 smithi049 bash[23528]: audit 2024-09-20T23:51:17.634151+0000 mgr.a (mgr.14388) 4184 : audit [DBG] from='client.100686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:19 smithi044 bash[22676]: cluster 2024-09-20T23:51:18.446265+0000 mgr.a (mgr.14388) 4185 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:19 smithi179 bash[23186]: cluster 2024-09-20T23:51:18.446265+0000 mgr.a (mgr.14388) 4185 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:19 smithi049 bash[23528]: cluster 2024-09-20T23:51:18.446265+0000 mgr.a (mgr.14388) 4185 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:21 smithi044 bash[22676]: cluster 2024-09-20T23:51:20.448441+0000 mgr.a (mgr.14388) 4186 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:21 smithi179 bash[23186]: cluster 2024-09-20T23:51:20.448441+0000 mgr.a (mgr.14388) 4186 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:21 smithi049 bash[23528]: cluster 2024-09-20T23:51:20.448441+0000 mgr.a (mgr.14388) 4186 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:23.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:23.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:23.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:23.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:23 smithi044 bash[22676]: cluster 2024-09-20T23:51:22.449231+0000 mgr.a (mgr.14388) 4187 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:23 smithi179 bash[23186]: cluster 2024-09-20T23:51:22.449231+0000 mgr.a (mgr.14388) 4187 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:24.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:23 smithi049 bash[23528]: cluster 2024-09-20T23:51:22.449231+0000 mgr.a (mgr.14388) 4187 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:24 smithi044 bash[22676]: audit 2024-09-20T23:51:23.408154+0000 mgr.a (mgr.14388) 4188 : audit [DBG] from='client.100764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:24 smithi179 bash[23186]: audit 2024-09-20T23:51:23.408154+0000 mgr.a (mgr.14388) 4188 : audit [DBG] from='client.100764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:24 smithi049 bash[23528]: audit 2024-09-20T23:51:23.408154+0000 mgr.a (mgr.14388) 4188 : audit [DBG] from='client.100764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:25 smithi044 bash[22676]: cluster 2024-09-20T23:51:24.450190+0000 mgr.a (mgr.14388) 4189 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:25 smithi179 bash[23186]: cluster 2024-09-20T23:51:24.450190+0000 mgr.a (mgr.14388) 4189 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:25 smithi049 bash[23528]: cluster 2024-09-20T23:51:24.450190+0000 mgr.a (mgr.14388) 4189 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:25.734613+0000 mon.a (mon.0) 3959 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.351762+0000 mon.a (mon.0) 3960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.357677+0000 mon.a (mon.0) 3961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.362644+0000 mon.a (mon.0) 3962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.367676+0000 mon.a (mon.0) 3963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.368594+0000 mon.a (mon.0) 3964 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.369318+0000 mon.a (mon.0) 3965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.374073+0000 mon.a (mon.0) 3966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:26 smithi044 bash[22676]: audit 2024-09-20T23:51:26.376956+0000 mon.a (mon.0) 3967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:51:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:25.734613+0000 mon.a (mon.0) 3959 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.351762+0000 mon.a (mon.0) 3960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.357677+0000 mon.a (mon.0) 3961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.362644+0000 mon.a (mon.0) 3962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.367676+0000 mon.a (mon.0) 3963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.368594+0000 mon.a (mon.0) 3964 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.369318+0000 mon.a (mon.0) 3965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.374073+0000 mon.a (mon.0) 3966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:26 smithi179 bash[23186]: audit 2024-09-20T23:51:26.376956+0000 mon.a (mon.0) 3967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:51:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:25.734613+0000 mon.a (mon.0) 3959 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:51:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.351762+0000 mon.a (mon.0) 3960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.357677+0000 mon.a (mon.0) 3961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.362644+0000 mon.a (mon.0) 3962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.367676+0000 mon.a (mon.0) 3963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.368594+0000 mon.a (mon.0) 3964 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:51:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.369318+0000 mon.a (mon.0) 3965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:51:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.374073+0000 mon.a (mon.0) 3966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:26 smithi049 bash[23528]: audit 2024-09-20T23:51:26.376956+0000 mon.a (mon.0) 3967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:51:27.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:51:27 smithi044 bash[22930]: debug 2024-09-20T23:51:27.102+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:51:27.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:51:27 smithi044 bash[22930]: debug 2024-09-20T23:51:27.102+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:51:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:27 smithi044 bash[22676]: audit 2024-09-20T23:51:26.379247+0000 mgr.a (mgr.14388) 4190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:51:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:27 smithi044 bash[22676]: cluster 2024-09-20T23:51:26.451499+0000 mgr.a (mgr.14388) 4191 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:27 smithi044 bash[22676]: audit 2024-09-20T23:51:27.106098+0000 mgr.a (mgr.14388) 4192 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:51:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:27 smithi044 bash[22676]: cephadm 2024-09-20T23:51:27.107375+0000 mgr.a (mgr.14388) 4193 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:51:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:27 smithi179 bash[23186]: audit 2024-09-20T23:51:26.379247+0000 mgr.a (mgr.14388) 4190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:51:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:27 smithi179 bash[23186]: cluster 2024-09-20T23:51:26.451499+0000 mgr.a (mgr.14388) 4191 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:27 smithi179 bash[23186]: audit 2024-09-20T23:51:27.106098+0000 mgr.a (mgr.14388) 4192 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:51:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:27 smithi179 bash[23186]: cephadm 2024-09-20T23:51:27.107375+0000 mgr.a (mgr.14388) 4193 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:51:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:27 smithi049 bash[23528]: audit 2024-09-20T23:51:26.379247+0000 mgr.a (mgr.14388) 4190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:51:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:27 smithi049 bash[23528]: cluster 2024-09-20T23:51:26.451499+0000 mgr.a (mgr.14388) 4191 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:27 smithi049 bash[23528]: audit 2024-09-20T23:51:27.106098+0000 mgr.a (mgr.14388) 4192 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:51:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:27 smithi049 bash[23528]: cephadm 2024-09-20T23:51:27.107375+0000 mgr.a (mgr.14388) 4193 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:51:28.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:28.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:28.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:29.633 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:29 smithi044 bash[22676]: cluster 2024-09-20T23:51:28.452413+0000 mgr.a (mgr.14388) 4194 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:29 smithi179 bash[23186]: cluster 2024-09-20T23:51:28.452413+0000 mgr.a (mgr.14388) 4194 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:29 smithi049 bash[23528]: cluster 2024-09-20T23:51:28.452413+0000 mgr.a (mgr.14388) 4194 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:30 smithi044 bash[22676]: audit 2024-09-20T23:51:29.192300+0000 mgr.a (mgr.14388) 4195 : audit [DBG] from='client.100941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:30 smithi179 bash[23186]: audit 2024-09-20T23:51:29.192300+0000 mgr.a (mgr.14388) 4195 : audit [DBG] from='client.100941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:30 smithi049 bash[23528]: audit 2024-09-20T23:51:29.192300+0000 mgr.a (mgr.14388) 4195 : audit [DBG] from='client.100941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:31 smithi044 bash[22676]: cluster 2024-09-20T23:51:30.454100+0000 mgr.a (mgr.14388) 4196 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:31 smithi179 bash[23186]: cluster 2024-09-20T23:51:30.454100+0000 mgr.a (mgr.14388) 4196 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:31 smithi049 bash[23528]: cluster 2024-09-20T23:51:30.454100+0000 mgr.a (mgr.14388) 4196 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:33 smithi049 bash[23528]: cluster 2024-09-20T23:51:32.454903+0000 mgr.a (mgr.14388) 4197 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:33 smithi049 bash[23528]: audit 2024-09-20T23:51:33.622791+0000 mon.a (mon.0) 3968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:33 smithi049 bash[23528]: audit 2024-09-20T23:51:33.627616+0000 mon.a (mon.0) 3969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:33 smithi049 bash[23528]: audit 2024-09-20T23:51:33.635425+0000 mon.a (mon.0) 3970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:33.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:33 smithi044 bash[22676]: cluster 2024-09-20T23:51:32.454903+0000 mgr.a (mgr.14388) 4197 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:33.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:33 smithi044 bash[22676]: audit 2024-09-20T23:51:33.622791+0000 mon.a (mon.0) 3968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:33.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:33 smithi044 bash[22676]: audit 2024-09-20T23:51:33.627616+0000 mon.a (mon.0) 3969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:33.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:33 smithi044 bash[22676]: audit 2024-09-20T23:51:33.635425+0000 mon.a (mon.0) 3970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:33 smithi179 bash[23186]: cluster 2024-09-20T23:51:32.454903+0000 mgr.a (mgr.14388) 4197 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:33 smithi179 bash[23186]: audit 2024-09-20T23:51:33.622791+0000 mon.a (mon.0) 3968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:33 smithi179 bash[23186]: audit 2024-09-20T23:51:33.627616+0000 mon.a (mon.0) 3969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:33 smithi179 bash[23186]: audit 2024-09-20T23:51:33.635425+0000 mon.a (mon.0) 3970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:34.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:34.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:35.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:35.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:35.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:35.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:35.408 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:35 smithi044 bash[22676]: cluster 2024-09-20T23:51:34.455717+0000 mgr.a (mgr.14388) 4198 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:35 smithi044 bash[22676]: audit 2024-09-20T23:51:34.979107+0000 mgr.a (mgr.14388) 4199 : audit [DBG] from='client.101016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:35 smithi179 bash[23186]: cluster 2024-09-20T23:51:34.455717+0000 mgr.a (mgr.14388) 4198 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:35 smithi179 bash[23186]: audit 2024-09-20T23:51:34.979107+0000 mgr.a (mgr.14388) 4199 : audit [DBG] from='client.101016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:35 smithi049 bash[23528]: cluster 2024-09-20T23:51:34.455717+0000 mgr.a (mgr.14388) 4198 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:35 smithi049 bash[23528]: audit 2024-09-20T23:51:34.979107+0000 mgr.a (mgr.14388) 4199 : audit [DBG] from='client.101016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:36 smithi049 bash[23528]: audit 2024-09-20T23:51:35.782487+0000 mon.a (mon.0) 3971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:36 smithi049 bash[23528]: audit 2024-09-20T23:51:35.791440+0000 mon.a (mon.0) 3972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:36 smithi049 bash[23528]: audit 2024-09-20T23:51:35.803542+0000 mon.a (mon.0) 3973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:36 smithi179 bash[23186]: audit 2024-09-20T23:51:35.782487+0000 mon.a (mon.0) 3971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:36 smithi179 bash[23186]: audit 2024-09-20T23:51:35.791440+0000 mon.a (mon.0) 3972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:36 smithi179 bash[23186]: audit 2024-09-20T23:51:35.803542+0000 mon.a (mon.0) 3973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:36 smithi044 bash[22676]: audit 2024-09-20T23:51:35.782487+0000 mon.a (mon.0) 3971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:36 smithi044 bash[22676]: audit 2024-09-20T23:51:35.791440+0000 mon.a (mon.0) 3972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:36 smithi044 bash[22676]: audit 2024-09-20T23:51:35.803542+0000 mon.a (mon.0) 3973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.105 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:37 smithi179 bash[23186]: cluster 2024-09-20T23:51:36.458514+0000 mgr.a (mgr.14388) 4200 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:38.105 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:37 smithi179 bash[23186]: audit 2024-09-20T23:51:36.811009+0000 mon.a (mon.0) 3974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.105 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:37 smithi179 bash[23186]: audit 2024-09-20T23:51:36.819179+0000 mon.a (mon.0) 3975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.106 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:37 smithi179 bash[23186]: audit 2024-09-20T23:51:36.826835+0000 mon.a (mon.0) 3976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:37 smithi044 bash[22676]: cluster 2024-09-20T23:51:36.458514+0000 mgr.a (mgr.14388) 4200 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:37 smithi044 bash[22676]: audit 2024-09-20T23:51:36.811009+0000 mon.a (mon.0) 3974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:37 smithi044 bash[22676]: audit 2024-09-20T23:51:36.819179+0000 mon.a (mon.0) 3975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:37 smithi044 bash[22676]: audit 2024-09-20T23:51:36.826835+0000 mon.a (mon.0) 3976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:37 smithi049 bash[23528]: cluster 2024-09-20T23:51:36.458514+0000 mgr.a (mgr.14388) 4200 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:37 smithi049 bash[23528]: audit 2024-09-20T23:51:36.811009+0000 mon.a (mon.0) 3974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:37 smithi049 bash[23528]: audit 2024-09-20T23:51:36.819179+0000 mon.a (mon.0) 3975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:37 smithi049 bash[23528]: audit 2024-09-20T23:51:36.826835+0000 mon.a (mon.0) 3976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:39 smithi179 bash[23186]: cluster 2024-09-20T23:51:38.459341+0000 mgr.a (mgr.14388) 4201 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:51:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:39 smithi044 bash[22676]: cluster 2024-09-20T23:51:38.459341+0000 mgr.a (mgr.14388) 4201 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:51:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:39 smithi049 bash[23528]: cluster 2024-09-20T23:51:38.459341+0000 mgr.a (mgr.14388) 4201 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:51:40.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:41.178 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:41.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:41.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:41.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:41.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:41 smithi044 bash[22676]: cluster 2024-09-20T23:51:40.461372+0000 mgr.a (mgr.14388) 4202 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:41 smithi044 bash[22676]: audit 2024-09-20T23:51:40.746378+0000 mgr.a (mgr.14388) 4203 : audit [DBG] from='client.101091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:41 smithi179 bash[23186]: cluster 2024-09-20T23:51:40.461372+0000 mgr.a (mgr.14388) 4202 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:42.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:41 smithi179 bash[23186]: audit 2024-09-20T23:51:40.746378+0000 mgr.a (mgr.14388) 4203 : audit [DBG] from='client.101091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:41 smithi049 bash[23528]: cluster 2024-09-20T23:51:40.461372+0000 mgr.a (mgr.14388) 4202 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:51:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:41 smithi049 bash[23528]: audit 2024-09-20T23:51:40.746378+0000 mgr.a (mgr.14388) 4203 : audit [DBG] from='client.101091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:43 smithi044 bash[22676]: cluster 2024-09-20T23:51:42.462372+0000 mgr.a (mgr.14388) 4204 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:43 smithi179 bash[23186]: cluster 2024-09-20T23:51:42.462372+0000 mgr.a (mgr.14388) 4204 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:44.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:43 smithi049 bash[23528]: cluster 2024-09-20T23:51:42.462372+0000 mgr.a (mgr.14388) 4204 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:51:46.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:46.180 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:46.180 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:45 smithi044 bash[22676]: cluster 2024-09-20T23:51:44.463173+0000 mgr.a (mgr.14388) 4205 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:51:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:45 smithi179 bash[23186]: cluster 2024-09-20T23:51:44.463173+0000 mgr.a (mgr.14388) 4205 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:51:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:45 smithi049 bash[23528]: cluster 2024-09-20T23:51:44.463173+0000 mgr.a (mgr.14388) 4205 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:51:46.961 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:47 smithi044 bash[22676]: cluster 2024-09-20T23:51:46.465463+0000 mgr.a (mgr.14388) 4206 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:47 smithi044 bash[22676]: audit 2024-09-20T23:51:46.515892+0000 mgr.a (mgr.14388) 4207 : audit [DBG] from='client.101166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:47 smithi179 bash[23186]: cluster 2024-09-20T23:51:46.465463+0000 mgr.a (mgr.14388) 4206 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:47 smithi179 bash[23186]: audit 2024-09-20T23:51:46.515892+0000 mgr.a (mgr.14388) 4207 : audit [DBG] from='client.101166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:47 smithi049 bash[23528]: cluster 2024-09-20T23:51:46.465463+0000 mgr.a (mgr.14388) 4206 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:47 smithi049 bash[23528]: audit 2024-09-20T23:51:46.515892+0000 mgr.a (mgr.14388) 4207 : audit [DBG] from='client.101166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:50.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:49 smithi044 bash[22676]: cluster 2024-09-20T23:51:48.466458+0000 mgr.a (mgr.14388) 4208 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:49 smithi179 bash[23186]: cluster 2024-09-20T23:51:48.466458+0000 mgr.a (mgr.14388) 4208 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:49 smithi049 bash[23528]: cluster 2024-09-20T23:51:48.466458+0000 mgr.a (mgr.14388) 4208 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:51.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:51.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:52.183 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:51 smithi044 bash[22676]: cluster 2024-09-20T23:51:50.468801+0000 mgr.a (mgr.14388) 4209 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:51 smithi179 bash[23186]: cluster 2024-09-20T23:51:50.468801+0000 mgr.a (mgr.14388) 4209 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:51 smithi049 bash[23528]: cluster 2024-09-20T23:51:50.468801+0000 mgr.a (mgr.14388) 4209 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:52.708 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:53 smithi049 bash[23528]: audit 2024-09-20T23:51:52.298938+0000 mgr.a (mgr.14388) 4210 : audit [DBG] from='client.101244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:53 smithi049 bash[23528]: cluster 2024-09-20T23:51:52.469401+0000 mgr.a (mgr.14388) 4211 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:53 smithi049 bash[23528]: audit 2024-09-20T23:51:53.795941+0000 mon.a (mon.0) 3977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:53 smithi049 bash[23528]: audit 2024-09-20T23:51:53.804720+0000 mon.a (mon.0) 3978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:53 smithi049 bash[23528]: audit 2024-09-20T23:51:53.815707+0000 mon.a (mon.0) 3979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:53 smithi044 bash[22676]: audit 2024-09-20T23:51:52.298938+0000 mgr.a (mgr.14388) 4210 : audit [DBG] from='client.101244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:53 smithi044 bash[22676]: cluster 2024-09-20T23:51:52.469401+0000 mgr.a (mgr.14388) 4211 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:53 smithi044 bash[22676]: audit 2024-09-20T23:51:53.795941+0000 mon.a (mon.0) 3977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:53 smithi044 bash[22676]: audit 2024-09-20T23:51:53.804720+0000 mon.a (mon.0) 3978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:53 smithi044 bash[22676]: audit 2024-09-20T23:51:53.815707+0000 mon.a (mon.0) 3979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:53 smithi179 bash[23186]: audit 2024-09-20T23:51:52.298938+0000 mgr.a (mgr.14388) 4210 : audit [DBG] from='client.101244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:53 smithi179 bash[23186]: cluster 2024-09-20T23:51:52.469401+0000 mgr.a (mgr.14388) 4211 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:53 smithi179 bash[23186]: audit 2024-09-20T23:51:53.795941+0000 mon.a (mon.0) 3977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:53 smithi179 bash[23186]: audit 2024-09-20T23:51:53.804720+0000 mon.a (mon.0) 3978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:53 smithi179 bash[23186]: audit 2024-09-20T23:51:53.815707+0000 mon.a (mon.0) 3979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:55 smithi044 bash[22676]: cluster 2024-09-20T23:51:54.470252+0000 mgr.a (mgr.14388) 4212 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:55 smithi179 bash[23186]: cluster 2024-09-20T23:51:54.470252+0000 mgr.a (mgr.14388) 4212 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:56.274 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:55 smithi049 bash[23528]: cluster 2024-09-20T23:51:54.470252+0000 mgr.a (mgr.14388) 4212 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:51:57.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:57 smithi179 bash[23186]: audit 2024-09-20T23:51:56.014722+0000 mon.a (mon.0) 3980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:57 smithi179 bash[23186]: audit 2024-09-20T23:51:56.023076+0000 mon.a (mon.0) 3981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:57 smithi179 bash[23186]: audit 2024-09-20T23:51:56.033620+0000 mon.a (mon.0) 3982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:57 smithi049 bash[23528]: audit 2024-09-20T23:51:56.014722+0000 mon.a (mon.0) 3980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:57 smithi049 bash[23528]: audit 2024-09-20T23:51:56.023076+0000 mon.a (mon.0) 3981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:57 smithi049 bash[23528]: audit 2024-09-20T23:51:56.033620+0000 mon.a (mon.0) 3982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:57 smithi044 bash[22676]: audit 2024-09-20T23:51:56.014722+0000 mon.a (mon.0) 3980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:57 smithi044 bash[22676]: audit 2024-09-20T23:51:56.023076+0000 mon.a (mon.0) 3981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:57 smithi044 bash[22676]: audit 2024-09-20T23:51:56.033620+0000 mon.a (mon.0) 3982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:57.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:51:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:51:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:51:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:58 smithi049 bash[23528]: cluster 2024-09-20T23:51:56.472454+0000 mgr.a (mgr.14388) 4213 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:58 smithi049 bash[23528]: audit 2024-09-20T23:51:57.034042+0000 mon.a (mon.0) 3983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:58 smithi049 bash[23528]: audit 2024-09-20T23:51:57.046226+0000 mon.a (mon.0) 3984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:58 smithi049 bash[23528]: audit 2024-09-20T23:51:57.056027+0000 mon.a (mon.0) 3985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.483 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:51:58.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:51:58.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:51:58.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:51:58.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:51:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:58 smithi044 bash[22676]: cluster 2024-09-20T23:51:56.472454+0000 mgr.a (mgr.14388) 4213 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:58 smithi044 bash[22676]: audit 2024-09-20T23:51:57.034042+0000 mon.a (mon.0) 3983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:58 smithi044 bash[22676]: audit 2024-09-20T23:51:57.046226+0000 mon.a (mon.0) 3984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:58 smithi044 bash[22676]: audit 2024-09-20T23:51:57.056027+0000 mon.a (mon.0) 3985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:58 smithi179 bash[23186]: cluster 2024-09-20T23:51:56.472454+0000 mgr.a (mgr.14388) 4213 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:51:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:58 smithi179 bash[23186]: audit 2024-09-20T23:51:57.034042+0000 mon.a (mon.0) 3983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:58 smithi179 bash[23186]: audit 2024-09-20T23:51:57.046226+0000 mon.a (mon.0) 3984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:58 smithi179 bash[23186]: audit 2024-09-20T23:51:57.056027+0000 mon.a (mon.0) 3985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:51:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:51:59 smithi049 bash[23528]: audit 2024-09-20T23:51:58.043987+0000 mgr.a (mgr.14388) 4214 : audit [DBG] from='client.101322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:51:59 smithi044 bash[22676]: audit 2024-09-20T23:51:58.043987+0000 mgr.a (mgr.14388) 4214 : audit [DBG] from='client.101322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:51:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:51:59 smithi179 bash[23186]: audit 2024-09-20T23:51:58.043987+0000 mgr.a (mgr.14388) 4214 : audit [DBG] from='client.101322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:00 smithi179 bash[23186]: cluster 2024-09-20T23:51:58.472945+0000 mgr.a (mgr.14388) 4215 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:00 smithi049 bash[23528]: cluster 2024-09-20T23:51:58.472945+0000 mgr.a (mgr.14388) 4215 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:00 smithi044 bash[22676]: cluster 2024-09-20T23:51:58.472945+0000 mgr.a (mgr.14388) 4215 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:02 smithi049 bash[23528]: cluster 2024-09-20T23:52:00.475147+0000 mgr.a (mgr.14388) 4216 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:02.399 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:02 smithi179 bash[23186]: cluster 2024-09-20T23:52:00.475147+0000 mgr.a (mgr.14388) 4216 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:02 smithi044 bash[22676]: cluster 2024-09-20T23:52:00.475147+0000 mgr.a (mgr.14388) 4216 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:04.252 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:04.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:04.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:04.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:04.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:04 smithi044 bash[22676]: cluster 2024-09-20T23:52:02.475932+0000 mgr.a (mgr.14388) 4217 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:04 smithi179 bash[23186]: cluster 2024-09-20T23:52:02.475932+0000 mgr.a (mgr.14388) 4217 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:04 smithi049 bash[23528]: cluster 2024-09-20T23:52:02.475932+0000 mgr.a (mgr.14388) 4217 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:05 smithi049 bash[23528]: audit 2024-09-20T23:52:03.816908+0000 mgr.a (mgr.14388) 4218 : audit [DBG] from='client.101397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:05 smithi044 bash[22676]: audit 2024-09-20T23:52:03.816908+0000 mgr.a (mgr.14388) 4218 : audit [DBG] from='client.101397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:05 smithi179 bash[23186]: audit 2024-09-20T23:52:03.816908+0000 mgr.a (mgr.14388) 4218 : audit [DBG] from='client.101397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:06 smithi044 bash[22676]: cluster 2024-09-20T23:52:04.476898+0000 mgr.a (mgr.14388) 4219 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:06 smithi179 bash[23186]: cluster 2024-09-20T23:52:04.476898+0000 mgr.a (mgr.14388) 4219 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:06 smithi049 bash[23528]: cluster 2024-09-20T23:52:04.476898+0000 mgr.a (mgr.14388) 4219 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:08 smithi044 bash[22676]: cluster 2024-09-20T23:52:06.479217+0000 mgr.a (mgr.14388) 4220 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:08 smithi179 bash[23186]: cluster 2024-09-20T23:52:06.479217+0000 mgr.a (mgr.14388) 4220 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:08 smithi049 bash[23528]: cluster 2024-09-20T23:52:06.479217+0000 mgr.a (mgr.14388) 4220 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:09.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:09.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:09.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:10.037 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:10.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:10.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:10.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:10.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:10 smithi044 bash[22676]: cluster 2024-09-20T23:52:08.479974+0000 mgr.a (mgr.14388) 4221 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:10 smithi179 bash[23186]: cluster 2024-09-20T23:52:08.479974+0000 mgr.a (mgr.14388) 4221 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:10 smithi049 bash[23528]: cluster 2024-09-20T23:52:08.479974+0000 mgr.a (mgr.14388) 4221 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:11 smithi044 bash[22676]: audit 2024-09-20T23:52:09.588469+0000 mgr.a (mgr.14388) 4222 : audit [DBG] from='client.101475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:11 smithi179 bash[23186]: audit 2024-09-20T23:52:09.588469+0000 mgr.a (mgr.14388) 4222 : audit [DBG] from='client.101475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:11 smithi049 bash[23528]: audit 2024-09-20T23:52:09.588469+0000 mgr.a (mgr.14388) 4222 : audit [DBG] from='client.101475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:12 smithi044 bash[22676]: cluster 2024-09-20T23:52:10.482384+0000 mgr.a (mgr.14388) 4223 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:52:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:12 smithi179 bash[23186]: cluster 2024-09-20T23:52:10.482384+0000 mgr.a (mgr.14388) 4223 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:52:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:12 smithi049 bash[23528]: cluster 2024-09-20T23:52:10.482384+0000 mgr.a (mgr.14388) 4223 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:52:14.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:14 smithi049 bash[23528]: cluster 2024-09-20T23:52:12.483213+0000 mgr.a (mgr.14388) 4224 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:52:14.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:14 smithi049 bash[23528]: audit 2024-09-20T23:52:13.977425+0000 mon.a (mon.0) 3986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:14 smithi049 bash[23528]: audit 2024-09-20T23:52:13.983912+0000 mon.a (mon.0) 3987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:14 smithi049 bash[23528]: audit 2024-09-20T23:52:13.991694+0000 mon.a (mon.0) 3988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:14 smithi044 bash[22676]: cluster 2024-09-20T23:52:12.483213+0000 mgr.a (mgr.14388) 4224 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:52:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:14 smithi044 bash[22676]: audit 2024-09-20T23:52:13.977425+0000 mon.a (mon.0) 3986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:14 smithi044 bash[22676]: audit 2024-09-20T23:52:13.983912+0000 mon.a (mon.0) 3987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:14 smithi044 bash[22676]: audit 2024-09-20T23:52:13.991694+0000 mon.a (mon.0) 3988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:14 smithi179 bash[23186]: cluster 2024-09-20T23:52:12.483213+0000 mgr.a (mgr.14388) 4224 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:52:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:14 smithi179 bash[23186]: audit 2024-09-20T23:52:13.977425+0000 mon.a (mon.0) 3986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:14 smithi179 bash[23186]: audit 2024-09-20T23:52:13.983912+0000 mon.a (mon.0) 3987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:14 smithi179 bash[23186]: audit 2024-09-20T23:52:13.991694+0000 mon.a (mon.0) 3988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:15.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:15.039 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:15.039 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:15.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:15.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:15.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:15.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:15.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:16 smithi044 bash[22676]: cluster 2024-09-20T23:52:14.483988+0000 mgr.a (mgr.14388) 4225 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:52:16.494 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:16 smithi049 bash[23528]: cluster 2024-09-20T23:52:14.483988+0000 mgr.a (mgr.14388) 4225 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:52:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:16 smithi179 bash[23186]: cluster 2024-09-20T23:52:14.483988+0000 mgr.a (mgr.14388) 4225 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:52:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:17 smithi044 bash[22676]: audit 2024-09-20T23:52:15.372845+0000 mgr.a (mgr.14388) 4226 : audit [DBG] from='client.101553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:17 smithi044 bash[22676]: audit 2024-09-20T23:52:16.250032+0000 mon.a (mon.0) 3989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:17 smithi044 bash[22676]: audit 2024-09-20T23:52:16.258546+0000 mon.a (mon.0) 3990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:17 smithi044 bash[22676]: audit 2024-09-20T23:52:16.268871+0000 mon.a (mon.0) 3991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:17 smithi179 bash[23186]: audit 2024-09-20T23:52:15.372845+0000 mgr.a (mgr.14388) 4226 : audit [DBG] from='client.101553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:17 smithi179 bash[23186]: audit 2024-09-20T23:52:16.250032+0000 mon.a (mon.0) 3989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:17 smithi179 bash[23186]: audit 2024-09-20T23:52:16.258546+0000 mon.a (mon.0) 3990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:17 smithi179 bash[23186]: audit 2024-09-20T23:52:16.268871+0000 mon.a (mon.0) 3991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:17 smithi049 bash[23528]: audit 2024-09-20T23:52:15.372845+0000 mgr.a (mgr.14388) 4226 : audit [DBG] from='client.101553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:17 smithi049 bash[23528]: audit 2024-09-20T23:52:16.250032+0000 mon.a (mon.0) 3989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:17 smithi049 bash[23528]: audit 2024-09-20T23:52:16.258546+0000 mon.a (mon.0) 3990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:17 smithi049 bash[23528]: audit 2024-09-20T23:52:16.268871+0000 mon.a (mon.0) 3991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.357 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:18 smithi179 bash[23186]: cluster 2024-09-20T23:52:16.486802+0000 mgr.a (mgr.14388) 4227 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:18.357 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:18 smithi179 bash[23186]: audit 2024-09-20T23:52:17.271705+0000 mon.a (mon.0) 3992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.357 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:18 smithi179 bash[23186]: audit 2024-09-20T23:52:17.284418+0000 mon.a (mon.0) 3993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.357 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:18 smithi179 bash[23186]: audit 2024-09-20T23:52:17.294776+0000 mon.a (mon.0) 3994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:18 smithi044 bash[22676]: cluster 2024-09-20T23:52:16.486802+0000 mgr.a (mgr.14388) 4227 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:18 smithi044 bash[22676]: audit 2024-09-20T23:52:17.271705+0000 mon.a (mon.0) 3992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:18 smithi044 bash[22676]: audit 2024-09-20T23:52:17.284418+0000 mon.a (mon.0) 3993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:18 smithi044 bash[22676]: audit 2024-09-20T23:52:17.294776+0000 mon.a (mon.0) 3994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:18 smithi049 bash[23528]: cluster 2024-09-20T23:52:16.486802+0000 mgr.a (mgr.14388) 4227 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:18 smithi049 bash[23528]: audit 2024-09-20T23:52:17.271705+0000 mon.a (mon.0) 3992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:18 smithi049 bash[23528]: audit 2024-09-20T23:52:17.284418+0000 mon.a (mon.0) 3993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:18 smithi049 bash[23528]: audit 2024-09-20T23:52:17.294776+0000 mon.a (mon.0) 3994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:20 smithi179 bash[23186]: cluster 2024-09-20T23:52:18.487662+0000 mgr.a (mgr.14388) 4228 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:52:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:20 smithi044 bash[22676]: cluster 2024-09-20T23:52:18.487662+0000 mgr.a (mgr.14388) 4228 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:52:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:20 smithi049 bash[23528]: cluster 2024-09-20T23:52:18.487662+0000 mgr.a (mgr.14388) 4228 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:52:20.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:21.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:21.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:21.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:21.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:21.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:22 smithi044 bash[22676]: cluster 2024-09-20T23:52:20.489642+0000 mgr.a (mgr.14388) 4229 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:22 smithi044 bash[22676]: audit 2024-09-20T23:52:21.141556+0000 mgr.a (mgr.14388) 4230 : audit [DBG] from='client.101631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:22 smithi179 bash[23186]: cluster 2024-09-20T23:52:20.489642+0000 mgr.a (mgr.14388) 4229 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:22 smithi179 bash[23186]: audit 2024-09-20T23:52:21.141556+0000 mgr.a (mgr.14388) 4230 : audit [DBG] from='client.101631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:22 smithi049 bash[23528]: cluster 2024-09-20T23:52:20.489642+0000 mgr.a (mgr.14388) 4229 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:22 smithi049 bash[23528]: audit 2024-09-20T23:52:21.141556+0000 mgr.a (mgr.14388) 4230 : audit [DBG] from='client.101631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:24 smithi044 bash[22676]: cluster 2024-09-20T23:52:22.490636+0000 mgr.a (mgr.14388) 4231 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:52:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:24 smithi179 bash[23186]: cluster 2024-09-20T23:52:22.490636+0000 mgr.a (mgr.14388) 4231 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:52:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:24 smithi049 bash[23528]: cluster 2024-09-20T23:52:22.490636+0000 mgr.a (mgr.14388) 4231 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:52:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:26 smithi044 bash[22676]: cluster 2024-09-20T23:52:24.491481+0000 mgr.a (mgr.14388) 4232 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:52:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:26 smithi179 bash[23186]: cluster 2024-09-20T23:52:24.491481+0000 mgr.a (mgr.14388) 4232 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:52:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:26 smithi049 bash[23528]: cluster 2024-09-20T23:52:24.491481+0000 mgr.a (mgr.14388) 4232 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:52:26.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:26.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:26.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:27.350 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:27.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:27.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:27.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:27.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:27 smithi044 bash[22676]: cluster 2024-09-20T23:52:26.493729+0000 mgr.a (mgr.14388) 4233 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:52:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:27 smithi044 bash[22676]: audit 2024-09-20T23:52:26.917574+0000 mgr.a (mgr.14388) 4234 : audit [DBG] from='client.101709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:27 smithi044 bash[22676]: audit 2024-09-20T23:52:27.170323+0000 mon.a (mon.0) 3995 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:52:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:27 smithi179 bash[23186]: cluster 2024-09-20T23:52:26.493729+0000 mgr.a (mgr.14388) 4233 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:52:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:27 smithi179 bash[23186]: audit 2024-09-20T23:52:26.917574+0000 mgr.a (mgr.14388) 4234 : audit [DBG] from='client.101709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:27 smithi179 bash[23186]: audit 2024-09-20T23:52:27.170323+0000 mon.a (mon.0) 3995 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:52:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:27 smithi049 bash[23528]: cluster 2024-09-20T23:52:26.493729+0000 mgr.a (mgr.14388) 4233 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:52:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:27 smithi049 bash[23528]: audit 2024-09-20T23:52:26.917574+0000 mgr.a (mgr.14388) 4234 : audit [DBG] from='client.101709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:27 smithi049 bash[23528]: audit 2024-09-20T23:52:27.170323+0000 mon.a (mon.0) 3995 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:52:28.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22930]: debug 2024-09-20T23:52:28.493+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:52:28.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22930]: debug 2024-09-20T23:52:28.493+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:52:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22676]: audit 2024-09-20T23:52:27.713501+0000 mon.a (mon.0) 3996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22676]: audit 2024-09-20T23:52:27.722079+0000 mon.a (mon.0) 3997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22676]: audit 2024-09-20T23:52:27.724925+0000 mon.a (mon.0) 3998 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:52:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22676]: audit 2024-09-20T23:52:27.727072+0000 mon.a (mon.0) 3999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:52:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22676]: audit 2024-09-20T23:52:27.738156+0000 mon.a (mon.0) 4000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22676]: audit 2024-09-20T23:52:27.744630+0000 mon.a (mon.0) 4001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:52:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:28 smithi044 bash[22676]: audit 2024-09-20T23:52:27.747532+0000 mgr.a (mgr.14388) 4235 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:52:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:28 smithi179 bash[23186]: audit 2024-09-20T23:52:27.713501+0000 mon.a (mon.0) 3996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:28 smithi179 bash[23186]: audit 2024-09-20T23:52:27.722079+0000 mon.a (mon.0) 3997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:28 smithi179 bash[23186]: audit 2024-09-20T23:52:27.724925+0000 mon.a (mon.0) 3998 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:52:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:28 smithi179 bash[23186]: audit 2024-09-20T23:52:27.727072+0000 mon.a (mon.0) 3999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:52:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:28 smithi179 bash[23186]: audit 2024-09-20T23:52:27.738156+0000 mon.a (mon.0) 4000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:28 smithi179 bash[23186]: audit 2024-09-20T23:52:27.744630+0000 mon.a (mon.0) 4001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:52:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:28 smithi179 bash[23186]: audit 2024-09-20T23:52:27.747532+0000 mgr.a (mgr.14388) 4235 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:52:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:28 smithi049 bash[23528]: audit 2024-09-20T23:52:27.713501+0000 mon.a (mon.0) 3996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:28 smithi049 bash[23528]: audit 2024-09-20T23:52:27.722079+0000 mon.a (mon.0) 3997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:28 smithi049 bash[23528]: audit 2024-09-20T23:52:27.724925+0000 mon.a (mon.0) 3998 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:52:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:28 smithi049 bash[23528]: audit 2024-09-20T23:52:27.727072+0000 mon.a (mon.0) 3999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:52:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:28 smithi049 bash[23528]: audit 2024-09-20T23:52:27.738156+0000 mon.a (mon.0) 4000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:28 smithi049 bash[23528]: audit 2024-09-20T23:52:27.744630+0000 mon.a (mon.0) 4001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:52:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:28 smithi049 bash[23528]: audit 2024-09-20T23:52:27.747532+0000 mgr.a (mgr.14388) 4235 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:52:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:29 smithi179 bash[23186]: cluster 2024-09-20T23:52:28.494520+0000 mgr.a (mgr.14388) 4236 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:29 smithi179 bash[23186]: audit 2024-09-20T23:52:28.499863+0000 mgr.a (mgr.14388) 4237 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:52:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:29 smithi179 bash[23186]: cephadm 2024-09-20T23:52:28.501110+0000 mgr.a (mgr.14388) 4238 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:52:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:29 smithi049 bash[23528]: cluster 2024-09-20T23:52:28.494520+0000 mgr.a (mgr.14388) 4236 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:29 smithi049 bash[23528]: audit 2024-09-20T23:52:28.499863+0000 mgr.a (mgr.14388) 4237 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:52:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:29 smithi049 bash[23528]: cephadm 2024-09-20T23:52:28.501110+0000 mgr.a (mgr.14388) 4238 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:52:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:29 smithi044 bash[22676]: cluster 2024-09-20T23:52:28.494520+0000 mgr.a (mgr.14388) 4236 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:29 smithi044 bash[22676]: audit 2024-09-20T23:52:28.499863+0000 mgr.a (mgr.14388) 4237 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:52:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:29 smithi044 bash[22676]: cephadm 2024-09-20T23:52:28.501110+0000 mgr.a (mgr.14388) 4238 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:52:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:31 smithi179 bash[23186]: cluster 2024-09-20T23:52:30.496699+0000 mgr.a (mgr.14388) 4239 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:31 smithi049 bash[23528]: cluster 2024-09-20T23:52:30.496699+0000 mgr.a (mgr.14388) 4239 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:31 smithi044 bash[22676]: cluster 2024-09-20T23:52:30.496699+0000 mgr.a (mgr.14388) 4239 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:32.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:32.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:33.104 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:33.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:33.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:33.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:33.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:33 smithi179 bash[23186]: cluster 2024-09-20T23:52:32.497242+0000 mgr.a (mgr.14388) 4240 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:33 smithi179 bash[23186]: audit 2024-09-20T23:52:32.678400+0000 mgr.a (mgr.14388) 4241 : audit [DBG] from='client.101892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:34.015 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:33 smithi049 bash[23528]: cluster 2024-09-20T23:52:32.497242+0000 mgr.a (mgr.14388) 4240 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:34.015 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:33 smithi049 bash[23528]: audit 2024-09-20T23:52:32.678400+0000 mgr.a (mgr.14388) 4241 : audit [DBG] from='client.101892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:34.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:33 smithi044 bash[22676]: cluster 2024-09-20T23:52:32.497242+0000 mgr.a (mgr.14388) 4240 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:34.147 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:33 smithi044 bash[22676]: audit 2024-09-20T23:52:32.678400+0000 mgr.a (mgr.14388) 4241 : audit [DBG] from='client.101892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:35 smithi044 bash[22676]: audit 2024-09-20T23:52:34.121616+0000 mon.a (mon.0) 4002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:35 smithi044 bash[22676]: audit 2024-09-20T23:52:34.131963+0000 mon.a (mon.0) 4003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:35 smithi044 bash[22676]: audit 2024-09-20T23:52:34.144226+0000 mon.a (mon.0) 4004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:35 smithi179 bash[23186]: audit 2024-09-20T23:52:34.121616+0000 mon.a (mon.0) 4002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:35 smithi179 bash[23186]: audit 2024-09-20T23:52:34.131963+0000 mon.a (mon.0) 4003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:35 smithi179 bash[23186]: audit 2024-09-20T23:52:34.144226+0000 mon.a (mon.0) 4004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:35 smithi049 bash[23528]: audit 2024-09-20T23:52:34.121616+0000 mon.a (mon.0) 4002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:35 smithi049 bash[23528]: audit 2024-09-20T23:52:34.131963+0000 mon.a (mon.0) 4003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:35 smithi049 bash[23528]: audit 2024-09-20T23:52:34.144226+0000 mon.a (mon.0) 4004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:36 smithi044 bash[22676]: cluster 2024-09-20T23:52:34.498131+0000 mgr.a (mgr.14388) 4242 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:36.489 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:36 smithi179 bash[23186]: cluster 2024-09-20T23:52:34.498131+0000 mgr.a (mgr.14388) 4242 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:36.499 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:36 smithi049 bash[23528]: cluster 2024-09-20T23:52:34.498131+0000 mgr.a (mgr.14388) 4242 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:37 smithi044 bash[22676]: audit 2024-09-20T23:52:36.473827+0000 mon.a (mon.0) 4005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:37 smithi044 bash[22676]: audit 2024-09-20T23:52:36.480039+0000 mon.a (mon.0) 4006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:37 smithi044 bash[22676]: audit 2024-09-20T23:52:36.487717+0000 mon.a (mon.0) 4007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:37 smithi044 bash[22676]: cluster 2024-09-20T23:52:36.500691+0000 mgr.a (mgr.14388) 4243 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:37 smithi179 bash[23186]: audit 2024-09-20T23:52:36.473827+0000 mon.a (mon.0) 4005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:37 smithi179 bash[23186]: audit 2024-09-20T23:52:36.480039+0000 mon.a (mon.0) 4006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:37 smithi179 bash[23186]: audit 2024-09-20T23:52:36.487717+0000 mon.a (mon.0) 4007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:37 smithi179 bash[23186]: cluster 2024-09-20T23:52:36.500691+0000 mgr.a (mgr.14388) 4243 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:37 smithi049 bash[23528]: audit 2024-09-20T23:52:36.473827+0000 mon.a (mon.0) 4005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:37 smithi049 bash[23528]: audit 2024-09-20T23:52:36.480039+0000 mon.a (mon.0) 4006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:37 smithi049 bash[23528]: audit 2024-09-20T23:52:36.487717+0000 mon.a (mon.0) 4007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:37 smithi049 bash[23528]: cluster 2024-09-20T23:52:36.500691+0000 mgr.a (mgr.14388) 4243 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:38 smithi179 bash[23186]: audit 2024-09-20T23:52:37.506960+0000 mon.a (mon.0) 4008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:38 smithi179 bash[23186]: audit 2024-09-20T23:52:37.514381+0000 mon.a (mon.0) 4009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:38 smithi179 bash[23186]: audit 2024-09-20T23:52:37.524202+0000 mon.a (mon.0) 4010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:38 smithi049 bash[23528]: audit 2024-09-20T23:52:37.506960+0000 mon.a (mon.0) 4008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:38 smithi049 bash[23528]: audit 2024-09-20T23:52:37.514381+0000 mon.a (mon.0) 4009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:38 smithi049 bash[23528]: audit 2024-09-20T23:52:37.524202+0000 mon.a (mon.0) 4010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.897 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:38.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:38 smithi044 bash[22676]: audit 2024-09-20T23:52:37.506960+0000 mon.a (mon.0) 4008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:38 smithi044 bash[22676]: audit 2024-09-20T23:52:37.514381+0000 mon.a (mon.0) 4009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:38 smithi044 bash[22676]: audit 2024-09-20T23:52:37.524202+0000 mon.a (mon.0) 4010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:39 smithi179 bash[23186]: audit 2024-09-20T23:52:38.441598+0000 mgr.a (mgr.14388) 4244 : audit [DBG] from='client.101970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:39 smithi179 bash[23186]: cluster 2024-09-20T23:52:38.501631+0000 mgr.a (mgr.14388) 4245 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:39 smithi049 bash[23528]: audit 2024-09-20T23:52:38.441598+0000 mgr.a (mgr.14388) 4244 : audit [DBG] from='client.101970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:39 smithi049 bash[23528]: cluster 2024-09-20T23:52:38.501631+0000 mgr.a (mgr.14388) 4245 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:39 smithi044 bash[22676]: audit 2024-09-20T23:52:38.441598+0000 mgr.a (mgr.14388) 4244 : audit [DBG] from='client.101970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:39 smithi044 bash[22676]: cluster 2024-09-20T23:52:38.501631+0000 mgr.a (mgr.14388) 4245 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:41 smithi049 bash[23528]: cluster 2024-09-20T23:52:40.503951+0000 mgr.a (mgr.14388) 4246 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:41 smithi044 bash[22676]: cluster 2024-09-20T23:52:40.503951+0000 mgr.a (mgr.14388) 4246 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:41 smithi179 bash[23186]: cluster 2024-09-20T23:52:40.503951+0000 mgr.a (mgr.14388) 4246 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:52:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:43 smithi049 bash[23528]: cluster 2024-09-20T23:52:42.504729+0000 mgr.a (mgr.14388) 4247 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:43.898 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:43.899 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:43 smithi044 bash[22676]: cluster 2024-09-20T23:52:42.504729+0000 mgr.a (mgr.14388) 4247 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:43 smithi179 bash[23186]: cluster 2024-09-20T23:52:42.504729+0000 mgr.a (mgr.14388) 4247 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:44.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:44.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:44.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:44.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:45 smithi049 bash[23528]: audit 2024-09-20T23:52:44.237306+0000 mgr.a (mgr.14388) 4248 : audit [DBG] from='client.102048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:45 smithi049 bash[23528]: cluster 2024-09-20T23:52:44.505727+0000 mgr.a (mgr.14388) 4249 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:45 smithi044 bash[22676]: audit 2024-09-20T23:52:44.237306+0000 mgr.a (mgr.14388) 4248 : audit [DBG] from='client.102048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:45 smithi044 bash[22676]: cluster 2024-09-20T23:52:44.505727+0000 mgr.a (mgr.14388) 4249 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:45 smithi179 bash[23186]: audit 2024-09-20T23:52:44.237306+0000 mgr.a (mgr.14388) 4248 : audit [DBG] from='client.102048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:45 smithi179 bash[23186]: cluster 2024-09-20T23:52:44.505727+0000 mgr.a (mgr.14388) 4249 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:47 smithi049 bash[23528]: cluster 2024-09-20T23:52:46.508283+0000 mgr.a (mgr.14388) 4250 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:47 smithi044 bash[22676]: cluster 2024-09-20T23:52:46.508283+0000 mgr.a (mgr.14388) 4250 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:47 smithi179 bash[23186]: cluster 2024-09-20T23:52:46.508283+0000 mgr.a (mgr.14388) 4250 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:52:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:49 smithi049 bash[23528]: cluster 2024-09-20T23:52:48.509219+0000 mgr.a (mgr.14388) 4251 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:49 smithi044 bash[22676]: cluster 2024-09-20T23:52:48.509219+0000 mgr.a (mgr.14388) 4251 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:49 smithi179 bash[23186]: cluster 2024-09-20T23:52:48.509219+0000 mgr.a (mgr.14388) 4251 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:50.465 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:50.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:50 smithi044 bash[22676]: audit 2024-09-20T23:52:50.017441+0000 mgr.a (mgr.14388) 4252 : audit [DBG] from='client.102126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:50 smithi179 bash[23186]: audit 2024-09-20T23:52:50.017441+0000 mgr.a (mgr.14388) 4252 : audit [DBG] from='client.102126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:50 smithi049 bash[23528]: audit 2024-09-20T23:52:50.017441+0000 mgr.a (mgr.14388) 4252 : audit [DBG] from='client.102126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:51 smithi044 bash[22676]: cluster 2024-09-20T23:52:50.511379+0000 mgr.a (mgr.14388) 4253 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:51 smithi179 bash[23186]: cluster 2024-09-20T23:52:50.511379+0000 mgr.a (mgr.14388) 4253 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:51 smithi049 bash[23528]: cluster 2024-09-20T23:52:50.511379+0000 mgr.a (mgr.14388) 4253 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:53.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:53 smithi049 bash[23528]: cluster 2024-09-20T23:52:52.512196+0000 mgr.a (mgr.14388) 4254 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:52:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:53 smithi044 bash[22676]: cluster 2024-09-20T23:52:52.512196+0000 mgr.a (mgr.14388) 4254 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:52:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:53 smithi179 bash[23186]: cluster 2024-09-20T23:52:52.512196+0000 mgr.a (mgr.14388) 4254 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:52:55.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:55 smithi044 bash[22676]: audit 2024-09-20T23:52:54.293970+0000 mon.a (mon.0) 4011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:55 smithi044 bash[22676]: audit 2024-09-20T23:52:54.303509+0000 mon.a (mon.0) 4012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:55 smithi044 bash[22676]: audit 2024-09-20T23:52:54.315095+0000 mon.a (mon.0) 4013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:55 smithi044 bash[22676]: cluster 2024-09-20T23:52:54.512977+0000 mgr.a (mgr.14388) 4255 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:52:55.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:52:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:52:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:52:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:55 smithi049 bash[23528]: audit 2024-09-20T23:52:54.293970+0000 mon.a (mon.0) 4011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:55 smithi049 bash[23528]: audit 2024-09-20T23:52:54.303509+0000 mon.a (mon.0) 4012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:55 smithi049 bash[23528]: audit 2024-09-20T23:52:54.315095+0000 mon.a (mon.0) 4013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:55 smithi049 bash[23528]: cluster 2024-09-20T23:52:54.512977+0000 mgr.a (mgr.14388) 4255 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:52:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:55 smithi179 bash[23186]: audit 2024-09-20T23:52:54.293970+0000 mon.a (mon.0) 4011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:55 smithi179 bash[23186]: audit 2024-09-20T23:52:54.303509+0000 mon.a (mon.0) 4012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:55 smithi179 bash[23186]: audit 2024-09-20T23:52:54.315095+0000 mon.a (mon.0) 4013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:55 smithi179 bash[23186]: cluster 2024-09-20T23:52:54.512977+0000 mgr.a (mgr.14388) 4255 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:52:56.232 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:52:56.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:52:56.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:52:56.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:52:56.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:52:56.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:56 smithi044 bash[22676]: audit 2024-09-20T23:52:55.805765+0000 mgr.a (mgr.14388) 4256 : audit [DBG] from='client.102201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:56.637 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:56 smithi049 bash[23528]: audit 2024-09-20T23:52:55.805765+0000 mgr.a (mgr.14388) 4256 : audit [DBG] from='client.102201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:56.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:56 smithi179 bash[23186]: audit 2024-09-20T23:52:55.805765+0000 mgr.a (mgr.14388) 4256 : audit [DBG] from='client.102201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:52:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:57 smithi044 bash[22676]: cluster 2024-09-20T23:52:56.515917+0000 mgr.a (mgr.14388) 4257 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:57 smithi044 bash[22676]: audit 2024-09-20T23:52:56.677988+0000 mon.a (mon.0) 4014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:57 smithi044 bash[22676]: audit 2024-09-20T23:52:56.683590+0000 mon.a (mon.0) 4015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:57 smithi044 bash[22676]: audit 2024-09-20T23:52:56.689067+0000 mon.a (mon.0) 4016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:57 smithi179 bash[23186]: cluster 2024-09-20T23:52:56.515917+0000 mgr.a (mgr.14388) 4257 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:57 smithi179 bash[23186]: audit 2024-09-20T23:52:56.677988+0000 mon.a (mon.0) 4014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:57 smithi179 bash[23186]: audit 2024-09-20T23:52:56.683590+0000 mon.a (mon.0) 4015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:57 smithi179 bash[23186]: audit 2024-09-20T23:52:56.689067+0000 mon.a (mon.0) 4016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:57 smithi049 bash[23528]: cluster 2024-09-20T23:52:56.515917+0000 mgr.a (mgr.14388) 4257 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:52:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:57 smithi049 bash[23528]: audit 2024-09-20T23:52:56.677988+0000 mon.a (mon.0) 4014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:57 smithi049 bash[23528]: audit 2024-09-20T23:52:56.683590+0000 mon.a (mon.0) 4015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:57 smithi049 bash[23528]: audit 2024-09-20T23:52:56.689067+0000 mon.a (mon.0) 4016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:58 smithi044 bash[22676]: audit 2024-09-20T23:52:57.705966+0000 mon.a (mon.0) 4017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:58 smithi044 bash[22676]: audit 2024-09-20T23:52:57.712477+0000 mon.a (mon.0) 4018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:58 smithi044 bash[22676]: audit 2024-09-20T23:52:57.720464+0000 mon.a (mon.0) 4019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:58 smithi179 bash[23186]: audit 2024-09-20T23:52:57.705966+0000 mon.a (mon.0) 4017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:58 smithi179 bash[23186]: audit 2024-09-20T23:52:57.712477+0000 mon.a (mon.0) 4018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:58 smithi179 bash[23186]: audit 2024-09-20T23:52:57.720464+0000 mon.a (mon.0) 4019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:58 smithi049 bash[23528]: audit 2024-09-20T23:52:57.705966+0000 mon.a (mon.0) 4017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:58 smithi049 bash[23528]: audit 2024-09-20T23:52:57.712477+0000 mon.a (mon.0) 4018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:58 smithi049 bash[23528]: audit 2024-09-20T23:52:57.720464+0000 mon.a (mon.0) 4019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:52:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:52:59 smithi044 bash[22676]: cluster 2024-09-20T23:52:58.516754+0000 mgr.a (mgr.14388) 4258 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:53:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:52:59 smithi179 bash[23186]: cluster 2024-09-20T23:52:58.516754+0000 mgr.a (mgr.14388) 4258 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:53:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:52:59 smithi049 bash[23528]: cluster 2024-09-20T23:52:58.516754+0000 mgr.a (mgr.14388) 4258 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:53:01.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:01.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:01.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:01 smithi044 bash[22676]: cluster 2024-09-20T23:53:00.518782+0000 mgr.a (mgr.14388) 4259 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:01 smithi179 bash[23186]: cluster 2024-09-20T23:53:00.518782+0000 mgr.a (mgr.14388) 4259 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:02.026 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:01 smithi049 bash[23528]: cluster 2024-09-20T23:53:00.518782+0000 mgr.a (mgr.14388) 4259 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:02 smithi044 bash[22676]: audit 2024-09-20T23:53:01.573824+0000 mgr.a (mgr.14388) 4260 : audit [DBG] from='client.102279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:02 smithi179 bash[23186]: audit 2024-09-20T23:53:01.573824+0000 mgr.a (mgr.14388) 4260 : audit [DBG] from='client.102279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:02 smithi049 bash[23528]: audit 2024-09-20T23:53:01.573824+0000 mgr.a (mgr.14388) 4260 : audit [DBG] from='client.102279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:03 smithi179 bash[23186]: cluster 2024-09-20T23:53:02.519716+0000 mgr.a (mgr.14388) 4261 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:03 smithi049 bash[23528]: cluster 2024-09-20T23:53:02.519716+0000 mgr.a (mgr.14388) 4261 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:03 smithi044 bash[22676]: cluster 2024-09-20T23:53:02.519716+0000 mgr.a (mgr.14388) 4261 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:05 smithi179 bash[23186]: cluster 2024-09-20T23:53:04.520555+0000 mgr.a (mgr.14388) 4262 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:05 smithi049 bash[23528]: cluster 2024-09-20T23:53:04.520555+0000 mgr.a (mgr.14388) 4262 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:05 smithi044 bash[22676]: cluster 2024-09-20T23:53:04.520555+0000 mgr.a (mgr.14388) 4262 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:07.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:07.028 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:07.793 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:07.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:07.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:07.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:07.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:07 smithi049 bash[23528]: cluster 2024-09-20T23:53:06.522854+0000 mgr.a (mgr.14388) 4263 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:07 smithi044 bash[22676]: cluster 2024-09-20T23:53:06.522854+0000 mgr.a (mgr.14388) 4263 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:07 smithi179 bash[23186]: cluster 2024-09-20T23:53:06.522854+0000 mgr.a (mgr.14388) 4263 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:08 smithi049 bash[23528]: audit 2024-09-20T23:53:07.363239+0000 mgr.a (mgr.14388) 4264 : audit [DBG] from='client.102351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:08 smithi044 bash[22676]: audit 2024-09-20T23:53:07.363239+0000 mgr.a (mgr.14388) 4264 : audit [DBG] from='client.102351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:08 smithi179 bash[23186]: audit 2024-09-20T23:53:07.363239+0000 mgr.a (mgr.14388) 4264 : audit [DBG] from='client.102351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:09 smithi049 bash[23528]: cluster 2024-09-20T23:53:08.523833+0000 mgr.a (mgr.14388) 4265 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:09 smithi044 bash[22676]: cluster 2024-09-20T23:53:08.523833+0000 mgr.a (mgr.14388) 4265 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:09 smithi179 bash[23186]: cluster 2024-09-20T23:53:08.523833+0000 mgr.a (mgr.14388) 4265 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:11 smithi049 bash[23528]: cluster 2024-09-20T23:53:10.526113+0000 mgr.a (mgr.14388) 4266 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:11 smithi044 bash[22676]: cluster 2024-09-20T23:53:10.526113+0000 mgr.a (mgr.14388) 4266 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:11 smithi179 bash[23186]: cluster 2024-09-20T23:53:10.526113+0000 mgr.a (mgr.14388) 4266 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:12.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:12.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:12.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:13.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:13.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:13.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:13.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:13 smithi049 bash[23528]: cluster 2024-09-20T23:53:12.526899+0000 mgr.a (mgr.14388) 4267 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:13 smithi049 bash[23528]: audit 2024-09-20T23:53:13.128392+0000 mgr.a (mgr.14388) 4268 : audit [DBG] from='client.102429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:13 smithi044 bash[22676]: cluster 2024-09-20T23:53:12.526899+0000 mgr.a (mgr.14388) 4267 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:13 smithi044 bash[22676]: audit 2024-09-20T23:53:13.128392+0000 mgr.a (mgr.14388) 4268 : audit [DBG] from='client.102429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:13 smithi179 bash[23186]: cluster 2024-09-20T23:53:12.526899+0000 mgr.a (mgr.14388) 4267 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:13 smithi179 bash[23186]: audit 2024-09-20T23:53:13.128392+0000 mgr.a (mgr.14388) 4268 : audit [DBG] from='client.102429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:15 smithi044 bash[22676]: audit 2024-09-20T23:53:14.463113+0000 mon.a (mon.0) 4020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:15 smithi044 bash[22676]: audit 2024-09-20T23:53:14.471804+0000 mon.a (mon.0) 4021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:15 smithi044 bash[22676]: audit 2024-09-20T23:53:14.482284+0000 mon.a (mon.0) 4022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:15 smithi044 bash[22676]: cluster 2024-09-20T23:53:14.527782+0000 mgr.a (mgr.14388) 4269 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:15 smithi179 bash[23186]: audit 2024-09-20T23:53:14.463113+0000 mon.a (mon.0) 4020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:15 smithi179 bash[23186]: audit 2024-09-20T23:53:14.471804+0000 mon.a (mon.0) 4021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:15 smithi179 bash[23186]: audit 2024-09-20T23:53:14.482284+0000 mon.a (mon.0) 4022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:15 smithi179 bash[23186]: cluster 2024-09-20T23:53:14.527782+0000 mgr.a (mgr.14388) 4269 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:15 smithi049 bash[23528]: audit 2024-09-20T23:53:14.463113+0000 mon.a (mon.0) 4020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:15 smithi049 bash[23528]: audit 2024-09-20T23:53:14.471804+0000 mon.a (mon.0) 4021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:15 smithi049 bash[23528]: audit 2024-09-20T23:53:14.482284+0000 mon.a (mon.0) 4022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:15 smithi049 bash[23528]: cluster 2024-09-20T23:53:14.527782+0000 mgr.a (mgr.14388) 4269 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:18.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:17 smithi044 bash[22676]: cluster 2024-09-20T23:53:16.529647+0000 mgr.a (mgr.14388) 4270 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:18.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:17 smithi044 bash[22676]: audit 2024-09-20T23:53:16.892508+0000 mon.a (mon.0) 4023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:17 smithi044 bash[22676]: audit 2024-09-20T23:53:16.900921+0000 mon.a (mon.0) 4024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:17 smithi044 bash[22676]: audit 2024-09-20T23:53:16.912264+0000 mon.a (mon.0) 4025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:17 smithi044 bash[22676]: audit 2024-09-20T23:53:17.866263+0000 mon.a (mon.0) 4026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:17 smithi044 bash[22676]: audit 2024-09-20T23:53:17.873807+0000 mon.a (mon.0) 4027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:17 smithi044 bash[22676]: audit 2024-09-20T23:53:17.885297+0000 mon.a (mon.0) 4028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:17 smithi179 bash[23186]: cluster 2024-09-20T23:53:16.529647+0000 mgr.a (mgr.14388) 4270 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:18.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:17 smithi179 bash[23186]: audit 2024-09-20T23:53:16.892508+0000 mon.a (mon.0) 4023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:17 smithi179 bash[23186]: audit 2024-09-20T23:53:16.900921+0000 mon.a (mon.0) 4024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:17 smithi179 bash[23186]: audit 2024-09-20T23:53:16.912264+0000 mon.a (mon.0) 4025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:17 smithi179 bash[23186]: audit 2024-09-20T23:53:17.866263+0000 mon.a (mon.0) 4026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:17 smithi179 bash[23186]: audit 2024-09-20T23:53:17.873807+0000 mon.a (mon.0) 4027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:17 smithi179 bash[23186]: audit 2024-09-20T23:53:17.885297+0000 mon.a (mon.0) 4028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:17 smithi049 bash[23528]: cluster 2024-09-20T23:53:16.529647+0000 mgr.a (mgr.14388) 4270 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:17 smithi049 bash[23528]: audit 2024-09-20T23:53:16.892508+0000 mon.a (mon.0) 4023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:17 smithi049 bash[23528]: audit 2024-09-20T23:53:16.900921+0000 mon.a (mon.0) 4024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:17 smithi049 bash[23528]: audit 2024-09-20T23:53:16.912264+0000 mon.a (mon.0) 4025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:17 smithi049 bash[23528]: audit 2024-09-20T23:53:17.866263+0000 mon.a (mon.0) 4026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:17 smithi049 bash[23528]: audit 2024-09-20T23:53:17.873807+0000 mon.a (mon.0) 4027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:17 smithi049 bash[23528]: audit 2024-09-20T23:53:17.885297+0000 mon.a (mon.0) 4028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:18.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:18.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:19.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:19.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:19.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:19 smithi044 bash[22676]: cluster 2024-09-20T23:53:18.530407+0000 mgr.a (mgr.14388) 4271 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:19 smithi044 bash[22676]: audit 2024-09-20T23:53:18.913354+0000 mgr.a (mgr.14388) 4272 : audit [DBG] from='client.102501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:20.245 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:19 smithi179 bash[23186]: cluster 2024-09-20T23:53:18.530407+0000 mgr.a (mgr.14388) 4271 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:20.245 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:19 smithi179 bash[23186]: audit 2024-09-20T23:53:18.913354+0000 mgr.a (mgr.14388) 4272 : audit [DBG] from='client.102501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:19 smithi049 bash[23528]: cluster 2024-09-20T23:53:18.530407+0000 mgr.a (mgr.14388) 4271 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:19 smithi049 bash[23528]: audit 2024-09-20T23:53:18.913354+0000 mgr.a (mgr.14388) 4272 : audit [DBG] from='client.102501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:21 smithi044 bash[22676]: cluster 2024-09-20T23:53:20.532754+0000 mgr.a (mgr.14388) 4273 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:21 smithi179 bash[23186]: cluster 2024-09-20T23:53:20.532754+0000 mgr.a (mgr.14388) 4273 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:21 smithi049 bash[23528]: cluster 2024-09-20T23:53:20.532754+0000 mgr.a (mgr.14388) 4273 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:24.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:23 smithi044 bash[22676]: cluster 2024-09-20T23:53:22.533550+0000 mgr.a (mgr.14388) 4274 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:23 smithi179 bash[23186]: cluster 2024-09-20T23:53:22.533550+0000 mgr.a (mgr.14388) 4274 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:23 smithi049 bash[23528]: cluster 2024-09-20T23:53:22.533550+0000 mgr.a (mgr.14388) 4274 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:24.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:24.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:24.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:25.156 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:25 smithi044 bash[22676]: cluster 2024-09-20T23:53:24.534003+0000 mgr.a (mgr.14388) 4275 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:25 smithi044 bash[22676]: audit 2024-09-20T23:53:24.713846+0000 mgr.a (mgr.14388) 4276 : audit [DBG] from='client.102579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:25 smithi179 bash[23186]: cluster 2024-09-20T23:53:24.534003+0000 mgr.a (mgr.14388) 4275 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:25 smithi179 bash[23186]: audit 2024-09-20T23:53:24.713846+0000 mgr.a (mgr.14388) 4276 : audit [DBG] from='client.102579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:25 smithi049 bash[23528]: cluster 2024-09-20T23:53:24.534003+0000 mgr.a (mgr.14388) 4275 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:25 smithi049 bash[23528]: audit 2024-09-20T23:53:24.713846+0000 mgr.a (mgr.14388) 4276 : audit [DBG] from='client.102579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:27 smithi044 bash[22676]: cluster 2024-09-20T23:53:26.536678+0000 mgr.a (mgr.14388) 4277 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:53:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:27 smithi179 bash[23186]: cluster 2024-09-20T23:53:26.536678+0000 mgr.a (mgr.14388) 4277 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:53:28.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:27 smithi049 bash[23528]: cluster 2024-09-20T23:53:26.536678+0000 mgr.a (mgr.14388) 4277 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-20T23:53:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:28 smithi044 bash[22676]: audit 2024-09-20T23:53:28.558398+0000 mon.a (mon.0) 4029 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:53:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:28 smithi044 bash[22676]: audit 2024-09-20T23:53:28.565161+0000 mon.a (mon.0) 4030 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:53:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:28 smithi044 bash[22676]: audit 2024-09-20T23:53:28.566962+0000 mon.a (mon.0) 4031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:53:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:28 smithi044 bash[22676]: audit 2024-09-20T23:53:28.578207+0000 mon.a (mon.0) 4032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:28 smithi044 bash[22676]: audit 2024-09-20T23:53:28.584636+0000 mon.a (mon.0) 4033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:53:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:28 smithi179 bash[23186]: audit 2024-09-20T23:53:28.558398+0000 mon.a (mon.0) 4029 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:53:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:28 smithi179 bash[23186]: audit 2024-09-20T23:53:28.565161+0000 mon.a (mon.0) 4030 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:53:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:28 smithi179 bash[23186]: audit 2024-09-20T23:53:28.566962+0000 mon.a (mon.0) 4031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:53:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:28 smithi179 bash[23186]: audit 2024-09-20T23:53:28.578207+0000 mon.a (mon.0) 4032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:28 smithi179 bash[23186]: audit 2024-09-20T23:53:28.584636+0000 mon.a (mon.0) 4033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:53:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:28 smithi049 bash[23528]: audit 2024-09-20T23:53:28.558398+0000 mon.a (mon.0) 4029 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:53:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:28 smithi049 bash[23528]: audit 2024-09-20T23:53:28.565161+0000 mon.a (mon.0) 4030 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:53:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:28 smithi049 bash[23528]: audit 2024-09-20T23:53:28.566962+0000 mon.a (mon.0) 4031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:53:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:28 smithi049 bash[23528]: audit 2024-09-20T23:53:28.578207+0000 mon.a (mon.0) 4032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:28 smithi049 bash[23528]: audit 2024-09-20T23:53:28.584636+0000 mon.a (mon.0) 4033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:53:29.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:53:29 smithi044 bash[22930]: debug 2024-09-20T23:53:29.372+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:53:29.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:53:29 smithi044 bash[22930]: debug 2024-09-20T23:53:29.372+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:53:30.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:30.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:30.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:29 smithi044 bash[22676]: cluster 2024-09-20T23:53:28.537454+0000 mgr.a (mgr.14388) 4278 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:53:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:29 smithi044 bash[22676]: audit 2024-09-20T23:53:28.587109+0000 mgr.a (mgr.14388) 4279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:53:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:29 smithi179 bash[23186]: cluster 2024-09-20T23:53:28.537454+0000 mgr.a (mgr.14388) 4278 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:53:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:29 smithi179 bash[23186]: audit 2024-09-20T23:53:28.587109+0000 mgr.a (mgr.14388) 4279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:53:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:29 smithi049 bash[23528]: cluster 2024-09-20T23:53:28.537454+0000 mgr.a (mgr.14388) 4278 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-20T23:53:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:29 smithi049 bash[23528]: audit 2024-09-20T23:53:28.587109+0000 mgr.a (mgr.14388) 4279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:53:30.938 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:30 smithi044 bash[22676]: audit 2024-09-20T23:53:29.373268+0000 mgr.a (mgr.14388) 4280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:53:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:30 smithi044 bash[22676]: cephadm 2024-09-20T23:53:29.374475+0000 mgr.a (mgr.14388) 4281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:53:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:30 smithi179 bash[23186]: audit 2024-09-20T23:53:29.373268+0000 mgr.a (mgr.14388) 4280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:53:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:30 smithi179 bash[23186]: cephadm 2024-09-20T23:53:29.374475+0000 mgr.a (mgr.14388) 4281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:53:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:30 smithi049 bash[23528]: audit 2024-09-20T23:53:29.373268+0000 mgr.a (mgr.14388) 4280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:53:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:30 smithi049 bash[23528]: cephadm 2024-09-20T23:53:29.374475+0000 mgr.a (mgr.14388) 4281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:53:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:31 smithi044 bash[22676]: audit 2024-09-20T23:53:30.493965+0000 mgr.a (mgr.14388) 4282 : audit [DBG] from='client.102765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:31 smithi044 bash[22676]: cluster 2024-09-20T23:53:30.540425+0000 mgr.a (mgr.14388) 4283 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:31 smithi179 bash[23186]: audit 2024-09-20T23:53:30.493965+0000 mgr.a (mgr.14388) 4282 : audit [DBG] from='client.102765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:31 smithi179 bash[23186]: cluster 2024-09-20T23:53:30.540425+0000 mgr.a (mgr.14388) 4283 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:31 smithi049 bash[23528]: audit 2024-09-20T23:53:30.493965+0000 mgr.a (mgr.14388) 4282 : audit [DBG] from='client.102765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:31 smithi049 bash[23528]: cluster 2024-09-20T23:53:30.540425+0000 mgr.a (mgr.14388) 4283 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:34.211 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:33 smithi049 bash[23528]: cluster 2024-09-20T23:53:32.541407+0000 mgr.a (mgr.14388) 4284 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:33 smithi044 bash[22676]: cluster 2024-09-20T23:53:32.541407+0000 mgr.a (mgr.14388) 4284 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:33 smithi179 bash[23186]: cluster 2024-09-20T23:53:32.541407+0000 mgr.a (mgr.14388) 4284 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:35.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:35.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:35.941 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:35 smithi044 bash[22676]: cluster 2024-09-20T23:53:34.542218+0000 mgr.a (mgr.14388) 4285 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:35 smithi044 bash[22676]: audit 2024-09-20T23:53:34.671726+0000 mon.a (mon.0) 4034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:35 smithi044 bash[22676]: audit 2024-09-20T23:53:34.680363+0000 mon.a (mon.0) 4035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:35 smithi044 bash[22676]: audit 2024-09-20T23:53:34.690802+0000 mon.a (mon.0) 4036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:35 smithi179 bash[23186]: cluster 2024-09-20T23:53:34.542218+0000 mgr.a (mgr.14388) 4285 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:35 smithi179 bash[23186]: audit 2024-09-20T23:53:34.671726+0000 mon.a (mon.0) 4034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:35 smithi179 bash[23186]: audit 2024-09-20T23:53:34.680363+0000 mon.a (mon.0) 4035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:35 smithi179 bash[23186]: audit 2024-09-20T23:53:34.690802+0000 mon.a (mon.0) 4036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:36.035 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:35 smithi049 bash[23528]: cluster 2024-09-20T23:53:34.542218+0000 mgr.a (mgr.14388) 4285 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:36.036 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:35 smithi049 bash[23528]: audit 2024-09-20T23:53:34.671726+0000 mon.a (mon.0) 4034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:36.036 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:35 smithi049 bash[23528]: audit 2024-09-20T23:53:34.680363+0000 mon.a (mon.0) 4035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:36.036 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:35 smithi049 bash[23528]: audit 2024-09-20T23:53:34.690802+0000 mon.a (mon.0) 4036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:36.727 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: audit 2024-09-20T23:53:36.278761+0000 mgr.a (mgr.14388) 4286 : audit [DBG] from='client.102843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: cluster 2024-09-20T23:53:36.543630+0000 mgr.a (mgr.14388) 4287 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: audit 2024-09-20T23:53:37.066144+0000 mon.a (mon.0) 4037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: audit 2024-09-20T23:53:37.074645+0000 mon.a (mon.0) 4038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: audit 2024-09-20T23:53:37.084820+0000 mon.a (mon.0) 4039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: audit 2024-09-20T23:53:38.040474+0000 mon.a (mon.0) 4040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: audit 2024-09-20T23:53:38.046350+0000 mon.a (mon.0) 4041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:38 smithi179 bash[23186]: audit 2024-09-20T23:53:38.053353+0000 mon.a (mon.0) 4042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.464 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: audit 2024-09-20T23:53:36.278761+0000 mgr.a (mgr.14388) 4286 : audit [DBG] from='client.102843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:38.464 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: cluster 2024-09-20T23:53:36.543630+0000 mgr.a (mgr.14388) 4287 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:38.464 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: audit 2024-09-20T23:53:37.066144+0000 mon.a (mon.0) 4037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.464 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: audit 2024-09-20T23:53:37.074645+0000 mon.a (mon.0) 4038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: audit 2024-09-20T23:53:37.084820+0000 mon.a (mon.0) 4039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: audit 2024-09-20T23:53:38.040474+0000 mon.a (mon.0) 4040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: audit 2024-09-20T23:53:38.046350+0000 mon.a (mon.0) 4041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:38 smithi044 bash[22676]: audit 2024-09-20T23:53:38.053353+0000 mon.a (mon.0) 4042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: audit 2024-09-20T23:53:36.278761+0000 mgr.a (mgr.14388) 4286 : audit [DBG] from='client.102843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: cluster 2024-09-20T23:53:36.543630+0000 mgr.a (mgr.14388) 4287 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: audit 2024-09-20T23:53:37.066144+0000 mon.a (mon.0) 4037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: audit 2024-09-20T23:53:37.074645+0000 mon.a (mon.0) 4038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: audit 2024-09-20T23:53:37.084820+0000 mon.a (mon.0) 4039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: audit 2024-09-20T23:53:38.040474+0000 mon.a (mon.0) 4040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: audit 2024-09-20T23:53:38.046350+0000 mon.a (mon.0) 4041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:38 smithi049 bash[23528]: audit 2024-09-20T23:53:38.053353+0000 mon.a (mon.0) 4042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:40.367 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:40 smithi179 bash[23186]: cluster 2024-09-20T23:53:38.544193+0000 mgr.a (mgr.14388) 4288 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:40.438 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:40 smithi044 bash[22676]: cluster 2024-09-20T23:53:38.544193+0000 mgr.a (mgr.14388) 4288 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:40 smithi049 bash[23528]: cluster 2024-09-20T23:53:38.544193+0000 mgr.a (mgr.14388) 4288 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:53:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:41.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:41.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:42 smithi044 bash[22676]: cluster 2024-09-20T23:53:40.546440+0000 mgr.a (mgr.14388) 4289 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:42 smithi179 bash[23186]: cluster 2024-09-20T23:53:40.546440+0000 mgr.a (mgr.14388) 4289 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:42.520 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:42.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:42 smithi049 bash[23528]: cluster 2024-09-20T23:53:40.546440+0000 mgr.a (mgr.14388) 4289 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:53:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:43 smithi044 bash[22676]: audit 2024-09-20T23:53:42.067205+0000 mgr.a (mgr.14388) 4290 : audit [DBG] from='client.102918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:43 smithi179 bash[23186]: audit 2024-09-20T23:53:42.067205+0000 mgr.a (mgr.14388) 4290 : audit [DBG] from='client.102918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:43 smithi049 bash[23528]: audit 2024-09-20T23:53:42.067205+0000 mgr.a (mgr.14388) 4290 : audit [DBG] from='client.102918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:44 smithi044 bash[22676]: cluster 2024-09-20T23:53:42.547050+0000 mgr.a (mgr.14388) 4291 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:44 smithi179 bash[23186]: cluster 2024-09-20T23:53:42.547050+0000 mgr.a (mgr.14388) 4291 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:44 smithi049 bash[23528]: cluster 2024-09-20T23:53:42.547050+0000 mgr.a (mgr.14388) 4291 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:46 smithi044 bash[22676]: cluster 2024-09-20T23:53:44.547816+0000 mgr.a (mgr.14388) 4292 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:46 smithi179 bash[23186]: cluster 2024-09-20T23:53:44.547816+0000 mgr.a (mgr.14388) 4292 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:46 smithi049 bash[23528]: cluster 2024-09-20T23:53:44.547816+0000 mgr.a (mgr.14388) 4292 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:47.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:47.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:47.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:48.280 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:48 smithi049 bash[23528]: cluster 2024-09-20T23:53:46.550095+0000 mgr.a (mgr.14388) 4293 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:48 smithi044 bash[22676]: cluster 2024-09-20T23:53:46.550095+0000 mgr.a (mgr.14388) 4293 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:48 smithi179 bash[23186]: cluster 2024-09-20T23:53:46.550095+0000 mgr.a (mgr.14388) 4293 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:49 smithi044 bash[22676]: audit 2024-09-20T23:53:47.851823+0000 mgr.a (mgr.14388) 4294 : audit [DBG] from='client.102996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:49 smithi179 bash[23186]: audit 2024-09-20T23:53:47.851823+0000 mgr.a (mgr.14388) 4294 : audit [DBG] from='client.102996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:49 smithi049 bash[23528]: audit 2024-09-20T23:53:47.851823+0000 mgr.a (mgr.14388) 4294 : audit [DBG] from='client.102996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:50 smithi044 bash[22676]: cluster 2024-09-20T23:53:48.551061+0000 mgr.a (mgr.14388) 4295 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:50 smithi179 bash[23186]: cluster 2024-09-20T23:53:48.551061+0000 mgr.a (mgr.14388) 4295 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:50 smithi049 bash[23528]: cluster 2024-09-20T23:53:48.551061+0000 mgr.a (mgr.14388) 4295 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:52 smithi044 bash[22676]: cluster 2024-09-20T23:53:50.553391+0000 mgr.a (mgr.14388) 4296 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:52 smithi179 bash[23186]: cluster 2024-09-20T23:53:50.553391+0000 mgr.a (mgr.14388) 4296 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:52 smithi049 bash[23528]: cluster 2024-09-20T23:53:50.553391+0000 mgr.a (mgr.14388) 4296 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:53.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:53.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:53.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:54.047 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:53:54.407 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:54 smithi049 bash[23528]: cluster 2024-09-20T23:53:52.554175+0000 mgr.a (mgr.14388) 4297 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:54 smithi044 bash[22676]: cluster 2024-09-20T23:53:52.554175+0000 mgr.a (mgr.14388) 4297 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:54 smithi179 bash[23186]: cluster 2024-09-20T23:53:52.554175+0000 mgr.a (mgr.14388) 4297 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:55 smithi044 bash[22676]: audit 2024-09-20T23:53:53.616062+0000 mgr.a (mgr.14388) 4298 : audit [DBG] from='client.103071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:55 smithi044 bash[22676]: audit 2024-09-20T23:53:54.881805+0000 mon.a (mon.0) 4043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:55 smithi044 bash[22676]: audit 2024-09-20T23:53:54.890722+0000 mon.a (mon.0) 4044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:55 smithi044 bash[22676]: audit 2024-09-20T23:53:54.901479+0000 mon.a (mon.0) 4045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:55 smithi179 bash[23186]: audit 2024-09-20T23:53:53.616062+0000 mgr.a (mgr.14388) 4298 : audit [DBG] from='client.103071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:55 smithi179 bash[23186]: audit 2024-09-20T23:53:54.881805+0000 mon.a (mon.0) 4043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:55 smithi179 bash[23186]: audit 2024-09-20T23:53:54.890722+0000 mon.a (mon.0) 4044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:55 smithi179 bash[23186]: audit 2024-09-20T23:53:54.901479+0000 mon.a (mon.0) 4045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:55 smithi049 bash[23528]: audit 2024-09-20T23:53:53.616062+0000 mgr.a (mgr.14388) 4298 : audit [DBG] from='client.103071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:53:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:55 smithi049 bash[23528]: audit 2024-09-20T23:53:54.881805+0000 mon.a (mon.0) 4043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:55 smithi049 bash[23528]: audit 2024-09-20T23:53:54.890722+0000 mon.a (mon.0) 4044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:55 smithi049 bash[23528]: audit 2024-09-20T23:53:54.901479+0000 mon.a (mon.0) 4045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:56 smithi044 bash[22676]: cluster 2024-09-20T23:53:54.555156+0000 mgr.a (mgr.14388) 4299 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:56 smithi179 bash[23186]: cluster 2024-09-20T23:53:54.555156+0000 mgr.a (mgr.14388) 4299 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:56 smithi049 bash[23528]: cluster 2024-09-20T23:53:54.555156+0000 mgr.a (mgr.14388) 4299 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:58.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:58 smithi179 bash[23186]: cluster 2024-09-20T23:53:56.557406+0000 mgr.a (mgr.14388) 4300 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:58.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:58 smithi179 bash[23186]: audit 2024-09-20T23:53:57.288618+0000 mon.a (mon.0) 4046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.369 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:58 smithi179 bash[23186]: audit 2024-09-20T23:53:57.297092+0000 mon.a (mon.0) 4047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.369 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:58 smithi179 bash[23186]: audit 2024-09-20T23:53:57.307217+0000 mon.a (mon.0) 4048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:58 smithi044 bash[22676]: cluster 2024-09-20T23:53:56.557406+0000 mgr.a (mgr.14388) 4300 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:58 smithi044 bash[22676]: audit 2024-09-20T23:53:57.288618+0000 mon.a (mon.0) 4046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:58 smithi044 bash[22676]: audit 2024-09-20T23:53:57.297092+0000 mon.a (mon.0) 4047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:58 smithi044 bash[22676]: audit 2024-09-20T23:53:57.307217+0000 mon.a (mon.0) 4048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:58 smithi049 bash[23528]: cluster 2024-09-20T23:53:56.557406+0000 mgr.a (mgr.14388) 4300 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:53:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:58 smithi049 bash[23528]: audit 2024-09-20T23:53:57.288618+0000 mon.a (mon.0) 4046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:58 smithi049 bash[23528]: audit 2024-09-20T23:53:57.297092+0000 mon.a (mon.0) 4047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:58 smithi049 bash[23528]: audit 2024-09-20T23:53:57.307217+0000 mon.a (mon.0) 4048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:53:59.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:53:59.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:53:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:59 smithi179 bash[23186]: audit 2024-09-20T23:53:58.205767+0000 mon.a (mon.0) 4049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:59 smithi179 bash[23186]: audit 2024-09-20T23:53:58.212578+0000 mon.a (mon.0) 4050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:59 smithi179 bash[23186]: audit 2024-09-20T23:53:58.221204+0000 mon.a (mon.0) 4051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:53:59 smithi179 bash[23186]: cluster 2024-09-20T23:53:58.557906+0000 mgr.a (mgr.14388) 4301 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:59 smithi044 bash[22676]: audit 2024-09-20T23:53:58.205767+0000 mon.a (mon.0) 4049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:59 smithi044 bash[22676]: audit 2024-09-20T23:53:58.212578+0000 mon.a (mon.0) 4050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:59 smithi044 bash[22676]: audit 2024-09-20T23:53:58.221204+0000 mon.a (mon.0) 4051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:53:59 smithi044 bash[22676]: cluster 2024-09-20T23:53:58.557906+0000 mgr.a (mgr.14388) 4301 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:59 smithi049 bash[23528]: audit 2024-09-20T23:53:58.205767+0000 mon.a (mon.0) 4049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:59 smithi049 bash[23528]: audit 2024-09-20T23:53:58.212578+0000 mon.a (mon.0) 4050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:59 smithi049 bash[23528]: audit 2024-09-20T23:53:58.221204+0000 mon.a (mon.0) 4051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:53:59 smithi049 bash[23528]: cluster 2024-09-20T23:53:58.557906+0000 mgr.a (mgr.14388) 4301 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:53:59.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:53:59.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:53:59.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:53:59.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:53:59.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:00.484 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:00 smithi179 bash[23186]: audit 2024-09-20T23:53:59.387676+0000 mgr.a (mgr.14388) 4302 : audit [DBG] from='client.103143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:00 smithi044 bash[22676]: audit 2024-09-20T23:53:59.387676+0000 mgr.a (mgr.14388) 4302 : audit [DBG] from='client.103143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:00 smithi049 bash[23528]: audit 2024-09-20T23:53:59.387676+0000 mgr.a (mgr.14388) 4302 : audit [DBG] from='client.103143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:01 smithi044 bash[22676]: cluster 2024-09-20T23:54:00.560186+0000 mgr.a (mgr.14388) 4303 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:01 smithi179 bash[23186]: cluster 2024-09-20T23:54:00.560186+0000 mgr.a (mgr.14388) 4303 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:01 smithi049 bash[23528]: cluster 2024-09-20T23:54:00.560186+0000 mgr.a (mgr.14388) 4303 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:03 smithi044 bash[22676]: cluster 2024-09-20T23:54:02.560959+0000 mgr.a (mgr.14388) 4304 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:03 smithi179 bash[23186]: cluster 2024-09-20T23:54:02.560959+0000 mgr.a (mgr.14388) 4304 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:03 smithi049 bash[23528]: cluster 2024-09-20T23:54:02.560959+0000 mgr.a (mgr.14388) 4304 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:04.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:04.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:04.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:05.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:05.961 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:05 smithi179 bash[23186]: cluster 2024-09-20T23:54:04.561767+0000 mgr.a (mgr.14388) 4305 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:06.041 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:05 smithi179 bash[23186]: audit 2024-09-20T23:54:05.159075+0000 mgr.a (mgr.14388) 4306 : audit [DBG] from='client.103215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:06.041 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:05 smithi044 bash[22676]: cluster 2024-09-20T23:54:04.561767+0000 mgr.a (mgr.14388) 4305 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:06.041 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:05 smithi044 bash[22676]: audit 2024-09-20T23:54:05.159075+0000 mgr.a (mgr.14388) 4306 : audit [DBG] from='client.103215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:05 smithi049 bash[23528]: cluster 2024-09-20T23:54:04.561767+0000 mgr.a (mgr.14388) 4305 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:05 smithi049 bash[23528]: audit 2024-09-20T23:54:05.159075+0000 mgr.a (mgr.14388) 4306 : audit [DBG] from='client.103215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:07 smithi044 bash[22676]: cluster 2024-09-20T23:54:06.564508+0000 mgr.a (mgr.14388) 4307 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:07 smithi179 bash[23186]: cluster 2024-09-20T23:54:06.564508+0000 mgr.a (mgr.14388) 4307 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:07 smithi049 bash[23528]: cluster 2024-09-20T23:54:06.564508+0000 mgr.a (mgr.14388) 4307 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:09 smithi044 bash[22676]: cluster 2024-09-20T23:54:08.565332+0000 mgr.a (mgr.14388) 4308 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:09 smithi179 bash[23186]: cluster 2024-09-20T23:54:08.565332+0000 mgr.a (mgr.14388) 4308 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:09 smithi049 bash[23528]: cluster 2024-09-20T23:54:08.565332+0000 mgr.a (mgr.14388) 4308 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:10.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:10.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:10.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:11.355 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:11 smithi044 bash[22676]: cluster 2024-09-20T23:54:10.567359+0000 mgr.a (mgr.14388) 4309 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:11 smithi044 bash[22676]: audit 2024-09-20T23:54:10.928262+0000 mgr.a (mgr.14388) 4310 : audit [DBG] from='client.103293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:11 smithi179 bash[23186]: cluster 2024-09-20T23:54:10.567359+0000 mgr.a (mgr.14388) 4309 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:11 smithi179 bash[23186]: audit 2024-09-20T23:54:10.928262+0000 mgr.a (mgr.14388) 4310 : audit [DBG] from='client.103293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:11 smithi049 bash[23528]: cluster 2024-09-20T23:54:10.567359+0000 mgr.a (mgr.14388) 4309 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:11 smithi049 bash[23528]: audit 2024-09-20T23:54:10.928262+0000 mgr.a (mgr.14388) 4310 : audit [DBG] from='client.103293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:13 smithi044 bash[22676]: cluster 2024-09-20T23:54:12.568252+0000 mgr.a (mgr.14388) 4311 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:13 smithi179 bash[23186]: cluster 2024-09-20T23:54:12.568252+0000 mgr.a (mgr.14388) 4311 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:13 smithi049 bash[23528]: cluster 2024-09-20T23:54:12.568252+0000 mgr.a (mgr.14388) 4311 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:16.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:16.358 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:16.413 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:16 smithi049 bash[23528]: cluster 2024-09-20T23:54:14.569042+0000 mgr.a (mgr.14388) 4312 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:54:16.413 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:16 smithi049 bash[23528]: audit 2024-09-20T23:54:15.111397+0000 mon.a (mon.0) 4052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.413 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:16 smithi049 bash[23528]: audit 2024-09-20T23:54:15.120347+0000 mon.a (mon.0) 4053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.413 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:16 smithi049 bash[23528]: audit 2024-09-20T23:54:15.130936+0000 mon.a (mon.0) 4054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:16 smithi044 bash[22676]: cluster 2024-09-20T23:54:14.569042+0000 mgr.a (mgr.14388) 4312 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:54:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:16 smithi044 bash[22676]: audit 2024-09-20T23:54:15.111397+0000 mon.a (mon.0) 4052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:16 smithi044 bash[22676]: audit 2024-09-20T23:54:15.120347+0000 mon.a (mon.0) 4053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:16 smithi044 bash[22676]: audit 2024-09-20T23:54:15.130936+0000 mon.a (mon.0) 4054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:16 smithi179 bash[23186]: cluster 2024-09-20T23:54:14.569042+0000 mgr.a (mgr.14388) 4312 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:54:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:16 smithi179 bash[23186]: audit 2024-09-20T23:54:15.111397+0000 mon.a (mon.0) 4052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:16 smithi179 bash[23186]: audit 2024-09-20T23:54:15.120347+0000 mon.a (mon.0) 4053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:16 smithi179 bash[23186]: audit 2024-09-20T23:54:15.130936+0000 mon.a (mon.0) 4054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:18.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:18 smithi179 bash[23186]: cluster 2024-09-20T23:54:16.570928+0000 mgr.a (mgr.14388) 4313 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:18.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:18 smithi179 bash[23186]: audit 2024-09-20T23:54:16.697217+0000 mgr.a (mgr.14388) 4314 : audit [DBG] from='client.103368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:18.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:18 smithi179 bash[23186]: audit 2024-09-20T23:54:17.516043+0000 mon.a (mon.0) 4055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:18 smithi179 bash[23186]: audit 2024-09-20T23:54:17.524573+0000 mon.a (mon.0) 4056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:18 smithi179 bash[23186]: audit 2024-09-20T23:54:17.535494+0000 mon.a (mon.0) 4057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.459 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:18 smithi044 bash[22676]: cluster 2024-09-20T23:54:16.570928+0000 mgr.a (mgr.14388) 4313 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:18.459 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:18 smithi044 bash[22676]: audit 2024-09-20T23:54:16.697217+0000 mgr.a (mgr.14388) 4314 : audit [DBG] from='client.103368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:18.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:18 smithi044 bash[22676]: audit 2024-09-20T23:54:17.516043+0000 mon.a (mon.0) 4055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:18 smithi044 bash[22676]: audit 2024-09-20T23:54:17.524573+0000 mon.a (mon.0) 4056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:18 smithi044 bash[22676]: audit 2024-09-20T23:54:17.535494+0000 mon.a (mon.0) 4057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:18 smithi049 bash[23528]: cluster 2024-09-20T23:54:16.570928+0000 mgr.a (mgr.14388) 4313 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:18 smithi049 bash[23528]: audit 2024-09-20T23:54:16.697217+0000 mgr.a (mgr.14388) 4314 : audit [DBG] from='client.103368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:18 smithi049 bash[23528]: audit 2024-09-20T23:54:17.516043+0000 mon.a (mon.0) 4055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:18 smithi049 bash[23528]: audit 2024-09-20T23:54:17.524573+0000 mon.a (mon.0) 4056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:18 smithi049 bash[23528]: audit 2024-09-20T23:54:17.535494+0000 mon.a (mon.0) 4057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:19 smithi044 bash[22676]: audit 2024-09-20T23:54:18.438682+0000 mon.a (mon.0) 4058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:19 smithi044 bash[22676]: audit 2024-09-20T23:54:18.447160+0000 mon.a (mon.0) 4059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:19 smithi044 bash[22676]: audit 2024-09-20T23:54:18.457455+0000 mon.a (mon.0) 4060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:19 smithi044 bash[22676]: cluster 2024-09-20T23:54:18.571879+0000 mgr.a (mgr.14388) 4315 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:19 smithi179 bash[23186]: audit 2024-09-20T23:54:18.438682+0000 mon.a (mon.0) 4058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:19 smithi179 bash[23186]: audit 2024-09-20T23:54:18.447160+0000 mon.a (mon.0) 4059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:19 smithi179 bash[23186]: audit 2024-09-20T23:54:18.457455+0000 mon.a (mon.0) 4060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:19 smithi179 bash[23186]: cluster 2024-09-20T23:54:18.571879+0000 mgr.a (mgr.14388) 4315 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:19 smithi049 bash[23528]: audit 2024-09-20T23:54:18.438682+0000 mon.a (mon.0) 4058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:19 smithi049 bash[23528]: audit 2024-09-20T23:54:18.447160+0000 mon.a (mon.0) 4059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:19 smithi049 bash[23528]: audit 2024-09-20T23:54:18.457455+0000 mon.a (mon.0) 4060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:19 smithi049 bash[23528]: cluster 2024-09-20T23:54:18.571879+0000 mgr.a (mgr.14388) 4315 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:21 smithi044 bash[22676]: cluster 2024-09-20T23:54:20.573319+0000 mgr.a (mgr.14388) 4316 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:21 smithi179 bash[23186]: cluster 2024-09-20T23:54:20.573319+0000 mgr.a (mgr.14388) 4316 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:21 smithi049 bash[23528]: cluster 2024-09-20T23:54:20.573319+0000 mgr.a (mgr.14388) 4316 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:22.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:22.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:23 smithi044 bash[22676]: audit 2024-09-20T23:54:22.473648+0000 mgr.a (mgr.14388) 4317 : audit [DBG] from='client.103446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:23 smithi044 bash[22676]: cluster 2024-09-20T23:54:22.573789+0000 mgr.a (mgr.14388) 4318 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:23 smithi179 bash[23186]: audit 2024-09-20T23:54:22.473648+0000 mgr.a (mgr.14388) 4317 : audit [DBG] from='client.103446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:23 smithi179 bash[23186]: cluster 2024-09-20T23:54:22.573789+0000 mgr.a (mgr.14388) 4318 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:24.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:23 smithi049 bash[23528]: audit 2024-09-20T23:54:22.473648+0000 mgr.a (mgr.14388) 4317 : audit [DBG] from='client.103446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:24.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:23 smithi049 bash[23528]: cluster 2024-09-20T23:54:22.573789+0000 mgr.a (mgr.14388) 4318 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:25 smithi044 bash[22676]: cluster 2024-09-20T23:54:24.574591+0000 mgr.a (mgr.14388) 4319 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:25 smithi179 bash[23186]: cluster 2024-09-20T23:54:24.574591+0000 mgr.a (mgr.14388) 4319 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:25 smithi049 bash[23528]: cluster 2024-09-20T23:54:24.574591+0000 mgr.a (mgr.14388) 4319 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:27.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:27.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:27.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:27 smithi044 bash[22676]: cluster 2024-09-20T23:54:26.576735+0000 mgr.a (mgr.14388) 4320 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:27 smithi179 bash[23186]: cluster 2024-09-20T23:54:26.576735+0000 mgr.a (mgr.14388) 4320 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:27 smithi049 bash[23528]: cluster 2024-09-20T23:54:26.576735+0000 mgr.a (mgr.14388) 4320 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:28.687 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:29 smithi044 bash[22676]: audit 2024-09-20T23:54:28.234545+0000 mgr.a (mgr.14388) 4321 : audit [DBG] from='client.103524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:29 smithi044 bash[22676]: cluster 2024-09-20T23:54:28.583042+0000 mgr.a (mgr.14388) 4322 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:29 smithi044 bash[22676]: audit 2024-09-20T23:54:29.445527+0000 mon.a (mon.0) 4061 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:29 smithi044 bash[22676]: audit 2024-09-20T23:54:29.453022+0000 mon.a (mon.0) 4062 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:29 smithi044 bash[22676]: audit 2024-09-20T23:54:29.454910+0000 mon.a (mon.0) 4063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:29 smithi044 bash[22676]: audit 2024-09-20T23:54:29.466345+0000 mon.a (mon.0) 4064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:29 smithi044 bash[22676]: audit 2024-09-20T23:54:29.473620+0000 mon.a (mon.0) 4065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:54:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:29 smithi179 bash[23186]: audit 2024-09-20T23:54:28.234545+0000 mgr.a (mgr.14388) 4321 : audit [DBG] from='client.103524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:29 smithi179 bash[23186]: cluster 2024-09-20T23:54:28.583042+0000 mgr.a (mgr.14388) 4322 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:29 smithi179 bash[23186]: audit 2024-09-20T23:54:29.445527+0000 mon.a (mon.0) 4061 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:54:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:29 smithi179 bash[23186]: audit 2024-09-20T23:54:29.453022+0000 mon.a (mon.0) 4062 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:54:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:29 smithi179 bash[23186]: audit 2024-09-20T23:54:29.454910+0000 mon.a (mon.0) 4063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:54:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:29 smithi179 bash[23186]: audit 2024-09-20T23:54:29.466345+0000 mon.a (mon.0) 4064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:29 smithi179 bash[23186]: audit 2024-09-20T23:54:29.473620+0000 mon.a (mon.0) 4065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:54:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:29 smithi049 bash[23528]: audit 2024-09-20T23:54:28.234545+0000 mgr.a (mgr.14388) 4321 : audit [DBG] from='client.103524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:29 smithi049 bash[23528]: cluster 2024-09-20T23:54:28.583042+0000 mgr.a (mgr.14388) 4322 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:29 smithi049 bash[23528]: audit 2024-09-20T23:54:29.445527+0000 mon.a (mon.0) 4061 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:54:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:29 smithi049 bash[23528]: audit 2024-09-20T23:54:29.453022+0000 mon.a (mon.0) 4062 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:54:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:29 smithi049 bash[23528]: audit 2024-09-20T23:54:29.454910+0000 mon.a (mon.0) 4063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:54:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:29 smithi049 bash[23528]: audit 2024-09-20T23:54:29.466345+0000 mon.a (mon.0) 4064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:29 smithi049 bash[23528]: audit 2024-09-20T23:54:29.473620+0000 mon.a (mon.0) 4065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:54:30.646 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:54:30 smithi044 bash[22930]: debug 2024-09-20T23:54:30.251+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:54:30.646 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:54:30 smithi044 bash[22930]: debug 2024-09-20T23:54:30.255+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:54:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:30 smithi044 bash[22676]: audit 2024-09-20T23:54:29.476531+0000 mgr.a (mgr.14388) 4323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:54:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:30 smithi179 bash[23186]: audit 2024-09-20T23:54:29.476531+0000 mgr.a (mgr.14388) 4323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:54:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:30 smithi049 bash[23528]: audit 2024-09-20T23:54:29.476531+0000 mgr.a (mgr.14388) 4323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:54:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:31 smithi044 bash[22676]: audit 2024-09-20T23:54:30.256373+0000 mgr.a (mgr.14388) 4324 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:54:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:31 smithi044 bash[22676]: cephadm 2024-09-20T23:54:30.258035+0000 mgr.a (mgr.14388) 4325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:54:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:31 smithi044 bash[22676]: cluster 2024-09-20T23:54:30.585873+0000 mgr.a (mgr.14388) 4326 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:54:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:31 smithi179 bash[23186]: audit 2024-09-20T23:54:30.256373+0000 mgr.a (mgr.14388) 4324 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:54:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:31 smithi179 bash[23186]: cephadm 2024-09-20T23:54:30.258035+0000 mgr.a (mgr.14388) 4325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:54:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:31 smithi179 bash[23186]: cluster 2024-09-20T23:54:30.585873+0000 mgr.a (mgr.14388) 4326 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:54:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:31 smithi049 bash[23528]: audit 2024-09-20T23:54:30.256373+0000 mgr.a (mgr.14388) 4324 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:54:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:31 smithi049 bash[23528]: cephadm 2024-09-20T23:54:30.258035+0000 mgr.a (mgr.14388) 4325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:54:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:31 smithi049 bash[23528]: cluster 2024-09-20T23:54:30.585873+0000 mgr.a (mgr.14388) 4326 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-20T23:54:33.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:33.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:33.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:33.934 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:33 smithi049 bash[23528]: cluster 2024-09-20T23:54:32.586637+0000 mgr.a (mgr.14388) 4327 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:54:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:33 smithi044 bash[22676]: cluster 2024-09-20T23:54:32.586637+0000 mgr.a (mgr.14388) 4327 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:54:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:33 smithi179 bash[23186]: cluster 2024-09-20T23:54:32.586637+0000 mgr.a (mgr.14388) 4327 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:54:34.450 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:34.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:34.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:34.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:34.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:34.955 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:34 smithi049 bash[23528]: audit 2024-09-20T23:54:34.018260+0000 mgr.a (mgr.14388) 4328 : audit [DBG] from='client.103710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:34 smithi044 bash[22676]: audit 2024-09-20T23:54:34.018260+0000 mgr.a (mgr.14388) 4328 : audit [DBG] from='client.103710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:34 smithi179 bash[23186]: audit 2024-09-20T23:54:34.018260+0000 mgr.a (mgr.14388) 4328 : audit [DBG] from='client.103710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:35 smithi044 bash[22676]: cluster 2024-09-20T23:54:34.587746+0000 mgr.a (mgr.14388) 4329 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:54:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:35 smithi044 bash[22676]: audit 2024-09-20T23:54:35.323734+0000 mon.a (mon.0) 4066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:35 smithi044 bash[22676]: audit 2024-09-20T23:54:35.332419+0000 mon.a (mon.0) 4067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:35 smithi044 bash[22676]: audit 2024-09-20T23:54:35.343142+0000 mon.a (mon.0) 4068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:35 smithi179 bash[23186]: cluster 2024-09-20T23:54:34.587746+0000 mgr.a (mgr.14388) 4329 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:54:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:35 smithi179 bash[23186]: audit 2024-09-20T23:54:35.323734+0000 mon.a (mon.0) 4066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:35 smithi179 bash[23186]: audit 2024-09-20T23:54:35.332419+0000 mon.a (mon.0) 4067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:35 smithi179 bash[23186]: audit 2024-09-20T23:54:35.343142+0000 mon.a (mon.0) 4068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:35 smithi049 bash[23528]: cluster 2024-09-20T23:54:34.587746+0000 mgr.a (mgr.14388) 4329 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-20T23:54:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:35 smithi049 bash[23528]: audit 2024-09-20T23:54:35.323734+0000 mon.a (mon.0) 4066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:35 smithi049 bash[23528]: audit 2024-09-20T23:54:35.332419+0000 mon.a (mon.0) 4067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:35 smithi049 bash[23528]: audit 2024-09-20T23:54:35.343142+0000 mon.a (mon.0) 4068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:37 smithi044 bash[22676]: cluster 2024-09-20T23:54:36.590070+0000 mgr.a (mgr.14388) 4330 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:37 smithi179 bash[23186]: cluster 2024-09-20T23:54:36.590070+0000 mgr.a (mgr.14388) 4330 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:37 smithi049 bash[23528]: cluster 2024-09-20T23:54:36.590070+0000 mgr.a (mgr.14388) 4330 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:38 smithi044 bash[22676]: audit 2024-09-20T23:54:37.740913+0000 mon.a (mon.0) 4069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:38 smithi044 bash[22676]: audit 2024-09-20T23:54:37.749622+0000 mon.a (mon.0) 4070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:38 smithi044 bash[22676]: audit 2024-09-20T23:54:37.759770+0000 mon.a (mon.0) 4071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:38 smithi044 bash[22676]: audit 2024-09-20T23:54:38.616522+0000 mon.a (mon.0) 4072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:38 smithi044 bash[22676]: audit 2024-09-20T23:54:38.622015+0000 mon.a (mon.0) 4073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:38 smithi044 bash[22676]: audit 2024-09-20T23:54:38.628678+0000 mon.a (mon.0) 4074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:38 smithi179 bash[23186]: audit 2024-09-20T23:54:37.740913+0000 mon.a (mon.0) 4069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:38 smithi179 bash[23186]: audit 2024-09-20T23:54:37.749622+0000 mon.a (mon.0) 4070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:38 smithi179 bash[23186]: audit 2024-09-20T23:54:37.759770+0000 mon.a (mon.0) 4071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:38 smithi179 bash[23186]: audit 2024-09-20T23:54:38.616522+0000 mon.a (mon.0) 4072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:38 smithi179 bash[23186]: audit 2024-09-20T23:54:38.622015+0000 mon.a (mon.0) 4073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:38 smithi179 bash[23186]: audit 2024-09-20T23:54:38.628678+0000 mon.a (mon.0) 4074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:38 smithi049 bash[23528]: audit 2024-09-20T23:54:37.740913+0000 mon.a (mon.0) 4069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:38 smithi049 bash[23528]: audit 2024-09-20T23:54:37.749622+0000 mon.a (mon.0) 4070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:38 smithi049 bash[23528]: audit 2024-09-20T23:54:37.759770+0000 mon.a (mon.0) 4071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:38 smithi049 bash[23528]: audit 2024-09-20T23:54:38.616522+0000 mon.a (mon.0) 4072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:38 smithi049 bash[23528]: audit 2024-09-20T23:54:38.622015+0000 mon.a (mon.0) 4073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:38 smithi049 bash[23528]: audit 2024-09-20T23:54:38.628678+0000 mon.a (mon.0) 4074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:39 smithi044 bash[22676]: cluster 2024-09-20T23:54:38.590828+0000 mgr.a (mgr.14388) 4331 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:39 smithi049 bash[23528]: cluster 2024-09-20T23:54:38.590828+0000 mgr.a (mgr.14388) 4331 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:40.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:39 smithi179 bash[23186]: cluster 2024-09-20T23:54:38.590828+0000 mgr.a (mgr.14388) 4331 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:40 smithi044 bash[22676]: audit 2024-09-20T23:54:39.798600+0000 mgr.a (mgr.14388) 4332 : audit [DBG] from='client.103788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:40 smithi049 bash[23528]: audit 2024-09-20T23:54:39.798600+0000 mgr.a (mgr.14388) 4332 : audit [DBG] from='client.103788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:40 smithi179 bash[23186]: audit 2024-09-20T23:54:39.798600+0000 mgr.a (mgr.14388) 4332 : audit [DBG] from='client.103788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:42.035 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:41 smithi044 bash[22676]: cluster 2024-09-20T23:54:40.593561+0000 mgr.a (mgr.14388) 4333 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:41 smithi049 bash[23528]: cluster 2024-09-20T23:54:40.593561+0000 mgr.a (mgr.14388) 4333 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:41 smithi179 bash[23186]: cluster 2024-09-20T23:54:40.593561+0000 mgr.a (mgr.14388) 4333 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:54:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:43 smithi049 bash[23528]: cluster 2024-09-20T23:54:42.594473+0000 mgr.a (mgr.14388) 4334 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:43 smithi044 bash[22676]: cluster 2024-09-20T23:54:42.594473+0000 mgr.a (mgr.14388) 4334 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:43 smithi179 bash[23186]: cluster 2024-09-20T23:54:42.594473+0000 mgr.a (mgr.14388) 4334 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:45.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:45.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:45.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:45.992 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:45 smithi049 bash[23528]: cluster 2024-09-20T23:54:44.595231+0000 mgr.a (mgr.14388) 4335 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:45 smithi044 bash[22676]: cluster 2024-09-20T23:54:44.595231+0000 mgr.a (mgr.14388) 4335 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:45 smithi179 bash[23186]: cluster 2024-09-20T23:54:44.595231+0000 mgr.a (mgr.14388) 4335 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:46 smithi049 bash[23528]: audit 2024-09-20T23:54:45.569916+0000 mgr.a (mgr.14388) 4336 : audit [DBG] from='client.103866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:47.148 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:46 smithi179 bash[23186]: audit 2024-09-20T23:54:45.569916+0000 mgr.a (mgr.14388) 4336 : audit [DBG] from='client.103866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:46 smithi044 bash[22676]: audit 2024-09-20T23:54:45.569916+0000 mgr.a (mgr.14388) 4336 : audit [DBG] from='client.103866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:47 smithi049 bash[23528]: cluster 2024-09-20T23:54:46.598108+0000 mgr.a (mgr.14388) 4337 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:47 smithi044 bash[22676]: cluster 2024-09-20T23:54:46.598108+0000 mgr.a (mgr.14388) 4337 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:47 smithi179 bash[23186]: cluster 2024-09-20T23:54:46.598108+0000 mgr.a (mgr.14388) 4337 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-20T23:54:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:49 smithi049 bash[23528]: cluster 2024-09-20T23:54:48.599063+0000 mgr.a (mgr.14388) 4338 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:49 smithi044 bash[22676]: cluster 2024-09-20T23:54:48.599063+0000 mgr.a (mgr.14388) 4338 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:49 smithi179 bash[23186]: cluster 2024-09-20T23:54:48.599063+0000 mgr.a (mgr.14388) 4338 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:54:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:51.757 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:51 smithi044 bash[22676]: cluster 2024-09-20T23:54:50.601185+0000 mgr.a (mgr.14388) 4339 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:51 smithi179 bash[23186]: cluster 2024-09-20T23:54:50.601185+0000 mgr.a (mgr.14388) 4339 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:51 smithi049 bash[23528]: cluster 2024-09-20T23:54:50.601185+0000 mgr.a (mgr.14388) 4339 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:52 smithi044 bash[22676]: audit 2024-09-20T23:54:51.323389+0000 mgr.a (mgr.14388) 4340 : audit [DBG] from='client.103944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:52 smithi179 bash[23186]: audit 2024-09-20T23:54:51.323389+0000 mgr.a (mgr.14388) 4340 : audit [DBG] from='client.103944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:52 smithi049 bash[23528]: audit 2024-09-20T23:54:51.323389+0000 mgr.a (mgr.14388) 4340 : audit [DBG] from='client.103944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:54.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:53 smithi049 bash[23528]: cluster 2024-09-20T23:54:52.602081+0000 mgr.a (mgr.14388) 4341 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:53 smithi044 bash[22676]: cluster 2024-09-20T23:54:52.602081+0000 mgr.a (mgr.14388) 4341 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:53 smithi179 bash[23186]: cluster 2024-09-20T23:54:52.602081+0000 mgr.a (mgr.14388) 4341 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:56.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:55 smithi049 bash[23528]: cluster 2024-09-20T23:54:54.602868+0000 mgr.a (mgr.14388) 4342 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:56.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:55 smithi049 bash[23528]: audit 2024-09-20T23:54:55.537448+0000 mon.a (mon.0) 4075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:55 smithi049 bash[23528]: audit 2024-09-20T23:54:55.546072+0000 mon.a (mon.0) 4076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:55 smithi049 bash[23528]: audit 2024-09-20T23:54:55.556334+0000 mon.a (mon.0) 4077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:55 smithi044 bash[22676]: cluster 2024-09-20T23:54:54.602868+0000 mgr.a (mgr.14388) 4342 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:55 smithi044 bash[22676]: audit 2024-09-20T23:54:55.537448+0000 mon.a (mon.0) 4075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:55 smithi044 bash[22676]: audit 2024-09-20T23:54:55.546072+0000 mon.a (mon.0) 4076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:55 smithi044 bash[22676]: audit 2024-09-20T23:54:55.556334+0000 mon.a (mon.0) 4077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:55 smithi179 bash[23186]: cluster 2024-09-20T23:54:54.602868+0000 mgr.a (mgr.14388) 4342 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:54:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:55 smithi179 bash[23186]: audit 2024-09-20T23:54:55.537448+0000 mon.a (mon.0) 4075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:55 smithi179 bash[23186]: audit 2024-09-20T23:54:55.546072+0000 mon.a (mon.0) 4076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:55 smithi179 bash[23186]: audit 2024-09-20T23:54:55.556334+0000 mon.a (mon.0) 4077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:56.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:54:56.759 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:54:56.759 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:54:57.542 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:54:57.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:54:57.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:54:57.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:54:57.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:54:58.084 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:57 smithi049 bash[23528]: cluster 2024-09-20T23:54:56.605068+0000 mgr.a (mgr.14388) 4343 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:58.084 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:57 smithi049 bash[23528]: audit 2024-09-20T23:54:57.097110+0000 mgr.a (mgr.14388) 4344 : audit [DBG] from='client.104019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:57 smithi044 bash[22676]: cluster 2024-09-20T23:54:56.605068+0000 mgr.a (mgr.14388) 4343 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:57 smithi044 bash[22676]: audit 2024-09-20T23:54:57.097110+0000 mgr.a (mgr.14388) 4344 : audit [DBG] from='client.104019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:57 smithi179 bash[23186]: cluster 2024-09-20T23:54:56.605068+0000 mgr.a (mgr.14388) 4343 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:54:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:57 smithi179 bash[23186]: audit 2024-09-20T23:54:57.097110+0000 mgr.a (mgr.14388) 4344 : audit [DBG] from='client.104019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:54:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:58 smithi179 bash[23186]: audit 2024-09-20T23:54:57.972269+0000 mon.a (mon.0) 4078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:58 smithi179 bash[23186]: audit 2024-09-20T23:54:57.981159+0000 mon.a (mon.0) 4079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:58 smithi179 bash[23186]: audit 2024-09-20T23:54:57.992132+0000 mon.a (mon.0) 4080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:58 smithi179 bash[23186]: audit 2024-09-20T23:54:58.843277+0000 mon.a (mon.0) 4081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:58 smithi179 bash[23186]: audit 2024-09-20T23:54:58.848982+0000 mon.a (mon.0) 4082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:58 smithi179 bash[23186]: audit 2024-09-20T23:54:58.855486+0000 mon.a (mon.0) 4083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:58 smithi044 bash[22676]: audit 2024-09-20T23:54:57.972269+0000 mon.a (mon.0) 4078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:58 smithi044 bash[22676]: audit 2024-09-20T23:54:57.981159+0000 mon.a (mon.0) 4079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:58 smithi044 bash[22676]: audit 2024-09-20T23:54:57.992132+0000 mon.a (mon.0) 4080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:58 smithi044 bash[22676]: audit 2024-09-20T23:54:58.843277+0000 mon.a (mon.0) 4081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:58 smithi044 bash[22676]: audit 2024-09-20T23:54:58.848982+0000 mon.a (mon.0) 4082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:58 smithi044 bash[22676]: audit 2024-09-20T23:54:58.855486+0000 mon.a (mon.0) 4083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:58 smithi049 bash[23528]: audit 2024-09-20T23:54:57.972269+0000 mon.a (mon.0) 4078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:58 smithi049 bash[23528]: audit 2024-09-20T23:54:57.981159+0000 mon.a (mon.0) 4079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:58 smithi049 bash[23528]: audit 2024-09-20T23:54:57.992132+0000 mon.a (mon.0) 4080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:58 smithi049 bash[23528]: audit 2024-09-20T23:54:58.843277+0000 mon.a (mon.0) 4081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:58 smithi049 bash[23528]: audit 2024-09-20T23:54:58.848982+0000 mon.a (mon.0) 4082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:54:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:58 smithi049 bash[23528]: audit 2024-09-20T23:54:58.855486+0000 mon.a (mon.0) 4083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:54:59 smithi044 bash[22676]: cluster 2024-09-20T23:54:58.605998+0000 mgr.a (mgr.14388) 4345 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:54:59 smithi179 bash[23186]: cluster 2024-09-20T23:54:58.605998+0000 mgr.a (mgr.14388) 4345 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:54:59 smithi049 bash[23528]: cluster 2024-09-20T23:54:58.605998+0000 mgr.a (mgr.14388) 4345 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:01 smithi179 bash[23186]: cluster 2024-09-20T23:55:00.608150+0000 mgr.a (mgr.14388) 4346 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:01 smithi049 bash[23528]: cluster 2024-09-20T23:55:00.608150+0000 mgr.a (mgr.14388) 4346 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:01 smithi044 bash[22676]: cluster 2024-09-20T23:55:00.608150+0000 mgr.a (mgr.14388) 4346 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:02.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:02.544 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:02.544 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:03.306 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:03.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:03.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:03.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:03.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:04 smithi179 bash[23186]: cluster 2024-09-20T23:55:02.608599+0000 mgr.a (mgr.14388) 4347 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:04 smithi179 bash[23186]: audit 2024-09-20T23:55:02.872595+0000 mgr.a (mgr.14388) 4348 : audit [DBG] from='client.104097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:04.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:04 smithi044 bash[22676]: cluster 2024-09-20T23:55:02.608599+0000 mgr.a (mgr.14388) 4347 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:04.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:04 smithi044 bash[22676]: audit 2024-09-20T23:55:02.872595+0000 mgr.a (mgr.14388) 4348 : audit [DBG] from='client.104097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:04 smithi049 bash[23528]: cluster 2024-09-20T23:55:02.608599+0000 mgr.a (mgr.14388) 4347 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:04 smithi049 bash[23528]: audit 2024-09-20T23:55:02.872595+0000 mgr.a (mgr.14388) 4348 : audit [DBG] from='client.104097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:06 smithi049 bash[23528]: cluster 2024-09-20T23:55:04.609536+0000 mgr.a (mgr.14388) 4349 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:06 smithi044 bash[22676]: cluster 2024-09-20T23:55:04.609536+0000 mgr.a (mgr.14388) 4349 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:06 smithi179 bash[23186]: cluster 2024-09-20T23:55:04.609536+0000 mgr.a (mgr.14388) 4349 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:08 smithi049 bash[23528]: cluster 2024-09-20T23:55:06.611891+0000 mgr.a (mgr.14388) 4350 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:08.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:08.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:08.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:08 smithi044 bash[22676]: cluster 2024-09-20T23:55:06.611891+0000 mgr.a (mgr.14388) 4350 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:08 smithi179 bash[23186]: cluster 2024-09-20T23:55:06.611891+0000 mgr.a (mgr.14388) 4350 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:09.056 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:09.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:09.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:09.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:09.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:10 smithi049 bash[23528]: cluster 2024-09-20T23:55:08.612398+0000 mgr.a (mgr.14388) 4351 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:10 smithi049 bash[23528]: audit 2024-09-20T23:55:08.641404+0000 mgr.a (mgr.14388) 4352 : audit [DBG] from='client.104175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:10 smithi044 bash[22676]: cluster 2024-09-20T23:55:08.612398+0000 mgr.a (mgr.14388) 4351 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:10 smithi044 bash[22676]: audit 2024-09-20T23:55:08.641404+0000 mgr.a (mgr.14388) 4352 : audit [DBG] from='client.104175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:10 smithi179 bash[23186]: cluster 2024-09-20T23:55:08.612398+0000 mgr.a (mgr.14388) 4351 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:10 smithi179 bash[23186]: audit 2024-09-20T23:55:08.641404+0000 mgr.a (mgr.14388) 4352 : audit [DBG] from='client.104175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:12 smithi049 bash[23528]: cluster 2024-09-20T23:55:10.614836+0000 mgr.a (mgr.14388) 4353 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:12 smithi044 bash[22676]: cluster 2024-09-20T23:55:10.614836+0000 mgr.a (mgr.14388) 4353 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:12 smithi179 bash[23186]: cluster 2024-09-20T23:55:10.614836+0000 mgr.a (mgr.14388) 4353 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:14.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:14 smithi049 bash[23528]: cluster 2024-09-20T23:55:12.615610+0000 mgr.a (mgr.14388) 4354 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:14 smithi044 bash[22676]: cluster 2024-09-20T23:55:12.615610+0000 mgr.a (mgr.14388) 4354 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:14 smithi179 bash[23186]: cluster 2024-09-20T23:55:12.615610+0000 mgr.a (mgr.14388) 4354 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:14.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:14.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:14.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:14.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:14.841 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:16 smithi049 bash[23528]: audit 2024-09-20T23:55:14.395224+0000 mgr.a (mgr.14388) 4355 : audit [DBG] from='client.104253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:16 smithi049 bash[23528]: cluster 2024-09-20T23:55:14.616198+0000 mgr.a (mgr.14388) 4356 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:16 smithi049 bash[23528]: audit 2024-09-20T23:55:15.689204+0000 mon.a (mon.0) 4084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:16 smithi049 bash[23528]: audit 2024-09-20T23:55:15.699152+0000 mon.a (mon.0) 4085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:16 smithi049 bash[23528]: audit 2024-09-20T23:55:15.710591+0000 mon.a (mon.0) 4086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:16 smithi044 bash[22676]: audit 2024-09-20T23:55:14.395224+0000 mgr.a (mgr.14388) 4355 : audit [DBG] from='client.104253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:16 smithi044 bash[22676]: cluster 2024-09-20T23:55:14.616198+0000 mgr.a (mgr.14388) 4356 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:16 smithi044 bash[22676]: audit 2024-09-20T23:55:15.689204+0000 mon.a (mon.0) 4084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:16 smithi044 bash[22676]: audit 2024-09-20T23:55:15.699152+0000 mon.a (mon.0) 4085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:16 smithi044 bash[22676]: audit 2024-09-20T23:55:15.710591+0000 mon.a (mon.0) 4086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:16 smithi179 bash[23186]: audit 2024-09-20T23:55:14.395224+0000 mgr.a (mgr.14388) 4355 : audit [DBG] from='client.104253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:16 smithi179 bash[23186]: cluster 2024-09-20T23:55:14.616198+0000 mgr.a (mgr.14388) 4356 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:16 smithi179 bash[23186]: audit 2024-09-20T23:55:15.689204+0000 mon.a (mon.0) 4084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:16 smithi179 bash[23186]: audit 2024-09-20T23:55:15.699152+0000 mon.a (mon.0) 4085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:16 smithi179 bash[23186]: audit 2024-09-20T23:55:15.710591+0000 mon.a (mon.0) 4086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:18 smithi049 bash[23528]: cluster 2024-09-20T23:55:16.618594+0000 mgr.a (mgr.14388) 4357 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:18.428 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:18 smithi179 bash[23186]: cluster 2024-09-20T23:55:16.618594+0000 mgr.a (mgr.14388) 4357 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:18 smithi044 bash[22676]: cluster 2024-09-20T23:55:16.618594+0000 mgr.a (mgr.14388) 4357 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:55:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:19 smithi044 bash[22676]: audit 2024-09-20T23:55:18.200340+0000 mon.a (mon.0) 4087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:19 smithi044 bash[22676]: audit 2024-09-20T23:55:18.208525+0000 mon.a (mon.0) 4088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:19 smithi044 bash[22676]: audit 2024-09-20T23:55:18.218851+0000 mon.a (mon.0) 4089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:19 smithi044 bash[22676]: audit 2024-09-20T23:55:19.067453+0000 mon.a (mon.0) 4090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:19 smithi044 bash[22676]: audit 2024-09-20T23:55:19.075272+0000 mon.a (mon.0) 4091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:19 smithi044 bash[22676]: audit 2024-09-20T23:55:19.083711+0000 mon.a (mon.0) 4092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:19 smithi179 bash[23186]: audit 2024-09-20T23:55:18.200340+0000 mon.a (mon.0) 4087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:19 smithi179 bash[23186]: audit 2024-09-20T23:55:18.208525+0000 mon.a (mon.0) 4088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:19 smithi179 bash[23186]: audit 2024-09-20T23:55:18.218851+0000 mon.a (mon.0) 4089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:19 smithi179 bash[23186]: audit 2024-09-20T23:55:19.067453+0000 mon.a (mon.0) 4090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:19 smithi179 bash[23186]: audit 2024-09-20T23:55:19.075272+0000 mon.a (mon.0) 4091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:19 smithi179 bash[23186]: audit 2024-09-20T23:55:19.083711+0000 mon.a (mon.0) 4092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:19 smithi049 bash[23528]: audit 2024-09-20T23:55:18.200340+0000 mon.a (mon.0) 4087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:19 smithi049 bash[23528]: audit 2024-09-20T23:55:18.208525+0000 mon.a (mon.0) 4088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:19 smithi049 bash[23528]: audit 2024-09-20T23:55:18.218851+0000 mon.a (mon.0) 4089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:19 smithi049 bash[23528]: audit 2024-09-20T23:55:19.067453+0000 mon.a (mon.0) 4090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:19 smithi049 bash[23528]: audit 2024-09-20T23:55:19.075272+0000 mon.a (mon.0) 4091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:19 smithi049 bash[23528]: audit 2024-09-20T23:55:19.083711+0000 mon.a (mon.0) 4092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:19.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:19.843 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:19.843 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:20 smithi044 bash[22676]: cluster 2024-09-20T23:55:18.619391+0000 mgr.a (mgr.14388) 4358 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:20 smithi179 bash[23186]: cluster 2024-09-20T23:55:18.619391+0000 mgr.a (mgr.14388) 4358 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:20 smithi049 bash[23528]: cluster 2024-09-20T23:55:18.619391+0000 mgr.a (mgr.14388) 4358 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:20.613 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:20.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:21 smithi044 bash[22676]: audit 2024-09-20T23:55:20.168976+0000 mgr.a (mgr.14388) 4359 : audit [DBG] from='client.104331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:21 smithi179 bash[23186]: audit 2024-09-20T23:55:20.168976+0000 mgr.a (mgr.14388) 4359 : audit [DBG] from='client.104331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:21 smithi049 bash[23528]: audit 2024-09-20T23:55:20.168976+0000 mgr.a (mgr.14388) 4359 : audit [DBG] from='client.104331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:22 smithi044 bash[22676]: cluster 2024-09-20T23:55:20.620954+0000 mgr.a (mgr.14388) 4360 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:22 smithi179 bash[23186]: cluster 2024-09-20T23:55:20.620954+0000 mgr.a (mgr.14388) 4360 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:22 smithi049 bash[23528]: cluster 2024-09-20T23:55:20.620954+0000 mgr.a (mgr.14388) 4360 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:23.477 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:23 smithi044 bash[22676]: cluster 2024-09-20T23:55:22.621581+0000 mgr.a (mgr.14388) 4361 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:55:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:23 smithi179 bash[23186]: cluster 2024-09-20T23:55:22.621581+0000 mgr.a (mgr.14388) 4361 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:55:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:23 smithi049 bash[23528]: cluster 2024-09-20T23:55:22.621581+0000 mgr.a (mgr.14388) 4361 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:55:25.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:25.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:25 smithi044 bash[22676]: cluster 2024-09-20T23:55:24.622309+0000 mgr.a (mgr.14388) 4362 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:55:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:25 smithi179 bash[23186]: cluster 2024-09-20T23:55:24.622309+0000 mgr.a (mgr.14388) 4362 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:55:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:25 smithi049 bash[23528]: cluster 2024-09-20T23:55:24.622309+0000 mgr.a (mgr.14388) 4362 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:55:26.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:26.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:26.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:26.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:26.374 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:26 smithi044 bash[22676]: audit 2024-09-20T23:55:25.952609+0000 mgr.a (mgr.14388) 4363 : audit [DBG] from='client.104409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:26 smithi179 bash[23186]: audit 2024-09-20T23:55:25.952609+0000 mgr.a (mgr.14388) 4363 : audit [DBG] from='client.104409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:26 smithi049 bash[23528]: audit 2024-09-20T23:55:25.952609+0000 mgr.a (mgr.14388) 4363 : audit [DBG] from='client.104409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:27 smithi044 bash[22676]: cluster 2024-09-20T23:55:26.625222+0000 mgr.a (mgr.14388) 4364 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:27 smithi179 bash[23186]: cluster 2024-09-20T23:55:26.625222+0000 mgr.a (mgr.14388) 4364 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:27 smithi049 bash[23528]: cluster 2024-09-20T23:55:26.625222+0000 mgr.a (mgr.14388) 4364 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:29 smithi044 bash[22676]: cluster 2024-09-20T23:55:28.626038+0000 mgr.a (mgr.14388) 4365 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:55:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:29 smithi179 bash[23186]: cluster 2024-09-20T23:55:28.626038+0000 mgr.a (mgr.14388) 4365 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:55:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:29 smithi049 bash[23528]: cluster 2024-09-20T23:55:28.626038+0000 mgr.a (mgr.14388) 4365 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:55:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:30 smithi044 bash[22676]: audit 2024-09-20T23:55:30.331425+0000 mon.a (mon.0) 4093 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:55:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:30 smithi044 bash[22676]: audit 2024-09-20T23:55:30.337716+0000 mon.a (mon.0) 4094 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:55:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:30 smithi044 bash[22676]: audit 2024-09-20T23:55:30.339526+0000 mon.a (mon.0) 4095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:55:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:30 smithi044 bash[22676]: audit 2024-09-20T23:55:30.350998+0000 mon.a (mon.0) 4096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:30 smithi044 bash[22676]: audit 2024-09-20T23:55:30.357351+0000 mon.a (mon.0) 4097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:55:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:30 smithi179 bash[23186]: audit 2024-09-20T23:55:30.331425+0000 mon.a (mon.0) 4093 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:55:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:30 smithi179 bash[23186]: audit 2024-09-20T23:55:30.337716+0000 mon.a (mon.0) 4094 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:55:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:30 smithi179 bash[23186]: audit 2024-09-20T23:55:30.339526+0000 mon.a (mon.0) 4095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:55:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:30 smithi179 bash[23186]: audit 2024-09-20T23:55:30.350998+0000 mon.a (mon.0) 4096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:30 smithi179 bash[23186]: audit 2024-09-20T23:55:30.357351+0000 mon.a (mon.0) 4097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:55:31.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:30 smithi049 bash[23528]: audit 2024-09-20T23:55:30.331425+0000 mon.a (mon.0) 4093 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:55:31.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:30 smithi049 bash[23528]: audit 2024-09-20T23:55:30.337716+0000 mon.a (mon.0) 4094 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:55:31.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:30 smithi049 bash[23528]: audit 2024-09-20T23:55:30.339526+0000 mon.a (mon.0) 4095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:55:31.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:30 smithi049 bash[23528]: audit 2024-09-20T23:55:30.350998+0000 mon.a (mon.0) 4096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:31.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:30 smithi049 bash[23528]: audit 2024-09-20T23:55:30.357351+0000 mon.a (mon.0) 4097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:55:31.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:31.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:31.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:31.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:55:31 smithi044 bash[22930]: debug 2024-09-20T23:55:31.102+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:55:31.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:55:31 smithi044 bash[22930]: debug 2024-09-20T23:55:31.106+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:55:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:31 smithi044 bash[22676]: audit 2024-09-20T23:55:30.359703+0000 mgr.a (mgr.14388) 4366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:55:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:31 smithi044 bash[22676]: cluster 2024-09-20T23:55:30.627439+0000 mgr.a (mgr.14388) 4367 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:31 smithi044 bash[22676]: audit 2024-09-20T23:55:31.109186+0000 mgr.a (mgr.14388) 4368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:55:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:31 smithi044 bash[22676]: cephadm 2024-09-20T23:55:31.110483+0000 mgr.a (mgr.14388) 4369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:55:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:31 smithi179 bash[23186]: audit 2024-09-20T23:55:30.359703+0000 mgr.a (mgr.14388) 4366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:55:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:31 smithi179 bash[23186]: cluster 2024-09-20T23:55:30.627439+0000 mgr.a (mgr.14388) 4367 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:31 smithi179 bash[23186]: audit 2024-09-20T23:55:31.109186+0000 mgr.a (mgr.14388) 4368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:55:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:31 smithi179 bash[23186]: cephadm 2024-09-20T23:55:31.110483+0000 mgr.a (mgr.14388) 4369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:55:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:31 smithi049 bash[23528]: audit 2024-09-20T23:55:30.359703+0000 mgr.a (mgr.14388) 4366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:55:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:31 smithi049 bash[23528]: cluster 2024-09-20T23:55:30.627439+0000 mgr.a (mgr.14388) 4367 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:31 smithi049 bash[23528]: audit 2024-09-20T23:55:31.109186+0000 mgr.a (mgr.14388) 4368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:55:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:31 smithi049 bash[23528]: cephadm 2024-09-20T23:55:31.110483+0000 mgr.a (mgr.14388) 4369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:55:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:32.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:32.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:32.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:32.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:32 smithi044 bash[22676]: audit 2024-09-20T23:55:31.703115+0000 mgr.a (mgr.14388) 4370 : audit [DBG] from='client.104595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:32 smithi179 bash[23186]: audit 2024-09-20T23:55:31.703115+0000 mgr.a (mgr.14388) 4370 : audit [DBG] from='client.104595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:32 smithi049 bash[23528]: audit 2024-09-20T23:55:31.703115+0000 mgr.a (mgr.14388) 4370 : audit [DBG] from='client.104595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:33 smithi044 bash[22676]: cluster 2024-09-20T23:55:32.628547+0000 mgr.a (mgr.14388) 4371 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:33 smithi179 bash[23186]: cluster 2024-09-20T23:55:32.628547+0000 mgr.a (mgr.14388) 4371 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:33 smithi049 bash[23528]: cluster 2024-09-20T23:55:32.628547+0000 mgr.a (mgr.14388) 4371 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:35 smithi044 bash[22676]: cluster 2024-09-20T23:55:34.629416+0000 mgr.a (mgr.14388) 4372 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:35 smithi179 bash[23186]: cluster 2024-09-20T23:55:34.629416+0000 mgr.a (mgr.14388) 4372 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:36.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:35 smithi049 bash[23528]: cluster 2024-09-20T23:55:34.629416+0000 mgr.a (mgr.14388) 4372 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:36 smithi049 bash[23528]: audit 2024-09-20T23:55:35.863594+0000 mon.a (mon.0) 4098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:36 smithi049 bash[23528]: audit 2024-09-20T23:55:35.873516+0000 mon.a (mon.0) 4099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:36 smithi049 bash[23528]: audit 2024-09-20T23:55:35.885409+0000 mon.a (mon.0) 4100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:37.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:37.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:36 smithi044 bash[22676]: audit 2024-09-20T23:55:35.863594+0000 mon.a (mon.0) 4098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:36 smithi044 bash[22676]: audit 2024-09-20T23:55:35.873516+0000 mon.a (mon.0) 4099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:36 smithi044 bash[22676]: audit 2024-09-20T23:55:35.885409+0000 mon.a (mon.0) 4100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:36 smithi179 bash[23186]: audit 2024-09-20T23:55:35.863594+0000 mon.a (mon.0) 4098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:36 smithi179 bash[23186]: audit 2024-09-20T23:55:35.873516+0000 mon.a (mon.0) 4099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:36 smithi179 bash[23186]: audit 2024-09-20T23:55:35.885409+0000 mon.a (mon.0) 4100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:37.886 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:37.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:37.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:37.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:37.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:38.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:37 smithi049 bash[23528]: cluster 2024-09-20T23:55:36.631667+0000 mgr.a (mgr.14388) 4373 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:37 smithi044 bash[22676]: cluster 2024-09-20T23:55:36.631667+0000 mgr.a (mgr.14388) 4373 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:37 smithi179 bash[23186]: cluster 2024-09-20T23:55:36.631667+0000 mgr.a (mgr.14388) 4373 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:38 smithi179 bash[23186]: audit 2024-09-20T23:55:37.459015+0000 mgr.a (mgr.14388) 4374 : audit [DBG] from='client.104670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:38 smithi179 bash[23186]: audit 2024-09-20T23:55:38.397628+0000 mon.a (mon.0) 4101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:38 smithi179 bash[23186]: audit 2024-09-20T23:55:38.407369+0000 mon.a (mon.0) 4102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:38 smithi179 bash[23186]: audit 2024-09-20T23:55:38.419145+0000 mon.a (mon.0) 4103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:38 smithi044 bash[22676]: audit 2024-09-20T23:55:37.459015+0000 mgr.a (mgr.14388) 4374 : audit [DBG] from='client.104670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:38 smithi044 bash[22676]: audit 2024-09-20T23:55:38.397628+0000 mon.a (mon.0) 4101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:38 smithi044 bash[22676]: audit 2024-09-20T23:55:38.407369+0000 mon.a (mon.0) 4102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:38 smithi044 bash[22676]: audit 2024-09-20T23:55:38.419145+0000 mon.a (mon.0) 4103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:38 smithi049 bash[23528]: audit 2024-09-20T23:55:37.459015+0000 mgr.a (mgr.14388) 4374 : audit [DBG] from='client.104670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:38 smithi049 bash[23528]: audit 2024-09-20T23:55:38.397628+0000 mon.a (mon.0) 4101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:38 smithi049 bash[23528]: audit 2024-09-20T23:55:38.407369+0000 mon.a (mon.0) 4102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:38 smithi049 bash[23528]: audit 2024-09-20T23:55:38.419145+0000 mon.a (mon.0) 4103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:39 smithi044 bash[22676]: cluster 2024-09-20T23:55:38.632732+0000 mgr.a (mgr.14388) 4375 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:39 smithi044 bash[22676]: audit 2024-09-20T23:55:39.291895+0000 mon.a (mon.0) 4104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:39 smithi044 bash[22676]: audit 2024-09-20T23:55:39.299348+0000 mon.a (mon.0) 4105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:39 smithi044 bash[22676]: audit 2024-09-20T23:55:39.315438+0000 mon.a (mon.0) 4106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:39 smithi179 bash[23186]: cluster 2024-09-20T23:55:38.632732+0000 mgr.a (mgr.14388) 4375 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:39 smithi179 bash[23186]: audit 2024-09-20T23:55:39.291895+0000 mon.a (mon.0) 4104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:39 smithi179 bash[23186]: audit 2024-09-20T23:55:39.299348+0000 mon.a (mon.0) 4105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:39 smithi179 bash[23186]: audit 2024-09-20T23:55:39.315438+0000 mon.a (mon.0) 4106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:39 smithi049 bash[23528]: cluster 2024-09-20T23:55:38.632732+0000 mgr.a (mgr.14388) 4375 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:39 smithi049 bash[23528]: audit 2024-09-20T23:55:39.291895+0000 mon.a (mon.0) 4104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:39 smithi049 bash[23528]: audit 2024-09-20T23:55:39.299348+0000 mon.a (mon.0) 4105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:39 smithi049 bash[23528]: audit 2024-09-20T23:55:39.315438+0000 mon.a (mon.0) 4106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:41 smithi044 bash[22676]: cluster 2024-09-20T23:55:40.635166+0000 mgr.a (mgr.14388) 4376 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:41 smithi179 bash[23186]: cluster 2024-09-20T23:55:40.635166+0000 mgr.a (mgr.14388) 4376 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:41 smithi049 bash[23528]: cluster 2024-09-20T23:55:40.635166+0000 mgr.a (mgr.14388) 4376 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:42.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:42.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:42.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:43.666 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:43.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:43.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:43.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:43.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:43 smithi044 bash[22676]: cluster 2024-09-20T23:55:42.635741+0000 mgr.a (mgr.14388) 4377 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:43 smithi179 bash[23186]: cluster 2024-09-20T23:55:42.635741+0000 mgr.a (mgr.14388) 4377 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:43 smithi049 bash[23528]: cluster 2024-09-20T23:55:42.635741+0000 mgr.a (mgr.14388) 4377 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:44 smithi044 bash[22676]: audit 2024-09-20T23:55:43.248448+0000 mgr.a (mgr.14388) 4378 : audit [DBG] from='client.104745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:44 smithi179 bash[23186]: audit 2024-09-20T23:55:43.248448+0000 mgr.a (mgr.14388) 4378 : audit [DBG] from='client.104745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:44 smithi049 bash[23528]: audit 2024-09-20T23:55:43.248448+0000 mgr.a (mgr.14388) 4378 : audit [DBG] from='client.104745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:45 smithi044 bash[22676]: cluster 2024-09-20T23:55:44.636728+0000 mgr.a (mgr.14388) 4379 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:45 smithi179 bash[23186]: cluster 2024-09-20T23:55:44.636728+0000 mgr.a (mgr.14388) 4379 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:45 smithi049 bash[23528]: cluster 2024-09-20T23:55:44.636728+0000 mgr.a (mgr.14388) 4379 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:47 smithi044 bash[22676]: cluster 2024-09-20T23:55:46.638993+0000 mgr.a (mgr.14388) 4380 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:47 smithi179 bash[23186]: cluster 2024-09-20T23:55:46.638993+0000 mgr.a (mgr.14388) 4380 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:47 smithi049 bash[23528]: cluster 2024-09-20T23:55:46.638993+0000 mgr.a (mgr.14388) 4380 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:55:48.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:49.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:49.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:49.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:49.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:49.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:49 smithi044 bash[22676]: cluster 2024-09-20T23:55:48.639778+0000 mgr.a (mgr.14388) 4381 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:49 smithi044 bash[22676]: audit 2024-09-20T23:55:49.003253+0000 mgr.a (mgr.14388) 4382 : audit [DBG] from='client.104820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:49 smithi179 bash[23186]: cluster 2024-09-20T23:55:48.639778+0000 mgr.a (mgr.14388) 4381 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:49 smithi179 bash[23186]: audit 2024-09-20T23:55:49.003253+0000 mgr.a (mgr.14388) 4382 : audit [DBG] from='client.104820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:49 smithi049 bash[23528]: cluster 2024-09-20T23:55:48.639778+0000 mgr.a (mgr.14388) 4381 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:55:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:49 smithi049 bash[23528]: audit 2024-09-20T23:55:49.003253+0000 mgr.a (mgr.14388) 4382 : audit [DBG] from='client.104820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:51 smithi044 bash[22676]: cluster 2024-09-20T23:55:50.642191+0000 mgr.a (mgr.14388) 4383 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:55:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:51 smithi179 bash[23186]: cluster 2024-09-20T23:55:50.642191+0000 mgr.a (mgr.14388) 4383 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:55:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:51 smithi049 bash[23528]: cluster 2024-09-20T23:55:50.642191+0000 mgr.a (mgr.14388) 4383 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-20T23:55:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:53 smithi044 bash[22676]: cluster 2024-09-20T23:55:52.642993+0000 mgr.a (mgr.14388) 4384 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:55:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:53 smithi179 bash[23186]: cluster 2024-09-20T23:55:52.642993+0000 mgr.a (mgr.14388) 4384 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:55:54.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:53 smithi049 bash[23528]: cluster 2024-09-20T23:55:52.642993+0000 mgr.a (mgr.14388) 4384 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:55:54.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:55:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:55:54.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:55:55.264 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:55:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:55:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:55:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:55:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:55:56.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:55 smithi049 bash[23528]: cluster 2024-09-20T23:55:54.643662+0000 mgr.a (mgr.14388) 4385 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:55:56.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:55 smithi049 bash[23528]: audit 2024-09-20T23:55:54.806917+0000 mgr.a (mgr.14388) 4386 : audit [DBG] from='client.104898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:55 smithi044 bash[22676]: cluster 2024-09-20T23:55:54.643662+0000 mgr.a (mgr.14388) 4385 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:55:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:55 smithi044 bash[22676]: audit 2024-09-20T23:55:54.806917+0000 mgr.a (mgr.14388) 4386 : audit [DBG] from='client.104898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:55 smithi179 bash[23186]: cluster 2024-09-20T23:55:54.643662+0000 mgr.a (mgr.14388) 4385 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-20T23:55:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:55 smithi179 bash[23186]: audit 2024-09-20T23:55:54.806917+0000 mgr.a (mgr.14388) 4386 : audit [DBG] from='client.104898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:55:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:57 smithi049 bash[23528]: audit 2024-09-20T23:55:56.037547+0000 mon.a (mon.0) 4107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:57 smithi049 bash[23528]: audit 2024-09-20T23:55:56.046336+0000 mon.a (mon.0) 4108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:57 smithi049 bash[23528]: audit 2024-09-20T23:55:56.057025+0000 mon.a (mon.0) 4109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:57 smithi044 bash[22676]: audit 2024-09-20T23:55:56.037547+0000 mon.a (mon.0) 4107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:57 smithi044 bash[22676]: audit 2024-09-20T23:55:56.046336+0000 mon.a (mon.0) 4108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:57 smithi044 bash[22676]: audit 2024-09-20T23:55:56.057025+0000 mon.a (mon.0) 4109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:57 smithi179 bash[23186]: audit 2024-09-20T23:55:56.037547+0000 mon.a (mon.0) 4107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:57 smithi179 bash[23186]: audit 2024-09-20T23:55:56.046336+0000 mon.a (mon.0) 4108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:57 smithi179 bash[23186]: audit 2024-09-20T23:55:56.057025+0000 mon.a (mon.0) 4109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:58.415 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:58 smithi049 bash[23528]: cluster 2024-09-20T23:55:56.646485+0000 mgr.a (mgr.14388) 4387 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-20T23:55:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:58 smithi044 bash[22676]: cluster 2024-09-20T23:55:56.646485+0000 mgr.a (mgr.14388) 4387 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-20T23:55:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:58 smithi179 bash[23186]: cluster 2024-09-20T23:55:56.646485+0000 mgr.a (mgr.14388) 4387 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-20T23:55:59.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:59 smithi044 bash[22676]: audit 2024-09-20T23:55:58.602004+0000 mon.a (mon.0) 4110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:59.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:59 smithi044 bash[22676]: audit 2024-09-20T23:55:58.611066+0000 mon.a (mon.0) 4111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:59.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:59 smithi044 bash[22676]: audit 2024-09-20T23:55:58.623009+0000 mon.a (mon.0) 4112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:59.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:59 smithi044 bash[22676]: cluster 2024-09-20T23:55:58.647255+0000 mgr.a (mgr.14388) 4388 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-20T23:55:59.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:59 smithi044 bash[22676]: audit 2024-09-20T23:55:59.536019+0000 mon.a (mon.0) 4113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:59.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:59 smithi044 bash[22676]: audit 2024-09-20T23:55:59.546278+0000 mon.a (mon.0) 4114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:55:59.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:55:59 smithi044 bash[22676]: audit 2024-09-20T23:55:59.558310+0000 mon.a (mon.0) 4115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:59 smithi179 bash[23186]: audit 2024-09-20T23:55:58.602004+0000 mon.a (mon.0) 4110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:59 smithi179 bash[23186]: audit 2024-09-20T23:55:58.611066+0000 mon.a (mon.0) 4111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:59 smithi179 bash[23186]: audit 2024-09-20T23:55:58.623009+0000 mon.a (mon.0) 4112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:59 smithi179 bash[23186]: cluster 2024-09-20T23:55:58.647255+0000 mgr.a (mgr.14388) 4388 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-20T23:56:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:59 smithi179 bash[23186]: audit 2024-09-20T23:55:59.536019+0000 mon.a (mon.0) 4113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:59 smithi179 bash[23186]: audit 2024-09-20T23:55:59.546278+0000 mon.a (mon.0) 4114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:55:59 smithi179 bash[23186]: audit 2024-09-20T23:55:59.558310+0000 mon.a (mon.0) 4115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:59 smithi049 bash[23528]: audit 2024-09-20T23:55:58.602004+0000 mon.a (mon.0) 4110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:59 smithi049 bash[23528]: audit 2024-09-20T23:55:58.611066+0000 mon.a (mon.0) 4111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:59 smithi049 bash[23528]: audit 2024-09-20T23:55:58.623009+0000 mon.a (mon.0) 4112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:59 smithi049 bash[23528]: cluster 2024-09-20T23:55:58.647255+0000 mgr.a (mgr.14388) 4388 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-20T23:56:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:59 smithi049 bash[23528]: audit 2024-09-20T23:55:59.536019+0000 mon.a (mon.0) 4113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:59 smithi049 bash[23528]: audit 2024-09-20T23:55:59.546278+0000 mon.a (mon.0) 4114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:55:59 smithi049 bash[23528]: audit 2024-09-20T23:55:59.558310+0000 mon.a (mon.0) 4115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:00.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:00.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:00.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:01.066 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:01.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:01 smithi044 bash[22676]: audit 2024-09-20T23:56:00.607124+0000 mgr.a (mgr.14388) 4389 : audit [DBG] from='client.104976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:01 smithi044 bash[22676]: cluster 2024-09-20T23:56:00.649356+0000 mgr.a (mgr.14388) 4390 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-20T23:56:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:01 smithi179 bash[23186]: audit 2024-09-20T23:56:00.607124+0000 mgr.a (mgr.14388) 4389 : audit [DBG] from='client.104976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:01 smithi179 bash[23186]: cluster 2024-09-20T23:56:00.649356+0000 mgr.a (mgr.14388) 4390 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-20T23:56:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:01 smithi049 bash[23528]: audit 2024-09-20T23:56:00.607124+0000 mgr.a (mgr.14388) 4389 : audit [DBG] from='client.104976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:01 smithi049 bash[23528]: cluster 2024-09-20T23:56:00.649356+0000 mgr.a (mgr.14388) 4390 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-20T23:56:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:03 smithi044 bash[22676]: cluster 2024-09-20T23:56:02.650130+0000 mgr.a (mgr.14388) 4391 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:03 smithi179 bash[23186]: cluster 2024-09-20T23:56:02.650130+0000 mgr.a (mgr.14388) 4391 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:03 smithi049 bash[23528]: cluster 2024-09-20T23:56:02.650130+0000 mgr.a (mgr.14388) 4391 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:05 smithi044 bash[22676]: cluster 2024-09-20T23:56:04.650924+0000 mgr.a (mgr.14388) 4392 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:05 smithi179 bash[23186]: cluster 2024-09-20T23:56:04.650924+0000 mgr.a (mgr.14388) 4392 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:05 smithi049 bash[23528]: cluster 2024-09-20T23:56:04.650924+0000 mgr.a (mgr.14388) 4392 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:06.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:06.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:06.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:06.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:06.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:06.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:06.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:06.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:07 smithi044 bash[22676]: audit 2024-09-20T23:56:06.404709+0000 mgr.a (mgr.14388) 4393 : audit [DBG] from='client.105048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:07 smithi044 bash[22676]: cluster 2024-09-20T23:56:06.652262+0000 mgr.a (mgr.14388) 4394 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:07 smithi179 bash[23186]: audit 2024-09-20T23:56:06.404709+0000 mgr.a (mgr.14388) 4393 : audit [DBG] from='client.105048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:07 smithi179 bash[23186]: cluster 2024-09-20T23:56:06.652262+0000 mgr.a (mgr.14388) 4394 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:07 smithi049 bash[23528]: audit 2024-09-20T23:56:06.404709+0000 mgr.a (mgr.14388) 4393 : audit [DBG] from='client.105048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:07 smithi049 bash[23528]: cluster 2024-09-20T23:56:06.652262+0000 mgr.a (mgr.14388) 4394 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-20T23:56:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:09 smithi044 bash[22676]: cluster 2024-09-20T23:56:08.653150+0000 mgr.a (mgr.14388) 4395 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:09 smithi179 bash[23186]: cluster 2024-09-20T23:56:08.653150+0000 mgr.a (mgr.14388) 4395 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:09 smithi049 bash[23528]: cluster 2024-09-20T23:56:08.653150+0000 mgr.a (mgr.14388) 4395 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:11 smithi044 bash[22676]: cluster 2024-09-20T23:56:10.655283+0000 mgr.a (mgr.14388) 4396 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:11 smithi179 bash[23186]: cluster 2024-09-20T23:56:10.655283+0000 mgr.a (mgr.14388) 4396 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:11 smithi049 bash[23528]: cluster 2024-09-20T23:56:10.655283+0000 mgr.a (mgr.14388) 4396 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:12.599 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:12.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:12.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:12.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:12.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:12 smithi044 bash[22676]: audit 2024-09-20T23:56:12.162646+0000 mgr.a (mgr.14388) 4397 : audit [DBG] from='client.105126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:12 smithi179 bash[23186]: audit 2024-09-20T23:56:12.162646+0000 mgr.a (mgr.14388) 4397 : audit [DBG] from='client.105126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:12 smithi049 bash[23528]: audit 2024-09-20T23:56:12.162646+0000 mgr.a (mgr.14388) 4397 : audit [DBG] from='client.105126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:13 smithi179 bash[23186]: cluster 2024-09-20T23:56:12.655869+0000 mgr.a (mgr.14388) 4398 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:13 smithi049 bash[23528]: cluster 2024-09-20T23:56:12.655869+0000 mgr.a (mgr.14388) 4398 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:13 smithi044 bash[22676]: cluster 2024-09-20T23:56:12.655869+0000 mgr.a (mgr.14388) 4398 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:16.001 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:15 smithi049 bash[23528]: cluster 2024-09-20T23:56:14.656604+0000 mgr.a (mgr.14388) 4399 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:15 smithi179 bash[23186]: cluster 2024-09-20T23:56:14.656604+0000 mgr.a (mgr.14388) 4399 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:15 smithi044 bash[22676]: cluster 2024-09-20T23:56:14.656604+0000 mgr.a (mgr.14388) 4399 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:17 smithi044 bash[22676]: audit 2024-09-20T23:56:16.211512+0000 mon.a (mon.0) 4116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:17 smithi044 bash[22676]: audit 2024-09-20T23:56:16.220402+0000 mon.a (mon.0) 4117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:17 smithi044 bash[22676]: audit 2024-09-20T23:56:16.230982+0000 mon.a (mon.0) 4118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:17 smithi179 bash[23186]: audit 2024-09-20T23:56:16.211512+0000 mon.a (mon.0) 4116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:17 smithi179 bash[23186]: audit 2024-09-20T23:56:16.220402+0000 mon.a (mon.0) 4117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:17 smithi179 bash[23186]: audit 2024-09-20T23:56:16.230982+0000 mon.a (mon.0) 4118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:17 smithi049 bash[23528]: audit 2024-09-20T23:56:16.211512+0000 mon.a (mon.0) 4116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:17 smithi049 bash[23528]: audit 2024-09-20T23:56:16.220402+0000 mon.a (mon.0) 4117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:17 smithi049 bash[23528]: audit 2024-09-20T23:56:16.230982+0000 mon.a (mon.0) 4118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:17.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:17.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:17.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:18.381 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:18.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:18.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:18.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:18.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:18 smithi044 bash[22676]: cluster 2024-09-20T23:56:16.658863+0000 mgr.a (mgr.14388) 4400 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:18 smithi179 bash[23186]: cluster 2024-09-20T23:56:16.658863+0000 mgr.a (mgr.14388) 4400 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:18 smithi049 bash[23528]: cluster 2024-09-20T23:56:16.658863+0000 mgr.a (mgr.14388) 4400 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:19 smithi044 bash[22676]: audit 2024-09-20T23:56:17.941855+0000 mgr.a (mgr.14388) 4401 : audit [DBG] from='client.51428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:19 smithi044 bash[22676]: audit 2024-09-20T23:56:18.834506+0000 mon.a (mon.0) 4119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:19 smithi044 bash[22676]: audit 2024-09-20T23:56:18.843394+0000 mon.a (mon.0) 4120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:19 smithi044 bash[22676]: audit 2024-09-20T23:56:18.853807+0000 mon.a (mon.0) 4121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:19 smithi179 bash[23186]: audit 2024-09-20T23:56:17.941855+0000 mgr.a (mgr.14388) 4401 : audit [DBG] from='client.51428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:19 smithi179 bash[23186]: audit 2024-09-20T23:56:18.834506+0000 mon.a (mon.0) 4119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:19 smithi179 bash[23186]: audit 2024-09-20T23:56:18.843394+0000 mon.a (mon.0) 4120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:19 smithi179 bash[23186]: audit 2024-09-20T23:56:18.853807+0000 mon.a (mon.0) 4121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:19 smithi049 bash[23528]: audit 2024-09-20T23:56:17.941855+0000 mgr.a (mgr.14388) 4401 : audit [DBG] from='client.51428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:19 smithi049 bash[23528]: audit 2024-09-20T23:56:18.834506+0000 mon.a (mon.0) 4119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:19 smithi049 bash[23528]: audit 2024-09-20T23:56:18.843394+0000 mon.a (mon.0) 4120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:19 smithi049 bash[23528]: audit 2024-09-20T23:56:18.853807+0000 mon.a (mon.0) 4121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:20 smithi044 bash[22676]: cluster 2024-09-20T23:56:18.659853+0000 mgr.a (mgr.14388) 4402 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:20 smithi044 bash[22676]: audit 2024-09-20T23:56:19.770336+0000 mon.a (mon.0) 4122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:20 smithi044 bash[22676]: audit 2024-09-20T23:56:19.778676+0000 mon.a (mon.0) 4123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:20 smithi044 bash[22676]: audit 2024-09-20T23:56:19.788660+0000 mon.a (mon.0) 4124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:20 smithi179 bash[23186]: cluster 2024-09-20T23:56:18.659853+0000 mgr.a (mgr.14388) 4402 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:20 smithi179 bash[23186]: audit 2024-09-20T23:56:19.770336+0000 mon.a (mon.0) 4122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:20 smithi179 bash[23186]: audit 2024-09-20T23:56:19.778676+0000 mon.a (mon.0) 4123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:20 smithi179 bash[23186]: audit 2024-09-20T23:56:19.788660+0000 mon.a (mon.0) 4124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:20 smithi049 bash[23528]: cluster 2024-09-20T23:56:18.659853+0000 mgr.a (mgr.14388) 4402 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:20 smithi049 bash[23528]: audit 2024-09-20T23:56:19.770336+0000 mon.a (mon.0) 4122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:20 smithi049 bash[23528]: audit 2024-09-20T23:56:19.778676+0000 mon.a (mon.0) 4123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:20 smithi049 bash[23528]: audit 2024-09-20T23:56:19.788660+0000 mon.a (mon.0) 4124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:22 smithi044 bash[22676]: cluster 2024-09-20T23:56:20.662126+0000 mgr.a (mgr.14388) 4403 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:22 smithi179 bash[23186]: cluster 2024-09-20T23:56:20.662126+0000 mgr.a (mgr.14388) 4403 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:22 smithi049 bash[23528]: cluster 2024-09-20T23:56:20.662126+0000 mgr.a (mgr.14388) 4403 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:23.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:23.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:23 smithi049 bash[23528]: cluster 2024-09-20T23:56:22.662838+0000 mgr.a (mgr.14388) 4404 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:23 smithi044 bash[22676]: cluster 2024-09-20T23:56:22.662838+0000 mgr.a (mgr.14388) 4404 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:23 smithi179 bash[23186]: cluster 2024-09-20T23:56:22.662838+0000 mgr.a (mgr.14388) 4404 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:24.164 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:24.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:24.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:24.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:24.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:24 smithi049 bash[23528]: audit 2024-09-20T23:56:23.715296+0000 mgr.a (mgr.14388) 4405 : audit [DBG] from='client.105276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:24 smithi044 bash[22676]: audit 2024-09-20T23:56:23.715296+0000 mgr.a (mgr.14388) 4405 : audit [DBG] from='client.105276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:24 smithi179 bash[23186]: audit 2024-09-20T23:56:23.715296+0000 mgr.a (mgr.14388) 4405 : audit [DBG] from='client.105276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:25 smithi049 bash[23528]: cluster 2024-09-20T23:56:24.663786+0000 mgr.a (mgr.14388) 4406 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:25 smithi044 bash[22676]: cluster 2024-09-20T23:56:24.663786+0000 mgr.a (mgr.14388) 4406 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:25 smithi179 bash[23186]: cluster 2024-09-20T23:56:24.663786+0000 mgr.a (mgr.14388) 4406 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:27 smithi044 bash[22676]: cluster 2024-09-20T23:56:26.666074+0000 mgr.a (mgr.14388) 4407 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:27 smithi179 bash[23186]: cluster 2024-09-20T23:56:26.666074+0000 mgr.a (mgr.14388) 4407 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:27 smithi049 bash[23528]: cluster 2024-09-20T23:56:26.666074+0000 mgr.a (mgr.14388) 4407 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:29.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:29.166 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:29.166 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:29 smithi044 bash[22676]: cluster 2024-09-20T23:56:28.666836+0000 mgr.a (mgr.14388) 4408 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:29 smithi179 bash[23186]: cluster 2024-09-20T23:56:28.666836+0000 mgr.a (mgr.14388) 4408 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:29 smithi049 bash[23528]: cluster 2024-09-20T23:56:28.666836+0000 mgr.a (mgr.14388) 4408 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:30 smithi044 bash[22676]: audit 2024-09-20T23:56:29.502346+0000 mgr.a (mgr.14388) 4409 : audit [DBG] from='client.105351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:30 smithi179 bash[23186]: audit 2024-09-20T23:56:29.502346+0000 mgr.a (mgr.14388) 4409 : audit [DBG] from='client.105351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:30 smithi049 bash[23528]: audit 2024-09-20T23:56:29.502346+0000 mgr.a (mgr.14388) 4409 : audit [DBG] from='client.105351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:31.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22930]: debug 2024-09-20T23:56:31.949+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:56:31.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22930]: debug 2024-09-20T23:56:31.949+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:56:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22676]: cluster 2024-09-20T23:56:30.669277+0000 mgr.a (mgr.14388) 4410 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22676]: audit 2024-09-20T23:56:31.163455+0000 mon.a (mon.0) 4125 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:56:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22676]: audit 2024-09-20T23:56:31.170435+0000 mon.a (mon.0) 4126 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:56:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22676]: audit 2024-09-20T23:56:31.172314+0000 mon.a (mon.0) 4127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:56:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22676]: audit 2024-09-20T23:56:31.183566+0000 mon.a (mon.0) 4128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22676]: audit 2024-09-20T23:56:31.189919+0000 mon.a (mon.0) 4129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:56:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:31 smithi044 bash[22676]: audit 2024-09-20T23:56:31.192521+0000 mgr.a (mgr.14388) 4411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:56:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:31 smithi179 bash[23186]: cluster 2024-09-20T23:56:30.669277+0000 mgr.a (mgr.14388) 4410 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:31 smithi179 bash[23186]: audit 2024-09-20T23:56:31.163455+0000 mon.a (mon.0) 4125 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:56:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:31 smithi179 bash[23186]: audit 2024-09-20T23:56:31.170435+0000 mon.a (mon.0) 4126 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:56:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:31 smithi179 bash[23186]: audit 2024-09-20T23:56:31.172314+0000 mon.a (mon.0) 4127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:56:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:31 smithi179 bash[23186]: audit 2024-09-20T23:56:31.183566+0000 mon.a (mon.0) 4128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:31 smithi179 bash[23186]: audit 2024-09-20T23:56:31.189919+0000 mon.a (mon.0) 4129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:56:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:31 smithi179 bash[23186]: audit 2024-09-20T23:56:31.192521+0000 mgr.a (mgr.14388) 4411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:56:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:31 smithi049 bash[23528]: cluster 2024-09-20T23:56:30.669277+0000 mgr.a (mgr.14388) 4410 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:31 smithi049 bash[23528]: audit 2024-09-20T23:56:31.163455+0000 mon.a (mon.0) 4125 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:56:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:31 smithi049 bash[23528]: audit 2024-09-20T23:56:31.170435+0000 mon.a (mon.0) 4126 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:56:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:31 smithi049 bash[23528]: audit 2024-09-20T23:56:31.172314+0000 mon.a (mon.0) 4127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:56:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:31 smithi049 bash[23528]: audit 2024-09-20T23:56:31.183566+0000 mon.a (mon.0) 4128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:31 smithi049 bash[23528]: audit 2024-09-20T23:56:31.189919+0000 mon.a (mon.0) 4129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:56:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:31 smithi049 bash[23528]: audit 2024-09-20T23:56:31.192521+0000 mgr.a (mgr.14388) 4411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:56:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:32 smithi179 bash[23186]: audit 2024-09-20T23:56:31.953710+0000 mgr.a (mgr.14388) 4412 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:56:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:32 smithi179 bash[23186]: cephadm 2024-09-20T23:56:31.954975+0000 mgr.a (mgr.14388) 4413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:56:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:32 smithi049 bash[23528]: audit 2024-09-20T23:56:31.953710+0000 mgr.a (mgr.14388) 4412 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:56:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:32 smithi049 bash[23528]: cephadm 2024-09-20T23:56:31.954975+0000 mgr.a (mgr.14388) 4413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:56:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:32 smithi044 bash[22676]: audit 2024-09-20T23:56:31.953710+0000 mgr.a (mgr.14388) 4412 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:56:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:32 smithi044 bash[22676]: cephadm 2024-09-20T23:56:31.954975+0000 mgr.a (mgr.14388) 4413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:56:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:33 smithi179 bash[23186]: cluster 2024-09-20T23:56:32.670263+0000 mgr.a (mgr.14388) 4414 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:33 smithi049 bash[23528]: cluster 2024-09-20T23:56:32.670263+0000 mgr.a (mgr.14388) 4414 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:33 smithi044 bash[22676]: cluster 2024-09-20T23:56:32.670263+0000 mgr.a (mgr.14388) 4414 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:34.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:34.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:34.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:35.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:35.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:36.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:35 smithi179 bash[23186]: cluster 2024-09-20T23:56:34.671051+0000 mgr.a (mgr.14388) 4415 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:36.023 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:35 smithi049 bash[23528]: cluster 2024-09-20T23:56:34.671051+0000 mgr.a (mgr.14388) 4415 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:35 smithi044 bash[22676]: cluster 2024-09-20T23:56:34.671051+0000 mgr.a (mgr.14388) 4415 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:36 smithi179 bash[23186]: audit 2024-09-20T23:56:35.294920+0000 mgr.a (mgr.14388) 4416 : audit [DBG] from='client.105537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:36 smithi179 bash[23186]: audit 2024-09-20T23:56:36.399384+0000 mon.a (mon.0) 4130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:36 smithi179 bash[23186]: audit 2024-09-20T23:56:36.408465+0000 mon.a (mon.0) 4131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:36 smithi179 bash[23186]: audit 2024-09-20T23:56:36.419508+0000 mon.a (mon.0) 4132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:36 smithi049 bash[23528]: audit 2024-09-20T23:56:35.294920+0000 mgr.a (mgr.14388) 4416 : audit [DBG] from='client.105537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:36 smithi049 bash[23528]: audit 2024-09-20T23:56:36.399384+0000 mon.a (mon.0) 4130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:36 smithi049 bash[23528]: audit 2024-09-20T23:56:36.408465+0000 mon.a (mon.0) 4131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:36 smithi049 bash[23528]: audit 2024-09-20T23:56:36.419508+0000 mon.a (mon.0) 4132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:36 smithi044 bash[22676]: audit 2024-09-20T23:56:35.294920+0000 mgr.a (mgr.14388) 4416 : audit [DBG] from='client.105537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:36 smithi044 bash[22676]: audit 2024-09-20T23:56:36.399384+0000 mon.a (mon.0) 4130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:36 smithi044 bash[22676]: audit 2024-09-20T23:56:36.408465+0000 mon.a (mon.0) 4131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:36 smithi044 bash[22676]: audit 2024-09-20T23:56:36.419508+0000 mon.a (mon.0) 4132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:37 smithi049 bash[23528]: cluster 2024-09-20T23:56:36.673903+0000 mgr.a (mgr.14388) 4417 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:38.097 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:37 smithi179 bash[23186]: cluster 2024-09-20T23:56:36.673903+0000 mgr.a (mgr.14388) 4417 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:37 smithi044 bash[22676]: cluster 2024-09-20T23:56:36.673903+0000 mgr.a (mgr.14388) 4417 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:40 smithi179 bash[23186]: cluster 2024-09-20T23:56:38.674681+0000 mgr.a (mgr.14388) 4418 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:40 smithi179 bash[23186]: audit 2024-09-20T23:56:39.064533+0000 mon.a (mon.0) 4133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:40 smithi179 bash[23186]: audit 2024-09-20T23:56:39.074329+0000 mon.a (mon.0) 4134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:40 smithi179 bash[23186]: audit 2024-09-20T23:56:39.085761+0000 mon.a (mon.0) 4135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:40 smithi179 bash[23186]: audit 2024-09-20T23:56:40.009072+0000 mon.a (mon.0) 4136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:40 smithi179 bash[23186]: audit 2024-09-20T23:56:40.018997+0000 mon.a (mon.0) 4137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:40 smithi179 bash[23186]: audit 2024-09-20T23:56:40.029430+0000 mon.a (mon.0) 4138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:40 smithi044 bash[22676]: cluster 2024-09-20T23:56:38.674681+0000 mgr.a (mgr.14388) 4418 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:40 smithi044 bash[22676]: audit 2024-09-20T23:56:39.064533+0000 mon.a (mon.0) 4133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:40 smithi044 bash[22676]: audit 2024-09-20T23:56:39.074329+0000 mon.a (mon.0) 4134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:40 smithi044 bash[22676]: audit 2024-09-20T23:56:39.085761+0000 mon.a (mon.0) 4135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:40 smithi044 bash[22676]: audit 2024-09-20T23:56:40.009072+0000 mon.a (mon.0) 4136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:40 smithi044 bash[22676]: audit 2024-09-20T23:56:40.018997+0000 mon.a (mon.0) 4137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:40 smithi044 bash[22676]: audit 2024-09-20T23:56:40.029430+0000 mon.a (mon.0) 4138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:40 smithi049 bash[23528]: cluster 2024-09-20T23:56:38.674681+0000 mgr.a (mgr.14388) 4418 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:40 smithi049 bash[23528]: audit 2024-09-20T23:56:39.064533+0000 mon.a (mon.0) 4133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:40 smithi049 bash[23528]: audit 2024-09-20T23:56:39.074329+0000 mon.a (mon.0) 4134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:40 smithi049 bash[23528]: audit 2024-09-20T23:56:39.085761+0000 mon.a (mon.0) 4135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:40 smithi049 bash[23528]: audit 2024-09-20T23:56:40.009072+0000 mon.a (mon.0) 4136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:40 smithi049 bash[23528]: audit 2024-09-20T23:56:40.018997+0000 mon.a (mon.0) 4137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:40 smithi049 bash[23528]: audit 2024-09-20T23:56:40.029430+0000 mon.a (mon.0) 4138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:40.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:41.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:41.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:41.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:41.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:41.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:42 smithi044 bash[22676]: cluster 2024-09-20T23:56:40.676683+0000 mgr.a (mgr.14388) 4419 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:42 smithi044 bash[22676]: audit 2024-09-20T23:56:41.086370+0000 mgr.a (mgr.14388) 4420 : audit [DBG] from='client.105609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:42 smithi179 bash[23186]: cluster 2024-09-20T23:56:40.676683+0000 mgr.a (mgr.14388) 4419 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:42 smithi179 bash[23186]: audit 2024-09-20T23:56:41.086370+0000 mgr.a (mgr.14388) 4420 : audit [DBG] from='client.105609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:42 smithi049 bash[23528]: cluster 2024-09-20T23:56:40.676683+0000 mgr.a (mgr.14388) 4419 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:42 smithi049 bash[23528]: audit 2024-09-20T23:56:41.086370+0000 mgr.a (mgr.14388) 4420 : audit [DBG] from='client.105609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:44 smithi044 bash[22676]: cluster 2024-09-20T23:56:42.677735+0000 mgr.a (mgr.14388) 4421 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:44 smithi179 bash[23186]: cluster 2024-09-20T23:56:42.677735+0000 mgr.a (mgr.14388) 4421 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:44 smithi049 bash[23528]: cluster 2024-09-20T23:56:42.677735+0000 mgr.a (mgr.14388) 4421 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:46 smithi044 bash[22676]: cluster 2024-09-20T23:56:44.678699+0000 mgr.a (mgr.14388) 4422 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:46 smithi179 bash[23186]: cluster 2024-09-20T23:56:44.678699+0000 mgr.a (mgr.14388) 4422 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:46.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:46.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:46.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:46 smithi049 bash[23528]: cluster 2024-09-20T23:56:44.678699+0000 mgr.a (mgr.14388) 4422 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:56:47.285 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:47.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:47.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:47.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:47.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:47 smithi044 bash[22676]: cluster 2024-09-20T23:56:46.680897+0000 mgr.a (mgr.14388) 4423 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:47 smithi044 bash[22676]: audit 2024-09-20T23:56:46.840732+0000 mgr.a (mgr.14388) 4424 : audit [DBG] from='client.105684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:47 smithi179 bash[23186]: cluster 2024-09-20T23:56:46.680897+0000 mgr.a (mgr.14388) 4423 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:47 smithi179 bash[23186]: audit 2024-09-20T23:56:46.840732+0000 mgr.a (mgr.14388) 4424 : audit [DBG] from='client.105684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:47 smithi049 bash[23528]: cluster 2024-09-20T23:56:46.680897+0000 mgr.a (mgr.14388) 4423 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:56:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:47 smithi049 bash[23528]: audit 2024-09-20T23:56:46.840732+0000 mgr.a (mgr.14388) 4424 : audit [DBG] from='client.105684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:49 smithi179 bash[23186]: cluster 2024-09-20T23:56:48.681804+0000 mgr.a (mgr.14388) 4425 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:49 smithi049 bash[23528]: cluster 2024-09-20T23:56:48.681804+0000 mgr.a (mgr.14388) 4425 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:49 smithi044 bash[22676]: cluster 2024-09-20T23:56:48.681804+0000 mgr.a (mgr.14388) 4425 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:51 smithi179 bash[23186]: cluster 2024-09-20T23:56:50.683997+0000 mgr.a (mgr.14388) 4426 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:51 smithi049 bash[23528]: cluster 2024-09-20T23:56:50.683997+0000 mgr.a (mgr.14388) 4426 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:51 smithi044 bash[22676]: cluster 2024-09-20T23:56:50.683997+0000 mgr.a (mgr.14388) 4426 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:52.287 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:53.071 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:56:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:53 smithi179 bash[23186]: audit 2024-09-20T23:56:52.620003+0000 mgr.a (mgr.14388) 4427 : audit [DBG] from='client.105762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:53 smithi179 bash[23186]: cluster 2024-09-20T23:56:52.684564+0000 mgr.a (mgr.14388) 4428 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:53 smithi049 bash[23528]: audit 2024-09-20T23:56:52.620003+0000 mgr.a (mgr.14388) 4427 : audit [DBG] from='client.105762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:53 smithi049 bash[23528]: cluster 2024-09-20T23:56:52.684564+0000 mgr.a (mgr.14388) 4428 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:53 smithi044 bash[22676]: audit 2024-09-20T23:56:52.620003+0000 mgr.a (mgr.14388) 4427 : audit [DBG] from='client.105762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:56:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:53 smithi044 bash[22676]: cluster 2024-09-20T23:56:52.684564+0000 mgr.a (mgr.14388) 4428 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:55 smithi049 bash[23528]: cluster 2024-09-20T23:56:54.685459+0000 mgr.a (mgr.14388) 4429 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:55 smithi044 bash[22676]: cluster 2024-09-20T23:56:54.685459+0000 mgr.a (mgr.14388) 4429 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:55 smithi179 bash[23186]: cluster 2024-09-20T23:56:54.685459+0000 mgr.a (mgr.14388) 4429 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:56:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:57 smithi049 bash[23528]: audit 2024-09-20T23:56:56.549731+0000 mon.a (mon.0) 4139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:57 smithi049 bash[23528]: audit 2024-09-20T23:56:56.559609+0000 mon.a (mon.0) 4140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:57 smithi049 bash[23528]: audit 2024-09-20T23:56:56.571112+0000 mon.a (mon.0) 4141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:56:57 smithi049 bash[23528]: cluster 2024-09-20T23:56:56.687713+0000 mgr.a (mgr.14388) 4430 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:57 smithi044 bash[22676]: audit 2024-09-20T23:56:56.549731+0000 mon.a (mon.0) 4139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:57 smithi044 bash[22676]: audit 2024-09-20T23:56:56.559609+0000 mon.a (mon.0) 4140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:57 smithi044 bash[22676]: audit 2024-09-20T23:56:56.571112+0000 mon.a (mon.0) 4141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:56:57 smithi044 bash[22676]: cluster 2024-09-20T23:56:56.687713+0000 mgr.a (mgr.14388) 4430 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:57 smithi179 bash[23186]: audit 2024-09-20T23:56:56.549731+0000 mon.a (mon.0) 4139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:57 smithi179 bash[23186]: audit 2024-09-20T23:56:56.559609+0000 mon.a (mon.0) 4140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:57 smithi179 bash[23186]: audit 2024-09-20T23:56:56.571112+0000 mon.a (mon.0) 4141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:56:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:56:57 smithi179 bash[23186]: cluster 2024-09-20T23:56:56.687713+0000 mgr.a (mgr.14388) 4430 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:56:58.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:56:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:56:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:56:58.867 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:56:58.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:56:58.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:56:58.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:56:58.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:00 smithi044 bash[22676]: audit 2024-09-20T23:56:58.413908+0000 mgr.a (mgr.14388) 4431 : audit [DBG] from='client.105837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:00 smithi044 bash[22676]: cluster 2024-09-20T23:56:58.688454+0000 mgr.a (mgr.14388) 4432 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:00 smithi044 bash[22676]: audit 2024-09-20T23:56:59.216274+0000 mon.a (mon.0) 4142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:00 smithi044 bash[22676]: audit 2024-09-20T23:56:59.224870+0000 mon.a (mon.0) 4143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:00 smithi044 bash[22676]: audit 2024-09-20T23:56:59.235231+0000 mon.a (mon.0) 4144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:00 smithi179 bash[23186]: audit 2024-09-20T23:56:58.413908+0000 mgr.a (mgr.14388) 4431 : audit [DBG] from='client.105837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:00 smithi179 bash[23186]: cluster 2024-09-20T23:56:58.688454+0000 mgr.a (mgr.14388) 4432 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:00 smithi179 bash[23186]: audit 2024-09-20T23:56:59.216274+0000 mon.a (mon.0) 4142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:00 smithi179 bash[23186]: audit 2024-09-20T23:56:59.224870+0000 mon.a (mon.0) 4143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:00 smithi179 bash[23186]: audit 2024-09-20T23:56:59.235231+0000 mon.a (mon.0) 4144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:00 smithi049 bash[23528]: audit 2024-09-20T23:56:58.413908+0000 mgr.a (mgr.14388) 4431 : audit [DBG] from='client.105837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:00 smithi049 bash[23528]: cluster 2024-09-20T23:56:58.688454+0000 mgr.a (mgr.14388) 4432 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:00 smithi049 bash[23528]: audit 2024-09-20T23:56:59.216274+0000 mon.a (mon.0) 4142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:00 smithi049 bash[23528]: audit 2024-09-20T23:56:59.224870+0000 mon.a (mon.0) 4143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:00 smithi049 bash[23528]: audit 2024-09-20T23:56:59.235231+0000 mon.a (mon.0) 4144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:01 smithi044 bash[22676]: audit 2024-09-20T23:57:00.235322+0000 mon.a (mon.0) 4145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:01 smithi044 bash[22676]: audit 2024-09-20T23:57:00.240815+0000 mon.a (mon.0) 4146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:01 smithi044 bash[22676]: audit 2024-09-20T23:57:00.249035+0000 mon.a (mon.0) 4147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:01 smithi044 bash[22676]: cluster 2024-09-20T23:57:00.690794+0000 mgr.a (mgr.14388) 4433 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:01.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:01 smithi179 bash[23186]: audit 2024-09-20T23:57:00.235322+0000 mon.a (mon.0) 4145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.500 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:01 smithi179 bash[23186]: audit 2024-09-20T23:57:00.240815+0000 mon.a (mon.0) 4146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:01 smithi179 bash[23186]: audit 2024-09-20T23:57:00.249035+0000 mon.a (mon.0) 4147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:01 smithi179 bash[23186]: cluster 2024-09-20T23:57:00.690794+0000 mgr.a (mgr.14388) 4433 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:01 smithi049 bash[23528]: audit 2024-09-20T23:57:00.235322+0000 mon.a (mon.0) 4145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:01 smithi049 bash[23528]: audit 2024-09-20T23:57:00.240815+0000 mon.a (mon.0) 4146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:01 smithi049 bash[23528]: audit 2024-09-20T23:57:00.249035+0000 mon.a (mon.0) 4147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:01 smithi049 bash[23528]: cluster 2024-09-20T23:57:00.690794+0000 mgr.a (mgr.14388) 4433 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:03.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:03.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:03.870 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:03 smithi179 bash[23186]: cluster 2024-09-20T23:57:02.691555+0000 mgr.a (mgr.14388) 4434 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:03 smithi049 bash[23528]: cluster 2024-09-20T23:57:02.691555+0000 mgr.a (mgr.14388) 4434 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:04.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:03 smithi044 bash[22676]: cluster 2024-09-20T23:57:02.691555+0000 mgr.a (mgr.14388) 4434 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:04.650 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:04.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:04.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:04.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:04.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:05.006 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:04 smithi044 bash[22676]: audit 2024-09-20T23:57:04.209983+0000 mgr.a (mgr.14388) 4435 : audit [DBG] from='client.105909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:05.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:04 smithi049 bash[23528]: audit 2024-09-20T23:57:04.209983+0000 mgr.a (mgr.14388) 4435 : audit [DBG] from='client.105909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:04 smithi179 bash[23186]: audit 2024-09-20T23:57:04.209983+0000 mgr.a (mgr.14388) 4435 : audit [DBG] from='client.105909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:06.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:05 smithi044 bash[22676]: cluster 2024-09-20T23:57:04.692229+0000 mgr.a (mgr.14388) 4436 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:05 smithi049 bash[23528]: cluster 2024-09-20T23:57:04.692229+0000 mgr.a (mgr.14388) 4436 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:05 smithi179 bash[23186]: cluster 2024-09-20T23:57:04.692229+0000 mgr.a (mgr.14388) 4436 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:07 smithi049 bash[23528]: cluster 2024-09-20T23:57:06.694485+0000 mgr.a (mgr.14388) 4437 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:07 smithi044 bash[22676]: cluster 2024-09-20T23:57:06.694485+0000 mgr.a (mgr.14388) 4437 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:07 smithi179 bash[23186]: cluster 2024-09-20T23:57:06.694485+0000 mgr.a (mgr.14388) 4437 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:09.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:09.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:09.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:09 smithi049 bash[23528]: cluster 2024-09-20T23:57:08.695262+0000 mgr.a (mgr.14388) 4438 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:09 smithi044 bash[22676]: cluster 2024-09-20T23:57:08.695262+0000 mgr.a (mgr.14388) 4438 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:09 smithi179 bash[23186]: cluster 2024-09-20T23:57:08.695262+0000 mgr.a (mgr.14388) 4438 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:10.426 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:10.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:10 smithi049 bash[23528]: audit 2024-09-20T23:57:09.989088+0000 mgr.a (mgr.14388) 4439 : audit [DBG] from='client.105978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:10 smithi044 bash[22676]: audit 2024-09-20T23:57:09.989088+0000 mgr.a (mgr.14388) 4439 : audit [DBG] from='client.105978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:10 smithi179 bash[23186]: audit 2024-09-20T23:57:09.989088+0000 mgr.a (mgr.14388) 4439 : audit [DBG] from='client.105978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:11 smithi049 bash[23528]: cluster 2024-09-20T23:57:10.698059+0000 mgr.a (mgr.14388) 4440 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:11 smithi044 bash[22676]: cluster 2024-09-20T23:57:10.698059+0000 mgr.a (mgr.14388) 4440 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:11 smithi179 bash[23186]: cluster 2024-09-20T23:57:10.698059+0000 mgr.a (mgr.14388) 4440 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:13 smithi049 bash[23528]: cluster 2024-09-20T23:57:12.698844+0000 mgr.a (mgr.14388) 4441 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:57:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:13 smithi044 bash[22676]: cluster 2024-09-20T23:57:12.698844+0000 mgr.a (mgr.14388) 4441 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:57:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:13 smithi179 bash[23186]: cluster 2024-09-20T23:57:12.698844+0000 mgr.a (mgr.14388) 4441 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:57:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:15 smithi049 bash[23528]: cluster 2024-09-20T23:57:14.699628+0000 mgr.a (mgr.14388) 4442 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:16.219 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:15 smithi044 bash[22676]: cluster 2024-09-20T23:57:14.699628+0000 mgr.a (mgr.14388) 4442 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:15 smithi179 bash[23186]: cluster 2024-09-20T23:57:14.699628+0000 mgr.a (mgr.14388) 4442 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:16 smithi049 bash[23528]: audit 2024-09-20T23:57:15.768664+0000 mgr.a (mgr.14388) 4443 : audit [DBG] from='client.106056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:16 smithi049 bash[23528]: audit 2024-09-20T23:57:16.720993+0000 mon.a (mon.0) 4148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:16 smithi049 bash[23528]: audit 2024-09-20T23:57:16.730972+0000 mon.a (mon.0) 4149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:16 smithi049 bash[23528]: audit 2024-09-20T23:57:16.742763+0000 mon.a (mon.0) 4150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:16 smithi044 bash[22676]: audit 2024-09-20T23:57:15.768664+0000 mgr.a (mgr.14388) 4443 : audit [DBG] from='client.106056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:16 smithi044 bash[22676]: audit 2024-09-20T23:57:16.720993+0000 mon.a (mon.0) 4148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:16 smithi044 bash[22676]: audit 2024-09-20T23:57:16.730972+0000 mon.a (mon.0) 4149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:16 smithi044 bash[22676]: audit 2024-09-20T23:57:16.742763+0000 mon.a (mon.0) 4150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:16 smithi179 bash[23186]: audit 2024-09-20T23:57:15.768664+0000 mgr.a (mgr.14388) 4443 : audit [DBG] from='client.106056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:16 smithi179 bash[23186]: audit 2024-09-20T23:57:16.720993+0000 mon.a (mon.0) 4148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:16 smithi179 bash[23186]: audit 2024-09-20T23:57:16.730972+0000 mon.a (mon.0) 4149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:16 smithi179 bash[23186]: audit 2024-09-20T23:57:16.742763+0000 mon.a (mon.0) 4150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:17 smithi049 bash[23528]: cluster 2024-09-20T23:57:16.702513+0000 mgr.a (mgr.14388) 4444 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:18.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:17 smithi179 bash[23186]: cluster 2024-09-20T23:57:16.702513+0000 mgr.a (mgr.14388) 4444 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:17 smithi044 bash[22676]: cluster 2024-09-20T23:57:16.702513+0000 mgr.a (mgr.14388) 4444 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:19 smithi044 bash[22676]: cluster 2024-09-20T23:57:18.703278+0000 mgr.a (mgr.14388) 4445 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:57:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:19 smithi044 bash[22676]: audit 2024-09-20T23:57:19.445150+0000 mon.a (mon.0) 4151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:19 smithi044 bash[22676]: audit 2024-09-20T23:57:19.453713+0000 mon.a (mon.0) 4152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:19 smithi044 bash[22676]: audit 2024-09-20T23:57:19.463807+0000 mon.a (mon.0) 4153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:19 smithi179 bash[23186]: cluster 2024-09-20T23:57:18.703278+0000 mgr.a (mgr.14388) 4445 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:57:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:19 smithi179 bash[23186]: audit 2024-09-20T23:57:19.445150+0000 mon.a (mon.0) 4151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:19 smithi179 bash[23186]: audit 2024-09-20T23:57:19.453713+0000 mon.a (mon.0) 4152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:19 smithi179 bash[23186]: audit 2024-09-20T23:57:19.463807+0000 mon.a (mon.0) 4153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:19 smithi049 bash[23528]: cluster 2024-09-20T23:57:18.703278+0000 mgr.a (mgr.14388) 4445 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:57:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:19 smithi049 bash[23528]: audit 2024-09-20T23:57:19.445150+0000 mon.a (mon.0) 4151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:19 smithi049 bash[23528]: audit 2024-09-20T23:57:19.453713+0000 mon.a (mon.0) 4152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:19 smithi049 bash[23528]: audit 2024-09-20T23:57:19.463807+0000 mon.a (mon.0) 4153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:21.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:21.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:21 smithi044 bash[22676]: audit 2024-09-20T23:57:20.462128+0000 mon.a (mon.0) 4154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:21 smithi044 bash[22676]: audit 2024-09-20T23:57:20.471265+0000 mon.a (mon.0) 4155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:21 smithi044 bash[22676]: audit 2024-09-20T23:57:20.481221+0000 mon.a (mon.0) 4156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:21 smithi044 bash[22676]: cluster 2024-09-20T23:57:20.705333+0000 mgr.a (mgr.14388) 4446 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:21 smithi179 bash[23186]: audit 2024-09-20T23:57:20.462128+0000 mon.a (mon.0) 4154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:21 smithi179 bash[23186]: audit 2024-09-20T23:57:20.471265+0000 mon.a (mon.0) 4155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:21 smithi179 bash[23186]: audit 2024-09-20T23:57:20.481221+0000 mon.a (mon.0) 4156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:21 smithi179 bash[23186]: cluster 2024-09-20T23:57:20.705333+0000 mgr.a (mgr.14388) 4446 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:21 smithi049 bash[23528]: audit 2024-09-20T23:57:20.462128+0000 mon.a (mon.0) 4154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:21 smithi049 bash[23528]: audit 2024-09-20T23:57:20.471265+0000 mon.a (mon.0) 4155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:21 smithi049 bash[23528]: audit 2024-09-20T23:57:20.481221+0000 mon.a (mon.0) 4156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:21 smithi049 bash[23528]: cluster 2024-09-20T23:57:20.705333+0000 mgr.a (mgr.14388) 4446 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:21.992 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:21.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:21.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:21.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:21.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:22 smithi044 bash[22676]: audit 2024-09-20T23:57:21.555322+0000 mgr.a (mgr.14388) 4447 : audit [DBG] from='client.106134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:22 smithi179 bash[23186]: audit 2024-09-20T23:57:21.555322+0000 mgr.a (mgr.14388) 4447 : audit [DBG] from='client.106134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:22 smithi049 bash[23528]: audit 2024-09-20T23:57:21.555322+0000 mgr.a (mgr.14388) 4447 : audit [DBG] from='client.106134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:23 smithi044 bash[22676]: cluster 2024-09-20T23:57:22.706186+0000 mgr.a (mgr.14388) 4448 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:23 smithi179 bash[23186]: cluster 2024-09-20T23:57:22.706186+0000 mgr.a (mgr.14388) 4448 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:23 smithi049 bash[23528]: cluster 2024-09-20T23:57:22.706186+0000 mgr.a (mgr.14388) 4448 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:25 smithi049 bash[23528]: cluster 2024-09-20T23:57:24.706974+0000 mgr.a (mgr.14388) 4449 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:25 smithi044 bash[22676]: cluster 2024-09-20T23:57:24.706974+0000 mgr.a (mgr.14388) 4449 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:25 smithi179 bash[23186]: cluster 2024-09-20T23:57:24.706974+0000 mgr.a (mgr.14388) 4449 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:26.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:26.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:26.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:27.775 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:27.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:27.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:27.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:27.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:27 smithi049 bash[23528]: cluster 2024-09-20T23:57:26.709225+0000 mgr.a (mgr.14388) 4450 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:27 smithi044 bash[22676]: cluster 2024-09-20T23:57:26.709225+0000 mgr.a (mgr.14388) 4450 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:27 smithi179 bash[23186]: cluster 2024-09-20T23:57:26.709225+0000 mgr.a (mgr.14388) 4450 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:28 smithi049 bash[23528]: audit 2024-09-20T23:57:27.328238+0000 mgr.a (mgr.14388) 4451 : audit [DBG] from='client.106209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:28 smithi044 bash[22676]: audit 2024-09-20T23:57:27.328238+0000 mgr.a (mgr.14388) 4451 : audit [DBG] from='client.106209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:28 smithi179 bash[23186]: audit 2024-09-20T23:57:27.328238+0000 mgr.a (mgr.14388) 4451 : audit [DBG] from='client.106209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:29 smithi049 bash[23528]: cluster 2024-09-20T23:57:28.710140+0000 mgr.a (mgr.14388) 4452 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:29 smithi044 bash[22676]: cluster 2024-09-20T23:57:28.710140+0000 mgr.a (mgr.14388) 4452 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:29 smithi179 bash[23186]: cluster 2024-09-20T23:57:28.710140+0000 mgr.a (mgr.14388) 4452 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:31 smithi049 bash[23528]: cluster 2024-09-20T23:57:30.712336+0000 mgr.a (mgr.14388) 4453 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:31 smithi044 bash[22676]: cluster 2024-09-20T23:57:30.712336+0000 mgr.a (mgr.14388) 4453 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:31 smithi179 bash[23186]: cluster 2024-09-20T23:57:30.712336+0000 mgr.a (mgr.14388) 4453 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:57:32.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:32.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:32.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:32 smithi049 bash[23528]: audit 2024-09-20T23:57:32.015407+0000 mon.a (mon.0) 4157 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:57:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:32 smithi049 bash[23528]: audit 2024-09-20T23:57:32.027116+0000 mon.a (mon.0) 4158 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:57:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:32 smithi049 bash[23528]: audit 2024-09-20T23:57:32.029152+0000 mon.a (mon.0) 4159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:57:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:32 smithi049 bash[23528]: audit 2024-09-20T23:57:32.042355+0000 mon.a (mon.0) 4160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:32 smithi049 bash[23528]: audit 2024-09-20T23:57:32.048855+0000 mon.a (mon.0) 4161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:57:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:32 smithi049 bash[23528]: audit 2024-09-20T23:57:32.051326+0000 mgr.a (mgr.14388) 4454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22930]: debug 2024-09-20T23:57:32.820+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22930]: debug 2024-09-20T23:57:32.820+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22676]: audit 2024-09-20T23:57:32.015407+0000 mon.a (mon.0) 4157 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22676]: audit 2024-09-20T23:57:32.027116+0000 mon.a (mon.0) 4158 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22676]: audit 2024-09-20T23:57:32.029152+0000 mon.a (mon.0) 4159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22676]: audit 2024-09-20T23:57:32.042355+0000 mon.a (mon.0) 4160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22676]: audit 2024-09-20T23:57:32.048855+0000 mon.a (mon.0) 4161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:57:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:32 smithi044 bash[22676]: audit 2024-09-20T23:57:32.051326+0000 mgr.a (mgr.14388) 4454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:57:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:32 smithi179 bash[23186]: audit 2024-09-20T23:57:32.015407+0000 mon.a (mon.0) 4157 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:57:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:32 smithi179 bash[23186]: audit 2024-09-20T23:57:32.027116+0000 mon.a (mon.0) 4158 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:57:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:32 smithi179 bash[23186]: audit 2024-09-20T23:57:32.029152+0000 mon.a (mon.0) 4159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:57:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:32 smithi179 bash[23186]: audit 2024-09-20T23:57:32.042355+0000 mon.a (mon.0) 4160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:32 smithi179 bash[23186]: audit 2024-09-20T23:57:32.048855+0000 mon.a (mon.0) 4161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:57:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:32 smithi179 bash[23186]: audit 2024-09-20T23:57:32.051326+0000 mgr.a (mgr.14388) 4454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:57:33.532 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:33.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:33.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:33.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:33.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:34 smithi049 bash[23528]: cluster 2024-09-20T23:57:32.712889+0000 mgr.a (mgr.14388) 4455 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:34 smithi049 bash[23528]: audit 2024-09-20T23:57:32.823084+0000 mgr.a (mgr.14388) 4456 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:57:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:34 smithi049 bash[23528]: cephadm 2024-09-20T23:57:32.824299+0000 mgr.a (mgr.14388) 4457 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:57:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:34 smithi049 bash[23528]: audit 2024-09-20T23:57:33.101521+0000 mgr.a (mgr.14388) 4458 : audit [DBG] from='client.106389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:34 smithi044 bash[22676]: cluster 2024-09-20T23:57:32.712889+0000 mgr.a (mgr.14388) 4455 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:34 smithi044 bash[22676]: audit 2024-09-20T23:57:32.823084+0000 mgr.a (mgr.14388) 4456 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:57:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:34 smithi044 bash[22676]: cephadm 2024-09-20T23:57:32.824299+0000 mgr.a (mgr.14388) 4457 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:57:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:34 smithi044 bash[22676]: audit 2024-09-20T23:57:33.101521+0000 mgr.a (mgr.14388) 4458 : audit [DBG] from='client.106389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:34 smithi179 bash[23186]: cluster 2024-09-20T23:57:32.712889+0000 mgr.a (mgr.14388) 4455 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:34 smithi179 bash[23186]: audit 2024-09-20T23:57:32.823084+0000 mgr.a (mgr.14388) 4456 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:57:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:34 smithi179 bash[23186]: cephadm 2024-09-20T23:57:32.824299+0000 mgr.a (mgr.14388) 4457 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:57:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:34 smithi179 bash[23186]: audit 2024-09-20T23:57:33.101521+0000 mgr.a (mgr.14388) 4458 : audit [DBG] from='client.106389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:36 smithi049 bash[23528]: cluster 2024-09-20T23:57:34.713814+0000 mgr.a (mgr.14388) 4459 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:36 smithi044 bash[22676]: cluster 2024-09-20T23:57:34.713814+0000 mgr.a (mgr.14388) 4459 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:36 smithi179 bash[23186]: cluster 2024-09-20T23:57:34.713814+0000 mgr.a (mgr.14388) 4459 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:37 smithi044 bash[22676]: cluster 2024-09-20T23:57:36.716059+0000 mgr.a (mgr.14388) 4460 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:37 smithi044 bash[22676]: audit 2024-09-20T23:57:36.909892+0000 mon.a (mon.0) 4162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:37 smithi044 bash[22676]: audit 2024-09-20T23:57:36.918686+0000 mon.a (mon.0) 4163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:37 smithi044 bash[22676]: audit 2024-09-20T23:57:36.929474+0000 mon.a (mon.0) 4164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:37 smithi179 bash[23186]: cluster 2024-09-20T23:57:36.716059+0000 mgr.a (mgr.14388) 4460 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:37 smithi179 bash[23186]: audit 2024-09-20T23:57:36.909892+0000 mon.a (mon.0) 4162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:37 smithi179 bash[23186]: audit 2024-09-20T23:57:36.918686+0000 mon.a (mon.0) 4163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:37 smithi179 bash[23186]: audit 2024-09-20T23:57:36.929474+0000 mon.a (mon.0) 4164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:37 smithi049 bash[23528]: cluster 2024-09-20T23:57:36.716059+0000 mgr.a (mgr.14388) 4460 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:37 smithi049 bash[23528]: audit 2024-09-20T23:57:36.909892+0000 mon.a (mon.0) 4162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:37 smithi049 bash[23528]: audit 2024-09-20T23:57:36.918686+0000 mon.a (mon.0) 4163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:37 smithi049 bash[23528]: audit 2024-09-20T23:57:36.929474+0000 mon.a (mon.0) 4164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:39.288 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:39 smithi044 bash[22676]: cluster 2024-09-20T23:57:38.716801+0000 mgr.a (mgr.14388) 4461 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:39 smithi044 bash[22676]: audit 2024-09-20T23:57:38.870562+0000 mgr.a (mgr.14388) 4462 : audit [DBG] from='client.106467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:39 smithi044 bash[22676]: audit 2024-09-20T23:57:39.641160+0000 mon.a (mon.0) 4165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:39 smithi044 bash[22676]: audit 2024-09-20T23:57:39.649297+0000 mon.a (mon.0) 4166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:39 smithi044 bash[22676]: audit 2024-09-20T23:57:39.660785+0000 mon.a (mon.0) 4167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:39 smithi049 bash[23528]: cluster 2024-09-20T23:57:38.716801+0000 mgr.a (mgr.14388) 4461 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:39 smithi049 bash[23528]: audit 2024-09-20T23:57:38.870562+0000 mgr.a (mgr.14388) 4462 : audit [DBG] from='client.106467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:39 smithi049 bash[23528]: audit 2024-09-20T23:57:39.641160+0000 mon.a (mon.0) 4165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:39 smithi049 bash[23528]: audit 2024-09-20T23:57:39.649297+0000 mon.a (mon.0) 4166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:39 smithi049 bash[23528]: audit 2024-09-20T23:57:39.660785+0000 mon.a (mon.0) 4167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:40 smithi179 bash[23186]: cluster 2024-09-20T23:57:38.716801+0000 mgr.a (mgr.14388) 4461 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:40 smithi179 bash[23186]: audit 2024-09-20T23:57:38.870562+0000 mgr.a (mgr.14388) 4462 : audit [DBG] from='client.106467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:40 smithi179 bash[23186]: audit 2024-09-20T23:57:39.641160+0000 mon.a (mon.0) 4165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:40 smithi179 bash[23186]: audit 2024-09-20T23:57:39.649297+0000 mon.a (mon.0) 4166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:40 smithi179 bash[23186]: audit 2024-09-20T23:57:39.660785+0000 mon.a (mon.0) 4167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:41 smithi044 bash[22676]: audit 2024-09-20T23:57:40.695649+0000 mon.a (mon.0) 4168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:41 smithi044 bash[22676]: audit 2024-09-20T23:57:40.704296+0000 mon.a (mon.0) 4169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:41 smithi044 bash[22676]: audit 2024-09-20T23:57:40.715170+0000 mon.a (mon.0) 4170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:41 smithi044 bash[22676]: cluster 2024-09-20T23:57:40.719451+0000 mgr.a (mgr.14388) 4463 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:41 smithi179 bash[23186]: audit 2024-09-20T23:57:40.695649+0000 mon.a (mon.0) 4168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:41 smithi179 bash[23186]: audit 2024-09-20T23:57:40.704296+0000 mon.a (mon.0) 4169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:41 smithi179 bash[23186]: audit 2024-09-20T23:57:40.715170+0000 mon.a (mon.0) 4170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:41 smithi179 bash[23186]: cluster 2024-09-20T23:57:40.719451+0000 mgr.a (mgr.14388) 4463 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:41 smithi049 bash[23528]: audit 2024-09-20T23:57:40.695649+0000 mon.a (mon.0) 4168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:41 smithi049 bash[23528]: audit 2024-09-20T23:57:40.704296+0000 mon.a (mon.0) 4169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:41 smithi049 bash[23528]: audit 2024-09-20T23:57:40.715170+0000 mon.a (mon.0) 4170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:41 smithi049 bash[23528]: cluster 2024-09-20T23:57:40.719451+0000 mgr.a (mgr.14388) 4463 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:43 smithi049 bash[23528]: cluster 2024-09-20T23:57:42.720211+0000 mgr.a (mgr.14388) 4464 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:43 smithi044 bash[22676]: cluster 2024-09-20T23:57:42.720211+0000 mgr.a (mgr.14388) 4464 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:43 smithi179 bash[23186]: cluster 2024-09-20T23:57:42.720211+0000 mgr.a (mgr.14388) 4464 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:44.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:44.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:44.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:45.031 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:45 smithi049 bash[23528]: audit 2024-09-20T23:57:44.619134+0000 mgr.a (mgr.14388) 4465 : audit [DBG] from='client.106539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:45 smithi049 bash[23528]: cluster 2024-09-20T23:57:44.720783+0000 mgr.a (mgr.14388) 4466 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:45 smithi044 bash[22676]: audit 2024-09-20T23:57:44.619134+0000 mgr.a (mgr.14388) 4465 : audit [DBG] from='client.106539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:45 smithi044 bash[22676]: cluster 2024-09-20T23:57:44.720783+0000 mgr.a (mgr.14388) 4466 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:45 smithi179 bash[23186]: audit 2024-09-20T23:57:44.619134+0000 mgr.a (mgr.14388) 4465 : audit [DBG] from='client.106539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:45 smithi179 bash[23186]: cluster 2024-09-20T23:57:44.720783+0000 mgr.a (mgr.14388) 4466 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:47 smithi044 bash[22676]: cluster 2024-09-20T23:57:46.723175+0000 mgr.a (mgr.14388) 4467 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:47 smithi049 bash[23528]: cluster 2024-09-20T23:57:46.723175+0000 mgr.a (mgr.14388) 4467 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:47 smithi179 bash[23186]: cluster 2024-09-20T23:57:46.723175+0000 mgr.a (mgr.14388) 4467 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:57:50.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:50.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:50.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:49 smithi049 bash[23528]: cluster 2024-09-20T23:57:48.723966+0000 mgr.a (mgr.14388) 4468 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:49 smithi044 bash[22676]: cluster 2024-09-20T23:57:48.723966+0000 mgr.a (mgr.14388) 4468 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:49 smithi179 bash[23186]: cluster 2024-09-20T23:57:48.723966+0000 mgr.a (mgr.14388) 4468 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:50.820 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:50.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:50.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:50.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:50.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:51 smithi049 bash[23528]: audit 2024-09-20T23:57:50.369198+0000 mgr.a (mgr.14388) 4469 : audit [DBG] from='client.106611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:51 smithi049 bash[23528]: cluster 2024-09-20T23:57:50.725354+0000 mgr.a (mgr.14388) 4470 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:51 smithi044 bash[22676]: audit 2024-09-20T23:57:50.369198+0000 mgr.a (mgr.14388) 4469 : audit [DBG] from='client.106611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:51 smithi044 bash[22676]: cluster 2024-09-20T23:57:50.725354+0000 mgr.a (mgr.14388) 4470 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:51 smithi179 bash[23186]: audit 2024-09-20T23:57:50.369198+0000 mgr.a (mgr.14388) 4469 : audit [DBG] from='client.106611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:51 smithi179 bash[23186]: cluster 2024-09-20T23:57:50.725354+0000 mgr.a (mgr.14388) 4470 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:53 smithi049 bash[23528]: cluster 2024-09-20T23:57:52.726213+0000 mgr.a (mgr.14388) 4471 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:53 smithi044 bash[22676]: cluster 2024-09-20T23:57:52.726213+0000 mgr.a (mgr.14388) 4471 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:53 smithi179 bash[23186]: cluster 2024-09-20T23:57:52.726213+0000 mgr.a (mgr.14388) 4471 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:57:55.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:57:55.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:57:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:55 smithi049 bash[23528]: cluster 2024-09-20T23:57:54.726997+0000 mgr.a (mgr.14388) 4472 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:55 smithi044 bash[22676]: cluster 2024-09-20T23:57:54.726997+0000 mgr.a (mgr.14388) 4472 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:55 smithi179 bash[23186]: cluster 2024-09-20T23:57:54.726997+0000 mgr.a (mgr.14388) 4472 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:57:56.595 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:57:56.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:57:56.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:57:56.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:57:56.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:57:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:56 smithi049 bash[23528]: audit 2024-09-20T23:57:56.160135+0000 mgr.a (mgr.14388) 4473 : audit [DBG] from='client.106686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:56 smithi044 bash[22676]: audit 2024-09-20T23:57:56.160135+0000 mgr.a (mgr.14388) 4473 : audit [DBG] from='client.106686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:56 smithi179 bash[23186]: audit 2024-09-20T23:57:56.160135+0000 mgr.a (mgr.14388) 4473 : audit [DBG] from='client.106686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:57:58.367 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:58 smithi179 bash[23186]: cluster 2024-09-20T23:57:56.729961+0000 mgr.a (mgr.14388) 4474 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:58.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:58 smithi179 bash[23186]: audit 2024-09-20T23:57:57.082362+0000 mon.a (mon.0) 4171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:58 smithi179 bash[23186]: audit 2024-09-20T23:57:57.090904+0000 mon.a (mon.0) 4172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:57:58 smithi179 bash[23186]: audit 2024-09-20T23:57:57.101310+0000 mon.a (mon.0) 4173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:58 smithi044 bash[22676]: cluster 2024-09-20T23:57:56.729961+0000 mgr.a (mgr.14388) 4474 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:58 smithi044 bash[22676]: audit 2024-09-20T23:57:57.082362+0000 mon.a (mon.0) 4171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:58 smithi044 bash[22676]: audit 2024-09-20T23:57:57.090904+0000 mon.a (mon.0) 4172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:57:58 smithi044 bash[22676]: audit 2024-09-20T23:57:57.101310+0000 mon.a (mon.0) 4173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:58 smithi049 bash[23528]: cluster 2024-09-20T23:57:56.729961+0000 mgr.a (mgr.14388) 4474 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:57:58.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:58 smithi049 bash[23528]: audit 2024-09-20T23:57:57.082362+0000 mon.a (mon.0) 4171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:58 smithi049 bash[23528]: audit 2024-09-20T23:57:57.090904+0000 mon.a (mon.0) 4172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:57:58.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:57:58 smithi049 bash[23528]: audit 2024-09-20T23:57:57.101310+0000 mon.a (mon.0) 4173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:00 smithi179 bash[23186]: cluster 2024-09-20T23:57:58.730785+0000 mgr.a (mgr.14388) 4475 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:00 smithi179 bash[23186]: audit 2024-09-20T23:57:59.865114+0000 mon.a (mon.0) 4174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:00 smithi179 bash[23186]: audit 2024-09-20T23:57:59.875344+0000 mon.a (mon.0) 4175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:00 smithi179 bash[23186]: audit 2024-09-20T23:57:59.886587+0000 mon.a (mon.0) 4176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:00 smithi044 bash[22676]: cluster 2024-09-20T23:57:58.730785+0000 mgr.a (mgr.14388) 4475 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:00 smithi044 bash[22676]: audit 2024-09-20T23:57:59.865114+0000 mon.a (mon.0) 4174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:00 smithi044 bash[22676]: audit 2024-09-20T23:57:59.875344+0000 mon.a (mon.0) 4175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:00 smithi044 bash[22676]: audit 2024-09-20T23:57:59.886587+0000 mon.a (mon.0) 4176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:00 smithi049 bash[23528]: cluster 2024-09-20T23:57:58.730785+0000 mgr.a (mgr.14388) 4475 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:00 smithi049 bash[23528]: audit 2024-09-20T23:57:59.865114+0000 mon.a (mon.0) 4174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:00 smithi049 bash[23528]: audit 2024-09-20T23:57:59.875344+0000 mon.a (mon.0) 4175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:00 smithi049 bash[23528]: audit 2024-09-20T23:57:59.886587+0000 mon.a (mon.0) 4176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:01 smithi179 bash[23186]: cluster 2024-09-20T23:58:00.732051+0000 mgr.a (mgr.14388) 4476 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:01 smithi179 bash[23186]: audit 2024-09-20T23:58:00.934774+0000 mon.a (mon.0) 4177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:01 smithi179 bash[23186]: audit 2024-09-20T23:58:00.944210+0000 mon.a (mon.0) 4178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:01 smithi179 bash[23186]: audit 2024-09-20T23:58:00.955348+0000 mon.a (mon.0) 4179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:01 smithi044 bash[22676]: cluster 2024-09-20T23:58:00.732051+0000 mgr.a (mgr.14388) 4476 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:01 smithi044 bash[22676]: audit 2024-09-20T23:58:00.934774+0000 mon.a (mon.0) 4177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:01 smithi044 bash[22676]: audit 2024-09-20T23:58:00.944210+0000 mon.a (mon.0) 4178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:01 smithi044 bash[22676]: audit 2024-09-20T23:58:00.955348+0000 mon.a (mon.0) 4179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:01 smithi049 bash[23528]: cluster 2024-09-20T23:58:00.732051+0000 mgr.a (mgr.14388) 4476 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:01 smithi049 bash[23528]: audit 2024-09-20T23:58:00.934774+0000 mon.a (mon.0) 4177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:01 smithi049 bash[23528]: audit 2024-09-20T23:58:00.944210+0000 mon.a (mon.0) 4178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:01 smithi049 bash[23528]: audit 2024-09-20T23:58:00.955348+0000 mon.a (mon.0) 4179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:02.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:02.387 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:02 smithi044 bash[22676]: audit 2024-09-20T23:58:01.938113+0000 mgr.a (mgr.14388) 4477 : audit [DBG] from='client.106764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:02 smithi179 bash[23186]: audit 2024-09-20T23:58:01.938113+0000 mgr.a (mgr.14388) 4477 : audit [DBG] from='client.106764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:03.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:02 smithi049 bash[23528]: audit 2024-09-20T23:58:01.938113+0000 mgr.a (mgr.14388) 4477 : audit [DBG] from='client.106764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:03 smithi044 bash[22676]: cluster 2024-09-20T23:58:02.732938+0000 mgr.a (mgr.14388) 4478 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:03 smithi179 bash[23186]: cluster 2024-09-20T23:58:02.732938+0000 mgr.a (mgr.14388) 4478 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:03 smithi049 bash[23528]: cluster 2024-09-20T23:58:02.732938+0000 mgr.a (mgr.14388) 4478 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:05 smithi044 bash[22676]: cluster 2024-09-20T23:58:04.733766+0000 mgr.a (mgr.14388) 4479 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:05 smithi179 bash[23186]: cluster 2024-09-20T23:58:04.733766+0000 mgr.a (mgr.14388) 4479 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:05 smithi049 bash[23528]: cluster 2024-09-20T23:58:04.733766+0000 mgr.a (mgr.14388) 4479 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:07.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:08.140 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:08.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:08.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:08.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:08.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:07 smithi044 bash[22676]: cluster 2024-09-20T23:58:06.735035+0000 mgr.a (mgr.14388) 4480 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:07 smithi179 bash[23186]: cluster 2024-09-20T23:58:06.735035+0000 mgr.a (mgr.14388) 4480 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:07 smithi049 bash[23528]: cluster 2024-09-20T23:58:06.735035+0000 mgr.a (mgr.14388) 4480 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:08 smithi044 bash[22676]: audit 2024-09-20T23:58:07.718131+0000 mgr.a (mgr.14388) 4481 : audit [DBG] from='client.106842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:08 smithi179 bash[23186]: audit 2024-09-20T23:58:07.718131+0000 mgr.a (mgr.14388) 4481 : audit [DBG] from='client.106842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:08 smithi049 bash[23528]: audit 2024-09-20T23:58:07.718131+0000 mgr.a (mgr.14388) 4481 : audit [DBG] from='client.106842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:09 smithi044 bash[22676]: cluster 2024-09-20T23:58:08.735946+0000 mgr.a (mgr.14388) 4482 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:09 smithi179 bash[23186]: cluster 2024-09-20T23:58:08.735946+0000 mgr.a (mgr.14388) 4482 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:09 smithi049 bash[23528]: cluster 2024-09-20T23:58:08.735946+0000 mgr.a (mgr.14388) 4482 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:11 smithi044 bash[22676]: cluster 2024-09-20T23:58:10.738182+0000 mgr.a (mgr.14388) 4483 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:11 smithi179 bash[23186]: cluster 2024-09-20T23:58:10.738182+0000 mgr.a (mgr.14388) 4483 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:11 smithi049 bash[23528]: cluster 2024-09-20T23:58:10.738182+0000 mgr.a (mgr.14388) 4483 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:13.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:13.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:13.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:13.926 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:13.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:13.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:13.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:13.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:13 smithi044 bash[22676]: cluster 2024-09-20T23:58:12.738960+0000 mgr.a (mgr.14388) 4484 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:13 smithi179 bash[23186]: cluster 2024-09-20T23:58:12.738960+0000 mgr.a (mgr.14388) 4484 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:13 smithi049 bash[23528]: cluster 2024-09-20T23:58:12.738960+0000 mgr.a (mgr.14388) 4484 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:14 smithi044 bash[22676]: audit 2024-09-20T23:58:13.477291+0000 mgr.a (mgr.14388) 4485 : audit [DBG] from='client.106920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:14 smithi179 bash[23186]: audit 2024-09-20T23:58:13.477291+0000 mgr.a (mgr.14388) 4485 : audit [DBG] from='client.106920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:14 smithi049 bash[23528]: audit 2024-09-20T23:58:13.477291+0000 mgr.a (mgr.14388) 4485 : audit [DBG] from='client.106920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:15 smithi044 bash[22676]: cluster 2024-09-20T23:58:14.739864+0000 mgr.a (mgr.14388) 4486 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:15 smithi179 bash[23186]: cluster 2024-09-20T23:58:14.739864+0000 mgr.a (mgr.14388) 4486 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:15 smithi049 bash[23528]: cluster 2024-09-20T23:58:14.739864+0000 mgr.a (mgr.14388) 4486 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:18 smithi044 bash[22676]: cluster 2024-09-20T23:58:16.742141+0000 mgr.a (mgr.14388) 4487 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:18 smithi044 bash[22676]: audit 2024-09-20T23:58:17.229095+0000 mon.a (mon.0) 4180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:18 smithi044 bash[22676]: audit 2024-09-20T23:58:17.238256+0000 mon.a (mon.0) 4181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:18 smithi044 bash[22676]: audit 2024-09-20T23:58:17.249344+0000 mon.a (mon.0) 4182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:18 smithi179 bash[23186]: cluster 2024-09-20T23:58:16.742141+0000 mgr.a (mgr.14388) 4487 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:18 smithi179 bash[23186]: audit 2024-09-20T23:58:17.229095+0000 mon.a (mon.0) 4180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:18 smithi179 bash[23186]: audit 2024-09-20T23:58:17.238256+0000 mon.a (mon.0) 4181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:18 smithi179 bash[23186]: audit 2024-09-20T23:58:17.249344+0000 mon.a (mon.0) 4182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:18 smithi049 bash[23528]: cluster 2024-09-20T23:58:16.742141+0000 mgr.a (mgr.14388) 4487 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:18 smithi049 bash[23528]: audit 2024-09-20T23:58:17.229095+0000 mon.a (mon.0) 4180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:18 smithi049 bash[23528]: audit 2024-09-20T23:58:17.238256+0000 mon.a (mon.0) 4181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:18 smithi049 bash[23528]: audit 2024-09-20T23:58:17.249344+0000 mon.a (mon.0) 4182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:18.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:18.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:19.694 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:20 smithi179 bash[23186]: cluster 2024-09-20T23:58:18.742912+0000 mgr.a (mgr.14388) 4488 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:20 smithi179 bash[23186]: audit 2024-09-20T23:58:20.055318+0000 mon.a (mon.0) 4183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:20 smithi179 bash[23186]: audit 2024-09-20T23:58:20.064113+0000 mon.a (mon.0) 4184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:20 smithi179 bash[23186]: audit 2024-09-20T23:58:20.075054+0000 mon.a (mon.0) 4185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:20 smithi049 bash[23528]: cluster 2024-09-20T23:58:18.742912+0000 mgr.a (mgr.14388) 4488 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:20 smithi049 bash[23528]: audit 2024-09-20T23:58:20.055318+0000 mon.a (mon.0) 4183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:20 smithi049 bash[23528]: audit 2024-09-20T23:58:20.064113+0000 mon.a (mon.0) 4184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:20 smithi049 bash[23528]: audit 2024-09-20T23:58:20.075054+0000 mon.a (mon.0) 4185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:20 smithi044 bash[22676]: cluster 2024-09-20T23:58:18.742912+0000 mgr.a (mgr.14388) 4488 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:20 smithi044 bash[22676]: audit 2024-09-20T23:58:20.055318+0000 mon.a (mon.0) 4183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:20 smithi044 bash[22676]: audit 2024-09-20T23:58:20.064113+0000 mon.a (mon.0) 4184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:20 smithi044 bash[22676]: audit 2024-09-20T23:58:20.075054+0000 mon.a (mon.0) 4185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:21 smithi044 bash[22676]: audit 2024-09-20T23:58:19.263567+0000 mgr.a (mgr.14388) 4489 : audit [DBG] from='client.106998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:21 smithi044 bash[22676]: audit 2024-09-20T23:58:21.167581+0000 mon.a (mon.0) 4186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:21 smithi044 bash[22676]: audit 2024-09-20T23:58:21.175980+0000 mon.a (mon.0) 4187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:21 smithi044 bash[22676]: audit 2024-09-20T23:58:21.186138+0000 mon.a (mon.0) 4188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:21 smithi179 bash[23186]: audit 2024-09-20T23:58:19.263567+0000 mgr.a (mgr.14388) 4489 : audit [DBG] from='client.106998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:21 smithi179 bash[23186]: audit 2024-09-20T23:58:21.167581+0000 mon.a (mon.0) 4186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:21 smithi179 bash[23186]: audit 2024-09-20T23:58:21.175980+0000 mon.a (mon.0) 4187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:21 smithi179 bash[23186]: audit 2024-09-20T23:58:21.186138+0000 mon.a (mon.0) 4188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:21 smithi049 bash[23528]: audit 2024-09-20T23:58:19.263567+0000 mgr.a (mgr.14388) 4489 : audit [DBG] from='client.106998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:21 smithi049 bash[23528]: audit 2024-09-20T23:58:21.167581+0000 mon.a (mon.0) 4186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:21 smithi049 bash[23528]: audit 2024-09-20T23:58:21.175980+0000 mon.a (mon.0) 4187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:21 smithi049 bash[23528]: audit 2024-09-20T23:58:21.186138+0000 mon.a (mon.0) 4188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:22 smithi049 bash[23528]: cluster 2024-09-20T23:58:20.745187+0000 mgr.a (mgr.14388) 4490 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:22 smithi044 bash[22676]: cluster 2024-09-20T23:58:20.745187+0000 mgr.a (mgr.14388) 4490 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:22 smithi179 bash[23186]: cluster 2024-09-20T23:58:20.745187+0000 mgr.a (mgr.14388) 4490 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:23 smithi049 bash[23528]: cluster 2024-09-20T23:58:22.745951+0000 mgr.a (mgr.14388) 4491 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:23 smithi044 bash[22676]: cluster 2024-09-20T23:58:22.745951+0000 mgr.a (mgr.14388) 4491 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:23 smithi179 bash[23186]: cluster 2024-09-20T23:58:22.745951+0000 mgr.a (mgr.14388) 4491 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:24.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:24.696 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:24.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:25.440 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:25.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:25.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:25.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:25.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:26.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:25 smithi044 bash[22676]: cluster 2024-09-20T23:58:24.746605+0000 mgr.a (mgr.14388) 4492 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:26.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:25 smithi044 bash[22676]: audit 2024-09-20T23:58:25.028239+0000 mgr.a (mgr.14388) 4493 : audit [DBG] from='client.107073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:25 smithi179 bash[23186]: cluster 2024-09-20T23:58:24.746605+0000 mgr.a (mgr.14388) 4492 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:25 smithi179 bash[23186]: audit 2024-09-20T23:58:25.028239+0000 mgr.a (mgr.14388) 4493 : audit [DBG] from='client.107073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:25 smithi049 bash[23528]: cluster 2024-09-20T23:58:24.746605+0000 mgr.a (mgr.14388) 4492 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:25 smithi049 bash[23528]: audit 2024-09-20T23:58:25.028239+0000 mgr.a (mgr.14388) 4493 : audit [DBG] from='client.107073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:27 smithi044 bash[22676]: cluster 2024-09-20T23:58:26.749491+0000 mgr.a (mgr.14388) 4494 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:27 smithi179 bash[23186]: cluster 2024-09-20T23:58:26.749491+0000 mgr.a (mgr.14388) 4494 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:27 smithi049 bash[23528]: cluster 2024-09-20T23:58:26.749491+0000 mgr.a (mgr.14388) 4494 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:29 smithi044 bash[22676]: cluster 2024-09-20T23:58:28.750533+0000 mgr.a (mgr.14388) 4495 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:29 smithi179 bash[23186]: cluster 2024-09-20T23:58:28.750533+0000 mgr.a (mgr.14388) 4495 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:29 smithi049 bash[23528]: cluster 2024-09-20T23:58:28.750533+0000 mgr.a (mgr.14388) 4495 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:30.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:31 smithi044 bash[22676]: cluster 2024-09-20T23:58:30.751746+0000 mgr.a (mgr.14388) 4496 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:31 smithi044 bash[22676]: audit 2024-09-20T23:58:30.777617+0000 mgr.a (mgr.14388) 4497 : audit [DBG] from='client.107151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:31 smithi179 bash[23186]: cluster 2024-09-20T23:58:30.751746+0000 mgr.a (mgr.14388) 4496 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:31 smithi179 bash[23186]: audit 2024-09-20T23:58:30.777617+0000 mgr.a (mgr.14388) 4497 : audit [DBG] from='client.107151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:31 smithi049 bash[23528]: cluster 2024-09-20T23:58:30.751746+0000 mgr.a (mgr.14388) 4496 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:31 smithi049 bash[23528]: audit 2024-09-20T23:58:30.777617+0000 mgr.a (mgr.14388) 4497 : audit [DBG] from='client.107151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:33.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22930]: debug 2024-09-20T23:58:33.667+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:58:33.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22930]: debug 2024-09-20T23:58:33.671+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:58:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22676]: cluster 2024-09-20T23:58:32.752613+0000 mgr.a (mgr.14388) 4498 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22676]: audit 2024-09-20T23:58:32.876865+0000 mon.a (mon.0) 4189 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:58:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22676]: audit 2024-09-20T23:58:32.883558+0000 mon.a (mon.0) 4190 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:58:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22676]: audit 2024-09-20T23:58:32.885535+0000 mon.a (mon.0) 4191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:58:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22676]: audit 2024-09-20T23:58:32.896478+0000 mon.a (mon.0) 4192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22676]: audit 2024-09-20T23:58:32.902988+0000 mon.a (mon.0) 4193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:58:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:33 smithi044 bash[22676]: audit 2024-09-20T23:58:32.905622+0000 mgr.a (mgr.14388) 4499 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:58:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:33 smithi179 bash[23186]: cluster 2024-09-20T23:58:32.752613+0000 mgr.a (mgr.14388) 4498 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:33 smithi179 bash[23186]: audit 2024-09-20T23:58:32.876865+0000 mon.a (mon.0) 4189 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:58:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:33 smithi179 bash[23186]: audit 2024-09-20T23:58:32.883558+0000 mon.a (mon.0) 4190 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:58:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:33 smithi179 bash[23186]: audit 2024-09-20T23:58:32.885535+0000 mon.a (mon.0) 4191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:58:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:33 smithi179 bash[23186]: audit 2024-09-20T23:58:32.896478+0000 mon.a (mon.0) 4192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:33 smithi179 bash[23186]: audit 2024-09-20T23:58:32.902988+0000 mon.a (mon.0) 4193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:58:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:33 smithi179 bash[23186]: audit 2024-09-20T23:58:32.905622+0000 mgr.a (mgr.14388) 4499 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:58:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:33 smithi049 bash[23528]: cluster 2024-09-20T23:58:32.752613+0000 mgr.a (mgr.14388) 4498 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:58:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:33 smithi049 bash[23528]: audit 2024-09-20T23:58:32.876865+0000 mon.a (mon.0) 4189 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:58:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:33 smithi049 bash[23528]: audit 2024-09-20T23:58:32.883558+0000 mon.a (mon.0) 4190 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:58:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:33 smithi049 bash[23528]: audit 2024-09-20T23:58:32.885535+0000 mon.a (mon.0) 4191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:58:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:33 smithi049 bash[23528]: audit 2024-09-20T23:58:32.896478+0000 mon.a (mon.0) 4192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:33 smithi049 bash[23528]: audit 2024-09-20T23:58:32.902988+0000 mon.a (mon.0) 4193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:58:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:33 smithi049 bash[23528]: audit 2024-09-20T23:58:32.905622+0000 mgr.a (mgr.14388) 4499 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:58:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:34 smithi044 bash[22676]: audit 2024-09-20T23:58:33.672928+0000 mgr.a (mgr.14388) 4500 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:58:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:34 smithi044 bash[22676]: cephadm 2024-09-20T23:58:33.674169+0000 mgr.a (mgr.14388) 4501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:58:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:34 smithi179 bash[23186]: audit 2024-09-20T23:58:33.672928+0000 mgr.a (mgr.14388) 4500 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:58:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:34 smithi179 bash[23186]: cephadm 2024-09-20T23:58:33.674169+0000 mgr.a (mgr.14388) 4501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:58:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:34 smithi049 bash[23528]: audit 2024-09-20T23:58:33.672928+0000 mgr.a (mgr.14388) 4500 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:58:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:34 smithi049 bash[23528]: cephadm 2024-09-20T23:58:33.674169+0000 mgr.a (mgr.14388) 4501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:58:36.095 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:35 smithi049 bash[23528]: cluster 2024-09-20T23:58:34.753687+0000 mgr.a (mgr.14388) 4502 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:58:36.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:36.207 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:35 smithi044 bash[22676]: cluster 2024-09-20T23:58:34.753687+0000 mgr.a (mgr.14388) 4502 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:58:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:35 smithi179 bash[23186]: cluster 2024-09-20T23:58:34.753687+0000 mgr.a (mgr.14388) 4502 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-20T23:58:36.981 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:37 smithi044 bash[22676]: audit 2024-09-20T23:58:36.543654+0000 mgr.a (mgr.14388) 4503 : audit [DBG] from='client.107337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:37 smithi044 bash[22676]: cluster 2024-09-20T23:58:36.755132+0000 mgr.a (mgr.14388) 4504 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:38.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:37 smithi044 bash[22676]: audit 2024-09-20T23:58:37.405398+0000 mon.a (mon.0) 4194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:37 smithi044 bash[22676]: audit 2024-09-20T23:58:37.415209+0000 mon.a (mon.0) 4195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:37 smithi044 bash[22676]: audit 2024-09-20T23:58:37.426731+0000 mon.a (mon.0) 4196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:37 smithi179 bash[23186]: audit 2024-09-20T23:58:36.543654+0000 mgr.a (mgr.14388) 4503 : audit [DBG] from='client.107337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:37 smithi179 bash[23186]: cluster 2024-09-20T23:58:36.755132+0000 mgr.a (mgr.14388) 4504 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:37 smithi179 bash[23186]: audit 2024-09-20T23:58:37.405398+0000 mon.a (mon.0) 4194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:37 smithi179 bash[23186]: audit 2024-09-20T23:58:37.415209+0000 mon.a (mon.0) 4195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:37 smithi179 bash[23186]: audit 2024-09-20T23:58:37.426731+0000 mon.a (mon.0) 4196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:37 smithi049 bash[23528]: audit 2024-09-20T23:58:36.543654+0000 mgr.a (mgr.14388) 4503 : audit [DBG] from='client.107337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:37 smithi049 bash[23528]: cluster 2024-09-20T23:58:36.755132+0000 mgr.a (mgr.14388) 4504 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:37 smithi049 bash[23528]: audit 2024-09-20T23:58:37.405398+0000 mon.a (mon.0) 4194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:37 smithi049 bash[23528]: audit 2024-09-20T23:58:37.415209+0000 mon.a (mon.0) 4195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:37 smithi049 bash[23528]: audit 2024-09-20T23:58:37.426731+0000 mon.a (mon.0) 4196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:39 smithi179 bash[23186]: cluster 2024-09-20T23:58:38.756056+0000 mgr.a (mgr.14388) 4505 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:39 smithi049 bash[23528]: cluster 2024-09-20T23:58:38.756056+0000 mgr.a (mgr.14388) 4505 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:39 smithi044 bash[22676]: cluster 2024-09-20T23:58:38.756056+0000 mgr.a (mgr.14388) 4505 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:41 smithi044 bash[22676]: audit 2024-09-20T23:58:40.226883+0000 mon.a (mon.0) 4197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:41 smithi044 bash[22676]: audit 2024-09-20T23:58:40.235375+0000 mon.a (mon.0) 4198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:41 smithi044 bash[22676]: audit 2024-09-20T23:58:40.245410+0000 mon.a (mon.0) 4199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:41 smithi179 bash[23186]: audit 2024-09-20T23:58:40.226883+0000 mon.a (mon.0) 4197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:41 smithi179 bash[23186]: audit 2024-09-20T23:58:40.235375+0000 mon.a (mon.0) 4198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:41 smithi179 bash[23186]: audit 2024-09-20T23:58:40.245410+0000 mon.a (mon.0) 4199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:41 smithi049 bash[23528]: audit 2024-09-20T23:58:40.226883+0000 mon.a (mon.0) 4197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:41 smithi049 bash[23528]: audit 2024-09-20T23:58:40.235375+0000 mon.a (mon.0) 4198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:41 smithi049 bash[23528]: audit 2024-09-20T23:58:40.245410+0000 mon.a (mon.0) 4199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:41.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:41.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:41.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:42 smithi179 bash[23186]: cluster 2024-09-20T23:58:40.758290+0000 mgr.a (mgr.14388) 4506 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:42 smithi179 bash[23186]: audit 2024-09-20T23:58:41.351547+0000 mon.a (mon.0) 4200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:42 smithi179 bash[23186]: audit 2024-09-20T23:58:41.357885+0000 mon.a (mon.0) 4201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:42 smithi179 bash[23186]: audit 2024-09-20T23:58:41.365464+0000 mon.a (mon.0) 4202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:42 smithi049 bash[23528]: cluster 2024-09-20T23:58:40.758290+0000 mgr.a (mgr.14388) 4506 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:42 smithi049 bash[23528]: audit 2024-09-20T23:58:41.351547+0000 mon.a (mon.0) 4200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:42 smithi049 bash[23528]: audit 2024-09-20T23:58:41.357885+0000 mon.a (mon.0) 4201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:42 smithi049 bash[23528]: audit 2024-09-20T23:58:41.365464+0000 mon.a (mon.0) 4202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:42 smithi044 bash[22676]: cluster 2024-09-20T23:58:40.758290+0000 mgr.a (mgr.14388) 4506 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:42 smithi044 bash[22676]: audit 2024-09-20T23:58:41.351547+0000 mon.a (mon.0) 4200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:42 smithi044 bash[22676]: audit 2024-09-20T23:58:41.357885+0000 mon.a (mon.0) 4201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:42 smithi044 bash[22676]: audit 2024-09-20T23:58:41.365464+0000 mon.a (mon.0) 4202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:42.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:43 smithi044 bash[22676]: audit 2024-09-20T23:58:42.324369+0000 mgr.a (mgr.14388) 4507 : audit [DBG] from='client.107412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:43 smithi044 bash[22676]: cluster 2024-09-20T23:58:42.758726+0000 mgr.a (mgr.14388) 4508 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:43 smithi179 bash[23186]: audit 2024-09-20T23:58:42.324369+0000 mgr.a (mgr.14388) 4507 : audit [DBG] from='client.107412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:43 smithi179 bash[23186]: cluster 2024-09-20T23:58:42.758726+0000 mgr.a (mgr.14388) 4508 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:43 smithi049 bash[23528]: audit 2024-09-20T23:58:42.324369+0000 mgr.a (mgr.14388) 4507 : audit [DBG] from='client.107412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:43 smithi049 bash[23528]: cluster 2024-09-20T23:58:42.758726+0000 mgr.a (mgr.14388) 4508 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:45 smithi044 bash[22676]: cluster 2024-09-20T23:58:44.759604+0000 mgr.a (mgr.14388) 4509 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:45 smithi179 bash[23186]: cluster 2024-09-20T23:58:44.759604+0000 mgr.a (mgr.14388) 4509 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:45 smithi049 bash[23528]: cluster 2024-09-20T23:58:44.759604+0000 mgr.a (mgr.14388) 4509 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:47.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:47.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:47.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:47 smithi044 bash[22676]: cluster 2024-09-20T23:58:46.760948+0000 mgr.a (mgr.14388) 4510 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:47 smithi179 bash[23186]: cluster 2024-09-20T23:58:46.760948+0000 mgr.a (mgr.14388) 4510 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:47 smithi049 bash[23528]: cluster 2024-09-20T23:58:46.760948+0000 mgr.a (mgr.14388) 4510 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:58:48.571 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:49.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:48 smithi044 bash[22676]: audit 2024-09-20T23:58:48.106272+0000 mgr.a (mgr.14388) 4511 : audit [DBG] from='client.107490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:48 smithi179 bash[23186]: audit 2024-09-20T23:58:48.106272+0000 mgr.a (mgr.14388) 4511 : audit [DBG] from='client.107490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:48 smithi049 bash[23528]: audit 2024-09-20T23:58:48.106272+0000 mgr.a (mgr.14388) 4511 : audit [DBG] from='client.107490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:49 smithi044 bash[22676]: cluster 2024-09-20T23:58:48.761815+0000 mgr.a (mgr.14388) 4512 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:49 smithi179 bash[23186]: cluster 2024-09-20T23:58:48.761815+0000 mgr.a (mgr.14388) 4512 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:49 smithi049 bash[23528]: cluster 2024-09-20T23:58:48.761815+0000 mgr.a (mgr.14388) 4512 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:51 smithi044 bash[22676]: cluster 2024-09-20T23:58:50.764011+0000 mgr.a (mgr.14388) 4513 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:51 smithi179 bash[23186]: cluster 2024-09-20T23:58:50.764011+0000 mgr.a (mgr.14388) 4513 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:51 smithi049 bash[23528]: cluster 2024-09-20T23:58:50.764011+0000 mgr.a (mgr.14388) 4513 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:53.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:53.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:53.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:58:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:53 smithi044 bash[22676]: cluster 2024-09-20T23:58:52.764762+0000 mgr.a (mgr.14388) 4514 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:53 smithi179 bash[23186]: cluster 2024-09-20T23:58:52.764762+0000 mgr.a (mgr.14388) 4514 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:54.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:53 smithi049 bash[23528]: cluster 2024-09-20T23:58:52.764762+0000 mgr.a (mgr.14388) 4514 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:54.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:58:54.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:58:54.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:58:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:58:54.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:58:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:54 smithi044 bash[22676]: audit 2024-09-20T23:58:53.908646+0000 mgr.a (mgr.14388) 4515 : audit [DBG] from='client.107565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:54 smithi179 bash[23186]: audit 2024-09-20T23:58:53.908646+0000 mgr.a (mgr.14388) 4515 : audit [DBG] from='client.107565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:54 smithi049 bash[23528]: audit 2024-09-20T23:58:53.908646+0000 mgr.a (mgr.14388) 4515 : audit [DBG] from='client.107565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:58:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:55 smithi044 bash[22676]: cluster 2024-09-20T23:58:54.765735+0000 mgr.a (mgr.14388) 4516 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:55 smithi179 bash[23186]: cluster 2024-09-20T23:58:54.765735+0000 mgr.a (mgr.14388) 4516 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:55 smithi049 bash[23528]: cluster 2024-09-20T23:58:54.765735+0000 mgr.a (mgr.14388) 4516 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:58:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:57 smithi044 bash[22676]: cluster 2024-09-20T23:58:56.768013+0000 mgr.a (mgr.14388) 4517 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:57 smithi044 bash[22676]: audit 2024-09-20T23:58:57.579982+0000 mon.a (mon.0) 4203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:57 smithi044 bash[22676]: audit 2024-09-20T23:58:57.589867+0000 mon.a (mon.0) 4204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:57 smithi044 bash[22676]: audit 2024-09-20T23:58:57.601866+0000 mon.a (mon.0) 4205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:57 smithi179 bash[23186]: cluster 2024-09-20T23:58:56.768013+0000 mgr.a (mgr.14388) 4517 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:57 smithi179 bash[23186]: audit 2024-09-20T23:58:57.579982+0000 mon.a (mon.0) 4203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:57 smithi179 bash[23186]: audit 2024-09-20T23:58:57.589867+0000 mon.a (mon.0) 4204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:57 smithi179 bash[23186]: audit 2024-09-20T23:58:57.601866+0000 mon.a (mon.0) 4205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:57 smithi049 bash[23528]: cluster 2024-09-20T23:58:56.768013+0000 mgr.a (mgr.14388) 4517 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:58:58.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:57 smithi049 bash[23528]: audit 2024-09-20T23:58:57.579982+0000 mon.a (mon.0) 4203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:57 smithi049 bash[23528]: audit 2024-09-20T23:58:57.589867+0000 mon.a (mon.0) 4204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:58.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:57 smithi049 bash[23528]: audit 2024-09-20T23:58:57.601866+0000 mon.a (mon.0) 4205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:58:59.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:58:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:58:59.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:58:59 smithi179 bash[23186]: cluster 2024-09-20T23:58:58.768786+0000 mgr.a (mgr.14388) 4518 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:00.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:00.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:58:59 smithi044 bash[22676]: cluster 2024-09-20T23:58:58.768786+0000 mgr.a (mgr.14388) 4518 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:58:59 smithi049 bash[23528]: cluster 2024-09-20T23:58:58.768786+0000 mgr.a (mgr.14388) 4518 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:01.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:00 smithi179 bash[23186]: audit 2024-09-20T23:58:59.674076+0000 mgr.a (mgr.14388) 4519 : audit [DBG] from='client.107640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:01.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:00 smithi179 bash[23186]: audit 2024-09-20T23:59:00.453020+0000 mon.a (mon.0) 4206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:00 smithi179 bash[23186]: audit 2024-09-20T23:59:00.462601+0000 mon.a (mon.0) 4207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.182 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:00 smithi179 bash[23186]: audit 2024-09-20T23:59:00.472741+0000 mon.a (mon.0) 4208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:00 smithi044 bash[22676]: audit 2024-09-20T23:58:59.674076+0000 mgr.a (mgr.14388) 4519 : audit [DBG] from='client.107640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:00 smithi044 bash[22676]: audit 2024-09-20T23:59:00.453020+0000 mon.a (mon.0) 4206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:00 smithi044 bash[22676]: audit 2024-09-20T23:59:00.462601+0000 mon.a (mon.0) 4207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:00 smithi044 bash[22676]: audit 2024-09-20T23:59:00.472741+0000 mon.a (mon.0) 4208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:00 smithi049 bash[23528]: audit 2024-09-20T23:58:59.674076+0000 mgr.a (mgr.14388) 4519 : audit [DBG] from='client.107640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:00 smithi049 bash[23528]: audit 2024-09-20T23:59:00.453020+0000 mon.a (mon.0) 4206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:00 smithi049 bash[23528]: audit 2024-09-20T23:59:00.462601+0000 mon.a (mon.0) 4207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:00 smithi049 bash[23528]: audit 2024-09-20T23:59:00.472741+0000 mon.a (mon.0) 4208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:01 smithi049 bash[23528]: cluster 2024-09-20T23:59:00.771162+0000 mgr.a (mgr.14388) 4520 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:59:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:01 smithi049 bash[23528]: audit 2024-09-20T23:59:01.585170+0000 mon.a (mon.0) 4209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:01 smithi049 bash[23528]: audit 2024-09-20T23:59:01.593350+0000 mon.a (mon.0) 4210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:01 smithi049 bash[23528]: audit 2024-09-20T23:59:01.603134+0000 mon.a (mon.0) 4211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:01 smithi044 bash[22676]: cluster 2024-09-20T23:59:00.771162+0000 mgr.a (mgr.14388) 4520 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:59:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:01 smithi044 bash[22676]: audit 2024-09-20T23:59:01.585170+0000 mon.a (mon.0) 4209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:01 smithi044 bash[22676]: audit 2024-09-20T23:59:01.593350+0000 mon.a (mon.0) 4210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:01 smithi044 bash[22676]: audit 2024-09-20T23:59:01.603134+0000 mon.a (mon.0) 4211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:01 smithi179 bash[23186]: cluster 2024-09-20T23:59:00.771162+0000 mgr.a (mgr.14388) 4520 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-20T23:59:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:01 smithi179 bash[23186]: audit 2024-09-20T23:59:01.585170+0000 mon.a (mon.0) 4209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:01 smithi179 bash[23186]: audit 2024-09-20T23:59:01.593350+0000 mon.a (mon.0) 4210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:01 smithi179 bash[23186]: audit 2024-09-20T23:59:01.603134+0000 mon.a (mon.0) 4211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:03 smithi044 bash[22676]: cluster 2024-09-20T23:59:02.771989+0000 mgr.a (mgr.14388) 4521 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:59:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:03 smithi179 bash[23186]: cluster 2024-09-20T23:59:02.771989+0000 mgr.a (mgr.14388) 4521 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:59:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:03 smithi049 bash[23528]: cluster 2024-09-20T23:59:02.771989+0000 mgr.a (mgr.14388) 4521 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:59:05.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:05.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:05.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:05.891 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:05.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:05.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:05.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:05.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:05 smithi044 bash[22676]: cluster 2024-09-20T23:59:04.772763+0000 mgr.a (mgr.14388) 4522 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:59:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:05 smithi179 bash[23186]: cluster 2024-09-20T23:59:04.772763+0000 mgr.a (mgr.14388) 4522 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:59:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:05 smithi049 bash[23528]: cluster 2024-09-20T23:59:04.772763+0000 mgr.a (mgr.14388) 4522 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-20T23:59:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:06 smithi044 bash[22676]: audit 2024-09-20T23:59:05.453159+0000 mgr.a (mgr.14388) 4523 : audit [DBG] from='client.107718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:06 smithi179 bash[23186]: audit 2024-09-20T23:59:05.453159+0000 mgr.a (mgr.14388) 4523 : audit [DBG] from='client.107718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:06 smithi049 bash[23528]: audit 2024-09-20T23:59:05.453159+0000 mgr.a (mgr.14388) 4523 : audit [DBG] from='client.107718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:07.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:07 smithi044 bash[22676]: cluster 2024-09-20T23:59:06.774525+0000 mgr.a (mgr.14388) 4524 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:07 smithi179 bash[23186]: cluster 2024-09-20T23:59:06.774525+0000 mgr.a (mgr.14388) 4524 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:07 smithi049 bash[23528]: cluster 2024-09-20T23:59:06.774525+0000 mgr.a (mgr.14388) 4524 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:09 smithi044 bash[22676]: cluster 2024-09-20T23:59:08.775302+0000 mgr.a (mgr.14388) 4525 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:59:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:09 smithi179 bash[23186]: cluster 2024-09-20T23:59:08.775302+0000 mgr.a (mgr.14388) 4525 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:59:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:09 smithi049 bash[23528]: cluster 2024-09-20T23:59:08.775302+0000 mgr.a (mgr.14388) 4525 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:59:10.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:10.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:10.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:11.637 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:11.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:11.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:11.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:11.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:11 smithi044 bash[22676]: cluster 2024-09-20T23:59:10.777353+0000 mgr.a (mgr.14388) 4526 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:11 smithi044 bash[22676]: audit 2024-09-20T23:59:11.225759+0000 mgr.a (mgr.14388) 4527 : audit [DBG] from='client.107793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:11 smithi179 bash[23186]: cluster 2024-09-20T23:59:10.777353+0000 mgr.a (mgr.14388) 4526 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:11 smithi179 bash[23186]: audit 2024-09-20T23:59:11.225759+0000 mgr.a (mgr.14388) 4527 : audit [DBG] from='client.107793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:11 smithi049 bash[23528]: cluster 2024-09-20T23:59:10.777353+0000 mgr.a (mgr.14388) 4526 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:11 smithi049 bash[23528]: audit 2024-09-20T23:59:11.225759+0000 mgr.a (mgr.14388) 4527 : audit [DBG] from='client.107793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:13 smithi044 bash[22676]: cluster 2024-09-20T23:59:12.778494+0000 mgr.a (mgr.14388) 4528 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:59:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:13 smithi179 bash[23186]: cluster 2024-09-20T23:59:12.778494+0000 mgr.a (mgr.14388) 4528 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:59:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:13 smithi049 bash[23528]: cluster 2024-09-20T23:59:12.778494+0000 mgr.a (mgr.14388) 4528 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:59:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:15 smithi044 bash[22676]: cluster 2024-09-20T23:59:14.779481+0000 mgr.a (mgr.14388) 4529 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:59:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:15 smithi179 bash[23186]: cluster 2024-09-20T23:59:14.779481+0000 mgr.a (mgr.14388) 4529 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:59:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:15 smithi049 bash[23528]: cluster 2024-09-20T23:59:14.779481+0000 mgr.a (mgr.14388) 4529 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-20T23:59:16.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:17.395 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:17.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:17.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:17.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:17.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:17 smithi049 bash[23528]: cluster 2024-09-20T23:59:16.781367+0000 mgr.a (mgr.14388) 4530 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:59:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:17 smithi049 bash[23528]: audit 2024-09-20T23:59:16.967450+0000 mgr.a (mgr.14388) 4531 : audit [DBG] from='client.107868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:17 smithi049 bash[23528]: audit 2024-09-20T23:59:17.731968+0000 mon.a (mon.0) 4212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:17 smithi049 bash[23528]: audit 2024-09-20T23:59:17.740363+0000 mon.a (mon.0) 4213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:17 smithi049 bash[23528]: audit 2024-09-20T23:59:17.750876+0000 mon.a (mon.0) 4214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:17 smithi044 bash[22676]: cluster 2024-09-20T23:59:16.781367+0000 mgr.a (mgr.14388) 4530 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:59:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:17 smithi044 bash[22676]: audit 2024-09-20T23:59:16.967450+0000 mgr.a (mgr.14388) 4531 : audit [DBG] from='client.107868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:17 smithi044 bash[22676]: audit 2024-09-20T23:59:17.731968+0000 mon.a (mon.0) 4212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:17 smithi044 bash[22676]: audit 2024-09-20T23:59:17.740363+0000 mon.a (mon.0) 4213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:17 smithi044 bash[22676]: audit 2024-09-20T23:59:17.750876+0000 mon.a (mon.0) 4214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:17 smithi179 bash[23186]: cluster 2024-09-20T23:59:16.781367+0000 mgr.a (mgr.14388) 4530 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-20T23:59:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:17 smithi179 bash[23186]: audit 2024-09-20T23:59:16.967450+0000 mgr.a (mgr.14388) 4531 : audit [DBG] from='client.107868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:17 smithi179 bash[23186]: audit 2024-09-20T23:59:17.731968+0000 mon.a (mon.0) 4212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:17 smithi179 bash[23186]: audit 2024-09-20T23:59:17.740363+0000 mon.a (mon.0) 4213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:17 smithi179 bash[23186]: audit 2024-09-20T23:59:17.750876+0000 mon.a (mon.0) 4214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:19 smithi044 bash[22676]: cluster 2024-09-20T23:59:18.782329+0000 mgr.a (mgr.14388) 4532 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:19 smithi179 bash[23186]: cluster 2024-09-20T23:59:18.782329+0000 mgr.a (mgr.14388) 4532 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:20.256 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:19 smithi049 bash[23528]: cluster 2024-09-20T23:59:18.782329+0000 mgr.a (mgr.14388) 4532 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:21 smithi044 bash[22676]: audit 2024-09-20T23:59:20.653408+0000 mon.a (mon.0) 4215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:21 smithi044 bash[22676]: audit 2024-09-20T23:59:20.661616+0000 mon.a (mon.0) 4216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:21 smithi044 bash[22676]: audit 2024-09-20T23:59:20.671704+0000 mon.a (mon.0) 4217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:21 smithi044 bash[22676]: cluster 2024-09-20T23:59:20.784556+0000 mgr.a (mgr.14388) 4533 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:21 smithi179 bash[23186]: audit 2024-09-20T23:59:20.653408+0000 mon.a (mon.0) 4215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:21 smithi179 bash[23186]: audit 2024-09-20T23:59:20.661616+0000 mon.a (mon.0) 4216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:21 smithi179 bash[23186]: audit 2024-09-20T23:59:20.671704+0000 mon.a (mon.0) 4217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:21 smithi179 bash[23186]: cluster 2024-09-20T23:59:20.784556+0000 mgr.a (mgr.14388) 4533 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:21 smithi049 bash[23528]: audit 2024-09-20T23:59:20.653408+0000 mon.a (mon.0) 4215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:21 smithi049 bash[23528]: audit 2024-09-20T23:59:20.661616+0000 mon.a (mon.0) 4216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:21 smithi049 bash[23528]: audit 2024-09-20T23:59:20.671704+0000 mon.a (mon.0) 4217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:21 smithi049 bash[23528]: cluster 2024-09-20T23:59:20.784556+0000 mgr.a (mgr.14388) 4533 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:22.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:22.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:22.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:23.185 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:23.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:23.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:23.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:23.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:22 smithi044 bash[22676]: audit 2024-09-20T23:59:21.820624+0000 mon.a (mon.0) 4218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:22 smithi044 bash[22676]: audit 2024-09-20T23:59:21.829078+0000 mon.a (mon.0) 4219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:22 smithi044 bash[22676]: audit 2024-09-20T23:59:21.839234+0000 mon.a (mon.0) 4220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:22 smithi179 bash[23186]: audit 2024-09-20T23:59:21.820624+0000 mon.a (mon.0) 4218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:22 smithi179 bash[23186]: audit 2024-09-20T23:59:21.829078+0000 mon.a (mon.0) 4219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:22 smithi179 bash[23186]: audit 2024-09-20T23:59:21.839234+0000 mon.a (mon.0) 4220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:22 smithi049 bash[23528]: audit 2024-09-20T23:59:21.820624+0000 mon.a (mon.0) 4218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:22 smithi049 bash[23528]: audit 2024-09-20T23:59:21.829078+0000 mon.a (mon.0) 4219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:22 smithi049 bash[23528]: audit 2024-09-20T23:59:21.839234+0000 mon.a (mon.0) 4220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:23 smithi044 bash[22676]: audit 2024-09-20T23:59:22.734055+0000 mgr.a (mgr.14388) 4534 : audit [DBG] from='client.107943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:23 smithi044 bash[22676]: cluster 2024-09-20T23:59:22.785628+0000 mgr.a (mgr.14388) 4535 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:23 smithi179 bash[23186]: audit 2024-09-20T23:59:22.734055+0000 mgr.a (mgr.14388) 4534 : audit [DBG] from='client.107943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:23 smithi179 bash[23186]: cluster 2024-09-20T23:59:22.785628+0000 mgr.a (mgr.14388) 4535 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:23 smithi049 bash[23528]: audit 2024-09-20T23:59:22.734055+0000 mgr.a (mgr.14388) 4534 : audit [DBG] from='client.107943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:23 smithi049 bash[23528]: cluster 2024-09-20T23:59:22.785628+0000 mgr.a (mgr.14388) 4535 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:25 smithi044 bash[22676]: cluster 2024-09-20T23:59:24.786558+0000 mgr.a (mgr.14388) 4536 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:25 smithi179 bash[23186]: cluster 2024-09-20T23:59:24.786558+0000 mgr.a (mgr.14388) 4536 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:25 smithi049 bash[23528]: cluster 2024-09-20T23:59:24.786558+0000 mgr.a (mgr.14388) 4536 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:28.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:28.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:28.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:27 smithi044 bash[22676]: cluster 2024-09-20T23:59:26.788823+0000 mgr.a (mgr.14388) 4537 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:27 smithi179 bash[23186]: cluster 2024-09-20T23:59:26.788823+0000 mgr.a (mgr.14388) 4537 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:28.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:27 smithi049 bash[23528]: cluster 2024-09-20T23:59:26.788823+0000 mgr.a (mgr.14388) 4537 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:28.993 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:28.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:28.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:28.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:28.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:30.227 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:29 smithi044 bash[22676]: audit 2024-09-20T23:59:28.523785+0000 mgr.a (mgr.14388) 4538 : audit [DBG] from='client.108018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:30.227 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:29 smithi044 bash[22676]: cluster 2024-09-20T23:59:28.789423+0000 mgr.a (mgr.14388) 4539 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:29 smithi179 bash[23186]: audit 2024-09-20T23:59:28.523785+0000 mgr.a (mgr.14388) 4538 : audit [DBG] from='client.108018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:29 smithi179 bash[23186]: cluster 2024-09-20T23:59:28.789423+0000 mgr.a (mgr.14388) 4539 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:29 smithi049 bash[23528]: audit 2024-09-20T23:59:28.523785+0000 mgr.a (mgr.14388) 4538 : audit [DBG] from='client.108018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:29 smithi049 bash[23528]: cluster 2024-09-20T23:59:28.789423+0000 mgr.a (mgr.14388) 4539 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:32.130 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:31 smithi044 bash[22676]: cluster 2024-09-20T23:59:30.791557+0000 mgr.a (mgr.14388) 4540 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:31 smithi179 bash[23186]: cluster 2024-09-20T23:59:30.791557+0000 mgr.a (mgr.14388) 4540 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:31 smithi049 bash[23528]: cluster 2024-09-20T23:59:30.791557+0000 mgr.a (mgr.14388) 4540 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:33.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:33.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:33.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:33 smithi044 bash[22676]: cluster 2024-09-20T23:59:32.792328+0000 mgr.a (mgr.14388) 4541 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:33 smithi044 bash[22676]: audit 2024-09-20T23:59:33.745805+0000 mon.a (mon.0) 4221 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:59:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:33 smithi044 bash[22676]: audit 2024-09-20T23:59:33.752899+0000 mon.a (mon.0) 4222 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:59:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:33 smithi044 bash[22676]: audit 2024-09-20T23:59:33.754826+0000 mon.a (mon.0) 4223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:59:34.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:33 smithi044 bash[22676]: audit 2024-09-20T23:59:33.766666+0000 mon.a (mon.0) 4224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:34.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:33 smithi044 bash[22676]: audit 2024-09-20T23:59:33.773156+0000 mon.a (mon.0) 4225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:59:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:33 smithi179 bash[23186]: cluster 2024-09-20T23:59:32.792328+0000 mgr.a (mgr.14388) 4541 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:33 smithi179 bash[23186]: audit 2024-09-20T23:59:33.745805+0000 mon.a (mon.0) 4221 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:59:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:33 smithi179 bash[23186]: audit 2024-09-20T23:59:33.752899+0000 mon.a (mon.0) 4222 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:59:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:33 smithi179 bash[23186]: audit 2024-09-20T23:59:33.754826+0000 mon.a (mon.0) 4223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:59:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:33 smithi179 bash[23186]: audit 2024-09-20T23:59:33.766666+0000 mon.a (mon.0) 4224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:33 smithi179 bash[23186]: audit 2024-09-20T23:59:33.773156+0000 mon.a (mon.0) 4225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:59:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:33 smithi049 bash[23528]: cluster 2024-09-20T23:59:32.792328+0000 mgr.a (mgr.14388) 4541 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:33 smithi049 bash[23528]: audit 2024-09-20T23:59:33.745805+0000 mon.a (mon.0) 4221 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T23:59:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:33 smithi049 bash[23528]: audit 2024-09-20T23:59:33.752899+0000 mon.a (mon.0) 4222 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T23:59:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:33 smithi049 bash[23528]: audit 2024-09-20T23:59:33.754826+0000 mon.a (mon.0) 4223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T23:59:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:33 smithi049 bash[23528]: audit 2024-09-20T23:59:33.766666+0000 mon.a (mon.0) 4224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:33 smithi049 bash[23528]: audit 2024-09-20T23:59:33.773156+0000 mon.a (mon.0) 4225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:59:34.869 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:59:34 smithi044 bash[22930]: debug 2024-09-20T23:59:34.566+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:59:34.869 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 20 23:59:34 smithi044 bash[22930]: debug 2024-09-20T23:59:34.578+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:59:34.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:34.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:34.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:34.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:34.967 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:34 smithi044 bash[22676]: audit 2024-09-20T23:59:33.775564+0000 mgr.a (mgr.14388) 4542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:59:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:34 smithi179 bash[23186]: audit 2024-09-20T23:59:33.775564+0000 mgr.a (mgr.14388) 4542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:59:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:34 smithi049 bash[23528]: audit 2024-09-20T23:59:33.775564+0000 mgr.a (mgr.14388) 4542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-20T23:59:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:35 smithi044 bash[22676]: audit 2024-09-20T23:59:34.360390+0000 mgr.a (mgr.14388) 4543 : audit [DBG] from='client.108135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:35 smithi044 bash[22676]: audit 2024-09-20T23:59:34.569901+0000 mgr.a (mgr.14388) 4544 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:59:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:35 smithi044 bash[22676]: cephadm 2024-09-20T23:59:34.581281+0000 mgr.a (mgr.14388) 4545 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:59:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:35 smithi044 bash[22676]: cluster 2024-09-20T23:59:34.792908+0000 mgr.a (mgr.14388) 4546 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:35 smithi179 bash[23186]: audit 2024-09-20T23:59:34.360390+0000 mgr.a (mgr.14388) 4543 : audit [DBG] from='client.108135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:35 smithi179 bash[23186]: audit 2024-09-20T23:59:34.569901+0000 mgr.a (mgr.14388) 4544 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:59:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:35 smithi179 bash[23186]: cephadm 2024-09-20T23:59:34.581281+0000 mgr.a (mgr.14388) 4545 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:59:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:35 smithi179 bash[23186]: cluster 2024-09-20T23:59:34.792908+0000 mgr.a (mgr.14388) 4546 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:35 smithi049 bash[23528]: audit 2024-09-20T23:59:34.360390+0000 mgr.a (mgr.14388) 4543 : audit [DBG] from='client.108135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:35 smithi049 bash[23528]: audit 2024-09-20T23:59:34.569901+0000 mgr.a (mgr.14388) 4544 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-20T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:35 smithi049 bash[23528]: cephadm 2024-09-20T23:59:34.581281+0000 mgr.a (mgr.14388) 4545 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-20T23:59:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:35 smithi049 bash[23528]: cluster 2024-09-20T23:59:34.792908+0000 mgr.a (mgr.14388) 4546 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:37.996 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:37 smithi049 bash[23528]: cluster 2024-09-20T23:59:36.795223+0000 mgr.a (mgr.14388) 4547 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:37 smithi044 bash[22676]: cluster 2024-09-20T23:59:36.795223+0000 mgr.a (mgr.14388) 4547 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:37 smithi179 bash[23186]: cluster 2024-09-20T23:59:36.795223+0000 mgr.a (mgr.14388) 4547 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:38 smithi049 bash[23528]: audit 2024-09-20T23:59:37.893583+0000 mon.a (mon.0) 4226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:38 smithi049 bash[23528]: audit 2024-09-20T23:59:37.902559+0000 mon.a (mon.0) 4227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:38 smithi049 bash[23528]: audit 2024-09-20T23:59:37.913275+0000 mon.a (mon.0) 4228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:38 smithi044 bash[22676]: audit 2024-09-20T23:59:37.893583+0000 mon.a (mon.0) 4226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:38 smithi044 bash[22676]: audit 2024-09-20T23:59:37.902559+0000 mon.a (mon.0) 4227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:38 smithi044 bash[22676]: audit 2024-09-20T23:59:37.913275+0000 mon.a (mon.0) 4228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:38 smithi179 bash[23186]: audit 2024-09-20T23:59:37.893583+0000 mon.a (mon.0) 4226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:38 smithi179 bash[23186]: audit 2024-09-20T23:59:37.902559+0000 mon.a (mon.0) 4227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:38 smithi179 bash[23186]: audit 2024-09-20T23:59:37.913275+0000 mon.a (mon.0) 4228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:39.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:39.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:39.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:40.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:39 smithi179 bash[23186]: cluster 2024-09-20T23:59:38.796027+0000 mgr.a (mgr.14388) 4548 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:39 smithi049 bash[23528]: cluster 2024-09-20T23:59:38.796027+0000 mgr.a (mgr.14388) 4548 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:39 smithi044 bash[22676]: cluster 2024-09-20T23:59:38.796027+0000 mgr.a (mgr.14388) 4548 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:40.718 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:40.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:40.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:40.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:40.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:42.220 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:41 smithi179 bash[23186]: audit 2024-09-20T23:59:40.303915+0000 mgr.a (mgr.14388) 4549 : audit [DBG] from='client.108279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:42.220 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:41 smithi179 bash[23186]: cluster 2024-09-20T23:59:40.797926+0000 mgr.a (mgr.14388) 4550 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:42.220 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:41 smithi179 bash[23186]: audit 2024-09-20T23:59:40.878151+0000 mon.a (mon.0) 4229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.220 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:41 smithi179 bash[23186]: audit 2024-09-20T23:59:40.886254+0000 mon.a (mon.0) 4230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.220 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:41 smithi179 bash[23186]: audit 2024-09-20T23:59:40.896321+0000 mon.a (mon.0) 4231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:41 smithi044 bash[22676]: audit 2024-09-20T23:59:40.303915+0000 mgr.a (mgr.14388) 4549 : audit [DBG] from='client.108279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:41 smithi044 bash[22676]: cluster 2024-09-20T23:59:40.797926+0000 mgr.a (mgr.14388) 4550 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:41 smithi044 bash[22676]: audit 2024-09-20T23:59:40.878151+0000 mon.a (mon.0) 4229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:41 smithi044 bash[22676]: audit 2024-09-20T23:59:40.886254+0000 mon.a (mon.0) 4230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:41 smithi044 bash[22676]: audit 2024-09-20T23:59:40.896321+0000 mon.a (mon.0) 4231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:41 smithi049 bash[23528]: audit 2024-09-20T23:59:40.303915+0000 mgr.a (mgr.14388) 4549 : audit [DBG] from='client.108279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:41 smithi049 bash[23528]: cluster 2024-09-20T23:59:40.797926+0000 mgr.a (mgr.14388) 4550 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:41 smithi049 bash[23528]: audit 2024-09-20T23:59:40.878151+0000 mon.a (mon.0) 4229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:41 smithi049 bash[23528]: audit 2024-09-20T23:59:40.886254+0000 mon.a (mon.0) 4230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:41 smithi049 bash[23528]: audit 2024-09-20T23:59:40.896321+0000 mon.a (mon.0) 4231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:43 smithi044 bash[22676]: audit 2024-09-20T23:59:42.061932+0000 mon.a (mon.0) 4232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:43 smithi044 bash[22676]: audit 2024-09-20T23:59:42.071826+0000 mon.a (mon.0) 4233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:43 smithi044 bash[22676]: audit 2024-09-20T23:59:42.083488+0000 mon.a (mon.0) 4234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:43 smithi179 bash[23186]: audit 2024-09-20T23:59:42.061932+0000 mon.a (mon.0) 4232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:43 smithi179 bash[23186]: audit 2024-09-20T23:59:42.071826+0000 mon.a (mon.0) 4233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:43 smithi179 bash[23186]: audit 2024-09-20T23:59:42.083488+0000 mon.a (mon.0) 4234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:43 smithi049 bash[23528]: audit 2024-09-20T23:59:42.061932+0000 mon.a (mon.0) 4232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:43 smithi049 bash[23528]: audit 2024-09-20T23:59:42.071826+0000 mon.a (mon.0) 4233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:43 smithi049 bash[23528]: audit 2024-09-20T23:59:42.083488+0000 mon.a (mon.0) 4234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:44 smithi044 bash[22676]: cluster 2024-09-20T23:59:42.798656+0000 mgr.a (mgr.14388) 4551 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:59:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:44 smithi179 bash[23186]: cluster 2024-09-20T23:59:42.798656+0000 mgr.a (mgr.14388) 4551 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:59:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:44 smithi049 bash[23528]: cluster 2024-09-20T23:59:42.798656+0000 mgr.a (mgr.14388) 4551 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:59:45.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:45.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:45.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:46.480 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:46.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:46.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:46.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:46.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:46 smithi044 bash[22676]: cluster 2024-09-20T23:59:44.799437+0000 mgr.a (mgr.14388) 4552 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:59:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:46 smithi179 bash[23186]: cluster 2024-09-20T23:59:44.799437+0000 mgr.a (mgr.14388) 4552 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:59:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:46 smithi049 bash[23528]: cluster 2024-09-20T23:59:44.799437+0000 mgr.a (mgr.14388) 4552 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-20T23:59:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:47 smithi044 bash[22676]: audit 2024-09-20T23:59:46.052751+0000 mgr.a (mgr.14388) 4553 : audit [DBG] from='client.108354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:47 smithi179 bash[23186]: audit 2024-09-20T23:59:46.052751+0000 mgr.a (mgr.14388) 4553 : audit [DBG] from='client.108354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:47 smithi049 bash[23528]: audit 2024-09-20T23:59:46.052751+0000 mgr.a (mgr.14388) 4553 : audit [DBG] from='client.108354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:48 smithi044 bash[22676]: cluster 2024-09-20T23:59:46.802233+0000 mgr.a (mgr.14388) 4554 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:48 smithi179 bash[23186]: cluster 2024-09-20T23:59:46.802233+0000 mgr.a (mgr.14388) 4554 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:48 smithi049 bash[23528]: cluster 2024-09-20T23:59:46.802233+0000 mgr.a (mgr.14388) 4554 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-20T23:59:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:50 smithi044 bash[22676]: cluster 2024-09-20T23:59:48.803063+0000 mgr.a (mgr.14388) 4555 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:59:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:50 smithi179 bash[23186]: cluster 2024-09-20T23:59:48.803063+0000 mgr.a (mgr.14388) 4555 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:59:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:50 smithi049 bash[23528]: cluster 2024-09-20T23:59:48.803063+0000 mgr.a (mgr.14388) 4555 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-20T23:59:51.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:51.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:51.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:52.261 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:52.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:52.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:52.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:52.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:52 smithi044 bash[22676]: cluster 2024-09-20T23:59:50.805226+0000 mgr.a (mgr.14388) 4556 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:52 smithi179 bash[23186]: cluster 2024-09-20T23:59:50.805226+0000 mgr.a (mgr.14388) 4556 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:52 smithi049 bash[23528]: cluster 2024-09-20T23:59:50.805226+0000 mgr.a (mgr.14388) 4556 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:53 smithi044 bash[22676]: audit 2024-09-20T23:59:51.818506+0000 mgr.a (mgr.14388) 4557 : audit [DBG] from='client.108429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:53 smithi179 bash[23186]: audit 2024-09-20T23:59:51.818506+0000 mgr.a (mgr.14388) 4557 : audit [DBG] from='client.108429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:53 smithi049 bash[23528]: audit 2024-09-20T23:59:51.818506+0000 mgr.a (mgr.14388) 4557 : audit [DBG] from='client.108429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:54 smithi044 bash[22676]: cluster 2024-09-20T23:59:52.806237+0000 mgr.a (mgr.14388) 4558 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:54 smithi179 bash[23186]: cluster 2024-09-20T23:59:52.806237+0000 mgr.a (mgr.14388) 4558 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:54 smithi049 bash[23528]: cluster 2024-09-20T23:59:52.806237+0000 mgr.a (mgr.14388) 4558 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:56 smithi044 bash[22676]: cluster 2024-09-20T23:59:54.807166+0000 mgr.a (mgr.14388) 4559 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:56 smithi179 bash[23186]: cluster 2024-09-20T23:59:54.807166+0000 mgr.a (mgr.14388) 4559 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:56 smithi049 bash[23528]: cluster 2024-09-20T23:59:54.807166+0000 mgr.a (mgr.14388) 4559 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-20T23:59:57.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-20T23:59:57.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-20T23:59:57.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-20T23:59:58.047 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-20T23:59:58.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-20T23:59:58.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-20T23:59:58.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-20T23:59:58.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-20T23:59:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:58 smithi049 bash[23528]: cluster 2024-09-20T23:59:56.809565+0000 mgr.a (mgr.14388) 4560 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:58 smithi049 bash[23528]: audit 2024-09-20T23:59:58.090241+0000 mon.a (mon.0) 4235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:58 smithi049 bash[23528]: audit 2024-09-20T23:59:58.095569+0000 mon.a (mon.0) 4236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:58 smithi049 bash[23528]: audit 2024-09-20T23:59:58.100569+0000 mon.a (mon.0) 4237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:58 smithi044 bash[22676]: cluster 2024-09-20T23:59:56.809565+0000 mgr.a (mgr.14388) 4560 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:58 smithi044 bash[22676]: audit 2024-09-20T23:59:58.090241+0000 mon.a (mon.0) 4235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:58 smithi044 bash[22676]: audit 2024-09-20T23:59:58.095569+0000 mon.a (mon.0) 4236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:58 smithi044 bash[22676]: audit 2024-09-20T23:59:58.100569+0000 mon.a (mon.0) 4237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:58 smithi179 bash[23186]: cluster 2024-09-20T23:59:56.809565+0000 mgr.a (mgr.14388) 4560 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-20T23:59:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:58 smithi179 bash[23186]: audit 2024-09-20T23:59:58.090241+0000 mon.a (mon.0) 4235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:58 smithi179 bash[23186]: audit 2024-09-20T23:59:58.095569+0000 mon.a (mon.0) 4236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:58 smithi179 bash[23186]: audit 2024-09-20T23:59:58.100569+0000 mon.a (mon.0) 4237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-20T23:59:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 20 23:59:59 smithi049 bash[23528]: audit 2024-09-20T23:59:57.601970+0000 mgr.a (mgr.14388) 4561 : audit [DBG] from='client.108507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 20 23:59:59 smithi044 bash[22676]: audit 2024-09-20T23:59:57.601970+0000 mgr.a (mgr.14388) 4561 : audit [DBG] from='client.108507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T23:59:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 20 23:59:59 smithi179 bash[23186]: audit 2024-09-20T23:59:57.601970+0000 mgr.a (mgr.14388) 4561 : audit [DBG] from='client.108507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:00.453 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:00 smithi049 bash[23528]: cluster 2024-09-20T23:59:58.810537+0000 mgr.a (mgr.14388) 4562 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:00.453 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:00 smithi049 bash[23528]: cluster 2024-09-21T00:00:00.000147+0000 mon.a (mon.0) 4238 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:00:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:00 smithi044 bash[22676]: cluster 2024-09-20T23:59:58.810537+0000 mgr.a (mgr.14388) 4562 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:00 smithi044 bash[22676]: cluster 2024-09-21T00:00:00.000147+0000 mon.a (mon.0) 4238 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:00:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:00 smithi179 bash[23186]: cluster 2024-09-20T23:59:58.810537+0000 mgr.a (mgr.14388) 4562 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:00 smithi179 bash[23186]: cluster 2024-09-21T00:00:00.000147+0000 mon.a (mon.0) 4238 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:00:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:02 smithi179 bash[23186]: cluster 2024-09-21T00:00:00.812754+0000 mgr.a (mgr.14388) 4563 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:00:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:02 smithi179 bash[23186]: audit 2024-09-21T00:00:01.036598+0000 mon.a (mon.0) 4239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:02 smithi179 bash[23186]: audit 2024-09-21T00:00:01.045216+0000 mon.a (mon.0) 4240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:02 smithi179 bash[23186]: audit 2024-09-21T00:00:01.055507+0000 mon.a (mon.0) 4241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:02 smithi049 bash[23528]: cluster 2024-09-21T00:00:00.812754+0000 mgr.a (mgr.14388) 4563 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:00:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:02 smithi049 bash[23528]: audit 2024-09-21T00:00:01.036598+0000 mon.a (mon.0) 4239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:02 smithi049 bash[23528]: audit 2024-09-21T00:00:01.045216+0000 mon.a (mon.0) 4240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:02 smithi049 bash[23528]: audit 2024-09-21T00:00:01.055507+0000 mon.a (mon.0) 4241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.327 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:02 smithi044 bash[22676]: cluster 2024-09-21T00:00:00.812754+0000 mgr.a (mgr.14388) 4563 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:00:02.327 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:02 smithi044 bash[22676]: audit 2024-09-21T00:00:01.036598+0000 mon.a (mon.0) 4239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.327 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:02 smithi044 bash[22676]: audit 2024-09-21T00:00:01.045216+0000 mon.a (mon.0) 4240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:02.327 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:02 smithi044 bash[22676]: audit 2024-09-21T00:00:01.055507+0000 mon.a (mon.0) 4241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:03 smithi044 bash[22676]: audit 2024-09-21T00:00:02.304776+0000 mon.a (mon.0) 4242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:03 smithi044 bash[22676]: audit 2024-09-21T00:00:02.314061+0000 mon.a (mon.0) 4243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:03 smithi044 bash[22676]: audit 2024-09-21T00:00:02.325166+0000 mon.a (mon.0) 4244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:03 smithi044 bash[22676]: cluster 2024-09-21T00:00:02.813637+0000 mgr.a (mgr.14388) 4564 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:03 smithi179 bash[23186]: audit 2024-09-21T00:00:02.304776+0000 mon.a (mon.0) 4242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:03 smithi179 bash[23186]: audit 2024-09-21T00:00:02.314061+0000 mon.a (mon.0) 4243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:03 smithi179 bash[23186]: audit 2024-09-21T00:00:02.325166+0000 mon.a (mon.0) 4244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:03 smithi179 bash[23186]: cluster 2024-09-21T00:00:02.813637+0000 mgr.a (mgr.14388) 4564 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:03 smithi049 bash[23528]: audit 2024-09-21T00:00:02.304776+0000 mon.a (mon.0) 4242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:03 smithi049 bash[23528]: audit 2024-09-21T00:00:02.314061+0000 mon.a (mon.0) 4243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:03 smithi049 bash[23528]: audit 2024-09-21T00:00:02.325166+0000 mon.a (mon.0) 4244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:03 smithi049 bash[23528]: cluster 2024-09-21T00:00:02.813637+0000 mgr.a (mgr.14388) 4564 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:04 smithi044 bash[22676]: audit 2024-09-21T00:00:03.378234+0000 mgr.a (mgr.14388) 4565 : audit [DBG] from='client.108585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:04 smithi179 bash[23186]: audit 2024-09-21T00:00:03.378234+0000 mgr.a (mgr.14388) 4565 : audit [DBG] from='client.108585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:04 smithi049 bash[23528]: audit 2024-09-21T00:00:03.378234+0000 mgr.a (mgr.14388) 4565 : audit [DBG] from='client.108585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:05 smithi044 bash[22676]: cluster 2024-09-21T00:00:04.814644+0000 mgr.a (mgr.14388) 4566 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:05 smithi179 bash[23186]: cluster 2024-09-21T00:00:04.814644+0000 mgr.a (mgr.14388) 4566 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:05 smithi049 bash[23528]: cluster 2024-09-21T00:00:04.814644+0000 mgr.a (mgr.14388) 4566 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:07 smithi044 bash[22676]: cluster 2024-09-21T00:00:06.816933+0000 mgr.a (mgr.14388) 4567 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T00:00:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:07 smithi179 bash[23186]: cluster 2024-09-21T00:00:06.816933+0000 mgr.a (mgr.14388) 4567 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T00:00:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:07 smithi049 bash[23528]: cluster 2024-09-21T00:00:06.816933+0000 mgr.a (mgr.14388) 4567 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T00:00:08.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:08.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:09.562 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:10.173 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:09 smithi044 bash[22676]: cluster 2024-09-21T00:00:08.817658+0000 mgr.a (mgr.14388) 4568 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:10.173 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:09 smithi044 bash[22676]: audit 2024-09-21T00:00:09.140487+0000 mgr.a (mgr.14388) 4569 : audit [DBG] from='client.108663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:09 smithi179 bash[23186]: cluster 2024-09-21T00:00:08.817658+0000 mgr.a (mgr.14388) 4568 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:09 smithi179 bash[23186]: audit 2024-09-21T00:00:09.140487+0000 mgr.a (mgr.14388) 4569 : audit [DBG] from='client.108663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:09 smithi049 bash[23528]: cluster 2024-09-21T00:00:08.817658+0000 mgr.a (mgr.14388) 4568 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:09 smithi049 bash[23528]: audit 2024-09-21T00:00:09.140487+0000 mgr.a (mgr.14388) 4569 : audit [DBG] from='client.108663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:12.202 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:11 smithi044 bash[22676]: cluster 2024-09-21T00:00:10.820032+0000 mgr.a (mgr.14388) 4570 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T00:00:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:11 smithi179 bash[23186]: cluster 2024-09-21T00:00:10.820032+0000 mgr.a (mgr.14388) 4570 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T00:00:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:11 smithi049 bash[23528]: cluster 2024-09-21T00:00:10.820032+0000 mgr.a (mgr.14388) 4570 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T00:00:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:13 smithi044 bash[22676]: cluster 2024-09-21T00:00:12.820826+0000 mgr.a (mgr.14388) 4571 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:13 smithi179 bash[23186]: cluster 2024-09-21T00:00:12.820826+0000 mgr.a (mgr.14388) 4571 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:13 smithi049 bash[23528]: cluster 2024-09-21T00:00:12.820826+0000 mgr.a (mgr.14388) 4571 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:14.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:15.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:15 smithi044 bash[22676]: cluster 2024-09-21T00:00:14.821615+0000 mgr.a (mgr.14388) 4572 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:15 smithi044 bash[22676]: audit 2024-09-21T00:00:14.893569+0000 mgr.a (mgr.14388) 4573 : audit [DBG] from='client.108741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:15 smithi179 bash[23186]: cluster 2024-09-21T00:00:14.821615+0000 mgr.a (mgr.14388) 4572 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:15 smithi179 bash[23186]: audit 2024-09-21T00:00:14.893569+0000 mgr.a (mgr.14388) 4573 : audit [DBG] from='client.108741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:15 smithi049 bash[23528]: cluster 2024-09-21T00:00:14.821615+0000 mgr.a (mgr.14388) 4572 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:15 smithi049 bash[23528]: audit 2024-09-21T00:00:14.893569+0000 mgr.a (mgr.14388) 4573 : audit [DBG] from='client.108741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:17 smithi044 bash[22676]: cluster 2024-09-21T00:00:16.824412+0000 mgr.a (mgr.14388) 4574 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:17 smithi179 bash[23186]: cluster 2024-09-21T00:00:16.824412+0000 mgr.a (mgr.14388) 4574 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:17 smithi049 bash[23528]: cluster 2024-09-21T00:00:16.824412+0000 mgr.a (mgr.14388) 4574 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-21T00:00:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:19 smithi049 bash[23528]: audit 2024-09-21T00:00:18.284014+0000 mon.a (mon.0) 4245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:19 smithi049 bash[23528]: audit 2024-09-21T00:00:18.292535+0000 mon.a (mon.0) 4246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:19 smithi049 bash[23528]: audit 2024-09-21T00:00:18.302878+0000 mon.a (mon.0) 4247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:19 smithi049 bash[23528]: cluster 2024-09-21T00:00:18.825348+0000 mgr.a (mgr.14388) 4575 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:00:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:19 smithi044 bash[22676]: audit 2024-09-21T00:00:18.284014+0000 mon.a (mon.0) 4245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:19 smithi044 bash[22676]: audit 2024-09-21T00:00:18.292535+0000 mon.a (mon.0) 4246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:19 smithi044 bash[22676]: audit 2024-09-21T00:00:18.302878+0000 mon.a (mon.0) 4247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:19 smithi044 bash[22676]: cluster 2024-09-21T00:00:18.825348+0000 mgr.a (mgr.14388) 4575 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:00:19.767 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:19 smithi179 bash[23186]: audit 2024-09-21T00:00:18.284014+0000 mon.a (mon.0) 4245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.767 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:19 smithi179 bash[23186]: audit 2024-09-21T00:00:18.292535+0000 mon.a (mon.0) 4246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.767 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:19 smithi179 bash[23186]: audit 2024-09-21T00:00:18.302878+0000 mon.a (mon.0) 4247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:19.767 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:19 smithi179 bash[23186]: cluster 2024-09-21T00:00:18.825348+0000 mgr.a (mgr.14388) 4575 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:00:20.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:20.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:20.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:21.103 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:21.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:21.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:21.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:21.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:22 smithi044 bash[22676]: audit 2024-09-21T00:00:20.658199+0000 mgr.a (mgr.14388) 4576 : audit [DBG] from='client.108819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:22 smithi044 bash[22676]: cluster 2024-09-21T00:00:20.826701+0000 mgr.a (mgr.14388) 4577 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:22 smithi044 bash[22676]: audit 2024-09-21T00:00:21.205015+0000 mon.a (mon.0) 4248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:22 smithi044 bash[22676]: audit 2024-09-21T00:00:21.213193+0000 mon.a (mon.0) 4249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:22 smithi044 bash[22676]: audit 2024-09-21T00:00:21.223279+0000 mon.a (mon.0) 4250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:22 smithi179 bash[23186]: audit 2024-09-21T00:00:20.658199+0000 mgr.a (mgr.14388) 4576 : audit [DBG] from='client.108819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:22 smithi179 bash[23186]: cluster 2024-09-21T00:00:20.826701+0000 mgr.a (mgr.14388) 4577 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:22 smithi179 bash[23186]: audit 2024-09-21T00:00:21.205015+0000 mon.a (mon.0) 4248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:22 smithi179 bash[23186]: audit 2024-09-21T00:00:21.213193+0000 mon.a (mon.0) 4249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:22 smithi179 bash[23186]: audit 2024-09-21T00:00:21.223279+0000 mon.a (mon.0) 4250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:22 smithi049 bash[23528]: audit 2024-09-21T00:00:20.658199+0000 mgr.a (mgr.14388) 4576 : audit [DBG] from='client.108819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:22 smithi049 bash[23528]: cluster 2024-09-21T00:00:20.826701+0000 mgr.a (mgr.14388) 4577 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:22 smithi049 bash[23528]: audit 2024-09-21T00:00:21.205015+0000 mon.a (mon.0) 4248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:22 smithi049 bash[23528]: audit 2024-09-21T00:00:21.213193+0000 mon.a (mon.0) 4249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:22 smithi049 bash[23528]: audit 2024-09-21T00:00:21.223279+0000 mon.a (mon.0) 4250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:23 smithi049 bash[23528]: audit 2024-09-21T00:00:22.533032+0000 mon.a (mon.0) 4251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:23 smithi049 bash[23528]: audit 2024-09-21T00:00:22.538764+0000 mon.a (mon.0) 4252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:23 smithi049 bash[23528]: audit 2024-09-21T00:00:22.545303+0000 mon.a (mon.0) 4253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:23 smithi049 bash[23528]: cluster 2024-09-21T00:00:22.827547+0000 mgr.a (mgr.14388) 4578 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:00:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:23 smithi044 bash[22676]: audit 2024-09-21T00:00:22.533032+0000 mon.a (mon.0) 4251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:23 smithi044 bash[22676]: audit 2024-09-21T00:00:22.538764+0000 mon.a (mon.0) 4252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:23 smithi044 bash[22676]: audit 2024-09-21T00:00:22.545303+0000 mon.a (mon.0) 4253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:23 smithi044 bash[22676]: cluster 2024-09-21T00:00:22.827547+0000 mgr.a (mgr.14388) 4578 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:00:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:23 smithi179 bash[23186]: audit 2024-09-21T00:00:22.533032+0000 mon.a (mon.0) 4251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:23 smithi179 bash[23186]: audit 2024-09-21T00:00:22.538764+0000 mon.a (mon.0) 4252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:23 smithi179 bash[23186]: audit 2024-09-21T00:00:22.545303+0000 mon.a (mon.0) 4253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:23 smithi179 bash[23186]: cluster 2024-09-21T00:00:22.827547+0000 mgr.a (mgr.14388) 4578 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:00:26.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:26.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:26.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:25 smithi044 bash[22676]: cluster 2024-09-21T00:00:24.828338+0000 mgr.a (mgr.14388) 4579 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:00:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:25 smithi179 bash[23186]: cluster 2024-09-21T00:00:24.828338+0000 mgr.a (mgr.14388) 4579 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:00:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:25 smithi049 bash[23528]: cluster 2024-09-21T00:00:24.828338+0000 mgr.a (mgr.14388) 4579 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:00:26.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:26.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:26.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:26.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:26.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:27 smithi049 bash[23528]: audit 2024-09-21T00:00:26.441346+0000 mgr.a (mgr.14388) 4580 : audit [DBG] from='client.108897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:27 smithi049 bash[23528]: cluster 2024-09-21T00:00:26.829656+0000 mgr.a (mgr.14388) 4581 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:27 smithi044 bash[22676]: audit 2024-09-21T00:00:26.441346+0000 mgr.a (mgr.14388) 4580 : audit [DBG] from='client.108897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:27 smithi044 bash[22676]: cluster 2024-09-21T00:00:26.829656+0000 mgr.a (mgr.14388) 4581 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:27 smithi179 bash[23186]: audit 2024-09-21T00:00:26.441346+0000 mgr.a (mgr.14388) 4580 : audit [DBG] from='client.108897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:27 smithi179 bash[23186]: cluster 2024-09-21T00:00:26.829656+0000 mgr.a (mgr.14388) 4581 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:29 smithi044 bash[22676]: cluster 2024-09-21T00:00:28.830444+0000 mgr.a (mgr.14388) 4582 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:29 smithi179 bash[23186]: cluster 2024-09-21T00:00:28.830444+0000 mgr.a (mgr.14388) 4582 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:29 smithi049 bash[23528]: cluster 2024-09-21T00:00:28.830444+0000 mgr.a (mgr.14388) 4582 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:31 smithi044 bash[22676]: cluster 2024-09-21T00:00:30.832537+0000 mgr.a (mgr.14388) 4583 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:00:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:31 smithi179 bash[23186]: cluster 2024-09-21T00:00:30.832537+0000 mgr.a (mgr.14388) 4583 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:00:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:31 smithi049 bash[23528]: cluster 2024-09-21T00:00:30.832537+0000 mgr.a (mgr.14388) 4583 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:00:32.645 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:32.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:32.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:32.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:32.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:32 smithi044 bash[22676]: audit 2024-09-21T00:00:32.199486+0000 mgr.a (mgr.14388) 4584 : audit [DBG] from='client.108975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:32 smithi179 bash[23186]: audit 2024-09-21T00:00:32.199486+0000 mgr.a (mgr.14388) 4584 : audit [DBG] from='client.108975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:32 smithi049 bash[23528]: audit 2024-09-21T00:00:32.199486+0000 mgr.a (mgr.14388) 4584 : audit [DBG] from='client.108975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:33 smithi044 bash[22676]: cluster 2024-09-21T00:00:32.833504+0000 mgr.a (mgr.14388) 4585 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:33 smithi179 bash[23186]: cluster 2024-09-21T00:00:32.833504+0000 mgr.a (mgr.14388) 4585 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:33 smithi049 bash[23528]: cluster 2024-09-21T00:00:32.833504+0000 mgr.a (mgr.14388) 4585 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:34 smithi044 bash[22676]: audit 2024-09-21T00:00:34.640928+0000 mon.a (mon.0) 4254 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:00:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:34 smithi044 bash[22676]: audit 2024-09-21T00:00:34.648456+0000 mon.a (mon.0) 4255 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:00:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:34 smithi044 bash[22676]: audit 2024-09-21T00:00:34.650389+0000 mon.a (mon.0) 4256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:00:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:34 smithi044 bash[22676]: audit 2024-09-21T00:00:34.661835+0000 mon.a (mon.0) 4257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:34 smithi044 bash[22676]: audit 2024-09-21T00:00:34.669426+0000 mon.a (mon.0) 4258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:00:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:34 smithi179 bash[23186]: audit 2024-09-21T00:00:34.640928+0000 mon.a (mon.0) 4254 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:00:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:34 smithi179 bash[23186]: audit 2024-09-21T00:00:34.648456+0000 mon.a (mon.0) 4255 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:00:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:34 smithi179 bash[23186]: audit 2024-09-21T00:00:34.650389+0000 mon.a (mon.0) 4256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:00:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:34 smithi179 bash[23186]: audit 2024-09-21T00:00:34.661835+0000 mon.a (mon.0) 4257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:34 smithi179 bash[23186]: audit 2024-09-21T00:00:34.669426+0000 mon.a (mon.0) 4258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:00:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:34 smithi049 bash[23528]: audit 2024-09-21T00:00:34.640928+0000 mon.a (mon.0) 4254 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:00:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:34 smithi049 bash[23528]: audit 2024-09-21T00:00:34.648456+0000 mon.a (mon.0) 4255 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:00:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:34 smithi049 bash[23528]: audit 2024-09-21T00:00:34.650389+0000 mon.a (mon.0) 4256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:00:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:34 smithi049 bash[23528]: audit 2024-09-21T00:00:34.661835+0000 mon.a (mon.0) 4257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:34 smithi049 bash[23528]: audit 2024-09-21T00:00:34.669426+0000 mon.a (mon.0) 4258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:00:35.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:00:35 smithi044 bash[22930]: debug 2024-09-21T00:00:35.441+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:00:35.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:00:35 smithi044 bash[22930]: debug 2024-09-21T00:00:35.445+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:00:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:35 smithi044 bash[22676]: audit 2024-09-21T00:00:34.672002+0000 mgr.a (mgr.14388) 4586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:00:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:35 smithi044 bash[22676]: cluster 2024-09-21T00:00:34.834120+0000 mgr.a (mgr.14388) 4587 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:35 smithi179 bash[23186]: audit 2024-09-21T00:00:34.672002+0000 mgr.a (mgr.14388) 4586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:00:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:35 smithi179 bash[23186]: cluster 2024-09-21T00:00:34.834120+0000 mgr.a (mgr.14388) 4587 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:35 smithi049 bash[23528]: audit 2024-09-21T00:00:34.672002+0000 mgr.a (mgr.14388) 4586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:00:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:35 smithi049 bash[23528]: cluster 2024-09-21T00:00:34.834120+0000 mgr.a (mgr.14388) 4587 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:36 smithi044 bash[22676]: audit 2024-09-21T00:00:35.448167+0000 mgr.a (mgr.14388) 4588 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:00:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:36 smithi044 bash[22676]: cephadm 2024-09-21T00:00:35.449532+0000 mgr.a (mgr.14388) 4589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:00:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:36 smithi179 bash[23186]: audit 2024-09-21T00:00:35.448167+0000 mgr.a (mgr.14388) 4588 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:00:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:36 smithi179 bash[23186]: cephadm 2024-09-21T00:00:35.449532+0000 mgr.a (mgr.14388) 4589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:00:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:36 smithi049 bash[23528]: audit 2024-09-21T00:00:35.448167+0000 mgr.a (mgr.14388) 4588 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:00:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:36 smithi049 bash[23528]: cephadm 2024-09-21T00:00:35.449532+0000 mgr.a (mgr.14388) 4589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:00:37.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:37.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:37.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:37 smithi044 bash[22676]: cluster 2024-09-21T00:00:36.836873+0000 mgr.a (mgr.14388) 4590 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:00:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:37 smithi179 bash[23186]: cluster 2024-09-21T00:00:36.836873+0000 mgr.a (mgr.14388) 4590 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:00:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:37 smithi049 bash[23528]: cluster 2024-09-21T00:00:36.836873+0000 mgr.a (mgr.14388) 4590 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:00:38.401 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:39.235 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:38 smithi049 bash[23528]: audit 2024-09-21T00:00:37.977514+0000 mgr.a (mgr.14388) 4591 : audit [DBG] from='client.109155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:39.235 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:38 smithi049 bash[23528]: audit 2024-09-21T00:00:38.486418+0000 mon.a (mon.0) 4259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.235 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:38 smithi049 bash[23528]: audit 2024-09-21T00:00:38.494696+0000 mon.a (mon.0) 4260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.235 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:38 smithi049 bash[23528]: audit 2024-09-21T00:00:38.504738+0000 mon.a (mon.0) 4261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:38 smithi044 bash[22676]: audit 2024-09-21T00:00:37.977514+0000 mgr.a (mgr.14388) 4591 : audit [DBG] from='client.109155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:38 smithi044 bash[22676]: audit 2024-09-21T00:00:38.486418+0000 mon.a (mon.0) 4259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:38 smithi044 bash[22676]: audit 2024-09-21T00:00:38.494696+0000 mon.a (mon.0) 4260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:38 smithi044 bash[22676]: audit 2024-09-21T00:00:38.504738+0000 mon.a (mon.0) 4261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:38 smithi179 bash[23186]: audit 2024-09-21T00:00:37.977514+0000 mgr.a (mgr.14388) 4591 : audit [DBG] from='client.109155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:38 smithi179 bash[23186]: audit 2024-09-21T00:00:38.486418+0000 mon.a (mon.0) 4259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:38 smithi179 bash[23186]: audit 2024-09-21T00:00:38.494696+0000 mon.a (mon.0) 4260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:38 smithi179 bash[23186]: audit 2024-09-21T00:00:38.504738+0000 mon.a (mon.0) 4261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:39 smithi044 bash[22676]: cluster 2024-09-21T00:00:38.837860+0000 mgr.a (mgr.14388) 4592 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:00:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:39 smithi179 bash[23186]: cluster 2024-09-21T00:00:38.837860+0000 mgr.a (mgr.14388) 4592 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:00:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:39 smithi049 bash[23528]: cluster 2024-09-21T00:00:38.837860+0000 mgr.a (mgr.14388) 4592 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:00:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:41 smithi044 bash[22676]: cluster 2024-09-21T00:00:40.840057+0000 mgr.a (mgr.14388) 4593 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:41 smithi044 bash[22676]: audit 2024-09-21T00:00:41.398335+0000 mon.a (mon.0) 4262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:41 smithi044 bash[22676]: audit 2024-09-21T00:00:41.407013+0000 mon.a (mon.0) 4263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:41 smithi044 bash[22676]: audit 2024-09-21T00:00:41.417199+0000 mon.a (mon.0) 4264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:41 smithi179 bash[23186]: cluster 2024-09-21T00:00:40.840057+0000 mgr.a (mgr.14388) 4593 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:41 smithi179 bash[23186]: audit 2024-09-21T00:00:41.398335+0000 mon.a (mon.0) 4262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:41 smithi179 bash[23186]: audit 2024-09-21T00:00:41.407013+0000 mon.a (mon.0) 4263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:41 smithi179 bash[23186]: audit 2024-09-21T00:00:41.417199+0000 mon.a (mon.0) 4264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:41 smithi049 bash[23528]: cluster 2024-09-21T00:00:40.840057+0000 mgr.a (mgr.14388) 4593 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:41 smithi049 bash[23528]: audit 2024-09-21T00:00:41.398335+0000 mon.a (mon.0) 4262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:41 smithi049 bash[23528]: audit 2024-09-21T00:00:41.407013+0000 mon.a (mon.0) 4263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:41 smithi049 bash[23528]: audit 2024-09-21T00:00:41.417199+0000 mon.a (mon.0) 4264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:43.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:43.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:43 smithi049 bash[23528]: audit 2024-09-21T00:00:42.763889+0000 mon.a (mon.0) 4265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:43 smithi049 bash[23528]: audit 2024-09-21T00:00:42.771894+0000 mon.a (mon.0) 4266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:43 smithi049 bash[23528]: audit 2024-09-21T00:00:42.781719+0000 mon.a (mon.0) 4267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:43 smithi049 bash[23528]: cluster 2024-09-21T00:00:42.840860+0000 mgr.a (mgr.14388) 4594 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:44.168 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:44.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:44.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:44.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:44.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:43 smithi044 bash[22676]: audit 2024-09-21T00:00:42.763889+0000 mon.a (mon.0) 4265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:43 smithi044 bash[22676]: audit 2024-09-21T00:00:42.771894+0000 mon.a (mon.0) 4266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:43 smithi044 bash[22676]: audit 2024-09-21T00:00:42.781719+0000 mon.a (mon.0) 4267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:43 smithi044 bash[22676]: cluster 2024-09-21T00:00:42.840860+0000 mgr.a (mgr.14388) 4594 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:43 smithi179 bash[23186]: audit 2024-09-21T00:00:42.763889+0000 mon.a (mon.0) 4265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:43 smithi179 bash[23186]: audit 2024-09-21T00:00:42.771894+0000 mon.a (mon.0) 4266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:43 smithi179 bash[23186]: audit 2024-09-21T00:00:42.781719+0000 mon.a (mon.0) 4267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:43 smithi179 bash[23186]: cluster 2024-09-21T00:00:42.840860+0000 mgr.a (mgr.14388) 4594 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:44 smithi049 bash[23528]: audit 2024-09-21T00:00:43.734936+0000 mgr.a (mgr.14388) 4595 : audit [DBG] from='client.109233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:44 smithi044 bash[22676]: audit 2024-09-21T00:00:43.734936+0000 mgr.a (mgr.14388) 4595 : audit [DBG] from='client.109233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:44 smithi179 bash[23186]: audit 2024-09-21T00:00:43.734936+0000 mgr.a (mgr.14388) 4595 : audit [DBG] from='client.109233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:45 smithi049 bash[23528]: cluster 2024-09-21T00:00:44.841918+0000 mgr.a (mgr.14388) 4596 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:45 smithi044 bash[22676]: cluster 2024-09-21T00:00:44.841918+0000 mgr.a (mgr.14388) 4596 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:45 smithi179 bash[23186]: cluster 2024-09-21T00:00:44.841918+0000 mgr.a (mgr.14388) 4596 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:47 smithi044 bash[22676]: cluster 2024-09-21T00:00:46.844200+0000 mgr.a (mgr.14388) 4597 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:47 smithi179 bash[23186]: cluster 2024-09-21T00:00:46.844200+0000 mgr.a (mgr.14388) 4597 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:47 smithi049 bash[23528]: cluster 2024-09-21T00:00:46.844200+0000 mgr.a (mgr.14388) 4597 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:49.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:49.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:49.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:49.959 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:49.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:49 smithi044 bash[22676]: cluster 2024-09-21T00:00:48.844986+0000 mgr.a (mgr.14388) 4598 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:00:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:49 smithi179 bash[23186]: cluster 2024-09-21T00:00:48.844986+0000 mgr.a (mgr.14388) 4598 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:00:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:49 smithi049 bash[23528]: cluster 2024-09-21T00:00:48.844986+0000 mgr.a (mgr.14388) 4598 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:00:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:50 smithi044 bash[22676]: audit 2024-09-21T00:00:49.517989+0000 mgr.a (mgr.14388) 4599 : audit [DBG] from='client.109311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:50 smithi179 bash[23186]: audit 2024-09-21T00:00:49.517989+0000 mgr.a (mgr.14388) 4599 : audit [DBG] from='client.109311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:50 smithi049 bash[23528]: audit 2024-09-21T00:00:49.517989+0000 mgr.a (mgr.14388) 4599 : audit [DBG] from='client.109311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:52.225 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:51 smithi044 bash[22676]: cluster 2024-09-21T00:00:50.847370+0000 mgr.a (mgr.14388) 4600 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:51 smithi179 bash[23186]: cluster 2024-09-21T00:00:50.847370+0000 mgr.a (mgr.14388) 4600 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:51 smithi049 bash[23528]: cluster 2024-09-21T00:00:50.847370+0000 mgr.a (mgr.14388) 4600 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:00:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:53 smithi044 bash[22676]: cluster 2024-09-21T00:00:52.848210+0000 mgr.a (mgr.14388) 4601 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:00:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:53 smithi179 bash[23186]: cluster 2024-09-21T00:00:52.848210+0000 mgr.a (mgr.14388) 4601 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:00:54.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:53 smithi049 bash[23528]: cluster 2024-09-21T00:00:52.848210+0000 mgr.a (mgr.14388) 4601 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:00:54.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:00:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:00:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:00:55.751 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:00:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:00:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:00:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:00:55.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:00:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:55 smithi044 bash[22676]: cluster 2024-09-21T00:00:54.849043+0000 mgr.a (mgr.14388) 4602 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:00:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:55 smithi179 bash[23186]: cluster 2024-09-21T00:00:54.849043+0000 mgr.a (mgr.14388) 4602 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:00:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:55 smithi049 bash[23528]: cluster 2024-09-21T00:00:54.849043+0000 mgr.a (mgr.14388) 4602 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:00:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:56 smithi044 bash[22676]: audit 2024-09-21T00:00:55.302210+0000 mgr.a (mgr.14388) 4603 : audit [DBG] from='client.109389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:56 smithi179 bash[23186]: audit 2024-09-21T00:00:55.302210+0000 mgr.a (mgr.14388) 4603 : audit [DBG] from='client.109389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:56 smithi049 bash[23528]: audit 2024-09-21T00:00:55.302210+0000 mgr.a (mgr.14388) 4603 : audit [DBG] from='client.109389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:00:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:57 smithi044 bash[22676]: cluster 2024-09-21T00:00:56.851843+0000 mgr.a (mgr.14388) 4604 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:57 smithi179 bash[23186]: cluster 2024-09-21T00:00:56.851843+0000 mgr.a (mgr.14388) 4604 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:58.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:57 smithi049 bash[23528]: cluster 2024-09-21T00:00:56.851843+0000 mgr.a (mgr.14388) 4604 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:00:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:59 smithi044 bash[22676]: audit 2024-09-21T00:00:58.701195+0000 mon.a (mon.0) 4268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:59 smithi044 bash[22676]: audit 2024-09-21T00:00:58.709824+0000 mon.a (mon.0) 4269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:59 smithi044 bash[22676]: audit 2024-09-21T00:00:58.720381+0000 mon.a (mon.0) 4270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:00:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:00:59 smithi044 bash[22676]: cluster 2024-09-21T00:00:58.852651+0000 mgr.a (mgr.14388) 4605 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:59 smithi179 bash[23186]: audit 2024-09-21T00:00:58.701195+0000 mon.a (mon.0) 4268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:59 smithi179 bash[23186]: audit 2024-09-21T00:00:58.709824+0000 mon.a (mon.0) 4269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:59 smithi179 bash[23186]: audit 2024-09-21T00:00:58.720381+0000 mon.a (mon.0) 4270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:00:59 smithi179 bash[23186]: cluster 2024-09-21T00:00:58.852651+0000 mgr.a (mgr.14388) 4605 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:59 smithi049 bash[23528]: audit 2024-09-21T00:00:58.701195+0000 mon.a (mon.0) 4268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:59 smithi049 bash[23528]: audit 2024-09-21T00:00:58.709824+0000 mon.a (mon.0) 4269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:59 smithi049 bash[23528]: audit 2024-09-21T00:00:58.720381+0000 mon.a (mon.0) 4270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:00:59 smithi049 bash[23528]: cluster 2024-09-21T00:00:58.852651+0000 mgr.a (mgr.14388) 4605 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:00.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:00.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:00.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:01.534 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:01.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:01.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:01.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:01.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:01 smithi044 bash[22676]: cluster 2024-09-21T00:01:00.853668+0000 mgr.a (mgr.14388) 4606 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:01 smithi044 bash[22676]: audit 2024-09-21T00:01:01.088430+0000 mgr.a (mgr.14388) 4607 : audit [DBG] from='client.109464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:01 smithi044 bash[22676]: audit 2024-09-21T00:01:01.572903+0000 mon.a (mon.0) 4271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:01 smithi044 bash[22676]: audit 2024-09-21T00:01:01.577575+0000 mon.a (mon.0) 4272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:01 smithi044 bash[22676]: audit 2024-09-21T00:01:01.584718+0000 mon.a (mon.0) 4273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:01 smithi179 bash[23186]: cluster 2024-09-21T00:01:00.853668+0000 mgr.a (mgr.14388) 4606 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:01 smithi179 bash[23186]: audit 2024-09-21T00:01:01.088430+0000 mgr.a (mgr.14388) 4607 : audit [DBG] from='client.109464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:01 smithi179 bash[23186]: audit 2024-09-21T00:01:01.572903+0000 mon.a (mon.0) 4271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:01 smithi179 bash[23186]: audit 2024-09-21T00:01:01.577575+0000 mon.a (mon.0) 4272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:01 smithi179 bash[23186]: audit 2024-09-21T00:01:01.584718+0000 mon.a (mon.0) 4273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:01 smithi049 bash[23528]: cluster 2024-09-21T00:01:00.853668+0000 mgr.a (mgr.14388) 4606 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:01 smithi049 bash[23528]: audit 2024-09-21T00:01:01.088430+0000 mgr.a (mgr.14388) 4607 : audit [DBG] from='client.109464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:01 smithi049 bash[23528]: audit 2024-09-21T00:01:01.572903+0000 mon.a (mon.0) 4271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:01 smithi049 bash[23528]: audit 2024-09-21T00:01:01.577575+0000 mon.a (mon.0) 4272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:01 smithi049 bash[23528]: audit 2024-09-21T00:01:01.584718+0000 mon.a (mon.0) 4273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:03 smithi179 bash[23186]: cluster 2024-09-21T00:01:02.854557+0000 mgr.a (mgr.14388) 4608 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:01:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:03 smithi179 bash[23186]: audit 2024-09-21T00:01:02.998973+0000 mon.a (mon.0) 4274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:03 smithi179 bash[23186]: audit 2024-09-21T00:01:03.007327+0000 mon.a (mon.0) 4275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:03 smithi179 bash[23186]: audit 2024-09-21T00:01:03.017432+0000 mon.a (mon.0) 4276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:03 smithi049 bash[23528]: cluster 2024-09-21T00:01:02.854557+0000 mgr.a (mgr.14388) 4608 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:01:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:03 smithi049 bash[23528]: audit 2024-09-21T00:01:02.998973+0000 mon.a (mon.0) 4274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:03 smithi049 bash[23528]: audit 2024-09-21T00:01:03.007327+0000 mon.a (mon.0) 4275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:03 smithi049 bash[23528]: audit 2024-09-21T00:01:03.017432+0000 mon.a (mon.0) 4276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:03 smithi044 bash[22676]: cluster 2024-09-21T00:01:02.854557+0000 mgr.a (mgr.14388) 4608 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:01:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:03 smithi044 bash[22676]: audit 2024-09-21T00:01:02.998973+0000 mon.a (mon.0) 4274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:03 smithi044 bash[22676]: audit 2024-09-21T00:01:03.007327+0000 mon.a (mon.0) 4275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:03 smithi044 bash[22676]: audit 2024-09-21T00:01:03.017432+0000 mon.a (mon.0) 4276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:06 smithi179 bash[23186]: cluster 2024-09-21T00:01:04.855345+0000 mgr.a (mgr.14388) 4609 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:01:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:06 smithi049 bash[23528]: cluster 2024-09-21T00:01:04.855345+0000 mgr.a (mgr.14388) 4609 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:01:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:06 smithi044 bash[22676]: cluster 2024-09-21T00:01:04.855345+0000 mgr.a (mgr.14388) 4609 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:01:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:07.300 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:07.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:07.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:07.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:07.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:08 smithi049 bash[23528]: cluster 2024-09-21T00:01:06.857529+0000 mgr.a (mgr.14388) 4610 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:01:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:08 smithi049 bash[23528]: audit 2024-09-21T00:01:06.873271+0000 mgr.a (mgr.14388) 4611 : audit [DBG] from='client.109539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:08 smithi044 bash[22676]: cluster 2024-09-21T00:01:06.857529+0000 mgr.a (mgr.14388) 4610 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:01:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:08 smithi044 bash[22676]: audit 2024-09-21T00:01:06.873271+0000 mgr.a (mgr.14388) 4611 : audit [DBG] from='client.109539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:08 smithi179 bash[23186]: cluster 2024-09-21T00:01:06.857529+0000 mgr.a (mgr.14388) 4610 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:01:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:08 smithi179 bash[23186]: audit 2024-09-21T00:01:06.873271+0000 mgr.a (mgr.14388) 4611 : audit [DBG] from='client.109539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:10 smithi049 bash[23528]: cluster 2024-09-21T00:01:08.858453+0000 mgr.a (mgr.14388) 4612 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:10 smithi044 bash[22676]: cluster 2024-09-21T00:01:08.858453+0000 mgr.a (mgr.14388) 4612 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:10 smithi179 bash[23186]: cluster 2024-09-21T00:01:08.858453+0000 mgr.a (mgr.14388) 4612 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:12 smithi049 bash[23528]: cluster 2024-09-21T00:01:10.860736+0000 mgr.a (mgr.14388) 4613 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:12.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:12.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:12.338 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:12 smithi044 bash[22676]: cluster 2024-09-21T00:01:10.860736+0000 mgr.a (mgr.14388) 4613 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:12 smithi179 bash[23186]: cluster 2024-09-21T00:01:10.860736+0000 mgr.a (mgr.14388) 4613 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:13.080 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:13.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:13.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:13.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:13.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:14 smithi044 bash[22676]: audit 2024-09-21T00:01:12.628451+0000 mgr.a (mgr.14388) 4614 : audit [DBG] from='client.109617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:14 smithi044 bash[22676]: cluster 2024-09-21T00:01:12.870097+0000 mgr.a (mgr.14388) 4615 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:14 smithi049 bash[23528]: audit 2024-09-21T00:01:12.628451+0000 mgr.a (mgr.14388) 4614 : audit [DBG] from='client.109617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:14 smithi049 bash[23528]: cluster 2024-09-21T00:01:12.870097+0000 mgr.a (mgr.14388) 4615 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:14 smithi179 bash[23186]: audit 2024-09-21T00:01:12.628451+0000 mgr.a (mgr.14388) 4614 : audit [DBG] from='client.109617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:14 smithi179 bash[23186]: cluster 2024-09-21T00:01:12.870097+0000 mgr.a (mgr.14388) 4615 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:16 smithi049 bash[23528]: cluster 2024-09-21T00:01:14.871677+0000 mgr.a (mgr.14388) 4616 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T00:01:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:16 smithi044 bash[22676]: cluster 2024-09-21T00:01:14.871677+0000 mgr.a (mgr.14388) 4616 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T00:01:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:16 smithi179 bash[23186]: cluster 2024-09-21T00:01:14.871677+0000 mgr.a (mgr.14388) 4616 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T00:01:18.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:18.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:18.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:18 smithi049 bash[23528]: cluster 2024-09-21T00:01:16.873421+0000 mgr.a (mgr.14388) 4617 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:18.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:18 smithi179 bash[23186]: cluster 2024-09-21T00:01:16.873421+0000 mgr.a (mgr.14388) 4617 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:18 smithi044 bash[22676]: cluster 2024-09-21T00:01:16.873421+0000 mgr.a (mgr.14388) 4617 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:18.875 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:19 smithi049 bash[23528]: audit 2024-09-21T00:01:18.425360+0000 mgr.a (mgr.14388) 4618 : audit [DBG] from='client.109695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:19 smithi049 bash[23528]: cluster 2024-09-21T00:01:18.874040+0000 mgr.a (mgr.14388) 4619 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:19 smithi049 bash[23528]: audit 2024-09-21T00:01:18.915706+0000 mon.a (mon.0) 4277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:19 smithi049 bash[23528]: audit 2024-09-21T00:01:18.921876+0000 mon.a (mon.0) 4278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:19 smithi049 bash[23528]: audit 2024-09-21T00:01:18.929110+0000 mon.a (mon.0) 4279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:19 smithi044 bash[22676]: audit 2024-09-21T00:01:18.425360+0000 mgr.a (mgr.14388) 4618 : audit [DBG] from='client.109695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:19 smithi044 bash[22676]: cluster 2024-09-21T00:01:18.874040+0000 mgr.a (mgr.14388) 4619 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:19 smithi044 bash[22676]: audit 2024-09-21T00:01:18.915706+0000 mon.a (mon.0) 4277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:19 smithi044 bash[22676]: audit 2024-09-21T00:01:18.921876+0000 mon.a (mon.0) 4278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:19 smithi044 bash[22676]: audit 2024-09-21T00:01:18.929110+0000 mon.a (mon.0) 4279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:19 smithi179 bash[23186]: audit 2024-09-21T00:01:18.425360+0000 mgr.a (mgr.14388) 4618 : audit [DBG] from='client.109695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:19 smithi179 bash[23186]: cluster 2024-09-21T00:01:18.874040+0000 mgr.a (mgr.14388) 4619 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:19 smithi179 bash[23186]: audit 2024-09-21T00:01:18.915706+0000 mon.a (mon.0) 4277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:19 smithi179 bash[23186]: audit 2024-09-21T00:01:18.921876+0000 mon.a (mon.0) 4278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:19 smithi179 bash[23186]: audit 2024-09-21T00:01:18.929110+0000 mon.a (mon.0) 4279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:21 smithi179 bash[23186]: cluster 2024-09-21T00:01:20.876358+0000 mgr.a (mgr.14388) 4620 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:21 smithi179 bash[23186]: audit 2024-09-21T00:01:21.783992+0000 mon.a (mon.0) 4280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:21 smithi179 bash[23186]: audit 2024-09-21T00:01:21.792414+0000 mon.a (mon.0) 4281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:21 smithi179 bash[23186]: audit 2024-09-21T00:01:21.802323+0000 mon.a (mon.0) 4282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.035 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:21 smithi049 bash[23528]: cluster 2024-09-21T00:01:20.876358+0000 mgr.a (mgr.14388) 4620 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:22.035 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:21 smithi049 bash[23528]: audit 2024-09-21T00:01:21.783992+0000 mon.a (mon.0) 4280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.035 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:21 smithi049 bash[23528]: audit 2024-09-21T00:01:21.792414+0000 mon.a (mon.0) 4281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.035 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:21 smithi049 bash[23528]: audit 2024-09-21T00:01:21.802323+0000 mon.a (mon.0) 4282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:21 smithi044 bash[22676]: cluster 2024-09-21T00:01:20.876358+0000 mgr.a (mgr.14388) 4620 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:21 smithi044 bash[22676]: audit 2024-09-21T00:01:21.783992+0000 mon.a (mon.0) 4280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:21 smithi044 bash[22676]: audit 2024-09-21T00:01:21.792414+0000 mon.a (mon.0) 4281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:21 smithi044 bash[22676]: audit 2024-09-21T00:01:21.802323+0000 mon.a (mon.0) 4282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:23.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:24 smithi044 bash[22676]: cluster 2024-09-21T00:01:22.877140+0000 mgr.a (mgr.14388) 4621 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:24 smithi044 bash[22676]: audit 2024-09-21T00:01:23.192043+0000 mon.a (mon.0) 4283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:24 smithi044 bash[22676]: audit 2024-09-21T00:01:23.200319+0000 mon.a (mon.0) 4284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:24 smithi044 bash[22676]: audit 2024-09-21T00:01:23.210187+0000 mon.a (mon.0) 4285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:24 smithi179 bash[23186]: cluster 2024-09-21T00:01:22.877140+0000 mgr.a (mgr.14388) 4621 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:24 smithi179 bash[23186]: audit 2024-09-21T00:01:23.192043+0000 mon.a (mon.0) 4283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:24 smithi179 bash[23186]: audit 2024-09-21T00:01:23.200319+0000 mon.a (mon.0) 4284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:24 smithi179 bash[23186]: audit 2024-09-21T00:01:23.210187+0000 mon.a (mon.0) 4285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:24 smithi049 bash[23528]: cluster 2024-09-21T00:01:22.877140+0000 mgr.a (mgr.14388) 4621 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:24 smithi049 bash[23528]: audit 2024-09-21T00:01:23.192043+0000 mon.a (mon.0) 4283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:24 smithi049 bash[23528]: audit 2024-09-21T00:01:23.200319+0000 mon.a (mon.0) 4284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:24 smithi049 bash[23528]: audit 2024-09-21T00:01:23.210187+0000 mon.a (mon.0) 4285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:24.632 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:24.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:24.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:24.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:24.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:25 smithi044 bash[22676]: audit 2024-09-21T00:01:24.209706+0000 mgr.a (mgr.14388) 4622 : audit [DBG] from='client.109773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:25 smithi179 bash[23186]: audit 2024-09-21T00:01:24.209706+0000 mgr.a (mgr.14388) 4622 : audit [DBG] from='client.109773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:25 smithi049 bash[23528]: audit 2024-09-21T00:01:24.209706+0000 mgr.a (mgr.14388) 4622 : audit [DBG] from='client.109773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:26 smithi044 bash[22676]: cluster 2024-09-21T00:01:24.879108+0000 mgr.a (mgr.14388) 4623 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T00:01:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:26 smithi179 bash[23186]: cluster 2024-09-21T00:01:24.879108+0000 mgr.a (mgr.14388) 4623 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T00:01:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:26 smithi049 bash[23528]: cluster 2024-09-21T00:01:24.879108+0000 mgr.a (mgr.14388) 4623 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T00:01:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:28 smithi044 bash[22676]: cluster 2024-09-21T00:01:26.880363+0000 mgr.a (mgr.14388) 4624 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:28 smithi179 bash[23186]: cluster 2024-09-21T00:01:26.880363+0000 mgr.a (mgr.14388) 4624 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:28 smithi049 bash[23528]: cluster 2024-09-21T00:01:26.880363+0000 mgr.a (mgr.14388) 4624 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:29.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:29.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:30.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:30 smithi044 bash[22676]: cluster 2024-09-21T00:01:28.881275+0000 mgr.a (mgr.14388) 4625 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:30 smithi179 bash[23186]: cluster 2024-09-21T00:01:28.881275+0000 mgr.a (mgr.14388) 4625 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:30 smithi049 bash[23528]: cluster 2024-09-21T00:01:28.881275+0000 mgr.a (mgr.14388) 4625 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:31 smithi044 bash[22676]: audit 2024-09-21T00:01:29.971644+0000 mgr.a (mgr.14388) 4626 : audit [DBG] from='client.109851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:31 smithi179 bash[23186]: audit 2024-09-21T00:01:29.971644+0000 mgr.a (mgr.14388) 4626 : audit [DBG] from='client.109851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:31 smithi049 bash[23528]: audit 2024-09-21T00:01:29.971644+0000 mgr.a (mgr.14388) 4626 : audit [DBG] from='client.109851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:32 smithi044 bash[22676]: cluster 2024-09-21T00:01:30.884064+0000 mgr.a (mgr.14388) 4627 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:32 smithi179 bash[23186]: cluster 2024-09-21T00:01:30.884064+0000 mgr.a (mgr.14388) 4627 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:32 smithi049 bash[23528]: cluster 2024-09-21T00:01:30.884064+0000 mgr.a (mgr.14388) 4627 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:34 smithi044 bash[22676]: cluster 2024-09-21T00:01:32.884857+0000 mgr.a (mgr.14388) 4628 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:34 smithi179 bash[23186]: cluster 2024-09-21T00:01:32.884857+0000 mgr.a (mgr.14388) 4628 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:34 smithi049 bash[23528]: cluster 2024-09-21T00:01:32.884857+0000 mgr.a (mgr.14388) 4628 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:35.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:35.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:35.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:36.203 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: cluster 2024-09-21T00:01:34.886851+0000 mgr.a (mgr.14388) 4629 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:35.505936+0000 mon.a (mon.0) 4286 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.073443+0000 mon.a (mon.0) 4287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.079269+0000 mon.a (mon.0) 4288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.085227+0000 mon.a (mon.0) 4289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.090426+0000 mon.a (mon.0) 4290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.091641+0000 mon.a (mon.0) 4291 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.092563+0000 mon.a (mon.0) 4292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.109153+0000 mon.a (mon.0) 4293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22676]: audit 2024-09-21T00:01:36.112128+0000 mon.a (mon.0) 4294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:01:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: cluster 2024-09-21T00:01:34.886851+0000 mgr.a (mgr.14388) 4629 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:35.505936+0000 mon.a (mon.0) 4286 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:01:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.073443+0000 mon.a (mon.0) 4287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.079269+0000 mon.a (mon.0) 4288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.085227+0000 mon.a (mon.0) 4289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.090426+0000 mon.a (mon.0) 4290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.091641+0000 mon.a (mon.0) 4291 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:01:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.092563+0000 mon.a (mon.0) 4292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:01:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.109153+0000 mon.a (mon.0) 4293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:36 smithi179 bash[23186]: audit 2024-09-21T00:01:36.112128+0000 mon.a (mon.0) 4294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:01:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: cluster 2024-09-21T00:01:34.886851+0000 mgr.a (mgr.14388) 4629 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:35.505936+0000 mon.a (mon.0) 4286 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:01:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.073443+0000 mon.a (mon.0) 4287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.079269+0000 mon.a (mon.0) 4288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.085227+0000 mon.a (mon.0) 4289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.090426+0000 mon.a (mon.0) 4290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.091641+0000 mon.a (mon.0) 4291 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:01:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.092563+0000 mon.a (mon.0) 4292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:01:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.109153+0000 mon.a (mon.0) 4293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:36 smithi049 bash[23528]: audit 2024-09-21T00:01:36.112128+0000 mon.a (mon.0) 4294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:01:37.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22930]: debug 2024-09-21T00:01:36.896+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:01:37.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:01:36 smithi044 bash[22930]: debug 2024-09-21T00:01:36.896+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:01:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:37 smithi179 bash[23186]: audit 2024-09-21T00:01:35.758156+0000 mgr.a (mgr.14388) 4630 : audit [DBG] from='client.109923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:37 smithi179 bash[23186]: audit 2024-09-21T00:01:36.113358+0000 mgr.a (mgr.14388) 4631 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:01:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:37 smithi049 bash[23528]: audit 2024-09-21T00:01:35.758156+0000 mgr.a (mgr.14388) 4630 : audit [DBG] from='client.109923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:37 smithi049 bash[23528]: audit 2024-09-21T00:01:36.113358+0000 mgr.a (mgr.14388) 4631 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:01:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:37 smithi044 bash[22676]: audit 2024-09-21T00:01:35.758156+0000 mgr.a (mgr.14388) 4630 : audit [DBG] from='client.109923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:37 smithi044 bash[22676]: audit 2024-09-21T00:01:36.113358+0000 mgr.a (mgr.14388) 4631 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:01:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:38 smithi179 bash[23186]: cluster 2024-09-21T00:01:36.887714+0000 mgr.a (mgr.14388) 4632 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T00:01:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:38 smithi179 bash[23186]: audit 2024-09-21T00:01:36.899138+0000 mgr.a (mgr.14388) 4633 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:01:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:38 smithi179 bash[23186]: cephadm 2024-09-21T00:01:36.900576+0000 mgr.a (mgr.14388) 4634 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:01:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:38 smithi049 bash[23528]: cluster 2024-09-21T00:01:36.887714+0000 mgr.a (mgr.14388) 4632 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T00:01:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:38 smithi049 bash[23528]: audit 2024-09-21T00:01:36.899138+0000 mgr.a (mgr.14388) 4633 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:01:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:38 smithi049 bash[23528]: cephadm 2024-09-21T00:01:36.900576+0000 mgr.a (mgr.14388) 4634 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:01:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:38 smithi044 bash[22676]: cluster 2024-09-21T00:01:36.887714+0000 mgr.a (mgr.14388) 4632 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T00:01:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:38 smithi044 bash[22676]: audit 2024-09-21T00:01:36.899138+0000 mgr.a (mgr.14388) 4633 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:01:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:38 smithi044 bash[22676]: cephadm 2024-09-21T00:01:36.900576+0000 mgr.a (mgr.14388) 4634 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:01:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:40 smithi179 bash[23186]: cluster 2024-09-21T00:01:38.888640+0000 mgr.a (mgr.14388) 4635 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:40 smithi179 bash[23186]: audit 2024-09-21T00:01:39.145221+0000 mon.a (mon.0) 4295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:40 smithi179 bash[23186]: audit 2024-09-21T00:01:39.153623+0000 mon.a (mon.0) 4296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:40 smithi179 bash[23186]: audit 2024-09-21T00:01:39.164416+0000 mon.a (mon.0) 4297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:40 smithi049 bash[23528]: cluster 2024-09-21T00:01:38.888640+0000 mgr.a (mgr.14388) 4635 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:40 smithi049 bash[23528]: audit 2024-09-21T00:01:39.145221+0000 mon.a (mon.0) 4295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:40 smithi049 bash[23528]: audit 2024-09-21T00:01:39.153623+0000 mon.a (mon.0) 4296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:40 smithi049 bash[23528]: audit 2024-09-21T00:01:39.164416+0000 mon.a (mon.0) 4297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:40 smithi044 bash[22676]: cluster 2024-09-21T00:01:38.888640+0000 mgr.a (mgr.14388) 4635 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:01:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:40 smithi044 bash[22676]: audit 2024-09-21T00:01:39.145221+0000 mon.a (mon.0) 4295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:40 smithi044 bash[22676]: audit 2024-09-21T00:01:39.153623+0000 mon.a (mon.0) 4296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:40 smithi044 bash[22676]: audit 2024-09-21T00:01:39.164416+0000 mon.a (mon.0) 4297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:41.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:41.206 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:41.206 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:41.960 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:41.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:41.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:41.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:41.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:42 smithi044 bash[22676]: cluster 2024-09-21T00:01:40.890994+0000 mgr.a (mgr.14388) 4636 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:42 smithi044 bash[22676]: audit 2024-09-21T00:01:41.919291+0000 mon.a (mon.0) 4298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:42 smithi044 bash[22676]: audit 2024-09-21T00:01:41.923562+0000 mon.a (mon.0) 4299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:42 smithi044 bash[22676]: audit 2024-09-21T00:01:41.929615+0000 mon.a (mon.0) 4300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:42 smithi179 bash[23186]: cluster 2024-09-21T00:01:40.890994+0000 mgr.a (mgr.14388) 4636 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:42 smithi179 bash[23186]: audit 2024-09-21T00:01:41.919291+0000 mon.a (mon.0) 4298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:42 smithi179 bash[23186]: audit 2024-09-21T00:01:41.923562+0000 mon.a (mon.0) 4299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:42 smithi179 bash[23186]: audit 2024-09-21T00:01:41.929615+0000 mon.a (mon.0) 4300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:42 smithi049 bash[23528]: cluster 2024-09-21T00:01:40.890994+0000 mgr.a (mgr.14388) 4636 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:42 smithi049 bash[23528]: audit 2024-09-21T00:01:41.919291+0000 mon.a (mon.0) 4298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:42 smithi049 bash[23528]: audit 2024-09-21T00:01:41.923562+0000 mon.a (mon.0) 4299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:42 smithi049 bash[23528]: audit 2024-09-21T00:01:41.929615+0000 mon.a (mon.0) 4300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:43.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:43 smithi044 bash[22676]: audit 2024-09-21T00:01:41.541242+0000 mgr.a (mgr.14388) 4637 : audit [DBG] from='client.110100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:43.475 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:43 smithi179 bash[23186]: audit 2024-09-21T00:01:41.541242+0000 mgr.a (mgr.14388) 4637 : audit [DBG] from='client.110100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:43 smithi049 bash[23528]: audit 2024-09-21T00:01:41.541242+0000 mgr.a (mgr.14388) 4637 : audit [DBG] from='client.110100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:44 smithi044 bash[22676]: cluster 2024-09-21T00:01:42.891907+0000 mgr.a (mgr.14388) 4638 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:44 smithi044 bash[22676]: audit 2024-09-21T00:01:43.426335+0000 mon.a (mon.0) 4301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:44 smithi044 bash[22676]: audit 2024-09-21T00:01:43.434385+0000 mon.a (mon.0) 4302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:44 smithi044 bash[22676]: audit 2024-09-21T00:01:43.444138+0000 mon.a (mon.0) 4303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:44 smithi179 bash[23186]: cluster 2024-09-21T00:01:42.891907+0000 mgr.a (mgr.14388) 4638 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:44 smithi179 bash[23186]: audit 2024-09-21T00:01:43.426335+0000 mon.a (mon.0) 4301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:44 smithi179 bash[23186]: audit 2024-09-21T00:01:43.434385+0000 mon.a (mon.0) 4302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:44 smithi179 bash[23186]: audit 2024-09-21T00:01:43.444138+0000 mon.a (mon.0) 4303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:44 smithi049 bash[23528]: cluster 2024-09-21T00:01:42.891907+0000 mgr.a (mgr.14388) 4638 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:44 smithi049 bash[23528]: audit 2024-09-21T00:01:43.426335+0000 mon.a (mon.0) 4301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:44 smithi049 bash[23528]: audit 2024-09-21T00:01:43.434385+0000 mon.a (mon.0) 4302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:44 smithi049 bash[23528]: audit 2024-09-21T00:01:43.444138+0000 mon.a (mon.0) 4303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:01:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:46 smithi044 bash[22676]: cluster 2024-09-21T00:01:44.894232+0000 mgr.a (mgr.14388) 4639 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:46 smithi179 bash[23186]: cluster 2024-09-21T00:01:44.894232+0000 mgr.a (mgr.14388) 4639 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:46 smithi049 bash[23528]: cluster 2024-09-21T00:01:44.894232+0000 mgr.a (mgr.14388) 4639 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:46.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:46.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:46.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:47.727 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:47.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:47.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:47.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:47.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:48 smithi044 bash[22676]: cluster 2024-09-21T00:01:46.894990+0000 mgr.a (mgr.14388) 4640 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:48 smithi179 bash[23186]: cluster 2024-09-21T00:01:46.894990+0000 mgr.a (mgr.14388) 4640 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:48 smithi049 bash[23528]: cluster 2024-09-21T00:01:46.894990+0000 mgr.a (mgr.14388) 4640 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:49 smithi044 bash[22676]: audit 2024-09-21T00:01:47.294651+0000 mgr.a (mgr.14388) 4641 : audit [DBG] from='client.110175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:49 smithi179 bash[23186]: audit 2024-09-21T00:01:47.294651+0000 mgr.a (mgr.14388) 4641 : audit [DBG] from='client.110175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:49 smithi049 bash[23528]: audit 2024-09-21T00:01:47.294651+0000 mgr.a (mgr.14388) 4641 : audit [DBG] from='client.110175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:50 smithi044 bash[22676]: cluster 2024-09-21T00:01:48.895905+0000 mgr.a (mgr.14388) 4642 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:50 smithi179 bash[23186]: cluster 2024-09-21T00:01:48.895905+0000 mgr.a (mgr.14388) 4642 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:50 smithi049 bash[23528]: cluster 2024-09-21T00:01:48.895905+0000 mgr.a (mgr.14388) 4642 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:52 smithi044 bash[22676]: cluster 2024-09-21T00:01:50.898176+0000 mgr.a (mgr.14388) 4643 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:52 smithi179 bash[23186]: cluster 2024-09-21T00:01:50.898176+0000 mgr.a (mgr.14388) 4643 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:52 smithi049 bash[23528]: cluster 2024-09-21T00:01:50.898176+0000 mgr.a (mgr.14388) 4643 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:01:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:52.729 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:52.729 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:01:53.495 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:54 smithi044 bash[22676]: cluster 2024-09-21T00:01:52.898932+0000 mgr.a (mgr.14388) 4644 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:54 smithi044 bash[22676]: audit 2024-09-21T00:01:53.063572+0000 mgr.a (mgr.14388) 4645 : audit [DBG] from='client.110253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:54 smithi179 bash[23186]: cluster 2024-09-21T00:01:52.898932+0000 mgr.a (mgr.14388) 4644 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:54 smithi179 bash[23186]: audit 2024-09-21T00:01:53.063572+0000 mgr.a (mgr.14388) 4645 : audit [DBG] from='client.110253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:54 smithi049 bash[23528]: cluster 2024-09-21T00:01:52.898932+0000 mgr.a (mgr.14388) 4644 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:54 smithi049 bash[23528]: audit 2024-09-21T00:01:53.063572+0000 mgr.a (mgr.14388) 4645 : audit [DBG] from='client.110253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:01:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:56 smithi044 bash[22676]: cluster 2024-09-21T00:01:54.901192+0000 mgr.a (mgr.14388) 4646 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:56 smithi179 bash[23186]: cluster 2024-09-21T00:01:54.901192+0000 mgr.a (mgr.14388) 4646 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:56 smithi049 bash[23528]: cluster 2024-09-21T00:01:54.901192+0000 mgr.a (mgr.14388) 4646 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:01:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:01:58 smithi044 bash[22676]: cluster 2024-09-21T00:01:56.902075+0000 mgr.a (mgr.14388) 4647 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:01:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:01:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:01:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:01:58 smithi179 bash[23186]: cluster 2024-09-21T00:01:56.902075+0000 mgr.a (mgr.14388) 4647 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:01:58 smithi049 bash[23528]: cluster 2024-09-21T00:01:56.902075+0000 mgr.a (mgr.14388) 4647 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:01:59.257 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:01:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:01:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:01:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:01:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:00 smithi044 bash[22676]: audit 2024-09-21T00:01:58.832329+0000 mgr.a (mgr.14388) 4648 : audit [DBG] from='client.110331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:00 smithi044 bash[22676]: cluster 2024-09-21T00:01:58.902622+0000 mgr.a (mgr.14388) 4649 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:00 smithi044 bash[22676]: audit 2024-09-21T00:01:59.351970+0000 mon.a (mon.0) 4304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:00 smithi044 bash[22676]: audit 2024-09-21T00:01:59.360206+0000 mon.a (mon.0) 4305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:00 smithi044 bash[22676]: audit 2024-09-21T00:01:59.370171+0000 mon.a (mon.0) 4306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:00 smithi179 bash[23186]: audit 2024-09-21T00:01:58.832329+0000 mgr.a (mgr.14388) 4648 : audit [DBG] from='client.110331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:00 smithi179 bash[23186]: cluster 2024-09-21T00:01:58.902622+0000 mgr.a (mgr.14388) 4649 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:00 smithi179 bash[23186]: audit 2024-09-21T00:01:59.351970+0000 mon.a (mon.0) 4304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:00 smithi179 bash[23186]: audit 2024-09-21T00:01:59.360206+0000 mon.a (mon.0) 4305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:00 smithi179 bash[23186]: audit 2024-09-21T00:01:59.370171+0000 mon.a (mon.0) 4306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:00 smithi049 bash[23528]: audit 2024-09-21T00:01:58.832329+0000 mgr.a (mgr.14388) 4648 : audit [DBG] from='client.110331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:00 smithi049 bash[23528]: cluster 2024-09-21T00:01:58.902622+0000 mgr.a (mgr.14388) 4649 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:00 smithi049 bash[23528]: audit 2024-09-21T00:01:59.351970+0000 mon.a (mon.0) 4304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:00 smithi049 bash[23528]: audit 2024-09-21T00:01:59.360206+0000 mon.a (mon.0) 4305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:00 smithi049 bash[23528]: audit 2024-09-21T00:01:59.370171+0000 mon.a (mon.0) 4306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:02 smithi179 bash[23186]: cluster 2024-09-21T00:02:00.904914+0000 mgr.a (mgr.14388) 4650 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:02 smithi179 bash[23186]: audit 2024-09-21T00:02:02.085979+0000 mon.a (mon.0) 4307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:02 smithi179 bash[23186]: audit 2024-09-21T00:02:02.095857+0000 mon.a (mon.0) 4308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:02 smithi179 bash[23186]: audit 2024-09-21T00:02:02.107202+0000 mon.a (mon.0) 4309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:02 smithi044 bash[22676]: cluster 2024-09-21T00:02:00.904914+0000 mgr.a (mgr.14388) 4650 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:02 smithi044 bash[22676]: audit 2024-09-21T00:02:02.085979+0000 mon.a (mon.0) 4307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:02 smithi044 bash[22676]: audit 2024-09-21T00:02:02.095857+0000 mon.a (mon.0) 4308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:02 smithi044 bash[22676]: audit 2024-09-21T00:02:02.107202+0000 mon.a (mon.0) 4309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:02 smithi049 bash[23528]: cluster 2024-09-21T00:02:00.904914+0000 mgr.a (mgr.14388) 4650 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:02 smithi049 bash[23528]: audit 2024-09-21T00:02:02.085979+0000 mon.a (mon.0) 4307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:02 smithi049 bash[23528]: audit 2024-09-21T00:02:02.095857+0000 mon.a (mon.0) 4308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:02 smithi049 bash[23528]: audit 2024-09-21T00:02:02.107202+0000 mon.a (mon.0) 4309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:04.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:04.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:04 smithi044 bash[22676]: cluster 2024-09-21T00:02:02.905700+0000 mgr.a (mgr.14388) 4651 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:04 smithi044 bash[22676]: audit 2024-09-21T00:02:03.612093+0000 mon.a (mon.0) 4310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:04 smithi044 bash[22676]: audit 2024-09-21T00:02:03.620421+0000 mon.a (mon.0) 4311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:04 smithi044 bash[22676]: audit 2024-09-21T00:02:03.630268+0000 mon.a (mon.0) 4312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:04 smithi179 bash[23186]: cluster 2024-09-21T00:02:02.905700+0000 mgr.a (mgr.14388) 4651 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:04 smithi179 bash[23186]: audit 2024-09-21T00:02:03.612093+0000 mon.a (mon.0) 4310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:04 smithi179 bash[23186]: audit 2024-09-21T00:02:03.620421+0000 mon.a (mon.0) 4311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:04 smithi179 bash[23186]: audit 2024-09-21T00:02:03.630268+0000 mon.a (mon.0) 4312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:04 smithi049 bash[23528]: cluster 2024-09-21T00:02:02.905700+0000 mgr.a (mgr.14388) 4651 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:04 smithi049 bash[23528]: audit 2024-09-21T00:02:03.612093+0000 mon.a (mon.0) 4310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:04 smithi049 bash[23528]: audit 2024-09-21T00:02:03.620421+0000 mon.a (mon.0) 4311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:04 smithi049 bash[23528]: audit 2024-09-21T00:02:03.630268+0000 mon.a (mon.0) 4312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:05.019 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:05.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:06 smithi044 bash[22676]: audit 2024-09-21T00:02:04.590498+0000 mgr.a (mgr.14388) 4652 : audit [DBG] from='client.110406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:06 smithi044 bash[22676]: cluster 2024-09-21T00:02:04.907069+0000 mgr.a (mgr.14388) 4653 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:02:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:06 smithi179 bash[23186]: audit 2024-09-21T00:02:04.590498+0000 mgr.a (mgr.14388) 4652 : audit [DBG] from='client.110406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:06 smithi179 bash[23186]: cluster 2024-09-21T00:02:04.907069+0000 mgr.a (mgr.14388) 4653 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:02:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:06 smithi049 bash[23528]: audit 2024-09-21T00:02:04.590498+0000 mgr.a (mgr.14388) 4652 : audit [DBG] from='client.110406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:06 smithi049 bash[23528]: cluster 2024-09-21T00:02:04.907069+0000 mgr.a (mgr.14388) 4653 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:02:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:08 smithi044 bash[22676]: cluster 2024-09-21T00:02:06.907952+0000 mgr.a (mgr.14388) 4654 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:02:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:08 smithi179 bash[23186]: cluster 2024-09-21T00:02:06.907952+0000 mgr.a (mgr.14388) 4654 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:02:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:08 smithi049 bash[23528]: cluster 2024-09-21T00:02:06.907952+0000 mgr.a (mgr.14388) 4654 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:02:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:10 smithi044 bash[22676]: cluster 2024-09-21T00:02:08.908737+0000 mgr.a (mgr.14388) 4655 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:02:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:10 smithi179 bash[23186]: cluster 2024-09-21T00:02:08.908737+0000 mgr.a (mgr.14388) 4655 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:02:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:10 smithi049 bash[23528]: cluster 2024-09-21T00:02:08.908737+0000 mgr.a (mgr.14388) 4655 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:02:10.773 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:10.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:12 smithi044 bash[22676]: audit 2024-09-21T00:02:10.358611+0000 mgr.a (mgr.14388) 4656 : audit [DBG] from='client.110484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:12 smithi044 bash[22676]: cluster 2024-09-21T00:02:10.911437+0000 mgr.a (mgr.14388) 4657 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:12 smithi179 bash[23186]: audit 2024-09-21T00:02:10.358611+0000 mgr.a (mgr.14388) 4656 : audit [DBG] from='client.110484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:12 smithi179 bash[23186]: cluster 2024-09-21T00:02:10.911437+0000 mgr.a (mgr.14388) 4657 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:12 smithi049 bash[23528]: audit 2024-09-21T00:02:10.358611+0000 mgr.a (mgr.14388) 4656 : audit [DBG] from='client.110484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:12 smithi049 bash[23528]: cluster 2024-09-21T00:02:10.911437+0000 mgr.a (mgr.14388) 4657 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:14 smithi044 bash[22676]: cluster 2024-09-21T00:02:12.912207+0000 mgr.a (mgr.14388) 4658 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:02:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:14 smithi179 bash[23186]: cluster 2024-09-21T00:02:12.912207+0000 mgr.a (mgr.14388) 4658 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:02:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:14 smithi049 bash[23528]: cluster 2024-09-21T00:02:12.912207+0000 mgr.a (mgr.14388) 4658 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:02:15.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:15.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:15.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:16 smithi044 bash[22676]: cluster 2024-09-21T00:02:14.913434+0000 mgr.a (mgr.14388) 4659 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:16 smithi179 bash[23186]: cluster 2024-09-21T00:02:14.913434+0000 mgr.a (mgr.14388) 4659 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:16.534 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:16.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:16.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:16.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:16.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:16 smithi049 bash[23528]: cluster 2024-09-21T00:02:14.913434+0000 mgr.a (mgr.14388) 4659 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:17 smithi179 bash[23186]: audit 2024-09-21T00:02:16.111533+0000 mgr.a (mgr.14388) 4660 : audit [DBG] from='client.110559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:17 smithi049 bash[23528]: audit 2024-09-21T00:02:16.111533+0000 mgr.a (mgr.14388) 4660 : audit [DBG] from='client.110559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:17.607 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:17 smithi044 bash[22676]: audit 2024-09-21T00:02:16.111533+0000 mgr.a (mgr.14388) 4660 : audit [DBG] from='client.110559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:18 smithi179 bash[23186]: cluster 2024-09-21T00:02:16.914285+0000 mgr.a (mgr.14388) 4661 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:02:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:18 smithi049 bash[23528]: cluster 2024-09-21T00:02:16.914285+0000 mgr.a (mgr.14388) 4661 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:02:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:18 smithi044 bash[22676]: cluster 2024-09-21T00:02:16.914285+0000 mgr.a (mgr.14388) 4661 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:02:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:20 smithi049 bash[23528]: cluster 2024-09-21T00:02:18.915043+0000 mgr.a (mgr.14388) 4662 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:02:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:20 smithi049 bash[23528]: audit 2024-09-21T00:02:19.534004+0000 mon.a (mon.0) 4313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:20 smithi049 bash[23528]: audit 2024-09-21T00:02:19.542602+0000 mon.a (mon.0) 4314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:20 smithi049 bash[23528]: audit 2024-09-21T00:02:19.553376+0000 mon.a (mon.0) 4315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:20 smithi179 bash[23186]: cluster 2024-09-21T00:02:18.915043+0000 mgr.a (mgr.14388) 4662 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:02:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:20 smithi179 bash[23186]: audit 2024-09-21T00:02:19.534004+0000 mon.a (mon.0) 4313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:20 smithi179 bash[23186]: audit 2024-09-21T00:02:19.542602+0000 mon.a (mon.0) 4314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:20 smithi179 bash[23186]: audit 2024-09-21T00:02:19.553376+0000 mon.a (mon.0) 4315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:20 smithi044 bash[22676]: cluster 2024-09-21T00:02:18.915043+0000 mgr.a (mgr.14388) 4662 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:02:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:20 smithi044 bash[22676]: audit 2024-09-21T00:02:19.534004+0000 mon.a (mon.0) 4313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:20 smithi044 bash[22676]: audit 2024-09-21T00:02:19.542602+0000 mon.a (mon.0) 4314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:20 smithi044 bash[22676]: audit 2024-09-21T00:02:19.553376+0000 mon.a (mon.0) 4315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:21.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:21.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:22.315 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:22 smithi179 bash[23186]: cluster 2024-09-21T00:02:20.917229+0000 mgr.a (mgr.14388) 4663 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:02:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:22 smithi179 bash[23186]: audit 2024-09-21T00:02:22.243190+0000 mon.a (mon.0) 4316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:22 smithi179 bash[23186]: audit 2024-09-21T00:02:22.249419+0000 mon.a (mon.0) 4317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:22 smithi049 bash[23528]: cluster 2024-09-21T00:02:20.917229+0000 mgr.a (mgr.14388) 4663 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:02:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:22 smithi049 bash[23528]: audit 2024-09-21T00:02:22.243190+0000 mon.a (mon.0) 4316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:22 smithi049 bash[23528]: audit 2024-09-21T00:02:22.249419+0000 mon.a (mon.0) 4317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:22 smithi044 bash[22676]: cluster 2024-09-21T00:02:20.917229+0000 mgr.a (mgr.14388) 4663 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:02:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:22 smithi044 bash[22676]: audit 2024-09-21T00:02:22.243190+0000 mon.a (mon.0) 4316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:22 smithi044 bash[22676]: audit 2024-09-21T00:02:22.249419+0000 mon.a (mon.0) 4317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:23 smithi049 bash[23528]: audit 2024-09-21T00:02:21.873552+0000 mgr.a (mgr.14388) 4664 : audit [DBG] from='client.110634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:23 smithi049 bash[23528]: audit 2024-09-21T00:02:22.259078+0000 mon.a (mon.0) 4318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:23.681 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:23 smithi179 bash[23186]: audit 2024-09-21T00:02:21.873552+0000 mgr.a (mgr.14388) 4664 : audit [DBG] from='client.110634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:23.681 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:23 smithi179 bash[23186]: audit 2024-09-21T00:02:22.259078+0000 mon.a (mon.0) 4318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:23 smithi044 bash[22676]: audit 2024-09-21T00:02:21.873552+0000 mgr.a (mgr.14388) 4664 : audit [DBG] from='client.110634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:23 smithi044 bash[22676]: audit 2024-09-21T00:02:22.259078+0000 mon.a (mon.0) 4318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:24 smithi049 bash[23528]: cluster 2024-09-21T00:02:22.918109+0000 mgr.a (mgr.14388) 4665 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:24 smithi049 bash[23528]: audit 2024-09-21T00:02:23.848055+0000 mon.a (mon.0) 4319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:24 smithi049 bash[23528]: audit 2024-09-21T00:02:23.856622+0000 mon.a (mon.0) 4320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:24 smithi049 bash[23528]: audit 2024-09-21T00:02:23.865768+0000 mon.a (mon.0) 4321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:24 smithi044 bash[22676]: cluster 2024-09-21T00:02:22.918109+0000 mgr.a (mgr.14388) 4665 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:24 smithi044 bash[22676]: audit 2024-09-21T00:02:23.848055+0000 mon.a (mon.0) 4319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:24 smithi044 bash[22676]: audit 2024-09-21T00:02:23.856622+0000 mon.a (mon.0) 4320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:24 smithi044 bash[22676]: audit 2024-09-21T00:02:23.865768+0000 mon.a (mon.0) 4321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:24 smithi179 bash[23186]: cluster 2024-09-21T00:02:22.918109+0000 mgr.a (mgr.14388) 4665 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:24 smithi179 bash[23186]: audit 2024-09-21T00:02:23.848055+0000 mon.a (mon.0) 4319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:24 smithi179 bash[23186]: audit 2024-09-21T00:02:23.856622+0000 mon.a (mon.0) 4320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:24 smithi179 bash[23186]: audit 2024-09-21T00:02:23.865768+0000 mon.a (mon.0) 4321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:26 smithi049 bash[23528]: cluster 2024-09-21T00:02:24.920213+0000 mgr.a (mgr.14388) 4666 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:26 smithi044 bash[22676]: cluster 2024-09-21T00:02:24.920213+0000 mgr.a (mgr.14388) 4666 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:26 smithi179 bash[23186]: cluster 2024-09-21T00:02:24.920213+0000 mgr.a (mgr.14388) 4666 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:28.100 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:28.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:28.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:28.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:28.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:28 smithi049 bash[23528]: cluster 2024-09-21T00:02:26.920955+0000 mgr.a (mgr.14388) 4667 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:28 smithi044 bash[22676]: cluster 2024-09-21T00:02:26.920955+0000 mgr.a (mgr.14388) 4667 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:28 smithi179 bash[23186]: cluster 2024-09-21T00:02:26.920955+0000 mgr.a (mgr.14388) 4667 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:29 smithi049 bash[23528]: audit 2024-09-21T00:02:27.652476+0000 mgr.a (mgr.14388) 4668 : audit [DBG] from='client.110712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:29 smithi044 bash[22676]: audit 2024-09-21T00:02:27.652476+0000 mgr.a (mgr.14388) 4668 : audit [DBG] from='client.110712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:29 smithi179 bash[23186]: audit 2024-09-21T00:02:27.652476+0000 mgr.a (mgr.14388) 4668 : audit [DBG] from='client.110712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:30 smithi049 bash[23528]: cluster 2024-09-21T00:02:28.921877+0000 mgr.a (mgr.14388) 4669 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:30 smithi044 bash[22676]: cluster 2024-09-21T00:02:28.921877+0000 mgr.a (mgr.14388) 4669 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:30 smithi179 bash[23186]: cluster 2024-09-21T00:02:28.921877+0000 mgr.a (mgr.14388) 4669 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:31 smithi044 bash[22676]: cluster 2024-09-21T00:02:30.924093+0000 mgr.a (mgr.14388) 4670 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:31 smithi179 bash[23186]: cluster 2024-09-21T00:02:30.924093+0000 mgr.a (mgr.14388) 4670 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:31 smithi049 bash[23528]: cluster 2024-09-21T00:02:30.924093+0000 mgr.a (mgr.14388) 4670 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:33.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:33.102 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:33.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:33.878 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:33 smithi044 bash[22676]: cluster 2024-09-21T00:02:32.924883+0000 mgr.a (mgr.14388) 4671 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:33 smithi179 bash[23186]: cluster 2024-09-21T00:02:32.924883+0000 mgr.a (mgr.14388) 4671 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:33 smithi049 bash[23528]: cluster 2024-09-21T00:02:32.924883+0000 mgr.a (mgr.14388) 4671 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:35.249 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:34 smithi044 bash[22676]: audit 2024-09-21T00:02:33.440867+0000 mgr.a (mgr.14388) 4672 : audit [DBG] from='client.110790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:34 smithi179 bash[23186]: audit 2024-09-21T00:02:33.440867+0000 mgr.a (mgr.14388) 4672 : audit [DBG] from='client.110790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:34 smithi049 bash[23528]: audit 2024-09-21T00:02:33.440867+0000 mgr.a (mgr.14388) 4672 : audit [DBG] from='client.110790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:35 smithi179 bash[23186]: cluster 2024-09-21T00:02:34.926379+0000 mgr.a (mgr.14388) 4673 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:35 smithi049 bash[23528]: cluster 2024-09-21T00:02:34.926379+0000 mgr.a (mgr.14388) 4673 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:35 smithi044 bash[22676]: cluster 2024-09-21T00:02:34.926379+0000 mgr.a (mgr.14388) 4673 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:02:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:36 smithi044 bash[22676]: audit 2024-09-21T00:02:36.952690+0000 mon.a (mon.0) 4322 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:02:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:36 smithi179 bash[23186]: audit 2024-09-21T00:02:36.952690+0000 mon.a (mon.0) 4322 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:02:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:36 smithi049 bash[23528]: audit 2024-09-21T00:02:36.952690+0000 mon.a (mon.0) 4322 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:02:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:38 smithi179 bash[23186]: cluster 2024-09-21T00:02:36.927137+0000 mgr.a (mgr.14388) 4674 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:38 smithi179 bash[23186]: audit 2024-09-21T00:02:37.502903+0000 mon.a (mon.0) 4323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:38 smithi179 bash[23186]: audit 2024-09-21T00:02:37.509925+0000 mon.a (mon.0) 4324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:38 smithi179 bash[23186]: audit 2024-09-21T00:02:37.511560+0000 mon.a (mon.0) 4325 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:02:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:38 smithi179 bash[23186]: audit 2024-09-21T00:02:37.512614+0000 mon.a (mon.0) 4326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:02:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:38 smithi179 bash[23186]: audit 2024-09-21T00:02:37.518561+0000 mon.a (mon.0) 4327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:38 smithi179 bash[23186]: audit 2024-09-21T00:02:37.521423+0000 mon.a (mon.0) 4328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:02:38.261 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22676]: cluster 2024-09-21T00:02:36.927137+0000 mgr.a (mgr.14388) 4674 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:38.261 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22676]: audit 2024-09-21T00:02:37.502903+0000 mon.a (mon.0) 4323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22676]: audit 2024-09-21T00:02:37.509925+0000 mon.a (mon.0) 4324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22676]: audit 2024-09-21T00:02:37.511560+0000 mon.a (mon.0) 4325 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:02:38.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22676]: audit 2024-09-21T00:02:37.512614+0000 mon.a (mon.0) 4326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:02:38.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22676]: audit 2024-09-21T00:02:37.518561+0000 mon.a (mon.0) 4327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22676]: audit 2024-09-21T00:02:37.521423+0000 mon.a (mon.0) 4328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:02:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:38 smithi049 bash[23528]: cluster 2024-09-21T00:02:36.927137+0000 mgr.a (mgr.14388) 4674 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:38 smithi049 bash[23528]: audit 2024-09-21T00:02:37.502903+0000 mon.a (mon.0) 4323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:38 smithi049 bash[23528]: audit 2024-09-21T00:02:37.509925+0000 mon.a (mon.0) 4324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:38 smithi049 bash[23528]: audit 2024-09-21T00:02:37.511560+0000 mon.a (mon.0) 4325 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:02:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:38 smithi049 bash[23528]: audit 2024-09-21T00:02:37.512614+0000 mon.a (mon.0) 4326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:02:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:38 smithi049 bash[23528]: audit 2024-09-21T00:02:37.518561+0000 mon.a (mon.0) 4327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:38 smithi049 bash[23528]: audit 2024-09-21T00:02:37.521423+0000 mon.a (mon.0) 4328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:02:38.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22930]: debug 2024-09-21T00:02:38.259+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:02:38.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:02:38 smithi044 bash[22930]: debug 2024-09-21T00:02:38.259+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:02:38.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:38.879 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:38.879 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:39 smithi044 bash[22676]: audit 2024-09-21T00:02:37.522495+0000 mgr.a (mgr.14388) 4675 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:02:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:39 smithi044 bash[22676]: audit 2024-09-21T00:02:38.261846+0000 mgr.a (mgr.14388) 4676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:02:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:39 smithi044 bash[22676]: cephadm 2024-09-21T00:02:38.263109+0000 mgr.a (mgr.14388) 4677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:02:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:39 smithi049 bash[23528]: audit 2024-09-21T00:02:37.522495+0000 mgr.a (mgr.14388) 4675 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:02:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:39 smithi049 bash[23528]: audit 2024-09-21T00:02:38.261846+0000 mgr.a (mgr.14388) 4676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:02:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:39 smithi049 bash[23528]: cephadm 2024-09-21T00:02:38.263109+0000 mgr.a (mgr.14388) 4677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:02:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:39 smithi179 bash[23186]: audit 2024-09-21T00:02:37.522495+0000 mgr.a (mgr.14388) 4675 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:02:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:39 smithi179 bash[23186]: audit 2024-09-21T00:02:38.261846+0000 mgr.a (mgr.14388) 4676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:02:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:39 smithi179 bash[23186]: cephadm 2024-09-21T00:02:38.263109+0000 mgr.a (mgr.14388) 4677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:02:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:39.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:39.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:39.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:39.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:40 smithi049 bash[23528]: cluster 2024-09-21T00:02:38.927818+0000 mgr.a (mgr.14388) 4678 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:40 smithi049 bash[23528]: audit 2024-09-21T00:02:39.204462+0000 mgr.a (mgr.14388) 4679 : audit [DBG] from='client.110976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:40 smithi049 bash[23528]: audit 2024-09-21T00:02:39.774290+0000 mon.a (mon.0) 4329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:40 smithi049 bash[23528]: audit 2024-09-21T00:02:39.783200+0000 mon.a (mon.0) 4330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:40 smithi049 bash[23528]: audit 2024-09-21T00:02:39.793867+0000 mon.a (mon.0) 4331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.408 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:40 smithi179 bash[23186]: cluster 2024-09-21T00:02:38.927818+0000 mgr.a (mgr.14388) 4678 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:40.409 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:40 smithi179 bash[23186]: audit 2024-09-21T00:02:39.204462+0000 mgr.a (mgr.14388) 4679 : audit [DBG] from='client.110976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:40.409 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:40 smithi179 bash[23186]: audit 2024-09-21T00:02:39.774290+0000 mon.a (mon.0) 4329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.409 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:40 smithi179 bash[23186]: audit 2024-09-21T00:02:39.783200+0000 mon.a (mon.0) 4330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.409 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:40 smithi179 bash[23186]: audit 2024-09-21T00:02:39.793867+0000 mon.a (mon.0) 4331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:40 smithi044 bash[22676]: cluster 2024-09-21T00:02:38.927818+0000 mgr.a (mgr.14388) 4678 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:40 smithi044 bash[22676]: audit 2024-09-21T00:02:39.204462+0000 mgr.a (mgr.14388) 4679 : audit [DBG] from='client.110976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:40 smithi044 bash[22676]: audit 2024-09-21T00:02:39.774290+0000 mon.a (mon.0) 4329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:40 smithi044 bash[22676]: audit 2024-09-21T00:02:39.783200+0000 mon.a (mon.0) 4330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:40 smithi044 bash[22676]: audit 2024-09-21T00:02:39.793867+0000 mon.a (mon.0) 4331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:42.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:42 smithi179 bash[23186]: cluster 2024-09-21T00:02:40.930149+0000 mgr.a (mgr.14388) 4680 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:42.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:42 smithi049 bash[23528]: cluster 2024-09-21T00:02:40.930149+0000 mgr.a (mgr.14388) 4680 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:42 smithi044 bash[22676]: cluster 2024-09-21T00:02:40.930149+0000 mgr.a (mgr.14388) 4680 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:43.511 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:43 smithi179 bash[23186]: audit 2024-09-21T00:02:42.404614+0000 mon.a (mon.0) 4332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.512 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:43 smithi179 bash[23186]: audit 2024-09-21T00:02:42.413081+0000 mon.a (mon.0) 4333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.512 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:43 smithi179 bash[23186]: audit 2024-09-21T00:02:42.423098+0000 mon.a (mon.0) 4334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.512 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:43 smithi179 bash[23186]: cluster 2024-09-21T00:02:42.930936+0000 mgr.a (mgr.14388) 4681 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:43 smithi044 bash[22676]: audit 2024-09-21T00:02:42.404614+0000 mon.a (mon.0) 4332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:43 smithi044 bash[22676]: audit 2024-09-21T00:02:42.413081+0000 mon.a (mon.0) 4333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:43 smithi044 bash[22676]: audit 2024-09-21T00:02:42.423098+0000 mon.a (mon.0) 4334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:43 smithi044 bash[22676]: cluster 2024-09-21T00:02:42.930936+0000 mgr.a (mgr.14388) 4681 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:43 smithi049 bash[23528]: audit 2024-09-21T00:02:42.404614+0000 mon.a (mon.0) 4332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:43 smithi049 bash[23528]: audit 2024-09-21T00:02:42.413081+0000 mon.a (mon.0) 4333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:43 smithi049 bash[23528]: audit 2024-09-21T00:02:42.423098+0000 mon.a (mon.0) 4334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:43 smithi049 bash[23528]: cluster 2024-09-21T00:02:42.930936+0000 mgr.a (mgr.14388) 4681 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:44.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:44.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:44.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:45.400 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:45.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:45.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:45.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:45.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:45 smithi044 bash[22676]: audit 2024-09-21T00:02:44.075109+0000 mon.a (mon.0) 4335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:45 smithi044 bash[22676]: audit 2024-09-21T00:02:44.082786+0000 mon.a (mon.0) 4336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:45 smithi044 bash[22676]: audit 2024-09-21T00:02:44.092819+0000 mon.a (mon.0) 4337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:45 smithi179 bash[23186]: audit 2024-09-21T00:02:44.075109+0000 mon.a (mon.0) 4335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:45 smithi179 bash[23186]: audit 2024-09-21T00:02:44.082786+0000 mon.a (mon.0) 4336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:45 smithi179 bash[23186]: audit 2024-09-21T00:02:44.092819+0000 mon.a (mon.0) 4337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:45 smithi049 bash[23528]: audit 2024-09-21T00:02:44.075109+0000 mon.a (mon.0) 4335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:45 smithi049 bash[23528]: audit 2024-09-21T00:02:44.082786+0000 mon.a (mon.0) 4336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:45 smithi049 bash[23528]: audit 2024-09-21T00:02:44.092819+0000 mon.a (mon.0) 4337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:02:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:46 smithi044 bash[22676]: cluster 2024-09-21T00:02:44.932747+0000 mgr.a (mgr.14388) 4682 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:46 smithi044 bash[22676]: audit 2024-09-21T00:02:44.970293+0000 mgr.a (mgr.14388) 4683 : audit [DBG] from='client.111054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:46 smithi179 bash[23186]: cluster 2024-09-21T00:02:44.932747+0000 mgr.a (mgr.14388) 4682 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:46 smithi179 bash[23186]: audit 2024-09-21T00:02:44.970293+0000 mgr.a (mgr.14388) 4683 : audit [DBG] from='client.111054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:46 smithi049 bash[23528]: cluster 2024-09-21T00:02:44.932747+0000 mgr.a (mgr.14388) 4682 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:46 smithi049 bash[23528]: audit 2024-09-21T00:02:44.970293+0000 mgr.a (mgr.14388) 4683 : audit [DBG] from='client.111054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:48 smithi044 bash[22676]: cluster 2024-09-21T00:02:46.933884+0000 mgr.a (mgr.14388) 4684 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:02:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:48 smithi179 bash[23186]: cluster 2024-09-21T00:02:46.933884+0000 mgr.a (mgr.14388) 4684 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:02:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:48 smithi049 bash[23528]: cluster 2024-09-21T00:02:46.933884+0000 mgr.a (mgr.14388) 4684 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:02:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:50.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:50.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:50 smithi044 bash[22676]: cluster 2024-09-21T00:02:48.934711+0000 mgr.a (mgr.14388) 4685 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:02:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:50 smithi179 bash[23186]: cluster 2024-09-21T00:02:48.934711+0000 mgr.a (mgr.14388) 4685 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:02:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:50 smithi049 bash[23528]: cluster 2024-09-21T00:02:48.934711+0000 mgr.a (mgr.14388) 4685 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:02:51.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:51.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:51.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:51.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:51.193 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:52 smithi044 bash[22676]: audit 2024-09-21T00:02:50.740295+0000 mgr.a (mgr.14388) 4686 : audit [DBG] from='client.111126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:52 smithi044 bash[22676]: cluster 2024-09-21T00:02:50.936060+0000 mgr.a (mgr.14388) 4687 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:52 smithi179 bash[23186]: audit 2024-09-21T00:02:50.740295+0000 mgr.a (mgr.14388) 4686 : audit [DBG] from='client.111126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:52 smithi179 bash[23186]: cluster 2024-09-21T00:02:50.936060+0000 mgr.a (mgr.14388) 4687 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:52 smithi049 bash[23528]: audit 2024-09-21T00:02:50.740295+0000 mgr.a (mgr.14388) 4686 : audit [DBG] from='client.111126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:52 smithi049 bash[23528]: cluster 2024-09-21T00:02:50.936060+0000 mgr.a (mgr.14388) 4687 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:02:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:54 smithi044 bash[22676]: cluster 2024-09-21T00:02:52.936965+0000 mgr.a (mgr.14388) 4688 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:02:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:54 smithi179 bash[23186]: cluster 2024-09-21T00:02:52.936965+0000 mgr.a (mgr.14388) 4688 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:02:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:54 smithi049 bash[23528]: cluster 2024-09-21T00:02:52.936965+0000 mgr.a (mgr.14388) 4688 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:02:56.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:02:56.195 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:02:56.195 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:02:56.433 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:56 smithi044 bash[22676]: cluster 2024-09-21T00:02:54.939100+0000 mgr.a (mgr.14388) 4689 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:56 smithi179 bash[23186]: cluster 2024-09-21T00:02:54.939100+0000 mgr.a (mgr.14388) 4689 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:56 smithi049 bash[23528]: cluster 2024-09-21T00:02:54.939100+0000 mgr.a (mgr.14388) 4689 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:56.988 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:02:56.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:02:56.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:02:56.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:02:56.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:02:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:58 smithi044 bash[22676]: audit 2024-09-21T00:02:56.532701+0000 mgr.a (mgr.14388) 4690 : audit [DBG] from='client.111204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:02:58 smithi044 bash[22676]: cluster 2024-09-21T00:02:56.939789+0000 mgr.a (mgr.14388) 4691 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:58 smithi179 bash[23186]: audit 2024-09-21T00:02:56.532701+0000 mgr.a (mgr.14388) 4690 : audit [DBG] from='client.111204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:02:58 smithi179 bash[23186]: cluster 2024-09-21T00:02:56.939789+0000 mgr.a (mgr.14388) 4691 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:02:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:58 smithi049 bash[23528]: audit 2024-09-21T00:02:56.532701+0000 mgr.a (mgr.14388) 4690 : audit [DBG] from='client.111204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:02:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:02:58 smithi049 bash[23528]: cluster 2024-09-21T00:02:56.939789+0000 mgr.a (mgr.14388) 4691 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:00.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:00 smithi049 bash[23528]: cluster 2024-09-21T00:02:58.940572+0000 mgr.a (mgr.14388) 4692 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:00.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:00 smithi049 bash[23528]: audit 2024-09-21T00:03:00.007597+0000 mon.a (mon.0) 4338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.284 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:00 smithi049 bash[23528]: audit 2024-09-21T00:03:00.016154+0000 mon.a (mon.0) 4339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.284 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:00 smithi049 bash[23528]: audit 2024-09-21T00:03:00.026696+0000 mon.a (mon.0) 4340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:00 smithi044 bash[22676]: cluster 2024-09-21T00:02:58.940572+0000 mgr.a (mgr.14388) 4692 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:00 smithi044 bash[22676]: audit 2024-09-21T00:03:00.007597+0000 mon.a (mon.0) 4338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:00 smithi044 bash[22676]: audit 2024-09-21T00:03:00.016154+0000 mon.a (mon.0) 4339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:00 smithi044 bash[22676]: audit 2024-09-21T00:03:00.026696+0000 mon.a (mon.0) 4340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:00 smithi179 bash[23186]: cluster 2024-09-21T00:02:58.940572+0000 mgr.a (mgr.14388) 4692 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:00 smithi179 bash[23186]: audit 2024-09-21T00:03:00.007597+0000 mon.a (mon.0) 4338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:00 smithi179 bash[23186]: audit 2024-09-21T00:03:00.016154+0000 mon.a (mon.0) 4339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:00 smithi179 bash[23186]: audit 2024-09-21T00:03:00.026696+0000 mon.a (mon.0) 4340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:01.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:01.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:01.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:02 smithi049 bash[23528]: cluster 2024-09-21T00:03:00.942890+0000 mgr.a (mgr.14388) 4693 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:02 smithi044 bash[22676]: cluster 2024-09-21T00:03:00.942890+0000 mgr.a (mgr.14388) 4693 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:02 smithi179 bash[23186]: cluster 2024-09-21T00:03:00.942890+0000 mgr.a (mgr.14388) 4693 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:02.773 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:02.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:02.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:02.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:02.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:03.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:03 smithi179 bash[23186]: audit 2024-09-21T00:03:02.331378+0000 mgr.a (mgr.14388) 4694 : audit [DBG] from='client.111282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:03.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:03 smithi179 bash[23186]: audit 2024-09-21T00:03:02.601065+0000 mon.a (mon.0) 4341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:03.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:03 smithi179 bash[23186]: audit 2024-09-21T00:03:02.608495+0000 mon.a (mon.0) 4342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:03.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:03 smithi179 bash[23186]: audit 2024-09-21T00:03:02.615978+0000 mon.a (mon.0) 4343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:03.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:03 smithi179 bash[23186]: cluster 2024-09-21T00:03:02.943899+0000 mgr.a (mgr.14388) 4695 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:03 smithi044 bash[22676]: audit 2024-09-21T00:03:02.331378+0000 mgr.a (mgr.14388) 4694 : audit [DBG] from='client.111282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:03 smithi044 bash[22676]: audit 2024-09-21T00:03:02.601065+0000 mon.a (mon.0) 4341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:03 smithi044 bash[22676]: audit 2024-09-21T00:03:02.608495+0000 mon.a (mon.0) 4342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:03 smithi044 bash[22676]: audit 2024-09-21T00:03:02.615978+0000 mon.a (mon.0) 4343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:03 smithi044 bash[22676]: cluster 2024-09-21T00:03:02.943899+0000 mgr.a (mgr.14388) 4695 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:03 smithi049 bash[23528]: audit 2024-09-21T00:03:02.331378+0000 mgr.a (mgr.14388) 4694 : audit [DBG] from='client.111282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:03 smithi049 bash[23528]: audit 2024-09-21T00:03:02.601065+0000 mon.a (mon.0) 4341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:03 smithi049 bash[23528]: audit 2024-09-21T00:03:02.608495+0000 mon.a (mon.0) 4342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:03 smithi049 bash[23528]: audit 2024-09-21T00:03:02.615978+0000 mon.a (mon.0) 4343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:03 smithi049 bash[23528]: cluster 2024-09-21T00:03:02.943899+0000 mgr.a (mgr.14388) 4695 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:05.731 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:05 smithi049 bash[23528]: audit 2024-09-21T00:03:04.310134+0000 mon.a (mon.0) 4344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.731 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:05 smithi049 bash[23528]: audit 2024-09-21T00:03:04.318434+0000 mon.a (mon.0) 4345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.731 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:05 smithi049 bash[23528]: audit 2024-09-21T00:03:04.329095+0000 mon.a (mon.0) 4346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.732 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:05 smithi049 bash[23528]: cluster 2024-09-21T00:03:04.946100+0000 mgr.a (mgr.14388) 4696 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:05 smithi044 bash[22676]: audit 2024-09-21T00:03:04.310134+0000 mon.a (mon.0) 4344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:05 smithi044 bash[22676]: audit 2024-09-21T00:03:04.318434+0000 mon.a (mon.0) 4345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:05 smithi044 bash[22676]: audit 2024-09-21T00:03:04.329095+0000 mon.a (mon.0) 4346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:05 smithi044 bash[22676]: cluster 2024-09-21T00:03:04.946100+0000 mgr.a (mgr.14388) 4696 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:05 smithi179 bash[23186]: audit 2024-09-21T00:03:04.310134+0000 mon.a (mon.0) 4344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:05 smithi179 bash[23186]: audit 2024-09-21T00:03:04.318434+0000 mon.a (mon.0) 4345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:05 smithi179 bash[23186]: audit 2024-09-21T00:03:04.329095+0000 mon.a (mon.0) 4346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:05 smithi179 bash[23186]: cluster 2024-09-21T00:03:04.946100+0000 mgr.a (mgr.14388) 4696 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:07.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:07.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:07.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:08 smithi049 bash[23528]: cluster 2024-09-21T00:03:06.946910+0000 mgr.a (mgr.14388) 4697 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:08 smithi044 bash[22676]: cluster 2024-09-21T00:03:06.946910+0000 mgr.a (mgr.14388) 4697 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:08 smithi179 bash[23186]: cluster 2024-09-21T00:03:06.946910+0000 mgr.a (mgr.14388) 4697 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:08.547 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:09 smithi049 bash[23528]: audit 2024-09-21T00:03:08.108970+0000 mgr.a (mgr.14388) 4698 : audit [DBG] from='client.111357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:09 smithi044 bash[22676]: audit 2024-09-21T00:03:08.108970+0000 mgr.a (mgr.14388) 4698 : audit [DBG] from='client.111357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:09 smithi179 bash[23186]: audit 2024-09-21T00:03:08.108970+0000 mgr.a (mgr.14388) 4698 : audit [DBG] from='client.111357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:10 smithi049 bash[23528]: cluster 2024-09-21T00:03:08.947904+0000 mgr.a (mgr.14388) 4699 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:10 smithi044 bash[22676]: cluster 2024-09-21T00:03:08.947904+0000 mgr.a (mgr.14388) 4699 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:10 smithi179 bash[23186]: cluster 2024-09-21T00:03:08.947904+0000 mgr.a (mgr.14388) 4699 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:12 smithi049 bash[23528]: cluster 2024-09-21T00:03:10.950181+0000 mgr.a (mgr.14388) 4700 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:12 smithi044 bash[22676]: cluster 2024-09-21T00:03:10.950181+0000 mgr.a (mgr.14388) 4700 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:12 smithi179 bash[23186]: cluster 2024-09-21T00:03:10.950181+0000 mgr.a (mgr.14388) 4700 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:13.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:13.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:13.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:14 smithi049 bash[23528]: cluster 2024-09-21T00:03:12.950948+0000 mgr.a (mgr.14388) 4701 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:14.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:14.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:14.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:14.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:14 smithi044 bash[22676]: cluster 2024-09-21T00:03:12.950948+0000 mgr.a (mgr.14388) 4701 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:14 smithi179 bash[23186]: cluster 2024-09-21T00:03:12.950948+0000 mgr.a (mgr.14388) 4701 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:15 smithi049 bash[23528]: audit 2024-09-21T00:03:13.888677+0000 mgr.a (mgr.14388) 4702 : audit [DBG] from='client.111426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:15 smithi044 bash[22676]: audit 2024-09-21T00:03:13.888677+0000 mgr.a (mgr.14388) 4702 : audit [DBG] from='client.111426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:15 smithi179 bash[23186]: audit 2024-09-21T00:03:13.888677+0000 mgr.a (mgr.14388) 4702 : audit [DBG] from='client.111426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:16.290 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:16 smithi044 bash[22676]: cluster 2024-09-21T00:03:14.953292+0000 mgr.a (mgr.14388) 4703 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:16 smithi049 bash[23528]: cluster 2024-09-21T00:03:14.953292+0000 mgr.a (mgr.14388) 4703 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:16 smithi179 bash[23186]: cluster 2024-09-21T00:03:14.953292+0000 mgr.a (mgr.14388) 4703 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:18 smithi049 bash[23528]: cluster 2024-09-21T00:03:16.954108+0000 mgr.a (mgr.14388) 4704 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:18 smithi044 bash[22676]: cluster 2024-09-21T00:03:16.954108+0000 mgr.a (mgr.14388) 4704 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:18 smithi179 bash[23186]: cluster 2024-09-21T00:03:16.954108+0000 mgr.a (mgr.14388) 4704 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:19.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:19.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:20.079 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:20.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:20 smithi049 bash[23528]: cluster 2024-09-21T00:03:18.954875+0000 mgr.a (mgr.14388) 4705 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:20 smithi044 bash[22676]: cluster 2024-09-21T00:03:18.954875+0000 mgr.a (mgr.14388) 4705 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:20 smithi179 bash[23186]: cluster 2024-09-21T00:03:18.954875+0000 mgr.a (mgr.14388) 4705 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:21.484 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:21 smithi179 bash[23186]: audit 2024-09-21T00:03:19.662652+0000 mgr.a (mgr.14388) 4706 : audit [DBG] from='client.111501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:21.484 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:21 smithi179 bash[23186]: audit 2024-09-21T00:03:20.210929+0000 mon.a (mon.0) 4347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.484 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:21 smithi179 bash[23186]: audit 2024-09-21T00:03:20.216837+0000 mon.a (mon.0) 4348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.484 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:21 smithi179 bash[23186]: audit 2024-09-21T00:03:20.225638+0000 mon.a (mon.0) 4349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:21 smithi044 bash[22676]: audit 2024-09-21T00:03:19.662652+0000 mgr.a (mgr.14388) 4706 : audit [DBG] from='client.111501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:21 smithi044 bash[22676]: audit 2024-09-21T00:03:20.210929+0000 mon.a (mon.0) 4347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:21 smithi044 bash[22676]: audit 2024-09-21T00:03:20.216837+0000 mon.a (mon.0) 4348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:21 smithi044 bash[22676]: audit 2024-09-21T00:03:20.225638+0000 mon.a (mon.0) 4349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:21 smithi049 bash[23528]: audit 2024-09-21T00:03:19.662652+0000 mgr.a (mgr.14388) 4706 : audit [DBG] from='client.111501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:21 smithi049 bash[23528]: audit 2024-09-21T00:03:20.210929+0000 mon.a (mon.0) 4347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:21 smithi049 bash[23528]: audit 2024-09-21T00:03:20.216837+0000 mon.a (mon.0) 4348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:21 smithi049 bash[23528]: audit 2024-09-21T00:03:20.225638+0000 mon.a (mon.0) 4349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:22 smithi044 bash[22676]: cluster 2024-09-21T00:03:20.957833+0000 mgr.a (mgr.14388) 4707 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:03:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:22 smithi179 bash[23186]: cluster 2024-09-21T00:03:20.957833+0000 mgr.a (mgr.14388) 4707 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:03:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:22 smithi049 bash[23528]: cluster 2024-09-21T00:03:20.957833+0000 mgr.a (mgr.14388) 4707 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:03:24.162 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:23 smithi179 bash[23186]: audit 2024-09-21T00:03:22.809165+0000 mon.a (mon.0) 4350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.163 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:23 smithi179 bash[23186]: audit 2024-09-21T00:03:22.817696+0000 mon.a (mon.0) 4351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.163 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:23 smithi179 bash[23186]: audit 2024-09-21T00:03:22.827684+0000 mon.a (mon.0) 4352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.163 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:23 smithi179 bash[23186]: cluster 2024-09-21T00:03:22.958644+0000 mgr.a (mgr.14388) 4708 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:03:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:23 smithi044 bash[22676]: audit 2024-09-21T00:03:22.809165+0000 mon.a (mon.0) 4350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:23 smithi044 bash[22676]: audit 2024-09-21T00:03:22.817696+0000 mon.a (mon.0) 4351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:23 smithi044 bash[22676]: audit 2024-09-21T00:03:22.827684+0000 mon.a (mon.0) 4352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:23 smithi044 bash[22676]: cluster 2024-09-21T00:03:22.958644+0000 mgr.a (mgr.14388) 4708 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:03:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:23 smithi049 bash[23528]: audit 2024-09-21T00:03:22.809165+0000 mon.a (mon.0) 4350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:23 smithi049 bash[23528]: audit 2024-09-21T00:03:22.817696+0000 mon.a (mon.0) 4351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:23 smithi049 bash[23528]: audit 2024-09-21T00:03:22.827684+0000 mon.a (mon.0) 4352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:23 smithi049 bash[23528]: cluster 2024-09-21T00:03:22.958644+0000 mgr.a (mgr.14388) 4708 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:03:25.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:25.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:25 smithi049 bash[23528]: audit 2024-09-21T00:03:24.541422+0000 mon.a (mon.0) 4353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:25 smithi049 bash[23528]: audit 2024-09-21T00:03:24.547434+0000 mon.a (mon.0) 4354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:25 smithi049 bash[23528]: audit 2024-09-21T00:03:24.554294+0000 mon.a (mon.0) 4355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:25 smithi049 bash[23528]: cluster 2024-09-21T00:03:24.960540+0000 mgr.a (mgr.14388) 4709 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:25.841 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:25 smithi044 bash[22676]: audit 2024-09-21T00:03:24.541422+0000 mon.a (mon.0) 4353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:25 smithi044 bash[22676]: audit 2024-09-21T00:03:24.547434+0000 mon.a (mon.0) 4354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:25 smithi044 bash[22676]: audit 2024-09-21T00:03:24.554294+0000 mon.a (mon.0) 4355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:25 smithi044 bash[22676]: cluster 2024-09-21T00:03:24.960540+0000 mgr.a (mgr.14388) 4709 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:25 smithi179 bash[23186]: audit 2024-09-21T00:03:24.541422+0000 mon.a (mon.0) 4353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:25 smithi179 bash[23186]: audit 2024-09-21T00:03:24.547434+0000 mon.a (mon.0) 4354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:25 smithi179 bash[23186]: audit 2024-09-21T00:03:24.554294+0000 mon.a (mon.0) 4355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:25 smithi179 bash[23186]: cluster 2024-09-21T00:03:24.960540+0000 mgr.a (mgr.14388) 4709 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:26 smithi049 bash[23528]: audit 2024-09-21T00:03:25.413802+0000 mgr.a (mgr.14388) 4710 : audit [DBG] from='client.111576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:26 smithi044 bash[22676]: audit 2024-09-21T00:03:25.413802+0000 mgr.a (mgr.14388) 4710 : audit [DBG] from='client.111576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:26 smithi179 bash[23186]: audit 2024-09-21T00:03:25.413802+0000 mgr.a (mgr.14388) 4710 : audit [DBG] from='client.111576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:27 smithi044 bash[22676]: cluster 2024-09-21T00:03:26.961535+0000 mgr.a (mgr.14388) 4711 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:03:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:27 smithi179 bash[23186]: cluster 2024-09-21T00:03:26.961535+0000 mgr.a (mgr.14388) 4711 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:03:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:27 smithi049 bash[23528]: cluster 2024-09-21T00:03:26.961535+0000 mgr.a (mgr.14388) 4711 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:03:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:30 smithi049 bash[23528]: cluster 2024-09-21T00:03:28.962411+0000 mgr.a (mgr.14388) 4712 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:03:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:30 smithi044 bash[22676]: cluster 2024-09-21T00:03:28.962411+0000 mgr.a (mgr.14388) 4712 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:03:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:30 smithi179 bash[23186]: cluster 2024-09-21T00:03:28.962411+0000 mgr.a (mgr.14388) 4712 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:03:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:30.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:31.597 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:31.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:31.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:31.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:31.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:32 smithi049 bash[23528]: cluster 2024-09-21T00:03:30.963991+0000 mgr.a (mgr.14388) 4713 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:32 smithi049 bash[23528]: audit 2024-09-21T00:03:31.172923+0000 mgr.a (mgr.14388) 4714 : audit [DBG] from='client.111651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:32 smithi044 bash[22676]: cluster 2024-09-21T00:03:30.963991+0000 mgr.a (mgr.14388) 4713 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:32 smithi044 bash[22676]: audit 2024-09-21T00:03:31.172923+0000 mgr.a (mgr.14388) 4714 : audit [DBG] from='client.111651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:32 smithi179 bash[23186]: cluster 2024-09-21T00:03:30.963991+0000 mgr.a (mgr.14388) 4713 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:32 smithi179 bash[23186]: audit 2024-09-21T00:03:31.172923+0000 mgr.a (mgr.14388) 4714 : audit [DBG] from='client.111651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:34 smithi049 bash[23528]: cluster 2024-09-21T00:03:32.965029+0000 mgr.a (mgr.14388) 4715 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:03:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:34 smithi044 bash[22676]: cluster 2024-09-21T00:03:32.965029+0000 mgr.a (mgr.14388) 4715 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:03:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:34 smithi179 bash[23186]: cluster 2024-09-21T00:03:32.965029+0000 mgr.a (mgr.14388) 4715 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:03:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:36 smithi049 bash[23528]: cluster 2024-09-21T00:03:34.967243+0000 mgr.a (mgr.14388) 4716 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:03:36.311 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:36 smithi044 bash[22676]: cluster 2024-09-21T00:03:34.967243+0000 mgr.a (mgr.14388) 4716 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:03:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:36 smithi179 bash[23186]: cluster 2024-09-21T00:03:34.967243+0000 mgr.a (mgr.14388) 4716 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:03:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:37.402 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:38 smithi049 bash[23528]: audit 2024-09-21T00:03:36.938184+0000 mgr.a (mgr.14388) 4717 : audit [DBG] from='client.111729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:38 smithi049 bash[23528]: cluster 2024-09-21T00:03:36.968242+0000 mgr.a (mgr.14388) 4718 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:38 smithi044 bash[22676]: audit 2024-09-21T00:03:36.938184+0000 mgr.a (mgr.14388) 4717 : audit [DBG] from='client.111729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:38 smithi044 bash[22676]: cluster 2024-09-21T00:03:36.968242+0000 mgr.a (mgr.14388) 4718 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:38 smithi179 bash[23186]: audit 2024-09-21T00:03:36.938184+0000 mgr.a (mgr.14388) 4717 : audit [DBG] from='client.111729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:38 smithi179 bash[23186]: cluster 2024-09-21T00:03:36.968242+0000 mgr.a (mgr.14388) 4718 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:39.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:03:39 smithi044 bash[22930]: debug 2024-09-21T00:03:39.126+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:03:39.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:03:39 smithi044 bash[22930]: debug 2024-09-21T00:03:39.126+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:03:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:39 smithi044 bash[22676]: audit 2024-09-21T00:03:38.318391+0000 mon.a (mon.0) 4356 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:03:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:39 smithi044 bash[22676]: audit 2024-09-21T00:03:38.325829+0000 mon.a (mon.0) 4357 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:03:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:39 smithi044 bash[22676]: audit 2024-09-21T00:03:38.327818+0000 mon.a (mon.0) 4358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:03:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:39 smithi044 bash[22676]: audit 2024-09-21T00:03:38.340713+0000 mon.a (mon.0) 4359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:39 smithi044 bash[22676]: audit 2024-09-21T00:03:38.347173+0000 mon.a (mon.0) 4360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:03:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:39 smithi049 bash[23528]: audit 2024-09-21T00:03:38.318391+0000 mon.a (mon.0) 4356 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:03:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:39 smithi049 bash[23528]: audit 2024-09-21T00:03:38.325829+0000 mon.a (mon.0) 4357 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:03:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:39 smithi049 bash[23528]: audit 2024-09-21T00:03:38.327818+0000 mon.a (mon.0) 4358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:03:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:39 smithi049 bash[23528]: audit 2024-09-21T00:03:38.340713+0000 mon.a (mon.0) 4359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:39 smithi049 bash[23528]: audit 2024-09-21T00:03:38.347173+0000 mon.a (mon.0) 4360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:03:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:39 smithi179 bash[23186]: audit 2024-09-21T00:03:38.318391+0000 mon.a (mon.0) 4356 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:03:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:39 smithi179 bash[23186]: audit 2024-09-21T00:03:38.325829+0000 mon.a (mon.0) 4357 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:03:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:39 smithi179 bash[23186]: audit 2024-09-21T00:03:38.327818+0000 mon.a (mon.0) 4358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:03:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:39 smithi179 bash[23186]: audit 2024-09-21T00:03:38.340713+0000 mon.a (mon.0) 4359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:39 smithi179 bash[23186]: audit 2024-09-21T00:03:38.347173+0000 mon.a (mon.0) 4360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:03:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:40 smithi049 bash[23528]: audit 2024-09-21T00:03:38.349911+0000 mgr.a (mgr.14388) 4719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:03:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:40 smithi049 bash[23528]: cluster 2024-09-21T00:03:38.968796+0000 mgr.a (mgr.14388) 4720 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:40 smithi049 bash[23528]: audit 2024-09-21T00:03:39.130553+0000 mgr.a (mgr.14388) 4721 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:03:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:40 smithi049 bash[23528]: cephadm 2024-09-21T00:03:39.131667+0000 mgr.a (mgr.14388) 4722 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:03:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:40 smithi044 bash[22676]: audit 2024-09-21T00:03:38.349911+0000 mgr.a (mgr.14388) 4719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:03:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:40 smithi044 bash[22676]: cluster 2024-09-21T00:03:38.968796+0000 mgr.a (mgr.14388) 4720 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:40 smithi044 bash[22676]: audit 2024-09-21T00:03:39.130553+0000 mgr.a (mgr.14388) 4721 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:03:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:40 smithi044 bash[22676]: cephadm 2024-09-21T00:03:39.131667+0000 mgr.a (mgr.14388) 4722 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:03:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:40 smithi179 bash[23186]: audit 2024-09-21T00:03:38.349911+0000 mgr.a (mgr.14388) 4719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:03:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:40 smithi179 bash[23186]: cluster 2024-09-21T00:03:38.968796+0000 mgr.a (mgr.14388) 4720 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:40 smithi179 bash[23186]: audit 2024-09-21T00:03:39.130553+0000 mgr.a (mgr.14388) 4721 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:03:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:40 smithi179 bash[23186]: cephadm 2024-09-21T00:03:39.131667+0000 mgr.a (mgr.14388) 4722 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:03:41.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:41 smithi179 bash[23186]: audit 2024-09-21T00:03:40.420173+0000 mon.a (mon.0) 4361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:41 smithi179 bash[23186]: audit 2024-09-21T00:03:40.429657+0000 mon.a (mon.0) 4362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:41 smithi179 bash[23186]: audit 2024-09-21T00:03:40.441128+0000 mon.a (mon.0) 4363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:41 smithi179 bash[23186]: cluster 2024-09-21T00:03:40.971178+0000 mgr.a (mgr.14388) 4723 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:41 smithi044 bash[22676]: audit 2024-09-21T00:03:40.420173+0000 mon.a (mon.0) 4361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:41 smithi044 bash[22676]: audit 2024-09-21T00:03:40.429657+0000 mon.a (mon.0) 4362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:41 smithi044 bash[22676]: audit 2024-09-21T00:03:40.441128+0000 mon.a (mon.0) 4363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:41 smithi044 bash[22676]: cluster 2024-09-21T00:03:40.971178+0000 mgr.a (mgr.14388) 4723 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:41 smithi049 bash[23528]: audit 2024-09-21T00:03:40.420173+0000 mon.a (mon.0) 4361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:41 smithi049 bash[23528]: audit 2024-09-21T00:03:40.429657+0000 mon.a (mon.0) 4362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:41 smithi049 bash[23528]: audit 2024-09-21T00:03:40.441128+0000 mon.a (mon.0) 4363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:41 smithi049 bash[23528]: cluster 2024-09-21T00:03:40.971178+0000 mgr.a (mgr.14388) 4723 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:42.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:42.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:42.405 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:43.185 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:43.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:43.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:43.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:43.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:43 smithi179 bash[23186]: audit 2024-09-21T00:03:42.741874+0000 mgr.a (mgr.14388) 4724 : audit [DBG] from='client.111912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:43 smithi179 bash[23186]: cluster 2024-09-21T00:03:42.977543+0000 mgr.a (mgr.14388) 4725 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:43 smithi179 bash[23186]: audit 2024-09-21T00:03:42.998537+0000 mon.a (mon.0) 4364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:43 smithi179 bash[23186]: audit 2024-09-21T00:03:43.003813+0000 mon.a (mon.0) 4365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:43 smithi179 bash[23186]: audit 2024-09-21T00:03:43.009877+0000 mon.a (mon.0) 4366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:44 smithi049 bash[23528]: audit 2024-09-21T00:03:42.741874+0000 mgr.a (mgr.14388) 4724 : audit [DBG] from='client.111912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:44 smithi049 bash[23528]: cluster 2024-09-21T00:03:42.977543+0000 mgr.a (mgr.14388) 4725 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:44 smithi049 bash[23528]: audit 2024-09-21T00:03:42.998537+0000 mon.a (mon.0) 4364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:44 smithi049 bash[23528]: audit 2024-09-21T00:03:43.003813+0000 mon.a (mon.0) 4365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:44 smithi049 bash[23528]: audit 2024-09-21T00:03:43.009877+0000 mon.a (mon.0) 4366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:43 smithi044 bash[22676]: audit 2024-09-21T00:03:42.741874+0000 mgr.a (mgr.14388) 4724 : audit [DBG] from='client.111912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:43 smithi044 bash[22676]: cluster 2024-09-21T00:03:42.977543+0000 mgr.a (mgr.14388) 4725 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:43 smithi044 bash[22676]: audit 2024-09-21T00:03:42.998537+0000 mon.a (mon.0) 4364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:43 smithi044 bash[22676]: audit 2024-09-21T00:03:43.003813+0000 mon.a (mon.0) 4365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:43 smithi044 bash[22676]: audit 2024-09-21T00:03:43.009877+0000 mon.a (mon.0) 4366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:45 smithi049 bash[23528]: audit 2024-09-21T00:03:44.761090+0000 mon.a (mon.0) 4367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:45 smithi049 bash[23528]: audit 2024-09-21T00:03:44.771120+0000 mon.a (mon.0) 4368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:45 smithi049 bash[23528]: audit 2024-09-21T00:03:44.783125+0000 mon.a (mon.0) 4369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:45 smithi049 bash[23528]: cluster 2024-09-21T00:03:44.979779+0000 mgr.a (mgr.14388) 4726 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:45 smithi044 bash[22676]: audit 2024-09-21T00:03:44.761090+0000 mon.a (mon.0) 4367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:45 smithi044 bash[22676]: audit 2024-09-21T00:03:44.771120+0000 mon.a (mon.0) 4368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:45 smithi044 bash[22676]: audit 2024-09-21T00:03:44.783125+0000 mon.a (mon.0) 4369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:45 smithi044 bash[22676]: cluster 2024-09-21T00:03:44.979779+0000 mgr.a (mgr.14388) 4726 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:45 smithi179 bash[23186]: audit 2024-09-21T00:03:44.761090+0000 mon.a (mon.0) 4367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:45 smithi179 bash[23186]: audit 2024-09-21T00:03:44.771120+0000 mon.a (mon.0) 4368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:45 smithi179 bash[23186]: audit 2024-09-21T00:03:44.783125+0000 mon.a (mon.0) 4369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:03:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:45 smithi179 bash[23186]: cluster 2024-09-21T00:03:44.979779+0000 mgr.a (mgr.14388) 4726 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:48.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:48.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:48.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:48 smithi049 bash[23528]: cluster 2024-09-21T00:03:46.980564+0000 mgr.a (mgr.14388) 4727 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:48 smithi044 bash[22676]: cluster 2024-09-21T00:03:46.980564+0000 mgr.a (mgr.14388) 4727 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:48 smithi179 bash[23186]: cluster 2024-09-21T00:03:46.980564+0000 mgr.a (mgr.14388) 4727 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:48.958 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:48.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:48.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:48.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:48.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:50 smithi049 bash[23528]: audit 2024-09-21T00:03:48.521758+0000 mgr.a (mgr.14388) 4728 : audit [DBG] from='client.111987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:50 smithi049 bash[23528]: cluster 2024-09-21T00:03:48.981116+0000 mgr.a (mgr.14388) 4729 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:50 smithi044 bash[22676]: audit 2024-09-21T00:03:48.521758+0000 mgr.a (mgr.14388) 4728 : audit [DBG] from='client.111987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:50 smithi044 bash[22676]: cluster 2024-09-21T00:03:48.981116+0000 mgr.a (mgr.14388) 4729 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:50 smithi179 bash[23186]: audit 2024-09-21T00:03:48.521758+0000 mgr.a (mgr.14388) 4728 : audit [DBG] from='client.111987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:50 smithi179 bash[23186]: cluster 2024-09-21T00:03:48.981116+0000 mgr.a (mgr.14388) 4729 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:52 smithi049 bash[23528]: cluster 2024-09-21T00:03:50.983339+0000 mgr.a (mgr.14388) 4730 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:52 smithi044 bash[22676]: cluster 2024-09-21T00:03:50.983339+0000 mgr.a (mgr.14388) 4730 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:52 smithi179 bash[23186]: cluster 2024-09-21T00:03:50.983339+0000 mgr.a (mgr.14388) 4730 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:03:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:53.960 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:53.961 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:03:54.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:54 smithi049 bash[23528]: cluster 2024-09-21T00:03:52.984139+0000 mgr.a (mgr.14388) 4731 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:54 smithi044 bash[22676]: cluster 2024-09-21T00:03:52.984139+0000 mgr.a (mgr.14388) 4731 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:54 smithi179 bash[23186]: cluster 2024-09-21T00:03:52.984139+0000 mgr.a (mgr.14388) 4731 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:54.712 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:03:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:03:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:03:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:03:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:03:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:55 smithi044 bash[22676]: audit 2024-09-21T00:03:54.290290+0000 mgr.a (mgr.14388) 4732 : audit [DBG] from='client.112065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:55 smithi179 bash[23186]: audit 2024-09-21T00:03:54.290290+0000 mgr.a (mgr.14388) 4732 : audit [DBG] from='client.112065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:55 smithi049 bash[23528]: audit 2024-09-21T00:03:54.290290+0000 mgr.a (mgr.14388) 4732 : audit [DBG] from='client.112065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:03:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:56 smithi044 bash[22676]: cluster 2024-09-21T00:03:54.986492+0000 mgr.a (mgr.14388) 4733 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:56 smithi179 bash[23186]: cluster 2024-09-21T00:03:54.986492+0000 mgr.a (mgr.14388) 4733 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:56 smithi049 bash[23528]: cluster 2024-09-21T00:03:54.986492+0000 mgr.a (mgr.14388) 4733 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:03:58.451 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:03:58 smithi044 bash[22676]: cluster 2024-09-21T00:03:56.987294+0000 mgr.a (mgr.14388) 4734 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:03:58 smithi179 bash[23186]: cluster 2024-09-21T00:03:56.987294+0000 mgr.a (mgr.14388) 4734 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:03:58 smithi049 bash[23528]: cluster 2024-09-21T00:03:56.987294+0000 mgr.a (mgr.14388) 4734 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:03:59.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:03:59.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:03:59.715 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:00 smithi044 bash[22676]: cluster 2024-09-21T00:03:58.988087+0000 mgr.a (mgr.14388) 4735 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:00 smithi049 bash[23528]: cluster 2024-09-21T00:03:58.988087+0000 mgr.a (mgr.14388) 4735 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:00.489 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:00.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:00.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:00.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:00.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:00 smithi179 bash[23186]: cluster 2024-09-21T00:03:58.988087+0000 mgr.a (mgr.14388) 4735 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:01 smithi179 bash[23186]: audit 2024-09-21T00:04:00.057377+0000 mgr.a (mgr.14388) 4736 : audit [DBG] from='client.112143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:01 smithi179 bash[23186]: audit 2024-09-21T00:04:00.608391+0000 mon.a (mon.0) 4370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:01 smithi179 bash[23186]: audit 2024-09-21T00:04:00.613127+0000 mon.a (mon.0) 4371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:01 smithi179 bash[23186]: audit 2024-09-21T00:04:00.618424+0000 mon.a (mon.0) 4372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.277 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:01 smithi049 bash[23528]: audit 2024-09-21T00:04:00.057377+0000 mgr.a (mgr.14388) 4736 : audit [DBG] from='client.112143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:01.278 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:01 smithi049 bash[23528]: audit 2024-09-21T00:04:00.608391+0000 mon.a (mon.0) 4370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.278 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:01 smithi049 bash[23528]: audit 2024-09-21T00:04:00.613127+0000 mon.a (mon.0) 4371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.278 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:01 smithi049 bash[23528]: audit 2024-09-21T00:04:00.618424+0000 mon.a (mon.0) 4372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:01 smithi044 bash[22676]: audit 2024-09-21T00:04:00.057377+0000 mgr.a (mgr.14388) 4736 : audit [DBG] from='client.112143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:01 smithi044 bash[22676]: audit 2024-09-21T00:04:00.608391+0000 mon.a (mon.0) 4370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:01 smithi044 bash[22676]: audit 2024-09-21T00:04:00.613127+0000 mon.a (mon.0) 4371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:01 smithi044 bash[22676]: audit 2024-09-21T00:04:00.618424+0000 mon.a (mon.0) 4372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:02.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:02 smithi179 bash[23186]: cluster 2024-09-21T00:04:00.990948+0000 mgr.a (mgr.14388) 4737 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:02 smithi049 bash[23528]: cluster 2024-09-21T00:04:00.990948+0000 mgr.a (mgr.14388) 4737 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:02 smithi044 bash[22676]: cluster 2024-09-21T00:04:00.990948+0000 mgr.a (mgr.14388) 4737 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:04 smithi044 bash[22676]: cluster 2024-09-21T00:04:02.991775+0000 mgr.a (mgr.14388) 4738 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:04:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:04 smithi044 bash[22676]: audit 2024-09-21T00:04:03.223305+0000 mon.a (mon.0) 4373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:04 smithi044 bash[22676]: audit 2024-09-21T00:04:03.231760+0000 mon.a (mon.0) 4374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:04 smithi044 bash[22676]: audit 2024-09-21T00:04:03.241682+0000 mon.a (mon.0) 4375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:04 smithi179 bash[23186]: cluster 2024-09-21T00:04:02.991775+0000 mgr.a (mgr.14388) 4738 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:04:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:04 smithi179 bash[23186]: audit 2024-09-21T00:04:03.223305+0000 mon.a (mon.0) 4373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:04 smithi179 bash[23186]: audit 2024-09-21T00:04:03.231760+0000 mon.a (mon.0) 4374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:04 smithi179 bash[23186]: audit 2024-09-21T00:04:03.241682+0000 mon.a (mon.0) 4375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:04 smithi049 bash[23528]: cluster 2024-09-21T00:04:02.991775+0000 mgr.a (mgr.14388) 4738 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:04:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:04 smithi049 bash[23528]: audit 2024-09-21T00:04:03.223305+0000 mon.a (mon.0) 4373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:04 smithi049 bash[23528]: audit 2024-09-21T00:04:03.231760+0000 mon.a (mon.0) 4374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:04 smithi049 bash[23528]: audit 2024-09-21T00:04:03.241682+0000 mon.a (mon.0) 4375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:05.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:05.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:06 smithi179 bash[23186]: cluster 2024-09-21T00:04:04.993867+0000 mgr.a (mgr.14388) 4739 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:06 smithi179 bash[23186]: audit 2024-09-21T00:04:05.003173+0000 mon.a (mon.0) 4376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:06 smithi179 bash[23186]: audit 2024-09-21T00:04:05.012836+0000 mon.a (mon.0) 4377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:06 smithi179 bash[23186]: audit 2024-09-21T00:04:05.024233+0000 mon.a (mon.0) 4378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.288 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:06.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:06.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:06 smithi049 bash[23528]: cluster 2024-09-21T00:04:04.993867+0000 mgr.a (mgr.14388) 4739 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:06 smithi049 bash[23528]: audit 2024-09-21T00:04:05.003173+0000 mon.a (mon.0) 4376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:06 smithi049 bash[23528]: audit 2024-09-21T00:04:05.012836+0000 mon.a (mon.0) 4377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:06 smithi049 bash[23528]: audit 2024-09-21T00:04:05.024233+0000 mon.a (mon.0) 4378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:06 smithi044 bash[22676]: cluster 2024-09-21T00:04:04.993867+0000 mgr.a (mgr.14388) 4739 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:06 smithi044 bash[22676]: audit 2024-09-21T00:04:05.003173+0000 mon.a (mon.0) 4376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:06 smithi044 bash[22676]: audit 2024-09-21T00:04:05.012836+0000 mon.a (mon.0) 4377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:06 smithi044 bash[22676]: audit 2024-09-21T00:04:05.024233+0000 mon.a (mon.0) 4378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:07 smithi049 bash[23528]: audit 2024-09-21T00:04:05.828471+0000 mgr.a (mgr.14388) 4740 : audit [DBG] from='client.112221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:07 smithi044 bash[22676]: audit 2024-09-21T00:04:05.828471+0000 mgr.a (mgr.14388) 4740 : audit [DBG] from='client.112221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:07 smithi179 bash[23186]: audit 2024-09-21T00:04:05.828471+0000 mgr.a (mgr.14388) 4740 : audit [DBG] from='client.112221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:08 smithi049 bash[23528]: cluster 2024-09-21T00:04:06.994890+0000 mgr.a (mgr.14388) 4741 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:04:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:08 smithi044 bash[22676]: cluster 2024-09-21T00:04:06.994890+0000 mgr.a (mgr.14388) 4741 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:04:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:08 smithi179 bash[23186]: cluster 2024-09-21T00:04:06.994890+0000 mgr.a (mgr.14388) 4741 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:04:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:10 smithi049 bash[23528]: cluster 2024-09-21T00:04:08.995628+0000 mgr.a (mgr.14388) 4742 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:10 smithi044 bash[22676]: cluster 2024-09-21T00:04:08.995628+0000 mgr.a (mgr.14388) 4742 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:10 smithi179 bash[23186]: cluster 2024-09-21T00:04:08.995628+0000 mgr.a (mgr.14388) 4742 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:12.048 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:12.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:12 smithi049 bash[23528]: cluster 2024-09-21T00:04:10.997877+0000 mgr.a (mgr.14388) 4743 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:12 smithi044 bash[22676]: cluster 2024-09-21T00:04:10.997877+0000 mgr.a (mgr.14388) 4743 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:12 smithi179 bash[23186]: cluster 2024-09-21T00:04:10.997877+0000 mgr.a (mgr.14388) 4743 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:13 smithi049 bash[23528]: audit 2024-09-21T00:04:11.620601+0000 mgr.a (mgr.14388) 4744 : audit [DBG] from='client.112296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:13 smithi044 bash[22676]: audit 2024-09-21T00:04:11.620601+0000 mgr.a (mgr.14388) 4744 : audit [DBG] from='client.112296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:13 smithi179 bash[23186]: audit 2024-09-21T00:04:11.620601+0000 mgr.a (mgr.14388) 4744 : audit [DBG] from='client.112296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:14 smithi049 bash[23528]: cluster 2024-09-21T00:04:12.998835+0000 mgr.a (mgr.14388) 4745 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:14 smithi044 bash[22676]: cluster 2024-09-21T00:04:12.998835+0000 mgr.a (mgr.14388) 4745 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:14 smithi179 bash[23186]: cluster 2024-09-21T00:04:12.998835+0000 mgr.a (mgr.14388) 4745 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:16 smithi049 bash[23528]: cluster 2024-09-21T00:04:15.001010+0000 mgr.a (mgr.14388) 4746 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:16 smithi044 bash[22676]: cluster 2024-09-21T00:04:15.001010+0000 mgr.a (mgr.14388) 4746 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:16 smithi179 bash[23186]: cluster 2024-09-21T00:04:15.001010+0000 mgr.a (mgr.14388) 4746 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:17.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:17.056 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:17.056 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:17.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:18 smithi049 bash[23528]: cluster 2024-09-21T00:04:17.001823+0000 mgr.a (mgr.14388) 4747 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:18.325 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:18 smithi044 bash[22676]: cluster 2024-09-21T00:04:17.001823+0000 mgr.a (mgr.14388) 4747 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:18 smithi179 bash[23186]: cluster 2024-09-21T00:04:17.001823+0000 mgr.a (mgr.14388) 4747 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:19 smithi049 bash[23528]: audit 2024-09-21T00:04:17.374484+0000 mgr.a (mgr.14388) 4748 : audit [DBG] from='client.112371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:19 smithi044 bash[22676]: audit 2024-09-21T00:04:17.374484+0000 mgr.a (mgr.14388) 4748 : audit [DBG] from='client.112371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:19 smithi179 bash[23186]: audit 2024-09-21T00:04:17.374484+0000 mgr.a (mgr.14388) 4748 : audit [DBG] from='client.112371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:20 smithi044 bash[22676]: cluster 2024-09-21T00:04:19.002423+0000 mgr.a (mgr.14388) 4749 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:20 smithi179 bash[23186]: cluster 2024-09-21T00:04:19.002423+0000 mgr.a (mgr.14388) 4749 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:20 smithi049 bash[23528]: cluster 2024-09-21T00:04:19.002423+0000 mgr.a (mgr.14388) 4749 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:22.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:21 smithi179 bash[23186]: audit 2024-09-21T00:04:20.766599+0000 mon.a (mon.0) 4379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:21 smithi179 bash[23186]: audit 2024-09-21T00:04:20.771510+0000 mon.a (mon.0) 4380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:21 smithi179 bash[23186]: audit 2024-09-21T00:04:20.779918+0000 mon.a (mon.0) 4381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:21 smithi179 bash[23186]: cluster 2024-09-21T00:04:21.004642+0000 mgr.a (mgr.14388) 4750 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:21 smithi049 bash[23528]: audit 2024-09-21T00:04:20.766599+0000 mon.a (mon.0) 4379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:21 smithi049 bash[23528]: audit 2024-09-21T00:04:20.771510+0000 mon.a (mon.0) 4380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:21 smithi049 bash[23528]: audit 2024-09-21T00:04:20.779918+0000 mon.a (mon.0) 4381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:21 smithi049 bash[23528]: cluster 2024-09-21T00:04:21.004642+0000 mgr.a (mgr.14388) 4750 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:21 smithi044 bash[22676]: audit 2024-09-21T00:04:20.766599+0000 mon.a (mon.0) 4379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:21 smithi044 bash[22676]: audit 2024-09-21T00:04:20.771510+0000 mon.a (mon.0) 4380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:21 smithi044 bash[22676]: audit 2024-09-21T00:04:20.779918+0000 mon.a (mon.0) 4381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:21 smithi044 bash[22676]: cluster 2024-09-21T00:04:21.004642+0000 mgr.a (mgr.14388) 4750 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:22.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:22.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:22.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:23.585 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:23.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:23.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:23.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:23.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:24.422 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:24 smithi179 bash[23186]: cluster 2024-09-21T00:04:23.005422+0000 mgr.a (mgr.14388) 4751 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:24.422 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:24 smithi179 bash[23186]: audit 2024-09-21T00:04:23.132733+0000 mgr.a (mgr.14388) 4752 : audit [DBG] from='client.112446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:24.422 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:24 smithi179 bash[23186]: audit 2024-09-21T00:04:23.427270+0000 mon.a (mon.0) 4382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.422 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:24 smithi179 bash[23186]: audit 2024-09-21T00:04:23.433918+0000 mon.a (mon.0) 4383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.422 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:24 smithi179 bash[23186]: audit 2024-09-21T00:04:23.441287+0000 mon.a (mon.0) 4384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:24 smithi044 bash[22676]: cluster 2024-09-21T00:04:23.005422+0000 mgr.a (mgr.14388) 4751 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:24 smithi044 bash[22676]: audit 2024-09-21T00:04:23.132733+0000 mgr.a (mgr.14388) 4752 : audit [DBG] from='client.112446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:24 smithi044 bash[22676]: audit 2024-09-21T00:04:23.427270+0000 mon.a (mon.0) 4382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:24 smithi044 bash[22676]: audit 2024-09-21T00:04:23.433918+0000 mon.a (mon.0) 4383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:24 smithi044 bash[22676]: audit 2024-09-21T00:04:23.441287+0000 mon.a (mon.0) 4384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:24 smithi049 bash[23528]: cluster 2024-09-21T00:04:23.005422+0000 mgr.a (mgr.14388) 4751 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:24 smithi049 bash[23528]: audit 2024-09-21T00:04:23.132733+0000 mgr.a (mgr.14388) 4752 : audit [DBG] from='client.112446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:24 smithi049 bash[23528]: audit 2024-09-21T00:04:23.427270+0000 mon.a (mon.0) 4382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:24 smithi049 bash[23528]: audit 2024-09-21T00:04:23.433918+0000 mon.a (mon.0) 4383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:24 smithi049 bash[23528]: audit 2024-09-21T00:04:23.441287+0000 mon.a (mon.0) 4384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:26 smithi179 bash[23186]: cluster 2024-09-21T00:04:25.007762+0000 mgr.a (mgr.14388) 4753 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:26 smithi179 bash[23186]: audit 2024-09-21T00:04:25.249684+0000 mon.a (mon.0) 4385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:26 smithi179 bash[23186]: audit 2024-09-21T00:04:25.259296+0000 mon.a (mon.0) 4386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:26 smithi179 bash[23186]: audit 2024-09-21T00:04:25.270880+0000 mon.a (mon.0) 4387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:26 smithi049 bash[23528]: cluster 2024-09-21T00:04:25.007762+0000 mgr.a (mgr.14388) 4753 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:26 smithi049 bash[23528]: audit 2024-09-21T00:04:25.249684+0000 mon.a (mon.0) 4385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:26 smithi049 bash[23528]: audit 2024-09-21T00:04:25.259296+0000 mon.a (mon.0) 4386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:26 smithi049 bash[23528]: audit 2024-09-21T00:04:25.270880+0000 mon.a (mon.0) 4387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:26 smithi044 bash[22676]: cluster 2024-09-21T00:04:25.007762+0000 mgr.a (mgr.14388) 4753 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:26 smithi044 bash[22676]: audit 2024-09-21T00:04:25.249684+0000 mon.a (mon.0) 4385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:26 smithi044 bash[22676]: audit 2024-09-21T00:04:25.259296+0000 mon.a (mon.0) 4386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:26 smithi044 bash[22676]: audit 2024-09-21T00:04:25.270880+0000 mon.a (mon.0) 4387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:27 smithi044 bash[22676]: cluster 2024-09-21T00:04:27.008593+0000 mgr.a (mgr.14388) 4754 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:27 smithi179 bash[23186]: cluster 2024-09-21T00:04:27.008593+0000 mgr.a (mgr.14388) 4754 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:27 smithi049 bash[23528]: cluster 2024-09-21T00:04:27.008593+0000 mgr.a (mgr.14388) 4754 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:28.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:28.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:28.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:29.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:29.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:29.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:29.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:29.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:30 smithi044 bash[22676]: audit 2024-09-21T00:04:28.922267+0000 mgr.a (mgr.14388) 4755 : audit [DBG] from='client.112524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:30 smithi044 bash[22676]: cluster 2024-09-21T00:04:29.009133+0000 mgr.a (mgr.14388) 4756 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:30 smithi179 bash[23186]: audit 2024-09-21T00:04:28.922267+0000 mgr.a (mgr.14388) 4755 : audit [DBG] from='client.112524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:30 smithi179 bash[23186]: cluster 2024-09-21T00:04:29.009133+0000 mgr.a (mgr.14388) 4756 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:30 smithi049 bash[23528]: audit 2024-09-21T00:04:28.922267+0000 mgr.a (mgr.14388) 4755 : audit [DBG] from='client.112524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:30 smithi049 bash[23528]: cluster 2024-09-21T00:04:29.009133+0000 mgr.a (mgr.14388) 4756 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:32 smithi044 bash[22676]: cluster 2024-09-21T00:04:31.011173+0000 mgr.a (mgr.14388) 4757 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:32 smithi179 bash[23186]: cluster 2024-09-21T00:04:31.011173+0000 mgr.a (mgr.14388) 4757 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:32 smithi049 bash[23528]: cluster 2024-09-21T00:04:31.011173+0000 mgr.a (mgr.14388) 4757 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:04:34.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:34.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:34.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:34 smithi044 bash[22676]: cluster 2024-09-21T00:04:33.011972+0000 mgr.a (mgr.14388) 4758 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:34 smithi179 bash[23186]: cluster 2024-09-21T00:04:33.011972+0000 mgr.a (mgr.14388) 4758 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:34 smithi049 bash[23528]: cluster 2024-09-21T00:04:33.011972+0000 mgr.a (mgr.14388) 4758 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:35.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:35.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:35.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:35.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:35.136 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:36 smithi044 bash[22676]: audit 2024-09-21T00:04:34.710622+0000 mgr.a (mgr.14388) 4759 : audit [DBG] from='client.112596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:36 smithi044 bash[22676]: cluster 2024-09-21T00:04:35.013378+0000 mgr.a (mgr.14388) 4760 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:36 smithi179 bash[23186]: audit 2024-09-21T00:04:34.710622+0000 mgr.a (mgr.14388) 4759 : audit [DBG] from='client.112596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:36 smithi179 bash[23186]: cluster 2024-09-21T00:04:35.013378+0000 mgr.a (mgr.14388) 4760 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:36 smithi049 bash[23528]: audit 2024-09-21T00:04:34.710622+0000 mgr.a (mgr.14388) 4759 : audit [DBG] from='client.112596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:36 smithi049 bash[23528]: cluster 2024-09-21T00:04:35.013378+0000 mgr.a (mgr.14388) 4760 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:38.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:38 smithi044 bash[22676]: cluster 2024-09-21T00:04:37.014239+0000 mgr.a (mgr.14388) 4761 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:38 smithi179 bash[23186]: cluster 2024-09-21T00:04:37.014239+0000 mgr.a (mgr.14388) 4761 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:38 smithi049 bash[23528]: cluster 2024-09-21T00:04:37.014239+0000 mgr.a (mgr.14388) 4761 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:40.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:40.137 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:40.137 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:04:39 smithi044 bash[22930]: debug 2024-09-21T00:04:39.985+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:04:39 smithi044 bash[22930]: debug 2024-09-21T00:04:39.985+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:40 smithi044 bash[22676]: cluster 2024-09-21T00:04:39.014923+0000 mgr.a (mgr.14388) 4762 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:40 smithi044 bash[22676]: audit 2024-09-21T00:04:39.183810+0000 mon.a (mon.0) 4388 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:40 smithi044 bash[22676]: audit 2024-09-21T00:04:39.191590+0000 mon.a (mon.0) 4389 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:40 smithi044 bash[22676]: audit 2024-09-21T00:04:39.193566+0000 mon.a (mon.0) 4390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:40 smithi044 bash[22676]: audit 2024-09-21T00:04:39.205427+0000 mon.a (mon.0) 4391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:40 smithi044 bash[22676]: audit 2024-09-21T00:04:39.211922+0000 mon.a (mon.0) 4392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:04:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:40 smithi044 bash[22676]: audit 2024-09-21T00:04:39.214466+0000 mgr.a (mgr.14388) 4763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:04:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:40 smithi179 bash[23186]: cluster 2024-09-21T00:04:39.014923+0000 mgr.a (mgr.14388) 4762 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:40 smithi179 bash[23186]: audit 2024-09-21T00:04:39.183810+0000 mon.a (mon.0) 4388 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:04:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:40 smithi179 bash[23186]: audit 2024-09-21T00:04:39.191590+0000 mon.a (mon.0) 4389 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:04:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:40 smithi179 bash[23186]: audit 2024-09-21T00:04:39.193566+0000 mon.a (mon.0) 4390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:04:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:40 smithi179 bash[23186]: audit 2024-09-21T00:04:39.205427+0000 mon.a (mon.0) 4391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:40 smithi179 bash[23186]: audit 2024-09-21T00:04:39.211922+0000 mon.a (mon.0) 4392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:04:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:40 smithi179 bash[23186]: audit 2024-09-21T00:04:39.214466+0000 mgr.a (mgr.14388) 4763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:04:40.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:40 smithi049 bash[23528]: cluster 2024-09-21T00:04:39.014923+0000 mgr.a (mgr.14388) 4762 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:04:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:40 smithi049 bash[23528]: audit 2024-09-21T00:04:39.183810+0000 mon.a (mon.0) 4388 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:04:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:40 smithi049 bash[23528]: audit 2024-09-21T00:04:39.191590+0000 mon.a (mon.0) 4389 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:04:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:40 smithi049 bash[23528]: audit 2024-09-21T00:04:39.193566+0000 mon.a (mon.0) 4390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:04:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:40 smithi049 bash[23528]: audit 2024-09-21T00:04:39.205427+0000 mon.a (mon.0) 4391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:40 smithi049 bash[23528]: audit 2024-09-21T00:04:39.211922+0000 mon.a (mon.0) 4392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:04:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:40 smithi049 bash[23528]: audit 2024-09-21T00:04:39.214466+0000 mgr.a (mgr.14388) 4763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:04:40.860 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:41.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:41 smithi049 bash[23528]: audit 2024-09-21T00:04:39.989584+0000 mgr.a (mgr.14388) 4764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:04:41.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:41 smithi049 bash[23528]: cephadm 2024-09-21T00:04:39.990825+0000 mgr.a (mgr.14388) 4765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:04:41.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:41 smithi049 bash[23528]: audit 2024-09-21T00:04:40.990252+0000 mon.a (mon.0) 4393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:41 smithi049 bash[23528]: audit 2024-09-21T00:04:40.998364+0000 mon.a (mon.0) 4394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:41 smithi049 bash[23528]: audit 2024-09-21T00:04:41.008192+0000 mon.a (mon.0) 4395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:41 smithi044 bash[22676]: audit 2024-09-21T00:04:39.989584+0000 mgr.a (mgr.14388) 4764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:04:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:41 smithi044 bash[22676]: cephadm 2024-09-21T00:04:39.990825+0000 mgr.a (mgr.14388) 4765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:04:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:41 smithi044 bash[22676]: audit 2024-09-21T00:04:40.990252+0000 mon.a (mon.0) 4393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:41 smithi044 bash[22676]: audit 2024-09-21T00:04:40.998364+0000 mon.a (mon.0) 4394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:41 smithi044 bash[22676]: audit 2024-09-21T00:04:41.008192+0000 mon.a (mon.0) 4395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:41 smithi179 bash[23186]: audit 2024-09-21T00:04:39.989584+0000 mgr.a (mgr.14388) 4764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:04:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:41 smithi179 bash[23186]: cephadm 2024-09-21T00:04:39.990825+0000 mgr.a (mgr.14388) 4765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:04:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:41 smithi179 bash[23186]: audit 2024-09-21T00:04:40.990252+0000 mon.a (mon.0) 4393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:41 smithi179 bash[23186]: audit 2024-09-21T00:04:40.998364+0000 mon.a (mon.0) 4394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:41 smithi179 bash[23186]: audit 2024-09-21T00:04:41.008192+0000 mon.a (mon.0) 4395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:42.351 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:42 smithi179 bash[23186]: audit 2024-09-21T00:04:40.454249+0000 mgr.a (mgr.14388) 4766 : audit [DBG] from='client.112782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:42.352 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:42 smithi179 bash[23186]: cluster 2024-09-21T00:04:41.017745+0000 mgr.a (mgr.14388) 4767 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T00:04:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:42 smithi044 bash[22676]: audit 2024-09-21T00:04:40.454249+0000 mgr.a (mgr.14388) 4766 : audit [DBG] from='client.112782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:42 smithi044 bash[22676]: cluster 2024-09-21T00:04:41.017745+0000 mgr.a (mgr.14388) 4767 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T00:04:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:42 smithi049 bash[23528]: audit 2024-09-21T00:04:40.454249+0000 mgr.a (mgr.14388) 4766 : audit [DBG] from='client.112782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:42 smithi049 bash[23528]: cluster 2024-09-21T00:04:41.017745+0000 mgr.a (mgr.14388) 4767 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T00:04:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:44 smithi044 bash[22676]: cluster 2024-09-21T00:04:43.018562+0000 mgr.a (mgr.14388) 4768 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:04:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:44 smithi044 bash[22676]: audit 2024-09-21T00:04:43.649467+0000 mon.a (mon.0) 4396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:44 smithi044 bash[22676]: audit 2024-09-21T00:04:43.657914+0000 mon.a (mon.0) 4397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:44 smithi044 bash[22676]: audit 2024-09-21T00:04:43.668063+0000 mon.a (mon.0) 4398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:44 smithi179 bash[23186]: cluster 2024-09-21T00:04:43.018562+0000 mgr.a (mgr.14388) 4768 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:04:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:44 smithi179 bash[23186]: audit 2024-09-21T00:04:43.649467+0000 mon.a (mon.0) 4396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:44 smithi179 bash[23186]: audit 2024-09-21T00:04:43.657914+0000 mon.a (mon.0) 4397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:44 smithi179 bash[23186]: audit 2024-09-21T00:04:43.668063+0000 mon.a (mon.0) 4398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:44 smithi049 bash[23528]: cluster 2024-09-21T00:04:43.018562+0000 mgr.a (mgr.14388) 4768 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:04:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:44 smithi049 bash[23528]: audit 2024-09-21T00:04:43.649467+0000 mon.a (mon.0) 4396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:44 smithi049 bash[23528]: audit 2024-09-21T00:04:43.657914+0000 mon.a (mon.0) 4397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:44 smithi049 bash[23528]: audit 2024-09-21T00:04:43.668063+0000 mon.a (mon.0) 4398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:45.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:45.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:46 smithi044 bash[22676]: cluster 2024-09-21T00:04:45.020471+0000 mgr.a (mgr.14388) 4769 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:46 smithi044 bash[22676]: audit 2024-09-21T00:04:45.483638+0000 mon.a (mon.0) 4399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:46 smithi044 bash[22676]: audit 2024-09-21T00:04:45.492012+0000 mon.a (mon.0) 4400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:46 smithi044 bash[22676]: audit 2024-09-21T00:04:45.502251+0000 mon.a (mon.0) 4401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:46 smithi179 bash[23186]: cluster 2024-09-21T00:04:45.020471+0000 mgr.a (mgr.14388) 4769 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:46 smithi179 bash[23186]: audit 2024-09-21T00:04:45.483638+0000 mon.a (mon.0) 4399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:46 smithi179 bash[23186]: audit 2024-09-21T00:04:45.492012+0000 mon.a (mon.0) 4400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:46 smithi179 bash[23186]: audit 2024-09-21T00:04:45.502251+0000 mon.a (mon.0) 4401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:46 smithi049 bash[23528]: cluster 2024-09-21T00:04:45.020471+0000 mgr.a (mgr.14388) 4769 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:46 smithi049 bash[23528]: audit 2024-09-21T00:04:45.483638+0000 mon.a (mon.0) 4399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:46 smithi049 bash[23528]: audit 2024-09-21T00:04:45.492012+0000 mon.a (mon.0) 4400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:46 smithi049 bash[23528]: audit 2024-09-21T00:04:45.502251+0000 mon.a (mon.0) 4401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:04:46.652 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:46.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:46.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:46.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:46.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:47 smithi044 bash[22676]: audit 2024-09-21T00:04:46.199812+0000 mgr.a (mgr.14388) 4770 : audit [DBG] from='client.112860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:47 smithi179 bash[23186]: audit 2024-09-21T00:04:46.199812+0000 mgr.a (mgr.14388) 4770 : audit [DBG] from='client.112860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:47 smithi049 bash[23528]: audit 2024-09-21T00:04:46.199812+0000 mgr.a (mgr.14388) 4770 : audit [DBG] from='client.112860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:48 smithi044 bash[22676]: cluster 2024-09-21T00:04:47.021352+0000 mgr.a (mgr.14388) 4771 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:48 smithi179 bash[23186]: cluster 2024-09-21T00:04:47.021352+0000 mgr.a (mgr.14388) 4771 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:48 smithi049 bash[23528]: cluster 2024-09-21T00:04:47.021352+0000 mgr.a (mgr.14388) 4771 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:50 smithi044 bash[22676]: cluster 2024-09-21T00:04:49.022176+0000 mgr.a (mgr.14388) 4772 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:50 smithi179 bash[23186]: cluster 2024-09-21T00:04:49.022176+0000 mgr.a (mgr.14388) 4772 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:50 smithi049 bash[23528]: cluster 2024-09-21T00:04:49.022176+0000 mgr.a (mgr.14388) 4772 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:51.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:51.654 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:51.654 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:52.407 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:52.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:52 smithi044 bash[22676]: cluster 2024-09-21T00:04:51.024426+0000 mgr.a (mgr.14388) 4773 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:52 smithi179 bash[23186]: cluster 2024-09-21T00:04:51.024426+0000 mgr.a (mgr.14388) 4773 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:52 smithi049 bash[23528]: cluster 2024-09-21T00:04:51.024426+0000 mgr.a (mgr.14388) 4773 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:53 smithi044 bash[22676]: audit 2024-09-21T00:04:51.983150+0000 mgr.a (mgr.14388) 4774 : audit [DBG] from='client.112935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:53 smithi179 bash[23186]: audit 2024-09-21T00:04:51.983150+0000 mgr.a (mgr.14388) 4774 : audit [DBG] from='client.112935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:53 smithi049 bash[23528]: audit 2024-09-21T00:04:51.983150+0000 mgr.a (mgr.14388) 4774 : audit [DBG] from='client.112935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:54 smithi044 bash[22676]: cluster 2024-09-21T00:04:53.025387+0000 mgr.a (mgr.14388) 4775 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:04:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:54 smithi179 bash[23186]: cluster 2024-09-21T00:04:53.025387+0000 mgr.a (mgr.14388) 4775 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:04:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:54 smithi049 bash[23528]: cluster 2024-09-21T00:04:53.025387+0000 mgr.a (mgr.14388) 4775 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:04:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:56 smithi044 bash[22676]: cluster 2024-09-21T00:04:55.027920+0000 mgr.a (mgr.14388) 4776 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:04:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:56 smithi179 bash[23186]: cluster 2024-09-21T00:04:55.027920+0000 mgr.a (mgr.14388) 4776 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:04:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:56 smithi049 bash[23528]: cluster 2024-09-21T00:04:55.027920+0000 mgr.a (mgr.14388) 4776 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:04:57.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:04:57.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:04:57.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:04:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:04:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:04:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:04:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:04:58.170 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:04:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:58 smithi044 bash[22676]: cluster 2024-09-21T00:04:57.028739+0000 mgr.a (mgr.14388) 4777 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:58 smithi179 bash[23186]: cluster 2024-09-21T00:04:57.028739+0000 mgr.a (mgr.14388) 4777 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:58 smithi049 bash[23528]: cluster 2024-09-21T00:04:57.028739+0000 mgr.a (mgr.14388) 4777 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:04:59.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:04:59 smithi044 bash[22676]: audit 2024-09-21T00:04:57.743805+0000 mgr.a (mgr.14388) 4778 : audit [DBG] from='client.113007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:04:59 smithi179 bash[23186]: audit 2024-09-21T00:04:57.743805+0000 mgr.a (mgr.14388) 4778 : audit [DBG] from='client.113007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:04:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:04:59 smithi049 bash[23528]: audit 2024-09-21T00:04:57.743805+0000 mgr.a (mgr.14388) 4778 : audit [DBG] from='client.113007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:00 smithi044 bash[22676]: cluster 2024-09-21T00:04:59.029685+0000 mgr.a (mgr.14388) 4779 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:00 smithi179 bash[23186]: cluster 2024-09-21T00:04:59.029685+0000 mgr.a (mgr.14388) 4779 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:00 smithi049 bash[23528]: cluster 2024-09-21T00:04:59.029685+0000 mgr.a (mgr.14388) 4779 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:02.440 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:02 smithi179 bash[23186]: cluster 2024-09-21T00:05:01.031306+0000 mgr.a (mgr.14388) 4780 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:02.441 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:02 smithi179 bash[23186]: audit 2024-09-21T00:05:01.208420+0000 mon.a (mon.0) 4402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.441 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:02 smithi179 bash[23186]: audit 2024-09-21T00:05:01.214026+0000 mon.a (mon.0) 4403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.441 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:02 smithi179 bash[23186]: audit 2024-09-21T00:05:01.220933+0000 mon.a (mon.0) 4404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:02 smithi044 bash[22676]: cluster 2024-09-21T00:05:01.031306+0000 mgr.a (mgr.14388) 4780 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:02 smithi044 bash[22676]: audit 2024-09-21T00:05:01.208420+0000 mon.a (mon.0) 4402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:02 smithi044 bash[22676]: audit 2024-09-21T00:05:01.214026+0000 mon.a (mon.0) 4403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:02 smithi044 bash[22676]: audit 2024-09-21T00:05:01.220933+0000 mon.a (mon.0) 4404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:02 smithi049 bash[23528]: cluster 2024-09-21T00:05:01.031306+0000 mgr.a (mgr.14388) 4780 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:02 smithi049 bash[23528]: audit 2024-09-21T00:05:01.208420+0000 mon.a (mon.0) 4402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:02 smithi049 bash[23528]: audit 2024-09-21T00:05:01.214026+0000 mon.a (mon.0) 4403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:02 smithi049 bash[23528]: audit 2024-09-21T00:05:01.220933+0000 mon.a (mon.0) 4404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:03.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:03.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:03.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:03.926 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:03.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:04 smithi044 bash[22676]: cluster 2024-09-21T00:05:03.032089+0000 mgr.a (mgr.14388) 4781 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:04 smithi044 bash[22676]: audit 2024-09-21T00:05:03.806948+0000 mon.a (mon.0) 4405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:04 smithi044 bash[22676]: audit 2024-09-21T00:05:03.813057+0000 mon.a (mon.0) 4406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:04 smithi044 bash[22676]: audit 2024-09-21T00:05:03.819800+0000 mon.a (mon.0) 4407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:04 smithi179 bash[23186]: cluster 2024-09-21T00:05:03.032089+0000 mgr.a (mgr.14388) 4781 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:04 smithi179 bash[23186]: audit 2024-09-21T00:05:03.806948+0000 mon.a (mon.0) 4405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:04 smithi179 bash[23186]: audit 2024-09-21T00:05:03.813057+0000 mon.a (mon.0) 4406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:04 smithi179 bash[23186]: audit 2024-09-21T00:05:03.819800+0000 mon.a (mon.0) 4407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:04 smithi049 bash[23528]: cluster 2024-09-21T00:05:03.032089+0000 mgr.a (mgr.14388) 4781 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:04 smithi049 bash[23528]: audit 2024-09-21T00:05:03.806948+0000 mon.a (mon.0) 4405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:04 smithi049 bash[23528]: audit 2024-09-21T00:05:03.813057+0000 mon.a (mon.0) 4406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:04 smithi049 bash[23528]: audit 2024-09-21T00:05:03.819800+0000 mon.a (mon.0) 4407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:05 smithi044 bash[22676]: audit 2024-09-21T00:05:03.507342+0000 mgr.a (mgr.14388) 4782 : audit [DBG] from='client.113079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:05 smithi179 bash[23186]: audit 2024-09-21T00:05:03.507342+0000 mgr.a (mgr.14388) 4782 : audit [DBG] from='client.113079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:05 smithi049 bash[23528]: audit 2024-09-21T00:05:03.507342+0000 mgr.a (mgr.14388) 4782 : audit [DBG] from='client.113079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:06 smithi044 bash[22676]: cluster 2024-09-21T00:05:05.034308+0000 mgr.a (mgr.14388) 4783 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:06 smithi044 bash[22676]: audit 2024-09-21T00:05:05.719045+0000 mon.a (mon.0) 4408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:06 smithi044 bash[22676]: audit 2024-09-21T00:05:05.727541+0000 mon.a (mon.0) 4409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:06 smithi044 bash[22676]: audit 2024-09-21T00:05:05.737982+0000 mon.a (mon.0) 4410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:06 smithi179 bash[23186]: cluster 2024-09-21T00:05:05.034308+0000 mgr.a (mgr.14388) 4783 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:06 smithi179 bash[23186]: audit 2024-09-21T00:05:05.719045+0000 mon.a (mon.0) 4408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:06 smithi179 bash[23186]: audit 2024-09-21T00:05:05.727541+0000 mon.a (mon.0) 4409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:06 smithi179 bash[23186]: audit 2024-09-21T00:05:05.737982+0000 mon.a (mon.0) 4410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:06 smithi049 bash[23528]: cluster 2024-09-21T00:05:05.034308+0000 mgr.a (mgr.14388) 4783 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:06 smithi049 bash[23528]: audit 2024-09-21T00:05:05.719045+0000 mon.a (mon.0) 4408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:06 smithi049 bash[23528]: audit 2024-09-21T00:05:05.727541+0000 mon.a (mon.0) 4409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:06 smithi049 bash[23528]: audit 2024-09-21T00:05:05.737982+0000 mon.a (mon.0) 4410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:08 smithi044 bash[22676]: cluster 2024-09-21T00:05:07.035068+0000 mgr.a (mgr.14388) 4784 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:08 smithi179 bash[23186]: cluster 2024-09-21T00:05:07.035068+0000 mgr.a (mgr.14388) 4784 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:08 smithi049 bash[23528]: cluster 2024-09-21T00:05:07.035068+0000 mgr.a (mgr.14388) 4784 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:08.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:08.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:08.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:09.704 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:09.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:09.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:09.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:09.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:10 smithi044 bash[22676]: cluster 2024-09-21T00:05:09.035510+0000 mgr.a (mgr.14388) 4785 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:10 smithi044 bash[22676]: audit 2024-09-21T00:05:09.261195+0000 mgr.a (mgr.14388) 4786 : audit [DBG] from='client.113154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:10 smithi179 bash[23186]: cluster 2024-09-21T00:05:09.035510+0000 mgr.a (mgr.14388) 4785 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:10 smithi179 bash[23186]: audit 2024-09-21T00:05:09.261195+0000 mgr.a (mgr.14388) 4786 : audit [DBG] from='client.113154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:10 smithi049 bash[23528]: cluster 2024-09-21T00:05:09.035510+0000 mgr.a (mgr.14388) 4785 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:10 smithi049 bash[23528]: audit 2024-09-21T00:05:09.261195+0000 mgr.a (mgr.14388) 4786 : audit [DBG] from='client.113154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:12 smithi044 bash[22676]: cluster 2024-09-21T00:05:11.037810+0000 mgr.a (mgr.14388) 4787 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:12 smithi179 bash[23186]: cluster 2024-09-21T00:05:11.037810+0000 mgr.a (mgr.14388) 4787 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:12 smithi049 bash[23528]: cluster 2024-09-21T00:05:11.037810+0000 mgr.a (mgr.14388) 4787 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:05:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:14 smithi179 bash[23186]: cluster 2024-09-21T00:05:13.038578+0000 mgr.a (mgr.14388) 4788 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:14 smithi049 bash[23528]: cluster 2024-09-21T00:05:13.038578+0000 mgr.a (mgr.14388) 4788 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:14.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:14.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:14 smithi044 bash[22676]: cluster 2024-09-21T00:05:13.038578+0000 mgr.a (mgr.14388) 4788 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:15.496 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:15.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:16 smithi179 bash[23186]: cluster 2024-09-21T00:05:15.040462+0000 mgr.a (mgr.14388) 4789 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:16.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:16 smithi179 bash[23186]: audit 2024-09-21T00:05:15.044629+0000 mgr.a (mgr.14388) 4790 : audit [DBG] from='client.113229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:16 smithi049 bash[23528]: cluster 2024-09-21T00:05:15.040462+0000 mgr.a (mgr.14388) 4789 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:16 smithi049 bash[23528]: audit 2024-09-21T00:05:15.044629+0000 mgr.a (mgr.14388) 4790 : audit [DBG] from='client.113229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:16 smithi044 bash[22676]: cluster 2024-09-21T00:05:15.040462+0000 mgr.a (mgr.14388) 4789 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:16 smithi044 bash[22676]: audit 2024-09-21T00:05:15.044629+0000 mgr.a (mgr.14388) 4790 : audit [DBG] from='client.113229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:18 smithi179 bash[23186]: cluster 2024-09-21T00:05:17.041390+0000 mgr.a (mgr.14388) 4791 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:18 smithi049 bash[23528]: cluster 2024-09-21T00:05:17.041390+0000 mgr.a (mgr.14388) 4791 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:18 smithi044 bash[22676]: cluster 2024-09-21T00:05:17.041390+0000 mgr.a (mgr.14388) 4791 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:20.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:20 smithi044 bash[22676]: cluster 2024-09-21T00:05:19.042162+0000 mgr.a (mgr.14388) 4792 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:20.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:20.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:20 smithi049 bash[23528]: cluster 2024-09-21T00:05:19.042162+0000 mgr.a (mgr.14388) 4792 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:20 smithi179 bash[23186]: cluster 2024-09-21T00:05:19.042162+0000 mgr.a (mgr.14388) 4792 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:21.295 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:21.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:21.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:22.369 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:22 smithi179 bash[23186]: audit 2024-09-21T00:05:20.838066+0000 mgr.a (mgr.14388) 4793 : audit [DBG] from='client.113307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:22.370 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:22 smithi179 bash[23186]: cluster 2024-09-21T00:05:21.043521+0000 mgr.a (mgr.14388) 4794 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:22.370 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:22 smithi179 bash[23186]: audit 2024-09-21T00:05:21.439194+0000 mon.a (mon.0) 4411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.370 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:22 smithi179 bash[23186]: audit 2024-09-21T00:05:21.448091+0000 mon.a (mon.0) 4412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.370 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:22 smithi179 bash[23186]: audit 2024-09-21T00:05:21.458887+0000 mon.a (mon.0) 4413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:22 smithi049 bash[23528]: audit 2024-09-21T00:05:20.838066+0000 mgr.a (mgr.14388) 4793 : audit [DBG] from='client.113307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:22 smithi049 bash[23528]: cluster 2024-09-21T00:05:21.043521+0000 mgr.a (mgr.14388) 4794 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:22 smithi049 bash[23528]: audit 2024-09-21T00:05:21.439194+0000 mon.a (mon.0) 4411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:22 smithi049 bash[23528]: audit 2024-09-21T00:05:21.448091+0000 mon.a (mon.0) 4412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:22 smithi049 bash[23528]: audit 2024-09-21T00:05:21.458887+0000 mon.a (mon.0) 4413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:22 smithi044 bash[22676]: audit 2024-09-21T00:05:20.838066+0000 mgr.a (mgr.14388) 4793 : audit [DBG] from='client.113307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:22.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:22 smithi044 bash[22676]: cluster 2024-09-21T00:05:21.043521+0000 mgr.a (mgr.14388) 4794 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:22.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:22 smithi044 bash[22676]: audit 2024-09-21T00:05:21.439194+0000 mon.a (mon.0) 4411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.626 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:22 smithi044 bash[22676]: audit 2024-09-21T00:05:21.448091+0000 mon.a (mon.0) 4412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:22.626 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:22 smithi044 bash[22676]: audit 2024-09-21T00:05:21.458887+0000 mon.a (mon.0) 4413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:24 smithi179 bash[23186]: cluster 2024-09-21T00:05:23.044419+0000 mgr.a (mgr.14388) 4795 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:24 smithi179 bash[23186]: audit 2024-09-21T00:05:23.962847+0000 mon.a (mon.0) 4414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:24 smithi179 bash[23186]: audit 2024-09-21T00:05:23.971678+0000 mon.a (mon.0) 4415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:24 smithi179 bash[23186]: audit 2024-09-21T00:05:23.982267+0000 mon.a (mon.0) 4416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:24 smithi049 bash[23528]: cluster 2024-09-21T00:05:23.044419+0000 mgr.a (mgr.14388) 4795 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:24 smithi049 bash[23528]: audit 2024-09-21T00:05:23.962847+0000 mon.a (mon.0) 4414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:24 smithi049 bash[23528]: audit 2024-09-21T00:05:23.971678+0000 mon.a (mon.0) 4415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:24 smithi049 bash[23528]: audit 2024-09-21T00:05:23.982267+0000 mon.a (mon.0) 4416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:24 smithi044 bash[22676]: cluster 2024-09-21T00:05:23.044419+0000 mgr.a (mgr.14388) 4795 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:05:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:24 smithi044 bash[22676]: audit 2024-09-21T00:05:23.962847+0000 mon.a (mon.0) 4414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:24 smithi044 bash[22676]: audit 2024-09-21T00:05:23.971678+0000 mon.a (mon.0) 4415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:24 smithi044 bash[22676]: audit 2024-09-21T00:05:23.982267+0000 mon.a (mon.0) 4416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:26.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:26.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:26 smithi049 bash[23528]: cluster 2024-09-21T00:05:25.046551+0000 mgr.a (mgr.14388) 4796 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:26 smithi049 bash[23528]: audit 2024-09-21T00:05:25.958716+0000 mon.a (mon.0) 4417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:26 smithi049 bash[23528]: audit 2024-09-21T00:05:25.967064+0000 mon.a (mon.0) 4418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:26 smithi049 bash[23528]: audit 2024-09-21T00:05:25.977889+0000 mon.a (mon.0) 4419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:26 smithi179 bash[23186]: cluster 2024-09-21T00:05:25.046551+0000 mgr.a (mgr.14388) 4796 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:26.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:26 smithi179 bash[23186]: audit 2024-09-21T00:05:25.958716+0000 mon.a (mon.0) 4417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:26 smithi179 bash[23186]: audit 2024-09-21T00:05:25.967064+0000 mon.a (mon.0) 4418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:26 smithi179 bash[23186]: audit 2024-09-21T00:05:25.977889+0000 mon.a (mon.0) 4419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:26 smithi044 bash[22676]: cluster 2024-09-21T00:05:25.046551+0000 mgr.a (mgr.14388) 4796 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:26 smithi044 bash[22676]: audit 2024-09-21T00:05:25.958716+0000 mon.a (mon.0) 4417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:26 smithi044 bash[22676]: audit 2024-09-21T00:05:25.967064+0000 mon.a (mon.0) 4418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:26 smithi044 bash[22676]: audit 2024-09-21T00:05:25.977889+0000 mon.a (mon.0) 4419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:27.090 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:28 smithi044 bash[22676]: audit 2024-09-21T00:05:26.623610+0000 mgr.a (mgr.14388) 4797 : audit [DBG] from='client.113382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:28 smithi044 bash[22676]: cluster 2024-09-21T00:05:27.047082+0000 mgr.a (mgr.14388) 4798 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:28 smithi044 bash[22676]: audit 2024-09-21T00:05:27.168720+0000 mon.a (mon.0) 4420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:28 smithi044 bash[22676]: audit 2024-09-21T00:05:28.164202+0000 mon.a (mon.0) 4421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:28 smithi179 bash[23186]: audit 2024-09-21T00:05:26.623610+0000 mgr.a (mgr.14388) 4797 : audit [DBG] from='client.113382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:28 smithi179 bash[23186]: cluster 2024-09-21T00:05:27.047082+0000 mgr.a (mgr.14388) 4798 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:28 smithi179 bash[23186]: audit 2024-09-21T00:05:27.168720+0000 mon.a (mon.0) 4420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:28 smithi179 bash[23186]: audit 2024-09-21T00:05:28.164202+0000 mon.a (mon.0) 4421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:28 smithi049 bash[23528]: audit 2024-09-21T00:05:26.623610+0000 mgr.a (mgr.14388) 4797 : audit [DBG] from='client.113382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:28 smithi049 bash[23528]: cluster 2024-09-21T00:05:27.047082+0000 mgr.a (mgr.14388) 4798 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:28 smithi049 bash[23528]: audit 2024-09-21T00:05:27.168720+0000 mon.a (mon.0) 4420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:28 smithi049 bash[23528]: audit 2024-09-21T00:05:28.164202+0000 mon.a (mon.0) 4421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: cluster 2024-09-21T00:05:29.047830+0000 mgr.a (mgr.14388) 4799 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:29.132222+0000 mon.a (mon.0) 4422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:29.135007+0000 mon.a (mon.0) 4423 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:30.095295+0000 mon.a (mon.0) 4424 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:30.096905+0000 mon.a (mon.0) 4425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:30.097047+0000 mon.a (mon.0) 4426 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:30.097282+0000 mon.a (mon.0) 4427 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:30.103399+0000 mon.a (mon.0) 4428 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:30.103575+0000 mon.a (mon.0) 4429 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:31 smithi049 bash[23528]: audit 2024-09-21T00:05:30.103701+0000 mon.a (mon.0) 4430 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: cluster 2024-09-21T00:05:29.047830+0000 mgr.a (mgr.14388) 4799 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:29.132222+0000 mon.a (mon.0) 4422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:29.135007+0000 mon.a (mon.0) 4423 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:30.095295+0000 mon.a (mon.0) 4424 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:30.096905+0000 mon.a (mon.0) 4425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:30.097047+0000 mon.a (mon.0) 4426 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:30.097282+0000 mon.a (mon.0) 4427 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:30.103399+0000 mon.a (mon.0) 4428 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:30.103575+0000 mon.a (mon.0) 4429 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:31 smithi044 bash[22676]: audit 2024-09-21T00:05:30.103701+0000 mon.a (mon.0) 4430 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: cluster 2024-09-21T00:05:29.047830+0000 mgr.a (mgr.14388) 4799 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:29.132222+0000 mon.a (mon.0) 4422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:29.135007+0000 mon.a (mon.0) 4423 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:30.095295+0000 mon.a (mon.0) 4424 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:30.096905+0000 mon.a (mon.0) 4425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:30.097047+0000 mon.a (mon.0) 4426 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:30.097282+0000 mon.a (mon.0) 4427 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:30.103399+0000 mon.a (mon.0) 4428 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:30.103575+0000 mon.a (mon.0) 4429 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:31 smithi179 bash[23186]: audit 2024-09-21T00:05:30.103701+0000 mon.a (mon.0) 4430 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:32.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:32.093 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:32.093 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: audit 2024-09-21T00:05:30.103146+0000 mon.c (mon.1) 14 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: audit 2024-09-21T00:05:31.020444+0000 mon.c (mon.1) 15 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: audit 2024-09-21T00:05:31.030052+0000 mon.a (mon.0) 4431 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: audit 2024-09-21T00:05:31.030512+0000 mon.a (mon.0) 4432 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: audit 2024-09-21T00:05:31.030601+0000 mon.b (mon.2) 20 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: audit 2024-09-21T00:05:31.030893+0000 mon.a (mon.0) 4433 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: cluster 2024-09-21T00:05:31.050164+0000 mgr.a (mgr.14388) 4800 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 98 KiB/s wr, 10 op/s 2024-09-21T00:05:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:32 smithi049 bash[23528]: audit 2024-09-21T00:05:31.975215+0000 mon.b (mon.2) 21 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: audit 2024-09-21T00:05:30.103146+0000 mon.c (mon.1) 14 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: audit 2024-09-21T00:05:31.020444+0000 mon.c (mon.1) 15 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: audit 2024-09-21T00:05:31.030052+0000 mon.a (mon.0) 4431 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: audit 2024-09-21T00:05:31.030512+0000 mon.a (mon.0) 4432 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: audit 2024-09-21T00:05:31.030601+0000 mon.b (mon.2) 20 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: audit 2024-09-21T00:05:31.030893+0000 mon.a (mon.0) 4433 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: cluster 2024-09-21T00:05:31.050164+0000 mgr.a (mgr.14388) 4800 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 98 KiB/s wr, 10 op/s 2024-09-21T00:05:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:32 smithi044 bash[22676]: audit 2024-09-21T00:05:31.975215+0000 mon.b (mon.2) 21 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: audit 2024-09-21T00:05:30.103146+0000 mon.c (mon.1) 14 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: audit 2024-09-21T00:05:31.020444+0000 mon.c (mon.1) 15 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: audit 2024-09-21T00:05:31.030052+0000 mon.a (mon.0) 4431 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: audit 2024-09-21T00:05:31.030512+0000 mon.a (mon.0) 4432 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: audit 2024-09-21T00:05:31.030601+0000 mon.b (mon.2) 20 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: audit 2024-09-21T00:05:31.030893+0000 mon.a (mon.0) 4433 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: cluster 2024-09-21T00:05:31.050164+0000 mgr.a (mgr.14388) 4800 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 98 KiB/s wr, 10 op/s 2024-09-21T00:05:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:32 smithi179 bash[23186]: audit 2024-09-21T00:05:31.975215+0000 mon.b (mon.2) 21 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:05:32.864 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:32.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:32.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:32.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:34 smithi044 bash[22676]: audit 2024-09-21T00:05:32.427059+0000 mgr.a (mgr.14388) 4801 : audit [DBG] from='client.113463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:34 smithi044 bash[22676]: cluster 2024-09-21T00:05:33.051203+0000 mgr.a (mgr.14388) 4802 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 98 KiB/s wr, 9 op/s 2024-09-21T00:05:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:34 smithi179 bash[23186]: audit 2024-09-21T00:05:32.427059+0000 mgr.a (mgr.14388) 4801 : audit [DBG] from='client.113463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:34 smithi179 bash[23186]: cluster 2024-09-21T00:05:33.051203+0000 mgr.a (mgr.14388) 4802 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 98 KiB/s wr, 9 op/s 2024-09-21T00:05:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:34 smithi049 bash[23528]: audit 2024-09-21T00:05:32.427059+0000 mgr.a (mgr.14388) 4801 : audit [DBG] from='client.113463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:34 smithi049 bash[23528]: cluster 2024-09-21T00:05:33.051203+0000 mgr.a (mgr.14388) 4802 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 98 KiB/s wr, 9 op/s 2024-09-21T00:05:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:36 smithi044 bash[22676]: cluster 2024-09-21T00:05:35.053403+0000 mgr.a (mgr.14388) 4803 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 12 op/s 2024-09-21T00:05:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:36 smithi179 bash[23186]: cluster 2024-09-21T00:05:35.053403+0000 mgr.a (mgr.14388) 4803 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 12 op/s 2024-09-21T00:05:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:36 smithi049 bash[23528]: cluster 2024-09-21T00:05:35.053403+0000 mgr.a (mgr.14388) 4803 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 12 op/s 2024-09-21T00:05:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:37.867 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:38 smithi044 bash[22676]: cluster 2024-09-21T00:05:37.054132+0000 mgr.a (mgr.14388) 4804 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-09-21T00:05:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:38 smithi179 bash[23186]: cluster 2024-09-21T00:05:37.054132+0000 mgr.a (mgr.14388) 4804 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-09-21T00:05:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:38 smithi049 bash[23528]: cluster 2024-09-21T00:05:37.054132+0000 mgr.a (mgr.14388) 4804 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-09-21T00:05:38.623 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:38.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:38.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:38.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:38.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:39 smithi044 bash[22676]: audit 2024-09-21T00:05:38.194197+0000 mgr.a (mgr.14388) 4805 : audit [DBG] from='client.113535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:39 smithi179 bash[23186]: audit 2024-09-21T00:05:38.194197+0000 mgr.a (mgr.14388) 4805 : audit [DBG] from='client.113535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:39 smithi049 bash[23528]: audit 2024-09-21T00:05:38.194197+0000 mgr.a (mgr.14388) 4805 : audit [DBG] from='client.113535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22676]: cluster 2024-09-21T00:05:39.055031+0000 mgr.a (mgr.14388) 4806 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-09-21T00:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22676]: audit 2024-09-21T00:05:40.040185+0000 mon.a (mon.0) 4434 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22676]: audit 2024-09-21T00:05:40.047280+0000 mon.a (mon.0) 4435 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22676]: audit 2024-09-21T00:05:40.049192+0000 mon.a (mon.0) 4436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22676]: audit 2024-09-21T00:05:40.060350+0000 mon.a (mon.0) 4437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22676]: audit 2024-09-21T00:05:40.066920+0000 mon.a (mon.0) 4438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:05:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:40 smithi179 bash[23186]: cluster 2024-09-21T00:05:39.055031+0000 mgr.a (mgr.14388) 4806 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-09-21T00:05:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:40 smithi179 bash[23186]: audit 2024-09-21T00:05:40.040185+0000 mon.a (mon.0) 4434 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:05:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:40 smithi179 bash[23186]: audit 2024-09-21T00:05:40.047280+0000 mon.a (mon.0) 4435 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:05:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:40 smithi179 bash[23186]: audit 2024-09-21T00:05:40.049192+0000 mon.a (mon.0) 4436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:05:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:40 smithi179 bash[23186]: audit 2024-09-21T00:05:40.060350+0000 mon.a (mon.0) 4437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:40 smithi179 bash[23186]: audit 2024-09-21T00:05:40.066920+0000 mon.a (mon.0) 4438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:40 smithi049 bash[23528]: cluster 2024-09-21T00:05:39.055031+0000 mgr.a (mgr.14388) 4806 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-09-21T00:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:40 smithi049 bash[23528]: audit 2024-09-21T00:05:40.040185+0000 mon.a (mon.0) 4434 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:40 smithi049 bash[23528]: audit 2024-09-21T00:05:40.047280+0000 mon.a (mon.0) 4435 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:40 smithi049 bash[23528]: audit 2024-09-21T00:05:40.049192+0000 mon.a (mon.0) 4436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:40 smithi049 bash[23528]: audit 2024-09-21T00:05:40.060350+0000 mon.a (mon.0) 4437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:40 smithi049 bash[23528]: audit 2024-09-21T00:05:40.066920+0000 mon.a (mon.0) 4438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:05:41.051 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22930]: debug 2024-09-21T00:05:40.800+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:05:41.052 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:05:40 smithi044 bash[22930]: debug 2024-09-21T00:05:40.800+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:05:41.339 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:41 smithi044 bash[22676]: audit 2024-09-21T00:05:40.069489+0000 mgr.a (mgr.14388) 4807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:05:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:41 smithi179 bash[23186]: audit 2024-09-21T00:05:40.069489+0000 mgr.a (mgr.14388) 4807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:05:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:41 smithi049 bash[23528]: audit 2024-09-21T00:05:40.069489+0000 mgr.a (mgr.14388) 4807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:42 smithi049 bash[23528]: audit 2024-09-21T00:05:40.801684+0000 mgr.a (mgr.14388) 4808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:42 smithi049 bash[23528]: cephadm 2024-09-21T00:05:40.802841+0000 mgr.a (mgr.14388) 4809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:42 smithi049 bash[23528]: cluster 2024-09-21T00:05:41.056311+0000 mgr.a (mgr.14388) 4810 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 12 op/s 2024-09-21T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:42 smithi049 bash[23528]: audit 2024-09-21T00:05:41.654566+0000 mon.a (mon.0) 4439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:42 smithi049 bash[23528]: audit 2024-09-21T00:05:41.659331+0000 mon.a (mon.0) 4440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.201 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:42 smithi049 bash[23528]: audit 2024-09-21T00:05:41.664989+0000 mon.a (mon.0) 4441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:42 smithi044 bash[22676]: audit 2024-09-21T00:05:40.801684+0000 mgr.a (mgr.14388) 4808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:05:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:42 smithi044 bash[22676]: cephadm 2024-09-21T00:05:40.802841+0000 mgr.a (mgr.14388) 4809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:05:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:42 smithi044 bash[22676]: cluster 2024-09-21T00:05:41.056311+0000 mgr.a (mgr.14388) 4810 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 12 op/s 2024-09-21T00:05:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:42 smithi044 bash[22676]: audit 2024-09-21T00:05:41.654566+0000 mon.a (mon.0) 4439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:42 smithi044 bash[22676]: audit 2024-09-21T00:05:41.659331+0000 mon.a (mon.0) 4440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:42 smithi044 bash[22676]: audit 2024-09-21T00:05:41.664989+0000 mon.a (mon.0) 4441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:42 smithi179 bash[23186]: audit 2024-09-21T00:05:40.801684+0000 mgr.a (mgr.14388) 4808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:05:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:42 smithi179 bash[23186]: cephadm 2024-09-21T00:05:40.802841+0000 mgr.a (mgr.14388) 4809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:05:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:42 smithi179 bash[23186]: cluster 2024-09-21T00:05:41.056311+0000 mgr.a (mgr.14388) 4810 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 120 KiB/s wr, 12 op/s 2024-09-21T00:05:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:42 smithi179 bash[23186]: audit 2024-09-21T00:05:41.654566+0000 mon.a (mon.0) 4439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:42 smithi179 bash[23186]: audit 2024-09-21T00:05:41.659331+0000 mon.a (mon.0) 4440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:42 smithi179 bash[23186]: audit 2024-09-21T00:05:41.664989+0000 mon.a (mon.0) 4441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:44.374 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:44.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:44 smithi044 bash[22676]: cluster 2024-09-21T00:05:43.056850+0000 mgr.a (mgr.14388) 4811 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T00:05:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:44 smithi044 bash[22676]: audit 2024-09-21T00:05:44.121952+0000 mon.a (mon.0) 4442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:44 smithi044 bash[22676]: audit 2024-09-21T00:05:44.126831+0000 mon.a (mon.0) 4443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:44 smithi044 bash[22676]: audit 2024-09-21T00:05:44.132039+0000 mon.a (mon.0) 4444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:44 smithi179 bash[23186]: cluster 2024-09-21T00:05:43.056850+0000 mgr.a (mgr.14388) 4811 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T00:05:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:44 smithi179 bash[23186]: audit 2024-09-21T00:05:44.121952+0000 mon.a (mon.0) 4442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:44 smithi179 bash[23186]: audit 2024-09-21T00:05:44.126831+0000 mon.a (mon.0) 4443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:44 smithi179 bash[23186]: audit 2024-09-21T00:05:44.132039+0000 mon.a (mon.0) 4444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:44 smithi049 bash[23528]: cluster 2024-09-21T00:05:43.056850+0000 mgr.a (mgr.14388) 4811 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T00:05:44.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:44 smithi049 bash[23528]: audit 2024-09-21T00:05:44.121952+0000 mon.a (mon.0) 4442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:44 smithi049 bash[23528]: audit 2024-09-21T00:05:44.126831+0000 mon.a (mon.0) 4443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:44.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:44 smithi049 bash[23528]: audit 2024-09-21T00:05:44.132039+0000 mon.a (mon.0) 4444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:45 smithi179 bash[23186]: audit 2024-09-21T00:05:43.957337+0000 mgr.a (mgr.14388) 4812 : audit [DBG] from='client.113721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:45 smithi044 bash[22676]: audit 2024-09-21T00:05:43.957337+0000 mgr.a (mgr.14388) 4812 : audit [DBG] from='client.113721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:45 smithi049 bash[23528]: audit 2024-09-21T00:05:43.957337+0000 mgr.a (mgr.14388) 4812 : audit [DBG] from='client.113721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:46 smithi044 bash[22676]: cluster 2024-09-21T00:05:45.059255+0000 mgr.a (mgr.14388) 4813 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T00:05:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:46 smithi179 bash[23186]: cluster 2024-09-21T00:05:45.059255+0000 mgr.a (mgr.14388) 4813 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T00:05:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:46 smithi049 bash[23528]: cluster 2024-09-21T00:05:45.059255+0000 mgr.a (mgr.14388) 4813 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T00:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:47 smithi044 bash[22676]: audit 2024-09-21T00:05:46.183657+0000 mon.a (mon.0) 4445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:47 smithi044 bash[22676]: audit 2024-09-21T00:05:46.192471+0000 mon.a (mon.0) 4446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:47 smithi044 bash[22676]: audit 2024-09-21T00:05:46.202814+0000 mon.a (mon.0) 4447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:47 smithi179 bash[23186]: audit 2024-09-21T00:05:46.183657+0000 mon.a (mon.0) 4445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:47 smithi179 bash[23186]: audit 2024-09-21T00:05:46.192471+0000 mon.a (mon.0) 4446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:47 smithi179 bash[23186]: audit 2024-09-21T00:05:46.202814+0000 mon.a (mon.0) 4447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:47 smithi049 bash[23528]: audit 2024-09-21T00:05:46.183657+0000 mon.a (mon.0) 4445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:47 smithi049 bash[23528]: audit 2024-09-21T00:05:46.192471+0000 mon.a (mon.0) 4446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:47 smithi049 bash[23528]: audit 2024-09-21T00:05:46.202814+0000 mon.a (mon.0) 4447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:05:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:48 smithi044 bash[22676]: cluster 2024-09-21T00:05:47.060088+0000 mgr.a (mgr.14388) 4814 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:05:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:48 smithi179 bash[23186]: cluster 2024-09-21T00:05:47.060088+0000 mgr.a (mgr.14388) 4814 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:05:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:48 smithi049 bash[23528]: cluster 2024-09-21T00:05:47.060088+0000 mgr.a (mgr.14388) 4814 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:05:49.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:49.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:49.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:50.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:50.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:50.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:50.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:50.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:50 smithi044 bash[22676]: cluster 2024-09-21T00:05:49.060866+0000 mgr.a (mgr.14388) 4815 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:05:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:50 smithi179 bash[23186]: cluster 2024-09-21T00:05:49.060866+0000 mgr.a (mgr.14388) 4815 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:05:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:50 smithi049 bash[23528]: cluster 2024-09-21T00:05:49.060866+0000 mgr.a (mgr.14388) 4815 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:05:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:51 smithi044 bash[22676]: audit 2024-09-21T00:05:49.717833+0000 mgr.a (mgr.14388) 4816 : audit [DBG] from='client.113799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:51 smithi179 bash[23186]: audit 2024-09-21T00:05:49.717833+0000 mgr.a (mgr.14388) 4816 : audit [DBG] from='client.113799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:51 smithi049 bash[23528]: audit 2024-09-21T00:05:49.717833+0000 mgr.a (mgr.14388) 4816 : audit [DBG] from='client.113799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:52 smithi044 bash[22676]: cluster 2024-09-21T00:05:51.063576+0000 mgr.a (mgr.14388) 4817 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T00:05:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:52 smithi179 bash[23186]: cluster 2024-09-21T00:05:51.063576+0000 mgr.a (mgr.14388) 4817 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T00:05:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:52 smithi049 bash[23528]: cluster 2024-09-21T00:05:51.063576+0000 mgr.a (mgr.14388) 4817 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T00:05:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:54 smithi044 bash[22676]: cluster 2024-09-21T00:05:53.064333+0000 mgr.a (mgr.14388) 4818 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T00:05:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:54 smithi179 bash[23186]: cluster 2024-09-21T00:05:53.064333+0000 mgr.a (mgr.14388) 4818 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T00:05:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:54 smithi049 bash[23528]: cluster 2024-09-21T00:05:53.064333+0000 mgr.a (mgr.14388) 4818 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T00:05:55.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:05:55.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:05:55.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:05:55.969 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:05:55.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:05:55.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:05:55.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:05:55.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:05:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:56 smithi044 bash[22676]: cluster 2024-09-21T00:05:55.066800+0000 mgr.a (mgr.14388) 4819 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 38 op/s 2024-09-21T00:05:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:56 smithi179 bash[23186]: cluster 2024-09-21T00:05:55.066800+0000 mgr.a (mgr.14388) 4819 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 38 op/s 2024-09-21T00:05:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:56 smithi049 bash[23528]: cluster 2024-09-21T00:05:55.066800+0000 mgr.a (mgr.14388) 4819 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 38 op/s 2024-09-21T00:05:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:57 smithi179 bash[23186]: audit 2024-09-21T00:05:55.523525+0000 mgr.a (mgr.14388) 4820 : audit [DBG] from='client.113877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:57 smithi049 bash[23528]: audit 2024-09-21T00:05:55.523525+0000 mgr.a (mgr.14388) 4820 : audit [DBG] from='client.113877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:57 smithi044 bash[22676]: audit 2024-09-21T00:05:55.523525+0000 mgr.a (mgr.14388) 4820 : audit [DBG] from='client.113877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:05:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:05:58 smithi179 bash[23186]: cluster 2024-09-21T00:05:57.067695+0000 mgr.a (mgr.14388) 4821 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T00:05:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:05:58 smithi049 bash[23528]: cluster 2024-09-21T00:05:57.067695+0000 mgr.a (mgr.14388) 4821 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T00:05:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:05:58 smithi044 bash[22676]: cluster 2024-09-21T00:05:57.067695+0000 mgr.a (mgr.14388) 4821 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T00:06:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:00 smithi179 bash[23186]: cluster 2024-09-21T00:05:59.068460+0000 mgr.a (mgr.14388) 4822 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T00:06:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:00 smithi049 bash[23528]: cluster 2024-09-21T00:05:59.068460+0000 mgr.a (mgr.14388) 4822 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T00:06:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:00 smithi044 bash[22676]: cluster 2024-09-21T00:05:59.068460+0000 mgr.a (mgr.14388) 4822 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T00:06:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:00.971 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:00.971 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:01.745 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:02.302 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:02 smithi044 bash[22676]: cluster 2024-09-21T00:06:01.069527+0000 mgr.a (mgr.14388) 4823 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-21T00:06:02.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:02 smithi044 bash[22676]: audit 2024-09-21T00:06:01.309353+0000 mgr.a (mgr.14388) 4824 : audit [DBG] from='client.113952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:02.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:02 smithi044 bash[22676]: audit 2024-09-21T00:06:01.840370+0000 mon.a (mon.0) 4448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:02 smithi044 bash[22676]: audit 2024-09-21T00:06:01.846195+0000 mon.a (mon.0) 4449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:02 smithi044 bash[22676]: audit 2024-09-21T00:06:01.853008+0000 mon.a (mon.0) 4450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:02 smithi179 bash[23186]: cluster 2024-09-21T00:06:01.069527+0000 mgr.a (mgr.14388) 4823 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-21T00:06:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:02 smithi179 bash[23186]: audit 2024-09-21T00:06:01.309353+0000 mgr.a (mgr.14388) 4824 : audit [DBG] from='client.113952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:02 smithi179 bash[23186]: audit 2024-09-21T00:06:01.840370+0000 mon.a (mon.0) 4448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:02 smithi179 bash[23186]: audit 2024-09-21T00:06:01.846195+0000 mon.a (mon.0) 4449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:02 smithi179 bash[23186]: audit 2024-09-21T00:06:01.853008+0000 mon.a (mon.0) 4450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:02 smithi049 bash[23528]: cluster 2024-09-21T00:06:01.069527+0000 mgr.a (mgr.14388) 4823 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-21T00:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:02 smithi049 bash[23528]: audit 2024-09-21T00:06:01.309353+0000 mgr.a (mgr.14388) 4824 : audit [DBG] from='client.113952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:02 smithi049 bash[23528]: audit 2024-09-21T00:06:01.840370+0000 mon.a (mon.0) 4448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:02 smithi049 bash[23528]: audit 2024-09-21T00:06:01.846195+0000 mon.a (mon.0) 4449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:02 smithi049 bash[23528]: audit 2024-09-21T00:06:01.853008+0000 mon.a (mon.0) 4450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:04 smithi179 bash[23186]: cluster 2024-09-21T00:06:03.070329+0000 mgr.a (mgr.14388) 4825 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:06:04.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:04 smithi049 bash[23528]: cluster 2024-09-21T00:06:03.070329+0000 mgr.a (mgr.14388) 4825 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:06:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:04 smithi044 bash[22676]: cluster 2024-09-21T00:06:03.070329+0000 mgr.a (mgr.14388) 4825 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:06:05.592 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:05 smithi179 bash[23186]: audit 2024-09-21T00:06:04.325135+0000 mon.a (mon.0) 4451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.592 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:05 smithi179 bash[23186]: audit 2024-09-21T00:06:04.332326+0000 mon.a (mon.0) 4452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.592 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:05 smithi179 bash[23186]: audit 2024-09-21T00:06:04.340260+0000 mon.a (mon.0) 4453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:05 smithi044 bash[22676]: audit 2024-09-21T00:06:04.325135+0000 mon.a (mon.0) 4451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:05 smithi044 bash[22676]: audit 2024-09-21T00:06:04.332326+0000 mon.a (mon.0) 4452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:05 smithi044 bash[22676]: audit 2024-09-21T00:06:04.340260+0000 mon.a (mon.0) 4453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:05 smithi049 bash[23528]: audit 2024-09-21T00:06:04.325135+0000 mon.a (mon.0) 4451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:05 smithi049 bash[23528]: audit 2024-09-21T00:06:04.332326+0000 mon.a (mon.0) 4452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:05 smithi049 bash[23528]: audit 2024-09-21T00:06:04.340260+0000 mon.a (mon.0) 4453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:06.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:06 smithi179 bash[23186]: cluster 2024-09-21T00:06:05.072501+0000 mgr.a (mgr.14388) 4826 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:06:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:06 smithi044 bash[22676]: cluster 2024-09-21T00:06:05.072501+0000 mgr.a (mgr.14388) 4826 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:06:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:06.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:06 smithi049 bash[23528]: cluster 2024-09-21T00:06:05.072501+0000 mgr.a (mgr.14388) 4826 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:06:07.544 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:07.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:07 smithi044 bash[22676]: audit 2024-09-21T00:06:06.415013+0000 mon.a (mon.0) 4454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:07 smithi044 bash[22676]: audit 2024-09-21T00:06:06.423346+0000 mon.a (mon.0) 4455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:07 smithi044 bash[22676]: audit 2024-09-21T00:06:06.433504+0000 mon.a (mon.0) 4456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:07 smithi044 bash[22676]: cluster 2024-09-21T00:06:07.073236+0000 mgr.a (mgr.14388) 4827 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-21T00:06:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:07 smithi044 bash[22676]: audit 2024-09-21T00:06:07.082800+0000 mgr.a (mgr.14388) 4828 : audit [DBG] from='client.114030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:07 smithi179 bash[23186]: audit 2024-09-21T00:06:06.415013+0000 mon.a (mon.0) 4454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:07 smithi179 bash[23186]: audit 2024-09-21T00:06:06.423346+0000 mon.a (mon.0) 4455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:07 smithi179 bash[23186]: audit 2024-09-21T00:06:06.433504+0000 mon.a (mon.0) 4456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:07 smithi179 bash[23186]: cluster 2024-09-21T00:06:07.073236+0000 mgr.a (mgr.14388) 4827 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-21T00:06:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:07 smithi179 bash[23186]: audit 2024-09-21T00:06:07.082800+0000 mgr.a (mgr.14388) 4828 : audit [DBG] from='client.114030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:07 smithi049 bash[23528]: audit 2024-09-21T00:06:06.415013+0000 mon.a (mon.0) 4454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:07 smithi049 bash[23528]: audit 2024-09-21T00:06:06.423346+0000 mon.a (mon.0) 4455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:07 smithi049 bash[23528]: audit 2024-09-21T00:06:06.433504+0000 mon.a (mon.0) 4456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:07 smithi049 bash[23528]: cluster 2024-09-21T00:06:07.073236+0000 mgr.a (mgr.14388) 4827 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-21T00:06:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:07 smithi049 bash[23528]: audit 2024-09-21T00:06:07.082800+0000 mgr.a (mgr.14388) 4828 : audit [DBG] from='client.114030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:10 smithi044 bash[22676]: cluster 2024-09-21T00:06:09.074103+0000 mgr.a (mgr.14388) 4829 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-21T00:06:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:10 smithi179 bash[23186]: cluster 2024-09-21T00:06:09.074103+0000 mgr.a (mgr.14388) 4829 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-21T00:06:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:10 smithi049 bash[23528]: cluster 2024-09-21T00:06:09.074103+0000 mgr.a (mgr.14388) 4829 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-21T00:06:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:12 smithi044 bash[22676]: cluster 2024-09-21T00:06:11.076352+0000 mgr.a (mgr.14388) 4830 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-21T00:06:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:12 smithi179 bash[23186]: cluster 2024-09-21T00:06:11.076352+0000 mgr.a (mgr.14388) 4830 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-21T00:06:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:12 smithi049 bash[23528]: cluster 2024-09-21T00:06:11.076352+0000 mgr.a (mgr.14388) 4830 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-21T00:06:13.337 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:13.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:13.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:13.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:13.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:14 smithi044 bash[22676]: audit 2024-09-21T00:06:12.880107+0000 mgr.a (mgr.14388) 4831 : audit [DBG] from='client.114108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:14 smithi044 bash[22676]: cluster 2024-09-21T00:06:13.077030+0000 mgr.a (mgr.14388) 4832 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:14 smithi179 bash[23186]: audit 2024-09-21T00:06:12.880107+0000 mgr.a (mgr.14388) 4831 : audit [DBG] from='client.114108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:14 smithi179 bash[23186]: cluster 2024-09-21T00:06:13.077030+0000 mgr.a (mgr.14388) 4832 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:14 smithi049 bash[23528]: audit 2024-09-21T00:06:12.880107+0000 mgr.a (mgr.14388) 4831 : audit [DBG] from='client.114108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:14 smithi049 bash[23528]: cluster 2024-09-21T00:06:13.077030+0000 mgr.a (mgr.14388) 4832 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:16 smithi044 bash[22676]: cluster 2024-09-21T00:06:15.079294+0000 mgr.a (mgr.14388) 4833 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:06:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:16 smithi179 bash[23186]: cluster 2024-09-21T00:06:15.079294+0000 mgr.a (mgr.14388) 4833 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:06:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:16 smithi049 bash[23528]: cluster 2024-09-21T00:06:15.079294+0000 mgr.a (mgr.14388) 4833 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:06:18.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:18.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:18.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:18 smithi044 bash[22676]: cluster 2024-09-21T00:06:17.080032+0000 mgr.a (mgr.14388) 4834 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:18 smithi179 bash[23186]: cluster 2024-09-21T00:06:17.080032+0000 mgr.a (mgr.14388) 4834 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:18 smithi049 bash[23528]: cluster 2024-09-21T00:06:17.080032+0000 mgr.a (mgr.14388) 4834 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:19.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:19.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:19.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:19.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:20 smithi044 bash[22676]: audit 2024-09-21T00:06:18.675593+0000 mgr.a (mgr.14388) 4835 : audit [DBG] from='client.114186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:20 smithi044 bash[22676]: cluster 2024-09-21T00:06:19.080505+0000 mgr.a (mgr.14388) 4836 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:20 smithi179 bash[23186]: audit 2024-09-21T00:06:18.675593+0000 mgr.a (mgr.14388) 4835 : audit [DBG] from='client.114186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:20 smithi179 bash[23186]: cluster 2024-09-21T00:06:19.080505+0000 mgr.a (mgr.14388) 4836 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:20 smithi049 bash[23528]: audit 2024-09-21T00:06:18.675593+0000 mgr.a (mgr.14388) 4835 : audit [DBG] from='client.114186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:20 smithi049 bash[23528]: cluster 2024-09-21T00:06:19.080505+0000 mgr.a (mgr.14388) 4836 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:06:22.277 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:22 smithi049 bash[23528]: cluster 2024-09-21T00:06:21.082776+0000 mgr.a (mgr.14388) 4837 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:06:22.277 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:22 smithi049 bash[23528]: audit 2024-09-21T00:06:22.036855+0000 mon.a (mon.0) 4457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.278 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:22 smithi049 bash[23528]: audit 2024-09-21T00:06:22.043189+0000 mon.a (mon.0) 4458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.278 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:22 smithi049 bash[23528]: audit 2024-09-21T00:06:22.048615+0000 mon.a (mon.0) 4459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:22 smithi044 bash[22676]: cluster 2024-09-21T00:06:21.082776+0000 mgr.a (mgr.14388) 4837 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:06:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:22 smithi044 bash[22676]: audit 2024-09-21T00:06:22.036855+0000 mon.a (mon.0) 4457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:22 smithi044 bash[22676]: audit 2024-09-21T00:06:22.043189+0000 mon.a (mon.0) 4458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:22 smithi044 bash[22676]: audit 2024-09-21T00:06:22.048615+0000 mon.a (mon.0) 4459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:22 smithi179 bash[23186]: cluster 2024-09-21T00:06:21.082776+0000 mgr.a (mgr.14388) 4837 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:06:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:22 smithi179 bash[23186]: audit 2024-09-21T00:06:22.036855+0000 mon.a (mon.0) 4457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:22 smithi179 bash[23186]: audit 2024-09-21T00:06:22.043189+0000 mon.a (mon.0) 4458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:22 smithi179 bash[23186]: audit 2024-09-21T00:06:22.048615+0000 mon.a (mon.0) 4459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:24.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:24.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:24.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:24.419 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:24 smithi049 bash[23528]: cluster 2024-09-21T00:06:23.083359+0000 mgr.a (mgr.14388) 4838 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:24 smithi044 bash[22676]: cluster 2024-09-21T00:06:23.083359+0000 mgr.a (mgr.14388) 4838 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:24 smithi179 bash[23186]: cluster 2024-09-21T00:06:23.083359+0000 mgr.a (mgr.14388) 4838 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:24.932 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:25 smithi044 bash[22676]: audit 2024-09-21T00:06:24.469229+0000 mgr.a (mgr.14388) 4839 : audit [DBG] from='client.114258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:25 smithi044 bash[22676]: audit 2024-09-21T00:06:24.543827+0000 mon.a (mon.0) 4460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:25 smithi044 bash[22676]: audit 2024-09-21T00:06:24.552445+0000 mon.a (mon.0) 4461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:25 smithi044 bash[22676]: audit 2024-09-21T00:06:24.558513+0000 mon.a (mon.0) 4462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:25 smithi044 bash[22676]: cluster 2024-09-21T00:06:25.084666+0000 mgr.a (mgr.14388) 4840 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:06:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:25 smithi049 bash[23528]: audit 2024-09-21T00:06:24.469229+0000 mgr.a (mgr.14388) 4839 : audit [DBG] from='client.114258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:25 smithi049 bash[23528]: audit 2024-09-21T00:06:24.543827+0000 mon.a (mon.0) 4460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:25 smithi049 bash[23528]: audit 2024-09-21T00:06:24.552445+0000 mon.a (mon.0) 4461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:25 smithi049 bash[23528]: audit 2024-09-21T00:06:24.558513+0000 mon.a (mon.0) 4462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:25 smithi049 bash[23528]: cluster 2024-09-21T00:06:25.084666+0000 mgr.a (mgr.14388) 4840 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:06:25.810 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:25 smithi179 bash[23186]: audit 2024-09-21T00:06:24.469229+0000 mgr.a (mgr.14388) 4839 : audit [DBG] from='client.114258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:25.810 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:25 smithi179 bash[23186]: audit 2024-09-21T00:06:24.543827+0000 mon.a (mon.0) 4460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.811 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:25 smithi179 bash[23186]: audit 2024-09-21T00:06:24.552445+0000 mon.a (mon.0) 4461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.811 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:25 smithi179 bash[23186]: audit 2024-09-21T00:06:24.558513+0000 mon.a (mon.0) 4462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:25.811 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:25 smithi179 bash[23186]: cluster 2024-09-21T00:06:25.084666+0000 mgr.a (mgr.14388) 4840 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:06:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:27 smithi044 bash[22676]: audit 2024-09-21T00:06:26.572894+0000 mon.a (mon.0) 4463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:27 smithi044 bash[22676]: audit 2024-09-21T00:06:26.578498+0000 mon.a (mon.0) 4464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:27 smithi044 bash[22676]: audit 2024-09-21T00:06:26.584508+0000 mon.a (mon.0) 4465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:27 smithi044 bash[22676]: cluster 2024-09-21T00:06:27.085595+0000 mgr.a (mgr.14388) 4841 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:27 smithi179 bash[23186]: audit 2024-09-21T00:06:26.572894+0000 mon.a (mon.0) 4463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:27 smithi179 bash[23186]: audit 2024-09-21T00:06:26.578498+0000 mon.a (mon.0) 4464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:27 smithi179 bash[23186]: audit 2024-09-21T00:06:26.584508+0000 mon.a (mon.0) 4465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:27 smithi179 bash[23186]: cluster 2024-09-21T00:06:27.085595+0000 mgr.a (mgr.14388) 4841 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:27 smithi049 bash[23528]: audit 2024-09-21T00:06:26.572894+0000 mon.a (mon.0) 4463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:27 smithi049 bash[23528]: audit 2024-09-21T00:06:26.578498+0000 mon.a (mon.0) 4464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:27 smithi049 bash[23528]: audit 2024-09-21T00:06:26.584508+0000 mon.a (mon.0) 4465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:27 smithi049 bash[23528]: cluster 2024-09-21T00:06:27.085595+0000 mgr.a (mgr.14388) 4841 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:30 smithi044 bash[22676]: cluster 2024-09-21T00:06:29.086374+0000 mgr.a (mgr.14388) 4842 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:30 smithi179 bash[23186]: cluster 2024-09-21T00:06:29.086374+0000 mgr.a (mgr.14388) 4842 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:30 smithi049 bash[23528]: cluster 2024-09-21T00:06:29.086374+0000 mgr.a (mgr.14388) 4842 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:30.689 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:31 smithi044 bash[22676]: audit 2024-09-21T00:06:30.274057+0000 mgr.a (mgr.14388) 4843 : audit [DBG] from='client.114336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:31 smithi179 bash[23186]: audit 2024-09-21T00:06:30.274057+0000 mgr.a (mgr.14388) 4843 : audit [DBG] from='client.114336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:31 smithi049 bash[23528]: audit 2024-09-21T00:06:30.274057+0000 mgr.a (mgr.14388) 4843 : audit [DBG] from='client.114336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:32 smithi044 bash[22676]: cluster 2024-09-21T00:06:31.089323+0000 mgr.a (mgr.14388) 4844 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:32 smithi179 bash[23186]: cluster 2024-09-21T00:06:31.089323+0000 mgr.a (mgr.14388) 4844 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:32 smithi049 bash[23528]: cluster 2024-09-21T00:06:31.089323+0000 mgr.a (mgr.14388) 4844 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:34 smithi044 bash[22676]: cluster 2024-09-21T00:06:33.090111+0000 mgr.a (mgr.14388) 4845 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:34 smithi179 bash[23186]: cluster 2024-09-21T00:06:33.090111+0000 mgr.a (mgr.14388) 4845 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:34 smithi049 bash[23528]: cluster 2024-09-21T00:06:33.090111+0000 mgr.a (mgr.14388) 4845 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:35.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:35.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:35.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:36.450 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:36.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:36.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:36.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:36.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:36 smithi044 bash[22676]: cluster 2024-09-21T00:06:35.091992+0000 mgr.a (mgr.14388) 4846 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:36 smithi179 bash[23186]: cluster 2024-09-21T00:06:35.091992+0000 mgr.a (mgr.14388) 4846 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:36 smithi049 bash[23528]: cluster 2024-09-21T00:06:35.091992+0000 mgr.a (mgr.14388) 4846 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:37 smithi044 bash[22676]: audit 2024-09-21T00:06:36.021094+0000 mgr.a (mgr.14388) 4847 : audit [DBG] from='client.114414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:37 smithi179 bash[23186]: audit 2024-09-21T00:06:36.021094+0000 mgr.a (mgr.14388) 4847 : audit [DBG] from='client.114414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:37 smithi049 bash[23528]: audit 2024-09-21T00:06:36.021094+0000 mgr.a (mgr.14388) 4847 : audit [DBG] from='client.114414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:38 smithi044 bash[22676]: cluster 2024-09-21T00:06:37.093141+0000 mgr.a (mgr.14388) 4848 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:38 smithi179 bash[23186]: cluster 2024-09-21T00:06:37.093141+0000 mgr.a (mgr.14388) 4848 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:38 smithi049 bash[23528]: cluster 2024-09-21T00:06:37.093141+0000 mgr.a (mgr.14388) 4848 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:40 smithi044 bash[22676]: cluster 2024-09-21T00:06:39.094119+0000 mgr.a (mgr.14388) 4849 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:40 smithi179 bash[23186]: cluster 2024-09-21T00:06:39.094119+0000 mgr.a (mgr.14388) 4849 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:40 smithi049 bash[23528]: cluster 2024-09-21T00:06:39.094119+0000 mgr.a (mgr.14388) 4849 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:06:41.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:41.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:41.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:41 smithi044 bash[22676]: audit 2024-09-21T00:06:40.854132+0000 mon.a (mon.0) 4466 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:06:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:41 smithi044 bash[22676]: audit 2024-09-21T00:06:40.861230+0000 mon.a (mon.0) 4467 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:06:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:41 smithi044 bash[22676]: audit 2024-09-21T00:06:40.863146+0000 mon.a (mon.0) 4468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:06:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:41 smithi044 bash[22676]: audit 2024-09-21T00:06:40.874269+0000 mon.a (mon.0) 4469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:41 smithi044 bash[22676]: audit 2024-09-21T00:06:40.880660+0000 mon.a (mon.0) 4470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:06:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:41 smithi179 bash[23186]: audit 2024-09-21T00:06:40.854132+0000 mon.a (mon.0) 4466 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:06:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:41 smithi179 bash[23186]: audit 2024-09-21T00:06:40.861230+0000 mon.a (mon.0) 4467 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:06:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:41 smithi179 bash[23186]: audit 2024-09-21T00:06:40.863146+0000 mon.a (mon.0) 4468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:06:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:41 smithi179 bash[23186]: audit 2024-09-21T00:06:40.874269+0000 mon.a (mon.0) 4469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:41 smithi179 bash[23186]: audit 2024-09-21T00:06:40.880660+0000 mon.a (mon.0) 4470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:06:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:41 smithi049 bash[23528]: audit 2024-09-21T00:06:40.854132+0000 mon.a (mon.0) 4466 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:06:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:41 smithi049 bash[23528]: audit 2024-09-21T00:06:40.861230+0000 mon.a (mon.0) 4467 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:06:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:41 smithi049 bash[23528]: audit 2024-09-21T00:06:40.863146+0000 mon.a (mon.0) 4468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:06:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:41 smithi049 bash[23528]: audit 2024-09-21T00:06:40.874269+0000 mon.a (mon.0) 4469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:41 smithi049 bash[23528]: audit 2024-09-21T00:06:40.880660+0000 mon.a (mon.0) 4470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:06:41.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:06:41 smithi044 bash[22930]: debug 2024-09-21T00:06:41.655+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:06:41.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:06:41 smithi044 bash[22930]: debug 2024-09-21T00:06:41.659+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:06:42.193 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:42 smithi044 bash[22676]: audit 2024-09-21T00:06:40.883099+0000 mgr.a (mgr.14388) 4850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:06:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:42 smithi044 bash[22676]: cluster 2024-09-21T00:06:41.095486+0000 mgr.a (mgr.14388) 4851 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:42 smithi179 bash[23186]: audit 2024-09-21T00:06:40.883099+0000 mgr.a (mgr.14388) 4850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:06:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:42 smithi179 bash[23186]: cluster 2024-09-21T00:06:41.095486+0000 mgr.a (mgr.14388) 4851 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:42.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:42 smithi049 bash[23528]: audit 2024-09-21T00:06:40.883099+0000 mgr.a (mgr.14388) 4850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:06:42.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:42 smithi049 bash[23528]: cluster 2024-09-21T00:06:41.095486+0000 mgr.a (mgr.14388) 4851 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:43.458 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:43 smithi179 bash[23186]: audit 2024-09-21T00:06:41.660383+0000 mgr.a (mgr.14388) 4852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:06:43.458 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:43 smithi179 bash[23186]: cephadm 2024-09-21T00:06:41.661914+0000 mgr.a (mgr.14388) 4853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:06:43.458 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:43 smithi179 bash[23186]: audit 2024-09-21T00:06:41.773052+0000 mgr.a (mgr.14388) 4854 : audit [DBG] from='client.114600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:43.459 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:43 smithi179 bash[23186]: audit 2024-09-21T00:06:42.237773+0000 mon.a (mon.0) 4471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.459 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:43 smithi179 bash[23186]: audit 2024-09-21T00:06:42.245182+0000 mon.a (mon.0) 4472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.459 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:43 smithi179 bash[23186]: audit 2024-09-21T00:06:42.252794+0000 mon.a (mon.0) 4473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:43 smithi044 bash[22676]: audit 2024-09-21T00:06:41.660383+0000 mgr.a (mgr.14388) 4852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:06:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:43 smithi044 bash[22676]: cephadm 2024-09-21T00:06:41.661914+0000 mgr.a (mgr.14388) 4853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:06:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:43 smithi044 bash[22676]: audit 2024-09-21T00:06:41.773052+0000 mgr.a (mgr.14388) 4854 : audit [DBG] from='client.114600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:43 smithi044 bash[22676]: audit 2024-09-21T00:06:42.237773+0000 mon.a (mon.0) 4471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:43 smithi044 bash[22676]: audit 2024-09-21T00:06:42.245182+0000 mon.a (mon.0) 4472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:43 smithi044 bash[22676]: audit 2024-09-21T00:06:42.252794+0000 mon.a (mon.0) 4473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:43 smithi049 bash[23528]: audit 2024-09-21T00:06:41.660383+0000 mgr.a (mgr.14388) 4852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:06:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:43 smithi049 bash[23528]: cephadm 2024-09-21T00:06:41.661914+0000 mgr.a (mgr.14388) 4853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:06:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:43 smithi049 bash[23528]: audit 2024-09-21T00:06:41.773052+0000 mgr.a (mgr.14388) 4854 : audit [DBG] from='client.114600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:43 smithi049 bash[23528]: audit 2024-09-21T00:06:42.237773+0000 mon.a (mon.0) 4471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:43 smithi049 bash[23528]: audit 2024-09-21T00:06:42.245182+0000 mon.a (mon.0) 4472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:43 smithi049 bash[23528]: audit 2024-09-21T00:06:42.252794+0000 mon.a (mon.0) 4473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:44.405 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:44 smithi044 bash[22676]: cluster 2024-09-21T00:06:43.096420+0000 mgr.a (mgr.14388) 4855 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:44 smithi179 bash[23186]: cluster 2024-09-21T00:06:43.096420+0000 mgr.a (mgr.14388) 4855 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:44.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:44 smithi049 bash[23528]: cluster 2024-09-21T00:06:43.096420+0000 mgr.a (mgr.14388) 4855 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:45 smithi044 bash[22676]: audit 2024-09-21T00:06:44.719822+0000 mon.a (mon.0) 4474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:45 smithi044 bash[22676]: audit 2024-09-21T00:06:44.728281+0000 mon.a (mon.0) 4475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:45 smithi044 bash[22676]: audit 2024-09-21T00:06:44.737834+0000 mon.a (mon.0) 4476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:45 smithi044 bash[22676]: cluster 2024-09-21T00:06:45.098606+0000 mgr.a (mgr.14388) 4856 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:45 smithi179 bash[23186]: audit 2024-09-21T00:06:44.719822+0000 mon.a (mon.0) 4474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:45 smithi179 bash[23186]: audit 2024-09-21T00:06:44.728281+0000 mon.a (mon.0) 4475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:45 smithi179 bash[23186]: audit 2024-09-21T00:06:44.737834+0000 mon.a (mon.0) 4476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:45 smithi179 bash[23186]: cluster 2024-09-21T00:06:45.098606+0000 mgr.a (mgr.14388) 4856 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:45 smithi049 bash[23528]: audit 2024-09-21T00:06:44.719822+0000 mon.a (mon.0) 4474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:45 smithi049 bash[23528]: audit 2024-09-21T00:06:44.728281+0000 mon.a (mon.0) 4475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:45 smithi049 bash[23528]: audit 2024-09-21T00:06:44.737834+0000 mon.a (mon.0) 4476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:45 smithi049 bash[23528]: cluster 2024-09-21T00:06:45.098606+0000 mgr.a (mgr.14388) 4856 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:47.980 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:47.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:47.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:47.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:47.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:47 smithi044 bash[22676]: audit 2024-09-21T00:06:46.781089+0000 mon.a (mon.0) 4477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:47 smithi044 bash[22676]: audit 2024-09-21T00:06:46.790206+0000 mon.a (mon.0) 4478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:47 smithi044 bash[22676]: audit 2024-09-21T00:06:46.799656+0000 mon.a (mon.0) 4479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:47 smithi044 bash[22676]: cluster 2024-09-21T00:06:47.099307+0000 mgr.a (mgr.14388) 4857 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:47 smithi049 bash[23528]: audit 2024-09-21T00:06:46.781089+0000 mon.a (mon.0) 4477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:47 smithi049 bash[23528]: audit 2024-09-21T00:06:46.790206+0000 mon.a (mon.0) 4478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:47 smithi049 bash[23528]: audit 2024-09-21T00:06:46.799656+0000 mon.a (mon.0) 4479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:47 smithi049 bash[23528]: cluster 2024-09-21T00:06:47.099307+0000 mgr.a (mgr.14388) 4857 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:47 smithi179 bash[23186]: audit 2024-09-21T00:06:46.781089+0000 mon.a (mon.0) 4477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:47 smithi179 bash[23186]: audit 2024-09-21T00:06:46.790206+0000 mon.a (mon.0) 4478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:47 smithi179 bash[23186]: audit 2024-09-21T00:06:46.799656+0000 mon.a (mon.0) 4479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:06:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:47 smithi179 bash[23186]: cluster 2024-09-21T00:06:47.099307+0000 mgr.a (mgr.14388) 4857 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:48 smithi049 bash[23528]: audit 2024-09-21T00:06:47.536022+0000 mgr.a (mgr.14388) 4858 : audit [DBG] from='client.114672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:48 smithi044 bash[22676]: audit 2024-09-21T00:06:47.536022+0000 mgr.a (mgr.14388) 4858 : audit [DBG] from='client.114672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:48 smithi179 bash[23186]: audit 2024-09-21T00:06:47.536022+0000 mgr.a (mgr.14388) 4858 : audit [DBG] from='client.114672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:49 smithi044 bash[22676]: cluster 2024-09-21T00:06:49.100293+0000 mgr.a (mgr.14388) 4859 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:49 smithi179 bash[23186]: cluster 2024-09-21T00:06:49.100293+0000 mgr.a (mgr.14388) 4859 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:49 smithi049 bash[23528]: cluster 2024-09-21T00:06:49.100293+0000 mgr.a (mgr.14388) 4859 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:52.447 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:52 smithi049 bash[23528]: cluster 2024-09-21T00:06:51.102541+0000 mgr.a (mgr.14388) 4860 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:52 smithi044 bash[22676]: cluster 2024-09-21T00:06:51.102541+0000 mgr.a (mgr.14388) 4860 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:52 smithi179 bash[23186]: cluster 2024-09-21T00:06:51.102541+0000 mgr.a (mgr.14388) 4860 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:52.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:52.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:52.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:53.746 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:53.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:53.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:53.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:53.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:06:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:54 smithi044 bash[22676]: cluster 2024-09-21T00:06:53.103087+0000 mgr.a (mgr.14388) 4861 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:54 smithi044 bash[22676]: audit 2024-09-21T00:06:53.317539+0000 mgr.a (mgr.14388) 4862 : audit [DBG] from='client.114750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:54 smithi179 bash[23186]: cluster 2024-09-21T00:06:53.103087+0000 mgr.a (mgr.14388) 4861 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:54 smithi179 bash[23186]: audit 2024-09-21T00:06:53.317539+0000 mgr.a (mgr.14388) 4862 : audit [DBG] from='client.114750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:54 smithi049 bash[23528]: cluster 2024-09-21T00:06:53.103087+0000 mgr.a (mgr.14388) 4861 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:54 smithi049 bash[23528]: audit 2024-09-21T00:06:53.317539+0000 mgr.a (mgr.14388) 4862 : audit [DBG] from='client.114750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:06:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:56 smithi044 bash[22676]: cluster 2024-09-21T00:06:55.105398+0000 mgr.a (mgr.14388) 4863 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:56 smithi179 bash[23186]: cluster 2024-09-21T00:06:55.105398+0000 mgr.a (mgr.14388) 4863 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:56 smithi049 bash[23528]: cluster 2024-09-21T00:06:55.105398+0000 mgr.a (mgr.14388) 4863 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:06:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:06:58 smithi044 bash[22676]: cluster 2024-09-21T00:06:57.106146+0000 mgr.a (mgr.14388) 4864 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:06:58 smithi179 bash[23186]: cluster 2024-09-21T00:06:57.106146+0000 mgr.a (mgr.14388) 4864 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:06:58 smithi049 bash[23528]: cluster 2024-09-21T00:06:57.106146+0000 mgr.a (mgr.14388) 4864 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:06:58.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:06:58.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:06:58.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:06:59.498 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:06:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:06:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:06:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:06:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:00 smithi044 bash[22676]: audit 2024-09-21T00:06:59.078192+0000 mgr.a (mgr.14388) 4865 : audit [DBG] from='client.114825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:00 smithi044 bash[22676]: cluster 2024-09-21T00:06:59.107194+0000 mgr.a (mgr.14388) 4866 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:00 smithi179 bash[23186]: audit 2024-09-21T00:06:59.078192+0000 mgr.a (mgr.14388) 4865 : audit [DBG] from='client.114825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:00 smithi179 bash[23186]: cluster 2024-09-21T00:06:59.107194+0000 mgr.a (mgr.14388) 4866 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:00 smithi049 bash[23528]: audit 2024-09-21T00:06:59.078192+0000 mgr.a (mgr.14388) 4865 : audit [DBG] from='client.114825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:00 smithi049 bash[23528]: cluster 2024-09-21T00:06:59.107194+0000 mgr.a (mgr.14388) 4866 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:02.450 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:02 smithi049 bash[23528]: cluster 2024-09-21T00:07:01.109574+0000 mgr.a (mgr.14388) 4867 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:02 smithi044 bash[22676]: cluster 2024-09-21T00:07:01.109574+0000 mgr.a (mgr.14388) 4867 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:02 smithi179 bash[23186]: cluster 2024-09-21T00:07:01.109574+0000 mgr.a (mgr.14388) 4867 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:03 smithi044 bash[22676]: audit 2024-09-21T00:07:02.433152+0000 mon.a (mon.0) 4480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:03 smithi044 bash[22676]: audit 2024-09-21T00:07:02.443417+0000 mon.a (mon.0) 4481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:03 smithi044 bash[22676]: audit 2024-09-21T00:07:02.454349+0000 mon.a (mon.0) 4482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:03 smithi044 bash[22676]: cluster 2024-09-21T00:07:03.110087+0000 mgr.a (mgr.14388) 4868 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:03 smithi179 bash[23186]: audit 2024-09-21T00:07:02.433152+0000 mon.a (mon.0) 4480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:03 smithi179 bash[23186]: audit 2024-09-21T00:07:02.443417+0000 mon.a (mon.0) 4481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:03 smithi179 bash[23186]: audit 2024-09-21T00:07:02.454349+0000 mon.a (mon.0) 4482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:03 smithi179 bash[23186]: cluster 2024-09-21T00:07:03.110087+0000 mgr.a (mgr.14388) 4868 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:03 smithi049 bash[23528]: audit 2024-09-21T00:07:02.433152+0000 mon.a (mon.0) 4480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:03 smithi049 bash[23528]: audit 2024-09-21T00:07:02.443417+0000 mon.a (mon.0) 4481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:03 smithi049 bash[23528]: audit 2024-09-21T00:07:02.454349+0000 mon.a (mon.0) 4482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:03 smithi049 bash[23528]: cluster 2024-09-21T00:07:03.110087+0000 mgr.a (mgr.14388) 4868 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:04.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:04.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:04.501 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:05.262 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:05.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:05.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:05.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:05.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:05 smithi044 bash[22676]: audit 2024-09-21T00:07:04.837197+0000 mgr.a (mgr.14388) 4869 : audit [DBG] from='client.114903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:05 smithi044 bash[22676]: audit 2024-09-21T00:07:04.873762+0000 mon.a (mon.0) 4483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:05 smithi044 bash[22676]: audit 2024-09-21T00:07:04.881346+0000 mon.a (mon.0) 4484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:05 smithi044 bash[22676]: audit 2024-09-21T00:07:04.887927+0000 mon.a (mon.0) 4485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:05 smithi044 bash[22676]: cluster 2024-09-21T00:07:05.111337+0000 mgr.a (mgr.14388) 4870 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:05 smithi179 bash[23186]: audit 2024-09-21T00:07:04.837197+0000 mgr.a (mgr.14388) 4869 : audit [DBG] from='client.114903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:05 smithi179 bash[23186]: audit 2024-09-21T00:07:04.873762+0000 mon.a (mon.0) 4483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:05 smithi179 bash[23186]: audit 2024-09-21T00:07:04.881346+0000 mon.a (mon.0) 4484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:05 smithi179 bash[23186]: audit 2024-09-21T00:07:04.887927+0000 mon.a (mon.0) 4485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:05 smithi179 bash[23186]: cluster 2024-09-21T00:07:05.111337+0000 mgr.a (mgr.14388) 4870 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:05 smithi049 bash[23528]: audit 2024-09-21T00:07:04.837197+0000 mgr.a (mgr.14388) 4869 : audit [DBG] from='client.114903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:05 smithi049 bash[23528]: audit 2024-09-21T00:07:04.873762+0000 mon.a (mon.0) 4483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:05 smithi049 bash[23528]: audit 2024-09-21T00:07:04.881346+0000 mon.a (mon.0) 4484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:05 smithi049 bash[23528]: audit 2024-09-21T00:07:04.887927+0000 mon.a (mon.0) 4485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:05 smithi049 bash[23528]: cluster 2024-09-21T00:07:05.111337+0000 mgr.a (mgr.14388) 4870 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:08 smithi179 bash[23186]: audit 2024-09-21T00:07:07.004550+0000 mon.a (mon.0) 4486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:08 smithi179 bash[23186]: audit 2024-09-21T00:07:07.010776+0000 mon.a (mon.0) 4487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:08 smithi179 bash[23186]: audit 2024-09-21T00:07:07.020847+0000 mon.a (mon.0) 4488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:08 smithi179 bash[23186]: cluster 2024-09-21T00:07:07.112207+0000 mgr.a (mgr.14388) 4871 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:08 smithi049 bash[23528]: audit 2024-09-21T00:07:07.004550+0000 mon.a (mon.0) 4486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:08 smithi049 bash[23528]: audit 2024-09-21T00:07:07.010776+0000 mon.a (mon.0) 4487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:08 smithi049 bash[23528]: audit 2024-09-21T00:07:07.020847+0000 mon.a (mon.0) 4488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:08 smithi049 bash[23528]: cluster 2024-09-21T00:07:07.112207+0000 mgr.a (mgr.14388) 4871 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:08 smithi044 bash[22676]: audit 2024-09-21T00:07:07.004550+0000 mon.a (mon.0) 4486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:08 smithi044 bash[22676]: audit 2024-09-21T00:07:07.010776+0000 mon.a (mon.0) 4487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:08 smithi044 bash[22676]: audit 2024-09-21T00:07:07.020847+0000 mon.a (mon.0) 4488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:08 smithi044 bash[22676]: cluster 2024-09-21T00:07:07.112207+0000 mgr.a (mgr.14388) 4871 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:10.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:10.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:10 smithi044 bash[22676]: cluster 2024-09-21T00:07:09.112998+0000 mgr.a (mgr.14388) 4872 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:10 smithi179 bash[23186]: cluster 2024-09-21T00:07:09.112998+0000 mgr.a (mgr.14388) 4872 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:10 smithi049 bash[23528]: cluster 2024-09-21T00:07:09.112998+0000 mgr.a (mgr.14388) 4872 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:11.019 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:11.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:11.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:11.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:11.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:12 smithi044 bash[22676]: audit 2024-09-21T00:07:10.590670+0000 mgr.a (mgr.14388) 4873 : audit [DBG] from='client.114981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:12 smithi044 bash[22676]: cluster 2024-09-21T00:07:11.115563+0000 mgr.a (mgr.14388) 4874 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:12 smithi179 bash[23186]: audit 2024-09-21T00:07:10.590670+0000 mgr.a (mgr.14388) 4873 : audit [DBG] from='client.114981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:12 smithi179 bash[23186]: cluster 2024-09-21T00:07:11.115563+0000 mgr.a (mgr.14388) 4874 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:12 smithi049 bash[23528]: audit 2024-09-21T00:07:10.590670+0000 mgr.a (mgr.14388) 4873 : audit [DBG] from='client.114981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:12 smithi049 bash[23528]: cluster 2024-09-21T00:07:11.115563+0000 mgr.a (mgr.14388) 4874 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:14 smithi044 bash[22676]: cluster 2024-09-21T00:07:13.116383+0000 mgr.a (mgr.14388) 4875 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:14 smithi179 bash[23186]: cluster 2024-09-21T00:07:13.116383+0000 mgr.a (mgr.14388) 4875 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:14 smithi049 bash[23528]: cluster 2024-09-21T00:07:13.116383+0000 mgr.a (mgr.14388) 4875 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:07:16.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:16.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:16.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:16 smithi044 bash[22676]: cluster 2024-09-21T00:07:15.118356+0000 mgr.a (mgr.14388) 4876 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:16 smithi179 bash[23186]: cluster 2024-09-21T00:07:15.118356+0000 mgr.a (mgr.14388) 4876 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:16 smithi049 bash[23528]: cluster 2024-09-21T00:07:15.118356+0000 mgr.a (mgr.14388) 4876 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:16.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:16.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:17 smithi044 bash[22676]: audit 2024-09-21T00:07:16.351658+0000 mgr.a (mgr.14388) 4877 : audit [DBG] from='client.115056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:17 smithi179 bash[23186]: audit 2024-09-21T00:07:16.351658+0000 mgr.a (mgr.14388) 4877 : audit [DBG] from='client.115056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:17 smithi049 bash[23528]: audit 2024-09-21T00:07:16.351658+0000 mgr.a (mgr.14388) 4877 : audit [DBG] from='client.115056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:18 smithi044 bash[22676]: cluster 2024-09-21T00:07:17.119471+0000 mgr.a (mgr.14388) 4878 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:18 smithi179 bash[23186]: cluster 2024-09-21T00:07:17.119471+0000 mgr.a (mgr.14388) 4878 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:18 smithi049 bash[23528]: cluster 2024-09-21T00:07:17.119471+0000 mgr.a (mgr.14388) 4878 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:20 smithi044 bash[22676]: cluster 2024-09-21T00:07:19.120330+0000 mgr.a (mgr.14388) 4879 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:20 smithi179 bash[23186]: cluster 2024-09-21T00:07:19.120330+0000 mgr.a (mgr.14388) 4879 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:20.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:20 smithi049 bash[23528]: cluster 2024-09-21T00:07:19.120330+0000 mgr.a (mgr.14388) 4879 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:21.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:21.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:21.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:22 smithi044 bash[22676]: cluster 2024-09-21T00:07:21.122671+0000 mgr.a (mgr.14388) 4880 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:22 smithi179 bash[23186]: cluster 2024-09-21T00:07:21.122671+0000 mgr.a (mgr.14388) 4880 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:22 smithi049 bash[23528]: cluster 2024-09-21T00:07:21.122671+0000 mgr.a (mgr.14388) 4880 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:22.561 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:22.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:23 smithi044 bash[22676]: audit 2024-09-21T00:07:22.119125+0000 mgr.a (mgr.14388) 4881 : audit [DBG] from='client.115134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:23 smithi044 bash[22676]: audit 2024-09-21T00:07:22.621931+0000 mon.a (mon.0) 4489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:23 smithi044 bash[22676]: audit 2024-09-21T00:07:22.627938+0000 mon.a (mon.0) 4490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:23 smithi044 bash[22676]: audit 2024-09-21T00:07:22.634101+0000 mon.a (mon.0) 4491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:23 smithi179 bash[23186]: audit 2024-09-21T00:07:22.119125+0000 mgr.a (mgr.14388) 4881 : audit [DBG] from='client.115134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:23 smithi179 bash[23186]: audit 2024-09-21T00:07:22.621931+0000 mon.a (mon.0) 4489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:23 smithi179 bash[23186]: audit 2024-09-21T00:07:22.627938+0000 mon.a (mon.0) 4490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:23 smithi179 bash[23186]: audit 2024-09-21T00:07:22.634101+0000 mon.a (mon.0) 4491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.510 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:23 smithi049 bash[23528]: audit 2024-09-21T00:07:22.119125+0000 mgr.a (mgr.14388) 4881 : audit [DBG] from='client.115134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:23.511 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:23 smithi049 bash[23528]: audit 2024-09-21T00:07:22.621931+0000 mon.a (mon.0) 4489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.511 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:23 smithi049 bash[23528]: audit 2024-09-21T00:07:22.627938+0000 mon.a (mon.0) 4490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:23.511 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:23 smithi049 bash[23528]: audit 2024-09-21T00:07:22.634101+0000 mon.a (mon.0) 4491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:24.463 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:24 smithi179 bash[23186]: cluster 2024-09-21T00:07:23.123645+0000 mgr.a (mgr.14388) 4882 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:24 smithi044 bash[22676]: cluster 2024-09-21T00:07:23.123645+0000 mgr.a (mgr.14388) 4882 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:24.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:24 smithi049 bash[23528]: cluster 2024-09-21T00:07:23.123645+0000 mgr.a (mgr.14388) 4882 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:26 smithi044 bash[22676]: audit 2024-09-21T00:07:25.036551+0000 mon.a (mon.0) 4492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:26 smithi044 bash[22676]: audit 2024-09-21T00:07:25.045135+0000 mon.a (mon.0) 4493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:26 smithi044 bash[22676]: audit 2024-09-21T00:07:25.053751+0000 mon.a (mon.0) 4494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:26 smithi044 bash[22676]: cluster 2024-09-21T00:07:25.125655+0000 mgr.a (mgr.14388) 4883 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:26 smithi049 bash[23528]: audit 2024-09-21T00:07:25.036551+0000 mon.a (mon.0) 4492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:26 smithi049 bash[23528]: audit 2024-09-21T00:07:25.045135+0000 mon.a (mon.0) 4493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:26 smithi049 bash[23528]: audit 2024-09-21T00:07:25.053751+0000 mon.a (mon.0) 4494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:26 smithi049 bash[23528]: cluster 2024-09-21T00:07:25.125655+0000 mgr.a (mgr.14388) 4883 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:26 smithi179 bash[23186]: audit 2024-09-21T00:07:25.036551+0000 mon.a (mon.0) 4492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:26 smithi179 bash[23186]: audit 2024-09-21T00:07:25.045135+0000 mon.a (mon.0) 4493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:26 smithi179 bash[23186]: audit 2024-09-21T00:07:25.053751+0000 mon.a (mon.0) 4494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:26 smithi179 bash[23186]: cluster 2024-09-21T00:07:25.125655+0000 mgr.a (mgr.14388) 4883 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:27.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:27.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:28.352 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:28.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:28.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:28.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:28.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:28 smithi044 bash[22676]: cluster 2024-09-21T00:07:27.126240+0000 mgr.a (mgr.14388) 4884 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:28 smithi044 bash[22676]: audit 2024-09-21T00:07:27.212676+0000 mon.a (mon.0) 4495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:28 smithi044 bash[22676]: audit 2024-09-21T00:07:27.220271+0000 mon.a (mon.0) 4496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:28 smithi044 bash[22676]: audit 2024-09-21T00:07:27.231305+0000 mon.a (mon.0) 4497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:28 smithi179 bash[23186]: cluster 2024-09-21T00:07:27.126240+0000 mgr.a (mgr.14388) 4884 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:28 smithi179 bash[23186]: audit 2024-09-21T00:07:27.212676+0000 mon.a (mon.0) 4495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:28 smithi179 bash[23186]: audit 2024-09-21T00:07:27.220271+0000 mon.a (mon.0) 4496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:28 smithi179 bash[23186]: audit 2024-09-21T00:07:27.231305+0000 mon.a (mon.0) 4497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:28 smithi049 bash[23528]: cluster 2024-09-21T00:07:27.126240+0000 mgr.a (mgr.14388) 4884 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:28 smithi049 bash[23528]: audit 2024-09-21T00:07:27.212676+0000 mon.a (mon.0) 4495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:28 smithi049 bash[23528]: audit 2024-09-21T00:07:27.220271+0000 mon.a (mon.0) 4496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:28 smithi049 bash[23528]: audit 2024-09-21T00:07:27.231305+0000 mon.a (mon.0) 4497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:29 smithi044 bash[22676]: audit 2024-09-21T00:07:27.900946+0000 mgr.a (mgr.14388) 4885 : audit [DBG] from='client.115212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:29 smithi179 bash[23186]: audit 2024-09-21T00:07:27.900946+0000 mgr.a (mgr.14388) 4885 : audit [DBG] from='client.115212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:29 smithi049 bash[23528]: audit 2024-09-21T00:07:27.900946+0000 mgr.a (mgr.14388) 4885 : audit [DBG] from='client.115212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:30 smithi044 bash[22676]: cluster 2024-09-21T00:07:29.127214+0000 mgr.a (mgr.14388) 4886 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:30 smithi179 bash[23186]: cluster 2024-09-21T00:07:29.127214+0000 mgr.a (mgr.14388) 4886 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:30 smithi049 bash[23528]: cluster 2024-09-21T00:07:29.127214+0000 mgr.a (mgr.14388) 4886 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:32 smithi044 bash[22676]: cluster 2024-09-21T00:07:31.129491+0000 mgr.a (mgr.14388) 4887 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:32 smithi179 bash[23186]: cluster 2024-09-21T00:07:31.129491+0000 mgr.a (mgr.14388) 4887 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:32 smithi049 bash[23528]: cluster 2024-09-21T00:07:31.129491+0000 mgr.a (mgr.14388) 4887 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:33.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:33.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:34.126 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:34.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:34.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:34.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:34.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:34 smithi044 bash[22676]: cluster 2024-09-21T00:07:33.130250+0000 mgr.a (mgr.14388) 4888 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:34 smithi179 bash[23186]: cluster 2024-09-21T00:07:33.130250+0000 mgr.a (mgr.14388) 4888 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:34 smithi049 bash[23528]: cluster 2024-09-21T00:07:33.130250+0000 mgr.a (mgr.14388) 4888 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:35 smithi179 bash[23186]: audit 2024-09-21T00:07:33.694162+0000 mgr.a (mgr.14388) 4889 : audit [DBG] from='client.115284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:35 smithi049 bash[23528]: audit 2024-09-21T00:07:33.694162+0000 mgr.a (mgr.14388) 4889 : audit [DBG] from='client.115284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:35 smithi044 bash[22676]: audit 2024-09-21T00:07:33.694162+0000 mgr.a (mgr.14388) 4889 : audit [DBG] from='client.115284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:36 smithi179 bash[23186]: cluster 2024-09-21T00:07:35.132598+0000 mgr.a (mgr.14388) 4890 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:36 smithi049 bash[23528]: cluster 2024-09-21T00:07:35.132598+0000 mgr.a (mgr.14388) 4890 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:36 smithi044 bash[22676]: cluster 2024-09-21T00:07:35.132598+0000 mgr.a (mgr.14388) 4890 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:38 smithi179 bash[23186]: cluster 2024-09-21T00:07:37.133412+0000 mgr.a (mgr.14388) 4891 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:38 smithi049 bash[23528]: cluster 2024-09-21T00:07:37.133412+0000 mgr.a (mgr.14388) 4891 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:38 smithi044 bash[22676]: cluster 2024-09-21T00:07:37.133412+0000 mgr.a (mgr.14388) 4891 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:39.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:39.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:39.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:39.920 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:39.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:39.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:39.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:39.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:40 smithi049 bash[23528]: cluster 2024-09-21T00:07:39.134132+0000 mgr.a (mgr.14388) 4892 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:40 smithi044 bash[22676]: cluster 2024-09-21T00:07:39.134132+0000 mgr.a (mgr.14388) 4892 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:40 smithi179 bash[23186]: cluster 2024-09-21T00:07:39.134132+0000 mgr.a (mgr.14388) 4892 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:41 smithi049 bash[23528]: audit 2024-09-21T00:07:39.465046+0000 mgr.a (mgr.14388) 4893 : audit [DBG] from='client.115362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:41 smithi044 bash[22676]: audit 2024-09-21T00:07:39.465046+0000 mgr.a (mgr.14388) 4893 : audit [DBG] from='client.115362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:41 smithi179 bash[23186]: audit 2024-09-21T00:07:39.465046+0000 mgr.a (mgr.14388) 4893 : audit [DBG] from='client.115362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:42.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22676]: cluster 2024-09-21T00:07:41.136521+0000 mgr.a (mgr.14388) 4894 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:42.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22676]: audit 2024-09-21T00:07:41.719767+0000 mon.a (mon.0) 4498 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:07:42.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22676]: audit 2024-09-21T00:07:41.731436+0000 mon.a (mon.0) 4499 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:07:42.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22676]: audit 2024-09-21T00:07:41.733478+0000 mon.a (mon.0) 4500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:07:42.540 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22676]: audit 2024-09-21T00:07:41.746570+0000 mon.a (mon.0) 4501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:42.540 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22676]: audit 2024-09-21T00:07:41.752836+0000 mon.a (mon.0) 4502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:07:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:42 smithi049 bash[23528]: cluster 2024-09-21T00:07:41.136521+0000 mgr.a (mgr.14388) 4894 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:42 smithi049 bash[23528]: audit 2024-09-21T00:07:41.719767+0000 mon.a (mon.0) 4498 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:07:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:42 smithi049 bash[23528]: audit 2024-09-21T00:07:41.731436+0000 mon.a (mon.0) 4499 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:07:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:42 smithi049 bash[23528]: audit 2024-09-21T00:07:41.733478+0000 mon.a (mon.0) 4500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:07:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:42 smithi049 bash[23528]: audit 2024-09-21T00:07:41.746570+0000 mon.a (mon.0) 4501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:42 smithi049 bash[23528]: audit 2024-09-21T00:07:41.752836+0000 mon.a (mon.0) 4502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:07:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:42 smithi179 bash[23186]: cluster 2024-09-21T00:07:41.136521+0000 mgr.a (mgr.14388) 4894 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:07:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:42 smithi179 bash[23186]: audit 2024-09-21T00:07:41.719767+0000 mon.a (mon.0) 4498 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:07:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:42 smithi179 bash[23186]: audit 2024-09-21T00:07:41.731436+0000 mon.a (mon.0) 4499 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:07:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:42 smithi179 bash[23186]: audit 2024-09-21T00:07:41.733478+0000 mon.a (mon.0) 4500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:07:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:42 smithi179 bash[23186]: audit 2024-09-21T00:07:41.746570+0000 mon.a (mon.0) 4501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:42 smithi179 bash[23186]: audit 2024-09-21T00:07:41.752836+0000 mon.a (mon.0) 4502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:07:42.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22930]: debug 2024-09-21T00:07:42.534+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:07:42.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:07:42 smithi044 bash[22930]: debug 2024-09-21T00:07:42.534+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:07:43.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:43 smithi179 bash[23186]: audit 2024-09-21T00:07:41.755252+0000 mgr.a (mgr.14388) 4895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:07:43.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:43 smithi179 bash[23186]: audit 2024-09-21T00:07:42.843926+0000 mon.a (mon.0) 4503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:43 smithi179 bash[23186]: audit 2024-09-21T00:07:42.853568+0000 mon.a (mon.0) 4504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:43 smithi179 bash[23186]: audit 2024-09-21T00:07:42.863905+0000 mon.a (mon.0) 4505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:43 smithi049 bash[23528]: audit 2024-09-21T00:07:41.755252+0000 mgr.a (mgr.14388) 4895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:07:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:43 smithi049 bash[23528]: audit 2024-09-21T00:07:42.843926+0000 mon.a (mon.0) 4503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:43 smithi049 bash[23528]: audit 2024-09-21T00:07:42.853568+0000 mon.a (mon.0) 4504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:43 smithi049 bash[23528]: audit 2024-09-21T00:07:42.863905+0000 mon.a (mon.0) 4505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:43 smithi044 bash[22676]: audit 2024-09-21T00:07:41.755252+0000 mgr.a (mgr.14388) 4895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:07:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:43 smithi044 bash[22676]: audit 2024-09-21T00:07:42.843926+0000 mon.a (mon.0) 4503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:43 smithi044 bash[22676]: audit 2024-09-21T00:07:42.853568+0000 mon.a (mon.0) 4504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:43 smithi044 bash[22676]: audit 2024-09-21T00:07:42.863905+0000 mon.a (mon.0) 4505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:44.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:44 smithi044 bash[22676]: audit 2024-09-21T00:07:42.539378+0000 mgr.a (mgr.14388) 4896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:07:44.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:44 smithi044 bash[22676]: cephadm 2024-09-21T00:07:42.540838+0000 mgr.a (mgr.14388) 4897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:07:44.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:44 smithi044 bash[22676]: cluster 2024-09-21T00:07:43.137504+0000 mgr.a (mgr.14388) 4898 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:44.544 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:44 smithi179 bash[23186]: audit 2024-09-21T00:07:42.539378+0000 mgr.a (mgr.14388) 4896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:07:44.544 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:44 smithi179 bash[23186]: cephadm 2024-09-21T00:07:42.540838+0000 mgr.a (mgr.14388) 4897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:07:44.544 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:44 smithi179 bash[23186]: cluster 2024-09-21T00:07:43.137504+0000 mgr.a (mgr.14388) 4898 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:44 smithi049 bash[23528]: audit 2024-09-21T00:07:42.539378+0000 mgr.a (mgr.14388) 4896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:07:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:44 smithi049 bash[23528]: cephadm 2024-09-21T00:07:42.540838+0000 mgr.a (mgr.14388) 4897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:07:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:44 smithi049 bash[23528]: cluster 2024-09-21T00:07:43.137504+0000 mgr.a (mgr.14388) 4898 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:44.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:44.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:44.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:45.701 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:45.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:45.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:45.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:45.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:46.474 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:46 smithi044 bash[22676]: cluster 2024-09-21T00:07:45.139604+0000 mgr.a (mgr.14388) 4899 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:46.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:46 smithi044 bash[22676]: audit 2024-09-21T00:07:45.220953+0000 mon.a (mon.0) 4506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:46 smithi044 bash[22676]: audit 2024-09-21T00:07:45.227213+0000 mon.a (mon.0) 4507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:46 smithi044 bash[22676]: audit 2024-09-21T00:07:45.235118+0000 mon.a (mon.0) 4508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:46 smithi044 bash[22676]: audit 2024-09-21T00:07:45.260927+0000 mgr.a (mgr.14388) 4900 : audit [DBG] from='client.115548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:46 smithi179 bash[23186]: cluster 2024-09-21T00:07:45.139604+0000 mgr.a (mgr.14388) 4899 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:46 smithi179 bash[23186]: audit 2024-09-21T00:07:45.220953+0000 mon.a (mon.0) 4506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:46 smithi179 bash[23186]: audit 2024-09-21T00:07:45.227213+0000 mon.a (mon.0) 4507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:46 smithi179 bash[23186]: audit 2024-09-21T00:07:45.235118+0000 mon.a (mon.0) 4508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:46 smithi179 bash[23186]: audit 2024-09-21T00:07:45.260927+0000 mgr.a (mgr.14388) 4900 : audit [DBG] from='client.115548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:46 smithi049 bash[23528]: cluster 2024-09-21T00:07:45.139604+0000 mgr.a (mgr.14388) 4899 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:46 smithi049 bash[23528]: audit 2024-09-21T00:07:45.220953+0000 mon.a (mon.0) 4506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:46 smithi049 bash[23528]: audit 2024-09-21T00:07:45.227213+0000 mon.a (mon.0) 4507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:46 smithi049 bash[23528]: audit 2024-09-21T00:07:45.235118+0000 mon.a (mon.0) 4508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:46 smithi049 bash[23528]: audit 2024-09-21T00:07:45.260927+0000 mgr.a (mgr.14388) 4900 : audit [DBG] from='client.115548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:48 smithi044 bash[22676]: cluster 2024-09-21T00:07:47.140450+0000 mgr.a (mgr.14388) 4901 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:48 smithi044 bash[22676]: audit 2024-09-21T00:07:47.415648+0000 mon.a (mon.0) 4509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:48 smithi044 bash[22676]: audit 2024-09-21T00:07:47.423674+0000 mon.a (mon.0) 4510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:48 smithi044 bash[22676]: audit 2024-09-21T00:07:47.433833+0000 mon.a (mon.0) 4511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:48 smithi179 bash[23186]: cluster 2024-09-21T00:07:47.140450+0000 mgr.a (mgr.14388) 4901 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:48 smithi179 bash[23186]: audit 2024-09-21T00:07:47.415648+0000 mon.a (mon.0) 4509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:48 smithi179 bash[23186]: audit 2024-09-21T00:07:47.423674+0000 mon.a (mon.0) 4510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:48 smithi179 bash[23186]: audit 2024-09-21T00:07:47.433833+0000 mon.a (mon.0) 4511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:48 smithi049 bash[23528]: cluster 2024-09-21T00:07:47.140450+0000 mgr.a (mgr.14388) 4901 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:48 smithi049 bash[23528]: audit 2024-09-21T00:07:47.415648+0000 mon.a (mon.0) 4509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:48 smithi049 bash[23528]: audit 2024-09-21T00:07:47.423674+0000 mon.a (mon.0) 4510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:48 smithi049 bash[23528]: audit 2024-09-21T00:07:47.433833+0000 mon.a (mon.0) 4511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:07:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:50 smithi044 bash[22676]: cluster 2024-09-21T00:07:49.141426+0000 mgr.a (mgr.14388) 4902 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:50 smithi179 bash[23186]: cluster 2024-09-21T00:07:49.141426+0000 mgr.a (mgr.14388) 4902 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:50 smithi049 bash[23528]: cluster 2024-09-21T00:07:49.141426+0000 mgr.a (mgr.14388) 4902 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:51.480 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:51.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:51.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:51.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:51.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:52 smithi044 bash[22676]: audit 2024-09-21T00:07:51.038845+0000 mgr.a (mgr.14388) 4903 : audit [DBG] from='client.115626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:52 smithi044 bash[22676]: cluster 2024-09-21T00:07:51.142775+0000 mgr.a (mgr.14388) 4904 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:52 smithi179 bash[23186]: audit 2024-09-21T00:07:51.038845+0000 mgr.a (mgr.14388) 4903 : audit [DBG] from='client.115626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:52 smithi179 bash[23186]: cluster 2024-09-21T00:07:51.142775+0000 mgr.a (mgr.14388) 4904 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:52 smithi049 bash[23528]: audit 2024-09-21T00:07:51.038845+0000 mgr.a (mgr.14388) 4903 : audit [DBG] from='client.115626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:52 smithi049 bash[23528]: cluster 2024-09-21T00:07:51.142775+0000 mgr.a (mgr.14388) 4904 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:54 smithi179 bash[23186]: cluster 2024-09-21T00:07:53.143677+0000 mgr.a (mgr.14388) 4905 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:54 smithi049 bash[23528]: cluster 2024-09-21T00:07:53.143677+0000 mgr.a (mgr.14388) 4905 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:54 smithi044 bash[22676]: cluster 2024-09-21T00:07:53.143677+0000 mgr.a (mgr.14388) 4905 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:07:56.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:07:56.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:07:56.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:07:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:56 smithi179 bash[23186]: cluster 2024-09-21T00:07:55.145854+0000 mgr.a (mgr.14388) 4906 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:56 smithi049 bash[23528]: cluster 2024-09-21T00:07:55.145854+0000 mgr.a (mgr.14388) 4906 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:56 smithi044 bash[22676]: cluster 2024-09-21T00:07:55.145854+0000 mgr.a (mgr.14388) 4906 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:07:57.251 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:07:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:07:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:07:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:07:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:07:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:58 smithi179 bash[23186]: audit 2024-09-21T00:07:56.819070+0000 mgr.a (mgr.14388) 4907 : audit [DBG] from='client.115704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:07:58 smithi179 bash[23186]: cluster 2024-09-21T00:07:57.153422+0000 mgr.a (mgr.14388) 4908 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:58 smithi049 bash[23528]: audit 2024-09-21T00:07:56.819070+0000 mgr.a (mgr.14388) 4907 : audit [DBG] from='client.115704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:07:58 smithi049 bash[23528]: cluster 2024-09-21T00:07:57.153422+0000 mgr.a (mgr.14388) 4908 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:07:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:58 smithi044 bash[22676]: audit 2024-09-21T00:07:56.819070+0000 mgr.a (mgr.14388) 4907 : audit [DBG] from='client.115704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:07:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:07:58 smithi044 bash[22676]: cluster 2024-09-21T00:07:57.153422+0000 mgr.a (mgr.14388) 4908 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:00 smithi179 bash[23186]: cluster 2024-09-21T00:07:59.154179+0000 mgr.a (mgr.14388) 4909 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:00 smithi049 bash[23528]: cluster 2024-09-21T00:07:59.154179+0000 mgr.a (mgr.14388) 4909 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:00 smithi044 bash[22676]: cluster 2024-09-21T00:07:59.154179+0000 mgr.a (mgr.14388) 4909 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:02.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:02 smithi049 bash[23528]: cluster 2024-09-21T00:08:01.156496+0000 mgr.a (mgr.14388) 4910 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:02 smithi044 bash[22676]: cluster 2024-09-21T00:08:01.156496+0000 mgr.a (mgr.14388) 4910 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:02 smithi179 bash[23186]: cluster 2024-09-21T00:08:01.156496+0000 mgr.a (mgr.14388) 4910 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:03.033 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:03.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:03.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:03.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:03.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:04.270 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:04 smithi044 bash[22676]: audit 2024-09-21T00:08:02.590719+0000 mgr.a (mgr.14388) 4911 : audit [DBG] from='client.115782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:04.270 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:04 smithi044 bash[22676]: audit 2024-09-21T00:08:03.012929+0000 mon.a (mon.0) 4512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.270 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:04 smithi044 bash[22676]: audit 2024-09-21T00:08:03.018242+0000 mon.a (mon.0) 4513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.270 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:04 smithi044 bash[22676]: audit 2024-09-21T00:08:03.025413+0000 mon.a (mon.0) 4514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.271 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:04 smithi044 bash[22676]: cluster 2024-09-21T00:08:03.157294+0000 mgr.a (mgr.14388) 4912 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:04.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:04 smithi049 bash[23528]: audit 2024-09-21T00:08:02.590719+0000 mgr.a (mgr.14388) 4911 : audit [DBG] from='client.115782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:04.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:04 smithi049 bash[23528]: audit 2024-09-21T00:08:03.012929+0000 mon.a (mon.0) 4512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:04 smithi049 bash[23528]: audit 2024-09-21T00:08:03.018242+0000 mon.a (mon.0) 4513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:04 smithi049 bash[23528]: audit 2024-09-21T00:08:03.025413+0000 mon.a (mon.0) 4514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:04 smithi049 bash[23528]: cluster 2024-09-21T00:08:03.157294+0000 mgr.a (mgr.14388) 4912 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:04.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:04 smithi179 bash[23186]: audit 2024-09-21T00:08:02.590719+0000 mgr.a (mgr.14388) 4911 : audit [DBG] from='client.115782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:04.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:04 smithi179 bash[23186]: audit 2024-09-21T00:08:03.012929+0000 mon.a (mon.0) 4512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:04 smithi179 bash[23186]: audit 2024-09-21T00:08:03.018242+0000 mon.a (mon.0) 4513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:04 smithi179 bash[23186]: audit 2024-09-21T00:08:03.025413+0000 mon.a (mon.0) 4514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:04.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:04 smithi179 bash[23186]: cluster 2024-09-21T00:08:03.157294+0000 mgr.a (mgr.14388) 4912 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:06 smithi044 bash[22676]: cluster 2024-09-21T00:08:05.159594+0000 mgr.a (mgr.14388) 4913 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:06 smithi044 bash[22676]: audit 2024-09-21T00:08:05.393264+0000 mon.a (mon.0) 4515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:06 smithi044 bash[22676]: audit 2024-09-21T00:08:05.401735+0000 mon.a (mon.0) 4516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:06 smithi044 bash[22676]: audit 2024-09-21T00:08:05.411806+0000 mon.a (mon.0) 4517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:06 smithi179 bash[23186]: cluster 2024-09-21T00:08:05.159594+0000 mgr.a (mgr.14388) 4913 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:06 smithi179 bash[23186]: audit 2024-09-21T00:08:05.393264+0000 mon.a (mon.0) 4515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:06 smithi179 bash[23186]: audit 2024-09-21T00:08:05.401735+0000 mon.a (mon.0) 4516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:06 smithi179 bash[23186]: audit 2024-09-21T00:08:05.411806+0000 mon.a (mon.0) 4517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:06 smithi049 bash[23528]: cluster 2024-09-21T00:08:05.159594+0000 mgr.a (mgr.14388) 4913 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:06 smithi049 bash[23528]: audit 2024-09-21T00:08:05.393264+0000 mon.a (mon.0) 4515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:06 smithi049 bash[23528]: audit 2024-09-21T00:08:05.401735+0000 mon.a (mon.0) 4516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:06 smithi049 bash[23528]: audit 2024-09-21T00:08:05.411806+0000 mon.a (mon.0) 4517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:08.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:08.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:08 smithi044 bash[22676]: cluster 2024-09-21T00:08:07.160453+0000 mgr.a (mgr.14388) 4914 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:08 smithi044 bash[22676]: audit 2024-09-21T00:08:07.604252+0000 mon.a (mon.0) 4518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:08 smithi044 bash[22676]: audit 2024-09-21T00:08:07.612626+0000 mon.a (mon.0) 4519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:08 smithi044 bash[22676]: audit 2024-09-21T00:08:07.622815+0000 mon.a (mon.0) 4520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:08 smithi179 bash[23186]: cluster 2024-09-21T00:08:07.160453+0000 mgr.a (mgr.14388) 4914 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:08 smithi179 bash[23186]: audit 2024-09-21T00:08:07.604252+0000 mon.a (mon.0) 4518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:08 smithi179 bash[23186]: audit 2024-09-21T00:08:07.612626+0000 mon.a (mon.0) 4519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:08 smithi179 bash[23186]: audit 2024-09-21T00:08:07.622815+0000 mon.a (mon.0) 4520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:08 smithi049 bash[23528]: cluster 2024-09-21T00:08:07.160453+0000 mgr.a (mgr.14388) 4914 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:08 smithi049 bash[23528]: audit 2024-09-21T00:08:07.604252+0000 mon.a (mon.0) 4518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:08 smithi049 bash[23528]: audit 2024-09-21T00:08:07.612626+0000 mon.a (mon.0) 4519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:08 smithi049 bash[23528]: audit 2024-09-21T00:08:07.622815+0000 mon.a (mon.0) 4520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:08.819 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:08.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:09 smithi044 bash[22676]: audit 2024-09-21T00:08:08.372808+0000 mgr.a (mgr.14388) 4915 : audit [DBG] from='client.115860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:09 smithi179 bash[23186]: audit 2024-09-21T00:08:08.372808+0000 mgr.a (mgr.14388) 4915 : audit [DBG] from='client.115860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:09 smithi049 bash[23528]: audit 2024-09-21T00:08:08.372808+0000 mgr.a (mgr.14388) 4915 : audit [DBG] from='client.115860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:10 smithi044 bash[22676]: cluster 2024-09-21T00:08:09.161519+0000 mgr.a (mgr.14388) 4916 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:10 smithi179 bash[23186]: cluster 2024-09-21T00:08:09.161519+0000 mgr.a (mgr.14388) 4916 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:10.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:10 smithi049 bash[23528]: cluster 2024-09-21T00:08:09.161519+0000 mgr.a (mgr.14388) 4916 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:12 smithi044 bash[22676]: cluster 2024-09-21T00:08:11.163796+0000 mgr.a (mgr.14388) 4917 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:12 smithi179 bash[23186]: cluster 2024-09-21T00:08:11.163796+0000 mgr.a (mgr.14388) 4917 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:12 smithi049 bash[23528]: cluster 2024-09-21T00:08:11.163796+0000 mgr.a (mgr.14388) 4917 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:13.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:13.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:13.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:14 smithi179 bash[23186]: cluster 2024-09-21T00:08:13.164550+0000 mgr.a (mgr.14388) 4918 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:14 smithi049 bash[23528]: cluster 2024-09-21T00:08:13.164550+0000 mgr.a (mgr.14388) 4918 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:14.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:14.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:14.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:14.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:14.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:14 smithi044 bash[22676]: cluster 2024-09-21T00:08:13.164550+0000 mgr.a (mgr.14388) 4918 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:15 smithi179 bash[23186]: audit 2024-09-21T00:08:14.159161+0000 mgr.a (mgr.14388) 4919 : audit [DBG] from='client.115932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:15 smithi049 bash[23528]: audit 2024-09-21T00:08:14.159161+0000 mgr.a (mgr.14388) 4919 : audit [DBG] from='client.115932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:15 smithi044 bash[22676]: audit 2024-09-21T00:08:14.159161+0000 mgr.a (mgr.14388) 4919 : audit [DBG] from='client.115932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:16 smithi049 bash[23528]: cluster 2024-09-21T00:08:15.166908+0000 mgr.a (mgr.14388) 4920 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:16 smithi044 bash[22676]: cluster 2024-09-21T00:08:15.166908+0000 mgr.a (mgr.14388) 4920 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:16 smithi179 bash[23186]: cluster 2024-09-21T00:08:15.166908+0000 mgr.a (mgr.14388) 4920 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:18.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:18 smithi049 bash[23528]: cluster 2024-09-21T00:08:17.167710+0000 mgr.a (mgr.14388) 4921 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:18 smithi044 bash[22676]: cluster 2024-09-21T00:08:17.167710+0000 mgr.a (mgr.14388) 4921 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:18 smithi179 bash[23186]: cluster 2024-09-21T00:08:17.167710+0000 mgr.a (mgr.14388) 4921 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:19.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:19.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:20.387 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:20.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:20.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:20.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:20.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:20 smithi049 bash[23528]: cluster 2024-09-21T00:08:19.168490+0000 mgr.a (mgr.14388) 4922 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:20 smithi044 bash[22676]: cluster 2024-09-21T00:08:19.168490+0000 mgr.a (mgr.14388) 4922 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:20 smithi179 bash[23186]: cluster 2024-09-21T00:08:19.168490+0000 mgr.a (mgr.14388) 4922 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:21 smithi049 bash[23528]: audit 2024-09-21T00:08:19.935256+0000 mgr.a (mgr.14388) 4923 : audit [DBG] from='client.116010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:21 smithi044 bash[22676]: audit 2024-09-21T00:08:19.935256+0000 mgr.a (mgr.14388) 4923 : audit [DBG] from='client.116010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:21 smithi179 bash[23186]: audit 2024-09-21T00:08:19.935256+0000 mgr.a (mgr.14388) 4923 : audit [DBG] from='client.116010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:22 smithi049 bash[23528]: cluster 2024-09-21T00:08:21.171407+0000 mgr.a (mgr.14388) 4924 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:22 smithi044 bash[22676]: cluster 2024-09-21T00:08:21.171407+0000 mgr.a (mgr.14388) 4924 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:22 smithi179 bash[23186]: cluster 2024-09-21T00:08:21.171407+0000 mgr.a (mgr.14388) 4924 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:24.426 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:24 smithi044 bash[22676]: cluster 2024-09-21T00:08:23.172216+0000 mgr.a (mgr.14388) 4925 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:08:24.426 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:24 smithi044 bash[22676]: audit 2024-09-21T00:08:23.222414+0000 mon.a (mon.0) 4521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.426 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:24 smithi044 bash[22676]: audit 2024-09-21T00:08:23.227159+0000 mon.a (mon.0) 4522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.426 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:24 smithi044 bash[22676]: audit 2024-09-21T00:08:23.234241+0000 mon.a (mon.0) 4523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:24 smithi179 bash[23186]: cluster 2024-09-21T00:08:23.172216+0000 mgr.a (mgr.14388) 4925 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:08:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:24 smithi179 bash[23186]: audit 2024-09-21T00:08:23.222414+0000 mon.a (mon.0) 4521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:24 smithi179 bash[23186]: audit 2024-09-21T00:08:23.227159+0000 mon.a (mon.0) 4522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:24 smithi179 bash[23186]: audit 2024-09-21T00:08:23.234241+0000 mon.a (mon.0) 4523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:24 smithi049 bash[23528]: cluster 2024-09-21T00:08:23.172216+0000 mgr.a (mgr.14388) 4925 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:08:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:24 smithi049 bash[23528]: audit 2024-09-21T00:08:23.222414+0000 mon.a (mon.0) 4521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:24 smithi049 bash[23528]: audit 2024-09-21T00:08:23.227159+0000 mon.a (mon.0) 4522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:24 smithi049 bash[23528]: audit 2024-09-21T00:08:23.234241+0000 mon.a (mon.0) 4523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:25.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:26.191 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:26 smithi044 bash[22676]: cluster 2024-09-21T00:08:25.174275+0000 mgr.a (mgr.14388) 4926 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:26 smithi044 bash[22676]: audit 2024-09-21T00:08:25.579466+0000 mon.a (mon.0) 4524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:26 smithi044 bash[22676]: audit 2024-09-21T00:08:25.585089+0000 mon.a (mon.0) 4525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:26 smithi044 bash[22676]: audit 2024-09-21T00:08:25.591331+0000 mon.a (mon.0) 4526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:26 smithi179 bash[23186]: cluster 2024-09-21T00:08:25.174275+0000 mgr.a (mgr.14388) 4926 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:26 smithi179 bash[23186]: audit 2024-09-21T00:08:25.579466+0000 mon.a (mon.0) 4524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:26 smithi179 bash[23186]: audit 2024-09-21T00:08:25.585089+0000 mon.a (mon.0) 4525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:26 smithi179 bash[23186]: audit 2024-09-21T00:08:25.591331+0000 mon.a (mon.0) 4526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:26 smithi049 bash[23528]: cluster 2024-09-21T00:08:25.174275+0000 mgr.a (mgr.14388) 4926 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:26 smithi049 bash[23528]: audit 2024-09-21T00:08:25.579466+0000 mon.a (mon.0) 4524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:26 smithi049 bash[23528]: audit 2024-09-21T00:08:25.585089+0000 mon.a (mon.0) 4525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:26 smithi049 bash[23528]: audit 2024-09-21T00:08:25.591331+0000 mon.a (mon.0) 4526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:27 smithi044 bash[22676]: audit 2024-09-21T00:08:25.738002+0000 mgr.a (mgr.14388) 4927 : audit [DBG] from='client.116085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:27 smithi179 bash[23186]: audit 2024-09-21T00:08:25.738002+0000 mgr.a (mgr.14388) 4927 : audit [DBG] from='client.116085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:27 smithi049 bash[23528]: audit 2024-09-21T00:08:25.738002+0000 mgr.a (mgr.14388) 4927 : audit [DBG] from='client.116085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:28 smithi044 bash[22676]: cluster 2024-09-21T00:08:27.175184+0000 mgr.a (mgr.14388) 4928 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:08:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:28 smithi044 bash[22676]: audit 2024-09-21T00:08:27.821401+0000 mon.a (mon.0) 4527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:28 smithi044 bash[22676]: audit 2024-09-21T00:08:27.830573+0000 mon.a (mon.0) 4528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:28 smithi044 bash[22676]: audit 2024-09-21T00:08:27.841143+0000 mon.a (mon.0) 4529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:28 smithi179 bash[23186]: cluster 2024-09-21T00:08:27.175184+0000 mgr.a (mgr.14388) 4928 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:08:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:28 smithi179 bash[23186]: audit 2024-09-21T00:08:27.821401+0000 mon.a (mon.0) 4527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:28 smithi179 bash[23186]: audit 2024-09-21T00:08:27.830573+0000 mon.a (mon.0) 4528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:28 smithi179 bash[23186]: audit 2024-09-21T00:08:27.841143+0000 mon.a (mon.0) 4529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:28 smithi049 bash[23528]: cluster 2024-09-21T00:08:27.175184+0000 mgr.a (mgr.14388) 4928 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:08:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:28 smithi049 bash[23528]: audit 2024-09-21T00:08:27.821401+0000 mon.a (mon.0) 4527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:28 smithi049 bash[23528]: audit 2024-09-21T00:08:27.830573+0000 mon.a (mon.0) 4528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:28 smithi049 bash[23528]: audit 2024-09-21T00:08:27.841143+0000 mon.a (mon.0) 4529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:30 smithi044 bash[22676]: cluster 2024-09-21T00:08:29.176015+0000 mgr.a (mgr.14388) 4929 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:08:30.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:30 smithi179 bash[23186]: cluster 2024-09-21T00:08:29.176015+0000 mgr.a (mgr.14388) 4929 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:08:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:30 smithi049 bash[23528]: cluster 2024-09-21T00:08:29.176015+0000 mgr.a (mgr.14388) 4929 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:08:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:31.195 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:31.983 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:32.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:32 smithi179 bash[23186]: cluster 2024-09-21T00:08:31.178224+0000 mgr.a (mgr.14388) 4930 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:32 smithi049 bash[23528]: cluster 2024-09-21T00:08:31.178224+0000 mgr.a (mgr.14388) 4930 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:32 smithi044 bash[22676]: cluster 2024-09-21T00:08:31.178224+0000 mgr.a (mgr.14388) 4930 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:33 smithi179 bash[23186]: audit 2024-09-21T00:08:31.528650+0000 mgr.a (mgr.14388) 4931 : audit [DBG] from='client.116157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:33 smithi049 bash[23528]: audit 2024-09-21T00:08:31.528650+0000 mgr.a (mgr.14388) 4931 : audit [DBG] from='client.116157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:33 smithi044 bash[22676]: audit 2024-09-21T00:08:31.528650+0000 mgr.a (mgr.14388) 4931 : audit [DBG] from='client.116157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:34 smithi179 bash[23186]: cluster 2024-09-21T00:08:33.179169+0000 mgr.a (mgr.14388) 4932 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:34 smithi049 bash[23528]: cluster 2024-09-21T00:08:33.179169+0000 mgr.a (mgr.14388) 4932 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:34 smithi044 bash[22676]: cluster 2024-09-21T00:08:33.179169+0000 mgr.a (mgr.14388) 4932 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:36 smithi049 bash[23528]: cluster 2024-09-21T00:08:35.181404+0000 mgr.a (mgr.14388) 4933 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:36 smithi044 bash[22676]: cluster 2024-09-21T00:08:35.181404+0000 mgr.a (mgr.14388) 4933 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:36 smithi179 bash[23186]: cluster 2024-09-21T00:08:35.181404+0000 mgr.a (mgr.14388) 4933 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:36.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:36.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:37.738 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:37.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:37.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:37.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:37.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:38 smithi049 bash[23528]: cluster 2024-09-21T00:08:37.181932+0000 mgr.a (mgr.14388) 4934 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:38 smithi049 bash[23528]: audit 2024-09-21T00:08:37.317281+0000 mgr.a (mgr.14388) 4935 : audit [DBG] from='client.116235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:38 smithi044 bash[22676]: cluster 2024-09-21T00:08:37.181932+0000 mgr.a (mgr.14388) 4934 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:38 smithi044 bash[22676]: audit 2024-09-21T00:08:37.317281+0000 mgr.a (mgr.14388) 4935 : audit [DBG] from='client.116235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:38 smithi179 bash[23186]: cluster 2024-09-21T00:08:37.181932+0000 mgr.a (mgr.14388) 4934 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:38 smithi179 bash[23186]: audit 2024-09-21T00:08:37.317281+0000 mgr.a (mgr.14388) 4935 : audit [DBG] from='client.116235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:40.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:40 smithi049 bash[23528]: cluster 2024-09-21T00:08:39.182784+0000 mgr.a (mgr.14388) 4936 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:40 smithi044 bash[22676]: cluster 2024-09-21T00:08:39.182784+0000 mgr.a (mgr.14388) 4936 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:40 smithi179 bash[23186]: cluster 2024-09-21T00:08:39.182784+0000 mgr.a (mgr.14388) 4936 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:42.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:42 smithi049 bash[23528]: cluster 2024-09-21T00:08:41.185047+0000 mgr.a (mgr.14388) 4937 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:42 smithi044 bash[22676]: cluster 2024-09-21T00:08:41.185047+0000 mgr.a (mgr.14388) 4937 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:42.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:42.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:42.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:42 smithi179 bash[23186]: cluster 2024-09-21T00:08:41.185047+0000 mgr.a (mgr.14388) 4937 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:08:43.533 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:43 smithi179 bash[23186]: audit 2024-09-21T00:08:42.610244+0000 mon.a (mon.0) 4530 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:08:43.533 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:43 smithi179 bash[23186]: audit 2024-09-21T00:08:42.617759+0000 mon.a (mon.0) 4531 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:08:43.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:43 smithi179 bash[23186]: audit 2024-09-21T00:08:42.619615+0000 mon.a (mon.0) 4532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:08:43.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:43 smithi179 bash[23186]: audit 2024-09-21T00:08:42.631138+0000 mon.a (mon.0) 4533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:43.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:43 smithi179 bash[23186]: audit 2024-09-21T00:08:42.643007+0000 mon.a (mon.0) 4534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:08:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:43 smithi049 bash[23528]: audit 2024-09-21T00:08:42.610244+0000 mon.a (mon.0) 4530 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:08:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:43 smithi049 bash[23528]: audit 2024-09-21T00:08:42.617759+0000 mon.a (mon.0) 4531 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:08:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:43 smithi049 bash[23528]: audit 2024-09-21T00:08:42.619615+0000 mon.a (mon.0) 4532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:08:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:43 smithi049 bash[23528]: audit 2024-09-21T00:08:42.631138+0000 mon.a (mon.0) 4533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:43 smithi049 bash[23528]: audit 2024-09-21T00:08:42.643007+0000 mon.a (mon.0) 4534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:08:43.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:08:43 smithi044 bash[22930]: debug 2024-09-21T00:08:43.417+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:08:43.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:08:43 smithi044 bash[22930]: debug 2024-09-21T00:08:43.429+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:08:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:43 smithi044 bash[22676]: audit 2024-09-21T00:08:42.610244+0000 mon.a (mon.0) 4530 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:08:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:43 smithi044 bash[22676]: audit 2024-09-21T00:08:42.617759+0000 mon.a (mon.0) 4531 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:08:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:43 smithi044 bash[22676]: audit 2024-09-21T00:08:42.619615+0000 mon.a (mon.0) 4532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:08:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:43 smithi044 bash[22676]: audit 2024-09-21T00:08:42.631138+0000 mon.a (mon.0) 4533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:43 smithi044 bash[22676]: audit 2024-09-21T00:08:42.643007+0000 mon.a (mon.0) 4534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:08:43.824 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:43.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:43.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:43.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:43.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:44.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:44 smithi049 bash[23528]: audit 2024-09-21T00:08:42.645473+0000 mgr.a (mgr.14388) 4938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:08:44.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:44 smithi049 bash[23528]: audit 2024-09-21T00:08:43.082822+0000 mgr.a (mgr.14388) 4939 : audit [DBG] from='client.116334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:44.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:44 smithi049 bash[23528]: cluster 2024-09-21T00:08:43.185648+0000 mgr.a (mgr.14388) 4940 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:44.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:44 smithi049 bash[23528]: audit 2024-09-21T00:08:43.416821+0000 mon.a (mon.0) 4535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:44 smithi049 bash[23528]: audit 2024-09-21T00:08:43.422366+0000 mon.a (mon.0) 4536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:44 smithi049 bash[23528]: audit 2024-09-21T00:08:43.440823+0000 mon.a (mon.0) 4537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.537 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:44 smithi044 bash[22676]: audit 2024-09-21T00:08:42.645473+0000 mgr.a (mgr.14388) 4938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:08:44.537 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:44 smithi044 bash[22676]: audit 2024-09-21T00:08:43.082822+0000 mgr.a (mgr.14388) 4939 : audit [DBG] from='client.116334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:44.537 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:44 smithi044 bash[22676]: cluster 2024-09-21T00:08:43.185648+0000 mgr.a (mgr.14388) 4940 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:44.537 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:44 smithi044 bash[22676]: audit 2024-09-21T00:08:43.416821+0000 mon.a (mon.0) 4535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.538 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:44 smithi044 bash[22676]: audit 2024-09-21T00:08:43.422366+0000 mon.a (mon.0) 4536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.538 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:44 smithi044 bash[22676]: audit 2024-09-21T00:08:43.440823+0000 mon.a (mon.0) 4537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:44 smithi179 bash[23186]: audit 2024-09-21T00:08:42.645473+0000 mgr.a (mgr.14388) 4938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:08:44.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:44 smithi179 bash[23186]: audit 2024-09-21T00:08:43.082822+0000 mgr.a (mgr.14388) 4939 : audit [DBG] from='client.116334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:44.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:44 smithi179 bash[23186]: cluster 2024-09-21T00:08:43.185648+0000 mgr.a (mgr.14388) 4940 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:08:44.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:44 smithi179 bash[23186]: audit 2024-09-21T00:08:43.416821+0000 mon.a (mon.0) 4535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:44 smithi179 bash[23186]: audit 2024-09-21T00:08:43.422366+0000 mon.a (mon.0) 4536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:44.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:44 smithi179 bash[23186]: audit 2024-09-21T00:08:43.440823+0000 mon.a (mon.0) 4537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:45 smithi049 bash[23528]: audit 2024-09-21T00:08:43.422208+0000 mgr.a (mgr.14388) 4941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:08:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:45 smithi049 bash[23528]: cephadm 2024-09-21T00:08:43.435832+0000 mgr.a (mgr.14388) 4942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:08:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:45 smithi044 bash[22676]: audit 2024-09-21T00:08:43.422208+0000 mgr.a (mgr.14388) 4941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:08:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:45 smithi044 bash[22676]: cephadm 2024-09-21T00:08:43.435832+0000 mgr.a (mgr.14388) 4942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:08:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:45 smithi179 bash[23186]: audit 2024-09-21T00:08:43.422208+0000 mgr.a (mgr.14388) 4941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:08:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:45 smithi179 bash[23186]: cephadm 2024-09-21T00:08:43.435832+0000 mgr.a (mgr.14388) 4942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:46 smithi044 bash[22676]: cluster 2024-09-21T00:08:45.186910+0000 mgr.a (mgr.14388) 4943 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:46 smithi044 bash[22676]: audit 2024-09-21T00:08:45.799980+0000 mon.a (mon.0) 4538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:46 smithi044 bash[22676]: audit 2024-09-21T00:08:45.808210+0000 mon.a (mon.0) 4539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:46 smithi044 bash[22676]: audit 2024-09-21T00:08:45.818528+0000 mon.a (mon.0) 4540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:46 smithi179 bash[23186]: cluster 2024-09-21T00:08:45.186910+0000 mgr.a (mgr.14388) 4943 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:46 smithi179 bash[23186]: audit 2024-09-21T00:08:45.799980+0000 mon.a (mon.0) 4538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:46 smithi179 bash[23186]: audit 2024-09-21T00:08:45.808210+0000 mon.a (mon.0) 4539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:46 smithi179 bash[23186]: audit 2024-09-21T00:08:45.818528+0000 mon.a (mon.0) 4540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:46 smithi049 bash[23528]: cluster 2024-09-21T00:08:45.186910+0000 mgr.a (mgr.14388) 4943 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:46 smithi049 bash[23528]: audit 2024-09-21T00:08:45.799980+0000 mon.a (mon.0) 4538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:46 smithi049 bash[23528]: audit 2024-09-21T00:08:45.808210+0000 mon.a (mon.0) 4539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:46 smithi049 bash[23528]: audit 2024-09-21T00:08:45.818528+0000 mon.a (mon.0) 4540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:48 smithi049 bash[23528]: cluster 2024-09-21T00:08:47.187706+0000 mgr.a (mgr.14388) 4944 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:48 smithi049 bash[23528]: audit 2024-09-21T00:08:48.014333+0000 mon.a (mon.0) 4541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:48 smithi049 bash[23528]: audit 2024-09-21T00:08:48.019765+0000 mon.a (mon.0) 4542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:48 smithi049 bash[23528]: audit 2024-09-21T00:08:48.026247+0000 mon.a (mon.0) 4543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:48 smithi044 bash[22676]: cluster 2024-09-21T00:08:47.187706+0000 mgr.a (mgr.14388) 4944 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:48 smithi044 bash[22676]: audit 2024-09-21T00:08:48.014333+0000 mon.a (mon.0) 4541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:48 smithi044 bash[22676]: audit 2024-09-21T00:08:48.019765+0000 mon.a (mon.0) 4542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:48 smithi044 bash[22676]: audit 2024-09-21T00:08:48.026247+0000 mon.a (mon.0) 4543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:48 smithi179 bash[23186]: cluster 2024-09-21T00:08:47.187706+0000 mgr.a (mgr.14388) 4944 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:48 smithi179 bash[23186]: audit 2024-09-21T00:08:48.014333+0000 mon.a (mon.0) 4541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:48 smithi179 bash[23186]: audit 2024-09-21T00:08:48.019765+0000 mon.a (mon.0) 4542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:48 smithi179 bash[23186]: audit 2024-09-21T00:08:48.026247+0000 mon.a (mon.0) 4543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:08:48.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:48.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:48.827 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:49.603 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:49.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:49.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:49.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:49.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:50 smithi049 bash[23528]: audit 2024-09-21T00:08:49.164466+0000 mgr.a (mgr.14388) 4945 : audit [DBG] from='client.116499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:50 smithi049 bash[23528]: cluster 2024-09-21T00:08:49.188452+0000 mgr.a (mgr.14388) 4946 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:50 smithi044 bash[22676]: audit 2024-09-21T00:08:49.164466+0000 mgr.a (mgr.14388) 4945 : audit [DBG] from='client.116499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:50 smithi044 bash[22676]: cluster 2024-09-21T00:08:49.188452+0000 mgr.a (mgr.14388) 4946 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:50 smithi179 bash[23186]: audit 2024-09-21T00:08:49.164466+0000 mgr.a (mgr.14388) 4945 : audit [DBG] from='client.116499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:50 smithi179 bash[23186]: cluster 2024-09-21T00:08:49.188452+0000 mgr.a (mgr.14388) 4946 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:52 smithi049 bash[23528]: cluster 2024-09-21T00:08:51.190915+0000 mgr.a (mgr.14388) 4947 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:52 smithi044 bash[22676]: cluster 2024-09-21T00:08:51.190915+0000 mgr.a (mgr.14388) 4947 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:52 smithi179 bash[23186]: cluster 2024-09-21T00:08:51.190915+0000 mgr.a (mgr.14388) 4947 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:54 smithi049 bash[23528]: cluster 2024-09-21T00:08:53.191727+0000 mgr.a (mgr.14388) 4948 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:08:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:08:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:08:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:54 smithi044 bash[22676]: cluster 2024-09-21T00:08:53.191727+0000 mgr.a (mgr.14388) 4948 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:54 smithi179 bash[23186]: cluster 2024-09-21T00:08:53.191727+0000 mgr.a (mgr.14388) 4948 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:55.396 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:08:55.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:08:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:08:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:08:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:08:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:56 smithi049 bash[23528]: audit 2024-09-21T00:08:54.945152+0000 mgr.a (mgr.14388) 4949 : audit [DBG] from='client.116577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:56 smithi049 bash[23528]: cluster 2024-09-21T00:08:55.193176+0000 mgr.a (mgr.14388) 4950 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:56 smithi044 bash[22676]: audit 2024-09-21T00:08:54.945152+0000 mgr.a (mgr.14388) 4949 : audit [DBG] from='client.116577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:56 smithi044 bash[22676]: cluster 2024-09-21T00:08:55.193176+0000 mgr.a (mgr.14388) 4950 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:56 smithi179 bash[23186]: audit 2024-09-21T00:08:54.945152+0000 mgr.a (mgr.14388) 4949 : audit [DBG] from='client.116577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:08:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:56 smithi179 bash[23186]: cluster 2024-09-21T00:08:55.193176+0000 mgr.a (mgr.14388) 4950 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:08:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:08:58 smithi044 bash[22676]: cluster 2024-09-21T00:08:57.194214+0000 mgr.a (mgr.14388) 4951 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:08:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:08:58 smithi179 bash[23186]: cluster 2024-09-21T00:08:57.194214+0000 mgr.a (mgr.14388) 4951 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:08:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:08:58 smithi049 bash[23528]: cluster 2024-09-21T00:08:57.194214+0000 mgr.a (mgr.14388) 4951 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:00.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:00.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:00.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:00 smithi044 bash[22676]: cluster 2024-09-21T00:08:59.195059+0000 mgr.a (mgr.14388) 4952 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:00 smithi179 bash[23186]: cluster 2024-09-21T00:08:59.195059+0000 mgr.a (mgr.14388) 4952 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:00 smithi049 bash[23528]: cluster 2024-09-21T00:08:59.195059+0000 mgr.a (mgr.14388) 4952 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:01.167 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:01.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:01.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:01.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:01.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:02 smithi044 bash[22676]: audit 2024-09-21T00:09:00.730943+0000 mgr.a (mgr.14388) 4953 : audit [DBG] from='client.116652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:02 smithi044 bash[22676]: cluster 2024-09-21T00:09:01.196336+0000 mgr.a (mgr.14388) 4954 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:02 smithi179 bash[23186]: audit 2024-09-21T00:09:00.730943+0000 mgr.a (mgr.14388) 4953 : audit [DBG] from='client.116652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:02 smithi179 bash[23186]: cluster 2024-09-21T00:09:01.196336+0000 mgr.a (mgr.14388) 4954 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:02 smithi049 bash[23528]: audit 2024-09-21T00:09:00.730943+0000 mgr.a (mgr.14388) 4953 : audit [DBG] from='client.116652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:02 smithi049 bash[23528]: cluster 2024-09-21T00:09:01.196336+0000 mgr.a (mgr.14388) 4954 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:04.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:04 smithi044 bash[22676]: cluster 2024-09-21T00:09:03.197078+0000 mgr.a (mgr.14388) 4955 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:04.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:04 smithi044 bash[22676]: audit 2024-09-21T00:09:03.653474+0000 mon.a (mon.0) 4544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:04 smithi044 bash[22676]: audit 2024-09-21T00:09:03.663685+0000 mon.a (mon.0) 4545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:04 smithi044 bash[22676]: audit 2024-09-21T00:09:03.675809+0000 mon.a (mon.0) 4546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:04 smithi049 bash[23528]: cluster 2024-09-21T00:09:03.197078+0000 mgr.a (mgr.14388) 4955 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:04.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:04 smithi049 bash[23528]: audit 2024-09-21T00:09:03.653474+0000 mon.a (mon.0) 4544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:04 smithi049 bash[23528]: audit 2024-09-21T00:09:03.663685+0000 mon.a (mon.0) 4545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:04 smithi049 bash[23528]: audit 2024-09-21T00:09:03.675809+0000 mon.a (mon.0) 4546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.701 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:04 smithi179 bash[23186]: cluster 2024-09-21T00:09:03.197078+0000 mgr.a (mgr.14388) 4955 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:04.701 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:04 smithi179 bash[23186]: audit 2024-09-21T00:09:03.653474+0000 mon.a (mon.0) 4544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.702 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:04 smithi179 bash[23186]: audit 2024-09-21T00:09:03.663685+0000 mon.a (mon.0) 4545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:04.702 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:04 smithi179 bash[23186]: audit 2024-09-21T00:09:03.675809+0000 mon.a (mon.0) 4546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:06.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:06.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:06 smithi049 bash[23528]: cluster 2024-09-21T00:09:05.199434+0000 mgr.a (mgr.14388) 4956 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:06 smithi049 bash[23528]: audit 2024-09-21T00:09:06.005602+0000 mon.a (mon.0) 4547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:06 smithi049 bash[23528]: audit 2024-09-21T00:09:06.011776+0000 mon.a (mon.0) 4548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:06 smithi049 bash[23528]: audit 2024-09-21T00:09:06.019579+0000 mon.a (mon.0) 4549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:06 smithi044 bash[22676]: cluster 2024-09-21T00:09:05.199434+0000 mgr.a (mgr.14388) 4956 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:06.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:06 smithi044 bash[22676]: audit 2024-09-21T00:09:06.005602+0000 mon.a (mon.0) 4547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:06 smithi044 bash[22676]: audit 2024-09-21T00:09:06.011776+0000 mon.a (mon.0) 4548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:06 smithi044 bash[22676]: audit 2024-09-21T00:09:06.019579+0000 mon.a (mon.0) 4549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:06 smithi179 bash[23186]: cluster 2024-09-21T00:09:05.199434+0000 mgr.a (mgr.14388) 4956 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:06 smithi179 bash[23186]: audit 2024-09-21T00:09:06.005602+0000 mon.a (mon.0) 4547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:06 smithi179 bash[23186]: audit 2024-09-21T00:09:06.011776+0000 mon.a (mon.0) 4548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:06 smithi179 bash[23186]: audit 2024-09-21T00:09:06.019579+0000 mon.a (mon.0) 4549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:06.922 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:06.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:06.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:06.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:06.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:08 smithi044 bash[22676]: audit 2024-09-21T00:09:06.493305+0000 mgr.a (mgr.14388) 4957 : audit [DBG] from='client.116730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:08 smithi044 bash[22676]: cluster 2024-09-21T00:09:07.200399+0000 mgr.a (mgr.14388) 4958 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:08 smithi044 bash[22676]: audit 2024-09-21T00:09:08.249069+0000 mon.a (mon.0) 4550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:08 smithi044 bash[22676]: audit 2024-09-21T00:09:08.256641+0000 mon.a (mon.0) 4551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:08 smithi044 bash[22676]: audit 2024-09-21T00:09:08.266381+0000 mon.a (mon.0) 4552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:08 smithi179 bash[23186]: audit 2024-09-21T00:09:06.493305+0000 mgr.a (mgr.14388) 4957 : audit [DBG] from='client.116730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:08 smithi179 bash[23186]: cluster 2024-09-21T00:09:07.200399+0000 mgr.a (mgr.14388) 4958 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:08 smithi179 bash[23186]: audit 2024-09-21T00:09:08.249069+0000 mon.a (mon.0) 4550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:08 smithi179 bash[23186]: audit 2024-09-21T00:09:08.256641+0000 mon.a (mon.0) 4551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:08 smithi179 bash[23186]: audit 2024-09-21T00:09:08.266381+0000 mon.a (mon.0) 4552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:08 smithi049 bash[23528]: audit 2024-09-21T00:09:06.493305+0000 mgr.a (mgr.14388) 4957 : audit [DBG] from='client.116730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:08 smithi049 bash[23528]: cluster 2024-09-21T00:09:07.200399+0000 mgr.a (mgr.14388) 4958 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:08 smithi049 bash[23528]: audit 2024-09-21T00:09:08.249069+0000 mon.a (mon.0) 4550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:08 smithi049 bash[23528]: audit 2024-09-21T00:09:08.256641+0000 mon.a (mon.0) 4551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:08 smithi049 bash[23528]: audit 2024-09-21T00:09:08.266381+0000 mon.a (mon.0) 4552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:10 smithi044 bash[22676]: cluster 2024-09-21T00:09:09.201234+0000 mgr.a (mgr.14388) 4959 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:10 smithi179 bash[23186]: cluster 2024-09-21T00:09:09.201234+0000 mgr.a (mgr.14388) 4959 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:10 smithi049 bash[23528]: cluster 2024-09-21T00:09:09.201234+0000 mgr.a (mgr.14388) 4959 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:11.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:12.705 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:12 smithi044 bash[22676]: cluster 2024-09-21T00:09:11.203438+0000 mgr.a (mgr.14388) 4960 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:12 smithi179 bash[23186]: cluster 2024-09-21T00:09:11.203438+0000 mgr.a (mgr.14388) 4960 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:12 smithi049 bash[23528]: cluster 2024-09-21T00:09:11.203438+0000 mgr.a (mgr.14388) 4960 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:13 smithi044 bash[22676]: audit 2024-09-21T00:09:12.261239+0000 mgr.a (mgr.14388) 4961 : audit [DBG] from='client.116808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:13 smithi179 bash[23186]: audit 2024-09-21T00:09:12.261239+0000 mgr.a (mgr.14388) 4961 : audit [DBG] from='client.116808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:13 smithi049 bash[23528]: audit 2024-09-21T00:09:12.261239+0000 mgr.a (mgr.14388) 4961 : audit [DBG] from='client.116808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:14 smithi044 bash[22676]: cluster 2024-09-21T00:09:13.204327+0000 mgr.a (mgr.14388) 4962 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:14 smithi179 bash[23186]: cluster 2024-09-21T00:09:13.204327+0000 mgr.a (mgr.14388) 4962 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:14.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:14 smithi049 bash[23528]: cluster 2024-09-21T00:09:13.204327+0000 mgr.a (mgr.14388) 4962 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:16.712 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:16 smithi049 bash[23528]: cluster 2024-09-21T00:09:15.206494+0000 mgr.a (mgr.14388) 4963 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:16 smithi044 bash[22676]: cluster 2024-09-21T00:09:15.206494+0000 mgr.a (mgr.14388) 4963 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:16 smithi179 bash[23186]: cluster 2024-09-21T00:09:15.206494+0000 mgr.a (mgr.14388) 4963 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:17.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:17.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:17.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:18.492 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:18.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:18 smithi044 bash[22676]: cluster 2024-09-21T00:09:17.207256+0000 mgr.a (mgr.14388) 4964 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:18 smithi179 bash[23186]: cluster 2024-09-21T00:09:17.207256+0000 mgr.a (mgr.14388) 4964 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:18 smithi049 bash[23528]: cluster 2024-09-21T00:09:17.207256+0000 mgr.a (mgr.14388) 4964 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:19 smithi044 bash[22676]: audit 2024-09-21T00:09:18.039520+0000 mgr.a (mgr.14388) 4965 : audit [DBG] from='client.116886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:19 smithi179 bash[23186]: audit 2024-09-21T00:09:18.039520+0000 mgr.a (mgr.14388) 4965 : audit [DBG] from='client.116886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:19 smithi049 bash[23528]: audit 2024-09-21T00:09:18.039520+0000 mgr.a (mgr.14388) 4965 : audit [DBG] from='client.116886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:20 smithi044 bash[22676]: cluster 2024-09-21T00:09:19.208130+0000 mgr.a (mgr.14388) 4966 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:20 smithi179 bash[23186]: cluster 2024-09-21T00:09:19.208130+0000 mgr.a (mgr.14388) 4966 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:20 smithi049 bash[23528]: cluster 2024-09-21T00:09:19.208130+0000 mgr.a (mgr.14388) 4966 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:22 smithi044 bash[22676]: cluster 2024-09-21T00:09:21.210591+0000 mgr.a (mgr.14388) 4967 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:22 smithi179 bash[23186]: cluster 2024-09-21T00:09:21.210591+0000 mgr.a (mgr.14388) 4967 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:22 smithi049 bash[23528]: cluster 2024-09-21T00:09:21.210591+0000 mgr.a (mgr.14388) 4967 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:23.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:23.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:23.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:24.284 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:24.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:24.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:24.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:24.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:24.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:24 smithi044 bash[22676]: cluster 2024-09-21T00:09:23.211535+0000 mgr.a (mgr.14388) 4968 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:24.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:24 smithi044 bash[22676]: audit 2024-09-21T00:09:23.887318+0000 mon.a (mon.0) 4553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:24 smithi044 bash[22676]: audit 2024-09-21T00:09:23.895712+0000 mon.a (mon.0) 4554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:24 smithi044 bash[22676]: audit 2024-09-21T00:09:23.901663+0000 mon.a (mon.0) 4555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.707 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:24 smithi049 bash[23528]: cluster 2024-09-21T00:09:23.211535+0000 mgr.a (mgr.14388) 4968 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:24.707 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:24 smithi049 bash[23528]: audit 2024-09-21T00:09:23.887318+0000 mon.a (mon.0) 4553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.707 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:24 smithi049 bash[23528]: audit 2024-09-21T00:09:23.895712+0000 mon.a (mon.0) 4554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.707 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:24 smithi049 bash[23528]: audit 2024-09-21T00:09:23.901663+0000 mon.a (mon.0) 4555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:24 smithi179 bash[23186]: cluster 2024-09-21T00:09:23.211535+0000 mgr.a (mgr.14388) 4968 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:24 smithi179 bash[23186]: audit 2024-09-21T00:09:23.887318+0000 mon.a (mon.0) 4553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:24 smithi179 bash[23186]: audit 2024-09-21T00:09:23.895712+0000 mon.a (mon.0) 4554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:24.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:24 smithi179 bash[23186]: audit 2024-09-21T00:09:23.901663+0000 mon.a (mon.0) 4555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:25.675 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:25 smithi179 bash[23186]: audit 2024-09-21T00:09:23.830953+0000 mgr.a (mgr.14388) 4969 : audit [DBG] from='client.116961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:25 smithi044 bash[22676]: audit 2024-09-21T00:09:23.830953+0000 mgr.a (mgr.14388) 4969 : audit [DBG] from='client.116961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:25 smithi049 bash[23528]: audit 2024-09-21T00:09:23.830953+0000 mgr.a (mgr.14388) 4969 : audit [DBG] from='client.116961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:26 smithi179 bash[23186]: cluster 2024-09-21T00:09:25.214069+0000 mgr.a (mgr.14388) 4970 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:26 smithi179 bash[23186]: audit 2024-09-21T00:09:26.223535+0000 mon.a (mon.0) 4556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:26 smithi179 bash[23186]: audit 2024-09-21T00:09:26.229734+0000 mon.a (mon.0) 4557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:26 smithi179 bash[23186]: audit 2024-09-21T00:09:26.235575+0000 mon.a (mon.0) 4558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.650 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:26 smithi044 bash[22676]: cluster 2024-09-21T00:09:25.214069+0000 mgr.a (mgr.14388) 4970 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:26.650 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:26 smithi044 bash[22676]: audit 2024-09-21T00:09:26.223535+0000 mon.a (mon.0) 4556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.650 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:26 smithi044 bash[22676]: audit 2024-09-21T00:09:26.229734+0000 mon.a (mon.0) 4557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.650 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:26 smithi044 bash[22676]: audit 2024-09-21T00:09:26.235575+0000 mon.a (mon.0) 4558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:26 smithi049 bash[23528]: cluster 2024-09-21T00:09:25.214069+0000 mgr.a (mgr.14388) 4970 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:09:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:26 smithi049 bash[23528]: audit 2024-09-21T00:09:26.223535+0000 mon.a (mon.0) 4556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:26 smithi049 bash[23528]: audit 2024-09-21T00:09:26.229734+0000 mon.a (mon.0) 4557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:26 smithi049 bash[23528]: audit 2024-09-21T00:09:26.235575+0000 mon.a (mon.0) 4558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:27 smithi044 bash[22676]: cluster 2024-09-21T00:09:27.214841+0000 mgr.a (mgr.14388) 4971 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:27 smithi179 bash[23186]: cluster 2024-09-21T00:09:27.214841+0000 mgr.a (mgr.14388) 4971 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:27 smithi049 bash[23528]: cluster 2024-09-21T00:09:27.214841+0000 mgr.a (mgr.14388) 4971 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:29.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:29.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:29 smithi044 bash[22676]: audit 2024-09-21T00:09:28.449085+0000 mon.a (mon.0) 4559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:29 smithi044 bash[22676]: audit 2024-09-21T00:09:28.459155+0000 mon.a (mon.0) 4560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:29 smithi044 bash[22676]: audit 2024-09-21T00:09:28.470594+0000 mon.a (mon.0) 4561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:29 smithi044 bash[22676]: cluster 2024-09-21T00:09:29.215584+0000 mgr.a (mgr.14388) 4972 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:29 smithi179 bash[23186]: audit 2024-09-21T00:09:28.449085+0000 mon.a (mon.0) 4559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:29 smithi179 bash[23186]: audit 2024-09-21T00:09:28.459155+0000 mon.a (mon.0) 4560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:29 smithi179 bash[23186]: audit 2024-09-21T00:09:28.470594+0000 mon.a (mon.0) 4561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:29 smithi179 bash[23186]: cluster 2024-09-21T00:09:29.215584+0000 mgr.a (mgr.14388) 4972 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:29 smithi049 bash[23528]: audit 2024-09-21T00:09:28.449085+0000 mon.a (mon.0) 4559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:29 smithi049 bash[23528]: audit 2024-09-21T00:09:28.459155+0000 mon.a (mon.0) 4560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:29 smithi049 bash[23528]: audit 2024-09-21T00:09:28.470594+0000 mon.a (mon.0) 4561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:29 smithi049 bash[23528]: cluster 2024-09-21T00:09:29.215584+0000 mgr.a (mgr.14388) 4972 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:30.056 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:30 smithi044 bash[22676]: audit 2024-09-21T00:09:29.620121+0000 mgr.a (mgr.14388) 4973 : audit [DBG] from='client.117036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:30 smithi179 bash[23186]: audit 2024-09-21T00:09:29.620121+0000 mgr.a (mgr.14388) 4973 : audit [DBG] from='client.117036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:30 smithi049 bash[23528]: audit 2024-09-21T00:09:29.620121+0000 mgr.a (mgr.14388) 4973 : audit [DBG] from='client.117036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:31 smithi044 bash[22676]: cluster 2024-09-21T00:09:31.217938+0000 mgr.a (mgr.14388) 4974 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:09:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:31 smithi179 bash[23186]: cluster 2024-09-21T00:09:31.217938+0000 mgr.a (mgr.14388) 4974 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:09:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:31 smithi049 bash[23528]: cluster 2024-09-21T00:09:31.217938+0000 mgr.a (mgr.14388) 4974 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:09:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:34 smithi049 bash[23528]: cluster 2024-09-21T00:09:33.218864+0000 mgr.a (mgr.14388) 4975 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:09:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:34 smithi044 bash[22676]: cluster 2024-09-21T00:09:33.218864+0000 mgr.a (mgr.14388) 4975 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:09:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:34 smithi179 bash[23186]: cluster 2024-09-21T00:09:33.218864+0000 mgr.a (mgr.14388) 4975 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:09:35.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:35.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:35.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:36 smithi049 bash[23528]: cluster 2024-09-21T00:09:35.220824+0000 mgr.a (mgr.14388) 4976 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:36 smithi049 bash[23528]: audit 2024-09-21T00:09:35.394016+0000 mgr.a (mgr.14388) 4977 : audit [DBG] from='client.117114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:36 smithi044 bash[22676]: cluster 2024-09-21T00:09:35.220824+0000 mgr.a (mgr.14388) 4976 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:36 smithi044 bash[22676]: audit 2024-09-21T00:09:35.394016+0000 mgr.a (mgr.14388) 4977 : audit [DBG] from='client.117114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:36 smithi179 bash[23186]: cluster 2024-09-21T00:09:35.220824+0000 mgr.a (mgr.14388) 4976 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:36 smithi179 bash[23186]: audit 2024-09-21T00:09:35.394016+0000 mgr.a (mgr.14388) 4977 : audit [DBG] from='client.117114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:38.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:38 smithi049 bash[23528]: cluster 2024-09-21T00:09:37.221793+0000 mgr.a (mgr.14388) 4978 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:09:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:38 smithi044 bash[22676]: cluster 2024-09-21T00:09:37.221793+0000 mgr.a (mgr.14388) 4978 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:09:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:38 smithi179 bash[23186]: cluster 2024-09-21T00:09:37.221793+0000 mgr.a (mgr.14388) 4978 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:09:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:40 smithi049 bash[23528]: cluster 2024-09-21T00:09:39.222578+0000 mgr.a (mgr.14388) 4979 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:40 smithi044 bash[22676]: cluster 2024-09-21T00:09:39.222578+0000 mgr.a (mgr.14388) 4979 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:40 smithi179 bash[23186]: cluster 2024-09-21T00:09:39.222578+0000 mgr.a (mgr.14388) 4979 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:41.583 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:42 smithi049 bash[23528]: audit 2024-09-21T00:09:41.166337+0000 mgr.a (mgr.14388) 4980 : audit [DBG] from='client.117192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:42 smithi049 bash[23528]: cluster 2024-09-21T00:09:41.225621+0000 mgr.a (mgr.14388) 4981 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:42 smithi044 bash[22676]: audit 2024-09-21T00:09:41.166337+0000 mgr.a (mgr.14388) 4980 : audit [DBG] from='client.117192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:42 smithi044 bash[22676]: cluster 2024-09-21T00:09:41.225621+0000 mgr.a (mgr.14388) 4981 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:42 smithi179 bash[23186]: audit 2024-09-21T00:09:41.166337+0000 mgr.a (mgr.14388) 4980 : audit [DBG] from='client.117192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:42 smithi179 bash[23186]: cluster 2024-09-21T00:09:41.225621+0000 mgr.a (mgr.14388) 4981 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: cluster 2024-09-21T00:09:43.226523+0000 mgr.a (mgr.14388) 4982 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:43.486491+0000 mon.a (mon.0) 4562 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:43.493818+0000 mon.a (mon.0) 4563 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:43.495726+0000 mon.a (mon.0) 4564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:43.506879+0000 mon.a (mon.0) 4565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:43.513975+0000 mon.a (mon.0) 4566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:44.101391+0000 mon.a (mon.0) 4567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:44.107237+0000 mon.a (mon.0) 4568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:44 smithi049 bash[23528]: audit 2024-09-21T00:09:44.114181+0000 mon.a (mon.0) 4569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22930]: debug 2024-09-21T00:09:44.260+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:09:44.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22930]: debug 2024-09-21T00:09:44.260+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:09:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: cluster 2024-09-21T00:09:43.226523+0000 mgr.a (mgr.14388) 4982 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:09:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:43.486491+0000 mon.a (mon.0) 4562 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:43.493818+0000 mon.a (mon.0) 4563 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:43.495726+0000 mon.a (mon.0) 4564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:43.506879+0000 mon.a (mon.0) 4565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:43.513975+0000 mon.a (mon.0) 4566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:44.101391+0000 mon.a (mon.0) 4567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:44.107237+0000 mon.a (mon.0) 4568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:44 smithi044 bash[22676]: audit 2024-09-21T00:09:44.114181+0000 mon.a (mon.0) 4569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: cluster 2024-09-21T00:09:43.226523+0000 mgr.a (mgr.14388) 4982 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:43.486491+0000 mon.a (mon.0) 4562 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:43.493818+0000 mon.a (mon.0) 4563 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:43.495726+0000 mon.a (mon.0) 4564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:43.506879+0000 mon.a (mon.0) 4565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:43.513975+0000 mon.a (mon.0) 4566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:44.101391+0000 mon.a (mon.0) 4567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:44.107237+0000 mon.a (mon.0) 4568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:44 smithi179 bash[23186]: audit 2024-09-21T00:09:44.114181+0000 mon.a (mon.0) 4569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:45.624 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:45 smithi044 bash[22676]: audit 2024-09-21T00:09:43.516539+0000 mgr.a (mgr.14388) 4983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:09:45.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:45 smithi044 bash[22676]: audit 2024-09-21T00:09:44.261348+0000 mgr.a (mgr.14388) 4984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:09:45.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:45 smithi044 bash[22676]: cephadm 2024-09-21T00:09:44.262362+0000 mgr.a (mgr.14388) 4985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:09:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:45 smithi179 bash[23186]: audit 2024-09-21T00:09:43.516539+0000 mgr.a (mgr.14388) 4983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:09:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:45 smithi179 bash[23186]: audit 2024-09-21T00:09:44.261348+0000 mgr.a (mgr.14388) 4984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:09:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:45 smithi179 bash[23186]: cephadm 2024-09-21T00:09:44.262362+0000 mgr.a (mgr.14388) 4985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:09:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:45 smithi049 bash[23528]: audit 2024-09-21T00:09:43.516539+0000 mgr.a (mgr.14388) 4983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:09:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:45 smithi049 bash[23528]: audit 2024-09-21T00:09:44.261348+0000 mgr.a (mgr.14388) 4984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:09:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:45 smithi049 bash[23528]: cephadm 2024-09-21T00:09:44.262362+0000 mgr.a (mgr.14388) 4985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:09:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:46 smithi044 bash[22676]: cluster 2024-09-21T00:09:45.228984+0000 mgr.a (mgr.14388) 4986 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:46.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:46.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:46.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:46 smithi179 bash[23186]: cluster 2024-09-21T00:09:45.228984+0000 mgr.a (mgr.14388) 4986 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:46.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:46 smithi049 bash[23528]: cluster 2024-09-21T00:09:45.228984+0000 mgr.a (mgr.14388) 4986 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:47.383 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:47.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:47.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:47.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:47.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:47.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:47 smithi044 bash[22676]: audit 2024-09-21T00:09:46.450526+0000 mon.a (mon.0) 4570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:47 smithi044 bash[22676]: audit 2024-09-21T00:09:46.459600+0000 mon.a (mon.0) 4571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:47 smithi044 bash[22676]: audit 2024-09-21T00:09:46.472040+0000 mon.a (mon.0) 4572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:47 smithi044 bash[22676]: audit 2024-09-21T00:09:46.924941+0000 mgr.a (mgr.14388) 4987 : audit [DBG] from='client.117375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:47.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:47 smithi044 bash[22676]: cluster 2024-09-21T00:09:47.229613+0000 mgr.a (mgr.14388) 4988 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:47 smithi179 bash[23186]: audit 2024-09-21T00:09:46.450526+0000 mon.a (mon.0) 4570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:47 smithi179 bash[23186]: audit 2024-09-21T00:09:46.459600+0000 mon.a (mon.0) 4571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:47 smithi179 bash[23186]: audit 2024-09-21T00:09:46.472040+0000 mon.a (mon.0) 4572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:47 smithi179 bash[23186]: audit 2024-09-21T00:09:46.924941+0000 mgr.a (mgr.14388) 4987 : audit [DBG] from='client.117375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:47 smithi179 bash[23186]: cluster 2024-09-21T00:09:47.229613+0000 mgr.a (mgr.14388) 4988 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:47 smithi049 bash[23528]: audit 2024-09-21T00:09:46.450526+0000 mon.a (mon.0) 4570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:47 smithi049 bash[23528]: audit 2024-09-21T00:09:46.459600+0000 mon.a (mon.0) 4571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:47 smithi049 bash[23528]: audit 2024-09-21T00:09:46.472040+0000 mon.a (mon.0) 4572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:47 smithi049 bash[23528]: audit 2024-09-21T00:09:46.924941+0000 mgr.a (mgr.14388) 4987 : audit [DBG] from='client.117375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:47 smithi049 bash[23528]: cluster 2024-09-21T00:09:47.229613+0000 mgr.a (mgr.14388) 4988 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:49 smithi044 bash[22676]: audit 2024-09-21T00:09:48.685778+0000 mon.a (mon.0) 4573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:49 smithi044 bash[22676]: audit 2024-09-21T00:09:48.693787+0000 mon.a (mon.0) 4574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:49 smithi044 bash[22676]: audit 2024-09-21T00:09:48.704598+0000 mon.a (mon.0) 4575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:49 smithi044 bash[22676]: cluster 2024-09-21T00:09:49.230415+0000 mgr.a (mgr.14388) 4989 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:49 smithi179 bash[23186]: audit 2024-09-21T00:09:48.685778+0000 mon.a (mon.0) 4573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:49 smithi179 bash[23186]: audit 2024-09-21T00:09:48.693787+0000 mon.a (mon.0) 4574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:49 smithi179 bash[23186]: audit 2024-09-21T00:09:48.704598+0000 mon.a (mon.0) 4575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:49 smithi179 bash[23186]: cluster 2024-09-21T00:09:49.230415+0000 mgr.a (mgr.14388) 4989 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:49 smithi049 bash[23528]: audit 2024-09-21T00:09:48.685778+0000 mon.a (mon.0) 4573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:49 smithi049 bash[23528]: audit 2024-09-21T00:09:48.693787+0000 mon.a (mon.0) 4574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:49 smithi049 bash[23528]: audit 2024-09-21T00:09:48.704598+0000 mon.a (mon.0) 4575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:09:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:49 smithi049 bash[23528]: cluster 2024-09-21T00:09:49.230415+0000 mgr.a (mgr.14388) 4989 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:52.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:52.385 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:52.385 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:52 smithi049 bash[23528]: cluster 2024-09-21T00:09:51.232610+0000 mgr.a (mgr.14388) 4990 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:52 smithi044 bash[22676]: cluster 2024-09-21T00:09:51.232610+0000 mgr.a (mgr.14388) 4990 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:52 smithi179 bash[23186]: cluster 2024-09-21T00:09:51.232610+0000 mgr.a (mgr.14388) 4990 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:53.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:53.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:09:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:54 smithi049 bash[23528]: audit 2024-09-21T00:09:52.724339+0000 mgr.a (mgr.14388) 4991 : audit [DBG] from='client.117447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:54 smithi049 bash[23528]: cluster 2024-09-21T00:09:53.233181+0000 mgr.a (mgr.14388) 4992 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:54 smithi044 bash[22676]: audit 2024-09-21T00:09:52.724339+0000 mgr.a (mgr.14388) 4991 : audit [DBG] from='client.117447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:54 smithi044 bash[22676]: cluster 2024-09-21T00:09:53.233181+0000 mgr.a (mgr.14388) 4992 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:54 smithi179 bash[23186]: audit 2024-09-21T00:09:52.724339+0000 mgr.a (mgr.14388) 4991 : audit [DBG] from='client.117447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:09:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:54 smithi179 bash[23186]: cluster 2024-09-21T00:09:53.233181+0000 mgr.a (mgr.14388) 4992 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:56 smithi049 bash[23528]: cluster 2024-09-21T00:09:55.235244+0000 mgr.a (mgr.14388) 4993 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:56 smithi044 bash[22676]: cluster 2024-09-21T00:09:55.235244+0000 mgr.a (mgr.14388) 4993 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:56 smithi179 bash[23186]: cluster 2024-09-21T00:09:55.235244+0000 mgr.a (mgr.14388) 4993 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:09:58.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:09:58.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:09:58.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:09:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:09:58 smithi044 bash[22676]: cluster 2024-09-21T00:09:57.235999+0000 mgr.a (mgr.14388) 4994 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:09:58 smithi179 bash[23186]: cluster 2024-09-21T00:09:57.235999+0000 mgr.a (mgr.14388) 4994 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:09:58 smithi049 bash[23528]: cluster 2024-09-21T00:09:57.235999+0000 mgr.a (mgr.14388) 4994 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:09:58.947 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:09:58.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:09:58.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:09:58.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:09:58.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:00 smithi044 bash[22676]: audit 2024-09-21T00:09:58.512076+0000 mgr.a (mgr.14388) 4995 : audit [DBG] from='client.117525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:00 smithi044 bash[22676]: cluster 2024-09-21T00:09:59.236882+0000 mgr.a (mgr.14388) 4996 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:00 smithi044 bash[22676]: cluster 2024-09-21T00:10:00.000151+0000 mon.a (mon.0) 4576 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:10:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:00 smithi179 bash[23186]: audit 2024-09-21T00:09:58.512076+0000 mgr.a (mgr.14388) 4995 : audit [DBG] from='client.117525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:00 smithi179 bash[23186]: cluster 2024-09-21T00:09:59.236882+0000 mgr.a (mgr.14388) 4996 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:00 smithi179 bash[23186]: cluster 2024-09-21T00:10:00.000151+0000 mon.a (mon.0) 4576 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:10:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:00 smithi049 bash[23528]: audit 2024-09-21T00:09:58.512076+0000 mgr.a (mgr.14388) 4995 : audit [DBG] from='client.117525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:00 smithi049 bash[23528]: cluster 2024-09-21T00:09:59.236882+0000 mgr.a (mgr.14388) 4996 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:00 smithi049 bash[23528]: cluster 2024-09-21T00:10:00.000151+0000 mon.a (mon.0) 4576 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:10:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:02 smithi044 bash[22676]: cluster 2024-09-21T00:10:01.239249+0000 mgr.a (mgr.14388) 4997 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:02 smithi179 bash[23186]: cluster 2024-09-21T00:10:01.239249+0000 mgr.a (mgr.14388) 4997 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:02 smithi049 bash[23528]: cluster 2024-09-21T00:10:01.239249+0000 mgr.a (mgr.14388) 4997 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:03.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:03.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:03.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:04 smithi049 bash[23528]: cluster 2024-09-21T00:10:03.240179+0000 mgr.a (mgr.14388) 4998 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:04 smithi049 bash[23528]: audit 2024-09-21T00:10:04.274441+0000 mon.a (mon.0) 4577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:04 smithi049 bash[23528]: audit 2024-09-21T00:10:04.282464+0000 mon.a (mon.0) 4578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:04 smithi049 bash[23528]: audit 2024-09-21T00:10:04.292916+0000 mon.a (mon.0) 4579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:04 smithi044 bash[22676]: cluster 2024-09-21T00:10:03.240179+0000 mgr.a (mgr.14388) 4998 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:04 smithi044 bash[22676]: audit 2024-09-21T00:10:04.274441+0000 mon.a (mon.0) 4577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:04 smithi044 bash[22676]: audit 2024-09-21T00:10:04.282464+0000 mon.a (mon.0) 4578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:04 smithi044 bash[22676]: audit 2024-09-21T00:10:04.292916+0000 mon.a (mon.0) 4579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:04.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:04.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:04.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:04.738 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:04 smithi179 bash[23186]: cluster 2024-09-21T00:10:03.240179+0000 mgr.a (mgr.14388) 4998 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:04 smithi179 bash[23186]: audit 2024-09-21T00:10:04.274441+0000 mon.a (mon.0) 4577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:04 smithi179 bash[23186]: audit 2024-09-21T00:10:04.282464+0000 mon.a (mon.0) 4578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:04 smithi179 bash[23186]: audit 2024-09-21T00:10:04.292916+0000 mon.a (mon.0) 4579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:05.623 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:05 smithi049 bash[23528]: audit 2024-09-21T00:10:04.288014+0000 mgr.a (mgr.14388) 4999 : audit [DBG] from='client.117597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:05.629 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:05 smithi179 bash[23186]: audit 2024-09-21T00:10:04.288014+0000 mgr.a (mgr.14388) 4999 : audit [DBG] from='client.117597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:05 smithi044 bash[22676]: audit 2024-09-21T00:10:04.288014+0000 mgr.a (mgr.14388) 4999 : audit [DBG] from='client.117597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:06.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:06 smithi049 bash[23528]: cluster 2024-09-21T00:10:05.242574+0000 mgr.a (mgr.14388) 5000 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:06.699 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:06 smithi179 bash[23186]: cluster 2024-09-21T00:10:05.242574+0000 mgr.a (mgr.14388) 5000 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:06.704 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:06 smithi044 bash[22676]: cluster 2024-09-21T00:10:05.242574+0000 mgr.a (mgr.14388) 5000 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:07 smithi044 bash[22676]: audit 2024-09-21T00:10:06.677491+0000 mon.a (mon.0) 4580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:07 smithi044 bash[22676]: audit 2024-09-21T00:10:06.685715+0000 mon.a (mon.0) 4581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:07 smithi044 bash[22676]: audit 2024-09-21T00:10:06.696414+0000 mon.a (mon.0) 4582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:07 smithi044 bash[22676]: cluster 2024-09-21T00:10:07.243228+0000 mgr.a (mgr.14388) 5001 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:07 smithi179 bash[23186]: audit 2024-09-21T00:10:06.677491+0000 mon.a (mon.0) 4580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:07 smithi179 bash[23186]: audit 2024-09-21T00:10:06.685715+0000 mon.a (mon.0) 4581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:07 smithi179 bash[23186]: audit 2024-09-21T00:10:06.696414+0000 mon.a (mon.0) 4582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:07 smithi179 bash[23186]: cluster 2024-09-21T00:10:07.243228+0000 mgr.a (mgr.14388) 5001 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:07 smithi049 bash[23528]: audit 2024-09-21T00:10:06.677491+0000 mon.a (mon.0) 4580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:07 smithi049 bash[23528]: audit 2024-09-21T00:10:06.685715+0000 mon.a (mon.0) 4581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:07 smithi049 bash[23528]: audit 2024-09-21T00:10:06.696414+0000 mon.a (mon.0) 4582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:07 smithi049 bash[23528]: cluster 2024-09-21T00:10:07.243228+0000 mgr.a (mgr.14388) 5001 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:09.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:09.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:09.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:09 smithi044 bash[22676]: audit 2024-09-21T00:10:08.818911+0000 mon.a (mon.0) 4583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:09 smithi044 bash[22676]: audit 2024-09-21T00:10:08.824505+0000 mon.a (mon.0) 4584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:09 smithi044 bash[22676]: audit 2024-09-21T00:10:08.831244+0000 mon.a (mon.0) 4585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:09 smithi044 bash[22676]: cluster 2024-09-21T00:10:09.243996+0000 mgr.a (mgr.14388) 5002 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:09 smithi179 bash[23186]: audit 2024-09-21T00:10:08.818911+0000 mon.a (mon.0) 4583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:09 smithi179 bash[23186]: audit 2024-09-21T00:10:08.824505+0000 mon.a (mon.0) 4584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:09 smithi179 bash[23186]: audit 2024-09-21T00:10:08.831244+0000 mon.a (mon.0) 4585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:09 smithi179 bash[23186]: cluster 2024-09-21T00:10:09.243996+0000 mgr.a (mgr.14388) 5002 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:09 smithi049 bash[23528]: audit 2024-09-21T00:10:08.818911+0000 mon.a (mon.0) 4583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:09 smithi049 bash[23528]: audit 2024-09-21T00:10:08.824505+0000 mon.a (mon.0) 4584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:09 smithi049 bash[23528]: audit 2024-09-21T00:10:08.831244+0000 mon.a (mon.0) 4585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:09 smithi049 bash[23528]: cluster 2024-09-21T00:10:09.243996+0000 mgr.a (mgr.14388) 5002 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:10.496 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:10.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:10.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:10.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:10.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:10 smithi044 bash[22676]: audit 2024-09-21T00:10:10.072182+0000 mgr.a (mgr.14388) 5003 : audit [DBG] from='client.117672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:10 smithi179 bash[23186]: audit 2024-09-21T00:10:10.072182+0000 mgr.a (mgr.14388) 5003 : audit [DBG] from='client.117672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:10 smithi049 bash[23528]: audit 2024-09-21T00:10:10.072182+0000 mgr.a (mgr.14388) 5003 : audit [DBG] from='client.117672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:11 smithi044 bash[22676]: cluster 2024-09-21T00:10:11.246864+0000 mgr.a (mgr.14388) 5004 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:11 smithi179 bash[23186]: cluster 2024-09-21T00:10:11.246864+0000 mgr.a (mgr.14388) 5004 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:11 smithi049 bash[23528]: cluster 2024-09-21T00:10:11.246864+0000 mgr.a (mgr.14388) 5004 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:14 smithi044 bash[22676]: cluster 2024-09-21T00:10:13.247691+0000 mgr.a (mgr.14388) 5005 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:10:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:14 smithi179 bash[23186]: cluster 2024-09-21T00:10:13.247691+0000 mgr.a (mgr.14388) 5005 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:10:14.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:14 smithi049 bash[23528]: cluster 2024-09-21T00:10:13.247691+0000 mgr.a (mgr.14388) 5005 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:10:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:15.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:15.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:16.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:16 smithi044 bash[22676]: cluster 2024-09-21T00:10:15.249640+0000 mgr.a (mgr.14388) 5006 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:16 smithi179 bash[23186]: cluster 2024-09-21T00:10:15.249640+0000 mgr.a (mgr.14388) 5006 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:16.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:16 smithi049 bash[23528]: cluster 2024-09-21T00:10:15.249640+0000 mgr.a (mgr.14388) 5006 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:17 smithi044 bash[22676]: audit 2024-09-21T00:10:15.827213+0000 mgr.a (mgr.14388) 5007 : audit [DBG] from='client.117747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:17 smithi179 bash[23186]: audit 2024-09-21T00:10:15.827213+0000 mgr.a (mgr.14388) 5007 : audit [DBG] from='client.117747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:17 smithi049 bash[23528]: audit 2024-09-21T00:10:15.827213+0000 mgr.a (mgr.14388) 5007 : audit [DBG] from='client.117747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:18 smithi044 bash[22676]: cluster 2024-09-21T00:10:17.250767+0000 mgr.a (mgr.14388) 5008 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:10:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:18 smithi179 bash[23186]: cluster 2024-09-21T00:10:17.250767+0000 mgr.a (mgr.14388) 5008 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:10:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:18 smithi049 bash[23528]: cluster 2024-09-21T00:10:17.250767+0000 mgr.a (mgr.14388) 5008 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:10:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:20 smithi044 bash[22676]: cluster 2024-09-21T00:10:19.251755+0000 mgr.a (mgr.14388) 5009 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:10:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:20 smithi179 bash[23186]: cluster 2024-09-21T00:10:19.251755+0000 mgr.a (mgr.14388) 5009 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:10:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:20 smithi049 bash[23528]: cluster 2024-09-21T00:10:19.251755+0000 mgr.a (mgr.14388) 5009 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:10:21.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:22.029 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:22.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:22.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:22.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:22.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:22 smithi044 bash[22676]: cluster 2024-09-21T00:10:21.254144+0000 mgr.a (mgr.14388) 5010 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:22 smithi179 bash[23186]: cluster 2024-09-21T00:10:21.254144+0000 mgr.a (mgr.14388) 5010 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:22 smithi049 bash[23528]: cluster 2024-09-21T00:10:21.254144+0000 mgr.a (mgr.14388) 5010 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:23 smithi044 bash[22676]: audit 2024-09-21T00:10:21.594507+0000 mgr.a (mgr.14388) 5011 : audit [DBG] from='client.117822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:23 smithi179 bash[23186]: audit 2024-09-21T00:10:21.594507+0000 mgr.a (mgr.14388) 5011 : audit [DBG] from='client.117822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:23 smithi049 bash[23528]: audit 2024-09-21T00:10:21.594507+0000 mgr.a (mgr.14388) 5011 : audit [DBG] from='client.117822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:24 smithi044 bash[22676]: cluster 2024-09-21T00:10:23.255139+0000 mgr.a (mgr.14388) 5012 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:24 smithi179 bash[23186]: cluster 2024-09-21T00:10:23.255139+0000 mgr.a (mgr.14388) 5012 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:24 smithi049 bash[23528]: cluster 2024-09-21T00:10:23.255139+0000 mgr.a (mgr.14388) 5012 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:25.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:25 smithi179 bash[23186]: audit 2024-09-21T00:10:24.481852+0000 mon.a (mon.0) 4586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:25 smithi179 bash[23186]: audit 2024-09-21T00:10:24.490501+0000 mon.a (mon.0) 4587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:25 smithi179 bash[23186]: audit 2024-09-21T00:10:24.501314+0000 mon.a (mon.0) 4588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:25 smithi179 bash[23186]: cluster 2024-09-21T00:10:25.257322+0000 mgr.a (mgr.14388) 5013 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:25 smithi044 bash[22676]: audit 2024-09-21T00:10:24.481852+0000 mon.a (mon.0) 4586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:25 smithi044 bash[22676]: audit 2024-09-21T00:10:24.490501+0000 mon.a (mon.0) 4587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:25 smithi044 bash[22676]: audit 2024-09-21T00:10:24.501314+0000 mon.a (mon.0) 4588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:25 smithi044 bash[22676]: cluster 2024-09-21T00:10:25.257322+0000 mgr.a (mgr.14388) 5013 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:25 smithi049 bash[23528]: audit 2024-09-21T00:10:24.481852+0000 mon.a (mon.0) 4586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:25 smithi049 bash[23528]: audit 2024-09-21T00:10:24.490501+0000 mon.a (mon.0) 4587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:25 smithi049 bash[23528]: audit 2024-09-21T00:10:24.501314+0000 mon.a (mon.0) 4588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:25 smithi049 bash[23528]: cluster 2024-09-21T00:10:25.257322+0000 mgr.a (mgr.14388) 5013 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:27.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:27.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:27.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:27.811 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:27.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:27.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:27.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:27.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:27 smithi179 bash[23186]: audit 2024-09-21T00:10:26.887064+0000 mon.a (mon.0) 4589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:27 smithi179 bash[23186]: audit 2024-09-21T00:10:26.896136+0000 mon.a (mon.0) 4590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:27 smithi179 bash[23186]: audit 2024-09-21T00:10:26.906281+0000 mon.a (mon.0) 4591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:27 smithi179 bash[23186]: cluster 2024-09-21T00:10:27.257905+0000 mgr.a (mgr.14388) 5014 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:27 smithi179 bash[23186]: audit 2024-09-21T00:10:27.374285+0000 mgr.a (mgr.14388) 5015 : audit [DBG] from='client.117900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:28.160 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:27 smithi049 bash[23528]: audit 2024-09-21T00:10:26.887064+0000 mon.a (mon.0) 4589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.161 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:27 smithi049 bash[23528]: audit 2024-09-21T00:10:26.896136+0000 mon.a (mon.0) 4590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.161 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:27 smithi049 bash[23528]: audit 2024-09-21T00:10:26.906281+0000 mon.a (mon.0) 4591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.161 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:27 smithi049 bash[23528]: cluster 2024-09-21T00:10:27.257905+0000 mgr.a (mgr.14388) 5014 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:28.161 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:27 smithi049 bash[23528]: audit 2024-09-21T00:10:27.374285+0000 mgr.a (mgr.14388) 5015 : audit [DBG] from='client.117900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:27 smithi044 bash[22676]: audit 2024-09-21T00:10:26.887064+0000 mon.a (mon.0) 4589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:27 smithi044 bash[22676]: audit 2024-09-21T00:10:26.896136+0000 mon.a (mon.0) 4590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:27 smithi044 bash[22676]: audit 2024-09-21T00:10:26.906281+0000 mon.a (mon.0) 4591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:27 smithi044 bash[22676]: cluster 2024-09-21T00:10:27.257905+0000 mgr.a (mgr.14388) 5014 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:27 smithi044 bash[22676]: audit 2024-09-21T00:10:27.374285+0000 mgr.a (mgr.14388) 5015 : audit [DBG] from='client.117900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:30 smithi044 bash[22676]: audit 2024-09-21T00:10:29.002495+0000 mon.a (mon.0) 4592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:30 smithi044 bash[22676]: audit 2024-09-21T00:10:29.011977+0000 mon.a (mon.0) 4593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:30 smithi044 bash[22676]: audit 2024-09-21T00:10:29.023310+0000 mon.a (mon.0) 4594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:30 smithi044 bash[22676]: cluster 2024-09-21T00:10:29.258811+0000 mgr.a (mgr.14388) 5016 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:30 smithi179 bash[23186]: audit 2024-09-21T00:10:29.002495+0000 mon.a (mon.0) 4592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:30 smithi179 bash[23186]: audit 2024-09-21T00:10:29.011977+0000 mon.a (mon.0) 4593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:30 smithi179 bash[23186]: audit 2024-09-21T00:10:29.023310+0000 mon.a (mon.0) 4594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:30 smithi179 bash[23186]: cluster 2024-09-21T00:10:29.258811+0000 mgr.a (mgr.14388) 5016 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:30 smithi049 bash[23528]: audit 2024-09-21T00:10:29.002495+0000 mon.a (mon.0) 4592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:30 smithi049 bash[23528]: audit 2024-09-21T00:10:29.011977+0000 mon.a (mon.0) 4593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:30 smithi049 bash[23528]: audit 2024-09-21T00:10:29.023310+0000 mon.a (mon.0) 4594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:30 smithi049 bash[23528]: cluster 2024-09-21T00:10:29.258811+0000 mgr.a (mgr.14388) 5016 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:32 smithi044 bash[22676]: cluster 2024-09-21T00:10:31.261047+0000 mgr.a (mgr.14388) 5017 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:32 smithi179 bash[23186]: cluster 2024-09-21T00:10:31.261047+0000 mgr.a (mgr.14388) 5017 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:32 smithi049 bash[23528]: cluster 2024-09-21T00:10:31.261047+0000 mgr.a (mgr.14388) 5017 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:32.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:33.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:33.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:33.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:33.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:34 smithi044 bash[22676]: audit 2024-09-21T00:10:33.144999+0000 mgr.a (mgr.14388) 5018 : audit [DBG] from='client.117975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:34 smithi044 bash[22676]: cluster 2024-09-21T00:10:33.261574+0000 mgr.a (mgr.14388) 5019 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:34 smithi179 bash[23186]: audit 2024-09-21T00:10:33.144999+0000 mgr.a (mgr.14388) 5018 : audit [DBG] from='client.117975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:34 smithi179 bash[23186]: cluster 2024-09-21T00:10:33.261574+0000 mgr.a (mgr.14388) 5019 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:34 smithi049 bash[23528]: audit 2024-09-21T00:10:33.144999+0000 mgr.a (mgr.14388) 5018 : audit [DBG] from='client.117975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:34 smithi049 bash[23528]: cluster 2024-09-21T00:10:33.261574+0000 mgr.a (mgr.14388) 5019 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:36 smithi044 bash[22676]: cluster 2024-09-21T00:10:35.263843+0000 mgr.a (mgr.14388) 5020 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:36 smithi179 bash[23186]: cluster 2024-09-21T00:10:35.263843+0000 mgr.a (mgr.14388) 5020 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:36 smithi049 bash[23528]: cluster 2024-09-21T00:10:35.263843+0000 mgr.a (mgr.14388) 5020 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:38.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:38.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:38.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:38 smithi044 bash[22676]: cluster 2024-09-21T00:10:37.264785+0000 mgr.a (mgr.14388) 5021 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:38 smithi179 bash[23186]: cluster 2024-09-21T00:10:37.264785+0000 mgr.a (mgr.14388) 5021 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:38 smithi049 bash[23528]: cluster 2024-09-21T00:10:37.264785+0000 mgr.a (mgr.14388) 5021 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:39.354 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:39.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:39.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:40 smithi044 bash[22676]: audit 2024-09-21T00:10:38.913951+0000 mgr.a (mgr.14388) 5022 : audit [DBG] from='client.118053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:40 smithi044 bash[22676]: cluster 2024-09-21T00:10:39.265386+0000 mgr.a (mgr.14388) 5023 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:40 smithi179 bash[23186]: audit 2024-09-21T00:10:38.913951+0000 mgr.a (mgr.14388) 5022 : audit [DBG] from='client.118053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:40 smithi179 bash[23186]: cluster 2024-09-21T00:10:39.265386+0000 mgr.a (mgr.14388) 5023 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:40 smithi049 bash[23528]: audit 2024-09-21T00:10:38.913951+0000 mgr.a (mgr.14388) 5022 : audit [DBG] from='client.118053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:40 smithi049 bash[23528]: cluster 2024-09-21T00:10:39.265386+0000 mgr.a (mgr.14388) 5023 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:42 smithi044 bash[22676]: cluster 2024-09-21T00:10:41.267537+0000 mgr.a (mgr.14388) 5024 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:42 smithi179 bash[23186]: cluster 2024-09-21T00:10:41.267537+0000 mgr.a (mgr.14388) 5024 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:42 smithi049 bash[23528]: cluster 2024-09-21T00:10:41.267537+0000 mgr.a (mgr.14388) 5024 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:10:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:44.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:44.700 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:44 smithi049 bash[23528]: cluster 2024-09-21T00:10:43.268305+0000 mgr.a (mgr.14388) 5025 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:44.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:44 smithi049 bash[23528]: audit 2024-09-21T00:10:44.317549+0000 mon.a (mon.0) 4595 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:10:44.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:44 smithi049 bash[23528]: audit 2024-09-21T00:10:44.324855+0000 mon.a (mon.0) 4596 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:10:44.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:44 smithi049 bash[23528]: audit 2024-09-21T00:10:44.326873+0000 mon.a (mon.0) 4597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:10:44.701 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:44 smithi049 bash[23528]: audit 2024-09-21T00:10:44.338606+0000 mon.a (mon.0) 4598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:44 smithi044 bash[22676]: cluster 2024-09-21T00:10:43.268305+0000 mgr.a (mgr.14388) 5025 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:44 smithi044 bash[22676]: audit 2024-09-21T00:10:44.317549+0000 mon.a (mon.0) 4595 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:10:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:44 smithi044 bash[22676]: audit 2024-09-21T00:10:44.324855+0000 mon.a (mon.0) 4596 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:10:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:44 smithi044 bash[22676]: audit 2024-09-21T00:10:44.326873+0000 mon.a (mon.0) 4597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:10:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:44 smithi044 bash[22676]: audit 2024-09-21T00:10:44.338606+0000 mon.a (mon.0) 4598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:44 smithi179 bash[23186]: cluster 2024-09-21T00:10:43.268305+0000 mgr.a (mgr.14388) 5025 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:10:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:44 smithi179 bash[23186]: audit 2024-09-21T00:10:44.317549+0000 mon.a (mon.0) 4595 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:10:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:44 smithi179 bash[23186]: audit 2024-09-21T00:10:44.324855+0000 mon.a (mon.0) 4596 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:10:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:44 smithi179 bash[23186]: audit 2024-09-21T00:10:44.326873+0000 mon.a (mon.0) 4597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:10:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:44 smithi179 bash[23186]: audit 2024-09-21T00:10:44.338606+0000 mon.a (mon.0) 4598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:45 smithi044 bash[22676]: audit 2024-09-21T00:10:44.352067+0000 mon.a (mon.0) 4599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:10:45.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:45 smithi044 bash[22676]: audit 2024-09-21T00:10:44.354489+0000 mgr.a (mgr.14388) 5026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:10:45.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:45 smithi044 bash[22676]: audit 2024-09-21T00:10:44.685815+0000 mon.a (mon.0) 4600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:45 smithi044 bash[22676]: audit 2024-09-21T00:10:44.693061+0000 mon.a (mon.0) 4601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:45 smithi044 bash[22676]: audit 2024-09-21T00:10:44.699261+0000 mon.a (mon.0) 4602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.430 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:10:45 smithi044 bash[22930]: debug 2024-09-21T00:10:45.119+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:10:45.430 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:10:45 smithi044 bash[22930]: debug 2024-09-21T00:10:45.135+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:10:45.540 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:45.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:45.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:45.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:45.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:45.698 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:45 smithi179 bash[23186]: audit 2024-09-21T00:10:44.352067+0000 mon.a (mon.0) 4599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:10:45.698 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:45 smithi179 bash[23186]: audit 2024-09-21T00:10:44.354489+0000 mgr.a (mgr.14388) 5026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:10:45.698 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:45 smithi179 bash[23186]: audit 2024-09-21T00:10:44.685815+0000 mon.a (mon.0) 4600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.698 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:45 smithi179 bash[23186]: audit 2024-09-21T00:10:44.693061+0000 mon.a (mon.0) 4601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.698 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:45 smithi179 bash[23186]: audit 2024-09-21T00:10:44.699261+0000 mon.a (mon.0) 4602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:45 smithi049 bash[23528]: audit 2024-09-21T00:10:44.352067+0000 mon.a (mon.0) 4599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:10:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:45 smithi049 bash[23528]: audit 2024-09-21T00:10:44.354489+0000 mgr.a (mgr.14388) 5026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:10:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:45 smithi049 bash[23528]: audit 2024-09-21T00:10:44.685815+0000 mon.a (mon.0) 4600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:45 smithi049 bash[23528]: audit 2024-09-21T00:10:44.693061+0000 mon.a (mon.0) 4601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:45 smithi049 bash[23528]: audit 2024-09-21T00:10:44.699261+0000 mon.a (mon.0) 4602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:46.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:46 smithi044 bash[22676]: audit 2024-09-21T00:10:44.718461+0000 mgr.a (mgr.14388) 5027 : audit [DBG] from='client.118146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:46.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:46 smithi044 bash[22676]: audit 2024-09-21T00:10:45.125065+0000 mgr.a (mgr.14388) 5028 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:10:46.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:46 smithi044 bash[22676]: cephadm 2024-09-21T00:10:45.138189+0000 mgr.a (mgr.14388) 5029 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:10:46.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:46 smithi044 bash[22676]: cluster 2024-09-21T00:10:45.269720+0000 mgr.a (mgr.14388) 5030 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T00:10:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:46 smithi179 bash[23186]: audit 2024-09-21T00:10:44.718461+0000 mgr.a (mgr.14388) 5027 : audit [DBG] from='client.118146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:46 smithi179 bash[23186]: audit 2024-09-21T00:10:45.125065+0000 mgr.a (mgr.14388) 5028 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:10:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:46 smithi179 bash[23186]: cephadm 2024-09-21T00:10:45.138189+0000 mgr.a (mgr.14388) 5029 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:10:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:46 smithi179 bash[23186]: cluster 2024-09-21T00:10:45.269720+0000 mgr.a (mgr.14388) 5030 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T00:10:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:46 smithi049 bash[23528]: audit 2024-09-21T00:10:44.718461+0000 mgr.a (mgr.14388) 5027 : audit [DBG] from='client.118146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:46 smithi049 bash[23528]: audit 2024-09-21T00:10:45.125065+0000 mgr.a (mgr.14388) 5028 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:10:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:46 smithi049 bash[23528]: cephadm 2024-09-21T00:10:45.138189+0000 mgr.a (mgr.14388) 5029 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:10:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:46 smithi049 bash[23528]: cluster 2024-09-21T00:10:45.269720+0000 mgr.a (mgr.14388) 5030 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T00:10:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:48 smithi179 bash[23186]: audit 2024-09-21T00:10:47.086074+0000 mon.a (mon.0) 4603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:48 smithi179 bash[23186]: audit 2024-09-21T00:10:47.094482+0000 mon.a (mon.0) 4604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:48 smithi179 bash[23186]: audit 2024-09-21T00:10:47.104806+0000 mon.a (mon.0) 4605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:48 smithi179 bash[23186]: cluster 2024-09-21T00:10:47.270577+0000 mgr.a (mgr.14388) 5031 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:10:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:48 smithi049 bash[23528]: audit 2024-09-21T00:10:47.086074+0000 mon.a (mon.0) 4603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:48 smithi049 bash[23528]: audit 2024-09-21T00:10:47.094482+0000 mon.a (mon.0) 4604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:48 smithi049 bash[23528]: audit 2024-09-21T00:10:47.104806+0000 mon.a (mon.0) 4605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:48 smithi049 bash[23528]: cluster 2024-09-21T00:10:47.270577+0000 mgr.a (mgr.14388) 5031 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:10:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:48 smithi044 bash[22676]: audit 2024-09-21T00:10:47.086074+0000 mon.a (mon.0) 4603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:48 smithi044 bash[22676]: audit 2024-09-21T00:10:47.094482+0000 mon.a (mon.0) 4604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:48 smithi044 bash[22676]: audit 2024-09-21T00:10:47.104806+0000 mon.a (mon.0) 4605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:48 smithi044 bash[22676]: cluster 2024-09-21T00:10:47.270577+0000 mgr.a (mgr.14388) 5031 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:10:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:50 smithi044 bash[22676]: audit 2024-09-21T00:10:49.215457+0000 mon.a (mon.0) 4606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:50 smithi044 bash[22676]: audit 2024-09-21T00:10:49.223364+0000 mon.a (mon.0) 4607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:50 smithi044 bash[22676]: audit 2024-09-21T00:10:49.233349+0000 mon.a (mon.0) 4608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:50 smithi044 bash[22676]: cluster 2024-09-21T00:10:49.271364+0000 mgr.a (mgr.14388) 5032 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:10:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:50 smithi179 bash[23186]: audit 2024-09-21T00:10:49.215457+0000 mon.a (mon.0) 4606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:50 smithi179 bash[23186]: audit 2024-09-21T00:10:49.223364+0000 mon.a (mon.0) 4607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:50 smithi179 bash[23186]: audit 2024-09-21T00:10:49.233349+0000 mon.a (mon.0) 4608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:50 smithi179 bash[23186]: cluster 2024-09-21T00:10:49.271364+0000 mgr.a (mgr.14388) 5032 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:10:50.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:50.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:50.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:50.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:50 smithi049 bash[23528]: audit 2024-09-21T00:10:49.215457+0000 mon.a (mon.0) 4606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:50 smithi049 bash[23528]: audit 2024-09-21T00:10:49.223364+0000 mon.a (mon.0) 4607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:50 smithi049 bash[23528]: audit 2024-09-21T00:10:49.233349+0000 mon.a (mon.0) 4608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:10:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:50 smithi049 bash[23528]: cluster 2024-09-21T00:10:49.271364+0000 mgr.a (mgr.14388) 5032 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T00:10:51.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:51.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:51.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:51.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:51.329 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:52 smithi044 bash[22676]: audit 2024-09-21T00:10:50.879825+0000 mgr.a (mgr.14388) 5033 : audit [DBG] from='client.118308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:52 smithi044 bash[22676]: cluster 2024-09-21T00:10:51.272701+0000 mgr.a (mgr.14388) 5034 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:10:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:52 smithi179 bash[23186]: audit 2024-09-21T00:10:50.879825+0000 mgr.a (mgr.14388) 5033 : audit [DBG] from='client.118308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:52 smithi179 bash[23186]: cluster 2024-09-21T00:10:51.272701+0000 mgr.a (mgr.14388) 5034 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:10:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:52 smithi049 bash[23528]: audit 2024-09-21T00:10:50.879825+0000 mgr.a (mgr.14388) 5033 : audit [DBG] from='client.118308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:52 smithi049 bash[23528]: cluster 2024-09-21T00:10:51.272701+0000 mgr.a (mgr.14388) 5034 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:10:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:54 smithi044 bash[22676]: cluster 2024-09-21T00:10:53.273626+0000 mgr.a (mgr.14388) 5035 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:10:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:54 smithi179 bash[23186]: cluster 2024-09-21T00:10:53.273626+0000 mgr.a (mgr.14388) 5035 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:10:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:54 smithi049 bash[23528]: cluster 2024-09-21T00:10:53.273626+0000 mgr.a (mgr.14388) 5035 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:10:56.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:10:56.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:10:56.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:10:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:56 smithi044 bash[22676]: cluster 2024-09-21T00:10:55.275694+0000 mgr.a (mgr.14388) 5036 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:10:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:56 smithi179 bash[23186]: cluster 2024-09-21T00:10:55.275694+0000 mgr.a (mgr.14388) 5036 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:10:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:56 smithi049 bash[23528]: cluster 2024-09-21T00:10:55.275694+0000 mgr.a (mgr.14388) 5036 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:10:57.108 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:10:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:10:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:10:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:10:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:10:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:58 smithi044 bash[22676]: audit 2024-09-21T00:10:56.663924+0000 mgr.a (mgr.14388) 5037 : audit [DBG] from='client.118386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:10:58 smithi044 bash[22676]: cluster 2024-09-21T00:10:57.276677+0000 mgr.a (mgr.14388) 5038 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:10:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:58 smithi179 bash[23186]: audit 2024-09-21T00:10:56.663924+0000 mgr.a (mgr.14388) 5037 : audit [DBG] from='client.118386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:10:58 smithi179 bash[23186]: cluster 2024-09-21T00:10:57.276677+0000 mgr.a (mgr.14388) 5038 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:10:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:58 smithi049 bash[23528]: audit 2024-09-21T00:10:56.663924+0000 mgr.a (mgr.14388) 5037 : audit [DBG] from='client.118386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:10:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:10:58 smithi049 bash[23528]: cluster 2024-09-21T00:10:57.276677+0000 mgr.a (mgr.14388) 5038 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:11:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:00 smithi044 bash[22676]: cluster 2024-09-21T00:10:59.277511+0000 mgr.a (mgr.14388) 5039 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:11:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:00 smithi179 bash[23186]: cluster 2024-09-21T00:10:59.277511+0000 mgr.a (mgr.14388) 5039 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:11:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:00 smithi049 bash[23528]: cluster 2024-09-21T00:10:59.277511+0000 mgr.a (mgr.14388) 5039 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T00:11:02.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:02.111 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:02.111 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:02 smithi044 bash[22676]: cluster 2024-09-21T00:11:01.279706+0000 mgr.a (mgr.14388) 5040 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T00:11:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:02 smithi179 bash[23186]: cluster 2024-09-21T00:11:01.279706+0000 mgr.a (mgr.14388) 5040 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T00:11:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:02 smithi049 bash[23528]: cluster 2024-09-21T00:11:01.279706+0000 mgr.a (mgr.14388) 5040 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T00:11:02.875 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:04 smithi044 bash[22676]: audit 2024-09-21T00:11:02.445790+0000 mgr.a (mgr.14388) 5041 : audit [DBG] from='client.118464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:04 smithi044 bash[22676]: cluster 2024-09-21T00:11:03.280624+0000 mgr.a (mgr.14388) 5042 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:04 smithi179 bash[23186]: audit 2024-09-21T00:11:02.445790+0000 mgr.a (mgr.14388) 5041 : audit [DBG] from='client.118464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:04 smithi179 bash[23186]: cluster 2024-09-21T00:11:03.280624+0000 mgr.a (mgr.14388) 5042 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:04 smithi049 bash[23528]: audit 2024-09-21T00:11:02.445790+0000 mgr.a (mgr.14388) 5041 : audit [DBG] from='client.118464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:04 smithi049 bash[23528]: cluster 2024-09-21T00:11:03.280624+0000 mgr.a (mgr.14388) 5042 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:06.189 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:05 smithi049 bash[23528]: audit 2024-09-21T00:11:04.913075+0000 mon.a (mon.0) 4609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.189 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:05 smithi049 bash[23528]: audit 2024-09-21T00:11:04.923039+0000 mon.a (mon.0) 4610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.189 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:05 smithi049 bash[23528]: audit 2024-09-21T00:11:04.933813+0000 mon.a (mon.0) 4611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.189 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:05 smithi049 bash[23528]: cluster 2024-09-21T00:11:05.282798+0000 mgr.a (mgr.14388) 5043 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:05 smithi044 bash[22676]: audit 2024-09-21T00:11:04.913075+0000 mon.a (mon.0) 4609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:05 smithi044 bash[22676]: audit 2024-09-21T00:11:04.923039+0000 mon.a (mon.0) 4610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:05 smithi044 bash[22676]: audit 2024-09-21T00:11:04.933813+0000 mon.a (mon.0) 4611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:05 smithi044 bash[22676]: cluster 2024-09-21T00:11:05.282798+0000 mgr.a (mgr.14388) 5043 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:05 smithi179 bash[23186]: audit 2024-09-21T00:11:04.913075+0000 mon.a (mon.0) 4609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:05 smithi179 bash[23186]: audit 2024-09-21T00:11:04.923039+0000 mon.a (mon.0) 4610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:05 smithi179 bash[23186]: audit 2024-09-21T00:11:04.933813+0000 mon.a (mon.0) 4611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:05 smithi179 bash[23186]: cluster 2024-09-21T00:11:05.282798+0000 mgr.a (mgr.14388) 5043 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:07.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:07.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:07.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:08.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:08 smithi049 bash[23528]: cluster 2024-09-21T00:11:07.283511+0000 mgr.a (mgr.14388) 5044 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:08.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:08 smithi049 bash[23528]: audit 2024-09-21T00:11:07.290703+0000 mon.a (mon.0) 4612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:08 smithi049 bash[23528]: audit 2024-09-21T00:11:07.299198+0000 mon.a (mon.0) 4613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:08 smithi049 bash[23528]: audit 2024-09-21T00:11:07.308826+0000 mon.a (mon.0) 4614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.696 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:08.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:08.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:08.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:08.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:08 smithi044 bash[22676]: cluster 2024-09-21T00:11:07.283511+0000 mgr.a (mgr.14388) 5044 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:08 smithi044 bash[22676]: audit 2024-09-21T00:11:07.290703+0000 mon.a (mon.0) 4612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:08 smithi044 bash[22676]: audit 2024-09-21T00:11:07.299198+0000 mon.a (mon.0) 4613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:08 smithi044 bash[22676]: audit 2024-09-21T00:11:07.308826+0000 mon.a (mon.0) 4614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:08 smithi179 bash[23186]: cluster 2024-09-21T00:11:07.283511+0000 mgr.a (mgr.14388) 5044 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:08 smithi179 bash[23186]: audit 2024-09-21T00:11:07.290703+0000 mon.a (mon.0) 4612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:08 smithi179 bash[23186]: audit 2024-09-21T00:11:07.299198+0000 mon.a (mon.0) 4613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:08 smithi179 bash[23186]: audit 2024-09-21T00:11:07.308826+0000 mon.a (mon.0) 4614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:09 smithi049 bash[23528]: audit 2024-09-21T00:11:08.221264+0000 mgr.a (mgr.14388) 5045 : audit [DBG] from='client.118542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:09 smithi044 bash[22676]: audit 2024-09-21T00:11:08.221264+0000 mgr.a (mgr.14388) 5045 : audit [DBG] from='client.118542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:09 smithi179 bash[23186]: audit 2024-09-21T00:11:08.221264+0000 mgr.a (mgr.14388) 5045 : audit [DBG] from='client.118542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:10 smithi044 bash[22676]: cluster 2024-09-21T00:11:09.284290+0000 mgr.a (mgr.14388) 5046 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:10 smithi044 bash[22676]: audit 2024-09-21T00:11:09.442317+0000 mon.a (mon.0) 4615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:10 smithi044 bash[22676]: audit 2024-09-21T00:11:09.450613+0000 mon.a (mon.0) 4616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:10 smithi044 bash[22676]: audit 2024-09-21T00:11:09.461362+0000 mon.a (mon.0) 4617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:10 smithi049 bash[23528]: cluster 2024-09-21T00:11:09.284290+0000 mgr.a (mgr.14388) 5046 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:10 smithi049 bash[23528]: audit 2024-09-21T00:11:09.442317+0000 mon.a (mon.0) 4615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:10 smithi049 bash[23528]: audit 2024-09-21T00:11:09.450613+0000 mon.a (mon.0) 4616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:10 smithi049 bash[23528]: audit 2024-09-21T00:11:09.461362+0000 mon.a (mon.0) 4617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:10 smithi179 bash[23186]: cluster 2024-09-21T00:11:09.284290+0000 mgr.a (mgr.14388) 5046 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:10 smithi179 bash[23186]: audit 2024-09-21T00:11:09.442317+0000 mon.a (mon.0) 4615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:10 smithi179 bash[23186]: audit 2024-09-21T00:11:09.450613+0000 mon.a (mon.0) 4616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:10 smithi179 bash[23186]: audit 2024-09-21T00:11:09.461362+0000 mon.a (mon.0) 4617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:12 smithi044 bash[22676]: cluster 2024-09-21T00:11:11.286543+0000 mgr.a (mgr.14388) 5047 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:12 smithi179 bash[23186]: cluster 2024-09-21T00:11:11.286543+0000 mgr.a (mgr.14388) 5047 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:12 smithi049 bash[23528]: cluster 2024-09-21T00:11:11.286543+0000 mgr.a (mgr.14388) 5047 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:13.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:13.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:13.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:14 smithi044 bash[22676]: cluster 2024-09-21T00:11:13.287290+0000 mgr.a (mgr.14388) 5048 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:14 smithi179 bash[23186]: cluster 2024-09-21T00:11:13.287290+0000 mgr.a (mgr.14388) 5048 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:14 smithi049 bash[23528]: cluster 2024-09-21T00:11:13.287290+0000 mgr.a (mgr.14388) 5048 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:15 smithi044 bash[22676]: audit 2024-09-21T00:11:14.032696+0000 mgr.a (mgr.14388) 5049 : audit [DBG] from='client.118620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:15 smithi179 bash[23186]: audit 2024-09-21T00:11:14.032696+0000 mgr.a (mgr.14388) 5049 : audit [DBG] from='client.118620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:15 smithi049 bash[23528]: audit 2024-09-21T00:11:14.032696+0000 mgr.a (mgr.14388) 5049 : audit [DBG] from='client.118620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:16 smithi044 bash[22676]: cluster 2024-09-21T00:11:15.289657+0000 mgr.a (mgr.14388) 5050 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:16 smithi179 bash[23186]: cluster 2024-09-21T00:11:15.289657+0000 mgr.a (mgr.14388) 5050 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:16.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:16 smithi049 bash[23528]: cluster 2024-09-21T00:11:15.289657+0000 mgr.a (mgr.14388) 5050 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:18 smithi044 bash[22676]: cluster 2024-09-21T00:11:17.290474+0000 mgr.a (mgr.14388) 5051 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:18 smithi179 bash[23186]: cluster 2024-09-21T00:11:17.290474+0000 mgr.a (mgr.14388) 5051 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:18 smithi049 bash[23528]: cluster 2024-09-21T00:11:17.290474+0000 mgr.a (mgr.14388) 5051 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:19.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:19.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:19.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:20.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:20.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:20 smithi044 bash[22676]: cluster 2024-09-21T00:11:19.291435+0000 mgr.a (mgr.14388) 5052 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:20 smithi179 bash[23186]: cluster 2024-09-21T00:11:19.291435+0000 mgr.a (mgr.14388) 5052 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:20 smithi049 bash[23528]: cluster 2024-09-21T00:11:19.291435+0000 mgr.a (mgr.14388) 5052 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:21 smithi044 bash[22676]: audit 2024-09-21T00:11:19.826179+0000 mgr.a (mgr.14388) 5053 : audit [DBG] from='client.118695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:21 smithi179 bash[23186]: audit 2024-09-21T00:11:19.826179+0000 mgr.a (mgr.14388) 5053 : audit [DBG] from='client.118695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:21 smithi049 bash[23528]: audit 2024-09-21T00:11:19.826179+0000 mgr.a (mgr.14388) 5053 : audit [DBG] from='client.118695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:22 smithi044 bash[22676]: cluster 2024-09-21T00:11:21.294318+0000 mgr.a (mgr.14388) 5054 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:22 smithi179 bash[23186]: cluster 2024-09-21T00:11:21.294318+0000 mgr.a (mgr.14388) 5054 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:22.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:22 smithi049 bash[23528]: cluster 2024-09-21T00:11:21.294318+0000 mgr.a (mgr.14388) 5054 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:24.698 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:24 smithi179 bash[23186]: cluster 2024-09-21T00:11:23.295240+0000 mgr.a (mgr.14388) 5055 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:11:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:24 smithi044 bash[22676]: cluster 2024-09-21T00:11:23.295240+0000 mgr.a (mgr.14388) 5055 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:11:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:24 smithi049 bash[23528]: cluster 2024-09-21T00:11:23.295240+0000 mgr.a (mgr.14388) 5055 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:11:25.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:25.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:25.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:26.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:26.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:26 smithi179 bash[23186]: audit 2024-09-21T00:11:25.149577+0000 mon.a (mon.0) 4618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:26 smithi179 bash[23186]: audit 2024-09-21T00:11:25.158346+0000 mon.a (mon.0) 4619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:26 smithi179 bash[23186]: audit 2024-09-21T00:11:25.169117+0000 mon.a (mon.0) 4620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:26 smithi179 bash[23186]: cluster 2024-09-21T00:11:25.296553+0000 mgr.a (mgr.14388) 5056 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:26 smithi044 bash[22676]: audit 2024-09-21T00:11:25.149577+0000 mon.a (mon.0) 4618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:26 smithi044 bash[22676]: audit 2024-09-21T00:11:25.158346+0000 mon.a (mon.0) 4619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:26 smithi044 bash[22676]: audit 2024-09-21T00:11:25.169117+0000 mon.a (mon.0) 4620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:26 smithi044 bash[22676]: cluster 2024-09-21T00:11:25.296553+0000 mgr.a (mgr.14388) 5056 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:26.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:26 smithi049 bash[23528]: audit 2024-09-21T00:11:25.149577+0000 mon.a (mon.0) 4618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:26 smithi049 bash[23528]: audit 2024-09-21T00:11:25.158346+0000 mon.a (mon.0) 4619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:26 smithi049 bash[23528]: audit 2024-09-21T00:11:25.169117+0000 mon.a (mon.0) 4620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:26.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:26 smithi049 bash[23528]: cluster 2024-09-21T00:11:25.296553+0000 mgr.a (mgr.14388) 5056 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:27.443 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:27 smithi044 bash[22676]: audit 2024-09-21T00:11:25.581070+0000 mgr.a (mgr.14388) 5057 : audit [DBG] from='client.118773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:27.489 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:27 smithi179 bash[23186]: audit 2024-09-21T00:11:25.581070+0000 mgr.a (mgr.14388) 5057 : audit [DBG] from='client.118773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:27.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:27 smithi049 bash[23528]: audit 2024-09-21T00:11:25.581070+0000 mgr.a (mgr.14388) 5057 : audit [DBG] from='client.118773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:28 smithi179 bash[23186]: cluster 2024-09-21T00:11:27.297222+0000 mgr.a (mgr.14388) 5058 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:11:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:28 smithi179 bash[23186]: audit 2024-09-21T00:11:27.464989+0000 mon.a (mon.0) 4621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:28 smithi179 bash[23186]: audit 2024-09-21T00:11:27.475424+0000 mon.a (mon.0) 4622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:28 smithi179 bash[23186]: audit 2024-09-21T00:11:27.486286+0000 mon.a (mon.0) 4623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:28 smithi049 bash[23528]: cluster 2024-09-21T00:11:27.297222+0000 mgr.a (mgr.14388) 5058 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:11:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:28 smithi049 bash[23528]: audit 2024-09-21T00:11:27.464989+0000 mon.a (mon.0) 4621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:28 smithi049 bash[23528]: audit 2024-09-21T00:11:27.475424+0000 mon.a (mon.0) 4622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:28 smithi049 bash[23528]: audit 2024-09-21T00:11:27.486286+0000 mon.a (mon.0) 4623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:28 smithi044 bash[22676]: cluster 2024-09-21T00:11:27.297222+0000 mgr.a (mgr.14388) 5058 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:11:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:28 smithi044 bash[22676]: audit 2024-09-21T00:11:27.464989+0000 mon.a (mon.0) 4621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:28 smithi044 bash[22676]: audit 2024-09-21T00:11:27.475424+0000 mon.a (mon.0) 4622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:28 smithi044 bash[22676]: audit 2024-09-21T00:11:27.486286+0000 mon.a (mon.0) 4623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:30 smithi044 bash[22676]: cluster 2024-09-21T00:11:29.298014+0000 mgr.a (mgr.14388) 5059 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:11:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:30 smithi044 bash[22676]: audit 2024-09-21T00:11:29.643404+0000 mon.a (mon.0) 4624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:30 smithi044 bash[22676]: audit 2024-09-21T00:11:29.650685+0000 mon.a (mon.0) 4625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:30 smithi044 bash[22676]: audit 2024-09-21T00:11:29.659532+0000 mon.a (mon.0) 4626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:30 smithi179 bash[23186]: cluster 2024-09-21T00:11:29.298014+0000 mgr.a (mgr.14388) 5059 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:11:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:30 smithi179 bash[23186]: audit 2024-09-21T00:11:29.643404+0000 mon.a (mon.0) 4624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:30 smithi179 bash[23186]: audit 2024-09-21T00:11:29.650685+0000 mon.a (mon.0) 4625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:30 smithi179 bash[23186]: audit 2024-09-21T00:11:29.659532+0000 mon.a (mon.0) 4626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:30 smithi049 bash[23528]: cluster 2024-09-21T00:11:29.298014+0000 mgr.a (mgr.14388) 5059 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:11:30.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:30 smithi049 bash[23528]: audit 2024-09-21T00:11:29.643404+0000 mon.a (mon.0) 4624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:30 smithi049 bash[23528]: audit 2024-09-21T00:11:29.650685+0000 mon.a (mon.0) 4625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:30.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:30 smithi049 bash[23528]: audit 2024-09-21T00:11:29.659532+0000 mon.a (mon.0) 4626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:31.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:31.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:31.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:31.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:31.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:32 smithi044 bash[22676]: cluster 2024-09-21T00:11:31.300135+0000 mgr.a (mgr.14388) 5060 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:32 smithi044 bash[22676]: audit 2024-09-21T00:11:31.348103+0000 mgr.a (mgr.14388) 5061 : audit [DBG] from='client.118848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:32 smithi179 bash[23186]: cluster 2024-09-21T00:11:31.300135+0000 mgr.a (mgr.14388) 5060 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:32 smithi179 bash[23186]: audit 2024-09-21T00:11:31.348103+0000 mgr.a (mgr.14388) 5061 : audit [DBG] from='client.118848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:32 smithi049 bash[23528]: cluster 2024-09-21T00:11:31.300135+0000 mgr.a (mgr.14388) 5060 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:32 smithi049 bash[23528]: audit 2024-09-21T00:11:31.348103+0000 mgr.a (mgr.14388) 5061 : audit [DBG] from='client.118848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:34 smithi044 bash[22676]: cluster 2024-09-21T00:11:33.301040+0000 mgr.a (mgr.14388) 5062 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:34 smithi179 bash[23186]: cluster 2024-09-21T00:11:33.301040+0000 mgr.a (mgr.14388) 5062 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:34 smithi049 bash[23528]: cluster 2024-09-21T00:11:33.301040+0000 mgr.a (mgr.14388) 5062 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:36 smithi044 bash[22676]: cluster 2024-09-21T00:11:35.303213+0000 mgr.a (mgr.14388) 5063 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:36 smithi179 bash[23186]: cluster 2024-09-21T00:11:35.303213+0000 mgr.a (mgr.14388) 5063 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:36 smithi049 bash[23528]: cluster 2024-09-21T00:11:35.303213+0000 mgr.a (mgr.14388) 5063 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:36.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:36.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:36.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:37.591 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:38 smithi044 bash[22676]: audit 2024-09-21T00:11:37.137065+0000 mgr.a (mgr.14388) 5064 : audit [DBG] from='client.118926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:38 smithi044 bash[22676]: cluster 2024-09-21T00:11:37.303792+0000 mgr.a (mgr.14388) 5065 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:38 smithi179 bash[23186]: audit 2024-09-21T00:11:37.137065+0000 mgr.a (mgr.14388) 5064 : audit [DBG] from='client.118926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:38 smithi179 bash[23186]: cluster 2024-09-21T00:11:37.303792+0000 mgr.a (mgr.14388) 5065 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:38 smithi049 bash[23528]: audit 2024-09-21T00:11:37.137065+0000 mgr.a (mgr.14388) 5064 : audit [DBG] from='client.118926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:38 smithi049 bash[23528]: cluster 2024-09-21T00:11:37.303792+0000 mgr.a (mgr.14388) 5065 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:40 smithi044 bash[22676]: cluster 2024-09-21T00:11:39.304672+0000 mgr.a (mgr.14388) 5066 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:40 smithi179 bash[23186]: cluster 2024-09-21T00:11:39.304672+0000 mgr.a (mgr.14388) 5066 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:40 smithi049 bash[23528]: cluster 2024-09-21T00:11:39.304672+0000 mgr.a (mgr.14388) 5066 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:42.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:42.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:42.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:42 smithi044 bash[22676]: cluster 2024-09-21T00:11:41.306947+0000 mgr.a (mgr.14388) 5067 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:42 smithi179 bash[23186]: cluster 2024-09-21T00:11:41.306947+0000 mgr.a (mgr.14388) 5067 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:42 smithi049 bash[23528]: cluster 2024-09-21T00:11:41.306947+0000 mgr.a (mgr.14388) 5067 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:43.357 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:44 smithi044 bash[22676]: audit 2024-09-21T00:11:42.920650+0000 mgr.a (mgr.14388) 5068 : audit [DBG] from='client.119004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:44 smithi044 bash[22676]: cluster 2024-09-21T00:11:43.307621+0000 mgr.a (mgr.14388) 5069 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:44 smithi179 bash[23186]: audit 2024-09-21T00:11:42.920650+0000 mgr.a (mgr.14388) 5068 : audit [DBG] from='client.119004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:44 smithi179 bash[23186]: cluster 2024-09-21T00:11:43.307621+0000 mgr.a (mgr.14388) 5069 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:44.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:44 smithi049 bash[23528]: audit 2024-09-21T00:11:42.920650+0000 mgr.a (mgr.14388) 5068 : audit [DBG] from='client.119004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:44 smithi049 bash[23528]: cluster 2024-09-21T00:11:43.307621+0000 mgr.a (mgr.14388) 5069 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:45.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:45 smithi179 bash[23186]: audit 2024-09-21T00:11:45.196789+0000 mon.a (mon.0) 4627 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:11:45.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:45 smithi179 bash[23186]: audit 2024-09-21T00:11:45.360055+0000 mon.a (mon.0) 4628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:45 smithi179 bash[23186]: audit 2024-09-21T00:11:45.369124+0000 mon.a (mon.0) 4629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:45 smithi179 bash[23186]: audit 2024-09-21T00:11:45.379485+0000 mon.a (mon.0) 4630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.716 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:45 smithi044 bash[22676]: audit 2024-09-21T00:11:45.196789+0000 mon.a (mon.0) 4627 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:11:45.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:45 smithi044 bash[22676]: audit 2024-09-21T00:11:45.360055+0000 mon.a (mon.0) 4628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:45 smithi044 bash[22676]: audit 2024-09-21T00:11:45.369124+0000 mon.a (mon.0) 4629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:45 smithi044 bash[22676]: audit 2024-09-21T00:11:45.379485+0000 mon.a (mon.0) 4630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:45 smithi049 bash[23528]: audit 2024-09-21T00:11:45.196789+0000 mon.a (mon.0) 4627 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:11:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:45 smithi049 bash[23528]: audit 2024-09-21T00:11:45.360055+0000 mon.a (mon.0) 4628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:45 smithi049 bash[23528]: audit 2024-09-21T00:11:45.369124+0000 mon.a (mon.0) 4629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:45 smithi049 bash[23528]: audit 2024-09-21T00:11:45.379485+0000 mon.a (mon.0) 4630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.648 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: cluster 2024-09-21T00:11:45.310013+0000 mgr.a (mgr.14388) 5070 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.789967+0000 mon.a (mon.0) 4631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.793936+0000 mon.a (mon.0) 4632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.809464+0000 mon.a (mon.0) 4633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.814503+0000 mon.a (mon.0) 4634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.815493+0000 mon.a (mon.0) 4635 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.816283+0000 mon.a (mon.0) 4636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.821424+0000 mon.a (mon.0) 4637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:46 smithi179 bash[23186]: audit 2024-09-21T00:11:45.823770+0000 mon.a (mon.0) 4638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:11:46.652 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22930]: debug 2024-09-21T00:11:46.522+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:11:46.652 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22930]: debug 2024-09-21T00:11:46.526+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:11:46.652 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: cluster 2024-09-21T00:11:45.310013+0000 mgr.a (mgr.14388) 5070 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:46.652 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.789967+0000 mon.a (mon.0) 4631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.793936+0000 mon.a (mon.0) 4632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.809464+0000 mon.a (mon.0) 4633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.814503+0000 mon.a (mon.0) 4634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.815493+0000 mon.a (mon.0) 4635 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:11:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.816283+0000 mon.a (mon.0) 4636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:11:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.821424+0000 mon.a (mon.0) 4637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:46 smithi044 bash[22676]: audit 2024-09-21T00:11:45.823770+0000 mon.a (mon.0) 4638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: cluster 2024-09-21T00:11:45.310013+0000 mgr.a (mgr.14388) 5070 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.789967+0000 mon.a (mon.0) 4631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.793936+0000 mon.a (mon.0) 4632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.809464+0000 mon.a (mon.0) 4633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.814503+0000 mon.a (mon.0) 4634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.815493+0000 mon.a (mon.0) 4635 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.816283+0000 mon.a (mon.0) 4636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.821424+0000 mon.a (mon.0) 4637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:46 smithi049 bash[23528]: audit 2024-09-21T00:11:45.823770+0000 mon.a (mon.0) 4638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:11:47.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:47 smithi179 bash[23186]: audit 2024-09-21T00:11:45.824875+0000 mgr.a (mgr.14388) 5071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:11:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:47 smithi044 bash[22676]: audit 2024-09-21T00:11:45.824875+0000 mgr.a (mgr.14388) 5071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:11:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:47 smithi049 bash[23528]: audit 2024-09-21T00:11:45.824875+0000 mgr.a (mgr.14388) 5071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:11:48.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:48.359 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:48.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:48 smithi044 bash[22676]: audit 2024-09-21T00:11:46.529162+0000 mgr.a (mgr.14388) 5072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:11:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:48 smithi044 bash[22676]: cephadm 2024-09-21T00:11:46.530262+0000 mgr.a (mgr.14388) 5073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:11:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:48 smithi044 bash[22676]: cluster 2024-09-21T00:11:47.311026+0000 mgr.a (mgr.14388) 5074 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:48 smithi044 bash[22676]: audit 2024-09-21T00:11:47.672904+0000 mon.a (mon.0) 4639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:48 smithi044 bash[22676]: audit 2024-09-21T00:11:47.682738+0000 mon.a (mon.0) 4640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:48 smithi044 bash[22676]: audit 2024-09-21T00:11:47.694527+0000 mon.a (mon.0) 4641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:48 smithi179 bash[23186]: audit 2024-09-21T00:11:46.529162+0000 mgr.a (mgr.14388) 5072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:11:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:48 smithi179 bash[23186]: cephadm 2024-09-21T00:11:46.530262+0000 mgr.a (mgr.14388) 5073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:11:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:48 smithi179 bash[23186]: cluster 2024-09-21T00:11:47.311026+0000 mgr.a (mgr.14388) 5074 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:48 smithi179 bash[23186]: audit 2024-09-21T00:11:47.672904+0000 mon.a (mon.0) 4639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:48 smithi179 bash[23186]: audit 2024-09-21T00:11:47.682738+0000 mon.a (mon.0) 4640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:48 smithi179 bash[23186]: audit 2024-09-21T00:11:47.694527+0000 mon.a (mon.0) 4641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:48 smithi049 bash[23528]: audit 2024-09-21T00:11:46.529162+0000 mgr.a (mgr.14388) 5072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:11:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:48 smithi049 bash[23528]: cephadm 2024-09-21T00:11:46.530262+0000 mgr.a (mgr.14388) 5073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:11:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:48 smithi049 bash[23528]: cluster 2024-09-21T00:11:47.311026+0000 mgr.a (mgr.14388) 5074 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:48 smithi049 bash[23528]: audit 2024-09-21T00:11:47.672904+0000 mon.a (mon.0) 4639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:48 smithi049 bash[23528]: audit 2024-09-21T00:11:47.682738+0000 mon.a (mon.0) 4640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:48 smithi049 bash[23528]: audit 2024-09-21T00:11:47.694527+0000 mon.a (mon.0) 4641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:49.120 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:49.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:50 smithi044 bash[22676]: audit 2024-09-21T00:11:48.697500+0000 mgr.a (mgr.14388) 5075 : audit [DBG] from='client.119184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:50 smithi044 bash[22676]: cluster 2024-09-21T00:11:49.312009+0000 mgr.a (mgr.14388) 5076 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:50 smithi044 bash[22676]: audit 2024-09-21T00:11:49.807064+0000 mon.a (mon.0) 4642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:50 smithi044 bash[22676]: audit 2024-09-21T00:11:49.812603+0000 mon.a (mon.0) 4643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:50 smithi044 bash[22676]: audit 2024-09-21T00:11:49.820509+0000 mon.a (mon.0) 4644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:50 smithi179 bash[23186]: audit 2024-09-21T00:11:48.697500+0000 mgr.a (mgr.14388) 5075 : audit [DBG] from='client.119184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:50 smithi179 bash[23186]: cluster 2024-09-21T00:11:49.312009+0000 mgr.a (mgr.14388) 5076 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:50 smithi179 bash[23186]: audit 2024-09-21T00:11:49.807064+0000 mon.a (mon.0) 4642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:50 smithi179 bash[23186]: audit 2024-09-21T00:11:49.812603+0000 mon.a (mon.0) 4643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:50 smithi179 bash[23186]: audit 2024-09-21T00:11:49.820509+0000 mon.a (mon.0) 4644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:50 smithi049 bash[23528]: audit 2024-09-21T00:11:48.697500+0000 mgr.a (mgr.14388) 5075 : audit [DBG] from='client.119184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:50 smithi049 bash[23528]: cluster 2024-09-21T00:11:49.312009+0000 mgr.a (mgr.14388) 5076 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:11:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:50 smithi049 bash[23528]: audit 2024-09-21T00:11:49.807064+0000 mon.a (mon.0) 4642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:50 smithi049 bash[23528]: audit 2024-09-21T00:11:49.812603+0000 mon.a (mon.0) 4643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:50 smithi049 bash[23528]: audit 2024-09-21T00:11:49.820509+0000 mon.a (mon.0) 4644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:11:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:52 smithi044 bash[22676]: cluster 2024-09-21T00:11:51.314351+0000 mgr.a (mgr.14388) 5077 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:52 smithi179 bash[23186]: cluster 2024-09-21T00:11:51.314351+0000 mgr.a (mgr.14388) 5077 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:52 smithi049 bash[23528]: cluster 2024-09-21T00:11:51.314351+0000 mgr.a (mgr.14388) 5077 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:54.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:54.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:54.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:11:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:54 smithi044 bash[22676]: cluster 2024-09-21T00:11:53.315214+0000 mgr.a (mgr.14388) 5078 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:54 smithi179 bash[23186]: cluster 2024-09-21T00:11:53.315214+0000 mgr.a (mgr.14388) 5078 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:54 smithi049 bash[23528]: cluster 2024-09-21T00:11:53.315214+0000 mgr.a (mgr.14388) 5078 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:54.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:11:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:11:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:11:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:11:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:11:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:56 smithi044 bash[22676]: audit 2024-09-21T00:11:54.461978+0000 mgr.a (mgr.14388) 5079 : audit [DBG] from='client.119259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:56 smithi044 bash[22676]: cluster 2024-09-21T00:11:55.317632+0000 mgr.a (mgr.14388) 5080 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:56 smithi179 bash[23186]: audit 2024-09-21T00:11:54.461978+0000 mgr.a (mgr.14388) 5079 : audit [DBG] from='client.119259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:56 smithi179 bash[23186]: cluster 2024-09-21T00:11:55.317632+0000 mgr.a (mgr.14388) 5080 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:56 smithi049 bash[23528]: audit 2024-09-21T00:11:54.461978+0000 mgr.a (mgr.14388) 5079 : audit [DBG] from='client.119259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:11:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:56 smithi049 bash[23528]: cluster 2024-09-21T00:11:55.317632+0000 mgr.a (mgr.14388) 5080 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:11:58 smithi044 bash[22676]: cluster 2024-09-21T00:11:57.318439+0000 mgr.a (mgr.14388) 5081 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:11:58 smithi179 bash[23186]: cluster 2024-09-21T00:11:57.318439+0000 mgr.a (mgr.14388) 5081 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:11:58 smithi049 bash[23528]: cluster 2024-09-21T00:11:57.318439+0000 mgr.a (mgr.14388) 5081 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:11:59.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:11:59.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:11:59.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:00.679 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:00 smithi044 bash[22676]: cluster 2024-09-21T00:11:59.319220+0000 mgr.a (mgr.14388) 5082 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:00 smithi179 bash[23186]: cluster 2024-09-21T00:11:59.319220+0000 mgr.a (mgr.14388) 5082 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:00 smithi049 bash[23528]: cluster 2024-09-21T00:11:59.319220+0000 mgr.a (mgr.14388) 5082 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:01 smithi044 bash[22676]: audit 2024-09-21T00:12:00.246897+0000 mgr.a (mgr.14388) 5083 : audit [DBG] from='client.119334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:01 smithi179 bash[23186]: audit 2024-09-21T00:12:00.246897+0000 mgr.a (mgr.14388) 5083 : audit [DBG] from='client.119334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:01 smithi049 bash[23528]: audit 2024-09-21T00:12:00.246897+0000 mgr.a (mgr.14388) 5083 : audit [DBG] from='client.119334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:02 smithi044 bash[22676]: cluster 2024-09-21T00:12:01.322243+0000 mgr.a (mgr.14388) 5084 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:02 smithi179 bash[23186]: cluster 2024-09-21T00:12:01.322243+0000 mgr.a (mgr.14388) 5084 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:02 smithi049 bash[23528]: cluster 2024-09-21T00:12:01.322243+0000 mgr.a (mgr.14388) 5084 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:03 smithi044 bash[22676]: cluster 2024-09-21T00:12:03.323215+0000 mgr.a (mgr.14388) 5085 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:03 smithi179 bash[23186]: cluster 2024-09-21T00:12:03.323215+0000 mgr.a (mgr.14388) 5085 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:03 smithi049 bash[23528]: cluster 2024-09-21T00:12:03.323215+0000 mgr.a (mgr.14388) 5085 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:05.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:05.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:06.448 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:06 smithi179 bash[23186]: cluster 2024-09-21T00:12:05.325308+0000 mgr.a (mgr.14388) 5086 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:06 smithi179 bash[23186]: audit 2024-09-21T00:12:05.601543+0000 mon.a (mon.0) 4645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:06 smithi179 bash[23186]: audit 2024-09-21T00:12:05.610482+0000 mon.a (mon.0) 4646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:06 smithi179 bash[23186]: audit 2024-09-21T00:12:05.620975+0000 mon.a (mon.0) 4647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.643 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:06 smithi044 bash[22676]: cluster 2024-09-21T00:12:05.325308+0000 mgr.a (mgr.14388) 5086 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:06.643 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:06 smithi044 bash[22676]: audit 2024-09-21T00:12:05.601543+0000 mon.a (mon.0) 4645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.643 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:06 smithi044 bash[22676]: audit 2024-09-21T00:12:05.610482+0000 mon.a (mon.0) 4646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.643 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:06 smithi044 bash[22676]: audit 2024-09-21T00:12:05.620975+0000 mon.a (mon.0) 4647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.706 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:06 smithi049 bash[23528]: cluster 2024-09-21T00:12:05.325308+0000 mgr.a (mgr.14388) 5086 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:06.706 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:06 smithi049 bash[23528]: audit 2024-09-21T00:12:05.601543+0000 mon.a (mon.0) 4645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.706 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:06 smithi049 bash[23528]: audit 2024-09-21T00:12:05.610482+0000 mon.a (mon.0) 4646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:06.706 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:06 smithi049 bash[23528]: audit 2024-09-21T00:12:05.620975+0000 mon.a (mon.0) 4647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:07.656 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:07 smithi044 bash[22676]: audit 2024-09-21T00:12:06.020105+0000 mgr.a (mgr.14388) 5087 : audit [DBG] from='client.119412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:07.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:07 smithi179 bash[23186]: audit 2024-09-21T00:12:06.020105+0000 mgr.a (mgr.14388) 5087 : audit [DBG] from='client.119412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:07.757 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:07 smithi049 bash[23528]: audit 2024-09-21T00:12:06.020105+0000 mgr.a (mgr.14388) 5087 : audit [DBG] from='client.119412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:08.674 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:08 smithi049 bash[23528]: cluster 2024-09-21T00:12:07.326321+0000 mgr.a (mgr.14388) 5088 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:08.674 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:08 smithi049 bash[23528]: audit 2024-09-21T00:12:07.822458+0000 mon.a (mon.0) 4648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.675 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:08 smithi049 bash[23528]: audit 2024-09-21T00:12:07.831016+0000 mon.a (mon.0) 4649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.675 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:08 smithi049 bash[23528]: audit 2024-09-21T00:12:07.841728+0000 mon.a (mon.0) 4650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:08 smithi044 bash[22676]: cluster 2024-09-21T00:12:07.326321+0000 mgr.a (mgr.14388) 5088 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:08 smithi044 bash[22676]: audit 2024-09-21T00:12:07.822458+0000 mon.a (mon.0) 4648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:08 smithi044 bash[22676]: audit 2024-09-21T00:12:07.831016+0000 mon.a (mon.0) 4649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:08 smithi044 bash[22676]: audit 2024-09-21T00:12:07.841728+0000 mon.a (mon.0) 4650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:08 smithi179 bash[23186]: cluster 2024-09-21T00:12:07.326321+0000 mgr.a (mgr.14388) 5088 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:08 smithi179 bash[23186]: audit 2024-09-21T00:12:07.822458+0000 mon.a (mon.0) 4648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:08 smithi179 bash[23186]: audit 2024-09-21T00:12:07.831016+0000 mon.a (mon.0) 4649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:08 smithi179 bash[23186]: audit 2024-09-21T00:12:07.841728+0000 mon.a (mon.0) 4650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:10 smithi044 bash[22676]: cluster 2024-09-21T00:12:09.327119+0000 mgr.a (mgr.14388) 5089 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:10 smithi044 bash[22676]: audit 2024-09-21T00:12:09.991546+0000 mon.a (mon.0) 4651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:10 smithi044 bash[22676]: audit 2024-09-21T00:12:09.997571+0000 mon.a (mon.0) 4652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:10 smithi044 bash[22676]: audit 2024-09-21T00:12:10.007169+0000 mon.a (mon.0) 4653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:10 smithi179 bash[23186]: cluster 2024-09-21T00:12:09.327119+0000 mgr.a (mgr.14388) 5089 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:10 smithi179 bash[23186]: audit 2024-09-21T00:12:09.991546+0000 mon.a (mon.0) 4651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:10 smithi179 bash[23186]: audit 2024-09-21T00:12:09.997571+0000 mon.a (mon.0) 4652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:10 smithi179 bash[23186]: audit 2024-09-21T00:12:10.007169+0000 mon.a (mon.0) 4653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:10 smithi049 bash[23528]: cluster 2024-09-21T00:12:09.327119+0000 mgr.a (mgr.14388) 5089 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:10 smithi049 bash[23528]: audit 2024-09-21T00:12:09.991546+0000 mon.a (mon.0) 4651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:10 smithi049 bash[23528]: audit 2024-09-21T00:12:09.997571+0000 mon.a (mon.0) 4652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:10 smithi049 bash[23528]: audit 2024-09-21T00:12:10.007169+0000 mon.a (mon.0) 4653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:12.235 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:12 smithi044 bash[22676]: cluster 2024-09-21T00:12:11.329344+0000 mgr.a (mgr.14388) 5090 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:12 smithi179 bash[23186]: cluster 2024-09-21T00:12:11.329344+0000 mgr.a (mgr.14388) 5090 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:12 smithi049 bash[23528]: cluster 2024-09-21T00:12:11.329344+0000 mgr.a (mgr.14388) 5090 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:13 smithi044 bash[22676]: audit 2024-09-21T00:12:11.794441+0000 mgr.a (mgr.14388) 5091 : audit [DBG] from='client.119484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:13 smithi179 bash[23186]: audit 2024-09-21T00:12:11.794441+0000 mgr.a (mgr.14388) 5091 : audit [DBG] from='client.119484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:13 smithi049 bash[23528]: audit 2024-09-21T00:12:11.794441+0000 mgr.a (mgr.14388) 5091 : audit [DBG] from='client.119484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:14 smithi044 bash[22676]: cluster 2024-09-21T00:12:13.330247+0000 mgr.a (mgr.14388) 5092 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:14 smithi179 bash[23186]: cluster 2024-09-21T00:12:13.330247+0000 mgr.a (mgr.14388) 5092 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:14.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:14 smithi049 bash[23528]: cluster 2024-09-21T00:12:13.330247+0000 mgr.a (mgr.14388) 5092 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:16 smithi044 bash[22676]: cluster 2024-09-21T00:12:15.332413+0000 mgr.a (mgr.14388) 5093 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:16 smithi179 bash[23186]: cluster 2024-09-21T00:12:15.332413+0000 mgr.a (mgr.14388) 5093 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:16.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:16 smithi049 bash[23528]: cluster 2024-09-21T00:12:15.332413+0000 mgr.a (mgr.14388) 5093 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:18.026 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:18.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:18.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:18.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:18.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:18 smithi044 bash[22676]: cluster 2024-09-21T00:12:17.333165+0000 mgr.a (mgr.14388) 5094 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:18 smithi179 bash[23186]: cluster 2024-09-21T00:12:17.333165+0000 mgr.a (mgr.14388) 5094 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:18 smithi049 bash[23528]: cluster 2024-09-21T00:12:17.333165+0000 mgr.a (mgr.14388) 5094 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:19 smithi044 bash[22676]: audit 2024-09-21T00:12:17.577490+0000 mgr.a (mgr.14388) 5095 : audit [DBG] from='client.119562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:19 smithi179 bash[23186]: audit 2024-09-21T00:12:17.577490+0000 mgr.a (mgr.14388) 5095 : audit [DBG] from='client.119562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:19 smithi049 bash[23528]: audit 2024-09-21T00:12:17.577490+0000 mgr.a (mgr.14388) 5095 : audit [DBG] from='client.119562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:20 smithi044 bash[22676]: cluster 2024-09-21T00:12:19.334107+0000 mgr.a (mgr.14388) 5096 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:20 smithi179 bash[23186]: cluster 2024-09-21T00:12:19.334107+0000 mgr.a (mgr.14388) 5096 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:20 smithi049 bash[23528]: cluster 2024-09-21T00:12:19.334107+0000 mgr.a (mgr.14388) 5096 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:22 smithi049 bash[23528]: cluster 2024-09-21T00:12:21.336343+0000 mgr.a (mgr.14388) 5097 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:22 smithi044 bash[22676]: cluster 2024-09-21T00:12:21.336343+0000 mgr.a (mgr.14388) 5097 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:22 smithi179 bash[23186]: cluster 2024-09-21T00:12:21.336343+0000 mgr.a (mgr.14388) 5097 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:23.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:23.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:23.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:23.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:23.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:24 smithi044 bash[22676]: cluster 2024-09-21T00:12:23.337074+0000 mgr.a (mgr.14388) 5098 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:24 smithi044 bash[22676]: audit 2024-09-21T00:12:23.364687+0000 mgr.a (mgr.14388) 5099 : audit [DBG] from='client.119640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:24 smithi179 bash[23186]: cluster 2024-09-21T00:12:23.337074+0000 mgr.a (mgr.14388) 5098 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:24 smithi179 bash[23186]: audit 2024-09-21T00:12:23.364687+0000 mgr.a (mgr.14388) 5099 : audit [DBG] from='client.119640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:24 smithi049 bash[23528]: cluster 2024-09-21T00:12:23.337074+0000 mgr.a (mgr.14388) 5098 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:24 smithi049 bash[23528]: audit 2024-09-21T00:12:23.364687+0000 mgr.a (mgr.14388) 5099 : audit [DBG] from='client.119640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:25 smithi179 bash[23186]: cluster 2024-09-21T00:12:25.339337+0000 mgr.a (mgr.14388) 5100 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:25 smithi049 bash[23528]: cluster 2024-09-21T00:12:25.339337+0000 mgr.a (mgr.14388) 5100 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:25 smithi044 bash[22676]: cluster 2024-09-21T00:12:25.339337+0000 mgr.a (mgr.14388) 5100 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:27.126 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:26 smithi049 bash[23528]: audit 2024-09-21T00:12:25.838902+0000 mon.a (mon.0) 4654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.126 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:26 smithi049 bash[23528]: audit 2024-09-21T00:12:25.847645+0000 mon.a (mon.0) 4655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.126 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:26 smithi049 bash[23528]: audit 2024-09-21T00:12:25.858149+0000 mon.a (mon.0) 4656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.211 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:26 smithi044 bash[22676]: audit 2024-09-21T00:12:25.838902+0000 mon.a (mon.0) 4654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.211 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:26 smithi044 bash[22676]: audit 2024-09-21T00:12:25.847645+0000 mon.a (mon.0) 4655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.211 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:26 smithi044 bash[22676]: audit 2024-09-21T00:12:25.858149+0000 mon.a (mon.0) 4656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:26 smithi179 bash[23186]: audit 2024-09-21T00:12:25.838902+0000 mon.a (mon.0) 4654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:26 smithi179 bash[23186]: audit 2024-09-21T00:12:25.847645+0000 mon.a (mon.0) 4655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:26 smithi179 bash[23186]: audit 2024-09-21T00:12:25.858149+0000 mon.a (mon.0) 4656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:27 smithi044 bash[22676]: cluster 2024-09-21T00:12:27.340146+0000 mgr.a (mgr.14388) 5101 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:27 smithi179 bash[23186]: cluster 2024-09-21T00:12:27.340146+0000 mgr.a (mgr.14388) 5101 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:27 smithi049 bash[23528]: cluster 2024-09-21T00:12:27.340146+0000 mgr.a (mgr.14388) 5101 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:28 smithi044 bash[22676]: audit 2024-09-21T00:12:27.980770+0000 mon.a (mon.0) 4657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:28 smithi044 bash[22676]: audit 2024-09-21T00:12:27.990968+0000 mon.a (mon.0) 4658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:28 smithi044 bash[22676]: audit 2024-09-21T00:12:28.001224+0000 mon.a (mon.0) 4659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:28 smithi179 bash[23186]: audit 2024-09-21T00:12:27.980770+0000 mon.a (mon.0) 4657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:28 smithi179 bash[23186]: audit 2024-09-21T00:12:27.990968+0000 mon.a (mon.0) 4658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:28 smithi179 bash[23186]: audit 2024-09-21T00:12:28.001224+0000 mon.a (mon.0) 4659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:28 smithi049 bash[23528]: audit 2024-09-21T00:12:27.980770+0000 mon.a (mon.0) 4657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:28 smithi049 bash[23528]: audit 2024-09-21T00:12:27.990968+0000 mon.a (mon.0) 4658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:28 smithi049 bash[23528]: audit 2024-09-21T00:12:28.001224+0000 mon.a (mon.0) 4659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:29.583 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:29.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:29.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:29.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:29.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:29 smithi044 bash[22676]: audit 2024-09-21T00:12:29.151552+0000 mgr.a (mgr.14388) 5102 : audit [DBG] from='client.119715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:29 smithi044 bash[22676]: cluster 2024-09-21T00:12:29.340810+0000 mgr.a (mgr.14388) 5103 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:29 smithi179 bash[23186]: audit 2024-09-21T00:12:29.151552+0000 mgr.a (mgr.14388) 5102 : audit [DBG] from='client.119715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:29 smithi179 bash[23186]: cluster 2024-09-21T00:12:29.340810+0000 mgr.a (mgr.14388) 5103 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:30.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:29 smithi049 bash[23528]: audit 2024-09-21T00:12:29.151552+0000 mgr.a (mgr.14388) 5102 : audit [DBG] from='client.119715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:29 smithi049 bash[23528]: cluster 2024-09-21T00:12:29.340810+0000 mgr.a (mgr.14388) 5103 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:31 smithi044 bash[22676]: audit 2024-09-21T00:12:30.196952+0000 mon.a (mon.0) 4660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:31 smithi044 bash[22676]: audit 2024-09-21T00:12:30.204806+0000 mon.a (mon.0) 4661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:31 smithi044 bash[22676]: audit 2024-09-21T00:12:30.215182+0000 mon.a (mon.0) 4662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:31 smithi179 bash[23186]: audit 2024-09-21T00:12:30.196952+0000 mon.a (mon.0) 4660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:31 smithi179 bash[23186]: audit 2024-09-21T00:12:30.204806+0000 mon.a (mon.0) 4661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:31 smithi179 bash[23186]: audit 2024-09-21T00:12:30.215182+0000 mon.a (mon.0) 4662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:31 smithi049 bash[23528]: audit 2024-09-21T00:12:30.196952+0000 mon.a (mon.0) 4660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:31 smithi049 bash[23528]: audit 2024-09-21T00:12:30.204806+0000 mon.a (mon.0) 4661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:31 smithi049 bash[23528]: audit 2024-09-21T00:12:30.215182+0000 mon.a (mon.0) 4662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:32 smithi044 bash[22676]: cluster 2024-09-21T00:12:31.343276+0000 mgr.a (mgr.14388) 5104 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:32 smithi179 bash[23186]: cluster 2024-09-21T00:12:31.343276+0000 mgr.a (mgr.14388) 5104 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:32 smithi049 bash[23528]: cluster 2024-09-21T00:12:31.343276+0000 mgr.a (mgr.14388) 5104 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:12:34.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:34.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:34.586 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:34 smithi044 bash[22676]: cluster 2024-09-21T00:12:33.344058+0000 mgr.a (mgr.14388) 5105 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:34 smithi179 bash[23186]: cluster 2024-09-21T00:12:33.344058+0000 mgr.a (mgr.14388) 5105 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:34 smithi049 bash[23528]: cluster 2024-09-21T00:12:33.344058+0000 mgr.a (mgr.14388) 5105 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:35.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:35.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:35.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:36 smithi044 bash[22676]: audit 2024-09-21T00:12:34.920098+0000 mgr.a (mgr.14388) 5106 : audit [DBG] from='client.119793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:36 smithi044 bash[22676]: cluster 2024-09-21T00:12:35.345430+0000 mgr.a (mgr.14388) 5107 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:36 smithi179 bash[23186]: audit 2024-09-21T00:12:34.920098+0000 mgr.a (mgr.14388) 5106 : audit [DBG] from='client.119793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:36 smithi179 bash[23186]: cluster 2024-09-21T00:12:35.345430+0000 mgr.a (mgr.14388) 5107 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:36 smithi049 bash[23528]: audit 2024-09-21T00:12:34.920098+0000 mgr.a (mgr.14388) 5106 : audit [DBG] from='client.119793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:36 smithi049 bash[23528]: cluster 2024-09-21T00:12:35.345430+0000 mgr.a (mgr.14388) 5107 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:38 smithi044 bash[22676]: cluster 2024-09-21T00:12:37.346167+0000 mgr.a (mgr.14388) 5108 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:12:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:38 smithi179 bash[23186]: cluster 2024-09-21T00:12:37.346167+0000 mgr.a (mgr.14388) 5108 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:12:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:38 smithi049 bash[23528]: cluster 2024-09-21T00:12:37.346167+0000 mgr.a (mgr.14388) 5108 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:12:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:40 smithi044 bash[22676]: cluster 2024-09-21T00:12:39.346941+0000 mgr.a (mgr.14388) 5109 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:12:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:40 smithi179 bash[23186]: cluster 2024-09-21T00:12:39.346941+0000 mgr.a (mgr.14388) 5109 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:12:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:40 smithi049 bash[23528]: cluster 2024-09-21T00:12:39.346941+0000 mgr.a (mgr.14388) 5109 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:12:41.134 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:41.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:41.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:41.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:41.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:42 smithi044 bash[22676]: audit 2024-09-21T00:12:40.703783+0000 mgr.a (mgr.14388) 5110 : audit [DBG] from='client.119868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:42 smithi044 bash[22676]: cluster 2024-09-21T00:12:41.349892+0000 mgr.a (mgr.14388) 5111 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:42 smithi179 bash[23186]: audit 2024-09-21T00:12:40.703783+0000 mgr.a (mgr.14388) 5110 : audit [DBG] from='client.119868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:42 smithi179 bash[23186]: cluster 2024-09-21T00:12:41.349892+0000 mgr.a (mgr.14388) 5111 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:42 smithi049 bash[23528]: audit 2024-09-21T00:12:40.703783+0000 mgr.a (mgr.14388) 5110 : audit [DBG] from='client.119868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:42 smithi049 bash[23528]: cluster 2024-09-21T00:12:41.349892+0000 mgr.a (mgr.14388) 5111 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:44 smithi044 bash[22676]: cluster 2024-09-21T00:12:43.350834+0000 mgr.a (mgr.14388) 5112 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:44 smithi179 bash[23186]: cluster 2024-09-21T00:12:43.350834+0000 mgr.a (mgr.14388) 5112 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:44.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:44 smithi049 bash[23528]: cluster 2024-09-21T00:12:43.350834+0000 mgr.a (mgr.14388) 5112 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:12:46.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:46.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:46.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:46 smithi179 bash[23186]: cluster 2024-09-21T00:12:45.352917+0000 mgr.a (mgr.14388) 5113 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:46 smithi179 bash[23186]: audit 2024-09-21T00:12:46.072701+0000 mon.a (mon.0) 4663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:46 smithi179 bash[23186]: audit 2024-09-21T00:12:46.081409+0000 mon.a (mon.0) 4664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:46 smithi179 bash[23186]: audit 2024-09-21T00:12:46.092059+0000 mon.a (mon.0) 4665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:46 smithi044 bash[22676]: cluster 2024-09-21T00:12:45.352917+0000 mgr.a (mgr.14388) 5113 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:46 smithi044 bash[22676]: audit 2024-09-21T00:12:46.072701+0000 mon.a (mon.0) 4663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:46 smithi044 bash[22676]: audit 2024-09-21T00:12:46.081409+0000 mon.a (mon.0) 4664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:46 smithi044 bash[22676]: audit 2024-09-21T00:12:46.092059+0000 mon.a (mon.0) 4665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:46 smithi049 bash[23528]: cluster 2024-09-21T00:12:45.352917+0000 mgr.a (mgr.14388) 5113 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:46 smithi049 bash[23528]: audit 2024-09-21T00:12:46.072701+0000 mon.a (mon.0) 4663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:46 smithi049 bash[23528]: audit 2024-09-21T00:12:46.081409+0000 mon.a (mon.0) 4664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:46 smithi049 bash[23528]: audit 2024-09-21T00:12:46.092059+0000 mon.a (mon.0) 4665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:46.927 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:46.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:46.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:46.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:46.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:47.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22676]: audit 2024-09-21T00:12:46.582905+0000 mon.a (mon.0) 4666 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:12:47.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22676]: audit 2024-09-21T00:12:47.143053+0000 mon.a (mon.0) 4667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22676]: audit 2024-09-21T00:12:47.150777+0000 mon.a (mon.0) 4668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22676]: audit 2024-09-21T00:12:47.153508+0000 mon.a (mon.0) 4669 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:12:47.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22676]: audit 2024-09-21T00:12:47.155287+0000 mon.a (mon.0) 4670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:12:47.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22676]: audit 2024-09-21T00:12:47.165719+0000 mon.a (mon.0) 4671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22676]: audit 2024-09-21T00:12:47.172487+0000 mon.a (mon.0) 4672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:12:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:47 smithi179 bash[23186]: audit 2024-09-21T00:12:46.582905+0000 mon.a (mon.0) 4666 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:12:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:47 smithi179 bash[23186]: audit 2024-09-21T00:12:47.143053+0000 mon.a (mon.0) 4667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:47 smithi179 bash[23186]: audit 2024-09-21T00:12:47.150777+0000 mon.a (mon.0) 4668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:47 smithi179 bash[23186]: audit 2024-09-21T00:12:47.153508+0000 mon.a (mon.0) 4669 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:12:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:47 smithi179 bash[23186]: audit 2024-09-21T00:12:47.155287+0000 mon.a (mon.0) 4670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:12:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:47 smithi179 bash[23186]: audit 2024-09-21T00:12:47.165719+0000 mon.a (mon.0) 4671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:47 smithi179 bash[23186]: audit 2024-09-21T00:12:47.172487+0000 mon.a (mon.0) 4672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:12:47.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:47 smithi049 bash[23528]: audit 2024-09-21T00:12:46.582905+0000 mon.a (mon.0) 4666 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:12:47.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:47 smithi049 bash[23528]: audit 2024-09-21T00:12:47.143053+0000 mon.a (mon.0) 4667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:47 smithi049 bash[23528]: audit 2024-09-21T00:12:47.150777+0000 mon.a (mon.0) 4668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:47 smithi049 bash[23528]: audit 2024-09-21T00:12:47.153508+0000 mon.a (mon.0) 4669 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:12:47.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:47 smithi049 bash[23528]: audit 2024-09-21T00:12:47.155287+0000 mon.a (mon.0) 4670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:12:47.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:47 smithi049 bash[23528]: audit 2024-09-21T00:12:47.165719+0000 mon.a (mon.0) 4671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:47.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:47 smithi049 bash[23528]: audit 2024-09-21T00:12:47.172487+0000 mon.a (mon.0) 4672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:12:47.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22930]: debug 2024-09-21T00:12:47.901+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:12:47.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:12:47 smithi044 bash[22930]: debug 2024-09-21T00:12:47.905+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:12:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:48 smithi044 bash[22676]: audit 2024-09-21T00:12:46.476718+0000 mgr.a (mgr.14388) 5114 : audit [DBG] from='client.119946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:48 smithi044 bash[22676]: audit 2024-09-21T00:12:47.175363+0000 mgr.a (mgr.14388) 5115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:12:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:48 smithi044 bash[22676]: cluster 2024-09-21T00:12:47.353496+0000 mgr.a (mgr.14388) 5116 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:48 smithi044 bash[22676]: audit 2024-09-21T00:12:48.146609+0000 mon.a (mon.0) 4673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:48 smithi044 bash[22676]: audit 2024-09-21T00:12:48.154759+0000 mon.a (mon.0) 4674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:48 smithi044 bash[22676]: audit 2024-09-21T00:12:48.166380+0000 mon.a (mon.0) 4675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:48 smithi179 bash[23186]: audit 2024-09-21T00:12:46.476718+0000 mgr.a (mgr.14388) 5114 : audit [DBG] from='client.119946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:48 smithi179 bash[23186]: audit 2024-09-21T00:12:47.175363+0000 mgr.a (mgr.14388) 5115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:12:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:48 smithi179 bash[23186]: cluster 2024-09-21T00:12:47.353496+0000 mgr.a (mgr.14388) 5116 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:48 smithi179 bash[23186]: audit 2024-09-21T00:12:48.146609+0000 mon.a (mon.0) 4673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:48 smithi179 bash[23186]: audit 2024-09-21T00:12:48.154759+0000 mon.a (mon.0) 4674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:48 smithi179 bash[23186]: audit 2024-09-21T00:12:48.166380+0000 mon.a (mon.0) 4675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:48 smithi049 bash[23528]: audit 2024-09-21T00:12:46.476718+0000 mgr.a (mgr.14388) 5114 : audit [DBG] from='client.119946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:48 smithi049 bash[23528]: audit 2024-09-21T00:12:47.175363+0000 mgr.a (mgr.14388) 5115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:12:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:48 smithi049 bash[23528]: cluster 2024-09-21T00:12:47.353496+0000 mgr.a (mgr.14388) 5116 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:48 smithi049 bash[23528]: audit 2024-09-21T00:12:48.146609+0000 mon.a (mon.0) 4673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:48 smithi049 bash[23528]: audit 2024-09-21T00:12:48.154759+0000 mon.a (mon.0) 4674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:48 smithi049 bash[23528]: audit 2024-09-21T00:12:48.166380+0000 mon.a (mon.0) 4675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:49 smithi044 bash[22676]: audit 2024-09-21T00:12:47.908274+0000 mgr.a (mgr.14388) 5117 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:12:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:49 smithi044 bash[22676]: cephadm 2024-09-21T00:12:47.909687+0000 mgr.a (mgr.14388) 5118 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:12:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:49 smithi179 bash[23186]: audit 2024-09-21T00:12:47.908274+0000 mgr.a (mgr.14388) 5117 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:12:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:49 smithi179 bash[23186]: cephadm 2024-09-21T00:12:47.909687+0000 mgr.a (mgr.14388) 5118 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:12:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:49 smithi049 bash[23528]: audit 2024-09-21T00:12:47.908274+0000 mgr.a (mgr.14388) 5117 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:12:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:49 smithi049 bash[23528]: cephadm 2024-09-21T00:12:47.909687+0000 mgr.a (mgr.14388) 5118 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:12:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:50 smithi044 bash[22676]: cluster 2024-09-21T00:12:49.354086+0000 mgr.a (mgr.14388) 5119 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:50 smithi044 bash[22676]: audit 2024-09-21T00:12:50.409519+0000 mon.a (mon.0) 4676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:50 smithi044 bash[22676]: audit 2024-09-21T00:12:50.417007+0000 mon.a (mon.0) 4677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:50 smithi044 bash[22676]: audit 2024-09-21T00:12:50.426054+0000 mon.a (mon.0) 4678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:50 smithi179 bash[23186]: cluster 2024-09-21T00:12:49.354086+0000 mgr.a (mgr.14388) 5119 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:50 smithi179 bash[23186]: audit 2024-09-21T00:12:50.409519+0000 mon.a (mon.0) 4676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:50 smithi179 bash[23186]: audit 2024-09-21T00:12:50.417007+0000 mon.a (mon.0) 4677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:50 smithi179 bash[23186]: audit 2024-09-21T00:12:50.426054+0000 mon.a (mon.0) 4678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:50 smithi049 bash[23528]: cluster 2024-09-21T00:12:49.354086+0000 mgr.a (mgr.14388) 5119 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:12:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:50 smithi049 bash[23528]: audit 2024-09-21T00:12:50.409519+0000 mon.a (mon.0) 4676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:50 smithi049 bash[23528]: audit 2024-09-21T00:12:50.417007+0000 mon.a (mon.0) 4677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:50 smithi049 bash[23528]: audit 2024-09-21T00:12:50.426054+0000 mon.a (mon.0) 4678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:12:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:51 smithi044 bash[22676]: cluster 2024-09-21T00:12:51.356237+0000 mgr.a (mgr.14388) 5120 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:51 smithi179 bash[23186]: cluster 2024-09-21T00:12:51.356237+0000 mgr.a (mgr.14388) 5120 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:51 smithi049 bash[23528]: cluster 2024-09-21T00:12:51.356237+0000 mgr.a (mgr.14388) 5120 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:52.717 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:52 smithi044 bash[22676]: audit 2024-09-21T00:12:52.270327+0000 mgr.a (mgr.14388) 5121 : audit [DBG] from='client.120129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:52 smithi179 bash[23186]: audit 2024-09-21T00:12:52.270327+0000 mgr.a (mgr.14388) 5121 : audit [DBG] from='client.120129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:52 smithi049 bash[23528]: audit 2024-09-21T00:12:52.270327+0000 mgr.a (mgr.14388) 5121 : audit [DBG] from='client.120129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:53 smithi044 bash[22676]: cluster 2024-09-21T00:12:53.357147+0000 mgr.a (mgr.14388) 5122 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:53 smithi179 bash[23186]: cluster 2024-09-21T00:12:53.357147+0000 mgr.a (mgr.14388) 5122 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:53 smithi049 bash[23528]: cluster 2024-09-21T00:12:53.357147+0000 mgr.a (mgr.14388) 5122 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:56 smithi044 bash[22676]: cluster 2024-09-21T00:12:55.359262+0000 mgr.a (mgr.14388) 5123 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:56 smithi179 bash[23186]: cluster 2024-09-21T00:12:55.359262+0000 mgr.a (mgr.14388) 5123 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:56 smithi049 bash[23528]: cluster 2024-09-21T00:12:55.359262+0000 mgr.a (mgr.14388) 5123 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:57.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:12:57.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:12:57.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:12:58.504 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:12:58.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:12:58.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:12:58.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:12:58.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:12:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:58 smithi044 bash[22676]: cluster 2024-09-21T00:12:57.360160+0000 mgr.a (mgr.14388) 5124 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:58 smithi179 bash[23186]: cluster 2024-09-21T00:12:57.360160+0000 mgr.a (mgr.14388) 5124 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:58 smithi049 bash[23528]: cluster 2024-09-21T00:12:57.360160+0000 mgr.a (mgr.14388) 5124 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:12:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:12:59 smithi044 bash[22676]: audit 2024-09-21T00:12:58.052280+0000 mgr.a (mgr.14388) 5125 : audit [DBG] from='client.120201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:12:59 smithi179 bash[23186]: audit 2024-09-21T00:12:58.052280+0000 mgr.a (mgr.14388) 5125 : audit [DBG] from='client.120201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:12:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:12:59 smithi049 bash[23528]: audit 2024-09-21T00:12:58.052280+0000 mgr.a (mgr.14388) 5125 : audit [DBG] from='client.120201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:00 smithi044 bash[22676]: cluster 2024-09-21T00:12:59.361099+0000 mgr.a (mgr.14388) 5126 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:00 smithi179 bash[23186]: cluster 2024-09-21T00:12:59.361099+0000 mgr.a (mgr.14388) 5126 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:00 smithi049 bash[23528]: cluster 2024-09-21T00:12:59.361099+0000 mgr.a (mgr.14388) 5126 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:02 smithi044 bash[22676]: cluster 2024-09-21T00:13:01.363314+0000 mgr.a (mgr.14388) 5127 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:02 smithi179 bash[23186]: cluster 2024-09-21T00:13:01.363314+0000 mgr.a (mgr.14388) 5127 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:02 smithi049 bash[23528]: cluster 2024-09-21T00:13:01.363314+0000 mgr.a (mgr.14388) 5127 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:03.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:04.297 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:04.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:04.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:04.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:04.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:04 smithi044 bash[22676]: cluster 2024-09-21T00:13:03.364076+0000 mgr.a (mgr.14388) 5128 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:04 smithi179 bash[23186]: cluster 2024-09-21T00:13:03.364076+0000 mgr.a (mgr.14388) 5128 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:04 smithi049 bash[23528]: cluster 2024-09-21T00:13:03.364076+0000 mgr.a (mgr.14388) 5128 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:05 smithi044 bash[22676]: audit 2024-09-21T00:13:03.842444+0000 mgr.a (mgr.14388) 5129 : audit [DBG] from='client.120279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:05 smithi179 bash[23186]: audit 2024-09-21T00:13:03.842444+0000 mgr.a (mgr.14388) 5129 : audit [DBG] from='client.120279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:05 smithi049 bash[23528]: audit 2024-09-21T00:13:03.842444+0000 mgr.a (mgr.14388) 5129 : audit [DBG] from='client.120279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:06.661 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:06 smithi179 bash[23186]: cluster 2024-09-21T00:13:05.366315+0000 mgr.a (mgr.14388) 5130 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:06.661 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:06 smithi179 bash[23186]: audit 2024-09-21T00:13:06.290700+0000 mon.a (mon.0) 4679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.661 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:06 smithi179 bash[23186]: audit 2024-09-21T00:13:06.299649+0000 mon.a (mon.0) 4680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.661 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:06 smithi179 bash[23186]: audit 2024-09-21T00:13:06.310188+0000 mon.a (mon.0) 4681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:06 smithi044 bash[22676]: cluster 2024-09-21T00:13:05.366315+0000 mgr.a (mgr.14388) 5130 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:06 smithi044 bash[22676]: audit 2024-09-21T00:13:06.290700+0000 mon.a (mon.0) 4679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:06 smithi044 bash[22676]: audit 2024-09-21T00:13:06.299649+0000 mon.a (mon.0) 4680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:06 smithi044 bash[22676]: audit 2024-09-21T00:13:06.310188+0000 mon.a (mon.0) 4681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:06 smithi049 bash[23528]: cluster 2024-09-21T00:13:05.366315+0000 mgr.a (mgr.14388) 5130 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:06 smithi049 bash[23528]: audit 2024-09-21T00:13:06.290700+0000 mon.a (mon.0) 4679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:06 smithi049 bash[23528]: audit 2024-09-21T00:13:06.299649+0000 mon.a (mon.0) 4680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:06 smithi049 bash[23528]: audit 2024-09-21T00:13:06.310188+0000 mon.a (mon.0) 4681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:07 smithi044 bash[22676]: cluster 2024-09-21T00:13:07.366943+0000 mgr.a (mgr.14388) 5131 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:07 smithi179 bash[23186]: cluster 2024-09-21T00:13:07.366943+0000 mgr.a (mgr.14388) 5131 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:07 smithi049 bash[23528]: cluster 2024-09-21T00:13:07.366943+0000 mgr.a (mgr.14388) 5131 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:09.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:09.409 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:09.409 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:09.640 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:09 smithi049 bash[23528]: audit 2024-09-21T00:13:08.307141+0000 mon.a (mon.0) 4682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.640 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:09 smithi049 bash[23528]: audit 2024-09-21T00:13:08.314980+0000 mon.a (mon.0) 4683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.640 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:09 smithi049 bash[23528]: audit 2024-09-21T00:13:08.327468+0000 mon.a (mon.0) 4684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:09 smithi044 bash[22676]: audit 2024-09-21T00:13:08.307141+0000 mon.a (mon.0) 4682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:09 smithi044 bash[22676]: audit 2024-09-21T00:13:08.314980+0000 mon.a (mon.0) 4683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:09 smithi044 bash[22676]: audit 2024-09-21T00:13:08.327468+0000 mon.a (mon.0) 4684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:09 smithi179 bash[23186]: audit 2024-09-21T00:13:08.307141+0000 mon.a (mon.0) 4682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:09 smithi179 bash[23186]: audit 2024-09-21T00:13:08.314980+0000 mon.a (mon.0) 4683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:09 smithi179 bash[23186]: audit 2024-09-21T00:13:08.327468+0000 mon.a (mon.0) 4684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:10.069 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:10.652 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:10 smithi044 bash[22676]: cluster 2024-09-21T00:13:09.367657+0000 mgr.a (mgr.14388) 5132 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:10 smithi179 bash[23186]: cluster 2024-09-21T00:13:09.367657+0000 mgr.a (mgr.14388) 5132 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:10 smithi049 bash[23528]: cluster 2024-09-21T00:13:09.367657+0000 mgr.a (mgr.14388) 5132 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:11 smithi044 bash[22676]: audit 2024-09-21T00:13:09.631936+0000 mgr.a (mgr.14388) 5133 : audit [DBG] from='client.120357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:11 smithi044 bash[22676]: audit 2024-09-21T00:13:10.631155+0000 mon.a (mon.0) 4685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:11 smithi044 bash[22676]: audit 2024-09-21T00:13:10.639244+0000 mon.a (mon.0) 4686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:11 smithi044 bash[22676]: audit 2024-09-21T00:13:10.649658+0000 mon.a (mon.0) 4687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:11 smithi179 bash[23186]: audit 2024-09-21T00:13:09.631936+0000 mgr.a (mgr.14388) 5133 : audit [DBG] from='client.120357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:11 smithi179 bash[23186]: audit 2024-09-21T00:13:10.631155+0000 mon.a (mon.0) 4685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:11 smithi179 bash[23186]: audit 2024-09-21T00:13:10.639244+0000 mon.a (mon.0) 4686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:11 smithi179 bash[23186]: audit 2024-09-21T00:13:10.649658+0000 mon.a (mon.0) 4687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:11 smithi049 bash[23528]: audit 2024-09-21T00:13:09.631936+0000 mgr.a (mgr.14388) 5133 : audit [DBG] from='client.120357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:11 smithi049 bash[23528]: audit 2024-09-21T00:13:10.631155+0000 mon.a (mon.0) 4685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:11 smithi049 bash[23528]: audit 2024-09-21T00:13:10.639244+0000 mon.a (mon.0) 4686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:11 smithi049 bash[23528]: audit 2024-09-21T00:13:10.649658+0000 mon.a (mon.0) 4687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:12 smithi044 bash[22676]: cluster 2024-09-21T00:13:11.369994+0000 mgr.a (mgr.14388) 5134 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:12 smithi179 bash[23186]: cluster 2024-09-21T00:13:11.369994+0000 mgr.a (mgr.14388) 5134 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:12 smithi049 bash[23528]: cluster 2024-09-21T00:13:11.369994+0000 mgr.a (mgr.14388) 5134 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:14 smithi044 bash[22676]: cluster 2024-09-21T00:13:13.370757+0000 mgr.a (mgr.14388) 5135 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:14 smithi179 bash[23186]: cluster 2024-09-21T00:13:13.370757+0000 mgr.a (mgr.14388) 5135 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:14 smithi049 bash[23528]: cluster 2024-09-21T00:13:13.370757+0000 mgr.a (mgr.14388) 5135 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:15.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:15.854 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:15.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:15.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:15.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:15.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:16 smithi044 bash[22676]: cluster 2024-09-21T00:13:15.372679+0000 mgr.a (mgr.14388) 5136 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:16 smithi044 bash[22676]: audit 2024-09-21T00:13:15.410474+0000 mgr.a (mgr.14388) 5137 : audit [DBG] from='client.120432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:16 smithi179 bash[23186]: cluster 2024-09-21T00:13:15.372679+0000 mgr.a (mgr.14388) 5136 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:16 smithi179 bash[23186]: audit 2024-09-21T00:13:15.410474+0000 mgr.a (mgr.14388) 5137 : audit [DBG] from='client.120432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:16.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:16 smithi049 bash[23528]: cluster 2024-09-21T00:13:15.372679+0000 mgr.a (mgr.14388) 5136 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:16.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:16 smithi049 bash[23528]: audit 2024-09-21T00:13:15.410474+0000 mgr.a (mgr.14388) 5137 : audit [DBG] from='client.120432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:18 smithi044 bash[22676]: cluster 2024-09-21T00:13:17.373598+0000 mgr.a (mgr.14388) 5138 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:13:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:18 smithi179 bash[23186]: cluster 2024-09-21T00:13:17.373598+0000 mgr.a (mgr.14388) 5138 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:13:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:18 smithi049 bash[23528]: cluster 2024-09-21T00:13:17.373598+0000 mgr.a (mgr.14388) 5138 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:13:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:20 smithi044 bash[22676]: cluster 2024-09-21T00:13:19.374361+0000 mgr.a (mgr.14388) 5139 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:13:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:20 smithi179 bash[23186]: cluster 2024-09-21T00:13:19.374361+0000 mgr.a (mgr.14388) 5139 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:13:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:20 smithi049 bash[23528]: cluster 2024-09-21T00:13:19.374361+0000 mgr.a (mgr.14388) 5139 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:13:20.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:20.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:20.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:22 smithi044 bash[22676]: audit 2024-09-21T00:13:21.191093+0000 mgr.a (mgr.14388) 5140 : audit [DBG] from='client.120510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:22 smithi044 bash[22676]: cluster 2024-09-21T00:13:21.375682+0000 mgr.a (mgr.14388) 5141 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:22 smithi179 bash[23186]: audit 2024-09-21T00:13:21.191093+0000 mgr.a (mgr.14388) 5140 : audit [DBG] from='client.120510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:22 smithi179 bash[23186]: cluster 2024-09-21T00:13:21.375682+0000 mgr.a (mgr.14388) 5141 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:22 smithi049 bash[23528]: audit 2024-09-21T00:13:21.191093+0000 mgr.a (mgr.14388) 5140 : audit [DBG] from='client.120510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:22 smithi049 bash[23528]: cluster 2024-09-21T00:13:21.375682+0000 mgr.a (mgr.14388) 5141 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:24 smithi044 bash[22676]: cluster 2024-09-21T00:13:23.376544+0000 mgr.a (mgr.14388) 5142 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:13:24.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:24 smithi179 bash[23186]: cluster 2024-09-21T00:13:23.376544+0000 mgr.a (mgr.14388) 5142 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:13:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:24 smithi049 bash[23528]: cluster 2024-09-21T00:13:23.376544+0000 mgr.a (mgr.14388) 5142 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:13:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:25 smithi049 bash[23528]: cluster 2024-09-21T00:13:25.378670+0000 mgr.a (mgr.14388) 5143 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:25 smithi044 bash[22676]: cluster 2024-09-21T00:13:25.378670+0000 mgr.a (mgr.14388) 5143 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:25 smithi179 bash[23186]: cluster 2024-09-21T00:13:25.378670+0000 mgr.a (mgr.14388) 5143 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:26.642 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:26.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:27.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:27.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:27 smithi044 bash[22676]: audit 2024-09-21T00:13:26.519291+0000 mon.a (mon.0) 4688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:27 smithi044 bash[22676]: audit 2024-09-21T00:13:26.528965+0000 mon.a (mon.0) 4689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:27 smithi044 bash[22676]: audit 2024-09-21T00:13:26.539825+0000 mon.a (mon.0) 4690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:27 smithi044 bash[22676]: audit 2024-09-21T00:13:26.981717+0000 mgr.a (mgr.14388) 5144 : audit [DBG] from='client.120585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:27 smithi044 bash[22676]: cluster 2024-09-21T00:13:27.379227+0000 mgr.a (mgr.14388) 5145 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:27 smithi049 bash[23528]: audit 2024-09-21T00:13:26.519291+0000 mon.a (mon.0) 4688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:27 smithi049 bash[23528]: audit 2024-09-21T00:13:26.528965+0000 mon.a (mon.0) 4689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:27 smithi049 bash[23528]: audit 2024-09-21T00:13:26.539825+0000 mon.a (mon.0) 4690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:27 smithi049 bash[23528]: audit 2024-09-21T00:13:26.981717+0000 mgr.a (mgr.14388) 5144 : audit [DBG] from='client.120585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:27 smithi049 bash[23528]: cluster 2024-09-21T00:13:27.379227+0000 mgr.a (mgr.14388) 5145 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:27 smithi179 bash[23186]: audit 2024-09-21T00:13:26.519291+0000 mon.a (mon.0) 4688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:27 smithi179 bash[23186]: audit 2024-09-21T00:13:26.528965+0000 mon.a (mon.0) 4689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:27 smithi179 bash[23186]: audit 2024-09-21T00:13:26.539825+0000 mon.a (mon.0) 4690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:27 smithi179 bash[23186]: audit 2024-09-21T00:13:26.981717+0000 mgr.a (mgr.14388) 5144 : audit [DBG] from='client.120585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:27 smithi179 bash[23186]: cluster 2024-09-21T00:13:27.379227+0000 mgr.a (mgr.14388) 5145 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:29 smithi044 bash[22676]: audit 2024-09-21T00:13:28.487904+0000 mon.a (mon.0) 4691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:29 smithi044 bash[22676]: audit 2024-09-21T00:13:28.496488+0000 mon.a (mon.0) 4692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:29 smithi044 bash[22676]: audit 2024-09-21T00:13:28.508191+0000 mon.a (mon.0) 4693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:29 smithi044 bash[22676]: cluster 2024-09-21T00:13:29.379822+0000 mgr.a (mgr.14388) 5146 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:29 smithi179 bash[23186]: audit 2024-09-21T00:13:28.487904+0000 mon.a (mon.0) 4691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:29 smithi179 bash[23186]: audit 2024-09-21T00:13:28.496488+0000 mon.a (mon.0) 4692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:29 smithi179 bash[23186]: audit 2024-09-21T00:13:28.508191+0000 mon.a (mon.0) 4693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:29 smithi179 bash[23186]: cluster 2024-09-21T00:13:29.379822+0000 mgr.a (mgr.14388) 5146 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:29.786 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:29 smithi049 bash[23528]: audit 2024-09-21T00:13:28.487904+0000 mon.a (mon.0) 4691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.787 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:29 smithi049 bash[23528]: audit 2024-09-21T00:13:28.496488+0000 mon.a (mon.0) 4692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.787 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:29 smithi049 bash[23528]: audit 2024-09-21T00:13:28.508191+0000 mon.a (mon.0) 4693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:29.787 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:29 smithi049 bash[23528]: cluster 2024-09-21T00:13:29.379822+0000 mgr.a (mgr.14388) 5146 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:31 smithi044 bash[22676]: audit 2024-09-21T00:13:30.835278+0000 mon.a (mon.0) 4694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:31 smithi044 bash[22676]: audit 2024-09-21T00:13:30.841193+0000 mon.a (mon.0) 4695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:31 smithi044 bash[22676]: audit 2024-09-21T00:13:30.846687+0000 mon.a (mon.0) 4696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:31 smithi044 bash[22676]: cluster 2024-09-21T00:13:31.381999+0000 mgr.a (mgr.14388) 5147 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:31 smithi179 bash[23186]: audit 2024-09-21T00:13:30.835278+0000 mon.a (mon.0) 4694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:31 smithi179 bash[23186]: audit 2024-09-21T00:13:30.841193+0000 mon.a (mon.0) 4695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:31 smithi179 bash[23186]: audit 2024-09-21T00:13:30.846687+0000 mon.a (mon.0) 4696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:31 smithi179 bash[23186]: cluster 2024-09-21T00:13:31.381999+0000 mgr.a (mgr.14388) 5147 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:31 smithi049 bash[23528]: audit 2024-09-21T00:13:30.835278+0000 mon.a (mon.0) 4694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:31 smithi049 bash[23528]: audit 2024-09-21T00:13:30.841193+0000 mon.a (mon.0) 4695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:31 smithi049 bash[23528]: audit 2024-09-21T00:13:30.846687+0000 mon.a (mon.0) 4696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:31 smithi049 bash[23528]: cluster 2024-09-21T00:13:31.381999+0000 mgr.a (mgr.14388) 5147 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:32.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:32.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:32.437 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:33.212 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:33.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:33.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:33.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:33.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:34 smithi044 bash[22676]: audit 2024-09-21T00:13:32.772320+0000 mgr.a (mgr.14388) 5148 : audit [DBG] from='client.120660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:34 smithi044 bash[22676]: cluster 2024-09-21T00:13:33.383037+0000 mgr.a (mgr.14388) 5149 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:34 smithi179 bash[23186]: audit 2024-09-21T00:13:32.772320+0000 mgr.a (mgr.14388) 5148 : audit [DBG] from='client.120660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:34 smithi179 bash[23186]: cluster 2024-09-21T00:13:33.383037+0000 mgr.a (mgr.14388) 5149 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:34 smithi049 bash[23528]: audit 2024-09-21T00:13:32.772320+0000 mgr.a (mgr.14388) 5148 : audit [DBG] from='client.120660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:34 smithi049 bash[23528]: cluster 2024-09-21T00:13:33.383037+0000 mgr.a (mgr.14388) 5149 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:36 smithi044 bash[22676]: cluster 2024-09-21T00:13:35.385275+0000 mgr.a (mgr.14388) 5150 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:36 smithi179 bash[23186]: cluster 2024-09-21T00:13:35.385275+0000 mgr.a (mgr.14388) 5150 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:36 smithi049 bash[23528]: cluster 2024-09-21T00:13:35.385275+0000 mgr.a (mgr.14388) 5150 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:38.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:38.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:38.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:38 smithi044 bash[22676]: cluster 2024-09-21T00:13:37.386025+0000 mgr.a (mgr.14388) 5151 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:38 smithi179 bash[23186]: cluster 2024-09-21T00:13:37.386025+0000 mgr.a (mgr.14388) 5151 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:38 smithi049 bash[23528]: cluster 2024-09-21T00:13:37.386025+0000 mgr.a (mgr.14388) 5151 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:39.008 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:40 smithi044 bash[22676]: audit 2024-09-21T00:13:38.560204+0000 mgr.a (mgr.14388) 5152 : audit [DBG] from='client.120735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:40 smithi044 bash[22676]: cluster 2024-09-21T00:13:39.386928+0000 mgr.a (mgr.14388) 5153 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:40 smithi179 bash[23186]: audit 2024-09-21T00:13:38.560204+0000 mgr.a (mgr.14388) 5152 : audit [DBG] from='client.120735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:40 smithi179 bash[23186]: cluster 2024-09-21T00:13:39.386928+0000 mgr.a (mgr.14388) 5153 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:40 smithi049 bash[23528]: audit 2024-09-21T00:13:38.560204+0000 mgr.a (mgr.14388) 5152 : audit [DBG] from='client.120735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:40 smithi049 bash[23528]: cluster 2024-09-21T00:13:39.386928+0000 mgr.a (mgr.14388) 5153 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:41 smithi044 bash[22676]: cluster 2024-09-21T00:13:41.389151+0000 mgr.a (mgr.14388) 5154 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:41 smithi179 bash[23186]: cluster 2024-09-21T00:13:41.389151+0000 mgr.a (mgr.14388) 5154 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:41.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:41 smithi049 bash[23528]: cluster 2024-09-21T00:13:41.389151+0000 mgr.a (mgr.14388) 5154 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:44.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:44 smithi044 bash[22676]: cluster 2024-09-21T00:13:43.389888+0000 mgr.a (mgr.14388) 5155 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:44 smithi179 bash[23186]: cluster 2024-09-21T00:13:43.389888+0000 mgr.a (mgr.14388) 5155 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:44.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:44.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:44.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:44.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:44.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:44 smithi049 bash[23528]: cluster 2024-09-21T00:13:43.389888+0000 mgr.a (mgr.14388) 5155 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:45 smithi044 bash[22676]: audit 2024-09-21T00:13:44.346987+0000 mgr.a (mgr.14388) 5156 : audit [DBG] from='client.120813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:45 smithi179 bash[23186]: audit 2024-09-21T00:13:44.346987+0000 mgr.a (mgr.14388) 5156 : audit [DBG] from='client.120813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:45 smithi049 bash[23528]: audit 2024-09-21T00:13:44.346987+0000 mgr.a (mgr.14388) 5156 : audit [DBG] from='client.120813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:46.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:46 smithi179 bash[23186]: cluster 2024-09-21T00:13:45.392101+0000 mgr.a (mgr.14388) 5157 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:46 smithi044 bash[22676]: cluster 2024-09-21T00:13:45.392101+0000 mgr.a (mgr.14388) 5157 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:46.741 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:46 smithi049 bash[23528]: cluster 2024-09-21T00:13:45.392101+0000 mgr.a (mgr.14388) 5157 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:13:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:47 smithi044 bash[22676]: audit 2024-09-21T00:13:46.719456+0000 mon.a (mon.0) 4697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:47 smithi044 bash[22676]: audit 2024-09-21T00:13:46.728069+0000 mon.a (mon.0) 4698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:47 smithi044 bash[22676]: audit 2024-09-21T00:13:46.738793+0000 mon.a (mon.0) 4699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:47 smithi044 bash[22676]: cluster 2024-09-21T00:13:47.392808+0000 mgr.a (mgr.14388) 5158 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:47 smithi179 bash[23186]: audit 2024-09-21T00:13:46.719456+0000 mon.a (mon.0) 4697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:47 smithi179 bash[23186]: audit 2024-09-21T00:13:46.728069+0000 mon.a (mon.0) 4698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:47 smithi179 bash[23186]: audit 2024-09-21T00:13:46.738793+0000 mon.a (mon.0) 4699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:47 smithi179 bash[23186]: cluster 2024-09-21T00:13:47.392808+0000 mgr.a (mgr.14388) 5158 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:47 smithi049 bash[23528]: audit 2024-09-21T00:13:46.719456+0000 mon.a (mon.0) 4697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:47 smithi049 bash[23528]: audit 2024-09-21T00:13:46.728069+0000 mon.a (mon.0) 4698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:47 smithi049 bash[23528]: audit 2024-09-21T00:13:46.738793+0000 mon.a (mon.0) 4699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:47 smithi049 bash[23528]: cluster 2024-09-21T00:13:47.392808+0000 mgr.a (mgr.14388) 5158 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:48.913 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:47.965473+0000 mon.a (mon.0) 4700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:13:48.913 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:47.970838+0000 mon.a (mon.0) 4701 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:13:48.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:47.972467+0000 mon.a (mon.0) 4702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:13:48.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:47.982190+0000 mon.a (mon.0) 4703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:47.988548+0000 mon.a (mon.0) 4704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:13:48.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:47.990952+0000 mgr.a (mgr.14388) 5159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:13:48.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:48.643151+0000 mon.a (mon.0) 4705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:48.648699+0000 mon.a (mon.0) 4706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:48 smithi179 bash[23186]: audit 2024-09-21T00:13:48.655366+0000 mon.a (mon.0) 4707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22930]: debug 2024-09-21T00:13:48.729+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:13:48.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22930]: debug 2024-09-21T00:13:48.729+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:13:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:47.965473+0000 mon.a (mon.0) 4700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:47.970838+0000 mon.a (mon.0) 4701 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:47.972467+0000 mon.a (mon.0) 4702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:47.982190+0000 mon.a (mon.0) 4703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:47.988548+0000 mon.a (mon.0) 4704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:47.990952+0000 mgr.a (mgr.14388) 5159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:48.643151+0000 mon.a (mon.0) 4705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:48.648699+0000 mon.a (mon.0) 4706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:48 smithi044 bash[22676]: audit 2024-09-21T00:13:48.655366+0000 mon.a (mon.0) 4707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:47.965473+0000 mon.a (mon.0) 4700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:47.970838+0000 mon.a (mon.0) 4701 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:47.972467+0000 mon.a (mon.0) 4702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:47.982190+0000 mon.a (mon.0) 4703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:47.988548+0000 mon.a (mon.0) 4704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:47.990952+0000 mgr.a (mgr.14388) 5159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:48.643151+0000 mon.a (mon.0) 4705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:48.648699+0000 mon.a (mon.0) 4706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:48 smithi049 bash[23528]: audit 2024-09-21T00:13:48.655366+0000 mon.a (mon.0) 4707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:49.762 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:49.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:49 smithi179 bash[23186]: audit 2024-09-21T00:13:48.729338+0000 mgr.a (mgr.14388) 5160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:13:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:49 smithi179 bash[23186]: cephadm 2024-09-21T00:13:48.730258+0000 mgr.a (mgr.14388) 5161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:13:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:49 smithi179 bash[23186]: cluster 2024-09-21T00:13:49.393450+0000 mgr.a (mgr.14388) 5162 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:49 smithi049 bash[23528]: audit 2024-09-21T00:13:48.729338+0000 mgr.a (mgr.14388) 5160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:13:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:49 smithi049 bash[23528]: cephadm 2024-09-21T00:13:48.730258+0000 mgr.a (mgr.14388) 5161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:13:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:49 smithi049 bash[23528]: cluster 2024-09-21T00:13:49.393450+0000 mgr.a (mgr.14388) 5162 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:49 smithi044 bash[22676]: audit 2024-09-21T00:13:48.729338+0000 mgr.a (mgr.14388) 5160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:13:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:49 smithi044 bash[22676]: cephadm 2024-09-21T00:13:48.730258+0000 mgr.a (mgr.14388) 5161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:13:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:49 smithi044 bash[22676]: cluster 2024-09-21T00:13:49.393450+0000 mgr.a (mgr.14388) 5162 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:13:50.515 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:50.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:50.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:50 smithi179 bash[23186]: audit 2024-09-21T00:13:50.085028+0000 mgr.a (mgr.14388) 5163 : audit [DBG] from='client.120996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:50 smithi049 bash[23528]: audit 2024-09-21T00:13:50.085028+0000 mgr.a (mgr.14388) 5163 : audit [DBG] from='client.120996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:51.056 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:50 smithi044 bash[22676]: audit 2024-09-21T00:13:50.085028+0000 mgr.a (mgr.14388) 5163 : audit [DBG] from='client.120996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:52 smithi049 bash[23528]: audit 2024-09-21T00:13:51.025704+0000 mon.a (mon.0) 4708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:52 smithi049 bash[23528]: audit 2024-09-21T00:13:51.046633+0000 mon.a (mon.0) 4709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:52 smithi049 bash[23528]: audit 2024-09-21T00:13:51.054816+0000 mon.a (mon.0) 4710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:52 smithi049 bash[23528]: cluster 2024-09-21T00:13:51.396115+0000 mgr.a (mgr.14388) 5164 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:52 smithi044 bash[22676]: audit 2024-09-21T00:13:51.025704+0000 mon.a (mon.0) 4708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:52 smithi044 bash[22676]: audit 2024-09-21T00:13:51.046633+0000 mon.a (mon.0) 4709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:52 smithi044 bash[22676]: audit 2024-09-21T00:13:51.054816+0000 mon.a (mon.0) 4710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:52 smithi044 bash[22676]: cluster 2024-09-21T00:13:51.396115+0000 mgr.a (mgr.14388) 5164 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:52 smithi179 bash[23186]: audit 2024-09-21T00:13:51.025704+0000 mon.a (mon.0) 4708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:52 smithi179 bash[23186]: audit 2024-09-21T00:13:51.046633+0000 mon.a (mon.0) 4709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:52 smithi179 bash[23186]: audit 2024-09-21T00:13:51.054816+0000 mon.a (mon.0) 4710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:13:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:52 smithi179 bash[23186]: cluster 2024-09-21T00:13:51.396115+0000 mgr.a (mgr.14388) 5164 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:54 smithi044 bash[22676]: cluster 2024-09-21T00:13:53.396874+0000 mgr.a (mgr.14388) 5165 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:13:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:54 smithi179 bash[23186]: cluster 2024-09-21T00:13:53.396874+0000 mgr.a (mgr.14388) 5165 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:13:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:54 smithi049 bash[23528]: cluster 2024-09-21T00:13:53.396874+0000 mgr.a (mgr.14388) 5165 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:13:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:13:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:13:55.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:13:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:55 smithi179 bash[23186]: cluster 2024-09-21T00:13:55.398783+0000 mgr.a (mgr.14388) 5166 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:55 smithi049 bash[23528]: cluster 2024-09-21T00:13:55.398783+0000 mgr.a (mgr.14388) 5166 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:55 smithi044 bash[22676]: cluster 2024-09-21T00:13:55.398783+0000 mgr.a (mgr.14388) 5166 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:13:56.295 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:13:56.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:13:56.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:13:56.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:13:56.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:13:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:56 smithi049 bash[23528]: audit 2024-09-21T00:13:55.862769+0000 mgr.a (mgr.14388) 5167 : audit [DBG] from='client.121071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:56 smithi044 bash[22676]: audit 2024-09-21T00:13:55.862769+0000 mgr.a (mgr.14388) 5167 : audit [DBG] from='client.121071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:56 smithi179 bash[23186]: audit 2024-09-21T00:13:55.862769+0000 mgr.a (mgr.14388) 5167 : audit [DBG] from='client.121071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:13:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:13:57 smithi049 bash[23528]: cluster 2024-09-21T00:13:57.399686+0000 mgr.a (mgr.14388) 5168 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:13:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:13:57 smithi044 bash[22676]: cluster 2024-09-21T00:13:57.399686+0000 mgr.a (mgr.14388) 5168 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:13:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:13:57 smithi179 bash[23186]: cluster 2024-09-21T00:13:57.399686+0000 mgr.a (mgr.14388) 5168 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:14:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:00 smithi044 bash[22676]: cluster 2024-09-21T00:13:59.400540+0000 mgr.a (mgr.14388) 5169 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:14:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:00 smithi179 bash[23186]: cluster 2024-09-21T00:13:59.400540+0000 mgr.a (mgr.14388) 5169 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:14:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:00 smithi049 bash[23528]: cluster 2024-09-21T00:13:59.400540+0000 mgr.a (mgr.14388) 5169 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:14:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:01 smithi044 bash[22676]: cluster 2024-09-21T00:14:01.401721+0000 mgr.a (mgr.14388) 5170 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:01 smithi179 bash[23186]: cluster 2024-09-21T00:14:01.401721+0000 mgr.a (mgr.14388) 5170 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:01 smithi049 bash[23528]: cluster 2024-09-21T00:14:01.401721+0000 mgr.a (mgr.14388) 5170 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:02.083 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:02.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:02.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:02.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:02.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:02 smithi044 bash[22676]: audit 2024-09-21T00:14:01.639164+0000 mgr.a (mgr.14388) 5171 : audit [DBG] from='client.121149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:02 smithi179 bash[23186]: audit 2024-09-21T00:14:01.639164+0000 mgr.a (mgr.14388) 5171 : audit [DBG] from='client.121149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:02 smithi049 bash[23528]: audit 2024-09-21T00:14:01.639164+0000 mgr.a (mgr.14388) 5171 : audit [DBG] from='client.121149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:03 smithi044 bash[22676]: cluster 2024-09-21T00:14:03.402630+0000 mgr.a (mgr.14388) 5172 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:03 smithi179 bash[23186]: cluster 2024-09-21T00:14:03.402630+0000 mgr.a (mgr.14388) 5172 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:03 smithi049 bash[23528]: cluster 2024-09-21T00:14:03.402630+0000 mgr.a (mgr.14388) 5172 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:05 smithi049 bash[23528]: cluster 2024-09-21T00:14:05.404796+0000 mgr.a (mgr.14388) 5173 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:05 smithi044 bash[22676]: cluster 2024-09-21T00:14:05.404796+0000 mgr.a (mgr.14388) 5173 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:05 smithi179 bash[23186]: cluster 2024-09-21T00:14:05.404796+0000 mgr.a (mgr.14388) 5173 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:07.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:07.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:07.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:07.844 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:07 smithi044 bash[22676]: audit 2024-09-21T00:14:06.957503+0000 mon.a (mon.0) 4711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:07 smithi044 bash[22676]: audit 2024-09-21T00:14:06.966881+0000 mon.a (mon.0) 4712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:07 smithi044 bash[22676]: audit 2024-09-21T00:14:06.978276+0000 mon.a (mon.0) 4713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:07 smithi044 bash[22676]: cluster 2024-09-21T00:14:07.405585+0000 mgr.a (mgr.14388) 5174 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:07 smithi044 bash[22676]: audit 2024-09-21T00:14:07.424223+0000 mgr.a (mgr.14388) 5175 : audit [DBG] from='client.121221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:07 smithi179 bash[23186]: audit 2024-09-21T00:14:06.957503+0000 mon.a (mon.0) 4711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:07 smithi179 bash[23186]: audit 2024-09-21T00:14:06.966881+0000 mon.a (mon.0) 4712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:07 smithi179 bash[23186]: audit 2024-09-21T00:14:06.978276+0000 mon.a (mon.0) 4713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:07 smithi179 bash[23186]: cluster 2024-09-21T00:14:07.405585+0000 mgr.a (mgr.14388) 5174 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:07 smithi179 bash[23186]: audit 2024-09-21T00:14:07.424223+0000 mgr.a (mgr.14388) 5175 : audit [DBG] from='client.121221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:08.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:07 smithi049 bash[23528]: audit 2024-09-21T00:14:06.957503+0000 mon.a (mon.0) 4711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:08.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:07 smithi049 bash[23528]: audit 2024-09-21T00:14:06.966881+0000 mon.a (mon.0) 4712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:07 smithi049 bash[23528]: audit 2024-09-21T00:14:06.978276+0000 mon.a (mon.0) 4713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:07 smithi049 bash[23528]: cluster 2024-09-21T00:14:07.405585+0000 mgr.a (mgr.14388) 5174 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:07 smithi049 bash[23528]: audit 2024-09-21T00:14:07.424223+0000 mgr.a (mgr.14388) 5175 : audit [DBG] from='client.121221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:10.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:09 smithi044 bash[22676]: audit 2024-09-21T00:14:08.821572+0000 mon.a (mon.0) 4714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:09 smithi044 bash[22676]: audit 2024-09-21T00:14:08.829884+0000 mon.a (mon.0) 4715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:09 smithi044 bash[22676]: audit 2024-09-21T00:14:08.840126+0000 mon.a (mon.0) 4716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.216 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:09 smithi044 bash[22676]: cluster 2024-09-21T00:14:09.406289+0000 mgr.a (mgr.14388) 5176 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:09 smithi179 bash[23186]: audit 2024-09-21T00:14:08.821572+0000 mon.a (mon.0) 4714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:09 smithi179 bash[23186]: audit 2024-09-21T00:14:08.829884+0000 mon.a (mon.0) 4715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:09 smithi179 bash[23186]: audit 2024-09-21T00:14:08.840126+0000 mon.a (mon.0) 4716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:09 smithi179 bash[23186]: cluster 2024-09-21T00:14:09.406289+0000 mgr.a (mgr.14388) 5176 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:10.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:09 smithi049 bash[23528]: audit 2024-09-21T00:14:08.821572+0000 mon.a (mon.0) 4714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:09 smithi049 bash[23528]: audit 2024-09-21T00:14:08.829884+0000 mon.a (mon.0) 4715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:09 smithi049 bash[23528]: audit 2024-09-21T00:14:08.840126+0000 mon.a (mon.0) 4716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:09 smithi049 bash[23528]: cluster 2024-09-21T00:14:09.406289+0000 mgr.a (mgr.14388) 5176 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:12 smithi044 bash[22676]: audit 2024-09-21T00:14:11.217279+0000 mon.a (mon.0) 4717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:12 smithi044 bash[22676]: audit 2024-09-21T00:14:11.224784+0000 mon.a (mon.0) 4718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:12 smithi044 bash[22676]: audit 2024-09-21T00:14:11.232547+0000 mon.a (mon.0) 4719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:12 smithi044 bash[22676]: cluster 2024-09-21T00:14:11.408595+0000 mgr.a (mgr.14388) 5177 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:12 smithi179 bash[23186]: audit 2024-09-21T00:14:11.217279+0000 mon.a (mon.0) 4717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:12 smithi179 bash[23186]: audit 2024-09-21T00:14:11.224784+0000 mon.a (mon.0) 4718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:12 smithi179 bash[23186]: audit 2024-09-21T00:14:11.232547+0000 mon.a (mon.0) 4719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:12 smithi179 bash[23186]: cluster 2024-09-21T00:14:11.408595+0000 mgr.a (mgr.14388) 5177 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:12 smithi049 bash[23528]: audit 2024-09-21T00:14:11.217279+0000 mon.a (mon.0) 4717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:12 smithi049 bash[23528]: audit 2024-09-21T00:14:11.224784+0000 mon.a (mon.0) 4718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:12 smithi049 bash[23528]: audit 2024-09-21T00:14:11.232547+0000 mon.a (mon.0) 4719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:12 smithi049 bash[23528]: cluster 2024-09-21T00:14:11.408595+0000 mgr.a (mgr.14388) 5177 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:12.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:12.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:12.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:13.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:13 smithi049 bash[23528]: audit 2024-09-21T00:14:13.176892+0000 mgr.a (mgr.14388) 5178 : audit [DBG] from='client.121299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:13 smithi049 bash[23528]: cluster 2024-09-21T00:14:13.415233+0000 mgr.a (mgr.14388) 5179 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:13 smithi044 bash[22676]: audit 2024-09-21T00:14:13.176892+0000 mgr.a (mgr.14388) 5178 : audit [DBG] from='client.121299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:13 smithi044 bash[22676]: cluster 2024-09-21T00:14:13.415233+0000 mgr.a (mgr.14388) 5179 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:13 smithi179 bash[23186]: audit 2024-09-21T00:14:13.176892+0000 mgr.a (mgr.14388) 5178 : audit [DBG] from='client.121299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:14.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:13 smithi179 bash[23186]: cluster 2024-09-21T00:14:13.415233+0000 mgr.a (mgr.14388) 5179 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:15 smithi049 bash[23528]: cluster 2024-09-21T00:14:15.417647+0000 mgr.a (mgr.14388) 5180 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:15 smithi044 bash[22676]: cluster 2024-09-21T00:14:15.417647+0000 mgr.a (mgr.14388) 5180 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:15 smithi179 bash[23186]: cluster 2024-09-21T00:14:15.417647+0000 mgr.a (mgr.14388) 5180 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:17 smithi049 bash[23528]: cluster 2024-09-21T00:14:17.418637+0000 mgr.a (mgr.14388) 5181 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:17 smithi044 bash[22676]: cluster 2024-09-21T00:14:17.418637+0000 mgr.a (mgr.14388) 5181 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:17 smithi179 bash[23186]: cluster 2024-09-21T00:14:17.418637+0000 mgr.a (mgr.14388) 5181 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:18.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:18.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:18.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:19.387 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:19 smithi049 bash[23528]: audit 2024-09-21T00:14:18.953275+0000 mgr.a (mgr.14388) 5182 : audit [DBG] from='client.121374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:19 smithi049 bash[23528]: cluster 2024-09-21T00:14:19.419243+0000 mgr.a (mgr.14388) 5183 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:19 smithi044 bash[22676]: audit 2024-09-21T00:14:18.953275+0000 mgr.a (mgr.14388) 5182 : audit [DBG] from='client.121374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:19 smithi044 bash[22676]: cluster 2024-09-21T00:14:19.419243+0000 mgr.a (mgr.14388) 5183 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:19 smithi179 bash[23186]: audit 2024-09-21T00:14:18.953275+0000 mgr.a (mgr.14388) 5182 : audit [DBG] from='client.121374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:19 smithi179 bash[23186]: cluster 2024-09-21T00:14:19.419243+0000 mgr.a (mgr.14388) 5183 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:21 smithi049 bash[23528]: cluster 2024-09-21T00:14:21.421563+0000 mgr.a (mgr.14388) 5184 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:21 smithi044 bash[22676]: cluster 2024-09-21T00:14:21.421563+0000 mgr.a (mgr.14388) 5184 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:21 smithi179 bash[23186]: cluster 2024-09-21T00:14:21.421563+0000 mgr.a (mgr.14388) 5184 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:23.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:23 smithi049 bash[23528]: cluster 2024-09-21T00:14:23.422500+0000 mgr.a (mgr.14388) 5185 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:23 smithi044 bash[22676]: cluster 2024-09-21T00:14:23.422500+0000 mgr.a (mgr.14388) 5185 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:23 smithi179 bash[23186]: cluster 2024-09-21T00:14:23.422500+0000 mgr.a (mgr.14388) 5185 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:24.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:24.389 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:24.389 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:25.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:25 smithi049 bash[23528]: audit 2024-09-21T00:14:24.727096+0000 mgr.a (mgr.14388) 5186 : audit [DBG] from='client.121449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:25 smithi049 bash[23528]: cluster 2024-09-21T00:14:25.424995+0000 mgr.a (mgr.14388) 5187 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:14:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:25 smithi044 bash[22676]: audit 2024-09-21T00:14:24.727096+0000 mgr.a (mgr.14388) 5186 : audit [DBG] from='client.121449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:25 smithi044 bash[22676]: cluster 2024-09-21T00:14:25.424995+0000 mgr.a (mgr.14388) 5187 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:14:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:25 smithi179 bash[23186]: audit 2024-09-21T00:14:24.727096+0000 mgr.a (mgr.14388) 5186 : audit [DBG] from='client.121449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:25 smithi179 bash[23186]: cluster 2024-09-21T00:14:25.424995+0000 mgr.a (mgr.14388) 5187 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:14:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:28 smithi044 bash[22676]: audit 2024-09-21T00:14:27.177738+0000 mon.a (mon.0) 4720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:28 smithi044 bash[22676]: audit 2024-09-21T00:14:27.186573+0000 mon.a (mon.0) 4721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:28 smithi044 bash[22676]: audit 2024-09-21T00:14:27.196932+0000 mon.a (mon.0) 4722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:28 smithi044 bash[22676]: cluster 2024-09-21T00:14:27.425805+0000 mgr.a (mgr.14388) 5188 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:14:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:28 smithi179 bash[23186]: audit 2024-09-21T00:14:27.177738+0000 mon.a (mon.0) 4720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:28 smithi179 bash[23186]: audit 2024-09-21T00:14:27.186573+0000 mon.a (mon.0) 4721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:28 smithi179 bash[23186]: audit 2024-09-21T00:14:27.196932+0000 mon.a (mon.0) 4722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:28 smithi179 bash[23186]: cluster 2024-09-21T00:14:27.425805+0000 mgr.a (mgr.14388) 5188 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:14:28.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:28 smithi049 bash[23528]: audit 2024-09-21T00:14:27.177738+0000 mon.a (mon.0) 4720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:28 smithi049 bash[23528]: audit 2024-09-21T00:14:27.186573+0000 mon.a (mon.0) 4721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:28 smithi049 bash[23528]: audit 2024-09-21T00:14:27.196932+0000 mon.a (mon.0) 4722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:28 smithi049 bash[23528]: cluster 2024-09-21T00:14:27.425805+0000 mgr.a (mgr.14388) 5188 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:14:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:30 smithi049 bash[23528]: audit 2024-09-21T00:14:29.011433+0000 mon.a (mon.0) 4723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:30 smithi049 bash[23528]: audit 2024-09-21T00:14:29.019982+0000 mon.a (mon.0) 4724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:30 smithi049 bash[23528]: audit 2024-09-21T00:14:29.030602+0000 mon.a (mon.0) 4725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:30 smithi049 bash[23528]: cluster 2024-09-21T00:14:29.426551+0000 mgr.a (mgr.14388) 5189 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:14:30.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:30.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:30.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:30 smithi044 bash[22676]: audit 2024-09-21T00:14:29.011433+0000 mon.a (mon.0) 4723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:30 smithi044 bash[22676]: audit 2024-09-21T00:14:29.019982+0000 mon.a (mon.0) 4724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:30 smithi044 bash[22676]: audit 2024-09-21T00:14:29.030602+0000 mon.a (mon.0) 4725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:30 smithi044 bash[22676]: cluster 2024-09-21T00:14:29.426551+0000 mgr.a (mgr.14388) 5189 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:14:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:30 smithi179 bash[23186]: audit 2024-09-21T00:14:29.011433+0000 mon.a (mon.0) 4723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:30 smithi179 bash[23186]: audit 2024-09-21T00:14:29.019982+0000 mon.a (mon.0) 4724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:30 smithi179 bash[23186]: audit 2024-09-21T00:14:29.030602+0000 mon.a (mon.0) 4725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:30 smithi179 bash[23186]: cluster 2024-09-21T00:14:29.426551+0000 mgr.a (mgr.14388) 5189 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:14:30.950 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:32 smithi044 bash[22676]: audit 2024-09-21T00:14:30.520672+0000 mgr.a (mgr.14388) 5190 : audit [DBG] from='client.121527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:32 smithi044 bash[22676]: cluster 2024-09-21T00:14:31.428521+0000 mgr.a (mgr.14388) 5191 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:32 smithi044 bash[22676]: audit 2024-09-21T00:14:31.444472+0000 mon.a (mon.0) 4726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:32 smithi044 bash[22676]: audit 2024-09-21T00:14:31.452315+0000 mon.a (mon.0) 4727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:32 smithi044 bash[22676]: audit 2024-09-21T00:14:31.463773+0000 mon.a (mon.0) 4728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:32 smithi179 bash[23186]: audit 2024-09-21T00:14:30.520672+0000 mgr.a (mgr.14388) 5190 : audit [DBG] from='client.121527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:32 smithi179 bash[23186]: cluster 2024-09-21T00:14:31.428521+0000 mgr.a (mgr.14388) 5191 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:32 smithi179 bash[23186]: audit 2024-09-21T00:14:31.444472+0000 mon.a (mon.0) 4726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:32 smithi179 bash[23186]: audit 2024-09-21T00:14:31.452315+0000 mon.a (mon.0) 4727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:32 smithi179 bash[23186]: audit 2024-09-21T00:14:31.463773+0000 mon.a (mon.0) 4728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:32 smithi049 bash[23528]: audit 2024-09-21T00:14:30.520672+0000 mgr.a (mgr.14388) 5190 : audit [DBG] from='client.121527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:32 smithi049 bash[23528]: cluster 2024-09-21T00:14:31.428521+0000 mgr.a (mgr.14388) 5191 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:32 smithi049 bash[23528]: audit 2024-09-21T00:14:31.444472+0000 mon.a (mon.0) 4726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:32 smithi049 bash[23528]: audit 2024-09-21T00:14:31.452315+0000 mon.a (mon.0) 4727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:32 smithi049 bash[23528]: audit 2024-09-21T00:14:31.463773+0000 mon.a (mon.0) 4728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:34 smithi044 bash[22676]: cluster 2024-09-21T00:14:33.429297+0000 mgr.a (mgr.14388) 5192 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:14:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:34 smithi179 bash[23186]: cluster 2024-09-21T00:14:33.429297+0000 mgr.a (mgr.14388) 5192 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:14:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:34 smithi049 bash[23528]: cluster 2024-09-21T00:14:33.429297+0000 mgr.a (mgr.14388) 5192 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:14:35.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:35.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:36.725 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:36 smithi044 bash[22676]: cluster 2024-09-21T00:14:35.431240+0000 mgr.a (mgr.14388) 5193 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:36 smithi179 bash[23186]: cluster 2024-09-21T00:14:35.431240+0000 mgr.a (mgr.14388) 5193 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:36 smithi049 bash[23528]: cluster 2024-09-21T00:14:35.431240+0000 mgr.a (mgr.14388) 5193 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:37 smithi044 bash[22676]: audit 2024-09-21T00:14:36.286539+0000 mgr.a (mgr.14388) 5194 : audit [DBG] from='client.121605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:37 smithi179 bash[23186]: audit 2024-09-21T00:14:36.286539+0000 mgr.a (mgr.14388) 5194 : audit [DBG] from='client.121605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:37.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:37 smithi049 bash[23528]: audit 2024-09-21T00:14:36.286539+0000 mgr.a (mgr.14388) 5194 : audit [DBG] from='client.121605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:38 smithi044 bash[22676]: cluster 2024-09-21T00:14:37.432270+0000 mgr.a (mgr.14388) 5195 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:14:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:38 smithi179 bash[23186]: cluster 2024-09-21T00:14:37.432270+0000 mgr.a (mgr.14388) 5195 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:14:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:38 smithi049 bash[23528]: cluster 2024-09-21T00:14:37.432270+0000 mgr.a (mgr.14388) 5195 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:14:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:39 smithi044 bash[22676]: cluster 2024-09-21T00:14:39.433112+0000 mgr.a (mgr.14388) 5196 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:14:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:39 smithi179 bash[23186]: cluster 2024-09-21T00:14:39.433112+0000 mgr.a (mgr.14388) 5196 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:14:39.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:39 smithi049 bash[23528]: cluster 2024-09-21T00:14:39.433112+0000 mgr.a (mgr.14388) 5196 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:14:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:41.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:41 smithi049 bash[23528]: cluster 2024-09-21T00:14:41.435259+0000 mgr.a (mgr.14388) 5197 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:14:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:41 smithi044 bash[22676]: cluster 2024-09-21T00:14:41.435259+0000 mgr.a (mgr.14388) 5197 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:14:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:41 smithi179 bash[23186]: cluster 2024-09-21T00:14:41.435259+0000 mgr.a (mgr.14388) 5197 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:14:42.481 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:42.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:42.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:42.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:42.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:42 smithi049 bash[23528]: audit 2024-09-21T00:14:42.053846+0000 mgr.a (mgr.14388) 5198 : audit [DBG] from='client.121683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:42 smithi044 bash[22676]: audit 2024-09-21T00:14:42.053846+0000 mgr.a (mgr.14388) 5198 : audit [DBG] from='client.121683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:42 smithi179 bash[23186]: audit 2024-09-21T00:14:42.053846+0000 mgr.a (mgr.14388) 5198 : audit [DBG] from='client.121683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:43.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:43 smithi049 bash[23528]: cluster 2024-09-21T00:14:43.436234+0000 mgr.a (mgr.14388) 5199 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:43 smithi044 bash[22676]: cluster 2024-09-21T00:14:43.436234+0000 mgr.a (mgr.14388) 5199 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:43 smithi179 bash[23186]: cluster 2024-09-21T00:14:43.436234+0000 mgr.a (mgr.14388) 5199 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:45 smithi049 bash[23528]: cluster 2024-09-21T00:14:45.438419+0000 mgr.a (mgr.14388) 5200 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:45 smithi044 bash[22676]: cluster 2024-09-21T00:14:45.438419+0000 mgr.a (mgr.14388) 5200 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:45 smithi179 bash[23186]: cluster 2024-09-21T00:14:45.438419+0000 mgr.a (mgr.14388) 5200 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:14:47.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:47.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:47.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:48.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:48.233 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:48 smithi044 bash[22676]: audit 2024-09-21T00:14:47.406986+0000 mon.a (mon.0) 4729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:48 smithi044 bash[22676]: audit 2024-09-21T00:14:47.412395+0000 mon.a (mon.0) 4730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:48 smithi044 bash[22676]: audit 2024-09-21T00:14:47.418892+0000 mon.a (mon.0) 4731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:48 smithi044 bash[22676]: cluster 2024-09-21T00:14:47.438981+0000 mgr.a (mgr.14388) 5201 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:48.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:48 smithi049 bash[23528]: audit 2024-09-21T00:14:47.406986+0000 mon.a (mon.0) 4729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:48 smithi049 bash[23528]: audit 2024-09-21T00:14:47.412395+0000 mon.a (mon.0) 4730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:48 smithi049 bash[23528]: audit 2024-09-21T00:14:47.418892+0000 mon.a (mon.0) 4731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:48 smithi049 bash[23528]: cluster 2024-09-21T00:14:47.438981+0000 mgr.a (mgr.14388) 5201 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:48 smithi179 bash[23186]: audit 2024-09-21T00:14:47.406986+0000 mon.a (mon.0) 4729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:48 smithi179 bash[23186]: audit 2024-09-21T00:14:47.412395+0000 mon.a (mon.0) 4730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:48 smithi179 bash[23186]: audit 2024-09-21T00:14:47.418892+0000 mon.a (mon.0) 4731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:48.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:48 smithi179 bash[23186]: cluster 2024-09-21T00:14:47.438981+0000 mgr.a (mgr.14388) 5201 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:49.625 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:47.801439+0000 mgr.a (mgr.14388) 5202 : audit [DBG] from='client.121761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:49.625 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:48.784344+0000 mon.a (mon.0) 4732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:14:49.625 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:48.791718+0000 mon.a (mon.0) 4733 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:14:49.625 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:48.793813+0000 mon.a (mon.0) 4734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:14:49.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:48.805575+0000 mon.a (mon.0) 4735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:48.811991+0000 mon.a (mon.0) 4736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:14:49.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:49.203753+0000 mon.a (mon.0) 4737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:49.208716+0000 mon.a (mon.0) 4738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:49 smithi049 bash[23528]: audit 2024-09-21T00:14:49.214730+0000 mon.a (mon.0) 4739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22930]: debug 2024-09-21T00:14:49.552+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22930]: debug 2024-09-21T00:14:49.556+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:47.801439+0000 mgr.a (mgr.14388) 5202 : audit [DBG] from='client.121761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:48.784344+0000 mon.a (mon.0) 4732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:48.791718+0000 mon.a (mon.0) 4733 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:48.793813+0000 mon.a (mon.0) 4734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:48.805575+0000 mon.a (mon.0) 4735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:48.811991+0000 mon.a (mon.0) 4736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:49.203753+0000 mon.a (mon.0) 4737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:49.208716+0000 mon.a (mon.0) 4738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:49 smithi044 bash[22676]: audit 2024-09-21T00:14:49.214730+0000 mon.a (mon.0) 4739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:47.801439+0000 mgr.a (mgr.14388) 5202 : audit [DBG] from='client.121761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:48.784344+0000 mon.a (mon.0) 4732 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:48.791718+0000 mon.a (mon.0) 4733 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:48.793813+0000 mon.a (mon.0) 4734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:48.805575+0000 mon.a (mon.0) 4735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:48.811991+0000 mon.a (mon.0) 4736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:49.203753+0000 mon.a (mon.0) 4737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:49.208716+0000 mon.a (mon.0) 4738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:49 smithi179 bash[23186]: audit 2024-09-21T00:14:49.214730+0000 mon.a (mon.0) 4739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:50 smithi044 bash[22676]: audit 2024-09-21T00:14:48.814853+0000 mgr.a (mgr.14388) 5203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:14:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:50 smithi044 bash[22676]: cluster 2024-09-21T00:14:49.439627+0000 mgr.a (mgr.14388) 5204 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:50 smithi179 bash[23186]: audit 2024-09-21T00:14:48.814853+0000 mgr.a (mgr.14388) 5203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:14:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:50 smithi179 bash[23186]: cluster 2024-09-21T00:14:49.439627+0000 mgr.a (mgr.14388) 5204 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:50 smithi049 bash[23528]: audit 2024-09-21T00:14:48.814853+0000 mgr.a (mgr.14388) 5203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:14:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:50 smithi049 bash[23528]: cluster 2024-09-21T00:14:49.439627+0000 mgr.a (mgr.14388) 5204 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:14:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:51 smithi044 bash[22676]: audit 2024-09-21T00:14:49.556238+0000 mgr.a (mgr.14388) 5205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:14:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:51 smithi044 bash[22676]: cephadm 2024-09-21T00:14:49.557427+0000 mgr.a (mgr.14388) 5206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:14:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:51 smithi179 bash[23186]: audit 2024-09-21T00:14:49.556238+0000 mgr.a (mgr.14388) 5205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:14:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:51 smithi179 bash[23186]: cephadm 2024-09-21T00:14:49.557427+0000 mgr.a (mgr.14388) 5206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:14:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:51 smithi049 bash[23528]: audit 2024-09-21T00:14:49.556238+0000 mgr.a (mgr.14388) 5205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:14:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:51 smithi049 bash[23528]: cephadm 2024-09-21T00:14:49.557427+0000 mgr.a (mgr.14388) 5206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:14:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:52 smithi044 bash[22676]: cluster 2024-09-21T00:14:51.441860+0000 mgr.a (mgr.14388) 5207 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:52 smithi044 bash[22676]: audit 2024-09-21T00:14:51.628994+0000 mon.a (mon.0) 4740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:52 smithi044 bash[22676]: audit 2024-09-21T00:14:51.636986+0000 mon.a (mon.0) 4741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:52 smithi044 bash[22676]: audit 2024-09-21T00:14:51.646373+0000 mon.a (mon.0) 4742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:52 smithi179 bash[23186]: cluster 2024-09-21T00:14:51.441860+0000 mgr.a (mgr.14388) 5207 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:52 smithi179 bash[23186]: audit 2024-09-21T00:14:51.628994+0000 mon.a (mon.0) 4740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:52 smithi179 bash[23186]: audit 2024-09-21T00:14:51.636986+0000 mon.a (mon.0) 4741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:52 smithi179 bash[23186]: audit 2024-09-21T00:14:51.646373+0000 mon.a (mon.0) 4742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:52 smithi049 bash[23528]: cluster 2024-09-21T00:14:51.441860+0000 mgr.a (mgr.14388) 5207 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:52 smithi049 bash[23528]: audit 2024-09-21T00:14:51.628994+0000 mon.a (mon.0) 4740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:52 smithi049 bash[23528]: audit 2024-09-21T00:14:51.636986+0000 mon.a (mon.0) 4741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:52 smithi049 bash[23528]: audit 2024-09-21T00:14:51.646373+0000 mon.a (mon.0) 4742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:14:53.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:53.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:53.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:53 smithi049 bash[23528]: cluster 2024-09-21T00:14:53.442597+0000 mgr.a (mgr.14388) 5208 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:53 smithi044 bash[22676]: cluster 2024-09-21T00:14:53.442597+0000 mgr.a (mgr.14388) 5208 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:53 smithi179 bash[23186]: cluster 2024-09-21T00:14:53.442597+0000 mgr.a (mgr.14388) 5208 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:54.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:54.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:54 smithi049 bash[23528]: audit 2024-09-21T00:14:53.572598+0000 mgr.a (mgr.14388) 5209 : audit [DBG] from='client.121944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:54 smithi044 bash[22676]: audit 2024-09-21T00:14:53.572598+0000 mgr.a (mgr.14388) 5209 : audit [DBG] from='client.121944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:54 smithi179 bash[23186]: audit 2024-09-21T00:14:53.572598+0000 mgr.a (mgr.14388) 5209 : audit [DBG] from='client.121944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:55 smithi049 bash[23528]: cluster 2024-09-21T00:14:55.444897+0000 mgr.a (mgr.14388) 5210 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:55 smithi044 bash[22676]: cluster 2024-09-21T00:14:55.444897+0000 mgr.a (mgr.14388) 5210 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:55 smithi179 bash[23186]: cluster 2024-09-21T00:14:55.444897+0000 mgr.a (mgr.14388) 5210 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:57 smithi049 bash[23528]: cluster 2024-09-21T00:14:57.445851+0000 mgr.a (mgr.14388) 5211 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:57 smithi044 bash[22676]: cluster 2024-09-21T00:14:57.445851+0000 mgr.a (mgr.14388) 5211 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:57 smithi179 bash[23186]: cluster 2024-09-21T00:14:57.445851+0000 mgr.a (mgr.14388) 5211 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:14:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:14:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:14:59.794 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:14:59.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:14:59.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:14:59.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:14:59.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:14:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:59 smithi049 bash[23528]: audit 2024-09-21T00:14:59.359930+0000 mgr.a (mgr.14388) 5212 : audit [DBG] from='client.122016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:14:59 smithi049 bash[23528]: cluster 2024-09-21T00:14:59.446456+0000 mgr.a (mgr.14388) 5213 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:14:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:59 smithi044 bash[22676]: audit 2024-09-21T00:14:59.359930+0000 mgr.a (mgr.14388) 5212 : audit [DBG] from='client.122016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:14:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:14:59 smithi044 bash[22676]: cluster 2024-09-21T00:14:59.446456+0000 mgr.a (mgr.14388) 5213 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:15:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:59 smithi179 bash[23186]: audit 2024-09-21T00:14:59.359930+0000 mgr.a (mgr.14388) 5212 : audit [DBG] from='client.122016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:14:59 smithi179 bash[23186]: cluster 2024-09-21T00:14:59.446456+0000 mgr.a (mgr.14388) 5213 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:15:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:01 smithi049 bash[23528]: cluster 2024-09-21T00:15:01.448801+0000 mgr.a (mgr.14388) 5214 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:15:01.837 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:01 smithi179 bash[23186]: cluster 2024-09-21T00:15:01.448801+0000 mgr.a (mgr.14388) 5214 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:15:01.854 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:01 smithi044 bash[22676]: cluster 2024-09-21T00:15:01.448801+0000 mgr.a (mgr.14388) 5214 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:15:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:03 smithi049 bash[23528]: cluster 2024-09-21T00:15:03.449607+0000 mgr.a (mgr.14388) 5215 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:03 smithi044 bash[22676]: cluster 2024-09-21T00:15:03.449607+0000 mgr.a (mgr.14388) 5215 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:03 smithi179 bash[23186]: cluster 2024-09-21T00:15:03.449607+0000 mgr.a (mgr.14388) 5215 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:04.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:04.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:04.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:05.580 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:05 smithi049 bash[23528]: audit 2024-09-21T00:15:05.132192+0000 mgr.a (mgr.14388) 5216 : audit [DBG] from='client.122088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:05 smithi049 bash[23528]: cluster 2024-09-21T00:15:05.450861+0000 mgr.a (mgr.14388) 5217 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:05 smithi044 bash[22676]: audit 2024-09-21T00:15:05.132192+0000 mgr.a (mgr.14388) 5216 : audit [DBG] from='client.122088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:05 smithi044 bash[22676]: cluster 2024-09-21T00:15:05.450861+0000 mgr.a (mgr.14388) 5217 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:05 smithi179 bash[23186]: audit 2024-09-21T00:15:05.132192+0000 mgr.a (mgr.14388) 5216 : audit [DBG] from='client.122088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:05 smithi179 bash[23186]: cluster 2024-09-21T00:15:05.450861+0000 mgr.a (mgr.14388) 5217 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:07.718 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:07 smithi179 bash[23186]: cluster 2024-09-21T00:15:07.451511+0000 mgr.a (mgr.14388) 5218 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:07 smithi049 bash[23528]: cluster 2024-09-21T00:15:07.451511+0000 mgr.a (mgr.14388) 5218 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:07 smithi044 bash[22676]: cluster 2024-09-21T00:15:07.451511+0000 mgr.a (mgr.14388) 5218 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:08 smithi179 bash[23186]: audit 2024-09-21T00:15:07.603475+0000 mon.a (mon.0) 4743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:08 smithi179 bash[23186]: audit 2024-09-21T00:15:07.612098+0000 mon.a (mon.0) 4744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:08 smithi179 bash[23186]: audit 2024-09-21T00:15:07.622719+0000 mon.a (mon.0) 4745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:08 smithi044 bash[22676]: audit 2024-09-21T00:15:07.603475+0000 mon.a (mon.0) 4743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:08 smithi044 bash[22676]: audit 2024-09-21T00:15:07.612098+0000 mon.a (mon.0) 4744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:08 smithi044 bash[22676]: audit 2024-09-21T00:15:07.622719+0000 mon.a (mon.0) 4745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:08 smithi049 bash[23528]: audit 2024-09-21T00:15:07.603475+0000 mon.a (mon.0) 4743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:08 smithi049 bash[23528]: audit 2024-09-21T00:15:07.612098+0000 mon.a (mon.0) 4744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:08 smithi049 bash[23528]: audit 2024-09-21T00:15:07.622719+0000 mon.a (mon.0) 4745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:10.581 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:10.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:10.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:10 smithi049 bash[23528]: audit 2024-09-21T00:15:09.358128+0000 mon.a (mon.0) 4746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:10 smithi049 bash[23528]: audit 2024-09-21T00:15:09.366686+0000 mon.a (mon.0) 4747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:10 smithi049 bash[23528]: audit 2024-09-21T00:15:09.376565+0000 mon.a (mon.0) 4748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:10 smithi049 bash[23528]: cluster 2024-09-21T00:15:09.452315+0000 mgr.a (mgr.14388) 5219 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:10.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:10 smithi044 bash[22676]: audit 2024-09-21T00:15:09.358128+0000 mon.a (mon.0) 4746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:10 smithi044 bash[22676]: audit 2024-09-21T00:15:09.366686+0000 mon.a (mon.0) 4747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:10 smithi044 bash[22676]: audit 2024-09-21T00:15:09.376565+0000 mon.a (mon.0) 4748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:10 smithi044 bash[22676]: cluster 2024-09-21T00:15:09.452315+0000 mgr.a (mgr.14388) 5219 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:10 smithi179 bash[23186]: audit 2024-09-21T00:15:09.358128+0000 mon.a (mon.0) 4746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:10 smithi179 bash[23186]: audit 2024-09-21T00:15:09.366686+0000 mon.a (mon.0) 4747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:10 smithi179 bash[23186]: audit 2024-09-21T00:15:09.376565+0000 mon.a (mon.0) 4748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:10 smithi179 bash[23186]: cluster 2024-09-21T00:15:09.452315+0000 mgr.a (mgr.14388) 5219 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:11.352 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:11.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:11.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:11.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:11.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:11 smithi049 bash[23528]: audit 2024-09-21T00:15:10.916196+0000 mgr.a (mgr.14388) 5220 : audit [DBG] from='client.122166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:11 smithi049 bash[23528]: cluster 2024-09-21T00:15:11.454009+0000 mgr.a (mgr.14388) 5221 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:11.810 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:11 smithi044 bash[22676]: audit 2024-09-21T00:15:10.916196+0000 mgr.a (mgr.14388) 5220 : audit [DBG] from='client.122166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:11.810 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:11 smithi044 bash[22676]: cluster 2024-09-21T00:15:11.454009+0000 mgr.a (mgr.14388) 5221 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:11 smithi179 bash[23186]: audit 2024-09-21T00:15:10.916196+0000 mgr.a (mgr.14388) 5220 : audit [DBG] from='client.122166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:11 smithi179 bash[23186]: cluster 2024-09-21T00:15:11.454009+0000 mgr.a (mgr.14388) 5221 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:12 smithi044 bash[22676]: audit 2024-09-21T00:15:11.841149+0000 mon.a (mon.0) 4749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:12 smithi044 bash[22676]: audit 2024-09-21T00:15:11.846659+0000 mon.a (mon.0) 4750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:12 smithi044 bash[22676]: audit 2024-09-21T00:15:11.851484+0000 mon.a (mon.0) 4751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:12 smithi179 bash[23186]: audit 2024-09-21T00:15:11.841149+0000 mon.a (mon.0) 4749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:12 smithi179 bash[23186]: audit 2024-09-21T00:15:11.846659+0000 mon.a (mon.0) 4750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:12 smithi179 bash[23186]: audit 2024-09-21T00:15:11.851484+0000 mon.a (mon.0) 4751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:12 smithi049 bash[23528]: audit 2024-09-21T00:15:11.841149+0000 mon.a (mon.0) 4749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:12 smithi049 bash[23528]: audit 2024-09-21T00:15:11.846659+0000 mon.a (mon.0) 4750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:12 smithi049 bash[23528]: audit 2024-09-21T00:15:11.851484+0000 mon.a (mon.0) 4751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:13 smithi044 bash[22676]: cluster 2024-09-21T00:15:13.454762+0000 mgr.a (mgr.14388) 5222 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:13 smithi179 bash[23186]: cluster 2024-09-21T00:15:13.454762+0000 mgr.a (mgr.14388) 5222 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:13 smithi049 bash[23528]: cluster 2024-09-21T00:15:13.454762+0000 mgr.a (mgr.14388) 5222 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:15 smithi049 bash[23528]: cluster 2024-09-21T00:15:15.456710+0000 mgr.a (mgr.14388) 5223 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:15 smithi044 bash[22676]: cluster 2024-09-21T00:15:15.456710+0000 mgr.a (mgr.14388) 5223 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:15 smithi179 bash[23186]: cluster 2024-09-21T00:15:15.456710+0000 mgr.a (mgr.14388) 5223 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:17.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:17.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:17.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:17 smithi049 bash[23528]: audit 2024-09-21T00:15:16.689009+0000 mgr.a (mgr.14388) 5224 : audit [DBG] from='client.122244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:17 smithi049 bash[23528]: cluster 2024-09-21T00:15:17.457886+0000 mgr.a (mgr.14388) 5225 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:17.823 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:17 smithi179 bash[23186]: audit 2024-09-21T00:15:16.689009+0000 mgr.a (mgr.14388) 5224 : audit [DBG] from='client.122244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:17.823 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:17 smithi179 bash[23186]: cluster 2024-09-21T00:15:17.457886+0000 mgr.a (mgr.14388) 5225 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:17 smithi044 bash[22676]: audit 2024-09-21T00:15:16.689009+0000 mgr.a (mgr.14388) 5224 : audit [DBG] from='client.122244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:17 smithi044 bash[22676]: cluster 2024-09-21T00:15:17.457886+0000 mgr.a (mgr.14388) 5225 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:19 smithi049 bash[23528]: cluster 2024-09-21T00:15:19.458883+0000 mgr.a (mgr.14388) 5226 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:19 smithi044 bash[22676]: cluster 2024-09-21T00:15:19.458883+0000 mgr.a (mgr.14388) 5226 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:19 smithi179 bash[23186]: cluster 2024-09-21T00:15:19.458883+0000 mgr.a (mgr.14388) 5226 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:21 smithi049 bash[23528]: cluster 2024-09-21T00:15:21.461282+0000 mgr.a (mgr.14388) 5227 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:21 smithi044 bash[22676]: cluster 2024-09-21T00:15:21.461282+0000 mgr.a (mgr.14388) 5227 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:21 smithi179 bash[23186]: cluster 2024-09-21T00:15:21.461282+0000 mgr.a (mgr.14388) 5227 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:22.925 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:22.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:22.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:22.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:23.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:23 smithi049 bash[23528]: audit 2024-09-21T00:15:22.484562+0000 mgr.a (mgr.14388) 5228 : audit [DBG] from='client.122319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:23.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:23 smithi049 bash[23528]: cluster 2024-09-21T00:15:23.462289+0000 mgr.a (mgr.14388) 5229 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:23 smithi044 bash[22676]: audit 2024-09-21T00:15:22.484562+0000 mgr.a (mgr.14388) 5228 : audit [DBG] from='client.122319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:23 smithi044 bash[22676]: cluster 2024-09-21T00:15:23.462289+0000 mgr.a (mgr.14388) 5229 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:23 smithi179 bash[23186]: audit 2024-09-21T00:15:22.484562+0000 mgr.a (mgr.14388) 5228 : audit [DBG] from='client.122319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:23 smithi179 bash[23186]: cluster 2024-09-21T00:15:23.462289+0000 mgr.a (mgr.14388) 5229 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:25 smithi049 bash[23528]: cluster 2024-09-21T00:15:25.464407+0000 mgr.a (mgr.14388) 5230 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:25 smithi044 bash[22676]: cluster 2024-09-21T00:15:25.464407+0000 mgr.a (mgr.14388) 5230 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:25 smithi179 bash[23186]: cluster 2024-09-21T00:15:25.464407+0000 mgr.a (mgr.14388) 5230 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:27.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:27 smithi179 bash[23186]: cluster 2024-09-21T00:15:27.465200+0000 mgr.a (mgr.14388) 5231 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:27 smithi049 bash[23528]: cluster 2024-09-21T00:15:27.465200+0000 mgr.a (mgr.14388) 5231 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:27.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:27.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:27.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:27 smithi044 bash[22676]: cluster 2024-09-21T00:15:27.465200+0000 mgr.a (mgr.14388) 5231 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:28.696 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:28.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:28.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:28.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:28 smithi049 bash[23528]: audit 2024-09-21T00:15:27.795481+0000 mon.a (mon.0) 4752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:28 smithi049 bash[23528]: audit 2024-09-21T00:15:27.803994+0000 mon.a (mon.0) 4753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:28 smithi049 bash[23528]: audit 2024-09-21T00:15:27.815678+0000 mon.a (mon.0) 4754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:28 smithi049 bash[23528]: audit 2024-09-21T00:15:28.265814+0000 mgr.a (mgr.14388) 5232 : audit [DBG] from='client.122397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:29.123 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:28 smithi179 bash[23186]: audit 2024-09-21T00:15:27.795481+0000 mon.a (mon.0) 4752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.123 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:28 smithi179 bash[23186]: audit 2024-09-21T00:15:27.803994+0000 mon.a (mon.0) 4753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.123 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:28 smithi179 bash[23186]: audit 2024-09-21T00:15:27.815678+0000 mon.a (mon.0) 4754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.123 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:28 smithi179 bash[23186]: audit 2024-09-21T00:15:28.265814+0000 mgr.a (mgr.14388) 5232 : audit [DBG] from='client.122397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:29.226 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:28 smithi044 bash[22676]: audit 2024-09-21T00:15:27.795481+0000 mon.a (mon.0) 4752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.226 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:28 smithi044 bash[22676]: audit 2024-09-21T00:15:27.803994+0000 mon.a (mon.0) 4753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.226 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:28 smithi044 bash[22676]: audit 2024-09-21T00:15:27.815678+0000 mon.a (mon.0) 4754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.226 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:28 smithi044 bash[22676]: audit 2024-09-21T00:15:28.265814+0000 mgr.a (mgr.14388) 5232 : audit [DBG] from='client.122397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:29.915 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:29 smithi179 bash[23186]: cluster 2024-09-21T00:15:29.466183+0000 mgr.a (mgr.14388) 5233 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:29.916 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:29 smithi179 bash[23186]: audit 2024-09-21T00:15:29.543326+0000 mon.a (mon.0) 4755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.916 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:29 smithi179 bash[23186]: audit 2024-09-21T00:15:29.552991+0000 mon.a (mon.0) 4756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:29.916 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:29 smithi179 bash[23186]: audit 2024-09-21T00:15:29.565166+0000 mon.a (mon.0) 4757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:30.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:29 smithi044 bash[22676]: cluster 2024-09-21T00:15:29.466183+0000 mgr.a (mgr.14388) 5233 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:30.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:29 smithi044 bash[22676]: audit 2024-09-21T00:15:29.543326+0000 mon.a (mon.0) 4755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:30.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:29 smithi044 bash[22676]: audit 2024-09-21T00:15:29.552991+0000 mon.a (mon.0) 4756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:30.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:29 smithi044 bash[22676]: audit 2024-09-21T00:15:29.565166+0000 mon.a (mon.0) 4757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:30.164 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:29 smithi049 bash[23528]: cluster 2024-09-21T00:15:29.466183+0000 mgr.a (mgr.14388) 5233 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:30.164 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:29 smithi049 bash[23528]: audit 2024-09-21T00:15:29.543326+0000 mon.a (mon.0) 4755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:30.164 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:29 smithi049 bash[23528]: audit 2024-09-21T00:15:29.552991+0000 mon.a (mon.0) 4756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:30.164 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:29 smithi049 bash[23528]: audit 2024-09-21T00:15:29.565166+0000 mon.a (mon.0) 4757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:31 smithi049 bash[23528]: cluster 2024-09-21T00:15:31.467349+0000 mgr.a (mgr.14388) 5234 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:31.863 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:31 smithi044 bash[22676]: cluster 2024-09-21T00:15:31.467349+0000 mgr.a (mgr.14388) 5234 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:31 smithi179 bash[23186]: cluster 2024-09-21T00:15:31.467349+0000 mgr.a (mgr.14388) 5234 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:33 smithi044 bash[22676]: audit 2024-09-21T00:15:32.007250+0000 mon.a (mon.0) 4758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:33 smithi044 bash[22676]: audit 2024-09-21T00:15:32.023315+0000 mon.a (mon.0) 4759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:33 smithi044 bash[22676]: audit 2024-09-21T00:15:32.032071+0000 mon.a (mon.0) 4760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:33 smithi049 bash[23528]: audit 2024-09-21T00:15:32.007250+0000 mon.a (mon.0) 4758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:33 smithi049 bash[23528]: audit 2024-09-21T00:15:32.023315+0000 mon.a (mon.0) 4759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:33 smithi049 bash[23528]: audit 2024-09-21T00:15:32.032071+0000 mon.a (mon.0) 4760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:33 smithi179 bash[23186]: audit 2024-09-21T00:15:32.007250+0000 mon.a (mon.0) 4758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:33 smithi179 bash[23186]: audit 2024-09-21T00:15:32.023315+0000 mon.a (mon.0) 4759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:33 smithi179 bash[23186]: audit 2024-09-21T00:15:32.032071+0000 mon.a (mon.0) 4760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:33.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:33.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:33.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:34 smithi049 bash[23528]: cluster 2024-09-21T00:15:33.468100+0000 mgr.a (mgr.14388) 5235 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:34.466 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:34.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:34 smithi044 bash[22676]: cluster 2024-09-21T00:15:33.468100+0000 mgr.a (mgr.14388) 5235 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:34 smithi179 bash[23186]: cluster 2024-09-21T00:15:33.468100+0000 mgr.a (mgr.14388) 5235 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:35 smithi049 bash[23528]: audit 2024-09-21T00:15:34.034075+0000 mgr.a (mgr.14388) 5236 : audit [DBG] from='client.122475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:35 smithi044 bash[22676]: audit 2024-09-21T00:15:34.034075+0000 mgr.a (mgr.14388) 5236 : audit [DBG] from='client.122475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:35 smithi179 bash[23186]: audit 2024-09-21T00:15:34.034075+0000 mgr.a (mgr.14388) 5236 : audit [DBG] from='client.122475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:36.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:36 smithi049 bash[23528]: cluster 2024-09-21T00:15:35.470534+0000 mgr.a (mgr.14388) 5237 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:36 smithi044 bash[22676]: cluster 2024-09-21T00:15:35.470534+0000 mgr.a (mgr.14388) 5237 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:36 smithi179 bash[23186]: cluster 2024-09-21T00:15:35.470534+0000 mgr.a (mgr.14388) 5237 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:15:37.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:37 smithi049 bash[23528]: cluster 2024-09-21T00:15:37.471318+0000 mgr.a (mgr.14388) 5238 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:37 smithi044 bash[22676]: cluster 2024-09-21T00:15:37.471318+0000 mgr.a (mgr.14388) 5238 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:37 smithi179 bash[23186]: cluster 2024-09-21T00:15:37.471318+0000 mgr.a (mgr.14388) 5238 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:39.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:39.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:39.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:39.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:39 smithi049 bash[23528]: cluster 2024-09-21T00:15:39.472063+0000 mgr.a (mgr.14388) 5239 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:39 smithi044 bash[22676]: cluster 2024-09-21T00:15:39.472063+0000 mgr.a (mgr.14388) 5239 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:39 smithi179 bash[23186]: cluster 2024-09-21T00:15:39.472063+0000 mgr.a (mgr.14388) 5239 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:40.239 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:40.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:40.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:40.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:40.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:40 smithi049 bash[23528]: audit 2024-09-21T00:15:39.809729+0000 mgr.a (mgr.14388) 5240 : audit [DBG] from='client.122553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:40 smithi044 bash[22676]: audit 2024-09-21T00:15:39.809729+0000 mgr.a (mgr.14388) 5240 : audit [DBG] from='client.122553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:40 smithi179 bash[23186]: audit 2024-09-21T00:15:39.809729+0000 mgr.a (mgr.14388) 5240 : audit [DBG] from='client.122553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:41.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:41 smithi049 bash[23528]: cluster 2024-09-21T00:15:41.474831+0000 mgr.a (mgr.14388) 5241 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:41 smithi044 bash[22676]: cluster 2024-09-21T00:15:41.474831+0000 mgr.a (mgr.14388) 5241 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:41 smithi179 bash[23186]: cluster 2024-09-21T00:15:41.474831+0000 mgr.a (mgr.14388) 5241 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:43.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:43 smithi049 bash[23528]: cluster 2024-09-21T00:15:43.475592+0000 mgr.a (mgr.14388) 5242 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:15:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:43 smithi044 bash[22676]: cluster 2024-09-21T00:15:43.475592+0000 mgr.a (mgr.14388) 5242 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:15:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:43 smithi179 bash[23186]: cluster 2024-09-21T00:15:43.475592+0000 mgr.a (mgr.14388) 5242 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:15:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:45 smithi049 bash[23528]: cluster 2024-09-21T00:15:45.477606+0000 mgr.a (mgr.14388) 5243 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:45 smithi044 bash[22676]: cluster 2024-09-21T00:15:45.477606+0000 mgr.a (mgr.14388) 5243 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:45 smithi179 bash[23186]: cluster 2024-09-21T00:15:45.477606+0000 mgr.a (mgr.14388) 5243 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:15:46.030 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:46.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:46.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:46.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:46.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:46 smithi049 bash[23528]: audit 2024-09-21T00:15:45.575051+0000 mgr.a (mgr.14388) 5244 : audit [DBG] from='client.122625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:46 smithi044 bash[22676]: audit 2024-09-21T00:15:45.575051+0000 mgr.a (mgr.14388) 5244 : audit [DBG] from='client.122625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:46 smithi179 bash[23186]: audit 2024-09-21T00:15:45.575051+0000 mgr.a (mgr.14388) 5244 : audit [DBG] from='client.122625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:47 smithi179 bash[23186]: cluster 2024-09-21T00:15:47.478547+0000 mgr.a (mgr.14388) 5245 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:15:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:47 smithi049 bash[23528]: cluster 2024-09-21T00:15:47.478547+0000 mgr.a (mgr.14388) 5245 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:15:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:47 smithi044 bash[22676]: cluster 2024-09-21T00:15:47.478547+0000 mgr.a (mgr.14388) 5245 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:15:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:49 smithi049 bash[23528]: audit 2024-09-21T00:15:48.032017+0000 mon.a (mon.0) 4761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:49 smithi049 bash[23528]: audit 2024-09-21T00:15:48.040698+0000 mon.a (mon.0) 4762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:49 smithi049 bash[23528]: audit 2024-09-21T00:15:48.051368+0000 mon.a (mon.0) 4763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.321 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:49 smithi179 bash[23186]: audit 2024-09-21T00:15:48.032017+0000 mon.a (mon.0) 4761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.322 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:49 smithi179 bash[23186]: audit 2024-09-21T00:15:48.040698+0000 mon.a (mon.0) 4762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.322 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:49 smithi179 bash[23186]: audit 2024-09-21T00:15:48.051368+0000 mon.a (mon.0) 4763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.398 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:49 smithi044 bash[22676]: audit 2024-09-21T00:15:48.032017+0000 mon.a (mon.0) 4761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.398 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:49 smithi044 bash[22676]: audit 2024-09-21T00:15:48.040698+0000 mon.a (mon.0) 4762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:49.399 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:49 smithi044 bash[22676]: audit 2024-09-21T00:15:48.051368+0000 mon.a (mon.0) 4763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: cluster 2024-09-21T00:15:49.479368+0000 mgr.a (mgr.14388) 5246 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.605772+0000 mon.a (mon.0) 4764 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.612365+0000 mon.a (mon.0) 4765 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.614369+0000 mon.a (mon.0) 4766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.625728+0000 mon.a (mon.0) 4767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.632049+0000 mon.a (mon.0) 4768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.729057+0000 mon.a (mon.0) 4769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.735138+0000 mon.a (mon.0) 4770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:50 smithi049 bash[23528]: audit 2024-09-21T00:15:49.741653+0000 mon.a (mon.0) 4771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: cluster 2024-09-21T00:15:49.479368+0000 mgr.a (mgr.14388) 5246 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:50.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.605772+0000 mon.a (mon.0) 4764 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:15:50.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.612365+0000 mon.a (mon.0) 4765 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:15:50.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.614369+0000 mon.a (mon.0) 4766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:15:50.298 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.625728+0000 mon.a (mon.0) 4767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.298 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.632049+0000 mon.a (mon.0) 4768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:15:50.298 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.729057+0000 mon.a (mon.0) 4769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.298 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.735138+0000 mon.a (mon.0) 4770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.298 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22676]: audit 2024-09-21T00:15:49.741653+0000 mon.a (mon.0) 4771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: cluster 2024-09-21T00:15:49.479368+0000 mgr.a (mgr.14388) 5246 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.605772+0000 mon.a (mon.0) 4764 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.612365+0000 mon.a (mon.0) 4765 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.614369+0000 mon.a (mon.0) 4766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.625728+0000 mon.a (mon.0) 4767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.632049+0000 mon.a (mon.0) 4768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.729057+0000 mon.a (mon.0) 4769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.735138+0000 mon.a (mon.0) 4770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:50 smithi179 bash[23186]: audit 2024-09-21T00:15:49.741653+0000 mon.a (mon.0) 4771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:50.593 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22930]: debug 2024-09-21T00:15:50.359+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:15:50.593 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:15:50 smithi044 bash[22930]: debug 2024-09-21T00:15:50.359+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:15:51.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:51 smithi179 bash[23186]: audit 2024-09-21T00:15:49.634557+0000 mgr.a (mgr.14388) 5247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:15:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:51 smithi179 bash[23186]: audit 2024-09-21T00:15:50.362158+0000 mgr.a (mgr.14388) 5248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:15:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:51 smithi179 bash[23186]: cephadm 2024-09-21T00:15:50.363251+0000 mgr.a (mgr.14388) 5249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:15:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:51 smithi049 bash[23528]: audit 2024-09-21T00:15:49.634557+0000 mgr.a (mgr.14388) 5247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:15:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:51 smithi049 bash[23528]: audit 2024-09-21T00:15:50.362158+0000 mgr.a (mgr.14388) 5248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:15:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:51 smithi049 bash[23528]: cephadm 2024-09-21T00:15:50.363251+0000 mgr.a (mgr.14388) 5249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:15:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:51 smithi044 bash[22676]: audit 2024-09-21T00:15:49.634557+0000 mgr.a (mgr.14388) 5247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:15:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:51 smithi044 bash[22676]: audit 2024-09-21T00:15:50.362158+0000 mgr.a (mgr.14388) 5248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:15:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:51 smithi044 bash[22676]: cephadm 2024-09-21T00:15:50.363251+0000 mgr.a (mgr.14388) 5249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:15:51.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:51.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:51.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:51.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:51.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:52 smithi044 bash[22676]: audit 2024-09-21T00:15:51.370302+0000 mgr.a (mgr.14388) 5250 : audit [DBG] from='client.122811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:52 smithi044 bash[22676]: cluster 2024-09-21T00:15:51.480618+0000 mgr.a (mgr.14388) 5251 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T00:15:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:52 smithi179 bash[23186]: audit 2024-09-21T00:15:51.370302+0000 mgr.a (mgr.14388) 5250 : audit [DBG] from='client.122811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:52 smithi179 bash[23186]: cluster 2024-09-21T00:15:51.480618+0000 mgr.a (mgr.14388) 5251 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T00:15:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:52 smithi049 bash[23528]: audit 2024-09-21T00:15:51.370302+0000 mgr.a (mgr.14388) 5250 : audit [DBG] from='client.122811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:52 smithi049 bash[23528]: cluster 2024-09-21T00:15:51.480618+0000 mgr.a (mgr.14388) 5251 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T00:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:53 smithi044 bash[22676]: audit 2024-09-21T00:15:52.192704+0000 mon.a (mon.0) 4772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:53 smithi044 bash[22676]: audit 2024-09-21T00:15:52.198177+0000 mon.a (mon.0) 4773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:53 smithi044 bash[22676]: audit 2024-09-21T00:15:52.204342+0000 mon.a (mon.0) 4774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:53 smithi179 bash[23186]: audit 2024-09-21T00:15:52.192704+0000 mon.a (mon.0) 4772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:53 smithi179 bash[23186]: audit 2024-09-21T00:15:52.198177+0000 mon.a (mon.0) 4773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:53 smithi179 bash[23186]: audit 2024-09-21T00:15:52.204342+0000 mon.a (mon.0) 4774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:53 smithi049 bash[23528]: audit 2024-09-21T00:15:52.192704+0000 mon.a (mon.0) 4772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:53 smithi049 bash[23528]: audit 2024-09-21T00:15:52.198177+0000 mon.a (mon.0) 4773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:53 smithi049 bash[23528]: audit 2024-09-21T00:15:52.204342+0000 mon.a (mon.0) 4774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:15:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:54 smithi044 bash[22676]: cluster 2024-09-21T00:15:53.481528+0000 mgr.a (mgr.14388) 5252 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T00:15:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:54 smithi179 bash[23186]: cluster 2024-09-21T00:15:53.481528+0000 mgr.a (mgr.14388) 5252 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T00:15:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:54 smithi049 bash[23528]: cluster 2024-09-21T00:15:53.481528+0000 mgr.a (mgr.14388) 5252 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T00:15:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:55 smithi049 bash[23528]: cluster 2024-09-21T00:15:55.483960+0000 mgr.a (mgr.14388) 5253 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T00:15:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:55 smithi044 bash[22676]: cluster 2024-09-21T00:15:55.483960+0000 mgr.a (mgr.14388) 5253 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T00:15:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:55 smithi179 bash[23186]: cluster 2024-09-21T00:15:55.483960+0000 mgr.a (mgr.14388) 5253 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T00:15:56.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:15:56.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:15:56.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:15:57.587 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:15:57.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:15:57.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:15:57.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:15:57.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:15:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:57 smithi049 bash[23528]: audit 2024-09-21T00:15:57.135253+0000 mgr.a (mgr.14388) 5254 : audit [DBG] from='client.122886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:57 smithi044 bash[22676]: audit 2024-09-21T00:15:57.135253+0000 mgr.a (mgr.14388) 5254 : audit [DBG] from='client.122886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:57 smithi179 bash[23186]: audit 2024-09-21T00:15:57.135253+0000 mgr.a (mgr.14388) 5254 : audit [DBG] from='client.122886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:15:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:15:58 smithi049 bash[23528]: cluster 2024-09-21T00:15:57.484662+0000 mgr.a (mgr.14388) 5255 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T00:15:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:15:58 smithi044 bash[22676]: cluster 2024-09-21T00:15:57.484662+0000 mgr.a (mgr.14388) 5255 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T00:15:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:15:58 smithi179 bash[23186]: cluster 2024-09-21T00:15:57.484662+0000 mgr.a (mgr.14388) 5255 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T00:16:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:00 smithi044 bash[22676]: cluster 2024-09-21T00:15:59.485434+0000 mgr.a (mgr.14388) 5256 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T00:16:01.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:00 smithi179 bash[23186]: cluster 2024-09-21T00:15:59.485434+0000 mgr.a (mgr.14388) 5256 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T00:16:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:00 smithi049 bash[23528]: cluster 2024-09-21T00:15:59.485434+0000 mgr.a (mgr.14388) 5256 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T00:16:02.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:02.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:02.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:02 smithi044 bash[22676]: cluster 2024-09-21T00:16:01.487662+0000 mgr.a (mgr.14388) 5257 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 426 B/s wr, 94 op/s 2024-09-21T00:16:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:02 smithi179 bash[23186]: cluster 2024-09-21T00:16:01.487662+0000 mgr.a (mgr.14388) 5257 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 426 B/s wr, 94 op/s 2024-09-21T00:16:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:02 smithi049 bash[23528]: cluster 2024-09-21T00:16:01.487662+0000 mgr.a (mgr.14388) 5257 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 426 B/s wr, 94 op/s 2024-09-21T00:16:03.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:03.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:03.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:03.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:03.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:03 smithi044 bash[22676]: audit 2024-09-21T00:16:02.925640+0000 mgr.a (mgr.14388) 5258 : audit [DBG] from='client.122961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:03 smithi179 bash[23186]: audit 2024-09-21T00:16:02.925640+0000 mgr.a (mgr.14388) 5258 : audit [DBG] from='client.122961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:04.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:03 smithi049 bash[23528]: audit 2024-09-21T00:16:02.925640+0000 mgr.a (mgr.14388) 5258 : audit [DBG] from='client.122961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:04 smithi044 bash[22676]: cluster 2024-09-21T00:16:03.488637+0000 mgr.a (mgr.14388) 5259 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T00:16:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:04 smithi179 bash[23186]: cluster 2024-09-21T00:16:03.488637+0000 mgr.a (mgr.14388) 5259 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T00:16:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:04 smithi049 bash[23528]: cluster 2024-09-21T00:16:03.488637+0000 mgr.a (mgr.14388) 5259 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T00:16:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:06 smithi044 bash[22676]: cluster 2024-09-21T00:16:05.490816+0000 mgr.a (mgr.14388) 5260 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T00:16:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:06 smithi179 bash[23186]: cluster 2024-09-21T00:16:05.490816+0000 mgr.a (mgr.14388) 5260 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T00:16:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:06 smithi049 bash[23528]: cluster 2024-09-21T00:16:05.490816+0000 mgr.a (mgr.14388) 5260 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T00:16:08.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:08.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:08.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:09.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:09.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:09.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:09.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:09.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:09 smithi044 bash[22676]: cluster 2024-09-21T00:16:07.491629+0000 mgr.a (mgr.14388) 5261 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:16:09.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:09 smithi044 bash[22676]: audit 2024-09-21T00:16:08.216234+0000 mon.a (mon.0) 4775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:09 smithi044 bash[22676]: audit 2024-09-21T00:16:08.226910+0000 mon.a (mon.0) 4776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:09 smithi044 bash[22676]: audit 2024-09-21T00:16:08.237448+0000 mon.a (mon.0) 4777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:09 smithi179 bash[23186]: cluster 2024-09-21T00:16:07.491629+0000 mgr.a (mgr.14388) 5261 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:16:09.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:09 smithi179 bash[23186]: audit 2024-09-21T00:16:08.216234+0000 mon.a (mon.0) 4775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:09 smithi179 bash[23186]: audit 2024-09-21T00:16:08.226910+0000 mon.a (mon.0) 4776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:09 smithi179 bash[23186]: audit 2024-09-21T00:16:08.237448+0000 mon.a (mon.0) 4777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:09 smithi049 bash[23528]: cluster 2024-09-21T00:16:07.491629+0000 mgr.a (mgr.14388) 5261 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:16:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:09 smithi049 bash[23528]: audit 2024-09-21T00:16:08.216234+0000 mon.a (mon.0) 4775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:09 smithi049 bash[23528]: audit 2024-09-21T00:16:08.226910+0000 mon.a (mon.0) 4776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:09 smithi049 bash[23528]: audit 2024-09-21T00:16:08.237448+0000 mon.a (mon.0) 4777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:10 smithi179 bash[23186]: audit 2024-09-21T00:16:08.688735+0000 mgr.a (mgr.14388) 5262 : audit [DBG] from='client.123039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:10 smithi179 bash[23186]: audit 2024-09-21T00:16:09.953737+0000 mon.a (mon.0) 4778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:10 smithi179 bash[23186]: audit 2024-09-21T00:16:09.962476+0000 mon.a (mon.0) 4779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:10 smithi179 bash[23186]: audit 2024-09-21T00:16:09.973156+0000 mon.a (mon.0) 4780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:10 smithi044 bash[22676]: audit 2024-09-21T00:16:08.688735+0000 mgr.a (mgr.14388) 5262 : audit [DBG] from='client.123039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:10 smithi044 bash[22676]: audit 2024-09-21T00:16:09.953737+0000 mon.a (mon.0) 4778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:10 smithi044 bash[22676]: audit 2024-09-21T00:16:09.962476+0000 mon.a (mon.0) 4779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:10 smithi044 bash[22676]: audit 2024-09-21T00:16:09.973156+0000 mon.a (mon.0) 4780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:10 smithi049 bash[23528]: audit 2024-09-21T00:16:08.688735+0000 mgr.a (mgr.14388) 5262 : audit [DBG] from='client.123039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:10 smithi049 bash[23528]: audit 2024-09-21T00:16:09.953737+0000 mon.a (mon.0) 4778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:10 smithi049 bash[23528]: audit 2024-09-21T00:16:09.962476+0000 mon.a (mon.0) 4779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:10 smithi049 bash[23528]: audit 2024-09-21T00:16:09.973156+0000 mon.a (mon.0) 4780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:11 smithi044 bash[22676]: cluster 2024-09-21T00:16:09.492607+0000 mgr.a (mgr.14388) 5263 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:16:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:11 smithi179 bash[23186]: cluster 2024-09-21T00:16:09.492607+0000 mgr.a (mgr.14388) 5263 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:16:11.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:11 smithi049 bash[23528]: cluster 2024-09-21T00:16:09.492607+0000 mgr.a (mgr.14388) 5263 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:16:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:13 smithi049 bash[23528]: cluster 2024-09-21T00:16:11.494867+0000 mgr.a (mgr.14388) 5264 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:16:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:13 smithi049 bash[23528]: audit 2024-09-21T00:16:12.325005+0000 mon.a (mon.0) 4781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:13 smithi049 bash[23528]: audit 2024-09-21T00:16:12.330631+0000 mon.a (mon.0) 4782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:13 smithi049 bash[23528]: audit 2024-09-21T00:16:12.337079+0000 mon.a (mon.0) 4783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:13 smithi044 bash[22676]: cluster 2024-09-21T00:16:11.494867+0000 mgr.a (mgr.14388) 5264 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:16:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:13 smithi044 bash[22676]: audit 2024-09-21T00:16:12.325005+0000 mon.a (mon.0) 4781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:13 smithi044 bash[22676]: audit 2024-09-21T00:16:12.330631+0000 mon.a (mon.0) 4782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:13 smithi044 bash[22676]: audit 2024-09-21T00:16:12.337079+0000 mon.a (mon.0) 4783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:13 smithi179 bash[23186]: cluster 2024-09-21T00:16:11.494867+0000 mgr.a (mgr.14388) 5264 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:16:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:13 smithi179 bash[23186]: audit 2024-09-21T00:16:12.325005+0000 mon.a (mon.0) 4781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:13 smithi179 bash[23186]: audit 2024-09-21T00:16:12.330631+0000 mon.a (mon.0) 4782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:13 smithi179 bash[23186]: audit 2024-09-21T00:16:12.337079+0000 mon.a (mon.0) 4783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:14.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:14.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:14.892 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:14.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:14.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:14.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:14.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:15 smithi044 bash[22676]: cluster 2024-09-21T00:16:13.495669+0000 mgr.a (mgr.14388) 5265 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:15 smithi044 bash[22676]: audit 2024-09-21T00:16:14.465561+0000 mgr.a (mgr.14388) 5266 : audit [DBG] from='client.123117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:15 smithi179 bash[23186]: cluster 2024-09-21T00:16:13.495669+0000 mgr.a (mgr.14388) 5265 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:15 smithi179 bash[23186]: audit 2024-09-21T00:16:14.465561+0000 mgr.a (mgr.14388) 5266 : audit [DBG] from='client.123117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:15 smithi049 bash[23528]: cluster 2024-09-21T00:16:13.495669+0000 mgr.a (mgr.14388) 5265 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:15 smithi049 bash[23528]: audit 2024-09-21T00:16:14.465561+0000 mgr.a (mgr.14388) 5266 : audit [DBG] from='client.123117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:17 smithi044 bash[22676]: cluster 2024-09-21T00:16:15.498132+0000 mgr.a (mgr.14388) 5267 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:17 smithi179 bash[23186]: cluster 2024-09-21T00:16:15.498132+0000 mgr.a (mgr.14388) 5267 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:17 smithi049 bash[23528]: cluster 2024-09-21T00:16:15.498132+0000 mgr.a (mgr.14388) 5267 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:19.599 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:19 smithi179 bash[23186]: cluster 2024-09-21T00:16:17.498901+0000 mgr.a (mgr.14388) 5268 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:19 smithi044 bash[22676]: cluster 2024-09-21T00:16:17.498901+0000 mgr.a (mgr.14388) 5268 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:19 smithi049 bash[23528]: cluster 2024-09-21T00:16:17.498901+0000 mgr.a (mgr.14388) 5268 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:19.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:19.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:19.895 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:20.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:20.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:20.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:20.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:20.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:21 smithi044 bash[22676]: cluster 2024-09-21T00:16:19.499811+0000 mgr.a (mgr.14388) 5269 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:21 smithi044 bash[22676]: audit 2024-09-21T00:16:20.231310+0000 mgr.a (mgr.14388) 5270 : audit [DBG] from='client.123192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:21 smithi179 bash[23186]: cluster 2024-09-21T00:16:19.499811+0000 mgr.a (mgr.14388) 5269 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:21 smithi179 bash[23186]: audit 2024-09-21T00:16:20.231310+0000 mgr.a (mgr.14388) 5270 : audit [DBG] from='client.123192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:21 smithi049 bash[23528]: cluster 2024-09-21T00:16:19.499811+0000 mgr.a (mgr.14388) 5269 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:21 smithi049 bash[23528]: audit 2024-09-21T00:16:20.231310+0000 mgr.a (mgr.14388) 5270 : audit [DBG] from='client.123192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:23 smithi044 bash[22676]: cluster 2024-09-21T00:16:21.502749+0000 mgr.a (mgr.14388) 5271 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:23 smithi179 bash[23186]: cluster 2024-09-21T00:16:21.502749+0000 mgr.a (mgr.14388) 5271 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:23.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:23 smithi049 bash[23528]: cluster 2024-09-21T00:16:21.502749+0000 mgr.a (mgr.14388) 5271 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:25 smithi044 bash[22676]: cluster 2024-09-21T00:16:23.503622+0000 mgr.a (mgr.14388) 5272 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:25 smithi179 bash[23186]: cluster 2024-09-21T00:16:23.503622+0000 mgr.a (mgr.14388) 5272 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:25 smithi049 bash[23528]: cluster 2024-09-21T00:16:23.503622+0000 mgr.a (mgr.14388) 5272 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:26.460 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:27 smithi044 bash[22676]: cluster 2024-09-21T00:16:25.505901+0000 mgr.a (mgr.14388) 5273 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:27 smithi044 bash[22676]: audit 2024-09-21T00:16:26.007773+0000 mgr.a (mgr.14388) 5274 : audit [DBG] from='client.123267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:27 smithi179 bash[23186]: cluster 2024-09-21T00:16:25.505901+0000 mgr.a (mgr.14388) 5273 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:27 smithi179 bash[23186]: audit 2024-09-21T00:16:26.007773+0000 mgr.a (mgr.14388) 5274 : audit [DBG] from='client.123267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:27 smithi049 bash[23528]: cluster 2024-09-21T00:16:25.505901+0000 mgr.a (mgr.14388) 5273 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:27 smithi049 bash[23528]: audit 2024-09-21T00:16:26.007773+0000 mgr.a (mgr.14388) 5274 : audit [DBG] from='client.123267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:29 smithi044 bash[22676]: cluster 2024-09-21T00:16:27.506802+0000 mgr.a (mgr.14388) 5275 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:29 smithi044 bash[22676]: audit 2024-09-21T00:16:28.458369+0000 mon.a (mon.0) 4784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:29 smithi044 bash[22676]: audit 2024-09-21T00:16:28.468538+0000 mon.a (mon.0) 4785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:29 smithi044 bash[22676]: audit 2024-09-21T00:16:28.480394+0000 mon.a (mon.0) 4786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:29 smithi179 bash[23186]: cluster 2024-09-21T00:16:27.506802+0000 mgr.a (mgr.14388) 5275 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:29 smithi179 bash[23186]: audit 2024-09-21T00:16:28.458369+0000 mon.a (mon.0) 4784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:29 smithi179 bash[23186]: audit 2024-09-21T00:16:28.468538+0000 mon.a (mon.0) 4785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:29 smithi179 bash[23186]: audit 2024-09-21T00:16:28.480394+0000 mon.a (mon.0) 4786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:29 smithi049 bash[23528]: cluster 2024-09-21T00:16:27.506802+0000 mgr.a (mgr.14388) 5275 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:29 smithi049 bash[23528]: audit 2024-09-21T00:16:28.458369+0000 mon.a (mon.0) 4784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:29 smithi049 bash[23528]: audit 2024-09-21T00:16:28.468538+0000 mon.a (mon.0) 4785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:29 smithi049 bash[23528]: audit 2024-09-21T00:16:28.480394+0000 mon.a (mon.0) 4786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:31 smithi049 bash[23528]: cluster 2024-09-21T00:16:29.507603+0000 mgr.a (mgr.14388) 5276 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:31.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:31 smithi049 bash[23528]: audit 2024-09-21T00:16:30.182668+0000 mon.a (mon.0) 4787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:31 smithi049 bash[23528]: audit 2024-09-21T00:16:30.189793+0000 mon.a (mon.0) 4788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.293 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:31 smithi049 bash[23528]: audit 2024-09-21T00:16:30.198438+0000 mon.a (mon.0) 4789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:31 smithi044 bash[22676]: cluster 2024-09-21T00:16:29.507603+0000 mgr.a (mgr.14388) 5276 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:31 smithi044 bash[22676]: audit 2024-09-21T00:16:30.182668+0000 mon.a (mon.0) 4787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:31 smithi044 bash[22676]: audit 2024-09-21T00:16:30.189793+0000 mon.a (mon.0) 4788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:31 smithi044 bash[22676]: audit 2024-09-21T00:16:30.198438+0000 mon.a (mon.0) 4789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:31 smithi179 bash[23186]: cluster 2024-09-21T00:16:29.507603+0000 mgr.a (mgr.14388) 5276 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:16:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:31 smithi179 bash[23186]: audit 2024-09-21T00:16:30.182668+0000 mon.a (mon.0) 4787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:31 smithi179 bash[23186]: audit 2024-09-21T00:16:30.189793+0000 mon.a (mon.0) 4788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:31 smithi179 bash[23186]: audit 2024-09-21T00:16:30.198438+0000 mon.a (mon.0) 4789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:32.261 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:32.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:32.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:32.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:32.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:33 smithi044 bash[22676]: cluster 2024-09-21T00:16:31.509103+0000 mgr.a (mgr.14388) 5277 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:33 smithi044 bash[22676]: audit 2024-09-21T00:16:31.797552+0000 mgr.a (mgr.14388) 5278 : audit [DBG] from='client.123342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:33 smithi044 bash[22676]: audit 2024-09-21T00:16:32.442328+0000 mon.a (mon.0) 4790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:33 smithi044 bash[22676]: audit 2024-09-21T00:16:32.447050+0000 mon.a (mon.0) 4791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:33 smithi044 bash[22676]: audit 2024-09-21T00:16:32.452082+0000 mon.a (mon.0) 4792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:33 smithi179 bash[23186]: cluster 2024-09-21T00:16:31.509103+0000 mgr.a (mgr.14388) 5277 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:33 smithi179 bash[23186]: audit 2024-09-21T00:16:31.797552+0000 mgr.a (mgr.14388) 5278 : audit [DBG] from='client.123342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:33 smithi179 bash[23186]: audit 2024-09-21T00:16:32.442328+0000 mon.a (mon.0) 4790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:33 smithi179 bash[23186]: audit 2024-09-21T00:16:32.447050+0000 mon.a (mon.0) 4791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:33 smithi179 bash[23186]: audit 2024-09-21T00:16:32.452082+0000 mon.a (mon.0) 4792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:33 smithi049 bash[23528]: cluster 2024-09-21T00:16:31.509103+0000 mgr.a (mgr.14388) 5277 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:33 smithi049 bash[23528]: audit 2024-09-21T00:16:31.797552+0000 mgr.a (mgr.14388) 5278 : audit [DBG] from='client.123342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:33 smithi049 bash[23528]: audit 2024-09-21T00:16:32.442328+0000 mon.a (mon.0) 4790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:33 smithi049 bash[23528]: audit 2024-09-21T00:16:32.447050+0000 mon.a (mon.0) 4791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:33 smithi049 bash[23528]: audit 2024-09-21T00:16:32.452082+0000 mon.a (mon.0) 4792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:35 smithi044 bash[22676]: cluster 2024-09-21T00:16:33.510128+0000 mgr.a (mgr.14388) 5279 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:35 smithi179 bash[23186]: cluster 2024-09-21T00:16:33.510128+0000 mgr.a (mgr.14388) 5279 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:35 smithi049 bash[23528]: cluster 2024-09-21T00:16:33.510128+0000 mgr.a (mgr.14388) 5279 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:37.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:37 smithi044 bash[22676]: cluster 2024-09-21T00:16:35.512487+0000 mgr.a (mgr.14388) 5280 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:37 smithi179 bash[23186]: cluster 2024-09-21T00:16:35.512487+0000 mgr.a (mgr.14388) 5280 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:37.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:37 smithi049 bash[23528]: cluster 2024-09-21T00:16:35.512487+0000 mgr.a (mgr.14388) 5280 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:38.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:38.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:38.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:38.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:38.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:39 smithi044 bash[22676]: cluster 2024-09-21T00:16:37.513373+0000 mgr.a (mgr.14388) 5281 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:39 smithi044 bash[22676]: audit 2024-09-21T00:16:37.592581+0000 mgr.a (mgr.14388) 5282 : audit [DBG] from='client.123417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:39 smithi179 bash[23186]: cluster 2024-09-21T00:16:37.513373+0000 mgr.a (mgr.14388) 5281 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:39 smithi179 bash[23186]: audit 2024-09-21T00:16:37.592581+0000 mgr.a (mgr.14388) 5282 : audit [DBG] from='client.123417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:39.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:39 smithi049 bash[23528]: cluster 2024-09-21T00:16:37.513373+0000 mgr.a (mgr.14388) 5281 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:39.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:39 smithi049 bash[23528]: audit 2024-09-21T00:16:37.592581+0000 mgr.a (mgr.14388) 5282 : audit [DBG] from='client.123417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:41 smithi044 bash[22676]: cluster 2024-09-21T00:16:39.514263+0000 mgr.a (mgr.14388) 5283 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:41 smithi179 bash[23186]: cluster 2024-09-21T00:16:39.514263+0000 mgr.a (mgr.14388) 5283 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:41.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:41 smithi049 bash[23528]: cluster 2024-09-21T00:16:39.514263+0000 mgr.a (mgr.14388) 5283 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:43 smithi044 bash[22676]: cluster 2024-09-21T00:16:41.516540+0000 mgr.a (mgr.14388) 5284 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:43 smithi179 bash[23186]: cluster 2024-09-21T00:16:41.516540+0000 mgr.a (mgr.14388) 5284 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:43.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:43 smithi049 bash[23528]: cluster 2024-09-21T00:16:41.516540+0000 mgr.a (mgr.14388) 5284 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:43.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:43.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:43.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:43.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:43.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:44 smithi044 bash[22676]: audit 2024-09-21T00:16:43.351818+0000 mgr.a (mgr.14388) 5285 : audit [DBG] from='client.123495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:44 smithi179 bash[23186]: audit 2024-09-21T00:16:43.351818+0000 mgr.a (mgr.14388) 5285 : audit [DBG] from='client.123495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:44.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:44 smithi049 bash[23528]: audit 2024-09-21T00:16:43.351818+0000 mgr.a (mgr.14388) 5285 : audit [DBG] from='client.123495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:45 smithi044 bash[22676]: cluster 2024-09-21T00:16:43.517121+0000 mgr.a (mgr.14388) 5286 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:45 smithi179 bash[23186]: cluster 2024-09-21T00:16:43.517121+0000 mgr.a (mgr.14388) 5286 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:45 smithi049 bash[23528]: cluster 2024-09-21T00:16:43.517121+0000 mgr.a (mgr.14388) 5286 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:47 smithi044 bash[22676]: cluster 2024-09-21T00:16:45.519427+0000 mgr.a (mgr.14388) 5287 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:47 smithi179 bash[23186]: cluster 2024-09-21T00:16:45.519427+0000 mgr.a (mgr.14388) 5287 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:47 smithi049 bash[23528]: cluster 2024-09-21T00:16:45.519427+0000 mgr.a (mgr.14388) 5287 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:48.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:48.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:48.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:49.566 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:49.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:49 smithi044 bash[22676]: cluster 2024-09-21T00:16:47.520247+0000 mgr.a (mgr.14388) 5288 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:49 smithi044 bash[22676]: audit 2024-09-21T00:16:48.683533+0000 mon.a (mon.0) 4793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:49 smithi044 bash[22676]: audit 2024-09-21T00:16:48.691957+0000 mon.a (mon.0) 4794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:49 smithi044 bash[22676]: audit 2024-09-21T00:16:48.702686+0000 mon.a (mon.0) 4795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:49 smithi179 bash[23186]: cluster 2024-09-21T00:16:47.520247+0000 mgr.a (mgr.14388) 5288 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:49.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:49 smithi179 bash[23186]: audit 2024-09-21T00:16:48.683533+0000 mon.a (mon.0) 4793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:49 smithi179 bash[23186]: audit 2024-09-21T00:16:48.691957+0000 mon.a (mon.0) 4794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:49 smithi179 bash[23186]: audit 2024-09-21T00:16:48.702686+0000 mon.a (mon.0) 4795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:49 smithi049 bash[23528]: cluster 2024-09-21T00:16:47.520247+0000 mgr.a (mgr.14388) 5288 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:49 smithi049 bash[23528]: audit 2024-09-21T00:16:48.683533+0000 mon.a (mon.0) 4793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:49 smithi049 bash[23528]: audit 2024-09-21T00:16:48.691957+0000 mon.a (mon.0) 4794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:49 smithi049 bash[23528]: audit 2024-09-21T00:16:48.702686+0000 mon.a (mon.0) 4795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:49.136208+0000 mgr.a (mgr.14388) 5289 : audit [DBG] from='client.123573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.382739+0000 mon.a (mon.0) 4796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.387916+0000 mon.a (mon.0) 4797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.392881+0000 mon.a (mon.0) 4798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.408796+0000 mon.a (mon.0) 4799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.411703+0000 mon.a (mon.0) 4800 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.412520+0000 mon.a (mon.0) 4801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.418286+0000 mon.a (mon.0) 4802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.677 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:50 smithi179 bash[23186]: audit 2024-09-21T00:16:50.421124+0000 mon.a (mon.0) 4803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:16:50.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:49.136208+0000 mgr.a (mgr.14388) 5289 : audit [DBG] from='client.123573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:50.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.382739+0000 mon.a (mon.0) 4796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.387916+0000 mon.a (mon.0) 4797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.392881+0000 mon.a (mon.0) 4798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.408796+0000 mon.a (mon.0) 4799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:16:50.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.411703+0000 mon.a (mon.0) 4800 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:16:50.693 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.412520+0000 mon.a (mon.0) 4801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:16:50.693 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.418286+0000 mon.a (mon.0) 4802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.693 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:50 smithi044 bash[22676]: audit 2024-09-21T00:16:50.421124+0000 mon.a (mon.0) 4803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:16:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:49.136208+0000 mgr.a (mgr.14388) 5289 : audit [DBG] from='client.123573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.382739+0000 mon.a (mon.0) 4796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.387916+0000 mon.a (mon.0) 4797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.392881+0000 mon.a (mon.0) 4798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.408796+0000 mon.a (mon.0) 4799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:16:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.411703+0000 mon.a (mon.0) 4800 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:16:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.412520+0000 mon.a (mon.0) 4801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:16:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.418286+0000 mon.a (mon.0) 4802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:50 smithi049 bash[23528]: audit 2024-09-21T00:16:50.421124+0000 mon.a (mon.0) 4803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:16:51.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:16:51 smithi044 bash[22930]: debug 2024-09-21T00:16:51.130+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:16:51.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:16:51 smithi044 bash[22930]: debug 2024-09-21T00:16:51.134+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:16:51.571 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:51 smithi049 bash[23528]: cluster 2024-09-21T00:16:49.520813+0000 mgr.a (mgr.14388) 5290 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:51.571 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:51 smithi049 bash[23528]: audit 2024-09-21T00:16:50.422694+0000 mgr.a (mgr.14388) 5291 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:16:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:51 smithi179 bash[23186]: cluster 2024-09-21T00:16:49.520813+0000 mgr.a (mgr.14388) 5290 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:51 smithi179 bash[23186]: audit 2024-09-21T00:16:50.422694+0000 mgr.a (mgr.14388) 5291 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:16:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:51 smithi044 bash[22676]: cluster 2024-09-21T00:16:49.520813+0000 mgr.a (mgr.14388) 5290 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:51 smithi044 bash[22676]: audit 2024-09-21T00:16:50.422694+0000 mgr.a (mgr.14388) 5291 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:16:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:52 smithi049 bash[23528]: audit 2024-09-21T00:16:51.136223+0000 mgr.a (mgr.14388) 5292 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:16:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:52 smithi049 bash[23528]: cephadm 2024-09-21T00:16:51.137394+0000 mgr.a (mgr.14388) 5293 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:16:52.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:52 smithi044 bash[22676]: audit 2024-09-21T00:16:51.136223+0000 mgr.a (mgr.14388) 5292 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:16:52.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:52 smithi044 bash[22676]: cephadm 2024-09-21T00:16:51.137394+0000 mgr.a (mgr.14388) 5293 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:16:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:52 smithi179 bash[23186]: audit 2024-09-21T00:16:51.136223+0000 mgr.a (mgr.14388) 5292 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:16:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:52 smithi179 bash[23186]: cephadm 2024-09-21T00:16:51.137394+0000 mgr.a (mgr.14388) 5293 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:16:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:53 smithi049 bash[23528]: cluster 2024-09-21T00:16:51.523503+0000 mgr.a (mgr.14388) 5294 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:53 smithi049 bash[23528]: audit 2024-09-21T00:16:52.655303+0000 mon.a (mon.0) 4804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:53 smithi049 bash[23528]: audit 2024-09-21T00:16:52.660018+0000 mon.a (mon.0) 4805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:53 smithi049 bash[23528]: audit 2024-09-21T00:16:52.668278+0000 mon.a (mon.0) 4806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:53 smithi044 bash[22676]: cluster 2024-09-21T00:16:51.523503+0000 mgr.a (mgr.14388) 5294 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:53 smithi044 bash[22676]: audit 2024-09-21T00:16:52.655303+0000 mon.a (mon.0) 4804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:53 smithi044 bash[22676]: audit 2024-09-21T00:16:52.660018+0000 mon.a (mon.0) 4805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:53 smithi044 bash[22676]: audit 2024-09-21T00:16:52.668278+0000 mon.a (mon.0) 4806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:53 smithi179 bash[23186]: cluster 2024-09-21T00:16:51.523503+0000 mgr.a (mgr.14388) 5294 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:16:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:53 smithi179 bash[23186]: audit 2024-09-21T00:16:52.655303+0000 mon.a (mon.0) 4804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:53 smithi179 bash[23186]: audit 2024-09-21T00:16:52.660018+0000 mon.a (mon.0) 4805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:53 smithi179 bash[23186]: audit 2024-09-21T00:16:52.668278+0000 mon.a (mon.0) 4806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:16:54.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:16:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:16:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:16:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:54 smithi049 bash[23528]: cluster 2024-09-21T00:16:53.524341+0000 mgr.a (mgr.14388) 5295 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:54 smithi044 bash[22676]: cluster 2024-09-21T00:16:53.524341+0000 mgr.a (mgr.14388) 5295 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:54 smithi179 bash[23186]: cluster 2024-09-21T00:16:53.524341+0000 mgr.a (mgr.14388) 5295 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:16:55.357 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:16:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:16:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:16:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:16:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:16:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:55 smithi049 bash[23528]: audit 2024-09-21T00:16:54.906845+0000 mgr.a (mgr.14388) 5296 : audit [DBG] from='client.123759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:55 smithi044 bash[22676]: audit 2024-09-21T00:16:54.906845+0000 mgr.a (mgr.14388) 5296 : audit [DBG] from='client.123759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:55 smithi179 bash[23186]: audit 2024-09-21T00:16:54.906845+0000 mgr.a (mgr.14388) 5296 : audit [DBG] from='client.123759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:16:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:56 smithi049 bash[23528]: cluster 2024-09-21T00:16:55.527178+0000 mgr.a (mgr.14388) 5297 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:16:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:56 smithi044 bash[22676]: cluster 2024-09-21T00:16:55.527178+0000 mgr.a (mgr.14388) 5297 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:16:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:56 smithi179 bash[23186]: cluster 2024-09-21T00:16:55.527178+0000 mgr.a (mgr.14388) 5297 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:16:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:16:58 smithi044 bash[22676]: cluster 2024-09-21T00:16:57.528000+0000 mgr.a (mgr.14388) 5298 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:16:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:16:58 smithi179 bash[23186]: cluster 2024-09-21T00:16:57.528000+0000 mgr.a (mgr.14388) 5298 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:16:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:16:58 smithi049 bash[23528]: cluster 2024-09-21T00:16:57.528000+0000 mgr.a (mgr.14388) 5298 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:17:00.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:00.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:00.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:00 smithi044 bash[22676]: cluster 2024-09-21T00:16:59.528788+0000 mgr.a (mgr.14388) 5299 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:17:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:00 smithi179 bash[23186]: cluster 2024-09-21T00:16:59.528788+0000 mgr.a (mgr.14388) 5299 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:17:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:00 smithi049 bash[23528]: cluster 2024-09-21T00:16:59.528788+0000 mgr.a (mgr.14388) 5299 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:17:01.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:01.863 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:01 smithi044 bash[22676]: audit 2024-09-21T00:17:00.694274+0000 mgr.a (mgr.14388) 5300 : audit [DBG] from='client.123837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:01 smithi179 bash[23186]: audit 2024-09-21T00:17:00.694274+0000 mgr.a (mgr.14388) 5300 : audit [DBG] from='client.123837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:01 smithi049 bash[23528]: audit 2024-09-21T00:17:00.694274+0000 mgr.a (mgr.14388) 5300 : audit [DBG] from='client.123837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:02 smithi044 bash[22676]: cluster 2024-09-21T00:17:01.531600+0000 mgr.a (mgr.14388) 5301 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:02 smithi179 bash[23186]: cluster 2024-09-21T00:17:01.531600+0000 mgr.a (mgr.14388) 5301 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:02 smithi049 bash[23528]: cluster 2024-09-21T00:17:01.531600+0000 mgr.a (mgr.14388) 5301 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:04 smithi044 bash[22676]: cluster 2024-09-21T00:17:03.532420+0000 mgr.a (mgr.14388) 5302 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:17:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:04 smithi179 bash[23186]: cluster 2024-09-21T00:17:03.532420+0000 mgr.a (mgr.14388) 5302 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:17:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:04 smithi049 bash[23528]: cluster 2024-09-21T00:17:03.532420+0000 mgr.a (mgr.14388) 5302 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:17:06.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:06.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:06.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:06.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:06.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:06.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:06 smithi044 bash[22676]: cluster 2024-09-21T00:17:05.534400+0000 mgr.a (mgr.14388) 5303 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:06 smithi044 bash[22676]: audit 2024-09-21T00:17:06.464239+0000 mgr.a (mgr.14388) 5304 : audit [DBG] from='client.123912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:06 smithi179 bash[23186]: cluster 2024-09-21T00:17:05.534400+0000 mgr.a (mgr.14388) 5303 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:06 smithi179 bash[23186]: audit 2024-09-21T00:17:06.464239+0000 mgr.a (mgr.14388) 5304 : audit [DBG] from='client.123912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:06 smithi049 bash[23528]: cluster 2024-09-21T00:17:05.534400+0000 mgr.a (mgr.14388) 5303 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:06 smithi049 bash[23528]: audit 2024-09-21T00:17:06.464239+0000 mgr.a (mgr.14388) 5304 : audit [DBG] from='client.123912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:08.939 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:08 smithi049 bash[23528]: cluster 2024-09-21T00:17:07.535276+0000 mgr.a (mgr.14388) 5305 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:08 smithi044 bash[22676]: cluster 2024-09-21T00:17:07.535276+0000 mgr.a (mgr.14388) 5305 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:08 smithi179 bash[23186]: cluster 2024-09-21T00:17:07.535276+0000 mgr.a (mgr.14388) 5305 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:09 smithi044 bash[22676]: audit 2024-09-21T00:17:08.916576+0000 mon.a (mon.0) 4807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:09 smithi044 bash[22676]: audit 2024-09-21T00:17:08.925464+0000 mon.a (mon.0) 4808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:09 smithi044 bash[22676]: audit 2024-09-21T00:17:08.937319+0000 mon.a (mon.0) 4809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:09 smithi179 bash[23186]: audit 2024-09-21T00:17:08.916576+0000 mon.a (mon.0) 4807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:09 smithi179 bash[23186]: audit 2024-09-21T00:17:08.925464+0000 mon.a (mon.0) 4808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:09 smithi179 bash[23186]: audit 2024-09-21T00:17:08.937319+0000 mon.a (mon.0) 4809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:09 smithi049 bash[23528]: audit 2024-09-21T00:17:08.916576+0000 mon.a (mon.0) 4807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:09 smithi049 bash[23528]: audit 2024-09-21T00:17:08.925464+0000 mon.a (mon.0) 4808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:09 smithi049 bash[23528]: audit 2024-09-21T00:17:08.937319+0000 mon.a (mon.0) 4809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:10.941 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:10 smithi044 bash[22676]: cluster 2024-09-21T00:17:09.536099+0000 mgr.a (mgr.14388) 5306 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:10.941 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:10 smithi044 bash[22676]: audit 2024-09-21T00:17:10.602104+0000 mon.a (mon.0) 4810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:10 smithi049 bash[23528]: cluster 2024-09-21T00:17:09.536099+0000 mgr.a (mgr.14388) 5306 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:10 smithi049 bash[23528]: audit 2024-09-21T00:17:10.602104+0000 mon.a (mon.0) 4810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:10 smithi049 bash[23528]: audit 2024-09-21T00:17:10.611411+0000 mon.a (mon.0) 4811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:10 smithi049 bash[23528]: audit 2024-09-21T00:17:10.620765+0000 mon.a (mon.0) 4812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:10 smithi044 bash[22676]: audit 2024-09-21T00:17:10.611411+0000 mon.a (mon.0) 4811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:10 smithi044 bash[22676]: audit 2024-09-21T00:17:10.620765+0000 mon.a (mon.0) 4812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:10 smithi179 bash[23186]: cluster 2024-09-21T00:17:09.536099+0000 mgr.a (mgr.14388) 5306 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:10 smithi179 bash[23186]: audit 2024-09-21T00:17:10.602104+0000 mon.a (mon.0) 4810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:10 smithi179 bash[23186]: audit 2024-09-21T00:17:10.611411+0000 mon.a (mon.0) 4811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:10 smithi179 bash[23186]: audit 2024-09-21T00:17:10.620765+0000 mon.a (mon.0) 4812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:11.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:11.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:12.663 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:13.181 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:12 smithi044 bash[22676]: cluster 2024-09-21T00:17:11.538280+0000 mgr.a (mgr.14388) 5307 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:13.181 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:12 smithi044 bash[22676]: audit 2024-09-21T00:17:12.219367+0000 mgr.a (mgr.14388) 5308 : audit [DBG] from='client.123990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:13.181 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:12 smithi044 bash[22676]: audit 2024-09-21T00:17:12.787726+0000 mon.a (mon.0) 4813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.181 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:12 smithi044 bash[22676]: audit 2024-09-21T00:17:12.792951+0000 mon.a (mon.0) 4814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.181 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:12 smithi044 bash[22676]: audit 2024-09-21T00:17:12.799817+0000 mon.a (mon.0) 4815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:12 smithi179 bash[23186]: cluster 2024-09-21T00:17:11.538280+0000 mgr.a (mgr.14388) 5307 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:12 smithi179 bash[23186]: audit 2024-09-21T00:17:12.219367+0000 mgr.a (mgr.14388) 5308 : audit [DBG] from='client.123990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:12 smithi179 bash[23186]: audit 2024-09-21T00:17:12.787726+0000 mon.a (mon.0) 4813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:12 smithi179 bash[23186]: audit 2024-09-21T00:17:12.792951+0000 mon.a (mon.0) 4814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:12 smithi179 bash[23186]: audit 2024-09-21T00:17:12.799817+0000 mon.a (mon.0) 4815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:12 smithi049 bash[23528]: cluster 2024-09-21T00:17:11.538280+0000 mgr.a (mgr.14388) 5307 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:12 smithi049 bash[23528]: audit 2024-09-21T00:17:12.219367+0000 mgr.a (mgr.14388) 5308 : audit [DBG] from='client.123990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:12 smithi049 bash[23528]: audit 2024-09-21T00:17:12.787726+0000 mon.a (mon.0) 4813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:12 smithi049 bash[23528]: audit 2024-09-21T00:17:12.792951+0000 mon.a (mon.0) 4814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:12 smithi049 bash[23528]: audit 2024-09-21T00:17:12.799817+0000 mon.a (mon.0) 4815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:14 smithi044 bash[22676]: cluster 2024-09-21T00:17:13.538854+0000 mgr.a (mgr.14388) 5309 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:14 smithi179 bash[23186]: cluster 2024-09-21T00:17:13.538854+0000 mgr.a (mgr.14388) 5309 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:14 smithi049 bash[23528]: cluster 2024-09-21T00:17:13.538854+0000 mgr.a (mgr.14388) 5309 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:16 smithi044 bash[22676]: cluster 2024-09-21T00:17:15.541021+0000 mgr.a (mgr.14388) 5310 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:16 smithi179 bash[23186]: cluster 2024-09-21T00:17:15.541021+0000 mgr.a (mgr.14388) 5310 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:16 smithi049 bash[23528]: cluster 2024-09-21T00:17:15.541021+0000 mgr.a (mgr.14388) 5310 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:17.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:17.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:17.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:18.419 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:18.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:18.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:18.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:18.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:18 smithi044 bash[22676]: cluster 2024-09-21T00:17:17.541816+0000 mgr.a (mgr.14388) 5311 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:18 smithi044 bash[22676]: audit 2024-09-21T00:17:17.999530+0000 mgr.a (mgr.14388) 5312 : audit [DBG] from='client.124068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:18 smithi179 bash[23186]: cluster 2024-09-21T00:17:17.541816+0000 mgr.a (mgr.14388) 5311 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:18 smithi179 bash[23186]: audit 2024-09-21T00:17:17.999530+0000 mgr.a (mgr.14388) 5312 : audit [DBG] from='client.124068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:18 smithi049 bash[23528]: cluster 2024-09-21T00:17:17.541816+0000 mgr.a (mgr.14388) 5311 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:18 smithi049 bash[23528]: audit 2024-09-21T00:17:17.999530+0000 mgr.a (mgr.14388) 5312 : audit [DBG] from='client.124068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:20 smithi044 bash[22676]: cluster 2024-09-21T00:17:19.542729+0000 mgr.a (mgr.14388) 5313 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:20 smithi179 bash[23186]: cluster 2024-09-21T00:17:19.542729+0000 mgr.a (mgr.14388) 5313 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:20 smithi049 bash[23528]: cluster 2024-09-21T00:17:19.542729+0000 mgr.a (mgr.14388) 5313 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:22 smithi044 bash[22676]: cluster 2024-09-21T00:17:21.544977+0000 mgr.a (mgr.14388) 5314 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:22 smithi179 bash[23186]: cluster 2024-09-21T00:17:21.544977+0000 mgr.a (mgr.14388) 5314 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:22 smithi049 bash[23528]: cluster 2024-09-21T00:17:21.544977+0000 mgr.a (mgr.14388) 5314 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:23.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:24.214 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:24.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:24 smithi044 bash[22676]: cluster 2024-09-21T00:17:23.545529+0000 mgr.a (mgr.14388) 5315 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:24 smithi044 bash[22676]: audit 2024-09-21T00:17:23.758348+0000 mgr.a (mgr.14388) 5316 : audit [DBG] from='client.124146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:24 smithi179 bash[23186]: cluster 2024-09-21T00:17:23.545529+0000 mgr.a (mgr.14388) 5315 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:24 smithi179 bash[23186]: audit 2024-09-21T00:17:23.758348+0000 mgr.a (mgr.14388) 5316 : audit [DBG] from='client.124146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:25.382 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:24 smithi049 bash[23528]: cluster 2024-09-21T00:17:23.545529+0000 mgr.a (mgr.14388) 5315 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:25.382 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:24 smithi049 bash[23528]: audit 2024-09-21T00:17:23.758348+0000 mgr.a (mgr.14388) 5316 : audit [DBG] from='client.124146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:26 smithi044 bash[22676]: cluster 2024-09-21T00:17:25.547892+0000 mgr.a (mgr.14388) 5317 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:26 smithi179 bash[23186]: cluster 2024-09-21T00:17:25.547892+0000 mgr.a (mgr.14388) 5317 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:26 smithi049 bash[23528]: cluster 2024-09-21T00:17:25.547892+0000 mgr.a (mgr.14388) 5317 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:29.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:29.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:29.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:28 smithi044 bash[22676]: cluster 2024-09-21T00:17:27.548839+0000 mgr.a (mgr.14388) 5318 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:29.245 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:28 smithi179 bash[23186]: cluster 2024-09-21T00:17:27.548839+0000 mgr.a (mgr.14388) 5318 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:28 smithi049 bash[23528]: cluster 2024-09-21T00:17:27.548839+0000 mgr.a (mgr.14388) 5318 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:30.007 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:30 smithi044 bash[22676]: audit 2024-09-21T00:17:29.150340+0000 mon.a (mon.0) 4816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:30 smithi044 bash[22676]: audit 2024-09-21T00:17:29.160193+0000 mon.a (mon.0) 4817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:30 smithi044 bash[22676]: audit 2024-09-21T00:17:29.171952+0000 mon.a (mon.0) 4818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:30 smithi179 bash[23186]: audit 2024-09-21T00:17:29.150340+0000 mon.a (mon.0) 4816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:30 smithi179 bash[23186]: audit 2024-09-21T00:17:29.160193+0000 mon.a (mon.0) 4817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:30 smithi179 bash[23186]: audit 2024-09-21T00:17:29.171952+0000 mon.a (mon.0) 4818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:30 smithi049 bash[23528]: audit 2024-09-21T00:17:29.150340+0000 mon.a (mon.0) 4816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:30 smithi049 bash[23528]: audit 2024-09-21T00:17:29.160193+0000 mon.a (mon.0) 4817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:30.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:30 smithi049 bash[23528]: audit 2024-09-21T00:17:29.171952+0000 mon.a (mon.0) 4818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:31 smithi044 bash[22676]: cluster 2024-09-21T00:17:29.549728+0000 mgr.a (mgr.14388) 5319 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:31 smithi044 bash[22676]: audit 2024-09-21T00:17:29.550964+0000 mgr.a (mgr.14388) 5320 : audit [DBG] from='client.124224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:31 smithi044 bash[22676]: audit 2024-09-21T00:17:30.814911+0000 mon.a (mon.0) 4819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:31 smithi044 bash[22676]: audit 2024-09-21T00:17:30.825142+0000 mon.a (mon.0) 4820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:31 smithi044 bash[22676]: audit 2024-09-21T00:17:30.837157+0000 mon.a (mon.0) 4821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:31 smithi179 bash[23186]: cluster 2024-09-21T00:17:29.549728+0000 mgr.a (mgr.14388) 5319 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:31 smithi179 bash[23186]: audit 2024-09-21T00:17:29.550964+0000 mgr.a (mgr.14388) 5320 : audit [DBG] from='client.124224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:31 smithi179 bash[23186]: audit 2024-09-21T00:17:30.814911+0000 mon.a (mon.0) 4819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:31 smithi179 bash[23186]: audit 2024-09-21T00:17:30.825142+0000 mon.a (mon.0) 4820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:31 smithi179 bash[23186]: audit 2024-09-21T00:17:30.837157+0000 mon.a (mon.0) 4821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:31 smithi049 bash[23528]: cluster 2024-09-21T00:17:29.549728+0000 mgr.a (mgr.14388) 5319 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:31 smithi049 bash[23528]: audit 2024-09-21T00:17:29.550964+0000 mgr.a (mgr.14388) 5320 : audit [DBG] from='client.124224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:31 smithi049 bash[23528]: audit 2024-09-21T00:17:30.814911+0000 mon.a (mon.0) 4819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:31 smithi049 bash[23528]: audit 2024-09-21T00:17:30.825142+0000 mon.a (mon.0) 4820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:31 smithi049 bash[23528]: audit 2024-09-21T00:17:30.837157+0000 mon.a (mon.0) 4821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.277 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:33 smithi044 bash[22676]: cluster 2024-09-21T00:17:31.550986+0000 mgr.a (mgr.14388) 5321 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:17:33.278 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:33 smithi044 bash[22676]: audit 2024-09-21T00:17:33.006360+0000 mon.a (mon.0) 4822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.278 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:33 smithi044 bash[22676]: audit 2024-09-21T00:17:33.011596+0000 mon.a (mon.0) 4823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.278 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:33 smithi044 bash[22676]: audit 2024-09-21T00:17:33.022004+0000 mon.a (mon.0) 4824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:33 smithi179 bash[23186]: cluster 2024-09-21T00:17:31.550986+0000 mgr.a (mgr.14388) 5321 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:17:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:33 smithi179 bash[23186]: audit 2024-09-21T00:17:33.006360+0000 mon.a (mon.0) 4822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:33 smithi179 bash[23186]: audit 2024-09-21T00:17:33.011596+0000 mon.a (mon.0) 4823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:33 smithi179 bash[23186]: audit 2024-09-21T00:17:33.022004+0000 mon.a (mon.0) 4824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:33 smithi049 bash[23528]: cluster 2024-09-21T00:17:31.550986+0000 mgr.a (mgr.14388) 5321 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:17:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:33 smithi049 bash[23528]: audit 2024-09-21T00:17:33.006360+0000 mon.a (mon.0) 4822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:33 smithi049 bash[23528]: audit 2024-09-21T00:17:33.011596+0000 mon.a (mon.0) 4823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:33 smithi049 bash[23528]: audit 2024-09-21T00:17:33.022004+0000 mon.a (mon.0) 4824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:35.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:35.009 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:35.009 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:35 smithi044 bash[22676]: cluster 2024-09-21T00:17:33.551438+0000 mgr.a (mgr.14388) 5322 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:17:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:35 smithi179 bash[23186]: cluster 2024-09-21T00:17:33.551438+0000 mgr.a (mgr.14388) 5322 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:17:35.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:35 smithi049 bash[23528]: cluster 2024-09-21T00:17:33.551438+0000 mgr.a (mgr.14388) 5322 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:17:35.759 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:35.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:35.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:35.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:35.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:36 smithi044 bash[22676]: audit 2024-09-21T00:17:35.342008+0000 mgr.a (mgr.14388) 5323 : audit [DBG] from='client.124302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:36 smithi179 bash[23186]: audit 2024-09-21T00:17:35.342008+0000 mgr.a (mgr.14388) 5323 : audit [DBG] from='client.124302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:36 smithi049 bash[23528]: audit 2024-09-21T00:17:35.342008+0000 mgr.a (mgr.14388) 5323 : audit [DBG] from='client.124302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:37 smithi044 bash[22676]: cluster 2024-09-21T00:17:35.553048+0000 mgr.a (mgr.14388) 5324 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:37 smithi179 bash[23186]: cluster 2024-09-21T00:17:35.553048+0000 mgr.a (mgr.14388) 5324 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:37 smithi049 bash[23528]: cluster 2024-09-21T00:17:35.553048+0000 mgr.a (mgr.14388) 5324 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:39 smithi044 bash[22676]: cluster 2024-09-21T00:17:37.553940+0000 mgr.a (mgr.14388) 5325 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:17:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:39 smithi179 bash[23186]: cluster 2024-09-21T00:17:37.553940+0000 mgr.a (mgr.14388) 5325 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:17:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:39 smithi049 bash[23528]: cluster 2024-09-21T00:17:37.553940+0000 mgr.a (mgr.14388) 5325 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:17:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:41 smithi044 bash[22676]: cluster 2024-09-21T00:17:39.554694+0000 mgr.a (mgr.14388) 5326 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:17:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:41 smithi179 bash[23186]: cluster 2024-09-21T00:17:39.554694+0000 mgr.a (mgr.14388) 5326 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:17:41.535 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:41.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:41.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:41.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:41.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:41 smithi049 bash[23528]: cluster 2024-09-21T00:17:39.554694+0000 mgr.a (mgr.14388) 5326 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:17:42.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:42 smithi179 bash[23186]: audit 2024-09-21T00:17:41.094198+0000 mgr.a (mgr.14388) 5327 : audit [DBG] from='client.124380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:42 smithi044 bash[22676]: audit 2024-09-21T00:17:41.094198+0000 mgr.a (mgr.14388) 5327 : audit [DBG] from='client.124380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:42.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:42 smithi049 bash[23528]: audit 2024-09-21T00:17:41.094198+0000 mgr.a (mgr.14388) 5327 : audit [DBG] from='client.124380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:43 smithi044 bash[22676]: cluster 2024-09-21T00:17:41.556000+0000 mgr.a (mgr.14388) 5328 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:43 smithi179 bash[23186]: cluster 2024-09-21T00:17:41.556000+0000 mgr.a (mgr.14388) 5328 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:43.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:43 smithi049 bash[23528]: cluster 2024-09-21T00:17:41.556000+0000 mgr.a (mgr.14388) 5328 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:45 smithi044 bash[22676]: cluster 2024-09-21T00:17:43.556869+0000 mgr.a (mgr.14388) 5329 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:17:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:45 smithi179 bash[23186]: cluster 2024-09-21T00:17:43.556869+0000 mgr.a (mgr.14388) 5329 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:17:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:45 smithi049 bash[23528]: cluster 2024-09-21T00:17:43.556869+0000 mgr.a (mgr.14388) 5329 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:17:46.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:46.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:46.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:47.296 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:47.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:47.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:47.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:47.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:47 smithi044 bash[22676]: cluster 2024-09-21T00:17:45.558895+0000 mgr.a (mgr.14388) 5330 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:17:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:47 smithi179 bash[23186]: cluster 2024-09-21T00:17:45.558895+0000 mgr.a (mgr.14388) 5330 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:17:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:47 smithi049 bash[23528]: cluster 2024-09-21T00:17:45.558895+0000 mgr.a (mgr.14388) 5330 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:17:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:48 smithi044 bash[22676]: audit 2024-09-21T00:17:46.869084+0000 mgr.a (mgr.14388) 5331 : audit [DBG] from='client.124458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:48 smithi179 bash[23186]: audit 2024-09-21T00:17:46.869084+0000 mgr.a (mgr.14388) 5331 : audit [DBG] from='client.124458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:48.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:48 smithi049 bash[23528]: audit 2024-09-21T00:17:46.869084+0000 mgr.a (mgr.14388) 5331 : audit [DBG] from='client.124458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:49 smithi044 bash[22676]: cluster 2024-09-21T00:17:47.559754+0000 mgr.a (mgr.14388) 5332 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:49 smithi179 bash[23186]: cluster 2024-09-21T00:17:47.559754+0000 mgr.a (mgr.14388) 5332 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:49 smithi049 bash[23528]: cluster 2024-09-21T00:17:47.559754+0000 mgr.a (mgr.14388) 5332 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:50 smithi179 bash[23186]: audit 2024-09-21T00:17:49.389596+0000 mon.a (mon.0) 4825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:50 smithi179 bash[23186]: audit 2024-09-21T00:17:49.398184+0000 mon.a (mon.0) 4826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:50 smithi179 bash[23186]: audit 2024-09-21T00:17:49.408538+0000 mon.a (mon.0) 4827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:50 smithi044 bash[22676]: audit 2024-09-21T00:17:49.389596+0000 mon.a (mon.0) 4825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:50 smithi044 bash[22676]: audit 2024-09-21T00:17:49.398184+0000 mon.a (mon.0) 4826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:50 smithi044 bash[22676]: audit 2024-09-21T00:17:49.408538+0000 mon.a (mon.0) 4827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:50 smithi049 bash[23528]: audit 2024-09-21T00:17:49.389596+0000 mon.a (mon.0) 4825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:50 smithi049 bash[23528]: audit 2024-09-21T00:17:49.398184+0000 mon.a (mon.0) 4826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:50 smithi049 bash[23528]: audit 2024-09-21T00:17:49.408538+0000 mon.a (mon.0) 4827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: cluster 2024-09-21T00:17:49.560498+0000 mgr.a (mgr.14388) 5333 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.040538+0000 mon.a (mon.0) 4828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.049015+0000 mon.a (mon.0) 4829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.059263+0000 mon.a (mon.0) 4830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.190788+0000 mon.a (mon.0) 4831 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.201399+0000 mon.a (mon.0) 4832 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.203144+0000 mon.a (mon.0) 4833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.214167+0000 mon.a (mon.0) 4834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22676]: audit 2024-09-21T00:17:51.220997+0000 mon.a (mon.0) 4835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: cluster 2024-09-21T00:17:49.560498+0000 mgr.a (mgr.14388) 5333 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.040538+0000 mon.a (mon.0) 4828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.049015+0000 mon.a (mon.0) 4829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.059263+0000 mon.a (mon.0) 4830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.190788+0000 mon.a (mon.0) 4831 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.201399+0000 mon.a (mon.0) 4832 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.203144+0000 mon.a (mon.0) 4833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:17:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.214167+0000 mon.a (mon.0) 4834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:51 smithi179 bash[23186]: audit 2024-09-21T00:17:51.220997+0000 mon.a (mon.0) 4835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:17:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: cluster 2024-09-21T00:17:49.560498+0000 mgr.a (mgr.14388) 5333 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.040538+0000 mon.a (mon.0) 4828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.049015+0000 mon.a (mon.0) 4829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.059263+0000 mon.a (mon.0) 4830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.190788+0000 mon.a (mon.0) 4831 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.201399+0000 mon.a (mon.0) 4832 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.203144+0000 mon.a (mon.0) 4833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.214167+0000 mon.a (mon.0) 4834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:51 smithi049 bash[23528]: audit 2024-09-21T00:17:51.220997+0000 mon.a (mon.0) 4835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:17:52.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22930]: debug 2024-09-21T00:17:51.973+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:17:52.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:17:51 smithi044 bash[22930]: debug 2024-09-21T00:17:51.973+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:17:52.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:52.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:52.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:52 smithi044 bash[22676]: audit 2024-09-21T00:17:51.223589+0000 mgr.a (mgr.14388) 5334 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:17:52.745 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:52 smithi049 bash[23528]: audit 2024-09-21T00:17:51.223589+0000 mgr.a (mgr.14388) 5334 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:17:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:52 smithi179 bash[23186]: audit 2024-09-21T00:17:51.223589+0000 mgr.a (mgr.14388) 5334 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:17:53.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:53.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:53.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:53.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:53.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:53 smithi044 bash[22676]: cluster 2024-09-21T00:17:51.562152+0000 mgr.a (mgr.14388) 5335 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:53 smithi044 bash[22676]: audit 2024-09-21T00:17:51.979058+0000 mgr.a (mgr.14388) 5336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:17:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:53 smithi044 bash[22676]: cephadm 2024-09-21T00:17:51.980298+0000 mgr.a (mgr.14388) 5337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:17:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:53 smithi044 bash[22676]: audit 2024-09-21T00:17:53.149780+0000 mon.a (mon.0) 4836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:53 smithi044 bash[22676]: audit 2024-09-21T00:17:53.156790+0000 mon.a (mon.0) 4837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:53 smithi044 bash[22676]: audit 2024-09-21T00:17:53.167031+0000 mon.a (mon.0) 4838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:53 smithi179 bash[23186]: cluster 2024-09-21T00:17:51.562152+0000 mgr.a (mgr.14388) 5335 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:53 smithi179 bash[23186]: audit 2024-09-21T00:17:51.979058+0000 mgr.a (mgr.14388) 5336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:17:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:53 smithi179 bash[23186]: cephadm 2024-09-21T00:17:51.980298+0000 mgr.a (mgr.14388) 5337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:17:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:53 smithi179 bash[23186]: audit 2024-09-21T00:17:53.149780+0000 mon.a (mon.0) 4836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:53 smithi179 bash[23186]: audit 2024-09-21T00:17:53.156790+0000 mon.a (mon.0) 4837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:53 smithi179 bash[23186]: audit 2024-09-21T00:17:53.167031+0000 mon.a (mon.0) 4838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:53 smithi049 bash[23528]: cluster 2024-09-21T00:17:51.562152+0000 mgr.a (mgr.14388) 5335 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:17:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:53 smithi049 bash[23528]: audit 2024-09-21T00:17:51.979058+0000 mgr.a (mgr.14388) 5336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:17:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:53 smithi049 bash[23528]: cephadm 2024-09-21T00:17:51.980298+0000 mgr.a (mgr.14388) 5337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:17:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:53 smithi049 bash[23528]: audit 2024-09-21T00:17:53.149780+0000 mon.a (mon.0) 4836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:53 smithi049 bash[23528]: audit 2024-09-21T00:17:53.156790+0000 mon.a (mon.0) 4837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:53 smithi049 bash[23528]: audit 2024-09-21T00:17:53.167031+0000 mon.a (mon.0) 4838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:17:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:54 smithi049 bash[23528]: audit 2024-09-21T00:17:52.624891+0000 mgr.a (mgr.14388) 5338 : audit [DBG] from='client.124644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:54 smithi044 bash[22676]: audit 2024-09-21T00:17:52.624891+0000 mgr.a (mgr.14388) 5338 : audit [DBG] from='client.124644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:54 smithi179 bash[23186]: audit 2024-09-21T00:17:52.624891+0000 mgr.a (mgr.14388) 5338 : audit [DBG] from='client.124644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:55 smithi044 bash[22676]: cluster 2024-09-21T00:17:53.563174+0000 mgr.a (mgr.14388) 5339 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:55 smithi179 bash[23186]: cluster 2024-09-21T00:17:53.563174+0000 mgr.a (mgr.14388) 5339 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:55 smithi049 bash[23528]: cluster 2024-09-21T00:17:53.563174+0000 mgr.a (mgr.14388) 5339 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:17:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:57 smithi044 bash[22676]: cluster 2024-09-21T00:17:55.565598+0000 mgr.a (mgr.14388) 5340 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:57 smithi179 bash[23186]: cluster 2024-09-21T00:17:55.565598+0000 mgr.a (mgr.14388) 5340 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:57 smithi049 bash[23528]: cluster 2024-09-21T00:17:55.565598+0000 mgr.a (mgr.14388) 5340 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:17:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:17:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:17:58.811 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:17:58.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:17:58.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:17:58.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:17:58.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:17:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:59 smithi044 bash[22676]: cluster 2024-09-21T00:17:57.566554+0000 mgr.a (mgr.14388) 5341 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:17:59 smithi044 bash[22676]: audit 2024-09-21T00:17:58.397896+0000 mgr.a (mgr.14388) 5342 : audit [DBG] from='client.124722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:59 smithi179 bash[23186]: cluster 2024-09-21T00:17:57.566554+0000 mgr.a (mgr.14388) 5341 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:17:59 smithi179 bash[23186]: audit 2024-09-21T00:17:58.397896+0000 mgr.a (mgr.14388) 5342 : audit [DBG] from='client.124722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:17:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:59 smithi049 bash[23528]: cluster 2024-09-21T00:17:57.566554+0000 mgr.a (mgr.14388) 5341 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:17:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:17:59 smithi049 bash[23528]: audit 2024-09-21T00:17:58.397896+0000 mgr.a (mgr.14388) 5342 : audit [DBG] from='client.124722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:01 smithi044 bash[22676]: cluster 2024-09-21T00:17:59.567539+0000 mgr.a (mgr.14388) 5343 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:01 smithi179 bash[23186]: cluster 2024-09-21T00:17:59.567539+0000 mgr.a (mgr.14388) 5343 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:01 smithi049 bash[23528]: cluster 2024-09-21T00:17:59.567539+0000 mgr.a (mgr.14388) 5343 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:03 smithi044 bash[22676]: cluster 2024-09-21T00:18:01.569810+0000 mgr.a (mgr.14388) 5344 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:03 smithi179 bash[23186]: cluster 2024-09-21T00:18:01.569810+0000 mgr.a (mgr.14388) 5344 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:03 smithi049 bash[23528]: cluster 2024-09-21T00:18:01.569810+0000 mgr.a (mgr.14388) 5344 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:03.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:03.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:03.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:04.564 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:04.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:05 smithi044 bash[22676]: cluster 2024-09-21T00:18:03.570530+0000 mgr.a (mgr.14388) 5345 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:05 smithi044 bash[22676]: audit 2024-09-21T00:18:04.146517+0000 mgr.a (mgr.14388) 5346 : audit [DBG] from='client.124797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:05 smithi179 bash[23186]: cluster 2024-09-21T00:18:03.570530+0000 mgr.a (mgr.14388) 5345 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:05 smithi179 bash[23186]: audit 2024-09-21T00:18:04.146517+0000 mgr.a (mgr.14388) 5346 : audit [DBG] from='client.124797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:05 smithi049 bash[23528]: cluster 2024-09-21T00:18:03.570530+0000 mgr.a (mgr.14388) 5345 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:05 smithi049 bash[23528]: audit 2024-09-21T00:18:04.146517+0000 mgr.a (mgr.14388) 5346 : audit [DBG] from='client.124797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:07 smithi044 bash[22676]: cluster 2024-09-21T00:18:05.572905+0000 mgr.a (mgr.14388) 5347 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:07 smithi179 bash[23186]: cluster 2024-09-21T00:18:05.572905+0000 mgr.a (mgr.14388) 5347 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:07 smithi049 bash[23528]: cluster 2024-09-21T00:18:05.572905+0000 mgr.a (mgr.14388) 5347 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:09.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:09.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:09.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:09 smithi044 bash[22676]: cluster 2024-09-21T00:18:07.573730+0000 mgr.a (mgr.14388) 5348 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:09 smithi179 bash[23186]: cluster 2024-09-21T00:18:07.573730+0000 mgr.a (mgr.14388) 5348 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:09.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:09 smithi049 bash[23528]: cluster 2024-09-21T00:18:07.573730+0000 mgr.a (mgr.14388) 5348 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:10.343 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:10.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:10 smithi179 bash[23186]: cluster 2024-09-21T00:18:09.574304+0000 mgr.a (mgr.14388) 5349 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:10 smithi179 bash[23186]: audit 2024-09-21T00:18:09.627857+0000 mon.a (mon.0) 4839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:10 smithi179 bash[23186]: audit 2024-09-21T00:18:09.636815+0000 mon.a (mon.0) 4840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:10 smithi179 bash[23186]: audit 2024-09-21T00:18:09.646640+0000 mon.a (mon.0) 4841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:10 smithi179 bash[23186]: audit 2024-09-21T00:18:09.903350+0000 mgr.a (mgr.14388) 5350 : audit [DBG] from='client.124872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:10 smithi044 bash[22676]: cluster 2024-09-21T00:18:09.574304+0000 mgr.a (mgr.14388) 5349 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:10 smithi044 bash[22676]: audit 2024-09-21T00:18:09.627857+0000 mon.a (mon.0) 4839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:10 smithi044 bash[22676]: audit 2024-09-21T00:18:09.636815+0000 mon.a (mon.0) 4840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:10 smithi044 bash[22676]: audit 2024-09-21T00:18:09.646640+0000 mon.a (mon.0) 4841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:10 smithi044 bash[22676]: audit 2024-09-21T00:18:09.903350+0000 mgr.a (mgr.14388) 5350 : audit [DBG] from='client.124872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:10 smithi049 bash[23528]: cluster 2024-09-21T00:18:09.574304+0000 mgr.a (mgr.14388) 5349 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:10 smithi049 bash[23528]: audit 2024-09-21T00:18:09.627857+0000 mon.a (mon.0) 4839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:10 smithi049 bash[23528]: audit 2024-09-21T00:18:09.636815+0000 mon.a (mon.0) 4840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:10 smithi049 bash[23528]: audit 2024-09-21T00:18:09.646640+0000 mon.a (mon.0) 4841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:10 smithi049 bash[23528]: audit 2024-09-21T00:18:09.903350+0000 mgr.a (mgr.14388) 5350 : audit [DBG] from='client.124872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:12 smithi049 bash[23528]: audit 2024-09-21T00:18:11.271634+0000 mon.a (mon.0) 4842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:12 smithi049 bash[23528]: audit 2024-09-21T00:18:11.280310+0000 mon.a (mon.0) 4843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:12 smithi049 bash[23528]: audit 2024-09-21T00:18:11.291011+0000 mon.a (mon.0) 4844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:12 smithi044 bash[22676]: audit 2024-09-21T00:18:11.271634+0000 mon.a (mon.0) 4842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:12 smithi044 bash[22676]: audit 2024-09-21T00:18:11.280310+0000 mon.a (mon.0) 4843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:12 smithi044 bash[22676]: audit 2024-09-21T00:18:11.291011+0000 mon.a (mon.0) 4844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:12 smithi179 bash[23186]: audit 2024-09-21T00:18:11.271634+0000 mon.a (mon.0) 4842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:12 smithi179 bash[23186]: audit 2024-09-21T00:18:11.280310+0000 mon.a (mon.0) 4843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:12 smithi179 bash[23186]: audit 2024-09-21T00:18:11.291011+0000 mon.a (mon.0) 4844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:13 smithi049 bash[23528]: cluster 2024-09-21T00:18:11.577200+0000 mgr.a (mgr.14388) 5351 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:13 smithi044 bash[22676]: cluster 2024-09-21T00:18:11.577200+0000 mgr.a (mgr.14388) 5351 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:13 smithi179 bash[23186]: cluster 2024-09-21T00:18:11.577200+0000 mgr.a (mgr.14388) 5351 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:14 smithi044 bash[22676]: audit 2024-09-21T00:18:13.359505+0000 mon.a (mon.0) 4845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:14 smithi044 bash[22676]: audit 2024-09-21T00:18:13.367914+0000 mon.a (mon.0) 4846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:14 smithi044 bash[22676]: audit 2024-09-21T00:18:13.376350+0000 mon.a (mon.0) 4847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:14 smithi179 bash[23186]: audit 2024-09-21T00:18:13.359505+0000 mon.a (mon.0) 4845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:14 smithi179 bash[23186]: audit 2024-09-21T00:18:13.367914+0000 mon.a (mon.0) 4846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:14 smithi179 bash[23186]: audit 2024-09-21T00:18:13.376350+0000 mon.a (mon.0) 4847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:14 smithi049 bash[23528]: audit 2024-09-21T00:18:13.359505+0000 mon.a (mon.0) 4845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:14 smithi049 bash[23528]: audit 2024-09-21T00:18:13.367914+0000 mon.a (mon.0) 4846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:14 smithi049 bash[23528]: audit 2024-09-21T00:18:13.376350+0000 mon.a (mon.0) 4847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:15.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:15.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:15.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:15 smithi049 bash[23528]: cluster 2024-09-21T00:18:13.577994+0000 mgr.a (mgr.14388) 5352 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:15 smithi044 bash[22676]: cluster 2024-09-21T00:18:13.577994+0000 mgr.a (mgr.14388) 5352 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:15 smithi179 bash[23186]: cluster 2024-09-21T00:18:13.577994+0000 mgr.a (mgr.14388) 5352 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:16.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:17 smithi044 bash[22676]: cluster 2024-09-21T00:18:15.580032+0000 mgr.a (mgr.14388) 5353 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:17 smithi044 bash[22676]: audit 2024-09-21T00:18:15.677016+0000 mgr.a (mgr.14388) 5354 : audit [DBG] from='client.124950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:17 smithi179 bash[23186]: cluster 2024-09-21T00:18:15.580032+0000 mgr.a (mgr.14388) 5353 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:17 smithi179 bash[23186]: audit 2024-09-21T00:18:15.677016+0000 mgr.a (mgr.14388) 5354 : audit [DBG] from='client.124950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:17 smithi049 bash[23528]: cluster 2024-09-21T00:18:15.580032+0000 mgr.a (mgr.14388) 5353 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:17 smithi049 bash[23528]: audit 2024-09-21T00:18:15.677016+0000 mgr.a (mgr.14388) 5354 : audit [DBG] from='client.124950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:19 smithi044 bash[22676]: cluster 2024-09-21T00:18:17.581066+0000 mgr.a (mgr.14388) 5355 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:19 smithi179 bash[23186]: cluster 2024-09-21T00:18:17.581066+0000 mgr.a (mgr.14388) 5355 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:19 smithi049 bash[23528]: cluster 2024-09-21T00:18:17.581066+0000 mgr.a (mgr.14388) 5355 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:21.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:21.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:21.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:21 smithi044 bash[22676]: cluster 2024-09-21T00:18:19.582026+0000 mgr.a (mgr.14388) 5356 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:18:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:21 smithi179 bash[23186]: cluster 2024-09-21T00:18:19.582026+0000 mgr.a (mgr.14388) 5356 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:18:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:21 smithi049 bash[23528]: cluster 2024-09-21T00:18:19.582026+0000 mgr.a (mgr.14388) 5356 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:18:21.922 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:21.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:21.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:21.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:21.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:22 smithi044 bash[22676]: audit 2024-09-21T00:18:21.469807+0000 mgr.a (mgr.14388) 5357 : audit [DBG] from='client.125028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:22 smithi179 bash[23186]: audit 2024-09-21T00:18:21.469807+0000 mgr.a (mgr.14388) 5357 : audit [DBG] from='client.125028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:22.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:22 smithi049 bash[23528]: audit 2024-09-21T00:18:21.469807+0000 mgr.a (mgr.14388) 5357 : audit [DBG] from='client.125028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:23 smithi179 bash[23186]: cluster 2024-09-21T00:18:21.583371+0000 mgr.a (mgr.14388) 5358 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:23 smithi044 bash[22676]: cluster 2024-09-21T00:18:21.583371+0000 mgr.a (mgr.14388) 5358 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:23.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:23 smithi049 bash[23528]: cluster 2024-09-21T00:18:21.583371+0000 mgr.a (mgr.14388) 5358 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:25 smithi044 bash[22676]: cluster 2024-09-21T00:18:23.584389+0000 mgr.a (mgr.14388) 5359 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:25 smithi179 bash[23186]: cluster 2024-09-21T00:18:23.584389+0000 mgr.a (mgr.14388) 5359 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:25 smithi049 bash[23528]: cluster 2024-09-21T00:18:23.584389+0000 mgr.a (mgr.14388) 5359 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:26.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:26.924 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:26.924 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:27 smithi044 bash[22676]: cluster 2024-09-21T00:18:25.586679+0000 mgr.a (mgr.14388) 5360 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:27 smithi179 bash[23186]: cluster 2024-09-21T00:18:25.586679+0000 mgr.a (mgr.14388) 5360 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:27 smithi049 bash[23528]: cluster 2024-09-21T00:18:25.586679+0000 mgr.a (mgr.14388) 5360 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:28 smithi044 bash[22676]: audit 2024-09-21T00:18:27.257849+0000 mgr.a (mgr.14388) 5361 : audit [DBG] from='client.125106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:28 smithi179 bash[23186]: audit 2024-09-21T00:18:27.257849+0000 mgr.a (mgr.14388) 5361 : audit [DBG] from='client.125106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:28 smithi049 bash[23528]: audit 2024-09-21T00:18:27.257849+0000 mgr.a (mgr.14388) 5361 : audit [DBG] from='client.125106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:29.678 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:29 smithi179 bash[23186]: cluster 2024-09-21T00:18:27.593941+0000 mgr.a (mgr.14388) 5362 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:29 smithi044 bash[22676]: cluster 2024-09-21T00:18:27.593941+0000 mgr.a (mgr.14388) 5362 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:29 smithi049 bash[23528]: cluster 2024-09-21T00:18:27.593941+0000 mgr.a (mgr.14388) 5362 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:30 smithi044 bash[22676]: cluster 2024-09-21T00:18:29.594748+0000 mgr.a (mgr.14388) 5363 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:30 smithi044 bash[22676]: audit 2024-09-21T00:18:29.845416+0000 mon.a (mon.0) 4848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:30 smithi044 bash[22676]: audit 2024-09-21T00:18:29.855244+0000 mon.a (mon.0) 4849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:30 smithi044 bash[22676]: audit 2024-09-21T00:18:29.867028+0000 mon.a (mon.0) 4850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:30 smithi179 bash[23186]: cluster 2024-09-21T00:18:29.594748+0000 mgr.a (mgr.14388) 5363 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:30 smithi179 bash[23186]: audit 2024-09-21T00:18:29.845416+0000 mon.a (mon.0) 4848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:30 smithi179 bash[23186]: audit 2024-09-21T00:18:29.855244+0000 mon.a (mon.0) 4849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:30 smithi179 bash[23186]: audit 2024-09-21T00:18:29.867028+0000 mon.a (mon.0) 4850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:30 smithi049 bash[23528]: cluster 2024-09-21T00:18:29.594748+0000 mgr.a (mgr.14388) 5363 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:30 smithi049 bash[23528]: audit 2024-09-21T00:18:29.845416+0000 mon.a (mon.0) 4848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:30 smithi049 bash[23528]: audit 2024-09-21T00:18:29.855244+0000 mon.a (mon.0) 4849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:30 smithi049 bash[23528]: audit 2024-09-21T00:18:29.867028+0000 mon.a (mon.0) 4850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:32 smithi044 bash[22676]: audit 2024-09-21T00:18:31.442343+0000 mon.a (mon.0) 4851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:32 smithi044 bash[22676]: audit 2024-09-21T00:18:31.450630+0000 mon.a (mon.0) 4852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:32 smithi044 bash[22676]: audit 2024-09-21T00:18:31.461822+0000 mon.a (mon.0) 4853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:32 smithi179 bash[23186]: audit 2024-09-21T00:18:31.442343+0000 mon.a (mon.0) 4851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:32 smithi179 bash[23186]: audit 2024-09-21T00:18:31.450630+0000 mon.a (mon.0) 4852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:32 smithi179 bash[23186]: audit 2024-09-21T00:18:31.461822+0000 mon.a (mon.0) 4853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.767 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:32 smithi049 bash[23528]: audit 2024-09-21T00:18:31.442343+0000 mon.a (mon.0) 4851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.767 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:32 smithi049 bash[23528]: audit 2024-09-21T00:18:31.450630+0000 mon.a (mon.0) 4852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:32.767 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:32 smithi049 bash[23528]: audit 2024-09-21T00:18:31.461822+0000 mon.a (mon.0) 4853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:33 smithi044 bash[22676]: cluster 2024-09-21T00:18:31.596936+0000 mgr.a (mgr.14388) 5364 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:33 smithi179 bash[23186]: cluster 2024-09-21T00:18:31.596936+0000 mgr.a (mgr.14388) 5364 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:33 smithi049 bash[23528]: cluster 2024-09-21T00:18:31.596936+0000 mgr.a (mgr.14388) 5364 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:34.725 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:34 smithi049 bash[23528]: audit 2024-09-21T00:18:33.028470+0000 mgr.a (mgr.14388) 5365 : audit [DBG] from='client.125181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:34.725 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:34 smithi049 bash[23528]: audit 2024-09-21T00:18:33.519087+0000 mon.a (mon.0) 4854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.725 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:34 smithi049 bash[23528]: audit 2024-09-21T00:18:33.524330+0000 mon.a (mon.0) 4855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.726 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:34 smithi049 bash[23528]: audit 2024-09-21T00:18:33.530479+0000 mon.a (mon.0) 4856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:34 smithi044 bash[22676]: audit 2024-09-21T00:18:33.028470+0000 mgr.a (mgr.14388) 5365 : audit [DBG] from='client.125181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:34 smithi044 bash[22676]: audit 2024-09-21T00:18:33.519087+0000 mon.a (mon.0) 4854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:34 smithi044 bash[22676]: audit 2024-09-21T00:18:33.524330+0000 mon.a (mon.0) 4855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:34 smithi044 bash[22676]: audit 2024-09-21T00:18:33.530479+0000 mon.a (mon.0) 4856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:34 smithi179 bash[23186]: audit 2024-09-21T00:18:33.028470+0000 mgr.a (mgr.14388) 5365 : audit [DBG] from='client.125181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:34 smithi179 bash[23186]: audit 2024-09-21T00:18:33.519087+0000 mon.a (mon.0) 4854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:34 smithi179 bash[23186]: audit 2024-09-21T00:18:33.524330+0000 mon.a (mon.0) 4855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:34 smithi179 bash[23186]: audit 2024-09-21T00:18:33.530479+0000 mon.a (mon.0) 4856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:35 smithi044 bash[22676]: cluster 2024-09-21T00:18:33.597566+0000 mgr.a (mgr.14388) 5366 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:35 smithi179 bash[23186]: cluster 2024-09-21T00:18:33.597566+0000 mgr.a (mgr.14388) 5366 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:35 smithi049 bash[23528]: cluster 2024-09-21T00:18:33.597566+0000 mgr.a (mgr.14388) 5366 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:37 smithi044 bash[22676]: cluster 2024-09-21T00:18:35.599781+0000 mgr.a (mgr.14388) 5367 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:37 smithi179 bash[23186]: cluster 2024-09-21T00:18:35.599781+0000 mgr.a (mgr.14388) 5367 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:37 smithi049 bash[23528]: cluster 2024-09-21T00:18:35.599781+0000 mgr.a (mgr.14388) 5367 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:38.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:38.475 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:38.476 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:39.265 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:39 smithi044 bash[22676]: cluster 2024-09-21T00:18:37.600560+0000 mgr.a (mgr.14388) 5368 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:39 smithi179 bash[23186]: cluster 2024-09-21T00:18:37.600560+0000 mgr.a (mgr.14388) 5368 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:39.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:39 smithi049 bash[23528]: cluster 2024-09-21T00:18:37.600560+0000 mgr.a (mgr.14388) 5368 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:40 smithi044 bash[22676]: audit 2024-09-21T00:18:38.812225+0000 mgr.a (mgr.14388) 5369 : audit [DBG] from='client.125259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:40 smithi179 bash[23186]: audit 2024-09-21T00:18:38.812225+0000 mgr.a (mgr.14388) 5369 : audit [DBG] from='client.125259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:40 smithi049 bash[23528]: audit 2024-09-21T00:18:38.812225+0000 mgr.a (mgr.14388) 5369 : audit [DBG] from='client.125259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:41 smithi044 bash[22676]: cluster 2024-09-21T00:18:39.601536+0000 mgr.a (mgr.14388) 5370 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:41 smithi179 bash[23186]: cluster 2024-09-21T00:18:39.601536+0000 mgr.a (mgr.14388) 5370 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:41.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:41 smithi049 bash[23528]: cluster 2024-09-21T00:18:39.601536+0000 mgr.a (mgr.14388) 5370 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:43 smithi179 bash[23186]: cluster 2024-09-21T00:18:41.603802+0000 mgr.a (mgr.14388) 5371 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:43.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:43 smithi049 bash[23528]: cluster 2024-09-21T00:18:41.603802+0000 mgr.a (mgr.14388) 5371 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:43 smithi044 bash[22676]: cluster 2024-09-21T00:18:41.603802+0000 mgr.a (mgr.14388) 5371 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:18:44.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:44.267 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:44.267 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:45.048 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:45 smithi179 bash[23186]: cluster 2024-09-21T00:18:43.604570+0000 mgr.a (mgr.14388) 5372 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:45 smithi049 bash[23528]: cluster 2024-09-21T00:18:43.604570+0000 mgr.a (mgr.14388) 5372 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:45 smithi044 bash[22676]: cluster 2024-09-21T00:18:43.604570+0000 mgr.a (mgr.14388) 5372 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:46 smithi179 bash[23186]: audit 2024-09-21T00:18:44.606692+0000 mgr.a (mgr.14388) 5373 : audit [DBG] from='client.125325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:46 smithi049 bash[23528]: audit 2024-09-21T00:18:44.606692+0000 mgr.a (mgr.14388) 5373 : audit [DBG] from='client.125325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:46 smithi044 bash[22676]: audit 2024-09-21T00:18:44.606692+0000 mgr.a (mgr.14388) 5373 : audit [DBG] from='client.125325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:47 smithi049 bash[23528]: cluster 2024-09-21T00:18:45.607447+0000 mgr.a (mgr.14388) 5374 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:18:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:47 smithi044 bash[22676]: cluster 2024-09-21T00:18:45.607447+0000 mgr.a (mgr.14388) 5374 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:18:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:47 smithi179 bash[23186]: cluster 2024-09-21T00:18:45.607447+0000 mgr.a (mgr.14388) 5374 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:18:49.784 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:49 smithi179 bash[23186]: cluster 2024-09-21T00:18:47.608242+0000 mgr.a (mgr.14388) 5375 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:18:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:49 smithi049 bash[23528]: cluster 2024-09-21T00:18:47.608242+0000 mgr.a (mgr.14388) 5375 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:18:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:49 smithi044 bash[22676]: cluster 2024-09-21T00:18:47.608242+0000 mgr.a (mgr.14388) 5375 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:18:50.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:50.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:50.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:50.832 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:50.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:50.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:50.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:50.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:51 smithi044 bash[22676]: cluster 2024-09-21T00:18:49.609004+0000 mgr.a (mgr.14388) 5376 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:18:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:51 smithi044 bash[22676]: audit 2024-09-21T00:18:50.077041+0000 mon.a (mon.0) 4857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:51 smithi044 bash[22676]: audit 2024-09-21T00:18:50.086748+0000 mon.a (mon.0) 4858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:51 smithi044 bash[22676]: audit 2024-09-21T00:18:50.095769+0000 mon.a (mon.0) 4859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:51 smithi044 bash[22676]: audit 2024-09-21T00:18:50.390415+0000 mgr.a (mgr.14388) 5377 : audit [DBG] from='client.125403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:51.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:51 smithi179 bash[23186]: cluster 2024-09-21T00:18:49.609004+0000 mgr.a (mgr.14388) 5376 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:18:51.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:51 smithi179 bash[23186]: audit 2024-09-21T00:18:50.077041+0000 mon.a (mon.0) 4857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:51 smithi179 bash[23186]: audit 2024-09-21T00:18:50.086748+0000 mon.a (mon.0) 4858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:51 smithi179 bash[23186]: audit 2024-09-21T00:18:50.095769+0000 mon.a (mon.0) 4859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:51 smithi179 bash[23186]: audit 2024-09-21T00:18:50.390415+0000 mgr.a (mgr.14388) 5377 : audit [DBG] from='client.125403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:51 smithi049 bash[23528]: cluster 2024-09-21T00:18:49.609004+0000 mgr.a (mgr.14388) 5376 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:18:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:51 smithi049 bash[23528]: audit 2024-09-21T00:18:50.077041+0000 mon.a (mon.0) 4857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:51 smithi049 bash[23528]: audit 2024-09-21T00:18:50.086748+0000 mon.a (mon.0) 4858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:51 smithi049 bash[23528]: audit 2024-09-21T00:18:50.095769+0000 mon.a (mon.0) 4859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:51 smithi049 bash[23528]: audit 2024-09-21T00:18:50.390415+0000 mgr.a (mgr.14388) 5377 : audit [DBG] from='client.125403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:52.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22930]: debug 2024-09-21T00:18:52.768+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:18:52.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22930]: debug 2024-09-21T00:18:52.768+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:18:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:51.607521+0000 mon.a (mon.0) 4860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: cluster 2024-09-21T00:18:51.611381+0000 mgr.a (mgr.14388) 5378 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:51.616630+0000 mon.a (mon.0) 4861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:51.625658+0000 mon.a (mon.0) 4862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:52.029461+0000 mon.a (mon.0) 4863 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:18:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:52.033522+0000 mon.a (mon.0) 4864 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:18:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:52.034634+0000 mon.a (mon.0) 4865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:18:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:52.040884+0000 mon.a (mon.0) 4866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:52.043778+0000 mon.a (mon.0) 4867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:18:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:52 smithi044 bash[22676]: audit 2024-09-21T00:18:52.046329+0000 mgr.a (mgr.14388) 5379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:18:52.996 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:51.607521+0000 mon.a (mon.0) 4860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.996 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: cluster 2024-09-21T00:18:51.611381+0000 mgr.a (mgr.14388) 5378 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:52.996 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:51.616630+0000 mon.a (mon.0) 4861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.996 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:51.625658+0000 mon.a (mon.0) 4862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.997 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:52.029461+0000 mon.a (mon.0) 4863 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:18:52.997 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:52.033522+0000 mon.a (mon.0) 4864 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:18:52.997 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:52.034634+0000 mon.a (mon.0) 4865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:18:52.997 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:52.040884+0000 mon.a (mon.0) 4866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:52.997 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:52.043778+0000 mon.a (mon.0) 4867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:18:52.997 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:52 smithi049 bash[23528]: audit 2024-09-21T00:18:52.046329+0000 mgr.a (mgr.14388) 5379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:51.607521+0000 mon.a (mon.0) 4860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: cluster 2024-09-21T00:18:51.611381+0000 mgr.a (mgr.14388) 5378 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:51.616630+0000 mon.a (mon.0) 4861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:51.625658+0000 mon.a (mon.0) 4862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:52.029461+0000 mon.a (mon.0) 4863 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:52.033522+0000 mon.a (mon.0) 4864 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:52.034634+0000 mon.a (mon.0) 4865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:18:53.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:52.040884+0000 mon.a (mon.0) 4866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:52.043778+0000 mon.a (mon.0) 4867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:18:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:52 smithi179 bash[23186]: audit 2024-09-21T00:18:52.046329+0000 mgr.a (mgr.14388) 5379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:18:53.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:53 smithi049 bash[23528]: audit 2024-09-21T00:18:52.769625+0000 mgr.a (mgr.14388) 5380 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:18:53.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:53 smithi049 bash[23528]: cephadm 2024-09-21T00:18:52.770666+0000 mgr.a (mgr.14388) 5381 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:18:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:53 smithi044 bash[22676]: audit 2024-09-21T00:18:52.769625+0000 mgr.a (mgr.14388) 5380 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:18:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:53 smithi044 bash[22676]: cephadm 2024-09-21T00:18:52.770666+0000 mgr.a (mgr.14388) 5381 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:18:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:53 smithi179 bash[23186]: audit 2024-09-21T00:18:52.769625+0000 mgr.a (mgr.14388) 5380 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:18:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:53 smithi179 bash[23186]: cephadm 2024-09-21T00:18:52.770666+0000 mgr.a (mgr.14388) 5381 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:18:54.940 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:54 smithi049 bash[23528]: cluster 2024-09-21T00:18:53.612114+0000 mgr.a (mgr.14388) 5382 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:54.940 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:54 smithi049 bash[23528]: audit 2024-09-21T00:18:53.686281+0000 mon.a (mon.0) 4868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:54.940 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:54 smithi049 bash[23528]: audit 2024-09-21T00:18:53.690828+0000 mon.a (mon.0) 4869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:54.940 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:54 smithi049 bash[23528]: audit 2024-09-21T00:18:53.695854+0000 mon.a (mon.0) 4870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:54 smithi044 bash[22676]: cluster 2024-09-21T00:18:53.612114+0000 mgr.a (mgr.14388) 5382 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:54 smithi044 bash[22676]: audit 2024-09-21T00:18:53.686281+0000 mon.a (mon.0) 4868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:54 smithi044 bash[22676]: audit 2024-09-21T00:18:53.690828+0000 mon.a (mon.0) 4869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:54 smithi044 bash[22676]: audit 2024-09-21T00:18:53.695854+0000 mon.a (mon.0) 4870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:54 smithi179 bash[23186]: cluster 2024-09-21T00:18:53.612114+0000 mgr.a (mgr.14388) 5382 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:18:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:54 smithi179 bash[23186]: audit 2024-09-21T00:18:53.686281+0000 mon.a (mon.0) 4868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:54 smithi179 bash[23186]: audit 2024-09-21T00:18:53.690828+0000 mon.a (mon.0) 4869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:54 smithi179 bash[23186]: audit 2024-09-21T00:18:53.695854+0000 mon.a (mon.0) 4870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:18:55.833 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:18:55.835 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:18:55.835 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:18:56.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:18:56.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:18:56.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:18:56.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:18:56.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:18:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:56 smithi044 bash[22676]: cluster 2024-09-21T00:18:55.614395+0000 mgr.a (mgr.14388) 5383 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:56 smithi044 bash[22676]: audit 2024-09-21T00:18:56.169846+0000 mgr.a (mgr.14388) 5384 : audit [DBG] from='client.125586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:56 smithi179 bash[23186]: cluster 2024-09-21T00:18:55.614395+0000 mgr.a (mgr.14388) 5383 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:56 smithi179 bash[23186]: audit 2024-09-21T00:18:56.169846+0000 mgr.a (mgr.14388) 5384 : audit [DBG] from='client.125586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:56 smithi049 bash[23528]: cluster 2024-09-21T00:18:55.614395+0000 mgr.a (mgr.14388) 5383 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:18:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:56 smithi049 bash[23528]: audit 2024-09-21T00:18:56.169846+0000 mgr.a (mgr.14388) 5384 : audit [DBG] from='client.125586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:18:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:18:58 smithi044 bash[22676]: cluster 2024-09-21T00:18:57.615404+0000 mgr.a (mgr.14388) 5385 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:18:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:18:58 smithi179 bash[23186]: cluster 2024-09-21T00:18:57.615404+0000 mgr.a (mgr.14388) 5385 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:18:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:18:58 smithi049 bash[23528]: cluster 2024-09-21T00:18:57.615404+0000 mgr.a (mgr.14388) 5385 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:19:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:00 smithi044 bash[22676]: cluster 2024-09-21T00:18:59.616195+0000 mgr.a (mgr.14388) 5386 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:19:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:00 smithi179 bash[23186]: cluster 2024-09-21T00:18:59.616195+0000 mgr.a (mgr.14388) 5386 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:19:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:00 smithi049 bash[23528]: cluster 2024-09-21T00:18:59.616195+0000 mgr.a (mgr.14388) 5386 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:19:01.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:01.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:01.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:02.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:02.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:02.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:02.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:02.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:02 smithi044 bash[22676]: cluster 2024-09-21T00:19:01.618438+0000 mgr.a (mgr.14388) 5387 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:02 smithi044 bash[22676]: audit 2024-09-21T00:19:01.963093+0000 mgr.a (mgr.14388) 5388 : audit [DBG] from='client.125664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:02 smithi179 bash[23186]: cluster 2024-09-21T00:19:01.618438+0000 mgr.a (mgr.14388) 5387 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:03.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:02 smithi179 bash[23186]: audit 2024-09-21T00:19:01.963093+0000 mgr.a (mgr.14388) 5388 : audit [DBG] from='client.125664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:02 smithi049 bash[23528]: cluster 2024-09-21T00:19:01.618438+0000 mgr.a (mgr.14388) 5387 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:02 smithi049 bash[23528]: audit 2024-09-21T00:19:01.963093+0000 mgr.a (mgr.14388) 5388 : audit [DBG] from='client.125664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:04 smithi044 bash[22676]: cluster 2024-09-21T00:19:03.619438+0000 mgr.a (mgr.14388) 5389 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:04 smithi179 bash[23186]: cluster 2024-09-21T00:19:03.619438+0000 mgr.a (mgr.14388) 5389 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:04 smithi049 bash[23528]: cluster 2024-09-21T00:19:03.619438+0000 mgr.a (mgr.14388) 5389 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:06 smithi044 bash[22676]: cluster 2024-09-21T00:19:05.621594+0000 mgr.a (mgr.14388) 5390 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:06 smithi179 bash[23186]: cluster 2024-09-21T00:19:05.621594+0000 mgr.a (mgr.14388) 5390 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:06 smithi049 bash[23528]: cluster 2024-09-21T00:19:05.621594+0000 mgr.a (mgr.14388) 5390 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:07.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:07.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:07.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:08.135 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:08.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:08.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:08.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:08.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:08 smithi044 bash[22676]: cluster 2024-09-21T00:19:07.622323+0000 mgr.a (mgr.14388) 5391 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:08 smithi044 bash[22676]: audit 2024-09-21T00:19:07.725848+0000 mgr.a (mgr.14388) 5392 : audit [DBG] from='client.125742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:08 smithi179 bash[23186]: cluster 2024-09-21T00:19:07.622323+0000 mgr.a (mgr.14388) 5391 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:08 smithi179 bash[23186]: audit 2024-09-21T00:19:07.725848+0000 mgr.a (mgr.14388) 5392 : audit [DBG] from='client.125742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:08 smithi049 bash[23528]: cluster 2024-09-21T00:19:07.622323+0000 mgr.a (mgr.14388) 5391 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:08 smithi049 bash[23528]: audit 2024-09-21T00:19:07.725848+0000 mgr.a (mgr.14388) 5392 : audit [DBG] from='client.125742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:11 smithi044 bash[22676]: cluster 2024-09-21T00:19:09.623211+0000 mgr.a (mgr.14388) 5393 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:11 smithi044 bash[22676]: audit 2024-09-21T00:19:10.317463+0000 mon.a (mon.0) 4871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:11 smithi044 bash[22676]: audit 2024-09-21T00:19:10.327488+0000 mon.a (mon.0) 4872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:11 smithi044 bash[22676]: audit 2024-09-21T00:19:10.344829+0000 mon.a (mon.0) 4873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:11 smithi179 bash[23186]: cluster 2024-09-21T00:19:09.623211+0000 mgr.a (mgr.14388) 5393 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:11 smithi179 bash[23186]: audit 2024-09-21T00:19:10.317463+0000 mon.a (mon.0) 4871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:11 smithi179 bash[23186]: audit 2024-09-21T00:19:10.327488+0000 mon.a (mon.0) 4872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:11 smithi179 bash[23186]: audit 2024-09-21T00:19:10.344829+0000 mon.a (mon.0) 4873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:11 smithi049 bash[23528]: cluster 2024-09-21T00:19:09.623211+0000 mgr.a (mgr.14388) 5393 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:11 smithi049 bash[23528]: audit 2024-09-21T00:19:10.317463+0000 mon.a (mon.0) 4871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:11 smithi049 bash[23528]: audit 2024-09-21T00:19:10.327488+0000 mon.a (mon.0) 4872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:11 smithi049 bash[23528]: audit 2024-09-21T00:19:10.344829+0000 mon.a (mon.0) 4873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:12 smithi049 bash[23528]: cluster 2024-09-21T00:19:11.625484+0000 mgr.a (mgr.14388) 5394 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:12 smithi049 bash[23528]: audit 2024-09-21T00:19:11.779339+0000 mon.a (mon.0) 4874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:12 smithi049 bash[23528]: audit 2024-09-21T00:19:11.787962+0000 mon.a (mon.0) 4875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:12 smithi049 bash[23528]: audit 2024-09-21T00:19:11.798089+0000 mon.a (mon.0) 4876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:12 smithi044 bash[22676]: cluster 2024-09-21T00:19:11.625484+0000 mgr.a (mgr.14388) 5394 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:12 smithi044 bash[22676]: audit 2024-09-21T00:19:11.779339+0000 mon.a (mon.0) 4874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:12 smithi044 bash[22676]: audit 2024-09-21T00:19:11.787962+0000 mon.a (mon.0) 4875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:12 smithi044 bash[22676]: audit 2024-09-21T00:19:11.798089+0000 mon.a (mon.0) 4876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:12 smithi179 bash[23186]: cluster 2024-09-21T00:19:11.625484+0000 mgr.a (mgr.14388) 5394 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:12 smithi179 bash[23186]: audit 2024-09-21T00:19:11.779339+0000 mon.a (mon.0) 4874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:12 smithi179 bash[23186]: audit 2024-09-21T00:19:11.787962+0000 mon.a (mon.0) 4875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:12 smithi179 bash[23186]: audit 2024-09-21T00:19:11.798089+0000 mon.a (mon.0) 4876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:13.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:13.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:13.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:13 smithi044 bash[22676]: audit 2024-09-21T00:19:13.471626+0000 mgr.a (mgr.14388) 5395 : audit [DBG] from='client.125820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:14.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:13 smithi049 bash[23528]: audit 2024-09-21T00:19:13.471626+0000 mgr.a (mgr.14388) 5395 : audit [DBG] from='client.125820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:13 smithi179 bash[23186]: audit 2024-09-21T00:19:13.471626+0000 mgr.a (mgr.14388) 5395 : audit [DBG] from='client.125820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:15.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:14 smithi049 bash[23528]: cluster 2024-09-21T00:19:13.626039+0000 mgr.a (mgr.14388) 5396 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:15.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:14 smithi049 bash[23528]: audit 2024-09-21T00:19:13.857632+0000 mon.a (mon.0) 4877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:14 smithi049 bash[23528]: audit 2024-09-21T00:19:13.862533+0000 mon.a (mon.0) 4878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.178 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:14 smithi049 bash[23528]: audit 2024-09-21T00:19:13.868707+0000 mon.a (mon.0) 4879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:14 smithi044 bash[22676]: cluster 2024-09-21T00:19:13.626039+0000 mgr.a (mgr.14388) 5396 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:14 smithi044 bash[22676]: audit 2024-09-21T00:19:13.857632+0000 mon.a (mon.0) 4877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:14 smithi044 bash[22676]: audit 2024-09-21T00:19:13.862533+0000 mon.a (mon.0) 4878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:14 smithi044 bash[22676]: audit 2024-09-21T00:19:13.868707+0000 mon.a (mon.0) 4879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:14 smithi179 bash[23186]: cluster 2024-09-21T00:19:13.626039+0000 mgr.a (mgr.14388) 5396 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:14 smithi179 bash[23186]: audit 2024-09-21T00:19:13.857632+0000 mon.a (mon.0) 4877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:14 smithi179 bash[23186]: audit 2024-09-21T00:19:13.862533+0000 mon.a (mon.0) 4878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:14 smithi179 bash[23186]: audit 2024-09-21T00:19:13.868707+0000 mon.a (mon.0) 4879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:16 smithi044 bash[22676]: cluster 2024-09-21T00:19:15.628367+0000 mgr.a (mgr.14388) 5397 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:16 smithi179 bash[23186]: cluster 2024-09-21T00:19:15.628367+0000 mgr.a (mgr.14388) 5397 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:16 smithi049 bash[23528]: cluster 2024-09-21T00:19:15.628367+0000 mgr.a (mgr.14388) 5397 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:18 smithi044 bash[22676]: cluster 2024-09-21T00:19:17.629166+0000 mgr.a (mgr.14388) 5398 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:18 smithi179 bash[23186]: cluster 2024-09-21T00:19:17.629166+0000 mgr.a (mgr.14388) 5398 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:18 smithi049 bash[23528]: cluster 2024-09-21T00:19:17.629166+0000 mgr.a (mgr.14388) 5398 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:19.739 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:19.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:19 smithi044 bash[22676]: audit 2024-09-21T00:19:19.293618+0000 mgr.a (mgr.14388) 5399 : audit [DBG] from='client.125898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:19 smithi179 bash[23186]: audit 2024-09-21T00:19:19.293618+0000 mgr.a (mgr.14388) 5399 : audit [DBG] from='client.125898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:19 smithi049 bash[23528]: audit 2024-09-21T00:19:19.293618+0000 mgr.a (mgr.14388) 5399 : audit [DBG] from='client.125898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:20 smithi044 bash[22676]: cluster 2024-09-21T00:19:19.636341+0000 mgr.a (mgr.14388) 5400 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:20 smithi179 bash[23186]: cluster 2024-09-21T00:19:19.636341+0000 mgr.a (mgr.14388) 5400 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:20 smithi049 bash[23528]: cluster 2024-09-21T00:19:19.636341+0000 mgr.a (mgr.14388) 5400 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:22 smithi044 bash[22676]: cluster 2024-09-21T00:19:21.638647+0000 mgr.a (mgr.14388) 5401 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:22 smithi179 bash[23186]: cluster 2024-09-21T00:19:21.638647+0000 mgr.a (mgr.14388) 5401 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:22 smithi049 bash[23528]: cluster 2024-09-21T00:19:21.638647+0000 mgr.a (mgr.14388) 5401 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:24.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:24.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:24.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:24 smithi044 bash[22676]: cluster 2024-09-21T00:19:23.639406+0000 mgr.a (mgr.14388) 5402 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:24 smithi179 bash[23186]: cluster 2024-09-21T00:19:23.639406+0000 mgr.a (mgr.14388) 5402 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:24 smithi049 bash[23528]: cluster 2024-09-21T00:19:23.639406+0000 mgr.a (mgr.14388) 5402 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:25.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:25.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:25 smithi044 bash[22676]: audit 2024-09-21T00:19:25.073142+0000 mgr.a (mgr.14388) 5403 : audit [DBG] from='client.125976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:25 smithi179 bash[23186]: audit 2024-09-21T00:19:25.073142+0000 mgr.a (mgr.14388) 5403 : audit [DBG] from='client.125976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:25 smithi049 bash[23528]: audit 2024-09-21T00:19:25.073142+0000 mgr.a (mgr.14388) 5403 : audit [DBG] from='client.125976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:26 smithi044 bash[22676]: cluster 2024-09-21T00:19:25.642175+0000 mgr.a (mgr.14388) 5404 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:26 smithi179 bash[23186]: cluster 2024-09-21T00:19:25.642175+0000 mgr.a (mgr.14388) 5404 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:26 smithi049 bash[23528]: cluster 2024-09-21T00:19:25.642175+0000 mgr.a (mgr.14388) 5404 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:28 smithi044 bash[22676]: cluster 2024-09-21T00:19:27.642948+0000 mgr.a (mgr.14388) 5405 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:28 smithi179 bash[23186]: cluster 2024-09-21T00:19:27.642948+0000 mgr.a (mgr.14388) 5405 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:28 smithi049 bash[23528]: cluster 2024-09-21T00:19:27.642948+0000 mgr.a (mgr.14388) 5405 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:30.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:30.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:30.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:31.286 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:31.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:31.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:31.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:31.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:31 smithi049 bash[23528]: cluster 2024-09-21T00:19:29.643733+0000 mgr.a (mgr.14388) 5406 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:31 smithi049 bash[23528]: audit 2024-09-21T00:19:30.519944+0000 mon.a (mon.0) 4880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:31 smithi049 bash[23528]: audit 2024-09-21T00:19:30.527956+0000 mon.a (mon.0) 4881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:31 smithi049 bash[23528]: audit 2024-09-21T00:19:30.538388+0000 mon.a (mon.0) 4882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.965 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:31 smithi179 bash[23186]: cluster 2024-09-21T00:19:29.643733+0000 mgr.a (mgr.14388) 5406 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:31.965 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:31 smithi179 bash[23186]: audit 2024-09-21T00:19:30.519944+0000 mon.a (mon.0) 4880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.965 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:31 smithi179 bash[23186]: audit 2024-09-21T00:19:30.527956+0000 mon.a (mon.0) 4881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.965 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:31 smithi179 bash[23186]: audit 2024-09-21T00:19:30.538388+0000 mon.a (mon.0) 4882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.969 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:31 smithi044 bash[22676]: cluster 2024-09-21T00:19:29.643733+0000 mgr.a (mgr.14388) 5406 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:31.970 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:31 smithi044 bash[22676]: audit 2024-09-21T00:19:30.519944+0000 mon.a (mon.0) 4880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.970 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:31 smithi044 bash[22676]: audit 2024-09-21T00:19:30.527956+0000 mon.a (mon.0) 4881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:31.970 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:31 smithi044 bash[22676]: audit 2024-09-21T00:19:30.538388+0000 mon.a (mon.0) 4882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:32 smithi049 bash[23528]: audit 2024-09-21T00:19:30.842595+0000 mgr.a (mgr.14388) 5407 : audit [DBG] from='client.126054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:32 smithi049 bash[23528]: audit 2024-09-21T00:19:31.943664+0000 mon.a (mon.0) 4883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:32 smithi049 bash[23528]: audit 2024-09-21T00:19:31.951566+0000 mon.a (mon.0) 4884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:32 smithi049 bash[23528]: audit 2024-09-21T00:19:31.962220+0000 mon.a (mon.0) 4885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:32.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:32 smithi044 bash[22676]: audit 2024-09-21T00:19:30.842595+0000 mgr.a (mgr.14388) 5407 : audit [DBG] from='client.126054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:32.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:32 smithi044 bash[22676]: audit 2024-09-21T00:19:31.943664+0000 mon.a (mon.0) 4883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:32.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:32 smithi044 bash[22676]: audit 2024-09-21T00:19:31.951566+0000 mon.a (mon.0) 4884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:32.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:32 smithi044 bash[22676]: audit 2024-09-21T00:19:31.962220+0000 mon.a (mon.0) 4885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:32 smithi179 bash[23186]: audit 2024-09-21T00:19:30.842595+0000 mgr.a (mgr.14388) 5407 : audit [DBG] from='client.126054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:32 smithi179 bash[23186]: audit 2024-09-21T00:19:31.943664+0000 mon.a (mon.0) 4883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:32 smithi179 bash[23186]: audit 2024-09-21T00:19:31.951566+0000 mon.a (mon.0) 4884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:32 smithi179 bash[23186]: audit 2024-09-21T00:19:31.962220+0000 mon.a (mon.0) 4885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:33 smithi049 bash[23528]: cluster 2024-09-21T00:19:31.646591+0000 mgr.a (mgr.14388) 5408 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:33.820 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:33 smithi044 bash[22676]: cluster 2024-09-21T00:19:31.646591+0000 mgr.a (mgr.14388) 5408 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:33 smithi179 bash[23186]: cluster 2024-09-21T00:19:31.646591+0000 mgr.a (mgr.14388) 5408 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:35 smithi179 bash[23186]: cluster 2024-09-21T00:19:33.647531+0000 mgr.a (mgr.14388) 5409 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:35 smithi179 bash[23186]: audit 2024-09-21T00:19:33.999975+0000 mon.a (mon.0) 4886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:35 smithi179 bash[23186]: audit 2024-09-21T00:19:34.005470+0000 mon.a (mon.0) 4887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:35 smithi179 bash[23186]: audit 2024-09-21T00:19:34.010975+0000 mon.a (mon.0) 4888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:35 smithi049 bash[23528]: cluster 2024-09-21T00:19:33.647531+0000 mgr.a (mgr.14388) 5409 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:35.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:35 smithi049 bash[23528]: audit 2024-09-21T00:19:33.999975+0000 mon.a (mon.0) 4886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:35 smithi049 bash[23528]: audit 2024-09-21T00:19:34.005470+0000 mon.a (mon.0) 4887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.260 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:35 smithi049 bash[23528]: audit 2024-09-21T00:19:34.010975+0000 mon.a (mon.0) 4888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:35 smithi044 bash[22676]: cluster 2024-09-21T00:19:33.647531+0000 mgr.a (mgr.14388) 5409 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:19:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:35 smithi044 bash[22676]: audit 2024-09-21T00:19:33.999975+0000 mon.a (mon.0) 4886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:35 smithi044 bash[22676]: audit 2024-09-21T00:19:34.005470+0000 mon.a (mon.0) 4887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:35 smithi044 bash[22676]: audit 2024-09-21T00:19:34.010975+0000 mon.a (mon.0) 4888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:36.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:36.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:36.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:37.051 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:37.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:37.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:37 smithi049 bash[23528]: cluster 2024-09-21T00:19:35.649607+0000 mgr.a (mgr.14388) 5410 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:37 smithi044 bash[22676]: cluster 2024-09-21T00:19:35.649607+0000 mgr.a (mgr.14388) 5410 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:37 smithi179 bash[23186]: cluster 2024-09-21T00:19:35.649607+0000 mgr.a (mgr.14388) 5410 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:38.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:38 smithi049 bash[23528]: audit 2024-09-21T00:19:36.624110+0000 mgr.a (mgr.14388) 5411 : audit [DBG] from='client.126132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:38 smithi044 bash[22676]: audit 2024-09-21T00:19:36.624110+0000 mgr.a (mgr.14388) 5411 : audit [DBG] from='client.126132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:38 smithi179 bash[23186]: audit 2024-09-21T00:19:36.624110+0000 mgr.a (mgr.14388) 5411 : audit [DBG] from='client.126132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:39 smithi049 bash[23528]: cluster 2024-09-21T00:19:37.650617+0000 mgr.a (mgr.14388) 5412 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:39 smithi044 bash[22676]: cluster 2024-09-21T00:19:37.650617+0000 mgr.a (mgr.14388) 5412 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:39 smithi179 bash[23186]: cluster 2024-09-21T00:19:37.650617+0000 mgr.a (mgr.14388) 5412 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:41 smithi049 bash[23528]: cluster 2024-09-21T00:19:39.651603+0000 mgr.a (mgr.14388) 5413 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:41 smithi044 bash[22676]: cluster 2024-09-21T00:19:39.651603+0000 mgr.a (mgr.14388) 5413 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:41 smithi179 bash[23186]: cluster 2024-09-21T00:19:39.651603+0000 mgr.a (mgr.14388) 5413 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:42.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:42.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:42.054 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:42.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:42.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:42.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:42.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:42.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:43 smithi049 bash[23528]: cluster 2024-09-21T00:19:41.653894+0000 mgr.a (mgr.14388) 5414 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:43 smithi049 bash[23528]: audit 2024-09-21T00:19:42.383294+0000 mgr.a (mgr.14388) 5415 : audit [DBG] from='client.126210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:43 smithi044 bash[22676]: cluster 2024-09-21T00:19:41.653894+0000 mgr.a (mgr.14388) 5414 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:43 smithi044 bash[22676]: audit 2024-09-21T00:19:42.383294+0000 mgr.a (mgr.14388) 5415 : audit [DBG] from='client.126210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:43 smithi179 bash[23186]: cluster 2024-09-21T00:19:41.653894+0000 mgr.a (mgr.14388) 5414 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:43 smithi179 bash[23186]: audit 2024-09-21T00:19:42.383294+0000 mgr.a (mgr.14388) 5415 : audit [DBG] from='client.126210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:45 smithi049 bash[23528]: cluster 2024-09-21T00:19:43.655043+0000 mgr.a (mgr.14388) 5416 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:45 smithi044 bash[22676]: cluster 2024-09-21T00:19:43.655043+0000 mgr.a (mgr.14388) 5416 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:45 smithi179 bash[23186]: cluster 2024-09-21T00:19:43.655043+0000 mgr.a (mgr.14388) 5416 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:47 smithi049 bash[23528]: cluster 2024-09-21T00:19:45.657443+0000 mgr.a (mgr.14388) 5417 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:47 smithi044 bash[22676]: cluster 2024-09-21T00:19:45.657443+0000 mgr.a (mgr.14388) 5417 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:47 smithi179 bash[23186]: cluster 2024-09-21T00:19:45.657443+0000 mgr.a (mgr.14388) 5417 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:48.587 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:49 smithi049 bash[23528]: cluster 2024-09-21T00:19:47.658377+0000 mgr.a (mgr.14388) 5418 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:49 smithi049 bash[23528]: audit 2024-09-21T00:19:48.133310+0000 mgr.a (mgr.14388) 5419 : audit [DBG] from='client.126285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:49 smithi044 bash[22676]: cluster 2024-09-21T00:19:47.658377+0000 mgr.a (mgr.14388) 5418 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:49 smithi044 bash[22676]: audit 2024-09-21T00:19:48.133310+0000 mgr.a (mgr.14388) 5419 : audit [DBG] from='client.126285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:49 smithi179 bash[23186]: cluster 2024-09-21T00:19:47.658377+0000 mgr.a (mgr.14388) 5418 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:49 smithi179 bash[23186]: audit 2024-09-21T00:19:48.133310+0000 mgr.a (mgr.14388) 5419 : audit [DBG] from='client.126285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:51 smithi179 bash[23186]: cluster 2024-09-21T00:19:49.659315+0000 mgr.a (mgr.14388) 5420 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:51 smithi179 bash[23186]: audit 2024-09-21T00:19:50.734561+0000 mon.a (mon.0) 4889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:51 smithi179 bash[23186]: audit 2024-09-21T00:19:50.745005+0000 mon.a (mon.0) 4890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:51 smithi179 bash[23186]: audit 2024-09-21T00:19:50.755562+0000 mon.a (mon.0) 4891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:51 smithi049 bash[23528]: cluster 2024-09-21T00:19:49.659315+0000 mgr.a (mgr.14388) 5420 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:51 smithi049 bash[23528]: audit 2024-09-21T00:19:50.734561+0000 mon.a (mon.0) 4889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:51 smithi049 bash[23528]: audit 2024-09-21T00:19:50.745005+0000 mon.a (mon.0) 4890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:51 smithi049 bash[23528]: audit 2024-09-21T00:19:50.755562+0000 mon.a (mon.0) 4891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.310 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:51 smithi044 bash[22676]: cluster 2024-09-21T00:19:49.659315+0000 mgr.a (mgr.14388) 5420 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:51.310 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:51 smithi044 bash[22676]: audit 2024-09-21T00:19:50.734561+0000 mon.a (mon.0) 4889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.310 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:51 smithi044 bash[22676]: audit 2024-09-21T00:19:50.745005+0000 mon.a (mon.0) 4890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:51.310 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:51 smithi044 bash[22676]: audit 2024-09-21T00:19:50.755562+0000 mon.a (mon.0) 4891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: cluster 2024-09-21T00:19:51.661721+0000 mgr.a (mgr.14388) 5421 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.155844+0000 mon.a (mon.0) 4892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.164045+0000 mon.a (mon.0) 4893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.174417+0000 mon.a (mon.0) 4894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.836650+0000 mon.a (mon.0) 4895 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:19:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.843253+0000 mon.a (mon.0) 4896 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:19:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.845351+0000 mon.a (mon.0) 4897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:19:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.857287+0000 mon.a (mon.0) 4898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22676]: audit 2024-09-21T00:19:52.864261+0000 mon.a (mon.0) 4899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: cluster 2024-09-21T00:19:51.661721+0000 mgr.a (mgr.14388) 5421 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.155844+0000 mon.a (mon.0) 4892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.164045+0000 mon.a (mon.0) 4893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.174417+0000 mon.a (mon.0) 4894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.836650+0000 mon.a (mon.0) 4895 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.843253+0000 mon.a (mon.0) 4896 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.845351+0000 mon.a (mon.0) 4897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.857287+0000 mon.a (mon.0) 4898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:53 smithi179 bash[23186]: audit 2024-09-21T00:19:52.864261+0000 mon.a (mon.0) 4899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: cluster 2024-09-21T00:19:51.661721+0000 mgr.a (mgr.14388) 5421 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.155844+0000 mon.a (mon.0) 4892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.164045+0000 mon.a (mon.0) 4893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.174417+0000 mon.a (mon.0) 4894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.836650+0000 mon.a (mon.0) 4895 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.843253+0000 mon.a (mon.0) 4896 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.845351+0000 mon.a (mon.0) 4897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:19:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.857287+0000 mon.a (mon.0) 4898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:53 smithi049 bash[23528]: audit 2024-09-21T00:19:52.864261+0000 mon.a (mon.0) 4899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:19:53.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:53.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:53.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:53.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22930]: debug 2024-09-21T00:19:53.639+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:19:53.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:19:53 smithi044 bash[22930]: debug 2024-09-21T00:19:53.639+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:19:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:54 smithi049 bash[23528]: audit 2024-09-21T00:19:52.866630+0000 mgr.a (mgr.14388) 5422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:19:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:54 smithi049 bash[23528]: audit 2024-09-21T00:19:54.138950+0000 mon.a (mon.0) 4900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:54 smithi049 bash[23528]: audit 2024-09-21T00:19:54.144967+0000 mon.a (mon.0) 4901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:54 smithi049 bash[23528]: audit 2024-09-21T00:19:54.151404+0000 mon.a (mon.0) 4902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.366 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:19:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:19:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:19:54.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:19:54.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:19:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:54 smithi044 bash[22676]: audit 2024-09-21T00:19:52.866630+0000 mgr.a (mgr.14388) 5422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:19:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:54 smithi044 bash[22676]: audit 2024-09-21T00:19:54.138950+0000 mon.a (mon.0) 4900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:54 smithi044 bash[22676]: audit 2024-09-21T00:19:54.144967+0000 mon.a (mon.0) 4901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:54 smithi044 bash[22676]: audit 2024-09-21T00:19:54.151404+0000 mon.a (mon.0) 4902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:54 smithi179 bash[23186]: audit 2024-09-21T00:19:52.866630+0000 mgr.a (mgr.14388) 5422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:19:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:54 smithi179 bash[23186]: audit 2024-09-21T00:19:54.138950+0000 mon.a (mon.0) 4900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:54 smithi179 bash[23186]: audit 2024-09-21T00:19:54.144967+0000 mon.a (mon.0) 4901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:54 smithi179 bash[23186]: audit 2024-09-21T00:19:54.151404+0000 mon.a (mon.0) 4902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:19:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:55 smithi044 bash[22676]: audit 2024-09-21T00:19:53.641630+0000 mgr.a (mgr.14388) 5423 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:19:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:55 smithi044 bash[22676]: cephadm 2024-09-21T00:19:53.643015+0000 mgr.a (mgr.14388) 5424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:19:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:55 smithi044 bash[22676]: cluster 2024-09-21T00:19:53.662336+0000 mgr.a (mgr.14388) 5425 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:55 smithi044 bash[22676]: audit 2024-09-21T00:19:53.919076+0000 mgr.a (mgr.14388) 5426 : audit [DBG] from='client.126468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:55 smithi179 bash[23186]: audit 2024-09-21T00:19:53.641630+0000 mgr.a (mgr.14388) 5423 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:19:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:55 smithi179 bash[23186]: cephadm 2024-09-21T00:19:53.643015+0000 mgr.a (mgr.14388) 5424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:19:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:55 smithi179 bash[23186]: cluster 2024-09-21T00:19:53.662336+0000 mgr.a (mgr.14388) 5425 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:55 smithi179 bash[23186]: audit 2024-09-21T00:19:53.919076+0000 mgr.a (mgr.14388) 5426 : audit [DBG] from='client.126468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:55.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:55 smithi049 bash[23528]: audit 2024-09-21T00:19:53.641630+0000 mgr.a (mgr.14388) 5423 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:19:55.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:55 smithi049 bash[23528]: cephadm 2024-09-21T00:19:53.643015+0000 mgr.a (mgr.14388) 5424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:19:55.532 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:55 smithi049 bash[23528]: cluster 2024-09-21T00:19:53.662336+0000 mgr.a (mgr.14388) 5425 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:19:55.532 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:55 smithi049 bash[23528]: audit 2024-09-21T00:19:53.919076+0000 mgr.a (mgr.14388) 5426 : audit [DBG] from='client.126468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:19:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:57 smithi044 bash[22676]: cluster 2024-09-21T00:19:55.664678+0000 mgr.a (mgr.14388) 5427 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:57 smithi179 bash[23186]: cluster 2024-09-21T00:19:55.664678+0000 mgr.a (mgr.14388) 5427 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:57 smithi049 bash[23528]: cluster 2024-09-21T00:19:55.664678+0000 mgr.a (mgr.14388) 5427 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:59.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:19:59.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:19:59.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:19:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:19:59 smithi044 bash[22676]: cluster 2024-09-21T00:19:57.665472+0000 mgr.a (mgr.14388) 5428 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:19:59 smithi179 bash[23186]: cluster 2024-09-21T00:19:57.665472+0000 mgr.a (mgr.14388) 5428 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:19:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:19:59 smithi049 bash[23528]: cluster 2024-09-21T00:19:57.665472+0000 mgr.a (mgr.14388) 5428 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:00.144 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:00.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:00.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:00.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:00.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:00 smithi044 bash[22676]: cluster 2024-09-21T00:20:00.000086+0000 mon.a (mon.0) 4903 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:20:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:00 smithi179 bash[23186]: cluster 2024-09-21T00:20:00.000086+0000 mon.a (mon.0) 4903 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:20:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:00 smithi049 bash[23528]: cluster 2024-09-21T00:20:00.000086+0000 mon.a (mon.0) 4903 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:20:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:01 smithi044 bash[22676]: cluster 2024-09-21T00:19:59.666016+0000 mgr.a (mgr.14388) 5429 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:01 smithi044 bash[22676]: audit 2024-09-21T00:19:59.703059+0000 mgr.a (mgr.14388) 5430 : audit [DBG] from='client.126546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:01 smithi179 bash[23186]: cluster 2024-09-21T00:19:59.666016+0000 mgr.a (mgr.14388) 5429 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:01 smithi179 bash[23186]: audit 2024-09-21T00:19:59.703059+0000 mgr.a (mgr.14388) 5430 : audit [DBG] from='client.126546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:01 smithi049 bash[23528]: cluster 2024-09-21T00:19:59.666016+0000 mgr.a (mgr.14388) 5429 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:01 smithi049 bash[23528]: audit 2024-09-21T00:19:59.703059+0000 mgr.a (mgr.14388) 5430 : audit [DBG] from='client.126546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:03 smithi044 bash[22676]: cluster 2024-09-21T00:20:01.668826+0000 mgr.a (mgr.14388) 5431 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:03 smithi179 bash[23186]: cluster 2024-09-21T00:20:01.668826+0000 mgr.a (mgr.14388) 5431 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:03 smithi049 bash[23528]: cluster 2024-09-21T00:20:01.668826+0000 mgr.a (mgr.14388) 5431 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:05.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:05.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:05.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:05 smithi044 bash[22676]: cluster 2024-09-21T00:20:03.669840+0000 mgr.a (mgr.14388) 5432 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:20:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:05 smithi179 bash[23186]: cluster 2024-09-21T00:20:03.669840+0000 mgr.a (mgr.14388) 5432 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:20:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:05 smithi049 bash[23528]: cluster 2024-09-21T00:20:03.669840+0000 mgr.a (mgr.14388) 5432 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:20:05.935 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:06 smithi044 bash[22676]: audit 2024-09-21T00:20:05.481478+0000 mgr.a (mgr.14388) 5433 : audit [DBG] from='client.126621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:06 smithi179 bash[23186]: audit 2024-09-21T00:20:05.481478+0000 mgr.a (mgr.14388) 5433 : audit [DBG] from='client.126621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:06.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:06 smithi049 bash[23528]: audit 2024-09-21T00:20:05.481478+0000 mgr.a (mgr.14388) 5433 : audit [DBG] from='client.126621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:07 smithi044 bash[22676]: cluster 2024-09-21T00:20:05.673105+0000 mgr.a (mgr.14388) 5434 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:07 smithi179 bash[23186]: cluster 2024-09-21T00:20:05.673105+0000 mgr.a (mgr.14388) 5434 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:07.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:07 smithi049 bash[23528]: cluster 2024-09-21T00:20:05.673105+0000 mgr.a (mgr.14388) 5434 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:09 smithi044 bash[22676]: cluster 2024-09-21T00:20:07.674048+0000 mgr.a (mgr.14388) 5435 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:09 smithi179 bash[23186]: cluster 2024-09-21T00:20:07.674048+0000 mgr.a (mgr.14388) 5435 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:09 smithi049 bash[23528]: cluster 2024-09-21T00:20:07.674048+0000 mgr.a (mgr.14388) 5435 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:10.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:10.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:10.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:11 smithi049 bash[23528]: cluster 2024-09-21T00:20:09.674853+0000 mgr.a (mgr.14388) 5436 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:11 smithi049 bash[23528]: audit 2024-09-21T00:20:10.967908+0000 mon.a (mon.0) 4904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:11 smithi049 bash[23528]: audit 2024-09-21T00:20:10.973892+0000 mon.a (mon.0) 4905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:11 smithi049 bash[23528]: audit 2024-09-21T00:20:10.981551+0000 mon.a (mon.0) 4906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:11 smithi044 bash[22676]: cluster 2024-09-21T00:20:09.674853+0000 mgr.a (mgr.14388) 5436 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:11 smithi044 bash[22676]: audit 2024-09-21T00:20:10.967908+0000 mon.a (mon.0) 4904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:11 smithi044 bash[22676]: audit 2024-09-21T00:20:10.973892+0000 mon.a (mon.0) 4905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:11 smithi044 bash[22676]: audit 2024-09-21T00:20:10.981551+0000 mon.a (mon.0) 4906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:11 smithi179 bash[23186]: cluster 2024-09-21T00:20:09.674853+0000 mgr.a (mgr.14388) 5436 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:11 smithi179 bash[23186]: audit 2024-09-21T00:20:10.967908+0000 mon.a (mon.0) 4904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:11 smithi179 bash[23186]: audit 2024-09-21T00:20:10.973892+0000 mon.a (mon.0) 4905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:11 smithi179 bash[23186]: audit 2024-09-21T00:20:10.981551+0000 mon.a (mon.0) 4906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:11.708 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:11.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:12 smithi044 bash[22676]: audit 2024-09-21T00:20:11.279420+0000 mgr.a (mgr.14388) 5437 : audit [DBG] from='client.126693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:12 smithi179 bash[23186]: audit 2024-09-21T00:20:11.279420+0000 mgr.a (mgr.14388) 5437 : audit [DBG] from='client.126693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:12 smithi049 bash[23528]: audit 2024-09-21T00:20:11.279420+0000 mgr.a (mgr.14388) 5437 : audit [DBG] from='client.126693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:13 smithi044 bash[22676]: cluster 2024-09-21T00:20:11.676349+0000 mgr.a (mgr.14388) 5438 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:13 smithi044 bash[22676]: audit 2024-09-21T00:20:12.338044+0000 mon.a (mon.0) 4907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:13 smithi044 bash[22676]: audit 2024-09-21T00:20:12.348602+0000 mon.a (mon.0) 4908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:13 smithi044 bash[22676]: audit 2024-09-21T00:20:12.361859+0000 mon.a (mon.0) 4909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:13 smithi179 bash[23186]: cluster 2024-09-21T00:20:11.676349+0000 mgr.a (mgr.14388) 5438 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:13 smithi179 bash[23186]: audit 2024-09-21T00:20:12.338044+0000 mon.a (mon.0) 4907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:13 smithi179 bash[23186]: audit 2024-09-21T00:20:12.348602+0000 mon.a (mon.0) 4908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:13 smithi179 bash[23186]: audit 2024-09-21T00:20:12.361859+0000 mon.a (mon.0) 4909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:13 smithi049 bash[23528]: cluster 2024-09-21T00:20:11.676349+0000 mgr.a (mgr.14388) 5438 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:13 smithi049 bash[23528]: audit 2024-09-21T00:20:12.338044+0000 mon.a (mon.0) 4907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:13 smithi049 bash[23528]: audit 2024-09-21T00:20:12.348602+0000 mon.a (mon.0) 4908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:13 smithi049 bash[23528]: audit 2024-09-21T00:20:12.361859+0000 mon.a (mon.0) 4909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:15 smithi049 bash[23528]: cluster 2024-09-21T00:20:13.677058+0000 mgr.a (mgr.14388) 5439 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:15.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:15 smithi049 bash[23528]: audit 2024-09-21T00:20:14.305732+0000 mon.a (mon.0) 4910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:15 smithi049 bash[23528]: audit 2024-09-21T00:20:14.311772+0000 mon.a (mon.0) 4911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:15 smithi049 bash[23528]: audit 2024-09-21T00:20:14.321329+0000 mon.a (mon.0) 4912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:15 smithi044 bash[22676]: cluster 2024-09-21T00:20:13.677058+0000 mgr.a (mgr.14388) 5439 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:15 smithi044 bash[22676]: audit 2024-09-21T00:20:14.305732+0000 mon.a (mon.0) 4910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:15 smithi044 bash[22676]: audit 2024-09-21T00:20:14.311772+0000 mon.a (mon.0) 4911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:15 smithi044 bash[22676]: audit 2024-09-21T00:20:14.321329+0000 mon.a (mon.0) 4912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:15 smithi179 bash[23186]: cluster 2024-09-21T00:20:13.677058+0000 mgr.a (mgr.14388) 5439 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:15 smithi179 bash[23186]: audit 2024-09-21T00:20:14.305732+0000 mon.a (mon.0) 4910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:15 smithi179 bash[23186]: audit 2024-09-21T00:20:14.311772+0000 mon.a (mon.0) 4911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:15 smithi179 bash[23186]: audit 2024-09-21T00:20:14.321329+0000 mon.a (mon.0) 4912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:16.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:16.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:16.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:17.479 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:17 smithi044 bash[22676]: cluster 2024-09-21T00:20:15.679086+0000 mgr.a (mgr.14388) 5440 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:17 smithi179 bash[23186]: cluster 2024-09-21T00:20:15.679086+0000 mgr.a (mgr.14388) 5440 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:17 smithi049 bash[23528]: cluster 2024-09-21T00:20:15.679086+0000 mgr.a (mgr.14388) 5440 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:18 smithi044 bash[22676]: audit 2024-09-21T00:20:17.042810+0000 mgr.a (mgr.14388) 5441 : audit [DBG] from='client.126771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:18 smithi179 bash[23186]: audit 2024-09-21T00:20:17.042810+0000 mgr.a (mgr.14388) 5441 : audit [DBG] from='client.126771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:18 smithi049 bash[23528]: audit 2024-09-21T00:20:17.042810+0000 mgr.a (mgr.14388) 5441 : audit [DBG] from='client.126771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:19 smithi044 bash[22676]: cluster 2024-09-21T00:20:17.680028+0000 mgr.a (mgr.14388) 5442 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:19 smithi179 bash[23186]: cluster 2024-09-21T00:20:17.680028+0000 mgr.a (mgr.14388) 5442 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:19 smithi049 bash[23528]: cluster 2024-09-21T00:20:17.680028+0000 mgr.a (mgr.14388) 5442 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:21 smithi044 bash[22676]: cluster 2024-09-21T00:20:19.680814+0000 mgr.a (mgr.14388) 5443 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:21 smithi179 bash[23186]: cluster 2024-09-21T00:20:19.680814+0000 mgr.a (mgr.14388) 5443 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:21 smithi049 bash[23528]: cluster 2024-09-21T00:20:19.680814+0000 mgr.a (mgr.14388) 5443 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:22.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:22.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:22.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:23.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:23.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:23.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:23.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:23.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:23 smithi044 bash[22676]: cluster 2024-09-21T00:20:21.683100+0000 mgr.a (mgr.14388) 5444 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:23 smithi179 bash[23186]: cluster 2024-09-21T00:20:21.683100+0000 mgr.a (mgr.14388) 5444 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:23.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:23 smithi049 bash[23528]: cluster 2024-09-21T00:20:21.683100+0000 mgr.a (mgr.14388) 5444 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:24 smithi044 bash[22676]: audit 2024-09-21T00:20:22.814985+0000 mgr.a (mgr.14388) 5445 : audit [DBG] from='client.126846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:24 smithi179 bash[23186]: audit 2024-09-21T00:20:22.814985+0000 mgr.a (mgr.14388) 5445 : audit [DBG] from='client.126846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:24 smithi049 bash[23528]: audit 2024-09-21T00:20:22.814985+0000 mgr.a (mgr.14388) 5445 : audit [DBG] from='client.126846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:25 smithi044 bash[22676]: cluster 2024-09-21T00:20:23.684067+0000 mgr.a (mgr.14388) 5446 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:25 smithi179 bash[23186]: cluster 2024-09-21T00:20:23.684067+0000 mgr.a (mgr.14388) 5446 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:25 smithi049 bash[23528]: cluster 2024-09-21T00:20:23.684067+0000 mgr.a (mgr.14388) 5446 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:27 smithi044 bash[22676]: cluster 2024-09-21T00:20:25.686297+0000 mgr.a (mgr.14388) 5447 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:27 smithi179 bash[23186]: cluster 2024-09-21T00:20:25.686297+0000 mgr.a (mgr.14388) 5447 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:27 smithi049 bash[23528]: cluster 2024-09-21T00:20:25.686297+0000 mgr.a (mgr.14388) 5447 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:28.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:28.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:28.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:29.031 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:29.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:29.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:29.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:29.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:29 smithi044 bash[22676]: cluster 2024-09-21T00:20:27.687093+0000 mgr.a (mgr.14388) 5448 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:29 smithi179 bash[23186]: cluster 2024-09-21T00:20:27.687093+0000 mgr.a (mgr.14388) 5448 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:29 smithi049 bash[23528]: cluster 2024-09-21T00:20:27.687093+0000 mgr.a (mgr.14388) 5448 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:30.463 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:30 smithi179 bash[23186]: audit 2024-09-21T00:20:28.580063+0000 mgr.a (mgr.14388) 5449 : audit [DBG] from='client.126921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:30 smithi044 bash[22676]: audit 2024-09-21T00:20:28.580063+0000 mgr.a (mgr.14388) 5449 : audit [DBG] from='client.126921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:30 smithi049 bash[23528]: audit 2024-09-21T00:20:28.580063+0000 mgr.a (mgr.14388) 5449 : audit [DBG] from='client.126921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:31 smithi049 bash[23528]: cluster 2024-09-21T00:20:29.688015+0000 mgr.a (mgr.14388) 5450 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:31 smithi049 bash[23528]: audit 2024-09-21T00:20:31.198900+0000 mon.a (mon.0) 4913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:31 smithi049 bash[23528]: audit 2024-09-21T00:20:31.207580+0000 mon.a (mon.0) 4914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:31 smithi049 bash[23528]: audit 2024-09-21T00:20:31.218839+0000 mon.a (mon.0) 4915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:31 smithi044 bash[22676]: cluster 2024-09-21T00:20:29.688015+0000 mgr.a (mgr.14388) 5450 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:31 smithi044 bash[22676]: audit 2024-09-21T00:20:31.198900+0000 mon.a (mon.0) 4913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:31 smithi044 bash[22676]: audit 2024-09-21T00:20:31.207580+0000 mon.a (mon.0) 4914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:31 smithi044 bash[22676]: audit 2024-09-21T00:20:31.218839+0000 mon.a (mon.0) 4915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:31 smithi179 bash[23186]: cluster 2024-09-21T00:20:29.688015+0000 mgr.a (mgr.14388) 5450 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:31 smithi179 bash[23186]: audit 2024-09-21T00:20:31.198900+0000 mon.a (mon.0) 4913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:31 smithi179 bash[23186]: audit 2024-09-21T00:20:31.207580+0000 mon.a (mon.0) 4914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:31 smithi179 bash[23186]: audit 2024-09-21T00:20:31.218839+0000 mon.a (mon.0) 4915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:33 smithi049 bash[23528]: cluster 2024-09-21T00:20:31.690305+0000 mgr.a (mgr.14388) 5451 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:33 smithi049 bash[23528]: audit 2024-09-21T00:20:32.512258+0000 mon.a (mon.0) 4916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:33 smithi049 bash[23528]: audit 2024-09-21T00:20:32.520108+0000 mon.a (mon.0) 4917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:33 smithi049 bash[23528]: audit 2024-09-21T00:20:32.529738+0000 mon.a (mon.0) 4918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:33.923 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:33 smithi044 bash[22676]: cluster 2024-09-21T00:20:31.690305+0000 mgr.a (mgr.14388) 5451 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:33.923 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:33 smithi044 bash[22676]: audit 2024-09-21T00:20:32.512258+0000 mon.a (mon.0) 4916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:33.923 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:33 smithi044 bash[22676]: audit 2024-09-21T00:20:32.520108+0000 mon.a (mon.0) 4917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:33.923 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:33 smithi044 bash[22676]: audit 2024-09-21T00:20:32.529738+0000 mon.a (mon.0) 4918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:33 smithi179 bash[23186]: cluster 2024-09-21T00:20:31.690305+0000 mgr.a (mgr.14388) 5451 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:33 smithi179 bash[23186]: audit 2024-09-21T00:20:32.512258+0000 mon.a (mon.0) 4916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:33 smithi179 bash[23186]: audit 2024-09-21T00:20:32.520108+0000 mon.a (mon.0) 4917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:33 smithi179 bash[23186]: audit 2024-09-21T00:20:32.529738+0000 mon.a (mon.0) 4918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:34.783 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:34.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:34.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:34.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:34.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:35.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:35 smithi044 bash[22676]: cluster 2024-09-21T00:20:33.691057+0000 mgr.a (mgr.14388) 5452 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:35.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:35 smithi044 bash[22676]: audit 2024-09-21T00:20:34.355677+0000 mgr.a (mgr.14388) 5453 : audit [DBG] from='client.126999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:35.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:35 smithi044 bash[22676]: audit 2024-09-21T00:20:34.473047+0000 mon.a (mon.0) 4919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:35 smithi044 bash[22676]: audit 2024-09-21T00:20:34.479170+0000 mon.a (mon.0) 4920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:35 smithi044 bash[22676]: audit 2024-09-21T00:20:34.497520+0000 mon.a (mon.0) 4921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:35 smithi179 bash[23186]: cluster 2024-09-21T00:20:33.691057+0000 mgr.a (mgr.14388) 5452 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:35 smithi179 bash[23186]: audit 2024-09-21T00:20:34.355677+0000 mgr.a (mgr.14388) 5453 : audit [DBG] from='client.126999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:35 smithi179 bash[23186]: audit 2024-09-21T00:20:34.473047+0000 mon.a (mon.0) 4919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:35 smithi179 bash[23186]: audit 2024-09-21T00:20:34.479170+0000 mon.a (mon.0) 4920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:35 smithi179 bash[23186]: audit 2024-09-21T00:20:34.497520+0000 mon.a (mon.0) 4921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:35 smithi049 bash[23528]: cluster 2024-09-21T00:20:33.691057+0000 mgr.a (mgr.14388) 5452 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:35 smithi049 bash[23528]: audit 2024-09-21T00:20:34.355677+0000 mgr.a (mgr.14388) 5453 : audit [DBG] from='client.126999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:35 smithi049 bash[23528]: audit 2024-09-21T00:20:34.473047+0000 mon.a (mon.0) 4919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:35 smithi049 bash[23528]: audit 2024-09-21T00:20:34.479170+0000 mon.a (mon.0) 4920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:35 smithi049 bash[23528]: audit 2024-09-21T00:20:34.497520+0000 mon.a (mon.0) 4921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:37 smithi044 bash[22676]: cluster 2024-09-21T00:20:35.694252+0000 mgr.a (mgr.14388) 5454 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:37 smithi179 bash[23186]: cluster 2024-09-21T00:20:35.694252+0000 mgr.a (mgr.14388) 5454 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:37.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:37 smithi049 bash[23528]: cluster 2024-09-21T00:20:35.694252+0000 mgr.a (mgr.14388) 5454 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:20:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:39 smithi044 bash[22676]: cluster 2024-09-21T00:20:37.695087+0000 mgr.a (mgr.14388) 5455 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:39 smithi179 bash[23186]: cluster 2024-09-21T00:20:37.695087+0000 mgr.a (mgr.14388) 5455 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:39.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:39.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:39.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:39 smithi049 bash[23528]: cluster 2024-09-21T00:20:37.695087+0000 mgr.a (mgr.14388) 5455 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:40.589 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:40.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:40.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:40.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:40.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:41 smithi044 bash[22676]: cluster 2024-09-21T00:20:39.695856+0000 mgr.a (mgr.14388) 5456 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:41 smithi044 bash[22676]: audit 2024-09-21T00:20:40.127004+0000 mgr.a (mgr.14388) 5457 : audit [DBG] from='client.127077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:41 smithi179 bash[23186]: cluster 2024-09-21T00:20:39.695856+0000 mgr.a (mgr.14388) 5456 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:41 smithi179 bash[23186]: audit 2024-09-21T00:20:40.127004+0000 mgr.a (mgr.14388) 5457 : audit [DBG] from='client.127077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:41.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:41 smithi049 bash[23528]: cluster 2024-09-21T00:20:39.695856+0000 mgr.a (mgr.14388) 5456 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:41.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:41 smithi049 bash[23528]: audit 2024-09-21T00:20:40.127004+0000 mgr.a (mgr.14388) 5457 : audit [DBG] from='client.127077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:43 smithi179 bash[23186]: cluster 2024-09-21T00:20:41.698636+0000 mgr.a (mgr.14388) 5458 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:43.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:43 smithi049 bash[23528]: cluster 2024-09-21T00:20:41.698636+0000 mgr.a (mgr.14388) 5458 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:43 smithi044 bash[22676]: cluster 2024-09-21T00:20:41.698636+0000 mgr.a (mgr.14388) 5458 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:45.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:45.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:45.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:45 smithi179 bash[23186]: cluster 2024-09-21T00:20:43.699426+0000 mgr.a (mgr.14388) 5459 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:45 smithi049 bash[23528]: cluster 2024-09-21T00:20:43.699426+0000 mgr.a (mgr.14388) 5459 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:45 smithi044 bash[22676]: cluster 2024-09-21T00:20:43.699426+0000 mgr.a (mgr.14388) 5459 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:46.340 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:46.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:47 smithi179 bash[23186]: cluster 2024-09-21T00:20:45.700568+0000 mgr.a (mgr.14388) 5460 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:47 smithi179 bash[23186]: audit 2024-09-21T00:20:45.921937+0000 mgr.a (mgr.14388) 5461 : audit [DBG] from='client.127155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:47 smithi049 bash[23528]: cluster 2024-09-21T00:20:45.700568+0000 mgr.a (mgr.14388) 5460 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:47 smithi049 bash[23528]: audit 2024-09-21T00:20:45.921937+0000 mgr.a (mgr.14388) 5461 : audit [DBG] from='client.127155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:47 smithi044 bash[22676]: cluster 2024-09-21T00:20:45.700568+0000 mgr.a (mgr.14388) 5460 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:47 smithi044 bash[22676]: audit 2024-09-21T00:20:45.921937+0000 mgr.a (mgr.14388) 5461 : audit [DBG] from='client.127155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:49 smithi049 bash[23528]: cluster 2024-09-21T00:20:47.701444+0000 mgr.a (mgr.14388) 5462 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:49 smithi044 bash[22676]: cluster 2024-09-21T00:20:47.701444+0000 mgr.a (mgr.14388) 5462 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:49 smithi179 bash[23186]: cluster 2024-09-21T00:20:47.701444+0000 mgr.a (mgr.14388) 5462 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:20:51.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:51.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:51.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:51.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:51 smithi179 bash[23186]: cluster 2024-09-21T00:20:49.702246+0000 mgr.a (mgr.14388) 5463 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:20:51.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:51 smithi179 bash[23186]: audit 2024-09-21T00:20:51.423515+0000 mon.a (mon.0) 4922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:51 smithi179 bash[23186]: audit 2024-09-21T00:20:51.432286+0000 mon.a (mon.0) 4923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:51 smithi179 bash[23186]: audit 2024-09-21T00:20:51.440603+0000 mon.a (mon.0) 4924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:51 smithi049 bash[23528]: cluster 2024-09-21T00:20:49.702246+0000 mgr.a (mgr.14388) 5463 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:20:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:51 smithi049 bash[23528]: audit 2024-09-21T00:20:51.423515+0000 mon.a (mon.0) 4922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:51 smithi049 bash[23528]: audit 2024-09-21T00:20:51.432286+0000 mon.a (mon.0) 4923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:51 smithi049 bash[23528]: audit 2024-09-21T00:20:51.440603+0000 mon.a (mon.0) 4924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:51 smithi044 bash[22676]: cluster 2024-09-21T00:20:49.702246+0000 mgr.a (mgr.14388) 5463 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:20:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:51 smithi044 bash[22676]: audit 2024-09-21T00:20:51.423515+0000 mon.a (mon.0) 4922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:51 smithi044 bash[22676]: audit 2024-09-21T00:20:51.432286+0000 mon.a (mon.0) 4923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:51 smithi044 bash[22676]: audit 2024-09-21T00:20:51.440603+0000 mon.a (mon.0) 4924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:52.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:52.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:52.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:52.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:52.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:53 smithi049 bash[23528]: audit 2024-09-21T00:20:51.681145+0000 mgr.a (mgr.14388) 5464 : audit [DBG] from='client.127233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:53 smithi049 bash[23528]: cluster 2024-09-21T00:20:51.706144+0000 mgr.a (mgr.14388) 5465 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:53 smithi049 bash[23528]: audit 2024-09-21T00:20:52.683084+0000 mon.a (mon.0) 4925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:53 smithi049 bash[23528]: audit 2024-09-21T00:20:52.691606+0000 mon.a (mon.0) 4926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:53.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:53 smithi049 bash[23528]: audit 2024-09-21T00:20:52.702697+0000 mon.a (mon.0) 4927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:53.952 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:53 smithi044 bash[22676]: audit 2024-09-21T00:20:51.681145+0000 mgr.a (mgr.14388) 5464 : audit [DBG] from='client.127233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:53.952 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:53 smithi044 bash[22676]: cluster 2024-09-21T00:20:51.706144+0000 mgr.a (mgr.14388) 5465 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:53.952 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:53 smithi044 bash[22676]: audit 2024-09-21T00:20:52.683084+0000 mon.a (mon.0) 4925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:53.952 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:53 smithi044 bash[22676]: audit 2024-09-21T00:20:52.691606+0000 mon.a (mon.0) 4926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:53.953 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:53 smithi044 bash[22676]: audit 2024-09-21T00:20:52.702697+0000 mon.a (mon.0) 4927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:53 smithi179 bash[23186]: audit 2024-09-21T00:20:51.681145+0000 mgr.a (mgr.14388) 5464 : audit [DBG] from='client.127233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:53 smithi179 bash[23186]: cluster 2024-09-21T00:20:51.706144+0000 mgr.a (mgr.14388) 5465 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:53 smithi179 bash[23186]: audit 2024-09-21T00:20:52.683084+0000 mon.a (mon.0) 4925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:53 smithi179 bash[23186]: audit 2024-09-21T00:20:52.691606+0000 mon.a (mon.0) 4926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:53 smithi179 bash[23186]: audit 2024-09-21T00:20:52.702697+0000 mon.a (mon.0) 4927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:54.647 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:54 smithi049 bash[23528]: audit 2024-09-21T00:20:53.698536+0000 mon.a (mon.0) 4928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:20:54.647 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:54 smithi049 bash[23528]: audit 2024-09-21T00:20:53.704678+0000 mon.a (mon.0) 4929 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:20:54.647 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:54 smithi049 bash[23528]: audit 2024-09-21T00:20:53.706580+0000 mon.a (mon.0) 4930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:20:54.647 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:54 smithi049 bash[23528]: audit 2024-09-21T00:20:53.718777+0000 mon.a (mon.0) 4931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:54.647 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:54 smithi049 bash[23528]: audit 2024-09-21T00:20:53.724988+0000 mon.a (mon.0) 4932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:20:54.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:20:54 smithi044 bash[22930]: debug 2024-09-21T00:20:54.470+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:20:54.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:20:54 smithi044 bash[22930]: debug 2024-09-21T00:20:54.474+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:20:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:54 smithi044 bash[22676]: audit 2024-09-21T00:20:53.698536+0000 mon.a (mon.0) 4928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:20:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:54 smithi044 bash[22676]: audit 2024-09-21T00:20:53.704678+0000 mon.a (mon.0) 4929 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:20:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:54 smithi044 bash[22676]: audit 2024-09-21T00:20:53.706580+0000 mon.a (mon.0) 4930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:20:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:54 smithi044 bash[22676]: audit 2024-09-21T00:20:53.718777+0000 mon.a (mon.0) 4931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:54 smithi044 bash[22676]: audit 2024-09-21T00:20:53.724988+0000 mon.a (mon.0) 4932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:20:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:54 smithi179 bash[23186]: audit 2024-09-21T00:20:53.698536+0000 mon.a (mon.0) 4928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:20:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:54 smithi179 bash[23186]: audit 2024-09-21T00:20:53.704678+0000 mon.a (mon.0) 4929 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:20:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:54 smithi179 bash[23186]: audit 2024-09-21T00:20:53.706580+0000 mon.a (mon.0) 4930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:20:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:54 smithi179 bash[23186]: audit 2024-09-21T00:20:53.718777+0000 mon.a (mon.0) 4931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:54 smithi179 bash[23186]: audit 2024-09-21T00:20:53.724988+0000 mon.a (mon.0) 4932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:20:55.688 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:55 smithi044 bash[22676]: cluster 2024-09-21T00:20:53.707009+0000 mgr.a (mgr.14388) 5466 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:55.688 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:55 smithi044 bash[22676]: audit 2024-09-21T00:20:53.727526+0000 mgr.a (mgr.14388) 5467 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:20:55.688 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:55 smithi044 bash[22676]: audit 2024-09-21T00:20:54.477205+0000 mgr.a (mgr.14388) 5468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:20:55.688 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:55 smithi044 bash[22676]: cephadm 2024-09-21T00:20:54.478392+0000 mgr.a (mgr.14388) 5469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:20:55.688 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:55 smithi044 bash[22676]: audit 2024-09-21T00:20:54.598515+0000 mon.a (mon.0) 4933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:55.688 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:55 smithi044 bash[22676]: audit 2024-09-21T00:20:54.602749+0000 mon.a (mon.0) 4934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:55.689 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:55 smithi044 bash[22676]: audit 2024-09-21T00:20:54.609567+0000 mon.a (mon.0) 4935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:55 smithi049 bash[23528]: cluster 2024-09-21T00:20:53.707009+0000 mgr.a (mgr.14388) 5466 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:55 smithi049 bash[23528]: audit 2024-09-21T00:20:53.727526+0000 mgr.a (mgr.14388) 5467 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:20:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:55 smithi049 bash[23528]: audit 2024-09-21T00:20:54.477205+0000 mgr.a (mgr.14388) 5468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:20:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:55 smithi049 bash[23528]: cephadm 2024-09-21T00:20:54.478392+0000 mgr.a (mgr.14388) 5469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:20:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:55 smithi049 bash[23528]: audit 2024-09-21T00:20:54.598515+0000 mon.a (mon.0) 4933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:55 smithi049 bash[23528]: audit 2024-09-21T00:20:54.602749+0000 mon.a (mon.0) 4934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:55 smithi049 bash[23528]: audit 2024-09-21T00:20:54.609567+0000 mon.a (mon.0) 4935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:55 smithi179 bash[23186]: cluster 2024-09-21T00:20:53.707009+0000 mgr.a (mgr.14388) 5466 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:20:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:55 smithi179 bash[23186]: audit 2024-09-21T00:20:53.727526+0000 mgr.a (mgr.14388) 5467 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:20:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:55 smithi179 bash[23186]: audit 2024-09-21T00:20:54.477205+0000 mgr.a (mgr.14388) 5468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:20:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:55 smithi179 bash[23186]: cephadm 2024-09-21T00:20:54.478392+0000 mgr.a (mgr.14388) 5469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:20:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:55 smithi179 bash[23186]: audit 2024-09-21T00:20:54.598515+0000 mon.a (mon.0) 4933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:55 smithi179 bash[23186]: audit 2024-09-21T00:20:54.602749+0000 mon.a (mon.0) 4934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:55 smithi179 bash[23186]: audit 2024-09-21T00:20:54.609567+0000 mon.a (mon.0) 4935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:20:57.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:20:57.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:20:57.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:20:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:57 smithi049 bash[23528]: cluster 2024-09-21T00:20:55.709476+0000 mgr.a (mgr.14388) 5470 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:57.911 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:20:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:20:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:20:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:20:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:20:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:57 smithi044 bash[22676]: cluster 2024-09-21T00:20:55.709476+0000 mgr.a (mgr.14388) 5470 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:57 smithi179 bash[23186]: cluster 2024-09-21T00:20:55.709476+0000 mgr.a (mgr.14388) 5470 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:58 smithi049 bash[23528]: audit 2024-09-21T00:20:57.467253+0000 mgr.a (mgr.14388) 5471 : audit [DBG] from='client.127416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:58 smithi044 bash[22676]: audit 2024-09-21T00:20:57.467253+0000 mgr.a (mgr.14388) 5471 : audit [DBG] from='client.127416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:58 smithi179 bash[23186]: audit 2024-09-21T00:20:57.467253+0000 mgr.a (mgr.14388) 5471 : audit [DBG] from='client.127416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:20:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:20:59 smithi049 bash[23528]: cluster 2024-09-21T00:20:57.715341+0000 mgr.a (mgr.14388) 5472 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:20:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:20:59 smithi044 bash[22676]: cluster 2024-09-21T00:20:57.715341+0000 mgr.a (mgr.14388) 5472 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:20:59 smithi179 bash[23186]: cluster 2024-09-21T00:20:57.715341+0000 mgr.a (mgr.14388) 5472 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:01 smithi049 bash[23528]: cluster 2024-09-21T00:20:59.716236+0000 mgr.a (mgr.14388) 5473 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:01 smithi044 bash[22676]: cluster 2024-09-21T00:20:59.716236+0000 mgr.a (mgr.14388) 5473 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:01 smithi179 bash[23186]: cluster 2024-09-21T00:20:59.716236+0000 mgr.a (mgr.14388) 5473 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:02.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:02.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:03.704 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:03.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:03.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:03.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:03.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:03 smithi044 bash[22676]: cluster 2024-09-21T00:21:01.718504+0000 mgr.a (mgr.14388) 5474 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:03 smithi179 bash[23186]: cluster 2024-09-21T00:21:01.718504+0000 mgr.a (mgr.14388) 5474 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:04.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:03 smithi049 bash[23528]: cluster 2024-09-21T00:21:01.718504+0000 mgr.a (mgr.14388) 5474 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:04 smithi044 bash[22676]: audit 2024-09-21T00:21:03.250156+0000 mgr.a (mgr.14388) 5475 : audit [DBG] from='client.127494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:04 smithi179 bash[23186]: audit 2024-09-21T00:21:03.250156+0000 mgr.a (mgr.14388) 5475 : audit [DBG] from='client.127494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:04 smithi049 bash[23528]: audit 2024-09-21T00:21:03.250156+0000 mgr.a (mgr.14388) 5475 : audit [DBG] from='client.127494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:05 smithi044 bash[22676]: cluster 2024-09-21T00:21:03.719170+0000 mgr.a (mgr.14388) 5476 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:05 smithi179 bash[23186]: cluster 2024-09-21T00:21:03.719170+0000 mgr.a (mgr.14388) 5476 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:05 smithi049 bash[23528]: cluster 2024-09-21T00:21:03.719170+0000 mgr.a (mgr.14388) 5476 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:06 smithi044 bash[22676]: cluster 2024-09-21T00:21:05.721356+0000 mgr.a (mgr.14388) 5477 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:06 smithi179 bash[23186]: cluster 2024-09-21T00:21:05.721356+0000 mgr.a (mgr.14388) 5477 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:06 smithi049 bash[23528]: cluster 2024-09-21T00:21:05.721356+0000 mgr.a (mgr.14388) 5477 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:21:08.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:08.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:08.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:08 smithi049 bash[23528]: cluster 2024-09-21T00:21:07.722135+0000 mgr.a (mgr.14388) 5478 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:08 smithi044 bash[22676]: cluster 2024-09-21T00:21:07.722135+0000 mgr.a (mgr.14388) 5478 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:08 smithi179 bash[23186]: cluster 2024-09-21T00:21:07.722135+0000 mgr.a (mgr.14388) 5478 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:09.481 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:09.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:09 smithi049 bash[23528]: audit 2024-09-21T00:21:09.041220+0000 mgr.a (mgr.14388) 5479 : audit [DBG] from='client.127569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:10.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:09 smithi179 bash[23186]: audit 2024-09-21T00:21:09.041220+0000 mgr.a (mgr.14388) 5479 : audit [DBG] from='client.127569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:09 smithi044 bash[22676]: audit 2024-09-21T00:21:09.041220+0000 mgr.a (mgr.14388) 5479 : audit [DBG] from='client.127569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:11.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:10 smithi179 bash[23186]: cluster 2024-09-21T00:21:09.723009+0000 mgr.a (mgr.14388) 5480 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:10 smithi049 bash[23528]: cluster 2024-09-21T00:21:09.723009+0000 mgr.a (mgr.14388) 5480 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:10 smithi044 bash[22676]: cluster 2024-09-21T00:21:09.723009+0000 mgr.a (mgr.14388) 5480 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:12 smithi044 bash[22676]: audit 2024-09-21T00:21:11.654548+0000 mon.a (mon.0) 4936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:12 smithi044 bash[22676]: audit 2024-09-21T00:21:11.663434+0000 mon.a (mon.0) 4937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:12 smithi044 bash[22676]: audit 2024-09-21T00:21:11.673921+0000 mon.a (mon.0) 4938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:12 smithi044 bash[22676]: cluster 2024-09-21T00:21:11.725385+0000 mgr.a (mgr.14388) 5481 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:12 smithi179 bash[23186]: audit 2024-09-21T00:21:11.654548+0000 mon.a (mon.0) 4936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:12 smithi179 bash[23186]: audit 2024-09-21T00:21:11.663434+0000 mon.a (mon.0) 4937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:12 smithi179 bash[23186]: audit 2024-09-21T00:21:11.673921+0000 mon.a (mon.0) 4938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:12 smithi179 bash[23186]: cluster 2024-09-21T00:21:11.725385+0000 mgr.a (mgr.14388) 5481 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:12 smithi049 bash[23528]: audit 2024-09-21T00:21:11.654548+0000 mon.a (mon.0) 4936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:12 smithi049 bash[23528]: audit 2024-09-21T00:21:11.663434+0000 mon.a (mon.0) 4937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:12 smithi049 bash[23528]: audit 2024-09-21T00:21:11.673921+0000 mon.a (mon.0) 4938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:12 smithi049 bash[23528]: cluster 2024-09-21T00:21:11.725385+0000 mgr.a (mgr.14388) 5481 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:14.207 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:13 smithi044 bash[22676]: audit 2024-09-21T00:21:12.880060+0000 mon.a (mon.0) 4939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.207 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:13 smithi044 bash[22676]: audit 2024-09-21T00:21:12.888871+0000 mon.a (mon.0) 4940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.207 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:13 smithi044 bash[22676]: audit 2024-09-21T00:21:12.899217+0000 mon.a (mon.0) 4941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:13 smithi179 bash[23186]: audit 2024-09-21T00:21:12.880060+0000 mon.a (mon.0) 4939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:13 smithi179 bash[23186]: audit 2024-09-21T00:21:12.888871+0000 mon.a (mon.0) 4940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:13 smithi179 bash[23186]: audit 2024-09-21T00:21:12.899217+0000 mon.a (mon.0) 4941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:13 smithi049 bash[23528]: audit 2024-09-21T00:21:12.880060+0000 mon.a (mon.0) 4939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:13 smithi049 bash[23528]: audit 2024-09-21T00:21:12.888871+0000 mon.a (mon.0) 4940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:13 smithi049 bash[23528]: audit 2024-09-21T00:21:12.899217+0000 mon.a (mon.0) 4941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:15.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:14 smithi044 bash[22676]: cluster 2024-09-21T00:21:13.726123+0000 mgr.a (mgr.14388) 5482 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:15.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:14 smithi044 bash[22676]: audit 2024-09-21T00:21:14.746024+0000 mon.a (mon.0) 4942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:14 smithi044 bash[22676]: audit 2024-09-21T00:21:14.751471+0000 mon.a (mon.0) 4943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:14 smithi044 bash[22676]: audit 2024-09-21T00:21:14.758180+0000 mon.a (mon.0) 4944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.179 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:14 smithi049 bash[23528]: cluster 2024-09-21T00:21:13.726123+0000 mgr.a (mgr.14388) 5482 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:15.179 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:14 smithi049 bash[23528]: audit 2024-09-21T00:21:14.746024+0000 mon.a (mon.0) 4942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.179 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:14 smithi049 bash[23528]: audit 2024-09-21T00:21:14.751471+0000 mon.a (mon.0) 4943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.179 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:14 smithi049 bash[23528]: audit 2024-09-21T00:21:14.758180+0000 mon.a (mon.0) 4944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:14 smithi179 bash[23186]: cluster 2024-09-21T00:21:13.726123+0000 mgr.a (mgr.14388) 5482 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:14 smithi179 bash[23186]: audit 2024-09-21T00:21:14.746024+0000 mon.a (mon.0) 4942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:14 smithi179 bash[23186]: audit 2024-09-21T00:21:14.751471+0000 mon.a (mon.0) 4943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:14 smithi179 bash[23186]: audit 2024-09-21T00:21:14.758180+0000 mon.a (mon.0) 4944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:15.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:15.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:15 smithi049 bash[23528]: audit 2024-09-21T00:21:14.818463+0000 mgr.a (mgr.14388) 5483 : audit [DBG] from='client.127644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:15 smithi044 bash[22676]: audit 2024-09-21T00:21:14.818463+0000 mgr.a (mgr.14388) 5483 : audit [DBG] from='client.127644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:15 smithi179 bash[23186]: audit 2024-09-21T00:21:14.818463+0000 mgr.a (mgr.14388) 5483 : audit [DBG] from='client.127644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:16 smithi049 bash[23528]: cluster 2024-09-21T00:21:15.728872+0000 mgr.a (mgr.14388) 5484 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:16 smithi044 bash[22676]: cluster 2024-09-21T00:21:15.728872+0000 mgr.a (mgr.14388) 5484 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:16 smithi179 bash[23186]: cluster 2024-09-21T00:21:15.728872+0000 mgr.a (mgr.14388) 5484 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:18 smithi044 bash[22676]: cluster 2024-09-21T00:21:17.729709+0000 mgr.a (mgr.14388) 5485 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:21:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:18 smithi179 bash[23186]: cluster 2024-09-21T00:21:17.729709+0000 mgr.a (mgr.14388) 5485 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:21:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:18 smithi049 bash[23528]: cluster 2024-09-21T00:21:17.729709+0000 mgr.a (mgr.14388) 5485 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:21:20.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:20.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:20.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:21.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:20 smithi044 bash[22676]: cluster 2024-09-21T00:21:19.730445+0000 mgr.a (mgr.14388) 5486 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:21:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:20 smithi179 bash[23186]: cluster 2024-09-21T00:21:19.730445+0000 mgr.a (mgr.14388) 5486 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:21:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:20 smithi049 bash[23528]: cluster 2024-09-21T00:21:19.730445+0000 mgr.a (mgr.14388) 5486 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:21:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:21 smithi044 bash[22676]: audit 2024-09-21T00:21:20.593465+0000 mgr.a (mgr.14388) 5487 : audit [DBG] from='client.127722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:22.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:21 smithi179 bash[23186]: audit 2024-09-21T00:21:20.593465+0000 mgr.a (mgr.14388) 5487 : audit [DBG] from='client.127722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:22.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:21 smithi049 bash[23528]: audit 2024-09-21T00:21:20.593465+0000 mgr.a (mgr.14388) 5487 : audit [DBG] from='client.127722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:22 smithi044 bash[22676]: cluster 2024-09-21T00:21:21.733226+0000 mgr.a (mgr.14388) 5488 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:22 smithi179 bash[23186]: cluster 2024-09-21T00:21:21.733226+0000 mgr.a (mgr.14388) 5488 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:22 smithi049 bash[23528]: cluster 2024-09-21T00:21:21.733226+0000 mgr.a (mgr.14388) 5488 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:24 smithi044 bash[22676]: cluster 2024-09-21T00:21:23.734023+0000 mgr.a (mgr.14388) 5489 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:21:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:24 smithi179 bash[23186]: cluster 2024-09-21T00:21:23.734023+0000 mgr.a (mgr.14388) 5489 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:21:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:24 smithi049 bash[23528]: cluster 2024-09-21T00:21:23.734023+0000 mgr.a (mgr.14388) 5489 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:21:26.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:26.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:26.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:26.815 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:26.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:26 smithi044 bash[22676]: cluster 2024-09-21T00:21:25.736034+0000 mgr.a (mgr.14388) 5490 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:26 smithi044 bash[22676]: audit 2024-09-21T00:21:26.364976+0000 mgr.a (mgr.14388) 5491 : audit [DBG] from='client.127797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:26 smithi179 bash[23186]: cluster 2024-09-21T00:21:25.736034+0000 mgr.a (mgr.14388) 5490 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:26 smithi179 bash[23186]: audit 2024-09-21T00:21:26.364976+0000 mgr.a (mgr.14388) 5491 : audit [DBG] from='client.127797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:26 smithi049 bash[23528]: cluster 2024-09-21T00:21:25.736034+0000 mgr.a (mgr.14388) 5490 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:26 smithi049 bash[23528]: audit 2024-09-21T00:21:26.364976+0000 mgr.a (mgr.14388) 5491 : audit [DBG] from='client.127797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:28 smithi044 bash[22676]: cluster 2024-09-21T00:21:27.736928+0000 mgr.a (mgr.14388) 5492 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:28 smithi179 bash[23186]: cluster 2024-09-21T00:21:27.736928+0000 mgr.a (mgr.14388) 5492 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:28 smithi049 bash[23528]: cluster 2024-09-21T00:21:27.736928+0000 mgr.a (mgr.14388) 5492 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:30 smithi044 bash[22676]: cluster 2024-09-21T00:21:29.737730+0000 mgr.a (mgr.14388) 5493 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:31.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:30 smithi179 bash[23186]: cluster 2024-09-21T00:21:29.737730+0000 mgr.a (mgr.14388) 5493 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:30 smithi049 bash[23528]: cluster 2024-09-21T00:21:29.737730+0000 mgr.a (mgr.14388) 5493 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:31.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:32 smithi044 bash[22676]: cluster 2024-09-21T00:21:31.739929+0000 mgr.a (mgr.14388) 5494 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:32 smithi044 bash[22676]: audit 2024-09-21T00:21:31.877164+0000 mon.a (mon.0) 4945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:32 smithi044 bash[22676]: audit 2024-09-21T00:21:31.887603+0000 mon.a (mon.0) 4946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:32 smithi044 bash[22676]: audit 2024-09-21T00:21:31.898345+0000 mon.a (mon.0) 4947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:32 smithi044 bash[22676]: audit 2024-09-21T00:21:32.163356+0000 mgr.a (mgr.14388) 5495 : audit [DBG] from='client.127869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:32 smithi179 bash[23186]: cluster 2024-09-21T00:21:31.739929+0000 mgr.a (mgr.14388) 5494 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:32 smithi179 bash[23186]: audit 2024-09-21T00:21:31.877164+0000 mon.a (mon.0) 4945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:32 smithi179 bash[23186]: audit 2024-09-21T00:21:31.887603+0000 mon.a (mon.0) 4946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:32 smithi179 bash[23186]: audit 2024-09-21T00:21:31.898345+0000 mon.a (mon.0) 4947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:32 smithi179 bash[23186]: audit 2024-09-21T00:21:32.163356+0000 mgr.a (mgr.14388) 5495 : audit [DBG] from='client.127869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:32 smithi049 bash[23528]: cluster 2024-09-21T00:21:31.739929+0000 mgr.a (mgr.14388) 5494 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:32 smithi049 bash[23528]: audit 2024-09-21T00:21:31.877164+0000 mon.a (mon.0) 4945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:32 smithi049 bash[23528]: audit 2024-09-21T00:21:31.887603+0000 mon.a (mon.0) 4946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:32 smithi049 bash[23528]: audit 2024-09-21T00:21:31.898345+0000 mon.a (mon.0) 4947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:32 smithi049 bash[23528]: audit 2024-09-21T00:21:32.163356+0000 mgr.a (mgr.14388) 5495 : audit [DBG] from='client.127869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:34.329 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:34 smithi044 bash[22676]: audit 2024-09-21T00:21:33.064982+0000 mon.a (mon.0) 4948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.329 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:34 smithi044 bash[22676]: audit 2024-09-21T00:21:33.073596+0000 mon.a (mon.0) 4949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.329 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:34 smithi044 bash[22676]: audit 2024-09-21T00:21:33.084336+0000 mon.a (mon.0) 4950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:34 smithi179 bash[23186]: audit 2024-09-21T00:21:33.064982+0000 mon.a (mon.0) 4948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:34 smithi179 bash[23186]: audit 2024-09-21T00:21:33.073596+0000 mon.a (mon.0) 4949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:34 smithi179 bash[23186]: audit 2024-09-21T00:21:33.084336+0000 mon.a (mon.0) 4950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:34 smithi049 bash[23528]: audit 2024-09-21T00:21:33.064982+0000 mon.a (mon.0) 4948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:34 smithi049 bash[23528]: audit 2024-09-21T00:21:33.073596+0000 mon.a (mon.0) 4949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:34 smithi049 bash[23528]: audit 2024-09-21T00:21:33.084336+0000 mon.a (mon.0) 4950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:35 smithi049 bash[23528]: cluster 2024-09-21T00:21:33.740813+0000 mgr.a (mgr.14388) 5496 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:35.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:35 smithi049 bash[23528]: audit 2024-09-21T00:21:34.977078+0000 mon.a (mon.0) 4951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:35 smithi049 bash[23528]: audit 2024-09-21T00:21:34.983181+0000 mon.a (mon.0) 4952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:35 smithi049 bash[23528]: audit 2024-09-21T00:21:34.993636+0000 mon.a (mon.0) 4953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:35 smithi044 bash[22676]: cluster 2024-09-21T00:21:33.740813+0000 mgr.a (mgr.14388) 5496 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:35 smithi044 bash[22676]: audit 2024-09-21T00:21:34.977078+0000 mon.a (mon.0) 4951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:35 smithi044 bash[22676]: audit 2024-09-21T00:21:34.983181+0000 mon.a (mon.0) 4952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:35 smithi044 bash[22676]: audit 2024-09-21T00:21:34.993636+0000 mon.a (mon.0) 4953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:35 smithi179 bash[23186]: cluster 2024-09-21T00:21:33.740813+0000 mgr.a (mgr.14388) 5496 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:35 smithi179 bash[23186]: audit 2024-09-21T00:21:34.977078+0000 mon.a (mon.0) 4951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:35 smithi179 bash[23186]: audit 2024-09-21T00:21:34.983181+0000 mon.a (mon.0) 4952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:35 smithi179 bash[23186]: audit 2024-09-21T00:21:34.993636+0000 mon.a (mon.0) 4953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:37 smithi044 bash[22676]: cluster 2024-09-21T00:21:35.743125+0000 mgr.a (mgr.14388) 5497 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:37 smithi049 bash[23528]: cluster 2024-09-21T00:21:35.743125+0000 mgr.a (mgr.14388) 5497 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:37 smithi179 bash[23186]: cluster 2024-09-21T00:21:35.743125+0000 mgr.a (mgr.14388) 5497 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:37.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:37.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:37.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:38.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:38.365 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:39 smithi044 bash[22676]: cluster 2024-09-21T00:21:37.743836+0000 mgr.a (mgr.14388) 5498 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:39 smithi044 bash[22676]: audit 2024-09-21T00:21:37.933025+0000 mgr.a (mgr.14388) 5499 : audit [DBG] from='client.127947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:39 smithi179 bash[23186]: cluster 2024-09-21T00:21:37.743836+0000 mgr.a (mgr.14388) 5498 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:39 smithi179 bash[23186]: audit 2024-09-21T00:21:37.933025+0000 mgr.a (mgr.14388) 5499 : audit [DBG] from='client.127947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:39 smithi049 bash[23528]: cluster 2024-09-21T00:21:37.743836+0000 mgr.a (mgr.14388) 5498 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:39 smithi049 bash[23528]: audit 2024-09-21T00:21:37.933025+0000 mgr.a (mgr.14388) 5499 : audit [DBG] from='client.127947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:41 smithi044 bash[22676]: cluster 2024-09-21T00:21:39.744717+0000 mgr.a (mgr.14388) 5500 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:41 smithi179 bash[23186]: cluster 2024-09-21T00:21:39.744717+0000 mgr.a (mgr.14388) 5500 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:41 smithi049 bash[23528]: cluster 2024-09-21T00:21:39.744717+0000 mgr.a (mgr.14388) 5500 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:43.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:43.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:43.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:43 smithi044 bash[22676]: cluster 2024-09-21T00:21:41.746953+0000 mgr.a (mgr.14388) 5501 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:43 smithi179 bash[23186]: cluster 2024-09-21T00:21:41.746953+0000 mgr.a (mgr.14388) 5501 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:43.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:43 smithi049 bash[23528]: cluster 2024-09-21T00:21:41.746953+0000 mgr.a (mgr.14388) 5501 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:44.143 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:44.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:45 smithi044 bash[22676]: audit 2024-09-21T00:21:43.705626+0000 mgr.a (mgr.14388) 5502 : audit [DBG] from='client.128025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:45 smithi044 bash[22676]: cluster 2024-09-21T00:21:43.747851+0000 mgr.a (mgr.14388) 5503 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:45 smithi179 bash[23186]: audit 2024-09-21T00:21:43.705626+0000 mgr.a (mgr.14388) 5502 : audit [DBG] from='client.128025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:45 smithi179 bash[23186]: cluster 2024-09-21T00:21:43.747851+0000 mgr.a (mgr.14388) 5503 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:45 smithi049 bash[23528]: audit 2024-09-21T00:21:43.705626+0000 mgr.a (mgr.14388) 5502 : audit [DBG] from='client.128025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:45 smithi049 bash[23528]: cluster 2024-09-21T00:21:43.747851+0000 mgr.a (mgr.14388) 5503 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:47 smithi044 bash[22676]: cluster 2024-09-21T00:21:45.750235+0000 mgr.a (mgr.14388) 5504 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:47 smithi179 bash[23186]: cluster 2024-09-21T00:21:45.750235+0000 mgr.a (mgr.14388) 5504 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:47 smithi049 bash[23528]: cluster 2024-09-21T00:21:45.750235+0000 mgr.a (mgr.14388) 5504 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:49 smithi044 bash[22676]: cluster 2024-09-21T00:21:47.751029+0000 mgr.a (mgr.14388) 5505 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:49 smithi179 bash[23186]: cluster 2024-09-21T00:21:47.751029+0000 mgr.a (mgr.14388) 5505 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:49 smithi049 bash[23528]: cluster 2024-09-21T00:21:47.751029+0000 mgr.a (mgr.14388) 5505 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:49.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:49.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:49.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:49.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:49.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:50 smithi044 bash[22676]: audit 2024-09-21T00:21:49.478652+0000 mgr.a (mgr.14388) 5506 : audit [DBG] from='client.128100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:50 smithi179 bash[23186]: audit 2024-09-21T00:21:49.478652+0000 mgr.a (mgr.14388) 5506 : audit [DBG] from='client.128100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:50.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:50 smithi049 bash[23528]: audit 2024-09-21T00:21:49.478652+0000 mgr.a (mgr.14388) 5506 : audit [DBG] from='client.128100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:51 smithi044 bash[22676]: cluster 2024-09-21T00:21:49.751589+0000 mgr.a (mgr.14388) 5507 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:51 smithi179 bash[23186]: cluster 2024-09-21T00:21:49.751589+0000 mgr.a (mgr.14388) 5507 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:51 smithi049 bash[23528]: cluster 2024-09-21T00:21:49.751589+0000 mgr.a (mgr.14388) 5507 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:53 smithi044 bash[22676]: cluster 2024-09-21T00:21:51.754085+0000 mgr.a (mgr.14388) 5508 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:53 smithi044 bash[22676]: audit 2024-09-21T00:21:52.113084+0000 mon.a (mon.0) 4954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:53 smithi044 bash[22676]: audit 2024-09-21T00:21:52.123124+0000 mon.a (mon.0) 4955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:53 smithi044 bash[22676]: audit 2024-09-21T00:21:52.134712+0000 mon.a (mon.0) 4956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:53 smithi179 bash[23186]: cluster 2024-09-21T00:21:51.754085+0000 mgr.a (mgr.14388) 5508 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:53 smithi179 bash[23186]: audit 2024-09-21T00:21:52.113084+0000 mon.a (mon.0) 4954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:53 smithi179 bash[23186]: audit 2024-09-21T00:21:52.123124+0000 mon.a (mon.0) 4955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:53 smithi179 bash[23186]: audit 2024-09-21T00:21:52.134712+0000 mon.a (mon.0) 4956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:53 smithi049 bash[23528]: cluster 2024-09-21T00:21:51.754085+0000 mgr.a (mgr.14388) 5508 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:21:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:53 smithi049 bash[23528]: audit 2024-09-21T00:21:52.113084+0000 mon.a (mon.0) 4954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:53 smithi049 bash[23528]: audit 2024-09-21T00:21:52.123124+0000 mon.a (mon.0) 4955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:53 smithi049 bash[23528]: audit 2024-09-21T00:21:52.134712+0000 mon.a (mon.0) 4956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:54 smithi179 bash[23186]: audit 2024-09-21T00:21:53.248988+0000 mon.a (mon.0) 4957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:54 smithi179 bash[23186]: audit 2024-09-21T00:21:53.258744+0000 mon.a (mon.0) 4958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:54 smithi179 bash[23186]: audit 2024-09-21T00:21:53.268625+0000 mon.a (mon.0) 4959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:54 smithi044 bash[22676]: audit 2024-09-21T00:21:53.248988+0000 mon.a (mon.0) 4957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:54 smithi044 bash[22676]: audit 2024-09-21T00:21:53.258744+0000 mon.a (mon.0) 4958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:54 smithi044 bash[22676]: audit 2024-09-21T00:21:53.268625+0000 mon.a (mon.0) 4959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:54 smithi049 bash[23528]: audit 2024-09-21T00:21:53.248988+0000 mon.a (mon.0) 4957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:54 smithi049 bash[23528]: audit 2024-09-21T00:21:53.258744+0000 mon.a (mon.0) 4958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:54 smithi049 bash[23528]: audit 2024-09-21T00:21:53.268625+0000 mon.a (mon.0) 4959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:21:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:21:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:21:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: cluster 2024-09-21T00:21:53.754928+0000 mgr.a (mgr.14388) 5509 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:54.526734+0000 mon.a (mon.0) 4960 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:21:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.072277+0000 mon.a (mon.0) 4961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.079210+0000 mon.a (mon.0) 4962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.099860+0000 mon.a (mon.0) 4963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.106938+0000 mon.a (mon.0) 4964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.108039+0000 mon.a (mon.0) 4965 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.108691+0000 mon.a (mon.0) 4966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.114338+0000 mon.a (mon.0) 4967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.117426+0000 mon.a (mon.0) 4968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.123693+0000 mon.a (mon.0) 4969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.135876+0000 mon.a (mon.0) 4970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22676]: audit 2024-09-21T00:21:55.143623+0000 mon.a (mon.0) 4971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: cluster 2024-09-21T00:21:53.754928+0000 mgr.a (mgr.14388) 5509 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:55.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:54.526734+0000 mon.a (mon.0) 4960 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:21:55.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.072277+0000 mon.a (mon.0) 4961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.079210+0000 mon.a (mon.0) 4962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.099860+0000 mon.a (mon.0) 4963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.106938+0000 mon.a (mon.0) 4964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.108039+0000 mon.a (mon.0) 4965 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.108691+0000 mon.a (mon.0) 4966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.114338+0000 mon.a (mon.0) 4967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.117426+0000 mon.a (mon.0) 4968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:21:55.542 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.123693+0000 mon.a (mon.0) 4969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.135876+0000 mon.a (mon.0) 4970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.543 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:55 smithi049 bash[23528]: audit 2024-09-21T00:21:55.143623+0000 mon.a (mon.0) 4971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: cluster 2024-09-21T00:21:53.754928+0000 mgr.a (mgr.14388) 5509 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:54.526734+0000 mon.a (mon.0) 4960 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.072277+0000 mon.a (mon.0) 4961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.079210+0000 mon.a (mon.0) 4962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.099860+0000 mon.a (mon.0) 4963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.106938+0000 mon.a (mon.0) 4964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.108039+0000 mon.a (mon.0) 4965 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.108691+0000 mon.a (mon.0) 4966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.114338+0000 mon.a (mon.0) 4967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.117426+0000 mon.a (mon.0) 4968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.123693+0000 mon.a (mon.0) 4969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.135876+0000 mon.a (mon.0) 4970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:55 smithi179 bash[23186]: audit 2024-09-21T00:21:55.143623+0000 mon.a (mon.0) 4971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:21:56.229 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:21:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:21:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:21:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:21:56.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:21:56.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22930]: debug 2024-09-21T00:21:55.825+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:21:56.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:21:55 smithi044 bash[22930]: debug 2024-09-21T00:21:55.837+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:21:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:56 smithi049 bash[23528]: audit 2024-09-21T00:21:55.118329+0000 mgr.a (mgr.14388) 5510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:21:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:56 smithi049 bash[23528]: audit 2024-09-21T00:21:55.267751+0000 mgr.a (mgr.14388) 5511 : audit [DBG] from='client.128178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:56 smithi044 bash[22676]: audit 2024-09-21T00:21:55.118329+0000 mgr.a (mgr.14388) 5510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:21:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:56 smithi044 bash[22676]: audit 2024-09-21T00:21:55.267751+0000 mgr.a (mgr.14388) 5511 : audit [DBG] from='client.128178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:56 smithi179 bash[23186]: audit 2024-09-21T00:21:55.118329+0000 mgr.a (mgr.14388) 5510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:21:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:56 smithi179 bash[23186]: audit 2024-09-21T00:21:55.267751+0000 mgr.a (mgr.14388) 5511 : audit [DBG] from='client.128178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:21:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:57 smithi049 bash[23528]: cluster 2024-09-21T00:21:55.756147+0000 mgr.a (mgr.14388) 5512 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:57 smithi049 bash[23528]: audit 2024-09-21T00:21:55.830028+0000 mgr.a (mgr.14388) 5513 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:21:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:57 smithi049 bash[23528]: cephadm 2024-09-21T00:21:55.841920+0000 mgr.a (mgr.14388) 5514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:21:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:57 smithi044 bash[22676]: cluster 2024-09-21T00:21:55.756147+0000 mgr.a (mgr.14388) 5512 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:57 smithi044 bash[22676]: audit 2024-09-21T00:21:55.830028+0000 mgr.a (mgr.14388) 5513 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:21:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:57 smithi044 bash[22676]: cephadm 2024-09-21T00:21:55.841920+0000 mgr.a (mgr.14388) 5514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:21:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:57 smithi179 bash[23186]: cluster 2024-09-21T00:21:55.756147+0000 mgr.a (mgr.14388) 5512 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:21:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:57 smithi179 bash[23186]: audit 2024-09-21T00:21:55.830028+0000 mgr.a (mgr.14388) 5513 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:21:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:57 smithi179 bash[23186]: cephadm 2024-09-21T00:21:55.841920+0000 mgr.a (mgr.14388) 5514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:21:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:21:59 smithi049 bash[23528]: cluster 2024-09-21T00:21:57.757072+0000 mgr.a (mgr.14388) 5515 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:21:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:21:59 smithi044 bash[22676]: cluster 2024-09-21T00:21:57.757072+0000 mgr.a (mgr.14388) 5515 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:21:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:21:59 smithi179 bash[23186]: cluster 2024-09-21T00:21:57.757072+0000 mgr.a (mgr.14388) 5515 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:22:01.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:01.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:01.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:01 smithi049 bash[23528]: cluster 2024-09-21T00:21:59.757926+0000 mgr.a (mgr.14388) 5516 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:22:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:01 smithi044 bash[22676]: cluster 2024-09-21T00:21:59.757926+0000 mgr.a (mgr.14388) 5516 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:22:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:01 smithi179 bash[23186]: cluster 2024-09-21T00:21:59.757926+0000 mgr.a (mgr.14388) 5516 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:22:02.013 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:02.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:02.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:02.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:02.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:02.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:02 smithi049 bash[23528]: audit 2024-09-21T00:22:01.566326+0000 mgr.a (mgr.14388) 5517 : audit [DBG] from='client.128361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:02 smithi044 bash[22676]: audit 2024-09-21T00:22:01.566326+0000 mgr.a (mgr.14388) 5517 : audit [DBG] from='client.128361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:02.818 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:02 smithi179 bash[23186]: audit 2024-09-21T00:22:01.566326+0000 mgr.a (mgr.14388) 5517 : audit [DBG] from='client.128361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:03 smithi049 bash[23528]: cluster 2024-09-21T00:22:01.759276+0000 mgr.a (mgr.14388) 5518 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:03 smithi044 bash[22676]: cluster 2024-09-21T00:22:01.759276+0000 mgr.a (mgr.14388) 5518 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:03 smithi179 bash[23186]: cluster 2024-09-21T00:22:01.759276+0000 mgr.a (mgr.14388) 5518 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:05 smithi044 bash[22676]: cluster 2024-09-21T00:22:03.760156+0000 mgr.a (mgr.14388) 5519 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:22:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:05 smithi179 bash[23186]: cluster 2024-09-21T00:22:03.760156+0000 mgr.a (mgr.14388) 5519 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:22:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:05 smithi049 bash[23528]: cluster 2024-09-21T00:22:03.760156+0000 mgr.a (mgr.14388) 5519 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:22:07.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:07.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:07.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:07 smithi044 bash[22676]: cluster 2024-09-21T00:22:05.762476+0000 mgr.a (mgr.14388) 5520 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:07 smithi179 bash[23186]: cluster 2024-09-21T00:22:05.762476+0000 mgr.a (mgr.14388) 5520 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:07 smithi049 bash[23528]: cluster 2024-09-21T00:22:05.762476+0000 mgr.a (mgr.14388) 5520 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:07.806 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:07.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:07.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:07.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:07.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:08 smithi044 bash[22676]: audit 2024-09-21T00:22:07.353803+0000 mgr.a (mgr.14388) 5521 : audit [DBG] from='client.128439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:08 smithi179 bash[23186]: audit 2024-09-21T00:22:07.353803+0000 mgr.a (mgr.14388) 5521 : audit [DBG] from='client.128439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:08.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:08 smithi049 bash[23528]: audit 2024-09-21T00:22:07.353803+0000 mgr.a (mgr.14388) 5521 : audit [DBG] from='client.128439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:09.703 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:09 smithi179 bash[23186]: cluster 2024-09-21T00:22:07.763221+0000 mgr.a (mgr.14388) 5522 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:09 smithi044 bash[22676]: cluster 2024-09-21T00:22:07.763221+0000 mgr.a (mgr.14388) 5522 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:09.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:09 smithi049 bash[23528]: cluster 2024-09-21T00:22:07.763221+0000 mgr.a (mgr.14388) 5522 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:11 smithi044 bash[22676]: cluster 2024-09-21T00:22:09.763996+0000 mgr.a (mgr.14388) 5523 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:11 smithi179 bash[23186]: cluster 2024-09-21T00:22:09.763996+0000 mgr.a (mgr.14388) 5523 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:11 smithi049 bash[23528]: cluster 2024-09-21T00:22:09.763996+0000 mgr.a (mgr.14388) 5523 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:12.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:13.596 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:13.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:13.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:13.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:13.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:13.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:13 smithi044 bash[22676]: cluster 2024-09-21T00:22:11.766241+0000 mgr.a (mgr.14388) 5524 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:13.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:13 smithi044 bash[22676]: audit 2024-09-21T00:22:12.351704+0000 mon.a (mon.0) 4972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:13 smithi044 bash[22676]: audit 2024-09-21T00:22:12.361900+0000 mon.a (mon.0) 4973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:13 smithi044 bash[22676]: audit 2024-09-21T00:22:12.374111+0000 mon.a (mon.0) 4974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:13 smithi179 bash[23186]: cluster 2024-09-21T00:22:11.766241+0000 mgr.a (mgr.14388) 5524 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:13 smithi179 bash[23186]: audit 2024-09-21T00:22:12.351704+0000 mon.a (mon.0) 4972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:13 smithi179 bash[23186]: audit 2024-09-21T00:22:12.361900+0000 mon.a (mon.0) 4973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:13 smithi179 bash[23186]: audit 2024-09-21T00:22:12.374111+0000 mon.a (mon.0) 4974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:13 smithi049 bash[23528]: cluster 2024-09-21T00:22:11.766241+0000 mgr.a (mgr.14388) 5524 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:22:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:13 smithi049 bash[23528]: audit 2024-09-21T00:22:12.351704+0000 mon.a (mon.0) 4972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:13 smithi049 bash[23528]: audit 2024-09-21T00:22:12.361900+0000 mon.a (mon.0) 4973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:13 smithi049 bash[23528]: audit 2024-09-21T00:22:12.374111+0000 mon.a (mon.0) 4974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.704 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:14 smithi179 bash[23186]: audit 2024-09-21T00:22:13.150566+0000 mgr.a (mgr.14388) 5525 : audit [DBG] from='client.128514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:14.704 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:14 smithi179 bash[23186]: audit 2024-09-21T00:22:13.407437+0000 mon.a (mon.0) 4975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.705 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:14 smithi179 bash[23186]: audit 2024-09-21T00:22:13.416391+0000 mon.a (mon.0) 4976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.705 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:14 smithi179 bash[23186]: audit 2024-09-21T00:22:13.426434+0000 mon.a (mon.0) 4977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:14 smithi044 bash[22676]: audit 2024-09-21T00:22:13.150566+0000 mgr.a (mgr.14388) 5525 : audit [DBG] from='client.128514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:14 smithi044 bash[22676]: audit 2024-09-21T00:22:13.407437+0000 mon.a (mon.0) 4975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:14 smithi044 bash[22676]: audit 2024-09-21T00:22:13.416391+0000 mon.a (mon.0) 4976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:14 smithi044 bash[22676]: audit 2024-09-21T00:22:13.426434+0000 mon.a (mon.0) 4977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:14 smithi049 bash[23528]: audit 2024-09-21T00:22:13.150566+0000 mgr.a (mgr.14388) 5525 : audit [DBG] from='client.128514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:14.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:14 smithi049 bash[23528]: audit 2024-09-21T00:22:13.407437+0000 mon.a (mon.0) 4975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:14 smithi049 bash[23528]: audit 2024-09-21T00:22:13.416391+0000 mon.a (mon.0) 4976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:14.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:14 smithi049 bash[23528]: audit 2024-09-21T00:22:13.426434+0000 mon.a (mon.0) 4977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.679 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:15 smithi049 bash[23528]: cluster 2024-09-21T00:22:13.767186+0000 mgr.a (mgr.14388) 5526 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:15.679 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:15 smithi049 bash[23528]: audit 2024-09-21T00:22:15.353155+0000 mon.a (mon.0) 4978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.680 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:15 smithi049 bash[23528]: audit 2024-09-21T00:22:15.360849+0000 mon.a (mon.0) 4979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.680 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:15 smithi049 bash[23528]: audit 2024-09-21T00:22:15.371185+0000 mon.a (mon.0) 4980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:15 smithi044 bash[22676]: cluster 2024-09-21T00:22:13.767186+0000 mgr.a (mgr.14388) 5526 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:15 smithi044 bash[22676]: audit 2024-09-21T00:22:15.353155+0000 mon.a (mon.0) 4978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:15 smithi044 bash[22676]: audit 2024-09-21T00:22:15.360849+0000 mon.a (mon.0) 4979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:15 smithi044 bash[22676]: audit 2024-09-21T00:22:15.371185+0000 mon.a (mon.0) 4980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:15 smithi179 bash[23186]: cluster 2024-09-21T00:22:13.767186+0000 mgr.a (mgr.14388) 5526 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:15 smithi179 bash[23186]: audit 2024-09-21T00:22:15.353155+0000 mon.a (mon.0) 4978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:15 smithi179 bash[23186]: audit 2024-09-21T00:22:15.360849+0000 mon.a (mon.0) 4979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:15 smithi179 bash[23186]: audit 2024-09-21T00:22:15.371185+0000 mon.a (mon.0) 4980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:17 smithi044 bash[22676]: cluster 2024-09-21T00:22:15.770178+0000 mgr.a (mgr.14388) 5527 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:17 smithi179 bash[23186]: cluster 2024-09-21T00:22:15.770178+0000 mgr.a (mgr.14388) 5527 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:17 smithi049 bash[23528]: cluster 2024-09-21T00:22:15.770178+0000 mgr.a (mgr.14388) 5527 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:18.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:18.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:18.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:19.396 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:19 smithi044 bash[22676]: cluster 2024-09-21T00:22:17.770958+0000 mgr.a (mgr.14388) 5528 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:19 smithi179 bash[23186]: cluster 2024-09-21T00:22:17.770958+0000 mgr.a (mgr.14388) 5528 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:19 smithi049 bash[23528]: cluster 2024-09-21T00:22:17.770958+0000 mgr.a (mgr.14388) 5528 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:20 smithi044 bash[22676]: audit 2024-09-21T00:22:18.939419+0000 mgr.a (mgr.14388) 5529 : audit [DBG] from='client.128586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:20 smithi179 bash[23186]: audit 2024-09-21T00:22:18.939419+0000 mgr.a (mgr.14388) 5529 : audit [DBG] from='client.128586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:20 smithi049 bash[23528]: audit 2024-09-21T00:22:18.939419+0000 mgr.a (mgr.14388) 5529 : audit [DBG] from='client.128586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:21 smithi044 bash[22676]: cluster 2024-09-21T00:22:19.771943+0000 mgr.a (mgr.14388) 5530 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:21 smithi179 bash[23186]: cluster 2024-09-21T00:22:19.771943+0000 mgr.a (mgr.14388) 5530 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:21 smithi049 bash[23528]: cluster 2024-09-21T00:22:19.771943+0000 mgr.a (mgr.14388) 5530 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:23 smithi044 bash[22676]: cluster 2024-09-21T00:22:21.774233+0000 mgr.a (mgr.14388) 5531 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:23 smithi179 bash[23186]: cluster 2024-09-21T00:22:21.774233+0000 mgr.a (mgr.14388) 5531 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:23.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:23 smithi049 bash[23528]: cluster 2024-09-21T00:22:21.774233+0000 mgr.a (mgr.14388) 5531 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:24.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:24.399 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:24.399 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:25.152 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:25 smithi044 bash[22676]: cluster 2024-09-21T00:22:23.775004+0000 mgr.a (mgr.14388) 5532 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:25 smithi179 bash[23186]: cluster 2024-09-21T00:22:23.775004+0000 mgr.a (mgr.14388) 5532 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:25 smithi049 bash[23528]: cluster 2024-09-21T00:22:23.775004+0000 mgr.a (mgr.14388) 5532 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:26 smithi044 bash[22676]: audit 2024-09-21T00:22:24.728504+0000 mgr.a (mgr.14388) 5533 : audit [DBG] from='client.128661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:26 smithi179 bash[23186]: audit 2024-09-21T00:22:24.728504+0000 mgr.a (mgr.14388) 5533 : audit [DBG] from='client.128661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:26 smithi049 bash[23528]: audit 2024-09-21T00:22:24.728504+0000 mgr.a (mgr.14388) 5533 : audit [DBG] from='client.128661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:27 smithi044 bash[22676]: cluster 2024-09-21T00:22:25.777909+0000 mgr.a (mgr.14388) 5534 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:22:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:27 smithi179 bash[23186]: cluster 2024-09-21T00:22:25.777909+0000 mgr.a (mgr.14388) 5534 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:22:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:27 smithi049 bash[23528]: cluster 2024-09-21T00:22:25.777909+0000 mgr.a (mgr.14388) 5534 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:22:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:29 smithi044 bash[22676]: cluster 2024-09-21T00:22:27.778769+0000 mgr.a (mgr.14388) 5535 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:22:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:29 smithi179 bash[23186]: cluster 2024-09-21T00:22:27.778769+0000 mgr.a (mgr.14388) 5535 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:22:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:29 smithi049 bash[23528]: cluster 2024-09-21T00:22:27.778769+0000 mgr.a (mgr.14388) 5535 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:22:30.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:30.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:30.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:31 smithi044 bash[22676]: cluster 2024-09-21T00:22:29.779542+0000 mgr.a (mgr.14388) 5536 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:22:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:31 smithi044 bash[22676]: audit 2024-09-21T00:22:30.495210+0000 mgr.a (mgr.14388) 5537 : audit [DBG] from='client.128733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:31 smithi179 bash[23186]: cluster 2024-09-21T00:22:29.779542+0000 mgr.a (mgr.14388) 5536 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:22:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:31 smithi179 bash[23186]: audit 2024-09-21T00:22:30.495210+0000 mgr.a (mgr.14388) 5537 : audit [DBG] from='client.128733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:31 smithi049 bash[23528]: cluster 2024-09-21T00:22:29.779542+0000 mgr.a (mgr.14388) 5536 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:22:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:31 smithi049 bash[23528]: audit 2024-09-21T00:22:30.495210+0000 mgr.a (mgr.14388) 5537 : audit [DBG] from='client.128733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:33 smithi044 bash[22676]: cluster 2024-09-21T00:22:31.782464+0000 mgr.a (mgr.14388) 5538 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:33 smithi044 bash[22676]: audit 2024-09-21T00:22:32.591634+0000 mon.a (mon.0) 4981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:33 smithi044 bash[22676]: audit 2024-09-21T00:22:32.600342+0000 mon.a (mon.0) 4982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:33 smithi044 bash[22676]: audit 2024-09-21T00:22:32.610811+0000 mon.a (mon.0) 4983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:33 smithi179 bash[23186]: cluster 2024-09-21T00:22:31.782464+0000 mgr.a (mgr.14388) 5538 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:33 smithi179 bash[23186]: audit 2024-09-21T00:22:32.591634+0000 mon.a (mon.0) 4981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:33 smithi179 bash[23186]: audit 2024-09-21T00:22:32.600342+0000 mon.a (mon.0) 4982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:33 smithi179 bash[23186]: audit 2024-09-21T00:22:32.610811+0000 mon.a (mon.0) 4983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:33 smithi049 bash[23528]: cluster 2024-09-21T00:22:31.782464+0000 mgr.a (mgr.14388) 5538 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:33 smithi049 bash[23528]: audit 2024-09-21T00:22:32.591634+0000 mon.a (mon.0) 4981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:33 smithi049 bash[23528]: audit 2024-09-21T00:22:32.600342+0000 mon.a (mon.0) 4982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:33 smithi049 bash[23528]: audit 2024-09-21T00:22:32.610811+0000 mon.a (mon.0) 4983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:34.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:34 smithi179 bash[23186]: audit 2024-09-21T00:22:33.597612+0000 mon.a (mon.0) 4984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:34.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:34 smithi179 bash[23186]: audit 2024-09-21T00:22:33.605822+0000 mon.a (mon.0) 4985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:34.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:34 smithi179 bash[23186]: audit 2024-09-21T00:22:33.615930+0000 mon.a (mon.0) 4986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:34.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:34 smithi179 bash[23186]: cluster 2024-09-21T00:22:33.783420+0000 mgr.a (mgr.14388) 5539 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:22:34.971 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:34 smithi044 bash[22676]: audit 2024-09-21T00:22:33.597612+0000 mon.a (mon.0) 4984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:34.971 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:34 smithi044 bash[22676]: audit 2024-09-21T00:22:33.605822+0000 mon.a (mon.0) 4985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:34.971 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:34 smithi044 bash[22676]: audit 2024-09-21T00:22:33.615930+0000 mon.a (mon.0) 4986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:34.971 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:34 smithi044 bash[22676]: cluster 2024-09-21T00:22:33.783420+0000 mgr.a (mgr.14388) 5539 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:22:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:34 smithi049 bash[23528]: audit 2024-09-21T00:22:33.597612+0000 mon.a (mon.0) 4984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:34 smithi049 bash[23528]: audit 2024-09-21T00:22:33.605822+0000 mon.a (mon.0) 4985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:34 smithi049 bash[23528]: audit 2024-09-21T00:22:33.615930+0000 mon.a (mon.0) 4986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:34 smithi049 bash[23528]: cluster 2024-09-21T00:22:33.783420+0000 mgr.a (mgr.14388) 5539 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:22:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:36.740 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:36 smithi044 bash[22676]: audit 2024-09-21T00:22:35.551964+0000 mon.a (mon.0) 4987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:36 smithi044 bash[22676]: audit 2024-09-21T00:22:35.559574+0000 mon.a (mon.0) 4988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:36 smithi044 bash[22676]: audit 2024-09-21T00:22:35.569384+0000 mon.a (mon.0) 4989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:36 smithi179 bash[23186]: audit 2024-09-21T00:22:35.551964+0000 mon.a (mon.0) 4987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:36 smithi179 bash[23186]: audit 2024-09-21T00:22:35.559574+0000 mon.a (mon.0) 4988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:37.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:36 smithi179 bash[23186]: audit 2024-09-21T00:22:35.569384+0000 mon.a (mon.0) 4989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:36 smithi049 bash[23528]: audit 2024-09-21T00:22:35.551964+0000 mon.a (mon.0) 4987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:36 smithi049 bash[23528]: audit 2024-09-21T00:22:35.559574+0000 mon.a (mon.0) 4988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:36 smithi049 bash[23528]: audit 2024-09-21T00:22:35.569384+0000 mon.a (mon.0) 4989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:37 smithi044 bash[22676]: cluster 2024-09-21T00:22:35.785470+0000 mgr.a (mgr.14388) 5540 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:37 smithi044 bash[22676]: audit 2024-09-21T00:22:36.286393+0000 mgr.a (mgr.14388) 5541 : audit [DBG] from='client.128808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:37 smithi179 bash[23186]: cluster 2024-09-21T00:22:35.785470+0000 mgr.a (mgr.14388) 5540 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:37 smithi179 bash[23186]: audit 2024-09-21T00:22:36.286393+0000 mgr.a (mgr.14388) 5541 : audit [DBG] from='client.128808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:37 smithi049 bash[23528]: cluster 2024-09-21T00:22:35.785470+0000 mgr.a (mgr.14388) 5540 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:37 smithi049 bash[23528]: audit 2024-09-21T00:22:36.286393+0000 mgr.a (mgr.14388) 5541 : audit [DBG] from='client.128808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:39 smithi044 bash[22676]: cluster 2024-09-21T00:22:37.786443+0000 mgr.a (mgr.14388) 5542 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:22:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:39 smithi179 bash[23186]: cluster 2024-09-21T00:22:37.786443+0000 mgr.a (mgr.14388) 5542 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:22:40.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:39 smithi049 bash[23528]: cluster 2024-09-21T00:22:37.786443+0000 mgr.a (mgr.14388) 5542 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:22:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:40 smithi044 bash[22676]: cluster 2024-09-21T00:22:39.787259+0000 mgr.a (mgr.14388) 5543 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:22:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:40 smithi179 bash[23186]: cluster 2024-09-21T00:22:39.787259+0000 mgr.a (mgr.14388) 5543 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:22:41.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:40 smithi049 bash[23528]: cluster 2024-09-21T00:22:39.787259+0000 mgr.a (mgr.14388) 5543 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:22:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:41.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:42.515 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:42.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:42.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:42.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:42.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:42 smithi044 bash[22676]: cluster 2024-09-21T00:22:41.788847+0000 mgr.a (mgr.14388) 5544 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:22:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:42 smithi044 bash[22676]: audit 2024-09-21T00:22:42.077321+0000 mgr.a (mgr.14388) 5545 : audit [DBG] from='client.128886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:42 smithi179 bash[23186]: cluster 2024-09-21T00:22:41.788847+0000 mgr.a (mgr.14388) 5544 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:22:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:42 smithi179 bash[23186]: audit 2024-09-21T00:22:42.077321+0000 mgr.a (mgr.14388) 5545 : audit [DBG] from='client.128886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:42 smithi049 bash[23528]: cluster 2024-09-21T00:22:41.788847+0000 mgr.a (mgr.14388) 5544 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:22:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:42 smithi049 bash[23528]: audit 2024-09-21T00:22:42.077321+0000 mgr.a (mgr.14388) 5545 : audit [DBG] from='client.128886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:44 smithi044 bash[22676]: cluster 2024-09-21T00:22:43.789837+0000 mgr.a (mgr.14388) 5546 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:44 smithi179 bash[23186]: cluster 2024-09-21T00:22:43.789837+0000 mgr.a (mgr.14388) 5546 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:44 smithi049 bash[23528]: cluster 2024-09-21T00:22:43.789837+0000 mgr.a (mgr.14388) 5546 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:46 smithi044 bash[22676]: cluster 2024-09-21T00:22:45.792031+0000 mgr.a (mgr.14388) 5547 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:46 smithi179 bash[23186]: cluster 2024-09-21T00:22:45.792031+0000 mgr.a (mgr.14388) 5547 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:46 smithi049 bash[23528]: cluster 2024-09-21T00:22:45.792031+0000 mgr.a (mgr.14388) 5547 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:47.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:48.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:48 smithi044 bash[22676]: cluster 2024-09-21T00:22:47.792829+0000 mgr.a (mgr.14388) 5548 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:48 smithi044 bash[22676]: audit 2024-09-21T00:22:47.859316+0000 mgr.a (mgr.14388) 5549 : audit [DBG] from='client.128964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:48 smithi179 bash[23186]: cluster 2024-09-21T00:22:47.792829+0000 mgr.a (mgr.14388) 5548 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:48 smithi179 bash[23186]: audit 2024-09-21T00:22:47.859316+0000 mgr.a (mgr.14388) 5549 : audit [DBG] from='client.128964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:48 smithi049 bash[23528]: cluster 2024-09-21T00:22:47.792829+0000 mgr.a (mgr.14388) 5548 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:48 smithi049 bash[23528]: audit 2024-09-21T00:22:47.859316+0000 mgr.a (mgr.14388) 5549 : audit [DBG] from='client.128964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:50 smithi044 bash[22676]: cluster 2024-09-21T00:22:49.793783+0000 mgr.a (mgr.14388) 5550 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:50 smithi179 bash[23186]: cluster 2024-09-21T00:22:49.793783+0000 mgr.a (mgr.14388) 5550 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:50 smithi049 bash[23528]: cluster 2024-09-21T00:22:49.793783+0000 mgr.a (mgr.14388) 5550 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:53.156 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:52 smithi179 bash[23186]: cluster 2024-09-21T00:22:51.796011+0000 mgr.a (mgr.14388) 5551 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:53.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:52 smithi179 bash[23186]: audit 2024-09-21T00:22:52.830516+0000 mon.a (mon.0) 4990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:52 smithi179 bash[23186]: audit 2024-09-21T00:22:52.840653+0000 mon.a (mon.0) 4991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:52 smithi179 bash[23186]: audit 2024-09-21T00:22:52.852615+0000 mon.a (mon.0) 4992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:52 smithi044 bash[22676]: cluster 2024-09-21T00:22:51.796011+0000 mgr.a (mgr.14388) 5551 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:52 smithi044 bash[22676]: audit 2024-09-21T00:22:52.830516+0000 mon.a (mon.0) 4990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:52 smithi044 bash[22676]: audit 2024-09-21T00:22:52.840653+0000 mon.a (mon.0) 4991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:52 smithi044 bash[22676]: audit 2024-09-21T00:22:52.852615+0000 mon.a (mon.0) 4992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:52 smithi049 bash[23528]: cluster 2024-09-21T00:22:51.796011+0000 mgr.a (mgr.14388) 5551 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:52 smithi049 bash[23528]: audit 2024-09-21T00:22:52.830516+0000 mon.a (mon.0) 4990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:52 smithi049 bash[23528]: audit 2024-09-21T00:22:52.840653+0000 mon.a (mon.0) 4991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:52 smithi049 bash[23528]: audit 2024-09-21T00:22:52.852615+0000 mon.a (mon.0) 4992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:53.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:53.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:53.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:54.102 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:54.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:54.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:54.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:54.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:22:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:54 smithi049 bash[23528]: audit 2024-09-21T00:22:53.643803+0000 mgr.a (mgr.14388) 5552 : audit [DBG] from='client.129039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:54 smithi049 bash[23528]: audit 2024-09-21T00:22:53.779872+0000 mon.a (mon.0) 4993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:54 smithi049 bash[23528]: audit 2024-09-21T00:22:53.794901+0000 mon.a (mon.0) 4994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:54 smithi049 bash[23528]: cluster 2024-09-21T00:22:53.796598+0000 mgr.a (mgr.14388) 5553 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:54 smithi049 bash[23528]: audit 2024-09-21T00:22:53.802432+0000 mon.a (mon.0) 4995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:54 smithi044 bash[22676]: audit 2024-09-21T00:22:53.643803+0000 mgr.a (mgr.14388) 5552 : audit [DBG] from='client.129039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:55.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:54 smithi044 bash[22676]: audit 2024-09-21T00:22:53.779872+0000 mon.a (mon.0) 4993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:54 smithi044 bash[22676]: audit 2024-09-21T00:22:53.794901+0000 mon.a (mon.0) 4994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:54 smithi044 bash[22676]: cluster 2024-09-21T00:22:53.796598+0000 mgr.a (mgr.14388) 5553 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:55.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:54 smithi044 bash[22676]: audit 2024-09-21T00:22:53.802432+0000 mon.a (mon.0) 4995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:54 smithi179 bash[23186]: audit 2024-09-21T00:22:53.643803+0000 mgr.a (mgr.14388) 5552 : audit [DBG] from='client.129039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:22:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:54 smithi179 bash[23186]: audit 2024-09-21T00:22:53.779872+0000 mon.a (mon.0) 4993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:54 smithi179 bash[23186]: audit 2024-09-21T00:22:53.794901+0000 mon.a (mon.0) 4994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:54 smithi179 bash[23186]: cluster 2024-09-21T00:22:53.796598+0000 mgr.a (mgr.14388) 5553 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:54 smithi179 bash[23186]: audit 2024-09-21T00:22:53.802432+0000 mon.a (mon.0) 4995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:55.777458+0000 mon.a (mon.0) 4996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:55.784949+0000 mon.a (mon.0) 4997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:55.794512+0000 mon.a (mon.0) 4998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: cluster 2024-09-21T00:22:55.797872+0000 mgr.a (mgr.14388) 5554 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:55.896450+0000 mon.a (mon.0) 4999 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:56.468009+0000 mon.a (mon.0) 5000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:56.476845+0000 mon.a (mon.0) 5001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:56.479287+0000 mon.a (mon.0) 5002 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:56.481236+0000 mon.a (mon.0) 5003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:56.492073+0000 mon.a (mon.0) 5004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:56.499074+0000 mon.a (mon.0) 5005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:56 smithi049 bash[23528]: audit 2024-09-21T00:22:56.501552+0000 mgr.a (mgr.14388) 5555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:55.777458+0000 mon.a (mon.0) 4996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:55.784949+0000 mon.a (mon.0) 4997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:55.794512+0000 mon.a (mon.0) 4998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: cluster 2024-09-21T00:22:55.797872+0000 mgr.a (mgr.14388) 5554 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:55.896450+0000 mon.a (mon.0) 4999 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:56.468009+0000 mon.a (mon.0) 5000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:56.476845+0000 mon.a (mon.0) 5001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:56.479287+0000 mon.a (mon.0) 5002 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:56.481236+0000 mon.a (mon.0) 5003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:56.492073+0000 mon.a (mon.0) 5004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:56.499074+0000 mon.a (mon.0) 5005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:22:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:56 smithi044 bash[22676]: audit 2024-09-21T00:22:56.501552+0000 mgr.a (mgr.14388) 5555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:55.777458+0000 mon.a (mon.0) 4996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:55.784949+0000 mon.a (mon.0) 4997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:55.794512+0000 mon.a (mon.0) 4998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: cluster 2024-09-21T00:22:55.797872+0000 mgr.a (mgr.14388) 5554 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:55.896450+0000 mon.a (mon.0) 4999 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:56.468009+0000 mon.a (mon.0) 5000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:56.476845+0000 mon.a (mon.0) 5001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:56.479287+0000 mon.a (mon.0) 5002 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:22:57.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:56.481236+0000 mon.a (mon.0) 5003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:22:57.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:56.492073+0000 mon.a (mon.0) 5004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:22:57.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:56.499074+0000 mon.a (mon.0) 5005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:22:57.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:56 smithi179 bash[23186]: audit 2024-09-21T00:22:56.501552+0000 mgr.a (mgr.14388) 5555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:22:57.530 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:22:57 smithi044 bash[22930]: debug 2024-09-21T00:22:57.272+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:22:57.530 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:22:57 smithi044 bash[22930]: debug 2024-09-21T00:22:57.276+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:57 smithi044 bash[22676]: audit 2024-09-21T00:22:57.276655+0000 mgr.a (mgr.14388) 5556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:22:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:57 smithi044 bash[22676]: cephadm 2024-09-21T00:22:57.277919+0000 mgr.a (mgr.14388) 5557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:22:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:57 smithi179 bash[23186]: audit 2024-09-21T00:22:57.276655+0000 mgr.a (mgr.14388) 5556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:22:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:57 smithi179 bash[23186]: cephadm 2024-09-21T00:22:57.277919+0000 mgr.a (mgr.14388) 5557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:22:58.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:57 smithi049 bash[23528]: audit 2024-09-21T00:22:57.276655+0000 mgr.a (mgr.14388) 5556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:22:58.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:57 smithi049 bash[23528]: cephadm 2024-09-21T00:22:57.277919+0000 mgr.a (mgr.14388) 5557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:22:59.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:22:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:22:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:22:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:58 smithi044 bash[22676]: cluster 2024-09-21T00:22:57.798728+0000 mgr.a (mgr.14388) 5558 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:58 smithi179 bash[23186]: cluster 2024-09-21T00:22:57.798728+0000 mgr.a (mgr.14388) 5558 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:58 smithi049 bash[23528]: cluster 2024-09-21T00:22:57.798728+0000 mgr.a (mgr.14388) 5558 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:22:59.889 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:22:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:22:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:22:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:22:59.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:00.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:22:59 smithi044 bash[22676]: audit 2024-09-21T00:22:59.438372+0000 mgr.a (mgr.14388) 5559 : audit [DBG] from='client.129219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:22:59 smithi179 bash[23186]: audit 2024-09-21T00:22:59.438372+0000 mgr.a (mgr.14388) 5559 : audit [DBG] from='client.129219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:00.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:22:59 smithi049 bash[23528]: audit 2024-09-21T00:22:59.438372+0000 mgr.a (mgr.14388) 5559 : audit [DBG] from='client.129219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:00 smithi044 bash[22676]: cluster 2024-09-21T00:22:59.799315+0000 mgr.a (mgr.14388) 5560 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:00 smithi179 bash[23186]: cluster 2024-09-21T00:22:59.799315+0000 mgr.a (mgr.14388) 5560 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:00 smithi049 bash[23528]: cluster 2024-09-21T00:22:59.799315+0000 mgr.a (mgr.14388) 5560 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:02 smithi049 bash[23528]: cluster 2024-09-21T00:23:01.801556+0000 mgr.a (mgr.14388) 5561 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:02 smithi044 bash[22676]: cluster 2024-09-21T00:23:01.801556+0000 mgr.a (mgr.14388) 5561 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:02 smithi179 bash[23186]: cluster 2024-09-21T00:23:01.801556+0000 mgr.a (mgr.14388) 5561 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:04.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:04.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:04.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:04 smithi044 bash[22676]: cluster 2024-09-21T00:23:03.802325+0000 mgr.a (mgr.14388) 5562 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:04 smithi179 bash[23186]: cluster 2024-09-21T00:23:03.802325+0000 mgr.a (mgr.14388) 5562 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:04 smithi049 bash[23528]: cluster 2024-09-21T00:23:03.802325+0000 mgr.a (mgr.14388) 5562 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:05.681 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:05.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:05.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:05.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:05.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:05 smithi044 bash[22676]: audit 2024-09-21T00:23:05.226967+0000 mgr.a (mgr.14388) 5563 : audit [DBG] from='client.129297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:05 smithi179 bash[23186]: audit 2024-09-21T00:23:05.226967+0000 mgr.a (mgr.14388) 5563 : audit [DBG] from='client.129297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:06.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:05 smithi049 bash[23528]: audit 2024-09-21T00:23:05.226967+0000 mgr.a (mgr.14388) 5563 : audit [DBG] from='client.129297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:06 smithi044 bash[22676]: cluster 2024-09-21T00:23:05.805216+0000 mgr.a (mgr.14388) 5564 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:06 smithi179 bash[23186]: cluster 2024-09-21T00:23:05.805216+0000 mgr.a (mgr.14388) 5564 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:06 smithi049 bash[23528]: cluster 2024-09-21T00:23:05.805216+0000 mgr.a (mgr.14388) 5564 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:08 smithi044 bash[22676]: cluster 2024-09-21T00:23:07.806039+0000 mgr.a (mgr.14388) 5565 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:23:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:08 smithi179 bash[23186]: cluster 2024-09-21T00:23:07.806039+0000 mgr.a (mgr.14388) 5565 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:23:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:08 smithi049 bash[23528]: cluster 2024-09-21T00:23:07.806039+0000 mgr.a (mgr.14388) 5565 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:23:10.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:10.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:10.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:10 smithi044 bash[22676]: cluster 2024-09-21T00:23:09.806811+0000 mgr.a (mgr.14388) 5566 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:23:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:10 smithi179 bash[23186]: cluster 2024-09-21T00:23:09.806811+0000 mgr.a (mgr.14388) 5566 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:23:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:10 smithi049 bash[23528]: cluster 2024-09-21T00:23:09.806811+0000 mgr.a (mgr.14388) 5566 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:23:11.469 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:11.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:11.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:11.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:11.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:11 smithi044 bash[22676]: audit 2024-09-21T00:23:11.018794+0000 mgr.a (mgr.14388) 5567 : audit [DBG] from='client.129375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:11 smithi179 bash[23186]: audit 2024-09-21T00:23:11.018794+0000 mgr.a (mgr.14388) 5567 : audit [DBG] from='client.129375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:12.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:11 smithi049 bash[23528]: audit 2024-09-21T00:23:11.018794+0000 mgr.a (mgr.14388) 5567 : audit [DBG] from='client.129375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:12 smithi044 bash[22676]: cluster 2024-09-21T00:23:11.809611+0000 mgr.a (mgr.14388) 5568 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:12 smithi179 bash[23186]: cluster 2024-09-21T00:23:11.809611+0000 mgr.a (mgr.14388) 5568 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:12 smithi049 bash[23528]: cluster 2024-09-21T00:23:11.809611+0000 mgr.a (mgr.14388) 5568 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:23:14.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:14 smithi179 bash[23186]: audit 2024-09-21T00:23:13.072893+0000 mon.a (mon.0) 5006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:14 smithi179 bash[23186]: audit 2024-09-21T00:23:13.082945+0000 mon.a (mon.0) 5007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:14 smithi179 bash[23186]: audit 2024-09-21T00:23:13.095097+0000 mon.a (mon.0) 5008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:14 smithi179 bash[23186]: audit 2024-09-21T00:23:14.003519+0000 mon.a (mon.0) 5009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:14 smithi179 bash[23186]: audit 2024-09-21T00:23:14.013501+0000 mon.a (mon.0) 5010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:14 smithi179 bash[23186]: audit 2024-09-21T00:23:14.022560+0000 mon.a (mon.0) 5011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:14 smithi044 bash[22676]: audit 2024-09-21T00:23:13.072893+0000 mon.a (mon.0) 5006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:14 smithi044 bash[22676]: audit 2024-09-21T00:23:13.082945+0000 mon.a (mon.0) 5007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:14 smithi044 bash[22676]: audit 2024-09-21T00:23:13.095097+0000 mon.a (mon.0) 5008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:14 smithi044 bash[22676]: audit 2024-09-21T00:23:14.003519+0000 mon.a (mon.0) 5009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:14 smithi044 bash[22676]: audit 2024-09-21T00:23:14.013501+0000 mon.a (mon.0) 5010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:14 smithi044 bash[22676]: audit 2024-09-21T00:23:14.022560+0000 mon.a (mon.0) 5011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:14 smithi049 bash[23528]: audit 2024-09-21T00:23:13.072893+0000 mon.a (mon.0) 5006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:14 smithi049 bash[23528]: audit 2024-09-21T00:23:13.082945+0000 mon.a (mon.0) 5007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:14 smithi049 bash[23528]: audit 2024-09-21T00:23:13.095097+0000 mon.a (mon.0) 5008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:14 smithi049 bash[23528]: audit 2024-09-21T00:23:14.003519+0000 mon.a (mon.0) 5009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:14 smithi049 bash[23528]: audit 2024-09-21T00:23:14.013501+0000 mon.a (mon.0) 5010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:14 smithi049 bash[23528]: audit 2024-09-21T00:23:14.022560+0000 mon.a (mon.0) 5011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:15.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:15 smithi044 bash[22676]: cluster 2024-09-21T00:23:13.810389+0000 mgr.a (mgr.14388) 5569 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:15 smithi179 bash[23186]: cluster 2024-09-21T00:23:13.810389+0000 mgr.a (mgr.14388) 5569 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:15.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:15 smithi049 bash[23528]: cluster 2024-09-21T00:23:13.810389+0000 mgr.a (mgr.14388) 5569 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:16.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:16.471 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:16.471 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:16 smithi044 bash[22676]: cluster 2024-09-21T00:23:15.811631+0000 mgr.a (mgr.14388) 5570 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:16 smithi044 bash[22676]: audit 2024-09-21T00:23:15.966473+0000 mon.a (mon.0) 5012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:16 smithi044 bash[22676]: audit 2024-09-21T00:23:15.974988+0000 mon.a (mon.0) 5013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:16 smithi044 bash[22676]: audit 2024-09-21T00:23:15.985284+0000 mon.a (mon.0) 5014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:16 smithi179 bash[23186]: cluster 2024-09-21T00:23:15.811631+0000 mgr.a (mgr.14388) 5570 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:16 smithi179 bash[23186]: audit 2024-09-21T00:23:15.966473+0000 mon.a (mon.0) 5012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:16 smithi179 bash[23186]: audit 2024-09-21T00:23:15.974988+0000 mon.a (mon.0) 5013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:16 smithi179 bash[23186]: audit 2024-09-21T00:23:15.985284+0000 mon.a (mon.0) 5014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:16 smithi049 bash[23528]: cluster 2024-09-21T00:23:15.811631+0000 mgr.a (mgr.14388) 5570 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:16 smithi049 bash[23528]: audit 2024-09-21T00:23:15.966473+0000 mon.a (mon.0) 5012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:16 smithi049 bash[23528]: audit 2024-09-21T00:23:15.974988+0000 mon.a (mon.0) 5013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:16 smithi049 bash[23528]: audit 2024-09-21T00:23:15.985284+0000 mon.a (mon.0) 5014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:17 smithi044 bash[22676]: audit 2024-09-21T00:23:16.808358+0000 mgr.a (mgr.14388) 5571 : audit [DBG] from='client.129453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:17 smithi179 bash[23186]: audit 2024-09-21T00:23:16.808358+0000 mgr.a (mgr.14388) 5571 : audit [DBG] from='client.129453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:18.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:17 smithi049 bash[23528]: audit 2024-09-21T00:23:16.808358+0000 mgr.a (mgr.14388) 5571 : audit [DBG] from='client.129453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:18 smithi044 bash[22676]: cluster 2024-09-21T00:23:17.812571+0000 mgr.a (mgr.14388) 5572 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:18 smithi179 bash[23186]: cluster 2024-09-21T00:23:17.812571+0000 mgr.a (mgr.14388) 5572 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:18 smithi049 bash[23528]: cluster 2024-09-21T00:23:17.812571+0000 mgr.a (mgr.14388) 5572 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:20 smithi044 bash[22676]: cluster 2024-09-21T00:23:19.813401+0000 mgr.a (mgr.14388) 5573 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:20 smithi179 bash[23186]: cluster 2024-09-21T00:23:19.813401+0000 mgr.a (mgr.14388) 5573 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:20 smithi049 bash[23528]: cluster 2024-09-21T00:23:19.813401+0000 mgr.a (mgr.14388) 5573 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:22.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:23.030 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:23.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:23.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:23.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:23.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:22 smithi044 bash[22676]: cluster 2024-09-21T00:23:21.815583+0000 mgr.a (mgr.14388) 5574 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:22 smithi179 bash[23186]: cluster 2024-09-21T00:23:21.815583+0000 mgr.a (mgr.14388) 5574 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:22 smithi049 bash[23528]: cluster 2024-09-21T00:23:21.815583+0000 mgr.a (mgr.14388) 5574 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:23 smithi179 bash[23186]: audit 2024-09-21T00:23:22.596385+0000 mgr.a (mgr.14388) 5575 : audit [DBG] from='client.129531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:23 smithi049 bash[23528]: audit 2024-09-21T00:23:22.596385+0000 mgr.a (mgr.14388) 5575 : audit [DBG] from='client.129531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:23 smithi044 bash[22676]: audit 2024-09-21T00:23:22.596385+0000 mgr.a (mgr.14388) 5575 : audit [DBG] from='client.129531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:24 smithi179 bash[23186]: cluster 2024-09-21T00:23:23.816541+0000 mgr.a (mgr.14388) 5576 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:24 smithi049 bash[23528]: cluster 2024-09-21T00:23:23.816541+0000 mgr.a (mgr.14388) 5576 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:24 smithi044 bash[22676]: cluster 2024-09-21T00:23:23.816541+0000 mgr.a (mgr.14388) 5576 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:26 smithi179 bash[23186]: cluster 2024-09-21T00:23:25.818813+0000 mgr.a (mgr.14388) 5577 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:27 smithi049 bash[23528]: cluster 2024-09-21T00:23:25.818813+0000 mgr.a (mgr.14388) 5577 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:26 smithi044 bash[22676]: cluster 2024-09-21T00:23:25.818813+0000 mgr.a (mgr.14388) 5577 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:28.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:28.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:28.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:28.816 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:29 smithi049 bash[23528]: cluster 2024-09-21T00:23:27.819591+0000 mgr.a (mgr.14388) 5578 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:29 smithi049 bash[23528]: audit 2024-09-21T00:23:28.370142+0000 mgr.a (mgr.14388) 5579 : audit [DBG] from='client.129609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:29 smithi044 bash[22676]: cluster 2024-09-21T00:23:27.819591+0000 mgr.a (mgr.14388) 5578 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:29 smithi044 bash[22676]: audit 2024-09-21T00:23:28.370142+0000 mgr.a (mgr.14388) 5579 : audit [DBG] from='client.129609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:29 smithi179 bash[23186]: cluster 2024-09-21T00:23:27.819591+0000 mgr.a (mgr.14388) 5578 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:29 smithi179 bash[23186]: audit 2024-09-21T00:23:28.370142+0000 mgr.a (mgr.14388) 5579 : audit [DBG] from='client.129609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:31 smithi049 bash[23528]: cluster 2024-09-21T00:23:29.820559+0000 mgr.a (mgr.14388) 5580 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:31 smithi044 bash[22676]: cluster 2024-09-21T00:23:29.820559+0000 mgr.a (mgr.14388) 5580 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:31 smithi179 bash[23186]: cluster 2024-09-21T00:23:29.820559+0000 mgr.a (mgr.14388) 5580 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:33 smithi179 bash[23186]: cluster 2024-09-21T00:23:31.822872+0000 mgr.a (mgr.14388) 5581 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:33.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:33 smithi049 bash[23528]: cluster 2024-09-21T00:23:31.822872+0000 mgr.a (mgr.14388) 5581 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:33 smithi044 bash[22676]: cluster 2024-09-21T00:23:31.822872+0000 mgr.a (mgr.14388) 5581 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:33.819 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:33.819 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:34 smithi044 bash[22676]: audit 2024-09-21T00:23:33.308894+0000 mon.a (mon.0) 5015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:34 smithi044 bash[22676]: audit 2024-09-21T00:23:33.321396+0000 mon.a (mon.0) 5016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:34 smithi044 bash[22676]: audit 2024-09-21T00:23:33.333334+0000 mon.a (mon.0) 5017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:34 smithi044 bash[22676]: audit 2024-09-21T00:23:34.212364+0000 mon.a (mon.0) 5018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:34 smithi044 bash[22676]: audit 2024-09-21T00:23:34.218838+0000 mon.a (mon.0) 5019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:34 smithi044 bash[22676]: audit 2024-09-21T00:23:34.226235+0000 mon.a (mon.0) 5020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:34 smithi179 bash[23186]: audit 2024-09-21T00:23:33.308894+0000 mon.a (mon.0) 5015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:34 smithi179 bash[23186]: audit 2024-09-21T00:23:33.321396+0000 mon.a (mon.0) 5016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:34 smithi179 bash[23186]: audit 2024-09-21T00:23:33.333334+0000 mon.a (mon.0) 5017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:34 smithi179 bash[23186]: audit 2024-09-21T00:23:34.212364+0000 mon.a (mon.0) 5018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:34 smithi179 bash[23186]: audit 2024-09-21T00:23:34.218838+0000 mon.a (mon.0) 5019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:34 smithi179 bash[23186]: audit 2024-09-21T00:23:34.226235+0000 mon.a (mon.0) 5020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:34 smithi049 bash[23528]: audit 2024-09-21T00:23:33.308894+0000 mon.a (mon.0) 5015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:34 smithi049 bash[23528]: audit 2024-09-21T00:23:33.321396+0000 mon.a (mon.0) 5016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:34 smithi049 bash[23528]: audit 2024-09-21T00:23:33.333334+0000 mon.a (mon.0) 5017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:34 smithi049 bash[23528]: audit 2024-09-21T00:23:34.212364+0000 mon.a (mon.0) 5018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:34 smithi049 bash[23528]: audit 2024-09-21T00:23:34.218838+0000 mon.a (mon.0) 5019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:34 smithi049 bash[23528]: audit 2024-09-21T00:23:34.226235+0000 mon.a (mon.0) 5020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:35 smithi044 bash[22676]: cluster 2024-09-21T00:23:33.823600+0000 mgr.a (mgr.14388) 5582 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:35 smithi044 bash[22676]: audit 2024-09-21T00:23:34.153209+0000 mgr.a (mgr.14388) 5583 : audit [DBG] from='client.129687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:35 smithi179 bash[23186]: cluster 2024-09-21T00:23:33.823600+0000 mgr.a (mgr.14388) 5582 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:35 smithi179 bash[23186]: audit 2024-09-21T00:23:34.153209+0000 mgr.a (mgr.14388) 5583 : audit [DBG] from='client.129687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:35 smithi049 bash[23528]: cluster 2024-09-21T00:23:33.823600+0000 mgr.a (mgr.14388) 5582 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:35 smithi049 bash[23528]: audit 2024-09-21T00:23:34.153209+0000 mgr.a (mgr.14388) 5583 : audit [DBG] from='client.129687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:37 smithi044 bash[22676]: cluster 2024-09-21T00:23:35.825976+0000 mgr.a (mgr.14388) 5584 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:37 smithi044 bash[22676]: audit 2024-09-21T00:23:36.151802+0000 mon.a (mon.0) 5021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:37 smithi044 bash[22676]: audit 2024-09-21T00:23:36.159765+0000 mon.a (mon.0) 5022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:37 smithi044 bash[22676]: audit 2024-09-21T00:23:36.169884+0000 mon.a (mon.0) 5023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:37 smithi179 bash[23186]: cluster 2024-09-21T00:23:35.825976+0000 mgr.a (mgr.14388) 5584 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:37 smithi179 bash[23186]: audit 2024-09-21T00:23:36.151802+0000 mon.a (mon.0) 5021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:37 smithi179 bash[23186]: audit 2024-09-21T00:23:36.159765+0000 mon.a (mon.0) 5022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:37 smithi179 bash[23186]: audit 2024-09-21T00:23:36.169884+0000 mon.a (mon.0) 5023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.506 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:37 smithi049 bash[23528]: cluster 2024-09-21T00:23:35.825976+0000 mgr.a (mgr.14388) 5584 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:37.507 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:37 smithi049 bash[23528]: audit 2024-09-21T00:23:36.151802+0000 mon.a (mon.0) 5021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.507 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:37 smithi049 bash[23528]: audit 2024-09-21T00:23:36.159765+0000 mon.a (mon.0) 5022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:37.507 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:37 smithi049 bash[23528]: audit 2024-09-21T00:23:36.169884+0000 mon.a (mon.0) 5023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:39 smithi044 bash[22676]: cluster 2024-09-21T00:23:37.826736+0000 mgr.a (mgr.14388) 5585 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:39 smithi179 bash[23186]: cluster 2024-09-21T00:23:37.826736+0000 mgr.a (mgr.14388) 5585 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:39 smithi049 bash[23528]: cluster 2024-09-21T00:23:37.826736+0000 mgr.a (mgr.14388) 5585 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:39.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:40.373 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:40.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:41 smithi044 bash[22676]: cluster 2024-09-21T00:23:39.827503+0000 mgr.a (mgr.14388) 5586 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:41 smithi044 bash[22676]: audit 2024-09-21T00:23:39.916021+0000 mgr.a (mgr.14388) 5587 : audit [DBG] from='client.129765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:41 smithi179 bash[23186]: cluster 2024-09-21T00:23:39.827503+0000 mgr.a (mgr.14388) 5586 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:41 smithi179 bash[23186]: audit 2024-09-21T00:23:39.916021+0000 mgr.a (mgr.14388) 5587 : audit [DBG] from='client.129765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:41 smithi049 bash[23528]: cluster 2024-09-21T00:23:39.827503+0000 mgr.a (mgr.14388) 5586 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:41 smithi049 bash[23528]: audit 2024-09-21T00:23:39.916021+0000 mgr.a (mgr.14388) 5587 : audit [DBG] from='client.129765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:43 smithi044 bash[22676]: cluster 2024-09-21T00:23:41.830300+0000 mgr.a (mgr.14388) 5588 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:43 smithi179 bash[23186]: cluster 2024-09-21T00:23:41.830300+0000 mgr.a (mgr.14388) 5588 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:43.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:43 smithi049 bash[23528]: cluster 2024-09-21T00:23:41.830300+0000 mgr.a (mgr.14388) 5588 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:45.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:45.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:45.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:45 smithi044 bash[22676]: cluster 2024-09-21T00:23:43.831137+0000 mgr.a (mgr.14388) 5589 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:45 smithi179 bash[23186]: cluster 2024-09-21T00:23:43.831137+0000 mgr.a (mgr.14388) 5589 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:45 smithi049 bash[23528]: cluster 2024-09-21T00:23:43.831137+0000 mgr.a (mgr.14388) 5589 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:46.155 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:46.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:46.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:46.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:46.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:47 smithi044 bash[22676]: audit 2024-09-21T00:23:45.712238+0000 mgr.a (mgr.14388) 5590 : audit [DBG] from='client.129843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:47 smithi044 bash[22676]: cluster 2024-09-21T00:23:45.832766+0000 mgr.a (mgr.14388) 5591 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:47 smithi179 bash[23186]: audit 2024-09-21T00:23:45.712238+0000 mgr.a (mgr.14388) 5590 : audit [DBG] from='client.129843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:47 smithi179 bash[23186]: cluster 2024-09-21T00:23:45.832766+0000 mgr.a (mgr.14388) 5591 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:47 smithi049 bash[23528]: audit 2024-09-21T00:23:45.712238+0000 mgr.a (mgr.14388) 5590 : audit [DBG] from='client.129843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:47 smithi049 bash[23528]: cluster 2024-09-21T00:23:45.832766+0000 mgr.a (mgr.14388) 5591 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:49 smithi044 bash[22676]: cluster 2024-09-21T00:23:47.833699+0000 mgr.a (mgr.14388) 5592 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:49 smithi179 bash[23186]: cluster 2024-09-21T00:23:47.833699+0000 mgr.a (mgr.14388) 5592 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:49 smithi049 bash[23528]: cluster 2024-09-21T00:23:47.833699+0000 mgr.a (mgr.14388) 5592 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:23:51.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:51.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:51.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:51 smithi044 bash[22676]: cluster 2024-09-21T00:23:49.834517+0000 mgr.a (mgr.14388) 5593 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:23:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:51 smithi179 bash[23186]: cluster 2024-09-21T00:23:49.834517+0000 mgr.a (mgr.14388) 5593 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:23:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:51 smithi049 bash[23528]: cluster 2024-09-21T00:23:49.834517+0000 mgr.a (mgr.14388) 5593 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:23:51.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:52.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:52 smithi179 bash[23186]: audit 2024-09-21T00:23:51.492724+0000 mgr.a (mgr.14388) 5594 : audit [DBG] from='client.129918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:52 smithi044 bash[22676]: audit 2024-09-21T00:23:51.492724+0000 mgr.a (mgr.14388) 5594 : audit [DBG] from='client.129918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:52 smithi049 bash[23528]: audit 2024-09-21T00:23:51.492724+0000 mgr.a (mgr.14388) 5594 : audit [DBG] from='client.129918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:53.218 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:53 smithi179 bash[23186]: cluster 2024-09-21T00:23:51.837517+0000 mgr.a (mgr.14388) 5595 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:53 smithi044 bash[22676]: cluster 2024-09-21T00:23:51.837517+0000 mgr.a (mgr.14388) 5595 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:53 smithi049 bash[23528]: cluster 2024-09-21T00:23:51.837517+0000 mgr.a (mgr.14388) 5595 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:54 smithi044 bash[22676]: audit 2024-09-21T00:23:53.550345+0000 mon.a (mon.0) 5024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:54 smithi044 bash[22676]: audit 2024-09-21T00:23:53.560243+0000 mon.a (mon.0) 5025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:54 smithi044 bash[22676]: audit 2024-09-21T00:23:53.572111+0000 mon.a (mon.0) 5026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:54 smithi044 bash[22676]: audit 2024-09-21T00:23:54.426481+0000 mon.a (mon.0) 5027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:54 smithi044 bash[22676]: audit 2024-09-21T00:23:54.435996+0000 mon.a (mon.0) 5028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:54 smithi044 bash[22676]: audit 2024-09-21T00:23:54.447370+0000 mon.a (mon.0) 5029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:54 smithi179 bash[23186]: audit 2024-09-21T00:23:53.550345+0000 mon.a (mon.0) 5024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:54 smithi179 bash[23186]: audit 2024-09-21T00:23:53.560243+0000 mon.a (mon.0) 5025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:54 smithi179 bash[23186]: audit 2024-09-21T00:23:53.572111+0000 mon.a (mon.0) 5026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:54 smithi179 bash[23186]: audit 2024-09-21T00:23:54.426481+0000 mon.a (mon.0) 5027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:54 smithi179 bash[23186]: audit 2024-09-21T00:23:54.435996+0000 mon.a (mon.0) 5028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:54 smithi179 bash[23186]: audit 2024-09-21T00:23:54.447370+0000 mon.a (mon.0) 5029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:54 smithi049 bash[23528]: audit 2024-09-21T00:23:53.550345+0000 mon.a (mon.0) 5024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:54 smithi049 bash[23528]: audit 2024-09-21T00:23:53.560243+0000 mon.a (mon.0) 5025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:54 smithi049 bash[23528]: audit 2024-09-21T00:23:53.572111+0000 mon.a (mon.0) 5026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:54 smithi049 bash[23528]: audit 2024-09-21T00:23:54.426481+0000 mon.a (mon.0) 5027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:54 smithi049 bash[23528]: audit 2024-09-21T00:23:54.435996+0000 mon.a (mon.0) 5028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:54 smithi049 bash[23528]: audit 2024-09-21T00:23:54.447370+0000 mon.a (mon.0) 5029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:55 smithi044 bash[22676]: cluster 2024-09-21T00:23:53.838353+0000 mgr.a (mgr.14388) 5596 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:55 smithi179 bash[23186]: cluster 2024-09-21T00:23:53.838353+0000 mgr.a (mgr.14388) 5596 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:55 smithi049 bash[23528]: cluster 2024-09-21T00:23:53.838353+0000 mgr.a (mgr.14388) 5596 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:56.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:23:56.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:23:56.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:23:57.609 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: cluster 2024-09-21T00:23:55.840389+0000 mgr.a (mgr.14388) 5597 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:57.609 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:56.349580+0000 mon.a (mon.0) 5030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.609 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:56.356416+0000 mon.a (mon.0) 5031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.609 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:56.363867+0000 mon.a (mon.0) 5032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:57.329799+0000 mon.a (mon.0) 5033 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:23:57.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:57.333754+0000 mon.a (mon.0) 5034 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:23:57.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:57.334663+0000 mon.a (mon.0) 5035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:23:57.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:57.341738+0000 mon.a (mon.0) 5036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:57 smithi049 bash[23528]: audit 2024-09-21T00:23:57.345077+0000 mon.a (mon.0) 5037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:23:57.712 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:23:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:23:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:23:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:23:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:23:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: cluster 2024-09-21T00:23:55.840389+0000 mgr.a (mgr.14388) 5597 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:56.349580+0000 mon.a (mon.0) 5030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:56.356416+0000 mon.a (mon.0) 5031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:56.363867+0000 mon.a (mon.0) 5032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:57.329799+0000 mon.a (mon.0) 5033 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:23:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:57.333754+0000 mon.a (mon.0) 5034 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:23:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:57.334663+0000 mon.a (mon.0) 5035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:23:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:57.341738+0000 mon.a (mon.0) 5036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:57 smithi044 bash[22676]: audit 2024-09-21T00:23:57.345077+0000 mon.a (mon.0) 5037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:23:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: cluster 2024-09-21T00:23:55.840389+0000 mgr.a (mgr.14388) 5597 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:23:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:56.349580+0000 mon.a (mon.0) 5030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:56.356416+0000 mon.a (mon.0) 5031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:56.363867+0000 mon.a (mon.0) 5032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:57.329799+0000 mon.a (mon.0) 5033 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:23:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:57.333754+0000 mon.a (mon.0) 5034 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:23:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:57.334663+0000 mon.a (mon.0) 5035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:23:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:57.341738+0000 mon.a (mon.0) 5036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:23:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:57 smithi179 bash[23186]: audit 2024-09-21T00:23:57.345077+0000 mon.a (mon.0) 5037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:23:58.614 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:58 smithi049 bash[23528]: audit 2024-09-21T00:23:57.249431+0000 mgr.a (mgr.14388) 5598 : audit [DBG] from='client.129996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:58.615 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:58 smithi049 bash[23528]: audit 2024-09-21T00:23:57.346377+0000 mgr.a (mgr.14388) 5599 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:23:58.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:23:58 smithi044 bash[22930]: debug 2024-09-21T00:23:58.407+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:23:58.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:23:58 smithi044 bash[22930]: debug 2024-09-21T00:23:58.407+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:23:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:58 smithi044 bash[22676]: audit 2024-09-21T00:23:57.249431+0000 mgr.a (mgr.14388) 5598 : audit [DBG] from='client.129996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:58 smithi044 bash[22676]: audit 2024-09-21T00:23:57.346377+0000 mgr.a (mgr.14388) 5599 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:23:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:58 smithi179 bash[23186]: audit 2024-09-21T00:23:57.249431+0000 mgr.a (mgr.14388) 5598 : audit [DBG] from='client.129996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:23:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:58 smithi179 bash[23186]: audit 2024-09-21T00:23:57.346377+0000 mgr.a (mgr.14388) 5599 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:23:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:59 smithi049 bash[23528]: cluster 2024-09-21T00:23:57.840987+0000 mgr.a (mgr.14388) 5600 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:59 smithi049 bash[23528]: audit 2024-09-21T00:23:58.411166+0000 mgr.a (mgr.14388) 5601 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:23:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:23:59 smithi049 bash[23528]: cephadm 2024-09-21T00:23:58.412397+0000 mgr.a (mgr.14388) 5602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:23:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:59 smithi044 bash[22676]: cluster 2024-09-21T00:23:57.840987+0000 mgr.a (mgr.14388) 5600 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:59 smithi044 bash[22676]: audit 2024-09-21T00:23:58.411166+0000 mgr.a (mgr.14388) 5601 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:23:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:23:59 smithi044 bash[22676]: cephadm 2024-09-21T00:23:58.412397+0000 mgr.a (mgr.14388) 5602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:23:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:59 smithi179 bash[23186]: cluster 2024-09-21T00:23:57.840987+0000 mgr.a (mgr.14388) 5600 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:23:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:59 smithi179 bash[23186]: audit 2024-09-21T00:23:58.411166+0000 mgr.a (mgr.14388) 5601 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:23:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:23:59 smithi179 bash[23186]: cephadm 2024-09-21T00:23:58.412397+0000 mgr.a (mgr.14388) 5602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:24:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:01 smithi044 bash[22676]: cluster 2024-09-21T00:23:59.841948+0000 mgr.a (mgr.14388) 5603 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:01 smithi179 bash[23186]: cluster 2024-09-21T00:23:59.841948+0000 mgr.a (mgr.14388) 5603 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:01 smithi049 bash[23528]: cluster 2024-09-21T00:23:59.841948+0000 mgr.a (mgr.14388) 5603 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:02.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:02.715 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:02.715 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:03.456 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:03.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:03.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:03 smithi044 bash[22676]: cluster 2024-09-21T00:24:01.844232+0000 mgr.a (mgr.14388) 5604 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:03 smithi179 bash[23186]: cluster 2024-09-21T00:24:01.844232+0000 mgr.a (mgr.14388) 5604 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:03 smithi049 bash[23528]: cluster 2024-09-21T00:24:01.844232+0000 mgr.a (mgr.14388) 5604 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:04 smithi044 bash[22676]: audit 2024-09-21T00:24:03.038944+0000 mgr.a (mgr.14388) 5605 : audit [DBG] from='client.130182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:04 smithi179 bash[23186]: audit 2024-09-21T00:24:03.038944+0000 mgr.a (mgr.14388) 5605 : audit [DBG] from='client.130182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:04.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:04 smithi049 bash[23528]: audit 2024-09-21T00:24:03.038944+0000 mgr.a (mgr.14388) 5605 : audit [DBG] from='client.130182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:05 smithi044 bash[22676]: cluster 2024-09-21T00:24:03.845226+0000 mgr.a (mgr.14388) 5606 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:05 smithi179 bash[23186]: cluster 2024-09-21T00:24:03.845226+0000 mgr.a (mgr.14388) 5606 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:05 smithi049 bash[23528]: cluster 2024-09-21T00:24:03.845226+0000 mgr.a (mgr.14388) 5606 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:07 smithi044 bash[22676]: cluster 2024-09-21T00:24:05.847512+0000 mgr.a (mgr.14388) 5607 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:07 smithi179 bash[23186]: cluster 2024-09-21T00:24:05.847512+0000 mgr.a (mgr.14388) 5607 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:07 smithi049 bash[23528]: cluster 2024-09-21T00:24:05.847512+0000 mgr.a (mgr.14388) 5607 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:08.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:08.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:08.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:09.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:09 smithi044 bash[22676]: cluster 2024-09-21T00:24:07.848289+0000 mgr.a (mgr.14388) 5608 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:09 smithi179 bash[23186]: cluster 2024-09-21T00:24:07.848289+0000 mgr.a (mgr.14388) 5608 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:09 smithi049 bash[23528]: cluster 2024-09-21T00:24:07.848289+0000 mgr.a (mgr.14388) 5608 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:10 smithi044 bash[22676]: audit 2024-09-21T00:24:08.794695+0000 mgr.a (mgr.14388) 5609 : audit [DBG] from='client.130260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:10 smithi179 bash[23186]: audit 2024-09-21T00:24:08.794695+0000 mgr.a (mgr.14388) 5609 : audit [DBG] from='client.130260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:10 smithi049 bash[23528]: audit 2024-09-21T00:24:08.794695+0000 mgr.a (mgr.14388) 5609 : audit [DBG] from='client.130260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:11 smithi044 bash[22676]: cluster 2024-09-21T00:24:09.849230+0000 mgr.a (mgr.14388) 5610 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:11 smithi179 bash[23186]: cluster 2024-09-21T00:24:09.849230+0000 mgr.a (mgr.14388) 5610 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:11.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:11 smithi049 bash[23528]: cluster 2024-09-21T00:24:09.849230+0000 mgr.a (mgr.14388) 5610 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:13 smithi044 bash[22676]: cluster 2024-09-21T00:24:11.851519+0000 mgr.a (mgr.14388) 5611 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:13 smithi179 bash[23186]: cluster 2024-09-21T00:24:11.851519+0000 mgr.a (mgr.14388) 5611 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:13 smithi049 bash[23528]: cluster 2024-09-21T00:24:11.851519+0000 mgr.a (mgr.14388) 5611 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:24:14.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:14.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:14.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:14.988 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:14.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:14.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:14.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: audit 2024-09-21T00:24:13.786433+0000 mon.a (mon.0) 5038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: audit 2024-09-21T00:24:13.796630+0000 mon.a (mon.0) 5039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: audit 2024-09-21T00:24:13.808593+0000 mon.a (mon.0) 5040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: cluster 2024-09-21T00:24:13.852285+0000 mgr.a (mgr.14388) 5612 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: audit 2024-09-21T00:24:14.569641+0000 mgr.a (mgr.14388) 5613 : audit [DBG] from='client.130335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: audit 2024-09-21T00:24:14.626120+0000 mon.a (mon.0) 5041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: audit 2024-09-21T00:24:14.634155+0000 mon.a (mon.0) 5042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:14 smithi179 bash[23186]: audit 2024-09-21T00:24:14.641933+0000 mon.a (mon.0) 5043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: audit 2024-09-21T00:24:13.786433+0000 mon.a (mon.0) 5038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: audit 2024-09-21T00:24:13.796630+0000 mon.a (mon.0) 5039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: audit 2024-09-21T00:24:13.808593+0000 mon.a (mon.0) 5040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: cluster 2024-09-21T00:24:13.852285+0000 mgr.a (mgr.14388) 5612 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: audit 2024-09-21T00:24:14.569641+0000 mgr.a (mgr.14388) 5613 : audit [DBG] from='client.130335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: audit 2024-09-21T00:24:14.626120+0000 mon.a (mon.0) 5041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: audit 2024-09-21T00:24:14.634155+0000 mon.a (mon.0) 5042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:14 smithi049 bash[23528]: audit 2024-09-21T00:24:14.641933+0000 mon.a (mon.0) 5043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: audit 2024-09-21T00:24:13.786433+0000 mon.a (mon.0) 5038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: audit 2024-09-21T00:24:13.796630+0000 mon.a (mon.0) 5039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: audit 2024-09-21T00:24:13.808593+0000 mon.a (mon.0) 5040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: cluster 2024-09-21T00:24:13.852285+0000 mgr.a (mgr.14388) 5612 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: audit 2024-09-21T00:24:14.569641+0000 mgr.a (mgr.14388) 5613 : audit [DBG] from='client.130335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: audit 2024-09-21T00:24:14.626120+0000 mon.a (mon.0) 5041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: audit 2024-09-21T00:24:14.634155+0000 mon.a (mon.0) 5042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:14 smithi044 bash[22676]: audit 2024-09-21T00:24:14.641933+0000 mon.a (mon.0) 5043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:17 smithi044 bash[22676]: cluster 2024-09-21T00:24:15.853467+0000 mgr.a (mgr.14388) 5614 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:17 smithi044 bash[22676]: audit 2024-09-21T00:24:16.537850+0000 mon.a (mon.0) 5044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:17 smithi044 bash[22676]: audit 2024-09-21T00:24:16.543279+0000 mon.a (mon.0) 5045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:17 smithi044 bash[22676]: audit 2024-09-21T00:24:16.548472+0000 mon.a (mon.0) 5046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:17 smithi049 bash[23528]: cluster 2024-09-21T00:24:15.853467+0000 mgr.a (mgr.14388) 5614 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:17 smithi049 bash[23528]: audit 2024-09-21T00:24:16.537850+0000 mon.a (mon.0) 5044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:17 smithi049 bash[23528]: audit 2024-09-21T00:24:16.543279+0000 mon.a (mon.0) 5045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:17 smithi049 bash[23528]: audit 2024-09-21T00:24:16.548472+0000 mon.a (mon.0) 5046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:17 smithi179 bash[23186]: cluster 2024-09-21T00:24:15.853467+0000 mgr.a (mgr.14388) 5614 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:17 smithi179 bash[23186]: audit 2024-09-21T00:24:16.537850+0000 mon.a (mon.0) 5044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:17 smithi179 bash[23186]: audit 2024-09-21T00:24:16.543279+0000 mon.a (mon.0) 5045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:17 smithi179 bash[23186]: audit 2024-09-21T00:24:16.548472+0000 mon.a (mon.0) 5046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:19 smithi049 bash[23528]: cluster 2024-09-21T00:24:17.854200+0000 mgr.a (mgr.14388) 5615 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:19 smithi044 bash[22676]: cluster 2024-09-21T00:24:17.854200+0000 mgr.a (mgr.14388) 5615 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:19.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:19.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:19.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:19 smithi179 bash[23186]: cluster 2024-09-21T00:24:17.854200+0000 mgr.a (mgr.14388) 5615 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:20.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:20.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:20.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:20.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:21 smithi049 bash[23528]: cluster 2024-09-21T00:24:19.855127+0000 mgr.a (mgr.14388) 5616 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:21 smithi049 bash[23528]: audit 2024-09-21T00:24:20.319047+0000 mgr.a (mgr.14388) 5617 : audit [DBG] from='client.130407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:21 smithi044 bash[22676]: cluster 2024-09-21T00:24:19.855127+0000 mgr.a (mgr.14388) 5616 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:21 smithi044 bash[22676]: audit 2024-09-21T00:24:20.319047+0000 mgr.a (mgr.14388) 5617 : audit [DBG] from='client.130407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:21 smithi179 bash[23186]: cluster 2024-09-21T00:24:19.855127+0000 mgr.a (mgr.14388) 5616 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:21 smithi179 bash[23186]: audit 2024-09-21T00:24:20.319047+0000 mgr.a (mgr.14388) 5617 : audit [DBG] from='client.130407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:23 smithi044 bash[22676]: cluster 2024-09-21T00:24:21.858077+0000 mgr.a (mgr.14388) 5618 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:23 smithi179 bash[23186]: cluster 2024-09-21T00:24:21.858077+0000 mgr.a (mgr.14388) 5618 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:24.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:23 smithi049 bash[23528]: cluster 2024-09-21T00:24:21.858077+0000 mgr.a (mgr.14388) 5618 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:25.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:25.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:25.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:25 smithi044 bash[22676]: cluster 2024-09-21T00:24:23.859057+0000 mgr.a (mgr.14388) 5619 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:25 smithi179 bash[23186]: cluster 2024-09-21T00:24:23.859057+0000 mgr.a (mgr.14388) 5619 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:25 smithi049 bash[23528]: cluster 2024-09-21T00:24:23.859057+0000 mgr.a (mgr.14388) 5619 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:26.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:26.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:26.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:26.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:26.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:27 smithi044 bash[22676]: cluster 2024-09-21T00:24:25.861063+0000 mgr.a (mgr.14388) 5620 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:27 smithi044 bash[22676]: audit 2024-09-21T00:24:26.111648+0000 mgr.a (mgr.14388) 5621 : audit [DBG] from='client.130482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:27 smithi179 bash[23186]: cluster 2024-09-21T00:24:25.861063+0000 mgr.a (mgr.14388) 5620 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:27 smithi179 bash[23186]: audit 2024-09-21T00:24:26.111648+0000 mgr.a (mgr.14388) 5621 : audit [DBG] from='client.130482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:27 smithi049 bash[23528]: cluster 2024-09-21T00:24:25.861063+0000 mgr.a (mgr.14388) 5620 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:27 smithi049 bash[23528]: audit 2024-09-21T00:24:26.111648+0000 mgr.a (mgr.14388) 5621 : audit [DBG] from='client.130482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:29 smithi044 bash[22676]: cluster 2024-09-21T00:24:27.861994+0000 mgr.a (mgr.14388) 5622 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:29 smithi179 bash[23186]: cluster 2024-09-21T00:24:27.861994+0000 mgr.a (mgr.14388) 5622 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:29 smithi049 bash[23528]: cluster 2024-09-21T00:24:27.861994+0000 mgr.a (mgr.14388) 5622 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:31.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:31 smithi044 bash[22676]: cluster 2024-09-21T00:24:29.862763+0000 mgr.a (mgr.14388) 5623 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:31 smithi179 bash[23186]: cluster 2024-09-21T00:24:29.862763+0000 mgr.a (mgr.14388) 5623 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:32.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:31 smithi049 bash[23528]: cluster 2024-09-21T00:24:29.862763+0000 mgr.a (mgr.14388) 5623 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:33 smithi179 bash[23186]: cluster 2024-09-21T00:24:31.864043+0000 mgr.a (mgr.14388) 5624 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:33 smithi179 bash[23186]: audit 2024-09-21T00:24:31.874354+0000 mgr.a (mgr.14388) 5625 : audit [DBG] from='client.130560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:33 smithi044 bash[22676]: cluster 2024-09-21T00:24:31.864043+0000 mgr.a (mgr.14388) 5624 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:33 smithi044 bash[22676]: audit 2024-09-21T00:24:31.874354+0000 mgr.a (mgr.14388) 5625 : audit [DBG] from='client.130560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:33 smithi049 bash[23528]: cluster 2024-09-21T00:24:31.864043+0000 mgr.a (mgr.14388) 5624 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:33 smithi049 bash[23528]: audit 2024-09-21T00:24:31.874354+0000 mgr.a (mgr.14388) 5625 : audit [DBG] from='client.130560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:35 smithi179 bash[23186]: cluster 2024-09-21T00:24:33.864924+0000 mgr.a (mgr.14388) 5626 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:35 smithi179 bash[23186]: audit 2024-09-21T00:24:34.032376+0000 mon.a (mon.0) 5047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:35 smithi179 bash[23186]: audit 2024-09-21T00:24:34.042535+0000 mon.a (mon.0) 5048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:35 smithi179 bash[23186]: audit 2024-09-21T00:24:34.054452+0000 mon.a (mon.0) 5049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:35 smithi179 bash[23186]: audit 2024-09-21T00:24:34.830826+0000 mon.a (mon.0) 5050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:35 smithi179 bash[23186]: audit 2024-09-21T00:24:34.839736+0000 mon.a (mon.0) 5051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:35 smithi179 bash[23186]: audit 2024-09-21T00:24:34.850362+0000 mon.a (mon.0) 5052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:35 smithi049 bash[23528]: cluster 2024-09-21T00:24:33.864924+0000 mgr.a (mgr.14388) 5626 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:35 smithi049 bash[23528]: audit 2024-09-21T00:24:34.032376+0000 mon.a (mon.0) 5047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:35 smithi049 bash[23528]: audit 2024-09-21T00:24:34.042535+0000 mon.a (mon.0) 5048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:35 smithi049 bash[23528]: audit 2024-09-21T00:24:34.054452+0000 mon.a (mon.0) 5049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:35 smithi049 bash[23528]: audit 2024-09-21T00:24:34.830826+0000 mon.a (mon.0) 5050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:35 smithi049 bash[23528]: audit 2024-09-21T00:24:34.839736+0000 mon.a (mon.0) 5051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:35 smithi049 bash[23528]: audit 2024-09-21T00:24:34.850362+0000 mon.a (mon.0) 5052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:35 smithi044 bash[22676]: cluster 2024-09-21T00:24:33.864924+0000 mgr.a (mgr.14388) 5626 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:35 smithi044 bash[22676]: audit 2024-09-21T00:24:34.032376+0000 mon.a (mon.0) 5047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:35 smithi044 bash[22676]: audit 2024-09-21T00:24:34.042535+0000 mon.a (mon.0) 5048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:35 smithi044 bash[22676]: audit 2024-09-21T00:24:34.054452+0000 mon.a (mon.0) 5049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:35 smithi044 bash[22676]: audit 2024-09-21T00:24:34.830826+0000 mon.a (mon.0) 5050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:35 smithi044 bash[22676]: audit 2024-09-21T00:24:34.839736+0000 mon.a (mon.0) 5051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:35 smithi044 bash[22676]: audit 2024-09-21T00:24:34.850362+0000 mon.a (mon.0) 5052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:37 smithi049 bash[23528]: cluster 2024-09-21T00:24:35.867159+0000 mgr.a (mgr.14388) 5627 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:37 smithi049 bash[23528]: audit 2024-09-21T00:24:36.740380+0000 mon.a (mon.0) 5053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:37 smithi049 bash[23528]: audit 2024-09-21T00:24:36.745757+0000 mon.a (mon.0) 5054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:37 smithi049 bash[23528]: audit 2024-09-21T00:24:36.751765+0000 mon.a (mon.0) 5055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:37.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:37.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:37 smithi044 bash[22676]: cluster 2024-09-21T00:24:35.867159+0000 mgr.a (mgr.14388) 5627 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:37 smithi044 bash[22676]: audit 2024-09-21T00:24:36.740380+0000 mon.a (mon.0) 5053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:37 smithi044 bash[22676]: audit 2024-09-21T00:24:36.745757+0000 mon.a (mon.0) 5054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:37 smithi044 bash[22676]: audit 2024-09-21T00:24:36.751765+0000 mon.a (mon.0) 5055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:37 smithi179 bash[23186]: cluster 2024-09-21T00:24:35.867159+0000 mgr.a (mgr.14388) 5627 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:37 smithi179 bash[23186]: audit 2024-09-21T00:24:36.740380+0000 mon.a (mon.0) 5053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:37 smithi179 bash[23186]: audit 2024-09-21T00:24:36.745757+0000 mon.a (mon.0) 5054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:37 smithi179 bash[23186]: audit 2024-09-21T00:24:36.751765+0000 mon.a (mon.0) 5055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:38.117 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:38.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:38.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:38.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:38.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:39 smithi049 bash[23528]: audit 2024-09-21T00:24:37.658017+0000 mgr.a (mgr.14388) 5628 : audit [DBG] from='client.130638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:39 smithi049 bash[23528]: cluster 2024-09-21T00:24:37.867708+0000 mgr.a (mgr.14388) 5629 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:39 smithi044 bash[22676]: audit 2024-09-21T00:24:37.658017+0000 mgr.a (mgr.14388) 5628 : audit [DBG] from='client.130638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:39 smithi044 bash[22676]: cluster 2024-09-21T00:24:37.867708+0000 mgr.a (mgr.14388) 5629 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:39 smithi179 bash[23186]: audit 2024-09-21T00:24:37.658017+0000 mgr.a (mgr.14388) 5628 : audit [DBG] from='client.130638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:39 smithi179 bash[23186]: cluster 2024-09-21T00:24:37.867708+0000 mgr.a (mgr.14388) 5629 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:41 smithi049 bash[23528]: cluster 2024-09-21T00:24:39.868570+0000 mgr.a (mgr.14388) 5630 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:41 smithi044 bash[22676]: cluster 2024-09-21T00:24:39.868570+0000 mgr.a (mgr.14388) 5630 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:41 smithi179 bash[23186]: cluster 2024-09-21T00:24:39.868570+0000 mgr.a (mgr.14388) 5630 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:43.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:43.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:43.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:43 smithi049 bash[23528]: cluster 2024-09-21T00:24:41.870906+0000 mgr.a (mgr.14388) 5631 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:43 smithi044 bash[22676]: cluster 2024-09-21T00:24:41.870906+0000 mgr.a (mgr.14388) 5631 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:43 smithi179 bash[23186]: cluster 2024-09-21T00:24:41.870906+0000 mgr.a (mgr.14388) 5631 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:43.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:43.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:43.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:43.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:43.877 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:44 smithi044 bash[22676]: audit 2024-09-21T00:24:43.443387+0000 mgr.a (mgr.14388) 5632 : audit [DBG] from='client.130716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:44 smithi179 bash[23186]: audit 2024-09-21T00:24:43.443387+0000 mgr.a (mgr.14388) 5632 : audit [DBG] from='client.130716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:44.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:44 smithi049 bash[23528]: audit 2024-09-21T00:24:43.443387+0000 mgr.a (mgr.14388) 5632 : audit [DBG] from='client.130716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:45 smithi044 bash[22676]: cluster 2024-09-21T00:24:43.871412+0000 mgr.a (mgr.14388) 5633 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:45 smithi179 bash[23186]: cluster 2024-09-21T00:24:43.871412+0000 mgr.a (mgr.14388) 5633 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:45 smithi049 bash[23528]: cluster 2024-09-21T00:24:43.871412+0000 mgr.a (mgr.14388) 5633 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:47 smithi044 bash[22676]: cluster 2024-09-21T00:24:45.873629+0000 mgr.a (mgr.14388) 5634 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:47 smithi179 bash[23186]: cluster 2024-09-21T00:24:45.873629+0000 mgr.a (mgr.14388) 5634 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:47 smithi049 bash[23528]: cluster 2024-09-21T00:24:45.873629+0000 mgr.a (mgr.14388) 5634 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:48.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:48.876 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:48.876 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:49 smithi044 bash[22676]: cluster 2024-09-21T00:24:47.874394+0000 mgr.a (mgr.14388) 5635 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:49 smithi179 bash[23186]: cluster 2024-09-21T00:24:47.874394+0000 mgr.a (mgr.14388) 5635 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:49.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:49 smithi049 bash[23528]: cluster 2024-09-21T00:24:47.874394+0000 mgr.a (mgr.14388) 5635 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:49.652 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:49.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:49.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:49.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:49.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:50 smithi044 bash[22676]: audit 2024-09-21T00:24:49.215630+0000 mgr.a (mgr.14388) 5636 : audit [DBG] from='client.130791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:50 smithi179 bash[23186]: audit 2024-09-21T00:24:49.215630+0000 mgr.a (mgr.14388) 5636 : audit [DBG] from='client.130791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:50.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:50 smithi049 bash[23528]: audit 2024-09-21T00:24:49.215630+0000 mgr.a (mgr.14388) 5636 : audit [DBG] from='client.130791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:51 smithi044 bash[22676]: cluster 2024-09-21T00:24:49.875312+0000 mgr.a (mgr.14388) 5637 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:51 smithi179 bash[23186]: cluster 2024-09-21T00:24:49.875312+0000 mgr.a (mgr.14388) 5637 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:51.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:51 smithi049 bash[23528]: cluster 2024-09-21T00:24:49.875312+0000 mgr.a (mgr.14388) 5637 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:53.359 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:53 smithi179 bash[23186]: cluster 2024-09-21T00:24:51.877539+0000 mgr.a (mgr.14388) 5638 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:53 smithi044 bash[22676]: cluster 2024-09-21T00:24:51.877539+0000 mgr.a (mgr.14388) 5638 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:53.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:53 smithi049 bash[23528]: cluster 2024-09-21T00:24:51.877539+0000 mgr.a (mgr.14388) 5638 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:24:54.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:24:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:24:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:24:55.443 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:24:55.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:24:55.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:24:55.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:24:55.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:24:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:55 smithi044 bash[22676]: cluster 2024-09-21T00:24:53.878420+0000 mgr.a (mgr.14388) 5639 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:55 smithi044 bash[22676]: audit 2024-09-21T00:24:54.270407+0000 mon.a (mon.0) 5056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:55 smithi044 bash[22676]: audit 2024-09-21T00:24:54.278944+0000 mon.a (mon.0) 5057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:55 smithi044 bash[22676]: audit 2024-09-21T00:24:54.289481+0000 mon.a (mon.0) 5058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:55 smithi044 bash[22676]: audit 2024-09-21T00:24:55.030410+0000 mon.a (mon.0) 5059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:55 smithi044 bash[22676]: audit 2024-09-21T00:24:55.037321+0000 mon.a (mon.0) 5060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:55 smithi044 bash[22676]: audit 2024-09-21T00:24:55.044453+0000 mon.a (mon.0) 5061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:55 smithi049 bash[23528]: cluster 2024-09-21T00:24:53.878420+0000 mgr.a (mgr.14388) 5639 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:55 smithi049 bash[23528]: audit 2024-09-21T00:24:54.270407+0000 mon.a (mon.0) 5056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:55 smithi049 bash[23528]: audit 2024-09-21T00:24:54.278944+0000 mon.a (mon.0) 5057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:55 smithi049 bash[23528]: audit 2024-09-21T00:24:54.289481+0000 mon.a (mon.0) 5058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:55 smithi049 bash[23528]: audit 2024-09-21T00:24:55.030410+0000 mon.a (mon.0) 5059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:55 smithi049 bash[23528]: audit 2024-09-21T00:24:55.037321+0000 mon.a (mon.0) 5060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:55 smithi049 bash[23528]: audit 2024-09-21T00:24:55.044453+0000 mon.a (mon.0) 5061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.682 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:55 smithi179 bash[23186]: cluster 2024-09-21T00:24:53.878420+0000 mgr.a (mgr.14388) 5639 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:55.682 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:55 smithi179 bash[23186]: audit 2024-09-21T00:24:54.270407+0000 mon.a (mon.0) 5056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.682 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:55 smithi179 bash[23186]: audit 2024-09-21T00:24:54.278944+0000 mon.a (mon.0) 5057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.682 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:55 smithi179 bash[23186]: audit 2024-09-21T00:24:54.289481+0000 mon.a (mon.0) 5058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.683 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:55 smithi179 bash[23186]: audit 2024-09-21T00:24:55.030410+0000 mon.a (mon.0) 5059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.683 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:55 smithi179 bash[23186]: audit 2024-09-21T00:24:55.037321+0000 mon.a (mon.0) 5060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:55.683 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:55 smithi179 bash[23186]: audit 2024-09-21T00:24:55.044453+0000 mon.a (mon.0) 5061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:56.418 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:56 smithi044 bash[22676]: audit 2024-09-21T00:24:54.990906+0000 mgr.a (mgr.14388) 5640 : audit [DBG] from='client.130869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:56.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:56 smithi049 bash[23528]: audit 2024-09-21T00:24:54.990906+0000 mgr.a (mgr.14388) 5640 : audit [DBG] from='client.130869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:56 smithi179 bash[23186]: audit 2024-09-21T00:24:54.990906+0000 mgr.a (mgr.14388) 5640 : audit [DBG] from='client.130869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:24:57.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:57 smithi049 bash[23528]: cluster 2024-09-21T00:24:55.881404+0000 mgr.a (mgr.14388) 5641 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:57 smithi049 bash[23528]: audit 2024-09-21T00:24:56.964231+0000 mon.a (mon.0) 5062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:57 smithi049 bash[23528]: audit 2024-09-21T00:24:56.972590+0000 mon.a (mon.0) 5063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:57 smithi049 bash[23528]: audit 2024-09-21T00:24:56.983209+0000 mon.a (mon.0) 5064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:57 smithi044 bash[22676]: cluster 2024-09-21T00:24:55.881404+0000 mgr.a (mgr.14388) 5641 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:57 smithi044 bash[22676]: audit 2024-09-21T00:24:56.964231+0000 mon.a (mon.0) 5062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:57 smithi044 bash[22676]: audit 2024-09-21T00:24:56.972590+0000 mon.a (mon.0) 5063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:57 smithi044 bash[22676]: audit 2024-09-21T00:24:56.983209+0000 mon.a (mon.0) 5064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:57 smithi179 bash[23186]: cluster 2024-09-21T00:24:55.881404+0000 mgr.a (mgr.14388) 5641 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:24:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:57 smithi179 bash[23186]: audit 2024-09-21T00:24:56.964231+0000 mon.a (mon.0) 5062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:57 smithi179 bash[23186]: audit 2024-09-21T00:24:56.972590+0000 mon.a (mon.0) 5063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:57 smithi179 bash[23186]: audit 2024-09-21T00:24:56.983209+0000 mon.a (mon.0) 5064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:59 smithi049 bash[23528]: cluster 2024-09-21T00:24:57.882356+0000 mgr.a (mgr.14388) 5642 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:59 smithi049 bash[23528]: audit 2024-09-21T00:24:58.465948+0000 mon.a (mon.0) 5065 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:24:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:59 smithi049 bash[23528]: audit 2024-09-21T00:24:58.470094+0000 mon.a (mon.0) 5066 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:24:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:59 smithi049 bash[23528]: audit 2024-09-21T00:24:58.471208+0000 mon.a (mon.0) 5067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:24:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:59 smithi049 bash[23528]: audit 2024-09-21T00:24:58.480043+0000 mon.a (mon.0) 5068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:59 smithi049 bash[23528]: audit 2024-09-21T00:24:58.483840+0000 mon.a (mon.0) 5069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:24:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:24:59 smithi049 bash[23528]: audit 2024-09-21T00:24:58.485114+0000 mgr.a (mgr.14388) 5643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:24:59.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22930]: debug 2024-09-21T00:24:59.234+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:24:59.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22930]: debug 2024-09-21T00:24:59.234+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:24:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22676]: cluster 2024-09-21T00:24:57.882356+0000 mgr.a (mgr.14388) 5642 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22676]: audit 2024-09-21T00:24:58.465948+0000 mon.a (mon.0) 5065 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:24:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22676]: audit 2024-09-21T00:24:58.470094+0000 mon.a (mon.0) 5066 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:24:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22676]: audit 2024-09-21T00:24:58.471208+0000 mon.a (mon.0) 5067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:24:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22676]: audit 2024-09-21T00:24:58.480043+0000 mon.a (mon.0) 5068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22676]: audit 2024-09-21T00:24:58.483840+0000 mon.a (mon.0) 5069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:24:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:24:59 smithi044 bash[22676]: audit 2024-09-21T00:24:58.485114+0000 mgr.a (mgr.14388) 5643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:24:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:59 smithi179 bash[23186]: cluster 2024-09-21T00:24:57.882356+0000 mgr.a (mgr.14388) 5642 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:24:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:59 smithi179 bash[23186]: audit 2024-09-21T00:24:58.465948+0000 mon.a (mon.0) 5065 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:24:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:59 smithi179 bash[23186]: audit 2024-09-21T00:24:58.470094+0000 mon.a (mon.0) 5066 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:24:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:59 smithi179 bash[23186]: audit 2024-09-21T00:24:58.471208+0000 mon.a (mon.0) 5067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:24:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:59 smithi179 bash[23186]: audit 2024-09-21T00:24:58.480043+0000 mon.a (mon.0) 5068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:24:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:59 smithi179 bash[23186]: audit 2024-09-21T00:24:58.483840+0000 mon.a (mon.0) 5069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:24:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:24:59 smithi179 bash[23186]: audit 2024-09-21T00:24:58.485114+0000 mgr.a (mgr.14388) 5643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:25:00.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:00.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:00.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:00.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:00 smithi049 bash[23528]: audit 2024-09-21T00:24:59.237558+0000 mgr.a (mgr.14388) 5644 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:25:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:00 smithi049 bash[23528]: cephadm 2024-09-21T00:24:59.238729+0000 mgr.a (mgr.14388) 5645 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:25:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:00 smithi044 bash[22676]: audit 2024-09-21T00:24:59.237558+0000 mgr.a (mgr.14388) 5644 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:25:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:00 smithi044 bash[22676]: cephadm 2024-09-21T00:24:59.238729+0000 mgr.a (mgr.14388) 5645 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:25:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:00 smithi179 bash[23186]: audit 2024-09-21T00:24:59.237558+0000 mgr.a (mgr.14388) 5644 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:25:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:00 smithi179 bash[23186]: cephadm 2024-09-21T00:24:59.238729+0000 mgr.a (mgr.14388) 5645 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:25:01.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:01.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:01.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:01.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:01.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:01 smithi049 bash[23528]: cluster 2024-09-21T00:24:59.883313+0000 mgr.a (mgr.14388) 5646 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:01 smithi044 bash[22676]: cluster 2024-09-21T00:24:59.883313+0000 mgr.a (mgr.14388) 5646 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:01 smithi179 bash[23186]: cluster 2024-09-21T00:24:59.883313+0000 mgr.a (mgr.14388) 5646 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:02 smithi044 bash[22676]: audit 2024-09-21T00:25:00.783380+0000 mgr.a (mgr.14388) 5647 : audit [DBG] from='client.131052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:02 smithi179 bash[23186]: audit 2024-09-21T00:25:00.783380+0000 mgr.a (mgr.14388) 5647 : audit [DBG] from='client.131052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:02 smithi049 bash[23528]: audit 2024-09-21T00:25:00.783380+0000 mgr.a (mgr.14388) 5647 : audit [DBG] from='client.131052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:03.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:03 smithi044 bash[22676]: cluster 2024-09-21T00:25:01.885143+0000 mgr.a (mgr.14388) 5648 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:03 smithi179 bash[23186]: cluster 2024-09-21T00:25:01.885143+0000 mgr.a (mgr.14388) 5648 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:03 smithi049 bash[23528]: cluster 2024-09-21T00:25:01.885143+0000 mgr.a (mgr.14388) 5648 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:05 smithi044 bash[22676]: cluster 2024-09-21T00:25:03.885727+0000 mgr.a (mgr.14388) 5649 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:25:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:05 smithi179 bash[23186]: cluster 2024-09-21T00:25:03.885727+0000 mgr.a (mgr.14388) 5649 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:25:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:05 smithi049 bash[23528]: cluster 2024-09-21T00:25:03.885727+0000 mgr.a (mgr.14388) 5649 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:25:06.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:06.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:06.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:07.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:07.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:07.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:07.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:07.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:07 smithi044 bash[22676]: cluster 2024-09-21T00:25:05.887705+0000 mgr.a (mgr.14388) 5650 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:07 smithi044 bash[22676]: audit 2024-09-21T00:25:06.580873+0000 mgr.a (mgr.14388) 5651 : audit [DBG] from='client.131127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:07 smithi179 bash[23186]: cluster 2024-09-21T00:25:05.887705+0000 mgr.a (mgr.14388) 5650 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:07 smithi179 bash[23186]: audit 2024-09-21T00:25:06.580873+0000 mgr.a (mgr.14388) 5651 : audit [DBG] from='client.131127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:07 smithi049 bash[23528]: cluster 2024-09-21T00:25:05.887705+0000 mgr.a (mgr.14388) 5650 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:07 smithi049 bash[23528]: audit 2024-09-21T00:25:06.580873+0000 mgr.a (mgr.14388) 5651 : audit [DBG] from='client.131127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:09 smithi044 bash[22676]: cluster 2024-09-21T00:25:07.888603+0000 mgr.a (mgr.14388) 5652 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:09 smithi179 bash[23186]: cluster 2024-09-21T00:25:07.888603+0000 mgr.a (mgr.14388) 5652 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:09 smithi049 bash[23528]: cluster 2024-09-21T00:25:07.888603+0000 mgr.a (mgr.14388) 5652 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:11 smithi044 bash[22676]: cluster 2024-09-21T00:25:09.889456+0000 mgr.a (mgr.14388) 5653 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:11 smithi179 bash[23186]: cluster 2024-09-21T00:25:09.889456+0000 mgr.a (mgr.14388) 5653 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:11 smithi049 bash[23528]: cluster 2024-09-21T00:25:09.889456+0000 mgr.a (mgr.14388) 5653 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:12.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:12.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:12.769 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:13.623 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:13 smithi179 bash[23186]: cluster 2024-09-21T00:25:11.891677+0000 mgr.a (mgr.14388) 5654 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:13.623 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:13 smithi179 bash[23186]: audit 2024-09-21T00:25:12.343035+0000 mgr.a (mgr.14388) 5655 : audit [DBG] from='client.131205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:13 smithi044 bash[22676]: cluster 2024-09-21T00:25:11.891677+0000 mgr.a (mgr.14388) 5654 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:13 smithi044 bash[22676]: audit 2024-09-21T00:25:12.343035+0000 mgr.a (mgr.14388) 5655 : audit [DBG] from='client.131205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:13 smithi049 bash[23528]: cluster 2024-09-21T00:25:11.891677+0000 mgr.a (mgr.14388) 5654 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:25:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:13 smithi049 bash[23528]: audit 2024-09-21T00:25:12.343035+0000 mgr.a (mgr.14388) 5655 : audit [DBG] from='client.131205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:15 smithi179 bash[23186]: cluster 2024-09-21T00:25:13.892577+0000 mgr.a (mgr.14388) 5656 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:15 smithi179 bash[23186]: audit 2024-09-21T00:25:14.505363+0000 mon.a (mon.0) 5070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:15 smithi179 bash[23186]: audit 2024-09-21T00:25:14.513886+0000 mon.a (mon.0) 5071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:15 smithi179 bash[23186]: audit 2024-09-21T00:25:14.524366+0000 mon.a (mon.0) 5072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:15 smithi179 bash[23186]: audit 2024-09-21T00:25:15.217336+0000 mon.a (mon.0) 5073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:15 smithi179 bash[23186]: audit 2024-09-21T00:25:15.225775+0000 mon.a (mon.0) 5074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:15 smithi179 bash[23186]: audit 2024-09-21T00:25:15.236004+0000 mon.a (mon.0) 5075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:15 smithi049 bash[23528]: cluster 2024-09-21T00:25:13.892577+0000 mgr.a (mgr.14388) 5656 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:15 smithi049 bash[23528]: audit 2024-09-21T00:25:14.505363+0000 mon.a (mon.0) 5070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:15 smithi049 bash[23528]: audit 2024-09-21T00:25:14.513886+0000 mon.a (mon.0) 5071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:15 smithi049 bash[23528]: audit 2024-09-21T00:25:14.524366+0000 mon.a (mon.0) 5072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:15 smithi049 bash[23528]: audit 2024-09-21T00:25:15.217336+0000 mon.a (mon.0) 5073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:15 smithi049 bash[23528]: audit 2024-09-21T00:25:15.225775+0000 mon.a (mon.0) 5074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:15 smithi049 bash[23528]: audit 2024-09-21T00:25:15.236004+0000 mon.a (mon.0) 5075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:15 smithi044 bash[22676]: cluster 2024-09-21T00:25:13.892577+0000 mgr.a (mgr.14388) 5656 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:15 smithi044 bash[22676]: audit 2024-09-21T00:25:14.505363+0000 mon.a (mon.0) 5070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:15 smithi044 bash[22676]: audit 2024-09-21T00:25:14.513886+0000 mon.a (mon.0) 5071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:15 smithi044 bash[22676]: audit 2024-09-21T00:25:14.524366+0000 mon.a (mon.0) 5072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:15 smithi044 bash[22676]: audit 2024-09-21T00:25:15.217336+0000 mon.a (mon.0) 5073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:15 smithi044 bash[22676]: audit 2024-09-21T00:25:15.225775+0000 mon.a (mon.0) 5074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:15 smithi044 bash[22676]: audit 2024-09-21T00:25:15.236004+0000 mon.a (mon.0) 5075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:17.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:17.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:17.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:17.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:17 smithi049 bash[23528]: cluster 2024-09-21T00:25:15.894826+0000 mgr.a (mgr.14388) 5657 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:17 smithi049 bash[23528]: audit 2024-09-21T00:25:17.180288+0000 mon.a (mon.0) 5076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:17 smithi049 bash[23528]: audit 2024-09-21T00:25:17.186249+0000 mon.a (mon.0) 5077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:17 smithi049 bash[23528]: audit 2024-09-21T00:25:17.192260+0000 mon.a (mon.0) 5078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:17 smithi044 bash[22676]: cluster 2024-09-21T00:25:15.894826+0000 mgr.a (mgr.14388) 5657 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:17 smithi044 bash[22676]: audit 2024-09-21T00:25:17.180288+0000 mon.a (mon.0) 5076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:17 smithi044 bash[22676]: audit 2024-09-21T00:25:17.186249+0000 mon.a (mon.0) 5077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:17 smithi044 bash[22676]: audit 2024-09-21T00:25:17.192260+0000 mon.a (mon.0) 5078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:17 smithi179 bash[23186]: cluster 2024-09-21T00:25:15.894826+0000 mgr.a (mgr.14388) 5657 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:17 smithi179 bash[23186]: audit 2024-09-21T00:25:17.180288+0000 mon.a (mon.0) 5076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:17 smithi179 bash[23186]: audit 2024-09-21T00:25:17.186249+0000 mon.a (mon.0) 5077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:17 smithi179 bash[23186]: audit 2024-09-21T00:25:17.192260+0000 mon.a (mon.0) 5078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:18.531 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:18.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:18.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:18.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:18.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:19.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:19 smithi049 bash[23528]: cluster 2024-09-21T00:25:17.895362+0000 mgr.a (mgr.14388) 5658 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:19.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:19 smithi049 bash[23528]: audit 2024-09-21T00:25:18.100709+0000 mgr.a (mgr.14388) 5659 : audit [DBG] from='client.131283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:19 smithi044 bash[22676]: cluster 2024-09-21T00:25:17.895362+0000 mgr.a (mgr.14388) 5658 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:19 smithi044 bash[22676]: audit 2024-09-21T00:25:18.100709+0000 mgr.a (mgr.14388) 5659 : audit [DBG] from='client.131283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:19 smithi179 bash[23186]: cluster 2024-09-21T00:25:17.895362+0000 mgr.a (mgr.14388) 5658 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:19 smithi179 bash[23186]: audit 2024-09-21T00:25:18.100709+0000 mgr.a (mgr.14388) 5659 : audit [DBG] from='client.131283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:21 smithi049 bash[23528]: cluster 2024-09-21T00:25:19.896238+0000 mgr.a (mgr.14388) 5660 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:21 smithi044 bash[22676]: cluster 2024-09-21T00:25:19.896238+0000 mgr.a (mgr.14388) 5660 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:21 smithi179 bash[23186]: cluster 2024-09-21T00:25:19.896238+0000 mgr.a (mgr.14388) 5660 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:23.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:23.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:23.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:23 smithi049 bash[23528]: cluster 2024-09-21T00:25:21.898519+0000 mgr.a (mgr.14388) 5661 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:23 smithi044 bash[22676]: cluster 2024-09-21T00:25:21.898519+0000 mgr.a (mgr.14388) 5661 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:23 smithi179 bash[23186]: cluster 2024-09-21T00:25:21.898519+0000 mgr.a (mgr.14388) 5661 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:24.287 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:25 smithi049 bash[23528]: audit 2024-09-21T00:25:23.865506+0000 mgr.a (mgr.14388) 5662 : audit [DBG] from='client.131361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:25 smithi049 bash[23528]: cluster 2024-09-21T00:25:23.899262+0000 mgr.a (mgr.14388) 5663 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:25 smithi044 bash[22676]: audit 2024-09-21T00:25:23.865506+0000 mgr.a (mgr.14388) 5662 : audit [DBG] from='client.131361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:25 smithi044 bash[22676]: cluster 2024-09-21T00:25:23.899262+0000 mgr.a (mgr.14388) 5663 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:25 smithi179 bash[23186]: audit 2024-09-21T00:25:23.865506+0000 mgr.a (mgr.14388) 5662 : audit [DBG] from='client.131361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:25 smithi179 bash[23186]: cluster 2024-09-21T00:25:23.899262+0000 mgr.a (mgr.14388) 5663 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:27 smithi049 bash[23528]: cluster 2024-09-21T00:25:25.901728+0000 mgr.a (mgr.14388) 5664 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:27 smithi044 bash[22676]: cluster 2024-09-21T00:25:25.901728+0000 mgr.a (mgr.14388) 5664 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:27 smithi179 bash[23186]: cluster 2024-09-21T00:25:25.901728+0000 mgr.a (mgr.14388) 5664 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:25:29.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:29.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:29.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:29 smithi049 bash[23528]: cluster 2024-09-21T00:25:27.902521+0000 mgr.a (mgr.14388) 5665 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:29 smithi044 bash[22676]: cluster 2024-09-21T00:25:27.902521+0000 mgr.a (mgr.14388) 5665 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:29 smithi179 bash[23186]: cluster 2024-09-21T00:25:27.902521+0000 mgr.a (mgr.14388) 5665 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:30.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:30.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:30.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:30.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:30.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:31 smithi049 bash[23528]: audit 2024-09-21T00:25:29.626892+0000 mgr.a (mgr.14388) 5666 : audit [DBG] from='client.131439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:31 smithi049 bash[23528]: cluster 2024-09-21T00:25:29.903333+0000 mgr.a (mgr.14388) 5667 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:31 smithi044 bash[22676]: audit 2024-09-21T00:25:29.626892+0000 mgr.a (mgr.14388) 5666 : audit [DBG] from='client.131439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:31 smithi044 bash[22676]: cluster 2024-09-21T00:25:29.903333+0000 mgr.a (mgr.14388) 5667 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:31 smithi179 bash[23186]: audit 2024-09-21T00:25:29.626892+0000 mgr.a (mgr.14388) 5666 : audit [DBG] from='client.131439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:31 smithi179 bash[23186]: cluster 2024-09-21T00:25:29.903333+0000 mgr.a (mgr.14388) 5667 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:33.594 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:33 smithi179 bash[23186]: cluster 2024-09-21T00:25:31.905896+0000 mgr.a (mgr.14388) 5668 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:25:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:33 smithi049 bash[23528]: cluster 2024-09-21T00:25:31.905896+0000 mgr.a (mgr.14388) 5668 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:25:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:33 smithi044 bash[22676]: cluster 2024-09-21T00:25:31.905896+0000 mgr.a (mgr.14388) 5668 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:25:35.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:35.080 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:35.080 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:35 smithi179 bash[23186]: cluster 2024-09-21T00:25:33.906879+0000 mgr.a (mgr.14388) 5669 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:25:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:35 smithi179 bash[23186]: audit 2024-09-21T00:25:34.740600+0000 mon.a (mon.0) 5079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:35 smithi179 bash[23186]: audit 2024-09-21T00:25:34.751007+0000 mon.a (mon.0) 5080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:35 smithi179 bash[23186]: audit 2024-09-21T00:25:34.762510+0000 mon.a (mon.0) 5081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:35 smithi179 bash[23186]: audit 2024-09-21T00:25:35.387106+0000 mon.a (mon.0) 5082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:35 smithi179 bash[23186]: audit 2024-09-21T00:25:35.396522+0000 mon.a (mon.0) 5083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:35 smithi179 bash[23186]: audit 2024-09-21T00:25:35.407478+0000 mon.a (mon.0) 5084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:35 smithi049 bash[23528]: cluster 2024-09-21T00:25:33.906879+0000 mgr.a (mgr.14388) 5669 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:25:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:35 smithi049 bash[23528]: audit 2024-09-21T00:25:34.740600+0000 mon.a (mon.0) 5079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:35 smithi049 bash[23528]: audit 2024-09-21T00:25:34.751007+0000 mon.a (mon.0) 5080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:35 smithi049 bash[23528]: audit 2024-09-21T00:25:34.762510+0000 mon.a (mon.0) 5081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:35 smithi049 bash[23528]: audit 2024-09-21T00:25:35.387106+0000 mon.a (mon.0) 5082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:35 smithi049 bash[23528]: audit 2024-09-21T00:25:35.396522+0000 mon.a (mon.0) 5083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:35 smithi049 bash[23528]: audit 2024-09-21T00:25:35.407478+0000 mon.a (mon.0) 5084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:35.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:35.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:35.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:35.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:35 smithi044 bash[22676]: cluster 2024-09-21T00:25:33.906879+0000 mgr.a (mgr.14388) 5669 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:25:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:35 smithi044 bash[22676]: audit 2024-09-21T00:25:34.740600+0000 mon.a (mon.0) 5079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:35 smithi044 bash[22676]: audit 2024-09-21T00:25:34.751007+0000 mon.a (mon.0) 5080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:35 smithi044 bash[22676]: audit 2024-09-21T00:25:34.762510+0000 mon.a (mon.0) 5081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:35 smithi044 bash[22676]: audit 2024-09-21T00:25:35.387106+0000 mon.a (mon.0) 5082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:35 smithi044 bash[22676]: audit 2024-09-21T00:25:35.396522+0000 mon.a (mon.0) 5083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:35 smithi044 bash[22676]: audit 2024-09-21T00:25:35.407478+0000 mon.a (mon.0) 5084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:36.841 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:36 smithi049 bash[23528]: audit 2024-09-21T00:25:35.412851+0000 mgr.a (mgr.14388) 5670 : audit [DBG] from='client.131517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:36.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:36 smithi044 bash[22676]: audit 2024-09-21T00:25:35.412851+0000 mgr.a (mgr.14388) 5670 : audit [DBG] from='client.131517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:36 smithi179 bash[23186]: audit 2024-09-21T00:25:35.412851+0000 mgr.a (mgr.14388) 5670 : audit [DBG] from='client.131517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:37 smithi044 bash[22676]: cluster 2024-09-21T00:25:35.909731+0000 mgr.a (mgr.14388) 5671 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:37 smithi044 bash[22676]: audit 2024-09-21T00:25:37.394009+0000 mon.a (mon.0) 5085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:37 smithi044 bash[22676]: audit 2024-09-21T00:25:37.400328+0000 mon.a (mon.0) 5086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:37 smithi044 bash[22676]: audit 2024-09-21T00:25:37.408967+0000 mon.a (mon.0) 5087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:37.814 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:37 smithi049 bash[23528]: cluster 2024-09-21T00:25:35.909731+0000 mgr.a (mgr.14388) 5671 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:37.814 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:37 smithi049 bash[23528]: audit 2024-09-21T00:25:37.394009+0000 mon.a (mon.0) 5085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:37.814 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:37 smithi049 bash[23528]: audit 2024-09-21T00:25:37.400328+0000 mon.a (mon.0) 5086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:37.814 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:37 smithi049 bash[23528]: audit 2024-09-21T00:25:37.408967+0000 mon.a (mon.0) 5087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:37 smithi179 bash[23186]: cluster 2024-09-21T00:25:35.909731+0000 mgr.a (mgr.14388) 5671 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:37 smithi179 bash[23186]: audit 2024-09-21T00:25:37.394009+0000 mon.a (mon.0) 5085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:37 smithi179 bash[23186]: audit 2024-09-21T00:25:37.400328+0000 mon.a (mon.0) 5086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:37 smithi179 bash[23186]: audit 2024-09-21T00:25:37.408967+0000 mon.a (mon.0) 5087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:39 smithi044 bash[22676]: cluster 2024-09-21T00:25:37.911063+0000 mgr.a (mgr.14388) 5672 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:39 smithi179 bash[23186]: cluster 2024-09-21T00:25:37.911063+0000 mgr.a (mgr.14388) 5672 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:39 smithi049 bash[23528]: cluster 2024-09-21T00:25:37.911063+0000 mgr.a (mgr.14388) 5672 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:40.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:40.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:40.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:41.626 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:41.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:41 smithi044 bash[22676]: cluster 2024-09-21T00:25:39.911842+0000 mgr.a (mgr.14388) 5673 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:41 smithi179 bash[23186]: cluster 2024-09-21T00:25:39.911842+0000 mgr.a (mgr.14388) 5673 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:41 smithi049 bash[23528]: cluster 2024-09-21T00:25:39.911842+0000 mgr.a (mgr.14388) 5673 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:25:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:42 smithi044 bash[22676]: audit 2024-09-21T00:25:41.166170+0000 mgr.a (mgr.14388) 5674 : audit [DBG] from='client.131592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:42 smithi179 bash[23186]: audit 2024-09-21T00:25:41.166170+0000 mgr.a (mgr.14388) 5674 : audit [DBG] from='client.131592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:43.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:42 smithi049 bash[23528]: audit 2024-09-21T00:25:41.166170+0000 mgr.a (mgr.14388) 5674 : audit [DBG] from='client.131592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:43 smithi044 bash[22676]: cluster 2024-09-21T00:25:41.914749+0000 mgr.a (mgr.14388) 5675 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:43 smithi179 bash[23186]: cluster 2024-09-21T00:25:41.914749+0000 mgr.a (mgr.14388) 5675 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:43 smithi049 bash[23528]: cluster 2024-09-21T00:25:41.914749+0000 mgr.a (mgr.14388) 5675 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:45 smithi044 bash[22676]: cluster 2024-09-21T00:25:43.915560+0000 mgr.a (mgr.14388) 5676 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:25:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:45 smithi179 bash[23186]: cluster 2024-09-21T00:25:43.915560+0000 mgr.a (mgr.14388) 5676 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:25:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:45 smithi049 bash[23528]: cluster 2024-09-21T00:25:43.915560+0000 mgr.a (mgr.14388) 5676 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:25:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:47.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:47.395 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:47 smithi049 bash[23528]: cluster 2024-09-21T00:25:45.917627+0000 mgr.a (mgr.14388) 5677 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:25:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:47 smithi044 bash[22676]: cluster 2024-09-21T00:25:45.917627+0000 mgr.a (mgr.14388) 5677 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:25:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:47 smithi179 bash[23186]: cluster 2024-09-21T00:25:45.917627+0000 mgr.a (mgr.14388) 5677 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:25:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:48 smithi044 bash[22676]: audit 2024-09-21T00:25:46.957533+0000 mgr.a (mgr.14388) 5678 : audit [DBG] from='client.131667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:48 smithi179 bash[23186]: audit 2024-09-21T00:25:46.957533+0000 mgr.a (mgr.14388) 5678 : audit [DBG] from='client.131667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:49.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:48 smithi049 bash[23528]: audit 2024-09-21T00:25:46.957533+0000 mgr.a (mgr.14388) 5678 : audit [DBG] from='client.131667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:49 smithi044 bash[22676]: cluster 2024-09-21T00:25:47.918774+0000 mgr.a (mgr.14388) 5679 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:49 smithi179 bash[23186]: cluster 2024-09-21T00:25:47.918774+0000 mgr.a (mgr.14388) 5679 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:49 smithi049 bash[23528]: cluster 2024-09-21T00:25:47.918774+0000 mgr.a (mgr.14388) 5679 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:51 smithi044 bash[22676]: cluster 2024-09-21T00:25:49.919596+0000 mgr.a (mgr.14388) 5680 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:51 smithi179 bash[23186]: cluster 2024-09-21T00:25:49.919596+0000 mgr.a (mgr.14388) 5680 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:51 smithi049 bash[23528]: cluster 2024-09-21T00:25:49.919596+0000 mgr.a (mgr.14388) 5680 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:25:52.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:52.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:52.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:53.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:53.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:53.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:53 smithi179 bash[23186]: cluster 2024-09-21T00:25:51.921883+0000 mgr.a (mgr.14388) 5681 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:25:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:53 smithi044 bash[22676]: cluster 2024-09-21T00:25:51.921883+0000 mgr.a (mgr.14388) 5681 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:25:54.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:53 smithi049 bash[23528]: cluster 2024-09-21T00:25:51.921883+0000 mgr.a (mgr.14388) 5681 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:25:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:54 smithi044 bash[22676]: audit 2024-09-21T00:25:52.732717+0000 mgr.a (mgr.14388) 5682 : audit [DBG] from='client.131742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:54 smithi179 bash[23186]: audit 2024-09-21T00:25:52.732717+0000 mgr.a (mgr.14388) 5682 : audit [DBG] from='client.131742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:55.003 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:54 smithi049 bash[23528]: audit 2024-09-21T00:25:52.732717+0000 mgr.a (mgr.14388) 5682 : audit [DBG] from='client.131742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:55 smithi044 bash[22676]: cluster 2024-09-21T00:25:53.922866+0000 mgr.a (mgr.14388) 5683 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:25:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:55 smithi044 bash[22676]: audit 2024-09-21T00:25:54.980432+0000 mon.a (mon.0) 5088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:55 smithi044 bash[22676]: audit 2024-09-21T00:25:54.989612+0000 mon.a (mon.0) 5089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:55 smithi044 bash[22676]: audit 2024-09-21T00:25:55.000564+0000 mon.a (mon.0) 5090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:55 smithi044 bash[22676]: audit 2024-09-21T00:25:55.595979+0000 mon.a (mon.0) 5091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:55 smithi044 bash[22676]: audit 2024-09-21T00:25:55.604632+0000 mon.a (mon.0) 5092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:55 smithi044 bash[22676]: audit 2024-09-21T00:25:55.615043+0000 mon.a (mon.0) 5093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:55 smithi179 bash[23186]: cluster 2024-09-21T00:25:53.922866+0000 mgr.a (mgr.14388) 5683 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:25:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:55 smithi179 bash[23186]: audit 2024-09-21T00:25:54.980432+0000 mon.a (mon.0) 5088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:55 smithi179 bash[23186]: audit 2024-09-21T00:25:54.989612+0000 mon.a (mon.0) 5089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:55 smithi179 bash[23186]: audit 2024-09-21T00:25:55.000564+0000 mon.a (mon.0) 5090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:55 smithi179 bash[23186]: audit 2024-09-21T00:25:55.595979+0000 mon.a (mon.0) 5091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:55 smithi179 bash[23186]: audit 2024-09-21T00:25:55.604632+0000 mon.a (mon.0) 5092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:55 smithi179 bash[23186]: audit 2024-09-21T00:25:55.615043+0000 mon.a (mon.0) 5093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:55 smithi049 bash[23528]: cluster 2024-09-21T00:25:53.922866+0000 mgr.a (mgr.14388) 5683 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:25:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:55 smithi049 bash[23528]: audit 2024-09-21T00:25:54.980432+0000 mon.a (mon.0) 5088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:55 smithi049 bash[23528]: audit 2024-09-21T00:25:54.989612+0000 mon.a (mon.0) 5089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:55 smithi049 bash[23528]: audit 2024-09-21T00:25:55.000564+0000 mon.a (mon.0) 5090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:55 smithi049 bash[23528]: audit 2024-09-21T00:25:55.595979+0000 mon.a (mon.0) 5091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:55 smithi049 bash[23528]: audit 2024-09-21T00:25:55.604632+0000 mon.a (mon.0) 5092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:55 smithi049 bash[23528]: audit 2024-09-21T00:25:55.615043+0000 mon.a (mon.0) 5093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:56.941 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:56 smithi044 bash[22676]: cluster 2024-09-21T00:25:55.925302+0000 mgr.a (mgr.14388) 5684 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:25:56.964 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:56 smithi049 bash[23528]: cluster 2024-09-21T00:25:55.925302+0000 mgr.a (mgr.14388) 5684 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:25:56.994 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:56 smithi179 bash[23186]: cluster 2024-09-21T00:25:55.925302+0000 mgr.a (mgr.14388) 5684 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:25:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:25:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:25:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:25:58.956 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:58 smithi049 bash[23528]: audit 2024-09-21T00:25:57.599745+0000 mon.a (mon.0) 5094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:58.956 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:58 smithi049 bash[23528]: audit 2024-09-21T00:25:57.605673+0000 mon.a (mon.0) 5095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:58.956 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:58 smithi049 bash[23528]: audit 2024-09-21T00:25:57.611923+0000 mon.a (mon.0) 5096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:58.986 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:25:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:25:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:25:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:25:58.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:25:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:58 smithi044 bash[22676]: audit 2024-09-21T00:25:57.599745+0000 mon.a (mon.0) 5094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:58 smithi044 bash[22676]: audit 2024-09-21T00:25:57.605673+0000 mon.a (mon.0) 5095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:58 smithi044 bash[22676]: audit 2024-09-21T00:25:57.611923+0000 mon.a (mon.0) 5096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:58 smithi179 bash[23186]: audit 2024-09-21T00:25:57.599745+0000 mon.a (mon.0) 5094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:58 smithi179 bash[23186]: audit 2024-09-21T00:25:57.605673+0000 mon.a (mon.0) 5095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:58 smithi179 bash[23186]: audit 2024-09-21T00:25:57.611923+0000 mon.a (mon.0) 5096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:59 smithi044 bash[22676]: cluster 2024-09-21T00:25:57.926112+0000 mgr.a (mgr.14388) 5685 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:25:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:59 smithi044 bash[22676]: audit 2024-09-21T00:25:58.528319+0000 mgr.a (mgr.14388) 5686 : audit [DBG] from='client.131814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:59 smithi044 bash[22676]: audit 2024-09-21T00:25:59.296208+0000 mon.a (mon.0) 5097 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:25:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:59 smithi044 bash[22676]: audit 2024-09-21T00:25:59.300514+0000 mon.a (mon.0) 5098 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:25:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:59 smithi044 bash[22676]: audit 2024-09-21T00:25:59.301875+0000 mon.a (mon.0) 5099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:25:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:59 smithi044 bash[22676]: audit 2024-09-21T00:25:59.312246+0000 mon.a (mon.0) 5100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:25:59 smithi044 bash[22676]: audit 2024-09-21T00:25:59.318474+0000 mon.a (mon.0) 5101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:25:59.943 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:59 smithi049 bash[23528]: cluster 2024-09-21T00:25:57.926112+0000 mgr.a (mgr.14388) 5685 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:25:59.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:59 smithi049 bash[23528]: audit 2024-09-21T00:25:58.528319+0000 mgr.a (mgr.14388) 5686 : audit [DBG] from='client.131814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:25:59.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:59 smithi049 bash[23528]: audit 2024-09-21T00:25:59.296208+0000 mon.a (mon.0) 5097 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:25:59.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:59 smithi049 bash[23528]: audit 2024-09-21T00:25:59.300514+0000 mon.a (mon.0) 5098 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:25:59.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:59 smithi049 bash[23528]: audit 2024-09-21T00:25:59.301875+0000 mon.a (mon.0) 5099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:25:59.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:59 smithi049 bash[23528]: audit 2024-09-21T00:25:59.312246+0000 mon.a (mon.0) 5100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:25:59.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:25:59 smithi049 bash[23528]: audit 2024-09-21T00:25:59.318474+0000 mon.a (mon.0) 5101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:26:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:59 smithi179 bash[23186]: cluster 2024-09-21T00:25:57.926112+0000 mgr.a (mgr.14388) 5685 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:26:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:59 smithi179 bash[23186]: audit 2024-09-21T00:25:58.528319+0000 mgr.a (mgr.14388) 5686 : audit [DBG] from='client.131814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:59 smithi179 bash[23186]: audit 2024-09-21T00:25:59.296208+0000 mon.a (mon.0) 5097 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:26:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:59 smithi179 bash[23186]: audit 2024-09-21T00:25:59.300514+0000 mon.a (mon.0) 5098 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:26:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:59 smithi179 bash[23186]: audit 2024-09-21T00:25:59.301875+0000 mon.a (mon.0) 5099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:26:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:59 smithi179 bash[23186]: audit 2024-09-21T00:25:59.312246+0000 mon.a (mon.0) 5100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:25:59 smithi179 bash[23186]: audit 2024-09-21T00:25:59.318474+0000 mon.a (mon.0) 5101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:26:00.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:26:00 smithi044 bash[22930]: debug 2024-09-21T00:26:00.037+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:26:00.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:26:00 smithi044 bash[22930]: debug 2024-09-21T00:26:00.037+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:26:00.899 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:00 smithi049 bash[23528]: audit 2024-09-21T00:25:59.321275+0000 mgr.a (mgr.14388) 5687 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:26:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:00 smithi044 bash[22676]: audit 2024-09-21T00:25:59.321275+0000 mgr.a (mgr.14388) 5687 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:26:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:00 smithi179 bash[23186]: audit 2024-09-21T00:25:59.321275+0000 mgr.a (mgr.14388) 5687 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:26:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:01 smithi044 bash[22676]: cluster 2024-09-21T00:25:59.926616+0000 mgr.a (mgr.14388) 5688 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:26:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:01 smithi044 bash[22676]: audit 2024-09-21T00:26:00.042887+0000 mgr.a (mgr.14388) 5689 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:26:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:01 smithi044 bash[22676]: cephadm 2024-09-21T00:26:00.044028+0000 mgr.a (mgr.14388) 5690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:26:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:01 smithi179 bash[23186]: cluster 2024-09-21T00:25:59.926616+0000 mgr.a (mgr.14388) 5688 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:26:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:01 smithi179 bash[23186]: audit 2024-09-21T00:26:00.042887+0000 mgr.a (mgr.14388) 5689 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:26:02.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:01 smithi179 bash[23186]: cephadm 2024-09-21T00:26:00.044028+0000 mgr.a (mgr.14388) 5690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:26:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:01 smithi049 bash[23528]: cluster 2024-09-21T00:25:59.926616+0000 mgr.a (mgr.14388) 5688 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:26:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:01 smithi049 bash[23528]: audit 2024-09-21T00:26:00.042887+0000 mgr.a (mgr.14388) 5689 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:26:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:01 smithi049 bash[23528]: cephadm 2024-09-21T00:26:00.044028+0000 mgr.a (mgr.14388) 5690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:26:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:02 smithi044 bash[22676]: cluster 2024-09-21T00:26:01.928818+0000 mgr.a (mgr.14388) 5691 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 426 B/s wr, 71 op/s 2024-09-21T00:26:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:02 smithi179 bash[23186]: cluster 2024-09-21T00:26:01.928818+0000 mgr.a (mgr.14388) 5691 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 426 B/s wr, 71 op/s 2024-09-21T00:26:03.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:02 smithi049 bash[23528]: cluster 2024-09-21T00:26:01.928818+0000 mgr.a (mgr.14388) 5691 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 426 B/s wr, 71 op/s 2024-09-21T00:26:03.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:03.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:03.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:04.765 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:04.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:04.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:04.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:04.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:04 smithi044 bash[22676]: cluster 2024-09-21T00:26:03.929621+0000 mgr.a (mgr.14388) 5692 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T00:26:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:04 smithi044 bash[22676]: audit 2024-09-21T00:26:04.320327+0000 mgr.a (mgr.14388) 5693 : audit [DBG] from='client.131997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:04 smithi179 bash[23186]: cluster 2024-09-21T00:26:03.929621+0000 mgr.a (mgr.14388) 5692 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T00:26:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:04 smithi179 bash[23186]: audit 2024-09-21T00:26:04.320327+0000 mgr.a (mgr.14388) 5693 : audit [DBG] from='client.131997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:04 smithi049 bash[23528]: cluster 2024-09-21T00:26:03.929621+0000 mgr.a (mgr.14388) 5692 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T00:26:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:04 smithi049 bash[23528]: audit 2024-09-21T00:26:04.320327+0000 mgr.a (mgr.14388) 5693 : audit [DBG] from='client.131997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:06 smithi179 bash[23186]: cluster 2024-09-21T00:26:05.932204+0000 mgr.a (mgr.14388) 5694 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:06 smithi049 bash[23528]: cluster 2024-09-21T00:26:05.932204+0000 mgr.a (mgr.14388) 5694 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:06 smithi044 bash[22676]: cluster 2024-09-21T00:26:05.932204+0000 mgr.a (mgr.14388) 5694 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:08 smithi179 bash[23186]: cluster 2024-09-21T00:26:07.933043+0000 mgr.a (mgr.14388) 5695 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:09.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:08 smithi049 bash[23528]: cluster 2024-09-21T00:26:07.933043+0000 mgr.a (mgr.14388) 5695 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:08 smithi044 bash[22676]: cluster 2024-09-21T00:26:07.933043+0000 mgr.a (mgr.14388) 5695 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:09.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:09.768 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:09.768 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:10.527 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:10.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:10 smithi179 bash[23186]: cluster 2024-09-21T00:26:09.933778+0000 mgr.a (mgr.14388) 5696 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:10 smithi179 bash[23186]: audit 2024-09-21T00:26:10.103993+0000 mgr.a (mgr.14388) 5697 : audit [DBG] from='client.132075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:11 smithi049 bash[23528]: cluster 2024-09-21T00:26:09.933778+0000 mgr.a (mgr.14388) 5696 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:11 smithi049 bash[23528]: audit 2024-09-21T00:26:10.103993+0000 mgr.a (mgr.14388) 5697 : audit [DBG] from='client.132075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:10 smithi044 bash[22676]: cluster 2024-09-21T00:26:09.933778+0000 mgr.a (mgr.14388) 5696 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:10 smithi044 bash[22676]: audit 2024-09-21T00:26:10.103993+0000 mgr.a (mgr.14388) 5697 : audit [DBG] from='client.132075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:13 smithi049 bash[23528]: cluster 2024-09-21T00:26:11.936780+0000 mgr.a (mgr.14388) 5698 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:13 smithi044 bash[22676]: cluster 2024-09-21T00:26:11.936780+0000 mgr.a (mgr.14388) 5698 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:13 smithi179 bash[23186]: cluster 2024-09-21T00:26:11.936780+0000 mgr.a (mgr.14388) 5698 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T00:26:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:15 smithi049 bash[23528]: cluster 2024-09-21T00:26:13.937782+0000 mgr.a (mgr.14388) 5699 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:15 smithi044 bash[22676]: cluster 2024-09-21T00:26:13.937782+0000 mgr.a (mgr.14388) 5699 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:15 smithi179 bash[23186]: cluster 2024-09-21T00:26:13.937782+0000 mgr.a (mgr.14388) 5699 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:15.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:15.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:15.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:16 smithi044 bash[22676]: audit 2024-09-21T00:26:15.215941+0000 mon.a (mon.0) 5102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:16 smithi044 bash[22676]: audit 2024-09-21T00:26:15.224741+0000 mon.a (mon.0) 5103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:16 smithi044 bash[22676]: audit 2024-09-21T00:26:15.235185+0000 mon.a (mon.0) 5104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:16 smithi044 bash[22676]: audit 2024-09-21T00:26:15.747375+0000 mon.a (mon.0) 5105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:16 smithi044 bash[22676]: audit 2024-09-21T00:26:15.755586+0000 mon.a (mon.0) 5106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:16 smithi044 bash[22676]: audit 2024-09-21T00:26:15.765571+0000 mon.a (mon.0) 5107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:16 smithi179 bash[23186]: audit 2024-09-21T00:26:15.215941+0000 mon.a (mon.0) 5102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:16 smithi179 bash[23186]: audit 2024-09-21T00:26:15.224741+0000 mon.a (mon.0) 5103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:16 smithi179 bash[23186]: audit 2024-09-21T00:26:15.235185+0000 mon.a (mon.0) 5104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:16 smithi179 bash[23186]: audit 2024-09-21T00:26:15.747375+0000 mon.a (mon.0) 5105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:16 smithi179 bash[23186]: audit 2024-09-21T00:26:15.755586+0000 mon.a (mon.0) 5106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:16 smithi179 bash[23186]: audit 2024-09-21T00:26:15.765571+0000 mon.a (mon.0) 5107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:16 smithi049 bash[23528]: audit 2024-09-21T00:26:15.215941+0000 mon.a (mon.0) 5102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:16 smithi049 bash[23528]: audit 2024-09-21T00:26:15.224741+0000 mon.a (mon.0) 5103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:16 smithi049 bash[23528]: audit 2024-09-21T00:26:15.235185+0000 mon.a (mon.0) 5104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:16 smithi049 bash[23528]: audit 2024-09-21T00:26:15.747375+0000 mon.a (mon.0) 5105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:16 smithi049 bash[23528]: audit 2024-09-21T00:26:15.755586+0000 mon.a (mon.0) 5106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:16 smithi049 bash[23528]: audit 2024-09-21T00:26:15.765571+0000 mon.a (mon.0) 5107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:17.453 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:17 smithi044 bash[22676]: audit 2024-09-21T00:26:15.865441+0000 mgr.a (mgr.14388) 5700 : audit [DBG] from='client.69001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:17.454 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:17 smithi044 bash[22676]: cluster 2024-09-21T00:26:15.939826+0000 mgr.a (mgr.14388) 5701 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:26:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:17 smithi179 bash[23186]: audit 2024-09-21T00:26:15.865441+0000 mgr.a (mgr.14388) 5700 : audit [DBG] from='client.69001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:17 smithi179 bash[23186]: cluster 2024-09-21T00:26:15.939826+0000 mgr.a (mgr.14388) 5701 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:26:17.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:17 smithi049 bash[23528]: audit 2024-09-21T00:26:15.865441+0000 mgr.a (mgr.14388) 5700 : audit [DBG] from='client.69001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:17.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:17 smithi049 bash[23528]: cluster 2024-09-21T00:26:15.939826+0000 mgr.a (mgr.14388) 5701 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:26:19.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:18 smithi049 bash[23528]: audit 2024-09-21T00:26:17.782766+0000 mon.a (mon.0) 5108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:18 smithi049 bash[23528]: audit 2024-09-21T00:26:17.798292+0000 mon.a (mon.0) 5109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:18 smithi049 bash[23528]: audit 2024-09-21T00:26:17.808963+0000 mon.a (mon.0) 5110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:18 smithi049 bash[23528]: cluster 2024-09-21T00:26:17.940583+0000 mgr.a (mgr.14388) 5702 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:26:19.069 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:18 smithi044 bash[22676]: audit 2024-09-21T00:26:17.782766+0000 mon.a (mon.0) 5108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.069 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:18 smithi044 bash[22676]: audit 2024-09-21T00:26:17.798292+0000 mon.a (mon.0) 5109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.069 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:18 smithi044 bash[22676]: audit 2024-09-21T00:26:17.808963+0000 mon.a (mon.0) 5110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.069 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:18 smithi044 bash[22676]: cluster 2024-09-21T00:26:17.940583+0000 mgr.a (mgr.14388) 5702 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:26:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:18 smithi179 bash[23186]: audit 2024-09-21T00:26:17.782766+0000 mon.a (mon.0) 5108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:18 smithi179 bash[23186]: audit 2024-09-21T00:26:17.798292+0000 mon.a (mon.0) 5109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:18 smithi179 bash[23186]: audit 2024-09-21T00:26:17.808963+0000 mon.a (mon.0) 5110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:18 smithi179 bash[23186]: cluster 2024-09-21T00:26:17.940583+0000 mgr.a (mgr.14388) 5702 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:26:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:20 smithi179 bash[23186]: cluster 2024-09-21T00:26:19.941361+0000 mgr.a (mgr.14388) 5703 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:26:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:21 smithi049 bash[23528]: cluster 2024-09-21T00:26:19.941361+0000 mgr.a (mgr.14388) 5703 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:26:21.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:21.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:21.306 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:20 smithi044 bash[22676]: cluster 2024-09-21T00:26:19.941361+0000 mgr.a (mgr.14388) 5703 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:26:22.100 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:23 smithi179 bash[23186]: audit 2024-09-21T00:26:21.645510+0000 mgr.a (mgr.14388) 5704 : audit [DBG] from='client.132225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:23 smithi179 bash[23186]: cluster 2024-09-21T00:26:21.943279+0000 mgr.a (mgr.14388) 5705 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:23 smithi049 bash[23528]: audit 2024-09-21T00:26:21.645510+0000 mgr.a (mgr.14388) 5704 : audit [DBG] from='client.132225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:23 smithi049 bash[23528]: cluster 2024-09-21T00:26:21.943279+0000 mgr.a (mgr.14388) 5705 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:23 smithi044 bash[22676]: audit 2024-09-21T00:26:21.645510+0000 mgr.a (mgr.14388) 5704 : audit [DBG] from='client.132225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:23 smithi044 bash[22676]: cluster 2024-09-21T00:26:21.943279+0000 mgr.a (mgr.14388) 5705 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:25 smithi049 bash[23528]: cluster 2024-09-21T00:26:23.944225+0000 mgr.a (mgr.14388) 5706 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:25 smithi044 bash[22676]: cluster 2024-09-21T00:26:23.944225+0000 mgr.a (mgr.14388) 5706 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:25 smithi179 bash[23186]: cluster 2024-09-21T00:26:23.944225+0000 mgr.a (mgr.14388) 5706 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:27.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:27.102 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:27.102 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:27 smithi049 bash[23528]: cluster 2024-09-21T00:26:25.946486+0000 mgr.a (mgr.14388) 5707 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:27 smithi044 bash[22676]: cluster 2024-09-21T00:26:25.946486+0000 mgr.a (mgr.14388) 5707 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:27 smithi179 bash[23186]: cluster 2024-09-21T00:26:25.946486+0000 mgr.a (mgr.14388) 5707 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:27.865 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:27.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:27.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:27.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:27.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:28.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:28 smithi049 bash[23528]: audit 2024-09-21T00:26:27.433832+0000 mgr.a (mgr.14388) 5708 : audit [DBG] from='client.132303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:28 smithi044 bash[22676]: audit 2024-09-21T00:26:27.433832+0000 mgr.a (mgr.14388) 5708 : audit [DBG] from='client.132303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:28 smithi179 bash[23186]: audit 2024-09-21T00:26:27.433832+0000 mgr.a (mgr.14388) 5708 : audit [DBG] from='client.132303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:29.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:29 smithi049 bash[23528]: cluster 2024-09-21T00:26:27.947438+0000 mgr.a (mgr.14388) 5709 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:29 smithi044 bash[22676]: cluster 2024-09-21T00:26:27.947438+0000 mgr.a (mgr.14388) 5709 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:29 smithi179 bash[23186]: cluster 2024-09-21T00:26:27.947438+0000 mgr.a (mgr.14388) 5709 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:31.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:31 smithi049 bash[23528]: cluster 2024-09-21T00:26:29.948202+0000 mgr.a (mgr.14388) 5710 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:31 smithi044 bash[22676]: cluster 2024-09-21T00:26:29.948202+0000 mgr.a (mgr.14388) 5710 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:31 smithi179 bash[23186]: cluster 2024-09-21T00:26:29.948202+0000 mgr.a (mgr.14388) 5710 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:32.867 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:32.867 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:33.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:33 smithi049 bash[23528]: cluster 2024-09-21T00:26:31.950478+0000 mgr.a (mgr.14388) 5711 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:33 smithi044 bash[22676]: cluster 2024-09-21T00:26:31.950478+0000 mgr.a (mgr.14388) 5711 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:33 smithi179 bash[23186]: cluster 2024-09-21T00:26:31.950478+0000 mgr.a (mgr.14388) 5711 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:33.651 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:33.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:33.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:33.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:33.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:34 smithi179 bash[23186]: audit 2024-09-21T00:26:33.201414+0000 mgr.a (mgr.14388) 5712 : audit [DBG] from='client.132381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:34.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:34 smithi049 bash[23528]: audit 2024-09-21T00:26:33.201414+0000 mgr.a (mgr.14388) 5712 : audit [DBG] from='client.132381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:34 smithi044 bash[22676]: audit 2024-09-21T00:26:33.201414+0000 mgr.a (mgr.14388) 5712 : audit [DBG] from='client.132381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:35.194 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:35 smithi179 bash[23186]: cluster 2024-09-21T00:26:33.951419+0000 mgr.a (mgr.14388) 5713 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:35.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:35 smithi049 bash[23528]: cluster 2024-09-21T00:26:33.951419+0000 mgr.a (mgr.14388) 5713 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:35 smithi044 bash[22676]: cluster 2024-09-21T00:26:33.951419+0000 mgr.a (mgr.14388) 5713 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:36 smithi044 bash[22676]: audit 2024-09-21T00:26:35.447454+0000 mon.a (mon.0) 5111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:36 smithi044 bash[22676]: audit 2024-09-21T00:26:35.456179+0000 mon.a (mon.0) 5112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:36 smithi044 bash[22676]: audit 2024-09-21T00:26:35.466764+0000 mon.a (mon.0) 5113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:36 smithi044 bash[22676]: audit 2024-09-21T00:26:35.937781+0000 mon.a (mon.0) 5114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:36 smithi044 bash[22676]: audit 2024-09-21T00:26:35.946360+0000 mon.a (mon.0) 5115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:36 smithi044 bash[22676]: audit 2024-09-21T00:26:35.956859+0000 mon.a (mon.0) 5116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:36 smithi179 bash[23186]: audit 2024-09-21T00:26:35.447454+0000 mon.a (mon.0) 5111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:36 smithi179 bash[23186]: audit 2024-09-21T00:26:35.456179+0000 mon.a (mon.0) 5112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:36 smithi179 bash[23186]: audit 2024-09-21T00:26:35.466764+0000 mon.a (mon.0) 5113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:36 smithi179 bash[23186]: audit 2024-09-21T00:26:35.937781+0000 mon.a (mon.0) 5114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:36 smithi179 bash[23186]: audit 2024-09-21T00:26:35.946360+0000 mon.a (mon.0) 5115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:36 smithi179 bash[23186]: audit 2024-09-21T00:26:35.956859+0000 mon.a (mon.0) 5116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:36 smithi049 bash[23528]: audit 2024-09-21T00:26:35.447454+0000 mon.a (mon.0) 5111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:36 smithi049 bash[23528]: audit 2024-09-21T00:26:35.456179+0000 mon.a (mon.0) 5112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:36 smithi049 bash[23528]: audit 2024-09-21T00:26:35.466764+0000 mon.a (mon.0) 5113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:36 smithi049 bash[23528]: audit 2024-09-21T00:26:35.937781+0000 mon.a (mon.0) 5114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:36 smithi049 bash[23528]: audit 2024-09-21T00:26:35.946360+0000 mon.a (mon.0) 5115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:36 smithi049 bash[23528]: audit 2024-09-21T00:26:35.956859+0000 mon.a (mon.0) 5116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:37 smithi044 bash[22676]: cluster 2024-09-21T00:26:35.953695+0000 mgr.a (mgr.14388) 5714 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:37 smithi179 bash[23186]: cluster 2024-09-21T00:26:35.953695+0000 mgr.a (mgr.14388) 5714 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:37.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:37 smithi049 bash[23528]: cluster 2024-09-21T00:26:35.953695+0000 mgr.a (mgr.14388) 5714 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:38.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:38.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:38.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:38 smithi049 bash[23528]: cluster 2024-09-21T00:26:37.954232+0000 mgr.a (mgr.14388) 5715 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:38 smithi049 bash[23528]: audit 2024-09-21T00:26:37.983302+0000 mon.a (mon.0) 5117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:38 smithi049 bash[23528]: audit 2024-09-21T00:26:37.991271+0000 mon.a (mon.0) 5118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:38 smithi049 bash[23528]: audit 2024-09-21T00:26:37.999174+0000 mon.a (mon.0) 5119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:38 smithi044 bash[22676]: cluster 2024-09-21T00:26:37.954232+0000 mgr.a (mgr.14388) 5715 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:38 smithi044 bash[22676]: audit 2024-09-21T00:26:37.983302+0000 mon.a (mon.0) 5117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:38 smithi044 bash[22676]: audit 2024-09-21T00:26:37.991271+0000 mon.a (mon.0) 5118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:38 smithi044 bash[22676]: audit 2024-09-21T00:26:37.999174+0000 mon.a (mon.0) 5119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:38 smithi179 bash[23186]: cluster 2024-09-21T00:26:37.954232+0000 mgr.a (mgr.14388) 5715 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:38 smithi179 bash[23186]: audit 2024-09-21T00:26:37.983302+0000 mon.a (mon.0) 5117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:38 smithi179 bash[23186]: audit 2024-09-21T00:26:37.991271+0000 mon.a (mon.0) 5118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:38 smithi179 bash[23186]: audit 2024-09-21T00:26:37.999174+0000 mon.a (mon.0) 5119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:39.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:39.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:39.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:39.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:39.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:39 smithi044 bash[22676]: audit 2024-09-21T00:26:38.986099+0000 mgr.a (mgr.14388) 5716 : audit [DBG] from='client.132456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:39 smithi179 bash[23186]: audit 2024-09-21T00:26:38.986099+0000 mgr.a (mgr.14388) 5716 : audit [DBG] from='client.132456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:40.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:39 smithi049 bash[23528]: audit 2024-09-21T00:26:38.986099+0000 mgr.a (mgr.14388) 5716 : audit [DBG] from='client.132456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:40 smithi179 bash[23186]: cluster 2024-09-21T00:26:39.955128+0000 mgr.a (mgr.14388) 5717 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:40 smithi049 bash[23528]: cluster 2024-09-21T00:26:39.955128+0000 mgr.a (mgr.14388) 5717 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:40 smithi044 bash[22676]: cluster 2024-09-21T00:26:39.955128+0000 mgr.a (mgr.14388) 5717 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:42 smithi179 bash[23186]: cluster 2024-09-21T00:26:41.957457+0000 mgr.a (mgr.14388) 5718 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:43 smithi049 bash[23528]: cluster 2024-09-21T00:26:41.957457+0000 mgr.a (mgr.14388) 5718 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:42 smithi044 bash[22676]: cluster 2024-09-21T00:26:41.957457+0000 mgr.a (mgr.14388) 5718 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:26:44.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:44.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:44.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:45.187 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:45 smithi179 bash[23186]: cluster 2024-09-21T00:26:43.958253+0000 mgr.a (mgr.14388) 5719 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:45.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:45 smithi049 bash[23528]: cluster 2024-09-21T00:26:43.958253+0000 mgr.a (mgr.14388) 5719 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:45 smithi044 bash[22676]: cluster 2024-09-21T00:26:43.958253+0000 mgr.a (mgr.14388) 5719 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:46 smithi049 bash[23528]: audit 2024-09-21T00:26:44.767914+0000 mgr.a (mgr.14388) 5720 : audit [DBG] from='client.132534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:46 smithi044 bash[22676]: audit 2024-09-21T00:26:44.767914+0000 mgr.a (mgr.14388) 5720 : audit [DBG] from='client.132534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:46 smithi179 bash[23186]: audit 2024-09-21T00:26:44.767914+0000 mgr.a (mgr.14388) 5720 : audit [DBG] from='client.132534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:47.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:47 smithi049 bash[23528]: cluster 2024-09-21T00:26:45.961101+0000 mgr.a (mgr.14388) 5721 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:26:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:47 smithi044 bash[22676]: cluster 2024-09-21T00:26:45.961101+0000 mgr.a (mgr.14388) 5721 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:26:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:47 smithi179 bash[23186]: cluster 2024-09-21T00:26:45.961101+0000 mgr.a (mgr.14388) 5721 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:26:49.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:49 smithi049 bash[23528]: cluster 2024-09-21T00:26:47.962006+0000 mgr.a (mgr.14388) 5722 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:49 smithi044 bash[22676]: cluster 2024-09-21T00:26:47.962006+0000 mgr.a (mgr.14388) 5722 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:49 smithi179 bash[23186]: cluster 2024-09-21T00:26:47.962006+0000 mgr.a (mgr.14388) 5722 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:50.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:50.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:50.975 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:51 smithi049 bash[23528]: cluster 2024-09-21T00:26:49.962951+0000 mgr.a (mgr.14388) 5723 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:51 smithi049 bash[23528]: audit 2024-09-21T00:26:50.527657+0000 mgr.a (mgr.14388) 5724 : audit [DBG] from='client.132612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:51 smithi044 bash[22676]: cluster 2024-09-21T00:26:49.962951+0000 mgr.a (mgr.14388) 5723 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:51 smithi044 bash[22676]: audit 2024-09-21T00:26:50.527657+0000 mgr.a (mgr.14388) 5724 : audit [DBG] from='client.132612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:51 smithi179 bash[23186]: cluster 2024-09-21T00:26:49.962951+0000 mgr.a (mgr.14388) 5723 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:26:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:51 smithi179 bash[23186]: audit 2024-09-21T00:26:50.527657+0000 mgr.a (mgr.14388) 5724 : audit [DBG] from='client.132612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:53 smithi049 bash[23528]: cluster 2024-09-21T00:26:51.965935+0000 mgr.a (mgr.14388) 5725 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:53 smithi044 bash[22676]: cluster 2024-09-21T00:26:51.965935+0000 mgr.a (mgr.14388) 5725 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:53 smithi179 bash[23186]: cluster 2024-09-21T00:26:51.965935+0000 mgr.a (mgr.14388) 5725 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:55.242 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:55 smithi179 bash[23186]: cluster 2024-09-21T00:26:53.966865+0000 mgr.a (mgr.14388) 5726 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:26:55.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:55 smithi049 bash[23528]: cluster 2024-09-21T00:26:53.966865+0000 mgr.a (mgr.14388) 5726 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:26:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:55 smithi044 bash[22676]: cluster 2024-09-21T00:26:53.966865+0000 mgr.a (mgr.14388) 5726 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:26:55.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:26:55.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:26:55.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:26:56.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:26:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:26:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:26:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:26:56.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: audit 2024-09-21T00:26:55.685448+0000 mon.a (mon.0) 5120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: audit 2024-09-21T00:26:55.695083+0000 mon.a (mon.0) 5121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: audit 2024-09-21T00:26:55.705530+0000 mon.a (mon.0) 5122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: cluster 2024-09-21T00:26:55.968916+0000 mgr.a (mgr.14388) 5727 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: audit 2024-09-21T00:26:56.164954+0000 mon.a (mon.0) 5123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: audit 2024-09-21T00:26:56.171628+0000 mon.a (mon.0) 5124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: audit 2024-09-21T00:26:56.181147+0000 mon.a (mon.0) 5125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:56 smithi044 bash[22676]: audit 2024-09-21T00:26:56.315338+0000 mgr.a (mgr.14388) 5728 : audit [DBG] from='client.132687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: audit 2024-09-21T00:26:55.685448+0000 mon.a (mon.0) 5120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: audit 2024-09-21T00:26:55.695083+0000 mon.a (mon.0) 5121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: audit 2024-09-21T00:26:55.705530+0000 mon.a (mon.0) 5122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: cluster 2024-09-21T00:26:55.968916+0000 mgr.a (mgr.14388) 5727 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: audit 2024-09-21T00:26:56.164954+0000 mon.a (mon.0) 5123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: audit 2024-09-21T00:26:56.171628+0000 mon.a (mon.0) 5124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: audit 2024-09-21T00:26:56.181147+0000 mon.a (mon.0) 5125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:56 smithi179 bash[23186]: audit 2024-09-21T00:26:56.315338+0000 mgr.a (mgr.14388) 5728 : audit [DBG] from='client.132687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: audit 2024-09-21T00:26:55.685448+0000 mon.a (mon.0) 5120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: audit 2024-09-21T00:26:55.695083+0000 mon.a (mon.0) 5121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: audit 2024-09-21T00:26:55.705530+0000 mon.a (mon.0) 5122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: cluster 2024-09-21T00:26:55.968916+0000 mgr.a (mgr.14388) 5727 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: audit 2024-09-21T00:26:56.164954+0000 mon.a (mon.0) 5123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: audit 2024-09-21T00:26:56.171628+0000 mon.a (mon.0) 5124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: audit 2024-09-21T00:26:56.181147+0000 mon.a (mon.0) 5125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:56 smithi049 bash[23528]: audit 2024-09-21T00:26:56.315338+0000 mgr.a (mgr.14388) 5728 : audit [DBG] from='client.132687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:26:59.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:59 smithi044 bash[22676]: cluster 2024-09-21T00:26:57.970036+0000 mgr.a (mgr.14388) 5729 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:26:59.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:59 smithi044 bash[22676]: audit 2024-09-21T00:26:58.180434+0000 mon.a (mon.0) 5126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:59 smithi044 bash[22676]: audit 2024-09-21T00:26:58.188189+0000 mon.a (mon.0) 5127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:26:59 smithi044 bash[22676]: audit 2024-09-21T00:26:58.198611+0000 mon.a (mon.0) 5128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:59 smithi179 bash[23186]: cluster 2024-09-21T00:26:57.970036+0000 mgr.a (mgr.14388) 5729 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:26:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:59 smithi179 bash[23186]: audit 2024-09-21T00:26:58.180434+0000 mon.a (mon.0) 5126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:59 smithi179 bash[23186]: audit 2024-09-21T00:26:58.188189+0000 mon.a (mon.0) 5127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:26:59 smithi179 bash[23186]: audit 2024-09-21T00:26:58.198611+0000 mon.a (mon.0) 5128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:59 smithi049 bash[23528]: cluster 2024-09-21T00:26:57.970036+0000 mgr.a (mgr.14388) 5729 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:26:59.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:59 smithi049 bash[23528]: audit 2024-09-21T00:26:58.180434+0000 mon.a (mon.0) 5126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:59 smithi049 bash[23528]: audit 2024-09-21T00:26:58.188189+0000 mon.a (mon.0) 5127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:26:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:26:59 smithi049 bash[23528]: audit 2024-09-21T00:26:58.198611+0000 mon.a (mon.0) 5128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:00 smithi044 bash[22676]: audit 2024-09-21T00:27:00.089456+0000 mon.a (mon.0) 5129 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:27:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:00 smithi044 bash[22676]: audit 2024-09-21T00:27:00.094500+0000 mon.a (mon.0) 5130 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:27:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:00 smithi044 bash[22676]: audit 2024-09-21T00:27:00.095867+0000 mon.a (mon.0) 5131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:27:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:00 smithi044 bash[22676]: audit 2024-09-21T00:27:00.104251+0000 mon.a (mon.0) 5132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:00 smithi044 bash[22676]: audit 2024-09-21T00:27:00.108204+0000 mon.a (mon.0) 5133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:27:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:00 smithi179 bash[23186]: audit 2024-09-21T00:27:00.089456+0000 mon.a (mon.0) 5129 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:27:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:00 smithi179 bash[23186]: audit 2024-09-21T00:27:00.094500+0000 mon.a (mon.0) 5130 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:27:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:00 smithi179 bash[23186]: audit 2024-09-21T00:27:00.095867+0000 mon.a (mon.0) 5131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:27:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:00 smithi179 bash[23186]: audit 2024-09-21T00:27:00.104251+0000 mon.a (mon.0) 5132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:00 smithi179 bash[23186]: audit 2024-09-21T00:27:00.108204+0000 mon.a (mon.0) 5133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:27:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:00 smithi049 bash[23528]: audit 2024-09-21T00:27:00.089456+0000 mon.a (mon.0) 5129 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:27:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:00 smithi049 bash[23528]: audit 2024-09-21T00:27:00.094500+0000 mon.a (mon.0) 5130 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:27:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:00 smithi049 bash[23528]: audit 2024-09-21T00:27:00.095867+0000 mon.a (mon.0) 5131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:27:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:00 smithi049 bash[23528]: audit 2024-09-21T00:27:00.104251+0000 mon.a (mon.0) 5132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:00 smithi049 bash[23528]: audit 2024-09-21T00:27:00.108204+0000 mon.a (mon.0) 5133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:27:01.188 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:27:00 smithi044 bash[22930]: debug 2024-09-21T00:27:00.864+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:27:01.188 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:27:00 smithi044 bash[22930]: debug 2024-09-21T00:27:00.864+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:27:01.443 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:01 smithi049 bash[23528]: cluster 2024-09-21T00:26:59.970920+0000 mgr.a (mgr.14388) 5730 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:27:01.444 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:01 smithi049 bash[23528]: audit 2024-09-21T00:27:00.109526+0000 mgr.a (mgr.14388) 5731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:27:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:01 smithi044 bash[22676]: cluster 2024-09-21T00:26:59.970920+0000 mgr.a (mgr.14388) 5730 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:27:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:01 smithi044 bash[22676]: audit 2024-09-21T00:27:00.109526+0000 mgr.a (mgr.14388) 5731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:27:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:01 smithi179 bash[23186]: cluster 2024-09-21T00:26:59.970920+0000 mgr.a (mgr.14388) 5730 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:27:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:01 smithi179 bash[23186]: audit 2024-09-21T00:27:00.109526+0000 mgr.a (mgr.14388) 5731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:27:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:01.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:01.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:02 smithi044 bash[22676]: audit 2024-09-21T00:27:00.865498+0000 mgr.a (mgr.14388) 5732 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:27:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:02 smithi044 bash[22676]: cephadm 2024-09-21T00:27:00.866726+0000 mgr.a (mgr.14388) 5733 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:27:02.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:02.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:02 smithi179 bash[23186]: audit 2024-09-21T00:27:00.865498+0000 mgr.a (mgr.14388) 5732 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:27:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:02 smithi179 bash[23186]: cephadm 2024-09-21T00:27:00.866726+0000 mgr.a (mgr.14388) 5733 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:27:02.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:02 smithi049 bash[23528]: audit 2024-09-21T00:27:00.865498+0000 mgr.a (mgr.14388) 5732 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:27:02.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:02 smithi049 bash[23528]: cephadm 2024-09-21T00:27:00.866726+0000 mgr.a (mgr.14388) 5733 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:27:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:03 smithi044 bash[22676]: cluster 2024-09-21T00:27:01.972464+0000 mgr.a (mgr.14388) 5734 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:27:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:03 smithi044 bash[22676]: audit 2024-09-21T00:27:02.076334+0000 mgr.a (mgr.14388) 5735 : audit [DBG] from='client.132867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:03 smithi179 bash[23186]: cluster 2024-09-21T00:27:01.972464+0000 mgr.a (mgr.14388) 5734 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:27:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:03 smithi179 bash[23186]: audit 2024-09-21T00:27:02.076334+0000 mgr.a (mgr.14388) 5735 : audit [DBG] from='client.132867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:03 smithi049 bash[23528]: cluster 2024-09-21T00:27:01.972464+0000 mgr.a (mgr.14388) 5734 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:27:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:03 smithi049 bash[23528]: audit 2024-09-21T00:27:02.076334+0000 mgr.a (mgr.14388) 5735 : audit [DBG] from='client.132867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:05 smithi044 bash[22676]: cluster 2024-09-21T00:27:03.973376+0000 mgr.a (mgr.14388) 5736 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:05 smithi179 bash[23186]: cluster 2024-09-21T00:27:03.973376+0000 mgr.a (mgr.14388) 5736 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:05 smithi049 bash[23528]: cluster 2024-09-21T00:27:03.973376+0000 mgr.a (mgr.14388) 5736 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 131 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:07 smithi044 bash[22676]: cluster 2024-09-21T00:27:05.975624+0000 mgr.a (mgr.14388) 5737 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:07 smithi179 bash[23186]: cluster 2024-09-21T00:27:05.975624+0000 mgr.a (mgr.14388) 5737 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:07.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:07.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:07.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:07 smithi049 bash[23528]: cluster 2024-09-21T00:27:05.975624+0000 mgr.a (mgr.14388) 5737 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:08.246 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:08.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:09 smithi044 bash[22676]: audit 2024-09-21T00:27:07.831639+0000 mgr.a (mgr.14388) 5738 : audit [DBG] from='client.132945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:09 smithi044 bash[22676]: cluster 2024-09-21T00:27:07.976280+0000 mgr.a (mgr.14388) 5739 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:09 smithi179 bash[23186]: audit 2024-09-21T00:27:07.831639+0000 mgr.a (mgr.14388) 5738 : audit [DBG] from='client.132945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:09 smithi179 bash[23186]: cluster 2024-09-21T00:27:07.976280+0000 mgr.a (mgr.14388) 5739 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:09.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:09 smithi049 bash[23528]: audit 2024-09-21T00:27:07.831639+0000 mgr.a (mgr.14388) 5738 : audit [DBG] from='client.132945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:09.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:09 smithi049 bash[23528]: cluster 2024-09-21T00:27:07.976280+0000 mgr.a (mgr.14388) 5739 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:11 smithi044 bash[22676]: cluster 2024-09-21T00:27:09.977173+0000 mgr.a (mgr.14388) 5740 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:11 smithi179 bash[23186]: cluster 2024-09-21T00:27:09.977173+0000 mgr.a (mgr.14388) 5740 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:11 smithi049 bash[23528]: cluster 2024-09-21T00:27:09.977173+0000 mgr.a (mgr.14388) 5740 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:13.249 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:13 smithi044 bash[22676]: cluster 2024-09-21T00:27:11.979453+0000 mgr.a (mgr.14388) 5741 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:13 smithi179 bash[23186]: cluster 2024-09-21T00:27:11.979453+0000 mgr.a (mgr.14388) 5741 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:13.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:13 smithi049 bash[23528]: cluster 2024-09-21T00:27:11.979453+0000 mgr.a (mgr.14388) 5741 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:14.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:14.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:14.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:14.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:14.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:14 smithi044 bash[22676]: audit 2024-09-21T00:27:13.584104+0000 mgr.a (mgr.14388) 5742 : audit [DBG] from='client.133020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:14 smithi179 bash[23186]: audit 2024-09-21T00:27:13.584104+0000 mgr.a (mgr.14388) 5742 : audit [DBG] from='client.133020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:14.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:14 smithi049 bash[23528]: audit 2024-09-21T00:27:13.584104+0000 mgr.a (mgr.14388) 5742 : audit [DBG] from='client.133020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:15 smithi044 bash[22676]: cluster 2024-09-21T00:27:13.979933+0000 mgr.a (mgr.14388) 5743 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:15 smithi179 bash[23186]: cluster 2024-09-21T00:27:13.979933+0000 mgr.a (mgr.14388) 5743 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:15.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:15 smithi049 bash[23528]: cluster 2024-09-21T00:27:13.979933+0000 mgr.a (mgr.14388) 5743 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:16 smithi044 bash[22676]: audit 2024-09-21T00:27:15.918827+0000 mon.a (mon.0) 5134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:16 smithi044 bash[22676]: audit 2024-09-21T00:27:15.927877+0000 mon.a (mon.0) 5135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:16 smithi044 bash[22676]: audit 2024-09-21T00:27:15.938540+0000 mon.a (mon.0) 5136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:16 smithi044 bash[22676]: cluster 2024-09-21T00:27:15.982156+0000 mgr.a (mgr.14388) 5744 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:16 smithi044 bash[22676]: audit 2024-09-21T00:27:16.393219+0000 mon.a (mon.0) 5137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:16 smithi044 bash[22676]: audit 2024-09-21T00:27:16.401597+0000 mon.a (mon.0) 5138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:16 smithi044 bash[22676]: audit 2024-09-21T00:27:16.411545+0000 mon.a (mon.0) 5139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:16 smithi179 bash[23186]: audit 2024-09-21T00:27:15.918827+0000 mon.a (mon.0) 5134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:16 smithi179 bash[23186]: audit 2024-09-21T00:27:15.927877+0000 mon.a (mon.0) 5135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:16 smithi179 bash[23186]: audit 2024-09-21T00:27:15.938540+0000 mon.a (mon.0) 5136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:16 smithi179 bash[23186]: cluster 2024-09-21T00:27:15.982156+0000 mgr.a (mgr.14388) 5744 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:16 smithi179 bash[23186]: audit 2024-09-21T00:27:16.393219+0000 mon.a (mon.0) 5137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:16 smithi179 bash[23186]: audit 2024-09-21T00:27:16.401597+0000 mon.a (mon.0) 5138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:16 smithi179 bash[23186]: audit 2024-09-21T00:27:16.411545+0000 mon.a (mon.0) 5139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:16 smithi049 bash[23528]: audit 2024-09-21T00:27:15.918827+0000 mon.a (mon.0) 5134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:16 smithi049 bash[23528]: audit 2024-09-21T00:27:15.927877+0000 mon.a (mon.0) 5135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:16 smithi049 bash[23528]: audit 2024-09-21T00:27:15.938540+0000 mon.a (mon.0) 5136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:16 smithi049 bash[23528]: cluster 2024-09-21T00:27:15.982156+0000 mgr.a (mgr.14388) 5744 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:27:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:16 smithi049 bash[23528]: audit 2024-09-21T00:27:16.393219+0000 mon.a (mon.0) 5137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:16 smithi049 bash[23528]: audit 2024-09-21T00:27:16.401597+0000 mon.a (mon.0) 5138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:16 smithi049 bash[23528]: audit 2024-09-21T00:27:16.411545+0000 mon.a (mon.0) 5139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:19 smithi044 bash[22676]: cluster 2024-09-21T00:27:17.982696+0000 mgr.a (mgr.14388) 5745 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:19 smithi044 bash[22676]: audit 2024-09-21T00:27:18.383662+0000 mon.a (mon.0) 5140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:19 smithi044 bash[22676]: audit 2024-09-21T00:27:18.390639+0000 mon.a (mon.0) 5141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:19 smithi044 bash[22676]: audit 2024-09-21T00:27:18.399881+0000 mon.a (mon.0) 5142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:19 smithi179 bash[23186]: cluster 2024-09-21T00:27:17.982696+0000 mgr.a (mgr.14388) 5745 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:19 smithi179 bash[23186]: audit 2024-09-21T00:27:18.383662+0000 mon.a (mon.0) 5140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:19 smithi179 bash[23186]: audit 2024-09-21T00:27:18.390639+0000 mon.a (mon.0) 5141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:19 smithi179 bash[23186]: audit 2024-09-21T00:27:18.399881+0000 mon.a (mon.0) 5142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:19 smithi049 bash[23528]: cluster 2024-09-21T00:27:17.982696+0000 mgr.a (mgr.14388) 5745 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:19 smithi049 bash[23528]: audit 2024-09-21T00:27:18.383662+0000 mon.a (mon.0) 5140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:19 smithi049 bash[23528]: audit 2024-09-21T00:27:18.390639+0000 mon.a (mon.0) 5141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:19 smithi049 bash[23528]: audit 2024-09-21T00:27:18.399881+0000 mon.a (mon.0) 5142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:19.801 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:19.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:19.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:19.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:19.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:20.696 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:20 smithi044 bash[22676]: audit 2024-09-21T00:27:19.346850+0000 mgr.a (mgr.14388) 5746 : audit [DBG] from='client.133095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:20 smithi179 bash[23186]: audit 2024-09-21T00:27:19.346850+0000 mgr.a (mgr.14388) 5746 : audit [DBG] from='client.133095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:20.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:20 smithi049 bash[23528]: audit 2024-09-21T00:27:19.346850+0000 mgr.a (mgr.14388) 5746 : audit [DBG] from='client.133095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:21.659 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:21 smithi049 bash[23528]: cluster 2024-09-21T00:27:19.983485+0000 mgr.a (mgr.14388) 5747 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:21 smithi044 bash[22676]: cluster 2024-09-21T00:27:19.983485+0000 mgr.a (mgr.14388) 5747 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:21 smithi179 bash[23186]: cluster 2024-09-21T00:27:19.983485+0000 mgr.a (mgr.14388) 5747 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:23 smithi044 bash[22676]: cluster 2024-09-21T00:27:21.985718+0000 mgr.a (mgr.14388) 5748 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:23 smithi179 bash[23186]: cluster 2024-09-21T00:27:21.985718+0000 mgr.a (mgr.14388) 5748 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:23 smithi049 bash[23528]: cluster 2024-09-21T00:27:21.985718+0000 mgr.a (mgr.14388) 5748 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:25.584 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:25.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:25 smithi044 bash[22676]: cluster 2024-09-21T00:27:23.986515+0000 mgr.a (mgr.14388) 5749 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:25 smithi179 bash[23186]: cluster 2024-09-21T00:27:23.986515+0000 mgr.a (mgr.14388) 5749 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:25 smithi049 bash[23528]: cluster 2024-09-21T00:27:23.986515+0000 mgr.a (mgr.14388) 5749 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:26 smithi044 bash[22676]: audit 2024-09-21T00:27:25.140939+0000 mgr.a (mgr.14388) 5750 : audit [DBG] from='client.133173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:26 smithi179 bash[23186]: audit 2024-09-21T00:27:25.140939+0000 mgr.a (mgr.14388) 5750 : audit [DBG] from='client.133173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:26 smithi049 bash[23528]: audit 2024-09-21T00:27:25.140939+0000 mgr.a (mgr.14388) 5750 : audit [DBG] from='client.133173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:27 smithi044 bash[22676]: cluster 2024-09-21T00:27:25.989286+0000 mgr.a (mgr.14388) 5751 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:27 smithi179 bash[23186]: cluster 2024-09-21T00:27:25.989286+0000 mgr.a (mgr.14388) 5751 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:27 smithi049 bash[23528]: cluster 2024-09-21T00:27:25.989286+0000 mgr.a (mgr.14388) 5751 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:29 smithi044 bash[22676]: cluster 2024-09-21T00:27:27.990067+0000 mgr.a (mgr.14388) 5752 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:27:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:29 smithi179 bash[23186]: cluster 2024-09-21T00:27:27.990067+0000 mgr.a (mgr.14388) 5752 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:27:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:29 smithi049 bash[23528]: cluster 2024-09-21T00:27:27.990067+0000 mgr.a (mgr.14388) 5752 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:27:30.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:31.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:31.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:31.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:31.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:31.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:31 smithi044 bash[22676]: cluster 2024-09-21T00:27:29.990815+0000 mgr.a (mgr.14388) 5753 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:27:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:31 smithi179 bash[23186]: cluster 2024-09-21T00:27:29.990815+0000 mgr.a (mgr.14388) 5753 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:27:31.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:31 smithi049 bash[23528]: cluster 2024-09-21T00:27:29.990815+0000 mgr.a (mgr.14388) 5753 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:27:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:32 smithi044 bash[22676]: audit 2024-09-21T00:27:30.925149+0000 mgr.a (mgr.14388) 5754 : audit [DBG] from='client.133248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:32 smithi179 bash[23186]: audit 2024-09-21T00:27:30.925149+0000 mgr.a (mgr.14388) 5754 : audit [DBG] from='client.133248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:32.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:32 smithi049 bash[23528]: audit 2024-09-21T00:27:30.925149+0000 mgr.a (mgr.14388) 5754 : audit [DBG] from='client.133248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:33 smithi044 bash[22676]: cluster 2024-09-21T00:27:31.993687+0000 mgr.a (mgr.14388) 5755 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:33 smithi179 bash[23186]: cluster 2024-09-21T00:27:31.993687+0000 mgr.a (mgr.14388) 5755 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:33.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:33 smithi049 bash[23528]: cluster 2024-09-21T00:27:31.993687+0000 mgr.a (mgr.14388) 5755 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:35 smithi044 bash[22676]: cluster 2024-09-21T00:27:33.994507+0000 mgr.a (mgr.14388) 5756 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:27:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:35 smithi179 bash[23186]: cluster 2024-09-21T00:27:33.994507+0000 mgr.a (mgr.14388) 5756 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:27:35.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:35 smithi049 bash[23528]: cluster 2024-09-21T00:27:33.994507+0000 mgr.a (mgr.14388) 5756 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:27:36.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:37.172 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:37.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:37.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:37 smithi179 bash[23186]: cluster 2024-09-21T00:27:35.996596+0000 mgr.a (mgr.14388) 5757 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:37.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:37 smithi179 bash[23186]: audit 2024-09-21T00:27:36.155574+0000 mon.a (mon.0) 5143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:37 smithi179 bash[23186]: audit 2024-09-21T00:27:36.164725+0000 mon.a (mon.0) 5144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:37 smithi179 bash[23186]: audit 2024-09-21T00:27:36.175596+0000 mon.a (mon.0) 5145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:37 smithi179 bash[23186]: audit 2024-09-21T00:27:36.579930+0000 mon.a (mon.0) 5146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:37 smithi179 bash[23186]: audit 2024-09-21T00:27:36.587485+0000 mon.a (mon.0) 5147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:37 smithi179 bash[23186]: audit 2024-09-21T00:27:36.596787+0000 mon.a (mon.0) 5148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:37 smithi044 bash[22676]: cluster 2024-09-21T00:27:35.996596+0000 mgr.a (mgr.14388) 5757 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:37 smithi044 bash[22676]: audit 2024-09-21T00:27:36.155574+0000 mon.a (mon.0) 5143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:37 smithi044 bash[22676]: audit 2024-09-21T00:27:36.164725+0000 mon.a (mon.0) 5144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:37 smithi044 bash[22676]: audit 2024-09-21T00:27:36.175596+0000 mon.a (mon.0) 5145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:37 smithi044 bash[22676]: audit 2024-09-21T00:27:36.579930+0000 mon.a (mon.0) 5146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:37 smithi044 bash[22676]: audit 2024-09-21T00:27:36.587485+0000 mon.a (mon.0) 5147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:37 smithi044 bash[22676]: audit 2024-09-21T00:27:36.596787+0000 mon.a (mon.0) 5148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:37 smithi049 bash[23528]: cluster 2024-09-21T00:27:35.996596+0000 mgr.a (mgr.14388) 5757 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:37 smithi049 bash[23528]: audit 2024-09-21T00:27:36.155574+0000 mon.a (mon.0) 5143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:37 smithi049 bash[23528]: audit 2024-09-21T00:27:36.164725+0000 mon.a (mon.0) 5144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:37 smithi049 bash[23528]: audit 2024-09-21T00:27:36.175596+0000 mon.a (mon.0) 5145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:37 smithi049 bash[23528]: audit 2024-09-21T00:27:36.579930+0000 mon.a (mon.0) 5146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:37 smithi049 bash[23528]: audit 2024-09-21T00:27:36.587485+0000 mon.a (mon.0) 5147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:37.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:37 smithi049 bash[23528]: audit 2024-09-21T00:27:36.596787+0000 mon.a (mon.0) 5148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:38 smithi044 bash[22676]: audit 2024-09-21T00:27:36.734183+0000 mgr.a (mgr.14388) 5758 : audit [DBG] from='client.133326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:38 smithi179 bash[23186]: audit 2024-09-21T00:27:36.734183+0000 mgr.a (mgr.14388) 5758 : audit [DBG] from='client.133326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:38.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:38 smithi049 bash[23528]: audit 2024-09-21T00:27:36.734183+0000 mgr.a (mgr.14388) 5758 : audit [DBG] from='client.133326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:39.656 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:39 smithi049 bash[23528]: cluster 2024-09-21T00:27:37.997551+0000 mgr.a (mgr.14388) 5759 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:39.656 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:39 smithi049 bash[23528]: audit 2024-09-21T00:27:38.581462+0000 mon.a (mon.0) 5149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:39.656 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:39 smithi049 bash[23528]: audit 2024-09-21T00:27:38.589806+0000 mon.a (mon.0) 5150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:39.656 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:39 smithi049 bash[23528]: audit 2024-09-21T00:27:38.600306+0000 mon.a (mon.0) 5151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:39.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:39 smithi044 bash[22676]: cluster 2024-09-21T00:27:37.997551+0000 mgr.a (mgr.14388) 5759 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:39.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:39 smithi044 bash[22676]: audit 2024-09-21T00:27:38.581462+0000 mon.a (mon.0) 5149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:39.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:39 smithi044 bash[22676]: audit 2024-09-21T00:27:38.589806+0000 mon.a (mon.0) 5150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:39.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:39 smithi044 bash[22676]: audit 2024-09-21T00:27:38.600306+0000 mon.a (mon.0) 5151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:39 smithi179 bash[23186]: cluster 2024-09-21T00:27:37.997551+0000 mgr.a (mgr.14388) 5759 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:39 smithi179 bash[23186]: audit 2024-09-21T00:27:38.581462+0000 mon.a (mon.0) 5149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:39 smithi179 bash[23186]: audit 2024-09-21T00:27:38.589806+0000 mon.a (mon.0) 5150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:39 smithi179 bash[23186]: audit 2024-09-21T00:27:38.600306+0000 mon.a (mon.0) 5151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:41.896 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:41 smithi049 bash[23528]: cluster 2024-09-21T00:27:39.998041+0000 mgr.a (mgr.14388) 5760 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:41 smithi044 bash[22676]: cluster 2024-09-21T00:27:39.998041+0000 mgr.a (mgr.14388) 5760 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:41 smithi179 bash[23186]: cluster 2024-09-21T00:27:39.998041+0000 mgr.a (mgr.14388) 5760 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:42.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:42.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:42.968 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:42.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:42.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:42.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:42.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:43 smithi044 bash[22676]: cluster 2024-09-21T00:27:42.000227+0000 mgr.a (mgr.14388) 5761 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:43 smithi044 bash[22676]: audit 2024-09-21T00:27:42.512149+0000 mgr.a (mgr.14388) 5762 : audit [DBG] from='client.133398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:43 smithi179 bash[23186]: cluster 2024-09-21T00:27:42.000227+0000 mgr.a (mgr.14388) 5761 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:43 smithi179 bash[23186]: audit 2024-09-21T00:27:42.512149+0000 mgr.a (mgr.14388) 5762 : audit [DBG] from='client.133398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:43 smithi049 bash[23528]: cluster 2024-09-21T00:27:42.000227+0000 mgr.a (mgr.14388) 5761 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:44.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:43 smithi049 bash[23528]: audit 2024-09-21T00:27:42.512149+0000 mgr.a (mgr.14388) 5762 : audit [DBG] from='client.133398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:45 smithi044 bash[22676]: cluster 2024-09-21T00:27:44.001153+0000 mgr.a (mgr.14388) 5763 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:45 smithi179 bash[23186]: cluster 2024-09-21T00:27:44.001153+0000 mgr.a (mgr.14388) 5763 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:45 smithi049 bash[23528]: cluster 2024-09-21T00:27:44.001153+0000 mgr.a (mgr.14388) 5763 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:47.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:47.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:47.971 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:47 smithi044 bash[22676]: cluster 2024-09-21T00:27:46.003434+0000 mgr.a (mgr.14388) 5764 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:47 smithi179 bash[23186]: cluster 2024-09-21T00:27:46.003434+0000 mgr.a (mgr.14388) 5764 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:47 smithi049 bash[23528]: cluster 2024-09-21T00:27:46.003434+0000 mgr.a (mgr.14388) 5764 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:48.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:48.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:48.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:48.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:48.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:49 smithi044 bash[22676]: cluster 2024-09-21T00:27:48.004253+0000 mgr.a (mgr.14388) 5765 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:49 smithi044 bash[22676]: audit 2024-09-21T00:27:48.308325+0000 mgr.a (mgr.14388) 5766 : audit [DBG] from='client.133476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:49 smithi179 bash[23186]: cluster 2024-09-21T00:27:48.004253+0000 mgr.a (mgr.14388) 5765 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:49 smithi179 bash[23186]: audit 2024-09-21T00:27:48.308325+0000 mgr.a (mgr.14388) 5766 : audit [DBG] from='client.133476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:49 smithi049 bash[23528]: cluster 2024-09-21T00:27:48.004253+0000 mgr.a (mgr.14388) 5765 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:49 smithi049 bash[23528]: audit 2024-09-21T00:27:48.308325+0000 mgr.a (mgr.14388) 5766 : audit [DBG] from='client.133476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:51 smithi044 bash[22676]: cluster 2024-09-21T00:27:50.005217+0000 mgr.a (mgr.14388) 5767 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:52.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:51 smithi179 bash[23186]: cluster 2024-09-21T00:27:50.005217+0000 mgr.a (mgr.14388) 5767 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:51 smithi049 bash[23528]: cluster 2024-09-21T00:27:50.005217+0000 mgr.a (mgr.14388) 5767 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:53.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:53.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:53.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:53 smithi044 bash[22676]: cluster 2024-09-21T00:27:52.007460+0000 mgr.a (mgr.14388) 5768 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:54.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:53 smithi179 bash[23186]: cluster 2024-09-21T00:27:52.007460+0000 mgr.a (mgr.14388) 5768 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:53 smithi049 bash[23528]: cluster 2024-09-21T00:27:52.007460+0000 mgr.a (mgr.14388) 5768 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:54.534 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:27:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:27:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:27:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:27:54.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:27:55.877 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:55 smithi179 bash[23186]: cluster 2024-09-21T00:27:54.008196+0000 mgr.a (mgr.14388) 5769 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:55.877 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:55 smithi179 bash[23186]: audit 2024-09-21T00:27:54.102637+0000 mgr.a (mgr.14388) 5770 : audit [DBG] from='client.133548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:55 smithi044 bash[22676]: cluster 2024-09-21T00:27:54.008196+0000 mgr.a (mgr.14388) 5769 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:55 smithi044 bash[22676]: audit 2024-09-21T00:27:54.102637+0000 mgr.a (mgr.14388) 5770 : audit [DBG] from='client.133548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:55 smithi049 bash[23528]: cluster 2024-09-21T00:27:54.008196+0000 mgr.a (mgr.14388) 5769 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:55 smithi049 bash[23528]: audit 2024-09-21T00:27:54.102637+0000 mgr.a (mgr.14388) 5770 : audit [DBG] from='client.133548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:27:57.666 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:57 smithi179 bash[23186]: cluster 2024-09-21T00:27:56.010697+0000 mgr.a (mgr.14388) 5771 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:57.666 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:57 smithi179 bash[23186]: audit 2024-09-21T00:27:56.393888+0000 mon.a (mon.0) 5152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.666 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:57 smithi179 bash[23186]: audit 2024-09-21T00:27:56.402525+0000 mon.a (mon.0) 5153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.666 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:57 smithi179 bash[23186]: audit 2024-09-21T00:27:56.413022+0000 mon.a (mon.0) 5154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.666 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:57 smithi179 bash[23186]: audit 2024-09-21T00:27:56.806599+0000 mon.a (mon.0) 5155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.666 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:57 smithi179 bash[23186]: audit 2024-09-21T00:27:56.815068+0000 mon.a (mon.0) 5156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:57 smithi179 bash[23186]: audit 2024-09-21T00:27:56.825379+0000 mon.a (mon.0) 5157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:57 smithi044 bash[22676]: cluster 2024-09-21T00:27:56.010697+0000 mgr.a (mgr.14388) 5771 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:57 smithi044 bash[22676]: audit 2024-09-21T00:27:56.393888+0000 mon.a (mon.0) 5152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:57 smithi044 bash[22676]: audit 2024-09-21T00:27:56.402525+0000 mon.a (mon.0) 5153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:57 smithi044 bash[22676]: audit 2024-09-21T00:27:56.413022+0000 mon.a (mon.0) 5154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:57 smithi044 bash[22676]: audit 2024-09-21T00:27:56.806599+0000 mon.a (mon.0) 5155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:57 smithi044 bash[22676]: audit 2024-09-21T00:27:56.815068+0000 mon.a (mon.0) 5156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:57 smithi044 bash[22676]: audit 2024-09-21T00:27:56.825379+0000 mon.a (mon.0) 5157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:57 smithi049 bash[23528]: cluster 2024-09-21T00:27:56.010697+0000 mgr.a (mgr.14388) 5771 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:27:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:57 smithi049 bash[23528]: audit 2024-09-21T00:27:56.393888+0000 mon.a (mon.0) 5152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:57 smithi049 bash[23528]: audit 2024-09-21T00:27:56.402525+0000 mon.a (mon.0) 5153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:57 smithi049 bash[23528]: audit 2024-09-21T00:27:56.413022+0000 mon.a (mon.0) 5154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:57 smithi049 bash[23528]: audit 2024-09-21T00:27:56.806599+0000 mon.a (mon.0) 5155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:57 smithi049 bash[23528]: audit 2024-09-21T00:27:56.815068+0000 mon.a (mon.0) 5156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:57.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:57 smithi049 bash[23528]: audit 2024-09-21T00:27:56.825379+0000 mon.a (mon.0) 5157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:27:59.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:27:59.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:27:59.735 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:59 smithi049 bash[23528]: cluster 2024-09-21T00:27:58.011668+0000 mgr.a (mgr.14388) 5772 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:59.735 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:59 smithi049 bash[23528]: audit 2024-09-21T00:27:58.792192+0000 mon.a (mon.0) 5158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.735 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:59 smithi049 bash[23528]: audit 2024-09-21T00:27:58.800776+0000 mon.a (mon.0) 5159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.735 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:27:59 smithi049 bash[23528]: audit 2024-09-21T00:27:58.808842+0000 mon.a (mon.0) 5160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:59 smithi044 bash[22676]: cluster 2024-09-21T00:27:58.011668+0000 mgr.a (mgr.14388) 5772 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:59 smithi044 bash[22676]: audit 2024-09-21T00:27:58.792192+0000 mon.a (mon.0) 5158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:59 smithi044 bash[22676]: audit 2024-09-21T00:27:58.800776+0000 mon.a (mon.0) 5159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:27:59 smithi044 bash[22676]: audit 2024-09-21T00:27:58.808842+0000 mon.a (mon.0) 5160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:59 smithi179 bash[23186]: cluster 2024-09-21T00:27:58.011668+0000 mgr.a (mgr.14388) 5772 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:27:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:59 smithi179 bash[23186]: audit 2024-09-21T00:27:58.792192+0000 mon.a (mon.0) 5158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:59 smithi179 bash[23186]: audit 2024-09-21T00:27:58.800776+0000 mon.a (mon.0) 5159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:27:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:27:59 smithi179 bash[23186]: audit 2024-09-21T00:27:58.808842+0000 mon.a (mon.0) 5160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:00.317 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:00.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:01.661 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22676]: audit 2024-09-21T00:27:59.869348+0000 mgr.a (mgr.14388) 5773 : audit [DBG] from='client.133626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:01.661 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22676]: cluster 2024-09-21T00:28:00.012303+0000 mgr.a (mgr.14388) 5774 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:01.661 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22676]: audit 2024-09-21T00:28:00.923675+0000 mon.a (mon.0) 5161 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:28:01.661 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22676]: audit 2024-09-21T00:28:00.929017+0000 mon.a (mon.0) 5162 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:28:01.661 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22676]: audit 2024-09-21T00:28:00.929962+0000 mon.a (mon.0) 5163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:28:01.662 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22676]: audit 2024-09-21T00:28:00.936468+0000 mon.a (mon.0) 5164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:01.662 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22676]: audit 2024-09-21T00:28:00.939681+0000 mon.a (mon.0) 5165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:28:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:01 smithi179 bash[23186]: audit 2024-09-21T00:27:59.869348+0000 mgr.a (mgr.14388) 5773 : audit [DBG] from='client.133626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:01 smithi179 bash[23186]: cluster 2024-09-21T00:28:00.012303+0000 mgr.a (mgr.14388) 5774 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:01 smithi179 bash[23186]: audit 2024-09-21T00:28:00.923675+0000 mon.a (mon.0) 5161 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:28:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:01 smithi179 bash[23186]: audit 2024-09-21T00:28:00.929017+0000 mon.a (mon.0) 5162 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:28:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:01 smithi179 bash[23186]: audit 2024-09-21T00:28:00.929962+0000 mon.a (mon.0) 5163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:28:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:01 smithi179 bash[23186]: audit 2024-09-21T00:28:00.936468+0000 mon.a (mon.0) 5164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:01 smithi179 bash[23186]: audit 2024-09-21T00:28:00.939681+0000 mon.a (mon.0) 5165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:28:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:01 smithi049 bash[23528]: audit 2024-09-21T00:27:59.869348+0000 mgr.a (mgr.14388) 5773 : audit [DBG] from='client.133626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:01 smithi049 bash[23528]: cluster 2024-09-21T00:28:00.012303+0000 mgr.a (mgr.14388) 5774 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:01 smithi049 bash[23528]: audit 2024-09-21T00:28:00.923675+0000 mon.a (mon.0) 5161 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:28:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:01 smithi049 bash[23528]: audit 2024-09-21T00:28:00.929017+0000 mon.a (mon.0) 5162 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:28:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:01 smithi049 bash[23528]: audit 2024-09-21T00:28:00.929962+0000 mon.a (mon.0) 5163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:28:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:01 smithi049 bash[23528]: audit 2024-09-21T00:28:00.936468+0000 mon.a (mon.0) 5164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:01.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:01 smithi049 bash[23528]: audit 2024-09-21T00:28:00.939681+0000 mon.a (mon.0) 5165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:28:01.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22930]: debug 2024-09-21T00:28:01.655+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:28:01.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:28:01 smithi044 bash[22930]: debug 2024-09-21T00:28:01.659+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:28:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:02 smithi044 bash[22676]: audit 2024-09-21T00:28:00.941012+0000 mgr.a (mgr.14388) 5775 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:28:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:02 smithi179 bash[23186]: audit 2024-09-21T00:28:00.941012+0000 mgr.a (mgr.14388) 5775 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:28:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:02 smithi049 bash[23528]: audit 2024-09-21T00:28:00.941012+0000 mgr.a (mgr.14388) 5775 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:28:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:03 smithi044 bash[22676]: audit 2024-09-21T00:28:01.660837+0000 mgr.a (mgr.14388) 5776 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:28:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:03 smithi044 bash[22676]: cephadm 2024-09-21T00:28:01.662648+0000 mgr.a (mgr.14388) 5777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:28:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:03 smithi044 bash[22676]: cluster 2024-09-21T00:28:02.015087+0000 mgr.a (mgr.14388) 5778 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:03 smithi179 bash[23186]: audit 2024-09-21T00:28:01.660837+0000 mgr.a (mgr.14388) 5776 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:28:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:03 smithi179 bash[23186]: cephadm 2024-09-21T00:28:01.662648+0000 mgr.a (mgr.14388) 5777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:28:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:03 smithi179 bash[23186]: cluster 2024-09-21T00:28:02.015087+0000 mgr.a (mgr.14388) 5778 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:03 smithi049 bash[23528]: audit 2024-09-21T00:28:01.660837+0000 mgr.a (mgr.14388) 5776 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:28:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:03 smithi049 bash[23528]: cephadm 2024-09-21T00:28:01.662648+0000 mgr.a (mgr.14388) 5777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:28:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:03 smithi049 bash[23528]: cluster 2024-09-21T00:28:02.015087+0000 mgr.a (mgr.14388) 5778 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:05.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:05 smithi044 bash[22676]: cluster 2024-09-21T00:28:04.015804+0000 mgr.a (mgr.14388) 5779 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:05 smithi179 bash[23186]: cluster 2024-09-21T00:28:04.015804+0000 mgr.a (mgr.14388) 5779 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:05 smithi049 bash[23528]: cluster 2024-09-21T00:28:04.015804+0000 mgr.a (mgr.14388) 5779 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:06.080 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:07 smithi044 bash[22676]: audit 2024-09-21T00:28:05.654918+0000 mgr.a (mgr.14388) 5780 : audit [DBG] from='client.133812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:07 smithi044 bash[22676]: cluster 2024-09-21T00:28:06.017179+0000 mgr.a (mgr.14388) 5781 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:07 smithi179 bash[23186]: audit 2024-09-21T00:28:05.654918+0000 mgr.a (mgr.14388) 5780 : audit [DBG] from='client.133812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:07 smithi179 bash[23186]: cluster 2024-09-21T00:28:06.017179+0000 mgr.a (mgr.14388) 5781 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:07 smithi049 bash[23528]: audit 2024-09-21T00:28:05.654918+0000 mgr.a (mgr.14388) 5780 : audit [DBG] from='client.133812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:07 smithi049 bash[23528]: cluster 2024-09-21T00:28:06.017179+0000 mgr.a (mgr.14388) 5781 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:09 smithi044 bash[22676]: cluster 2024-09-21T00:28:08.017955+0000 mgr.a (mgr.14388) 5782 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:28:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:09 smithi179 bash[23186]: cluster 2024-09-21T00:28:08.017955+0000 mgr.a (mgr.14388) 5782 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:28:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:09 smithi049 bash[23528]: cluster 2024-09-21T00:28:08.017955+0000 mgr.a (mgr.14388) 5782 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:28:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:11 smithi044 bash[22676]: cluster 2024-09-21T00:28:10.018828+0000 mgr.a (mgr.14388) 5783 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:28:11.739 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:11 smithi049 bash[23528]: cluster 2024-09-21T00:28:10.018828+0000 mgr.a (mgr.14388) 5783 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:28:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:11 smithi179 bash[23186]: cluster 2024-09-21T00:28:10.018828+0000 mgr.a (mgr.14388) 5783 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:28:11.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:12 smithi044 bash[22676]: audit 2024-09-21T00:28:11.414453+0000 mgr.a (mgr.14388) 5784 : audit [DBG] from='client.133890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:12 smithi179 bash[23186]: audit 2024-09-21T00:28:11.414453+0000 mgr.a (mgr.14388) 5784 : audit [DBG] from='client.133890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:12.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:12 smithi049 bash[23528]: audit 2024-09-21T00:28:11.414453+0000 mgr.a (mgr.14388) 5784 : audit [DBG] from='client.133890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:13 smithi044 bash[22676]: cluster 2024-09-21T00:28:12.021690+0000 mgr.a (mgr.14388) 5785 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:13 smithi179 bash[23186]: cluster 2024-09-21T00:28:12.021690+0000 mgr.a (mgr.14388) 5785 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:13 smithi049 bash[23528]: cluster 2024-09-21T00:28:12.021690+0000 mgr.a (mgr.14388) 5785 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:15 smithi044 bash[22676]: cluster 2024-09-21T00:28:14.022623+0000 mgr.a (mgr.14388) 5786 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:15 smithi179 bash[23186]: cluster 2024-09-21T00:28:14.022623+0000 mgr.a (mgr.14388) 5786 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:15.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:15 smithi049 bash[23528]: cluster 2024-09-21T00:28:14.022623+0000 mgr.a (mgr.14388) 5786 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:16.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:16.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:16.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:17.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:17.613 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:17 smithi179 bash[23186]: cluster 2024-09-21T00:28:16.024623+0000 mgr.a (mgr.14388) 5787 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:17 smithi179 bash[23186]: audit 2024-09-21T00:28:16.611305+0000 mon.a (mon.0) 5166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:17 smithi179 bash[23186]: audit 2024-09-21T00:28:16.619907+0000 mon.a (mon.0) 5167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:17 smithi179 bash[23186]: audit 2024-09-21T00:28:16.630428+0000 mon.a (mon.0) 5168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:17 smithi179 bash[23186]: audit 2024-09-21T00:28:16.943637+0000 mon.a (mon.0) 5169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:17 smithi179 bash[23186]: audit 2024-09-21T00:28:16.948676+0000 mon.a (mon.0) 5170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:17 smithi179 bash[23186]: audit 2024-09-21T00:28:16.954378+0000 mon.a (mon.0) 5171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:17 smithi044 bash[22676]: cluster 2024-09-21T00:28:16.024623+0000 mgr.a (mgr.14388) 5787 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:17 smithi044 bash[22676]: audit 2024-09-21T00:28:16.611305+0000 mon.a (mon.0) 5166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:17 smithi044 bash[22676]: audit 2024-09-21T00:28:16.619907+0000 mon.a (mon.0) 5167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:17 smithi044 bash[22676]: audit 2024-09-21T00:28:16.630428+0000 mon.a (mon.0) 5168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:17 smithi044 bash[22676]: audit 2024-09-21T00:28:16.943637+0000 mon.a (mon.0) 5169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:17 smithi044 bash[22676]: audit 2024-09-21T00:28:16.948676+0000 mon.a (mon.0) 5170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:17 smithi044 bash[22676]: audit 2024-09-21T00:28:16.954378+0000 mon.a (mon.0) 5171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:17 smithi049 bash[23528]: cluster 2024-09-21T00:28:16.024623+0000 mgr.a (mgr.14388) 5787 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:28:18.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:17 smithi049 bash[23528]: audit 2024-09-21T00:28:16.611305+0000 mon.a (mon.0) 5166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:18.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:17 smithi049 bash[23528]: audit 2024-09-21T00:28:16.619907+0000 mon.a (mon.0) 5167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:18.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:17 smithi049 bash[23528]: audit 2024-09-21T00:28:16.630428+0000 mon.a (mon.0) 5168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:18.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:17 smithi049 bash[23528]: audit 2024-09-21T00:28:16.943637+0000 mon.a (mon.0) 5169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:18.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:17 smithi049 bash[23528]: audit 2024-09-21T00:28:16.948676+0000 mon.a (mon.0) 5170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:18.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:17 smithi049 bash[23528]: audit 2024-09-21T00:28:16.954378+0000 mon.a (mon.0) 5171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:18.854 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:18 smithi044 bash[22676]: audit 2024-09-21T00:28:17.161632+0000 mgr.a (mgr.14388) 5788 : audit [DBG] from='client.69715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:18 smithi179 bash[23186]: audit 2024-09-21T00:28:17.161632+0000 mgr.a (mgr.14388) 5788 : audit [DBG] from='client.69715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:19.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:18 smithi049 bash[23528]: audit 2024-09-21T00:28:17.161632+0000 mgr.a (mgr.14388) 5788 : audit [DBG] from='client.69715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:19 smithi044 bash[22676]: cluster 2024-09-21T00:28:18.025567+0000 mgr.a (mgr.14388) 5789 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:19 smithi044 bash[22676]: audit 2024-09-21T00:28:18.975098+0000 mon.a (mon.0) 5172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:19 smithi044 bash[22676]: audit 2024-09-21T00:28:18.980121+0000 mon.a (mon.0) 5173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:19 smithi044 bash[22676]: audit 2024-09-21T00:28:18.986501+0000 mon.a (mon.0) 5174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:19.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:19 smithi049 bash[23528]: cluster 2024-09-21T00:28:18.025567+0000 mgr.a (mgr.14388) 5789 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:19.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:19 smithi049 bash[23528]: audit 2024-09-21T00:28:18.975098+0000 mon.a (mon.0) 5172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:19.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:19 smithi049 bash[23528]: audit 2024-09-21T00:28:18.980121+0000 mon.a (mon.0) 5173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:19.857 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:19 smithi049 bash[23528]: audit 2024-09-21T00:28:18.986501+0000 mon.a (mon.0) 5174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:19 smithi179 bash[23186]: cluster 2024-09-21T00:28:18.025567+0000 mgr.a (mgr.14388) 5789 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:19 smithi179 bash[23186]: audit 2024-09-21T00:28:18.975098+0000 mon.a (mon.0) 5172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:19 smithi179 bash[23186]: audit 2024-09-21T00:28:18.980121+0000 mon.a (mon.0) 5173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:19 smithi179 bash[23186]: audit 2024-09-21T00:28:18.986501+0000 mon.a (mon.0) 5174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:21 smithi044 bash[22676]: cluster 2024-09-21T00:28:20.026362+0000 mgr.a (mgr.14388) 5790 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:21 smithi179 bash[23186]: cluster 2024-09-21T00:28:20.026362+0000 mgr.a (mgr.14388) 5790 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:21 smithi049 bash[23528]: cluster 2024-09-21T00:28:20.026362+0000 mgr.a (mgr.14388) 5790 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:22.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:22.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:22.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:23.419 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:23 smithi044 bash[22676]: cluster 2024-09-21T00:28:22.028576+0000 mgr.a (mgr.14388) 5791 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:23 smithi179 bash[23186]: cluster 2024-09-21T00:28:22.028576+0000 mgr.a (mgr.14388) 5791 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:24.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:23 smithi049 bash[23528]: cluster 2024-09-21T00:28:22.028576+0000 mgr.a (mgr.14388) 5791 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:24 smithi044 bash[22676]: audit 2024-09-21T00:28:22.954888+0000 mgr.a (mgr.14388) 5792 : audit [DBG] from='client.134043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:24 smithi179 bash[23186]: audit 2024-09-21T00:28:22.954888+0000 mgr.a (mgr.14388) 5792 : audit [DBG] from='client.134043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:24 smithi049 bash[23528]: audit 2024-09-21T00:28:22.954888+0000 mgr.a (mgr.14388) 5792 : audit [DBG] from='client.134043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:25 smithi044 bash[22676]: cluster 2024-09-21T00:28:24.029525+0000 mgr.a (mgr.14388) 5793 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:25 smithi179 bash[23186]: cluster 2024-09-21T00:28:24.029525+0000 mgr.a (mgr.14388) 5793 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:25 smithi049 bash[23528]: cluster 2024-09-21T00:28:24.029525+0000 mgr.a (mgr.14388) 5793 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:27 smithi044 bash[22676]: cluster 2024-09-21T00:28:26.031770+0000 mgr.a (mgr.14388) 5794 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:27 smithi179 bash[23186]: cluster 2024-09-21T00:28:26.031770+0000 mgr.a (mgr.14388) 5794 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:27 smithi049 bash[23528]: cluster 2024-09-21T00:28:26.031770+0000 mgr.a (mgr.14388) 5794 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:28.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:28 smithi044 bash[22676]: cluster 2024-09-21T00:28:28.032540+0000 mgr.a (mgr.14388) 5795 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:28 smithi179 bash[23186]: cluster 2024-09-21T00:28:28.032540+0000 mgr.a (mgr.14388) 5795 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:29.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:28 smithi049 bash[23528]: cluster 2024-09-21T00:28:28.032540+0000 mgr.a (mgr.14388) 5795 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:29.211 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:29 smithi044 bash[22676]: audit 2024-09-21T00:28:28.770727+0000 mgr.a (mgr.14388) 5796 : audit [DBG] from='client.134121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:29 smithi179 bash[23186]: audit 2024-09-21T00:28:28.770727+0000 mgr.a (mgr.14388) 5796 : audit [DBG] from='client.134121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:30.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:29 smithi049 bash[23528]: audit 2024-09-21T00:28:28.770727+0000 mgr.a (mgr.14388) 5796 : audit [DBG] from='client.134121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:30 smithi044 bash[22676]: cluster 2024-09-21T00:28:30.033448+0000 mgr.a (mgr.14388) 5797 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:30 smithi179 bash[23186]: cluster 2024-09-21T00:28:30.033448+0000 mgr.a (mgr.14388) 5797 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:31.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:30 smithi049 bash[23528]: cluster 2024-09-21T00:28:30.033448+0000 mgr.a (mgr.14388) 5797 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:33 smithi044 bash[22676]: cluster 2024-09-21T00:28:32.035649+0000 mgr.a (mgr.14388) 5798 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:33 smithi179 bash[23186]: cluster 2024-09-21T00:28:32.035649+0000 mgr.a (mgr.14388) 5798 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:33.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:33 smithi049 bash[23528]: cluster 2024-09-21T00:28:32.035649+0000 mgr.a (mgr.14388) 5798 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:34.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:34.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:34.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:34.969 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:34.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:35.419 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:35 smithi179 bash[23186]: cluster 2024-09-21T00:28:34.036425+0000 mgr.a (mgr.14388) 5799 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:35.419 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:35 smithi179 bash[23186]: audit 2024-09-21T00:28:34.538169+0000 mgr.a (mgr.14388) 5800 : audit [DBG] from='client.134199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:35 smithi044 bash[22676]: cluster 2024-09-21T00:28:34.036425+0000 mgr.a (mgr.14388) 5799 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:35 smithi044 bash[22676]: audit 2024-09-21T00:28:34.538169+0000 mgr.a (mgr.14388) 5800 : audit [DBG] from='client.134199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:35.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:35 smithi049 bash[23528]: cluster 2024-09-21T00:28:34.036425+0000 mgr.a (mgr.14388) 5799 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:35.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:35 smithi049 bash[23528]: audit 2024-09-21T00:28:34.538169+0000 mgr.a (mgr.14388) 5800 : audit [DBG] from='client.134199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:37 smithi179 bash[23186]: cluster 2024-09-21T00:28:36.038808+0000 mgr.a (mgr.14388) 5801 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:37 smithi179 bash[23186]: audit 2024-09-21T00:28:36.843866+0000 mon.a (mon.0) 5175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:37 smithi179 bash[23186]: audit 2024-09-21T00:28:36.853241+0000 mon.a (mon.0) 5176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:37 smithi179 bash[23186]: audit 2024-09-21T00:28:36.864292+0000 mon.a (mon.0) 5177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:37 smithi049 bash[23528]: cluster 2024-09-21T00:28:36.038808+0000 mgr.a (mgr.14388) 5801 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:37.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:37 smithi049 bash[23528]: audit 2024-09-21T00:28:36.843866+0000 mon.a (mon.0) 5175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:37 smithi049 bash[23528]: audit 2024-09-21T00:28:36.853241+0000 mon.a (mon.0) 5176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:37 smithi049 bash[23528]: audit 2024-09-21T00:28:36.864292+0000 mon.a (mon.0) 5177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:37 smithi044 bash[22676]: cluster 2024-09-21T00:28:36.038808+0000 mgr.a (mgr.14388) 5801 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:37 smithi044 bash[22676]: audit 2024-09-21T00:28:36.843866+0000 mon.a (mon.0) 5175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:37 smithi044 bash[22676]: audit 2024-09-21T00:28:36.853241+0000 mon.a (mon.0) 5176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:37 smithi044 bash[22676]: audit 2024-09-21T00:28:36.864292+0000 mon.a (mon.0) 5177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:38 smithi044 bash[22676]: audit 2024-09-21T00:28:37.112280+0000 mon.a (mon.0) 5178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:38 smithi044 bash[22676]: audit 2024-09-21T00:28:37.121190+0000 mon.a (mon.0) 5179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:38 smithi044 bash[22676]: audit 2024-09-21T00:28:37.131897+0000 mon.a (mon.0) 5180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:38 smithi179 bash[23186]: audit 2024-09-21T00:28:37.112280+0000 mon.a (mon.0) 5178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:38 smithi179 bash[23186]: audit 2024-09-21T00:28:37.121190+0000 mon.a (mon.0) 5179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:38 smithi179 bash[23186]: audit 2024-09-21T00:28:37.131897+0000 mon.a (mon.0) 5180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:38 smithi049 bash[23528]: audit 2024-09-21T00:28:37.112280+0000 mon.a (mon.0) 5178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:38 smithi049 bash[23528]: audit 2024-09-21T00:28:37.121190+0000 mon.a (mon.0) 5179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:38.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:38 smithi049 bash[23528]: audit 2024-09-21T00:28:37.131897+0000 mon.a (mon.0) 5180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:39 smithi044 bash[22676]: cluster 2024-09-21T00:28:38.039582+0000 mgr.a (mgr.14388) 5802 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:39 smithi044 bash[22676]: audit 2024-09-21T00:28:39.118612+0000 mon.a (mon.0) 5181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:39 smithi044 bash[22676]: audit 2024-09-21T00:28:39.123960+0000 mon.a (mon.0) 5182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:39 smithi179 bash[23186]: cluster 2024-09-21T00:28:38.039582+0000 mgr.a (mgr.14388) 5802 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:39 smithi179 bash[23186]: audit 2024-09-21T00:28:39.118612+0000 mon.a (mon.0) 5181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:39 smithi179 bash[23186]: audit 2024-09-21T00:28:39.123960+0000 mon.a (mon.0) 5182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:39 smithi049 bash[23528]: cluster 2024-09-21T00:28:38.039582+0000 mgr.a (mgr.14388) 5802 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:39 smithi049 bash[23528]: audit 2024-09-21T00:28:39.118612+0000 mon.a (mon.0) 5181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:39 smithi049 bash[23528]: audit 2024-09-21T00:28:39.123960+0000 mon.a (mon.0) 5182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:39.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:39.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:39.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:40 smithi044 bash[22676]: audit 2024-09-21T00:28:39.133220+0000 mon.a (mon.0) 5183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:40 smithi179 bash[23186]: audit 2024-09-21T00:28:39.133220+0000 mon.a (mon.0) 5183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:40.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:40 smithi049 bash[23528]: audit 2024-09-21T00:28:39.133220+0000 mon.a (mon.0) 5183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:40.785 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:41.419 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:41 smithi044 bash[22676]: cluster 2024-09-21T00:28:40.040320+0000 mgr.a (mgr.14388) 5803 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:41.419 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:41 smithi044 bash[22676]: audit 2024-09-21T00:28:40.313712+0000 mgr.a (mgr.14388) 5804 : audit [DBG] from='client.134277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:41 smithi179 bash[23186]: cluster 2024-09-21T00:28:40.040320+0000 mgr.a (mgr.14388) 5803 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:41 smithi179 bash[23186]: audit 2024-09-21T00:28:40.313712+0000 mgr.a (mgr.14388) 5804 : audit [DBG] from='client.134277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:41.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:41 smithi049 bash[23528]: cluster 2024-09-21T00:28:40.040320+0000 mgr.a (mgr.14388) 5803 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:41.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:41 smithi049 bash[23528]: audit 2024-09-21T00:28:40.313712+0000 mgr.a (mgr.14388) 5804 : audit [DBG] from='client.134277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:43 smithi044 bash[22676]: cluster 2024-09-21T00:28:42.043184+0000 mgr.a (mgr.14388) 5805 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:43 smithi179 bash[23186]: cluster 2024-09-21T00:28:42.043184+0000 mgr.a (mgr.14388) 5805 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:43.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:43 smithi049 bash[23528]: cluster 2024-09-21T00:28:42.043184+0000 mgr.a (mgr.14388) 5805 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:45 smithi044 bash[22676]: cluster 2024-09-21T00:28:44.043968+0000 mgr.a (mgr.14388) 5806 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:45 smithi179 bash[23186]: cluster 2024-09-21T00:28:44.043968+0000 mgr.a (mgr.14388) 5806 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:45 smithi049 bash[23528]: cluster 2024-09-21T00:28:44.043968+0000 mgr.a (mgr.14388) 5806 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:45.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:45.787 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:45.788 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:46.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:46.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:46.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:46.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:46.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:47 smithi044 bash[22676]: cluster 2024-09-21T00:28:46.045943+0000 mgr.a (mgr.14388) 5807 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:47 smithi044 bash[22676]: audit 2024-09-21T00:28:46.126514+0000 mgr.a (mgr.14388) 5808 : audit [DBG] from='client.134355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:47 smithi179 bash[23186]: cluster 2024-09-21T00:28:46.045943+0000 mgr.a (mgr.14388) 5807 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:47 smithi179 bash[23186]: audit 2024-09-21T00:28:46.126514+0000 mgr.a (mgr.14388) 5808 : audit [DBG] from='client.134355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:47 smithi049 bash[23528]: cluster 2024-09-21T00:28:46.045943+0000 mgr.a (mgr.14388) 5807 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:47 smithi049 bash[23528]: audit 2024-09-21T00:28:46.126514+0000 mgr.a (mgr.14388) 5808 : audit [DBG] from='client.134355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:49 smithi044 bash[22676]: cluster 2024-09-21T00:28:48.046853+0000 mgr.a (mgr.14388) 5809 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:49 smithi179 bash[23186]: cluster 2024-09-21T00:28:48.046853+0000 mgr.a (mgr.14388) 5809 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:49.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:49 smithi049 bash[23528]: cluster 2024-09-21T00:28:48.046853+0000 mgr.a (mgr.14388) 5809 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:28:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:51 smithi044 bash[22676]: cluster 2024-09-21T00:28:50.048181+0000 mgr.a (mgr.14388) 5810 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T00:28:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:51 smithi179 bash[23186]: cluster 2024-09-21T00:28:50.048181+0000 mgr.a (mgr.14388) 5810 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T00:28:51.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:51 smithi049 bash[23528]: cluster 2024-09-21T00:28:50.048181+0000 mgr.a (mgr.14388) 5810 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T00:28:51.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:51.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:51.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:52.330 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:52.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:52.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:52.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:52.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:53 smithi049 bash[23528]: audit 2024-09-21T00:28:51.904517+0000 mgr.a (mgr.14388) 5811 : audit [DBG] from='client.134433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:53 smithi049 bash[23528]: cluster 2024-09-21T00:28:52.049865+0000 mgr.a (mgr.14388) 5812 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:53 smithi044 bash[22676]: audit 2024-09-21T00:28:51.904517+0000 mgr.a (mgr.14388) 5811 : audit [DBG] from='client.134433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:53 smithi044 bash[22676]: cluster 2024-09-21T00:28:52.049865+0000 mgr.a (mgr.14388) 5812 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:53 smithi179 bash[23186]: audit 2024-09-21T00:28:51.904517+0000 mgr.a (mgr.14388) 5811 : audit [DBG] from='client.134433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:53 smithi179 bash[23186]: cluster 2024-09-21T00:28:52.049865+0000 mgr.a (mgr.14388) 5812 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:55.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:55 smithi179 bash[23186]: cluster 2024-09-21T00:28:54.050746+0000 mgr.a (mgr.14388) 5813 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:55 smithi044 bash[22676]: cluster 2024-09-21T00:28:54.050746+0000 mgr.a (mgr.14388) 5813 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:55.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:55 smithi049 bash[23528]: cluster 2024-09-21T00:28:54.050746+0000 mgr.a (mgr.14388) 5813 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:57.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:28:57.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:28:57.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:28:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:57 smithi044 bash[22676]: cluster 2024-09-21T00:28:56.052977+0000 mgr.a (mgr.14388) 5814 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:57 smithi044 bash[22676]: audit 2024-09-21T00:28:57.080202+0000 mon.a (mon.0) 5184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:57 smithi044 bash[22676]: audit 2024-09-21T00:28:57.090272+0000 mon.a (mon.0) 5185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:57 smithi044 bash[22676]: audit 2024-09-21T00:28:57.102215+0000 mon.a (mon.0) 5186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:57 smithi179 bash[23186]: cluster 2024-09-21T00:28:56.052977+0000 mgr.a (mgr.14388) 5814 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:57 smithi179 bash[23186]: audit 2024-09-21T00:28:57.080202+0000 mon.a (mon.0) 5184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:57 smithi179 bash[23186]: audit 2024-09-21T00:28:57.090272+0000 mon.a (mon.0) 5185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:57 smithi179 bash[23186]: audit 2024-09-21T00:28:57.102215+0000 mon.a (mon.0) 5186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:57 smithi049 bash[23528]: cluster 2024-09-21T00:28:56.052977+0000 mgr.a (mgr.14388) 5814 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:28:57.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:57 smithi049 bash[23528]: audit 2024-09-21T00:28:57.080202+0000 mon.a (mon.0) 5184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:57 smithi049 bash[23528]: audit 2024-09-21T00:28:57.090272+0000 mon.a (mon.0) 5185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:57 smithi049 bash[23528]: audit 2024-09-21T00:28:57.102215+0000 mon.a (mon.0) 5186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:28:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:28:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:28:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:28:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:28:58.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:58 smithi049 bash[23528]: audit 2024-09-21T00:28:57.293434+0000 mon.a (mon.0) 5187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:58 smithi049 bash[23528]: audit 2024-09-21T00:28:57.303251+0000 mon.a (mon.0) 5188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:58 smithi049 bash[23528]: audit 2024-09-21T00:28:57.314451+0000 mon.a (mon.0) 5189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:58 smithi179 bash[23186]: audit 2024-09-21T00:28:57.293434+0000 mon.a (mon.0) 5187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:58 smithi179 bash[23186]: audit 2024-09-21T00:28:57.303251+0000 mon.a (mon.0) 5188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:58 smithi179 bash[23186]: audit 2024-09-21T00:28:57.314451+0000 mon.a (mon.0) 5189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:58 smithi044 bash[22676]: audit 2024-09-21T00:28:57.293434+0000 mon.a (mon.0) 5187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:58 smithi044 bash[22676]: audit 2024-09-21T00:28:57.303251+0000 mon.a (mon.0) 5188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:58 smithi044 bash[22676]: audit 2024-09-21T00:28:57.314451+0000 mon.a (mon.0) 5189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:59 smithi044 bash[22676]: audit 2024-09-21T00:28:57.667006+0000 mgr.a (mgr.14388) 5815 : audit [DBG] from='client.134508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:59 smithi044 bash[22676]: cluster 2024-09-21T00:28:58.053647+0000 mgr.a (mgr.14388) 5816 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:59 smithi044 bash[22676]: audit 2024-09-21T00:28:59.262629+0000 mon.a (mon.0) 5190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:59 smithi044 bash[22676]: audit 2024-09-21T00:28:59.268261+0000 mon.a (mon.0) 5191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:28:59 smithi044 bash[22676]: audit 2024-09-21T00:28:59.273332+0000 mon.a (mon.0) 5192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:59 smithi179 bash[23186]: audit 2024-09-21T00:28:57.667006+0000 mgr.a (mgr.14388) 5815 : audit [DBG] from='client.134508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:59 smithi179 bash[23186]: cluster 2024-09-21T00:28:58.053647+0000 mgr.a (mgr.14388) 5816 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:59 smithi179 bash[23186]: audit 2024-09-21T00:28:59.262629+0000 mon.a (mon.0) 5190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:59 smithi179 bash[23186]: audit 2024-09-21T00:28:59.268261+0000 mon.a (mon.0) 5191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:28:59 smithi179 bash[23186]: audit 2024-09-21T00:28:59.273332+0000 mon.a (mon.0) 5192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:59 smithi049 bash[23528]: audit 2024-09-21T00:28:57.667006+0000 mgr.a (mgr.14388) 5815 : audit [DBG] from='client.134508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:28:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:59 smithi049 bash[23528]: cluster 2024-09-21T00:28:58.053647+0000 mgr.a (mgr.14388) 5816 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:28:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:59 smithi049 bash[23528]: audit 2024-09-21T00:28:59.262629+0000 mon.a (mon.0) 5190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:59 smithi049 bash[23528]: audit 2024-09-21T00:28:59.268261+0000 mon.a (mon.0) 5191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:28:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:28:59 smithi049 bash[23528]: audit 2024-09-21T00:28:59.273332+0000 mon.a (mon.0) 5192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:01.663 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:01 smithi049 bash[23528]: cluster 2024-09-21T00:29:00.055359+0000 mgr.a (mgr.14388) 5817 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T00:29:01.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:01 smithi044 bash[22676]: cluster 2024-09-21T00:29:00.055359+0000 mgr.a (mgr.14388) 5817 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T00:29:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:01 smithi179 bash[23186]: cluster 2024-09-21T00:29:00.055359+0000 mgr.a (mgr.14388) 5817 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T00:29:02.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:29:02 smithi044 bash[22930]: debug 2024-09-21T00:29:02.510+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:29:02.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:29:02 smithi044 bash[22930]: debug 2024-09-21T00:29:02.510+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:29:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:02 smithi044 bash[22676]: audit 2024-09-21T00:29:01.720231+0000 mon.a (mon.0) 5193 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:29:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:02 smithi044 bash[22676]: audit 2024-09-21T00:29:01.726826+0000 mon.a (mon.0) 5194 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:29:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:02 smithi044 bash[22676]: audit 2024-09-21T00:29:01.728610+0000 mon.a (mon.0) 5195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:29:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:02 smithi044 bash[22676]: audit 2024-09-21T00:29:01.739500+0000 mon.a (mon.0) 5196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:02 smithi044 bash[22676]: audit 2024-09-21T00:29:01.745768+0000 mon.a (mon.0) 5197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:29:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:02 smithi179 bash[23186]: audit 2024-09-21T00:29:01.720231+0000 mon.a (mon.0) 5193 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:29:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:02 smithi179 bash[23186]: audit 2024-09-21T00:29:01.726826+0000 mon.a (mon.0) 5194 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:29:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:02 smithi179 bash[23186]: audit 2024-09-21T00:29:01.728610+0000 mon.a (mon.0) 5195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:29:02.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:02 smithi179 bash[23186]: audit 2024-09-21T00:29:01.739500+0000 mon.a (mon.0) 5196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:02 smithi179 bash[23186]: audit 2024-09-21T00:29:01.745768+0000 mon.a (mon.0) 5197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:29:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:02 smithi049 bash[23528]: audit 2024-09-21T00:29:01.720231+0000 mon.a (mon.0) 5193 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:29:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:02 smithi049 bash[23528]: audit 2024-09-21T00:29:01.726826+0000 mon.a (mon.0) 5194 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:29:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:02 smithi049 bash[23528]: audit 2024-09-21T00:29:01.728610+0000 mon.a (mon.0) 5195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:29:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:02 smithi049 bash[23528]: audit 2024-09-21T00:29:01.739500+0000 mon.a (mon.0) 5196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:02 smithi049 bash[23528]: audit 2024-09-21T00:29:01.745768+0000 mon.a (mon.0) 5197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:29:03.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:03.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:03.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:03 smithi044 bash[22676]: audit 2024-09-21T00:29:01.748203+0000 mgr.a (mgr.14388) 5818 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:29:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:03 smithi044 bash[22676]: cluster 2024-09-21T00:29:02.056419+0000 mgr.a (mgr.14388) 5819 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:03 smithi044 bash[22676]: audit 2024-09-21T00:29:02.515286+0000 mgr.a (mgr.14388) 5820 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:29:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:03 smithi044 bash[22676]: cephadm 2024-09-21T00:29:02.516758+0000 mgr.a (mgr.14388) 5821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:29:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:03 smithi179 bash[23186]: audit 2024-09-21T00:29:01.748203+0000 mgr.a (mgr.14388) 5818 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:29:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:03 smithi179 bash[23186]: cluster 2024-09-21T00:29:02.056419+0000 mgr.a (mgr.14388) 5819 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:03 smithi179 bash[23186]: audit 2024-09-21T00:29:02.515286+0000 mgr.a (mgr.14388) 5820 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:29:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:03 smithi179 bash[23186]: cephadm 2024-09-21T00:29:02.516758+0000 mgr.a (mgr.14388) 5821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:29:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:03 smithi049 bash[23528]: audit 2024-09-21T00:29:01.748203+0000 mgr.a (mgr.14388) 5818 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:29:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:03 smithi049 bash[23528]: cluster 2024-09-21T00:29:02.056419+0000 mgr.a (mgr.14388) 5819 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:03 smithi049 bash[23528]: audit 2024-09-21T00:29:02.515286+0000 mgr.a (mgr.14388) 5820 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:29:03.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:03 smithi049 bash[23528]: cephadm 2024-09-21T00:29:02.516758+0000 mgr.a (mgr.14388) 5821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:29:03.871 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:03.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:03.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:03.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:03.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:04 smithi044 bash[22676]: audit 2024-09-21T00:29:03.449050+0000 mgr.a (mgr.14388) 5822 : audit [DBG] from='client.134685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:04 smithi179 bash[23186]: audit 2024-09-21T00:29:03.449050+0000 mgr.a (mgr.14388) 5822 : audit [DBG] from='client.134685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:04 smithi049 bash[23528]: audit 2024-09-21T00:29:03.449050+0000 mgr.a (mgr.14388) 5822 : audit [DBG] from='client.134685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:05 smithi044 bash[22676]: cluster 2024-09-21T00:29:04.057301+0000 mgr.a (mgr.14388) 5823 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:05 smithi179 bash[23186]: cluster 2024-09-21T00:29:04.057301+0000 mgr.a (mgr.14388) 5823 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:05 smithi049 bash[23528]: cluster 2024-09-21T00:29:04.057301+0000 mgr.a (mgr.14388) 5823 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:07 smithi044 bash[22676]: cluster 2024-09-21T00:29:06.059526+0000 mgr.a (mgr.14388) 5824 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:07 smithi179 bash[23186]: cluster 2024-09-21T00:29:06.059526+0000 mgr.a (mgr.14388) 5824 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:07 smithi049 bash[23528]: cluster 2024-09-21T00:29:06.059526+0000 mgr.a (mgr.14388) 5824 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:08.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:09.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:09.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:09.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:09.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:09.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:09 smithi044 bash[22676]: cluster 2024-09-21T00:29:08.060263+0000 mgr.a (mgr.14388) 5825 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:09 smithi179 bash[23186]: cluster 2024-09-21T00:29:08.060263+0000 mgr.a (mgr.14388) 5825 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:09 smithi049 bash[23528]: cluster 2024-09-21T00:29:08.060263+0000 mgr.a (mgr.14388) 5825 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:10 smithi044 bash[22676]: audit 2024-09-21T00:29:09.207327+0000 mgr.a (mgr.14388) 5826 : audit [DBG] from='client.134763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:10 smithi179 bash[23186]: audit 2024-09-21T00:29:09.207327+0000 mgr.a (mgr.14388) 5826 : audit [DBG] from='client.134763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:10.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:10 smithi049 bash[23528]: audit 2024-09-21T00:29:09.207327+0000 mgr.a (mgr.14388) 5826 : audit [DBG] from='client.134763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:11 smithi044 bash[22676]: cluster 2024-09-21T00:29:10.062078+0000 mgr.a (mgr.14388) 5827 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:11 smithi179 bash[23186]: cluster 2024-09-21T00:29:10.062078+0000 mgr.a (mgr.14388) 5827 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:11 smithi049 bash[23528]: cluster 2024-09-21T00:29:10.062078+0000 mgr.a (mgr.14388) 5827 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:13 smithi044 bash[22676]: cluster 2024-09-21T00:29:12.063497+0000 mgr.a (mgr.14388) 5828 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:13 smithi179 bash[23186]: cluster 2024-09-21T00:29:12.063497+0000 mgr.a (mgr.14388) 5828 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:13 smithi049 bash[23528]: cluster 2024-09-21T00:29:12.063497+0000 mgr.a (mgr.14388) 5828 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:14.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:14.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:15.399 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:15.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:15.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:15.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:15.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:15 smithi044 bash[22676]: cluster 2024-09-21T00:29:14.064444+0000 mgr.a (mgr.14388) 5829 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:15 smithi179 bash[23186]: cluster 2024-09-21T00:29:14.064444+0000 mgr.a (mgr.14388) 5829 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:15.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:15 smithi049 bash[23528]: cluster 2024-09-21T00:29:14.064444+0000 mgr.a (mgr.14388) 5829 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:16 smithi044 bash[22676]: audit 2024-09-21T00:29:14.961775+0000 mgr.a (mgr.14388) 5830 : audit [DBG] from='client.134841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:16 smithi179 bash[23186]: audit 2024-09-21T00:29:14.961775+0000 mgr.a (mgr.14388) 5830 : audit [DBG] from='client.134841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:16.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:16 smithi049 bash[23528]: audit 2024-09-21T00:29:14.961775+0000 mgr.a (mgr.14388) 5830 : audit [DBG] from='client.134841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:17.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:17 smithi179 bash[23186]: cluster 2024-09-21T00:29:16.067369+0000 mgr.a (mgr.14388) 5831 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:17.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:17 smithi179 bash[23186]: audit 2024-09-21T00:29:17.315918+0000 mon.a (mon.0) 5198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:17 smithi179 bash[23186]: audit 2024-09-21T00:29:17.326070+0000 mon.a (mon.0) 5199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:17 smithi179 bash[23186]: audit 2024-09-21T00:29:17.338055+0000 mon.a (mon.0) 5200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:17 smithi044 bash[22676]: cluster 2024-09-21T00:29:16.067369+0000 mgr.a (mgr.14388) 5831 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:17 smithi044 bash[22676]: audit 2024-09-21T00:29:17.315918+0000 mon.a (mon.0) 5198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:17 smithi044 bash[22676]: audit 2024-09-21T00:29:17.326070+0000 mon.a (mon.0) 5199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:17 smithi044 bash[22676]: audit 2024-09-21T00:29:17.338055+0000 mon.a (mon.0) 5200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:17 smithi049 bash[23528]: cluster 2024-09-21T00:29:16.067369+0000 mgr.a (mgr.14388) 5831 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:29:17.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:17 smithi049 bash[23528]: audit 2024-09-21T00:29:17.315918+0000 mon.a (mon.0) 5198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:17 smithi049 bash[23528]: audit 2024-09-21T00:29:17.326070+0000 mon.a (mon.0) 5199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:17 smithi049 bash[23528]: audit 2024-09-21T00:29:17.338055+0000 mon.a (mon.0) 5200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:18 smithi049 bash[23528]: audit 2024-09-21T00:29:17.531695+0000 mon.a (mon.0) 5201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:18 smithi049 bash[23528]: audit 2024-09-21T00:29:17.541336+0000 mon.a (mon.0) 5202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:18.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:18 smithi049 bash[23528]: audit 2024-09-21T00:29:17.552937+0000 mon.a (mon.0) 5203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:18 smithi044 bash[22676]: audit 2024-09-21T00:29:17.531695+0000 mon.a (mon.0) 5201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:18 smithi044 bash[22676]: audit 2024-09-21T00:29:17.541336+0000 mon.a (mon.0) 5202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:18 smithi044 bash[22676]: audit 2024-09-21T00:29:17.552937+0000 mon.a (mon.0) 5203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:18 smithi179 bash[23186]: audit 2024-09-21T00:29:17.531695+0000 mon.a (mon.0) 5201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:18 smithi179 bash[23186]: audit 2024-09-21T00:29:17.541336+0000 mon.a (mon.0) 5202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:18 smithi179 bash[23186]: audit 2024-09-21T00:29:17.552937+0000 mon.a (mon.0) 5203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:19 smithi044 bash[22676]: cluster 2024-09-21T00:29:18.068144+0000 mgr.a (mgr.14388) 5832 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:19 smithi044 bash[22676]: audit 2024-09-21T00:29:19.397075+0000 mon.a (mon.0) 5204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:19 smithi044 bash[22676]: audit 2024-09-21T00:29:19.402952+0000 mon.a (mon.0) 5205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:19 smithi044 bash[22676]: audit 2024-09-21T00:29:19.411106+0000 mon.a (mon.0) 5206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:19 smithi179 bash[23186]: cluster 2024-09-21T00:29:18.068144+0000 mgr.a (mgr.14388) 5832 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:19 smithi179 bash[23186]: audit 2024-09-21T00:29:19.397075+0000 mon.a (mon.0) 5204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:19 smithi179 bash[23186]: audit 2024-09-21T00:29:19.402952+0000 mon.a (mon.0) 5205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:20.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:19 smithi179 bash[23186]: audit 2024-09-21T00:29:19.411106+0000 mon.a (mon.0) 5206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:19 smithi049 bash[23528]: cluster 2024-09-21T00:29:18.068144+0000 mgr.a (mgr.14388) 5832 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:19 smithi049 bash[23528]: audit 2024-09-21T00:29:19.397075+0000 mon.a (mon.0) 5204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:19 smithi049 bash[23528]: audit 2024-09-21T00:29:19.402952+0000 mon.a (mon.0) 5205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:19 smithi049 bash[23528]: audit 2024-09-21T00:29:19.411106+0000 mon.a (mon.0) 5206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:20.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:20.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:20.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:21.178 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:21.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:21.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:21.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:21.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:21 smithi044 bash[22676]: cluster 2024-09-21T00:29:20.069731+0000 mgr.a (mgr.14388) 5833 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:29:21.826 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:21 smithi049 bash[23528]: cluster 2024-09-21T00:29:20.069731+0000 mgr.a (mgr.14388) 5833 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:29:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:21 smithi179 bash[23186]: cluster 2024-09-21T00:29:20.069731+0000 mgr.a (mgr.14388) 5833 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:29:22.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:22 smithi049 bash[23528]: audit 2024-09-21T00:29:20.739319+0000 mgr.a (mgr.14388) 5834 : audit [DBG] from='client.134916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:22 smithi044 bash[22676]: audit 2024-09-21T00:29:20.739319+0000 mgr.a (mgr.14388) 5834 : audit [DBG] from='client.134916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:23.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:22 smithi179 bash[23186]: audit 2024-09-21T00:29:20.739319+0000 mgr.a (mgr.14388) 5834 : audit [DBG] from='client.134916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:23 smithi044 bash[22676]: cluster 2024-09-21T00:29:22.071577+0000 mgr.a (mgr.14388) 5835 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T00:29:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:23 smithi179 bash[23186]: cluster 2024-09-21T00:29:22.071577+0000 mgr.a (mgr.14388) 5835 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T00:29:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:23 smithi049 bash[23528]: cluster 2024-09-21T00:29:22.071577+0000 mgr.a (mgr.14388) 5835 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T00:29:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:25 smithi044 bash[22676]: cluster 2024-09-21T00:29:24.072394+0000 mgr.a (mgr.14388) 5836 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:25 smithi179 bash[23186]: cluster 2024-09-21T00:29:24.072394+0000 mgr.a (mgr.14388) 5836 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:25 smithi049 bash[23528]: cluster 2024-09-21T00:29:24.072394+0000 mgr.a (mgr.14388) 5836 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:26.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:26.180 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:26.180 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:26.937 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:26.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:27 smithi044 bash[22676]: cluster 2024-09-21T00:29:26.074475+0000 mgr.a (mgr.14388) 5837 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:27 smithi044 bash[22676]: audit 2024-09-21T00:29:26.514058+0000 mgr.a (mgr.14388) 5838 : audit [DBG] from='client.134985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:27 smithi179 bash[23186]: cluster 2024-09-21T00:29:26.074475+0000 mgr.a (mgr.14388) 5837 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:27 smithi179 bash[23186]: audit 2024-09-21T00:29:26.514058+0000 mgr.a (mgr.14388) 5838 : audit [DBG] from='client.134985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:27 smithi049 bash[23528]: cluster 2024-09-21T00:29:26.074475+0000 mgr.a (mgr.14388) 5837 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:27 smithi049 bash[23528]: audit 2024-09-21T00:29:26.514058+0000 mgr.a (mgr.14388) 5838 : audit [DBG] from='client.134985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:29 smithi044 bash[22676]: cluster 2024-09-21T00:29:28.075489+0000 mgr.a (mgr.14388) 5839 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:29 smithi179 bash[23186]: cluster 2024-09-21T00:29:28.075489+0000 mgr.a (mgr.14388) 5839 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:30.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:29 smithi049 bash[23528]: cluster 2024-09-21T00:29:28.075489+0000 mgr.a (mgr.14388) 5839 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:31 smithi044 bash[22676]: cluster 2024-09-21T00:29:30.077656+0000 mgr.a (mgr.14388) 5840 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:31 smithi179 bash[23186]: cluster 2024-09-21T00:29:30.077656+0000 mgr.a (mgr.14388) 5840 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:31 smithi049 bash[23528]: cluster 2024-09-21T00:29:30.077656+0000 mgr.a (mgr.14388) 5840 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:32.711 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:32.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:32.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:32.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:32.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:33 smithi044 bash[22676]: cluster 2024-09-21T00:29:32.078207+0000 mgr.a (mgr.14388) 5841 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T00:29:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:33 smithi044 bash[22676]: audit 2024-09-21T00:29:32.275868+0000 mgr.a (mgr.14388) 5842 : audit [DBG] from='client.135063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:33 smithi179 bash[23186]: cluster 2024-09-21T00:29:32.078207+0000 mgr.a (mgr.14388) 5841 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T00:29:34.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:33 smithi179 bash[23186]: audit 2024-09-21T00:29:32.275868+0000 mgr.a (mgr.14388) 5842 : audit [DBG] from='client.135063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:34.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:33 smithi049 bash[23528]: cluster 2024-09-21T00:29:32.078207+0000 mgr.a (mgr.14388) 5841 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T00:29:34.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:33 smithi049 bash[23528]: audit 2024-09-21T00:29:32.275868+0000 mgr.a (mgr.14388) 5842 : audit [DBG] from='client.135063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:35 smithi179 bash[23186]: cluster 2024-09-21T00:29:34.079137+0000 mgr.a (mgr.14388) 5843 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:35 smithi044 bash[22676]: cluster 2024-09-21T00:29:34.079137+0000 mgr.a (mgr.14388) 5843 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:35 smithi049 bash[23528]: cluster 2024-09-21T00:29:34.079137+0000 mgr.a (mgr.14388) 5843 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:37.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:37.713 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:37.713 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:37 smithi044 bash[22676]: cluster 2024-09-21T00:29:36.081424+0000 mgr.a (mgr.14388) 5844 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:37 smithi044 bash[22676]: audit 2024-09-21T00:29:37.552639+0000 mon.a (mon.0) 5207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:37 smithi044 bash[22676]: audit 2024-09-21T00:29:37.562160+0000 mon.a (mon.0) 5208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:37 smithi044 bash[22676]: audit 2024-09-21T00:29:37.572777+0000 mon.a (mon.0) 5209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:37 smithi179 bash[23186]: cluster 2024-09-21T00:29:36.081424+0000 mgr.a (mgr.14388) 5844 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:37 smithi179 bash[23186]: audit 2024-09-21T00:29:37.552639+0000 mon.a (mon.0) 5207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:37 smithi179 bash[23186]: audit 2024-09-21T00:29:37.562160+0000 mon.a (mon.0) 5208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:37 smithi179 bash[23186]: audit 2024-09-21T00:29:37.572777+0000 mon.a (mon.0) 5209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:37 smithi049 bash[23528]: cluster 2024-09-21T00:29:36.081424+0000 mgr.a (mgr.14388) 5844 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:37 smithi049 bash[23528]: audit 2024-09-21T00:29:37.552639+0000 mon.a (mon.0) 5207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:37 smithi049 bash[23528]: audit 2024-09-21T00:29:37.562160+0000 mon.a (mon.0) 5208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:37 smithi049 bash[23528]: audit 2024-09-21T00:29:37.572777+0000 mon.a (mon.0) 5209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.491 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:38 smithi044 bash[22676]: audit 2024-09-21T00:29:37.693805+0000 mon.a (mon.0) 5210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:38 smithi044 bash[22676]: audit 2024-09-21T00:29:37.703359+0000 mon.a (mon.0) 5211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:38 smithi044 bash[22676]: audit 2024-09-21T00:29:37.714852+0000 mon.a (mon.0) 5212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:38 smithi044 bash[22676]: audit 2024-09-21T00:29:38.051795+0000 mgr.a (mgr.14388) 5845 : audit [DBG] from='client.135141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:38 smithi044 bash[22676]: cluster 2024-09-21T00:29:38.082248+0000 mgr.a (mgr.14388) 5846 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:38 smithi179 bash[23186]: audit 2024-09-21T00:29:37.693805+0000 mon.a (mon.0) 5210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:38 smithi179 bash[23186]: audit 2024-09-21T00:29:37.703359+0000 mon.a (mon.0) 5211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:38 smithi179 bash[23186]: audit 2024-09-21T00:29:37.714852+0000 mon.a (mon.0) 5212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:38 smithi179 bash[23186]: audit 2024-09-21T00:29:38.051795+0000 mgr.a (mgr.14388) 5845 : audit [DBG] from='client.135141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:38 smithi179 bash[23186]: cluster 2024-09-21T00:29:38.082248+0000 mgr.a (mgr.14388) 5846 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:38 smithi049 bash[23528]: audit 2024-09-21T00:29:37.693805+0000 mon.a (mon.0) 5210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:38 smithi049 bash[23528]: audit 2024-09-21T00:29:37.703359+0000 mon.a (mon.0) 5211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:38 smithi049 bash[23528]: audit 2024-09-21T00:29:37.714852+0000 mon.a (mon.0) 5212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:38 smithi049 bash[23528]: audit 2024-09-21T00:29:38.051795+0000 mgr.a (mgr.14388) 5845 : audit [DBG] from='client.135141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:38 smithi049 bash[23528]: cluster 2024-09-21T00:29:38.082248+0000 mgr.a (mgr.14388) 5846 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:40.863 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:40 smithi044 bash[22676]: audit 2024-09-21T00:29:39.591226+0000 mon.a (mon.0) 5213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:40.863 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:40 smithi044 bash[22676]: audit 2024-09-21T00:29:39.599679+0000 mon.a (mon.0) 5214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:40.863 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:40 smithi044 bash[22676]: audit 2024-09-21T00:29:39.609911+0000 mon.a (mon.0) 5215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:40 smithi179 bash[23186]: audit 2024-09-21T00:29:39.591226+0000 mon.a (mon.0) 5213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:40 smithi179 bash[23186]: audit 2024-09-21T00:29:39.599679+0000 mon.a (mon.0) 5214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:40 smithi179 bash[23186]: audit 2024-09-21T00:29:39.609911+0000 mon.a (mon.0) 5215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:40 smithi049 bash[23528]: audit 2024-09-21T00:29:39.591226+0000 mon.a (mon.0) 5213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:40 smithi049 bash[23528]: audit 2024-09-21T00:29:39.599679+0000 mon.a (mon.0) 5214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:40 smithi049 bash[23528]: audit 2024-09-21T00:29:39.609911+0000 mon.a (mon.0) 5215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:41 smithi044 bash[22676]: cluster 2024-09-21T00:29:40.084566+0000 mgr.a (mgr.14388) 5847 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:41 smithi179 bash[23186]: cluster 2024-09-21T00:29:40.084566+0000 mgr.a (mgr.14388) 5847 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:42.014 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:41 smithi049 bash[23528]: cluster 2024-09-21T00:29:40.084566+0000 mgr.a (mgr.14388) 5847 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:43.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:43.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:43.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:43 smithi044 bash[22676]: cluster 2024-09-21T00:29:42.085410+0000 mgr.a (mgr.14388) 5848 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:43 smithi179 bash[23186]: cluster 2024-09-21T00:29:42.085410+0000 mgr.a (mgr.14388) 5848 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:43 smithi049 bash[23528]: cluster 2024-09-21T00:29:42.085410+0000 mgr.a (mgr.14388) 5848 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:44.264 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:44.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:44.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:44.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:44.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:45 smithi044 bash[22676]: audit 2024-09-21T00:29:43.828935+0000 mgr.a (mgr.14388) 5849 : audit [DBG] from='client.135219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:45 smithi044 bash[22676]: cluster 2024-09-21T00:29:44.085996+0000 mgr.a (mgr.14388) 5850 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:45 smithi179 bash[23186]: audit 2024-09-21T00:29:43.828935+0000 mgr.a (mgr.14388) 5849 : audit [DBG] from='client.135219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:45 smithi179 bash[23186]: cluster 2024-09-21T00:29:44.085996+0000 mgr.a (mgr.14388) 5850 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:45 smithi049 bash[23528]: audit 2024-09-21T00:29:43.828935+0000 mgr.a (mgr.14388) 5849 : audit [DBG] from='client.135219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:45 smithi049 bash[23528]: cluster 2024-09-21T00:29:44.085996+0000 mgr.a (mgr.14388) 5850 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:47 smithi044 bash[22676]: cluster 2024-09-21T00:29:46.088291+0000 mgr.a (mgr.14388) 5851 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:47 smithi179 bash[23186]: cluster 2024-09-21T00:29:46.088291+0000 mgr.a (mgr.14388) 5851 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:47 smithi049 bash[23528]: cluster 2024-09-21T00:29:46.088291+0000 mgr.a (mgr.14388) 5851 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:49.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:49.267 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:49.267 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:49 smithi044 bash[22676]: cluster 2024-09-21T00:29:48.089120+0000 mgr.a (mgr.14388) 5852 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:49 smithi179 bash[23186]: cluster 2024-09-21T00:29:48.089120+0000 mgr.a (mgr.14388) 5852 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:49 smithi049 bash[23528]: cluster 2024-09-21T00:29:48.089120+0000 mgr.a (mgr.14388) 5852 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:50.056 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:50 smithi044 bash[22676]: audit 2024-09-21T00:29:49.603559+0000 mgr.a (mgr.14388) 5853 : audit [DBG] from='client.135297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:50 smithi179 bash[23186]: audit 2024-09-21T00:29:49.603559+0000 mgr.a (mgr.14388) 5853 : audit [DBG] from='client.135297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:50 smithi049 bash[23528]: audit 2024-09-21T00:29:49.603559+0000 mgr.a (mgr.14388) 5853 : audit [DBG] from='client.135297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:51 smithi044 bash[22676]: cluster 2024-09-21T00:29:50.090138+0000 mgr.a (mgr.14388) 5854 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:51 smithi179 bash[23186]: cluster 2024-09-21T00:29:50.090138+0000 mgr.a (mgr.14388) 5854 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:51 smithi049 bash[23528]: cluster 2024-09-21T00:29:50.090138+0000 mgr.a (mgr.14388) 5854 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:29:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:53 smithi044 bash[22676]: cluster 2024-09-21T00:29:52.091053+0000 mgr.a (mgr.14388) 5855 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:53 smithi179 bash[23186]: cluster 2024-09-21T00:29:52.091053+0000 mgr.a (mgr.14388) 5855 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:53 smithi049 bash[23528]: cluster 2024-09-21T00:29:52.091053+0000 mgr.a (mgr.14388) 5855 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:55.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:29:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:29:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:29:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:55 smithi179 bash[23186]: cluster 2024-09-21T00:29:54.092000+0000 mgr.a (mgr.14388) 5856 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:55.834 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:29:55.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:29:55.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:29:55.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:29:55.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:29:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:55 smithi044 bash[22676]: cluster 2024-09-21T00:29:54.092000+0000 mgr.a (mgr.14388) 5856 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:55 smithi049 bash[23528]: cluster 2024-09-21T00:29:54.092000+0000 mgr.a (mgr.14388) 5856 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:56 smithi044 bash[22676]: audit 2024-09-21T00:29:55.397886+0000 mgr.a (mgr.14388) 5857 : audit [DBG] from='client.135372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:56 smithi179 bash[23186]: audit 2024-09-21T00:29:55.397886+0000 mgr.a (mgr.14388) 5857 : audit [DBG] from='client.135372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:56 smithi049 bash[23528]: audit 2024-09-21T00:29:55.397886+0000 mgr.a (mgr.14388) 5857 : audit [DBG] from='client.135372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:29:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:57 smithi179 bash[23186]: cluster 2024-09-21T00:29:56.094862+0000 mgr.a (mgr.14388) 5858 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:57 smithi044 bash[22676]: cluster 2024-09-21T00:29:56.094862+0000 mgr.a (mgr.14388) 5858 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:58.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:57 smithi049 bash[23528]: cluster 2024-09-21T00:29:56.094862+0000 mgr.a (mgr.14388) 5858 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:58 smithi179 bash[23186]: audit 2024-09-21T00:29:57.770137+0000 mon.a (mon.0) 5216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:58 smithi179 bash[23186]: audit 2024-09-21T00:29:57.778663+0000 mon.a (mon.0) 5217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:58 smithi179 bash[23186]: audit 2024-09-21T00:29:57.789112+0000 mon.a (mon.0) 5218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:58 smithi179 bash[23186]: audit 2024-09-21T00:29:57.891310+0000 mon.a (mon.0) 5219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:58 smithi179 bash[23186]: audit 2024-09-21T00:29:57.900010+0000 mon.a (mon.0) 5220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:58 smithi179 bash[23186]: audit 2024-09-21T00:29:57.910057+0000 mon.a (mon.0) 5221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:29:58 smithi179 bash[23186]: cluster 2024-09-21T00:29:58.095653+0000 mgr.a (mgr.14388) 5859 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:59.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:58 smithi049 bash[23528]: audit 2024-09-21T00:29:57.770137+0000 mon.a (mon.0) 5216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:58 smithi049 bash[23528]: audit 2024-09-21T00:29:57.778663+0000 mon.a (mon.0) 5217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:58 smithi049 bash[23528]: audit 2024-09-21T00:29:57.789112+0000 mon.a (mon.0) 5218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:58 smithi049 bash[23528]: audit 2024-09-21T00:29:57.891310+0000 mon.a (mon.0) 5219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:58 smithi049 bash[23528]: audit 2024-09-21T00:29:57.900010+0000 mon.a (mon.0) 5220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:58 smithi049 bash[23528]: audit 2024-09-21T00:29:57.910057+0000 mon.a (mon.0) 5221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:29:58 smithi049 bash[23528]: cluster 2024-09-21T00:29:58.095653+0000 mgr.a (mgr.14388) 5859 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:29:59.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:58 smithi044 bash[22676]: audit 2024-09-21T00:29:57.770137+0000 mon.a (mon.0) 5216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:58 smithi044 bash[22676]: audit 2024-09-21T00:29:57.778663+0000 mon.a (mon.0) 5217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:58 smithi044 bash[22676]: audit 2024-09-21T00:29:57.789112+0000 mon.a (mon.0) 5218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:58 smithi044 bash[22676]: audit 2024-09-21T00:29:57.891310+0000 mon.a (mon.0) 5219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:58 smithi044 bash[22676]: audit 2024-09-21T00:29:57.900010+0000 mon.a (mon.0) 5220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:58 smithi044 bash[22676]: audit 2024-09-21T00:29:57.910057+0000 mon.a (mon.0) 5221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:29:59.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:29:58 smithi044 bash[22676]: cluster 2024-09-21T00:29:58.095653+0000 mgr.a (mgr.14388) 5859 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:00.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:00.836 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:00.837 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:01.049 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:00 smithi044 bash[22676]: audit 2024-09-21T00:29:59.796335+0000 mon.a (mon.0) 5222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.049 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:00 smithi044 bash[22676]: audit 2024-09-21T00:29:59.804404+0000 mon.a (mon.0) 5223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.049 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:00 smithi044 bash[22676]: audit 2024-09-21T00:29:59.812928+0000 mon.a (mon.0) 5224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.049 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:00 smithi044 bash[22676]: cluster 2024-09-21T00:30:00.000174+0000 mon.a (mon.0) 5225 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:30:01.049 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:00 smithi044 bash[22676]: cluster 2024-09-21T00:30:00.097691+0000 mgr.a (mgr.14388) 5860 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:01.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:00 smithi049 bash[23528]: audit 2024-09-21T00:29:59.796335+0000 mon.a (mon.0) 5222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:00 smithi049 bash[23528]: audit 2024-09-21T00:29:59.804404+0000 mon.a (mon.0) 5223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:00 smithi049 bash[23528]: audit 2024-09-21T00:29:59.812928+0000 mon.a (mon.0) 5224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:00 smithi049 bash[23528]: cluster 2024-09-21T00:30:00.000174+0000 mon.a (mon.0) 5225 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:30:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:00 smithi049 bash[23528]: cluster 2024-09-21T00:30:00.097691+0000 mgr.a (mgr.14388) 5860 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:00 smithi179 bash[23186]: audit 2024-09-21T00:29:59.796335+0000 mon.a (mon.0) 5222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:00 smithi179 bash[23186]: audit 2024-09-21T00:29:59.804404+0000 mon.a (mon.0) 5223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:00 smithi179 bash[23186]: audit 2024-09-21T00:29:59.812928+0000 mon.a (mon.0) 5224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:00 smithi179 bash[23186]: cluster 2024-09-21T00:30:00.000174+0000 mon.a (mon.0) 5225 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:00 smithi179 bash[23186]: cluster 2024-09-21T00:30:00.097691+0000 mgr.a (mgr.14388) 5860 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:01.592 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:01.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:01.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:01.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:01.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:01 smithi044 bash[22676]: audit 2024-09-21T00:30:01.177162+0000 mgr.a (mgr.14388) 5861 : audit [DBG] from='client.135450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:02.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:01 smithi179 bash[23186]: audit 2024-09-21T00:30:01.177162+0000 mgr.a (mgr.14388) 5861 : audit [DBG] from='client.135450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:02.262 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:01 smithi049 bash[23528]: audit 2024-09-21T00:30:01.177162+0000 mgr.a (mgr.14388) 5861 : audit [DBG] from='client.135450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:03.098 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:02 smithi049 bash[23528]: cluster 2024-09-21T00:30:02.098726+0000 mgr.a (mgr.14388) 5862 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:03.098 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:02 smithi049 bash[23528]: audit 2024-09-21T00:30:02.576376+0000 mon.a (mon.0) 5226 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:30:03.098 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:02 smithi049 bash[23528]: audit 2024-09-21T00:30:02.583283+0000 mon.a (mon.0) 5227 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:30:03.098 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:02 smithi049 bash[23528]: audit 2024-09-21T00:30:02.585142+0000 mon.a (mon.0) 5228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:30:03.099 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:02 smithi049 bash[23528]: audit 2024-09-21T00:30:02.596426+0000 mon.a (mon.0) 5229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:03.099 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:02 smithi049 bash[23528]: audit 2024-09-21T00:30:02.602851+0000 mon.a (mon.0) 5230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:30:03.099 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:02 smithi049 bash[23528]: audit 2024-09-21T00:30:02.605465+0000 mgr.a (mgr.14388) 5863 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:02 smithi044 bash[22676]: cluster 2024-09-21T00:30:02.098726+0000 mgr.a (mgr.14388) 5862 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:02 smithi044 bash[22676]: audit 2024-09-21T00:30:02.576376+0000 mon.a (mon.0) 5226 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:02 smithi044 bash[22676]: audit 2024-09-21T00:30:02.583283+0000 mon.a (mon.0) 5227 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:02 smithi044 bash[22676]: audit 2024-09-21T00:30:02.585142+0000 mon.a (mon.0) 5228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:02 smithi044 bash[22676]: audit 2024-09-21T00:30:02.596426+0000 mon.a (mon.0) 5229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:02 smithi044 bash[22676]: audit 2024-09-21T00:30:02.602851+0000 mon.a (mon.0) 5230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:02 smithi044 bash[22676]: audit 2024-09-21T00:30:02.605465+0000 mgr.a (mgr.14388) 5863 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:30:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:02 smithi179 bash[23186]: cluster 2024-09-21T00:30:02.098726+0000 mgr.a (mgr.14388) 5862 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:02 smithi179 bash[23186]: audit 2024-09-21T00:30:02.576376+0000 mon.a (mon.0) 5226 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:30:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:02 smithi179 bash[23186]: audit 2024-09-21T00:30:02.583283+0000 mon.a (mon.0) 5227 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:30:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:02 smithi179 bash[23186]: audit 2024-09-21T00:30:02.585142+0000 mon.a (mon.0) 5228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:30:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:02 smithi179 bash[23186]: audit 2024-09-21T00:30:02.596426+0000 mon.a (mon.0) 5229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:02 smithi179 bash[23186]: audit 2024-09-21T00:30:02.602851+0000 mon.a (mon.0) 5230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:30:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:02 smithi179 bash[23186]: audit 2024-09-21T00:30:02.605465+0000 mgr.a (mgr.14388) 5863 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:30:03.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:30:03 smithi044 bash[22930]: debug 2024-09-21T00:30:03.373+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:30:03.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:30:03 smithi044 bash[22930]: debug 2024-09-21T00:30:03.373+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:30:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:03 smithi044 bash[22676]: audit 2024-09-21T00:30:03.378138+0000 mgr.a (mgr.14388) 5864 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:30:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:03 smithi044 bash[22676]: cephadm 2024-09-21T00:30:03.379487+0000 mgr.a (mgr.14388) 5865 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:30:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:03 smithi179 bash[23186]: audit 2024-09-21T00:30:03.378138+0000 mgr.a (mgr.14388) 5864 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:30:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:03 smithi179 bash[23186]: cephadm 2024-09-21T00:30:03.379487+0000 mgr.a (mgr.14388) 5865 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:30:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:03 smithi049 bash[23528]: audit 2024-09-21T00:30:03.378138+0000 mgr.a (mgr.14388) 5864 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:30:04.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:03 smithi049 bash[23528]: cephadm 2024-09-21T00:30:03.379487+0000 mgr.a (mgr.14388) 5865 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:30:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:04 smithi044 bash[22676]: cluster 2024-09-21T00:30:04.099715+0000 mgr.a (mgr.14388) 5866 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:04 smithi179 bash[23186]: cluster 2024-09-21T00:30:04.099715+0000 mgr.a (mgr.14388) 5866 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:04 smithi049 bash[23528]: cluster 2024-09-21T00:30:04.099715+0000 mgr.a (mgr.14388) 5866 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:06.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:06.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:06.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:07.382 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:07.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:07.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:07.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:07.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:07 smithi044 bash[22676]: cluster 2024-09-21T00:30:06.101892+0000 mgr.a (mgr.14388) 5867 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:07 smithi179 bash[23186]: cluster 2024-09-21T00:30:06.101892+0000 mgr.a (mgr.14388) 5867 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:07 smithi049 bash[23528]: cluster 2024-09-21T00:30:06.101892+0000 mgr.a (mgr.14388) 5867 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:08 smithi044 bash[22676]: audit 2024-09-21T00:30:06.935464+0000 mgr.a (mgr.14388) 5868 : audit [DBG] from='client.135633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:08 smithi179 bash[23186]: audit 2024-09-21T00:30:06.935464+0000 mgr.a (mgr.14388) 5868 : audit [DBG] from='client.135633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:08.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:08 smithi049 bash[23528]: audit 2024-09-21T00:30:06.935464+0000 mgr.a (mgr.14388) 5868 : audit [DBG] from='client.135633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:09 smithi044 bash[22676]: cluster 2024-09-21T00:30:08.102845+0000 mgr.a (mgr.14388) 5869 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:09 smithi179 bash[23186]: cluster 2024-09-21T00:30:08.102845+0000 mgr.a (mgr.14388) 5869 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:09.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:09 smithi049 bash[23528]: cluster 2024-09-21T00:30:08.102845+0000 mgr.a (mgr.14388) 5869 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:11 smithi044 bash[22676]: cluster 2024-09-21T00:30:10.104985+0000 mgr.a (mgr.14388) 5870 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:11 smithi179 bash[23186]: cluster 2024-09-21T00:30:10.104985+0000 mgr.a (mgr.14388) 5870 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:11.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:11 smithi049 bash[23528]: cluster 2024-09-21T00:30:10.104985+0000 mgr.a (mgr.14388) 5870 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:12.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:12.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:12.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:13.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:13.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:13 smithi044 bash[22676]: cluster 2024-09-21T00:30:12.105953+0000 mgr.a (mgr.14388) 5871 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:13 smithi179 bash[23186]: cluster 2024-09-21T00:30:12.105953+0000 mgr.a (mgr.14388) 5871 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:13.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:13 smithi049 bash[23528]: cluster 2024-09-21T00:30:12.105953+0000 mgr.a (mgr.14388) 5871 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:14 smithi044 bash[22676]: audit 2024-09-21T00:30:12.719072+0000 mgr.a (mgr.14388) 5872 : audit [DBG] from='client.135711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:14 smithi179 bash[23186]: audit 2024-09-21T00:30:12.719072+0000 mgr.a (mgr.14388) 5872 : audit [DBG] from='client.135711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:14.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:14 smithi049 bash[23528]: audit 2024-09-21T00:30:12.719072+0000 mgr.a (mgr.14388) 5872 : audit [DBG] from='client.135711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:15 smithi044 bash[22676]: cluster 2024-09-21T00:30:14.106980+0000 mgr.a (mgr.14388) 5873 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:15 smithi179 bash[23186]: cluster 2024-09-21T00:30:14.106980+0000 mgr.a (mgr.14388) 5873 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:15.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:15 smithi049 bash[23528]: cluster 2024-09-21T00:30:14.106980+0000 mgr.a (mgr.14388) 5873 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:17 smithi179 bash[23186]: cluster 2024-09-21T00:30:16.109278+0000 mgr.a (mgr.14388) 5874 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:17.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:17 smithi044 bash[22676]: cluster 2024-09-21T00:30:16.109278+0000 mgr.a (mgr.14388) 5874 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:17.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:17 smithi049 bash[23528]: cluster 2024-09-21T00:30:16.109278+0000 mgr.a (mgr.14388) 5874 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:30:18.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:18.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:18.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:18.969 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:19.268 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: audit 2024-09-21T00:30:18.007083+0000 mon.a (mon.0) 5231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: audit 2024-09-21T00:30:18.015500+0000 mon.a (mon.0) 5232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: audit 2024-09-21T00:30:18.026106+0000 mon.a (mon.0) 5233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: audit 2024-09-21T00:30:18.040670+0000 mon.a (mon.0) 5234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: audit 2024-09-21T00:30:18.048669+0000 mon.a (mon.0) 5235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: audit 2024-09-21T00:30:18.058505+0000 mon.a (mon.0) 5236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: cluster 2024-09-21T00:30:18.110036+0000 mgr.a (mgr.14388) 5875 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:19.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:19 smithi044 bash[22676]: audit 2024-09-21T00:30:18.525287+0000 mgr.a (mgr.14388) 5876 : audit [DBG] from='client.135783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: audit 2024-09-21T00:30:18.007083+0000 mon.a (mon.0) 5231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: audit 2024-09-21T00:30:18.015500+0000 mon.a (mon.0) 5232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: audit 2024-09-21T00:30:18.026106+0000 mon.a (mon.0) 5233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: audit 2024-09-21T00:30:18.040670+0000 mon.a (mon.0) 5234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: audit 2024-09-21T00:30:18.048669+0000 mon.a (mon.0) 5235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: audit 2024-09-21T00:30:18.058505+0000 mon.a (mon.0) 5236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: cluster 2024-09-21T00:30:18.110036+0000 mgr.a (mgr.14388) 5875 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:19 smithi049 bash[23528]: audit 2024-09-21T00:30:18.525287+0000 mgr.a (mgr.14388) 5876 : audit [DBG] from='client.135783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: audit 2024-09-21T00:30:18.007083+0000 mon.a (mon.0) 5231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: audit 2024-09-21T00:30:18.015500+0000 mon.a (mon.0) 5232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: audit 2024-09-21T00:30:18.026106+0000 mon.a (mon.0) 5233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: audit 2024-09-21T00:30:18.040670+0000 mon.a (mon.0) 5234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: audit 2024-09-21T00:30:18.048669+0000 mon.a (mon.0) 5235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: audit 2024-09-21T00:30:18.058505+0000 mon.a (mon.0) 5236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: cluster 2024-09-21T00:30:18.110036+0000 mgr.a (mgr.14388) 5875 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:19.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:19 smithi179 bash[23186]: audit 2024-09-21T00:30:18.525287+0000 mgr.a (mgr.14388) 5876 : audit [DBG] from='client.135783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:21 smithi049 bash[23528]: audit 2024-09-21T00:30:20.033608+0000 mon.a (mon.0) 5237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:21 smithi049 bash[23528]: audit 2024-09-21T00:30:20.043690+0000 mon.a (mon.0) 5238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:21 smithi049 bash[23528]: audit 2024-09-21T00:30:20.054173+0000 mon.a (mon.0) 5239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:21 smithi049 bash[23528]: cluster 2024-09-21T00:30:20.112435+0000 mgr.a (mgr.14388) 5877 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:21 smithi044 bash[22676]: audit 2024-09-21T00:30:20.033608+0000 mon.a (mon.0) 5237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:21 smithi044 bash[22676]: audit 2024-09-21T00:30:20.043690+0000 mon.a (mon.0) 5238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:21 smithi044 bash[22676]: audit 2024-09-21T00:30:20.054173+0000 mon.a (mon.0) 5239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:21 smithi044 bash[22676]: cluster 2024-09-21T00:30:20.112435+0000 mgr.a (mgr.14388) 5877 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:21 smithi179 bash[23186]: audit 2024-09-21T00:30:20.033608+0000 mon.a (mon.0) 5237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:21 smithi179 bash[23186]: audit 2024-09-21T00:30:20.043690+0000 mon.a (mon.0) 5238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:21 smithi179 bash[23186]: audit 2024-09-21T00:30:20.054173+0000 mon.a (mon.0) 5239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:21 smithi179 bash[23186]: cluster 2024-09-21T00:30:20.112435+0000 mgr.a (mgr.14388) 5877 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:23 smithi044 bash[22676]: cluster 2024-09-21T00:30:22.113320+0000 mgr.a (mgr.14388) 5878 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:23 smithi179 bash[23186]: cluster 2024-09-21T00:30:22.113320+0000 mgr.a (mgr.14388) 5878 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:23 smithi049 bash[23528]: cluster 2024-09-21T00:30:22.113320+0000 mgr.a (mgr.14388) 5878 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:23.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:24.758 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:24.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:24.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:24.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:24.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:25 smithi044 bash[22676]: cluster 2024-09-21T00:30:24.113772+0000 mgr.a (mgr.14388) 5879 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:25 smithi044 bash[22676]: audit 2024-09-21T00:30:24.309944+0000 mgr.a (mgr.14388) 5880 : audit [DBG] from='client.135858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:25 smithi179 bash[23186]: cluster 2024-09-21T00:30:24.113772+0000 mgr.a (mgr.14388) 5879 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:25 smithi179 bash[23186]: audit 2024-09-21T00:30:24.309944+0000 mgr.a (mgr.14388) 5880 : audit [DBG] from='client.135858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:25.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:25 smithi049 bash[23528]: cluster 2024-09-21T00:30:24.113772+0000 mgr.a (mgr.14388) 5879 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:25.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:25 smithi049 bash[23528]: audit 2024-09-21T00:30:24.309944+0000 mgr.a (mgr.14388) 5880 : audit [DBG] from='client.135858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:27 smithi044 bash[22676]: cluster 2024-09-21T00:30:26.115949+0000 mgr.a (mgr.14388) 5881 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:27 smithi179 bash[23186]: cluster 2024-09-21T00:30:26.115949+0000 mgr.a (mgr.14388) 5881 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:27.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:27 smithi049 bash[23528]: cluster 2024-09-21T00:30:26.115949+0000 mgr.a (mgr.14388) 5881 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:29 smithi044 bash[22676]: cluster 2024-09-21T00:30:28.116736+0000 mgr.a (mgr.14388) 5882 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:29 smithi179 bash[23186]: cluster 2024-09-21T00:30:28.116736+0000 mgr.a (mgr.14388) 5882 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:29.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:29 smithi049 bash[23528]: cluster 2024-09-21T00:30:28.116736+0000 mgr.a (mgr.14388) 5882 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:29.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:29.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:30.532 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:31 smithi044 bash[22676]: audit 2024-09-21T00:30:30.083030+0000 mgr.a (mgr.14388) 5883 : audit [DBG] from='client.135936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:31 smithi044 bash[22676]: cluster 2024-09-21T00:30:30.118827+0000 mgr.a (mgr.14388) 5884 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:31 smithi179 bash[23186]: audit 2024-09-21T00:30:30.083030+0000 mgr.a (mgr.14388) 5883 : audit [DBG] from='client.135936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:31 smithi179 bash[23186]: cluster 2024-09-21T00:30:30.118827+0000 mgr.a (mgr.14388) 5884 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:31.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:31 smithi049 bash[23528]: audit 2024-09-21T00:30:30.083030+0000 mgr.a (mgr.14388) 5883 : audit [DBG] from='client.135936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:31.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:31 smithi049 bash[23528]: cluster 2024-09-21T00:30:30.118827+0000 mgr.a (mgr.14388) 5884 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:33 smithi044 bash[22676]: cluster 2024-09-21T00:30:32.119777+0000 mgr.a (mgr.14388) 5885 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:33 smithi179 bash[23186]: cluster 2024-09-21T00:30:32.119777+0000 mgr.a (mgr.14388) 5885 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:33.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:33 smithi049 bash[23528]: cluster 2024-09-21T00:30:32.119777+0000 mgr.a (mgr.14388) 5885 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:30:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:35 smithi044 bash[22676]: cluster 2024-09-21T00:30:34.120561+0000 mgr.a (mgr.14388) 5886 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:30:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:35 smithi179 bash[23186]: cluster 2024-09-21T00:30:34.120561+0000 mgr.a (mgr.14388) 5886 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:30:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:35.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:35 smithi049 bash[23528]: cluster 2024-09-21T00:30:34.120561+0000 mgr.a (mgr.14388) 5886 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:30:36.309 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:36.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:36.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:36.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:36.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:37.418 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:37 smithi179 bash[23186]: audit 2024-09-21T00:30:35.871477+0000 mgr.a (mgr.14388) 5887 : audit [DBG] from='client.136011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:37.418 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:37 smithi179 bash[23186]: cluster 2024-09-21T00:30:36.121918+0000 mgr.a (mgr.14388) 5888 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:37 smithi044 bash[22676]: audit 2024-09-21T00:30:35.871477+0000 mgr.a (mgr.14388) 5887 : audit [DBG] from='client.136011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:37 smithi044 bash[22676]: cluster 2024-09-21T00:30:36.121918+0000 mgr.a (mgr.14388) 5888 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:37.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:37 smithi049 bash[23528]: audit 2024-09-21T00:30:35.871477+0000 mgr.a (mgr.14388) 5887 : audit [DBG] from='client.136011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:37.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:37 smithi049 bash[23528]: cluster 2024-09-21T00:30:36.121918+0000 mgr.a (mgr.14388) 5888 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:39 smithi044 bash[22676]: cluster 2024-09-21T00:30:38.122835+0000 mgr.a (mgr.14388) 5889 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:30:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:39 smithi044 bash[22676]: audit 2024-09-21T00:30:38.236438+0000 mon.a (mon.0) 5240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:39 smithi044 bash[22676]: audit 2024-09-21T00:30:38.244704+0000 mon.a (mon.0) 5241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:39 smithi044 bash[22676]: audit 2024-09-21T00:30:38.255673+0000 mon.a (mon.0) 5242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:39 smithi044 bash[22676]: audit 2024-09-21T00:30:38.266514+0000 mon.a (mon.0) 5243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:39 smithi044 bash[22676]: audit 2024-09-21T00:30:38.274944+0000 mon.a (mon.0) 5244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:39 smithi044 bash[22676]: audit 2024-09-21T00:30:38.285463+0000 mon.a (mon.0) 5245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:39 smithi179 bash[23186]: cluster 2024-09-21T00:30:38.122835+0000 mgr.a (mgr.14388) 5889 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:30:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:39 smithi179 bash[23186]: audit 2024-09-21T00:30:38.236438+0000 mon.a (mon.0) 5240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:39 smithi179 bash[23186]: audit 2024-09-21T00:30:38.244704+0000 mon.a (mon.0) 5241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:39 smithi179 bash[23186]: audit 2024-09-21T00:30:38.255673+0000 mon.a (mon.0) 5242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:39 smithi179 bash[23186]: audit 2024-09-21T00:30:38.266514+0000 mon.a (mon.0) 5243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:39 smithi179 bash[23186]: audit 2024-09-21T00:30:38.274944+0000 mon.a (mon.0) 5244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:39 smithi179 bash[23186]: audit 2024-09-21T00:30:38.285463+0000 mon.a (mon.0) 5245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:39 smithi049 bash[23528]: cluster 2024-09-21T00:30:38.122835+0000 mgr.a (mgr.14388) 5889 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:30:39.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:39 smithi049 bash[23528]: audit 2024-09-21T00:30:38.236438+0000 mon.a (mon.0) 5240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:39 smithi049 bash[23528]: audit 2024-09-21T00:30:38.244704+0000 mon.a (mon.0) 5241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:39 smithi049 bash[23528]: audit 2024-09-21T00:30:38.255673+0000 mon.a (mon.0) 5242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:39 smithi049 bash[23528]: audit 2024-09-21T00:30:38.266514+0000 mon.a (mon.0) 5243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:39 smithi049 bash[23528]: audit 2024-09-21T00:30:38.274944+0000 mon.a (mon.0) 5244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:39.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:39 smithi049 bash[23528]: audit 2024-09-21T00:30:38.285463+0000 mon.a (mon.0) 5245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:41.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:41.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:41 smithi044 bash[22676]: cluster 2024-09-21T00:30:40.124332+0000 mgr.a (mgr.14388) 5890 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:41 smithi044 bash[22676]: audit 2024-09-21T00:30:40.229756+0000 mon.a (mon.0) 5246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:41 smithi044 bash[22676]: audit 2024-09-21T00:30:40.235125+0000 mon.a (mon.0) 5247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:41 smithi044 bash[22676]: audit 2024-09-21T00:30:40.245842+0000 mon.a (mon.0) 5248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:41 smithi179 bash[23186]: cluster 2024-09-21T00:30:40.124332+0000 mgr.a (mgr.14388) 5890 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:41 smithi179 bash[23186]: audit 2024-09-21T00:30:40.229756+0000 mon.a (mon.0) 5246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:41 smithi179 bash[23186]: audit 2024-09-21T00:30:40.235125+0000 mon.a (mon.0) 5247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:41 smithi179 bash[23186]: audit 2024-09-21T00:30:40.245842+0000 mon.a (mon.0) 5248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:41 smithi049 bash[23528]: cluster 2024-09-21T00:30:40.124332+0000 mgr.a (mgr.14388) 5890 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:41 smithi049 bash[23528]: audit 2024-09-21T00:30:40.229756+0000 mon.a (mon.0) 5246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:41 smithi049 bash[23528]: audit 2024-09-21T00:30:40.235125+0000 mon.a (mon.0) 5247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:41 smithi049 bash[23528]: audit 2024-09-21T00:30:40.245842+0000 mon.a (mon.0) 5248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:42.041 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:42.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:42.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:42.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:42.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:42 smithi179 bash[23186]: audit 2024-09-21T00:30:41.626360+0000 mgr.a (mgr.14388) 5891 : audit [DBG] from='client.136089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:42.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:42 smithi049 bash[23528]: audit 2024-09-21T00:30:41.626360+0000 mgr.a (mgr.14388) 5891 : audit [DBG] from='client.136089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:42 smithi044 bash[22676]: audit 2024-09-21T00:30:41.626360+0000 mgr.a (mgr.14388) 5891 : audit [DBG] from='client.136089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:43.499 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:43 smithi049 bash[23528]: cluster 2024-09-21T00:30:42.125336+0000 mgr.a (mgr.14388) 5892 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:43 smithi179 bash[23186]: cluster 2024-09-21T00:30:42.125336+0000 mgr.a (mgr.14388) 5892 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:43 smithi044 bash[22676]: cluster 2024-09-21T00:30:42.125336+0000 mgr.a (mgr.14388) 5892 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:45 smithi179 bash[23186]: cluster 2024-09-21T00:30:44.126130+0000 mgr.a (mgr.14388) 5893 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:45 smithi049 bash[23528]: cluster 2024-09-21T00:30:44.126130+0000 mgr.a (mgr.14388) 5893 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:45 smithi044 bash[22676]: cluster 2024-09-21T00:30:44.126130+0000 mgr.a (mgr.14388) 5893 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:47.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:47.043 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:47.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:47 smithi179 bash[23186]: cluster 2024-09-21T00:30:46.128333+0000 mgr.a (mgr.14388) 5894 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:47 smithi049 bash[23528]: cluster 2024-09-21T00:30:46.128333+0000 mgr.a (mgr.14388) 5894 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:47 smithi044 bash[22676]: cluster 2024-09-21T00:30:46.128333+0000 mgr.a (mgr.14388) 5894 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:47.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:47.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:48.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:48 smithi049 bash[23528]: audit 2024-09-21T00:30:47.386024+0000 mgr.a (mgr.14388) 5895 : audit [DBG] from='client.136167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:48 smithi044 bash[22676]: audit 2024-09-21T00:30:47.386024+0000 mgr.a (mgr.14388) 5895 : audit [DBG] from='client.136167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:48 smithi179 bash[23186]: audit 2024-09-21T00:30:47.386024+0000 mgr.a (mgr.14388) 5895 : audit [DBG] from='client.136167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:49.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:49 smithi049 bash[23528]: cluster 2024-09-21T00:30:48.129314+0000 mgr.a (mgr.14388) 5896 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:49 smithi044 bash[22676]: cluster 2024-09-21T00:30:48.129314+0000 mgr.a (mgr.14388) 5896 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:49 smithi179 bash[23186]: cluster 2024-09-21T00:30:48.129314+0000 mgr.a (mgr.14388) 5896 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:51.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:51 smithi049 bash[23528]: cluster 2024-09-21T00:30:50.131543+0000 mgr.a (mgr.14388) 5897 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:51 smithi044 bash[22676]: cluster 2024-09-21T00:30:50.131543+0000 mgr.a (mgr.14388) 5897 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:51 smithi179 bash[23186]: cluster 2024-09-21T00:30:50.131543+0000 mgr.a (mgr.14388) 5897 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:52.833 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:52.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:52.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:53.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:53 smithi049 bash[23528]: cluster 2024-09-21T00:30:52.132377+0000 mgr.a (mgr.14388) 5898 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:53.588 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:53.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:53.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:53.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:53.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:53 smithi044 bash[22676]: cluster 2024-09-21T00:30:52.132377+0000 mgr.a (mgr.14388) 5898 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:53 smithi179 bash[23186]: cluster 2024-09-21T00:30:52.132377+0000 mgr.a (mgr.14388) 5898 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:54.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:54 smithi049 bash[23528]: audit 2024-09-21T00:30:53.167508+0000 mgr.a (mgr.14388) 5899 : audit [DBG] from='client.136242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:54 smithi044 bash[22676]: audit 2024-09-21T00:30:53.167508+0000 mgr.a (mgr.14388) 5899 : audit [DBG] from='client.136242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:54 smithi179 bash[23186]: audit 2024-09-21T00:30:53.167508+0000 mgr.a (mgr.14388) 5899 : audit [DBG] from='client.136242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:30:55.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:55 smithi049 bash[23528]: cluster 2024-09-21T00:30:54.133361+0000 mgr.a (mgr.14388) 5900 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:55 smithi044 bash[22676]: cluster 2024-09-21T00:30:54.133361+0000 mgr.a (mgr.14388) 5900 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:55 smithi179 bash[23186]: cluster 2024-09-21T00:30:54.133361+0000 mgr.a (mgr.14388) 5900 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:57 smithi179 bash[23186]: cluster 2024-09-21T00:30:56.135616+0000 mgr.a (mgr.14388) 5901 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:57.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:57 smithi049 bash[23528]: cluster 2024-09-21T00:30:56.135616+0000 mgr.a (mgr.14388) 5901 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:57 smithi044 bash[22676]: cluster 2024-09-21T00:30:56.135616+0000 mgr.a (mgr.14388) 5901 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:30:58.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:30:58.591 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:30:58.591 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:30:59.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:30:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:30:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:30:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:30:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:30:59.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:59 smithi179 bash[23186]: cluster 2024-09-21T00:30:58.136404+0000 mgr.a (mgr.14388) 5902 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:59.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:59 smithi179 bash[23186]: audit 2024-09-21T00:30:58.424915+0000 mon.a (mon.0) 5249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:59 smithi179 bash[23186]: audit 2024-09-21T00:30:58.429983+0000 mon.a (mon.0) 5250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:59 smithi179 bash[23186]: audit 2024-09-21T00:30:58.436481+0000 mon.a (mon.0) 5251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:59 smithi179 bash[23186]: audit 2024-09-21T00:30:58.485160+0000 mon.a (mon.0) 5252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:59 smithi179 bash[23186]: audit 2024-09-21T00:30:58.491721+0000 mon.a (mon.0) 5253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:30:59 smithi179 bash[23186]: audit 2024-09-21T00:30:58.501383+0000 mon.a (mon.0) 5254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:59 smithi044 bash[22676]: cluster 2024-09-21T00:30:58.136404+0000 mgr.a (mgr.14388) 5902 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:59.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:59 smithi044 bash[22676]: audit 2024-09-21T00:30:58.424915+0000 mon.a (mon.0) 5249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:59 smithi044 bash[22676]: audit 2024-09-21T00:30:58.429983+0000 mon.a (mon.0) 5250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:59 smithi044 bash[22676]: audit 2024-09-21T00:30:58.436481+0000 mon.a (mon.0) 5251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:59 smithi044 bash[22676]: audit 2024-09-21T00:30:58.485160+0000 mon.a (mon.0) 5252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:59 smithi044 bash[22676]: audit 2024-09-21T00:30:58.491721+0000 mon.a (mon.0) 5253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:30:59 smithi044 bash[22676]: audit 2024-09-21T00:30:58.501383+0000 mon.a (mon.0) 5254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:59 smithi049 bash[23528]: cluster 2024-09-21T00:30:58.136404+0000 mgr.a (mgr.14388) 5902 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:30:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:59 smithi049 bash[23528]: audit 2024-09-21T00:30:58.424915+0000 mon.a (mon.0) 5249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:59 smithi049 bash[23528]: audit 2024-09-21T00:30:58.429983+0000 mon.a (mon.0) 5250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:59 smithi049 bash[23528]: audit 2024-09-21T00:30:58.436481+0000 mon.a (mon.0) 5251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:59 smithi049 bash[23528]: audit 2024-09-21T00:30:58.485160+0000 mon.a (mon.0) 5252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:59 smithi049 bash[23528]: audit 2024-09-21T00:30:58.491721+0000 mon.a (mon.0) 5253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:30:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:30:59 smithi049 bash[23528]: audit 2024-09-21T00:30:58.501383+0000 mon.a (mon.0) 5254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:00 smithi049 bash[23528]: audit 2024-09-21T00:30:58.926718+0000 mgr.a (mgr.14388) 5903 : audit [DBG] from='client.136317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:00.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:00 smithi049 bash[23528]: audit 2024-09-21T00:31:00.405746+0000 mon.a (mon.0) 5255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:00 smithi049 bash[23528]: audit 2024-09-21T00:31:00.411557+0000 mon.a (mon.0) 5256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:00 smithi049 bash[23528]: audit 2024-09-21T00:31:00.419619+0000 mon.a (mon.0) 5257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:00 smithi044 bash[22676]: audit 2024-09-21T00:30:58.926718+0000 mgr.a (mgr.14388) 5903 : audit [DBG] from='client.136317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:00 smithi044 bash[22676]: audit 2024-09-21T00:31:00.405746+0000 mon.a (mon.0) 5255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:00 smithi044 bash[22676]: audit 2024-09-21T00:31:00.411557+0000 mon.a (mon.0) 5256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:00 smithi044 bash[22676]: audit 2024-09-21T00:31:00.419619+0000 mon.a (mon.0) 5257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:00 smithi179 bash[23186]: audit 2024-09-21T00:30:58.926718+0000 mgr.a (mgr.14388) 5903 : audit [DBG] from='client.136317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:00 smithi179 bash[23186]: audit 2024-09-21T00:31:00.405746+0000 mon.a (mon.0) 5255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:00 smithi179 bash[23186]: audit 2024-09-21T00:31:00.411557+0000 mon.a (mon.0) 5256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:00.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:00 smithi179 bash[23186]: audit 2024-09-21T00:31:00.419619+0000 mon.a (mon.0) 5257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:01.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:01 smithi049 bash[23528]: cluster 2024-09-21T00:31:00.138729+0000 mgr.a (mgr.14388) 5904 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:01 smithi044 bash[22676]: cluster 2024-09-21T00:31:00.138729+0000 mgr.a (mgr.14388) 5904 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:01 smithi179 bash[23186]: cluster 2024-09-21T00:31:00.138729+0000 mgr.a (mgr.14388) 5904 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:03 smithi044 bash[22676]: cluster 2024-09-21T00:31:02.139560+0000 mgr.a (mgr.14388) 5905 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:03 smithi179 bash[23186]: cluster 2024-09-21T00:31:02.139560+0000 mgr.a (mgr.14388) 5905 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:03 smithi049 bash[23528]: cluster 2024-09-21T00:31:02.139560+0000 mgr.a (mgr.14388) 5905 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:04.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:04.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22930]: debug 2024-09-21T00:31:04.240+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:31:04.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22930]: debug 2024-09-21T00:31:04.244+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:31:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22676]: audit 2024-09-21T00:31:03.444215+0000 mon.a (mon.0) 5258 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:31:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22676]: audit 2024-09-21T00:31:03.450557+0000 mon.a (mon.0) 5259 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:31:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22676]: audit 2024-09-21T00:31:03.452339+0000 mon.a (mon.0) 5260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:31:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22676]: audit 2024-09-21T00:31:03.462771+0000 mon.a (mon.0) 5261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22676]: audit 2024-09-21T00:31:03.469125+0000 mon.a (mon.0) 5262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:31:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:04 smithi044 bash[22676]: audit 2024-09-21T00:31:03.471471+0000 mgr.a (mgr.14388) 5906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:31:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:04 smithi179 bash[23186]: audit 2024-09-21T00:31:03.444215+0000 mon.a (mon.0) 5258 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:31:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:04 smithi179 bash[23186]: audit 2024-09-21T00:31:03.450557+0000 mon.a (mon.0) 5259 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:31:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:04 smithi179 bash[23186]: audit 2024-09-21T00:31:03.452339+0000 mon.a (mon.0) 5260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:31:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:04 smithi179 bash[23186]: audit 2024-09-21T00:31:03.462771+0000 mon.a (mon.0) 5261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:04 smithi179 bash[23186]: audit 2024-09-21T00:31:03.469125+0000 mon.a (mon.0) 5262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:31:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:04 smithi179 bash[23186]: audit 2024-09-21T00:31:03.471471+0000 mgr.a (mgr.14388) 5906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:31:04.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:04 smithi049 bash[23528]: audit 2024-09-21T00:31:03.444215+0000 mon.a (mon.0) 5258 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:31:04.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:04 smithi049 bash[23528]: audit 2024-09-21T00:31:03.450557+0000 mon.a (mon.0) 5259 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:31:04.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:04 smithi049 bash[23528]: audit 2024-09-21T00:31:03.452339+0000 mon.a (mon.0) 5260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:31:04.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:04 smithi049 bash[23528]: audit 2024-09-21T00:31:03.462771+0000 mon.a (mon.0) 5261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:04 smithi049 bash[23528]: audit 2024-09-21T00:31:03.469125+0000 mon.a (mon.0) 5262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:31:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:04 smithi049 bash[23528]: audit 2024-09-21T00:31:03.471471+0000 mgr.a (mgr.14388) 5906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:31:05.120 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:05.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:05 smithi044 bash[22676]: cluster 2024-09-21T00:31:04.140090+0000 mgr.a (mgr.14388) 5907 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:05 smithi044 bash[22676]: audit 2024-09-21T00:31:04.243267+0000 mgr.a (mgr.14388) 5908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:31:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:05 smithi044 bash[22676]: cephadm 2024-09-21T00:31:04.245338+0000 mgr.a (mgr.14388) 5909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:31:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:05 smithi179 bash[23186]: cluster 2024-09-21T00:31:04.140090+0000 mgr.a (mgr.14388) 5907 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:05 smithi179 bash[23186]: audit 2024-09-21T00:31:04.243267+0000 mgr.a (mgr.14388) 5908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:31:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:05 smithi179 bash[23186]: cephadm 2024-09-21T00:31:04.245338+0000 mgr.a (mgr.14388) 5909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:31:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:05 smithi049 bash[23528]: cluster 2024-09-21T00:31:04.140090+0000 mgr.a (mgr.14388) 5907 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:05 smithi049 bash[23528]: audit 2024-09-21T00:31:04.243267+0000 mgr.a (mgr.14388) 5908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:31:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:05 smithi049 bash[23528]: cephadm 2024-09-21T00:31:04.245338+0000 mgr.a (mgr.14388) 5909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:31:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:06 smithi044 bash[22676]: audit 2024-09-21T00:31:04.681988+0000 mgr.a (mgr.14388) 5910 : audit [DBG] from='client.136500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:06 smithi179 bash[23186]: audit 2024-09-21T00:31:04.681988+0000 mgr.a (mgr.14388) 5910 : audit [DBG] from='client.136500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:06.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:06 smithi049 bash[23528]: audit 2024-09-21T00:31:04.681988+0000 mgr.a (mgr.14388) 5910 : audit [DBG] from='client.136500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:07 smithi044 bash[22676]: cluster 2024-09-21T00:31:06.142859+0000 mgr.a (mgr.14388) 5911 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:07 smithi179 bash[23186]: cluster 2024-09-21T00:31:06.142859+0000 mgr.a (mgr.14388) 5911 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:07 smithi049 bash[23528]: cluster 2024-09-21T00:31:06.142859+0000 mgr.a (mgr.14388) 5911 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:09 smithi044 bash[22676]: cluster 2024-09-21T00:31:08.143694+0000 mgr.a (mgr.14388) 5912 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:09 smithi179 bash[23186]: cluster 2024-09-21T00:31:08.143694+0000 mgr.a (mgr.14388) 5912 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:09 smithi049 bash[23528]: cluster 2024-09-21T00:31:08.143694+0000 mgr.a (mgr.14388) 5912 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:10.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:10.907 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:10.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:10.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:10.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:10.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:11 smithi044 bash[22676]: cluster 2024-09-21T00:31:10.145311+0000 mgr.a (mgr.14388) 5913 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:11 smithi044 bash[22676]: audit 2024-09-21T00:31:10.467318+0000 mgr.a (mgr.14388) 5914 : audit [DBG] from='client.136578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:11 smithi179 bash[23186]: cluster 2024-09-21T00:31:10.145311+0000 mgr.a (mgr.14388) 5913 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:11 smithi179 bash[23186]: audit 2024-09-21T00:31:10.467318+0000 mgr.a (mgr.14388) 5914 : audit [DBG] from='client.136578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:11 smithi049 bash[23528]: cluster 2024-09-21T00:31:10.145311+0000 mgr.a (mgr.14388) 5913 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:11 smithi049 bash[23528]: audit 2024-09-21T00:31:10.467318+0000 mgr.a (mgr.14388) 5914 : audit [DBG] from='client.136578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:13 smithi044 bash[22676]: cluster 2024-09-21T00:31:12.146423+0000 mgr.a (mgr.14388) 5915 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:13 smithi179 bash[23186]: cluster 2024-09-21T00:31:12.146423+0000 mgr.a (mgr.14388) 5915 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:13 smithi049 bash[23528]: cluster 2024-09-21T00:31:12.146423+0000 mgr.a (mgr.14388) 5915 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:15 smithi179 bash[23186]: cluster 2024-09-21T00:31:14.147462+0000 mgr.a (mgr.14388) 5916 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:15.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:15 smithi049 bash[23528]: cluster 2024-09-21T00:31:14.147462+0000 mgr.a (mgr.14388) 5916 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:15.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:15.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:15.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:15 smithi044 bash[22676]: cluster 2024-09-21T00:31:14.147462+0000 mgr.a (mgr.14388) 5916 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:31:16.686 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:16.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:16.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:16.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:16.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:17.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:17 smithi049 bash[23528]: cluster 2024-09-21T00:31:16.149703+0000 mgr.a (mgr.14388) 5917 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:17.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:17 smithi049 bash[23528]: audit 2024-09-21T00:31:16.245626+0000 mgr.a (mgr.14388) 5918 : audit [DBG] from='client.136653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:17.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:17 smithi179 bash[23186]: cluster 2024-09-21T00:31:16.149703+0000 mgr.a (mgr.14388) 5917 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:17.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:17 smithi179 bash[23186]: audit 2024-09-21T00:31:16.245626+0000 mgr.a (mgr.14388) 5918 : audit [DBG] from='client.136653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:17 smithi044 bash[22676]: cluster 2024-09-21T00:31:16.149703+0000 mgr.a (mgr.14388) 5917 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:31:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:17 smithi044 bash[22676]: audit 2024-09-21T00:31:16.245626+0000 mgr.a (mgr.14388) 5918 : audit [DBG] from='client.136653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:19.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:19 smithi044 bash[22676]: cluster 2024-09-21T00:31:18.150640+0000 mgr.a (mgr.14388) 5919 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:19.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:19 smithi044 bash[22676]: audit 2024-09-21T00:31:18.648723+0000 mon.a (mon.0) 5263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:19 smithi044 bash[22676]: audit 2024-09-21T00:31:18.657153+0000 mon.a (mon.0) 5264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:19 smithi044 bash[22676]: audit 2024-09-21T00:31:18.667610+0000 mon.a (mon.0) 5265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:19 smithi044 bash[22676]: audit 2024-09-21T00:31:18.718820+0000 mon.a (mon.0) 5266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:19 smithi044 bash[22676]: audit 2024-09-21T00:31:18.727311+0000 mon.a (mon.0) 5267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:19 smithi044 bash[22676]: audit 2024-09-21T00:31:18.737364+0000 mon.a (mon.0) 5268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:19 smithi179 bash[23186]: cluster 2024-09-21T00:31:18.150640+0000 mgr.a (mgr.14388) 5919 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:19.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:19 smithi179 bash[23186]: audit 2024-09-21T00:31:18.648723+0000 mon.a (mon.0) 5263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:19 smithi179 bash[23186]: audit 2024-09-21T00:31:18.657153+0000 mon.a (mon.0) 5264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:19 smithi179 bash[23186]: audit 2024-09-21T00:31:18.667610+0000 mon.a (mon.0) 5265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:19 smithi179 bash[23186]: audit 2024-09-21T00:31:18.718820+0000 mon.a (mon.0) 5266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:19 smithi179 bash[23186]: audit 2024-09-21T00:31:18.727311+0000 mon.a (mon.0) 5267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:19.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:19 smithi179 bash[23186]: audit 2024-09-21T00:31:18.737364+0000 mon.a (mon.0) 5268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:19 smithi049 bash[23528]: cluster 2024-09-21T00:31:18.150640+0000 mgr.a (mgr.14388) 5919 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:20.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:19 smithi049 bash[23528]: audit 2024-09-21T00:31:18.648723+0000 mon.a (mon.0) 5263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:20.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:19 smithi049 bash[23528]: audit 2024-09-21T00:31:18.657153+0000 mon.a (mon.0) 5264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:20.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:19 smithi049 bash[23528]: audit 2024-09-21T00:31:18.667610+0000 mon.a (mon.0) 5265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:20.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:19 smithi049 bash[23528]: audit 2024-09-21T00:31:18.718820+0000 mon.a (mon.0) 5266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:20.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:19 smithi049 bash[23528]: audit 2024-09-21T00:31:18.727311+0000 mon.a (mon.0) 5267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:19 smithi049 bash[23528]: audit 2024-09-21T00:31:18.737364+0000 mon.a (mon.0) 5268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:21.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:21.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:21.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:21 smithi049 bash[23528]: cluster 2024-09-21T00:31:20.152731+0000 mgr.a (mgr.14388) 5920 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:21 smithi049 bash[23528]: audit 2024-09-21T00:31:20.619199+0000 mon.a (mon.0) 5269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:21 smithi049 bash[23528]: audit 2024-09-21T00:31:20.628085+0000 mon.a (mon.0) 5270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:21 smithi049 bash[23528]: audit 2024-09-21T00:31:20.639788+0000 mon.a (mon.0) 5271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:21.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:21 smithi044 bash[22676]: cluster 2024-09-21T00:31:20.152731+0000 mgr.a (mgr.14388) 5920 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:21.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:21 smithi044 bash[22676]: audit 2024-09-21T00:31:20.619199+0000 mon.a (mon.0) 5269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:21.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:21 smithi044 bash[22676]: audit 2024-09-21T00:31:20.628085+0000 mon.a (mon.0) 5270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:21.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:21 smithi044 bash[22676]: audit 2024-09-21T00:31:20.639788+0000 mon.a (mon.0) 5271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:21 smithi179 bash[23186]: cluster 2024-09-21T00:31:20.152731+0000 mgr.a (mgr.14388) 5920 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:21 smithi179 bash[23186]: audit 2024-09-21T00:31:20.619199+0000 mon.a (mon.0) 5269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:21 smithi179 bash[23186]: audit 2024-09-21T00:31:20.628085+0000 mon.a (mon.0) 5270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:21 smithi179 bash[23186]: audit 2024-09-21T00:31:20.639788+0000 mon.a (mon.0) 5271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:22.459 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:22.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:22.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:22.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:22.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:23 smithi044 bash[22676]: audit 2024-09-21T00:31:22.021471+0000 mgr.a (mgr.14388) 5921 : audit [DBG] from='client.136731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:23 smithi044 bash[22676]: cluster 2024-09-21T00:31:22.159620+0000 mgr.a (mgr.14388) 5922 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:23 smithi179 bash[23186]: audit 2024-09-21T00:31:22.021471+0000 mgr.a (mgr.14388) 5921 : audit [DBG] from='client.136731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:23 smithi179 bash[23186]: cluster 2024-09-21T00:31:22.159620+0000 mgr.a (mgr.14388) 5922 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:23 smithi049 bash[23528]: audit 2024-09-21T00:31:22.021471+0000 mgr.a (mgr.14388) 5921 : audit [DBG] from='client.136731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:23 smithi049 bash[23528]: cluster 2024-09-21T00:31:22.159620+0000 mgr.a (mgr.14388) 5922 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:25 smithi044 bash[22676]: cluster 2024-09-21T00:31:24.160547+0000 mgr.a (mgr.14388) 5923 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:25 smithi179 bash[23186]: cluster 2024-09-21T00:31:24.160547+0000 mgr.a (mgr.14388) 5923 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:25 smithi049 bash[23528]: cluster 2024-09-21T00:31:24.160547+0000 mgr.a (mgr.14388) 5923 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:27.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:27.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:27.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:27 smithi044 bash[22676]: cluster 2024-09-21T00:31:26.162894+0000 mgr.a (mgr.14388) 5924 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:27 smithi179 bash[23186]: cluster 2024-09-21T00:31:26.162894+0000 mgr.a (mgr.14388) 5924 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:27 smithi049 bash[23528]: cluster 2024-09-21T00:31:26.162894+0000 mgr.a (mgr.14388) 5924 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:28.252 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:29 smithi044 bash[22676]: audit 2024-09-21T00:31:27.801373+0000 mgr.a (mgr.14388) 5925 : audit [DBG] from='client.136809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:29 smithi044 bash[22676]: cluster 2024-09-21T00:31:28.163605+0000 mgr.a (mgr.14388) 5926 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:29 smithi179 bash[23186]: audit 2024-09-21T00:31:27.801373+0000 mgr.a (mgr.14388) 5925 : audit [DBG] from='client.136809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:29 smithi179 bash[23186]: cluster 2024-09-21T00:31:28.163605+0000 mgr.a (mgr.14388) 5926 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:30.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:29 smithi049 bash[23528]: audit 2024-09-21T00:31:27.801373+0000 mgr.a (mgr.14388) 5925 : audit [DBG] from='client.136809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:30.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:29 smithi049 bash[23528]: cluster 2024-09-21T00:31:28.163605+0000 mgr.a (mgr.14388) 5926 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:31 smithi044 bash[22676]: cluster 2024-09-21T00:31:30.165719+0000 mgr.a (mgr.14388) 5927 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:31 smithi179 bash[23186]: cluster 2024-09-21T00:31:30.165719+0000 mgr.a (mgr.14388) 5927 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:31 smithi049 bash[23528]: cluster 2024-09-21T00:31:30.165719+0000 mgr.a (mgr.14388) 5927 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:33.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:33.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:33.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:33 smithi044 bash[22676]: cluster 2024-09-21T00:31:32.166525+0000 mgr.a (mgr.14388) 5928 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:33 smithi179 bash[23186]: cluster 2024-09-21T00:31:32.166525+0000 mgr.a (mgr.14388) 5928 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:34.017 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:34.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:34.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:34.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:34.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:34.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:33 smithi049 bash[23528]: cluster 2024-09-21T00:31:32.166525+0000 mgr.a (mgr.14388) 5928 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:34 smithi044 bash[22676]: audit 2024-09-21T00:31:33.586838+0000 mgr.a (mgr.14388) 5929 : audit [DBG] from='client.136884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:34 smithi179 bash[23186]: audit 2024-09-21T00:31:33.586838+0000 mgr.a (mgr.14388) 5929 : audit [DBG] from='client.136884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:35.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:34 smithi049 bash[23528]: audit 2024-09-21T00:31:33.586838+0000 mgr.a (mgr.14388) 5929 : audit [DBG] from='client.136884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:35 smithi044 bash[22676]: cluster 2024-09-21T00:31:34.167520+0000 mgr.a (mgr.14388) 5930 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:35 smithi179 bash[23186]: cluster 2024-09-21T00:31:34.167520+0000 mgr.a (mgr.14388) 5930 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:35 smithi049 bash[23528]: cluster 2024-09-21T00:31:34.167520+0000 mgr.a (mgr.14388) 5930 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:37 smithi044 bash[22676]: cluster 2024-09-21T00:31:36.169850+0000 mgr.a (mgr.14388) 5931 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:37 smithi179 bash[23186]: cluster 2024-09-21T00:31:36.169850+0000 mgr.a (mgr.14388) 5931 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:37 smithi049 bash[23528]: cluster 2024-09-21T00:31:36.169850+0000 mgr.a (mgr.14388) 5931 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:39.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:39.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:39.812 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:39.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:39.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:39.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:39.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:39 smithi044 bash[22676]: cluster 2024-09-21T00:31:38.170600+0000 mgr.a (mgr.14388) 5932 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:39 smithi044 bash[22676]: audit 2024-09-21T00:31:38.861348+0000 mon.a (mon.0) 5272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:39 smithi044 bash[22676]: audit 2024-09-21T00:31:38.870096+0000 mon.a (mon.0) 5273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:39 smithi044 bash[22676]: audit 2024-09-21T00:31:38.880647+0000 mon.a (mon.0) 5274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:39 smithi044 bash[22676]: audit 2024-09-21T00:31:38.949744+0000 mon.a (mon.0) 5275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:39 smithi044 bash[22676]: audit 2024-09-21T00:31:38.958522+0000 mon.a (mon.0) 5276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:39 smithi044 bash[22676]: audit 2024-09-21T00:31:38.968646+0000 mon.a (mon.0) 5277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:39 smithi179 bash[23186]: cluster 2024-09-21T00:31:38.170600+0000 mgr.a (mgr.14388) 5932 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:39 smithi179 bash[23186]: audit 2024-09-21T00:31:38.861348+0000 mon.a (mon.0) 5272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:39 smithi179 bash[23186]: audit 2024-09-21T00:31:38.870096+0000 mon.a (mon.0) 5273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:39 smithi179 bash[23186]: audit 2024-09-21T00:31:38.880647+0000 mon.a (mon.0) 5274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:39 smithi179 bash[23186]: audit 2024-09-21T00:31:38.949744+0000 mon.a (mon.0) 5275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:39 smithi179 bash[23186]: audit 2024-09-21T00:31:38.958522+0000 mon.a (mon.0) 5276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:39 smithi179 bash[23186]: audit 2024-09-21T00:31:38.968646+0000 mon.a (mon.0) 5277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:39 smithi049 bash[23528]: cluster 2024-09-21T00:31:38.170600+0000 mgr.a (mgr.14388) 5932 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:39 smithi049 bash[23528]: audit 2024-09-21T00:31:38.861348+0000 mon.a (mon.0) 5272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:39 smithi049 bash[23528]: audit 2024-09-21T00:31:38.870096+0000 mon.a (mon.0) 5273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:39 smithi049 bash[23528]: audit 2024-09-21T00:31:38.880647+0000 mon.a (mon.0) 5274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:39 smithi049 bash[23528]: audit 2024-09-21T00:31:38.949744+0000 mon.a (mon.0) 5275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:39 smithi049 bash[23528]: audit 2024-09-21T00:31:38.958522+0000 mon.a (mon.0) 5276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:39 smithi049 bash[23528]: audit 2024-09-21T00:31:38.968646+0000 mon.a (mon.0) 5277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:40 smithi044 bash[22676]: audit 2024-09-21T00:31:39.357496+0000 mgr.a (mgr.14388) 5933 : audit [DBG] from='client.136962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:40 smithi179 bash[23186]: audit 2024-09-21T00:31:39.357496+0000 mgr.a (mgr.14388) 5933 : audit [DBG] from='client.136962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:40 smithi049 bash[23528]: audit 2024-09-21T00:31:39.357496+0000 mgr.a (mgr.14388) 5933 : audit [DBG] from='client.136962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:41.936 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:41 smithi044 bash[22676]: cluster 2024-09-21T00:31:40.172599+0000 mgr.a (mgr.14388) 5934 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:41.936 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:41 smithi044 bash[22676]: audit 2024-09-21T00:31:40.799533+0000 mon.a (mon.0) 5278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:41.936 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:41 smithi044 bash[22676]: audit 2024-09-21T00:31:40.807227+0000 mon.a (mon.0) 5279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:41.936 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:41 smithi044 bash[22676]: audit 2024-09-21T00:31:40.816557+0000 mon.a (mon.0) 5280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:41.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:41 smithi049 bash[23528]: cluster 2024-09-21T00:31:40.172599+0000 mgr.a (mgr.14388) 5934 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:41.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:41 smithi049 bash[23528]: audit 2024-09-21T00:31:40.799533+0000 mon.a (mon.0) 5278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:41.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:41 smithi049 bash[23528]: audit 2024-09-21T00:31:40.807227+0000 mon.a (mon.0) 5279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:41.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:41 smithi049 bash[23528]: audit 2024-09-21T00:31:40.816557+0000 mon.a (mon.0) 5280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:41 smithi179 bash[23186]: cluster 2024-09-21T00:31:40.172599+0000 mgr.a (mgr.14388) 5934 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:31:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:41 smithi179 bash[23186]: audit 2024-09-21T00:31:40.799533+0000 mon.a (mon.0) 5278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:41 smithi179 bash[23186]: audit 2024-09-21T00:31:40.807227+0000 mon.a (mon.0) 5279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:41 smithi179 bash[23186]: audit 2024-09-21T00:31:40.816557+0000 mon.a (mon.0) 5280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:43 smithi044 bash[22676]: cluster 2024-09-21T00:31:42.173443+0000 mgr.a (mgr.14388) 5935 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:43 smithi179 bash[23186]: cluster 2024-09-21T00:31:42.173443+0000 mgr.a (mgr.14388) 5935 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:43 smithi049 bash[23528]: cluster 2024-09-21T00:31:42.173443+0000 mgr.a (mgr.14388) 5935 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:45.608 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:45.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:45.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:45.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:45.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:45 smithi044 bash[22676]: cluster 2024-09-21T00:31:44.174229+0000 mgr.a (mgr.14388) 5936 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:45 smithi179 bash[23186]: cluster 2024-09-21T00:31:44.174229+0000 mgr.a (mgr.14388) 5936 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:45 smithi049 bash[23528]: cluster 2024-09-21T00:31:44.174229+0000 mgr.a (mgr.14388) 5936 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:46 smithi044 bash[22676]: audit 2024-09-21T00:31:45.156141+0000 mgr.a (mgr.14388) 5937 : audit [DBG] from='client.137040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:46 smithi179 bash[23186]: audit 2024-09-21T00:31:45.156141+0000 mgr.a (mgr.14388) 5937 : audit [DBG] from='client.137040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:47.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:46 smithi049 bash[23528]: audit 2024-09-21T00:31:45.156141+0000 mgr.a (mgr.14388) 5937 : audit [DBG] from='client.137040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:47 smithi044 bash[22676]: cluster 2024-09-21T00:31:46.177086+0000 mgr.a (mgr.14388) 5938 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:47 smithi179 bash[23186]: cluster 2024-09-21T00:31:46.177086+0000 mgr.a (mgr.14388) 5938 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:47 smithi049 bash[23528]: cluster 2024-09-21T00:31:46.177086+0000 mgr.a (mgr.14388) 5938 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:48 smithi044 bash[22676]: cluster 2024-09-21T00:31:48.177859+0000 mgr.a (mgr.14388) 5939 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:31:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:48 smithi179 bash[23186]: cluster 2024-09-21T00:31:48.177859+0000 mgr.a (mgr.14388) 5939 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:31:49.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:48 smithi049 bash[23528]: cluster 2024-09-21T00:31:48.177859+0000 mgr.a (mgr.14388) 5939 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:31:50.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:50.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:50.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:51.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:51.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:51.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:51.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:51.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:51 smithi044 bash[22676]: cluster 2024-09-21T00:31:50.179803+0000 mgr.a (mgr.14388) 5940 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:51 smithi179 bash[23186]: cluster 2024-09-21T00:31:50.179803+0000 mgr.a (mgr.14388) 5940 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:51.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:51 smithi049 bash[23528]: cluster 2024-09-21T00:31:50.179803+0000 mgr.a (mgr.14388) 5940 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:52.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:52 smithi179 bash[23186]: audit 2024-09-21T00:31:50.938520+0000 mgr.a (mgr.14388) 5941 : audit [DBG] from='client.137115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:52.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:52 smithi049 bash[23528]: audit 2024-09-21T00:31:50.938520+0000 mgr.a (mgr.14388) 5941 : audit [DBG] from='client.137115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:52 smithi044 bash[22676]: audit 2024-09-21T00:31:50.938520+0000 mgr.a (mgr.14388) 5941 : audit [DBG] from='client.137115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:53 smithi179 bash[23186]: cluster 2024-09-21T00:31:52.180496+0000 mgr.a (mgr.14388) 5942 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:31:53.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:53 smithi049 bash[23528]: cluster 2024-09-21T00:31:52.180496+0000 mgr.a (mgr.14388) 5942 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:31:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:53 smithi044 bash[22676]: cluster 2024-09-21T00:31:52.180496+0000 mgr.a (mgr.14388) 5942 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:31:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:55 smithi179 bash[23186]: cluster 2024-09-21T00:31:54.181065+0000 mgr.a (mgr.14388) 5943 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:31:55.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:55 smithi049 bash[23528]: cluster 2024-09-21T00:31:54.181065+0000 mgr.a (mgr.14388) 5943 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:31:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:55 smithi044 bash[22676]: cluster 2024-09-21T00:31:54.181065+0000 mgr.a (mgr.14388) 5943 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:31:56.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:31:56.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:31:56.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:31:57.166 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:31:57.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:31:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:31:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:31:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:31:57.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:57 smithi049 bash[23528]: cluster 2024-09-21T00:31:56.183272+0000 mgr.a (mgr.14388) 5944 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:57.565 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:57 smithi179 bash[23186]: cluster 2024-09-21T00:31:56.183272+0000 mgr.a (mgr.14388) 5944 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:57 smithi044 bash[22676]: cluster 2024-09-21T00:31:56.183272+0000 mgr.a (mgr.14388) 5944 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:58 smithi179 bash[23186]: audit 2024-09-21T00:31:56.715439+0000 mgr.a (mgr.14388) 5945 : audit [DBG] from='client.137193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:58.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:58 smithi049 bash[23528]: audit 2024-09-21T00:31:56.715439+0000 mgr.a (mgr.14388) 5945 : audit [DBG] from='client.137193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:58.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:58 smithi044 bash[22676]: audit 2024-09-21T00:31:56.715439+0000 mgr.a (mgr.14388) 5945 : audit [DBG] from='client.137193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:31:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:59 smithi179 bash[23186]: cluster 2024-09-21T00:31:58.184140+0000 mgr.a (mgr.14388) 5946 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:59 smithi179 bash[23186]: audit 2024-09-21T00:31:59.033806+0000 mon.a (mon.0) 5281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:59 smithi179 bash[23186]: audit 2024-09-21T00:31:59.042115+0000 mon.a (mon.0) 5282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:59 smithi179 bash[23186]: audit 2024-09-21T00:31:59.052898+0000 mon.a (mon.0) 5283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:59 smithi179 bash[23186]: audit 2024-09-21T00:31:59.181385+0000 mon.a (mon.0) 5284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:59 smithi179 bash[23186]: audit 2024-09-21T00:31:59.189697+0000 mon.a (mon.0) 5285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:31:59 smithi179 bash[23186]: audit 2024-09-21T00:31:59.199861+0000 mon.a (mon.0) 5286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:59 smithi049 bash[23528]: cluster 2024-09-21T00:31:58.184140+0000 mgr.a (mgr.14388) 5946 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:59.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:59 smithi049 bash[23528]: audit 2024-09-21T00:31:59.033806+0000 mon.a (mon.0) 5281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:59 smithi049 bash[23528]: audit 2024-09-21T00:31:59.042115+0000 mon.a (mon.0) 5282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:59 smithi049 bash[23528]: audit 2024-09-21T00:31:59.052898+0000 mon.a (mon.0) 5283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:59 smithi049 bash[23528]: audit 2024-09-21T00:31:59.181385+0000 mon.a (mon.0) 5284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:59 smithi049 bash[23528]: audit 2024-09-21T00:31:59.189697+0000 mon.a (mon.0) 5285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:31:59 smithi049 bash[23528]: audit 2024-09-21T00:31:59.199861+0000 mon.a (mon.0) 5286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:59 smithi044 bash[22676]: cluster 2024-09-21T00:31:58.184140+0000 mgr.a (mgr.14388) 5946 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:31:59.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:59 smithi044 bash[22676]: audit 2024-09-21T00:31:59.033806+0000 mon.a (mon.0) 5281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:59 smithi044 bash[22676]: audit 2024-09-21T00:31:59.042115+0000 mon.a (mon.0) 5282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:59 smithi044 bash[22676]: audit 2024-09-21T00:31:59.052898+0000 mon.a (mon.0) 5283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:59 smithi044 bash[22676]: audit 2024-09-21T00:31:59.181385+0000 mon.a (mon.0) 5284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:59 smithi044 bash[22676]: audit 2024-09-21T00:31:59.189697+0000 mon.a (mon.0) 5285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:31:59.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:31:59 smithi044 bash[22676]: audit 2024-09-21T00:31:59.199861+0000 mon.a (mon.0) 5286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:01 smithi044 bash[22676]: cluster 2024-09-21T00:32:00.186306+0000 mgr.a (mgr.14388) 5947 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:01 smithi044 bash[22676]: audit 2024-09-21T00:32:01.022212+0000 mon.a (mon.0) 5287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:01 smithi044 bash[22676]: audit 2024-09-21T00:32:01.030272+0000 mon.a (mon.0) 5288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:01 smithi044 bash[22676]: audit 2024-09-21T00:32:01.039743+0000 mon.a (mon.0) 5289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:01 smithi049 bash[23528]: cluster 2024-09-21T00:32:00.186306+0000 mgr.a (mgr.14388) 5947 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:01.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:01 smithi049 bash[23528]: audit 2024-09-21T00:32:01.022212+0000 mon.a (mon.0) 5287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:01 smithi049 bash[23528]: audit 2024-09-21T00:32:01.030272+0000 mon.a (mon.0) 5288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:01 smithi049 bash[23528]: audit 2024-09-21T00:32:01.039743+0000 mon.a (mon.0) 5289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:01 smithi179 bash[23186]: cluster 2024-09-21T00:32:00.186306+0000 mgr.a (mgr.14388) 5947 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:01 smithi179 bash[23186]: audit 2024-09-21T00:32:01.022212+0000 mon.a (mon.0) 5287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:01 smithi179 bash[23186]: audit 2024-09-21T00:32:01.030272+0000 mon.a (mon.0) 5288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:01 smithi179 bash[23186]: audit 2024-09-21T00:32:01.039743+0000 mon.a (mon.0) 5289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:02.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:02.168 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:02.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:02.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:02.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:02.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:02.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:02.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:03 smithi049 bash[23528]: cluster 2024-09-21T00:32:02.187094+0000 mgr.a (mgr.14388) 5948 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:03 smithi049 bash[23528]: audit 2024-09-21T00:32:02.508204+0000 mgr.a (mgr.14388) 5949 : audit [DBG] from='client.137268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:03 smithi044 bash[22676]: cluster 2024-09-21T00:32:02.187094+0000 mgr.a (mgr.14388) 5948 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:03 smithi044 bash[22676]: audit 2024-09-21T00:32:02.508204+0000 mgr.a (mgr.14388) 5949 : audit [DBG] from='client.137268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:03 smithi179 bash[23186]: cluster 2024-09-21T00:32:02.187094+0000 mgr.a (mgr.14388) 5948 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:03 smithi179 bash[23186]: audit 2024-09-21T00:32:02.508204+0000 mgr.a (mgr.14388) 5949 : audit [DBG] from='client.137268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: cluster 2024-09-21T00:32:04.188002+0000 mgr.a (mgr.14388) 5950 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.321616+0000 mon.a (mon.0) 5290 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:32:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.928386+0000 mon.a (mon.0) 5291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.933882+0000 mon.a (mon.0) 5292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.938949+0000 mon.a (mon.0) 5293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.943899+0000 mon.a (mon.0) 5294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.945095+0000 mon.a (mon.0) 5295 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:32:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.945823+0000 mon.a (mon.0) 5296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:32:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.952808+0000 mon.a (mon.0) 5297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:05 smithi049 bash[23528]: audit 2024-09-21T00:32:04.956254+0000 mon.a (mon.0) 5298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: cluster 2024-09-21T00:32:04.188002+0000 mgr.a (mgr.14388) 5950 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.321616+0000 mon.a (mon.0) 5290 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.928386+0000 mon.a (mon.0) 5291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.933882+0000 mon.a (mon.0) 5292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.938949+0000 mon.a (mon.0) 5293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.943899+0000 mon.a (mon.0) 5294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.945095+0000 mon.a (mon.0) 5295 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:32:05.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.945823+0000 mon.a (mon.0) 5296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:32:05.683 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.952808+0000 mon.a (mon.0) 5297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.683 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22676]: audit 2024-09-21T00:32:04.956254+0000 mon.a (mon.0) 5298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: cluster 2024-09-21T00:32:04.188002+0000 mgr.a (mgr.14388) 5950 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.321616+0000 mon.a (mon.0) 5290 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.928386+0000 mon.a (mon.0) 5291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.933882+0000 mon.a (mon.0) 5292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.938949+0000 mon.a (mon.0) 5293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.943899+0000 mon.a (mon.0) 5294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.945095+0000 mon.a (mon.0) 5295 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.945823+0000 mon.a (mon.0) 5296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.952808+0000 mon.a (mon.0) 5297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:05 smithi179 bash[23186]: audit 2024-09-21T00:32:04.956254+0000 mon.a (mon.0) 5298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:32:05.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22930]: debug 2024-09-21T00:32:05.679+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:32:05.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:32:05 smithi044 bash[22930]: debug 2024-09-21T00:32:05.679+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:32:06.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:06 smithi049 bash[23528]: audit 2024-09-21T00:32:04.957299+0000 mgr.a (mgr.14388) 5951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:32:06.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:06 smithi049 bash[23528]: audit 2024-09-21T00:32:05.682027+0000 mgr.a (mgr.14388) 5952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:32:06.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:06 smithi049 bash[23528]: cephadm 2024-09-21T00:32:05.683468+0000 mgr.a (mgr.14388) 5953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:32:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:06 smithi044 bash[22676]: audit 2024-09-21T00:32:04.957299+0000 mgr.a (mgr.14388) 5951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:32:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:06 smithi044 bash[22676]: audit 2024-09-21T00:32:05.682027+0000 mgr.a (mgr.14388) 5952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:32:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:06 smithi044 bash[22676]: cephadm 2024-09-21T00:32:05.683468+0000 mgr.a (mgr.14388) 5953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:32:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:06 smithi179 bash[23186]: audit 2024-09-21T00:32:04.957299+0000 mgr.a (mgr.14388) 5951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:32:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:06 smithi179 bash[23186]: audit 2024-09-21T00:32:05.682027+0000 mgr.a (mgr.14388) 5952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:32:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:06 smithi179 bash[23186]: cephadm 2024-09-21T00:32:05.683468+0000 mgr.a (mgr.14388) 5953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:32:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:07 smithi049 bash[23528]: cluster 2024-09-21T00:32:06.190890+0000 mgr.a (mgr.14388) 5954 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:07 smithi044 bash[22676]: cluster 2024-09-21T00:32:06.190890+0000 mgr.a (mgr.14388) 5954 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:07 smithi179 bash[23186]: cluster 2024-09-21T00:32:06.190890+0000 mgr.a (mgr.14388) 5954 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:08.743 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:08.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:08.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:08.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:08.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:09 smithi044 bash[22676]: cluster 2024-09-21T00:32:08.191476+0000 mgr.a (mgr.14388) 5955 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:09 smithi044 bash[22676]: audit 2024-09-21T00:32:08.289751+0000 mgr.a (mgr.14388) 5956 : audit [DBG] from='client.137454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:09 smithi179 bash[23186]: cluster 2024-09-21T00:32:08.191476+0000 mgr.a (mgr.14388) 5955 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:09 smithi179 bash[23186]: audit 2024-09-21T00:32:08.289751+0000 mgr.a (mgr.14388) 5956 : audit [DBG] from='client.137454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:09 smithi049 bash[23528]: cluster 2024-09-21T00:32:08.191476+0000 mgr.a (mgr.14388) 5955 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:09 smithi049 bash[23528]: audit 2024-09-21T00:32:08.289751+0000 mgr.a (mgr.14388) 5956 : audit [DBG] from='client.137454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:11 smithi044 bash[22676]: cluster 2024-09-21T00:32:10.193751+0000 mgr.a (mgr.14388) 5957 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:11 smithi179 bash[23186]: cluster 2024-09-21T00:32:10.193751+0000 mgr.a (mgr.14388) 5957 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:11 smithi049 bash[23528]: cluster 2024-09-21T00:32:10.193751+0000 mgr.a (mgr.14388) 5957 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:13 smithi044 bash[22676]: cluster 2024-09-21T00:32:12.194579+0000 mgr.a (mgr.14388) 5958 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:13.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:13.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:13.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:13 smithi179 bash[23186]: cluster 2024-09-21T00:32:12.194579+0000 mgr.a (mgr.14388) 5958 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:13 smithi049 bash[23528]: cluster 2024-09-21T00:32:12.194579+0000 mgr.a (mgr.14388) 5958 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:14.531 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:14.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:14.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:15 smithi044 bash[22676]: audit 2024-09-21T00:32:14.080507+0000 mgr.a (mgr.14388) 5959 : audit [DBG] from='client.137532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:15 smithi044 bash[22676]: cluster 2024-09-21T00:32:14.195124+0000 mgr.a (mgr.14388) 5960 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:15 smithi179 bash[23186]: audit 2024-09-21T00:32:14.080507+0000 mgr.a (mgr.14388) 5959 : audit [DBG] from='client.137532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:15 smithi179 bash[23186]: cluster 2024-09-21T00:32:14.195124+0000 mgr.a (mgr.14388) 5960 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:15.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:15 smithi049 bash[23528]: audit 2024-09-21T00:32:14.080507+0000 mgr.a (mgr.14388) 5959 : audit [DBG] from='client.137532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:15.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:15 smithi049 bash[23528]: cluster 2024-09-21T00:32:14.195124+0000 mgr.a (mgr.14388) 5960 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:17.580 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:17 smithi179 bash[23186]: cluster 2024-09-21T00:32:16.197476+0000 mgr.a (mgr.14388) 5961 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:17 smithi044 bash[22676]: cluster 2024-09-21T00:32:16.197476+0000 mgr.a (mgr.14388) 5961 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:17.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:17 smithi049 bash[23528]: cluster 2024-09-21T00:32:16.197476+0000 mgr.a (mgr.14388) 5961 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:19.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:19 smithi049 bash[23528]: cluster 2024-09-21T00:32:18.198237+0000 mgr.a (mgr.14388) 5962 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:19.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:19 smithi049 bash[23528]: audit 2024-09-21T00:32:19.211335+0000 mon.a (mon.0) 5299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:19 smithi049 bash[23528]: audit 2024-09-21T00:32:19.220985+0000 mon.a (mon.0) 5300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:19 smithi049 bash[23528]: audit 2024-09-21T00:32:19.232738+0000 mon.a (mon.0) 5301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:19 smithi179 bash[23186]: cluster 2024-09-21T00:32:18.198237+0000 mgr.a (mgr.14388) 5962 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:19 smithi179 bash[23186]: audit 2024-09-21T00:32:19.211335+0000 mon.a (mon.0) 5299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:19 smithi179 bash[23186]: audit 2024-09-21T00:32:19.220985+0000 mon.a (mon.0) 5300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:19 smithi179 bash[23186]: audit 2024-09-21T00:32:19.232738+0000 mon.a (mon.0) 5301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:19.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:19.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:19.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:19 smithi044 bash[22676]: cluster 2024-09-21T00:32:18.198237+0000 mgr.a (mgr.14388) 5962 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:19.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:19 smithi044 bash[22676]: audit 2024-09-21T00:32:19.211335+0000 mon.a (mon.0) 5299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:19 smithi044 bash[22676]: audit 2024-09-21T00:32:19.220985+0000 mon.a (mon.0) 5300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:19.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:19 smithi044 bash[22676]: audit 2024-09-21T00:32:19.232738+0000 mon.a (mon.0) 5301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:20.290 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:20 smithi044 bash[22676]: audit 2024-09-21T00:32:19.416958+0000 mon.a (mon.0) 5302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:20 smithi044 bash[22676]: audit 2024-09-21T00:32:19.427149+0000 mon.a (mon.0) 5303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:20 smithi044 bash[22676]: audit 2024-09-21T00:32:19.438220+0000 mon.a (mon.0) 5304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:20 smithi179 bash[23186]: audit 2024-09-21T00:32:19.416958+0000 mon.a (mon.0) 5302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:20 smithi179 bash[23186]: audit 2024-09-21T00:32:19.427149+0000 mon.a (mon.0) 5303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:20 smithi179 bash[23186]: audit 2024-09-21T00:32:19.438220+0000 mon.a (mon.0) 5304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:20 smithi049 bash[23528]: audit 2024-09-21T00:32:19.416958+0000 mon.a (mon.0) 5302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:20 smithi049 bash[23528]: audit 2024-09-21T00:32:19.427149+0000 mon.a (mon.0) 5303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:20.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:20 smithi049 bash[23528]: audit 2024-09-21T00:32:19.438220+0000 mon.a (mon.0) 5304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:21 smithi044 bash[22676]: audit 2024-09-21T00:32:19.855320+0000 mgr.a (mgr.14388) 5963 : audit [DBG] from='client.137607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:21 smithi044 bash[22676]: cluster 2024-09-21T00:32:20.199633+0000 mgr.a (mgr.14388) 5964 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:21 smithi044 bash[22676]: audit 2024-09-21T00:32:21.227213+0000 mon.a (mon.0) 5305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:21 smithi044 bash[22676]: audit 2024-09-21T00:32:21.234494+0000 mon.a (mon.0) 5306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:21 smithi044 bash[22676]: audit 2024-09-21T00:32:21.241294+0000 mon.a (mon.0) 5307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:21 smithi179 bash[23186]: audit 2024-09-21T00:32:19.855320+0000 mgr.a (mgr.14388) 5963 : audit [DBG] from='client.137607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:21 smithi179 bash[23186]: cluster 2024-09-21T00:32:20.199633+0000 mgr.a (mgr.14388) 5964 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:21 smithi179 bash[23186]: audit 2024-09-21T00:32:21.227213+0000 mon.a (mon.0) 5305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:21 smithi179 bash[23186]: audit 2024-09-21T00:32:21.234494+0000 mon.a (mon.0) 5306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:21 smithi179 bash[23186]: audit 2024-09-21T00:32:21.241294+0000 mon.a (mon.0) 5307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:21 smithi049 bash[23528]: audit 2024-09-21T00:32:19.855320+0000 mgr.a (mgr.14388) 5963 : audit [DBG] from='client.137607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:21 smithi049 bash[23528]: cluster 2024-09-21T00:32:20.199633+0000 mgr.a (mgr.14388) 5964 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:32:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:21 smithi049 bash[23528]: audit 2024-09-21T00:32:21.227213+0000 mon.a (mon.0) 5305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:21 smithi049 bash[23528]: audit 2024-09-21T00:32:21.234494+0000 mon.a (mon.0) 5306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:21 smithi049 bash[23528]: audit 2024-09-21T00:32:21.241294+0000 mon.a (mon.0) 5307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:23 smithi044 bash[22676]: cluster 2024-09-21T00:32:22.200558+0000 mgr.a (mgr.14388) 5965 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:32:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:23 smithi179 bash[23186]: cluster 2024-09-21T00:32:22.200558+0000 mgr.a (mgr.14388) 5965 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:32:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:23 smithi049 bash[23528]: cluster 2024-09-21T00:32:22.200558+0000 mgr.a (mgr.14388) 5965 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:32:25.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:25.292 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:25.292 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:25 smithi044 bash[22676]: cluster 2024-09-21T00:32:24.201512+0000 mgr.a (mgr.14388) 5966 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:32:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:25 smithi179 bash[23186]: cluster 2024-09-21T00:32:24.201512+0000 mgr.a (mgr.14388) 5966 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:32:25.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:25 smithi049 bash[23528]: cluster 2024-09-21T00:32:24.201512+0000 mgr.a (mgr.14388) 5966 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:32:26.053 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:26.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:26.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:26.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:26.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:26 smithi044 bash[22676]: audit 2024-09-21T00:32:25.624613+0000 mgr.a (mgr.14388) 5967 : audit [DBG] from='client.137685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:26 smithi179 bash[23186]: audit 2024-09-21T00:32:25.624613+0000 mgr.a (mgr.14388) 5967 : audit [DBG] from='client.137685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:26.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:26 smithi049 bash[23528]: audit 2024-09-21T00:32:25.624613+0000 mgr.a (mgr.14388) 5967 : audit [DBG] from='client.137685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:27 smithi044 bash[22676]: cluster 2024-09-21T00:32:26.204327+0000 mgr.a (mgr.14388) 5968 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:27 smithi179 bash[23186]: cluster 2024-09-21T00:32:26.204327+0000 mgr.a (mgr.14388) 5968 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:27 smithi049 bash[23528]: cluster 2024-09-21T00:32:26.204327+0000 mgr.a (mgr.14388) 5968 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:29 smithi044 bash[22676]: cluster 2024-09-21T00:32:28.205117+0000 mgr.a (mgr.14388) 5969 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:32:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:29 smithi179 bash[23186]: cluster 2024-09-21T00:32:28.205117+0000 mgr.a (mgr.14388) 5969 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:32:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:29 smithi049 bash[23528]: cluster 2024-09-21T00:32:28.205117+0000 mgr.a (mgr.14388) 5969 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:32:31.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:31.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:31.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:31 smithi044 bash[22676]: cluster 2024-09-21T00:32:30.207050+0000 mgr.a (mgr.14388) 5970 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:31 smithi179 bash[23186]: cluster 2024-09-21T00:32:30.207050+0000 mgr.a (mgr.14388) 5970 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:31.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:31 smithi049 bash[23528]: cluster 2024-09-21T00:32:30.207050+0000 mgr.a (mgr.14388) 5970 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:31.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:31.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:31.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:31.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:31.807 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:32 smithi044 bash[22676]: audit 2024-09-21T00:32:31.387963+0000 mgr.a (mgr.14388) 5971 : audit [DBG] from='client.137760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:32 smithi179 bash[23186]: audit 2024-09-21T00:32:31.387963+0000 mgr.a (mgr.14388) 5971 : audit [DBG] from='client.137760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:32.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:32 smithi049 bash[23528]: audit 2024-09-21T00:32:31.387963+0000 mgr.a (mgr.14388) 5971 : audit [DBG] from='client.137760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:33 smithi044 bash[22676]: cluster 2024-09-21T00:32:32.207963+0000 mgr.a (mgr.14388) 5972 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:33 smithi179 bash[23186]: cluster 2024-09-21T00:32:32.207963+0000 mgr.a (mgr.14388) 5972 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:33.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:33 smithi049 bash[23528]: cluster 2024-09-21T00:32:32.207963+0000 mgr.a (mgr.14388) 5972 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:35 smithi044 bash[22676]: cluster 2024-09-21T00:32:34.208746+0000 mgr.a (mgr.14388) 5973 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:35 smithi179 bash[23186]: cluster 2024-09-21T00:32:34.208746+0000 mgr.a (mgr.14388) 5973 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:35.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:35 smithi049 bash[23528]: cluster 2024-09-21T00:32:34.208746+0000 mgr.a (mgr.14388) 5973 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:36.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:37.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:37 smithi179 bash[23186]: cluster 2024-09-21T00:32:36.211033+0000 mgr.a (mgr.14388) 5974 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:37.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:37 smithi049 bash[23528]: cluster 2024-09-21T00:32:36.211033+0000 mgr.a (mgr.14388) 5974 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:37 smithi044 bash[22676]: cluster 2024-09-21T00:32:36.211033+0000 mgr.a (mgr.14388) 5974 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:38 smithi179 bash[23186]: audit 2024-09-21T00:32:37.145035+0000 mgr.a (mgr.14388) 5975 : audit [DBG] from='client.137838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:38.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:38 smithi049 bash[23528]: audit 2024-09-21T00:32:37.145035+0000 mgr.a (mgr.14388) 5975 : audit [DBG] from='client.137838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:38 smithi044 bash[22676]: audit 2024-09-21T00:32:37.145035+0000 mgr.a (mgr.14388) 5975 : audit [DBG] from='client.137838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:39.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:39 smithi044 bash[22676]: cluster 2024-09-21T00:32:38.211923+0000 mgr.a (mgr.14388) 5976 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:39.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:39 smithi044 bash[22676]: audit 2024-09-21T00:32:39.387048+0000 mon.a (mon.0) 5308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:39 smithi044 bash[22676]: audit 2024-09-21T00:32:39.397155+0000 mon.a (mon.0) 5309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:39 smithi044 bash[22676]: audit 2024-09-21T00:32:39.407990+0000 mon.a (mon.0) 5310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:39 smithi049 bash[23528]: cluster 2024-09-21T00:32:38.211923+0000 mgr.a (mgr.14388) 5976 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:39.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:39 smithi049 bash[23528]: audit 2024-09-21T00:32:39.387048+0000 mon.a (mon.0) 5308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:39 smithi049 bash[23528]: audit 2024-09-21T00:32:39.397155+0000 mon.a (mon.0) 5309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:39 smithi049 bash[23528]: audit 2024-09-21T00:32:39.407990+0000 mon.a (mon.0) 5310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.977 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:39 smithi179 bash[23186]: cluster 2024-09-21T00:32:38.211923+0000 mgr.a (mgr.14388) 5976 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:39.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:39 smithi179 bash[23186]: audit 2024-09-21T00:32:39.387048+0000 mon.a (mon.0) 5308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:39 smithi179 bash[23186]: audit 2024-09-21T00:32:39.397155+0000 mon.a (mon.0) 5309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:39.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:39 smithi179 bash[23186]: audit 2024-09-21T00:32:39.407990+0000 mon.a (mon.0) 5310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:40 smithi044 bash[22676]: audit 2024-09-21T00:32:39.630168+0000 mon.a (mon.0) 5311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:40 smithi044 bash[22676]: audit 2024-09-21T00:32:39.635401+0000 mon.a (mon.0) 5312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:40 smithi044 bash[22676]: audit 2024-09-21T00:32:39.643134+0000 mon.a (mon.0) 5313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:40 smithi179 bash[23186]: audit 2024-09-21T00:32:39.630168+0000 mon.a (mon.0) 5311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:40 smithi179 bash[23186]: audit 2024-09-21T00:32:39.635401+0000 mon.a (mon.0) 5312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:40 smithi179 bash[23186]: audit 2024-09-21T00:32:39.643134+0000 mon.a (mon.0) 5313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:40 smithi049 bash[23528]: audit 2024-09-21T00:32:39.630168+0000 mon.a (mon.0) 5311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:40 smithi049 bash[23528]: audit 2024-09-21T00:32:39.635401+0000 mon.a (mon.0) 5312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:40 smithi049 bash[23528]: audit 2024-09-21T00:32:39.643134+0000 mon.a (mon.0) 5313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:41 smithi044 bash[22676]: cluster 2024-09-21T00:32:40.214202+0000 mgr.a (mgr.14388) 5977 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:41 smithi044 bash[22676]: audit 2024-09-21T00:32:41.394196+0000 mon.a (mon.0) 5314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:41 smithi044 bash[22676]: audit 2024-09-21T00:32:41.399611+0000 mon.a (mon.0) 5315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:41 smithi044 bash[22676]: audit 2024-09-21T00:32:41.404848+0000 mon.a (mon.0) 5316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:41 smithi179 bash[23186]: cluster 2024-09-21T00:32:40.214202+0000 mgr.a (mgr.14388) 5977 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:41 smithi179 bash[23186]: audit 2024-09-21T00:32:41.394196+0000 mon.a (mon.0) 5314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:41 smithi179 bash[23186]: audit 2024-09-21T00:32:41.399611+0000 mon.a (mon.0) 5315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:41 smithi179 bash[23186]: audit 2024-09-21T00:32:41.404848+0000 mon.a (mon.0) 5316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:41 smithi049 bash[23528]: cluster 2024-09-21T00:32:40.214202+0000 mgr.a (mgr.14388) 5977 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:41 smithi049 bash[23528]: audit 2024-09-21T00:32:41.394196+0000 mon.a (mon.0) 5314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:41 smithi049 bash[23528]: audit 2024-09-21T00:32:41.399611+0000 mon.a (mon.0) 5315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:41 smithi049 bash[23528]: audit 2024-09-21T00:32:41.404848+0000 mon.a (mon.0) 5316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:42.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:42.569 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:42.569 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:43.358 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:43 smithi044 bash[22676]: cluster 2024-09-21T00:32:42.215072+0000 mgr.a (mgr.14388) 5978 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:43 smithi179 bash[23186]: cluster 2024-09-21T00:32:42.215072+0000 mgr.a (mgr.14388) 5978 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:43 smithi049 bash[23528]: cluster 2024-09-21T00:32:42.215072+0000 mgr.a (mgr.14388) 5978 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:44 smithi044 bash[22676]: audit 2024-09-21T00:32:42.907652+0000 mgr.a (mgr.14388) 5979 : audit [DBG] from='client.137916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:44 smithi179 bash[23186]: audit 2024-09-21T00:32:42.907652+0000 mgr.a (mgr.14388) 5979 : audit [DBG] from='client.137916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:44 smithi049 bash[23528]: audit 2024-09-21T00:32:42.907652+0000 mgr.a (mgr.14388) 5979 : audit [DBG] from='client.137916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:45 smithi044 bash[22676]: cluster 2024-09-21T00:32:44.215978+0000 mgr.a (mgr.14388) 5980 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:45 smithi179 bash[23186]: cluster 2024-09-21T00:32:44.215978+0000 mgr.a (mgr.14388) 5980 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:45 smithi049 bash[23528]: cluster 2024-09-21T00:32:44.215978+0000 mgr.a (mgr.14388) 5980 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:47 smithi044 bash[22676]: cluster 2024-09-21T00:32:46.218216+0000 mgr.a (mgr.14388) 5981 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:47 smithi179 bash[23186]: cluster 2024-09-21T00:32:46.218216+0000 mgr.a (mgr.14388) 5981 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:47 smithi049 bash[23528]: cluster 2024-09-21T00:32:46.218216+0000 mgr.a (mgr.14388) 5981 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:48.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:48.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:48.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:49.117 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:49 smithi044 bash[22676]: cluster 2024-09-21T00:32:48.218981+0000 mgr.a (mgr.14388) 5982 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:49 smithi044 bash[22676]: audit 2024-09-21T00:32:48.693230+0000 mgr.a (mgr.14388) 5983 : audit [DBG] from='client.137994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:49 smithi179 bash[23186]: cluster 2024-09-21T00:32:48.218981+0000 mgr.a (mgr.14388) 5982 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:49 smithi179 bash[23186]: audit 2024-09-21T00:32:48.693230+0000 mgr.a (mgr.14388) 5983 : audit [DBG] from='client.137994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:49 smithi049 bash[23528]: cluster 2024-09-21T00:32:48.218981+0000 mgr.a (mgr.14388) 5982 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:49 smithi049 bash[23528]: audit 2024-09-21T00:32:48.693230+0000 mgr.a (mgr.14388) 5983 : audit [DBG] from='client.137994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:51 smithi044 bash[22676]: cluster 2024-09-21T00:32:50.221290+0000 mgr.a (mgr.14388) 5984 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:51 smithi179 bash[23186]: cluster 2024-09-21T00:32:50.221290+0000 mgr.a (mgr.14388) 5984 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:51 smithi049 bash[23528]: cluster 2024-09-21T00:32:50.221290+0000 mgr.a (mgr.14388) 5984 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:53 smithi044 bash[22676]: cluster 2024-09-21T00:32:52.222047+0000 mgr.a (mgr.14388) 5985 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:53 smithi179 bash[23186]: cluster 2024-09-21T00:32:52.222047+0000 mgr.a (mgr.14388) 5985 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:53 smithi049 bash[23528]: cluster 2024-09-21T00:32:52.222047+0000 mgr.a (mgr.14388) 5985 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:54.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:32:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:32:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:32:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:32:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:32:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:55 smithi044 bash[22676]: cluster 2024-09-21T00:32:54.222464+0000 mgr.a (mgr.14388) 5986 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:55 smithi044 bash[22676]: audit 2024-09-21T00:32:54.457701+0000 mgr.a (mgr.14388) 5987 : audit [DBG] from='client.138072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:55 smithi179 bash[23186]: cluster 2024-09-21T00:32:54.222464+0000 mgr.a (mgr.14388) 5986 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:55 smithi179 bash[23186]: audit 2024-09-21T00:32:54.457701+0000 mgr.a (mgr.14388) 5987 : audit [DBG] from='client.138072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:55 smithi049 bash[23528]: cluster 2024-09-21T00:32:54.222464+0000 mgr.a (mgr.14388) 5986 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:55 smithi049 bash[23528]: audit 2024-09-21T00:32:54.457701+0000 mgr.a (mgr.14388) 5987 : audit [DBG] from='client.138072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:32:57.947 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:57 smithi179 bash[23186]: cluster 2024-09-21T00:32:56.224804+0000 mgr.a (mgr.14388) 5988 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:57 smithi044 bash[22676]: cluster 2024-09-21T00:32:56.224804+0000 mgr.a (mgr.14388) 5988 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:58.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:57 smithi049 bash[23528]: cluster 2024-09-21T00:32:56.224804+0000 mgr.a (mgr.14388) 5988 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:32:59.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:32:59.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:32:59.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:32:59.925 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:59 smithi044 bash[22676]: cluster 2024-09-21T00:32:58.225581+0000 mgr.a (mgr.14388) 5989 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:32:59.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:59 smithi044 bash[22676]: audit 2024-09-21T00:32:59.554272+0000 mon.a (mon.0) 5317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:59.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:59 smithi044 bash[22676]: audit 2024-09-21T00:32:59.564149+0000 mon.a (mon.0) 5318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:32:59.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:32:59 smithi044 bash[22676]: audit 2024-09-21T00:32:59.576564+0000 mon.a (mon.0) 5319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:59 smithi179 bash[23186]: cluster 2024-09-21T00:32:58.225581+0000 mgr.a (mgr.14388) 5989 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:59 smithi179 bash[23186]: audit 2024-09-21T00:32:59.554272+0000 mon.a (mon.0) 5317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:59 smithi179 bash[23186]: audit 2024-09-21T00:32:59.564149+0000 mon.a (mon.0) 5318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:00.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:32:59 smithi179 bash[23186]: audit 2024-09-21T00:32:59.576564+0000 mon.a (mon.0) 5319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:59 smithi049 bash[23528]: cluster 2024-09-21T00:32:58.225581+0000 mgr.a (mgr.14388) 5989 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:59 smithi049 bash[23528]: audit 2024-09-21T00:32:59.554272+0000 mon.a (mon.0) 5317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:59 smithi049 bash[23528]: audit 2024-09-21T00:32:59.564149+0000 mon.a (mon.0) 5318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:32:59 smithi049 bash[23528]: audit 2024-09-21T00:32:59.576564+0000 mon.a (mon.0) 5319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:00.673 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:00.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:00.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:00.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:00.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:01.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:00 smithi179 bash[23186]: audit 2024-09-21T00:32:59.816004+0000 mon.a (mon.0) 5320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:00 smithi179 bash[23186]: audit 2024-09-21T00:32:59.822202+0000 mon.a (mon.0) 5321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:00 smithi179 bash[23186]: audit 2024-09-21T00:32:59.829455+0000 mon.a (mon.0) 5322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:00 smithi179 bash[23186]: cluster 2024-09-21T00:33:00.226731+0000 mgr.a (mgr.14388) 5990 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:01.197 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:00 smithi179 bash[23186]: audit 2024-09-21T00:33:00.257236+0000 mgr.a (mgr.14388) 5991 : audit [DBG] from='client.138150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:00 smithi044 bash[22676]: audit 2024-09-21T00:32:59.816004+0000 mon.a (mon.0) 5320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:00 smithi044 bash[22676]: audit 2024-09-21T00:32:59.822202+0000 mon.a (mon.0) 5321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:00 smithi044 bash[22676]: audit 2024-09-21T00:32:59.829455+0000 mon.a (mon.0) 5322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:00 smithi044 bash[22676]: cluster 2024-09-21T00:33:00.226731+0000 mgr.a (mgr.14388) 5990 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:00 smithi044 bash[22676]: audit 2024-09-21T00:33:00.257236+0000 mgr.a (mgr.14388) 5991 : audit [DBG] from='client.138150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:00 smithi049 bash[23528]: audit 2024-09-21T00:32:59.816004+0000 mon.a (mon.0) 5320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:00 smithi049 bash[23528]: audit 2024-09-21T00:32:59.822202+0000 mon.a (mon.0) 5321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:00 smithi049 bash[23528]: audit 2024-09-21T00:32:59.829455+0000 mon.a (mon.0) 5322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:00 smithi049 bash[23528]: cluster 2024-09-21T00:33:00.226731+0000 mgr.a (mgr.14388) 5990 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:00 smithi049 bash[23528]: audit 2024-09-21T00:33:00.257236+0000 mgr.a (mgr.14388) 5991 : audit [DBG] from='client.138150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:02 smithi049 bash[23528]: audit 2024-09-21T00:33:01.545180+0000 mon.a (mon.0) 5323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:02 smithi049 bash[23528]: audit 2024-09-21T00:33:01.551085+0000 mon.a (mon.0) 5324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:02 smithi049 bash[23528]: audit 2024-09-21T00:33:01.558166+0000 mon.a (mon.0) 5325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:02 smithi044 bash[22676]: audit 2024-09-21T00:33:01.545180+0000 mon.a (mon.0) 5323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:02 smithi044 bash[22676]: audit 2024-09-21T00:33:01.551085+0000 mon.a (mon.0) 5324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:02 smithi044 bash[22676]: audit 2024-09-21T00:33:01.558166+0000 mon.a (mon.0) 5325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:02 smithi179 bash[23186]: audit 2024-09-21T00:33:01.545180+0000 mon.a (mon.0) 5323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:02 smithi179 bash[23186]: audit 2024-09-21T00:33:01.551085+0000 mon.a (mon.0) 5324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:02 smithi179 bash[23186]: audit 2024-09-21T00:33:01.558166+0000 mon.a (mon.0) 5325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:03.904 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:03 smithi049 bash[23528]: cluster 2024-09-21T00:33:02.227559+0000 mgr.a (mgr.14388) 5992 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:33:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:03 smithi044 bash[22676]: cluster 2024-09-21T00:33:02.227559+0000 mgr.a (mgr.14388) 5992 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:33:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:03 smithi179 bash[23186]: cluster 2024-09-21T00:33:02.227559+0000 mgr.a (mgr.14388) 5992 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:33:05.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:05.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:05.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:05 smithi044 bash[22676]: cluster 2024-09-21T00:33:04.228335+0000 mgr.a (mgr.14388) 5993 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:33:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:05 smithi179 bash[23186]: cluster 2024-09-21T00:33:04.228335+0000 mgr.a (mgr.14388) 5993 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:33:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:05 smithi049 bash[23528]: cluster 2024-09-21T00:33:04.228335+0000 mgr.a (mgr.14388) 5993 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:33:06.429 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:06.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:06.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:06.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:06.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:06 smithi044 bash[22676]: audit 2024-09-21T00:33:05.749086+0000 mon.a (mon.0) 5326 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:06 smithi044 bash[22676]: audit 2024-09-21T00:33:06.288311+0000 mon.a (mon.0) 5327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:06 smithi044 bash[22676]: audit 2024-09-21T00:33:06.294684+0000 mon.a (mon.0) 5328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:06 smithi044 bash[22676]: audit 2024-09-21T00:33:06.295841+0000 mon.a (mon.0) 5329 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:06 smithi044 bash[22676]: audit 2024-09-21T00:33:06.296607+0000 mon.a (mon.0) 5330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:06 smithi044 bash[22676]: audit 2024-09-21T00:33:06.302335+0000 mon.a (mon.0) 5331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:06 smithi044 bash[22676]: audit 2024-09-21T00:33:06.305502+0000 mon.a (mon.0) 5332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:33:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:06 smithi179 bash[23186]: audit 2024-09-21T00:33:05.749086+0000 mon.a (mon.0) 5326 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:33:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:06 smithi179 bash[23186]: audit 2024-09-21T00:33:06.288311+0000 mon.a (mon.0) 5327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:06 smithi179 bash[23186]: audit 2024-09-21T00:33:06.294684+0000 mon.a (mon.0) 5328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:06 smithi179 bash[23186]: audit 2024-09-21T00:33:06.295841+0000 mon.a (mon.0) 5329 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:33:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:06 smithi179 bash[23186]: audit 2024-09-21T00:33:06.296607+0000 mon.a (mon.0) 5330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:33:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:06 smithi179 bash[23186]: audit 2024-09-21T00:33:06.302335+0000 mon.a (mon.0) 5331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:07.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:06 smithi179 bash[23186]: audit 2024-09-21T00:33:06.305502+0000 mon.a (mon.0) 5332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:33:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:06 smithi049 bash[23528]: audit 2024-09-21T00:33:05.749086+0000 mon.a (mon.0) 5326 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:33:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:06 smithi049 bash[23528]: audit 2024-09-21T00:33:06.288311+0000 mon.a (mon.0) 5327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:06 smithi049 bash[23528]: audit 2024-09-21T00:33:06.294684+0000 mon.a (mon.0) 5328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:06 smithi049 bash[23528]: audit 2024-09-21T00:33:06.295841+0000 mon.a (mon.0) 5329 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:33:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:06 smithi049 bash[23528]: audit 2024-09-21T00:33:06.296607+0000 mon.a (mon.0) 5330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:33:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:06 smithi049 bash[23528]: audit 2024-09-21T00:33:06.302335+0000 mon.a (mon.0) 5331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:06 smithi049 bash[23528]: audit 2024-09-21T00:33:06.305502+0000 mon.a (mon.0) 5332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:33:07.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:33:07 smithi044 bash[22930]: debug 2024-09-21T00:33:07.135+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:33:07.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:33:07 smithi044 bash[22930]: debug 2024-09-21T00:33:07.135+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:33:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:07 smithi044 bash[22676]: audit 2024-09-21T00:33:06.005113+0000 mgr.a (mgr.14388) 5994 : audit [DBG] from='client.138225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:07 smithi044 bash[22676]: cluster 2024-09-21T00:33:06.232214+0000 mgr.a (mgr.14388) 5995 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:07 smithi044 bash[22676]: audit 2024-09-21T00:33:06.306672+0000 mgr.a (mgr.14388) 5996 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:33:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:07 smithi179 bash[23186]: audit 2024-09-21T00:33:06.005113+0000 mgr.a (mgr.14388) 5994 : audit [DBG] from='client.138225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:07 smithi179 bash[23186]: cluster 2024-09-21T00:33:06.232214+0000 mgr.a (mgr.14388) 5995 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:07 smithi179 bash[23186]: audit 2024-09-21T00:33:06.306672+0000 mgr.a (mgr.14388) 5996 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:33:08.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:07 smithi049 bash[23528]: audit 2024-09-21T00:33:06.005113+0000 mgr.a (mgr.14388) 5994 : audit [DBG] from='client.138225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:08.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:07 smithi049 bash[23528]: cluster 2024-09-21T00:33:06.232214+0000 mgr.a (mgr.14388) 5995 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:08.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:07 smithi049 bash[23528]: audit 2024-09-21T00:33:06.306672+0000 mgr.a (mgr.14388) 5996 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:33:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:08 smithi044 bash[22676]: audit 2024-09-21T00:33:07.139305+0000 mgr.a (mgr.14388) 5997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:33:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:08 smithi044 bash[22676]: cephadm 2024-09-21T00:33:07.140863+0000 mgr.a (mgr.14388) 5998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:33:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:08 smithi179 bash[23186]: audit 2024-09-21T00:33:07.139305+0000 mgr.a (mgr.14388) 5997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:33:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:08 smithi179 bash[23186]: cephadm 2024-09-21T00:33:07.140863+0000 mgr.a (mgr.14388) 5998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:33:09.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:08 smithi049 bash[23528]: audit 2024-09-21T00:33:07.139305+0000 mgr.a (mgr.14388) 5997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:33:09.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:08 smithi049 bash[23528]: cephadm 2024-09-21T00:33:07.140863+0000 mgr.a (mgr.14388) 5998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:33:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:09 smithi044 bash[22676]: cluster 2024-09-21T00:33:08.233149+0000 mgr.a (mgr.14388) 5999 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:09 smithi179 bash[23186]: cluster 2024-09-21T00:33:08.233149+0000 mgr.a (mgr.14388) 5999 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:09 smithi049 bash[23528]: cluster 2024-09-21T00:33:08.233149+0000 mgr.a (mgr.14388) 5999 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:11.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:11 smithi044 bash[22676]: cluster 2024-09-21T00:33:10.235403+0000 mgr.a (mgr.14388) 6000 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:11 smithi179 bash[23186]: cluster 2024-09-21T00:33:10.235403+0000 mgr.a (mgr.14388) 6000 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:11 smithi049 bash[23528]: cluster 2024-09-21T00:33:10.235403+0000 mgr.a (mgr.14388) 6000 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:12.221 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:13 smithi044 bash[22676]: audit 2024-09-21T00:33:11.765663+0000 mgr.a (mgr.14388) 6001 : audit [DBG] from='client.138408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:13 smithi044 bash[22676]: cluster 2024-09-21T00:33:12.235990+0000 mgr.a (mgr.14388) 6002 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:13 smithi179 bash[23186]: audit 2024-09-21T00:33:11.765663+0000 mgr.a (mgr.14388) 6001 : audit [DBG] from='client.138408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:13 smithi179 bash[23186]: cluster 2024-09-21T00:33:12.235990+0000 mgr.a (mgr.14388) 6002 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:13 smithi049 bash[23528]: audit 2024-09-21T00:33:11.765663+0000 mgr.a (mgr.14388) 6001 : audit [DBG] from='client.138408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:13 smithi049 bash[23528]: cluster 2024-09-21T00:33:12.235990+0000 mgr.a (mgr.14388) 6002 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:15 smithi044 bash[22676]: cluster 2024-09-21T00:33:14.236741+0000 mgr.a (mgr.14388) 6003 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:15 smithi179 bash[23186]: cluster 2024-09-21T00:33:14.236741+0000 mgr.a (mgr.14388) 6003 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:15 smithi049 bash[23528]: cluster 2024-09-21T00:33:14.236741+0000 mgr.a (mgr.14388) 6003 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:17.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:17.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:17.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:17.899 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:17 smithi179 bash[23186]: cluster 2024-09-21T00:33:16.239013+0000 mgr.a (mgr.14388) 6004 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:17 smithi044 bash[22676]: cluster 2024-09-21T00:33:16.239013+0000 mgr.a (mgr.14388) 6004 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:18.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:18.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:18.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:18.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:18.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:17 smithi049 bash[23528]: cluster 2024-09-21T00:33:16.239013+0000 mgr.a (mgr.14388) 6004 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:18 smithi044 bash[22676]: audit 2024-09-21T00:33:17.557127+0000 mgr.a (mgr.14388) 6005 : audit [DBG] from='client.138486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:18 smithi179 bash[23186]: audit 2024-09-21T00:33:17.557127+0000 mgr.a (mgr.14388) 6005 : audit [DBG] from='client.138486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:19.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:18 smithi049 bash[23528]: audit 2024-09-21T00:33:17.557127+0000 mgr.a (mgr.14388) 6005 : audit [DBG] from='client.138486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:19.857 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:19 smithi044 bash[22676]: cluster 2024-09-21T00:33:18.240004+0000 mgr.a (mgr.14388) 6006 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:19 smithi179 bash[23186]: cluster 2024-09-21T00:33:18.240004+0000 mgr.a (mgr.14388) 6006 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:19 smithi049 bash[23528]: cluster 2024-09-21T00:33:18.240004+0000 mgr.a (mgr.14388) 6006 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:20 smithi044 bash[22676]: audit 2024-09-21T00:33:19.709538+0000 mon.a (mon.0) 5333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:20 smithi044 bash[22676]: audit 2024-09-21T00:33:19.715792+0000 mon.a (mon.0) 5334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:20 smithi044 bash[22676]: audit 2024-09-21T00:33:19.723399+0000 mon.a (mon.0) 5335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:20 smithi044 bash[22676]: audit 2024-09-21T00:33:20.041795+0000 mon.a (mon.0) 5336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:20 smithi044 bash[22676]: audit 2024-09-21T00:33:20.050521+0000 mon.a (mon.0) 5337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:20 smithi044 bash[22676]: audit 2024-09-21T00:33:20.060536+0000 mon.a (mon.0) 5338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:20 smithi179 bash[23186]: audit 2024-09-21T00:33:19.709538+0000 mon.a (mon.0) 5333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:20 smithi179 bash[23186]: audit 2024-09-21T00:33:19.715792+0000 mon.a (mon.0) 5334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:20 smithi179 bash[23186]: audit 2024-09-21T00:33:19.723399+0000 mon.a (mon.0) 5335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:20 smithi179 bash[23186]: audit 2024-09-21T00:33:20.041795+0000 mon.a (mon.0) 5336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:20 smithi179 bash[23186]: audit 2024-09-21T00:33:20.050521+0000 mon.a (mon.0) 5337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:20 smithi179 bash[23186]: audit 2024-09-21T00:33:20.060536+0000 mon.a (mon.0) 5338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:20 smithi049 bash[23528]: audit 2024-09-21T00:33:19.709538+0000 mon.a (mon.0) 5333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:20 smithi049 bash[23528]: audit 2024-09-21T00:33:19.715792+0000 mon.a (mon.0) 5334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:20 smithi049 bash[23528]: audit 2024-09-21T00:33:19.723399+0000 mon.a (mon.0) 5335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:20 smithi049 bash[23528]: audit 2024-09-21T00:33:20.041795+0000 mon.a (mon.0) 5336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:20 smithi049 bash[23528]: audit 2024-09-21T00:33:20.050521+0000 mon.a (mon.0) 5337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:20 smithi049 bash[23528]: audit 2024-09-21T00:33:20.060536+0000 mon.a (mon.0) 5338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:21 smithi044 bash[22676]: cluster 2024-09-21T00:33:20.242296+0000 mgr.a (mgr.14388) 6007 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:21 smithi044 bash[22676]: audit 2024-09-21T00:33:21.701732+0000 mon.a (mon.0) 5339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:21 smithi179 bash[23186]: cluster 2024-09-21T00:33:20.242296+0000 mgr.a (mgr.14388) 6007 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:21 smithi179 bash[23186]: audit 2024-09-21T00:33:21.701732+0000 mon.a (mon.0) 5339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:21 smithi049 bash[23528]: cluster 2024-09-21T00:33:20.242296+0000 mgr.a (mgr.14388) 6007 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:33:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:21 smithi049 bash[23528]: audit 2024-09-21T00:33:21.701732+0000 mon.a (mon.0) 5339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:22 smithi044 bash[22676]: audit 2024-09-21T00:33:21.709499+0000 mon.a (mon.0) 5340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:22 smithi044 bash[22676]: audit 2024-09-21T00:33:21.721287+0000 mon.a (mon.0) 5341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:22 smithi179 bash[23186]: audit 2024-09-21T00:33:21.709499+0000 mon.a (mon.0) 5340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:22 smithi179 bash[23186]: audit 2024-09-21T00:33:21.721287+0000 mon.a (mon.0) 5341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:23.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:23.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:23.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:22 smithi049 bash[23528]: audit 2024-09-21T00:33:21.709499+0000 mon.a (mon.0) 5340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:22 smithi049 bash[23528]: audit 2024-09-21T00:33:21.721287+0000 mon.a (mon.0) 5341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:23.757 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:23 smithi044 bash[22676]: cluster 2024-09-21T00:33:22.243087+0000 mgr.a (mgr.14388) 6008 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:23 smithi179 bash[23186]: cluster 2024-09-21T00:33:22.243087+0000 mgr.a (mgr.14388) 6008 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:23 smithi049 bash[23528]: cluster 2024-09-21T00:33:22.243087+0000 mgr.a (mgr.14388) 6008 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:24 smithi044 bash[22676]: audit 2024-09-21T00:33:23.344830+0000 mgr.a (mgr.14388) 6009 : audit [DBG] from='client.138564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:24 smithi179 bash[23186]: audit 2024-09-21T00:33:23.344830+0000 mgr.a (mgr.14388) 6009 : audit [DBG] from='client.138564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:25.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:24 smithi049 bash[23528]: audit 2024-09-21T00:33:23.344830+0000 mgr.a (mgr.14388) 6009 : audit [DBG] from='client.138564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:25 smithi044 bash[22676]: cluster 2024-09-21T00:33:24.244085+0000 mgr.a (mgr.14388) 6010 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:25 smithi179 bash[23186]: cluster 2024-09-21T00:33:24.244085+0000 mgr.a (mgr.14388) 6010 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:26.047 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:25 smithi049 bash[23528]: cluster 2024-09-21T00:33:24.244085+0000 mgr.a (mgr.14388) 6010 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:26 smithi044 bash[22676]: cluster 2024-09-21T00:33:26.246354+0000 mgr.a (mgr.14388) 6011 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:26 smithi179 bash[23186]: cluster 2024-09-21T00:33:26.246354+0000 mgr.a (mgr.14388) 6011 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:27.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:26 smithi049 bash[23528]: cluster 2024-09-21T00:33:26.246354+0000 mgr.a (mgr.14388) 6011 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:28.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:29.554 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:29.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:29.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:29.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:29.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:29 smithi044 bash[22676]: cluster 2024-09-21T00:33:28.247126+0000 mgr.a (mgr.14388) 6012 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:29 smithi179 bash[23186]: cluster 2024-09-21T00:33:28.247126+0000 mgr.a (mgr.14388) 6012 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:29 smithi049 bash[23528]: cluster 2024-09-21T00:33:28.247126+0000 mgr.a (mgr.14388) 6012 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:30 smithi044 bash[22676]: audit 2024-09-21T00:33:29.093754+0000 mgr.a (mgr.14388) 6013 : audit [DBG] from='client.138642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:30 smithi179 bash[23186]: audit 2024-09-21T00:33:29.093754+0000 mgr.a (mgr.14388) 6013 : audit [DBG] from='client.138642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:30.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:30 smithi049 bash[23528]: audit 2024-09-21T00:33:29.093754+0000 mgr.a (mgr.14388) 6013 : audit [DBG] from='client.138642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:31 smithi044 bash[22676]: cluster 2024-09-21T00:33:30.249503+0000 mgr.a (mgr.14388) 6014 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:31 smithi179 bash[23186]: cluster 2024-09-21T00:33:30.249503+0000 mgr.a (mgr.14388) 6014 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:31.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:31 smithi049 bash[23528]: cluster 2024-09-21T00:33:30.249503+0000 mgr.a (mgr.14388) 6014 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:33 smithi044 bash[22676]: cluster 2024-09-21T00:33:32.250344+0000 mgr.a (mgr.14388) 6015 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:33 smithi179 bash[23186]: cluster 2024-09-21T00:33:32.250344+0000 mgr.a (mgr.14388) 6015 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:33.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:33 smithi049 bash[23528]: cluster 2024-09-21T00:33:32.250344+0000 mgr.a (mgr.14388) 6015 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:34.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:34.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:34.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:35.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:35.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:35.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:35.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:35.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:35 smithi044 bash[22676]: cluster 2024-09-21T00:33:34.251118+0000 mgr.a (mgr.14388) 6016 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:35 smithi179 bash[23186]: cluster 2024-09-21T00:33:34.251118+0000 mgr.a (mgr.14388) 6016 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:35.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:35 smithi049 bash[23528]: cluster 2024-09-21T00:33:34.251118+0000 mgr.a (mgr.14388) 6016 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:36 smithi044 bash[22676]: audit 2024-09-21T00:33:34.893131+0000 mgr.a (mgr.14388) 6017 : audit [DBG] from='client.138720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:36 smithi179 bash[23186]: audit 2024-09-21T00:33:34.893131+0000 mgr.a (mgr.14388) 6017 : audit [DBG] from='client.138720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:36.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:36 smithi049 bash[23528]: audit 2024-09-21T00:33:34.893131+0000 mgr.a (mgr.14388) 6017 : audit [DBG] from='client.138720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:37 smithi044 bash[22676]: cluster 2024-09-21T00:33:36.253962+0000 mgr.a (mgr.14388) 6018 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:37 smithi179 bash[23186]: cluster 2024-09-21T00:33:36.253962+0000 mgr.a (mgr.14388) 6018 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:37.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:37 smithi049 bash[23528]: cluster 2024-09-21T00:33:36.253962+0000 mgr.a (mgr.14388) 6018 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:39.660 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:39 smithi044 bash[22676]: cluster 2024-09-21T00:33:38.254771+0000 mgr.a (mgr.14388) 6019 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:39.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:39 smithi179 bash[23186]: cluster 2024-09-21T00:33:38.254771+0000 mgr.a (mgr.14388) 6019 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:39.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:39 smithi049 bash[23528]: cluster 2024-09-21T00:33:38.254771+0000 mgr.a (mgr.14388) 6019 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:40.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:41.120 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:41.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:41.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:41.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:41.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: audit 2024-09-21T00:33:39.850233+0000 mon.a (mon.0) 5342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: audit 2024-09-21T00:33:39.855236+0000 mon.a (mon.0) 5343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: audit 2024-09-21T00:33:39.861208+0000 mon.a (mon.0) 5344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: audit 2024-09-21T00:33:40.253559+0000 mon.a (mon.0) 5345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: cluster 2024-09-21T00:33:40.257320+0000 mgr.a (mgr.14388) 6020 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: audit 2024-09-21T00:33:40.263397+0000 mon.a (mon.0) 5346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: audit 2024-09-21T00:33:40.274127+0000 mon.a (mon.0) 5347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:40 smithi044 bash[22676]: audit 2024-09-21T00:33:40.692702+0000 mgr.a (mgr.14388) 6021 : audit [DBG] from='client.138795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: audit 2024-09-21T00:33:39.850233+0000 mon.a (mon.0) 5342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: audit 2024-09-21T00:33:39.855236+0000 mon.a (mon.0) 5343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: audit 2024-09-21T00:33:39.861208+0000 mon.a (mon.0) 5344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: audit 2024-09-21T00:33:40.253559+0000 mon.a (mon.0) 5345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: cluster 2024-09-21T00:33:40.257320+0000 mgr.a (mgr.14388) 6020 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: audit 2024-09-21T00:33:40.263397+0000 mon.a (mon.0) 5346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: audit 2024-09-21T00:33:40.274127+0000 mon.a (mon.0) 5347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:40 smithi179 bash[23186]: audit 2024-09-21T00:33:40.692702+0000 mgr.a (mgr.14388) 6021 : audit [DBG] from='client.138795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: audit 2024-09-21T00:33:39.850233+0000 mon.a (mon.0) 5342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: audit 2024-09-21T00:33:39.855236+0000 mon.a (mon.0) 5343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: audit 2024-09-21T00:33:39.861208+0000 mon.a (mon.0) 5344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: audit 2024-09-21T00:33:40.253559+0000 mon.a (mon.0) 5345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: cluster 2024-09-21T00:33:40.257320+0000 mgr.a (mgr.14388) 6020 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: audit 2024-09-21T00:33:40.263397+0000 mon.a (mon.0) 5346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: audit 2024-09-21T00:33:40.274127+0000 mon.a (mon.0) 5347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:40 smithi049 bash[23528]: audit 2024-09-21T00:33:40.692702+0000 mgr.a (mgr.14388) 6021 : audit [DBG] from='client.138795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:42 smithi044 bash[22676]: audit 2024-09-21T00:33:41.890393+0000 mon.a (mon.0) 5348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:42 smithi044 bash[22676]: audit 2024-09-21T00:33:41.896122+0000 mon.a (mon.0) 5349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:42 smithi044 bash[22676]: audit 2024-09-21T00:33:41.901856+0000 mon.a (mon.0) 5350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:42 smithi044 bash[22676]: cluster 2024-09-21T00:33:42.258265+0000 mgr.a (mgr.14388) 6022 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:42 smithi179 bash[23186]: audit 2024-09-21T00:33:41.890393+0000 mon.a (mon.0) 5348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:42 smithi179 bash[23186]: audit 2024-09-21T00:33:41.896122+0000 mon.a (mon.0) 5349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:42 smithi179 bash[23186]: audit 2024-09-21T00:33:41.901856+0000 mon.a (mon.0) 5350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:42 smithi179 bash[23186]: cluster 2024-09-21T00:33:42.258265+0000 mgr.a (mgr.14388) 6022 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:42 smithi049 bash[23528]: audit 2024-09-21T00:33:41.890393+0000 mon.a (mon.0) 5348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:42 smithi049 bash[23528]: audit 2024-09-21T00:33:41.896122+0000 mon.a (mon.0) 5349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:42 smithi049 bash[23528]: audit 2024-09-21T00:33:41.901856+0000 mon.a (mon.0) 5350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:33:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:42 smithi049 bash[23528]: cluster 2024-09-21T00:33:42.258265+0000 mgr.a (mgr.14388) 6022 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:45 smithi044 bash[22676]: cluster 2024-09-21T00:33:44.259071+0000 mgr.a (mgr.14388) 6023 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:45 smithi179 bash[23186]: cluster 2024-09-21T00:33:44.259071+0000 mgr.a (mgr.14388) 6023 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:45.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:45 smithi049 bash[23528]: cluster 2024-09-21T00:33:44.259071+0000 mgr.a (mgr.14388) 6023 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:33:46.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:46.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:46.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:46.916 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:46.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:46.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:46.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:46.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:47 smithi044 bash[22676]: cluster 2024-09-21T00:33:46.260780+0000 mgr.a (mgr.14388) 6024 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:47 smithi044 bash[22676]: audit 2024-09-21T00:33:46.463835+0000 mgr.a (mgr.14388) 6025 : audit [DBG] from='client.138873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:47 smithi179 bash[23186]: cluster 2024-09-21T00:33:46.260780+0000 mgr.a (mgr.14388) 6024 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:47 smithi179 bash[23186]: audit 2024-09-21T00:33:46.463835+0000 mgr.a (mgr.14388) 6025 : audit [DBG] from='client.138873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:47.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:47 smithi049 bash[23528]: cluster 2024-09-21T00:33:46.260780+0000 mgr.a (mgr.14388) 6024 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:47.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:47 smithi049 bash[23528]: audit 2024-09-21T00:33:46.463835+0000 mgr.a (mgr.14388) 6025 : audit [DBG] from='client.138873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:49 smithi044 bash[22676]: cluster 2024-09-21T00:33:48.261756+0000 mgr.a (mgr.14388) 6026 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:49 smithi179 bash[23186]: cluster 2024-09-21T00:33:48.261756+0000 mgr.a (mgr.14388) 6026 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:49.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:49 smithi049 bash[23528]: cluster 2024-09-21T00:33:48.261756+0000 mgr.a (mgr.14388) 6026 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:51 smithi044 bash[22676]: cluster 2024-09-21T00:33:50.264012+0000 mgr.a (mgr.14388) 6027 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:51 smithi179 bash[23186]: cluster 2024-09-21T00:33:50.264012+0000 mgr.a (mgr.14388) 6027 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:51.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:51 smithi049 bash[23528]: cluster 2024-09-21T00:33:50.264012+0000 mgr.a (mgr.14388) 6027 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:51.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:51.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:51.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:52.705 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:52.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:52.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:52.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:52.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:53 smithi044 bash[22676]: audit 2024-09-21T00:33:52.253672+0000 mgr.a (mgr.14388) 6028 : audit [DBG] from='client.138951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:53 smithi044 bash[22676]: cluster 2024-09-21T00:33:52.274257+0000 mgr.a (mgr.14388) 6029 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:53 smithi179 bash[23186]: audit 2024-09-21T00:33:52.253672+0000 mgr.a (mgr.14388) 6028 : audit [DBG] from='client.138951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:53 smithi179 bash[23186]: cluster 2024-09-21T00:33:52.274257+0000 mgr.a (mgr.14388) 6029 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:53.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:53 smithi049 bash[23528]: audit 2024-09-21T00:33:52.253672+0000 mgr.a (mgr.14388) 6028 : audit [DBG] from='client.138951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:53.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:53 smithi049 bash[23528]: cluster 2024-09-21T00:33:52.274257+0000 mgr.a (mgr.14388) 6029 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:55 smithi044 bash[22676]: cluster 2024-09-21T00:33:54.275385+0000 mgr.a (mgr.14388) 6030 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:55 smithi179 bash[23186]: cluster 2024-09-21T00:33:54.275385+0000 mgr.a (mgr.14388) 6030 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:55.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:55 smithi049 bash[23528]: cluster 2024-09-21T00:33:54.275385+0000 mgr.a (mgr.14388) 6030 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:57 smithi179 bash[23186]: cluster 2024-09-21T00:33:56.277736+0000 mgr.a (mgr.14388) 6031 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:57.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:33:57.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:33:57.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:33:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:57 smithi044 bash[22676]: cluster 2024-09-21T00:33:56.277736+0000 mgr.a (mgr.14388) 6031 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:57.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:57 smithi049 bash[23528]: cluster 2024-09-21T00:33:56.277736+0000 mgr.a (mgr.14388) 6031 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:33:58.485 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:33:58.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:33:58.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:33:58.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:33:58.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:33:59.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:59 smithi044 bash[22676]: audit 2024-09-21T00:33:58.041096+0000 mgr.a (mgr.14388) 6032 : audit [DBG] from='client.139026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:59.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:33:59 smithi044 bash[22676]: cluster 2024-09-21T00:33:58.278541+0000 mgr.a (mgr.14388) 6033 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:59 smithi179 bash[23186]: audit 2024-09-21T00:33:58.041096+0000 mgr.a (mgr.14388) 6032 : audit [DBG] from='client.139026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:33:59 smithi179 bash[23186]: cluster 2024-09-21T00:33:58.278541+0000 mgr.a (mgr.14388) 6033 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:33:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:59 smithi049 bash[23528]: audit 2024-09-21T00:33:58.041096+0000 mgr.a (mgr.14388) 6032 : audit [DBG] from='client.139026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:33:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:33:59 smithi049 bash[23528]: cluster 2024-09-21T00:33:58.278541+0000 mgr.a (mgr.14388) 6033 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:00 smithi179 bash[23186]: audit 2024-09-21T00:33:59.989142+0000 mon.a (mon.0) 5351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:00 smithi179 bash[23186]: audit 2024-09-21T00:33:59.998016+0000 mon.a (mon.0) 5352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:00 smithi179 bash[23186]: audit 2024-09-21T00:34:00.006967+0000 mon.a (mon.0) 5353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:00 smithi179 bash[23186]: cluster 2024-09-21T00:34:00.281000+0000 mgr.a (mgr.14388) 6034 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:00 smithi179 bash[23186]: audit 2024-09-21T00:34:00.468233+0000 mon.a (mon.0) 5354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:00 smithi179 bash[23186]: audit 2024-09-21T00:34:00.476895+0000 mon.a (mon.0) 5355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:00 smithi179 bash[23186]: audit 2024-09-21T00:34:00.485188+0000 mon.a (mon.0) 5356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:00 smithi049 bash[23528]: audit 2024-09-21T00:33:59.989142+0000 mon.a (mon.0) 5351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:00 smithi049 bash[23528]: audit 2024-09-21T00:33:59.998016+0000 mon.a (mon.0) 5352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:00 smithi049 bash[23528]: audit 2024-09-21T00:34:00.006967+0000 mon.a (mon.0) 5353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:00 smithi049 bash[23528]: cluster 2024-09-21T00:34:00.281000+0000 mgr.a (mgr.14388) 6034 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:00 smithi049 bash[23528]: audit 2024-09-21T00:34:00.468233+0000 mon.a (mon.0) 5354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:00 smithi049 bash[23528]: audit 2024-09-21T00:34:00.476895+0000 mon.a (mon.0) 5355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:00 smithi049 bash[23528]: audit 2024-09-21T00:34:00.485188+0000 mon.a (mon.0) 5356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:00 smithi044 bash[22676]: audit 2024-09-21T00:33:59.989142+0000 mon.a (mon.0) 5351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:00 smithi044 bash[22676]: audit 2024-09-21T00:33:59.998016+0000 mon.a (mon.0) 5352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:00 smithi044 bash[22676]: audit 2024-09-21T00:34:00.006967+0000 mon.a (mon.0) 5353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:00 smithi044 bash[22676]: cluster 2024-09-21T00:34:00.281000+0000 mgr.a (mgr.14388) 6034 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:01.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:00 smithi044 bash[22676]: audit 2024-09-21T00:34:00.468233+0000 mon.a (mon.0) 5354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:00 smithi044 bash[22676]: audit 2024-09-21T00:34:00.476895+0000 mon.a (mon.0) 5355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:01.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:00 smithi044 bash[22676]: audit 2024-09-21T00:34:00.485188+0000 mon.a (mon.0) 5356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:03 smithi049 bash[23528]: audit 2024-09-21T00:34:02.034584+0000 mon.a (mon.0) 5357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:03 smithi049 bash[23528]: audit 2024-09-21T00:34:02.041114+0000 mon.a (mon.0) 5358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:03 smithi049 bash[23528]: audit 2024-09-21T00:34:02.050356+0000 mon.a (mon.0) 5359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:03 smithi049 bash[23528]: cluster 2024-09-21T00:34:02.282036+0000 mgr.a (mgr.14388) 6035 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:03 smithi044 bash[22676]: audit 2024-09-21T00:34:02.034584+0000 mon.a (mon.0) 5357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:03 smithi044 bash[22676]: audit 2024-09-21T00:34:02.041114+0000 mon.a (mon.0) 5358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:03 smithi044 bash[22676]: audit 2024-09-21T00:34:02.050356+0000 mon.a (mon.0) 5359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:03 smithi044 bash[22676]: cluster 2024-09-21T00:34:02.282036+0000 mgr.a (mgr.14388) 6035 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:03.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:03.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:03 smithi179 bash[23186]: audit 2024-09-21T00:34:02.034584+0000 mon.a (mon.0) 5357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:03 smithi179 bash[23186]: audit 2024-09-21T00:34:02.041114+0000 mon.a (mon.0) 5358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:03 smithi179 bash[23186]: audit 2024-09-21T00:34:02.050356+0000 mon.a (mon.0) 5359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:03 smithi179 bash[23186]: cluster 2024-09-21T00:34:02.282036+0000 mgr.a (mgr.14388) 6035 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:04.257 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:04.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:04.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:04.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:04.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:05.720 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:05 smithi049 bash[23528]: audit 2024-09-21T00:34:03.820532+0000 mgr.a (mgr.14388) 6036 : audit [DBG] from='client.139104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:05.721 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:05 smithi049 bash[23528]: cluster 2024-09-21T00:34:04.282661+0000 mgr.a (mgr.14388) 6037 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:05 smithi044 bash[22676]: audit 2024-09-21T00:34:03.820532+0000 mgr.a (mgr.14388) 6036 : audit [DBG] from='client.139104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:05 smithi044 bash[22676]: cluster 2024-09-21T00:34:04.282661+0000 mgr.a (mgr.14388) 6037 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:05 smithi179 bash[23186]: audit 2024-09-21T00:34:03.820532+0000 mgr.a (mgr.14388) 6036 : audit [DBG] from='client.139104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:05 smithi179 bash[23186]: cluster 2024-09-21T00:34:04.282661+0000 mgr.a (mgr.14388) 6037 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:07 smithi044 bash[22676]: cluster 2024-09-21T00:34:06.284845+0000 mgr.a (mgr.14388) 6038 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:07 smithi044 bash[22676]: audit 2024-09-21T00:34:07.210361+0000 mon.a (mon.0) 5360 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:34:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:07 smithi044 bash[22676]: audit 2024-09-21T00:34:07.217000+0000 mon.a (mon.0) 5361 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:34:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:07 smithi044 bash[22676]: audit 2024-09-21T00:34:07.218971+0000 mon.a (mon.0) 5362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:34:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:07 smithi044 bash[22676]: audit 2024-09-21T00:34:07.230418+0000 mon.a (mon.0) 5363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:07 smithi044 bash[22676]: audit 2024-09-21T00:34:07.236740+0000 mon.a (mon.0) 5364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:34:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:07 smithi179 bash[23186]: cluster 2024-09-21T00:34:06.284845+0000 mgr.a (mgr.14388) 6038 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:07 smithi179 bash[23186]: audit 2024-09-21T00:34:07.210361+0000 mon.a (mon.0) 5360 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:34:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:07 smithi179 bash[23186]: audit 2024-09-21T00:34:07.217000+0000 mon.a (mon.0) 5361 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:34:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:07 smithi179 bash[23186]: audit 2024-09-21T00:34:07.218971+0000 mon.a (mon.0) 5362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:34:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:07 smithi179 bash[23186]: audit 2024-09-21T00:34:07.230418+0000 mon.a (mon.0) 5363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:07 smithi179 bash[23186]: audit 2024-09-21T00:34:07.236740+0000 mon.a (mon.0) 5364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:34:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:07 smithi049 bash[23528]: cluster 2024-09-21T00:34:06.284845+0000 mgr.a (mgr.14388) 6038 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:07 smithi049 bash[23528]: audit 2024-09-21T00:34:07.210361+0000 mon.a (mon.0) 5360 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:34:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:07 smithi049 bash[23528]: audit 2024-09-21T00:34:07.217000+0000 mon.a (mon.0) 5361 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:34:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:07 smithi049 bash[23528]: audit 2024-09-21T00:34:07.218971+0000 mon.a (mon.0) 5362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:34:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:07 smithi049 bash[23528]: audit 2024-09-21T00:34:07.230418+0000 mon.a (mon.0) 5363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:07 smithi049 bash[23528]: audit 2024-09-21T00:34:07.236740+0000 mon.a (mon.0) 5364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:34:08.344 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:34:08 smithi044 bash[22930]: debug 2024-09-21T00:34:08.026+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:34:08.344 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:34:08 smithi044 bash[22930]: debug 2024-09-21T00:34:08.026+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:34:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:08 smithi044 bash[22676]: audit 2024-09-21T00:34:07.239137+0000 mgr.a (mgr.14388) 6039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:34:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:08 smithi179 bash[23186]: audit 2024-09-21T00:34:07.239137+0000 mgr.a (mgr.14388) 6039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:34:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:08 smithi049 bash[23528]: audit 2024-09-21T00:34:07.239137+0000 mgr.a (mgr.14388) 6039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:34:09.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:09.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:09.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:09 smithi044 bash[22676]: audit 2024-09-21T00:34:08.030035+0000 mgr.a (mgr.14388) 6040 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:34:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:09 smithi044 bash[22676]: cephadm 2024-09-21T00:34:08.031615+0000 mgr.a (mgr.14388) 6041 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:34:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:09 smithi044 bash[22676]: cluster 2024-09-21T00:34:08.285876+0000 mgr.a (mgr.14388) 6042 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:09 smithi179 bash[23186]: audit 2024-09-21T00:34:08.030035+0000 mgr.a (mgr.14388) 6040 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:34:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:09 smithi179 bash[23186]: cephadm 2024-09-21T00:34:08.031615+0000 mgr.a (mgr.14388) 6041 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:34:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:09 smithi179 bash[23186]: cluster 2024-09-21T00:34:08.285876+0000 mgr.a (mgr.14388) 6042 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:09 smithi049 bash[23528]: audit 2024-09-21T00:34:08.030035+0000 mgr.a (mgr.14388) 6040 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:34:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:09 smithi049 bash[23528]: cephadm 2024-09-21T00:34:08.031615+0000 mgr.a (mgr.14388) 6041 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:34:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:09 smithi049 bash[23528]: cluster 2024-09-21T00:34:08.285876+0000 mgr.a (mgr.14388) 6042 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:10.028 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:10.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:10 smithi044 bash[22676]: audit 2024-09-21T00:34:09.593748+0000 mgr.a (mgr.14388) 6043 : audit [DBG] from='client.139287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:10 smithi179 bash[23186]: audit 2024-09-21T00:34:09.593748+0000 mgr.a (mgr.14388) 6043 : audit [DBG] from='client.139287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:10.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:10 smithi049 bash[23528]: audit 2024-09-21T00:34:09.593748+0000 mgr.a (mgr.14388) 6043 : audit [DBG] from='client.139287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:11 smithi044 bash[22676]: cluster 2024-09-21T00:34:10.288487+0000 mgr.a (mgr.14388) 6044 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:11 smithi179 bash[23186]: cluster 2024-09-21T00:34:10.288487+0000 mgr.a (mgr.14388) 6044 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:11.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:11 smithi049 bash[23528]: cluster 2024-09-21T00:34:10.288487+0000 mgr.a (mgr.14388) 6044 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:13 smithi044 bash[22676]: cluster 2024-09-21T00:34:12.289358+0000 mgr.a (mgr.14388) 6045 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:13 smithi179 bash[23186]: cluster 2024-09-21T00:34:12.289358+0000 mgr.a (mgr.14388) 6045 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:13 smithi049 bash[23528]: cluster 2024-09-21T00:34:12.289358+0000 mgr.a (mgr.14388) 6045 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:15.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:15.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:15.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:15 smithi044 bash[22676]: cluster 2024-09-21T00:34:14.290153+0000 mgr.a (mgr.14388) 6046 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:15 smithi179 bash[23186]: cluster 2024-09-21T00:34:14.290153+0000 mgr.a (mgr.14388) 6046 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:15.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:15 smithi049 bash[23528]: cluster 2024-09-21T00:34:14.290153+0000 mgr.a (mgr.14388) 6046 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:15.808 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:15.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:15.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:15.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:15.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:16 smithi044 bash[22676]: audit 2024-09-21T00:34:15.368821+0000 mgr.a (mgr.14388) 6047 : audit [DBG] from='client.139365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:16 smithi179 bash[23186]: audit 2024-09-21T00:34:15.368821+0000 mgr.a (mgr.14388) 6047 : audit [DBG] from='client.139365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:16.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:16 smithi049 bash[23528]: audit 2024-09-21T00:34:15.368821+0000 mgr.a (mgr.14388) 6047 : audit [DBG] from='client.139365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:17 smithi179 bash[23186]: cluster 2024-09-21T00:34:16.293109+0000 mgr.a (mgr.14388) 6048 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:17 smithi044 bash[22676]: cluster 2024-09-21T00:34:16.293109+0000 mgr.a (mgr.14388) 6048 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:17.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:17 smithi049 bash[23528]: cluster 2024-09-21T00:34:16.293109+0000 mgr.a (mgr.14388) 6048 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:19 smithi044 bash[22676]: cluster 2024-09-21T00:34:18.293991+0000 mgr.a (mgr.14388) 6049 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:19 smithi179 bash[23186]: cluster 2024-09-21T00:34:18.293991+0000 mgr.a (mgr.14388) 6049 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:19.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:19 smithi049 bash[23528]: cluster 2024-09-21T00:34:18.293991+0000 mgr.a (mgr.14388) 6049 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:34:20.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:20.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:21.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:21 smithi044 bash[22676]: audit 2024-09-21T00:34:20.168914+0000 mon.a (mon.0) 5365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:21 smithi044 bash[22676]: audit 2024-09-21T00:34:20.177433+0000 mon.a (mon.0) 5366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:21 smithi044 bash[22676]: audit 2024-09-21T00:34:20.188013+0000 mon.a (mon.0) 5367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:21 smithi044 bash[22676]: cluster 2024-09-21T00:34:20.296138+0000 mgr.a (mgr.14388) 6050 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:21.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:21 smithi044 bash[22676]: audit 2024-09-21T00:34:20.664703+0000 mon.a (mon.0) 5368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:21 smithi044 bash[22676]: audit 2024-09-21T00:34:20.673030+0000 mon.a (mon.0) 5369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:21 smithi044 bash[22676]: audit 2024-09-21T00:34:20.681790+0000 mon.a (mon.0) 5370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:21 smithi179 bash[23186]: audit 2024-09-21T00:34:20.168914+0000 mon.a (mon.0) 5365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:21 smithi179 bash[23186]: audit 2024-09-21T00:34:20.177433+0000 mon.a (mon.0) 5366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:21 smithi179 bash[23186]: audit 2024-09-21T00:34:20.188013+0000 mon.a (mon.0) 5367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:21 smithi179 bash[23186]: cluster 2024-09-21T00:34:20.296138+0000 mgr.a (mgr.14388) 6050 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:21 smithi179 bash[23186]: audit 2024-09-21T00:34:20.664703+0000 mon.a (mon.0) 5368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:21 smithi179 bash[23186]: audit 2024-09-21T00:34:20.673030+0000 mon.a (mon.0) 5369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:21 smithi179 bash[23186]: audit 2024-09-21T00:34:20.681790+0000 mon.a (mon.0) 5370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:21 smithi049 bash[23528]: audit 2024-09-21T00:34:20.168914+0000 mon.a (mon.0) 5365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:21 smithi049 bash[23528]: audit 2024-09-21T00:34:20.177433+0000 mon.a (mon.0) 5366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:21 smithi049 bash[23528]: audit 2024-09-21T00:34:20.188013+0000 mon.a (mon.0) 5367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:21 smithi049 bash[23528]: cluster 2024-09-21T00:34:20.296138+0000 mgr.a (mgr.14388) 6050 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:34:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:21 smithi049 bash[23528]: audit 2024-09-21T00:34:20.664703+0000 mon.a (mon.0) 5368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:21 smithi049 bash[23528]: audit 2024-09-21T00:34:20.673030+0000 mon.a (mon.0) 5369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:21 smithi049 bash[23528]: audit 2024-09-21T00:34:20.681790+0000 mon.a (mon.0) 5370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:21.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:21.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:21.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:21.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:21.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:22 smithi044 bash[22676]: audit 2024-09-21T00:34:21.148965+0000 mgr.a (mgr.14388) 6051 : audit [DBG] from='client.139443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:22 smithi044 bash[22676]: audit 2024-09-21T00:34:22.159728+0000 mon.a (mon.0) 5371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:22 smithi044 bash[22676]: audit 2024-09-21T00:34:22.165549+0000 mon.a (mon.0) 5372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:22 smithi044 bash[22676]: audit 2024-09-21T00:34:22.171248+0000 mon.a (mon.0) 5373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:22 smithi179 bash[23186]: audit 2024-09-21T00:34:21.148965+0000 mgr.a (mgr.14388) 6051 : audit [DBG] from='client.139443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:22 smithi179 bash[23186]: audit 2024-09-21T00:34:22.159728+0000 mon.a (mon.0) 5371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:22 smithi179 bash[23186]: audit 2024-09-21T00:34:22.165549+0000 mon.a (mon.0) 5372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:22 smithi179 bash[23186]: audit 2024-09-21T00:34:22.171248+0000 mon.a (mon.0) 5373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:22 smithi049 bash[23528]: audit 2024-09-21T00:34:21.148965+0000 mgr.a (mgr.14388) 6051 : audit [DBG] from='client.139443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:22 smithi049 bash[23528]: audit 2024-09-21T00:34:22.159728+0000 mon.a (mon.0) 5371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:22 smithi049 bash[23528]: audit 2024-09-21T00:34:22.165549+0000 mon.a (mon.0) 5372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:22.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:22 smithi049 bash[23528]: audit 2024-09-21T00:34:22.171248+0000 mon.a (mon.0) 5373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:23 smithi044 bash[22676]: cluster 2024-09-21T00:34:22.297079+0000 mgr.a (mgr.14388) 6052 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:34:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:23 smithi179 bash[23186]: cluster 2024-09-21T00:34:22.297079+0000 mgr.a (mgr.14388) 6052 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:34:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:23 smithi049 bash[23528]: cluster 2024-09-21T00:34:22.297079+0000 mgr.a (mgr.14388) 6052 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:34:25.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:25 smithi049 bash[23528]: cluster 2024-09-21T00:34:24.297869+0000 mgr.a (mgr.14388) 6053 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:34:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:25 smithi044 bash[22676]: cluster 2024-09-21T00:34:24.297869+0000 mgr.a (mgr.14388) 6053 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:34:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:25 smithi179 bash[23186]: cluster 2024-09-21T00:34:24.297869+0000 mgr.a (mgr.14388) 6053 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:34:26.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:26.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:27.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:27.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:27.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:27.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:27.400 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:27 smithi044 bash[22676]: cluster 2024-09-21T00:34:26.300044+0000 mgr.a (mgr.14388) 6054 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:34:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:27 smithi179 bash[23186]: cluster 2024-09-21T00:34:26.300044+0000 mgr.a (mgr.14388) 6054 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:34:27.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:27 smithi049 bash[23528]: cluster 2024-09-21T00:34:26.300044+0000 mgr.a (mgr.14388) 6054 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:34:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:28 smithi044 bash[22676]: audit 2024-09-21T00:34:26.948942+0000 mgr.a (mgr.14388) 6055 : audit [DBG] from='client.139521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:28 smithi179 bash[23186]: audit 2024-09-21T00:34:26.948942+0000 mgr.a (mgr.14388) 6055 : audit [DBG] from='client.139521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:28 smithi049 bash[23528]: audit 2024-09-21T00:34:26.948942+0000 mgr.a (mgr.14388) 6055 : audit [DBG] from='client.139521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:29 smithi044 bash[22676]: cluster 2024-09-21T00:34:28.300972+0000 mgr.a (mgr.14388) 6056 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:29 smithi179 bash[23186]: cluster 2024-09-21T00:34:28.300972+0000 mgr.a (mgr.14388) 6056 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:29 smithi049 bash[23528]: cluster 2024-09-21T00:34:28.300972+0000 mgr.a (mgr.14388) 6056 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:31 smithi044 bash[22676]: cluster 2024-09-21T00:34:30.303144+0000 mgr.a (mgr.14388) 6057 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:31 smithi179 bash[23186]: cluster 2024-09-21T00:34:30.303144+0000 mgr.a (mgr.14388) 6057 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:31.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:31 smithi049 bash[23528]: cluster 2024-09-21T00:34:30.303144+0000 mgr.a (mgr.14388) 6057 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:32.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:32.402 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:32.402 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:33.155 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:33 smithi044 bash[22676]: cluster 2024-09-21T00:34:32.303918+0000 mgr.a (mgr.14388) 6058 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:33 smithi044 bash[22676]: audit 2024-09-21T00:34:32.731843+0000 mgr.a (mgr.14388) 6059 : audit [DBG] from='client.139599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:33 smithi179 bash[23186]: cluster 2024-09-21T00:34:32.303918+0000 mgr.a (mgr.14388) 6058 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:33 smithi179 bash[23186]: audit 2024-09-21T00:34:32.731843+0000 mgr.a (mgr.14388) 6059 : audit [DBG] from='client.139599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:33.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:33 smithi049 bash[23528]: cluster 2024-09-21T00:34:32.303918+0000 mgr.a (mgr.14388) 6058 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:33.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:33 smithi049 bash[23528]: audit 2024-09-21T00:34:32.731843+0000 mgr.a (mgr.14388) 6059 : audit [DBG] from='client.139599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:35 smithi044 bash[22676]: cluster 2024-09-21T00:34:34.304834+0000 mgr.a (mgr.14388) 6060 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:35 smithi179 bash[23186]: cluster 2024-09-21T00:34:34.304834+0000 mgr.a (mgr.14388) 6060 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:35.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:35 smithi049 bash[23528]: cluster 2024-09-21T00:34:34.304834+0000 mgr.a (mgr.14388) 6060 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:37 smithi044 bash[22676]: cluster 2024-09-21T00:34:36.307092+0000 mgr.a (mgr.14388) 6061 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:37 smithi179 bash[23186]: cluster 2024-09-21T00:34:36.307092+0000 mgr.a (mgr.14388) 6061 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:37.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:37 smithi049 bash[23528]: cluster 2024-09-21T00:34:36.307092+0000 mgr.a (mgr.14388) 6061 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:38.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:38.157 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:38.157 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:38.924 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:38.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:38.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:38.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:38.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:39.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:39 smithi044 bash[22676]: cluster 2024-09-21T00:34:38.307830+0000 mgr.a (mgr.14388) 6062 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:39.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:39 smithi044 bash[22676]: audit 2024-09-21T00:34:38.490483+0000 mgr.a (mgr.14388) 6063 : audit [DBG] from='client.139677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:39 smithi179 bash[23186]: cluster 2024-09-21T00:34:38.307830+0000 mgr.a (mgr.14388) 6062 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:39 smithi179 bash[23186]: audit 2024-09-21T00:34:38.490483+0000 mgr.a (mgr.14388) 6063 : audit [DBG] from='client.139677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:39.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:39 smithi049 bash[23528]: cluster 2024-09-21T00:34:38.307830+0000 mgr.a (mgr.14388) 6062 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:39.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:39 smithi049 bash[23528]: audit 2024-09-21T00:34:38.490483+0000 mgr.a (mgr.14388) 6063 : audit [DBG] from='client.139677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:41 smithi044 bash[22676]: cluster 2024-09-21T00:34:40.309185+0000 mgr.a (mgr.14388) 6064 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:41 smithi044 bash[22676]: audit 2024-09-21T00:34:40.326142+0000 mon.a (mon.0) 5374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:41 smithi044 bash[22676]: audit 2024-09-21T00:34:40.335186+0000 mon.a (mon.0) 5375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:41 smithi044 bash[22676]: audit 2024-09-21T00:34:40.345635+0000 mon.a (mon.0) 5376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:41 smithi044 bash[22676]: audit 2024-09-21T00:34:40.872326+0000 mon.a (mon.0) 5377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:41 smithi044 bash[22676]: audit 2024-09-21T00:34:40.881009+0000 mon.a (mon.0) 5378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:41 smithi044 bash[22676]: audit 2024-09-21T00:34:40.891314+0000 mon.a (mon.0) 5379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:41 smithi179 bash[23186]: cluster 2024-09-21T00:34:40.309185+0000 mgr.a (mgr.14388) 6064 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:41 smithi179 bash[23186]: audit 2024-09-21T00:34:40.326142+0000 mon.a (mon.0) 5374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:41 smithi179 bash[23186]: audit 2024-09-21T00:34:40.335186+0000 mon.a (mon.0) 5375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:41 smithi179 bash[23186]: audit 2024-09-21T00:34:40.345635+0000 mon.a (mon.0) 5376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:41 smithi179 bash[23186]: audit 2024-09-21T00:34:40.872326+0000 mon.a (mon.0) 5377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:41 smithi179 bash[23186]: audit 2024-09-21T00:34:40.881009+0000 mon.a (mon.0) 5378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:41 smithi179 bash[23186]: audit 2024-09-21T00:34:40.891314+0000 mon.a (mon.0) 5379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:41 smithi049 bash[23528]: cluster 2024-09-21T00:34:40.309185+0000 mgr.a (mgr.14388) 6064 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:41 smithi049 bash[23528]: audit 2024-09-21T00:34:40.326142+0000 mon.a (mon.0) 5374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:41 smithi049 bash[23528]: audit 2024-09-21T00:34:40.335186+0000 mon.a (mon.0) 5375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:41 smithi049 bash[23528]: audit 2024-09-21T00:34:40.345635+0000 mon.a (mon.0) 5376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:41 smithi049 bash[23528]: audit 2024-09-21T00:34:40.872326+0000 mon.a (mon.0) 5377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:41 smithi049 bash[23528]: audit 2024-09-21T00:34:40.881009+0000 mon.a (mon.0) 5378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:41 smithi049 bash[23528]: audit 2024-09-21T00:34:40.891314+0000 mon.a (mon.0) 5379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:43 smithi044 bash[22676]: cluster 2024-09-21T00:34:42.309868+0000 mgr.a (mgr.14388) 6065 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:43 smithi044 bash[22676]: audit 2024-09-21T00:34:42.356445+0000 mon.a (mon.0) 5380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:43 smithi044 bash[22676]: audit 2024-09-21T00:34:42.365111+0000 mon.a (mon.0) 5381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:43 smithi044 bash[22676]: audit 2024-09-21T00:34:42.375313+0000 mon.a (mon.0) 5382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:43 smithi179 bash[23186]: cluster 2024-09-21T00:34:42.309868+0000 mgr.a (mgr.14388) 6065 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:43 smithi179 bash[23186]: audit 2024-09-21T00:34:42.356445+0000 mon.a (mon.0) 5380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:43 smithi179 bash[23186]: audit 2024-09-21T00:34:42.365111+0000 mon.a (mon.0) 5381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:43 smithi179 bash[23186]: audit 2024-09-21T00:34:42.375313+0000 mon.a (mon.0) 5382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:43 smithi049 bash[23528]: cluster 2024-09-21T00:34:42.309868+0000 mgr.a (mgr.14388) 6065 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:43.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:43 smithi049 bash[23528]: audit 2024-09-21T00:34:42.356445+0000 mon.a (mon.0) 5380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:43 smithi049 bash[23528]: audit 2024-09-21T00:34:42.365111+0000 mon.a (mon.0) 5381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:43 smithi049 bash[23528]: audit 2024-09-21T00:34:42.375313+0000 mon.a (mon.0) 5382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:34:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:43.927 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:43.927 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:44.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:44.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:44.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:44.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:45 smithi044 bash[22676]: audit 2024-09-21T00:34:44.267151+0000 mgr.a (mgr.14388) 6066 : audit [DBG] from='client.139755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:45 smithi044 bash[22676]: cluster 2024-09-21T00:34:44.310925+0000 mgr.a (mgr.14388) 6067 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:45 smithi179 bash[23186]: audit 2024-09-21T00:34:44.267151+0000 mgr.a (mgr.14388) 6066 : audit [DBG] from='client.139755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:45 smithi179 bash[23186]: cluster 2024-09-21T00:34:44.310925+0000 mgr.a (mgr.14388) 6067 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:45 smithi049 bash[23528]: audit 2024-09-21T00:34:44.267151+0000 mgr.a (mgr.14388) 6066 : audit [DBG] from='client.139755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:45.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:45 smithi049 bash[23528]: cluster 2024-09-21T00:34:44.310925+0000 mgr.a (mgr.14388) 6067 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:47 smithi044 bash[22676]: cluster 2024-09-21T00:34:46.313319+0000 mgr.a (mgr.14388) 6068 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:47 smithi179 bash[23186]: cluster 2024-09-21T00:34:46.313319+0000 mgr.a (mgr.14388) 6068 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:47.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:47 smithi049 bash[23528]: cluster 2024-09-21T00:34:46.313319+0000 mgr.a (mgr.14388) 6068 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:34:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:49 smithi044 bash[22676]: cluster 2024-09-21T00:34:48.314053+0000 mgr.a (mgr.14388) 6069 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:49 smithi179 bash[23186]: cluster 2024-09-21T00:34:48.314053+0000 mgr.a (mgr.14388) 6069 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:49.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:49 smithi049 bash[23528]: cluster 2024-09-21T00:34:48.314053+0000 mgr.a (mgr.14388) 6069 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:50.501 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:50.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:50.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:50.501 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:50.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:51 smithi044 bash[22676]: audit 2024-09-21T00:34:50.056185+0000 mgr.a (mgr.14388) 6070 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:51 smithi044 bash[22676]: cluster 2024-09-21T00:34:50.315815+0000 mgr.a (mgr.14388) 6071 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:51 smithi179 bash[23186]: audit 2024-09-21T00:34:50.056185+0000 mgr.a (mgr.14388) 6070 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:51 smithi179 bash[23186]: cluster 2024-09-21T00:34:50.315815+0000 mgr.a (mgr.14388) 6071 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:51.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:51 smithi049 bash[23528]: audit 2024-09-21T00:34:50.056185+0000 mgr.a (mgr.14388) 6070 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:51.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:51 smithi049 bash[23528]: cluster 2024-09-21T00:34:50.315815+0000 mgr.a (mgr.14388) 6071 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:53 smithi044 bash[22676]: cluster 2024-09-21T00:34:52.316728+0000 mgr.a (mgr.14388) 6072 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:53 smithi179 bash[23186]: cluster 2024-09-21T00:34:52.316728+0000 mgr.a (mgr.14388) 6072 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:53.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:53 smithi049 bash[23528]: cluster 2024-09-21T00:34:52.316728+0000 mgr.a (mgr.14388) 6072 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:34:55.503 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:34:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:34:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:55 smithi044 bash[22676]: cluster 2024-09-21T00:34:54.317536+0000 mgr.a (mgr.14388) 6073 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:55 smithi179 bash[23186]: cluster 2024-09-21T00:34:54.317536+0000 mgr.a (mgr.14388) 6073 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:55.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:55 smithi049 bash[23528]: cluster 2024-09-21T00:34:54.317536+0000 mgr.a (mgr.14388) 6073 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:56.261 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:34:56.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:34:56.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:34:56.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:34:56.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:34:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:57 smithi044 bash[22676]: audit 2024-09-21T00:34:55.834840+0000 mgr.a (mgr.14388) 6074 : audit [DBG] from='client.139911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:57 smithi044 bash[22676]: cluster 2024-09-21T00:34:56.318761+0000 mgr.a (mgr.14388) 6075 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:57 smithi179 bash[23186]: audit 2024-09-21T00:34:55.834840+0000 mgr.a (mgr.14388) 6074 : audit [DBG] from='client.139911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:57 smithi179 bash[23186]: cluster 2024-09-21T00:34:56.318761+0000 mgr.a (mgr.14388) 6075 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:57.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:57 smithi049 bash[23528]: audit 2024-09-21T00:34:55.834840+0000 mgr.a (mgr.14388) 6074 : audit [DBG] from='client.139911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:34:57.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:57 smithi049 bash[23528]: cluster 2024-09-21T00:34:56.318761+0000 mgr.a (mgr.14388) 6075 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:34:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:34:59 smithi179 bash[23186]: cluster 2024-09-21T00:34:58.319509+0000 mgr.a (mgr.14388) 6076 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:59.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:34:59 smithi044 bash[22676]: cluster 2024-09-21T00:34:58.319509+0000 mgr.a (mgr.14388) 6076 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:34:59.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:34:59 smithi049 bash[23528]: cluster 2024-09-21T00:34:58.319509+0000 mgr.a (mgr.14388) 6076 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:35:01.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:01.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:01.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:01 smithi044 bash[22676]: cluster 2024-09-21T00:35:00.321582+0000 mgr.a (mgr.14388) 6077 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:01 smithi044 bash[22676]: audit 2024-09-21T00:35:00.515777+0000 mon.a (mon.0) 5383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:01 smithi044 bash[22676]: audit 2024-09-21T00:35:00.524041+0000 mon.a (mon.0) 5384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:01 smithi044 bash[22676]: audit 2024-09-21T00:35:00.534876+0000 mon.a (mon.0) 5385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:01 smithi044 bash[22676]: audit 2024-09-21T00:35:01.108337+0000 mon.a (mon.0) 5386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:01 smithi044 bash[22676]: audit 2024-09-21T00:35:01.116767+0000 mon.a (mon.0) 5387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:01 smithi044 bash[22676]: audit 2024-09-21T00:35:01.126851+0000 mon.a (mon.0) 5388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:01 smithi049 bash[23528]: cluster 2024-09-21T00:35:00.321582+0000 mgr.a (mgr.14388) 6077 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:01 smithi049 bash[23528]: audit 2024-09-21T00:35:00.515777+0000 mon.a (mon.0) 5383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:01 smithi049 bash[23528]: audit 2024-09-21T00:35:00.524041+0000 mon.a (mon.0) 5384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:01 smithi049 bash[23528]: audit 2024-09-21T00:35:00.534876+0000 mon.a (mon.0) 5385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:01 smithi049 bash[23528]: audit 2024-09-21T00:35:01.108337+0000 mon.a (mon.0) 5386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:01 smithi049 bash[23528]: audit 2024-09-21T00:35:01.116767+0000 mon.a (mon.0) 5387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:01 smithi049 bash[23528]: audit 2024-09-21T00:35:01.126851+0000 mon.a (mon.0) 5388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.864 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:01 smithi179 bash[23186]: cluster 2024-09-21T00:35:00.321582+0000 mgr.a (mgr.14388) 6077 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:01.864 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:01 smithi179 bash[23186]: audit 2024-09-21T00:35:00.515777+0000 mon.a (mon.0) 5383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:01 smithi179 bash[23186]: audit 2024-09-21T00:35:00.524041+0000 mon.a (mon.0) 5384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:01 smithi179 bash[23186]: audit 2024-09-21T00:35:00.534876+0000 mon.a (mon.0) 5385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:01 smithi179 bash[23186]: audit 2024-09-21T00:35:01.108337+0000 mon.a (mon.0) 5386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:01 smithi179 bash[23186]: audit 2024-09-21T00:35:01.116767+0000 mon.a (mon.0) 5387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:01.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:01 smithi179 bash[23186]: audit 2024-09-21T00:35:01.126851+0000 mon.a (mon.0) 5388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:02.069 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:02 smithi044 bash[22676]: audit 2024-09-21T00:35:01.610727+0000 mgr.a (mgr.14388) 6078 : audit [DBG] from='client.139989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:02 smithi049 bash[23528]: audit 2024-09-21T00:35:01.610727+0000 mgr.a (mgr.14388) 6078 : audit [DBG] from='client.139989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:02 smithi179 bash[23186]: audit 2024-09-21T00:35:01.610727+0000 mgr.a (mgr.14388) 6078 : audit [DBG] from='client.139989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:03 smithi049 bash[23528]: cluster 2024-09-21T00:35:02.322574+0000 mgr.a (mgr.14388) 6079 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:03 smithi049 bash[23528]: audit 2024-09-21T00:35:02.518881+0000 mon.a (mon.0) 5389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:03 smithi049 bash[23528]: audit 2024-09-21T00:35:02.532071+0000 mon.a (mon.0) 5390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:03.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:03 smithi049 bash[23528]: audit 2024-09-21T00:35:02.539721+0000 mon.a (mon.0) 5391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:03 smithi044 bash[22676]: cluster 2024-09-21T00:35:02.322574+0000 mgr.a (mgr.14388) 6079 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:03 smithi044 bash[22676]: audit 2024-09-21T00:35:02.518881+0000 mon.a (mon.0) 5389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:03 smithi044 bash[22676]: audit 2024-09-21T00:35:02.532071+0000 mon.a (mon.0) 5390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:03 smithi044 bash[22676]: audit 2024-09-21T00:35:02.539721+0000 mon.a (mon.0) 5391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:03 smithi179 bash[23186]: cluster 2024-09-21T00:35:02.322574+0000 mgr.a (mgr.14388) 6079 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:03 smithi179 bash[23186]: audit 2024-09-21T00:35:02.518881+0000 mon.a (mon.0) 5389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:03 smithi179 bash[23186]: audit 2024-09-21T00:35:02.532071+0000 mon.a (mon.0) 5390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:03 smithi179 bash[23186]: audit 2024-09-21T00:35:02.539721+0000 mon.a (mon.0) 5391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:05 smithi049 bash[23528]: cluster 2024-09-21T00:35:04.323369+0000 mgr.a (mgr.14388) 6080 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:05 smithi044 bash[22676]: cluster 2024-09-21T00:35:04.323369+0000 mgr.a (mgr.14388) 6080 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:05 smithi179 bash[23186]: cluster 2024-09-21T00:35:04.323369+0000 mgr.a (mgr.14388) 6080 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:07 smithi049 bash[23528]: cluster 2024-09-21T00:35:06.325575+0000 mgr.a (mgr.14388) 6081 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:35:07.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:07 smithi044 bash[22676]: cluster 2024-09-21T00:35:06.325575+0000 mgr.a (mgr.14388) 6081 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:35:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:07 smithi179 bash[23186]: cluster 2024-09-21T00:35:06.325575+0000 mgr.a (mgr.14388) 6081 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:35:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:08 smithi049 bash[23528]: audit 2024-09-21T00:35:07.405480+0000 mgr.a (mgr.14388) 6082 : audit [DBG] from='client.140067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:08 smithi049 bash[23528]: audit 2024-09-21T00:35:08.097683+0000 mon.a (mon.0) 5392 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:35:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:08 smithi049 bash[23528]: audit 2024-09-21T00:35:08.104710+0000 mon.a (mon.0) 5393 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:35:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:08 smithi049 bash[23528]: audit 2024-09-21T00:35:08.106433+0000 mon.a (mon.0) 5394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:35:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:08 smithi049 bash[23528]: audit 2024-09-21T00:35:08.116702+0000 mon.a (mon.0) 5395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:08 smithi049 bash[23528]: audit 2024-09-21T00:35:08.123289+0000 mon.a (mon.0) 5396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:35:08.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22676]: audit 2024-09-21T00:35:07.405480+0000 mgr.a (mgr.14388) 6082 : audit [DBG] from='client.140067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:08.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22676]: audit 2024-09-21T00:35:08.097683+0000 mon.a (mon.0) 5392 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:35:08.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22676]: audit 2024-09-21T00:35:08.104710+0000 mon.a (mon.0) 5393 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:35:08.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22676]: audit 2024-09-21T00:35:08.106433+0000 mon.a (mon.0) 5394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:35:08.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22676]: audit 2024-09-21T00:35:08.116702+0000 mon.a (mon.0) 5395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:08.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22676]: audit 2024-09-21T00:35:08.123289+0000 mon.a (mon.0) 5396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:35:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:08 smithi179 bash[23186]: audit 2024-09-21T00:35:07.405480+0000 mgr.a (mgr.14388) 6082 : audit [DBG] from='client.140067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:08 smithi179 bash[23186]: audit 2024-09-21T00:35:08.097683+0000 mon.a (mon.0) 5392 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:35:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:08 smithi179 bash[23186]: audit 2024-09-21T00:35:08.104710+0000 mon.a (mon.0) 5393 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:35:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:08 smithi179 bash[23186]: audit 2024-09-21T00:35:08.106433+0000 mon.a (mon.0) 5394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:35:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:08 smithi179 bash[23186]: audit 2024-09-21T00:35:08.116702+0000 mon.a (mon.0) 5395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:08 smithi179 bash[23186]: audit 2024-09-21T00:35:08.123289+0000 mon.a (mon.0) 5396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:35:09.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22930]: debug 2024-09-21T00:35:08.885+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:35:09.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:35:08 smithi044 bash[22930]: debug 2024-09-21T00:35:08.889+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:35:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:09 smithi049 bash[23528]: audit 2024-09-21T00:35:08.126027+0000 mgr.a (mgr.14388) 6083 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:35:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:09 smithi049 bash[23528]: cluster 2024-09-21T00:35:08.326070+0000 mgr.a (mgr.14388) 6084 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:09 smithi044 bash[22676]: audit 2024-09-21T00:35:08.126027+0000 mgr.a (mgr.14388) 6083 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:35:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:09 smithi044 bash[22676]: cluster 2024-09-21T00:35:08.326070+0000 mgr.a (mgr.14388) 6084 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:09 smithi179 bash[23186]: audit 2024-09-21T00:35:08.126027+0000 mgr.a (mgr.14388) 6083 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:35:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:09 smithi179 bash[23186]: cluster 2024-09-21T00:35:08.326070+0000 mgr.a (mgr.14388) 6084 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:10.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:10 smithi049 bash[23528]: audit 2024-09-21T00:35:08.887585+0000 mgr.a (mgr.14388) 6085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:35:10.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:10 smithi049 bash[23528]: cephadm 2024-09-21T00:35:08.889402+0000 mgr.a (mgr.14388) 6086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:35:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:10 smithi044 bash[22676]: audit 2024-09-21T00:35:08.887585+0000 mgr.a (mgr.14388) 6085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:35:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:10 smithi044 bash[22676]: cephadm 2024-09-21T00:35:08.889402+0000 mgr.a (mgr.14388) 6086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:35:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:10 smithi179 bash[23186]: audit 2024-09-21T00:35:08.887585+0000 mgr.a (mgr.14388) 6085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:35:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:10 smithi179 bash[23186]: cephadm 2024-09-21T00:35:08.889402+0000 mgr.a (mgr.14388) 6086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:35:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:11 smithi044 bash[22676]: cluster 2024-09-21T00:35:10.328303+0000 mgr.a (mgr.14388) 6087 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:11 smithi179 bash[23186]: cluster 2024-09-21T00:35:10.328303+0000 mgr.a (mgr.14388) 6087 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:12.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:11 smithi049 bash[23528]: cluster 2024-09-21T00:35:10.328303+0000 mgr.a (mgr.14388) 6087 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:12.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:12.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:13.607 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:13.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:13.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:13.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:13.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:13 smithi044 bash[22676]: cluster 2024-09-21T00:35:12.329082+0000 mgr.a (mgr.14388) 6088 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:13 smithi179 bash[23186]: cluster 2024-09-21T00:35:12.329082+0000 mgr.a (mgr.14388) 6088 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:14.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:13 smithi049 bash[23528]: cluster 2024-09-21T00:35:12.329082+0000 mgr.a (mgr.14388) 6088 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:14 smithi044 bash[22676]: audit 2024-09-21T00:35:13.163831+0000 mgr.a (mgr.14388) 6089 : audit [DBG] from='client.140250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:14 smithi179 bash[23186]: audit 2024-09-21T00:35:13.163831+0000 mgr.a (mgr.14388) 6089 : audit [DBG] from='client.140250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:15.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:14 smithi049 bash[23528]: audit 2024-09-21T00:35:13.163831+0000 mgr.a (mgr.14388) 6089 : audit [DBG] from='client.140250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:15 smithi044 bash[22676]: cluster 2024-09-21T00:35:14.330090+0000 mgr.a (mgr.14388) 6090 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:15 smithi179 bash[23186]: cluster 2024-09-21T00:35:14.330090+0000 mgr.a (mgr.14388) 6090 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:16.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:15 smithi049 bash[23528]: cluster 2024-09-21T00:35:14.330090+0000 mgr.a (mgr.14388) 6090 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:17 smithi179 bash[23186]: cluster 2024-09-21T00:35:16.332364+0000 mgr.a (mgr.14388) 6091 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:17 smithi044 bash[22676]: cluster 2024-09-21T00:35:16.332364+0000 mgr.a (mgr.14388) 6091 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:18.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:17 smithi049 bash[23528]: cluster 2024-09-21T00:35:16.332364+0000 mgr.a (mgr.14388) 6091 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:18.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:18.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:18.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:19.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:19.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:19.886 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:19 smithi044 bash[22676]: cluster 2024-09-21T00:35:18.333182+0000 mgr.a (mgr.14388) 6092 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:19.976 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:19 smithi179 bash[23186]: cluster 2024-09-21T00:35:18.333182+0000 mgr.a (mgr.14388) 6092 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:19 smithi049 bash[23528]: cluster 2024-09-21T00:35:18.333182+0000 mgr.a (mgr.14388) 6092 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:20.837 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:20 smithi044 bash[22676]: audit 2024-09-21T00:35:18.942520+0000 mgr.a (mgr.14388) 6093 : audit [DBG] from='client.140325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:20.869 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:20 smithi179 bash[23186]: audit 2024-09-21T00:35:18.942520+0000 mgr.a (mgr.14388) 6093 : audit [DBG] from='client.140325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:20 smithi049 bash[23528]: audit 2024-09-21T00:35:18.942520+0000 mgr.a (mgr.14388) 6093 : audit [DBG] from='client.140325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:21 smithi044 bash[22676]: cluster 2024-09-21T00:35:20.335541+0000 mgr.a (mgr.14388) 6094 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:21 smithi044 bash[22676]: audit 2024-09-21T00:35:20.714106+0000 mon.a (mon.0) 5397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:21 smithi044 bash[22676]: audit 2024-09-21T00:35:20.720241+0000 mon.a (mon.0) 5398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:21 smithi044 bash[22676]: audit 2024-09-21T00:35:20.726469+0000 mon.a (mon.0) 5399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:21 smithi044 bash[22676]: audit 2024-09-21T00:35:21.340211+0000 mon.a (mon.0) 5400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:21 smithi044 bash[22676]: audit 2024-09-21T00:35:21.350193+0000 mon.a (mon.0) 5401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:21.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:21 smithi044 bash[22676]: audit 2024-09-21T00:35:21.360956+0000 mon.a (mon.0) 5402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:21 smithi179 bash[23186]: cluster 2024-09-21T00:35:20.335541+0000 mgr.a (mgr.14388) 6094 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:21 smithi179 bash[23186]: audit 2024-09-21T00:35:20.714106+0000 mon.a (mon.0) 5397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:21 smithi179 bash[23186]: audit 2024-09-21T00:35:20.720241+0000 mon.a (mon.0) 5398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:21 smithi179 bash[23186]: audit 2024-09-21T00:35:20.726469+0000 mon.a (mon.0) 5399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:21 smithi179 bash[23186]: audit 2024-09-21T00:35:21.340211+0000 mon.a (mon.0) 5400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:21 smithi179 bash[23186]: audit 2024-09-21T00:35:21.350193+0000 mon.a (mon.0) 5401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:21 smithi179 bash[23186]: audit 2024-09-21T00:35:21.360956+0000 mon.a (mon.0) 5402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:21 smithi049 bash[23528]: cluster 2024-09-21T00:35:20.335541+0000 mgr.a (mgr.14388) 6094 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:35:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:21 smithi049 bash[23528]: audit 2024-09-21T00:35:20.714106+0000 mon.a (mon.0) 5397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:21 smithi049 bash[23528]: audit 2024-09-21T00:35:20.720241+0000 mon.a (mon.0) 5398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:21 smithi049 bash[23528]: audit 2024-09-21T00:35:20.726469+0000 mon.a (mon.0) 5399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:21 smithi049 bash[23528]: audit 2024-09-21T00:35:21.340211+0000 mon.a (mon.0) 5400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:21 smithi049 bash[23528]: audit 2024-09-21T00:35:21.350193+0000 mon.a (mon.0) 5401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:21 smithi049 bash[23528]: audit 2024-09-21T00:35:21.360956+0000 mon.a (mon.0) 5402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:23 smithi044 bash[22676]: cluster 2024-09-21T00:35:22.336356+0000 mgr.a (mgr.14388) 6095 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:23 smithi044 bash[22676]: audit 2024-09-21T00:35:22.692804+0000 mon.a (mon.0) 5403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:23 smithi044 bash[22676]: audit 2024-09-21T00:35:22.698485+0000 mon.a (mon.0) 5404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:23 smithi044 bash[22676]: audit 2024-09-21T00:35:22.704305+0000 mon.a (mon.0) 5405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:23 smithi179 bash[23186]: cluster 2024-09-21T00:35:22.336356+0000 mgr.a (mgr.14388) 6095 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:23 smithi179 bash[23186]: audit 2024-09-21T00:35:22.692804+0000 mon.a (mon.0) 5403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:23 smithi179 bash[23186]: audit 2024-09-21T00:35:22.698485+0000 mon.a (mon.0) 5404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:23 smithi179 bash[23186]: audit 2024-09-21T00:35:22.704305+0000 mon.a (mon.0) 5405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:24.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:23 smithi049 bash[23528]: cluster 2024-09-21T00:35:22.336356+0000 mgr.a (mgr.14388) 6095 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:23 smithi049 bash[23528]: audit 2024-09-21T00:35:22.692804+0000 mon.a (mon.0) 5403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:23 smithi049 bash[23528]: audit 2024-09-21T00:35:22.698485+0000 mon.a (mon.0) 5404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:23 smithi049 bash[23528]: audit 2024-09-21T00:35:22.704305+0000 mon.a (mon.0) 5405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:24.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:24.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:24.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:25.124 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:25.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:25 smithi044 bash[22676]: cluster 2024-09-21T00:35:24.337153+0000 mgr.a (mgr.14388) 6096 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:25 smithi044 bash[22676]: audit 2024-09-21T00:35:24.695149+0000 mgr.a (mgr.14388) 6097 : audit [DBG] from='client.140400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:25 smithi179 bash[23186]: cluster 2024-09-21T00:35:24.337153+0000 mgr.a (mgr.14388) 6096 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:25 smithi179 bash[23186]: audit 2024-09-21T00:35:24.695149+0000 mgr.a (mgr.14388) 6097 : audit [DBG] from='client.140400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:26.003 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:25 smithi049 bash[23528]: cluster 2024-09-21T00:35:24.337153+0000 mgr.a (mgr.14388) 6096 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:26.003 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:25 smithi049 bash[23528]: audit 2024-09-21T00:35:24.695149+0000 mgr.a (mgr.14388) 6097 : audit [DBG] from='client.140400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:27 smithi044 bash[22676]: cluster 2024-09-21T00:35:26.339877+0000 mgr.a (mgr.14388) 6098 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:35:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:27 smithi179 bash[23186]: cluster 2024-09-21T00:35:26.339877+0000 mgr.a (mgr.14388) 6098 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:35:28.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:27 smithi049 bash[23528]: cluster 2024-09-21T00:35:26.339877+0000 mgr.a (mgr.14388) 6098 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:35:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:29 smithi044 bash[22676]: cluster 2024-09-21T00:35:28.340629+0000 mgr.a (mgr.14388) 6099 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:35:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:29 smithi179 bash[23186]: cluster 2024-09-21T00:35:28.340629+0000 mgr.a (mgr.14388) 6099 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:35:30.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:29 smithi049 bash[23528]: cluster 2024-09-21T00:35:28.340629+0000 mgr.a (mgr.14388) 6099 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:35:30.125 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:30.126 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:31 smithi044 bash[22676]: cluster 2024-09-21T00:35:30.342606+0000 mgr.a (mgr.14388) 6100 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:31 smithi044 bash[22676]: audit 2024-09-21T00:35:30.467397+0000 mgr.a (mgr.14388) 6101 : audit [DBG] from='client.140478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:31 smithi179 bash[23186]: cluster 2024-09-21T00:35:30.342606+0000 mgr.a (mgr.14388) 6100 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:31 smithi179 bash[23186]: audit 2024-09-21T00:35:30.467397+0000 mgr.a (mgr.14388) 6101 : audit [DBG] from='client.140478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:32.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:31 smithi049 bash[23528]: cluster 2024-09-21T00:35:30.342606+0000 mgr.a (mgr.14388) 6100 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:31 smithi049 bash[23528]: audit 2024-09-21T00:35:30.467397+0000 mgr.a (mgr.14388) 6101 : audit [DBG] from='client.140478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:33 smithi044 bash[22676]: cluster 2024-09-21T00:35:32.343477+0000 mgr.a (mgr.14388) 6102 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:35:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:33 smithi179 bash[23186]: cluster 2024-09-21T00:35:32.343477+0000 mgr.a (mgr.14388) 6102 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:35:34.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:33 smithi049 bash[23528]: cluster 2024-09-21T00:35:32.343477+0000 mgr.a (mgr.14388) 6102 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:35:35.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:35.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:35.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:35 smithi044 bash[22676]: cluster 2024-09-21T00:35:34.344296+0000 mgr.a (mgr.14388) 6103 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:35:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:35 smithi179 bash[23186]: cluster 2024-09-21T00:35:34.344296+0000 mgr.a (mgr.14388) 6103 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:35:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:35 smithi049 bash[23528]: cluster 2024-09-21T00:35:34.344296+0000 mgr.a (mgr.14388) 6103 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:35:36.682 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:37 smithi044 bash[22676]: audit 2024-09-21T00:35:36.253129+0000 mgr.a (mgr.14388) 6104 : audit [DBG] from='client.140553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:37 smithi044 bash[22676]: cluster 2024-09-21T00:35:36.345556+0000 mgr.a (mgr.14388) 6105 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:37 smithi179 bash[23186]: audit 2024-09-21T00:35:36.253129+0000 mgr.a (mgr.14388) 6104 : audit [DBG] from='client.140553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:37 smithi179 bash[23186]: cluster 2024-09-21T00:35:36.345556+0000 mgr.a (mgr.14388) 6105 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:37 smithi049 bash[23528]: audit 2024-09-21T00:35:36.253129+0000 mgr.a (mgr.14388) 6104 : audit [DBG] from='client.140553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:37 smithi049 bash[23528]: cluster 2024-09-21T00:35:36.345556+0000 mgr.a (mgr.14388) 6105 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:39 smithi044 bash[22676]: cluster 2024-09-21T00:35:38.346431+0000 mgr.a (mgr.14388) 6106 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:35:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:39 smithi179 bash[23186]: cluster 2024-09-21T00:35:38.346431+0000 mgr.a (mgr.14388) 6106 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:35:40.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:39 smithi049 bash[23528]: cluster 2024-09-21T00:35:38.346431+0000 mgr.a (mgr.14388) 6106 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:35:41.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:41.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:41.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:41 smithi044 bash[22676]: cluster 2024-09-21T00:35:40.347822+0000 mgr.a (mgr.14388) 6107 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:41 smithi044 bash[22676]: audit 2024-09-21T00:35:40.885659+0000 mon.a (mon.0) 5406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:41 smithi044 bash[22676]: audit 2024-09-21T00:35:40.895468+0000 mon.a (mon.0) 5407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:41 smithi044 bash[22676]: audit 2024-09-21T00:35:40.906492+0000 mon.a (mon.0) 5408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:41 smithi044 bash[22676]: audit 2024-09-21T00:35:41.551746+0000 mon.a (mon.0) 5409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:41 smithi044 bash[22676]: audit 2024-09-21T00:35:41.556986+0000 mon.a (mon.0) 5410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:41 smithi044 bash[22676]: audit 2024-09-21T00:35:41.562536+0000 mon.a (mon.0) 5411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:41 smithi179 bash[23186]: cluster 2024-09-21T00:35:40.347822+0000 mgr.a (mgr.14388) 6107 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:35:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:41 smithi179 bash[23186]: audit 2024-09-21T00:35:40.885659+0000 mon.a (mon.0) 5406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:41 smithi179 bash[23186]: audit 2024-09-21T00:35:40.895468+0000 mon.a (mon.0) 5407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:41 smithi179 bash[23186]: audit 2024-09-21T00:35:40.906492+0000 mon.a (mon.0) 5408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:41 smithi179 bash[23186]: audit 2024-09-21T00:35:41.551746+0000 mon.a (mon.0) 5409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:41 smithi179 bash[23186]: audit 2024-09-21T00:35:41.556986+0000 mon.a (mon.0) 5410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:41 smithi179 bash[23186]: audit 2024-09-21T00:35:41.562536+0000 mon.a (mon.0) 5411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:41 smithi049 bash[23528]: cluster 2024-09-21T00:35:40.347822+0000 mgr.a (mgr.14388) 6107 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:35:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:41 smithi049 bash[23528]: audit 2024-09-21T00:35:40.885659+0000 mon.a (mon.0) 5406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:41 smithi049 bash[23528]: audit 2024-09-21T00:35:40.895468+0000 mon.a (mon.0) 5407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:41 smithi049 bash[23528]: audit 2024-09-21T00:35:40.906492+0000 mon.a (mon.0) 5408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:41 smithi049 bash[23528]: audit 2024-09-21T00:35:41.551746+0000 mon.a (mon.0) 5409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:41 smithi049 bash[23528]: audit 2024-09-21T00:35:41.556986+0000 mon.a (mon.0) 5410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:41 smithi049 bash[23528]: audit 2024-09-21T00:35:41.562536+0000 mon.a (mon.0) 5411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:42.450 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:43 smithi044 bash[22676]: audit 2024-09-21T00:35:42.018469+0000 mgr.a (mgr.14388) 6108 : audit [DBG] from='client.140628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:43 smithi044 bash[22676]: cluster 2024-09-21T00:35:42.348587+0000 mgr.a (mgr.14388) 6109 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:43 smithi044 bash[22676]: audit 2024-09-21T00:35:42.845839+0000 mon.a (mon.0) 5412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:43 smithi044 bash[22676]: audit 2024-09-21T00:35:42.850893+0000 mon.a (mon.0) 5413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:43 smithi044 bash[22676]: audit 2024-09-21T00:35:42.856345+0000 mon.a (mon.0) 5414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:43 smithi179 bash[23186]: audit 2024-09-21T00:35:42.018469+0000 mgr.a (mgr.14388) 6108 : audit [DBG] from='client.140628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:43 smithi179 bash[23186]: cluster 2024-09-21T00:35:42.348587+0000 mgr.a (mgr.14388) 6109 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:43 smithi179 bash[23186]: audit 2024-09-21T00:35:42.845839+0000 mon.a (mon.0) 5412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:43 smithi179 bash[23186]: audit 2024-09-21T00:35:42.850893+0000 mon.a (mon.0) 5413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:43 smithi179 bash[23186]: audit 2024-09-21T00:35:42.856345+0000 mon.a (mon.0) 5414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:43 smithi049 bash[23528]: audit 2024-09-21T00:35:42.018469+0000 mgr.a (mgr.14388) 6108 : audit [DBG] from='client.140628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:43 smithi049 bash[23528]: cluster 2024-09-21T00:35:42.348587+0000 mgr.a (mgr.14388) 6109 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:43 smithi049 bash[23528]: audit 2024-09-21T00:35:42.845839+0000 mon.a (mon.0) 5412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:43 smithi049 bash[23528]: audit 2024-09-21T00:35:42.850893+0000 mon.a (mon.0) 5413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:43 smithi049 bash[23528]: audit 2024-09-21T00:35:42.856345+0000 mon.a (mon.0) 5414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:35:45.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:45 smithi049 bash[23528]: cluster 2024-09-21T00:35:44.349457+0000 mgr.a (mgr.14388) 6110 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:45 smithi179 bash[23186]: cluster 2024-09-21T00:35:44.349457+0000 mgr.a (mgr.14388) 6110 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:45 smithi044 bash[22676]: cluster 2024-09-21T00:35:44.349457+0000 mgr.a (mgr.14388) 6110 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:47.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:47.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:47.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:47 smithi179 bash[23186]: cluster 2024-09-21T00:35:46.351646+0000 mgr.a (mgr.14388) 6111 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:35:48.024 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:47 smithi049 bash[23528]: cluster 2024-09-21T00:35:46.351646+0000 mgr.a (mgr.14388) 6111 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:35:48.230 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:48.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:47 smithi044 bash[22676]: cluster 2024-09-21T00:35:46.351646+0000 mgr.a (mgr.14388) 6111 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:35:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:49 smithi179 bash[23186]: audit 2024-09-21T00:35:47.790094+0000 mgr.a (mgr.14388) 6112 : audit [DBG] from='client.140703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:49 smithi179 bash[23186]: cluster 2024-09-21T00:35:48.352571+0000 mgr.a (mgr.14388) 6113 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:49 smithi049 bash[23528]: audit 2024-09-21T00:35:47.790094+0000 mgr.a (mgr.14388) 6112 : audit [DBG] from='client.140703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:49 smithi049 bash[23528]: cluster 2024-09-21T00:35:48.352571+0000 mgr.a (mgr.14388) 6113 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:50.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:49 smithi044 bash[22676]: audit 2024-09-21T00:35:47.790094+0000 mgr.a (mgr.14388) 6112 : audit [DBG] from='client.140703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:49 smithi044 bash[22676]: cluster 2024-09-21T00:35:48.352571+0000 mgr.a (mgr.14388) 6113 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:35:51.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:50 smithi049 bash[23528]: cluster 2024-09-21T00:35:50.354874+0000 mgr.a (mgr.14388) 6114 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:35:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:50 smithi044 bash[22676]: cluster 2024-09-21T00:35:50.354874+0000 mgr.a (mgr.14388) 6114 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:35:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:50 smithi179 bash[23186]: cluster 2024-09-21T00:35:50.354874+0000 mgr.a (mgr.14388) 6114 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:35:53.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:53.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:53.233 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:53 smithi044 bash[22676]: cluster 2024-09-21T00:35:52.355757+0000 mgr.a (mgr.14388) 6115 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:53 smithi179 bash[23186]: cluster 2024-09-21T00:35:52.355757+0000 mgr.a (mgr.14388) 6115 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:53.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:53 smithi049 bash[23528]: cluster 2024-09-21T00:35:52.355757+0000 mgr.a (mgr.14388) 6115 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:53.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:53.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:53.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:53.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:53.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:54 smithi044 bash[22676]: audit 2024-09-21T00:35:53.566927+0000 mgr.a (mgr.14388) 6116 : audit [DBG] from='client.140781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:54 smithi179 bash[23186]: audit 2024-09-21T00:35:53.566927+0000 mgr.a (mgr.14388) 6116 : audit [DBG] from='client.140781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:54.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:54 smithi049 bash[23528]: audit 2024-09-21T00:35:53.566927+0000 mgr.a (mgr.14388) 6116 : audit [DBG] from='client.140781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:35:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:55 smithi044 bash[22676]: cluster 2024-09-21T00:35:54.356738+0000 mgr.a (mgr.14388) 6117 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:55 smithi179 bash[23186]: cluster 2024-09-21T00:35:54.356738+0000 mgr.a (mgr.14388) 6117 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:55.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:55 smithi049 bash[23528]: cluster 2024-09-21T00:35:54.356738+0000 mgr.a (mgr.14388) 6117 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:57 smithi044 bash[22676]: cluster 2024-09-21T00:35:56.359036+0000 mgr.a (mgr.14388) 6118 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:35:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:57 smithi179 bash[23186]: cluster 2024-09-21T00:35:56.359036+0000 mgr.a (mgr.14388) 6118 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:35:57.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:57 smithi049 bash[23528]: cluster 2024-09-21T00:35:56.359036+0000 mgr.a (mgr.14388) 6118 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:35:58.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:35:58.980 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:35:58.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:35:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:35:59 smithi044 bash[22676]: cluster 2024-09-21T00:35:58.359831+0000 mgr.a (mgr.14388) 6119 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:35:59 smithi179 bash[23186]: cluster 2024-09-21T00:35:58.359831+0000 mgr.a (mgr.14388) 6119 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:35:59.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:35:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:35:59.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:35:59 smithi049 bash[23528]: cluster 2024-09-21T00:35:58.359831+0000 mgr.a (mgr.14388) 6119 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:36:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:00 smithi044 bash[22676]: audit 2024-09-21T00:35:59.316910+0000 mgr.a (mgr.14388) 6120 : audit [DBG] from='client.140856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:00 smithi179 bash[23186]: audit 2024-09-21T00:35:59.316910+0000 mgr.a (mgr.14388) 6120 : audit [DBG] from='client.140856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:00.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:00 smithi049 bash[23528]: audit 2024-09-21T00:35:59.316910+0000 mgr.a (mgr.14388) 6120 : audit [DBG] from='client.140856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:01 smithi044 bash[22676]: cluster 2024-09-21T00:36:00.362325+0000 mgr.a (mgr.14388) 6121 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T00:36:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:01 smithi044 bash[22676]: audit 2024-09-21T00:36:01.055229+0000 mon.a (mon.0) 5415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:01 smithi044 bash[22676]: audit 2024-09-21T00:36:01.060361+0000 mon.a (mon.0) 5416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:01 smithi044 bash[22676]: audit 2024-09-21T00:36:01.065587+0000 mon.a (mon.0) 5417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:01 smithi179 bash[23186]: cluster 2024-09-21T00:36:00.362325+0000 mgr.a (mgr.14388) 6121 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T00:36:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:01 smithi179 bash[23186]: audit 2024-09-21T00:36:01.055229+0000 mon.a (mon.0) 5415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:01 smithi179 bash[23186]: audit 2024-09-21T00:36:01.060361+0000 mon.a (mon.0) 5416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:01 smithi179 bash[23186]: audit 2024-09-21T00:36:01.065587+0000 mon.a (mon.0) 5417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:01 smithi049 bash[23528]: cluster 2024-09-21T00:36:00.362325+0000 mgr.a (mgr.14388) 6121 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T00:36:01.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:01 smithi049 bash[23528]: audit 2024-09-21T00:36:01.055229+0000 mon.a (mon.0) 5415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:01 smithi049 bash[23528]: audit 2024-09-21T00:36:01.060361+0000 mon.a (mon.0) 5416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:01.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:01 smithi049 bash[23528]: audit 2024-09-21T00:36:01.065587+0000 mon.a (mon.0) 5417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.023 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:02 smithi044 bash[22676]: audit 2024-09-21T00:36:01.755276+0000 mon.a (mon.0) 5418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.024 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:02 smithi044 bash[22676]: audit 2024-09-21T00:36:01.765350+0000 mon.a (mon.0) 5419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.024 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:02 smithi044 bash[22676]: audit 2024-09-21T00:36:01.777092+0000 mon.a (mon.0) 5420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.024 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:02 smithi044 bash[22676]: cluster 2024-09-21T00:36:02.363187+0000 mgr.a (mgr.14388) 6122 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:03.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:02 smithi049 bash[23528]: audit 2024-09-21T00:36:01.755276+0000 mon.a (mon.0) 5418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:02 smithi049 bash[23528]: audit 2024-09-21T00:36:01.765350+0000 mon.a (mon.0) 5419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:02 smithi049 bash[23528]: audit 2024-09-21T00:36:01.777092+0000 mon.a (mon.0) 5420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:02 smithi049 bash[23528]: cluster 2024-09-21T00:36:02.363187+0000 mgr.a (mgr.14388) 6122 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:02 smithi179 bash[23186]: audit 2024-09-21T00:36:01.755276+0000 mon.a (mon.0) 5418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:02 smithi179 bash[23186]: audit 2024-09-21T00:36:01.765350+0000 mon.a (mon.0) 5419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:02 smithi179 bash[23186]: audit 2024-09-21T00:36:01.777092+0000 mon.a (mon.0) 5420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:02 smithi179 bash[23186]: cluster 2024-09-21T00:36:02.363187+0000 mgr.a (mgr.14388) 6122 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:04 smithi049 bash[23528]: audit 2024-09-21T00:36:03.010129+0000 mon.a (mon.0) 5421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:04 smithi049 bash[23528]: audit 2024-09-21T00:36:03.016963+0000 mon.a (mon.0) 5422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:04 smithi049 bash[23528]: audit 2024-09-21T00:36:03.022921+0000 mon.a (mon.0) 5423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:04 smithi044 bash[22676]: audit 2024-09-21T00:36:03.010129+0000 mon.a (mon.0) 5421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:04 smithi044 bash[22676]: audit 2024-09-21T00:36:03.016963+0000 mon.a (mon.0) 5422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:04 smithi044 bash[22676]: audit 2024-09-21T00:36:03.022921+0000 mon.a (mon.0) 5423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:04 smithi179 bash[23186]: audit 2024-09-21T00:36:03.010129+0000 mon.a (mon.0) 5421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:04 smithi179 bash[23186]: audit 2024-09-21T00:36:03.016963+0000 mon.a (mon.0) 5422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:04 smithi179 bash[23186]: audit 2024-09-21T00:36:03.022921+0000 mon.a (mon.0) 5423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:05.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:05 smithi049 bash[23528]: cluster 2024-09-21T00:36:04.364133+0000 mgr.a (mgr.14388) 6123 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:05 smithi044 bash[22676]: cluster 2024-09-21T00:36:04.364133+0000 mgr.a (mgr.14388) 6123 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:05 smithi179 bash[23186]: cluster 2024-09-21T00:36:04.364133+0000 mgr.a (mgr.14388) 6123 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:05.543 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:05.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:06.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:06 smithi049 bash[23528]: audit 2024-09-21T00:36:05.107518+0000 mgr.a (mgr.14388) 6124 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:06 smithi044 bash[22676]: audit 2024-09-21T00:36:05.107518+0000 mgr.a (mgr.14388) 6124 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:06 smithi179 bash[23186]: audit 2024-09-21T00:36:05.107518+0000 mgr.a (mgr.14388) 6124 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:07.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:07 smithi049 bash[23528]: cluster 2024-09-21T00:36:06.368017+0000 mgr.a (mgr.14388) 6125 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:07 smithi044 bash[22676]: cluster 2024-09-21T00:36:06.368017+0000 mgr.a (mgr.14388) 6125 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:07 smithi179 bash[23186]: cluster 2024-09-21T00:36:06.368017+0000 mgr.a (mgr.14388) 6125 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T00:36:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22676]: cluster 2024-09-21T00:36:08.368834+0000 mgr.a (mgr.14388) 6126 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:36:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22676]: audit 2024-09-21T00:36:08.965522+0000 mon.a (mon.0) 5424 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:36:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22676]: audit 2024-09-21T00:36:08.972853+0000 mon.a (mon.0) 5425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:36:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22676]: audit 2024-09-21T00:36:08.974951+0000 mon.a (mon.0) 5426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:36:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22676]: audit 2024-09-21T00:36:08.986731+0000 mon.a (mon.0) 5427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22676]: audit 2024-09-21T00:36:08.993117+0000 mon.a (mon.0) 5428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:36:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:09 smithi179 bash[23186]: cluster 2024-09-21T00:36:08.368834+0000 mgr.a (mgr.14388) 6126 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:36:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:09 smithi179 bash[23186]: audit 2024-09-21T00:36:08.965522+0000 mon.a (mon.0) 5424 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:36:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:09 smithi179 bash[23186]: audit 2024-09-21T00:36:08.972853+0000 mon.a (mon.0) 5425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:36:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:09 smithi179 bash[23186]: audit 2024-09-21T00:36:08.974951+0000 mon.a (mon.0) 5426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:36:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:09 smithi179 bash[23186]: audit 2024-09-21T00:36:08.986731+0000 mon.a (mon.0) 5427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:09.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:09 smithi179 bash[23186]: audit 2024-09-21T00:36:08.993117+0000 mon.a (mon.0) 5428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:36:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:09 smithi049 bash[23528]: cluster 2024-09-21T00:36:08.368834+0000 mgr.a (mgr.14388) 6126 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:36:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:09 smithi049 bash[23528]: audit 2024-09-21T00:36:08.965522+0000 mon.a (mon.0) 5424 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:36:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:09 smithi049 bash[23528]: audit 2024-09-21T00:36:08.972853+0000 mon.a (mon.0) 5425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:36:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:09 smithi049 bash[23528]: audit 2024-09-21T00:36:08.974951+0000 mon.a (mon.0) 5426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:36:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:09 smithi049 bash[23528]: audit 2024-09-21T00:36:08.986731+0000 mon.a (mon.0) 5427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:09 smithi049 bash[23528]: audit 2024-09-21T00:36:08.993117+0000 mon.a (mon.0) 5428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:36:10.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22930]: debug 2024-09-21T00:36:09.760+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:36:10.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:36:09 smithi044 bash[22930]: debug 2024-09-21T00:36:09.760+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:36:10.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:10 smithi044 bash[22676]: audit 2024-09-21T00:36:08.995619+0000 mgr.a (mgr.14388) 6127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:36:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:10 smithi179 bash[23186]: audit 2024-09-21T00:36:08.995619+0000 mgr.a (mgr.14388) 6127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:36:10.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:10 smithi049 bash[23528]: audit 2024-09-21T00:36:08.995619+0000 mgr.a (mgr.14388) 6127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:36:11.311 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:11 smithi044 bash[22676]: audit 2024-09-21T00:36:09.761430+0000 mgr.a (mgr.14388) 6128 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:36:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:11 smithi044 bash[22676]: cephadm 2024-09-21T00:36:09.762639+0000 mgr.a (mgr.14388) 6129 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:36:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:11 smithi044 bash[22676]: cluster 2024-09-21T00:36:10.371128+0000 mgr.a (mgr.14388) 6130 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T00:36:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:11 smithi179 bash[23186]: audit 2024-09-21T00:36:09.761430+0000 mgr.a (mgr.14388) 6128 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:36:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:11 smithi179 bash[23186]: cephadm 2024-09-21T00:36:09.762639+0000 mgr.a (mgr.14388) 6129 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:36:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:11 smithi179 bash[23186]: cluster 2024-09-21T00:36:10.371128+0000 mgr.a (mgr.14388) 6130 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T00:36:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:11 smithi049 bash[23528]: audit 2024-09-21T00:36:09.761430+0000 mgr.a (mgr.14388) 6128 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:36:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:11 smithi049 bash[23528]: cephadm 2024-09-21T00:36:09.762639+0000 mgr.a (mgr.14388) 6129 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:36:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:11 smithi049 bash[23528]: cluster 2024-09-21T00:36:10.371128+0000 mgr.a (mgr.14388) 6130 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T00:36:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:12 smithi044 bash[22676]: audit 2024-09-21T00:36:10.877884+0000 mgr.a (mgr.14388) 6131 : audit [DBG] from='client.141117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:12 smithi179 bash[23186]: audit 2024-09-21T00:36:10.877884+0000 mgr.a (mgr.14388) 6131 : audit [DBG] from='client.141117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:12.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:12 smithi049 bash[23528]: audit 2024-09-21T00:36:10.877884+0000 mgr.a (mgr.14388) 6131 : audit [DBG] from='client.141117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:13 smithi044 bash[22676]: cluster 2024-09-21T00:36:12.372033+0000 mgr.a (mgr.14388) 6132 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:36:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:13 smithi179 bash[23186]: cluster 2024-09-21T00:36:12.372033+0000 mgr.a (mgr.14388) 6132 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:36:13.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:13 smithi049 bash[23528]: cluster 2024-09-21T00:36:12.372033+0000 mgr.a (mgr.14388) 6132 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:36:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:15 smithi044 bash[22676]: cluster 2024-09-21T00:36:14.372935+0000 mgr.a (mgr.14388) 6133 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:36:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:15 smithi179 bash[23186]: cluster 2024-09-21T00:36:14.372935+0000 mgr.a (mgr.14388) 6133 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:36:15.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:15 smithi049 bash[23528]: cluster 2024-09-21T00:36:14.372935+0000 mgr.a (mgr.14388) 6133 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:36:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:17.060 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:17 smithi044 bash[22676]: cluster 2024-09-21T00:36:16.374518+0000 mgr.a (mgr.14388) 6134 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:17 smithi044 bash[22676]: audit 2024-09-21T00:36:16.637944+0000 mgr.a (mgr.14388) 6135 : audit [DBG] from='client.141195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:17 smithi179 bash[23186]: cluster 2024-09-21T00:36:16.374518+0000 mgr.a (mgr.14388) 6134 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:17 smithi179 bash[23186]: audit 2024-09-21T00:36:16.637944+0000 mgr.a (mgr.14388) 6135 : audit [DBG] from='client.141195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:17.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:17 smithi049 bash[23528]: cluster 2024-09-21T00:36:16.374518+0000 mgr.a (mgr.14388) 6134 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:17.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:17 smithi049 bash[23528]: audit 2024-09-21T00:36:16.637944+0000 mgr.a (mgr.14388) 6135 : audit [DBG] from='client.141195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:19 smithi044 bash[22676]: cluster 2024-09-21T00:36:18.375352+0000 mgr.a (mgr.14388) 6136 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:19 smithi179 bash[23186]: cluster 2024-09-21T00:36:18.375352+0000 mgr.a (mgr.14388) 6136 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:19.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:19 smithi049 bash[23528]: cluster 2024-09-21T00:36:18.375352+0000 mgr.a (mgr.14388) 6136 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:21 smithi044 bash[22676]: cluster 2024-09-21T00:36:20.376576+0000 mgr.a (mgr.14388) 6137 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:21 smithi044 bash[22676]: audit 2024-09-21T00:36:21.239475+0000 mon.a (mon.0) 5429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:21 smithi044 bash[22676]: audit 2024-09-21T00:36:21.244646+0000 mon.a (mon.0) 5430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:21 smithi044 bash[22676]: audit 2024-09-21T00:36:21.251165+0000 mon.a (mon.0) 5431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:21 smithi179 bash[23186]: cluster 2024-09-21T00:36:20.376576+0000 mgr.a (mgr.14388) 6137 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:21 smithi179 bash[23186]: audit 2024-09-21T00:36:21.239475+0000 mon.a (mon.0) 5429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:21 smithi179 bash[23186]: audit 2024-09-21T00:36:21.244646+0000 mon.a (mon.0) 5430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:21 smithi179 bash[23186]: audit 2024-09-21T00:36:21.251165+0000 mon.a (mon.0) 5431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:21 smithi049 bash[23528]: cluster 2024-09-21T00:36:20.376576+0000 mgr.a (mgr.14388) 6137 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:36:21.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:21 smithi049 bash[23528]: audit 2024-09-21T00:36:21.239475+0000 mon.a (mon.0) 5429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:21 smithi049 bash[23528]: audit 2024-09-21T00:36:21.244646+0000 mon.a (mon.0) 5430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:21 smithi049 bash[23528]: audit 2024-09-21T00:36:21.251165+0000 mon.a (mon.0) 5431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:22.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:22.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:22.811 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:22.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:22.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:22.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:22.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:23.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:22 smithi044 bash[22676]: audit 2024-09-21T00:36:21.956763+0000 mon.a (mon.0) 5432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:22 smithi044 bash[22676]: audit 2024-09-21T00:36:21.966860+0000 mon.a (mon.0) 5433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:22 smithi044 bash[22676]: audit 2024-09-21T00:36:21.976366+0000 mon.a (mon.0) 5434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:22 smithi044 bash[22676]: cluster 2024-09-21T00:36:22.377319+0000 mgr.a (mgr.14388) 6138 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:23.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:22 smithi044 bash[22676]: audit 2024-09-21T00:36:22.388272+0000 mgr.a (mgr.14388) 6139 : audit [DBG] from='client.141270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:22 smithi179 bash[23186]: audit 2024-09-21T00:36:21.956763+0000 mon.a (mon.0) 5432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:22 smithi179 bash[23186]: audit 2024-09-21T00:36:21.966860+0000 mon.a (mon.0) 5433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:22 smithi179 bash[23186]: audit 2024-09-21T00:36:21.976366+0000 mon.a (mon.0) 5434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:22 smithi179 bash[23186]: cluster 2024-09-21T00:36:22.377319+0000 mgr.a (mgr.14388) 6138 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:22 smithi179 bash[23186]: audit 2024-09-21T00:36:22.388272+0000 mgr.a (mgr.14388) 6139 : audit [DBG] from='client.141270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:23.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:22 smithi049 bash[23528]: audit 2024-09-21T00:36:21.956763+0000 mon.a (mon.0) 5432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:22 smithi049 bash[23528]: audit 2024-09-21T00:36:21.966860+0000 mon.a (mon.0) 5433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:22 smithi049 bash[23528]: audit 2024-09-21T00:36:21.976366+0000 mon.a (mon.0) 5434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:22 smithi049 bash[23528]: cluster 2024-09-21T00:36:22.377319+0000 mgr.a (mgr.14388) 6138 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:22 smithi049 bash[23528]: audit 2024-09-21T00:36:22.388272+0000 mgr.a (mgr.14388) 6139 : audit [DBG] from='client.141270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:24 smithi044 bash[22676]: audit 2024-09-21T00:36:23.140300+0000 mon.a (mon.0) 5435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:24 smithi044 bash[22676]: audit 2024-09-21T00:36:23.146048+0000 mon.a (mon.0) 5436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:24 smithi044 bash[22676]: audit 2024-09-21T00:36:23.150770+0000 mon.a (mon.0) 5437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:24 smithi179 bash[23186]: audit 2024-09-21T00:36:23.140300+0000 mon.a (mon.0) 5435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:24 smithi179 bash[23186]: audit 2024-09-21T00:36:23.146048+0000 mon.a (mon.0) 5436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:24 smithi179 bash[23186]: audit 2024-09-21T00:36:23.150770+0000 mon.a (mon.0) 5437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:24 smithi049 bash[23528]: audit 2024-09-21T00:36:23.140300+0000 mon.a (mon.0) 5435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:24 smithi049 bash[23528]: audit 2024-09-21T00:36:23.146048+0000 mon.a (mon.0) 5436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:24.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:24 smithi049 bash[23528]: audit 2024-09-21T00:36:23.150770+0000 mon.a (mon.0) 5437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:25.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:25 smithi049 bash[23528]: cluster 2024-09-21T00:36:24.378177+0000 mgr.a (mgr.14388) 6140 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:25 smithi044 bash[22676]: cluster 2024-09-21T00:36:24.378177+0000 mgr.a (mgr.14388) 6140 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:25 smithi179 bash[23186]: cluster 2024-09-21T00:36:24.378177+0000 mgr.a (mgr.14388) 6140 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:27 smithi044 bash[22676]: cluster 2024-09-21T00:36:26.380378+0000 mgr.a (mgr.14388) 6141 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:27 smithi179 bash[23186]: cluster 2024-09-21T00:36:26.380378+0000 mgr.a (mgr.14388) 6141 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:27.755 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:27 smithi049 bash[23528]: cluster 2024-09-21T00:36:26.380378+0000 mgr.a (mgr.14388) 6141 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:27.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:27.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:27.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:28.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:28.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:29 smithi044 bash[22676]: audit 2024-09-21T00:36:28.146301+0000 mgr.a (mgr.14388) 6142 : audit [DBG] from='client.141345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:29 smithi044 bash[22676]: cluster 2024-09-21T00:36:28.381143+0000 mgr.a (mgr.14388) 6143 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:29 smithi179 bash[23186]: audit 2024-09-21T00:36:28.146301+0000 mgr.a (mgr.14388) 6142 : audit [DBG] from='client.141345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:29 smithi179 bash[23186]: cluster 2024-09-21T00:36:28.381143+0000 mgr.a (mgr.14388) 6143 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:29.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:29 smithi049 bash[23528]: audit 2024-09-21T00:36:28.146301+0000 mgr.a (mgr.14388) 6142 : audit [DBG] from='client.141345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:29.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:29 smithi049 bash[23528]: cluster 2024-09-21T00:36:28.381143+0000 mgr.a (mgr.14388) 6143 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:31 smithi044 bash[22676]: cluster 2024-09-21T00:36:30.383390+0000 mgr.a (mgr.14388) 6144 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:31 smithi179 bash[23186]: cluster 2024-09-21T00:36:30.383390+0000 mgr.a (mgr.14388) 6144 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:31.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:31 smithi049 bash[23528]: cluster 2024-09-21T00:36:30.383390+0000 mgr.a (mgr.14388) 6144 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:33.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:33.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:33.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:33 smithi044 bash[22676]: cluster 2024-09-21T00:36:32.384192+0000 mgr.a (mgr.14388) 6145 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:33 smithi179 bash[23186]: cluster 2024-09-21T00:36:32.384192+0000 mgr.a (mgr.14388) 6145 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:33.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:33 smithi049 bash[23528]: cluster 2024-09-21T00:36:32.384192+0000 mgr.a (mgr.14388) 6145 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:34.339 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:34.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:34.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:34.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:34.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:35 smithi044 bash[22676]: audit 2024-09-21T00:36:33.907915+0000 mgr.a (mgr.14388) 6146 : audit [DBG] from='client.141420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:35 smithi044 bash[22676]: cluster 2024-09-21T00:36:34.384965+0000 mgr.a (mgr.14388) 6147 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:35 smithi179 bash[23186]: audit 2024-09-21T00:36:33.907915+0000 mgr.a (mgr.14388) 6146 : audit [DBG] from='client.141420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:35 smithi179 bash[23186]: cluster 2024-09-21T00:36:34.384965+0000 mgr.a (mgr.14388) 6147 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:35.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:35 smithi049 bash[23528]: audit 2024-09-21T00:36:33.907915+0000 mgr.a (mgr.14388) 6146 : audit [DBG] from='client.141420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:35.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:35 smithi049 bash[23528]: cluster 2024-09-21T00:36:34.384965+0000 mgr.a (mgr.14388) 6147 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:37 smithi044 bash[22676]: cluster 2024-09-21T00:36:36.387139+0000 mgr.a (mgr.14388) 6148 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:37 smithi179 bash[23186]: cluster 2024-09-21T00:36:36.387139+0000 mgr.a (mgr.14388) 6148 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:37.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:37 smithi049 bash[23528]: cluster 2024-09-21T00:36:36.387139+0000 mgr.a (mgr.14388) 6148 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:36:39.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:39.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:39.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:39 smithi044 bash[22676]: cluster 2024-09-21T00:36:38.387877+0000 mgr.a (mgr.14388) 6149 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:39 smithi179 bash[23186]: cluster 2024-09-21T00:36:38.387877+0000 mgr.a (mgr.14388) 6149 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:39.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:39 smithi049 bash[23528]: cluster 2024-09-21T00:36:38.387877+0000 mgr.a (mgr.14388) 6149 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:40.095 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:40.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:40.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:40.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:40.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:40.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:40 smithi179 bash[23186]: audit 2024-09-21T00:36:39.671753+0000 mgr.a (mgr.14388) 6150 : audit [DBG] from='client.141498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:40 smithi044 bash[22676]: audit 2024-09-21T00:36:39.671753+0000 mgr.a (mgr.14388) 6150 : audit [DBG] from='client.141498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:40.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:40 smithi049 bash[23528]: audit 2024-09-21T00:36:39.671753+0000 mgr.a (mgr.14388) 6150 : audit [DBG] from='client.141498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:41.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:41 smithi044 bash[22676]: cluster 2024-09-21T00:36:40.390680+0000 mgr.a (mgr.14388) 6151 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:36:41.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:41 smithi044 bash[22676]: audit 2024-09-21T00:36:41.429797+0000 mon.a (mon.0) 5438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:41 smithi044 bash[22676]: audit 2024-09-21T00:36:41.434930+0000 mon.a (mon.0) 5439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:41 smithi044 bash[22676]: audit 2024-09-21T00:36:41.440940+0000 mon.a (mon.0) 5440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:41 smithi179 bash[23186]: cluster 2024-09-21T00:36:40.390680+0000 mgr.a (mgr.14388) 6151 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:36:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:41 smithi179 bash[23186]: audit 2024-09-21T00:36:41.429797+0000 mon.a (mon.0) 5438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:41 smithi179 bash[23186]: audit 2024-09-21T00:36:41.434930+0000 mon.a (mon.0) 5439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:41 smithi179 bash[23186]: audit 2024-09-21T00:36:41.440940+0000 mon.a (mon.0) 5440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:41 smithi049 bash[23528]: cluster 2024-09-21T00:36:40.390680+0000 mgr.a (mgr.14388) 6151 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:36:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:41 smithi049 bash[23528]: audit 2024-09-21T00:36:41.429797+0000 mon.a (mon.0) 5438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:41 smithi049 bash[23528]: audit 2024-09-21T00:36:41.434930+0000 mon.a (mon.0) 5439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:41.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:41 smithi049 bash[23528]: audit 2024-09-21T00:36:41.440940+0000 mon.a (mon.0) 5440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:43 smithi044 bash[22676]: audit 2024-09-21T00:36:42.184372+0000 mon.a (mon.0) 5441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:43 smithi044 bash[22676]: audit 2024-09-21T00:36:42.192964+0000 mon.a (mon.0) 5442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:43 smithi044 bash[22676]: audit 2024-09-21T00:36:42.202923+0000 mon.a (mon.0) 5443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:43 smithi044 bash[22676]: cluster 2024-09-21T00:36:42.391409+0000 mgr.a (mgr.14388) 6152 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:36:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:43 smithi179 bash[23186]: audit 2024-09-21T00:36:42.184372+0000 mon.a (mon.0) 5441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:43 smithi179 bash[23186]: audit 2024-09-21T00:36:42.192964+0000 mon.a (mon.0) 5442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:43 smithi179 bash[23186]: audit 2024-09-21T00:36:42.202923+0000 mon.a (mon.0) 5443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:43 smithi179 bash[23186]: cluster 2024-09-21T00:36:42.391409+0000 mgr.a (mgr.14388) 6152 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:36:43.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:43 smithi049 bash[23528]: audit 2024-09-21T00:36:42.184372+0000 mon.a (mon.0) 5441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:43 smithi049 bash[23528]: audit 2024-09-21T00:36:42.192964+0000 mon.a (mon.0) 5442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:43 smithi049 bash[23528]: audit 2024-09-21T00:36:42.202923+0000 mon.a (mon.0) 5443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:43.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:43 smithi049 bash[23528]: cluster 2024-09-21T00:36:42.391409+0000 mgr.a (mgr.14388) 6152 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:36:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:44 smithi044 bash[22676]: audit 2024-09-21T00:36:43.319984+0000 mon.a (mon.0) 5444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:44 smithi044 bash[22676]: audit 2024-09-21T00:36:43.328578+0000 mon.a (mon.0) 5445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:44 smithi044 bash[22676]: audit 2024-09-21T00:36:43.337330+0000 mon.a (mon.0) 5446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:44 smithi179 bash[23186]: audit 2024-09-21T00:36:43.319984+0000 mon.a (mon.0) 5444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:44 smithi179 bash[23186]: audit 2024-09-21T00:36:43.328578+0000 mon.a (mon.0) 5445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:44 smithi179 bash[23186]: audit 2024-09-21T00:36:43.337330+0000 mon.a (mon.0) 5446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:44 smithi049 bash[23528]: audit 2024-09-21T00:36:43.319984+0000 mon.a (mon.0) 5444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:44 smithi049 bash[23528]: audit 2024-09-21T00:36:43.328578+0000 mon.a (mon.0) 5445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:44.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:44 smithi049 bash[23528]: audit 2024-09-21T00:36:43.337330+0000 mon.a (mon.0) 5446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:36:45.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:45.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:45.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:45.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:45 smithi049 bash[23528]: cluster 2024-09-21T00:36:44.392155+0000 mgr.a (mgr.14388) 6153 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:36:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:45 smithi044 bash[22676]: cluster 2024-09-21T00:36:44.392155+0000 mgr.a (mgr.14388) 6153 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:36:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:45 smithi179 bash[23186]: cluster 2024-09-21T00:36:44.392155+0000 mgr.a (mgr.14388) 6153 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:36:45.871 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:45.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:46.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:46 smithi049 bash[23528]: audit 2024-09-21T00:36:45.433531+0000 mgr.a (mgr.14388) 6154 : audit [DBG] from='client.141570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:46 smithi044 bash[22676]: audit 2024-09-21T00:36:45.433531+0000 mgr.a (mgr.14388) 6154 : audit [DBG] from='client.141570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:46 smithi179 bash[23186]: audit 2024-09-21T00:36:45.433531+0000 mgr.a (mgr.14388) 6154 : audit [DBG] from='client.141570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:47.548 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:47 smithi049 bash[23528]: cluster 2024-09-21T00:36:46.394895+0000 mgr.a (mgr.14388) 6155 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:47 smithi044 bash[22676]: cluster 2024-09-21T00:36:46.394895+0000 mgr.a (mgr.14388) 6155 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:47 smithi179 bash[23186]: cluster 2024-09-21T00:36:46.394895+0000 mgr.a (mgr.14388) 6155 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:49 smithi044 bash[22676]: cluster 2024-09-21T00:36:48.395733+0000 mgr.a (mgr.14388) 6156 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:36:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:49 smithi179 bash[23186]: cluster 2024-09-21T00:36:48.395733+0000 mgr.a (mgr.14388) 6156 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:36:49.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:49 smithi049 bash[23528]: cluster 2024-09-21T00:36:48.395733+0000 mgr.a (mgr.14388) 6156 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:36:50.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:50.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:50.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:51.619 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:51.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:51.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:51.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:51.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:51 smithi044 bash[22676]: cluster 2024-09-21T00:36:50.397781+0000 mgr.a (mgr.14388) 6157 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:51 smithi179 bash[23186]: cluster 2024-09-21T00:36:50.397781+0000 mgr.a (mgr.14388) 6157 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:51.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:51 smithi049 bash[23528]: cluster 2024-09-21T00:36:50.397781+0000 mgr.a (mgr.14388) 6157 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:52 smithi044 bash[22676]: audit 2024-09-21T00:36:51.201939+0000 mgr.a (mgr.14388) 6158 : audit [DBG] from='client.141639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:52 smithi179 bash[23186]: audit 2024-09-21T00:36:51.201939+0000 mgr.a (mgr.14388) 6158 : audit [DBG] from='client.141639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:52.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:52 smithi049 bash[23528]: audit 2024-09-21T00:36:51.201939+0000 mgr.a (mgr.14388) 6158 : audit [DBG] from='client.141639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:53 smithi044 bash[22676]: cluster 2024-09-21T00:36:52.398687+0000 mgr.a (mgr.14388) 6159 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:36:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:53 smithi179 bash[23186]: cluster 2024-09-21T00:36:52.398687+0000 mgr.a (mgr.14388) 6159 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:36:53.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:53 smithi049 bash[23528]: cluster 2024-09-21T00:36:52.398687+0000 mgr.a (mgr.14388) 6159 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:36:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:55 smithi044 bash[22676]: cluster 2024-09-21T00:36:54.399622+0000 mgr.a (mgr.14388) 6160 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:36:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:55 smithi179 bash[23186]: cluster 2024-09-21T00:36:54.399622+0000 mgr.a (mgr.14388) 6160 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:36:55.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:55 smithi049 bash[23528]: cluster 2024-09-21T00:36:54.399622+0000 mgr.a (mgr.14388) 6160 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:36:56.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:36:56.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:36:56.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:36:57.367 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:36:57.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:36:57.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:36:57.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:36:57.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:36:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:57 smithi044 bash[22676]: cluster 2024-09-21T00:36:56.402159+0000 mgr.a (mgr.14388) 6161 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:36:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:57 smithi179 bash[23186]: cluster 2024-09-21T00:36:56.402159+0000 mgr.a (mgr.14388) 6161 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:36:57.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:57 smithi049 bash[23528]: cluster 2024-09-21T00:36:56.402159+0000 mgr.a (mgr.14388) 6161 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:36:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:58 smithi179 bash[23186]: audit 2024-09-21T00:36:56.948118+0000 mgr.a (mgr.14388) 6162 : audit [DBG] from='client.141717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:58.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:58 smithi049 bash[23528]: audit 2024-09-21T00:36:56.948118+0000 mgr.a (mgr.14388) 6162 : audit [DBG] from='client.141717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:58 smithi044 bash[22676]: audit 2024-09-21T00:36:56.948118+0000 mgr.a (mgr.14388) 6162 : audit [DBG] from='client.141717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:36:59.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:36:59 smithi179 bash[23186]: cluster 2024-09-21T00:36:58.403036+0000 mgr.a (mgr.14388) 6163 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:59.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:36:59 smithi049 bash[23528]: cluster 2024-09-21T00:36:58.403036+0000 mgr.a (mgr.14388) 6163 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:36:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:36:59 smithi044 bash[22676]: cluster 2024-09-21T00:36:58.403036+0000 mgr.a (mgr.14388) 6163 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:01 smithi179 bash[23186]: cluster 2024-09-21T00:37:00.405603+0000 mgr.a (mgr.14388) 6164 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:01.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:01 smithi049 bash[23528]: cluster 2024-09-21T00:37:00.405603+0000 mgr.a (mgr.14388) 6164 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:01 smithi044 bash[22676]: cluster 2024-09-21T00:37:00.405603+0000 mgr.a (mgr.14388) 6164 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:02.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:02.370 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:02.370 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:02 smithi049 bash[23528]: audit 2024-09-21T00:37:01.579044+0000 mon.a (mon.0) 5447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:02 smithi049 bash[23528]: audit 2024-09-21T00:37:01.586438+0000 mon.a (mon.0) 5448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:02 smithi049 bash[23528]: audit 2024-09-21T00:37:01.596402+0000 mon.a (mon.0) 5449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:02 smithi049 bash[23528]: audit 2024-09-21T00:37:02.401437+0000 mon.a (mon.0) 5450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:02 smithi049 bash[23528]: audit 2024-09-21T00:37:02.410558+0000 mon.a (mon.0) 5451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:02 smithi049 bash[23528]: audit 2024-09-21T00:37:02.421199+0000 mon.a (mon.0) 5452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:02 smithi044 bash[22676]: audit 2024-09-21T00:37:01.579044+0000 mon.a (mon.0) 5447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:02 smithi044 bash[22676]: audit 2024-09-21T00:37:01.586438+0000 mon.a (mon.0) 5448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:02 smithi044 bash[22676]: audit 2024-09-21T00:37:01.596402+0000 mon.a (mon.0) 5449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:02 smithi044 bash[22676]: audit 2024-09-21T00:37:02.401437+0000 mon.a (mon.0) 5450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:02 smithi044 bash[22676]: audit 2024-09-21T00:37:02.410558+0000 mon.a (mon.0) 5451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:02 smithi044 bash[22676]: audit 2024-09-21T00:37:02.421199+0000 mon.a (mon.0) 5452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:02 smithi179 bash[23186]: audit 2024-09-21T00:37:01.579044+0000 mon.a (mon.0) 5447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:02 smithi179 bash[23186]: audit 2024-09-21T00:37:01.586438+0000 mon.a (mon.0) 5448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:02 smithi179 bash[23186]: audit 2024-09-21T00:37:01.596402+0000 mon.a (mon.0) 5449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:02 smithi179 bash[23186]: audit 2024-09-21T00:37:02.401437+0000 mon.a (mon.0) 5450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:02 smithi179 bash[23186]: audit 2024-09-21T00:37:02.410558+0000 mon.a (mon.0) 5451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:02.983 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:02 smithi179 bash[23186]: audit 2024-09-21T00:37:02.421199+0000 mon.a (mon.0) 5452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:03.175 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:03.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:03.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:03.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:03.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:03 smithi044 bash[22676]: cluster 2024-09-21T00:37:02.406462+0000 mgr.a (mgr.14388) 6165 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:03 smithi044 bash[22676]: audit 2024-09-21T00:37:02.732816+0000 mgr.a (mgr.14388) 6166 : audit [DBG] from='client.141792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:03 smithi044 bash[22676]: audit 2024-09-21T00:37:03.461438+0000 mon.a (mon.0) 5453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:03 smithi044 bash[22676]: audit 2024-09-21T00:37:03.467648+0000 mon.a (mon.0) 5454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:03 smithi044 bash[22676]: audit 2024-09-21T00:37:03.474368+0000 mon.a (mon.0) 5455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:03 smithi179 bash[23186]: cluster 2024-09-21T00:37:02.406462+0000 mgr.a (mgr.14388) 6165 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:03 smithi179 bash[23186]: audit 2024-09-21T00:37:02.732816+0000 mgr.a (mgr.14388) 6166 : audit [DBG] from='client.141792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:03 smithi179 bash[23186]: audit 2024-09-21T00:37:03.461438+0000 mon.a (mon.0) 5453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:03 smithi179 bash[23186]: audit 2024-09-21T00:37:03.467648+0000 mon.a (mon.0) 5454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:03 smithi179 bash[23186]: audit 2024-09-21T00:37:03.474368+0000 mon.a (mon.0) 5455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:03 smithi049 bash[23528]: cluster 2024-09-21T00:37:02.406462+0000 mgr.a (mgr.14388) 6165 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:03 smithi049 bash[23528]: audit 2024-09-21T00:37:02.732816+0000 mgr.a (mgr.14388) 6166 : audit [DBG] from='client.141792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:03 smithi049 bash[23528]: audit 2024-09-21T00:37:03.461438+0000 mon.a (mon.0) 5453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:03 smithi049 bash[23528]: audit 2024-09-21T00:37:03.467648+0000 mon.a (mon.0) 5454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:03 smithi049 bash[23528]: audit 2024-09-21T00:37:03.474368+0000 mon.a (mon.0) 5455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:05 smithi044 bash[22676]: cluster 2024-09-21T00:37:04.407385+0000 mgr.a (mgr.14388) 6167 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:05 smithi179 bash[23186]: cluster 2024-09-21T00:37:04.407385+0000 mgr.a (mgr.14388) 6167 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:06.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:05 smithi049 bash[23528]: cluster 2024-09-21T00:37:04.407385+0000 mgr.a (mgr.14388) 6167 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:07 smithi049 bash[23528]: cluster 2024-09-21T00:37:06.410463+0000 mgr.a (mgr.14388) 6168 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:07 smithi044 bash[22676]: cluster 2024-09-21T00:37:06.410463+0000 mgr.a (mgr.14388) 6168 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:07 smithi179 bash[23186]: cluster 2024-09-21T00:37:06.410463+0000 mgr.a (mgr.14388) 6168 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:08.942 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:08.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:08.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:08.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:08.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:09 smithi044 bash[22676]: cluster 2024-09-21T00:37:08.411197+0000 mgr.a (mgr.14388) 6169 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:09 smithi044 bash[22676]: audit 2024-09-21T00:37:08.508189+0000 mgr.a (mgr.14388) 6170 : audit [DBG] from='client.141870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:09 smithi179 bash[23186]: cluster 2024-09-21T00:37:08.411197+0000 mgr.a (mgr.14388) 6169 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:09 smithi179 bash[23186]: audit 2024-09-21T00:37:08.508189+0000 mgr.a (mgr.14388) 6170 : audit [DBG] from='client.141870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:09 smithi049 bash[23528]: cluster 2024-09-21T00:37:08.411197+0000 mgr.a (mgr.14388) 6169 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:09 smithi049 bash[23528]: audit 2024-09-21T00:37:08.508189+0000 mgr.a (mgr.14388) 6170 : audit [DBG] from='client.141870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:10.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:37:10 smithi044 bash[22930]: debug 2024-09-21T00:37:10.611+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:37:10.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:37:10 smithi044 bash[22930]: debug 2024-09-21T00:37:10.611+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:37:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:10 smithi044 bash[22676]: audit 2024-09-21T00:37:09.825726+0000 mon.a (mon.0) 5456 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:37:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:10 smithi044 bash[22676]: audit 2024-09-21T00:37:09.833535+0000 mon.a (mon.0) 5457 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:37:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:10 smithi044 bash[22676]: audit 2024-09-21T00:37:09.835541+0000 mon.a (mon.0) 5458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:37:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:10 smithi044 bash[22676]: audit 2024-09-21T00:37:09.847694+0000 mon.a (mon.0) 5459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:10 smithi044 bash[22676]: audit 2024-09-21T00:37:09.854208+0000 mon.a (mon.0) 5460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:37:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:10 smithi179 bash[23186]: audit 2024-09-21T00:37:09.825726+0000 mon.a (mon.0) 5456 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:37:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:10 smithi179 bash[23186]: audit 2024-09-21T00:37:09.833535+0000 mon.a (mon.0) 5457 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:37:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:10 smithi179 bash[23186]: audit 2024-09-21T00:37:09.835541+0000 mon.a (mon.0) 5458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:37:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:10 smithi179 bash[23186]: audit 2024-09-21T00:37:09.847694+0000 mon.a (mon.0) 5459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:10 smithi179 bash[23186]: audit 2024-09-21T00:37:09.854208+0000 mon.a (mon.0) 5460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:37:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:10 smithi049 bash[23528]: audit 2024-09-21T00:37:09.825726+0000 mon.a (mon.0) 5456 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:37:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:10 smithi049 bash[23528]: audit 2024-09-21T00:37:09.833535+0000 mon.a (mon.0) 5457 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:37:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:10 smithi049 bash[23528]: audit 2024-09-21T00:37:09.835541+0000 mon.a (mon.0) 5458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:37:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:10 smithi049 bash[23528]: audit 2024-09-21T00:37:09.847694+0000 mon.a (mon.0) 5459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:10 smithi049 bash[23528]: audit 2024-09-21T00:37:09.854208+0000 mon.a (mon.0) 5460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:37:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:11 smithi044 bash[22676]: audit 2024-09-21T00:37:09.857032+0000 mgr.a (mgr.14388) 6171 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:37:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:11 smithi044 bash[22676]: cluster 2024-09-21T00:37:10.412535+0000 mgr.a (mgr.14388) 6172 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:11 smithi044 bash[22676]: audit 2024-09-21T00:37:10.615221+0000 mgr.a (mgr.14388) 6173 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:37:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:11 smithi044 bash[22676]: cephadm 2024-09-21T00:37:10.616361+0000 mgr.a (mgr.14388) 6174 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:37:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:11 smithi179 bash[23186]: audit 2024-09-21T00:37:09.857032+0000 mgr.a (mgr.14388) 6171 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:37:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:11 smithi179 bash[23186]: cluster 2024-09-21T00:37:10.412535+0000 mgr.a (mgr.14388) 6172 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:11 smithi179 bash[23186]: audit 2024-09-21T00:37:10.615221+0000 mgr.a (mgr.14388) 6173 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:37:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:11 smithi179 bash[23186]: cephadm 2024-09-21T00:37:10.616361+0000 mgr.a (mgr.14388) 6174 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:37:12.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:11 smithi049 bash[23528]: audit 2024-09-21T00:37:09.857032+0000 mgr.a (mgr.14388) 6171 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:37:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:11 smithi049 bash[23528]: cluster 2024-09-21T00:37:10.412535+0000 mgr.a (mgr.14388) 6172 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:11 smithi049 bash[23528]: audit 2024-09-21T00:37:10.615221+0000 mgr.a (mgr.14388) 6173 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:37:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:11 smithi049 bash[23528]: cephadm 2024-09-21T00:37:10.616361+0000 mgr.a (mgr.14388) 6174 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:37:13.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:13.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:13.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:13 smithi044 bash[22676]: cluster 2024-09-21T00:37:12.413353+0000 mgr.a (mgr.14388) 6175 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:13 smithi179 bash[23186]: cluster 2024-09-21T00:37:12.413353+0000 mgr.a (mgr.14388) 6175 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:14.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:13 smithi049 bash[23528]: cluster 2024-09-21T00:37:12.413353+0000 mgr.a (mgr.14388) 6175 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:14.723 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:15 smithi044 bash[22676]: audit 2024-09-21T00:37:14.278039+0000 mgr.a (mgr.14388) 6176 : audit [DBG] from='client.142047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:15 smithi044 bash[22676]: cluster 2024-09-21T00:37:14.413877+0000 mgr.a (mgr.14388) 6177 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:15 smithi179 bash[23186]: audit 2024-09-21T00:37:14.278039+0000 mgr.a (mgr.14388) 6176 : audit [DBG] from='client.142047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:15 smithi179 bash[23186]: cluster 2024-09-21T00:37:14.413877+0000 mgr.a (mgr.14388) 6177 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:15 smithi049 bash[23528]: audit 2024-09-21T00:37:14.278039+0000 mgr.a (mgr.14388) 6176 : audit [DBG] from='client.142047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:15 smithi049 bash[23528]: cluster 2024-09-21T00:37:14.413877+0000 mgr.a (mgr.14388) 6177 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:17 smithi044 bash[22676]: cluster 2024-09-21T00:37:16.416191+0000 mgr.a (mgr.14388) 6178 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:17 smithi179 bash[23186]: cluster 2024-09-21T00:37:16.416191+0000 mgr.a (mgr.14388) 6178 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:18.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:17 smithi049 bash[23528]: cluster 2024-09-21T00:37:16.416191+0000 mgr.a (mgr.14388) 6178 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:19.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:19.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:19.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:19 smithi044 bash[22676]: cluster 2024-09-21T00:37:18.417001+0000 mgr.a (mgr.14388) 6179 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:19 smithi179 bash[23186]: cluster 2024-09-21T00:37:18.417001+0000 mgr.a (mgr.14388) 6179 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:19 smithi049 bash[23528]: cluster 2024-09-21T00:37:18.417001+0000 mgr.a (mgr.14388) 6179 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:20.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:20.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:20.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:20.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:20.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:21 smithi179 bash[23186]: audit 2024-09-21T00:37:20.060358+0000 mgr.a (mgr.14388) 6180 : audit [DBG] from='client.142125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:21 smithi179 bash[23186]: cluster 2024-09-21T00:37:20.418704+0000 mgr.a (mgr.14388) 6181 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:21 smithi044 bash[22676]: audit 2024-09-21T00:37:20.060358+0000 mgr.a (mgr.14388) 6180 : audit [DBG] from='client.142125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:21 smithi044 bash[22676]: cluster 2024-09-21T00:37:20.418704+0000 mgr.a (mgr.14388) 6181 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:22.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:21 smithi049 bash[23528]: audit 2024-09-21T00:37:20.060358+0000 mgr.a (mgr.14388) 6180 : audit [DBG] from='client.142125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:21 smithi049 bash[23528]: cluster 2024-09-21T00:37:20.418704+0000 mgr.a (mgr.14388) 6181 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:22 smithi049 bash[23528]: audit 2024-09-21T00:37:21.779989+0000 mon.a (mon.0) 5461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:22 smithi049 bash[23528]: audit 2024-09-21T00:37:21.788886+0000 mon.a (mon.0) 5462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:22 smithi049 bash[23528]: audit 2024-09-21T00:37:21.799813+0000 mon.a (mon.0) 5463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:22 smithi049 bash[23528]: cluster 2024-09-21T00:37:22.419522+0000 mgr.a (mgr.14388) 6182 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:37:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:22 smithi049 bash[23528]: audit 2024-09-21T00:37:22.653107+0000 mon.a (mon.0) 5464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:22 smithi049 bash[23528]: audit 2024-09-21T00:37:22.661489+0000 mon.a (mon.0) 5465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:22 smithi049 bash[23528]: audit 2024-09-21T00:37:22.671289+0000 mon.a (mon.0) 5466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:22 smithi179 bash[23186]: audit 2024-09-21T00:37:21.779989+0000 mon.a (mon.0) 5461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:22 smithi179 bash[23186]: audit 2024-09-21T00:37:21.788886+0000 mon.a (mon.0) 5462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:22 smithi179 bash[23186]: audit 2024-09-21T00:37:21.799813+0000 mon.a (mon.0) 5463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:22 smithi179 bash[23186]: cluster 2024-09-21T00:37:22.419522+0000 mgr.a (mgr.14388) 6182 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:37:23.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:22 smithi179 bash[23186]: audit 2024-09-21T00:37:22.653107+0000 mon.a (mon.0) 5464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:22 smithi179 bash[23186]: audit 2024-09-21T00:37:22.661489+0000 mon.a (mon.0) 5465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:22 smithi179 bash[23186]: audit 2024-09-21T00:37:22.671289+0000 mon.a (mon.0) 5466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:22 smithi044 bash[22676]: audit 2024-09-21T00:37:21.779989+0000 mon.a (mon.0) 5461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:22 smithi044 bash[22676]: audit 2024-09-21T00:37:21.788886+0000 mon.a (mon.0) 5462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:22 smithi044 bash[22676]: audit 2024-09-21T00:37:21.799813+0000 mon.a (mon.0) 5463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:22 smithi044 bash[22676]: cluster 2024-09-21T00:37:22.419522+0000 mgr.a (mgr.14388) 6182 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:37:23.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:22 smithi044 bash[22676]: audit 2024-09-21T00:37:22.653107+0000 mon.a (mon.0) 5464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:22 smithi044 bash[22676]: audit 2024-09-21T00:37:22.661489+0000 mon.a (mon.0) 5465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:23.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:22 smithi044 bash[22676]: audit 2024-09-21T00:37:22.671289+0000 mon.a (mon.0) 5466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:24 smithi044 bash[22676]: audit 2024-09-21T00:37:23.623655+0000 mon.a (mon.0) 5467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:24 smithi044 bash[22676]: audit 2024-09-21T00:37:23.629447+0000 mon.a (mon.0) 5468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:24 smithi044 bash[22676]: audit 2024-09-21T00:37:23.634288+0000 mon.a (mon.0) 5469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:24 smithi179 bash[23186]: audit 2024-09-21T00:37:23.623655+0000 mon.a (mon.0) 5467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:24 smithi179 bash[23186]: audit 2024-09-21T00:37:23.629447+0000 mon.a (mon.0) 5468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:24 smithi179 bash[23186]: audit 2024-09-21T00:37:23.634288+0000 mon.a (mon.0) 5469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:25.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:24 smithi049 bash[23528]: audit 2024-09-21T00:37:23.623655+0000 mon.a (mon.0) 5467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:25.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:24 smithi049 bash[23528]: audit 2024-09-21T00:37:23.629447+0000 mon.a (mon.0) 5468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:25.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:24 smithi049 bash[23528]: audit 2024-09-21T00:37:23.634288+0000 mon.a (mon.0) 5469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:25.924 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:25 smithi044 bash[22676]: cluster 2024-09-21T00:37:24.420291+0000 mgr.a (mgr.14388) 6183 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:37:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:25 smithi179 bash[23186]: cluster 2024-09-21T00:37:24.420291+0000 mgr.a (mgr.14388) 6183 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:37:26.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:25 smithi049 bash[23528]: cluster 2024-09-21T00:37:24.420291+0000 mgr.a (mgr.14388) 6183 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:37:26.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:26.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:26.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:26.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:26.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:27 smithi044 bash[22676]: audit 2024-09-21T00:37:25.810166+0000 mgr.a (mgr.14388) 6184 : audit [DBG] from='client.142203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:27 smithi044 bash[22676]: cluster 2024-09-21T00:37:26.423076+0000 mgr.a (mgr.14388) 6185 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:27 smithi179 bash[23186]: audit 2024-09-21T00:37:25.810166+0000 mgr.a (mgr.14388) 6184 : audit [DBG] from='client.142203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:27 smithi179 bash[23186]: cluster 2024-09-21T00:37:26.423076+0000 mgr.a (mgr.14388) 6185 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:28.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:27 smithi049 bash[23528]: audit 2024-09-21T00:37:25.810166+0000 mgr.a (mgr.14388) 6184 : audit [DBG] from='client.142203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:27 smithi049 bash[23528]: cluster 2024-09-21T00:37:26.423076+0000 mgr.a (mgr.14388) 6185 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:37:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:29 smithi044 bash[22676]: cluster 2024-09-21T00:37:28.424015+0000 mgr.a (mgr.14388) 6186 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:37:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:29 smithi179 bash[23186]: cluster 2024-09-21T00:37:28.424015+0000 mgr.a (mgr.14388) 6186 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:37:30.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:29 smithi049 bash[23528]: cluster 2024-09-21T00:37:28.424015+0000 mgr.a (mgr.14388) 6186 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:37:31.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:31.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:31.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:31 smithi044 bash[22676]: cluster 2024-09-21T00:37:30.426046+0000 mgr.a (mgr.14388) 6187 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:31 smithi179 bash[23186]: cluster 2024-09-21T00:37:30.426046+0000 mgr.a (mgr.14388) 6187 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:32.040 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:31 smithi049 bash[23528]: cluster 2024-09-21T00:37:30.426046+0000 mgr.a (mgr.14388) 6187 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:32 smithi044 bash[22676]: audit 2024-09-21T00:37:31.594329+0000 mgr.a (mgr.14388) 6188 : audit [DBG] from='client.142281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:32 smithi179 bash[23186]: audit 2024-09-21T00:37:31.594329+0000 mgr.a (mgr.14388) 6188 : audit [DBG] from='client.142281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:33.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:32 smithi049 bash[23528]: audit 2024-09-21T00:37:31.594329+0000 mgr.a (mgr.14388) 6188 : audit [DBG] from='client.142281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:33 smithi044 bash[22676]: cluster 2024-09-21T00:37:32.427069+0000 mgr.a (mgr.14388) 6189 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:33 smithi179 bash[23186]: cluster 2024-09-21T00:37:32.427069+0000 mgr.a (mgr.14388) 6189 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:34.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:33 smithi049 bash[23528]: cluster 2024-09-21T00:37:32.427069+0000 mgr.a (mgr.14388) 6189 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:35 smithi044 bash[22676]: cluster 2024-09-21T00:37:34.427886+0000 mgr.a (mgr.14388) 6190 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:35 smithi179 bash[23186]: cluster 2024-09-21T00:37:34.427886+0000 mgr.a (mgr.14388) 6190 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:35 smithi049 bash[23528]: cluster 2024-09-21T00:37:34.427886+0000 mgr.a (mgr.14388) 6190 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:37.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:37.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:37.043 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:37.815 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:37.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:37.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:37 smithi044 bash[22676]: cluster 2024-09-21T00:37:36.430159+0000 mgr.a (mgr.14388) 6191 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:37 smithi179 bash[23186]: cluster 2024-09-21T00:37:36.430159+0000 mgr.a (mgr.14388) 6191 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:37 smithi049 bash[23528]: cluster 2024-09-21T00:37:36.430159+0000 mgr.a (mgr.14388) 6191 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:38 smithi044 bash[22676]: audit 2024-09-21T00:37:37.373334+0000 mgr.a (mgr.14388) 6192 : audit [DBG] from='client.142356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:38 smithi179 bash[23186]: audit 2024-09-21T00:37:37.373334+0000 mgr.a (mgr.14388) 6192 : audit [DBG] from='client.142356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:39.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:38 smithi049 bash[23528]: audit 2024-09-21T00:37:37.373334+0000 mgr.a (mgr.14388) 6192 : audit [DBG] from='client.142356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:39 smithi044 bash[22676]: cluster 2024-09-21T00:37:38.431162+0000 mgr.a (mgr.14388) 6193 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:39 smithi179 bash[23186]: cluster 2024-09-21T00:37:38.431162+0000 mgr.a (mgr.14388) 6193 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:39 smithi049 bash[23528]: cluster 2024-09-21T00:37:38.431162+0000 mgr.a (mgr.14388) 6193 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:41 smithi044 bash[22676]: cluster 2024-09-21T00:37:40.432380+0000 mgr.a (mgr.14388) 6194 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:41 smithi179 bash[23186]: cluster 2024-09-21T00:37:40.432380+0000 mgr.a (mgr.14388) 6194 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:42.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:41 smithi049 bash[23528]: cluster 2024-09-21T00:37:40.432380+0000 mgr.a (mgr.14388) 6194 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:42.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:42.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:42.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:42 smithi179 bash[23186]: audit 2024-09-21T00:37:41.995383+0000 mon.a (mon.0) 5470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:42 smithi179 bash[23186]: audit 2024-09-21T00:37:42.004428+0000 mon.a (mon.0) 5471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:42 smithi179 bash[23186]: audit 2024-09-21T00:37:42.015518+0000 mon.a (mon.0) 5472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:42 smithi179 bash[23186]: cluster 2024-09-21T00:37:42.433329+0000 mgr.a (mgr.14388) 6195 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:42 smithi179 bash[23186]: audit 2024-09-21T00:37:42.881506+0000 mon.a (mon.0) 5473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:42 smithi179 bash[23186]: audit 2024-09-21T00:37:42.890969+0000 mon.a (mon.0) 5474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:42 smithi179 bash[23186]: audit 2024-09-21T00:37:42.901295+0000 mon.a (mon.0) 5475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:42 smithi049 bash[23528]: audit 2024-09-21T00:37:41.995383+0000 mon.a (mon.0) 5470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:42 smithi049 bash[23528]: audit 2024-09-21T00:37:42.004428+0000 mon.a (mon.0) 5471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:42 smithi049 bash[23528]: audit 2024-09-21T00:37:42.015518+0000 mon.a (mon.0) 5472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:42 smithi049 bash[23528]: cluster 2024-09-21T00:37:42.433329+0000 mgr.a (mgr.14388) 6195 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:42 smithi049 bash[23528]: audit 2024-09-21T00:37:42.881506+0000 mon.a (mon.0) 5473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:42 smithi049 bash[23528]: audit 2024-09-21T00:37:42.890969+0000 mon.a (mon.0) 5474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:42 smithi049 bash[23528]: audit 2024-09-21T00:37:42.901295+0000 mon.a (mon.0) 5475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:42 smithi044 bash[22676]: audit 2024-09-21T00:37:41.995383+0000 mon.a (mon.0) 5470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:42 smithi044 bash[22676]: audit 2024-09-21T00:37:42.004428+0000 mon.a (mon.0) 5471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:42 smithi044 bash[22676]: audit 2024-09-21T00:37:42.015518+0000 mon.a (mon.0) 5472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:42 smithi044 bash[22676]: cluster 2024-09-21T00:37:42.433329+0000 mgr.a (mgr.14388) 6195 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:42 smithi044 bash[22676]: audit 2024-09-21T00:37:42.881506+0000 mon.a (mon.0) 5473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:42 smithi044 bash[22676]: audit 2024-09-21T00:37:42.890969+0000 mon.a (mon.0) 5474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:42 smithi044 bash[22676]: audit 2024-09-21T00:37:42.901295+0000 mon.a (mon.0) 5475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:43.614 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:43.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:43.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:43.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:43.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:44 smithi179 bash[23186]: audit 2024-09-21T00:37:43.165424+0000 mgr.a (mgr.14388) 6196 : audit [DBG] from='client.142431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:44 smithi179 bash[23186]: audit 2024-09-21T00:37:43.744143+0000 mon.a (mon.0) 5476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:44 smithi179 bash[23186]: audit 2024-09-21T00:37:43.750336+0000 mon.a (mon.0) 5477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:44 smithi179 bash[23186]: audit 2024-09-21T00:37:43.756784+0000 mon.a (mon.0) 5478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:44 smithi049 bash[23528]: audit 2024-09-21T00:37:43.165424+0000 mgr.a (mgr.14388) 6196 : audit [DBG] from='client.142431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:44 smithi049 bash[23528]: audit 2024-09-21T00:37:43.744143+0000 mon.a (mon.0) 5476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:44 smithi049 bash[23528]: audit 2024-09-21T00:37:43.750336+0000 mon.a (mon.0) 5477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:44 smithi049 bash[23528]: audit 2024-09-21T00:37:43.756784+0000 mon.a (mon.0) 5478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:44 smithi044 bash[22676]: audit 2024-09-21T00:37:43.165424+0000 mgr.a (mgr.14388) 6196 : audit [DBG] from='client.142431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:44 smithi044 bash[22676]: audit 2024-09-21T00:37:43.744143+0000 mon.a (mon.0) 5476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:44 smithi044 bash[22676]: audit 2024-09-21T00:37:43.750336+0000 mon.a (mon.0) 5477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:44 smithi044 bash[22676]: audit 2024-09-21T00:37:43.756784+0000 mon.a (mon.0) 5478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:37:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:45 smithi049 bash[23528]: cluster 2024-09-21T00:37:44.434277+0000 mgr.a (mgr.14388) 6197 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:45 smithi044 bash[22676]: cluster 2024-09-21T00:37:44.434277+0000 mgr.a (mgr.14388) 6197 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:45 smithi179 bash[23186]: cluster 2024-09-21T00:37:44.434277+0000 mgr.a (mgr.14388) 6197 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:47 smithi049 bash[23528]: cluster 2024-09-21T00:37:46.436583+0000 mgr.a (mgr.14388) 6198 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:47 smithi044 bash[22676]: cluster 2024-09-21T00:37:46.436583+0000 mgr.a (mgr.14388) 6198 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:47 smithi179 bash[23186]: cluster 2024-09-21T00:37:46.436583+0000 mgr.a (mgr.14388) 6198 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:48.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:48.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:48.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:49.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:49.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:49.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:49.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:49.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:49 smithi049 bash[23528]: cluster 2024-09-21T00:37:48.437444+0000 mgr.a (mgr.14388) 6199 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:49 smithi044 bash[22676]: cluster 2024-09-21T00:37:48.437444+0000 mgr.a (mgr.14388) 6199 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:49 smithi179 bash[23186]: cluster 2024-09-21T00:37:48.437444+0000 mgr.a (mgr.14388) 6199 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:50 smithi049 bash[23528]: audit 2024-09-21T00:37:48.950361+0000 mgr.a (mgr.14388) 6200 : audit [DBG] from='client.62840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:50 smithi044 bash[22676]: audit 2024-09-21T00:37:48.950361+0000 mgr.a (mgr.14388) 6200 : audit [DBG] from='client.62840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:50 smithi179 bash[23186]: audit 2024-09-21T00:37:48.950361+0000 mgr.a (mgr.14388) 6200 : audit [DBG] from='client.62840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:52.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:51 smithi049 bash[23528]: cluster 2024-09-21T00:37:50.439900+0000 mgr.a (mgr.14388) 6201 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:51 smithi044 bash[22676]: cluster 2024-09-21T00:37:50.439900+0000 mgr.a (mgr.14388) 6201 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:51 smithi179 bash[23186]: cluster 2024-09-21T00:37:50.439900+0000 mgr.a (mgr.14388) 6201 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:37:53.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:52 smithi049 bash[23528]: cluster 2024-09-21T00:37:52.440853+0000 mgr.a (mgr.14388) 6202 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:52 smithi044 bash[22676]: cluster 2024-09-21T00:37:52.440853+0000 mgr.a (mgr.14388) 6202 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:52 smithi179 bash[23186]: cluster 2024-09-21T00:37:52.440853+0000 mgr.a (mgr.14388) 6202 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:54.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:37:54.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:37:54.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:37:55.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:37:55.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:37:55.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:37:55.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:37:55.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:55 smithi179 bash[23186]: cluster 2024-09-21T00:37:54.441488+0000 mgr.a (mgr.14388) 6203 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:55 smithi179 bash[23186]: audit 2024-09-21T00:37:54.720917+0000 mgr.a (mgr.14388) 6204 : audit [DBG] from='client.142581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:55.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:55 smithi049 bash[23528]: cluster 2024-09-21T00:37:54.441488+0000 mgr.a (mgr.14388) 6203 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:55.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:55 smithi049 bash[23528]: audit 2024-09-21T00:37:54.720917+0000 mgr.a (mgr.14388) 6204 : audit [DBG] from='client.142581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:55 smithi044 bash[22676]: cluster 2024-09-21T00:37:54.441488+0000 mgr.a (mgr.14388) 6203 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:55 smithi044 bash[22676]: audit 2024-09-21T00:37:54.720917+0000 mgr.a (mgr.14388) 6204 : audit [DBG] from='client.142581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:37:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:57 smithi179 bash[23186]: cluster 2024-09-21T00:37:56.444268+0000 mgr.a (mgr.14388) 6205 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:37:57.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:57 smithi049 bash[23528]: cluster 2024-09-21T00:37:56.444268+0000 mgr.a (mgr.14388) 6205 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:37:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:57 smithi044 bash[22676]: cluster 2024-09-21T00:37:56.444268+0000 mgr.a (mgr.14388) 6205 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T00:37:59.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:37:59 smithi179 bash[23186]: cluster 2024-09-21T00:37:58.445067+0000 mgr.a (mgr.14388) 6206 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:37:59.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:37:59 smithi049 bash[23528]: cluster 2024-09-21T00:37:58.445067+0000 mgr.a (mgr.14388) 6206 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:37:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:37:59 smithi044 bash[22676]: cluster 2024-09-21T00:37:58.445067+0000 mgr.a (mgr.14388) 6206 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T00:38:00.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:00.956 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:00.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:00.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:01.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:01 smithi044 bash[22676]: cluster 2024-09-21T00:38:00.447047+0000 mgr.a (mgr.14388) 6207 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:01.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:01 smithi044 bash[22676]: audit 2024-09-21T00:38:00.510632+0000 mgr.a (mgr.14388) 6208 : audit [DBG] from='client.142659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:01 smithi179 bash[23186]: cluster 2024-09-21T00:38:00.447047+0000 mgr.a (mgr.14388) 6207 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:01 smithi179 bash[23186]: audit 2024-09-21T00:38:00.510632+0000 mgr.a (mgr.14388) 6208 : audit [DBG] from='client.142659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:01.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:01 smithi049 bash[23528]: cluster 2024-09-21T00:38:00.447047+0000 mgr.a (mgr.14388) 6207 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:01.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:01 smithi049 bash[23528]: audit 2024-09-21T00:38:00.510632+0000 mgr.a (mgr.14388) 6208 : audit [DBG] from='client.142659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:03 smithi044 bash[22676]: audit 2024-09-21T00:38:02.184105+0000 mon.a (mon.0) 5479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:03 smithi044 bash[22676]: audit 2024-09-21T00:38:02.189725+0000 mon.a (mon.0) 5480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:03 smithi044 bash[22676]: audit 2024-09-21T00:38:02.196861+0000 mon.a (mon.0) 5481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:03 smithi044 bash[22676]: cluster 2024-09-21T00:38:02.447968+0000 mgr.a (mgr.14388) 6209 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:03 smithi044 bash[22676]: audit 2024-09-21T00:38:03.092137+0000 mon.a (mon.0) 5482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:03 smithi044 bash[22676]: audit 2024-09-21T00:38:03.097232+0000 mon.a (mon.0) 5483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:03 smithi044 bash[22676]: audit 2024-09-21T00:38:03.103448+0000 mon.a (mon.0) 5484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:03 smithi179 bash[23186]: audit 2024-09-21T00:38:02.184105+0000 mon.a (mon.0) 5479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:03 smithi179 bash[23186]: audit 2024-09-21T00:38:02.189725+0000 mon.a (mon.0) 5480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:03 smithi179 bash[23186]: audit 2024-09-21T00:38:02.196861+0000 mon.a (mon.0) 5481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:03 smithi179 bash[23186]: cluster 2024-09-21T00:38:02.447968+0000 mgr.a (mgr.14388) 6209 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:03 smithi179 bash[23186]: audit 2024-09-21T00:38:03.092137+0000 mon.a (mon.0) 5482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:03 smithi179 bash[23186]: audit 2024-09-21T00:38:03.097232+0000 mon.a (mon.0) 5483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:03 smithi179 bash[23186]: audit 2024-09-21T00:38:03.103448+0000 mon.a (mon.0) 5484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:03 smithi049 bash[23528]: audit 2024-09-21T00:38:02.184105+0000 mon.a (mon.0) 5479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:03 smithi049 bash[23528]: audit 2024-09-21T00:38:02.189725+0000 mon.a (mon.0) 5480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:03 smithi049 bash[23528]: audit 2024-09-21T00:38:02.196861+0000 mon.a (mon.0) 5481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:03 smithi049 bash[23528]: cluster 2024-09-21T00:38:02.447968+0000 mgr.a (mgr.14388) 6209 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:03 smithi049 bash[23528]: audit 2024-09-21T00:38:03.092137+0000 mon.a (mon.0) 5482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:03 smithi049 bash[23528]: audit 2024-09-21T00:38:03.097232+0000 mon.a (mon.0) 5483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:03.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:03 smithi049 bash[23528]: audit 2024-09-21T00:38:03.103448+0000 mon.a (mon.0) 5484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:04 smithi044 bash[22676]: audit 2024-09-21T00:38:03.872360+0000 mon.a (mon.0) 5485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:04 smithi044 bash[22676]: audit 2024-09-21T00:38:03.877820+0000 mon.a (mon.0) 5486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:04 smithi044 bash[22676]: audit 2024-09-21T00:38:03.882939+0000 mon.a (mon.0) 5487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:04 smithi044 bash[22676]: cluster 2024-09-21T00:38:04.448787+0000 mgr.a (mgr.14388) 6210 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:38:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:04 smithi179 bash[23186]: audit 2024-09-21T00:38:03.872360+0000 mon.a (mon.0) 5485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:04 smithi179 bash[23186]: audit 2024-09-21T00:38:03.877820+0000 mon.a (mon.0) 5486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:04 smithi179 bash[23186]: audit 2024-09-21T00:38:03.882939+0000 mon.a (mon.0) 5487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:04 smithi179 bash[23186]: cluster 2024-09-21T00:38:04.448787+0000 mgr.a (mgr.14388) 6210 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:38:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:04 smithi049 bash[23528]: audit 2024-09-21T00:38:03.872360+0000 mon.a (mon.0) 5485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:04 smithi049 bash[23528]: audit 2024-09-21T00:38:03.877820+0000 mon.a (mon.0) 5486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:04 smithi049 bash[23528]: audit 2024-09-21T00:38:03.882939+0000 mon.a (mon.0) 5487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:04 smithi049 bash[23528]: cluster 2024-09-21T00:38:04.448787+0000 mgr.a (mgr.14388) 6210 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:38:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:05.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:06.716 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:07 smithi049 bash[23528]: audit 2024-09-21T00:38:06.276315+0000 mgr.a (mgr.14388) 6211 : audit [DBG] from='client.142734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:07 smithi049 bash[23528]: cluster 2024-09-21T00:38:06.450668+0000 mgr.a (mgr.14388) 6212 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:07 smithi044 bash[22676]: audit 2024-09-21T00:38:06.276315+0000 mgr.a (mgr.14388) 6211 : audit [DBG] from='client.142734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:07 smithi044 bash[22676]: cluster 2024-09-21T00:38:06.450668+0000 mgr.a (mgr.14388) 6212 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:07 smithi179 bash[23186]: audit 2024-09-21T00:38:06.276315+0000 mgr.a (mgr.14388) 6211 : audit [DBG] from='client.142734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:07 smithi179 bash[23186]: cluster 2024-09-21T00:38:06.450668+0000 mgr.a (mgr.14388) 6212 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:09 smithi049 bash[23528]: cluster 2024-09-21T00:38:08.451573+0000 mgr.a (mgr.14388) 6213 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:38:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:09 smithi044 bash[22676]: cluster 2024-09-21T00:38:08.451573+0000 mgr.a (mgr.14388) 6213 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:38:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:09 smithi179 bash[23186]: cluster 2024-09-21T00:38:08.451573+0000 mgr.a (mgr.14388) 6213 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:38:11.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:11.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:11 smithi049 bash[23528]: cluster 2024-09-21T00:38:10.453772+0000 mgr.a (mgr.14388) 6214 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:38:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:11 smithi049 bash[23528]: audit 2024-09-21T00:38:10.666711+0000 mon.a (mon.0) 5488 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:38:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:11 smithi049 bash[23528]: audit 2024-09-21T00:38:10.677961+0000 mon.a (mon.0) 5489 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:38:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:11 smithi049 bash[23528]: audit 2024-09-21T00:38:10.679818+0000 mon.a (mon.0) 5490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:38:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:11 smithi049 bash[23528]: audit 2024-09-21T00:38:10.690868+0000 mon.a (mon.0) 5491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:11 smithi049 bash[23528]: audit 2024-09-21T00:38:10.697301+0000 mon.a (mon.0) 5492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:38:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:11 smithi049 bash[23528]: audit 2024-09-21T00:38:10.699630+0000 mgr.a (mgr.14388) 6215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:38:11.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22930]: debug 2024-09-21T00:38:11.482+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:38:11.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22930]: debug 2024-09-21T00:38:11.482+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:38:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22676]: cluster 2024-09-21T00:38:10.453772+0000 mgr.a (mgr.14388) 6214 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:38:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22676]: audit 2024-09-21T00:38:10.666711+0000 mon.a (mon.0) 5488 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:38:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22676]: audit 2024-09-21T00:38:10.677961+0000 mon.a (mon.0) 5489 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:38:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22676]: audit 2024-09-21T00:38:10.679818+0000 mon.a (mon.0) 5490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:38:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22676]: audit 2024-09-21T00:38:10.690868+0000 mon.a (mon.0) 5491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22676]: audit 2024-09-21T00:38:10.697301+0000 mon.a (mon.0) 5492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:38:11.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:11 smithi044 bash[22676]: audit 2024-09-21T00:38:10.699630+0000 mgr.a (mgr.14388) 6215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:38:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:11 smithi179 bash[23186]: cluster 2024-09-21T00:38:10.453772+0000 mgr.a (mgr.14388) 6214 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:38:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:11 smithi179 bash[23186]: audit 2024-09-21T00:38:10.666711+0000 mon.a (mon.0) 5488 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:38:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:11 smithi179 bash[23186]: audit 2024-09-21T00:38:10.677961+0000 mon.a (mon.0) 5489 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:38:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:11 smithi179 bash[23186]: audit 2024-09-21T00:38:10.679818+0000 mon.a (mon.0) 5490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:38:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:11 smithi179 bash[23186]: audit 2024-09-21T00:38:10.690868+0000 mon.a (mon.0) 5491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:11 smithi179 bash[23186]: audit 2024-09-21T00:38:10.697301+0000 mon.a (mon.0) 5492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:38:12.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:11 smithi179 bash[23186]: audit 2024-09-21T00:38:10.699630+0000 mgr.a (mgr.14388) 6215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:38:12.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:12.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:12.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:12.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:12.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:12.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:12 smithi049 bash[23528]: audit 2024-09-21T00:38:11.487353+0000 mgr.a (mgr.14388) 6216 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:38:12.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:12 smithi049 bash[23528]: cephadm 2024-09-21T00:38:11.488733+0000 mgr.a (mgr.14388) 6217 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:38:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:12 smithi044 bash[22676]: audit 2024-09-21T00:38:11.487353+0000 mgr.a (mgr.14388) 6216 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:38:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:12 smithi044 bash[22676]: cephadm 2024-09-21T00:38:11.488733+0000 mgr.a (mgr.14388) 6217 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:38:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:12 smithi179 bash[23186]: audit 2024-09-21T00:38:11.487353+0000 mgr.a (mgr.14388) 6216 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:38:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:12 smithi179 bash[23186]: cephadm 2024-09-21T00:38:11.488733+0000 mgr.a (mgr.14388) 6217 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:38:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:13 smithi049 bash[23528]: audit 2024-09-21T00:38:12.050918+0000 mgr.a (mgr.14388) 6218 : audit [DBG] from='client.142914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:13.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:13 smithi049 bash[23528]: cluster 2024-09-21T00:38:12.454253+0000 mgr.a (mgr.14388) 6219 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:13 smithi044 bash[22676]: audit 2024-09-21T00:38:12.050918+0000 mgr.a (mgr.14388) 6218 : audit [DBG] from='client.142914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:13 smithi044 bash[22676]: cluster 2024-09-21T00:38:12.454253+0000 mgr.a (mgr.14388) 6219 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:13 smithi179 bash[23186]: audit 2024-09-21T00:38:12.050918+0000 mgr.a (mgr.14388) 6218 : audit [DBG] from='client.142914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:13 smithi179 bash[23186]: cluster 2024-09-21T00:38:12.454253+0000 mgr.a (mgr.14388) 6219 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:15.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:15 smithi049 bash[23528]: cluster 2024-09-21T00:38:14.454999+0000 mgr.a (mgr.14388) 6220 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:15 smithi044 bash[22676]: cluster 2024-09-21T00:38:14.454999+0000 mgr.a (mgr.14388) 6220 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:15 smithi179 bash[23186]: cluster 2024-09-21T00:38:14.454999+0000 mgr.a (mgr.14388) 6220 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:17.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:17.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:17 smithi049 bash[23528]: cluster 2024-09-21T00:38:16.457276+0000 mgr.a (mgr.14388) 6221 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:17 smithi044 bash[22676]: cluster 2024-09-21T00:38:16.457276+0000 mgr.a (mgr.14388) 6221 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:17 smithi179 bash[23186]: cluster 2024-09-21T00:38:16.457276+0000 mgr.a (mgr.14388) 6221 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:18.234 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:18.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:18.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:18.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:18.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:19.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:19 smithi049 bash[23528]: audit 2024-09-21T00:38:17.811616+0000 mgr.a (mgr.14388) 6222 : audit [DBG] from='client.142992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:19.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:19 smithi049 bash[23528]: cluster 2024-09-21T00:38:18.458236+0000 mgr.a (mgr.14388) 6223 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:19 smithi044 bash[22676]: audit 2024-09-21T00:38:17.811616+0000 mgr.a (mgr.14388) 6222 : audit [DBG] from='client.142992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:19 smithi044 bash[22676]: cluster 2024-09-21T00:38:18.458236+0000 mgr.a (mgr.14388) 6223 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:19 smithi179 bash[23186]: audit 2024-09-21T00:38:17.811616+0000 mgr.a (mgr.14388) 6222 : audit [DBG] from='client.142992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:19 smithi179 bash[23186]: cluster 2024-09-21T00:38:18.458236+0000 mgr.a (mgr.14388) 6223 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:21.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:21 smithi044 bash[22676]: cluster 2024-09-21T00:38:20.460477+0000 mgr.a (mgr.14388) 6224 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:21.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:21 smithi049 bash[23528]: cluster 2024-09-21T00:38:20.460477+0000 mgr.a (mgr.14388) 6224 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:21 smithi179 bash[23186]: cluster 2024-09-21T00:38:20.460477+0000 mgr.a (mgr.14388) 6224 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:23.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:23.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:23.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:23 smithi179 bash[23186]: audit 2024-09-21T00:38:22.377162+0000 mon.a (mon.0) 5493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:23 smithi179 bash[23186]: audit 2024-09-21T00:38:22.386610+0000 mon.a (mon.0) 5494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:23 smithi179 bash[23186]: audit 2024-09-21T00:38:22.396956+0000 mon.a (mon.0) 5495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:23 smithi179 bash[23186]: cluster 2024-09-21T00:38:22.461267+0000 mgr.a (mgr.14388) 6225 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:23 smithi179 bash[23186]: audit 2024-09-21T00:38:23.309638+0000 mon.a (mon.0) 5496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:23 smithi179 bash[23186]: audit 2024-09-21T00:38:23.315595+0000 mon.a (mon.0) 5497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:23 smithi179 bash[23186]: audit 2024-09-21T00:38:23.323186+0000 mon.a (mon.0) 5498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:23 smithi044 bash[22676]: audit 2024-09-21T00:38:22.377162+0000 mon.a (mon.0) 5493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:23 smithi044 bash[22676]: audit 2024-09-21T00:38:22.386610+0000 mon.a (mon.0) 5494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:23 smithi044 bash[22676]: audit 2024-09-21T00:38:22.396956+0000 mon.a (mon.0) 5495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:23 smithi044 bash[22676]: cluster 2024-09-21T00:38:22.461267+0000 mgr.a (mgr.14388) 6225 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:23 smithi044 bash[22676]: audit 2024-09-21T00:38:23.309638+0000 mon.a (mon.0) 5496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:23 smithi044 bash[22676]: audit 2024-09-21T00:38:23.315595+0000 mon.a (mon.0) 5497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:23 smithi044 bash[22676]: audit 2024-09-21T00:38:23.323186+0000 mon.a (mon.0) 5498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:23 smithi049 bash[23528]: audit 2024-09-21T00:38:22.377162+0000 mon.a (mon.0) 5493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:23 smithi049 bash[23528]: audit 2024-09-21T00:38:22.386610+0000 mon.a (mon.0) 5494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:23 smithi049 bash[23528]: audit 2024-09-21T00:38:22.396956+0000 mon.a (mon.0) 5495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:23 smithi049 bash[23528]: cluster 2024-09-21T00:38:22.461267+0000 mgr.a (mgr.14388) 6225 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:23 smithi049 bash[23528]: audit 2024-09-21T00:38:23.309638+0000 mon.a (mon.0) 5496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:23 smithi049 bash[23528]: audit 2024-09-21T00:38:23.315595+0000 mon.a (mon.0) 5497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:23.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:23 smithi049 bash[23528]: audit 2024-09-21T00:38:23.323186+0000 mon.a (mon.0) 5498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.034 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:24 smithi044 bash[22676]: audit 2024-09-21T00:38:23.570189+0000 mgr.a (mgr.14388) 6226 : audit [DBG] from='client.143070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:24 smithi044 bash[22676]: audit 2024-09-21T00:38:24.005968+0000 mon.a (mon.0) 5499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:24 smithi044 bash[22676]: audit 2024-09-21T00:38:24.012297+0000 mon.a (mon.0) 5500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:24 smithi044 bash[22676]: audit 2024-09-21T00:38:24.018082+0000 mon.a (mon.0) 5501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:24 smithi179 bash[23186]: audit 2024-09-21T00:38:23.570189+0000 mgr.a (mgr.14388) 6226 : audit [DBG] from='client.143070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:24 smithi179 bash[23186]: audit 2024-09-21T00:38:24.005968+0000 mon.a (mon.0) 5499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:24 smithi179 bash[23186]: audit 2024-09-21T00:38:24.012297+0000 mon.a (mon.0) 5500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:24 smithi179 bash[23186]: audit 2024-09-21T00:38:24.018082+0000 mon.a (mon.0) 5501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:24 smithi049 bash[23528]: audit 2024-09-21T00:38:23.570189+0000 mgr.a (mgr.14388) 6226 : audit [DBG] from='client.143070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:24.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:24 smithi049 bash[23528]: audit 2024-09-21T00:38:24.005968+0000 mon.a (mon.0) 5499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:24 smithi049 bash[23528]: audit 2024-09-21T00:38:24.012297+0000 mon.a (mon.0) 5500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:24.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:24 smithi049 bash[23528]: audit 2024-09-21T00:38:24.018082+0000 mon.a (mon.0) 5501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:25 smithi044 bash[22676]: cluster 2024-09-21T00:38:24.462207+0000 mgr.a (mgr.14388) 6227 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:25 smithi179 bash[23186]: cluster 2024-09-21T00:38:24.462207+0000 mgr.a (mgr.14388) 6227 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:25.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:25 smithi049 bash[23528]: cluster 2024-09-21T00:38:24.462207+0000 mgr.a (mgr.14388) 6227 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:27.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:27 smithi049 bash[23528]: cluster 2024-09-21T00:38:26.464508+0000 mgr.a (mgr.14388) 6228 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:27 smithi044 bash[22676]: cluster 2024-09-21T00:38:26.464508+0000 mgr.a (mgr.14388) 6228 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:27 smithi179 bash[23186]: cluster 2024-09-21T00:38:26.464508+0000 mgr.a (mgr.14388) 6228 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:38:29.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:29.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:29.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:29 smithi049 bash[23528]: cluster 2024-09-21T00:38:28.465321+0000 mgr.a (mgr.14388) 6229 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:29.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:29 smithi044 bash[22676]: cluster 2024-09-21T00:38:28.465321+0000 mgr.a (mgr.14388) 6229 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:29 smithi179 bash[23186]: cluster 2024-09-21T00:38:28.465321+0000 mgr.a (mgr.14388) 6229 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:30.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:30 smithi049 bash[23528]: audit 2024-09-21T00:38:29.376407+0000 mgr.a (mgr.14388) 6230 : audit [DBG] from='client.143148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:30 smithi044 bash[22676]: audit 2024-09-21T00:38:29.376407+0000 mgr.a (mgr.14388) 6230 : audit [DBG] from='client.143148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:30 smithi179 bash[23186]: audit 2024-09-21T00:38:29.376407+0000 mgr.a (mgr.14388) 6230 : audit [DBG] from='client.143148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:31.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:31 smithi049 bash[23528]: cluster 2024-09-21T00:38:30.467680+0000 mgr.a (mgr.14388) 6231 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:31 smithi044 bash[22676]: cluster 2024-09-21T00:38:30.467680+0000 mgr.a (mgr.14388) 6231 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:31 smithi179 bash[23186]: cluster 2024-09-21T00:38:30.467680+0000 mgr.a (mgr.14388) 6231 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:33.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:33 smithi049 bash[23528]: cluster 2024-09-21T00:38:32.468459+0000 mgr.a (mgr.14388) 6232 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:33 smithi044 bash[22676]: cluster 2024-09-21T00:38:32.468459+0000 mgr.a (mgr.14388) 6232 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:33 smithi179 bash[23186]: cluster 2024-09-21T00:38:32.468459+0000 mgr.a (mgr.14388) 6232 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:34.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:34.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:34.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:35.614 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:35.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:35 smithi049 bash[23528]: cluster 2024-09-21T00:38:34.469223+0000 mgr.a (mgr.14388) 6233 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:35 smithi044 bash[22676]: cluster 2024-09-21T00:38:34.469223+0000 mgr.a (mgr.14388) 6233 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:35 smithi179 bash[23186]: cluster 2024-09-21T00:38:34.469223+0000 mgr.a (mgr.14388) 6233 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:36 smithi044 bash[22676]: audit 2024-09-21T00:38:35.148773+0000 mgr.a (mgr.14388) 6234 : audit [DBG] from='client.143226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:36 smithi179 bash[23186]: audit 2024-09-21T00:38:35.148773+0000 mgr.a (mgr.14388) 6234 : audit [DBG] from='client.143226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:36 smithi049 bash[23528]: audit 2024-09-21T00:38:35.148773+0000 mgr.a (mgr.14388) 6234 : audit [DBG] from='client.143226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:37 smithi044 bash[22676]: cluster 2024-09-21T00:38:36.472190+0000 mgr.a (mgr.14388) 6235 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:37 smithi179 bash[23186]: cluster 2024-09-21T00:38:36.472190+0000 mgr.a (mgr.14388) 6235 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:37 smithi049 bash[23528]: cluster 2024-09-21T00:38:36.472190+0000 mgr.a (mgr.14388) 6235 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:39.884 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:39 smithi179 bash[23186]: cluster 2024-09-21T00:38:38.473180+0000 mgr.a (mgr.14388) 6236 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:39 smithi044 bash[22676]: cluster 2024-09-21T00:38:38.473180+0000 mgr.a (mgr.14388) 6236 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:39 smithi049 bash[23528]: cluster 2024-09-21T00:38:38.473180+0000 mgr.a (mgr.14388) 6236 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:40.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:40.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:40.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:41.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:41.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:41.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:41.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:41.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:41.730 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:41 smithi044 bash[22676]: cluster 2024-09-21T00:38:40.475380+0000 mgr.a (mgr.14388) 6237 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:41 smithi179 bash[23186]: cluster 2024-09-21T00:38:40.475380+0000 mgr.a (mgr.14388) 6237 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:41 smithi049 bash[23528]: cluster 2024-09-21T00:38:40.475380+0000 mgr.a (mgr.14388) 6237 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:42.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:42 smithi179 bash[23186]: audit 2024-09-21T00:38:40.947951+0000 mgr.a (mgr.14388) 6238 : audit [DBG] from='client.143301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:42 smithi044 bash[22676]: audit 2024-09-21T00:38:40.947951+0000 mgr.a (mgr.14388) 6238 : audit [DBG] from='client.143301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:43.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:42 smithi049 bash[23528]: audit 2024-09-21T00:38:40.947951+0000 mgr.a (mgr.14388) 6238 : audit [DBG] from='client.143301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:43 smithi044 bash[22676]: cluster 2024-09-21T00:38:42.476331+0000 mgr.a (mgr.14388) 6239 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:43 smithi044 bash[22676]: audit 2024-09-21T00:38:42.584618+0000 mon.a (mon.0) 5502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:43 smithi044 bash[22676]: audit 2024-09-21T00:38:42.594448+0000 mon.a (mon.0) 5503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:43 smithi044 bash[22676]: audit 2024-09-21T00:38:42.605518+0000 mon.a (mon.0) 5504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:43 smithi044 bash[22676]: audit 2024-09-21T00:38:43.535811+0000 mon.a (mon.0) 5505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:43 smithi044 bash[22676]: audit 2024-09-21T00:38:43.542144+0000 mon.a (mon.0) 5506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:43 smithi044 bash[22676]: audit 2024-09-21T00:38:43.547824+0000 mon.a (mon.0) 5507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:43 smithi179 bash[23186]: cluster 2024-09-21T00:38:42.476331+0000 mgr.a (mgr.14388) 6239 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:43 smithi179 bash[23186]: audit 2024-09-21T00:38:42.584618+0000 mon.a (mon.0) 5502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:43 smithi179 bash[23186]: audit 2024-09-21T00:38:42.594448+0000 mon.a (mon.0) 5503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:43 smithi179 bash[23186]: audit 2024-09-21T00:38:42.605518+0000 mon.a (mon.0) 5504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:43 smithi179 bash[23186]: audit 2024-09-21T00:38:43.535811+0000 mon.a (mon.0) 5505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:43 smithi179 bash[23186]: audit 2024-09-21T00:38:43.542144+0000 mon.a (mon.0) 5506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:43 smithi179 bash[23186]: audit 2024-09-21T00:38:43.547824+0000 mon.a (mon.0) 5507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:43 smithi049 bash[23528]: cluster 2024-09-21T00:38:42.476331+0000 mgr.a (mgr.14388) 6239 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:43 smithi049 bash[23528]: audit 2024-09-21T00:38:42.584618+0000 mon.a (mon.0) 5502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:43 smithi049 bash[23528]: audit 2024-09-21T00:38:42.594448+0000 mon.a (mon.0) 5503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:43 smithi049 bash[23528]: audit 2024-09-21T00:38:42.605518+0000 mon.a (mon.0) 5504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:43 smithi049 bash[23528]: audit 2024-09-21T00:38:43.535811+0000 mon.a (mon.0) 5505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:43 smithi049 bash[23528]: audit 2024-09-21T00:38:43.542144+0000 mon.a (mon.0) 5506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:43 smithi049 bash[23528]: audit 2024-09-21T00:38:43.547824+0000 mon.a (mon.0) 5507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:45 smithi044 bash[22676]: audit 2024-09-21T00:38:44.142851+0000 mon.a (mon.0) 5508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:45 smithi044 bash[22676]: audit 2024-09-21T00:38:44.147915+0000 mon.a (mon.0) 5509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:45 smithi044 bash[22676]: audit 2024-09-21T00:38:44.153502+0000 mon.a (mon.0) 5510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:45 smithi044 bash[22676]: cluster 2024-09-21T00:38:44.476842+0000 mgr.a (mgr.14388) 6240 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:45 smithi179 bash[23186]: audit 2024-09-21T00:38:44.142851+0000 mon.a (mon.0) 5508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:45 smithi179 bash[23186]: audit 2024-09-21T00:38:44.147915+0000 mon.a (mon.0) 5509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:45 smithi179 bash[23186]: audit 2024-09-21T00:38:44.153502+0000 mon.a (mon.0) 5510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:45 smithi179 bash[23186]: cluster 2024-09-21T00:38:44.476842+0000 mgr.a (mgr.14388) 6240 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:45.597 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:45 smithi049 bash[23528]: audit 2024-09-21T00:38:44.142851+0000 mon.a (mon.0) 5508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.597 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:45 smithi049 bash[23528]: audit 2024-09-21T00:38:44.147915+0000 mon.a (mon.0) 5509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.597 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:45 smithi049 bash[23528]: audit 2024-09-21T00:38:44.153502+0000 mon.a (mon.0) 5510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:38:45.597 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:45 smithi049 bash[23528]: cluster 2024-09-21T00:38:44.476842+0000 mgr.a (mgr.14388) 6240 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:38:46.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:46.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:47.178 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:47.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:47.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:47.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:47.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:47.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:47 smithi049 bash[23528]: cluster 2024-09-21T00:38:46.477854+0000 mgr.a (mgr.14388) 6241 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:47.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:47 smithi049 bash[23528]: audit 2024-09-21T00:38:46.718581+0000 mgr.a (mgr.14388) 6242 : audit [DBG] from='client.143379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:47 smithi044 bash[22676]: cluster 2024-09-21T00:38:46.477854+0000 mgr.a (mgr.14388) 6241 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:47 smithi044 bash[22676]: audit 2024-09-21T00:38:46.718581+0000 mgr.a (mgr.14388) 6242 : audit [DBG] from='client.143379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:47 smithi179 bash[23186]: cluster 2024-09-21T00:38:46.477854+0000 mgr.a (mgr.14388) 6241 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:47 smithi179 bash[23186]: audit 2024-09-21T00:38:46.718581+0000 mgr.a (mgr.14388) 6242 : audit [DBG] from='client.143379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:49.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:49 smithi049 bash[23528]: cluster 2024-09-21T00:38:48.478736+0000 mgr.a (mgr.14388) 6243 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:49 smithi044 bash[22676]: cluster 2024-09-21T00:38:48.478736+0000 mgr.a (mgr.14388) 6243 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:49 smithi179 bash[23186]: cluster 2024-09-21T00:38:48.478736+0000 mgr.a (mgr.14388) 6243 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:51.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:51 smithi049 bash[23528]: cluster 2024-09-21T00:38:50.480944+0000 mgr.a (mgr.14388) 6244 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:51 smithi044 bash[22676]: cluster 2024-09-21T00:38:50.480944+0000 mgr.a (mgr.14388) 6244 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:51 smithi179 bash[23186]: cluster 2024-09-21T00:38:50.480944+0000 mgr.a (mgr.14388) 6244 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:52.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:52.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:52.180 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:52.960 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:53 smithi044 bash[22676]: cluster 2024-09-21T00:38:52.481710+0000 mgr.a (mgr.14388) 6245 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:53 smithi044 bash[22676]: audit 2024-09-21T00:38:52.512055+0000 mgr.a (mgr.14388) 6246 : audit [DBG] from='client.143454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:53 smithi179 bash[23186]: cluster 2024-09-21T00:38:52.481710+0000 mgr.a (mgr.14388) 6245 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:53 smithi179 bash[23186]: audit 2024-09-21T00:38:52.512055+0000 mgr.a (mgr.14388) 6246 : audit [DBG] from='client.143454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:53 smithi049 bash[23528]: cluster 2024-09-21T00:38:52.481710+0000 mgr.a (mgr.14388) 6245 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:53 smithi049 bash[23528]: audit 2024-09-21T00:38:52.512055+0000 mgr.a (mgr.14388) 6246 : audit [DBG] from='client.143454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:55 smithi044 bash[22676]: cluster 2024-09-21T00:38:54.482614+0000 mgr.a (mgr.14388) 6247 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:55 smithi179 bash[23186]: cluster 2024-09-21T00:38:54.482614+0000 mgr.a (mgr.14388) 6247 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:55 smithi049 bash[23528]: cluster 2024-09-21T00:38:54.482614+0000 mgr.a (mgr.14388) 6247 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:57.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:38:57.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:38:57.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:38:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:57 smithi044 bash[22676]: cluster 2024-09-21T00:38:56.484845+0000 mgr.a (mgr.14388) 6248 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:57 smithi179 bash[23186]: cluster 2024-09-21T00:38:56.484845+0000 mgr.a (mgr.14388) 6248 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:58.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:57 smithi049 bash[23528]: cluster 2024-09-21T00:38:56.484845+0000 mgr.a (mgr.14388) 6248 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:38:58.736 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:38:58.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:38:58.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:38:58.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:38:58.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:38:59.967 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:59 smithi179 bash[23186]: audit 2024-09-21T00:38:58.298716+0000 mgr.a (mgr.14388) 6249 : audit [DBG] from='client.143532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:59.967 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:38:59 smithi179 bash[23186]: cluster 2024-09-21T00:38:58.485583+0000 mgr.a (mgr.14388) 6250 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:38:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:59 smithi044 bash[22676]: audit 2024-09-21T00:38:58.298716+0000 mgr.a (mgr.14388) 6249 : audit [DBG] from='client.143532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:38:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:38:59 smithi044 bash[22676]: cluster 2024-09-21T00:38:58.485583+0000 mgr.a (mgr.14388) 6250 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:59 smithi049 bash[23528]: audit 2024-09-21T00:38:58.298716+0000 mgr.a (mgr.14388) 6249 : audit [DBG] from='client.143532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:38:59 smithi049 bash[23528]: cluster 2024-09-21T00:38:58.485583+0000 mgr.a (mgr.14388) 6250 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:01.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:01 smithi044 bash[22676]: cluster 2024-09-21T00:39:00.487863+0000 mgr.a (mgr.14388) 6251 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:01 smithi179 bash[23186]: cluster 2024-09-21T00:39:00.487863+0000 mgr.a (mgr.14388) 6251 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:02.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:01 smithi049 bash[23528]: cluster 2024-09-21T00:39:00.487863+0000 mgr.a (mgr.14388) 6251 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:03.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:03.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:03.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:04.034 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:03 smithi044 bash[22676]: cluster 2024-09-21T00:39:02.488669+0000 mgr.a (mgr.14388) 6252 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:04.034 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:03 smithi044 bash[22676]: audit 2024-09-21T00:39:02.782488+0000 mon.a (mon.0) 5511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.034 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:03 smithi044 bash[22676]: audit 2024-09-21T00:39:02.792081+0000 mon.a (mon.0) 5512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.034 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:03 smithi044 bash[22676]: audit 2024-09-21T00:39:02.802550+0000 mon.a (mon.0) 5513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.034 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:03 smithi044 bash[22676]: audit 2024-09-21T00:39:03.747507+0000 mon.a (mon.0) 5514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.034 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:03 smithi044 bash[22676]: audit 2024-09-21T00:39:03.753347+0000 mon.a (mon.0) 5515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.034 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:03 smithi044 bash[22676]: audit 2024-09-21T00:39:03.760723+0000 mon.a (mon.0) 5516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:03 smithi049 bash[23528]: cluster 2024-09-21T00:39:02.488669+0000 mgr.a (mgr.14388) 6252 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:03 smithi049 bash[23528]: audit 2024-09-21T00:39:02.782488+0000 mon.a (mon.0) 5511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:03 smithi049 bash[23528]: audit 2024-09-21T00:39:02.792081+0000 mon.a (mon.0) 5512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:03 smithi049 bash[23528]: audit 2024-09-21T00:39:02.802550+0000 mon.a (mon.0) 5513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:03 smithi049 bash[23528]: audit 2024-09-21T00:39:03.747507+0000 mon.a (mon.0) 5514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:03 smithi049 bash[23528]: audit 2024-09-21T00:39:03.753347+0000 mon.a (mon.0) 5515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:03 smithi049 bash[23528]: audit 2024-09-21T00:39:03.760723+0000 mon.a (mon.0) 5516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:03 smithi179 bash[23186]: cluster 2024-09-21T00:39:02.488669+0000 mgr.a (mgr.14388) 6252 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:03 smithi179 bash[23186]: audit 2024-09-21T00:39:02.782488+0000 mon.a (mon.0) 5511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:03 smithi179 bash[23186]: audit 2024-09-21T00:39:02.792081+0000 mon.a (mon.0) 5512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:03 smithi179 bash[23186]: audit 2024-09-21T00:39:02.802550+0000 mon.a (mon.0) 5513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:03 smithi179 bash[23186]: audit 2024-09-21T00:39:03.747507+0000 mon.a (mon.0) 5514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:03 smithi179 bash[23186]: audit 2024-09-21T00:39:03.753347+0000 mon.a (mon.0) 5515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:03 smithi179 bash[23186]: audit 2024-09-21T00:39:03.760723+0000 mon.a (mon.0) 5516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:04.477 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:04.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:04.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:04.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:04.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:05 smithi049 bash[23528]: audit 2024-09-21T00:39:04.060970+0000 mgr.a (mgr.14388) 6253 : audit [DBG] from='client.143607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:05 smithi049 bash[23528]: audit 2024-09-21T00:39:04.292186+0000 mon.a (mon.0) 5517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:05 smithi049 bash[23528]: audit 2024-09-21T00:39:04.298243+0000 mon.a (mon.0) 5518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:05 smithi049 bash[23528]: audit 2024-09-21T00:39:04.303771+0000 mon.a (mon.0) 5519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:05 smithi049 bash[23528]: cluster 2024-09-21T00:39:04.489262+0000 mgr.a (mgr.14388) 6254 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:05 smithi044 bash[22676]: audit 2024-09-21T00:39:04.060970+0000 mgr.a (mgr.14388) 6253 : audit [DBG] from='client.143607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:05 smithi044 bash[22676]: audit 2024-09-21T00:39:04.292186+0000 mon.a (mon.0) 5517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:05 smithi044 bash[22676]: audit 2024-09-21T00:39:04.298243+0000 mon.a (mon.0) 5518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:05 smithi044 bash[22676]: audit 2024-09-21T00:39:04.303771+0000 mon.a (mon.0) 5519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:05 smithi044 bash[22676]: cluster 2024-09-21T00:39:04.489262+0000 mgr.a (mgr.14388) 6254 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:05 smithi179 bash[23186]: audit 2024-09-21T00:39:04.060970+0000 mgr.a (mgr.14388) 6253 : audit [DBG] from='client.143607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:05 smithi179 bash[23186]: audit 2024-09-21T00:39:04.292186+0000 mon.a (mon.0) 5517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:05 smithi179 bash[23186]: audit 2024-09-21T00:39:04.298243+0000 mon.a (mon.0) 5518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:05 smithi179 bash[23186]: audit 2024-09-21T00:39:04.303771+0000 mon.a (mon.0) 5519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:05 smithi179 bash[23186]: cluster 2024-09-21T00:39:04.489262+0000 mgr.a (mgr.14388) 6254 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:07.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:07 smithi049 bash[23528]: cluster 2024-09-21T00:39:06.491466+0000 mgr.a (mgr.14388) 6255 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:07 smithi044 bash[22676]: cluster 2024-09-21T00:39:06.491466+0000 mgr.a (mgr.14388) 6255 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:07 smithi179 bash[23186]: cluster 2024-09-21T00:39:06.491466+0000 mgr.a (mgr.14388) 6255 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:09.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:09.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:09 smithi049 bash[23528]: cluster 2024-09-21T00:39:08.492284+0000 mgr.a (mgr.14388) 6256 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:09 smithi044 bash[22676]: cluster 2024-09-21T00:39:08.492284+0000 mgr.a (mgr.14388) 6256 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:09 smithi179 bash[23186]: cluster 2024-09-21T00:39:08.492284+0000 mgr.a (mgr.14388) 6256 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:10.232 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:11 smithi044 bash[22676]: audit 2024-09-21T00:39:09.813529+0000 mgr.a (mgr.14388) 6257 : audit [DBG] from='client.143685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:11 smithi044 bash[22676]: cluster 2024-09-21T00:39:10.495090+0000 mgr.a (mgr.14388) 6258 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:11 smithi179 bash[23186]: audit 2024-09-21T00:39:09.813529+0000 mgr.a (mgr.14388) 6257 : audit [DBG] from='client.143685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:11 smithi179 bash[23186]: cluster 2024-09-21T00:39:10.495090+0000 mgr.a (mgr.14388) 6258 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:12.026 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:11 smithi049 bash[23528]: audit 2024-09-21T00:39:09.813529+0000 mgr.a (mgr.14388) 6257 : audit [DBG] from='client.143685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:12.026 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:11 smithi049 bash[23528]: cluster 2024-09-21T00:39:10.495090+0000 mgr.a (mgr.14388) 6258 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:12.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22930]: debug 2024-09-21T00:39:12.341+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:39:12.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22930]: debug 2024-09-21T00:39:12.341+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:39:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22676]: audit 2024-09-21T00:39:11.563914+0000 mon.a (mon.0) 5520 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:39:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22676]: audit 2024-09-21T00:39:11.570841+0000 mon.a (mon.0) 5521 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:39:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22676]: audit 2024-09-21T00:39:11.572710+0000 mon.a (mon.0) 5522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:39:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22676]: audit 2024-09-21T00:39:11.583707+0000 mon.a (mon.0) 5523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22676]: audit 2024-09-21T00:39:11.590168+0000 mon.a (mon.0) 5524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:39:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:12 smithi044 bash[22676]: audit 2024-09-21T00:39:11.592816+0000 mgr.a (mgr.14388) 6259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:39:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:12 smithi179 bash[23186]: audit 2024-09-21T00:39:11.563914+0000 mon.a (mon.0) 5520 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:39:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:12 smithi179 bash[23186]: audit 2024-09-21T00:39:11.570841+0000 mon.a (mon.0) 5521 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:39:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:12 smithi179 bash[23186]: audit 2024-09-21T00:39:11.572710+0000 mon.a (mon.0) 5522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:39:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:12 smithi179 bash[23186]: audit 2024-09-21T00:39:11.583707+0000 mon.a (mon.0) 5523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:12 smithi179 bash[23186]: audit 2024-09-21T00:39:11.590168+0000 mon.a (mon.0) 5524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:39:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:12 smithi179 bash[23186]: audit 2024-09-21T00:39:11.592816+0000 mgr.a (mgr.14388) 6259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:39:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:12 smithi049 bash[23528]: audit 2024-09-21T00:39:11.563914+0000 mon.a (mon.0) 5520 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:39:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:12 smithi049 bash[23528]: audit 2024-09-21T00:39:11.570841+0000 mon.a (mon.0) 5521 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:39:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:12 smithi049 bash[23528]: audit 2024-09-21T00:39:11.572710+0000 mon.a (mon.0) 5522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:39:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:12 smithi049 bash[23528]: audit 2024-09-21T00:39:11.583707+0000 mon.a (mon.0) 5523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:12 smithi049 bash[23528]: audit 2024-09-21T00:39:11.590168+0000 mon.a (mon.0) 5524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:39:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:12 smithi049 bash[23528]: audit 2024-09-21T00:39:11.592816+0000 mgr.a (mgr.14388) 6259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:39:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:13 smithi044 bash[22676]: audit 2024-09-21T00:39:12.346146+0000 mgr.a (mgr.14388) 6260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:39:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:13 smithi044 bash[22676]: cephadm 2024-09-21T00:39:12.347535+0000 mgr.a (mgr.14388) 6261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:39:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:13 smithi044 bash[22676]: cluster 2024-09-21T00:39:12.496074+0000 mgr.a (mgr.14388) 6262 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:39:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:13 smithi179 bash[23186]: audit 2024-09-21T00:39:12.346146+0000 mgr.a (mgr.14388) 6260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:39:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:13 smithi179 bash[23186]: cephadm 2024-09-21T00:39:12.347535+0000 mgr.a (mgr.14388) 6261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:39:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:13 smithi179 bash[23186]: cluster 2024-09-21T00:39:12.496074+0000 mgr.a (mgr.14388) 6262 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:39:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:13 smithi049 bash[23528]: audit 2024-09-21T00:39:12.346146+0000 mgr.a (mgr.14388) 6260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:39:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:13 smithi049 bash[23528]: cephadm 2024-09-21T00:39:12.347535+0000 mgr.a (mgr.14388) 6261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:39:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:13 smithi049 bash[23528]: cluster 2024-09-21T00:39:12.496074+0000 mgr.a (mgr.14388) 6262 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:39:15.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:15.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:15.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:15 smithi044 bash[22676]: cluster 2024-09-21T00:39:14.496863+0000 mgr.a (mgr.14388) 6263 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:15 smithi179 bash[23186]: cluster 2024-09-21T00:39:14.496863+0000 mgr.a (mgr.14388) 6263 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:16.019 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:15 smithi049 bash[23528]: cluster 2024-09-21T00:39:14.496863+0000 mgr.a (mgr.14388) 6263 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:16 smithi044 bash[22676]: audit 2024-09-21T00:39:15.576856+0000 mgr.a (mgr.14388) 6264 : audit [DBG] from='client.143868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:16 smithi179 bash[23186]: audit 2024-09-21T00:39:15.576856+0000 mgr.a (mgr.14388) 6264 : audit [DBG] from='client.143868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:17.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:16 smithi049 bash[23528]: audit 2024-09-21T00:39:15.576856+0000 mgr.a (mgr.14388) 6264 : audit [DBG] from='client.143868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:17 smithi044 bash[22676]: cluster 2024-09-21T00:39:16.499889+0000 mgr.a (mgr.14388) 6265 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:17 smithi179 bash[23186]: cluster 2024-09-21T00:39:16.499889+0000 mgr.a (mgr.14388) 6265 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:18.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:17 smithi049 bash[23528]: cluster 2024-09-21T00:39:16.499889+0000 mgr.a (mgr.14388) 6265 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:19 smithi044 bash[22676]: cluster 2024-09-21T00:39:18.500728+0000 mgr.a (mgr.14388) 6266 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:39:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:19 smithi179 bash[23186]: cluster 2024-09-21T00:39:18.500728+0000 mgr.a (mgr.14388) 6266 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:39:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:19 smithi049 bash[23528]: cluster 2024-09-21T00:39:18.500728+0000 mgr.a (mgr.14388) 6266 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:39:21.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:21 smithi179 bash[23186]: cluster 2024-09-21T00:39:20.502820+0000 mgr.a (mgr.14388) 6267 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:21.787 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:21.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:21.879 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:21 smithi044 bash[22676]: cluster 2024-09-21T00:39:20.502820+0000 mgr.a (mgr.14388) 6267 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:21 smithi049 bash[23528]: cluster 2024-09-21T00:39:20.502820+0000 mgr.a (mgr.14388) 6267 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:22.887 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:22 smithi179 bash[23186]: audit 2024-09-21T00:39:21.357498+0000 mgr.a (mgr.14388) 6268 : audit [DBG] from='client.143943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:22 smithi044 bash[22676]: audit 2024-09-21T00:39:21.357498+0000 mgr.a (mgr.14388) 6268 : audit [DBG] from='client.143943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:23.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:22 smithi049 bash[23528]: audit 2024-09-21T00:39:21.357498+0000 mgr.a (mgr.14388) 6268 : audit [DBG] from='client.143943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:23 smithi044 bash[22676]: cluster 2024-09-21T00:39:22.503399+0000 mgr.a (mgr.14388) 6269 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:23 smithi044 bash[22676]: audit 2024-09-21T00:39:22.959589+0000 mon.a (mon.0) 5525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:23 smithi044 bash[22676]: audit 2024-09-21T00:39:22.967993+0000 mon.a (mon.0) 5526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:23 smithi044 bash[22676]: audit 2024-09-21T00:39:22.978798+0000 mon.a (mon.0) 5527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:23.983 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:23 smithi049 bash[23528]: cluster 2024-09-21T00:39:22.503399+0000 mgr.a (mgr.14388) 6269 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:23.983 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:23 smithi049 bash[23528]: audit 2024-09-21T00:39:22.959589+0000 mon.a (mon.0) 5525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:23.983 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:23 smithi049 bash[23528]: audit 2024-09-21T00:39:22.967993+0000 mon.a (mon.0) 5526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:23.983 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:23 smithi049 bash[23528]: audit 2024-09-21T00:39:22.978798+0000 mon.a (mon.0) 5527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:23 smithi179 bash[23186]: cluster 2024-09-21T00:39:22.503399+0000 mgr.a (mgr.14388) 6269 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:23 smithi179 bash[23186]: audit 2024-09-21T00:39:22.959589+0000 mon.a (mon.0) 5525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:23 smithi179 bash[23186]: audit 2024-09-21T00:39:22.967993+0000 mon.a (mon.0) 5526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:24.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:23 smithi179 bash[23186]: audit 2024-09-21T00:39:22.978798+0000 mon.a (mon.0) 5527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:24 smithi044 bash[22676]: audit 2024-09-21T00:39:23.960480+0000 mon.a (mon.0) 5528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:24 smithi044 bash[22676]: audit 2024-09-21T00:39:23.969859+0000 mon.a (mon.0) 5529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:24 smithi044 bash[22676]: audit 2024-09-21T00:39:23.981600+0000 mon.a (mon.0) 5530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:24 smithi044 bash[22676]: audit 2024-09-21T00:39:24.469659+0000 mon.a (mon.0) 5531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:24 smithi044 bash[22676]: audit 2024-09-21T00:39:24.479299+0000 mon.a (mon.0) 5532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:24 smithi044 bash[22676]: audit 2024-09-21T00:39:24.489394+0000 mon.a (mon.0) 5533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:24 smithi044 bash[22676]: cluster 2024-09-21T00:39:24.504165+0000 mgr.a (mgr.14388) 6270 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:24 smithi179 bash[23186]: audit 2024-09-21T00:39:23.960480+0000 mon.a (mon.0) 5528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:24 smithi179 bash[23186]: audit 2024-09-21T00:39:23.969859+0000 mon.a (mon.0) 5529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:24 smithi179 bash[23186]: audit 2024-09-21T00:39:23.981600+0000 mon.a (mon.0) 5530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:24 smithi179 bash[23186]: audit 2024-09-21T00:39:24.469659+0000 mon.a (mon.0) 5531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:24 smithi179 bash[23186]: audit 2024-09-21T00:39:24.479299+0000 mon.a (mon.0) 5532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:24 smithi179 bash[23186]: audit 2024-09-21T00:39:24.489394+0000 mon.a (mon.0) 5533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:24 smithi179 bash[23186]: cluster 2024-09-21T00:39:24.504165+0000 mgr.a (mgr.14388) 6270 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:24 smithi049 bash[23528]: audit 2024-09-21T00:39:23.960480+0000 mon.a (mon.0) 5528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:24 smithi049 bash[23528]: audit 2024-09-21T00:39:23.969859+0000 mon.a (mon.0) 5529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:24 smithi049 bash[23528]: audit 2024-09-21T00:39:23.981600+0000 mon.a (mon.0) 5530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:24 smithi049 bash[23528]: audit 2024-09-21T00:39:24.469659+0000 mon.a (mon.0) 5531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:24 smithi049 bash[23528]: audit 2024-09-21T00:39:24.479299+0000 mon.a (mon.0) 5532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:24 smithi049 bash[23528]: audit 2024-09-21T00:39:24.489394+0000 mon.a (mon.0) 5533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:24 smithi049 bash[23528]: cluster 2024-09-21T00:39:24.504165+0000 mgr.a (mgr.14388) 6270 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:26.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:26.789 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:27.583 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:27.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:27 smithi049 bash[23528]: cluster 2024-09-21T00:39:26.506531+0000 mgr.a (mgr.14388) 6271 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:27 smithi044 bash[22676]: cluster 2024-09-21T00:39:26.506531+0000 mgr.a (mgr.14388) 6271 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:27 smithi179 bash[23186]: cluster 2024-09-21T00:39:26.506531+0000 mgr.a (mgr.14388) 6271 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:39:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:28 smithi049 bash[23528]: audit 2024-09-21T00:39:27.127992+0000 mgr.a (mgr.14388) 6272 : audit [DBG] from='client.144015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:28 smithi044 bash[22676]: audit 2024-09-21T00:39:27.127992+0000 mgr.a (mgr.14388) 6272 : audit [DBG] from='client.144015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:28 smithi179 bash[23186]: audit 2024-09-21T00:39:27.127992+0000 mgr.a (mgr.14388) 6272 : audit [DBG] from='client.144015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:29.970 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:29 smithi049 bash[23528]: cluster 2024-09-21T00:39:28.507584+0000 mgr.a (mgr.14388) 6273 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:29 smithi044 bash[22676]: cluster 2024-09-21T00:39:28.507584+0000 mgr.a (mgr.14388) 6273 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:29 smithi179 bash[23186]: cluster 2024-09-21T00:39:28.507584+0000 mgr.a (mgr.14388) 6273 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:31 smithi044 bash[22676]: cluster 2024-09-21T00:39:30.509822+0000 mgr.a (mgr.14388) 6274 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:31 smithi179 bash[23186]: cluster 2024-09-21T00:39:30.509822+0000 mgr.a (mgr.14388) 6274 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:32.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:31 smithi049 bash[23528]: cluster 2024-09-21T00:39:30.509822+0000 mgr.a (mgr.14388) 6274 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:32.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:32.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:32.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:33.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:33.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:33.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:33.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:33 smithi044 bash[22676]: cluster 2024-09-21T00:39:32.510747+0000 mgr.a (mgr.14388) 6275 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:33 smithi179 bash[23186]: cluster 2024-09-21T00:39:32.510747+0000 mgr.a (mgr.14388) 6275 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:34.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:33 smithi049 bash[23528]: cluster 2024-09-21T00:39:32.510747+0000 mgr.a (mgr.14388) 6275 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:34 smithi044 bash[22676]: audit 2024-09-21T00:39:32.908674+0000 mgr.a (mgr.14388) 6276 : audit [DBG] from='client.144090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:34 smithi179 bash[23186]: audit 2024-09-21T00:39:32.908674+0000 mgr.a (mgr.14388) 6276 : audit [DBG] from='client.144090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:35.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:34 smithi049 bash[23528]: audit 2024-09-21T00:39:32.908674+0000 mgr.a (mgr.14388) 6276 : audit [DBG] from='client.144090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:35 smithi044 bash[22676]: cluster 2024-09-21T00:39:34.511829+0000 mgr.a (mgr.14388) 6277 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:35 smithi179 bash[23186]: cluster 2024-09-21T00:39:34.511829+0000 mgr.a (mgr.14388) 6277 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:36.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:35 smithi049 bash[23528]: cluster 2024-09-21T00:39:34.511829+0000 mgr.a (mgr.14388) 6277 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:37 smithi044 bash[22676]: cluster 2024-09-21T00:39:36.514241+0000 mgr.a (mgr.14388) 6278 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:37 smithi179 bash[23186]: cluster 2024-09-21T00:39:36.514241+0000 mgr.a (mgr.14388) 6278 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:37 smithi049 bash[23528]: cluster 2024-09-21T00:39:36.514241+0000 mgr.a (mgr.14388) 6278 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:38.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:38.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:38.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:39.119 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:39.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:39.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:39.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:39 smithi044 bash[22676]: cluster 2024-09-21T00:39:38.515137+0000 mgr.a (mgr.14388) 6279 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:39 smithi044 bash[22676]: audit 2024-09-21T00:39:38.670164+0000 mgr.a (mgr.14388) 6280 : audit [DBG] from='client.144168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:39 smithi179 bash[23186]: cluster 2024-09-21T00:39:38.515137+0000 mgr.a (mgr.14388) 6279 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:39 smithi179 bash[23186]: audit 2024-09-21T00:39:38.670164+0000 mgr.a (mgr.14388) 6280 : audit [DBG] from='client.144168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:39 smithi049 bash[23528]: cluster 2024-09-21T00:39:38.515137+0000 mgr.a (mgr.14388) 6279 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:39 smithi049 bash[23528]: audit 2024-09-21T00:39:38.670164+0000 mgr.a (mgr.14388) 6280 : audit [DBG] from='client.144168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:41.881 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:41 smithi044 bash[22676]: cluster 2024-09-21T00:39:40.517471+0000 mgr.a (mgr.14388) 6281 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:41 smithi179 bash[23186]: cluster 2024-09-21T00:39:40.517471+0000 mgr.a (mgr.14388) 6281 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:41 smithi049 bash[23528]: cluster 2024-09-21T00:39:40.517471+0000 mgr.a (mgr.14388) 6281 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:43 smithi044 bash[22676]: cluster 2024-09-21T00:39:42.518265+0000 mgr.a (mgr.14388) 6282 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:43 smithi044 bash[22676]: audit 2024-09-21T00:39:43.160672+0000 mon.a (mon.0) 5534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:43 smithi044 bash[22676]: audit 2024-09-21T00:39:43.169285+0000 mon.a (mon.0) 5535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:43 smithi044 bash[22676]: audit 2024-09-21T00:39:43.180173+0000 mon.a (mon.0) 5536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:43.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:43 smithi179 bash[23186]: cluster 2024-09-21T00:39:42.518265+0000 mgr.a (mgr.14388) 6282 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:43.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:43 smithi179 bash[23186]: audit 2024-09-21T00:39:43.160672+0000 mon.a (mon.0) 5534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:43.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:43 smithi179 bash[23186]: audit 2024-09-21T00:39:43.169285+0000 mon.a (mon.0) 5535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:43.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:43 smithi179 bash[23186]: audit 2024-09-21T00:39:43.180173+0000 mon.a (mon.0) 5536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:43 smithi049 bash[23528]: cluster 2024-09-21T00:39:42.518265+0000 mgr.a (mgr.14388) 6282 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:43 smithi049 bash[23528]: audit 2024-09-21T00:39:43.160672+0000 mon.a (mon.0) 5534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:44.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:43 smithi049 bash[23528]: audit 2024-09-21T00:39:43.169285+0000 mon.a (mon.0) 5535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:44.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:43 smithi049 bash[23528]: audit 2024-09-21T00:39:43.180173+0000 mon.a (mon.0) 5536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:44.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:44.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:44.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:44.859 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:44.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:44.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:44.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:44.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: audit 2024-09-21T00:39:44.173278+0000 mon.a (mon.0) 5537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: audit 2024-09-21T00:39:44.179206+0000 mon.a (mon.0) 5538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: audit 2024-09-21T00:39:44.184452+0000 mon.a (mon.0) 5539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: audit 2024-09-21T00:39:44.438888+0000 mgr.a (mgr.14388) 6283 : audit [DBG] from='client.144246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: cluster 2024-09-21T00:39:44.518861+0000 mgr.a (mgr.14388) 6284 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: audit 2024-09-21T00:39:44.597726+0000 mon.a (mon.0) 5540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: audit 2024-09-21T00:39:44.603483+0000 mon.a (mon.0) 5541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:45 smithi044 bash[22676]: audit 2024-09-21T00:39:44.610625+0000 mon.a (mon.0) 5542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: audit 2024-09-21T00:39:44.173278+0000 mon.a (mon.0) 5537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: audit 2024-09-21T00:39:44.179206+0000 mon.a (mon.0) 5538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: audit 2024-09-21T00:39:44.184452+0000 mon.a (mon.0) 5539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: audit 2024-09-21T00:39:44.438888+0000 mgr.a (mgr.14388) 6283 : audit [DBG] from='client.144246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: cluster 2024-09-21T00:39:44.518861+0000 mgr.a (mgr.14388) 6284 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: audit 2024-09-21T00:39:44.597726+0000 mon.a (mon.0) 5540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: audit 2024-09-21T00:39:44.603483+0000 mon.a (mon.0) 5541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:45 smithi179 bash[23186]: audit 2024-09-21T00:39:44.610625+0000 mon.a (mon.0) 5542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: audit 2024-09-21T00:39:44.173278+0000 mon.a (mon.0) 5537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: audit 2024-09-21T00:39:44.179206+0000 mon.a (mon.0) 5538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: audit 2024-09-21T00:39:44.184452+0000 mon.a (mon.0) 5539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: audit 2024-09-21T00:39:44.438888+0000 mgr.a (mgr.14388) 6283 : audit [DBG] from='client.144246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: cluster 2024-09-21T00:39:44.518861+0000 mgr.a (mgr.14388) 6284 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: audit 2024-09-21T00:39:44.597726+0000 mon.a (mon.0) 5540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: audit 2024-09-21T00:39:44.603483+0000 mon.a (mon.0) 5541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:45.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:45 smithi049 bash[23528]: audit 2024-09-21T00:39:44.610625+0000 mon.a (mon.0) 5542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:39:47.857 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:47 smithi049 bash[23528]: cluster 2024-09-21T00:39:46.521187+0000 mgr.a (mgr.14388) 6285 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:47 smithi044 bash[22676]: cluster 2024-09-21T00:39:46.521187+0000 mgr.a (mgr.14388) 6285 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:47 smithi179 bash[23186]: cluster 2024-09-21T00:39:46.521187+0000 mgr.a (mgr.14388) 6285 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:39:49.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:49 smithi049 bash[23528]: cluster 2024-09-21T00:39:48.521941+0000 mgr.a (mgr.14388) 6286 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:49.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:49.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:49.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:49 smithi044 bash[22676]: cluster 2024-09-21T00:39:48.521941+0000 mgr.a (mgr.14388) 6286 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:49 smithi179 bash[23186]: cluster 2024-09-21T00:39:48.521941+0000 mgr.a (mgr.14388) 6286 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:50.656 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:51 smithi044 bash[22676]: audit 2024-09-21T00:39:50.200726+0000 mgr.a (mgr.14388) 6287 : audit [DBG] from='client.144324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:51 smithi044 bash[22676]: cluster 2024-09-21T00:39:50.523417+0000 mgr.a (mgr.14388) 6288 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:51 smithi179 bash[23186]: audit 2024-09-21T00:39:50.200726+0000 mgr.a (mgr.14388) 6287 : audit [DBG] from='client.144324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:51 smithi179 bash[23186]: cluster 2024-09-21T00:39:50.523417+0000 mgr.a (mgr.14388) 6288 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:51 smithi049 bash[23528]: audit 2024-09-21T00:39:50.200726+0000 mgr.a (mgr.14388) 6287 : audit [DBG] from='client.144324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:51 smithi049 bash[23528]: cluster 2024-09-21T00:39:50.523417+0000 mgr.a (mgr.14388) 6288 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:53 smithi044 bash[22676]: cluster 2024-09-21T00:39:52.524304+0000 mgr.a (mgr.14388) 6289 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:53 smithi179 bash[23186]: cluster 2024-09-21T00:39:52.524304+0000 mgr.a (mgr.14388) 6289 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:53 smithi049 bash[23528]: cluster 2024-09-21T00:39:52.524304+0000 mgr.a (mgr.14388) 6289 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:55.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:39:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:39:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:39:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:55 smithi044 bash[22676]: cluster 2024-09-21T00:39:54.525117+0000 mgr.a (mgr.14388) 6290 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:55 smithi179 bash[23186]: cluster 2024-09-21T00:39:54.525117+0000 mgr.a (mgr.14388) 6290 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:55 smithi049 bash[23528]: cluster 2024-09-21T00:39:54.525117+0000 mgr.a (mgr.14388) 6290 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:39:56.414 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:39:56.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:39:56.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:39:56.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:39:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:39:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:57 smithi044 bash[22676]: audit 2024-09-21T00:39:55.991207+0000 mgr.a (mgr.14388) 6291 : audit [DBG] from='client.144399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:57 smithi044 bash[22676]: cluster 2024-09-21T00:39:56.527903+0000 mgr.a (mgr.14388) 6292 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:57 smithi179 bash[23186]: audit 2024-09-21T00:39:55.991207+0000 mgr.a (mgr.14388) 6291 : audit [DBG] from='client.144399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:57 smithi179 bash[23186]: cluster 2024-09-21T00:39:56.527903+0000 mgr.a (mgr.14388) 6292 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:58.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:57 smithi049 bash[23528]: audit 2024-09-21T00:39:55.991207+0000 mgr.a (mgr.14388) 6291 : audit [DBG] from='client.144399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:39:58.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:57 smithi049 bash[23528]: cluster 2024-09-21T00:39:56.527903+0000 mgr.a (mgr.14388) 6292 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:39:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:39:59 smithi044 bash[22676]: cluster 2024-09-21T00:39:58.528724+0000 mgr.a (mgr.14388) 6293 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:39:59 smithi179 bash[23186]: cluster 2024-09-21T00:39:58.528724+0000 mgr.a (mgr.14388) 6293 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:39:59 smithi049 bash[23528]: cluster 2024-09-21T00:39:58.528724+0000 mgr.a (mgr.14388) 6293 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:00.880 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:00 smithi044 bash[22676]: cluster 2024-09-21T00:40:00.000125+0000 mon.a (mon.0) 5543 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:40:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:00 smithi179 bash[23186]: cluster 2024-09-21T00:40:00.000125+0000 mon.a (mon.0) 5543 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:40:01.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:00 smithi049 bash[23528]: cluster 2024-09-21T00:40:00.000125+0000 mon.a (mon.0) 5543 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:40:01.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:01.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:01.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:01.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:01 smithi179 bash[23186]: cluster 2024-09-21T00:40:00.530690+0000 mgr.a (mgr.14388) 6294 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:01 smithi044 bash[22676]: cluster 2024-09-21T00:40:00.530690+0000 mgr.a (mgr.14388) 6294 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:02.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:01 smithi049 bash[23528]: cluster 2024-09-21T00:40:00.530690+0000 mgr.a (mgr.14388) 6294 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:02.154 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:02.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:02.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:02.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:02.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:02 smithi044 bash[22676]: audit 2024-09-21T00:40:01.748020+0000 mgr.a (mgr.14388) 6295 : audit [DBG] from='client.144477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:02 smithi179 bash[23186]: audit 2024-09-21T00:40:01.748020+0000 mgr.a (mgr.14388) 6295 : audit [DBG] from='client.144477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:03.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:02 smithi049 bash[23528]: audit 2024-09-21T00:40:01.748020+0000 mgr.a (mgr.14388) 6295 : audit [DBG] from='client.144477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:03.936 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:03 smithi179 bash[23186]: cluster 2024-09-21T00:40:02.531863+0000 mgr.a (mgr.14388) 6296 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:03.936 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:03 smithi179 bash[23186]: audit 2024-09-21T00:40:03.328276+0000 mon.a (mon.0) 5544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:03.936 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:03 smithi179 bash[23186]: audit 2024-09-21T00:40:03.332811+0000 mon.a (mon.0) 5545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:03.936 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:03 smithi179 bash[23186]: audit 2024-09-21T00:40:03.337935+0000 mon.a (mon.0) 5546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:03 smithi044 bash[22676]: cluster 2024-09-21T00:40:02.531863+0000 mgr.a (mgr.14388) 6296 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:03 smithi044 bash[22676]: audit 2024-09-21T00:40:03.328276+0000 mon.a (mon.0) 5544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:03 smithi044 bash[22676]: audit 2024-09-21T00:40:03.332811+0000 mon.a (mon.0) 5545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:03 smithi044 bash[22676]: audit 2024-09-21T00:40:03.337935+0000 mon.a (mon.0) 5546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:03 smithi049 bash[23528]: cluster 2024-09-21T00:40:02.531863+0000 mgr.a (mgr.14388) 6296 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:03 smithi049 bash[23528]: audit 2024-09-21T00:40:03.328276+0000 mon.a (mon.0) 5544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:03 smithi049 bash[23528]: audit 2024-09-21T00:40:03.332811+0000 mon.a (mon.0) 5545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:03 smithi049 bash[23528]: audit 2024-09-21T00:40:03.337935+0000 mon.a (mon.0) 5546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:05 smithi044 bash[22676]: audit 2024-09-21T00:40:04.381372+0000 mon.a (mon.0) 5547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:05 smithi044 bash[22676]: audit 2024-09-21T00:40:04.387548+0000 mon.a (mon.0) 5548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:05 smithi044 bash[22676]: audit 2024-09-21T00:40:04.394938+0000 mon.a (mon.0) 5549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:05 smithi044 bash[22676]: cluster 2024-09-21T00:40:04.532736+0000 mgr.a (mgr.14388) 6297 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:05 smithi044 bash[22676]: audit 2024-09-21T00:40:04.818382+0000 mon.a (mon.0) 5550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:05 smithi044 bash[22676]: audit 2024-09-21T00:40:04.826573+0000 mon.a (mon.0) 5551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:05 smithi044 bash[22676]: audit 2024-09-21T00:40:04.836580+0000 mon.a (mon.0) 5552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:05 smithi179 bash[23186]: audit 2024-09-21T00:40:04.381372+0000 mon.a (mon.0) 5547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:05 smithi179 bash[23186]: audit 2024-09-21T00:40:04.387548+0000 mon.a (mon.0) 5548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:05 smithi179 bash[23186]: audit 2024-09-21T00:40:04.394938+0000 mon.a (mon.0) 5549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:05 smithi179 bash[23186]: cluster 2024-09-21T00:40:04.532736+0000 mgr.a (mgr.14388) 6297 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:05 smithi179 bash[23186]: audit 2024-09-21T00:40:04.818382+0000 mon.a (mon.0) 5550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:05 smithi179 bash[23186]: audit 2024-09-21T00:40:04.826573+0000 mon.a (mon.0) 5551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:05 smithi179 bash[23186]: audit 2024-09-21T00:40:04.836580+0000 mon.a (mon.0) 5552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:05 smithi049 bash[23528]: audit 2024-09-21T00:40:04.381372+0000 mon.a (mon.0) 5547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:05 smithi049 bash[23528]: audit 2024-09-21T00:40:04.387548+0000 mon.a (mon.0) 5548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:05 smithi049 bash[23528]: audit 2024-09-21T00:40:04.394938+0000 mon.a (mon.0) 5549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:05 smithi049 bash[23528]: cluster 2024-09-21T00:40:04.532736+0000 mgr.a (mgr.14388) 6297 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:05 smithi049 bash[23528]: audit 2024-09-21T00:40:04.818382+0000 mon.a (mon.0) 5550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:05 smithi049 bash[23528]: audit 2024-09-21T00:40:04.826573+0000 mon.a (mon.0) 5551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:05.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:05 smithi049 bash[23528]: audit 2024-09-21T00:40:04.836580+0000 mon.a (mon.0) 5552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:07.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:07.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:07.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:07.937 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:07.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:07.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:07.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:07.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:07.966 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:07 smithi049 bash[23528]: cluster 2024-09-21T00:40:06.534978+0000 mgr.a (mgr.14388) 6298 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:07 smithi044 bash[22676]: cluster 2024-09-21T00:40:06.534978+0000 mgr.a (mgr.14388) 6298 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:07 smithi179 bash[23186]: cluster 2024-09-21T00:40:06.534978+0000 mgr.a (mgr.14388) 6298 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:08.889 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:08 smithi049 bash[23528]: audit 2024-09-21T00:40:07.487937+0000 mgr.a (mgr.14388) 6299 : audit [DBG] from='client.144552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:08 smithi044 bash[22676]: audit 2024-09-21T00:40:07.487937+0000 mgr.a (mgr.14388) 6299 : audit [DBG] from='client.144552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:08 smithi179 bash[23186]: audit 2024-09-21T00:40:07.487937+0000 mgr.a (mgr.14388) 6299 : audit [DBG] from='client.144552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:09.858 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:09 smithi049 bash[23528]: cluster 2024-09-21T00:40:08.535909+0000 mgr.a (mgr.14388) 6300 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:09 smithi044 bash[22676]: cluster 2024-09-21T00:40:08.535909+0000 mgr.a (mgr.14388) 6300 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:09 smithi179 bash[23186]: cluster 2024-09-21T00:40:08.535909+0000 mgr.a (mgr.14388) 6300 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:11 smithi044 bash[22676]: cluster 2024-09-21T00:40:10.538249+0000 mgr.a (mgr.14388) 6301 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:11 smithi179 bash[23186]: cluster 2024-09-21T00:40:10.538249+0000 mgr.a (mgr.14388) 6301 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:11 smithi049 bash[23528]: cluster 2024-09-21T00:40:10.538249+0000 mgr.a (mgr.14388) 6301 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:12.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:12.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:12.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:12 smithi044 bash[22676]: audit 2024-09-21T00:40:12.401644+0000 mon.a (mon.0) 5553 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:40:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:12 smithi044 bash[22676]: audit 2024-09-21T00:40:12.408944+0000 mon.a (mon.0) 5554 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:40:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:12 smithi044 bash[22676]: audit 2024-09-21T00:40:12.410886+0000 mon.a (mon.0) 5555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:40:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:12 smithi044 bash[22676]: audit 2024-09-21T00:40:12.423784+0000 mon.a (mon.0) 5556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:12 smithi044 bash[22676]: audit 2024-09-21T00:40:12.430270+0000 mon.a (mon.0) 5557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:40:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:12 smithi179 bash[23186]: audit 2024-09-21T00:40:12.401644+0000 mon.a (mon.0) 5553 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:40:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:12 smithi179 bash[23186]: audit 2024-09-21T00:40:12.408944+0000 mon.a (mon.0) 5554 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:40:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:12 smithi179 bash[23186]: audit 2024-09-21T00:40:12.410886+0000 mon.a (mon.0) 5555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:40:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:12 smithi179 bash[23186]: audit 2024-09-21T00:40:12.423784+0000 mon.a (mon.0) 5556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:12 smithi179 bash[23186]: audit 2024-09-21T00:40:12.430270+0000 mon.a (mon.0) 5557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:40:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:12 smithi049 bash[23528]: audit 2024-09-21T00:40:12.401644+0000 mon.a (mon.0) 5553 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:40:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:12 smithi049 bash[23528]: audit 2024-09-21T00:40:12.408944+0000 mon.a (mon.0) 5554 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:40:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:12 smithi049 bash[23528]: audit 2024-09-21T00:40:12.410886+0000 mon.a (mon.0) 5555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:40:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:12 smithi049 bash[23528]: audit 2024-09-21T00:40:12.423784+0000 mon.a (mon.0) 5556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:12 smithi049 bash[23528]: audit 2024-09-21T00:40:12.430270+0000 mon.a (mon.0) 5557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:40:13.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:40:13 smithi044 bash[22930]: debug 2024-09-21T00:40:13.204+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:40:13.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:40:13 smithi044 bash[22930]: debug 2024-09-21T00:40:13.208+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:40:13.692 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:13.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:13.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:13.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:13.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:13 smithi044 bash[22676]: audit 2024-09-21T00:40:12.432652+0000 mgr.a (mgr.14388) 6302 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:40:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:13 smithi044 bash[22676]: cluster 2024-09-21T00:40:12.538833+0000 mgr.a (mgr.14388) 6303 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:13 smithi179 bash[23186]: audit 2024-09-21T00:40:12.432652+0000 mgr.a (mgr.14388) 6302 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:40:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:13 smithi179 bash[23186]: cluster 2024-09-21T00:40:12.538833+0000 mgr.a (mgr.14388) 6303 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:13 smithi049 bash[23528]: audit 2024-09-21T00:40:12.432652+0000 mgr.a (mgr.14388) 6302 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:40:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:13 smithi049 bash[23528]: cluster 2024-09-21T00:40:12.538833+0000 mgr.a (mgr.14388) 6303 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:14 smithi044 bash[22676]: audit 2024-09-21T00:40:13.208106+0000 mgr.a (mgr.14388) 6304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:40:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:14 smithi044 bash[22676]: cephadm 2024-09-21T00:40:13.209671+0000 mgr.a (mgr.14388) 6305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:40:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:14 smithi044 bash[22676]: audit 2024-09-21T00:40:13.280457+0000 mgr.a (mgr.14388) 6306 : audit [DBG] from='client.144720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:14 smithi179 bash[23186]: audit 2024-09-21T00:40:13.208106+0000 mgr.a (mgr.14388) 6304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:40:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:14 smithi179 bash[23186]: cephadm 2024-09-21T00:40:13.209671+0000 mgr.a (mgr.14388) 6305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:40:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:14 smithi179 bash[23186]: audit 2024-09-21T00:40:13.280457+0000 mgr.a (mgr.14388) 6306 : audit [DBG] from='client.144720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:15.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:14 smithi049 bash[23528]: audit 2024-09-21T00:40:13.208106+0000 mgr.a (mgr.14388) 6304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:40:15.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:14 smithi049 bash[23528]: cephadm 2024-09-21T00:40:13.209671+0000 mgr.a (mgr.14388) 6305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:40:15.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:14 smithi049 bash[23528]: audit 2024-09-21T00:40:13.280457+0000 mgr.a (mgr.14388) 6306 : audit [DBG] from='client.144720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:15 smithi044 bash[22676]: cluster 2024-09-21T00:40:14.539721+0000 mgr.a (mgr.14388) 6307 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:15 smithi179 bash[23186]: cluster 2024-09-21T00:40:14.539721+0000 mgr.a (mgr.14388) 6307 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:15 smithi049 bash[23528]: cluster 2024-09-21T00:40:14.539721+0000 mgr.a (mgr.14388) 6307 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:17 smithi044 bash[22676]: cluster 2024-09-21T00:40:16.541999+0000 mgr.a (mgr.14388) 6308 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:17 smithi179 bash[23186]: cluster 2024-09-21T00:40:16.541999+0000 mgr.a (mgr.14388) 6308 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:17 smithi049 bash[23528]: cluster 2024-09-21T00:40:16.541999+0000 mgr.a (mgr.14388) 6308 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:18.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:18.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:18.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:19.448 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:19.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:19.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:19.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:19.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:19 smithi044 bash[22676]: cluster 2024-09-21T00:40:18.542769+0000 mgr.a (mgr.14388) 6309 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:19 smithi179 bash[23186]: cluster 2024-09-21T00:40:18.542769+0000 mgr.a (mgr.14388) 6309 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:19 smithi049 bash[23528]: cluster 2024-09-21T00:40:18.542769+0000 mgr.a (mgr.14388) 6309 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:20 smithi044 bash[22676]: audit 2024-09-21T00:40:19.024580+0000 mgr.a (mgr.14388) 6310 : audit [DBG] from='client.144816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:20 smithi179 bash[23186]: audit 2024-09-21T00:40:19.024580+0000 mgr.a (mgr.14388) 6310 : audit [DBG] from='client.144816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:21.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:20 smithi049 bash[23528]: audit 2024-09-21T00:40:19.024580+0000 mgr.a (mgr.14388) 6310 : audit [DBG] from='client.144816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:21.884 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:21 smithi179 bash[23186]: cluster 2024-09-21T00:40:20.545081+0000 mgr.a (mgr.14388) 6311 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:21 smithi044 bash[22676]: cluster 2024-09-21T00:40:20.545081+0000 mgr.a (mgr.14388) 6311 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:21 smithi049 bash[23528]: cluster 2024-09-21T00:40:20.545081+0000 mgr.a (mgr.14388) 6311 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:23.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:23 smithi179 bash[23186]: cluster 2024-09-21T00:40:22.545913+0000 mgr.a (mgr.14388) 6312 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:23.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:23 smithi179 bash[23186]: audit 2024-09-21T00:40:23.463676+0000 mon.a (mon.0) 5558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:23.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:23 smithi179 bash[23186]: audit 2024-09-21T00:40:23.472963+0000 mon.a (mon.0) 5559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:23.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:23 smithi179 bash[23186]: audit 2024-09-21T00:40:23.483907+0000 mon.a (mon.0) 5560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:23 smithi044 bash[22676]: cluster 2024-09-21T00:40:22.545913+0000 mgr.a (mgr.14388) 6312 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:23 smithi044 bash[22676]: audit 2024-09-21T00:40:23.463676+0000 mon.a (mon.0) 5558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:23 smithi044 bash[22676]: audit 2024-09-21T00:40:23.472963+0000 mon.a (mon.0) 5559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:23 smithi044 bash[22676]: audit 2024-09-21T00:40:23.483907+0000 mon.a (mon.0) 5560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:23 smithi049 bash[23528]: cluster 2024-09-21T00:40:22.545913+0000 mgr.a (mgr.14388) 6312 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:23 smithi049 bash[23528]: audit 2024-09-21T00:40:23.463676+0000 mon.a (mon.0) 5558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:23 smithi049 bash[23528]: audit 2024-09-21T00:40:23.472963+0000 mon.a (mon.0) 5559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:23 smithi049 bash[23528]: audit 2024-09-21T00:40:23.483907+0000 mon.a (mon.0) 5560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:24.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:24.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:24.450 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:25.261 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: cluster 2024-09-21T00:40:24.546374+0000 mgr.a (mgr.14388) 6313 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: audit 2024-09-21T00:40:24.572762+0000 mon.a (mon.0) 5561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: audit 2024-09-21T00:40:24.578617+0000 mon.a (mon.0) 5562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: audit 2024-09-21T00:40:24.584387+0000 mon.a (mon.0) 5563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: audit 2024-09-21T00:40:24.793026+0000 mgr.a (mgr.14388) 6314 : audit [DBG] from='client.144894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: audit 2024-09-21T00:40:24.990986+0000 mon.a (mon.0) 5564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: audit 2024-09-21T00:40:24.995972+0000 mon.a (mon.0) 5565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:25 smithi044 bash[22676]: audit 2024-09-21T00:40:25.001466+0000 mon.a (mon.0) 5566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: cluster 2024-09-21T00:40:24.546374+0000 mgr.a (mgr.14388) 6313 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: audit 2024-09-21T00:40:24.572762+0000 mon.a (mon.0) 5561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: audit 2024-09-21T00:40:24.578617+0000 mon.a (mon.0) 5562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: audit 2024-09-21T00:40:24.584387+0000 mon.a (mon.0) 5563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: audit 2024-09-21T00:40:24.793026+0000 mgr.a (mgr.14388) 6314 : audit [DBG] from='client.144894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: audit 2024-09-21T00:40:24.990986+0000 mon.a (mon.0) 5564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: audit 2024-09-21T00:40:24.995972+0000 mon.a (mon.0) 5565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:25 smithi179 bash[23186]: audit 2024-09-21T00:40:25.001466+0000 mon.a (mon.0) 5566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: cluster 2024-09-21T00:40:24.546374+0000 mgr.a (mgr.14388) 6313 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: audit 2024-09-21T00:40:24.572762+0000 mon.a (mon.0) 5561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: audit 2024-09-21T00:40:24.578617+0000 mon.a (mon.0) 5562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: audit 2024-09-21T00:40:24.584387+0000 mon.a (mon.0) 5563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: audit 2024-09-21T00:40:24.793026+0000 mgr.a (mgr.14388) 6314 : audit [DBG] from='client.144894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: audit 2024-09-21T00:40:24.990986+0000 mon.a (mon.0) 5564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: audit 2024-09-21T00:40:24.995972+0000 mon.a (mon.0) 5565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:25 smithi049 bash[23528]: audit 2024-09-21T00:40:25.001466+0000 mon.a (mon.0) 5566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:27 smithi044 bash[22676]: cluster 2024-09-21T00:40:26.548921+0000 mgr.a (mgr.14388) 6315 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:27 smithi179 bash[23186]: cluster 2024-09-21T00:40:26.548921+0000 mgr.a (mgr.14388) 6315 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:27 smithi049 bash[23528]: cluster 2024-09-21T00:40:26.548921+0000 mgr.a (mgr.14388) 6315 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:40:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:29 smithi049 bash[23528]: cluster 2024-09-21T00:40:28.549705+0000 mgr.a (mgr.14388) 6316 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:29 smithi044 bash[22676]: cluster 2024-09-21T00:40:28.549705+0000 mgr.a (mgr.14388) 6316 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:29 smithi179 bash[23186]: cluster 2024-09-21T00:40:28.549705+0000 mgr.a (mgr.14388) 6316 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:30.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:30.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:30.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:31.043 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:31.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:31.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:31.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:31.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:31 smithi044 bash[22676]: cluster 2024-09-21T00:40:30.551773+0000 mgr.a (mgr.14388) 6317 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:31 smithi044 bash[22676]: audit 2024-09-21T00:40:30.605378+0000 mgr.a (mgr.14388) 6318 : audit [DBG] from='client.144969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:31 smithi179 bash[23186]: cluster 2024-09-21T00:40:30.551773+0000 mgr.a (mgr.14388) 6317 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:31 smithi179 bash[23186]: audit 2024-09-21T00:40:30.605378+0000 mgr.a (mgr.14388) 6318 : audit [DBG] from='client.144969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:31 smithi049 bash[23528]: cluster 2024-09-21T00:40:30.551773+0000 mgr.a (mgr.14388) 6317 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:31 smithi049 bash[23528]: audit 2024-09-21T00:40:30.605378+0000 mgr.a (mgr.14388) 6318 : audit [DBG] from='client.144969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:33 smithi044 bash[22676]: cluster 2024-09-21T00:40:32.552842+0000 mgr.a (mgr.14388) 6319 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:33 smithi179 bash[23186]: cluster 2024-09-21T00:40:32.552842+0000 mgr.a (mgr.14388) 6319 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:34.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:33 smithi049 bash[23528]: cluster 2024-09-21T00:40:32.552842+0000 mgr.a (mgr.14388) 6319 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:40:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:35 smithi044 bash[22676]: cluster 2024-09-21T00:40:34.553684+0000 mgr.a (mgr.14388) 6320 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:40:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:35 smithi179 bash[23186]: cluster 2024-09-21T00:40:34.553684+0000 mgr.a (mgr.14388) 6320 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:40:36.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:36.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:36.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:35 smithi049 bash[23528]: cluster 2024-09-21T00:40:34.553684+0000 mgr.a (mgr.14388) 6320 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:40:36.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:37 smithi044 bash[22676]: audit 2024-09-21T00:40:36.384035+0000 mgr.a (mgr.14388) 6321 : audit [DBG] from='client.145044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:37 smithi044 bash[22676]: cluster 2024-09-21T00:40:36.554919+0000 mgr.a (mgr.14388) 6322 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:37 smithi179 bash[23186]: audit 2024-09-21T00:40:36.384035+0000 mgr.a (mgr.14388) 6321 : audit [DBG] from='client.145044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:37 smithi179 bash[23186]: cluster 2024-09-21T00:40:36.554919+0000 mgr.a (mgr.14388) 6322 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:37 smithi049 bash[23528]: audit 2024-09-21T00:40:36.384035+0000 mgr.a (mgr.14388) 6321 : audit [DBG] from='client.145044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:37 smithi049 bash[23528]: cluster 2024-09-21T00:40:36.554919+0000 mgr.a (mgr.14388) 6322 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:39 smithi044 bash[22676]: cluster 2024-09-21T00:40:38.555786+0000 mgr.a (mgr.14388) 6323 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:39 smithi179 bash[23186]: cluster 2024-09-21T00:40:38.555786+0000 mgr.a (mgr.14388) 6323 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:39 smithi049 bash[23528]: cluster 2024-09-21T00:40:38.555786+0000 mgr.a (mgr.14388) 6323 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:41.833 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:41.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:41.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:41.872 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:41 smithi179 bash[23186]: cluster 2024-09-21T00:40:40.557988+0000 mgr.a (mgr.14388) 6324 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:41 smithi044 bash[22676]: cluster 2024-09-21T00:40:40.557988+0000 mgr.a (mgr.14388) 6324 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:41 smithi049 bash[23528]: cluster 2024-09-21T00:40:40.557988+0000 mgr.a (mgr.14388) 6324 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:42.605 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:43.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:43 smithi044 bash[22676]: audit 2024-09-21T00:40:42.172892+0000 mgr.a (mgr.14388) 6325 : audit [DBG] from='client.145122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:43.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:43 smithi044 bash[22676]: cluster 2024-09-21T00:40:42.558567+0000 mgr.a (mgr.14388) 6326 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:43 smithi179 bash[23186]: audit 2024-09-21T00:40:42.172892+0000 mgr.a (mgr.14388) 6325 : audit [DBG] from='client.145122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:43 smithi179 bash[23186]: cluster 2024-09-21T00:40:42.558567+0000 mgr.a (mgr.14388) 6326 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:43 smithi049 bash[23528]: audit 2024-09-21T00:40:42.172892+0000 mgr.a (mgr.14388) 6325 : audit [DBG] from='client.145122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:43 smithi049 bash[23528]: cluster 2024-09-21T00:40:42.558567+0000 mgr.a (mgr.14388) 6326 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:44 smithi044 bash[22676]: audit 2024-09-21T00:40:43.640137+0000 mon.a (mon.0) 5567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:44 smithi044 bash[22676]: audit 2024-09-21T00:40:43.649105+0000 mon.a (mon.0) 5568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:44 smithi044 bash[22676]: audit 2024-09-21T00:40:43.659720+0000 mon.a (mon.0) 5569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:44 smithi179 bash[23186]: audit 2024-09-21T00:40:43.640137+0000 mon.a (mon.0) 5567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:44 smithi179 bash[23186]: audit 2024-09-21T00:40:43.649105+0000 mon.a (mon.0) 5568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:44 smithi179 bash[23186]: audit 2024-09-21T00:40:43.659720+0000 mon.a (mon.0) 5569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:44 smithi049 bash[23528]: audit 2024-09-21T00:40:43.640137+0000 mon.a (mon.0) 5567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:44 smithi049 bash[23528]: audit 2024-09-21T00:40:43.649105+0000 mon.a (mon.0) 5568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:44 smithi049 bash[23528]: audit 2024-09-21T00:40:43.659720+0000 mon.a (mon.0) 5569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:45 smithi044 bash[22676]: cluster 2024-09-21T00:40:44.559052+0000 mgr.a (mgr.14388) 6327 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:45 smithi044 bash[22676]: audit 2024-09-21T00:40:44.800994+0000 mon.a (mon.0) 5570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:45 smithi044 bash[22676]: audit 2024-09-21T00:40:44.809653+0000 mon.a (mon.0) 5571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:45 smithi044 bash[22676]: audit 2024-09-21T00:40:44.821091+0000 mon.a (mon.0) 5572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:45 smithi044 bash[22676]: audit 2024-09-21T00:40:45.150553+0000 mon.a (mon.0) 5573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:45 smithi044 bash[22676]: audit 2024-09-21T00:40:45.156162+0000 mon.a (mon.0) 5574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:45 smithi044 bash[22676]: audit 2024-09-21T00:40:45.162374+0000 mon.a (mon.0) 5575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:45 smithi179 bash[23186]: cluster 2024-09-21T00:40:44.559052+0000 mgr.a (mgr.14388) 6327 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:45 smithi179 bash[23186]: audit 2024-09-21T00:40:44.800994+0000 mon.a (mon.0) 5570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:45 smithi179 bash[23186]: audit 2024-09-21T00:40:44.809653+0000 mon.a (mon.0) 5571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:45 smithi179 bash[23186]: audit 2024-09-21T00:40:44.821091+0000 mon.a (mon.0) 5572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:45 smithi179 bash[23186]: audit 2024-09-21T00:40:45.150553+0000 mon.a (mon.0) 5573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:45 smithi179 bash[23186]: audit 2024-09-21T00:40:45.156162+0000 mon.a (mon.0) 5574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:45 smithi179 bash[23186]: audit 2024-09-21T00:40:45.162374+0000 mon.a (mon.0) 5575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:45 smithi049 bash[23528]: cluster 2024-09-21T00:40:44.559052+0000 mgr.a (mgr.14388) 6327 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:45 smithi049 bash[23528]: audit 2024-09-21T00:40:44.800994+0000 mon.a (mon.0) 5570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:45 smithi049 bash[23528]: audit 2024-09-21T00:40:44.809653+0000 mon.a (mon.0) 5571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:45 smithi049 bash[23528]: audit 2024-09-21T00:40:44.821091+0000 mon.a (mon.0) 5572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:45 smithi049 bash[23528]: audit 2024-09-21T00:40:45.150553+0000 mon.a (mon.0) 5573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:45 smithi049 bash[23528]: audit 2024-09-21T00:40:45.156162+0000 mon.a (mon.0) 5574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:45 smithi049 bash[23528]: audit 2024-09-21T00:40:45.162374+0000 mon.a (mon.0) 5575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:40:47.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:47 smithi049 bash[23528]: cluster 2024-09-21T00:40:46.561300+0000 mgr.a (mgr.14388) 6328 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:47 smithi044 bash[22676]: cluster 2024-09-21T00:40:46.561300+0000 mgr.a (mgr.14388) 6328 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:47 smithi179 bash[23186]: cluster 2024-09-21T00:40:46.561300+0000 mgr.a (mgr.14388) 6328 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:48.394 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:48.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:48.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:48.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:48.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:49 smithi049 bash[23528]: audit 2024-09-21T00:40:47.943471+0000 mgr.a (mgr.14388) 6329 : audit [DBG] from='client.145197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:49 smithi049 bash[23528]: cluster 2024-09-21T00:40:48.562240+0000 mgr.a (mgr.14388) 6330 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:49 smithi044 bash[22676]: audit 2024-09-21T00:40:47.943471+0000 mgr.a (mgr.14388) 6329 : audit [DBG] from='client.145197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:49 smithi044 bash[22676]: cluster 2024-09-21T00:40:48.562240+0000 mgr.a (mgr.14388) 6330 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:49 smithi179 bash[23186]: audit 2024-09-21T00:40:47.943471+0000 mgr.a (mgr.14388) 6329 : audit [DBG] from='client.145197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:49 smithi179 bash[23186]: cluster 2024-09-21T00:40:48.562240+0000 mgr.a (mgr.14388) 6330 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:51 smithi044 bash[22676]: cluster 2024-09-21T00:40:50.564467+0000 mgr.a (mgr.14388) 6331 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:51 smithi179 bash[23186]: cluster 2024-09-21T00:40:50.564467+0000 mgr.a (mgr.14388) 6331 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:52.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:51 smithi049 bash[23528]: cluster 2024-09-21T00:40:50.564467+0000 mgr.a (mgr.14388) 6331 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:53.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:53.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:54.159 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:54.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:53 smithi044 bash[22676]: cluster 2024-09-21T00:40:52.565416+0000 mgr.a (mgr.14388) 6332 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:53 smithi179 bash[23186]: cluster 2024-09-21T00:40:52.565416+0000 mgr.a (mgr.14388) 6332 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:54.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:53 smithi049 bash[23528]: cluster 2024-09-21T00:40:52.565416+0000 mgr.a (mgr.14388) 6332 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:54 smithi044 bash[22676]: audit 2024-09-21T00:40:53.725908+0000 mgr.a (mgr.14388) 6333 : audit [DBG] from='client.145272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:54 smithi179 bash[23186]: audit 2024-09-21T00:40:53.725908+0000 mgr.a (mgr.14388) 6333 : audit [DBG] from='client.145272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:55.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:54 smithi049 bash[23528]: audit 2024-09-21T00:40:53.725908+0000 mgr.a (mgr.14388) 6333 : audit [DBG] from='client.145272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:40:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:55 smithi044 bash[22676]: cluster 2024-09-21T00:40:54.566379+0000 mgr.a (mgr.14388) 6334 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:55 smithi179 bash[23186]: cluster 2024-09-21T00:40:54.566379+0000 mgr.a (mgr.14388) 6334 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:56.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:55 smithi049 bash[23528]: cluster 2024-09-21T00:40:54.566379+0000 mgr.a (mgr.14388) 6334 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:40:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:56 smithi044 bash[22676]: cluster 2024-09-21T00:40:56.568687+0000 mgr.a (mgr.14388) 6335 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:56 smithi179 bash[23186]: cluster 2024-09-21T00:40:56.568687+0000 mgr.a (mgr.14388) 6335 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:57.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:56 smithi049 bash[23528]: cluster 2024-09-21T00:40:56.568687+0000 mgr.a (mgr.14388) 6335 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:40:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:40:59.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:40:59.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:40:59.932 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:40:59.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:40:59.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:40:59.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:40:59.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:40:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:40:59 smithi044 bash[22676]: cluster 2024-09-21T00:40:58.569495+0000 mgr.a (mgr.14388) 6336 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:40:59 smithi179 bash[23186]: cluster 2024-09-21T00:40:58.569495+0000 mgr.a (mgr.14388) 6336 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:40:59 smithi049 bash[23528]: cluster 2024-09-21T00:40:58.569495+0000 mgr.a (mgr.14388) 6336 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:00 smithi044 bash[22676]: audit 2024-09-21T00:40:59.501203+0000 mgr.a (mgr.14388) 6337 : audit [DBG] from='client.145350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:00 smithi179 bash[23186]: audit 2024-09-21T00:40:59.501203+0000 mgr.a (mgr.14388) 6337 : audit [DBG] from='client.145350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:01.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:00 smithi049 bash[23528]: audit 2024-09-21T00:40:59.501203+0000 mgr.a (mgr.14388) 6337 : audit [DBG] from='client.145350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:01.970 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:01 smithi179 bash[23186]: cluster 2024-09-21T00:41:00.571855+0000 mgr.a (mgr.14388) 6338 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:01 smithi044 bash[22676]: cluster 2024-09-21T00:41:00.571855+0000 mgr.a (mgr.14388) 6338 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:01 smithi049 bash[23528]: cluster 2024-09-21T00:41:00.571855+0000 mgr.a (mgr.14388) 6338 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:03 smithi044 bash[22676]: cluster 2024-09-21T00:41:02.572678+0000 mgr.a (mgr.14388) 6339 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:03 smithi179 bash[23186]: cluster 2024-09-21T00:41:02.572678+0000 mgr.a (mgr.14388) 6339 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:03 smithi049 bash[23528]: cluster 2024-09-21T00:41:02.572678+0000 mgr.a (mgr.14388) 6339 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:04.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:04.935 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:04.935 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:04 smithi044 bash[22676]: audit 2024-09-21T00:41:03.841927+0000 mon.a (mon.0) 5576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:04 smithi044 bash[22676]: audit 2024-09-21T00:41:03.849677+0000 mon.a (mon.0) 5577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:04 smithi044 bash[22676]: audit 2024-09-21T00:41:03.856171+0000 mon.a (mon.0) 5578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:04 smithi044 bash[22676]: cluster 2024-09-21T00:41:04.573677+0000 mgr.a (mgr.14388) 6340 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:04 smithi179 bash[23186]: audit 2024-09-21T00:41:03.841927+0000 mon.a (mon.0) 5576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:04 smithi179 bash[23186]: audit 2024-09-21T00:41:03.849677+0000 mon.a (mon.0) 5577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:04 smithi179 bash[23186]: audit 2024-09-21T00:41:03.856171+0000 mon.a (mon.0) 5578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:04 smithi179 bash[23186]: cluster 2024-09-21T00:41:04.573677+0000 mgr.a (mgr.14388) 6340 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:04 smithi049 bash[23528]: audit 2024-09-21T00:41:03.841927+0000 mon.a (mon.0) 5576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:04 smithi049 bash[23528]: audit 2024-09-21T00:41:03.849677+0000 mon.a (mon.0) 5577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:04 smithi049 bash[23528]: audit 2024-09-21T00:41:03.856171+0000 mon.a (mon.0) 5578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:04 smithi049 bash[23528]: cluster 2024-09-21T00:41:04.573677+0000 mgr.a (mgr.14388) 6340 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:05.716 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:05.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:05.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:05.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:05.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:05 smithi179 bash[23186]: audit 2024-09-21T00:41:04.998111+0000 mon.a (mon.0) 5579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:05 smithi179 bash[23186]: audit 2024-09-21T00:41:05.007219+0000 mon.a (mon.0) 5580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:05 smithi179 bash[23186]: audit 2024-09-21T00:41:05.018044+0000 mon.a (mon.0) 5581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:05 smithi179 bash[23186]: audit 2024-09-21T00:41:05.278019+0000 mgr.a (mgr.14388) 6341 : audit [DBG] from='client.145425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:05 smithi179 bash[23186]: audit 2024-09-21T00:41:05.328370+0000 mon.a (mon.0) 5582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:05 smithi179 bash[23186]: audit 2024-09-21T00:41:05.334211+0000 mon.a (mon.0) 5583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:05 smithi179 bash[23186]: audit 2024-09-21T00:41:05.340806+0000 mon.a (mon.0) 5584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:06 smithi049 bash[23528]: audit 2024-09-21T00:41:04.998111+0000 mon.a (mon.0) 5579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:06 smithi049 bash[23528]: audit 2024-09-21T00:41:05.007219+0000 mon.a (mon.0) 5580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:06 smithi049 bash[23528]: audit 2024-09-21T00:41:05.018044+0000 mon.a (mon.0) 5581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:06 smithi049 bash[23528]: audit 2024-09-21T00:41:05.278019+0000 mgr.a (mgr.14388) 6341 : audit [DBG] from='client.145425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:06 smithi049 bash[23528]: audit 2024-09-21T00:41:05.328370+0000 mon.a (mon.0) 5582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:06 smithi049 bash[23528]: audit 2024-09-21T00:41:05.334211+0000 mon.a (mon.0) 5583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:06 smithi049 bash[23528]: audit 2024-09-21T00:41:05.340806+0000 mon.a (mon.0) 5584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:05 smithi044 bash[22676]: audit 2024-09-21T00:41:04.998111+0000 mon.a (mon.0) 5579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:05 smithi044 bash[22676]: audit 2024-09-21T00:41:05.007219+0000 mon.a (mon.0) 5580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:05 smithi044 bash[22676]: audit 2024-09-21T00:41:05.018044+0000 mon.a (mon.0) 5581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:05 smithi044 bash[22676]: audit 2024-09-21T00:41:05.278019+0000 mgr.a (mgr.14388) 6341 : audit [DBG] from='client.145425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:05 smithi044 bash[22676]: audit 2024-09-21T00:41:05.328370+0000 mon.a (mon.0) 5582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:05 smithi044 bash[22676]: audit 2024-09-21T00:41:05.334211+0000 mon.a (mon.0) 5583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:06.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:05 smithi044 bash[22676]: audit 2024-09-21T00:41:05.340806+0000 mon.a (mon.0) 5584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:07 smithi049 bash[23528]: cluster 2024-09-21T00:41:06.576609+0000 mgr.a (mgr.14388) 6342 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:07 smithi044 bash[22676]: cluster 2024-09-21T00:41:06.576609+0000 mgr.a (mgr.14388) 6342 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:07 smithi179 bash[23186]: cluster 2024-09-21T00:41:06.576609+0000 mgr.a (mgr.14388) 6342 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:09 smithi044 bash[22676]: cluster 2024-09-21T00:41:08.577466+0000 mgr.a (mgr.14388) 6343 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:09 smithi179 bash[23186]: cluster 2024-09-21T00:41:08.577466+0000 mgr.a (mgr.14388) 6343 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:09 smithi049 bash[23528]: cluster 2024-09-21T00:41:08.577466+0000 mgr.a (mgr.14388) 6343 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:10.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:10.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:10.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:11.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:11.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:11.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:11.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:11.499 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:11 smithi044 bash[22676]: cluster 2024-09-21T00:41:10.579434+0000 mgr.a (mgr.14388) 6344 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:11 smithi179 bash[23186]: cluster 2024-09-21T00:41:10.579434+0000 mgr.a (mgr.14388) 6344 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:11 smithi049 bash[23528]: cluster 2024-09-21T00:41:10.579434+0000 mgr.a (mgr.14388) 6344 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:12 smithi044 bash[22676]: audit 2024-09-21T00:41:11.057605+0000 mgr.a (mgr.14388) 6345 : audit [DBG] from='client.145503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:12 smithi179 bash[23186]: audit 2024-09-21T00:41:11.057605+0000 mgr.a (mgr.14388) 6345 : audit [DBG] from='client.145503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:13.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:12 smithi049 bash[23528]: audit 2024-09-21T00:41:11.057605+0000 mgr.a (mgr.14388) 6345 : audit [DBG] from='client.145503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:13 smithi044 bash[22676]: cluster 2024-09-21T00:41:12.580450+0000 mgr.a (mgr.14388) 6346 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:13 smithi044 bash[22676]: audit 2024-09-21T00:41:13.267178+0000 mon.a (mon.0) 5585 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:41:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:13 smithi044 bash[22676]: audit 2024-09-21T00:41:13.275392+0000 mon.a (mon.0) 5586 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:41:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:13 smithi044 bash[22676]: audit 2024-09-21T00:41:13.277290+0000 mon.a (mon.0) 5587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:41:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:13 smithi044 bash[22676]: audit 2024-09-21T00:41:13.288732+0000 mon.a (mon.0) 5588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:13 smithi044 bash[22676]: audit 2024-09-21T00:41:13.295342+0000 mon.a (mon.0) 5589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:41:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:13 smithi179 bash[23186]: cluster 2024-09-21T00:41:12.580450+0000 mgr.a (mgr.14388) 6346 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:13 smithi179 bash[23186]: audit 2024-09-21T00:41:13.267178+0000 mon.a (mon.0) 5585 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:41:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:13 smithi179 bash[23186]: audit 2024-09-21T00:41:13.275392+0000 mon.a (mon.0) 5586 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:41:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:13 smithi179 bash[23186]: audit 2024-09-21T00:41:13.277290+0000 mon.a (mon.0) 5587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:41:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:13 smithi179 bash[23186]: audit 2024-09-21T00:41:13.288732+0000 mon.a (mon.0) 5588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:13 smithi179 bash[23186]: audit 2024-09-21T00:41:13.295342+0000 mon.a (mon.0) 5589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:41:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:13 smithi049 bash[23528]: cluster 2024-09-21T00:41:12.580450+0000 mgr.a (mgr.14388) 6346 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:13 smithi049 bash[23528]: audit 2024-09-21T00:41:13.267178+0000 mon.a (mon.0) 5585 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:41:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:13 smithi049 bash[23528]: audit 2024-09-21T00:41:13.275392+0000 mon.a (mon.0) 5586 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:41:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:13 smithi049 bash[23528]: audit 2024-09-21T00:41:13.277290+0000 mon.a (mon.0) 5587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:41:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:13 smithi049 bash[23528]: audit 2024-09-21T00:41:13.288732+0000 mon.a (mon.0) 5588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:13 smithi049 bash[23528]: audit 2024-09-21T00:41:13.295342+0000 mon.a (mon.0) 5589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:41:14.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:41:14 smithi044 bash[22930]: debug 2024-09-21T00:41:14.047+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:41:14.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:41:14 smithi044 bash[22930]: debug 2024-09-21T00:41:14.047+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:41:14.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:14 smithi049 bash[23528]: audit 2024-09-21T00:41:13.297924+0000 mgr.a (mgr.14388) 6347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:41:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:14 smithi044 bash[22676]: audit 2024-09-21T00:41:13.297924+0000 mgr.a (mgr.14388) 6347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:41:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:14 smithi179 bash[23186]: audit 2024-09-21T00:41:13.297924+0000 mgr.a (mgr.14388) 6347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:41:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:15 smithi044 bash[22676]: audit 2024-09-21T00:41:14.049761+0000 mgr.a (mgr.14388) 6348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:41:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:15 smithi044 bash[22676]: cephadm 2024-09-21T00:41:14.051419+0000 mgr.a (mgr.14388) 6349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:41:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:15 smithi044 bash[22676]: cluster 2024-09-21T00:41:14.581506+0000 mgr.a (mgr.14388) 6350 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:15 smithi179 bash[23186]: audit 2024-09-21T00:41:14.049761+0000 mgr.a (mgr.14388) 6348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:41:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:15 smithi179 bash[23186]: cephadm 2024-09-21T00:41:14.051419+0000 mgr.a (mgr.14388) 6349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:41:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:15 smithi179 bash[23186]: cluster 2024-09-21T00:41:14.581506+0000 mgr.a (mgr.14388) 6350 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:15 smithi049 bash[23528]: audit 2024-09-21T00:41:14.049761+0000 mgr.a (mgr.14388) 6348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:41:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:15 smithi049 bash[23528]: cephadm 2024-09-21T00:41:14.051419+0000 mgr.a (mgr.14388) 6349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:41:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:15 smithi049 bash[23528]: cluster 2024-09-21T00:41:14.581506+0000 mgr.a (mgr.14388) 6350 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:16.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:16.501 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:16.501 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:17.289 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:17 smithi044 bash[22676]: cluster 2024-09-21T00:41:16.582976+0000 mgr.a (mgr.14388) 6351 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:17 smithi179 bash[23186]: cluster 2024-09-21T00:41:16.582976+0000 mgr.a (mgr.14388) 6351 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:17 smithi049 bash[23528]: cluster 2024-09-21T00:41:16.582976+0000 mgr.a (mgr.14388) 6351 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:18 smithi044 bash[22676]: audit 2024-09-21T00:41:16.843232+0000 mgr.a (mgr.14388) 6352 : audit [DBG] from='client.145680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:18 smithi179 bash[23186]: audit 2024-09-21T00:41:16.843232+0000 mgr.a (mgr.14388) 6352 : audit [DBG] from='client.145680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:19.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:18 smithi049 bash[23528]: audit 2024-09-21T00:41:16.843232+0000 mgr.a (mgr.14388) 6352 : audit [DBG] from='client.145680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:19 smithi044 bash[22676]: cluster 2024-09-21T00:41:18.583948+0000 mgr.a (mgr.14388) 6353 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:19 smithi179 bash[23186]: cluster 2024-09-21T00:41:18.583948+0000 mgr.a (mgr.14388) 6353 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:19 smithi049 bash[23528]: cluster 2024-09-21T00:41:18.583948+0000 mgr.a (mgr.14388) 6353 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:21 smithi044 bash[22676]: cluster 2024-09-21T00:41:20.586104+0000 mgr.a (mgr.14388) 6354 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:21.991 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:21 smithi179 bash[23186]: cluster 2024-09-21T00:41:20.586104+0000 mgr.a (mgr.14388) 6354 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:21 smithi049 bash[23528]: cluster 2024-09-21T00:41:20.586104+0000 mgr.a (mgr.14388) 6354 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:22.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:22.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:22.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:23.054 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:23.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:23.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:23 smithi179 bash[23186]: cluster 2024-09-21T00:41:22.586982+0000 mgr.a (mgr.14388) 6355 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:23 smithi179 bash[23186]: audit 2024-09-21T00:41:22.623156+0000 mgr.a (mgr.14388) 6356 : audit [DBG] from='client.145755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:23.951 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:23 smithi044 bash[22676]: cluster 2024-09-21T00:41:22.586982+0000 mgr.a (mgr.14388) 6355 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:23.951 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:23 smithi044 bash[22676]: audit 2024-09-21T00:41:22.623156+0000 mgr.a (mgr.14388) 6356 : audit [DBG] from='client.145755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:23 smithi049 bash[23528]: cluster 2024-09-21T00:41:22.586982+0000 mgr.a (mgr.14388) 6355 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:23 smithi049 bash[23528]: audit 2024-09-21T00:41:22.623156+0000 mgr.a (mgr.14388) 6356 : audit [DBG] from='client.145755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:25.251 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:24 smithi049 bash[23528]: audit 2024-09-21T00:41:23.988906+0000 mon.a (mon.0) 5590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.251 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:24 smithi049 bash[23528]: audit 2024-09-21T00:41:23.994357+0000 mon.a (mon.0) 5591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.251 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:24 smithi049 bash[23528]: audit 2024-09-21T00:41:23.999449+0000 mon.a (mon.0) 5592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.251 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:24 smithi049 bash[23528]: cluster 2024-09-21T00:41:24.588052+0000 mgr.a (mgr.14388) 6357 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:24 smithi179 bash[23186]: audit 2024-09-21T00:41:23.988906+0000 mon.a (mon.0) 5590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:24 smithi179 bash[23186]: audit 2024-09-21T00:41:23.994357+0000 mon.a (mon.0) 5591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:24 smithi179 bash[23186]: audit 2024-09-21T00:41:23.999449+0000 mon.a (mon.0) 5592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:24 smithi179 bash[23186]: cluster 2024-09-21T00:41:24.588052+0000 mgr.a (mgr.14388) 6357 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:24 smithi044 bash[22676]: audit 2024-09-21T00:41:23.988906+0000 mon.a (mon.0) 5590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:24 smithi044 bash[22676]: audit 2024-09-21T00:41:23.994357+0000 mon.a (mon.0) 5591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:24 smithi044 bash[22676]: audit 2024-09-21T00:41:23.999449+0000 mon.a (mon.0) 5592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:24 smithi044 bash[22676]: cluster 2024-09-21T00:41:24.588052+0000 mgr.a (mgr.14388) 6357 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:26 smithi044 bash[22676]: audit 2024-09-21T00:41:25.229158+0000 mon.a (mon.0) 5593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:26 smithi044 bash[22676]: audit 2024-09-21T00:41:25.238218+0000 mon.a (mon.0) 5594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:26 smithi044 bash[22676]: audit 2024-09-21T00:41:25.248978+0000 mon.a (mon.0) 5595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:26 smithi044 bash[22676]: audit 2024-09-21T00:41:25.544001+0000 mon.a (mon.0) 5596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:26 smithi044 bash[22676]: audit 2024-09-21T00:41:25.550197+0000 mon.a (mon.0) 5597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:26 smithi044 bash[22676]: audit 2024-09-21T00:41:25.558476+0000 mon.a (mon.0) 5598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:26 smithi179 bash[23186]: audit 2024-09-21T00:41:25.229158+0000 mon.a (mon.0) 5593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:26 smithi179 bash[23186]: audit 2024-09-21T00:41:25.238218+0000 mon.a (mon.0) 5594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:26 smithi179 bash[23186]: audit 2024-09-21T00:41:25.248978+0000 mon.a (mon.0) 5595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:26 smithi179 bash[23186]: audit 2024-09-21T00:41:25.544001+0000 mon.a (mon.0) 5596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:26 smithi179 bash[23186]: audit 2024-09-21T00:41:25.550197+0000 mon.a (mon.0) 5597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:26 smithi179 bash[23186]: audit 2024-09-21T00:41:25.558476+0000 mon.a (mon.0) 5598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:26 smithi049 bash[23528]: audit 2024-09-21T00:41:25.229158+0000 mon.a (mon.0) 5593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:26 smithi049 bash[23528]: audit 2024-09-21T00:41:25.238218+0000 mon.a (mon.0) 5594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:26 smithi049 bash[23528]: audit 2024-09-21T00:41:25.248978+0000 mon.a (mon.0) 5595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:26 smithi049 bash[23528]: audit 2024-09-21T00:41:25.544001+0000 mon.a (mon.0) 5596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:26 smithi049 bash[23528]: audit 2024-09-21T00:41:25.550197+0000 mon.a (mon.0) 5597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:26 smithi049 bash[23528]: audit 2024-09-21T00:41:25.558476+0000 mon.a (mon.0) 5598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:27 smithi044 bash[22676]: cluster 2024-09-21T00:41:26.590371+0000 mgr.a (mgr.14388) 6358 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:27 smithi179 bash[23186]: cluster 2024-09-21T00:41:26.590371+0000 mgr.a (mgr.14388) 6358 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:27.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:27 smithi049 bash[23528]: cluster 2024-09-21T00:41:26.590371+0000 mgr.a (mgr.14388) 6358 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:41:28.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:28.057 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:28.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:28.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:28.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:29 smithi049 bash[23528]: audit 2024-09-21T00:41:28.393697+0000 mgr.a (mgr.14388) 6359 : audit [DBG] from='client.145830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:29 smithi049 bash[23528]: cluster 2024-09-21T00:41:28.590947+0000 mgr.a (mgr.14388) 6360 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:29 smithi044 bash[22676]: audit 2024-09-21T00:41:28.393697+0000 mgr.a (mgr.14388) 6359 : audit [DBG] from='client.145830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:29 smithi044 bash[22676]: cluster 2024-09-21T00:41:28.590947+0000 mgr.a (mgr.14388) 6360 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:29 smithi179 bash[23186]: audit 2024-09-21T00:41:28.393697+0000 mgr.a (mgr.14388) 6359 : audit [DBG] from='client.145830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:29 smithi179 bash[23186]: cluster 2024-09-21T00:41:28.590947+0000 mgr.a (mgr.14388) 6360 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:31 smithi044 bash[22676]: cluster 2024-09-21T00:41:30.593272+0000 mgr.a (mgr.14388) 6361 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:31 smithi179 bash[23186]: cluster 2024-09-21T00:41:30.593272+0000 mgr.a (mgr.14388) 6361 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:31 smithi049 bash[23528]: cluster 2024-09-21T00:41:30.593272+0000 mgr.a (mgr.14388) 6361 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:33.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:33.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:33.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:33 smithi044 bash[22676]: cluster 2024-09-21T00:41:32.594070+0000 mgr.a (mgr.14388) 6362 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:33 smithi179 bash[23186]: cluster 2024-09-21T00:41:32.594070+0000 mgr.a (mgr.14388) 6362 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:34.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:33 smithi049 bash[23528]: cluster 2024-09-21T00:41:32.594070+0000 mgr.a (mgr.14388) 6362 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:34.631 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:34.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:34.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:34.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:34.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:35 smithi044 bash[22676]: audit 2024-09-21T00:41:34.188496+0000 mgr.a (mgr.14388) 6363 : audit [DBG] from='client.145905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:35 smithi044 bash[22676]: cluster 2024-09-21T00:41:34.594733+0000 mgr.a (mgr.14388) 6364 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:35 smithi179 bash[23186]: audit 2024-09-21T00:41:34.188496+0000 mgr.a (mgr.14388) 6363 : audit [DBG] from='client.145905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:35 smithi179 bash[23186]: cluster 2024-09-21T00:41:34.594733+0000 mgr.a (mgr.14388) 6364 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:35 smithi049 bash[23528]: audit 2024-09-21T00:41:34.188496+0000 mgr.a (mgr.14388) 6363 : audit [DBG] from='client.145905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:35 smithi049 bash[23528]: cluster 2024-09-21T00:41:34.594733+0000 mgr.a (mgr.14388) 6364 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:37 smithi044 bash[22676]: cluster 2024-09-21T00:41:36.596975+0000 mgr.a (mgr.14388) 6365 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:37 smithi179 bash[23186]: cluster 2024-09-21T00:41:36.596975+0000 mgr.a (mgr.14388) 6365 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:37 smithi049 bash[23528]: cluster 2024-09-21T00:41:36.596975+0000 mgr.a (mgr.14388) 6365 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:39.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:39.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:39.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:39 smithi044 bash[22676]: cluster 2024-09-21T00:41:38.597902+0000 mgr.a (mgr.14388) 6366 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:39 smithi179 bash[23186]: cluster 2024-09-21T00:41:38.597902+0000 mgr.a (mgr.14388) 6366 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:40.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:39 smithi049 bash[23528]: cluster 2024-09-21T00:41:38.597902+0000 mgr.a (mgr.14388) 6366 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:40.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:40.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:41.943 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:41 smithi179 bash[23186]: audit 2024-09-21T00:41:39.974061+0000 mgr.a (mgr.14388) 6367 : audit [DBG] from='client.145983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:41.944 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:41 smithi179 bash[23186]: cluster 2024-09-21T00:41:40.600694+0000 mgr.a (mgr.14388) 6368 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:41 smithi044 bash[22676]: audit 2024-09-21T00:41:39.974061+0000 mgr.a (mgr.14388) 6367 : audit [DBG] from='client.145983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:41 smithi044 bash[22676]: cluster 2024-09-21T00:41:40.600694+0000 mgr.a (mgr.14388) 6368 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:41 smithi049 bash[23528]: audit 2024-09-21T00:41:39.974061+0000 mgr.a (mgr.14388) 6367 : audit [DBG] from='client.145983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:41 smithi049 bash[23528]: cluster 2024-09-21T00:41:40.600694+0000 mgr.a (mgr.14388) 6368 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:43 smithi179 bash[23186]: cluster 2024-09-21T00:41:42.601273+0000 mgr.a (mgr.14388) 6369 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:43 smithi044 bash[22676]: cluster 2024-09-21T00:41:42.601273+0000 mgr.a (mgr.14388) 6369 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:43 smithi049 bash[23528]: cluster 2024-09-21T00:41:42.601273+0000 mgr.a (mgr.14388) 6369 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:45.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:45.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:45.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:45.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:45 smithi049 bash[23528]: audit 2024-09-21T00:41:44.167312+0000 mon.a (mon.0) 5599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:45 smithi049 bash[23528]: audit 2024-09-21T00:41:44.175187+0000 mon.a (mon.0) 5600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:45 smithi049 bash[23528]: audit 2024-09-21T00:41:44.185586+0000 mon.a (mon.0) 5601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.478 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:45 smithi049 bash[23528]: cluster 2024-09-21T00:41:44.602272+0000 mgr.a (mgr.14388) 6370 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:41:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:45 smithi044 bash[22676]: audit 2024-09-21T00:41:44.167312+0000 mon.a (mon.0) 5599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:45 smithi044 bash[22676]: audit 2024-09-21T00:41:44.175187+0000 mon.a (mon.0) 5600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:45 smithi044 bash[22676]: audit 2024-09-21T00:41:44.185586+0000 mon.a (mon.0) 5601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:45 smithi044 bash[22676]: cluster 2024-09-21T00:41:44.602272+0000 mgr.a (mgr.14388) 6370 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:41:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:45 smithi179 bash[23186]: audit 2024-09-21T00:41:44.167312+0000 mon.a (mon.0) 5599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:45 smithi179 bash[23186]: audit 2024-09-21T00:41:44.175187+0000 mon.a (mon.0) 5600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:45 smithi179 bash[23186]: audit 2024-09-21T00:41:44.185586+0000 mon.a (mon.0) 5601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:45 smithi179 bash[23186]: cluster 2024-09-21T00:41:44.602272+0000 mgr.a (mgr.14388) 6370 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:41:46.204 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:46.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:46.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:46.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:46.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:46 smithi044 bash[22676]: audit 2024-09-21T00:41:45.458705+0000 mon.a (mon.0) 5602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:46 smithi044 bash[22676]: audit 2024-09-21T00:41:45.467593+0000 mon.a (mon.0) 5603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:46 smithi044 bash[22676]: audit 2024-09-21T00:41:45.475726+0000 mon.a (mon.0) 5604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:46 smithi044 bash[22676]: audit 2024-09-21T00:41:45.741284+0000 mon.a (mon.0) 5605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:46 smithi044 bash[22676]: audit 2024-09-21T00:41:45.749211+0000 mon.a (mon.0) 5606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:46 smithi044 bash[22676]: audit 2024-09-21T00:41:45.760256+0000 mon.a (mon.0) 5607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:46 smithi044 bash[22676]: audit 2024-09-21T00:41:45.762964+0000 mgr.a (mgr.14388) 6371 : audit [DBG] from='client.146061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:46 smithi179 bash[23186]: audit 2024-09-21T00:41:45.458705+0000 mon.a (mon.0) 5602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:46 smithi179 bash[23186]: audit 2024-09-21T00:41:45.467593+0000 mon.a (mon.0) 5603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:46 smithi179 bash[23186]: audit 2024-09-21T00:41:45.475726+0000 mon.a (mon.0) 5604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:46 smithi179 bash[23186]: audit 2024-09-21T00:41:45.741284+0000 mon.a (mon.0) 5605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:46 smithi179 bash[23186]: audit 2024-09-21T00:41:45.749211+0000 mon.a (mon.0) 5606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:46 smithi179 bash[23186]: audit 2024-09-21T00:41:45.760256+0000 mon.a (mon.0) 5607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:46 smithi179 bash[23186]: audit 2024-09-21T00:41:45.762964+0000 mgr.a (mgr.14388) 6371 : audit [DBG] from='client.146061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:46.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:46 smithi049 bash[23528]: audit 2024-09-21T00:41:45.458705+0000 mon.a (mon.0) 5602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:46 smithi049 bash[23528]: audit 2024-09-21T00:41:45.467593+0000 mon.a (mon.0) 5603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:46 smithi049 bash[23528]: audit 2024-09-21T00:41:45.475726+0000 mon.a (mon.0) 5604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:46 smithi049 bash[23528]: audit 2024-09-21T00:41:45.741284+0000 mon.a (mon.0) 5605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:46 smithi049 bash[23528]: audit 2024-09-21T00:41:45.749211+0000 mon.a (mon.0) 5606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:46 smithi049 bash[23528]: audit 2024-09-21T00:41:45.760256+0000 mon.a (mon.0) 5607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:41:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:46 smithi049 bash[23528]: audit 2024-09-21T00:41:45.762964+0000 mgr.a (mgr.14388) 6371 : audit [DBG] from='client.146061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:47 smithi044 bash[22676]: cluster 2024-09-21T00:41:46.605213+0000 mgr.a (mgr.14388) 6372 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:47 smithi179 bash[23186]: cluster 2024-09-21T00:41:46.605213+0000 mgr.a (mgr.14388) 6372 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:47.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:47 smithi049 bash[23528]: cluster 2024-09-21T00:41:46.605213+0000 mgr.a (mgr.14388) 6372 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:49 smithi044 bash[22676]: cluster 2024-09-21T00:41:48.606047+0000 mgr.a (mgr.14388) 6373 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:49 smithi179 bash[23186]: cluster 2024-09-21T00:41:48.606047+0000 mgr.a (mgr.14388) 6373 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:49 smithi049 bash[23528]: cluster 2024-09-21T00:41:48.606047+0000 mgr.a (mgr.14388) 6373 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:41:51.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:51.207 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:51.207 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:51.968 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:51 smithi044 bash[22676]: cluster 2024-09-21T00:41:50.608161+0000 mgr.a (mgr.14388) 6374 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:51 smithi179 bash[23186]: cluster 2024-09-21T00:41:50.608161+0000 mgr.a (mgr.14388) 6374 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:51 smithi049 bash[23528]: cluster 2024-09-21T00:41:50.608161+0000 mgr.a (mgr.14388) 6374 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:52 smithi044 bash[22676]: audit 2024-09-21T00:41:51.541324+0000 mgr.a (mgr.14388) 6375 : audit [DBG] from='client.146139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:52 smithi179 bash[23186]: audit 2024-09-21T00:41:51.541324+0000 mgr.a (mgr.14388) 6375 : audit [DBG] from='client.146139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:53.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:52 smithi049 bash[23528]: audit 2024-09-21T00:41:51.541324+0000 mgr.a (mgr.14388) 6375 : audit [DBG] from='client.146139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:53 smithi044 bash[22676]: cluster 2024-09-21T00:41:52.609218+0000 mgr.a (mgr.14388) 6376 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:53 smithi179 bash[23186]: cluster 2024-09-21T00:41:52.609218+0000 mgr.a (mgr.14388) 6376 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:53 smithi049 bash[23528]: cluster 2024-09-21T00:41:52.609218+0000 mgr.a (mgr.14388) 6376 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:55 smithi044 bash[22676]: cluster 2024-09-21T00:41:54.610210+0000 mgr.a (mgr.14388) 6377 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:55 smithi179 bash[23186]: cluster 2024-09-21T00:41:54.610210+0000 mgr.a (mgr.14388) 6377 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:55 smithi049 bash[23528]: cluster 2024-09-21T00:41:54.610210+0000 mgr.a (mgr.14388) 6377 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:41:56.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:41:56.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:41:56.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:41:57.732 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:41:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:41:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:57 smithi044 bash[22676]: cluster 2024-09-21T00:41:56.612608+0000 mgr.a (mgr.14388) 6378 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:57 smithi179 bash[23186]: cluster 2024-09-21T00:41:56.612608+0000 mgr.a (mgr.14388) 6378 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:58.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:57 smithi049 bash[23528]: cluster 2024-09-21T00:41:56.612608+0000 mgr.a (mgr.14388) 6378 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:41:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:58 smithi044 bash[22676]: audit 2024-09-21T00:41:57.302991+0000 mgr.a (mgr.14388) 6379 : audit [DBG] from='client.146214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:58 smithi179 bash[23186]: audit 2024-09-21T00:41:57.302991+0000 mgr.a (mgr.14388) 6379 : audit [DBG] from='client.146214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:59.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:58 smithi049 bash[23528]: audit 2024-09-21T00:41:57.302991+0000 mgr.a (mgr.14388) 6379 : audit [DBG] from='client.146214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:41:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:41:59 smithi044 bash[22676]: cluster 2024-09-21T00:41:58.613620+0000 mgr.a (mgr.14388) 6380 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:41:59 smithi179 bash[23186]: cluster 2024-09-21T00:41:58.613620+0000 mgr.a (mgr.14388) 6380 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:41:59 smithi049 bash[23528]: cluster 2024-09-21T00:41:58.613620+0000 mgr.a (mgr.14388) 6380 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:01.952 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:01 smithi179 bash[23186]: cluster 2024-09-21T00:42:00.615821+0000 mgr.a (mgr.14388) 6381 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:01 smithi044 bash[22676]: cluster 2024-09-21T00:42:00.615821+0000 mgr.a (mgr.14388) 6381 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:01 smithi049 bash[23528]: cluster 2024-09-21T00:42:00.615821+0000 mgr.a (mgr.14388) 6381 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:02.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:02.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:02.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:03.492 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:03.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:03.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:03.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:03.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:03 smithi044 bash[22676]: cluster 2024-09-21T00:42:02.616543+0000 mgr.a (mgr.14388) 6382 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:03 smithi179 bash[23186]: cluster 2024-09-21T00:42:02.616543+0000 mgr.a (mgr.14388) 6382 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:03 smithi049 bash[23528]: cluster 2024-09-21T00:42:02.616543+0000 mgr.a (mgr.14388) 6382 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:04 smithi044 bash[22676]: audit 2024-09-21T00:42:03.069942+0000 mgr.a (mgr.14388) 6383 : audit [DBG] from='client.146289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:04 smithi044 bash[22676]: audit 2024-09-21T00:42:04.316655+0000 mon.a (mon.0) 5608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:04 smithi044 bash[22676]: audit 2024-09-21T00:42:04.322397+0000 mon.a (mon.0) 5609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:04 smithi044 bash[22676]: audit 2024-09-21T00:42:04.328807+0000 mon.a (mon.0) 5610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:04 smithi179 bash[23186]: audit 2024-09-21T00:42:03.069942+0000 mgr.a (mgr.14388) 6383 : audit [DBG] from='client.146289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:04 smithi179 bash[23186]: audit 2024-09-21T00:42:04.316655+0000 mon.a (mon.0) 5608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:04 smithi179 bash[23186]: audit 2024-09-21T00:42:04.322397+0000 mon.a (mon.0) 5609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:04 smithi179 bash[23186]: audit 2024-09-21T00:42:04.328807+0000 mon.a (mon.0) 5610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:04 smithi049 bash[23528]: audit 2024-09-21T00:42:03.069942+0000 mgr.a (mgr.14388) 6383 : audit [DBG] from='client.146289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:04 smithi049 bash[23528]: audit 2024-09-21T00:42:04.316655+0000 mon.a (mon.0) 5608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:04 smithi049 bash[23528]: audit 2024-09-21T00:42:04.322397+0000 mon.a (mon.0) 5609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:04 smithi049 bash[23528]: audit 2024-09-21T00:42:04.328807+0000 mon.a (mon.0) 5610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:05 smithi044 bash[22676]: cluster 2024-09-21T00:42:04.617299+0000 mgr.a (mgr.14388) 6384 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:05 smithi044 bash[22676]: audit 2024-09-21T00:42:05.688007+0000 mon.a (mon.0) 5611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:05 smithi044 bash[22676]: audit 2024-09-21T00:42:05.696729+0000 mon.a (mon.0) 5612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:05 smithi179 bash[23186]: cluster 2024-09-21T00:42:04.617299+0000 mgr.a (mgr.14388) 6384 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:05 smithi179 bash[23186]: audit 2024-09-21T00:42:05.688007+0000 mon.a (mon.0) 5611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:05 smithi179 bash[23186]: audit 2024-09-21T00:42:05.696729+0000 mon.a (mon.0) 5612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:05 smithi049 bash[23528]: cluster 2024-09-21T00:42:04.617299+0000 mgr.a (mgr.14388) 6384 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:05 smithi049 bash[23528]: audit 2024-09-21T00:42:05.688007+0000 mon.a (mon.0) 5611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:05 smithi049 bash[23528]: audit 2024-09-21T00:42:05.696729+0000 mon.a (mon.0) 5612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:06 smithi044 bash[22676]: audit 2024-09-21T00:42:05.708035+0000 mon.a (mon.0) 5613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:06 smithi044 bash[22676]: audit 2024-09-21T00:42:05.980096+0000 mon.a (mon.0) 5614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:06 smithi044 bash[22676]: audit 2024-09-21T00:42:05.989859+0000 mon.a (mon.0) 5615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:06 smithi044 bash[22676]: audit 2024-09-21T00:42:05.999958+0000 mon.a (mon.0) 5616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:06 smithi179 bash[23186]: audit 2024-09-21T00:42:05.708035+0000 mon.a (mon.0) 5613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:06 smithi179 bash[23186]: audit 2024-09-21T00:42:05.980096+0000 mon.a (mon.0) 5614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:06 smithi179 bash[23186]: audit 2024-09-21T00:42:05.989859+0000 mon.a (mon.0) 5615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:06 smithi179 bash[23186]: audit 2024-09-21T00:42:05.999958+0000 mon.a (mon.0) 5616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:06 smithi049 bash[23528]: audit 2024-09-21T00:42:05.708035+0000 mon.a (mon.0) 5613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:06 smithi049 bash[23528]: audit 2024-09-21T00:42:05.980096+0000 mon.a (mon.0) 5614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:06 smithi049 bash[23528]: audit 2024-09-21T00:42:05.989859+0000 mon.a (mon.0) 5615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:06 smithi049 bash[23528]: audit 2024-09-21T00:42:05.999958+0000 mon.a (mon.0) 5616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:07 smithi044 bash[22676]: cluster 2024-09-21T00:42:06.619526+0000 mgr.a (mgr.14388) 6385 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:07 smithi179 bash[23186]: cluster 2024-09-21T00:42:06.619526+0000 mgr.a (mgr.14388) 6385 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:08.031 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:07 smithi049 bash[23528]: cluster 2024-09-21T00:42:06.619526+0000 mgr.a (mgr.14388) 6385 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:08.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:09.283 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:09.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:09 smithi044 bash[22676]: cluster 2024-09-21T00:42:08.619981+0000 mgr.a (mgr.14388) 6386 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:09 smithi179 bash[23186]: cluster 2024-09-21T00:42:08.619981+0000 mgr.a (mgr.14388) 6386 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:09 smithi049 bash[23528]: cluster 2024-09-21T00:42:08.619981+0000 mgr.a (mgr.14388) 6386 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:10 smithi044 bash[22676]: audit 2024-09-21T00:42:08.832774+0000 mgr.a (mgr.14388) 6387 : audit [DBG] from='client.146367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:10 smithi179 bash[23186]: audit 2024-09-21T00:42:08.832774+0000 mgr.a (mgr.14388) 6387 : audit [DBG] from='client.146367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:10 smithi049 bash[23528]: audit 2024-09-21T00:42:08.832774+0000 mgr.a (mgr.14388) 6387 : audit [DBG] from='client.146367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:11 smithi049 bash[23528]: cluster 2024-09-21T00:42:10.622276+0000 mgr.a (mgr.14388) 6388 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:11 smithi044 bash[22676]: cluster 2024-09-21T00:42:10.622276+0000 mgr.a (mgr.14388) 6388 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:11 smithi179 bash[23186]: cluster 2024-09-21T00:42:10.622276+0000 mgr.a (mgr.14388) 6388 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:13 smithi044 bash[22676]: cluster 2024-09-21T00:42:12.623100+0000 mgr.a (mgr.14388) 6389 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:13 smithi179 bash[23186]: cluster 2024-09-21T00:42:12.623100+0000 mgr.a (mgr.14388) 6389 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:14.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:13 smithi049 bash[23528]: cluster 2024-09-21T00:42:12.623100+0000 mgr.a (mgr.14388) 6389 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:14.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:14.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:14.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:14 smithi179 bash[23186]: audit 2024-09-21T00:42:14.123563+0000 mon.a (mon.0) 5617 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:42:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:14 smithi179 bash[23186]: audit 2024-09-21T00:42:14.732522+0000 mon.a (mon.0) 5618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:15.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:14 smithi049 bash[23528]: audit 2024-09-21T00:42:14.123563+0000 mon.a (mon.0) 5617 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:42:15.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:14 smithi049 bash[23528]: audit 2024-09-21T00:42:14.732522+0000 mon.a (mon.0) 5618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:15.052 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:15.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:15.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:15.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:15.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:14 smithi044 bash[22676]: audit 2024-09-21T00:42:14.123563+0000 mon.a (mon.0) 5617 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:42:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:14 smithi044 bash[22676]: audit 2024-09-21T00:42:14.732522+0000 mon.a (mon.0) 5618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.621485+0000 mgr.a (mgr.14388) 6390 : audit [DBG] from='client.146445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: cluster 2024-09-21T00:42:14.632849+0000 mgr.a (mgr.14388) 6391 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.739396+0000 mon.a (mon.0) 5619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.749621+0000 mon.a (mon.0) 5620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.763693+0000 mon.a (mon.0) 5621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.765540+0000 mon.a (mon.0) 5622 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.766331+0000 mon.a (mon.0) 5623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.771485+0000 mon.a (mon.0) 5624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.774005+0000 mon.a (mon.0) 5625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:42:16.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:15 smithi179 bash[23186]: audit 2024-09-21T00:42:14.775141+0000 mgr.a (mgr.14388) 6392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:42:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.621485+0000 mgr.a (mgr.14388) 6390 : audit [DBG] from='client.146445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: cluster 2024-09-21T00:42:14.632849+0000 mgr.a (mgr.14388) 6391 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.739396+0000 mon.a (mon.0) 5619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.749621+0000 mon.a (mon.0) 5620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.763693+0000 mon.a (mon.0) 5621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.765540+0000 mon.a (mon.0) 5622 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:42:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.766331+0000 mon.a (mon.0) 5623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:42:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.771485+0000 mon.a (mon.0) 5624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.774005+0000 mon.a (mon.0) 5625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:42:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:15 smithi049 bash[23528]: audit 2024-09-21T00:42:14.775141+0000 mgr.a (mgr.14388) 6392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:42:16.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22930]: debug 2024-09-21T00:42:15.750+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:42:16.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22930]: debug 2024-09-21T00:42:15.750+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:42:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.621485+0000 mgr.a (mgr.14388) 6390 : audit [DBG] from='client.146445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: cluster 2024-09-21T00:42:14.632849+0000 mgr.a (mgr.14388) 6391 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.739396+0000 mon.a (mon.0) 5619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.749621+0000 mon.a (mon.0) 5620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.763693+0000 mon.a (mon.0) 5621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.765540+0000 mon.a (mon.0) 5622 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.766331+0000 mon.a (mon.0) 5623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.771485+0000 mon.a (mon.0) 5624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.774005+0000 mon.a (mon.0) 5625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:42:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:15 smithi044 bash[22676]: audit 2024-09-21T00:42:14.775141+0000 mgr.a (mgr.14388) 6392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:42:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:16 smithi179 bash[23186]: audit 2024-09-21T00:42:15.754958+0000 mgr.a (mgr.14388) 6393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:42:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:16 smithi179 bash[23186]: cephadm 2024-09-21T00:42:15.756481+0000 mgr.a (mgr.14388) 6394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:42:17.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:16 smithi049 bash[23528]: audit 2024-09-21T00:42:15.754958+0000 mgr.a (mgr.14388) 6393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:42:17.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:16 smithi049 bash[23528]: cephadm 2024-09-21T00:42:15.756481+0000 mgr.a (mgr.14388) 6394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:42:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:16 smithi044 bash[22676]: audit 2024-09-21T00:42:15.754958+0000 mgr.a (mgr.14388) 6393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:42:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:16 smithi044 bash[22676]: cephadm 2024-09-21T00:42:15.756481+0000 mgr.a (mgr.14388) 6394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:42:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:17 smithi049 bash[23528]: cluster 2024-09-21T00:42:16.635743+0000 mgr.a (mgr.14388) 6395 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:17 smithi044 bash[22676]: cluster 2024-09-21T00:42:16.635743+0000 mgr.a (mgr.14388) 6395 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:17 smithi179 bash[23186]: cluster 2024-09-21T00:42:16.635743+0000 mgr.a (mgr.14388) 6395 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:19 smithi049 bash[23528]: cluster 2024-09-21T00:42:18.636529+0000 mgr.a (mgr.14388) 6396 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:20.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:20.054 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:20.054 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:19 smithi044 bash[22676]: cluster 2024-09-21T00:42:18.636529+0000 mgr.a (mgr.14388) 6396 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:19 smithi179 bash[23186]: cluster 2024-09-21T00:42:18.636529+0000 mgr.a (mgr.14388) 6396 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:20.840 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:20.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:20.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:20.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:20.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:21 smithi179 bash[23186]: audit 2024-09-21T00:42:20.394581+0000 mgr.a (mgr.14388) 6397 : audit [DBG] from='client.146628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:21 smithi179 bash[23186]: cluster 2024-09-21T00:42:20.638564+0000 mgr.a (mgr.14388) 6398 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:21 smithi049 bash[23528]: audit 2024-09-21T00:42:20.394581+0000 mgr.a (mgr.14388) 6397 : audit [DBG] from='client.146628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:21 smithi049 bash[23528]: cluster 2024-09-21T00:42:20.638564+0000 mgr.a (mgr.14388) 6398 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:21 smithi044 bash[22676]: audit 2024-09-21T00:42:20.394581+0000 mgr.a (mgr.14388) 6397 : audit [DBG] from='client.146628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:21 smithi044 bash[22676]: cluster 2024-09-21T00:42:20.638564+0000 mgr.a (mgr.14388) 6398 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:23 smithi179 bash[23186]: cluster 2024-09-21T00:42:22.639519+0000 mgr.a (mgr.14388) 6399 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:24.022 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:23 smithi044 bash[22676]: cluster 2024-09-21T00:42:22.639519+0000 mgr.a (mgr.14388) 6399 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:23 smithi049 bash[23528]: cluster 2024-09-21T00:42:22.639519+0000 mgr.a (mgr.14388) 6399 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:25.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:25.941 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:25 smithi049 bash[23528]: audit 2024-09-21T00:42:24.550721+0000 mon.a (mon.0) 5626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:25.941 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:25 smithi049 bash[23528]: audit 2024-09-21T00:42:24.572440+0000 mon.a (mon.0) 5627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:25.941 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:25 smithi049 bash[23528]: audit 2024-09-21T00:42:24.585214+0000 mon.a (mon.0) 5628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:25.942 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:25 smithi049 bash[23528]: cluster 2024-09-21T00:42:24.640300+0000 mgr.a (mgr.14388) 6400 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:25 smithi044 bash[22676]: audit 2024-09-21T00:42:24.550721+0000 mon.a (mon.0) 5626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:25 smithi044 bash[22676]: audit 2024-09-21T00:42:24.572440+0000 mon.a (mon.0) 5627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:25 smithi044 bash[22676]: audit 2024-09-21T00:42:24.585214+0000 mon.a (mon.0) 5628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:25 smithi044 bash[22676]: cluster 2024-09-21T00:42:24.640300+0000 mgr.a (mgr.14388) 6400 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:25 smithi179 bash[23186]: audit 2024-09-21T00:42:24.550721+0000 mon.a (mon.0) 5626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:25 smithi179 bash[23186]: audit 2024-09-21T00:42:24.572440+0000 mon.a (mon.0) 5627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:25 smithi179 bash[23186]: audit 2024-09-21T00:42:24.585214+0000 mon.a (mon.0) 5628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:25 smithi179 bash[23186]: cluster 2024-09-21T00:42:24.640300+0000 mgr.a (mgr.14388) 6400 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:26.622 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:26.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:26.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:26.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:26.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: audit 2024-09-21T00:42:25.920563+0000 mon.a (mon.0) 5629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: audit 2024-09-21T00:42:25.929345+0000 mon.a (mon.0) 5630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: audit 2024-09-21T00:42:25.939260+0000 mon.a (mon.0) 5631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: audit 2024-09-21T00:42:26.179475+0000 mgr.a (mgr.14388) 6401 : audit [DBG] from='client.146706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: audit 2024-09-21T00:42:26.187230+0000 mon.a (mon.0) 5632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: audit 2024-09-21T00:42:26.201210+0000 mon.a (mon.0) 5633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: audit 2024-09-21T00:42:26.214045+0000 mon.a (mon.0) 5634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:26 smithi044 bash[22676]: cluster 2024-09-21T00:42:26.641843+0000 mgr.a (mgr.14388) 6402 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: audit 2024-09-21T00:42:25.920563+0000 mon.a (mon.0) 5629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: audit 2024-09-21T00:42:25.929345+0000 mon.a (mon.0) 5630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: audit 2024-09-21T00:42:25.939260+0000 mon.a (mon.0) 5631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: audit 2024-09-21T00:42:26.179475+0000 mgr.a (mgr.14388) 6401 : audit [DBG] from='client.146706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: audit 2024-09-21T00:42:26.187230+0000 mon.a (mon.0) 5632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: audit 2024-09-21T00:42:26.201210+0000 mon.a (mon.0) 5633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: audit 2024-09-21T00:42:26.214045+0000 mon.a (mon.0) 5634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:26 smithi179 bash[23186]: cluster 2024-09-21T00:42:26.641843+0000 mgr.a (mgr.14388) 6402 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: audit 2024-09-21T00:42:25.920563+0000 mon.a (mon.0) 5629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: audit 2024-09-21T00:42:25.929345+0000 mon.a (mon.0) 5630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: audit 2024-09-21T00:42:25.939260+0000 mon.a (mon.0) 5631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: audit 2024-09-21T00:42:26.179475+0000 mgr.a (mgr.14388) 6401 : audit [DBG] from='client.146706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: audit 2024-09-21T00:42:26.187230+0000 mon.a (mon.0) 5632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: audit 2024-09-21T00:42:26.201210+0000 mon.a (mon.0) 5633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: audit 2024-09-21T00:42:26.214045+0000 mon.a (mon.0) 5634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:26 smithi049 bash[23528]: cluster 2024-09-21T00:42:26.641843+0000 mgr.a (mgr.14388) 6402 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:29 smithi049 bash[23528]: cluster 2024-09-21T00:42:28.642731+0000 mgr.a (mgr.14388) 6403 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:29 smithi044 bash[22676]: cluster 2024-09-21T00:42:28.642731+0000 mgr.a (mgr.14388) 6403 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:29 smithi179 bash[23186]: cluster 2024-09-21T00:42:28.642731+0000 mgr.a (mgr.14388) 6403 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:42:31.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:31.625 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:31.625 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:31 smithi044 bash[22676]: cluster 2024-09-21T00:42:30.644788+0000 mgr.a (mgr.14388) 6404 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:31 smithi179 bash[23186]: cluster 2024-09-21T00:42:30.644788+0000 mgr.a (mgr.14388) 6404 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:31 smithi049 bash[23528]: cluster 2024-09-21T00:42:30.644788+0000 mgr.a (mgr.14388) 6404 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:42:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:33 smithi044 bash[22676]: audit 2024-09-21T00:42:31.957074+0000 mgr.a (mgr.14388) 6405 : audit [DBG] from='client.146784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:33 smithi044 bash[22676]: cluster 2024-09-21T00:42:32.645800+0000 mgr.a (mgr.14388) 6406 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:33 smithi179 bash[23186]: audit 2024-09-21T00:42:31.957074+0000 mgr.a (mgr.14388) 6405 : audit [DBG] from='client.146784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:33 smithi179 bash[23186]: cluster 2024-09-21T00:42:32.645800+0000 mgr.a (mgr.14388) 6406 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:33 smithi049 bash[23528]: audit 2024-09-21T00:42:31.957074+0000 mgr.a (mgr.14388) 6405 : audit [DBG] from='client.146784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:33 smithi049 bash[23528]: cluster 2024-09-21T00:42:32.645800+0000 mgr.a (mgr.14388) 6406 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:35 smithi044 bash[22676]: cluster 2024-09-21T00:42:34.646612+0000 mgr.a (mgr.14388) 6407 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:35 smithi179 bash[23186]: cluster 2024-09-21T00:42:34.646612+0000 mgr.a (mgr.14388) 6407 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:35 smithi049 bash[23528]: cluster 2024-09-21T00:42:34.646612+0000 mgr.a (mgr.14388) 6407 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:37.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:37.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:37.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:37 smithi044 bash[22676]: cluster 2024-09-21T00:42:36.648831+0000 mgr.a (mgr.14388) 6408 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:37 smithi179 bash[23186]: cluster 2024-09-21T00:42:36.648831+0000 mgr.a (mgr.14388) 6408 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:37 smithi049 bash[23528]: cluster 2024-09-21T00:42:36.648831+0000 mgr.a (mgr.14388) 6408 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:38.158 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:38 smithi044 bash[22676]: audit 2024-09-21T00:42:37.713322+0000 mgr.a (mgr.14388) 6409 : audit [DBG] from='client.146859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:38 smithi179 bash[23186]: audit 2024-09-21T00:42:37.713322+0000 mgr.a (mgr.14388) 6409 : audit [DBG] from='client.146859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:39.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:38 smithi049 bash[23528]: audit 2024-09-21T00:42:37.713322+0000 mgr.a (mgr.14388) 6409 : audit [DBG] from='client.146859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:39 smithi044 bash[22676]: cluster 2024-09-21T00:42:38.649975+0000 mgr.a (mgr.14388) 6410 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:39 smithi179 bash[23186]: cluster 2024-09-21T00:42:38.649975+0000 mgr.a (mgr.14388) 6410 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:40.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:39 smithi049 bash[23528]: cluster 2024-09-21T00:42:38.649975+0000 mgr.a (mgr.14388) 6410 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:41 smithi044 bash[22676]: cluster 2024-09-21T00:42:40.652210+0000 mgr.a (mgr.14388) 6411 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:41 smithi179 bash[23186]: cluster 2024-09-21T00:42:40.652210+0000 mgr.a (mgr.14388) 6411 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:41 smithi049 bash[23528]: cluster 2024-09-21T00:42:40.652210+0000 mgr.a (mgr.14388) 6411 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:43.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:43.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:43.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:43.908 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:43 smithi044 bash[22676]: cluster 2024-09-21T00:42:42.653046+0000 mgr.a (mgr.14388) 6412 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:43 smithi179 bash[23186]: cluster 2024-09-21T00:42:42.653046+0000 mgr.a (mgr.14388) 6412 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:43 smithi049 bash[23528]: cluster 2024-09-21T00:42:42.653046+0000 mgr.a (mgr.14388) 6412 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:44 smithi044 bash[22676]: audit 2024-09-21T00:42:43.485742+0000 mgr.a (mgr.14388) 6413 : audit [DBG] from='client.146937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:44 smithi179 bash[23186]: audit 2024-09-21T00:42:43.485742+0000 mgr.a (mgr.14388) 6413 : audit [DBG] from='client.146937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:45.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:44 smithi049 bash[23528]: audit 2024-09-21T00:42:43.485742+0000 mgr.a (mgr.14388) 6413 : audit [DBG] from='client.146937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:45 smithi049 bash[23528]: cluster 2024-09-21T00:42:44.653914+0000 mgr.a (mgr.14388) 6414 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:45 smithi049 bash[23528]: audit 2024-09-21T00:42:44.779697+0000 mon.a (mon.0) 5635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:45 smithi049 bash[23528]: audit 2024-09-21T00:42:44.787897+0000 mon.a (mon.0) 5636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:45 smithi049 bash[23528]: audit 2024-09-21T00:42:44.798646+0000 mon.a (mon.0) 5637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:45 smithi044 bash[22676]: cluster 2024-09-21T00:42:44.653914+0000 mgr.a (mgr.14388) 6414 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:45 smithi044 bash[22676]: audit 2024-09-21T00:42:44.779697+0000 mon.a (mon.0) 5635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:45 smithi044 bash[22676]: audit 2024-09-21T00:42:44.787897+0000 mon.a (mon.0) 5636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:45 smithi044 bash[22676]: audit 2024-09-21T00:42:44.798646+0000 mon.a (mon.0) 5637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:45 smithi179 bash[23186]: cluster 2024-09-21T00:42:44.653914+0000 mgr.a (mgr.14388) 6414 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:46.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:45 smithi179 bash[23186]: audit 2024-09-21T00:42:44.779697+0000 mon.a (mon.0) 5635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:45 smithi179 bash[23186]: audit 2024-09-21T00:42:44.787897+0000 mon.a (mon.0) 5636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:46.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:45 smithi179 bash[23186]: audit 2024-09-21T00:42:44.798646+0000 mon.a (mon.0) 5637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:47 smithi044 bash[22676]: audit 2024-09-21T00:42:46.148529+0000 mon.a (mon.0) 5638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:47 smithi044 bash[22676]: audit 2024-09-21T00:42:46.156888+0000 mon.a (mon.0) 5639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:47 smithi044 bash[22676]: audit 2024-09-21T00:42:46.166771+0000 mon.a (mon.0) 5640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:47 smithi044 bash[22676]: audit 2024-09-21T00:42:46.418044+0000 mon.a (mon.0) 5641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:47 smithi044 bash[22676]: audit 2024-09-21T00:42:46.423719+0000 mon.a (mon.0) 5642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:47 smithi044 bash[22676]: audit 2024-09-21T00:42:46.430107+0000 mon.a (mon.0) 5643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:47 smithi044 bash[22676]: cluster 2024-09-21T00:42:46.656138+0000 mgr.a (mgr.14388) 6415 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:47 smithi179 bash[23186]: audit 2024-09-21T00:42:46.148529+0000 mon.a (mon.0) 5638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:47 smithi179 bash[23186]: audit 2024-09-21T00:42:46.156888+0000 mon.a (mon.0) 5639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:47 smithi179 bash[23186]: audit 2024-09-21T00:42:46.166771+0000 mon.a (mon.0) 5640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:47 smithi179 bash[23186]: audit 2024-09-21T00:42:46.418044+0000 mon.a (mon.0) 5641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:47 smithi179 bash[23186]: audit 2024-09-21T00:42:46.423719+0000 mon.a (mon.0) 5642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:47 smithi179 bash[23186]: audit 2024-09-21T00:42:46.430107+0000 mon.a (mon.0) 5643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:47 smithi179 bash[23186]: cluster 2024-09-21T00:42:46.656138+0000 mgr.a (mgr.14388) 6415 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:47 smithi049 bash[23528]: audit 2024-09-21T00:42:46.148529+0000 mon.a (mon.0) 5638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:47 smithi049 bash[23528]: audit 2024-09-21T00:42:46.156888+0000 mon.a (mon.0) 5639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:47 smithi049 bash[23528]: audit 2024-09-21T00:42:46.166771+0000 mon.a (mon.0) 5640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:47 smithi049 bash[23528]: audit 2024-09-21T00:42:46.418044+0000 mon.a (mon.0) 5641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:47 smithi049 bash[23528]: audit 2024-09-21T00:42:46.423719+0000 mon.a (mon.0) 5642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:47 smithi049 bash[23528]: audit 2024-09-21T00:42:46.430107+0000 mon.a (mon.0) 5643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:42:47.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:47 smithi049 bash[23528]: cluster 2024-09-21T00:42:46.656138+0000 mgr.a (mgr.14388) 6415 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:48.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:48.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:48.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:49.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:49.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:49 smithi044 bash[22676]: cluster 2024-09-21T00:42:48.656950+0000 mgr.a (mgr.14388) 6416 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:49 smithi179 bash[23186]: cluster 2024-09-21T00:42:48.656950+0000 mgr.a (mgr.14388) 6416 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:50.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:49 smithi049 bash[23528]: cluster 2024-09-21T00:42:48.656950+0000 mgr.a (mgr.14388) 6416 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:50 smithi044 bash[22676]: audit 2024-09-21T00:42:49.240035+0000 mgr.a (mgr.14388) 6417 : audit [DBG] from='client.147012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:50 smithi179 bash[23186]: audit 2024-09-21T00:42:49.240035+0000 mgr.a (mgr.14388) 6417 : audit [DBG] from='client.147012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:51.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:50 smithi049 bash[23528]: audit 2024-09-21T00:42:49.240035+0000 mgr.a (mgr.14388) 6417 : audit [DBG] from='client.147012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:51 smithi044 bash[22676]: cluster 2024-09-21T00:42:50.658198+0000 mgr.a (mgr.14388) 6418 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:51 smithi179 bash[23186]: cluster 2024-09-21T00:42:50.658198+0000 mgr.a (mgr.14388) 6418 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:51 smithi049 bash[23528]: cluster 2024-09-21T00:42:50.658198+0000 mgr.a (mgr.14388) 6418 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:42:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:53 smithi044 bash[22676]: cluster 2024-09-21T00:42:52.658938+0000 mgr.a (mgr.14388) 6419 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:53 smithi179 bash[23186]: cluster 2024-09-21T00:42:52.658938+0000 mgr.a (mgr.14388) 6419 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:54.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:53 smithi049 bash[23528]: cluster 2024-09-21T00:42:52.658938+0000 mgr.a (mgr.14388) 6419 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:42:54.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:42:54.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:42:55.446 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:42:55.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:42:55.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:42:55.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:42:55.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:42:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:55 smithi044 bash[22676]: cluster 2024-09-21T00:42:54.659729+0000 mgr.a (mgr.14388) 6420 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:55 smithi179 bash[23186]: cluster 2024-09-21T00:42:54.659729+0000 mgr.a (mgr.14388) 6420 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:55 smithi049 bash[23528]: cluster 2024-09-21T00:42:54.659729+0000 mgr.a (mgr.14388) 6420 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:56 smithi179 bash[23186]: audit 2024-09-21T00:42:55.005785+0000 mgr.a (mgr.14388) 6421 : audit [DBG] from='client.147087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:57.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:56 smithi049 bash[23528]: audit 2024-09-21T00:42:55.005785+0000 mgr.a (mgr.14388) 6421 : audit [DBG] from='client.147087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:56 smithi044 bash[22676]: audit 2024-09-21T00:42:55.005785+0000 mgr.a (mgr.14388) 6421 : audit [DBG] from='client.147087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:42:57.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:57 smithi049 bash[23528]: cluster 2024-09-21T00:42:56.662626+0000 mgr.a (mgr.14388) 6422 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:57 smithi179 bash[23186]: cluster 2024-09-21T00:42:56.662626+0000 mgr.a (mgr.14388) 6422 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:42:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:57 smithi044 bash[22676]: cluster 2024-09-21T00:42:56.662626+0000 mgr.a (mgr.14388) 6422 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:42:59 smithi179 bash[23186]: cluster 2024-09-21T00:42:58.663400+0000 mgr.a (mgr.14388) 6423 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:42:59 smithi049 bash[23528]: cluster 2024-09-21T00:42:58.663400+0000 mgr.a (mgr.14388) 6423 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:42:59 smithi044 bash[22676]: cluster 2024-09-21T00:42:58.663400+0000 mgr.a (mgr.14388) 6423 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:00.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:00.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:01.211 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:01.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:01.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:01.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:01.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:01 smithi179 bash[23186]: cluster 2024-09-21T00:43:00.665464+0000 mgr.a (mgr.14388) 6424 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:01 smithi179 bash[23186]: audit 2024-09-21T00:43:00.783474+0000 mgr.a (mgr.14388) 6425 : audit [DBG] from='client.147165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:02.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:01 smithi049 bash[23528]: cluster 2024-09-21T00:43:00.665464+0000 mgr.a (mgr.14388) 6424 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:02.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:01 smithi049 bash[23528]: audit 2024-09-21T00:43:00.783474+0000 mgr.a (mgr.14388) 6425 : audit [DBG] from='client.147165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:01 smithi044 bash[22676]: cluster 2024-09-21T00:43:00.665464+0000 mgr.a (mgr.14388) 6424 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:01 smithi044 bash[22676]: audit 2024-09-21T00:43:00.783474+0000 mgr.a (mgr.14388) 6425 : audit [DBG] from='client.147165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:04.020 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:03 smithi179 bash[23186]: cluster 2024-09-21T00:43:02.666560+0000 mgr.a (mgr.14388) 6426 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:05.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:03 smithi049 bash[23528]: cluster 2024-09-21T00:43:02.666560+0000 mgr.a (mgr.14388) 6426 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:05.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:03 smithi044 bash[22676]: cluster 2024-09-21T00:43:02.666560+0000 mgr.a (mgr.14388) 6426 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:05 smithi179 bash[23186]: cluster 2024-09-21T00:43:04.667392+0000 mgr.a (mgr.14388) 6427 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:43:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:05 smithi179 bash[23186]: audit 2024-09-21T00:43:04.968942+0000 mon.a (mon.0) 5644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:05 smithi179 bash[23186]: audit 2024-09-21T00:43:04.977518+0000 mon.a (mon.0) 5645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:05 smithi179 bash[23186]: audit 2024-09-21T00:43:04.987953+0000 mon.a (mon.0) 5646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:05 smithi049 bash[23528]: cluster 2024-09-21T00:43:04.667392+0000 mgr.a (mgr.14388) 6427 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:43:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:05 smithi049 bash[23528]: audit 2024-09-21T00:43:04.968942+0000 mon.a (mon.0) 5644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:05 smithi049 bash[23528]: audit 2024-09-21T00:43:04.977518+0000 mon.a (mon.0) 5645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:05 smithi049 bash[23528]: audit 2024-09-21T00:43:04.987953+0000 mon.a (mon.0) 5646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:06.213 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:06.213 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:05 smithi044 bash[22676]: cluster 2024-09-21T00:43:04.667392+0000 mgr.a (mgr.14388) 6427 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:43:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:05 smithi044 bash[22676]: audit 2024-09-21T00:43:04.968942+0000 mon.a (mon.0) 5644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:05 smithi044 bash[22676]: audit 2024-09-21T00:43:04.977518+0000 mon.a (mon.0) 5645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:05 smithi044 bash[22676]: audit 2024-09-21T00:43:04.987953+0000 mon.a (mon.0) 5646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:06.997 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:06.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:06.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:06.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:06.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: audit 2024-09-21T00:43:06.373453+0000 mon.a (mon.0) 5647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: audit 2024-09-21T00:43:06.381339+0000 mon.a (mon.0) 5648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: audit 2024-09-21T00:43:06.390642+0000 mon.a (mon.0) 5649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: audit 2024-09-21T00:43:06.557083+0000 mgr.a (mgr.14388) 6428 : audit [DBG] from='client.147243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: audit 2024-09-21T00:43:06.597277+0000 mon.a (mon.0) 5650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: audit 2024-09-21T00:43:06.603115+0000 mon.a (mon.0) 5651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: audit 2024-09-21T00:43:06.609872+0000 mon.a (mon.0) 5652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:07 smithi044 bash[22676]: cluster 2024-09-21T00:43:06.669150+0000 mgr.a (mgr.14388) 6429 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: audit 2024-09-21T00:43:06.373453+0000 mon.a (mon.0) 5647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: audit 2024-09-21T00:43:06.381339+0000 mon.a (mon.0) 5648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: audit 2024-09-21T00:43:06.390642+0000 mon.a (mon.0) 5649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: audit 2024-09-21T00:43:06.557083+0000 mgr.a (mgr.14388) 6428 : audit [DBG] from='client.147243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: audit 2024-09-21T00:43:06.597277+0000 mon.a (mon.0) 5650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: audit 2024-09-21T00:43:06.603115+0000 mon.a (mon.0) 5651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: audit 2024-09-21T00:43:06.609872+0000 mon.a (mon.0) 5652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:07 smithi179 bash[23186]: cluster 2024-09-21T00:43:06.669150+0000 mgr.a (mgr.14388) 6429 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: audit 2024-09-21T00:43:06.373453+0000 mon.a (mon.0) 5647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: audit 2024-09-21T00:43:06.381339+0000 mon.a (mon.0) 5648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: audit 2024-09-21T00:43:06.390642+0000 mon.a (mon.0) 5649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: audit 2024-09-21T00:43:06.557083+0000 mgr.a (mgr.14388) 6428 : audit [DBG] from='client.147243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: audit 2024-09-21T00:43:06.597277+0000 mon.a (mon.0) 5650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: audit 2024-09-21T00:43:06.603115+0000 mon.a (mon.0) 5651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: audit 2024-09-21T00:43:06.609872+0000 mon.a (mon.0) 5652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:07.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:07 smithi049 bash[23528]: cluster 2024-09-21T00:43:06.669150+0000 mgr.a (mgr.14388) 6429 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:09.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:09 smithi049 bash[23528]: cluster 2024-09-21T00:43:08.670042+0000 mgr.a (mgr.14388) 6430 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:09 smithi044 bash[22676]: cluster 2024-09-21T00:43:08.670042+0000 mgr.a (mgr.14388) 6430 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:09 smithi179 bash[23186]: cluster 2024-09-21T00:43:08.670042+0000 mgr.a (mgr.14388) 6430 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:11 smithi179 bash[23186]: cluster 2024-09-21T00:43:10.672232+0000 mgr.a (mgr.14388) 6431 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:11 smithi044 bash[22676]: cluster 2024-09-21T00:43:10.672232+0000 mgr.a (mgr.14388) 6431 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:11.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:12.000 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:12.000 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:11 smithi049 bash[23528]: cluster 2024-09-21T00:43:10.672232+0000 mgr.a (mgr.14388) 6431 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:12.780 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:12.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:12.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:12.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:12.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:13 smithi044 bash[22676]: audit 2024-09-21T00:43:12.337460+0000 mgr.a (mgr.14388) 6432 : audit [DBG] from='client.147321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:13 smithi044 bash[22676]: cluster 2024-09-21T00:43:12.676437+0000 mgr.a (mgr.14388) 6433 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:13 smithi179 bash[23186]: audit 2024-09-21T00:43:12.337460+0000 mgr.a (mgr.14388) 6432 : audit [DBG] from='client.147321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:13 smithi179 bash[23186]: cluster 2024-09-21T00:43:12.676437+0000 mgr.a (mgr.14388) 6433 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:14.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:13 smithi049 bash[23528]: audit 2024-09-21T00:43:12.337460+0000 mgr.a (mgr.14388) 6432 : audit [DBG] from='client.147321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:14.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:13 smithi049 bash[23528]: cluster 2024-09-21T00:43:12.676437+0000 mgr.a (mgr.14388) 6433 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:15 smithi179 bash[23186]: cluster 2024-09-21T00:43:14.677217+0000 mgr.a (mgr.14388) 6434 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:15 smithi049 bash[23528]: cluster 2024-09-21T00:43:14.677217+0000 mgr.a (mgr.14388) 6434 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:15 smithi044 bash[22676]: cluster 2024-09-21T00:43:14.677217+0000 mgr.a (mgr.14388) 6434 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:16 smithi179 bash[23186]: audit 2024-09-21T00:43:15.815533+0000 mon.a (mon.0) 5653 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:43:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:16 smithi179 bash[23186]: audit 2024-09-21T00:43:16.395955+0000 mon.a (mon.0) 5654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:16 smithi179 bash[23186]: audit 2024-09-21T00:43:16.404312+0000 mon.a (mon.0) 5655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:16 smithi179 bash[23186]: audit 2024-09-21T00:43:16.406540+0000 mon.a (mon.0) 5656 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:43:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:16 smithi179 bash[23186]: audit 2024-09-21T00:43:16.408503+0000 mon.a (mon.0) 5657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:43:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:16 smithi179 bash[23186]: audit 2024-09-21T00:43:16.419162+0000 mon.a (mon.0) 5658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:16 smithi179 bash[23186]: audit 2024-09-21T00:43:16.426659+0000 mon.a (mon.0) 5659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:43:17.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:16 smithi049 bash[23528]: audit 2024-09-21T00:43:15.815533+0000 mon.a (mon.0) 5653 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:43:17.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:16 smithi049 bash[23528]: audit 2024-09-21T00:43:16.395955+0000 mon.a (mon.0) 5654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:16 smithi049 bash[23528]: audit 2024-09-21T00:43:16.404312+0000 mon.a (mon.0) 5655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:16 smithi049 bash[23528]: audit 2024-09-21T00:43:16.406540+0000 mon.a (mon.0) 5656 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:43:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:16 smithi049 bash[23528]: audit 2024-09-21T00:43:16.408503+0000 mon.a (mon.0) 5657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:43:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:16 smithi049 bash[23528]: audit 2024-09-21T00:43:16.419162+0000 mon.a (mon.0) 5658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:16 smithi049 bash[23528]: audit 2024-09-21T00:43:16.426659+0000 mon.a (mon.0) 5659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:43:17.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:16 smithi044 bash[22676]: audit 2024-09-21T00:43:15.815533+0000 mon.a (mon.0) 5653 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:43:17.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:16 smithi044 bash[22676]: audit 2024-09-21T00:43:16.395955+0000 mon.a (mon.0) 5654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:16 smithi044 bash[22676]: audit 2024-09-21T00:43:16.404312+0000 mon.a (mon.0) 5655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:16 smithi044 bash[22676]: audit 2024-09-21T00:43:16.406540+0000 mon.a (mon.0) 5656 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:43:17.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:16 smithi044 bash[22676]: audit 2024-09-21T00:43:16.408503+0000 mon.a (mon.0) 5657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:43:17.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:16 smithi044 bash[22676]: audit 2024-09-21T00:43:16.419162+0000 mon.a (mon.0) 5658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:17.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:16 smithi044 bash[22676]: audit 2024-09-21T00:43:16.426659+0000 mon.a (mon.0) 5659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:43:17.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:43:17 smithi044 bash[22930]: debug 2024-09-21T00:43:17.189+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:43:17.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:43:17 smithi044 bash[22930]: debug 2024-09-21T00:43:17.193+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:43:17.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:17.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:17.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:17 smithi179 bash[23186]: audit 2024-09-21T00:43:16.429293+0000 mgr.a (mgr.14388) 6435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:43:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:17 smithi179 bash[23186]: cluster 2024-09-21T00:43:16.678678+0000 mgr.a (mgr.14388) 6436 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:17 smithi049 bash[23528]: audit 2024-09-21T00:43:16.429293+0000 mgr.a (mgr.14388) 6435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:43:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:17 smithi049 bash[23528]: cluster 2024-09-21T00:43:16.678678+0000 mgr.a (mgr.14388) 6436 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:17 smithi044 bash[22676]: audit 2024-09-21T00:43:16.429293+0000 mgr.a (mgr.14388) 6435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:43:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:17 smithi044 bash[22676]: cluster 2024-09-21T00:43:16.678678+0000 mgr.a (mgr.14388) 6436 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:18.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:18.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:18.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:18.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:19.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:18 smithi049 bash[23528]: audit 2024-09-21T00:43:17.196257+0000 mgr.a (mgr.14388) 6437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:43:19.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:18 smithi049 bash[23528]: cephadm 2024-09-21T00:43:17.197754+0000 mgr.a (mgr.14388) 6438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:43:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:18 smithi044 bash[22676]: audit 2024-09-21T00:43:17.196257+0000 mgr.a (mgr.14388) 6437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:43:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:18 smithi044 bash[22676]: cephadm 2024-09-21T00:43:17.197754+0000 mgr.a (mgr.14388) 6438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:43:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:18 smithi179 bash[23186]: audit 2024-09-21T00:43:17.196257+0000 mgr.a (mgr.14388) 6437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:43:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:18 smithi179 bash[23186]: cephadm 2024-09-21T00:43:17.197754+0000 mgr.a (mgr.14388) 6438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:43:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:19 smithi049 bash[23528]: audit 2024-09-21T00:43:18.116083+0000 mgr.a (mgr.14388) 6439 : audit [DBG] from='client.147507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:20.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:19 smithi049 bash[23528]: cluster 2024-09-21T00:43:18.679633+0000 mgr.a (mgr.14388) 6440 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:19 smithi044 bash[22676]: audit 2024-09-21T00:43:18.116083+0000 mgr.a (mgr.14388) 6439 : audit [DBG] from='client.147507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:19 smithi044 bash[22676]: cluster 2024-09-21T00:43:18.679633+0000 mgr.a (mgr.14388) 6440 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:19 smithi179 bash[23186]: audit 2024-09-21T00:43:18.116083+0000 mgr.a (mgr.14388) 6439 : audit [DBG] from='client.147507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:19 smithi179 bash[23186]: cluster 2024-09-21T00:43:18.679633+0000 mgr.a (mgr.14388) 6440 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:22.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:21 smithi049 bash[23528]: cluster 2024-09-21T00:43:20.681845+0000 mgr.a (mgr.14388) 6441 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:21 smithi044 bash[22676]: cluster 2024-09-21T00:43:20.681845+0000 mgr.a (mgr.14388) 6441 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:21 smithi179 bash[23186]: cluster 2024-09-21T00:43:20.681845+0000 mgr.a (mgr.14388) 6441 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:23.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:24.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:23 smithi179 bash[23186]: cluster 2024-09-21T00:43:22.682641+0000 mgr.a (mgr.14388) 6442 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:23 smithi049 bash[23528]: cluster 2024-09-21T00:43:22.682641+0000 mgr.a (mgr.14388) 6442 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:23 smithi044 bash[22676]: cluster 2024-09-21T00:43:22.682641+0000 mgr.a (mgr.14388) 6442 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:24.336 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:25 smithi179 bash[23186]: audit 2024-09-21T00:43:23.886397+0000 mgr.a (mgr.14388) 6443 : audit [DBG] from='client.147585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:25 smithi179 bash[23186]: cluster 2024-09-21T00:43:24.683303+0000 mgr.a (mgr.14388) 6444 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:25 smithi179 bash[23186]: audit 2024-09-21T00:43:25.168932+0000 mon.a (mon.0) 5660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:25 smithi179 bash[23186]: audit 2024-09-21T00:43:25.177621+0000 mon.a (mon.0) 5661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:25 smithi179 bash[23186]: audit 2024-09-21T00:43:25.188252+0000 mon.a (mon.0) 5662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:25 smithi049 bash[23528]: audit 2024-09-21T00:43:23.886397+0000 mgr.a (mgr.14388) 6443 : audit [DBG] from='client.147585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:26.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:25 smithi049 bash[23528]: cluster 2024-09-21T00:43:24.683303+0000 mgr.a (mgr.14388) 6444 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:25 smithi049 bash[23528]: audit 2024-09-21T00:43:25.168932+0000 mon.a (mon.0) 5660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:25 smithi049 bash[23528]: audit 2024-09-21T00:43:25.177621+0000 mon.a (mon.0) 5661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:25 smithi049 bash[23528]: audit 2024-09-21T00:43:25.188252+0000 mon.a (mon.0) 5662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:25 smithi044 bash[22676]: audit 2024-09-21T00:43:23.886397+0000 mgr.a (mgr.14388) 6443 : audit [DBG] from='client.147585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:25 smithi044 bash[22676]: cluster 2024-09-21T00:43:24.683303+0000 mgr.a (mgr.14388) 6444 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:25 smithi044 bash[22676]: audit 2024-09-21T00:43:25.168932+0000 mon.a (mon.0) 5660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:25 smithi044 bash[22676]: audit 2024-09-21T00:43:25.177621+0000 mon.a (mon.0) 5661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:25 smithi044 bash[22676]: audit 2024-09-21T00:43:25.188252+0000 mon.a (mon.0) 5662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:27 smithi044 bash[22676]: audit 2024-09-21T00:43:26.584104+0000 mon.a (mon.0) 5663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:27 smithi044 bash[22676]: audit 2024-09-21T00:43:26.593046+0000 mon.a (mon.0) 5664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:27 smithi044 bash[22676]: audit 2024-09-21T00:43:26.603702+0000 mon.a (mon.0) 5665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:27 smithi044 bash[22676]: cluster 2024-09-21T00:43:26.685573+0000 mgr.a (mgr.14388) 6445 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:27 smithi044 bash[22676]: audit 2024-09-21T00:43:26.826229+0000 mon.a (mon.0) 5666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:27 smithi044 bash[22676]: audit 2024-09-21T00:43:26.835809+0000 mon.a (mon.0) 5667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:27 smithi044 bash[22676]: audit 2024-09-21T00:43:26.847303+0000 mon.a (mon.0) 5668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:27 smithi179 bash[23186]: audit 2024-09-21T00:43:26.584104+0000 mon.a (mon.0) 5663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:27 smithi179 bash[23186]: audit 2024-09-21T00:43:26.593046+0000 mon.a (mon.0) 5664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:27 smithi179 bash[23186]: audit 2024-09-21T00:43:26.603702+0000 mon.a (mon.0) 5665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:27 smithi179 bash[23186]: cluster 2024-09-21T00:43:26.685573+0000 mgr.a (mgr.14388) 6445 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:27 smithi179 bash[23186]: audit 2024-09-21T00:43:26.826229+0000 mon.a (mon.0) 5666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:27 smithi179 bash[23186]: audit 2024-09-21T00:43:26.835809+0000 mon.a (mon.0) 5667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:27 smithi179 bash[23186]: audit 2024-09-21T00:43:26.847303+0000 mon.a (mon.0) 5668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:27 smithi049 bash[23528]: audit 2024-09-21T00:43:26.584104+0000 mon.a (mon.0) 5663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:27 smithi049 bash[23528]: audit 2024-09-21T00:43:26.593046+0000 mon.a (mon.0) 5664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:27 smithi049 bash[23528]: audit 2024-09-21T00:43:26.603702+0000 mon.a (mon.0) 5665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:27 smithi049 bash[23528]: cluster 2024-09-21T00:43:26.685573+0000 mgr.a (mgr.14388) 6445 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:27 smithi049 bash[23528]: audit 2024-09-21T00:43:26.826229+0000 mon.a (mon.0) 5666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:27 smithi049 bash[23528]: audit 2024-09-21T00:43:26.835809+0000 mon.a (mon.0) 5667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:27 smithi049 bash[23528]: audit 2024-09-21T00:43:26.847303+0000 mon.a (mon.0) 5668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:29.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:29.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:29.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:29 smithi179 bash[23186]: cluster 2024-09-21T00:43:28.686289+0000 mgr.a (mgr.14388) 6446 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:30.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:29 smithi049 bash[23528]: cluster 2024-09-21T00:43:28.686289+0000 mgr.a (mgr.14388) 6446 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:30.088 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:30.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:30.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:30.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:30.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:29 smithi044 bash[22676]: cluster 2024-09-21T00:43:28.686289+0000 mgr.a (mgr.14388) 6446 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:31.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:30 smithi049 bash[23528]: audit 2024-09-21T00:43:29.662160+0000 mgr.a (mgr.14388) 6447 : audit [DBG] from='client.147663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:30 smithi044 bash[22676]: audit 2024-09-21T00:43:29.662160+0000 mgr.a (mgr.14388) 6447 : audit [DBG] from='client.147663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:30 smithi179 bash[23186]: audit 2024-09-21T00:43:29.662160+0000 mgr.a (mgr.14388) 6447 : audit [DBG] from='client.147663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:31 smithi049 bash[23528]: cluster 2024-09-21T00:43:30.688619+0000 mgr.a (mgr.14388) 6448 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:32.080 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:31 smithi179 bash[23186]: cluster 2024-09-21T00:43:30.688619+0000 mgr.a (mgr.14388) 6448 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:31 smithi044 bash[22676]: cluster 2024-09-21T00:43:30.688619+0000 mgr.a (mgr.14388) 6448 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:43:34.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:33 smithi049 bash[23528]: cluster 2024-09-21T00:43:32.689451+0000 mgr.a (mgr.14388) 6449 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:43:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:33 smithi044 bash[22676]: cluster 2024-09-21T00:43:32.689451+0000 mgr.a (mgr.14388) 6449 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:43:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:33 smithi179 bash[23186]: cluster 2024-09-21T00:43:32.689451+0000 mgr.a (mgr.14388) 6449 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:43:35.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:35.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:35.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:35.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:35.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:35.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:35.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:35.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:35 smithi049 bash[23528]: cluster 2024-09-21T00:43:34.690199+0000 mgr.a (mgr.14388) 6450 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:43:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:35 smithi044 bash[22676]: cluster 2024-09-21T00:43:34.690199+0000 mgr.a (mgr.14388) 6450 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:43:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:35 smithi179 bash[23186]: cluster 2024-09-21T00:43:34.690199+0000 mgr.a (mgr.14388) 6450 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:43:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:36 smithi049 bash[23528]: audit 2024-09-21T00:43:35.430491+0000 mgr.a (mgr.14388) 6451 : audit [DBG] from='client.147738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:36 smithi044 bash[22676]: audit 2024-09-21T00:43:35.430491+0000 mgr.a (mgr.14388) 6451 : audit [DBG] from='client.147738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:36 smithi179 bash[23186]: audit 2024-09-21T00:43:35.430491+0000 mgr.a (mgr.14388) 6451 : audit [DBG] from='client.147738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:38.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:37 smithi049 bash[23528]: cluster 2024-09-21T00:43:36.692995+0000 mgr.a (mgr.14388) 6452 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:37 smithi044 bash[22676]: cluster 2024-09-21T00:43:36.692995+0000 mgr.a (mgr.14388) 6452 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:37 smithi179 bash[23186]: cluster 2024-09-21T00:43:36.692995+0000 mgr.a (mgr.14388) 6452 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:40.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:39 smithi049 bash[23528]: cluster 2024-09-21T00:43:38.693816+0000 mgr.a (mgr.14388) 6453 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:39 smithi044 bash[22676]: cluster 2024-09-21T00:43:38.693816+0000 mgr.a (mgr.14388) 6453 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:39 smithi179 bash[23186]: cluster 2024-09-21T00:43:38.693816+0000 mgr.a (mgr.14388) 6453 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:43:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:41.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:41.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:41.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:41.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:41.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:42.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:41 smithi049 bash[23528]: cluster 2024-09-21T00:43:40.695768+0000 mgr.a (mgr.14388) 6454 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:41 smithi044 bash[22676]: cluster 2024-09-21T00:43:40.695768+0000 mgr.a (mgr.14388) 6454 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:41 smithi179 bash[23186]: cluster 2024-09-21T00:43:40.695768+0000 mgr.a (mgr.14388) 6454 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:43.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:42 smithi049 bash[23528]: audit 2024-09-21T00:43:41.221735+0000 mgr.a (mgr.14388) 6455 : audit [DBG] from='client.147816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:43.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:42 smithi179 bash[23186]: audit 2024-09-21T00:43:41.221735+0000 mgr.a (mgr.14388) 6455 : audit [DBG] from='client.147816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:43.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:42 smithi044 bash[22676]: audit 2024-09-21T00:43:41.221735+0000 mgr.a (mgr.14388) 6455 : audit [DBG] from='client.147816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:44.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:43 smithi049 bash[23528]: cluster 2024-09-21T00:43:42.696834+0000 mgr.a (mgr.14388) 6456 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:43:44.062 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:43 smithi044 bash[22676]: cluster 2024-09-21T00:43:42.696834+0000 mgr.a (mgr.14388) 6456 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:43:44.075 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:43 smithi179 bash[23186]: cluster 2024-09-21T00:43:42.696834+0000 mgr.a (mgr.14388) 6456 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:43:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:45 smithi044 bash[22676]: cluster 2024-09-21T00:43:44.697866+0000 mgr.a (mgr.14388) 6457 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:43:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:45 smithi044 bash[22676]: audit 2024-09-21T00:43:45.369634+0000 mon.a (mon.0) 5669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:45 smithi044 bash[22676]: audit 2024-09-21T00:43:45.381008+0000 mon.a (mon.0) 5670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:45 smithi044 bash[22676]: audit 2024-09-21T00:43:45.393092+0000 mon.a (mon.0) 5671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:45 smithi179 bash[23186]: cluster 2024-09-21T00:43:44.697866+0000 mgr.a (mgr.14388) 6457 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:43:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:45 smithi179 bash[23186]: audit 2024-09-21T00:43:45.369634+0000 mon.a (mon.0) 5669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:45 smithi179 bash[23186]: audit 2024-09-21T00:43:45.381008+0000 mon.a (mon.0) 5670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:45 smithi179 bash[23186]: audit 2024-09-21T00:43:45.393092+0000 mon.a (mon.0) 5671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:45 smithi049 bash[23528]: cluster 2024-09-21T00:43:44.697866+0000 mgr.a (mgr.14388) 6457 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:43:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:45 smithi049 bash[23528]: audit 2024-09-21T00:43:45.369634+0000 mon.a (mon.0) 5669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:45 smithi049 bash[23528]: audit 2024-09-21T00:43:45.381008+0000 mon.a (mon.0) 5670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:46.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:45 smithi049 bash[23528]: audit 2024-09-21T00:43:45.393092+0000 mon.a (mon.0) 5671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:47.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:47.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:47.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:47.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:47.470 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:47 smithi049 bash[23528]: cluster 2024-09-21T00:43:46.699627+0000 mgr.a (mgr.14388) 6458 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:43:48.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:47 smithi049 bash[23528]: audit 2024-09-21T00:43:46.798134+0000 mon.a (mon.0) 5672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:47 smithi049 bash[23528]: audit 2024-09-21T00:43:46.808187+0000 mon.a (mon.0) 5673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:47 smithi049 bash[23528]: audit 2024-09-21T00:43:46.813316+0000 mon.a (mon.0) 5674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:47 smithi049 bash[23528]: audit 2024-09-21T00:43:47.064885+0000 mon.a (mon.0) 5675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:47 smithi049 bash[23528]: audit 2024-09-21T00:43:47.071900+0000 mon.a (mon.0) 5676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:47 smithi049 bash[23528]: audit 2024-09-21T00:43:47.082427+0000 mon.a (mon.0) 5677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:47 smithi044 bash[22676]: cluster 2024-09-21T00:43:46.699627+0000 mgr.a (mgr.14388) 6458 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:43:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:47 smithi044 bash[22676]: audit 2024-09-21T00:43:46.798134+0000 mon.a (mon.0) 5672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:47 smithi044 bash[22676]: audit 2024-09-21T00:43:46.808187+0000 mon.a (mon.0) 5673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:47 smithi044 bash[22676]: audit 2024-09-21T00:43:46.813316+0000 mon.a (mon.0) 5674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:47 smithi044 bash[22676]: audit 2024-09-21T00:43:47.064885+0000 mon.a (mon.0) 5675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:47 smithi044 bash[22676]: audit 2024-09-21T00:43:47.071900+0000 mon.a (mon.0) 5676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:47 smithi044 bash[22676]: audit 2024-09-21T00:43:47.082427+0000 mon.a (mon.0) 5677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:47 smithi179 bash[23186]: cluster 2024-09-21T00:43:46.699627+0000 mgr.a (mgr.14388) 6458 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:47 smithi179 bash[23186]: audit 2024-09-21T00:43:46.798134+0000 mon.a (mon.0) 5672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:47 smithi179 bash[23186]: audit 2024-09-21T00:43:46.808187+0000 mon.a (mon.0) 5673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:47 smithi179 bash[23186]: audit 2024-09-21T00:43:46.813316+0000 mon.a (mon.0) 5674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:47 smithi179 bash[23186]: audit 2024-09-21T00:43:47.064885+0000 mon.a (mon.0) 5675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:47 smithi179 bash[23186]: audit 2024-09-21T00:43:47.071900+0000 mon.a (mon.0) 5676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:47 smithi179 bash[23186]: audit 2024-09-21T00:43:47.082427+0000 mon.a (mon.0) 5677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:43:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:48 smithi044 bash[22676]: audit 2024-09-21T00:43:47.019861+0000 mgr.a (mgr.14388) 6459 : audit [DBG] from='client.147894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:48 smithi179 bash[23186]: audit 2024-09-21T00:43:47.019861+0000 mgr.a (mgr.14388) 6459 : audit [DBG] from='client.147894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:49.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:48 smithi049 bash[23528]: audit 2024-09-21T00:43:47.019861+0000 mgr.a (mgr.14388) 6459 : audit [DBG] from='client.147894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:50.063 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:49 smithi049 bash[23528]: cluster 2024-09-21T00:43:48.700500+0000 mgr.a (mgr.14388) 6460 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:49 smithi044 bash[22676]: cluster 2024-09-21T00:43:48.700500+0000 mgr.a (mgr.14388) 6460 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:49 smithi179 bash[23186]: cluster 2024-09-21T00:43:48.700500+0000 mgr.a (mgr.14388) 6460 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:51 smithi049 bash[23528]: cluster 2024-09-21T00:43:50.702760+0000 mgr.a (mgr.14388) 6461 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:51 smithi044 bash[22676]: cluster 2024-09-21T00:43:50.702760+0000 mgr.a (mgr.14388) 6461 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:51 smithi179 bash[23186]: cluster 2024-09-21T00:43:50.702760+0000 mgr.a (mgr.14388) 6461 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:52.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:52.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:52.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:53.214 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:53.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:53.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:53.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:53.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:43:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:53 smithi044 bash[22676]: cluster 2024-09-21T00:43:52.703523+0000 mgr.a (mgr.14388) 6462 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:53 smithi044 bash[22676]: audit 2024-09-21T00:43:52.796379+0000 mgr.a (mgr.14388) 6463 : audit [DBG] from='client.147972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:53 smithi179 bash[23186]: cluster 2024-09-21T00:43:52.703523+0000 mgr.a (mgr.14388) 6462 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:53 smithi179 bash[23186]: audit 2024-09-21T00:43:52.796379+0000 mgr.a (mgr.14388) 6463 : audit [DBG] from='client.147972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:53.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:53 smithi049 bash[23528]: cluster 2024-09-21T00:43:52.703523+0000 mgr.a (mgr.14388) 6462 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:53.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:53 smithi049 bash[23528]: audit 2024-09-21T00:43:52.796379+0000 mgr.a (mgr.14388) 6463 : audit [DBG] from='client.147972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:43:56.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:55 smithi049 bash[23528]: cluster 2024-09-21T00:43:54.704417+0000 mgr.a (mgr.14388) 6464 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:55 smithi044 bash[22676]: cluster 2024-09-21T00:43:54.704417+0000 mgr.a (mgr.14388) 6464 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:55 smithi179 bash[23186]: cluster 2024-09-21T00:43:54.704417+0000 mgr.a (mgr.14388) 6464 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:43:58.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:57 smithi049 bash[23528]: cluster 2024-09-21T00:43:56.706687+0000 mgr.a (mgr.14388) 6465 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:58.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:43:58.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:43:58.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:43:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:57 smithi044 bash[22676]: cluster 2024-09-21T00:43:56.706687+0000 mgr.a (mgr.14388) 6465 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:57 smithi179 bash[23186]: cluster 2024-09-21T00:43:56.706687+0000 mgr.a (mgr.14388) 6465 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:43:58.973 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:43:58.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:43:58.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:43:58.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:43:58.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:59 smithi049 bash[23528]: audit 2024-09-21T00:43:58.553661+0000 mgr.a (mgr.14388) 6466 : audit [DBG] from='client.148050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:00.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:43:59 smithi049 bash[23528]: cluster 2024-09-21T00:43:58.707354+0000 mgr.a (mgr.14388) 6467 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:59 smithi044 bash[22676]: audit 2024-09-21T00:43:58.553661+0000 mgr.a (mgr.14388) 6466 : audit [DBG] from='client.148050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:43:59 smithi044 bash[22676]: cluster 2024-09-21T00:43:58.707354+0000 mgr.a (mgr.14388) 6467 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:59 smithi179 bash[23186]: audit 2024-09-21T00:43:58.553661+0000 mgr.a (mgr.14388) 6466 : audit [DBG] from='client.148050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:43:59 smithi179 bash[23186]: cluster 2024-09-21T00:43:58.707354+0000 mgr.a (mgr.14388) 6467 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:02.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:01 smithi049 bash[23528]: cluster 2024-09-21T00:44:00.709655+0000 mgr.a (mgr.14388) 6468 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:01 smithi044 bash[22676]: cluster 2024-09-21T00:44:00.709655+0000 mgr.a (mgr.14388) 6468 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:01 smithi179 bash[23186]: cluster 2024-09-21T00:44:00.709655+0000 mgr.a (mgr.14388) 6468 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:03.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:03.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:03.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:04.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:03 smithi179 bash[23186]: cluster 2024-09-21T00:44:02.710410+0000 mgr.a (mgr.14388) 6469 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:04.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:03 smithi049 bash[23528]: cluster 2024-09-21T00:44:02.710410+0000 mgr.a (mgr.14388) 6469 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:03 smithi044 bash[22676]: cluster 2024-09-21T00:44:02.710410+0000 mgr.a (mgr.14388) 6469 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:04.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:04.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:04.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:04.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:04.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:05.861 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:05 smithi179 bash[23186]: audit 2024-09-21T00:44:04.329987+0000 mgr.a (mgr.14388) 6470 : audit [DBG] from='client.148128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:05.891 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:05 smithi179 bash[23186]: cluster 2024-09-21T00:44:04.710962+0000 mgr.a (mgr.14388) 6471 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:05.891 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:05 smithi179 bash[23186]: audit 2024-09-21T00:44:05.587773+0000 mon.a (mon.0) 5678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:05.891 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:05 smithi179 bash[23186]: audit 2024-09-21T00:44:05.596745+0000 mon.a (mon.0) 5679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:05.891 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:05 smithi179 bash[23186]: audit 2024-09-21T00:44:05.607481+0000 mon.a (mon.0) 5680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:06.040 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:05 smithi044 bash[22676]: audit 2024-09-21T00:44:04.329987+0000 mgr.a (mgr.14388) 6470 : audit [DBG] from='client.148128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:06.040 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:05 smithi044 bash[22676]: cluster 2024-09-21T00:44:04.710962+0000 mgr.a (mgr.14388) 6471 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:06.040 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:05 smithi044 bash[22676]: audit 2024-09-21T00:44:05.587773+0000 mon.a (mon.0) 5678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:06.040 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:05 smithi044 bash[22676]: audit 2024-09-21T00:44:05.596745+0000 mon.a (mon.0) 5679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:06.040 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:05 smithi044 bash[22676]: audit 2024-09-21T00:44:05.607481+0000 mon.a (mon.0) 5680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:06.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:05 smithi049 bash[23528]: audit 2024-09-21T00:44:04.329987+0000 mgr.a (mgr.14388) 6470 : audit [DBG] from='client.148128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:05 smithi049 bash[23528]: cluster 2024-09-21T00:44:04.710962+0000 mgr.a (mgr.14388) 6471 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:05 smithi049 bash[23528]: audit 2024-09-21T00:44:05.587773+0000 mon.a (mon.0) 5678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:05 smithi049 bash[23528]: audit 2024-09-21T00:44:05.596745+0000 mon.a (mon.0) 5679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:05 smithi049 bash[23528]: audit 2024-09-21T00:44:05.607481+0000 mon.a (mon.0) 5680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:07 smithi049 bash[23528]: cluster 2024-09-21T00:44:06.712162+0000 mgr.a (mgr.14388) 6472 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:08.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:07 smithi049 bash[23528]: audit 2024-09-21T00:44:07.022606+0000 mon.a (mon.0) 5681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:07 smithi049 bash[23528]: audit 2024-09-21T00:44:07.031372+0000 mon.a (mon.0) 5682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:07 smithi049 bash[23528]: audit 2024-09-21T00:44:07.041291+0000 mon.a (mon.0) 5683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:07 smithi049 bash[23528]: audit 2024-09-21T00:44:07.282250+0000 mon.a (mon.0) 5684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:07 smithi049 bash[23528]: audit 2024-09-21T00:44:07.290229+0000 mon.a (mon.0) 5685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:07 smithi049 bash[23528]: audit 2024-09-21T00:44:07.299875+0000 mon.a (mon.0) 5686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:07 smithi044 bash[22676]: cluster 2024-09-21T00:44:06.712162+0000 mgr.a (mgr.14388) 6472 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:07 smithi044 bash[22676]: audit 2024-09-21T00:44:07.022606+0000 mon.a (mon.0) 5681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:07 smithi044 bash[22676]: audit 2024-09-21T00:44:07.031372+0000 mon.a (mon.0) 5682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:07 smithi044 bash[22676]: audit 2024-09-21T00:44:07.041291+0000 mon.a (mon.0) 5683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:07 smithi044 bash[22676]: audit 2024-09-21T00:44:07.282250+0000 mon.a (mon.0) 5684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:07 smithi044 bash[22676]: audit 2024-09-21T00:44:07.290229+0000 mon.a (mon.0) 5685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:07 smithi044 bash[22676]: audit 2024-09-21T00:44:07.299875+0000 mon.a (mon.0) 5686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:07 smithi179 bash[23186]: cluster 2024-09-21T00:44:06.712162+0000 mgr.a (mgr.14388) 6472 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:07 smithi179 bash[23186]: audit 2024-09-21T00:44:07.022606+0000 mon.a (mon.0) 5681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:07 smithi179 bash[23186]: audit 2024-09-21T00:44:07.031372+0000 mon.a (mon.0) 5682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:07 smithi179 bash[23186]: audit 2024-09-21T00:44:07.041291+0000 mon.a (mon.0) 5683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:07 smithi179 bash[23186]: audit 2024-09-21T00:44:07.282250+0000 mon.a (mon.0) 5684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:07 smithi179 bash[23186]: audit 2024-09-21T00:44:07.290229+0000 mon.a (mon.0) 5685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:07 smithi179 bash[23186]: audit 2024-09-21T00:44:07.299875+0000 mon.a (mon.0) 5686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:09.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:09.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:09.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:09 smithi049 bash[23528]: cluster 2024-09-21T00:44:08.712900+0000 mgr.a (mgr.14388) 6473 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:09 smithi044 bash[22676]: cluster 2024-09-21T00:44:08.712900+0000 mgr.a (mgr.14388) 6473 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:09 smithi179 bash[23186]: cluster 2024-09-21T00:44:08.712900+0000 mgr.a (mgr.14388) 6473 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:10.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:10.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:11 smithi049 bash[23528]: audit 2024-09-21T00:44:10.083222+0000 mgr.a (mgr.14388) 6474 : audit [DBG] from='client.148206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:11 smithi049 bash[23528]: cluster 2024-09-21T00:44:10.715582+0000 mgr.a (mgr.14388) 6475 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:11 smithi044 bash[22676]: audit 2024-09-21T00:44:10.083222+0000 mgr.a (mgr.14388) 6474 : audit [DBG] from='client.148206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:11 smithi044 bash[22676]: cluster 2024-09-21T00:44:10.715582+0000 mgr.a (mgr.14388) 6475 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:11 smithi179 bash[23186]: audit 2024-09-21T00:44:10.083222+0000 mgr.a (mgr.14388) 6474 : audit [DBG] from='client.148206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:11 smithi179 bash[23186]: cluster 2024-09-21T00:44:10.715582+0000 mgr.a (mgr.14388) 6475 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:13 smithi044 bash[22676]: cluster 2024-09-21T00:44:12.716343+0000 mgr.a (mgr.14388) 6476 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:13 smithi179 bash[23186]: cluster 2024-09-21T00:44:12.716343+0000 mgr.a (mgr.14388) 6476 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:14.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:13 smithi049 bash[23528]: cluster 2024-09-21T00:44:12.716343+0000 mgr.a (mgr.14388) 6476 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:15.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:15.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:15.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:15 smithi044 bash[22676]: cluster 2024-09-21T00:44:14.717117+0000 mgr.a (mgr.14388) 6477 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:15 smithi179 bash[23186]: cluster 2024-09-21T00:44:14.717117+0000 mgr.a (mgr.14388) 6477 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:16.285 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:16.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:15 smithi049 bash[23528]: cluster 2024-09-21T00:44:14.717117+0000 mgr.a (mgr.14388) 6477 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:16 smithi044 bash[22676]: audit 2024-09-21T00:44:15.855317+0000 mgr.a (mgr.14388) 6478 : audit [DBG] from='client.148284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:16 smithi179 bash[23186]: audit 2024-09-21T00:44:15.855317+0000 mgr.a (mgr.14388) 6478 : audit [DBG] from='client.148284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:17.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:16 smithi049 bash[23528]: audit 2024-09-21T00:44:15.855317+0000 mgr.a (mgr.14388) 6478 : audit [DBG] from='client.148284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:18.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:44:18 smithi044 bash[22930]: debug 2024-09-21T00:44:18.056+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:44:18.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:44:18 smithi044 bash[22930]: debug 2024-09-21T00:44:18.060+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:44:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:17 smithi044 bash[22676]: cluster 2024-09-21T00:44:16.719819+0000 mgr.a (mgr.14388) 6479 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:17 smithi044 bash[22676]: audit 2024-09-21T00:44:17.263173+0000 mon.a (mon.0) 5687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:44:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:17 smithi044 bash[22676]: audit 2024-09-21T00:44:17.270617+0000 mon.a (mon.0) 5688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:44:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:17 smithi044 bash[22676]: audit 2024-09-21T00:44:17.272467+0000 mon.a (mon.0) 5689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:44:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:17 smithi044 bash[22676]: audit 2024-09-21T00:44:17.283647+0000 mon.a (mon.0) 5690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:17 smithi044 bash[22676]: audit 2024-09-21T00:44:17.290188+0000 mon.a (mon.0) 5691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:44:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:17 smithi179 bash[23186]: cluster 2024-09-21T00:44:16.719819+0000 mgr.a (mgr.14388) 6479 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:17 smithi179 bash[23186]: audit 2024-09-21T00:44:17.263173+0000 mon.a (mon.0) 5687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:44:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:17 smithi179 bash[23186]: audit 2024-09-21T00:44:17.270617+0000 mon.a (mon.0) 5688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:44:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:17 smithi179 bash[23186]: audit 2024-09-21T00:44:17.272467+0000 mon.a (mon.0) 5689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:44:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:17 smithi179 bash[23186]: audit 2024-09-21T00:44:17.283647+0000 mon.a (mon.0) 5690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:17 smithi179 bash[23186]: audit 2024-09-21T00:44:17.290188+0000 mon.a (mon.0) 5691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:44:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:17 smithi049 bash[23528]: cluster 2024-09-21T00:44:16.719819+0000 mgr.a (mgr.14388) 6479 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:17 smithi049 bash[23528]: audit 2024-09-21T00:44:17.263173+0000 mon.a (mon.0) 5687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:44:18.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:17 smithi049 bash[23528]: audit 2024-09-21T00:44:17.270617+0000 mon.a (mon.0) 5688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:44:18.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:17 smithi049 bash[23528]: audit 2024-09-21T00:44:17.272467+0000 mon.a (mon.0) 5689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:44:18.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:17 smithi049 bash[23528]: audit 2024-09-21T00:44:17.283647+0000 mon.a (mon.0) 5690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:18.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:17 smithi049 bash[23528]: audit 2024-09-21T00:44:17.290188+0000 mon.a (mon.0) 5691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:44:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:18 smithi044 bash[22676]: audit 2024-09-21T00:44:17.292777+0000 mgr.a (mgr.14388) 6480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:44:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:18 smithi179 bash[23186]: audit 2024-09-21T00:44:17.292777+0000 mgr.a (mgr.14388) 6480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:44:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:18 smithi049 bash[23528]: audit 2024-09-21T00:44:17.292777+0000 mgr.a (mgr.14388) 6480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:44:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:19 smithi044 bash[22676]: audit 2024-09-21T00:44:18.061004+0000 mgr.a (mgr.14388) 6481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:44:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:19 smithi044 bash[22676]: cephadm 2024-09-21T00:44:18.062736+0000 mgr.a (mgr.14388) 6482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:44:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:19 smithi044 bash[22676]: cluster 2024-09-21T00:44:18.720728+0000 mgr.a (mgr.14388) 6483 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:44:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:19 smithi179 bash[23186]: audit 2024-09-21T00:44:18.061004+0000 mgr.a (mgr.14388) 6481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:44:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:19 smithi179 bash[23186]: cephadm 2024-09-21T00:44:18.062736+0000 mgr.a (mgr.14388) 6482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:44:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:19 smithi179 bash[23186]: cluster 2024-09-21T00:44:18.720728+0000 mgr.a (mgr.14388) 6483 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:44:20.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:19 smithi049 bash[23528]: audit 2024-09-21T00:44:18.061004+0000 mgr.a (mgr.14388) 6481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:44:20.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:19 smithi049 bash[23528]: cephadm 2024-09-21T00:44:18.062736+0000 mgr.a (mgr.14388) 6482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:44:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:19 smithi049 bash[23528]: cluster 2024-09-21T00:44:18.720728+0000 mgr.a (mgr.14388) 6483 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:44:21.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:21.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:21.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:22.064 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:22.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:21 smithi044 bash[22676]: cluster 2024-09-21T00:44:20.722894+0000 mgr.a (mgr.14388) 6484 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:21 smithi179 bash[23186]: cluster 2024-09-21T00:44:20.722894+0000 mgr.a (mgr.14388) 6484 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:22.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:21 smithi049 bash[23528]: cluster 2024-09-21T00:44:20.722894+0000 mgr.a (mgr.14388) 6484 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:23.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:22 smithi179 bash[23186]: audit 2024-09-21T00:44:21.621469+0000 mgr.a (mgr.14388) 6485 : audit [DBG] from='client.148464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:22 smithi044 bash[22676]: audit 2024-09-21T00:44:21.621469+0000 mgr.a (mgr.14388) 6485 : audit [DBG] from='client.148464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:22 smithi049 bash[23528]: audit 2024-09-21T00:44:21.621469+0000 mgr.a (mgr.14388) 6485 : audit [DBG] from='client.148464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:24.107 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:23 smithi179 bash[23186]: cluster 2024-09-21T00:44:22.723790+0000 mgr.a (mgr.14388) 6486 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:23 smithi044 bash[22676]: cluster 2024-09-21T00:44:22.723790+0000 mgr.a (mgr.14388) 6486 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:24.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:23 smithi049 bash[23528]: cluster 2024-09-21T00:44:22.723790+0000 mgr.a (mgr.14388) 6486 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:25 smithi044 bash[22676]: cluster 2024-09-21T00:44:24.724586+0000 mgr.a (mgr.14388) 6487 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:25 smithi044 bash[22676]: audit 2024-09-21T00:44:25.814348+0000 mon.a (mon.0) 5692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:25 smithi044 bash[22676]: audit 2024-09-21T00:44:25.822971+0000 mon.a (mon.0) 5693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:25 smithi044 bash[22676]: audit 2024-09-21T00:44:25.834794+0000 mon.a (mon.0) 5694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:25 smithi179 bash[23186]: cluster 2024-09-21T00:44:24.724586+0000 mgr.a (mgr.14388) 6487 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:25 smithi179 bash[23186]: audit 2024-09-21T00:44:25.814348+0000 mon.a (mon.0) 5692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:25 smithi179 bash[23186]: audit 2024-09-21T00:44:25.822971+0000 mon.a (mon.0) 5693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:25 smithi179 bash[23186]: audit 2024-09-21T00:44:25.834794+0000 mon.a (mon.0) 5694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:26.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:25 smithi049 bash[23528]: cluster 2024-09-21T00:44:24.724586+0000 mgr.a (mgr.14388) 6487 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:26.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:25 smithi049 bash[23528]: audit 2024-09-21T00:44:25.814348+0000 mon.a (mon.0) 5692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:26.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:25 smithi049 bash[23528]: audit 2024-09-21T00:44:25.822971+0000 mon.a (mon.0) 5693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:25 smithi049 bash[23528]: audit 2024-09-21T00:44:25.834794+0000 mon.a (mon.0) 5694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:27.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:27.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:27.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:27.820 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:27.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:27.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:27.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:27.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:27 smithi044 bash[22676]: cluster 2024-09-21T00:44:26.726811+0000 mgr.a (mgr.14388) 6488 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:27 smithi044 bash[22676]: audit 2024-09-21T00:44:27.248446+0000 mon.a (mon.0) 5695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:27 smithi044 bash[22676]: audit 2024-09-21T00:44:27.254188+0000 mon.a (mon.0) 5696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:27 smithi044 bash[22676]: audit 2024-09-21T00:44:27.259137+0000 mon.a (mon.0) 5697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:27 smithi044 bash[22676]: audit 2024-09-21T00:44:27.426611+0000 mon.a (mon.0) 5698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:27 smithi044 bash[22676]: audit 2024-09-21T00:44:27.431564+0000 mon.a (mon.0) 5699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:27 smithi044 bash[22676]: audit 2024-09-21T00:44:27.437333+0000 mon.a (mon.0) 5700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:27 smithi179 bash[23186]: cluster 2024-09-21T00:44:26.726811+0000 mgr.a (mgr.14388) 6488 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:27 smithi179 bash[23186]: audit 2024-09-21T00:44:27.248446+0000 mon.a (mon.0) 5695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:27 smithi179 bash[23186]: audit 2024-09-21T00:44:27.254188+0000 mon.a (mon.0) 5696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:27 smithi179 bash[23186]: audit 2024-09-21T00:44:27.259137+0000 mon.a (mon.0) 5697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:27 smithi179 bash[23186]: audit 2024-09-21T00:44:27.426611+0000 mon.a (mon.0) 5698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:27 smithi179 bash[23186]: audit 2024-09-21T00:44:27.431564+0000 mon.a (mon.0) 5699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:27 smithi179 bash[23186]: audit 2024-09-21T00:44:27.437333+0000 mon.a (mon.0) 5700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:27 smithi049 bash[23528]: cluster 2024-09-21T00:44:26.726811+0000 mgr.a (mgr.14388) 6488 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:27 smithi049 bash[23528]: audit 2024-09-21T00:44:27.248446+0000 mon.a (mon.0) 5695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:27 smithi049 bash[23528]: audit 2024-09-21T00:44:27.254188+0000 mon.a (mon.0) 5696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:27 smithi049 bash[23528]: audit 2024-09-21T00:44:27.259137+0000 mon.a (mon.0) 5697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:27 smithi049 bash[23528]: audit 2024-09-21T00:44:27.426611+0000 mon.a (mon.0) 5698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:27 smithi049 bash[23528]: audit 2024-09-21T00:44:27.431564+0000 mon.a (mon.0) 5699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:27 smithi049 bash[23528]: audit 2024-09-21T00:44:27.437333+0000 mon.a (mon.0) 5700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:29.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:28 smithi049 bash[23528]: audit 2024-09-21T00:44:27.396293+0000 mgr.a (mgr.14388) 6489 : audit [DBG] from='client.148542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:28 smithi044 bash[22676]: audit 2024-09-21T00:44:27.396293+0000 mgr.a (mgr.14388) 6489 : audit [DBG] from='client.148542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:28 smithi179 bash[23186]: audit 2024-09-21T00:44:27.396293+0000 mgr.a (mgr.14388) 6489 : audit [DBG] from='client.148542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:30.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:29 smithi049 bash[23528]: cluster 2024-09-21T00:44:28.727671+0000 mgr.a (mgr.14388) 6490 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:29 smithi044 bash[22676]: cluster 2024-09-21T00:44:28.727671+0000 mgr.a (mgr.14388) 6490 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:29 smithi179 bash[23186]: cluster 2024-09-21T00:44:28.727671+0000 mgr.a (mgr.14388) 6490 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:30 smithi044 bash[22676]: cluster 2024-09-21T00:44:30.729884+0000 mgr.a (mgr.14388) 6491 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:30 smithi179 bash[23186]: cluster 2024-09-21T00:44:30.729884+0000 mgr.a (mgr.14388) 6491 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:31.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:30 smithi049 bash[23528]: cluster 2024-09-21T00:44:30.729884+0000 mgr.a (mgr.14388) 6491 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:44:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:32.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:32.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:33.570 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:33.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:33.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:33.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:33.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:33 smithi044 bash[22676]: cluster 2024-09-21T00:44:32.730669+0000 mgr.a (mgr.14388) 6492 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:34.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:33 smithi049 bash[23528]: cluster 2024-09-21T00:44:32.730669+0000 mgr.a (mgr.14388) 6492 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:33 smithi179 bash[23186]: cluster 2024-09-21T00:44:32.730669+0000 mgr.a (mgr.14388) 6492 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:35.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:34 smithi049 bash[23528]: audit 2024-09-21T00:44:33.154875+0000 mgr.a (mgr.14388) 6493 : audit [DBG] from='client.148617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:34 smithi044 bash[22676]: audit 2024-09-21T00:44:33.154875+0000 mgr.a (mgr.14388) 6493 : audit [DBG] from='client.148617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:34 smithi179 bash[23186]: audit 2024-09-21T00:44:33.154875+0000 mgr.a (mgr.14388) 6493 : audit [DBG] from='client.148617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:35 smithi049 bash[23528]: cluster 2024-09-21T00:44:34.731822+0000 mgr.a (mgr.14388) 6494 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:35 smithi044 bash[22676]: cluster 2024-09-21T00:44:34.731822+0000 mgr.a (mgr.14388) 6494 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:35 smithi179 bash[23186]: cluster 2024-09-21T00:44:34.731822+0000 mgr.a (mgr.14388) 6494 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:37 smithi044 bash[22676]: cluster 2024-09-21T00:44:36.734163+0000 mgr.a (mgr.14388) 6495 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:37 smithi179 bash[23186]: cluster 2024-09-21T00:44:36.734163+0000 mgr.a (mgr.14388) 6495 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:38.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:37 smithi049 bash[23528]: cluster 2024-09-21T00:44:36.734163+0000 mgr.a (mgr.14388) 6495 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:38.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:39.360 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:39.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:39.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:39 smithi044 bash[22676]: cluster 2024-09-21T00:44:38.734892+0000 mgr.a (mgr.14388) 6496 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:39 smithi179 bash[23186]: cluster 2024-09-21T00:44:38.734892+0000 mgr.a (mgr.14388) 6496 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:40.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:39 smithi049 bash[23528]: cluster 2024-09-21T00:44:38.734892+0000 mgr.a (mgr.14388) 6496 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:41.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:40 smithi049 bash[23528]: audit 2024-09-21T00:44:38.904386+0000 mgr.a (mgr.14388) 6497 : audit [DBG] from='client.148695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:40 smithi044 bash[22676]: audit 2024-09-21T00:44:38.904386+0000 mgr.a (mgr.14388) 6497 : audit [DBG] from='client.148695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:40 smithi179 bash[23186]: audit 2024-09-21T00:44:38.904386+0000 mgr.a (mgr.14388) 6497 : audit [DBG] from='client.148695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:41 smithi044 bash[22676]: cluster 2024-09-21T00:44:40.737236+0000 mgr.a (mgr.14388) 6498 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:41 smithi179 bash[23186]: cluster 2024-09-21T00:44:40.737236+0000 mgr.a (mgr.14388) 6498 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:42.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:41 smithi049 bash[23528]: cluster 2024-09-21T00:44:40.737236+0000 mgr.a (mgr.14388) 6498 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:44:44.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:43 smithi179 bash[23186]: cluster 2024-09-21T00:44:42.738002+0000 mgr.a (mgr.14388) 6499 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:43 smithi044 bash[22676]: cluster 2024-09-21T00:44:42.738002+0000 mgr.a (mgr.14388) 6499 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:44.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:43 smithi049 bash[23528]: cluster 2024-09-21T00:44:42.738002+0000 mgr.a (mgr.14388) 6499 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:44.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:44.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:44.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:45.115 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:45.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:45 smithi044 bash[22676]: audit 2024-09-21T00:44:44.680485+0000 mgr.a (mgr.14388) 6500 : audit [DBG] from='client.148770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:45 smithi044 bash[22676]: cluster 2024-09-21T00:44:44.738819+0000 mgr.a (mgr.14388) 6501 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:45 smithi179 bash[23186]: audit 2024-09-21T00:44:44.680485+0000 mgr.a (mgr.14388) 6500 : audit [DBG] from='client.148770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:45 smithi179 bash[23186]: cluster 2024-09-21T00:44:44.738819+0000 mgr.a (mgr.14388) 6501 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:45 smithi049 bash[23528]: audit 2024-09-21T00:44:44.680485+0000 mgr.a (mgr.14388) 6500 : audit [DBG] from='client.148770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:45 smithi049 bash[23528]: cluster 2024-09-21T00:44:44.738819+0000 mgr.a (mgr.14388) 6501 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:46 smithi179 bash[23186]: audit 2024-09-21T00:44:45.999552+0000 mon.a (mon.0) 5701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:46 smithi179 bash[23186]: audit 2024-09-21T00:44:46.009226+0000 mon.a (mon.0) 5702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:46 smithi179 bash[23186]: audit 2024-09-21T00:44:46.019850+0000 mon.a (mon.0) 5703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:46 smithi179 bash[23186]: cluster 2024-09-21T00:44:46.741242+0000 mgr.a (mgr.14388) 6502 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:44:47.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:47 smithi049 bash[23528]: audit 2024-09-21T00:44:45.999552+0000 mon.a (mon.0) 5701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:47 smithi049 bash[23528]: audit 2024-09-21T00:44:46.009226+0000 mon.a (mon.0) 5702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:47 smithi049 bash[23528]: audit 2024-09-21T00:44:46.019850+0000 mon.a (mon.0) 5703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:47 smithi049 bash[23528]: cluster 2024-09-21T00:44:46.741242+0000 mgr.a (mgr.14388) 6502 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:46 smithi044 bash[22676]: audit 2024-09-21T00:44:45.999552+0000 mon.a (mon.0) 5701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:46 smithi044 bash[22676]: audit 2024-09-21T00:44:46.009226+0000 mon.a (mon.0) 5702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:46 smithi044 bash[22676]: audit 2024-09-21T00:44:46.019850+0000 mon.a (mon.0) 5703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:46 smithi044 bash[22676]: cluster 2024-09-21T00:44:46.741242+0000 mgr.a (mgr.14388) 6502 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:44:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:48 smithi044 bash[22676]: audit 2024-09-21T00:44:47.461166+0000 mon.a (mon.0) 5704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:48 smithi044 bash[22676]: audit 2024-09-21T00:44:47.466703+0000 mon.a (mon.0) 5705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:48 smithi044 bash[22676]: audit 2024-09-21T00:44:47.472269+0000 mon.a (mon.0) 5706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:48 smithi044 bash[22676]: audit 2024-09-21T00:44:47.585506+0000 mon.a (mon.0) 5707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:48 smithi044 bash[22676]: audit 2024-09-21T00:44:47.590681+0000 mon.a (mon.0) 5708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:48 smithi044 bash[22676]: audit 2024-09-21T00:44:47.595722+0000 mon.a (mon.0) 5709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:48 smithi179 bash[23186]: audit 2024-09-21T00:44:47.461166+0000 mon.a (mon.0) 5704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:48 smithi179 bash[23186]: audit 2024-09-21T00:44:47.466703+0000 mon.a (mon.0) 5705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:48 smithi179 bash[23186]: audit 2024-09-21T00:44:47.472269+0000 mon.a (mon.0) 5706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:48 smithi179 bash[23186]: audit 2024-09-21T00:44:47.585506+0000 mon.a (mon.0) 5707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:48 smithi179 bash[23186]: audit 2024-09-21T00:44:47.590681+0000 mon.a (mon.0) 5708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:48 smithi179 bash[23186]: audit 2024-09-21T00:44:47.595722+0000 mon.a (mon.0) 5709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:48 smithi049 bash[23528]: audit 2024-09-21T00:44:47.461166+0000 mon.a (mon.0) 5704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:48 smithi049 bash[23528]: audit 2024-09-21T00:44:47.466703+0000 mon.a (mon.0) 5705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:48 smithi049 bash[23528]: audit 2024-09-21T00:44:47.472269+0000 mon.a (mon.0) 5706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:48 smithi049 bash[23528]: audit 2024-09-21T00:44:47.585506+0000 mon.a (mon.0) 5707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:48 smithi049 bash[23528]: audit 2024-09-21T00:44:47.590681+0000 mon.a (mon.0) 5708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:48 smithi049 bash[23528]: audit 2024-09-21T00:44:47.595722+0000 mon.a (mon.0) 5709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:44:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:49 smithi044 bash[22676]: cluster 2024-09-21T00:44:48.742017+0000 mgr.a (mgr.14388) 6503 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:44:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:49 smithi179 bash[23186]: cluster 2024-09-21T00:44:48.742017+0000 mgr.a (mgr.14388) 6503 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:44:49.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:49 smithi049 bash[23528]: cluster 2024-09-21T00:44:48.742017+0000 mgr.a (mgr.14388) 6503 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:44:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:50.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:51 smithi044 bash[22676]: audit 2024-09-21T00:44:50.449233+0000 mgr.a (mgr.14388) 6504 : audit [DBG] from='client.148848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:51 smithi044 bash[22676]: cluster 2024-09-21T00:44:50.743932+0000 mgr.a (mgr.14388) 6505 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:51 smithi179 bash[23186]: audit 2024-09-21T00:44:50.449233+0000 mgr.a (mgr.14388) 6504 : audit [DBG] from='client.148848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:51 smithi179 bash[23186]: cluster 2024-09-21T00:44:50.743932+0000 mgr.a (mgr.14388) 6505 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:52.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:51 smithi049 bash[23528]: audit 2024-09-21T00:44:50.449233+0000 mgr.a (mgr.14388) 6504 : audit [DBG] from='client.148848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:52.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:51 smithi049 bash[23528]: cluster 2024-09-21T00:44:50.743932+0000 mgr.a (mgr.14388) 6505 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:53 smithi044 bash[22676]: cluster 2024-09-21T00:44:52.744773+0000 mgr.a (mgr.14388) 6506 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:44:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:53 smithi179 bash[23186]: cluster 2024-09-21T00:44:52.744773+0000 mgr.a (mgr.14388) 6506 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:44:54.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:53 smithi049 bash[23528]: cluster 2024-09-21T00:44:52.744773+0000 mgr.a (mgr.14388) 6506 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:44:55.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:44:55.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:44:55.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:44:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:55 smithi044 bash[22676]: cluster 2024-09-21T00:44:54.745569+0000 mgr.a (mgr.14388) 6507 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:55 smithi179 bash[23186]: cluster 2024-09-21T00:44:54.745569+0000 mgr.a (mgr.14388) 6507 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:56.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:55 smithi049 bash[23528]: cluster 2024-09-21T00:44:54.745569+0000 mgr.a (mgr.14388) 6507 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:44:56.690 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:44:56.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:44:56.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:44:56.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:44:56.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:44:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:57 smithi044 bash[22676]: audit 2024-09-21T00:44:56.240380+0000 mgr.a (mgr.14388) 6508 : audit [DBG] from='client.148923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:57 smithi044 bash[22676]: cluster 2024-09-21T00:44:56.748403+0000 mgr.a (mgr.14388) 6509 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:57 smithi179 bash[23186]: audit 2024-09-21T00:44:56.240380+0000 mgr.a (mgr.14388) 6508 : audit [DBG] from='client.148923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:57 smithi179 bash[23186]: cluster 2024-09-21T00:44:56.748403+0000 mgr.a (mgr.14388) 6509 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:44:58.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:57 smithi049 bash[23528]: audit 2024-09-21T00:44:56.240380+0000 mgr.a (mgr.14388) 6508 : audit [DBG] from='client.148923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:44:58.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:57 smithi049 bash[23528]: cluster 2024-09-21T00:44:56.748403+0000 mgr.a (mgr.14388) 6509 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:44:59 smithi044 bash[22676]: cluster 2024-09-21T00:44:58.749227+0000 mgr.a (mgr.14388) 6510 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:45:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:44:59 smithi179 bash[23186]: cluster 2024-09-21T00:44:58.749227+0000 mgr.a (mgr.14388) 6510 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:45:00.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:44:59 smithi049 bash[23528]: cluster 2024-09-21T00:44:58.749227+0000 mgr.a (mgr.14388) 6510 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:45:01.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:01.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:01.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:02.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:01 smithi049 bash[23528]: cluster 2024-09-21T00:45:00.751208+0000 mgr.a (mgr.14388) 6511 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:45:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:01 smithi044 bash[22676]: cluster 2024-09-21T00:45:00.751208+0000 mgr.a (mgr.14388) 6511 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:45:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:01 smithi179 bash[23186]: cluster 2024-09-21T00:45:00.751208+0000 mgr.a (mgr.14388) 6511 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:45:02.443 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:02.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:02.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:02.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:02.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:03 smithi044 bash[22676]: audit 2024-09-21T00:45:02.023967+0000 mgr.a (mgr.14388) 6512 : audit [DBG] from='client.149001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:03 smithi044 bash[22676]: cluster 2024-09-21T00:45:02.752310+0000 mgr.a (mgr.14388) 6513 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:04.239 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:03 smithi179 bash[23186]: audit 2024-09-21T00:45:02.023967+0000 mgr.a (mgr.14388) 6512 : audit [DBG] from='client.149001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:04.239 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:03 smithi179 bash[23186]: cluster 2024-09-21T00:45:02.752310+0000 mgr.a (mgr.14388) 6513 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:03 smithi049 bash[23528]: audit 2024-09-21T00:45:02.023967+0000 mgr.a (mgr.14388) 6512 : audit [DBG] from='client.149001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:03 smithi049 bash[23528]: cluster 2024-09-21T00:45:02.752310+0000 mgr.a (mgr.14388) 6513 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:05 smithi044 bash[22676]: cluster 2024-09-21T00:45:04.753361+0000 mgr.a (mgr.14388) 6514 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:06.186 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:05 smithi179 bash[23186]: cluster 2024-09-21T00:45:04.753361+0000 mgr.a (mgr.14388) 6514 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:05 smithi049 bash[23528]: cluster 2024-09-21T00:45:04.753361+0000 mgr.a (mgr.14388) 6514 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:07.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:07.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:07.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:07 smithi044 bash[22676]: audit 2024-09-21T00:45:06.173861+0000 mon.a (mon.0) 5710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:07 smithi044 bash[22676]: audit 2024-09-21T00:45:06.178994+0000 mon.a (mon.0) 5711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:07 smithi044 bash[22676]: audit 2024-09-21T00:45:06.185017+0000 mon.a (mon.0) 5712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:07 smithi044 bash[22676]: cluster 2024-09-21T00:45:06.755540+0000 mgr.a (mgr.14388) 6515 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:07 smithi179 bash[23186]: audit 2024-09-21T00:45:06.173861+0000 mon.a (mon.0) 5710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:07 smithi179 bash[23186]: audit 2024-09-21T00:45:06.178994+0000 mon.a (mon.0) 5711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:07 smithi179 bash[23186]: audit 2024-09-21T00:45:06.185017+0000 mon.a (mon.0) 5712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:07 smithi179 bash[23186]: cluster 2024-09-21T00:45:06.755540+0000 mgr.a (mgr.14388) 6515 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:07 smithi049 bash[23528]: audit 2024-09-21T00:45:06.173861+0000 mon.a (mon.0) 5710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:07 smithi049 bash[23528]: audit 2024-09-21T00:45:06.178994+0000 mon.a (mon.0) 5711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:07 smithi049 bash[23528]: audit 2024-09-21T00:45:06.185017+0000 mon.a (mon.0) 5712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:07.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:07 smithi049 bash[23528]: cluster 2024-09-21T00:45:06.755540+0000 mgr.a (mgr.14388) 6515 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:08.251 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:08.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:08.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:08.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:08.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:08 smithi044 bash[22676]: audit 2024-09-21T00:45:07.674256+0000 mon.a (mon.0) 5713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:08 smithi044 bash[22676]: audit 2024-09-21T00:45:07.682318+0000 mon.a (mon.0) 5714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:08 smithi044 bash[22676]: audit 2024-09-21T00:45:07.688490+0000 mon.a (mon.0) 5715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:08 smithi044 bash[22676]: audit 2024-09-21T00:45:07.722043+0000 mon.a (mon.0) 5716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:08 smithi044 bash[22676]: audit 2024-09-21T00:45:07.727493+0000 mon.a (mon.0) 5717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:08 smithi044 bash[22676]: audit 2024-09-21T00:45:07.733814+0000 mon.a (mon.0) 5718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:08 smithi044 bash[22676]: audit 2024-09-21T00:45:07.812310+0000 mgr.a (mgr.14388) 6516 : audit [DBG] from='client.149079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:08 smithi179 bash[23186]: audit 2024-09-21T00:45:07.674256+0000 mon.a (mon.0) 5713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:08 smithi179 bash[23186]: audit 2024-09-21T00:45:07.682318+0000 mon.a (mon.0) 5714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:08 smithi179 bash[23186]: audit 2024-09-21T00:45:07.688490+0000 mon.a (mon.0) 5715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:08 smithi179 bash[23186]: audit 2024-09-21T00:45:07.722043+0000 mon.a (mon.0) 5716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:08 smithi179 bash[23186]: audit 2024-09-21T00:45:07.727493+0000 mon.a (mon.0) 5717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:08 smithi179 bash[23186]: audit 2024-09-21T00:45:07.733814+0000 mon.a (mon.0) 5718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:08 smithi179 bash[23186]: audit 2024-09-21T00:45:07.812310+0000 mgr.a (mgr.14388) 6516 : audit [DBG] from='client.149079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:09.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:08 smithi049 bash[23528]: audit 2024-09-21T00:45:07.674256+0000 mon.a (mon.0) 5713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:08 smithi049 bash[23528]: audit 2024-09-21T00:45:07.682318+0000 mon.a (mon.0) 5714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:08 smithi049 bash[23528]: audit 2024-09-21T00:45:07.688490+0000 mon.a (mon.0) 5715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:08 smithi049 bash[23528]: audit 2024-09-21T00:45:07.722043+0000 mon.a (mon.0) 5716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:08 smithi049 bash[23528]: audit 2024-09-21T00:45:07.727493+0000 mon.a (mon.0) 5717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:08 smithi049 bash[23528]: audit 2024-09-21T00:45:07.733814+0000 mon.a (mon.0) 5718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:08 smithi049 bash[23528]: audit 2024-09-21T00:45:07.812310+0000 mgr.a (mgr.14388) 6516 : audit [DBG] from='client.149079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:09 smithi044 bash[22676]: cluster 2024-09-21T00:45:08.756512+0000 mgr.a (mgr.14388) 6517 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:09 smithi179 bash[23186]: cluster 2024-09-21T00:45:08.756512+0000 mgr.a (mgr.14388) 6517 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:09 smithi049 bash[23528]: cluster 2024-09-21T00:45:08.756512+0000 mgr.a (mgr.14388) 6517 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:12.084 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:11 smithi049 bash[23528]: cluster 2024-09-21T00:45:10.758728+0000 mgr.a (mgr.14388) 6518 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:11 smithi044 bash[22676]: cluster 2024-09-21T00:45:10.758728+0000 mgr.a (mgr.14388) 6518 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:11 smithi179 bash[23186]: cluster 2024-09-21T00:45:10.758728+0000 mgr.a (mgr.14388) 6518 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:13.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:13 smithi044 bash[22676]: cluster 2024-09-21T00:45:12.759499+0000 mgr.a (mgr.14388) 6519 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:13 smithi179 bash[23186]: cluster 2024-09-21T00:45:12.759499+0000 mgr.a (mgr.14388) 6519 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:13.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:13 smithi049 bash[23528]: cluster 2024-09-21T00:45:12.759499+0000 mgr.a (mgr.14388) 6519 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:14.036 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:14.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:14.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:14.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:14.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:14 smithi044 bash[22676]: audit 2024-09-21T00:45:13.588717+0000 mgr.a (mgr.14388) 6520 : audit [DBG] from='client.149157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:14 smithi179 bash[23186]: audit 2024-09-21T00:45:13.588717+0000 mgr.a (mgr.14388) 6520 : audit [DBG] from='client.149157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:14.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:14 smithi049 bash[23528]: audit 2024-09-21T00:45:13.588717+0000 mgr.a (mgr.14388) 6520 : audit [DBG] from='client.149157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:15 smithi044 bash[22676]: cluster 2024-09-21T00:45:14.760495+0000 mgr.a (mgr.14388) 6521 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:15 smithi179 bash[23186]: cluster 2024-09-21T00:45:14.760495+0000 mgr.a (mgr.14388) 6521 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:15.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:15 smithi049 bash[23528]: cluster 2024-09-21T00:45:14.760495+0000 mgr.a (mgr.14388) 6521 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:17 smithi044 bash[22676]: cluster 2024-09-21T00:45:16.762765+0000 mgr.a (mgr.14388) 6522 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:17 smithi179 bash[23186]: cluster 2024-09-21T00:45:16.762765+0000 mgr.a (mgr.14388) 6522 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:17 smithi049 bash[23528]: cluster 2024-09-21T00:45:16.762765+0000 mgr.a (mgr.14388) 6522 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:19.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:45:18 smithi044 bash[22930]: debug 2024-09-21T00:45:18.919+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:45:19.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:45:18 smithi044 bash[22930]: debug 2024-09-21T00:45:18.919+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:45:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:18 smithi044 bash[22676]: audit 2024-09-21T00:45:18.120313+0000 mon.a (mon.0) 5719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:45:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:18 smithi044 bash[22676]: audit 2024-09-21T00:45:18.126889+0000 mon.a (mon.0) 5720 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:45:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:18 smithi044 bash[22676]: audit 2024-09-21T00:45:18.128845+0000 mon.a (mon.0) 5721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:45:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:18 smithi044 bash[22676]: audit 2024-09-21T00:45:18.140412+0000 mon.a (mon.0) 5722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:18 smithi044 bash[22676]: audit 2024-09-21T00:45:18.146936+0000 mon.a (mon.0) 5723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:45:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:18 smithi179 bash[23186]: audit 2024-09-21T00:45:18.120313+0000 mon.a (mon.0) 5719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:45:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:18 smithi179 bash[23186]: audit 2024-09-21T00:45:18.126889+0000 mon.a (mon.0) 5720 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:45:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:18 smithi179 bash[23186]: audit 2024-09-21T00:45:18.128845+0000 mon.a (mon.0) 5721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:45:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:18 smithi179 bash[23186]: audit 2024-09-21T00:45:18.140412+0000 mon.a (mon.0) 5722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:18 smithi179 bash[23186]: audit 2024-09-21T00:45:18.146936+0000 mon.a (mon.0) 5723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:45:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:18 smithi049 bash[23528]: audit 2024-09-21T00:45:18.120313+0000 mon.a (mon.0) 5719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:45:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:18 smithi049 bash[23528]: audit 2024-09-21T00:45:18.126889+0000 mon.a (mon.0) 5720 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:45:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:18 smithi049 bash[23528]: audit 2024-09-21T00:45:18.128845+0000 mon.a (mon.0) 5721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:45:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:18 smithi049 bash[23528]: audit 2024-09-21T00:45:18.140412+0000 mon.a (mon.0) 5722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:18 smithi049 bash[23528]: audit 2024-09-21T00:45:18.146936+0000 mon.a (mon.0) 5723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:45:19.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:19.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:19.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:19.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:19.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:19 smithi044 bash[22676]: audit 2024-09-21T00:45:18.149366+0000 mgr.a (mgr.14388) 6523 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:45:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:19 smithi044 bash[22676]: cluster 2024-09-21T00:45:18.763338+0000 mgr.a (mgr.14388) 6524 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:19 smithi179 bash[23186]: audit 2024-09-21T00:45:18.149366+0000 mgr.a (mgr.14388) 6523 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:45:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:19 smithi179 bash[23186]: cluster 2024-09-21T00:45:18.763338+0000 mgr.a (mgr.14388) 6524 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:20.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:19 smithi049 bash[23528]: audit 2024-09-21T00:45:18.149366+0000 mgr.a (mgr.14388) 6523 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:45:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:19 smithi049 bash[23528]: cluster 2024-09-21T00:45:18.763338+0000 mgr.a (mgr.14388) 6524 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:20 smithi044 bash[22676]: audit 2024-09-21T00:45:18.923637+0000 mgr.a (mgr.14388) 6525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:20 smithi044 bash[22676]: cephadm 2024-09-21T00:45:18.924843+0000 mgr.a (mgr.14388) 6526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:45:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:20 smithi044 bash[22676]: audit 2024-09-21T00:45:19.360415+0000 mgr.a (mgr.14388) 6527 : audit [DBG] from='client.149337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:20 smithi179 bash[23186]: audit 2024-09-21T00:45:18.923637+0000 mgr.a (mgr.14388) 6525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:45:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:20 smithi179 bash[23186]: cephadm 2024-09-21T00:45:18.924843+0000 mgr.a (mgr.14388) 6526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:45:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:20 smithi179 bash[23186]: audit 2024-09-21T00:45:19.360415+0000 mgr.a (mgr.14388) 6527 : audit [DBG] from='client.149337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:20 smithi049 bash[23528]: audit 2024-09-21T00:45:18.923637+0000 mgr.a (mgr.14388) 6525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:45:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:20 smithi049 bash[23528]: cephadm 2024-09-21T00:45:18.924843+0000 mgr.a (mgr.14388) 6526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:45:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:20 smithi049 bash[23528]: audit 2024-09-21T00:45:19.360415+0000 mgr.a (mgr.14388) 6527 : audit [DBG] from='client.149337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:21 smithi044 bash[22676]: cluster 2024-09-21T00:45:20.765801+0000 mgr.a (mgr.14388) 6528 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:21 smithi179 bash[23186]: cluster 2024-09-21T00:45:20.765801+0000 mgr.a (mgr.14388) 6528 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:22.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:21 smithi049 bash[23528]: cluster 2024-09-21T00:45:20.765801+0000 mgr.a (mgr.14388) 6528 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:24.138 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:23 smithi179 bash[23186]: cluster 2024-09-21T00:45:22.766786+0000 mgr.a (mgr.14388) 6529 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:23 smithi044 bash[22676]: cluster 2024-09-21T00:45:22.766786+0000 mgr.a (mgr.14388) 6529 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:24.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:23 smithi049 bash[23528]: cluster 2024-09-21T00:45:22.766786+0000 mgr.a (mgr.14388) 6529 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:24.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:24.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:24.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:25.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:25 smithi044 bash[22676]: cluster 2024-09-21T00:45:24.767578+0000 mgr.a (mgr.14388) 6530 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:25 smithi179 bash[23186]: cluster 2024-09-21T00:45:24.767578+0000 mgr.a (mgr.14388) 6530 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:26.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:25 smithi049 bash[23528]: cluster 2024-09-21T00:45:24.767578+0000 mgr.a (mgr.14388) 6530 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:26 smithi179 bash[23186]: audit 2024-09-21T00:45:25.123368+0000 mgr.a (mgr.14388) 6531 : audit [DBG] from='client.149415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:26 smithi179 bash[23186]: audit 2024-09-21T00:45:26.362223+0000 mon.a (mon.0) 5724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:26 smithi179 bash[23186]: audit 2024-09-21T00:45:26.370822+0000 mon.a (mon.0) 5725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:26 smithi179 bash[23186]: audit 2024-09-21T00:45:26.381489+0000 mon.a (mon.0) 5726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.169 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:26 smithi044 bash[22676]: audit 2024-09-21T00:45:25.123368+0000 mgr.a (mgr.14388) 6531 : audit [DBG] from='client.149415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:27.169 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:26 smithi044 bash[22676]: audit 2024-09-21T00:45:26.362223+0000 mon.a (mon.0) 5724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.169 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:26 smithi044 bash[22676]: audit 2024-09-21T00:45:26.370822+0000 mon.a (mon.0) 5725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.169 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:26 smithi044 bash[22676]: audit 2024-09-21T00:45:26.381489+0000 mon.a (mon.0) 5726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:26 smithi049 bash[23528]: audit 2024-09-21T00:45:25.123368+0000 mgr.a (mgr.14388) 6531 : audit [DBG] from='client.149415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:26 smithi049 bash[23528]: audit 2024-09-21T00:45:26.362223+0000 mon.a (mon.0) 5724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:26 smithi049 bash[23528]: audit 2024-09-21T00:45:26.370822+0000 mon.a (mon.0) 5725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:26 smithi049 bash[23528]: audit 2024-09-21T00:45:26.381489+0000 mon.a (mon.0) 5726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:28.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:27 smithi044 bash[22676]: cluster 2024-09-21T00:45:26.770365+0000 mgr.a (mgr.14388) 6532 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:27 smithi179 bash[23186]: cluster 2024-09-21T00:45:26.770365+0000 mgr.a (mgr.14388) 6532 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:28.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:27 smithi049 bash[23528]: cluster 2024-09-21T00:45:26.770365+0000 mgr.a (mgr.14388) 6532 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:28 smithi044 bash[22676]: audit 2024-09-21T00:45:27.859467+0000 mon.a (mon.0) 5727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:28 smithi044 bash[22676]: audit 2024-09-21T00:45:27.866761+0000 mon.a (mon.0) 5728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:28 smithi044 bash[22676]: audit 2024-09-21T00:45:27.872612+0000 mon.a (mon.0) 5729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:28 smithi044 bash[22676]: audit 2024-09-21T00:45:27.887996+0000 mon.a (mon.0) 5730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:28 smithi044 bash[22676]: audit 2024-09-21T00:45:27.894671+0000 mon.a (mon.0) 5731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:28 smithi044 bash[22676]: audit 2024-09-21T00:45:27.901532+0000 mon.a (mon.0) 5732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:28 smithi179 bash[23186]: audit 2024-09-21T00:45:27.859467+0000 mon.a (mon.0) 5727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:28 smithi179 bash[23186]: audit 2024-09-21T00:45:27.866761+0000 mon.a (mon.0) 5728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:28 smithi179 bash[23186]: audit 2024-09-21T00:45:27.872612+0000 mon.a (mon.0) 5729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:28 smithi179 bash[23186]: audit 2024-09-21T00:45:27.887996+0000 mon.a (mon.0) 5730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:28 smithi179 bash[23186]: audit 2024-09-21T00:45:27.894671+0000 mon.a (mon.0) 5731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:28 smithi179 bash[23186]: audit 2024-09-21T00:45:27.901532+0000 mon.a (mon.0) 5732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:28 smithi049 bash[23528]: audit 2024-09-21T00:45:27.859467+0000 mon.a (mon.0) 5727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:28 smithi049 bash[23528]: audit 2024-09-21T00:45:27.866761+0000 mon.a (mon.0) 5728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:28 smithi049 bash[23528]: audit 2024-09-21T00:45:27.872612+0000 mon.a (mon.0) 5729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:28 smithi049 bash[23528]: audit 2024-09-21T00:45:27.887996+0000 mon.a (mon.0) 5730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:28 smithi049 bash[23528]: audit 2024-09-21T00:45:27.894671+0000 mon.a (mon.0) 5731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:28 smithi049 bash[23528]: audit 2024-09-21T00:45:27.901532+0000 mon.a (mon.0) 5732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:29 smithi044 bash[22676]: cluster 2024-09-21T00:45:28.771288+0000 mgr.a (mgr.14388) 6533 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:45:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:29 smithi179 bash[23186]: cluster 2024-09-21T00:45:28.771288+0000 mgr.a (mgr.14388) 6533 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:45:30.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:29 smithi049 bash[23528]: cluster 2024-09-21T00:45:28.771288+0000 mgr.a (mgr.14388) 6533 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:45:30.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:31.356 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:32.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:31 smithi049 bash[23528]: cluster 2024-09-21T00:45:30.773304+0000 mgr.a (mgr.14388) 6534 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:31 smithi044 bash[22676]: cluster 2024-09-21T00:45:30.773304+0000 mgr.a (mgr.14388) 6534 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:31 smithi179 bash[23186]: cluster 2024-09-21T00:45:30.773304+0000 mgr.a (mgr.14388) 6534 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:45:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:32 smithi044 bash[22676]: audit 2024-09-21T00:45:30.913627+0000 mgr.a (mgr.14388) 6535 : audit [DBG] from='client.149490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:32 smithi179 bash[23186]: audit 2024-09-21T00:45:30.913627+0000 mgr.a (mgr.14388) 6535 : audit [DBG] from='client.149490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:33.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:32 smithi049 bash[23528]: audit 2024-09-21T00:45:30.913627+0000 mgr.a (mgr.14388) 6535 : audit [DBG] from='client.149490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:33 smithi044 bash[22676]: cluster 2024-09-21T00:45:32.774110+0000 mgr.a (mgr.14388) 6536 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:45:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:33 smithi179 bash[23186]: cluster 2024-09-21T00:45:32.774110+0000 mgr.a (mgr.14388) 6536 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:45:34.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:33 smithi049 bash[23528]: cluster 2024-09-21T00:45:32.774110+0000 mgr.a (mgr.14388) 6536 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:45:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:34 smithi044 bash[22676]: cluster 2024-09-21T00:45:34.774932+0000 mgr.a (mgr.14388) 6537 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:45:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:34 smithi179 bash[23186]: cluster 2024-09-21T00:45:34.774932+0000 mgr.a (mgr.14388) 6537 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:45:35.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:34 smithi049 bash[23528]: cluster 2024-09-21T00:45:34.774932+0000 mgr.a (mgr.14388) 6537 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:45:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:36.358 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:36.358 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:37.153 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:37.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:37.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:37 smithi044 bash[22676]: audit 2024-09-21T00:45:36.695544+0000 mgr.a (mgr.14388) 6538 : audit [DBG] from='client.149568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:37 smithi044 bash[22676]: cluster 2024-09-21T00:45:36.776900+0000 mgr.a (mgr.14388) 6539 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:37 smithi179 bash[23186]: audit 2024-09-21T00:45:36.695544+0000 mgr.a (mgr.14388) 6538 : audit [DBG] from='client.149568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:37 smithi179 bash[23186]: cluster 2024-09-21T00:45:36.776900+0000 mgr.a (mgr.14388) 6539 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:38.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:37 smithi049 bash[23528]: audit 2024-09-21T00:45:36.695544+0000 mgr.a (mgr.14388) 6538 : audit [DBG] from='client.149568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:38.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:37 smithi049 bash[23528]: cluster 2024-09-21T00:45:36.776900+0000 mgr.a (mgr.14388) 6539 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:39 smithi044 bash[22676]: cluster 2024-09-21T00:45:38.777880+0000 mgr.a (mgr.14388) 6540 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:39 smithi179 bash[23186]: cluster 2024-09-21T00:45:38.777880+0000 mgr.a (mgr.14388) 6540 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:40.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:39 smithi049 bash[23528]: cluster 2024-09-21T00:45:38.777880+0000 mgr.a (mgr.14388) 6540 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:42.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:42.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:42.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:41 smithi044 bash[22676]: cluster 2024-09-21T00:45:40.780122+0000 mgr.a (mgr.14388) 6541 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:41 smithi179 bash[23186]: cluster 2024-09-21T00:45:40.780122+0000 mgr.a (mgr.14388) 6541 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:42.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:41 smithi049 bash[23528]: cluster 2024-09-21T00:45:40.780122+0000 mgr.a (mgr.14388) 6541 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:42.927 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:42.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:42.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:42.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:42.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:44.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:43 smithi179 bash[23186]: audit 2024-09-21T00:45:42.487660+0000 mgr.a (mgr.14388) 6542 : audit [DBG] from='client.149646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:44.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:43 smithi179 bash[23186]: cluster 2024-09-21T00:45:42.780665+0000 mgr.a (mgr.14388) 6543 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:43 smithi044 bash[22676]: audit 2024-09-21T00:45:42.487660+0000 mgr.a (mgr.14388) 6542 : audit [DBG] from='client.149646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:43 smithi044 bash[22676]: cluster 2024-09-21T00:45:42.780665+0000 mgr.a (mgr.14388) 6543 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:44.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:43 smithi049 bash[23528]: audit 2024-09-21T00:45:42.487660+0000 mgr.a (mgr.14388) 6542 : audit [DBG] from='client.149646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:44.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:43 smithi049 bash[23528]: cluster 2024-09-21T00:45:42.780665+0000 mgr.a (mgr.14388) 6543 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:45 smithi044 bash[22676]: cluster 2024-09-21T00:45:44.781606+0000 mgr.a (mgr.14388) 6544 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:45 smithi179 bash[23186]: cluster 2024-09-21T00:45:44.781606+0000 mgr.a (mgr.14388) 6544 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:46.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:45 smithi049 bash[23528]: cluster 2024-09-21T00:45:44.781606+0000 mgr.a (mgr.14388) 6544 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:47.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:47 smithi049 bash[23528]: audit 2024-09-21T00:45:46.538627+0000 mon.a (mon.0) 5733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:47 smithi049 bash[23528]: audit 2024-09-21T00:45:46.547072+0000 mon.a (mon.0) 5734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:47 smithi049 bash[23528]: audit 2024-09-21T00:45:46.557656+0000 mon.a (mon.0) 5735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:47.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:47 smithi049 bash[23528]: cluster 2024-09-21T00:45:46.783973+0000 mgr.a (mgr.14388) 6545 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:47.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:47.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:47.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:47.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:47 smithi044 bash[22676]: audit 2024-09-21T00:45:46.538627+0000 mon.a (mon.0) 5733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:47.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:47 smithi044 bash[22676]: audit 2024-09-21T00:45:46.547072+0000 mon.a (mon.0) 5734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:47.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:47 smithi044 bash[22676]: audit 2024-09-21T00:45:46.557656+0000 mon.a (mon.0) 5735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:47.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:47 smithi044 bash[22676]: cluster 2024-09-21T00:45:46.783973+0000 mgr.a (mgr.14388) 6545 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:47 smithi179 bash[23186]: audit 2024-09-21T00:45:46.538627+0000 mon.a (mon.0) 5733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:47 smithi179 bash[23186]: audit 2024-09-21T00:45:46.547072+0000 mon.a (mon.0) 5734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:47 smithi179 bash[23186]: audit 2024-09-21T00:45:46.557656+0000 mon.a (mon.0) 5735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:47 smithi179 bash[23186]: cluster 2024-09-21T00:45:46.783973+0000 mgr.a (mgr.14388) 6545 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:45:48.738 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:48.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:48.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:48.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:48.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: audit 2024-09-21T00:45:48.056345+0000 mon.a (mon.0) 5736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: audit 2024-09-21T00:45:48.063968+0000 mon.a (mon.0) 5737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: audit 2024-09-21T00:45:48.070544+0000 mon.a (mon.0) 5738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: audit 2024-09-21T00:45:48.095900+0000 mon.a (mon.0) 5739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: audit 2024-09-21T00:45:48.101167+0000 mon.a (mon.0) 5740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: audit 2024-09-21T00:45:48.107034+0000 mon.a (mon.0) 5741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: audit 2024-09-21T00:45:48.277175+0000 mgr.a (mgr.14388) 6546 : audit [DBG] from='client.149724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:49 smithi044 bash[22676]: cluster 2024-09-21T00:45:48.784817+0000 mgr.a (mgr.14388) 6547 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: audit 2024-09-21T00:45:48.056345+0000 mon.a (mon.0) 5736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: audit 2024-09-21T00:45:48.063968+0000 mon.a (mon.0) 5737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: audit 2024-09-21T00:45:48.070544+0000 mon.a (mon.0) 5738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: audit 2024-09-21T00:45:48.095900+0000 mon.a (mon.0) 5739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: audit 2024-09-21T00:45:48.101167+0000 mon.a (mon.0) 5740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: audit 2024-09-21T00:45:48.107034+0000 mon.a (mon.0) 5741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: audit 2024-09-21T00:45:48.277175+0000 mgr.a (mgr.14388) 6546 : audit [DBG] from='client.149724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:49 smithi179 bash[23186]: cluster 2024-09-21T00:45:48.784817+0000 mgr.a (mgr.14388) 6547 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:49.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: audit 2024-09-21T00:45:48.056345+0000 mon.a (mon.0) 5736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: audit 2024-09-21T00:45:48.063968+0000 mon.a (mon.0) 5737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: audit 2024-09-21T00:45:48.070544+0000 mon.a (mon.0) 5738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: audit 2024-09-21T00:45:48.095900+0000 mon.a (mon.0) 5739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: audit 2024-09-21T00:45:48.101167+0000 mon.a (mon.0) 5740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: audit 2024-09-21T00:45:48.107034+0000 mon.a (mon.0) 5741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:45:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: audit 2024-09-21T00:45:48.277175+0000 mgr.a (mgr.14388) 6546 : audit [DBG] from='client.149724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:49 smithi049 bash[23528]: cluster 2024-09-21T00:45:48.784817+0000 mgr.a (mgr.14388) 6547 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:45:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:51 smithi044 bash[22676]: cluster 2024-09-21T00:45:50.787036+0000 mgr.a (mgr.14388) 6548 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:45:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:51 smithi179 bash[23186]: cluster 2024-09-21T00:45:50.787036+0000 mgr.a (mgr.14388) 6548 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:45:52.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:51 smithi049 bash[23528]: cluster 2024-09-21T00:45:50.787036+0000 mgr.a (mgr.14388) 6548 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:45:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:53.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:53.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:45:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:53 smithi044 bash[22676]: cluster 2024-09-21T00:45:52.787834+0000 mgr.a (mgr.14388) 6549 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:45:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:53 smithi179 bash[23186]: cluster 2024-09-21T00:45:52.787834+0000 mgr.a (mgr.14388) 6549 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:45:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:53 smithi049 bash[23528]: cluster 2024-09-21T00:45:52.787834+0000 mgr.a (mgr.14388) 6549 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:45:54.536 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:45:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:45:54.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:45:54.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:45:54.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:45:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:55 smithi044 bash[22676]: audit 2024-09-21T00:45:54.076634+0000 mgr.a (mgr.14388) 6550 : audit [DBG] from='client.149802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:55 smithi044 bash[22676]: cluster 2024-09-21T00:45:54.788877+0000 mgr.a (mgr.14388) 6551 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:45:56.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:55 smithi179 bash[23186]: audit 2024-09-21T00:45:54.076634+0000 mgr.a (mgr.14388) 6550 : audit [DBG] from='client.149802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:56.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:55 smithi179 bash[23186]: cluster 2024-09-21T00:45:54.788877+0000 mgr.a (mgr.14388) 6551 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:45:56.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:55 smithi049 bash[23528]: audit 2024-09-21T00:45:54.076634+0000 mgr.a (mgr.14388) 6550 : audit [DBG] from='client.149802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:45:56.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:55 smithi049 bash[23528]: cluster 2024-09-21T00:45:54.788877+0000 mgr.a (mgr.14388) 6551 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:45:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:57 smithi044 bash[22676]: cluster 2024-09-21T00:45:56.791206+0000 mgr.a (mgr.14388) 6552 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:45:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:57 smithi179 bash[23186]: cluster 2024-09-21T00:45:56.791206+0000 mgr.a (mgr.14388) 6552 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:45:58.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:57 smithi049 bash[23528]: cluster 2024-09-21T00:45:56.791206+0000 mgr.a (mgr.14388) 6552 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T00:45:59.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:45:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:45:59.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:45:59 smithi044 bash[22676]: cluster 2024-09-21T00:45:58.792001+0000 mgr.a (mgr.14388) 6553 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:46:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:45:59 smithi179 bash[23186]: cluster 2024-09-21T00:45:58.792001+0000 mgr.a (mgr.14388) 6553 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:46:00.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:45:59 smithi049 bash[23528]: cluster 2024-09-21T00:45:58.792001+0000 mgr.a (mgr.14388) 6553 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:46:00.315 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:00.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:01 smithi044 bash[22676]: audit 2024-09-21T00:45:59.881105+0000 mgr.a (mgr.14388) 6554 : audit [DBG] from='client.149880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:01 smithi044 bash[22676]: cluster 2024-09-21T00:46:00.794915+0000 mgr.a (mgr.14388) 6555 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-21T00:46:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:01 smithi179 bash[23186]: audit 2024-09-21T00:45:59.881105+0000 mgr.a (mgr.14388) 6554 : audit [DBG] from='client.149880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:01 smithi179 bash[23186]: cluster 2024-09-21T00:46:00.794915+0000 mgr.a (mgr.14388) 6555 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-21T00:46:02.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:01 smithi049 bash[23528]: audit 2024-09-21T00:45:59.881105+0000 mgr.a (mgr.14388) 6554 : audit [DBG] from='client.149880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:02.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:01 smithi049 bash[23528]: cluster 2024-09-21T00:46:00.794915+0000 mgr.a (mgr.14388) 6555 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-21T00:46:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:03 smithi044 bash[22676]: cluster 2024-09-21T00:46:02.795742+0000 mgr.a (mgr.14388) 6556 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:03 smithi179 bash[23186]: cluster 2024-09-21T00:46:02.795742+0000 mgr.a (mgr.14388) 6556 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:03 smithi049 bash[23528]: cluster 2024-09-21T00:46:02.795742+0000 mgr.a (mgr.14388) 6556 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:05.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:05.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:05.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:05.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:05 smithi044 bash[22676]: cluster 2024-09-21T00:46:04.796549+0000 mgr.a (mgr.14388) 6557 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:06.098 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:05 smithi179 bash[23186]: cluster 2024-09-21T00:46:04.796549+0000 mgr.a (mgr.14388) 6557 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:05 smithi049 bash[23528]: cluster 2024-09-21T00:46:04.796549+0000 mgr.a (mgr.14388) 6557 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:07.011 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:06 smithi179 bash[23186]: audit 2024-09-21T00:46:05.657711+0000 mgr.a (mgr.14388) 6558 : audit [DBG] from='client.149952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:07.011 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:06 smithi179 bash[23186]: audit 2024-09-21T00:46:06.735980+0000 mon.a (mon.0) 5742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.011 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:06 smithi179 bash[23186]: audit 2024-09-21T00:46:06.744439+0000 mon.a (mon.0) 5743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.011 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:06 smithi179 bash[23186]: audit 2024-09-21T00:46:06.755421+0000 mon.a (mon.0) 5744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:06 smithi044 bash[22676]: audit 2024-09-21T00:46:05.657711+0000 mgr.a (mgr.14388) 6558 : audit [DBG] from='client.149952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:06 smithi044 bash[22676]: audit 2024-09-21T00:46:06.735980+0000 mon.a (mon.0) 5742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:06 smithi044 bash[22676]: audit 2024-09-21T00:46:06.744439+0000 mon.a (mon.0) 5743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:06 smithi044 bash[22676]: audit 2024-09-21T00:46:06.755421+0000 mon.a (mon.0) 5744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:06 smithi049 bash[23528]: audit 2024-09-21T00:46:05.657711+0000 mgr.a (mgr.14388) 6558 : audit [DBG] from='client.149952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:06 smithi049 bash[23528]: audit 2024-09-21T00:46:06.735980+0000 mon.a (mon.0) 5742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:06 smithi049 bash[23528]: audit 2024-09-21T00:46:06.744439+0000 mon.a (mon.0) 5743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:06 smithi049 bash[23528]: audit 2024-09-21T00:46:06.755421+0000 mon.a (mon.0) 5744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:07 smithi179 bash[23186]: cluster 2024-09-21T00:46:06.799478+0000 mgr.a (mgr.14388) 6559 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:46:08.148 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:07 smithi044 bash[22676]: cluster 2024-09-21T00:46:06.799478+0000 mgr.a (mgr.14388) 6559 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:46:08.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:07 smithi049 bash[23528]: cluster 2024-09-21T00:46:06.799478+0000 mgr.a (mgr.14388) 6559 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:46:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:09 smithi044 bash[22676]: audit 2024-09-21T00:46:08.201679+0000 mon.a (mon.0) 5745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:09 smithi044 bash[22676]: audit 2024-09-21T00:46:08.208722+0000 mon.a (mon.0) 5746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:09 smithi044 bash[22676]: audit 2024-09-21T00:46:08.217619+0000 mon.a (mon.0) 5747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:09 smithi044 bash[22676]: audit 2024-09-21T00:46:08.299392+0000 mon.a (mon.0) 5748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:09 smithi044 bash[22676]: audit 2024-09-21T00:46:08.308205+0000 mon.a (mon.0) 5749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:09 smithi044 bash[22676]: audit 2024-09-21T00:46:08.318363+0000 mon.a (mon.0) 5750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:09 smithi044 bash[22676]: cluster 2024-09-21T00:46:08.800288+0000 mgr.a (mgr.14388) 6560 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:09 smithi179 bash[23186]: audit 2024-09-21T00:46:08.201679+0000 mon.a (mon.0) 5745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:09 smithi179 bash[23186]: audit 2024-09-21T00:46:08.208722+0000 mon.a (mon.0) 5746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:09 smithi179 bash[23186]: audit 2024-09-21T00:46:08.217619+0000 mon.a (mon.0) 5747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:09 smithi179 bash[23186]: audit 2024-09-21T00:46:08.299392+0000 mon.a (mon.0) 5748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:09 smithi179 bash[23186]: audit 2024-09-21T00:46:08.308205+0000 mon.a (mon.0) 5749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:09 smithi179 bash[23186]: audit 2024-09-21T00:46:08.318363+0000 mon.a (mon.0) 5750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:09 smithi179 bash[23186]: cluster 2024-09-21T00:46:08.800288+0000 mgr.a (mgr.14388) 6560 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:09.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:09 smithi049 bash[23528]: audit 2024-09-21T00:46:08.201679+0000 mon.a (mon.0) 5745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:09 smithi049 bash[23528]: audit 2024-09-21T00:46:08.208722+0000 mon.a (mon.0) 5746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:09 smithi049 bash[23528]: audit 2024-09-21T00:46:08.217619+0000 mon.a (mon.0) 5747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:09 smithi049 bash[23528]: audit 2024-09-21T00:46:08.299392+0000 mon.a (mon.0) 5748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:09 smithi049 bash[23528]: audit 2024-09-21T00:46:08.308205+0000 mon.a (mon.0) 5749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:09 smithi049 bash[23528]: audit 2024-09-21T00:46:08.318363+0000 mon.a (mon.0) 5750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:09.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:09 smithi049 bash[23528]: cluster 2024-09-21T00:46:08.800288+0000 mgr.a (mgr.14388) 6560 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T00:46:11.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:11.862 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:11 smithi044 bash[22676]: cluster 2024-09-21T00:46:10.802284+0000 mgr.a (mgr.14388) 6561 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:46:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:11 smithi179 bash[23186]: cluster 2024-09-21T00:46:10.802284+0000 mgr.a (mgr.14388) 6561 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:46:12.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:11 smithi049 bash[23528]: cluster 2024-09-21T00:46:10.802284+0000 mgr.a (mgr.14388) 6561 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T00:46:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:12 smithi044 bash[22676]: audit 2024-09-21T00:46:11.432351+0000 mgr.a (mgr.14388) 6562 : audit [DBG] from='client.150027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:12 smithi179 bash[23186]: audit 2024-09-21T00:46:11.432351+0000 mgr.a (mgr.14388) 6562 : audit [DBG] from='client.150027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:12 smithi049 bash[23528]: audit 2024-09-21T00:46:11.432351+0000 mgr.a (mgr.14388) 6562 : audit [DBG] from='client.150027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:13 smithi044 bash[22676]: cluster 2024-09-21T00:46:12.803227+0000 mgr.a (mgr.14388) 6563 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:13 smithi179 bash[23186]: cluster 2024-09-21T00:46:12.803227+0000 mgr.a (mgr.14388) 6563 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:14.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:13 smithi049 bash[23528]: cluster 2024-09-21T00:46:12.803227+0000 mgr.a (mgr.14388) 6563 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:15 smithi044 bash[22676]: cluster 2024-09-21T00:46:14.804095+0000 mgr.a (mgr.14388) 6564 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:15 smithi179 bash[23186]: cluster 2024-09-21T00:46:14.804095+0000 mgr.a (mgr.14388) 6564 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:16.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:15 smithi049 bash[23528]: cluster 2024-09-21T00:46:14.804095+0000 mgr.a (mgr.14388) 6564 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:16.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:16.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:17.626 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:17.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:17.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:17.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:17.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:17 smithi044 bash[22676]: cluster 2024-09-21T00:46:16.806442+0000 mgr.a (mgr.14388) 6565 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:17 smithi179 bash[23186]: cluster 2024-09-21T00:46:16.806442+0000 mgr.a (mgr.14388) 6565 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:17 smithi049 bash[23528]: cluster 2024-09-21T00:46:16.806442+0000 mgr.a (mgr.14388) 6565 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:18 smithi044 bash[22676]: audit 2024-09-21T00:46:17.194848+0000 mgr.a (mgr.14388) 6566 : audit [DBG] from='client.150102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:18 smithi179 bash[23186]: audit 2024-09-21T00:46:17.194848+0000 mgr.a (mgr.14388) 6566 : audit [DBG] from='client.150102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:18 smithi049 bash[23528]: audit 2024-09-21T00:46:17.194848+0000 mgr.a (mgr.14388) 6566 : audit [DBG] from='client.150102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:20.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22930]: debug 2024-09-21T00:46:19.786+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:46:20.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22930]: debug 2024-09-21T00:46:19.790+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:46:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: cluster 2024-09-21T00:46:18.807416+0000 mgr.a (mgr.14388) 6567 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: audit 2024-09-21T00:46:18.982507+0000 mon.a (mon.0) 5751 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: audit 2024-09-21T00:46:18.989466+0000 mon.a (mon.0) 5752 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: audit 2024-09-21T00:46:18.991460+0000 mon.a (mon.0) 5753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: audit 2024-09-21T00:46:19.002674+0000 mon.a (mon.0) 5754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: audit 2024-09-21T00:46:19.009884+0000 mon.a (mon.0) 5755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: audit 2024-09-21T00:46:19.012482+0000 mgr.a (mgr.14388) 6568 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: audit 2024-09-21T00:46:19.791635+0000 mgr.a (mgr.14388) 6569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:46:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:19 smithi044 bash[22676]: cephadm 2024-09-21T00:46:19.793502+0000 mgr.a (mgr.14388) 6570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:46:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: cluster 2024-09-21T00:46:18.807416+0000 mgr.a (mgr.14388) 6567 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: audit 2024-09-21T00:46:18.982507+0000 mon.a (mon.0) 5751 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:46:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: audit 2024-09-21T00:46:18.989466+0000 mon.a (mon.0) 5752 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:46:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: audit 2024-09-21T00:46:18.991460+0000 mon.a (mon.0) 5753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:46:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: audit 2024-09-21T00:46:19.002674+0000 mon.a (mon.0) 5754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: audit 2024-09-21T00:46:19.009884+0000 mon.a (mon.0) 5755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:46:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: audit 2024-09-21T00:46:19.012482+0000 mgr.a (mgr.14388) 6568 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:46:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: audit 2024-09-21T00:46:19.791635+0000 mgr.a (mgr.14388) 6569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:46:20.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:19 smithi179 bash[23186]: cephadm 2024-09-21T00:46:19.793502+0000 mgr.a (mgr.14388) 6570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: cluster 2024-09-21T00:46:18.807416+0000 mgr.a (mgr.14388) 6567 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: audit 2024-09-21T00:46:18.982507+0000 mon.a (mon.0) 5751 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: audit 2024-09-21T00:46:18.989466+0000 mon.a (mon.0) 5752 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: audit 2024-09-21T00:46:18.991460+0000 mon.a (mon.0) 5753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: audit 2024-09-21T00:46:19.002674+0000 mon.a (mon.0) 5754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: audit 2024-09-21T00:46:19.009884+0000 mon.a (mon.0) 5755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: audit 2024-09-21T00:46:19.012482+0000 mgr.a (mgr.14388) 6568 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:46:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: audit 2024-09-21T00:46:19.791635+0000 mgr.a (mgr.14388) 6569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:46:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:19 smithi049 bash[23528]: cephadm 2024-09-21T00:46:19.793502+0000 mgr.a (mgr.14388) 6570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:46:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:20 smithi044 bash[22676]: cluster 2024-09-21T00:46:20.809806+0000 mgr.a (mgr.14388) 6571 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:20 smithi179 bash[23186]: cluster 2024-09-21T00:46:20.809806+0000 mgr.a (mgr.14388) 6571 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:21.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:20 smithi049 bash[23528]: cluster 2024-09-21T00:46:20.809806+0000 mgr.a (mgr.14388) 6571 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:22.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:22.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:23.369 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:23.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:24.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:23 smithi049 bash[23528]: cluster 2024-09-21T00:46:22.810582+0000 mgr.a (mgr.14388) 6572 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:23 smithi044 bash[22676]: cluster 2024-09-21T00:46:22.810582+0000 mgr.a (mgr.14388) 6572 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:23 smithi179 bash[23186]: cluster 2024-09-21T00:46:22.810582+0000 mgr.a (mgr.14388) 6572 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:24 smithi044 bash[22676]: audit 2024-09-21T00:46:22.952765+0000 mgr.a (mgr.14388) 6573 : audit [DBG] from='client.150282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:24 smithi179 bash[23186]: audit 2024-09-21T00:46:22.952765+0000 mgr.a (mgr.14388) 6573 : audit [DBG] from='client.150282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:24 smithi049 bash[23528]: audit 2024-09-21T00:46:22.952765+0000 mgr.a (mgr.14388) 6573 : audit [DBG] from='client.150282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:25 smithi179 bash[23186]: cluster 2024-09-21T00:46:24.811503+0000 mgr.a (mgr.14388) 6574 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:25 smithi044 bash[22676]: cluster 2024-09-21T00:46:24.811503+0000 mgr.a (mgr.14388) 6574 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:26.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:25 smithi049 bash[23528]: cluster 2024-09-21T00:46:24.811503+0000 mgr.a (mgr.14388) 6574 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:27 smithi044 bash[22676]: cluster 2024-09-21T00:46:26.813851+0000 mgr.a (mgr.14388) 6575 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:27 smithi044 bash[22676]: audit 2024-09-21T00:46:26.944744+0000 mon.a (mon.0) 5756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:27 smithi044 bash[22676]: audit 2024-09-21T00:46:26.950727+0000 mon.a (mon.0) 5757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:27 smithi044 bash[22676]: audit 2024-09-21T00:46:26.960637+0000 mon.a (mon.0) 5758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:27 smithi179 bash[23186]: cluster 2024-09-21T00:46:26.813851+0000 mgr.a (mgr.14388) 6575 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:27 smithi179 bash[23186]: audit 2024-09-21T00:46:26.944744+0000 mon.a (mon.0) 5756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:27 smithi179 bash[23186]: audit 2024-09-21T00:46:26.950727+0000 mon.a (mon.0) 5757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:27 smithi179 bash[23186]: audit 2024-09-21T00:46:26.960637+0000 mon.a (mon.0) 5758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:27 smithi049 bash[23528]: cluster 2024-09-21T00:46:26.813851+0000 mgr.a (mgr.14388) 6575 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:28.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:27 smithi049 bash[23528]: audit 2024-09-21T00:46:26.944744+0000 mon.a (mon.0) 5756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:27 smithi049 bash[23528]: audit 2024-09-21T00:46:26.950727+0000 mon.a (mon.0) 5757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:27 smithi049 bash[23528]: audit 2024-09-21T00:46:26.960637+0000 mon.a (mon.0) 5758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:28.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:28.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:28.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:29.148 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: audit 2024-09-21T00:46:28.365748+0000 mon.a (mon.0) 5759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: audit 2024-09-21T00:46:28.374109+0000 mon.a (mon.0) 5760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: audit 2024-09-21T00:46:28.382844+0000 mon.a (mon.0) 5761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: audit 2024-09-21T00:46:28.499594+0000 mon.a (mon.0) 5762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: audit 2024-09-21T00:46:28.507926+0000 mon.a (mon.0) 5763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: audit 2024-09-21T00:46:28.517851+0000 mon.a (mon.0) 5764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: audit 2024-09-21T00:46:28.703078+0000 mgr.a (mgr.14388) 6576 : audit [DBG] from='client.150360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:29 smithi044 bash[22676]: cluster 2024-09-21T00:46:28.814374+0000 mgr.a (mgr.14388) 6577 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: audit 2024-09-21T00:46:28.365748+0000 mon.a (mon.0) 5759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: audit 2024-09-21T00:46:28.374109+0000 mon.a (mon.0) 5760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: audit 2024-09-21T00:46:28.382844+0000 mon.a (mon.0) 5761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: audit 2024-09-21T00:46:28.499594+0000 mon.a (mon.0) 5762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: audit 2024-09-21T00:46:28.507926+0000 mon.a (mon.0) 5763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: audit 2024-09-21T00:46:28.517851+0000 mon.a (mon.0) 5764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: audit 2024-09-21T00:46:28.703078+0000 mgr.a (mgr.14388) 6576 : audit [DBG] from='client.150360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:29 smithi179 bash[23186]: cluster 2024-09-21T00:46:28.814374+0000 mgr.a (mgr.14388) 6577 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:29.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: audit 2024-09-21T00:46:28.365748+0000 mon.a (mon.0) 5759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: audit 2024-09-21T00:46:28.374109+0000 mon.a (mon.0) 5760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: audit 2024-09-21T00:46:28.382844+0000 mon.a (mon.0) 5761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: audit 2024-09-21T00:46:28.499594+0000 mon.a (mon.0) 5762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: audit 2024-09-21T00:46:28.507926+0000 mon.a (mon.0) 5763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: audit 2024-09-21T00:46:28.517851+0000 mon.a (mon.0) 5764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: audit 2024-09-21T00:46:28.703078+0000 mgr.a (mgr.14388) 6576 : audit [DBG] from='client.150360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:29.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:29 smithi049 bash[23528]: cluster 2024-09-21T00:46:28.814374+0000 mgr.a (mgr.14388) 6577 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:32.196 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:31 smithi049 bash[23528]: cluster 2024-09-21T00:46:30.816697+0000 mgr.a (mgr.14388) 6578 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:31 smithi044 bash[22676]: cluster 2024-09-21T00:46:30.816697+0000 mgr.a (mgr.14388) 6578 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:31 smithi179 bash[23186]: cluster 2024-09-21T00:46:30.816697+0000 mgr.a (mgr.14388) 6578 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:46:34.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:34.151 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:34.151 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:33 smithi044 bash[22676]: cluster 2024-09-21T00:46:32.817493+0000 mgr.a (mgr.14388) 6579 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:33 smithi179 bash[23186]: cluster 2024-09-21T00:46:32.817493+0000 mgr.a (mgr.14388) 6579 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:34.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:33 smithi049 bash[23528]: cluster 2024-09-21T00:46:32.817493+0000 mgr.a (mgr.14388) 6579 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:34.904 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:34.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:34.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:34.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:34.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:35 smithi044 bash[22676]: audit 2024-09-21T00:46:34.481219+0000 mgr.a (mgr.14388) 6580 : audit [DBG] from='client.150438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:35 smithi044 bash[22676]: cluster 2024-09-21T00:46:34.818068+0000 mgr.a (mgr.14388) 6581 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:35 smithi179 bash[23186]: audit 2024-09-21T00:46:34.481219+0000 mgr.a (mgr.14388) 6580 : audit [DBG] from='client.150438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:35 smithi179 bash[23186]: cluster 2024-09-21T00:46:34.818068+0000 mgr.a (mgr.14388) 6581 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:36.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:35 smithi049 bash[23528]: audit 2024-09-21T00:46:34.481219+0000 mgr.a (mgr.14388) 6580 : audit [DBG] from='client.150438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:36.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:35 smithi049 bash[23528]: cluster 2024-09-21T00:46:34.818068+0000 mgr.a (mgr.14388) 6581 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:37 smithi044 bash[22676]: cluster 2024-09-21T00:46:36.820374+0000 mgr.a (mgr.14388) 6582 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:37 smithi179 bash[23186]: cluster 2024-09-21T00:46:36.820374+0000 mgr.a (mgr.14388) 6582 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:38.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:37 smithi049 bash[23528]: cluster 2024-09-21T00:46:36.820374+0000 mgr.a (mgr.14388) 6582 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:39.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:39 smithi044 bash[22676]: cluster 2024-09-21T00:46:38.821149+0000 mgr.a (mgr.14388) 6583 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:39 smithi179 bash[23186]: cluster 2024-09-21T00:46:38.821149+0000 mgr.a (mgr.14388) 6583 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:40.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:39 smithi049 bash[23528]: cluster 2024-09-21T00:46:38.821149+0000 mgr.a (mgr.14388) 6583 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:40.656 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:40.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:40.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:40.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:40.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:40 smithi044 bash[22676]: audit 2024-09-21T00:46:40.236955+0000 mgr.a (mgr.14388) 6584 : audit [DBG] from='client.150516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:40 smithi044 bash[22676]: cluster 2024-09-21T00:46:40.824035+0000 mgr.a (mgr.14388) 6585 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:40 smithi179 bash[23186]: audit 2024-09-21T00:46:40.236955+0000 mgr.a (mgr.14388) 6584 : audit [DBG] from='client.150516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:40 smithi179 bash[23186]: cluster 2024-09-21T00:46:40.824035+0000 mgr.a (mgr.14388) 6585 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:40 smithi049 bash[23528]: audit 2024-09-21T00:46:40.236955+0000 mgr.a (mgr.14388) 6584 : audit [DBG] from='client.150516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:40 smithi049 bash[23528]: cluster 2024-09-21T00:46:40.824035+0000 mgr.a (mgr.14388) 6585 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:43 smithi044 bash[22676]: cluster 2024-09-21T00:46:42.824860+0000 mgr.a (mgr.14388) 6586 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:46:44.251 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:43 smithi049 bash[23528]: cluster 2024-09-21T00:46:42.824860+0000 mgr.a (mgr.14388) 6586 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:46:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:43 smithi179 bash[23186]: cluster 2024-09-21T00:46:42.824860+0000 mgr.a (mgr.14388) 6586 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:46:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:45.658 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:45.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:45 smithi044 bash[22676]: cluster 2024-09-21T00:46:44.825844+0000 mgr.a (mgr.14388) 6587 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:46:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:45 smithi179 bash[23186]: cluster 2024-09-21T00:46:44.825844+0000 mgr.a (mgr.14388) 6587 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:46:46.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:45 smithi049 bash[23528]: cluster 2024-09-21T00:46:44.825844+0000 mgr.a (mgr.14388) 6587 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:46:46.409 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:46.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:46.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:46.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:46.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:47 smithi044 bash[22676]: audit 2024-09-21T00:46:45.980979+0000 mgr.a (mgr.14388) 6588 : audit [DBG] from='client.150591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:47 smithi044 bash[22676]: cluster 2024-09-21T00:46:46.828736+0000 mgr.a (mgr.14388) 6589 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:47 smithi044 bash[22676]: audit 2024-09-21T00:46:47.171881+0000 mon.a (mon.0) 5765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:47 smithi044 bash[22676]: audit 2024-09-21T00:46:47.181494+0000 mon.a (mon.0) 5766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:47 smithi044 bash[22676]: audit 2024-09-21T00:46:47.193421+0000 mon.a (mon.0) 5767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:47 smithi179 bash[23186]: audit 2024-09-21T00:46:45.980979+0000 mgr.a (mgr.14388) 6588 : audit [DBG] from='client.150591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:47 smithi179 bash[23186]: cluster 2024-09-21T00:46:46.828736+0000 mgr.a (mgr.14388) 6589 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:47 smithi179 bash[23186]: audit 2024-09-21T00:46:47.171881+0000 mon.a (mon.0) 5765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:47 smithi179 bash[23186]: audit 2024-09-21T00:46:47.181494+0000 mon.a (mon.0) 5766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:47 smithi179 bash[23186]: audit 2024-09-21T00:46:47.193421+0000 mon.a (mon.0) 5767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:47 smithi049 bash[23528]: audit 2024-09-21T00:46:45.980979+0000 mgr.a (mgr.14388) 6588 : audit [DBG] from='client.150591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:48.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:47 smithi049 bash[23528]: cluster 2024-09-21T00:46:46.828736+0000 mgr.a (mgr.14388) 6589 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:48.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:47 smithi049 bash[23528]: audit 2024-09-21T00:46:47.171881+0000 mon.a (mon.0) 5765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:47 smithi049 bash[23528]: audit 2024-09-21T00:46:47.181494+0000 mon.a (mon.0) 5766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:48.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:47 smithi049 bash[23528]: audit 2024-09-21T00:46:47.193421+0000 mon.a (mon.0) 5767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:49 smithi044 bash[22676]: audit 2024-09-21T00:46:48.567649+0000 mon.a (mon.0) 5768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:49 smithi044 bash[22676]: audit 2024-09-21T00:46:48.575427+0000 mon.a (mon.0) 5769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:49 smithi044 bash[22676]: audit 2024-09-21T00:46:48.586562+0000 mon.a (mon.0) 5770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:49 smithi044 bash[22676]: audit 2024-09-21T00:46:48.709602+0000 mon.a (mon.0) 5771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:49 smithi044 bash[22676]: audit 2024-09-21T00:46:48.718235+0000 mon.a (mon.0) 5772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:49 smithi044 bash[22676]: audit 2024-09-21T00:46:48.726140+0000 mon.a (mon.0) 5773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:49 smithi044 bash[22676]: cluster 2024-09-21T00:46:48.829552+0000 mgr.a (mgr.14388) 6590 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:49 smithi179 bash[23186]: audit 2024-09-21T00:46:48.567649+0000 mon.a (mon.0) 5768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:49 smithi179 bash[23186]: audit 2024-09-21T00:46:48.575427+0000 mon.a (mon.0) 5769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:49 smithi179 bash[23186]: audit 2024-09-21T00:46:48.586562+0000 mon.a (mon.0) 5770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:49 smithi179 bash[23186]: audit 2024-09-21T00:46:48.709602+0000 mon.a (mon.0) 5771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:49 smithi179 bash[23186]: audit 2024-09-21T00:46:48.718235+0000 mon.a (mon.0) 5772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:49 smithi179 bash[23186]: audit 2024-09-21T00:46:48.726140+0000 mon.a (mon.0) 5773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:49 smithi179 bash[23186]: cluster 2024-09-21T00:46:48.829552+0000 mgr.a (mgr.14388) 6590 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:46:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:49 smithi049 bash[23528]: audit 2024-09-21T00:46:48.567649+0000 mon.a (mon.0) 5768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:49 smithi049 bash[23528]: audit 2024-09-21T00:46:48.575427+0000 mon.a (mon.0) 5769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:49 smithi049 bash[23528]: audit 2024-09-21T00:46:48.586562+0000 mon.a (mon.0) 5770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:49 smithi049 bash[23528]: audit 2024-09-21T00:46:48.709602+0000 mon.a (mon.0) 5771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:49 smithi049 bash[23528]: audit 2024-09-21T00:46:48.718235+0000 mon.a (mon.0) 5772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:49 smithi049 bash[23528]: audit 2024-09-21T00:46:48.726140+0000 mon.a (mon.0) 5773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:46:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:49 smithi049 bash[23528]: cluster 2024-09-21T00:46:48.829552+0000 mgr.a (mgr.14388) 6590 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:46:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:51.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:51.412 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:52.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:51 smithi049 bash[23528]: cluster 2024-09-21T00:46:50.831541+0000 mgr.a (mgr.14388) 6591 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:52.195 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:51 smithi044 bash[22676]: cluster 2024-09-21T00:46:50.831541+0000 mgr.a (mgr.14388) 6591 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:51 smithi179 bash[23186]: cluster 2024-09-21T00:46:50.831541+0000 mgr.a (mgr.14388) 6591 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:52 smithi044 bash[22676]: audit 2024-09-21T00:46:51.745812+0000 mgr.a (mgr.14388) 6592 : audit [DBG] from='client.150666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:52 smithi179 bash[23186]: audit 2024-09-21T00:46:51.745812+0000 mgr.a (mgr.14388) 6592 : audit [DBG] from='client.150666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:52 smithi049 bash[23528]: audit 2024-09-21T00:46:51.745812+0000 mgr.a (mgr.14388) 6592 : audit [DBG] from='client.150666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:53 smithi044 bash[22676]: cluster 2024-09-21T00:46:52.832482+0000 mgr.a (mgr.14388) 6593 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:53 smithi179 bash[23186]: cluster 2024-09-21T00:46:52.832482+0000 mgr.a (mgr.14388) 6593 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:54.271 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:53 smithi049 bash[23528]: cluster 2024-09-21T00:46:52.832482+0000 mgr.a (mgr.14388) 6593 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:54 smithi044 bash[22676]: cluster 2024-09-21T00:46:54.833307+0000 mgr.a (mgr.14388) 6594 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:54 smithi179 bash[23186]: cluster 2024-09-21T00:46:54.833307+0000 mgr.a (mgr.14388) 6594 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:55.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:54 smithi049 bash[23528]: cluster 2024-09-21T00:46:54.833307+0000 mgr.a (mgr.14388) 6594 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:46:57.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:46:57.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:46:57.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:46:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:46:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:46:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:46:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:46:57.995 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:46:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:57 smithi044 bash[22676]: cluster 2024-09-21T00:46:56.835517+0000 mgr.a (mgr.14388) 6595 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:57 smithi179 bash[23186]: cluster 2024-09-21T00:46:56.835517+0000 mgr.a (mgr.14388) 6595 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:58.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:57 smithi049 bash[23528]: cluster 2024-09-21T00:46:56.835517+0000 mgr.a (mgr.14388) 6595 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:46:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:58 smithi044 bash[22676]: audit 2024-09-21T00:46:57.538246+0000 mgr.a (mgr.14388) 6596 : audit [DBG] from='client.150741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:58 smithi179 bash[23186]: audit 2024-09-21T00:46:57.538246+0000 mgr.a (mgr.14388) 6596 : audit [DBG] from='client.150741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:46:59.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:58 smithi049 bash[23528]: audit 2024-09-21T00:46:57.538246+0000 mgr.a (mgr.14388) 6596 : audit [DBG] from='client.150741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:46:59 smithi044 bash[22676]: cluster 2024-09-21T00:46:58.836439+0000 mgr.a (mgr.14388) 6597 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:46:59 smithi179 bash[23186]: cluster 2024-09-21T00:46:58.836439+0000 mgr.a (mgr.14388) 6597 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:00.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:46:59 smithi049 bash[23528]: cluster 2024-09-21T00:46:58.836439+0000 mgr.a (mgr.14388) 6597 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:00 smithi044 bash[22676]: cluster 2024-09-21T00:47:00.838677+0000 mgr.a (mgr.14388) 6598 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:00 smithi179 bash[23186]: cluster 2024-09-21T00:47:00.838677+0000 mgr.a (mgr.14388) 6598 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:00 smithi049 bash[23528]: cluster 2024-09-21T00:47:00.838677+0000 mgr.a (mgr.14388) 6598 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:02.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:03.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:03 smithi044 bash[22676]: cluster 2024-09-21T00:47:02.839458+0000 mgr.a (mgr.14388) 6599 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:03 smithi179 bash[23186]: cluster 2024-09-21T00:47:02.839458+0000 mgr.a (mgr.14388) 6599 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:04.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:03 smithi049 bash[23528]: cluster 2024-09-21T00:47:02.839458+0000 mgr.a (mgr.14388) 6599 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:04 smithi044 bash[22676]: audit 2024-09-21T00:47:03.337427+0000 mgr.a (mgr.14388) 6600 : audit [DBG] from='client.150819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:04 smithi179 bash[23186]: audit 2024-09-21T00:47:03.337427+0000 mgr.a (mgr.14388) 6600 : audit [DBG] from='client.150819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:04 smithi049 bash[23528]: audit 2024-09-21T00:47:03.337427+0000 mgr.a (mgr.14388) 6600 : audit [DBG] from='client.150819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:06.100 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:05 smithi044 bash[22676]: cluster 2024-09-21T00:47:04.840382+0000 mgr.a (mgr.14388) 6601 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:05 smithi179 bash[23186]: cluster 2024-09-21T00:47:04.840382+0000 mgr.a (mgr.14388) 6601 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:06.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:05 smithi049 bash[23528]: cluster 2024-09-21T00:47:04.840382+0000 mgr.a (mgr.14388) 6601 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:06 smithi044 bash[22676]: cluster 2024-09-21T00:47:06.842705+0000 mgr.a (mgr.14388) 6602 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:06 smithi179 bash[23186]: cluster 2024-09-21T00:47:06.842705+0000 mgr.a (mgr.14388) 6602 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:06 smithi049 bash[23528]: cluster 2024-09-21T00:47:06.842705+0000 mgr.a (mgr.14388) 6602 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:08 smithi044 bash[22676]: audit 2024-09-21T00:47:07.396427+0000 mon.a (mon.0) 5774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:08 smithi044 bash[22676]: audit 2024-09-21T00:47:07.405197+0000 mon.a (mon.0) 5775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:08 smithi044 bash[22676]: audit 2024-09-21T00:47:07.416608+0000 mon.a (mon.0) 5776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:08 smithi179 bash[23186]: audit 2024-09-21T00:47:07.396427+0000 mon.a (mon.0) 5774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:08 smithi179 bash[23186]: audit 2024-09-21T00:47:07.405197+0000 mon.a (mon.0) 5775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:08 smithi179 bash[23186]: audit 2024-09-21T00:47:07.416608+0000 mon.a (mon.0) 5776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:08.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:08.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:08 smithi049 bash[23528]: audit 2024-09-21T00:47:07.396427+0000 mon.a (mon.0) 5774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:08 smithi049 bash[23528]: audit 2024-09-21T00:47:07.405197+0000 mon.a (mon.0) 5775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:08.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:08 smithi049 bash[23528]: audit 2024-09-21T00:47:07.416608+0000 mon.a (mon.0) 5776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:09.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:09.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:09.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:09.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:09.568 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:10.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:09 smithi049 bash[23528]: audit 2024-09-21T00:47:08.771925+0000 mon.a (mon.0) 5777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:09 smithi049 bash[23528]: audit 2024-09-21T00:47:08.780574+0000 mon.a (mon.0) 5778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:09 smithi049 bash[23528]: audit 2024-09-21T00:47:08.792877+0000 mon.a (mon.0) 5779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:09 smithi049 bash[23528]: cluster 2024-09-21T00:47:08.843412+0000 mgr.a (mgr.14388) 6603 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:09 smithi049 bash[23528]: audit 2024-09-21T00:47:08.906606+0000 mon.a (mon.0) 5780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:09 smithi049 bash[23528]: audit 2024-09-21T00:47:08.912172+0000 mon.a (mon.0) 5781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:09 smithi049 bash[23528]: audit 2024-09-21T00:47:08.919473+0000 mon.a (mon.0) 5782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:09 smithi044 bash[22676]: audit 2024-09-21T00:47:08.771925+0000 mon.a (mon.0) 5777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:09 smithi044 bash[22676]: audit 2024-09-21T00:47:08.780574+0000 mon.a (mon.0) 5778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:09 smithi044 bash[22676]: audit 2024-09-21T00:47:08.792877+0000 mon.a (mon.0) 5779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:09 smithi044 bash[22676]: cluster 2024-09-21T00:47:08.843412+0000 mgr.a (mgr.14388) 6603 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:09 smithi044 bash[22676]: audit 2024-09-21T00:47:08.906606+0000 mon.a (mon.0) 5780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:09 smithi044 bash[22676]: audit 2024-09-21T00:47:08.912172+0000 mon.a (mon.0) 5781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:09 smithi044 bash[22676]: audit 2024-09-21T00:47:08.919473+0000 mon.a (mon.0) 5782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:09 smithi179 bash[23186]: audit 2024-09-21T00:47:08.771925+0000 mon.a (mon.0) 5777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:09 smithi179 bash[23186]: audit 2024-09-21T00:47:08.780574+0000 mon.a (mon.0) 5778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:09 smithi179 bash[23186]: audit 2024-09-21T00:47:08.792877+0000 mon.a (mon.0) 5779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:09 smithi179 bash[23186]: cluster 2024-09-21T00:47:08.843412+0000 mgr.a (mgr.14388) 6603 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:09 smithi179 bash[23186]: audit 2024-09-21T00:47:08.906606+0000 mon.a (mon.0) 5780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:09 smithi179 bash[23186]: audit 2024-09-21T00:47:08.912172+0000 mon.a (mon.0) 5781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:09 smithi179 bash[23186]: audit 2024-09-21T00:47:08.919473+0000 mon.a (mon.0) 5782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:10 smithi049 bash[23528]: audit 2024-09-21T00:47:09.119985+0000 mgr.a (mgr.14388) 6604 : audit [DBG] from='client.150897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:10 smithi044 bash[22676]: audit 2024-09-21T00:47:09.119985+0000 mgr.a (mgr.14388) 6604 : audit [DBG] from='client.150897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:10 smithi179 bash[23186]: audit 2024-09-21T00:47:09.119985+0000 mgr.a (mgr.14388) 6604 : audit [DBG] from='client.150897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:12.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:11 smithi049 bash[23528]: cluster 2024-09-21T00:47:10.845821+0000 mgr.a (mgr.14388) 6605 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:11 smithi044 bash[22676]: cluster 2024-09-21T00:47:10.845821+0000 mgr.a (mgr.14388) 6605 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:11 smithi179 bash[23186]: cluster 2024-09-21T00:47:10.845821+0000 mgr.a (mgr.14388) 6605 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:12 smithi049 bash[23528]: cluster 2024-09-21T00:47:12.846593+0000 mgr.a (mgr.14388) 6606 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:12 smithi044 bash[22676]: cluster 2024-09-21T00:47:12.846593+0000 mgr.a (mgr.14388) 6606 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:12 smithi179 bash[23186]: cluster 2024-09-21T00:47:12.846593+0000 mgr.a (mgr.14388) 6606 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:14 smithi044 bash[22676]: cluster 2024-09-21T00:47:14.847093+0000 mgr.a (mgr.14388) 6607 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:14 smithi179 bash[23186]: cluster 2024-09-21T00:47:14.847093+0000 mgr.a (mgr.14388) 6607 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:15.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:14 smithi049 bash[23528]: cluster 2024-09-21T00:47:14.847093+0000 mgr.a (mgr.14388) 6607 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:15.340 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:15.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:15 smithi044 bash[22676]: audit 2024-09-21T00:47:14.905681+0000 mgr.a (mgr.14388) 6608 : audit [DBG] from='client.150975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:15 smithi179 bash[23186]: audit 2024-09-21T00:47:14.905681+0000 mgr.a (mgr.14388) 6608 : audit [DBG] from='client.150975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:16.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:15 smithi049 bash[23528]: audit 2024-09-21T00:47:14.905681+0000 mgr.a (mgr.14388) 6608 : audit [DBG] from='client.150975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:16 smithi044 bash[22676]: cluster 2024-09-21T00:47:16.849839+0000 mgr.a (mgr.14388) 6609 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:16 smithi179 bash[23186]: cluster 2024-09-21T00:47:16.849839+0000 mgr.a (mgr.14388) 6609 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:17.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:16 smithi049 bash[23528]: cluster 2024-09-21T00:47:16.849839+0000 mgr.a (mgr.14388) 6609 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:18 smithi044 bash[22676]: cluster 2024-09-21T00:47:18.850650+0000 mgr.a (mgr.14388) 6610 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:47:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:18 smithi179 bash[23186]: cluster 2024-09-21T00:47:18.850650+0000 mgr.a (mgr.14388) 6610 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:47:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:18 smithi049 bash[23528]: cluster 2024-09-21T00:47:18.850650+0000 mgr.a (mgr.14388) 6610 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:47:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:19 smithi044 bash[22676]: audit 2024-09-21T00:47:19.872080+0000 mon.a (mon.0) 5783 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:19 smithi044 bash[22676]: audit 2024-09-21T00:47:19.879329+0000 mon.a (mon.0) 5784 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:47:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:19 smithi044 bash[22676]: audit 2024-09-21T00:47:19.881401+0000 mon.a (mon.0) 5785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:47:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:19 smithi044 bash[22676]: audit 2024-09-21T00:47:19.893893+0000 mon.a (mon.0) 5786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:19 smithi044 bash[22676]: audit 2024-09-21T00:47:19.900309+0000 mon.a (mon.0) 5787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:47:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:19 smithi179 bash[23186]: audit 2024-09-21T00:47:19.872080+0000 mon.a (mon.0) 5783 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:19 smithi179 bash[23186]: audit 2024-09-21T00:47:19.879329+0000 mon.a (mon.0) 5784 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:47:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:19 smithi179 bash[23186]: audit 2024-09-21T00:47:19.881401+0000 mon.a (mon.0) 5785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:47:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:19 smithi179 bash[23186]: audit 2024-09-21T00:47:19.893893+0000 mon.a (mon.0) 5786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:19 smithi179 bash[23186]: audit 2024-09-21T00:47:19.900309+0000 mon.a (mon.0) 5787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:47:20.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:19 smithi049 bash[23528]: audit 2024-09-21T00:47:19.872080+0000 mon.a (mon.0) 5783 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:19 smithi049 bash[23528]: audit 2024-09-21T00:47:19.879329+0000 mon.a (mon.0) 5784 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:47:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:19 smithi049 bash[23528]: audit 2024-09-21T00:47:19.881401+0000 mon.a (mon.0) 5785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:47:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:19 smithi049 bash[23528]: audit 2024-09-21T00:47:19.893893+0000 mon.a (mon.0) 5786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:19 smithi049 bash[23528]: audit 2024-09-21T00:47:19.900309+0000 mon.a (mon.0) 5787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:47:20.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:20.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:20.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:20.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:47:20 smithi044 bash[22930]: debug 2024-09-21T00:47:20.713+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:47:20.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:47:20 smithi044 bash[22930]: debug 2024-09-21T00:47:20.725+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:47:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:20 smithi044 bash[22676]: audit 2024-09-21T00:47:19.902743+0000 mgr.a (mgr.14388) 6611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:47:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:20 smithi044 bash[22676]: audit 2024-09-21T00:47:20.707543+0000 mgr.a (mgr.14388) 6612 : audit [DBG] from='client.151128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:20 smithi044 bash[22676]: audit 2024-09-21T00:47:20.718826+0000 mgr.a (mgr.14388) 6613 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:47:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:20 smithi044 bash[22676]: cephadm 2024-09-21T00:47:20.730315+0000 mgr.a (mgr.14388) 6614 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:47:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:20 smithi044 bash[22676]: cluster 2024-09-21T00:47:20.851957+0000 mgr.a (mgr.14388) 6615 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:21.126 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:20 smithi179 bash[23186]: audit 2024-09-21T00:47:19.902743+0000 mgr.a (mgr.14388) 6611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:47:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:20 smithi179 bash[23186]: audit 2024-09-21T00:47:20.707543+0000 mgr.a (mgr.14388) 6612 : audit [DBG] from='client.151128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:20 smithi179 bash[23186]: audit 2024-09-21T00:47:20.718826+0000 mgr.a (mgr.14388) 6613 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:47:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:20 smithi179 bash[23186]: cephadm 2024-09-21T00:47:20.730315+0000 mgr.a (mgr.14388) 6614 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:47:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:20 smithi179 bash[23186]: cluster 2024-09-21T00:47:20.851957+0000 mgr.a (mgr.14388) 6615 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:20 smithi049 bash[23528]: audit 2024-09-21T00:47:19.902743+0000 mgr.a (mgr.14388) 6611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:47:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:20 smithi049 bash[23528]: audit 2024-09-21T00:47:20.707543+0000 mgr.a (mgr.14388) 6612 : audit [DBG] from='client.151128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:20 smithi049 bash[23528]: audit 2024-09-21T00:47:20.718826+0000 mgr.a (mgr.14388) 6613 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:47:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:20 smithi049 bash[23528]: cephadm 2024-09-21T00:47:20.730315+0000 mgr.a (mgr.14388) 6614 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:47:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:20 smithi049 bash[23528]: cluster 2024-09-21T00:47:20.851957+0000 mgr.a (mgr.14388) 6615 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:22 smithi044 bash[22676]: cluster 2024-09-21T00:47:22.852848+0000 mgr.a (mgr.14388) 6616 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:47:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:22 smithi179 bash[23186]: cluster 2024-09-21T00:47:22.852848+0000 mgr.a (mgr.14388) 6616 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:47:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:22 smithi049 bash[23528]: cluster 2024-09-21T00:47:22.852848+0000 mgr.a (mgr.14388) 6616 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:47:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:24 smithi044 bash[22676]: cluster 2024-09-21T00:47:24.853910+0000 mgr.a (mgr.14388) 6617 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:47:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:24 smithi179 bash[23186]: cluster 2024-09-21T00:47:24.853910+0000 mgr.a (mgr.14388) 6617 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:47:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:24 smithi049 bash[23528]: cluster 2024-09-21T00:47:24.853910+0000 mgr.a (mgr.14388) 6617 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:47:26.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:26.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:26.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:26.876 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:26.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:26.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:26.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:26.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:26 smithi044 bash[22676]: audit 2024-09-21T00:47:26.454089+0000 mgr.a (mgr.14388) 6618 : audit [DBG] from='client.151239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:26 smithi044 bash[22676]: cluster 2024-09-21T00:47:26.855558+0000 mgr.a (mgr.14388) 6619 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:26 smithi179 bash[23186]: audit 2024-09-21T00:47:26.454089+0000 mgr.a (mgr.14388) 6618 : audit [DBG] from='client.151239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:26 smithi179 bash[23186]: cluster 2024-09-21T00:47:26.855558+0000 mgr.a (mgr.14388) 6619 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:26 smithi049 bash[23528]: audit 2024-09-21T00:47:26.454089+0000 mgr.a (mgr.14388) 6618 : audit [DBG] from='client.151239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:27.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:26 smithi049 bash[23528]: cluster 2024-09-21T00:47:26.855558+0000 mgr.a (mgr.14388) 6619 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:28 smithi044 bash[22676]: audit 2024-09-21T00:47:27.633733+0000 mon.a (mon.0) 5788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:28 smithi044 bash[22676]: audit 2024-09-21T00:47:27.642167+0000 mon.a (mon.0) 5789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:28 smithi044 bash[22676]: audit 2024-09-21T00:47:27.652779+0000 mon.a (mon.0) 5790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:28 smithi179 bash[23186]: audit 2024-09-21T00:47:27.633733+0000 mon.a (mon.0) 5788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:28 smithi179 bash[23186]: audit 2024-09-21T00:47:27.642167+0000 mon.a (mon.0) 5789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:28 smithi179 bash[23186]: audit 2024-09-21T00:47:27.652779+0000 mon.a (mon.0) 5790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:28 smithi049 bash[23528]: audit 2024-09-21T00:47:27.633733+0000 mon.a (mon.0) 5788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:28 smithi049 bash[23528]: audit 2024-09-21T00:47:27.642167+0000 mon.a (mon.0) 5789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:28 smithi049 bash[23528]: audit 2024-09-21T00:47:27.652779+0000 mon.a (mon.0) 5790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:29 smithi044 bash[22676]: cluster 2024-09-21T00:47:28.856078+0000 mgr.a (mgr.14388) 6620 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:29 smithi044 bash[22676]: audit 2024-09-21T00:47:28.981008+0000 mon.a (mon.0) 5791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:29 smithi044 bash[22676]: audit 2024-09-21T00:47:28.989589+0000 mon.a (mon.0) 5792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:29 smithi044 bash[22676]: audit 2024-09-21T00:47:29.000096+0000 mon.a (mon.0) 5793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:29 smithi044 bash[22676]: audit 2024-09-21T00:47:29.138269+0000 mon.a (mon.0) 5794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:29 smithi044 bash[22676]: audit 2024-09-21T00:47:29.147168+0000 mon.a (mon.0) 5795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:29 smithi044 bash[22676]: audit 2024-09-21T00:47:29.157107+0000 mon.a (mon.0) 5796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:29 smithi179 bash[23186]: cluster 2024-09-21T00:47:28.856078+0000 mgr.a (mgr.14388) 6620 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:29 smithi179 bash[23186]: audit 2024-09-21T00:47:28.981008+0000 mon.a (mon.0) 5791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:29 smithi179 bash[23186]: audit 2024-09-21T00:47:28.989589+0000 mon.a (mon.0) 5792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:29 smithi179 bash[23186]: audit 2024-09-21T00:47:29.000096+0000 mon.a (mon.0) 5793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:29 smithi179 bash[23186]: audit 2024-09-21T00:47:29.138269+0000 mon.a (mon.0) 5794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:29 smithi179 bash[23186]: audit 2024-09-21T00:47:29.147168+0000 mon.a (mon.0) 5795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:29 smithi179 bash[23186]: audit 2024-09-21T00:47:29.157107+0000 mon.a (mon.0) 5796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:29 smithi049 bash[23528]: cluster 2024-09-21T00:47:28.856078+0000 mgr.a (mgr.14388) 6620 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:29 smithi049 bash[23528]: audit 2024-09-21T00:47:28.981008+0000 mon.a (mon.0) 5791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:29 smithi049 bash[23528]: audit 2024-09-21T00:47:28.989589+0000 mon.a (mon.0) 5792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:29 smithi049 bash[23528]: audit 2024-09-21T00:47:29.000096+0000 mon.a (mon.0) 5793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:29 smithi049 bash[23528]: audit 2024-09-21T00:47:29.138269+0000 mon.a (mon.0) 5794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:29 smithi049 bash[23528]: audit 2024-09-21T00:47:29.147168+0000 mon.a (mon.0) 5795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:29 smithi049 bash[23528]: audit 2024-09-21T00:47:29.157107+0000 mon.a (mon.0) 5796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:30 smithi044 bash[22676]: cluster 2024-09-21T00:47:30.858044+0000 mgr.a (mgr.14388) 6621 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:30 smithi179 bash[23186]: cluster 2024-09-21T00:47:30.858044+0000 mgr.a (mgr.14388) 6621 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:31.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:30 smithi049 bash[23528]: cluster 2024-09-21T00:47:30.858044+0000 mgr.a (mgr.14388) 6621 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:31.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:31.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:32.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:32 smithi044 bash[22676]: audit 2024-09-21T00:47:32.213677+0000 mgr.a (mgr.14388) 6622 : audit [DBG] from='client.151317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:32 smithi044 bash[22676]: cluster 2024-09-21T00:47:32.859237+0000 mgr.a (mgr.14388) 6623 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:32 smithi179 bash[23186]: audit 2024-09-21T00:47:32.213677+0000 mgr.a (mgr.14388) 6622 : audit [DBG] from='client.151317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:32 smithi179 bash[23186]: cluster 2024-09-21T00:47:32.859237+0000 mgr.a (mgr.14388) 6623 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:33.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:32 smithi049 bash[23528]: audit 2024-09-21T00:47:32.213677+0000 mgr.a (mgr.14388) 6622 : audit [DBG] from='client.151317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:32 smithi049 bash[23528]: cluster 2024-09-21T00:47:32.859237+0000 mgr.a (mgr.14388) 6623 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:34 smithi044 bash[22676]: cluster 2024-09-21T00:47:34.860229+0000 mgr.a (mgr.14388) 6624 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:34 smithi179 bash[23186]: cluster 2024-09-21T00:47:34.860229+0000 mgr.a (mgr.14388) 6624 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:35.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:34 smithi049 bash[23528]: cluster 2024-09-21T00:47:34.860229+0000 mgr.a (mgr.14388) 6624 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:36 smithi044 bash[22676]: cluster 2024-09-21T00:47:36.862510+0000 mgr.a (mgr.14388) 6625 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:36 smithi179 bash[23186]: cluster 2024-09-21T00:47:36.862510+0000 mgr.a (mgr.14388) 6625 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:36 smithi049 bash[23528]: cluster 2024-09-21T00:47:36.862510+0000 mgr.a (mgr.14388) 6625 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:47:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:38.447 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:39.211 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:38 smithi179 bash[23186]: audit 2024-09-21T00:47:38.009955+0000 mgr.a (mgr.14388) 6626 : audit [DBG] from='client.151392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:39.212 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:38 smithi179 bash[23186]: cluster 2024-09-21T00:47:38.863386+0000 mgr.a (mgr.14388) 6627 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:39.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:38 smithi049 bash[23528]: audit 2024-09-21T00:47:38.009955+0000 mgr.a (mgr.14388) 6626 : audit [DBG] from='client.151392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:38 smithi049 bash[23528]: cluster 2024-09-21T00:47:38.863386+0000 mgr.a (mgr.14388) 6627 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:39.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:38 smithi044 bash[22676]: audit 2024-09-21T00:47:38.009955+0000 mgr.a (mgr.14388) 6626 : audit [DBG] from='client.151392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:39.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:38 smithi044 bash[22676]: cluster 2024-09-21T00:47:38.863386+0000 mgr.a (mgr.14388) 6627 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:40 smithi044 bash[22676]: cluster 2024-09-21T00:47:40.865589+0000 mgr.a (mgr.14388) 6628 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:40 smithi179 bash[23186]: cluster 2024-09-21T00:47:40.865589+0000 mgr.a (mgr.14388) 6628 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:40 smithi049 bash[23528]: cluster 2024-09-21T00:47:40.865589+0000 mgr.a (mgr.14388) 6628 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:42 smithi044 bash[22676]: cluster 2024-09-21T00:47:42.866360+0000 mgr.a (mgr.14388) 6629 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:42 smithi179 bash[23186]: cluster 2024-09-21T00:47:42.866360+0000 mgr.a (mgr.14388) 6629 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:42 smithi049 bash[23528]: cluster 2024-09-21T00:47:42.866360+0000 mgr.a (mgr.14388) 6629 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:44.230 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:43 smithi044 bash[22676]: audit 2024-09-21T00:47:43.786421+0000 mgr.a (mgr.14388) 6630 : audit [DBG] from='client.151470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:44.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:43 smithi179 bash[23186]: audit 2024-09-21T00:47:43.786421+0000 mgr.a (mgr.14388) 6630 : audit [DBG] from='client.151470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:44.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:43 smithi049 bash[23528]: audit 2024-09-21T00:47:43.786421+0000 mgr.a (mgr.14388) 6630 : audit [DBG] from='client.151470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:44 smithi044 bash[22676]: cluster 2024-09-21T00:47:44.867336+0000 mgr.a (mgr.14388) 6631 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:44 smithi179 bash[23186]: cluster 2024-09-21T00:47:44.867336+0000 mgr.a (mgr.14388) 6631 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:45.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:44 smithi049 bash[23528]: cluster 2024-09-21T00:47:44.867336+0000 mgr.a (mgr.14388) 6631 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:46 smithi044 bash[22676]: cluster 2024-09-21T00:47:46.868905+0000 mgr.a (mgr.14388) 6632 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:46 smithi179 bash[23186]: cluster 2024-09-21T00:47:46.868905+0000 mgr.a (mgr.14388) 6632 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:47.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:46 smithi049 bash[23528]: cluster 2024-09-21T00:47:46.868905+0000 mgr.a (mgr.14388) 6632 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:47:49.213 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:48 smithi044 bash[22676]: audit 2024-09-21T00:47:47.800837+0000 mon.a (mon.0) 5797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:48 smithi044 bash[22676]: audit 2024-09-21T00:47:47.805802+0000 mon.a (mon.0) 5798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:48 smithi044 bash[22676]: audit 2024-09-21T00:47:47.811421+0000 mon.a (mon.0) 5799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:48 smithi179 bash[23186]: audit 2024-09-21T00:47:47.800837+0000 mon.a (mon.0) 5797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:48 smithi179 bash[23186]: audit 2024-09-21T00:47:47.805802+0000 mon.a (mon.0) 5798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:48 smithi179 bash[23186]: audit 2024-09-21T00:47:47.811421+0000 mon.a (mon.0) 5799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:48 smithi049 bash[23528]: audit 2024-09-21T00:47:47.800837+0000 mon.a (mon.0) 5797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:48 smithi049 bash[23528]: audit 2024-09-21T00:47:47.805802+0000 mon.a (mon.0) 5798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:49.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:48 smithi049 bash[23528]: audit 2024-09-21T00:47:47.811421+0000 mon.a (mon.0) 5799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.012 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:50.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:49 smithi044 bash[22676]: cluster 2024-09-21T00:47:48.869821+0000 mgr.a (mgr.14388) 6633 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:49 smithi044 bash[22676]: audit 2024-09-21T00:47:49.192847+0000 mon.a (mon.0) 5800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:49 smithi044 bash[22676]: audit 2024-09-21T00:47:49.201086+0000 mon.a (mon.0) 5801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:49 smithi044 bash[22676]: audit 2024-09-21T00:47:49.211363+0000 mon.a (mon.0) 5802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:49 smithi044 bash[22676]: audit 2024-09-21T00:47:49.350932+0000 mon.a (mon.0) 5803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:49 smithi044 bash[22676]: audit 2024-09-21T00:47:49.356386+0000 mon.a (mon.0) 5804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:49 smithi044 bash[22676]: audit 2024-09-21T00:47:49.361750+0000 mon.a (mon.0) 5805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:49 smithi179 bash[23186]: cluster 2024-09-21T00:47:48.869821+0000 mgr.a (mgr.14388) 6633 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:49 smithi179 bash[23186]: audit 2024-09-21T00:47:49.192847+0000 mon.a (mon.0) 5800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:49 smithi179 bash[23186]: audit 2024-09-21T00:47:49.201086+0000 mon.a (mon.0) 5801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:49 smithi179 bash[23186]: audit 2024-09-21T00:47:49.211363+0000 mon.a (mon.0) 5802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:49 smithi179 bash[23186]: audit 2024-09-21T00:47:49.350932+0000 mon.a (mon.0) 5803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:49 smithi179 bash[23186]: audit 2024-09-21T00:47:49.356386+0000 mon.a (mon.0) 5804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:49 smithi179 bash[23186]: audit 2024-09-21T00:47:49.361750+0000 mon.a (mon.0) 5805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:49 smithi049 bash[23528]: cluster 2024-09-21T00:47:48.869821+0000 mgr.a (mgr.14388) 6633 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:49 smithi049 bash[23528]: audit 2024-09-21T00:47:49.192847+0000 mon.a (mon.0) 5800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:49 smithi049 bash[23528]: audit 2024-09-21T00:47:49.201086+0000 mon.a (mon.0) 5801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:49 smithi049 bash[23528]: audit 2024-09-21T00:47:49.211363+0000 mon.a (mon.0) 5802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:49 smithi049 bash[23528]: audit 2024-09-21T00:47:49.350932+0000 mon.a (mon.0) 5803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:49 smithi049 bash[23528]: audit 2024-09-21T00:47:49.356386+0000 mon.a (mon.0) 5804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:49 smithi049 bash[23528]: audit 2024-09-21T00:47:49.361750+0000 mon.a (mon.0) 5805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:47:51.106 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:50 smithi049 bash[23528]: audit 2024-09-21T00:47:49.565158+0000 mgr.a (mgr.14388) 6634 : audit [DBG] from='client.151548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:50 smithi044 bash[22676]: audit 2024-09-21T00:47:49.565158+0000 mgr.a (mgr.14388) 6634 : audit [DBG] from='client.151548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:50 smithi179 bash[23186]: audit 2024-09-21T00:47:49.565158+0000 mgr.a (mgr.14388) 6634 : audit [DBG] from='client.151548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:52.146 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:51 smithi049 bash[23528]: cluster 2024-09-21T00:47:50.872244+0000 mgr.a (mgr.14388) 6635 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:47:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:51 smithi044 bash[22676]: cluster 2024-09-21T00:47:50.872244+0000 mgr.a (mgr.14388) 6635 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:47:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:51 smithi179 bash[23186]: cluster 2024-09-21T00:47:50.872244+0000 mgr.a (mgr.14388) 6635 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:47:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:52 smithi044 bash[22676]: cluster 2024-09-21T00:47:52.873017+0000 mgr.a (mgr.14388) 6636 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:47:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:52 smithi179 bash[23186]: cluster 2024-09-21T00:47:52.873017+0000 mgr.a (mgr.14388) 6636 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:47:53.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:52 smithi049 bash[23528]: cluster 2024-09-21T00:47:52.873017+0000 mgr.a (mgr.14388) 6636 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:47:55.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:47:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:47:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:47:55.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:54 smithi049 bash[23528]: cluster 2024-09-21T00:47:54.873800+0000 mgr.a (mgr.14388) 6637 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:47:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:54 smithi044 bash[22676]: cluster 2024-09-21T00:47:54.873800+0000 mgr.a (mgr.14388) 6637 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:47:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:54 smithi179 bash[23186]: cluster 2024-09-21T00:47:54.873800+0000 mgr.a (mgr.14388) 6637 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:47:55.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:47:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:47:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:47:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:47:55.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:47:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:55 smithi044 bash[22676]: audit 2024-09-21T00:47:55.347509+0000 mgr.a (mgr.14388) 6638 : audit [DBG] from='client.151626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:55 smithi179 bash[23186]: audit 2024-09-21T00:47:55.347509+0000 mgr.a (mgr.14388) 6638 : audit [DBG] from='client.151626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:56.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:55 smithi049 bash[23528]: audit 2024-09-21T00:47:55.347509+0000 mgr.a (mgr.14388) 6638 : audit [DBG] from='client.151626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:56 smithi044 bash[22676]: cluster 2024-09-21T00:47:56.876524+0000 mgr.a (mgr.14388) 6639 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:56 smithi179 bash[23186]: cluster 2024-09-21T00:47:56.876524+0000 mgr.a (mgr.14388) 6639 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:57.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:56 smithi049 bash[23528]: cluster 2024-09-21T00:47:56.876524+0000 mgr.a (mgr.14388) 6639 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:47:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:47:58 smithi044 bash[22676]: cluster 2024-09-21T00:47:58.877345+0000 mgr.a (mgr.14388) 6640 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:47:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:47:58 smithi179 bash[23186]: cluster 2024-09-21T00:47:58.877345+0000 mgr.a (mgr.14388) 6640 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:47:59.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:47:58 smithi049 bash[23528]: cluster 2024-09-21T00:47:58.877345+0000 mgr.a (mgr.14388) 6640 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:48:00.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:00.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:00.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:00 smithi044 bash[22676]: cluster 2024-09-21T00:48:00.878326+0000 mgr.a (mgr.14388) 6641 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:00 smithi179 bash[23186]: cluster 2024-09-21T00:48:00.878326+0000 mgr.a (mgr.14388) 6641 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:00 smithi049 bash[23528]: cluster 2024-09-21T00:48:00.878326+0000 mgr.a (mgr.14388) 6641 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:01.561 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:01.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:01.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:01.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:01.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:01 smithi044 bash[22676]: audit 2024-09-21T00:48:01.123396+0000 mgr.a (mgr.14388) 6642 : audit [DBG] from='client.151704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:01 smithi179 bash[23186]: audit 2024-09-21T00:48:01.123396+0000 mgr.a (mgr.14388) 6642 : audit [DBG] from='client.151704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:02.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:01 smithi049 bash[23528]: audit 2024-09-21T00:48:01.123396+0000 mgr.a (mgr.14388) 6642 : audit [DBG] from='client.151704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:02 smithi044 bash[22676]: cluster 2024-09-21T00:48:02.879204+0000 mgr.a (mgr.14388) 6643 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:48:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:02 smithi179 bash[23186]: cluster 2024-09-21T00:48:02.879204+0000 mgr.a (mgr.14388) 6643 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:48:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:02 smithi049 bash[23528]: cluster 2024-09-21T00:48:02.879204+0000 mgr.a (mgr.14388) 6643 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:48:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:04 smithi044 bash[22676]: cluster 2024-09-21T00:48:04.879979+0000 mgr.a (mgr.14388) 6644 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:48:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:04 smithi179 bash[23186]: cluster 2024-09-21T00:48:04.879979+0000 mgr.a (mgr.14388) 6644 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:48:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:04 smithi049 bash[23528]: cluster 2024-09-21T00:48:04.879979+0000 mgr.a (mgr.14388) 6644 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:48:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:06 smithi044 bash[22676]: cluster 2024-09-21T00:48:06.881617+0000 mgr.a (mgr.14388) 6645 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:48:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:06 smithi179 bash[23186]: cluster 2024-09-21T00:48:06.881617+0000 mgr.a (mgr.14388) 6645 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:48:07.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:06 smithi049 bash[23528]: cluster 2024-09-21T00:48:06.881617+0000 mgr.a (mgr.14388) 6645 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:48:07.364 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:07 smithi044 bash[22676]: audit 2024-09-21T00:48:06.916609+0000 mgr.a (mgr.14388) 6646 : audit [DBG] from='client.151779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:07 smithi179 bash[23186]: audit 2024-09-21T00:48:06.916609+0000 mgr.a (mgr.14388) 6646 : audit [DBG] from='client.151779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:08.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:07 smithi049 bash[23528]: audit 2024-09-21T00:48:06.916609+0000 mgr.a (mgr.14388) 6646 : audit [DBG] from='client.151779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:08 smithi179 bash[23186]: audit 2024-09-21T00:48:07.990014+0000 mon.a (mon.0) 5806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:08 smithi179 bash[23186]: audit 2024-09-21T00:48:07.998568+0000 mon.a (mon.0) 5807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:08 smithi179 bash[23186]: audit 2024-09-21T00:48:08.007624+0000 mon.a (mon.0) 5808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:08 smithi179 bash[23186]: cluster 2024-09-21T00:48:08.882508+0000 mgr.a (mgr.14388) 6647 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:08 smithi049 bash[23528]: audit 2024-09-21T00:48:07.990014+0000 mon.a (mon.0) 5806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:08 smithi049 bash[23528]: audit 2024-09-21T00:48:07.998568+0000 mon.a (mon.0) 5807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:08 smithi049 bash[23528]: audit 2024-09-21T00:48:08.007624+0000 mon.a (mon.0) 5808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:08 smithi049 bash[23528]: cluster 2024-09-21T00:48:08.882508+0000 mgr.a (mgr.14388) 6647 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:09.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:08 smithi044 bash[22676]: audit 2024-09-21T00:48:07.990014+0000 mon.a (mon.0) 5806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:08 smithi044 bash[22676]: audit 2024-09-21T00:48:07.998568+0000 mon.a (mon.0) 5807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:08 smithi044 bash[22676]: audit 2024-09-21T00:48:08.007624+0000 mon.a (mon.0) 5808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:09.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:08 smithi044 bash[22676]: cluster 2024-09-21T00:48:08.882508+0000 mgr.a (mgr.14388) 6647 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:10 smithi044 bash[22676]: audit 2024-09-21T00:48:09.391563+0000 mon.a (mon.0) 5809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:10 smithi044 bash[22676]: audit 2024-09-21T00:48:09.400208+0000 mon.a (mon.0) 5810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:10 smithi044 bash[22676]: audit 2024-09-21T00:48:09.410239+0000 mon.a (mon.0) 5811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:10 smithi044 bash[22676]: audit 2024-09-21T00:48:09.544043+0000 mon.a (mon.0) 5812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:10 smithi044 bash[22676]: audit 2024-09-21T00:48:09.552621+0000 mon.a (mon.0) 5813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:10 smithi044 bash[22676]: audit 2024-09-21T00:48:09.562814+0000 mon.a (mon.0) 5814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:10 smithi179 bash[23186]: audit 2024-09-21T00:48:09.391563+0000 mon.a (mon.0) 5809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:10 smithi179 bash[23186]: audit 2024-09-21T00:48:09.400208+0000 mon.a (mon.0) 5810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:10 smithi179 bash[23186]: audit 2024-09-21T00:48:09.410239+0000 mon.a (mon.0) 5811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:10 smithi179 bash[23186]: audit 2024-09-21T00:48:09.544043+0000 mon.a (mon.0) 5812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:10 smithi179 bash[23186]: audit 2024-09-21T00:48:09.552621+0000 mon.a (mon.0) 5813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:10 smithi179 bash[23186]: audit 2024-09-21T00:48:09.562814+0000 mon.a (mon.0) 5814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:10 smithi049 bash[23528]: audit 2024-09-21T00:48:09.391563+0000 mon.a (mon.0) 5809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:10 smithi049 bash[23528]: audit 2024-09-21T00:48:09.400208+0000 mon.a (mon.0) 5810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:10 smithi049 bash[23528]: audit 2024-09-21T00:48:09.410239+0000 mon.a (mon.0) 5811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:10 smithi049 bash[23528]: audit 2024-09-21T00:48:09.544043+0000 mon.a (mon.0) 5812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:10 smithi049 bash[23528]: audit 2024-09-21T00:48:09.552621+0000 mon.a (mon.0) 5813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:10 smithi049 bash[23528]: audit 2024-09-21T00:48:09.562814+0000 mon.a (mon.0) 5814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:11 smithi044 bash[22676]: cluster 2024-09-21T00:48:10.884703+0000 mgr.a (mgr.14388) 6648 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:11 smithi179 bash[23186]: cluster 2024-09-21T00:48:10.884703+0000 mgr.a (mgr.14388) 6648 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:11.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:11 smithi049 bash[23528]: cluster 2024-09-21T00:48:10.884703+0000 mgr.a (mgr.14388) 6648 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:12.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:13.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:12 smithi044 bash[22676]: audit 2024-09-21T00:48:12.710471+0000 mgr.a (mgr.14388) 6649 : audit [DBG] from='client.151854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:12 smithi044 bash[22676]: cluster 2024-09-21T00:48:12.885326+0000 mgr.a (mgr.14388) 6650 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:12 smithi179 bash[23186]: audit 2024-09-21T00:48:12.710471+0000 mgr.a (mgr.14388) 6649 : audit [DBG] from='client.151854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:12 smithi179 bash[23186]: cluster 2024-09-21T00:48:12.885326+0000 mgr.a (mgr.14388) 6650 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:12 smithi049 bash[23528]: audit 2024-09-21T00:48:12.710471+0000 mgr.a (mgr.14388) 6649 : audit [DBG] from='client.151854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:13.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:12 smithi049 bash[23528]: cluster 2024-09-21T00:48:12.885326+0000 mgr.a (mgr.14388) 6650 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:15.231 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:14 smithi049 bash[23528]: cluster 2024-09-21T00:48:14.886313+0000 mgr.a (mgr.14388) 6651 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:14 smithi044 bash[22676]: cluster 2024-09-21T00:48:14.886313+0000 mgr.a (mgr.14388) 6651 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:14 smithi179 bash[23186]: cluster 2024-09-21T00:48:14.886313+0000 mgr.a (mgr.14388) 6651 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:16 smithi044 bash[22676]: cluster 2024-09-21T00:48:16.888566+0000 mgr.a (mgr.14388) 6652 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:16 smithi179 bash[23186]: cluster 2024-09-21T00:48:16.888566+0000 mgr.a (mgr.14388) 6652 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:17.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:16 smithi049 bash[23528]: cluster 2024-09-21T00:48:16.888566+0000 mgr.a (mgr.14388) 6652 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:18.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:18.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:18.925 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:18 smithi044 bash[22676]: audit 2024-09-21T00:48:18.477734+0000 mgr.a (mgr.14388) 6653 : audit [DBG] from='client.151929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:18 smithi044 bash[22676]: cluster 2024-09-21T00:48:18.889133+0000 mgr.a (mgr.14388) 6654 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:18 smithi179 bash[23186]: audit 2024-09-21T00:48:18.477734+0000 mgr.a (mgr.14388) 6653 : audit [DBG] from='client.151929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:18 smithi179 bash[23186]: cluster 2024-09-21T00:48:18.889133+0000 mgr.a (mgr.14388) 6654 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:18 smithi049 bash[23528]: audit 2024-09-21T00:48:18.477734+0000 mgr.a (mgr.14388) 6653 : audit [DBG] from='client.151929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:18 smithi049 bash[23528]: cluster 2024-09-21T00:48:18.889133+0000 mgr.a (mgr.14388) 6654 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:20 smithi044 bash[22676]: audit 2024-09-21T00:48:20.784152+0000 mon.a (mon.0) 5815 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:48:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:20 smithi044 bash[22676]: audit 2024-09-21T00:48:20.795328+0000 mon.a (mon.0) 5816 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:48:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:20 smithi044 bash[22676]: audit 2024-09-21T00:48:20.797272+0000 mon.a (mon.0) 5817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:48:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:20 smithi044 bash[22676]: audit 2024-09-21T00:48:20.808863+0000 mon.a (mon.0) 5818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:20 smithi044 bash[22676]: audit 2024-09-21T00:48:20.815347+0000 mon.a (mon.0) 5819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:48:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:20 smithi179 bash[23186]: audit 2024-09-21T00:48:20.784152+0000 mon.a (mon.0) 5815 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:48:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:20 smithi179 bash[23186]: audit 2024-09-21T00:48:20.795328+0000 mon.a (mon.0) 5816 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:48:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:20 smithi179 bash[23186]: audit 2024-09-21T00:48:20.797272+0000 mon.a (mon.0) 5817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:48:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:20 smithi179 bash[23186]: audit 2024-09-21T00:48:20.808863+0000 mon.a (mon.0) 5818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:20 smithi179 bash[23186]: audit 2024-09-21T00:48:20.815347+0000 mon.a (mon.0) 5819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:48:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:20 smithi049 bash[23528]: audit 2024-09-21T00:48:20.784152+0000 mon.a (mon.0) 5815 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:48:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:20 smithi049 bash[23528]: audit 2024-09-21T00:48:20.795328+0000 mon.a (mon.0) 5816 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:48:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:20 smithi049 bash[23528]: audit 2024-09-21T00:48:20.797272+0000 mon.a (mon.0) 5817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:48:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:20 smithi049 bash[23528]: audit 2024-09-21T00:48:20.808863+0000 mon.a (mon.0) 5818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:20 smithi049 bash[23528]: audit 2024-09-21T00:48:20.815347+0000 mon.a (mon.0) 5819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:48:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:21 smithi044 bash[22676]: audit 2024-09-21T00:48:20.817801+0000 mgr.a (mgr.14388) 6655 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:48:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:21 smithi044 bash[22676]: cluster 2024-09-21T00:48:20.890975+0000 mgr.a (mgr.14388) 6656 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:21.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:48:21 smithi044 bash[22930]: debug 2024-09-21T00:48:21.600+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:48:21.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:48:21 smithi044 bash[22930]: debug 2024-09-21T00:48:21.600+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:48:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:21 smithi179 bash[23186]: audit 2024-09-21T00:48:20.817801+0000 mgr.a (mgr.14388) 6655 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:48:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:21 smithi179 bash[23186]: cluster 2024-09-21T00:48:20.890975+0000 mgr.a (mgr.14388) 6656 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:22.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:21 smithi049 bash[23528]: audit 2024-09-21T00:48:20.817801+0000 mgr.a (mgr.14388) 6655 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:48:22.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:21 smithi049 bash[23528]: cluster 2024-09-21T00:48:20.890975+0000 mgr.a (mgr.14388) 6656 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:22 smithi044 bash[22676]: audit 2024-09-21T00:48:21.601509+0000 mgr.a (mgr.14388) 6657 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:48:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:22 smithi044 bash[22676]: cephadm 2024-09-21T00:48:21.602712+0000 mgr.a (mgr.14388) 6658 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:48:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:22 smithi179 bash[23186]: audit 2024-09-21T00:48:21.601509+0000 mgr.a (mgr.14388) 6657 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:48:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:22 smithi179 bash[23186]: cephadm 2024-09-21T00:48:21.602712+0000 mgr.a (mgr.14388) 6658 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:48:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:22 smithi049 bash[23528]: audit 2024-09-21T00:48:21.601509+0000 mgr.a (mgr.14388) 6657 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:48:23.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:22 smithi049 bash[23528]: cephadm 2024-09-21T00:48:21.602712+0000 mgr.a (mgr.14388) 6658 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:48:23.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:23.927 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:23.927 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:24.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:23 smithi044 bash[22676]: cluster 2024-09-21T00:48:22.891923+0000 mgr.a (mgr.14388) 6659 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:23 smithi179 bash[23186]: cluster 2024-09-21T00:48:22.891923+0000 mgr.a (mgr.14388) 6659 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:24.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:23 smithi049 bash[23528]: cluster 2024-09-21T00:48:22.891923+0000 mgr.a (mgr.14388) 6659 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:24.697 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:24.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:24.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:24.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:24.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:24 smithi044 bash[22676]: audit 2024-09-21T00:48:24.263257+0000 mgr.a (mgr.14388) 6660 : audit [DBG] from='client.152112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:24 smithi044 bash[22676]: cluster 2024-09-21T00:48:24.892823+0000 mgr.a (mgr.14388) 6661 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:24 smithi179 bash[23186]: audit 2024-09-21T00:48:24.263257+0000 mgr.a (mgr.14388) 6660 : audit [DBG] from='client.152112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:24 smithi179 bash[23186]: cluster 2024-09-21T00:48:24.892823+0000 mgr.a (mgr.14388) 6661 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:24 smithi049 bash[23528]: audit 2024-09-21T00:48:24.263257+0000 mgr.a (mgr.14388) 6660 : audit [DBG] from='client.152112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:24 smithi049 bash[23528]: cluster 2024-09-21T00:48:24.892823+0000 mgr.a (mgr.14388) 6661 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:26 smithi044 bash[22676]: cluster 2024-09-21T00:48:26.894323+0000 mgr.a (mgr.14388) 6662 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:26 smithi179 bash[23186]: cluster 2024-09-21T00:48:26.894323+0000 mgr.a (mgr.14388) 6662 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:27.298 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:26 smithi049 bash[23528]: cluster 2024-09-21T00:48:26.894323+0000 mgr.a (mgr.14388) 6662 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:29 smithi044 bash[22676]: audit 2024-09-21T00:48:28.183801+0000 mon.a (mon.0) 5820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:29 smithi044 bash[22676]: audit 2024-09-21T00:48:28.194438+0000 mon.a (mon.0) 5821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:29 smithi044 bash[22676]: audit 2024-09-21T00:48:28.204891+0000 mon.a (mon.0) 5822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:29 smithi044 bash[22676]: cluster 2024-09-21T00:48:28.895053+0000 mgr.a (mgr.14388) 6663 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:29 smithi179 bash[23186]: audit 2024-09-21T00:48:28.183801+0000 mon.a (mon.0) 5820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:29 smithi179 bash[23186]: audit 2024-09-21T00:48:28.194438+0000 mon.a (mon.0) 5821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:29 smithi179 bash[23186]: audit 2024-09-21T00:48:28.204891+0000 mon.a (mon.0) 5822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:29 smithi179 bash[23186]: cluster 2024-09-21T00:48:28.895053+0000 mgr.a (mgr.14388) 6663 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:29.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:29 smithi049 bash[23528]: audit 2024-09-21T00:48:28.183801+0000 mon.a (mon.0) 5820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:29 smithi049 bash[23528]: audit 2024-09-21T00:48:28.194438+0000 mon.a (mon.0) 5821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:29 smithi049 bash[23528]: audit 2024-09-21T00:48:28.204891+0000 mon.a (mon.0) 5822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:29.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:29 smithi049 bash[23528]: cluster 2024-09-21T00:48:28.895053+0000 mgr.a (mgr.14388) 6663 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:29.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:29.700 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:29.700 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:30.506 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:30.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:30.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:30.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:30.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:30 smithi044 bash[22676]: audit 2024-09-21T00:48:29.627796+0000 mon.a (mon.0) 5823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:30 smithi044 bash[22676]: audit 2024-09-21T00:48:29.634822+0000 mon.a (mon.0) 5824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:30 smithi044 bash[22676]: audit 2024-09-21T00:48:29.642948+0000 mon.a (mon.0) 5825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:30 smithi044 bash[22676]: audit 2024-09-21T00:48:29.776446+0000 mon.a (mon.0) 5826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:30 smithi044 bash[22676]: audit 2024-09-21T00:48:29.786342+0000 mon.a (mon.0) 5827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:30 smithi044 bash[22676]: audit 2024-09-21T00:48:29.797283+0000 mon.a (mon.0) 5828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:30 smithi179 bash[23186]: audit 2024-09-21T00:48:29.627796+0000 mon.a (mon.0) 5823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:30 smithi179 bash[23186]: audit 2024-09-21T00:48:29.634822+0000 mon.a (mon.0) 5824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:30 smithi179 bash[23186]: audit 2024-09-21T00:48:29.642948+0000 mon.a (mon.0) 5825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:30 smithi179 bash[23186]: audit 2024-09-21T00:48:29.776446+0000 mon.a (mon.0) 5826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:30 smithi179 bash[23186]: audit 2024-09-21T00:48:29.786342+0000 mon.a (mon.0) 5827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:30 smithi179 bash[23186]: audit 2024-09-21T00:48:29.797283+0000 mon.a (mon.0) 5828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:30 smithi049 bash[23528]: audit 2024-09-21T00:48:29.627796+0000 mon.a (mon.0) 5823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:30 smithi049 bash[23528]: audit 2024-09-21T00:48:29.634822+0000 mon.a (mon.0) 5824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:30 smithi049 bash[23528]: audit 2024-09-21T00:48:29.642948+0000 mon.a (mon.0) 5825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:30 smithi049 bash[23528]: audit 2024-09-21T00:48:29.776446+0000 mon.a (mon.0) 5826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:30 smithi049 bash[23528]: audit 2024-09-21T00:48:29.786342+0000 mon.a (mon.0) 5827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:30 smithi049 bash[23528]: audit 2024-09-21T00:48:29.797283+0000 mon.a (mon.0) 5828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:31 smithi044 bash[22676]: audit 2024-09-21T00:48:30.035946+0000 mgr.a (mgr.14388) 6664 : audit [DBG] from='client.152190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:31 smithi044 bash[22676]: cluster 2024-09-21T00:48:30.897943+0000 mgr.a (mgr.14388) 6665 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:31 smithi179 bash[23186]: audit 2024-09-21T00:48:30.035946+0000 mgr.a (mgr.14388) 6664 : audit [DBG] from='client.152190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:31 smithi179 bash[23186]: cluster 2024-09-21T00:48:30.897943+0000 mgr.a (mgr.14388) 6665 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:31 smithi049 bash[23528]: audit 2024-09-21T00:48:30.035946+0000 mgr.a (mgr.14388) 6664 : audit [DBG] from='client.152190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:32.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:31 smithi049 bash[23528]: cluster 2024-09-21T00:48:30.897943+0000 mgr.a (mgr.14388) 6665 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:33.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:32 smithi049 bash[23528]: cluster 2024-09-21T00:48:32.898758+0000 mgr.a (mgr.14388) 6666 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:48:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:32 smithi044 bash[22676]: cluster 2024-09-21T00:48:32.898758+0000 mgr.a (mgr.14388) 6666 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:48:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:32 smithi179 bash[23186]: cluster 2024-09-21T00:48:32.898758+0000 mgr.a (mgr.14388) 6666 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:48:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:34 smithi044 bash[22676]: cluster 2024-09-21T00:48:34.899580+0000 mgr.a (mgr.14388) 6667 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:48:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:34 smithi179 bash[23186]: cluster 2024-09-21T00:48:34.899580+0000 mgr.a (mgr.14388) 6667 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:48:35.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:34 smithi049 bash[23528]: cluster 2024-09-21T00:48:34.899580+0000 mgr.a (mgr.14388) 6667 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:48:35.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:35 smithi044 bash[22676]: audit 2024-09-21T00:48:35.840436+0000 mgr.a (mgr.14388) 6668 : audit [DBG] from='client.152265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:35 smithi179 bash[23186]: audit 2024-09-21T00:48:35.840436+0000 mgr.a (mgr.14388) 6668 : audit [DBG] from='client.152265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:36.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:36.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:36.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:36.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:36.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:36.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:35 smithi049 bash[23528]: audit 2024-09-21T00:48:35.840436+0000 mgr.a (mgr.14388) 6668 : audit [DBG] from='client.152265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:36 smithi044 bash[22676]: cluster 2024-09-21T00:48:36.902487+0000 mgr.a (mgr.14388) 6669 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:36 smithi179 bash[23186]: cluster 2024-09-21T00:48:36.902487+0000 mgr.a (mgr.14388) 6669 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:37.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:36 smithi049 bash[23528]: cluster 2024-09-21T00:48:36.902487+0000 mgr.a (mgr.14388) 6669 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:48:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:38 smithi044 bash[22676]: cluster 2024-09-21T00:48:38.903317+0000 mgr.a (mgr.14388) 6670 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:48:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:38 smithi179 bash[23186]: cluster 2024-09-21T00:48:38.903317+0000 mgr.a (mgr.14388) 6670 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:48:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:38 smithi049 bash[23528]: cluster 2024-09-21T00:48:38.903317+0000 mgr.a (mgr.14388) 6670 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:48:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:40 smithi044 bash[22676]: cluster 2024-09-21T00:48:40.904592+0000 mgr.a (mgr.14388) 6671 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:40 smithi179 bash[23186]: cluster 2024-09-21T00:48:40.904592+0000 mgr.a (mgr.14388) 6671 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:41.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:40 smithi049 bash[23528]: cluster 2024-09-21T00:48:40.904592+0000 mgr.a (mgr.14388) 6671 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:42.045 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:42.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:42.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:42.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:42.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:41 smithi044 bash[22676]: audit 2024-09-21T00:48:41.598244+0000 mgr.a (mgr.14388) 6672 : audit [DBG] from='client.152343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:41 smithi179 bash[23186]: audit 2024-09-21T00:48:41.598244+0000 mgr.a (mgr.14388) 6672 : audit [DBG] from='client.152343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:42.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:41 smithi049 bash[23528]: audit 2024-09-21T00:48:41.598244+0000 mgr.a (mgr.14388) 6672 : audit [DBG] from='client.152343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:42 smithi044 bash[22676]: cluster 2024-09-21T00:48:42.905558+0000 mgr.a (mgr.14388) 6673 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:42 smithi179 bash[23186]: cluster 2024-09-21T00:48:42.905558+0000 mgr.a (mgr.14388) 6673 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:42 smithi049 bash[23528]: cluster 2024-09-21T00:48:42.905558+0000 mgr.a (mgr.14388) 6673 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:44 smithi044 bash[22676]: cluster 2024-09-21T00:48:44.906814+0000 mgr.a (mgr.14388) 6674 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:44 smithi179 bash[23186]: cluster 2024-09-21T00:48:44.906814+0000 mgr.a (mgr.14388) 6674 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:44 smithi049 bash[23528]: cluster 2024-09-21T00:48:44.906814+0000 mgr.a (mgr.14388) 6674 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:47.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:47.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:47.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:47.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:46 smithi179 bash[23186]: cluster 2024-09-21T00:48:46.908223+0000 mgr.a (mgr.14388) 6675 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:46 smithi044 bash[22676]: cluster 2024-09-21T00:48:46.908223+0000 mgr.a (mgr.14388) 6675 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:47.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:46 smithi049 bash[23528]: cluster 2024-09-21T00:48:46.908223+0000 mgr.a (mgr.14388) 6675 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:47.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:47.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:47.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:47.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:47.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:47 smithi044 bash[22676]: audit 2024-09-21T00:48:47.392040+0000 mgr.a (mgr.14388) 6676 : audit [DBG] from='client.152421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:47 smithi179 bash[23186]: audit 2024-09-21T00:48:47.392040+0000 mgr.a (mgr.14388) 6676 : audit [DBG] from='client.152421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:48.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:47 smithi049 bash[23528]: audit 2024-09-21T00:48:47.392040+0000 mgr.a (mgr.14388) 6676 : audit [DBG] from='client.152421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:49 smithi044 bash[22676]: audit 2024-09-21T00:48:48.371751+0000 mon.a (mon.0) 5829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:49 smithi044 bash[22676]: audit 2024-09-21T00:48:48.377215+0000 mon.a (mon.0) 5830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:49 smithi044 bash[22676]: audit 2024-09-21T00:48:48.383634+0000 mon.a (mon.0) 5831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:49 smithi044 bash[22676]: cluster 2024-09-21T00:48:48.909237+0000 mgr.a (mgr.14388) 6677 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:49 smithi179 bash[23186]: audit 2024-09-21T00:48:48.371751+0000 mon.a (mon.0) 5829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:49 smithi179 bash[23186]: audit 2024-09-21T00:48:48.377215+0000 mon.a (mon.0) 5830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:49 smithi179 bash[23186]: audit 2024-09-21T00:48:48.383634+0000 mon.a (mon.0) 5831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:49 smithi179 bash[23186]: cluster 2024-09-21T00:48:48.909237+0000 mgr.a (mgr.14388) 6677 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:49.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:49 smithi049 bash[23528]: audit 2024-09-21T00:48:48.371751+0000 mon.a (mon.0) 5829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:49 smithi049 bash[23528]: audit 2024-09-21T00:48:48.377215+0000 mon.a (mon.0) 5830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:49 smithi049 bash[23528]: audit 2024-09-21T00:48:48.383634+0000 mon.a (mon.0) 5831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:49 smithi049 bash[23528]: cluster 2024-09-21T00:48:48.909237+0000 mgr.a (mgr.14388) 6677 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:50 smithi044 bash[22676]: audit 2024-09-21T00:48:49.836985+0000 mon.a (mon.0) 5832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:50 smithi044 bash[22676]: audit 2024-09-21T00:48:49.844615+0000 mon.a (mon.0) 5833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:50 smithi044 bash[22676]: audit 2024-09-21T00:48:49.853962+0000 mon.a (mon.0) 5834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:50 smithi044 bash[22676]: audit 2024-09-21T00:48:49.995778+0000 mon.a (mon.0) 5835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:50 smithi044 bash[22676]: audit 2024-09-21T00:48:50.004696+0000 mon.a (mon.0) 5836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:50 smithi044 bash[22676]: audit 2024-09-21T00:48:50.016748+0000 mon.a (mon.0) 5837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:50 smithi179 bash[23186]: audit 2024-09-21T00:48:49.836985+0000 mon.a (mon.0) 5832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:50 smithi179 bash[23186]: audit 2024-09-21T00:48:49.844615+0000 mon.a (mon.0) 5833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:50 smithi179 bash[23186]: audit 2024-09-21T00:48:49.853962+0000 mon.a (mon.0) 5834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:50 smithi179 bash[23186]: audit 2024-09-21T00:48:49.995778+0000 mon.a (mon.0) 5835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:50 smithi179 bash[23186]: audit 2024-09-21T00:48:50.004696+0000 mon.a (mon.0) 5836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:50 smithi179 bash[23186]: audit 2024-09-21T00:48:50.016748+0000 mon.a (mon.0) 5837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:50 smithi049 bash[23528]: audit 2024-09-21T00:48:49.836985+0000 mon.a (mon.0) 5832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:50 smithi049 bash[23528]: audit 2024-09-21T00:48:49.844615+0000 mon.a (mon.0) 5833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:50 smithi049 bash[23528]: audit 2024-09-21T00:48:49.853962+0000 mon.a (mon.0) 5834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:50 smithi049 bash[23528]: audit 2024-09-21T00:48:49.995778+0000 mon.a (mon.0) 5835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:50 smithi049 bash[23528]: audit 2024-09-21T00:48:50.004696+0000 mon.a (mon.0) 5836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:50 smithi049 bash[23528]: audit 2024-09-21T00:48:50.016748+0000 mon.a (mon.0) 5837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:48:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:51 smithi044 bash[22676]: cluster 2024-09-21T00:48:50.911495+0000 mgr.a (mgr.14388) 6678 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:51 smithi179 bash[23186]: cluster 2024-09-21T00:48:50.911495+0000 mgr.a (mgr.14388) 6678 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:52.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:51 smithi049 bash[23528]: cluster 2024-09-21T00:48:50.911495+0000 mgr.a (mgr.14388) 6678 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:52.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:52.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:52.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:52 smithi044 bash[22676]: cluster 2024-09-21T00:48:52.912081+0000 mgr.a (mgr.14388) 6679 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:52 smithi179 bash[23186]: cluster 2024-09-21T00:48:52.912081+0000 mgr.a (mgr.14388) 6679 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:53.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:52 smithi049 bash[23528]: cluster 2024-09-21T00:48:52.912081+0000 mgr.a (mgr.14388) 6679 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:53.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:53.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:48:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:53 smithi044 bash[22676]: audit 2024-09-21T00:48:53.195543+0000 mgr.a (mgr.14388) 6680 : audit [DBG] from='client.152499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:53 smithi179 bash[23186]: audit 2024-09-21T00:48:53.195543+0000 mgr.a (mgr.14388) 6680 : audit [DBG] from='client.152499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:53 smithi049 bash[23528]: audit 2024-09-21T00:48:53.195543+0000 mgr.a (mgr.14388) 6680 : audit [DBG] from='client.152499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:54 smithi049 bash[23528]: cluster 2024-09-21T00:48:54.913651+0000 mgr.a (mgr.14388) 6681 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T00:48:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:54 smithi044 bash[22676]: cluster 2024-09-21T00:48:54.913651+0000 mgr.a (mgr.14388) 6681 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T00:48:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:54 smithi179 bash[23186]: cluster 2024-09-21T00:48:54.913651+0000 mgr.a (mgr.14388) 6681 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T00:48:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:56 smithi044 bash[22676]: cluster 2024-09-21T00:48:56.915365+0000 mgr.a (mgr.14388) 6682 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:56 smithi179 bash[23186]: cluster 2024-09-21T00:48:56.915365+0000 mgr.a (mgr.14388) 6682 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:57.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:56 smithi049 bash[23528]: cluster 2024-09-21T00:48:56.915365+0000 mgr.a (mgr.14388) 6682 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:48:58.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:48:58.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:48:58.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:48:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:58 smithi044 bash[22676]: cluster 2024-09-21T00:48:58.915878+0000 mgr.a (mgr.14388) 6683 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:58 smithi179 bash[23186]: cluster 2024-09-21T00:48:58.915878+0000 mgr.a (mgr.14388) 6683 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:58 smithi049 bash[23528]: cluster 2024-09-21T00:48:58.915878+0000 mgr.a (mgr.14388) 6683 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:48:59.393 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:48:59.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:48:59.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:48:59.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:48:59.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:48:59 smithi044 bash[22676]: audit 2024-09-21T00:48:58.981406+0000 mgr.a (mgr.14388) 6684 : audit [DBG] from='client.152571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:48:59 smithi179 bash[23186]: audit 2024-09-21T00:48:58.981406+0000 mgr.a (mgr.14388) 6684 : audit [DBG] from='client.152571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:00.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:48:59 smithi049 bash[23528]: audit 2024-09-21T00:48:58.981406+0000 mgr.a (mgr.14388) 6684 : audit [DBG] from='client.152571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:00 smithi044 bash[22676]: cluster 2024-09-21T00:49:00.918330+0000 mgr.a (mgr.14388) 6685 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:00 smithi179 bash[23186]: cluster 2024-09-21T00:49:00.918330+0000 mgr.a (mgr.14388) 6685 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:01.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:00 smithi049 bash[23528]: cluster 2024-09-21T00:49:00.918330+0000 mgr.a (mgr.14388) 6685 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:02 smithi044 bash[22676]: cluster 2024-09-21T00:49:02.919339+0000 mgr.a (mgr.14388) 6686 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:02 smithi179 bash[23186]: cluster 2024-09-21T00:49:02.919339+0000 mgr.a (mgr.14388) 6686 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:03.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:02 smithi049 bash[23528]: cluster 2024-09-21T00:49:02.919339+0000 mgr.a (mgr.14388) 6686 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:04.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:04.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:04.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:05.195 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:04 smithi044 bash[22676]: audit 2024-09-21T00:49:04.736585+0000 mgr.a (mgr.14388) 6687 : audit [DBG] from='client.152649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:04 smithi044 bash[22676]: cluster 2024-09-21T00:49:04.920314+0000 mgr.a (mgr.14388) 6688 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:04 smithi179 bash[23186]: audit 2024-09-21T00:49:04.736585+0000 mgr.a (mgr.14388) 6687 : audit [DBG] from='client.152649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:04 smithi179 bash[23186]: cluster 2024-09-21T00:49:04.920314+0000 mgr.a (mgr.14388) 6688 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:05.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:04 smithi049 bash[23528]: audit 2024-09-21T00:49:04.736585+0000 mgr.a (mgr.14388) 6687 : audit [DBG] from='client.152649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:04 smithi049 bash[23528]: cluster 2024-09-21T00:49:04.920314+0000 mgr.a (mgr.14388) 6688 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:07.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:06 smithi044 bash[22676]: cluster 2024-09-21T00:49:06.921454+0000 mgr.a (mgr.14388) 6689 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:49:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:06 smithi179 bash[23186]: cluster 2024-09-21T00:49:06.921454+0000 mgr.a (mgr.14388) 6689 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:49:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:06 smithi049 bash[23528]: cluster 2024-09-21T00:49:06.921454+0000 mgr.a (mgr.14388) 6689 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:49:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:09 smithi044 bash[22676]: audit 2024-09-21T00:49:08.563173+0000 mon.a (mon.0) 5838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:09 smithi044 bash[22676]: audit 2024-09-21T00:49:08.567507+0000 mon.a (mon.0) 5839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:09 smithi044 bash[22676]: audit 2024-09-21T00:49:08.573372+0000 mon.a (mon.0) 5840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:09 smithi044 bash[22676]: cluster 2024-09-21T00:49:08.922155+0000 mgr.a (mgr.14388) 6690 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:09 smithi179 bash[23186]: audit 2024-09-21T00:49:08.563173+0000 mon.a (mon.0) 5838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:09 smithi179 bash[23186]: audit 2024-09-21T00:49:08.567507+0000 mon.a (mon.0) 5839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:09 smithi179 bash[23186]: audit 2024-09-21T00:49:08.573372+0000 mon.a (mon.0) 5840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:09 smithi179 bash[23186]: cluster 2024-09-21T00:49:08.922155+0000 mgr.a (mgr.14388) 6690 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:09 smithi049 bash[23528]: audit 2024-09-21T00:49:08.563173+0000 mon.a (mon.0) 5838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:09 smithi049 bash[23528]: audit 2024-09-21T00:49:08.567507+0000 mon.a (mon.0) 5839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:09 smithi049 bash[23528]: audit 2024-09-21T00:49:08.573372+0000 mon.a (mon.0) 5840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:09 smithi049 bash[23528]: cluster 2024-09-21T00:49:08.922155+0000 mgr.a (mgr.14388) 6690 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:10.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:10.198 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:10.198 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:10.987 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:10.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:10.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:10.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:10.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:11 smithi049 bash[23528]: audit 2024-09-21T00:49:10.035413+0000 mon.a (mon.0) 5841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:11 smithi049 bash[23528]: audit 2024-09-21T00:49:10.040836+0000 mon.a (mon.0) 5842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:11 smithi049 bash[23528]: audit 2024-09-21T00:49:10.046927+0000 mon.a (mon.0) 5843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:11 smithi049 bash[23528]: audit 2024-09-21T00:49:10.177997+0000 mon.a (mon.0) 5844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:11 smithi049 bash[23528]: audit 2024-09-21T00:49:10.186765+0000 mon.a (mon.0) 5845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:11 smithi049 bash[23528]: audit 2024-09-21T00:49:10.197199+0000 mon.a (mon.0) 5846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:11 smithi049 bash[23528]: audit 2024-09-21T00:49:10.538661+0000 mgr.a (mgr.14388) 6691 : audit [DBG] from='client.152721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:11 smithi044 bash[22676]: audit 2024-09-21T00:49:10.035413+0000 mon.a (mon.0) 5841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:11 smithi044 bash[22676]: audit 2024-09-21T00:49:10.040836+0000 mon.a (mon.0) 5842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:11 smithi044 bash[22676]: audit 2024-09-21T00:49:10.046927+0000 mon.a (mon.0) 5843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:11 smithi044 bash[22676]: audit 2024-09-21T00:49:10.177997+0000 mon.a (mon.0) 5844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:11 smithi044 bash[22676]: audit 2024-09-21T00:49:10.186765+0000 mon.a (mon.0) 5845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:11 smithi044 bash[22676]: audit 2024-09-21T00:49:10.197199+0000 mon.a (mon.0) 5846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:11 smithi044 bash[22676]: audit 2024-09-21T00:49:10.538661+0000 mgr.a (mgr.14388) 6691 : audit [DBG] from='client.152721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:11 smithi179 bash[23186]: audit 2024-09-21T00:49:10.035413+0000 mon.a (mon.0) 5841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:11 smithi179 bash[23186]: audit 2024-09-21T00:49:10.040836+0000 mon.a (mon.0) 5842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:11 smithi179 bash[23186]: audit 2024-09-21T00:49:10.046927+0000 mon.a (mon.0) 5843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:11 smithi179 bash[23186]: audit 2024-09-21T00:49:10.177997+0000 mon.a (mon.0) 5844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:11 smithi179 bash[23186]: audit 2024-09-21T00:49:10.186765+0000 mon.a (mon.0) 5845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:11 smithi179 bash[23186]: audit 2024-09-21T00:49:10.197199+0000 mon.a (mon.0) 5846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:11 smithi179 bash[23186]: audit 2024-09-21T00:49:10.538661+0000 mgr.a (mgr.14388) 6691 : audit [DBG] from='client.152721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:12 smithi044 bash[22676]: cluster 2024-09-21T00:49:10.923574+0000 mgr.a (mgr.14388) 6692 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:12 smithi179 bash[23186]: cluster 2024-09-21T00:49:10.923574+0000 mgr.a (mgr.14388) 6692 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:12.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:12 smithi049 bash[23528]: cluster 2024-09-21T00:49:10.923574+0000 mgr.a (mgr.14388) 6692 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:14 smithi044 bash[22676]: cluster 2024-09-21T00:49:12.924297+0000 mgr.a (mgr.14388) 6693 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:14 smithi179 bash[23186]: cluster 2024-09-21T00:49:12.924297+0000 mgr.a (mgr.14388) 6693 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:14.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:14 smithi049 bash[23528]: cluster 2024-09-21T00:49:12.924297+0000 mgr.a (mgr.14388) 6693 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:15.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:15.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:16 smithi044 bash[22676]: cluster 2024-09-21T00:49:14.925861+0000 mgr.a (mgr.14388) 6694 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:49:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:16 smithi179 bash[23186]: cluster 2024-09-21T00:49:14.925861+0000 mgr.a (mgr.14388) 6694 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:49:16.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:16 smithi049 bash[23528]: cluster 2024-09-21T00:49:14.925861+0000 mgr.a (mgr.14388) 6694 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T00:49:16.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:16.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:16.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:16.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:16.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:17 smithi044 bash[22676]: audit 2024-09-21T00:49:16.327815+0000 mgr.a (mgr.14388) 6695 : audit [DBG] from='client.152793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:17 smithi179 bash[23186]: audit 2024-09-21T00:49:16.327815+0000 mgr.a (mgr.14388) 6695 : audit [DBG] from='client.152793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:17.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:17 smithi049 bash[23528]: audit 2024-09-21T00:49:16.327815+0000 mgr.a (mgr.14388) 6695 : audit [DBG] from='client.152793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:18 smithi044 bash[22676]: cluster 2024-09-21T00:49:16.927631+0000 mgr.a (mgr.14388) 6696 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:18 smithi179 bash[23186]: cluster 2024-09-21T00:49:16.927631+0000 mgr.a (mgr.14388) 6696 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:18.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:18 smithi049 bash[23528]: cluster 2024-09-21T00:49:16.927631+0000 mgr.a (mgr.14388) 6696 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:20 smithi044 bash[22676]: cluster 2024-09-21T00:49:18.928428+0000 mgr.a (mgr.14388) 6697 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:20 smithi179 bash[23186]: cluster 2024-09-21T00:49:18.928428+0000 mgr.a (mgr.14388) 6697 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:20.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:20 smithi049 bash[23528]: cluster 2024-09-21T00:49:18.928428+0000 mgr.a (mgr.14388) 6697 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:21.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:21.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:22.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22676]: cluster 2024-09-21T00:49:20.930524+0000 mgr.a (mgr.14388) 6698 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:22.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22676]: audit 2024-09-21T00:49:21.654681+0000 mon.a (mon.0) 5847 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:49:22.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22676]: audit 2024-09-21T00:49:21.661945+0000 mon.a (mon.0) 5848 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:22.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22676]: audit 2024-09-21T00:49:21.663982+0000 mon.a (mon.0) 5849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:49:22.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22676]: audit 2024-09-21T00:49:21.675836+0000 mon.a (mon.0) 5850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:22.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22676]: audit 2024-09-21T00:49:21.682213+0000 mon.a (mon.0) 5851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:49:22.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22676]: audit 2024-09-21T00:49:21.684557+0000 mgr.a (mgr.14388) 6699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:49:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:22 smithi179 bash[23186]: cluster 2024-09-21T00:49:20.930524+0000 mgr.a (mgr.14388) 6698 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:22 smithi179 bash[23186]: audit 2024-09-21T00:49:21.654681+0000 mon.a (mon.0) 5847 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:49:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:22 smithi179 bash[23186]: audit 2024-09-21T00:49:21.661945+0000 mon.a (mon.0) 5848 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:22 smithi179 bash[23186]: audit 2024-09-21T00:49:21.663982+0000 mon.a (mon.0) 5849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:49:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:22 smithi179 bash[23186]: audit 2024-09-21T00:49:21.675836+0000 mon.a (mon.0) 5850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:22 smithi179 bash[23186]: audit 2024-09-21T00:49:21.682213+0000 mon.a (mon.0) 5851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:49:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:22 smithi179 bash[23186]: audit 2024-09-21T00:49:21.684557+0000 mgr.a (mgr.14388) 6699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:49:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:22 smithi049 bash[23528]: cluster 2024-09-21T00:49:20.930524+0000 mgr.a (mgr.14388) 6698 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:22 smithi049 bash[23528]: audit 2024-09-21T00:49:21.654681+0000 mon.a (mon.0) 5847 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:49:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:22 smithi049 bash[23528]: audit 2024-09-21T00:49:21.661945+0000 mon.a (mon.0) 5848 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:22 smithi049 bash[23528]: audit 2024-09-21T00:49:21.663982+0000 mon.a (mon.0) 5849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:49:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:22 smithi049 bash[23528]: audit 2024-09-21T00:49:21.675836+0000 mon.a (mon.0) 5850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:22 smithi049 bash[23528]: audit 2024-09-21T00:49:21.682213+0000 mon.a (mon.0) 5851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:49:22.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:22 smithi049 bash[23528]: audit 2024-09-21T00:49:21.684557+0000 mgr.a (mgr.14388) 6699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:49:22.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22930]: debug 2024-09-21T00:49:22.455+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:49:22.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:49:22 smithi044 bash[22930]: debug 2024-09-21T00:49:22.463+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:49:22.850 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:22.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:22.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:22.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:22.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:23 smithi044 bash[22676]: audit 2024-09-21T00:49:22.135968+0000 mgr.a (mgr.14388) 6700 : audit [DBG] from='client.152889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:23 smithi044 bash[22676]: audit 2024-09-21T00:49:22.457618+0000 mgr.a (mgr.14388) 6701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:23 smithi044 bash[22676]: cephadm 2024-09-21T00:49:22.469078+0000 mgr.a (mgr.14388) 6702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:23 smithi044 bash[22676]: cluster 2024-09-21T00:49:22.931358+0000 mgr.a (mgr.14388) 6703 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:23 smithi179 bash[23186]: audit 2024-09-21T00:49:22.135968+0000 mgr.a (mgr.14388) 6700 : audit [DBG] from='client.152889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:23 smithi179 bash[23186]: audit 2024-09-21T00:49:22.457618+0000 mgr.a (mgr.14388) 6701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:49:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:23 smithi179 bash[23186]: cephadm 2024-09-21T00:49:22.469078+0000 mgr.a (mgr.14388) 6702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:49:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:23 smithi179 bash[23186]: cluster 2024-09-21T00:49:22.931358+0000 mgr.a (mgr.14388) 6703 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:23.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:23 smithi049 bash[23528]: audit 2024-09-21T00:49:22.135968+0000 mgr.a (mgr.14388) 6700 : audit [DBG] from='client.152889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:23.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:23 smithi049 bash[23528]: audit 2024-09-21T00:49:22.457618+0000 mgr.a (mgr.14388) 6701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:49:23.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:23 smithi049 bash[23528]: cephadm 2024-09-21T00:49:22.469078+0000 mgr.a (mgr.14388) 6702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:49:23.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:23 smithi049 bash[23528]: cluster 2024-09-21T00:49:22.931358+0000 mgr.a (mgr.14388) 6703 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:25 smithi179 bash[23186]: cluster 2024-09-21T00:49:24.933541+0000 mgr.a (mgr.14388) 6704 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:26.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:25 smithi049 bash[23528]: cluster 2024-09-21T00:49:24.933541+0000 mgr.a (mgr.14388) 6704 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:25 smithi044 bash[22676]: cluster 2024-09-21T00:49:24.933541+0000 mgr.a (mgr.14388) 6704 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:27.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:27.853 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:27.853 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:28.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:27 smithi044 bash[22676]: cluster 2024-09-21T00:49:26.934175+0000 mgr.a (mgr.14388) 6705 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:28.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:27 smithi179 bash[23186]: cluster 2024-09-21T00:49:26.934175+0000 mgr.a (mgr.14388) 6705 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:28.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:27 smithi049 bash[23528]: cluster 2024-09-21T00:49:26.934175+0000 mgr.a (mgr.14388) 6705 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:28.614 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:28.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:29 smithi044 bash[22676]: audit 2024-09-21T00:49:28.197787+0000 mgr.a (mgr.14388) 6706 : audit [DBG] from='client.153048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:29 smithi044 bash[22676]: audit 2024-09-21T00:49:28.751364+0000 mon.a (mon.0) 5852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:29 smithi044 bash[22676]: audit 2024-09-21T00:49:28.760016+0000 mon.a (mon.0) 5853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:29 smithi044 bash[22676]: audit 2024-09-21T00:49:28.772429+0000 mon.a (mon.0) 5854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:29 smithi179 bash[23186]: audit 2024-09-21T00:49:28.197787+0000 mgr.a (mgr.14388) 6706 : audit [DBG] from='client.153048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:29 smithi179 bash[23186]: audit 2024-09-21T00:49:28.751364+0000 mon.a (mon.0) 5852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:29 smithi179 bash[23186]: audit 2024-09-21T00:49:28.760016+0000 mon.a (mon.0) 5853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:29 smithi179 bash[23186]: audit 2024-09-21T00:49:28.772429+0000 mon.a (mon.0) 5854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:30.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:29 smithi049 bash[23528]: audit 2024-09-21T00:49:28.197787+0000 mgr.a (mgr.14388) 6706 : audit [DBG] from='client.153048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:29 smithi049 bash[23528]: audit 2024-09-21T00:49:28.751364+0000 mon.a (mon.0) 5852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:29 smithi049 bash[23528]: audit 2024-09-21T00:49:28.760016+0000 mon.a (mon.0) 5853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:29 smithi049 bash[23528]: audit 2024-09-21T00:49:28.772429+0000 mon.a (mon.0) 5854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:30 smithi179 bash[23186]: cluster 2024-09-21T00:49:28.934983+0000 mgr.a (mgr.14388) 6707 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:30 smithi179 bash[23186]: audit 2024-09-21T00:49:30.238217+0000 mon.a (mon.0) 5855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:30 smithi179 bash[23186]: audit 2024-09-21T00:49:30.244130+0000 mon.a (mon.0) 5856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:30 smithi179 bash[23186]: audit 2024-09-21T00:49:30.251392+0000 mon.a (mon.0) 5857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:30 smithi179 bash[23186]: audit 2024-09-21T00:49:30.402570+0000 mon.a (mon.0) 5858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:30 smithi179 bash[23186]: audit 2024-09-21T00:49:30.411084+0000 mon.a (mon.0) 5859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:30 smithi179 bash[23186]: audit 2024-09-21T00:49:30.421569+0000 mon.a (mon.0) 5860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:30 smithi049 bash[23528]: cluster 2024-09-21T00:49:28.934983+0000 mgr.a (mgr.14388) 6707 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:30 smithi049 bash[23528]: audit 2024-09-21T00:49:30.238217+0000 mon.a (mon.0) 5855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:30 smithi049 bash[23528]: audit 2024-09-21T00:49:30.244130+0000 mon.a (mon.0) 5856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:30 smithi049 bash[23528]: audit 2024-09-21T00:49:30.251392+0000 mon.a (mon.0) 5857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:30 smithi049 bash[23528]: audit 2024-09-21T00:49:30.402570+0000 mon.a (mon.0) 5858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:30 smithi049 bash[23528]: audit 2024-09-21T00:49:30.411084+0000 mon.a (mon.0) 5859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:30 smithi049 bash[23528]: audit 2024-09-21T00:49:30.421569+0000 mon.a (mon.0) 5860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:30 smithi044 bash[22676]: cluster 2024-09-21T00:49:28.934983+0000 mgr.a (mgr.14388) 6707 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:30 smithi044 bash[22676]: audit 2024-09-21T00:49:30.238217+0000 mon.a (mon.0) 5855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:30 smithi044 bash[22676]: audit 2024-09-21T00:49:30.244130+0000 mon.a (mon.0) 5856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:30 smithi044 bash[22676]: audit 2024-09-21T00:49:30.251392+0000 mon.a (mon.0) 5857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:30 smithi044 bash[22676]: audit 2024-09-21T00:49:30.402570+0000 mon.a (mon.0) 5858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:30 smithi044 bash[22676]: audit 2024-09-21T00:49:30.411084+0000 mon.a (mon.0) 5859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:31.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:30 smithi044 bash[22676]: audit 2024-09-21T00:49:30.421569+0000 mon.a (mon.0) 5860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:33.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:32 smithi049 bash[23528]: cluster 2024-09-21T00:49:30.937237+0000 mgr.a (mgr.14388) 6708 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:32 smithi044 bash[22676]: cluster 2024-09-21T00:49:30.937237+0000 mgr.a (mgr.14388) 6708 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:32 smithi179 bash[23186]: cluster 2024-09-21T00:49:30.937237+0000 mgr.a (mgr.14388) 6708 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:33.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:33.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:33.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:34.395 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:34.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:35.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:34 smithi049 bash[23528]: cluster 2024-09-21T00:49:32.938020+0000 mgr.a (mgr.14388) 6709 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:34 smithi044 bash[22676]: cluster 2024-09-21T00:49:32.938020+0000 mgr.a (mgr.14388) 6709 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:34 smithi179 bash[23186]: cluster 2024-09-21T00:49:32.938020+0000 mgr.a (mgr.14388) 6709 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:36.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:35 smithi049 bash[23528]: audit 2024-09-21T00:49:33.952898+0000 mgr.a (mgr.14388) 6710 : audit [DBG] from='client.153123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:35 smithi044 bash[22676]: audit 2024-09-21T00:49:33.952898+0000 mgr.a (mgr.14388) 6710 : audit [DBG] from='client.153123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:35 smithi179 bash[23186]: audit 2024-09-21T00:49:33.952898+0000 mgr.a (mgr.14388) 6710 : audit [DBG] from='client.153123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:36 smithi049 bash[23528]: cluster 2024-09-21T00:49:34.940281+0000 mgr.a (mgr.14388) 6711 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:36 smithi044 bash[22676]: cluster 2024-09-21T00:49:34.940281+0000 mgr.a (mgr.14388) 6711 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:36 smithi179 bash[23186]: cluster 2024-09-21T00:49:34.940281+0000 mgr.a (mgr.14388) 6711 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:49:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:38 smithi044 bash[22676]: cluster 2024-09-21T00:49:36.941070+0000 mgr.a (mgr.14388) 6712 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:38 smithi179 bash[23186]: cluster 2024-09-21T00:49:36.941070+0000 mgr.a (mgr.14388) 6712 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:39.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:38 smithi049 bash[23528]: cluster 2024-09-21T00:49:36.941070+0000 mgr.a (mgr.14388) 6712 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:39.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:39.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:39.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:40.165 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:40.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:40.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:40.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:40.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:40 smithi044 bash[22676]: cluster 2024-09-21T00:49:38.941859+0000 mgr.a (mgr.14388) 6713 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:40 smithi044 bash[22676]: audit 2024-09-21T00:49:39.733985+0000 mgr.a (mgr.14388) 6714 : audit [DBG] from='client.153201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:40 smithi179 bash[23186]: cluster 2024-09-21T00:49:38.941859+0000 mgr.a (mgr.14388) 6713 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:40 smithi179 bash[23186]: audit 2024-09-21T00:49:39.733985+0000 mgr.a (mgr.14388) 6714 : audit [DBG] from='client.153201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:41.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:40 smithi049 bash[23528]: cluster 2024-09-21T00:49:38.941859+0000 mgr.a (mgr.14388) 6713 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:40 smithi049 bash[23528]: audit 2024-09-21T00:49:39.733985+0000 mgr.a (mgr.14388) 6714 : audit [DBG] from='client.153201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:42 smithi044 bash[22676]: cluster 2024-09-21T00:49:40.944700+0000 mgr.a (mgr.14388) 6715 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:42 smithi179 bash[23186]: cluster 2024-09-21T00:49:40.944700+0000 mgr.a (mgr.14388) 6715 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:43.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:42 smithi049 bash[23528]: cluster 2024-09-21T00:49:40.944700+0000 mgr.a (mgr.14388) 6715 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:44 smithi044 bash[22676]: cluster 2024-09-21T00:49:42.945520+0000 mgr.a (mgr.14388) 6716 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:49:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:44 smithi179 bash[23186]: cluster 2024-09-21T00:49:42.945520+0000 mgr.a (mgr.14388) 6716 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:49:45.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:44 smithi049 bash[23528]: cluster 2024-09-21T00:49:42.945520+0000 mgr.a (mgr.14388) 6716 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:49:45.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:45.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:46 smithi044 bash[22676]: cluster 2024-09-21T00:49:44.947438+0000 mgr.a (mgr.14388) 6717 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:46 smithi044 bash[22676]: audit 2024-09-21T00:49:45.504970+0000 mgr.a (mgr.14388) 6718 : audit [DBG] from='client.153273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:46 smithi179 bash[23186]: cluster 2024-09-21T00:49:44.947438+0000 mgr.a (mgr.14388) 6717 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:46 smithi179 bash[23186]: audit 2024-09-21T00:49:45.504970+0000 mgr.a (mgr.14388) 6718 : audit [DBG] from='client.153273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:46 smithi049 bash[23528]: cluster 2024-09-21T00:49:44.947438+0000 mgr.a (mgr.14388) 6717 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:46 smithi049 bash[23528]: audit 2024-09-21T00:49:45.504970+0000 mgr.a (mgr.14388) 6718 : audit [DBG] from='client.153273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:48 smithi179 bash[23186]: cluster 2024-09-21T00:49:46.948426+0000 mgr.a (mgr.14388) 6719 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:49:49.186 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:48 smithi044 bash[22676]: cluster 2024-09-21T00:49:46.948426+0000 mgr.a (mgr.14388) 6719 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:49:49.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:48 smithi049 bash[23528]: cluster 2024-09-21T00:49:46.948426+0000 mgr.a (mgr.14388) 6719 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:49:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:49 smithi044 bash[22676]: cluster 2024-09-21T00:49:48.949024+0000 mgr.a (mgr.14388) 6720 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:49 smithi044 bash[22676]: audit 2024-09-21T00:49:48.998106+0000 mon.a (mon.0) 5861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:49 smithi044 bash[22676]: audit 2024-09-21T00:49:49.003198+0000 mon.a (mon.0) 5862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:49 smithi044 bash[22676]: audit 2024-09-21T00:49:49.008173+0000 mon.a (mon.0) 5863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:50 smithi179 bash[23186]: cluster 2024-09-21T00:49:48.949024+0000 mgr.a (mgr.14388) 6720 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:50 smithi179 bash[23186]: audit 2024-09-21T00:49:48.998106+0000 mon.a (mon.0) 5861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:50 smithi179 bash[23186]: audit 2024-09-21T00:49:49.003198+0000 mon.a (mon.0) 5862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:50 smithi179 bash[23186]: audit 2024-09-21T00:49:49.008173+0000 mon.a (mon.0) 5863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:50 smithi049 bash[23528]: cluster 2024-09-21T00:49:48.949024+0000 mgr.a (mgr.14388) 6720 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:49:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:50 smithi049 bash[23528]: audit 2024-09-21T00:49:48.998106+0000 mon.a (mon.0) 5861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:50 smithi049 bash[23528]: audit 2024-09-21T00:49:49.003198+0000 mon.a (mon.0) 5862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:50 smithi049 bash[23528]: audit 2024-09-21T00:49:49.008173+0000 mon.a (mon.0) 5863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:51.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:51.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:51.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:51.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:51.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:51 smithi044 bash[22676]: audit 2024-09-21T00:49:50.459084+0000 mon.a (mon.0) 5864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:51 smithi044 bash[22676]: audit 2024-09-21T00:49:50.466450+0000 mon.a (mon.0) 5865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:51 smithi044 bash[22676]: audit 2024-09-21T00:49:50.476106+0000 mon.a (mon.0) 5866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:51 smithi044 bash[22676]: audit 2024-09-21T00:49:50.621801+0000 mon.a (mon.0) 5867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:51 smithi044 bash[22676]: audit 2024-09-21T00:49:50.627032+0000 mon.a (mon.0) 5868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:51 smithi044 bash[22676]: audit 2024-09-21T00:49:50.633539+0000 mon.a (mon.0) 5869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:51 smithi179 bash[23186]: audit 2024-09-21T00:49:50.459084+0000 mon.a (mon.0) 5864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:51 smithi179 bash[23186]: audit 2024-09-21T00:49:50.466450+0000 mon.a (mon.0) 5865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:51 smithi179 bash[23186]: audit 2024-09-21T00:49:50.476106+0000 mon.a (mon.0) 5866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:51 smithi179 bash[23186]: audit 2024-09-21T00:49:50.621801+0000 mon.a (mon.0) 5867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:51 smithi179 bash[23186]: audit 2024-09-21T00:49:50.627032+0000 mon.a (mon.0) 5868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:51 smithi179 bash[23186]: audit 2024-09-21T00:49:50.633539+0000 mon.a (mon.0) 5869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:51 smithi049 bash[23528]: audit 2024-09-21T00:49:50.459084+0000 mon.a (mon.0) 5864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:51 smithi049 bash[23528]: audit 2024-09-21T00:49:50.466450+0000 mon.a (mon.0) 5865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:51 smithi049 bash[23528]: audit 2024-09-21T00:49:50.476106+0000 mon.a (mon.0) 5866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:51 smithi049 bash[23528]: audit 2024-09-21T00:49:50.621801+0000 mon.a (mon.0) 5867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:51 smithi049 bash[23528]: audit 2024-09-21T00:49:50.627032+0000 mon.a (mon.0) 5868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:51.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:51 smithi049 bash[23528]: audit 2024-09-21T00:49:50.633539+0000 mon.a (mon.0) 5869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:49:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:52 smithi044 bash[22676]: cluster 2024-09-21T00:49:50.950424+0000 mgr.a (mgr.14388) 6721 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:52 smithi044 bash[22676]: audit 2024-09-21T00:49:51.257912+0000 mgr.a (mgr.14388) 6722 : audit [DBG] from='client.153351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:52 smithi179 bash[23186]: cluster 2024-09-21T00:49:50.950424+0000 mgr.a (mgr.14388) 6721 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:52 smithi179 bash[23186]: audit 2024-09-21T00:49:51.257912+0000 mgr.a (mgr.14388) 6722 : audit [DBG] from='client.153351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:52 smithi049 bash[23528]: cluster 2024-09-21T00:49:50.950424+0000 mgr.a (mgr.14388) 6721 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:52 smithi049 bash[23528]: audit 2024-09-21T00:49:51.257912+0000 mgr.a (mgr.14388) 6722 : audit [DBG] from='client.153351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:54 smithi049 bash[23528]: cluster 2024-09-21T00:49:52.951326+0000 mgr.a (mgr.14388) 6723 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:54 smithi044 bash[22676]: cluster 2024-09-21T00:49:52.951326+0000 mgr.a (mgr.14388) 6723 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:54 smithi179 bash[23186]: cluster 2024-09-21T00:49:52.951326+0000 mgr.a (mgr.14388) 6723 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:56.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:49:56.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:49:56.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:49:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:56 smithi044 bash[22676]: cluster 2024-09-21T00:49:54.953494+0000 mgr.a (mgr.14388) 6724 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:56 smithi179 bash[23186]: cluster 2024-09-21T00:49:54.953494+0000 mgr.a (mgr.14388) 6724 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:56 smithi049 bash[23528]: cluster 2024-09-21T00:49:54.953494+0000 mgr.a (mgr.14388) 6724 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:49:57.463 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:49:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:49:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:49:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:49:57.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:49:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:58 smithi044 bash[22676]: cluster 2024-09-21T00:49:56.954212+0000 mgr.a (mgr.14388) 6725 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:49:58 smithi044 bash[22676]: audit 2024-09-21T00:49:57.036245+0000 mgr.a (mgr.14388) 6726 : audit [DBG] from='client.153429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:58 smithi179 bash[23186]: cluster 2024-09-21T00:49:56.954212+0000 mgr.a (mgr.14388) 6725 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:49:58 smithi179 bash[23186]: audit 2024-09-21T00:49:57.036245+0000 mgr.a (mgr.14388) 6726 : audit [DBG] from='client.153429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:58 smithi049 bash[23528]: cluster 2024-09-21T00:49:56.954212+0000 mgr.a (mgr.14388) 6725 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:49:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:49:58 smithi049 bash[23528]: audit 2024-09-21T00:49:57.036245+0000 mgr.a (mgr.14388) 6726 : audit [DBG] from='client.153429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:00 smithi044 bash[22676]: cluster 2024-09-21T00:49:58.955130+0000 mgr.a (mgr.14388) 6727 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:00 smithi044 bash[22676]: cluster 2024-09-21T00:50:00.000134+0000 mon.a (mon.0) 5870 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:50:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:00 smithi179 bash[23186]: cluster 2024-09-21T00:49:58.955130+0000 mgr.a (mgr.14388) 6727 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:00 smithi179 bash[23186]: cluster 2024-09-21T00:50:00.000134+0000 mon.a (mon.0) 5870 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:50:01.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:00 smithi049 bash[23528]: cluster 2024-09-21T00:49:58.955130+0000 mgr.a (mgr.14388) 6727 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:00 smithi049 bash[23528]: cluster 2024-09-21T00:50:00.000134+0000 mon.a (mon.0) 5870 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T00:50:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:02 smithi044 bash[22676]: cluster 2024-09-21T00:50:00.957434+0000 mgr.a (mgr.14388) 6728 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:02 smithi179 bash[23186]: cluster 2024-09-21T00:50:00.957434+0000 mgr.a (mgr.14388) 6728 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:03.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:02 smithi049 bash[23528]: cluster 2024-09-21T00:50:00.957434+0000 mgr.a (mgr.14388) 6728 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:03.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:03.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:03.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:03.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:03.264 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:03 smithi044 bash[22676]: audit 2024-09-21T00:50:02.807013+0000 mgr.a (mgr.14388) 6729 : audit [DBG] from='client.153507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:03 smithi179 bash[23186]: audit 2024-09-21T00:50:02.807013+0000 mgr.a (mgr.14388) 6729 : audit [DBG] from='client.153507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:04.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:03 smithi049 bash[23528]: audit 2024-09-21T00:50:02.807013+0000 mgr.a (mgr.14388) 6729 : audit [DBG] from='client.153507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:04 smithi044 bash[22676]: cluster 2024-09-21T00:50:02.958606+0000 mgr.a (mgr.14388) 6730 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:04 smithi179 bash[23186]: cluster 2024-09-21T00:50:02.958606+0000 mgr.a (mgr.14388) 6730 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:04 smithi049 bash[23528]: cluster 2024-09-21T00:50:02.958606+0000 mgr.a (mgr.14388) 6730 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:06 smithi044 bash[22676]: cluster 2024-09-21T00:50:04.960910+0000 mgr.a (mgr.14388) 6731 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:06 smithi179 bash[23186]: cluster 2024-09-21T00:50:04.960910+0000 mgr.a (mgr.14388) 6731 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:06 smithi049 bash[23528]: cluster 2024-09-21T00:50:04.960910+0000 mgr.a (mgr.14388) 6731 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:08.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:08.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:08 smithi179 bash[23186]: cluster 2024-09-21T00:50:06.961746+0000 mgr.a (mgr.14388) 6732 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:08 smithi044 bash[22676]: cluster 2024-09-21T00:50:06.961746+0000 mgr.a (mgr.14388) 6732 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:09.041 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:09.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:09.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:08 smithi049 bash[23528]: cluster 2024-09-21T00:50:06.961746+0000 mgr.a (mgr.14388) 6732 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:09 smithi044 bash[22676]: audit 2024-09-21T00:50:08.606591+0000 mgr.a (mgr.14388) 6733 : audit [DBG] from='client.153582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:09 smithi044 bash[22676]: audit 2024-09-21T00:50:09.177020+0000 mon.a (mon.0) 5871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:09 smithi044 bash[22676]: audit 2024-09-21T00:50:09.185673+0000 mon.a (mon.0) 5872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:09 smithi044 bash[22676]: audit 2024-09-21T00:50:09.196321+0000 mon.a (mon.0) 5873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:09 smithi179 bash[23186]: audit 2024-09-21T00:50:08.606591+0000 mgr.a (mgr.14388) 6733 : audit [DBG] from='client.153582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:09 smithi179 bash[23186]: audit 2024-09-21T00:50:09.177020+0000 mon.a (mon.0) 5871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:09 smithi179 bash[23186]: audit 2024-09-21T00:50:09.185673+0000 mon.a (mon.0) 5872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:09 smithi179 bash[23186]: audit 2024-09-21T00:50:09.196321+0000 mon.a (mon.0) 5873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:09 smithi049 bash[23528]: audit 2024-09-21T00:50:08.606591+0000 mgr.a (mgr.14388) 6733 : audit [DBG] from='client.153582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:09 smithi049 bash[23528]: audit 2024-09-21T00:50:09.177020+0000 mon.a (mon.0) 5871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:09 smithi049 bash[23528]: audit 2024-09-21T00:50:09.185673+0000 mon.a (mon.0) 5872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:09 smithi049 bash[23528]: audit 2024-09-21T00:50:09.196321+0000 mon.a (mon.0) 5873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:10 smithi179 bash[23186]: cluster 2024-09-21T00:50:08.962278+0000 mgr.a (mgr.14388) 6734 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:10 smithi044 bash[22676]: cluster 2024-09-21T00:50:08.962278+0000 mgr.a (mgr.14388) 6734 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:11.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:10 smithi049 bash[23528]: cluster 2024-09-21T00:50:08.962278+0000 mgr.a (mgr.14388) 6734 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:11 smithi044 bash[22676]: audit 2024-09-21T00:50:10.686836+0000 mon.a (mon.0) 5874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:11 smithi044 bash[22676]: audit 2024-09-21T00:50:10.716240+0000 mon.a (mon.0) 5875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:11 smithi044 bash[22676]: audit 2024-09-21T00:50:10.731956+0000 mon.a (mon.0) 5876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:11 smithi044 bash[22676]: audit 2024-09-21T00:50:10.830980+0000 mon.a (mon.0) 5877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:11 smithi044 bash[22676]: audit 2024-09-21T00:50:10.837507+0000 mon.a (mon.0) 5878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:11 smithi044 bash[22676]: audit 2024-09-21T00:50:10.845542+0000 mon.a (mon.0) 5879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:11 smithi179 bash[23186]: audit 2024-09-21T00:50:10.686836+0000 mon.a (mon.0) 5874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:11 smithi179 bash[23186]: audit 2024-09-21T00:50:10.716240+0000 mon.a (mon.0) 5875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:11 smithi179 bash[23186]: audit 2024-09-21T00:50:10.731956+0000 mon.a (mon.0) 5876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:11 smithi179 bash[23186]: audit 2024-09-21T00:50:10.830980+0000 mon.a (mon.0) 5877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:11 smithi179 bash[23186]: audit 2024-09-21T00:50:10.837507+0000 mon.a (mon.0) 5878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:11 smithi179 bash[23186]: audit 2024-09-21T00:50:10.845542+0000 mon.a (mon.0) 5879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:11 smithi049 bash[23528]: audit 2024-09-21T00:50:10.686836+0000 mon.a (mon.0) 5874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:11 smithi049 bash[23528]: audit 2024-09-21T00:50:10.716240+0000 mon.a (mon.0) 5875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:11 smithi049 bash[23528]: audit 2024-09-21T00:50:10.731956+0000 mon.a (mon.0) 5876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:11 smithi049 bash[23528]: audit 2024-09-21T00:50:10.830980+0000 mon.a (mon.0) 5877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:11 smithi049 bash[23528]: audit 2024-09-21T00:50:10.837507+0000 mon.a (mon.0) 5878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:11 smithi049 bash[23528]: audit 2024-09-21T00:50:10.845542+0000 mon.a (mon.0) 5879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:12 smithi044 bash[22676]: cluster 2024-09-21T00:50:10.964489+0000 mgr.a (mgr.14388) 6735 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:12 smithi179 bash[23186]: cluster 2024-09-21T00:50:10.964489+0000 mgr.a (mgr.14388) 6735 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:12 smithi049 bash[23528]: cluster 2024-09-21T00:50:10.964489+0000 mgr.a (mgr.14388) 6735 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:14.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:14.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:14.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:14.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:14.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:14.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:14.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:14.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:14 smithi049 bash[23528]: cluster 2024-09-21T00:50:12.965280+0000 mgr.a (mgr.14388) 6736 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:14 smithi044 bash[22676]: cluster 2024-09-21T00:50:12.965280+0000 mgr.a (mgr.14388) 6736 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:14 smithi179 bash[23186]: cluster 2024-09-21T00:50:12.965280+0000 mgr.a (mgr.14388) 6736 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:16.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:15 smithi049 bash[23528]: audit 2024-09-21T00:50:14.378719+0000 mgr.a (mgr.14388) 6737 : audit [DBG] from='client.153654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:15 smithi044 bash[22676]: audit 2024-09-21T00:50:14.378719+0000 mgr.a (mgr.14388) 6737 : audit [DBG] from='client.153654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:15 smithi179 bash[23186]: audit 2024-09-21T00:50:14.378719+0000 mgr.a (mgr.14388) 6737 : audit [DBG] from='client.153654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:16 smithi044 bash[22676]: cluster 2024-09-21T00:50:14.967612+0000 mgr.a (mgr.14388) 6738 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:16 smithi179 bash[23186]: cluster 2024-09-21T00:50:14.967612+0000 mgr.a (mgr.14388) 6738 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:17.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:16 smithi049 bash[23528]: cluster 2024-09-21T00:50:14.967612+0000 mgr.a (mgr.14388) 6738 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:18 smithi044 bash[22676]: cluster 2024-09-21T00:50:16.968402+0000 mgr.a (mgr.14388) 6739 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:18 smithi179 bash[23186]: cluster 2024-09-21T00:50:16.968402+0000 mgr.a (mgr.14388) 6739 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:19.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:18 smithi049 bash[23528]: cluster 2024-09-21T00:50:16.968402+0000 mgr.a (mgr.14388) 6739 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:19.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:19.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:19.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:20.628 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:20.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:20 smithi044 bash[22676]: cluster 2024-09-21T00:50:18.969167+0000 mgr.a (mgr.14388) 6740 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:20 smithi179 bash[23186]: cluster 2024-09-21T00:50:18.969167+0000 mgr.a (mgr.14388) 6740 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:20 smithi049 bash[23528]: cluster 2024-09-21T00:50:18.969167+0000 mgr.a (mgr.14388) 6740 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:21 smithi044 bash[22676]: audit 2024-09-21T00:50:20.178003+0000 mgr.a (mgr.14388) 6741 : audit [DBG] from='client.153726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:21 smithi179 bash[23186]: audit 2024-09-21T00:50:20.178003+0000 mgr.a (mgr.14388) 6741 : audit [DBG] from='client.153726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:22.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:21 smithi049 bash[23528]: audit 2024-09-21T00:50:20.178003+0000 mgr.a (mgr.14388) 6741 : audit [DBG] from='client.153726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:22 smithi044 bash[22676]: cluster 2024-09-21T00:50:20.971889+0000 mgr.a (mgr.14388) 6742 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:22 smithi044 bash[22676]: audit 2024-09-21T00:50:22.528626+0000 mon.a (mon.0) 5880 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:22 smithi044 bash[22676]: audit 2024-09-21T00:50:22.536233+0000 mon.a (mon.0) 5881 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:22 smithi044 bash[22676]: audit 2024-09-21T00:50:22.538210+0000 mon.a (mon.0) 5882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:50:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:22 smithi044 bash[22676]: audit 2024-09-21T00:50:22.549588+0000 mon.a (mon.0) 5883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:22 smithi044 bash[22676]: audit 2024-09-21T00:50:22.555989+0000 mon.a (mon.0) 5884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:50:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:22 smithi179 bash[23186]: cluster 2024-09-21T00:50:20.971889+0000 mgr.a (mgr.14388) 6742 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:22 smithi179 bash[23186]: audit 2024-09-21T00:50:22.528626+0000 mon.a (mon.0) 5880 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:22 smithi179 bash[23186]: audit 2024-09-21T00:50:22.536233+0000 mon.a (mon.0) 5881 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:22 smithi179 bash[23186]: audit 2024-09-21T00:50:22.538210+0000 mon.a (mon.0) 5882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:50:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:22 smithi179 bash[23186]: audit 2024-09-21T00:50:22.549588+0000 mon.a (mon.0) 5883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:22 smithi179 bash[23186]: audit 2024-09-21T00:50:22.555989+0000 mon.a (mon.0) 5884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:50:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:22 smithi049 bash[23528]: cluster 2024-09-21T00:50:20.971889+0000 mgr.a (mgr.14388) 6742 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:22 smithi049 bash[23528]: audit 2024-09-21T00:50:22.528626+0000 mon.a (mon.0) 5880 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:22 smithi049 bash[23528]: audit 2024-09-21T00:50:22.536233+0000 mon.a (mon.0) 5881 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:22 smithi049 bash[23528]: audit 2024-09-21T00:50:22.538210+0000 mon.a (mon.0) 5882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:50:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:22 smithi049 bash[23528]: audit 2024-09-21T00:50:22.549588+0000 mon.a (mon.0) 5883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:22 smithi049 bash[23528]: audit 2024-09-21T00:50:22.555989+0000 mon.a (mon.0) 5884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:50:23.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:50:23 smithi044 bash[22930]: debug 2024-09-21T00:50:23.342+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:50:23.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:50:23 smithi044 bash[22930]: debug 2024-09-21T00:50:23.342+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:50:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:23 smithi044 bash[22676]: audit 2024-09-21T00:50:22.558557+0000 mgr.a (mgr.14388) 6743 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:50:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:23 smithi179 bash[23186]: audit 2024-09-21T00:50:22.558557+0000 mgr.a (mgr.14388) 6743 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:50:24.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:23 smithi049 bash[23528]: audit 2024-09-21T00:50:22.558557+0000 mgr.a (mgr.14388) 6743 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:50:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:24 smithi044 bash[22676]: cluster 2024-09-21T00:50:22.972471+0000 mgr.a (mgr.14388) 6744 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:50:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:24 smithi044 bash[22676]: audit 2024-09-21T00:50:23.347518+0000 mgr.a (mgr.14388) 6745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:50:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:24 smithi044 bash[22676]: cephadm 2024-09-21T00:50:23.349015+0000 mgr.a (mgr.14388) 6746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:50:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:24 smithi179 bash[23186]: cluster 2024-09-21T00:50:22.972471+0000 mgr.a (mgr.14388) 6744 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:50:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:24 smithi179 bash[23186]: audit 2024-09-21T00:50:23.347518+0000 mgr.a (mgr.14388) 6745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:50:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:24 smithi179 bash[23186]: cephadm 2024-09-21T00:50:23.349015+0000 mgr.a (mgr.14388) 6746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:50:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:24 smithi049 bash[23528]: cluster 2024-09-21T00:50:22.972471+0000 mgr.a (mgr.14388) 6744 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:50:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:24 smithi049 bash[23528]: audit 2024-09-21T00:50:23.347518+0000 mgr.a (mgr.14388) 6745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:50:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:24 smithi049 bash[23528]: cephadm 2024-09-21T00:50:23.349015+0000 mgr.a (mgr.14388) 6746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:50:25.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:25.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:25.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:26.412 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:26.412 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:26.412 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:26.412 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:26.412 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:26 smithi044 bash[22676]: cluster 2024-09-21T00:50:24.974673+0000 mgr.a (mgr.14388) 6747 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:26 smithi179 bash[23186]: cluster 2024-09-21T00:50:24.974673+0000 mgr.a (mgr.14388) 6747 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:26 smithi049 bash[23528]: cluster 2024-09-21T00:50:24.974673+0000 mgr.a (mgr.14388) 6747 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:27 smithi044 bash[22676]: audit 2024-09-21T00:50:25.968790+0000 mgr.a (mgr.14388) 6748 : audit [DBG] from='client.153909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:28.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:27 smithi179 bash[23186]: audit 2024-09-21T00:50:25.968790+0000 mgr.a (mgr.14388) 6748 : audit [DBG] from='client.153909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:27 smithi049 bash[23528]: audit 2024-09-21T00:50:25.968790+0000 mgr.a (mgr.14388) 6748 : audit [DBG] from='client.153909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:29.136 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:28 smithi179 bash[23186]: cluster 2024-09-21T00:50:26.975673+0000 mgr.a (mgr.14388) 6749 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:50:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:28 smithi044 bash[22676]: cluster 2024-09-21T00:50:26.975673+0000 mgr.a (mgr.14388) 6749 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:50:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:28 smithi049 bash[23528]: cluster 2024-09-21T00:50:26.975673+0000 mgr.a (mgr.14388) 6749 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:50:30.474 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:30 smithi044 bash[22676]: cluster 2024-09-21T00:50:28.976467+0000 mgr.a (mgr.14388) 6750 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:50:30.474 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:30 smithi044 bash[22676]: audit 2024-09-21T00:50:29.402101+0000 mon.a (mon.0) 5885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.474 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:30 smithi044 bash[22676]: audit 2024-09-21T00:50:29.411081+0000 mon.a (mon.0) 5886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.474 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:30 smithi044 bash[22676]: audit 2024-09-21T00:50:29.422731+0000 mon.a (mon.0) 5887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:30 smithi179 bash[23186]: cluster 2024-09-21T00:50:28.976467+0000 mgr.a (mgr.14388) 6750 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:50:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:30 smithi179 bash[23186]: audit 2024-09-21T00:50:29.402101+0000 mon.a (mon.0) 5885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:30 smithi179 bash[23186]: audit 2024-09-21T00:50:29.411081+0000 mon.a (mon.0) 5886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:30 smithi179 bash[23186]: audit 2024-09-21T00:50:29.422731+0000 mon.a (mon.0) 5887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:30 smithi049 bash[23528]: cluster 2024-09-21T00:50:28.976467+0000 mgr.a (mgr.14388) 6750 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:50:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:30 smithi049 bash[23528]: audit 2024-09-21T00:50:29.402101+0000 mon.a (mon.0) 5885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:30 smithi049 bash[23528]: audit 2024-09-21T00:50:29.411081+0000 mon.a (mon.0) 5886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:30 smithi049 bash[23528]: audit 2024-09-21T00:50:29.422731+0000 mon.a (mon.0) 5887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:31.413 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:31.414 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:31.414 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:32.213 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:32.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:32.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:32.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:32.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:31 smithi044 bash[22676]: audit 2024-09-21T00:50:30.899692+0000 mon.a (mon.0) 5888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:31 smithi044 bash[22676]: audit 2024-09-21T00:50:30.904253+0000 mon.a (mon.0) 5889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:31 smithi044 bash[22676]: audit 2024-09-21T00:50:30.910031+0000 mon.a (mon.0) 5890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:31 smithi044 bash[22676]: audit 2024-09-21T00:50:31.021335+0000 mon.a (mon.0) 5891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:31 smithi044 bash[22676]: audit 2024-09-21T00:50:31.029297+0000 mon.a (mon.0) 5892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:31 smithi044 bash[22676]: audit 2024-09-21T00:50:31.038856+0000 mon.a (mon.0) 5893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:31 smithi179 bash[23186]: audit 2024-09-21T00:50:30.899692+0000 mon.a (mon.0) 5888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:31 smithi179 bash[23186]: audit 2024-09-21T00:50:30.904253+0000 mon.a (mon.0) 5889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:31 smithi179 bash[23186]: audit 2024-09-21T00:50:30.910031+0000 mon.a (mon.0) 5890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:31 smithi179 bash[23186]: audit 2024-09-21T00:50:31.021335+0000 mon.a (mon.0) 5891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:31 smithi179 bash[23186]: audit 2024-09-21T00:50:31.029297+0000 mon.a (mon.0) 5892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:31 smithi179 bash[23186]: audit 2024-09-21T00:50:31.038856+0000 mon.a (mon.0) 5893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:31 smithi049 bash[23528]: audit 2024-09-21T00:50:30.899692+0000 mon.a (mon.0) 5888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:31 smithi049 bash[23528]: audit 2024-09-21T00:50:30.904253+0000 mon.a (mon.0) 5889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:31 smithi049 bash[23528]: audit 2024-09-21T00:50:30.910031+0000 mon.a (mon.0) 5890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:31 smithi049 bash[23528]: audit 2024-09-21T00:50:31.021335+0000 mon.a (mon.0) 5891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:31 smithi049 bash[23528]: audit 2024-09-21T00:50:31.029297+0000 mon.a (mon.0) 5892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:31 smithi049 bash[23528]: audit 2024-09-21T00:50:31.038856+0000 mon.a (mon.0) 5893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:33.164 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:32 smithi049 bash[23528]: cluster 2024-09-21T00:50:30.977684+0000 mgr.a (mgr.14388) 6751 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:33.164 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:32 smithi049 bash[23528]: audit 2024-09-21T00:50:31.754396+0000 mgr.a (mgr.14388) 6752 : audit [DBG] from='client.153987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:32 smithi044 bash[22676]: cluster 2024-09-21T00:50:30.977684+0000 mgr.a (mgr.14388) 6751 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:32 smithi044 bash[22676]: audit 2024-09-21T00:50:31.754396+0000 mgr.a (mgr.14388) 6752 : audit [DBG] from='client.153987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:32 smithi179 bash[23186]: cluster 2024-09-21T00:50:30.977684+0000 mgr.a (mgr.14388) 6751 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:32 smithi179 bash[23186]: audit 2024-09-21T00:50:31.754396+0000 mgr.a (mgr.14388) 6752 : audit [DBG] from='client.153987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:34 smithi044 bash[22676]: cluster 2024-09-21T00:50:32.978577+0000 mgr.a (mgr.14388) 6753 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:34 smithi179 bash[23186]: cluster 2024-09-21T00:50:32.978577+0000 mgr.a (mgr.14388) 6753 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:34 smithi049 bash[23528]: cluster 2024-09-21T00:50:32.978577+0000 mgr.a (mgr.14388) 6753 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:37.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:36 smithi044 bash[22676]: cluster 2024-09-21T00:50:34.980693+0000 mgr.a (mgr.14388) 6754 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:36 smithi179 bash[23186]: cluster 2024-09-21T00:50:34.980693+0000 mgr.a (mgr.14388) 6754 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:36 smithi049 bash[23528]: cluster 2024-09-21T00:50:34.980693+0000 mgr.a (mgr.14388) 6754 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:50:37.994 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:38 smithi044 bash[22676]: cluster 2024-09-21T00:50:36.981633+0000 mgr.a (mgr.14388) 6755 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:38 smithi044 bash[22676]: audit 2024-09-21T00:50:37.549340+0000 mgr.a (mgr.14388) 6756 : audit [DBG] from='client.154062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:38 smithi179 bash[23186]: cluster 2024-09-21T00:50:36.981633+0000 mgr.a (mgr.14388) 6755 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:38 smithi179 bash[23186]: audit 2024-09-21T00:50:37.549340+0000 mgr.a (mgr.14388) 6756 : audit [DBG] from='client.154062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:39.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:38 smithi049 bash[23528]: cluster 2024-09-21T00:50:36.981633+0000 mgr.a (mgr.14388) 6755 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:38 smithi049 bash[23528]: audit 2024-09-21T00:50:37.549340+0000 mgr.a (mgr.14388) 6756 : audit [DBG] from='client.154062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:40 smithi044 bash[22676]: cluster 2024-09-21T00:50:38.982570+0000 mgr.a (mgr.14388) 6757 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:40 smithi179 bash[23186]: cluster 2024-09-21T00:50:38.982570+0000 mgr.a (mgr.14388) 6757 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:40 smithi049 bash[23528]: cluster 2024-09-21T00:50:38.982570+0000 mgr.a (mgr.14388) 6757 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:42.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:42 smithi044 bash[22676]: cluster 2024-09-21T00:50:40.984939+0000 mgr.a (mgr.14388) 6758 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:42 smithi179 bash[23186]: cluster 2024-09-21T00:50:40.984939+0000 mgr.a (mgr.14388) 6758 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:42 smithi049 bash[23528]: cluster 2024-09-21T00:50:40.984939+0000 mgr.a (mgr.14388) 6758 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:43.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:43.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:43.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:43.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:43.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:44 smithi044 bash[22676]: cluster 2024-09-21T00:50:42.985751+0000 mgr.a (mgr.14388) 6759 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:44 smithi044 bash[22676]: audit 2024-09-21T00:50:43.325508+0000 mgr.a (mgr.14388) 6760 : audit [DBG] from='client.154137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:44 smithi179 bash[23186]: cluster 2024-09-21T00:50:42.985751+0000 mgr.a (mgr.14388) 6759 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:44 smithi179 bash[23186]: audit 2024-09-21T00:50:43.325508+0000 mgr.a (mgr.14388) 6760 : audit [DBG] from='client.154137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:44 smithi049 bash[23528]: cluster 2024-09-21T00:50:42.985751+0000 mgr.a (mgr.14388) 6759 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:44 smithi049 bash[23528]: audit 2024-09-21T00:50:43.325508+0000 mgr.a (mgr.14388) 6760 : audit [DBG] from='client.154137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:46 smithi044 bash[22676]: cluster 2024-09-21T00:50:44.988019+0000 mgr.a (mgr.14388) 6761 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:46 smithi179 bash[23186]: cluster 2024-09-21T00:50:44.988019+0000 mgr.a (mgr.14388) 6761 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:46 smithi049 bash[23528]: cluster 2024-09-21T00:50:44.988019+0000 mgr.a (mgr.14388) 6761 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:48.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:48.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:48.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:49.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:48 smithi179 bash[23186]: cluster 2024-09-21T00:50:46.988819+0000 mgr.a (mgr.14388) 6762 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:48 smithi044 bash[22676]: cluster 2024-09-21T00:50:46.988819+0000 mgr.a (mgr.14388) 6762 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:49.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:48 smithi049 bash[23528]: cluster 2024-09-21T00:50:46.988819+0000 mgr.a (mgr.14388) 6762 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:49.508 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:49.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:49.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:49.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:49.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:50 smithi044 bash[22676]: cluster 2024-09-21T00:50:48.989568+0000 mgr.a (mgr.14388) 6763 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:50 smithi044 bash[22676]: audit 2024-09-21T00:50:49.079351+0000 mgr.a (mgr.14388) 6764 : audit [DBG] from='client.154215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:50 smithi044 bash[22676]: audit 2024-09-21T00:50:49.590586+0000 mon.a (mon.0) 5894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:50 smithi044 bash[22676]: audit 2024-09-21T00:50:49.597765+0000 mon.a (mon.0) 5895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:50 smithi044 bash[22676]: audit 2024-09-21T00:50:49.607388+0000 mon.a (mon.0) 5896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:50 smithi179 bash[23186]: cluster 2024-09-21T00:50:48.989568+0000 mgr.a (mgr.14388) 6763 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:50 smithi179 bash[23186]: audit 2024-09-21T00:50:49.079351+0000 mgr.a (mgr.14388) 6764 : audit [DBG] from='client.154215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:50 smithi179 bash[23186]: audit 2024-09-21T00:50:49.590586+0000 mon.a (mon.0) 5894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:50 smithi179 bash[23186]: audit 2024-09-21T00:50:49.597765+0000 mon.a (mon.0) 5895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:50 smithi179 bash[23186]: audit 2024-09-21T00:50:49.607388+0000 mon.a (mon.0) 5896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:50 smithi049 bash[23528]: cluster 2024-09-21T00:50:48.989568+0000 mgr.a (mgr.14388) 6763 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:50 smithi049 bash[23528]: audit 2024-09-21T00:50:49.079351+0000 mgr.a (mgr.14388) 6764 : audit [DBG] from='client.154215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:50 smithi049 bash[23528]: audit 2024-09-21T00:50:49.590586+0000 mon.a (mon.0) 5894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:50 smithi049 bash[23528]: audit 2024-09-21T00:50:49.597765+0000 mon.a (mon.0) 5895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:50 smithi049 bash[23528]: audit 2024-09-21T00:50:49.607388+0000 mon.a (mon.0) 5896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:52 smithi044 bash[22676]: cluster 2024-09-21T00:50:50.991098+0000 mgr.a (mgr.14388) 6765 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:52 smithi044 bash[22676]: audit 2024-09-21T00:50:51.123535+0000 mon.a (mon.0) 5897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:52 smithi044 bash[22676]: audit 2024-09-21T00:50:51.130430+0000 mon.a (mon.0) 5898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:52 smithi044 bash[22676]: audit 2024-09-21T00:50:51.138288+0000 mon.a (mon.0) 5899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:52 smithi044 bash[22676]: audit 2024-09-21T00:50:51.237205+0000 mon.a (mon.0) 5900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:52 smithi044 bash[22676]: audit 2024-09-21T00:50:51.246794+0000 mon.a (mon.0) 5901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:52 smithi044 bash[22676]: audit 2024-09-21T00:50:51.258577+0000 mon.a (mon.0) 5902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:52 smithi179 bash[23186]: cluster 2024-09-21T00:50:50.991098+0000 mgr.a (mgr.14388) 6765 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:52 smithi179 bash[23186]: audit 2024-09-21T00:50:51.123535+0000 mon.a (mon.0) 5897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:52 smithi179 bash[23186]: audit 2024-09-21T00:50:51.130430+0000 mon.a (mon.0) 5898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:52 smithi179 bash[23186]: audit 2024-09-21T00:50:51.138288+0000 mon.a (mon.0) 5899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:52 smithi179 bash[23186]: audit 2024-09-21T00:50:51.237205+0000 mon.a (mon.0) 5900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:52 smithi179 bash[23186]: audit 2024-09-21T00:50:51.246794+0000 mon.a (mon.0) 5901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:52 smithi179 bash[23186]: audit 2024-09-21T00:50:51.258577+0000 mon.a (mon.0) 5902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:52 smithi049 bash[23528]: cluster 2024-09-21T00:50:50.991098+0000 mgr.a (mgr.14388) 6765 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:50:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:52 smithi049 bash[23528]: audit 2024-09-21T00:50:51.123535+0000 mon.a (mon.0) 5897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:52 smithi049 bash[23528]: audit 2024-09-21T00:50:51.130430+0000 mon.a (mon.0) 5898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:52 smithi049 bash[23528]: audit 2024-09-21T00:50:51.138288+0000 mon.a (mon.0) 5899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:52 smithi049 bash[23528]: audit 2024-09-21T00:50:51.237205+0000 mon.a (mon.0) 5900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:52 smithi049 bash[23528]: audit 2024-09-21T00:50:51.246794+0000 mon.a (mon.0) 5901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:52 smithi049 bash[23528]: audit 2024-09-21T00:50:51.258577+0000 mon.a (mon.0) 5902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:50:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:54 smithi044 bash[22676]: cluster 2024-09-21T00:50:52.991863+0000 mgr.a (mgr.14388) 6766 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:54 smithi179 bash[23186]: cluster 2024-09-21T00:50:52.991863+0000 mgr.a (mgr.14388) 6766 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:50:54.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:50:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:50:54.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:54 smithi049 bash[23528]: cluster 2024-09-21T00:50:52.991863+0000 mgr.a (mgr.14388) 6766 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:55.274 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:50:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:50:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:50:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:50:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:50:55.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:55 smithi049 bash[23528]: audit 2024-09-21T00:50:54.845826+0000 mgr.a (mgr.14388) 6767 : audit [DBG] from='client.154293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:55 smithi044 bash[22676]: audit 2024-09-21T00:50:54.845826+0000 mgr.a (mgr.14388) 6767 : audit [DBG] from='client.154293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:55 smithi179 bash[23186]: audit 2024-09-21T00:50:54.845826+0000 mgr.a (mgr.14388) 6767 : audit [DBG] from='client.154293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:56 smithi044 bash[22676]: cluster 2024-09-21T00:50:54.993305+0000 mgr.a (mgr.14388) 6768 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:56 smithi179 bash[23186]: cluster 2024-09-21T00:50:54.993305+0000 mgr.a (mgr.14388) 6768 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:56.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:56 smithi049 bash[23528]: cluster 2024-09-21T00:50:54.993305+0000 mgr.a (mgr.14388) 6768 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:50:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:50:58 smithi044 bash[22676]: cluster 2024-09-21T00:50:56.994195+0000 mgr.a (mgr.14388) 6769 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:50:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:50:58 smithi179 bash[23186]: cluster 2024-09-21T00:50:56.994195+0000 mgr.a (mgr.14388) 6769 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:50:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:50:58 smithi049 bash[23528]: cluster 2024-09-21T00:50:56.994195+0000 mgr.a (mgr.14388) 6769 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:00.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:00 smithi044 bash[22676]: cluster 2024-09-21T00:50:58.994960+0000 mgr.a (mgr.14388) 6770 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:00 smithi179 bash[23186]: cluster 2024-09-21T00:50:58.994960+0000 mgr.a (mgr.14388) 6770 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:00 smithi049 bash[23528]: cluster 2024-09-21T00:50:58.994960+0000 mgr.a (mgr.14388) 6770 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:01.031 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:01.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:01.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:01.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:01.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:01 smithi044 bash[22676]: audit 2024-09-21T00:51:00.608279+0000 mgr.a (mgr.14388) 6771 : audit [DBG] from='client.154371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:01 smithi179 bash[23186]: audit 2024-09-21T00:51:00.608279+0000 mgr.a (mgr.14388) 6771 : audit [DBG] from='client.154371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:01.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:01 smithi049 bash[23528]: audit 2024-09-21T00:51:00.608279+0000 mgr.a (mgr.14388) 6771 : audit [DBG] from='client.154371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:02 smithi044 bash[22676]: cluster 2024-09-21T00:51:00.996445+0000 mgr.a (mgr.14388) 6772 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:02 smithi179 bash[23186]: cluster 2024-09-21T00:51:00.996445+0000 mgr.a (mgr.14388) 6772 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:02.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:02 smithi049 bash[23528]: cluster 2024-09-21T00:51:00.996445+0000 mgr.a (mgr.14388) 6772 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:04 smithi044 bash[22676]: cluster 2024-09-21T00:51:02.997179+0000 mgr.a (mgr.14388) 6773 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:04 smithi179 bash[23186]: cluster 2024-09-21T00:51:02.997179+0000 mgr.a (mgr.14388) 6773 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:04.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:04 smithi049 bash[23528]: cluster 2024-09-21T00:51:02.997179+0000 mgr.a (mgr.14388) 6773 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:06.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:06.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:06.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:06 smithi044 bash[22676]: cluster 2024-09-21T00:51:04.999102+0000 mgr.a (mgr.14388) 6774 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:06 smithi179 bash[23186]: cluster 2024-09-21T00:51:04.999102+0000 mgr.a (mgr.14388) 6774 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:06.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:06 smithi049 bash[23528]: cluster 2024-09-21T00:51:04.999102+0000 mgr.a (mgr.14388) 6774 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:06.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:06.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:06.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:06.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:06.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:07 smithi044 bash[22676]: audit 2024-09-21T00:51:06.374889+0000 mgr.a (mgr.14388) 6775 : audit [DBG] from='client.154446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:07 smithi179 bash[23186]: audit 2024-09-21T00:51:06.374889+0000 mgr.a (mgr.14388) 6775 : audit [DBG] from='client.154446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:07.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:07 smithi049 bash[23528]: audit 2024-09-21T00:51:06.374889+0000 mgr.a (mgr.14388) 6775 : audit [DBG] from='client.154446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:08 smithi044 bash[22676]: cluster 2024-09-21T00:51:07.000044+0000 mgr.a (mgr.14388) 6776 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:08 smithi179 bash[23186]: cluster 2024-09-21T00:51:07.000044+0000 mgr.a (mgr.14388) 6776 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:08.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:08 smithi049 bash[23528]: cluster 2024-09-21T00:51:07.000044+0000 mgr.a (mgr.14388) 6776 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:10 smithi044 bash[22676]: cluster 2024-09-21T00:51:09.000819+0000 mgr.a (mgr.14388) 6777 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:10 smithi044 bash[22676]: audit 2024-09-21T00:51:09.835479+0000 mon.a (mon.0) 5903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:10 smithi044 bash[22676]: audit 2024-09-21T00:51:09.843968+0000 mon.a (mon.0) 5904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:10 smithi044 bash[22676]: audit 2024-09-21T00:51:09.854554+0000 mon.a (mon.0) 5905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:10 smithi179 bash[23186]: cluster 2024-09-21T00:51:09.000819+0000 mgr.a (mgr.14388) 6777 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:10 smithi179 bash[23186]: audit 2024-09-21T00:51:09.835479+0000 mon.a (mon.0) 5903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:10 smithi179 bash[23186]: audit 2024-09-21T00:51:09.843968+0000 mon.a (mon.0) 5904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:10 smithi179 bash[23186]: audit 2024-09-21T00:51:09.854554+0000 mon.a (mon.0) 5905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:10 smithi049 bash[23528]: cluster 2024-09-21T00:51:09.000819+0000 mgr.a (mgr.14388) 6777 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:10 smithi049 bash[23528]: audit 2024-09-21T00:51:09.835479+0000 mon.a (mon.0) 5903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:10 smithi049 bash[23528]: audit 2024-09-21T00:51:09.843968+0000 mon.a (mon.0) 5904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:10 smithi049 bash[23528]: audit 2024-09-21T00:51:09.854554+0000 mon.a (mon.0) 5905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:11.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:11.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:11.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:12 smithi049 bash[23528]: cluster 2024-09-21T00:51:11.003190+0000 mgr.a (mgr.14388) 6778 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:12 smithi049 bash[23528]: audit 2024-09-21T00:51:11.283366+0000 mon.a (mon.0) 5906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:12 smithi049 bash[23528]: audit 2024-09-21T00:51:11.287602+0000 mon.a (mon.0) 5907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:12 smithi049 bash[23528]: audit 2024-09-21T00:51:11.293811+0000 mon.a (mon.0) 5908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:12 smithi049 bash[23528]: audit 2024-09-21T00:51:11.468541+0000 mon.a (mon.0) 5909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:12 smithi049 bash[23528]: audit 2024-09-21T00:51:11.478253+0000 mon.a (mon.0) 5910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:12 smithi049 bash[23528]: audit 2024-09-21T00:51:11.489811+0000 mon.a (mon.0) 5911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:12.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:12.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:12.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:12.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:12 smithi044 bash[22676]: cluster 2024-09-21T00:51:11.003190+0000 mgr.a (mgr.14388) 6778 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:12 smithi044 bash[22676]: audit 2024-09-21T00:51:11.283366+0000 mon.a (mon.0) 5906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:12 smithi044 bash[22676]: audit 2024-09-21T00:51:11.287602+0000 mon.a (mon.0) 5907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:12 smithi044 bash[22676]: audit 2024-09-21T00:51:11.293811+0000 mon.a (mon.0) 5908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:12 smithi044 bash[22676]: audit 2024-09-21T00:51:11.468541+0000 mon.a (mon.0) 5909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:12 smithi044 bash[22676]: audit 2024-09-21T00:51:11.478253+0000 mon.a (mon.0) 5910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:12 smithi044 bash[22676]: audit 2024-09-21T00:51:11.489811+0000 mon.a (mon.0) 5911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:12 smithi179 bash[23186]: cluster 2024-09-21T00:51:11.003190+0000 mgr.a (mgr.14388) 6778 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:12 smithi179 bash[23186]: audit 2024-09-21T00:51:11.283366+0000 mon.a (mon.0) 5906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:12 smithi179 bash[23186]: audit 2024-09-21T00:51:11.287602+0000 mon.a (mon.0) 5907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:12 smithi179 bash[23186]: audit 2024-09-21T00:51:11.293811+0000 mon.a (mon.0) 5908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:12 smithi179 bash[23186]: audit 2024-09-21T00:51:11.468541+0000 mon.a (mon.0) 5909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:12 smithi179 bash[23186]: audit 2024-09-21T00:51:11.478253+0000 mon.a (mon.0) 5910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:12 smithi179 bash[23186]: audit 2024-09-21T00:51:11.489811+0000 mon.a (mon.0) 5911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:13.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:13 smithi049 bash[23528]: audit 2024-09-21T00:51:12.164376+0000 mgr.a (mgr.14388) 6779 : audit [DBG] from='client.154524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:13 smithi044 bash[22676]: audit 2024-09-21T00:51:12.164376+0000 mgr.a (mgr.14388) 6779 : audit [DBG] from='client.154524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:13 smithi179 bash[23186]: audit 2024-09-21T00:51:12.164376+0000 mgr.a (mgr.14388) 6779 : audit [DBG] from='client.154524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:14.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:14 smithi049 bash[23528]: cluster 2024-09-21T00:51:13.003847+0000 mgr.a (mgr.14388) 6780 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:14 smithi044 bash[22676]: cluster 2024-09-21T00:51:13.003847+0000 mgr.a (mgr.14388) 6780 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:14 smithi179 bash[23186]: cluster 2024-09-21T00:51:13.003847+0000 mgr.a (mgr.14388) 6780 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:16.576 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:16 smithi049 bash[23528]: cluster 2024-09-21T00:51:15.005980+0000 mgr.a (mgr.14388) 6781 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:16 smithi044 bash[22676]: cluster 2024-09-21T00:51:15.005980+0000 mgr.a (mgr.14388) 6781 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:16 smithi179 bash[23186]: cluster 2024-09-21T00:51:15.005980+0000 mgr.a (mgr.14388) 6781 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:17.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:17.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:17.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:18.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:18.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:18.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:18.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:18 smithi044 bash[22676]: cluster 2024-09-21T00:51:17.006742+0000 mgr.a (mgr.14388) 6782 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:18 smithi044 bash[22676]: audit 2024-09-21T00:51:17.951360+0000 mgr.a (mgr.14388) 6783 : audit [DBG] from='client.154599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:18 smithi179 bash[23186]: cluster 2024-09-21T00:51:17.006742+0000 mgr.a (mgr.14388) 6782 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:18 smithi179 bash[23186]: audit 2024-09-21T00:51:17.951360+0000 mgr.a (mgr.14388) 6783 : audit [DBG] from='client.154599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:18 smithi049 bash[23528]: cluster 2024-09-21T00:51:17.006742+0000 mgr.a (mgr.14388) 6782 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:18 smithi049 bash[23528]: audit 2024-09-21T00:51:17.951360+0000 mgr.a (mgr.14388) 6783 : audit [DBG] from='client.154599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:20 smithi044 bash[22676]: cluster 2024-09-21T00:51:19.007634+0000 mgr.a (mgr.14388) 6784 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:20 smithi179 bash[23186]: cluster 2024-09-21T00:51:19.007634+0000 mgr.a (mgr.14388) 6784 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:20 smithi049 bash[23528]: cluster 2024-09-21T00:51:19.007634+0000 mgr.a (mgr.14388) 6784 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:22 smithi044 bash[22676]: cluster 2024-09-21T00:51:21.009874+0000 mgr.a (mgr.14388) 6785 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:22 smithi179 bash[23186]: cluster 2024-09-21T00:51:21.009874+0000 mgr.a (mgr.14388) 6785 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:22.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:22 smithi049 bash[23528]: cluster 2024-09-21T00:51:21.009874+0000 mgr.a (mgr.14388) 6785 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:23.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:24.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22930]: debug 2024-09-21T00:51:24.209+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:51:24.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22930]: debug 2024-09-21T00:51:24.221+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:51:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: cluster 2024-09-21T00:51:23.010623+0000 mgr.a (mgr.14388) 6786 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: audit 2024-09-21T00:51:23.414953+0000 mon.a (mon.0) 5912 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: audit 2024-09-21T00:51:23.421644+0000 mon.a (mon.0) 5913 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: audit 2024-09-21T00:51:23.423321+0000 mon.a (mon.0) 5914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: audit 2024-09-21T00:51:23.434041+0000 mon.a (mon.0) 5915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: audit 2024-09-21T00:51:23.440604+0000 mon.a (mon.0) 5916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:51:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: audit 2024-09-21T00:51:23.443012+0000 mgr.a (mgr.14388) 6787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:51:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:24 smithi044 bash[22676]: audit 2024-09-21T00:51:23.742839+0000 mgr.a (mgr.14388) 6788 : audit [DBG] from='client.154674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:24.635 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:24.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:24.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:24.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:24.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: cluster 2024-09-21T00:51:23.010623+0000 mgr.a (mgr.14388) 6786 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: audit 2024-09-21T00:51:23.414953+0000 mon.a (mon.0) 5912 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: audit 2024-09-21T00:51:23.421644+0000 mon.a (mon.0) 5913 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: audit 2024-09-21T00:51:23.423321+0000 mon.a (mon.0) 5914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: audit 2024-09-21T00:51:23.434041+0000 mon.a (mon.0) 5915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: audit 2024-09-21T00:51:23.440604+0000 mon.a (mon.0) 5916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: audit 2024-09-21T00:51:23.443012+0000 mgr.a (mgr.14388) 6787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:51:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:24 smithi179 bash[23186]: audit 2024-09-21T00:51:23.742839+0000 mgr.a (mgr.14388) 6788 : audit [DBG] from='client.154674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: cluster 2024-09-21T00:51:23.010623+0000 mgr.a (mgr.14388) 6786 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: audit 2024-09-21T00:51:23.414953+0000 mon.a (mon.0) 5912 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: audit 2024-09-21T00:51:23.421644+0000 mon.a (mon.0) 5913 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: audit 2024-09-21T00:51:23.423321+0000 mon.a (mon.0) 5914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: audit 2024-09-21T00:51:23.434041+0000 mon.a (mon.0) 5915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: audit 2024-09-21T00:51:23.440604+0000 mon.a (mon.0) 5916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:51:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: audit 2024-09-21T00:51:23.443012+0000 mgr.a (mgr.14388) 6787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:51:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:24 smithi049 bash[23528]: audit 2024-09-21T00:51:23.742839+0000 mgr.a (mgr.14388) 6788 : audit [DBG] from='client.154674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:25.655 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:25 smithi044 bash[22676]: audit 2024-09-21T00:51:24.213595+0000 mgr.a (mgr.14388) 6789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:51:25.655 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:25 smithi044 bash[22676]: cephadm 2024-09-21T00:51:24.226154+0000 mgr.a (mgr.14388) 6790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:51:25.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:25 smithi179 bash[23186]: audit 2024-09-21T00:51:24.213595+0000 mgr.a (mgr.14388) 6789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:51:25.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:25 smithi179 bash[23186]: cephadm 2024-09-21T00:51:24.226154+0000 mgr.a (mgr.14388) 6790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:51:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:25 smithi049 bash[23528]: audit 2024-09-21T00:51:24.213595+0000 mgr.a (mgr.14388) 6789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:51:25.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:25 smithi049 bash[23528]: cephadm 2024-09-21T00:51:24.226154+0000 mgr.a (mgr.14388) 6790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:51:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:26 smithi044 bash[22676]: cluster 2024-09-21T00:51:25.012773+0000 mgr.a (mgr.14388) 6791 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:26 smithi179 bash[23186]: cluster 2024-09-21T00:51:25.012773+0000 mgr.a (mgr.14388) 6791 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:26 smithi049 bash[23528]: cluster 2024-09-21T00:51:25.012773+0000 mgr.a (mgr.14388) 6791 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:28 smithi044 bash[22676]: cluster 2024-09-21T00:51:27.013587+0000 mgr.a (mgr.14388) 6792 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:28 smithi179 bash[23186]: cluster 2024-09-21T00:51:27.013587+0000 mgr.a (mgr.14388) 6792 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:28.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:28 smithi049 bash[23528]: cluster 2024-09-21T00:51:27.013587+0000 mgr.a (mgr.14388) 6792 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:29.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:29.637 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:29.637 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:30.398 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:30.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:30.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:30.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:30.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:30.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:30 smithi044 bash[22676]: cluster 2024-09-21T00:51:29.014477+0000 mgr.a (mgr.14388) 6793 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:30.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:30 smithi044 bash[22676]: audit 2024-09-21T00:51:30.040886+0000 mon.a (mon.0) 5917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:30 smithi044 bash[22676]: audit 2024-09-21T00:51:30.048969+0000 mon.a (mon.0) 5918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:30 smithi044 bash[22676]: audit 2024-09-21T00:51:30.055006+0000 mon.a (mon.0) 5919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:30 smithi179 bash[23186]: cluster 2024-09-21T00:51:29.014477+0000 mgr.a (mgr.14388) 6793 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:30 smithi179 bash[23186]: audit 2024-09-21T00:51:30.040886+0000 mon.a (mon.0) 5917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:30 smithi179 bash[23186]: audit 2024-09-21T00:51:30.048969+0000 mon.a (mon.0) 5918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:30 smithi179 bash[23186]: audit 2024-09-21T00:51:30.055006+0000 mon.a (mon.0) 5919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:30 smithi049 bash[23528]: cluster 2024-09-21T00:51:29.014477+0000 mgr.a (mgr.14388) 6793 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:30 smithi049 bash[23528]: audit 2024-09-21T00:51:30.040886+0000 mon.a (mon.0) 5917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:30 smithi049 bash[23528]: audit 2024-09-21T00:51:30.048969+0000 mon.a (mon.0) 5918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:30 smithi049 bash[23528]: audit 2024-09-21T00:51:30.055006+0000 mon.a (mon.0) 5919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:31 smithi179 bash[23186]: audit 2024-09-21T00:51:29.968470+0000 mgr.a (mgr.14388) 6794 : audit [DBG] from='client.154857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:31.723 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:31 smithi049 bash[23528]: audit 2024-09-21T00:51:29.968470+0000 mgr.a (mgr.14388) 6794 : audit [DBG] from='client.154857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:31.764 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:31 smithi044 bash[22676]: audit 2024-09-21T00:51:29.968470+0000 mgr.a (mgr.14388) 6794 : audit [DBG] from='client.154857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:32 smithi044 bash[22676]: cluster 2024-09-21T00:51:31.017294+0000 mgr.a (mgr.14388) 6795 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:32 smithi044 bash[22676]: audit 2024-09-21T00:51:31.449828+0000 mon.a (mon.0) 5920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:32 smithi044 bash[22676]: audit 2024-09-21T00:51:31.458548+0000 mon.a (mon.0) 5921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:32 smithi044 bash[22676]: audit 2024-09-21T00:51:31.464480+0000 mon.a (mon.0) 5922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:32 smithi044 bash[22676]: audit 2024-09-21T00:51:31.702080+0000 mon.a (mon.0) 5923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:32 smithi044 bash[22676]: audit 2024-09-21T00:51:31.710760+0000 mon.a (mon.0) 5924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:32 smithi044 bash[22676]: audit 2024-09-21T00:51:31.721067+0000 mon.a (mon.0) 5925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:32 smithi179 bash[23186]: cluster 2024-09-21T00:51:31.017294+0000 mgr.a (mgr.14388) 6795 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:32 smithi179 bash[23186]: audit 2024-09-21T00:51:31.449828+0000 mon.a (mon.0) 5920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:32 smithi179 bash[23186]: audit 2024-09-21T00:51:31.458548+0000 mon.a (mon.0) 5921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:32 smithi179 bash[23186]: audit 2024-09-21T00:51:31.464480+0000 mon.a (mon.0) 5922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:32 smithi179 bash[23186]: audit 2024-09-21T00:51:31.702080+0000 mon.a (mon.0) 5923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:32 smithi179 bash[23186]: audit 2024-09-21T00:51:31.710760+0000 mon.a (mon.0) 5924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:32 smithi179 bash[23186]: audit 2024-09-21T00:51:31.721067+0000 mon.a (mon.0) 5925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.787 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:32 smithi049 bash[23528]: cluster 2024-09-21T00:51:31.017294+0000 mgr.a (mgr.14388) 6795 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:32.787 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:32 smithi049 bash[23528]: audit 2024-09-21T00:51:31.449828+0000 mon.a (mon.0) 5920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.788 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:32 smithi049 bash[23528]: audit 2024-09-21T00:51:31.458548+0000 mon.a (mon.0) 5921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.788 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:32 smithi049 bash[23528]: audit 2024-09-21T00:51:31.464480+0000 mon.a (mon.0) 5922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.788 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:32 smithi049 bash[23528]: audit 2024-09-21T00:51:31.702080+0000 mon.a (mon.0) 5923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.788 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:32 smithi049 bash[23528]: audit 2024-09-21T00:51:31.710760+0000 mon.a (mon.0) 5924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:32.788 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:32 smithi049 bash[23528]: audit 2024-09-21T00:51:31.721067+0000 mon.a (mon.0) 5925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:34 smithi044 bash[22676]: cluster 2024-09-21T00:51:33.018086+0000 mgr.a (mgr.14388) 6796 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:51:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:34 smithi179 bash[23186]: cluster 2024-09-21T00:51:33.018086+0000 mgr.a (mgr.14388) 6796 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:51:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:34 smithi049 bash[23528]: cluster 2024-09-21T00:51:33.018086+0000 mgr.a (mgr.14388) 6796 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:51:35.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:35.400 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:35.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:36.192 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:36.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:36.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:36.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:36.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:36 smithi044 bash[22676]: cluster 2024-09-21T00:51:35.020004+0000 mgr.a (mgr.14388) 6797 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:36 smithi044 bash[22676]: audit 2024-09-21T00:51:35.736752+0000 mgr.a (mgr.14388) 6798 : audit [DBG] from='client.154932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:36 smithi179 bash[23186]: cluster 2024-09-21T00:51:35.020004+0000 mgr.a (mgr.14388) 6797 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:36 smithi179 bash[23186]: audit 2024-09-21T00:51:35.736752+0000 mgr.a (mgr.14388) 6798 : audit [DBG] from='client.154932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:36 smithi049 bash[23528]: cluster 2024-09-21T00:51:35.020004+0000 mgr.a (mgr.14388) 6797 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:51:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:36 smithi049 bash[23528]: audit 2024-09-21T00:51:35.736752+0000 mgr.a (mgr.14388) 6798 : audit [DBG] from='client.154932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:38 smithi044 bash[22676]: cluster 2024-09-21T00:51:37.020910+0000 mgr.a (mgr.14388) 6799 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:51:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:38 smithi179 bash[23186]: cluster 2024-09-21T00:51:37.020910+0000 mgr.a (mgr.14388) 6799 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:51:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:38 smithi049 bash[23528]: cluster 2024-09-21T00:51:37.020910+0000 mgr.a (mgr.14388) 6799 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:51:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:40 smithi044 bash[22676]: cluster 2024-09-21T00:51:39.021727+0000 mgr.a (mgr.14388) 6800 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:40 smithi179 bash[23186]: cluster 2024-09-21T00:51:39.021727+0000 mgr.a (mgr.14388) 6800 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:40 smithi049 bash[23528]: cluster 2024-09-21T00:51:39.021727+0000 mgr.a (mgr.14388) 6800 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:51:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:41.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:42 smithi044 bash[22676]: cluster 2024-09-21T00:51:41.023967+0000 mgr.a (mgr.14388) 6801 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:42 smithi044 bash[22676]: audit 2024-09-21T00:51:41.525470+0000 mgr.a (mgr.14388) 6802 : audit [DBG] from='client.155010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:42 smithi179 bash[23186]: cluster 2024-09-21T00:51:41.023967+0000 mgr.a (mgr.14388) 6801 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:42 smithi179 bash[23186]: audit 2024-09-21T00:51:41.525470+0000 mgr.a (mgr.14388) 6802 : audit [DBG] from='client.155010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:42 smithi049 bash[23528]: cluster 2024-09-21T00:51:41.023967+0000 mgr.a (mgr.14388) 6801 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:42.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:42 smithi049 bash[23528]: audit 2024-09-21T00:51:41.525470+0000 mgr.a (mgr.14388) 6802 : audit [DBG] from='client.155010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:44 smithi044 bash[22676]: cluster 2024-09-21T00:51:43.024879+0000 mgr.a (mgr.14388) 6803 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:44 smithi179 bash[23186]: cluster 2024-09-21T00:51:43.024879+0000 mgr.a (mgr.14388) 6803 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:44.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:44 smithi049 bash[23528]: cluster 2024-09-21T00:51:43.024879+0000 mgr.a (mgr.14388) 6803 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:46 smithi044 bash[22676]: cluster 2024-09-21T00:51:45.027049+0000 mgr.a (mgr.14388) 6804 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:46 smithi179 bash[23186]: cluster 2024-09-21T00:51:45.027049+0000 mgr.a (mgr.14388) 6804 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:46 smithi049 bash[23528]: cluster 2024-09-21T00:51:45.027049+0000 mgr.a (mgr.14388) 6804 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:46.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:46.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:46.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:47.708 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:47.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:47.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:47.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:47.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:48 smithi044 bash[22676]: cluster 2024-09-21T00:51:47.027600+0000 mgr.a (mgr.14388) 6805 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:48 smithi044 bash[22676]: audit 2024-09-21T00:51:47.288983+0000 mgr.a (mgr.14388) 6806 : audit [DBG] from='client.155088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:48 smithi179 bash[23186]: cluster 2024-09-21T00:51:47.027600+0000 mgr.a (mgr.14388) 6805 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:48 smithi179 bash[23186]: audit 2024-09-21T00:51:47.288983+0000 mgr.a (mgr.14388) 6806 : audit [DBG] from='client.155088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:48 smithi049 bash[23528]: cluster 2024-09-21T00:51:47.027600+0000 mgr.a (mgr.14388) 6805 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:48 smithi049 bash[23528]: audit 2024-09-21T00:51:47.288983+0000 mgr.a (mgr.14388) 6806 : audit [DBG] from='client.155088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:50 smithi179 bash[23186]: cluster 2024-09-21T00:51:49.028517+0000 mgr.a (mgr.14388) 6807 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:50 smithi179 bash[23186]: audit 2024-09-21T00:51:50.228729+0000 mon.a (mon.0) 5926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:50 smithi179 bash[23186]: audit 2024-09-21T00:51:50.237067+0000 mon.a (mon.0) 5927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:50 smithi179 bash[23186]: audit 2024-09-21T00:51:50.248769+0000 mon.a (mon.0) 5928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:50 smithi044 bash[22676]: cluster 2024-09-21T00:51:49.028517+0000 mgr.a (mgr.14388) 6807 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:50.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:50 smithi044 bash[22676]: audit 2024-09-21T00:51:50.228729+0000 mon.a (mon.0) 5926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:50 smithi044 bash[22676]: audit 2024-09-21T00:51:50.237067+0000 mon.a (mon.0) 5927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:50 smithi044 bash[22676]: audit 2024-09-21T00:51:50.248769+0000 mon.a (mon.0) 5928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:50 smithi049 bash[23528]: cluster 2024-09-21T00:51:49.028517+0000 mgr.a (mgr.14388) 6807 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:50 smithi049 bash[23528]: audit 2024-09-21T00:51:50.228729+0000 mon.a (mon.0) 5926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:50 smithi049 bash[23528]: audit 2024-09-21T00:51:50.237067+0000 mon.a (mon.0) 5927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:50 smithi049 bash[23528]: audit 2024-09-21T00:51:50.248769+0000 mon.a (mon.0) 5928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:52.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:52 smithi044 bash[22676]: cluster 2024-09-21T00:51:51.030262+0000 mgr.a (mgr.14388) 6808 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:52 smithi044 bash[22676]: audit 2024-09-21T00:51:51.642725+0000 mon.a (mon.0) 5929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:52 smithi044 bash[22676]: audit 2024-09-21T00:51:51.649821+0000 mon.a (mon.0) 5930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:52 smithi044 bash[22676]: audit 2024-09-21T00:51:51.655776+0000 mon.a (mon.0) 5931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:52 smithi044 bash[22676]: audit 2024-09-21T00:51:51.926660+0000 mon.a (mon.0) 5932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:52 smithi044 bash[22676]: audit 2024-09-21T00:51:51.935654+0000 mon.a (mon.0) 5933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:52 smithi044 bash[22676]: audit 2024-09-21T00:51:51.945621+0000 mon.a (mon.0) 5934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:52 smithi179 bash[23186]: cluster 2024-09-21T00:51:51.030262+0000 mgr.a (mgr.14388) 6808 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:52 smithi179 bash[23186]: audit 2024-09-21T00:51:51.642725+0000 mon.a (mon.0) 5929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:52 smithi179 bash[23186]: audit 2024-09-21T00:51:51.649821+0000 mon.a (mon.0) 5930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:52 smithi179 bash[23186]: audit 2024-09-21T00:51:51.655776+0000 mon.a (mon.0) 5931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:52 smithi179 bash[23186]: audit 2024-09-21T00:51:51.926660+0000 mon.a (mon.0) 5932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:52 smithi179 bash[23186]: audit 2024-09-21T00:51:51.935654+0000 mon.a (mon.0) 5933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:52 smithi179 bash[23186]: audit 2024-09-21T00:51:51.945621+0000 mon.a (mon.0) 5934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:52 smithi049 bash[23528]: cluster 2024-09-21T00:51:51.030262+0000 mgr.a (mgr.14388) 6808 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:52 smithi049 bash[23528]: audit 2024-09-21T00:51:51.642725+0000 mon.a (mon.0) 5929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:52 smithi049 bash[23528]: audit 2024-09-21T00:51:51.649821+0000 mon.a (mon.0) 5930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:52 smithi049 bash[23528]: audit 2024-09-21T00:51:51.655776+0000 mon.a (mon.0) 5931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:52 smithi049 bash[23528]: audit 2024-09-21T00:51:51.926660+0000 mon.a (mon.0) 5932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:52 smithi049 bash[23528]: audit 2024-09-21T00:51:51.935654+0000 mon.a (mon.0) 5933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:52 smithi049 bash[23528]: audit 2024-09-21T00:51:51.945621+0000 mon.a (mon.0) 5934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:51:53.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:53.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:53.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:53.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:53.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:54 smithi044 bash[22676]: cluster 2024-09-21T00:51:53.030756+0000 mgr.a (mgr.14388) 6809 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:54 smithi044 bash[22676]: audit 2024-09-21T00:51:53.034585+0000 mgr.a (mgr.14388) 6810 : audit [DBG] from='client.155166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:54 smithi179 bash[23186]: cluster 2024-09-21T00:51:53.030756+0000 mgr.a (mgr.14388) 6809 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:54 smithi179 bash[23186]: audit 2024-09-21T00:51:53.034585+0000 mgr.a (mgr.14388) 6810 : audit [DBG] from='client.155166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:54 smithi049 bash[23528]: cluster 2024-09-21T00:51:53.030756+0000 mgr.a (mgr.14388) 6809 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:54 smithi049 bash[23528]: audit 2024-09-21T00:51:53.034585+0000 mgr.a (mgr.14388) 6810 : audit [DBG] from='client.155166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:56 smithi049 bash[23528]: cluster 2024-09-21T00:51:55.033013+0000 mgr.a (mgr.14388) 6811 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:56 smithi044 bash[22676]: cluster 2024-09-21T00:51:55.033013+0000 mgr.a (mgr.14388) 6811 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:56 smithi179 bash[23186]: cluster 2024-09-21T00:51:55.033013+0000 mgr.a (mgr.14388) 6811 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:51:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:51:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:51:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:51:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:58 smithi044 bash[22676]: cluster 2024-09-21T00:51:57.033862+0000 mgr.a (mgr.14388) 6812 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:58 smithi179 bash[23186]: cluster 2024-09-21T00:51:57.033862+0000 mgr.a (mgr.14388) 6812 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:58 smithi049 bash[23528]: cluster 2024-09-21T00:51:57.033862+0000 mgr.a (mgr.14388) 6812 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:51:59.249 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:51:59.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:51:59.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:51:59.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:51:59.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:51:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:51:59 smithi044 bash[22676]: audit 2024-09-21T00:51:58.799795+0000 mgr.a (mgr.14388) 6813 : audit [DBG] from='client.155244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:51:59 smithi179 bash[23186]: audit 2024-09-21T00:51:58.799795+0000 mgr.a (mgr.14388) 6813 : audit [DBG] from='client.155244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:00.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:51:59 smithi049 bash[23528]: audit 2024-09-21T00:51:58.799795+0000 mgr.a (mgr.14388) 6813 : audit [DBG] from='client.155244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:00 smithi044 bash[22676]: cluster 2024-09-21T00:51:59.043100+0000 mgr.a (mgr.14388) 6814 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:01.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:00 smithi179 bash[23186]: cluster 2024-09-21T00:51:59.043100+0000 mgr.a (mgr.14388) 6814 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:01.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:00 smithi049 bash[23528]: cluster 2024-09-21T00:51:59.043100+0000 mgr.a (mgr.14388) 6814 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:02 smithi044 bash[22676]: cluster 2024-09-21T00:52:01.045492+0000 mgr.a (mgr.14388) 6815 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:52:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:02 smithi179 bash[23186]: cluster 2024-09-21T00:52:01.045492+0000 mgr.a (mgr.14388) 6815 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:52:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:02 smithi049 bash[23528]: cluster 2024-09-21T00:52:01.045492+0000 mgr.a (mgr.14388) 6815 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:52:04.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:04.251 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:04.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:04 smithi044 bash[22676]: cluster 2024-09-21T00:52:03.046264+0000 mgr.a (mgr.14388) 6816 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:04 smithi179 bash[23186]: cluster 2024-09-21T00:52:03.046264+0000 mgr.a (mgr.14388) 6816 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:05.041 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:05.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:04 smithi049 bash[23528]: cluster 2024-09-21T00:52:03.046264+0000 mgr.a (mgr.14388) 6816 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:05 smithi044 bash[22676]: audit 2024-09-21T00:52:04.584323+0000 mgr.a (mgr.14388) 6817 : audit [DBG] from='client.155319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:05 smithi179 bash[23186]: audit 2024-09-21T00:52:04.584323+0000 mgr.a (mgr.14388) 6817 : audit [DBG] from='client.155319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:05 smithi049 bash[23528]: audit 2024-09-21T00:52:04.584323+0000 mgr.a (mgr.14388) 6817 : audit [DBG] from='client.155319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:06 smithi044 bash[22676]: cluster 2024-09-21T00:52:05.047443+0000 mgr.a (mgr.14388) 6818 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:52:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:06 smithi179 bash[23186]: cluster 2024-09-21T00:52:05.047443+0000 mgr.a (mgr.14388) 6818 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:52:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:06 smithi049 bash[23528]: cluster 2024-09-21T00:52:05.047443+0000 mgr.a (mgr.14388) 6818 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:52:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:08 smithi044 bash[22676]: cluster 2024-09-21T00:52:07.048215+0000 mgr.a (mgr.14388) 6819 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:52:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:08 smithi179 bash[23186]: cluster 2024-09-21T00:52:07.048215+0000 mgr.a (mgr.14388) 6819 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:52:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:08 smithi049 bash[23528]: cluster 2024-09-21T00:52:07.048215+0000 mgr.a (mgr.14388) 6819 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:52:10.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:10 smithi179 bash[23186]: cluster 2024-09-21T00:52:09.049003+0000 mgr.a (mgr.14388) 6820 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:52:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:10 smithi179 bash[23186]: audit 2024-09-21T00:52:10.433804+0000 mon.a (mon.0) 5935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:10 smithi179 bash[23186]: audit 2024-09-21T00:52:10.439294+0000 mon.a (mon.0) 5936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:10 smithi179 bash[23186]: audit 2024-09-21T00:52:10.445324+0000 mon.a (mon.0) 5937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:10.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:10 smithi044 bash[22676]: cluster 2024-09-21T00:52:09.049003+0000 mgr.a (mgr.14388) 6820 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:52:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:10 smithi044 bash[22676]: audit 2024-09-21T00:52:10.433804+0000 mon.a (mon.0) 5935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:10 smithi044 bash[22676]: audit 2024-09-21T00:52:10.439294+0000 mon.a (mon.0) 5936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:10 smithi044 bash[22676]: audit 2024-09-21T00:52:10.445324+0000 mon.a (mon.0) 5937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:10 smithi049 bash[23528]: cluster 2024-09-21T00:52:09.049003+0000 mgr.a (mgr.14388) 6820 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:52:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:10 smithi049 bash[23528]: audit 2024-09-21T00:52:10.433804+0000 mon.a (mon.0) 5935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:10 smithi049 bash[23528]: audit 2024-09-21T00:52:10.439294+0000 mon.a (mon.0) 5936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:10 smithi049 bash[23528]: audit 2024-09-21T00:52:10.445324+0000 mon.a (mon.0) 5937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:11 smithi179 bash[23186]: audit 2024-09-21T00:52:10.374594+0000 mgr.a (mgr.14388) 6821 : audit [DBG] from='client.155394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:11 smithi044 bash[22676]: audit 2024-09-21T00:52:10.374594+0000 mgr.a (mgr.14388) 6821 : audit [DBG] from='client.155394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:11 smithi049 bash[23528]: audit 2024-09-21T00:52:10.374594+0000 mgr.a (mgr.14388) 6821 : audit [DBG] from='client.155394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:12 smithi044 bash[22676]: cluster 2024-09-21T00:52:11.051694+0000 mgr.a (mgr.14388) 6822 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:12 smithi044 bash[22676]: audit 2024-09-21T00:52:11.850608+0000 mon.a (mon.0) 5938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:12 smithi044 bash[22676]: audit 2024-09-21T00:52:11.856825+0000 mon.a (mon.0) 5939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:12 smithi044 bash[22676]: audit 2024-09-21T00:52:11.865483+0000 mon.a (mon.0) 5940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:12 smithi044 bash[22676]: audit 2024-09-21T00:52:12.136090+0000 mon.a (mon.0) 5941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:12 smithi044 bash[22676]: audit 2024-09-21T00:52:12.145490+0000 mon.a (mon.0) 5942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:12 smithi044 bash[22676]: audit 2024-09-21T00:52:12.157154+0000 mon.a (mon.0) 5943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:12 smithi179 bash[23186]: cluster 2024-09-21T00:52:11.051694+0000 mgr.a (mgr.14388) 6822 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:12 smithi179 bash[23186]: audit 2024-09-21T00:52:11.850608+0000 mon.a (mon.0) 5938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:12 smithi179 bash[23186]: audit 2024-09-21T00:52:11.856825+0000 mon.a (mon.0) 5939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:12 smithi179 bash[23186]: audit 2024-09-21T00:52:11.865483+0000 mon.a (mon.0) 5940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:12 smithi179 bash[23186]: audit 2024-09-21T00:52:12.136090+0000 mon.a (mon.0) 5941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:12 smithi179 bash[23186]: audit 2024-09-21T00:52:12.145490+0000 mon.a (mon.0) 5942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:12 smithi179 bash[23186]: audit 2024-09-21T00:52:12.157154+0000 mon.a (mon.0) 5943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:12 smithi049 bash[23528]: cluster 2024-09-21T00:52:11.051694+0000 mgr.a (mgr.14388) 6822 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:12 smithi049 bash[23528]: audit 2024-09-21T00:52:11.850608+0000 mon.a (mon.0) 5938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:12 smithi049 bash[23528]: audit 2024-09-21T00:52:11.856825+0000 mon.a (mon.0) 5939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:12 smithi049 bash[23528]: audit 2024-09-21T00:52:11.865483+0000 mon.a (mon.0) 5940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:12 smithi049 bash[23528]: audit 2024-09-21T00:52:12.136090+0000 mon.a (mon.0) 5941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:12 smithi049 bash[23528]: audit 2024-09-21T00:52:12.145490+0000 mon.a (mon.0) 5942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:12 smithi049 bash[23528]: audit 2024-09-21T00:52:12.157154+0000 mon.a (mon.0) 5943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:14 smithi044 bash[22676]: cluster 2024-09-21T00:52:13.052329+0000 mgr.a (mgr.14388) 6823 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:52:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:14 smithi179 bash[23186]: cluster 2024-09-21T00:52:13.052329+0000 mgr.a (mgr.14388) 6823 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:52:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:14 smithi049 bash[23528]: cluster 2024-09-21T00:52:13.052329+0000 mgr.a (mgr.14388) 6823 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:52:15.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:15.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:15.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:16.576 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:16.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:16.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:16.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:16.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:16 smithi044 bash[22676]: cluster 2024-09-21T00:52:15.054297+0000 mgr.a (mgr.14388) 6824 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:16 smithi179 bash[23186]: cluster 2024-09-21T00:52:15.054297+0000 mgr.a (mgr.14388) 6824 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:16 smithi049 bash[23528]: cluster 2024-09-21T00:52:15.054297+0000 mgr.a (mgr.14388) 6824 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:17 smithi044 bash[22676]: audit 2024-09-21T00:52:16.155279+0000 mgr.a (mgr.14388) 6825 : audit [DBG] from='client.155472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:17 smithi179 bash[23186]: audit 2024-09-21T00:52:16.155279+0000 mgr.a (mgr.14388) 6825 : audit [DBG] from='client.155472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:17 smithi049 bash[23528]: audit 2024-09-21T00:52:16.155279+0000 mgr.a (mgr.14388) 6825 : audit [DBG] from='client.155472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:18 smithi044 bash[22676]: cluster 2024-09-21T00:52:17.055263+0000 mgr.a (mgr.14388) 6826 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:52:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:18 smithi179 bash[23186]: cluster 2024-09-21T00:52:17.055263+0000 mgr.a (mgr.14388) 6826 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:52:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:18 smithi049 bash[23528]: cluster 2024-09-21T00:52:17.055263+0000 mgr.a (mgr.14388) 6826 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:52:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:20 smithi044 bash[22676]: cluster 2024-09-21T00:52:19.056090+0000 mgr.a (mgr.14388) 6827 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:52:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:20 smithi179 bash[23186]: cluster 2024-09-21T00:52:19.056090+0000 mgr.a (mgr.14388) 6827 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:52:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:20 smithi049 bash[23528]: cluster 2024-09-21T00:52:19.056090+0000 mgr.a (mgr.14388) 6827 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T00:52:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:21.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:21.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:22.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:22.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:22.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:22.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:22.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:22 smithi044 bash[22676]: cluster 2024-09-21T00:52:21.058352+0000 mgr.a (mgr.14388) 6828 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:52:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:22 smithi044 bash[22676]: audit 2024-09-21T00:52:21.916777+0000 mgr.a (mgr.14388) 6829 : audit [DBG] from='client.155547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:22 smithi179 bash[23186]: cluster 2024-09-21T00:52:21.058352+0000 mgr.a (mgr.14388) 6828 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:52:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:22 smithi179 bash[23186]: audit 2024-09-21T00:52:21.916777+0000 mgr.a (mgr.14388) 6829 : audit [DBG] from='client.155547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:22 smithi049 bash[23528]: cluster 2024-09-21T00:52:21.058352+0000 mgr.a (mgr.14388) 6828 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:52:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:22 smithi049 bash[23528]: audit 2024-09-21T00:52:21.916777+0000 mgr.a (mgr.14388) 6829 : audit [DBG] from='client.155547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:24 smithi044 bash[22676]: cluster 2024-09-21T00:52:23.059323+0000 mgr.a (mgr.14388) 6830 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:24 smithi044 bash[22676]: audit 2024-09-21T00:52:24.293103+0000 mon.a (mon.0) 5944 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:24 smithi179 bash[23186]: cluster 2024-09-21T00:52:23.059323+0000 mgr.a (mgr.14388) 6830 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:24 smithi179 bash[23186]: audit 2024-09-21T00:52:24.293103+0000 mon.a (mon.0) 5944 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:24 smithi049 bash[23528]: cluster 2024-09-21T00:52:23.059323+0000 mgr.a (mgr.14388) 6830 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:24 smithi049 bash[23528]: audit 2024-09-21T00:52:24.293103+0000 mon.a (mon.0) 5944 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:25.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22930]: debug 2024-09-21T00:52:25.664+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:52:25.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22930]: debug 2024-09-21T00:52:25.664+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:52:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.894731+0000 mon.a (mon.0) 5945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.899424+0000 mon.a (mon.0) 5946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.922985+0000 mon.a (mon.0) 5947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.928080+0000 mon.a (mon.0) 5948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.929003+0000 mon.a (mon.0) 5949 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.929691+0000 mon.a (mon.0) 5950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.934169+0000 mon.a (mon.0) 5951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.936644+0000 mon.a (mon.0) 5952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:52:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:25 smithi044 bash[22676]: audit 2024-09-21T00:52:24.937591+0000 mgr.a (mgr.14388) 6831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.894731+0000 mon.a (mon.0) 5945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.899424+0000 mon.a (mon.0) 5946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.922985+0000 mon.a (mon.0) 5947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.928080+0000 mon.a (mon.0) 5948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.929003+0000 mon.a (mon.0) 5949 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.929691+0000 mon.a (mon.0) 5950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.934169+0000 mon.a (mon.0) 5951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.936644+0000 mon.a (mon.0) 5952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:52:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:25 smithi179 bash[23186]: audit 2024-09-21T00:52:24.937591+0000 mgr.a (mgr.14388) 6831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.894731+0000 mon.a (mon.0) 5945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.899424+0000 mon.a (mon.0) 5946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.922985+0000 mon.a (mon.0) 5947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.928080+0000 mon.a (mon.0) 5948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.929003+0000 mon.a (mon.0) 5949 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.929691+0000 mon.a (mon.0) 5950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.934169+0000 mon.a (mon.0) 5951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.936644+0000 mon.a (mon.0) 5952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:52:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:25 smithi049 bash[23528]: audit 2024-09-21T00:52:24.937591+0000 mgr.a (mgr.14388) 6831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:52:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:26 smithi044 bash[22676]: cluster 2024-09-21T00:52:25.060777+0000 mgr.a (mgr.14388) 6832 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:52:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:26 smithi044 bash[22676]: audit 2024-09-21T00:52:25.667602+0000 mgr.a (mgr.14388) 6833 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:52:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:26 smithi044 bash[22676]: cephadm 2024-09-21T00:52:25.668717+0000 mgr.a (mgr.14388) 6834 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:52:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:26 smithi179 bash[23186]: cluster 2024-09-21T00:52:25.060777+0000 mgr.a (mgr.14388) 6832 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:52:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:26 smithi179 bash[23186]: audit 2024-09-21T00:52:25.667602+0000 mgr.a (mgr.14388) 6833 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:52:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:26 smithi179 bash[23186]: cephadm 2024-09-21T00:52:25.668717+0000 mgr.a (mgr.14388) 6834 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:52:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:26 smithi049 bash[23528]: cluster 2024-09-21T00:52:25.060777+0000 mgr.a (mgr.14388) 6832 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:52:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:26 smithi049 bash[23528]: audit 2024-09-21T00:52:25.667602+0000 mgr.a (mgr.14388) 6833 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:52:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:26 smithi049 bash[23528]: cephadm 2024-09-21T00:52:25.668717+0000 mgr.a (mgr.14388) 6834 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:52:27.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:27.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:27.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:28.121 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:28.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:28.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:28.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:28.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:28 smithi044 bash[22676]: cluster 2024-09-21T00:52:27.061741+0000 mgr.a (mgr.14388) 6835 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:28 smithi044 bash[22676]: audit 2024-09-21T00:52:27.678496+0000 mgr.a (mgr.14388) 6836 : audit [DBG] from='client.155727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:28 smithi179 bash[23186]: cluster 2024-09-21T00:52:27.061741+0000 mgr.a (mgr.14388) 6835 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:28 smithi179 bash[23186]: audit 2024-09-21T00:52:27.678496+0000 mgr.a (mgr.14388) 6836 : audit [DBG] from='client.155727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:28 smithi049 bash[23528]: cluster 2024-09-21T00:52:27.061741+0000 mgr.a (mgr.14388) 6835 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:28 smithi049 bash[23528]: audit 2024-09-21T00:52:27.678496+0000 mgr.a (mgr.14388) 6836 : audit [DBG] from='client.155727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:31.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:30 smithi044 bash[22676]: cluster 2024-09-21T00:52:29.062682+0000 mgr.a (mgr.14388) 6837 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:31.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:30 smithi044 bash[22676]: audit 2024-09-21T00:52:30.636656+0000 mon.a (mon.0) 5953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:30 smithi044 bash[22676]: audit 2024-09-21T00:52:30.645112+0000 mon.a (mon.0) 5954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:30 smithi044 bash[22676]: audit 2024-09-21T00:52:30.655466+0000 mon.a (mon.0) 5955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:30 smithi179 bash[23186]: cluster 2024-09-21T00:52:29.062682+0000 mgr.a (mgr.14388) 6837 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:30 smithi179 bash[23186]: audit 2024-09-21T00:52:30.636656+0000 mon.a (mon.0) 5953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:30 smithi179 bash[23186]: audit 2024-09-21T00:52:30.645112+0000 mon.a (mon.0) 5954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:30 smithi179 bash[23186]: audit 2024-09-21T00:52:30.655466+0000 mon.a (mon.0) 5955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:30 smithi049 bash[23528]: cluster 2024-09-21T00:52:29.062682+0000 mgr.a (mgr.14388) 6837 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:30 smithi049 bash[23528]: audit 2024-09-21T00:52:30.636656+0000 mon.a (mon.0) 5953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:30 smithi049 bash[23528]: audit 2024-09-21T00:52:30.645112+0000 mon.a (mon.0) 5954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:30 smithi049 bash[23528]: audit 2024-09-21T00:52:30.655466+0000 mon.a (mon.0) 5955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:33.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:33.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:32 smithi044 bash[22676]: cluster 2024-09-21T00:52:31.064893+0000 mgr.a (mgr.14388) 6838 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:32 smithi044 bash[22676]: audit 2024-09-21T00:52:32.031802+0000 mon.a (mon.0) 5956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:32 smithi044 bash[22676]: audit 2024-09-21T00:52:32.036609+0000 mon.a (mon.0) 5957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:32 smithi044 bash[22676]: audit 2024-09-21T00:52:32.041571+0000 mon.a (mon.0) 5958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:32 smithi044 bash[22676]: audit 2024-09-21T00:52:32.358273+0000 mon.a (mon.0) 5959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:32 smithi044 bash[22676]: audit 2024-09-21T00:52:32.367096+0000 mon.a (mon.0) 5960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:32 smithi044 bash[22676]: audit 2024-09-21T00:52:32.378867+0000 mon.a (mon.0) 5961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:32 smithi179 bash[23186]: cluster 2024-09-21T00:52:31.064893+0000 mgr.a (mgr.14388) 6838 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:32 smithi179 bash[23186]: audit 2024-09-21T00:52:32.031802+0000 mon.a (mon.0) 5956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:32 smithi179 bash[23186]: audit 2024-09-21T00:52:32.036609+0000 mon.a (mon.0) 5957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:32 smithi179 bash[23186]: audit 2024-09-21T00:52:32.041571+0000 mon.a (mon.0) 5958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:32 smithi179 bash[23186]: audit 2024-09-21T00:52:32.358273+0000 mon.a (mon.0) 5959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:32 smithi179 bash[23186]: audit 2024-09-21T00:52:32.367096+0000 mon.a (mon.0) 5960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:32 smithi179 bash[23186]: audit 2024-09-21T00:52:32.378867+0000 mon.a (mon.0) 5961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:32 smithi049 bash[23528]: cluster 2024-09-21T00:52:31.064893+0000 mgr.a (mgr.14388) 6838 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:32 smithi049 bash[23528]: audit 2024-09-21T00:52:32.031802+0000 mon.a (mon.0) 5956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:32 smithi049 bash[23528]: audit 2024-09-21T00:52:32.036609+0000 mon.a (mon.0) 5957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:32 smithi049 bash[23528]: audit 2024-09-21T00:52:32.041571+0000 mon.a (mon.0) 5958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:32 smithi049 bash[23528]: audit 2024-09-21T00:52:32.358273+0000 mon.a (mon.0) 5959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:32 smithi049 bash[23528]: audit 2024-09-21T00:52:32.367096+0000 mon.a (mon.0) 5960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:32 smithi049 bash[23528]: audit 2024-09-21T00:52:32.378867+0000 mon.a (mon.0) 5961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:33.889 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:34 smithi044 bash[22676]: cluster 2024-09-21T00:52:33.065542+0000 mgr.a (mgr.14388) 6839 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:35.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:34 smithi044 bash[22676]: audit 2024-09-21T00:52:33.449531+0000 mgr.a (mgr.14388) 6840 : audit [DBG] from='client.155805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:34 smithi179 bash[23186]: cluster 2024-09-21T00:52:33.065542+0000 mgr.a (mgr.14388) 6839 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:34 smithi179 bash[23186]: audit 2024-09-21T00:52:33.449531+0000 mgr.a (mgr.14388) 6840 : audit [DBG] from='client.155805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:35.266 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:34 smithi049 bash[23528]: cluster 2024-09-21T00:52:33.065542+0000 mgr.a (mgr.14388) 6839 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:35.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:34 smithi049 bash[23528]: audit 2024-09-21T00:52:33.449531+0000 mgr.a (mgr.14388) 6840 : audit [DBG] from='client.155805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:37.218 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:36 smithi049 bash[23528]: cluster 2024-09-21T00:52:35.067844+0000 mgr.a (mgr.14388) 6841 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:36 smithi044 bash[22676]: cluster 2024-09-21T00:52:35.067844+0000 mgr.a (mgr.14388) 6841 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:36 smithi179 bash[23186]: cluster 2024-09-21T00:52:35.067844+0000 mgr.a (mgr.14388) 6841 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:38.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:38.891 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:38.891 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:38 smithi044 bash[22676]: cluster 2024-09-21T00:52:37.068620+0000 mgr.a (mgr.14388) 6842 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:38 smithi179 bash[23186]: cluster 2024-09-21T00:52:37.068620+0000 mgr.a (mgr.14388) 6842 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:38 smithi049 bash[23528]: cluster 2024-09-21T00:52:37.068620+0000 mgr.a (mgr.14388) 6842 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:39.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:39.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:39.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:39.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:40 smithi044 bash[22676]: cluster 2024-09-21T00:52:39.069388+0000 mgr.a (mgr.14388) 6843 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:40 smithi044 bash[22676]: audit 2024-09-21T00:52:39.226476+0000 mgr.a (mgr.14388) 6844 : audit [DBG] from='client.155880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:40 smithi179 bash[23186]: cluster 2024-09-21T00:52:39.069388+0000 mgr.a (mgr.14388) 6843 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:40 smithi179 bash[23186]: audit 2024-09-21T00:52:39.226476+0000 mgr.a (mgr.14388) 6844 : audit [DBG] from='client.155880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:40 smithi049 bash[23528]: cluster 2024-09-21T00:52:39.069388+0000 mgr.a (mgr.14388) 6843 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:40 smithi049 bash[23528]: audit 2024-09-21T00:52:39.226476+0000 mgr.a (mgr.14388) 6844 : audit [DBG] from='client.155880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:42 smithi044 bash[22676]: cluster 2024-09-21T00:52:41.071818+0000 mgr.a (mgr.14388) 6845 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:42 smithi179 bash[23186]: cluster 2024-09-21T00:52:41.071818+0000 mgr.a (mgr.14388) 6845 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:42 smithi049 bash[23528]: cluster 2024-09-21T00:52:41.071818+0000 mgr.a (mgr.14388) 6845 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:52:44.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:44.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:44.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:44 smithi044 bash[22676]: cluster 2024-09-21T00:52:43.072595+0000 mgr.a (mgr.14388) 6846 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:44 smithi179 bash[23186]: cluster 2024-09-21T00:52:43.072595+0000 mgr.a (mgr.14388) 6846 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:44 smithi049 bash[23528]: cluster 2024-09-21T00:52:43.072595+0000 mgr.a (mgr.14388) 6846 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:45.467 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:46 smithi044 bash[22676]: audit 2024-09-21T00:52:45.021206+0000 mgr.a (mgr.14388) 6847 : audit [DBG] from='client.155958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:46 smithi044 bash[22676]: cluster 2024-09-21T00:52:45.075500+0000 mgr.a (mgr.14388) 6848 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:46 smithi179 bash[23186]: audit 2024-09-21T00:52:45.021206+0000 mgr.a (mgr.14388) 6847 : audit [DBG] from='client.155958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:46 smithi179 bash[23186]: cluster 2024-09-21T00:52:45.075500+0000 mgr.a (mgr.14388) 6848 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:46 smithi049 bash[23528]: audit 2024-09-21T00:52:45.021206+0000 mgr.a (mgr.14388) 6847 : audit [DBG] from='client.155958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:46 smithi049 bash[23528]: cluster 2024-09-21T00:52:45.075500+0000 mgr.a (mgr.14388) 6848 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:48.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:48 smithi049 bash[23528]: cluster 2024-09-21T00:52:47.076511+0000 mgr.a (mgr.14388) 6849 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:48 smithi044 bash[22676]: cluster 2024-09-21T00:52:47.076511+0000 mgr.a (mgr.14388) 6849 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:48 smithi179 bash[23186]: cluster 2024-09-21T00:52:47.076511+0000 mgr.a (mgr.14388) 6849 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:50.375 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:50 smithi179 bash[23186]: cluster 2024-09-21T00:52:49.077376+0000 mgr.a (mgr.14388) 6850 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:50.424 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:50 smithi044 bash[22676]: cluster 2024-09-21T00:52:49.077376+0000 mgr.a (mgr.14388) 6850 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:50.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:50 smithi049 bash[23528]: cluster 2024-09-21T00:52:49.077376+0000 mgr.a (mgr.14388) 6850 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:51.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:51.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:51.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:51.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:51.217 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:51 smithi044 bash[22676]: audit 2024-09-21T00:52:50.800048+0000 mgr.a (mgr.14388) 6851 : audit [DBG] from='client.156033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:51 smithi044 bash[22676]: audit 2024-09-21T00:52:50.810246+0000 mon.a (mon.0) 5962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:51 smithi044 bash[22676]: audit 2024-09-21T00:52:50.830273+0000 mon.a (mon.0) 5963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:51 smithi044 bash[22676]: audit 2024-09-21T00:52:50.838827+0000 mon.a (mon.0) 5964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:51 smithi179 bash[23186]: audit 2024-09-21T00:52:50.800048+0000 mgr.a (mgr.14388) 6851 : audit [DBG] from='client.156033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:51 smithi179 bash[23186]: audit 2024-09-21T00:52:50.810246+0000 mon.a (mon.0) 5962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:51 smithi179 bash[23186]: audit 2024-09-21T00:52:50.830273+0000 mon.a (mon.0) 5963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:51 smithi179 bash[23186]: audit 2024-09-21T00:52:50.838827+0000 mon.a (mon.0) 5964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:51 smithi049 bash[23528]: audit 2024-09-21T00:52:50.800048+0000 mgr.a (mgr.14388) 6851 : audit [DBG] from='client.156033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:51 smithi049 bash[23528]: audit 2024-09-21T00:52:50.810246+0000 mon.a (mon.0) 5962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:51 smithi049 bash[23528]: audit 2024-09-21T00:52:50.830273+0000 mon.a (mon.0) 5963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:52.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:51 smithi049 bash[23528]: audit 2024-09-21T00:52:50.838827+0000 mon.a (mon.0) 5964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:52 smithi049 bash[23528]: cluster 2024-09-21T00:52:51.078772+0000 mgr.a (mgr.14388) 6852 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:52 smithi049 bash[23528]: audit 2024-09-21T00:52:52.234328+0000 mon.a (mon.0) 5965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:52 smithi049 bash[23528]: audit 2024-09-21T00:52:52.239344+0000 mon.a (mon.0) 5966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:52 smithi049 bash[23528]: audit 2024-09-21T00:52:52.244282+0000 mon.a (mon.0) 5967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:52 smithi049 bash[23528]: audit 2024-09-21T00:52:52.587052+0000 mon.a (mon.0) 5968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:52 smithi049 bash[23528]: audit 2024-09-21T00:52:52.595372+0000 mon.a (mon.0) 5969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:52 smithi049 bash[23528]: audit 2024-09-21T00:52:52.605796+0000 mon.a (mon.0) 5970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:52 smithi044 bash[22676]: cluster 2024-09-21T00:52:51.078772+0000 mgr.a (mgr.14388) 6852 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:52 smithi044 bash[22676]: audit 2024-09-21T00:52:52.234328+0000 mon.a (mon.0) 5965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:52 smithi044 bash[22676]: audit 2024-09-21T00:52:52.239344+0000 mon.a (mon.0) 5966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:52 smithi044 bash[22676]: audit 2024-09-21T00:52:52.244282+0000 mon.a (mon.0) 5967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:52 smithi044 bash[22676]: audit 2024-09-21T00:52:52.587052+0000 mon.a (mon.0) 5968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:52 smithi044 bash[22676]: audit 2024-09-21T00:52:52.595372+0000 mon.a (mon.0) 5969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:52 smithi044 bash[22676]: audit 2024-09-21T00:52:52.605796+0000 mon.a (mon.0) 5970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:52 smithi179 bash[23186]: cluster 2024-09-21T00:52:51.078772+0000 mgr.a (mgr.14388) 6852 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:52 smithi179 bash[23186]: audit 2024-09-21T00:52:52.234328+0000 mon.a (mon.0) 5965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:52 smithi179 bash[23186]: audit 2024-09-21T00:52:52.239344+0000 mon.a (mon.0) 5966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:52 smithi179 bash[23186]: audit 2024-09-21T00:52:52.244282+0000 mon.a (mon.0) 5967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:52 smithi179 bash[23186]: audit 2024-09-21T00:52:52.587052+0000 mon.a (mon.0) 5968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:52 smithi179 bash[23186]: audit 2024-09-21T00:52:52.595372+0000 mon.a (mon.0) 5969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:52 smithi179 bash[23186]: audit 2024-09-21T00:52:52.605796+0000 mon.a (mon.0) 5970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:52:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:54 smithi044 bash[22676]: cluster 2024-09-21T00:52:53.079625+0000 mgr.a (mgr.14388) 6853 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:55.238 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:54 smithi049 bash[23528]: cluster 2024-09-21T00:52:53.079625+0000 mgr.a (mgr.14388) 6853 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:54 smithi179 bash[23186]: cluster 2024-09-21T00:52:53.079625+0000 mgr.a (mgr.14388) 6853 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:52:56.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:52:56.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:52:56.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:52:57.006 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:52:57.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:52:57.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:52:57.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:52:57.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:52:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:56 smithi049 bash[23528]: cluster 2024-09-21T00:52:55.081760+0000 mgr.a (mgr.14388) 6854 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:56 smithi044 bash[22676]: cluster 2024-09-21T00:52:55.081760+0000 mgr.a (mgr.14388) 6854 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:56 smithi179 bash[23186]: cluster 2024-09-21T00:52:55.081760+0000 mgr.a (mgr.14388) 6854 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:58.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:57 smithi049 bash[23528]: audit 2024-09-21T00:52:56.558933+0000 mgr.a (mgr.14388) 6855 : audit [DBG] from='client.156111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:57 smithi044 bash[22676]: audit 2024-09-21T00:52:56.558933+0000 mgr.a (mgr.14388) 6855 : audit [DBG] from='client.156111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:57 smithi179 bash[23186]: audit 2024-09-21T00:52:56.558933+0000 mgr.a (mgr.14388) 6855 : audit [DBG] from='client.156111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:52:58 smithi044 bash[22676]: cluster 2024-09-21T00:52:57.082744+0000 mgr.a (mgr.14388) 6856 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:52:58 smithi179 bash[23186]: cluster 2024-09-21T00:52:57.082744+0000 mgr.a (mgr.14388) 6856 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:52:59.282 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:52:58 smithi049 bash[23528]: cluster 2024-09-21T00:52:57.082744+0000 mgr.a (mgr.14388) 6856 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:00 smithi044 bash[22676]: cluster 2024-09-21T00:52:59.083519+0000 mgr.a (mgr.14388) 6857 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:00 smithi179 bash[23186]: cluster 2024-09-21T00:52:59.083519+0000 mgr.a (mgr.14388) 6857 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:00 smithi049 bash[23528]: cluster 2024-09-21T00:52:59.083519+0000 mgr.a (mgr.14388) 6857 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:02.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:02.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:02.775 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:02 smithi044 bash[22676]: cluster 2024-09-21T00:53:01.085755+0000 mgr.a (mgr.14388) 6858 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:02 smithi179 bash[23186]: cluster 2024-09-21T00:53:01.085755+0000 mgr.a (mgr.14388) 6858 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:02 smithi049 bash[23528]: cluster 2024-09-21T00:53:01.085755+0000 mgr.a (mgr.14388) 6858 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:04.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:03 smithi044 bash[22676]: audit 2024-09-21T00:53:02.338801+0000 mgr.a (mgr.14388) 6859 : audit [DBG] from='client.156186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:03 smithi179 bash[23186]: audit 2024-09-21T00:53:02.338801+0000 mgr.a (mgr.14388) 6859 : audit [DBG] from='client.156186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:04.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:03 smithi049 bash[23528]: audit 2024-09-21T00:53:02.338801+0000 mgr.a (mgr.14388) 6859 : audit [DBG] from='client.156186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:04 smithi044 bash[22676]: cluster 2024-09-21T00:53:03.086651+0000 mgr.a (mgr.14388) 6860 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:04 smithi179 bash[23186]: cluster 2024-09-21T00:53:03.086651+0000 mgr.a (mgr.14388) 6860 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:04 smithi049 bash[23528]: cluster 2024-09-21T00:53:03.086651+0000 mgr.a (mgr.14388) 6860 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:06 smithi044 bash[22676]: cluster 2024-09-21T00:53:05.088813+0000 mgr.a (mgr.14388) 6861 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:06 smithi179 bash[23186]: cluster 2024-09-21T00:53:05.088813+0000 mgr.a (mgr.14388) 6861 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:06 smithi049 bash[23528]: cluster 2024-09-21T00:53:05.088813+0000 mgr.a (mgr.14388) 6861 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:07.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:07.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:07.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:08.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:08.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:08.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:08.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:08.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:08 smithi179 bash[23186]: cluster 2024-09-21T00:53:07.089606+0000 mgr.a (mgr.14388) 6862 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:08 smithi044 bash[22676]: cluster 2024-09-21T00:53:07.089606+0000 mgr.a (mgr.14388) 6862 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:08 smithi049 bash[23528]: cluster 2024-09-21T00:53:07.089606+0000 mgr.a (mgr.14388) 6862 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:09 smithi044 bash[22676]: audit 2024-09-21T00:53:08.114903+0000 mgr.a (mgr.14388) 6863 : audit [DBG] from='client.156264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:09 smithi179 bash[23186]: audit 2024-09-21T00:53:08.114903+0000 mgr.a (mgr.14388) 6863 : audit [DBG] from='client.156264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:10.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:09 smithi049 bash[23528]: audit 2024-09-21T00:53:08.114903+0000 mgr.a (mgr.14388) 6863 : audit [DBG] from='client.156264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:10 smithi044 bash[22676]: cluster 2024-09-21T00:53:09.090613+0000 mgr.a (mgr.14388) 6864 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:11.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:10 smithi179 bash[23186]: cluster 2024-09-21T00:53:09.090613+0000 mgr.a (mgr.14388) 6864 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:10 smithi049 bash[23528]: cluster 2024-09-21T00:53:09.090613+0000 mgr.a (mgr.14388) 6864 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:12 smithi044 bash[22676]: audit 2024-09-21T00:53:11.055655+0000 mon.a (mon.0) 5971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:12 smithi044 bash[22676]: audit 2024-09-21T00:53:11.064360+0000 mon.a (mon.0) 5972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:12 smithi044 bash[22676]: audit 2024-09-21T00:53:11.074821+0000 mon.a (mon.0) 5973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:12 smithi044 bash[22676]: cluster 2024-09-21T00:53:11.092853+0000 mgr.a (mgr.14388) 6865 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:12.313 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:12 smithi179 bash[23186]: audit 2024-09-21T00:53:11.055655+0000 mon.a (mon.0) 5971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.313 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:12 smithi179 bash[23186]: audit 2024-09-21T00:53:11.064360+0000 mon.a (mon.0) 5972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.313 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:12 smithi179 bash[23186]: audit 2024-09-21T00:53:11.074821+0000 mon.a (mon.0) 5973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:12 smithi179 bash[23186]: cluster 2024-09-21T00:53:11.092853+0000 mgr.a (mgr.14388) 6865 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:12 smithi049 bash[23528]: audit 2024-09-21T00:53:11.055655+0000 mon.a (mon.0) 5971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:12 smithi049 bash[23528]: audit 2024-09-21T00:53:11.064360+0000 mon.a (mon.0) 5972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:12 smithi049 bash[23528]: audit 2024-09-21T00:53:11.074821+0000 mon.a (mon.0) 5973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:12.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:12 smithi049 bash[23528]: cluster 2024-09-21T00:53:11.092853+0000 mgr.a (mgr.14388) 6865 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:13.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:13.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:13.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:13 smithi044 bash[22676]: audit 2024-09-21T00:53:12.399068+0000 mon.a (mon.0) 5974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:13 smithi044 bash[22676]: audit 2024-09-21T00:53:12.406318+0000 mon.a (mon.0) 5975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:13 smithi044 bash[22676]: audit 2024-09-21T00:53:12.414167+0000 mon.a (mon.0) 5976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:13 smithi044 bash[22676]: audit 2024-09-21T00:53:12.783935+0000 mon.a (mon.0) 5977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:13 smithi044 bash[22676]: audit 2024-09-21T00:53:12.792852+0000 mon.a (mon.0) 5978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:13 smithi044 bash[22676]: audit 2024-09-21T00:53:12.802979+0000 mon.a (mon.0) 5979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:13 smithi179 bash[23186]: audit 2024-09-21T00:53:12.399068+0000 mon.a (mon.0) 5974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:13 smithi179 bash[23186]: audit 2024-09-21T00:53:12.406318+0000 mon.a (mon.0) 5975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:13 smithi179 bash[23186]: audit 2024-09-21T00:53:12.414167+0000 mon.a (mon.0) 5976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:13 smithi179 bash[23186]: audit 2024-09-21T00:53:12.783935+0000 mon.a (mon.0) 5977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:13 smithi179 bash[23186]: audit 2024-09-21T00:53:12.792852+0000 mon.a (mon.0) 5978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:13 smithi179 bash[23186]: audit 2024-09-21T00:53:12.802979+0000 mon.a (mon.0) 5979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:13 smithi049 bash[23528]: audit 2024-09-21T00:53:12.399068+0000 mon.a (mon.0) 5974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:13 smithi049 bash[23528]: audit 2024-09-21T00:53:12.406318+0000 mon.a (mon.0) 5975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:13 smithi049 bash[23528]: audit 2024-09-21T00:53:12.414167+0000 mon.a (mon.0) 5976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:13 smithi049 bash[23528]: audit 2024-09-21T00:53:12.783935+0000 mon.a (mon.0) 5977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:13 smithi049 bash[23528]: audit 2024-09-21T00:53:12.792852+0000 mon.a (mon.0) 5978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:13.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:13 smithi049 bash[23528]: audit 2024-09-21T00:53:12.802979+0000 mon.a (mon.0) 5979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:14.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:14.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:14.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:14.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:14.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:14 smithi044 bash[22676]: cluster 2024-09-21T00:53:13.093652+0000 mgr.a (mgr.14388) 6866 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:14 smithi044 bash[22676]: audit 2024-09-21T00:53:13.882038+0000 mgr.a (mgr.14388) 6867 : audit [DBG] from='client.156339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:14 smithi179 bash[23186]: cluster 2024-09-21T00:53:13.093652+0000 mgr.a (mgr.14388) 6866 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:14 smithi179 bash[23186]: audit 2024-09-21T00:53:13.882038+0000 mgr.a (mgr.14388) 6867 : audit [DBG] from='client.156339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:14 smithi049 bash[23528]: cluster 2024-09-21T00:53:13.093652+0000 mgr.a (mgr.14388) 6866 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:14 smithi049 bash[23528]: audit 2024-09-21T00:53:13.882038+0000 mgr.a (mgr.14388) 6867 : audit [DBG] from='client.156339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:17.159 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:16 smithi049 bash[23528]: cluster 2024-09-21T00:53:15.095976+0000 mgr.a (mgr.14388) 6868 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:16 smithi044 bash[22676]: cluster 2024-09-21T00:53:15.095976+0000 mgr.a (mgr.14388) 6868 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:16 smithi179 bash[23186]: cluster 2024-09-21T00:53:15.095976+0000 mgr.a (mgr.14388) 6868 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:18 smithi044 bash[22676]: cluster 2024-09-21T00:53:17.096767+0000 mgr.a (mgr.14388) 6869 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:18 smithi179 bash[23186]: cluster 2024-09-21T00:53:17.096767+0000 mgr.a (mgr.14388) 6869 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:18 smithi049 bash[23528]: cluster 2024-09-21T00:53:17.096767+0000 mgr.a (mgr.14388) 6869 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:19.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:19.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:20.095 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:20 smithi044 bash[22676]: cluster 2024-09-21T00:53:19.097558+0000 mgr.a (mgr.14388) 6870 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:20 smithi044 bash[22676]: audit 2024-09-21T00:53:19.650492+0000 mgr.a (mgr.14388) 6871 : audit [DBG] from='client.156417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:20 smithi179 bash[23186]: cluster 2024-09-21T00:53:19.097558+0000 mgr.a (mgr.14388) 6870 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:20 smithi179 bash[23186]: audit 2024-09-21T00:53:19.650492+0000 mgr.a (mgr.14388) 6871 : audit [DBG] from='client.156417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:20 smithi049 bash[23528]: cluster 2024-09-21T00:53:19.097558+0000 mgr.a (mgr.14388) 6870 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:20 smithi049 bash[23528]: audit 2024-09-21T00:53:19.650492+0000 mgr.a (mgr.14388) 6871 : audit [DBG] from='client.156417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:22 smithi044 bash[22676]: cluster 2024-09-21T00:53:21.100073+0000 mgr.a (mgr.14388) 6872 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:53:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:22 smithi179 bash[23186]: cluster 2024-09-21T00:53:21.100073+0000 mgr.a (mgr.14388) 6872 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:53:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:22 smithi049 bash[23528]: cluster 2024-09-21T00:53:21.100073+0000 mgr.a (mgr.14388) 6872 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T00:53:25.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:25.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:24 smithi044 bash[22676]: cluster 2024-09-21T00:53:23.100920+0000 mgr.a (mgr.14388) 6873 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:53:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:24 smithi179 bash[23186]: cluster 2024-09-21T00:53:23.100920+0000 mgr.a (mgr.14388) 6873 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:53:25.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:24 smithi049 bash[23528]: cluster 2024-09-21T00:53:23.100920+0000 mgr.a (mgr.14388) 6873 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T00:53:25.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:25.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:25.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:25.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:25.886 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:25 smithi044 bash[22676]: audit 2024-09-21T00:53:25.718597+0000 mon.a (mon.0) 5980 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:25 smithi179 bash[23186]: audit 2024-09-21T00:53:25.718597+0000 mon.a (mon.0) 5980 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:25 smithi049 bash[23528]: audit 2024-09-21T00:53:25.718597+0000 mon.a (mon.0) 5980 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:27.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: cluster 2024-09-21T00:53:25.102222+0000 mgr.a (mgr.14388) 6874 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:27.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: audit 2024-09-21T00:53:25.434946+0000 mgr.a (mgr.14388) 6875 : audit [DBG] from='client.156495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:27.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: audit 2024-09-21T00:53:26.277444+0000 mon.a (mon.0) 5981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: audit 2024-09-21T00:53:26.287200+0000 mon.a (mon.0) 5982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: audit 2024-09-21T00:53:26.290299+0000 mon.a (mon.0) 5983 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:27.104 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: audit 2024-09-21T00:53:26.292203+0000 mon.a (mon.0) 5984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:27.104 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: audit 2024-09-21T00:53:26.302814+0000 mon.a (mon.0) 5985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.104 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:26 smithi044 bash[22676]: audit 2024-09-21T00:53:26.309399+0000 mon.a (mon.0) 5986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: cluster 2024-09-21T00:53:25.102222+0000 mgr.a (mgr.14388) 6874 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: audit 2024-09-21T00:53:25.434946+0000 mgr.a (mgr.14388) 6875 : audit [DBG] from='client.156495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: audit 2024-09-21T00:53:26.277444+0000 mon.a (mon.0) 5981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: audit 2024-09-21T00:53:26.287200+0000 mon.a (mon.0) 5982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: audit 2024-09-21T00:53:26.290299+0000 mon.a (mon.0) 5983 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: audit 2024-09-21T00:53:26.292203+0000 mon.a (mon.0) 5984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: audit 2024-09-21T00:53:26.302814+0000 mon.a (mon.0) 5985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:26 smithi179 bash[23186]: audit 2024-09-21T00:53:26.309399+0000 mon.a (mon.0) 5986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:53:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: cluster 2024-09-21T00:53:25.102222+0000 mgr.a (mgr.14388) 6874 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: audit 2024-09-21T00:53:25.434946+0000 mgr.a (mgr.14388) 6875 : audit [DBG] from='client.156495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: audit 2024-09-21T00:53:26.277444+0000 mon.a (mon.0) 5981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: audit 2024-09-21T00:53:26.287200+0000 mon.a (mon.0) 5982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: audit 2024-09-21T00:53:26.290299+0000 mon.a (mon.0) 5983 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: audit 2024-09-21T00:53:26.292203+0000 mon.a (mon.0) 5984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: audit 2024-09-21T00:53:26.302814+0000 mon.a (mon.0) 5985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:26 smithi049 bash[23528]: audit 2024-09-21T00:53:26.309399+0000 mon.a (mon.0) 5986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:53:27.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:53:27 smithi044 bash[22930]: debug 2024-09-21T00:53:27.099+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:53:27.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:53:27 smithi044 bash[22930]: debug 2024-09-21T00:53:27.099+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:53:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:27 smithi044 bash[22676]: audit 2024-09-21T00:53:26.311963+0000 mgr.a (mgr.14388) 6876 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:53:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:27 smithi179 bash[23186]: audit 2024-09-21T00:53:26.311963+0000 mgr.a (mgr.14388) 6876 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:53:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:27 smithi049 bash[23528]: audit 2024-09-21T00:53:26.311963+0000 mgr.a (mgr.14388) 6876 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:53:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:28 smithi044 bash[22676]: cluster 2024-09-21T00:53:27.102731+0000 mgr.a (mgr.14388) 6877 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:53:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:28 smithi044 bash[22676]: audit 2024-09-21T00:53:27.103502+0000 mgr.a (mgr.14388) 6878 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:53:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:28 smithi044 bash[22676]: cephadm 2024-09-21T00:53:27.104756+0000 mgr.a (mgr.14388) 6879 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:53:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:28 smithi179 bash[23186]: cluster 2024-09-21T00:53:27.102731+0000 mgr.a (mgr.14388) 6877 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:53:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:28 smithi179 bash[23186]: audit 2024-09-21T00:53:27.103502+0000 mgr.a (mgr.14388) 6878 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:53:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:28 smithi179 bash[23186]: cephadm 2024-09-21T00:53:27.104756+0000 mgr.a (mgr.14388) 6879 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:53:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:28 smithi049 bash[23528]: cluster 2024-09-21T00:53:27.102731+0000 mgr.a (mgr.14388) 6877 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:53:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:28 smithi049 bash[23528]: audit 2024-09-21T00:53:27.103502+0000 mgr.a (mgr.14388) 6878 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:53:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:28 smithi049 bash[23528]: cephadm 2024-09-21T00:53:27.104756+0000 mgr.a (mgr.14388) 6879 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:53:30.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:30.953 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:30 smithi179 bash[23186]: cluster 2024-09-21T00:53:29.103455+0000 mgr.a (mgr.14388) 6880 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:53:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:30 smithi044 bash[22676]: cluster 2024-09-21T00:53:29.103455+0000 mgr.a (mgr.14388) 6880 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:53:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:30 smithi049 bash[23528]: cluster 2024-09-21T00:53:29.103455+0000 mgr.a (mgr.14388) 6880 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:53:31.673 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:32 smithi049 bash[23528]: cluster 2024-09-21T00:53:31.105645+0000 mgr.a (mgr.14388) 6881 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:32 smithi049 bash[23528]: audit 2024-09-21T00:53:31.223769+0000 mgr.a (mgr.14388) 6882 : audit [DBG] from='client.156675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:32 smithi049 bash[23528]: audit 2024-09-21T00:53:31.272010+0000 mon.a (mon.0) 5987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:32 smithi049 bash[23528]: audit 2024-09-21T00:53:31.278479+0000 mon.a (mon.0) 5988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:32 smithi049 bash[23528]: audit 2024-09-21T00:53:31.287054+0000 mon.a (mon.0) 5989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:32 smithi044 bash[22676]: cluster 2024-09-21T00:53:31.105645+0000 mgr.a (mgr.14388) 6881 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:32.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:32 smithi044 bash[22676]: audit 2024-09-21T00:53:31.223769+0000 mgr.a (mgr.14388) 6882 : audit [DBG] from='client.156675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:32.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:32 smithi044 bash[22676]: audit 2024-09-21T00:53:31.272010+0000 mon.a (mon.0) 5987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:32 smithi044 bash[22676]: audit 2024-09-21T00:53:31.278479+0000 mon.a (mon.0) 5988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:32 smithi044 bash[22676]: audit 2024-09-21T00:53:31.287054+0000 mon.a (mon.0) 5989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:32 smithi179 bash[23186]: cluster 2024-09-21T00:53:31.105645+0000 mgr.a (mgr.14388) 6881 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:32 smithi179 bash[23186]: audit 2024-09-21T00:53:31.223769+0000 mgr.a (mgr.14388) 6882 : audit [DBG] from='client.156675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:32 smithi179 bash[23186]: audit 2024-09-21T00:53:31.272010+0000 mon.a (mon.0) 5987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:32 smithi179 bash[23186]: audit 2024-09-21T00:53:31.278479+0000 mon.a (mon.0) 5988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:32 smithi179 bash[23186]: audit 2024-09-21T00:53:31.287054+0000 mon.a (mon.0) 5989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:33 smithi044 bash[22676]: audit 2024-09-21T00:53:32.573406+0000 mon.a (mon.0) 5990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:33 smithi044 bash[22676]: audit 2024-09-21T00:53:32.580453+0000 mon.a (mon.0) 5991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:33 smithi044 bash[22676]: audit 2024-09-21T00:53:32.591078+0000 mon.a (mon.0) 5992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:33 smithi044 bash[22676]: audit 2024-09-21T00:53:33.014663+0000 mon.a (mon.0) 5993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:33 smithi044 bash[22676]: audit 2024-09-21T00:53:33.023066+0000 mon.a (mon.0) 5994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:33 smithi044 bash[22676]: audit 2024-09-21T00:53:33.033702+0000 mon.a (mon.0) 5995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:33 smithi179 bash[23186]: audit 2024-09-21T00:53:32.573406+0000 mon.a (mon.0) 5990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:33 smithi179 bash[23186]: audit 2024-09-21T00:53:32.580453+0000 mon.a (mon.0) 5991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:33 smithi179 bash[23186]: audit 2024-09-21T00:53:32.591078+0000 mon.a (mon.0) 5992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:33 smithi179 bash[23186]: audit 2024-09-21T00:53:33.014663+0000 mon.a (mon.0) 5993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:33 smithi179 bash[23186]: audit 2024-09-21T00:53:33.023066+0000 mon.a (mon.0) 5994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:33 smithi179 bash[23186]: audit 2024-09-21T00:53:33.033702+0000 mon.a (mon.0) 5995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:33 smithi049 bash[23528]: audit 2024-09-21T00:53:32.573406+0000 mon.a (mon.0) 5990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:33 smithi049 bash[23528]: audit 2024-09-21T00:53:32.580453+0000 mon.a (mon.0) 5991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:33 smithi049 bash[23528]: audit 2024-09-21T00:53:32.591078+0000 mon.a (mon.0) 5992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:33 smithi049 bash[23528]: audit 2024-09-21T00:53:33.014663+0000 mon.a (mon.0) 5993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:33 smithi049 bash[23528]: audit 2024-09-21T00:53:33.023066+0000 mon.a (mon.0) 5994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:33 smithi049 bash[23528]: audit 2024-09-21T00:53:33.033702+0000 mon.a (mon.0) 5995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:34 smithi044 bash[22676]: cluster 2024-09-21T00:53:33.106523+0000 mgr.a (mgr.14388) 6883 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:53:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:34 smithi179 bash[23186]: cluster 2024-09-21T00:53:33.106523+0000 mgr.a (mgr.14388) 6883 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:53:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:34 smithi049 bash[23528]: cluster 2024-09-21T00:53:33.106523+0000 mgr.a (mgr.14388) 6883 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:53:36.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:36.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:36.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:36 smithi049 bash[23528]: cluster 2024-09-21T00:53:35.108663+0000 mgr.a (mgr.14388) 6884 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:36 smithi044 bash[22676]: cluster 2024-09-21T00:53:35.108663+0000 mgr.a (mgr.14388) 6884 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:36 smithi179 bash[23186]: cluster 2024-09-21T00:53:35.108663+0000 mgr.a (mgr.14388) 6884 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:37.457 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:37.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:37.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:37.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:37.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:38 smithi049 bash[23528]: audit 2024-09-21T00:53:37.010906+0000 mgr.a (mgr.14388) 6885 : audit [DBG] from='client.156753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:38 smithi049 bash[23528]: cluster 2024-09-21T00:53:37.109208+0000 mgr.a (mgr.14388) 6886 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:38 smithi044 bash[22676]: audit 2024-09-21T00:53:37.010906+0000 mgr.a (mgr.14388) 6885 : audit [DBG] from='client.156753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:38 smithi044 bash[22676]: cluster 2024-09-21T00:53:37.109208+0000 mgr.a (mgr.14388) 6886 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:38 smithi179 bash[23186]: audit 2024-09-21T00:53:37.010906+0000 mgr.a (mgr.14388) 6885 : audit [DBG] from='client.156753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:38 smithi179 bash[23186]: cluster 2024-09-21T00:53:37.109208+0000 mgr.a (mgr.14388) 6886 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:40 smithi044 bash[22676]: cluster 2024-09-21T00:53:39.110128+0000 mgr.a (mgr.14388) 6887 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:40 smithi179 bash[23186]: cluster 2024-09-21T00:53:39.110128+0000 mgr.a (mgr.14388) 6887 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:41.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:40 smithi049 bash[23528]: cluster 2024-09-21T00:53:39.110128+0000 mgr.a (mgr.14388) 6887 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:42.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:42.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:42 smithi044 bash[22676]: cluster 2024-09-21T00:53:41.112394+0000 mgr.a (mgr.14388) 6888 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:42 smithi179 bash[23186]: cluster 2024-09-21T00:53:41.112394+0000 mgr.a (mgr.14388) 6888 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:43.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:42 smithi049 bash[23528]: cluster 2024-09-21T00:53:41.112394+0000 mgr.a (mgr.14388) 6888 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:53:43.218 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:43.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:43.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:43.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:43.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:43 smithi044 bash[22676]: audit 2024-09-21T00:53:42.791499+0000 mgr.a (mgr.14388) 6889 : audit [DBG] from='client.156831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:43 smithi179 bash[23186]: audit 2024-09-21T00:53:42.791499+0000 mgr.a (mgr.14388) 6889 : audit [DBG] from='client.156831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:44.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:43 smithi049 bash[23528]: audit 2024-09-21T00:53:42.791499+0000 mgr.a (mgr.14388) 6889 : audit [DBG] from='client.156831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:44 smithi044 bash[22676]: cluster 2024-09-21T00:53:43.112927+0000 mgr.a (mgr.14388) 6890 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:44 smithi179 bash[23186]: cluster 2024-09-21T00:53:43.112927+0000 mgr.a (mgr.14388) 6890 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:44 smithi049 bash[23528]: cluster 2024-09-21T00:53:43.112927+0000 mgr.a (mgr.14388) 6890 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:46 smithi044 bash[22676]: cluster 2024-09-21T00:53:45.115184+0000 mgr.a (mgr.14388) 6891 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:46 smithi179 bash[23186]: cluster 2024-09-21T00:53:45.115184+0000 mgr.a (mgr.14388) 6891 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:47.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:46 smithi049 bash[23528]: cluster 2024-09-21T00:53:45.115184+0000 mgr.a (mgr.14388) 6891 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:48.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:48 smithi044 bash[22676]: cluster 2024-09-21T00:53:47.115966+0000 mgr.a (mgr.14388) 6892 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:48 smithi179 bash[23186]: cluster 2024-09-21T00:53:47.115966+0000 mgr.a (mgr.14388) 6892 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:49.004 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:49.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:49.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:49.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:49.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:49.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:48 smithi049 bash[23528]: cluster 2024-09-21T00:53:47.115966+0000 mgr.a (mgr.14388) 6892 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:49.872 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:49 smithi179 bash[23186]: audit 2024-09-21T00:53:48.561697+0000 mgr.a (mgr.14388) 6893 : audit [DBG] from='client.156909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:49 smithi044 bash[22676]: audit 2024-09-21T00:53:48.561697+0000 mgr.a (mgr.14388) 6893 : audit [DBG] from='client.156909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:49 smithi049 bash[23528]: audit 2024-09-21T00:53:48.561697+0000 mgr.a (mgr.14388) 6893 : audit [DBG] from='client.156909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:50.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:50 smithi179 bash[23186]: cluster 2024-09-21T00:53:49.116937+0000 mgr.a (mgr.14388) 6894 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:50 smithi044 bash[22676]: cluster 2024-09-21T00:53:49.116937+0000 mgr.a (mgr.14388) 6894 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:50 smithi049 bash[23528]: cluster 2024-09-21T00:53:49.116937+0000 mgr.a (mgr.14388) 6894 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:52.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:52 smithi044 bash[22676]: cluster 2024-09-21T00:53:51.119239+0000 mgr.a (mgr.14388) 6895 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:52.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:52 smithi044 bash[22676]: audit 2024-09-21T00:53:51.503473+0000 mon.a (mon.0) 5996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:52.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:52 smithi044 bash[22676]: audit 2024-09-21T00:53:51.511344+0000 mon.a (mon.0) 5997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:52.759 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:52 smithi044 bash[22676]: audit 2024-09-21T00:53:51.521678+0000 mon.a (mon.0) 5998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:52 smithi049 bash[23528]: cluster 2024-09-21T00:53:51.119239+0000 mgr.a (mgr.14388) 6895 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:52 smithi049 bash[23528]: audit 2024-09-21T00:53:51.503473+0000 mon.a (mon.0) 5996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:52 smithi049 bash[23528]: audit 2024-09-21T00:53:51.511344+0000 mon.a (mon.0) 5997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:52.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:52 smithi049 bash[23528]: audit 2024-09-21T00:53:51.521678+0000 mon.a (mon.0) 5998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:52 smithi179 bash[23186]: cluster 2024-09-21T00:53:51.119239+0000 mgr.a (mgr.14388) 6895 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:52 smithi179 bash[23186]: audit 2024-09-21T00:53:51.503473+0000 mon.a (mon.0) 5996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:52 smithi179 bash[23186]: audit 2024-09-21T00:53:51.511344+0000 mon.a (mon.0) 5997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:52 smithi179 bash[23186]: audit 2024-09-21T00:53:51.521678+0000 mon.a (mon.0) 5998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:53 smithi044 bash[22676]: audit 2024-09-21T00:53:52.745702+0000 mon.a (mon.0) 5999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:53 smithi044 bash[22676]: audit 2024-09-21T00:53:52.751477+0000 mon.a (mon.0) 6000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:53 smithi044 bash[22676]: audit 2024-09-21T00:53:52.758220+0000 mon.a (mon.0) 6001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:53 smithi044 bash[22676]: audit 2024-09-21T00:53:53.248039+0000 mon.a (mon.0) 6002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:53 smithi044 bash[22676]: audit 2024-09-21T00:53:53.257705+0000 mon.a (mon.0) 6003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:53 smithi044 bash[22676]: audit 2024-09-21T00:53:53.269056+0000 mon.a (mon.0) 6004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:53 smithi179 bash[23186]: audit 2024-09-21T00:53:52.745702+0000 mon.a (mon.0) 5999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:53 smithi179 bash[23186]: audit 2024-09-21T00:53:52.751477+0000 mon.a (mon.0) 6000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:53 smithi179 bash[23186]: audit 2024-09-21T00:53:52.758220+0000 mon.a (mon.0) 6001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:53 smithi179 bash[23186]: audit 2024-09-21T00:53:53.248039+0000 mon.a (mon.0) 6002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:53 smithi179 bash[23186]: audit 2024-09-21T00:53:53.257705+0000 mon.a (mon.0) 6003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:53 smithi179 bash[23186]: audit 2024-09-21T00:53:53.269056+0000 mon.a (mon.0) 6004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:54.006 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:54.006 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:53:54.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:53 smithi049 bash[23528]: audit 2024-09-21T00:53:52.745702+0000 mon.a (mon.0) 5999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:53 smithi049 bash[23528]: audit 2024-09-21T00:53:52.751477+0000 mon.a (mon.0) 6000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:53 smithi049 bash[23528]: audit 2024-09-21T00:53:52.758220+0000 mon.a (mon.0) 6001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:53 smithi049 bash[23528]: audit 2024-09-21T00:53:53.248039+0000 mon.a (mon.0) 6002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:53 smithi049 bash[23528]: audit 2024-09-21T00:53:53.257705+0000 mon.a (mon.0) 6003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:53 smithi049 bash[23528]: audit 2024-09-21T00:53:53.269056+0000 mon.a (mon.0) 6004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:53:54.739 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:53:54.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:53:54.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:53:54.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:53:54.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:53:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:54 smithi049 bash[23528]: cluster 2024-09-21T00:53:53.120035+0000 mgr.a (mgr.14388) 6896 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:54 smithi044 bash[22676]: cluster 2024-09-21T00:53:53.120035+0000 mgr.a (mgr.14388) 6896 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:54 smithi179 bash[23186]: cluster 2024-09-21T00:53:53.120035+0000 mgr.a (mgr.14388) 6896 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:56.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:55 smithi049 bash[23528]: audit 2024-09-21T00:53:54.325968+0000 mgr.a (mgr.14388) 6897 : audit [DBG] from='client.156987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:55 smithi044 bash[22676]: audit 2024-09-21T00:53:54.325968+0000 mgr.a (mgr.14388) 6897 : audit [DBG] from='client.156987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:55 smithi179 bash[23186]: audit 2024-09-21T00:53:54.325968+0000 mgr.a (mgr.14388) 6897 : audit [DBG] from='client.156987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:56 smithi049 bash[23528]: cluster 2024-09-21T00:53:55.122393+0000 mgr.a (mgr.14388) 6898 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:56 smithi044 bash[22676]: cluster 2024-09-21T00:53:55.122393+0000 mgr.a (mgr.14388) 6898 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:56 smithi179 bash[23186]: cluster 2024-09-21T00:53:55.122393+0000 mgr.a (mgr.14388) 6898 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:53:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:53:58 smithi049 bash[23528]: cluster 2024-09-21T00:53:57.123208+0000 mgr.a (mgr.14388) 6899 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:53:58 smithi044 bash[22676]: cluster 2024-09-21T00:53:57.123208+0000 mgr.a (mgr.14388) 6899 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:53:58 smithi179 bash[23186]: cluster 2024-09-21T00:53:57.123208+0000 mgr.a (mgr.14388) 6899 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:53:59.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:53:59.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:53:59.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:00.528 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:00.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:00.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:00.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:00.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:00 smithi049 bash[23528]: cluster 2024-09-21T00:53:59.123965+0000 mgr.a (mgr.14388) 6900 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:00 smithi044 bash[22676]: cluster 2024-09-21T00:53:59.123965+0000 mgr.a (mgr.14388) 6900 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:00 smithi179 bash[23186]: cluster 2024-09-21T00:53:59.123965+0000 mgr.a (mgr.14388) 6900 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:01 smithi049 bash[23528]: audit 2024-09-21T00:54:00.083007+0000 mgr.a (mgr.14388) 6901 : audit [DBG] from='client.157065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:01 smithi044 bash[22676]: audit 2024-09-21T00:54:00.083007+0000 mgr.a (mgr.14388) 6901 : audit [DBG] from='client.157065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:01 smithi179 bash[23186]: audit 2024-09-21T00:54:00.083007+0000 mgr.a (mgr.14388) 6901 : audit [DBG] from='client.157065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:02 smithi049 bash[23528]: cluster 2024-09-21T00:54:01.126807+0000 mgr.a (mgr.14388) 6902 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:02 smithi044 bash[22676]: cluster 2024-09-21T00:54:01.126807+0000 mgr.a (mgr.14388) 6902 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:02 smithi179 bash[23186]: cluster 2024-09-21T00:54:01.126807+0000 mgr.a (mgr.14388) 6902 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:04 smithi049 bash[23528]: cluster 2024-09-21T00:54:03.127599+0000 mgr.a (mgr.14388) 6903 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:04 smithi044 bash[22676]: cluster 2024-09-21T00:54:03.127599+0000 mgr.a (mgr.14388) 6903 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:04 smithi179 bash[23186]: cluster 2024-09-21T00:54:03.127599+0000 mgr.a (mgr.14388) 6903 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:05.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:05.531 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:05.531 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:06.279 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:06.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:06.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:06.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:06.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:06 smithi044 bash[22676]: cluster 2024-09-21T00:54:05.129541+0000 mgr.a (mgr.14388) 6904 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:06 smithi044 bash[22676]: audit 2024-09-21T00:54:05.864367+0000 mgr.a (mgr.14388) 6905 : audit [DBG] from='client.157140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:06 smithi179 bash[23186]: cluster 2024-09-21T00:54:05.129541+0000 mgr.a (mgr.14388) 6904 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:06 smithi179 bash[23186]: audit 2024-09-21T00:54:05.864367+0000 mgr.a (mgr.14388) 6905 : audit [DBG] from='client.157140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:06 smithi049 bash[23528]: cluster 2024-09-21T00:54:05.129541+0000 mgr.a (mgr.14388) 6904 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:06 smithi049 bash[23528]: audit 2024-09-21T00:54:05.864367+0000 mgr.a (mgr.14388) 6905 : audit [DBG] from='client.157140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:08 smithi044 bash[22676]: cluster 2024-09-21T00:54:07.130465+0000 mgr.a (mgr.14388) 6906 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:08 smithi179 bash[23186]: cluster 2024-09-21T00:54:07.130465+0000 mgr.a (mgr.14388) 6906 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:08 smithi049 bash[23528]: cluster 2024-09-21T00:54:07.130465+0000 mgr.a (mgr.14388) 6906 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:11.064 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:10 smithi179 bash[23186]: cluster 2024-09-21T00:54:09.131251+0000 mgr.a (mgr.14388) 6907 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:54:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:10 smithi044 bash[22676]: cluster 2024-09-21T00:54:09.131251+0000 mgr.a (mgr.14388) 6907 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:54:11.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:11.281 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:11.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:11.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:10 smithi049 bash[23528]: cluster 2024-09-21T00:54:09.131251+0000 mgr.a (mgr.14388) 6907 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:54:12.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:12.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:12.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:12.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:12.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:12.969 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:12 smithi044 bash[22676]: cluster 2024-09-21T00:54:11.133571+0000 mgr.a (mgr.14388) 6908 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:12.969 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:12 smithi044 bash[22676]: audit 2024-09-21T00:54:11.619003+0000 mgr.a (mgr.14388) 6909 : audit [DBG] from='client.157212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:12.969 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:12 smithi044 bash[22676]: audit 2024-09-21T00:54:11.693658+0000 mon.a (mon.0) 6005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:12.969 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:12 smithi044 bash[22676]: audit 2024-09-21T00:54:11.699666+0000 mon.a (mon.0) 6006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:12.969 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:12 smithi044 bash[22676]: audit 2024-09-21T00:54:11.706367+0000 mon.a (mon.0) 6007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:12 smithi179 bash[23186]: cluster 2024-09-21T00:54:11.133571+0000 mgr.a (mgr.14388) 6908 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:12 smithi179 bash[23186]: audit 2024-09-21T00:54:11.619003+0000 mgr.a (mgr.14388) 6909 : audit [DBG] from='client.157212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:12 smithi179 bash[23186]: audit 2024-09-21T00:54:11.693658+0000 mon.a (mon.0) 6005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:12 smithi179 bash[23186]: audit 2024-09-21T00:54:11.699666+0000 mon.a (mon.0) 6006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:12 smithi179 bash[23186]: audit 2024-09-21T00:54:11.706367+0000 mon.a (mon.0) 6007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:12 smithi049 bash[23528]: cluster 2024-09-21T00:54:11.133571+0000 mgr.a (mgr.14388) 6908 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:12 smithi049 bash[23528]: audit 2024-09-21T00:54:11.619003+0000 mgr.a (mgr.14388) 6909 : audit [DBG] from='client.157212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:12 smithi049 bash[23528]: audit 2024-09-21T00:54:11.693658+0000 mon.a (mon.0) 6005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:12 smithi049 bash[23528]: audit 2024-09-21T00:54:11.699666+0000 mon.a (mon.0) 6006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:12 smithi049 bash[23528]: audit 2024-09-21T00:54:11.706367+0000 mon.a (mon.0) 6007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:13 smithi044 bash[22676]: audit 2024-09-21T00:54:12.950342+0000 mon.a (mon.0) 6008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:13 smithi044 bash[22676]: audit 2024-09-21T00:54:12.958410+0000 mon.a (mon.0) 6009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:13 smithi044 bash[22676]: audit 2024-09-21T00:54:12.966474+0000 mon.a (mon.0) 6010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:13 smithi044 bash[22676]: audit 2024-09-21T00:54:13.481182+0000 mon.a (mon.0) 6011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:13 smithi044 bash[22676]: audit 2024-09-21T00:54:13.490257+0000 mon.a (mon.0) 6012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:13 smithi044 bash[22676]: audit 2024-09-21T00:54:13.498952+0000 mon.a (mon.0) 6013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:13 smithi179 bash[23186]: audit 2024-09-21T00:54:12.950342+0000 mon.a (mon.0) 6008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:13 smithi179 bash[23186]: audit 2024-09-21T00:54:12.958410+0000 mon.a (mon.0) 6009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:13 smithi179 bash[23186]: audit 2024-09-21T00:54:12.966474+0000 mon.a (mon.0) 6010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:13 smithi179 bash[23186]: audit 2024-09-21T00:54:13.481182+0000 mon.a (mon.0) 6011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:13 smithi179 bash[23186]: audit 2024-09-21T00:54:13.490257+0000 mon.a (mon.0) 6012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:13 smithi179 bash[23186]: audit 2024-09-21T00:54:13.498952+0000 mon.a (mon.0) 6013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:13 smithi049 bash[23528]: audit 2024-09-21T00:54:12.950342+0000 mon.a (mon.0) 6008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:13 smithi049 bash[23528]: audit 2024-09-21T00:54:12.958410+0000 mon.a (mon.0) 6009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:13 smithi049 bash[23528]: audit 2024-09-21T00:54:12.966474+0000 mon.a (mon.0) 6010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:13 smithi049 bash[23528]: audit 2024-09-21T00:54:13.481182+0000 mon.a (mon.0) 6011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:13 smithi049 bash[23528]: audit 2024-09-21T00:54:13.490257+0000 mon.a (mon.0) 6012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:13 smithi049 bash[23528]: audit 2024-09-21T00:54:13.498952+0000 mon.a (mon.0) 6013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:14 smithi044 bash[22676]: cluster 2024-09-21T00:54:13.134641+0000 mgr.a (mgr.14388) 6910 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:14 smithi179 bash[23186]: cluster 2024-09-21T00:54:13.134641+0000 mgr.a (mgr.14388) 6910 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:14 smithi049 bash[23528]: cluster 2024-09-21T00:54:13.134641+0000 mgr.a (mgr.14388) 6910 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:17.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:17.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:17.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:16 smithi044 bash[22676]: cluster 2024-09-21T00:54:15.136811+0000 mgr.a (mgr.14388) 6911 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:16 smithi179 bash[23186]: cluster 2024-09-21T00:54:15.136811+0000 mgr.a (mgr.14388) 6911 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:16 smithi049 bash[23528]: cluster 2024-09-21T00:54:15.136811+0000 mgr.a (mgr.14388) 6911 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:17.860 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:17.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:17.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:17.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:17.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:18 smithi044 bash[22676]: cluster 2024-09-21T00:54:17.137489+0000 mgr.a (mgr.14388) 6912 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:18 smithi044 bash[22676]: audit 2024-09-21T00:54:17.414192+0000 mgr.a (mgr.14388) 6913 : audit [DBG] from='client.157287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:18 smithi179 bash[23186]: cluster 2024-09-21T00:54:17.137489+0000 mgr.a (mgr.14388) 6912 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:18 smithi179 bash[23186]: audit 2024-09-21T00:54:17.414192+0000 mgr.a (mgr.14388) 6913 : audit [DBG] from='client.157287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:18 smithi049 bash[23528]: cluster 2024-09-21T00:54:17.137489+0000 mgr.a (mgr.14388) 6912 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:18 smithi049 bash[23528]: audit 2024-09-21T00:54:17.414192+0000 mgr.a (mgr.14388) 6913 : audit [DBG] from='client.157287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:21.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:20 smithi049 bash[23528]: cluster 2024-09-21T00:54:19.138409+0000 mgr.a (mgr.14388) 6914 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:20 smithi044 bash[22676]: cluster 2024-09-21T00:54:19.138409+0000 mgr.a (mgr.14388) 6914 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:20 smithi179 bash[23186]: cluster 2024-09-21T00:54:19.138409+0000 mgr.a (mgr.14388) 6914 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:22.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:22.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:22.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:22 smithi044 bash[22676]: cluster 2024-09-21T00:54:21.140661+0000 mgr.a (mgr.14388) 6915 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:22 smithi179 bash[23186]: cluster 2024-09-21T00:54:21.140661+0000 mgr.a (mgr.14388) 6915 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:22 smithi049 bash[23528]: cluster 2024-09-21T00:54:21.140661+0000 mgr.a (mgr.14388) 6915 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:23.639 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:23.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:23.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:23.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:23.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:24 smithi179 bash[23186]: cluster 2024-09-21T00:54:23.141425+0000 mgr.a (mgr.14388) 6916 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:24 smithi179 bash[23186]: audit 2024-09-21T00:54:23.196866+0000 mgr.a (mgr.14388) 6917 : audit [DBG] from='client.157365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:24 smithi049 bash[23528]: cluster 2024-09-21T00:54:23.141425+0000 mgr.a (mgr.14388) 6916 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:24 smithi049 bash[23528]: audit 2024-09-21T00:54:23.196866+0000 mgr.a (mgr.14388) 6917 : audit [DBG] from='client.157365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:24 smithi044 bash[22676]: cluster 2024-09-21T00:54:23.141425+0000 mgr.a (mgr.14388) 6916 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:24 smithi044 bash[22676]: audit 2024-09-21T00:54:23.196866+0000 mgr.a (mgr.14388) 6917 : audit [DBG] from='client.157365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:26 smithi179 bash[23186]: cluster 2024-09-21T00:54:25.143659+0000 mgr.a (mgr.14388) 6918 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:26 smithi049 bash[23528]: cluster 2024-09-21T00:54:25.143659+0000 mgr.a (mgr.14388) 6918 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:26 smithi044 bash[22676]: cluster 2024-09-21T00:54:25.143659+0000 mgr.a (mgr.14388) 6918 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:28 smithi049 bash[23528]: audit 2024-09-21T00:54:27.172795+0000 mon.a (mon.0) 6014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:54:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:28 smithi049 bash[23528]: audit 2024-09-21T00:54:27.180013+0000 mon.a (mon.0) 6015 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:28 smithi049 bash[23528]: audit 2024-09-21T00:54:27.182105+0000 mon.a (mon.0) 6016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:54:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:28 smithi049 bash[23528]: audit 2024-09-21T00:54:27.193429+0000 mon.a (mon.0) 6017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:28.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:28 smithi049 bash[23528]: audit 2024-09-21T00:54:27.199759+0000 mon.a (mon.0) 6018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:54:28.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:54:27 smithi044 bash[22930]: debug 2024-09-21T00:54:27.982+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:54:28.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:54:27 smithi044 bash[22930]: debug 2024-09-21T00:54:27.986+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:54:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:28 smithi044 bash[22676]: audit 2024-09-21T00:54:27.172795+0000 mon.a (mon.0) 6014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:54:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:28 smithi044 bash[22676]: audit 2024-09-21T00:54:27.180013+0000 mon.a (mon.0) 6015 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:28 smithi044 bash[22676]: audit 2024-09-21T00:54:27.182105+0000 mon.a (mon.0) 6016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:54:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:28 smithi044 bash[22676]: audit 2024-09-21T00:54:27.193429+0000 mon.a (mon.0) 6017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:28 smithi044 bash[22676]: audit 2024-09-21T00:54:27.199759+0000 mon.a (mon.0) 6018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:54:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:28 smithi179 bash[23186]: audit 2024-09-21T00:54:27.172795+0000 mon.a (mon.0) 6014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:54:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:28 smithi179 bash[23186]: audit 2024-09-21T00:54:27.180013+0000 mon.a (mon.0) 6015 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:28 smithi179 bash[23186]: audit 2024-09-21T00:54:27.182105+0000 mon.a (mon.0) 6016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:54:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:28 smithi179 bash[23186]: audit 2024-09-21T00:54:27.193429+0000 mon.a (mon.0) 6017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:28 smithi179 bash[23186]: audit 2024-09-21T00:54:27.199759+0000 mon.a (mon.0) 6018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:54:28.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:28.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:28.642 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:29 smithi049 bash[23528]: cluster 2024-09-21T00:54:27.144454+0000 mgr.a (mgr.14388) 6919 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:29 smithi049 bash[23528]: audit 2024-09-21T00:54:27.202146+0000 mgr.a (mgr.14388) 6920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:54:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:29 smithi049 bash[23528]: audit 2024-09-21T00:54:27.989064+0000 mgr.a (mgr.14388) 6921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:54:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:29 smithi049 bash[23528]: cephadm 2024-09-21T00:54:27.990321+0000 mgr.a (mgr.14388) 6922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:54:29.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:29.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:29 smithi044 bash[22676]: cluster 2024-09-21T00:54:27.144454+0000 mgr.a (mgr.14388) 6919 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:29 smithi044 bash[22676]: audit 2024-09-21T00:54:27.202146+0000 mgr.a (mgr.14388) 6920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:54:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:29 smithi044 bash[22676]: audit 2024-09-21T00:54:27.989064+0000 mgr.a (mgr.14388) 6921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:54:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:29 smithi044 bash[22676]: cephadm 2024-09-21T00:54:27.990321+0000 mgr.a (mgr.14388) 6922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:54:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:29 smithi179 bash[23186]: cluster 2024-09-21T00:54:27.144454+0000 mgr.a (mgr.14388) 6919 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:29 smithi179 bash[23186]: audit 2024-09-21T00:54:27.202146+0000 mgr.a (mgr.14388) 6920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:54:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:29 smithi179 bash[23186]: audit 2024-09-21T00:54:27.989064+0000 mgr.a (mgr.14388) 6921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:54:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:29 smithi179 bash[23186]: cephadm 2024-09-21T00:54:27.990321+0000 mgr.a (mgr.14388) 6922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:54:30.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:30 smithi049 bash[23528]: audit 2024-09-21T00:54:28.989126+0000 mgr.a (mgr.14388) 6923 : audit [DBG] from='client.157551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:30 smithi044 bash[22676]: audit 2024-09-21T00:54:28.989126+0000 mgr.a (mgr.14388) 6923 : audit [DBG] from='client.157551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:30 smithi179 bash[23186]: audit 2024-09-21T00:54:28.989126+0000 mgr.a (mgr.14388) 6923 : audit [DBG] from='client.157551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:31 smithi049 bash[23528]: cluster 2024-09-21T00:54:29.145014+0000 mgr.a (mgr.14388) 6924 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:31.335 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:31 smithi179 bash[23186]: cluster 2024-09-21T00:54:29.145014+0000 mgr.a (mgr.14388) 6924 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:31 smithi044 bash[22676]: cluster 2024-09-21T00:54:29.145014+0000 mgr.a (mgr.14388) 6924 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:33.178 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:32 smithi044 bash[22676]: cluster 2024-09-21T00:54:31.147356+0000 mgr.a (mgr.14388) 6925 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:33.178 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:32 smithi044 bash[22676]: audit 2024-09-21T00:54:31.943916+0000 mon.a (mon.0) 6019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.178 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:32 smithi044 bash[22676]: audit 2024-09-21T00:54:31.950409+0000 mon.a (mon.0) 6020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.178 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:32 smithi044 bash[22676]: audit 2024-09-21T00:54:31.956495+0000 mon.a (mon.0) 6021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:32 smithi179 bash[23186]: cluster 2024-09-21T00:54:31.147356+0000 mgr.a (mgr.14388) 6925 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:32 smithi179 bash[23186]: audit 2024-09-21T00:54:31.943916+0000 mon.a (mon.0) 6019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:32 smithi179 bash[23186]: audit 2024-09-21T00:54:31.950409+0000 mon.a (mon.0) 6020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:32 smithi179 bash[23186]: audit 2024-09-21T00:54:31.956495+0000 mon.a (mon.0) 6021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:32 smithi049 bash[23528]: cluster 2024-09-21T00:54:31.147356+0000 mgr.a (mgr.14388) 6925 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:32 smithi049 bash[23528]: audit 2024-09-21T00:54:31.943916+0000 mon.a (mon.0) 6019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:32 smithi049 bash[23528]: audit 2024-09-21T00:54:31.950409+0000 mon.a (mon.0) 6020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:32 smithi049 bash[23528]: audit 2024-09-21T00:54:31.956495+0000 mon.a (mon.0) 6021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:34 smithi044 bash[22676]: cluster 2024-09-21T00:54:33.147912+0000 mgr.a (mgr.14388) 6926 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:34.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:34 smithi044 bash[22676]: audit 2024-09-21T00:54:33.157516+0000 mon.a (mon.0) 6022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:34 smithi044 bash[22676]: audit 2024-09-21T00:54:33.165365+0000 mon.a (mon.0) 6023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:34 smithi044 bash[22676]: audit 2024-09-21T00:54:33.175720+0000 mon.a (mon.0) 6024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:34 smithi044 bash[22676]: audit 2024-09-21T00:54:33.700531+0000 mon.a (mon.0) 6025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:34 smithi044 bash[22676]: audit 2024-09-21T00:54:33.705701+0000 mon.a (mon.0) 6026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:34 smithi044 bash[22676]: audit 2024-09-21T00:54:33.713823+0000 mon.a (mon.0) 6027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:34.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:34.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:34 smithi179 bash[23186]: cluster 2024-09-21T00:54:33.147912+0000 mgr.a (mgr.14388) 6926 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:34 smithi179 bash[23186]: audit 2024-09-21T00:54:33.157516+0000 mon.a (mon.0) 6022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:34 smithi179 bash[23186]: audit 2024-09-21T00:54:33.165365+0000 mon.a (mon.0) 6023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:34 smithi179 bash[23186]: audit 2024-09-21T00:54:33.175720+0000 mon.a (mon.0) 6024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:34 smithi179 bash[23186]: audit 2024-09-21T00:54:33.700531+0000 mon.a (mon.0) 6025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:34 smithi179 bash[23186]: audit 2024-09-21T00:54:33.705701+0000 mon.a (mon.0) 6026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:34 smithi179 bash[23186]: audit 2024-09-21T00:54:33.713823+0000 mon.a (mon.0) 6027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:34 smithi049 bash[23528]: cluster 2024-09-21T00:54:33.147912+0000 mgr.a (mgr.14388) 6926 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:34 smithi049 bash[23528]: audit 2024-09-21T00:54:33.157516+0000 mon.a (mon.0) 6022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:34 smithi049 bash[23528]: audit 2024-09-21T00:54:33.165365+0000 mon.a (mon.0) 6023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:34 smithi049 bash[23528]: audit 2024-09-21T00:54:33.175720+0000 mon.a (mon.0) 6024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:34 smithi049 bash[23528]: audit 2024-09-21T00:54:33.700531+0000 mon.a (mon.0) 6025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:34 smithi049 bash[23528]: audit 2024-09-21T00:54:33.705701+0000 mon.a (mon.0) 6026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:34.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:34 smithi049 bash[23528]: audit 2024-09-21T00:54:33.713823+0000 mon.a (mon.0) 6027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:35.182 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:35.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:35.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:35.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:35.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:35 smithi044 bash[22676]: audit 2024-09-21T00:54:34.743080+0000 mgr.a (mgr.14388) 6927 : audit [DBG] from='client.157626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:35 smithi179 bash[23186]: audit 2024-09-21T00:54:34.743080+0000 mgr.a (mgr.14388) 6927 : audit [DBG] from='client.157626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:35.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:35 smithi049 bash[23528]: audit 2024-09-21T00:54:34.743080+0000 mgr.a (mgr.14388) 6927 : audit [DBG] from='client.157626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:36 smithi044 bash[22676]: cluster 2024-09-21T00:54:35.149290+0000 mgr.a (mgr.14388) 6928 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:36 smithi179 bash[23186]: cluster 2024-09-21T00:54:35.149290+0000 mgr.a (mgr.14388) 6928 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:36 smithi049 bash[23528]: cluster 2024-09-21T00:54:35.149290+0000 mgr.a (mgr.14388) 6928 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:38 smithi044 bash[22676]: cluster 2024-09-21T00:54:37.150044+0000 mgr.a (mgr.14388) 6929 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:54:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:38 smithi179 bash[23186]: cluster 2024-09-21T00:54:37.150044+0000 mgr.a (mgr.14388) 6929 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:54:38.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:38 smithi049 bash[23528]: cluster 2024-09-21T00:54:37.150044+0000 mgr.a (mgr.14388) 6929 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:54:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:40 smithi044 bash[22676]: cluster 2024-09-21T00:54:39.150814+0000 mgr.a (mgr.14388) 6930 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:54:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:40 smithi179 bash[23186]: cluster 2024-09-21T00:54:39.150814+0000 mgr.a (mgr.14388) 6930 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:54:40.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:40 smithi049 bash[23528]: cluster 2024-09-21T00:54:39.150814+0000 mgr.a (mgr.14388) 6930 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:54:40.933 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:41 smithi044 bash[22676]: audit 2024-09-21T00:54:40.516396+0000 mgr.a (mgr.14388) 6931 : audit [DBG] from='client.157704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:41 smithi179 bash[23186]: audit 2024-09-21T00:54:40.516396+0000 mgr.a (mgr.14388) 6931 : audit [DBG] from='client.157704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:41.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:41 smithi049 bash[23528]: audit 2024-09-21T00:54:40.516396+0000 mgr.a (mgr.14388) 6931 : audit [DBG] from='client.157704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:42 smithi044 bash[22676]: cluster 2024-09-21T00:54:41.153633+0000 mgr.a (mgr.14388) 6932 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:42 smithi179 bash[23186]: cluster 2024-09-21T00:54:41.153633+0000 mgr.a (mgr.14388) 6932 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:42.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:42 smithi049 bash[23528]: cluster 2024-09-21T00:54:41.153633+0000 mgr.a (mgr.14388) 6932 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:54:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:44 smithi044 bash[22676]: cluster 2024-09-21T00:54:43.154420+0000 mgr.a (mgr.14388) 6933 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:44 smithi179 bash[23186]: cluster 2024-09-21T00:54:43.154420+0000 mgr.a (mgr.14388) 6933 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:44.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:44 smithi049 bash[23528]: cluster 2024-09-21T00:54:43.154420+0000 mgr.a (mgr.14388) 6933 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:54:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:45.935 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:45.935 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:46 smithi044 bash[22676]: cluster 2024-09-21T00:54:45.156326+0000 mgr.a (mgr.14388) 6934 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:46 smithi179 bash[23186]: cluster 2024-09-21T00:54:45.156326+0000 mgr.a (mgr.14388) 6934 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:46.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:46 smithi049 bash[23528]: cluster 2024-09-21T00:54:45.156326+0000 mgr.a (mgr.14388) 6934 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:46.728 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:46.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:46.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:46.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:46.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:47 smithi044 bash[22676]: audit 2024-09-21T00:54:46.269733+0000 mgr.a (mgr.14388) 6935 : audit [DBG] from='client.157782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:47 smithi179 bash[23186]: audit 2024-09-21T00:54:46.269733+0000 mgr.a (mgr.14388) 6935 : audit [DBG] from='client.157782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:47.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:47 smithi049 bash[23528]: audit 2024-09-21T00:54:46.269733+0000 mgr.a (mgr.14388) 6935 : audit [DBG] from='client.157782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:48 smithi044 bash[22676]: cluster 2024-09-21T00:54:47.157269+0000 mgr.a (mgr.14388) 6936 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:54:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:48 smithi179 bash[23186]: cluster 2024-09-21T00:54:47.157269+0000 mgr.a (mgr.14388) 6936 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:54:48.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:48 smithi049 bash[23528]: cluster 2024-09-21T00:54:47.157269+0000 mgr.a (mgr.14388) 6936 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:54:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:50 smithi044 bash[22676]: cluster 2024-09-21T00:54:49.157971+0000 mgr.a (mgr.14388) 6937 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:54:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:50 smithi179 bash[23186]: cluster 2024-09-21T00:54:49.157971+0000 mgr.a (mgr.14388) 6937 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:54:50.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:50 smithi049 bash[23528]: cluster 2024-09-21T00:54:49.157971+0000 mgr.a (mgr.14388) 6937 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T00:54:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:51.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:52.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:52 smithi044 bash[22676]: cluster 2024-09-21T00:54:51.159623+0000 mgr.a (mgr.14388) 6938 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:54:52.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:52 smithi044 bash[22676]: audit 2024-09-21T00:54:52.086902+0000 mon.a (mon.0) 6028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:52 smithi044 bash[22676]: audit 2024-09-21T00:54:52.092109+0000 mon.a (mon.0) 6029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:52 smithi044 bash[22676]: audit 2024-09-21T00:54:52.097358+0000 mon.a (mon.0) 6030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:52 smithi179 bash[23186]: cluster 2024-09-21T00:54:51.159623+0000 mgr.a (mgr.14388) 6938 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:54:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:52 smithi179 bash[23186]: audit 2024-09-21T00:54:52.086902+0000 mon.a (mon.0) 6028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:52 smithi179 bash[23186]: audit 2024-09-21T00:54:52.092109+0000 mon.a (mon.0) 6029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:52 smithi179 bash[23186]: audit 2024-09-21T00:54:52.097358+0000 mon.a (mon.0) 6030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:52.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:52.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:52.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:52.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:52 smithi049 bash[23528]: cluster 2024-09-21T00:54:51.159623+0000 mgr.a (mgr.14388) 6938 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T00:54:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:52 smithi049 bash[23528]: audit 2024-09-21T00:54:52.086902+0000 mon.a (mon.0) 6028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:52 smithi049 bash[23528]: audit 2024-09-21T00:54:52.092109+0000 mon.a (mon.0) 6029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:52 smithi049 bash[23528]: audit 2024-09-21T00:54:52.097358+0000 mon.a (mon.0) 6030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:53.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:53 smithi044 bash[22676]: audit 2024-09-21T00:54:52.064324+0000 mgr.a (mgr.14388) 6939 : audit [DBG] from='client.157860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:53 smithi179 bash[23186]: audit 2024-09-21T00:54:52.064324+0000 mgr.a (mgr.14388) 6939 : audit [DBG] from='client.157860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:53 smithi049 bash[23528]: audit 2024-09-21T00:54:52.064324+0000 mgr.a (mgr.14388) 6939 : audit [DBG] from='client.157860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:54.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:54 smithi044 bash[22676]: cluster 2024-09-21T00:54:53.160540+0000 mgr.a (mgr.14388) 6940 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:54.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:54 smithi044 bash[22676]: audit 2024-09-21T00:54:53.371826+0000 mon.a (mon.0) 6031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:54 smithi044 bash[22676]: audit 2024-09-21T00:54:53.379561+0000 mon.a (mon.0) 6032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:54 smithi044 bash[22676]: audit 2024-09-21T00:54:53.388058+0000 mon.a (mon.0) 6033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:54 smithi044 bash[22676]: audit 2024-09-21T00:54:53.922463+0000 mon.a (mon.0) 6034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:54 smithi044 bash[22676]: audit 2024-09-21T00:54:53.928050+0000 mon.a (mon.0) 6035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.643 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:54 smithi044 bash[22676]: audit 2024-09-21T00:54:53.935154+0000 mon.a (mon.0) 6036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:54 smithi179 bash[23186]: cluster 2024-09-21T00:54:53.160540+0000 mgr.a (mgr.14388) 6940 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:54 smithi179 bash[23186]: audit 2024-09-21T00:54:53.371826+0000 mon.a (mon.0) 6031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:54 smithi179 bash[23186]: audit 2024-09-21T00:54:53.379561+0000 mon.a (mon.0) 6032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:54 smithi179 bash[23186]: audit 2024-09-21T00:54:53.388058+0000 mon.a (mon.0) 6033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:54 smithi179 bash[23186]: audit 2024-09-21T00:54:53.922463+0000 mon.a (mon.0) 6034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:54 smithi179 bash[23186]: audit 2024-09-21T00:54:53.928050+0000 mon.a (mon.0) 6035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:54 smithi179 bash[23186]: audit 2024-09-21T00:54:53.935154+0000 mon.a (mon.0) 6036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:54 smithi049 bash[23528]: cluster 2024-09-21T00:54:53.160540+0000 mgr.a (mgr.14388) 6940 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:54 smithi049 bash[23528]: audit 2024-09-21T00:54:53.371826+0000 mon.a (mon.0) 6031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:54 smithi049 bash[23528]: audit 2024-09-21T00:54:53.379561+0000 mon.a (mon.0) 6032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:54 smithi049 bash[23528]: audit 2024-09-21T00:54:53.388058+0000 mon.a (mon.0) 6033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:54 smithi049 bash[23528]: audit 2024-09-21T00:54:53.922463+0000 mon.a (mon.0) 6034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:54 smithi049 bash[23528]: audit 2024-09-21T00:54:53.928050+0000 mon.a (mon.0) 6035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:54 smithi049 bash[23528]: audit 2024-09-21T00:54:53.935154+0000 mon.a (mon.0) 6036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:54:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:56 smithi044 bash[22676]: cluster 2024-09-21T00:54:55.162695+0000 mgr.a (mgr.14388) 6941 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:56 smithi179 bash[23186]: cluster 2024-09-21T00:54:55.162695+0000 mgr.a (mgr.14388) 6941 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:56.847 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:56 smithi049 bash[23528]: cluster 2024-09-21T00:54:55.162695+0000 mgr.a (mgr.14388) 6941 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:54:57.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:54:57.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:54:57.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:54:58.264 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:54:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:54:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:54:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:54:58.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:54:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:58 smithi044 bash[22676]: cluster 2024-09-21T00:54:57.163485+0000 mgr.a (mgr.14388) 6942 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:54:58 smithi044 bash[22676]: audit 2024-09-21T00:54:57.835596+0000 mgr.a (mgr.14388) 6943 : audit [DBG] from='client.157938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:58 smithi179 bash[23186]: cluster 2024-09-21T00:54:57.163485+0000 mgr.a (mgr.14388) 6942 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:54:58 smithi179 bash[23186]: audit 2024-09-21T00:54:57.835596+0000 mgr.a (mgr.14388) 6943 : audit [DBG] from='client.157938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:58 smithi049 bash[23528]: cluster 2024-09-21T00:54:57.163485+0000 mgr.a (mgr.14388) 6942 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:54:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:54:58 smithi049 bash[23528]: audit 2024-09-21T00:54:57.835596+0000 mgr.a (mgr.14388) 6943 : audit [DBG] from='client.157938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:00 smithi044 bash[22676]: cluster 2024-09-21T00:54:59.164377+0000 mgr.a (mgr.14388) 6944 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:00 smithi179 bash[23186]: cluster 2024-09-21T00:54:59.164377+0000 mgr.a (mgr.14388) 6944 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:00 smithi049 bash[23528]: cluster 2024-09-21T00:54:59.164377+0000 mgr.a (mgr.14388) 6944 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:02 smithi044 bash[22676]: cluster 2024-09-21T00:55:01.166649+0000 mgr.a (mgr.14388) 6945 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:02 smithi179 bash[23186]: cluster 2024-09-21T00:55:01.166649+0000 mgr.a (mgr.14388) 6945 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:02 smithi049 bash[23528]: cluster 2024-09-21T00:55:01.166649+0000 mgr.a (mgr.14388) 6945 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:03.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:03.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:03.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:04.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:04.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:04.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:04.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:04.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:04 smithi044 bash[22676]: cluster 2024-09-21T00:55:03.167421+0000 mgr.a (mgr.14388) 6946 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:04 smithi044 bash[22676]: audit 2024-09-21T00:55:03.597711+0000 mgr.a (mgr.14388) 6947 : audit [DBG] from='client.158016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:04 smithi179 bash[23186]: cluster 2024-09-21T00:55:03.167421+0000 mgr.a (mgr.14388) 6946 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:04 smithi179 bash[23186]: audit 2024-09-21T00:55:03.597711+0000 mgr.a (mgr.14388) 6947 : audit [DBG] from='client.158016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:04 smithi049 bash[23528]: cluster 2024-09-21T00:55:03.167421+0000 mgr.a (mgr.14388) 6946 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:04 smithi049 bash[23528]: audit 2024-09-21T00:55:03.597711+0000 mgr.a (mgr.14388) 6947 : audit [DBG] from='client.158016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:06 smithi044 bash[22676]: cluster 2024-09-21T00:55:05.169665+0000 mgr.a (mgr.14388) 6948 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:06 smithi179 bash[23186]: cluster 2024-09-21T00:55:05.169665+0000 mgr.a (mgr.14388) 6948 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:06.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:06 smithi049 bash[23528]: cluster 2024-09-21T00:55:05.169665+0000 mgr.a (mgr.14388) 6948 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:08 smithi044 bash[22676]: cluster 2024-09-21T00:55:07.170434+0000 mgr.a (mgr.14388) 6949 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:08 smithi179 bash[23186]: cluster 2024-09-21T00:55:07.170434+0000 mgr.a (mgr.14388) 6949 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:08.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:08 smithi049 bash[23528]: cluster 2024-09-21T00:55:07.170434+0000 mgr.a (mgr.14388) 6949 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:09.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:09.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:09.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:09.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:09.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:09.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:10 smithi044 bash[22676]: cluster 2024-09-21T00:55:09.171168+0000 mgr.a (mgr.14388) 6950 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:10 smithi044 bash[22676]: audit 2024-09-21T00:55:09.362526+0000 mgr.a (mgr.14388) 6951 : audit [DBG] from='client.158094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:10 smithi179 bash[23186]: cluster 2024-09-21T00:55:09.171168+0000 mgr.a (mgr.14388) 6950 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:10 smithi179 bash[23186]: audit 2024-09-21T00:55:09.362526+0000 mgr.a (mgr.14388) 6951 : audit [DBG] from='client.158094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:10 smithi049 bash[23528]: cluster 2024-09-21T00:55:09.171168+0000 mgr.a (mgr.14388) 6950 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:10 smithi049 bash[23528]: audit 2024-09-21T00:55:09.362526+0000 mgr.a (mgr.14388) 6951 : audit [DBG] from='client.158094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:12.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:12 smithi179 bash[23186]: cluster 2024-09-21T00:55:11.173520+0000 mgr.a (mgr.14388) 6952 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:12.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:12 smithi179 bash[23186]: audit 2024-09-21T00:55:12.253459+0000 mon.a (mon.0) 6037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:12 smithi179 bash[23186]: audit 2024-09-21T00:55:12.259885+0000 mon.a (mon.0) 6038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:12 smithi179 bash[23186]: audit 2024-09-21T00:55:12.265108+0000 mon.a (mon.0) 6039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.612 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:12 smithi044 bash[22676]: cluster 2024-09-21T00:55:11.173520+0000 mgr.a (mgr.14388) 6952 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:12.613 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:12 smithi044 bash[22676]: audit 2024-09-21T00:55:12.253459+0000 mon.a (mon.0) 6037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.613 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:12 smithi044 bash[22676]: audit 2024-09-21T00:55:12.259885+0000 mon.a (mon.0) 6038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.613 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:12 smithi044 bash[22676]: audit 2024-09-21T00:55:12.265108+0000 mon.a (mon.0) 6039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:12 smithi049 bash[23528]: cluster 2024-09-21T00:55:11.173520+0000 mgr.a (mgr.14388) 6952 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:12 smithi049 bash[23528]: audit 2024-09-21T00:55:12.253459+0000 mon.a (mon.0) 6037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:12 smithi049 bash[23528]: audit 2024-09-21T00:55:12.259885+0000 mon.a (mon.0) 6038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:12 smithi049 bash[23528]: audit 2024-09-21T00:55:12.265108+0000 mon.a (mon.0) 6039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:14.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:14.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:14.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:14 smithi044 bash[22676]: cluster 2024-09-21T00:55:13.174311+0000 mgr.a (mgr.14388) 6953 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:14.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:14 smithi044 bash[22676]: audit 2024-09-21T00:55:13.549335+0000 mon.a (mon.0) 6040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:14.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:14 smithi044 bash[22676]: audit 2024-09-21T00:55:13.555706+0000 mon.a (mon.0) 6041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:14.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:14 smithi044 bash[22676]: audit 2024-09-21T00:55:13.565622+0000 mon.a (mon.0) 6042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:14.846 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:14 smithi044 bash[22676]: audit 2024-09-21T00:55:14.144935+0000 mon.a (mon.0) 6043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:14.846 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:14 smithi044 bash[22676]: audit 2024-09-21T00:55:14.153009+0000 mon.a (mon.0) 6044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:14.846 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:14 smithi044 bash[22676]: audit 2024-09-21T00:55:14.164333+0000 mon.a (mon.0) 6045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:14 smithi179 bash[23186]: cluster 2024-09-21T00:55:13.174311+0000 mgr.a (mgr.14388) 6953 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:14 smithi179 bash[23186]: audit 2024-09-21T00:55:13.549335+0000 mon.a (mon.0) 6040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:14 smithi179 bash[23186]: audit 2024-09-21T00:55:13.555706+0000 mon.a (mon.0) 6041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:14 smithi179 bash[23186]: audit 2024-09-21T00:55:13.565622+0000 mon.a (mon.0) 6042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:14 smithi179 bash[23186]: audit 2024-09-21T00:55:14.144935+0000 mon.a (mon.0) 6043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:14 smithi179 bash[23186]: audit 2024-09-21T00:55:14.153009+0000 mon.a (mon.0) 6044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:14 smithi179 bash[23186]: audit 2024-09-21T00:55:14.164333+0000 mon.a (mon.0) 6045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:14 smithi049 bash[23528]: cluster 2024-09-21T00:55:13.174311+0000 mgr.a (mgr.14388) 6953 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:14 smithi049 bash[23528]: audit 2024-09-21T00:55:13.549335+0000 mon.a (mon.0) 6040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:14 smithi049 bash[23528]: audit 2024-09-21T00:55:13.555706+0000 mon.a (mon.0) 6041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:14 smithi049 bash[23528]: audit 2024-09-21T00:55:13.565622+0000 mon.a (mon.0) 6042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:14 smithi049 bash[23528]: audit 2024-09-21T00:55:14.144935+0000 mon.a (mon.0) 6043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:14 smithi049 bash[23528]: audit 2024-09-21T00:55:14.153009+0000 mon.a (mon.0) 6044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:14 smithi049 bash[23528]: audit 2024-09-21T00:55:14.164333+0000 mon.a (mon.0) 6045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:15.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:15.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:15.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:15.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:15.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:16 smithi044 bash[22676]: audit 2024-09-21T00:55:15.146404+0000 mgr.a (mgr.14388) 6954 : audit [DBG] from='client.158172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:16 smithi044 bash[22676]: cluster 2024-09-21T00:55:15.177345+0000 mgr.a (mgr.14388) 6955 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:16 smithi179 bash[23186]: audit 2024-09-21T00:55:15.146404+0000 mgr.a (mgr.14388) 6954 : audit [DBG] from='client.158172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:16 smithi179 bash[23186]: cluster 2024-09-21T00:55:15.177345+0000 mgr.a (mgr.14388) 6955 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:16 smithi049 bash[23528]: audit 2024-09-21T00:55:15.146404+0000 mgr.a (mgr.14388) 6954 : audit [DBG] from='client.158172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:16 smithi049 bash[23528]: cluster 2024-09-21T00:55:15.177345+0000 mgr.a (mgr.14388) 6955 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:18.811 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:18 smithi049 bash[23528]: cluster 2024-09-21T00:55:17.178282+0000 mgr.a (mgr.14388) 6956 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:18 smithi044 bash[22676]: cluster 2024-09-21T00:55:17.178282+0000 mgr.a (mgr.14388) 6956 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:18 smithi179 bash[23186]: cluster 2024-09-21T00:55:17.178282+0000 mgr.a (mgr.14388) 6956 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:20.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:20.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:20.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:20 smithi049 bash[23528]: cluster 2024-09-21T00:55:19.179054+0000 mgr.a (mgr.14388) 6957 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:20 smithi044 bash[22676]: cluster 2024-09-21T00:55:19.179054+0000 mgr.a (mgr.14388) 6957 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:20 smithi179 bash[23186]: cluster 2024-09-21T00:55:19.179054+0000 mgr.a (mgr.14388) 6957 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:21.326 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:21.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:21.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:21.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:21.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:21 smithi044 bash[22676]: audit 2024-09-21T00:55:20.910840+0000 mgr.a (mgr.14388) 6958 : audit [DBG] from='client.158250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:21 smithi179 bash[23186]: audit 2024-09-21T00:55:20.910840+0000 mgr.a (mgr.14388) 6958 : audit [DBG] from='client.158250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:22.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:21 smithi049 bash[23528]: audit 2024-09-21T00:55:20.910840+0000 mgr.a (mgr.14388) 6958 : audit [DBG] from='client.158250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:22 smithi044 bash[22676]: cluster 2024-09-21T00:55:21.180363+0000 mgr.a (mgr.14388) 6959 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:22 smithi179 bash[23186]: cluster 2024-09-21T00:55:21.180363+0000 mgr.a (mgr.14388) 6959 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:22 smithi049 bash[23528]: cluster 2024-09-21T00:55:21.180363+0000 mgr.a (mgr.14388) 6959 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:24 smithi044 bash[22676]: cluster 2024-09-21T00:55:23.181430+0000 mgr.a (mgr.14388) 6960 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:24 smithi179 bash[23186]: cluster 2024-09-21T00:55:23.181430+0000 mgr.a (mgr.14388) 6960 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:25.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:24 smithi049 bash[23528]: cluster 2024-09-21T00:55:23.181430+0000 mgr.a (mgr.14388) 6960 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:55:26.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:26.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:26.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:26 smithi044 bash[22676]: cluster 2024-09-21T00:55:25.183601+0000 mgr.a (mgr.14388) 6961 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:26 smithi179 bash[23186]: cluster 2024-09-21T00:55:25.183601+0000 mgr.a (mgr.14388) 6961 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:27.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:26 smithi049 bash[23528]: cluster 2024-09-21T00:55:25.183601+0000 mgr.a (mgr.14388) 6961 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:27.106 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:27 smithi044 bash[22676]: audit 2024-09-21T00:55:26.672434+0000 mgr.a (mgr.14388) 6962 : audit [DBG] from='client.158325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:27 smithi179 bash[23186]: audit 2024-09-21T00:55:26.672434+0000 mgr.a (mgr.14388) 6962 : audit [DBG] from='client.158325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:28.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:27 smithi049 bash[23528]: audit 2024-09-21T00:55:26.672434+0000 mgr.a (mgr.14388) 6962 : audit [DBG] from='client.158325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:28.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22930]: debug 2024-09-21T00:55:28.825+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:55:28.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22930]: debug 2024-09-21T00:55:28.825+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:55:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22676]: cluster 2024-09-21T00:55:27.184561+0000 mgr.a (mgr.14388) 6963 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22676]: audit 2024-09-21T00:55:28.044522+0000 mon.a (mon.0) 6046 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22676]: audit 2024-09-21T00:55:28.051929+0000 mon.a (mon.0) 6047 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:55:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22676]: audit 2024-09-21T00:55:28.054180+0000 mon.a (mon.0) 6048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:55:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22676]: audit 2024-09-21T00:55:28.066010+0000 mon.a (mon.0) 6049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:28 smithi044 bash[22676]: audit 2024-09-21T00:55:28.072419+0000 mon.a (mon.0) 6050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:55:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:28 smithi179 bash[23186]: cluster 2024-09-21T00:55:27.184561+0000 mgr.a (mgr.14388) 6963 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:28 smithi179 bash[23186]: audit 2024-09-21T00:55:28.044522+0000 mon.a (mon.0) 6046 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:28 smithi179 bash[23186]: audit 2024-09-21T00:55:28.051929+0000 mon.a (mon.0) 6047 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:55:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:28 smithi179 bash[23186]: audit 2024-09-21T00:55:28.054180+0000 mon.a (mon.0) 6048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:55:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:28 smithi179 bash[23186]: audit 2024-09-21T00:55:28.066010+0000 mon.a (mon.0) 6049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:28 smithi179 bash[23186]: audit 2024-09-21T00:55:28.072419+0000 mon.a (mon.0) 6050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:55:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:28 smithi049 bash[23528]: cluster 2024-09-21T00:55:27.184561+0000 mgr.a (mgr.14388) 6963 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:28 smithi049 bash[23528]: audit 2024-09-21T00:55:28.044522+0000 mon.a (mon.0) 6046 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:28 smithi049 bash[23528]: audit 2024-09-21T00:55:28.051929+0000 mon.a (mon.0) 6047 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:55:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:28 smithi049 bash[23528]: audit 2024-09-21T00:55:28.054180+0000 mon.a (mon.0) 6048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:55:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:28 smithi049 bash[23528]: audit 2024-09-21T00:55:28.066010+0000 mon.a (mon.0) 6049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:28 smithi049 bash[23528]: audit 2024-09-21T00:55:28.072419+0000 mon.a (mon.0) 6050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:55:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:29 smithi044 bash[22676]: audit 2024-09-21T00:55:28.075202+0000 mgr.a (mgr.14388) 6964 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:55:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:29 smithi044 bash[22676]: audit 2024-09-21T00:55:28.830257+0000 mgr.a (mgr.14388) 6965 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:55:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:29 smithi044 bash[22676]: cephadm 2024-09-21T00:55:28.831377+0000 mgr.a (mgr.14388) 6966 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:55:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:29 smithi179 bash[23186]: audit 2024-09-21T00:55:28.075202+0000 mgr.a (mgr.14388) 6964 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:55:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:29 smithi179 bash[23186]: audit 2024-09-21T00:55:28.830257+0000 mgr.a (mgr.14388) 6965 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:55:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:29 smithi179 bash[23186]: cephadm 2024-09-21T00:55:28.831377+0000 mgr.a (mgr.14388) 6966 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:55:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:29 smithi049 bash[23528]: audit 2024-09-21T00:55:28.075202+0000 mgr.a (mgr.14388) 6964 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:55:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:29 smithi049 bash[23528]: audit 2024-09-21T00:55:28.830257+0000 mgr.a (mgr.14388) 6965 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:55:30.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:29 smithi049 bash[23528]: cephadm 2024-09-21T00:55:28.831377+0000 mgr.a (mgr.14388) 6966 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:55:30.868 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:30 smithi179 bash[23186]: cluster 2024-09-21T00:55:29.185475+0000 mgr.a (mgr.14388) 6967 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:30 smithi044 bash[22676]: cluster 2024-09-21T00:55:29.185475+0000 mgr.a (mgr.14388) 6967 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:30 smithi049 bash[23528]: cluster 2024-09-21T00:55:29.185475+0000 mgr.a (mgr.14388) 6967 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:32.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:32.108 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:32.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:32 smithi179 bash[23186]: cluster 2024-09-21T00:55:31.187704+0000 mgr.a (mgr.14388) 6968 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:32 smithi179 bash[23186]: audit 2024-09-21T00:55:32.466853+0000 mon.a (mon.0) 6051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:32 smithi179 bash[23186]: audit 2024-09-21T00:55:32.474088+0000 mon.a (mon.0) 6052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:32 smithi179 bash[23186]: audit 2024-09-21T00:55:32.481441+0000 mon.a (mon.0) 6053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:32.831 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:32 smithi044 bash[22676]: cluster 2024-09-21T00:55:31.187704+0000 mgr.a (mgr.14388) 6968 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:32.831 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:32 smithi044 bash[22676]: audit 2024-09-21T00:55:32.466853+0000 mon.a (mon.0) 6051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:32.832 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:32 smithi044 bash[22676]: audit 2024-09-21T00:55:32.474088+0000 mon.a (mon.0) 6052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:32.832 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:32 smithi044 bash[22676]: audit 2024-09-21T00:55:32.481441+0000 mon.a (mon.0) 6053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:32 smithi049 bash[23528]: cluster 2024-09-21T00:55:31.187704+0000 mgr.a (mgr.14388) 6968 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:32 smithi049 bash[23528]: audit 2024-09-21T00:55:32.466853+0000 mon.a (mon.0) 6051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:32 smithi049 bash[23528]: audit 2024-09-21T00:55:32.474088+0000 mon.a (mon.0) 6052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:32 smithi049 bash[23528]: audit 2024-09-21T00:55:32.481441+0000 mon.a (mon.0) 6053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:33 smithi044 bash[22676]: audit 2024-09-21T00:55:32.437555+0000 mgr.a (mgr.14388) 6969 : audit [DBG] from='client.158508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:33 smithi179 bash[23186]: audit 2024-09-21T00:55:32.437555+0000 mgr.a (mgr.14388) 6969 : audit [DBG] from='client.158508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:34.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:33 smithi049 bash[23528]: audit 2024-09-21T00:55:32.437555+0000 mgr.a (mgr.14388) 6969 : audit [DBG] from='client.158508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:34 smithi049 bash[23528]: cluster 2024-09-21T00:55:33.188574+0000 mgr.a (mgr.14388) 6970 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:34 smithi049 bash[23528]: audit 2024-09-21T00:55:33.768414+0000 mon.a (mon.0) 6054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:34 smithi049 bash[23528]: audit 2024-09-21T00:55:33.775697+0000 mon.a (mon.0) 6055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:34 smithi049 bash[23528]: audit 2024-09-21T00:55:33.785709+0000 mon.a (mon.0) 6056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:34 smithi049 bash[23528]: audit 2024-09-21T00:55:34.355751+0000 mon.a (mon.0) 6057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:34 smithi049 bash[23528]: audit 2024-09-21T00:55:34.363235+0000 mon.a (mon.0) 6058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:34 smithi049 bash[23528]: audit 2024-09-21T00:55:34.369275+0000 mon.a (mon.0) 6059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:34 smithi044 bash[22676]: cluster 2024-09-21T00:55:33.188574+0000 mgr.a (mgr.14388) 6970 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:35.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:34 smithi044 bash[22676]: audit 2024-09-21T00:55:33.768414+0000 mon.a (mon.0) 6054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:34 smithi044 bash[22676]: audit 2024-09-21T00:55:33.775697+0000 mon.a (mon.0) 6055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:34 smithi044 bash[22676]: audit 2024-09-21T00:55:33.785709+0000 mon.a (mon.0) 6056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:34 smithi044 bash[22676]: audit 2024-09-21T00:55:34.355751+0000 mon.a (mon.0) 6057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:34 smithi044 bash[22676]: audit 2024-09-21T00:55:34.363235+0000 mon.a (mon.0) 6058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:34 smithi044 bash[22676]: audit 2024-09-21T00:55:34.369275+0000 mon.a (mon.0) 6059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:34 smithi179 bash[23186]: cluster 2024-09-21T00:55:33.188574+0000 mgr.a (mgr.14388) 6970 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:34 smithi179 bash[23186]: audit 2024-09-21T00:55:33.768414+0000 mon.a (mon.0) 6054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:34 smithi179 bash[23186]: audit 2024-09-21T00:55:33.775697+0000 mon.a (mon.0) 6055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:34 smithi179 bash[23186]: audit 2024-09-21T00:55:33.785709+0000 mon.a (mon.0) 6056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:34 smithi179 bash[23186]: audit 2024-09-21T00:55:34.355751+0000 mon.a (mon.0) 6057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:34 smithi179 bash[23186]: audit 2024-09-21T00:55:34.363235+0000 mon.a (mon.0) 6058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:34 smithi179 bash[23186]: audit 2024-09-21T00:55:34.369275+0000 mon.a (mon.0) 6059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:37.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:36 smithi049 bash[23528]: cluster 2024-09-21T00:55:35.190811+0000 mgr.a (mgr.14388) 6971 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:36 smithi044 bash[22676]: cluster 2024-09-21T00:55:35.190811+0000 mgr.a (mgr.14388) 6971 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:36 smithi179 bash[23186]: cluster 2024-09-21T00:55:35.190811+0000 mgr.a (mgr.14388) 6971 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:37.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:37.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:37.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:38.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:38 smithi049 bash[23528]: cluster 2024-09-21T00:55:37.191572+0000 mgr.a (mgr.14388) 6972 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:38 smithi044 bash[22676]: cluster 2024-09-21T00:55:37.191572+0000 mgr.a (mgr.14388) 6972 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:38 smithi179 bash[23186]: cluster 2024-09-21T00:55:37.191572+0000 mgr.a (mgr.14388) 6972 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:40.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:39 smithi049 bash[23528]: audit 2024-09-21T00:55:38.197942+0000 mgr.a (mgr.14388) 6973 : audit [DBG] from='client.158586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:39 smithi044 bash[22676]: audit 2024-09-21T00:55:38.197942+0000 mgr.a (mgr.14388) 6973 : audit [DBG] from='client.158586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:39 smithi179 bash[23186]: audit 2024-09-21T00:55:38.197942+0000 mgr.a (mgr.14388) 6973 : audit [DBG] from='client.158586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:41.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:40 smithi049 bash[23528]: cluster 2024-09-21T00:55:39.192472+0000 mgr.a (mgr.14388) 6974 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:40 smithi044 bash[22676]: cluster 2024-09-21T00:55:39.192472+0000 mgr.a (mgr.14388) 6974 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:40 smithi179 bash[23186]: cluster 2024-09-21T00:55:39.192472+0000 mgr.a (mgr.14388) 6974 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:43.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:42 smithi049 bash[23528]: cluster 2024-09-21T00:55:41.194772+0000 mgr.a (mgr.14388) 6975 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:42 smithi044 bash[22676]: cluster 2024-09-21T00:55:41.194772+0000 mgr.a (mgr.14388) 6975 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:42 smithi179 bash[23186]: cluster 2024-09-21T00:55:41.194772+0000 mgr.a (mgr.14388) 6975 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:55:43.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:44.422 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:44.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:44.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:44.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:44.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:44 smithi049 bash[23528]: cluster 2024-09-21T00:55:43.195516+0000 mgr.a (mgr.14388) 6976 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:44 smithi049 bash[23528]: audit 2024-09-21T00:55:43.981646+0000 mgr.a (mgr.14388) 6977 : audit [DBG] from='client.158664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:44 smithi044 bash[22676]: cluster 2024-09-21T00:55:43.195516+0000 mgr.a (mgr.14388) 6976 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:44 smithi044 bash[22676]: audit 2024-09-21T00:55:43.981646+0000 mgr.a (mgr.14388) 6977 : audit [DBG] from='client.158664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:44 smithi179 bash[23186]: cluster 2024-09-21T00:55:43.195516+0000 mgr.a (mgr.14388) 6976 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:44 smithi179 bash[23186]: audit 2024-09-21T00:55:43.981646+0000 mgr.a (mgr.14388) 6977 : audit [DBG] from='client.158664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:47.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:46 smithi049 bash[23528]: cluster 2024-09-21T00:55:45.197926+0000 mgr.a (mgr.14388) 6978 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:46 smithi044 bash[22676]: cluster 2024-09-21T00:55:45.197926+0000 mgr.a (mgr.14388) 6978 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:46 smithi179 bash[23186]: cluster 2024-09-21T00:55:45.197926+0000 mgr.a (mgr.14388) 6978 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:55:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:48 smithi044 bash[22676]: cluster 2024-09-21T00:55:47.198861+0000 mgr.a (mgr.14388) 6979 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:48 smithi179 bash[23186]: cluster 2024-09-21T00:55:47.198861+0000 mgr.a (mgr.14388) 6979 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:48 smithi049 bash[23528]: cluster 2024-09-21T00:55:47.198861+0000 mgr.a (mgr.14388) 6979 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:50.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:50.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:50.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:50.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:50.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:51.081 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:50 smithi179 bash[23186]: cluster 2024-09-21T00:55:49.199805+0000 mgr.a (mgr.14388) 6980 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:51.081 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:50 smithi179 bash[23186]: audit 2024-09-21T00:55:49.754630+0000 mgr.a (mgr.14388) 6981 : audit [DBG] from='client.158739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:50 smithi044 bash[22676]: cluster 2024-09-21T00:55:49.199805+0000 mgr.a (mgr.14388) 6980 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:50 smithi044 bash[22676]: audit 2024-09-21T00:55:49.754630+0000 mgr.a (mgr.14388) 6981 : audit [DBG] from='client.158739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:50 smithi049 bash[23528]: cluster 2024-09-21T00:55:49.199805+0000 mgr.a (mgr.14388) 6980 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:55:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:50 smithi049 bash[23528]: audit 2024-09-21T00:55:49.754630+0000 mgr.a (mgr.14388) 6981 : audit [DBG] from='client.158739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:52 smithi179 bash[23186]: cluster 2024-09-21T00:55:51.202602+0000 mgr.a (mgr.14388) 6982 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:55:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:52 smithi179 bash[23186]: audit 2024-09-21T00:55:52.633751+0000 mon.a (mon.0) 6060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:52 smithi179 bash[23186]: audit 2024-09-21T00:55:52.639342+0000 mon.a (mon.0) 6061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:52 smithi179 bash[23186]: audit 2024-09-21T00:55:52.646195+0000 mon.a (mon.0) 6062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:52 smithi044 bash[22676]: cluster 2024-09-21T00:55:51.202602+0000 mgr.a (mgr.14388) 6982 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:55:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:52 smithi044 bash[22676]: audit 2024-09-21T00:55:52.633751+0000 mon.a (mon.0) 6060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:52 smithi044 bash[22676]: audit 2024-09-21T00:55:52.639342+0000 mon.a (mon.0) 6061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:52 smithi044 bash[22676]: audit 2024-09-21T00:55:52.646195+0000 mon.a (mon.0) 6062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:52 smithi049 bash[23528]: cluster 2024-09-21T00:55:51.202602+0000 mgr.a (mgr.14388) 6982 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:55:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:52 smithi049 bash[23528]: audit 2024-09-21T00:55:52.633751+0000 mon.a (mon.0) 6060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:52 smithi049 bash[23528]: audit 2024-09-21T00:55:52.639342+0000 mon.a (mon.0) 6061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:52 smithi049 bash[23528]: audit 2024-09-21T00:55:52.646195+0000 mon.a (mon.0) 6062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:55:55.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:55:55.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:55:55.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:54 smithi044 bash[22676]: cluster 2024-09-21T00:55:53.203401+0000 mgr.a (mgr.14388) 6983 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:55:55.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:54 smithi044 bash[22676]: audit 2024-09-21T00:55:53.919342+0000 mon.a (mon.0) 6063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:54 smithi044 bash[22676]: audit 2024-09-21T00:55:53.925656+0000 mon.a (mon.0) 6064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:54 smithi044 bash[22676]: audit 2024-09-21T00:55:53.934547+0000 mon.a (mon.0) 6065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:54 smithi044 bash[22676]: audit 2024-09-21T00:55:54.565878+0000 mon.a (mon.0) 6066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:54 smithi044 bash[22676]: audit 2024-09-21T00:55:54.573182+0000 mon.a (mon.0) 6067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:54 smithi044 bash[22676]: audit 2024-09-21T00:55:54.580058+0000 mon.a (mon.0) 6068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:54 smithi179 bash[23186]: cluster 2024-09-21T00:55:53.203401+0000 mgr.a (mgr.14388) 6983 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:55:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:54 smithi179 bash[23186]: audit 2024-09-21T00:55:53.919342+0000 mon.a (mon.0) 6063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:54 smithi179 bash[23186]: audit 2024-09-21T00:55:53.925656+0000 mon.a (mon.0) 6064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:54 smithi179 bash[23186]: audit 2024-09-21T00:55:53.934547+0000 mon.a (mon.0) 6065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:54 smithi179 bash[23186]: audit 2024-09-21T00:55:54.565878+0000 mon.a (mon.0) 6066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:54 smithi179 bash[23186]: audit 2024-09-21T00:55:54.573182+0000 mon.a (mon.0) 6067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:54 smithi179 bash[23186]: audit 2024-09-21T00:55:54.580058+0000 mon.a (mon.0) 6068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:54 smithi049 bash[23528]: cluster 2024-09-21T00:55:53.203401+0000 mgr.a (mgr.14388) 6983 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:55:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:54 smithi049 bash[23528]: audit 2024-09-21T00:55:53.919342+0000 mon.a (mon.0) 6063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:54 smithi049 bash[23528]: audit 2024-09-21T00:55:53.925656+0000 mon.a (mon.0) 6064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:54 smithi049 bash[23528]: audit 2024-09-21T00:55:53.934547+0000 mon.a (mon.0) 6065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:54 smithi049 bash[23528]: audit 2024-09-21T00:55:54.565878+0000 mon.a (mon.0) 6066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:54 smithi049 bash[23528]: audit 2024-09-21T00:55:54.573182+0000 mon.a (mon.0) 6067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:54 smithi049 bash[23528]: audit 2024-09-21T00:55:54.580058+0000 mon.a (mon.0) 6068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:55:55.934 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:55:55.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:55:55.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:55:55.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:55:55.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:55:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:56 smithi044 bash[22676]: cluster 2024-09-21T00:55:55.205491+0000 mgr.a (mgr.14388) 6984 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:55:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:56 smithi044 bash[22676]: audit 2024-09-21T00:55:55.512593+0000 mgr.a (mgr.14388) 6985 : audit [DBG] from='client.158817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:56 smithi179 bash[23186]: cluster 2024-09-21T00:55:55.205491+0000 mgr.a (mgr.14388) 6984 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:55:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:56 smithi179 bash[23186]: audit 2024-09-21T00:55:55.512593+0000 mgr.a (mgr.14388) 6985 : audit [DBG] from='client.158817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:56 smithi049 bash[23528]: cluster 2024-09-21T00:55:55.205491+0000 mgr.a (mgr.14388) 6984 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T00:55:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:56 smithi049 bash[23528]: audit 2024-09-21T00:55:55.512593+0000 mgr.a (mgr.14388) 6985 : audit [DBG] from='client.158817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:59.199 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:55:58 smithi049 bash[23528]: cluster 2024-09-21T00:55:57.206514+0000 mgr.a (mgr.14388) 6986 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:55:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:55:58 smithi044 bash[22676]: cluster 2024-09-21T00:55:57.206514+0000 mgr.a (mgr.14388) 6986 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:55:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:55:58 smithi179 bash[23186]: cluster 2024-09-21T00:55:57.206514+0000 mgr.a (mgr.14388) 6986 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:56:00.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:00.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:00.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:01.218 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:00 smithi049 bash[23528]: cluster 2024-09-21T00:55:59.207325+0000 mgr.a (mgr.14388) 6987 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:56:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:00 smithi044 bash[22676]: cluster 2024-09-21T00:55:59.207325+0000 mgr.a (mgr.14388) 6987 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:56:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:00 smithi179 bash[23186]: cluster 2024-09-21T00:55:59.207325+0000 mgr.a (mgr.14388) 6987 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:56:01.709 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:01.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:01.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:01.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:01.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:02 smithi044 bash[22676]: cluster 2024-09-21T00:56:01.209624+0000 mgr.a (mgr.14388) 6988 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T00:56:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:02 smithi044 bash[22676]: audit 2024-09-21T00:56:01.272454+0000 mgr.a (mgr.14388) 6989 : audit [DBG] from='client.158895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:02 smithi179 bash[23186]: cluster 2024-09-21T00:56:01.209624+0000 mgr.a (mgr.14388) 6988 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T00:56:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:02 smithi179 bash[23186]: audit 2024-09-21T00:56:01.272454+0000 mgr.a (mgr.14388) 6989 : audit [DBG] from='client.158895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:02 smithi049 bash[23528]: cluster 2024-09-21T00:56:01.209624+0000 mgr.a (mgr.14388) 6988 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T00:56:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:02 smithi049 bash[23528]: audit 2024-09-21T00:56:01.272454+0000 mgr.a (mgr.14388) 6989 : audit [DBG] from='client.158895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:04 smithi044 bash[22676]: cluster 2024-09-21T00:56:03.210612+0000 mgr.a (mgr.14388) 6990 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:04 smithi179 bash[23186]: cluster 2024-09-21T00:56:03.210612+0000 mgr.a (mgr.14388) 6990 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:04 smithi049 bash[23528]: cluster 2024-09-21T00:56:03.210612+0000 mgr.a (mgr.14388) 6990 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:06.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:06 smithi044 bash[22676]: cluster 2024-09-21T00:56:05.212784+0000 mgr.a (mgr.14388) 6991 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:06 smithi179 bash[23186]: cluster 2024-09-21T00:56:05.212784+0000 mgr.a (mgr.14388) 6991 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:07.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:06 smithi049 bash[23528]: cluster 2024-09-21T00:56:05.212784+0000 mgr.a (mgr.14388) 6991 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:07.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:07.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:07.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:07.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:07.496 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:08 smithi044 bash[22676]: audit 2024-09-21T00:56:07.043483+0000 mgr.a (mgr.14388) 6992 : audit [DBG] from='client.158973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:08 smithi044 bash[22676]: cluster 2024-09-21T00:56:07.213439+0000 mgr.a (mgr.14388) 6993 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:08 smithi179 bash[23186]: audit 2024-09-21T00:56:07.043483+0000 mgr.a (mgr.14388) 6992 : audit [DBG] from='client.158973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:08 smithi179 bash[23186]: cluster 2024-09-21T00:56:07.213439+0000 mgr.a (mgr.14388) 6993 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:08 smithi049 bash[23528]: audit 2024-09-21T00:56:07.043483+0000 mgr.a (mgr.14388) 6992 : audit [DBG] from='client.158973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:08 smithi049 bash[23528]: cluster 2024-09-21T00:56:07.213439+0000 mgr.a (mgr.14388) 6993 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:10 smithi044 bash[22676]: cluster 2024-09-21T00:56:09.214577+0000 mgr.a (mgr.14388) 6994 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:10 smithi179 bash[23186]: cluster 2024-09-21T00:56:09.214577+0000 mgr.a (mgr.14388) 6994 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:10 smithi049 bash[23528]: cluster 2024-09-21T00:56:09.214577+0000 mgr.a (mgr.14388) 6994 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-21T00:56:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:12.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:12 smithi044 bash[22676]: cluster 2024-09-21T00:56:11.216918+0000 mgr.a (mgr.14388) 6995 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-21T00:56:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:12 smithi044 bash[22676]: audit 2024-09-21T00:56:12.848929+0000 mon.a (mon.0) 6069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:12 smithi044 bash[22676]: audit 2024-09-21T00:56:12.855205+0000 mon.a (mon.0) 6070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:12 smithi044 bash[22676]: audit 2024-09-21T00:56:12.874260+0000 mon.a (mon.0) 6071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:12 smithi179 bash[23186]: cluster 2024-09-21T00:56:11.216918+0000 mgr.a (mgr.14388) 6995 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-21T00:56:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:12 smithi179 bash[23186]: audit 2024-09-21T00:56:12.848929+0000 mon.a (mon.0) 6069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:12 smithi179 bash[23186]: audit 2024-09-21T00:56:12.855205+0000 mon.a (mon.0) 6070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:12 smithi179 bash[23186]: audit 2024-09-21T00:56:12.874260+0000 mon.a (mon.0) 6071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.293 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:13.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:13.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:13.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:13.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:12 smithi049 bash[23528]: cluster 2024-09-21T00:56:11.216918+0000 mgr.a (mgr.14388) 6995 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 69 op/s 2024-09-21T00:56:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:12 smithi049 bash[23528]: audit 2024-09-21T00:56:12.848929+0000 mon.a (mon.0) 6069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:12 smithi049 bash[23528]: audit 2024-09-21T00:56:12.855205+0000 mon.a (mon.0) 6070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:12 smithi049 bash[23528]: audit 2024-09-21T00:56:12.874260+0000 mon.a (mon.0) 6071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:13 smithi044 bash[22676]: audit 2024-09-21T00:56:12.849945+0000 mgr.a (mgr.14388) 6996 : audit [DBG] from='client.159048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:13 smithi179 bash[23186]: audit 2024-09-21T00:56:12.849945+0000 mgr.a (mgr.14388) 6996 : audit [DBG] from='client.159048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:14.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:13 smithi049 bash[23528]: audit 2024-09-21T00:56:12.849945+0000 mgr.a (mgr.14388) 6996 : audit [DBG] from='client.159048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:14 smithi049 bash[23528]: cluster 2024-09-21T00:56:13.217748+0000 mgr.a (mgr.14388) 6997 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:14 smithi049 bash[23528]: audit 2024-09-21T00:56:14.156752+0000 mon.a (mon.0) 6072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:14 smithi049 bash[23528]: audit 2024-09-21T00:56:14.165374+0000 mon.a (mon.0) 6073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:14 smithi049 bash[23528]: audit 2024-09-21T00:56:14.176205+0000 mon.a (mon.0) 6074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:14 smithi049 bash[23528]: audit 2024-09-21T00:56:14.773323+0000 mon.a (mon.0) 6075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:14 smithi049 bash[23528]: audit 2024-09-21T00:56:14.779342+0000 mon.a (mon.0) 6076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:14 smithi049 bash[23528]: audit 2024-09-21T00:56:14.787953+0000 mon.a (mon.0) 6077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:14 smithi044 bash[22676]: cluster 2024-09-21T00:56:13.217748+0000 mgr.a (mgr.14388) 6997 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:14 smithi044 bash[22676]: audit 2024-09-21T00:56:14.156752+0000 mon.a (mon.0) 6072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:14 smithi044 bash[22676]: audit 2024-09-21T00:56:14.165374+0000 mon.a (mon.0) 6073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:14 smithi044 bash[22676]: audit 2024-09-21T00:56:14.176205+0000 mon.a (mon.0) 6074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:14 smithi044 bash[22676]: audit 2024-09-21T00:56:14.773323+0000 mon.a (mon.0) 6075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:14 smithi044 bash[22676]: audit 2024-09-21T00:56:14.779342+0000 mon.a (mon.0) 6076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:14 smithi044 bash[22676]: audit 2024-09-21T00:56:14.787953+0000 mon.a (mon.0) 6077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:14 smithi179 bash[23186]: cluster 2024-09-21T00:56:13.217748+0000 mgr.a (mgr.14388) 6997 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:14 smithi179 bash[23186]: audit 2024-09-21T00:56:14.156752+0000 mon.a (mon.0) 6072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:14 smithi179 bash[23186]: audit 2024-09-21T00:56:14.165374+0000 mon.a (mon.0) 6073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:14 smithi179 bash[23186]: audit 2024-09-21T00:56:14.176205+0000 mon.a (mon.0) 6074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:14 smithi179 bash[23186]: audit 2024-09-21T00:56:14.773323+0000 mon.a (mon.0) 6075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:14 smithi179 bash[23186]: audit 2024-09-21T00:56:14.779342+0000 mon.a (mon.0) 6076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:14 smithi179 bash[23186]: audit 2024-09-21T00:56:14.787953+0000 mon.a (mon.0) 6077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:16 smithi044 bash[22676]: cluster 2024-09-21T00:56:15.219015+0000 mgr.a (mgr.14388) 6998 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:16 smithi179 bash[23186]: cluster 2024-09-21T00:56:15.219015+0000 mgr.a (mgr.14388) 6998 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:16 smithi049 bash[23528]: cluster 2024-09-21T00:56:15.219015+0000 mgr.a (mgr.14388) 6998 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:19.085 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:19.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:19.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:19.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:19.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:18 smithi044 bash[22676]: cluster 2024-09-21T00:56:17.219770+0000 mgr.a (mgr.14388) 6999 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:18 smithi179 bash[23186]: cluster 2024-09-21T00:56:17.219770+0000 mgr.a (mgr.14388) 6999 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:18 smithi049 bash[23528]: cluster 2024-09-21T00:56:17.219770+0000 mgr.a (mgr.14388) 6999 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:19 smithi044 bash[22676]: audit 2024-09-21T00:56:18.632120+0000 mgr.a (mgr.14388) 7000 : audit [DBG] from='client.159126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:19 smithi179 bash[23186]: audit 2024-09-21T00:56:18.632120+0000 mgr.a (mgr.14388) 7000 : audit [DBG] from='client.159126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:20.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:19 smithi049 bash[23528]: audit 2024-09-21T00:56:18.632120+0000 mgr.a (mgr.14388) 7000 : audit [DBG] from='client.159126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:20 smithi179 bash[23186]: cluster 2024-09-21T00:56:19.220737+0000 mgr.a (mgr.14388) 7001 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:20 smithi049 bash[23528]: cluster 2024-09-21T00:56:19.220737+0000 mgr.a (mgr.14388) 7001 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:20 smithi044 bash[22676]: cluster 2024-09-21T00:56:19.220737+0000 mgr.a (mgr.14388) 7001 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:22 smithi179 bash[23186]: cluster 2024-09-21T00:56:21.223007+0000 mgr.a (mgr.14388) 7002 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:22 smithi049 bash[23528]: cluster 2024-09-21T00:56:21.223007+0000 mgr.a (mgr.14388) 7002 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:22 smithi044 bash[22676]: cluster 2024-09-21T00:56:21.223007+0000 mgr.a (mgr.14388) 7002 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:24.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:24.087 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:24.087 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:24.843 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:24 smithi179 bash[23186]: cluster 2024-09-21T00:56:23.223776+0000 mgr.a (mgr.14388) 7003 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:25 smithi049 bash[23528]: cluster 2024-09-21T00:56:23.223776+0000 mgr.a (mgr.14388) 7003 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:24 smithi044 bash[22676]: cluster 2024-09-21T00:56:23.223776+0000 mgr.a (mgr.14388) 7003 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:26.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:26 smithi049 bash[23528]: audit 2024-09-21T00:56:24.416730+0000 mgr.a (mgr.14388) 7004 : audit [DBG] from='client.159201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:26 smithi044 bash[22676]: audit 2024-09-21T00:56:24.416730+0000 mgr.a (mgr.14388) 7004 : audit [DBG] from='client.159201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:26 smithi179 bash[23186]: audit 2024-09-21T00:56:24.416730+0000 mgr.a (mgr.14388) 7004 : audit [DBG] from='client.159201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:27 smithi049 bash[23528]: cluster 2024-09-21T00:56:25.226088+0000 mgr.a (mgr.14388) 7005 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:27 smithi044 bash[22676]: cluster 2024-09-21T00:56:25.226088+0000 mgr.a (mgr.14388) 7005 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:27 smithi179 bash[23186]: cluster 2024-09-21T00:56:25.226088+0000 mgr.a (mgr.14388) 7005 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:29 smithi049 bash[23528]: cluster 2024-09-21T00:56:27.227005+0000 mgr.a (mgr.14388) 7006 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:29 smithi049 bash[23528]: audit 2024-09-21T00:56:28.890273+0000 mon.a (mon.0) 6078 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:56:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:29 smithi049 bash[23528]: audit 2024-09-21T00:56:28.897201+0000 mon.a (mon.0) 6079 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:29 smithi049 bash[23528]: audit 2024-09-21T00:56:28.899230+0000 mon.a (mon.0) 6080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:56:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:29 smithi049 bash[23528]: audit 2024-09-21T00:56:28.911028+0000 mon.a (mon.0) 6081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:29 smithi049 bash[23528]: audit 2024-09-21T00:56:28.917506+0000 mon.a (mon.0) 6082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:56:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22676]: cluster 2024-09-21T00:56:27.227005+0000 mgr.a (mgr.14388) 7006 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22676]: audit 2024-09-21T00:56:28.890273+0000 mon.a (mon.0) 6078 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:56:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22676]: audit 2024-09-21T00:56:28.897201+0000 mon.a (mon.0) 6079 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22676]: audit 2024-09-21T00:56:28.899230+0000 mon.a (mon.0) 6080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:56:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22676]: audit 2024-09-21T00:56:28.911028+0000 mon.a (mon.0) 6081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22676]: audit 2024-09-21T00:56:28.917506+0000 mon.a (mon.0) 6082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:56:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:29 smithi179 bash[23186]: cluster 2024-09-21T00:56:27.227005+0000 mgr.a (mgr.14388) 7006 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:29 smithi179 bash[23186]: audit 2024-09-21T00:56:28.890273+0000 mon.a (mon.0) 6078 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:56:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:29 smithi179 bash[23186]: audit 2024-09-21T00:56:28.897201+0000 mon.a (mon.0) 6079 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:29 smithi179 bash[23186]: audit 2024-09-21T00:56:28.899230+0000 mon.a (mon.0) 6080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:56:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:29 smithi179 bash[23186]: audit 2024-09-21T00:56:28.911028+0000 mon.a (mon.0) 6081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:29 smithi179 bash[23186]: audit 2024-09-21T00:56:28.917506+0000 mon.a (mon.0) 6082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:56:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:29.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22930]: debug 2024-09-21T00:56:29.725+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:56:29.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:56:29 smithi044 bash[22930]: debug 2024-09-21T00:56:29.729+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:56:30.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:30 smithi049 bash[23528]: audit 2024-09-21T00:56:28.919871+0000 mgr.a (mgr.14388) 7007 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:56:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:30 smithi044 bash[22676]: audit 2024-09-21T00:56:28.919871+0000 mgr.a (mgr.14388) 7007 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:56:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:30 smithi179 bash[23186]: audit 2024-09-21T00:56:28.919871+0000 mgr.a (mgr.14388) 7007 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:56:30.607 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:30.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:31 smithi049 bash[23528]: cluster 2024-09-21T00:56:29.227604+0000 mgr.a (mgr.14388) 7008 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:31 smithi049 bash[23528]: audit 2024-09-21T00:56:29.728430+0000 mgr.a (mgr.14388) 7009 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:56:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:31 smithi049 bash[23528]: cephadm 2024-09-21T00:56:29.730143+0000 mgr.a (mgr.14388) 7010 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:56:31.444 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:31 smithi179 bash[23186]: cluster 2024-09-21T00:56:29.227604+0000 mgr.a (mgr.14388) 7008 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:31.444 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:31 smithi179 bash[23186]: audit 2024-09-21T00:56:29.728430+0000 mgr.a (mgr.14388) 7009 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:56:31.444 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:31 smithi179 bash[23186]: cephadm 2024-09-21T00:56:29.730143+0000 mgr.a (mgr.14388) 7010 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:56:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:31 smithi044 bash[22676]: cluster 2024-09-21T00:56:29.227604+0000 mgr.a (mgr.14388) 7008 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:31 smithi044 bash[22676]: audit 2024-09-21T00:56:29.728430+0000 mgr.a (mgr.14388) 7009 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:56:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:31 smithi044 bash[22676]: cephadm 2024-09-21T00:56:29.730143+0000 mgr.a (mgr.14388) 7010 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:56:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:32 smithi044 bash[22676]: audit 2024-09-21T00:56:30.182535+0000 mgr.a (mgr.14388) 7011 : audit [DBG] from='client.159384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:32 smithi049 bash[23528]: audit 2024-09-21T00:56:30.182535+0000 mgr.a (mgr.14388) 7011 : audit [DBG] from='client.159384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:32.307 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:32 smithi179 bash[23186]: audit 2024-09-21T00:56:30.182535+0000 mgr.a (mgr.14388) 7011 : audit [DBG] from='client.159384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:33.126 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:33 smithi044 bash[22676]: cluster 2024-09-21T00:56:31.230528+0000 mgr.a (mgr.14388) 7012 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:33 smithi049 bash[23528]: cluster 2024-09-21T00:56:31.230528+0000 mgr.a (mgr.14388) 7012 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:33 smithi179 bash[23186]: cluster 2024-09-21T00:56:31.230528+0000 mgr.a (mgr.14388) 7012 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:34 smithi049 bash[23528]: audit 2024-09-21T00:56:33.041973+0000 mon.a (mon.0) 6083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:34 smithi049 bash[23528]: audit 2024-09-21T00:56:33.046889+0000 mon.a (mon.0) 6084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:34 smithi049 bash[23528]: audit 2024-09-21T00:56:33.052086+0000 mon.a (mon.0) 6085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:34 smithi049 bash[23528]: cluster 2024-09-21T00:56:33.231369+0000 mgr.a (mgr.14388) 7013 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:34.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:34 smithi044 bash[22676]: audit 2024-09-21T00:56:33.041973+0000 mon.a (mon.0) 6083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:34 smithi044 bash[22676]: audit 2024-09-21T00:56:33.046889+0000 mon.a (mon.0) 6084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:34 smithi044 bash[22676]: audit 2024-09-21T00:56:33.052086+0000 mon.a (mon.0) 6085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:34 smithi044 bash[22676]: cluster 2024-09-21T00:56:33.231369+0000 mgr.a (mgr.14388) 7013 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:34 smithi179 bash[23186]: audit 2024-09-21T00:56:33.041973+0000 mon.a (mon.0) 6083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:34 smithi179 bash[23186]: audit 2024-09-21T00:56:33.046889+0000 mon.a (mon.0) 6084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:34 smithi179 bash[23186]: audit 2024-09-21T00:56:33.052086+0000 mon.a (mon.0) 6085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:34 smithi179 bash[23186]: cluster 2024-09-21T00:56:33.231369+0000 mgr.a (mgr.14388) 7013 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:35.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:35.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:35.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:35 smithi044 bash[22676]: audit 2024-09-21T00:56:34.352144+0000 mon.a (mon.0) 6086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:35 smithi044 bash[22676]: audit 2024-09-21T00:56:34.360085+0000 mon.a (mon.0) 6087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:35 smithi044 bash[22676]: audit 2024-09-21T00:56:34.368286+0000 mon.a (mon.0) 6088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:35 smithi044 bash[22676]: audit 2024-09-21T00:56:34.982270+0000 mon.a (mon.0) 6089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:35 smithi044 bash[22676]: audit 2024-09-21T00:56:34.987757+0000 mon.a (mon.0) 6090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:35 smithi044 bash[22676]: audit 2024-09-21T00:56:34.993244+0000 mon.a (mon.0) 6091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:35 smithi179 bash[23186]: audit 2024-09-21T00:56:34.352144+0000 mon.a (mon.0) 6086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:35 smithi179 bash[23186]: audit 2024-09-21T00:56:34.360085+0000 mon.a (mon.0) 6087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:35 smithi179 bash[23186]: audit 2024-09-21T00:56:34.368286+0000 mon.a (mon.0) 6088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:35 smithi179 bash[23186]: audit 2024-09-21T00:56:34.982270+0000 mon.a (mon.0) 6089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:35 smithi179 bash[23186]: audit 2024-09-21T00:56:34.987757+0000 mon.a (mon.0) 6090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:35 smithi179 bash[23186]: audit 2024-09-21T00:56:34.993244+0000 mon.a (mon.0) 6091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:35 smithi049 bash[23528]: audit 2024-09-21T00:56:34.352144+0000 mon.a (mon.0) 6086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:35 smithi049 bash[23528]: audit 2024-09-21T00:56:34.360085+0000 mon.a (mon.0) 6087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:35 smithi049 bash[23528]: audit 2024-09-21T00:56:34.368286+0000 mon.a (mon.0) 6088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:35 smithi049 bash[23528]: audit 2024-09-21T00:56:34.982270+0000 mon.a (mon.0) 6089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:35 smithi049 bash[23528]: audit 2024-09-21T00:56:34.987757+0000 mon.a (mon.0) 6090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:35.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:35 smithi049 bash[23528]: audit 2024-09-21T00:56:34.993244+0000 mon.a (mon.0) 6091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:36.367 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:36 smithi179 bash[23186]: cluster 2024-09-21T00:56:35.233390+0000 mgr.a (mgr.14388) 7014 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:36 smithi179 bash[23186]: audit 2024-09-21T00:56:35.945221+0000 mgr.a (mgr.14388) 7015 : audit [DBG] from='client.159462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:36 smithi049 bash[23528]: cluster 2024-09-21T00:56:35.233390+0000 mgr.a (mgr.14388) 7014 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:36 smithi049 bash[23528]: audit 2024-09-21T00:56:35.945221+0000 mgr.a (mgr.14388) 7015 : audit [DBG] from='client.159462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:36 smithi044 bash[22676]: cluster 2024-09-21T00:56:35.233390+0000 mgr.a (mgr.14388) 7014 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:36 smithi044 bash[22676]: audit 2024-09-21T00:56:35.945221+0000 mgr.a (mgr.14388) 7015 : audit [DBG] from='client.159462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:39 smithi179 bash[23186]: cluster 2024-09-21T00:56:37.234380+0000 mgr.a (mgr.14388) 7016 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:39.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:39 smithi049 bash[23528]: cluster 2024-09-21T00:56:37.234380+0000 mgr.a (mgr.14388) 7016 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:39 smithi044 bash[22676]: cluster 2024-09-21T00:56:37.234380+0000 mgr.a (mgr.14388) 7016 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:41 smithi049 bash[23528]: cluster 2024-09-21T00:56:39.235186+0000 mgr.a (mgr.14388) 7017 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:41.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:41.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:41.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:41 smithi044 bash[22676]: cluster 2024-09-21T00:56:39.235186+0000 mgr.a (mgr.14388) 7017 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:41 smithi179 bash[23186]: cluster 2024-09-21T00:56:39.235186+0000 mgr.a (mgr.14388) 7017 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:56:42.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:43 smithi049 bash[23528]: cluster 2024-09-21T00:56:41.237450+0000 mgr.a (mgr.14388) 7018 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:43 smithi049 bash[23528]: audit 2024-09-21T00:56:41.705150+0000 mgr.a (mgr.14388) 7019 : audit [DBG] from='client.159540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:43 smithi044 bash[22676]: cluster 2024-09-21T00:56:41.237450+0000 mgr.a (mgr.14388) 7018 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:43 smithi044 bash[22676]: audit 2024-09-21T00:56:41.705150+0000 mgr.a (mgr.14388) 7019 : audit [DBG] from='client.159540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:43 smithi179 bash[23186]: cluster 2024-09-21T00:56:41.237450+0000 mgr.a (mgr.14388) 7018 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:56:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:43 smithi179 bash[23186]: audit 2024-09-21T00:56:41.705150+0000 mgr.a (mgr.14388) 7019 : audit [DBG] from='client.159540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:45 smithi049 bash[23528]: cluster 2024-09-21T00:56:43.238365+0000 mgr.a (mgr.14388) 7020 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:45 smithi044 bash[22676]: cluster 2024-09-21T00:56:43.238365+0000 mgr.a (mgr.14388) 7020 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:45 smithi179 bash[23186]: cluster 2024-09-21T00:56:43.238365+0000 mgr.a (mgr.14388) 7020 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:47.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:47.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:47 smithi049 bash[23528]: cluster 2024-09-21T00:56:45.240528+0000 mgr.a (mgr.14388) 7021 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:47 smithi044 bash[22676]: cluster 2024-09-21T00:56:45.240528+0000 mgr.a (mgr.14388) 7021 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:47 smithi179 bash[23186]: cluster 2024-09-21T00:56:45.240528+0000 mgr.a (mgr.14388) 7021 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:47.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:47.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:47.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:47.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:47.937 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:49 smithi049 bash[23528]: cluster 2024-09-21T00:56:47.241310+0000 mgr.a (mgr.14388) 7022 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:49 smithi049 bash[23528]: audit 2024-09-21T00:56:47.488969+0000 mgr.a (mgr.14388) 7023 : audit [DBG] from='client.159615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:49 smithi044 bash[22676]: cluster 2024-09-21T00:56:47.241310+0000 mgr.a (mgr.14388) 7022 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:49 smithi044 bash[22676]: audit 2024-09-21T00:56:47.488969+0000 mgr.a (mgr.14388) 7023 : audit [DBG] from='client.159615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:49 smithi179 bash[23186]: cluster 2024-09-21T00:56:47.241310+0000 mgr.a (mgr.14388) 7022 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:49 smithi179 bash[23186]: audit 2024-09-21T00:56:47.488969+0000 mgr.a (mgr.14388) 7023 : audit [DBG] from='client.159615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:51 smithi049 bash[23528]: cluster 2024-09-21T00:56:49.242281+0000 mgr.a (mgr.14388) 7024 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:51 smithi044 bash[22676]: cluster 2024-09-21T00:56:49.242281+0000 mgr.a (mgr.14388) 7024 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:51 smithi179 bash[23186]: cluster 2024-09-21T00:56:49.242281+0000 mgr.a (mgr.14388) 7024 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:52.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:53 smithi049 bash[23528]: cluster 2024-09-21T00:56:51.244539+0000 mgr.a (mgr.14388) 7025 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:53.326 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:53 smithi179 bash[23186]: cluster 2024-09-21T00:56:51.244539+0000 mgr.a (mgr.14388) 7025 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:53 smithi044 bash[22676]: cluster 2024-09-21T00:56:51.244539+0000 mgr.a (mgr.14388) 7025 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:53.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:53.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:53.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:53.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:53.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:56:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:54 smithi044 bash[22676]: audit 2024-09-21T00:56:53.236781+0000 mon.a (mon.0) 6092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:54 smithi044 bash[22676]: audit 2024-09-21T00:56:53.244995+0000 mon.a (mon.0) 6093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:54 smithi044 bash[22676]: cluster 2024-09-21T00:56:53.245281+0000 mgr.a (mgr.14388) 7026 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:54 smithi044 bash[22676]: audit 2024-09-21T00:56:53.256059+0000 mon.a (mon.0) 6094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:54 smithi044 bash[22676]: audit 2024-09-21T00:56:53.281721+0000 mgr.a (mgr.14388) 7027 : audit [DBG] from='client.159690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:54 smithi179 bash[23186]: audit 2024-09-21T00:56:53.236781+0000 mon.a (mon.0) 6092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:54 smithi179 bash[23186]: audit 2024-09-21T00:56:53.244995+0000 mon.a (mon.0) 6093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:54 smithi179 bash[23186]: cluster 2024-09-21T00:56:53.245281+0000 mgr.a (mgr.14388) 7026 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:54 smithi179 bash[23186]: audit 2024-09-21T00:56:53.256059+0000 mon.a (mon.0) 6094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:54 smithi179 bash[23186]: audit 2024-09-21T00:56:53.281721+0000 mgr.a (mgr.14388) 7027 : audit [DBG] from='client.159690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:54 smithi049 bash[23528]: audit 2024-09-21T00:56:53.236781+0000 mon.a (mon.0) 6092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:54 smithi049 bash[23528]: audit 2024-09-21T00:56:53.244995+0000 mon.a (mon.0) 6093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:54 smithi049 bash[23528]: cluster 2024-09-21T00:56:53.245281+0000 mgr.a (mgr.14388) 7026 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:54 smithi049 bash[23528]: audit 2024-09-21T00:56:53.256059+0000 mon.a (mon.0) 6094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:54.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:54 smithi049 bash[23528]: audit 2024-09-21T00:56:53.281721+0000 mgr.a (mgr.14388) 7027 : audit [DBG] from='client.159690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:55 smithi049 bash[23528]: audit 2024-09-21T00:56:54.535271+0000 mon.a (mon.0) 6095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:55 smithi049 bash[23528]: audit 2024-09-21T00:56:54.542309+0000 mon.a (mon.0) 6096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:55 smithi049 bash[23528]: audit 2024-09-21T00:56:54.548694+0000 mon.a (mon.0) 6097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:55 smithi049 bash[23528]: audit 2024-09-21T00:56:55.186445+0000 mon.a (mon.0) 6098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:55 smithi049 bash[23528]: audit 2024-09-21T00:56:55.195372+0000 mon.a (mon.0) 6099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:55 smithi049 bash[23528]: audit 2024-09-21T00:56:55.205873+0000 mon.a (mon.0) 6100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:55 smithi044 bash[22676]: audit 2024-09-21T00:56:54.535271+0000 mon.a (mon.0) 6095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:55 smithi044 bash[22676]: audit 2024-09-21T00:56:54.542309+0000 mon.a (mon.0) 6096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:55 smithi044 bash[22676]: audit 2024-09-21T00:56:54.548694+0000 mon.a (mon.0) 6097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:55 smithi044 bash[22676]: audit 2024-09-21T00:56:55.186445+0000 mon.a (mon.0) 6098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:55 smithi044 bash[22676]: audit 2024-09-21T00:56:55.195372+0000 mon.a (mon.0) 6099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:55 smithi044 bash[22676]: audit 2024-09-21T00:56:55.205873+0000 mon.a (mon.0) 6100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:55 smithi179 bash[23186]: audit 2024-09-21T00:56:54.535271+0000 mon.a (mon.0) 6095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:55 smithi179 bash[23186]: audit 2024-09-21T00:56:54.542309+0000 mon.a (mon.0) 6096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:55 smithi179 bash[23186]: audit 2024-09-21T00:56:54.548694+0000 mon.a (mon.0) 6097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:55 smithi179 bash[23186]: audit 2024-09-21T00:56:55.186445+0000 mon.a (mon.0) 6098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:55 smithi179 bash[23186]: audit 2024-09-21T00:56:55.195372+0000 mon.a (mon.0) 6099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:55 smithi179 bash[23186]: audit 2024-09-21T00:56:55.205873+0000 mon.a (mon.0) 6100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:56:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:56 smithi049 bash[23528]: cluster 2024-09-21T00:56:55.247726+0000 mgr.a (mgr.14388) 7028 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:56 smithi044 bash[22676]: cluster 2024-09-21T00:56:55.247726+0000 mgr.a (mgr.14388) 7028 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:56 smithi179 bash[23186]: cluster 2024-09-21T00:56:55.247726+0000 mgr.a (mgr.14388) 7028 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:56:58.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:56:58.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:56:58.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:56:58.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:56:58 smithi049 bash[23528]: cluster 2024-09-21T00:56:57.248560+0000 mgr.a (mgr.14388) 7029 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:56:58 smithi044 bash[22676]: cluster 2024-09-21T00:56:57.248560+0000 mgr.a (mgr.14388) 7029 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:56:58 smithi179 bash[23186]: cluster 2024-09-21T00:56:57.248560+0000 mgr.a (mgr.14388) 7029 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:56:59.485 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:56:59.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:56:59.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:56:59.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:56:59.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:00 smithi049 bash[23528]: audit 2024-09-21T00:56:59.038292+0000 mgr.a (mgr.14388) 7030 : audit [DBG] from='client.159765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:00 smithi049 bash[23528]: cluster 2024-09-21T00:56:59.249113+0000 mgr.a (mgr.14388) 7031 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:00 smithi044 bash[22676]: audit 2024-09-21T00:56:59.038292+0000 mgr.a (mgr.14388) 7030 : audit [DBG] from='client.159765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:00 smithi044 bash[22676]: cluster 2024-09-21T00:56:59.249113+0000 mgr.a (mgr.14388) 7031 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:00 smithi179 bash[23186]: audit 2024-09-21T00:56:59.038292+0000 mgr.a (mgr.14388) 7030 : audit [DBG] from='client.159765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:00 smithi179 bash[23186]: cluster 2024-09-21T00:56:59.249113+0000 mgr.a (mgr.14388) 7031 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:02 smithi044 bash[22676]: cluster 2024-09-21T00:57:01.251565+0000 mgr.a (mgr.14388) 7032 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:02 smithi179 bash[23186]: cluster 2024-09-21T00:57:01.251565+0000 mgr.a (mgr.14388) 7032 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:03.039 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:02 smithi049 bash[23528]: cluster 2024-09-21T00:57:01.251565+0000 mgr.a (mgr.14388) 7032 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:04.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:04.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:04.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:04 smithi044 bash[22676]: cluster 2024-09-21T00:57:03.252505+0000 mgr.a (mgr.14388) 7033 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:04 smithi179 bash[23186]: cluster 2024-09-21T00:57:03.252505+0000 mgr.a (mgr.14388) 7033 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:05.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:04 smithi049 bash[23528]: cluster 2024-09-21T00:57:03.252505+0000 mgr.a (mgr.14388) 7033 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:05.278 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:05.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:05.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:05.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:05.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:05 smithi044 bash[22676]: audit 2024-09-21T00:57:04.822284+0000 mgr.a (mgr.14388) 7034 : audit [DBG] from='client.159843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:05 smithi179 bash[23186]: audit 2024-09-21T00:57:04.822284+0000 mgr.a (mgr.14388) 7034 : audit [DBG] from='client.159843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:06.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:05 smithi049 bash[23528]: audit 2024-09-21T00:57:04.822284+0000 mgr.a (mgr.14388) 7034 : audit [DBG] from='client.159843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:06 smithi044 bash[22676]: cluster 2024-09-21T00:57:05.254163+0000 mgr.a (mgr.14388) 7035 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:06 smithi179 bash[23186]: cluster 2024-09-21T00:57:05.254163+0000 mgr.a (mgr.14388) 7035 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:06 smithi049 bash[23528]: cluster 2024-09-21T00:57:05.254163+0000 mgr.a (mgr.14388) 7035 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:08 smithi044 bash[22676]: cluster 2024-09-21T00:57:07.254928+0000 mgr.a (mgr.14388) 7036 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:57:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:08 smithi179 bash[23186]: cluster 2024-09-21T00:57:07.254928+0000 mgr.a (mgr.14388) 7036 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:57:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:08 smithi049 bash[23528]: cluster 2024-09-21T00:57:07.254928+0000 mgr.a (mgr.14388) 7036 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:57:10.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:10.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:10.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:10 smithi044 bash[22676]: cluster 2024-09-21T00:57:09.255680+0000 mgr.a (mgr.14388) 7037 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:10 smithi179 bash[23186]: cluster 2024-09-21T00:57:09.255680+0000 mgr.a (mgr.14388) 7037 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:10 smithi049 bash[23528]: cluster 2024-09-21T00:57:09.255680+0000 mgr.a (mgr.14388) 7037 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:11.052 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:11.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:11.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:11.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:11.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:11 smithi044 bash[22676]: audit 2024-09-21T00:57:10.615246+0000 mgr.a (mgr.14388) 7038 : audit [DBG] from='client.159921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:11 smithi179 bash[23186]: audit 2024-09-21T00:57:10.615246+0000 mgr.a (mgr.14388) 7038 : audit [DBG] from='client.159921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:12.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:11 smithi049 bash[23528]: audit 2024-09-21T00:57:10.615246+0000 mgr.a (mgr.14388) 7038 : audit [DBG] from='client.159921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:12.876 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:12 smithi179 bash[23186]: cluster 2024-09-21T00:57:11.258490+0000 mgr.a (mgr.14388) 7039 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:12.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:12 smithi044 bash[22676]: cluster 2024-09-21T00:57:11.258490+0000 mgr.a (mgr.14388) 7039 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:12 smithi049 bash[23528]: cluster 2024-09-21T00:57:11.258490+0000 mgr.a (mgr.14388) 7039 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:14.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:14 smithi044 bash[22676]: cluster 2024-09-21T00:57:13.259297+0000 mgr.a (mgr.14388) 7040 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:57:14.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:14 smithi044 bash[22676]: audit 2024-09-21T00:57:13.426797+0000 mon.a (mon.0) 6101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:14 smithi044 bash[22676]: audit 2024-09-21T00:57:13.432663+0000 mon.a (mon.0) 6102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:14 smithi044 bash[22676]: audit 2024-09-21T00:57:13.439461+0000 mon.a (mon.0) 6103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:14 smithi179 bash[23186]: cluster 2024-09-21T00:57:13.259297+0000 mgr.a (mgr.14388) 7040 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:57:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:14 smithi179 bash[23186]: audit 2024-09-21T00:57:13.426797+0000 mon.a (mon.0) 6101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:14 smithi179 bash[23186]: audit 2024-09-21T00:57:13.432663+0000 mon.a (mon.0) 6102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:14 smithi179 bash[23186]: audit 2024-09-21T00:57:13.439461+0000 mon.a (mon.0) 6103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:14 smithi049 bash[23528]: cluster 2024-09-21T00:57:13.259297+0000 mgr.a (mgr.14388) 7040 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:57:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:14 smithi049 bash[23528]: audit 2024-09-21T00:57:13.426797+0000 mon.a (mon.0) 6101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:14 smithi049 bash[23528]: audit 2024-09-21T00:57:13.432663+0000 mon.a (mon.0) 6102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:14 smithi049 bash[23528]: audit 2024-09-21T00:57:13.439461+0000 mon.a (mon.0) 6103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:15 smithi044 bash[22676]: audit 2024-09-21T00:57:14.692489+0000 mon.a (mon.0) 6104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:15 smithi044 bash[22676]: audit 2024-09-21T00:57:14.697171+0000 mon.a (mon.0) 6105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:15 smithi044 bash[22676]: audit 2024-09-21T00:57:14.702130+0000 mon.a (mon.0) 6106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:15 smithi044 bash[22676]: audit 2024-09-21T00:57:15.420831+0000 mon.a (mon.0) 6107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:15 smithi044 bash[22676]: audit 2024-09-21T00:57:15.429727+0000 mon.a (mon.0) 6108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:15 smithi044 bash[22676]: audit 2024-09-21T00:57:15.439751+0000 mon.a (mon.0) 6109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:15 smithi179 bash[23186]: audit 2024-09-21T00:57:14.692489+0000 mon.a (mon.0) 6104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:15 smithi179 bash[23186]: audit 2024-09-21T00:57:14.697171+0000 mon.a (mon.0) 6105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:15 smithi179 bash[23186]: audit 2024-09-21T00:57:14.702130+0000 mon.a (mon.0) 6106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:15 smithi179 bash[23186]: audit 2024-09-21T00:57:15.420831+0000 mon.a (mon.0) 6107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:15 smithi179 bash[23186]: audit 2024-09-21T00:57:15.429727+0000 mon.a (mon.0) 6108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:15 smithi179 bash[23186]: audit 2024-09-21T00:57:15.439751+0000 mon.a (mon.0) 6109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:15 smithi049 bash[23528]: audit 2024-09-21T00:57:14.692489+0000 mon.a (mon.0) 6104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:15 smithi049 bash[23528]: audit 2024-09-21T00:57:14.697171+0000 mon.a (mon.0) 6105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:15 smithi049 bash[23528]: audit 2024-09-21T00:57:14.702130+0000 mon.a (mon.0) 6106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:15 smithi049 bash[23528]: audit 2024-09-21T00:57:15.420831+0000 mon.a (mon.0) 6107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:15 smithi049 bash[23528]: audit 2024-09-21T00:57:15.429727+0000 mon.a (mon.0) 6108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:15 smithi049 bash[23528]: audit 2024-09-21T00:57:15.439751+0000 mon.a (mon.0) 6109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:16.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:16.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:16.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:16.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:16.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:16 smithi044 bash[22676]: cluster 2024-09-21T00:57:15.261513+0000 mgr.a (mgr.14388) 7041 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:16 smithi179 bash[23186]: cluster 2024-09-21T00:57:15.261513+0000 mgr.a (mgr.14388) 7041 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:16 smithi049 bash[23528]: cluster 2024-09-21T00:57:15.261513+0000 mgr.a (mgr.14388) 7041 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:17 smithi044 bash[22676]: audit 2024-09-21T00:57:16.384658+0000 mgr.a (mgr.14388) 7042 : audit [DBG] from='client.159999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:17 smithi179 bash[23186]: audit 2024-09-21T00:57:16.384658+0000 mgr.a (mgr.14388) 7042 : audit [DBG] from='client.159999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:18.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:17 smithi049 bash[23528]: audit 2024-09-21T00:57:16.384658+0000 mgr.a (mgr.14388) 7042 : audit [DBG] from='client.159999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:18 smithi044 bash[22676]: cluster 2024-09-21T00:57:17.262215+0000 mgr.a (mgr.14388) 7043 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:18 smithi179 bash[23186]: cluster 2024-09-21T00:57:17.262215+0000 mgr.a (mgr.14388) 7043 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:19.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:18 smithi049 bash[23528]: cluster 2024-09-21T00:57:17.262215+0000 mgr.a (mgr.14388) 7043 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:20.978 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:20 smithi049 bash[23528]: cluster 2024-09-21T00:57:19.263143+0000 mgr.a (mgr.14388) 7044 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:20 smithi044 bash[22676]: cluster 2024-09-21T00:57:19.263143+0000 mgr.a (mgr.14388) 7044 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:20 smithi179 bash[23186]: cluster 2024-09-21T00:57:19.263143+0000 mgr.a (mgr.14388) 7044 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:21.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:21.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:21.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:22.591 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:22 smithi044 bash[22676]: cluster 2024-09-21T00:57:21.265534+0000 mgr.a (mgr.14388) 7045 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:22 smithi179 bash[23186]: cluster 2024-09-21T00:57:21.265534+0000 mgr.a (mgr.14388) 7045 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:22 smithi049 bash[23528]: cluster 2024-09-21T00:57:21.265534+0000 mgr.a (mgr.14388) 7045 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:23 smithi044 bash[22676]: audit 2024-09-21T00:57:22.157851+0000 mgr.a (mgr.14388) 7046 : audit [DBG] from='client.160077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:23 smithi179 bash[23186]: audit 2024-09-21T00:57:22.157851+0000 mgr.a (mgr.14388) 7046 : audit [DBG] from='client.160077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:24.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:23 smithi049 bash[23528]: audit 2024-09-21T00:57:22.157851+0000 mgr.a (mgr.14388) 7046 : audit [DBG] from='client.160077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:24 smithi044 bash[22676]: cluster 2024-09-21T00:57:23.266533+0000 mgr.a (mgr.14388) 7047 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:24 smithi179 bash[23186]: cluster 2024-09-21T00:57:23.266533+0000 mgr.a (mgr.14388) 7047 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:25.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:24 smithi049 bash[23528]: cluster 2024-09-21T00:57:23.266533+0000 mgr.a (mgr.14388) 7047 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:26 smithi179 bash[23186]: cluster 2024-09-21T00:57:25.268674+0000 mgr.a (mgr.14388) 7048 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:27.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:26 smithi049 bash[23528]: cluster 2024-09-21T00:57:25.268674+0000 mgr.a (mgr.14388) 7048 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:26 smithi044 bash[22676]: cluster 2024-09-21T00:57:25.268674+0000 mgr.a (mgr.14388) 7048 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:57:27.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:27.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:27.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:28.389 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:28.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:28 smithi179 bash[23186]: cluster 2024-09-21T00:57:27.269468+0000 mgr.a (mgr.14388) 7049 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:28 smithi179 bash[23186]: audit 2024-09-21T00:57:27.931538+0000 mgr.a (mgr.14388) 7050 : audit [DBG] from='client.160155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:28 smithi049 bash[23528]: cluster 2024-09-21T00:57:27.269468+0000 mgr.a (mgr.14388) 7049 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:28 smithi049 bash[23528]: audit 2024-09-21T00:57:27.931538+0000 mgr.a (mgr.14388) 7050 : audit [DBG] from='client.160155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:28 smithi044 bash[22676]: cluster 2024-09-21T00:57:27.269468+0000 mgr.a (mgr.14388) 7049 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:28 smithi044 bash[22676]: audit 2024-09-21T00:57:27.931538+0000 mgr.a (mgr.14388) 7050 : audit [DBG] from='client.160155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:30.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22930]: debug 2024-09-21T00:57:30.608+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:57:30.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22930]: debug 2024-09-21T00:57:30.612+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:57:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22676]: cluster 2024-09-21T00:57:29.270550+0000 mgr.a (mgr.14388) 7051 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22676]: audit 2024-09-21T00:57:29.803462+0000 mon.a (mon.0) 6110 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22676]: audit 2024-09-21T00:57:29.810164+0000 mon.a (mon.0) 6111 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22676]: audit 2024-09-21T00:57:29.811966+0000 mon.a (mon.0) 6112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:57:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22676]: audit 2024-09-21T00:57:29.822756+0000 mon.a (mon.0) 6113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22676]: audit 2024-09-21T00:57:29.829096+0000 mon.a (mon.0) 6114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:57:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:30 smithi044 bash[22676]: audit 2024-09-21T00:57:29.831818+0000 mgr.a (mgr.14388) 7052 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:57:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:30 smithi179 bash[23186]: cluster 2024-09-21T00:57:29.270550+0000 mgr.a (mgr.14388) 7051 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:30 smithi179 bash[23186]: audit 2024-09-21T00:57:29.803462+0000 mon.a (mon.0) 6110 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:30 smithi179 bash[23186]: audit 2024-09-21T00:57:29.810164+0000 mon.a (mon.0) 6111 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:30 smithi179 bash[23186]: audit 2024-09-21T00:57:29.811966+0000 mon.a (mon.0) 6112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:57:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:30 smithi179 bash[23186]: audit 2024-09-21T00:57:29.822756+0000 mon.a (mon.0) 6113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:30 smithi179 bash[23186]: audit 2024-09-21T00:57:29.829096+0000 mon.a (mon.0) 6114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:57:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:30 smithi179 bash[23186]: audit 2024-09-21T00:57:29.831818+0000 mgr.a (mgr.14388) 7052 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:57:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:30 smithi049 bash[23528]: cluster 2024-09-21T00:57:29.270550+0000 mgr.a (mgr.14388) 7051 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:30 smithi049 bash[23528]: audit 2024-09-21T00:57:29.803462+0000 mon.a (mon.0) 6110 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:30 smithi049 bash[23528]: audit 2024-09-21T00:57:29.810164+0000 mon.a (mon.0) 6111 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:30 smithi049 bash[23528]: audit 2024-09-21T00:57:29.811966+0000 mon.a (mon.0) 6112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:57:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:30 smithi049 bash[23528]: audit 2024-09-21T00:57:29.822756+0000 mon.a (mon.0) 6113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:30 smithi049 bash[23528]: audit 2024-09-21T00:57:29.829096+0000 mon.a (mon.0) 6114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:57:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:30 smithi049 bash[23528]: audit 2024-09-21T00:57:29.831818+0000 mgr.a (mgr.14388) 7052 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:57:32.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:31 smithi049 bash[23528]: audit 2024-09-21T00:57:30.613116+0000 mgr.a (mgr.14388) 7053 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:57:32.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:31 smithi049 bash[23528]: cephadm 2024-09-21T00:57:30.614488+0000 mgr.a (mgr.14388) 7054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:57:32.090 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:31 smithi179 bash[23186]: audit 2024-09-21T00:57:30.613116+0000 mgr.a (mgr.14388) 7053 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:57:32.090 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:31 smithi179 bash[23186]: cephadm 2024-09-21T00:57:30.614488+0000 mgr.a (mgr.14388) 7054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:57:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:31 smithi044 bash[22676]: audit 2024-09-21T00:57:30.613116+0000 mgr.a (mgr.14388) 7053 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:57:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:31 smithi044 bash[22676]: cephadm 2024-09-21T00:57:30.614488+0000 mgr.a (mgr.14388) 7054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:57:33.012 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:32 smithi179 bash[23186]: cluster 2024-09-21T00:57:31.273454+0000 mgr.a (mgr.14388) 7055 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:57:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:32 smithi049 bash[23528]: cluster 2024-09-21T00:57:31.273454+0000 mgr.a (mgr.14388) 7055 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:57:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:32 smithi044 bash[22676]: cluster 2024-09-21T00:57:31.273454+0000 mgr.a (mgr.14388) 7055 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T00:57:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:33.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:34.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:34.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:34.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:34.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:34.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:34.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:34 smithi044 bash[22676]: cluster 2024-09-21T00:57:33.274235+0000 mgr.a (mgr.14388) 7056 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:57:34.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:34 smithi044 bash[22676]: audit 2024-09-21T00:57:33.617000+0000 mon.a (mon.0) 6115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:34.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:34 smithi044 bash[22676]: audit 2024-09-21T00:57:33.624345+0000 mon.a (mon.0) 6116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:34.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:34 smithi044 bash[22676]: audit 2024-09-21T00:57:33.633416+0000 mon.a (mon.0) 6117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:34.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:34 smithi044 bash[22676]: audit 2024-09-21T00:57:33.752042+0000 mgr.a (mgr.14388) 7057 : audit [DBG] from='client.160335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:34 smithi179 bash[23186]: cluster 2024-09-21T00:57:33.274235+0000 mgr.a (mgr.14388) 7056 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:57:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:34 smithi179 bash[23186]: audit 2024-09-21T00:57:33.617000+0000 mon.a (mon.0) 6115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:34 smithi179 bash[23186]: audit 2024-09-21T00:57:33.624345+0000 mon.a (mon.0) 6116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:34 smithi179 bash[23186]: audit 2024-09-21T00:57:33.633416+0000 mon.a (mon.0) 6117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:34 smithi179 bash[23186]: audit 2024-09-21T00:57:33.752042+0000 mgr.a (mgr.14388) 7057 : audit [DBG] from='client.160335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:34 smithi049 bash[23528]: cluster 2024-09-21T00:57:33.274235+0000 mgr.a (mgr.14388) 7056 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T00:57:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:34 smithi049 bash[23528]: audit 2024-09-21T00:57:33.617000+0000 mon.a (mon.0) 6115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:34 smithi049 bash[23528]: audit 2024-09-21T00:57:33.624345+0000 mon.a (mon.0) 6116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:34 smithi049 bash[23528]: audit 2024-09-21T00:57:33.633416+0000 mon.a (mon.0) 6117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:34 smithi049 bash[23528]: audit 2024-09-21T00:57:33.752042+0000 mgr.a (mgr.14388) 7057 : audit [DBG] from='client.160335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:35 smithi044 bash[22676]: audit 2024-09-21T00:57:34.896007+0000 mon.a (mon.0) 6118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:35 smithi044 bash[22676]: audit 2024-09-21T00:57:34.902781+0000 mon.a (mon.0) 6119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:35 smithi044 bash[22676]: audit 2024-09-21T00:57:34.911390+0000 mon.a (mon.0) 6120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:35 smithi044 bash[22676]: audit 2024-09-21T00:57:35.639128+0000 mon.a (mon.0) 6121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:35 smithi044 bash[22676]: audit 2024-09-21T00:57:35.647730+0000 mon.a (mon.0) 6122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:35 smithi044 bash[22676]: audit 2024-09-21T00:57:35.657814+0000 mon.a (mon.0) 6123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:35 smithi049 bash[23528]: audit 2024-09-21T00:57:34.896007+0000 mon.a (mon.0) 6118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:35 smithi049 bash[23528]: audit 2024-09-21T00:57:34.902781+0000 mon.a (mon.0) 6119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:35 smithi049 bash[23528]: audit 2024-09-21T00:57:34.911390+0000 mon.a (mon.0) 6120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:35 smithi049 bash[23528]: audit 2024-09-21T00:57:35.639128+0000 mon.a (mon.0) 6121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:35 smithi049 bash[23528]: audit 2024-09-21T00:57:35.647730+0000 mon.a (mon.0) 6122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:35 smithi049 bash[23528]: audit 2024-09-21T00:57:35.657814+0000 mon.a (mon.0) 6123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:35 smithi179 bash[23186]: audit 2024-09-21T00:57:34.896007+0000 mon.a (mon.0) 6118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:35 smithi179 bash[23186]: audit 2024-09-21T00:57:34.902781+0000 mon.a (mon.0) 6119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:35 smithi179 bash[23186]: audit 2024-09-21T00:57:34.911390+0000 mon.a (mon.0) 6120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:35 smithi179 bash[23186]: audit 2024-09-21T00:57:35.639128+0000 mon.a (mon.0) 6121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:35 smithi179 bash[23186]: audit 2024-09-21T00:57:35.647730+0000 mon.a (mon.0) 6122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:35 smithi179 bash[23186]: audit 2024-09-21T00:57:35.657814+0000 mon.a (mon.0) 6123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:36 smithi044 bash[22676]: cluster 2024-09-21T00:57:35.275550+0000 mgr.a (mgr.14388) 7058 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:36 smithi179 bash[23186]: cluster 2024-09-21T00:57:35.275550+0000 mgr.a (mgr.14388) 7058 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:36 smithi049 bash[23528]: cluster 2024-09-21T00:57:35.275550+0000 mgr.a (mgr.14388) 7058 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:39.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:39.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:39.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:38 smithi044 bash[22676]: cluster 2024-09-21T00:57:37.276403+0000 mgr.a (mgr.14388) 7059 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:38 smithi179 bash[23186]: cluster 2024-09-21T00:57:37.276403+0000 mgr.a (mgr.14388) 7059 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:38 smithi049 bash[23528]: cluster 2024-09-21T00:57:37.276403+0000 mgr.a (mgr.14388) 7059 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:39.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:39.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:39.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:39.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:39.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:41.194 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:40 smithi049 bash[23528]: cluster 2024-09-21T00:57:39.277338+0000 mgr.a (mgr.14388) 7060 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:41.195 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:40 smithi049 bash[23528]: audit 2024-09-21T00:57:39.519000+0000 mgr.a (mgr.14388) 7061 : audit [DBG] from='client.160413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:40 smithi044 bash[22676]: cluster 2024-09-21T00:57:39.277338+0000 mgr.a (mgr.14388) 7060 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:40 smithi044 bash[22676]: audit 2024-09-21T00:57:39.519000+0000 mgr.a (mgr.14388) 7061 : audit [DBG] from='client.160413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:40 smithi179 bash[23186]: cluster 2024-09-21T00:57:39.277338+0000 mgr.a (mgr.14388) 7060 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:40 smithi179 bash[23186]: audit 2024-09-21T00:57:39.519000+0000 mgr.a (mgr.14388) 7061 : audit [DBG] from='client.160413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:42 smithi044 bash[22676]: cluster 2024-09-21T00:57:41.279721+0000 mgr.a (mgr.14388) 7062 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:42 smithi179 bash[23186]: cluster 2024-09-21T00:57:41.279721+0000 mgr.a (mgr.14388) 7062 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:42 smithi049 bash[23528]: cluster 2024-09-21T00:57:41.279721+0000 mgr.a (mgr.14388) 7062 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:57:44.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:44.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:44.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:44 smithi044 bash[22676]: cluster 2024-09-21T00:57:43.280506+0000 mgr.a (mgr.14388) 7063 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:57:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:44 smithi179 bash[23186]: cluster 2024-09-21T00:57:43.280506+0000 mgr.a (mgr.14388) 7063 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:57:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:44 smithi049 bash[23528]: cluster 2024-09-21T00:57:43.280506+0000 mgr.a (mgr.14388) 7063 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:57:45.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:45.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:45.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:45.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:45.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:46 smithi044 bash[22676]: cluster 2024-09-21T00:57:45.282460+0000 mgr.a (mgr.14388) 7064 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:57:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:46 smithi044 bash[22676]: audit 2024-09-21T00:57:45.294974+0000 mgr.a (mgr.14388) 7065 : audit [DBG] from='client.160491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:46 smithi179 bash[23186]: cluster 2024-09-21T00:57:45.282460+0000 mgr.a (mgr.14388) 7064 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:57:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:46 smithi179 bash[23186]: audit 2024-09-21T00:57:45.294974+0000 mgr.a (mgr.14388) 7065 : audit [DBG] from='client.160491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:46 smithi049 bash[23528]: cluster 2024-09-21T00:57:45.282460+0000 mgr.a (mgr.14388) 7064 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:57:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:46 smithi049 bash[23528]: audit 2024-09-21T00:57:45.294974+0000 mgr.a (mgr.14388) 7065 : audit [DBG] from='client.160491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:48 smithi044 bash[22676]: cluster 2024-09-21T00:57:47.283393+0000 mgr.a (mgr.14388) 7066 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:48 smithi179 bash[23186]: cluster 2024-09-21T00:57:47.283393+0000 mgr.a (mgr.14388) 7066 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:48 smithi049 bash[23528]: cluster 2024-09-21T00:57:47.283393+0000 mgr.a (mgr.14388) 7066 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:50 smithi044 bash[22676]: cluster 2024-09-21T00:57:49.284217+0000 mgr.a (mgr.14388) 7067 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:50 smithi179 bash[23186]: cluster 2024-09-21T00:57:49.284217+0000 mgr.a (mgr.14388) 7067 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:50 smithi049 bash[23528]: cluster 2024-09-21T00:57:49.284217+0000 mgr.a (mgr.14388) 7067 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:51.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:53.203 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:52 smithi179 bash[23186]: audit 2024-09-21T00:57:51.080477+0000 mgr.a (mgr.14388) 7068 : audit [DBG] from='client.160569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:53.203 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:52 smithi179 bash[23186]: cluster 2024-09-21T00:57:51.285622+0000 mgr.a (mgr.14388) 7069 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:52 smithi044 bash[22676]: audit 2024-09-21T00:57:51.080477+0000 mgr.a (mgr.14388) 7068 : audit [DBG] from='client.160569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:52 smithi044 bash[22676]: cluster 2024-09-21T00:57:51.285622+0000 mgr.a (mgr.14388) 7069 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:52 smithi049 bash[23528]: audit 2024-09-21T00:57:51.080477+0000 mgr.a (mgr.14388) 7068 : audit [DBG] from='client.160569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:52 smithi049 bash[23528]: cluster 2024-09-21T00:57:51.285622+0000 mgr.a (mgr.14388) 7069 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:54 smithi044 bash[22676]: cluster 2024-09-21T00:57:53.286494+0000 mgr.a (mgr.14388) 7070 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:54 smithi044 bash[22676]: audit 2024-09-21T00:57:53.821033+0000 mon.a (mon.0) 6124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:54 smithi044 bash[22676]: audit 2024-09-21T00:57:53.829723+0000 mon.a (mon.0) 6125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:54 smithi044 bash[22676]: audit 2024-09-21T00:57:53.840622+0000 mon.a (mon.0) 6126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:54 smithi179 bash[23186]: cluster 2024-09-21T00:57:53.286494+0000 mgr.a (mgr.14388) 7070 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:54 smithi179 bash[23186]: audit 2024-09-21T00:57:53.821033+0000 mon.a (mon.0) 6124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:54 smithi179 bash[23186]: audit 2024-09-21T00:57:53.829723+0000 mon.a (mon.0) 6125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:54 smithi179 bash[23186]: audit 2024-09-21T00:57:53.840622+0000 mon.a (mon.0) 6126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:54 smithi049 bash[23528]: cluster 2024-09-21T00:57:53.286494+0000 mgr.a (mgr.14388) 7070 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:57:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:54 smithi049 bash[23528]: audit 2024-09-21T00:57:53.821033+0000 mon.a (mon.0) 6124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:54 smithi049 bash[23528]: audit 2024-09-21T00:57:53.829723+0000 mon.a (mon.0) 6125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:54 smithi049 bash[23528]: audit 2024-09-21T00:57:53.840622+0000 mon.a (mon.0) 6126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:56 smithi049 bash[23528]: audit 2024-09-21T00:57:55.090004+0000 mon.a (mon.0) 6127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:56 smithi049 bash[23528]: audit 2024-09-21T00:57:55.095152+0000 mon.a (mon.0) 6128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:56 smithi049 bash[23528]: audit 2024-09-21T00:57:55.113784+0000 mon.a (mon.0) 6129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:56 smithi049 bash[23528]: cluster 2024-09-21T00:57:55.288781+0000 mgr.a (mgr.14388) 7071 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:56 smithi049 bash[23528]: audit 2024-09-21T00:57:55.833627+0000 mon.a (mon.0) 6130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:56 smithi049 bash[23528]: audit 2024-09-21T00:57:55.840976+0000 mon.a (mon.0) 6131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:56 smithi049 bash[23528]: audit 2024-09-21T00:57:55.848034+0000 mon.a (mon.0) 6132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:56 smithi044 bash[22676]: audit 2024-09-21T00:57:55.090004+0000 mon.a (mon.0) 6127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:56 smithi044 bash[22676]: audit 2024-09-21T00:57:55.095152+0000 mon.a (mon.0) 6128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:56 smithi044 bash[22676]: audit 2024-09-21T00:57:55.113784+0000 mon.a (mon.0) 6129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:56 smithi044 bash[22676]: cluster 2024-09-21T00:57:55.288781+0000 mgr.a (mgr.14388) 7071 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:56.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:56 smithi044 bash[22676]: audit 2024-09-21T00:57:55.833627+0000 mon.a (mon.0) 6130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:56 smithi044 bash[22676]: audit 2024-09-21T00:57:55.840976+0000 mon.a (mon.0) 6131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:56 smithi044 bash[22676]: audit 2024-09-21T00:57:55.848034+0000 mon.a (mon.0) 6132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:56 smithi179 bash[23186]: audit 2024-09-21T00:57:55.090004+0000 mon.a (mon.0) 6127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:56 smithi179 bash[23186]: audit 2024-09-21T00:57:55.095152+0000 mon.a (mon.0) 6128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:56 smithi179 bash[23186]: audit 2024-09-21T00:57:55.113784+0000 mon.a (mon.0) 6129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:56 smithi179 bash[23186]: cluster 2024-09-21T00:57:55.288781+0000 mgr.a (mgr.14388) 7071 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:56 smithi179 bash[23186]: audit 2024-09-21T00:57:55.833627+0000 mon.a (mon.0) 6130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:56 smithi179 bash[23186]: audit 2024-09-21T00:57:55.840976+0000 mon.a (mon.0) 6131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:56 smithi179 bash[23186]: audit 2024-09-21T00:57:55.848034+0000 mon.a (mon.0) 6132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:57:56.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:57:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:57:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:57:57.271 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:57:57.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:57:57.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:57:57.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:57:57.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:57:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:57 smithi044 bash[22676]: audit 2024-09-21T00:57:56.853225+0000 mgr.a (mgr.14388) 7072 : audit [DBG] from='client.160644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:57 smithi179 bash[23186]: audit 2024-09-21T00:57:56.853225+0000 mgr.a (mgr.14388) 7072 : audit [DBG] from='client.160644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:57.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:57 smithi049 bash[23528]: audit 2024-09-21T00:57:56.853225+0000 mgr.a (mgr.14388) 7072 : audit [DBG] from='client.160644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:57:58 smithi044 bash[22676]: cluster 2024-09-21T00:57:57.289533+0000 mgr.a (mgr.14388) 7073 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:57:58 smithi179 bash[23186]: cluster 2024-09-21T00:57:57.289533+0000 mgr.a (mgr.14388) 7073 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:57:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:57:58 smithi049 bash[23528]: cluster 2024-09-21T00:57:57.289533+0000 mgr.a (mgr.14388) 7073 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:00 smithi044 bash[22676]: cluster 2024-09-21T00:57:59.290301+0000 mgr.a (mgr.14388) 7074 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:00 smithi179 bash[23186]: cluster 2024-09-21T00:57:59.290301+0000 mgr.a (mgr.14388) 7074 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:00.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:00 smithi049 bash[23528]: cluster 2024-09-21T00:57:59.290301+0000 mgr.a (mgr.14388) 7074 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:02.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:02.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:02.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:02.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:02 smithi049 bash[23528]: cluster 2024-09-21T00:58:01.292617+0000 mgr.a (mgr.14388) 7075 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:02 smithi044 bash[22676]: cluster 2024-09-21T00:58:01.292617+0000 mgr.a (mgr.14388) 7075 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:02 smithi179 bash[23186]: cluster 2024-09-21T00:58:01.292617+0000 mgr.a (mgr.14388) 7075 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:03.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:03.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:03.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:03 smithi049 bash[23528]: audit 2024-09-21T00:58:02.610806+0000 mgr.a (mgr.14388) 7076 : audit [DBG] from='client.160722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:03 smithi044 bash[22676]: audit 2024-09-21T00:58:02.610806+0000 mgr.a (mgr.14388) 7076 : audit [DBG] from='client.160722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:03 smithi179 bash[23186]: audit 2024-09-21T00:58:02.610806+0000 mgr.a (mgr.14388) 7076 : audit [DBG] from='client.160722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:04 smithi044 bash[22676]: cluster 2024-09-21T00:58:03.293770+0000 mgr.a (mgr.14388) 7077 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:04 smithi179 bash[23186]: cluster 2024-09-21T00:58:03.293770+0000 mgr.a (mgr.14388) 7077 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:04.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:04 smithi049 bash[23528]: cluster 2024-09-21T00:58:03.293770+0000 mgr.a (mgr.14388) 7077 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:06 smithi044 bash[22676]: cluster 2024-09-21T00:58:05.295958+0000 mgr.a (mgr.14388) 7078 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:06 smithi179 bash[23186]: cluster 2024-09-21T00:58:05.295958+0000 mgr.a (mgr.14388) 7078 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:06.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:06 smithi049 bash[23528]: cluster 2024-09-21T00:58:05.295958+0000 mgr.a (mgr.14388) 7078 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:08.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:08.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:08.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:08 smithi044 bash[22676]: cluster 2024-09-21T00:58:07.296816+0000 mgr.a (mgr.14388) 7079 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:08 smithi179 bash[23186]: cluster 2024-09-21T00:58:07.296816+0000 mgr.a (mgr.14388) 7079 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:08.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:08 smithi049 bash[23528]: cluster 2024-09-21T00:58:07.296816+0000 mgr.a (mgr.14388) 7079 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:09 smithi044 bash[22676]: audit 2024-09-21T00:58:08.355276+0000 mgr.a (mgr.14388) 7080 : audit [DBG] from='client.160800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:09 smithi179 bash[23186]: audit 2024-09-21T00:58:08.355276+0000 mgr.a (mgr.14388) 7080 : audit [DBG] from='client.160800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:09.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:09 smithi049 bash[23528]: audit 2024-09-21T00:58:08.355276+0000 mgr.a (mgr.14388) 7080 : audit [DBG] from='client.160800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:10 smithi044 bash[22676]: cluster 2024-09-21T00:58:09.297836+0000 mgr.a (mgr.14388) 7081 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:10 smithi179 bash[23186]: cluster 2024-09-21T00:58:09.297836+0000 mgr.a (mgr.14388) 7081 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:10 smithi049 bash[23528]: cluster 2024-09-21T00:58:09.297836+0000 mgr.a (mgr.14388) 7081 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:12 smithi044 bash[22676]: cluster 2024-09-21T00:58:11.300048+0000 mgr.a (mgr.14388) 7082 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:12 smithi179 bash[23186]: cluster 2024-09-21T00:58:11.300048+0000 mgr.a (mgr.14388) 7082 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:12 smithi049 bash[23528]: cluster 2024-09-21T00:58:11.300048+0000 mgr.a (mgr.14388) 7082 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:13.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:13.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:14.553 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:14 smithi044 bash[22676]: cluster 2024-09-21T00:58:13.300581+0000 mgr.a (mgr.14388) 7083 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:14 smithi044 bash[22676]: audit 2024-09-21T00:58:13.985903+0000 mon.a (mon.0) 6133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:14 smithi044 bash[22676]: audit 2024-09-21T00:58:13.995308+0000 mon.a (mon.0) 6134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:14 smithi044 bash[22676]: audit 2024-09-21T00:58:14.005664+0000 mon.a (mon.0) 6135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:14 smithi179 bash[23186]: cluster 2024-09-21T00:58:13.300581+0000 mgr.a (mgr.14388) 7083 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:14 smithi179 bash[23186]: audit 2024-09-21T00:58:13.985903+0000 mon.a (mon.0) 6133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:14 smithi179 bash[23186]: audit 2024-09-21T00:58:13.995308+0000 mon.a (mon.0) 6134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:14 smithi179 bash[23186]: audit 2024-09-21T00:58:14.005664+0000 mon.a (mon.0) 6135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:14 smithi049 bash[23528]: cluster 2024-09-21T00:58:13.300581+0000 mgr.a (mgr.14388) 7083 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:14 smithi049 bash[23528]: audit 2024-09-21T00:58:13.985903+0000 mon.a (mon.0) 6133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:14 smithi049 bash[23528]: audit 2024-09-21T00:58:13.995308+0000 mon.a (mon.0) 6134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:14 smithi049 bash[23528]: audit 2024-09-21T00:58:14.005664+0000 mon.a (mon.0) 6135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:15 smithi044 bash[22676]: audit 2024-09-21T00:58:14.110629+0000 mgr.a (mgr.14388) 7084 : audit [DBG] from='client.160878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:15 smithi044 bash[22676]: audit 2024-09-21T00:58:15.279266+0000 mon.a (mon.0) 6136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:15 smithi044 bash[22676]: audit 2024-09-21T00:58:15.285844+0000 mon.a (mon.0) 6137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:15 smithi044 bash[22676]: audit 2024-09-21T00:58:15.293662+0000 mon.a (mon.0) 6138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:15 smithi179 bash[23186]: audit 2024-09-21T00:58:14.110629+0000 mgr.a (mgr.14388) 7084 : audit [DBG] from='client.160878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:15 smithi179 bash[23186]: audit 2024-09-21T00:58:15.279266+0000 mon.a (mon.0) 6136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:15 smithi179 bash[23186]: audit 2024-09-21T00:58:15.285844+0000 mon.a (mon.0) 6137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:15 smithi179 bash[23186]: audit 2024-09-21T00:58:15.293662+0000 mon.a (mon.0) 6138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:15 smithi049 bash[23528]: audit 2024-09-21T00:58:14.110629+0000 mgr.a (mgr.14388) 7084 : audit [DBG] from='client.160878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:16.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:15 smithi049 bash[23528]: audit 2024-09-21T00:58:15.279266+0000 mon.a (mon.0) 6136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:15 smithi049 bash[23528]: audit 2024-09-21T00:58:15.285844+0000 mon.a (mon.0) 6137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:16.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:15 smithi049 bash[23528]: audit 2024-09-21T00:58:15.293662+0000 mon.a (mon.0) 6138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:17 smithi049 bash[23528]: cluster 2024-09-21T00:58:15.301875+0000 mgr.a (mgr.14388) 7085 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:17 smithi049 bash[23528]: audit 2024-09-21T00:58:16.043051+0000 mon.a (mon.0) 6139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:17 smithi049 bash[23528]: audit 2024-09-21T00:58:16.048570+0000 mon.a (mon.0) 6140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:17 smithi049 bash[23528]: audit 2024-09-21T00:58:16.056048+0000 mon.a (mon.0) 6141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:17 smithi044 bash[22676]: cluster 2024-09-21T00:58:15.301875+0000 mgr.a (mgr.14388) 7085 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:17 smithi044 bash[22676]: audit 2024-09-21T00:58:16.043051+0000 mon.a (mon.0) 6139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:17 smithi044 bash[22676]: audit 2024-09-21T00:58:16.048570+0000 mon.a (mon.0) 6140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:17 smithi044 bash[22676]: audit 2024-09-21T00:58:16.056048+0000 mon.a (mon.0) 6141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:17 smithi179 bash[23186]: cluster 2024-09-21T00:58:15.301875+0000 mgr.a (mgr.14388) 7085 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:17 smithi179 bash[23186]: audit 2024-09-21T00:58:16.043051+0000 mon.a (mon.0) 6139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:17 smithi179 bash[23186]: audit 2024-09-21T00:58:16.048570+0000 mon.a (mon.0) 6140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:17 smithi179 bash[23186]: audit 2024-09-21T00:58:16.056048+0000 mon.a (mon.0) 6141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:19 smithi049 bash[23528]: cluster 2024-09-21T00:58:17.302614+0000 mgr.a (mgr.14388) 7086 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:19 smithi044 bash[22676]: cluster 2024-09-21T00:58:17.302614+0000 mgr.a (mgr.14388) 7086 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:19 smithi179 bash[23186]: cluster 2024-09-21T00:58:17.302614+0000 mgr.a (mgr.14388) 7086 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:19.555 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:19.555 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:20.316 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:20.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:20.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:20.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:20.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:21 smithi044 bash[22676]: cluster 2024-09-21T00:58:19.303398+0000 mgr.a (mgr.14388) 7087 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:21 smithi044 bash[22676]: audit 2024-09-21T00:58:19.884143+0000 mgr.a (mgr.14388) 7088 : audit [DBG] from='client.160950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:21 smithi179 bash[23186]: cluster 2024-09-21T00:58:19.303398+0000 mgr.a (mgr.14388) 7087 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:21 smithi179 bash[23186]: audit 2024-09-21T00:58:19.884143+0000 mgr.a (mgr.14388) 7088 : audit [DBG] from='client.160950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:21 smithi049 bash[23528]: cluster 2024-09-21T00:58:19.303398+0000 mgr.a (mgr.14388) 7087 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:21.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:21 smithi049 bash[23528]: audit 2024-09-21T00:58:19.884143+0000 mgr.a (mgr.14388) 7088 : audit [DBG] from='client.160950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:22.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:22 smithi049 bash[23528]: cluster 2024-09-21T00:58:21.306328+0000 mgr.a (mgr.14388) 7089 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:22 smithi044 bash[22676]: cluster 2024-09-21T00:58:21.306328+0000 mgr.a (mgr.14388) 7089 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:22 smithi179 bash[23186]: cluster 2024-09-21T00:58:21.306328+0000 mgr.a (mgr.14388) 7089 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:24.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:24 smithi049 bash[23528]: cluster 2024-09-21T00:58:23.307302+0000 mgr.a (mgr.14388) 7090 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:24 smithi044 bash[22676]: cluster 2024-09-21T00:58:23.307302+0000 mgr.a (mgr.14388) 7090 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:24 smithi179 bash[23186]: cluster 2024-09-21T00:58:23.307302+0000 mgr.a (mgr.14388) 7090 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:25.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:25.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:25.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:26.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:26.113 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:26 smithi044 bash[22676]: cluster 2024-09-21T00:58:25.309413+0000 mgr.a (mgr.14388) 7091 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:26 smithi044 bash[22676]: audit 2024-09-21T00:58:25.651886+0000 mgr.a (mgr.14388) 7092 : audit [DBG] from='client.161028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:26 smithi179 bash[23186]: cluster 2024-09-21T00:58:25.309413+0000 mgr.a (mgr.14388) 7091 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:26 smithi179 bash[23186]: audit 2024-09-21T00:58:25.651886+0000 mgr.a (mgr.14388) 7092 : audit [DBG] from='client.161028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:26 smithi049 bash[23528]: cluster 2024-09-21T00:58:25.309413+0000 mgr.a (mgr.14388) 7091 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:26 smithi049 bash[23528]: audit 2024-09-21T00:58:25.651886+0000 mgr.a (mgr.14388) 7092 : audit [DBG] from='client.161028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:28 smithi044 bash[22676]: cluster 2024-09-21T00:58:27.310416+0000 mgr.a (mgr.14388) 7093 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:28 smithi179 bash[23186]: cluster 2024-09-21T00:58:27.310416+0000 mgr.a (mgr.14388) 7093 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:28 smithi049 bash[23528]: cluster 2024-09-21T00:58:27.310416+0000 mgr.a (mgr.14388) 7093 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:30 smithi044 bash[22676]: cluster 2024-09-21T00:58:29.311223+0000 mgr.a (mgr.14388) 7094 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:30 smithi179 bash[23186]: cluster 2024-09-21T00:58:29.311223+0000 mgr.a (mgr.14388) 7094 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:30 smithi049 bash[23528]: cluster 2024-09-21T00:58:29.311223+0000 mgr.a (mgr.14388) 7094 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:58:31.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:31.114 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:31.114 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22930]: debug 2024-09-21T00:58:31.479+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22930]: debug 2024-09-21T00:58:31.487+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22676]: audit 2024-09-21T00:58:30.672595+0000 mon.a (mon.0) 6142 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22676]: audit 2024-09-21T00:58:30.683427+0000 mon.a (mon.0) 6143 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22676]: audit 2024-09-21T00:58:30.685547+0000 mon.a (mon.0) 6144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22676]: audit 2024-09-21T00:58:30.697364+0000 mon.a (mon.0) 6145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22676]: audit 2024-09-21T00:58:30.703682+0000 mon.a (mon.0) 6146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:58:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:31 smithi044 bash[22676]: audit 2024-09-21T00:58:30.706018+0000 mgr.a (mgr.14388) 7095 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:58:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:31 smithi179 bash[23186]: audit 2024-09-21T00:58:30.672595+0000 mon.a (mon.0) 6142 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:31 smithi179 bash[23186]: audit 2024-09-21T00:58:30.683427+0000 mon.a (mon.0) 6143 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:31 smithi179 bash[23186]: audit 2024-09-21T00:58:30.685547+0000 mon.a (mon.0) 6144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:58:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:31 smithi179 bash[23186]: audit 2024-09-21T00:58:30.697364+0000 mon.a (mon.0) 6145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:31 smithi179 bash[23186]: audit 2024-09-21T00:58:30.703682+0000 mon.a (mon.0) 6146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:58:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:31 smithi179 bash[23186]: audit 2024-09-21T00:58:30.706018+0000 mgr.a (mgr.14388) 7095 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:58:31.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:31 smithi049 bash[23528]: audit 2024-09-21T00:58:30.672595+0000 mon.a (mon.0) 6142 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:31 smithi049 bash[23528]: audit 2024-09-21T00:58:30.683427+0000 mon.a (mon.0) 6143 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:31 smithi049 bash[23528]: audit 2024-09-21T00:58:30.685547+0000 mon.a (mon.0) 6144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:58:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:31 smithi049 bash[23528]: audit 2024-09-21T00:58:30.697364+0000 mon.a (mon.0) 6145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:31 smithi049 bash[23528]: audit 2024-09-21T00:58:30.703682+0000 mon.a (mon.0) 6146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:58:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:31 smithi049 bash[23528]: audit 2024-09-21T00:58:30.706018+0000 mgr.a (mgr.14388) 7095 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:58:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:32 smithi044 bash[22676]: cluster 2024-09-21T00:58:31.312906+0000 mgr.a (mgr.14388) 7096 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:32 smithi044 bash[22676]: audit 2024-09-21T00:58:31.444030+0000 mgr.a (mgr.14388) 7097 : audit [DBG] from='client.161178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:32 smithi044 bash[22676]: audit 2024-09-21T00:58:31.481688+0000 mgr.a (mgr.14388) 7098 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:58:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:32 smithi044 bash[22676]: cephadm 2024-09-21T00:58:31.492845+0000 mgr.a (mgr.14388) 7099 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:58:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:32 smithi179 bash[23186]: cluster 2024-09-21T00:58:31.312906+0000 mgr.a (mgr.14388) 7096 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:32 smithi179 bash[23186]: audit 2024-09-21T00:58:31.444030+0000 mgr.a (mgr.14388) 7097 : audit [DBG] from='client.161178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:32 smithi179 bash[23186]: audit 2024-09-21T00:58:31.481688+0000 mgr.a (mgr.14388) 7098 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:58:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:32 smithi179 bash[23186]: cephadm 2024-09-21T00:58:31.492845+0000 mgr.a (mgr.14388) 7099 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:58:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:32 smithi049 bash[23528]: cluster 2024-09-21T00:58:31.312906+0000 mgr.a (mgr.14388) 7096 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:32 smithi049 bash[23528]: audit 2024-09-21T00:58:31.444030+0000 mgr.a (mgr.14388) 7097 : audit [DBG] from='client.161178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:32 smithi049 bash[23528]: audit 2024-09-21T00:58:31.481688+0000 mgr.a (mgr.14388) 7098 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:58:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:32 smithi049 bash[23528]: cephadm 2024-09-21T00:58:31.492845+0000 mgr.a (mgr.14388) 7099 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:58:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:34 smithi044 bash[22676]: cluster 2024-09-21T00:58:33.313818+0000 mgr.a (mgr.14388) 7100 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:34 smithi044 bash[22676]: audit 2024-09-21T00:58:34.137485+0000 mon.a (mon.0) 6147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:34 smithi044 bash[22676]: audit 2024-09-21T00:58:34.148095+0000 mon.a (mon.0) 6148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:34 smithi044 bash[22676]: audit 2024-09-21T00:58:34.160640+0000 mon.a (mon.0) 6149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:34 smithi179 bash[23186]: cluster 2024-09-21T00:58:33.313818+0000 mgr.a (mgr.14388) 7100 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:34 smithi179 bash[23186]: audit 2024-09-21T00:58:34.137485+0000 mon.a (mon.0) 6147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:34 smithi179 bash[23186]: audit 2024-09-21T00:58:34.148095+0000 mon.a (mon.0) 6148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:34 smithi179 bash[23186]: audit 2024-09-21T00:58:34.160640+0000 mon.a (mon.0) 6149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:34 smithi049 bash[23528]: cluster 2024-09-21T00:58:33.313818+0000 mgr.a (mgr.14388) 7100 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:34 smithi049 bash[23528]: audit 2024-09-21T00:58:34.137485+0000 mon.a (mon.0) 6147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:34 smithi049 bash[23528]: audit 2024-09-21T00:58:34.148095+0000 mon.a (mon.0) 6148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:34 smithi049 bash[23528]: audit 2024-09-21T00:58:34.160640+0000 mon.a (mon.0) 6149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:36 smithi049 bash[23528]: cluster 2024-09-21T00:58:35.315425+0000 mgr.a (mgr.14388) 7101 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:36 smithi049 bash[23528]: audit 2024-09-21T00:58:35.475193+0000 mon.a (mon.0) 6150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:36 smithi049 bash[23528]: audit 2024-09-21T00:58:35.483858+0000 mon.a (mon.0) 6151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:36 smithi049 bash[23528]: audit 2024-09-21T00:58:35.493539+0000 mon.a (mon.0) 6152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:36 smithi049 bash[23528]: audit 2024-09-21T00:58:36.252085+0000 mon.a (mon.0) 6153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:36 smithi049 bash[23528]: audit 2024-09-21T00:58:36.258603+0000 mon.a (mon.0) 6154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:36 smithi049 bash[23528]: audit 2024-09-21T00:58:36.266602+0000 mon.a (mon.0) 6155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:36 smithi044 bash[22676]: cluster 2024-09-21T00:58:35.315425+0000 mgr.a (mgr.14388) 7101 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:36 smithi044 bash[22676]: audit 2024-09-21T00:58:35.475193+0000 mon.a (mon.0) 6150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:36 smithi044 bash[22676]: audit 2024-09-21T00:58:35.483858+0000 mon.a (mon.0) 6151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:36 smithi044 bash[22676]: audit 2024-09-21T00:58:35.493539+0000 mon.a (mon.0) 6152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:36 smithi044 bash[22676]: audit 2024-09-21T00:58:36.252085+0000 mon.a (mon.0) 6153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:36 smithi044 bash[22676]: audit 2024-09-21T00:58:36.258603+0000 mon.a (mon.0) 6154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:36 smithi044 bash[22676]: audit 2024-09-21T00:58:36.266602+0000 mon.a (mon.0) 6155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:36 smithi179 bash[23186]: cluster 2024-09-21T00:58:35.315425+0000 mgr.a (mgr.14388) 7101 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:36 smithi179 bash[23186]: audit 2024-09-21T00:58:35.475193+0000 mon.a (mon.0) 6150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:36 smithi179 bash[23186]: audit 2024-09-21T00:58:35.483858+0000 mon.a (mon.0) 6151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:36 smithi179 bash[23186]: audit 2024-09-21T00:58:35.493539+0000 mon.a (mon.0) 6152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:36 smithi179 bash[23186]: audit 2024-09-21T00:58:36.252085+0000 mon.a (mon.0) 6153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:36 smithi179 bash[23186]: audit 2024-09-21T00:58:36.258603+0000 mon.a (mon.0) 6154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:36 smithi179 bash[23186]: audit 2024-09-21T00:58:36.266602+0000 mon.a (mon.0) 6155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:36.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:36.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:37.671 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:38 smithi044 bash[22676]: audit 2024-09-21T00:58:37.217115+0000 mgr.a (mgr.14388) 7102 : audit [DBG] from='client.161292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:38 smithi044 bash[22676]: cluster 2024-09-21T00:58:37.316178+0000 mgr.a (mgr.14388) 7103 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:38 smithi179 bash[23186]: audit 2024-09-21T00:58:37.217115+0000 mgr.a (mgr.14388) 7102 : audit [DBG] from='client.161292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:38 smithi179 bash[23186]: cluster 2024-09-21T00:58:37.316178+0000 mgr.a (mgr.14388) 7103 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:38 smithi049 bash[23528]: audit 2024-09-21T00:58:37.217115+0000 mgr.a (mgr.14388) 7102 : audit [DBG] from='client.161292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:38.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:38 smithi049 bash[23528]: cluster 2024-09-21T00:58:37.316178+0000 mgr.a (mgr.14388) 7103 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:40 smithi044 bash[22676]: cluster 2024-09-21T00:58:39.317165+0000 mgr.a (mgr.14388) 7104 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:40 smithi179 bash[23186]: cluster 2024-09-21T00:58:39.317165+0000 mgr.a (mgr.14388) 7104 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:40.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:40 smithi049 bash[23528]: cluster 2024-09-21T00:58:39.317165+0000 mgr.a (mgr.14388) 7104 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:42.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:42 smithi049 bash[23528]: cluster 2024-09-21T00:58:41.319586+0000 mgr.a (mgr.14388) 7105 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:42.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:42.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:42.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:42 smithi044 bash[22676]: cluster 2024-09-21T00:58:41.319586+0000 mgr.a (mgr.14388) 7105 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:42 smithi179 bash[23186]: cluster 2024-09-21T00:58:41.319586+0000 mgr.a (mgr.14388) 7105 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:43.437 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:43.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:43.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:43.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:43.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:43 smithi179 bash[23186]: audit 2024-09-21T00:58:43.006703+0000 mgr.a (mgr.14388) 7106 : audit [DBG] from='client.161370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:43.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:43 smithi049 bash[23528]: audit 2024-09-21T00:58:43.006703+0000 mgr.a (mgr.14388) 7106 : audit [DBG] from='client.161370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:43 smithi044 bash[22676]: audit 2024-09-21T00:58:43.006703+0000 mgr.a (mgr.14388) 7106 : audit [DBG] from='client.161370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:44 smithi179 bash[23186]: cluster 2024-09-21T00:58:43.320163+0000 mgr.a (mgr.14388) 7107 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:44.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:44 smithi049 bash[23528]: cluster 2024-09-21T00:58:43.320163+0000 mgr.a (mgr.14388) 7107 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:44 smithi044 bash[22676]: cluster 2024-09-21T00:58:43.320163+0000 mgr.a (mgr.14388) 7107 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:46 smithi179 bash[23186]: cluster 2024-09-21T00:58:45.322439+0000 mgr.a (mgr.14388) 7108 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:46 smithi049 bash[23528]: cluster 2024-09-21T00:58:45.322439+0000 mgr.a (mgr.14388) 7108 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:46 smithi044 bash[22676]: cluster 2024-09-21T00:58:45.322439+0000 mgr.a (mgr.14388) 7108 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:58:48.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:48.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:48.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:48.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:48 smithi049 bash[23528]: cluster 2024-09-21T00:58:47.323250+0000 mgr.a (mgr.14388) 7109 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:48 smithi044 bash[22676]: cluster 2024-09-21T00:58:47.323250+0000 mgr.a (mgr.14388) 7109 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:48 smithi179 bash[23186]: cluster 2024-09-21T00:58:47.323250+0000 mgr.a (mgr.14388) 7109 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:49.239 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:49.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:49 smithi049 bash[23528]: audit 2024-09-21T00:58:48.782339+0000 mgr.a (mgr.14388) 7110 : audit [DBG] from='client.161448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:49 smithi044 bash[22676]: audit 2024-09-21T00:58:48.782339+0000 mgr.a (mgr.14388) 7110 : audit [DBG] from='client.161448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:49 smithi179 bash[23186]: audit 2024-09-21T00:58:48.782339+0000 mgr.a (mgr.14388) 7110 : audit [DBG] from='client.161448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:50.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:50 smithi049 bash[23528]: cluster 2024-09-21T00:58:49.324220+0000 mgr.a (mgr.14388) 7111 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:50 smithi044 bash[22676]: cluster 2024-09-21T00:58:49.324220+0000 mgr.a (mgr.14388) 7111 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:50 smithi179 bash[23186]: cluster 2024-09-21T00:58:49.324220+0000 mgr.a (mgr.14388) 7111 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:52 smithi049 bash[23528]: cluster 2024-09-21T00:58:51.326511+0000 mgr.a (mgr.14388) 7112 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:52 smithi044 bash[22676]: cluster 2024-09-21T00:58:51.326511+0000 mgr.a (mgr.14388) 7112 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:52 smithi179 bash[23186]: cluster 2024-09-21T00:58:51.326511+0000 mgr.a (mgr.14388) 7112 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:54.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:58:54.241 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:58:54.242 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:58:54.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:54 smithi044 bash[22676]: cluster 2024-09-21T00:58:53.327272+0000 mgr.a (mgr.14388) 7113 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:54.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:54 smithi044 bash[22676]: audit 2024-09-21T00:58:54.303344+0000 mon.a (mon.0) 6156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:54 smithi044 bash[22676]: audit 2024-09-21T00:58:54.308375+0000 mon.a (mon.0) 6157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:54 smithi044 bash[22676]: audit 2024-09-21T00:58:54.314417+0000 mon.a (mon.0) 6158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:54 smithi179 bash[23186]: cluster 2024-09-21T00:58:53.327272+0000 mgr.a (mgr.14388) 7113 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:54 smithi179 bash[23186]: audit 2024-09-21T00:58:54.303344+0000 mon.a (mon.0) 6156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:54 smithi179 bash[23186]: audit 2024-09-21T00:58:54.308375+0000 mon.a (mon.0) 6157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:54 smithi179 bash[23186]: audit 2024-09-21T00:58:54.314417+0000 mon.a (mon.0) 6158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:54 smithi049 bash[23528]: cluster 2024-09-21T00:58:53.327272+0000 mgr.a (mgr.14388) 7113 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:54 smithi049 bash[23528]: audit 2024-09-21T00:58:54.303344+0000 mon.a (mon.0) 6156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:54 smithi049 bash[23528]: audit 2024-09-21T00:58:54.308375+0000 mon.a (mon.0) 6157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:54 smithi049 bash[23528]: audit 2024-09-21T00:58:54.314417+0000 mon.a (mon.0) 6158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:55.015 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:58:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:58:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:58:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:58:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:58:55.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:55 smithi049 bash[23528]: audit 2024-09-21T00:58:54.587301+0000 mgr.a (mgr.14388) 7114 : audit [DBG] from='client.161526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:55.807 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:55 smithi044 bash[22676]: audit 2024-09-21T00:58:54.587301+0000 mgr.a (mgr.14388) 7114 : audit [DBG] from='client.161526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:55.854 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:55 smithi179 bash[23186]: audit 2024-09-21T00:58:54.587301+0000 mgr.a (mgr.14388) 7114 : audit [DBG] from='client.161526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:56 smithi049 bash[23528]: cluster 2024-09-21T00:58:55.329472+0000 mgr.a (mgr.14388) 7115 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:56 smithi049 bash[23528]: audit 2024-09-21T00:58:55.679530+0000 mon.a (mon.0) 6159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:56 smithi049 bash[23528]: audit 2024-09-21T00:58:55.688372+0000 mon.a (mon.0) 6160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:56 smithi049 bash[23528]: audit 2024-09-21T00:58:55.698888+0000 mon.a (mon.0) 6161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:56 smithi049 bash[23528]: audit 2024-09-21T00:58:56.472469+0000 mon.a (mon.0) 6162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:56 smithi049 bash[23528]: audit 2024-09-21T00:58:56.483898+0000 mon.a (mon.0) 6163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:56 smithi049 bash[23528]: audit 2024-09-21T00:58:56.493497+0000 mon.a (mon.0) 6164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:56 smithi044 bash[22676]: cluster 2024-09-21T00:58:55.329472+0000 mgr.a (mgr.14388) 7115 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:56 smithi044 bash[22676]: audit 2024-09-21T00:58:55.679530+0000 mon.a (mon.0) 6159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:56 smithi044 bash[22676]: audit 2024-09-21T00:58:55.688372+0000 mon.a (mon.0) 6160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:56 smithi044 bash[22676]: audit 2024-09-21T00:58:55.698888+0000 mon.a (mon.0) 6161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:56 smithi044 bash[22676]: audit 2024-09-21T00:58:56.472469+0000 mon.a (mon.0) 6162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:56 smithi044 bash[22676]: audit 2024-09-21T00:58:56.483898+0000 mon.a (mon.0) 6163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:56 smithi044 bash[22676]: audit 2024-09-21T00:58:56.493497+0000 mon.a (mon.0) 6164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:56 smithi179 bash[23186]: cluster 2024-09-21T00:58:55.329472+0000 mgr.a (mgr.14388) 7115 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:58:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:56 smithi179 bash[23186]: audit 2024-09-21T00:58:55.679530+0000 mon.a (mon.0) 6159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:56 smithi179 bash[23186]: audit 2024-09-21T00:58:55.688372+0000 mon.a (mon.0) 6160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:56 smithi179 bash[23186]: audit 2024-09-21T00:58:55.698888+0000 mon.a (mon.0) 6161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:56 smithi179 bash[23186]: audit 2024-09-21T00:58:56.472469+0000 mon.a (mon.0) 6162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:56 smithi179 bash[23186]: audit 2024-09-21T00:58:56.483898+0000 mon.a (mon.0) 6163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:56 smithi179 bash[23186]: audit 2024-09-21T00:58:56.493497+0000 mon.a (mon.0) 6164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:58:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:58:58 smithi044 bash[22676]: cluster 2024-09-21T00:58:57.330234+0000 mgr.a (mgr.14388) 7116 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:58:58 smithi179 bash[23186]: cluster 2024-09-21T00:58:57.330234+0000 mgr.a (mgr.14388) 7116 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:58:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:58:58 smithi049 bash[23528]: cluster 2024-09-21T00:58:57.330234+0000 mgr.a (mgr.14388) 7116 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:00.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:00.017 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:00 smithi044 bash[22676]: cluster 2024-09-21T00:58:59.331155+0000 mgr.a (mgr.14388) 7117 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:00.806 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:00.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:00.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:00.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:00.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:00 smithi179 bash[23186]: cluster 2024-09-21T00:58:59.331155+0000 mgr.a (mgr.14388) 7117 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:00 smithi049 bash[23528]: cluster 2024-09-21T00:58:59.331155+0000 mgr.a (mgr.14388) 7117 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:01 smithi044 bash[22676]: audit 2024-09-21T00:59:00.355099+0000 mgr.a (mgr.14388) 7118 : audit [DBG] from='client.161601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:01 smithi179 bash[23186]: audit 2024-09-21T00:59:00.355099+0000 mgr.a (mgr.14388) 7118 : audit [DBG] from='client.161601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:02.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:01 smithi049 bash[23528]: audit 2024-09-21T00:59:00.355099+0000 mgr.a (mgr.14388) 7118 : audit [DBG] from='client.161601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:02 smithi044 bash[22676]: cluster 2024-09-21T00:59:01.333948+0000 mgr.a (mgr.14388) 7119 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:02 smithi179 bash[23186]: cluster 2024-09-21T00:59:01.333948+0000 mgr.a (mgr.14388) 7119 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:02 smithi049 bash[23528]: cluster 2024-09-21T00:59:01.333948+0000 mgr.a (mgr.14388) 7119 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:04.968 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:04 smithi049 bash[23528]: cluster 2024-09-21T00:59:03.334709+0000 mgr.a (mgr.14388) 7120 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:59:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:04 smithi044 bash[22676]: cluster 2024-09-21T00:59:03.334709+0000 mgr.a (mgr.14388) 7120 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:59:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:04 smithi179 bash[23186]: cluster 2024-09-21T00:59:03.334709+0000 mgr.a (mgr.14388) 7120 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:59:05.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:05.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:05.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:06.595 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:06.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:06.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:06.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:06.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:06 smithi044 bash[22676]: cluster 2024-09-21T00:59:05.336601+0000 mgr.a (mgr.14388) 7121 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:06 smithi179 bash[23186]: cluster 2024-09-21T00:59:05.336601+0000 mgr.a (mgr.14388) 7121 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:06 smithi049 bash[23528]: cluster 2024-09-21T00:59:05.336601+0000 mgr.a (mgr.14388) 7121 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:07 smithi044 bash[22676]: audit 2024-09-21T00:59:06.142888+0000 mgr.a (mgr.14388) 7122 : audit [DBG] from='client.161676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:07 smithi179 bash[23186]: audit 2024-09-21T00:59:06.142888+0000 mgr.a (mgr.14388) 7122 : audit [DBG] from='client.161676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:08.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:07 smithi049 bash[23528]: audit 2024-09-21T00:59:06.142888+0000 mgr.a (mgr.14388) 7122 : audit [DBG] from='client.161676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:08 smithi044 bash[22676]: cluster 2024-09-21T00:59:07.337530+0000 mgr.a (mgr.14388) 7123 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:59:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:08 smithi179 bash[23186]: cluster 2024-09-21T00:59:07.337530+0000 mgr.a (mgr.14388) 7123 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:59:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:08 smithi049 bash[23528]: cluster 2024-09-21T00:59:07.337530+0000 mgr.a (mgr.14388) 7123 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T00:59:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:10 smithi044 bash[22676]: cluster 2024-09-21T00:59:09.338331+0000 mgr.a (mgr.14388) 7124 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:59:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:10 smithi179 bash[23186]: cluster 2024-09-21T00:59:09.338331+0000 mgr.a (mgr.14388) 7124 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:59:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:10 smithi049 bash[23528]: cluster 2024-09-21T00:59:09.338331+0000 mgr.a (mgr.14388) 7124 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T00:59:11.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:11.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:11.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:12.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:12.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:12.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:12.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:12.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:12 smithi044 bash[22676]: cluster 2024-09-21T00:59:11.340550+0000 mgr.a (mgr.14388) 7125 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:12 smithi044 bash[22676]: audit 2024-09-21T00:59:11.932531+0000 mgr.a (mgr.14388) 7126 : audit [DBG] from='client.161751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:12 smithi179 bash[23186]: cluster 2024-09-21T00:59:11.340550+0000 mgr.a (mgr.14388) 7125 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:12 smithi179 bash[23186]: audit 2024-09-21T00:59:11.932531+0000 mgr.a (mgr.14388) 7126 : audit [DBG] from='client.161751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:12 smithi049 bash[23528]: cluster 2024-09-21T00:59:11.340550+0000 mgr.a (mgr.14388) 7125 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:12 smithi049 bash[23528]: audit 2024-09-21T00:59:11.932531+0000 mgr.a (mgr.14388) 7126 : audit [DBG] from='client.161751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:14 smithi044 bash[22676]: cluster 2024-09-21T00:59:13.341516+0000 mgr.a (mgr.14388) 7127 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:14 smithi044 bash[22676]: audit 2024-09-21T00:59:14.518507+0000 mon.a (mon.0) 6165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:14 smithi044 bash[22676]: audit 2024-09-21T00:59:14.529749+0000 mon.a (mon.0) 6166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:14 smithi044 bash[22676]: audit 2024-09-21T00:59:14.540911+0000 mon.a (mon.0) 6167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:14 smithi179 bash[23186]: cluster 2024-09-21T00:59:13.341516+0000 mgr.a (mgr.14388) 7127 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:14 smithi179 bash[23186]: audit 2024-09-21T00:59:14.518507+0000 mon.a (mon.0) 6165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:14 smithi179 bash[23186]: audit 2024-09-21T00:59:14.529749+0000 mon.a (mon.0) 6166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:14 smithi179 bash[23186]: audit 2024-09-21T00:59:14.540911+0000 mon.a (mon.0) 6167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:14 smithi049 bash[23528]: cluster 2024-09-21T00:59:13.341516+0000 mgr.a (mgr.14388) 7127 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:14 smithi049 bash[23528]: audit 2024-09-21T00:59:14.518507+0000 mon.a (mon.0) 6165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:14 smithi049 bash[23528]: audit 2024-09-21T00:59:14.529749+0000 mon.a (mon.0) 6166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:14 smithi049 bash[23528]: audit 2024-09-21T00:59:14.540911+0000 mon.a (mon.0) 6167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:16 smithi044 bash[22676]: cluster 2024-09-21T00:59:15.343634+0000 mgr.a (mgr.14388) 7128 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:16 smithi044 bash[22676]: audit 2024-09-21T00:59:15.907379+0000 mon.a (mon.0) 6168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:16 smithi044 bash[22676]: audit 2024-09-21T00:59:15.913150+0000 mon.a (mon.0) 6169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:16 smithi044 bash[22676]: audit 2024-09-21T00:59:15.919290+0000 mon.a (mon.0) 6170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:16 smithi044 bash[22676]: audit 2024-09-21T00:59:16.700827+0000 mon.a (mon.0) 6171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:16 smithi044 bash[22676]: audit 2024-09-21T00:59:16.708900+0000 mon.a (mon.0) 6172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:16 smithi044 bash[22676]: audit 2024-09-21T00:59:16.716813+0000 mon.a (mon.0) 6173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:16 smithi049 bash[23528]: cluster 2024-09-21T00:59:15.343634+0000 mgr.a (mgr.14388) 7128 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:16 smithi049 bash[23528]: audit 2024-09-21T00:59:15.907379+0000 mon.a (mon.0) 6168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:16 smithi049 bash[23528]: audit 2024-09-21T00:59:15.913150+0000 mon.a (mon.0) 6169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:16 smithi049 bash[23528]: audit 2024-09-21T00:59:15.919290+0000 mon.a (mon.0) 6170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:16 smithi049 bash[23528]: audit 2024-09-21T00:59:16.700827+0000 mon.a (mon.0) 6171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:16 smithi049 bash[23528]: audit 2024-09-21T00:59:16.708900+0000 mon.a (mon.0) 6172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:16 smithi049 bash[23528]: audit 2024-09-21T00:59:16.716813+0000 mon.a (mon.0) 6173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:16 smithi179 bash[23186]: cluster 2024-09-21T00:59:15.343634+0000 mgr.a (mgr.14388) 7128 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:16 smithi179 bash[23186]: audit 2024-09-21T00:59:15.907379+0000 mon.a (mon.0) 6168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:16 smithi179 bash[23186]: audit 2024-09-21T00:59:15.913150+0000 mon.a (mon.0) 6169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:16 smithi179 bash[23186]: audit 2024-09-21T00:59:15.919290+0000 mon.a (mon.0) 6170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:16 smithi179 bash[23186]: audit 2024-09-21T00:59:16.700827+0000 mon.a (mon.0) 6171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:16 smithi179 bash[23186]: audit 2024-09-21T00:59:16.708900+0000 mon.a (mon.0) 6172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:16 smithi179 bash[23186]: audit 2024-09-21T00:59:16.716813+0000 mon.a (mon.0) 6173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:17.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:17.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:17.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:18.163 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:18 smithi044 bash[22676]: cluster 2024-09-21T00:59:17.344283+0000 mgr.a (mgr.14388) 7129 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:18 smithi044 bash[22676]: audit 2024-09-21T00:59:17.723880+0000 mgr.a (mgr.14388) 7130 : audit [DBG] from='client.161829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:18 smithi179 bash[23186]: cluster 2024-09-21T00:59:17.344283+0000 mgr.a (mgr.14388) 7129 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:18 smithi179 bash[23186]: audit 2024-09-21T00:59:17.723880+0000 mgr.a (mgr.14388) 7130 : audit [DBG] from='client.161829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:18 smithi049 bash[23528]: cluster 2024-09-21T00:59:17.344283+0000 mgr.a (mgr.14388) 7129 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:18 smithi049 bash[23528]: audit 2024-09-21T00:59:17.723880+0000 mgr.a (mgr.14388) 7130 : audit [DBG] from='client.161829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:20 smithi044 bash[22676]: cluster 2024-09-21T00:59:19.345195+0000 mgr.a (mgr.14388) 7131 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:20 smithi179 bash[23186]: cluster 2024-09-21T00:59:19.345195+0000 mgr.a (mgr.14388) 7131 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:20 smithi049 bash[23528]: cluster 2024-09-21T00:59:19.345195+0000 mgr.a (mgr.14388) 7131 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:23.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:23.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:23.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:22 smithi044 bash[22676]: cluster 2024-09-21T00:59:21.347447+0000 mgr.a (mgr.14388) 7132 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:22 smithi179 bash[23186]: cluster 2024-09-21T00:59:21.347447+0000 mgr.a (mgr.14388) 7132 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:22 smithi049 bash[23528]: cluster 2024-09-21T00:59:21.347447+0000 mgr.a (mgr.14388) 7132 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:23.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:24 smithi044 bash[22676]: cluster 2024-09-21T00:59:23.348193+0000 mgr.a (mgr.14388) 7133 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:24 smithi044 bash[22676]: audit 2024-09-21T00:59:23.502840+0000 mgr.a (mgr.14388) 7134 : audit [DBG] from='client.161907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:24 smithi179 bash[23186]: cluster 2024-09-21T00:59:23.348193+0000 mgr.a (mgr.14388) 7133 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:24 smithi179 bash[23186]: audit 2024-09-21T00:59:23.502840+0000 mgr.a (mgr.14388) 7134 : audit [DBG] from='client.161907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:24 smithi049 bash[23528]: cluster 2024-09-21T00:59:23.348193+0000 mgr.a (mgr.14388) 7133 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:25.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:24 smithi049 bash[23528]: audit 2024-09-21T00:59:23.502840+0000 mgr.a (mgr.14388) 7134 : audit [DBG] from='client.161907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:26 smithi044 bash[22676]: cluster 2024-09-21T00:59:25.350398+0000 mgr.a (mgr.14388) 7135 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:26 smithi179 bash[23186]: cluster 2024-09-21T00:59:25.350398+0000 mgr.a (mgr.14388) 7135 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:26 smithi049 bash[23528]: cluster 2024-09-21T00:59:25.350398+0000 mgr.a (mgr.14388) 7135 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:28.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:28 smithi044 bash[22676]: cluster 2024-09-21T00:59:27.351314+0000 mgr.a (mgr.14388) 7136 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:28 smithi179 bash[23186]: cluster 2024-09-21T00:59:27.351314+0000 mgr.a (mgr.14388) 7136 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:28 smithi049 bash[23528]: cluster 2024-09-21T00:59:27.351314+0000 mgr.a (mgr.14388) 7136 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:29.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:30 smithi044 bash[22676]: audit 2024-09-21T00:59:29.287298+0000 mgr.a (mgr.14388) 7137 : audit [DBG] from='client.161982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:30 smithi044 bash[22676]: cluster 2024-09-21T00:59:29.351952+0000 mgr.a (mgr.14388) 7138 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:30 smithi179 bash[23186]: audit 2024-09-21T00:59:29.287298+0000 mgr.a (mgr.14388) 7137 : audit [DBG] from='client.161982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:30 smithi179 bash[23186]: cluster 2024-09-21T00:59:29.351952+0000 mgr.a (mgr.14388) 7138 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:30 smithi049 bash[23528]: audit 2024-09-21T00:59:29.287298+0000 mgr.a (mgr.14388) 7137 : audit [DBG] from='client.161982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:30 smithi049 bash[23528]: cluster 2024-09-21T00:59:29.351952+0000 mgr.a (mgr.14388) 7138 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:31 smithi044 bash[22676]: audit 2024-09-21T00:59:31.545573+0000 mon.a (mon.0) 6174 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:31 smithi044 bash[22676]: audit 2024-09-21T00:59:31.552675+0000 mon.a (mon.0) 6175 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:59:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:31 smithi044 bash[22676]: audit 2024-09-21T00:59:31.554525+0000 mon.a (mon.0) 6176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:59:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:31 smithi044 bash[22676]: audit 2024-09-21T00:59:31.565610+0000 mon.a (mon.0) 6177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:31 smithi044 bash[22676]: audit 2024-09-21T00:59:31.572137+0000 mon.a (mon.0) 6178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:59:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:31 smithi179 bash[23186]: audit 2024-09-21T00:59:31.545573+0000 mon.a (mon.0) 6174 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:31 smithi179 bash[23186]: audit 2024-09-21T00:59:31.552675+0000 mon.a (mon.0) 6175 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:59:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:31 smithi179 bash[23186]: audit 2024-09-21T00:59:31.554525+0000 mon.a (mon.0) 6176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:59:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:31 smithi179 bash[23186]: audit 2024-09-21T00:59:31.565610+0000 mon.a (mon.0) 6177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:31 smithi179 bash[23186]: audit 2024-09-21T00:59:31.572137+0000 mon.a (mon.0) 6178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:59:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:31 smithi049 bash[23528]: audit 2024-09-21T00:59:31.545573+0000 mon.a (mon.0) 6174 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:31 smithi049 bash[23528]: audit 2024-09-21T00:59:31.552675+0000 mon.a (mon.0) 6175 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:59:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:31 smithi049 bash[23528]: audit 2024-09-21T00:59:31.554525+0000 mon.a (mon.0) 6176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:59:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:31 smithi049 bash[23528]: audit 2024-09-21T00:59:31.565610+0000 mon.a (mon.0) 6177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:31 smithi049 bash[23528]: audit 2024-09-21T00:59:31.572137+0000 mon.a (mon.0) 6178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:59:32.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:59:32 smithi044 bash[22930]: debug 2024-09-21T00:59:32.358+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:59:32.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 00:59:32 smithi044 bash[22930]: debug 2024-09-21T00:59:32.358+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:59:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:32 smithi044 bash[22676]: cluster 2024-09-21T00:59:31.354419+0000 mgr.a (mgr.14388) 7139 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:32 smithi044 bash[22676]: audit 2024-09-21T00:59:31.574501+0000 mgr.a (mgr.14388) 7140 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:59:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:32 smithi179 bash[23186]: cluster 2024-09-21T00:59:31.354419+0000 mgr.a (mgr.14388) 7139 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:32 smithi179 bash[23186]: audit 2024-09-21T00:59:31.574501+0000 mgr.a (mgr.14388) 7140 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:59:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:32 smithi049 bash[23528]: cluster 2024-09-21T00:59:31.354419+0000 mgr.a (mgr.14388) 7139 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:32 smithi049 bash[23528]: audit 2024-09-21T00:59:31.574501+0000 mgr.a (mgr.14388) 7140 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T00:59:34.217 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:33 smithi179 bash[23186]: audit 2024-09-21T00:59:32.361569+0000 mgr.a (mgr.14388) 7141 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:59:34.217 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:33 smithi179 bash[23186]: cephadm 2024-09-21T00:59:32.363057+0000 mgr.a (mgr.14388) 7142 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:59:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:33 smithi044 bash[22676]: audit 2024-09-21T00:59:32.361569+0000 mgr.a (mgr.14388) 7141 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:59:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:33 smithi044 bash[22676]: cephadm 2024-09-21T00:59:32.363057+0000 mgr.a (mgr.14388) 7142 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:59:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:33 smithi049 bash[23528]: audit 2024-09-21T00:59:32.361569+0000 mgr.a (mgr.14388) 7141 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T00:59:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:33 smithi049 bash[23528]: cephadm 2024-09-21T00:59:32.363057+0000 mgr.a (mgr.14388) 7142 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T00:59:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:34 smithi179 bash[23186]: cluster 2024-09-21T00:59:33.355338+0000 mgr.a (mgr.14388) 7143 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:34 smithi179 bash[23186]: audit 2024-09-21T00:59:34.726117+0000 mon.a (mon.0) 6179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:34 smithi179 bash[23186]: audit 2024-09-21T00:59:34.735834+0000 mon.a (mon.0) 6180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:34 smithi179 bash[23186]: audit 2024-09-21T00:59:34.748069+0000 mon.a (mon.0) 6181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:34 smithi044 bash[22676]: cluster 2024-09-21T00:59:33.355338+0000 mgr.a (mgr.14388) 7143 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:34 smithi044 bash[22676]: audit 2024-09-21T00:59:34.726117+0000 mon.a (mon.0) 6179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:34 smithi044 bash[22676]: audit 2024-09-21T00:59:34.735834+0000 mon.a (mon.0) 6180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:34 smithi044 bash[22676]: audit 2024-09-21T00:59:34.748069+0000 mon.a (mon.0) 6181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:34 smithi049 bash[23528]: cluster 2024-09-21T00:59:33.355338+0000 mgr.a (mgr.14388) 7143 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:34 smithi049 bash[23528]: audit 2024-09-21T00:59:34.726117+0000 mon.a (mon.0) 6179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:34 smithi049 bash[23528]: audit 2024-09-21T00:59:34.735834+0000 mon.a (mon.0) 6180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:34 smithi049 bash[23528]: audit 2024-09-21T00:59:34.748069+0000 mon.a (mon.0) 6181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:35.496 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:35.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:35.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:35.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:35.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: audit 2024-09-21T00:59:35.073223+0000 mgr.a (mgr.14388) 7144 : audit [DBG] from='client.162168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: cluster 2024-09-21T00:59:35.356758+0000 mgr.a (mgr.14388) 7145 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: audit 2024-09-21T00:59:36.101765+0000 mon.a (mon.0) 6182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: audit 2024-09-21T00:59:36.106173+0000 mon.a (mon.0) 6183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: audit 2024-09-21T00:59:36.110930+0000 mon.a (mon.0) 6184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: audit 2024-09-21T00:59:36.934628+0000 mon.a (mon.0) 6185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: audit 2024-09-21T00:59:36.944352+0000 mon.a (mon.0) 6186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:36 smithi044 bash[22676]: audit 2024-09-21T00:59:36.957691+0000 mon.a (mon.0) 6187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: audit 2024-09-21T00:59:35.073223+0000 mgr.a (mgr.14388) 7144 : audit [DBG] from='client.162168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: cluster 2024-09-21T00:59:35.356758+0000 mgr.a (mgr.14388) 7145 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: audit 2024-09-21T00:59:36.101765+0000 mon.a (mon.0) 6182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: audit 2024-09-21T00:59:36.106173+0000 mon.a (mon.0) 6183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: audit 2024-09-21T00:59:36.110930+0000 mon.a (mon.0) 6184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: audit 2024-09-21T00:59:36.934628+0000 mon.a (mon.0) 6185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: audit 2024-09-21T00:59:36.944352+0000 mon.a (mon.0) 6186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:36 smithi179 bash[23186]: audit 2024-09-21T00:59:36.957691+0000 mon.a (mon.0) 6187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: audit 2024-09-21T00:59:35.073223+0000 mgr.a (mgr.14388) 7144 : audit [DBG] from='client.162168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:37.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: cluster 2024-09-21T00:59:35.356758+0000 mgr.a (mgr.14388) 7145 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: audit 2024-09-21T00:59:36.101765+0000 mon.a (mon.0) 6182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: audit 2024-09-21T00:59:36.106173+0000 mon.a (mon.0) 6183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: audit 2024-09-21T00:59:36.110930+0000 mon.a (mon.0) 6184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: audit 2024-09-21T00:59:36.934628+0000 mon.a (mon.0) 6185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: audit 2024-09-21T00:59:36.944352+0000 mon.a (mon.0) 6186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:36 smithi049 bash[23528]: audit 2024-09-21T00:59:36.957691+0000 mon.a (mon.0) 6187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:38 smithi044 bash[22676]: cluster 2024-09-21T00:59:37.357673+0000 mgr.a (mgr.14388) 7146 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:38 smithi179 bash[23186]: cluster 2024-09-21T00:59:37.357673+0000 mgr.a (mgr.14388) 7146 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:38 smithi049 bash[23528]: cluster 2024-09-21T00:59:37.357673+0000 mgr.a (mgr.14388) 7146 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:40.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:40.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:40 smithi044 bash[22676]: cluster 2024-09-21T00:59:39.358475+0000 mgr.a (mgr.14388) 7147 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:40 smithi179 bash[23186]: cluster 2024-09-21T00:59:39.358475+0000 mgr.a (mgr.14388) 7147 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:41.258 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:41.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:40 smithi049 bash[23528]: cluster 2024-09-21T00:59:39.358475+0000 mgr.a (mgr.14388) 7147 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:41 smithi044 bash[22676]: audit 2024-09-21T00:59:40.830131+0000 mgr.a (mgr.14388) 7148 : audit [DBG] from='client.162246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:41 smithi179 bash[23186]: audit 2024-09-21T00:59:40.830131+0000 mgr.a (mgr.14388) 7148 : audit [DBG] from='client.162246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:42.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:41 smithi049 bash[23528]: audit 2024-09-21T00:59:40.830131+0000 mgr.a (mgr.14388) 7148 : audit [DBG] from='client.162246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:42 smithi044 bash[22676]: cluster 2024-09-21T00:59:41.359772+0000 mgr.a (mgr.14388) 7149 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:42 smithi179 bash[23186]: cluster 2024-09-21T00:59:41.359772+0000 mgr.a (mgr.14388) 7149 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:42 smithi049 bash[23528]: cluster 2024-09-21T00:59:41.359772+0000 mgr.a (mgr.14388) 7149 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:44 smithi179 bash[23186]: cluster 2024-09-21T00:59:43.360499+0000 mgr.a (mgr.14388) 7150 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:44 smithi049 bash[23528]: cluster 2024-09-21T00:59:43.360499+0000 mgr.a (mgr.14388) 7150 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:44 smithi044 bash[22676]: cluster 2024-09-21T00:59:43.360499+0000 mgr.a (mgr.14388) 7150 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T00:59:46.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:46.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:46.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:47.060 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:47.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:47.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:47.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:47.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:46 smithi179 bash[23186]: cluster 2024-09-21T00:59:45.362435+0000 mgr.a (mgr.14388) 7151 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:47.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:46 smithi049 bash[23528]: cluster 2024-09-21T00:59:45.362435+0000 mgr.a (mgr.14388) 7151 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:46 smithi044 bash[22676]: cluster 2024-09-21T00:59:45.362435+0000 mgr.a (mgr.14388) 7151 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T00:59:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:48 smithi179 bash[23186]: audit 2024-09-21T00:59:46.599531+0000 mgr.a (mgr.14388) 7152 : audit [DBG] from='client.162324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:48.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:47 smithi049 bash[23528]: audit 2024-09-21T00:59:46.599531+0000 mgr.a (mgr.14388) 7152 : audit [DBG] from='client.162324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:47 smithi044 bash[22676]: audit 2024-09-21T00:59:46.599531+0000 mgr.a (mgr.14388) 7152 : audit [DBG] from='client.162324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:49.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:49 smithi049 bash[23528]: cluster 2024-09-21T00:59:47.363426+0000 mgr.a (mgr.14388) 7153 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:49 smithi044 bash[22676]: cluster 2024-09-21T00:59:47.363426+0000 mgr.a (mgr.14388) 7153 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:49 smithi179 bash[23186]: cluster 2024-09-21T00:59:47.363426+0000 mgr.a (mgr.14388) 7153 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:51.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:51 smithi049 bash[23528]: cluster 2024-09-21T00:59:49.364372+0000 mgr.a (mgr.14388) 7154 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:51 smithi044 bash[22676]: cluster 2024-09-21T00:59:49.364372+0000 mgr.a (mgr.14388) 7154 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:51 smithi179 bash[23186]: cluster 2024-09-21T00:59:49.364372+0000 mgr.a (mgr.14388) 7154 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:52.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:52.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:52.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:52.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:52.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:52.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:52.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:52.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:53.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:53 smithi049 bash[23528]: cluster 2024-09-21T00:59:51.366689+0000 mgr.a (mgr.14388) 7155 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:53.366 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:53 smithi179 bash[23186]: cluster 2024-09-21T00:59:51.366689+0000 mgr.a (mgr.14388) 7155 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:53.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:53 smithi044 bash[22676]: cluster 2024-09-21T00:59:51.366689+0000 mgr.a (mgr.14388) 7155 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:54.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:54 smithi049 bash[23528]: audit 2024-09-21T00:59:52.400965+0000 mgr.a (mgr.14388) 7156 : audit [DBG] from='client.162396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:54.314 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:54 smithi044 bash[22676]: audit 2024-09-21T00:59:52.400965+0000 mgr.a (mgr.14388) 7156 : audit [DBG] from='client.162396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:54.323 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:54 smithi179 bash[23186]: audit 2024-09-21T00:59:52.400965+0000 mgr.a (mgr.14388) 7156 : audit [DBG] from='client.162396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:55 smithi179 bash[23186]: cluster 2024-09-21T00:59:53.367662+0000 mgr.a (mgr.14388) 7157 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:55 smithi179 bash[23186]: audit 2024-09-21T00:59:54.887862+0000 mon.a (mon.0) 6188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:55 smithi179 bash[23186]: audit 2024-09-21T00:59:54.896807+0000 mon.a (mon.0) 6189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:55 smithi179 bash[23186]: audit 2024-09-21T00:59:54.905796+0000 mon.a (mon.0) 6190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:55 smithi049 bash[23528]: cluster 2024-09-21T00:59:53.367662+0000 mgr.a (mgr.14388) 7157 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:55 smithi049 bash[23528]: audit 2024-09-21T00:59:54.887862+0000 mon.a (mon.0) 6188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:55 smithi049 bash[23528]: audit 2024-09-21T00:59:54.896807+0000 mon.a (mon.0) 6189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:55 smithi049 bash[23528]: audit 2024-09-21T00:59:54.905796+0000 mon.a (mon.0) 6190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:55 smithi044 bash[22676]: cluster 2024-09-21T00:59:53.367662+0000 mgr.a (mgr.14388) 7157 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:55 smithi044 bash[22676]: audit 2024-09-21T00:59:54.887862+0000 mon.a (mon.0) 6188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:55 smithi044 bash[22676]: audit 2024-09-21T00:59:54.896807+0000 mon.a (mon.0) 6189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:55 smithi044 bash[22676]: audit 2024-09-21T00:59:54.905796+0000 mon.a (mon.0) 6190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:57 smithi044 bash[22676]: cluster 2024-09-21T00:59:55.369984+0000 mgr.a (mgr.14388) 7158 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:57 smithi044 bash[22676]: audit 2024-09-21T00:59:56.246161+0000 mon.a (mon.0) 6191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:57 smithi044 bash[22676]: audit 2024-09-21T00:59:56.253337+0000 mon.a (mon.0) 6192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:57 smithi044 bash[22676]: audit 2024-09-21T00:59:56.262891+0000 mon.a (mon.0) 6193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:57 smithi049 bash[23528]: cluster 2024-09-21T00:59:55.369984+0000 mgr.a (mgr.14388) 7158 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:57 smithi049 bash[23528]: audit 2024-09-21T00:59:56.246161+0000 mon.a (mon.0) 6191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:57 smithi049 bash[23528]: audit 2024-09-21T00:59:56.253337+0000 mon.a (mon.0) 6192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:57 smithi049 bash[23528]: audit 2024-09-21T00:59:56.262891+0000 mon.a (mon.0) 6193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:57 smithi179 bash[23186]: cluster 2024-09-21T00:59:55.369984+0000 mgr.a (mgr.14388) 7158 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T00:59:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:57 smithi179 bash[23186]: audit 2024-09-21T00:59:56.246161+0000 mon.a (mon.0) 6191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:57 smithi179 bash[23186]: audit 2024-09-21T00:59:56.253337+0000 mon.a (mon.0) 6192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:57 smithi179 bash[23186]: audit 2024-09-21T00:59:56.262891+0000 mon.a (mon.0) 6193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:57.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T00:59:57.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T00:59:57.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T00:59:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:58 smithi044 bash[22676]: audit 2024-09-21T00:59:57.170146+0000 mon.a (mon.0) 6194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:58 smithi044 bash[22676]: audit 2024-09-21T00:59:57.179433+0000 mon.a (mon.0) 6195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:58 smithi044 bash[22676]: audit 2024-09-21T00:59:57.191268+0000 mon.a (mon.0) 6196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:58 smithi044 bash[22676]: cluster 2024-09-21T00:59:57.370750+0000 mgr.a (mgr.14388) 7159 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:58 smithi179 bash[23186]: audit 2024-09-21T00:59:57.170146+0000 mon.a (mon.0) 6194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:58 smithi179 bash[23186]: audit 2024-09-21T00:59:57.179433+0000 mon.a (mon.0) 6195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:58 smithi179 bash[23186]: audit 2024-09-21T00:59:57.191268+0000 mon.a (mon.0) 6196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:58 smithi179 bash[23186]: cluster 2024-09-21T00:59:57.370750+0000 mgr.a (mgr.14388) 7159 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:58 smithi049 bash[23528]: audit 2024-09-21T00:59:57.170146+0000 mon.a (mon.0) 6194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:58 smithi049 bash[23528]: audit 2024-09-21T00:59:57.179433+0000 mon.a (mon.0) 6195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:58 smithi049 bash[23528]: audit 2024-09-21T00:59:57.191268+0000 mon.a (mon.0) 6196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T00:59:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:58 smithi049 bash[23528]: cluster 2024-09-21T00:59:57.370750+0000 mgr.a (mgr.14388) 7159 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T00:59:58.628 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T00:59:58.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T00:59:58.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T00:59:58.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T00:59:58.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T00:59:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 00:59:59 smithi044 bash[22676]: audit 2024-09-21T00:59:58.179224+0000 mgr.a (mgr.14388) 7160 : audit [DBG] from='client.162474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 00:59:59 smithi179 bash[23186]: audit 2024-09-21T00:59:58.179224+0000 mgr.a (mgr.14388) 7160 : audit [DBG] from='client.162474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:59.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 00:59:59 smithi049 bash[23528]: audit 2024-09-21T00:59:58.179224+0000 mgr.a (mgr.14388) 7160 : audit [DBG] from='client.162474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:00 smithi044 bash[22676]: cluster 2024-09-21T00:59:59.371866+0000 mgr.a (mgr.14388) 7161 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:00 smithi044 bash[22676]: cluster 2024-09-21T01:00:00.000162+0000 mon.a (mon.0) 6197 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:00:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:00 smithi179 bash[23186]: cluster 2024-09-21T00:59:59.371866+0000 mgr.a (mgr.14388) 7161 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:00 smithi179 bash[23186]: cluster 2024-09-21T01:00:00.000162+0000 mon.a (mon.0) 6197 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:00:00.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:00 smithi049 bash[23528]: cluster 2024-09-21T00:59:59.371866+0000 mgr.a (mgr.14388) 7161 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:00 smithi049 bash[23528]: cluster 2024-09-21T01:00:00.000162+0000 mon.a (mon.0) 6197 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:00:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:02 smithi044 bash[22676]: cluster 2024-09-21T01:00:01.374295+0000 mgr.a (mgr.14388) 7162 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:02 smithi179 bash[23186]: cluster 2024-09-21T01:00:01.374295+0000 mgr.a (mgr.14388) 7162 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:02.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:02 smithi049 bash[23528]: cluster 2024-09-21T01:00:01.374295+0000 mgr.a (mgr.14388) 7162 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:03.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:03.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:03.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:04.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:04.389 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:04.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:04 smithi049 bash[23528]: cluster 2024-09-21T01:00:03.375267+0000 mgr.a (mgr.14388) 7163 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:04.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:04 smithi049 bash[23528]: audit 2024-09-21T01:00:03.956997+0000 mgr.a (mgr.14388) 7164 : audit [DBG] from='client.162546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:04 smithi044 bash[22676]: cluster 2024-09-21T01:00:03.375267+0000 mgr.a (mgr.14388) 7163 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:04 smithi044 bash[22676]: audit 2024-09-21T01:00:03.956997+0000 mgr.a (mgr.14388) 7164 : audit [DBG] from='client.162546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:04 smithi179 bash[23186]: cluster 2024-09-21T01:00:03.375267+0000 mgr.a (mgr.14388) 7163 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:04 smithi179 bash[23186]: audit 2024-09-21T01:00:03.956997+0000 mgr.a (mgr.14388) 7164 : audit [DBG] from='client.162546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:06 smithi044 bash[22676]: cluster 2024-09-21T01:00:05.377679+0000 mgr.a (mgr.14388) 7165 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:06 smithi179 bash[23186]: cluster 2024-09-21T01:00:05.377679+0000 mgr.a (mgr.14388) 7165 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:06.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:06 smithi049 bash[23528]: cluster 2024-09-21T01:00:05.377679+0000 mgr.a (mgr.14388) 7165 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:08 smithi044 bash[22676]: cluster 2024-09-21T01:00:07.378482+0000 mgr.a (mgr.14388) 7166 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:08 smithi179 bash[23186]: cluster 2024-09-21T01:00:07.378482+0000 mgr.a (mgr.14388) 7166 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:08.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:08 smithi049 bash[23528]: cluster 2024-09-21T01:00:07.378482+0000 mgr.a (mgr.14388) 7166 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:09.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:10.143 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:10.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:10.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:10 smithi044 bash[22676]: cluster 2024-09-21T01:00:09.379260+0000 mgr.a (mgr.14388) 7167 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:10 smithi044 bash[22676]: audit 2024-09-21T01:00:09.723709+0000 mgr.a (mgr.14388) 7168 : audit [DBG] from='client.162618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:10 smithi179 bash[23186]: cluster 2024-09-21T01:00:09.379260+0000 mgr.a (mgr.14388) 7167 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:10 smithi179 bash[23186]: audit 2024-09-21T01:00:09.723709+0000 mgr.a (mgr.14388) 7168 : audit [DBG] from='client.162618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:10.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:10 smithi049 bash[23528]: cluster 2024-09-21T01:00:09.379260+0000 mgr.a (mgr.14388) 7167 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:10 smithi049 bash[23528]: audit 2024-09-21T01:00:09.723709+0000 mgr.a (mgr.14388) 7168 : audit [DBG] from='client.162618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:12 smithi044 bash[22676]: cluster 2024-09-21T01:00:11.381765+0000 mgr.a (mgr.14388) 7169 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:00:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:12 smithi179 bash[23186]: cluster 2024-09-21T01:00:11.381765+0000 mgr.a (mgr.14388) 7169 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:00:12.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:12 smithi049 bash[23528]: cluster 2024-09-21T01:00:11.381765+0000 mgr.a (mgr.14388) 7169 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:00:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:14 smithi179 bash[23186]: cluster 2024-09-21T01:00:13.382736+0000 mgr.a (mgr.14388) 7170 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:00:14.694 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:14 smithi044 bash[22676]: cluster 2024-09-21T01:00:13.382736+0000 mgr.a (mgr.14388) 7170 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:00:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:14 smithi049 bash[23528]: cluster 2024-09-21T01:00:13.382736+0000 mgr.a (mgr.14388) 7170 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:00:15.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:15.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:15.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:15.913 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:16.096 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:16 smithi179 bash[23186]: audit 2024-09-21T01:00:15.097841+0000 mon.a (mon.0) 6198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.096 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:16 smithi179 bash[23186]: audit 2024-09-21T01:00:15.107394+0000 mon.a (mon.0) 6199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.096 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:16 smithi179 bash[23186]: audit 2024-09-21T01:00:15.117951+0000 mon.a (mon.0) 6200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.418 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:16 smithi044 bash[22676]: audit 2024-09-21T01:00:15.097841+0000 mon.a (mon.0) 6198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.418 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:16 smithi044 bash[22676]: audit 2024-09-21T01:00:15.107394+0000 mon.a (mon.0) 6199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.418 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:16 smithi044 bash[22676]: audit 2024-09-21T01:00:15.117951+0000 mon.a (mon.0) 6200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.419 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:16 smithi044 bash[22676]: cluster 2024-09-21T01:00:15.383994+0000 mgr.a (mgr.14388) 7171 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:16.419 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:16 smithi044 bash[22676]: audit 2024-09-21T01:00:15.486876+0000 mgr.a (mgr.14388) 7172 : audit [DBG] from='client.162690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:16 smithi179 bash[23186]: cluster 2024-09-21T01:00:15.383994+0000 mgr.a (mgr.14388) 7171 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:16 smithi179 bash[23186]: audit 2024-09-21T01:00:15.486876+0000 mgr.a (mgr.14388) 7172 : audit [DBG] from='client.162690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:16 smithi049 bash[23528]: audit 2024-09-21T01:00:15.097841+0000 mon.a (mon.0) 6198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:16 smithi049 bash[23528]: audit 2024-09-21T01:00:15.107394+0000 mon.a (mon.0) 6199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:16 smithi049 bash[23528]: audit 2024-09-21T01:00:15.117951+0000 mon.a (mon.0) 6200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:16 smithi049 bash[23528]: cluster 2024-09-21T01:00:15.383994+0000 mgr.a (mgr.14388) 7171 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:16 smithi049 bash[23528]: audit 2024-09-21T01:00:15.486876+0000 mgr.a (mgr.14388) 7172 : audit [DBG] from='client.162690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:17 smithi044 bash[22676]: audit 2024-09-21T01:00:16.402961+0000 mon.a (mon.0) 6201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:17 smithi044 bash[22676]: audit 2024-09-21T01:00:16.409540+0000 mon.a (mon.0) 6202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:17 smithi044 bash[22676]: audit 2024-09-21T01:00:16.417276+0000 mon.a (mon.0) 6203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:17 smithi044 bash[22676]: audit 2024-09-21T01:00:17.396475+0000 mon.a (mon.0) 6204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:17 smithi179 bash[23186]: audit 2024-09-21T01:00:16.402961+0000 mon.a (mon.0) 6201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:17 smithi179 bash[23186]: audit 2024-09-21T01:00:16.409540+0000 mon.a (mon.0) 6202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:17 smithi179 bash[23186]: audit 2024-09-21T01:00:16.417276+0000 mon.a (mon.0) 6203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:17 smithi179 bash[23186]: audit 2024-09-21T01:00:17.396475+0000 mon.a (mon.0) 6204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:17 smithi049 bash[23528]: audit 2024-09-21T01:00:16.402961+0000 mon.a (mon.0) 6201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:17 smithi049 bash[23528]: audit 2024-09-21T01:00:16.409540+0000 mon.a (mon.0) 6202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:17 smithi049 bash[23528]: audit 2024-09-21T01:00:16.417276+0000 mon.a (mon.0) 6203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:17 smithi049 bash[23528]: audit 2024-09-21T01:00:17.396475+0000 mon.a (mon.0) 6204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:18 smithi044 bash[22676]: cluster 2024-09-21T01:00:17.384844+0000 mgr.a (mgr.14388) 7173 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:18 smithi044 bash[22676]: audit 2024-09-21T01:00:17.405135+0000 mon.a (mon.0) 6205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:18 smithi044 bash[22676]: audit 2024-09-21T01:00:17.425811+0000 mon.a (mon.0) 6206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:18 smithi179 bash[23186]: cluster 2024-09-21T01:00:17.384844+0000 mgr.a (mgr.14388) 7173 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:18 smithi179 bash[23186]: audit 2024-09-21T01:00:17.405135+0000 mon.a (mon.0) 6205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:18 smithi179 bash[23186]: audit 2024-09-21T01:00:17.425811+0000 mon.a (mon.0) 6206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:18 smithi049 bash[23528]: cluster 2024-09-21T01:00:17.384844+0000 mgr.a (mgr.14388) 7173 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:18.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:18 smithi049 bash[23528]: audit 2024-09-21T01:00:17.405135+0000 mon.a (mon.0) 6205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:18 smithi049 bash[23528]: audit 2024-09-21T01:00:17.425811+0000 mon.a (mon.0) 6206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:20 smithi044 bash[22676]: cluster 2024-09-21T01:00:19.385635+0000 mgr.a (mgr.14388) 7174 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:00:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:20 smithi179 bash[23186]: cluster 2024-09-21T01:00:19.385635+0000 mgr.a (mgr.14388) 7174 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:00:20.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:20 smithi049 bash[23528]: cluster 2024-09-21T01:00:19.385635+0000 mgr.a (mgr.14388) 7174 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:00:20.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:20.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:20.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:21.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:21.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:21.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:21.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:21.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:22 smithi044 bash[22676]: audit 2024-09-21T01:00:21.249681+0000 mgr.a (mgr.14388) 7175 : audit [DBG] from='client.162768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:22 smithi044 bash[22676]: cluster 2024-09-21T01:00:21.387000+0000 mgr.a (mgr.14388) 7176 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:22 smithi179 bash[23186]: audit 2024-09-21T01:00:21.249681+0000 mgr.a (mgr.14388) 7175 : audit [DBG] from='client.162768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:22 smithi179 bash[23186]: cluster 2024-09-21T01:00:21.387000+0000 mgr.a (mgr.14388) 7176 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:22.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:22 smithi049 bash[23528]: audit 2024-09-21T01:00:21.249681+0000 mgr.a (mgr.14388) 7175 : audit [DBG] from='client.162768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:22.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:22 smithi049 bash[23528]: cluster 2024-09-21T01:00:21.387000+0000 mgr.a (mgr.14388) 7176 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:24 smithi044 bash[22676]: cluster 2024-09-21T01:00:23.387867+0000 mgr.a (mgr.14388) 7177 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:00:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:24 smithi179 bash[23186]: cluster 2024-09-21T01:00:23.387867+0000 mgr.a (mgr.14388) 7177 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:00:24.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:24 smithi049 bash[23528]: cluster 2024-09-21T01:00:23.387867+0000 mgr.a (mgr.14388) 7177 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:00:26.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:26.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:26.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:26 smithi044 bash[22676]: cluster 2024-09-21T01:00:25.390048+0000 mgr.a (mgr.14388) 7178 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:00:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:26 smithi179 bash[23186]: cluster 2024-09-21T01:00:25.390048+0000 mgr.a (mgr.14388) 7178 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:00:26.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:26 smithi049 bash[23528]: cluster 2024-09-21T01:00:25.390048+0000 mgr.a (mgr.14388) 7178 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:00:27.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:27.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:27.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:27.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:27.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:27 smithi044 bash[22676]: audit 2024-09-21T01:00:27.038012+0000 mgr.a (mgr.14388) 7179 : audit [DBG] from='client.162843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:27 smithi179 bash[23186]: audit 2024-09-21T01:00:27.038012+0000 mgr.a (mgr.14388) 7179 : audit [DBG] from='client.162843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:27 smithi049 bash[23528]: audit 2024-09-21T01:00:27.038012+0000 mgr.a (mgr.14388) 7179 : audit [DBG] from='client.162843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:28 smithi044 bash[22676]: cluster 2024-09-21T01:00:27.390577+0000 mgr.a (mgr.14388) 7180 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:28 smithi179 bash[23186]: cluster 2024-09-21T01:00:27.390577+0000 mgr.a (mgr.14388) 7180 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:28 smithi049 bash[23528]: cluster 2024-09-21T01:00:27.390577+0000 mgr.a (mgr.14388) 7180 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:30 smithi044 bash[22676]: cluster 2024-09-21T01:00:29.391306+0000 mgr.a (mgr.14388) 7181 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:30 smithi179 bash[23186]: cluster 2024-09-21T01:00:29.391306+0000 mgr.a (mgr.14388) 7181 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:30.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:30 smithi049 bash[23528]: cluster 2024-09-21T01:00:29.391306+0000 mgr.a (mgr.14388) 7181 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:32 smithi044 bash[22676]: cluster 2024-09-21T01:00:31.393585+0000 mgr.a (mgr.14388) 7182 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:32 smithi179 bash[23186]: cluster 2024-09-21T01:00:31.393585+0000 mgr.a (mgr.14388) 7182 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:32.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:32 smithi049 bash[23528]: cluster 2024-09-21T01:00:31.393585+0000 mgr.a (mgr.14388) 7182 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:00:33.600 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22930]: debug 2024-09-21T01:00:33.261+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:00:33.600 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22930]: debug 2024-09-21T01:00:33.273+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:00:33.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22676]: audit 2024-09-21T01:00:32.446313+0000 mon.a (mon.0) 6207 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:33.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22676]: audit 2024-09-21T01:00:32.453236+0000 mon.a (mon.0) 6208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:33.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22676]: audit 2024-09-21T01:00:32.454955+0000 mon.a (mon.0) 6209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:33.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22676]: audit 2024-09-21T01:00:32.467278+0000 mon.a (mon.0) 6210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:33.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22676]: audit 2024-09-21T01:00:32.474536+0000 mon.a (mon.0) 6211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:00:33.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22676]: audit 2024-09-21T01:00:32.476891+0000 mgr.a (mgr.14388) 7183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:00:33.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:33 smithi044 bash[22676]: audit 2024-09-21T01:00:32.851826+0000 mgr.a (mgr.14388) 7184 : audit [DBG] from='client.162927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:33.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:33.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:33.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:33.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:33 smithi179 bash[23186]: audit 2024-09-21T01:00:32.446313+0000 mon.a (mon.0) 6207 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:33 smithi179 bash[23186]: audit 2024-09-21T01:00:32.453236+0000 mon.a (mon.0) 6208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:33 smithi179 bash[23186]: audit 2024-09-21T01:00:32.454955+0000 mon.a (mon.0) 6209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:33 smithi179 bash[23186]: audit 2024-09-21T01:00:32.467278+0000 mon.a (mon.0) 6210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:33 smithi179 bash[23186]: audit 2024-09-21T01:00:32.474536+0000 mon.a (mon.0) 6211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:00:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:33 smithi179 bash[23186]: audit 2024-09-21T01:00:32.476891+0000 mgr.a (mgr.14388) 7183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:00:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:33 smithi179 bash[23186]: audit 2024-09-21T01:00:32.851826+0000 mgr.a (mgr.14388) 7184 : audit [DBG] from='client.162927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:33.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:33 smithi049 bash[23528]: audit 2024-09-21T01:00:32.446313+0000 mon.a (mon.0) 6207 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:33 smithi049 bash[23528]: audit 2024-09-21T01:00:32.453236+0000 mon.a (mon.0) 6208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:33 smithi049 bash[23528]: audit 2024-09-21T01:00:32.454955+0000 mon.a (mon.0) 6209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:33 smithi049 bash[23528]: audit 2024-09-21T01:00:32.467278+0000 mon.a (mon.0) 6210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:33 smithi049 bash[23528]: audit 2024-09-21T01:00:32.474536+0000 mon.a (mon.0) 6211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:33 smithi049 bash[23528]: audit 2024-09-21T01:00:32.476891+0000 mgr.a (mgr.14388) 7183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:00:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:33 smithi049 bash[23528]: audit 2024-09-21T01:00:32.851826+0000 mgr.a (mgr.14388) 7184 : audit [DBG] from='client.162927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:34.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:34 smithi179 bash[23186]: audit 2024-09-21T01:00:33.265398+0000 mgr.a (mgr.14388) 7185 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:00:34.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:34 smithi179 bash[23186]: cephadm 2024-09-21T01:00:33.280143+0000 mgr.a (mgr.14388) 7186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:00:34.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:34 smithi179 bash[23186]: cluster 2024-09-21T01:00:33.395379+0000 mgr.a (mgr.14388) 7187 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:34.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:34 smithi044 bash[22676]: audit 2024-09-21T01:00:33.265398+0000 mgr.a (mgr.14388) 7185 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:00:34.722 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:34 smithi044 bash[22676]: cephadm 2024-09-21T01:00:33.280143+0000 mgr.a (mgr.14388) 7186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:00:34.722 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:34 smithi044 bash[22676]: cluster 2024-09-21T01:00:33.395379+0000 mgr.a (mgr.14388) 7187 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:34.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:34 smithi049 bash[23528]: audit 2024-09-21T01:00:33.265398+0000 mgr.a (mgr.14388) 7185 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:00:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:34 smithi049 bash[23528]: cephadm 2024-09-21T01:00:33.280143+0000 mgr.a (mgr.14388) 7186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:00:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:34 smithi049 bash[23528]: cluster 2024-09-21T01:00:33.395379+0000 mgr.a (mgr.14388) 7187 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:36 smithi179 bash[23186]: audit 2024-09-21T01:00:35.306335+0000 mon.a (mon.0) 6212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:36 smithi179 bash[23186]: audit 2024-09-21T01:00:35.314469+0000 mon.a (mon.0) 6213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:36 smithi179 bash[23186]: audit 2024-09-21T01:00:35.324755+0000 mon.a (mon.0) 6214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:36 smithi179 bash[23186]: cluster 2024-09-21T01:00:35.398636+0000 mgr.a (mgr.14388) 7188 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:36.598 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:36 smithi044 bash[22676]: audit 2024-09-21T01:00:35.306335+0000 mon.a (mon.0) 6212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.598 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:36 smithi044 bash[22676]: audit 2024-09-21T01:00:35.314469+0000 mon.a (mon.0) 6213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.598 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:36 smithi044 bash[22676]: audit 2024-09-21T01:00:35.324755+0000 mon.a (mon.0) 6214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.598 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:36 smithi044 bash[22676]: cluster 2024-09-21T01:00:35.398636+0000 mgr.a (mgr.14388) 7188 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:36.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:36 smithi049 bash[23528]: audit 2024-09-21T01:00:35.306335+0000 mon.a (mon.0) 6212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:36 smithi049 bash[23528]: audit 2024-09-21T01:00:35.314469+0000 mon.a (mon.0) 6213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:36 smithi049 bash[23528]: audit 2024-09-21T01:00:35.324755+0000 mon.a (mon.0) 6214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:36 smithi049 bash[23528]: cluster 2024-09-21T01:00:35.398636+0000 mgr.a (mgr.14388) 7188 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:37 smithi044 bash[22676]: audit 2024-09-21T01:00:36.584063+0000 mon.a (mon.0) 6215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:37 smithi044 bash[22676]: audit 2024-09-21T01:00:36.589810+0000 mon.a (mon.0) 6216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:37 smithi044 bash[22676]: audit 2024-09-21T01:00:36.596783+0000 mon.a (mon.0) 6217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:37 smithi179 bash[23186]: audit 2024-09-21T01:00:36.584063+0000 mon.a (mon.0) 6215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:37 smithi179 bash[23186]: audit 2024-09-21T01:00:36.589810+0000 mon.a (mon.0) 6216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:37 smithi179 bash[23186]: audit 2024-09-21T01:00:36.596783+0000 mon.a (mon.0) 6217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:37 smithi049 bash[23528]: audit 2024-09-21T01:00:36.584063+0000 mon.a (mon.0) 6215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:37 smithi049 bash[23528]: audit 2024-09-21T01:00:36.589810+0000 mon.a (mon.0) 6216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:37 smithi049 bash[23528]: audit 2024-09-21T01:00:36.596783+0000 mon.a (mon.0) 6217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:38 smithi044 bash[22676]: cluster 2024-09-21T01:00:37.399501+0000 mgr.a (mgr.14388) 7189 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:38 smithi044 bash[22676]: audit 2024-09-21T01:00:37.637868+0000 mon.a (mon.0) 6218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:38 smithi044 bash[22676]: audit 2024-09-21T01:00:37.646899+0000 mon.a (mon.0) 6219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:38 smithi044 bash[22676]: audit 2024-09-21T01:00:37.657452+0000 mon.a (mon.0) 6220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:38 smithi179 bash[23186]: cluster 2024-09-21T01:00:37.399501+0000 mgr.a (mgr.14388) 7189 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:38 smithi179 bash[23186]: audit 2024-09-21T01:00:37.637868+0000 mon.a (mon.0) 6218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:38 smithi179 bash[23186]: audit 2024-09-21T01:00:37.646899+0000 mon.a (mon.0) 6219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:38 smithi179 bash[23186]: audit 2024-09-21T01:00:37.657452+0000 mon.a (mon.0) 6220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:39.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:38 smithi049 bash[23528]: cluster 2024-09-21T01:00:37.399501+0000 mgr.a (mgr.14388) 7189 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:38 smithi049 bash[23528]: audit 2024-09-21T01:00:37.637868+0000 mon.a (mon.0) 6218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:38 smithi049 bash[23528]: audit 2024-09-21T01:00:37.646899+0000 mon.a (mon.0) 6219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:38 smithi049 bash[23528]: audit 2024-09-21T01:00:37.657452+0000 mon.a (mon.0) 6220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:39.464 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:39.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:39.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:39.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:39.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:39 smithi044 bash[22676]: audit 2024-09-21T01:00:39.017342+0000 mgr.a (mgr.14388) 7190 : audit [DBG] from='client.163107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:39 smithi179 bash[23186]: audit 2024-09-21T01:00:39.017342+0000 mgr.a (mgr.14388) 7190 : audit [DBG] from='client.163107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:40.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:39 smithi049 bash[23528]: audit 2024-09-21T01:00:39.017342+0000 mgr.a (mgr.14388) 7190 : audit [DBG] from='client.163107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:40 smithi044 bash[22676]: cluster 2024-09-21T01:00:39.400055+0000 mgr.a (mgr.14388) 7191 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:40 smithi179 bash[23186]: cluster 2024-09-21T01:00:39.400055+0000 mgr.a (mgr.14388) 7191 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:41.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:40 smithi049 bash[23528]: cluster 2024-09-21T01:00:39.400055+0000 mgr.a (mgr.14388) 7191 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:42.920 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:42 smithi049 bash[23528]: cluster 2024-09-21T01:00:41.402333+0000 mgr.a (mgr.14388) 7192 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:42 smithi044 bash[22676]: cluster 2024-09-21T01:00:41.402333+0000 mgr.a (mgr.14388) 7192 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:42 smithi179 bash[23186]: cluster 2024-09-21T01:00:41.402333+0000 mgr.a (mgr.14388) 7192 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:44.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:44.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:44.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:44 smithi044 bash[22676]: cluster 2024-09-21T01:00:43.403148+0000 mgr.a (mgr.14388) 7193 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:44 smithi179 bash[23186]: cluster 2024-09-21T01:00:43.403148+0000 mgr.a (mgr.14388) 7193 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:45.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:44 smithi049 bash[23528]: cluster 2024-09-21T01:00:43.403148+0000 mgr.a (mgr.14388) 7193 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:45.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:45.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:45.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:45.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:45.217 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:45 smithi044 bash[22676]: audit 2024-09-21T01:00:44.799436+0000 mgr.a (mgr.14388) 7194 : audit [DBG] from='client.163185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:45 smithi179 bash[23186]: audit 2024-09-21T01:00:44.799436+0000 mgr.a (mgr.14388) 7194 : audit [DBG] from='client.163185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:46.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:45 smithi049 bash[23528]: audit 2024-09-21T01:00:44.799436+0000 mgr.a (mgr.14388) 7194 : audit [DBG] from='client.163185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:46.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:46 smithi049 bash[23528]: cluster 2024-09-21T01:00:45.405981+0000 mgr.a (mgr.14388) 7195 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:46 smithi044 bash[22676]: cluster 2024-09-21T01:00:45.405981+0000 mgr.a (mgr.14388) 7195 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:46 smithi179 bash[23186]: cluster 2024-09-21T01:00:45.405981+0000 mgr.a (mgr.14388) 7195 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:00:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:48 smithi044 bash[22676]: cluster 2024-09-21T01:00:47.406806+0000 mgr.a (mgr.14388) 7196 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:48 smithi179 bash[23186]: cluster 2024-09-21T01:00:47.406806+0000 mgr.a (mgr.14388) 7196 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:49.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:48 smithi049 bash[23528]: cluster 2024-09-21T01:00:47.406806+0000 mgr.a (mgr.14388) 7196 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:50.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:50.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:50 smithi044 bash[22676]: cluster 2024-09-21T01:00:49.407633+0000 mgr.a (mgr.14388) 7197 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:00:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:50 smithi179 bash[23186]: cluster 2024-09-21T01:00:49.407633+0000 mgr.a (mgr.14388) 7197 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:00:51.016 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:50 smithi049 bash[23528]: cluster 2024-09-21T01:00:49.407633+0000 mgr.a (mgr.14388) 7197 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:00:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:51 smithi044 bash[22676]: audit 2024-09-21T01:00:50.556944+0000 mgr.a (mgr.14388) 7198 : audit [DBG] from='client.163263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:51 smithi179 bash[23186]: audit 2024-09-21T01:00:50.556944+0000 mgr.a (mgr.14388) 7198 : audit [DBG] from='client.163263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:52.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:51 smithi049 bash[23528]: audit 2024-09-21T01:00:50.556944+0000 mgr.a (mgr.14388) 7198 : audit [DBG] from='client.163263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:52 smithi044 bash[22676]: cluster 2024-09-21T01:00:51.410566+0000 mgr.a (mgr.14388) 7199 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:52 smithi179 bash[23186]: cluster 2024-09-21T01:00:51.410566+0000 mgr.a (mgr.14388) 7199 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:52 smithi049 bash[23528]: cluster 2024-09-21T01:00:51.410566+0000 mgr.a (mgr.14388) 7199 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:54 smithi179 bash[23186]: cluster 2024-09-21T01:00:53.411385+0000 mgr.a (mgr.14388) 7200 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:54.786 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:54 smithi044 bash[22676]: cluster 2024-09-21T01:00:53.411385+0000 mgr.a (mgr.14388) 7200 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:54 smithi049 bash[23528]: cluster 2024-09-21T01:00:53.411385+0000 mgr.a (mgr.14388) 7200 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:00:56.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:00:56.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:00:56.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:00:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:56 smithi044 bash[22676]: cluster 2024-09-21T01:00:55.413781+0000 mgr.a (mgr.14388) 7201 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:56 smithi044 bash[22676]: audit 2024-09-21T01:00:55.496119+0000 mon.a (mon.0) 6221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:56 smithi044 bash[22676]: audit 2024-09-21T01:00:55.504113+0000 mon.a (mon.0) 6222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:56 smithi044 bash[22676]: audit 2024-09-21T01:00:55.516554+0000 mon.a (mon.0) 6223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:56 smithi179 bash[23186]: cluster 2024-09-21T01:00:55.413781+0000 mgr.a (mgr.14388) 7201 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:56 smithi179 bash[23186]: audit 2024-09-21T01:00:55.496119+0000 mon.a (mon.0) 6221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:56 smithi179 bash[23186]: audit 2024-09-21T01:00:55.504113+0000 mon.a (mon.0) 6222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:56 smithi179 bash[23186]: audit 2024-09-21T01:00:55.516554+0000 mon.a (mon.0) 6223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:56 smithi049 bash[23528]: cluster 2024-09-21T01:00:55.413781+0000 mgr.a (mgr.14388) 7201 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:56.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:56 smithi049 bash[23528]: audit 2024-09-21T01:00:55.496119+0000 mon.a (mon.0) 6221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:56 smithi049 bash[23528]: audit 2024-09-21T01:00:55.504113+0000 mon.a (mon.0) 6222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:56 smithi049 bash[23528]: audit 2024-09-21T01:00:55.516554+0000 mon.a (mon.0) 6223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:56.813 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:00:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:00:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:00:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:00:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:00:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:57 smithi179 bash[23186]: audit 2024-09-21T01:00:56.365435+0000 mgr.a (mgr.14388) 7202 : audit [DBG] from='client.163335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:57 smithi179 bash[23186]: audit 2024-09-21T01:00:56.738056+0000 mon.a (mon.0) 6224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:57 smithi179 bash[23186]: audit 2024-09-21T01:00:56.744057+0000 mon.a (mon.0) 6225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:57 smithi179 bash[23186]: audit 2024-09-21T01:00:56.749819+0000 mon.a (mon.0) 6226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:57 smithi049 bash[23528]: audit 2024-09-21T01:00:56.365435+0000 mgr.a (mgr.14388) 7202 : audit [DBG] from='client.163335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:57 smithi049 bash[23528]: audit 2024-09-21T01:00:56.738056+0000 mon.a (mon.0) 6224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:57 smithi049 bash[23528]: audit 2024-09-21T01:00:56.744057+0000 mon.a (mon.0) 6225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:57 smithi049 bash[23528]: audit 2024-09-21T01:00:56.749819+0000 mon.a (mon.0) 6226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:57 smithi044 bash[22676]: audit 2024-09-21T01:00:56.365435+0000 mgr.a (mgr.14388) 7202 : audit [DBG] from='client.163335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:57 smithi044 bash[22676]: audit 2024-09-21T01:00:56.738056+0000 mon.a (mon.0) 6224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:57 smithi044 bash[22676]: audit 2024-09-21T01:00:56.744057+0000 mon.a (mon.0) 6225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:57 smithi044 bash[22676]: audit 2024-09-21T01:00:56.749819+0000 mon.a (mon.0) 6226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:58 smithi044 bash[22676]: cluster 2024-09-21T01:00:57.414802+0000 mgr.a (mgr.14388) 7203 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:58 smithi044 bash[22676]: audit 2024-09-21T01:00:57.871662+0000 mon.a (mon.0) 6227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:58 smithi044 bash[22676]: audit 2024-09-21T01:00:57.880321+0000 mon.a (mon.0) 6228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:00:58 smithi044 bash[22676]: audit 2024-09-21T01:00:57.890697+0000 mon.a (mon.0) 6229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:58 smithi179 bash[23186]: cluster 2024-09-21T01:00:57.414802+0000 mgr.a (mgr.14388) 7203 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:58 smithi179 bash[23186]: audit 2024-09-21T01:00:57.871662+0000 mon.a (mon.0) 6227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:58 smithi179 bash[23186]: audit 2024-09-21T01:00:57.880321+0000 mon.a (mon.0) 6228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:00:58 smithi179 bash[23186]: audit 2024-09-21T01:00:57.890697+0000 mon.a (mon.0) 6229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:58 smithi049 bash[23528]: cluster 2024-09-21T01:00:57.414802+0000 mgr.a (mgr.14388) 7203 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:00:59.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:58 smithi049 bash[23528]: audit 2024-09-21T01:00:57.871662+0000 mon.a (mon.0) 6227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:58 smithi049 bash[23528]: audit 2024-09-21T01:00:57.880321+0000 mon.a (mon.0) 6228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:00:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:00:58 smithi049 bash[23528]: audit 2024-09-21T01:00:57.890697+0000 mon.a (mon.0) 6229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:00 smithi044 bash[22676]: cluster 2024-09-21T01:00:59.415576+0000 mgr.a (mgr.14388) 7204 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:00 smithi179 bash[23186]: cluster 2024-09-21T01:00:59.415576+0000 mgr.a (mgr.14388) 7204 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:00 smithi049 bash[23528]: cluster 2024-09-21T01:00:59.415576+0000 mgr.a (mgr.14388) 7204 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:01.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:02.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:02 smithi044 bash[22676]: cluster 2024-09-21T01:01:01.417854+0000 mgr.a (mgr.14388) 7205 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:03.242 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:02 smithi049 bash[23528]: cluster 2024-09-21T01:01:01.417854+0000 mgr.a (mgr.14388) 7205 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:02 smithi179 bash[23186]: cluster 2024-09-21T01:01:01.417854+0000 mgr.a (mgr.14388) 7205 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:04.139 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:03 smithi049 bash[23528]: audit 2024-09-21T01:01:02.151419+0000 mgr.a (mgr.14388) 7206 : audit [DBG] from='client.163410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:03 smithi044 bash[22676]: audit 2024-09-21T01:01:02.151419+0000 mgr.a (mgr.14388) 7206 : audit [DBG] from='client.163410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:03 smithi179 bash[23186]: audit 2024-09-21T01:01:02.151419+0000 mgr.a (mgr.14388) 7206 : audit [DBG] from='client.163410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:04 smithi044 bash[22676]: cluster 2024-09-21T01:01:03.418993+0000 mgr.a (mgr.14388) 7207 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:04 smithi179 bash[23186]: cluster 2024-09-21T01:01:03.418993+0000 mgr.a (mgr.14388) 7207 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:04 smithi049 bash[23528]: cluster 2024-09-21T01:01:03.418993+0000 mgr.a (mgr.14388) 7207 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:06 smithi049 bash[23528]: cluster 2024-09-21T01:01:05.421272+0000 mgr.a (mgr.14388) 7208 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:06 smithi044 bash[22676]: cluster 2024-09-21T01:01:05.421272+0000 mgr.a (mgr.14388) 7208 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:06 smithi179 bash[23186]: cluster 2024-09-21T01:01:05.421272+0000 mgr.a (mgr.14388) 7208 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:07.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:07.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:08.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:08.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:08.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:08.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:08.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:08 smithi044 bash[22676]: cluster 2024-09-21T01:01:07.422080+0000 mgr.a (mgr.14388) 7209 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:08 smithi044 bash[22676]: audit 2024-09-21T01:01:07.936611+0000 mgr.a (mgr.14388) 7210 : audit [DBG] from='client.163488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:08 smithi179 bash[23186]: cluster 2024-09-21T01:01:07.422080+0000 mgr.a (mgr.14388) 7209 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:08 smithi179 bash[23186]: audit 2024-09-21T01:01:07.936611+0000 mgr.a (mgr.14388) 7210 : audit [DBG] from='client.163488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:08 smithi049 bash[23528]: cluster 2024-09-21T01:01:07.422080+0000 mgr.a (mgr.14388) 7209 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:08 smithi049 bash[23528]: audit 2024-09-21T01:01:07.936611+0000 mgr.a (mgr.14388) 7210 : audit [DBG] from='client.163488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:10 smithi049 bash[23528]: cluster 2024-09-21T01:01:09.423055+0000 mgr.a (mgr.14388) 7211 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:10 smithi044 bash[22676]: cluster 2024-09-21T01:01:09.423055+0000 mgr.a (mgr.14388) 7211 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:10 smithi179 bash[23186]: cluster 2024-09-21T01:01:09.423055+0000 mgr.a (mgr.14388) 7211 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:12 smithi044 bash[22676]: cluster 2024-09-21T01:01:11.425309+0000 mgr.a (mgr.14388) 7212 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:12 smithi179 bash[23186]: cluster 2024-09-21T01:01:11.425309+0000 mgr.a (mgr.14388) 7212 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:12 smithi049 bash[23528]: cluster 2024-09-21T01:01:11.425309+0000 mgr.a (mgr.14388) 7212 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:13.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:13.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:14.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:14.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:14 smithi044 bash[22676]: cluster 2024-09-21T01:01:13.425847+0000 mgr.a (mgr.14388) 7213 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:14 smithi044 bash[22676]: audit 2024-09-21T01:01:13.696877+0000 mgr.a (mgr.14388) 7214 : audit [DBG] from='client.163566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:14 smithi179 bash[23186]: cluster 2024-09-21T01:01:13.425847+0000 mgr.a (mgr.14388) 7213 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:14 smithi179 bash[23186]: audit 2024-09-21T01:01:13.696877+0000 mgr.a (mgr.14388) 7214 : audit [DBG] from='client.163566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:14 smithi049 bash[23528]: cluster 2024-09-21T01:01:13.425847+0000 mgr.a (mgr.14388) 7213 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:14 smithi049 bash[23528]: audit 2024-09-21T01:01:13.696877+0000 mgr.a (mgr.14388) 7214 : audit [DBG] from='client.163566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:16 smithi044 bash[22676]: cluster 2024-09-21T01:01:15.428201+0000 mgr.a (mgr.14388) 7215 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:16 smithi044 bash[22676]: audit 2024-09-21T01:01:15.726228+0000 mon.a (mon.0) 6230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:16 smithi044 bash[22676]: audit 2024-09-21T01:01:15.735996+0000 mon.a (mon.0) 6231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:16 smithi044 bash[22676]: audit 2024-09-21T01:01:15.748167+0000 mon.a (mon.0) 6232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:16 smithi179 bash[23186]: cluster 2024-09-21T01:01:15.428201+0000 mgr.a (mgr.14388) 7215 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:16 smithi179 bash[23186]: audit 2024-09-21T01:01:15.726228+0000 mon.a (mon.0) 6230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:16 smithi179 bash[23186]: audit 2024-09-21T01:01:15.735996+0000 mon.a (mon.0) 6231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:16 smithi179 bash[23186]: audit 2024-09-21T01:01:15.748167+0000 mon.a (mon.0) 6232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:16 smithi049 bash[23528]: cluster 2024-09-21T01:01:15.428201+0000 mgr.a (mgr.14388) 7215 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:16 smithi049 bash[23528]: audit 2024-09-21T01:01:15.726228+0000 mon.a (mon.0) 6230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:16 smithi049 bash[23528]: audit 2024-09-21T01:01:15.735996+0000 mon.a (mon.0) 6231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:16 smithi049 bash[23528]: audit 2024-09-21T01:01:15.748167+0000 mon.a (mon.0) 6232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.123 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:17 smithi049 bash[23528]: audit 2024-09-21T01:01:16.872783+0000 mon.a (mon.0) 6233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.124 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:17 smithi049 bash[23528]: audit 2024-09-21T01:01:16.877311+0000 mon.a (mon.0) 6234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.124 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:17 smithi049 bash[23528]: audit 2024-09-21T01:01:16.882692+0000 mon.a (mon.0) 6235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:17 smithi044 bash[22676]: audit 2024-09-21T01:01:16.872783+0000 mon.a (mon.0) 6233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:17 smithi044 bash[22676]: audit 2024-09-21T01:01:16.877311+0000 mon.a (mon.0) 6234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:17 smithi044 bash[22676]: audit 2024-09-21T01:01:16.882692+0000 mon.a (mon.0) 6235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:17 smithi179 bash[23186]: audit 2024-09-21T01:01:16.872783+0000 mon.a (mon.0) 6233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:17 smithi179 bash[23186]: audit 2024-09-21T01:01:16.877311+0000 mon.a (mon.0) 6234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:17 smithi179 bash[23186]: audit 2024-09-21T01:01:16.882692+0000 mon.a (mon.0) 6235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:19.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:19.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:18 smithi044 bash[22676]: cluster 2024-09-21T01:01:17.429178+0000 mgr.a (mgr.14388) 7216 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:18 smithi044 bash[22676]: audit 2024-09-21T01:01:18.103260+0000 mon.a (mon.0) 6236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:18 smithi044 bash[22676]: audit 2024-09-21T01:01:18.111808+0000 mon.a (mon.0) 6237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:18 smithi044 bash[22676]: audit 2024-09-21T01:01:18.121837+0000 mon.a (mon.0) 6238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:18 smithi179 bash[23186]: cluster 2024-09-21T01:01:17.429178+0000 mgr.a (mgr.14388) 7216 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:18 smithi179 bash[23186]: audit 2024-09-21T01:01:18.103260+0000 mon.a (mon.0) 6236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:18 smithi179 bash[23186]: audit 2024-09-21T01:01:18.111808+0000 mon.a (mon.0) 6237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:18 smithi179 bash[23186]: audit 2024-09-21T01:01:18.121837+0000 mon.a (mon.0) 6238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:18 smithi049 bash[23528]: cluster 2024-09-21T01:01:17.429178+0000 mgr.a (mgr.14388) 7216 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:18 smithi049 bash[23528]: audit 2024-09-21T01:01:18.103260+0000 mon.a (mon.0) 6236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:18 smithi049 bash[23528]: audit 2024-09-21T01:01:18.111808+0000 mon.a (mon.0) 6237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:18 smithi049 bash[23528]: audit 2024-09-21T01:01:18.121837+0000 mon.a (mon.0) 6238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:19.886 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:20 smithi044 bash[22676]: cluster 2024-09-21T01:01:19.429762+0000 mgr.a (mgr.14388) 7217 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:20 smithi044 bash[22676]: audit 2024-09-21T01:01:19.463869+0000 mgr.a (mgr.14388) 7218 : audit [DBG] from='client.163644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:20 smithi179 bash[23186]: cluster 2024-09-21T01:01:19.429762+0000 mgr.a (mgr.14388) 7217 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:20 smithi179 bash[23186]: audit 2024-09-21T01:01:19.463869+0000 mgr.a (mgr.14388) 7218 : audit [DBG] from='client.163644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:20 smithi049 bash[23528]: cluster 2024-09-21T01:01:19.429762+0000 mgr.a (mgr.14388) 7217 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:20 smithi049 bash[23528]: audit 2024-09-21T01:01:19.463869+0000 mgr.a (mgr.14388) 7218 : audit [DBG] from='client.163644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:22 smithi044 bash[22676]: cluster 2024-09-21T01:01:21.432106+0000 mgr.a (mgr.14388) 7219 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:22 smithi179 bash[23186]: cluster 2024-09-21T01:01:21.432106+0000 mgr.a (mgr.14388) 7219 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:23.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:22 smithi049 bash[23528]: cluster 2024-09-21T01:01:21.432106+0000 mgr.a (mgr.14388) 7219 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:24.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:24.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:24.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:24 smithi044 bash[22676]: cluster 2024-09-21T01:01:23.432893+0000 mgr.a (mgr.14388) 7220 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:25.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:24 smithi049 bash[23528]: cluster 2024-09-21T01:01:23.432893+0000 mgr.a (mgr.14388) 7220 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:24 smithi179 bash[23186]: cluster 2024-09-21T01:01:23.432893+0000 mgr.a (mgr.14388) 7220 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:25.682 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:25.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:25.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:25.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:25.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:26 smithi044 bash[22676]: audit 2024-09-21T01:01:25.226881+0000 mgr.a (mgr.14388) 7221 : audit [DBG] from='client.163719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:26 smithi044 bash[22676]: cluster 2024-09-21T01:01:25.434554+0000 mgr.a (mgr.14388) 7222 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:26 smithi179 bash[23186]: audit 2024-09-21T01:01:25.226881+0000 mgr.a (mgr.14388) 7221 : audit [DBG] from='client.163719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:26 smithi179 bash[23186]: cluster 2024-09-21T01:01:25.434554+0000 mgr.a (mgr.14388) 7222 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:26 smithi049 bash[23528]: audit 2024-09-21T01:01:25.226881+0000 mgr.a (mgr.14388) 7221 : audit [DBG] from='client.163719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:27.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:26 smithi049 bash[23528]: cluster 2024-09-21T01:01:25.434554+0000 mgr.a (mgr.14388) 7222 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:28 smithi044 bash[22676]: cluster 2024-09-21T01:01:27.435440+0000 mgr.a (mgr.14388) 7223 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:01:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:28 smithi179 bash[23186]: cluster 2024-09-21T01:01:27.435440+0000 mgr.a (mgr.14388) 7223 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:01:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:28 smithi049 bash[23528]: cluster 2024-09-21T01:01:27.435440+0000 mgr.a (mgr.14388) 7223 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:01:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:30.685 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:30.685 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:30 smithi044 bash[22676]: cluster 2024-09-21T01:01:29.436234+0000 mgr.a (mgr.14388) 7224 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:01:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:30 smithi179 bash[23186]: cluster 2024-09-21T01:01:29.436234+0000 mgr.a (mgr.14388) 7224 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:01:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:30 smithi049 bash[23528]: cluster 2024-09-21T01:01:29.436234+0000 mgr.a (mgr.14388) 7224 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:01:31.466 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:31.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:31.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:31.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:31.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:31 smithi044 bash[22676]: audit 2024-09-21T01:01:31.020023+0000 mgr.a (mgr.14388) 7225 : audit [DBG] from='client.163797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:31 smithi179 bash[23186]: audit 2024-09-21T01:01:31.020023+0000 mgr.a (mgr.14388) 7225 : audit [DBG] from='client.163797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:32.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:31 smithi049 bash[23528]: audit 2024-09-21T01:01:31.020023+0000 mgr.a (mgr.14388) 7225 : audit [DBG] from='client.163797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:32 smithi044 bash[22676]: cluster 2024-09-21T01:01:31.437539+0000 mgr.a (mgr.14388) 7226 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:01:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:32 smithi179 bash[23186]: cluster 2024-09-21T01:01:31.437539+0000 mgr.a (mgr.14388) 7226 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:01:33.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:32 smithi049 bash[23528]: cluster 2024-09-21T01:01:31.437539+0000 mgr.a (mgr.14388) 7226 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:01:34.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:01:34 smithi044 bash[22930]: debug 2024-09-21T01:01:34.156+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:01:34.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:01:34 smithi044 bash[22930]: debug 2024-09-21T01:01:34.156+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:01:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:33 smithi044 bash[22676]: audit 2024-09-21T01:01:33.344092+0000 mon.a (mon.0) 6239 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:01:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:33 smithi044 bash[22676]: audit 2024-09-21T01:01:33.351745+0000 mon.a (mon.0) 6240 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:01:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:33 smithi044 bash[22676]: audit 2024-09-21T01:01:33.353783+0000 mon.a (mon.0) 6241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:01:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:33 smithi044 bash[22676]: audit 2024-09-21T01:01:33.365382+0000 mon.a (mon.0) 6242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:33 smithi044 bash[22676]: audit 2024-09-21T01:01:33.371847+0000 mon.a (mon.0) 6243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:01:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:33 smithi179 bash[23186]: audit 2024-09-21T01:01:33.344092+0000 mon.a (mon.0) 6239 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:01:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:33 smithi179 bash[23186]: audit 2024-09-21T01:01:33.351745+0000 mon.a (mon.0) 6240 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:01:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:33 smithi179 bash[23186]: audit 2024-09-21T01:01:33.353783+0000 mon.a (mon.0) 6241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:01:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:33 smithi179 bash[23186]: audit 2024-09-21T01:01:33.365382+0000 mon.a (mon.0) 6242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:33 smithi179 bash[23186]: audit 2024-09-21T01:01:33.371847+0000 mon.a (mon.0) 6243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:01:34.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:33 smithi049 bash[23528]: audit 2024-09-21T01:01:33.344092+0000 mon.a (mon.0) 6239 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:01:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:33 smithi049 bash[23528]: audit 2024-09-21T01:01:33.351745+0000 mon.a (mon.0) 6240 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:01:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:33 smithi049 bash[23528]: audit 2024-09-21T01:01:33.353783+0000 mon.a (mon.0) 6241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:01:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:33 smithi049 bash[23528]: audit 2024-09-21T01:01:33.365382+0000 mon.a (mon.0) 6242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:33 smithi049 bash[23528]: audit 2024-09-21T01:01:33.371847+0000 mon.a (mon.0) 6243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:01:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:34 smithi044 bash[22676]: audit 2024-09-21T01:01:33.374447+0000 mgr.a (mgr.14388) 7227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:01:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:34 smithi044 bash[22676]: cluster 2024-09-21T01:01:33.438575+0000 mgr.a (mgr.14388) 7228 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:01:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:34 smithi179 bash[23186]: audit 2024-09-21T01:01:33.374447+0000 mgr.a (mgr.14388) 7227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:01:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:34 smithi179 bash[23186]: cluster 2024-09-21T01:01:33.438575+0000 mgr.a (mgr.14388) 7228 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:01:35.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:34 smithi049 bash[23528]: audit 2024-09-21T01:01:33.374447+0000 mgr.a (mgr.14388) 7227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:01:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:34 smithi049 bash[23528]: cluster 2024-09-21T01:01:33.438575+0000 mgr.a (mgr.14388) 7228 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:01:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:35 smithi044 bash[22676]: audit 2024-09-21T01:01:34.159531+0000 mgr.a (mgr.14388) 7229 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:01:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:35 smithi044 bash[22676]: cephadm 2024-09-21T01:01:34.160898+0000 mgr.a (mgr.14388) 7230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:01:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:35 smithi179 bash[23186]: audit 2024-09-21T01:01:34.159531+0000 mgr.a (mgr.14388) 7229 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:01:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:35 smithi179 bash[23186]: cephadm 2024-09-21T01:01:34.160898+0000 mgr.a (mgr.14388) 7230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:01:36.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:35 smithi049 bash[23528]: audit 2024-09-21T01:01:34.159531+0000 mgr.a (mgr.14388) 7229 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:01:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:35 smithi049 bash[23528]: cephadm 2024-09-21T01:01:34.160898+0000 mgr.a (mgr.14388) 7230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:01:36.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:36.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:36.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:37.230 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:37.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:37.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:37.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:37.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:36 smithi044 bash[22676]: cluster 2024-09-21T01:01:35.440988+0000 mgr.a (mgr.14388) 7231 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:36 smithi044 bash[22676]: audit 2024-09-21T01:01:35.955361+0000 mon.a (mon.0) 6244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:36 smithi044 bash[22676]: audit 2024-09-21T01:01:35.966343+0000 mon.a (mon.0) 6245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:36 smithi044 bash[22676]: audit 2024-09-21T01:01:35.978379+0000 mon.a (mon.0) 6246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:36 smithi179 bash[23186]: cluster 2024-09-21T01:01:35.440988+0000 mgr.a (mgr.14388) 7231 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:36 smithi179 bash[23186]: audit 2024-09-21T01:01:35.955361+0000 mon.a (mon.0) 6244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:36 smithi179 bash[23186]: audit 2024-09-21T01:01:35.966343+0000 mon.a (mon.0) 6245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:36 smithi179 bash[23186]: audit 2024-09-21T01:01:35.978379+0000 mon.a (mon.0) 6246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:36 smithi049 bash[23528]: cluster 2024-09-21T01:01:35.440988+0000 mgr.a (mgr.14388) 7231 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:36 smithi049 bash[23528]: audit 2024-09-21T01:01:35.955361+0000 mon.a (mon.0) 6244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:36 smithi049 bash[23528]: audit 2024-09-21T01:01:35.966343+0000 mon.a (mon.0) 6245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:36 smithi049 bash[23528]: audit 2024-09-21T01:01:35.978379+0000 mon.a (mon.0) 6246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:38 smithi044 bash[22676]: audit 2024-09-21T01:01:36.795755+0000 mgr.a (mgr.14388) 7232 : audit [DBG] from='client.163980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:38 smithi044 bash[22676]: audit 2024-09-21T01:01:37.013271+0000 mon.a (mon.0) 6247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:38 smithi044 bash[22676]: audit 2024-09-21T01:01:37.018594+0000 mon.a (mon.0) 6248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:38 smithi044 bash[22676]: audit 2024-09-21T01:01:37.025065+0000 mon.a (mon.0) 6249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:38 smithi049 bash[23528]: audit 2024-09-21T01:01:36.795755+0000 mgr.a (mgr.14388) 7232 : audit [DBG] from='client.163980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:38 smithi049 bash[23528]: audit 2024-09-21T01:01:37.013271+0000 mon.a (mon.0) 6247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:38 smithi049 bash[23528]: audit 2024-09-21T01:01:37.018594+0000 mon.a (mon.0) 6248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:38 smithi049 bash[23528]: audit 2024-09-21T01:01:37.025065+0000 mon.a (mon.0) 6249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:38 smithi179 bash[23186]: audit 2024-09-21T01:01:36.795755+0000 mgr.a (mgr.14388) 7232 : audit [DBG] from='client.163980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:38 smithi179 bash[23186]: audit 2024-09-21T01:01:37.013271+0000 mon.a (mon.0) 6247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:38 smithi179 bash[23186]: audit 2024-09-21T01:01:37.018594+0000 mon.a (mon.0) 6248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:38 smithi179 bash[23186]: audit 2024-09-21T01:01:37.025065+0000 mon.a (mon.0) 6249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:39 smithi049 bash[23528]: cluster 2024-09-21T01:01:37.442027+0000 mgr.a (mgr.14388) 7233 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:39 smithi049 bash[23528]: audit 2024-09-21T01:01:38.337800+0000 mon.a (mon.0) 6250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:39 smithi049 bash[23528]: audit 2024-09-21T01:01:38.345350+0000 mon.a (mon.0) 6251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:39 smithi049 bash[23528]: audit 2024-09-21T01:01:38.357640+0000 mon.a (mon.0) 6252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:39 smithi044 bash[22676]: cluster 2024-09-21T01:01:37.442027+0000 mgr.a (mgr.14388) 7233 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:39 smithi044 bash[22676]: audit 2024-09-21T01:01:38.337800+0000 mon.a (mon.0) 6250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:39 smithi044 bash[22676]: audit 2024-09-21T01:01:38.345350+0000 mon.a (mon.0) 6251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:39 smithi044 bash[22676]: audit 2024-09-21T01:01:38.357640+0000 mon.a (mon.0) 6252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:39 smithi179 bash[23186]: cluster 2024-09-21T01:01:37.442027+0000 mgr.a (mgr.14388) 7233 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:39 smithi179 bash[23186]: audit 2024-09-21T01:01:38.337800+0000 mon.a (mon.0) 6250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:39 smithi179 bash[23186]: audit 2024-09-21T01:01:38.345350+0000 mon.a (mon.0) 6251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:39 smithi179 bash[23186]: audit 2024-09-21T01:01:38.357640+0000 mon.a (mon.0) 6252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:41 smithi049 bash[23528]: cluster 2024-09-21T01:01:39.443006+0000 mgr.a (mgr.14388) 7234 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:41 smithi044 bash[22676]: cluster 2024-09-21T01:01:39.443006+0000 mgr.a (mgr.14388) 7234 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:41 smithi179 bash[23186]: cluster 2024-09-21T01:01:39.443006+0000 mgr.a (mgr.14388) 7234 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:43.020 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:43 smithi049 bash[23528]: cluster 2024-09-21T01:01:41.445406+0000 mgr.a (mgr.14388) 7235 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:01:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:43 smithi044 bash[22676]: cluster 2024-09-21T01:01:41.445406+0000 mgr.a (mgr.14388) 7235 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:01:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:43 smithi179 bash[23186]: cluster 2024-09-21T01:01:41.445406+0000 mgr.a (mgr.14388) 7235 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:01:44.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:44 smithi049 bash[23528]: audit 2024-09-21T01:01:42.573164+0000 mgr.a (mgr.14388) 7236 : audit [DBG] from='client.164055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:44 smithi044 bash[22676]: audit 2024-09-21T01:01:42.573164+0000 mgr.a (mgr.14388) 7236 : audit [DBG] from='client.164055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:44 smithi179 bash[23186]: audit 2024-09-21T01:01:42.573164+0000 mgr.a (mgr.14388) 7236 : audit [DBG] from='client.164055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:45 smithi049 bash[23528]: cluster 2024-09-21T01:01:43.446346+0000 mgr.a (mgr.14388) 7237 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:45 smithi044 bash[22676]: cluster 2024-09-21T01:01:43.446346+0000 mgr.a (mgr.14388) 7237 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:45 smithi179 bash[23186]: cluster 2024-09-21T01:01:43.446346+0000 mgr.a (mgr.14388) 7237 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:47.412 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:47 smithi049 bash[23528]: cluster 2024-09-21T01:01:45.448629+0000 mgr.a (mgr.14388) 7238 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:47 smithi044 bash[22676]: cluster 2024-09-21T01:01:45.448629+0000 mgr.a (mgr.14388) 7238 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:47 smithi179 bash[23186]: cluster 2024-09-21T01:01:45.448629+0000 mgr.a (mgr.14388) 7238 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:01:48.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:48.022 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:48.817 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:48.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:48.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:48.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:48.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:49 smithi044 bash[22676]: cluster 2024-09-21T01:01:47.449449+0000 mgr.a (mgr.14388) 7239 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:49 smithi179 bash[23186]: cluster 2024-09-21T01:01:47.449449+0000 mgr.a (mgr.14388) 7239 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:49 smithi049 bash[23528]: cluster 2024-09-21T01:01:47.449449+0000 mgr.a (mgr.14388) 7239 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:50 smithi044 bash[22676]: audit 2024-09-21T01:01:48.365007+0000 mgr.a (mgr.14388) 7240 : audit [DBG] from='client.164133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:50 smithi179 bash[23186]: audit 2024-09-21T01:01:48.365007+0000 mgr.a (mgr.14388) 7240 : audit [DBG] from='client.164133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:50.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:50 smithi049 bash[23528]: audit 2024-09-21T01:01:48.365007+0000 mgr.a (mgr.14388) 7240 : audit [DBG] from='client.164133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:51 smithi044 bash[22676]: cluster 2024-09-21T01:01:49.450465+0000 mgr.a (mgr.14388) 7241 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:51 smithi179 bash[23186]: cluster 2024-09-21T01:01:49.450465+0000 mgr.a (mgr.14388) 7241 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:51 smithi049 bash[23528]: cluster 2024-09-21T01:01:49.450465+0000 mgr.a (mgr.14388) 7241 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:53 smithi044 bash[22676]: cluster 2024-09-21T01:01:51.452743+0000 mgr.a (mgr.14388) 7242 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:53 smithi179 bash[23186]: cluster 2024-09-21T01:01:51.452743+0000 mgr.a (mgr.14388) 7242 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:53.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:53 smithi049 bash[23528]: cluster 2024-09-21T01:01:51.452743+0000 mgr.a (mgr.14388) 7242 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:53.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:53.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:53.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:54.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:01:54.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:01:54.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:01:54.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:01:54.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:01:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:55 smithi044 bash[22676]: cluster 2024-09-21T01:01:53.453656+0000 mgr.a (mgr.14388) 7243 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:55 smithi179 bash[23186]: cluster 2024-09-21T01:01:53.453656+0000 mgr.a (mgr.14388) 7243 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:55 smithi049 bash[23528]: cluster 2024-09-21T01:01:53.453656+0000 mgr.a (mgr.14388) 7243 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:56 smithi044 bash[22676]: audit 2024-09-21T01:01:54.152769+0000 mgr.a (mgr.14388) 7244 : audit [DBG] from='client.164211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:56 smithi179 bash[23186]: audit 2024-09-21T01:01:54.152769+0000 mgr.a (mgr.14388) 7244 : audit [DBG] from='client.164211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:56.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:56 smithi049 bash[23528]: audit 2024-09-21T01:01:54.152769+0000 mgr.a (mgr.14388) 7244 : audit [DBG] from='client.164211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:57.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:57 smithi044 bash[22676]: cluster 2024-09-21T01:01:55.456516+0000 mgr.a (mgr.14388) 7245 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:57.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:57 smithi044 bash[22676]: audit 2024-09-21T01:01:56.184328+0000 mon.a (mon.0) 6253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:57 smithi044 bash[22676]: audit 2024-09-21T01:01:56.192733+0000 mon.a (mon.0) 6254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:57 smithi044 bash[22676]: audit 2024-09-21T01:01:56.203747+0000 mon.a (mon.0) 6255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.389 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:57 smithi179 bash[23186]: cluster 2024-09-21T01:01:55.456516+0000 mgr.a (mgr.14388) 7245 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:57.389 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:57 smithi179 bash[23186]: audit 2024-09-21T01:01:56.184328+0000 mon.a (mon.0) 6253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.389 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:57 smithi179 bash[23186]: audit 2024-09-21T01:01:56.192733+0000 mon.a (mon.0) 6254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.389 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:57 smithi179 bash[23186]: audit 2024-09-21T01:01:56.203747+0000 mon.a (mon.0) 6255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:57 smithi049 bash[23528]: cluster 2024-09-21T01:01:55.456516+0000 mgr.a (mgr.14388) 7245 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:01:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:57 smithi049 bash[23528]: audit 2024-09-21T01:01:56.184328+0000 mon.a (mon.0) 6253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:57 smithi049 bash[23528]: audit 2024-09-21T01:01:56.192733+0000 mon.a (mon.0) 6254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:57 smithi049 bash[23528]: audit 2024-09-21T01:01:56.203747+0000 mon.a (mon.0) 6255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:58 smithi044 bash[22676]: audit 2024-09-21T01:01:57.223354+0000 mon.a (mon.0) 6256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:58 smithi044 bash[22676]: audit 2024-09-21T01:01:57.229699+0000 mon.a (mon.0) 6257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:58 smithi044 bash[22676]: audit 2024-09-21T01:01:57.238357+0000 mon.a (mon.0) 6258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:58 smithi044 bash[22676]: cluster 2024-09-21T01:01:57.457096+0000 mgr.a (mgr.14388) 7246 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:58 smithi179 bash[23186]: audit 2024-09-21T01:01:57.223354+0000 mon.a (mon.0) 6256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:58 smithi179 bash[23186]: audit 2024-09-21T01:01:57.229699+0000 mon.a (mon.0) 6257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:58 smithi179 bash[23186]: audit 2024-09-21T01:01:57.238357+0000 mon.a (mon.0) 6258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:58 smithi179 bash[23186]: cluster 2024-09-21T01:01:57.457096+0000 mgr.a (mgr.14388) 7246 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:58 smithi049 bash[23528]: audit 2024-09-21T01:01:57.223354+0000 mon.a (mon.0) 6256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:58 smithi049 bash[23528]: audit 2024-09-21T01:01:57.229699+0000 mon.a (mon.0) 6257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:58 smithi049 bash[23528]: audit 2024-09-21T01:01:57.238357+0000 mon.a (mon.0) 6258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:58.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:58 smithi049 bash[23528]: cluster 2024-09-21T01:01:57.457096+0000 mgr.a (mgr.14388) 7246 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:01:59.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:01:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:01:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:01:59.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:59 smithi049 bash[23528]: audit 2024-09-21T01:01:58.551475+0000 mon.a (mon.0) 6259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:59 smithi049 bash[23528]: audit 2024-09-21T01:01:58.561603+0000 mon.a (mon.0) 6260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:01:59 smithi049 bash[23528]: audit 2024-09-21T01:01:58.573325+0000 mon.a (mon.0) 6261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:59 smithi044 bash[22676]: audit 2024-09-21T01:01:58.551475+0000 mon.a (mon.0) 6259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:59 smithi044 bash[22676]: audit 2024-09-21T01:01:58.561603+0000 mon.a (mon.0) 6260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:01:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:01:59 smithi044 bash[22676]: audit 2024-09-21T01:01:58.573325+0000 mon.a (mon.0) 6261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:59 smithi179 bash[23186]: audit 2024-09-21T01:01:58.551475+0000 mon.a (mon.0) 6259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:59 smithi179 bash[23186]: audit 2024-09-21T01:01:58.561603+0000 mon.a (mon.0) 6260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:01:59 smithi179 bash[23186]: audit 2024-09-21T01:01:58.573325+0000 mon.a (mon.0) 6261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:00.348 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:00 smithi044 bash[22676]: cluster 2024-09-21T01:01:59.457994+0000 mgr.a (mgr.14388) 7247 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:00 smithi044 bash[22676]: audit 2024-09-21T01:01:59.922775+0000 mgr.a (mgr.14388) 7248 : audit [DBG] from='client.164286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:00 smithi179 bash[23186]: cluster 2024-09-21T01:01:59.457994+0000 mgr.a (mgr.14388) 7247 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:00 smithi179 bash[23186]: audit 2024-09-21T01:01:59.922775+0000 mgr.a (mgr.14388) 7248 : audit [DBG] from='client.164286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:01.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:00 smithi049 bash[23528]: cluster 2024-09-21T01:01:59.457994+0000 mgr.a (mgr.14388) 7247 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:00 smithi049 bash[23528]: audit 2024-09-21T01:01:59.922775+0000 mgr.a (mgr.14388) 7248 : audit [DBG] from='client.164286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:02 smithi044 bash[22676]: cluster 2024-09-21T01:02:01.460908+0000 mgr.a (mgr.14388) 7249 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:02 smithi179 bash[23186]: cluster 2024-09-21T01:02:01.460908+0000 mgr.a (mgr.14388) 7249 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:03.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:02 smithi049 bash[23528]: cluster 2024-09-21T01:02:01.460908+0000 mgr.a (mgr.14388) 7249 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:04.846 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:04 smithi049 bash[23528]: cluster 2024-09-21T01:02:03.461948+0000 mgr.a (mgr.14388) 7250 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:02:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:04 smithi044 bash[22676]: cluster 2024-09-21T01:02:03.461948+0000 mgr.a (mgr.14388) 7250 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:02:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:04 smithi179 bash[23186]: cluster 2024-09-21T01:02:03.461948+0000 mgr.a (mgr.14388) 7250 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:02:05.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:05.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:05.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:06.120 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:06.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:06.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:06.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:06.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:06 smithi044 bash[22676]: cluster 2024-09-21T01:02:05.463015+0000 mgr.a (mgr.14388) 7251 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:06 smithi044 bash[22676]: audit 2024-09-21T01:02:05.681717+0000 mgr.a (mgr.14388) 7252 : audit [DBG] from='client.164361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:06 smithi179 bash[23186]: cluster 2024-09-21T01:02:05.463015+0000 mgr.a (mgr.14388) 7251 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:06 smithi179 bash[23186]: audit 2024-09-21T01:02:05.681717+0000 mgr.a (mgr.14388) 7252 : audit [DBG] from='client.164361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:06 smithi049 bash[23528]: cluster 2024-09-21T01:02:05.463015+0000 mgr.a (mgr.14388) 7251 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:07.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:06 smithi049 bash[23528]: audit 2024-09-21T01:02:05.681717+0000 mgr.a (mgr.14388) 7252 : audit [DBG] from='client.164361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:08 smithi044 bash[22676]: cluster 2024-09-21T01:02:07.463909+0000 mgr.a (mgr.14388) 7253 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:02:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:08 smithi179 bash[23186]: cluster 2024-09-21T01:02:07.463909+0000 mgr.a (mgr.14388) 7253 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:02:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:08 smithi049 bash[23528]: cluster 2024-09-21T01:02:07.463909+0000 mgr.a (mgr.14388) 7253 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:02:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:10 smithi044 bash[22676]: cluster 2024-09-21T01:02:09.464705+0000 mgr.a (mgr.14388) 7254 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:02:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:10 smithi179 bash[23186]: cluster 2024-09-21T01:02:09.464705+0000 mgr.a (mgr.14388) 7254 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:02:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:10 smithi049 bash[23528]: cluster 2024-09-21T01:02:09.464705+0000 mgr.a (mgr.14388) 7254 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:02:11.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:11.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:11.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:11.866 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:12 smithi044 bash[22676]: audit 2024-09-21T01:02:11.451032+0000 mgr.a (mgr.14388) 7255 : audit [DBG] from='client.164436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:12 smithi044 bash[22676]: cluster 2024-09-21T01:02:11.470623+0000 mgr.a (mgr.14388) 7256 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:12 smithi179 bash[23186]: audit 2024-09-21T01:02:11.451032+0000 mgr.a (mgr.14388) 7255 : audit [DBG] from='client.164436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:12 smithi179 bash[23186]: cluster 2024-09-21T01:02:11.470623+0000 mgr.a (mgr.14388) 7256 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:13.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:12 smithi049 bash[23528]: audit 2024-09-21T01:02:11.451032+0000 mgr.a (mgr.14388) 7255 : audit [DBG] from='client.164436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:12 smithi049 bash[23528]: cluster 2024-09-21T01:02:11.470623+0000 mgr.a (mgr.14388) 7256 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:14.886 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:14 smithi179 bash[23186]: cluster 2024-09-21T01:02:13.471781+0000 mgr.a (mgr.14388) 7257 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:14 smithi044 bash[22676]: cluster 2024-09-21T01:02:13.471781+0000 mgr.a (mgr.14388) 7257 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:15.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:14 smithi049 bash[23528]: cluster 2024-09-21T01:02:13.471781+0000 mgr.a (mgr.14388) 7257 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:16 smithi179 bash[23186]: cluster 2024-09-21T01:02:15.474134+0000 mgr.a (mgr.14388) 7258 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:16 smithi179 bash[23186]: audit 2024-09-21T01:02:16.418646+0000 mon.a (mon.0) 6262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:16 smithi179 bash[23186]: audit 2024-09-21T01:02:16.428772+0000 mon.a (mon.0) 6263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:16 smithi179 bash[23186]: audit 2024-09-21T01:02:16.438702+0000 mon.a (mon.0) 6264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:16 smithi044 bash[22676]: cluster 2024-09-21T01:02:15.474134+0000 mgr.a (mgr.14388) 7258 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:16 smithi044 bash[22676]: audit 2024-09-21T01:02:16.418646+0000 mon.a (mon.0) 6262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:16 smithi044 bash[22676]: audit 2024-09-21T01:02:16.428772+0000 mon.a (mon.0) 6263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:16 smithi044 bash[22676]: audit 2024-09-21T01:02:16.438702+0000 mon.a (mon.0) 6264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:16 smithi049 bash[23528]: cluster 2024-09-21T01:02:15.474134+0000 mgr.a (mgr.14388) 7258 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:16 smithi049 bash[23528]: audit 2024-09-21T01:02:16.418646+0000 mon.a (mon.0) 6262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:16 smithi049 bash[23528]: audit 2024-09-21T01:02:16.428772+0000 mon.a (mon.0) 6263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:16 smithi049 bash[23528]: audit 2024-09-21T01:02:16.438702+0000 mon.a (mon.0) 6264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:17.663 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:17.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:17.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:17.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:17.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:18 smithi044 bash[22676]: audit 2024-09-21T01:02:17.215902+0000 mgr.a (mgr.14388) 7259 : audit [DBG] from='client.80656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:18 smithi044 bash[22676]: audit 2024-09-21T01:02:17.373973+0000 mon.a (mon.0) 6265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:18 smithi044 bash[22676]: audit 2024-09-21T01:02:17.380043+0000 mon.a (mon.0) 6266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:18 smithi044 bash[22676]: audit 2024-09-21T01:02:17.388079+0000 mon.a (mon.0) 6267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:18 smithi044 bash[22676]: cluster 2024-09-21T01:02:17.474787+0000 mgr.a (mgr.14388) 7260 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:18 smithi179 bash[23186]: audit 2024-09-21T01:02:17.215902+0000 mgr.a (mgr.14388) 7259 : audit [DBG] from='client.80656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:18 smithi179 bash[23186]: audit 2024-09-21T01:02:17.373973+0000 mon.a (mon.0) 6265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:18 smithi179 bash[23186]: audit 2024-09-21T01:02:17.380043+0000 mon.a (mon.0) 6266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:18 smithi179 bash[23186]: audit 2024-09-21T01:02:17.388079+0000 mon.a (mon.0) 6267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:18 smithi179 bash[23186]: cluster 2024-09-21T01:02:17.474787+0000 mgr.a (mgr.14388) 7260 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:18 smithi049 bash[23528]: audit 2024-09-21T01:02:17.215902+0000 mgr.a (mgr.14388) 7259 : audit [DBG] from='client.80656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:18 smithi049 bash[23528]: audit 2024-09-21T01:02:17.373973+0000 mon.a (mon.0) 6265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:18 smithi049 bash[23528]: audit 2024-09-21T01:02:17.380043+0000 mon.a (mon.0) 6266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:18 smithi049 bash[23528]: audit 2024-09-21T01:02:17.388079+0000 mon.a (mon.0) 6267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:18 smithi049 bash[23528]: cluster 2024-09-21T01:02:17.474787+0000 mgr.a (mgr.14388) 7260 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:19 smithi049 bash[23528]: audit 2024-09-21T01:02:18.795151+0000 mon.a (mon.0) 6268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:19 smithi049 bash[23528]: audit 2024-09-21T01:02:18.804955+0000 mon.a (mon.0) 6269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:19 smithi049 bash[23528]: audit 2024-09-21T01:02:18.816769+0000 mon.a (mon.0) 6270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:19 smithi044 bash[22676]: audit 2024-09-21T01:02:18.795151+0000 mon.a (mon.0) 6268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:19 smithi044 bash[22676]: audit 2024-09-21T01:02:18.804955+0000 mon.a (mon.0) 6269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:19 smithi044 bash[22676]: audit 2024-09-21T01:02:18.816769+0000 mon.a (mon.0) 6270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:19 smithi179 bash[23186]: audit 2024-09-21T01:02:18.795151+0000 mon.a (mon.0) 6268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:19 smithi179 bash[23186]: audit 2024-09-21T01:02:18.804955+0000 mon.a (mon.0) 6269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:19 smithi179 bash[23186]: audit 2024-09-21T01:02:18.816769+0000 mon.a (mon.0) 6270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:20 smithi044 bash[22676]: cluster 2024-09-21T01:02:19.475682+0000 mgr.a (mgr.14388) 7261 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:20 smithi179 bash[23186]: cluster 2024-09-21T01:02:19.475682+0000 mgr.a (mgr.14388) 7261 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:21.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:20 smithi049 bash[23528]: cluster 2024-09-21T01:02:19.475682+0000 mgr.a (mgr.14388) 7261 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:22.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:22.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:22.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:22 smithi044 bash[22676]: cluster 2024-09-21T01:02:21.477935+0000 mgr.a (mgr.14388) 7262 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:22 smithi179 bash[23186]: cluster 2024-09-21T01:02:21.477935+0000 mgr.a (mgr.14388) 7262 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:22 smithi049 bash[23528]: cluster 2024-09-21T01:02:21.477935+0000 mgr.a (mgr.14388) 7262 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:23.421 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:23 smithi044 bash[22676]: audit 2024-09-21T01:02:22.996033+0000 mgr.a (mgr.14388) 7263 : audit [DBG] from='client.164589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:23 smithi179 bash[23186]: audit 2024-09-21T01:02:22.996033+0000 mgr.a (mgr.14388) 7263 : audit [DBG] from='client.164589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:24.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:23 smithi049 bash[23528]: audit 2024-09-21T01:02:22.996033+0000 mgr.a (mgr.14388) 7263 : audit [DBG] from='client.164589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:25.106 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:24 smithi049 bash[23528]: cluster 2024-09-21T01:02:23.478644+0000 mgr.a (mgr.14388) 7264 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:24 smithi044 bash[22676]: cluster 2024-09-21T01:02:23.478644+0000 mgr.a (mgr.14388) 7264 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:25.249 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:24 smithi179 bash[23186]: cluster 2024-09-21T01:02:23.478644+0000 mgr.a (mgr.14388) 7264 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:27.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:26 smithi049 bash[23528]: cluster 2024-09-21T01:02:25.480792+0000 mgr.a (mgr.14388) 7265 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:26 smithi044 bash[22676]: cluster 2024-09-21T01:02:25.480792+0000 mgr.a (mgr.14388) 7265 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:26 smithi179 bash[23186]: cluster 2024-09-21T01:02:25.480792+0000 mgr.a (mgr.14388) 7265 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:29.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:29.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:29.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:29.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:29.190 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:28 smithi044 bash[22676]: cluster 2024-09-21T01:02:27.481590+0000 mgr.a (mgr.14388) 7266 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:28 smithi179 bash[23186]: cluster 2024-09-21T01:02:27.481590+0000 mgr.a (mgr.14388) 7266 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:29.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:28 smithi049 bash[23528]: cluster 2024-09-21T01:02:27.481590+0000 mgr.a (mgr.14388) 7266 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:29 smithi044 bash[22676]: audit 2024-09-21T01:02:28.756886+0000 mgr.a (mgr.14388) 7267 : audit [DBG] from='client.164664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:29 smithi179 bash[23186]: audit 2024-09-21T01:02:28.756886+0000 mgr.a (mgr.14388) 7267 : audit [DBG] from='client.164664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:30.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:29 smithi049 bash[23528]: audit 2024-09-21T01:02:28.756886+0000 mgr.a (mgr.14388) 7267 : audit [DBG] from='client.164664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:30 smithi044 bash[22676]: cluster 2024-09-21T01:02:29.482537+0000 mgr.a (mgr.14388) 7268 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:30 smithi179 bash[23186]: cluster 2024-09-21T01:02:29.482537+0000 mgr.a (mgr.14388) 7268 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:31.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:30 smithi049 bash[23528]: cluster 2024-09-21T01:02:29.482537+0000 mgr.a (mgr.14388) 7268 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:33.231 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:32 smithi049 bash[23528]: cluster 2024-09-21T01:02:31.484875+0000 mgr.a (mgr.14388) 7269 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:32 smithi044 bash[22676]: cluster 2024-09-21T01:02:31.484875+0000 mgr.a (mgr.14388) 7269 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:32 smithi179 bash[23186]: cluster 2024-09-21T01:02:31.484875+0000 mgr.a (mgr.14388) 7269 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:34.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:34.192 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:34.192 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:34.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:34.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:34.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:34.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:34.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: cluster 2024-09-21T01:02:33.485836+0000 mgr.a (mgr.14388) 7270 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.215860+0000 mon.a (mon.0) 6271 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.807848+0000 mon.a (mon.0) 6272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.813283+0000 mon.a (mon.0) 6273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.820148+0000 mon.a (mon.0) 6274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.826372+0000 mon.a (mon.0) 6275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.827675+0000 mon.a (mon.0) 6276 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.828505+0000 mon.a (mon.0) 6277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.834931+0000 mon.a (mon.0) 6278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:34 smithi179 bash[23186]: audit 2024-09-21T01:02:34.838022+0000 mon.a (mon.0) 6279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:02:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: cluster 2024-09-21T01:02:33.485836+0000 mgr.a (mgr.14388) 7270 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.215860+0000 mon.a (mon.0) 6271 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.807848+0000 mon.a (mon.0) 6272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.813283+0000 mon.a (mon.0) 6273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.820148+0000 mon.a (mon.0) 6274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.826372+0000 mon.a (mon.0) 6275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.827675+0000 mon.a (mon.0) 6276 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.828505+0000 mon.a (mon.0) 6277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.834931+0000 mon.a (mon.0) 6278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:34 smithi044 bash[22676]: audit 2024-09-21T01:02:34.838022+0000 mon.a (mon.0) 6279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: cluster 2024-09-21T01:02:33.485836+0000 mgr.a (mgr.14388) 7270 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.215860+0000 mon.a (mon.0) 6271 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.807848+0000 mon.a (mon.0) 6272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.813283+0000 mon.a (mon.0) 6273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.820148+0000 mon.a (mon.0) 6274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.826372+0000 mon.a (mon.0) 6275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.827675+0000 mon.a (mon.0) 6276 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.828505+0000 mon.a (mon.0) 6277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:02:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.834931+0000 mon.a (mon.0) 6278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:34 smithi049 bash[23528]: audit 2024-09-21T01:02:34.838022+0000 mon.a (mon.0) 6279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:02:35.959 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:02:35 smithi044 bash[22930]: debug 2024-09-21T01:02:35.679+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:02:35.959 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:02:35 smithi044 bash[22930]: debug 2024-09-21T01:02:35.679+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:02:35.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:35 smithi044 bash[22676]: audit 2024-09-21T01:02:34.531858+0000 mgr.a (mgr.14388) 7271 : audit [DBG] from='client.164742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:35.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:35 smithi044 bash[22676]: audit 2024-09-21T01:02:34.839698+0000 mgr.a (mgr.14388) 7272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:02:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:35 smithi179 bash[23186]: audit 2024-09-21T01:02:34.531858+0000 mgr.a (mgr.14388) 7271 : audit [DBG] from='client.164742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:35 smithi179 bash[23186]: audit 2024-09-21T01:02:34.839698+0000 mgr.a (mgr.14388) 7272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:02:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:35 smithi049 bash[23528]: audit 2024-09-21T01:02:34.531858+0000 mgr.a (mgr.14388) 7271 : audit [DBG] from='client.164742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:35 smithi049 bash[23528]: audit 2024-09-21T01:02:34.839698+0000 mgr.a (mgr.14388) 7272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:02:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:36 smithi179 bash[23186]: cluster 2024-09-21T01:02:35.487136+0000 mgr.a (mgr.14388) 7273 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:02:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:36 smithi179 bash[23186]: audit 2024-09-21T01:02:35.681587+0000 mgr.a (mgr.14388) 7274 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:02:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:36 smithi179 bash[23186]: cephadm 2024-09-21T01:02:35.682990+0000 mgr.a (mgr.14388) 7275 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:02:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:36 smithi179 bash[23186]: audit 2024-09-21T01:02:36.649643+0000 mon.a (mon.0) 6280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:36 smithi179 bash[23186]: audit 2024-09-21T01:02:36.657592+0000 mon.a (mon.0) 6281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:36 smithi179 bash[23186]: audit 2024-09-21T01:02:36.669464+0000 mon.a (mon.0) 6282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:36 smithi044 bash[22676]: cluster 2024-09-21T01:02:35.487136+0000 mgr.a (mgr.14388) 7273 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:02:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:36 smithi044 bash[22676]: audit 2024-09-21T01:02:35.681587+0000 mgr.a (mgr.14388) 7274 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:02:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:36 smithi044 bash[22676]: cephadm 2024-09-21T01:02:35.682990+0000 mgr.a (mgr.14388) 7275 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:02:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:36 smithi044 bash[22676]: audit 2024-09-21T01:02:36.649643+0000 mon.a (mon.0) 6280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:36 smithi044 bash[22676]: audit 2024-09-21T01:02:36.657592+0000 mon.a (mon.0) 6281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:36 smithi044 bash[22676]: audit 2024-09-21T01:02:36.669464+0000 mon.a (mon.0) 6282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:36 smithi049 bash[23528]: cluster 2024-09-21T01:02:35.487136+0000 mgr.a (mgr.14388) 7273 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:02:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:36 smithi049 bash[23528]: audit 2024-09-21T01:02:35.681587+0000 mgr.a (mgr.14388) 7274 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:02:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:36 smithi049 bash[23528]: cephadm 2024-09-21T01:02:35.682990+0000 mgr.a (mgr.14388) 7275 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:02:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:36 smithi049 bash[23528]: audit 2024-09-21T01:02:36.649643+0000 mon.a (mon.0) 6280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:36 smithi049 bash[23528]: audit 2024-09-21T01:02:36.657592+0000 mon.a (mon.0) 6281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:36 smithi049 bash[23528]: audit 2024-09-21T01:02:36.669464+0000 mon.a (mon.0) 6282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:38 smithi044 bash[22676]: cluster 2024-09-21T01:02:37.487786+0000 mgr.a (mgr.14388) 7276 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:02:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:38 smithi044 bash[22676]: audit 2024-09-21T01:02:37.602518+0000 mon.a (mon.0) 6283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:38 smithi044 bash[22676]: audit 2024-09-21T01:02:37.610346+0000 mon.a (mon.0) 6284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:38 smithi044 bash[22676]: audit 2024-09-21T01:02:37.618928+0000 mon.a (mon.0) 6285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:38 smithi179 bash[23186]: cluster 2024-09-21T01:02:37.487786+0000 mgr.a (mgr.14388) 7276 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:38 smithi179 bash[23186]: audit 2024-09-21T01:02:37.602518+0000 mon.a (mon.0) 6283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:38 smithi179 bash[23186]: audit 2024-09-21T01:02:37.610346+0000 mon.a (mon.0) 6284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:38 smithi179 bash[23186]: audit 2024-09-21T01:02:37.618928+0000 mon.a (mon.0) 6285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:39.039 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:38 smithi049 bash[23528]: cluster 2024-09-21T01:02:37.487786+0000 mgr.a (mgr.14388) 7276 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:02:39.039 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:38 smithi049 bash[23528]: audit 2024-09-21T01:02:37.602518+0000 mon.a (mon.0) 6283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:39.039 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:38 smithi049 bash[23528]: audit 2024-09-21T01:02:37.610346+0000 mon.a (mon.0) 6284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:39.039 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:38 smithi049 bash[23528]: audit 2024-09-21T01:02:37.618928+0000 mon.a (mon.0) 6285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:39.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:39.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:39.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:40.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:40 smithi049 bash[23528]: audit 2024-09-21T01:02:39.024381+0000 mon.a (mon.0) 6286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:40 smithi049 bash[23528]: audit 2024-09-21T01:02:39.030882+0000 mon.a (mon.0) 6287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:40 smithi049 bash[23528]: audit 2024-09-21T01:02:39.037992+0000 mon.a (mon.0) 6288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:40 smithi044 bash[22676]: audit 2024-09-21T01:02:39.024381+0000 mon.a (mon.0) 6286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:40 smithi044 bash[22676]: audit 2024-09-21T01:02:39.030882+0000 mon.a (mon.0) 6287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:40 smithi044 bash[22676]: audit 2024-09-21T01:02:39.037992+0000 mon.a (mon.0) 6288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:40 smithi179 bash[23186]: audit 2024-09-21T01:02:39.024381+0000 mon.a (mon.0) 6286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:40 smithi179 bash[23186]: audit 2024-09-21T01:02:39.030882+0000 mon.a (mon.0) 6287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:40 smithi179 bash[23186]: audit 2024-09-21T01:02:39.037992+0000 mon.a (mon.0) 6288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:40.759 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:41.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:41 smithi049 bash[23528]: cluster 2024-09-21T01:02:39.488767+0000 mgr.a (mgr.14388) 7277 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:02:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:41 smithi044 bash[22676]: cluster 2024-09-21T01:02:39.488767+0000 mgr.a (mgr.14388) 7277 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:02:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:41 smithi179 bash[23186]: cluster 2024-09-21T01:02:39.488767+0000 mgr.a (mgr.14388) 7277 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:02:42.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:42 smithi049 bash[23528]: audit 2024-09-21T01:02:40.313742+0000 mgr.a (mgr.14388) 7278 : audit [DBG] from='client.164925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:42 smithi044 bash[22676]: audit 2024-09-21T01:02:40.313742+0000 mgr.a (mgr.14388) 7278 : audit [DBG] from='client.164925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:42 smithi179 bash[23186]: audit 2024-09-21T01:02:40.313742+0000 mgr.a (mgr.14388) 7278 : audit [DBG] from='client.164925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:43 smithi044 bash[22676]: cluster 2024-09-21T01:02:41.491599+0000 mgr.a (mgr.14388) 7279 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:43 smithi179 bash[23186]: cluster 2024-09-21T01:02:41.491599+0000 mgr.a (mgr.14388) 7279 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:43.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:43 smithi049 bash[23528]: cluster 2024-09-21T01:02:41.491599+0000 mgr.a (mgr.14388) 7279 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:45.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:45 smithi049 bash[23528]: cluster 2024-09-21T01:02:43.492391+0000 mgr.a (mgr.14388) 7280 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:45 smithi044 bash[22676]: cluster 2024-09-21T01:02:43.492391+0000 mgr.a (mgr.14388) 7280 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:45 smithi179 bash[23186]: cluster 2024-09-21T01:02:43.492391+0000 mgr.a (mgr.14388) 7280 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:45.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:45.761 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:45.761 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:46.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:46.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:46.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:46.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:46.547 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:47 smithi044 bash[22676]: cluster 2024-09-21T01:02:45.494425+0000 mgr.a (mgr.14388) 7281 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:47 smithi044 bash[22676]: audit 2024-09-21T01:02:46.101982+0000 mgr.a (mgr.14388) 7282 : audit [DBG] from='client.164997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:47.488 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:47 smithi049 bash[23528]: cluster 2024-09-21T01:02:45.494425+0000 mgr.a (mgr.14388) 7281 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:47.488 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:47 smithi049 bash[23528]: audit 2024-09-21T01:02:46.101982+0000 mgr.a (mgr.14388) 7282 : audit [DBG] from='client.164997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:47 smithi179 bash[23186]: cluster 2024-09-21T01:02:45.494425+0000 mgr.a (mgr.14388) 7281 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:47 smithi179 bash[23186]: audit 2024-09-21T01:02:46.101982+0000 mgr.a (mgr.14388) 7282 : audit [DBG] from='client.164997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:49 smithi044 bash[22676]: cluster 2024-09-21T01:02:47.495464+0000 mgr.a (mgr.14388) 7283 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:49 smithi179 bash[23186]: cluster 2024-09-21T01:02:47.495464+0000 mgr.a (mgr.14388) 7283 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:49 smithi049 bash[23528]: cluster 2024-09-21T01:02:47.495464+0000 mgr.a (mgr.14388) 7283 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:51 smithi044 bash[22676]: cluster 2024-09-21T01:02:49.496426+0000 mgr.a (mgr.14388) 7284 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:51 smithi179 bash[23186]: cluster 2024-09-21T01:02:49.496426+0000 mgr.a (mgr.14388) 7284 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:51.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:51.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:51.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:51 smithi049 bash[23528]: cluster 2024-09-21T01:02:49.496426+0000 mgr.a (mgr.14388) 7284 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:02:52.298 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:52.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:52.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:52.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:52.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:53 smithi044 bash[22676]: cluster 2024-09-21T01:02:51.498823+0000 mgr.a (mgr.14388) 7285 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:53 smithi044 bash[22676]: audit 2024-09-21T01:02:51.875754+0000 mgr.a (mgr.14388) 7286 : audit [DBG] from='client.165072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:53 smithi179 bash[23186]: cluster 2024-09-21T01:02:51.498823+0000 mgr.a (mgr.14388) 7285 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:53 smithi179 bash[23186]: audit 2024-09-21T01:02:51.875754+0000 mgr.a (mgr.14388) 7286 : audit [DBG] from='client.165072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:53 smithi049 bash[23528]: cluster 2024-09-21T01:02:51.498823+0000 mgr.a (mgr.14388) 7285 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:02:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:53 smithi049 bash[23528]: audit 2024-09-21T01:02:51.875754+0000 mgr.a (mgr.14388) 7286 : audit [DBG] from='client.165072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:55.338 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:55 smithi179 bash[23186]: cluster 2024-09-21T01:02:53.499762+0000 mgr.a (mgr.14388) 7287 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:55 smithi044 bash[22676]: cluster 2024-09-21T01:02:53.499762+0000 mgr.a (mgr.14388) 7287 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:55 smithi049 bash[23528]: cluster 2024-09-21T01:02:53.499762+0000 mgr.a (mgr.14388) 7287 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:57 smithi044 bash[22676]: cluster 2024-09-21T01:02:55.502000+0000 mgr.a (mgr.14388) 7288 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:57 smithi044 bash[22676]: audit 2024-09-21T01:02:56.843156+0000 mon.a (mon.0) 6289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:57 smithi044 bash[22676]: audit 2024-09-21T01:02:56.848165+0000 mon.a (mon.0) 6290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:57 smithi044 bash[22676]: audit 2024-09-21T01:02:56.854020+0000 mon.a (mon.0) 6291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:02:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:02:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:02:57.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:57 smithi179 bash[23186]: cluster 2024-09-21T01:02:55.502000+0000 mgr.a (mgr.14388) 7288 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:57.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:57 smithi179 bash[23186]: audit 2024-09-21T01:02:56.843156+0000 mon.a (mon.0) 6289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:57 smithi179 bash[23186]: audit 2024-09-21T01:02:56.848165+0000 mon.a (mon.0) 6290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:57 smithi179 bash[23186]: audit 2024-09-21T01:02:56.854020+0000 mon.a (mon.0) 6291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:57 smithi049 bash[23528]: cluster 2024-09-21T01:02:55.502000+0000 mgr.a (mgr.14388) 7288 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:02:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:57 smithi049 bash[23528]: audit 2024-09-21T01:02:56.843156+0000 mon.a (mon.0) 6289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:57 smithi049 bash[23528]: audit 2024-09-21T01:02:56.848165+0000 mon.a (mon.0) 6290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:57 smithi049 bash[23528]: audit 2024-09-21T01:02:56.854020+0000 mon.a (mon.0) 6291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:02:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:02:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:02:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:02:58.112 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:02:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:58 smithi044 bash[22676]: cluster 2024-09-21T01:02:57.502655+0000 mgr.a (mgr.14388) 7289 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:58 smithi044 bash[22676]: audit 2024-09-21T01:02:57.643623+0000 mgr.a (mgr.14388) 7290 : audit [DBG] from='client.165150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:58 smithi044 bash[22676]: audit 2024-09-21T01:02:57.746329+0000 mon.a (mon.0) 6292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:58 smithi044 bash[22676]: audit 2024-09-21T01:02:57.752346+0000 mon.a (mon.0) 6293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:02:58 smithi044 bash[22676]: audit 2024-09-21T01:02:57.759288+0000 mon.a (mon.0) 6294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:58 smithi179 bash[23186]: cluster 2024-09-21T01:02:57.502655+0000 mgr.a (mgr.14388) 7289 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:58 smithi179 bash[23186]: audit 2024-09-21T01:02:57.643623+0000 mgr.a (mgr.14388) 7290 : audit [DBG] from='client.165150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:58 smithi179 bash[23186]: audit 2024-09-21T01:02:57.746329+0000 mon.a (mon.0) 6292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:58 smithi179 bash[23186]: audit 2024-09-21T01:02:57.752346+0000 mon.a (mon.0) 6293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:02:58 smithi179 bash[23186]: audit 2024-09-21T01:02:57.759288+0000 mon.a (mon.0) 6294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:59.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:58 smithi049 bash[23528]: cluster 2024-09-21T01:02:57.502655+0000 mgr.a (mgr.14388) 7289 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:02:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:58 smithi049 bash[23528]: audit 2024-09-21T01:02:57.643623+0000 mgr.a (mgr.14388) 7290 : audit [DBG] from='client.165150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:58 smithi049 bash[23528]: audit 2024-09-21T01:02:57.746329+0000 mon.a (mon.0) 6292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:58 smithi049 bash[23528]: audit 2024-09-21T01:02:57.752346+0000 mon.a (mon.0) 6293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:02:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:02:58 smithi049 bash[23528]: audit 2024-09-21T01:02:57.759288+0000 mon.a (mon.0) 6294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:00 smithi049 bash[23528]: audit 2024-09-21T01:02:59.253207+0000 mon.a (mon.0) 6295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:00 smithi049 bash[23528]: audit 2024-09-21T01:02:59.261603+0000 mon.a (mon.0) 6296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:00 smithi049 bash[23528]: audit 2024-09-21T01:02:59.271555+0000 mon.a (mon.0) 6297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:00 smithi049 bash[23528]: cluster 2024-09-21T01:02:59.503683+0000 mgr.a (mgr.14388) 7291 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:00 smithi044 bash[22676]: audit 2024-09-21T01:02:59.253207+0000 mon.a (mon.0) 6295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:00 smithi044 bash[22676]: audit 2024-09-21T01:02:59.261603+0000 mon.a (mon.0) 6296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:00 smithi044 bash[22676]: audit 2024-09-21T01:02:59.271555+0000 mon.a (mon.0) 6297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:00 smithi044 bash[22676]: cluster 2024-09-21T01:02:59.503683+0000 mgr.a (mgr.14388) 7291 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:00 smithi179 bash[23186]: audit 2024-09-21T01:02:59.253207+0000 mon.a (mon.0) 6295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:00 smithi179 bash[23186]: audit 2024-09-21T01:02:59.261603+0000 mon.a (mon.0) 6296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:00 smithi179 bash[23186]: audit 2024-09-21T01:02:59.271555+0000 mon.a (mon.0) 6297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:00 smithi179 bash[23186]: cluster 2024-09-21T01:02:59.503683+0000 mgr.a (mgr.14388) 7291 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:02 smithi044 bash[22676]: cluster 2024-09-21T01:03:01.505984+0000 mgr.a (mgr.14388) 7292 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:02 smithi179 bash[23186]: cluster 2024-09-21T01:03:01.505984+0000 mgr.a (mgr.14388) 7292 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:02 smithi049 bash[23528]: cluster 2024-09-21T01:03:01.505984+0000 mgr.a (mgr.14388) 7292 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:03.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:03.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:03.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:03.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:03.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:04 smithi044 bash[22676]: audit 2024-09-21T01:03:03.446314+0000 mgr.a (mgr.14388) 7293 : audit [DBG] from='client.165228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:04 smithi044 bash[22676]: cluster 2024-09-21T01:03:03.506549+0000 mgr.a (mgr.14388) 7294 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:04 smithi179 bash[23186]: audit 2024-09-21T01:03:03.446314+0000 mgr.a (mgr.14388) 7293 : audit [DBG] from='client.165228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:04 smithi179 bash[23186]: cluster 2024-09-21T01:03:03.506549+0000 mgr.a (mgr.14388) 7294 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:05.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:04 smithi049 bash[23528]: audit 2024-09-21T01:03:03.446314+0000 mgr.a (mgr.14388) 7293 : audit [DBG] from='client.165228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:05.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:04 smithi049 bash[23528]: cluster 2024-09-21T01:03:03.506549+0000 mgr.a (mgr.14388) 7294 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:06 smithi179 bash[23186]: cluster 2024-09-21T01:03:05.508916+0000 mgr.a (mgr.14388) 7295 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:06 smithi044 bash[22676]: cluster 2024-09-21T01:03:05.508916+0000 mgr.a (mgr.14388) 7295 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:06 smithi049 bash[23528]: cluster 2024-09-21T01:03:05.508916+0000 mgr.a (mgr.14388) 7295 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:08.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:08.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:08.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:08 smithi044 bash[22676]: cluster 2024-09-21T01:03:07.509758+0000 mgr.a (mgr.14388) 7296 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:08 smithi179 bash[23186]: cluster 2024-09-21T01:03:07.509758+0000 mgr.a (mgr.14388) 7296 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:08 smithi049 bash[23528]: cluster 2024-09-21T01:03:07.509758+0000 mgr.a (mgr.14388) 7296 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:09.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:09.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:09.634 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:10 smithi044 bash[22676]: audit 2024-09-21T01:03:09.211705+0000 mgr.a (mgr.14388) 7297 : audit [DBG] from='client.165306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:10 smithi044 bash[22676]: cluster 2024-09-21T01:03:09.510296+0000 mgr.a (mgr.14388) 7298 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:10 smithi179 bash[23186]: audit 2024-09-21T01:03:09.211705+0000 mgr.a (mgr.14388) 7297 : audit [DBG] from='client.165306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:10 smithi179 bash[23186]: cluster 2024-09-21T01:03:09.510296+0000 mgr.a (mgr.14388) 7298 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:11.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:10 smithi049 bash[23528]: audit 2024-09-21T01:03:09.211705+0000 mgr.a (mgr.14388) 7297 : audit [DBG] from='client.165306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:10 smithi049 bash[23528]: cluster 2024-09-21T01:03:09.510296+0000 mgr.a (mgr.14388) 7298 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:12 smithi044 bash[22676]: cluster 2024-09-21T01:03:11.512643+0000 mgr.a (mgr.14388) 7299 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:12 smithi179 bash[23186]: cluster 2024-09-21T01:03:11.512643+0000 mgr.a (mgr.14388) 7299 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:12 smithi049 bash[23528]: cluster 2024-09-21T01:03:11.512643+0000 mgr.a (mgr.14388) 7299 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:14.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:14.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:14.636 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:14.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:14 smithi049 bash[23528]: cluster 2024-09-21T01:03:13.513422+0000 mgr.a (mgr.14388) 7300 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:14 smithi044 bash[22676]: cluster 2024-09-21T01:03:13.513422+0000 mgr.a (mgr.14388) 7300 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:14 smithi179 bash[23186]: cluster 2024-09-21T01:03:13.513422+0000 mgr.a (mgr.14388) 7300 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:15.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:15.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:15.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:15.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:15 smithi044 bash[22676]: audit 2024-09-21T01:03:14.968426+0000 mgr.a (mgr.14388) 7301 : audit [DBG] from='client.165384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:16.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:15 smithi179 bash[23186]: audit 2024-09-21T01:03:14.968426+0000 mgr.a (mgr.14388) 7301 : audit [DBG] from='client.165384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:16.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:15 smithi049 bash[23528]: audit 2024-09-21T01:03:14.968426+0000 mgr.a (mgr.14388) 7301 : audit [DBG] from='client.165384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:16 smithi044 bash[22676]: cluster 2024-09-21T01:03:15.516164+0000 mgr.a (mgr.14388) 7302 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:16 smithi179 bash[23186]: cluster 2024-09-21T01:03:15.516164+0000 mgr.a (mgr.14388) 7302 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:17.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:16 smithi049 bash[23528]: cluster 2024-09-21T01:03:15.516164+0000 mgr.a (mgr.14388) 7302 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:18 smithi049 bash[23528]: audit 2024-09-21T01:03:17.031125+0000 mon.a (mon.0) 6298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:18 smithi049 bash[23528]: audit 2024-09-21T01:03:17.041455+0000 mon.a (mon.0) 6299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:18 smithi049 bash[23528]: audit 2024-09-21T01:03:17.051585+0000 mon.a (mon.0) 6300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:18 smithi049 bash[23528]: audit 2024-09-21T01:03:17.978905+0000 mon.a (mon.0) 6301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:18 smithi049 bash[23528]: audit 2024-09-21T01:03:17.985285+0000 mon.a (mon.0) 6302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:18 smithi049 bash[23528]: audit 2024-09-21T01:03:17.993561+0000 mon.a (mon.0) 6303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:18 smithi044 bash[22676]: audit 2024-09-21T01:03:17.031125+0000 mon.a (mon.0) 6298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:18 smithi044 bash[22676]: audit 2024-09-21T01:03:17.041455+0000 mon.a (mon.0) 6299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:18 smithi044 bash[22676]: audit 2024-09-21T01:03:17.051585+0000 mon.a (mon.0) 6300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:18 smithi044 bash[22676]: audit 2024-09-21T01:03:17.978905+0000 mon.a (mon.0) 6301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:18 smithi044 bash[22676]: audit 2024-09-21T01:03:17.985285+0000 mon.a (mon.0) 6302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:18 smithi044 bash[22676]: audit 2024-09-21T01:03:17.993561+0000 mon.a (mon.0) 6303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:18 smithi179 bash[23186]: audit 2024-09-21T01:03:17.031125+0000 mon.a (mon.0) 6298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:18 smithi179 bash[23186]: audit 2024-09-21T01:03:17.041455+0000 mon.a (mon.0) 6299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:18 smithi179 bash[23186]: audit 2024-09-21T01:03:17.051585+0000 mon.a (mon.0) 6300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:18 smithi179 bash[23186]: audit 2024-09-21T01:03:17.978905+0000 mon.a (mon.0) 6301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:18 smithi179 bash[23186]: audit 2024-09-21T01:03:17.985285+0000 mon.a (mon.0) 6302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:18 smithi179 bash[23186]: audit 2024-09-21T01:03:17.993561+0000 mon.a (mon.0) 6303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:19 smithi044 bash[22676]: cluster 2024-09-21T01:03:17.516988+0000 mgr.a (mgr.14388) 7303 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:19 smithi179 bash[23186]: cluster 2024-09-21T01:03:17.516988+0000 mgr.a (mgr.14388) 7303 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:19.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:19 smithi049 bash[23528]: cluster 2024-09-21T01:03:17.516988+0000 mgr.a (mgr.14388) 7303 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:20.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:20.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:20.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:20 smithi044 bash[22676]: audit 2024-09-21T01:03:19.485323+0000 mon.a (mon.0) 6304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:20 smithi044 bash[22676]: audit 2024-09-21T01:03:19.495791+0000 mon.a (mon.0) 6305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:20 smithi044 bash[22676]: audit 2024-09-21T01:03:19.505853+0000 mon.a (mon.0) 6306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:20 smithi044 bash[22676]: cluster 2024-09-21T01:03:19.517801+0000 mgr.a (mgr.14388) 7304 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:03:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:20 smithi179 bash[23186]: audit 2024-09-21T01:03:19.485323+0000 mon.a (mon.0) 6304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:20 smithi179 bash[23186]: audit 2024-09-21T01:03:19.495791+0000 mon.a (mon.0) 6305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:20 smithi179 bash[23186]: audit 2024-09-21T01:03:19.505853+0000 mon.a (mon.0) 6306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:20 smithi179 bash[23186]: cluster 2024-09-21T01:03:19.517801+0000 mgr.a (mgr.14388) 7304 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:03:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:20 smithi049 bash[23528]: audit 2024-09-21T01:03:19.485323+0000 mon.a (mon.0) 6304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:20 smithi049 bash[23528]: audit 2024-09-21T01:03:19.495791+0000 mon.a (mon.0) 6305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:20 smithi049 bash[23528]: audit 2024-09-21T01:03:19.505853+0000 mon.a (mon.0) 6306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:20 smithi049 bash[23528]: cluster 2024-09-21T01:03:19.517801+0000 mgr.a (mgr.14388) 7304 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:03:21.149 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:21.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:21.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:21.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:21.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:21 smithi049 bash[23528]: audit 2024-09-21T01:03:20.723053+0000 mgr.a (mgr.14388) 7305 : audit [DBG] from='client.165462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:21 smithi044 bash[22676]: audit 2024-09-21T01:03:20.723053+0000 mgr.a (mgr.14388) 7305 : audit [DBG] from='client.165462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:21 smithi179 bash[23186]: audit 2024-09-21T01:03:20.723053+0000 mgr.a (mgr.14388) 7305 : audit [DBG] from='client.165462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:22.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:22 smithi049 bash[23528]: cluster 2024-09-21T01:03:21.520792+0000 mgr.a (mgr.14388) 7306 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:22 smithi044 bash[22676]: cluster 2024-09-21T01:03:21.520792+0000 mgr.a (mgr.14388) 7306 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:22 smithi179 bash[23186]: cluster 2024-09-21T01:03:21.520792+0000 mgr.a (mgr.14388) 7306 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:24 smithi044 bash[22676]: cluster 2024-09-21T01:03:23.521802+0000 mgr.a (mgr.14388) 7307 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:24 smithi179 bash[23186]: cluster 2024-09-21T01:03:23.521802+0000 mgr.a (mgr.14388) 7307 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:24 smithi049 bash[23528]: cluster 2024-09-21T01:03:23.521802+0000 mgr.a (mgr.14388) 7307 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:26.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:26.151 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:26.151 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:26.936 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:26.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:26 smithi044 bash[22676]: cluster 2024-09-21T01:03:25.523897+0000 mgr.a (mgr.14388) 7308 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:26 smithi179 bash[23186]: cluster 2024-09-21T01:03:25.523897+0000 mgr.a (mgr.14388) 7308 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:27.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:26 smithi049 bash[23528]: cluster 2024-09-21T01:03:25.523897+0000 mgr.a (mgr.14388) 7308 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:27.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:27 smithi049 bash[23528]: audit 2024-09-21T01:03:26.485238+0000 mgr.a (mgr.14388) 7309 : audit [DBG] from='client.165540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:27 smithi044 bash[22676]: audit 2024-09-21T01:03:26.485238+0000 mgr.a (mgr.14388) 7309 : audit [DBG] from='client.165540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:27 smithi179 bash[23186]: audit 2024-09-21T01:03:26.485238+0000 mgr.a (mgr.14388) 7309 : audit [DBG] from='client.165540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:28 smithi044 bash[22676]: cluster 2024-09-21T01:03:27.524935+0000 mgr.a (mgr.14388) 7310 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:28 smithi179 bash[23186]: cluster 2024-09-21T01:03:27.524935+0000 mgr.a (mgr.14388) 7310 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:29.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:28 smithi049 bash[23528]: cluster 2024-09-21T01:03:27.524935+0000 mgr.a (mgr.14388) 7310 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:30 smithi044 bash[22676]: cluster 2024-09-21T01:03:29.525892+0000 mgr.a (mgr.14388) 7311 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:30 smithi179 bash[23186]: cluster 2024-09-21T01:03:29.525892+0000 mgr.a (mgr.14388) 7311 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:30 smithi049 bash[23528]: cluster 2024-09-21T01:03:29.525892+0000 mgr.a (mgr.14388) 7311 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:32.694 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:32 smithi044 bash[22676]: cluster 2024-09-21T01:03:31.528252+0000 mgr.a (mgr.14388) 7312 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:32 smithi179 bash[23186]: cluster 2024-09-21T01:03:31.528252+0000 mgr.a (mgr.14388) 7312 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:33.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:32 smithi049 bash[23528]: cluster 2024-09-21T01:03:31.528252+0000 mgr.a (mgr.14388) 7312 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:33 smithi044 bash[22676]: audit 2024-09-21T01:03:32.270463+0000 mgr.a (mgr.14388) 7313 : audit [DBG] from='client.165615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:33 smithi179 bash[23186]: audit 2024-09-21T01:03:32.270463+0000 mgr.a (mgr.14388) 7313 : audit [DBG] from='client.165615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:33 smithi049 bash[23528]: audit 2024-09-21T01:03:32.270463+0000 mgr.a (mgr.14388) 7313 : audit [DBG] from='client.165615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:34 smithi179 bash[23186]: cluster 2024-09-21T01:03:33.529238+0000 mgr.a (mgr.14388) 7314 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:34 smithi044 bash[22676]: cluster 2024-09-21T01:03:33.529238+0000 mgr.a (mgr.14388) 7314 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:35.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:34 smithi049 bash[23528]: cluster 2024-09-21T01:03:33.529238+0000 mgr.a (mgr.14388) 7314 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: cluster 2024-09-21T01:03:35.531541+0000 mgr.a (mgr.14388) 7315 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: audit 2024-09-21T01:03:35.742436+0000 mon.a (mon.0) 6307 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: audit 2024-09-21T01:03:36.318535+0000 mon.a (mon.0) 6308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: audit 2024-09-21T01:03:36.326255+0000 mon.a (mon.0) 6309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: audit 2024-09-21T01:03:36.328560+0000 mon.a (mon.0) 6310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: audit 2024-09-21T01:03:36.330400+0000 mon.a (mon.0) 6311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: audit 2024-09-21T01:03:36.342293+0000 mon.a (mon.0) 6312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:36 smithi044 bash[22676]: audit 2024-09-21T01:03:36.349939+0000 mon.a (mon.0) 6313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: cluster 2024-09-21T01:03:35.531541+0000 mgr.a (mgr.14388) 7315 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: audit 2024-09-21T01:03:35.742436+0000 mon.a (mon.0) 6307 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: audit 2024-09-21T01:03:36.318535+0000 mon.a (mon.0) 6308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: audit 2024-09-21T01:03:36.326255+0000 mon.a (mon.0) 6309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: audit 2024-09-21T01:03:36.328560+0000 mon.a (mon.0) 6310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: audit 2024-09-21T01:03:36.330400+0000 mon.a (mon.0) 6311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: audit 2024-09-21T01:03:36.342293+0000 mon.a (mon.0) 6312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:36 smithi179 bash[23186]: audit 2024-09-21T01:03:36.349939+0000 mon.a (mon.0) 6313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:03:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: cluster 2024-09-21T01:03:35.531541+0000 mgr.a (mgr.14388) 7315 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:03:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: audit 2024-09-21T01:03:35.742436+0000 mon.a (mon.0) 6307 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:03:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: audit 2024-09-21T01:03:36.318535+0000 mon.a (mon.0) 6308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: audit 2024-09-21T01:03:36.326255+0000 mon.a (mon.0) 6309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: audit 2024-09-21T01:03:36.328560+0000 mon.a (mon.0) 6310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:03:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: audit 2024-09-21T01:03:36.330400+0000 mon.a (mon.0) 6311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:03:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: audit 2024-09-21T01:03:36.342293+0000 mon.a (mon.0) 6312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:36 smithi049 bash[23528]: audit 2024-09-21T01:03:36.349939+0000 mon.a (mon.0) 6313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:03:37.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:03:37 smithi044 bash[22930]: debug 2024-09-21T01:03:37.122+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:03:37.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:03:37 smithi044 bash[22930]: debug 2024-09-21T01:03:37.122+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:03:37.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:37.696 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:37.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:37 smithi044 bash[22676]: audit 2024-09-21T01:03:36.351528+0000 mgr.a (mgr.14388) 7316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:03:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:37 smithi044 bash[22676]: audit 2024-09-21T01:03:37.180385+0000 mon.a (mon.0) 6314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:37 smithi044 bash[22676]: audit 2024-09-21T01:03:37.186018+0000 mon.a (mon.0) 6315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:37 smithi044 bash[22676]: audit 2024-09-21T01:03:37.193093+0000 mon.a (mon.0) 6316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:37 smithi179 bash[23186]: audit 2024-09-21T01:03:36.351528+0000 mgr.a (mgr.14388) 7316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:03:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:37 smithi179 bash[23186]: audit 2024-09-21T01:03:37.180385+0000 mon.a (mon.0) 6314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:37 smithi179 bash[23186]: audit 2024-09-21T01:03:37.186018+0000 mon.a (mon.0) 6315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:37 smithi179 bash[23186]: audit 2024-09-21T01:03:37.193093+0000 mon.a (mon.0) 6316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:37 smithi049 bash[23528]: audit 2024-09-21T01:03:36.351528+0000 mgr.a (mgr.14388) 7316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:03:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:37 smithi049 bash[23528]: audit 2024-09-21T01:03:37.180385+0000 mon.a (mon.0) 6314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:37 smithi049 bash[23528]: audit 2024-09-21T01:03:37.186018+0000 mon.a (mon.0) 6315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:37 smithi049 bash[23528]: audit 2024-09-21T01:03:37.193093+0000 mon.a (mon.0) 6316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.495 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:38.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:38 smithi044 bash[22676]: audit 2024-09-21T01:03:37.125562+0000 mgr.a (mgr.14388) 7317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:03:38.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:38 smithi044 bash[22676]: cephadm 2024-09-21T01:03:37.126684+0000 mgr.a (mgr.14388) 7318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:03:38.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:38 smithi044 bash[22676]: cluster 2024-09-21T01:03:37.532491+0000 mgr.a (mgr.14388) 7319 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:38.922 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:38 smithi044 bash[22676]: audit 2024-09-21T01:03:38.048823+0000 mgr.a (mgr.14388) 7320 : audit [DBG] from='client.81127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:38.922 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:38 smithi044 bash[22676]: audit 2024-09-21T01:03:38.172749+0000 mon.a (mon.0) 6317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.922 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:38 smithi044 bash[22676]: audit 2024-09-21T01:03:38.180642+0000 mon.a (mon.0) 6318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:38.922 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:38 smithi044 bash[22676]: audit 2024-09-21T01:03:38.187324+0000 mon.a (mon.0) 6319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:38 smithi179 bash[23186]: audit 2024-09-21T01:03:37.125562+0000 mgr.a (mgr.14388) 7317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:03:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:38 smithi179 bash[23186]: cephadm 2024-09-21T01:03:37.126684+0000 mgr.a (mgr.14388) 7318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:03:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:38 smithi179 bash[23186]: cluster 2024-09-21T01:03:37.532491+0000 mgr.a (mgr.14388) 7319 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:38 smithi179 bash[23186]: audit 2024-09-21T01:03:38.048823+0000 mgr.a (mgr.14388) 7320 : audit [DBG] from='client.81127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:38 smithi179 bash[23186]: audit 2024-09-21T01:03:38.172749+0000 mon.a (mon.0) 6317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:38 smithi179 bash[23186]: audit 2024-09-21T01:03:38.180642+0000 mon.a (mon.0) 6318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:38 smithi179 bash[23186]: audit 2024-09-21T01:03:38.187324+0000 mon.a (mon.0) 6319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:38 smithi049 bash[23528]: audit 2024-09-21T01:03:37.125562+0000 mgr.a (mgr.14388) 7317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:03:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:38 smithi049 bash[23528]: cephadm 2024-09-21T01:03:37.126684+0000 mgr.a (mgr.14388) 7318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:03:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:38 smithi049 bash[23528]: cluster 2024-09-21T01:03:37.532491+0000 mgr.a (mgr.14388) 7319 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:38 smithi049 bash[23528]: audit 2024-09-21T01:03:38.048823+0000 mgr.a (mgr.14388) 7320 : audit [DBG] from='client.81127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:38 smithi049 bash[23528]: audit 2024-09-21T01:03:38.172749+0000 mon.a (mon.0) 6317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:38 smithi049 bash[23528]: audit 2024-09-21T01:03:38.180642+0000 mon.a (mon.0) 6318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:38 smithi049 bash[23528]: audit 2024-09-21T01:03:38.187324+0000 mon.a (mon.0) 6319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:40 smithi044 bash[22676]: cluster 2024-09-21T01:03:39.533521+0000 mgr.a (mgr.14388) 7321 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:40 smithi044 bash[22676]: audit 2024-09-21T01:03:39.723087+0000 mon.a (mon.0) 6320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:40 smithi044 bash[22676]: audit 2024-09-21T01:03:39.731629+0000 mon.a (mon.0) 6321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:40 smithi044 bash[22676]: audit 2024-09-21T01:03:39.756173+0000 mon.a (mon.0) 6322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:40 smithi179 bash[23186]: cluster 2024-09-21T01:03:39.533521+0000 mgr.a (mgr.14388) 7321 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:40 smithi179 bash[23186]: audit 2024-09-21T01:03:39.723087+0000 mon.a (mon.0) 6320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:40 smithi179 bash[23186]: audit 2024-09-21T01:03:39.731629+0000 mon.a (mon.0) 6321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:40 smithi179 bash[23186]: audit 2024-09-21T01:03:39.756173+0000 mon.a (mon.0) 6322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:40 smithi049 bash[23528]: cluster 2024-09-21T01:03:39.533521+0000 mgr.a (mgr.14388) 7321 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:40 smithi049 bash[23528]: audit 2024-09-21T01:03:39.723087+0000 mon.a (mon.0) 6320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:40 smithi049 bash[23528]: audit 2024-09-21T01:03:39.731629+0000 mon.a (mon.0) 6321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:40 smithi049 bash[23528]: audit 2024-09-21T01:03:39.756173+0000 mon.a (mon.0) 6322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:42 smithi044 bash[22676]: cluster 2024-09-21T01:03:41.535685+0000 mgr.a (mgr.14388) 7322 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:42 smithi179 bash[23186]: cluster 2024-09-21T01:03:41.535685+0000 mgr.a (mgr.14388) 7322 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:43.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:42 smithi049 bash[23528]: cluster 2024-09-21T01:03:41.535685+0000 mgr.a (mgr.14388) 7322 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:43.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:43.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:43.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:44.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:44.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:44.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:44.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:44.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:44 smithi044 bash[22676]: cluster 2024-09-21T01:03:43.536394+0000 mgr.a (mgr.14388) 7323 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:44 smithi044 bash[22676]: audit 2024-09-21T01:03:43.828723+0000 mgr.a (mgr.14388) 7324 : audit [DBG] from='client.165870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:44.993 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:44 smithi049 bash[23528]: cluster 2024-09-21T01:03:43.536394+0000 mgr.a (mgr.14388) 7323 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:44.993 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:44 smithi049 bash[23528]: audit 2024-09-21T01:03:43.828723+0000 mgr.a (mgr.14388) 7324 : audit [DBG] from='client.165870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:44 smithi179 bash[23186]: cluster 2024-09-21T01:03:43.536394+0000 mgr.a (mgr.14388) 7323 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:44 smithi179 bash[23186]: audit 2024-09-21T01:03:43.828723+0000 mgr.a (mgr.14388) 7324 : audit [DBG] from='client.165870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:46 smithi044 bash[22676]: cluster 2024-09-21T01:03:45.538910+0000 mgr.a (mgr.14388) 7325 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:46 smithi179 bash[23186]: cluster 2024-09-21T01:03:45.538910+0000 mgr.a (mgr.14388) 7325 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:47.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:46 smithi049 bash[23528]: cluster 2024-09-21T01:03:45.538910+0000 mgr.a (mgr.14388) 7325 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:48 smithi179 bash[23186]: cluster 2024-09-21T01:03:47.539756+0000 mgr.a (mgr.14388) 7326 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:48 smithi049 bash[23528]: cluster 2024-09-21T01:03:47.539756+0000 mgr.a (mgr.14388) 7326 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:48 smithi044 bash[22676]: cluster 2024-09-21T01:03:47.539756+0000 mgr.a (mgr.14388) 7326 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:50.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:50.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:50.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:50.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:50.045 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:50 smithi179 bash[23186]: cluster 2024-09-21T01:03:49.540509+0000 mgr.a (mgr.14388) 7327 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:50 smithi179 bash[23186]: audit 2024-09-21T01:03:49.582592+0000 mgr.a (mgr.14388) 7328 : audit [DBG] from='client.165948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:50 smithi049 bash[23528]: cluster 2024-09-21T01:03:49.540509+0000 mgr.a (mgr.14388) 7327 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:50 smithi049 bash[23528]: audit 2024-09-21T01:03:49.582592+0000 mgr.a (mgr.14388) 7328 : audit [DBG] from='client.165948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:50 smithi044 bash[22676]: cluster 2024-09-21T01:03:49.540509+0000 mgr.a (mgr.14388) 7327 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:50 smithi044 bash[22676]: audit 2024-09-21T01:03:49.582592+0000 mgr.a (mgr.14388) 7328 : audit [DBG] from='client.165948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:52 smithi179 bash[23186]: cluster 2024-09-21T01:03:51.543342+0000 mgr.a (mgr.14388) 7329 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:52 smithi049 bash[23528]: cluster 2024-09-21T01:03:51.543342+0000 mgr.a (mgr.14388) 7329 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:52 smithi044 bash[22676]: cluster 2024-09-21T01:03:51.543342+0000 mgr.a (mgr.14388) 7329 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:03:55.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:03:55.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:03:55.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:03:55.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:54 smithi049 bash[23528]: cluster 2024-09-21T01:03:53.544146+0000 mgr.a (mgr.14388) 7330 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:03:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:54 smithi044 bash[22676]: cluster 2024-09-21T01:03:53.544146+0000 mgr.a (mgr.14388) 7330 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:03:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:54 smithi179 bash[23186]: cluster 2024-09-21T01:03:53.544146+0000 mgr.a (mgr.14388) 7330 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:03:55.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:03:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:03:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:03:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:03:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:03:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:56 smithi044 bash[22676]: audit 2024-09-21T01:03:55.381480+0000 mgr.a (mgr.14388) 7331 : audit [DBG] from='client.166023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:56 smithi044 bash[22676]: cluster 2024-09-21T01:03:55.545536+0000 mgr.a (mgr.14388) 7332 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:56 smithi049 bash[23528]: audit 2024-09-21T01:03:55.381480+0000 mgr.a (mgr.14388) 7331 : audit [DBG] from='client.166023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:56 smithi049 bash[23528]: cluster 2024-09-21T01:03:55.545536+0000 mgr.a (mgr.14388) 7332 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:56 smithi179 bash[23186]: audit 2024-09-21T01:03:55.381480+0000 mgr.a (mgr.14388) 7331 : audit [DBG] from='client.166023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:56 smithi179 bash[23186]: cluster 2024-09-21T01:03:55.545536+0000 mgr.a (mgr.14388) 7332 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:03:58.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:58 smithi044 bash[22676]: audit 2024-09-21T01:03:57.357439+0000 mon.a (mon.0) 6323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:58 smithi044 bash[22676]: audit 2024-09-21T01:03:57.365807+0000 mon.a (mon.0) 6324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:58 smithi044 bash[22676]: audit 2024-09-21T01:03:57.377651+0000 mon.a (mon.0) 6325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:58 smithi044 bash[22676]: cluster 2024-09-21T01:03:57.546266+0000 mgr.a (mgr.14388) 7333 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:58.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:58 smithi044 bash[22676]: audit 2024-09-21T01:03:58.341390+0000 mon.a (mon.0) 6326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:58 smithi044 bash[22676]: audit 2024-09-21T01:03:58.347353+0000 mon.a (mon.0) 6327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:03:58 smithi044 bash[22676]: audit 2024-09-21T01:03:58.352701+0000 mon.a (mon.0) 6328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:58 smithi179 bash[23186]: audit 2024-09-21T01:03:57.357439+0000 mon.a (mon.0) 6323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:58 smithi179 bash[23186]: audit 2024-09-21T01:03:57.365807+0000 mon.a (mon.0) 6324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:58 smithi179 bash[23186]: audit 2024-09-21T01:03:57.377651+0000 mon.a (mon.0) 6325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:58 smithi179 bash[23186]: cluster 2024-09-21T01:03:57.546266+0000 mgr.a (mgr.14388) 7333 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:58 smithi179 bash[23186]: audit 2024-09-21T01:03:58.341390+0000 mon.a (mon.0) 6326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:58 smithi179 bash[23186]: audit 2024-09-21T01:03:58.347353+0000 mon.a (mon.0) 6327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:03:58 smithi179 bash[23186]: audit 2024-09-21T01:03:58.352701+0000 mon.a (mon.0) 6328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:58 smithi049 bash[23528]: audit 2024-09-21T01:03:57.357439+0000 mon.a (mon.0) 6323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:58 smithi049 bash[23528]: audit 2024-09-21T01:03:57.365807+0000 mon.a (mon.0) 6324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:58 smithi049 bash[23528]: audit 2024-09-21T01:03:57.377651+0000 mon.a (mon.0) 6325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:58 smithi049 bash[23528]: cluster 2024-09-21T01:03:57.546266+0000 mgr.a (mgr.14388) 7333 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:03:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:58 smithi049 bash[23528]: audit 2024-09-21T01:03:58.341390+0000 mon.a (mon.0) 6326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:58 smithi049 bash[23528]: audit 2024-09-21T01:03:58.347353+0000 mon.a (mon.0) 6327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:03:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:03:58 smithi049 bash[23528]: audit 2024-09-21T01:03:58.352701+0000 mon.a (mon.0) 6328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:00.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:00.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:00.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:00 smithi044 bash[22676]: cluster 2024-09-21T01:03:59.547090+0000 mgr.a (mgr.14388) 7334 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:00 smithi044 bash[22676]: audit 2024-09-21T01:03:59.969524+0000 mon.a (mon.0) 6329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:00 smithi044 bash[22676]: audit 2024-09-21T01:03:59.977900+0000 mon.a (mon.0) 6330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:00 smithi044 bash[22676]: audit 2024-09-21T01:03:59.987756+0000 mon.a (mon.0) 6331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:00 smithi179 bash[23186]: cluster 2024-09-21T01:03:59.547090+0000 mgr.a (mgr.14388) 7334 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:00 smithi179 bash[23186]: audit 2024-09-21T01:03:59.969524+0000 mon.a (mon.0) 6329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:00 smithi179 bash[23186]: audit 2024-09-21T01:03:59.977900+0000 mon.a (mon.0) 6330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:00 smithi179 bash[23186]: audit 2024-09-21T01:03:59.987756+0000 mon.a (mon.0) 6331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:00 smithi049 bash[23528]: cluster 2024-09-21T01:03:59.547090+0000 mgr.a (mgr.14388) 7334 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:00 smithi049 bash[23528]: audit 2024-09-21T01:03:59.969524+0000 mon.a (mon.0) 6329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:00 smithi049 bash[23528]: audit 2024-09-21T01:03:59.977900+0000 mon.a (mon.0) 6330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:00 smithi049 bash[23528]: audit 2024-09-21T01:03:59.987756+0000 mon.a (mon.0) 6331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:01.584 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:01.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:01.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:01.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:01.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:02 smithi044 bash[22676]: audit 2024-09-21T01:04:01.157308+0000 mgr.a (mgr.14388) 7335 : audit [DBG] from='client.166101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:02 smithi044 bash[22676]: cluster 2024-09-21T01:04:01.548543+0000 mgr.a (mgr.14388) 7336 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:02 smithi179 bash[23186]: audit 2024-09-21T01:04:01.157308+0000 mgr.a (mgr.14388) 7335 : audit [DBG] from='client.166101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:02 smithi179 bash[23186]: cluster 2024-09-21T01:04:01.548543+0000 mgr.a (mgr.14388) 7336 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:03.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:02 smithi049 bash[23528]: audit 2024-09-21T01:04:01.157308+0000 mgr.a (mgr.14388) 7335 : audit [DBG] from='client.166101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:03.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:02 smithi049 bash[23528]: cluster 2024-09-21T01:04:01.548543+0000 mgr.a (mgr.14388) 7336 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:05.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:04 smithi044 bash[22676]: cluster 2024-09-21T01:04:03.549312+0000 mgr.a (mgr.14388) 7337 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:04:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:04 smithi179 bash[23186]: cluster 2024-09-21T01:04:03.549312+0000 mgr.a (mgr.14388) 7337 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:04:05.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:04 smithi049 bash[23528]: cluster 2024-09-21T01:04:03.549312+0000 mgr.a (mgr.14388) 7337 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:04:06.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:06.586 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:06.586 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:06 smithi044 bash[22676]: cluster 2024-09-21T01:04:05.551255+0000 mgr.a (mgr.14388) 7338 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:04:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:06 smithi179 bash[23186]: cluster 2024-09-21T01:04:05.551255+0000 mgr.a (mgr.14388) 7338 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:04:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:06 smithi049 bash[23528]: cluster 2024-09-21T01:04:05.551255+0000 mgr.a (mgr.14388) 7338 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:04:07.331 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:07 smithi044 bash[22676]: audit 2024-09-21T01:04:06.921798+0000 mgr.a (mgr.14388) 7339 : audit [DBG] from='client.166179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:07 smithi179 bash[23186]: audit 2024-09-21T01:04:06.921798+0000 mgr.a (mgr.14388) 7339 : audit [DBG] from='client.166179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:07 smithi049 bash[23528]: audit 2024-09-21T01:04:06.921798+0000 mgr.a (mgr.14388) 7339 : audit [DBG] from='client.166179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:08 smithi179 bash[23186]: cluster 2024-09-21T01:04:07.552405+0000 mgr.a (mgr.14388) 7340 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:09.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:08 smithi049 bash[23528]: cluster 2024-09-21T01:04:07.552405+0000 mgr.a (mgr.14388) 7340 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:09.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:08 smithi044 bash[22676]: cluster 2024-09-21T01:04:07.552405+0000 mgr.a (mgr.14388) 7340 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:10 smithi179 bash[23186]: cluster 2024-09-21T01:04:09.553020+0000 mgr.a (mgr.14388) 7341 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:10 smithi049 bash[23528]: cluster 2024-09-21T01:04:09.553020+0000 mgr.a (mgr.14388) 7341 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:10 smithi044 bash[22676]: cluster 2024-09-21T01:04:09.553020+0000 mgr.a (mgr.14388) 7341 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:12.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:13.114 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:13.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:13.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:13.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:13.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:13 smithi179 bash[23186]: cluster 2024-09-21T01:04:11.555222+0000 mgr.a (mgr.14388) 7342 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:13.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:13 smithi049 bash[23528]: cluster 2024-09-21T01:04:11.555222+0000 mgr.a (mgr.14388) 7342 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:12 smithi044 bash[22676]: cluster 2024-09-21T01:04:11.555222+0000 mgr.a (mgr.14388) 7342 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:14 smithi179 bash[23186]: audit 2024-09-21T01:04:12.671577+0000 mgr.a (mgr.14388) 7343 : audit [DBG] from='client.166257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:14 smithi049 bash[23528]: audit 2024-09-21T01:04:12.671577+0000 mgr.a (mgr.14388) 7343 : audit [DBG] from='client.166257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:14 smithi044 bash[22676]: audit 2024-09-21T01:04:12.671577+0000 mgr.a (mgr.14388) 7343 : audit [DBG] from='client.166257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:15.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:15 smithi049 bash[23528]: cluster 2024-09-21T01:04:13.556314+0000 mgr.a (mgr.14388) 7344 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:15.375 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:15 smithi044 bash[22676]: cluster 2024-09-21T01:04:13.556314+0000 mgr.a (mgr.14388) 7344 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:15.407 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:15 smithi179 bash[23186]: cluster 2024-09-21T01:04:13.556314+0000 mgr.a (mgr.14388) 7344 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:17.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:17 smithi049 bash[23528]: cluster 2024-09-21T01:04:15.558771+0000 mgr.a (mgr.14388) 7345 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:17 smithi044 bash[22676]: cluster 2024-09-21T01:04:15.558771+0000 mgr.a (mgr.14388) 7345 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:17 smithi179 bash[23186]: cluster 2024-09-21T01:04:15.558771+0000 mgr.a (mgr.14388) 7345 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:18.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:18.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:18.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:18 smithi044 bash[22676]: audit 2024-09-21T01:04:17.547046+0000 mon.a (mon.0) 6332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:18 smithi044 bash[22676]: audit 2024-09-21T01:04:17.555818+0000 mon.a (mon.0) 6333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:18 smithi044 bash[22676]: cluster 2024-09-21T01:04:17.559719+0000 mgr.a (mgr.14388) 7346 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:18 smithi044 bash[22676]: audit 2024-09-21T01:04:17.567470+0000 mon.a (mon.0) 6334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:18 smithi044 bash[22676]: audit 2024-09-21T01:04:18.472003+0000 mon.a (mon.0) 6335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:18 smithi044 bash[22676]: audit 2024-09-21T01:04:18.477669+0000 mon.a (mon.0) 6336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:18 smithi044 bash[22676]: audit 2024-09-21T01:04:18.483521+0000 mon.a (mon.0) 6337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:18 smithi049 bash[23528]: audit 2024-09-21T01:04:17.547046+0000 mon.a (mon.0) 6332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:18 smithi049 bash[23528]: audit 2024-09-21T01:04:17.555818+0000 mon.a (mon.0) 6333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:18 smithi049 bash[23528]: cluster 2024-09-21T01:04:17.559719+0000 mgr.a (mgr.14388) 7346 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:18 smithi049 bash[23528]: audit 2024-09-21T01:04:17.567470+0000 mon.a (mon.0) 6334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:18 smithi049 bash[23528]: audit 2024-09-21T01:04:18.472003+0000 mon.a (mon.0) 6335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:18 smithi049 bash[23528]: audit 2024-09-21T01:04:18.477669+0000 mon.a (mon.0) 6336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:18 smithi049 bash[23528]: audit 2024-09-21T01:04:18.483521+0000 mon.a (mon.0) 6337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:18.858 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:18.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:18.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:18.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:18.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:18 smithi179 bash[23186]: audit 2024-09-21T01:04:17.547046+0000 mon.a (mon.0) 6332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:18 smithi179 bash[23186]: audit 2024-09-21T01:04:17.555818+0000 mon.a (mon.0) 6333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:18 smithi179 bash[23186]: cluster 2024-09-21T01:04:17.559719+0000 mgr.a (mgr.14388) 7346 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:18 smithi179 bash[23186]: audit 2024-09-21T01:04:17.567470+0000 mon.a (mon.0) 6334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:18 smithi179 bash[23186]: audit 2024-09-21T01:04:18.472003+0000 mon.a (mon.0) 6335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:18 smithi179 bash[23186]: audit 2024-09-21T01:04:18.477669+0000 mon.a (mon.0) 6336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:18 smithi179 bash[23186]: audit 2024-09-21T01:04:18.483521+0000 mon.a (mon.0) 6337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:19 smithi044 bash[22676]: audit 2024-09-21T01:04:18.440787+0000 mgr.a (mgr.14388) 7347 : audit [DBG] from='client.166332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:19 smithi179 bash[23186]: audit 2024-09-21T01:04:18.440787+0000 mgr.a (mgr.14388) 7347 : audit [DBG] from='client.166332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:20.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:19 smithi049 bash[23528]: audit 2024-09-21T01:04:18.440787+0000 mgr.a (mgr.14388) 7347 : audit [DBG] from='client.166332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:20 smithi044 bash[22676]: cluster 2024-09-21T01:04:19.560685+0000 mgr.a (mgr.14388) 7348 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:20 smithi044 bash[22676]: audit 2024-09-21T01:04:20.181343+0000 mon.a (mon.0) 6338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:20 smithi044 bash[22676]: audit 2024-09-21T01:04:20.190219+0000 mon.a (mon.0) 6339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:20 smithi044 bash[22676]: audit 2024-09-21T01:04:20.201110+0000 mon.a (mon.0) 6340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:20 smithi179 bash[23186]: cluster 2024-09-21T01:04:19.560685+0000 mgr.a (mgr.14388) 7348 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:20 smithi179 bash[23186]: audit 2024-09-21T01:04:20.181343+0000 mon.a (mon.0) 6338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:20 smithi179 bash[23186]: audit 2024-09-21T01:04:20.190219+0000 mon.a (mon.0) 6339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:20 smithi179 bash[23186]: audit 2024-09-21T01:04:20.201110+0000 mon.a (mon.0) 6340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:20 smithi049 bash[23528]: cluster 2024-09-21T01:04:19.560685+0000 mgr.a (mgr.14388) 7348 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:20 smithi049 bash[23528]: audit 2024-09-21T01:04:20.181343+0000 mon.a (mon.0) 6338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:20 smithi049 bash[23528]: audit 2024-09-21T01:04:20.190219+0000 mon.a (mon.0) 6339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:20 smithi049 bash[23528]: audit 2024-09-21T01:04:20.201110+0000 mon.a (mon.0) 6340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:22 smithi044 bash[22676]: cluster 2024-09-21T01:04:21.562970+0000 mgr.a (mgr.14388) 7349 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:22 smithi179 bash[23186]: cluster 2024-09-21T01:04:21.562970+0000 mgr.a (mgr.14388) 7349 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:23.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:22 smithi049 bash[23528]: cluster 2024-09-21T01:04:21.562970+0000 mgr.a (mgr.14388) 7349 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:24.654 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:24.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:24.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:24.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:24.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:24 smithi044 bash[22676]: cluster 2024-09-21T01:04:23.563730+0000 mgr.a (mgr.14388) 7350 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:24 smithi179 bash[23186]: cluster 2024-09-21T01:04:23.563730+0000 mgr.a (mgr.14388) 7350 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:24 smithi049 bash[23528]: cluster 2024-09-21T01:04:23.563730+0000 mgr.a (mgr.14388) 7350 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:25 smithi044 bash[22676]: audit 2024-09-21T01:04:24.200264+0000 mgr.a (mgr.14388) 7351 : audit [DBG] from='client.166410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:25 smithi179 bash[23186]: audit 2024-09-21T01:04:24.200264+0000 mgr.a (mgr.14388) 7351 : audit [DBG] from='client.166410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:25 smithi049 bash[23528]: audit 2024-09-21T01:04:24.200264+0000 mgr.a (mgr.14388) 7351 : audit [DBG] from='client.166410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:26.919 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:26 smithi049 bash[23528]: cluster 2024-09-21T01:04:25.566055+0000 mgr.a (mgr.14388) 7352 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:26 smithi044 bash[22676]: cluster 2024-09-21T01:04:25.566055+0000 mgr.a (mgr.14388) 7352 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:26 smithi179 bash[23186]: cluster 2024-09-21T01:04:25.566055+0000 mgr.a (mgr.14388) 7352 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:28.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:28 smithi049 bash[23528]: cluster 2024-09-21T01:04:27.566571+0000 mgr.a (mgr.14388) 7353 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:28 smithi044 bash[22676]: cluster 2024-09-21T01:04:27.566571+0000 mgr.a (mgr.14388) 7353 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:28 smithi179 bash[23186]: cluster 2024-09-21T01:04:27.566571+0000 mgr.a (mgr.14388) 7353 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:29.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:30.451 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:30.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:30.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:30.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:30.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:30 smithi044 bash[22676]: cluster 2024-09-21T01:04:29.567280+0000 mgr.a (mgr.14388) 7354 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:30 smithi044 bash[22676]: audit 2024-09-21T01:04:29.992973+0000 mgr.a (mgr.14388) 7355 : audit [DBG] from='client.166485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:30 smithi179 bash[23186]: cluster 2024-09-21T01:04:29.567280+0000 mgr.a (mgr.14388) 7354 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:30 smithi179 bash[23186]: audit 2024-09-21T01:04:29.992973+0000 mgr.a (mgr.14388) 7355 : audit [DBG] from='client.166485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:30 smithi049 bash[23528]: cluster 2024-09-21T01:04:29.567280+0000 mgr.a (mgr.14388) 7354 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:30 smithi049 bash[23528]: audit 2024-09-21T01:04:29.992973+0000 mgr.a (mgr.14388) 7355 : audit [DBG] from='client.166485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:32 smithi044 bash[22676]: cluster 2024-09-21T01:04:31.570221+0000 mgr.a (mgr.14388) 7356 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:32 smithi179 bash[23186]: cluster 2024-09-21T01:04:31.570221+0000 mgr.a (mgr.14388) 7356 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:32 smithi049 bash[23528]: cluster 2024-09-21T01:04:31.570221+0000 mgr.a (mgr.14388) 7356 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:34 smithi044 bash[22676]: cluster 2024-09-21T01:04:33.571052+0000 mgr.a (mgr.14388) 7357 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:04:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:34 smithi179 bash[23186]: cluster 2024-09-21T01:04:33.571052+0000 mgr.a (mgr.14388) 7357 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:04:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:34 smithi049 bash[23528]: cluster 2024-09-21T01:04:33.571052+0000 mgr.a (mgr.14388) 7357 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:04:35.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:35.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:35.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:36.208 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:36.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:36 smithi044 bash[22676]: cluster 2024-09-21T01:04:35.572033+0000 mgr.a (mgr.14388) 7358 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:36 smithi044 bash[22676]: audit 2024-09-21T01:04:35.787920+0000 mgr.a (mgr.14388) 7359 : audit [DBG] from='client.166557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:36 smithi179 bash[23186]: cluster 2024-09-21T01:04:35.572033+0000 mgr.a (mgr.14388) 7358 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:36 smithi179 bash[23186]: audit 2024-09-21T01:04:35.787920+0000 mgr.a (mgr.14388) 7359 : audit [DBG] from='client.166557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:36 smithi049 bash[23528]: cluster 2024-09-21T01:04:35.572033+0000 mgr.a (mgr.14388) 7358 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:36 smithi049 bash[23528]: audit 2024-09-21T01:04:35.787920+0000 mgr.a (mgr.14388) 7359 : audit [DBG] from='client.166557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:37.892 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:37 smithi179 bash[23186]: audit 2024-09-21T01:04:37.174643+0000 mon.a (mon.0) 6341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:04:37.892 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:37 smithi179 bash[23186]: audit 2024-09-21T01:04:37.182549+0000 mon.a (mon.0) 6342 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:04:37.892 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:37 smithi179 bash[23186]: audit 2024-09-21T01:04:37.184440+0000 mon.a (mon.0) 6343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:04:37.892 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:37 smithi179 bash[23186]: audit 2024-09-21T01:04:37.196342+0000 mon.a (mon.0) 6344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:37.892 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:37 smithi179 bash[23186]: audit 2024-09-21T01:04:37.203176+0000 mon.a (mon.0) 6345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:04:37.942 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:37 smithi044 bash[22676]: audit 2024-09-21T01:04:37.174643+0000 mon.a (mon.0) 6341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:04:37.942 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:37 smithi044 bash[22676]: audit 2024-09-21T01:04:37.182549+0000 mon.a (mon.0) 6342 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:04:37.943 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:37 smithi044 bash[22676]: audit 2024-09-21T01:04:37.184440+0000 mon.a (mon.0) 6343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:04:37.943 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:37 smithi044 bash[22676]: audit 2024-09-21T01:04:37.196342+0000 mon.a (mon.0) 6344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:37.943 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:37 smithi044 bash[22676]: audit 2024-09-21T01:04:37.203176+0000 mon.a (mon.0) 6345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:04:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:37 smithi049 bash[23528]: audit 2024-09-21T01:04:37.174643+0000 mon.a (mon.0) 6341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:04:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:37 smithi049 bash[23528]: audit 2024-09-21T01:04:37.182549+0000 mon.a (mon.0) 6342 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:04:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:37 smithi049 bash[23528]: audit 2024-09-21T01:04:37.184440+0000 mon.a (mon.0) 6343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:04:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:37 smithi049 bash[23528]: audit 2024-09-21T01:04:37.196342+0000 mon.a (mon.0) 6344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:37 smithi049 bash[23528]: audit 2024-09-21T01:04:37.203176+0000 mon.a (mon.0) 6345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:04:38.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:04:37 smithi044 bash[22930]: debug 2024-09-21T01:04:37.937+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:04:38.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:04:37 smithi044 bash[22930]: debug 2024-09-21T01:04:37.937+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:04:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:37.205806+0000 mgr.a (mgr.14388) 7360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:04:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: cluster 2024-09-21T01:04:37.572546+0000 mgr.a (mgr.14388) 7361 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:37.715972+0000 mon.a (mon.0) 6346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:37.721216+0000 mon.a (mon.0) 6347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:37.726426+0000 mon.a (mon.0) 6348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:37.943052+0000 mgr.a (mgr.14388) 7362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:04:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: cephadm 2024-09-21T01:04:37.944462+0000 mgr.a (mgr.14388) 7363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:04:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:38.647076+0000 mon.a (mon.0) 6349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:38.653955+0000 mon.a (mon.0) 6350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:38 smithi044 bash[22676]: audit 2024-09-21T01:04:38.661753+0000 mon.a (mon.0) 6351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:37.205806+0000 mgr.a (mgr.14388) 7360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: cluster 2024-09-21T01:04:37.572546+0000 mgr.a (mgr.14388) 7361 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:37.715972+0000 mon.a (mon.0) 6346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:37.721216+0000 mon.a (mon.0) 6347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:37.726426+0000 mon.a (mon.0) 6348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:37.943052+0000 mgr.a (mgr.14388) 7362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: cephadm 2024-09-21T01:04:37.944462+0000 mgr.a (mgr.14388) 7363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:38.647076+0000 mon.a (mon.0) 6349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:38.653955+0000 mon.a (mon.0) 6350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:38 smithi179 bash[23186]: audit 2024-09-21T01:04:38.661753+0000 mon.a (mon.0) 6351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:37.205806+0000 mgr.a (mgr.14388) 7360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: cluster 2024-09-21T01:04:37.572546+0000 mgr.a (mgr.14388) 7361 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:37.715972+0000 mon.a (mon.0) 6346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:37.721216+0000 mon.a (mon.0) 6347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:37.726426+0000 mon.a (mon.0) 6348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:37.943052+0000 mgr.a (mgr.14388) 7362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: cephadm 2024-09-21T01:04:37.944462+0000 mgr.a (mgr.14388) 7363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:38.647076+0000 mon.a (mon.0) 6349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:38.653955+0000 mon.a (mon.0) 6350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:38 smithi049 bash[23528]: audit 2024-09-21T01:04:38.661753+0000 mon.a (mon.0) 6351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:40 smithi044 bash[22676]: cluster 2024-09-21T01:04:39.573059+0000 mgr.a (mgr.14388) 7364 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:40 smithi044 bash[22676]: audit 2024-09-21T01:04:40.386340+0000 mon.a (mon.0) 6352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:40 smithi044 bash[22676]: audit 2024-09-21T01:04:40.395522+0000 mon.a (mon.0) 6353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:40 smithi044 bash[22676]: audit 2024-09-21T01:04:40.407506+0000 mon.a (mon.0) 6354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:40 smithi179 bash[23186]: cluster 2024-09-21T01:04:39.573059+0000 mgr.a (mgr.14388) 7364 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:40 smithi179 bash[23186]: audit 2024-09-21T01:04:40.386340+0000 mon.a (mon.0) 6352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:40 smithi179 bash[23186]: audit 2024-09-21T01:04:40.395522+0000 mon.a (mon.0) 6353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:40 smithi179 bash[23186]: audit 2024-09-21T01:04:40.407506+0000 mon.a (mon.0) 6354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:40 smithi049 bash[23528]: cluster 2024-09-21T01:04:39.573059+0000 mgr.a (mgr.14388) 7364 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:04:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:40 smithi049 bash[23528]: audit 2024-09-21T01:04:40.386340+0000 mon.a (mon.0) 6352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:40 smithi049 bash[23528]: audit 2024-09-21T01:04:40.395522+0000 mon.a (mon.0) 6353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:40 smithi049 bash[23528]: audit 2024-09-21T01:04:40.407506+0000 mon.a (mon.0) 6354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:41.995 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:41.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:41.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:41.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:41.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:42 smithi044 bash[22676]: audit 2024-09-21T01:04:41.547593+0000 mgr.a (mgr.14388) 7365 : audit [DBG] from='client.166734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:42 smithi044 bash[22676]: cluster 2024-09-21T01:04:41.576060+0000 mgr.a (mgr.14388) 7366 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:42 smithi179 bash[23186]: audit 2024-09-21T01:04:41.547593+0000 mgr.a (mgr.14388) 7365 : audit [DBG] from='client.166734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:42 smithi179 bash[23186]: cluster 2024-09-21T01:04:41.576060+0000 mgr.a (mgr.14388) 7366 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:42 smithi049 bash[23528]: audit 2024-09-21T01:04:41.547593+0000 mgr.a (mgr.14388) 7365 : audit [DBG] from='client.166734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:42 smithi049 bash[23528]: cluster 2024-09-21T01:04:41.576060+0000 mgr.a (mgr.14388) 7366 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:44 smithi044 bash[22676]: cluster 2024-09-21T01:04:43.577004+0000 mgr.a (mgr.14388) 7367 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:44 smithi179 bash[23186]: cluster 2024-09-21T01:04:43.577004+0000 mgr.a (mgr.14388) 7367 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:44 smithi049 bash[23528]: cluster 2024-09-21T01:04:43.577004+0000 mgr.a (mgr.14388) 7367 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:46 smithi044 bash[22676]: cluster 2024-09-21T01:04:45.579173+0000 mgr.a (mgr.14388) 7368 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:46.990 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:46 smithi049 bash[23528]: cluster 2024-09-21T01:04:45.579173+0000 mgr.a (mgr.14388) 7368 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:46 smithi179 bash[23186]: cluster 2024-09-21T01:04:45.579173+0000 mgr.a (mgr.14388) 7368 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:47.784 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:47.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:47.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:47.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:47.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:48 smithi179 bash[23186]: audit 2024-09-21T01:04:47.331242+0000 mgr.a (mgr.14388) 7369 : audit [DBG] from='client.166812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:48 smithi179 bash[23186]: cluster 2024-09-21T01:04:47.579758+0000 mgr.a (mgr.14388) 7370 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:48 smithi049 bash[23528]: audit 2024-09-21T01:04:47.331242+0000 mgr.a (mgr.14388) 7369 : audit [DBG] from='client.166812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:48 smithi049 bash[23528]: cluster 2024-09-21T01:04:47.579758+0000 mgr.a (mgr.14388) 7370 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:48 smithi044 bash[22676]: audit 2024-09-21T01:04:47.331242+0000 mgr.a (mgr.14388) 7369 : audit [DBG] from='client.166812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:48 smithi044 bash[22676]: cluster 2024-09-21T01:04:47.579758+0000 mgr.a (mgr.14388) 7370 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:50 smithi044 bash[22676]: cluster 2024-09-21T01:04:49.580629+0000 mgr.a (mgr.14388) 7371 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:50 smithi179 bash[23186]: cluster 2024-09-21T01:04:49.580629+0000 mgr.a (mgr.14388) 7371 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:50 smithi049 bash[23528]: cluster 2024-09-21T01:04:49.580629+0000 mgr.a (mgr.14388) 7371 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:52.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:52.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:52.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:52 smithi179 bash[23186]: cluster 2024-09-21T01:04:51.582896+0000 mgr.a (mgr.14388) 7372 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:52 smithi049 bash[23528]: cluster 2024-09-21T01:04:51.582896+0000 mgr.a (mgr.14388) 7372 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:52 smithi044 bash[22676]: cluster 2024-09-21T01:04:51.582896+0000 mgr.a (mgr.14388) 7372 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:04:53.577 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:53 smithi049 bash[23528]: audit 2024-09-21T01:04:53.122784+0000 mgr.a (mgr.14388) 7373 : audit [DBG] from='client.166890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:53 smithi044 bash[22676]: audit 2024-09-21T01:04:53.122784+0000 mgr.a (mgr.14388) 7373 : audit [DBG] from='client.166890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:53 smithi179 bash[23186]: audit 2024-09-21T01:04:53.122784+0000 mgr.a (mgr.14388) 7373 : audit [DBG] from='client.166890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:54 smithi049 bash[23528]: cluster 2024-09-21T01:04:53.583551+0000 mgr.a (mgr.14388) 7374 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:54 smithi044 bash[22676]: cluster 2024-09-21T01:04:53.583551+0000 mgr.a (mgr.14388) 7374 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:54 smithi179 bash[23186]: cluster 2024-09-21T01:04:53.583551+0000 mgr.a (mgr.14388) 7374 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:56.946 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:56 smithi179 bash[23186]: cluster 2024-09-21T01:04:55.585713+0000 mgr.a (mgr.14388) 7375 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:56 smithi044 bash[22676]: cluster 2024-09-21T01:04:55.585713+0000 mgr.a (mgr.14388) 7375 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:57.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:56 smithi049 bash[23528]: cluster 2024-09-21T01:04:55.585713+0000 mgr.a (mgr.14388) 7375 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:04:58.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:04:58.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:04:58.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:04:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:58 smithi044 bash[22676]: cluster 2024-09-21T01:04:57.586504+0000 mgr.a (mgr.14388) 7376 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:58 smithi044 bash[22676]: audit 2024-09-21T01:04:57.906885+0000 mon.a (mon.0) 6355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:58 smithi044 bash[22676]: audit 2024-09-21T01:04:57.913785+0000 mon.a (mon.0) 6356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:58 smithi044 bash[22676]: audit 2024-09-21T01:04:57.921795+0000 mon.a (mon.0) 6357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:58 smithi044 bash[22676]: audit 2024-09-21T01:04:58.774851+0000 mon.a (mon.0) 6358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:58 smithi044 bash[22676]: audit 2024-09-21T01:04:58.780091+0000 mon.a (mon.0) 6359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:58 smithi044 bash[22676]: audit 2024-09-21T01:04:58.785719+0000 mon.a (mon.0) 6360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:58 smithi179 bash[23186]: cluster 2024-09-21T01:04:57.586504+0000 mgr.a (mgr.14388) 7376 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:59.237 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:58 smithi179 bash[23186]: audit 2024-09-21T01:04:57.906885+0000 mon.a (mon.0) 6355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.238 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:58 smithi179 bash[23186]: audit 2024-09-21T01:04:57.913785+0000 mon.a (mon.0) 6356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.238 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:58 smithi179 bash[23186]: audit 2024-09-21T01:04:57.921795+0000 mon.a (mon.0) 6357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.238 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:58 smithi179 bash[23186]: audit 2024-09-21T01:04:58.774851+0000 mon.a (mon.0) 6358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.238 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:58 smithi179 bash[23186]: audit 2024-09-21T01:04:58.780091+0000 mon.a (mon.0) 6359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.238 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:58 smithi179 bash[23186]: audit 2024-09-21T01:04:58.785719+0000 mon.a (mon.0) 6360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:58 smithi049 bash[23528]: cluster 2024-09-21T01:04:57.586504+0000 mgr.a (mgr.14388) 7376 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:04:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:58 smithi049 bash[23528]: audit 2024-09-21T01:04:57.906885+0000 mon.a (mon.0) 6355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:58 smithi049 bash[23528]: audit 2024-09-21T01:04:57.913785+0000 mon.a (mon.0) 6356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:58 smithi049 bash[23528]: audit 2024-09-21T01:04:57.921795+0000 mon.a (mon.0) 6357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:58 smithi049 bash[23528]: audit 2024-09-21T01:04:58.774851+0000 mon.a (mon.0) 6358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:58 smithi049 bash[23528]: audit 2024-09-21T01:04:58.780091+0000 mon.a (mon.0) 6359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:58 smithi049 bash[23528]: audit 2024-09-21T01:04:58.785719+0000 mon.a (mon.0) 6360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:04:59.360 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:04:59.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:04:59.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:04:59.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:04:59.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:04:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:04:59 smithi044 bash[22676]: audit 2024-09-21T01:04:58.923302+0000 mgr.a (mgr.14388) 7377 : audit [DBG] from='client.166965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:04:59 smithi179 bash[23186]: audit 2024-09-21T01:04:58.923302+0000 mgr.a (mgr.14388) 7377 : audit [DBG] from='client.166965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:00.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:04:59 smithi049 bash[23528]: audit 2024-09-21T01:04:58.923302+0000 mgr.a (mgr.14388) 7377 : audit [DBG] from='client.166965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:00 smithi044 bash[22676]: cluster 2024-09-21T01:04:59.587518+0000 mgr.a (mgr.14388) 7378 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:00 smithi044 bash[22676]: audit 2024-09-21T01:05:00.608557+0000 mon.a (mon.0) 6361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:00 smithi044 bash[22676]: audit 2024-09-21T01:05:00.617733+0000 mon.a (mon.0) 6362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:00 smithi044 bash[22676]: audit 2024-09-21T01:05:00.628623+0000 mon.a (mon.0) 6363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:00 smithi179 bash[23186]: cluster 2024-09-21T01:04:59.587518+0000 mgr.a (mgr.14388) 7378 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:00 smithi179 bash[23186]: audit 2024-09-21T01:05:00.608557+0000 mon.a (mon.0) 6361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:00 smithi179 bash[23186]: audit 2024-09-21T01:05:00.617733+0000 mon.a (mon.0) 6362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:00 smithi179 bash[23186]: audit 2024-09-21T01:05:00.628623+0000 mon.a (mon.0) 6363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:00 smithi049 bash[23528]: cluster 2024-09-21T01:04:59.587518+0000 mgr.a (mgr.14388) 7378 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:00 smithi049 bash[23528]: audit 2024-09-21T01:05:00.608557+0000 mon.a (mon.0) 6361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:00 smithi049 bash[23528]: audit 2024-09-21T01:05:00.617733+0000 mon.a (mon.0) 6362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:00 smithi049 bash[23528]: audit 2024-09-21T01:05:00.628623+0000 mon.a (mon.0) 6363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:02 smithi044 bash[22676]: cluster 2024-09-21T01:05:01.589791+0000 mgr.a (mgr.14388) 7379 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:02 smithi179 bash[23186]: cluster 2024-09-21T01:05:01.589791+0000 mgr.a (mgr.14388) 7379 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:02 smithi049 bash[23528]: cluster 2024-09-21T01:05:01.589791+0000 mgr.a (mgr.14388) 7379 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:05.143 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:05.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:05.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:05.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:05.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:04 smithi044 bash[22676]: cluster 2024-09-21T01:05:03.590571+0000 mgr.a (mgr.14388) 7380 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:04 smithi179 bash[23186]: cluster 2024-09-21T01:05:03.590571+0000 mgr.a (mgr.14388) 7380 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:04 smithi049 bash[23528]: cluster 2024-09-21T01:05:03.590571+0000 mgr.a (mgr.14388) 7380 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:05 smithi044 bash[22676]: audit 2024-09-21T01:05:04.700557+0000 mgr.a (mgr.14388) 7381 : audit [DBG] from='client.167040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:05 smithi179 bash[23186]: audit 2024-09-21T01:05:04.700557+0000 mgr.a (mgr.14388) 7381 : audit [DBG] from='client.167040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:05 smithi049 bash[23528]: audit 2024-09-21T01:05:04.700557+0000 mgr.a (mgr.14388) 7381 : audit [DBG] from='client.167040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:06 smithi044 bash[22676]: cluster 2024-09-21T01:05:05.593551+0000 mgr.a (mgr.14388) 7382 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:05:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:06 smithi179 bash[23186]: cluster 2024-09-21T01:05:05.593551+0000 mgr.a (mgr.14388) 7382 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:05:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:06 smithi049 bash[23528]: cluster 2024-09-21T01:05:05.593551+0000 mgr.a (mgr.14388) 7382 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:05:09.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:08 smithi049 bash[23528]: cluster 2024-09-21T01:05:07.594390+0000 mgr.a (mgr.14388) 7383 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:05:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:08 smithi044 bash[22676]: cluster 2024-09-21T01:05:07.594390+0000 mgr.a (mgr.14388) 7383 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:05:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:08 smithi179 bash[23186]: cluster 2024-09-21T01:05:07.594390+0000 mgr.a (mgr.14388) 7383 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:05:10.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:10.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:10.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:10.937 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:10.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:10.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:10.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:10 smithi044 bash[22676]: cluster 2024-09-21T01:05:09.595178+0000 mgr.a (mgr.14388) 7384 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:05:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:10 smithi179 bash[23186]: cluster 2024-09-21T01:05:09.595178+0000 mgr.a (mgr.14388) 7384 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:05:11.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:10 smithi049 bash[23528]: cluster 2024-09-21T01:05:09.595178+0000 mgr.a (mgr.14388) 7384 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:05:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:11 smithi044 bash[22676]: audit 2024-09-21T01:05:10.485653+0000 mgr.a (mgr.14388) 7385 : audit [DBG] from='client.167112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:11 smithi179 bash[23186]: audit 2024-09-21T01:05:10.485653+0000 mgr.a (mgr.14388) 7385 : audit [DBG] from='client.167112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:12.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:11 smithi049 bash[23528]: audit 2024-09-21T01:05:10.485653+0000 mgr.a (mgr.14388) 7385 : audit [DBG] from='client.167112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:12 smithi044 bash[22676]: cluster 2024-09-21T01:05:11.598128+0000 mgr.a (mgr.14388) 7386 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:12 smithi179 bash[23186]: cluster 2024-09-21T01:05:11.598128+0000 mgr.a (mgr.14388) 7386 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:12 smithi049 bash[23528]: cluster 2024-09-21T01:05:11.598128+0000 mgr.a (mgr.14388) 7386 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:14 smithi044 bash[22676]: cluster 2024-09-21T01:05:13.598918+0000 mgr.a (mgr.14388) 7387 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:05:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:14 smithi179 bash[23186]: cluster 2024-09-21T01:05:13.598918+0000 mgr.a (mgr.14388) 7387 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:05:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:14 smithi049 bash[23528]: cluster 2024-09-21T01:05:13.598918+0000 mgr.a (mgr.14388) 7387 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:05:15.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:15.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:15.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:16.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:16.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:16.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:16.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:16.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:16 smithi044 bash[22676]: cluster 2024-09-21T01:05:15.600885+0000 mgr.a (mgr.14388) 7388 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:16 smithi179 bash[23186]: cluster 2024-09-21T01:05:15.600885+0000 mgr.a (mgr.14388) 7388 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:16 smithi049 bash[23528]: cluster 2024-09-21T01:05:15.600885+0000 mgr.a (mgr.14388) 7388 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:17 smithi044 bash[22676]: audit 2024-09-21T01:05:16.272964+0000 mgr.a (mgr.14388) 7389 : audit [DBG] from='client.167187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:17 smithi179 bash[23186]: audit 2024-09-21T01:05:16.272964+0000 mgr.a (mgr.14388) 7389 : audit [DBG] from='client.167187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:17 smithi049 bash[23528]: audit 2024-09-21T01:05:16.272964+0000 mgr.a (mgr.14388) 7389 : audit [DBG] from='client.167187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:19 smithi044 bash[22676]: cluster 2024-09-21T01:05:17.601855+0000 mgr.a (mgr.14388) 7390 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:05:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:19 smithi044 bash[22676]: audit 2024-09-21T01:05:18.114126+0000 mon.a (mon.0) 6364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:19 smithi044 bash[22676]: audit 2024-09-21T01:05:18.120634+0000 mon.a (mon.0) 6365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:19 smithi044 bash[22676]: audit 2024-09-21T01:05:18.127924+0000 mon.a (mon.0) 6366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:19 smithi044 bash[22676]: audit 2024-09-21T01:05:18.929764+0000 mon.a (mon.0) 6367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:19 smithi044 bash[22676]: audit 2024-09-21T01:05:18.935132+0000 mon.a (mon.0) 6368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:19 smithi044 bash[22676]: audit 2024-09-21T01:05:18.943313+0000 mon.a (mon.0) 6369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:19 smithi179 bash[23186]: cluster 2024-09-21T01:05:17.601855+0000 mgr.a (mgr.14388) 7390 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:05:19.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:19 smithi179 bash[23186]: audit 2024-09-21T01:05:18.114126+0000 mon.a (mon.0) 6364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:19 smithi179 bash[23186]: audit 2024-09-21T01:05:18.120634+0000 mon.a (mon.0) 6365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:19 smithi179 bash[23186]: audit 2024-09-21T01:05:18.127924+0000 mon.a (mon.0) 6366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:19 smithi179 bash[23186]: audit 2024-09-21T01:05:18.929764+0000 mon.a (mon.0) 6367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:19 smithi179 bash[23186]: audit 2024-09-21T01:05:18.935132+0000 mon.a (mon.0) 6368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.410 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:19 smithi179 bash[23186]: audit 2024-09-21T01:05:18.943313+0000 mon.a (mon.0) 6369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:19 smithi049 bash[23528]: cluster 2024-09-21T01:05:17.601855+0000 mgr.a (mgr.14388) 7390 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:05:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:19 smithi049 bash[23528]: audit 2024-09-21T01:05:18.114126+0000 mon.a (mon.0) 6364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:19 smithi049 bash[23528]: audit 2024-09-21T01:05:18.120634+0000 mon.a (mon.0) 6365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:19 smithi049 bash[23528]: audit 2024-09-21T01:05:18.127924+0000 mon.a (mon.0) 6366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:19 smithi049 bash[23528]: audit 2024-09-21T01:05:18.929764+0000 mon.a (mon.0) 6367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:19 smithi049 bash[23528]: audit 2024-09-21T01:05:18.935132+0000 mon.a (mon.0) 6368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:19 smithi049 bash[23528]: audit 2024-09-21T01:05:18.943313+0000 mon.a (mon.0) 6369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:21 smithi044 bash[22676]: cluster 2024-09-21T01:05:19.602611+0000 mgr.a (mgr.14388) 7391 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:05:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:21 smithi044 bash[22676]: audit 2024-09-21T01:05:20.838382+0000 mon.a (mon.0) 6370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:21 smithi044 bash[22676]: audit 2024-09-21T01:05:20.847687+0000 mon.a (mon.0) 6371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:21 smithi044 bash[22676]: audit 2024-09-21T01:05:20.858295+0000 mon.a (mon.0) 6372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:21 smithi179 bash[23186]: cluster 2024-09-21T01:05:19.602611+0000 mgr.a (mgr.14388) 7391 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:05:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:21 smithi179 bash[23186]: audit 2024-09-21T01:05:20.838382+0000 mon.a (mon.0) 6370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:21 smithi179 bash[23186]: audit 2024-09-21T01:05:20.847687+0000 mon.a (mon.0) 6371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:21 smithi179 bash[23186]: audit 2024-09-21T01:05:20.858295+0000 mon.a (mon.0) 6372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:21 smithi049 bash[23528]: cluster 2024-09-21T01:05:19.602611+0000 mgr.a (mgr.14388) 7391 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:05:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:21 smithi049 bash[23528]: audit 2024-09-21T01:05:20.838382+0000 mon.a (mon.0) 6370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:21 smithi049 bash[23528]: audit 2024-09-21T01:05:20.847687+0000 mon.a (mon.0) 6371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:21 smithi049 bash[23528]: audit 2024-09-21T01:05:20.858295+0000 mon.a (mon.0) 6372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:21.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:21.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:21.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:22.490 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:22.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:22.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:22.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:22.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:23 smithi044 bash[22676]: cluster 2024-09-21T01:05:21.604831+0000 mgr.a (mgr.14388) 7392 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:05:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:23 smithi044 bash[22676]: audit 2024-09-21T01:05:22.041240+0000 mgr.a (mgr.14388) 7393 : audit [DBG] from='client.167265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:23 smithi179 bash[23186]: cluster 2024-09-21T01:05:21.604831+0000 mgr.a (mgr.14388) 7392 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:05:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:23 smithi179 bash[23186]: audit 2024-09-21T01:05:22.041240+0000 mgr.a (mgr.14388) 7393 : audit [DBG] from='client.167265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:23 smithi049 bash[23528]: cluster 2024-09-21T01:05:21.604831+0000 mgr.a (mgr.14388) 7392 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:05:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:23 smithi049 bash[23528]: audit 2024-09-21T01:05:22.041240+0000 mgr.a (mgr.14388) 7393 : audit [DBG] from='client.167265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:25 smithi044 bash[22676]: cluster 2024-09-21T01:05:23.605818+0000 mgr.a (mgr.14388) 7394 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:25 smithi179 bash[23186]: cluster 2024-09-21T01:05:23.605818+0000 mgr.a (mgr.14388) 7394 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:25 smithi049 bash[23528]: cluster 2024-09-21T01:05:23.605818+0000 mgr.a (mgr.14388) 7394 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:27 smithi044 bash[22676]: cluster 2024-09-21T01:05:25.608012+0000 mgr.a (mgr.14388) 7395 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:27.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:27.492 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:27.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:27.501 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:27 smithi049 bash[23528]: cluster 2024-09-21T01:05:25.608012+0000 mgr.a (mgr.14388) 7395 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:27 smithi179 bash[23186]: cluster 2024-09-21T01:05:25.608012+0000 mgr.a (mgr.14388) 7395 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:28.289 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:28.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:28.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:28.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:28.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:29 smithi049 bash[23528]: cluster 2024-09-21T01:05:27.608432+0000 mgr.a (mgr.14388) 7396 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:29 smithi049 bash[23528]: audit 2024-09-21T01:05:27.830271+0000 mgr.a (mgr.14388) 7397 : audit [DBG] from='client.167340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:29 smithi044 bash[22676]: cluster 2024-09-21T01:05:27.608432+0000 mgr.a (mgr.14388) 7396 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:29 smithi044 bash[22676]: audit 2024-09-21T01:05:27.830271+0000 mgr.a (mgr.14388) 7397 : audit [DBG] from='client.167340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:29 smithi179 bash[23186]: cluster 2024-09-21T01:05:27.608432+0000 mgr.a (mgr.14388) 7396 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:29 smithi179 bash[23186]: audit 2024-09-21T01:05:27.830271+0000 mgr.a (mgr.14388) 7397 : audit [DBG] from='client.167340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:31 smithi044 bash[22676]: cluster 2024-09-21T01:05:29.609341+0000 mgr.a (mgr.14388) 7398 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:31 smithi179 bash[23186]: cluster 2024-09-21T01:05:29.609341+0000 mgr.a (mgr.14388) 7398 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:31 smithi049 bash[23528]: cluster 2024-09-21T01:05:29.609341+0000 mgr.a (mgr.14388) 7398 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:33.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:33.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:33.292 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:33 smithi044 bash[22676]: cluster 2024-09-21T01:05:31.611659+0000 mgr.a (mgr.14388) 7399 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:33 smithi179 bash[23186]: cluster 2024-09-21T01:05:31.611659+0000 mgr.a (mgr.14388) 7399 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:33 smithi049 bash[23528]: cluster 2024-09-21T01:05:31.611659+0000 mgr.a (mgr.14388) 7399 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:34.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:34.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:34.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:34.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:34.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:35 smithi044 bash[22676]: cluster 2024-09-21T01:05:33.612437+0000 mgr.a (mgr.14388) 7400 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:35 smithi044 bash[22676]: audit 2024-09-21T01:05:33.625673+0000 mgr.a (mgr.14388) 7401 : audit [DBG] from='client.167415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:35 smithi179 bash[23186]: cluster 2024-09-21T01:05:33.612437+0000 mgr.a (mgr.14388) 7400 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:35 smithi179 bash[23186]: audit 2024-09-21T01:05:33.625673+0000 mgr.a (mgr.14388) 7401 : audit [DBG] from='client.167415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:35 smithi049 bash[23528]: cluster 2024-09-21T01:05:33.612437+0000 mgr.a (mgr.14388) 7400 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:35 smithi049 bash[23528]: audit 2024-09-21T01:05:33.625673+0000 mgr.a (mgr.14388) 7401 : audit [DBG] from='client.167415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:36 smithi044 bash[22676]: cluster 2024-09-21T01:05:35.614808+0000 mgr.a (mgr.14388) 7402 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:36 smithi179 bash[23186]: cluster 2024-09-21T01:05:35.614808+0000 mgr.a (mgr.14388) 7402 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:36 smithi049 bash[23528]: cluster 2024-09-21T01:05:35.614808+0000 mgr.a (mgr.14388) 7402 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:05:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: cluster 2024-09-21T01:05:37.615749+0000 mgr.a (mgr.14388) 7403 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.002737+0000 mon.a (mon.0) 6373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.009872+0000 mon.a (mon.0) 6374 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.011811+0000 mon.a (mon.0) 6375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.024665+0000 mon.a (mon.0) 6376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.031176+0000 mon.a (mon.0) 6377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.033707+0000 mgr.a (mgr.14388) 7404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.319257+0000 mon.a (mon.0) 6378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.324891+0000 mon.a (mon.0) 6379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22676]: audit 2024-09-21T01:05:38.331353+0000 mon.a (mon.0) 6380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: cluster 2024-09-21T01:05:37.615749+0000 mgr.a (mgr.14388) 7403 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.002737+0000 mon.a (mon.0) 6373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:05:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.009872+0000 mon.a (mon.0) 6374 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.011811+0000 mon.a (mon.0) 6375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.024665+0000 mon.a (mon.0) 6376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.031176+0000 mon.a (mon.0) 6377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.033707+0000 mgr.a (mgr.14388) 7404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.319257+0000 mon.a (mon.0) 6378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.324891+0000 mon.a (mon.0) 6379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:38 smithi179 bash[23186]: audit 2024-09-21T01:05:38.331353+0000 mon.a (mon.0) 6380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: cluster 2024-09-21T01:05:37.615749+0000 mgr.a (mgr.14388) 7403 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.002737+0000 mon.a (mon.0) 6373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.009872+0000 mon.a (mon.0) 6374 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.011811+0000 mon.a (mon.0) 6375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.024665+0000 mon.a (mon.0) 6376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.031176+0000 mon.a (mon.0) 6377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.033707+0000 mgr.a (mgr.14388) 7404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:05:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.319257+0000 mon.a (mon.0) 6378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.324891+0000 mon.a (mon.0) 6379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:38 smithi049 bash[23528]: audit 2024-09-21T01:05:38.331353+0000 mon.a (mon.0) 6380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:39.081 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22930]: debug 2024-09-21T01:05:38.764+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:05:39.082 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:05:38 smithi044 bash[22930]: debug 2024-09-21T01:05:38.764+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:05:39.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:39.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:39.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:39.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:39.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:40 smithi044 bash[22676]: audit 2024-09-21T01:05:38.765813+0000 mgr.a (mgr.14388) 7405 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:40 smithi044 bash[22676]: cephadm 2024-09-21T01:05:38.766843+0000 mgr.a (mgr.14388) 7406 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:40 smithi044 bash[22676]: audit 2024-09-21T01:05:39.069297+0000 mon.a (mon.0) 6381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:40 smithi044 bash[22676]: audit 2024-09-21T01:05:39.074387+0000 mon.a (mon.0) 6382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:40 smithi044 bash[22676]: audit 2024-09-21T01:05:39.081233+0000 mon.a (mon.0) 6383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:40 smithi179 bash[23186]: audit 2024-09-21T01:05:38.765813+0000 mgr.a (mgr.14388) 7405 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:05:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:40 smithi179 bash[23186]: cephadm 2024-09-21T01:05:38.766843+0000 mgr.a (mgr.14388) 7406 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:05:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:40 smithi179 bash[23186]: audit 2024-09-21T01:05:39.069297+0000 mon.a (mon.0) 6381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:40 smithi179 bash[23186]: audit 2024-09-21T01:05:39.074387+0000 mon.a (mon.0) 6382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:40 smithi179 bash[23186]: audit 2024-09-21T01:05:39.081233+0000 mon.a (mon.0) 6383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:40 smithi049 bash[23528]: audit 2024-09-21T01:05:38.765813+0000 mgr.a (mgr.14388) 7405 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:40 smithi049 bash[23528]: cephadm 2024-09-21T01:05:38.766843+0000 mgr.a (mgr.14388) 7406 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:40 smithi049 bash[23528]: audit 2024-09-21T01:05:39.069297+0000 mon.a (mon.0) 6381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:40 smithi049 bash[23528]: audit 2024-09-21T01:05:39.074387+0000 mon.a (mon.0) 6382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:40 smithi049 bash[23528]: audit 2024-09-21T01:05:39.081233+0000 mon.a (mon.0) 6383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:41 smithi044 bash[22676]: audit 2024-09-21T01:05:39.387551+0000 mgr.a (mgr.14388) 7407 : audit [DBG] from='client.167598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:41 smithi044 bash[22676]: cluster 2024-09-21T01:05:39.616652+0000 mgr.a (mgr.14388) 7408 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:41 smithi044 bash[22676]: audit 2024-09-21T01:05:41.072733+0000 mon.a (mon.0) 6384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:41 smithi179 bash[23186]: audit 2024-09-21T01:05:39.387551+0000 mgr.a (mgr.14388) 7407 : audit [DBG] from='client.167598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:41 smithi179 bash[23186]: cluster 2024-09-21T01:05:39.616652+0000 mgr.a (mgr.14388) 7408 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:41 smithi179 bash[23186]: audit 2024-09-21T01:05:41.072733+0000 mon.a (mon.0) 6384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:41 smithi049 bash[23528]: audit 2024-09-21T01:05:39.387551+0000 mgr.a (mgr.14388) 7407 : audit [DBG] from='client.167598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:41 smithi049 bash[23528]: cluster 2024-09-21T01:05:39.616652+0000 mgr.a (mgr.14388) 7408 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:05:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:41 smithi049 bash[23528]: audit 2024-09-21T01:05:41.072733+0000 mon.a (mon.0) 6384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:42 smithi044 bash[22676]: audit 2024-09-21T01:05:41.094265+0000 mon.a (mon.0) 6385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:42 smithi044 bash[22676]: audit 2024-09-21T01:05:41.113146+0000 mon.a (mon.0) 6386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:42 smithi179 bash[23186]: audit 2024-09-21T01:05:41.094265+0000 mon.a (mon.0) 6385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:42 smithi179 bash[23186]: audit 2024-09-21T01:05:41.113146+0000 mon.a (mon.0) 6386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:42 smithi049 bash[23528]: audit 2024-09-21T01:05:41.094265+0000 mon.a (mon.0) 6385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:42 smithi049 bash[23528]: audit 2024-09-21T01:05:41.113146+0000 mon.a (mon.0) 6386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:43 smithi044 bash[22676]: cluster 2024-09-21T01:05:41.619048+0000 mgr.a (mgr.14388) 7409 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:43 smithi179 bash[23186]: cluster 2024-09-21T01:05:41.619048+0000 mgr.a (mgr.14388) 7409 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:43 smithi049 bash[23528]: cluster 2024-09-21T01:05:41.619048+0000 mgr.a (mgr.14388) 7409 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:45 smithi044 bash[22676]: cluster 2024-09-21T01:05:43.619984+0000 mgr.a (mgr.14388) 7410 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:45 smithi179 bash[23186]: cluster 2024-09-21T01:05:43.619984+0000 mgr.a (mgr.14388) 7410 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:45.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:45 smithi049 bash[23528]: cluster 2024-09-21T01:05:43.619984+0000 mgr.a (mgr.14388) 7410 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:45.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:47.395 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:47 smithi049 bash[23528]: audit 2024-09-21T01:05:45.160742+0000 mgr.a (mgr.14388) 7411 : audit [DBG] from='client.167676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:47.395 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:47 smithi049 bash[23528]: cluster 2024-09-21T01:05:45.621536+0000 mgr.a (mgr.14388) 7412 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:47 smithi044 bash[22676]: audit 2024-09-21T01:05:45.160742+0000 mgr.a (mgr.14388) 7411 : audit [DBG] from='client.167676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:47 smithi044 bash[22676]: cluster 2024-09-21T01:05:45.621536+0000 mgr.a (mgr.14388) 7412 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:47 smithi179 bash[23186]: audit 2024-09-21T01:05:45.160742+0000 mgr.a (mgr.14388) 7411 : audit [DBG] from='client.167676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:47 smithi179 bash[23186]: cluster 2024-09-21T01:05:45.621536+0000 mgr.a (mgr.14388) 7412 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:05:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:49 smithi044 bash[22676]: cluster 2024-09-21T01:05:47.622439+0000 mgr.a (mgr.14388) 7413 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:05:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:49 smithi179 bash[23186]: cluster 2024-09-21T01:05:47.622439+0000 mgr.a (mgr.14388) 7413 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:05:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:49 smithi049 bash[23528]: cluster 2024-09-21T01:05:47.622439+0000 mgr.a (mgr.14388) 7413 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:05:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:51.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:51.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:51.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:51.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:51.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:51 smithi044 bash[22676]: cluster 2024-09-21T01:05:49.623390+0000 mgr.a (mgr.14388) 7414 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:05:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:51 smithi179 bash[23186]: cluster 2024-09-21T01:05:49.623390+0000 mgr.a (mgr.14388) 7414 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:05:51.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:51 smithi049 bash[23528]: cluster 2024-09-21T01:05:49.623390+0000 mgr.a (mgr.14388) 7414 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:05:52.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:52 smithi044 bash[22676]: audit 2024-09-21T01:05:50.946366+0000 mgr.a (mgr.14388) 7415 : audit [DBG] from='client.167754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:52 smithi179 bash[23186]: audit 2024-09-21T01:05:50.946366+0000 mgr.a (mgr.14388) 7415 : audit [DBG] from='client.167754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:52.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:52 smithi049 bash[23528]: audit 2024-09-21T01:05:50.946366+0000 mgr.a (mgr.14388) 7415 : audit [DBG] from='client.167754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:53 smithi044 bash[22676]: cluster 2024-09-21T01:05:51.626290+0000 mgr.a (mgr.14388) 7416 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T01:05:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:53 smithi179 bash[23186]: cluster 2024-09-21T01:05:51.626290+0000 mgr.a (mgr.14388) 7416 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T01:05:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:53 smithi049 bash[23528]: cluster 2024-09-21T01:05:51.626290+0000 mgr.a (mgr.14388) 7416 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T01:05:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:55 smithi044 bash[22676]: cluster 2024-09-21T01:05:53.627090+0000 mgr.a (mgr.14388) 7417 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:05:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:55 smithi179 bash[23186]: cluster 2024-09-21T01:05:53.627090+0000 mgr.a (mgr.14388) 7417 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:05:55.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:55 smithi049 bash[23528]: cluster 2024-09-21T01:05:53.627090+0000 mgr.a (mgr.14388) 7417 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:05:56.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:05:56.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:05:56.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:05:57.126 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:05:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:05:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:05:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:05:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:05:57.287 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:57 smithi179 bash[23186]: cluster 2024-09-21T01:05:55.629060+0000 mgr.a (mgr.14388) 7418 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:05:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:57 smithi044 bash[22676]: cluster 2024-09-21T01:05:55.629060+0000 mgr.a (mgr.14388) 7418 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:57 smithi049 bash[23528]: cluster 2024-09-21T01:05:55.629060+0000 mgr.a (mgr.14388) 7418 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:05:58.409 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:58 smithi044 bash[22676]: audit 2024-09-21T01:05:56.700309+0000 mgr.a (mgr.14388) 7419 : audit [DBG] from='client.167832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:58 smithi179 bash[23186]: audit 2024-09-21T01:05:56.700309+0000 mgr.a (mgr.14388) 7419 : audit [DBG] from='client.167832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:58.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:58 smithi049 bash[23528]: audit 2024-09-21T01:05:56.700309+0000 mgr.a (mgr.14388) 7419 : audit [DBG] from='client.167832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:59.479 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:59 smithi179 bash[23186]: cluster 2024-09-21T01:05:57.630150+0000 mgr.a (mgr.14388) 7420 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:05:59.479 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:59 smithi179 bash[23186]: audit 2024-09-21T01:05:58.513037+0000 mon.a (mon.0) 6387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.479 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:59 smithi179 bash[23186]: audit 2024-09-21T01:05:58.520346+0000 mon.a (mon.0) 6388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.479 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:05:59 smithi179 bash[23186]: audit 2024-09-21T01:05:58.527362+0000 mon.a (mon.0) 6389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:59 smithi044 bash[22676]: cluster 2024-09-21T01:05:57.630150+0000 mgr.a (mgr.14388) 7420 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:05:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:59 smithi044 bash[22676]: audit 2024-09-21T01:05:58.513037+0000 mon.a (mon.0) 6387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:59 smithi044 bash[22676]: audit 2024-09-21T01:05:58.520346+0000 mon.a (mon.0) 6388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:05:59 smithi044 bash[22676]: audit 2024-09-21T01:05:58.527362+0000 mon.a (mon.0) 6389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:59 smithi049 bash[23528]: cluster 2024-09-21T01:05:57.630150+0000 mgr.a (mgr.14388) 7420 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:05:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:59 smithi049 bash[23528]: audit 2024-09-21T01:05:58.513037+0000 mon.a (mon.0) 6387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:59 smithi049 bash[23528]: audit 2024-09-21T01:05:58.520346+0000 mon.a (mon.0) 6388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:05:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:05:59 smithi049 bash[23528]: audit 2024-09-21T01:05:58.527362+0000 mon.a (mon.0) 6389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:00 smithi044 bash[22676]: audit 2024-09-21T01:05:59.235330+0000 mon.a (mon.0) 6390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:00 smithi044 bash[22676]: audit 2024-09-21T01:05:59.243584+0000 mon.a (mon.0) 6391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:00 smithi044 bash[22676]: audit 2024-09-21T01:05:59.250062+0000 mon.a (mon.0) 6392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:00 smithi044 bash[22676]: cluster 2024-09-21T01:05:59.631029+0000 mgr.a (mgr.14388) 7421 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:06:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:00 smithi179 bash[23186]: audit 2024-09-21T01:05:59.235330+0000 mon.a (mon.0) 6390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:00 smithi179 bash[23186]: audit 2024-09-21T01:05:59.243584+0000 mon.a (mon.0) 6391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:00 smithi179 bash[23186]: audit 2024-09-21T01:05:59.250062+0000 mon.a (mon.0) 6392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:00 smithi179 bash[23186]: cluster 2024-09-21T01:05:59.631029+0000 mgr.a (mgr.14388) 7421 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:06:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:00 smithi049 bash[23528]: audit 2024-09-21T01:05:59.235330+0000 mon.a (mon.0) 6390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:00 smithi049 bash[23528]: audit 2024-09-21T01:05:59.243584+0000 mon.a (mon.0) 6391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:00 smithi049 bash[23528]: audit 2024-09-21T01:05:59.250062+0000 mon.a (mon.0) 6392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:00 smithi049 bash[23528]: cluster 2024-09-21T01:05:59.631029+0000 mgr.a (mgr.14388) 7421 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:06:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:02 smithi049 bash[23528]: audit 2024-09-21T01:06:01.299171+0000 mon.a (mon.0) 6393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:02 smithi049 bash[23528]: audit 2024-09-21T01:06:01.307616+0000 mon.a (mon.0) 6394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:02 smithi049 bash[23528]: audit 2024-09-21T01:06:01.317462+0000 mon.a (mon.0) 6395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:02 smithi049 bash[23528]: cluster 2024-09-21T01:06:01.633278+0000 mgr.a (mgr.14388) 7422 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 50 KiB/s rd, 0 B/s wr, 80 op/s 2024-09-21T01:06:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:02 smithi044 bash[22676]: audit 2024-09-21T01:06:01.299171+0000 mon.a (mon.0) 6393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:02 smithi044 bash[22676]: audit 2024-09-21T01:06:01.307616+0000 mon.a (mon.0) 6394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:02 smithi044 bash[22676]: audit 2024-09-21T01:06:01.317462+0000 mon.a (mon.0) 6395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:02 smithi044 bash[22676]: cluster 2024-09-21T01:06:01.633278+0000 mgr.a (mgr.14388) 7422 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 50 KiB/s rd, 0 B/s wr, 80 op/s 2024-09-21T01:06:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:02 smithi179 bash[23186]: audit 2024-09-21T01:06:01.299171+0000 mon.a (mon.0) 6393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:02 smithi179 bash[23186]: audit 2024-09-21T01:06:01.307616+0000 mon.a (mon.0) 6394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:02 smithi179 bash[23186]: audit 2024-09-21T01:06:01.317462+0000 mon.a (mon.0) 6395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:02 smithi179 bash[23186]: cluster 2024-09-21T01:06:01.633278+0000 mgr.a (mgr.14388) 7422 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 50 KiB/s rd, 0 B/s wr, 80 op/s 2024-09-21T01:06:02.918 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:02.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:02.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:02.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:02.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:03 smithi044 bash[22676]: audit 2024-09-21T01:06:02.467299+0000 mgr.a (mgr.14388) 7423 : audit [DBG] from='client.167904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:03 smithi179 bash[23186]: audit 2024-09-21T01:06:02.467299+0000 mgr.a (mgr.14388) 7423 : audit [DBG] from='client.167904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:03 smithi049 bash[23528]: audit 2024-09-21T01:06:02.467299+0000 mgr.a (mgr.14388) 7423 : audit [DBG] from='client.167904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:04 smithi044 bash[22676]: cluster 2024-09-21T01:06:03.634138+0000 mgr.a (mgr.14388) 7424 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:04 smithi179 bash[23186]: cluster 2024-09-21T01:06:03.634138+0000 mgr.a (mgr.14388) 7424 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:04 smithi049 bash[23528]: cluster 2024-09-21T01:06:03.634138+0000 mgr.a (mgr.14388) 7424 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:06 smithi044 bash[22676]: cluster 2024-09-21T01:06:05.636267+0000 mgr.a (mgr.14388) 7425 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T01:06:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:06 smithi179 bash[23186]: cluster 2024-09-21T01:06:05.636267+0000 mgr.a (mgr.14388) 7425 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T01:06:07.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:06 smithi049 bash[23528]: cluster 2024-09-21T01:06:05.636267+0000 mgr.a (mgr.14388) 7425 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T01:06:07.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:07.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:07.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:08.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:08.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:08.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:08.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:08.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:08 smithi044 bash[22676]: cluster 2024-09-21T01:06:07.637048+0000 mgr.a (mgr.14388) 7426 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:08 smithi179 bash[23186]: cluster 2024-09-21T01:06:07.637048+0000 mgr.a (mgr.14388) 7426 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:08 smithi049 bash[23528]: cluster 2024-09-21T01:06:07.637048+0000 mgr.a (mgr.14388) 7426 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:09 smithi044 bash[22676]: audit 2024-09-21T01:06:08.256639+0000 mgr.a (mgr.14388) 7427 : audit [DBG] from='client.167982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:09 smithi179 bash[23186]: audit 2024-09-21T01:06:08.256639+0000 mgr.a (mgr.14388) 7427 : audit [DBG] from='client.167982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:10.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:09 smithi049 bash[23528]: audit 2024-09-21T01:06:08.256639+0000 mgr.a (mgr.14388) 7427 : audit [DBG] from='client.167982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:10 smithi044 bash[22676]: cluster 2024-09-21T01:06:09.637965+0000 mgr.a (mgr.14388) 7428 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:10 smithi179 bash[23186]: cluster 2024-09-21T01:06:09.637965+0000 mgr.a (mgr.14388) 7428 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:10 smithi049 bash[23528]: cluster 2024-09-21T01:06:09.637965+0000 mgr.a (mgr.14388) 7428 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-21T01:06:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:12 smithi044 bash[22676]: cluster 2024-09-21T01:06:11.640256+0000 mgr.a (mgr.14388) 7429 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T01:06:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:12 smithi179 bash[23186]: cluster 2024-09-21T01:06:11.640256+0000 mgr.a (mgr.14388) 7429 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T01:06:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:12 smithi049 bash[23528]: cluster 2024-09-21T01:06:11.640256+0000 mgr.a (mgr.14388) 7429 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-21T01:06:13.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:13.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:13.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:14.475 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:14.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:14.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:14.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:14.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:14 smithi044 bash[22676]: cluster 2024-09-21T01:06:13.641038+0000 mgr.a (mgr.14388) 7430 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:14 smithi044 bash[22676]: audit 2024-09-21T01:06:14.032842+0000 mgr.a (mgr.14388) 7431 : audit [DBG] from='client.168054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:14 smithi179 bash[23186]: cluster 2024-09-21T01:06:13.641038+0000 mgr.a (mgr.14388) 7430 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:14 smithi179 bash[23186]: audit 2024-09-21T01:06:14.032842+0000 mgr.a (mgr.14388) 7431 : audit [DBG] from='client.168054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:14 smithi049 bash[23528]: cluster 2024-09-21T01:06:13.641038+0000 mgr.a (mgr.14388) 7430 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:14 smithi049 bash[23528]: audit 2024-09-21T01:06:14.032842+0000 mgr.a (mgr.14388) 7431 : audit [DBG] from='client.168054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:16 smithi044 bash[22676]: cluster 2024-09-21T01:06:15.643337+0000 mgr.a (mgr.14388) 7432 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:16 smithi179 bash[23186]: cluster 2024-09-21T01:06:15.643337+0000 mgr.a (mgr.14388) 7432 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:16 smithi049 bash[23528]: cluster 2024-09-21T01:06:15.643337+0000 mgr.a (mgr.14388) 7432 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:18.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:18 smithi044 bash[22676]: cluster 2024-09-21T01:06:17.644166+0000 mgr.a (mgr.14388) 7433 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:18.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:18 smithi044 bash[22676]: audit 2024-09-21T01:06:18.675124+0000 mon.a (mon.0) 6396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:18.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:18 smithi044 bash[22676]: audit 2024-09-21T01:06:18.680403+0000 mon.a (mon.0) 6397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:18.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:18 smithi044 bash[22676]: audit 2024-09-21T01:06:18.688832+0000 mon.a (mon.0) 6398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:18 smithi179 bash[23186]: cluster 2024-09-21T01:06:17.644166+0000 mgr.a (mgr.14388) 7433 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:18 smithi179 bash[23186]: audit 2024-09-21T01:06:18.675124+0000 mon.a (mon.0) 6396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:18 smithi179 bash[23186]: audit 2024-09-21T01:06:18.680403+0000 mon.a (mon.0) 6397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:18 smithi179 bash[23186]: audit 2024-09-21T01:06:18.688832+0000 mon.a (mon.0) 6398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:18 smithi049 bash[23528]: cluster 2024-09-21T01:06:17.644166+0000 mgr.a (mgr.14388) 7433 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:18 smithi049 bash[23528]: audit 2024-09-21T01:06:18.675124+0000 mon.a (mon.0) 6396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:18 smithi049 bash[23528]: audit 2024-09-21T01:06:18.680403+0000 mon.a (mon.0) 6397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:18 smithi049 bash[23528]: audit 2024-09-21T01:06:18.688832+0000 mon.a (mon.0) 6398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:19.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:19.477 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:20.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:20.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:20.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:20 smithi044 bash[22676]: audit 2024-09-21T01:06:19.440051+0000 mon.a (mon.0) 6399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:20 smithi044 bash[22676]: audit 2024-09-21T01:06:19.445537+0000 mon.a (mon.0) 6400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:20 smithi044 bash[22676]: audit 2024-09-21T01:06:19.450932+0000 mon.a (mon.0) 6401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:20 smithi044 bash[22676]: cluster 2024-09-21T01:06:19.644912+0000 mgr.a (mgr.14388) 7434 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:20 smithi044 bash[22676]: audit 2024-09-21T01:06:19.801812+0000 mgr.a (mgr.14388) 7435 : audit [DBG] from='client.168129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:20 smithi179 bash[23186]: audit 2024-09-21T01:06:19.440051+0000 mon.a (mon.0) 6399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:20 smithi179 bash[23186]: audit 2024-09-21T01:06:19.445537+0000 mon.a (mon.0) 6400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:20 smithi179 bash[23186]: audit 2024-09-21T01:06:19.450932+0000 mon.a (mon.0) 6401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:20 smithi179 bash[23186]: cluster 2024-09-21T01:06:19.644912+0000 mgr.a (mgr.14388) 7434 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:20 smithi179 bash[23186]: audit 2024-09-21T01:06:19.801812+0000 mgr.a (mgr.14388) 7435 : audit [DBG] from='client.168129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:20 smithi049 bash[23528]: audit 2024-09-21T01:06:19.440051+0000 mon.a (mon.0) 6399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:20 smithi049 bash[23528]: audit 2024-09-21T01:06:19.445537+0000 mon.a (mon.0) 6400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:20 smithi049 bash[23528]: audit 2024-09-21T01:06:19.450932+0000 mon.a (mon.0) 6401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:20 smithi049 bash[23528]: cluster 2024-09-21T01:06:19.644912+0000 mgr.a (mgr.14388) 7434 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:20 smithi049 bash[23528]: audit 2024-09-21T01:06:19.801812+0000 mgr.a (mgr.14388) 7435 : audit [DBG] from='client.168129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:22 smithi049 bash[23528]: audit 2024-09-21T01:06:21.532193+0000 mon.a (mon.0) 6402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:22 smithi049 bash[23528]: audit 2024-09-21T01:06:21.540792+0000 mon.a (mon.0) 6403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:22 smithi049 bash[23528]: audit 2024-09-21T01:06:21.551337+0000 mon.a (mon.0) 6404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:22.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:22 smithi049 bash[23528]: cluster 2024-09-21T01:06:21.648494+0000 mgr.a (mgr.14388) 7436 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:22 smithi044 bash[22676]: audit 2024-09-21T01:06:21.532193+0000 mon.a (mon.0) 6402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:22 smithi044 bash[22676]: audit 2024-09-21T01:06:21.540792+0000 mon.a (mon.0) 6403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:22 smithi044 bash[22676]: audit 2024-09-21T01:06:21.551337+0000 mon.a (mon.0) 6404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:22 smithi044 bash[22676]: cluster 2024-09-21T01:06:21.648494+0000 mgr.a (mgr.14388) 7436 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:22 smithi179 bash[23186]: audit 2024-09-21T01:06:21.532193+0000 mon.a (mon.0) 6402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:22 smithi179 bash[23186]: audit 2024-09-21T01:06:21.540792+0000 mon.a (mon.0) 6403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:22 smithi179 bash[23186]: audit 2024-09-21T01:06:21.551337+0000 mon.a (mon.0) 6404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:22 smithi179 bash[23186]: cluster 2024-09-21T01:06:21.648494+0000 mgr.a (mgr.14388) 7436 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:24 smithi044 bash[22676]: cluster 2024-09-21T01:06:23.649332+0000 mgr.a (mgr.14388) 7437 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:24 smithi179 bash[23186]: cluster 2024-09-21T01:06:23.649332+0000 mgr.a (mgr.14388) 7437 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:24 smithi049 bash[23528]: cluster 2024-09-21T01:06:23.649332+0000 mgr.a (mgr.14388) 7437 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:25.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:25.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:25.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:26.046 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:26 smithi044 bash[22676]: audit 2024-09-21T01:06:25.593780+0000 mgr.a (mgr.14388) 7438 : audit [DBG] from='client.168207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:26 smithi044 bash[22676]: cluster 2024-09-21T01:06:25.652298+0000 mgr.a (mgr.14388) 7439 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:26 smithi179 bash[23186]: audit 2024-09-21T01:06:25.593780+0000 mgr.a (mgr.14388) 7438 : audit [DBG] from='client.168207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:26 smithi179 bash[23186]: cluster 2024-09-21T01:06:25.652298+0000 mgr.a (mgr.14388) 7439 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:26 smithi049 bash[23528]: audit 2024-09-21T01:06:25.593780+0000 mgr.a (mgr.14388) 7438 : audit [DBG] from='client.168207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:26 smithi049 bash[23528]: cluster 2024-09-21T01:06:25.652298+0000 mgr.a (mgr.14388) 7439 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:28 smithi044 bash[22676]: cluster 2024-09-21T01:06:27.653229+0000 mgr.a (mgr.14388) 7440 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:28 smithi179 bash[23186]: cluster 2024-09-21T01:06:27.653229+0000 mgr.a (mgr.14388) 7440 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:28 smithi049 bash[23528]: cluster 2024-09-21T01:06:27.653229+0000 mgr.a (mgr.14388) 7440 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:30 smithi044 bash[22676]: cluster 2024-09-21T01:06:29.654020+0000 mgr.a (mgr.14388) 7441 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:30 smithi179 bash[23186]: cluster 2024-09-21T01:06:29.654020+0000 mgr.a (mgr.14388) 7441 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:31.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:31.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:30 smithi049 bash[23528]: cluster 2024-09-21T01:06:29.654020+0000 mgr.a (mgr.14388) 7441 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:06:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:32 smithi044 bash[22676]: audit 2024-09-21T01:06:31.379178+0000 mgr.a (mgr.14388) 7442 : audit [DBG] from='client.168279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:32 smithi044 bash[22676]: cluster 2024-09-21T01:06:31.655394+0000 mgr.a (mgr.14388) 7443 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:32 smithi179 bash[23186]: audit 2024-09-21T01:06:31.379178+0000 mgr.a (mgr.14388) 7442 : audit [DBG] from='client.168279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:32 smithi179 bash[23186]: cluster 2024-09-21T01:06:31.655394+0000 mgr.a (mgr.14388) 7443 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:32 smithi049 bash[23528]: audit 2024-09-21T01:06:31.379178+0000 mgr.a (mgr.14388) 7442 : audit [DBG] from='client.168279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:32 smithi049 bash[23528]: cluster 2024-09-21T01:06:31.655394+0000 mgr.a (mgr.14388) 7443 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:34 smithi044 bash[22676]: cluster 2024-09-21T01:06:33.656040+0000 mgr.a (mgr.14388) 7444 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:34 smithi179 bash[23186]: cluster 2024-09-21T01:06:33.656040+0000 mgr.a (mgr.14388) 7444 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:34 smithi049 bash[23528]: cluster 2024-09-21T01:06:33.656040+0000 mgr.a (mgr.14388) 7444 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:36 smithi044 bash[22676]: cluster 2024-09-21T01:06:35.658227+0000 mgr.a (mgr.14388) 7445 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:36 smithi179 bash[23186]: cluster 2024-09-21T01:06:35.658227+0000 mgr.a (mgr.14388) 7445 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:36 smithi049 bash[23528]: cluster 2024-09-21T01:06:35.658227+0000 mgr.a (mgr.14388) 7445 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:37.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:37.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:37.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:37.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:37.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:37 smithi179 bash[23186]: audit 2024-09-21T01:06:37.155091+0000 mgr.a (mgr.14388) 7446 : audit [DBG] from='client.168354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:37 smithi049 bash[23528]: audit 2024-09-21T01:06:37.155091+0000 mgr.a (mgr.14388) 7446 : audit [DBG] from='client.168354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:37 smithi044 bash[22676]: audit 2024-09-21T01:06:37.155091+0000 mgr.a (mgr.14388) 7446 : audit [DBG] from='client.168354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:38.946 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:38 smithi044 bash[22676]: cluster 2024-09-21T01:06:37.659387+0000 mgr.a (mgr.14388) 7447 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:38 smithi179 bash[23186]: cluster 2024-09-21T01:06:37.659387+0000 mgr.a (mgr.14388) 7447 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:38 smithi049 bash[23528]: cluster 2024-09-21T01:06:37.659387+0000 mgr.a (mgr.14388) 7447 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:39.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22930]: debug 2024-09-21T01:06:39.567+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:06:39.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22930]: debug 2024-09-21T01:06:39.567+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:06:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.817699+0000 mon.a (mon.0) 6405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.821521+0000 mon.a (mon.0) 6406 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.822669+0000 mon.a (mon.0) 6407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.830808+0000 mon.a (mon.0) 6408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.834170+0000 mon.a (mon.0) 6409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.835375+0000 mgr.a (mgr.14388) 7448 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.879400+0000 mon.a (mon.0) 6410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.888449+0000 mon.a (mon.0) 6411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:38.897911+0000 mon.a (mon.0) 6412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:39.575324+0000 mon.a (mon.0) 6413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:39.581188+0000 mon.a (mon.0) 6414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:39 smithi179 bash[23186]: audit 2024-09-21T01:06:39.588099+0000 mon.a (mon.0) 6415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.817699+0000 mon.a (mon.0) 6405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:06:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.821521+0000 mon.a (mon.0) 6406 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:06:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.822669+0000 mon.a (mon.0) 6407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:06:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.830808+0000 mon.a (mon.0) 6408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.834170+0000 mon.a (mon.0) 6409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:06:40.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.835375+0000 mgr.a (mgr.14388) 7448 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.879400+0000 mon.a (mon.0) 6410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.888449+0000 mon.a (mon.0) 6411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:38.897911+0000 mon.a (mon.0) 6412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:39.575324+0000 mon.a (mon.0) 6413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:39.581188+0000 mon.a (mon.0) 6414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:39 smithi049 bash[23528]: audit 2024-09-21T01:06:39.588099+0000 mon.a (mon.0) 6415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.817699+0000 mon.a (mon.0) 6405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.821521+0000 mon.a (mon.0) 6406 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.822669+0000 mon.a (mon.0) 6407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.830808+0000 mon.a (mon.0) 6408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.834170+0000 mon.a (mon.0) 6409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.835375+0000 mgr.a (mgr.14388) 7448 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.879400+0000 mon.a (mon.0) 6410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.888449+0000 mon.a (mon.0) 6411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:38.897911+0000 mon.a (mon.0) 6412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:39.575324+0000 mon.a (mon.0) 6413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:39.581188+0000 mon.a (mon.0) 6414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:39 smithi044 bash[22676]: audit 2024-09-21T01:06:39.588099+0000 mon.a (mon.0) 6415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:40 smithi049 bash[23528]: audit 2024-09-21T01:06:39.571965+0000 mgr.a (mgr.14388) 7449 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:06:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:40 smithi049 bash[23528]: cephadm 2024-09-21T01:06:39.572834+0000 mgr.a (mgr.14388) 7450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:06:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:40 smithi049 bash[23528]: cluster 2024-09-21T01:06:39.660168+0000 mgr.a (mgr.14388) 7451 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:40 smithi044 bash[22676]: audit 2024-09-21T01:06:39.571965+0000 mgr.a (mgr.14388) 7449 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:06:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:40 smithi044 bash[22676]: cephadm 2024-09-21T01:06:39.572834+0000 mgr.a (mgr.14388) 7450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:06:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:40 smithi044 bash[22676]: cluster 2024-09-21T01:06:39.660168+0000 mgr.a (mgr.14388) 7451 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:40 smithi179 bash[23186]: audit 2024-09-21T01:06:39.571965+0000 mgr.a (mgr.14388) 7449 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:06:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:40 smithi179 bash[23186]: cephadm 2024-09-21T01:06:39.572834+0000 mgr.a (mgr.14388) 7450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:06:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:40 smithi179 bash[23186]: cluster 2024-09-21T01:06:39.660168+0000 mgr.a (mgr.14388) 7451 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:42.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:42.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:42.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:42 smithi049 bash[23528]: cluster 2024-09-21T01:06:41.662307+0000 mgr.a (mgr.14388) 7452 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:42 smithi049 bash[23528]: audit 2024-09-21T01:06:41.763323+0000 mon.a (mon.0) 6416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:42 smithi049 bash[23528]: audit 2024-09-21T01:06:41.772012+0000 mon.a (mon.0) 6417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:42 smithi049 bash[23528]: audit 2024-09-21T01:06:41.782491+0000 mon.a (mon.0) 6418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:42 smithi044 bash[22676]: cluster 2024-09-21T01:06:41.662307+0000 mgr.a (mgr.14388) 7452 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:42 smithi044 bash[22676]: audit 2024-09-21T01:06:41.763323+0000 mon.a (mon.0) 6416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:42 smithi044 bash[22676]: audit 2024-09-21T01:06:41.772012+0000 mon.a (mon.0) 6417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:42 smithi044 bash[22676]: audit 2024-09-21T01:06:41.782491+0000 mon.a (mon.0) 6418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:42 smithi179 bash[23186]: cluster 2024-09-21T01:06:41.662307+0000 mgr.a (mgr.14388) 7452 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:42 smithi179 bash[23186]: audit 2024-09-21T01:06:41.763323+0000 mon.a (mon.0) 6416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:42 smithi179 bash[23186]: audit 2024-09-21T01:06:41.772012+0000 mon.a (mon.0) 6417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:42 smithi179 bash[23186]: audit 2024-09-21T01:06:41.782491+0000 mon.a (mon.0) 6418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:06:43.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:43.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:43.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:43.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:43.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:43 smithi049 bash[23528]: audit 2024-09-21T01:06:42.917753+0000 mgr.a (mgr.14388) 7453 : audit [DBG] from='client.168537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:43 smithi044 bash[22676]: audit 2024-09-21T01:06:42.917753+0000 mgr.a (mgr.14388) 7453 : audit [DBG] from='client.168537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:44.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:43 smithi179 bash[23186]: audit 2024-09-21T01:06:42.917753+0000 mgr.a (mgr.14388) 7453 : audit [DBG] from='client.168537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:44 smithi049 bash[23528]: cluster 2024-09-21T01:06:43.663165+0000 mgr.a (mgr.14388) 7454 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:44 smithi044 bash[22676]: cluster 2024-09-21T01:06:43.663165+0000 mgr.a (mgr.14388) 7454 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:44 smithi179 bash[23186]: cluster 2024-09-21T01:06:43.663165+0000 mgr.a (mgr.14388) 7454 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:46 smithi049 bash[23528]: cluster 2024-09-21T01:06:45.665336+0000 mgr.a (mgr.14388) 7455 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:46 smithi044 bash[22676]: cluster 2024-09-21T01:06:45.665336+0000 mgr.a (mgr.14388) 7455 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:46 smithi179 bash[23186]: cluster 2024-09-21T01:06:45.665336+0000 mgr.a (mgr.14388) 7455 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:48.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:48.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:48.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:48 smithi049 bash[23528]: cluster 2024-09-21T01:06:47.666112+0000 mgr.a (mgr.14388) 7456 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:49.148 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:49.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:49.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:49.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:49.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:48 smithi044 bash[22676]: cluster 2024-09-21T01:06:47.666112+0000 mgr.a (mgr.14388) 7456 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:48 smithi179 bash[23186]: cluster 2024-09-21T01:06:47.666112+0000 mgr.a (mgr.14388) 7456 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:50.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:49 smithi049 bash[23528]: audit 2024-09-21T01:06:48.706519+0000 mgr.a (mgr.14388) 7457 : audit [DBG] from='client.168612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:49 smithi044 bash[22676]: audit 2024-09-21T01:06:48.706519+0000 mgr.a (mgr.14388) 7457 : audit [DBG] from='client.168612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:49 smithi179 bash[23186]: audit 2024-09-21T01:06:48.706519+0000 mgr.a (mgr.14388) 7457 : audit [DBG] from='client.168612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:51.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:50 smithi049 bash[23528]: cluster 2024-09-21T01:06:49.666997+0000 mgr.a (mgr.14388) 7458 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:50 smithi044 bash[22676]: cluster 2024-09-21T01:06:49.666997+0000 mgr.a (mgr.14388) 7458 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:50 smithi179 bash[23186]: cluster 2024-09-21T01:06:49.666997+0000 mgr.a (mgr.14388) 7458 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:52 smithi049 bash[23528]: cluster 2024-09-21T01:06:51.669213+0000 mgr.a (mgr.14388) 7459 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:52 smithi044 bash[22676]: cluster 2024-09-21T01:06:51.669213+0000 mgr.a (mgr.14388) 7459 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:52 smithi179 bash[23186]: cluster 2024-09-21T01:06:51.669213+0000 mgr.a (mgr.14388) 7459 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:06:54.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:54.151 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:54.151 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:06:54.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:06:54.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:06:54.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:06:54.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:06:54.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:06:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:54 smithi044 bash[22676]: cluster 2024-09-21T01:06:53.670041+0000 mgr.a (mgr.14388) 7460 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:54 smithi179 bash[23186]: cluster 2024-09-21T01:06:53.670041+0000 mgr.a (mgr.14388) 7460 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:54 smithi049 bash[23528]: cluster 2024-09-21T01:06:53.670041+0000 mgr.a (mgr.14388) 7460 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:55 smithi044 bash[22676]: audit 2024-09-21T01:06:54.483722+0000 mgr.a (mgr.14388) 7461 : audit [DBG] from='client.168690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:55 smithi179 bash[23186]: audit 2024-09-21T01:06:54.483722+0000 mgr.a (mgr.14388) 7461 : audit [DBG] from='client.168690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:55 smithi049 bash[23528]: audit 2024-09-21T01:06:54.483722+0000 mgr.a (mgr.14388) 7461 : audit [DBG] from='client.168690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:56 smithi044 bash[22676]: cluster 2024-09-21T01:06:55.672299+0000 mgr.a (mgr.14388) 7462 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:56 smithi179 bash[23186]: cluster 2024-09-21T01:06:55.672299+0000 mgr.a (mgr.14388) 7462 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:56 smithi049 bash[23528]: cluster 2024-09-21T01:06:55.672299+0000 mgr.a (mgr.14388) 7462 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:06:59.091 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:06:58 smithi179 bash[23186]: cluster 2024-09-21T01:06:57.673062+0000 mgr.a (mgr.14388) 7463 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:59.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:06:58 smithi044 bash[22676]: cluster 2024-09-21T01:06:57.673062+0000 mgr.a (mgr.14388) 7463 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:06:58 smithi049 bash[23528]: cluster 2024-09-21T01:06:57.673062+0000 mgr.a (mgr.14388) 7463 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:06:59.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:06:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:06:59.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:00 smithi179 bash[23186]: audit 2024-09-21T01:06:59.070151+0000 mon.a (mon.0) 6419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:00 smithi179 bash[23186]: audit 2024-09-21T01:06:59.079258+0000 mon.a (mon.0) 6420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:00 smithi179 bash[23186]: audit 2024-09-21T01:06:59.089046+0000 mon.a (mon.0) 6421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:00 smithi179 bash[23186]: audit 2024-09-21T01:06:59.747846+0000 mon.a (mon.0) 6422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:00 smithi179 bash[23186]: audit 2024-09-21T01:06:59.754907+0000 mon.a (mon.0) 6423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:00 smithi179 bash[23186]: audit 2024-09-21T01:06:59.763603+0000 mon.a (mon.0) 6424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:00 smithi044 bash[22676]: audit 2024-09-21T01:06:59.070151+0000 mon.a (mon.0) 6419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:00 smithi044 bash[22676]: audit 2024-09-21T01:06:59.079258+0000 mon.a (mon.0) 6420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:00 smithi044 bash[22676]: audit 2024-09-21T01:06:59.089046+0000 mon.a (mon.0) 6421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:00 smithi044 bash[22676]: audit 2024-09-21T01:06:59.747846+0000 mon.a (mon.0) 6422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:00 smithi044 bash[22676]: audit 2024-09-21T01:06:59.754907+0000 mon.a (mon.0) 6423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:00 smithi044 bash[22676]: audit 2024-09-21T01:06:59.763603+0000 mon.a (mon.0) 6424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:00 smithi049 bash[23528]: audit 2024-09-21T01:06:59.070151+0000 mon.a (mon.0) 6419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:00 smithi049 bash[23528]: audit 2024-09-21T01:06:59.079258+0000 mon.a (mon.0) 6420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:00 smithi049 bash[23528]: audit 2024-09-21T01:06:59.089046+0000 mon.a (mon.0) 6421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:00 smithi049 bash[23528]: audit 2024-09-21T01:06:59.747846+0000 mon.a (mon.0) 6422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:00 smithi049 bash[23528]: audit 2024-09-21T01:06:59.754907+0000 mon.a (mon.0) 6423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:00 smithi049 bash[23528]: audit 2024-09-21T01:06:59.763603+0000 mon.a (mon.0) 6424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:00.686 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:00.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:00.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:00.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:00.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:01.152 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:01 smithi044 bash[22676]: cluster 2024-09-21T01:06:59.673584+0000 mgr.a (mgr.14388) 7464 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:01 smithi179 bash[23186]: cluster 2024-09-21T01:06:59.673584+0000 mgr.a (mgr.14388) 7464 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:01 smithi049 bash[23528]: cluster 2024-09-21T01:06:59.673584+0000 mgr.a (mgr.14388) 7464 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:02 smithi049 bash[23528]: audit 2024-09-21T01:07:00.238559+0000 mgr.a (mgr.14388) 7465 : audit [DBG] from='client.168765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:02 smithi049 bash[23528]: audit 2024-09-21T01:07:01.998123+0000 mon.a (mon.0) 6425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:02 smithi049 bash[23528]: audit 2024-09-21T01:07:02.007037+0000 mon.a (mon.0) 6426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:02 smithi049 bash[23528]: audit 2024-09-21T01:07:02.017587+0000 mon.a (mon.0) 6427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:02 smithi044 bash[22676]: audit 2024-09-21T01:07:00.238559+0000 mgr.a (mgr.14388) 7465 : audit [DBG] from='client.168765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:02 smithi044 bash[22676]: audit 2024-09-21T01:07:01.998123+0000 mon.a (mon.0) 6425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:02 smithi044 bash[22676]: audit 2024-09-21T01:07:02.007037+0000 mon.a (mon.0) 6426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:02 smithi044 bash[22676]: audit 2024-09-21T01:07:02.017587+0000 mon.a (mon.0) 6427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:02 smithi179 bash[23186]: audit 2024-09-21T01:07:00.238559+0000 mgr.a (mgr.14388) 7465 : audit [DBG] from='client.168765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:02 smithi179 bash[23186]: audit 2024-09-21T01:07:01.998123+0000 mon.a (mon.0) 6425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:02 smithi179 bash[23186]: audit 2024-09-21T01:07:02.007037+0000 mon.a (mon.0) 6426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:02 smithi179 bash[23186]: audit 2024-09-21T01:07:02.017587+0000 mon.a (mon.0) 6427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:03 smithi044 bash[22676]: cluster 2024-09-21T01:07:01.676253+0000 mgr.a (mgr.14388) 7466 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:03 smithi179 bash[23186]: cluster 2024-09-21T01:07:01.676253+0000 mgr.a (mgr.14388) 7466 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:03 smithi049 bash[23528]: cluster 2024-09-21T01:07:01.676253+0000 mgr.a (mgr.14388) 7466 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:05 smithi044 bash[22676]: cluster 2024-09-21T01:07:03.677035+0000 mgr.a (mgr.14388) 7467 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:05 smithi179 bash[23186]: cluster 2024-09-21T01:07:03.677035+0000 mgr.a (mgr.14388) 7467 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:05 smithi049 bash[23528]: cluster 2024-09-21T01:07:03.677035+0000 mgr.a (mgr.14388) 7467 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:05.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:05.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:06.433 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:06.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:06.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:06.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:06.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:07 smithi044 bash[22676]: cluster 2024-09-21T01:07:05.679004+0000 mgr.a (mgr.14388) 7468 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:07 smithi044 bash[22676]: audit 2024-09-21T01:07:06.018646+0000 mgr.a (mgr.14388) 7469 : audit [DBG] from='client.168843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:07 smithi179 bash[23186]: cluster 2024-09-21T01:07:05.679004+0000 mgr.a (mgr.14388) 7468 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:07 smithi179 bash[23186]: audit 2024-09-21T01:07:06.018646+0000 mgr.a (mgr.14388) 7469 : audit [DBG] from='client.168843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:07 smithi049 bash[23528]: cluster 2024-09-21T01:07:05.679004+0000 mgr.a (mgr.14388) 7468 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:07 smithi049 bash[23528]: audit 2024-09-21T01:07:06.018646+0000 mgr.a (mgr.14388) 7469 : audit [DBG] from='client.168843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:09.200 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:09 smithi049 bash[23528]: cluster 2024-09-21T01:07:07.679998+0000 mgr.a (mgr.14388) 7470 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:09 smithi044 bash[22676]: cluster 2024-09-21T01:07:07.679998+0000 mgr.a (mgr.14388) 7470 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:09 smithi179 bash[23186]: cluster 2024-09-21T01:07:07.679998+0000 mgr.a (mgr.14388) 7470 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:11.384 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:11 smithi049 bash[23528]: cluster 2024-09-21T01:07:09.680807+0000 mgr.a (mgr.14388) 7471 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:11 smithi044 bash[22676]: cluster 2024-09-21T01:07:09.680807+0000 mgr.a (mgr.14388) 7471 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:11 smithi179 bash[23186]: cluster 2024-09-21T01:07:09.680807+0000 mgr.a (mgr.14388) 7471 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:07:12.207 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:12.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:12.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:12.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:13 smithi044 bash[22676]: cluster 2024-09-21T01:07:11.682178+0000 mgr.a (mgr.14388) 7472 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:13 smithi044 bash[22676]: audit 2024-09-21T01:07:11.773831+0000 mgr.a (mgr.14388) 7473 : audit [DBG] from='client.168921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:13 smithi179 bash[23186]: cluster 2024-09-21T01:07:11.682178+0000 mgr.a (mgr.14388) 7472 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:13 smithi179 bash[23186]: audit 2024-09-21T01:07:11.773831+0000 mgr.a (mgr.14388) 7473 : audit [DBG] from='client.168921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:13 smithi049 bash[23528]: cluster 2024-09-21T01:07:11.682178+0000 mgr.a (mgr.14388) 7472 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:13 smithi049 bash[23528]: audit 2024-09-21T01:07:11.773831+0000 mgr.a (mgr.14388) 7473 : audit [DBG] from='client.168921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:15 smithi044 bash[22676]: cluster 2024-09-21T01:07:13.683159+0000 mgr.a (mgr.14388) 7474 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:15 smithi179 bash[23186]: cluster 2024-09-21T01:07:13.683159+0000 mgr.a (mgr.14388) 7474 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:15 smithi049 bash[23528]: cluster 2024-09-21T01:07:13.683159+0000 mgr.a (mgr.14388) 7474 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:17.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:17.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:17.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:17 smithi044 bash[22676]: cluster 2024-09-21T01:07:15.685475+0000 mgr.a (mgr.14388) 7475 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:17 smithi179 bash[23186]: cluster 2024-09-21T01:07:15.685475+0000 mgr.a (mgr.14388) 7475 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:17.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:17 smithi049 bash[23528]: cluster 2024-09-21T01:07:15.685475+0000 mgr.a (mgr.14388) 7475 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:17.975 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:17.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:17.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:17.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:17.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:19 smithi044 bash[22676]: audit 2024-09-21T01:07:17.546070+0000 mgr.a (mgr.14388) 7476 : audit [DBG] from='client.168996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:19 smithi044 bash[22676]: cluster 2024-09-21T01:07:17.686233+0000 mgr.a (mgr.14388) 7477 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:19 smithi179 bash[23186]: audit 2024-09-21T01:07:17.546070+0000 mgr.a (mgr.14388) 7476 : audit [DBG] from='client.168996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:19 smithi179 bash[23186]: cluster 2024-09-21T01:07:17.686233+0000 mgr.a (mgr.14388) 7477 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:19 smithi049 bash[23528]: audit 2024-09-21T01:07:17.546070+0000 mgr.a (mgr.14388) 7476 : audit [DBG] from='client.168996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:19 smithi049 bash[23528]: cluster 2024-09-21T01:07:17.686233+0000 mgr.a (mgr.14388) 7477 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:20 smithi049 bash[23528]: audit 2024-09-21T01:07:19.297592+0000 mon.a (mon.0) 6428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:20 smithi049 bash[23528]: audit 2024-09-21T01:07:19.307467+0000 mon.a (mon.0) 6429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:20 smithi049 bash[23528]: audit 2024-09-21T01:07:19.318065+0000 mon.a (mon.0) 6430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:20 smithi049 bash[23528]: cluster 2024-09-21T01:07:19.687191+0000 mgr.a (mgr.14388) 7478 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:20 smithi049 bash[23528]: audit 2024-09-21T01:07:19.940695+0000 mon.a (mon.0) 6431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:20 smithi049 bash[23528]: audit 2024-09-21T01:07:19.948353+0000 mon.a (mon.0) 6432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:20 smithi049 bash[23528]: audit 2024-09-21T01:07:19.956601+0000 mon.a (mon.0) 6433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:20 smithi044 bash[22676]: audit 2024-09-21T01:07:19.297592+0000 mon.a (mon.0) 6428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:20 smithi044 bash[22676]: audit 2024-09-21T01:07:19.307467+0000 mon.a (mon.0) 6429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:20 smithi044 bash[22676]: audit 2024-09-21T01:07:19.318065+0000 mon.a (mon.0) 6430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:20 smithi044 bash[22676]: cluster 2024-09-21T01:07:19.687191+0000 mgr.a (mgr.14388) 7478 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:20 smithi044 bash[22676]: audit 2024-09-21T01:07:19.940695+0000 mon.a (mon.0) 6431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:20 smithi044 bash[22676]: audit 2024-09-21T01:07:19.948353+0000 mon.a (mon.0) 6432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:20 smithi044 bash[22676]: audit 2024-09-21T01:07:19.956601+0000 mon.a (mon.0) 6433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:20 smithi179 bash[23186]: audit 2024-09-21T01:07:19.297592+0000 mon.a (mon.0) 6428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:20 smithi179 bash[23186]: audit 2024-09-21T01:07:19.307467+0000 mon.a (mon.0) 6429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:20 smithi179 bash[23186]: audit 2024-09-21T01:07:19.318065+0000 mon.a (mon.0) 6430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:20 smithi179 bash[23186]: cluster 2024-09-21T01:07:19.687191+0000 mgr.a (mgr.14388) 7478 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:20 smithi179 bash[23186]: audit 2024-09-21T01:07:19.940695+0000 mon.a (mon.0) 6431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:20 smithi179 bash[23186]: audit 2024-09-21T01:07:19.948353+0000 mon.a (mon.0) 6432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:20 smithi179 bash[23186]: audit 2024-09-21T01:07:19.956601+0000 mon.a (mon.0) 6433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:22.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:22.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:22 smithi179 bash[23186]: cluster 2024-09-21T01:07:21.689470+0000 mgr.a (mgr.14388) 7479 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:22 smithi179 bash[23186]: audit 2024-09-21T01:07:22.230292+0000 mon.a (mon.0) 6434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:22 smithi179 bash[23186]: audit 2024-09-21T01:07:22.238584+0000 mon.a (mon.0) 6435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:22 smithi179 bash[23186]: audit 2024-09-21T01:07:22.248651+0000 mon.a (mon.0) 6436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:22 smithi049 bash[23528]: cluster 2024-09-21T01:07:21.689470+0000 mgr.a (mgr.14388) 7479 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:22 smithi049 bash[23528]: audit 2024-09-21T01:07:22.230292+0000 mon.a (mon.0) 6434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:22 smithi049 bash[23528]: audit 2024-09-21T01:07:22.238584+0000 mon.a (mon.0) 6435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:22 smithi049 bash[23528]: audit 2024-09-21T01:07:22.248651+0000 mon.a (mon.0) 6436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:22 smithi044 bash[22676]: cluster 2024-09-21T01:07:21.689470+0000 mgr.a (mgr.14388) 7479 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:22 smithi044 bash[22676]: audit 2024-09-21T01:07:22.230292+0000 mon.a (mon.0) 6434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:22 smithi044 bash[22676]: audit 2024-09-21T01:07:22.238584+0000 mon.a (mon.0) 6435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:22 smithi044 bash[22676]: audit 2024-09-21T01:07:22.248651+0000 mon.a (mon.0) 6436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:23.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:24 smithi179 bash[23186]: audit 2024-09-21T01:07:23.313634+0000 mgr.a (mgr.14388) 7480 : audit [DBG] from='client.169074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:24 smithi179 bash[23186]: cluster 2024-09-21T01:07:23.690005+0000 mgr.a (mgr.14388) 7481 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:24 smithi049 bash[23528]: audit 2024-09-21T01:07:23.313634+0000 mgr.a (mgr.14388) 7480 : audit [DBG] from='client.169074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:24 smithi049 bash[23528]: cluster 2024-09-21T01:07:23.690005+0000 mgr.a (mgr.14388) 7481 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:24 smithi044 bash[22676]: audit 2024-09-21T01:07:23.313634+0000 mgr.a (mgr.14388) 7480 : audit [DBG] from='client.169074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:24 smithi044 bash[22676]: cluster 2024-09-21T01:07:23.690005+0000 mgr.a (mgr.14388) 7481 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:26 smithi049 bash[23528]: cluster 2024-09-21T01:07:25.692098+0000 mgr.a (mgr.14388) 7482 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:26 smithi044 bash[22676]: cluster 2024-09-21T01:07:25.692098+0000 mgr.a (mgr.14388) 7482 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:26 smithi179 bash[23186]: cluster 2024-09-21T01:07:25.692098+0000 mgr.a (mgr.14388) 7482 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:28 smithi044 bash[22676]: cluster 2024-09-21T01:07:27.693014+0000 mgr.a (mgr.14388) 7483 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:28 smithi179 bash[23186]: cluster 2024-09-21T01:07:27.693014+0000 mgr.a (mgr.14388) 7483 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:28.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:28.800 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:28 smithi049 bash[23528]: cluster 2024-09-21T01:07:27.693014+0000 mgr.a (mgr.14388) 7483 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:29.548 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:29.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:29.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:29.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:29.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:29.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:29 smithi049 bash[23528]: audit 2024-09-21T01:07:29.095468+0000 mgr.a (mgr.14388) 7484 : audit [DBG] from='client.169146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:29 smithi044 bash[22676]: audit 2024-09-21T01:07:29.095468+0000 mgr.a (mgr.14388) 7484 : audit [DBG] from='client.169146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:29.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:29 smithi179 bash[23186]: audit 2024-09-21T01:07:29.095468+0000 mgr.a (mgr.14388) 7484 : audit [DBG] from='client.169146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:30 smithi049 bash[23528]: cluster 2024-09-21T01:07:29.694026+0000 mgr.a (mgr.14388) 7485 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:30 smithi044 bash[22676]: cluster 2024-09-21T01:07:29.694026+0000 mgr.a (mgr.14388) 7485 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:30 smithi179 bash[23186]: cluster 2024-09-21T01:07:29.694026+0000 mgr.a (mgr.14388) 7485 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:32 smithi049 bash[23528]: cluster 2024-09-21T01:07:31.696278+0000 mgr.a (mgr.14388) 7486 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:32 smithi044 bash[22676]: cluster 2024-09-21T01:07:31.696278+0000 mgr.a (mgr.14388) 7486 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:32 smithi179 bash[23186]: cluster 2024-09-21T01:07:31.696278+0000 mgr.a (mgr.14388) 7486 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:34.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:34.550 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:34.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:34 smithi049 bash[23528]: cluster 2024-09-21T01:07:33.697093+0000 mgr.a (mgr.14388) 7487 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:34 smithi044 bash[22676]: cluster 2024-09-21T01:07:33.697093+0000 mgr.a (mgr.14388) 7487 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:34 smithi179 bash[23186]: cluster 2024-09-21T01:07:33.697093+0000 mgr.a (mgr.14388) 7487 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:35.309 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:35.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:35.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:35.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:35.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:35 smithi049 bash[23528]: audit 2024-09-21T01:07:34.882410+0000 mgr.a (mgr.14388) 7488 : audit [DBG] from='client.169221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:35 smithi044 bash[22676]: audit 2024-09-21T01:07:34.882410+0000 mgr.a (mgr.14388) 7488 : audit [DBG] from='client.169221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:35 smithi179 bash[23186]: audit 2024-09-21T01:07:34.882410+0000 mgr.a (mgr.14388) 7488 : audit [DBG] from='client.169221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:36 smithi179 bash[23186]: cluster 2024-09-21T01:07:35.699886+0000 mgr.a (mgr.14388) 7489 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:36 smithi049 bash[23528]: cluster 2024-09-21T01:07:35.699886+0000 mgr.a (mgr.14388) 7489 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:36 smithi044 bash[22676]: cluster 2024-09-21T01:07:35.699886+0000 mgr.a (mgr.14388) 7489 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:38 smithi179 bash[23186]: cluster 2024-09-21T01:07:37.700686+0000 mgr.a (mgr.14388) 7490 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:38 smithi049 bash[23528]: cluster 2024-09-21T01:07:37.700686+0000 mgr.a (mgr.14388) 7490 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:39.065 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:38 smithi044 bash[22676]: cluster 2024-09-21T01:07:37.700686+0000 mgr.a (mgr.14388) 7490 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:40.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:40.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:40.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:40.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22930]: debug 2024-09-21T01:07:40.434+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:07:40.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22930]: debug 2024-09-21T01:07:40.434+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.490621+0000 mon.a (mon.0) 6437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.499701+0000 mon.a (mon.0) 6438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.509317+0000 mon.a (mon.0) 6439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.622661+0000 mon.a (mon.0) 6440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.629394+0000 mon.a (mon.0) 6441 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.631288+0000 mon.a (mon.0) 6442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.642746+0000 mon.a (mon.0) 6443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.649168+0000 mon.a (mon.0) 6444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:39.651949+0000 mgr.a (mgr.14388) 7491 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:07:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: cluster 2024-09-21T01:07:39.701825+0000 mgr.a (mgr.14388) 7492 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:40.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:40.070911+0000 mon.a (mon.0) 6445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:40.077573+0000 mon.a (mon.0) 6446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:40 smithi044 bash[22676]: audit 2024-09-21T01:07:40.083438+0000 mon.a (mon.0) 6447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.490621+0000 mon.a (mon.0) 6437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.499701+0000 mon.a (mon.0) 6438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.509317+0000 mon.a (mon.0) 6439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.622661+0000 mon.a (mon.0) 6440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.629394+0000 mon.a (mon.0) 6441 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.631288+0000 mon.a (mon.0) 6442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.642746+0000 mon.a (mon.0) 6443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.649168+0000 mon.a (mon.0) 6444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:39.651949+0000 mgr.a (mgr.14388) 7491 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: cluster 2024-09-21T01:07:39.701825+0000 mgr.a (mgr.14388) 7492 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:40.070911+0000 mon.a (mon.0) 6445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:40.077573+0000 mon.a (mon.0) 6446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:40 smithi179 bash[23186]: audit 2024-09-21T01:07:40.083438+0000 mon.a (mon.0) 6447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.490621+0000 mon.a (mon.0) 6437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.499701+0000 mon.a (mon.0) 6438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.509317+0000 mon.a (mon.0) 6439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.622661+0000 mon.a (mon.0) 6440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.629394+0000 mon.a (mon.0) 6441 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.631288+0000 mon.a (mon.0) 6442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.642746+0000 mon.a (mon.0) 6443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.649168+0000 mon.a (mon.0) 6444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:39.651949+0000 mgr.a (mgr.14388) 7491 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: cluster 2024-09-21T01:07:39.701825+0000 mgr.a (mgr.14388) 7492 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:40.070911+0000 mon.a (mon.0) 6445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:40.077573+0000 mon.a (mon.0) 6446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:40 smithi049 bash[23528]: audit 2024-09-21T01:07:40.083438+0000 mon.a (mon.0) 6447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:41.073 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:41 smithi044 bash[22676]: audit 2024-09-21T01:07:40.438158+0000 mgr.a (mgr.14388) 7493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:07:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:41 smithi044 bash[22676]: cephadm 2024-09-21T01:07:40.439460+0000 mgr.a (mgr.14388) 7494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:07:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:41 smithi044 bash[22676]: audit 2024-09-21T01:07:40.661779+0000 mgr.a (mgr.14388) 7495 : audit [DBG] from='client.169395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:41 smithi179 bash[23186]: audit 2024-09-21T01:07:40.438158+0000 mgr.a (mgr.14388) 7493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:07:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:41 smithi179 bash[23186]: cephadm 2024-09-21T01:07:40.439460+0000 mgr.a (mgr.14388) 7494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:07:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:41 smithi179 bash[23186]: audit 2024-09-21T01:07:40.661779+0000 mgr.a (mgr.14388) 7495 : audit [DBG] from='client.169395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:41 smithi049 bash[23528]: audit 2024-09-21T01:07:40.438158+0000 mgr.a (mgr.14388) 7493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:07:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:41 smithi049 bash[23528]: cephadm 2024-09-21T01:07:40.439460+0000 mgr.a (mgr.14388) 7494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:07:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:41 smithi049 bash[23528]: audit 2024-09-21T01:07:40.661779+0000 mgr.a (mgr.14388) 7495 : audit [DBG] from='client.169395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:42 smithi044 bash[22676]: cluster 2024-09-21T01:07:41.704744+0000 mgr.a (mgr.14388) 7496 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:42 smithi044 bash[22676]: audit 2024-09-21T01:07:42.446952+0000 mon.a (mon.0) 6448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:42 smithi044 bash[22676]: audit 2024-09-21T01:07:42.455792+0000 mon.a (mon.0) 6449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:42 smithi044 bash[22676]: audit 2024-09-21T01:07:42.466782+0000 mon.a (mon.0) 6450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:42 smithi179 bash[23186]: cluster 2024-09-21T01:07:41.704744+0000 mgr.a (mgr.14388) 7496 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:42 smithi179 bash[23186]: audit 2024-09-21T01:07:42.446952+0000 mon.a (mon.0) 6448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:42 smithi179 bash[23186]: audit 2024-09-21T01:07:42.455792+0000 mon.a (mon.0) 6449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:42 smithi179 bash[23186]: audit 2024-09-21T01:07:42.466782+0000 mon.a (mon.0) 6450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:42 smithi049 bash[23528]: cluster 2024-09-21T01:07:41.704744+0000 mgr.a (mgr.14388) 7496 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:07:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:42 smithi049 bash[23528]: audit 2024-09-21T01:07:42.446952+0000 mon.a (mon.0) 6448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:42 smithi049 bash[23528]: audit 2024-09-21T01:07:42.455792+0000 mon.a (mon.0) 6449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:42 smithi049 bash[23528]: audit 2024-09-21T01:07:42.466782+0000 mon.a (mon.0) 6450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:07:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:44 smithi049 bash[23528]: cluster 2024-09-21T01:07:43.705549+0000 mgr.a (mgr.14388) 7497 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:44 smithi044 bash[22676]: cluster 2024-09-21T01:07:43.705549+0000 mgr.a (mgr.14388) 7497 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:44 smithi179 bash[23186]: cluster 2024-09-21T01:07:43.705549+0000 mgr.a (mgr.14388) 7497 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:46.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:46.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:46.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:46.840 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:46.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:46.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:46.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:46.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:46 smithi049 bash[23528]: cluster 2024-09-21T01:07:45.707610+0000 mgr.a (mgr.14388) 7498 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:46 smithi044 bash[22676]: cluster 2024-09-21T01:07:45.707610+0000 mgr.a (mgr.14388) 7498 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:46 smithi179 bash[23186]: cluster 2024-09-21T01:07:45.707610+0000 mgr.a (mgr.14388) 7498 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:47 smithi049 bash[23528]: audit 2024-09-21T01:07:46.409029+0000 mgr.a (mgr.14388) 7499 : audit [DBG] from='client.169470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:47 smithi044 bash[22676]: audit 2024-09-21T01:07:46.409029+0000 mgr.a (mgr.14388) 7499 : audit [DBG] from='client.169470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:47 smithi179 bash[23186]: audit 2024-09-21T01:07:46.409029+0000 mgr.a (mgr.14388) 7499 : audit [DBG] from='client.169470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:48 smithi049 bash[23528]: cluster 2024-09-21T01:07:47.708628+0000 mgr.a (mgr.14388) 7500 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:48 smithi044 bash[22676]: cluster 2024-09-21T01:07:47.708628+0000 mgr.a (mgr.14388) 7500 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:48 smithi179 bash[23186]: cluster 2024-09-21T01:07:47.708628+0000 mgr.a (mgr.14388) 7500 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:50 smithi049 bash[23528]: cluster 2024-09-21T01:07:49.709489+0000 mgr.a (mgr.14388) 7501 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:50 smithi044 bash[22676]: cluster 2024-09-21T01:07:49.709489+0000 mgr.a (mgr.14388) 7501 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:50 smithi179 bash[23186]: cluster 2024-09-21T01:07:49.709489+0000 mgr.a (mgr.14388) 7501 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:52.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:52.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:52.617 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:52 smithi049 bash[23528]: cluster 2024-09-21T01:07:51.711756+0000 mgr.a (mgr.14388) 7502 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:52 smithi049 bash[23528]: audit 2024-09-21T01:07:52.177405+0000 mgr.a (mgr.14388) 7503 : audit [DBG] from='client.169548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:52 smithi044 bash[22676]: cluster 2024-09-21T01:07:51.711756+0000 mgr.a (mgr.14388) 7502 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:52 smithi044 bash[22676]: audit 2024-09-21T01:07:52.177405+0000 mgr.a (mgr.14388) 7503 : audit [DBG] from='client.169548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:52 smithi179 bash[23186]: cluster 2024-09-21T01:07:51.711756+0000 mgr.a (mgr.14388) 7502 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:52 smithi179 bash[23186]: audit 2024-09-21T01:07:52.177405+0000 mgr.a (mgr.14388) 7503 : audit [DBG] from='client.169548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:54 smithi179 bash[23186]: cluster 2024-09-21T01:07:53.712748+0000 mgr.a (mgr.14388) 7504 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:07:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:54 smithi049 bash[23528]: cluster 2024-09-21T01:07:53.712748+0000 mgr.a (mgr.14388) 7504 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:07:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:54 smithi044 bash[22676]: cluster 2024-09-21T01:07:53.712748+0000 mgr.a (mgr.14388) 7504 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:07:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:56 smithi049 bash[23528]: cluster 2024-09-21T01:07:55.714966+0000 mgr.a (mgr.14388) 7505 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:56 smithi044 bash[22676]: cluster 2024-09-21T01:07:55.714966+0000 mgr.a (mgr.14388) 7505 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:56 smithi179 bash[23186]: cluster 2024-09-21T01:07:55.714966+0000 mgr.a (mgr.14388) 7505 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:07:57.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:07:57.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:07:57.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:07:58.386 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:07:58.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:07:58.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:07:58.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:07:58.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:07:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:58 smithi179 bash[23186]: cluster 2024-09-21T01:07:57.715472+0000 mgr.a (mgr.14388) 7506 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:07:58 smithi179 bash[23186]: audit 2024-09-21T01:07:57.952225+0000 mgr.a (mgr.14388) 7507 : audit [DBG] from='client.169623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:58 smithi049 bash[23528]: cluster 2024-09-21T01:07:57.715472+0000 mgr.a (mgr.14388) 7506 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:07:58 smithi049 bash[23528]: audit 2024-09-21T01:07:57.952225+0000 mgr.a (mgr.14388) 7507 : audit [DBG] from='client.169623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:58 smithi044 bash[22676]: cluster 2024-09-21T01:07:57.715472+0000 mgr.a (mgr.14388) 7506 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:07:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:07:58 smithi044 bash[22676]: audit 2024-09-21T01:07:57.952225+0000 mgr.a (mgr.14388) 7507 : audit [DBG] from='client.169623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:00 smithi044 bash[22676]: audit 2024-09-21T01:07:59.677877+0000 mon.a (mon.0) 6451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:00 smithi044 bash[22676]: audit 2024-09-21T01:07:59.687717+0000 mon.a (mon.0) 6452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:00 smithi044 bash[22676]: audit 2024-09-21T01:07:59.697739+0000 mon.a (mon.0) 6453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:00 smithi044 bash[22676]: cluster 2024-09-21T01:07:59.716330+0000 mgr.a (mgr.14388) 7508 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:00 smithi044 bash[22676]: audit 2024-09-21T01:08:00.247626+0000 mon.a (mon.0) 6454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:00 smithi044 bash[22676]: audit 2024-09-21T01:08:00.255902+0000 mon.a (mon.0) 6455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:00 smithi044 bash[22676]: audit 2024-09-21T01:08:00.267119+0000 mon.a (mon.0) 6456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:00 smithi179 bash[23186]: audit 2024-09-21T01:07:59.677877+0000 mon.a (mon.0) 6451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:00 smithi179 bash[23186]: audit 2024-09-21T01:07:59.687717+0000 mon.a (mon.0) 6452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:00 smithi179 bash[23186]: audit 2024-09-21T01:07:59.697739+0000 mon.a (mon.0) 6453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:00 smithi179 bash[23186]: cluster 2024-09-21T01:07:59.716330+0000 mgr.a (mgr.14388) 7508 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:00 smithi179 bash[23186]: audit 2024-09-21T01:08:00.247626+0000 mon.a (mon.0) 6454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:00 smithi179 bash[23186]: audit 2024-09-21T01:08:00.255902+0000 mon.a (mon.0) 6455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:00 smithi179 bash[23186]: audit 2024-09-21T01:08:00.267119+0000 mon.a (mon.0) 6456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:00 smithi049 bash[23528]: audit 2024-09-21T01:07:59.677877+0000 mon.a (mon.0) 6451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:00 smithi049 bash[23528]: audit 2024-09-21T01:07:59.687717+0000 mon.a (mon.0) 6452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:00 smithi049 bash[23528]: audit 2024-09-21T01:07:59.697739+0000 mon.a (mon.0) 6453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:00 smithi049 bash[23528]: cluster 2024-09-21T01:07:59.716330+0000 mgr.a (mgr.14388) 7508 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:00 smithi049 bash[23528]: audit 2024-09-21T01:08:00.247626+0000 mon.a (mon.0) 6454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:00 smithi049 bash[23528]: audit 2024-09-21T01:08:00.255902+0000 mon.a (mon.0) 6455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:00 smithi049 bash[23528]: audit 2024-09-21T01:08:00.267119+0000 mon.a (mon.0) 6456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:02.976 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:02 smithi049 bash[23528]: cluster 2024-09-21T01:08:01.717544+0000 mgr.a (mgr.14388) 7509 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:02.977 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:02 smithi049 bash[23528]: audit 2024-09-21T01:08:02.686182+0000 mon.a (mon.0) 6457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:02.977 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:02 smithi049 bash[23528]: audit 2024-09-21T01:08:02.696257+0000 mon.a (mon.0) 6458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:02.977 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:02 smithi049 bash[23528]: audit 2024-09-21T01:08:02.706100+0000 mon.a (mon.0) 6459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:02 smithi044 bash[22676]: cluster 2024-09-21T01:08:01.717544+0000 mgr.a (mgr.14388) 7509 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:02 smithi044 bash[22676]: audit 2024-09-21T01:08:02.686182+0000 mon.a (mon.0) 6457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:02 smithi044 bash[22676]: audit 2024-09-21T01:08:02.696257+0000 mon.a (mon.0) 6458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:02 smithi044 bash[22676]: audit 2024-09-21T01:08:02.706100+0000 mon.a (mon.0) 6459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:02 smithi179 bash[23186]: cluster 2024-09-21T01:08:01.717544+0000 mgr.a (mgr.14388) 7509 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:02 smithi179 bash[23186]: audit 2024-09-21T01:08:02.686182+0000 mon.a (mon.0) 6457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:02 smithi179 bash[23186]: audit 2024-09-21T01:08:02.696257+0000 mon.a (mon.0) 6458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:02 smithi179 bash[23186]: audit 2024-09-21T01:08:02.706100+0000 mon.a (mon.0) 6459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:03.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:03.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:03.389 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:04.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:04.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:04.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:04.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:04.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:05.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:04 smithi049 bash[23528]: cluster 2024-09-21T01:08:03.718405+0000 mgr.a (mgr.14388) 7510 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:05.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:04 smithi049 bash[23528]: audit 2024-09-21T01:08:03.726331+0000 mgr.a (mgr.14388) 7511 : audit [DBG] from='client.169701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:04 smithi044 bash[22676]: cluster 2024-09-21T01:08:03.718405+0000 mgr.a (mgr.14388) 7510 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:04 smithi044 bash[22676]: audit 2024-09-21T01:08:03.726331+0000 mgr.a (mgr.14388) 7511 : audit [DBG] from='client.169701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:04 smithi179 bash[23186]: cluster 2024-09-21T01:08:03.718405+0000 mgr.a (mgr.14388) 7510 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:04 smithi179 bash[23186]: audit 2024-09-21T01:08:03.726331+0000 mgr.a (mgr.14388) 7511 : audit [DBG] from='client.169701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:07.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:06 smithi049 bash[23528]: cluster 2024-09-21T01:08:05.720696+0000 mgr.a (mgr.14388) 7512 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:06 smithi044 bash[22676]: cluster 2024-09-21T01:08:05.720696+0000 mgr.a (mgr.14388) 7512 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:06 smithi179 bash[23186]: cluster 2024-09-21T01:08:05.720696+0000 mgr.a (mgr.14388) 7512 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:08 smithi049 bash[23528]: cluster 2024-09-21T01:08:07.721526+0000 mgr.a (mgr.14388) 7513 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:09.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:09.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:09.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:08 smithi044 bash[22676]: cluster 2024-09-21T01:08:07.721526+0000 mgr.a (mgr.14388) 7513 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:08 smithi179 bash[23186]: cluster 2024-09-21T01:08:07.721526+0000 mgr.a (mgr.14388) 7513 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:09.950 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:09.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:09.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:09.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:09.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:10 smithi049 bash[23528]: audit 2024-09-21T01:08:09.516001+0000 mgr.a (mgr.14388) 7514 : audit [DBG] from='client.169779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:10 smithi049 bash[23528]: cluster 2024-09-21T01:08:09.722105+0000 mgr.a (mgr.14388) 7515 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:10 smithi044 bash[22676]: audit 2024-09-21T01:08:09.516001+0000 mgr.a (mgr.14388) 7514 : audit [DBG] from='client.169779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:10 smithi044 bash[22676]: cluster 2024-09-21T01:08:09.722105+0000 mgr.a (mgr.14388) 7515 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:10 smithi179 bash[23186]: audit 2024-09-21T01:08:09.516001+0000 mgr.a (mgr.14388) 7514 : audit [DBG] from='client.169779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:10 smithi179 bash[23186]: cluster 2024-09-21T01:08:09.722105+0000 mgr.a (mgr.14388) 7515 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:12 smithi049 bash[23528]: cluster 2024-09-21T01:08:11.724377+0000 mgr.a (mgr.14388) 7516 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:12 smithi044 bash[22676]: cluster 2024-09-21T01:08:11.724377+0000 mgr.a (mgr.14388) 7516 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:12 smithi179 bash[23186]: cluster 2024-09-21T01:08:11.724377+0000 mgr.a (mgr.14388) 7516 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:14.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:14.952 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:14.952 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:14 smithi049 bash[23528]: cluster 2024-09-21T01:08:13.725155+0000 mgr.a (mgr.14388) 7517 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:14 smithi044 bash[22676]: cluster 2024-09-21T01:08:13.725155+0000 mgr.a (mgr.14388) 7517 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:14 smithi179 bash[23186]: cluster 2024-09-21T01:08:13.725155+0000 mgr.a (mgr.14388) 7517 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:15.696 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:15.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:15.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:15.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:15.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:16 smithi044 bash[22676]: audit 2024-09-21T01:08:15.286199+0000 mgr.a (mgr.14388) 7518 : audit [DBG] from='client.169851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:16 smithi044 bash[22676]: cluster 2024-09-21T01:08:15.726607+0000 mgr.a (mgr.14388) 7519 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:16 smithi179 bash[23186]: audit 2024-09-21T01:08:15.286199+0000 mgr.a (mgr.14388) 7518 : audit [DBG] from='client.169851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:16 smithi179 bash[23186]: cluster 2024-09-21T01:08:15.726607+0000 mgr.a (mgr.14388) 7519 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:16 smithi049 bash[23528]: audit 2024-09-21T01:08:15.286199+0000 mgr.a (mgr.14388) 7518 : audit [DBG] from='client.169851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:16 smithi049 bash[23528]: cluster 2024-09-21T01:08:15.726607+0000 mgr.a (mgr.14388) 7519 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:18 smithi179 bash[23186]: cluster 2024-09-21T01:08:17.727525+0000 mgr.a (mgr.14388) 7520 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:08:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:18 smithi044 bash[22676]: cluster 2024-09-21T01:08:17.727525+0000 mgr.a (mgr.14388) 7520 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:08:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:18 smithi049 bash[23528]: cluster 2024-09-21T01:08:17.727525+0000 mgr.a (mgr.14388) 7520 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:08:20.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:20.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:20.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:20 smithi044 bash[22676]: cluster 2024-09-21T01:08:19.728494+0000 mgr.a (mgr.14388) 7521 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:08:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:20 smithi044 bash[22676]: audit 2024-09-21T01:08:19.822291+0000 mon.a (mon.0) 6460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:20 smithi044 bash[22676]: audit 2024-09-21T01:08:19.827193+0000 mon.a (mon.0) 6461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:20 smithi044 bash[22676]: audit 2024-09-21T01:08:19.832559+0000 mon.a (mon.0) 6462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:20 smithi044 bash[22676]: audit 2024-09-21T01:08:20.484799+0000 mon.a (mon.0) 6463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:20 smithi044 bash[22676]: audit 2024-09-21T01:08:20.492968+0000 mon.a (mon.0) 6464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:20 smithi044 bash[22676]: audit 2024-09-21T01:08:20.504216+0000 mon.a (mon.0) 6465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:20 smithi179 bash[23186]: cluster 2024-09-21T01:08:19.728494+0000 mgr.a (mgr.14388) 7521 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:08:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:20 smithi179 bash[23186]: audit 2024-09-21T01:08:19.822291+0000 mon.a (mon.0) 6460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:20 smithi179 bash[23186]: audit 2024-09-21T01:08:19.827193+0000 mon.a (mon.0) 6461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:20 smithi179 bash[23186]: audit 2024-09-21T01:08:19.832559+0000 mon.a (mon.0) 6462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:20 smithi179 bash[23186]: audit 2024-09-21T01:08:20.484799+0000 mon.a (mon.0) 6463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:20 smithi179 bash[23186]: audit 2024-09-21T01:08:20.492968+0000 mon.a (mon.0) 6464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:20 smithi179 bash[23186]: audit 2024-09-21T01:08:20.504216+0000 mon.a (mon.0) 6465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:20 smithi049 bash[23528]: cluster 2024-09-21T01:08:19.728494+0000 mgr.a (mgr.14388) 7521 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:08:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:20 smithi049 bash[23528]: audit 2024-09-21T01:08:19.822291+0000 mon.a (mon.0) 6460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:20 smithi049 bash[23528]: audit 2024-09-21T01:08:19.827193+0000 mon.a (mon.0) 6461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:20 smithi049 bash[23528]: audit 2024-09-21T01:08:19.832559+0000 mon.a (mon.0) 6462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:20 smithi049 bash[23528]: audit 2024-09-21T01:08:20.484799+0000 mon.a (mon.0) 6463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:20 smithi049 bash[23528]: audit 2024-09-21T01:08:20.492968+0000 mon.a (mon.0) 6464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:20 smithi049 bash[23528]: audit 2024-09-21T01:08:20.504216+0000 mon.a (mon.0) 6465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:21.459 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:21.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:21.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:21.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:21.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:21 smithi044 bash[22676]: audit 2024-09-21T01:08:21.032424+0000 mgr.a (mgr.14388) 7522 : audit [DBG] from='client.169926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:21 smithi179 bash[23186]: audit 2024-09-21T01:08:21.032424+0000 mgr.a (mgr.14388) 7522 : audit [DBG] from='client.169926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:21 smithi049 bash[23528]: audit 2024-09-21T01:08:21.032424+0000 mgr.a (mgr.14388) 7522 : audit [DBG] from='client.169926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:22 smithi044 bash[22676]: cluster 2024-09-21T01:08:21.731423+0000 mgr.a (mgr.14388) 7523 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:22 smithi179 bash[23186]: cluster 2024-09-21T01:08:21.731423+0000 mgr.a (mgr.14388) 7523 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:22 smithi049 bash[23528]: cluster 2024-09-21T01:08:21.731423+0000 mgr.a (mgr.14388) 7523 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:23 smithi044 bash[22676]: audit 2024-09-21T01:08:22.910831+0000 mon.a (mon.0) 6466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:23 smithi044 bash[22676]: audit 2024-09-21T01:08:22.920030+0000 mon.a (mon.0) 6467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:23 smithi044 bash[22676]: audit 2024-09-21T01:08:22.931021+0000 mon.a (mon.0) 6468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:23 smithi179 bash[23186]: audit 2024-09-21T01:08:22.910831+0000 mon.a (mon.0) 6466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:23 smithi179 bash[23186]: audit 2024-09-21T01:08:22.920030+0000 mon.a (mon.0) 6467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:23 smithi179 bash[23186]: audit 2024-09-21T01:08:22.931021+0000 mon.a (mon.0) 6468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:23 smithi049 bash[23528]: audit 2024-09-21T01:08:22.910831+0000 mon.a (mon.0) 6466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:23 smithi049 bash[23528]: audit 2024-09-21T01:08:22.920030+0000 mon.a (mon.0) 6467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:23 smithi049 bash[23528]: audit 2024-09-21T01:08:22.931021+0000 mon.a (mon.0) 6468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:24 smithi044 bash[22676]: cluster 2024-09-21T01:08:23.732222+0000 mgr.a (mgr.14388) 7524 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:08:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:24 smithi179 bash[23186]: cluster 2024-09-21T01:08:23.732222+0000 mgr.a (mgr.14388) 7524 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:08:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:24 smithi049 bash[23528]: cluster 2024-09-21T01:08:23.732222+0000 mgr.a (mgr.14388) 7524 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:08:26.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:26.461 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:26 smithi044 bash[22676]: cluster 2024-09-21T01:08:25.734194+0000 mgr.a (mgr.14388) 7525 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:26 smithi179 bash[23186]: cluster 2024-09-21T01:08:25.734194+0000 mgr.a (mgr.14388) 7525 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:27.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:27.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:27.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:27.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:27.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:26 smithi049 bash[23528]: cluster 2024-09-21T01:08:25.734194+0000 mgr.a (mgr.14388) 7525 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:27 smithi044 bash[22676]: audit 2024-09-21T01:08:26.804220+0000 mgr.a (mgr.14388) 7526 : audit [DBG] from='client.169998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:27 smithi179 bash[23186]: audit 2024-09-21T01:08:26.804220+0000 mgr.a (mgr.14388) 7526 : audit [DBG] from='client.169998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:28.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:27 smithi049 bash[23528]: audit 2024-09-21T01:08:26.804220+0000 mgr.a (mgr.14388) 7526 : audit [DBG] from='client.169998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:28 smithi044 bash[22676]: cluster 2024-09-21T01:08:27.735139+0000 mgr.a (mgr.14388) 7527 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:28 smithi179 bash[23186]: cluster 2024-09-21T01:08:27.735139+0000 mgr.a (mgr.14388) 7527 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:29.253 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:28 smithi049 bash[23528]: cluster 2024-09-21T01:08:27.735139+0000 mgr.a (mgr.14388) 7527 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:30 smithi044 bash[22676]: cluster 2024-09-21T01:08:29.736092+0000 mgr.a (mgr.14388) 7528 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:30 smithi179 bash[23186]: cluster 2024-09-21T01:08:29.736092+0000 mgr.a (mgr.14388) 7528 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:30 smithi049 bash[23528]: cluster 2024-09-21T01:08:29.736092+0000 mgr.a (mgr.14388) 7528 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:32.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:32.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:32.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:33.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:33.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:33.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:33.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:32 smithi044 bash[22676]: cluster 2024-09-21T01:08:31.738377+0000 mgr.a (mgr.14388) 7529 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:32 smithi179 bash[23186]: cluster 2024-09-21T01:08:31.738377+0000 mgr.a (mgr.14388) 7529 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:32 smithi049 bash[23528]: cluster 2024-09-21T01:08:31.738377+0000 mgr.a (mgr.14388) 7529 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:33 smithi044 bash[22676]: audit 2024-09-21T01:08:32.588097+0000 mgr.a (mgr.14388) 7530 : audit [DBG] from='client.170073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:33 smithi179 bash[23186]: audit 2024-09-21T01:08:32.588097+0000 mgr.a (mgr.14388) 7530 : audit [DBG] from='client.170073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:33 smithi049 bash[23528]: audit 2024-09-21T01:08:32.588097+0000 mgr.a (mgr.14388) 7530 : audit [DBG] from='client.170073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:34 smithi044 bash[22676]: cluster 2024-09-21T01:08:33.739534+0000 mgr.a (mgr.14388) 7531 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:34 smithi179 bash[23186]: cluster 2024-09-21T01:08:33.739534+0000 mgr.a (mgr.14388) 7531 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:34 smithi049 bash[23528]: cluster 2024-09-21T01:08:33.739534+0000 mgr.a (mgr.14388) 7531 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:36 smithi044 bash[22676]: cluster 2024-09-21T01:08:35.741168+0000 mgr.a (mgr.14388) 7532 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:36 smithi179 bash[23186]: cluster 2024-09-21T01:08:35.741168+0000 mgr.a (mgr.14388) 7532 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:36 smithi049 bash[23528]: cluster 2024-09-21T01:08:35.741168+0000 mgr.a (mgr.14388) 7532 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:38.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:38.010 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:38.010 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:38.768 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:38.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:38.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:38.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:38.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:38 smithi044 bash[22676]: cluster 2024-09-21T01:08:37.742052+0000 mgr.a (mgr.14388) 7533 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:38 smithi179 bash[23186]: cluster 2024-09-21T01:08:37.742052+0000 mgr.a (mgr.14388) 7533 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:38 smithi049 bash[23528]: cluster 2024-09-21T01:08:37.742052+0000 mgr.a (mgr.14388) 7533 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:39 smithi044 bash[22676]: audit 2024-09-21T01:08:38.341656+0000 mgr.a (mgr.14388) 7534 : audit [DBG] from='client.170148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:39 smithi179 bash[23186]: audit 2024-09-21T01:08:38.341656+0000 mgr.a (mgr.14388) 7534 : audit [DBG] from='client.170148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:40.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:39 smithi049 bash[23528]: audit 2024-09-21T01:08:38.341656+0000 mgr.a (mgr.14388) 7534 : audit [DBG] from='client.170148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: cluster 2024-09-21T01:08:39.743086+0000 mgr.a (mgr.14388) 7535 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.028208+0000 mon.a (mon.0) 6469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.035177+0000 mon.a (mon.0) 6470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.042619+0000 mon.a (mon.0) 6471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.501799+0000 mon.a (mon.0) 6472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.512695+0000 mon.a (mon.0) 6473 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.514747+0000 mon.a (mon.0) 6474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.524223+0000 mon.a (mon.0) 6475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.528036+0000 mon.a (mon.0) 6476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.671274+0000 mon.a (mon.0) 6477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.677427+0000 mon.a (mon.0) 6478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:41 smithi049 bash[23528]: audit 2024-09-21T01:08:40.684659+0000 mon.a (mon.0) 6479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: cluster 2024-09-21T01:08:39.743086+0000 mgr.a (mgr.14388) 7535 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.028208+0000 mon.a (mon.0) 6469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.035177+0000 mon.a (mon.0) 6470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.042619+0000 mon.a (mon.0) 6471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.501799+0000 mon.a (mon.0) 6472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.512695+0000 mon.a (mon.0) 6473 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.514747+0000 mon.a (mon.0) 6474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.524223+0000 mon.a (mon.0) 6475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.528036+0000 mon.a (mon.0) 6476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:08:41.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.671274+0000 mon.a (mon.0) 6477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.677427+0000 mon.a (mon.0) 6478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22676]: audit 2024-09-21T01:08:40.684659+0000 mon.a (mon.0) 6479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: cluster 2024-09-21T01:08:39.743086+0000 mgr.a (mgr.14388) 7535 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.028208+0000 mon.a (mon.0) 6469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.035177+0000 mon.a (mon.0) 6470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.042619+0000 mon.a (mon.0) 6471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.501799+0000 mon.a (mon.0) 6472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.512695+0000 mon.a (mon.0) 6473 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.514747+0000 mon.a (mon.0) 6474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:08:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.524223+0000 mon.a (mon.0) 6475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.528036+0000 mon.a (mon.0) 6476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:08:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.671274+0000 mon.a (mon.0) 6477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.677427+0000 mon.a (mon.0) 6478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:41 smithi179 bash[23186]: audit 2024-09-21T01:08:40.684659+0000 mon.a (mon.0) 6479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:41.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22930]: debug 2024-09-21T01:08:41.313+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:08:41.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:08:41 smithi044 bash[22930]: debug 2024-09-21T01:08:41.317+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:08:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:42 smithi044 bash[22676]: audit 2024-09-21T01:08:40.529415+0000 mgr.a (mgr.14388) 7536 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:08:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:42 smithi049 bash[23528]: audit 2024-09-21T01:08:40.529415+0000 mgr.a (mgr.14388) 7536 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:08:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:42 smithi179 bash[23186]: audit 2024-09-21T01:08:40.529415+0000 mgr.a (mgr.14388) 7536 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:08:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:43 smithi049 bash[23528]: audit 2024-09-21T01:08:41.321005+0000 mgr.a (mgr.14388) 7537 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:08:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:43 smithi049 bash[23528]: cephadm 2024-09-21T01:08:41.322583+0000 mgr.a (mgr.14388) 7538 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:08:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:43 smithi049 bash[23528]: cluster 2024-09-21T01:08:41.744680+0000 mgr.a (mgr.14388) 7539 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:43 smithi044 bash[22676]: audit 2024-09-21T01:08:41.321005+0000 mgr.a (mgr.14388) 7537 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:08:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:43 smithi044 bash[22676]: cephadm 2024-09-21T01:08:41.322583+0000 mgr.a (mgr.14388) 7538 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:08:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:43 smithi044 bash[22676]: cluster 2024-09-21T01:08:41.744680+0000 mgr.a (mgr.14388) 7539 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:43 smithi179 bash[23186]: audit 2024-09-21T01:08:41.321005+0000 mgr.a (mgr.14388) 7537 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:08:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:43 smithi179 bash[23186]: cephadm 2024-09-21T01:08:41.322583+0000 mgr.a (mgr.14388) 7538 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:08:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:43 smithi179 bash[23186]: cluster 2024-09-21T01:08:41.744680+0000 mgr.a (mgr.14388) 7539 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:08:43.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:43.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:43.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:44 smithi044 bash[22676]: audit 2024-09-21T01:08:43.146963+0000 mon.a (mon.0) 6480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:44 smithi044 bash[22676]: audit 2024-09-21T01:08:43.155973+0000 mon.a (mon.0) 6481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:44 smithi044 bash[22676]: audit 2024-09-21T01:08:43.166486+0000 mon.a (mon.0) 6482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:44 smithi179 bash[23186]: audit 2024-09-21T01:08:43.146963+0000 mon.a (mon.0) 6480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:44 smithi179 bash[23186]: audit 2024-09-21T01:08:43.155973+0000 mon.a (mon.0) 6481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:44 smithi179 bash[23186]: audit 2024-09-21T01:08:43.166486+0000 mon.a (mon.0) 6482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.535 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:44 smithi049 bash[23528]: audit 2024-09-21T01:08:43.146963+0000 mon.a (mon.0) 6480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:44 smithi049 bash[23528]: audit 2024-09-21T01:08:43.155973+0000 mon.a (mon.0) 6481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:44 smithi049 bash[23528]: audit 2024-09-21T01:08:43.166486+0000 mon.a (mon.0) 6482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:08:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:45 smithi044 bash[22676]: cluster 2024-09-21T01:08:43.745503+0000 mgr.a (mgr.14388) 7540 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:45 smithi044 bash[22676]: audit 2024-09-21T01:08:44.099197+0000 mgr.a (mgr.14388) 7541 : audit [DBG] from='client.170331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:45 smithi179 bash[23186]: cluster 2024-09-21T01:08:43.745503+0000 mgr.a (mgr.14388) 7540 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:45 smithi179 bash[23186]: audit 2024-09-21T01:08:44.099197+0000 mgr.a (mgr.14388) 7541 : audit [DBG] from='client.170331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:45 smithi049 bash[23528]: cluster 2024-09-21T01:08:43.745503+0000 mgr.a (mgr.14388) 7540 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:08:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:45 smithi049 bash[23528]: audit 2024-09-21T01:08:44.099197+0000 mgr.a (mgr.14388) 7541 : audit [DBG] from='client.170331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:47 smithi044 bash[22676]: cluster 2024-09-21T01:08:45.747813+0000 mgr.a (mgr.14388) 7542 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:47 smithi179 bash[23186]: cluster 2024-09-21T01:08:45.747813+0000 mgr.a (mgr.14388) 7542 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:47 smithi049 bash[23528]: cluster 2024-09-21T01:08:45.747813+0000 mgr.a (mgr.14388) 7542 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:49 smithi044 bash[22676]: cluster 2024-09-21T01:08:47.748591+0000 mgr.a (mgr.14388) 7543 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:49 smithi179 bash[23186]: cluster 2024-09-21T01:08:47.748591+0000 mgr.a (mgr.14388) 7543 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:49.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:49.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:49.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:49 smithi049 bash[23528]: cluster 2024-09-21T01:08:47.748591+0000 mgr.a (mgr.14388) 7543 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:50.286 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:50.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:50.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:50.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:50.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:51 smithi044 bash[22676]: cluster 2024-09-21T01:08:49.749365+0000 mgr.a (mgr.14388) 7544 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:51 smithi044 bash[22676]: audit 2024-09-21T01:08:49.874619+0000 mgr.a (mgr.14388) 7545 : audit [DBG] from='client.170406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:51 smithi179 bash[23186]: cluster 2024-09-21T01:08:49.749365+0000 mgr.a (mgr.14388) 7544 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:51 smithi179 bash[23186]: audit 2024-09-21T01:08:49.874619+0000 mgr.a (mgr.14388) 7545 : audit [DBG] from='client.170406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:51.529 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:51 smithi049 bash[23528]: cluster 2024-09-21T01:08:49.749365+0000 mgr.a (mgr.14388) 7544 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:51.529 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:51 smithi049 bash[23528]: audit 2024-09-21T01:08:49.874619+0000 mgr.a (mgr.14388) 7545 : audit [DBG] from='client.170406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:53.442 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:53 smithi049 bash[23528]: cluster 2024-09-21T01:08:51.752142+0000 mgr.a (mgr.14388) 7546 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:53 smithi044 bash[22676]: cluster 2024-09-21T01:08:51.752142+0000 mgr.a (mgr.14388) 7546 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:53 smithi179 bash[23186]: cluster 2024-09-21T01:08:51.752142+0000 mgr.a (mgr.14388) 7546 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:08:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:08:55.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:08:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:55 smithi044 bash[22676]: cluster 2024-09-21T01:08:53.752964+0000 mgr.a (mgr.14388) 7547 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:08:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:55 smithi179 bash[23186]: cluster 2024-09-21T01:08:53.752964+0000 mgr.a (mgr.14388) 7547 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:08:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:55 smithi049 bash[23528]: cluster 2024-09-21T01:08:53.752964+0000 mgr.a (mgr.14388) 7547 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:08:56.042 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:08:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:08:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:08:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:08:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:08:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:57 smithi044 bash[22676]: audit 2024-09-21T01:08:55.614861+0000 mgr.a (mgr.14388) 7548 : audit [DBG] from='client.170484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:57 smithi044 bash[22676]: cluster 2024-09-21T01:08:55.757195+0000 mgr.a (mgr.14388) 7549 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:57 smithi179 bash[23186]: audit 2024-09-21T01:08:55.614861+0000 mgr.a (mgr.14388) 7548 : audit [DBG] from='client.170484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:57 smithi179 bash[23186]: cluster 2024-09-21T01:08:55.757195+0000 mgr.a (mgr.14388) 7549 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:57 smithi049 bash[23528]: audit 2024-09-21T01:08:55.614861+0000 mgr.a (mgr.14388) 7548 : audit [DBG] from='client.170484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:57 smithi049 bash[23528]: cluster 2024-09-21T01:08:55.757195+0000 mgr.a (mgr.14388) 7549 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:08:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:08:59 smithi044 bash[22676]: cluster 2024-09-21T01:08:57.758150+0000 mgr.a (mgr.14388) 7550 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:08:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:08:59 smithi179 bash[23186]: cluster 2024-09-21T01:08:57.758150+0000 mgr.a (mgr.14388) 7550 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:08:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:08:59 smithi049 bash[23528]: cluster 2024-09-21T01:08:57.758150+0000 mgr.a (mgr.14388) 7550 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:01.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:01 smithi044 bash[22676]: cluster 2024-09-21T01:08:59.758959+0000 mgr.a (mgr.14388) 7551 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:01 smithi044 bash[22676]: audit 2024-09-21T01:09:00.200980+0000 mon.a (mon.0) 6483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:01 smithi044 bash[22676]: audit 2024-09-21T01:09:00.211412+0000 mon.a (mon.0) 6484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:01 smithi044 bash[22676]: audit 2024-09-21T01:09:00.217353+0000 mon.a (mon.0) 6485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:01 smithi044 bash[22676]: audit 2024-09-21T01:09:00.825614+0000 mon.a (mon.0) 6486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:01 smithi044 bash[22676]: audit 2024-09-21T01:09:00.831061+0000 mon.a (mon.0) 6487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:01 smithi044 bash[22676]: audit 2024-09-21T01:09:00.836753+0000 mon.a (mon.0) 6488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:01 smithi179 bash[23186]: cluster 2024-09-21T01:08:59.758959+0000 mgr.a (mgr.14388) 7551 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:01 smithi179 bash[23186]: audit 2024-09-21T01:09:00.200980+0000 mon.a (mon.0) 6483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:01 smithi179 bash[23186]: audit 2024-09-21T01:09:00.211412+0000 mon.a (mon.0) 6484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:01 smithi179 bash[23186]: audit 2024-09-21T01:09:00.217353+0000 mon.a (mon.0) 6485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:01 smithi179 bash[23186]: audit 2024-09-21T01:09:00.825614+0000 mon.a (mon.0) 6486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:01 smithi179 bash[23186]: audit 2024-09-21T01:09:00.831061+0000 mon.a (mon.0) 6487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:01 smithi179 bash[23186]: audit 2024-09-21T01:09:00.836753+0000 mon.a (mon.0) 6488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:01 smithi049 bash[23528]: cluster 2024-09-21T01:08:59.758959+0000 mgr.a (mgr.14388) 7551 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:01 smithi049 bash[23528]: audit 2024-09-21T01:09:00.200980+0000 mon.a (mon.0) 6483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:01 smithi049 bash[23528]: audit 2024-09-21T01:09:00.211412+0000 mon.a (mon.0) 6484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:01 smithi049 bash[23528]: audit 2024-09-21T01:09:00.217353+0000 mon.a (mon.0) 6485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:01 smithi049 bash[23528]: audit 2024-09-21T01:09:00.825614+0000 mon.a (mon.0) 6486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:01 smithi049 bash[23528]: audit 2024-09-21T01:09:00.831061+0000 mon.a (mon.0) 6487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:01 smithi049 bash[23528]: audit 2024-09-21T01:09:00.836753+0000 mon.a (mon.0) 6488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:01.828 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:01.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:03 smithi044 bash[22676]: audit 2024-09-21T01:09:01.380986+0000 mgr.a (mgr.14388) 7552 : audit [DBG] from='client.170559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:03 smithi044 bash[22676]: cluster 2024-09-21T01:09:01.760706+0000 mgr.a (mgr.14388) 7553 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:03 smithi179 bash[23186]: audit 2024-09-21T01:09:01.380986+0000 mgr.a (mgr.14388) 7552 : audit [DBG] from='client.170559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:03 smithi179 bash[23186]: cluster 2024-09-21T01:09:01.760706+0000 mgr.a (mgr.14388) 7553 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:03 smithi049 bash[23528]: audit 2024-09-21T01:09:01.380986+0000 mgr.a (mgr.14388) 7552 : audit [DBG] from='client.170559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:03 smithi049 bash[23528]: cluster 2024-09-21T01:09:01.760706+0000 mgr.a (mgr.14388) 7553 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:04 smithi044 bash[22676]: audit 2024-09-21T01:09:03.359255+0000 mon.a (mon.0) 6489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:04 smithi044 bash[22676]: audit 2024-09-21T01:09:03.367501+0000 mon.a (mon.0) 6490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:04 smithi044 bash[22676]: audit 2024-09-21T01:09:03.377187+0000 mon.a (mon.0) 6491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:04 smithi044 bash[22676]: cluster 2024-09-21T01:09:03.761484+0000 mgr.a (mgr.14388) 7554 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:04 smithi179 bash[23186]: audit 2024-09-21T01:09:03.359255+0000 mon.a (mon.0) 6489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:04 smithi179 bash[23186]: audit 2024-09-21T01:09:03.367501+0000 mon.a (mon.0) 6490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:04 smithi179 bash[23186]: audit 2024-09-21T01:09:03.377187+0000 mon.a (mon.0) 6491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:04 smithi179 bash[23186]: cluster 2024-09-21T01:09:03.761484+0000 mgr.a (mgr.14388) 7554 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:04 smithi049 bash[23528]: audit 2024-09-21T01:09:03.359255+0000 mon.a (mon.0) 6489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:04 smithi049 bash[23528]: audit 2024-09-21T01:09:03.367501+0000 mon.a (mon.0) 6490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:04 smithi049 bash[23528]: audit 2024-09-21T01:09:03.377187+0000 mon.a (mon.0) 6491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:04 smithi049 bash[23528]: cluster 2024-09-21T01:09:03.761484+0000 mgr.a (mgr.14388) 7554 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:06.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:06.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:06.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:06 smithi044 bash[22676]: cluster 2024-09-21T01:09:05.763385+0000 mgr.a (mgr.14388) 7555 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:06 smithi179 bash[23186]: cluster 2024-09-21T01:09:05.763385+0000 mgr.a (mgr.14388) 7555 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:06 smithi049 bash[23528]: cluster 2024-09-21T01:09:05.763385+0000 mgr.a (mgr.14388) 7555 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:07.573 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:07 smithi044 bash[22676]: audit 2024-09-21T01:09:07.165835+0000 mgr.a (mgr.14388) 7556 : audit [DBG] from='client.170634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:07 smithi179 bash[23186]: audit 2024-09-21T01:09:07.165835+0000 mgr.a (mgr.14388) 7556 : audit [DBG] from='client.170634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:07 smithi049 bash[23528]: audit 2024-09-21T01:09:07.165835+0000 mgr.a (mgr.14388) 7556 : audit [DBG] from='client.170634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:08 smithi044 bash[22676]: cluster 2024-09-21T01:09:07.764332+0000 mgr.a (mgr.14388) 7557 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:08 smithi179 bash[23186]: cluster 2024-09-21T01:09:07.764332+0000 mgr.a (mgr.14388) 7557 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:08 smithi049 bash[23528]: cluster 2024-09-21T01:09:07.764332+0000 mgr.a (mgr.14388) 7557 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:11.213 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:10 smithi049 bash[23528]: cluster 2024-09-21T01:09:09.765133+0000 mgr.a (mgr.14388) 7558 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:10 smithi044 bash[22676]: cluster 2024-09-21T01:09:09.765133+0000 mgr.a (mgr.14388) 7558 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:10 smithi179 bash[23186]: cluster 2024-09-21T01:09:09.765133+0000 mgr.a (mgr.14388) 7558 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:12 smithi049 bash[23528]: cluster 2024-09-21T01:09:11.767319+0000 mgr.a (mgr.14388) 7559 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:12 smithi044 bash[22676]: cluster 2024-09-21T01:09:11.767319+0000 mgr.a (mgr.14388) 7559 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:12 smithi179 bash[23186]: cluster 2024-09-21T01:09:11.767319+0000 mgr.a (mgr.14388) 7559 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:13.342 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:13.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:13.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:13 smithi044 bash[22676]: audit 2024-09-21T01:09:12.914926+0000 mgr.a (mgr.14388) 7560 : audit [DBG] from='client.170709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:13 smithi179 bash[23186]: audit 2024-09-21T01:09:12.914926+0000 mgr.a (mgr.14388) 7560 : audit [DBG] from='client.170709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:13 smithi049 bash[23528]: audit 2024-09-21T01:09:12.914926+0000 mgr.a (mgr.14388) 7560 : audit [DBG] from='client.170709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:14 smithi044 bash[22676]: cluster 2024-09-21T01:09:13.768296+0000 mgr.a (mgr.14388) 7561 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:14 smithi179 bash[23186]: cluster 2024-09-21T01:09:13.768296+0000 mgr.a (mgr.14388) 7561 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:14 smithi049 bash[23528]: cluster 2024-09-21T01:09:13.768296+0000 mgr.a (mgr.14388) 7561 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:17.124 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:16 smithi179 bash[23186]: cluster 2024-09-21T01:09:15.770503+0000 mgr.a (mgr.14388) 7562 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:16 smithi044 bash[22676]: cluster 2024-09-21T01:09:15.770503+0000 mgr.a (mgr.14388) 7562 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:16 smithi049 bash[23528]: cluster 2024-09-21T01:09:15.770503+0000 mgr.a (mgr.14388) 7562 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:18.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:18.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:18.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:19.119 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:19.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:19.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:18 smithi044 bash[22676]: cluster 2024-09-21T01:09:17.771273+0000 mgr.a (mgr.14388) 7563 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:18 smithi179 bash[23186]: cluster 2024-09-21T01:09:17.771273+0000 mgr.a (mgr.14388) 7563 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:18 smithi049 bash[23528]: cluster 2024-09-21T01:09:17.771273+0000 mgr.a (mgr.14388) 7563 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:19 smithi179 bash[23186]: audit 2024-09-21T01:09:18.685806+0000 mgr.a (mgr.14388) 7564 : audit [DBG] from='client.170784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:19 smithi044 bash[22676]: audit 2024-09-21T01:09:18.685806+0000 mgr.a (mgr.14388) 7564 : audit [DBG] from='client.170784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:19 smithi049 bash[23528]: audit 2024-09-21T01:09:18.685806+0000 mgr.a (mgr.14388) 7564 : audit [DBG] from='client.170784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:20 smithi044 bash[22676]: cluster 2024-09-21T01:09:19.772291+0000 mgr.a (mgr.14388) 7565 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:20 smithi044 bash[22676]: audit 2024-09-21T01:09:20.360083+0000 mon.a (mon.0) 6492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:20 smithi044 bash[22676]: audit 2024-09-21T01:09:20.364837+0000 mon.a (mon.0) 6493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:20 smithi044 bash[22676]: audit 2024-09-21T01:09:20.370762+0000 mon.a (mon.0) 6494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:20 smithi179 bash[23186]: cluster 2024-09-21T01:09:19.772291+0000 mgr.a (mgr.14388) 7565 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:20 smithi179 bash[23186]: audit 2024-09-21T01:09:20.360083+0000 mon.a (mon.0) 6492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:20 smithi179 bash[23186]: audit 2024-09-21T01:09:20.364837+0000 mon.a (mon.0) 6493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:20 smithi179 bash[23186]: audit 2024-09-21T01:09:20.370762+0000 mon.a (mon.0) 6494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:20 smithi049 bash[23528]: cluster 2024-09-21T01:09:19.772291+0000 mgr.a (mgr.14388) 7565 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:20 smithi049 bash[23528]: audit 2024-09-21T01:09:20.360083+0000 mon.a (mon.0) 6492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:20 smithi049 bash[23528]: audit 2024-09-21T01:09:20.364837+0000 mon.a (mon.0) 6493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:20 smithi049 bash[23528]: audit 2024-09-21T01:09:20.370762+0000 mon.a (mon.0) 6494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:22 smithi049 bash[23528]: audit 2024-09-21T01:09:21.021061+0000 mon.a (mon.0) 6495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:22 smithi049 bash[23528]: audit 2024-09-21T01:09:21.027121+0000 mon.a (mon.0) 6496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:22 smithi049 bash[23528]: audit 2024-09-21T01:09:21.033638+0000 mon.a (mon.0) 6497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:22 smithi044 bash[22676]: audit 2024-09-21T01:09:21.021061+0000 mon.a (mon.0) 6495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:22 smithi044 bash[22676]: audit 2024-09-21T01:09:21.027121+0000 mon.a (mon.0) 6496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:22 smithi044 bash[22676]: audit 2024-09-21T01:09:21.033638+0000 mon.a (mon.0) 6497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:22 smithi179 bash[23186]: audit 2024-09-21T01:09:21.021061+0000 mon.a (mon.0) 6495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:22 smithi179 bash[23186]: audit 2024-09-21T01:09:21.027121+0000 mon.a (mon.0) 6496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:22 smithi179 bash[23186]: audit 2024-09-21T01:09:21.033638+0000 mon.a (mon.0) 6497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:23 smithi044 bash[22676]: cluster 2024-09-21T01:09:21.774602+0000 mgr.a (mgr.14388) 7566 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:23 smithi049 bash[23528]: cluster 2024-09-21T01:09:21.774602+0000 mgr.a (mgr.14388) 7566 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:23 smithi179 bash[23186]: cluster 2024-09-21T01:09:21.774602+0000 mgr.a (mgr.14388) 7566 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:24.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:24.888 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:24.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:24.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:24.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:24.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:24 smithi044 bash[22676]: audit 2024-09-21T01:09:23.591299+0000 mon.a (mon.0) 6498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:24 smithi044 bash[22676]: audit 2024-09-21T01:09:23.600001+0000 mon.a (mon.0) 6499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:24 smithi044 bash[22676]: audit 2024-09-21T01:09:23.610459+0000 mon.a (mon.0) 6500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:24 smithi044 bash[22676]: cluster 2024-09-21T01:09:23.775387+0000 mgr.a (mgr.14388) 7567 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:24 smithi179 bash[23186]: audit 2024-09-21T01:09:23.591299+0000 mon.a (mon.0) 6498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:24 smithi179 bash[23186]: audit 2024-09-21T01:09:23.600001+0000 mon.a (mon.0) 6499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:24 smithi179 bash[23186]: audit 2024-09-21T01:09:23.610459+0000 mon.a (mon.0) 6500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:24 smithi179 bash[23186]: cluster 2024-09-21T01:09:23.775387+0000 mgr.a (mgr.14388) 7567 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:24 smithi049 bash[23528]: audit 2024-09-21T01:09:23.591299+0000 mon.a (mon.0) 6498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:24 smithi049 bash[23528]: audit 2024-09-21T01:09:23.600001+0000 mon.a (mon.0) 6499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:24 smithi049 bash[23528]: audit 2024-09-21T01:09:23.610459+0000 mon.a (mon.0) 6500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:24 smithi049 bash[23528]: cluster 2024-09-21T01:09:23.775387+0000 mgr.a (mgr.14388) 7567 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:25 smithi049 bash[23528]: audit 2024-09-21T01:09:24.450724+0000 mgr.a (mgr.14388) 7568 : audit [DBG] from='client.170862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:25 smithi044 bash[22676]: audit 2024-09-21T01:09:24.450724+0000 mgr.a (mgr.14388) 7568 : audit [DBG] from='client.170862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:25 smithi179 bash[23186]: audit 2024-09-21T01:09:24.450724+0000 mgr.a (mgr.14388) 7568 : audit [DBG] from='client.170862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:26 smithi044 bash[22676]: cluster 2024-09-21T01:09:25.777689+0000 mgr.a (mgr.14388) 7569 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:26 smithi179 bash[23186]: cluster 2024-09-21T01:09:25.777689+0000 mgr.a (mgr.14388) 7569 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:27.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:26 smithi049 bash[23528]: cluster 2024-09-21T01:09:25.777689+0000 mgr.a (mgr.14388) 7569 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:09:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:28 smithi044 bash[22676]: cluster 2024-09-21T01:09:27.778428+0000 mgr.a (mgr.14388) 7570 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:28 smithi179 bash[23186]: cluster 2024-09-21T01:09:27.778428+0000 mgr.a (mgr.14388) 7570 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:28 smithi049 bash[23528]: cluster 2024-09-21T01:09:27.778428+0000 mgr.a (mgr.14388) 7570 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:30.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:31.094 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:30 smithi049 bash[23528]: cluster 2024-09-21T01:09:29.779315+0000 mgr.a (mgr.14388) 7571 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:30 smithi044 bash[22676]: cluster 2024-09-21T01:09:29.779315+0000 mgr.a (mgr.14388) 7571 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:30 smithi179 bash[23186]: cluster 2024-09-21T01:09:29.779315+0000 mgr.a (mgr.14388) 7571 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:31 smithi044 bash[22676]: audit 2024-09-21T01:09:30.225605+0000 mgr.a (mgr.14388) 7572 : audit [DBG] from='client.170940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:31 smithi179 bash[23186]: audit 2024-09-21T01:09:30.225605+0000 mgr.a (mgr.14388) 7572 : audit [DBG] from='client.170940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:31 smithi049 bash[23528]: audit 2024-09-21T01:09:30.225605+0000 mgr.a (mgr.14388) 7572 : audit [DBG] from='client.170940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:32 smithi044 bash[22676]: cluster 2024-09-21T01:09:31.782216+0000 mgr.a (mgr.14388) 7573 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:32 smithi179 bash[23186]: cluster 2024-09-21T01:09:31.782216+0000 mgr.a (mgr.14388) 7573 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:32 smithi049 bash[23528]: cluster 2024-09-21T01:09:31.782216+0000 mgr.a (mgr.14388) 7573 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:34 smithi044 bash[22676]: cluster 2024-09-21T01:09:33.783196+0000 mgr.a (mgr.14388) 7574 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:34 smithi179 bash[23186]: cluster 2024-09-21T01:09:33.783196+0000 mgr.a (mgr.14388) 7574 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:34 smithi049 bash[23528]: cluster 2024-09-21T01:09:33.783196+0000 mgr.a (mgr.14388) 7574 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:35.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:36.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:36.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:36.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:36.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:37.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:36 smithi179 bash[23186]: cluster 2024-09-21T01:09:35.784254+0000 mgr.a (mgr.14388) 7575 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:37.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:36 smithi179 bash[23186]: audit 2024-09-21T01:09:36.003214+0000 mgr.a (mgr.14388) 7576 : audit [DBG] from='client.171018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:36 smithi044 bash[22676]: cluster 2024-09-21T01:09:35.784254+0000 mgr.a (mgr.14388) 7575 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:36 smithi044 bash[22676]: audit 2024-09-21T01:09:36.003214+0000 mgr.a (mgr.14388) 7576 : audit [DBG] from='client.171018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:36 smithi049 bash[23528]: cluster 2024-09-21T01:09:35.784254+0000 mgr.a (mgr.14388) 7575 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:36 smithi049 bash[23528]: audit 2024-09-21T01:09:36.003214+0000 mgr.a (mgr.14388) 7576 : audit [DBG] from='client.171018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:38 smithi044 bash[22676]: cluster 2024-09-21T01:09:37.785317+0000 mgr.a (mgr.14388) 7577 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:38 smithi179 bash[23186]: cluster 2024-09-21T01:09:37.785317+0000 mgr.a (mgr.14388) 7577 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:38 smithi049 bash[23528]: cluster 2024-09-21T01:09:37.785317+0000 mgr.a (mgr.14388) 7577 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:40 smithi044 bash[22676]: cluster 2024-09-21T01:09:39.786211+0000 mgr.a (mgr.14388) 7578 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:40 smithi044 bash[22676]: audit 2024-09-21T01:09:40.501276+0000 mon.a (mon.0) 6501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:40 smithi044 bash[22676]: audit 2024-09-21T01:09:40.507121+0000 mon.a (mon.0) 6502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:40 smithi044 bash[22676]: audit 2024-09-21T01:09:40.514137+0000 mon.a (mon.0) 6503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:40 smithi179 bash[23186]: cluster 2024-09-21T01:09:39.786211+0000 mgr.a (mgr.14388) 7578 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:09:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:40 smithi179 bash[23186]: audit 2024-09-21T01:09:40.501276+0000 mon.a (mon.0) 6501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:40 smithi179 bash[23186]: audit 2024-09-21T01:09:40.507121+0000 mon.a (mon.0) 6502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:40 smithi179 bash[23186]: audit 2024-09-21T01:09:40.514137+0000 mon.a (mon.0) 6503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:40 smithi049 bash[23528]: cluster 2024-09-21T01:09:39.786211+0000 mgr.a (mgr.14388) 7578 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:09:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:40 smithi049 bash[23528]: audit 2024-09-21T01:09:40.501276+0000 mon.a (mon.0) 6501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:40 smithi049 bash[23528]: audit 2024-09-21T01:09:40.507121+0000 mon.a (mon.0) 6502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:40 smithi049 bash[23528]: audit 2024-09-21T01:09:40.514137+0000 mon.a (mon.0) 6503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:42.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22930]: debug 2024-09-21T01:09:42.228+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:09:42.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22930]: debug 2024-09-21T01:09:42.240+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.229284+0000 mon.a (mon.0) 6504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.236785+0000 mon.a (mon.0) 6505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.245420+0000 mon.a (mon.0) 6506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.404567+0000 mon.a (mon.0) 6507 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.411360+0000 mon.a (mon.0) 6508 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.413244+0000 mon.a (mon.0) 6509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.425850+0000 mon.a (mon.0) 6510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.432179+0000 mon.a (mon.0) 6511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.434507+0000 mgr.a (mgr.14388) 7579 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: cluster 2024-09-21T01:09:41.795992+0000 mgr.a (mgr.14388) 7580 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:42 smithi044 bash[22676]: audit 2024-09-21T01:09:41.798324+0000 mgr.a (mgr.14388) 7581 : audit [DBG] from='client.171108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.229284+0000 mon.a (mon.0) 6504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.236785+0000 mon.a (mon.0) 6505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.245420+0000 mon.a (mon.0) 6506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.404567+0000 mon.a (mon.0) 6507 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.411360+0000 mon.a (mon.0) 6508 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.413244+0000 mon.a (mon.0) 6509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.425850+0000 mon.a (mon.0) 6510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.432179+0000 mon.a (mon.0) 6511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.434507+0000 mgr.a (mgr.14388) 7579 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: cluster 2024-09-21T01:09:41.795992+0000 mgr.a (mgr.14388) 7580 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:42 smithi179 bash[23186]: audit 2024-09-21T01:09:41.798324+0000 mgr.a (mgr.14388) 7581 : audit [DBG] from='client.171108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.229284+0000 mon.a (mon.0) 6504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.236785+0000 mon.a (mon.0) 6505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.245420+0000 mon.a (mon.0) 6506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.404567+0000 mon.a (mon.0) 6507 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.411360+0000 mon.a (mon.0) 6508 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.413244+0000 mon.a (mon.0) 6509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.425850+0000 mon.a (mon.0) 6510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.432179+0000 mon.a (mon.0) 6511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.434507+0000 mgr.a (mgr.14388) 7579 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: cluster 2024-09-21T01:09:41.795992+0000 mgr.a (mgr.14388) 7580 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:42 smithi049 bash[23528]: audit 2024-09-21T01:09:41.798324+0000 mgr.a (mgr.14388) 7581 : audit [DBG] from='client.171108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:42.652 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:42.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:42.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:42.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:42.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:43 smithi044 bash[22676]: audit 2024-09-21T01:09:42.230990+0000 mgr.a (mgr.14388) 7582 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:09:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:43 smithi044 bash[22676]: cephadm 2024-09-21T01:09:42.244303+0000 mgr.a (mgr.14388) 7583 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:09:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:43 smithi179 bash[23186]: audit 2024-09-21T01:09:42.230990+0000 mgr.a (mgr.14388) 7582 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:09:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:43 smithi179 bash[23186]: cephadm 2024-09-21T01:09:42.244303+0000 mgr.a (mgr.14388) 7583 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:09:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:43 smithi049 bash[23528]: audit 2024-09-21T01:09:42.230990+0000 mgr.a (mgr.14388) 7582 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:09:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:43 smithi049 bash[23528]: cephadm 2024-09-21T01:09:42.244303+0000 mgr.a (mgr.14388) 7583 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:09:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:44 smithi044 bash[22676]: cluster 2024-09-21T01:09:43.796888+0000 mgr.a (mgr.14388) 7584 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:44 smithi044 bash[22676]: audit 2024-09-21T01:09:43.824157+0000 mon.a (mon.0) 6512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:44 smithi044 bash[22676]: audit 2024-09-21T01:09:43.833409+0000 mon.a (mon.0) 6513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:44 smithi044 bash[22676]: audit 2024-09-21T01:09:43.843996+0000 mon.a (mon.0) 6514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:44 smithi179 bash[23186]: cluster 2024-09-21T01:09:43.796888+0000 mgr.a (mgr.14388) 7584 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:44 smithi179 bash[23186]: audit 2024-09-21T01:09:43.824157+0000 mon.a (mon.0) 6512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:44 smithi179 bash[23186]: audit 2024-09-21T01:09:43.833409+0000 mon.a (mon.0) 6513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:44 smithi179 bash[23186]: audit 2024-09-21T01:09:43.843996+0000 mon.a (mon.0) 6514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:44 smithi049 bash[23528]: cluster 2024-09-21T01:09:43.796888+0000 mgr.a (mgr.14388) 7584 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:44 smithi049 bash[23528]: audit 2024-09-21T01:09:43.824157+0000 mon.a (mon.0) 6512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:44 smithi049 bash[23528]: audit 2024-09-21T01:09:43.833409+0000 mon.a (mon.0) 6513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:44 smithi049 bash[23528]: audit 2024-09-21T01:09:43.843996+0000 mon.a (mon.0) 6514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:09:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:46 smithi044 bash[22676]: cluster 2024-09-21T01:09:45.799079+0000 mgr.a (mgr.14388) 7585 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:46 smithi179 bash[23186]: cluster 2024-09-21T01:09:45.799079+0000 mgr.a (mgr.14388) 7585 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:46 smithi049 bash[23528]: cluster 2024-09-21T01:09:45.799079+0000 mgr.a (mgr.14388) 7585 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:47.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:47.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:47.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:48.453 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:48.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:48.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:48.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:48.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:48 smithi044 bash[22676]: cluster 2024-09-21T01:09:47.799816+0000 mgr.a (mgr.14388) 7586 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:48 smithi044 bash[22676]: audit 2024-09-21T01:09:47.994402+0000 mgr.a (mgr.14388) 7587 : audit [DBG] from='client.171279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:48 smithi179 bash[23186]: cluster 2024-09-21T01:09:47.799816+0000 mgr.a (mgr.14388) 7586 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:48 smithi179 bash[23186]: audit 2024-09-21T01:09:47.994402+0000 mgr.a (mgr.14388) 7587 : audit [DBG] from='client.171279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:48 smithi049 bash[23528]: cluster 2024-09-21T01:09:47.799816+0000 mgr.a (mgr.14388) 7586 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:48 smithi049 bash[23528]: audit 2024-09-21T01:09:47.994402+0000 mgr.a (mgr.14388) 7587 : audit [DBG] from='client.171279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:50 smithi044 bash[22676]: cluster 2024-09-21T01:09:49.800747+0000 mgr.a (mgr.14388) 7588 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:50 smithi179 bash[23186]: cluster 2024-09-21T01:09:49.800747+0000 mgr.a (mgr.14388) 7588 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:50 smithi049 bash[23528]: cluster 2024-09-21T01:09:49.800747+0000 mgr.a (mgr.14388) 7588 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:52 smithi044 bash[22676]: cluster 2024-09-21T01:09:51.802988+0000 mgr.a (mgr.14388) 7589 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:52 smithi179 bash[23186]: cluster 2024-09-21T01:09:51.802988+0000 mgr.a (mgr.14388) 7589 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:52 smithi049 bash[23528]: cluster 2024-09-21T01:09:51.802988+0000 mgr.a (mgr.14388) 7589 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:53.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:53.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:53.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:54.217 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:09:54.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:09:54.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:09:54.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:09:54.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:09:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:54 smithi044 bash[22676]: audit 2024-09-21T01:09:53.790841+0000 mgr.a (mgr.14388) 7590 : audit [DBG] from='client.171357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:54 smithi044 bash[22676]: cluster 2024-09-21T01:09:53.809994+0000 mgr.a (mgr.14388) 7591 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:54 smithi179 bash[23186]: audit 2024-09-21T01:09:53.790841+0000 mgr.a (mgr.14388) 7590 : audit [DBG] from='client.171357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:54 smithi179 bash[23186]: cluster 2024-09-21T01:09:53.809994+0000 mgr.a (mgr.14388) 7591 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:54 smithi049 bash[23528]: audit 2024-09-21T01:09:53.790841+0000 mgr.a (mgr.14388) 7590 : audit [DBG] from='client.171357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:54 smithi049 bash[23528]: cluster 2024-09-21T01:09:53.809994+0000 mgr.a (mgr.14388) 7591 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:56 smithi044 bash[22676]: cluster 2024-09-21T01:09:55.812309+0000 mgr.a (mgr.14388) 7592 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:56 smithi179 bash[23186]: cluster 2024-09-21T01:09:55.812309+0000 mgr.a (mgr.14388) 7592 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:56 smithi049 bash[23528]: cluster 2024-09-21T01:09:55.812309+0000 mgr.a (mgr.14388) 7592 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:09:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:09:58 smithi179 bash[23186]: cluster 2024-09-21T01:09:57.813097+0000 mgr.a (mgr.14388) 7593 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:09:59.220 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:09:59.220 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:09:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:09:58 smithi044 bash[22676]: cluster 2024-09-21T01:09:57.813097+0000 mgr.a (mgr.14388) 7593 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:09:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:09:58 smithi049 bash[23528]: cluster 2024-09-21T01:09:57.813097+0000 mgr.a (mgr.14388) 7593 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:00.003 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:00.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:00.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:00.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:00.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:00.943 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:00 smithi179 bash[23186]: audit 2024-09-21T01:09:59.559694+0000 mgr.a (mgr.14388) 7594 : audit [DBG] from='client.171432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:00.943 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:00 smithi179 bash[23186]: cluster 2024-09-21T01:09:59.813930+0000 mgr.a (mgr.14388) 7595 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:00.944 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:00 smithi179 bash[23186]: cluster 2024-09-21T01:10:00.000092+0000 mon.a (mon.0) 6515 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:10:00.944 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:00 smithi179 bash[23186]: audit 2024-09-21T01:10:00.674548+0000 mon.a (mon.0) 6516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:00.944 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:00 smithi179 bash[23186]: audit 2024-09-21T01:10:00.680093+0000 mon.a (mon.0) 6517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:00.944 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:00 smithi179 bash[23186]: audit 2024-09-21T01:10:00.685207+0000 mon.a (mon.0) 6518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:00 smithi044 bash[22676]: audit 2024-09-21T01:09:59.559694+0000 mgr.a (mgr.14388) 7594 : audit [DBG] from='client.171432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:00 smithi044 bash[22676]: cluster 2024-09-21T01:09:59.813930+0000 mgr.a (mgr.14388) 7595 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:00 smithi044 bash[22676]: cluster 2024-09-21T01:10:00.000092+0000 mon.a (mon.0) 6515 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:10:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:00 smithi044 bash[22676]: audit 2024-09-21T01:10:00.674548+0000 mon.a (mon.0) 6516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:00 smithi044 bash[22676]: audit 2024-09-21T01:10:00.680093+0000 mon.a (mon.0) 6517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:00 smithi044 bash[22676]: audit 2024-09-21T01:10:00.685207+0000 mon.a (mon.0) 6518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:00 smithi049 bash[23528]: audit 2024-09-21T01:09:59.559694+0000 mgr.a (mgr.14388) 7594 : audit [DBG] from='client.171432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:00 smithi049 bash[23528]: cluster 2024-09-21T01:09:59.813930+0000 mgr.a (mgr.14388) 7595 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:00 smithi049 bash[23528]: cluster 2024-09-21T01:10:00.000092+0000 mon.a (mon.0) 6515 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:10:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:00 smithi049 bash[23528]: audit 2024-09-21T01:10:00.674548+0000 mon.a (mon.0) 6516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:00 smithi049 bash[23528]: audit 2024-09-21T01:10:00.680093+0000 mon.a (mon.0) 6517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:00 smithi049 bash[23528]: audit 2024-09-21T01:10:00.685207+0000 mon.a (mon.0) 6518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:02 smithi044 bash[22676]: audit 2024-09-21T01:10:01.375795+0000 mon.a (mon.0) 6519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:02 smithi044 bash[22676]: audit 2024-09-21T01:10:01.381319+0000 mon.a (mon.0) 6520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:02 smithi044 bash[22676]: audit 2024-09-21T01:10:01.387692+0000 mon.a (mon.0) 6521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:02 smithi044 bash[22676]: cluster 2024-09-21T01:10:01.816261+0000 mgr.a (mgr.14388) 7596 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:02 smithi179 bash[23186]: audit 2024-09-21T01:10:01.375795+0000 mon.a (mon.0) 6519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:02 smithi179 bash[23186]: audit 2024-09-21T01:10:01.381319+0000 mon.a (mon.0) 6520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:02 smithi179 bash[23186]: audit 2024-09-21T01:10:01.387692+0000 mon.a (mon.0) 6521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:02 smithi179 bash[23186]: cluster 2024-09-21T01:10:01.816261+0000 mgr.a (mgr.14388) 7596 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:02 smithi049 bash[23528]: audit 2024-09-21T01:10:01.375795+0000 mon.a (mon.0) 6519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:02 smithi049 bash[23528]: audit 2024-09-21T01:10:01.381319+0000 mon.a (mon.0) 6520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:02 smithi049 bash[23528]: audit 2024-09-21T01:10:01.387692+0000 mon.a (mon.0) 6521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:02 smithi049 bash[23528]: cluster 2024-09-21T01:10:01.816261+0000 mgr.a (mgr.14388) 7596 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:05.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:05.006 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:05.006 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:05 smithi049 bash[23528]: cluster 2024-09-21T01:10:03.817100+0000 mgr.a (mgr.14388) 7597 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:05 smithi049 bash[23528]: audit 2024-09-21T01:10:04.035779+0000 mon.a (mon.0) 6522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:05 smithi049 bash[23528]: audit 2024-09-21T01:10:04.044528+0000 mon.a (mon.0) 6523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:05 smithi049 bash[23528]: audit 2024-09-21T01:10:04.054687+0000 mon.a (mon.0) 6524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:05 smithi044 bash[22676]: cluster 2024-09-21T01:10:03.817100+0000 mgr.a (mgr.14388) 7597 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:05 smithi044 bash[22676]: audit 2024-09-21T01:10:04.035779+0000 mon.a (mon.0) 6522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:05 smithi044 bash[22676]: audit 2024-09-21T01:10:04.044528+0000 mon.a (mon.0) 6523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:05 smithi044 bash[22676]: audit 2024-09-21T01:10:04.054687+0000 mon.a (mon.0) 6524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:05 smithi179 bash[23186]: cluster 2024-09-21T01:10:03.817100+0000 mgr.a (mgr.14388) 7597 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:05 smithi179 bash[23186]: audit 2024-09-21T01:10:04.035779+0000 mon.a (mon.0) 6522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:05 smithi179 bash[23186]: audit 2024-09-21T01:10:04.044528+0000 mon.a (mon.0) 6523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:05 smithi179 bash[23186]: audit 2024-09-21T01:10:04.054687+0000 mon.a (mon.0) 6524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:05.769 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:05.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:05.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:05.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:05.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:07 smithi049 bash[23528]: audit 2024-09-21T01:10:05.342195+0000 mgr.a (mgr.14388) 7598 : audit [DBG] from='client.171510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:07 smithi049 bash[23528]: cluster 2024-09-21T01:10:05.818610+0000 mgr.a (mgr.14388) 7599 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:07 smithi044 bash[22676]: audit 2024-09-21T01:10:05.342195+0000 mgr.a (mgr.14388) 7598 : audit [DBG] from='client.171510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:07 smithi044 bash[22676]: cluster 2024-09-21T01:10:05.818610+0000 mgr.a (mgr.14388) 7599 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:07 smithi179 bash[23186]: audit 2024-09-21T01:10:05.342195+0000 mgr.a (mgr.14388) 7598 : audit [DBG] from='client.171510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:07 smithi179 bash[23186]: cluster 2024-09-21T01:10:05.818610+0000 mgr.a (mgr.14388) 7599 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:09 smithi049 bash[23528]: cluster 2024-09-21T01:10:07.819330+0000 mgr.a (mgr.14388) 7600 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:10:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:09 smithi044 bash[22676]: cluster 2024-09-21T01:10:07.819330+0000 mgr.a (mgr.14388) 7600 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:10:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:09 smithi179 bash[23186]: cluster 2024-09-21T01:10:07.819330+0000 mgr.a (mgr.14388) 7600 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:10:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:10.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:10.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:11.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:11 smithi049 bash[23528]: cluster 2024-09-21T01:10:09.820090+0000 mgr.a (mgr.14388) 7601 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:10:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:11 smithi044 bash[22676]: cluster 2024-09-21T01:10:09.820090+0000 mgr.a (mgr.14388) 7601 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:10:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:11 smithi179 bash[23186]: cluster 2024-09-21T01:10:09.820090+0000 mgr.a (mgr.14388) 7601 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:10:11.545 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:12 smithi044 bash[22676]: audit 2024-09-21T01:10:11.109078+0000 mgr.a (mgr.14388) 7602 : audit [DBG] from='client.171588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:12 smithi179 bash[23186]: audit 2024-09-21T01:10:11.109078+0000 mgr.a (mgr.14388) 7602 : audit [DBG] from='client.171588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:12 smithi049 bash[23528]: audit 2024-09-21T01:10:11.109078+0000 mgr.a (mgr.14388) 7602 : audit [DBG] from='client.171588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:13 smithi044 bash[22676]: cluster 2024-09-21T01:10:11.822803+0000 mgr.a (mgr.14388) 7603 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:13 smithi179 bash[23186]: cluster 2024-09-21T01:10:11.822803+0000 mgr.a (mgr.14388) 7603 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:13 smithi049 bash[23528]: cluster 2024-09-21T01:10:11.822803+0000 mgr.a (mgr.14388) 7603 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:15 smithi044 bash[22676]: cluster 2024-09-21T01:10:13.823552+0000 mgr.a (mgr.14388) 7604 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:10:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:15 smithi179 bash[23186]: cluster 2024-09-21T01:10:13.823552+0000 mgr.a (mgr.14388) 7604 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:10:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:15 smithi049 bash[23528]: cluster 2024-09-21T01:10:13.823552+0000 mgr.a (mgr.14388) 7604 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:10:16.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:16.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:16.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:17.303 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:17.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:17 smithi044 bash[22676]: cluster 2024-09-21T01:10:15.825572+0000 mgr.a (mgr.14388) 7605 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:17 smithi179 bash[23186]: cluster 2024-09-21T01:10:15.825572+0000 mgr.a (mgr.14388) 7605 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:17 smithi049 bash[23528]: cluster 2024-09-21T01:10:15.825572+0000 mgr.a (mgr.14388) 7605 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:18 smithi044 bash[22676]: audit 2024-09-21T01:10:16.878663+0000 mgr.a (mgr.14388) 7606 : audit [DBG] from='client.171663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:18 smithi179 bash[23186]: audit 2024-09-21T01:10:16.878663+0000 mgr.a (mgr.14388) 7606 : audit [DBG] from='client.171663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:18 smithi049 bash[23528]: audit 2024-09-21T01:10:16.878663+0000 mgr.a (mgr.14388) 7606 : audit [DBG] from='client.171663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:19 smithi044 bash[22676]: cluster 2024-09-21T01:10:17.826492+0000 mgr.a (mgr.14388) 7607 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:19 smithi179 bash[23186]: cluster 2024-09-21T01:10:17.826492+0000 mgr.a (mgr.14388) 7607 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:19 smithi049 bash[23528]: cluster 2024-09-21T01:10:17.826492+0000 mgr.a (mgr.14388) 7607 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:21 smithi044 bash[22676]: cluster 2024-09-21T01:10:19.827309+0000 mgr.a (mgr.14388) 7608 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:21 smithi044 bash[22676]: audit 2024-09-21T01:10:20.837168+0000 mon.a (mon.0) 6525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:21 smithi044 bash[22676]: audit 2024-09-21T01:10:20.841863+0000 mon.a (mon.0) 6526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:21 smithi044 bash[22676]: audit 2024-09-21T01:10:20.847760+0000 mon.a (mon.0) 6527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:21 smithi179 bash[23186]: cluster 2024-09-21T01:10:19.827309+0000 mgr.a (mgr.14388) 7608 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:21 smithi179 bash[23186]: audit 2024-09-21T01:10:20.837168+0000 mon.a (mon.0) 6525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:21 smithi179 bash[23186]: audit 2024-09-21T01:10:20.841863+0000 mon.a (mon.0) 6526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:21 smithi179 bash[23186]: audit 2024-09-21T01:10:20.847760+0000 mon.a (mon.0) 6527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:21 smithi049 bash[23528]: cluster 2024-09-21T01:10:19.827309+0000 mgr.a (mgr.14388) 7608 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:21 smithi049 bash[23528]: audit 2024-09-21T01:10:20.837168+0000 mon.a (mon.0) 6525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:21 smithi049 bash[23528]: audit 2024-09-21T01:10:20.841863+0000 mon.a (mon.0) 6526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:21 smithi049 bash[23528]: audit 2024-09-21T01:10:20.847760+0000 mon.a (mon.0) 6527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:22.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:22.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:22.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:22 smithi044 bash[22676]: audit 2024-09-21T01:10:21.575982+0000 mon.a (mon.0) 6528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:22 smithi044 bash[22676]: audit 2024-09-21T01:10:21.583884+0000 mon.a (mon.0) 6529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:22 smithi044 bash[22676]: audit 2024-09-21T01:10:21.591867+0000 mon.a (mon.0) 6530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:22 smithi044 bash[22676]: cluster 2024-09-21T01:10:21.829573+0000 mgr.a (mgr.14388) 7609 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:22 smithi179 bash[23186]: audit 2024-09-21T01:10:21.575982+0000 mon.a (mon.0) 6528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:22 smithi179 bash[23186]: audit 2024-09-21T01:10:21.583884+0000 mon.a (mon.0) 6529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:22 smithi179 bash[23186]: audit 2024-09-21T01:10:21.591867+0000 mon.a (mon.0) 6530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:22 smithi179 bash[23186]: cluster 2024-09-21T01:10:21.829573+0000 mgr.a (mgr.14388) 7609 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:22 smithi049 bash[23528]: audit 2024-09-21T01:10:21.575982+0000 mon.a (mon.0) 6528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:22 smithi049 bash[23528]: audit 2024-09-21T01:10:21.583884+0000 mon.a (mon.0) 6529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:22 smithi049 bash[23528]: audit 2024-09-21T01:10:21.591867+0000 mon.a (mon.0) 6530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:22 smithi049 bash[23528]: cluster 2024-09-21T01:10:21.829573+0000 mgr.a (mgr.14388) 7609 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:23.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:23.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:23.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:23.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:23.059 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:23 smithi044 bash[22676]: audit 2024-09-21T01:10:22.640208+0000 mgr.a (mgr.14388) 7610 : audit [DBG] from='client.171738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:23 smithi179 bash[23186]: audit 2024-09-21T01:10:22.640208+0000 mgr.a (mgr.14388) 7610 : audit [DBG] from='client.171738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:24.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:23 smithi049 bash[23528]: audit 2024-09-21T01:10:22.640208+0000 mgr.a (mgr.14388) 7610 : audit [DBG] from='client.171738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:24 smithi044 bash[22676]: cluster 2024-09-21T01:10:23.830530+0000 mgr.a (mgr.14388) 7611 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:24 smithi044 bash[22676]: audit 2024-09-21T01:10:24.270782+0000 mon.a (mon.0) 6531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:24 smithi044 bash[22676]: audit 2024-09-21T01:10:24.280097+0000 mon.a (mon.0) 6532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:24 smithi044 bash[22676]: audit 2024-09-21T01:10:24.291000+0000 mon.a (mon.0) 6533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:24 smithi179 bash[23186]: cluster 2024-09-21T01:10:23.830530+0000 mgr.a (mgr.14388) 7611 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:24 smithi179 bash[23186]: audit 2024-09-21T01:10:24.270782+0000 mon.a (mon.0) 6531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:24 smithi179 bash[23186]: audit 2024-09-21T01:10:24.280097+0000 mon.a (mon.0) 6532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:24 smithi179 bash[23186]: audit 2024-09-21T01:10:24.291000+0000 mon.a (mon.0) 6533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:24 smithi049 bash[23528]: cluster 2024-09-21T01:10:23.830530+0000 mgr.a (mgr.14388) 7611 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:24 smithi049 bash[23528]: audit 2024-09-21T01:10:24.270782+0000 mon.a (mon.0) 6531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:24 smithi049 bash[23528]: audit 2024-09-21T01:10:24.280097+0000 mon.a (mon.0) 6532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:24 smithi049 bash[23528]: audit 2024-09-21T01:10:24.291000+0000 mon.a (mon.0) 6533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:26 smithi044 bash[22676]: cluster 2024-09-21T01:10:25.832658+0000 mgr.a (mgr.14388) 7612 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:27.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:26 smithi049 bash[23528]: cluster 2024-09-21T01:10:25.832658+0000 mgr.a (mgr.14388) 7612 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:26 smithi179 bash[23186]: cluster 2024-09-21T01:10:25.832658+0000 mgr.a (mgr.14388) 7612 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:28.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:28.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:28 smithi044 bash[22676]: cluster 2024-09-21T01:10:27.833438+0000 mgr.a (mgr.14388) 7613 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:28 smithi179 bash[23186]: cluster 2024-09-21T01:10:27.833438+0000 mgr.a (mgr.14388) 7613 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:28 smithi049 bash[23528]: cluster 2024-09-21T01:10:27.833438+0000 mgr.a (mgr.14388) 7613 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:29 smithi044 bash[22676]: audit 2024-09-21T01:10:28.392968+0000 mgr.a (mgr.14388) 7614 : audit [DBG] from='client.171816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:29 smithi179 bash[23186]: audit 2024-09-21T01:10:28.392968+0000 mgr.a (mgr.14388) 7614 : audit [DBG] from='client.171816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:29 smithi049 bash[23528]: audit 2024-09-21T01:10:28.392968+0000 mgr.a (mgr.14388) 7614 : audit [DBG] from='client.171816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:30 smithi044 bash[22676]: cluster 2024-09-21T01:10:29.834326+0000 mgr.a (mgr.14388) 7615 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:30 smithi179 bash[23186]: cluster 2024-09-21T01:10:29.834326+0000 mgr.a (mgr.14388) 7615 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:30 smithi049 bash[23528]: cluster 2024-09-21T01:10:29.834326+0000 mgr.a (mgr.14388) 7615 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:32 smithi044 bash[22676]: cluster 2024-09-21T01:10:31.836537+0000 mgr.a (mgr.14388) 7616 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:32 smithi179 bash[23186]: cluster 2024-09-21T01:10:31.836537+0000 mgr.a (mgr.14388) 7616 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:32 smithi049 bash[23528]: cluster 2024-09-21T01:10:31.836537+0000 mgr.a (mgr.14388) 7616 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:33.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:33.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:34.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:34 smithi049 bash[23528]: cluster 2024-09-21T01:10:33.837339+0000 mgr.a (mgr.14388) 7617 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:34 smithi049 bash[23528]: audit 2024-09-21T01:10:34.154222+0000 mgr.a (mgr.14388) 7618 : audit [DBG] from='client.171891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:34 smithi044 bash[22676]: cluster 2024-09-21T01:10:33.837339+0000 mgr.a (mgr.14388) 7617 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:34 smithi044 bash[22676]: audit 2024-09-21T01:10:34.154222+0000 mgr.a (mgr.14388) 7618 : audit [DBG] from='client.171891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:34 smithi179 bash[23186]: cluster 2024-09-21T01:10:33.837339+0000 mgr.a (mgr.14388) 7617 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:34 smithi179 bash[23186]: audit 2024-09-21T01:10:34.154222+0000 mgr.a (mgr.14388) 7618 : audit [DBG] from='client.171891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:36 smithi044 bash[22676]: cluster 2024-09-21T01:10:35.839626+0000 mgr.a (mgr.14388) 7619 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:36 smithi179 bash[23186]: cluster 2024-09-21T01:10:35.839626+0000 mgr.a (mgr.14388) 7619 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:36 smithi049 bash[23528]: cluster 2024-09-21T01:10:35.839626+0000 mgr.a (mgr.14388) 7619 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:10:39.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:38 smithi179 bash[23186]: cluster 2024-09-21T01:10:37.840517+0000 mgr.a (mgr.14388) 7620 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:38 smithi044 bash[22676]: cluster 2024-09-21T01:10:37.840517+0000 mgr.a (mgr.14388) 7620 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:38 smithi049 bash[23528]: cluster 2024-09-21T01:10:37.840517+0000 mgr.a (mgr.14388) 7620 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:39.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:40.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:40.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:40.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:40.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:40.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:40 smithi044 bash[22676]: cluster 2024-09-21T01:10:39.841289+0000 mgr.a (mgr.14388) 7621 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:40 smithi044 bash[22676]: audit 2024-09-21T01:10:39.904235+0000 mgr.a (mgr.14388) 7622 : audit [DBG] from='client.171969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:40 smithi179 bash[23186]: cluster 2024-09-21T01:10:39.841289+0000 mgr.a (mgr.14388) 7621 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:40 smithi179 bash[23186]: audit 2024-09-21T01:10:39.904235+0000 mgr.a (mgr.14388) 7622 : audit [DBG] from='client.171969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:40 smithi049 bash[23528]: cluster 2024-09-21T01:10:39.841289+0000 mgr.a (mgr.14388) 7621 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:40 smithi049 bash[23528]: audit 2024-09-21T01:10:39.904235+0000 mgr.a (mgr.14388) 7622 : audit [DBG] from='client.171969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:41 smithi044 bash[22676]: audit 2024-09-21T01:10:40.967704+0000 mon.a (mon.0) 6534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:41 smithi044 bash[22676]: audit 2024-09-21T01:10:40.975837+0000 mon.a (mon.0) 6535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:41 smithi044 bash[22676]: audit 2024-09-21T01:10:40.986216+0000 mon.a (mon.0) 6536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:41 smithi044 bash[22676]: audit 2024-09-21T01:10:41.781653+0000 mon.a (mon.0) 6537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:41 smithi044 bash[22676]: audit 2024-09-21T01:10:41.790761+0000 mon.a (mon.0) 6538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:41 smithi044 bash[22676]: audit 2024-09-21T01:10:41.801873+0000 mon.a (mon.0) 6539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:41 smithi179 bash[23186]: audit 2024-09-21T01:10:40.967704+0000 mon.a (mon.0) 6534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:41 smithi179 bash[23186]: audit 2024-09-21T01:10:40.975837+0000 mon.a (mon.0) 6535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:41 smithi179 bash[23186]: audit 2024-09-21T01:10:40.986216+0000 mon.a (mon.0) 6536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:41 smithi179 bash[23186]: audit 2024-09-21T01:10:41.781653+0000 mon.a (mon.0) 6537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:41 smithi179 bash[23186]: audit 2024-09-21T01:10:41.790761+0000 mon.a (mon.0) 6538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:41 smithi179 bash[23186]: audit 2024-09-21T01:10:41.801873+0000 mon.a (mon.0) 6539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:41 smithi049 bash[23528]: audit 2024-09-21T01:10:40.967704+0000 mon.a (mon.0) 6534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:41 smithi049 bash[23528]: audit 2024-09-21T01:10:40.975837+0000 mon.a (mon.0) 6535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:41 smithi049 bash[23528]: audit 2024-09-21T01:10:40.986216+0000 mon.a (mon.0) 6536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:41 smithi049 bash[23528]: audit 2024-09-21T01:10:41.781653+0000 mon.a (mon.0) 6537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:41 smithi049 bash[23528]: audit 2024-09-21T01:10:41.790761+0000 mon.a (mon.0) 6538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:41 smithi049 bash[23528]: audit 2024-09-21T01:10:41.801873+0000 mon.a (mon.0) 6539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:43.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:10:43 smithi044 bash[22930]: debug 2024-09-21T01:10:43.127+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:10:43.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:10:43 smithi044 bash[22930]: debug 2024-09-21T01:10:43.127+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:10:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:42 smithi044 bash[22676]: cluster 2024-09-21T01:10:41.844032+0000 mgr.a (mgr.14388) 7623 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:42 smithi044 bash[22676]: audit 2024-09-21T01:10:42.311045+0000 mon.a (mon.0) 6540 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:10:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:42 smithi044 bash[22676]: audit 2024-09-21T01:10:42.316909+0000 mon.a (mon.0) 6541 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:10:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:42 smithi044 bash[22676]: audit 2024-09-21T01:10:42.318748+0000 mon.a (mon.0) 6542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:10:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:42 smithi044 bash[22676]: audit 2024-09-21T01:10:42.330996+0000 mon.a (mon.0) 6543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:42 smithi044 bash[22676]: audit 2024-09-21T01:10:42.337442+0000 mon.a (mon.0) 6544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:10:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:42 smithi179 bash[23186]: cluster 2024-09-21T01:10:41.844032+0000 mgr.a (mgr.14388) 7623 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:42 smithi179 bash[23186]: audit 2024-09-21T01:10:42.311045+0000 mon.a (mon.0) 6540 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:10:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:42 smithi179 bash[23186]: audit 2024-09-21T01:10:42.316909+0000 mon.a (mon.0) 6541 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:10:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:42 smithi179 bash[23186]: audit 2024-09-21T01:10:42.318748+0000 mon.a (mon.0) 6542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:10:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:42 smithi179 bash[23186]: audit 2024-09-21T01:10:42.330996+0000 mon.a (mon.0) 6543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:42 smithi179 bash[23186]: audit 2024-09-21T01:10:42.337442+0000 mon.a (mon.0) 6544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:10:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:42 smithi049 bash[23528]: cluster 2024-09-21T01:10:41.844032+0000 mgr.a (mgr.14388) 7623 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:42 smithi049 bash[23528]: audit 2024-09-21T01:10:42.311045+0000 mon.a (mon.0) 6540 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:10:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:42 smithi049 bash[23528]: audit 2024-09-21T01:10:42.316909+0000 mon.a (mon.0) 6541 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:10:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:42 smithi049 bash[23528]: audit 2024-09-21T01:10:42.318748+0000 mon.a (mon.0) 6542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:10:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:42 smithi049 bash[23528]: audit 2024-09-21T01:10:42.330996+0000 mon.a (mon.0) 6543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:43.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:42 smithi049 bash[23528]: audit 2024-09-21T01:10:42.337442+0000 mon.a (mon.0) 6544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:10:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:43 smithi044 bash[22676]: audit 2024-09-21T01:10:42.339967+0000 mgr.a (mgr.14388) 7624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:10:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:43 smithi044 bash[22676]: audit 2024-09-21T01:10:43.131837+0000 mgr.a (mgr.14388) 7625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:10:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:43 smithi044 bash[22676]: cephadm 2024-09-21T01:10:43.132945+0000 mgr.a (mgr.14388) 7626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:10:44.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:43 smithi179 bash[23186]: audit 2024-09-21T01:10:42.339967+0000 mgr.a (mgr.14388) 7624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:10:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:43 smithi179 bash[23186]: audit 2024-09-21T01:10:43.131837+0000 mgr.a (mgr.14388) 7625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:10:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:43 smithi179 bash[23186]: cephadm 2024-09-21T01:10:43.132945+0000 mgr.a (mgr.14388) 7626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:10:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:43 smithi049 bash[23528]: audit 2024-09-21T01:10:42.339967+0000 mgr.a (mgr.14388) 7624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:10:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:43 smithi049 bash[23528]: audit 2024-09-21T01:10:43.131837+0000 mgr.a (mgr.14388) 7625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:10:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:43 smithi049 bash[23528]: cephadm 2024-09-21T01:10:43.132945+0000 mgr.a (mgr.14388) 7626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:10:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:44 smithi044 bash[22676]: cluster 2024-09-21T01:10:43.844933+0000 mgr.a (mgr.14388) 7627 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:10:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:44 smithi044 bash[22676]: audit 2024-09-21T01:10:44.486301+0000 mon.a (mon.0) 6545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:44 smithi044 bash[22676]: audit 2024-09-21T01:10:44.494992+0000 mon.a (mon.0) 6546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:44 smithi044 bash[22676]: audit 2024-09-21T01:10:44.506516+0000 mon.a (mon.0) 6547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:44 smithi179 bash[23186]: cluster 2024-09-21T01:10:43.844933+0000 mgr.a (mgr.14388) 7627 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:10:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:44 smithi179 bash[23186]: audit 2024-09-21T01:10:44.486301+0000 mon.a (mon.0) 6545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:44 smithi179 bash[23186]: audit 2024-09-21T01:10:44.494992+0000 mon.a (mon.0) 6546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:44 smithi179 bash[23186]: audit 2024-09-21T01:10:44.506516+0000 mon.a (mon.0) 6547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:44 smithi049 bash[23528]: cluster 2024-09-21T01:10:43.844933+0000 mgr.a (mgr.14388) 7627 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:10:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:44 smithi049 bash[23528]: audit 2024-09-21T01:10:44.486301+0000 mon.a (mon.0) 6545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:44 smithi049 bash[23528]: audit 2024-09-21T01:10:44.494992+0000 mon.a (mon.0) 6546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:44 smithi049 bash[23528]: audit 2024-09-21T01:10:44.506516+0000 mon.a (mon.0) 6547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:10:45.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:45.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:45.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:46.105 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:46.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:46.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:46.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:46.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:46 smithi044 bash[22676]: audit 2024-09-21T01:10:45.670306+0000 mgr.a (mgr.14388) 7628 : audit [DBG] from='client.172152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:46 smithi044 bash[22676]: cluster 2024-09-21T01:10:45.846180+0000 mgr.a (mgr.14388) 7629 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:46 smithi179 bash[23186]: audit 2024-09-21T01:10:45.670306+0000 mgr.a (mgr.14388) 7628 : audit [DBG] from='client.172152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:46 smithi179 bash[23186]: cluster 2024-09-21T01:10:45.846180+0000 mgr.a (mgr.14388) 7629 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:46 smithi049 bash[23528]: audit 2024-09-21T01:10:45.670306+0000 mgr.a (mgr.14388) 7628 : audit [DBG] from='client.172152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:46 smithi049 bash[23528]: cluster 2024-09-21T01:10:45.846180+0000 mgr.a (mgr.14388) 7629 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:48 smithi049 bash[23528]: cluster 2024-09-21T01:10:47.847075+0000 mgr.a (mgr.14388) 7630 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:10:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:48 smithi044 bash[22676]: cluster 2024-09-21T01:10:47.847075+0000 mgr.a (mgr.14388) 7630 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:10:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:48 smithi179 bash[23186]: cluster 2024-09-21T01:10:47.847075+0000 mgr.a (mgr.14388) 7630 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:10:51.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:51.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:50 smithi044 bash[22676]: cluster 2024-09-21T01:10:49.847848+0000 mgr.a (mgr.14388) 7631 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:10:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:50 smithi179 bash[23186]: cluster 2024-09-21T01:10:49.847848+0000 mgr.a (mgr.14388) 7631 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:10:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:50 smithi049 bash[23528]: cluster 2024-09-21T01:10:49.847848+0000 mgr.a (mgr.14388) 7631 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:10:51.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:51.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:51.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:51.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:51.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:52 smithi044 bash[22676]: audit 2024-09-21T01:10:51.437032+0000 mgr.a (mgr.14388) 7632 : audit [DBG] from='client.172230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:52 smithi044 bash[22676]: cluster 2024-09-21T01:10:51.849050+0000 mgr.a (mgr.14388) 7633 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:52 smithi179 bash[23186]: audit 2024-09-21T01:10:51.437032+0000 mgr.a (mgr.14388) 7632 : audit [DBG] from='client.172230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:52 smithi179 bash[23186]: cluster 2024-09-21T01:10:51.849050+0000 mgr.a (mgr.14388) 7633 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:52 smithi049 bash[23528]: audit 2024-09-21T01:10:51.437032+0000 mgr.a (mgr.14388) 7632 : audit [DBG] from='client.172230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:52 smithi049 bash[23528]: cluster 2024-09-21T01:10:51.849050+0000 mgr.a (mgr.14388) 7633 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:55.167 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:54 smithi049 bash[23528]: cluster 2024-09-21T01:10:53.849825+0000 mgr.a (mgr.14388) 7634 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:54 smithi044 bash[22676]: cluster 2024-09-21T01:10:53.849825+0000 mgr.a (mgr.14388) 7634 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:54 smithi179 bash[23186]: cluster 2024-09-21T01:10:53.849825+0000 mgr.a (mgr.14388) 7634 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:10:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:10:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:10:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:56 smithi044 bash[22676]: cluster 2024-09-21T01:10:55.851786+0000 mgr.a (mgr.14388) 7635 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:56 smithi179 bash[23186]: cluster 2024-09-21T01:10:55.851786+0000 mgr.a (mgr.14388) 7635 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:56 smithi049 bash[23528]: cluster 2024-09-21T01:10:55.851786+0000 mgr.a (mgr.14388) 7635 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:10:57.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:10:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:10:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:10:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:10:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:10:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:57 smithi044 bash[22676]: audit 2024-09-21T01:10:57.193970+0000 mgr.a (mgr.14388) 7636 : audit [DBG] from='client.172308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:57 smithi179 bash[23186]: audit 2024-09-21T01:10:57.193970+0000 mgr.a (mgr.14388) 7636 : audit [DBG] from='client.172308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:57 smithi049 bash[23528]: audit 2024-09-21T01:10:57.193970+0000 mgr.a (mgr.14388) 7636 : audit [DBG] from='client.172308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:10:58 smithi044 bash[22676]: cluster 2024-09-21T01:10:57.852805+0000 mgr.a (mgr.14388) 7637 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:10:58 smithi179 bash[23186]: cluster 2024-09-21T01:10:57.852805+0000 mgr.a (mgr.14388) 7637 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:10:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:10:58 smithi049 bash[23528]: cluster 2024-09-21T01:10:57.852805+0000 mgr.a (mgr.14388) 7637 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:00 smithi179 bash[23186]: cluster 2024-09-21T01:10:59.853840+0000 mgr.a (mgr.14388) 7638 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:01.050 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:00 smithi044 bash[22676]: cluster 2024-09-21T01:10:59.853840+0000 mgr.a (mgr.14388) 7638 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:00 smithi049 bash[23528]: cluster 2024-09-21T01:10:59.853840+0000 mgr.a (mgr.14388) 7638 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:02 smithi044 bash[22676]: audit 2024-09-21T01:11:01.173746+0000 mon.a (mon.0) 6548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:02 smithi044 bash[22676]: audit 2024-09-21T01:11:01.183452+0000 mon.a (mon.0) 6549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:02 smithi044 bash[22676]: audit 2024-09-21T01:11:01.195018+0000 mon.a (mon.0) 6550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:02 smithi044 bash[22676]: audit 2024-09-21T01:11:01.983245+0000 mon.a (mon.0) 6551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:02 smithi044 bash[22676]: audit 2024-09-21T01:11:01.991441+0000 mon.a (mon.0) 6552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:02 smithi044 bash[22676]: audit 2024-09-21T01:11:02.001948+0000 mon.a (mon.0) 6553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:02 smithi179 bash[23186]: audit 2024-09-21T01:11:01.173746+0000 mon.a (mon.0) 6548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:02 smithi179 bash[23186]: audit 2024-09-21T01:11:01.183452+0000 mon.a (mon.0) 6549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:02 smithi179 bash[23186]: audit 2024-09-21T01:11:01.195018+0000 mon.a (mon.0) 6550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:02 smithi179 bash[23186]: audit 2024-09-21T01:11:01.983245+0000 mon.a (mon.0) 6551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:02 smithi179 bash[23186]: audit 2024-09-21T01:11:01.991441+0000 mon.a (mon.0) 6552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:02 smithi179 bash[23186]: audit 2024-09-21T01:11:02.001948+0000 mon.a (mon.0) 6553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:02 smithi049 bash[23528]: audit 2024-09-21T01:11:01.173746+0000 mon.a (mon.0) 6548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:02 smithi049 bash[23528]: audit 2024-09-21T01:11:01.183452+0000 mon.a (mon.0) 6549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:02 smithi049 bash[23528]: audit 2024-09-21T01:11:01.195018+0000 mon.a (mon.0) 6550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:02 smithi049 bash[23528]: audit 2024-09-21T01:11:01.983245+0000 mon.a (mon.0) 6551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:02 smithi049 bash[23528]: audit 2024-09-21T01:11:01.991441+0000 mon.a (mon.0) 6552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:02 smithi049 bash[23528]: audit 2024-09-21T01:11:02.001948+0000 mon.a (mon.0) 6553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:02.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:03.405 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:03.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:03.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:03.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:03.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:03 smithi044 bash[22676]: cluster 2024-09-21T01:11:01.855250+0000 mgr.a (mgr.14388) 7639 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:03 smithi179 bash[23186]: cluster 2024-09-21T01:11:01.855250+0000 mgr.a (mgr.14388) 7639 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:03 smithi049 bash[23528]: cluster 2024-09-21T01:11:01.855250+0000 mgr.a (mgr.14388) 7639 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:04 smithi044 bash[22676]: audit 2024-09-21T01:11:02.985272+0000 mgr.a (mgr.14388) 7640 : audit [DBG] from='client.172383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:04 smithi179 bash[23186]: audit 2024-09-21T01:11:02.985272+0000 mgr.a (mgr.14388) 7640 : audit [DBG] from='client.172383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:04 smithi049 bash[23528]: audit 2024-09-21T01:11:02.985272+0000 mgr.a (mgr.14388) 7640 : audit [DBG] from='client.172383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:05 smithi044 bash[22676]: cluster 2024-09-21T01:11:03.856406+0000 mgr.a (mgr.14388) 7641 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:05 smithi044 bash[22676]: audit 2024-09-21T01:11:04.705643+0000 mon.a (mon.0) 6554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:05 smithi044 bash[22676]: audit 2024-09-21T01:11:04.714530+0000 mon.a (mon.0) 6555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:05 smithi044 bash[22676]: audit 2024-09-21T01:11:04.725184+0000 mon.a (mon.0) 6556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:05 smithi179 bash[23186]: cluster 2024-09-21T01:11:03.856406+0000 mgr.a (mgr.14388) 7641 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:05 smithi179 bash[23186]: audit 2024-09-21T01:11:04.705643+0000 mon.a (mon.0) 6554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:05 smithi179 bash[23186]: audit 2024-09-21T01:11:04.714530+0000 mon.a (mon.0) 6555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:05 smithi179 bash[23186]: audit 2024-09-21T01:11:04.725184+0000 mon.a (mon.0) 6556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:05 smithi049 bash[23528]: cluster 2024-09-21T01:11:03.856406+0000 mgr.a (mgr.14388) 7641 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:05 smithi049 bash[23528]: audit 2024-09-21T01:11:04.705643+0000 mon.a (mon.0) 6554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:05 smithi049 bash[23528]: audit 2024-09-21T01:11:04.714530+0000 mon.a (mon.0) 6555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:05 smithi049 bash[23528]: audit 2024-09-21T01:11:04.725184+0000 mon.a (mon.0) 6556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:07 smithi044 bash[22676]: cluster 2024-09-21T01:11:05.858702+0000 mgr.a (mgr.14388) 7642 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:07 smithi179 bash[23186]: cluster 2024-09-21T01:11:05.858702+0000 mgr.a (mgr.14388) 7642 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:07 smithi049 bash[23528]: cluster 2024-09-21T01:11:05.858702+0000 mgr.a (mgr.14388) 7642 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:08.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:08.408 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:08.408 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:09.201 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:09.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:09.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:09 smithi044 bash[22676]: cluster 2024-09-21T01:11:07.859489+0000 mgr.a (mgr.14388) 7643 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:09 smithi179 bash[23186]: cluster 2024-09-21T01:11:07.859489+0000 mgr.a (mgr.14388) 7643 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:09 smithi049 bash[23528]: cluster 2024-09-21T01:11:07.859489+0000 mgr.a (mgr.14388) 7643 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:10 smithi044 bash[22676]: audit 2024-09-21T01:11:08.745927+0000 mgr.a (mgr.14388) 7644 : audit [DBG] from='client.172461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:10 smithi179 bash[23186]: audit 2024-09-21T01:11:08.745927+0000 mgr.a (mgr.14388) 7644 : audit [DBG] from='client.172461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:10 smithi049 bash[23528]: audit 2024-09-21T01:11:08.745927+0000 mgr.a (mgr.14388) 7644 : audit [DBG] from='client.172461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:11 smithi044 bash[22676]: cluster 2024-09-21T01:11:09.860464+0000 mgr.a (mgr.14388) 7645 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:11 smithi179 bash[23186]: cluster 2024-09-21T01:11:09.860464+0000 mgr.a (mgr.14388) 7645 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:11 smithi049 bash[23528]: cluster 2024-09-21T01:11:09.860464+0000 mgr.a (mgr.14388) 7645 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:13 smithi044 bash[22676]: cluster 2024-09-21T01:11:11.862797+0000 mgr.a (mgr.14388) 7646 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:13 smithi179 bash[23186]: cluster 2024-09-21T01:11:11.862797+0000 mgr.a (mgr.14388) 7646 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:13 smithi049 bash[23528]: cluster 2024-09-21T01:11:11.862797+0000 mgr.a (mgr.14388) 7646 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:14.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:14 smithi179 bash[23186]: cluster 2024-09-21T01:11:13.863596+0000 mgr.a (mgr.14388) 7647 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:14 smithi049 bash[23528]: cluster 2024-09-21T01:11:13.863596+0000 mgr.a (mgr.14388) 7647 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:14 smithi044 bash[22676]: cluster 2024-09-21T01:11:13.863596+0000 mgr.a (mgr.14388) 7647 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:14.971 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:14.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:15 smithi179 bash[23186]: audit 2024-09-21T01:11:14.541608+0000 mgr.a (mgr.14388) 7648 : audit [DBG] from='client.172539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:15 smithi049 bash[23528]: audit 2024-09-21T01:11:14.541608+0000 mgr.a (mgr.14388) 7648 : audit [DBG] from='client.172539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:15 smithi044 bash[22676]: audit 2024-09-21T01:11:14.541608+0000 mgr.a (mgr.14388) 7648 : audit [DBG] from='client.172539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:16 smithi049 bash[23528]: cluster 2024-09-21T01:11:15.866155+0000 mgr.a (mgr.14388) 7649 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:16 smithi044 bash[22676]: cluster 2024-09-21T01:11:15.866155+0000 mgr.a (mgr.14388) 7649 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:16 smithi179 bash[23186]: cluster 2024-09-21T01:11:15.866155+0000 mgr.a (mgr.14388) 7649 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:18 smithi179 bash[23186]: cluster 2024-09-21T01:11:17.867009+0000 mgr.a (mgr.14388) 7650 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:18 smithi044 bash[22676]: cluster 2024-09-21T01:11:17.867009+0000 mgr.a (mgr.14388) 7650 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:18 smithi049 bash[23528]: cluster 2024-09-21T01:11:17.867009+0000 mgr.a (mgr.14388) 7650 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:20.760 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:20.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:21.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:20 smithi044 bash[22676]: cluster 2024-09-21T01:11:19.867806+0000 mgr.a (mgr.14388) 7651 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:20 smithi179 bash[23186]: cluster 2024-09-21T01:11:19.867806+0000 mgr.a (mgr.14388) 7651 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:20 smithi049 bash[23528]: cluster 2024-09-21T01:11:19.867806+0000 mgr.a (mgr.14388) 7651 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:21 smithi044 bash[22676]: audit 2024-09-21T01:11:20.317104+0000 mgr.a (mgr.14388) 7652 : audit [DBG] from='client.172617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:21 smithi044 bash[22676]: audit 2024-09-21T01:11:21.361453+0000 mon.a (mon.0) 6557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:21 smithi044 bash[22676]: audit 2024-09-21T01:11:21.366689+0000 mon.a (mon.0) 6558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:21 smithi044 bash[22676]: audit 2024-09-21T01:11:21.371889+0000 mon.a (mon.0) 6559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:21 smithi179 bash[23186]: audit 2024-09-21T01:11:20.317104+0000 mgr.a (mgr.14388) 7652 : audit [DBG] from='client.172617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:21 smithi179 bash[23186]: audit 2024-09-21T01:11:21.361453+0000 mon.a (mon.0) 6557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:21 smithi179 bash[23186]: audit 2024-09-21T01:11:21.366689+0000 mon.a (mon.0) 6558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:21 smithi179 bash[23186]: audit 2024-09-21T01:11:21.371889+0000 mon.a (mon.0) 6559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:21 smithi049 bash[23528]: audit 2024-09-21T01:11:20.317104+0000 mgr.a (mgr.14388) 7652 : audit [DBG] from='client.172617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:21 smithi049 bash[23528]: audit 2024-09-21T01:11:21.361453+0000 mon.a (mon.0) 6557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:21 smithi049 bash[23528]: audit 2024-09-21T01:11:21.366689+0000 mon.a (mon.0) 6558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:21 smithi049 bash[23528]: audit 2024-09-21T01:11:21.371889+0000 mon.a (mon.0) 6559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:23 smithi044 bash[22676]: cluster 2024-09-21T01:11:21.870705+0000 mgr.a (mgr.14388) 7653 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:23 smithi044 bash[22676]: audit 2024-09-21T01:11:22.136963+0000 mon.a (mon.0) 6560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:23 smithi044 bash[22676]: audit 2024-09-21T01:11:22.142043+0000 mon.a (mon.0) 6561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:23 smithi044 bash[22676]: audit 2024-09-21T01:11:22.148932+0000 mon.a (mon.0) 6562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:23 smithi179 bash[23186]: cluster 2024-09-21T01:11:21.870705+0000 mgr.a (mgr.14388) 7653 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:23 smithi179 bash[23186]: audit 2024-09-21T01:11:22.136963+0000 mon.a (mon.0) 6560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:23 smithi179 bash[23186]: audit 2024-09-21T01:11:22.142043+0000 mon.a (mon.0) 6561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:23 smithi179 bash[23186]: audit 2024-09-21T01:11:22.148932+0000 mon.a (mon.0) 6562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:23 smithi049 bash[23528]: cluster 2024-09-21T01:11:21.870705+0000 mgr.a (mgr.14388) 7653 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:23 smithi049 bash[23528]: audit 2024-09-21T01:11:22.136963+0000 mon.a (mon.0) 6560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:23 smithi049 bash[23528]: audit 2024-09-21T01:11:22.142043+0000 mon.a (mon.0) 6561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:23 smithi049 bash[23528]: audit 2024-09-21T01:11:22.148932+0000 mon.a (mon.0) 6562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:25 smithi049 bash[23528]: cluster 2024-09-21T01:11:23.871228+0000 mgr.a (mgr.14388) 7654 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:11:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:25 smithi049 bash[23528]: audit 2024-09-21T01:11:24.940264+0000 mon.a (mon.0) 6563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:25 smithi049 bash[23528]: audit 2024-09-21T01:11:24.948919+0000 mon.a (mon.0) 6564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:25 smithi049 bash[23528]: audit 2024-09-21T01:11:24.959020+0000 mon.a (mon.0) 6565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:25 smithi044 bash[22676]: cluster 2024-09-21T01:11:23.871228+0000 mgr.a (mgr.14388) 7654 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:11:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:25 smithi044 bash[22676]: audit 2024-09-21T01:11:24.940264+0000 mon.a (mon.0) 6563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:25 smithi044 bash[22676]: audit 2024-09-21T01:11:24.948919+0000 mon.a (mon.0) 6564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:25 smithi044 bash[22676]: audit 2024-09-21T01:11:24.959020+0000 mon.a (mon.0) 6565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:25 smithi179 bash[23186]: cluster 2024-09-21T01:11:23.871228+0000 mgr.a (mgr.14388) 7654 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:11:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:25 smithi179 bash[23186]: audit 2024-09-21T01:11:24.940264+0000 mon.a (mon.0) 6563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:25 smithi179 bash[23186]: audit 2024-09-21T01:11:24.948919+0000 mon.a (mon.0) 6564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:25 smithi179 bash[23186]: audit 2024-09-21T01:11:24.959020+0000 mon.a (mon.0) 6565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:25.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:25.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:26.534 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:27 smithi044 bash[22676]: cluster 2024-09-21T01:11:25.872135+0000 mgr.a (mgr.14388) 7655 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:27 smithi044 bash[22676]: audit 2024-09-21T01:11:26.101975+0000 mgr.a (mgr.14388) 7656 : audit [DBG] from='client.172695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:27 smithi179 bash[23186]: cluster 2024-09-21T01:11:25.872135+0000 mgr.a (mgr.14388) 7655 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:27 smithi179 bash[23186]: audit 2024-09-21T01:11:26.101975+0000 mgr.a (mgr.14388) 7656 : audit [DBG] from='client.172695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:27 smithi049 bash[23528]: cluster 2024-09-21T01:11:25.872135+0000 mgr.a (mgr.14388) 7655 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:27 smithi049 bash[23528]: audit 2024-09-21T01:11:26.101975+0000 mgr.a (mgr.14388) 7656 : audit [DBG] from='client.172695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:29 smithi044 bash[22676]: cluster 2024-09-21T01:11:27.873045+0000 mgr.a (mgr.14388) 7657 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:11:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:29 smithi179 bash[23186]: cluster 2024-09-21T01:11:27.873045+0000 mgr.a (mgr.14388) 7657 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:11:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:29 smithi049 bash[23528]: cluster 2024-09-21T01:11:27.873045+0000 mgr.a (mgr.14388) 7657 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:11:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:31 smithi044 bash[22676]: cluster 2024-09-21T01:11:29.873850+0000 mgr.a (mgr.14388) 7658 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:11:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:31 smithi179 bash[23186]: cluster 2024-09-21T01:11:29.873850+0000 mgr.a (mgr.14388) 7658 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:11:31.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:31 smithi049 bash[23528]: cluster 2024-09-21T01:11:29.873850+0000 mgr.a (mgr.14388) 7658 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:11:32.299 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:32.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:32.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:32.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:32.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:33 smithi044 bash[22676]: audit 2024-09-21T01:11:31.868269+0000 mgr.a (mgr.14388) 7659 : audit [DBG] from='client.172773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:33 smithi044 bash[22676]: cluster 2024-09-21T01:11:31.889114+0000 mgr.a (mgr.14388) 7660 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:33 smithi179 bash[23186]: audit 2024-09-21T01:11:31.868269+0000 mgr.a (mgr.14388) 7659 : audit [DBG] from='client.172773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:33 smithi179 bash[23186]: cluster 2024-09-21T01:11:31.889114+0000 mgr.a (mgr.14388) 7660 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:33 smithi049 bash[23528]: audit 2024-09-21T01:11:31.868269+0000 mgr.a (mgr.14388) 7659 : audit [DBG] from='client.172773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:33 smithi049 bash[23528]: cluster 2024-09-21T01:11:31.889114+0000 mgr.a (mgr.14388) 7660 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:35 smithi044 bash[22676]: cluster 2024-09-21T01:11:33.890146+0000 mgr.a (mgr.14388) 7661 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:35 smithi179 bash[23186]: cluster 2024-09-21T01:11:33.890146+0000 mgr.a (mgr.14388) 7661 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:35 smithi049 bash[23528]: cluster 2024-09-21T01:11:33.890146+0000 mgr.a (mgr.14388) 7661 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:37.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:37.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:37.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:37 smithi044 bash[22676]: cluster 2024-09-21T01:11:35.892357+0000 mgr.a (mgr.14388) 7662 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:37 smithi179 bash[23186]: cluster 2024-09-21T01:11:35.892357+0000 mgr.a (mgr.14388) 7662 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:37 smithi049 bash[23528]: cluster 2024-09-21T01:11:35.892357+0000 mgr.a (mgr.14388) 7662 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:38.063 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:39 smithi179 bash[23186]: audit 2024-09-21T01:11:37.632395+0000 mgr.a (mgr.14388) 7663 : audit [DBG] from='client.172851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:39 smithi179 bash[23186]: cluster 2024-09-21T01:11:37.892899+0000 mgr.a (mgr.14388) 7664 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:39 smithi044 bash[22676]: audit 2024-09-21T01:11:37.632395+0000 mgr.a (mgr.14388) 7663 : audit [DBG] from='client.172851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:39 smithi044 bash[22676]: cluster 2024-09-21T01:11:37.892899+0000 mgr.a (mgr.14388) 7664 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:39 smithi049 bash[23528]: audit 2024-09-21T01:11:37.632395+0000 mgr.a (mgr.14388) 7663 : audit [DBG] from='client.172851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:39 smithi049 bash[23528]: cluster 2024-09-21T01:11:37.892899+0000 mgr.a (mgr.14388) 7664 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:41.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:41 smithi044 bash[22676]: cluster 2024-09-21T01:11:39.893911+0000 mgr.a (mgr.14388) 7665 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:41 smithi179 bash[23186]: cluster 2024-09-21T01:11:39.893911+0000 mgr.a (mgr.14388) 7665 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:41 smithi049 bash[23528]: cluster 2024-09-21T01:11:39.893911+0000 mgr.a (mgr.14388) 7665 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:42 smithi044 bash[22676]: audit 2024-09-21T01:11:41.497950+0000 mon.a (mon.0) 6566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:42 smithi044 bash[22676]: audit 2024-09-21T01:11:41.502431+0000 mon.a (mon.0) 6567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:42 smithi044 bash[22676]: audit 2024-09-21T01:11:41.507918+0000 mon.a (mon.0) 6568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:42 smithi044 bash[22676]: cluster 2024-09-21T01:11:41.896336+0000 mgr.a (mgr.14388) 7666 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:42 smithi044 bash[22676]: audit 2024-09-21T01:11:42.333460+0000 mon.a (mon.0) 6569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:42 smithi044 bash[22676]: audit 2024-09-21T01:11:42.339841+0000 mon.a (mon.0) 6570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:42 smithi044 bash[22676]: audit 2024-09-21T01:11:42.345977+0000 mon.a (mon.0) 6571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:42 smithi179 bash[23186]: audit 2024-09-21T01:11:41.497950+0000 mon.a (mon.0) 6566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:42 smithi179 bash[23186]: audit 2024-09-21T01:11:41.502431+0000 mon.a (mon.0) 6567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:42 smithi179 bash[23186]: audit 2024-09-21T01:11:41.507918+0000 mon.a (mon.0) 6568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:42 smithi179 bash[23186]: cluster 2024-09-21T01:11:41.896336+0000 mgr.a (mgr.14388) 7666 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:42 smithi179 bash[23186]: audit 2024-09-21T01:11:42.333460+0000 mon.a (mon.0) 6569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:42 smithi179 bash[23186]: audit 2024-09-21T01:11:42.339841+0000 mon.a (mon.0) 6570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:42 smithi179 bash[23186]: audit 2024-09-21T01:11:42.345977+0000 mon.a (mon.0) 6571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:42 smithi049 bash[23528]: audit 2024-09-21T01:11:41.497950+0000 mon.a (mon.0) 6566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:42 smithi049 bash[23528]: audit 2024-09-21T01:11:41.502431+0000 mon.a (mon.0) 6567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:42 smithi049 bash[23528]: audit 2024-09-21T01:11:41.507918+0000 mon.a (mon.0) 6568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:42 smithi049 bash[23528]: cluster 2024-09-21T01:11:41.896336+0000 mgr.a (mgr.14388) 7666 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:11:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:42 smithi049 bash[23528]: audit 2024-09-21T01:11:42.333460+0000 mon.a (mon.0) 6569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:42 smithi049 bash[23528]: audit 2024-09-21T01:11:42.339841+0000 mon.a (mon.0) 6570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:42 smithi049 bash[23528]: audit 2024-09-21T01:11:42.345977+0000 mon.a (mon.0) 6571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22676]: audit 2024-09-21T01:11:43.184188+0000 mon.a (mon.0) 6572 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:11:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22676]: audit 2024-09-21T01:11:43.186804+0000 mon.a (mon.0) 6573 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:11:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22676]: audit 2024-09-21T01:11:43.187596+0000 mon.a (mon.0) 6574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:11:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22676]: audit 2024-09-21T01:11:43.193367+0000 mon.a (mon.0) 6575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22676]: audit 2024-09-21T01:11:43.196771+0000 mon.a (mon.0) 6576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:11:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22676]: audit 2024-09-21T01:11:43.199073+0000 mgr.a (mgr.14388) 7667 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:11:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:43 smithi049 bash[23528]: audit 2024-09-21T01:11:43.184188+0000 mon.a (mon.0) 6572 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:11:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:43 smithi049 bash[23528]: audit 2024-09-21T01:11:43.186804+0000 mon.a (mon.0) 6573 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:11:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:43 smithi049 bash[23528]: audit 2024-09-21T01:11:43.187596+0000 mon.a (mon.0) 6574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:11:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:43 smithi049 bash[23528]: audit 2024-09-21T01:11:43.193367+0000 mon.a (mon.0) 6575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:43 smithi049 bash[23528]: audit 2024-09-21T01:11:43.196771+0000 mon.a (mon.0) 6576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:11:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:43 smithi049 bash[23528]: audit 2024-09-21T01:11:43.199073+0000 mgr.a (mgr.14388) 7667 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:11:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:43 smithi179 bash[23186]: audit 2024-09-21T01:11:43.184188+0000 mon.a (mon.0) 6572 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:11:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:43 smithi179 bash[23186]: audit 2024-09-21T01:11:43.186804+0000 mon.a (mon.0) 6573 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:11:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:43 smithi179 bash[23186]: audit 2024-09-21T01:11:43.187596+0000 mon.a (mon.0) 6574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:11:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:43 smithi179 bash[23186]: audit 2024-09-21T01:11:43.193367+0000 mon.a (mon.0) 6575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:43 smithi179 bash[23186]: audit 2024-09-21T01:11:43.196771+0000 mon.a (mon.0) 6576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:11:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:43 smithi179 bash[23186]: audit 2024-09-21T01:11:43.199073+0000 mgr.a (mgr.14388) 7667 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:11:44.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22930]: debug 2024-09-21T01:11:43.967+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:11:44.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:11:43 smithi044 bash[22930]: debug 2024-09-21T01:11:43.979+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:11:44.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:44 smithi044 bash[22676]: audit 2024-09-21T01:11:43.429546+0000 mgr.a (mgr.14388) 7668 : audit [DBG] from='client.172929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:44 smithi044 bash[22676]: cluster 2024-09-21T01:11:43.897049+0000 mgr.a (mgr.14388) 7669 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:44 smithi044 bash[22676]: audit 2024-09-21T01:11:43.969842+0000 mgr.a (mgr.14388) 7670 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:11:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:44 smithi044 bash[22676]: cephadm 2024-09-21T01:11:43.981304+0000 mgr.a (mgr.14388) 7671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:11:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:44 smithi049 bash[23528]: audit 2024-09-21T01:11:43.429546+0000 mgr.a (mgr.14388) 7668 : audit [DBG] from='client.172929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:44 smithi049 bash[23528]: cluster 2024-09-21T01:11:43.897049+0000 mgr.a (mgr.14388) 7669 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:44 smithi049 bash[23528]: audit 2024-09-21T01:11:43.969842+0000 mgr.a (mgr.14388) 7670 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:11:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:44 smithi049 bash[23528]: cephadm 2024-09-21T01:11:43.981304+0000 mgr.a (mgr.14388) 7671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:11:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:44 smithi179 bash[23186]: audit 2024-09-21T01:11:43.429546+0000 mgr.a (mgr.14388) 7668 : audit [DBG] from='client.172929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:44 smithi179 bash[23186]: cluster 2024-09-21T01:11:43.897049+0000 mgr.a (mgr.14388) 7669 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:11:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:44 smithi179 bash[23186]: audit 2024-09-21T01:11:43.969842+0000 mgr.a (mgr.14388) 7670 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:11:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:44 smithi179 bash[23186]: cephadm 2024-09-21T01:11:43.981304+0000 mgr.a (mgr.14388) 7671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:11:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:46 smithi044 bash[22676]: audit 2024-09-21T01:11:45.174795+0000 mon.a (mon.0) 6577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:46 smithi044 bash[22676]: audit 2024-09-21T01:11:45.183575+0000 mon.a (mon.0) 6578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:46 smithi044 bash[22676]: audit 2024-09-21T01:11:45.195404+0000 mon.a (mon.0) 6579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:46 smithi179 bash[23186]: audit 2024-09-21T01:11:45.174795+0000 mon.a (mon.0) 6577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:46 smithi179 bash[23186]: audit 2024-09-21T01:11:45.183575+0000 mon.a (mon.0) 6578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:46 smithi179 bash[23186]: audit 2024-09-21T01:11:45.195404+0000 mon.a (mon.0) 6579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:46 smithi049 bash[23528]: audit 2024-09-21T01:11:45.174795+0000 mon.a (mon.0) 6577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:46 smithi049 bash[23528]: audit 2024-09-21T01:11:45.183575+0000 mon.a (mon.0) 6578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:46 smithi049 bash[23528]: audit 2024-09-21T01:11:45.195404+0000 mon.a (mon.0) 6579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:11:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:47 smithi044 bash[22676]: cluster 2024-09-21T01:11:45.899503+0000 mgr.a (mgr.14388) 7672 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:47 smithi179 bash[23186]: cluster 2024-09-21T01:11:45.899503+0000 mgr.a (mgr.14388) 7672 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:47 smithi049 bash[23528]: cluster 2024-09-21T01:11:45.899503+0000 mgr.a (mgr.14388) 7672 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:48 smithi049 bash[23528]: cluster 2024-09-21T01:11:47.900443+0000 mgr.a (mgr.14388) 7673 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:48 smithi044 bash[22676]: cluster 2024-09-21T01:11:47.900443+0000 mgr.a (mgr.14388) 7673 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:48 smithi179 bash[23186]: cluster 2024-09-21T01:11:47.900443+0000 mgr.a (mgr.14388) 7673 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:49.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:49.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:49.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:50.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:50.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:50.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:50.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:50.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:50 smithi044 bash[22676]: audit 2024-09-21T01:11:49.716357+0000 mgr.a (mgr.14388) 7674 : audit [DBG] from='client.173115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:50 smithi044 bash[22676]: cluster 2024-09-21T01:11:49.901046+0000 mgr.a (mgr.14388) 7675 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:50 smithi179 bash[23186]: audit 2024-09-21T01:11:49.716357+0000 mgr.a (mgr.14388) 7674 : audit [DBG] from='client.173115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:50 smithi179 bash[23186]: cluster 2024-09-21T01:11:49.901046+0000 mgr.a (mgr.14388) 7675 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:50 smithi049 bash[23528]: audit 2024-09-21T01:11:49.716357+0000 mgr.a (mgr.14388) 7674 : audit [DBG] from='client.173115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:50 smithi049 bash[23528]: cluster 2024-09-21T01:11:49.901046+0000 mgr.a (mgr.14388) 7675 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:52 smithi044 bash[22676]: cluster 2024-09-21T01:11:51.903736+0000 mgr.a (mgr.14388) 7676 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:52 smithi179 bash[23186]: cluster 2024-09-21T01:11:51.903736+0000 mgr.a (mgr.14388) 7676 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:52 smithi049 bash[23528]: cluster 2024-09-21T01:11:51.903736+0000 mgr.a (mgr.14388) 7676 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:55.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:11:55.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:11:55.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:11:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:54 smithi044 bash[22676]: cluster 2024-09-21T01:11:53.904519+0000 mgr.a (mgr.14388) 7677 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:11:55.241 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:54 smithi049 bash[23528]: cluster 2024-09-21T01:11:53.904519+0000 mgr.a (mgr.14388) 7677 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:11:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:54 smithi179 bash[23186]: cluster 2024-09-21T01:11:53.904519+0000 mgr.a (mgr.14388) 7677 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:11:55.966 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:11:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:11:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:11:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:11:55.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:11:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:56 smithi044 bash[22676]: audit 2024-09-21T01:11:55.512604+0000 mgr.a (mgr.14388) 7678 : audit [DBG] from='client.173193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:56 smithi044 bash[22676]: cluster 2024-09-21T01:11:55.906472+0000 mgr.a (mgr.14388) 7679 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:56 smithi179 bash[23186]: audit 2024-09-21T01:11:55.512604+0000 mgr.a (mgr.14388) 7678 : audit [DBG] from='client.173193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:56 smithi179 bash[23186]: cluster 2024-09-21T01:11:55.906472+0000 mgr.a (mgr.14388) 7679 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:56 smithi049 bash[23528]: audit 2024-09-21T01:11:55.512604+0000 mgr.a (mgr.14388) 7678 : audit [DBG] from='client.173193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:56 smithi049 bash[23528]: cluster 2024-09-21T01:11:55.906472+0000 mgr.a (mgr.14388) 7679 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:11:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:11:58 smithi044 bash[22676]: cluster 2024-09-21T01:11:57.907233+0000 mgr.a (mgr.14388) 7680 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:11:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:11:58 smithi179 bash[23186]: cluster 2024-09-21T01:11:57.907233+0000 mgr.a (mgr.14388) 7680 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:11:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:11:58 smithi049 bash[23528]: cluster 2024-09-21T01:11:57.907233+0000 mgr.a (mgr.14388) 7680 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:12:00.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:00 smithi044 bash[22676]: cluster 2024-09-21T01:11:59.908002+0000 mgr.a (mgr.14388) 7681 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:00 smithi179 bash[23186]: cluster 2024-09-21T01:11:59.908002+0000 mgr.a (mgr.14388) 7681 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:01.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:00 smithi049 bash[23528]: cluster 2024-09-21T01:11:59.908002+0000 mgr.a (mgr.14388) 7681 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:01.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:01.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:01.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:01.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:01.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: audit 2024-09-21T01:12:01.313755+0000 mgr.a (mgr.14388) 7682 : audit [DBG] from='client.173268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: audit 2024-09-21T01:12:01.671541+0000 mon.a (mon.0) 6580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: audit 2024-09-21T01:12:01.677052+0000 mon.a (mon.0) 6581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: audit 2024-09-21T01:12:01.682257+0000 mon.a (mon.0) 6582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: cluster 2024-09-21T01:12:01.909557+0000 mgr.a (mgr.14388) 7683 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: audit 2024-09-21T01:12:02.556071+0000 mon.a (mon.0) 6583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: audit 2024-09-21T01:12:02.564756+0000 mon.a (mon.0) 6584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:02 smithi179 bash[23186]: audit 2024-09-21T01:12:02.573571+0000 mon.a (mon.0) 6585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: audit 2024-09-21T01:12:01.313755+0000 mgr.a (mgr.14388) 7682 : audit [DBG] from='client.173268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: audit 2024-09-21T01:12:01.671541+0000 mon.a (mon.0) 6580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: audit 2024-09-21T01:12:01.677052+0000 mon.a (mon.0) 6581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: audit 2024-09-21T01:12:01.682257+0000 mon.a (mon.0) 6582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: cluster 2024-09-21T01:12:01.909557+0000 mgr.a (mgr.14388) 7683 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: audit 2024-09-21T01:12:02.556071+0000 mon.a (mon.0) 6583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: audit 2024-09-21T01:12:02.564756+0000 mon.a (mon.0) 6584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:02 smithi044 bash[22676]: audit 2024-09-21T01:12:02.573571+0000 mon.a (mon.0) 6585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: audit 2024-09-21T01:12:01.313755+0000 mgr.a (mgr.14388) 7682 : audit [DBG] from='client.173268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: audit 2024-09-21T01:12:01.671541+0000 mon.a (mon.0) 6580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: audit 2024-09-21T01:12:01.677052+0000 mon.a (mon.0) 6581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: audit 2024-09-21T01:12:01.682257+0000 mon.a (mon.0) 6582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: cluster 2024-09-21T01:12:01.909557+0000 mgr.a (mgr.14388) 7683 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: audit 2024-09-21T01:12:02.556071+0000 mon.a (mon.0) 6583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: audit 2024-09-21T01:12:02.564756+0000 mon.a (mon.0) 6584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:02 smithi049 bash[23528]: audit 2024-09-21T01:12:02.573571+0000 mon.a (mon.0) 6585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:04 smithi044 bash[22676]: cluster 2024-09-21T01:12:03.910241+0000 mgr.a (mgr.14388) 7684 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:12:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:04 smithi179 bash[23186]: cluster 2024-09-21T01:12:03.910241+0000 mgr.a (mgr.14388) 7684 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:12:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:04 smithi049 bash[23528]: cluster 2024-09-21T01:12:03.910241+0000 mgr.a (mgr.14388) 7684 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:12:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:06 smithi044 bash[22676]: audit 2024-09-21T01:12:05.411089+0000 mon.a (mon.0) 6586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:06 smithi044 bash[22676]: audit 2024-09-21T01:12:05.421243+0000 mon.a (mon.0) 6587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:06 smithi044 bash[22676]: audit 2024-09-21T01:12:05.432738+0000 mon.a (mon.0) 6588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:06 smithi044 bash[22676]: cluster 2024-09-21T01:12:05.912246+0000 mgr.a (mgr.14388) 7685 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:12:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:06 smithi179 bash[23186]: audit 2024-09-21T01:12:05.411089+0000 mon.a (mon.0) 6586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:06 smithi179 bash[23186]: audit 2024-09-21T01:12:05.421243+0000 mon.a (mon.0) 6587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:06 smithi179 bash[23186]: audit 2024-09-21T01:12:05.432738+0000 mon.a (mon.0) 6588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:06 smithi179 bash[23186]: cluster 2024-09-21T01:12:05.912246+0000 mgr.a (mgr.14388) 7685 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:12:06.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:06.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:06 smithi049 bash[23528]: audit 2024-09-21T01:12:05.411089+0000 mon.a (mon.0) 6586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:06 smithi049 bash[23528]: audit 2024-09-21T01:12:05.421243+0000 mon.a (mon.0) 6587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:06 smithi049 bash[23528]: audit 2024-09-21T01:12:05.432738+0000 mon.a (mon.0) 6588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:06 smithi049 bash[23528]: cluster 2024-09-21T01:12:05.912246+0000 mgr.a (mgr.14388) 7685 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:12:07.560 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:07.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:07.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:07.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:07.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:07 smithi044 bash[22676]: audit 2024-09-21T01:12:07.105800+0000 mgr.a (mgr.14388) 7686 : audit [DBG] from='client.173346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:07 smithi179 bash[23186]: audit 2024-09-21T01:12:07.105800+0000 mgr.a (mgr.14388) 7686 : audit [DBG] from='client.173346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:07 smithi049 bash[23528]: audit 2024-09-21T01:12:07.105800+0000 mgr.a (mgr.14388) 7686 : audit [DBG] from='client.173346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:08 smithi044 bash[22676]: cluster 2024-09-21T01:12:07.913305+0000 mgr.a (mgr.14388) 7687 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:08 smithi179 bash[23186]: cluster 2024-09-21T01:12:07.913305+0000 mgr.a (mgr.14388) 7687 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:08 smithi049 bash[23528]: cluster 2024-09-21T01:12:07.913305+0000 mgr.a (mgr.14388) 7687 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:10 smithi044 bash[22676]: cluster 2024-09-21T01:12:09.914209+0000 mgr.a (mgr.14388) 7688 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:10 smithi179 bash[23186]: cluster 2024-09-21T01:12:09.914209+0000 mgr.a (mgr.14388) 7688 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:11.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:10 smithi049 bash[23528]: cluster 2024-09-21T01:12:09.914209+0000 mgr.a (mgr.14388) 7688 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:12 smithi044 bash[22676]: cluster 2024-09-21T01:12:11.916614+0000 mgr.a (mgr.14388) 7689 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:12 smithi179 bash[23186]: cluster 2024-09-21T01:12:11.916614+0000 mgr.a (mgr.14388) 7689 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:13.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:12 smithi049 bash[23528]: cluster 2024-09-21T01:12:11.916614+0000 mgr.a (mgr.14388) 7689 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:13.348 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:13 smithi049 bash[23528]: audit 2024-09-21T01:12:12.898656+0000 mgr.a (mgr.14388) 7690 : audit [DBG] from='client.173424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:13 smithi044 bash[22676]: audit 2024-09-21T01:12:12.898656+0000 mgr.a (mgr.14388) 7690 : audit [DBG] from='client.173424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:13 smithi179 bash[23186]: audit 2024-09-21T01:12:12.898656+0000 mgr.a (mgr.14388) 7690 : audit [DBG] from='client.173424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:14 smithi049 bash[23528]: cluster 2024-09-21T01:12:13.917675+0000 mgr.a (mgr.14388) 7691 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:14 smithi044 bash[22676]: cluster 2024-09-21T01:12:13.917675+0000 mgr.a (mgr.14388) 7691 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:14 smithi179 bash[23186]: cluster 2024-09-21T01:12:13.917675+0000 mgr.a (mgr.14388) 7691 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:16 smithi179 bash[23186]: cluster 2024-09-21T01:12:15.919880+0000 mgr.a (mgr.14388) 7692 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:16 smithi049 bash[23528]: cluster 2024-09-21T01:12:15.919880+0000 mgr.a (mgr.14388) 7692 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:16 smithi044 bash[22676]: cluster 2024-09-21T01:12:15.919880+0000 mgr.a (mgr.14388) 7692 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:18.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:19.143 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:18 smithi179 bash[23186]: cluster 2024-09-21T01:12:17.920657+0000 mgr.a (mgr.14388) 7693 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:18 smithi049 bash[23528]: cluster 2024-09-21T01:12:17.920657+0000 mgr.a (mgr.14388) 7693 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:18 smithi044 bash[22676]: cluster 2024-09-21T01:12:17.920657+0000 mgr.a (mgr.14388) 7693 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:19 smithi179 bash[23186]: audit 2024-09-21T01:12:18.687774+0000 mgr.a (mgr.14388) 7694 : audit [DBG] from='client.173502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:19 smithi049 bash[23528]: audit 2024-09-21T01:12:18.687774+0000 mgr.a (mgr.14388) 7694 : audit [DBG] from='client.173502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:19 smithi044 bash[22676]: audit 2024-09-21T01:12:18.687774+0000 mgr.a (mgr.14388) 7694 : audit [DBG] from='client.173502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:21.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:21 smithi049 bash[23528]: cluster 2024-09-21T01:12:19.921639+0000 mgr.a (mgr.14388) 7695 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:21 smithi044 bash[22676]: cluster 2024-09-21T01:12:19.921639+0000 mgr.a (mgr.14388) 7695 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:21 smithi179 bash[23186]: cluster 2024-09-21T01:12:19.921639+0000 mgr.a (mgr.14388) 7695 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:22 smithi179 bash[23186]: audit 2024-09-21T01:12:21.896106+0000 mon.a (mon.0) 6589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:22 smithi179 bash[23186]: audit 2024-09-21T01:12:21.904509+0000 mon.a (mon.0) 6590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:22 smithi179 bash[23186]: audit 2024-09-21T01:12:21.916305+0000 mon.a (mon.0) 6591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:22 smithi179 bash[23186]: cluster 2024-09-21T01:12:21.922779+0000 mgr.a (mgr.14388) 7696 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:22 smithi179 bash[23186]: audit 2024-09-21T01:12:22.731842+0000 mon.a (mon.0) 6592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:22 smithi179 bash[23186]: audit 2024-09-21T01:12:22.739574+0000 mon.a (mon.0) 6593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:22 smithi179 bash[23186]: audit 2024-09-21T01:12:22.748786+0000 mon.a (mon.0) 6594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:22 smithi044 bash[22676]: audit 2024-09-21T01:12:21.896106+0000 mon.a (mon.0) 6589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:22 smithi044 bash[22676]: audit 2024-09-21T01:12:21.904509+0000 mon.a (mon.0) 6590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:22 smithi044 bash[22676]: audit 2024-09-21T01:12:21.916305+0000 mon.a (mon.0) 6591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:22 smithi044 bash[22676]: cluster 2024-09-21T01:12:21.922779+0000 mgr.a (mgr.14388) 7696 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:22 smithi044 bash[22676]: audit 2024-09-21T01:12:22.731842+0000 mon.a (mon.0) 6592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:22 smithi044 bash[22676]: audit 2024-09-21T01:12:22.739574+0000 mon.a (mon.0) 6593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:22 smithi044 bash[22676]: audit 2024-09-21T01:12:22.748786+0000 mon.a (mon.0) 6594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:22 smithi049 bash[23528]: audit 2024-09-21T01:12:21.896106+0000 mon.a (mon.0) 6589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:22 smithi049 bash[23528]: audit 2024-09-21T01:12:21.904509+0000 mon.a (mon.0) 6590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:22 smithi049 bash[23528]: audit 2024-09-21T01:12:21.916305+0000 mon.a (mon.0) 6591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:22 smithi049 bash[23528]: cluster 2024-09-21T01:12:21.922779+0000 mgr.a (mgr.14388) 7696 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:23.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:22 smithi049 bash[23528]: audit 2024-09-21T01:12:22.731842+0000 mon.a (mon.0) 6592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:22 smithi049 bash[23528]: audit 2024-09-21T01:12:22.739574+0000 mon.a (mon.0) 6593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:22 smithi049 bash[23528]: audit 2024-09-21T01:12:22.748786+0000 mon.a (mon.0) 6594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:24.885 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:24 smithi044 bash[22676]: cluster 2024-09-21T01:12:23.923230+0000 mgr.a (mgr.14388) 7697 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:24 smithi179 bash[23186]: cluster 2024-09-21T01:12:23.923230+0000 mgr.a (mgr.14388) 7697 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:25.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:24 smithi049 bash[23528]: cluster 2024-09-21T01:12:23.923230+0000 mgr.a (mgr.14388) 7697 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:25 smithi044 bash[22676]: audit 2024-09-21T01:12:24.476278+0000 mgr.a (mgr.14388) 7698 : audit [DBG] from='client.173580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:25 smithi044 bash[22676]: audit 2024-09-21T01:12:25.646197+0000 mon.a (mon.0) 6595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:25 smithi044 bash[22676]: audit 2024-09-21T01:12:25.654758+0000 mon.a (mon.0) 6596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:25 smithi044 bash[22676]: audit 2024-09-21T01:12:25.665110+0000 mon.a (mon.0) 6597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:25 smithi179 bash[23186]: audit 2024-09-21T01:12:24.476278+0000 mgr.a (mgr.14388) 7698 : audit [DBG] from='client.173580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:25 smithi179 bash[23186]: audit 2024-09-21T01:12:25.646197+0000 mon.a (mon.0) 6595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:25 smithi179 bash[23186]: audit 2024-09-21T01:12:25.654758+0000 mon.a (mon.0) 6596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:25 smithi179 bash[23186]: audit 2024-09-21T01:12:25.665110+0000 mon.a (mon.0) 6597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:25 smithi049 bash[23528]: audit 2024-09-21T01:12:24.476278+0000 mgr.a (mgr.14388) 7698 : audit [DBG] from='client.173580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:25 smithi049 bash[23528]: audit 2024-09-21T01:12:25.646197+0000 mon.a (mon.0) 6595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:25 smithi049 bash[23528]: audit 2024-09-21T01:12:25.654758+0000 mon.a (mon.0) 6596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:25 smithi049 bash[23528]: audit 2024-09-21T01:12:25.665110+0000 mon.a (mon.0) 6597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:26 smithi044 bash[22676]: cluster 2024-09-21T01:12:25.925608+0000 mgr.a (mgr.14388) 7699 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:26 smithi179 bash[23186]: cluster 2024-09-21T01:12:25.925608+0000 mgr.a (mgr.14388) 7699 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:26 smithi049 bash[23528]: cluster 2024-09-21T01:12:25.925608+0000 mgr.a (mgr.14388) 7699 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:12:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:28 smithi049 bash[23528]: cluster 2024-09-21T01:12:27.926379+0000 mgr.a (mgr.14388) 7700 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:28 smithi044 bash[22676]: cluster 2024-09-21T01:12:27.926379+0000 mgr.a (mgr.14388) 7700 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:28 smithi179 bash[23186]: cluster 2024-09-21T01:12:27.926379+0000 mgr.a (mgr.14388) 7700 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:29.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:29.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:29.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:30.648 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:30.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:30.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:30.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:30.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:30 smithi044 bash[22676]: cluster 2024-09-21T01:12:29.927120+0000 mgr.a (mgr.14388) 7701 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:30 smithi044 bash[22676]: audit 2024-09-21T01:12:30.223308+0000 mgr.a (mgr.14388) 7702 : audit [DBG] from='client.173655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:30 smithi179 bash[23186]: cluster 2024-09-21T01:12:29.927120+0000 mgr.a (mgr.14388) 7701 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:30 smithi179 bash[23186]: audit 2024-09-21T01:12:30.223308+0000 mgr.a (mgr.14388) 7702 : audit [DBG] from='client.173655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:30 smithi049 bash[23528]: cluster 2024-09-21T01:12:29.927120+0000 mgr.a (mgr.14388) 7701 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:30 smithi049 bash[23528]: audit 2024-09-21T01:12:30.223308+0000 mgr.a (mgr.14388) 7702 : audit [DBG] from='client.173655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:32 smithi179 bash[23186]: cluster 2024-09-21T01:12:31.929879+0000 mgr.a (mgr.14388) 7703 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:32 smithi049 bash[23528]: cluster 2024-09-21T01:12:31.929879+0000 mgr.a (mgr.14388) 7703 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:32 smithi044 bash[22676]: cluster 2024-09-21T01:12:31.929879+0000 mgr.a (mgr.14388) 7703 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:34 smithi179 bash[23186]: cluster 2024-09-21T01:12:33.930670+0000 mgr.a (mgr.14388) 7704 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:34 smithi049 bash[23528]: cluster 2024-09-21T01:12:33.930670+0000 mgr.a (mgr.14388) 7704 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:34 smithi044 bash[22676]: cluster 2024-09-21T01:12:33.930670+0000 mgr.a (mgr.14388) 7704 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:35.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:35.650 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:35.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:36.421 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:36.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:36.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:36.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:36.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:36 smithi179 bash[23186]: cluster 2024-09-21T01:12:35.932682+0000 mgr.a (mgr.14388) 7705 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:36 smithi179 bash[23186]: audit 2024-09-21T01:12:35.984608+0000 mgr.a (mgr.14388) 7706 : audit [DBG] from='client.173730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:36 smithi049 bash[23528]: cluster 2024-09-21T01:12:35.932682+0000 mgr.a (mgr.14388) 7705 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:36 smithi049 bash[23528]: audit 2024-09-21T01:12:35.984608+0000 mgr.a (mgr.14388) 7706 : audit [DBG] from='client.173730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:36 smithi044 bash[22676]: cluster 2024-09-21T01:12:35.932682+0000 mgr.a (mgr.14388) 7705 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:36 smithi044 bash[22676]: audit 2024-09-21T01:12:35.984608+0000 mgr.a (mgr.14388) 7706 : audit [DBG] from='client.173730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:39 smithi179 bash[23186]: cluster 2024-09-21T01:12:37.933610+0000 mgr.a (mgr.14388) 7707 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:12:39.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:39 smithi049 bash[23528]: cluster 2024-09-21T01:12:37.933610+0000 mgr.a (mgr.14388) 7707 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:12:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:39 smithi044 bash[22676]: cluster 2024-09-21T01:12:37.933610+0000 mgr.a (mgr.14388) 7707 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:12:41.295 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:41 smithi179 bash[23186]: cluster 2024-09-21T01:12:39.934413+0000 mgr.a (mgr.14388) 7708 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:41.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:41 smithi049 bash[23528]: cluster 2024-09-21T01:12:39.934413+0000 mgr.a (mgr.14388) 7708 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:41.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:41.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:41.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:41 smithi044 bash[22676]: cluster 2024-09-21T01:12:39.934413+0000 mgr.a (mgr.14388) 7708 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:12:42.194 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: audit 2024-09-21T01:12:41.756130+0000 mgr.a (mgr.14388) 7709 : audit [DBG] from='client.173808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: cluster 2024-09-21T01:12:41.936103+0000 mgr.a (mgr.14388) 7710 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: audit 2024-09-21T01:12:42.076925+0000 mon.a (mon.0) 6598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: audit 2024-09-21T01:12:42.082029+0000 mon.a (mon.0) 6599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: audit 2024-09-21T01:12:42.097463+0000 mon.a (mon.0) 6600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: audit 2024-09-21T01:12:42.942527+0000 mon.a (mon.0) 6601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: audit 2024-09-21T01:12:42.951232+0000 mon.a (mon.0) 6602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:43 smithi044 bash[22676]: audit 2024-09-21T01:12:42.960852+0000 mon.a (mon.0) 6603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: audit 2024-09-21T01:12:41.756130+0000 mgr.a (mgr.14388) 7709 : audit [DBG] from='client.173808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: cluster 2024-09-21T01:12:41.936103+0000 mgr.a (mgr.14388) 7710 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: audit 2024-09-21T01:12:42.076925+0000 mon.a (mon.0) 6598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: audit 2024-09-21T01:12:42.082029+0000 mon.a (mon.0) 6599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: audit 2024-09-21T01:12:42.097463+0000 mon.a (mon.0) 6600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: audit 2024-09-21T01:12:42.942527+0000 mon.a (mon.0) 6601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: audit 2024-09-21T01:12:42.951232+0000 mon.a (mon.0) 6602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:43 smithi179 bash[23186]: audit 2024-09-21T01:12:42.960852+0000 mon.a (mon.0) 6603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: audit 2024-09-21T01:12:41.756130+0000 mgr.a (mgr.14388) 7709 : audit [DBG] from='client.173808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: cluster 2024-09-21T01:12:41.936103+0000 mgr.a (mgr.14388) 7710 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: audit 2024-09-21T01:12:42.076925+0000 mon.a (mon.0) 6598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: audit 2024-09-21T01:12:42.082029+0000 mon.a (mon.0) 6599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: audit 2024-09-21T01:12:42.097463+0000 mon.a (mon.0) 6600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: audit 2024-09-21T01:12:42.942527+0000 mon.a (mon.0) 6601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: audit 2024-09-21T01:12:42.951232+0000 mon.a (mon.0) 6602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:43 smithi049 bash[23528]: audit 2024-09-21T01:12:42.960852+0000 mon.a (mon.0) 6603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:44 smithi044 bash[22676]: audit 2024-09-21T01:12:44.033322+0000 mon.a (mon.0) 6604 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:12:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:44 smithi179 bash[23186]: audit 2024-09-21T01:12:44.033322+0000 mon.a (mon.0) 6604 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:12:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:44 smithi049 bash[23528]: audit 2024-09-21T01:12:44.033322+0000 mon.a (mon.0) 6604 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:12:45.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: cluster 2024-09-21T01:12:43.936776+0000 mgr.a (mgr.14388) 7711 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.629710+0000 mon.a (mon.0) 6605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.635441+0000 mon.a (mon.0) 6606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.641963+0000 mon.a (mon.0) 6607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.646826+0000 mon.a (mon.0) 6608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.647796+0000 mon.a (mon.0) 6609 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.648506+0000 mon.a (mon.0) 6610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.652954+0000 mon.a (mon.0) 6611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22676]: audit 2024-09-21T01:12:44.655243+0000 mon.a (mon.0) 6612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: cluster 2024-09-21T01:12:43.936776+0000 mgr.a (mgr.14388) 7711 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.629710+0000 mon.a (mon.0) 6605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.635441+0000 mon.a (mon.0) 6606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.641963+0000 mon.a (mon.0) 6607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.646826+0000 mon.a (mon.0) 6608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.647796+0000 mon.a (mon.0) 6609 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:12:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.648506+0000 mon.a (mon.0) 6610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:12:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.652954+0000 mon.a (mon.0) 6611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:45 smithi179 bash[23186]: audit 2024-09-21T01:12:44.655243+0000 mon.a (mon.0) 6612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:12:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: cluster 2024-09-21T01:12:43.936776+0000 mgr.a (mgr.14388) 7711 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:12:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.629710+0000 mon.a (mon.0) 6605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.635441+0000 mon.a (mon.0) 6606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.641963+0000 mon.a (mon.0) 6607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.646826+0000 mon.a (mon.0) 6608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.647796+0000 mon.a (mon.0) 6609 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:12:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.648506+0000 mon.a (mon.0) 6610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:12:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.652954+0000 mon.a (mon.0) 6611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:45 smithi049 bash[23528]: audit 2024-09-21T01:12:44.655243+0000 mon.a (mon.0) 6612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:12:45.678 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22930]: debug 2024-09-21T01:12:45.382+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:12:45.678 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:12:45 smithi044 bash[22930]: debug 2024-09-21T01:12:45.382+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:12:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:46 smithi049 bash[23528]: audit 2024-09-21T01:12:44.656161+0000 mgr.a (mgr.14388) 7712 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:12:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:46 smithi049 bash[23528]: audit 2024-09-21T01:12:45.877187+0000 mon.a (mon.0) 6613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:46 smithi049 bash[23528]: audit 2024-09-21T01:12:45.886139+0000 mon.a (mon.0) 6614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:46 smithi049 bash[23528]: audit 2024-09-21T01:12:45.896451+0000 mon.a (mon.0) 6615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:46 smithi044 bash[22676]: audit 2024-09-21T01:12:44.656161+0000 mgr.a (mgr.14388) 7712 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:12:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:46 smithi044 bash[22676]: audit 2024-09-21T01:12:45.877187+0000 mon.a (mon.0) 6613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:46 smithi044 bash[22676]: audit 2024-09-21T01:12:45.886139+0000 mon.a (mon.0) 6614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:46 smithi044 bash[22676]: audit 2024-09-21T01:12:45.896451+0000 mon.a (mon.0) 6615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:46 smithi179 bash[23186]: audit 2024-09-21T01:12:44.656161+0000 mgr.a (mgr.14388) 7712 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:12:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:46 smithi179 bash[23186]: audit 2024-09-21T01:12:45.877187+0000 mon.a (mon.0) 6613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:46 smithi179 bash[23186]: audit 2024-09-21T01:12:45.886139+0000 mon.a (mon.0) 6614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:46 smithi179 bash[23186]: audit 2024-09-21T01:12:45.896451+0000 mon.a (mon.0) 6615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:12:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:47 smithi044 bash[22676]: audit 2024-09-21T01:12:45.386998+0000 mgr.a (mgr.14388) 7713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:12:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:47 smithi044 bash[22676]: cephadm 2024-09-21T01:12:45.388710+0000 mgr.a (mgr.14388) 7714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:12:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:47 smithi044 bash[22676]: cluster 2024-09-21T01:12:45.939516+0000 mgr.a (mgr.14388) 7715 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:12:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:47 smithi179 bash[23186]: audit 2024-09-21T01:12:45.386998+0000 mgr.a (mgr.14388) 7713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:12:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:47 smithi179 bash[23186]: cephadm 2024-09-21T01:12:45.388710+0000 mgr.a (mgr.14388) 7714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:12:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:47 smithi179 bash[23186]: cluster 2024-09-21T01:12:45.939516+0000 mgr.a (mgr.14388) 7715 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:12:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:47 smithi049 bash[23528]: audit 2024-09-21T01:12:45.386998+0000 mgr.a (mgr.14388) 7713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:12:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:47 smithi049 bash[23528]: cephadm 2024-09-21T01:12:45.388710+0000 mgr.a (mgr.14388) 7714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:12:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:47 smithi049 bash[23528]: cluster 2024-09-21T01:12:45.939516+0000 mgr.a (mgr.14388) 7715 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:12:47.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:47.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:47.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:47.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:47.985 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:49 smithi044 bash[22676]: audit 2024-09-21T01:12:47.541442+0000 mgr.a (mgr.14388) 7716 : audit [DBG] from='client.173991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:49 smithi044 bash[22676]: cluster 2024-09-21T01:12:47.940133+0000 mgr.a (mgr.14388) 7717 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:12:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:49 smithi179 bash[23186]: audit 2024-09-21T01:12:47.541442+0000 mgr.a (mgr.14388) 7716 : audit [DBG] from='client.173991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:49 smithi179 bash[23186]: cluster 2024-09-21T01:12:47.940133+0000 mgr.a (mgr.14388) 7717 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:12:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:49 smithi049 bash[23528]: audit 2024-09-21T01:12:47.541442+0000 mgr.a (mgr.14388) 7716 : audit [DBG] from='client.173991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:49 smithi049 bash[23528]: cluster 2024-09-21T01:12:47.940133+0000 mgr.a (mgr.14388) 7717 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:12:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:51 smithi044 bash[22676]: cluster 2024-09-21T01:12:49.940858+0000 mgr.a (mgr.14388) 7718 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:12:51.499 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:51 smithi049 bash[23528]: cluster 2024-09-21T01:12:49.940858+0000 mgr.a (mgr.14388) 7718 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:12:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:51 smithi179 bash[23186]: cluster 2024-09-21T01:12:49.940858+0000 mgr.a (mgr.14388) 7718 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:12:52.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:53.430 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:53 smithi049 bash[23528]: cluster 2024-09-21T01:12:51.943113+0000 mgr.a (mgr.14388) 7719 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:53 smithi044 bash[22676]: cluster 2024-09-21T01:12:51.943113+0000 mgr.a (mgr.14388) 7719 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:53 smithi179 bash[23186]: cluster 2024-09-21T01:12:51.943113+0000 mgr.a (mgr.14388) 7719 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:53.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:53.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:53.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:53.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:53.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:55 smithi044 bash[22676]: audit 2024-09-21T01:12:53.324149+0000 mgr.a (mgr.14388) 7720 : audit [DBG] from='client.174066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:55 smithi044 bash[22676]: cluster 2024-09-21T01:12:53.944087+0000 mgr.a (mgr.14388) 7721 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:55 smithi179 bash[23186]: audit 2024-09-21T01:12:53.324149+0000 mgr.a (mgr.14388) 7720 : audit [DBG] from='client.174066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:55 smithi179 bash[23186]: cluster 2024-09-21T01:12:53.944087+0000 mgr.a (mgr.14388) 7721 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:55 smithi049 bash[23528]: audit 2024-09-21T01:12:53.324149+0000 mgr.a (mgr.14388) 7720 : audit [DBG] from='client.174066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:55 smithi049 bash[23528]: cluster 2024-09-21T01:12:53.944087+0000 mgr.a (mgr.14388) 7721 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:57 smithi049 bash[23528]: cluster 2024-09-21T01:12:55.946397+0000 mgr.a (mgr.14388) 7722 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:57 smithi044 bash[22676]: cluster 2024-09-21T01:12:55.946397+0000 mgr.a (mgr.14388) 7722 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:57 smithi179 bash[23186]: cluster 2024-09-21T01:12:55.946397+0000 mgr.a (mgr.14388) 7722 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:12:58.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:12:58.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:12:58.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:12:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:12:59 smithi044 bash[22676]: cluster 2024-09-21T01:12:57.947211+0000 mgr.a (mgr.14388) 7723 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:12:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:12:59 smithi179 bash[23186]: cluster 2024-09-21T01:12:57.947211+0000 mgr.a (mgr.14388) 7723 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:12:59.543 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:12:59.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:12:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:12:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:12:59.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:12:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:12:59 smithi049 bash[23528]: cluster 2024-09-21T01:12:57.947211+0000 mgr.a (mgr.14388) 7723 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:13:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:00 smithi044 bash[22676]: audit 2024-09-21T01:12:59.106449+0000 mgr.a (mgr.14388) 7724 : audit [DBG] from='client.174141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:00 smithi179 bash[23186]: audit 2024-09-21T01:12:59.106449+0000 mgr.a (mgr.14388) 7724 : audit [DBG] from='client.174141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:00 smithi049 bash[23528]: audit 2024-09-21T01:12:59.106449+0000 mgr.a (mgr.14388) 7724 : audit [DBG] from='client.174141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:01 smithi044 bash[22676]: cluster 2024-09-21T01:12:59.948217+0000 mgr.a (mgr.14388) 7725 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:13:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:01 smithi179 bash[23186]: cluster 2024-09-21T01:12:59.948217+0000 mgr.a (mgr.14388) 7725 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:13:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:01 smithi049 bash[23528]: cluster 2024-09-21T01:12:59.948217+0000 mgr.a (mgr.14388) 7725 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:13:03.392 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:03 smithi179 bash[23186]: cluster 2024-09-21T01:13:01.950546+0000 mgr.a (mgr.14388) 7726 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:13:03.392 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:03 smithi179 bash[23186]: audit 2024-09-21T01:13:02.291920+0000 mon.a (mon.0) 6616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:03 smithi179 bash[23186]: audit 2024-09-21T01:13:02.296682+0000 mon.a (mon.0) 6617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:03 smithi179 bash[23186]: audit 2024-09-21T01:13:02.301890+0000 mon.a (mon.0) 6618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:03 smithi179 bash[23186]: audit 2024-09-21T01:13:03.103019+0000 mon.a (mon.0) 6619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:03 smithi179 bash[23186]: audit 2024-09-21T01:13:03.109779+0000 mon.a (mon.0) 6620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:03 smithi179 bash[23186]: audit 2024-09-21T01:13:03.119047+0000 mon.a (mon.0) 6621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:03 smithi044 bash[22676]: cluster 2024-09-21T01:13:01.950546+0000 mgr.a (mgr.14388) 7726 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:13:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:03 smithi044 bash[22676]: audit 2024-09-21T01:13:02.291920+0000 mon.a (mon.0) 6616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:03 smithi044 bash[22676]: audit 2024-09-21T01:13:02.296682+0000 mon.a (mon.0) 6617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:03 smithi044 bash[22676]: audit 2024-09-21T01:13:02.301890+0000 mon.a (mon.0) 6618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:03 smithi044 bash[22676]: audit 2024-09-21T01:13:03.103019+0000 mon.a (mon.0) 6619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:03 smithi044 bash[22676]: audit 2024-09-21T01:13:03.109779+0000 mon.a (mon.0) 6620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:03 smithi044 bash[22676]: audit 2024-09-21T01:13:03.119047+0000 mon.a (mon.0) 6621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:03 smithi049 bash[23528]: cluster 2024-09-21T01:13:01.950546+0000 mgr.a (mgr.14388) 7726 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:13:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:03 smithi049 bash[23528]: audit 2024-09-21T01:13:02.291920+0000 mon.a (mon.0) 6616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:03 smithi049 bash[23528]: audit 2024-09-21T01:13:02.296682+0000 mon.a (mon.0) 6617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:03 smithi049 bash[23528]: audit 2024-09-21T01:13:02.301890+0000 mon.a (mon.0) 6618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:03 smithi049 bash[23528]: audit 2024-09-21T01:13:03.103019+0000 mon.a (mon.0) 6619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:03 smithi049 bash[23528]: audit 2024-09-21T01:13:03.109779+0000 mon.a (mon.0) 6620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:03 smithi049 bash[23528]: audit 2024-09-21T01:13:03.119047+0000 mon.a (mon.0) 6621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:04.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:05.308 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:05.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:05.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:05.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:05.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:05 smithi044 bash[22676]: cluster 2024-09-21T01:13:03.951327+0000 mgr.a (mgr.14388) 7727 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:05 smithi179 bash[23186]: cluster 2024-09-21T01:13:03.951327+0000 mgr.a (mgr.14388) 7727 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:05 smithi049 bash[23528]: cluster 2024-09-21T01:13:03.951327+0000 mgr.a (mgr.14388) 7727 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:06 smithi044 bash[22676]: audit 2024-09-21T01:13:04.864381+0000 mgr.a (mgr.14388) 7728 : audit [DBG] from='client.174216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:06 smithi044 bash[22676]: audit 2024-09-21T01:13:06.114850+0000 mon.a (mon.0) 6622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:06 smithi044 bash[22676]: audit 2024-09-21T01:13:06.123622+0000 mon.a (mon.0) 6623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:06 smithi179 bash[23186]: audit 2024-09-21T01:13:04.864381+0000 mgr.a (mgr.14388) 7728 : audit [DBG] from='client.174216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:06 smithi179 bash[23186]: audit 2024-09-21T01:13:06.114850+0000 mon.a (mon.0) 6622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:06 smithi179 bash[23186]: audit 2024-09-21T01:13:06.123622+0000 mon.a (mon.0) 6623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:06 smithi049 bash[23528]: audit 2024-09-21T01:13:04.864381+0000 mgr.a (mgr.14388) 7728 : audit [DBG] from='client.174216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:06 smithi049 bash[23528]: audit 2024-09-21T01:13:06.114850+0000 mon.a (mon.0) 6622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:06 smithi049 bash[23528]: audit 2024-09-21T01:13:06.123622+0000 mon.a (mon.0) 6623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:07 smithi044 bash[22676]: cluster 2024-09-21T01:13:05.954169+0000 mgr.a (mgr.14388) 7729 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:07 smithi044 bash[22676]: audit 2024-09-21T01:13:06.135394+0000 mon.a (mon.0) 6624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:07 smithi179 bash[23186]: cluster 2024-09-21T01:13:05.954169+0000 mgr.a (mgr.14388) 7729 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:07 smithi179 bash[23186]: audit 2024-09-21T01:13:06.135394+0000 mon.a (mon.0) 6624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:07 smithi049 bash[23528]: cluster 2024-09-21T01:13:05.954169+0000 mgr.a (mgr.14388) 7729 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:07 smithi049 bash[23528]: audit 2024-09-21T01:13:06.135394+0000 mon.a (mon.0) 6624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:09 smithi044 bash[22676]: cluster 2024-09-21T01:13:07.954964+0000 mgr.a (mgr.14388) 7730 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:09 smithi179 bash[23186]: cluster 2024-09-21T01:13:07.954964+0000 mgr.a (mgr.14388) 7730 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:09 smithi049 bash[23528]: cluster 2024-09-21T01:13:07.954964+0000 mgr.a (mgr.14388) 7730 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:10.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:10.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:10.314 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:11.060 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:11.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:11.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:11.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:11.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:11 smithi044 bash[22676]: cluster 2024-09-21T01:13:09.955732+0000 mgr.a (mgr.14388) 7731 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:13:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:11 smithi179 bash[23186]: cluster 2024-09-21T01:13:09.955732+0000 mgr.a (mgr.14388) 7731 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:13:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:11 smithi049 bash[23528]: cluster 2024-09-21T01:13:09.955732+0000 mgr.a (mgr.14388) 7731 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:13:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:12 smithi044 bash[22676]: audit 2024-09-21T01:13:10.643174+0000 mgr.a (mgr.14388) 7732 : audit [DBG] from='client.174294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:12 smithi179 bash[23186]: audit 2024-09-21T01:13:10.643174+0000 mgr.a (mgr.14388) 7732 : audit [DBG] from='client.174294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:12.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:12 smithi049 bash[23528]: audit 2024-09-21T01:13:10.643174+0000 mgr.a (mgr.14388) 7732 : audit [DBG] from='client.174294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:13 smithi044 bash[22676]: cluster 2024-09-21T01:13:11.958668+0000 mgr.a (mgr.14388) 7733 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:13 smithi179 bash[23186]: cluster 2024-09-21T01:13:11.958668+0000 mgr.a (mgr.14388) 7733 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:13 smithi049 bash[23528]: cluster 2024-09-21T01:13:11.958668+0000 mgr.a (mgr.14388) 7733 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:15 smithi049 bash[23528]: cluster 2024-09-21T01:13:13.959645+0000 mgr.a (mgr.14388) 7734 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:15 smithi044 bash[22676]: cluster 2024-09-21T01:13:13.959645+0000 mgr.a (mgr.14388) 7734 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:15 smithi179 bash[23186]: cluster 2024-09-21T01:13:13.959645+0000 mgr.a (mgr.14388) 7734 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:16.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:16.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:16.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:16.843 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:16.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:16.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:16.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:16.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:17 smithi044 bash[22676]: cluster 2024-09-21T01:13:15.961723+0000 mgr.a (mgr.14388) 7735 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:17 smithi179 bash[23186]: cluster 2024-09-21T01:13:15.961723+0000 mgr.a (mgr.14388) 7735 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:17.513 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:17 smithi049 bash[23528]: cluster 2024-09-21T01:13:15.961723+0000 mgr.a (mgr.14388) 7735 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:18 smithi044 bash[22676]: audit 2024-09-21T01:13:16.400843+0000 mgr.a (mgr.14388) 7736 : audit [DBG] from='client.174372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:18 smithi179 bash[23186]: audit 2024-09-21T01:13:16.400843+0000 mgr.a (mgr.14388) 7736 : audit [DBG] from='client.174372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:18 smithi049 bash[23528]: audit 2024-09-21T01:13:16.400843+0000 mgr.a (mgr.14388) 7736 : audit [DBG] from='client.174372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:19 smithi044 bash[22676]: cluster 2024-09-21T01:13:17.962629+0000 mgr.a (mgr.14388) 7737 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:19 smithi179 bash[23186]: cluster 2024-09-21T01:13:17.962629+0000 mgr.a (mgr.14388) 7737 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:19 smithi049 bash[23528]: cluster 2024-09-21T01:13:17.962629+0000 mgr.a (mgr.14388) 7737 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:21 smithi044 bash[22676]: cluster 2024-09-21T01:13:19.963429+0000 mgr.a (mgr.14388) 7738 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:21 smithi179 bash[23186]: cluster 2024-09-21T01:13:19.963429+0000 mgr.a (mgr.14388) 7738 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:21 smithi049 bash[23528]: cluster 2024-09-21T01:13:19.963429+0000 mgr.a (mgr.14388) 7738 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:22.635 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:22.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:22.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:22.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:22.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:23.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:23 smithi179 bash[23186]: cluster 2024-09-21T01:13:21.964831+0000 mgr.a (mgr.14388) 7739 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:23.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:23 smithi179 bash[23186]: audit 2024-09-21T01:13:22.181894+0000 mgr.a (mgr.14388) 7740 : audit [DBG] from='client.174447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:23.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:23 smithi179 bash[23186]: audit 2024-09-21T01:13:22.473019+0000 mon.a (mon.0) 6625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:23 smithi179 bash[23186]: audit 2024-09-21T01:13:22.479372+0000 mon.a (mon.0) 6626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:23 smithi179 bash[23186]: audit 2024-09-21T01:13:22.485274+0000 mon.a (mon.0) 6627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:23 smithi044 bash[22676]: cluster 2024-09-21T01:13:21.964831+0000 mgr.a (mgr.14388) 7739 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:23 smithi044 bash[22676]: audit 2024-09-21T01:13:22.181894+0000 mgr.a (mgr.14388) 7740 : audit [DBG] from='client.174447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:23 smithi044 bash[22676]: audit 2024-09-21T01:13:22.473019+0000 mon.a (mon.0) 6625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:23 smithi044 bash[22676]: audit 2024-09-21T01:13:22.479372+0000 mon.a (mon.0) 6626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:23 smithi044 bash[22676]: audit 2024-09-21T01:13:22.485274+0000 mon.a (mon.0) 6627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:23 smithi049 bash[23528]: cluster 2024-09-21T01:13:21.964831+0000 mgr.a (mgr.14388) 7739 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:23 smithi049 bash[23528]: audit 2024-09-21T01:13:22.181894+0000 mgr.a (mgr.14388) 7740 : audit [DBG] from='client.174447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:23 smithi049 bash[23528]: audit 2024-09-21T01:13:22.473019+0000 mon.a (mon.0) 6625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:23 smithi049 bash[23528]: audit 2024-09-21T01:13:22.479372+0000 mon.a (mon.0) 6626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:23 smithi049 bash[23528]: audit 2024-09-21T01:13:22.485274+0000 mon.a (mon.0) 6627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:24 smithi044 bash[22676]: audit 2024-09-21T01:13:23.277393+0000 mon.a (mon.0) 6628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:24 smithi044 bash[22676]: audit 2024-09-21T01:13:23.282866+0000 mon.a (mon.0) 6629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:24 smithi044 bash[22676]: audit 2024-09-21T01:13:23.288671+0000 mon.a (mon.0) 6630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:24 smithi044 bash[22676]: cluster 2024-09-21T01:13:23.965747+0000 mgr.a (mgr.14388) 7741 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:24 smithi049 bash[23528]: audit 2024-09-21T01:13:23.277393+0000 mon.a (mon.0) 6628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:24 smithi049 bash[23528]: audit 2024-09-21T01:13:23.282866+0000 mon.a (mon.0) 6629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:24 smithi049 bash[23528]: audit 2024-09-21T01:13:23.288671+0000 mon.a (mon.0) 6630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:24 smithi049 bash[23528]: cluster 2024-09-21T01:13:23.965747+0000 mgr.a (mgr.14388) 7741 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:24 smithi179 bash[23186]: audit 2024-09-21T01:13:23.277393+0000 mon.a (mon.0) 6628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:24 smithi179 bash[23186]: audit 2024-09-21T01:13:23.282866+0000 mon.a (mon.0) 6629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:24 smithi179 bash[23186]: audit 2024-09-21T01:13:23.288671+0000 mon.a (mon.0) 6630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:24 smithi179 bash[23186]: cluster 2024-09-21T01:13:23.965747+0000 mgr.a (mgr.14388) 7741 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:27 smithi044 bash[22676]: cluster 2024-09-21T01:13:25.967976+0000 mgr.a (mgr.14388) 7742 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:27 smithi044 bash[22676]: audit 2024-09-21T01:13:26.346850+0000 mon.a (mon.0) 6631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:27 smithi044 bash[22676]: audit 2024-09-21T01:13:26.356616+0000 mon.a (mon.0) 6632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:27 smithi044 bash[22676]: audit 2024-09-21T01:13:26.368035+0000 mon.a (mon.0) 6633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:27 smithi049 bash[23528]: cluster 2024-09-21T01:13:25.967976+0000 mgr.a (mgr.14388) 7742 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:27 smithi049 bash[23528]: audit 2024-09-21T01:13:26.346850+0000 mon.a (mon.0) 6631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:27 smithi049 bash[23528]: audit 2024-09-21T01:13:26.356616+0000 mon.a (mon.0) 6632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:27 smithi049 bash[23528]: audit 2024-09-21T01:13:26.368035+0000 mon.a (mon.0) 6633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:27 smithi179 bash[23186]: cluster 2024-09-21T01:13:25.967976+0000 mgr.a (mgr.14388) 7742 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:27 smithi179 bash[23186]: audit 2024-09-21T01:13:26.346850+0000 mon.a (mon.0) 6631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:27 smithi179 bash[23186]: audit 2024-09-21T01:13:26.356616+0000 mon.a (mon.0) 6632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:27 smithi179 bash[23186]: audit 2024-09-21T01:13:26.368035+0000 mon.a (mon.0) 6633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:27.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:27.638 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:27.638 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:28.416 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:28.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:29 smithi049 bash[23528]: cluster 2024-09-21T01:13:27.968702+0000 mgr.a (mgr.14388) 7743 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:29 smithi049 bash[23528]: audit 2024-09-21T01:13:27.972128+0000 mgr.a (mgr.14388) 7744 : audit [DBG] from='client.174519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:29 smithi044 bash[22676]: cluster 2024-09-21T01:13:27.968702+0000 mgr.a (mgr.14388) 7743 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:29 smithi044 bash[22676]: audit 2024-09-21T01:13:27.972128+0000 mgr.a (mgr.14388) 7744 : audit [DBG] from='client.174519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:29 smithi179 bash[23186]: cluster 2024-09-21T01:13:27.968702+0000 mgr.a (mgr.14388) 7743 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:29 smithi179 bash[23186]: audit 2024-09-21T01:13:27.972128+0000 mgr.a (mgr.14388) 7744 : audit [DBG] from='client.174519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:31 smithi049 bash[23528]: cluster 2024-09-21T01:13:29.969572+0000 mgr.a (mgr.14388) 7745 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:31 smithi044 bash[22676]: cluster 2024-09-21T01:13:29.969572+0000 mgr.a (mgr.14388) 7745 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:31 smithi179 bash[23186]: cluster 2024-09-21T01:13:29.969572+0000 mgr.a (mgr.14388) 7745 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:33.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:33 smithi049 bash[23528]: cluster 2024-09-21T01:13:31.971782+0000 mgr.a (mgr.14388) 7746 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:33.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:33.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:33.419 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:33 smithi044 bash[22676]: cluster 2024-09-21T01:13:31.971782+0000 mgr.a (mgr.14388) 7746 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:33 smithi179 bash[23186]: cluster 2024-09-21T01:13:31.971782+0000 mgr.a (mgr.14388) 7746 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:34.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:35.394 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:35 smithi049 bash[23528]: audit 2024-09-21T01:13:33.747686+0000 mgr.a (mgr.14388) 7747 : audit [DBG] from='client.174597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:35.394 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:35 smithi049 bash[23528]: cluster 2024-09-21T01:13:33.981641+0000 mgr.a (mgr.14388) 7748 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:35 smithi044 bash[22676]: audit 2024-09-21T01:13:33.747686+0000 mgr.a (mgr.14388) 7747 : audit [DBG] from='client.174597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:35 smithi044 bash[22676]: cluster 2024-09-21T01:13:33.981641+0000 mgr.a (mgr.14388) 7748 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:35 smithi179 bash[23186]: audit 2024-09-21T01:13:33.747686+0000 mgr.a (mgr.14388) 7747 : audit [DBG] from='client.174597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:35 smithi179 bash[23186]: cluster 2024-09-21T01:13:33.981641+0000 mgr.a (mgr.14388) 7748 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:37 smithi049 bash[23528]: cluster 2024-09-21T01:13:35.984037+0000 mgr.a (mgr.14388) 7749 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:37 smithi044 bash[22676]: cluster 2024-09-21T01:13:35.984037+0000 mgr.a (mgr.14388) 7749 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:37 smithi179 bash[23186]: cluster 2024-09-21T01:13:35.984037+0000 mgr.a (mgr.14388) 7749 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:39.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:39.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:39.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:39 smithi044 bash[22676]: cluster 2024-09-21T01:13:37.984818+0000 mgr.a (mgr.14388) 7750 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:39 smithi179 bash[23186]: cluster 2024-09-21T01:13:37.984818+0000 mgr.a (mgr.14388) 7750 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:39 smithi049 bash[23528]: cluster 2024-09-21T01:13:37.984818+0000 mgr.a (mgr.14388) 7750 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:39.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:39.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:39.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:39.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:39.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:41.328 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:41 smithi179 bash[23186]: audit 2024-09-21T01:13:39.514855+0000 mgr.a (mgr.14388) 7751 : audit [DBG] from='client.174672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:41.328 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:41 smithi179 bash[23186]: cluster 2024-09-21T01:13:39.985428+0000 mgr.a (mgr.14388) 7752 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:41 smithi044 bash[22676]: audit 2024-09-21T01:13:39.514855+0000 mgr.a (mgr.14388) 7751 : audit [DBG] from='client.174672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:41 smithi044 bash[22676]: cluster 2024-09-21T01:13:39.985428+0000 mgr.a (mgr.14388) 7752 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:41 smithi049 bash[23528]: audit 2024-09-21T01:13:39.514855+0000 mgr.a (mgr.14388) 7751 : audit [DBG] from='client.174672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:41 smithi049 bash[23528]: cluster 2024-09-21T01:13:39.985428+0000 mgr.a (mgr.14388) 7752 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:43.427 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:43 smithi179 bash[23186]: cluster 2024-09-21T01:13:41.987652+0000 mgr.a (mgr.14388) 7753 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:43.428 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:43 smithi179 bash[23186]: audit 2024-09-21T01:13:42.644371+0000 mon.a (mon.0) 6634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.428 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:43 smithi179 bash[23186]: audit 2024-09-21T01:13:42.650081+0000 mon.a (mon.0) 6635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.428 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:43 smithi179 bash[23186]: audit 2024-09-21T01:13:42.659346+0000 mon.a (mon.0) 6636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:43 smithi044 bash[22676]: cluster 2024-09-21T01:13:41.987652+0000 mgr.a (mgr.14388) 7753 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:43.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:43 smithi044 bash[22676]: audit 2024-09-21T01:13:42.644371+0000 mon.a (mon.0) 6634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:43 smithi044 bash[22676]: audit 2024-09-21T01:13:42.650081+0000 mon.a (mon.0) 6635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:43 smithi044 bash[22676]: audit 2024-09-21T01:13:42.659346+0000 mon.a (mon.0) 6636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:43 smithi049 bash[23528]: cluster 2024-09-21T01:13:41.987652+0000 mgr.a (mgr.14388) 7753 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:13:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:43 smithi049 bash[23528]: audit 2024-09-21T01:13:42.644371+0000 mon.a (mon.0) 6634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:43 smithi049 bash[23528]: audit 2024-09-21T01:13:42.650081+0000 mon.a (mon.0) 6635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:43 smithi049 bash[23528]: audit 2024-09-21T01:13:42.659346+0000 mon.a (mon.0) 6636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:44 smithi044 bash[22676]: audit 2024-09-21T01:13:43.489305+0000 mon.a (mon.0) 6637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:44 smithi044 bash[22676]: audit 2024-09-21T01:13:43.499371+0000 mon.a (mon.0) 6638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:44 smithi044 bash[22676]: audit 2024-09-21T01:13:43.511208+0000 mon.a (mon.0) 6639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:44 smithi044 bash[22676]: cluster 2024-09-21T01:13:43.988452+0000 mgr.a (mgr.14388) 7754 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:44 smithi179 bash[23186]: audit 2024-09-21T01:13:43.489305+0000 mon.a (mon.0) 6637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:44 smithi179 bash[23186]: audit 2024-09-21T01:13:43.499371+0000 mon.a (mon.0) 6638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:44 smithi179 bash[23186]: audit 2024-09-21T01:13:43.511208+0000 mon.a (mon.0) 6639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:44 smithi179 bash[23186]: cluster 2024-09-21T01:13:43.988452+0000 mgr.a (mgr.14388) 7754 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:44 smithi049 bash[23528]: audit 2024-09-21T01:13:43.489305+0000 mon.a (mon.0) 6637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:44 smithi049 bash[23528]: audit 2024-09-21T01:13:43.499371+0000 mon.a (mon.0) 6638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:44 smithi049 bash[23528]: audit 2024-09-21T01:13:43.511208+0000 mon.a (mon.0) 6639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:44 smithi049 bash[23528]: cluster 2024-09-21T01:13:43.988452+0000 mgr.a (mgr.14388) 7754 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:44.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:44.978 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:44.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:45.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:45.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:45.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:45.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:45 smithi049 bash[23528]: audit 2024-09-21T01:13:45.454651+0000 mon.a (mon.0) 6640 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:13:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:45 smithi044 bash[22676]: audit 2024-09-21T01:13:45.454651+0000 mon.a (mon.0) 6640 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:13:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:45 smithi179 bash[23186]: audit 2024-09-21T01:13:45.454651+0000 mon.a (mon.0) 6640 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:13:46.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:13:46 smithi044 bash[22930]: debug 2024-09-21T01:13:46.797+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:13:46.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:13:46 smithi044 bash[22930]: debug 2024-09-21T01:13:46.797+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:45.306500+0000 mgr.a (mgr.14388) 7755 : audit [DBG] from='client.174747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: cluster 2024-09-21T01:13:45.991308+0000 mgr.a (mgr.14388) 7756 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.008292+0000 mon.a (mon.0) 6641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.017162+0000 mon.a (mon.0) 6642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.019977+0000 mon.a (mon.0) 6643 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.021902+0000 mon.a (mon.0) 6644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.032382+0000 mon.a (mon.0) 6645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.038209+0000 mon.a (mon.0) 6646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.040763+0000 mgr.a (mgr.14388) 7757 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:13:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.567777+0000 mon.a (mon.0) 6647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.572674+0000 mon.a (mon.0) 6648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:47 smithi049 bash[23528]: audit 2024-09-21T01:13:46.579095+0000 mon.a (mon.0) 6649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:45.306500+0000 mgr.a (mgr.14388) 7755 : audit [DBG] from='client.174747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: cluster 2024-09-21T01:13:45.991308+0000 mgr.a (mgr.14388) 7756 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.008292+0000 mon.a (mon.0) 6641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.017162+0000 mon.a (mon.0) 6642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.019977+0000 mon.a (mon.0) 6643 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.021902+0000 mon.a (mon.0) 6644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.032382+0000 mon.a (mon.0) 6645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.038209+0000 mon.a (mon.0) 6646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:13:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.040763+0000 mgr.a (mgr.14388) 7757 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:13:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.567777+0000 mon.a (mon.0) 6647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.572674+0000 mon.a (mon.0) 6648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:47 smithi044 bash[22676]: audit 2024-09-21T01:13:46.579095+0000 mon.a (mon.0) 6649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:45.306500+0000 mgr.a (mgr.14388) 7755 : audit [DBG] from='client.174747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: cluster 2024-09-21T01:13:45.991308+0000 mgr.a (mgr.14388) 7756 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.008292+0000 mon.a (mon.0) 6641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.017162+0000 mon.a (mon.0) 6642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.019977+0000 mon.a (mon.0) 6643 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.021902+0000 mon.a (mon.0) 6644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.032382+0000 mon.a (mon.0) 6645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.038209+0000 mon.a (mon.0) 6646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:13:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.040763+0000 mgr.a (mgr.14388) 7757 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:13:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.567777+0000 mon.a (mon.0) 6647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.572674+0000 mon.a (mon.0) 6648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:47 smithi179 bash[23186]: audit 2024-09-21T01:13:46.579095+0000 mon.a (mon.0) 6649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:13:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:48 smithi049 bash[23528]: audit 2024-09-21T01:13:46.799581+0000 mgr.a (mgr.14388) 7758 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:13:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:48 smithi049 bash[23528]: cephadm 2024-09-21T01:13:46.800598+0000 mgr.a (mgr.14388) 7759 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:13:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:48 smithi044 bash[22676]: audit 2024-09-21T01:13:46.799581+0000 mgr.a (mgr.14388) 7758 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:13:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:48 smithi044 bash[22676]: cephadm 2024-09-21T01:13:46.800598+0000 mgr.a (mgr.14388) 7759 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:13:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:48 smithi179 bash[23186]: audit 2024-09-21T01:13:46.799581+0000 mgr.a (mgr.14388) 7758 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:13:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:48 smithi179 bash[23186]: cephadm 2024-09-21T01:13:46.800598+0000 mgr.a (mgr.14388) 7759 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:13:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:49 smithi049 bash[23528]: cluster 2024-09-21T01:13:47.992234+0000 mgr.a (mgr.14388) 7760 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:49 smithi044 bash[22676]: cluster 2024-09-21T01:13:47.992234+0000 mgr.a (mgr.14388) 7760 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:49 smithi179 bash[23186]: cluster 2024-09-21T01:13:47.992234+0000 mgr.a (mgr.14388) 7760 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:13:50.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:50.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:51 smithi049 bash[23528]: cluster 2024-09-21T01:13:49.992986+0000 mgr.a (mgr.14388) 7761 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:13:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:51 smithi044 bash[22676]: cluster 2024-09-21T01:13:49.992986+0000 mgr.a (mgr.14388) 7761 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:13:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:51 smithi179 bash[23186]: cluster 2024-09-21T01:13:49.992986+0000 mgr.a (mgr.14388) 7761 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:13:51.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:51.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:51.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:52 smithi049 bash[23528]: audit 2024-09-21T01:13:51.063316+0000 mgr.a (mgr.14388) 7762 : audit [DBG] from='client.174924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:52 smithi044 bash[22676]: audit 2024-09-21T01:13:51.063316+0000 mgr.a (mgr.14388) 7762 : audit [DBG] from='client.174924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:52 smithi179 bash[23186]: audit 2024-09-21T01:13:51.063316+0000 mgr.a (mgr.14388) 7762 : audit [DBG] from='client.174924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:53 smithi049 bash[23528]: cluster 2024-09-21T01:13:51.995862+0000 mgr.a (mgr.14388) 7763 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:53 smithi044 bash[22676]: cluster 2024-09-21T01:13:51.995862+0000 mgr.a (mgr.14388) 7763 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:53 smithi179 bash[23186]: cluster 2024-09-21T01:13:51.995862+0000 mgr.a (mgr.14388) 7763 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:55 smithi049 bash[23528]: cluster 2024-09-21T01:13:53.996679+0000 mgr.a (mgr.14388) 7764 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:13:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:55 smithi044 bash[22676]: cluster 2024-09-21T01:13:53.996679+0000 mgr.a (mgr.14388) 7764 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:13:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:55 smithi179 bash[23186]: cluster 2024-09-21T01:13:53.996679+0000 mgr.a (mgr.14388) 7764 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:13:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:13:56.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:13:56.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:13:57.286 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:13:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:13:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:13:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:13:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:13:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:57 smithi049 bash[23528]: cluster 2024-09-21T01:13:55.998796+0000 mgr.a (mgr.14388) 7765 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:57 smithi044 bash[22676]: cluster 2024-09-21T01:13:55.998796+0000 mgr.a (mgr.14388) 7765 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:57 smithi179 bash[23186]: cluster 2024-09-21T01:13:55.998796+0000 mgr.a (mgr.14388) 7765 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:58.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:58 smithi049 bash[23528]: audit 2024-09-21T01:13:56.852976+0000 mgr.a (mgr.14388) 7766 : audit [DBG] from='client.174999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:58 smithi044 bash[22676]: audit 2024-09-21T01:13:56.852976+0000 mgr.a (mgr.14388) 7766 : audit [DBG] from='client.174999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:58 smithi179 bash[23186]: audit 2024-09-21T01:13:56.852976+0000 mgr.a (mgr.14388) 7766 : audit [DBG] from='client.174999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:13:59 smithi044 bash[22676]: cluster 2024-09-21T01:13:57.999745+0000 mgr.a (mgr.14388) 7767 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:13:59 smithi179 bash[23186]: cluster 2024-09-21T01:13:57.999745+0000 mgr.a (mgr.14388) 7767 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:13:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:13:59 smithi049 bash[23528]: cluster 2024-09-21T01:13:57.999745+0000 mgr.a (mgr.14388) 7767 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:01.342 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:01 smithi179 bash[23186]: cluster 2024-09-21T01:14:00.000527+0000 mgr.a (mgr.14388) 7768 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:01 smithi044 bash[22676]: cluster 2024-09-21T01:14:00.000527+0000 mgr.a (mgr.14388) 7768 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:01 smithi049 bash[23528]: cluster 2024-09-21T01:14:00.000527+0000 mgr.a (mgr.14388) 7768 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:02.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:03.085 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:03.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:03.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:03.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:03.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:03 smithi179 bash[23186]: cluster 2024-09-21T01:14:02.002811+0000 mgr.a (mgr.14388) 7769 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:03 smithi179 bash[23186]: audit 2024-09-21T01:14:02.854034+0000 mon.a (mon.0) 6650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:03 smithi179 bash[23186]: audit 2024-09-21T01:14:02.862463+0000 mon.a (mon.0) 6651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:03 smithi179 bash[23186]: audit 2024-09-21T01:14:02.869133+0000 mon.a (mon.0) 6652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:03 smithi044 bash[22676]: cluster 2024-09-21T01:14:02.002811+0000 mgr.a (mgr.14388) 7769 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:03 smithi044 bash[22676]: audit 2024-09-21T01:14:02.854034+0000 mon.a (mon.0) 6650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:03 smithi044 bash[22676]: audit 2024-09-21T01:14:02.862463+0000 mon.a (mon.0) 6651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:03 smithi044 bash[22676]: audit 2024-09-21T01:14:02.869133+0000 mon.a (mon.0) 6652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:03 smithi049 bash[23528]: cluster 2024-09-21T01:14:02.002811+0000 mgr.a (mgr.14388) 7769 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:03 smithi049 bash[23528]: audit 2024-09-21T01:14:02.854034+0000 mon.a (mon.0) 6650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:03 smithi049 bash[23528]: audit 2024-09-21T01:14:02.862463+0000 mon.a (mon.0) 6651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:03 smithi049 bash[23528]: audit 2024-09-21T01:14:02.869133+0000 mon.a (mon.0) 6652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:04 smithi044 bash[22676]: audit 2024-09-21T01:14:02.631789+0000 mgr.a (mgr.14388) 7770 : audit [DBG] from='client.175074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:04 smithi044 bash[22676]: audit 2024-09-21T01:14:03.648983+0000 mon.a (mon.0) 6653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:04 smithi044 bash[22676]: audit 2024-09-21T01:14:03.655363+0000 mon.a (mon.0) 6654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:04 smithi044 bash[22676]: audit 2024-09-21T01:14:03.662308+0000 mon.a (mon.0) 6655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:04 smithi179 bash[23186]: audit 2024-09-21T01:14:02.631789+0000 mgr.a (mgr.14388) 7770 : audit [DBG] from='client.175074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:04 smithi179 bash[23186]: audit 2024-09-21T01:14:03.648983+0000 mon.a (mon.0) 6653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:04 smithi179 bash[23186]: audit 2024-09-21T01:14:03.655363+0000 mon.a (mon.0) 6654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:04 smithi179 bash[23186]: audit 2024-09-21T01:14:03.662308+0000 mon.a (mon.0) 6655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:04 smithi049 bash[23528]: audit 2024-09-21T01:14:02.631789+0000 mgr.a (mgr.14388) 7770 : audit [DBG] from='client.175074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:04 smithi049 bash[23528]: audit 2024-09-21T01:14:03.648983+0000 mon.a (mon.0) 6653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:04 smithi049 bash[23528]: audit 2024-09-21T01:14:03.655363+0000 mon.a (mon.0) 6654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:04 smithi049 bash[23528]: audit 2024-09-21T01:14:03.662308+0000 mon.a (mon.0) 6655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:05.431 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:05 smithi044 bash[22676]: cluster 2024-09-21T01:14:04.003703+0000 mgr.a (mgr.14388) 7771 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:05 smithi179 bash[23186]: cluster 2024-09-21T01:14:04.003703+0000 mgr.a (mgr.14388) 7771 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:05 smithi049 bash[23528]: cluster 2024-09-21T01:14:04.003703+0000 mgr.a (mgr.14388) 7771 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:07 smithi049 bash[23528]: cluster 2024-09-21T01:14:06.005983+0000 mgr.a (mgr.14388) 7772 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:07 smithi049 bash[23528]: audit 2024-09-21T01:14:06.800374+0000 mon.a (mon.0) 6656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:07 smithi049 bash[23528]: audit 2024-09-21T01:14:06.809340+0000 mon.a (mon.0) 6657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:07 smithi049 bash[23528]: audit 2024-09-21T01:14:06.819756+0000 mon.a (mon.0) 6658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.401 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:07 smithi044 bash[22676]: cluster 2024-09-21T01:14:06.005983+0000 mgr.a (mgr.14388) 7772 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:07.402 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:07 smithi044 bash[22676]: audit 2024-09-21T01:14:06.800374+0000 mon.a (mon.0) 6656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.402 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:07 smithi044 bash[22676]: audit 2024-09-21T01:14:06.809340+0000 mon.a (mon.0) 6657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.402 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:07 smithi044 bash[22676]: audit 2024-09-21T01:14:06.819756+0000 mon.a (mon.0) 6658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:07 smithi179 bash[23186]: cluster 2024-09-21T01:14:06.005983+0000 mgr.a (mgr.14388) 7772 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:07 smithi179 bash[23186]: audit 2024-09-21T01:14:06.800374+0000 mon.a (mon.0) 6656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:07 smithi179 bash[23186]: audit 2024-09-21T01:14:06.809340+0000 mon.a (mon.0) 6657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:07 smithi179 bash[23186]: audit 2024-09-21T01:14:06.819756+0000 mon.a (mon.0) 6658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:08.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:08.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:08.842 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:08.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:09 smithi044 bash[22676]: cluster 2024-09-21T01:14:08.006740+0000 mgr.a (mgr.14388) 7773 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:09 smithi179 bash[23186]: cluster 2024-09-21T01:14:08.006740+0000 mgr.a (mgr.14388) 7773 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:09 smithi049 bash[23528]: cluster 2024-09-21T01:14:08.006740+0000 mgr.a (mgr.14388) 7773 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:10 smithi044 bash[22676]: audit 2024-09-21T01:14:08.421817+0000 mgr.a (mgr.14388) 7774 : audit [DBG] from='client.175152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:10 smithi179 bash[23186]: audit 2024-09-21T01:14:08.421817+0000 mgr.a (mgr.14388) 7774 : audit [DBG] from='client.175152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:10 smithi049 bash[23528]: audit 2024-09-21T01:14:08.421817+0000 mgr.a (mgr.14388) 7774 : audit [DBG] from='client.175152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:11 smithi044 bash[22676]: cluster 2024-09-21T01:14:10.007652+0000 mgr.a (mgr.14388) 7775 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:11 smithi179 bash[23186]: cluster 2024-09-21T01:14:10.007652+0000 mgr.a (mgr.14388) 7775 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:11 smithi049 bash[23528]: cluster 2024-09-21T01:14:10.007652+0000 mgr.a (mgr.14388) 7775 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:13 smithi044 bash[22676]: cluster 2024-09-21T01:14:12.009897+0000 mgr.a (mgr.14388) 7776 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:13 smithi179 bash[23186]: cluster 2024-09-21T01:14:12.009897+0000 mgr.a (mgr.14388) 7776 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:13 smithi049 bash[23528]: cluster 2024-09-21T01:14:12.009897+0000 mgr.a (mgr.14388) 7776 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:13.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:13.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:13.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:14.607 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:15 smithi044 bash[22676]: cluster 2024-09-21T01:14:14.010347+0000 mgr.a (mgr.14388) 7777 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:15 smithi044 bash[22676]: audit 2024-09-21T01:14:14.173959+0000 mgr.a (mgr.14388) 7778 : audit [DBG] from='client.175224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:15 smithi179 bash[23186]: cluster 2024-09-21T01:14:14.010347+0000 mgr.a (mgr.14388) 7777 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:15 smithi179 bash[23186]: audit 2024-09-21T01:14:14.173959+0000 mgr.a (mgr.14388) 7778 : audit [DBG] from='client.175224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:15.532 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:15 smithi049 bash[23528]: cluster 2024-09-21T01:14:14.010347+0000 mgr.a (mgr.14388) 7777 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:15.532 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:15 smithi049 bash[23528]: audit 2024-09-21T01:14:14.173959+0000 mgr.a (mgr.14388) 7778 : audit [DBG] from='client.175224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:17 smithi044 bash[22676]: cluster 2024-09-21T01:14:16.012743+0000 mgr.a (mgr.14388) 7779 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:17 smithi179 bash[23186]: cluster 2024-09-21T01:14:16.012743+0000 mgr.a (mgr.14388) 7779 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:17 smithi049 bash[23528]: cluster 2024-09-21T01:14:16.012743+0000 mgr.a (mgr.14388) 7779 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:19 smithi044 bash[22676]: cluster 2024-09-21T01:14:18.013577+0000 mgr.a (mgr.14388) 7780 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:19 smithi179 bash[23186]: cluster 2024-09-21T01:14:18.013577+0000 mgr.a (mgr.14388) 7780 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:19 smithi049 bash[23528]: cluster 2024-09-21T01:14:18.013577+0000 mgr.a (mgr.14388) 7780 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:19.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:20.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:20.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:20.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:20.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:20.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:21.370 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:21 smithi179 bash[23186]: audit 2024-09-21T01:14:19.946331+0000 mgr.a (mgr.14388) 7781 : audit [DBG] from='client.175299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:21.370 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:21 smithi179 bash[23186]: cluster 2024-09-21T01:14:20.014132+0000 mgr.a (mgr.14388) 7782 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:21 smithi044 bash[22676]: audit 2024-09-21T01:14:19.946331+0000 mgr.a (mgr.14388) 7781 : audit [DBG] from='client.175299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:21 smithi044 bash[22676]: cluster 2024-09-21T01:14:20.014132+0000 mgr.a (mgr.14388) 7782 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:21 smithi049 bash[23528]: audit 2024-09-21T01:14:19.946331+0000 mgr.a (mgr.14388) 7781 : audit [DBG] from='client.175299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:21 smithi049 bash[23528]: cluster 2024-09-21T01:14:20.014132+0000 mgr.a (mgr.14388) 7782 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:23.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:23 smithi044 bash[22676]: cluster 2024-09-21T01:14:22.016927+0000 mgr.a (mgr.14388) 7783 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:23.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:23 smithi044 bash[22676]: audit 2024-09-21T01:14:23.033778+0000 mon.a (mon.0) 6659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:23 smithi044 bash[22676]: audit 2024-09-21T01:14:23.039550+0000 mon.a (mon.0) 6660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:23 smithi044 bash[22676]: audit 2024-09-21T01:14:23.044954+0000 mon.a (mon.0) 6661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:23 smithi179 bash[23186]: cluster 2024-09-21T01:14:22.016927+0000 mgr.a (mgr.14388) 7783 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:23 smithi179 bash[23186]: audit 2024-09-21T01:14:23.033778+0000 mon.a (mon.0) 6659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:23 smithi179 bash[23186]: audit 2024-09-21T01:14:23.039550+0000 mon.a (mon.0) 6660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:23 smithi179 bash[23186]: audit 2024-09-21T01:14:23.044954+0000 mon.a (mon.0) 6661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:23 smithi049 bash[23528]: cluster 2024-09-21T01:14:22.016927+0000 mgr.a (mgr.14388) 7783 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:23 smithi049 bash[23528]: audit 2024-09-21T01:14:23.033778+0000 mon.a (mon.0) 6659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:23 smithi049 bash[23528]: audit 2024-09-21T01:14:23.039550+0000 mon.a (mon.0) 6660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:23 smithi049 bash[23528]: audit 2024-09-21T01:14:23.044954+0000 mon.a (mon.0) 6661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:24 smithi044 bash[22676]: audit 2024-09-21T01:14:23.801802+0000 mon.a (mon.0) 6662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:24 smithi044 bash[22676]: audit 2024-09-21T01:14:23.810075+0000 mon.a (mon.0) 6663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:24 smithi044 bash[22676]: audit 2024-09-21T01:14:23.830591+0000 mon.a (mon.0) 6664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:24 smithi044 bash[22676]: cluster 2024-09-21T01:14:24.017805+0000 mgr.a (mgr.14388) 7784 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:14:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:24 smithi049 bash[23528]: audit 2024-09-21T01:14:23.801802+0000 mon.a (mon.0) 6662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:24 smithi049 bash[23528]: audit 2024-09-21T01:14:23.810075+0000 mon.a (mon.0) 6663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:24 smithi049 bash[23528]: audit 2024-09-21T01:14:23.830591+0000 mon.a (mon.0) 6664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:24 smithi049 bash[23528]: cluster 2024-09-21T01:14:24.017805+0000 mgr.a (mgr.14388) 7784 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:14:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:24 smithi179 bash[23186]: audit 2024-09-21T01:14:23.801802+0000 mon.a (mon.0) 6662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:24 smithi179 bash[23186]: audit 2024-09-21T01:14:23.810075+0000 mon.a (mon.0) 6663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:24 smithi179 bash[23186]: audit 2024-09-21T01:14:23.830591+0000 mon.a (mon.0) 6664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:24 smithi179 bash[23186]: cluster 2024-09-21T01:14:24.017805+0000 mgr.a (mgr.14388) 7784 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:14:25.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:26.148 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:26.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:26.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:26.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:26.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:27 smithi044 bash[22676]: audit 2024-09-21T01:14:25.711045+0000 mgr.a (mgr.14388) 7785 : audit [DBG] from='client.175377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:27 smithi044 bash[22676]: cluster 2024-09-21T01:14:26.019222+0000 mgr.a (mgr.14388) 7786 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:27 smithi044 bash[22676]: audit 2024-09-21T01:14:27.038468+0000 mon.a (mon.0) 6665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:27 smithi044 bash[22676]: audit 2024-09-21T01:14:27.047070+0000 mon.a (mon.0) 6666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:27 smithi044 bash[22676]: audit 2024-09-21T01:14:27.057617+0000 mon.a (mon.0) 6667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:27 smithi179 bash[23186]: audit 2024-09-21T01:14:25.711045+0000 mgr.a (mgr.14388) 7785 : audit [DBG] from='client.175377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:27 smithi179 bash[23186]: cluster 2024-09-21T01:14:26.019222+0000 mgr.a (mgr.14388) 7786 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:27 smithi179 bash[23186]: audit 2024-09-21T01:14:27.038468+0000 mon.a (mon.0) 6665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:27 smithi179 bash[23186]: audit 2024-09-21T01:14:27.047070+0000 mon.a (mon.0) 6666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:27 smithi179 bash[23186]: audit 2024-09-21T01:14:27.057617+0000 mon.a (mon.0) 6667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:27 smithi049 bash[23528]: audit 2024-09-21T01:14:25.711045+0000 mgr.a (mgr.14388) 7785 : audit [DBG] from='client.175377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:27 smithi049 bash[23528]: cluster 2024-09-21T01:14:26.019222+0000 mgr.a (mgr.14388) 7786 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:27 smithi049 bash[23528]: audit 2024-09-21T01:14:27.038468+0000 mon.a (mon.0) 6665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:27 smithi049 bash[23528]: audit 2024-09-21T01:14:27.047070+0000 mon.a (mon.0) 6666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:27 smithi049 bash[23528]: audit 2024-09-21T01:14:27.057617+0000 mon.a (mon.0) 6667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:29 smithi044 bash[22676]: cluster 2024-09-21T01:14:28.019760+0000 mgr.a (mgr.14388) 7787 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:14:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:29 smithi179 bash[23186]: cluster 2024-09-21T01:14:28.019760+0000 mgr.a (mgr.14388) 7787 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:14:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:29 smithi049 bash[23528]: cluster 2024-09-21T01:14:28.019760+0000 mgr.a (mgr.14388) 7787 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:14:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:31.151 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:31 smithi044 bash[22676]: cluster 2024-09-21T01:14:30.020493+0000 mgr.a (mgr.14388) 7788 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:14:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:31 smithi179 bash[23186]: cluster 2024-09-21T01:14:30.020493+0000 mgr.a (mgr.14388) 7788 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:14:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:31 smithi049 bash[23528]: cluster 2024-09-21T01:14:30.020493+0000 mgr.a (mgr.14388) 7788 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:14:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:33 smithi044 bash[22676]: audit 2024-09-21T01:14:31.483658+0000 mgr.a (mgr.14388) 7789 : audit [DBG] from='client.175455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:33 smithi044 bash[22676]: cluster 2024-09-21T01:14:32.023284+0000 mgr.a (mgr.14388) 7790 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:33 smithi179 bash[23186]: audit 2024-09-21T01:14:31.483658+0000 mgr.a (mgr.14388) 7789 : audit [DBG] from='client.175455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:33 smithi179 bash[23186]: cluster 2024-09-21T01:14:32.023284+0000 mgr.a (mgr.14388) 7790 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:33 smithi049 bash[23528]: audit 2024-09-21T01:14:31.483658+0000 mgr.a (mgr.14388) 7789 : audit [DBG] from='client.175455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:33 smithi049 bash[23528]: cluster 2024-09-21T01:14:32.023284+0000 mgr.a (mgr.14388) 7790 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:35 smithi044 bash[22676]: cluster 2024-09-21T01:14:34.024084+0000 mgr.a (mgr.14388) 7791 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:35 smithi179 bash[23186]: cluster 2024-09-21T01:14:34.024084+0000 mgr.a (mgr.14388) 7791 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:35 smithi049 bash[23528]: cluster 2024-09-21T01:14:34.024084+0000 mgr.a (mgr.14388) 7791 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:37.438 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:37 smithi049 bash[23528]: cluster 2024-09-21T01:14:36.026085+0000 mgr.a (mgr.14388) 7792 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:37 smithi044 bash[22676]: cluster 2024-09-21T01:14:36.026085+0000 mgr.a (mgr.14388) 7792 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:37 smithi179 bash[23186]: cluster 2024-09-21T01:14:36.026085+0000 mgr.a (mgr.14388) 7792 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:37.727 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:37.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:39 smithi044 bash[22676]: audit 2024-09-21T01:14:37.278569+0000 mgr.a (mgr.14388) 7793 : audit [DBG] from='client.175533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:39 smithi044 bash[22676]: cluster 2024-09-21T01:14:38.026958+0000 mgr.a (mgr.14388) 7794 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:39 smithi179 bash[23186]: audit 2024-09-21T01:14:37.278569+0000 mgr.a (mgr.14388) 7793 : audit [DBG] from='client.175533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:39 smithi179 bash[23186]: cluster 2024-09-21T01:14:38.026958+0000 mgr.a (mgr.14388) 7794 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:39 smithi049 bash[23528]: audit 2024-09-21T01:14:37.278569+0000 mgr.a (mgr.14388) 7793 : audit [DBG] from='client.175533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:39 smithi049 bash[23528]: cluster 2024-09-21T01:14:38.026958+0000 mgr.a (mgr.14388) 7794 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:41.359 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:41 smithi179 bash[23186]: cluster 2024-09-21T01:14:40.027738+0000 mgr.a (mgr.14388) 7795 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:41 smithi044 bash[22676]: cluster 2024-09-21T01:14:40.027738+0000 mgr.a (mgr.14388) 7795 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:41 smithi049 bash[23528]: cluster 2024-09-21T01:14:40.027738+0000 mgr.a (mgr.14388) 7795 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:42.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:42.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:43.209 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:43 smithi044 bash[22676]: cluster 2024-09-21T01:14:42.029508+0000 mgr.a (mgr.14388) 7796 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:43.481 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:43.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:43.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:43.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:43.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:43 smithi179 bash[23186]: cluster 2024-09-21T01:14:42.029508+0000 mgr.a (mgr.14388) 7796 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:43 smithi049 bash[23528]: cluster 2024-09-21T01:14:42.029508+0000 mgr.a (mgr.14388) 7796 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:44 smithi044 bash[22676]: audit 2024-09-21T01:14:43.073080+0000 mgr.a (mgr.14388) 7797 : audit [DBG] from='client.175611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:44 smithi044 bash[22676]: audit 2024-09-21T01:14:43.155731+0000 mon.a (mon.0) 6668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:44 smithi044 bash[22676]: audit 2024-09-21T01:14:43.161726+0000 mon.a (mon.0) 6669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:44 smithi044 bash[22676]: audit 2024-09-21T01:14:43.167061+0000 mon.a (mon.0) 6670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:44 smithi044 bash[22676]: audit 2024-09-21T01:14:44.007971+0000 mon.a (mon.0) 6671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:44 smithi044 bash[22676]: audit 2024-09-21T01:14:44.017483+0000 mon.a (mon.0) 6672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:44 smithi044 bash[22676]: audit 2024-09-21T01:14:44.029341+0000 mon.a (mon.0) 6673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:44 smithi179 bash[23186]: audit 2024-09-21T01:14:43.073080+0000 mgr.a (mgr.14388) 7797 : audit [DBG] from='client.175611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:44 smithi179 bash[23186]: audit 2024-09-21T01:14:43.155731+0000 mon.a (mon.0) 6668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:44 smithi179 bash[23186]: audit 2024-09-21T01:14:43.161726+0000 mon.a (mon.0) 6669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:44 smithi179 bash[23186]: audit 2024-09-21T01:14:43.167061+0000 mon.a (mon.0) 6670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:44 smithi179 bash[23186]: audit 2024-09-21T01:14:44.007971+0000 mon.a (mon.0) 6671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:44 smithi179 bash[23186]: audit 2024-09-21T01:14:44.017483+0000 mon.a (mon.0) 6672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:44 smithi179 bash[23186]: audit 2024-09-21T01:14:44.029341+0000 mon.a (mon.0) 6673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:44 smithi049 bash[23528]: audit 2024-09-21T01:14:43.073080+0000 mgr.a (mgr.14388) 7797 : audit [DBG] from='client.175611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:44 smithi049 bash[23528]: audit 2024-09-21T01:14:43.155731+0000 mon.a (mon.0) 6668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:44 smithi049 bash[23528]: audit 2024-09-21T01:14:43.161726+0000 mon.a (mon.0) 6669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:44 smithi049 bash[23528]: audit 2024-09-21T01:14:43.167061+0000 mon.a (mon.0) 6670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:44 smithi049 bash[23528]: audit 2024-09-21T01:14:44.007971+0000 mon.a (mon.0) 6671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:44 smithi049 bash[23528]: audit 2024-09-21T01:14:44.017483+0000 mon.a (mon.0) 6672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:44 smithi049 bash[23528]: audit 2024-09-21T01:14:44.029341+0000 mon.a (mon.0) 6673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:45 smithi044 bash[22676]: cluster 2024-09-21T01:14:44.030583+0000 mgr.a (mgr.14388) 7798 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:45 smithi179 bash[23186]: cluster 2024-09-21T01:14:44.030583+0000 mgr.a (mgr.14388) 7798 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:45 smithi049 bash[23528]: cluster 2024-09-21T01:14:44.030583+0000 mgr.a (mgr.14388) 7798 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22676]: cluster 2024-09-21T01:14:46.031773+0000 mgr.a (mgr.14388) 7799 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22676]: audit 2024-09-21T01:14:46.858276+0000 mon.a (mon.0) 6674 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:14:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22676]: audit 2024-09-21T01:14:46.865024+0000 mon.a (mon.0) 6675 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:14:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22676]: audit 2024-09-21T01:14:46.866967+0000 mon.a (mon.0) 6676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:14:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22676]: audit 2024-09-21T01:14:46.878311+0000 mon.a (mon.0) 6677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22676]: audit 2024-09-21T01:14:46.884620+0000 mon.a (mon.0) 6678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:47 smithi179 bash[23186]: cluster 2024-09-21T01:14:46.031773+0000 mgr.a (mgr.14388) 7799 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:47 smithi179 bash[23186]: audit 2024-09-21T01:14:46.858276+0000 mon.a (mon.0) 6674 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:47 smithi179 bash[23186]: audit 2024-09-21T01:14:46.865024+0000 mon.a (mon.0) 6675 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:47 smithi179 bash[23186]: audit 2024-09-21T01:14:46.866967+0000 mon.a (mon.0) 6676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:47 smithi179 bash[23186]: audit 2024-09-21T01:14:46.878311+0000 mon.a (mon.0) 6677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:47 smithi179 bash[23186]: audit 2024-09-21T01:14:46.884620+0000 mon.a (mon.0) 6678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:14:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:47 smithi049 bash[23528]: cluster 2024-09-21T01:14:46.031773+0000 mgr.a (mgr.14388) 7799 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:14:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:47 smithi049 bash[23528]: audit 2024-09-21T01:14:46.858276+0000 mon.a (mon.0) 6674 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:14:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:47 smithi049 bash[23528]: audit 2024-09-21T01:14:46.865024+0000 mon.a (mon.0) 6675 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:14:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:47 smithi049 bash[23528]: audit 2024-09-21T01:14:46.866967+0000 mon.a (mon.0) 6676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:14:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:47 smithi049 bash[23528]: audit 2024-09-21T01:14:46.878311+0000 mon.a (mon.0) 6677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:47 smithi049 bash[23528]: audit 2024-09-21T01:14:46.884620+0000 mon.a (mon.0) 6678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:14:47.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22930]: debug 2024-09-21T01:14:47.688+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:14:48.051 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:14:47 smithi044 bash[22930]: debug 2024-09-21T01:14:47.688+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:14:48.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:48.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:48.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:48 smithi179 bash[23186]: audit 2024-09-21T01:14:46.887017+0000 mgr.a (mgr.14388) 7800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:14:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:48 smithi179 bash[23186]: audit 2024-09-21T01:14:47.244586+0000 mon.a (mon.0) 6679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:48 smithi179 bash[23186]: audit 2024-09-21T01:14:47.258674+0000 mon.a (mon.0) 6680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:48 smithi179 bash[23186]: audit 2024-09-21T01:14:47.266739+0000 mon.a (mon.0) 6681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:48 smithi049 bash[23528]: audit 2024-09-21T01:14:46.887017+0000 mgr.a (mgr.14388) 7800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:14:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:48 smithi049 bash[23528]: audit 2024-09-21T01:14:47.244586+0000 mon.a (mon.0) 6679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:48 smithi049 bash[23528]: audit 2024-09-21T01:14:47.258674+0000 mon.a (mon.0) 6680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:48 smithi049 bash[23528]: audit 2024-09-21T01:14:47.266739+0000 mon.a (mon.0) 6681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.596 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:48 smithi044 bash[22676]: audit 2024-09-21T01:14:46.887017+0000 mgr.a (mgr.14388) 7800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:14:48.597 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:48 smithi044 bash[22676]: audit 2024-09-21T01:14:47.244586+0000 mon.a (mon.0) 6679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.597 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:48 smithi044 bash[22676]: audit 2024-09-21T01:14:47.258674+0000 mon.a (mon.0) 6680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:48.597 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:48 smithi044 bash[22676]: audit 2024-09-21T01:14:47.266739+0000 mon.a (mon.0) 6681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:14:49.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:49 smithi049 bash[23528]: audit 2024-09-21T01:14:47.690393+0000 mgr.a (mgr.14388) 7801 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:14:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:49 smithi049 bash[23528]: cephadm 2024-09-21T01:14:47.691751+0000 mgr.a (mgr.14388) 7802 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:14:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:49 smithi049 bash[23528]: cluster 2024-09-21T01:14:48.032656+0000 mgr.a (mgr.14388) 7803 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:49 smithi044 bash[22676]: audit 2024-09-21T01:14:47.690393+0000 mgr.a (mgr.14388) 7801 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:49 smithi044 bash[22676]: cephadm 2024-09-21T01:14:47.691751+0000 mgr.a (mgr.14388) 7802 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:14:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:49 smithi044 bash[22676]: cluster 2024-09-21T01:14:48.032656+0000 mgr.a (mgr.14388) 7803 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:49 smithi179 bash[23186]: audit 2024-09-21T01:14:47.690393+0000 mgr.a (mgr.14388) 7801 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:14:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:49 smithi179 bash[23186]: cephadm 2024-09-21T01:14:47.691751+0000 mgr.a (mgr.14388) 7802 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:14:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:49 smithi179 bash[23186]: cluster 2024-09-21T01:14:48.032656+0000 mgr.a (mgr.14388) 7803 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:50 smithi049 bash[23528]: audit 2024-09-21T01:14:48.819083+0000 mgr.a (mgr.14388) 7804 : audit [DBG] from='client.175797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:50 smithi044 bash[22676]: audit 2024-09-21T01:14:48.819083+0000 mgr.a (mgr.14388) 7804 : audit [DBG] from='client.175797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:50 smithi179 bash[23186]: audit 2024-09-21T01:14:48.819083+0000 mgr.a (mgr.14388) 7804 : audit [DBG] from='client.175797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:51 smithi049 bash[23528]: cluster 2024-09-21T01:14:50.033718+0000 mgr.a (mgr.14388) 7805 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:51 smithi044 bash[22676]: cluster 2024-09-21T01:14:50.033718+0000 mgr.a (mgr.14388) 7805 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:51 smithi179 bash[23186]: cluster 2024-09-21T01:14:50.033718+0000 mgr.a (mgr.14388) 7805 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:14:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:53 smithi049 bash[23528]: cluster 2024-09-21T01:14:52.036137+0000 mgr.a (mgr.14388) 7806 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:53 smithi044 bash[22676]: cluster 2024-09-21T01:14:52.036137+0000 mgr.a (mgr.14388) 7806 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:53 smithi179 bash[23186]: cluster 2024-09-21T01:14:52.036137+0000 mgr.a (mgr.14388) 7806 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:54.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:14:54.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:14:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:14:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:54 smithi044 bash[22676]: cluster 2024-09-21T01:14:54.036946+0000 mgr.a (mgr.14388) 7807 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:54 smithi179 bash[23186]: cluster 2024-09-21T01:14:54.036946+0000 mgr.a (mgr.14388) 7807 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:54 smithi049 bash[23528]: cluster 2024-09-21T01:14:54.036946+0000 mgr.a (mgr.14388) 7807 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:55.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:14:55.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:14:55.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:14:55.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:14:55.040 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:14:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:55 smithi049 bash[23528]: audit 2024-09-21T01:14:54.586403+0000 mgr.a (mgr.14388) 7808 : audit [DBG] from='client.175872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:55 smithi044 bash[22676]: audit 2024-09-21T01:14:54.586403+0000 mgr.a (mgr.14388) 7808 : audit [DBG] from='client.175872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:55 smithi179 bash[23186]: audit 2024-09-21T01:14:54.586403+0000 mgr.a (mgr.14388) 7808 : audit [DBG] from='client.175872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:56 smithi049 bash[23528]: cluster 2024-09-21T01:14:56.039403+0000 mgr.a (mgr.14388) 7809 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:56 smithi044 bash[22676]: cluster 2024-09-21T01:14:56.039403+0000 mgr.a (mgr.14388) 7809 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:56 smithi179 bash[23186]: cluster 2024-09-21T01:14:56.039403+0000 mgr.a (mgr.14388) 7809 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:14:59 smithi044 bash[22676]: cluster 2024-09-21T01:14:58.040236+0000 mgr.a (mgr.14388) 7810 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:14:59 smithi179 bash[23186]: cluster 2024-09-21T01:14:58.040236+0000 mgr.a (mgr.14388) 7810 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:14:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:14:59 smithi049 bash[23528]: cluster 2024-09-21T01:14:58.040236+0000 mgr.a (mgr.14388) 7810 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:15:00.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:00.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:00.043 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:00.800 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:00.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:00.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:00.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:00.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:01.405 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:01 smithi179 bash[23186]: cluster 2024-09-21T01:15:00.041048+0000 mgr.a (mgr.14388) 7811 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:15:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:01 smithi044 bash[22676]: cluster 2024-09-21T01:15:00.041048+0000 mgr.a (mgr.14388) 7811 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:15:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:01 smithi049 bash[23528]: cluster 2024-09-21T01:15:00.041048+0000 mgr.a (mgr.14388) 7811 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:15:02.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:02 smithi044 bash[22676]: audit 2024-09-21T01:15:00.376004+0000 mgr.a (mgr.14388) 7812 : audit [DBG] from='client.175950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:02 smithi179 bash[23186]: audit 2024-09-21T01:15:00.376004+0000 mgr.a (mgr.14388) 7812 : audit [DBG] from='client.175950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:02 smithi049 bash[23528]: audit 2024-09-21T01:15:00.376004+0000 mgr.a (mgr.14388) 7812 : audit [DBG] from='client.175950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:03.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:03 smithi044 bash[22676]: cluster 2024-09-21T01:15:02.044106+0000 mgr.a (mgr.14388) 7813 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:15:03.374 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:03 smithi179 bash[23186]: cluster 2024-09-21T01:15:02.044106+0000 mgr.a (mgr.14388) 7813 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:15:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:03 smithi049 bash[23528]: cluster 2024-09-21T01:15:02.044106+0000 mgr.a (mgr.14388) 7813 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:15:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:04 smithi044 bash[22676]: audit 2024-09-21T01:15:03.358933+0000 mon.a (mon.0) 6682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:04 smithi044 bash[22676]: audit 2024-09-21T01:15:03.366240+0000 mon.a (mon.0) 6683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:04 smithi044 bash[22676]: audit 2024-09-21T01:15:03.373666+0000 mon.a (mon.0) 6684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:04 smithi044 bash[22676]: cluster 2024-09-21T01:15:04.044917+0000 mgr.a (mgr.14388) 7814 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:04 smithi044 bash[22676]: audit 2024-09-21T01:15:04.227201+0000 mon.a (mon.0) 6685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:04 smithi044 bash[22676]: audit 2024-09-21T01:15:04.234491+0000 mon.a (mon.0) 6686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:04 smithi044 bash[22676]: audit 2024-09-21T01:15:04.242980+0000 mon.a (mon.0) 6687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:04 smithi179 bash[23186]: audit 2024-09-21T01:15:03.358933+0000 mon.a (mon.0) 6682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:04 smithi179 bash[23186]: audit 2024-09-21T01:15:03.366240+0000 mon.a (mon.0) 6683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:04 smithi179 bash[23186]: audit 2024-09-21T01:15:03.373666+0000 mon.a (mon.0) 6684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:04 smithi179 bash[23186]: cluster 2024-09-21T01:15:04.044917+0000 mgr.a (mgr.14388) 7814 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:04 smithi179 bash[23186]: audit 2024-09-21T01:15:04.227201+0000 mon.a (mon.0) 6685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:04 smithi179 bash[23186]: audit 2024-09-21T01:15:04.234491+0000 mon.a (mon.0) 6686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:04 smithi179 bash[23186]: audit 2024-09-21T01:15:04.242980+0000 mon.a (mon.0) 6687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:04 smithi049 bash[23528]: audit 2024-09-21T01:15:03.358933+0000 mon.a (mon.0) 6682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:04 smithi049 bash[23528]: audit 2024-09-21T01:15:03.366240+0000 mon.a (mon.0) 6683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:04 smithi049 bash[23528]: audit 2024-09-21T01:15:03.373666+0000 mon.a (mon.0) 6684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:04 smithi049 bash[23528]: cluster 2024-09-21T01:15:04.044917+0000 mgr.a (mgr.14388) 7814 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:04 smithi049 bash[23528]: audit 2024-09-21T01:15:04.227201+0000 mon.a (mon.0) 6685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:04 smithi049 bash[23528]: audit 2024-09-21T01:15:04.234491+0000 mon.a (mon.0) 6686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:04 smithi049 bash[23528]: audit 2024-09-21T01:15:04.242980+0000 mon.a (mon.0) 6687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:05.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:06.543 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:07 smithi044 bash[22676]: cluster 2024-09-21T01:15:06.046867+0000 mgr.a (mgr.14388) 7815 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:07 smithi044 bash[22676]: audit 2024-09-21T01:15:06.127299+0000 mgr.a (mgr.14388) 7816 : audit [DBG] from='client.176022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:07 smithi179 bash[23186]: cluster 2024-09-21T01:15:06.046867+0000 mgr.a (mgr.14388) 7815 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:07 smithi179 bash[23186]: audit 2024-09-21T01:15:06.127299+0000 mgr.a (mgr.14388) 7816 : audit [DBG] from='client.176022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:07.506 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:07 smithi049 bash[23528]: cluster 2024-09-21T01:15:06.046867+0000 mgr.a (mgr.14388) 7815 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:07.506 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:07 smithi049 bash[23528]: audit 2024-09-21T01:15:06.127299+0000 mgr.a (mgr.14388) 7816 : audit [DBG] from='client.176022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:08 smithi044 bash[22676]: audit 2024-09-21T01:15:07.482205+0000 mon.a (mon.0) 6688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:08 smithi044 bash[22676]: audit 2024-09-21T01:15:07.492281+0000 mon.a (mon.0) 6689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:08 smithi044 bash[22676]: audit 2024-09-21T01:15:07.504226+0000 mon.a (mon.0) 6690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:08 smithi044 bash[22676]: cluster 2024-09-21T01:15:08.047843+0000 mgr.a (mgr.14388) 7817 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:08 smithi179 bash[23186]: audit 2024-09-21T01:15:07.482205+0000 mon.a (mon.0) 6688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:08 smithi179 bash[23186]: audit 2024-09-21T01:15:07.492281+0000 mon.a (mon.0) 6689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:08 smithi179 bash[23186]: audit 2024-09-21T01:15:07.504226+0000 mon.a (mon.0) 6690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:08 smithi179 bash[23186]: cluster 2024-09-21T01:15:08.047843+0000 mgr.a (mgr.14388) 7817 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:08 smithi049 bash[23528]: audit 2024-09-21T01:15:07.482205+0000 mon.a (mon.0) 6688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:08 smithi049 bash[23528]: audit 2024-09-21T01:15:07.492281+0000 mon.a (mon.0) 6689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:08 smithi049 bash[23528]: audit 2024-09-21T01:15:07.504226+0000 mon.a (mon.0) 6690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:08 smithi049 bash[23528]: cluster 2024-09-21T01:15:08.047843+0000 mgr.a (mgr.14388) 7817 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:11 smithi044 bash[22676]: cluster 2024-09-21T01:15:10.048639+0000 mgr.a (mgr.14388) 7818 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:15:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:11 smithi179 bash[23186]: cluster 2024-09-21T01:15:10.048639+0000 mgr.a (mgr.14388) 7818 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:15:11.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:11.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:11 smithi049 bash[23528]: cluster 2024-09-21T01:15:10.048639+0000 mgr.a (mgr.14388) 7818 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:15:12.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:12.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:13 smithi044 bash[22676]: audit 2024-09-21T01:15:11.884170+0000 mgr.a (mgr.14388) 7819 : audit [DBG] from='client.176100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:13 smithi044 bash[22676]: cluster 2024-09-21T01:15:12.050033+0000 mgr.a (mgr.14388) 7820 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:13 smithi179 bash[23186]: audit 2024-09-21T01:15:11.884170+0000 mgr.a (mgr.14388) 7819 : audit [DBG] from='client.176100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:13 smithi179 bash[23186]: cluster 2024-09-21T01:15:12.050033+0000 mgr.a (mgr.14388) 7820 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:13 smithi049 bash[23528]: audit 2024-09-21T01:15:11.884170+0000 mgr.a (mgr.14388) 7819 : audit [DBG] from='client.176100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:13 smithi049 bash[23528]: cluster 2024-09-21T01:15:12.050033+0000 mgr.a (mgr.14388) 7820 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:15 smithi044 bash[22676]: cluster 2024-09-21T01:15:14.050924+0000 mgr.a (mgr.14388) 7821 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:15 smithi179 bash[23186]: cluster 2024-09-21T01:15:14.050924+0000 mgr.a (mgr.14388) 7821 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:15 smithi049 bash[23528]: cluster 2024-09-21T01:15:14.050924+0000 mgr.a (mgr.14388) 7821 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:17.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:17.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:17.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:17 smithi044 bash[22676]: cluster 2024-09-21T01:15:16.053184+0000 mgr.a (mgr.14388) 7822 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:17 smithi179 bash[23186]: cluster 2024-09-21T01:15:16.053184+0000 mgr.a (mgr.14388) 7822 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:17 smithi049 bash[23528]: cluster 2024-09-21T01:15:16.053184+0000 mgr.a (mgr.14388) 7822 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:18.096 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:18.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:18.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:18.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:18.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:19 smithi044 bash[22676]: audit 2024-09-21T01:15:17.664221+0000 mgr.a (mgr.14388) 7823 : audit [DBG] from='client.176175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:19 smithi044 bash[22676]: cluster 2024-09-21T01:15:18.053739+0000 mgr.a (mgr.14388) 7824 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:19 smithi179 bash[23186]: audit 2024-09-21T01:15:17.664221+0000 mgr.a (mgr.14388) 7823 : audit [DBG] from='client.176175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:19 smithi179 bash[23186]: cluster 2024-09-21T01:15:18.053739+0000 mgr.a (mgr.14388) 7824 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:19 smithi049 bash[23528]: audit 2024-09-21T01:15:17.664221+0000 mgr.a (mgr.14388) 7823 : audit [DBG] from='client.176175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:19 smithi049 bash[23528]: cluster 2024-09-21T01:15:18.053739+0000 mgr.a (mgr.14388) 7824 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:21 smithi044 bash[22676]: cluster 2024-09-21T01:15:20.054478+0000 mgr.a (mgr.14388) 7825 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:21 smithi179 bash[23186]: cluster 2024-09-21T01:15:20.054478+0000 mgr.a (mgr.14388) 7825 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:21 smithi049 bash[23528]: cluster 2024-09-21T01:15:20.054478+0000 mgr.a (mgr.14388) 7825 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:23.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:23.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:23.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:23.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:23 smithi044 bash[22676]: cluster 2024-09-21T01:15:22.056699+0000 mgr.a (mgr.14388) 7826 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:23 smithi179 bash[23186]: cluster 2024-09-21T01:15:22.056699+0000 mgr.a (mgr.14388) 7826 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:23 smithi049 bash[23528]: cluster 2024-09-21T01:15:22.056699+0000 mgr.a (mgr.14388) 7826 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:23.858 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: audit 2024-09-21T01:15:23.437056+0000 mgr.a (mgr.14388) 7827 : audit [DBG] from='client.176250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: audit 2024-09-21T01:15:23.510633+0000 mon.a (mon.0) 6691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: audit 2024-09-21T01:15:23.515296+0000 mon.a (mon.0) 6692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: audit 2024-09-21T01:15:23.522084+0000 mon.a (mon.0) 6693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: cluster 2024-09-21T01:15:24.057881+0000 mgr.a (mgr.14388) 7828 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: audit 2024-09-21T01:15:24.459383+0000 mon.a (mon.0) 6694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: audit 2024-09-21T01:15:24.467269+0000 mon.a (mon.0) 6695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:24 smithi044 bash[22676]: audit 2024-09-21T01:15:24.477500+0000 mon.a (mon.0) 6696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: audit 2024-09-21T01:15:23.437056+0000 mgr.a (mgr.14388) 7827 : audit [DBG] from='client.176250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: audit 2024-09-21T01:15:23.510633+0000 mon.a (mon.0) 6691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: audit 2024-09-21T01:15:23.515296+0000 mon.a (mon.0) 6692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: audit 2024-09-21T01:15:23.522084+0000 mon.a (mon.0) 6693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: cluster 2024-09-21T01:15:24.057881+0000 mgr.a (mgr.14388) 7828 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: audit 2024-09-21T01:15:24.459383+0000 mon.a (mon.0) 6694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: audit 2024-09-21T01:15:24.467269+0000 mon.a (mon.0) 6695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:24 smithi049 bash[23528]: audit 2024-09-21T01:15:24.477500+0000 mon.a (mon.0) 6696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: audit 2024-09-21T01:15:23.437056+0000 mgr.a (mgr.14388) 7827 : audit [DBG] from='client.176250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: audit 2024-09-21T01:15:23.510633+0000 mon.a (mon.0) 6691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: audit 2024-09-21T01:15:23.515296+0000 mon.a (mon.0) 6692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: audit 2024-09-21T01:15:23.522084+0000 mon.a (mon.0) 6693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: cluster 2024-09-21T01:15:24.057881+0000 mgr.a (mgr.14388) 7828 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: audit 2024-09-21T01:15:24.459383+0000 mon.a (mon.0) 6694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: audit 2024-09-21T01:15:24.467269+0000 mon.a (mon.0) 6695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:24 smithi179 bash[23186]: audit 2024-09-21T01:15:24.477500+0000 mon.a (mon.0) 6696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:27 smithi044 bash[22676]: cluster 2024-09-21T01:15:26.060267+0000 mgr.a (mgr.14388) 7829 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:27 smithi179 bash[23186]: cluster 2024-09-21T01:15:26.060267+0000 mgr.a (mgr.14388) 7829 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:27 smithi049 bash[23528]: cluster 2024-09-21T01:15:26.060267+0000 mgr.a (mgr.14388) 7829 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:28.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:28 smithi044 bash[22676]: audit 2024-09-21T01:15:27.715221+0000 mon.a (mon.0) 6697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:28 smithi044 bash[22676]: audit 2024-09-21T01:15:27.724052+0000 mon.a (mon.0) 6698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:28 smithi044 bash[22676]: audit 2024-09-21T01:15:27.734537+0000 mon.a (mon.0) 6699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:28 smithi044 bash[22676]: cluster 2024-09-21T01:15:28.061052+0000 mgr.a (mgr.14388) 7830 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:28 smithi179 bash[23186]: audit 2024-09-21T01:15:27.715221+0000 mon.a (mon.0) 6697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:28 smithi179 bash[23186]: audit 2024-09-21T01:15:27.724052+0000 mon.a (mon.0) 6698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:28 smithi179 bash[23186]: audit 2024-09-21T01:15:27.734537+0000 mon.a (mon.0) 6699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:28 smithi179 bash[23186]: cluster 2024-09-21T01:15:28.061052+0000 mgr.a (mgr.14388) 7830 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:28 smithi049 bash[23528]: audit 2024-09-21T01:15:27.715221+0000 mon.a (mon.0) 6697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:28 smithi049 bash[23528]: audit 2024-09-21T01:15:27.724052+0000 mon.a (mon.0) 6698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:28 smithi049 bash[23528]: audit 2024-09-21T01:15:27.734537+0000 mon.a (mon.0) 6699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:28 smithi049 bash[23528]: cluster 2024-09-21T01:15:28.061052+0000 mgr.a (mgr.14388) 7830 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:29.645 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:29 smithi044 bash[22676]: audit 2024-09-21T01:15:29.197187+0000 mgr.a (mgr.14388) 7831 : audit [DBG] from='client.176316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:29 smithi179 bash[23186]: audit 2024-09-21T01:15:29.197187+0000 mgr.a (mgr.14388) 7831 : audit [DBG] from='client.176316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:30.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:29 smithi049 bash[23528]: audit 2024-09-21T01:15:29.197187+0000 mgr.a (mgr.14388) 7831 : audit [DBG] from='client.176316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:30 smithi179 bash[23186]: cluster 2024-09-21T01:15:30.063427+0000 mgr.a (mgr.14388) 7832 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:30 smithi049 bash[23528]: cluster 2024-09-21T01:15:30.063427+0000 mgr.a (mgr.14388) 7832 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:30 smithi044 bash[22676]: cluster 2024-09-21T01:15:30.063427+0000 mgr.a (mgr.14388) 7832 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:33 smithi044 bash[22676]: cluster 2024-09-21T01:15:32.064231+0000 mgr.a (mgr.14388) 7833 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:33 smithi179 bash[23186]: cluster 2024-09-21T01:15:32.064231+0000 mgr.a (mgr.14388) 7833 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:33 smithi049 bash[23528]: cluster 2024-09-21T01:15:32.064231+0000 mgr.a (mgr.14388) 7833 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:15:34.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:34.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:34.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:35.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:35 smithi049 bash[23528]: cluster 2024-09-21T01:15:34.065158+0000 mgr.a (mgr.14388) 7834 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:35.429 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:35 smithi044 bash[22676]: cluster 2024-09-21T01:15:34.065158+0000 mgr.a (mgr.14388) 7834 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:35 smithi179 bash[23186]: cluster 2024-09-21T01:15:34.065158+0000 mgr.a (mgr.14388) 7834 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:36.378 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:36 smithi049 bash[23528]: audit 2024-09-21T01:15:34.982682+0000 mgr.a (mgr.14388) 7835 : audit [DBG] from='client.176394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:36 smithi044 bash[22676]: audit 2024-09-21T01:15:34.982682+0000 mgr.a (mgr.14388) 7835 : audit [DBG] from='client.176394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:36 smithi179 bash[23186]: audit 2024-09-21T01:15:34.982682+0000 mgr.a (mgr.14388) 7835 : audit [DBG] from='client.176394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:37 smithi044 bash[22676]: cluster 2024-09-21T01:15:36.068169+0000 mgr.a (mgr.14388) 7836 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:37 smithi179 bash[23186]: cluster 2024-09-21T01:15:36.068169+0000 mgr.a (mgr.14388) 7836 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:37 smithi049 bash[23528]: cluster 2024-09-21T01:15:36.068169+0000 mgr.a (mgr.14388) 7836 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:39 smithi049 bash[23528]: cluster 2024-09-21T01:15:38.068974+0000 mgr.a (mgr.14388) 7837 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:39 smithi044 bash[22676]: cluster 2024-09-21T01:15:38.068974+0000 mgr.a (mgr.14388) 7837 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:39 smithi179 bash[23186]: cluster 2024-09-21T01:15:38.068974+0000 mgr.a (mgr.14388) 7837 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:41.225 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:41.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:41.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:41.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:41.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:41 smithi044 bash[22676]: cluster 2024-09-21T01:15:40.070912+0000 mgr.a (mgr.14388) 7838 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:41 smithi179 bash[23186]: cluster 2024-09-21T01:15:40.070912+0000 mgr.a (mgr.14388) 7838 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:41 smithi049 bash[23528]: cluster 2024-09-21T01:15:40.070912+0000 mgr.a (mgr.14388) 7838 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:42.437 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:42 smithi044 bash[22676]: audit 2024-09-21T01:15:40.772370+0000 mgr.a (mgr.14388) 7839 : audit [DBG] from='client.176469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:42 smithi179 bash[23186]: audit 2024-09-21T01:15:40.772370+0000 mgr.a (mgr.14388) 7839 : audit [DBG] from='client.176469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:42 smithi049 bash[23528]: audit 2024-09-21T01:15:40.772370+0000 mgr.a (mgr.14388) 7839 : audit [DBG] from='client.176469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:43 smithi044 bash[22676]: cluster 2024-09-21T01:15:42.071897+0000 mgr.a (mgr.14388) 7840 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:43 smithi179 bash[23186]: cluster 2024-09-21T01:15:42.071897+0000 mgr.a (mgr.14388) 7840 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:43 smithi049 bash[23528]: cluster 2024-09-21T01:15:42.071897+0000 mgr.a (mgr.14388) 7840 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:15:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:44 smithi044 bash[22676]: audit 2024-09-21T01:15:43.679541+0000 mon.a (mon.0) 6700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:44 smithi044 bash[22676]: audit 2024-09-21T01:15:43.689168+0000 mon.a (mon.0) 6701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:44 smithi044 bash[22676]: audit 2024-09-21T01:15:43.698154+0000 mon.a (mon.0) 6702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:44 smithi044 bash[22676]: cluster 2024-09-21T01:15:44.072710+0000 mgr.a (mgr.14388) 7841 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:15:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:44 smithi179 bash[23186]: audit 2024-09-21T01:15:43.679541+0000 mon.a (mon.0) 6700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:44 smithi179 bash[23186]: audit 2024-09-21T01:15:43.689168+0000 mon.a (mon.0) 6701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:44 smithi179 bash[23186]: audit 2024-09-21T01:15:43.698154+0000 mon.a (mon.0) 6702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:44 smithi179 bash[23186]: cluster 2024-09-21T01:15:44.072710+0000 mgr.a (mgr.14388) 7841 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:15:45.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:44 smithi049 bash[23528]: audit 2024-09-21T01:15:43.679541+0000 mon.a (mon.0) 6700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:44 smithi049 bash[23528]: audit 2024-09-21T01:15:43.689168+0000 mon.a (mon.0) 6701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:44 smithi049 bash[23528]: audit 2024-09-21T01:15:43.698154+0000 mon.a (mon.0) 6702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:44 smithi049 bash[23528]: cluster 2024-09-21T01:15:44.072710+0000 mgr.a (mgr.14388) 7841 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:15:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:45 smithi044 bash[22676]: audit 2024-09-21T01:15:44.686919+0000 mon.a (mon.0) 6703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:45 smithi044 bash[22676]: audit 2024-09-21T01:15:44.693127+0000 mon.a (mon.0) 6704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:45 smithi044 bash[22676]: audit 2024-09-21T01:15:44.703995+0000 mon.a (mon.0) 6705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:45 smithi179 bash[23186]: audit 2024-09-21T01:15:44.686919+0000 mon.a (mon.0) 6703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:45 smithi179 bash[23186]: audit 2024-09-21T01:15:44.693127+0000 mon.a (mon.0) 6704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:45 smithi179 bash[23186]: audit 2024-09-21T01:15:44.703995+0000 mon.a (mon.0) 6705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:45 smithi049 bash[23528]: audit 2024-09-21T01:15:44.686919+0000 mon.a (mon.0) 6703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:45 smithi049 bash[23528]: audit 2024-09-21T01:15:44.693127+0000 mon.a (mon.0) 6704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:45 smithi049 bash[23528]: audit 2024-09-21T01:15:44.703995+0000 mon.a (mon.0) 6705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:46.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:46 smithi044 bash[22676]: cluster 2024-09-21T01:15:46.073937+0000 mgr.a (mgr.14388) 7842 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:46 smithi179 bash[23186]: cluster 2024-09-21T01:15:46.073937+0000 mgr.a (mgr.14388) 7842 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:47.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:46 smithi049 bash[23528]: cluster 2024-09-21T01:15:46.073937+0000 mgr.a (mgr.14388) 7842 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:47.955 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:47 smithi049 bash[23528]: audit 2024-09-21T01:15:46.564770+0000 mgr.a (mgr.14388) 7843 : audit [DBG] from='client.176547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:47 smithi044 bash[22676]: audit 2024-09-21T01:15:46.564770+0000 mgr.a (mgr.14388) 7843 : audit [DBG] from='client.176547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:47 smithi179 bash[23186]: audit 2024-09-21T01:15:46.564770+0000 mgr.a (mgr.14388) 7843 : audit [DBG] from='client.176547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22930]: debug 2024-09-21T01:15:48.595+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22930]: debug 2024-09-21T01:15:48.599+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.752024+0000 mon.a (mon.0) 6706 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.760206+0000 mon.a (mon.0) 6707 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.762255+0000 mon.a (mon.0) 6708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.775871+0000 mon.a (mon.0) 6709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.783848+0000 mon.a (mon.0) 6710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:15:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.787109+0000 mgr.a (mgr.14388) 7844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:15:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.943471+0000 mon.a (mon.0) 6711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.949617+0000 mon.a (mon.0) 6712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: audit 2024-09-21T01:15:47.954833+0000 mon.a (mon.0) 6713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:48 smithi044 bash[22676]: cluster 2024-09-21T01:15:48.074575+0000 mgr.a (mgr.14388) 7845 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.752024+0000 mon.a (mon.0) 6706 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.760206+0000 mon.a (mon.0) 6707 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.762255+0000 mon.a (mon.0) 6708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.775871+0000 mon.a (mon.0) 6709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.783848+0000 mon.a (mon.0) 6710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.787109+0000 mgr.a (mgr.14388) 7844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.943471+0000 mon.a (mon.0) 6711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.949617+0000 mon.a (mon.0) 6712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: audit 2024-09-21T01:15:47.954833+0000 mon.a (mon.0) 6713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:48 smithi179 bash[23186]: cluster 2024-09-21T01:15:48.074575+0000 mgr.a (mgr.14388) 7845 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.752024+0000 mon.a (mon.0) 6706 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.760206+0000 mon.a (mon.0) 6707 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.762255+0000 mon.a (mon.0) 6708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.775871+0000 mon.a (mon.0) 6709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.783848+0000 mon.a (mon.0) 6710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.787109+0000 mgr.a (mgr.14388) 7844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.943471+0000 mon.a (mon.0) 6711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.949617+0000 mon.a (mon.0) 6712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: audit 2024-09-21T01:15:47.954833+0000 mon.a (mon.0) 6713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:15:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:48 smithi049 bash[23528]: cluster 2024-09-21T01:15:48.074575+0000 mgr.a (mgr.14388) 7845 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:15:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:49 smithi044 bash[22676]: audit 2024-09-21T01:15:48.600926+0000 mgr.a (mgr.14388) 7846 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:15:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:49 smithi044 bash[22676]: cephadm 2024-09-21T01:15:48.602650+0000 mgr.a (mgr.14388) 7847 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:15:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:49 smithi179 bash[23186]: audit 2024-09-21T01:15:48.600926+0000 mgr.a (mgr.14388) 7846 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:15:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:49 smithi179 bash[23186]: cephadm 2024-09-21T01:15:48.602650+0000 mgr.a (mgr.14388) 7847 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:15:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:49 smithi049 bash[23528]: audit 2024-09-21T01:15:48.600926+0000 mgr.a (mgr.14388) 7846 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:15:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:49 smithi049 bash[23528]: cephadm 2024-09-21T01:15:48.602650+0000 mgr.a (mgr.14388) 7847 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:15:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:50 smithi044 bash[22676]: cluster 2024-09-21T01:15:50.076927+0000 mgr.a (mgr.14388) 7848 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T01:15:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:50 smithi179 bash[23186]: cluster 2024-09-21T01:15:50.076927+0000 mgr.a (mgr.14388) 7848 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T01:15:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:50 smithi049 bash[23528]: cluster 2024-09-21T01:15:50.076927+0000 mgr.a (mgr.14388) 7848 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T01:15:52.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:52.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:52.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:52.800 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:52.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:53 smithi044 bash[22676]: cluster 2024-09-21T01:15:52.077724+0000 mgr.a (mgr.14388) 7849 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:53 smithi179 bash[23186]: cluster 2024-09-21T01:15:52.077724+0000 mgr.a (mgr.14388) 7849 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:53 smithi049 bash[23528]: cluster 2024-09-21T01:15:52.077724+0000 mgr.a (mgr.14388) 7849 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:54 smithi044 bash[22676]: audit 2024-09-21T01:15:52.348870+0000 mgr.a (mgr.14388) 7850 : audit [DBG] from='client.176733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:54 smithi179 bash[23186]: audit 2024-09-21T01:15:52.348870+0000 mgr.a (mgr.14388) 7850 : audit [DBG] from='client.176733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:54 smithi049 bash[23528]: audit 2024-09-21T01:15:52.348870+0000 mgr.a (mgr.14388) 7850 : audit [DBG] from='client.176733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:55 smithi044 bash[22676]: cluster 2024-09-21T01:15:54.078708+0000 mgr.a (mgr.14388) 7851 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:55 smithi179 bash[23186]: cluster 2024-09-21T01:15:54.078708+0000 mgr.a (mgr.14388) 7851 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:55 smithi049 bash[23528]: cluster 2024-09-21T01:15:54.078708+0000 mgr.a (mgr.14388) 7851 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:57 smithi049 bash[23528]: cluster 2024-09-21T01:15:56.080941+0000 mgr.a (mgr.14388) 7852 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T01:15:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:57 smithi044 bash[22676]: cluster 2024-09-21T01:15:56.080941+0000 mgr.a (mgr.14388) 7852 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T01:15:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:57 smithi179 bash[23186]: cluster 2024-09-21T01:15:56.080941+0000 mgr.a (mgr.14388) 7852 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T01:15:57.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:15:57.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:15:57.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:15:58.551 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:15:58.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:15:58.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:15:58.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:15:58.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:15:59.461 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:59 smithi049 bash[23528]: cluster 2024-09-21T01:15:58.081669+0000 mgr.a (mgr.14388) 7853 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:59.462 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:15:59 smithi049 bash[23528]: audit 2024-09-21T01:15:58.134996+0000 mgr.a (mgr.14388) 7854 : audit [DBG] from='client.176808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:59 smithi044 bash[22676]: cluster 2024-09-21T01:15:58.081669+0000 mgr.a (mgr.14388) 7853 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:15:59 smithi044 bash[22676]: audit 2024-09-21T01:15:58.134996+0000 mgr.a (mgr.14388) 7854 : audit [DBG] from='client.176808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:59 smithi179 bash[23186]: cluster 2024-09-21T01:15:58.081669+0000 mgr.a (mgr.14388) 7853 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T01:15:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:15:59 smithi179 bash[23186]: audit 2024-09-21T01:15:58.134996+0000 mgr.a (mgr.14388) 7854 : audit [DBG] from='client.176808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:01 smithi044 bash[22676]: cluster 2024-09-21T01:16:00.084179+0000 mgr.a (mgr.14388) 7855 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 426 B/s wr, 89 op/s 2024-09-21T01:16:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:01 smithi179 bash[23186]: cluster 2024-09-21T01:16:00.084179+0000 mgr.a (mgr.14388) 7855 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 426 B/s wr, 89 op/s 2024-09-21T01:16:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:01 smithi049 bash[23528]: cluster 2024-09-21T01:16:00.084179+0000 mgr.a (mgr.14388) 7855 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 426 B/s wr, 89 op/s 2024-09-21T01:16:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:03 smithi179 bash[23186]: cluster 2024-09-21T01:16:02.085168+0000 mgr.a (mgr.14388) 7856 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-21T01:16:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:03 smithi044 bash[22676]: cluster 2024-09-21T01:16:02.085168+0000 mgr.a (mgr.14388) 7856 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-21T01:16:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:03 smithi049 bash[23528]: cluster 2024-09-21T01:16:02.085168+0000 mgr.a (mgr.14388) 7856 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-21T01:16:03.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:03.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:03.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:05.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: audit 2024-09-21T01:16:03.888512+0000 mon.a (mon.0) 6714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: audit 2024-09-21T01:16:03.894199+0000 mgr.a (mgr.14388) 7857 : audit [DBG] from='client.176883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:05.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: audit 2024-09-21T01:16:03.898175+0000 mon.a (mon.0) 6715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: audit 2024-09-21T01:16:03.915640+0000 mon.a (mon.0) 6716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: cluster 2024-09-21T01:16:04.085792+0000 mgr.a (mgr.14388) 7858 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-21T01:16:05.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: audit 2024-09-21T01:16:04.849423+0000 mon.a (mon.0) 6717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: audit 2024-09-21T01:16:04.857218+0000 mon.a (mon.0) 6718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:04 smithi044 bash[22676]: audit 2024-09-21T01:16:04.867146+0000 mon.a (mon.0) 6719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: audit 2024-09-21T01:16:03.888512+0000 mon.a (mon.0) 6714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: audit 2024-09-21T01:16:03.894199+0000 mgr.a (mgr.14388) 7857 : audit [DBG] from='client.176883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: audit 2024-09-21T01:16:03.898175+0000 mon.a (mon.0) 6715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: audit 2024-09-21T01:16:03.915640+0000 mon.a (mon.0) 6716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: cluster 2024-09-21T01:16:04.085792+0000 mgr.a (mgr.14388) 7858 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: audit 2024-09-21T01:16:04.849423+0000 mon.a (mon.0) 6717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: audit 2024-09-21T01:16:04.857218+0000 mon.a (mon.0) 6718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:04 smithi179 bash[23186]: audit 2024-09-21T01:16:04.867146+0000 mon.a (mon.0) 6719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: audit 2024-09-21T01:16:03.888512+0000 mon.a (mon.0) 6714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: audit 2024-09-21T01:16:03.894199+0000 mgr.a (mgr.14388) 7857 : audit [DBG] from='client.176883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: audit 2024-09-21T01:16:03.898175+0000 mon.a (mon.0) 6715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: audit 2024-09-21T01:16:03.915640+0000 mon.a (mon.0) 6716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: cluster 2024-09-21T01:16:04.085792+0000 mgr.a (mgr.14388) 7858 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-21T01:16:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: audit 2024-09-21T01:16:04.849423+0000 mon.a (mon.0) 6717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: audit 2024-09-21T01:16:04.857218+0000 mon.a (mon.0) 6718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:04 smithi049 bash[23528]: audit 2024-09-21T01:16:04.867146+0000 mon.a (mon.0) 6719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:07 smithi044 bash[22676]: cluster 2024-09-21T01:16:06.088201+0000 mgr.a (mgr.14388) 7859 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T01:16:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:07 smithi179 bash[23186]: cluster 2024-09-21T01:16:06.088201+0000 mgr.a (mgr.14388) 7859 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T01:16:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:07 smithi049 bash[23528]: cluster 2024-09-21T01:16:06.088201+0000 mgr.a (mgr.14388) 7859 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T01:16:09.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:09.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:09 smithi044 bash[22676]: cluster 2024-09-21T01:16:08.089180+0000 mgr.a (mgr.14388) 7860 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-21T01:16:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:09 smithi044 bash[22676]: audit 2024-09-21T01:16:08.169023+0000 mon.a (mon.0) 6720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:09 smithi044 bash[22676]: audit 2024-09-21T01:16:08.178147+0000 mon.a (mon.0) 6721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:09 smithi044 bash[22676]: audit 2024-09-21T01:16:08.189351+0000 mon.a (mon.0) 6722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:09 smithi179 bash[23186]: cluster 2024-09-21T01:16:08.089180+0000 mgr.a (mgr.14388) 7860 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-21T01:16:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:09 smithi179 bash[23186]: audit 2024-09-21T01:16:08.169023+0000 mon.a (mon.0) 6720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:09 smithi179 bash[23186]: audit 2024-09-21T01:16:08.178147+0000 mon.a (mon.0) 6721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:09 smithi179 bash[23186]: audit 2024-09-21T01:16:08.189351+0000 mon.a (mon.0) 6722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:09 smithi049 bash[23528]: cluster 2024-09-21T01:16:08.089180+0000 mgr.a (mgr.14388) 7860 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-21T01:16:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:09 smithi049 bash[23528]: audit 2024-09-21T01:16:08.169023+0000 mon.a (mon.0) 6720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:09 smithi049 bash[23528]: audit 2024-09-21T01:16:08.178147+0000 mon.a (mon.0) 6721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:09 smithi049 bash[23528]: audit 2024-09-21T01:16:08.189351+0000 mon.a (mon.0) 6722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:11 smithi044 bash[22676]: audit 2024-09-21T01:16:09.646615+0000 mgr.a (mgr.14388) 7861 : audit [DBG] from='client.176961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:11 smithi044 bash[22676]: cluster 2024-09-21T01:16:10.090657+0000 mgr.a (mgr.14388) 7862 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T01:16:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:11 smithi179 bash[23186]: audit 2024-09-21T01:16:09.646615+0000 mgr.a (mgr.14388) 7861 : audit [DBG] from='client.176961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:11 smithi179 bash[23186]: cluster 2024-09-21T01:16:10.090657+0000 mgr.a (mgr.14388) 7862 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T01:16:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:11 smithi049 bash[23528]: audit 2024-09-21T01:16:09.646615+0000 mgr.a (mgr.14388) 7861 : audit [DBG] from='client.176961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:11 smithi049 bash[23528]: cluster 2024-09-21T01:16:10.090657+0000 mgr.a (mgr.14388) 7862 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T01:16:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:13 smithi044 bash[22676]: cluster 2024-09-21T01:16:12.091587+0000 mgr.a (mgr.14388) 7863 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:13 smithi179 bash[23186]: cluster 2024-09-21T01:16:12.091587+0000 mgr.a (mgr.14388) 7863 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:13 smithi049 bash[23528]: cluster 2024-09-21T01:16:12.091587+0000 mgr.a (mgr.14388) 7863 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:15.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:15.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:15 smithi044 bash[22676]: cluster 2024-09-21T01:16:14.092536+0000 mgr.a (mgr.14388) 7864 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:15 smithi179 bash[23186]: cluster 2024-09-21T01:16:14.092536+0000 mgr.a (mgr.14388) 7864 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:15 smithi049 bash[23528]: cluster 2024-09-21T01:16:14.092536+0000 mgr.a (mgr.14388) 7864 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:15.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:17.367 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:17 smithi049 bash[23528]: audit 2024-09-21T01:16:15.412175+0000 mgr.a (mgr.14388) 7865 : audit [DBG] from='client.177036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:17.368 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:17 smithi049 bash[23528]: cluster 2024-09-21T01:16:16.095383+0000 mgr.a (mgr.14388) 7866 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:17 smithi044 bash[22676]: audit 2024-09-21T01:16:15.412175+0000 mgr.a (mgr.14388) 7865 : audit [DBG] from='client.177036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:17 smithi044 bash[22676]: cluster 2024-09-21T01:16:16.095383+0000 mgr.a (mgr.14388) 7866 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:17 smithi179 bash[23186]: audit 2024-09-21T01:16:15.412175+0000 mgr.a (mgr.14388) 7865 : audit [DBG] from='client.177036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:17 smithi179 bash[23186]: cluster 2024-09-21T01:16:16.095383+0000 mgr.a (mgr.14388) 7866 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:16:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:19 smithi049 bash[23528]: cluster 2024-09-21T01:16:18.096174+0000 mgr.a (mgr.14388) 7867 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:16:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:19 smithi044 bash[22676]: cluster 2024-09-21T01:16:18.096174+0000 mgr.a (mgr.14388) 7867 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:16:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:19 smithi179 bash[23186]: cluster 2024-09-21T01:16:18.096174+0000 mgr.a (mgr.14388) 7867 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:16:20.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:20.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:20.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:21 smithi044 bash[22676]: cluster 2024-09-21T01:16:20.098093+0000 mgr.a (mgr.14388) 7868 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:21 smithi179 bash[23186]: cluster 2024-09-21T01:16:20.098093+0000 mgr.a (mgr.14388) 7868 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:21 smithi049 bash[23528]: cluster 2024-09-21T01:16:20.098093+0000 mgr.a (mgr.14388) 7868 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:21.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:21.616 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:22 smithi044 bash[22676]: audit 2024-09-21T01:16:21.188012+0000 mgr.a (mgr.14388) 7869 : audit [DBG] from='client.177114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:22 smithi179 bash[23186]: audit 2024-09-21T01:16:21.188012+0000 mgr.a (mgr.14388) 7869 : audit [DBG] from='client.177114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:22 smithi049 bash[23528]: audit 2024-09-21T01:16:21.188012+0000 mgr.a (mgr.14388) 7869 : audit [DBG] from='client.177114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:23 smithi044 bash[22676]: cluster 2024-09-21T01:16:22.099091+0000 mgr.a (mgr.14388) 7870 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:16:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:23 smithi179 bash[23186]: cluster 2024-09-21T01:16:22.099091+0000 mgr.a (mgr.14388) 7870 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:16:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:23 smithi049 bash[23528]: cluster 2024-09-21T01:16:22.099091+0000 mgr.a (mgr.14388) 7870 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:16:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:25 smithi044 bash[22676]: audit 2024-09-21T01:16:24.091732+0000 mon.a (mon.0) 6723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:25 smithi044 bash[22676]: cluster 2024-09-21T01:16:24.099938+0000 mgr.a (mgr.14388) 7871 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:16:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:25 smithi044 bash[22676]: audit 2024-09-21T01:16:24.100295+0000 mon.a (mon.0) 6724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:25 smithi044 bash[22676]: audit 2024-09-21T01:16:24.110819+0000 mon.a (mon.0) 6725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:25 smithi044 bash[22676]: audit 2024-09-21T01:16:25.071075+0000 mon.a (mon.0) 6726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:25 smithi044 bash[22676]: audit 2024-09-21T01:16:25.078465+0000 mon.a (mon.0) 6727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:25 smithi179 bash[23186]: audit 2024-09-21T01:16:24.091732+0000 mon.a (mon.0) 6723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:25 smithi179 bash[23186]: cluster 2024-09-21T01:16:24.099938+0000 mgr.a (mgr.14388) 7871 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:16:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:25 smithi179 bash[23186]: audit 2024-09-21T01:16:24.100295+0000 mon.a (mon.0) 6724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:25 smithi179 bash[23186]: audit 2024-09-21T01:16:24.110819+0000 mon.a (mon.0) 6725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:25 smithi179 bash[23186]: audit 2024-09-21T01:16:25.071075+0000 mon.a (mon.0) 6726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:25 smithi179 bash[23186]: audit 2024-09-21T01:16:25.078465+0000 mon.a (mon.0) 6727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:25 smithi049 bash[23528]: audit 2024-09-21T01:16:24.091732+0000 mon.a (mon.0) 6723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:25 smithi049 bash[23528]: cluster 2024-09-21T01:16:24.099938+0000 mgr.a (mgr.14388) 7871 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:16:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:25 smithi049 bash[23528]: audit 2024-09-21T01:16:24.100295+0000 mon.a (mon.0) 6724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:25 smithi049 bash[23528]: audit 2024-09-21T01:16:24.110819+0000 mon.a (mon.0) 6725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:25 smithi049 bash[23528]: audit 2024-09-21T01:16:25.071075+0000 mon.a (mon.0) 6726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:25 smithi049 bash[23528]: audit 2024-09-21T01:16:25.078465+0000 mon.a (mon.0) 6727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:26 smithi044 bash[22676]: audit 2024-09-21T01:16:25.088341+0000 mon.a (mon.0) 6728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:26 smithi179 bash[23186]: audit 2024-09-21T01:16:25.088341+0000 mon.a (mon.0) 6728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:26 smithi049 bash[23528]: audit 2024-09-21T01:16:25.088341+0000 mon.a (mon.0) 6728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:26.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:26.618 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:26.618 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:27.392 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:27.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:27.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:27.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:27.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:27 smithi044 bash[22676]: cluster 2024-09-21T01:16:26.102212+0000 mgr.a (mgr.14388) 7872 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:16:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:27 smithi179 bash[23186]: cluster 2024-09-21T01:16:26.102212+0000 mgr.a (mgr.14388) 7872 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:16:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:27 smithi049 bash[23528]: cluster 2024-09-21T01:16:26.102212+0000 mgr.a (mgr.14388) 7872 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:16:28.425 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:28 smithi049 bash[23528]: audit 2024-09-21T01:16:26.959656+0000 mgr.a (mgr.14388) 7873 : audit [DBG] from='client.177192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:28 smithi044 bash[22676]: audit 2024-09-21T01:16:26.959656+0000 mgr.a (mgr.14388) 7873 : audit [DBG] from='client.177192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:28 smithi179 bash[23186]: audit 2024-09-21T01:16:26.959656+0000 mgr.a (mgr.14388) 7873 : audit [DBG] from='client.177192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:29 smithi044 bash[22676]: cluster 2024-09-21T01:16:28.103372+0000 mgr.a (mgr.14388) 7874 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:29 smithi044 bash[22676]: audit 2024-09-21T01:16:28.403867+0000 mon.a (mon.0) 6729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:29 smithi044 bash[22676]: audit 2024-09-21T01:16:28.412986+0000 mon.a (mon.0) 6730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:29 smithi044 bash[22676]: audit 2024-09-21T01:16:28.423471+0000 mon.a (mon.0) 6731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:29 smithi179 bash[23186]: cluster 2024-09-21T01:16:28.103372+0000 mgr.a (mgr.14388) 7874 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:29 smithi179 bash[23186]: audit 2024-09-21T01:16:28.403867+0000 mon.a (mon.0) 6729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:29 smithi179 bash[23186]: audit 2024-09-21T01:16:28.412986+0000 mon.a (mon.0) 6730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:29 smithi179 bash[23186]: audit 2024-09-21T01:16:28.423471+0000 mon.a (mon.0) 6731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:29 smithi049 bash[23528]: cluster 2024-09-21T01:16:28.103372+0000 mgr.a (mgr.14388) 7874 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:29 smithi049 bash[23528]: audit 2024-09-21T01:16:28.403867+0000 mon.a (mon.0) 6729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:29 smithi049 bash[23528]: audit 2024-09-21T01:16:28.412986+0000 mon.a (mon.0) 6730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:29 smithi049 bash[23528]: audit 2024-09-21T01:16:28.423471+0000 mon.a (mon.0) 6731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:31 smithi044 bash[22676]: cluster 2024-09-21T01:16:30.105632+0000 mgr.a (mgr.14388) 7875 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:31 smithi179 bash[23186]: cluster 2024-09-21T01:16:30.105632+0000 mgr.a (mgr.14388) 7875 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:31 smithi049 bash[23528]: cluster 2024-09-21T01:16:30.105632+0000 mgr.a (mgr.14388) 7875 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:32.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:32.395 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:32.395 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:33.150 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:33 smithi044 bash[22676]: cluster 2024-09-21T01:16:32.106414+0000 mgr.a (mgr.14388) 7876 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:33 smithi179 bash[23186]: cluster 2024-09-21T01:16:32.106414+0000 mgr.a (mgr.14388) 7876 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:33 smithi049 bash[23528]: cluster 2024-09-21T01:16:32.106414+0000 mgr.a (mgr.14388) 7876 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:34 smithi044 bash[22676]: audit 2024-09-21T01:16:32.726913+0000 mgr.a (mgr.14388) 7877 : audit [DBG] from='client.177267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:34 smithi179 bash[23186]: audit 2024-09-21T01:16:32.726913+0000 mgr.a (mgr.14388) 7877 : audit [DBG] from='client.177267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:34 smithi049 bash[23528]: audit 2024-09-21T01:16:32.726913+0000 mgr.a (mgr.14388) 7877 : audit [DBG] from='client.177267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:35 smithi044 bash[22676]: cluster 2024-09-21T01:16:34.107388+0000 mgr.a (mgr.14388) 7878 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:35 smithi179 bash[23186]: cluster 2024-09-21T01:16:34.107388+0000 mgr.a (mgr.14388) 7878 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:35 smithi049 bash[23528]: cluster 2024-09-21T01:16:34.107388+0000 mgr.a (mgr.14388) 7878 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:37.396 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:37 smithi049 bash[23528]: cluster 2024-09-21T01:16:36.109621+0000 mgr.a (mgr.14388) 7879 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:37 smithi044 bash[22676]: cluster 2024-09-21T01:16:36.109621+0000 mgr.a (mgr.14388) 7879 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:37 smithi179 bash[23186]: cluster 2024-09-21T01:16:36.109621+0000 mgr.a (mgr.14388) 7879 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:38.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:38.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:38.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:38.905 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:38.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:38.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:38.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:38.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:39 smithi044 bash[22676]: cluster 2024-09-21T01:16:38.110391+0000 mgr.a (mgr.14388) 7880 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:39 smithi179 bash[23186]: cluster 2024-09-21T01:16:38.110391+0000 mgr.a (mgr.14388) 7880 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:39 smithi049 bash[23528]: cluster 2024-09-21T01:16:38.110391+0000 mgr.a (mgr.14388) 7880 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:40 smithi044 bash[22676]: audit 2024-09-21T01:16:38.483879+0000 mgr.a (mgr.14388) 7881 : audit [DBG] from='client.177342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:40 smithi179 bash[23186]: audit 2024-09-21T01:16:38.483879+0000 mgr.a (mgr.14388) 7881 : audit [DBG] from='client.177342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:40 smithi049 bash[23528]: audit 2024-09-21T01:16:38.483879+0000 mgr.a (mgr.14388) 7881 : audit [DBG] from='client.177342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:41 smithi044 bash[22676]: cluster 2024-09-21T01:16:40.112627+0000 mgr.a (mgr.14388) 7882 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:41 smithi179 bash[23186]: cluster 2024-09-21T01:16:40.112627+0000 mgr.a (mgr.14388) 7882 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:41 smithi049 bash[23528]: cluster 2024-09-21T01:16:40.112627+0000 mgr.a (mgr.14388) 7882 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:43.474 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:43 smithi044 bash[22676]: cluster 2024-09-21T01:16:42.113441+0000 mgr.a (mgr.14388) 7883 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:43 smithi179 bash[23186]: cluster 2024-09-21T01:16:42.113441+0000 mgr.a (mgr.14388) 7883 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:43 smithi049 bash[23528]: cluster 2024-09-21T01:16:42.113441+0000 mgr.a (mgr.14388) 7883 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:43.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:44.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:44.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:44.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:44.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:45 smithi044 bash[22676]: cluster 2024-09-21T01:16:44.114172+0000 mgr.a (mgr.14388) 7884 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:45 smithi044 bash[22676]: audit 2024-09-21T01:16:44.240842+0000 mgr.a (mgr.14388) 7885 : audit [DBG] from='client.177420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:45 smithi044 bash[22676]: audit 2024-09-21T01:16:44.267228+0000 mon.a (mon.0) 6732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:45 smithi044 bash[22676]: audit 2024-09-21T01:16:44.273875+0000 mon.a (mon.0) 6733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:45 smithi044 bash[22676]: audit 2024-09-21T01:16:44.279417+0000 mon.a (mon.0) 6734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:45 smithi044 bash[22676]: audit 2024-09-21T01:16:45.256772+0000 mon.a (mon.0) 6735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:45 smithi044 bash[22676]: audit 2024-09-21T01:16:45.262501+0000 mon.a (mon.0) 6736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:45 smithi049 bash[23528]: cluster 2024-09-21T01:16:44.114172+0000 mgr.a (mgr.14388) 7884 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:45 smithi049 bash[23528]: audit 2024-09-21T01:16:44.240842+0000 mgr.a (mgr.14388) 7885 : audit [DBG] from='client.177420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:45 smithi049 bash[23528]: audit 2024-09-21T01:16:44.267228+0000 mon.a (mon.0) 6732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:45 smithi049 bash[23528]: audit 2024-09-21T01:16:44.273875+0000 mon.a (mon.0) 6733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:45 smithi049 bash[23528]: audit 2024-09-21T01:16:44.279417+0000 mon.a (mon.0) 6734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:45 smithi049 bash[23528]: audit 2024-09-21T01:16:45.256772+0000 mon.a (mon.0) 6735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:45 smithi049 bash[23528]: audit 2024-09-21T01:16:45.262501+0000 mon.a (mon.0) 6736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:45 smithi179 bash[23186]: cluster 2024-09-21T01:16:44.114172+0000 mgr.a (mgr.14388) 7884 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:45 smithi179 bash[23186]: audit 2024-09-21T01:16:44.240842+0000 mgr.a (mgr.14388) 7885 : audit [DBG] from='client.177420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:45 smithi179 bash[23186]: audit 2024-09-21T01:16:44.267228+0000 mon.a (mon.0) 6732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:45 smithi179 bash[23186]: audit 2024-09-21T01:16:44.273875+0000 mon.a (mon.0) 6733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:45 smithi179 bash[23186]: audit 2024-09-21T01:16:44.279417+0000 mon.a (mon.0) 6734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:45 smithi179 bash[23186]: audit 2024-09-21T01:16:45.256772+0000 mon.a (mon.0) 6735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:45 smithi179 bash[23186]: audit 2024-09-21T01:16:45.262501+0000 mon.a (mon.0) 6736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:46 smithi049 bash[23528]: audit 2024-09-21T01:16:45.269129+0000 mon.a (mon.0) 6737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:46 smithi044 bash[22676]: audit 2024-09-21T01:16:45.269129+0000 mon.a (mon.0) 6737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:46 smithi179 bash[23186]: audit 2024-09-21T01:16:45.269129+0000 mon.a (mon.0) 6737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:47 smithi049 bash[23528]: cluster 2024-09-21T01:16:46.116521+0000 mgr.a (mgr.14388) 7886 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:47 smithi044 bash[22676]: cluster 2024-09-21T01:16:46.116521+0000 mgr.a (mgr.14388) 7886 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:47 smithi179 bash[23186]: cluster 2024-09-21T01:16:46.116521+0000 mgr.a (mgr.14388) 7886 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: cluster 2024-09-21T01:16:48.117454+0000 mgr.a (mgr.14388) 7887 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.636996+0000 mon.a (mon.0) 6738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.645801+0000 mon.a (mon.0) 6739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.656057+0000 mon.a (mon.0) 6740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.661811+0000 mon.a (mon.0) 6741 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.667257+0000 mon.a (mon.0) 6742 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.669025+0000 mon.a (mon.0) 6743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.679863+0000 mon.a (mon.0) 6744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:49 smithi049 bash[23528]: audit 2024-09-21T01:16:48.685955+0000 mon.a (mon.0) 6745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:16:49.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:49.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:49.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22930]: debug 2024-09-21T01:16:49.470+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22930]: debug 2024-09-21T01:16:49.474+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: cluster 2024-09-21T01:16:48.117454+0000 mgr.a (mgr.14388) 7887 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.636996+0000 mon.a (mon.0) 6738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.645801+0000 mon.a (mon.0) 6739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.656057+0000 mon.a (mon.0) 6740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.661811+0000 mon.a (mon.0) 6741 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.667257+0000 mon.a (mon.0) 6742 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:16:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.669025+0000 mon.a (mon.0) 6743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:16:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.679863+0000 mon.a (mon.0) 6744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:49 smithi044 bash[22676]: audit 2024-09-21T01:16:48.685955+0000 mon.a (mon.0) 6745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: cluster 2024-09-21T01:16:48.117454+0000 mgr.a (mgr.14388) 7887 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.636996+0000 mon.a (mon.0) 6738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.645801+0000 mon.a (mon.0) 6739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.656057+0000 mon.a (mon.0) 6740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.661811+0000 mon.a (mon.0) 6741 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.667257+0000 mon.a (mon.0) 6742 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.669025+0000 mon.a (mon.0) 6743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.679863+0000 mon.a (mon.0) 6744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:16:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:49 smithi179 bash[23186]: audit 2024-09-21T01:16:48.685955+0000 mon.a (mon.0) 6745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:16:50.414 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:50.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:50.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:50.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:50.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:50.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:50 smithi049 bash[23528]: audit 2024-09-21T01:16:48.688332+0000 mgr.a (mgr.14388) 7888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:16:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:50 smithi044 bash[22676]: audit 2024-09-21T01:16:48.688332+0000 mgr.a (mgr.14388) 7888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:16:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:50 smithi179 bash[23186]: audit 2024-09-21T01:16:48.688332+0000 mgr.a (mgr.14388) 7888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:16:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:51 smithi049 bash[23528]: audit 2024-09-21T01:16:49.476458+0000 mgr.a (mgr.14388) 7889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:16:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:51 smithi049 bash[23528]: cephadm 2024-09-21T01:16:49.478169+0000 mgr.a (mgr.14388) 7890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:16:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:51 smithi049 bash[23528]: audit 2024-09-21T01:16:49.979961+0000 mgr.a (mgr.14388) 7891 : audit [DBG] from='client.177606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:51 smithi049 bash[23528]: cluster 2024-09-21T01:16:50.119429+0000 mgr.a (mgr.14388) 7892 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:16:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:51 smithi044 bash[22676]: audit 2024-09-21T01:16:49.476458+0000 mgr.a (mgr.14388) 7889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:16:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:51 smithi044 bash[22676]: cephadm 2024-09-21T01:16:49.478169+0000 mgr.a (mgr.14388) 7890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:16:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:51 smithi044 bash[22676]: audit 2024-09-21T01:16:49.979961+0000 mgr.a (mgr.14388) 7891 : audit [DBG] from='client.177606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:51 smithi044 bash[22676]: cluster 2024-09-21T01:16:50.119429+0000 mgr.a (mgr.14388) 7892 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:16:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:51 smithi179 bash[23186]: audit 2024-09-21T01:16:49.476458+0000 mgr.a (mgr.14388) 7889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:16:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:51 smithi179 bash[23186]: cephadm 2024-09-21T01:16:49.478169+0000 mgr.a (mgr.14388) 7890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:16:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:51 smithi179 bash[23186]: audit 2024-09-21T01:16:49.979961+0000 mgr.a (mgr.14388) 7891 : audit [DBG] from='client.177606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:51 smithi179 bash[23186]: cluster 2024-09-21T01:16:50.119429+0000 mgr.a (mgr.14388) 7892 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:16:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:53 smithi044 bash[22676]: cluster 2024-09-21T01:16:52.120380+0000 mgr.a (mgr.14388) 7893 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:53 smithi179 bash[23186]: cluster 2024-09-21T01:16:52.120380+0000 mgr.a (mgr.14388) 7893 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:53 smithi049 bash[23528]: cluster 2024-09-21T01:16:52.120380+0000 mgr.a (mgr.14388) 7893 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:55.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:16:55.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:16:55.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:16:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:55 smithi044 bash[22676]: cluster 2024-09-21T01:16:54.121162+0000 mgr.a (mgr.14388) 7894 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:55 smithi179 bash[23186]: cluster 2024-09-21T01:16:54.121162+0000 mgr.a (mgr.14388) 7894 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:55 smithi049 bash[23528]: cluster 2024-09-21T01:16:54.121162+0000 mgr.a (mgr.14388) 7894 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:56.187 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:16:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:16:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:16:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:16:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:16:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:56 smithi044 bash[22676]: audit 2024-09-21T01:16:55.757063+0000 mgr.a (mgr.14388) 7895 : audit [DBG] from='client.177684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:56 smithi044 bash[22676]: cluster 2024-09-21T01:16:56.123794+0000 mgr.a (mgr.14388) 7896 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:16:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:56 smithi179 bash[23186]: audit 2024-09-21T01:16:55.757063+0000 mgr.a (mgr.14388) 7895 : audit [DBG] from='client.177684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:56 smithi179 bash[23186]: cluster 2024-09-21T01:16:56.123794+0000 mgr.a (mgr.14388) 7896 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:16:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:56 smithi049 bash[23528]: audit 2024-09-21T01:16:55.757063+0000 mgr.a (mgr.14388) 7895 : audit [DBG] from='client.177684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:16:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:56 smithi049 bash[23528]: cluster 2024-09-21T01:16:56.123794+0000 mgr.a (mgr.14388) 7896 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:16:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:16:59 smithi044 bash[22676]: cluster 2024-09-21T01:16:58.124637+0000 mgr.a (mgr.14388) 7897 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:16:59 smithi179 bash[23186]: cluster 2024-09-21T01:16:58.124637+0000 mgr.a (mgr.14388) 7897 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:16:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:16:59 smithi049 bash[23528]: cluster 2024-09-21T01:16:58.124637+0000 mgr.a (mgr.14388) 7897 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:17:01.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:01.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:01.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:01 smithi044 bash[22676]: cluster 2024-09-21T01:17:00.126613+0000 mgr.a (mgr.14388) 7898 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:01 smithi179 bash[23186]: cluster 2024-09-21T01:17:00.126613+0000 mgr.a (mgr.14388) 7898 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:01 smithi049 bash[23528]: cluster 2024-09-21T01:17:00.126613+0000 mgr.a (mgr.14388) 7898 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:01.976 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:03 smithi044 bash[22676]: audit 2024-09-21T01:17:01.529510+0000 mgr.a (mgr.14388) 7899 : audit [DBG] from='client.177762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:03 smithi044 bash[22676]: cluster 2024-09-21T01:17:02.127608+0000 mgr.a (mgr.14388) 7900 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:03 smithi179 bash[23186]: audit 2024-09-21T01:17:01.529510+0000 mgr.a (mgr.14388) 7899 : audit [DBG] from='client.177762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:03 smithi179 bash[23186]: cluster 2024-09-21T01:17:02.127608+0000 mgr.a (mgr.14388) 7900 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:03 smithi049 bash[23528]: audit 2024-09-21T01:17:01.529510+0000 mgr.a (mgr.14388) 7899 : audit [DBG] from='client.177762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:03.704 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:03 smithi049 bash[23528]: cluster 2024-09-21T01:17:02.127608+0000 mgr.a (mgr.14388) 7900 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:05.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:05 smithi044 bash[22676]: cluster 2024-09-21T01:17:04.128269+0000 mgr.a (mgr.14388) 7901 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:05.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:05 smithi044 bash[22676]: audit 2024-09-21T01:17:04.448759+0000 mon.a (mon.0) 6746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:05 smithi044 bash[22676]: audit 2024-09-21T01:17:04.457727+0000 mon.a (mon.0) 6747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:05 smithi044 bash[22676]: audit 2024-09-21T01:17:04.468164+0000 mon.a (mon.0) 6748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:05 smithi179 bash[23186]: cluster 2024-09-21T01:17:04.128269+0000 mgr.a (mgr.14388) 7901 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:05 smithi179 bash[23186]: audit 2024-09-21T01:17:04.448759+0000 mon.a (mon.0) 6746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:05 smithi179 bash[23186]: audit 2024-09-21T01:17:04.457727+0000 mon.a (mon.0) 6747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:05 smithi179 bash[23186]: audit 2024-09-21T01:17:04.468164+0000 mon.a (mon.0) 6748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:05 smithi049 bash[23528]: cluster 2024-09-21T01:17:04.128269+0000 mgr.a (mgr.14388) 7901 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:05 smithi049 bash[23528]: audit 2024-09-21T01:17:04.448759+0000 mon.a (mon.0) 6746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:05 smithi049 bash[23528]: audit 2024-09-21T01:17:04.457727+0000 mon.a (mon.0) 6747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:05 smithi049 bash[23528]: audit 2024-09-21T01:17:04.468164+0000 mon.a (mon.0) 6748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:06 smithi044 bash[22676]: audit 2024-09-21T01:17:05.436494+0000 mon.a (mon.0) 6749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:06 smithi044 bash[22676]: audit 2024-09-21T01:17:05.441541+0000 mon.a (mon.0) 6750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:06 smithi044 bash[22676]: audit 2024-09-21T01:17:05.447472+0000 mon.a (mon.0) 6751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:06 smithi044 bash[22676]: cluster 2024-09-21T01:17:06.130591+0000 mgr.a (mgr.14388) 7902 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:06 smithi179 bash[23186]: audit 2024-09-21T01:17:05.436494+0000 mon.a (mon.0) 6749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:06 smithi179 bash[23186]: audit 2024-09-21T01:17:05.441541+0000 mon.a (mon.0) 6750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:06 smithi179 bash[23186]: audit 2024-09-21T01:17:05.447472+0000 mon.a (mon.0) 6751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:06 smithi179 bash[23186]: cluster 2024-09-21T01:17:06.130591+0000 mgr.a (mgr.14388) 7902 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:06 smithi049 bash[23528]: audit 2024-09-21T01:17:05.436494+0000 mon.a (mon.0) 6749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:06 smithi049 bash[23528]: audit 2024-09-21T01:17:05.441541+0000 mon.a (mon.0) 6750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:06 smithi049 bash[23528]: audit 2024-09-21T01:17:05.447472+0000 mon.a (mon.0) 6751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:06 smithi049 bash[23528]: cluster 2024-09-21T01:17:06.130591+0000 mgr.a (mgr.14388) 7902 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:06.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:07 smithi044 bash[22676]: audit 2024-09-21T01:17:07.307560+0000 mgr.a (mgr.14388) 7903 : audit [DBG] from='client.177837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:07.745 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:07.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:07.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:07.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:07.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:07 smithi179 bash[23186]: audit 2024-09-21T01:17:07.307560+0000 mgr.a (mgr.14388) 7903 : audit [DBG] from='client.177837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:07 smithi049 bash[23528]: audit 2024-09-21T01:17:07.307560+0000 mgr.a (mgr.14388) 7903 : audit [DBG] from='client.177837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:08 smithi044 bash[22676]: cluster 2024-09-21T01:17:08.131589+0000 mgr.a (mgr.14388) 7904 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:08.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:08 smithi179 bash[23186]: cluster 2024-09-21T01:17:08.131589+0000 mgr.a (mgr.14388) 7904 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:08 smithi049 bash[23528]: cluster 2024-09-21T01:17:08.131589+0000 mgr.a (mgr.14388) 7904 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:09 smithi044 bash[22676]: audit 2024-09-21T01:17:08.870682+0000 mon.a (mon.0) 6752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:09 smithi044 bash[22676]: audit 2024-09-21T01:17:08.880461+0000 mon.a (mon.0) 6753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:09 smithi044 bash[22676]: audit 2024-09-21T01:17:08.891067+0000 mon.a (mon.0) 6754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:09 smithi179 bash[23186]: audit 2024-09-21T01:17:08.870682+0000 mon.a (mon.0) 6752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:09 smithi179 bash[23186]: audit 2024-09-21T01:17:08.880461+0000 mon.a (mon.0) 6753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:09 smithi179 bash[23186]: audit 2024-09-21T01:17:08.891067+0000 mon.a (mon.0) 6754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:09 smithi049 bash[23528]: audit 2024-09-21T01:17:08.870682+0000 mon.a (mon.0) 6752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:09 smithi049 bash[23528]: audit 2024-09-21T01:17:08.880461+0000 mon.a (mon.0) 6753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:09 smithi049 bash[23528]: audit 2024-09-21T01:17:08.891067+0000 mon.a (mon.0) 6754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:10 smithi044 bash[22676]: cluster 2024-09-21T01:17:10.133825+0000 mgr.a (mgr.14388) 7905 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:10 smithi179 bash[23186]: cluster 2024-09-21T01:17:10.133825+0000 mgr.a (mgr.14388) 7905 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:11.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:10 smithi049 bash[23528]: cluster 2024-09-21T01:17:10.133825+0000 mgr.a (mgr.14388) 7905 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:12.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:13 smithi044 bash[22676]: cluster 2024-09-21T01:17:12.134610+0000 mgr.a (mgr.14388) 7906 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:13 smithi179 bash[23186]: cluster 2024-09-21T01:17:12.134610+0000 mgr.a (mgr.14388) 7906 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:13.507 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:13.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:13.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:13.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:13.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:13 smithi049 bash[23528]: cluster 2024-09-21T01:17:12.134610+0000 mgr.a (mgr.14388) 7906 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:14 smithi044 bash[22676]: audit 2024-09-21T01:17:13.074600+0000 mgr.a (mgr.14388) 7907 : audit [DBG] from='client.177915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:14 smithi179 bash[23186]: audit 2024-09-21T01:17:13.074600+0000 mgr.a (mgr.14388) 7907 : audit [DBG] from='client.177915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:14 smithi049 bash[23528]: audit 2024-09-21T01:17:13.074600+0000 mgr.a (mgr.14388) 7907 : audit [DBG] from='client.177915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:15 smithi044 bash[22676]: cluster 2024-09-21T01:17:14.135655+0000 mgr.a (mgr.14388) 7908 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:15 smithi179 bash[23186]: cluster 2024-09-21T01:17:14.135655+0000 mgr.a (mgr.14388) 7908 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:15 smithi049 bash[23528]: cluster 2024-09-21T01:17:14.135655+0000 mgr.a (mgr.14388) 7908 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:17 smithi044 bash[22676]: cluster 2024-09-21T01:17:16.137922+0000 mgr.a (mgr.14388) 7909 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:17 smithi179 bash[23186]: cluster 2024-09-21T01:17:16.137922+0000 mgr.a (mgr.14388) 7909 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:17 smithi049 bash[23528]: cluster 2024-09-21T01:17:16.137922+0000 mgr.a (mgr.14388) 7909 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:18.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:18.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:18.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:19.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:19.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:19.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:19.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:19.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:19 smithi044 bash[22676]: cluster 2024-09-21T01:17:18.138688+0000 mgr.a (mgr.14388) 7910 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:19 smithi179 bash[23186]: cluster 2024-09-21T01:17:18.138688+0000 mgr.a (mgr.14388) 7910 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:19.528 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:19 smithi049 bash[23528]: cluster 2024-09-21T01:17:18.138688+0000 mgr.a (mgr.14388) 7910 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:20 smithi044 bash[22676]: audit 2024-09-21T01:17:18.840999+0000 mgr.a (mgr.14388) 7911 : audit [DBG] from='client.177993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:20 smithi179 bash[23186]: audit 2024-09-21T01:17:18.840999+0000 mgr.a (mgr.14388) 7911 : audit [DBG] from='client.177993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:20 smithi049 bash[23528]: audit 2024-09-21T01:17:18.840999+0000 mgr.a (mgr.14388) 7911 : audit [DBG] from='client.177993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:21 smithi044 bash[22676]: cluster 2024-09-21T01:17:20.141011+0000 mgr.a (mgr.14388) 7912 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:21.490 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:21 smithi179 bash[23186]: cluster 2024-09-21T01:17:20.141011+0000 mgr.a (mgr.14388) 7912 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:21 smithi049 bash[23528]: cluster 2024-09-21T01:17:20.141011+0000 mgr.a (mgr.14388) 7912 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:23 smithi044 bash[22676]: cluster 2024-09-21T01:17:22.141820+0000 mgr.a (mgr.14388) 7913 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:23 smithi179 bash[23186]: cluster 2024-09-21T01:17:22.141820+0000 mgr.a (mgr.14388) 7913 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:23 smithi049 bash[23528]: cluster 2024-09-21T01:17:22.141820+0000 mgr.a (mgr.14388) 7913 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:24.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:24.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:24.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:25.056 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:25 smithi044 bash[22676]: cluster 2024-09-21T01:17:24.142614+0000 mgr.a (mgr.14388) 7914 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:25 smithi044 bash[22676]: audit 2024-09-21T01:17:24.635114+0000 mon.a (mon.0) 6755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:25 smithi044 bash[22676]: audit 2024-09-21T01:17:24.643409+0000 mon.a (mon.0) 6756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:25 smithi044 bash[22676]: audit 2024-09-21T01:17:24.650252+0000 mon.a (mon.0) 6757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:25 smithi179 bash[23186]: cluster 2024-09-21T01:17:24.142614+0000 mgr.a (mgr.14388) 7914 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:25 smithi179 bash[23186]: audit 2024-09-21T01:17:24.635114+0000 mon.a (mon.0) 6755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:25 smithi179 bash[23186]: audit 2024-09-21T01:17:24.643409+0000 mon.a (mon.0) 6756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:25 smithi179 bash[23186]: audit 2024-09-21T01:17:24.650252+0000 mon.a (mon.0) 6757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:25 smithi049 bash[23528]: cluster 2024-09-21T01:17:24.142614+0000 mgr.a (mgr.14388) 7914 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:25 smithi049 bash[23528]: audit 2024-09-21T01:17:24.635114+0000 mon.a (mon.0) 6755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:25 smithi049 bash[23528]: audit 2024-09-21T01:17:24.643409+0000 mon.a (mon.0) 6756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:25 smithi049 bash[23528]: audit 2024-09-21T01:17:24.650252+0000 mon.a (mon.0) 6757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:26 smithi044 bash[22676]: audit 2024-09-21T01:17:24.594936+0000 mgr.a (mgr.14388) 7915 : audit [DBG] from='client.178068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:26 smithi044 bash[22676]: audit 2024-09-21T01:17:25.631713+0000 mon.a (mon.0) 6758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:26 smithi044 bash[22676]: audit 2024-09-21T01:17:25.639219+0000 mon.a (mon.0) 6759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:26 smithi044 bash[22676]: audit 2024-09-21T01:17:25.649224+0000 mon.a (mon.0) 6760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:26 smithi179 bash[23186]: audit 2024-09-21T01:17:24.594936+0000 mgr.a (mgr.14388) 7915 : audit [DBG] from='client.178068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:26 smithi179 bash[23186]: audit 2024-09-21T01:17:25.631713+0000 mon.a (mon.0) 6758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:26 smithi179 bash[23186]: audit 2024-09-21T01:17:25.639219+0000 mon.a (mon.0) 6759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:26 smithi179 bash[23186]: audit 2024-09-21T01:17:25.649224+0000 mon.a (mon.0) 6760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:26 smithi049 bash[23528]: audit 2024-09-21T01:17:24.594936+0000 mgr.a (mgr.14388) 7915 : audit [DBG] from='client.178068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:26 smithi049 bash[23528]: audit 2024-09-21T01:17:25.631713+0000 mon.a (mon.0) 6758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:26 smithi049 bash[23528]: audit 2024-09-21T01:17:25.639219+0000 mon.a (mon.0) 6759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:26 smithi049 bash[23528]: audit 2024-09-21T01:17:25.649224+0000 mon.a (mon.0) 6760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:27 smithi044 bash[22676]: cluster 2024-09-21T01:17:26.145383+0000 mgr.a (mgr.14388) 7916 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:17:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:27 smithi179 bash[23186]: cluster 2024-09-21T01:17:26.145383+0000 mgr.a (mgr.14388) 7916 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:17:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:27 smithi049 bash[23528]: cluster 2024-09-21T01:17:26.145383+0000 mgr.a (mgr.14388) 7916 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:17:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:29 smithi179 bash[23186]: cluster 2024-09-21T01:17:28.146103+0000 mgr.a (mgr.14388) 7917 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:17:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:29 smithi179 bash[23186]: audit 2024-09-21T01:17:29.105889+0000 mon.a (mon.0) 6761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:29 smithi179 bash[23186]: audit 2024-09-21T01:17:29.114681+0000 mon.a (mon.0) 6762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:29 smithi179 bash[23186]: audit 2024-09-21T01:17:29.124629+0000 mon.a (mon.0) 6763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:29 smithi049 bash[23528]: cluster 2024-09-21T01:17:28.146103+0000 mgr.a (mgr.14388) 7917 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:17:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:29 smithi049 bash[23528]: audit 2024-09-21T01:17:29.105889+0000 mon.a (mon.0) 6761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:29 smithi049 bash[23528]: audit 2024-09-21T01:17:29.114681+0000 mon.a (mon.0) 6762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:29 smithi049 bash[23528]: audit 2024-09-21T01:17:29.124629+0000 mon.a (mon.0) 6763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:29 smithi044 bash[22676]: cluster 2024-09-21T01:17:28.146103+0000 mgr.a (mgr.14388) 7917 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:17:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:29 smithi044 bash[22676]: audit 2024-09-21T01:17:29.105889+0000 mon.a (mon.0) 6761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:29 smithi044 bash[22676]: audit 2024-09-21T01:17:29.114681+0000 mon.a (mon.0) 6762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:29 smithi044 bash[22676]: audit 2024-09-21T01:17:29.124629+0000 mon.a (mon.0) 6763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:30.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:30.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:30.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:30.812 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:30.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:30.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:30.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:30.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:31 smithi179 bash[23186]: cluster 2024-09-21T01:17:30.148097+0000 mgr.a (mgr.14388) 7918 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:31 smithi049 bash[23528]: cluster 2024-09-21T01:17:30.148097+0000 mgr.a (mgr.14388) 7918 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:31 smithi044 bash[22676]: cluster 2024-09-21T01:17:30.148097+0000 mgr.a (mgr.14388) 7918 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:32 smithi049 bash[23528]: audit 2024-09-21T01:17:30.388101+0000 mgr.a (mgr.14388) 7919 : audit [DBG] from='client.178143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:32 smithi044 bash[22676]: audit 2024-09-21T01:17:30.388101+0000 mgr.a (mgr.14388) 7919 : audit [DBG] from='client.178143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:32 smithi179 bash[23186]: audit 2024-09-21T01:17:30.388101+0000 mgr.a (mgr.14388) 7919 : audit [DBG] from='client.178143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:33 smithi049 bash[23528]: cluster 2024-09-21T01:17:32.148997+0000 mgr.a (mgr.14388) 7920 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:17:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:33 smithi044 bash[22676]: cluster 2024-09-21T01:17:32.148997+0000 mgr.a (mgr.14388) 7920 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:17:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:33 smithi179 bash[23186]: cluster 2024-09-21T01:17:32.148997+0000 mgr.a (mgr.14388) 7920 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:17:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:35 smithi049 bash[23528]: cluster 2024-09-21T01:17:34.149828+0000 mgr.a (mgr.14388) 7921 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:17:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:35 smithi044 bash[22676]: cluster 2024-09-21T01:17:34.149828+0000 mgr.a (mgr.14388) 7921 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:17:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:35 smithi179 bash[23186]: cluster 2024-09-21T01:17:34.149828+0000 mgr.a (mgr.14388) 7921 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:17:35.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:35.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:35.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:36.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:36.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:36.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:36.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:36.576 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:37 smithi049 bash[23528]: audit 2024-09-21T01:17:36.150622+0000 mgr.a (mgr.14388) 7922 : audit [DBG] from='client.178221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:37 smithi049 bash[23528]: cluster 2024-09-21T01:17:36.151499+0000 mgr.a (mgr.14388) 7923 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:37 smithi044 bash[22676]: audit 2024-09-21T01:17:36.150622+0000 mgr.a (mgr.14388) 7922 : audit [DBG] from='client.178221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:37 smithi044 bash[22676]: cluster 2024-09-21T01:17:36.151499+0000 mgr.a (mgr.14388) 7923 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:37 smithi179 bash[23186]: audit 2024-09-21T01:17:36.150622+0000 mgr.a (mgr.14388) 7922 : audit [DBG] from='client.178221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:37 smithi179 bash[23186]: cluster 2024-09-21T01:17:36.151499+0000 mgr.a (mgr.14388) 7923 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:39 smithi049 bash[23528]: cluster 2024-09-21T01:17:38.152328+0000 mgr.a (mgr.14388) 7924 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:17:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:39 smithi044 bash[22676]: cluster 2024-09-21T01:17:38.152328+0000 mgr.a (mgr.14388) 7924 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:17:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:39 smithi179 bash[23186]: cluster 2024-09-21T01:17:38.152328+0000 mgr.a (mgr.14388) 7924 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:17:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:41 smithi049 bash[23528]: cluster 2024-09-21T01:17:40.154558+0000 mgr.a (mgr.14388) 7925 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:17:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:41.578 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:41.578 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:41.596 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:41 smithi179 bash[23186]: cluster 2024-09-21T01:17:40.154558+0000 mgr.a (mgr.14388) 7925 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:17:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:41 smithi044 bash[22676]: cluster 2024-09-21T01:17:40.154558+0000 mgr.a (mgr.14388) 7925 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:17:42.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:42.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:42.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:42.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:42.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:43 smithi049 bash[23528]: audit 2024-09-21T01:17:41.913685+0000 mgr.a (mgr.14388) 7926 : audit [DBG] from='client.178296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:43 smithi049 bash[23528]: cluster 2024-09-21T01:17:42.155520+0000 mgr.a (mgr.14388) 7927 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:43 smithi044 bash[22676]: audit 2024-09-21T01:17:41.913685+0000 mgr.a (mgr.14388) 7926 : audit [DBG] from='client.178296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:43 smithi044 bash[22676]: cluster 2024-09-21T01:17:42.155520+0000 mgr.a (mgr.14388) 7927 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:43 smithi179 bash[23186]: audit 2024-09-21T01:17:41.913685+0000 mgr.a (mgr.14388) 7926 : audit [DBG] from='client.178296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:43 smithi179 bash[23186]: cluster 2024-09-21T01:17:42.155520+0000 mgr.a (mgr.14388) 7927 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:45 smithi179 bash[23186]: cluster 2024-09-21T01:17:44.156438+0000 mgr.a (mgr.14388) 7928 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:45 smithi179 bash[23186]: audit 2024-09-21T01:17:44.809635+0000 mon.a (mon.0) 6764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:45 smithi179 bash[23186]: audit 2024-09-21T01:17:44.817891+0000 mon.a (mon.0) 6765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:45 smithi179 bash[23186]: audit 2024-09-21T01:17:44.828491+0000 mon.a (mon.0) 6766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:45 smithi049 bash[23528]: cluster 2024-09-21T01:17:44.156438+0000 mgr.a (mgr.14388) 7928 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:45 smithi049 bash[23528]: audit 2024-09-21T01:17:44.809635+0000 mon.a (mon.0) 6764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:45 smithi049 bash[23528]: audit 2024-09-21T01:17:44.817891+0000 mon.a (mon.0) 6765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:45 smithi049 bash[23528]: audit 2024-09-21T01:17:44.828491+0000 mon.a (mon.0) 6766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:45 smithi044 bash[22676]: cluster 2024-09-21T01:17:44.156438+0000 mgr.a (mgr.14388) 7928 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:45 smithi044 bash[22676]: audit 2024-09-21T01:17:44.809635+0000 mon.a (mon.0) 6764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:45 smithi044 bash[22676]: audit 2024-09-21T01:17:44.817891+0000 mon.a (mon.0) 6765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:45 smithi044 bash[22676]: audit 2024-09-21T01:17:44.828491+0000 mon.a (mon.0) 6766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:46 smithi044 bash[22676]: audit 2024-09-21T01:17:45.808724+0000 mon.a (mon.0) 6767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:46 smithi044 bash[22676]: audit 2024-09-21T01:17:45.814049+0000 mon.a (mon.0) 6768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:46 smithi044 bash[22676]: audit 2024-09-21T01:17:45.819351+0000 mon.a (mon.0) 6769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:46 smithi044 bash[22676]: cluster 2024-09-21T01:17:46.158778+0000 mgr.a (mgr.14388) 7929 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:46 smithi179 bash[23186]: audit 2024-09-21T01:17:45.808724+0000 mon.a (mon.0) 6767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:46 smithi179 bash[23186]: audit 2024-09-21T01:17:45.814049+0000 mon.a (mon.0) 6768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:46 smithi179 bash[23186]: audit 2024-09-21T01:17:45.819351+0000 mon.a (mon.0) 6769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:46 smithi179 bash[23186]: cluster 2024-09-21T01:17:46.158778+0000 mgr.a (mgr.14388) 7929 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:47.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:46 smithi049 bash[23528]: audit 2024-09-21T01:17:45.808724+0000 mon.a (mon.0) 6767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:46 smithi049 bash[23528]: audit 2024-09-21T01:17:45.814049+0000 mon.a (mon.0) 6768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:46 smithi049 bash[23528]: audit 2024-09-21T01:17:45.819351+0000 mon.a (mon.0) 6769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:46 smithi049 bash[23528]: cluster 2024-09-21T01:17:46.158778+0000 mgr.a (mgr.14388) 7929 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:17:47.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:47.352 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:47.352 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:48.142 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:48.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:48.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:48.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:48.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:49 smithi044 bash[22676]: audit 2024-09-21T01:17:47.685771+0000 mgr.a (mgr.14388) 7930 : audit [DBG] from='client.178374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:49 smithi044 bash[22676]: cluster 2024-09-21T01:17:48.159375+0000 mgr.a (mgr.14388) 7931 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:49 smithi179 bash[23186]: audit 2024-09-21T01:17:47.685771+0000 mgr.a (mgr.14388) 7930 : audit [DBG] from='client.178374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:49 smithi179 bash[23186]: cluster 2024-09-21T01:17:48.159375+0000 mgr.a (mgr.14388) 7931 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:49 smithi049 bash[23528]: audit 2024-09-21T01:17:47.685771+0000 mgr.a (mgr.14388) 7930 : audit [DBG] from='client.178374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:49 smithi049 bash[23528]: cluster 2024-09-21T01:17:48.159375+0000 mgr.a (mgr.14388) 7931 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:17:50.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22930]: debug 2024-09-21T01:17:50.357+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:17:50.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22930]: debug 2024-09-21T01:17:50.357+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:17:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.353610+0000 mon.a (mon.0) 6770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.362209+0000 mon.a (mon.0) 6771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.373217+0000 mon.a (mon.0) 6772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.548948+0000 mon.a (mon.0) 6773 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:17:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.556137+0000 mon.a (mon.0) 6774 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:17:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.558112+0000 mon.a (mon.0) 6775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:17:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.569073+0000 mon.a (mon.0) 6776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.575257+0000 mon.a (mon.0) 6777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:17:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: audit 2024-09-21T01:17:49.578129+0000 mgr.a (mgr.14388) 7932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:17:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:50 smithi044 bash[22676]: cluster 2024-09-21T01:17:50.160714+0000 mgr.a (mgr.14388) 7933 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.353610+0000 mon.a (mon.0) 6770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.362209+0000 mon.a (mon.0) 6771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.373217+0000 mon.a (mon.0) 6772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.548948+0000 mon.a (mon.0) 6773 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.556137+0000 mon.a (mon.0) 6774 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.558112+0000 mon.a (mon.0) 6775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.569073+0000 mon.a (mon.0) 6776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.575257+0000 mon.a (mon.0) 6777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:17:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: audit 2024-09-21T01:17:49.578129+0000 mgr.a (mgr.14388) 7932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:17:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:50 smithi179 bash[23186]: cluster 2024-09-21T01:17:50.160714+0000 mgr.a (mgr.14388) 7933 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.353610+0000 mon.a (mon.0) 6770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.362209+0000 mon.a (mon.0) 6771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.373217+0000 mon.a (mon.0) 6772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.548948+0000 mon.a (mon.0) 6773 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.556137+0000 mon.a (mon.0) 6774 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.558112+0000 mon.a (mon.0) 6775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.569073+0000 mon.a (mon.0) 6776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.575257+0000 mon.a (mon.0) 6777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: audit 2024-09-21T01:17:49.578129+0000 mgr.a (mgr.14388) 7932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:17:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:50 smithi049 bash[23528]: cluster 2024-09-21T01:17:50.160714+0000 mgr.a (mgr.14388) 7933 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:17:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:51 smithi044 bash[22676]: audit 2024-09-21T01:17:50.363299+0000 mgr.a (mgr.14388) 7934 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:17:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:51 smithi044 bash[22676]: cephadm 2024-09-21T01:17:50.364775+0000 mgr.a (mgr.14388) 7935 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:17:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:51 smithi179 bash[23186]: audit 2024-09-21T01:17:50.363299+0000 mgr.a (mgr.14388) 7934 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:17:52.061 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:51 smithi179 bash[23186]: cephadm 2024-09-21T01:17:50.364775+0000 mgr.a (mgr.14388) 7935 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:17:52.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:51 smithi049 bash[23528]: audit 2024-09-21T01:17:50.363299+0000 mgr.a (mgr.14388) 7934 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:17:52.062 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:51 smithi049 bash[23528]: cephadm 2024-09-21T01:17:50.364775+0000 mgr.a (mgr.14388) 7935 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:17:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:52 smithi044 bash[22676]: cluster 2024-09-21T01:17:52.161492+0000 mgr.a (mgr.14388) 7936 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:17:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:52 smithi179 bash[23186]: cluster 2024-09-21T01:17:52.161492+0000 mgr.a (mgr.14388) 7936 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:17:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:52 smithi049 bash[23528]: cluster 2024-09-21T01:17:52.161492+0000 mgr.a (mgr.14388) 7936 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:17:53.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:53.144 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:53.144 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:53.894 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:17:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:55 smithi044 bash[22676]: audit 2024-09-21T01:17:53.475452+0000 mgr.a (mgr.14388) 7937 : audit [DBG] from='client.178560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:55 smithi044 bash[22676]: cluster 2024-09-21T01:17:54.162137+0000 mgr.a (mgr.14388) 7938 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:17:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:55 smithi179 bash[23186]: audit 2024-09-21T01:17:53.475452+0000 mgr.a (mgr.14388) 7937 : audit [DBG] from='client.178560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:55 smithi179 bash[23186]: cluster 2024-09-21T01:17:54.162137+0000 mgr.a (mgr.14388) 7938 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:17:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:55 smithi049 bash[23528]: audit 2024-09-21T01:17:53.475452+0000 mgr.a (mgr.14388) 7937 : audit [DBG] from='client.178560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:17:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:55 smithi049 bash[23528]: cluster 2024-09-21T01:17:54.162137+0000 mgr.a (mgr.14388) 7938 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:17:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:57 smithi044 bash[22676]: cluster 2024-09-21T01:17:56.164335+0000 mgr.a (mgr.14388) 7939 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:57 smithi179 bash[23186]: cluster 2024-09-21T01:17:56.164335+0000 mgr.a (mgr.14388) 7939 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:57 smithi049 bash[23528]: cluster 2024-09-21T01:17:56.164335+0000 mgr.a (mgr.14388) 7939 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:58.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:17:58.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:17:58.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:17:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:17:59 smithi044 bash[22676]: cluster 2024-09-21T01:17:58.165088+0000 mgr.a (mgr.14388) 7940 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:17:59 smithi179 bash[23186]: cluster 2024-09-21T01:17:58.165088+0000 mgr.a (mgr.14388) 7940 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:17:59 smithi049 bash[23528]: cluster 2024-09-21T01:17:58.165088+0000 mgr.a (mgr.14388) 7940 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:17:59.662 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:17:59.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:17:59.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:17:59.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:17:59.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:00 smithi044 bash[22676]: audit 2024-09-21T01:17:59.232656+0000 mgr.a (mgr.14388) 7941 : audit [DBG] from='client.178635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:00 smithi179 bash[23186]: audit 2024-09-21T01:17:59.232656+0000 mgr.a (mgr.14388) 7941 : audit [DBG] from='client.178635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:00 smithi049 bash[23528]: audit 2024-09-21T01:17:59.232656+0000 mgr.a (mgr.14388) 7941 : audit [DBG] from='client.178635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:01 smithi179 bash[23186]: cluster 2024-09-21T01:18:00.167383+0000 mgr.a (mgr.14388) 7942 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:01 smithi049 bash[23528]: cluster 2024-09-21T01:18:00.167383+0000 mgr.a (mgr.14388) 7942 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:01 smithi044 bash[22676]: cluster 2024-09-21T01:18:00.167383+0000 mgr.a (mgr.14388) 7942 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:03 smithi179 bash[23186]: cluster 2024-09-21T01:18:02.168162+0000 mgr.a (mgr.14388) 7943 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:03 smithi049 bash[23528]: cluster 2024-09-21T01:18:02.168162+0000 mgr.a (mgr.14388) 7943 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:03 smithi044 bash[22676]: cluster 2024-09-21T01:18:02.168162+0000 mgr.a (mgr.14388) 7943 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:04.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:04.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:04.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:05.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:05.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:05.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:05.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:05.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:05.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:05 smithi044 bash[22676]: cluster 2024-09-21T01:18:04.168914+0000 mgr.a (mgr.14388) 7944 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:05.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:05 smithi044 bash[22676]: audit 2024-09-21T01:18:04.971662+0000 mon.a (mon.0) 6778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.483 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:05 smithi044 bash[22676]: audit 2024-09-21T01:18:04.978882+0000 mon.a (mon.0) 6779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.483 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:05 smithi044 bash[22676]: audit 2024-09-21T01:18:04.988761+0000 mon.a (mon.0) 6780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:05 smithi179 bash[23186]: cluster 2024-09-21T01:18:04.168914+0000 mgr.a (mgr.14388) 7944 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:05 smithi179 bash[23186]: audit 2024-09-21T01:18:04.971662+0000 mon.a (mon.0) 6778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:05 smithi179 bash[23186]: audit 2024-09-21T01:18:04.978882+0000 mon.a (mon.0) 6779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:05 smithi179 bash[23186]: audit 2024-09-21T01:18:04.988761+0000 mon.a (mon.0) 6780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:05 smithi049 bash[23528]: cluster 2024-09-21T01:18:04.168914+0000 mgr.a (mgr.14388) 7944 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:05 smithi049 bash[23528]: audit 2024-09-21T01:18:04.971662+0000 mon.a (mon.0) 6778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:05 smithi049 bash[23528]: audit 2024-09-21T01:18:04.978882+0000 mon.a (mon.0) 6779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:05 smithi049 bash[23528]: audit 2024-09-21T01:18:04.988761+0000 mon.a (mon.0) 6780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:06 smithi044 bash[22676]: audit 2024-09-21T01:18:05.007217+0000 mgr.a (mgr.14388) 7945 : audit [DBG] from='client.178710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:06 smithi044 bash[22676]: audit 2024-09-21T01:18:05.991711+0000 mon.a (mon.0) 6781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:06 smithi044 bash[22676]: audit 2024-09-21T01:18:05.998647+0000 mon.a (mon.0) 6782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:06 smithi044 bash[22676]: audit 2024-09-21T01:18:06.004962+0000 mon.a (mon.0) 6783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:06 smithi049 bash[23528]: audit 2024-09-21T01:18:05.007217+0000 mgr.a (mgr.14388) 7945 : audit [DBG] from='client.178710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:06 smithi049 bash[23528]: audit 2024-09-21T01:18:05.991711+0000 mon.a (mon.0) 6781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:06 smithi049 bash[23528]: audit 2024-09-21T01:18:05.998647+0000 mon.a (mon.0) 6782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:06 smithi049 bash[23528]: audit 2024-09-21T01:18:06.004962+0000 mon.a (mon.0) 6783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:06 smithi179 bash[23186]: audit 2024-09-21T01:18:05.007217+0000 mgr.a (mgr.14388) 7945 : audit [DBG] from='client.178710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:06 smithi179 bash[23186]: audit 2024-09-21T01:18:05.991711+0000 mon.a (mon.0) 6781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:06 smithi179 bash[23186]: audit 2024-09-21T01:18:05.998647+0000 mon.a (mon.0) 6782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:06 smithi179 bash[23186]: audit 2024-09-21T01:18:06.004962+0000 mon.a (mon.0) 6783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:07 smithi044 bash[22676]: cluster 2024-09-21T01:18:06.171667+0000 mgr.a (mgr.14388) 7946 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:07.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:07 smithi049 bash[23528]: cluster 2024-09-21T01:18:06.171667+0000 mgr.a (mgr.14388) 7946 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:07 smithi179 bash[23186]: cluster 2024-09-21T01:18:06.171667+0000 mgr.a (mgr.14388) 7946 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:18:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:09 smithi049 bash[23528]: cluster 2024-09-21T01:18:08.172462+0000 mgr.a (mgr.14388) 7947 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:09 smithi044 bash[22676]: cluster 2024-09-21T01:18:08.172462+0000 mgr.a (mgr.14388) 7947 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:09 smithi179 bash[23186]: cluster 2024-09-21T01:18:08.172462+0000 mgr.a (mgr.14388) 7947 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:10.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:10.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:10 smithi044 bash[22676]: audit 2024-09-21T01:18:09.587364+0000 mon.a (mon.0) 6784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:10 smithi044 bash[22676]: audit 2024-09-21T01:18:09.596353+0000 mon.a (mon.0) 6785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:10 smithi044 bash[22676]: audit 2024-09-21T01:18:09.607381+0000 mon.a (mon.0) 6786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:10 smithi044 bash[22676]: cluster 2024-09-21T01:18:10.174436+0000 mgr.a (mgr.14388) 7948 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:10 smithi179 bash[23186]: audit 2024-09-21T01:18:09.587364+0000 mon.a (mon.0) 6784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:10 smithi179 bash[23186]: audit 2024-09-21T01:18:09.596353+0000 mon.a (mon.0) 6785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:10 smithi179 bash[23186]: audit 2024-09-21T01:18:09.607381+0000 mon.a (mon.0) 6786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:10 smithi179 bash[23186]: cluster 2024-09-21T01:18:10.174436+0000 mgr.a (mgr.14388) 7948 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:10 smithi049 bash[23528]: audit 2024-09-21T01:18:09.587364+0000 mon.a (mon.0) 6784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:10 smithi049 bash[23528]: audit 2024-09-21T01:18:09.596353+0000 mon.a (mon.0) 6785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:10 smithi049 bash[23528]: audit 2024-09-21T01:18:09.607381+0000 mon.a (mon.0) 6786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:10 smithi049 bash[23528]: cluster 2024-09-21T01:18:10.174436+0000 mgr.a (mgr.14388) 7948 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:11.190 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:11.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:11.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:11.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:11.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:11 smithi044 bash[22676]: audit 2024-09-21T01:18:10.772794+0000 mgr.a (mgr.14388) 7949 : audit [DBG] from='client.178788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:11 smithi179 bash[23186]: audit 2024-09-21T01:18:10.772794+0000 mgr.a (mgr.14388) 7949 : audit [DBG] from='client.178788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:11 smithi049 bash[23528]: audit 2024-09-21T01:18:10.772794+0000 mgr.a (mgr.14388) 7949 : audit [DBG] from='client.178788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:12 smithi044 bash[22676]: cluster 2024-09-21T01:18:12.175321+0000 mgr.a (mgr.14388) 7950 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:12 smithi179 bash[23186]: cluster 2024-09-21T01:18:12.175321+0000 mgr.a (mgr.14388) 7950 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:12 smithi049 bash[23528]: cluster 2024-09-21T01:18:12.175321+0000 mgr.a (mgr.14388) 7950 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:15 smithi044 bash[22676]: cluster 2024-09-21T01:18:14.176130+0000 mgr.a (mgr.14388) 7951 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:18:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:15 smithi179 bash[23186]: cluster 2024-09-21T01:18:14.176130+0000 mgr.a (mgr.14388) 7951 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:18:15.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:15 smithi049 bash[23528]: cluster 2024-09-21T01:18:14.176130+0000 mgr.a (mgr.14388) 7951 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:18:16.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:16.192 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:16.192 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:16.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:16.942 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:17.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:17 smithi179 bash[23186]: cluster 2024-09-21T01:18:16.178429+0000 mgr.a (mgr.14388) 7952 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:17 smithi049 bash[23528]: cluster 2024-09-21T01:18:16.178429+0000 mgr.a (mgr.14388) 7952 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:17 smithi044 bash[22676]: cluster 2024-09-21T01:18:16.178429+0000 mgr.a (mgr.14388) 7952 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:18 smithi179 bash[23186]: audit 2024-09-21T01:18:16.522650+0000 mgr.a (mgr.14388) 7953 : audit [DBG] from='client.178863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:18 smithi049 bash[23528]: audit 2024-09-21T01:18:16.522650+0000 mgr.a (mgr.14388) 7953 : audit [DBG] from='client.178863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:18 smithi044 bash[22676]: audit 2024-09-21T01:18:16.522650+0000 mgr.a (mgr.14388) 7953 : audit [DBG] from='client.178863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:19 smithi049 bash[23528]: cluster 2024-09-21T01:18:18.179323+0000 mgr.a (mgr.14388) 7954 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:19 smithi179 bash[23186]: cluster 2024-09-21T01:18:18.179323+0000 mgr.a (mgr.14388) 7954 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:19 smithi044 bash[22676]: cluster 2024-09-21T01:18:18.179323+0000 mgr.a (mgr.14388) 7954 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:21 smithi049 bash[23528]: cluster 2024-09-21T01:18:20.181585+0000 mgr.a (mgr.14388) 7955 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:21 smithi044 bash[22676]: cluster 2024-09-21T01:18:20.181585+0000 mgr.a (mgr.14388) 7955 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:21 smithi179 bash[23186]: cluster 2024-09-21T01:18:20.181585+0000 mgr.a (mgr.14388) 7955 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:21.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:21.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:22.716 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:23 smithi179 bash[23186]: cluster 2024-09-21T01:18:22.182318+0000 mgr.a (mgr.14388) 7956 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:23 smithi179 bash[23186]: audit 2024-09-21T01:18:22.283258+0000 mgr.a (mgr.14388) 7957 : audit [DBG] from='client.178938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:23 smithi049 bash[23528]: cluster 2024-09-21T01:18:22.182318+0000 mgr.a (mgr.14388) 7956 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:23 smithi049 bash[23528]: audit 2024-09-21T01:18:22.283258+0000 mgr.a (mgr.14388) 7957 : audit [DBG] from='client.178938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:23 smithi044 bash[22676]: cluster 2024-09-21T01:18:22.182318+0000 mgr.a (mgr.14388) 7956 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:23 smithi044 bash[22676]: audit 2024-09-21T01:18:22.283258+0000 mgr.a (mgr.14388) 7957 : audit [DBG] from='client.178938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:25.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:25 smithi179 bash[23186]: cluster 2024-09-21T01:18:24.183210+0000 mgr.a (mgr.14388) 7958 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:25.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:25 smithi179 bash[23186]: audit 2024-09-21T01:18:25.144211+0000 mon.a (mon.0) 6787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:25 smithi179 bash[23186]: audit 2024-09-21T01:18:25.152952+0000 mon.a (mon.0) 6788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:25 smithi179 bash[23186]: audit 2024-09-21T01:18:25.163269+0000 mon.a (mon.0) 6789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:25 smithi044 bash[22676]: cluster 2024-09-21T01:18:24.183210+0000 mgr.a (mgr.14388) 7958 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:25.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:25 smithi044 bash[22676]: audit 2024-09-21T01:18:25.144211+0000 mon.a (mon.0) 6787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:25 smithi044 bash[22676]: audit 2024-09-21T01:18:25.152952+0000 mon.a (mon.0) 6788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:25 smithi044 bash[22676]: audit 2024-09-21T01:18:25.163269+0000 mon.a (mon.0) 6789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:25 smithi049 bash[23528]: cluster 2024-09-21T01:18:24.183210+0000 mgr.a (mgr.14388) 7958 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:25 smithi049 bash[23528]: audit 2024-09-21T01:18:25.144211+0000 mon.a (mon.0) 6787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:25 smithi049 bash[23528]: audit 2024-09-21T01:18:25.152952+0000 mon.a (mon.0) 6788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:25 smithi049 bash[23528]: audit 2024-09-21T01:18:25.163269+0000 mon.a (mon.0) 6789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:27 smithi044 bash[22676]: audit 2024-09-21T01:18:26.168098+0000 mon.a (mon.0) 6790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:27 smithi044 bash[22676]: audit 2024-09-21T01:18:26.173338+0000 mon.a (mon.0) 6791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:27 smithi044 bash[22676]: audit 2024-09-21T01:18:26.179293+0000 mon.a (mon.0) 6792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:27 smithi044 bash[22676]: cluster 2024-09-21T01:18:26.185417+0000 mgr.a (mgr.14388) 7959 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:27 smithi179 bash[23186]: audit 2024-09-21T01:18:26.168098+0000 mon.a (mon.0) 6790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:27 smithi179 bash[23186]: audit 2024-09-21T01:18:26.173338+0000 mon.a (mon.0) 6791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:27 smithi179 bash[23186]: audit 2024-09-21T01:18:26.179293+0000 mon.a (mon.0) 6792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:27 smithi179 bash[23186]: cluster 2024-09-21T01:18:26.185417+0000 mgr.a (mgr.14388) 7959 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:27 smithi049 bash[23528]: audit 2024-09-21T01:18:26.168098+0000 mon.a (mon.0) 6790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:27 smithi049 bash[23528]: audit 2024-09-21T01:18:26.173338+0000 mon.a (mon.0) 6791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:27 smithi049 bash[23528]: audit 2024-09-21T01:18:26.179293+0000 mon.a (mon.0) 6792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:27 smithi049 bash[23528]: cluster 2024-09-21T01:18:26.185417+0000 mgr.a (mgr.14388) 7959 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:28.495 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:29 smithi179 bash[23186]: audit 2024-09-21T01:18:28.053093+0000 mgr.a (mgr.14388) 7960 : audit [DBG] from='client.179016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:29 smithi179 bash[23186]: cluster 2024-09-21T01:18:28.189233+0000 mgr.a (mgr.14388) 7961 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:29 smithi049 bash[23528]: audit 2024-09-21T01:18:28.053093+0000 mgr.a (mgr.14388) 7960 : audit [DBG] from='client.179016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:29 smithi049 bash[23528]: cluster 2024-09-21T01:18:28.189233+0000 mgr.a (mgr.14388) 7961 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:29 smithi044 bash[22676]: audit 2024-09-21T01:18:28.053093+0000 mgr.a (mgr.14388) 7960 : audit [DBG] from='client.179016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:29 smithi044 bash[22676]: cluster 2024-09-21T01:18:28.189233+0000 mgr.a (mgr.14388) 7961 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:30 smithi049 bash[23528]: audit 2024-09-21T01:18:29.795000+0000 mon.a (mon.0) 6793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:30 smithi049 bash[23528]: audit 2024-09-21T01:18:29.803548+0000 mon.a (mon.0) 6794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:30 smithi049 bash[23528]: audit 2024-09-21T01:18:29.814110+0000 mon.a (mon.0) 6795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:30 smithi049 bash[23528]: cluster 2024-09-21T01:18:30.191489+0000 mgr.a (mgr.14388) 7962 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:30 smithi044 bash[22676]: audit 2024-09-21T01:18:29.795000+0000 mon.a (mon.0) 6793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:30 smithi044 bash[22676]: audit 2024-09-21T01:18:29.803548+0000 mon.a (mon.0) 6794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:30 smithi044 bash[22676]: audit 2024-09-21T01:18:29.814110+0000 mon.a (mon.0) 6795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:30 smithi044 bash[22676]: cluster 2024-09-21T01:18:30.191489+0000 mgr.a (mgr.14388) 7962 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:30 smithi179 bash[23186]: audit 2024-09-21T01:18:29.795000+0000 mon.a (mon.0) 6793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:30 smithi179 bash[23186]: audit 2024-09-21T01:18:29.803548+0000 mon.a (mon.0) 6794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:30 smithi179 bash[23186]: audit 2024-09-21T01:18:29.814110+0000 mon.a (mon.0) 6795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:30 smithi179 bash[23186]: cluster 2024-09-21T01:18:30.191489+0000 mgr.a (mgr.14388) 7962 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:33.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:33.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:33.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:33 smithi179 bash[23186]: cluster 2024-09-21T01:18:32.192261+0000 mgr.a (mgr.14388) 7963 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:33 smithi049 bash[23528]: cluster 2024-09-21T01:18:32.192261+0000 mgr.a (mgr.14388) 7963 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:33 smithi044 bash[22676]: cluster 2024-09-21T01:18:32.192261+0000 mgr.a (mgr.14388) 7963 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:34.280 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:35 smithi044 bash[22676]: audit 2024-09-21T01:18:33.835570+0000 mgr.a (mgr.14388) 7964 : audit [DBG] from='client.179094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:35 smithi044 bash[22676]: cluster 2024-09-21T01:18:34.192826+0000 mgr.a (mgr.14388) 7965 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:35 smithi049 bash[23528]: audit 2024-09-21T01:18:33.835570+0000 mgr.a (mgr.14388) 7964 : audit [DBG] from='client.179094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:35 smithi049 bash[23528]: cluster 2024-09-21T01:18:34.192826+0000 mgr.a (mgr.14388) 7965 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:35 smithi179 bash[23186]: audit 2024-09-21T01:18:33.835570+0000 mgr.a (mgr.14388) 7964 : audit [DBG] from='client.179094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:35 smithi179 bash[23186]: cluster 2024-09-21T01:18:34.192826+0000 mgr.a (mgr.14388) 7965 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:37 smithi049 bash[23528]: cluster 2024-09-21T01:18:36.195033+0000 mgr.a (mgr.14388) 7966 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:37 smithi044 bash[22676]: cluster 2024-09-21T01:18:36.195033+0000 mgr.a (mgr.14388) 7966 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:37 smithi179 bash[23186]: cluster 2024-09-21T01:18:36.195033+0000 mgr.a (mgr.14388) 7966 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:18:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:38 smithi044 bash[22676]: cluster 2024-09-21T01:18:38.195789+0000 mgr.a (mgr.14388) 7967 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:38 smithi179 bash[23186]: cluster 2024-09-21T01:18:38.195789+0000 mgr.a (mgr.14388) 7967 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:38 smithi049 bash[23528]: cluster 2024-09-21T01:18:38.195789+0000 mgr.a (mgr.14388) 7967 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:40.075 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:40.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:40.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:40.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:40.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:41 smithi049 bash[23528]: audit 2024-09-21T01:18:39.623195+0000 mgr.a (mgr.14388) 7968 : audit [DBG] from='client.179172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:41.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:41 smithi049 bash[23528]: cluster 2024-09-21T01:18:40.198096+0000 mgr.a (mgr.14388) 7969 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:18:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:41 smithi044 bash[22676]: audit 2024-09-21T01:18:39.623195+0000 mgr.a (mgr.14388) 7968 : audit [DBG] from='client.179172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:41 smithi044 bash[22676]: cluster 2024-09-21T01:18:40.198096+0000 mgr.a (mgr.14388) 7969 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:18:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:41 smithi179 bash[23186]: audit 2024-09-21T01:18:39.623195+0000 mgr.a (mgr.14388) 7968 : audit [DBG] from='client.179172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:41 smithi179 bash[23186]: cluster 2024-09-21T01:18:40.198096+0000 mgr.a (mgr.14388) 7969 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:18:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:43 smithi049 bash[23528]: cluster 2024-09-21T01:18:42.198816+0000 mgr.a (mgr.14388) 7970 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:18:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:43 smithi044 bash[22676]: cluster 2024-09-21T01:18:42.198816+0000 mgr.a (mgr.14388) 7970 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:18:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:43 smithi179 bash[23186]: cluster 2024-09-21T01:18:42.198816+0000 mgr.a (mgr.14388) 7970 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:18:45.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:45.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:45.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:45.536 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:45 smithi044 bash[22676]: cluster 2024-09-21T01:18:44.199587+0000 mgr.a (mgr.14388) 7971 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:18:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:45 smithi049 bash[23528]: cluster 2024-09-21T01:18:44.199587+0000 mgr.a (mgr.14388) 7971 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:18:45.585 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:45 smithi179 bash[23186]: cluster 2024-09-21T01:18:44.199587+0000 mgr.a (mgr.14388) 7971 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:18:45.895 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:45.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:45.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:45.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:45.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:46.607 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:46 smithi179 bash[23186]: audit 2024-09-21T01:18:45.318037+0000 mon.a (mon.0) 6796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.607 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:46 smithi179 bash[23186]: audit 2024-09-21T01:18:45.327110+0000 mon.a (mon.0) 6797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.607 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:46 smithi179 bash[23186]: audit 2024-09-21T01:18:45.337014+0000 mon.a (mon.0) 6798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:46 smithi044 bash[22676]: audit 2024-09-21T01:18:45.318037+0000 mon.a (mon.0) 6796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:46 smithi044 bash[22676]: audit 2024-09-21T01:18:45.327110+0000 mon.a (mon.0) 6797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:46 smithi044 bash[22676]: audit 2024-09-21T01:18:45.337014+0000 mon.a (mon.0) 6798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:46 smithi049 bash[23528]: audit 2024-09-21T01:18:45.318037+0000 mon.a (mon.0) 6796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:46 smithi049 bash[23528]: audit 2024-09-21T01:18:45.327110+0000 mon.a (mon.0) 6797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:46 smithi049 bash[23528]: audit 2024-09-21T01:18:45.337014+0000 mon.a (mon.0) 6798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:47 smithi044 bash[22676]: audit 2024-09-21T01:18:45.429942+0000 mgr.a (mgr.14388) 7972 : audit [DBG] from='client.179250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:47 smithi044 bash[22676]: cluster 2024-09-21T01:18:46.201565+0000 mgr.a (mgr.14388) 7973 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:47 smithi044 bash[22676]: audit 2024-09-21T01:18:46.343239+0000 mon.a (mon.0) 6799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:47 smithi044 bash[22676]: audit 2024-09-21T01:18:46.352715+0000 mon.a (mon.0) 6800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:47 smithi044 bash[22676]: audit 2024-09-21T01:18:46.357649+0000 mon.a (mon.0) 6801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:47 smithi179 bash[23186]: audit 2024-09-21T01:18:45.429942+0000 mgr.a (mgr.14388) 7972 : audit [DBG] from='client.179250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:47 smithi179 bash[23186]: cluster 2024-09-21T01:18:46.201565+0000 mgr.a (mgr.14388) 7973 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:47 smithi179 bash[23186]: audit 2024-09-21T01:18:46.343239+0000 mon.a (mon.0) 6799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:47 smithi179 bash[23186]: audit 2024-09-21T01:18:46.352715+0000 mon.a (mon.0) 6800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:47 smithi179 bash[23186]: audit 2024-09-21T01:18:46.357649+0000 mon.a (mon.0) 6801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:47 smithi049 bash[23528]: audit 2024-09-21T01:18:45.429942+0000 mgr.a (mgr.14388) 7972 : audit [DBG] from='client.179250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:47 smithi049 bash[23528]: cluster 2024-09-21T01:18:46.201565+0000 mgr.a (mgr.14388) 7973 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:47 smithi049 bash[23528]: audit 2024-09-21T01:18:46.343239+0000 mon.a (mon.0) 6799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:47 smithi049 bash[23528]: audit 2024-09-21T01:18:46.352715+0000 mon.a (mon.0) 6800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:47 smithi049 bash[23528]: audit 2024-09-21T01:18:46.357649+0000 mon.a (mon.0) 6801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:48 smithi044 bash[22676]: cluster 2024-09-21T01:18:48.202351+0000 mgr.a (mgr.14388) 7974 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:48 smithi179 bash[23186]: cluster 2024-09-21T01:18:48.202351+0000 mgr.a (mgr.14388) 7974 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:48 smithi049 bash[23528]: cluster 2024-09-21T01:18:48.202351+0000 mgr.a (mgr.14388) 7974 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:18:50.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:50.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:50.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.006492+0000 mon.a (mon.0) 6802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.015193+0000 mon.a (mon.0) 6803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.025737+0000 mon.a (mon.0) 6804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: cluster 2024-09-21T01:18:50.204433+0000 mgr.a (mgr.14388) 7975 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.424488+0000 mon.a (mon.0) 6805 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.435124+0000 mon.a (mon.0) 6806 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.436874+0000 mon.a (mon.0) 6807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:18:51.256 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.449913+0000 mon.a (mon.0) 6808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.257 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22676]: audit 2024-09-21T01:18:50.456113+0000 mon.a (mon.0) 6809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:18:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.006492+0000 mon.a (mon.0) 6802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.015193+0000 mon.a (mon.0) 6803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.025737+0000 mon.a (mon.0) 6804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: cluster 2024-09-21T01:18:50.204433+0000 mgr.a (mgr.14388) 7975 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.424488+0000 mon.a (mon.0) 6805 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.435124+0000 mon.a (mon.0) 6806 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.436874+0000 mon.a (mon.0) 6807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.449913+0000 mon.a (mon.0) 6808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:51 smithi049 bash[23528]: audit 2024-09-21T01:18:50.456113+0000 mon.a (mon.0) 6809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.006492+0000 mon.a (mon.0) 6802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.015193+0000 mon.a (mon.0) 6803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.025737+0000 mon.a (mon.0) 6804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: cluster 2024-09-21T01:18:50.204433+0000 mgr.a (mgr.14388) 7975 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.424488+0000 mon.a (mon.0) 6805 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.435124+0000 mon.a (mon.0) 6806 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.436874+0000 mon.a (mon.0) 6807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:18:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.449913+0000 mon.a (mon.0) 6808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:18:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:51 smithi179 bash[23186]: audit 2024-09-21T01:18:50.456113+0000 mon.a (mon.0) 6809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:18:51.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:51.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:51.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:51.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:51.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:51.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22930]: debug 2024-09-21T01:18:51.252+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:18:51.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:18:51 smithi044 bash[22930]: debug 2024-09-21T01:18:51.268+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:18:52.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:52 smithi049 bash[23528]: audit 2024-09-21T01:18:50.458515+0000 mgr.a (mgr.14388) 7976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:18:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:52 smithi049 bash[23528]: audit 2024-09-21T01:18:51.229006+0000 mgr.a (mgr.14388) 7977 : audit [DBG] from='client.179397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:52 smithi049 bash[23528]: audit 2024-09-21T01:18:51.256547+0000 mgr.a (mgr.14388) 7978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:18:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:52 smithi049 bash[23528]: cephadm 2024-09-21T01:18:51.269544+0000 mgr.a (mgr.14388) 7979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:18:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:52 smithi044 bash[22676]: audit 2024-09-21T01:18:50.458515+0000 mgr.a (mgr.14388) 7976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:18:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:52 smithi044 bash[22676]: audit 2024-09-21T01:18:51.229006+0000 mgr.a (mgr.14388) 7977 : audit [DBG] from='client.179397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:52 smithi044 bash[22676]: audit 2024-09-21T01:18:51.256547+0000 mgr.a (mgr.14388) 7978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:18:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:52 smithi044 bash[22676]: cephadm 2024-09-21T01:18:51.269544+0000 mgr.a (mgr.14388) 7979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:18:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:52 smithi179 bash[23186]: audit 2024-09-21T01:18:50.458515+0000 mgr.a (mgr.14388) 7976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:18:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:52 smithi179 bash[23186]: audit 2024-09-21T01:18:51.229006+0000 mgr.a (mgr.14388) 7977 : audit [DBG] from='client.179397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:52 smithi179 bash[23186]: audit 2024-09-21T01:18:51.256547+0000 mgr.a (mgr.14388) 7978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:18:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:52 smithi179 bash[23186]: cephadm 2024-09-21T01:18:51.269544+0000 mgr.a (mgr.14388) 7979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:18:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:53 smithi049 bash[23528]: cluster 2024-09-21T01:18:52.205516+0000 mgr.a (mgr.14388) 7980 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:18:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:53 smithi044 bash[22676]: cluster 2024-09-21T01:18:52.205516+0000 mgr.a (mgr.14388) 7980 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:18:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:53 smithi179 bash[23186]: cluster 2024-09-21T01:18:52.205516+0000 mgr.a (mgr.14388) 7980 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:18:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:55 smithi049 bash[23528]: cluster 2024-09-21T01:18:54.206302+0000 mgr.a (mgr.14388) 7981 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:18:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:55 smithi044 bash[22676]: cluster 2024-09-21T01:18:54.206302+0000 mgr.a (mgr.14388) 7981 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:18:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:55 smithi179 bash[23186]: cluster 2024-09-21T01:18:54.206302+0000 mgr.a (mgr.14388) 7981 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:18:56.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:18:56.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:18:56.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:18:57.456 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:18:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:18:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:18:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:18:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:18:57.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:57 smithi049 bash[23528]: cluster 2024-09-21T01:18:56.208518+0000 mgr.a (mgr.14388) 7982 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:57 smithi044 bash[22676]: cluster 2024-09-21T01:18:56.208518+0000 mgr.a (mgr.14388) 7982 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:57.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:57 smithi179 bash[23186]: cluster 2024-09-21T01:18:56.208518+0000 mgr.a (mgr.14388) 7982 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:58 smithi049 bash[23528]: audit 2024-09-21T01:18:57.001326+0000 mgr.a (mgr.14388) 7983 : audit [DBG] from='client.179508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:58 smithi044 bash[22676]: audit 2024-09-21T01:18:57.001326+0000 mgr.a (mgr.14388) 7983 : audit [DBG] from='client.179508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:58 smithi179 bash[23186]: audit 2024-09-21T01:18:57.001326+0000 mgr.a (mgr.14388) 7983 : audit [DBG] from='client.179508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:18:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:18:59 smithi049 bash[23528]: cluster 2024-09-21T01:18:58.209645+0000 mgr.a (mgr.14388) 7984 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:18:59 smithi044 bash[22676]: cluster 2024-09-21T01:18:58.209645+0000 mgr.a (mgr.14388) 7984 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:18:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:18:59 smithi179 bash[23186]: cluster 2024-09-21T01:18:58.209645+0000 mgr.a (mgr.14388) 7984 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:01 smithi049 bash[23528]: cluster 2024-09-21T01:19:00.211823+0000 mgr.a (mgr.14388) 7985 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:01 smithi044 bash[22676]: cluster 2024-09-21T01:19:00.211823+0000 mgr.a (mgr.14388) 7985 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:01 smithi179 bash[23186]: cluster 2024-09-21T01:19:00.211823+0000 mgr.a (mgr.14388) 7985 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:02.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:02.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:02.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:03.214 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:03.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:03.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:03 smithi179 bash[23186]: cluster 2024-09-21T01:19:02.212592+0000 mgr.a (mgr.14388) 7986 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:03 smithi049 bash[23528]: cluster 2024-09-21T01:19:02.212592+0000 mgr.a (mgr.14388) 7986 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:03 smithi044 bash[22676]: cluster 2024-09-21T01:19:02.212592+0000 mgr.a (mgr.14388) 7986 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:04 smithi179 bash[23186]: audit 2024-09-21T01:19:02.790332+0000 mgr.a (mgr.14388) 7987 : audit [DBG] from='client.179583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:04 smithi049 bash[23528]: audit 2024-09-21T01:19:02.790332+0000 mgr.a (mgr.14388) 7987 : audit [DBG] from='client.179583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:04.659 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:04 smithi044 bash[22676]: audit 2024-09-21T01:19:02.790332+0000 mgr.a (mgr.14388) 7987 : audit [DBG] from='client.179583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:05 smithi049 bash[23528]: cluster 2024-09-21T01:19:04.213603+0000 mgr.a (mgr.14388) 7988 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:05.572 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:05 smithi044 bash[22676]: cluster 2024-09-21T01:19:04.213603+0000 mgr.a (mgr.14388) 7988 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:05.611 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:05 smithi179 bash[23186]: cluster 2024-09-21T01:19:04.213603+0000 mgr.a (mgr.14388) 7988 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:06 smithi179 bash[23186]: audit 2024-09-21T01:19:05.495489+0000 mon.a (mon.0) 6810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:06 smithi179 bash[23186]: audit 2024-09-21T01:19:05.504121+0000 mon.a (mon.0) 6811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:06 smithi179 bash[23186]: audit 2024-09-21T01:19:05.514712+0000 mon.a (mon.0) 6812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:06 smithi179 bash[23186]: cluster 2024-09-21T01:19:06.215847+0000 mgr.a (mgr.14388) 7989 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:06 smithi049 bash[23528]: audit 2024-09-21T01:19:05.495489+0000 mon.a (mon.0) 6810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:06 smithi049 bash[23528]: audit 2024-09-21T01:19:05.504121+0000 mon.a (mon.0) 6811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:06 smithi049 bash[23528]: audit 2024-09-21T01:19:05.514712+0000 mon.a (mon.0) 6812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:06 smithi049 bash[23528]: cluster 2024-09-21T01:19:06.215847+0000 mgr.a (mgr.14388) 7989 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:06 smithi044 bash[22676]: audit 2024-09-21T01:19:05.495489+0000 mon.a (mon.0) 6810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:06 smithi044 bash[22676]: audit 2024-09-21T01:19:05.504121+0000 mon.a (mon.0) 6811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:06 smithi044 bash[22676]: audit 2024-09-21T01:19:05.514712+0000 mon.a (mon.0) 6812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:06 smithi044 bash[22676]: cluster 2024-09-21T01:19:06.215847+0000 mgr.a (mgr.14388) 7989 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:07 smithi044 bash[22676]: audit 2024-09-21T01:19:06.565738+0000 mon.a (mon.0) 6813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:07 smithi044 bash[22676]: audit 2024-09-21T01:19:06.571570+0000 mon.a (mon.0) 6814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:07 smithi044 bash[22676]: audit 2024-09-21T01:19:06.578466+0000 mon.a (mon.0) 6815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:07 smithi179 bash[23186]: audit 2024-09-21T01:19:06.565738+0000 mon.a (mon.0) 6813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:07 smithi179 bash[23186]: audit 2024-09-21T01:19:06.571570+0000 mon.a (mon.0) 6814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:07 smithi179 bash[23186]: audit 2024-09-21T01:19:06.578466+0000 mon.a (mon.0) 6815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:07 smithi049 bash[23528]: audit 2024-09-21T01:19:06.565738+0000 mon.a (mon.0) 6813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:07 smithi049 bash[23528]: audit 2024-09-21T01:19:06.571570+0000 mon.a (mon.0) 6814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:07 smithi049 bash[23528]: audit 2024-09-21T01:19:06.578466+0000 mon.a (mon.0) 6815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:08.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:08.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:08.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:08.953 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:08.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:08.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:08.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:08.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:08 smithi044 bash[22676]: cluster 2024-09-21T01:19:08.216513+0000 mgr.a (mgr.14388) 7990 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:08 smithi179 bash[23186]: cluster 2024-09-21T01:19:08.216513+0000 mgr.a (mgr.14388) 7990 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:08 smithi049 bash[23528]: cluster 2024-09-21T01:19:08.216513+0000 mgr.a (mgr.14388) 7990 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:09 smithi044 bash[22676]: audit 2024-09-21T01:19:08.538805+0000 mgr.a (mgr.14388) 7991 : audit [DBG] from='client.179658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:09 smithi179 bash[23186]: audit 2024-09-21T01:19:08.538805+0000 mgr.a (mgr.14388) 7991 : audit [DBG] from='client.179658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:09 smithi049 bash[23528]: audit 2024-09-21T01:19:08.538805+0000 mgr.a (mgr.14388) 7991 : audit [DBG] from='client.179658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:11 smithi044 bash[22676]: cluster 2024-09-21T01:19:10.219020+0000 mgr.a (mgr.14388) 7992 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:11 smithi044 bash[22676]: audit 2024-09-21T01:19:10.238684+0000 mon.a (mon.0) 6816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:11 smithi044 bash[22676]: audit 2024-09-21T01:19:10.248173+0000 mon.a (mon.0) 6817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:11 smithi044 bash[22676]: audit 2024-09-21T01:19:10.258510+0000 mon.a (mon.0) 6818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:11 smithi179 bash[23186]: cluster 2024-09-21T01:19:10.219020+0000 mgr.a (mgr.14388) 7992 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:11 smithi179 bash[23186]: audit 2024-09-21T01:19:10.238684+0000 mon.a (mon.0) 6816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:11 smithi179 bash[23186]: audit 2024-09-21T01:19:10.248173+0000 mon.a (mon.0) 6817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:11 smithi179 bash[23186]: audit 2024-09-21T01:19:10.258510+0000 mon.a (mon.0) 6818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:11 smithi049 bash[23528]: cluster 2024-09-21T01:19:10.219020+0000 mgr.a (mgr.14388) 7992 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:11 smithi049 bash[23528]: audit 2024-09-21T01:19:10.238684+0000 mon.a (mon.0) 6816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:11 smithi049 bash[23528]: audit 2024-09-21T01:19:10.248173+0000 mon.a (mon.0) 6817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:11 smithi049 bash[23528]: audit 2024-09-21T01:19:10.258510+0000 mon.a (mon.0) 6818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:13 smithi179 bash[23186]: cluster 2024-09-21T01:19:12.219837+0000 mgr.a (mgr.14388) 7993 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:13 smithi049 bash[23528]: cluster 2024-09-21T01:19:12.219837+0000 mgr.a (mgr.14388) 7993 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:13 smithi044 bash[22676]: cluster 2024-09-21T01:19:12.219837+0000 mgr.a (mgr.14388) 7993 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:13.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:14.717 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:14.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:14.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:14.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:14.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:15 smithi179 bash[23186]: cluster 2024-09-21T01:19:14.220278+0000 mgr.a (mgr.14388) 7994 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:15 smithi179 bash[23186]: audit 2024-09-21T01:19:14.288542+0000 mgr.a (mgr.14388) 7995 : audit [DBG] from='client.179736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:15.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:15 smithi049 bash[23528]: cluster 2024-09-21T01:19:14.220278+0000 mgr.a (mgr.14388) 7994 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:15.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:15 smithi049 bash[23528]: audit 2024-09-21T01:19:14.288542+0000 mgr.a (mgr.14388) 7995 : audit [DBG] from='client.179736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:15 smithi044 bash[22676]: cluster 2024-09-21T01:19:14.220278+0000 mgr.a (mgr.14388) 7994 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:15 smithi044 bash[22676]: audit 2024-09-21T01:19:14.288542+0000 mgr.a (mgr.14388) 7995 : audit [DBG] from='client.179736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:17 smithi179 bash[23186]: cluster 2024-09-21T01:19:16.222706+0000 mgr.a (mgr.14388) 7996 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:17.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:17 smithi049 bash[23528]: cluster 2024-09-21T01:19:16.222706+0000 mgr.a (mgr.14388) 7996 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:17 smithi044 bash[22676]: cluster 2024-09-21T01:19:16.222706+0000 mgr.a (mgr.14388) 7996 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:19.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:19 smithi049 bash[23528]: cluster 2024-09-21T01:19:18.223487+0000 mgr.a (mgr.14388) 7997 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:19.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:19.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:19.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:19 smithi044 bash[22676]: cluster 2024-09-21T01:19:18.223487+0000 mgr.a (mgr.14388) 7997 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:19 smithi179 bash[23186]: cluster 2024-09-21T01:19:18.223487+0000 mgr.a (mgr.14388) 7997 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:20.470 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:20.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:20.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:20.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:20.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:21 smithi049 bash[23528]: audit 2024-09-21T01:19:20.045172+0000 mgr.a (mgr.14388) 7998 : audit [DBG] from='client.179814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:21 smithi049 bash[23528]: cluster 2024-09-21T01:19:20.225620+0000 mgr.a (mgr.14388) 7999 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:21 smithi044 bash[22676]: audit 2024-09-21T01:19:20.045172+0000 mgr.a (mgr.14388) 7998 : audit [DBG] from='client.179814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:21 smithi044 bash[22676]: cluster 2024-09-21T01:19:20.225620+0000 mgr.a (mgr.14388) 7999 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:21 smithi179 bash[23186]: audit 2024-09-21T01:19:20.045172+0000 mgr.a (mgr.14388) 7998 : audit [DBG] from='client.179814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:21 smithi179 bash[23186]: cluster 2024-09-21T01:19:20.225620+0000 mgr.a (mgr.14388) 7999 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:23.517 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:23 smithi179 bash[23186]: cluster 2024-09-21T01:19:22.226491+0000 mgr.a (mgr.14388) 8000 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:19:23.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:23 smithi049 bash[23528]: cluster 2024-09-21T01:19:22.226491+0000 mgr.a (mgr.14388) 8000 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:19:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:23 smithi044 bash[22676]: cluster 2024-09-21T01:19:22.226491+0000 mgr.a (mgr.14388) 8000 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:19:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:25.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:25 smithi179 bash[23186]: cluster 2024-09-21T01:19:24.227289+0000 mgr.a (mgr.14388) 8001 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:19:25.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:25 smithi049 bash[23528]: cluster 2024-09-21T01:19:24.227289+0000 mgr.a (mgr.14388) 8001 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:19:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:25 smithi044 bash[22676]: cluster 2024-09-21T01:19:24.227289+0000 mgr.a (mgr.14388) 8001 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:19:26.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:26.929 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:26 smithi179 bash[23186]: audit 2024-09-21T01:19:25.656086+0000 mon.a (mon.0) 6819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:26.929 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:26 smithi179 bash[23186]: audit 2024-09-21T01:19:25.663911+0000 mon.a (mon.0) 6820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:26.929 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:26 smithi179 bash[23186]: audit 2024-09-21T01:19:25.673810+0000 mon.a (mon.0) 6821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:26.929 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:26 smithi179 bash[23186]: audit 2024-09-21T01:19:25.814647+0000 mgr.a (mgr.14388) 8002 : audit [DBG] from='client.179892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:26.929 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:26 smithi179 bash[23186]: cluster 2024-09-21T01:19:26.228546+0000 mgr.a (mgr.14388) 8003 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:26 smithi044 bash[22676]: audit 2024-09-21T01:19:25.656086+0000 mon.a (mon.0) 6819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:26 smithi044 bash[22676]: audit 2024-09-21T01:19:25.663911+0000 mon.a (mon.0) 6820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:26 smithi044 bash[22676]: audit 2024-09-21T01:19:25.673810+0000 mon.a (mon.0) 6821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:26 smithi044 bash[22676]: audit 2024-09-21T01:19:25.814647+0000 mgr.a (mgr.14388) 8002 : audit [DBG] from='client.179892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:26 smithi044 bash[22676]: cluster 2024-09-21T01:19:26.228546+0000 mgr.a (mgr.14388) 8003 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:26 smithi049 bash[23528]: audit 2024-09-21T01:19:25.656086+0000 mon.a (mon.0) 6819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:26 smithi049 bash[23528]: audit 2024-09-21T01:19:25.663911+0000 mon.a (mon.0) 6820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:26 smithi049 bash[23528]: audit 2024-09-21T01:19:25.673810+0000 mon.a (mon.0) 6821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:26 smithi049 bash[23528]: audit 2024-09-21T01:19:25.814647+0000 mgr.a (mgr.14388) 8002 : audit [DBG] from='client.179892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:26 smithi049 bash[23528]: cluster 2024-09-21T01:19:26.228546+0000 mgr.a (mgr.14388) 8003 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:27 smithi044 bash[22676]: audit 2024-09-21T01:19:26.702786+0000 mon.a (mon.0) 6822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:27 smithi044 bash[22676]: audit 2024-09-21T01:19:26.709575+0000 mon.a (mon.0) 6823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:27 smithi044 bash[22676]: audit 2024-09-21T01:19:26.716926+0000 mon.a (mon.0) 6824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:27 smithi179 bash[23186]: audit 2024-09-21T01:19:26.702786+0000 mon.a (mon.0) 6822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:27 smithi179 bash[23186]: audit 2024-09-21T01:19:26.709575+0000 mon.a (mon.0) 6823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:27 smithi179 bash[23186]: audit 2024-09-21T01:19:26.716926+0000 mon.a (mon.0) 6824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:27 smithi049 bash[23528]: audit 2024-09-21T01:19:26.702786+0000 mon.a (mon.0) 6822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:27 smithi049 bash[23528]: audit 2024-09-21T01:19:26.709575+0000 mon.a (mon.0) 6823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:27 smithi049 bash[23528]: audit 2024-09-21T01:19:26.716926+0000 mon.a (mon.0) 6824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:28 smithi044 bash[22676]: cluster 2024-09-21T01:19:28.229112+0000 mgr.a (mgr.14388) 8004 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:19:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:28 smithi179 bash[23186]: cluster 2024-09-21T01:19:28.229112+0000 mgr.a (mgr.14388) 8004 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:19:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:28 smithi049 bash[23528]: cluster 2024-09-21T01:19:28.229112+0000 mgr.a (mgr.14388) 8004 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:19:31.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:31.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:31.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:31 smithi049 bash[23528]: cluster 2024-09-21T01:19:30.231008+0000 mgr.a (mgr.14388) 8005 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:31 smithi049 bash[23528]: audit 2024-09-21T01:19:30.447179+0000 mon.a (mon.0) 6825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:31 smithi049 bash[23528]: audit 2024-09-21T01:19:30.456577+0000 mon.a (mon.0) 6826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:31 smithi049 bash[23528]: audit 2024-09-21T01:19:30.467092+0000 mon.a (mon.0) 6827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:31 smithi044 bash[22676]: cluster 2024-09-21T01:19:30.231008+0000 mgr.a (mgr.14388) 8005 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:31 smithi044 bash[22676]: audit 2024-09-21T01:19:30.447179+0000 mon.a (mon.0) 6825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:31 smithi044 bash[22676]: audit 2024-09-21T01:19:30.456577+0000 mon.a (mon.0) 6826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:31 smithi044 bash[22676]: audit 2024-09-21T01:19:30.467092+0000 mon.a (mon.0) 6827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:31 smithi179 bash[23186]: cluster 2024-09-21T01:19:30.231008+0000 mgr.a (mgr.14388) 8005 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:31 smithi179 bash[23186]: audit 2024-09-21T01:19:30.447179+0000 mon.a (mon.0) 6825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:31 smithi179 bash[23186]: audit 2024-09-21T01:19:30.456577+0000 mon.a (mon.0) 6826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:31 smithi179 bash[23186]: audit 2024-09-21T01:19:30.467092+0000 mon.a (mon.0) 6827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:32.028 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:33.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:33 smithi049 bash[23528]: audit 2024-09-21T01:19:31.586137+0000 mgr.a (mgr.14388) 8006 : audit [DBG] from='client.179970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:33 smithi049 bash[23528]: cluster 2024-09-21T01:19:32.231928+0000 mgr.a (mgr.14388) 8007 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:33 smithi044 bash[22676]: audit 2024-09-21T01:19:31.586137+0000 mgr.a (mgr.14388) 8006 : audit [DBG] from='client.179970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:33 smithi044 bash[22676]: cluster 2024-09-21T01:19:32.231928+0000 mgr.a (mgr.14388) 8007 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:33 smithi179 bash[23186]: audit 2024-09-21T01:19:31.586137+0000 mgr.a (mgr.14388) 8006 : audit [DBG] from='client.179970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:33 smithi179 bash[23186]: cluster 2024-09-21T01:19:32.231928+0000 mgr.a (mgr.14388) 8007 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:35 smithi049 bash[23528]: cluster 2024-09-21T01:19:34.232740+0000 mgr.a (mgr.14388) 8008 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:35 smithi044 bash[22676]: cluster 2024-09-21T01:19:34.232740+0000 mgr.a (mgr.14388) 8008 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:35 smithi179 bash[23186]: cluster 2024-09-21T01:19:34.232740+0000 mgr.a (mgr.14388) 8008 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:37.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:37 smithi049 bash[23528]: cluster 2024-09-21T01:19:36.235020+0000 mgr.a (mgr.14388) 8009 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:37 smithi044 bash[22676]: cluster 2024-09-21T01:19:36.235020+0000 mgr.a (mgr.14388) 8009 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:37 smithi179 bash[23186]: cluster 2024-09-21T01:19:36.235020+0000 mgr.a (mgr.14388) 8009 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:37.792 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:39 smithi044 bash[22676]: audit 2024-09-21T01:19:37.362051+0000 mgr.a (mgr.14388) 8010 : audit [DBG] from='client.180045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:39 smithi044 bash[22676]: cluster 2024-09-21T01:19:38.235978+0000 mgr.a (mgr.14388) 8011 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:39 smithi179 bash[23186]: audit 2024-09-21T01:19:37.362051+0000 mgr.a (mgr.14388) 8010 : audit [DBG] from='client.180045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:39 smithi179 bash[23186]: cluster 2024-09-21T01:19:38.235978+0000 mgr.a (mgr.14388) 8011 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:39 smithi049 bash[23528]: audit 2024-09-21T01:19:37.362051+0000 mgr.a (mgr.14388) 8010 : audit [DBG] from='client.180045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:39 smithi049 bash[23528]: cluster 2024-09-21T01:19:38.235978+0000 mgr.a (mgr.14388) 8011 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:41 smithi044 bash[22676]: cluster 2024-09-21T01:19:40.238155+0000 mgr.a (mgr.14388) 8012 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:41 smithi179 bash[23186]: cluster 2024-09-21T01:19:40.238155+0000 mgr.a (mgr.14388) 8012 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:41 smithi049 bash[23528]: cluster 2024-09-21T01:19:40.238155+0000 mgr.a (mgr.14388) 8012 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:42.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:43.551 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:43.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:43.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:43.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:43.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:43.614 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:43 smithi179 bash[23186]: cluster 2024-09-21T01:19:42.238926+0000 mgr.a (mgr.14388) 8013 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:43.707 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:43 smithi049 bash[23528]: cluster 2024-09-21T01:19:42.238926+0000 mgr.a (mgr.14388) 8013 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:43 smithi044 bash[22676]: cluster 2024-09-21T01:19:42.238926+0000 mgr.a (mgr.14388) 8013 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:44 smithi044 bash[22676]: audit 2024-09-21T01:19:43.123892+0000 mgr.a (mgr.14388) 8014 : audit [DBG] from='client.180123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:44 smithi179 bash[23186]: audit 2024-09-21T01:19:43.123892+0000 mgr.a (mgr.14388) 8014 : audit [DBG] from='client.180123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:44 smithi049 bash[23528]: audit 2024-09-21T01:19:43.123892+0000 mgr.a (mgr.14388) 8014 : audit [DBG] from='client.180123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:45 smithi044 bash[22676]: cluster 2024-09-21T01:19:44.239940+0000 mgr.a (mgr.14388) 8015 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:45 smithi179 bash[23186]: cluster 2024-09-21T01:19:44.239940+0000 mgr.a (mgr.14388) 8015 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:45 smithi049 bash[23528]: cluster 2024-09-21T01:19:44.239940+0000 mgr.a (mgr.14388) 8015 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:47.149 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:46 smithi179 bash[23186]: audit 2024-09-21T01:19:45.849795+0000 mon.a (mon.0) 6828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.149 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:46 smithi179 bash[23186]: audit 2024-09-21T01:19:45.857797+0000 mon.a (mon.0) 6829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.149 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:46 smithi179 bash[23186]: audit 2024-09-21T01:19:45.868302+0000 mon.a (mon.0) 6830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.149 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:46 smithi179 bash[23186]: cluster 2024-09-21T01:19:46.242276+0000 mgr.a (mgr.14388) 8016 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:47.149 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:46 smithi179 bash[23186]: audit 2024-09-21T01:19:46.841983+0000 mon.a (mon.0) 6831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:46 smithi044 bash[22676]: audit 2024-09-21T01:19:45.849795+0000 mon.a (mon.0) 6828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:46 smithi044 bash[22676]: audit 2024-09-21T01:19:45.857797+0000 mon.a (mon.0) 6829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:46 smithi044 bash[22676]: audit 2024-09-21T01:19:45.868302+0000 mon.a (mon.0) 6830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:46 smithi044 bash[22676]: cluster 2024-09-21T01:19:46.242276+0000 mgr.a (mgr.14388) 8016 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:46 smithi044 bash[22676]: audit 2024-09-21T01:19:46.841983+0000 mon.a (mon.0) 6831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:46 smithi049 bash[23528]: audit 2024-09-21T01:19:45.849795+0000 mon.a (mon.0) 6828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:46 smithi049 bash[23528]: audit 2024-09-21T01:19:45.857797+0000 mon.a (mon.0) 6829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:46 smithi049 bash[23528]: audit 2024-09-21T01:19:45.868302+0000 mon.a (mon.0) 6830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:46 smithi049 bash[23528]: cluster 2024-09-21T01:19:46.242276+0000 mgr.a (mgr.14388) 8016 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:46 smithi049 bash[23528]: audit 2024-09-21T01:19:46.841983+0000 mon.a (mon.0) 6831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:47 smithi044 bash[22676]: audit 2024-09-21T01:19:46.847476+0000 mon.a (mon.0) 6832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:47 smithi044 bash[22676]: audit 2024-09-21T01:19:46.857832+0000 mon.a (mon.0) 6833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:47 smithi179 bash[23186]: audit 2024-09-21T01:19:46.847476+0000 mon.a (mon.0) 6832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:47 smithi179 bash[23186]: audit 2024-09-21T01:19:46.857832+0000 mon.a (mon.0) 6833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:47 smithi049 bash[23528]: audit 2024-09-21T01:19:46.847476+0000 mon.a (mon.0) 6832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:47 smithi049 bash[23528]: audit 2024-09-21T01:19:46.857832+0000 mon.a (mon.0) 6833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:48.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:48.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:48.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:48 smithi044 bash[22676]: cluster 2024-09-21T01:19:48.242803+0000 mgr.a (mgr.14388) 8017 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:48 smithi179 bash[23186]: cluster 2024-09-21T01:19:48.242803+0000 mgr.a (mgr.14388) 8017 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:48 smithi049 bash[23528]: cluster 2024-09-21T01:19:48.242803+0000 mgr.a (mgr.14388) 8017 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:49.341 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:49.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:49.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:49.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:49 smithi044 bash[22676]: audit 2024-09-21T01:19:48.887093+0000 mgr.a (mgr.14388) 8018 : audit [DBG] from='client.180201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:49 smithi179 bash[23186]: audit 2024-09-21T01:19:48.887093+0000 mgr.a (mgr.14388) 8018 : audit [DBG] from='client.180201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:49 smithi049 bash[23528]: audit 2024-09-21T01:19:48.887093+0000 mgr.a (mgr.14388) 8018 : audit [DBG] from='client.180201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:50 smithi049 bash[23528]: cluster 2024-09-21T01:19:50.245129+0000 mgr.a (mgr.14388) 8019 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:50 smithi049 bash[23528]: audit 2024-09-21T01:19:50.670098+0000 mon.a (mon.0) 6834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:50 smithi049 bash[23528]: audit 2024-09-21T01:19:50.678678+0000 mon.a (mon.0) 6835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:50 smithi049 bash[23528]: audit 2024-09-21T01:19:50.689378+0000 mon.a (mon.0) 6836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:50 smithi044 bash[22676]: cluster 2024-09-21T01:19:50.245129+0000 mgr.a (mgr.14388) 8019 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:50 smithi044 bash[22676]: audit 2024-09-21T01:19:50.670098+0000 mon.a (mon.0) 6834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:50 smithi044 bash[22676]: audit 2024-09-21T01:19:50.678678+0000 mon.a (mon.0) 6835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:50 smithi044 bash[22676]: audit 2024-09-21T01:19:50.689378+0000 mon.a (mon.0) 6836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:50 smithi179 bash[23186]: cluster 2024-09-21T01:19:50.245129+0000 mgr.a (mgr.14388) 8019 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:19:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:50 smithi179 bash[23186]: audit 2024-09-21T01:19:50.670098+0000 mon.a (mon.0) 6834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:50 smithi179 bash[23186]: audit 2024-09-21T01:19:50.678678+0000 mon.a (mon.0) 6835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:50 smithi179 bash[23186]: audit 2024-09-21T01:19:50.689378+0000 mon.a (mon.0) 6836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:52.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:51 smithi044 bash[22676]: audit 2024-09-21T01:19:51.326780+0000 mon.a (mon.0) 6837 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:19:52.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:51 smithi044 bash[22676]: audit 2024-09-21T01:19:51.333967+0000 mon.a (mon.0) 6838 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:19:52.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:51 smithi044 bash[22676]: audit 2024-09-21T01:19:51.336143+0000 mon.a (mon.0) 6839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:19:52.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:51 smithi044 bash[22676]: audit 2024-09-21T01:19:51.348196+0000 mon.a (mon.0) 6840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:52.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:51 smithi044 bash[22676]: audit 2024-09-21T01:19:51.354393+0000 mon.a (mon.0) 6841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:19:52.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:51 smithi044 bash[22676]: audit 2024-09-21T01:19:51.356808+0000 mgr.a (mgr.14388) 8020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:19:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:51 smithi179 bash[23186]: audit 2024-09-21T01:19:51.326780+0000 mon.a (mon.0) 6837 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:19:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:51 smithi179 bash[23186]: audit 2024-09-21T01:19:51.333967+0000 mon.a (mon.0) 6838 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:19:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:51 smithi179 bash[23186]: audit 2024-09-21T01:19:51.336143+0000 mon.a (mon.0) 6839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:19:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:51 smithi179 bash[23186]: audit 2024-09-21T01:19:51.348196+0000 mon.a (mon.0) 6840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:51 smithi179 bash[23186]: audit 2024-09-21T01:19:51.354393+0000 mon.a (mon.0) 6841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:19:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:51 smithi179 bash[23186]: audit 2024-09-21T01:19:51.356808+0000 mgr.a (mgr.14388) 8020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:19:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:51 smithi049 bash[23528]: audit 2024-09-21T01:19:51.326780+0000 mon.a (mon.0) 6837 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:19:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:51 smithi049 bash[23528]: audit 2024-09-21T01:19:51.333967+0000 mon.a (mon.0) 6838 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:19:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:51 smithi049 bash[23528]: audit 2024-09-21T01:19:51.336143+0000 mon.a (mon.0) 6839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:19:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:51 smithi049 bash[23528]: audit 2024-09-21T01:19:51.348196+0000 mon.a (mon.0) 6840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:19:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:51 smithi049 bash[23528]: audit 2024-09-21T01:19:51.354393+0000 mon.a (mon.0) 6841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:19:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:51 smithi049 bash[23528]: audit 2024-09-21T01:19:51.356808+0000 mgr.a (mgr.14388) 8020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:19:52.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:19:52 smithi044 bash[22930]: debug 2024-09-21T01:19:52.151+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:19:52.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:19:52 smithi044 bash[22930]: debug 2024-09-21T01:19:52.151+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:19:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:52 smithi044 bash[22676]: audit 2024-09-21T01:19:52.154476+0000 mgr.a (mgr.14388) 8021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:19:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:52 smithi044 bash[22676]: cephadm 2024-09-21T01:19:52.156487+0000 mgr.a (mgr.14388) 8022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:19:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:52 smithi044 bash[22676]: cluster 2024-09-21T01:19:52.245976+0000 mgr.a (mgr.14388) 8023 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:52 smithi179 bash[23186]: audit 2024-09-21T01:19:52.154476+0000 mgr.a (mgr.14388) 8021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:19:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:52 smithi179 bash[23186]: cephadm 2024-09-21T01:19:52.156487+0000 mgr.a (mgr.14388) 8022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:19:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:52 smithi179 bash[23186]: cluster 2024-09-21T01:19:52.245976+0000 mgr.a (mgr.14388) 8023 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:52 smithi049 bash[23528]: audit 2024-09-21T01:19:52.154476+0000 mgr.a (mgr.14388) 8021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:19:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:52 smithi049 bash[23528]: cephadm 2024-09-21T01:19:52.156487+0000 mgr.a (mgr.14388) 8022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:19:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:52 smithi049 bash[23528]: cluster 2024-09-21T01:19:52.245976+0000 mgr.a (mgr.14388) 8023 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:19:54.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:19:54.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:19:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:19:55.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:19:55.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:19:55.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:19:55.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:19:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:55 smithi044 bash[22676]: cluster 2024-09-21T01:19:54.246878+0000 mgr.a (mgr.14388) 8024 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:55 smithi179 bash[23186]: cluster 2024-09-21T01:19:54.246878+0000 mgr.a (mgr.14388) 8024 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:55 smithi049 bash[23528]: cluster 2024-09-21T01:19:54.246878+0000 mgr.a (mgr.14388) 8024 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:19:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:56 smithi044 bash[22676]: audit 2024-09-21T01:19:54.681157+0000 mgr.a (mgr.14388) 8025 : audit [DBG] from='client.180384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:56 smithi179 bash[23186]: audit 2024-09-21T01:19:54.681157+0000 mgr.a (mgr.14388) 8025 : audit [DBG] from='client.180384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:56 smithi049 bash[23528]: audit 2024-09-21T01:19:54.681157+0000 mgr.a (mgr.14388) 8025 : audit [DBG] from='client.180384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:19:57.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:57 smithi044 bash[22676]: cluster 2024-09-21T01:19:56.249782+0000 mgr.a (mgr.14388) 8026 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:57 smithi179 bash[23186]: cluster 2024-09-21T01:19:56.249782+0000 mgr.a (mgr.14388) 8026 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:57 smithi049 bash[23528]: cluster 2024-09-21T01:19:56.249782+0000 mgr.a (mgr.14388) 8026 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:19:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:19:59 smithi044 bash[22676]: cluster 2024-09-21T01:19:58.250566+0000 mgr.a (mgr.14388) 8027 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:19:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:19:59 smithi179 bash[23186]: cluster 2024-09-21T01:19:58.250566+0000 mgr.a (mgr.14388) 8027 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:19:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:19:59 smithi049 bash[23528]: cluster 2024-09-21T01:19:58.250566+0000 mgr.a (mgr.14388) 8027 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:20:00.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:00.612 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:00 smithi049 bash[23528]: cluster 2024-09-21T01:20:00.000149+0000 mon.a (mon.0) 6842 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:20:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:00 smithi044 bash[22676]: cluster 2024-09-21T01:20:00.000149+0000 mon.a (mon.0) 6842 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:20:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:00 smithi179 bash[23186]: cluster 2024-09-21T01:20:00.000149+0000 mon.a (mon.0) 6842 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:20:00.882 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:00.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:00.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:00.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:00.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:01.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:01 smithi049 bash[23528]: cluster 2024-09-21T01:20:00.251880+0000 mgr.a (mgr.14388) 8028 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:01 smithi044 bash[22676]: cluster 2024-09-21T01:20:00.251880+0000 mgr.a (mgr.14388) 8028 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:01 smithi179 bash[23186]: cluster 2024-09-21T01:20:00.251880+0000 mgr.a (mgr.14388) 8028 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:02 smithi049 bash[23528]: audit 2024-09-21T01:20:00.467024+0000 mgr.a (mgr.14388) 8029 : audit [DBG] from='client.180462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:02 smithi044 bash[22676]: audit 2024-09-21T01:20:00.467024+0000 mgr.a (mgr.14388) 8029 : audit [DBG] from='client.180462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:02 smithi179 bash[23186]: audit 2024-09-21T01:20:00.467024+0000 mgr.a (mgr.14388) 8029 : audit [DBG] from='client.180462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:03.719 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:03 smithi179 bash[23186]: cluster 2024-09-21T01:20:02.252752+0000 mgr.a (mgr.14388) 8030 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:20:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:03 smithi044 bash[22676]: cluster 2024-09-21T01:20:02.252752+0000 mgr.a (mgr.14388) 8030 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:20:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:03 smithi049 bash[23528]: cluster 2024-09-21T01:20:02.252752+0000 mgr.a (mgr.14388) 8030 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:20:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:05 smithi044 bash[22676]: cluster 2024-09-21T01:20:04.253558+0000 mgr.a (mgr.14388) 8031 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:20:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:05 smithi179 bash[23186]: cluster 2024-09-21T01:20:04.253558+0000 mgr.a (mgr.14388) 8031 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:20:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:05 smithi049 bash[23528]: cluster 2024-09-21T01:20:04.253558+0000 mgr.a (mgr.14388) 8031 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:20:05.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:05.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:05.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:06.654 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:06.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:06.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:06.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:06.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:07 smithi049 bash[23528]: audit 2024-09-21T01:20:06.010521+0000 mon.a (mon.0) 6843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:07 smithi049 bash[23528]: audit 2024-09-21T01:20:06.018145+0000 mon.a (mon.0) 6844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:07 smithi049 bash[23528]: audit 2024-09-21T01:20:06.026160+0000 mon.a (mon.0) 6845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:07 smithi049 bash[23528]: audit 2024-09-21T01:20:06.227230+0000 mgr.a (mgr.14388) 8032 : audit [DBG] from='client.180537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:07 smithi049 bash[23528]: cluster 2024-09-21T01:20:06.254896+0000 mgr.a (mgr.14388) 8033 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:07 smithi044 bash[22676]: audit 2024-09-21T01:20:06.010521+0000 mon.a (mon.0) 6843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:07 smithi044 bash[22676]: audit 2024-09-21T01:20:06.018145+0000 mon.a (mon.0) 6844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:07 smithi044 bash[22676]: audit 2024-09-21T01:20:06.026160+0000 mon.a (mon.0) 6845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:07 smithi044 bash[22676]: audit 2024-09-21T01:20:06.227230+0000 mgr.a (mgr.14388) 8032 : audit [DBG] from='client.180537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:07 smithi044 bash[22676]: cluster 2024-09-21T01:20:06.254896+0000 mgr.a (mgr.14388) 8033 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:07 smithi179 bash[23186]: audit 2024-09-21T01:20:06.010521+0000 mon.a (mon.0) 6843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:07 smithi179 bash[23186]: audit 2024-09-21T01:20:06.018145+0000 mon.a (mon.0) 6844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:07 smithi179 bash[23186]: audit 2024-09-21T01:20:06.026160+0000 mon.a (mon.0) 6845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:07 smithi179 bash[23186]: audit 2024-09-21T01:20:06.227230+0000 mgr.a (mgr.14388) 8032 : audit [DBG] from='client.180537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:07 smithi179 bash[23186]: cluster 2024-09-21T01:20:06.254896+0000 mgr.a (mgr.14388) 8033 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:08 smithi044 bash[22676]: audit 2024-09-21T01:20:07.032100+0000 mon.a (mon.0) 6846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:08 smithi044 bash[22676]: audit 2024-09-21T01:20:07.037133+0000 mon.a (mon.0) 6847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:08 smithi044 bash[22676]: audit 2024-09-21T01:20:07.042599+0000 mon.a (mon.0) 6848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:08 smithi049 bash[23528]: audit 2024-09-21T01:20:07.032100+0000 mon.a (mon.0) 6846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:08 smithi049 bash[23528]: audit 2024-09-21T01:20:07.037133+0000 mon.a (mon.0) 6847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:08 smithi049 bash[23528]: audit 2024-09-21T01:20:07.042599+0000 mon.a (mon.0) 6848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:08 smithi179 bash[23186]: audit 2024-09-21T01:20:07.032100+0000 mon.a (mon.0) 6846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:08 smithi179 bash[23186]: audit 2024-09-21T01:20:07.037133+0000 mon.a (mon.0) 6847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:08 smithi179 bash[23186]: audit 2024-09-21T01:20:07.042599+0000 mon.a (mon.0) 6848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:09 smithi049 bash[23528]: cluster 2024-09-21T01:20:08.255567+0000 mgr.a (mgr.14388) 8034 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:20:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:09 smithi044 bash[22676]: cluster 2024-09-21T01:20:08.255567+0000 mgr.a (mgr.14388) 8034 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:20:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:09 smithi179 bash[23186]: cluster 2024-09-21T01:20:08.255567+0000 mgr.a (mgr.14388) 8034 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:20:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:11.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:11.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:11 smithi044 bash[22676]: cluster 2024-09-21T01:20:10.257685+0000 mgr.a (mgr.14388) 8035 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:20:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:11 smithi044 bash[22676]: audit 2024-09-21T01:20:10.879595+0000 mon.a (mon.0) 6849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:11 smithi044 bash[22676]: audit 2024-09-21T01:20:10.888740+0000 mon.a (mon.0) 6850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:11 smithi044 bash[22676]: audit 2024-09-21T01:20:10.900684+0000 mon.a (mon.0) 6851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:11 smithi179 bash[23186]: cluster 2024-09-21T01:20:10.257685+0000 mgr.a (mgr.14388) 8035 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:20:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:11 smithi179 bash[23186]: audit 2024-09-21T01:20:10.879595+0000 mon.a (mon.0) 6849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:11 smithi179 bash[23186]: audit 2024-09-21T01:20:10.888740+0000 mon.a (mon.0) 6850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:11 smithi179 bash[23186]: audit 2024-09-21T01:20:10.900684+0000 mon.a (mon.0) 6851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:11 smithi049 bash[23528]: cluster 2024-09-21T01:20:10.257685+0000 mgr.a (mgr.14388) 8035 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:20:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:11 smithi049 bash[23528]: audit 2024-09-21T01:20:10.879595+0000 mon.a (mon.0) 6849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:11 smithi049 bash[23528]: audit 2024-09-21T01:20:10.888740+0000 mon.a (mon.0) 6850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:11 smithi049 bash[23528]: audit 2024-09-21T01:20:10.900684+0000 mon.a (mon.0) 6851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:12.431 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:12.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:12.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:12.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:12.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:13 smithi044 bash[22676]: audit 2024-09-21T01:20:11.984868+0000 mgr.a (mgr.14388) 8036 : audit [DBG] from='client.180615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:13 smithi044 bash[22676]: cluster 2024-09-21T01:20:12.258288+0000 mgr.a (mgr.14388) 8037 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:13 smithi179 bash[23186]: audit 2024-09-21T01:20:11.984868+0000 mgr.a (mgr.14388) 8036 : audit [DBG] from='client.180615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:13 smithi179 bash[23186]: cluster 2024-09-21T01:20:12.258288+0000 mgr.a (mgr.14388) 8037 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:13 smithi049 bash[23528]: audit 2024-09-21T01:20:11.984868+0000 mgr.a (mgr.14388) 8036 : audit [DBG] from='client.180615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:13 smithi049 bash[23528]: cluster 2024-09-21T01:20:12.258288+0000 mgr.a (mgr.14388) 8037 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:15 smithi044 bash[22676]: cluster 2024-09-21T01:20:14.259169+0000 mgr.a (mgr.14388) 8038 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:15 smithi179 bash[23186]: cluster 2024-09-21T01:20:14.259169+0000 mgr.a (mgr.14388) 8038 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:15 smithi049 bash[23528]: cluster 2024-09-21T01:20:14.259169+0000 mgr.a (mgr.14388) 8038 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:17.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:17.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:17.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:17 smithi044 bash[22676]: cluster 2024-09-21T01:20:16.261478+0000 mgr.a (mgr.14388) 8039 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:17 smithi179 bash[23186]: cluster 2024-09-21T01:20:16.261478+0000 mgr.a (mgr.14388) 8039 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:17 smithi049 bash[23528]: cluster 2024-09-21T01:20:16.261478+0000 mgr.a (mgr.14388) 8039 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:18.210 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:18.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:18.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:18.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:18.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:19 smithi044 bash[22676]: audit 2024-09-21T01:20:17.764299+0000 mgr.a (mgr.14388) 8040 : audit [DBG] from='client.180693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:19 smithi044 bash[22676]: cluster 2024-09-21T01:20:18.261999+0000 mgr.a (mgr.14388) 8041 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:19 smithi179 bash[23186]: audit 2024-09-21T01:20:17.764299+0000 mgr.a (mgr.14388) 8040 : audit [DBG] from='client.180693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:19 smithi179 bash[23186]: cluster 2024-09-21T01:20:18.261999+0000 mgr.a (mgr.14388) 8041 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:19.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:19 smithi049 bash[23528]: audit 2024-09-21T01:20:17.764299+0000 mgr.a (mgr.14388) 8040 : audit [DBG] from='client.180693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:19.780 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:19 smithi049 bash[23528]: cluster 2024-09-21T01:20:18.261999+0000 mgr.a (mgr.14388) 8041 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:21.644 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:21 smithi049 bash[23528]: cluster 2024-09-21T01:20:20.264114+0000 mgr.a (mgr.14388) 8042 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:21 smithi044 bash[22676]: cluster 2024-09-21T01:20:20.264114+0000 mgr.a (mgr.14388) 8042 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:21 smithi179 bash[23186]: cluster 2024-09-21T01:20:20.264114+0000 mgr.a (mgr.14388) 8042 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:23.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:23.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:23.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:23.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:23 smithi049 bash[23528]: cluster 2024-09-21T01:20:22.264901+0000 mgr.a (mgr.14388) 8043 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:23.634 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:23 smithi179 bash[23186]: cluster 2024-09-21T01:20:22.264901+0000 mgr.a (mgr.14388) 8043 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:23 smithi044 bash[22676]: cluster 2024-09-21T01:20:22.264901+0000 mgr.a (mgr.14388) 8043 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:23.944 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:25 smithi044 bash[22676]: audit 2024-09-21T01:20:23.536877+0000 mgr.a (mgr.14388) 8044 : audit [DBG] from='client.180771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:25 smithi044 bash[22676]: cluster 2024-09-21T01:20:24.265902+0000 mgr.a (mgr.14388) 8045 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:25 smithi179 bash[23186]: audit 2024-09-21T01:20:23.536877+0000 mgr.a (mgr.14388) 8044 : audit [DBG] from='client.180771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:25 smithi179 bash[23186]: cluster 2024-09-21T01:20:24.265902+0000 mgr.a (mgr.14388) 8045 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:25 smithi049 bash[23528]: audit 2024-09-21T01:20:23.536877+0000 mgr.a (mgr.14388) 8044 : audit [DBG] from='client.180771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:25 smithi049 bash[23528]: cluster 2024-09-21T01:20:24.265902+0000 mgr.a (mgr.14388) 8045 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:27 smithi044 bash[22676]: audit 2024-09-21T01:20:26.171316+0000 mon.a (mon.0) 6852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:27 smithi044 bash[22676]: audit 2024-09-21T01:20:26.177489+0000 mon.a (mon.0) 6853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:27 smithi044 bash[22676]: audit 2024-09-21T01:20:26.187928+0000 mon.a (mon.0) 6854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:27 smithi044 bash[22676]: cluster 2024-09-21T01:20:26.267396+0000 mgr.a (mgr.14388) 8046 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:27 smithi179 bash[23186]: audit 2024-09-21T01:20:26.171316+0000 mon.a (mon.0) 6852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:27 smithi179 bash[23186]: audit 2024-09-21T01:20:26.177489+0000 mon.a (mon.0) 6853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:27 smithi179 bash[23186]: audit 2024-09-21T01:20:26.187928+0000 mon.a (mon.0) 6854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:27 smithi179 bash[23186]: cluster 2024-09-21T01:20:26.267396+0000 mgr.a (mgr.14388) 8046 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:27.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:27 smithi049 bash[23528]: audit 2024-09-21T01:20:26.171316+0000 mon.a (mon.0) 6852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:27 smithi049 bash[23528]: audit 2024-09-21T01:20:26.177489+0000 mon.a (mon.0) 6853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:27 smithi049 bash[23528]: audit 2024-09-21T01:20:26.187928+0000 mon.a (mon.0) 6854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:27 smithi049 bash[23528]: cluster 2024-09-21T01:20:26.267396+0000 mgr.a (mgr.14388) 8046 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:28 smithi044 bash[22676]: audit 2024-09-21T01:20:27.181613+0000 mon.a (mon.0) 6855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:28 smithi044 bash[22676]: audit 2024-09-21T01:20:27.186531+0000 mon.a (mon.0) 6856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:28 smithi044 bash[22676]: audit 2024-09-21T01:20:27.196627+0000 mon.a (mon.0) 6857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:28 smithi179 bash[23186]: audit 2024-09-21T01:20:27.181613+0000 mon.a (mon.0) 6855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:28 smithi179 bash[23186]: audit 2024-09-21T01:20:27.186531+0000 mon.a (mon.0) 6856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:28 smithi179 bash[23186]: audit 2024-09-21T01:20:27.196627+0000 mon.a (mon.0) 6857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:28 smithi049 bash[23528]: audit 2024-09-21T01:20:27.181613+0000 mon.a (mon.0) 6855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:28 smithi049 bash[23528]: audit 2024-09-21T01:20:27.186531+0000 mon.a (mon.0) 6856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:28 smithi049 bash[23528]: audit 2024-09-21T01:20:27.196627+0000 mon.a (mon.0) 6857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:28.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:28.947 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:28.947 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:29 smithi044 bash[22676]: cluster 2024-09-21T01:20:28.268093+0000 mgr.a (mgr.14388) 8047 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:29 smithi179 bash[23186]: cluster 2024-09-21T01:20:28.268093+0000 mgr.a (mgr.14388) 8047 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:29 smithi049 bash[23528]: cluster 2024-09-21T01:20:28.268093+0000 mgr.a (mgr.14388) 8047 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:29.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:29.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:29.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:29.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:30 smithi044 bash[22676]: audit 2024-09-21T01:20:29.287702+0000 mgr.a (mgr.14388) 8048 : audit [DBG] from='client.180846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:30 smithi179 bash[23186]: audit 2024-09-21T01:20:29.287702+0000 mgr.a (mgr.14388) 8048 : audit [DBG] from='client.180846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:30 smithi049 bash[23528]: audit 2024-09-21T01:20:29.287702+0000 mgr.a (mgr.14388) 8048 : audit [DBG] from='client.180846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:31 smithi044 bash[22676]: cluster 2024-09-21T01:20:30.270617+0000 mgr.a (mgr.14388) 8049 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:31.554 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:31 smithi044 bash[22676]: audit 2024-09-21T01:20:31.095881+0000 mon.a (mon.0) 6858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.554 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:31 smithi044 bash[22676]: audit 2024-09-21T01:20:31.104680+0000 mon.a (mon.0) 6859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.554 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:31 smithi044 bash[22676]: audit 2024-09-21T01:20:31.115137+0000 mon.a (mon.0) 6860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:31 smithi049 bash[23528]: cluster 2024-09-21T01:20:30.270617+0000 mgr.a (mgr.14388) 8049 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:31 smithi049 bash[23528]: audit 2024-09-21T01:20:31.095881+0000 mon.a (mon.0) 6858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:31 smithi049 bash[23528]: audit 2024-09-21T01:20:31.104680+0000 mon.a (mon.0) 6859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:31 smithi049 bash[23528]: audit 2024-09-21T01:20:31.115137+0000 mon.a (mon.0) 6860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.555 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:31 smithi179 bash[23186]: cluster 2024-09-21T01:20:30.270617+0000 mgr.a (mgr.14388) 8049 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:31.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:31 smithi179 bash[23186]: audit 2024-09-21T01:20:31.095881+0000 mon.a (mon.0) 6858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:31 smithi179 bash[23186]: audit 2024-09-21T01:20:31.104680+0000 mon.a (mon.0) 6859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:31.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:31 smithi179 bash[23186]: audit 2024-09-21T01:20:31.115137+0000 mon.a (mon.0) 6860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:33 smithi044 bash[22676]: cluster 2024-09-21T01:20:32.271456+0000 mgr.a (mgr.14388) 8050 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:33 smithi179 bash[23186]: cluster 2024-09-21T01:20:32.271456+0000 mgr.a (mgr.14388) 8050 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:33 smithi049 bash[23528]: cluster 2024-09-21T01:20:32.271456+0000 mgr.a (mgr.14388) 8050 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:34.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:35.513 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:35 smithi044 bash[22676]: cluster 2024-09-21T01:20:34.272239+0000 mgr.a (mgr.14388) 8051 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:35 smithi179 bash[23186]: cluster 2024-09-21T01:20:34.272239+0000 mgr.a (mgr.14388) 8051 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:35 smithi049 bash[23528]: cluster 2024-09-21T01:20:34.272239+0000 mgr.a (mgr.14388) 8051 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:36 smithi044 bash[22676]: audit 2024-09-21T01:20:35.094255+0000 mgr.a (mgr.14388) 8052 : audit [DBG] from='client.180924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:36 smithi179 bash[23186]: audit 2024-09-21T01:20:35.094255+0000 mgr.a (mgr.14388) 8052 : audit [DBG] from='client.180924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:36 smithi049 bash[23528]: audit 2024-09-21T01:20:35.094255+0000 mgr.a (mgr.14388) 8052 : audit [DBG] from='client.180924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:37 smithi044 bash[22676]: cluster 2024-09-21T01:20:36.275160+0000 mgr.a (mgr.14388) 8053 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:37 smithi179 bash[23186]: cluster 2024-09-21T01:20:36.275160+0000 mgr.a (mgr.14388) 8053 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:37 smithi049 bash[23528]: cluster 2024-09-21T01:20:36.275160+0000 mgr.a (mgr.14388) 8053 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:39 smithi044 bash[22676]: cluster 2024-09-21T01:20:38.275966+0000 mgr.a (mgr.14388) 8054 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:20:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:39 smithi179 bash[23186]: cluster 2024-09-21T01:20:38.275966+0000 mgr.a (mgr.14388) 8054 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:20:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:39 smithi049 bash[23528]: cluster 2024-09-21T01:20:38.275966+0000 mgr.a (mgr.14388) 8054 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:20:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:40.515 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:41.310 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:41 smithi044 bash[22676]: cluster 2024-09-21T01:20:40.277899+0000 mgr.a (mgr.14388) 8055 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:41 smithi179 bash[23186]: cluster 2024-09-21T01:20:40.277899+0000 mgr.a (mgr.14388) 8055 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:41 smithi049 bash[23528]: cluster 2024-09-21T01:20:40.277899+0000 mgr.a (mgr.14388) 8055 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:42 smithi044 bash[22676]: audit 2024-09-21T01:20:40.853452+0000 mgr.a (mgr.14388) 8056 : audit [DBG] from='client.180999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:42 smithi179 bash[23186]: audit 2024-09-21T01:20:40.853452+0000 mgr.a (mgr.14388) 8056 : audit [DBG] from='client.180999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:42.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:42 smithi049 bash[23528]: audit 2024-09-21T01:20:40.853452+0000 mgr.a (mgr.14388) 8056 : audit [DBG] from='client.180999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:43.657 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:43 smithi049 bash[23528]: cluster 2024-09-21T01:20:42.278829+0000 mgr.a (mgr.14388) 8057 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:20:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:43 smithi044 bash[22676]: cluster 2024-09-21T01:20:42.278829+0000 mgr.a (mgr.14388) 8057 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:20:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:43 smithi179 bash[23186]: cluster 2024-09-21T01:20:42.278829+0000 mgr.a (mgr.14388) 8057 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:20:45.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:45 smithi179 bash[23186]: cluster 2024-09-21T01:20:44.279667+0000 mgr.a (mgr.14388) 8058 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:20:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:45 smithi044 bash[22676]: cluster 2024-09-21T01:20:44.279667+0000 mgr.a (mgr.14388) 8058 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:20:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:45 smithi049 bash[23528]: cluster 2024-09-21T01:20:44.279667+0000 mgr.a (mgr.14388) 8058 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:20:46.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:46.312 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:46.312 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:47.103 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:47.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:47.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:47.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:47.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:47.595 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:47 smithi179 bash[23186]: cluster 2024-09-21T01:20:46.281948+0000 mgr.a (mgr.14388) 8059 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:47.595 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:47 smithi179 bash[23186]: audit 2024-09-21T01:20:46.328759+0000 mon.a (mon.0) 6861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.595 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:47 smithi179 bash[23186]: audit 2024-09-21T01:20:46.334438+0000 mon.a (mon.0) 6862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.595 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:47 smithi179 bash[23186]: audit 2024-09-21T01:20:46.341952+0000 mon.a (mon.0) 6863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:47 smithi044 bash[22676]: cluster 2024-09-21T01:20:46.281948+0000 mgr.a (mgr.14388) 8059 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:47 smithi044 bash[22676]: audit 2024-09-21T01:20:46.328759+0000 mon.a (mon.0) 6861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:47 smithi044 bash[22676]: audit 2024-09-21T01:20:46.334438+0000 mon.a (mon.0) 6862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:47 smithi044 bash[22676]: audit 2024-09-21T01:20:46.341952+0000 mon.a (mon.0) 6863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:47 smithi049 bash[23528]: cluster 2024-09-21T01:20:46.281948+0000 mgr.a (mgr.14388) 8059 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:47 smithi049 bash[23528]: audit 2024-09-21T01:20:46.328759+0000 mon.a (mon.0) 6861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:47 smithi049 bash[23528]: audit 2024-09-21T01:20:46.334438+0000 mon.a (mon.0) 6862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:47 smithi049 bash[23528]: audit 2024-09-21T01:20:46.341952+0000 mon.a (mon.0) 6863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.704 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:48 smithi044 bash[22676]: audit 2024-09-21T01:20:46.649968+0000 mgr.a (mgr.14388) 8060 : audit [DBG] from='client.181071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:48.704 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:48 smithi044 bash[22676]: audit 2024-09-21T01:20:47.368523+0000 mon.a (mon.0) 6864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.705 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:48 smithi044 bash[22676]: audit 2024-09-21T01:20:47.374339+0000 mon.a (mon.0) 6865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.705 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:48 smithi044 bash[22676]: audit 2024-09-21T01:20:47.383805+0000 mon.a (mon.0) 6866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:48 smithi179 bash[23186]: audit 2024-09-21T01:20:46.649968+0000 mgr.a (mgr.14388) 8060 : audit [DBG] from='client.181071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:48 smithi179 bash[23186]: audit 2024-09-21T01:20:47.368523+0000 mon.a (mon.0) 6864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:48 smithi179 bash[23186]: audit 2024-09-21T01:20:47.374339+0000 mon.a (mon.0) 6865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:48 smithi179 bash[23186]: audit 2024-09-21T01:20:47.383805+0000 mon.a (mon.0) 6866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:48 smithi049 bash[23528]: audit 2024-09-21T01:20:46.649968+0000 mgr.a (mgr.14388) 8060 : audit [DBG] from='client.181071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:48 smithi049 bash[23528]: audit 2024-09-21T01:20:47.368523+0000 mon.a (mon.0) 6864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:48 smithi049 bash[23528]: audit 2024-09-21T01:20:47.374339+0000 mon.a (mon.0) 6865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:48 smithi049 bash[23528]: audit 2024-09-21T01:20:47.383805+0000 mon.a (mon.0) 6866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:49 smithi044 bash[22676]: cluster 2024-09-21T01:20:48.282836+0000 mgr.a (mgr.14388) 8061 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:49 smithi179 bash[23186]: cluster 2024-09-21T01:20:48.282836+0000 mgr.a (mgr.14388) 8061 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:49 smithi049 bash[23528]: cluster 2024-09-21T01:20:48.282836+0000 mgr.a (mgr.14388) 8061 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:51 smithi044 bash[22676]: cluster 2024-09-21T01:20:50.285026+0000 mgr.a (mgr.14388) 8062 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:51 smithi044 bash[22676]: audit 2024-09-21T01:20:51.304715+0000 mon.a (mon.0) 6867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:51 smithi044 bash[22676]: audit 2024-09-21T01:20:51.313127+0000 mon.a (mon.0) 6868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:51 smithi044 bash[22676]: audit 2024-09-21T01:20:51.323458+0000 mon.a (mon.0) 6869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:51 smithi179 bash[23186]: cluster 2024-09-21T01:20:50.285026+0000 mgr.a (mgr.14388) 8062 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:51 smithi179 bash[23186]: audit 2024-09-21T01:20:51.304715+0000 mon.a (mon.0) 6867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:51 smithi179 bash[23186]: audit 2024-09-21T01:20:51.313127+0000 mon.a (mon.0) 6868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:51 smithi179 bash[23186]: audit 2024-09-21T01:20:51.323458+0000 mon.a (mon.0) 6869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:51 smithi049 bash[23528]: cluster 2024-09-21T01:20:50.285026+0000 mgr.a (mgr.14388) 8062 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:20:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:51 smithi049 bash[23528]: audit 2024-09-21T01:20:51.304715+0000 mon.a (mon.0) 6867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:51 smithi049 bash[23528]: audit 2024-09-21T01:20:51.313127+0000 mon.a (mon.0) 6868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:51 smithi049 bash[23528]: audit 2024-09-21T01:20:51.323458+0000 mon.a (mon.0) 6869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:52 smithi044 bash[22676]: audit 2024-09-21T01:20:52.231871+0000 mon.a (mon.0) 6870 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:20:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:52 smithi044 bash[22676]: audit 2024-09-21T01:20:52.234767+0000 mon.a (mon.0) 6871 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:20:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:52 smithi044 bash[22676]: audit 2024-09-21T01:20:52.235708+0000 mon.a (mon.0) 6872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:20:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:52 smithi044 bash[22676]: audit 2024-09-21T01:20:52.241102+0000 mon.a (mon.0) 6873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:52 smithi044 bash[22676]: audit 2024-09-21T01:20:52.243718+0000 mon.a (mon.0) 6874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:20:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:52 smithi179 bash[23186]: audit 2024-09-21T01:20:52.231871+0000 mon.a (mon.0) 6870 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:20:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:52 smithi179 bash[23186]: audit 2024-09-21T01:20:52.234767+0000 mon.a (mon.0) 6871 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:20:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:52 smithi179 bash[23186]: audit 2024-09-21T01:20:52.235708+0000 mon.a (mon.0) 6872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:20:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:52 smithi179 bash[23186]: audit 2024-09-21T01:20:52.241102+0000 mon.a (mon.0) 6873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:52 smithi179 bash[23186]: audit 2024-09-21T01:20:52.243718+0000 mon.a (mon.0) 6874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:20:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:52 smithi049 bash[23528]: audit 2024-09-21T01:20:52.231871+0000 mon.a (mon.0) 6870 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:20:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:52 smithi049 bash[23528]: audit 2024-09-21T01:20:52.234767+0000 mon.a (mon.0) 6871 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:20:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:52 smithi049 bash[23528]: audit 2024-09-21T01:20:52.235708+0000 mon.a (mon.0) 6872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:20:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:52 smithi049 bash[23528]: audit 2024-09-21T01:20:52.241102+0000 mon.a (mon.0) 6873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:20:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:52 smithi049 bash[23528]: audit 2024-09-21T01:20:52.243718+0000 mon.a (mon.0) 6874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:20:53.377 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:20:52 smithi044 bash[22930]: debug 2024-09-21T01:20:52.994+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:20:53.377 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:20:53 smithi044 bash[22930]: debug 2024-09-21T01:20:53.006+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:20:53.413 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:53.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:53.414 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:53 smithi044 bash[22676]: audit 2024-09-21T01:20:52.245184+0000 mgr.a (mgr.14388) 8063 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:20:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:53 smithi044 bash[22676]: cluster 2024-09-21T01:20:52.286011+0000 mgr.a (mgr.14388) 8064 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:53 smithi179 bash[23186]: audit 2024-09-21T01:20:52.245184+0000 mgr.a (mgr.14388) 8063 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:20:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:53 smithi179 bash[23186]: cluster 2024-09-21T01:20:52.286011+0000 mgr.a (mgr.14388) 8064 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:53 smithi049 bash[23528]: audit 2024-09-21T01:20:52.245184+0000 mgr.a (mgr.14388) 8063 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:20:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:53 smithi049 bash[23528]: cluster 2024-09-21T01:20:52.286011+0000 mgr.a (mgr.14388) 8064 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:54 smithi044 bash[22676]: audit 2024-09-21T01:20:52.497820+0000 mgr.a (mgr.14388) 8065 : audit [DBG] from='client.181149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:54 smithi044 bash[22676]: audit 2024-09-21T01:20:52.998537+0000 mgr.a (mgr.14388) 8066 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:20:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:54 smithi044 bash[22676]: cephadm 2024-09-21T01:20:53.011857+0000 mgr.a (mgr.14388) 8067 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:20:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:54 smithi179 bash[23186]: audit 2024-09-21T01:20:52.497820+0000 mgr.a (mgr.14388) 8065 : audit [DBG] from='client.181149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:54 smithi179 bash[23186]: audit 2024-09-21T01:20:52.998537+0000 mgr.a (mgr.14388) 8066 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:20:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:54 smithi179 bash[23186]: cephadm 2024-09-21T01:20:53.011857+0000 mgr.a (mgr.14388) 8067 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:20:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:54 smithi049 bash[23528]: audit 2024-09-21T01:20:52.497820+0000 mgr.a (mgr.14388) 8065 : audit [DBG] from='client.181149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:20:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:54 smithi049 bash[23528]: audit 2024-09-21T01:20:52.998537+0000 mgr.a (mgr.14388) 8066 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:20:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:54 smithi049 bash[23528]: cephadm 2024-09-21T01:20:53.011857+0000 mgr.a (mgr.14388) 8067 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:20:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:55 smithi044 bash[22676]: cluster 2024-09-21T01:20:54.286959+0000 mgr.a (mgr.14388) 8068 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:55 smithi179 bash[23186]: cluster 2024-09-21T01:20:54.286959+0000 mgr.a (mgr.14388) 8068 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:55 smithi049 bash[23528]: cluster 2024-09-21T01:20:54.286959+0000 mgr.a (mgr.14388) 8068 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:20:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:56 smithi044 bash[22676]: cluster 2024-09-21T01:20:56.289214+0000 mgr.a (mgr.14388) 8069 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:56 smithi179 bash[23186]: cluster 2024-09-21T01:20:56.289214+0000 mgr.a (mgr.14388) 8069 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:56 smithi049 bash[23528]: cluster 2024-09-21T01:20:56.289214+0000 mgr.a (mgr.14388) 8069 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:58.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:20:58.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:20:58.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:20:59.207 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:20:59.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:20:59.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:20:59.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:20:59.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:20:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:20:59 smithi044 bash[22676]: cluster 2024-09-21T01:20:58.289997+0000 mgr.a (mgr.14388) 8070 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:20:59 smithi179 bash[23186]: cluster 2024-09-21T01:20:58.289997+0000 mgr.a (mgr.14388) 8070 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:20:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:20:59 smithi049 bash[23528]: cluster 2024-09-21T01:20:58.289997+0000 mgr.a (mgr.14388) 8070 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:00 smithi044 bash[22676]: audit 2024-09-21T01:20:58.758988+0000 mgr.a (mgr.14388) 8071 : audit [DBG] from='client.181335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:00 smithi179 bash[23186]: audit 2024-09-21T01:20:58.758988+0000 mgr.a (mgr.14388) 8071 : audit [DBG] from='client.181335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:00 smithi049 bash[23528]: audit 2024-09-21T01:20:58.758988+0000 mgr.a (mgr.14388) 8071 : audit [DBG] from='client.181335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:01.628 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:01 smithi049 bash[23528]: cluster 2024-09-21T01:21:00.292250+0000 mgr.a (mgr.14388) 8072 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:01 smithi044 bash[22676]: cluster 2024-09-21T01:21:00.292250+0000 mgr.a (mgr.14388) 8072 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:01 smithi179 bash[23186]: cluster 2024-09-21T01:21:00.292250+0000 mgr.a (mgr.14388) 8072 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:03 smithi179 bash[23186]: cluster 2024-09-21T01:21:02.293169+0000 mgr.a (mgr.14388) 8073 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:03 smithi049 bash[23528]: cluster 2024-09-21T01:21:02.293169+0000 mgr.a (mgr.14388) 8073 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:03 smithi044 bash[22676]: cluster 2024-09-21T01:21:02.293169+0000 mgr.a (mgr.14388) 8073 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:04.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:04.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:04.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:04.946 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:04.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:04.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:04.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:04.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:05 smithi044 bash[22676]: cluster 2024-09-21T01:21:04.293989+0000 mgr.a (mgr.14388) 8074 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:05 smithi179 bash[23186]: cluster 2024-09-21T01:21:04.293989+0000 mgr.a (mgr.14388) 8074 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:05 smithi049 bash[23528]: cluster 2024-09-21T01:21:04.293989+0000 mgr.a (mgr.14388) 8074 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:06.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:06 smithi044 bash[22676]: audit 2024-09-21T01:21:04.538328+0000 mgr.a (mgr.14388) 8075 : audit [DBG] from='client.181413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:06.689 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:06 smithi179 bash[23186]: audit 2024-09-21T01:21:04.538328+0000 mgr.a (mgr.14388) 8075 : audit [DBG] from='client.181413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:06 smithi049 bash[23528]: audit 2024-09-21T01:21:04.538328+0000 mgr.a (mgr.14388) 8075 : audit [DBG] from='client.181413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:07 smithi044 bash[22676]: cluster 2024-09-21T01:21:06.295408+0000 mgr.a (mgr.14388) 8076 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:07 smithi044 bash[22676]: audit 2024-09-21T01:21:06.494614+0000 mon.a (mon.0) 6875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:07 smithi044 bash[22676]: audit 2024-09-21T01:21:06.503129+0000 mon.a (mon.0) 6876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:07 smithi044 bash[22676]: audit 2024-09-21T01:21:06.514951+0000 mon.a (mon.0) 6877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:07 smithi179 bash[23186]: cluster 2024-09-21T01:21:06.295408+0000 mgr.a (mgr.14388) 8076 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:07.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:07 smithi179 bash[23186]: audit 2024-09-21T01:21:06.494614+0000 mon.a (mon.0) 6875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:07 smithi179 bash[23186]: audit 2024-09-21T01:21:06.503129+0000 mon.a (mon.0) 6876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:07 smithi179 bash[23186]: audit 2024-09-21T01:21:06.514951+0000 mon.a (mon.0) 6877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:07 smithi049 bash[23528]: cluster 2024-09-21T01:21:06.295408+0000 mgr.a (mgr.14388) 8076 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:07 smithi049 bash[23528]: audit 2024-09-21T01:21:06.494614+0000 mon.a (mon.0) 6875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:07 smithi049 bash[23528]: audit 2024-09-21T01:21:06.503129+0000 mon.a (mon.0) 6876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:07 smithi049 bash[23528]: audit 2024-09-21T01:21:06.514951+0000 mon.a (mon.0) 6877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:08.885 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:08 smithi044 bash[22676]: audit 2024-09-21T01:21:07.576467+0000 mon.a (mon.0) 6878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:08.885 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:08 smithi044 bash[22676]: audit 2024-09-21T01:21:07.586218+0000 mon.a (mon.0) 6879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:08.885 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:08 smithi044 bash[22676]: audit 2024-09-21T01:21:07.597676+0000 mon.a (mon.0) 6880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:08.885 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:08 smithi044 bash[22676]: cluster 2024-09-21T01:21:08.296095+0000 mgr.a (mgr.14388) 8077 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:08 smithi179 bash[23186]: audit 2024-09-21T01:21:07.576467+0000 mon.a (mon.0) 6878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:08 smithi179 bash[23186]: audit 2024-09-21T01:21:07.586218+0000 mon.a (mon.0) 6879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:08 smithi179 bash[23186]: audit 2024-09-21T01:21:07.597676+0000 mon.a (mon.0) 6880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:08 smithi179 bash[23186]: cluster 2024-09-21T01:21:08.296095+0000 mgr.a (mgr.14388) 8077 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:08 smithi049 bash[23528]: audit 2024-09-21T01:21:07.576467+0000 mon.a (mon.0) 6878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:08 smithi049 bash[23528]: audit 2024-09-21T01:21:07.586218+0000 mon.a (mon.0) 6879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:08 smithi049 bash[23528]: audit 2024-09-21T01:21:07.597676+0000 mon.a (mon.0) 6880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:08 smithi049 bash[23528]: cluster 2024-09-21T01:21:08.296095+0000 mgr.a (mgr.14388) 8077 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:09.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:09.948 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:09.948 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:10.738 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:11 smithi044 bash[22676]: audit 2024-09-21T01:21:10.286210+0000 mgr.a (mgr.14388) 8078 : audit [DBG] from='client.181491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:11 smithi044 bash[22676]: cluster 2024-09-21T01:21:10.306732+0000 mgr.a (mgr.14388) 8079 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:11 smithi179 bash[23186]: audit 2024-09-21T01:21:10.286210+0000 mgr.a (mgr.14388) 8078 : audit [DBG] from='client.181491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:11 smithi179 bash[23186]: cluster 2024-09-21T01:21:10.306732+0000 mgr.a (mgr.14388) 8079 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:11 smithi049 bash[23528]: audit 2024-09-21T01:21:10.286210+0000 mgr.a (mgr.14388) 8078 : audit [DBG] from='client.181491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:11.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:11 smithi049 bash[23528]: cluster 2024-09-21T01:21:10.306732+0000 mgr.a (mgr.14388) 8079 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:12 smithi049 bash[23528]: audit 2024-09-21T01:21:11.539260+0000 mon.a (mon.0) 6881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:12 smithi049 bash[23528]: audit 2024-09-21T01:21:11.547870+0000 mon.a (mon.0) 6882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:12 smithi049 bash[23528]: audit 2024-09-21T01:21:11.560244+0000 mon.a (mon.0) 6883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:12 smithi049 bash[23528]: cluster 2024-09-21T01:21:12.307678+0000 mgr.a (mgr.14388) 8080 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:12 smithi044 bash[22676]: audit 2024-09-21T01:21:11.539260+0000 mon.a (mon.0) 6881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:12 smithi044 bash[22676]: audit 2024-09-21T01:21:11.547870+0000 mon.a (mon.0) 6882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:12 smithi044 bash[22676]: audit 2024-09-21T01:21:11.560244+0000 mon.a (mon.0) 6883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:12 smithi044 bash[22676]: cluster 2024-09-21T01:21:12.307678+0000 mgr.a (mgr.14388) 8080 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:12 smithi179 bash[23186]: audit 2024-09-21T01:21:11.539260+0000 mon.a (mon.0) 6881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:12 smithi179 bash[23186]: audit 2024-09-21T01:21:11.547870+0000 mon.a (mon.0) 6882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:12 smithi179 bash[23186]: audit 2024-09-21T01:21:11.560244+0000 mon.a (mon.0) 6883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:12 smithi179 bash[23186]: cluster 2024-09-21T01:21:12.307678+0000 mgr.a (mgr.14388) 8080 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:15 smithi044 bash[22676]: cluster 2024-09-21T01:21:14.308469+0000 mgr.a (mgr.14388) 8081 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:15.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:15.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:15 smithi179 bash[23186]: cluster 2024-09-21T01:21:14.308469+0000 mgr.a (mgr.14388) 8081 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:15 smithi049 bash[23528]: cluster 2024-09-21T01:21:14.308469+0000 mgr.a (mgr.14388) 8081 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:16.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:17 smithi044 bash[22676]: audit 2024-09-21T01:21:16.078149+0000 mgr.a (mgr.14388) 8082 : audit [DBG] from='client.181569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:17 smithi044 bash[22676]: cluster 2024-09-21T01:21:16.309897+0000 mgr.a (mgr.14388) 8083 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:17 smithi179 bash[23186]: audit 2024-09-21T01:21:16.078149+0000 mgr.a (mgr.14388) 8082 : audit [DBG] from='client.181569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:17 smithi179 bash[23186]: cluster 2024-09-21T01:21:16.309897+0000 mgr.a (mgr.14388) 8083 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:17 smithi049 bash[23528]: audit 2024-09-21T01:21:16.078149+0000 mgr.a (mgr.14388) 8082 : audit [DBG] from='client.181569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:17 smithi049 bash[23528]: cluster 2024-09-21T01:21:16.309897+0000 mgr.a (mgr.14388) 8083 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:19 smithi044 bash[22676]: cluster 2024-09-21T01:21:18.310773+0000 mgr.a (mgr.14388) 8084 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:19 smithi179 bash[23186]: cluster 2024-09-21T01:21:18.310773+0000 mgr.a (mgr.14388) 8084 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:19.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:19 smithi049 bash[23528]: cluster 2024-09-21T01:21:18.310773+0000 mgr.a (mgr.14388) 8084 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:21.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:21 smithi049 bash[23528]: cluster 2024-09-21T01:21:20.313028+0000 mgr.a (mgr.14388) 8085 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:21 smithi044 bash[22676]: cluster 2024-09-21T01:21:20.313028+0000 mgr.a (mgr.14388) 8085 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:21 smithi179 bash[23186]: cluster 2024-09-21T01:21:20.313028+0000 mgr.a (mgr.14388) 8085 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:22.309 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:23 smithi044 bash[22676]: audit 2024-09-21T01:21:21.876800+0000 mgr.a (mgr.14388) 8086 : audit [DBG] from='client.181647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:23 smithi044 bash[22676]: cluster 2024-09-21T01:21:22.313704+0000 mgr.a (mgr.14388) 8087 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:23 smithi179 bash[23186]: audit 2024-09-21T01:21:21.876800+0000 mgr.a (mgr.14388) 8086 : audit [DBG] from='client.181647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:23 smithi179 bash[23186]: cluster 2024-09-21T01:21:22.313704+0000 mgr.a (mgr.14388) 8087 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:23 smithi049 bash[23528]: audit 2024-09-21T01:21:21.876800+0000 mgr.a (mgr.14388) 8086 : audit [DBG] from='client.181647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:23 smithi049 bash[23528]: cluster 2024-09-21T01:21:22.313704+0000 mgr.a (mgr.14388) 8087 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:24 smithi044 bash[22676]: cluster 2024-09-21T01:21:24.314425+0000 mgr.a (mgr.14388) 8088 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:24 smithi179 bash[23186]: cluster 2024-09-21T01:21:24.314425+0000 mgr.a (mgr.14388) 8088 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:24 smithi049 bash[23528]: cluster 2024-09-21T01:21:24.314425+0000 mgr.a (mgr.14388) 8088 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:27.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:27 smithi044 bash[22676]: cluster 2024-09-21T01:21:26.316573+0000 mgr.a (mgr.14388) 8089 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:27 smithi044 bash[22676]: audit 2024-09-21T01:21:26.666659+0000 mon.a (mon.0) 6884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:27 smithi044 bash[22676]: audit 2024-09-21T01:21:26.676346+0000 mon.a (mon.0) 6885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:27 smithi044 bash[22676]: audit 2024-09-21T01:21:26.687560+0000 mon.a (mon.0) 6886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:27 smithi179 bash[23186]: cluster 2024-09-21T01:21:26.316573+0000 mgr.a (mgr.14388) 8089 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:27 smithi179 bash[23186]: audit 2024-09-21T01:21:26.666659+0000 mon.a (mon.0) 6884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:27 smithi179 bash[23186]: audit 2024-09-21T01:21:26.676346+0000 mon.a (mon.0) 6885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:27 smithi179 bash[23186]: audit 2024-09-21T01:21:26.687560+0000 mon.a (mon.0) 6886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:27 smithi049 bash[23528]: cluster 2024-09-21T01:21:26.316573+0000 mgr.a (mgr.14388) 8089 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:27.845 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:27 smithi049 bash[23528]: audit 2024-09-21T01:21:26.666659+0000 mon.a (mon.0) 6884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.845 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:27 smithi049 bash[23528]: audit 2024-09-21T01:21:26.676346+0000 mon.a (mon.0) 6885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:27.845 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:27 smithi049 bash[23528]: audit 2024-09-21T01:21:26.687560+0000 mon.a (mon.0) 6886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:28.098 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:28.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:28.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:28.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:28.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:28 smithi179 bash[23186]: audit 2024-09-21T01:21:27.650577+0000 mgr.a (mgr.14388) 8090 : audit [DBG] from='client.181722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:28 smithi179 bash[23186]: audit 2024-09-21T01:21:27.743054+0000 mon.a (mon.0) 6887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:28 smithi179 bash[23186]: audit 2024-09-21T01:21:27.748761+0000 mon.a (mon.0) 6888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:28 smithi179 bash[23186]: audit 2024-09-21T01:21:27.755641+0000 mon.a (mon.0) 6889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:28 smithi179 bash[23186]: cluster 2024-09-21T01:21:28.317331+0000 mgr.a (mgr.14388) 8091 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:28 smithi049 bash[23528]: audit 2024-09-21T01:21:27.650577+0000 mgr.a (mgr.14388) 8090 : audit [DBG] from='client.181722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:28 smithi049 bash[23528]: audit 2024-09-21T01:21:27.743054+0000 mon.a (mon.0) 6887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:28 smithi049 bash[23528]: audit 2024-09-21T01:21:27.748761+0000 mon.a (mon.0) 6888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:28 smithi049 bash[23528]: audit 2024-09-21T01:21:27.755641+0000 mon.a (mon.0) 6889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:28 smithi049 bash[23528]: cluster 2024-09-21T01:21:28.317331+0000 mgr.a (mgr.14388) 8091 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:28 smithi044 bash[22676]: audit 2024-09-21T01:21:27.650577+0000 mgr.a (mgr.14388) 8090 : audit [DBG] from='client.181722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:28 smithi044 bash[22676]: audit 2024-09-21T01:21:27.743054+0000 mon.a (mon.0) 6887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:28 smithi044 bash[22676]: audit 2024-09-21T01:21:27.748761+0000 mon.a (mon.0) 6888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:28 smithi044 bash[22676]: audit 2024-09-21T01:21:27.755641+0000 mon.a (mon.0) 6889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:28 smithi044 bash[22676]: cluster 2024-09-21T01:21:28.317331+0000 mgr.a (mgr.14388) 8091 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:31 smithi044 bash[22676]: cluster 2024-09-21T01:21:30.319397+0000 mgr.a (mgr.14388) 8092 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:31 smithi179 bash[23186]: cluster 2024-09-21T01:21:30.319397+0000 mgr.a (mgr.14388) 8092 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:31.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:31 smithi049 bash[23528]: cluster 2024-09-21T01:21:30.319397+0000 mgr.a (mgr.14388) 8092 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:32 smithi179 bash[23186]: audit 2024-09-21T01:21:31.749027+0000 mon.a (mon.0) 6890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:32 smithi179 bash[23186]: audit 2024-09-21T01:21:31.757822+0000 mon.a (mon.0) 6891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:32 smithi179 bash[23186]: audit 2024-09-21T01:21:31.768290+0000 mon.a (mon.0) 6892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:32 smithi179 bash[23186]: cluster 2024-09-21T01:21:32.320202+0000 mgr.a (mgr.14388) 8093 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:32 smithi049 bash[23528]: audit 2024-09-21T01:21:31.749027+0000 mon.a (mon.0) 6890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:32 smithi049 bash[23528]: audit 2024-09-21T01:21:31.757822+0000 mon.a (mon.0) 6891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:32 smithi049 bash[23528]: audit 2024-09-21T01:21:31.768290+0000 mon.a (mon.0) 6892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:32 smithi049 bash[23528]: cluster 2024-09-21T01:21:32.320202+0000 mgr.a (mgr.14388) 8093 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:33.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:33.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:33.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:32 smithi044 bash[22676]: audit 2024-09-21T01:21:31.749027+0000 mon.a (mon.0) 6890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:32 smithi044 bash[22676]: audit 2024-09-21T01:21:31.757822+0000 mon.a (mon.0) 6891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:32 smithi044 bash[22676]: audit 2024-09-21T01:21:31.768290+0000 mon.a (mon.0) 6892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:32 smithi044 bash[22676]: cluster 2024-09-21T01:21:32.320202+0000 mgr.a (mgr.14388) 8093 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:33.870 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:33.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:33.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:33.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:33.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:35 smithi044 bash[22676]: audit 2024-09-21T01:21:33.438702+0000 mgr.a (mgr.14388) 8094 : audit [DBG] from='client.181800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:35 smithi044 bash[22676]: cluster 2024-09-21T01:21:34.321144+0000 mgr.a (mgr.14388) 8095 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:35 smithi179 bash[23186]: audit 2024-09-21T01:21:33.438702+0000 mgr.a (mgr.14388) 8094 : audit [DBG] from='client.181800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:35 smithi179 bash[23186]: cluster 2024-09-21T01:21:34.321144+0000 mgr.a (mgr.14388) 8095 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:35 smithi049 bash[23528]: audit 2024-09-21T01:21:33.438702+0000 mgr.a (mgr.14388) 8094 : audit [DBG] from='client.181800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:35 smithi049 bash[23528]: cluster 2024-09-21T01:21:34.321144+0000 mgr.a (mgr.14388) 8095 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:37 smithi044 bash[22676]: cluster 2024-09-21T01:21:36.323396+0000 mgr.a (mgr.14388) 8096 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:37 smithi179 bash[23186]: cluster 2024-09-21T01:21:36.323396+0000 mgr.a (mgr.14388) 8096 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:37 smithi049 bash[23528]: cluster 2024-09-21T01:21:36.323396+0000 mgr.a (mgr.14388) 8096 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:38.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:38.873 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:38.873 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:39.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:39.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:39.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:39.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:39 smithi044 bash[22676]: cluster 2024-09-21T01:21:38.324155+0000 mgr.a (mgr.14388) 8097 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:39 smithi179 bash[23186]: cluster 2024-09-21T01:21:38.324155+0000 mgr.a (mgr.14388) 8097 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:39 smithi049 bash[23528]: cluster 2024-09-21T01:21:38.324155+0000 mgr.a (mgr.14388) 8097 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:40 smithi044 bash[22676]: audit 2024-09-21T01:21:39.207284+0000 mgr.a (mgr.14388) 8098 : audit [DBG] from='client.181878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:40 smithi179 bash[23186]: audit 2024-09-21T01:21:39.207284+0000 mgr.a (mgr.14388) 8098 : audit [DBG] from='client.181878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:40 smithi049 bash[23528]: audit 2024-09-21T01:21:39.207284+0000 mgr.a (mgr.14388) 8098 : audit [DBG] from='client.181878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:41 smithi044 bash[22676]: cluster 2024-09-21T01:21:40.326640+0000 mgr.a (mgr.14388) 8099 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:41 smithi179 bash[23186]: cluster 2024-09-21T01:21:40.326640+0000 mgr.a (mgr.14388) 8099 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:41 smithi049 bash[23528]: cluster 2024-09-21T01:21:40.326640+0000 mgr.a (mgr.14388) 8099 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:21:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:43 smithi044 bash[22676]: cluster 2024-09-21T01:21:42.327604+0000 mgr.a (mgr.14388) 8100 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:43 smithi179 bash[23186]: cluster 2024-09-21T01:21:42.327604+0000 mgr.a (mgr.14388) 8100 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:43 smithi049 bash[23528]: cluster 2024-09-21T01:21:42.327604+0000 mgr.a (mgr.14388) 8100 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:44 smithi049 bash[23528]: cluster 2024-09-21T01:21:44.328566+0000 mgr.a (mgr.14388) 8101 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:44.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:44.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:44.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:44.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:44 smithi179 bash[23186]: cluster 2024-09-21T01:21:44.328566+0000 mgr.a (mgr.14388) 8101 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:44 smithi044 bash[22676]: cluster 2024-09-21T01:21:44.328566+0000 mgr.a (mgr.14388) 8101 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:45.387 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:45.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:45.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:45.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:45.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:45 smithi044 bash[22676]: audit 2024-09-21T01:21:44.963564+0000 mgr.a (mgr.14388) 8102 : audit [DBG] from='client.181956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:45 smithi179 bash[23186]: audit 2024-09-21T01:21:44.963564+0000 mgr.a (mgr.14388) 8102 : audit [DBG] from='client.181956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:45 smithi049 bash[23528]: audit 2024-09-21T01:21:44.963564+0000 mgr.a (mgr.14388) 8102 : audit [DBG] from='client.181956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:46 smithi179 bash[23186]: cluster 2024-09-21T01:21:46.331541+0000 mgr.a (mgr.14388) 8103 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:46.713 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:46 smithi044 bash[22676]: cluster 2024-09-21T01:21:46.331541+0000 mgr.a (mgr.14388) 8103 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:46 smithi049 bash[23528]: cluster 2024-09-21T01:21:46.331541+0000 mgr.a (mgr.14388) 8103 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:47 smithi049 bash[23528]: audit 2024-09-21T01:21:46.846804+0000 mon.a (mon.0) 6893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:47 smithi049 bash[23528]: audit 2024-09-21T01:21:46.855270+0000 mon.a (mon.0) 6894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:47 smithi049 bash[23528]: audit 2024-09-21T01:21:46.867678+0000 mon.a (mon.0) 6895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:47 smithi044 bash[22676]: audit 2024-09-21T01:21:46.846804+0000 mon.a (mon.0) 6893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:47 smithi044 bash[22676]: audit 2024-09-21T01:21:46.855270+0000 mon.a (mon.0) 6894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:47 smithi044 bash[22676]: audit 2024-09-21T01:21:46.867678+0000 mon.a (mon.0) 6895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:47 smithi179 bash[23186]: audit 2024-09-21T01:21:46.846804+0000 mon.a (mon.0) 6893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:47 smithi179 bash[23186]: audit 2024-09-21T01:21:46.855270+0000 mon.a (mon.0) 6894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:47 smithi179 bash[23186]: audit 2024-09-21T01:21:46.867678+0000 mon.a (mon.0) 6895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:48 smithi044 bash[22676]: audit 2024-09-21T01:21:47.955153+0000 mon.a (mon.0) 6896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:48 smithi044 bash[22676]: audit 2024-09-21T01:21:47.963823+0000 mon.a (mon.0) 6897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:48 smithi044 bash[22676]: audit 2024-09-21T01:21:47.974098+0000 mon.a (mon.0) 6898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:48 smithi044 bash[22676]: cluster 2024-09-21T01:21:48.332145+0000 mgr.a (mgr.14388) 8104 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:48 smithi179 bash[23186]: audit 2024-09-21T01:21:47.955153+0000 mon.a (mon.0) 6896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:48 smithi179 bash[23186]: audit 2024-09-21T01:21:47.963823+0000 mon.a (mon.0) 6897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:48 smithi179 bash[23186]: audit 2024-09-21T01:21:47.974098+0000 mon.a (mon.0) 6898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:48 smithi179 bash[23186]: cluster 2024-09-21T01:21:48.332145+0000 mgr.a (mgr.14388) 8104 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:48 smithi049 bash[23528]: audit 2024-09-21T01:21:47.955153+0000 mon.a (mon.0) 6896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:48 smithi049 bash[23528]: audit 2024-09-21T01:21:47.963823+0000 mon.a (mon.0) 6897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:48 smithi049 bash[23528]: audit 2024-09-21T01:21:47.974098+0000 mon.a (mon.0) 6898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:48 smithi049 bash[23528]: cluster 2024-09-21T01:21:48.332145+0000 mgr.a (mgr.14388) 8104 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:50.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:50.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:51.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:51.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:51.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:51.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:51.172 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:51 smithi044 bash[22676]: cluster 2024-09-21T01:21:50.334116+0000 mgr.a (mgr.14388) 8105 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:51 smithi179 bash[23186]: cluster 2024-09-21T01:21:50.334116+0000 mgr.a (mgr.14388) 8105 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:51 smithi049 bash[23528]: cluster 2024-09-21T01:21:50.334116+0000 mgr.a (mgr.14388) 8105 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:21:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:52 smithi044 bash[22676]: audit 2024-09-21T01:21:50.725308+0000 mgr.a (mgr.14388) 8106 : audit [DBG] from='client.182031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:52 smithi044 bash[22676]: audit 2024-09-21T01:21:51.995758+0000 mon.a (mon.0) 6899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:52 smithi044 bash[22676]: audit 2024-09-21T01:21:52.004710+0000 mon.a (mon.0) 6900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:52 smithi044 bash[22676]: audit 2024-09-21T01:21:52.015806+0000 mon.a (mon.0) 6901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:52 smithi179 bash[23186]: audit 2024-09-21T01:21:50.725308+0000 mgr.a (mgr.14388) 8106 : audit [DBG] from='client.182031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:52 smithi179 bash[23186]: audit 2024-09-21T01:21:51.995758+0000 mon.a (mon.0) 6899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:52 smithi179 bash[23186]: audit 2024-09-21T01:21:52.004710+0000 mon.a (mon.0) 6900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:52 smithi179 bash[23186]: audit 2024-09-21T01:21:52.015806+0000 mon.a (mon.0) 6901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:52 smithi049 bash[23528]: audit 2024-09-21T01:21:50.725308+0000 mgr.a (mgr.14388) 8106 : audit [DBG] from='client.182031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:52 smithi049 bash[23528]: audit 2024-09-21T01:21:51.995758+0000 mon.a (mon.0) 6899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:52 smithi049 bash[23528]: audit 2024-09-21T01:21:52.004710+0000 mon.a (mon.0) 6900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:52 smithi049 bash[23528]: audit 2024-09-21T01:21:52.015806+0000 mon.a (mon.0) 6901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22676]: cluster 2024-09-21T01:21:52.335127+0000 mgr.a (mgr.14388) 8107 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22676]: audit 2024-09-21T01:21:53.073236+0000 mon.a (mon.0) 6902 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:21:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22676]: audit 2024-09-21T01:21:53.079499+0000 mon.a (mon.0) 6903 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:21:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22676]: audit 2024-09-21T01:21:53.081273+0000 mon.a (mon.0) 6904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:21:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22676]: audit 2024-09-21T01:21:53.092202+0000 mon.a (mon.0) 6905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22676]: audit 2024-09-21T01:21:53.098517+0000 mon.a (mon.0) 6906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:21:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:53 smithi179 bash[23186]: cluster 2024-09-21T01:21:52.335127+0000 mgr.a (mgr.14388) 8107 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:53 smithi179 bash[23186]: audit 2024-09-21T01:21:53.073236+0000 mon.a (mon.0) 6902 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:21:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:53 smithi179 bash[23186]: audit 2024-09-21T01:21:53.079499+0000 mon.a (mon.0) 6903 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:21:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:53 smithi179 bash[23186]: audit 2024-09-21T01:21:53.081273+0000 mon.a (mon.0) 6904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:21:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:53 smithi179 bash[23186]: audit 2024-09-21T01:21:53.092202+0000 mon.a (mon.0) 6905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:53 smithi179 bash[23186]: audit 2024-09-21T01:21:53.098517+0000 mon.a (mon.0) 6906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:53 smithi049 bash[23528]: cluster 2024-09-21T01:21:52.335127+0000 mgr.a (mgr.14388) 8107 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:53 smithi049 bash[23528]: audit 2024-09-21T01:21:53.073236+0000 mon.a (mon.0) 6902 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:53 smithi049 bash[23528]: audit 2024-09-21T01:21:53.079499+0000 mon.a (mon.0) 6903 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:53 smithi049 bash[23528]: audit 2024-09-21T01:21:53.081273+0000 mon.a (mon.0) 6904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:53 smithi049 bash[23528]: audit 2024-09-21T01:21:53.092202+0000 mon.a (mon.0) 6905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:53 smithi049 bash[23528]: audit 2024-09-21T01:21:53.098517+0000 mon.a (mon.0) 6906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:21:54.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22930]: debug 2024-09-21T01:21:53.877+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:21:54.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:21:53 smithi044 bash[22930]: debug 2024-09-21T01:21:53.881+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:21:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:54 smithi044 bash[22676]: audit 2024-09-21T01:21:53.101084+0000 mgr.a (mgr.14388) 8108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:21:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:54 smithi179 bash[23186]: audit 2024-09-21T01:21:53.101084+0000 mgr.a (mgr.14388) 8108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:21:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:54 smithi049 bash[23528]: audit 2024-09-21T01:21:53.101084+0000 mgr.a (mgr.14388) 8108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:21:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:55 smithi044 bash[22676]: audit 2024-09-21T01:21:53.884680+0000 mgr.a (mgr.14388) 8109 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:21:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:55 smithi044 bash[22676]: cephadm 2024-09-21T01:21:53.886273+0000 mgr.a (mgr.14388) 8110 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:21:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:55 smithi044 bash[22676]: cluster 2024-09-21T01:21:54.336102+0000 mgr.a (mgr.14388) 8111 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:21:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:55 smithi179 bash[23186]: audit 2024-09-21T01:21:53.884680+0000 mgr.a (mgr.14388) 8109 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:21:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:55 smithi179 bash[23186]: cephadm 2024-09-21T01:21:53.886273+0000 mgr.a (mgr.14388) 8110 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:21:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:55 smithi179 bash[23186]: cluster 2024-09-21T01:21:54.336102+0000 mgr.a (mgr.14388) 8111 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:21:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:55 smithi049 bash[23528]: audit 2024-09-21T01:21:53.884680+0000 mgr.a (mgr.14388) 8109 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:21:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:55 smithi049 bash[23528]: cephadm 2024-09-21T01:21:53.886273+0000 mgr.a (mgr.14388) 8110 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:21:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:55 smithi049 bash[23528]: cluster 2024-09-21T01:21:54.336102+0000 mgr.a (mgr.14388) 8111 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:21:56.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:21:56.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:21:56.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:21:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:56 smithi044 bash[22676]: cluster 2024-09-21T01:21:56.338160+0000 mgr.a (mgr.14388) 8112 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:56 smithi179 bash[23186]: cluster 2024-09-21T01:21:56.338160+0000 mgr.a (mgr.14388) 8112 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:56 smithi049 bash[23528]: cluster 2024-09-21T01:21:56.338160+0000 mgr.a (mgr.14388) 8112 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:56.972 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:21:56.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:21:56.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:21:56.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:21:56.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:21:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:57 smithi044 bash[22676]: audit 2024-09-21T01:21:56.511141+0000 mgr.a (mgr.14388) 8113 : audit [DBG] from='client.182217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:57.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:57 smithi179 bash[23186]: audit 2024-09-21T01:21:56.511141+0000 mgr.a (mgr.14388) 8113 : audit [DBG] from='client.182217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:57 smithi049 bash[23528]: audit 2024-09-21T01:21:56.511141+0000 mgr.a (mgr.14388) 8113 : audit [DBG] from='client.182217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:21:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:21:58 smithi044 bash[22676]: cluster 2024-09-21T01:21:58.339076+0000 mgr.a (mgr.14388) 8114 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:21:58 smithi179 bash[23186]: cluster 2024-09-21T01:21:58.339076+0000 mgr.a (mgr.14388) 8114 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:21:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:21:58 smithi049 bash[23528]: cluster 2024-09-21T01:21:58.339076+0000 mgr.a (mgr.14388) 8114 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:01 smithi044 bash[22676]: cluster 2024-09-21T01:22:00.341215+0000 mgr.a (mgr.14388) 8115 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:01 smithi179 bash[23186]: cluster 2024-09-21T01:22:00.341215+0000 mgr.a (mgr.14388) 8115 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:01 smithi049 bash[23528]: cluster 2024-09-21T01:22:00.341215+0000 mgr.a (mgr.14388) 8115 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:01.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:01.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:02.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:03 smithi044 bash[22676]: audit 2024-09-21T01:22:02.308876+0000 mgr.a (mgr.14388) 8116 : audit [DBG] from='client.182295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:03 smithi044 bash[22676]: cluster 2024-09-21T01:22:02.342229+0000 mgr.a (mgr.14388) 8117 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:03 smithi179 bash[23186]: audit 2024-09-21T01:22:02.308876+0000 mgr.a (mgr.14388) 8116 : audit [DBG] from='client.182295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:03 smithi179 bash[23186]: cluster 2024-09-21T01:22:02.342229+0000 mgr.a (mgr.14388) 8117 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:03 smithi049 bash[23528]: audit 2024-09-21T01:22:02.308876+0000 mgr.a (mgr.14388) 8116 : audit [DBG] from='client.182295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:03 smithi049 bash[23528]: cluster 2024-09-21T01:22:02.342229+0000 mgr.a (mgr.14388) 8117 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:04 smithi044 bash[22676]: cluster 2024-09-21T01:22:04.343187+0000 mgr.a (mgr.14388) 8118 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:04 smithi179 bash[23186]: cluster 2024-09-21T01:22:04.343187+0000 mgr.a (mgr.14388) 8118 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:04 smithi049 bash[23528]: cluster 2024-09-21T01:22:04.343187+0000 mgr.a (mgr.14388) 8118 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:07.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:07.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:07.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:07 smithi179 bash[23186]: cluster 2024-09-21T01:22:06.345451+0000 mgr.a (mgr.14388) 8119 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:07 smithi179 bash[23186]: audit 2024-09-21T01:22:07.019436+0000 mon.a (mon.0) 6907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:07 smithi179 bash[23186]: audit 2024-09-21T01:22:07.028690+0000 mon.a (mon.0) 6908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:07 smithi179 bash[23186]: audit 2024-09-21T01:22:07.039616+0000 mon.a (mon.0) 6909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.783 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:07 smithi044 bash[22676]: cluster 2024-09-21T01:22:06.345451+0000 mgr.a (mgr.14388) 8119 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:07.783 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:07 smithi044 bash[22676]: audit 2024-09-21T01:22:07.019436+0000 mon.a (mon.0) 6907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.783 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:07 smithi044 bash[22676]: audit 2024-09-21T01:22:07.028690+0000 mon.a (mon.0) 6908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.783 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:07 smithi044 bash[22676]: audit 2024-09-21T01:22:07.039616+0000 mon.a (mon.0) 6909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:07 smithi049 bash[23528]: cluster 2024-09-21T01:22:06.345451+0000 mgr.a (mgr.14388) 8119 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:22:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:07 smithi049 bash[23528]: audit 2024-09-21T01:22:07.019436+0000 mon.a (mon.0) 6907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:07 smithi049 bash[23528]: audit 2024-09-21T01:22:07.028690+0000 mon.a (mon.0) 6908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:07 smithi049 bash[23528]: audit 2024-09-21T01:22:07.039616+0000 mon.a (mon.0) 6909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:08.526 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:08.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:08.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:09 smithi044 bash[22676]: audit 2024-09-21T01:22:08.088062+0000 mgr.a (mgr.14388) 8120 : audit [DBG] from='client.182373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:09 smithi044 bash[22676]: audit 2024-09-21T01:22:08.153120+0000 mon.a (mon.0) 6910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:09 smithi044 bash[22676]: audit 2024-09-21T01:22:08.159083+0000 mon.a (mon.0) 6911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:09 smithi044 bash[22676]: audit 2024-09-21T01:22:08.164542+0000 mon.a (mon.0) 6912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:09 smithi044 bash[22676]: cluster 2024-09-21T01:22:08.345957+0000 mgr.a (mgr.14388) 8121 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:09 smithi179 bash[23186]: audit 2024-09-21T01:22:08.088062+0000 mgr.a (mgr.14388) 8120 : audit [DBG] from='client.182373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:09 smithi179 bash[23186]: audit 2024-09-21T01:22:08.153120+0000 mon.a (mon.0) 6910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:09 smithi179 bash[23186]: audit 2024-09-21T01:22:08.159083+0000 mon.a (mon.0) 6911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:09 smithi179 bash[23186]: audit 2024-09-21T01:22:08.164542+0000 mon.a (mon.0) 6912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:09 smithi179 bash[23186]: cluster 2024-09-21T01:22:08.345957+0000 mgr.a (mgr.14388) 8121 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:09 smithi049 bash[23528]: audit 2024-09-21T01:22:08.088062+0000 mgr.a (mgr.14388) 8120 : audit [DBG] from='client.182373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:09 smithi049 bash[23528]: audit 2024-09-21T01:22:08.153120+0000 mon.a (mon.0) 6910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:09 smithi049 bash[23528]: audit 2024-09-21T01:22:08.159083+0000 mon.a (mon.0) 6911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:09 smithi049 bash[23528]: audit 2024-09-21T01:22:08.164542+0000 mon.a (mon.0) 6912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:09 smithi049 bash[23528]: cluster 2024-09-21T01:22:08.345957+0000 mgr.a (mgr.14388) 8121 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:10 smithi044 bash[22676]: cluster 2024-09-21T01:22:10.348203+0000 mgr.a (mgr.14388) 8122 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:10 smithi179 bash[23186]: cluster 2024-09-21T01:22:10.348203+0000 mgr.a (mgr.14388) 8122 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:10 smithi049 bash[23528]: cluster 2024-09-21T01:22:10.348203+0000 mgr.a (mgr.14388) 8122 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:13 smithi044 bash[22676]: audit 2024-09-21T01:22:12.207493+0000 mon.a (mon.0) 6913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:13 smithi044 bash[22676]: audit 2024-09-21T01:22:12.216424+0000 mon.a (mon.0) 6914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:13 smithi044 bash[22676]: audit 2024-09-21T01:22:12.227027+0000 mon.a (mon.0) 6915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:13 smithi044 bash[22676]: cluster 2024-09-21T01:22:12.348974+0000 mgr.a (mgr.14388) 8123 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:13 smithi179 bash[23186]: audit 2024-09-21T01:22:12.207493+0000 mon.a (mon.0) 6913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:13 smithi179 bash[23186]: audit 2024-09-21T01:22:12.216424+0000 mon.a (mon.0) 6914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:13 smithi179 bash[23186]: audit 2024-09-21T01:22:12.227027+0000 mon.a (mon.0) 6915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:13 smithi179 bash[23186]: cluster 2024-09-21T01:22:12.348974+0000 mgr.a (mgr.14388) 8123 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:13.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:13 smithi049 bash[23528]: audit 2024-09-21T01:22:12.207493+0000 mon.a (mon.0) 6913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:13 smithi049 bash[23528]: audit 2024-09-21T01:22:12.216424+0000 mon.a (mon.0) 6914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:13 smithi049 bash[23528]: audit 2024-09-21T01:22:12.227027+0000 mon.a (mon.0) 6915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:13.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:13 smithi049 bash[23528]: cluster 2024-09-21T01:22:12.348974+0000 mgr.a (mgr.14388) 8123 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:14.289 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:14.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:14.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:14.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:14.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:15 smithi044 bash[22676]: audit 2024-09-21T01:22:13.865486+0000 mgr.a (mgr.14388) 8124 : audit [DBG] from='client.182451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:15 smithi044 bash[22676]: cluster 2024-09-21T01:22:14.349608+0000 mgr.a (mgr.14388) 8125 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:15 smithi179 bash[23186]: audit 2024-09-21T01:22:13.865486+0000 mgr.a (mgr.14388) 8124 : audit [DBG] from='client.182451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:15 smithi179 bash[23186]: cluster 2024-09-21T01:22:14.349608+0000 mgr.a (mgr.14388) 8125 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:15 smithi049 bash[23528]: audit 2024-09-21T01:22:13.865486+0000 mgr.a (mgr.14388) 8124 : audit [DBG] from='client.182451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:15 smithi049 bash[23528]: cluster 2024-09-21T01:22:14.349608+0000 mgr.a (mgr.14388) 8125 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:16 smithi044 bash[22676]: cluster 2024-09-21T01:22:16.351775+0000 mgr.a (mgr.14388) 8126 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:16 smithi179 bash[23186]: cluster 2024-09-21T01:22:16.351775+0000 mgr.a (mgr.14388) 8126 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:16.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:16 smithi049 bash[23528]: cluster 2024-09-21T01:22:16.351775+0000 mgr.a (mgr.14388) 8126 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:18 smithi044 bash[22676]: cluster 2024-09-21T01:22:18.352552+0000 mgr.a (mgr.14388) 8127 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:18 smithi179 bash[23186]: cluster 2024-09-21T01:22:18.352552+0000 mgr.a (mgr.14388) 8127 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:18 smithi049 bash[23528]: cluster 2024-09-21T01:22:18.352552+0000 mgr.a (mgr.14388) 8127 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:20.082 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:20.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:20 smithi044 bash[22676]: audit 2024-09-21T01:22:19.630200+0000 mgr.a (mgr.14388) 8128 : audit [DBG] from='client.182526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:20 smithi044 bash[22676]: cluster 2024-09-21T01:22:20.354943+0000 mgr.a (mgr.14388) 8129 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:22:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:20 smithi179 bash[23186]: audit 2024-09-21T01:22:19.630200+0000 mgr.a (mgr.14388) 8128 : audit [DBG] from='client.182526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:20 smithi179 bash[23186]: cluster 2024-09-21T01:22:20.354943+0000 mgr.a (mgr.14388) 8129 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:22:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:20 smithi049 bash[23528]: audit 2024-09-21T01:22:19.630200+0000 mgr.a (mgr.14388) 8128 : audit [DBG] from='client.182526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:20 smithi049 bash[23528]: cluster 2024-09-21T01:22:20.354943+0000 mgr.a (mgr.14388) 8129 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:22:22.522 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:22 smithi049 bash[23528]: cluster 2024-09-21T01:22:22.355750+0000 mgr.a (mgr.14388) 8130 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:22:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:22 smithi044 bash[22676]: cluster 2024-09-21T01:22:22.355750+0000 mgr.a (mgr.14388) 8130 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:22:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:22 smithi179 bash[23186]: cluster 2024-09-21T01:22:22.355750+0000 mgr.a (mgr.14388) 8130 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:22:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:24 smithi044 bash[22676]: cluster 2024-09-21T01:22:24.356518+0000 mgr.a (mgr.14388) 8131 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:22:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:24 smithi179 bash[23186]: cluster 2024-09-21T01:22:24.356518+0000 mgr.a (mgr.14388) 8131 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:22:24.759 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:24 smithi049 bash[23528]: cluster 2024-09-21T01:22:24.356518+0000 mgr.a (mgr.14388) 8131 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:22:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:25.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:25.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:25.875 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:25.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:25.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:25.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:25.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:26.714 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:26 smithi044 bash[22676]: audit 2024-09-21T01:22:25.422593+0000 mgr.a (mgr.14388) 8132 : audit [DBG] from='client.182601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:26.714 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:26 smithi044 bash[22676]: cluster 2024-09-21T01:22:26.359406+0000 mgr.a (mgr.14388) 8133 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:26 smithi179 bash[23186]: audit 2024-09-21T01:22:25.422593+0000 mgr.a (mgr.14388) 8132 : audit [DBG] from='client.182601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:26 smithi179 bash[23186]: cluster 2024-09-21T01:22:26.359406+0000 mgr.a (mgr.14388) 8133 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:26 smithi049 bash[23528]: audit 2024-09-21T01:22:25.422593+0000 mgr.a (mgr.14388) 8132 : audit [DBG] from='client.182601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:26 smithi049 bash[23528]: cluster 2024-09-21T01:22:26.359406+0000 mgr.a (mgr.14388) 8133 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:28 smithi044 bash[22676]: audit 2024-09-21T01:22:27.171949+0000 mon.a (mon.0) 6916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:28 smithi044 bash[22676]: audit 2024-09-21T01:22:27.180464+0000 mon.a (mon.0) 6917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:28 smithi044 bash[22676]: audit 2024-09-21T01:22:27.192281+0000 mon.a (mon.0) 6918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:28 smithi179 bash[23186]: audit 2024-09-21T01:22:27.171949+0000 mon.a (mon.0) 6916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:28 smithi179 bash[23186]: audit 2024-09-21T01:22:27.180464+0000 mon.a (mon.0) 6917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:28 smithi179 bash[23186]: audit 2024-09-21T01:22:27.192281+0000 mon.a (mon.0) 6918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:28 smithi049 bash[23528]: audit 2024-09-21T01:22:27.171949+0000 mon.a (mon.0) 6916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:28 smithi049 bash[23528]: audit 2024-09-21T01:22:27.180464+0000 mon.a (mon.0) 6917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:28 smithi049 bash[23528]: audit 2024-09-21T01:22:27.192281+0000 mon.a (mon.0) 6918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:29 smithi044 bash[22676]: cluster 2024-09-21T01:22:28.359993+0000 mgr.a (mgr.14388) 8134 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:22:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:29 smithi044 bash[22676]: audit 2024-09-21T01:22:28.372237+0000 mon.a (mon.0) 6919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:29 smithi044 bash[22676]: audit 2024-09-21T01:22:28.379413+0000 mon.a (mon.0) 6920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:29 smithi044 bash[22676]: audit 2024-09-21T01:22:28.384718+0000 mon.a (mon.0) 6921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:29 smithi179 bash[23186]: cluster 2024-09-21T01:22:28.359993+0000 mgr.a (mgr.14388) 8134 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:22:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:29 smithi179 bash[23186]: audit 2024-09-21T01:22:28.372237+0000 mon.a (mon.0) 6919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:29 smithi179 bash[23186]: audit 2024-09-21T01:22:28.379413+0000 mon.a (mon.0) 6920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:29 smithi179 bash[23186]: audit 2024-09-21T01:22:28.384718+0000 mon.a (mon.0) 6921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:29 smithi049 bash[23528]: cluster 2024-09-21T01:22:28.359993+0000 mgr.a (mgr.14388) 8134 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:22:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:29 smithi049 bash[23528]: audit 2024-09-21T01:22:28.372237+0000 mon.a (mon.0) 6919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:29 smithi049 bash[23528]: audit 2024-09-21T01:22:28.379413+0000 mon.a (mon.0) 6920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:29 smithi049 bash[23528]: audit 2024-09-21T01:22:28.384718+0000 mon.a (mon.0) 6921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:30.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:30.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:30.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:31.640 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:31.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:31.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:31.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:31.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:31 smithi044 bash[22676]: cluster 2024-09-21T01:22:30.362025+0000 mgr.a (mgr.14388) 8135 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:31 smithi179 bash[23186]: cluster 2024-09-21T01:22:30.362025+0000 mgr.a (mgr.14388) 8135 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:31 smithi049 bash[23528]: cluster 2024-09-21T01:22:30.362025+0000 mgr.a (mgr.14388) 8135 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:32 smithi044 bash[22676]: audit 2024-09-21T01:22:31.210612+0000 mgr.a (mgr.14388) 8136 : audit [DBG] from='client.182679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:32 smithi179 bash[23186]: audit 2024-09-21T01:22:31.210612+0000 mgr.a (mgr.14388) 8136 : audit [DBG] from='client.182679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:32 smithi049 bash[23528]: audit 2024-09-21T01:22:31.210612+0000 mgr.a (mgr.14388) 8136 : audit [DBG] from='client.182679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:33 smithi044 bash[22676]: cluster 2024-09-21T01:22:32.362978+0000 mgr.a (mgr.14388) 8137 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:22:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:33 smithi044 bash[22676]: audit 2024-09-21T01:22:32.416421+0000 mon.a (mon.0) 6922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:33 smithi044 bash[22676]: audit 2024-09-21T01:22:32.424815+0000 mon.a (mon.0) 6923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:33 smithi044 bash[22676]: audit 2024-09-21T01:22:32.434995+0000 mon.a (mon.0) 6924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:33 smithi179 bash[23186]: cluster 2024-09-21T01:22:32.362978+0000 mgr.a (mgr.14388) 8137 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:22:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:33 smithi179 bash[23186]: audit 2024-09-21T01:22:32.416421+0000 mon.a (mon.0) 6922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:33 smithi179 bash[23186]: audit 2024-09-21T01:22:32.424815+0000 mon.a (mon.0) 6923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:33 smithi179 bash[23186]: audit 2024-09-21T01:22:32.434995+0000 mon.a (mon.0) 6924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:33 smithi049 bash[23528]: cluster 2024-09-21T01:22:32.362978+0000 mgr.a (mgr.14388) 8137 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:22:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:33 smithi049 bash[23528]: audit 2024-09-21T01:22:32.416421+0000 mon.a (mon.0) 6922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:33 smithi049 bash[23528]: audit 2024-09-21T01:22:32.424815+0000 mon.a (mon.0) 6923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:33 smithi049 bash[23528]: audit 2024-09-21T01:22:32.434995+0000 mon.a (mon.0) 6924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:35 smithi044 bash[22676]: cluster 2024-09-21T01:22:34.363842+0000 mgr.a (mgr.14388) 8138 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:22:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:35 smithi179 bash[23186]: cluster 2024-09-21T01:22:34.363842+0000 mgr.a (mgr.14388) 8138 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:22:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:35 smithi049 bash[23528]: cluster 2024-09-21T01:22:34.363842+0000 mgr.a (mgr.14388) 8138 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:22:36.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:36.642 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:36.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:37.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:37.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:37.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:37.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:37.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:37 smithi044 bash[22676]: cluster 2024-09-21T01:22:36.366083+0000 mgr.a (mgr.14388) 8139 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:22:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:37 smithi179 bash[23186]: cluster 2024-09-21T01:22:36.366083+0000 mgr.a (mgr.14388) 8139 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:22:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:37 smithi049 bash[23528]: cluster 2024-09-21T01:22:36.366083+0000 mgr.a (mgr.14388) 8139 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:22:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:38 smithi044 bash[22676]: audit 2024-09-21T01:22:36.982046+0000 mgr.a (mgr.14388) 8140 : audit [DBG] from='client.182757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:38 smithi179 bash[23186]: audit 2024-09-21T01:22:36.982046+0000 mgr.a (mgr.14388) 8140 : audit [DBG] from='client.182757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:38 smithi049 bash[23528]: audit 2024-09-21T01:22:36.982046+0000 mgr.a (mgr.14388) 8140 : audit [DBG] from='client.182757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:39 smithi044 bash[22676]: cluster 2024-09-21T01:22:38.367048+0000 mgr.a (mgr.14388) 8141 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:39 smithi179 bash[23186]: cluster 2024-09-21T01:22:38.367048+0000 mgr.a (mgr.14388) 8141 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:39 smithi049 bash[23528]: cluster 2024-09-21T01:22:38.367048+0000 mgr.a (mgr.14388) 8141 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:41 smithi044 bash[22676]: cluster 2024-09-21T01:22:40.369209+0000 mgr.a (mgr.14388) 8142 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:41 smithi179 bash[23186]: cluster 2024-09-21T01:22:40.369209+0000 mgr.a (mgr.14388) 8142 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:41 smithi049 bash[23528]: cluster 2024-09-21T01:22:40.369209+0000 mgr.a (mgr.14388) 8142 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:43.201 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:43.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:43.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:43.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:43.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:43.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:43 smithi049 bash[23528]: cluster 2024-09-21T01:22:42.369728+0000 mgr.a (mgr.14388) 8143 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:43 smithi044 bash[22676]: cluster 2024-09-21T01:22:42.369728+0000 mgr.a (mgr.14388) 8143 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:43 smithi179 bash[23186]: cluster 2024-09-21T01:22:42.369728+0000 mgr.a (mgr.14388) 8143 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:44.663 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:44 smithi179 bash[23186]: audit 2024-09-21T01:22:42.770129+0000 mgr.a (mgr.14388) 8144 : audit [DBG] from='client.182835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:44.695 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:44 smithi049 bash[23528]: audit 2024-09-21T01:22:42.770129+0000 mgr.a (mgr.14388) 8144 : audit [DBG] from='client.182835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:44 smithi044 bash[22676]: audit 2024-09-21T01:22:42.770129+0000 mgr.a (mgr.14388) 8144 : audit [DBG] from='client.182835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:45 smithi044 bash[22676]: cluster 2024-09-21T01:22:44.370681+0000 mgr.a (mgr.14388) 8145 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:45 smithi179 bash[23186]: cluster 2024-09-21T01:22:44.370681+0000 mgr.a (mgr.14388) 8145 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:45.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:45 smithi049 bash[23528]: cluster 2024-09-21T01:22:44.370681+0000 mgr.a (mgr.14388) 8145 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:46.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:46 smithi044 bash[22676]: cluster 2024-09-21T01:22:46.373003+0000 mgr.a (mgr.14388) 8146 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:46 smithi179 bash[23186]: cluster 2024-09-21T01:22:46.373003+0000 mgr.a (mgr.14388) 8146 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:46 smithi049 bash[23528]: cluster 2024-09-21T01:22:46.373003+0000 mgr.a (mgr.14388) 8146 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:48 smithi044 bash[22676]: audit 2024-09-21T01:22:47.356006+0000 mon.a (mon.0) 6925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:48 smithi044 bash[22676]: audit 2024-09-21T01:22:47.365320+0000 mon.a (mon.0) 6926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:48 smithi044 bash[22676]: audit 2024-09-21T01:22:47.376274+0000 mon.a (mon.0) 6927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:48 smithi179 bash[23186]: audit 2024-09-21T01:22:47.356006+0000 mon.a (mon.0) 6925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:48 smithi179 bash[23186]: audit 2024-09-21T01:22:47.365320+0000 mon.a (mon.0) 6926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:48 smithi179 bash[23186]: audit 2024-09-21T01:22:47.376274+0000 mon.a (mon.0) 6927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:48 smithi049 bash[23528]: audit 2024-09-21T01:22:47.356006+0000 mon.a (mon.0) 6925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:48 smithi049 bash[23528]: audit 2024-09-21T01:22:47.365320+0000 mon.a (mon.0) 6926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:48 smithi049 bash[23528]: audit 2024-09-21T01:22:47.376274+0000 mon.a (mon.0) 6927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:49.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:49.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:49.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:49.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:49 smithi044 bash[22676]: cluster 2024-09-21T01:22:48.373760+0000 mgr.a (mgr.14388) 8147 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:49 smithi044 bash[22676]: audit 2024-09-21T01:22:48.504599+0000 mon.a (mon.0) 6928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:49 smithi044 bash[22676]: audit 2024-09-21T01:22:48.510789+0000 mon.a (mon.0) 6929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:49 smithi044 bash[22676]: audit 2024-09-21T01:22:48.517780+0000 mon.a (mon.0) 6930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:49 smithi179 bash[23186]: cluster 2024-09-21T01:22:48.373760+0000 mgr.a (mgr.14388) 8147 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:49 smithi179 bash[23186]: audit 2024-09-21T01:22:48.504599+0000 mon.a (mon.0) 6928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:49 smithi179 bash[23186]: audit 2024-09-21T01:22:48.510789+0000 mon.a (mon.0) 6929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:49 smithi179 bash[23186]: audit 2024-09-21T01:22:48.517780+0000 mon.a (mon.0) 6930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:49 smithi049 bash[23528]: cluster 2024-09-21T01:22:48.373760+0000 mgr.a (mgr.14388) 8147 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:49 smithi049 bash[23528]: audit 2024-09-21T01:22:48.504599+0000 mon.a (mon.0) 6928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:49 smithi049 bash[23528]: audit 2024-09-21T01:22:48.510789+0000 mon.a (mon.0) 6929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:49 smithi049 bash[23528]: audit 2024-09-21T01:22:48.517780+0000 mon.a (mon.0) 6930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:50 smithi044 bash[22676]: audit 2024-09-21T01:22:48.564353+0000 mgr.a (mgr.14388) 8148 : audit [DBG] from='client.182913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:50 smithi179 bash[23186]: audit 2024-09-21T01:22:48.564353+0000 mgr.a (mgr.14388) 8148 : audit [DBG] from='client.182913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:50 smithi049 bash[23528]: audit 2024-09-21T01:22:48.564353+0000 mgr.a (mgr.14388) 8148 : audit [DBG] from='client.182913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:51 smithi044 bash[22676]: cluster 2024-09-21T01:22:50.376160+0000 mgr.a (mgr.14388) 8149 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:51 smithi179 bash[23186]: cluster 2024-09-21T01:22:50.376160+0000 mgr.a (mgr.14388) 8149 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:51 smithi049 bash[23528]: cluster 2024-09-21T01:22:50.376160+0000 mgr.a (mgr.14388) 8149 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:22:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:52 smithi044 bash[22676]: cluster 2024-09-21T01:22:52.376942+0000 mgr.a (mgr.14388) 8150 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:52 smithi179 bash[23186]: cluster 2024-09-21T01:22:52.376942+0000 mgr.a (mgr.14388) 8150 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:52 smithi049 bash[23528]: cluster 2024-09-21T01:22:52.376942+0000 mgr.a (mgr.14388) 8150 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:53 smithi044 bash[22676]: audit 2024-09-21T01:22:52.654520+0000 mon.a (mon.0) 6931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:53 smithi044 bash[22676]: audit 2024-09-21T01:22:52.663592+0000 mon.a (mon.0) 6932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:53 smithi044 bash[22676]: audit 2024-09-21T01:22:52.674213+0000 mon.a (mon.0) 6933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:53 smithi179 bash[23186]: audit 2024-09-21T01:22:52.654520+0000 mon.a (mon.0) 6931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:53 smithi179 bash[23186]: audit 2024-09-21T01:22:52.663592+0000 mon.a (mon.0) 6932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:53 smithi179 bash[23186]: audit 2024-09-21T01:22:52.674213+0000 mon.a (mon.0) 6933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:54.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:54.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:22:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:53 smithi049 bash[23528]: audit 2024-09-21T01:22:52.654520+0000 mon.a (mon.0) 6931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:53 smithi049 bash[23528]: audit 2024-09-21T01:22:52.663592+0000 mon.a (mon.0) 6932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:53 smithi049 bash[23528]: audit 2024-09-21T01:22:52.674213+0000 mon.a (mon.0) 6933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:22:54.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:22:54.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:22:54.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:22:54.790 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:22:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:53.952421+0000 mon.a (mon.0) 6934 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:22:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.350430+0000 mgr.a (mgr.14388) 8151 : audit [DBG] from='client.182988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: cluster 2024-09-21T01:22:54.377659+0000 mgr.a (mgr.14388) 8152 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.556201+0000 mon.a (mon.0) 6935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.562891+0000 mon.a (mon.0) 6936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.579629+0000 mon.a (mon.0) 6937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.596066+0000 mon.a (mon.0) 6938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.598097+0000 mon.a (mon.0) 6939 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:22:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.598975+0000 mon.a (mon.0) 6940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:22:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.607782+0000 mon.a (mon.0) 6941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:54 smithi044 bash[22676]: audit 2024-09-21T01:22:54.611242+0000 mon.a (mon.0) 6942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:22:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:53.952421+0000 mon.a (mon.0) 6934 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:22:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.350430+0000 mgr.a (mgr.14388) 8151 : audit [DBG] from='client.182988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: cluster 2024-09-21T01:22:54.377659+0000 mgr.a (mgr.14388) 8152 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.556201+0000 mon.a (mon.0) 6935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.562891+0000 mon.a (mon.0) 6936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.579629+0000 mon.a (mon.0) 6937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.596066+0000 mon.a (mon.0) 6938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.598097+0000 mon.a (mon.0) 6939 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:22:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.598975+0000 mon.a (mon.0) 6940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:22:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.607782+0000 mon.a (mon.0) 6941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:54 smithi179 bash[23186]: audit 2024-09-21T01:22:54.611242+0000 mon.a (mon.0) 6942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:53.952421+0000 mon.a (mon.0) 6934 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.350430+0000 mgr.a (mgr.14388) 8151 : audit [DBG] from='client.182988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: cluster 2024-09-21T01:22:54.377659+0000 mgr.a (mgr.14388) 8152 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.556201+0000 mon.a (mon.0) 6935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.562891+0000 mon.a (mon.0) 6936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.579629+0000 mon.a (mon.0) 6937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.596066+0000 mon.a (mon.0) 6938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.598097+0000 mon.a (mon.0) 6939 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.598975+0000 mon.a (mon.0) 6940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:22:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.607782+0000 mon.a (mon.0) 6941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:22:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:54 smithi049 bash[23528]: audit 2024-09-21T01:22:54.611242+0000 mon.a (mon.0) 6942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:22:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:55 smithi044 bash[22676]: audit 2024-09-21T01:22:54.612233+0000 mgr.a (mgr.14388) 8153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:22:55.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:22:55 smithi044 bash[22930]: debug 2024-09-21T01:22:55.496+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:22:55.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:22:55 smithi044 bash[22930]: debug 2024-09-21T01:22:55.496+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:22:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:55 smithi179 bash[23186]: audit 2024-09-21T01:22:54.612233+0000 mgr.a (mgr.14388) 8153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:22:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:55 smithi049 bash[23528]: audit 2024-09-21T01:22:54.612233+0000 mgr.a (mgr.14388) 8153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:22:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:56 smithi044 bash[22676]: audit 2024-09-21T01:22:55.499081+0000 mgr.a (mgr.14388) 8154 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:22:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:56 smithi044 bash[22676]: cephadm 2024-09-21T01:22:55.500506+0000 mgr.a (mgr.14388) 8155 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:22:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:56 smithi044 bash[22676]: cluster 2024-09-21T01:22:56.380464+0000 mgr.a (mgr.14388) 8156 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T01:22:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:56 smithi179 bash[23186]: audit 2024-09-21T01:22:55.499081+0000 mgr.a (mgr.14388) 8154 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:22:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:56 smithi179 bash[23186]: cephadm 2024-09-21T01:22:55.500506+0000 mgr.a (mgr.14388) 8155 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:22:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:56 smithi179 bash[23186]: cluster 2024-09-21T01:22:56.380464+0000 mgr.a (mgr.14388) 8156 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T01:22:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:56 smithi049 bash[23528]: audit 2024-09-21T01:22:55.499081+0000 mgr.a (mgr.14388) 8154 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:22:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:56 smithi049 bash[23528]: cephadm 2024-09-21T01:22:55.500506+0000 mgr.a (mgr.14388) 8155 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:22:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:56 smithi049 bash[23528]: cluster 2024-09-21T01:22:56.380464+0000 mgr.a (mgr.14388) 8156 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T01:22:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:22:58 smithi044 bash[22676]: cluster 2024-09-21T01:22:58.381230+0000 mgr.a (mgr.14388) 8157 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:22:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:22:58 smithi179 bash[23186]: cluster 2024-09-21T01:22:58.381230+0000 mgr.a (mgr.14388) 8157 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:22:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:22:58 smithi049 bash[23528]: cluster 2024-09-21T01:22:58.381230+0000 mgr.a (mgr.14388) 8157 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:22:59.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:22:59.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:22:59.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:00.592 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:00.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:00 smithi044 bash[22676]: audit 2024-09-21T01:23:00.124653+0000 mgr.a (mgr.14388) 8158 : audit [DBG] from='client.183171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:00 smithi044 bash[22676]: cluster 2024-09-21T01:23:00.383218+0000 mgr.a (mgr.14388) 8159 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:23:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:00 smithi179 bash[23186]: audit 2024-09-21T01:23:00.124653+0000 mgr.a (mgr.14388) 8158 : audit [DBG] from='client.183171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:00 smithi179 bash[23186]: cluster 2024-09-21T01:23:00.383218+0000 mgr.a (mgr.14388) 8159 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:23:00.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:00 smithi049 bash[23528]: audit 2024-09-21T01:23:00.124653+0000 mgr.a (mgr.14388) 8158 : audit [DBG] from='client.183171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:00 smithi049 bash[23528]: cluster 2024-09-21T01:23:00.383218+0000 mgr.a (mgr.14388) 8159 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:23:02.632 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:02 smithi049 bash[23528]: cluster 2024-09-21T01:23:02.384151+0000 mgr.a (mgr.14388) 8160 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:02 smithi044 bash[22676]: cluster 2024-09-21T01:23:02.384151+0000 mgr.a (mgr.14388) 8160 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:02 smithi179 bash[23186]: cluster 2024-09-21T01:23:02.384151+0000 mgr.a (mgr.14388) 8160 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:04 smithi044 bash[22676]: cluster 2024-09-21T01:23:04.384953+0000 mgr.a (mgr.14388) 8161 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:04 smithi179 bash[23186]: cluster 2024-09-21T01:23:04.384953+0000 mgr.a (mgr.14388) 8161 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:04.760 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:04 smithi049 bash[23528]: cluster 2024-09-21T01:23:04.384953+0000 mgr.a (mgr.14388) 8161 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:05.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:05.595 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:06.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:06.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:06.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:06.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:06.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:06 smithi044 bash[22676]: audit 2024-09-21T01:23:05.935357+0000 mgr.a (mgr.14388) 8162 : audit [DBG] from='client.183246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:06 smithi044 bash[22676]: cluster 2024-09-21T01:23:06.386515+0000 mgr.a (mgr.14388) 8163 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:23:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:06 smithi179 bash[23186]: audit 2024-09-21T01:23:05.935357+0000 mgr.a (mgr.14388) 8162 : audit [DBG] from='client.183246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:06 smithi179 bash[23186]: cluster 2024-09-21T01:23:06.386515+0000 mgr.a (mgr.14388) 8163 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:23:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:06 smithi049 bash[23528]: audit 2024-09-21T01:23:05.935357+0000 mgr.a (mgr.14388) 8162 : audit [DBG] from='client.183246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:06 smithi049 bash[23528]: cluster 2024-09-21T01:23:06.386515+0000 mgr.a (mgr.14388) 8163 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:23:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:08 smithi049 bash[23528]: audit 2024-09-21T01:23:07.507226+0000 mon.a (mon.0) 6943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:08 smithi049 bash[23528]: audit 2024-09-21T01:23:07.515911+0000 mon.a (mon.0) 6944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:08 smithi049 bash[23528]: audit 2024-09-21T01:23:07.526424+0000 mon.a (mon.0) 6945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:08 smithi049 bash[23528]: cluster 2024-09-21T01:23:08.387239+0000 mgr.a (mgr.14388) 8164 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T01:23:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:08 smithi044 bash[22676]: audit 2024-09-21T01:23:07.507226+0000 mon.a (mon.0) 6943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:08 smithi044 bash[22676]: audit 2024-09-21T01:23:07.515911+0000 mon.a (mon.0) 6944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:08 smithi044 bash[22676]: audit 2024-09-21T01:23:07.526424+0000 mon.a (mon.0) 6945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:08 smithi044 bash[22676]: cluster 2024-09-21T01:23:08.387239+0000 mgr.a (mgr.14388) 8164 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T01:23:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:08 smithi179 bash[23186]: audit 2024-09-21T01:23:07.507226+0000 mon.a (mon.0) 6943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:08 smithi179 bash[23186]: audit 2024-09-21T01:23:07.515911+0000 mon.a (mon.0) 6944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:08 smithi179 bash[23186]: audit 2024-09-21T01:23:07.526424+0000 mon.a (mon.0) 6945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:08 smithi179 bash[23186]: cluster 2024-09-21T01:23:08.387239+0000 mgr.a (mgr.14388) 8164 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T01:23:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:09 smithi044 bash[22676]: audit 2024-09-21T01:23:08.648906+0000 mon.a (mon.0) 6946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:09 smithi044 bash[22676]: audit 2024-09-21T01:23:08.654271+0000 mon.a (mon.0) 6947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:09 smithi044 bash[22676]: audit 2024-09-21T01:23:08.661513+0000 mon.a (mon.0) 6948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:09 smithi179 bash[23186]: audit 2024-09-21T01:23:08.648906+0000 mon.a (mon.0) 6946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:09 smithi179 bash[23186]: audit 2024-09-21T01:23:08.654271+0000 mon.a (mon.0) 6947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:09 smithi179 bash[23186]: audit 2024-09-21T01:23:08.661513+0000 mon.a (mon.0) 6948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:09 smithi049 bash[23528]: audit 2024-09-21T01:23:08.648906+0000 mon.a (mon.0) 6946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:09 smithi049 bash[23528]: audit 2024-09-21T01:23:08.654271+0000 mon.a (mon.0) 6947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:09 smithi049 bash[23528]: audit 2024-09-21T01:23:08.661513+0000 mon.a (mon.0) 6948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:10 smithi044 bash[22676]: cluster 2024-09-21T01:23:10.389181+0000 mgr.a (mgr.14388) 8165 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:10 smithi179 bash[23186]: cluster 2024-09-21T01:23:10.389181+0000 mgr.a (mgr.14388) 8165 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:10 smithi049 bash[23528]: cluster 2024-09-21T01:23:10.389181+0000 mgr.a (mgr.14388) 8165 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:23:11.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:12.156 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:12 smithi044 bash[22676]: audit 2024-09-21T01:23:11.716360+0000 mgr.a (mgr.14388) 8166 : audit [DBG] from='client.183324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:12 smithi044 bash[22676]: cluster 2024-09-21T01:23:12.390098+0000 mgr.a (mgr.14388) 8167 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:12 smithi179 bash[23186]: audit 2024-09-21T01:23:11.716360+0000 mgr.a (mgr.14388) 8166 : audit [DBG] from='client.183324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:12 smithi179 bash[23186]: cluster 2024-09-21T01:23:12.390098+0000 mgr.a (mgr.14388) 8167 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:12 smithi049 bash[23528]: audit 2024-09-21T01:23:11.716360+0000 mgr.a (mgr.14388) 8166 : audit [DBG] from='client.183324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:12 smithi049 bash[23528]: cluster 2024-09-21T01:23:12.390098+0000 mgr.a (mgr.14388) 8167 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:13 smithi044 bash[22676]: audit 2024-09-21T01:23:12.885526+0000 mon.a (mon.0) 6949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:13 smithi044 bash[22676]: audit 2024-09-21T01:23:12.895464+0000 mon.a (mon.0) 6950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:13 smithi044 bash[22676]: audit 2024-09-21T01:23:12.906181+0000 mon.a (mon.0) 6951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:13 smithi179 bash[23186]: audit 2024-09-21T01:23:12.885526+0000 mon.a (mon.0) 6949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:13 smithi179 bash[23186]: audit 2024-09-21T01:23:12.895464+0000 mon.a (mon.0) 6950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:13 smithi179 bash[23186]: audit 2024-09-21T01:23:12.906181+0000 mon.a (mon.0) 6951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:13 smithi049 bash[23528]: audit 2024-09-21T01:23:12.885526+0000 mon.a (mon.0) 6949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:13 smithi049 bash[23528]: audit 2024-09-21T01:23:12.895464+0000 mon.a (mon.0) 6950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:13 smithi049 bash[23528]: audit 2024-09-21T01:23:12.906181+0000 mon.a (mon.0) 6951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:14 smithi044 bash[22676]: cluster 2024-09-21T01:23:14.390862+0000 mgr.a (mgr.14388) 8168 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:14 smithi179 bash[23186]: cluster 2024-09-21T01:23:14.390862+0000 mgr.a (mgr.14388) 8168 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:15.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:14 smithi049 bash[23528]: cluster 2024-09-21T01:23:14.390862+0000 mgr.a (mgr.14388) 8168 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:16 smithi044 bash[22676]: cluster 2024-09-21T01:23:16.393122+0000 mgr.a (mgr.14388) 8169 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:16 smithi179 bash[23186]: cluster 2024-09-21T01:23:16.393122+0000 mgr.a (mgr.14388) 8169 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:16.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:16 smithi049 bash[23528]: cluster 2024-09-21T01:23:16.393122+0000 mgr.a (mgr.14388) 8169 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:17.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:17.927 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:17.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:17.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:17.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:17.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:18 smithi044 bash[22676]: audit 2024-09-21T01:23:17.496690+0000 mgr.a (mgr.14388) 8170 : audit [DBG] from='client.183402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:18 smithi044 bash[22676]: cluster 2024-09-21T01:23:18.394069+0000 mgr.a (mgr.14388) 8171 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:18 smithi179 bash[23186]: audit 2024-09-21T01:23:17.496690+0000 mgr.a (mgr.14388) 8170 : audit [DBG] from='client.183402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:18 smithi179 bash[23186]: cluster 2024-09-21T01:23:18.394069+0000 mgr.a (mgr.14388) 8171 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:18 smithi049 bash[23528]: audit 2024-09-21T01:23:17.496690+0000 mgr.a (mgr.14388) 8170 : audit [DBG] from='client.183402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:18.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:18 smithi049 bash[23528]: cluster 2024-09-21T01:23:18.394069+0000 mgr.a (mgr.14388) 8171 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:20 smithi044 bash[22676]: cluster 2024-09-21T01:23:20.396225+0000 mgr.a (mgr.14388) 8172 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:20 smithi179 bash[23186]: cluster 2024-09-21T01:23:20.396225+0000 mgr.a (mgr.14388) 8172 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:20.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:20 smithi049 bash[23528]: cluster 2024-09-21T01:23:20.396225+0000 mgr.a (mgr.14388) 8172 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:22 smithi044 bash[22676]: cluster 2024-09-21T01:23:22.396995+0000 mgr.a (mgr.14388) 8173 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:22 smithi179 bash[23186]: cluster 2024-09-21T01:23:22.396995+0000 mgr.a (mgr.14388) 8173 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:22.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:22 smithi049 bash[23528]: cluster 2024-09-21T01:23:22.396995+0000 mgr.a (mgr.14388) 8173 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:22.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:23.710 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:23.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:23 smithi044 bash[22676]: audit 2024-09-21T01:23:23.265767+0000 mgr.a (mgr.14388) 8174 : audit [DBG] from='client.183480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:23 smithi179 bash[23186]: audit 2024-09-21T01:23:23.265767+0000 mgr.a (mgr.14388) 8174 : audit [DBG] from='client.183480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:23.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:23 smithi049 bash[23528]: audit 2024-09-21T01:23:23.265767+0000 mgr.a (mgr.14388) 8174 : audit [DBG] from='client.183480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:24 smithi049 bash[23528]: cluster 2024-09-21T01:23:24.398028+0000 mgr.a (mgr.14388) 8175 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:24 smithi044 bash[22676]: cluster 2024-09-21T01:23:24.398028+0000 mgr.a (mgr.14388) 8175 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:24 smithi179 bash[23186]: cluster 2024-09-21T01:23:24.398028+0000 mgr.a (mgr.14388) 8175 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:26 smithi044 bash[22676]: cluster 2024-09-21T01:23:26.400318+0000 mgr.a (mgr.14388) 8176 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:26 smithi179 bash[23186]: cluster 2024-09-21T01:23:26.400318+0000 mgr.a (mgr.14388) 8176 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:26 smithi049 bash[23528]: cluster 2024-09-21T01:23:26.400318+0000 mgr.a (mgr.14388) 8176 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:28.713 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:28 smithi044 bash[22676]: audit 2024-09-21T01:23:27.674598+0000 mon.a (mon.0) 6952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:28 smithi044 bash[22676]: audit 2024-09-21T01:23:27.683034+0000 mon.a (mon.0) 6953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:28 smithi044 bash[22676]: audit 2024-09-21T01:23:27.694586+0000 mon.a (mon.0) 6954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:28 smithi044 bash[22676]: cluster 2024-09-21T01:23:28.401054+0000 mgr.a (mgr.14388) 8177 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:28 smithi179 bash[23186]: audit 2024-09-21T01:23:27.674598+0000 mon.a (mon.0) 6952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:28 smithi179 bash[23186]: audit 2024-09-21T01:23:27.683034+0000 mon.a (mon.0) 6953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:28 smithi179 bash[23186]: audit 2024-09-21T01:23:27.694586+0000 mon.a (mon.0) 6954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:28 smithi179 bash[23186]: cluster 2024-09-21T01:23:28.401054+0000 mgr.a (mgr.14388) 8177 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:28 smithi049 bash[23528]: audit 2024-09-21T01:23:27.674598+0000 mon.a (mon.0) 6952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:28 smithi049 bash[23528]: audit 2024-09-21T01:23:27.683034+0000 mon.a (mon.0) 6953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:28 smithi049 bash[23528]: audit 2024-09-21T01:23:27.694586+0000 mon.a (mon.0) 6954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:28 smithi049 bash[23528]: cluster 2024-09-21T01:23:28.401054+0000 mgr.a (mgr.14388) 8177 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:29.471 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:29.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:29.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:29.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:29.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:29 smithi044 bash[22676]: audit 2024-09-21T01:23:28.827320+0000 mon.a (mon.0) 6955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:29 smithi044 bash[22676]: audit 2024-09-21T01:23:28.833110+0000 mon.a (mon.0) 6956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:29 smithi044 bash[22676]: audit 2024-09-21T01:23:28.838641+0000 mon.a (mon.0) 6957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:29 smithi044 bash[22676]: audit 2024-09-21T01:23:29.049382+0000 mgr.a (mgr.14388) 8178 : audit [DBG] from='client.183558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:29 smithi179 bash[23186]: audit 2024-09-21T01:23:28.827320+0000 mon.a (mon.0) 6955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:29 smithi179 bash[23186]: audit 2024-09-21T01:23:28.833110+0000 mon.a (mon.0) 6956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:29 smithi179 bash[23186]: audit 2024-09-21T01:23:28.838641+0000 mon.a (mon.0) 6957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:29 smithi179 bash[23186]: audit 2024-09-21T01:23:29.049382+0000 mgr.a (mgr.14388) 8178 : audit [DBG] from='client.183558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:29 smithi049 bash[23528]: audit 2024-09-21T01:23:28.827320+0000 mon.a (mon.0) 6955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:29 smithi049 bash[23528]: audit 2024-09-21T01:23:28.833110+0000 mon.a (mon.0) 6956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:29 smithi049 bash[23528]: audit 2024-09-21T01:23:28.838641+0000 mon.a (mon.0) 6957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:29 smithi049 bash[23528]: audit 2024-09-21T01:23:29.049382+0000 mgr.a (mgr.14388) 8178 : audit [DBG] from='client.183558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:30 smithi049 bash[23528]: cluster 2024-09-21T01:23:30.403385+0000 mgr.a (mgr.14388) 8179 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:30 smithi044 bash[22676]: cluster 2024-09-21T01:23:30.403385+0000 mgr.a (mgr.14388) 8179 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:31.301 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:30 smithi179 bash[23186]: cluster 2024-09-21T01:23:30.403385+0000 mgr.a (mgr.14388) 8179 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:32 smithi044 bash[22676]: cluster 2024-09-21T01:23:32.404118+0000 mgr.a (mgr.14388) 8180 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:32 smithi179 bash[23186]: cluster 2024-09-21T01:23:32.404118+0000 mgr.a (mgr.14388) 8180 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:32 smithi049 bash[23528]: cluster 2024-09-21T01:23:32.404118+0000 mgr.a (mgr.14388) 8180 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:34.473 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:34.473 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:34 smithi044 bash[22676]: audit 2024-09-21T01:23:33.122585+0000 mon.a (mon.0) 6958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:34 smithi044 bash[22676]: audit 2024-09-21T01:23:33.131933+0000 mon.a (mon.0) 6959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:34 smithi044 bash[22676]: audit 2024-09-21T01:23:33.143570+0000 mon.a (mon.0) 6960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:34 smithi179 bash[23186]: audit 2024-09-21T01:23:33.122585+0000 mon.a (mon.0) 6958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:34 smithi179 bash[23186]: audit 2024-09-21T01:23:33.131933+0000 mon.a (mon.0) 6959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:34 smithi179 bash[23186]: audit 2024-09-21T01:23:33.143570+0000 mon.a (mon.0) 6960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:34 smithi049 bash[23528]: audit 2024-09-21T01:23:33.122585+0000 mon.a (mon.0) 6958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:34 smithi049 bash[23528]: audit 2024-09-21T01:23:33.131933+0000 mon.a (mon.0) 6959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:34 smithi049 bash[23528]: audit 2024-09-21T01:23:33.143570+0000 mon.a (mon.0) 6960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:35.258 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:35.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:35.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:35.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:35.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:35 smithi044 bash[22676]: cluster 2024-09-21T01:23:34.405050+0000 mgr.a (mgr.14388) 8181 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:35 smithi179 bash[23186]: cluster 2024-09-21T01:23:34.405050+0000 mgr.a (mgr.14388) 8181 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:35.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:35 smithi049 bash[23528]: cluster 2024-09-21T01:23:34.405050+0000 mgr.a (mgr.14388) 8181 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:36 smithi044 bash[22676]: audit 2024-09-21T01:23:34.812838+0000 mgr.a (mgr.14388) 8182 : audit [DBG] from='client.183636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:36 smithi179 bash[23186]: audit 2024-09-21T01:23:34.812838+0000 mgr.a (mgr.14388) 8182 : audit [DBG] from='client.183636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:36 smithi049 bash[23528]: audit 2024-09-21T01:23:34.812838+0000 mgr.a (mgr.14388) 8182 : audit [DBG] from='client.183636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:37 smithi044 bash[22676]: cluster 2024-09-21T01:23:36.407983+0000 mgr.a (mgr.14388) 8183 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:37 smithi179 bash[23186]: cluster 2024-09-21T01:23:36.407983+0000 mgr.a (mgr.14388) 8183 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:37.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:37 smithi049 bash[23528]: cluster 2024-09-21T01:23:36.407983+0000 mgr.a (mgr.14388) 8183 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:38 smithi044 bash[22676]: cluster 2024-09-21T01:23:38.408775+0000 mgr.a (mgr.14388) 8184 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:23:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:38 smithi179 bash[23186]: cluster 2024-09-21T01:23:38.408775+0000 mgr.a (mgr.14388) 8184 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:23:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:38 smithi049 bash[23528]: cluster 2024-09-21T01:23:38.408775+0000 mgr.a (mgr.14388) 8184 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:23:40.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:40.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:40 smithi044 bash[22676]: cluster 2024-09-21T01:23:40.410008+0000 mgr.a (mgr.14388) 8185 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:40 smithi179 bash[23186]: cluster 2024-09-21T01:23:40.410008+0000 mgr.a (mgr.14388) 8185 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:40.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:40 smithi049 bash[23528]: cluster 2024-09-21T01:23:40.410008+0000 mgr.a (mgr.14388) 8185 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:41.016 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:41 smithi044 bash[22676]: audit 2024-09-21T01:23:40.595181+0000 mgr.a (mgr.14388) 8186 : audit [DBG] from='client.183711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:41 smithi179 bash[23186]: audit 2024-09-21T01:23:40.595181+0000 mgr.a (mgr.14388) 8186 : audit [DBG] from='client.183711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:41.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:41 smithi049 bash[23528]: audit 2024-09-21T01:23:40.595181+0000 mgr.a (mgr.14388) 8186 : audit [DBG] from='client.183711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:42 smithi044 bash[22676]: cluster 2024-09-21T01:23:42.410903+0000 mgr.a (mgr.14388) 8187 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:23:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:42 smithi179 bash[23186]: cluster 2024-09-21T01:23:42.410903+0000 mgr.a (mgr.14388) 8187 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:23:42.779 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:42 smithi049 bash[23528]: cluster 2024-09-21T01:23:42.410903+0000 mgr.a (mgr.14388) 8187 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:23:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:44 smithi044 bash[22676]: cluster 2024-09-21T01:23:44.411731+0000 mgr.a (mgr.14388) 8188 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:23:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:44 smithi179 bash[23186]: cluster 2024-09-21T01:23:44.411731+0000 mgr.a (mgr.14388) 8188 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:23:44.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:44 smithi049 bash[23528]: cluster 2024-09-21T01:23:44.411731+0000 mgr.a (mgr.14388) 8188 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:23:46.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:46.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:46.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:46 smithi044 bash[22676]: audit 2024-09-21T01:23:46.350131+0000 mgr.a (mgr.14388) 8189 : audit [DBG] from='client.183786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:46 smithi044 bash[22676]: cluster 2024-09-21T01:23:46.413902+0000 mgr.a (mgr.14388) 8190 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:46 smithi179 bash[23186]: audit 2024-09-21T01:23:46.350131+0000 mgr.a (mgr.14388) 8189 : audit [DBG] from='client.183786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:46 smithi179 bash[23186]: cluster 2024-09-21T01:23:46.413902+0000 mgr.a (mgr.14388) 8190 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:46.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:46 smithi049 bash[23528]: audit 2024-09-21T01:23:46.350131+0000 mgr.a (mgr.14388) 8189 : audit [DBG] from='client.183786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:46 smithi049 bash[23528]: cluster 2024-09-21T01:23:46.413902+0000 mgr.a (mgr.14388) 8190 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:48 smithi044 bash[22676]: audit 2024-09-21T01:23:47.904424+0000 mon.a (mon.0) 6961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:48 smithi044 bash[22676]: audit 2024-09-21T01:23:47.911163+0000 mon.a (mon.0) 6962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:48 smithi044 bash[22676]: audit 2024-09-21T01:23:47.921203+0000 mon.a (mon.0) 6963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:48 smithi044 bash[22676]: cluster 2024-09-21T01:23:48.414789+0000 mgr.a (mgr.14388) 8191 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:48 smithi179 bash[23186]: audit 2024-09-21T01:23:47.904424+0000 mon.a (mon.0) 6961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:48 smithi179 bash[23186]: audit 2024-09-21T01:23:47.911163+0000 mon.a (mon.0) 6962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:48 smithi179 bash[23186]: audit 2024-09-21T01:23:47.921203+0000 mon.a (mon.0) 6963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:48 smithi179 bash[23186]: cluster 2024-09-21T01:23:48.414789+0000 mgr.a (mgr.14388) 8191 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:49.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:48 smithi049 bash[23528]: audit 2024-09-21T01:23:47.904424+0000 mon.a (mon.0) 6961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:48 smithi049 bash[23528]: audit 2024-09-21T01:23:47.911163+0000 mon.a (mon.0) 6962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:48 smithi049 bash[23528]: audit 2024-09-21T01:23:47.921203+0000 mon.a (mon.0) 6963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:48 smithi049 bash[23528]: cluster 2024-09-21T01:23:48.414789+0000 mgr.a (mgr.14388) 8191 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:49 smithi044 bash[22676]: audit 2024-09-21T01:23:48.969539+0000 mon.a (mon.0) 6964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:49 smithi044 bash[22676]: audit 2024-09-21T01:23:48.974246+0000 mon.a (mon.0) 6965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:49 smithi044 bash[22676]: audit 2024-09-21T01:23:48.979367+0000 mon.a (mon.0) 6966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:49 smithi179 bash[23186]: audit 2024-09-21T01:23:48.969539+0000 mon.a (mon.0) 6964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:49 smithi179 bash[23186]: audit 2024-09-21T01:23:48.974246+0000 mon.a (mon.0) 6965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:49 smithi179 bash[23186]: audit 2024-09-21T01:23:48.979367+0000 mon.a (mon.0) 6966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:49 smithi049 bash[23528]: audit 2024-09-21T01:23:48.969539+0000 mon.a (mon.0) 6964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:49 smithi049 bash[23528]: audit 2024-09-21T01:23:48.974246+0000 mon.a (mon.0) 6965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:49 smithi049 bash[23528]: audit 2024-09-21T01:23:48.979367+0000 mon.a (mon.0) 6966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:50 smithi179 bash[23186]: cluster 2024-09-21T01:23:50.416996+0000 mgr.a (mgr.14388) 8192 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:50 smithi049 bash[23528]: cluster 2024-09-21T01:23:50.416996+0000 mgr.a (mgr.14388) 8192 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:50 smithi044 bash[22676]: cluster 2024-09-21T01:23:50.416996+0000 mgr.a (mgr.14388) 8192 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:52.550 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:52.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:52.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:52.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:52.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:52 smithi044 bash[22676]: audit 2024-09-21T01:23:52.133720+0000 mgr.a (mgr.14388) 8193 : audit [DBG] from='client.183864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:52 smithi044 bash[22676]: cluster 2024-09-21T01:23:52.417609+0000 mgr.a (mgr.14388) 8194 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:52 smithi179 bash[23186]: audit 2024-09-21T01:23:52.133720+0000 mgr.a (mgr.14388) 8193 : audit [DBG] from='client.183864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:52 smithi179 bash[23186]: cluster 2024-09-21T01:23:52.417609+0000 mgr.a (mgr.14388) 8194 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:52 smithi049 bash[23528]: audit 2024-09-21T01:23:52.133720+0000 mgr.a (mgr.14388) 8193 : audit [DBG] from='client.183864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:52 smithi049 bash[23528]: cluster 2024-09-21T01:23:52.417609+0000 mgr.a (mgr.14388) 8194 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:54 smithi044 bash[22676]: audit 2024-09-21T01:23:53.358807+0000 mon.a (mon.0) 6967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:54 smithi044 bash[22676]: audit 2024-09-21T01:23:53.367386+0000 mon.a (mon.0) 6968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:54 smithi044 bash[22676]: audit 2024-09-21T01:23:53.378016+0000 mon.a (mon.0) 6969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:54 smithi179 bash[23186]: audit 2024-09-21T01:23:53.358807+0000 mon.a (mon.0) 6967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:54 smithi179 bash[23186]: audit 2024-09-21T01:23:53.367386+0000 mon.a (mon.0) 6968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:54 smithi179 bash[23186]: audit 2024-09-21T01:23:53.378016+0000 mon.a (mon.0) 6969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:54 smithi049 bash[23528]: audit 2024-09-21T01:23:53.358807+0000 mon.a (mon.0) 6967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:54 smithi049 bash[23528]: audit 2024-09-21T01:23:53.367386+0000 mon.a (mon.0) 6968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:54 smithi049 bash[23528]: audit 2024-09-21T01:23:53.378016+0000 mon.a (mon.0) 6969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:55 smithi044 bash[22676]: cluster 2024-09-21T01:23:54.418475+0000 mgr.a (mgr.14388) 8195 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:55 smithi179 bash[23186]: cluster 2024-09-21T01:23:54.418475+0000 mgr.a (mgr.14388) 8195 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:55 smithi049 bash[23528]: cluster 2024-09-21T01:23:54.418475+0000 mgr.a (mgr.14388) 8195 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22676]: audit 2024-09-21T01:23:55.553043+0000 mon.a (mon.0) 6970 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:23:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22676]: audit 2024-09-21T01:23:56.126174+0000 mon.a (mon.0) 6971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22676]: audit 2024-09-21T01:23:56.135050+0000 mon.a (mon.0) 6972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22676]: audit 2024-09-21T01:23:56.137566+0000 mon.a (mon.0) 6973 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:23:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22676]: audit 2024-09-21T01:23:56.139695+0000 mon.a (mon.0) 6974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:23:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22676]: audit 2024-09-21T01:23:56.150692+0000 mon.a (mon.0) 6975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22676]: audit 2024-09-21T01:23:56.157108+0000 mon.a (mon.0) 6976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:23:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:56 smithi179 bash[23186]: audit 2024-09-21T01:23:55.553043+0000 mon.a (mon.0) 6970 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:23:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:56 smithi179 bash[23186]: audit 2024-09-21T01:23:56.126174+0000 mon.a (mon.0) 6971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:56 smithi179 bash[23186]: audit 2024-09-21T01:23:56.135050+0000 mon.a (mon.0) 6972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:56 smithi179 bash[23186]: audit 2024-09-21T01:23:56.137566+0000 mon.a (mon.0) 6973 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:23:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:56 smithi179 bash[23186]: audit 2024-09-21T01:23:56.139695+0000 mon.a (mon.0) 6974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:23:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:56 smithi179 bash[23186]: audit 2024-09-21T01:23:56.150692+0000 mon.a (mon.0) 6975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:56 smithi179 bash[23186]: audit 2024-09-21T01:23:56.157108+0000 mon.a (mon.0) 6976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:23:56.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:56 smithi049 bash[23528]: audit 2024-09-21T01:23:55.553043+0000 mon.a (mon.0) 6970 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:23:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:56 smithi049 bash[23528]: audit 2024-09-21T01:23:56.126174+0000 mon.a (mon.0) 6971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:56 smithi049 bash[23528]: audit 2024-09-21T01:23:56.135050+0000 mon.a (mon.0) 6972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:56 smithi049 bash[23528]: audit 2024-09-21T01:23:56.137566+0000 mon.a (mon.0) 6973 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:23:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:56 smithi049 bash[23528]: audit 2024-09-21T01:23:56.139695+0000 mon.a (mon.0) 6974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:23:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:56 smithi049 bash[23528]: audit 2024-09-21T01:23:56.150692+0000 mon.a (mon.0) 6975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:23:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:56 smithi049 bash[23528]: audit 2024-09-21T01:23:56.157108+0000 mon.a (mon.0) 6976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:23:57.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22930]: debug 2024-09-21T01:23:56.963+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:23:57.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:23:56 smithi044 bash[22930]: debug 2024-09-21T01:23:56.963+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:23:57.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:23:57.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:23:57.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:23:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:57 smithi044 bash[22676]: audit 2024-09-21T01:23:56.159478+0000 mgr.a (mgr.14388) 8196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:23:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:57 smithi044 bash[22676]: cluster 2024-09-21T01:23:56.419894+0000 mgr.a (mgr.14388) 8197 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:57 smithi179 bash[23186]: audit 2024-09-21T01:23:56.159478+0000 mgr.a (mgr.14388) 8196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:23:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:57 smithi179 bash[23186]: cluster 2024-09-21T01:23:56.419894+0000 mgr.a (mgr.14388) 8197 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:57 smithi049 bash[23528]: audit 2024-09-21T01:23:56.159478+0000 mgr.a (mgr.14388) 8196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:23:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:57 smithi049 bash[23528]: cluster 2024-09-21T01:23:56.419894+0000 mgr.a (mgr.14388) 8197 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:23:58.327 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:23:58.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:23:58.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:23:58.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:23:58.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:23:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:58 smithi044 bash[22676]: audit 2024-09-21T01:23:56.965357+0000 mgr.a (mgr.14388) 8198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:23:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:58 smithi044 bash[22676]: cephadm 2024-09-21T01:23:56.967684+0000 mgr.a (mgr.14388) 8199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:23:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:58 smithi179 bash[23186]: audit 2024-09-21T01:23:56.965357+0000 mgr.a (mgr.14388) 8198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:23:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:58 smithi179 bash[23186]: cephadm 2024-09-21T01:23:56.967684+0000 mgr.a (mgr.14388) 8199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:23:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:58 smithi049 bash[23528]: audit 2024-09-21T01:23:56.965357+0000 mgr.a (mgr.14388) 8198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:23:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:58 smithi049 bash[23528]: cephadm 2024-09-21T01:23:56.967684+0000 mgr.a (mgr.14388) 8199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:23:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:59 smithi044 bash[22676]: audit 2024-09-21T01:23:57.890540+0000 mgr.a (mgr.14388) 8200 : audit [DBG] from='client.184044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:23:59 smithi044 bash[22676]: cluster 2024-09-21T01:23:58.420816+0000 mgr.a (mgr.14388) 8201 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:59 smithi179 bash[23186]: audit 2024-09-21T01:23:57.890540+0000 mgr.a (mgr.14388) 8200 : audit [DBG] from='client.184044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:23:59 smithi179 bash[23186]: cluster 2024-09-21T01:23:58.420816+0000 mgr.a (mgr.14388) 8201 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:23:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:59 smithi049 bash[23528]: audit 2024-09-21T01:23:57.890540+0000 mgr.a (mgr.14388) 8200 : audit [DBG] from='client.184044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:23:59.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:23:59 smithi049 bash[23528]: cluster 2024-09-21T01:23:58.420816+0000 mgr.a (mgr.14388) 8201 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:01 smithi044 bash[22676]: cluster 2024-09-21T01:24:00.423067+0000 mgr.a (mgr.14388) 8202 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:01 smithi179 bash[23186]: cluster 2024-09-21T01:24:00.423067+0000 mgr.a (mgr.14388) 8202 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:01.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:01 smithi049 bash[23528]: cluster 2024-09-21T01:24:00.423067+0000 mgr.a (mgr.14388) 8202 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:03.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:03.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:03.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:03 smithi044 bash[22676]: cluster 2024-09-21T01:24:02.423814+0000 mgr.a (mgr.14388) 8203 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:03 smithi179 bash[23186]: cluster 2024-09-21T01:24:02.423814+0000 mgr.a (mgr.14388) 8203 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:03 smithi049 bash[23528]: cluster 2024-09-21T01:24:02.423814+0000 mgr.a (mgr.14388) 8203 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:04.121 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:04.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:04.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:04.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:04.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:04 smithi179 bash[23186]: audit 2024-09-21T01:24:03.666786+0000 mgr.a (mgr.14388) 8204 : audit [DBG] from='client.184119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:04.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:04 smithi044 bash[22676]: audit 2024-09-21T01:24:03.666786+0000 mgr.a (mgr.14388) 8204 : audit [DBG] from='client.184119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:04 smithi049 bash[23528]: audit 2024-09-21T01:24:03.666786+0000 mgr.a (mgr.14388) 8204 : audit [DBG] from='client.184119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:05 smithi179 bash[23186]: cluster 2024-09-21T01:24:04.424754+0000 mgr.a (mgr.14388) 8205 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:05.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:05 smithi049 bash[23528]: cluster 2024-09-21T01:24:04.424754+0000 mgr.a (mgr.14388) 8205 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:05 smithi044 bash[22676]: cluster 2024-09-21T01:24:04.424754+0000 mgr.a (mgr.14388) 8205 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:07.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:07 smithi044 bash[22676]: cluster 2024-09-21T01:24:06.426980+0000 mgr.a (mgr.14388) 8206 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:07 smithi179 bash[23186]: cluster 2024-09-21T01:24:06.426980+0000 mgr.a (mgr.14388) 8206 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:07.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:07 smithi049 bash[23528]: cluster 2024-09-21T01:24:06.426980+0000 mgr.a (mgr.14388) 8206 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:09.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:09.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:09.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:09 smithi044 bash[22676]: audit 2024-09-21T01:24:08.067772+0000 mon.a (mon.0) 6977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:09 smithi044 bash[22676]: audit 2024-09-21T01:24:08.073390+0000 mon.a (mon.0) 6978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:09 smithi044 bash[22676]: audit 2024-09-21T01:24:08.079700+0000 mon.a (mon.0) 6979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:09 smithi179 bash[23186]: audit 2024-09-21T01:24:08.067772+0000 mon.a (mon.0) 6977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:09 smithi179 bash[23186]: audit 2024-09-21T01:24:08.073390+0000 mon.a (mon.0) 6978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:09 smithi179 bash[23186]: audit 2024-09-21T01:24:08.079700+0000 mon.a (mon.0) 6979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:09 smithi049 bash[23528]: audit 2024-09-21T01:24:08.067772+0000 mon.a (mon.0) 6977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:09 smithi049 bash[23528]: audit 2024-09-21T01:24:08.073390+0000 mon.a (mon.0) 6978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:09 smithi049 bash[23528]: audit 2024-09-21T01:24:08.079700+0000 mon.a (mon.0) 6979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:09.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:09.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:09.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:09.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:09.870 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:10 smithi044 bash[22676]: cluster 2024-09-21T01:24:08.427747+0000 mgr.a (mgr.14388) 8207 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:10 smithi044 bash[22676]: audit 2024-09-21T01:24:09.091531+0000 mon.a (mon.0) 6980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:10 smithi044 bash[22676]: audit 2024-09-21T01:24:09.097399+0000 mon.a (mon.0) 6981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:10 smithi044 bash[22676]: audit 2024-09-21T01:24:09.104312+0000 mon.a (mon.0) 6982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:10 smithi179 bash[23186]: cluster 2024-09-21T01:24:08.427747+0000 mgr.a (mgr.14388) 8207 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:10 smithi179 bash[23186]: audit 2024-09-21T01:24:09.091531+0000 mon.a (mon.0) 6980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:10 smithi179 bash[23186]: audit 2024-09-21T01:24:09.097399+0000 mon.a (mon.0) 6981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:10 smithi179 bash[23186]: audit 2024-09-21T01:24:09.104312+0000 mon.a (mon.0) 6982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:10 smithi049 bash[23528]: cluster 2024-09-21T01:24:08.427747+0000 mgr.a (mgr.14388) 8207 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:10 smithi049 bash[23528]: audit 2024-09-21T01:24:09.091531+0000 mon.a (mon.0) 6980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:10 smithi049 bash[23528]: audit 2024-09-21T01:24:09.097399+0000 mon.a (mon.0) 6981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:10 smithi049 bash[23528]: audit 2024-09-21T01:24:09.104312+0000 mon.a (mon.0) 6982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:11 smithi044 bash[22676]: audit 2024-09-21T01:24:09.442965+0000 mgr.a (mgr.14388) 8208 : audit [DBG] from='client.184194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:11 smithi179 bash[23186]: audit 2024-09-21T01:24:09.442965+0000 mgr.a (mgr.14388) 8208 : audit [DBG] from='client.184194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:11 smithi049 bash[23528]: audit 2024-09-21T01:24:09.442965+0000 mgr.a (mgr.14388) 8208 : audit [DBG] from='client.184194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:12 smithi049 bash[23528]: cluster 2024-09-21T01:24:10.430195+0000 mgr.a (mgr.14388) 8209 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:12 smithi044 bash[22676]: cluster 2024-09-21T01:24:10.430195+0000 mgr.a (mgr.14388) 8209 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:12 smithi179 bash[23186]: cluster 2024-09-21T01:24:10.430195+0000 mgr.a (mgr.14388) 8209 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:24:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:14 smithi044 bash[22676]: cluster 2024-09-21T01:24:12.430920+0000 mgr.a (mgr.14388) 8210 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:14 smithi044 bash[22676]: audit 2024-09-21T01:24:13.589791+0000 mon.a (mon.0) 6983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:14 smithi044 bash[22676]: audit 2024-09-21T01:24:13.598632+0000 mon.a (mon.0) 6984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:14 smithi044 bash[22676]: audit 2024-09-21T01:24:13.609112+0000 mon.a (mon.0) 6985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:14 smithi179 bash[23186]: cluster 2024-09-21T01:24:12.430920+0000 mgr.a (mgr.14388) 8210 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:14 smithi179 bash[23186]: audit 2024-09-21T01:24:13.589791+0000 mon.a (mon.0) 6983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:14 smithi179 bash[23186]: audit 2024-09-21T01:24:13.598632+0000 mon.a (mon.0) 6984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:14 smithi179 bash[23186]: audit 2024-09-21T01:24:13.609112+0000 mon.a (mon.0) 6985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:14 smithi049 bash[23528]: cluster 2024-09-21T01:24:12.430920+0000 mgr.a (mgr.14388) 8210 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:14 smithi049 bash[23528]: audit 2024-09-21T01:24:13.589791+0000 mon.a (mon.0) 6983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:14 smithi049 bash[23528]: audit 2024-09-21T01:24:13.598632+0000 mon.a (mon.0) 6984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:14 smithi049 bash[23528]: audit 2024-09-21T01:24:13.609112+0000 mon.a (mon.0) 6985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:15.659 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:15.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:15.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:15.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:15.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:16 smithi044 bash[22676]: cluster 2024-09-21T01:24:14.431668+0000 mgr.a (mgr.14388) 8211 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:16 smithi044 bash[22676]: audit 2024-09-21T01:24:15.210555+0000 mgr.a (mgr.14388) 8212 : audit [DBG] from='client.184272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:16 smithi179 bash[23186]: cluster 2024-09-21T01:24:14.431668+0000 mgr.a (mgr.14388) 8211 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:16 smithi179 bash[23186]: audit 2024-09-21T01:24:15.210555+0000 mgr.a (mgr.14388) 8212 : audit [DBG] from='client.184272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:16 smithi049 bash[23528]: cluster 2024-09-21T01:24:14.431668+0000 mgr.a (mgr.14388) 8211 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:16 smithi049 bash[23528]: audit 2024-09-21T01:24:15.210555+0000 mgr.a (mgr.14388) 8212 : audit [DBG] from='client.184272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:18 smithi044 bash[22676]: cluster 2024-09-21T01:24:16.434583+0000 mgr.a (mgr.14388) 8213 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:18 smithi179 bash[23186]: cluster 2024-09-21T01:24:16.434583+0000 mgr.a (mgr.14388) 8213 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:18 smithi049 bash[23528]: cluster 2024-09-21T01:24:16.434583+0000 mgr.a (mgr.14388) 8213 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:20 smithi044 bash[22676]: cluster 2024-09-21T01:24:18.435342+0000 mgr.a (mgr.14388) 8214 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:24:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:20 smithi179 bash[23186]: cluster 2024-09-21T01:24:18.435342+0000 mgr.a (mgr.14388) 8214 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:24:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:20 smithi049 bash[23528]: cluster 2024-09-21T01:24:18.435342+0000 mgr.a (mgr.14388) 8214 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:24:20.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:21.450 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:21.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:21.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:21.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:21.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:22 smithi044 bash[22676]: cluster 2024-09-21T01:24:20.437363+0000 mgr.a (mgr.14388) 8215 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:22 smithi044 bash[22676]: audit 2024-09-21T01:24:20.997939+0000 mgr.a (mgr.14388) 8216 : audit [DBG] from='client.184350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:22 smithi179 bash[23186]: cluster 2024-09-21T01:24:20.437363+0000 mgr.a (mgr.14388) 8215 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:22 smithi179 bash[23186]: audit 2024-09-21T01:24:20.997939+0000 mgr.a (mgr.14388) 8216 : audit [DBG] from='client.184350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:22 smithi049 bash[23528]: cluster 2024-09-21T01:24:20.437363+0000 mgr.a (mgr.14388) 8215 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:22 smithi049 bash[23528]: audit 2024-09-21T01:24:20.997939+0000 mgr.a (mgr.14388) 8216 : audit [DBG] from='client.184350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:24 smithi044 bash[22676]: cluster 2024-09-21T01:24:22.438284+0000 mgr.a (mgr.14388) 8217 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:24:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:24 smithi179 bash[23186]: cluster 2024-09-21T01:24:22.438284+0000 mgr.a (mgr.14388) 8217 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:24:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:24 smithi049 bash[23528]: cluster 2024-09-21T01:24:22.438284+0000 mgr.a (mgr.14388) 8217 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:24:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:26 smithi049 bash[23528]: cluster 2024-09-21T01:24:24.439123+0000 mgr.a (mgr.14388) 8218 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:26.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:26.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:26.453 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:26 smithi044 bash[22676]: cluster 2024-09-21T01:24:24.439123+0000 mgr.a (mgr.14388) 8218 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:26 smithi179 bash[23186]: cluster 2024-09-21T01:24:24.439123+0000 mgr.a (mgr.14388) 8218 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:27.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:27.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:27.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:27.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:27.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:28.418 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:28 smithi179 bash[23186]: cluster 2024-09-21T01:24:26.441373+0000 mgr.a (mgr.14388) 8219 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:28.418 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:28 smithi179 bash[23186]: audit 2024-09-21T01:24:26.792582+0000 mgr.a (mgr.14388) 8220 : audit [DBG] from='client.184428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:28 smithi044 bash[22676]: cluster 2024-09-21T01:24:26.441373+0000 mgr.a (mgr.14388) 8219 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:28 smithi044 bash[22676]: audit 2024-09-21T01:24:26.792582+0000 mgr.a (mgr.14388) 8220 : audit [DBG] from='client.184428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:28 smithi049 bash[23528]: cluster 2024-09-21T01:24:26.441373+0000 mgr.a (mgr.14388) 8219 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:28 smithi049 bash[23528]: audit 2024-09-21T01:24:26.792582+0000 mgr.a (mgr.14388) 8220 : audit [DBG] from='client.184428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:29 smithi044 bash[22676]: audit 2024-09-21T01:24:28.246525+0000 mon.a (mon.0) 6986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:29 smithi044 bash[22676]: audit 2024-09-21T01:24:28.255008+0000 mon.a (mon.0) 6987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:29 smithi044 bash[22676]: audit 2024-09-21T01:24:28.265308+0000 mon.a (mon.0) 6988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:29 smithi044 bash[22676]: audit 2024-09-21T01:24:29.237877+0000 mon.a (mon.0) 6989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:29 smithi179 bash[23186]: audit 2024-09-21T01:24:28.246525+0000 mon.a (mon.0) 6986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:29 smithi179 bash[23186]: audit 2024-09-21T01:24:28.255008+0000 mon.a (mon.0) 6987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:29 smithi179 bash[23186]: audit 2024-09-21T01:24:28.265308+0000 mon.a (mon.0) 6988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:29 smithi179 bash[23186]: audit 2024-09-21T01:24:29.237877+0000 mon.a (mon.0) 6989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:29 smithi049 bash[23528]: audit 2024-09-21T01:24:28.246525+0000 mon.a (mon.0) 6986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:29 smithi049 bash[23528]: audit 2024-09-21T01:24:28.255008+0000 mon.a (mon.0) 6987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:29 smithi049 bash[23528]: audit 2024-09-21T01:24:28.265308+0000 mon.a (mon.0) 6988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:29 smithi049 bash[23528]: audit 2024-09-21T01:24:29.237877+0000 mon.a (mon.0) 6989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:30 smithi179 bash[23186]: cluster 2024-09-21T01:24:28.442235+0000 mgr.a (mgr.14388) 8221 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:30 smithi179 bash[23186]: audit 2024-09-21T01:24:29.244753+0000 mon.a (mon.0) 6990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:30 smithi179 bash[23186]: audit 2024-09-21T01:24:29.259600+0000 mon.a (mon.0) 6991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:30 smithi049 bash[23528]: cluster 2024-09-21T01:24:28.442235+0000 mgr.a (mgr.14388) 8221 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:30.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:30 smithi049 bash[23528]: audit 2024-09-21T01:24:29.244753+0000 mon.a (mon.0) 6990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:30 smithi049 bash[23528]: audit 2024-09-21T01:24:29.259600+0000 mon.a (mon.0) 6991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:30 smithi044 bash[22676]: cluster 2024-09-21T01:24:28.442235+0000 mgr.a (mgr.14388) 8221 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:30 smithi044 bash[22676]: audit 2024-09-21T01:24:29.244753+0000 mon.a (mon.0) 6990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:30 smithi044 bash[22676]: audit 2024-09-21T01:24:29.259600+0000 mon.a (mon.0) 6991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:32.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:32.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:32.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:32.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:32 smithi049 bash[23528]: cluster 2024-09-21T01:24:30.444467+0000 mgr.a (mgr.14388) 8222 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:32 smithi044 bash[22676]: cluster 2024-09-21T01:24:30.444467+0000 mgr.a (mgr.14388) 8222 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:32 smithi179 bash[23186]: cluster 2024-09-21T01:24:30.444467+0000 mgr.a (mgr.14388) 8222 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:33.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:33.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:33.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:33.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:33.034 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:34 smithi049 bash[23528]: cluster 2024-09-21T01:24:32.445212+0000 mgr.a (mgr.14388) 8223 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:34 smithi049 bash[23528]: audit 2024-09-21T01:24:32.585944+0000 mgr.a (mgr.14388) 8224 : audit [DBG] from='client.184506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:34 smithi049 bash[23528]: audit 2024-09-21T01:24:33.787303+0000 mon.a (mon.0) 6992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:34 smithi049 bash[23528]: audit 2024-09-21T01:24:33.796362+0000 mon.a (mon.0) 6993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:34 smithi049 bash[23528]: audit 2024-09-21T01:24:33.807258+0000 mon.a (mon.0) 6994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:34 smithi044 bash[22676]: cluster 2024-09-21T01:24:32.445212+0000 mgr.a (mgr.14388) 8223 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:34 smithi044 bash[22676]: audit 2024-09-21T01:24:32.585944+0000 mgr.a (mgr.14388) 8224 : audit [DBG] from='client.184506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:34 smithi044 bash[22676]: audit 2024-09-21T01:24:33.787303+0000 mon.a (mon.0) 6992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:34 smithi044 bash[22676]: audit 2024-09-21T01:24:33.796362+0000 mon.a (mon.0) 6993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:34 smithi044 bash[22676]: audit 2024-09-21T01:24:33.807258+0000 mon.a (mon.0) 6994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:34 smithi179 bash[23186]: cluster 2024-09-21T01:24:32.445212+0000 mgr.a (mgr.14388) 8223 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:34 smithi179 bash[23186]: audit 2024-09-21T01:24:32.585944+0000 mgr.a (mgr.14388) 8224 : audit [DBG] from='client.184506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:34 smithi179 bash[23186]: audit 2024-09-21T01:24:33.787303+0000 mon.a (mon.0) 6992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:34 smithi179 bash[23186]: audit 2024-09-21T01:24:33.796362+0000 mon.a (mon.0) 6993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:34 smithi179 bash[23186]: audit 2024-09-21T01:24:33.807258+0000 mon.a (mon.0) 6994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:36 smithi049 bash[23528]: cluster 2024-09-21T01:24:34.446062+0000 mgr.a (mgr.14388) 8225 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:36 smithi044 bash[22676]: cluster 2024-09-21T01:24:34.446062+0000 mgr.a (mgr.14388) 8225 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:36 smithi179 bash[23186]: cluster 2024-09-21T01:24:34.446062+0000 mgr.a (mgr.14388) 8225 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:38.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:38.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:38.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:38.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:38 smithi049 bash[23528]: cluster 2024-09-21T01:24:36.448311+0000 mgr.a (mgr.14388) 8226 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:38 smithi044 bash[22676]: cluster 2024-09-21T01:24:36.448311+0000 mgr.a (mgr.14388) 8226 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:38 smithi179 bash[23186]: cluster 2024-09-21T01:24:36.448311+0000 mgr.a (mgr.14388) 8226 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:38.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:38.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:38.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:38.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:38.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:39.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:39 smithi049 bash[23528]: audit 2024-09-21T01:24:38.373560+0000 mgr.a (mgr.14388) 8227 : audit [DBG] from='client.184584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:39 smithi044 bash[22676]: audit 2024-09-21T01:24:38.373560+0000 mgr.a (mgr.14388) 8227 : audit [DBG] from='client.184584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:39 smithi179 bash[23186]: audit 2024-09-21T01:24:38.373560+0000 mgr.a (mgr.14388) 8227 : audit [DBG] from='client.184584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:40 smithi049 bash[23528]: cluster 2024-09-21T01:24:38.449056+0000 mgr.a (mgr.14388) 8228 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:40 smithi044 bash[22676]: cluster 2024-09-21T01:24:38.449056+0000 mgr.a (mgr.14388) 8228 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:40 smithi179 bash[23186]: cluster 2024-09-21T01:24:38.449056+0000 mgr.a (mgr.14388) 8228 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:42 smithi049 bash[23528]: cluster 2024-09-21T01:24:40.451386+0000 mgr.a (mgr.14388) 8229 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:42 smithi044 bash[22676]: cluster 2024-09-21T01:24:40.451386+0000 mgr.a (mgr.14388) 8229 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:42 smithi179 bash[23186]: cluster 2024-09-21T01:24:40.451386+0000 mgr.a (mgr.14388) 8229 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:43.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:43.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:43.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:44 smithi049 bash[23528]: cluster 2024-09-21T01:24:42.452174+0000 mgr.a (mgr.14388) 8230 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:44.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:44.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:44.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:44.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:44.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:44 smithi044 bash[22676]: cluster 2024-09-21T01:24:42.452174+0000 mgr.a (mgr.14388) 8230 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:44 smithi179 bash[23186]: cluster 2024-09-21T01:24:42.452174+0000 mgr.a (mgr.14388) 8230 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:45.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:45 smithi049 bash[23528]: audit 2024-09-21T01:24:44.164109+0000 mgr.a (mgr.14388) 8231 : audit [DBG] from='client.184659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:45 smithi044 bash[22676]: audit 2024-09-21T01:24:44.164109+0000 mgr.a (mgr.14388) 8231 : audit [DBG] from='client.184659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:45 smithi179 bash[23186]: audit 2024-09-21T01:24:44.164109+0000 mgr.a (mgr.14388) 8231 : audit [DBG] from='client.184659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:46 smithi049 bash[23528]: cluster 2024-09-21T01:24:44.452800+0000 mgr.a (mgr.14388) 8232 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:46 smithi044 bash[22676]: cluster 2024-09-21T01:24:44.452800+0000 mgr.a (mgr.14388) 8232 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:46 smithi179 bash[23186]: cluster 2024-09-21T01:24:44.452800+0000 mgr.a (mgr.14388) 8232 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:48.582 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:48 smithi179 bash[23186]: cluster 2024-09-21T01:24:46.454016+0000 mgr.a (mgr.14388) 8233 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:48 smithi044 bash[22676]: cluster 2024-09-21T01:24:46.454016+0000 mgr.a (mgr.14388) 8233 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:48 smithi049 bash[23528]: cluster 2024-09-21T01:24:46.454016+0000 mgr.a (mgr.14388) 8233 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:24:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:49 smithi044 bash[22676]: audit 2024-09-21T01:24:48.421751+0000 mon.a (mon.0) 6995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:49 smithi044 bash[22676]: audit 2024-09-21T01:24:48.428902+0000 mon.a (mon.0) 6996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:49 smithi044 bash[22676]: audit 2024-09-21T01:24:48.439491+0000 mon.a (mon.0) 6997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:49 smithi044 bash[22676]: audit 2024-09-21T01:24:49.410464+0000 mon.a (mon.0) 6998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:49 smithi044 bash[22676]: audit 2024-09-21T01:24:49.416448+0000 mon.a (mon.0) 6999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:49 smithi179 bash[23186]: audit 2024-09-21T01:24:48.421751+0000 mon.a (mon.0) 6995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:49 smithi179 bash[23186]: audit 2024-09-21T01:24:48.428902+0000 mon.a (mon.0) 6996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:49 smithi179 bash[23186]: audit 2024-09-21T01:24:48.439491+0000 mon.a (mon.0) 6997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:49 smithi179 bash[23186]: audit 2024-09-21T01:24:49.410464+0000 mon.a (mon.0) 6998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:49 smithi179 bash[23186]: audit 2024-09-21T01:24:49.416448+0000 mon.a (mon.0) 6999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:49 smithi049 bash[23528]: audit 2024-09-21T01:24:48.421751+0000 mon.a (mon.0) 6995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:49 smithi049 bash[23528]: audit 2024-09-21T01:24:48.428902+0000 mon.a (mon.0) 6996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:49 smithi049 bash[23528]: audit 2024-09-21T01:24:48.439491+0000 mon.a (mon.0) 6997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:49 smithi049 bash[23528]: audit 2024-09-21T01:24:49.410464+0000 mon.a (mon.0) 6998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:49 smithi049 bash[23528]: audit 2024-09-21T01:24:49.416448+0000 mon.a (mon.0) 6999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:50.404 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:50.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:50.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:50.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:50.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:50 smithi044 bash[22676]: cluster 2024-09-21T01:24:48.454728+0000 mgr.a (mgr.14388) 8234 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:50 smithi044 bash[22676]: audit 2024-09-21T01:24:49.431361+0000 mon.a (mon.0) 7000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:50 smithi179 bash[23186]: cluster 2024-09-21T01:24:48.454728+0000 mgr.a (mgr.14388) 8234 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:50 smithi179 bash[23186]: audit 2024-09-21T01:24:49.431361+0000 mon.a (mon.0) 7000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:50 smithi049 bash[23528]: cluster 2024-09-21T01:24:48.454728+0000 mgr.a (mgr.14388) 8234 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:50 smithi049 bash[23528]: audit 2024-09-21T01:24:49.431361+0000 mon.a (mon.0) 7000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:51 smithi044 bash[22676]: audit 2024-09-21T01:24:49.952587+0000 mgr.a (mgr.14388) 8235 : audit [DBG] from='client.184737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:51 smithi179 bash[23186]: audit 2024-09-21T01:24:49.952587+0000 mgr.a (mgr.14388) 8235 : audit [DBG] from='client.184737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:51 smithi049 bash[23528]: audit 2024-09-21T01:24:49.952587+0000 mgr.a (mgr.14388) 8235 : audit [DBG] from='client.184737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:52 smithi044 bash[22676]: cluster 2024-09-21T01:24:50.456112+0000 mgr.a (mgr.14388) 8236 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:52 smithi179 bash[23186]: cluster 2024-09-21T01:24:50.456112+0000 mgr.a (mgr.14388) 8236 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:52 smithi049 bash[23528]: cluster 2024-09-21T01:24:50.456112+0000 mgr.a (mgr.14388) 8236 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:53 smithi044 bash[22676]: cluster 2024-09-21T01:24:52.456851+0000 mgr.a (mgr.14388) 8237 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:53 smithi179 bash[23186]: cluster 2024-09-21T01:24:52.456851+0000 mgr.a (mgr.14388) 8237 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:53 smithi049 bash[23528]: cluster 2024-09-21T01:24:52.456851+0000 mgr.a (mgr.14388) 8237 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:55.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:55 smithi049 bash[23528]: audit 2024-09-21T01:24:54.022286+0000 mon.a (mon.0) 7001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:55 smithi049 bash[23528]: audit 2024-09-21T01:24:54.031333+0000 mon.a (mon.0) 7002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:55 smithi049 bash[23528]: audit 2024-09-21T01:24:54.041849+0000 mon.a (mon.0) 7003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:24:55.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:24:55.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:24:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:55 smithi044 bash[22676]: audit 2024-09-21T01:24:54.022286+0000 mon.a (mon.0) 7001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:55 smithi044 bash[22676]: audit 2024-09-21T01:24:54.031333+0000 mon.a (mon.0) 7002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:55 smithi044 bash[22676]: audit 2024-09-21T01:24:54.041849+0000 mon.a (mon.0) 7003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:55 smithi179 bash[23186]: audit 2024-09-21T01:24:54.022286+0000 mon.a (mon.0) 7001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:55 smithi179 bash[23186]: audit 2024-09-21T01:24:54.031333+0000 mon.a (mon.0) 7002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:55 smithi179 bash[23186]: audit 2024-09-21T01:24:54.041849+0000 mon.a (mon.0) 7003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:56.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:24:56.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:24:56.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:24:56.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:24:56.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:24:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:56 smithi049 bash[23528]: cluster 2024-09-21T01:24:54.457633+0000 mgr.a (mgr.14388) 8238 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:56 smithi044 bash[22676]: cluster 2024-09-21T01:24:54.457633+0000 mgr.a (mgr.14388) 8238 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:56 smithi179 bash[23186]: cluster 2024-09-21T01:24:54.457633+0000 mgr.a (mgr.14388) 8238 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:24:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:57 smithi049 bash[23528]: audit 2024-09-21T01:24:55.743702+0000 mgr.a (mgr.14388) 8239 : audit [DBG] from='client.184812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:57 smithi049 bash[23528]: audit 2024-09-21T01:24:57.041653+0000 mon.a (mon.0) 7004 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:24:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:57 smithi044 bash[22676]: audit 2024-09-21T01:24:55.743702+0000 mgr.a (mgr.14388) 8239 : audit [DBG] from='client.184812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:57 smithi044 bash[22676]: audit 2024-09-21T01:24:57.041653+0000 mon.a (mon.0) 7004 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:24:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:57 smithi179 bash[23186]: audit 2024-09-21T01:24:55.743702+0000 mgr.a (mgr.14388) 8239 : audit [DBG] from='client.184812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:24:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:57 smithi179 bash[23186]: audit 2024-09-21T01:24:57.041653+0000 mon.a (mon.0) 7004 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:24:58.246 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:24:57 smithi044 bash[22930]: debug 2024-09-21T01:24:57.818+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:24:58.246 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:24:57 smithi044 bash[22930]: debug 2024-09-21T01:24:57.818+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:24:58.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:58 smithi044 bash[22676]: cluster 2024-09-21T01:24:56.460398+0000 mgr.a (mgr.14388) 8240 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:58.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:58 smithi044 bash[22676]: audit 2024-09-21T01:24:57.050220+0000 mon.a (mon.0) 7005 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:24:58.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:58 smithi044 bash[22676]: audit 2024-09-21T01:24:57.056653+0000 mon.a (mon.0) 7006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:24:58.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:58 smithi044 bash[22676]: audit 2024-09-21T01:24:57.067840+0000 mon.a (mon.0) 7007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:58.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:58 smithi044 bash[22676]: audit 2024-09-21T01:24:57.074315+0000 mon.a (mon.0) 7008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:24:58.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:58 smithi044 bash[22676]: audit 2024-09-21T01:24:57.077161+0000 mgr.a (mgr.14388) 8241 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:24:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:58 smithi179 bash[23186]: cluster 2024-09-21T01:24:56.460398+0000 mgr.a (mgr.14388) 8240 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:58 smithi179 bash[23186]: audit 2024-09-21T01:24:57.050220+0000 mon.a (mon.0) 7005 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:24:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:58 smithi179 bash[23186]: audit 2024-09-21T01:24:57.056653+0000 mon.a (mon.0) 7006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:24:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:58 smithi179 bash[23186]: audit 2024-09-21T01:24:57.067840+0000 mon.a (mon.0) 7007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:58 smithi179 bash[23186]: audit 2024-09-21T01:24:57.074315+0000 mon.a (mon.0) 7008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:24:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:58 smithi179 bash[23186]: audit 2024-09-21T01:24:57.077161+0000 mgr.a (mgr.14388) 8241 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:58 smithi049 bash[23528]: cluster 2024-09-21T01:24:56.460398+0000 mgr.a (mgr.14388) 8240 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:58 smithi049 bash[23528]: audit 2024-09-21T01:24:57.050220+0000 mon.a (mon.0) 7005 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:58 smithi049 bash[23528]: audit 2024-09-21T01:24:57.056653+0000 mon.a (mon.0) 7006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:58 smithi049 bash[23528]: audit 2024-09-21T01:24:57.067840+0000 mon.a (mon.0) 7007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:58 smithi049 bash[23528]: audit 2024-09-21T01:24:57.074315+0000 mon.a (mon.0) 7008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:58 smithi049 bash[23528]: audit 2024-09-21T01:24:57.077161+0000 mgr.a (mgr.14388) 8241 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:24:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:59 smithi044 bash[22676]: audit 2024-09-21T01:24:57.821379+0000 mgr.a (mgr.14388) 8242 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:24:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:24:59 smithi044 bash[22676]: cephadm 2024-09-21T01:24:57.822499+0000 mgr.a (mgr.14388) 8243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:24:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:59 smithi179 bash[23186]: audit 2024-09-21T01:24:57.821379+0000 mgr.a (mgr.14388) 8242 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:24:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:24:59 smithi179 bash[23186]: cephadm 2024-09-21T01:24:57.822499+0000 mgr.a (mgr.14388) 8243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:24:59.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:59 smithi049 bash[23528]: audit 2024-09-21T01:24:57.821379+0000 mgr.a (mgr.14388) 8242 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:24:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:24:59 smithi049 bash[23528]: cephadm 2024-09-21T01:24:57.822499+0000 mgr.a (mgr.14388) 8243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:25:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:00 smithi044 bash[22676]: cluster 2024-09-21T01:24:58.461456+0000 mgr.a (mgr.14388) 8244 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:00 smithi179 bash[23186]: cluster 2024-09-21T01:24:58.461456+0000 mgr.a (mgr.14388) 8244 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:00 smithi049 bash[23528]: cluster 2024-09-21T01:24:58.461456+0000 mgr.a (mgr.14388) 8244 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:01.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:01.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:01.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:01.956 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:01.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:01.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:01.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:01.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:02 smithi044 bash[22676]: cluster 2024-09-21T01:25:00.463786+0000 mgr.a (mgr.14388) 8245 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:02 smithi179 bash[23186]: cluster 2024-09-21T01:25:00.463786+0000 mgr.a (mgr.14388) 8245 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:02 smithi049 bash[23528]: cluster 2024-09-21T01:25:00.463786+0000 mgr.a (mgr.14388) 8245 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:03 smithi044 bash[22676]: audit 2024-09-21T01:25:01.508245+0000 mgr.a (mgr.14388) 8246 : audit [DBG] from='client.184998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:03 smithi179 bash[23186]: audit 2024-09-21T01:25:01.508245+0000 mgr.a (mgr.14388) 8246 : audit [DBG] from='client.184998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:03.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:03 smithi049 bash[23528]: audit 2024-09-21T01:25:01.508245+0000 mgr.a (mgr.14388) 8246 : audit [DBG] from='client.184998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:04.437 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:04 smithi049 bash[23528]: cluster 2024-09-21T01:25:02.464764+0000 mgr.a (mgr.14388) 8247 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:04 smithi044 bash[22676]: cluster 2024-09-21T01:25:02.464764+0000 mgr.a (mgr.14388) 8247 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:04 smithi179 bash[23186]: cluster 2024-09-21T01:25:02.464764+0000 mgr.a (mgr.14388) 8247 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:06 smithi179 bash[23186]: cluster 2024-09-21T01:25:04.465591+0000 mgr.a (mgr.14388) 8248 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:06 smithi049 bash[23528]: cluster 2024-09-21T01:25:04.465591+0000 mgr.a (mgr.14388) 8248 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:06 smithi044 bash[22676]: cluster 2024-09-21T01:25:04.465591+0000 mgr.a (mgr.14388) 8248 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:06.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:06.959 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:07.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:07.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:07.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:07.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:07.739 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:08.367 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:08 smithi179 bash[23186]: cluster 2024-09-21T01:25:06.467839+0000 mgr.a (mgr.14388) 8249 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:08.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:08 smithi179 bash[23186]: audit 2024-09-21T01:25:07.300349+0000 mgr.a (mgr.14388) 8250 : audit [DBG] from='client.185076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:08 smithi044 bash[22676]: cluster 2024-09-21T01:25:06.467839+0000 mgr.a (mgr.14388) 8249 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:08 smithi044 bash[22676]: audit 2024-09-21T01:25:07.300349+0000 mgr.a (mgr.14388) 8250 : audit [DBG] from='client.185076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:08 smithi049 bash[23528]: cluster 2024-09-21T01:25:06.467839+0000 mgr.a (mgr.14388) 8249 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:08 smithi049 bash[23528]: audit 2024-09-21T01:25:07.300349+0000 mgr.a (mgr.14388) 8250 : audit [DBG] from='client.185076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:09 smithi044 bash[22676]: cluster 2024-09-21T01:25:08.468774+0000 mgr.a (mgr.14388) 8251 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:09 smithi044 bash[22676]: audit 2024-09-21T01:25:08.572250+0000 mon.a (mon.0) 7009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:09 smithi044 bash[22676]: audit 2024-09-21T01:25:08.582723+0000 mon.a (mon.0) 7010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:09 smithi044 bash[22676]: audit 2024-09-21T01:25:08.594302+0000 mon.a (mon.0) 7011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:09 smithi179 bash[23186]: cluster 2024-09-21T01:25:08.468774+0000 mgr.a (mgr.14388) 8251 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:09 smithi179 bash[23186]: audit 2024-09-21T01:25:08.572250+0000 mon.a (mon.0) 7009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:09 smithi179 bash[23186]: audit 2024-09-21T01:25:08.582723+0000 mon.a (mon.0) 7010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:09 smithi179 bash[23186]: audit 2024-09-21T01:25:08.594302+0000 mon.a (mon.0) 7011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:09 smithi049 bash[23528]: cluster 2024-09-21T01:25:08.468774+0000 mgr.a (mgr.14388) 8251 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:09 smithi049 bash[23528]: audit 2024-09-21T01:25:08.572250+0000 mon.a (mon.0) 7009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:09 smithi049 bash[23528]: audit 2024-09-21T01:25:08.582723+0000 mon.a (mon.0) 7010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:09 smithi049 bash[23528]: audit 2024-09-21T01:25:08.594302+0000 mon.a (mon.0) 7011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:10 smithi044 bash[22676]: audit 2024-09-21T01:25:09.579008+0000 mon.a (mon.0) 7012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:10 smithi044 bash[22676]: audit 2024-09-21T01:25:09.584839+0000 mon.a (mon.0) 7013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:10 smithi044 bash[22676]: audit 2024-09-21T01:25:09.589702+0000 mon.a (mon.0) 7014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:10 smithi179 bash[23186]: audit 2024-09-21T01:25:09.579008+0000 mon.a (mon.0) 7012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:10 smithi179 bash[23186]: audit 2024-09-21T01:25:09.584839+0000 mon.a (mon.0) 7013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:10 smithi179 bash[23186]: audit 2024-09-21T01:25:09.589702+0000 mon.a (mon.0) 7014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:10 smithi049 bash[23528]: audit 2024-09-21T01:25:09.579008+0000 mon.a (mon.0) 7012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:10 smithi049 bash[23528]: audit 2024-09-21T01:25:09.584839+0000 mon.a (mon.0) 7013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:10 smithi049 bash[23528]: audit 2024-09-21T01:25:09.589702+0000 mon.a (mon.0) 7014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:11 smithi044 bash[22676]: cluster 2024-09-21T01:25:10.471078+0000 mgr.a (mgr.14388) 8252 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:11 smithi179 bash[23186]: cluster 2024-09-21T01:25:10.471078+0000 mgr.a (mgr.14388) 8252 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:11 smithi049 bash[23528]: cluster 2024-09-21T01:25:10.471078+0000 mgr.a (mgr.14388) 8252 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:25:12.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:12.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:12.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:13.503 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:13 smithi044 bash[22676]: cluster 2024-09-21T01:25:12.471834+0000 mgr.a (mgr.14388) 8253 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:13 smithi044 bash[22676]: audit 2024-09-21T01:25:13.071849+0000 mgr.a (mgr.14388) 8254 : audit [DBG] from='client.185154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:13 smithi179 bash[23186]: cluster 2024-09-21T01:25:12.471834+0000 mgr.a (mgr.14388) 8253 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:13 smithi179 bash[23186]: audit 2024-09-21T01:25:13.071849+0000 mgr.a (mgr.14388) 8254 : audit [DBG] from='client.185154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:13 smithi049 bash[23528]: cluster 2024-09-21T01:25:12.471834+0000 mgr.a (mgr.14388) 8253 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:13 smithi049 bash[23528]: audit 2024-09-21T01:25:13.071849+0000 mgr.a (mgr.14388) 8254 : audit [DBG] from='client.185154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:15 smithi049 bash[23528]: audit 2024-09-21T01:25:14.257232+0000 mon.a (mon.0) 7015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:15 smithi049 bash[23528]: audit 2024-09-21T01:25:14.266649+0000 mon.a (mon.0) 7016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:15 smithi049 bash[23528]: audit 2024-09-21T01:25:14.277393+0000 mon.a (mon.0) 7017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:15 smithi044 bash[22676]: audit 2024-09-21T01:25:14.257232+0000 mon.a (mon.0) 7015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:15 smithi044 bash[22676]: audit 2024-09-21T01:25:14.266649+0000 mon.a (mon.0) 7016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:15 smithi044 bash[22676]: audit 2024-09-21T01:25:14.277393+0000 mon.a (mon.0) 7017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:15 smithi179 bash[23186]: audit 2024-09-21T01:25:14.257232+0000 mon.a (mon.0) 7015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:15 smithi179 bash[23186]: audit 2024-09-21T01:25:14.266649+0000 mon.a (mon.0) 7016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:15 smithi179 bash[23186]: audit 2024-09-21T01:25:14.277393+0000 mon.a (mon.0) 7017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:16.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:16 smithi049 bash[23528]: cluster 2024-09-21T01:25:14.472744+0000 mgr.a (mgr.14388) 8255 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:16 smithi044 bash[22676]: cluster 2024-09-21T01:25:14.472744+0000 mgr.a (mgr.14388) 8255 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:16 smithi179 bash[23186]: cluster 2024-09-21T01:25:14.472744+0000 mgr.a (mgr.14388) 8255 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:18.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:18.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:18.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:18 smithi049 bash[23528]: cluster 2024-09-21T01:25:16.474986+0000 mgr.a (mgr.14388) 8256 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:18 smithi044 bash[22676]: cluster 2024-09-21T01:25:16.474986+0000 mgr.a (mgr.14388) 8256 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:18 smithi179 bash[23186]: cluster 2024-09-21T01:25:16.474986+0000 mgr.a (mgr.14388) 8256 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:19.287 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:20.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:20 smithi049 bash[23528]: cluster 2024-09-21T01:25:18.475747+0000 mgr.a (mgr.14388) 8257 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:20 smithi049 bash[23528]: audit 2024-09-21T01:25:18.839788+0000 mgr.a (mgr.14388) 8258 : audit [DBG] from='client.185232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:20 smithi044 bash[22676]: cluster 2024-09-21T01:25:18.475747+0000 mgr.a (mgr.14388) 8257 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:20 smithi044 bash[22676]: audit 2024-09-21T01:25:18.839788+0000 mgr.a (mgr.14388) 8258 : audit [DBG] from='client.185232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:20 smithi179 bash[23186]: cluster 2024-09-21T01:25:18.475747+0000 mgr.a (mgr.14388) 8257 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:20 smithi179 bash[23186]: audit 2024-09-21T01:25:18.839788+0000 mgr.a (mgr.14388) 8258 : audit [DBG] from='client.185232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:22.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:22 smithi049 bash[23528]: cluster 2024-09-21T01:25:20.478065+0000 mgr.a (mgr.14388) 8259 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:22 smithi044 bash[22676]: cluster 2024-09-21T01:25:20.478065+0000 mgr.a (mgr.14388) 8259 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:22 smithi179 bash[23186]: cluster 2024-09-21T01:25:20.478065+0000 mgr.a (mgr.14388) 8259 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:24.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:24 smithi049 bash[23528]: cluster 2024-09-21T01:25:22.478861+0000 mgr.a (mgr.14388) 8260 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:24 smithi044 bash[22676]: cluster 2024-09-21T01:25:22.478861+0000 mgr.a (mgr.14388) 8260 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:24 smithi179 bash[23186]: cluster 2024-09-21T01:25:22.478861+0000 mgr.a (mgr.14388) 8260 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:25.025 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:25.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:25.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:26.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:26 smithi049 bash[23528]: cluster 2024-09-21T01:25:24.479569+0000 mgr.a (mgr.14388) 8261 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:26 smithi049 bash[23528]: audit 2024-09-21T01:25:24.620445+0000 mgr.a (mgr.14388) 8262 : audit [DBG] from='client.185307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:26 smithi044 bash[22676]: cluster 2024-09-21T01:25:24.479569+0000 mgr.a (mgr.14388) 8261 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:26 smithi044 bash[22676]: audit 2024-09-21T01:25:24.620445+0000 mgr.a (mgr.14388) 8262 : audit [DBG] from='client.185307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:26 smithi179 bash[23186]: cluster 2024-09-21T01:25:24.479569+0000 mgr.a (mgr.14388) 8261 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:26 smithi179 bash[23186]: audit 2024-09-21T01:25:24.620445+0000 mgr.a (mgr.14388) 8262 : audit [DBG] from='client.185307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:28 smithi044 bash[22676]: cluster 2024-09-21T01:25:26.481986+0000 mgr.a (mgr.14388) 8263 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:28 smithi179 bash[23186]: cluster 2024-09-21T01:25:26.481986+0000 mgr.a (mgr.14388) 8263 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:28 smithi049 bash[23528]: cluster 2024-09-21T01:25:26.481986+0000 mgr.a (mgr.14388) 8263 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:29 smithi044 bash[22676]: cluster 2024-09-21T01:25:28.482731+0000 mgr.a (mgr.14388) 8264 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:29 smithi044 bash[22676]: audit 2024-09-21T01:25:28.801126+0000 mon.a (mon.0) 7018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:29 smithi044 bash[22676]: audit 2024-09-21T01:25:28.809820+0000 mon.a (mon.0) 7019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:29 smithi044 bash[22676]: audit 2024-09-21T01:25:28.820394+0000 mon.a (mon.0) 7020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:29 smithi044 bash[22676]: audit 2024-09-21T01:25:29.722870+0000 mon.a (mon.0) 7021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:29 smithi044 bash[22676]: audit 2024-09-21T01:25:29.728544+0000 mon.a (mon.0) 7022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:29 smithi044 bash[22676]: audit 2024-09-21T01:25:29.733637+0000 mon.a (mon.0) 7023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:30.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:30.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:29 smithi049 bash[23528]: cluster 2024-09-21T01:25:28.482731+0000 mgr.a (mgr.14388) 8264 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:29 smithi049 bash[23528]: audit 2024-09-21T01:25:28.801126+0000 mon.a (mon.0) 7018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:29 smithi049 bash[23528]: audit 2024-09-21T01:25:28.809820+0000 mon.a (mon.0) 7019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:29 smithi049 bash[23528]: audit 2024-09-21T01:25:28.820394+0000 mon.a (mon.0) 7020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:29 smithi049 bash[23528]: audit 2024-09-21T01:25:29.722870+0000 mon.a (mon.0) 7021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:29 smithi049 bash[23528]: audit 2024-09-21T01:25:29.728544+0000 mon.a (mon.0) 7022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:29 smithi049 bash[23528]: audit 2024-09-21T01:25:29.733637+0000 mon.a (mon.0) 7023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:29 smithi179 bash[23186]: cluster 2024-09-21T01:25:28.482731+0000 mgr.a (mgr.14388) 8264 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:29 smithi179 bash[23186]: audit 2024-09-21T01:25:28.801126+0000 mon.a (mon.0) 7018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:29 smithi179 bash[23186]: audit 2024-09-21T01:25:28.809820+0000 mon.a (mon.0) 7019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:29 smithi179 bash[23186]: audit 2024-09-21T01:25:28.820394+0000 mon.a (mon.0) 7020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:29 smithi179 bash[23186]: audit 2024-09-21T01:25:29.722870+0000 mon.a (mon.0) 7021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:29 smithi179 bash[23186]: audit 2024-09-21T01:25:29.728544+0000 mon.a (mon.0) 7022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:29 smithi179 bash[23186]: audit 2024-09-21T01:25:29.733637+0000 mon.a (mon.0) 7023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:30.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:30 smithi044 bash[22676]: audit 2024-09-21T01:25:30.382458+0000 mgr.a (mgr.14388) 8265 : audit [DBG] from='client.185382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:30 smithi179 bash[23186]: audit 2024-09-21T01:25:30.382458+0000 mgr.a (mgr.14388) 8265 : audit [DBG] from='client.185382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:30 smithi049 bash[23528]: audit 2024-09-21T01:25:30.382458+0000 mgr.a (mgr.14388) 8265 : audit [DBG] from='client.185382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:31 smithi044 bash[22676]: cluster 2024-09-21T01:25:30.484037+0000 mgr.a (mgr.14388) 8266 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:31 smithi179 bash[23186]: cluster 2024-09-21T01:25:30.484037+0000 mgr.a (mgr.14388) 8266 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:31 smithi049 bash[23528]: cluster 2024-09-21T01:25:30.484037+0000 mgr.a (mgr.14388) 8266 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:33 smithi044 bash[22676]: cluster 2024-09-21T01:25:32.484836+0000 mgr.a (mgr.14388) 8267 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:33 smithi179 bash[23186]: cluster 2024-09-21T01:25:32.484836+0000 mgr.a (mgr.14388) 8267 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:33 smithi049 bash[23528]: cluster 2024-09-21T01:25:32.484836+0000 mgr.a (mgr.14388) 8267 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:35 smithi044 bash[22676]: audit 2024-09-21T01:25:34.468859+0000 mon.a (mon.0) 7024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:35 smithi044 bash[22676]: audit 2024-09-21T01:25:34.477697+0000 mon.a (mon.0) 7025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:35 smithi044 bash[22676]: cluster 2024-09-21T01:25:34.485596+0000 mgr.a (mgr.14388) 8268 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:35 smithi044 bash[22676]: audit 2024-09-21T01:25:34.488391+0000 mon.a (mon.0) 7026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:35 smithi179 bash[23186]: audit 2024-09-21T01:25:34.468859+0000 mon.a (mon.0) 7024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:35 smithi179 bash[23186]: audit 2024-09-21T01:25:34.477697+0000 mon.a (mon.0) 7025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:35 smithi179 bash[23186]: cluster 2024-09-21T01:25:34.485596+0000 mgr.a (mgr.14388) 8268 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:35 smithi179 bash[23186]: audit 2024-09-21T01:25:34.488391+0000 mon.a (mon.0) 7026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:35 smithi049 bash[23528]: audit 2024-09-21T01:25:34.468859+0000 mon.a (mon.0) 7024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:35 smithi049 bash[23528]: audit 2024-09-21T01:25:34.477697+0000 mon.a (mon.0) 7025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:35 smithi049 bash[23528]: cluster 2024-09-21T01:25:34.485596+0000 mgr.a (mgr.14388) 8268 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:35 smithi049 bash[23528]: audit 2024-09-21T01:25:34.488391+0000 mon.a (mon.0) 7026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:35.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:35.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:35.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:36.646 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:36.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:36.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:36.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:36.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:36 smithi179 bash[23186]: audit 2024-09-21T01:25:36.176908+0000 mgr.a (mgr.14388) 8269 : audit [DBG] from='client.185457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:36 smithi049 bash[23528]: audit 2024-09-21T01:25:36.176908+0000 mgr.a (mgr.14388) 8269 : audit [DBG] from='client.185457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:36 smithi044 bash[22676]: audit 2024-09-21T01:25:36.176908+0000 mgr.a (mgr.14388) 8269 : audit [DBG] from='client.185457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:37 smithi049 bash[23528]: cluster 2024-09-21T01:25:36.486938+0000 mgr.a (mgr.14388) 8270 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:37 smithi044 bash[22676]: cluster 2024-09-21T01:25:36.486938+0000 mgr.a (mgr.14388) 8270 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:37 smithi179 bash[23186]: cluster 2024-09-21T01:25:36.486938+0000 mgr.a (mgr.14388) 8270 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:39 smithi049 bash[23528]: cluster 2024-09-21T01:25:38.487798+0000 mgr.a (mgr.14388) 8271 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:39 smithi044 bash[22676]: cluster 2024-09-21T01:25:38.487798+0000 mgr.a (mgr.14388) 8271 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:39 smithi179 bash[23186]: cluster 2024-09-21T01:25:38.487798+0000 mgr.a (mgr.14388) 8271 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:25:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:41 smithi044 bash[22676]: cluster 2024-09-21T01:25:40.489921+0000 mgr.a (mgr.14388) 8272 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:41 smithi179 bash[23186]: cluster 2024-09-21T01:25:40.489921+0000 mgr.a (mgr.14388) 8272 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:41 smithi049 bash[23528]: cluster 2024-09-21T01:25:40.489921+0000 mgr.a (mgr.14388) 8272 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:42.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:42 smithi044 bash[22676]: audit 2024-09-21T01:25:41.986160+0000 mgr.a (mgr.14388) 8273 : audit [DBG] from='client.185532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:42 smithi179 bash[23186]: audit 2024-09-21T01:25:41.986160+0000 mgr.a (mgr.14388) 8273 : audit [DBG] from='client.185532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:42 smithi049 bash[23528]: audit 2024-09-21T01:25:41.986160+0000 mgr.a (mgr.14388) 8273 : audit [DBG] from='client.185532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:43 smithi049 bash[23528]: cluster 2024-09-21T01:25:42.490437+0000 mgr.a (mgr.14388) 8274 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:43 smithi044 bash[22676]: cluster 2024-09-21T01:25:42.490437+0000 mgr.a (mgr.14388) 8274 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:43 smithi179 bash[23186]: cluster 2024-09-21T01:25:42.490437+0000 mgr.a (mgr.14388) 8274 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:45 smithi049 bash[23528]: cluster 2024-09-21T01:25:44.491145+0000 mgr.a (mgr.14388) 8275 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:45.962 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:45 smithi179 bash[23186]: cluster 2024-09-21T01:25:44.491145+0000 mgr.a (mgr.14388) 8275 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:45 smithi044 bash[22676]: cluster 2024-09-21T01:25:44.491145+0000 mgr.a (mgr.14388) 8275 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:47.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:47.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:47.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:47 smithi044 bash[22676]: cluster 2024-09-21T01:25:46.493398+0000 mgr.a (mgr.14388) 8276 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:47 smithi179 bash[23186]: cluster 2024-09-21T01:25:46.493398+0000 mgr.a (mgr.14388) 8276 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:47 smithi049 bash[23528]: cluster 2024-09-21T01:25:46.493398+0000 mgr.a (mgr.14388) 8276 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:25:48.202 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:48.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:48.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:48 smithi044 bash[22676]: audit 2024-09-21T01:25:47.783756+0000 mgr.a (mgr.14388) 8277 : audit [DBG] from='client.185610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:48 smithi179 bash[23186]: audit 2024-09-21T01:25:47.783756+0000 mgr.a (mgr.14388) 8277 : audit [DBG] from='client.185610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:48 smithi049 bash[23528]: audit 2024-09-21T01:25:47.783756+0000 mgr.a (mgr.14388) 8277 : audit [DBG] from='client.185610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:50 smithi044 bash[22676]: cluster 2024-09-21T01:25:48.494241+0000 mgr.a (mgr.14388) 8278 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:50 smithi044 bash[22676]: audit 2024-09-21T01:25:49.019851+0000 mon.a (mon.0) 7027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:50 smithi044 bash[22676]: audit 2024-09-21T01:25:49.030101+0000 mon.a (mon.0) 7028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:50 smithi044 bash[22676]: audit 2024-09-21T01:25:49.038492+0000 mon.a (mon.0) 7029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:50 smithi044 bash[22676]: audit 2024-09-21T01:25:49.909036+0000 mon.a (mon.0) 7030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:50 smithi044 bash[22676]: audit 2024-09-21T01:25:49.914678+0000 mon.a (mon.0) 7031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:50 smithi044 bash[22676]: audit 2024-09-21T01:25:49.920804+0000 mon.a (mon.0) 7032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:50 smithi049 bash[23528]: cluster 2024-09-21T01:25:48.494241+0000 mgr.a (mgr.14388) 8278 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:50 smithi049 bash[23528]: audit 2024-09-21T01:25:49.019851+0000 mon.a (mon.0) 7027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:50 smithi049 bash[23528]: audit 2024-09-21T01:25:49.030101+0000 mon.a (mon.0) 7028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:50 smithi049 bash[23528]: audit 2024-09-21T01:25:49.038492+0000 mon.a (mon.0) 7029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:50 smithi049 bash[23528]: audit 2024-09-21T01:25:49.909036+0000 mon.a (mon.0) 7030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:50 smithi049 bash[23528]: audit 2024-09-21T01:25:49.914678+0000 mon.a (mon.0) 7031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:50 smithi049 bash[23528]: audit 2024-09-21T01:25:49.920804+0000 mon.a (mon.0) 7032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:50 smithi179 bash[23186]: cluster 2024-09-21T01:25:48.494241+0000 mgr.a (mgr.14388) 8278 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 184 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:25:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:50 smithi179 bash[23186]: audit 2024-09-21T01:25:49.019851+0000 mon.a (mon.0) 7027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:50 smithi179 bash[23186]: audit 2024-09-21T01:25:49.030101+0000 mon.a (mon.0) 7028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:50 smithi179 bash[23186]: audit 2024-09-21T01:25:49.038492+0000 mon.a (mon.0) 7029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:50 smithi179 bash[23186]: audit 2024-09-21T01:25:49.909036+0000 mon.a (mon.0) 7030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:50 smithi179 bash[23186]: audit 2024-09-21T01:25:49.914678+0000 mon.a (mon.0) 7031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:50 smithi179 bash[23186]: audit 2024-09-21T01:25:49.920804+0000 mon.a (mon.0) 7032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:52 smithi049 bash[23528]: cluster 2024-09-21T01:25:50.495585+0000 mgr.a (mgr.14388) 8279 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:25:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:52 smithi044 bash[22676]: cluster 2024-09-21T01:25:50.495585+0000 mgr.a (mgr.14388) 8279 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:25:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:52 smithi179 bash[23186]: cluster 2024-09-21T01:25:50.495585+0000 mgr.a (mgr.14388) 8279 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:25:53.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:53.204 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:53.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:53.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:53.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:53.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:53.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:53.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:25:54.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:54 smithi049 bash[23528]: cluster 2024-09-21T01:25:52.496309+0000 mgr.a (mgr.14388) 8280 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:25:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:54 smithi044 bash[22676]: cluster 2024-09-21T01:25:52.496309+0000 mgr.a (mgr.14388) 8280 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:25:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:54 smithi179 bash[23186]: cluster 2024-09-21T01:25:52.496309+0000 mgr.a (mgr.14388) 8280 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:25:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:55 smithi049 bash[23528]: audit 2024-09-21T01:25:53.543799+0000 mgr.a (mgr.14388) 8281 : audit [DBG] from='client.185685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:55 smithi049 bash[23528]: audit 2024-09-21T01:25:54.681457+0000 mon.a (mon.0) 7033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:55 smithi049 bash[23528]: audit 2024-09-21T01:25:54.690041+0000 mon.a (mon.0) 7034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:55 smithi049 bash[23528]: audit 2024-09-21T01:25:54.700299+0000 mon.a (mon.0) 7035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:55 smithi044 bash[22676]: audit 2024-09-21T01:25:53.543799+0000 mgr.a (mgr.14388) 8281 : audit [DBG] from='client.185685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:55 smithi044 bash[22676]: audit 2024-09-21T01:25:54.681457+0000 mon.a (mon.0) 7033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:55 smithi044 bash[22676]: audit 2024-09-21T01:25:54.690041+0000 mon.a (mon.0) 7034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:55 smithi044 bash[22676]: audit 2024-09-21T01:25:54.700299+0000 mon.a (mon.0) 7035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:55 smithi179 bash[23186]: audit 2024-09-21T01:25:53.543799+0000 mgr.a (mgr.14388) 8281 : audit [DBG] from='client.185685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:25:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:55 smithi179 bash[23186]: audit 2024-09-21T01:25:54.681457+0000 mon.a (mon.0) 7033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:55 smithi179 bash[23186]: audit 2024-09-21T01:25:54.690041+0000 mon.a (mon.0) 7034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:55 smithi179 bash[23186]: audit 2024-09-21T01:25:54.700299+0000 mon.a (mon.0) 7035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:56.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:56 smithi049 bash[23528]: cluster 2024-09-21T01:25:54.497211+0000 mgr.a (mgr.14388) 8282 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:25:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:56 smithi044 bash[22676]: cluster 2024-09-21T01:25:54.497211+0000 mgr.a (mgr.14388) 8282 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:25:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:56 smithi179 bash[23186]: cluster 2024-09-21T01:25:54.497211+0000 mgr.a (mgr.14388) 8282 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:25:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:58 smithi049 bash[23528]: cluster 2024-09-21T01:25:56.499385+0000 mgr.a (mgr.14388) 8283 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:25:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:58 smithi049 bash[23528]: audit 2024-09-21T01:25:57.871981+0000 mon.a (mon.0) 7036 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:25:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:58 smithi049 bash[23528]: audit 2024-09-21T01:25:57.878219+0000 mon.a (mon.0) 7037 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:25:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:58 smithi049 bash[23528]: audit 2024-09-21T01:25:57.880128+0000 mon.a (mon.0) 7038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:25:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:58 smithi049 bash[23528]: audit 2024-09-21T01:25:57.891274+0000 mon.a (mon.0) 7039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:58 smithi049 bash[23528]: audit 2024-09-21T01:25:57.897584+0000 mon.a (mon.0) 7040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:25:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22676]: cluster 2024-09-21T01:25:56.499385+0000 mgr.a (mgr.14388) 8283 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:25:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22676]: audit 2024-09-21T01:25:57.871981+0000 mon.a (mon.0) 7036 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:25:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22676]: audit 2024-09-21T01:25:57.878219+0000 mon.a (mon.0) 7037 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:25:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22676]: audit 2024-09-21T01:25:57.880128+0000 mon.a (mon.0) 7038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:25:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22676]: audit 2024-09-21T01:25:57.891274+0000 mon.a (mon.0) 7039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22676]: audit 2024-09-21T01:25:57.897584+0000 mon.a (mon.0) 7040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:58 smithi179 bash[23186]: cluster 2024-09-21T01:25:56.499385+0000 mgr.a (mgr.14388) 8283 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:58 smithi179 bash[23186]: audit 2024-09-21T01:25:57.871981+0000 mon.a (mon.0) 7036 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:58 smithi179 bash[23186]: audit 2024-09-21T01:25:57.878219+0000 mon.a (mon.0) 7037 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:58 smithi179 bash[23186]: audit 2024-09-21T01:25:57.880128+0000 mon.a (mon.0) 7038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:58 smithi179 bash[23186]: audit 2024-09-21T01:25:57.891274+0000 mon.a (mon.0) 7039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:58 smithi179 bash[23186]: audit 2024-09-21T01:25:57.897584+0000 mon.a (mon.0) 7040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:25:58.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22930]: debug 2024-09-21T01:25:58.673+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:25:58.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:25:58 smithi044 bash[22930]: debug 2024-09-21T01:25:58.673+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:25:58.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:25:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:25:58.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:25:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:25:59 smithi049 bash[23528]: audit 2024-09-21T01:25:57.899928+0000 mgr.a (mgr.14388) 8284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:25:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:25:59 smithi044 bash[22676]: audit 2024-09-21T01:25:57.899928+0000 mgr.a (mgr.14388) 8284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:25:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:25:59 smithi179 bash[23186]: audit 2024-09-21T01:25:57.899928+0000 mgr.a (mgr.14388) 8284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:25:59.780 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:25:59.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:25:59.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:25:59.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:25:59.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:00 smithi049 bash[23528]: cluster 2024-09-21T01:25:58.500336+0000 mgr.a (mgr.14388) 8285 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:26:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:00 smithi049 bash[23528]: audit 2024-09-21T01:25:58.679317+0000 mgr.a (mgr.14388) 8286 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:26:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:00 smithi049 bash[23528]: cephadm 2024-09-21T01:25:58.680423+0000 mgr.a (mgr.14388) 8287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:26:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:00 smithi049 bash[23528]: audit 2024-09-21T01:25:59.323746+0000 mgr.a (mgr.14388) 8288 : audit [DBG] from='client.185865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:00 smithi044 bash[22676]: cluster 2024-09-21T01:25:58.500336+0000 mgr.a (mgr.14388) 8285 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:26:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:00 smithi044 bash[22676]: audit 2024-09-21T01:25:58.679317+0000 mgr.a (mgr.14388) 8286 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:26:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:00 smithi044 bash[22676]: cephadm 2024-09-21T01:25:58.680423+0000 mgr.a (mgr.14388) 8287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:26:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:00 smithi044 bash[22676]: audit 2024-09-21T01:25:59.323746+0000 mgr.a (mgr.14388) 8288 : audit [DBG] from='client.185865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:00 smithi179 bash[23186]: cluster 2024-09-21T01:25:58.500336+0000 mgr.a (mgr.14388) 8285 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:26:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:00 smithi179 bash[23186]: audit 2024-09-21T01:25:58.679317+0000 mgr.a (mgr.14388) 8286 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:26:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:00 smithi179 bash[23186]: cephadm 2024-09-21T01:25:58.680423+0000 mgr.a (mgr.14388) 8287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:26:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:00 smithi179 bash[23186]: audit 2024-09-21T01:25:59.323746+0000 mgr.a (mgr.14388) 8288 : audit [DBG] from='client.185865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:02 smithi044 bash[22676]: cluster 2024-09-21T01:26:00.503074+0000 mgr.a (mgr.14388) 8289 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 16 op/s 2024-09-21T01:26:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:02 smithi179 bash[23186]: cluster 2024-09-21T01:26:00.503074+0000 mgr.a (mgr.14388) 8289 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 16 op/s 2024-09-21T01:26:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:02 smithi049 bash[23528]: cluster 2024-09-21T01:26:00.503074+0000 mgr.a (mgr.14388) 8289 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 16 op/s 2024-09-21T01:26:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:04 smithi049 bash[23528]: cluster 2024-09-21T01:26:02.503903+0000 mgr.a (mgr.14388) 8290 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:26:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:04 smithi044 bash[22676]: cluster 2024-09-21T01:26:02.503903+0000 mgr.a (mgr.14388) 8290 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:26:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:04 smithi179 bash[23186]: cluster 2024-09-21T01:26:02.503903+0000 mgr.a (mgr.14388) 8290 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:26:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:05.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:06 smithi049 bash[23528]: cluster 2024-09-21T01:26:04.504674+0000 mgr.a (mgr.14388) 8291 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:26:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:06 smithi049 bash[23528]: audit 2024-09-21T01:26:05.122138+0000 mgr.a (mgr.14388) 8292 : audit [DBG] from='client.185943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:06.412 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:06 smithi179 bash[23186]: cluster 2024-09-21T01:26:04.504674+0000 mgr.a (mgr.14388) 8291 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:26:06.412 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:06 smithi179 bash[23186]: audit 2024-09-21T01:26:05.122138+0000 mgr.a (mgr.14388) 8292 : audit [DBG] from='client.185943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:06 smithi044 bash[22676]: cluster 2024-09-21T01:26:04.504674+0000 mgr.a (mgr.14388) 8291 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T01:26:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:06 smithi044 bash[22676]: audit 2024-09-21T01:26:05.122138+0000 mgr.a (mgr.14388) 8292 : audit [DBG] from='client.185943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:08 smithi179 bash[23186]: cluster 2024-09-21T01:26:06.507438+0000 mgr.a (mgr.14388) 8293 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:08.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:08 smithi044 bash[22676]: cluster 2024-09-21T01:26:06.507438+0000 mgr.a (mgr.14388) 8293 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:08 smithi049 bash[23528]: cluster 2024-09-21T01:26:06.507438+0000 mgr.a (mgr.14388) 8293 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:10 smithi044 bash[22676]: cluster 2024-09-21T01:26:08.507951+0000 mgr.a (mgr.14388) 8294 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:10 smithi044 bash[22676]: audit 2024-09-21T01:26:09.225722+0000 mon.a (mon.0) 7041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:10 smithi044 bash[22676]: audit 2024-09-21T01:26:09.234090+0000 mon.a (mon.0) 7042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:10 smithi044 bash[22676]: audit 2024-09-21T01:26:09.244007+0000 mon.a (mon.0) 7043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:10 smithi044 bash[22676]: audit 2024-09-21T01:26:10.088323+0000 mon.a (mon.0) 7044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:10 smithi044 bash[22676]: audit 2024-09-21T01:26:10.093363+0000 mon.a (mon.0) 7045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:10 smithi044 bash[22676]: audit 2024-09-21T01:26:10.100441+0000 mon.a (mon.0) 7046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:10 smithi179 bash[23186]: cluster 2024-09-21T01:26:08.507951+0000 mgr.a (mgr.14388) 8294 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:10 smithi179 bash[23186]: audit 2024-09-21T01:26:09.225722+0000 mon.a (mon.0) 7041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:10 smithi179 bash[23186]: audit 2024-09-21T01:26:09.234090+0000 mon.a (mon.0) 7042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:10 smithi179 bash[23186]: audit 2024-09-21T01:26:09.244007+0000 mon.a (mon.0) 7043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:10 smithi179 bash[23186]: audit 2024-09-21T01:26:10.088323+0000 mon.a (mon.0) 7044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:10 smithi179 bash[23186]: audit 2024-09-21T01:26:10.093363+0000 mon.a (mon.0) 7045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:10 smithi179 bash[23186]: audit 2024-09-21T01:26:10.100441+0000 mon.a (mon.0) 7046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:10 smithi049 bash[23528]: cluster 2024-09-21T01:26:08.507951+0000 mgr.a (mgr.14388) 8294 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:10 smithi049 bash[23528]: audit 2024-09-21T01:26:09.225722+0000 mon.a (mon.0) 7041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:10 smithi049 bash[23528]: audit 2024-09-21T01:26:09.234090+0000 mon.a (mon.0) 7042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:10 smithi049 bash[23528]: audit 2024-09-21T01:26:09.244007+0000 mon.a (mon.0) 7043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:10 smithi049 bash[23528]: audit 2024-09-21T01:26:10.088323+0000 mon.a (mon.0) 7044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:10 smithi049 bash[23528]: audit 2024-09-21T01:26:10.093363+0000 mon.a (mon.0) 7045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:10 smithi049 bash[23528]: audit 2024-09-21T01:26:10.100441+0000 mon.a (mon.0) 7046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:11.320 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:11.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:12 smithi044 bash[22676]: cluster 2024-09-21T01:26:10.509366+0000 mgr.a (mgr.14388) 8295 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:12 smithi044 bash[22676]: audit 2024-09-21T01:26:10.887381+0000 mgr.a (mgr.14388) 8296 : audit [DBG] from='client.186021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:12 smithi179 bash[23186]: cluster 2024-09-21T01:26:10.509366+0000 mgr.a (mgr.14388) 8295 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:12 smithi179 bash[23186]: audit 2024-09-21T01:26:10.887381+0000 mgr.a (mgr.14388) 8296 : audit [DBG] from='client.186021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:12 smithi049 bash[23528]: cluster 2024-09-21T01:26:10.509366+0000 mgr.a (mgr.14388) 8295 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T01:26:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:12 smithi049 bash[23528]: audit 2024-09-21T01:26:10.887381+0000 mgr.a (mgr.14388) 8296 : audit [DBG] from='client.186021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:14 smithi044 bash[22676]: cluster 2024-09-21T01:26:12.510211+0000 mgr.a (mgr.14388) 8297 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s 2024-09-21T01:26:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:14 smithi179 bash[23186]: cluster 2024-09-21T01:26:12.510211+0000 mgr.a (mgr.14388) 8297 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s 2024-09-21T01:26:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:14 smithi049 bash[23528]: cluster 2024-09-21T01:26:12.510211+0000 mgr.a (mgr.14388) 8297 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s 2024-09-21T01:26:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:15 smithi044 bash[22676]: cluster 2024-09-21T01:26:14.511005+0000 mgr.a (mgr.14388) 8298 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s 2024-09-21T01:26:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:15 smithi044 bash[22676]: audit 2024-09-21T01:26:14.917048+0000 mon.a (mon.0) 7047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:15 smithi044 bash[22676]: audit 2024-09-21T01:26:14.925816+0000 mon.a (mon.0) 7048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:15 smithi044 bash[22676]: audit 2024-09-21T01:26:14.936329+0000 mon.a (mon.0) 7049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:15 smithi179 bash[23186]: cluster 2024-09-21T01:26:14.511005+0000 mgr.a (mgr.14388) 8298 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s 2024-09-21T01:26:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:15 smithi179 bash[23186]: audit 2024-09-21T01:26:14.917048+0000 mon.a (mon.0) 7047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:15 smithi179 bash[23186]: audit 2024-09-21T01:26:14.925816+0000 mon.a (mon.0) 7048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:15 smithi179 bash[23186]: audit 2024-09-21T01:26:14.936329+0000 mon.a (mon.0) 7049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:15 smithi049 bash[23528]: cluster 2024-09-21T01:26:14.511005+0000 mgr.a (mgr.14388) 8298 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s 2024-09-21T01:26:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:15 smithi049 bash[23528]: audit 2024-09-21T01:26:14.917048+0000 mon.a (mon.0) 7047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:15 smithi049 bash[23528]: audit 2024-09-21T01:26:14.925816+0000 mon.a (mon.0) 7048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:15 smithi049 bash[23528]: audit 2024-09-21T01:26:14.936329+0000 mon.a (mon.0) 7049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:16.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:16.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:17.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:17.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:17.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:17.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:17.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:17 smithi044 bash[22676]: cluster 2024-09-21T01:26:16.513134+0000 mgr.a (mgr.14388) 8299 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T01:26:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:17 smithi044 bash[22676]: audit 2024-09-21T01:26:16.662126+0000 mgr.a (mgr.14388) 8300 : audit [DBG] from='client.186093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:17 smithi179 bash[23186]: cluster 2024-09-21T01:26:16.513134+0000 mgr.a (mgr.14388) 8299 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T01:26:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:17 smithi179 bash[23186]: audit 2024-09-21T01:26:16.662126+0000 mgr.a (mgr.14388) 8300 : audit [DBG] from='client.186093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:17 smithi049 bash[23528]: cluster 2024-09-21T01:26:16.513134+0000 mgr.a (mgr.14388) 8299 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T01:26:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:17 smithi049 bash[23528]: audit 2024-09-21T01:26:16.662126+0000 mgr.a (mgr.14388) 8300 : audit [DBG] from='client.186093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:19 smithi044 bash[22676]: cluster 2024-09-21T01:26:18.514115+0000 mgr.a (mgr.14388) 8301 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:19 smithi179 bash[23186]: cluster 2024-09-21T01:26:18.514115+0000 mgr.a (mgr.14388) 8301 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:19 smithi049 bash[23528]: cluster 2024-09-21T01:26:18.514115+0000 mgr.a (mgr.14388) 8301 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:22.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:21 smithi044 bash[22676]: cluster 2024-09-21T01:26:20.516270+0000 mgr.a (mgr.14388) 8302 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:21 smithi179 bash[23186]: cluster 2024-09-21T01:26:20.516270+0000 mgr.a (mgr.14388) 8302 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:21 smithi049 bash[23528]: cluster 2024-09-21T01:26:20.516270+0000 mgr.a (mgr.14388) 8302 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:22.870 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:22 smithi044 bash[22676]: audit 2024-09-21T01:26:22.449154+0000 mgr.a (mgr.14388) 8303 : audit [DBG] from='client.186165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:22 smithi179 bash[23186]: audit 2024-09-21T01:26:22.449154+0000 mgr.a (mgr.14388) 8303 : audit [DBG] from='client.186165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:22 smithi049 bash[23528]: audit 2024-09-21T01:26:22.449154+0000 mgr.a (mgr.14388) 8303 : audit [DBG] from='client.186165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:23 smithi044 bash[22676]: cluster 2024-09-21T01:26:22.516812+0000 mgr.a (mgr.14388) 8304 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:23 smithi179 bash[23186]: cluster 2024-09-21T01:26:22.516812+0000 mgr.a (mgr.14388) 8304 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:24.252 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:23 smithi049 bash[23528]: cluster 2024-09-21T01:26:22.516812+0000 mgr.a (mgr.14388) 8304 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:26.214 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:25 smithi179 bash[23186]: cluster 2024-09-21T01:26:24.517751+0000 mgr.a (mgr.14388) 8305 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:25 smithi044 bash[22676]: cluster 2024-09-21T01:26:24.517751+0000 mgr.a (mgr.14388) 8305 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:25 smithi049 bash[23528]: cluster 2024-09-21T01:26:24.517751+0000 mgr.a (mgr.14388) 8305 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:27.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:27.873 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:27.873 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:27 smithi044 bash[22676]: cluster 2024-09-21T01:26:26.518989+0000 mgr.a (mgr.14388) 8306 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:27 smithi179 bash[23186]: cluster 2024-09-21T01:26:26.518989+0000 mgr.a (mgr.14388) 8306 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:27 smithi049 bash[23528]: cluster 2024-09-21T01:26:26.518989+0000 mgr.a (mgr.14388) 8306 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:28.654 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:28.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:28 smithi044 bash[22676]: audit 2024-09-21T01:26:28.223863+0000 mgr.a (mgr.14388) 8307 : audit [DBG] from='client.186240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:28 smithi179 bash[23186]: audit 2024-09-21T01:26:28.223863+0000 mgr.a (mgr.14388) 8307 : audit [DBG] from='client.186240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:28 smithi049 bash[23528]: audit 2024-09-21T01:26:28.223863+0000 mgr.a (mgr.14388) 8307 : audit [DBG] from='client.186240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:30 smithi044 bash[22676]: cluster 2024-09-21T01:26:28.519477+0000 mgr.a (mgr.14388) 8308 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:30 smithi044 bash[22676]: audit 2024-09-21T01:26:29.441295+0000 mon.a (mon.0) 7050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:30 smithi044 bash[22676]: audit 2024-09-21T01:26:29.450988+0000 mon.a (mon.0) 7051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:30 smithi044 bash[22676]: audit 2024-09-21T01:26:29.462467+0000 mon.a (mon.0) 7052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:30 smithi044 bash[22676]: audit 2024-09-21T01:26:30.242434+0000 mon.a (mon.0) 7053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:30 smithi044 bash[22676]: audit 2024-09-21T01:26:30.247792+0000 mon.a (mon.0) 7054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:30 smithi044 bash[22676]: audit 2024-09-21T01:26:30.254055+0000 mon.a (mon.0) 7055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:30 smithi179 bash[23186]: cluster 2024-09-21T01:26:28.519477+0000 mgr.a (mgr.14388) 8308 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:30 smithi179 bash[23186]: audit 2024-09-21T01:26:29.441295+0000 mon.a (mon.0) 7050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:30 smithi179 bash[23186]: audit 2024-09-21T01:26:29.450988+0000 mon.a (mon.0) 7051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:30 smithi179 bash[23186]: audit 2024-09-21T01:26:29.462467+0000 mon.a (mon.0) 7052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:30 smithi179 bash[23186]: audit 2024-09-21T01:26:30.242434+0000 mon.a (mon.0) 7053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:30 smithi179 bash[23186]: audit 2024-09-21T01:26:30.247792+0000 mon.a (mon.0) 7054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:30 smithi179 bash[23186]: audit 2024-09-21T01:26:30.254055+0000 mon.a (mon.0) 7055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:30 smithi049 bash[23528]: cluster 2024-09-21T01:26:28.519477+0000 mgr.a (mgr.14388) 8308 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:30 smithi049 bash[23528]: audit 2024-09-21T01:26:29.441295+0000 mon.a (mon.0) 7050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:30 smithi049 bash[23528]: audit 2024-09-21T01:26:29.450988+0000 mon.a (mon.0) 7051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:30 smithi049 bash[23528]: audit 2024-09-21T01:26:29.462467+0000 mon.a (mon.0) 7052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:30 smithi049 bash[23528]: audit 2024-09-21T01:26:30.242434+0000 mon.a (mon.0) 7053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:30 smithi049 bash[23528]: audit 2024-09-21T01:26:30.247792+0000 mon.a (mon.0) 7054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:30 smithi049 bash[23528]: audit 2024-09-21T01:26:30.254055+0000 mon.a (mon.0) 7055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:32 smithi044 bash[22676]: cluster 2024-09-21T01:26:30.520816+0000 mgr.a (mgr.14388) 8309 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:32 smithi179 bash[23186]: cluster 2024-09-21T01:26:30.520816+0000 mgr.a (mgr.14388) 8309 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:32 smithi049 bash[23528]: cluster 2024-09-21T01:26:30.520816+0000 mgr.a (mgr.14388) 8309 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:33.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:33.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:33.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:34.427 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:34.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:34.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:34.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:34.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:34 smithi044 bash[22676]: cluster 2024-09-21T01:26:32.521613+0000 mgr.a (mgr.14388) 8310 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:34 smithi179 bash[23186]: cluster 2024-09-21T01:26:32.521613+0000 mgr.a (mgr.14388) 8310 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:34 smithi049 bash[23528]: cluster 2024-09-21T01:26:32.521613+0000 mgr.a (mgr.14388) 8310 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:35 smithi044 bash[22676]: audit 2024-09-21T01:26:33.994568+0000 mgr.a (mgr.14388) 8311 : audit [DBG] from='client.186315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:35 smithi044 bash[22676]: audit 2024-09-21T01:26:35.156506+0000 mon.a (mon.0) 7056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:35 smithi044 bash[22676]: audit 2024-09-21T01:26:35.165499+0000 mon.a (mon.0) 7057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:35 smithi044 bash[22676]: audit 2024-09-21T01:26:35.176286+0000 mon.a (mon.0) 7058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:35 smithi179 bash[23186]: audit 2024-09-21T01:26:33.994568+0000 mgr.a (mgr.14388) 8311 : audit [DBG] from='client.186315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:35 smithi179 bash[23186]: audit 2024-09-21T01:26:35.156506+0000 mon.a (mon.0) 7056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:35 smithi179 bash[23186]: audit 2024-09-21T01:26:35.165499+0000 mon.a (mon.0) 7057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:35 smithi179 bash[23186]: audit 2024-09-21T01:26:35.176286+0000 mon.a (mon.0) 7058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:35 smithi049 bash[23528]: audit 2024-09-21T01:26:33.994568+0000 mgr.a (mgr.14388) 8311 : audit [DBG] from='client.186315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:35 smithi049 bash[23528]: audit 2024-09-21T01:26:35.156506+0000 mon.a (mon.0) 7056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:35 smithi049 bash[23528]: audit 2024-09-21T01:26:35.165499+0000 mon.a (mon.0) 7057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:35 smithi049 bash[23528]: audit 2024-09-21T01:26:35.176286+0000 mon.a (mon.0) 7058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:36 smithi044 bash[22676]: cluster 2024-09-21T01:26:34.522516+0000 mgr.a (mgr.14388) 8312 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:36 smithi179 bash[23186]: cluster 2024-09-21T01:26:34.522516+0000 mgr.a (mgr.14388) 8312 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:36 smithi049 bash[23528]: cluster 2024-09-21T01:26:34.522516+0000 mgr.a (mgr.14388) 8312 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:38 smithi044 bash[22676]: cluster 2024-09-21T01:26:36.524680+0000 mgr.a (mgr.14388) 8313 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:38 smithi179 bash[23186]: cluster 2024-09-21T01:26:36.524680+0000 mgr.a (mgr.14388) 8313 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:38 smithi049 bash[23528]: cluster 2024-09-21T01:26:36.524680+0000 mgr.a (mgr.14388) 8313 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:26:39.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:39.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:39.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:40.220 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:40.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:40.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:40.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:40.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:40 smithi044 bash[22676]: cluster 2024-09-21T01:26:38.525462+0000 mgr.a (mgr.14388) 8314 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:40 smithi179 bash[23186]: cluster 2024-09-21T01:26:38.525462+0000 mgr.a (mgr.14388) 8314 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:40 smithi049 bash[23528]: cluster 2024-09-21T01:26:38.525462+0000 mgr.a (mgr.14388) 8314 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:41 smithi044 bash[22676]: audit 2024-09-21T01:26:39.768724+0000 mgr.a (mgr.14388) 8315 : audit [DBG] from='client.186393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:41 smithi179 bash[23186]: audit 2024-09-21T01:26:39.768724+0000 mgr.a (mgr.14388) 8315 : audit [DBG] from='client.186393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:41 smithi049 bash[23528]: audit 2024-09-21T01:26:39.768724+0000 mgr.a (mgr.14388) 8315 : audit [DBG] from='client.186393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:42 smithi044 bash[22676]: cluster 2024-09-21T01:26:40.528194+0000 mgr.a (mgr.14388) 8316 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:26:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:42 smithi179 bash[23186]: cluster 2024-09-21T01:26:40.528194+0000 mgr.a (mgr.14388) 8316 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:26:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:42 smithi049 bash[23528]: cluster 2024-09-21T01:26:40.528194+0000 mgr.a (mgr.14388) 8316 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:26:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:43 smithi179 bash[23186]: cluster 2024-09-21T01:26:42.528960+0000 mgr.a (mgr.14388) 8317 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:26:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:43 smithi049 bash[23528]: cluster 2024-09-21T01:26:42.528960+0000 mgr.a (mgr.14388) 8317 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:26:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:43 smithi044 bash[22676]: cluster 2024-09-21T01:26:42.528960+0000 mgr.a (mgr.14388) 8317 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:26:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:45 smithi179 bash[23186]: cluster 2024-09-21T01:26:44.529762+0000 mgr.a (mgr.14388) 8318 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:26:45.753 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:45 smithi049 bash[23528]: cluster 2024-09-21T01:26:44.529762+0000 mgr.a (mgr.14388) 8318 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:26:45.964 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:45.964 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:45.964 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:45.964 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:45.964 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:45 smithi044 bash[22676]: cluster 2024-09-21T01:26:44.529762+0000 mgr.a (mgr.14388) 8318 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:26:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:46 smithi179 bash[23186]: audit 2024-09-21T01:26:45.553001+0000 mgr.a (mgr.14388) 8319 : audit [DBG] from='client.186471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:46 smithi049 bash[23528]: audit 2024-09-21T01:26:45.553001+0000 mgr.a (mgr.14388) 8319 : audit [DBG] from='client.186471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:46 smithi044 bash[22676]: audit 2024-09-21T01:26:45.553001+0000 mgr.a (mgr.14388) 8319 : audit [DBG] from='client.186471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:47 smithi179 bash[23186]: cluster 2024-09-21T01:26:46.532524+0000 mgr.a (mgr.14388) 8320 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:47.862 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:47 smithi049 bash[23528]: cluster 2024-09-21T01:26:46.532524+0000 mgr.a (mgr.14388) 8320 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:47 smithi044 bash[22676]: cluster 2024-09-21T01:26:46.532524+0000 mgr.a (mgr.14388) 8320 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:49 smithi044 bash[22676]: cluster 2024-09-21T01:26:48.533317+0000 mgr.a (mgr.14388) 8321 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:26:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:49 smithi179 bash[23186]: cluster 2024-09-21T01:26:48.533317+0000 mgr.a (mgr.14388) 8321 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:26:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:49 smithi049 bash[23528]: cluster 2024-09-21T01:26:48.533317+0000 mgr.a (mgr.14388) 8321 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:26:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:50 smithi179 bash[23186]: audit 2024-09-21T01:26:49.653651+0000 mon.a (mon.0) 7059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:50 smithi179 bash[23186]: audit 2024-09-21T01:26:49.663518+0000 mon.a (mon.0) 7060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:50 smithi179 bash[23186]: audit 2024-09-21T01:26:49.675208+0000 mon.a (mon.0) 7061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:50 smithi179 bash[23186]: audit 2024-09-21T01:26:50.385499+0000 mon.a (mon.0) 7062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:50 smithi179 bash[23186]: audit 2024-09-21T01:26:50.391563+0000 mon.a (mon.0) 7063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:50 smithi179 bash[23186]: audit 2024-09-21T01:26:50.398620+0000 mon.a (mon.0) 7064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:50 smithi044 bash[22676]: audit 2024-09-21T01:26:49.653651+0000 mon.a (mon.0) 7059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:50 smithi044 bash[22676]: audit 2024-09-21T01:26:49.663518+0000 mon.a (mon.0) 7060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:50 smithi044 bash[22676]: audit 2024-09-21T01:26:49.675208+0000 mon.a (mon.0) 7061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:50 smithi044 bash[22676]: audit 2024-09-21T01:26:50.385499+0000 mon.a (mon.0) 7062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:50 smithi044 bash[22676]: audit 2024-09-21T01:26:50.391563+0000 mon.a (mon.0) 7063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:50 smithi044 bash[22676]: audit 2024-09-21T01:26:50.398620+0000 mon.a (mon.0) 7064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:50 smithi049 bash[23528]: audit 2024-09-21T01:26:49.653651+0000 mon.a (mon.0) 7059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:50 smithi049 bash[23528]: audit 2024-09-21T01:26:49.663518+0000 mon.a (mon.0) 7060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:50 smithi049 bash[23528]: audit 2024-09-21T01:26:49.675208+0000 mon.a (mon.0) 7061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:50 smithi049 bash[23528]: audit 2024-09-21T01:26:50.385499+0000 mon.a (mon.0) 7062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:50 smithi049 bash[23528]: audit 2024-09-21T01:26:50.391563+0000 mon.a (mon.0) 7063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:50 smithi049 bash[23528]: audit 2024-09-21T01:26:50.398620+0000 mon.a (mon.0) 7064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:51.741 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:52 smithi044 bash[22676]: cluster 2024-09-21T01:26:50.534596+0000 mgr.a (mgr.14388) 8322 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:52 smithi044 bash[22676]: audit 2024-09-21T01:26:51.297339+0000 mgr.a (mgr.14388) 8323 : audit [DBG] from='client.186549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:52 smithi179 bash[23186]: cluster 2024-09-21T01:26:50.534596+0000 mgr.a (mgr.14388) 8322 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:52 smithi179 bash[23186]: audit 2024-09-21T01:26:51.297339+0000 mgr.a (mgr.14388) 8323 : audit [DBG] from='client.186549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:52 smithi049 bash[23528]: cluster 2024-09-21T01:26:50.534596+0000 mgr.a (mgr.14388) 8322 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:26:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:52 smithi049 bash[23528]: audit 2024-09-21T01:26:51.297339+0000 mgr.a (mgr.14388) 8323 : audit [DBG] from='client.186549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:54 smithi044 bash[22676]: cluster 2024-09-21T01:26:52.535579+0000 mgr.a (mgr.14388) 8324 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:26:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:54 smithi179 bash[23186]: cluster 2024-09-21T01:26:52.535579+0000 mgr.a (mgr.14388) 8324 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:26:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:54 smithi049 bash[23528]: cluster 2024-09-21T01:26:52.535579+0000 mgr.a (mgr.14388) 8324 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:26:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:56 smithi044 bash[22676]: cluster 2024-09-21T01:26:54.536418+0000 mgr.a (mgr.14388) 8325 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:26:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:56 smithi044 bash[22676]: audit 2024-09-21T01:26:55.389880+0000 mon.a (mon.0) 7065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:56 smithi044 bash[22676]: audit 2024-09-21T01:26:55.398691+0000 mon.a (mon.0) 7066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:56 smithi044 bash[22676]: audit 2024-09-21T01:26:55.409478+0000 mon.a (mon.0) 7067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:26:56.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:26:56.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:26:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:56 smithi179 bash[23186]: cluster 2024-09-21T01:26:54.536418+0000 mgr.a (mgr.14388) 8325 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:26:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:56 smithi179 bash[23186]: audit 2024-09-21T01:26:55.389880+0000 mon.a (mon.0) 7065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:56 smithi179 bash[23186]: audit 2024-09-21T01:26:55.398691+0000 mon.a (mon.0) 7066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:56 smithi179 bash[23186]: audit 2024-09-21T01:26:55.409478+0000 mon.a (mon.0) 7067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:56 smithi049 bash[23528]: cluster 2024-09-21T01:26:54.536418+0000 mgr.a (mgr.14388) 8325 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:26:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:56 smithi049 bash[23528]: audit 2024-09-21T01:26:55.389880+0000 mon.a (mon.0) 7065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:56 smithi049 bash[23528]: audit 2024-09-21T01:26:55.398691+0000 mon.a (mon.0) 7066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:56 smithi049 bash[23528]: audit 2024-09-21T01:26:55.409478+0000 mon.a (mon.0) 7067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:57.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:26:57.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:26:57.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:26:57.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:26:57.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:26:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:58 smithi044 bash[22676]: cluster 2024-09-21T01:26:56.538678+0000 mgr.a (mgr.14388) 8326 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:26:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:58 smithi044 bash[22676]: audit 2024-09-21T01:26:57.075779+0000 mgr.a (mgr.14388) 8327 : audit [DBG] from='client.186627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:58 smithi179 bash[23186]: cluster 2024-09-21T01:26:56.538678+0000 mgr.a (mgr.14388) 8326 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:26:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:58 smithi179 bash[23186]: audit 2024-09-21T01:26:57.075779+0000 mgr.a (mgr.14388) 8327 : audit [DBG] from='client.186627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:58 smithi049 bash[23528]: cluster 2024-09-21T01:26:56.538678+0000 mgr.a (mgr.14388) 8326 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:26:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:58 smithi049 bash[23528]: audit 2024-09-21T01:26:57.075779+0000 mgr.a (mgr.14388) 8327 : audit [DBG] from='client.186627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:26:59.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:26:59 smithi044 bash[22930]: debug 2024-09-21T01:26:59.508+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:26:59.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:26:59 smithi044 bash[22930]: debug 2024-09-21T01:26:59.508+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:26:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:59 smithi044 bash[22676]: audit 2024-09-21T01:26:58.736195+0000 mon.a (mon.0) 7068 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:26:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:59 smithi044 bash[22676]: audit 2024-09-21T01:26:58.743576+0000 mon.a (mon.0) 7069 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:26:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:59 smithi044 bash[22676]: audit 2024-09-21T01:26:58.745615+0000 mon.a (mon.0) 7070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:26:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:59 smithi044 bash[22676]: audit 2024-09-21T01:26:58.757219+0000 mon.a (mon.0) 7071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:26:59 smithi044 bash[22676]: audit 2024-09-21T01:26:58.763605+0000 mon.a (mon.0) 7072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:26:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:59 smithi179 bash[23186]: audit 2024-09-21T01:26:58.736195+0000 mon.a (mon.0) 7068 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:26:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:59 smithi179 bash[23186]: audit 2024-09-21T01:26:58.743576+0000 mon.a (mon.0) 7069 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:26:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:59 smithi179 bash[23186]: audit 2024-09-21T01:26:58.745615+0000 mon.a (mon.0) 7070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:26:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:59 smithi179 bash[23186]: audit 2024-09-21T01:26:58.757219+0000 mon.a (mon.0) 7071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:26:59 smithi179 bash[23186]: audit 2024-09-21T01:26:58.763605+0000 mon.a (mon.0) 7072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:26:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:59 smithi049 bash[23528]: audit 2024-09-21T01:26:58.736195+0000 mon.a (mon.0) 7068 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:26:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:59 smithi049 bash[23528]: audit 2024-09-21T01:26:58.743576+0000 mon.a (mon.0) 7069 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:26:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:59 smithi049 bash[23528]: audit 2024-09-21T01:26:58.745615+0000 mon.a (mon.0) 7070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:26:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:59 smithi049 bash[23528]: audit 2024-09-21T01:26:58.757219+0000 mon.a (mon.0) 7071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:26:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:26:59 smithi049 bash[23528]: audit 2024-09-21T01:26:58.763605+0000 mon.a (mon.0) 7072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:27:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:00 smithi044 bash[22676]: cluster 2024-09-21T01:26:58.539649+0000 mgr.a (mgr.14388) 8328 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:00 smithi044 bash[22676]: audit 2024-09-21T01:26:58.766453+0000 mgr.a (mgr.14388) 8329 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:27:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:00 smithi179 bash[23186]: cluster 2024-09-21T01:26:58.539649+0000 mgr.a (mgr.14388) 8328 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:00 smithi179 bash[23186]: audit 2024-09-21T01:26:58.766453+0000 mgr.a (mgr.14388) 8329 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:27:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:00 smithi049 bash[23528]: cluster 2024-09-21T01:26:58.539649+0000 mgr.a (mgr.14388) 8328 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:00 smithi049 bash[23528]: audit 2024-09-21T01:26:58.766453+0000 mgr.a (mgr.14388) 8329 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:27:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:01 smithi044 bash[22676]: audit 2024-09-21T01:26:59.510397+0000 mgr.a (mgr.14388) 8330 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:27:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:01 smithi044 bash[22676]: cephadm 2024-09-21T01:26:59.511942+0000 mgr.a (mgr.14388) 8331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:27:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:01 smithi179 bash[23186]: audit 2024-09-21T01:26:59.510397+0000 mgr.a (mgr.14388) 8330 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:27:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:01 smithi179 bash[23186]: cephadm 2024-09-21T01:26:59.511942+0000 mgr.a (mgr.14388) 8331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:27:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:01 smithi049 bash[23528]: audit 2024-09-21T01:26:59.510397+0000 mgr.a (mgr.14388) 8330 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:27:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:01 smithi049 bash[23528]: cephadm 2024-09-21T01:26:59.511942+0000 mgr.a (mgr.14388) 8331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:27:02.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:02.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:02.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:02 smithi044 bash[22676]: cluster 2024-09-21T01:27:00.542019+0000 mgr.a (mgr.14388) 8332 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:02 smithi179 bash[23186]: cluster 2024-09-21T01:27:00.542019+0000 mgr.a (mgr.14388) 8332 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:02 smithi049 bash[23528]: cluster 2024-09-21T01:27:00.542019+0000 mgr.a (mgr.14388) 8332 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:03.296 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:03.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:03.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:03.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:03.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:04 smithi044 bash[22676]: cluster 2024-09-21T01:27:02.542784+0000 mgr.a (mgr.14388) 8333 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:04 smithi044 bash[22676]: audit 2024-09-21T01:27:02.848618+0000 mgr.a (mgr.14388) 8334 : audit [DBG] from='client.186810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:04 smithi179 bash[23186]: cluster 2024-09-21T01:27:02.542784+0000 mgr.a (mgr.14388) 8333 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:04 smithi179 bash[23186]: audit 2024-09-21T01:27:02.848618+0000 mgr.a (mgr.14388) 8334 : audit [DBG] from='client.186810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:04 smithi049 bash[23528]: cluster 2024-09-21T01:27:02.542784+0000 mgr.a (mgr.14388) 8333 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:04 smithi049 bash[23528]: audit 2024-09-21T01:27:02.848618+0000 mgr.a (mgr.14388) 8334 : audit [DBG] from='client.186810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:06 smithi044 bash[22676]: cluster 2024-09-21T01:27:04.543804+0000 mgr.a (mgr.14388) 8335 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:06 smithi179 bash[23186]: cluster 2024-09-21T01:27:04.543804+0000 mgr.a (mgr.14388) 8335 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:06 smithi049 bash[23528]: cluster 2024-09-21T01:27:04.543804+0000 mgr.a (mgr.14388) 8335 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:08.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:08.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:08.299 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:08 smithi049 bash[23528]: cluster 2024-09-21T01:27:06.546028+0000 mgr.a (mgr.14388) 8336 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:08.713 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:08 smithi044 bash[22676]: cluster 2024-09-21T01:27:06.546028+0000 mgr.a (mgr.14388) 8336 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:08 smithi179 bash[23186]: cluster 2024-09-21T01:27:06.546028+0000 mgr.a (mgr.14388) 8336 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:09.041 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:09.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:10 smithi044 bash[22676]: cluster 2024-09-21T01:27:08.546563+0000 mgr.a (mgr.14388) 8337 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:10 smithi044 bash[22676]: audit 2024-09-21T01:27:08.631860+0000 mgr.a (mgr.14388) 8338 : audit [DBG] from='client.186882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:10 smithi044 bash[22676]: audit 2024-09-21T01:27:09.891326+0000 mon.a (mon.0) 7073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:10 smithi044 bash[22676]: audit 2024-09-21T01:27:09.900779+0000 mon.a (mon.0) 7074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:10 smithi044 bash[22676]: audit 2024-09-21T01:27:09.912075+0000 mon.a (mon.0) 7075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:10 smithi179 bash[23186]: cluster 2024-09-21T01:27:08.546563+0000 mgr.a (mgr.14388) 8337 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:10 smithi179 bash[23186]: audit 2024-09-21T01:27:08.631860+0000 mgr.a (mgr.14388) 8338 : audit [DBG] from='client.186882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:10 smithi179 bash[23186]: audit 2024-09-21T01:27:09.891326+0000 mon.a (mon.0) 7073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:10 smithi179 bash[23186]: audit 2024-09-21T01:27:09.900779+0000 mon.a (mon.0) 7074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:10 smithi179 bash[23186]: audit 2024-09-21T01:27:09.912075+0000 mon.a (mon.0) 7075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:10 smithi049 bash[23528]: cluster 2024-09-21T01:27:08.546563+0000 mgr.a (mgr.14388) 8337 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:10 smithi049 bash[23528]: audit 2024-09-21T01:27:08.631860+0000 mgr.a (mgr.14388) 8338 : audit [DBG] from='client.186882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:10 smithi049 bash[23528]: audit 2024-09-21T01:27:09.891326+0000 mon.a (mon.0) 7073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:10 smithi049 bash[23528]: audit 2024-09-21T01:27:09.900779+0000 mon.a (mon.0) 7074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:10 smithi049 bash[23528]: audit 2024-09-21T01:27:09.912075+0000 mon.a (mon.0) 7075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:11 smithi179 bash[23186]: audit 2024-09-21T01:27:10.535687+0000 mon.a (mon.0) 7076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:11 smithi179 bash[23186]: audit 2024-09-21T01:27:10.541432+0000 mon.a (mon.0) 7077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:11 smithi179 bash[23186]: cluster 2024-09-21T01:27:10.547594+0000 mgr.a (mgr.14388) 8339 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:11 smithi179 bash[23186]: audit 2024-09-21T01:27:10.548181+0000 mon.a (mon.0) 7078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:11 smithi049 bash[23528]: audit 2024-09-21T01:27:10.535687+0000 mon.a (mon.0) 7076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:11 smithi049 bash[23528]: audit 2024-09-21T01:27:10.541432+0000 mon.a (mon.0) 7077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:11 smithi049 bash[23528]: cluster 2024-09-21T01:27:10.547594+0000 mgr.a (mgr.14388) 8339 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:11 smithi049 bash[23528]: audit 2024-09-21T01:27:10.548181+0000 mon.a (mon.0) 7078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:11 smithi044 bash[22676]: audit 2024-09-21T01:27:10.535687+0000 mon.a (mon.0) 7076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:11 smithi044 bash[22676]: audit 2024-09-21T01:27:10.541432+0000 mon.a (mon.0) 7077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:11 smithi044 bash[22676]: cluster 2024-09-21T01:27:10.547594+0000 mgr.a (mgr.14388) 8339 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:27:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:11 smithi044 bash[22676]: audit 2024-09-21T01:27:10.548181+0000 mon.a (mon.0) 7078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:13 smithi044 bash[22676]: cluster 2024-09-21T01:27:12.548300+0000 mgr.a (mgr.14388) 8340 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:13 smithi179 bash[23186]: cluster 2024-09-21T01:27:12.548300+0000 mgr.a (mgr.14388) 8340 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:14.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:14.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:14.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:13 smithi049 bash[23528]: cluster 2024-09-21T01:27:12.548300+0000 mgr.a (mgr.14388) 8340 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:14.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:14 smithi044 bash[22676]: audit 2024-09-21T01:27:14.376357+0000 mgr.a (mgr.14388) 8341 : audit [DBG] from='client.186960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:14 smithi179 bash[23186]: audit 2024-09-21T01:27:14.376357+0000 mgr.a (mgr.14388) 8341 : audit [DBG] from='client.186960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:14 smithi049 bash[23528]: audit 2024-09-21T01:27:14.376357+0000 mgr.a (mgr.14388) 8341 : audit [DBG] from='client.186960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:15 smithi044 bash[22676]: cluster 2024-09-21T01:27:14.548882+0000 mgr.a (mgr.14388) 8342 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:15 smithi179 bash[23186]: cluster 2024-09-21T01:27:14.548882+0000 mgr.a (mgr.14388) 8342 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:15 smithi049 bash[23528]: cluster 2024-09-21T01:27:14.548882+0000 mgr.a (mgr.14388) 8342 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:16 smithi044 bash[22676]: audit 2024-09-21T01:27:15.629135+0000 mon.a (mon.0) 7079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:16 smithi044 bash[22676]: audit 2024-09-21T01:27:15.637571+0000 mon.a (mon.0) 7080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:16 smithi044 bash[22676]: audit 2024-09-21T01:27:15.647993+0000 mon.a (mon.0) 7081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:16 smithi179 bash[23186]: audit 2024-09-21T01:27:15.629135+0000 mon.a (mon.0) 7079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:16 smithi179 bash[23186]: audit 2024-09-21T01:27:15.637571+0000 mon.a (mon.0) 7080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:16 smithi179 bash[23186]: audit 2024-09-21T01:27:15.647993+0000 mon.a (mon.0) 7081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:16 smithi049 bash[23528]: audit 2024-09-21T01:27:15.629135+0000 mon.a (mon.0) 7079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:16 smithi049 bash[23528]: audit 2024-09-21T01:27:15.637571+0000 mon.a (mon.0) 7080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:16 smithi049 bash[23528]: audit 2024-09-21T01:27:15.647993+0000 mon.a (mon.0) 7081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:17 smithi049 bash[23528]: cluster 2024-09-21T01:27:16.551301+0000 mgr.a (mgr.14388) 8343 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:17 smithi044 bash[22676]: cluster 2024-09-21T01:27:16.551301+0000 mgr.a (mgr.14388) 8343 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:17 smithi179 bash[23186]: cluster 2024-09-21T01:27:16.551301+0000 mgr.a (mgr.14388) 8343 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:19.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:19.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:19.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:19 smithi044 bash[22676]: cluster 2024-09-21T01:27:18.552442+0000 mgr.a (mgr.14388) 8344 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:19 smithi179 bash[23186]: cluster 2024-09-21T01:27:18.552442+0000 mgr.a (mgr.14388) 8344 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:19 smithi049 bash[23528]: cluster 2024-09-21T01:27:18.552442+0000 mgr.a (mgr.14388) 8344 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:20.588 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:20.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:20.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:20.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:20.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:20 smithi044 bash[22676]: audit 2024-09-21T01:27:20.146123+0000 mgr.a (mgr.14388) 8345 : audit [DBG] from='client.187038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:20 smithi179 bash[23186]: audit 2024-09-21T01:27:20.146123+0000 mgr.a (mgr.14388) 8345 : audit [DBG] from='client.187038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:20 smithi049 bash[23528]: audit 2024-09-21T01:27:20.146123+0000 mgr.a (mgr.14388) 8345 : audit [DBG] from='client.187038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:21 smithi044 bash[22676]: cluster 2024-09-21T01:27:20.553943+0000 mgr.a (mgr.14388) 8346 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:21 smithi179 bash[23186]: cluster 2024-09-21T01:27:20.553943+0000 mgr.a (mgr.14388) 8346 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:22.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:21 smithi049 bash[23528]: cluster 2024-09-21T01:27:20.553943+0000 mgr.a (mgr.14388) 8346 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:23 smithi044 bash[22676]: cluster 2024-09-21T01:27:22.554710+0000 mgr.a (mgr.14388) 8347 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:27:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:23 smithi179 bash[23186]: cluster 2024-09-21T01:27:22.554710+0000 mgr.a (mgr.14388) 8347 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:27:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:23 smithi049 bash[23528]: cluster 2024-09-21T01:27:22.554710+0000 mgr.a (mgr.14388) 8347 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:27:25.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:25.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:25.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:25.948 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:25 smithi049 bash[23528]: cluster 2024-09-21T01:27:24.555677+0000 mgr.a (mgr.14388) 8348 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:27:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:25 smithi044 bash[22676]: cluster 2024-09-21T01:27:24.555677+0000 mgr.a (mgr.14388) 8348 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:27:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:25 smithi179 bash[23186]: cluster 2024-09-21T01:27:24.555677+0000 mgr.a (mgr.14388) 8348 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:27:26.369 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:26.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:26.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:26.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:26.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:26.937 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:26 smithi179 bash[23186]: audit 2024-09-21T01:27:25.924769+0000 mgr.a (mgr.14388) 8349 : audit [DBG] from='client.187116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:26 smithi044 bash[22676]: audit 2024-09-21T01:27:25.924769+0000 mgr.a (mgr.14388) 8349 : audit [DBG] from='client.187116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:26 smithi049 bash[23528]: audit 2024-09-21T01:27:25.924769+0000 mgr.a (mgr.14388) 8349 : audit [DBG] from='client.187116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:27.934 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:27 smithi044 bash[22676]: cluster 2024-09-21T01:27:26.558921+0000 mgr.a (mgr.14388) 8350 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:27 smithi179 bash[23186]: cluster 2024-09-21T01:27:26.558921+0000 mgr.a (mgr.14388) 8350 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:27 smithi049 bash[23528]: cluster 2024-09-21T01:27:26.558921+0000 mgr.a (mgr.14388) 8350 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:29 smithi044 bash[22676]: cluster 2024-09-21T01:27:28.559537+0000 mgr.a (mgr.14388) 8351 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:27:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:29 smithi179 bash[23186]: cluster 2024-09-21T01:27:28.559537+0000 mgr.a (mgr.14388) 8351 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:27:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:29 smithi049 bash[23528]: cluster 2024-09-21T01:27:28.559537+0000 mgr.a (mgr.14388) 8351 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:27:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:31 smithi044 bash[22676]: audit 2024-09-21T01:27:30.074651+0000 mon.a (mon.0) 7082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:31 smithi044 bash[22676]: audit 2024-09-21T01:27:30.083599+0000 mon.a (mon.0) 7083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:31 smithi044 bash[22676]: audit 2024-09-21T01:27:30.094804+0000 mon.a (mon.0) 7084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:31 smithi044 bash[22676]: audit 2024-09-21T01:27:30.691478+0000 mon.a (mon.0) 7085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:31 smithi044 bash[22676]: audit 2024-09-21T01:27:30.698411+0000 mon.a (mon.0) 7086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:31 smithi044 bash[22676]: audit 2024-09-21T01:27:30.706334+0000 mon.a (mon.0) 7087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:31.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:31.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:31 smithi179 bash[23186]: audit 2024-09-21T01:27:30.074651+0000 mon.a (mon.0) 7082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:31 smithi179 bash[23186]: audit 2024-09-21T01:27:30.083599+0000 mon.a (mon.0) 7083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:31 smithi179 bash[23186]: audit 2024-09-21T01:27:30.094804+0000 mon.a (mon.0) 7084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:31 smithi179 bash[23186]: audit 2024-09-21T01:27:30.691478+0000 mon.a (mon.0) 7085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:31 smithi179 bash[23186]: audit 2024-09-21T01:27:30.698411+0000 mon.a (mon.0) 7086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:31 smithi179 bash[23186]: audit 2024-09-21T01:27:30.706334+0000 mon.a (mon.0) 7087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:31 smithi049 bash[23528]: audit 2024-09-21T01:27:30.074651+0000 mon.a (mon.0) 7082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:31 smithi049 bash[23528]: audit 2024-09-21T01:27:30.083599+0000 mon.a (mon.0) 7083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:31 smithi049 bash[23528]: audit 2024-09-21T01:27:30.094804+0000 mon.a (mon.0) 7084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:31 smithi049 bash[23528]: audit 2024-09-21T01:27:30.691478+0000 mon.a (mon.0) 7085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:31 smithi049 bash[23528]: audit 2024-09-21T01:27:30.698411+0000 mon.a (mon.0) 7086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:31 smithi049 bash[23528]: audit 2024-09-21T01:27:30.706334+0000 mon.a (mon.0) 7087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:32.117 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:32.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:32.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:32.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:32.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:32 smithi044 bash[22676]: cluster 2024-09-21T01:27:30.560815+0000 mgr.a (mgr.14388) 8352 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:32 smithi179 bash[23186]: cluster 2024-09-21T01:27:30.560815+0000 mgr.a (mgr.14388) 8352 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:32 smithi049 bash[23528]: cluster 2024-09-21T01:27:30.560815+0000 mgr.a (mgr.14388) 8352 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:33 smithi044 bash[22676]: audit 2024-09-21T01:27:31.699014+0000 mgr.a (mgr.14388) 8353 : audit [DBG] from='client.187194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:33 smithi179 bash[23186]: audit 2024-09-21T01:27:31.699014+0000 mgr.a (mgr.14388) 8353 : audit [DBG] from='client.187194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:33 smithi049 bash[23528]: audit 2024-09-21T01:27:31.699014+0000 mgr.a (mgr.14388) 8353 : audit [DBG] from='client.187194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:34 smithi044 bash[22676]: cluster 2024-09-21T01:27:32.561765+0000 mgr.a (mgr.14388) 8354 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:34 smithi179 bash[23186]: cluster 2024-09-21T01:27:32.561765+0000 mgr.a (mgr.14388) 8354 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:34 smithi049 bash[23528]: cluster 2024-09-21T01:27:32.561765+0000 mgr.a (mgr.14388) 8354 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:36 smithi049 bash[23528]: cluster 2024-09-21T01:27:34.562497+0000 mgr.a (mgr.14388) 8355 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:36 smithi049 bash[23528]: audit 2024-09-21T01:27:35.844738+0000 mon.a (mon.0) 7088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:36 smithi049 bash[23528]: audit 2024-09-21T01:27:35.853290+0000 mon.a (mon.0) 7089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:36 smithi049 bash[23528]: audit 2024-09-21T01:27:35.864909+0000 mon.a (mon.0) 7090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:36 smithi044 bash[22676]: cluster 2024-09-21T01:27:34.562497+0000 mgr.a (mgr.14388) 8355 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:36 smithi044 bash[22676]: audit 2024-09-21T01:27:35.844738+0000 mon.a (mon.0) 7088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:36 smithi044 bash[22676]: audit 2024-09-21T01:27:35.853290+0000 mon.a (mon.0) 7089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:36 smithi044 bash[22676]: audit 2024-09-21T01:27:35.864909+0000 mon.a (mon.0) 7090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:36 smithi179 bash[23186]: cluster 2024-09-21T01:27:34.562497+0000 mgr.a (mgr.14388) 8355 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:36 smithi179 bash[23186]: audit 2024-09-21T01:27:35.844738+0000 mon.a (mon.0) 7088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:36 smithi179 bash[23186]: audit 2024-09-21T01:27:35.853290+0000 mon.a (mon.0) 7089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:36 smithi179 bash[23186]: audit 2024-09-21T01:27:35.864909+0000 mon.a (mon.0) 7090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:37.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:37.904 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:37.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:37.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:37.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:37.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:38 smithi049 bash[23528]: cluster 2024-09-21T01:27:36.564694+0000 mgr.a (mgr.14388) 8356 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:38 smithi049 bash[23528]: audit 2024-09-21T01:27:37.458485+0000 mgr.a (mgr.14388) 8357 : audit [DBG] from='client.187269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:38 smithi044 bash[22676]: cluster 2024-09-21T01:27:36.564694+0000 mgr.a (mgr.14388) 8356 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:38 smithi044 bash[22676]: audit 2024-09-21T01:27:37.458485+0000 mgr.a (mgr.14388) 8357 : audit [DBG] from='client.187269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:38 smithi179 bash[23186]: cluster 2024-09-21T01:27:36.564694+0000 mgr.a (mgr.14388) 8356 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:38 smithi179 bash[23186]: audit 2024-09-21T01:27:37.458485+0000 mgr.a (mgr.14388) 8357 : audit [DBG] from='client.187269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:40 smithi044 bash[22676]: cluster 2024-09-21T01:27:38.565835+0000 mgr.a (mgr.14388) 8358 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:40 smithi179 bash[23186]: cluster 2024-09-21T01:27:38.565835+0000 mgr.a (mgr.14388) 8358 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:40 smithi049 bash[23528]: cluster 2024-09-21T01:27:38.565835+0000 mgr.a (mgr.14388) 8358 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:42 smithi044 bash[22676]: cluster 2024-09-21T01:27:40.568193+0000 mgr.a (mgr.14388) 8359 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:42 smithi179 bash[23186]: cluster 2024-09-21T01:27:40.568193+0000 mgr.a (mgr.14388) 8359 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:42 smithi049 bash[23528]: cluster 2024-09-21T01:27:40.568193+0000 mgr.a (mgr.14388) 8359 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:42.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:42.907 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:42.907 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:43.697 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:44 smithi044 bash[22676]: cluster 2024-09-21T01:27:42.569161+0000 mgr.a (mgr.14388) 8360 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:44 smithi044 bash[22676]: audit 2024-09-21T01:27:43.245864+0000 mgr.a (mgr.14388) 8361 : audit [DBG] from='client.187347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:44 smithi179 bash[23186]: cluster 2024-09-21T01:27:42.569161+0000 mgr.a (mgr.14388) 8360 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:44 smithi179 bash[23186]: audit 2024-09-21T01:27:43.245864+0000 mgr.a (mgr.14388) 8361 : audit [DBG] from='client.187347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:44 smithi049 bash[23528]: cluster 2024-09-21T01:27:42.569161+0000 mgr.a (mgr.14388) 8360 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:44 smithi049 bash[23528]: audit 2024-09-21T01:27:43.245864+0000 mgr.a (mgr.14388) 8361 : audit [DBG] from='client.187347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:46.418 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:46 smithi049 bash[23528]: cluster 2024-09-21T01:27:44.570208+0000 mgr.a (mgr.14388) 8362 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:46 smithi044 bash[22676]: cluster 2024-09-21T01:27:44.570208+0000 mgr.a (mgr.14388) 8362 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:46 smithi179 bash[23186]: cluster 2024-09-21T01:27:44.570208+0000 mgr.a (mgr.14388) 8362 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:48 smithi044 bash[22676]: cluster 2024-09-21T01:27:46.572433+0000 mgr.a (mgr.14388) 8363 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:48 smithi049 bash[23528]: cluster 2024-09-21T01:27:46.572433+0000 mgr.a (mgr.14388) 8363 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:48 smithi179 bash[23186]: cluster 2024-09-21T01:27:46.572433+0000 mgr.a (mgr.14388) 8363 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:48.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:48.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:48.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:49.451 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:49.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:49.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:49.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:49.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:50 smithi044 bash[22676]: cluster 2024-09-21T01:27:48.573191+0000 mgr.a (mgr.14388) 8364 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:50 smithi044 bash[22676]: audit 2024-09-21T01:27:49.038833+0000 mgr.a (mgr.14388) 8365 : audit [DBG] from='client.187422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:50 smithi179 bash[23186]: cluster 2024-09-21T01:27:48.573191+0000 mgr.a (mgr.14388) 8364 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:50 smithi179 bash[23186]: audit 2024-09-21T01:27:49.038833+0000 mgr.a (mgr.14388) 8365 : audit [DBG] from='client.187422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:50 smithi049 bash[23528]: cluster 2024-09-21T01:27:48.573191+0000 mgr.a (mgr.14388) 8364 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:50 smithi049 bash[23528]: audit 2024-09-21T01:27:49.038833+0000 mgr.a (mgr.14388) 8365 : audit [DBG] from='client.187422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:51 smithi179 bash[23186]: audit 2024-09-21T01:27:50.246373+0000 mon.a (mon.0) 7091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:51 smithi179 bash[23186]: audit 2024-09-21T01:27:50.254566+0000 mon.a (mon.0) 7092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:51 smithi179 bash[23186]: audit 2024-09-21T01:27:50.264880+0000 mon.a (mon.0) 7093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:51 smithi179 bash[23186]: audit 2024-09-21T01:27:50.880189+0000 mon.a (mon.0) 7094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:51 smithi179 bash[23186]: audit 2024-09-21T01:27:50.889641+0000 mon.a (mon.0) 7095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:51 smithi179 bash[23186]: audit 2024-09-21T01:27:50.899745+0000 mon.a (mon.0) 7096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:51 smithi044 bash[22676]: audit 2024-09-21T01:27:50.246373+0000 mon.a (mon.0) 7091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:51 smithi044 bash[22676]: audit 2024-09-21T01:27:50.254566+0000 mon.a (mon.0) 7092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:51 smithi044 bash[22676]: audit 2024-09-21T01:27:50.264880+0000 mon.a (mon.0) 7093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:51 smithi044 bash[22676]: audit 2024-09-21T01:27:50.880189+0000 mon.a (mon.0) 7094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:51 smithi044 bash[22676]: audit 2024-09-21T01:27:50.889641+0000 mon.a (mon.0) 7095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:51 smithi044 bash[22676]: audit 2024-09-21T01:27:50.899745+0000 mon.a (mon.0) 7096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:51 smithi049 bash[23528]: audit 2024-09-21T01:27:50.246373+0000 mon.a (mon.0) 7091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:51 smithi049 bash[23528]: audit 2024-09-21T01:27:50.254566+0000 mon.a (mon.0) 7092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:51 smithi049 bash[23528]: audit 2024-09-21T01:27:50.264880+0000 mon.a (mon.0) 7093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:51 smithi049 bash[23528]: audit 2024-09-21T01:27:50.880189+0000 mon.a (mon.0) 7094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:51 smithi049 bash[23528]: audit 2024-09-21T01:27:50.889641+0000 mon.a (mon.0) 7095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:51 smithi049 bash[23528]: audit 2024-09-21T01:27:50.899745+0000 mon.a (mon.0) 7096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:52 smithi049 bash[23528]: cluster 2024-09-21T01:27:50.575440+0000 mgr.a (mgr.14388) 8366 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:52.604 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:52 smithi179 bash[23186]: cluster 2024-09-21T01:27:50.575440+0000 mgr.a (mgr.14388) 8366 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:52 smithi044 bash[22676]: cluster 2024-09-21T01:27:50.575440+0000 mgr.a (mgr.14388) 8366 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:27:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:27:54.453 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:27:54.453 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:27:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:54 smithi049 bash[23528]: cluster 2024-09-21T01:27:52.576216+0000 mgr.a (mgr.14388) 8367 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:54 smithi044 bash[22676]: cluster 2024-09-21T01:27:52.576216+0000 mgr.a (mgr.14388) 8367 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:54 smithi179 bash[23186]: cluster 2024-09-21T01:27:52.576216+0000 mgr.a (mgr.14388) 8367 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:55.210 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:27:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:27:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:27:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:27:55.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:56 smithi049 bash[23528]: cluster 2024-09-21T01:27:54.576657+0000 mgr.a (mgr.14388) 8368 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:56 smithi049 bash[23528]: audit 2024-09-21T01:27:54.780818+0000 mgr.a (mgr.14388) 8369 : audit [DBG] from='client.187500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:56 smithi049 bash[23528]: audit 2024-09-21T01:27:56.081358+0000 mon.a (mon.0) 7097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:56 smithi049 bash[23528]: audit 2024-09-21T01:27:56.091353+0000 mon.a (mon.0) 7098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:56 smithi049 bash[23528]: audit 2024-09-21T01:27:56.102958+0000 mon.a (mon.0) 7099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:56 smithi044 bash[22676]: cluster 2024-09-21T01:27:54.576657+0000 mgr.a (mgr.14388) 8368 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:56 smithi044 bash[22676]: audit 2024-09-21T01:27:54.780818+0000 mgr.a (mgr.14388) 8369 : audit [DBG] from='client.187500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:56 smithi044 bash[22676]: audit 2024-09-21T01:27:56.081358+0000 mon.a (mon.0) 7097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:56 smithi044 bash[22676]: audit 2024-09-21T01:27:56.091353+0000 mon.a (mon.0) 7098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:56 smithi044 bash[22676]: audit 2024-09-21T01:27:56.102958+0000 mon.a (mon.0) 7099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:56 smithi179 bash[23186]: cluster 2024-09-21T01:27:54.576657+0000 mgr.a (mgr.14388) 8368 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:27:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:56 smithi179 bash[23186]: audit 2024-09-21T01:27:54.780818+0000 mgr.a (mgr.14388) 8369 : audit [DBG] from='client.187500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:27:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:56 smithi179 bash[23186]: audit 2024-09-21T01:27:56.081358+0000 mon.a (mon.0) 7097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:56 smithi179 bash[23186]: audit 2024-09-21T01:27:56.091353+0000 mon.a (mon.0) 7098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:56 smithi179 bash[23186]: audit 2024-09-21T01:27:56.102958+0000 mon.a (mon.0) 7099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:27:58 smithi049 bash[23528]: cluster 2024-09-21T01:27:56.579309+0000 mgr.a (mgr.14388) 8370 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:27:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:27:58 smithi044 bash[22676]: cluster 2024-09-21T01:27:56.579309+0000 mgr.a (mgr.14388) 8370 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:27:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:27:58 smithi179 bash[23186]: cluster 2024-09-21T01:27:56.579309+0000 mgr.a (mgr.14388) 8370 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:28:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:00 smithi049 bash[23528]: cluster 2024-09-21T01:27:58.580107+0000 mgr.a (mgr.14388) 8371 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:00 smithi049 bash[23528]: audit 2024-09-21T01:27:59.572315+0000 mon.a (mon.0) 7100 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:00 smithi049 bash[23528]: audit 2024-09-21T01:27:59.578639+0000 mon.a (mon.0) 7101 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:00 smithi049 bash[23528]: audit 2024-09-21T01:27:59.580938+0000 mon.a (mon.0) 7102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:00 smithi049 bash[23528]: audit 2024-09-21T01:27:59.592964+0000 mon.a (mon.0) 7103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:00 smithi049 bash[23528]: audit 2024-09-21T01:27:59.599965+0000 mon.a (mon.0) 7104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:28:00.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22930]: debug 2024-09-21T01:28:00.384+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:28:00.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22930]: debug 2024-09-21T01:28:00.384+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:28:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22676]: cluster 2024-09-21T01:27:58.580107+0000 mgr.a (mgr.14388) 8371 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:28:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22676]: audit 2024-09-21T01:27:59.572315+0000 mon.a (mon.0) 7100 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:28:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22676]: audit 2024-09-21T01:27:59.578639+0000 mon.a (mon.0) 7101 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:28:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22676]: audit 2024-09-21T01:27:59.580938+0000 mon.a (mon.0) 7102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:28:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22676]: audit 2024-09-21T01:27:59.592964+0000 mon.a (mon.0) 7103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:00 smithi044 bash[22676]: audit 2024-09-21T01:27:59.599965+0000 mon.a (mon.0) 7104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:28:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:00 smithi179 bash[23186]: cluster 2024-09-21T01:27:58.580107+0000 mgr.a (mgr.14388) 8371 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:28:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:00 smithi179 bash[23186]: audit 2024-09-21T01:27:59.572315+0000 mon.a (mon.0) 7100 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:28:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:00 smithi179 bash[23186]: audit 2024-09-21T01:27:59.578639+0000 mon.a (mon.0) 7101 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:28:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:00 smithi179 bash[23186]: audit 2024-09-21T01:27:59.580938+0000 mon.a (mon.0) 7102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:28:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:00 smithi179 bash[23186]: audit 2024-09-21T01:27:59.592964+0000 mon.a (mon.0) 7103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:00 smithi179 bash[23186]: audit 2024-09-21T01:27:59.599965+0000 mon.a (mon.0) 7104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:28:00.965 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:00.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:00.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:00.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:00.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:01 smithi049 bash[23528]: audit 2024-09-21T01:27:59.602391+0000 mgr.a (mgr.14388) 8372 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:28:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:01 smithi049 bash[23528]: audit 2024-09-21T01:28:00.386505+0000 mgr.a (mgr.14388) 8373 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:28:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:01 smithi049 bash[23528]: cephadm 2024-09-21T01:28:00.387892+0000 mgr.a (mgr.14388) 8374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:28:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:01 smithi044 bash[22676]: audit 2024-09-21T01:27:59.602391+0000 mgr.a (mgr.14388) 8372 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:28:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:01 smithi044 bash[22676]: audit 2024-09-21T01:28:00.386505+0000 mgr.a (mgr.14388) 8373 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:28:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:01 smithi044 bash[22676]: cephadm 2024-09-21T01:28:00.387892+0000 mgr.a (mgr.14388) 8374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:28:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:01 smithi179 bash[23186]: audit 2024-09-21T01:27:59.602391+0000 mgr.a (mgr.14388) 8372 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:28:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:01 smithi179 bash[23186]: audit 2024-09-21T01:28:00.386505+0000 mgr.a (mgr.14388) 8373 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:28:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:01 smithi179 bash[23186]: cephadm 2024-09-21T01:28:00.387892+0000 mgr.a (mgr.14388) 8374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:28:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:02 smithi049 bash[23528]: audit 2024-09-21T01:28:00.539237+0000 mgr.a (mgr.14388) 8375 : audit [DBG] from='client.187683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:02 smithi049 bash[23528]: cluster 2024-09-21T01:28:00.582500+0000 mgr.a (mgr.14388) 8376 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:28:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:02 smithi044 bash[22676]: audit 2024-09-21T01:28:00.539237+0000 mgr.a (mgr.14388) 8375 : audit [DBG] from='client.187683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:02 smithi044 bash[22676]: cluster 2024-09-21T01:28:00.582500+0000 mgr.a (mgr.14388) 8376 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:28:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:02 smithi179 bash[23186]: audit 2024-09-21T01:28:00.539237+0000 mgr.a (mgr.14388) 8375 : audit [DBG] from='client.187683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:02 smithi179 bash[23186]: cluster 2024-09-21T01:28:00.582500+0000 mgr.a (mgr.14388) 8376 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:28:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:04 smithi044 bash[22676]: cluster 2024-09-21T01:28:02.583407+0000 mgr.a (mgr.14388) 8377 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:28:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:04 smithi179 bash[23186]: cluster 2024-09-21T01:28:02.583407+0000 mgr.a (mgr.14388) 8377 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:28:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:04 smithi049 bash[23528]: cluster 2024-09-21T01:28:02.583407+0000 mgr.a (mgr.14388) 8377 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:28:05.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:05.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:05.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:06.596 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:06 smithi049 bash[23528]: cluster 2024-09-21T01:28:04.584467+0000 mgr.a (mgr.14388) 8378 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:28:06.710 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:06.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:06 smithi044 bash[22676]: cluster 2024-09-21T01:28:04.584467+0000 mgr.a (mgr.14388) 8378 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:28:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:06 smithi179 bash[23186]: cluster 2024-09-21T01:28:04.584467+0000 mgr.a (mgr.14388) 8378 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:28:07.637 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:07 smithi179 bash[23186]: audit 2024-09-21T01:28:06.294289+0000 mgr.a (mgr.14388) 8379 : audit [DBG] from='client.187761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:07 smithi044 bash[22676]: audit 2024-09-21T01:28:06.294289+0000 mgr.a (mgr.14388) 8379 : audit [DBG] from='client.187761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:07 smithi049 bash[23528]: audit 2024-09-21T01:28:06.294289+0000 mgr.a (mgr.14388) 8379 : audit [DBG] from='client.187761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:08 smithi179 bash[23186]: cluster 2024-09-21T01:28:06.585898+0000 mgr.a (mgr.14388) 8380 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:28:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:08 smithi044 bash[22676]: cluster 2024-09-21T01:28:06.585898+0000 mgr.a (mgr.14388) 8380 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:28:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:08 smithi049 bash[23528]: cluster 2024-09-21T01:28:06.585898+0000 mgr.a (mgr.14388) 8380 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:28:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:10 smithi044 bash[22676]: cluster 2024-09-21T01:28:08.586746+0000 mgr.a (mgr.14388) 8381 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:28:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:10 smithi179 bash[23186]: cluster 2024-09-21T01:28:08.586746+0000 mgr.a (mgr.14388) 8381 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:28:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:10 smithi049 bash[23528]: cluster 2024-09-21T01:28:08.586746+0000 mgr.a (mgr.14388) 8381 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:28:11.699 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:11 smithi044 bash[22676]: audit 2024-09-21T01:28:10.438550+0000 mon.a (mon.0) 7105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:11 smithi044 bash[22676]: audit 2024-09-21T01:28:10.447149+0000 mon.a (mon.0) 7106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:11 smithi044 bash[22676]: audit 2024-09-21T01:28:10.457659+0000 mon.a (mon.0) 7107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:11 smithi044 bash[22676]: audit 2024-09-21T01:28:11.039504+0000 mon.a (mon.0) 7108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:11 smithi044 bash[22676]: audit 2024-09-21T01:28:11.045267+0000 mon.a (mon.0) 7109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:11 smithi044 bash[22676]: audit 2024-09-21T01:28:11.050835+0000 mon.a (mon.0) 7110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:11.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:11 smithi179 bash[23186]: audit 2024-09-21T01:28:10.438550+0000 mon.a (mon.0) 7105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:11 smithi179 bash[23186]: audit 2024-09-21T01:28:10.447149+0000 mon.a (mon.0) 7106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:11 smithi179 bash[23186]: audit 2024-09-21T01:28:10.457659+0000 mon.a (mon.0) 7107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:11 smithi179 bash[23186]: audit 2024-09-21T01:28:11.039504+0000 mon.a (mon.0) 7108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:11 smithi179 bash[23186]: audit 2024-09-21T01:28:11.045267+0000 mon.a (mon.0) 7109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:11 smithi179 bash[23186]: audit 2024-09-21T01:28:11.050835+0000 mon.a (mon.0) 7110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:11 smithi049 bash[23528]: audit 2024-09-21T01:28:10.438550+0000 mon.a (mon.0) 7105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:11 smithi049 bash[23528]: audit 2024-09-21T01:28:10.447149+0000 mon.a (mon.0) 7106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:11 smithi049 bash[23528]: audit 2024-09-21T01:28:10.457659+0000 mon.a (mon.0) 7107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:11 smithi049 bash[23528]: audit 2024-09-21T01:28:11.039504+0000 mon.a (mon.0) 7108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:11 smithi049 bash[23528]: audit 2024-09-21T01:28:11.045267+0000 mon.a (mon.0) 7109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:11 smithi049 bash[23528]: audit 2024-09-21T01:28:11.050835+0000 mon.a (mon.0) 7110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:12.504 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:12.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:12.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:12.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:12.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:12 smithi044 bash[22676]: cluster 2024-09-21T01:28:10.588509+0000 mgr.a (mgr.14388) 8382 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:28:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:12 smithi179 bash[23186]: cluster 2024-09-21T01:28:10.588509+0000 mgr.a (mgr.14388) 8382 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:28:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:12 smithi049 bash[23528]: cluster 2024-09-21T01:28:10.588509+0000 mgr.a (mgr.14388) 8382 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:28:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:13 smithi044 bash[22676]: audit 2024-09-21T01:28:12.047294+0000 mgr.a (mgr.14388) 8383 : audit [DBG] from='client.187839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:13 smithi179 bash[23186]: audit 2024-09-21T01:28:12.047294+0000 mgr.a (mgr.14388) 8383 : audit [DBG] from='client.187839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:13 smithi049 bash[23528]: audit 2024-09-21T01:28:12.047294+0000 mgr.a (mgr.14388) 8383 : audit [DBG] from='client.187839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:14 smithi044 bash[22676]: cluster 2024-09-21T01:28:12.589653+0000 mgr.a (mgr.14388) 8384 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:28:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:14 smithi179 bash[23186]: cluster 2024-09-21T01:28:12.589653+0000 mgr.a (mgr.14388) 8384 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:28:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:14 smithi049 bash[23528]: cluster 2024-09-21T01:28:12.589653+0000 mgr.a (mgr.14388) 8384 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:16 smithi044 bash[22676]: cluster 2024-09-21T01:28:14.590642+0000 mgr.a (mgr.14388) 8385 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:16 smithi044 bash[22676]: audit 2024-09-21T01:28:16.290760+0000 mon.a (mon.0) 7111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:16 smithi044 bash[22676]: audit 2024-09-21T01:28:16.299496+0000 mon.a (mon.0) 7112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:16 smithi044 bash[22676]: audit 2024-09-21T01:28:16.310521+0000 mon.a (mon.0) 7113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:16 smithi179 bash[23186]: cluster 2024-09-21T01:28:14.590642+0000 mgr.a (mgr.14388) 8385 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:28:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:16 smithi179 bash[23186]: audit 2024-09-21T01:28:16.290760+0000 mon.a (mon.0) 7111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:16 smithi179 bash[23186]: audit 2024-09-21T01:28:16.299496+0000 mon.a (mon.0) 7112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:16 smithi179 bash[23186]: audit 2024-09-21T01:28:16.310521+0000 mon.a (mon.0) 7113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:16 smithi049 bash[23528]: cluster 2024-09-21T01:28:14.590642+0000 mgr.a (mgr.14388) 8385 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:16 smithi049 bash[23528]: audit 2024-09-21T01:28:16.290760+0000 mon.a (mon.0) 7111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:16 smithi049 bash[23528]: audit 2024-09-21T01:28:16.299496+0000 mon.a (mon.0) 7112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:16 smithi049 bash[23528]: audit 2024-09-21T01:28:16.310521+0000 mon.a (mon.0) 7113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:17.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:17.507 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:17.507 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:18.299 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:18.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:18 smithi044 bash[22676]: cluster 2024-09-21T01:28:16.592867+0000 mgr.a (mgr.14388) 8386 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:28:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:18 smithi179 bash[23186]: cluster 2024-09-21T01:28:16.592867+0000 mgr.a (mgr.14388) 8386 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:28:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:18 smithi049 bash[23528]: cluster 2024-09-21T01:28:16.592867+0000 mgr.a (mgr.14388) 8386 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:28:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:19 smithi049 bash[23528]: audit 2024-09-21T01:28:17.845454+0000 mgr.a (mgr.14388) 8387 : audit [DBG] from='client.187914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:19 smithi044 bash[22676]: audit 2024-09-21T01:28:17.845454+0000 mgr.a (mgr.14388) 8387 : audit [DBG] from='client.187914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:19 smithi179 bash[23186]: audit 2024-09-21T01:28:17.845454+0000 mgr.a (mgr.14388) 8387 : audit [DBG] from='client.187914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:20 smithi179 bash[23186]: cluster 2024-09-21T01:28:18.594060+0000 mgr.a (mgr.14388) 8388 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:20 smithi049 bash[23528]: cluster 2024-09-21T01:28:18.594060+0000 mgr.a (mgr.14388) 8388 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:20 smithi044 bash[22676]: cluster 2024-09-21T01:28:18.594060+0000 mgr.a (mgr.14388) 8388 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:21 smithi049 bash[23528]: cluster 2024-09-21T01:28:20.596260+0000 mgr.a (mgr.14388) 8389 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:21 smithi044 bash[22676]: cluster 2024-09-21T01:28:20.596260+0000 mgr.a (mgr.14388) 8389 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:21 smithi179 bash[23186]: cluster 2024-09-21T01:28:20.596260+0000 mgr.a (mgr.14388) 8389 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:23.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:23.302 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:23 smithi044 bash[22676]: cluster 2024-09-21T01:28:22.597188+0000 mgr.a (mgr.14388) 8390 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:23 smithi179 bash[23186]: cluster 2024-09-21T01:28:22.597188+0000 mgr.a (mgr.14388) 8390 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:23 smithi049 bash[23528]: cluster 2024-09-21T01:28:22.597188+0000 mgr.a (mgr.14388) 8390 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:24.053 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:24.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:24.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:24.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:24.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:24 smithi044 bash[22676]: audit 2024-09-21T01:28:23.636413+0000 mgr.a (mgr.14388) 8391 : audit [DBG] from='client.187986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:24 smithi179 bash[23186]: audit 2024-09-21T01:28:23.636413+0000 mgr.a (mgr.14388) 8391 : audit [DBG] from='client.187986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:24 smithi049 bash[23528]: audit 2024-09-21T01:28:23.636413+0000 mgr.a (mgr.14388) 8391 : audit [DBG] from='client.187986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:25 smithi044 bash[22676]: cluster 2024-09-21T01:28:24.598188+0000 mgr.a (mgr.14388) 8392 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:25 smithi179 bash[23186]: cluster 2024-09-21T01:28:24.598188+0000 mgr.a (mgr.14388) 8392 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:25 smithi049 bash[23528]: cluster 2024-09-21T01:28:24.598188+0000 mgr.a (mgr.14388) 8392 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:27 smithi179 bash[23186]: cluster 2024-09-21T01:28:26.600491+0000 mgr.a (mgr.14388) 8393 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:27 smithi044 bash[22676]: cluster 2024-09-21T01:28:26.600491+0000 mgr.a (mgr.14388) 8393 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:27 smithi049 bash[23528]: cluster 2024-09-21T01:28:26.600491+0000 mgr.a (mgr.14388) 8393 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:29.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:29.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:29.056 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:29.775 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:29 smithi044 bash[22676]: cluster 2024-09-21T01:28:28.601268+0000 mgr.a (mgr.14388) 8394 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:29.776 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:29 smithi044 bash[22676]: audit 2024-09-21T01:28:29.393718+0000 mgr.a (mgr.14388) 8395 : audit [DBG] from='client.188064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:29.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:29 smithi049 bash[23528]: cluster 2024-09-21T01:28:28.601268+0000 mgr.a (mgr.14388) 8394 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:29 smithi049 bash[23528]: audit 2024-09-21T01:28:29.393718+0000 mgr.a (mgr.14388) 8395 : audit [DBG] from='client.188064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:30.096 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:29 smithi179 bash[23186]: cluster 2024-09-21T01:28:28.601268+0000 mgr.a (mgr.14388) 8394 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:30.096 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:29 smithi179 bash[23186]: audit 2024-09-21T01:28:29.393718+0000 mgr.a (mgr.14388) 8395 : audit [DBG] from='client.188064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:31 smithi044 bash[22676]: cluster 2024-09-21T01:28:30.603553+0000 mgr.a (mgr.14388) 8396 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:31 smithi044 bash[22676]: audit 2024-09-21T01:28:30.658553+0000 mon.a (mon.0) 7114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:31 smithi044 bash[22676]: audit 2024-09-21T01:28:30.667273+0000 mon.a (mon.0) 7115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:31 smithi044 bash[22676]: audit 2024-09-21T01:28:30.677813+0000 mon.a (mon.0) 7116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:31 smithi044 bash[22676]: audit 2024-09-21T01:28:31.204628+0000 mon.a (mon.0) 7117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:31 smithi044 bash[22676]: audit 2024-09-21T01:28:31.209989+0000 mon.a (mon.0) 7118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:31 smithi044 bash[22676]: audit 2024-09-21T01:28:31.214975+0000 mon.a (mon.0) 7119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:31 smithi179 bash[23186]: cluster 2024-09-21T01:28:30.603553+0000 mgr.a (mgr.14388) 8396 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:31 smithi179 bash[23186]: audit 2024-09-21T01:28:30.658553+0000 mon.a (mon.0) 7114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:31 smithi179 bash[23186]: audit 2024-09-21T01:28:30.667273+0000 mon.a (mon.0) 7115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:31 smithi179 bash[23186]: audit 2024-09-21T01:28:30.677813+0000 mon.a (mon.0) 7116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:31 smithi179 bash[23186]: audit 2024-09-21T01:28:31.204628+0000 mon.a (mon.0) 7117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:31 smithi179 bash[23186]: audit 2024-09-21T01:28:31.209989+0000 mon.a (mon.0) 7118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:31 smithi179 bash[23186]: audit 2024-09-21T01:28:31.214975+0000 mon.a (mon.0) 7119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:31 smithi049 bash[23528]: cluster 2024-09-21T01:28:30.603553+0000 mgr.a (mgr.14388) 8396 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:31 smithi049 bash[23528]: audit 2024-09-21T01:28:30.658553+0000 mon.a (mon.0) 7114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:31 smithi049 bash[23528]: audit 2024-09-21T01:28:30.667273+0000 mon.a (mon.0) 7115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:31 smithi049 bash[23528]: audit 2024-09-21T01:28:30.677813+0000 mon.a (mon.0) 7116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:31 smithi049 bash[23528]: audit 2024-09-21T01:28:31.204628+0000 mon.a (mon.0) 7117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:31 smithi049 bash[23528]: audit 2024-09-21T01:28:31.209989+0000 mon.a (mon.0) 7118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:31 smithi049 bash[23528]: audit 2024-09-21T01:28:31.214975+0000 mon.a (mon.0) 7119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:33 smithi044 bash[22676]: cluster 2024-09-21T01:28:32.604383+0000 mgr.a (mgr.14388) 8397 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:33 smithi179 bash[23186]: cluster 2024-09-21T01:28:32.604383+0000 mgr.a (mgr.14388) 8397 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:33 smithi049 bash[23528]: cluster 2024-09-21T01:28:32.604383+0000 mgr.a (mgr.14388) 8397 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:34.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:34.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:35.621 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:35.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:35.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:35.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:35.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:35 smithi044 bash[22676]: cluster 2024-09-21T01:28:34.605152+0000 mgr.a (mgr.14388) 8398 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:35 smithi044 bash[22676]: audit 2024-09-21T01:28:35.185218+0000 mgr.a (mgr.14388) 8399 : audit [DBG] from='client.188133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:35 smithi179 bash[23186]: cluster 2024-09-21T01:28:34.605152+0000 mgr.a (mgr.14388) 8398 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:35 smithi179 bash[23186]: audit 2024-09-21T01:28:35.185218+0000 mgr.a (mgr.14388) 8399 : audit [DBG] from='client.188133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:35 smithi049 bash[23528]: cluster 2024-09-21T01:28:34.605152+0000 mgr.a (mgr.14388) 8398 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:35 smithi049 bash[23528]: audit 2024-09-21T01:28:35.185218+0000 mgr.a (mgr.14388) 8399 : audit [DBG] from='client.188133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:37 smithi049 bash[23528]: audit 2024-09-21T01:28:36.527066+0000 mon.a (mon.0) 7120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:37 smithi049 bash[23528]: audit 2024-09-21T01:28:36.535859+0000 mon.a (mon.0) 7121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:37 smithi049 bash[23528]: audit 2024-09-21T01:28:36.546418+0000 mon.a (mon.0) 7122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:37 smithi049 bash[23528]: cluster 2024-09-21T01:28:36.607894+0000 mgr.a (mgr.14388) 8400 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:37 smithi044 bash[22676]: audit 2024-09-21T01:28:36.527066+0000 mon.a (mon.0) 7120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:37 smithi044 bash[22676]: audit 2024-09-21T01:28:36.535859+0000 mon.a (mon.0) 7121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:37 smithi044 bash[22676]: audit 2024-09-21T01:28:36.546418+0000 mon.a (mon.0) 7122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:37 smithi044 bash[22676]: cluster 2024-09-21T01:28:36.607894+0000 mgr.a (mgr.14388) 8400 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:37 smithi179 bash[23186]: audit 2024-09-21T01:28:36.527066+0000 mon.a (mon.0) 7120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:37 smithi179 bash[23186]: audit 2024-09-21T01:28:36.535859+0000 mon.a (mon.0) 7121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:37 smithi179 bash[23186]: audit 2024-09-21T01:28:36.546418+0000 mon.a (mon.0) 7122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:37 smithi179 bash[23186]: cluster 2024-09-21T01:28:36.607894+0000 mgr.a (mgr.14388) 8400 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:39 smithi044 bash[22676]: cluster 2024-09-21T01:28:38.608705+0000 mgr.a (mgr.14388) 8401 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:28:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:39 smithi179 bash[23186]: cluster 2024-09-21T01:28:38.608705+0000 mgr.a (mgr.14388) 8401 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:28:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:39 smithi049 bash[23528]: cluster 2024-09-21T01:28:38.608705+0000 mgr.a (mgr.14388) 8401 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:28:40.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:40.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:40.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:41.424 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:41.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:41.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:41.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:41.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:41 smithi044 bash[22676]: cluster 2024-09-21T01:28:40.610820+0000 mgr.a (mgr.14388) 8402 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:41 smithi044 bash[22676]: audit 2024-09-21T01:28:40.964715+0000 mgr.a (mgr.14388) 8403 : audit [DBG] from='client.188211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:41 smithi179 bash[23186]: cluster 2024-09-21T01:28:40.610820+0000 mgr.a (mgr.14388) 8402 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:41 smithi179 bash[23186]: audit 2024-09-21T01:28:40.964715+0000 mgr.a (mgr.14388) 8403 : audit [DBG] from='client.188211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:41 smithi049 bash[23528]: cluster 2024-09-21T01:28:40.610820+0000 mgr.a (mgr.14388) 8402 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:41 smithi049 bash[23528]: audit 2024-09-21T01:28:40.964715+0000 mgr.a (mgr.14388) 8403 : audit [DBG] from='client.188211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:43 smithi044 bash[22676]: cluster 2024-09-21T01:28:42.611774+0000 mgr.a (mgr.14388) 8404 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:28:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:43 smithi179 bash[23186]: cluster 2024-09-21T01:28:42.611774+0000 mgr.a (mgr.14388) 8404 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:28:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:43 smithi049 bash[23528]: cluster 2024-09-21T01:28:42.611774+0000 mgr.a (mgr.14388) 8404 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:28:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:45 smithi044 bash[22676]: cluster 2024-09-21T01:28:44.612555+0000 mgr.a (mgr.14388) 8405 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:28:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:45 smithi179 bash[23186]: cluster 2024-09-21T01:28:44.612555+0000 mgr.a (mgr.14388) 8405 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:28:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:45 smithi049 bash[23528]: cluster 2024-09-21T01:28:44.612555+0000 mgr.a (mgr.14388) 8405 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:28:46.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:46.427 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:46.427 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:47.163 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:47.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:47.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:47.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:47.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:47.967 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:47 smithi179 bash[23186]: cluster 2024-09-21T01:28:46.614688+0000 mgr.a (mgr.14388) 8406 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:47.967 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:47 smithi179 bash[23186]: audit 2024-09-21T01:28:46.747559+0000 mgr.a (mgr.14388) 8407 : audit [DBG] from='client.188283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:47 smithi044 bash[22676]: cluster 2024-09-21T01:28:46.614688+0000 mgr.a (mgr.14388) 8406 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:47 smithi044 bash[22676]: audit 2024-09-21T01:28:46.747559+0000 mgr.a (mgr.14388) 8407 : audit [DBG] from='client.188283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:47 smithi049 bash[23528]: cluster 2024-09-21T01:28:46.614688+0000 mgr.a (mgr.14388) 8406 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:47 smithi049 bash[23528]: audit 2024-09-21T01:28:46.747559+0000 mgr.a (mgr.14388) 8407 : audit [DBG] from='client.188283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:49 smithi044 bash[22676]: cluster 2024-09-21T01:28:48.615586+0000 mgr.a (mgr.14388) 8408 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:49.999 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:49 smithi049 bash[23528]: cluster 2024-09-21T01:28:48.615586+0000 mgr.a (mgr.14388) 8408 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:49 smithi179 bash[23186]: cluster 2024-09-21T01:28:48.615586+0000 mgr.a (mgr.14388) 8408 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:52.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:52.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:52.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:51 smithi044 bash[22676]: cluster 2024-09-21T01:28:50.617866+0000 mgr.a (mgr.14388) 8409 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:51 smithi044 bash[22676]: audit 2024-09-21T01:28:50.864456+0000 mon.a (mon.0) 7123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:51 smithi044 bash[22676]: audit 2024-09-21T01:28:50.873563+0000 mon.a (mon.0) 7124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:51 smithi044 bash[22676]: audit 2024-09-21T01:28:50.885123+0000 mon.a (mon.0) 7125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:51 smithi044 bash[22676]: audit 2024-09-21T01:28:51.404075+0000 mon.a (mon.0) 7126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:51 smithi044 bash[22676]: audit 2024-09-21T01:28:51.412714+0000 mon.a (mon.0) 7127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:51 smithi044 bash[22676]: audit 2024-09-21T01:28:51.423072+0000 mon.a (mon.0) 7128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:51 smithi179 bash[23186]: cluster 2024-09-21T01:28:50.617866+0000 mgr.a (mgr.14388) 8409 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:51 smithi179 bash[23186]: audit 2024-09-21T01:28:50.864456+0000 mon.a (mon.0) 7123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:51 smithi179 bash[23186]: audit 2024-09-21T01:28:50.873563+0000 mon.a (mon.0) 7124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:51 smithi179 bash[23186]: audit 2024-09-21T01:28:50.885123+0000 mon.a (mon.0) 7125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:51 smithi179 bash[23186]: audit 2024-09-21T01:28:51.404075+0000 mon.a (mon.0) 7126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:51 smithi179 bash[23186]: audit 2024-09-21T01:28:51.412714+0000 mon.a (mon.0) 7127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:51 smithi179 bash[23186]: audit 2024-09-21T01:28:51.423072+0000 mon.a (mon.0) 7128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:51 smithi049 bash[23528]: cluster 2024-09-21T01:28:50.617866+0000 mgr.a (mgr.14388) 8409 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:51 smithi049 bash[23528]: audit 2024-09-21T01:28:50.864456+0000 mon.a (mon.0) 7123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:51 smithi049 bash[23528]: audit 2024-09-21T01:28:50.873563+0000 mon.a (mon.0) 7124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:51 smithi049 bash[23528]: audit 2024-09-21T01:28:50.885123+0000 mon.a (mon.0) 7125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:51 smithi049 bash[23528]: audit 2024-09-21T01:28:51.404075+0000 mon.a (mon.0) 7126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:51 smithi049 bash[23528]: audit 2024-09-21T01:28:51.412714+0000 mon.a (mon.0) 7127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:51 smithi049 bash[23528]: audit 2024-09-21T01:28:51.423072+0000 mon.a (mon.0) 7128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:52.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:52.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:52.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:52.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:52.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:52 smithi044 bash[22676]: audit 2024-09-21T01:28:52.490007+0000 mgr.a (mgr.14388) 8410 : audit [DBG] from='client.188358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:52 smithi179 bash[23186]: audit 2024-09-21T01:28:52.490007+0000 mgr.a (mgr.14388) 8410 : audit [DBG] from='client.188358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:52 smithi049 bash[23528]: audit 2024-09-21T01:28:52.490007+0000 mgr.a (mgr.14388) 8410 : audit [DBG] from='client.188358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:54.142 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:53 smithi044 bash[22676]: cluster 2024-09-21T01:28:52.622177+0000 mgr.a (mgr.14388) 8411 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:53 smithi179 bash[23186]: cluster 2024-09-21T01:28:52.622177+0000 mgr.a (mgr.14388) 8411 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:53 smithi049 bash[23528]: cluster 2024-09-21T01:28:52.622177+0000 mgr.a (mgr.14388) 8411 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:55 smithi044 bash[22676]: cluster 2024-09-21T01:28:54.623149+0000 mgr.a (mgr.14388) 8412 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:55 smithi179 bash[23186]: cluster 2024-09-21T01:28:54.623149+0000 mgr.a (mgr.14388) 8412 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:55 smithi049 bash[23528]: cluster 2024-09-21T01:28:54.623149+0000 mgr.a (mgr.14388) 8412 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:28:57.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:28:57.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:28:57.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:28:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:57 smithi049 bash[23528]: cluster 2024-09-21T01:28:56.625478+0000 mgr.a (mgr.14388) 8413 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:57 smithi049 bash[23528]: audit 2024-09-21T01:28:56.762737+0000 mon.a (mon.0) 7129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:57 smithi049 bash[23528]: audit 2024-09-21T01:28:56.771992+0000 mon.a (mon.0) 7130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:57 smithi049 bash[23528]: audit 2024-09-21T01:28:56.783155+0000 mon.a (mon.0) 7131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:57 smithi044 bash[22676]: cluster 2024-09-21T01:28:56.625478+0000 mgr.a (mgr.14388) 8413 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:57 smithi044 bash[22676]: audit 2024-09-21T01:28:56.762737+0000 mon.a (mon.0) 7129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:57 smithi044 bash[22676]: audit 2024-09-21T01:28:56.771992+0000 mon.a (mon.0) 7130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:57 smithi044 bash[22676]: audit 2024-09-21T01:28:56.783155+0000 mon.a (mon.0) 7131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:57 smithi179 bash[23186]: cluster 2024-09-21T01:28:56.625478+0000 mgr.a (mgr.14388) 8413 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:28:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:57 smithi179 bash[23186]: audit 2024-09-21T01:28:56.762737+0000 mon.a (mon.0) 7129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:57 smithi179 bash[23186]: audit 2024-09-21T01:28:56.771992+0000 mon.a (mon.0) 7130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:57 smithi179 bash[23186]: audit 2024-09-21T01:28:56.783155+0000 mon.a (mon.0) 7131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:28:58.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:28:58.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:28:58.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:28:58.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:28:58.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:28:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:58 smithi049 bash[23528]: audit 2024-09-21T01:28:58.253183+0000 mgr.a (mgr.14388) 8414 : audit [DBG] from='client.188430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:58 smithi044 bash[22676]: audit 2024-09-21T01:28:58.253183+0000 mgr.a (mgr.14388) 8414 : audit [DBG] from='client.188430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:28:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:58 smithi179 bash[23186]: audit 2024-09-21T01:28:58.253183+0000 mgr.a (mgr.14388) 8414 : audit [DBG] from='client.188430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:28:59 smithi049 bash[23528]: cluster 2024-09-21T01:28:58.626018+0000 mgr.a (mgr.14388) 8415 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:28:59 smithi044 bash[22676]: cluster 2024-09-21T01:28:58.626018+0000 mgr.a (mgr.14388) 8415 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:28:59 smithi179 bash[23186]: cluster 2024-09-21T01:28:58.626018+0000 mgr.a (mgr.14388) 8415 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:00 smithi049 bash[23528]: audit 2024-09-21T01:29:00.452747+0000 mon.a (mon.0) 7132 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:29:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:00 smithi049 bash[23528]: audit 2024-09-21T01:29:00.464226+0000 mon.a (mon.0) 7133 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:29:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:00 smithi049 bash[23528]: audit 2024-09-21T01:29:00.466260+0000 mon.a (mon.0) 7134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:29:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:00 smithi049 bash[23528]: audit 2024-09-21T01:29:00.478237+0000 mon.a (mon.0) 7135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:00 smithi049 bash[23528]: audit 2024-09-21T01:29:00.484824+0000 mon.a (mon.0) 7136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:29:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:00 smithi049 bash[23528]: audit 2024-09-21T01:29:00.487269+0000 mgr.a (mgr.14388) 8416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:29:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:00 smithi044 bash[22676]: audit 2024-09-21T01:29:00.452747+0000 mon.a (mon.0) 7132 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:29:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:00 smithi044 bash[22676]: audit 2024-09-21T01:29:00.464226+0000 mon.a (mon.0) 7133 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:29:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:00 smithi044 bash[22676]: audit 2024-09-21T01:29:00.466260+0000 mon.a (mon.0) 7134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:29:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:00 smithi044 bash[22676]: audit 2024-09-21T01:29:00.478237+0000 mon.a (mon.0) 7135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:00 smithi044 bash[22676]: audit 2024-09-21T01:29:00.484824+0000 mon.a (mon.0) 7136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:29:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:00 smithi044 bash[22676]: audit 2024-09-21T01:29:00.487269+0000 mgr.a (mgr.14388) 8416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:29:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:00 smithi179 bash[23186]: audit 2024-09-21T01:29:00.452747+0000 mon.a (mon.0) 7132 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:29:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:00 smithi179 bash[23186]: audit 2024-09-21T01:29:00.464226+0000 mon.a (mon.0) 7133 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:29:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:00 smithi179 bash[23186]: audit 2024-09-21T01:29:00.466260+0000 mon.a (mon.0) 7134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:29:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:00 smithi179 bash[23186]: audit 2024-09-21T01:29:00.478237+0000 mon.a (mon.0) 7135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:00 smithi179 bash[23186]: audit 2024-09-21T01:29:00.484824+0000 mon.a (mon.0) 7136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:29:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:00 smithi179 bash[23186]: audit 2024-09-21T01:29:00.487269+0000 mgr.a (mgr.14388) 8416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:29:01.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:29:01 smithi044 bash[22930]: debug 2024-09-21T01:29:01.251+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:29:01.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:29:01 smithi044 bash[22930]: debug 2024-09-21T01:29:01.255+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:29:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:02 smithi044 bash[22676]: cluster 2024-09-21T01:29:00.628020+0000 mgr.a (mgr.14388) 8417 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:02 smithi044 bash[22676]: audit 2024-09-21T01:29:01.256614+0000 mgr.a (mgr.14388) 8418 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:29:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:02 smithi044 bash[22676]: cephadm 2024-09-21T01:29:01.258024+0000 mgr.a (mgr.14388) 8419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:29:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:02 smithi179 bash[23186]: cluster 2024-09-21T01:29:00.628020+0000 mgr.a (mgr.14388) 8417 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:02 smithi179 bash[23186]: audit 2024-09-21T01:29:01.256614+0000 mgr.a (mgr.14388) 8418 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:29:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:02 smithi179 bash[23186]: cephadm 2024-09-21T01:29:01.258024+0000 mgr.a (mgr.14388) 8419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:29:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:02 smithi049 bash[23528]: cluster 2024-09-21T01:29:00.628020+0000 mgr.a (mgr.14388) 8417 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:02 smithi049 bash[23528]: audit 2024-09-21T01:29:01.256614+0000 mgr.a (mgr.14388) 8418 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:29:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:02 smithi049 bash[23528]: cephadm 2024-09-21T01:29:01.258024+0000 mgr.a (mgr.14388) 8419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:29:03.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:03.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:03.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:04.454 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:04 smithi044 bash[22676]: cluster 2024-09-21T01:29:02.628958+0000 mgr.a (mgr.14388) 8420 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:04 smithi179 bash[23186]: cluster 2024-09-21T01:29:02.628958+0000 mgr.a (mgr.14388) 8420 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:04 smithi049 bash[23528]: cluster 2024-09-21T01:29:02.628958+0000 mgr.a (mgr.14388) 8420 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:05 smithi179 bash[23186]: audit 2024-09-21T01:29:04.012006+0000 mgr.a (mgr.14388) 8421 : audit [DBG] from='client.188613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:05 smithi049 bash[23528]: audit 2024-09-21T01:29:04.012006+0000 mgr.a (mgr.14388) 8421 : audit [DBG] from='client.188613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:05 smithi044 bash[22676]: audit 2024-09-21T01:29:04.012006+0000 mgr.a (mgr.14388) 8421 : audit [DBG] from='client.188613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:06 smithi179 bash[23186]: cluster 2024-09-21T01:29:04.629957+0000 mgr.a (mgr.14388) 8422 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:06 smithi049 bash[23528]: cluster 2024-09-21T01:29:04.629957+0000 mgr.a (mgr.14388) 8422 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:06 smithi044 bash[22676]: cluster 2024-09-21T01:29:04.629957+0000 mgr.a (mgr.14388) 8422 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:08 smithi179 bash[23186]: cluster 2024-09-21T01:29:06.632223+0000 mgr.a (mgr.14388) 8423 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:08 smithi049 bash[23528]: cluster 2024-09-21T01:29:06.632223+0000 mgr.a (mgr.14388) 8423 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:08 smithi044 bash[22676]: cluster 2024-09-21T01:29:06.632223+0000 mgr.a (mgr.14388) 8423 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:10.249 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:10.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:10.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:10 smithi044 bash[22676]: cluster 2024-09-21T01:29:08.633130+0000 mgr.a (mgr.14388) 8424 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:10 smithi179 bash[23186]: cluster 2024-09-21T01:29:08.633130+0000 mgr.a (mgr.14388) 8424 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:10 smithi049 bash[23528]: cluster 2024-09-21T01:29:08.633130+0000 mgr.a (mgr.14388) 8424 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:11 smithi044 bash[22676]: audit 2024-09-21T01:29:09.800279+0000 mgr.a (mgr.14388) 8425 : audit [DBG] from='client.188691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:11 smithi044 bash[22676]: audit 2024-09-21T01:29:11.077421+0000 mon.a (mon.0) 7137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:11 smithi044 bash[22676]: audit 2024-09-21T01:29:11.086053+0000 mon.a (mon.0) 7138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:11 smithi044 bash[22676]: audit 2024-09-21T01:29:11.096640+0000 mon.a (mon.0) 7139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:11 smithi049 bash[23528]: audit 2024-09-21T01:29:09.800279+0000 mgr.a (mgr.14388) 8425 : audit [DBG] from='client.188691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:11 smithi049 bash[23528]: audit 2024-09-21T01:29:11.077421+0000 mon.a (mon.0) 7137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:11 smithi049 bash[23528]: audit 2024-09-21T01:29:11.086053+0000 mon.a (mon.0) 7138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:11 smithi049 bash[23528]: audit 2024-09-21T01:29:11.096640+0000 mon.a (mon.0) 7139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:11 smithi179 bash[23186]: audit 2024-09-21T01:29:09.800279+0000 mgr.a (mgr.14388) 8425 : audit [DBG] from='client.188691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:11 smithi179 bash[23186]: audit 2024-09-21T01:29:11.077421+0000 mon.a (mon.0) 7137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:11 smithi179 bash[23186]: audit 2024-09-21T01:29:11.086053+0000 mon.a (mon.0) 7138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:11 smithi179 bash[23186]: audit 2024-09-21T01:29:11.096640+0000 mon.a (mon.0) 7139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:12 smithi044 bash[22676]: cluster 2024-09-21T01:29:10.634493+0000 mgr.a (mgr.14388) 8426 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:12 smithi044 bash[22676]: audit 2024-09-21T01:29:11.600231+0000 mon.a (mon.0) 7140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:12 smithi044 bash[22676]: audit 2024-09-21T01:29:11.607514+0000 mon.a (mon.0) 7141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:12 smithi044 bash[22676]: audit 2024-09-21T01:29:11.617002+0000 mon.a (mon.0) 7142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:12 smithi049 bash[23528]: cluster 2024-09-21T01:29:10.634493+0000 mgr.a (mgr.14388) 8426 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:12 smithi049 bash[23528]: audit 2024-09-21T01:29:11.600231+0000 mon.a (mon.0) 7140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:12 smithi049 bash[23528]: audit 2024-09-21T01:29:11.607514+0000 mon.a (mon.0) 7141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:12 smithi049 bash[23528]: audit 2024-09-21T01:29:11.617002+0000 mon.a (mon.0) 7142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:12 smithi179 bash[23186]: cluster 2024-09-21T01:29:10.634493+0000 mgr.a (mgr.14388) 8426 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:12 smithi179 bash[23186]: audit 2024-09-21T01:29:11.600231+0000 mon.a (mon.0) 7140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:12 smithi179 bash[23186]: audit 2024-09-21T01:29:11.607514+0000 mon.a (mon.0) 7141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:12 smithi179 bash[23186]: audit 2024-09-21T01:29:11.617002+0000 mon.a (mon.0) 7142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:13 smithi044 bash[22676]: cluster 2024-09-21T01:29:12.635148+0000 mgr.a (mgr.14388) 8427 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:29:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:13 smithi179 bash[23186]: cluster 2024-09-21T01:29:12.635148+0000 mgr.a (mgr.14388) 8427 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:29:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:13 smithi049 bash[23528]: cluster 2024-09-21T01:29:12.635148+0000 mgr.a (mgr.14388) 8427 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:29:15.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:15.251 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:15.251 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:15 smithi044 bash[22676]: cluster 2024-09-21T01:29:14.635917+0000 mgr.a (mgr.14388) 8428 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:29:15.995 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:15.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:15.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:15.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:15.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:16.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:15 smithi179 bash[23186]: cluster 2024-09-21T01:29:14.635917+0000 mgr.a (mgr.14388) 8428 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:29:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:15 smithi049 bash[23528]: cluster 2024-09-21T01:29:14.635917+0000 mgr.a (mgr.14388) 8428 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:29:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:16 smithi044 bash[22676]: audit 2024-09-21T01:29:15.570731+0000 mgr.a (mgr.14388) 8429 : audit [DBG] from='client.188766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:16 smithi179 bash[23186]: audit 2024-09-21T01:29:15.570731+0000 mgr.a (mgr.14388) 8429 : audit [DBG] from='client.188766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:17.019 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:16 smithi049 bash[23528]: audit 2024-09-21T01:29:15.570731+0000 mgr.a (mgr.14388) 8429 : audit [DBG] from='client.188766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:17 smithi179 bash[23186]: cluster 2024-09-21T01:29:16.638678+0000 mgr.a (mgr.14388) 8430 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:17 smithi179 bash[23186]: audit 2024-09-21T01:29:16.998462+0000 mon.a (mon.0) 7143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:17 smithi179 bash[23186]: audit 2024-09-21T01:29:17.007238+0000 mon.a (mon.0) 7144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:17 smithi179 bash[23186]: audit 2024-09-21T01:29:17.017786+0000 mon.a (mon.0) 7145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:17 smithi049 bash[23528]: cluster 2024-09-21T01:29:16.638678+0000 mgr.a (mgr.14388) 8430 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:17 smithi049 bash[23528]: audit 2024-09-21T01:29:16.998462+0000 mon.a (mon.0) 7143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:17 smithi049 bash[23528]: audit 2024-09-21T01:29:17.007238+0000 mon.a (mon.0) 7144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:17 smithi049 bash[23528]: audit 2024-09-21T01:29:17.017786+0000 mon.a (mon.0) 7145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:17 smithi044 bash[22676]: cluster 2024-09-21T01:29:16.638678+0000 mgr.a (mgr.14388) 8430 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:29:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:17 smithi044 bash[22676]: audit 2024-09-21T01:29:16.998462+0000 mon.a (mon.0) 7143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:17 smithi044 bash[22676]: audit 2024-09-21T01:29:17.007238+0000 mon.a (mon.0) 7144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:17 smithi044 bash[22676]: audit 2024-09-21T01:29:17.017786+0000 mon.a (mon.0) 7145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:20 smithi179 bash[23186]: cluster 2024-09-21T01:29:18.639435+0000 mgr.a (mgr.14388) 8431 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:29:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:20 smithi049 bash[23528]: cluster 2024-09-21T01:29:18.639435+0000 mgr.a (mgr.14388) 8431 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:29:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:20 smithi044 bash[22676]: cluster 2024-09-21T01:29:18.639435+0000 mgr.a (mgr.14388) 8431 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:29:20.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:20.998 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:20.998 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:21.771 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:21.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:21.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:21.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:21.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:22 smithi049 bash[23528]: cluster 2024-09-21T01:29:20.641561+0000 mgr.a (mgr.14388) 8432 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:22 smithi049 bash[23528]: audit 2024-09-21T01:29:21.332179+0000 mgr.a (mgr.14388) 8433 : audit [DBG] from='client.188844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:22 smithi044 bash[22676]: cluster 2024-09-21T01:29:20.641561+0000 mgr.a (mgr.14388) 8432 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:22 smithi044 bash[22676]: audit 2024-09-21T01:29:21.332179+0000 mgr.a (mgr.14388) 8433 : audit [DBG] from='client.188844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:22 smithi179 bash[23186]: cluster 2024-09-21T01:29:20.641561+0000 mgr.a (mgr.14388) 8432 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:22 smithi179 bash[23186]: audit 2024-09-21T01:29:21.332179+0000 mgr.a (mgr.14388) 8433 : audit [DBG] from='client.188844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:24 smithi049 bash[23528]: cluster 2024-09-21T01:29:22.642499+0000 mgr.a (mgr.14388) 8434 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:29:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:24 smithi044 bash[22676]: cluster 2024-09-21T01:29:22.642499+0000 mgr.a (mgr.14388) 8434 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:29:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:24 smithi179 bash[23186]: cluster 2024-09-21T01:29:22.642499+0000 mgr.a (mgr.14388) 8434 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:29:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:26 smithi049 bash[23528]: cluster 2024-09-21T01:29:24.643270+0000 mgr.a (mgr.14388) 8435 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:29:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:26 smithi044 bash[22676]: cluster 2024-09-21T01:29:24.643270+0000 mgr.a (mgr.14388) 8435 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:29:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:26 smithi179 bash[23186]: cluster 2024-09-21T01:29:24.643270+0000 mgr.a (mgr.14388) 8435 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:29:26.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:26.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:26.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:27.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:27.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:27.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:27.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:28 smithi049 bash[23528]: cluster 2024-09-21T01:29:26.645485+0000 mgr.a (mgr.14388) 8436 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:29:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:28 smithi049 bash[23528]: audit 2024-09-21T01:29:27.112582+0000 mgr.a (mgr.14388) 8437 : audit [DBG] from='client.188922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:28.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:28 smithi179 bash[23186]: cluster 2024-09-21T01:29:26.645485+0000 mgr.a (mgr.14388) 8436 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:29:28.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:28 smithi179 bash[23186]: audit 2024-09-21T01:29:27.112582+0000 mgr.a (mgr.14388) 8437 : audit [DBG] from='client.188922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:28 smithi044 bash[22676]: cluster 2024-09-21T01:29:26.645485+0000 mgr.a (mgr.14388) 8436 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:29:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:28 smithi044 bash[22676]: audit 2024-09-21T01:29:27.112582+0000 mgr.a (mgr.14388) 8437 : audit [DBG] from='client.188922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:30 smithi044 bash[22676]: cluster 2024-09-21T01:29:28.646361+0000 mgr.a (mgr.14388) 8438 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:30 smithi179 bash[23186]: cluster 2024-09-21T01:29:28.646361+0000 mgr.a (mgr.14388) 8438 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:30 smithi049 bash[23528]: cluster 2024-09-21T01:29:28.646361+0000 mgr.a (mgr.14388) 8438 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:32.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:32 smithi049 bash[23528]: cluster 2024-09-21T01:29:30.648585+0000 mgr.a (mgr.14388) 8439 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:32 smithi049 bash[23528]: audit 2024-09-21T01:29:31.273105+0000 mon.a (mon.0) 7146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:32 smithi049 bash[23528]: audit 2024-09-21T01:29:31.281831+0000 mon.a (mon.0) 7147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:32 smithi049 bash[23528]: audit 2024-09-21T01:29:31.292253+0000 mon.a (mon.0) 7148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:32 smithi049 bash[23528]: audit 2024-09-21T01:29:31.757728+0000 mon.a (mon.0) 7149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:32 smithi049 bash[23528]: audit 2024-09-21T01:29:31.762244+0000 mon.a (mon.0) 7150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:32 smithi049 bash[23528]: audit 2024-09-21T01:29:31.766941+0000 mon.a (mon.0) 7151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:32.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:32.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:32 smithi044 bash[22676]: cluster 2024-09-21T01:29:30.648585+0000 mgr.a (mgr.14388) 8439 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:32.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:32 smithi044 bash[22676]: audit 2024-09-21T01:29:31.273105+0000 mon.a (mon.0) 7146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:32 smithi044 bash[22676]: audit 2024-09-21T01:29:31.281831+0000 mon.a (mon.0) 7147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:32 smithi044 bash[22676]: audit 2024-09-21T01:29:31.292253+0000 mon.a (mon.0) 7148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:32 smithi044 bash[22676]: audit 2024-09-21T01:29:31.757728+0000 mon.a (mon.0) 7149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.681 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:32 smithi044 bash[22676]: audit 2024-09-21T01:29:31.762244+0000 mon.a (mon.0) 7150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.682 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:32 smithi044 bash[22676]: audit 2024-09-21T01:29:31.766941+0000 mon.a (mon.0) 7151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:32 smithi179 bash[23186]: cluster 2024-09-21T01:29:30.648585+0000 mgr.a (mgr.14388) 8439 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:32 smithi179 bash[23186]: audit 2024-09-21T01:29:31.273105+0000 mon.a (mon.0) 7146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:32 smithi179 bash[23186]: audit 2024-09-21T01:29:31.281831+0000 mon.a (mon.0) 7147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:32 smithi179 bash[23186]: audit 2024-09-21T01:29:31.292253+0000 mon.a (mon.0) 7148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:32 smithi179 bash[23186]: audit 2024-09-21T01:29:31.757728+0000 mon.a (mon.0) 7149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:32 smithi179 bash[23186]: audit 2024-09-21T01:29:31.762244+0000 mon.a (mon.0) 7150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:32 smithi179 bash[23186]: audit 2024-09-21T01:29:31.766941+0000 mon.a (mon.0) 7151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:33.344 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:34 smithi049 bash[23528]: cluster 2024-09-21T01:29:32.649216+0000 mgr.a (mgr.14388) 8440 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:34 smithi049 bash[23528]: audit 2024-09-21T01:29:32.894931+0000 mgr.a (mgr.14388) 8441 : audit [DBG] from='client.188997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:34 smithi044 bash[22676]: cluster 2024-09-21T01:29:32.649216+0000 mgr.a (mgr.14388) 8440 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:34 smithi044 bash[22676]: audit 2024-09-21T01:29:32.894931+0000 mgr.a (mgr.14388) 8441 : audit [DBG] from='client.188997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:34 smithi179 bash[23186]: cluster 2024-09-21T01:29:32.649216+0000 mgr.a (mgr.14388) 8440 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:34 smithi179 bash[23186]: audit 2024-09-21T01:29:32.894931+0000 mgr.a (mgr.14388) 8441 : audit [DBG] from='client.188997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:36 smithi049 bash[23528]: cluster 2024-09-21T01:29:34.650286+0000 mgr.a (mgr.14388) 8442 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:36 smithi044 bash[22676]: cluster 2024-09-21T01:29:34.650286+0000 mgr.a (mgr.14388) 8442 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:36 smithi179 bash[23186]: cluster 2024-09-21T01:29:34.650286+0000 mgr.a (mgr.14388) 8442 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:38.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:38.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:38.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:38 smithi044 bash[22676]: cluster 2024-09-21T01:29:36.652693+0000 mgr.a (mgr.14388) 8443 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:38 smithi044 bash[22676]: audit 2024-09-21T01:29:37.232590+0000 mon.a (mon.0) 7152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:38 smithi044 bash[22676]: audit 2024-09-21T01:29:37.241385+0000 mon.a (mon.0) 7153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:38 smithi044 bash[22676]: audit 2024-09-21T01:29:37.251909+0000 mon.a (mon.0) 7154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:38 smithi179 bash[23186]: cluster 2024-09-21T01:29:36.652693+0000 mgr.a (mgr.14388) 8443 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:38 smithi179 bash[23186]: audit 2024-09-21T01:29:37.232590+0000 mon.a (mon.0) 7152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:38 smithi179 bash[23186]: audit 2024-09-21T01:29:37.241385+0000 mon.a (mon.0) 7153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:38 smithi179 bash[23186]: audit 2024-09-21T01:29:37.251909+0000 mon.a (mon.0) 7154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:38 smithi049 bash[23528]: cluster 2024-09-21T01:29:36.652693+0000 mgr.a (mgr.14388) 8443 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:38 smithi049 bash[23528]: audit 2024-09-21T01:29:37.232590+0000 mon.a (mon.0) 7152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:38 smithi049 bash[23528]: audit 2024-09-21T01:29:37.241385+0000 mon.a (mon.0) 7153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:38 smithi049 bash[23528]: audit 2024-09-21T01:29:37.251909+0000 mon.a (mon.0) 7154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:39.147 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:39.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:39.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:39.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:39.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:40 smithi044 bash[22676]: cluster 2024-09-21T01:29:38.653623+0000 mgr.a (mgr.14388) 8444 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:40 smithi044 bash[22676]: audit 2024-09-21T01:29:38.686103+0000 mgr.a (mgr.14388) 8445 : audit [DBG] from='client.189075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:40 smithi179 bash[23186]: cluster 2024-09-21T01:29:38.653623+0000 mgr.a (mgr.14388) 8444 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:40 smithi179 bash[23186]: audit 2024-09-21T01:29:38.686103+0000 mgr.a (mgr.14388) 8445 : audit [DBG] from='client.189075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:40 smithi049 bash[23528]: cluster 2024-09-21T01:29:38.653623+0000 mgr.a (mgr.14388) 8444 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:40 smithi049 bash[23528]: audit 2024-09-21T01:29:38.686103+0000 mgr.a (mgr.14388) 8445 : audit [DBG] from='client.189075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:42 smithi179 bash[23186]: cluster 2024-09-21T01:29:40.655970+0000 mgr.a (mgr.14388) 8446 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:42 smithi049 bash[23528]: cluster 2024-09-21T01:29:40.655970+0000 mgr.a (mgr.14388) 8446 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:42 smithi044 bash[22676]: cluster 2024-09-21T01:29:40.655970+0000 mgr.a (mgr.14388) 8446 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:44.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:44.150 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:44 smithi179 bash[23186]: cluster 2024-09-21T01:29:42.656766+0000 mgr.a (mgr.14388) 8447 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:44 smithi049 bash[23528]: cluster 2024-09-21T01:29:42.656766+0000 mgr.a (mgr.14388) 8447 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:44 smithi044 bash[22676]: cluster 2024-09-21T01:29:42.656766+0000 mgr.a (mgr.14388) 8447 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:44.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:44.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:44.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:44.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:44.927 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:45 smithi049 bash[23528]: audit 2024-09-21T01:29:44.485988+0000 mgr.a (mgr.14388) 8448 : audit [DBG] from='client.189153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:45 smithi044 bash[22676]: audit 2024-09-21T01:29:44.485988+0000 mgr.a (mgr.14388) 8448 : audit [DBG] from='client.189153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:45 smithi179 bash[23186]: audit 2024-09-21T01:29:44.485988+0000 mgr.a (mgr.14388) 8448 : audit [DBG] from='client.189153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:46 smithi049 bash[23528]: cluster 2024-09-21T01:29:44.657410+0000 mgr.a (mgr.14388) 8449 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:46 smithi044 bash[22676]: cluster 2024-09-21T01:29:44.657410+0000 mgr.a (mgr.14388) 8449 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:46 smithi179 bash[23186]: cluster 2024-09-21T01:29:44.657410+0000 mgr.a (mgr.14388) 8449 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:48.472 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:48 smithi179 bash[23186]: cluster 2024-09-21T01:29:46.659644+0000 mgr.a (mgr.14388) 8450 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:48.489 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:48 smithi049 bash[23528]: cluster 2024-09-21T01:29:46.659644+0000 mgr.a (mgr.14388) 8450 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:48 smithi044 bash[22676]: cluster 2024-09-21T01:29:46.659644+0000 mgr.a (mgr.14388) 8450 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:29:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:49.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:50 smithi044 bash[22676]: cluster 2024-09-21T01:29:48.660438+0000 mgr.a (mgr.14388) 8451 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:50 smithi049 bash[23528]: cluster 2024-09-21T01:29:48.660438+0000 mgr.a (mgr.14388) 8451 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:50.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:50 smithi179 bash[23186]: cluster 2024-09-21T01:29:48.660438+0000 mgr.a (mgr.14388) 8451 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:50.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:50.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:51 smithi049 bash[23528]: audit 2024-09-21T01:29:50.261972+0000 mgr.a (mgr.14388) 8452 : audit [DBG] from='client.189231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:51 smithi044 bash[22676]: audit 2024-09-21T01:29:50.261972+0000 mgr.a (mgr.14388) 8452 : audit [DBG] from='client.189231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:51 smithi179 bash[23186]: audit 2024-09-21T01:29:50.261972+0000 mgr.a (mgr.14388) 8452 : audit [DBG] from='client.189231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:52 smithi044 bash[22676]: cluster 2024-09-21T01:29:50.661743+0000 mgr.a (mgr.14388) 8453 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:52 smithi044 bash[22676]: audit 2024-09-21T01:29:51.436812+0000 mon.a (mon.0) 7155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:52 smithi044 bash[22676]: audit 2024-09-21T01:29:51.444592+0000 mon.a (mon.0) 7156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:52 smithi044 bash[22676]: audit 2024-09-21T01:29:51.454484+0000 mon.a (mon.0) 7157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:52 smithi044 bash[22676]: audit 2024-09-21T01:29:51.962339+0000 mon.a (mon.0) 7158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:52 smithi044 bash[22676]: audit 2024-09-21T01:29:51.968448+0000 mon.a (mon.0) 7159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:52 smithi044 bash[22676]: audit 2024-09-21T01:29:51.974362+0000 mon.a (mon.0) 7160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:52 smithi179 bash[23186]: cluster 2024-09-21T01:29:50.661743+0000 mgr.a (mgr.14388) 8453 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:52 smithi179 bash[23186]: audit 2024-09-21T01:29:51.436812+0000 mon.a (mon.0) 7155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:52 smithi179 bash[23186]: audit 2024-09-21T01:29:51.444592+0000 mon.a (mon.0) 7156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:52 smithi179 bash[23186]: audit 2024-09-21T01:29:51.454484+0000 mon.a (mon.0) 7157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:52 smithi179 bash[23186]: audit 2024-09-21T01:29:51.962339+0000 mon.a (mon.0) 7158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:52 smithi179 bash[23186]: audit 2024-09-21T01:29:51.968448+0000 mon.a (mon.0) 7159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:52 smithi179 bash[23186]: audit 2024-09-21T01:29:51.974362+0000 mon.a (mon.0) 7160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:52 smithi049 bash[23528]: cluster 2024-09-21T01:29:50.661743+0000 mgr.a (mgr.14388) 8453 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:52 smithi049 bash[23528]: audit 2024-09-21T01:29:51.436812+0000 mon.a (mon.0) 7155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:52 smithi049 bash[23528]: audit 2024-09-21T01:29:51.444592+0000 mon.a (mon.0) 7156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:52 smithi049 bash[23528]: audit 2024-09-21T01:29:51.454484+0000 mon.a (mon.0) 7157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:52 smithi049 bash[23528]: audit 2024-09-21T01:29:51.962339+0000 mon.a (mon.0) 7158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:52 smithi049 bash[23528]: audit 2024-09-21T01:29:51.968448+0000 mon.a (mon.0) 7159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:52 smithi049 bash[23528]: audit 2024-09-21T01:29:51.974362+0000 mon.a (mon.0) 7160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:54 smithi044 bash[22676]: cluster 2024-09-21T01:29:52.662479+0000 mgr.a (mgr.14388) 8454 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:29:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:54 smithi179 bash[23186]: cluster 2024-09-21T01:29:52.662479+0000 mgr.a (mgr.14388) 8454 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:29:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:54 smithi049 bash[23528]: cluster 2024-09-21T01:29:52.662479+0000 mgr.a (mgr.14388) 8454 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:29:55.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:29:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:29:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:29:56.460 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:29:56.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:29:56.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:29:56.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:29:56.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:29:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:56 smithi044 bash[22676]: cluster 2024-09-21T01:29:54.663281+0000 mgr.a (mgr.14388) 8455 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:29:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:56 smithi179 bash[23186]: cluster 2024-09-21T01:29:54.663281+0000 mgr.a (mgr.14388) 8455 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:29:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:56 smithi049 bash[23528]: cluster 2024-09-21T01:29:54.663281+0000 mgr.a (mgr.14388) 8455 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:29:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:57 smithi044 bash[22676]: audit 2024-09-21T01:29:56.008641+0000 mgr.a (mgr.14388) 8456 : audit [DBG] from='client.189309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:57 smithi179 bash[23186]: audit 2024-09-21T01:29:56.008641+0000 mgr.a (mgr.14388) 8456 : audit [DBG] from='client.189309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:57 smithi049 bash[23528]: audit 2024-09-21T01:29:56.008641+0000 mgr.a (mgr.14388) 8456 : audit [DBG] from='client.189309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:29:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:58 smithi044 bash[22676]: cluster 2024-09-21T01:29:56.666032+0000 mgr.a (mgr.14388) 8457 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:58 smithi044 bash[22676]: audit 2024-09-21T01:29:57.465028+0000 mon.a (mon.0) 7161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:58 smithi044 bash[22676]: audit 2024-09-21T01:29:57.474900+0000 mon.a (mon.0) 7162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:29:58 smithi044 bash[22676]: audit 2024-09-21T01:29:57.486986+0000 mon.a (mon.0) 7163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:58 smithi179 bash[23186]: cluster 2024-09-21T01:29:56.666032+0000 mgr.a (mgr.14388) 8457 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:58 smithi179 bash[23186]: audit 2024-09-21T01:29:57.465028+0000 mon.a (mon.0) 7161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:58 smithi179 bash[23186]: audit 2024-09-21T01:29:57.474900+0000 mon.a (mon.0) 7162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:29:58 smithi179 bash[23186]: audit 2024-09-21T01:29:57.486986+0000 mon.a (mon.0) 7163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:58 smithi049 bash[23528]: cluster 2024-09-21T01:29:56.666032+0000 mgr.a (mgr.14388) 8457 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:29:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:58 smithi049 bash[23528]: audit 2024-09-21T01:29:57.465028+0000 mon.a (mon.0) 7161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:58 smithi049 bash[23528]: audit 2024-09-21T01:29:57.474900+0000 mon.a (mon.0) 7162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:29:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:29:58 smithi049 bash[23528]: audit 2024-09-21T01:29:57.486986+0000 mon.a (mon.0) 7163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:00 smithi044 bash[22676]: cluster 2024-09-21T01:29:58.666780+0000 mgr.a (mgr.14388) 8458 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:00 smithi044 bash[22676]: cluster 2024-09-21T01:30:00.000136+0000 mon.a (mon.0) 7164 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:30:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:00 smithi179 bash[23186]: cluster 2024-09-21T01:29:58.666780+0000 mgr.a (mgr.14388) 8458 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:00 smithi179 bash[23186]: cluster 2024-09-21T01:30:00.000136+0000 mon.a (mon.0) 7164 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:30:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:00 smithi049 bash[23528]: cluster 2024-09-21T01:29:58.666780+0000 mgr.a (mgr.14388) 8458 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:00 smithi049 bash[23528]: cluster 2024-09-21T01:30:00.000136+0000 mon.a (mon.0) 7164 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:30:01.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:01.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:01 smithi044 bash[22676]: audit 2024-09-21T01:30:01.320644+0000 mon.a (mon.0) 7165 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:30:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:01 smithi044 bash[22676]: audit 2024-09-21T01:30:01.327294+0000 mon.a (mon.0) 7166 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:30:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:01 smithi044 bash[22676]: audit 2024-09-21T01:30:01.329284+0000 mon.a (mon.0) 7167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:30:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:01 smithi044 bash[22676]: audit 2024-09-21T01:30:01.340469+0000 mon.a (mon.0) 7168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:01 smithi044 bash[22676]: audit 2024-09-21T01:30:01.346704+0000 mon.a (mon.0) 7169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:30:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:01 smithi179 bash[23186]: audit 2024-09-21T01:30:01.320644+0000 mon.a (mon.0) 7165 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:30:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:01 smithi179 bash[23186]: audit 2024-09-21T01:30:01.327294+0000 mon.a (mon.0) 7166 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:30:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:01 smithi179 bash[23186]: audit 2024-09-21T01:30:01.329284+0000 mon.a (mon.0) 7167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:30:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:01 smithi179 bash[23186]: audit 2024-09-21T01:30:01.340469+0000 mon.a (mon.0) 7168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:01 smithi179 bash[23186]: audit 2024-09-21T01:30:01.346704+0000 mon.a (mon.0) 7169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:30:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:01 smithi049 bash[23528]: audit 2024-09-21T01:30:01.320644+0000 mon.a (mon.0) 7165 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:30:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:01 smithi049 bash[23528]: audit 2024-09-21T01:30:01.327294+0000 mon.a (mon.0) 7166 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:30:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:01 smithi049 bash[23528]: audit 2024-09-21T01:30:01.329284+0000 mon.a (mon.0) 7167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:30:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:01 smithi049 bash[23528]: audit 2024-09-21T01:30:01.340469+0000 mon.a (mon.0) 7168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:01 smithi049 bash[23528]: audit 2024-09-21T01:30:01.346704+0000 mon.a (mon.0) 7169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:30:02.477 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:30:02 smithi044 bash[22930]: debug 2024-09-21T01:30:02.134+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:30:02.478 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:30:02 smithi044 bash[22930]: debug 2024-09-21T01:30:02.146+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:30:02.551 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:02.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:02.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:02.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:02.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:02 smithi049 bash[23528]: cluster 2024-09-21T01:30:00.668758+0000 mgr.a (mgr.14388) 8459 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:02 smithi049 bash[23528]: audit 2024-09-21T01:30:01.349037+0000 mgr.a (mgr.14388) 8460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:30:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:02 smithi044 bash[22676]: cluster 2024-09-21T01:30:00.668758+0000 mgr.a (mgr.14388) 8459 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:02 smithi044 bash[22676]: audit 2024-09-21T01:30:01.349037+0000 mgr.a (mgr.14388) 8460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:30:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:02 smithi179 bash[23186]: cluster 2024-09-21T01:30:00.668758+0000 mgr.a (mgr.14388) 8459 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:02 smithi179 bash[23186]: audit 2024-09-21T01:30:01.349037+0000 mgr.a (mgr.14388) 8460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:30:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:03 smithi044 bash[22676]: audit 2024-09-21T01:30:01.797387+0000 mgr.a (mgr.14388) 8461 : audit [DBG] from='client.189405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:03 smithi044 bash[22676]: audit 2024-09-21T01:30:02.137958+0000 mgr.a (mgr.14388) 8462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:30:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:03 smithi044 bash[22676]: cephadm 2024-09-21T01:30:02.150711+0000 mgr.a (mgr.14388) 8463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:30:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:03 smithi179 bash[23186]: audit 2024-09-21T01:30:01.797387+0000 mgr.a (mgr.14388) 8461 : audit [DBG] from='client.189405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:03 smithi179 bash[23186]: audit 2024-09-21T01:30:02.137958+0000 mgr.a (mgr.14388) 8462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:30:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:03 smithi179 bash[23186]: cephadm 2024-09-21T01:30:02.150711+0000 mgr.a (mgr.14388) 8463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:30:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:03 smithi049 bash[23528]: audit 2024-09-21T01:30:01.797387+0000 mgr.a (mgr.14388) 8461 : audit [DBG] from='client.189405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:03 smithi049 bash[23528]: audit 2024-09-21T01:30:02.137958+0000 mgr.a (mgr.14388) 8462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:30:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:03 smithi049 bash[23528]: cephadm 2024-09-21T01:30:02.150711+0000 mgr.a (mgr.14388) 8463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:30:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:04 smithi179 bash[23186]: cluster 2024-09-21T01:30:02.669750+0000 mgr.a (mgr.14388) 8464 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:04 smithi049 bash[23528]: cluster 2024-09-21T01:30:02.669750+0000 mgr.a (mgr.14388) 8464 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:04 smithi044 bash[22676]: cluster 2024-09-21T01:30:02.669750+0000 mgr.a (mgr.14388) 8464 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:06 smithi179 bash[23186]: cluster 2024-09-21T01:30:04.670538+0000 mgr.a (mgr.14388) 8465 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:06 smithi049 bash[23528]: cluster 2024-09-21T01:30:04.670538+0000 mgr.a (mgr.14388) 8465 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:06 smithi044 bash[22676]: cluster 2024-09-21T01:30:04.670538+0000 mgr.a (mgr.14388) 8465 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:07.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:07.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:08.324 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:08.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:08.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:08.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:08.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:08.611 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:08 smithi179 bash[23186]: cluster 2024-09-21T01:30:06.672874+0000 mgr.a (mgr.14388) 8466 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:08 smithi049 bash[23528]: cluster 2024-09-21T01:30:06.672874+0000 mgr.a (mgr.14388) 8466 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:08 smithi044 bash[22676]: cluster 2024-09-21T01:30:06.672874+0000 mgr.a (mgr.14388) 8466 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:09 smithi049 bash[23528]: audit 2024-09-21T01:30:07.889446+0000 mgr.a (mgr.14388) 8467 : audit [DBG] from='client.189570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:09 smithi044 bash[22676]: audit 2024-09-21T01:30:07.889446+0000 mgr.a (mgr.14388) 8467 : audit [DBG] from='client.189570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:09 smithi179 bash[23186]: audit 2024-09-21T01:30:07.889446+0000 mgr.a (mgr.14388) 8467 : audit [DBG] from='client.189570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:10 smithi044 bash[22676]: cluster 2024-09-21T01:30:08.674064+0000 mgr.a (mgr.14388) 8468 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:10 smithi049 bash[23528]: cluster 2024-09-21T01:30:08.674064+0000 mgr.a (mgr.14388) 8468 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:10.854 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:10 smithi179 bash[23186]: cluster 2024-09-21T01:30:08.674064+0000 mgr.a (mgr.14388) 8468 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:12 smithi049 bash[23528]: cluster 2024-09-21T01:30:10.676514+0000 mgr.a (mgr.14388) 8469 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:12 smithi049 bash[23528]: audit 2024-09-21T01:30:11.631028+0000 mon.a (mon.0) 7170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:12 smithi049 bash[23528]: audit 2024-09-21T01:30:11.640048+0000 mon.a (mon.0) 7171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:12 smithi049 bash[23528]: audit 2024-09-21T01:30:11.650958+0000 mon.a (mon.0) 7172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:12 smithi049 bash[23528]: audit 2024-09-21T01:30:12.119426+0000 mon.a (mon.0) 7173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:12 smithi049 bash[23528]: audit 2024-09-21T01:30:12.127642+0000 mon.a (mon.0) 7174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:12 smithi049 bash[23528]: audit 2024-09-21T01:30:12.133395+0000 mon.a (mon.0) 7175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:12 smithi044 bash[22676]: cluster 2024-09-21T01:30:10.676514+0000 mgr.a (mgr.14388) 8469 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:12 smithi044 bash[22676]: audit 2024-09-21T01:30:11.631028+0000 mon.a (mon.0) 7170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:12 smithi044 bash[22676]: audit 2024-09-21T01:30:11.640048+0000 mon.a (mon.0) 7171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:12 smithi044 bash[22676]: audit 2024-09-21T01:30:11.650958+0000 mon.a (mon.0) 7172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:12 smithi044 bash[22676]: audit 2024-09-21T01:30:12.119426+0000 mon.a (mon.0) 7173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:12 smithi044 bash[22676]: audit 2024-09-21T01:30:12.127642+0000 mon.a (mon.0) 7174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:12 smithi044 bash[22676]: audit 2024-09-21T01:30:12.133395+0000 mon.a (mon.0) 7175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:12 smithi179 bash[23186]: cluster 2024-09-21T01:30:10.676514+0000 mgr.a (mgr.14388) 8469 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:12 smithi179 bash[23186]: audit 2024-09-21T01:30:11.631028+0000 mon.a (mon.0) 7170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:12 smithi179 bash[23186]: audit 2024-09-21T01:30:11.640048+0000 mon.a (mon.0) 7171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:12 smithi179 bash[23186]: audit 2024-09-21T01:30:11.650958+0000 mon.a (mon.0) 7172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:12 smithi179 bash[23186]: audit 2024-09-21T01:30:12.119426+0000 mon.a (mon.0) 7173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:12 smithi179 bash[23186]: audit 2024-09-21T01:30:12.127642+0000 mon.a (mon.0) 7174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:12 smithi179 bash[23186]: audit 2024-09-21T01:30:12.133395+0000 mon.a (mon.0) 7175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:13.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:13.326 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:13.326 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:14.058 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:14 smithi049 bash[23528]: cluster 2024-09-21T01:30:12.677335+0000 mgr.a (mgr.14388) 8470 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:14 smithi044 bash[22676]: cluster 2024-09-21T01:30:12.677335+0000 mgr.a (mgr.14388) 8470 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:14 smithi179 bash[23186]: cluster 2024-09-21T01:30:12.677335+0000 mgr.a (mgr.14388) 8470 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:15 smithi049 bash[23528]: audit 2024-09-21T01:30:13.640370+0000 mgr.a (mgr.14388) 8471 : audit [DBG] from='client.189648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:15 smithi044 bash[22676]: audit 2024-09-21T01:30:13.640370+0000 mgr.a (mgr.14388) 8471 : audit [DBG] from='client.189648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:15 smithi179 bash[23186]: audit 2024-09-21T01:30:13.640370+0000 mgr.a (mgr.14388) 8471 : audit [DBG] from='client.189648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:16 smithi049 bash[23528]: cluster 2024-09-21T01:30:14.678304+0000 mgr.a (mgr.14388) 8472 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:16 smithi044 bash[22676]: cluster 2024-09-21T01:30:14.678304+0000 mgr.a (mgr.14388) 8472 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:16 smithi179 bash[23186]: cluster 2024-09-21T01:30:14.678304+0000 mgr.a (mgr.14388) 8472 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:18 smithi049 bash[23528]: cluster 2024-09-21T01:30:16.680618+0000 mgr.a (mgr.14388) 8473 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:18 smithi049 bash[23528]: audit 2024-09-21T01:30:17.684498+0000 mon.a (mon.0) 7176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:18 smithi049 bash[23528]: audit 2024-09-21T01:30:17.692921+0000 mon.a (mon.0) 7177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:18 smithi049 bash[23528]: audit 2024-09-21T01:30:17.703168+0000 mon.a (mon.0) 7178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:18 smithi044 bash[22676]: cluster 2024-09-21T01:30:16.680618+0000 mgr.a (mgr.14388) 8473 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:18 smithi044 bash[22676]: audit 2024-09-21T01:30:17.684498+0000 mon.a (mon.0) 7176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:18 smithi044 bash[22676]: audit 2024-09-21T01:30:17.692921+0000 mon.a (mon.0) 7177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:18 smithi044 bash[22676]: audit 2024-09-21T01:30:17.703168+0000 mon.a (mon.0) 7178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:18 smithi179 bash[23186]: cluster 2024-09-21T01:30:16.680618+0000 mgr.a (mgr.14388) 8473 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:30:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:18 smithi179 bash[23186]: audit 2024-09-21T01:30:17.684498+0000 mon.a (mon.0) 7176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:18 smithi179 bash[23186]: audit 2024-09-21T01:30:17.692921+0000 mon.a (mon.0) 7177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:18 smithi179 bash[23186]: audit 2024-09-21T01:30:17.703168+0000 mon.a (mon.0) 7178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:19.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:19.843 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:19.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:19.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:19.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:19.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:20 smithi049 bash[23528]: cluster 2024-09-21T01:30:18.681411+0000 mgr.a (mgr.14388) 8474 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:20 smithi049 bash[23528]: audit 2024-09-21T01:30:19.397290+0000 mgr.a (mgr.14388) 8475 : audit [DBG] from='client.189723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:20 smithi044 bash[22676]: cluster 2024-09-21T01:30:18.681411+0000 mgr.a (mgr.14388) 8474 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:20 smithi044 bash[22676]: audit 2024-09-21T01:30:19.397290+0000 mgr.a (mgr.14388) 8475 : audit [DBG] from='client.189723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:20 smithi179 bash[23186]: cluster 2024-09-21T01:30:18.681411+0000 mgr.a (mgr.14388) 8474 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:20 smithi179 bash[23186]: audit 2024-09-21T01:30:19.397290+0000 mgr.a (mgr.14388) 8475 : audit [DBG] from='client.189723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:22 smithi049 bash[23528]: cluster 2024-09-21T01:30:20.683926+0000 mgr.a (mgr.14388) 8476 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:22 smithi044 bash[22676]: cluster 2024-09-21T01:30:20.683926+0000 mgr.a (mgr.14388) 8476 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:22 smithi179 bash[23186]: cluster 2024-09-21T01:30:20.683926+0000 mgr.a (mgr.14388) 8476 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:23 smithi044 bash[22676]: cluster 2024-09-21T01:30:22.684717+0000 mgr.a (mgr.14388) 8477 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:23 smithi179 bash[23186]: cluster 2024-09-21T01:30:22.684717+0000 mgr.a (mgr.14388) 8477 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:23 smithi049 bash[23528]: cluster 2024-09-21T01:30:22.684717+0000 mgr.a (mgr.14388) 8477 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:24.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:24.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:24.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:25.620 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:25.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:25.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:25.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:25.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:25 smithi179 bash[23186]: cluster 2024-09-21T01:30:24.685531+0000 mgr.a (mgr.14388) 8478 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:25 smithi179 bash[23186]: audit 2024-09-21T01:30:25.180444+0000 mgr.a (mgr.14388) 8479 : audit [DBG] from='client.189801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:25 smithi049 bash[23528]: cluster 2024-09-21T01:30:24.685531+0000 mgr.a (mgr.14388) 8478 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:25 smithi049 bash[23528]: audit 2024-09-21T01:30:25.180444+0000 mgr.a (mgr.14388) 8479 : audit [DBG] from='client.189801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:25 smithi044 bash[22676]: cluster 2024-09-21T01:30:24.685531+0000 mgr.a (mgr.14388) 8478 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:25 smithi044 bash[22676]: audit 2024-09-21T01:30:25.180444+0000 mgr.a (mgr.14388) 8479 : audit [DBG] from='client.189801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:27 smithi179 bash[23186]: cluster 2024-09-21T01:30:26.688518+0000 mgr.a (mgr.14388) 8480 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:27 smithi049 bash[23528]: cluster 2024-09-21T01:30:26.688518+0000 mgr.a (mgr.14388) 8480 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:27 smithi044 bash[22676]: cluster 2024-09-21T01:30:26.688518+0000 mgr.a (mgr.14388) 8480 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:29 smithi179 bash[23186]: cluster 2024-09-21T01:30:28.689511+0000 mgr.a (mgr.14388) 8481 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:29 smithi049 bash[23528]: cluster 2024-09-21T01:30:28.689511+0000 mgr.a (mgr.14388) 8481 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:29 smithi044 bash[22676]: cluster 2024-09-21T01:30:28.689511+0000 mgr.a (mgr.14388) 8481 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:30.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:31.398 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:31.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:31.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:31.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:31.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:31.912 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:31 smithi044 bash[22676]: cluster 2024-09-21T01:30:30.691621+0000 mgr.a (mgr.14388) 8482 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:31.912 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:31 smithi044 bash[22676]: audit 2024-09-21T01:30:30.958914+0000 mgr.a (mgr.14388) 8483 : audit [DBG] from='client.189876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:31 smithi179 bash[23186]: cluster 2024-09-21T01:30:30.691621+0000 mgr.a (mgr.14388) 8482 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:31 smithi179 bash[23186]: audit 2024-09-21T01:30:30.958914+0000 mgr.a (mgr.14388) 8483 : audit [DBG] from='client.189876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:31 smithi049 bash[23528]: cluster 2024-09-21T01:30:30.691621+0000 mgr.a (mgr.14388) 8482 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:31 smithi049 bash[23528]: audit 2024-09-21T01:30:30.958914+0000 mgr.a (mgr.14388) 8483 : audit [DBG] from='client.189876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:32 smithi044 bash[22676]: audit 2024-09-21T01:30:31.815349+0000 mon.a (mon.0) 7179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:32 smithi044 bash[22676]: audit 2024-09-21T01:30:31.820501+0000 mon.a (mon.0) 7180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:32 smithi044 bash[22676]: audit 2024-09-21T01:30:31.825727+0000 mon.a (mon.0) 7181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:32 smithi044 bash[22676]: audit 2024-09-21T01:30:32.321627+0000 mon.a (mon.0) 7182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:32 smithi044 bash[22676]: audit 2024-09-21T01:30:32.329428+0000 mon.a (mon.0) 7183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:32 smithi044 bash[22676]: audit 2024-09-21T01:30:32.336183+0000 mon.a (mon.0) 7184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:32 smithi179 bash[23186]: audit 2024-09-21T01:30:31.815349+0000 mon.a (mon.0) 7179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:32 smithi179 bash[23186]: audit 2024-09-21T01:30:31.820501+0000 mon.a (mon.0) 7180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:32 smithi179 bash[23186]: audit 2024-09-21T01:30:31.825727+0000 mon.a (mon.0) 7181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:32 smithi179 bash[23186]: audit 2024-09-21T01:30:32.321627+0000 mon.a (mon.0) 7182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:32 smithi179 bash[23186]: audit 2024-09-21T01:30:32.329428+0000 mon.a (mon.0) 7183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:32 smithi179 bash[23186]: audit 2024-09-21T01:30:32.336183+0000 mon.a (mon.0) 7184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:32 smithi049 bash[23528]: audit 2024-09-21T01:30:31.815349+0000 mon.a (mon.0) 7179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:32 smithi049 bash[23528]: audit 2024-09-21T01:30:31.820501+0000 mon.a (mon.0) 7180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:32 smithi049 bash[23528]: audit 2024-09-21T01:30:31.825727+0000 mon.a (mon.0) 7181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:32 smithi049 bash[23528]: audit 2024-09-21T01:30:32.321627+0000 mon.a (mon.0) 7182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:32 smithi049 bash[23528]: audit 2024-09-21T01:30:32.329428+0000 mon.a (mon.0) 7183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:32 smithi049 bash[23528]: audit 2024-09-21T01:30:32.336183+0000 mon.a (mon.0) 7184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:34 smithi044 bash[22676]: cluster 2024-09-21T01:30:32.692617+0000 mgr.a (mgr.14388) 8484 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:34 smithi179 bash[23186]: cluster 2024-09-21T01:30:32.692617+0000 mgr.a (mgr.14388) 8484 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:34 smithi049 bash[23528]: cluster 2024-09-21T01:30:32.692617+0000 mgr.a (mgr.14388) 8484 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:36.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:36.400 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:36.400 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:36 smithi044 bash[22676]: cluster 2024-09-21T01:30:34.693451+0000 mgr.a (mgr.14388) 8485 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:36 smithi179 bash[23186]: cluster 2024-09-21T01:30:34.693451+0000 mgr.a (mgr.14388) 8485 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:36 smithi049 bash[23528]: cluster 2024-09-21T01:30:34.693451+0000 mgr.a (mgr.14388) 8485 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:30:37.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:37.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:37.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:37.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:37.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:38 smithi044 bash[22676]: cluster 2024-09-21T01:30:36.695583+0000 mgr.a (mgr.14388) 8486 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:38 smithi044 bash[22676]: audit 2024-09-21T01:30:36.737590+0000 mgr.a (mgr.14388) 8487 : audit [DBG] from='client.189951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:38 smithi044 bash[22676]: audit 2024-09-21T01:30:37.916486+0000 mon.a (mon.0) 7185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:38 smithi044 bash[22676]: audit 2024-09-21T01:30:37.925891+0000 mon.a (mon.0) 7186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:38 smithi044 bash[22676]: audit 2024-09-21T01:30:37.937001+0000 mon.a (mon.0) 7187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:38 smithi179 bash[23186]: cluster 2024-09-21T01:30:36.695583+0000 mgr.a (mgr.14388) 8486 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:38 smithi179 bash[23186]: audit 2024-09-21T01:30:36.737590+0000 mgr.a (mgr.14388) 8487 : audit [DBG] from='client.189951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:38 smithi179 bash[23186]: audit 2024-09-21T01:30:37.916486+0000 mon.a (mon.0) 7185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:38 smithi179 bash[23186]: audit 2024-09-21T01:30:37.925891+0000 mon.a (mon.0) 7186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:38 smithi179 bash[23186]: audit 2024-09-21T01:30:37.937001+0000 mon.a (mon.0) 7187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:38 smithi049 bash[23528]: cluster 2024-09-21T01:30:36.695583+0000 mgr.a (mgr.14388) 8486 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:38 smithi049 bash[23528]: audit 2024-09-21T01:30:36.737590+0000 mgr.a (mgr.14388) 8487 : audit [DBG] from='client.189951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:38 smithi049 bash[23528]: audit 2024-09-21T01:30:37.916486+0000 mon.a (mon.0) 7185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:38 smithi049 bash[23528]: audit 2024-09-21T01:30:37.925891+0000 mon.a (mon.0) 7186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:38 smithi049 bash[23528]: audit 2024-09-21T01:30:37.937001+0000 mon.a (mon.0) 7187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:40 smithi044 bash[22676]: cluster 2024-09-21T01:30:38.696521+0000 mgr.a (mgr.14388) 8488 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:40 smithi179 bash[23186]: cluster 2024-09-21T01:30:38.696521+0000 mgr.a (mgr.14388) 8488 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:40 smithi049 bash[23528]: cluster 2024-09-21T01:30:38.696521+0000 mgr.a (mgr.14388) 8488 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:42 smithi044 bash[22676]: cluster 2024-09-21T01:30:40.698771+0000 mgr.a (mgr.14388) 8489 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:42 smithi179 bash[23186]: cluster 2024-09-21T01:30:40.698771+0000 mgr.a (mgr.14388) 8489 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:42 smithi049 bash[23528]: cluster 2024-09-21T01:30:40.698771+0000 mgr.a (mgr.14388) 8489 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:42.979 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:42.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:42.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:42.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:43 smithi044 bash[22676]: audit 2024-09-21T01:30:42.523937+0000 mgr.a (mgr.14388) 8490 : audit [DBG] from='client.190029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:43 smithi179 bash[23186]: audit 2024-09-21T01:30:42.523937+0000 mgr.a (mgr.14388) 8490 : audit [DBG] from='client.190029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:43 smithi049 bash[23528]: audit 2024-09-21T01:30:42.523937+0000 mgr.a (mgr.14388) 8490 : audit [DBG] from='client.190029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:44 smithi044 bash[22676]: cluster 2024-09-21T01:30:42.699763+0000 mgr.a (mgr.14388) 8491 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:44 smithi179 bash[23186]: cluster 2024-09-21T01:30:42.699763+0000 mgr.a (mgr.14388) 8491 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:44 smithi049 bash[23528]: cluster 2024-09-21T01:30:42.699763+0000 mgr.a (mgr.14388) 8491 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:46 smithi044 bash[22676]: cluster 2024-09-21T01:30:44.700731+0000 mgr.a (mgr.14388) 8492 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:46 smithi179 bash[23186]: cluster 2024-09-21T01:30:44.700731+0000 mgr.a (mgr.14388) 8492 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:46 smithi049 bash[23528]: cluster 2024-09-21T01:30:44.700731+0000 mgr.a (mgr.14388) 8492 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:47.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:47.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:47.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:48 smithi044 bash[22676]: cluster 2024-09-21T01:30:46.703065+0000 mgr.a (mgr.14388) 8493 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:48.745 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:48.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:48.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:48.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:48.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:48 smithi179 bash[23186]: cluster 2024-09-21T01:30:46.703065+0000 mgr.a (mgr.14388) 8493 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:48 smithi049 bash[23528]: cluster 2024-09-21T01:30:46.703065+0000 mgr.a (mgr.14388) 8493 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:49 smithi179 bash[23186]: audit 2024-09-21T01:30:48.315372+0000 mgr.a (mgr.14388) 8494 : audit [DBG] from='client.190104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:49 smithi044 bash[22676]: audit 2024-09-21T01:30:48.315372+0000 mgr.a (mgr.14388) 8494 : audit [DBG] from='client.190104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:49 smithi049 bash[23528]: audit 2024-09-21T01:30:48.315372+0000 mgr.a (mgr.14388) 8494 : audit [DBG] from='client.190104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:50.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:50 smithi179 bash[23186]: cluster 2024-09-21T01:30:48.703682+0000 mgr.a (mgr.14388) 8495 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:50 smithi044 bash[22676]: cluster 2024-09-21T01:30:48.703682+0000 mgr.a (mgr.14388) 8495 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:50 smithi049 bash[23528]: cluster 2024-09-21T01:30:48.703682+0000 mgr.a (mgr.14388) 8495 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:52.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:52 smithi044 bash[22676]: cluster 2024-09-21T01:30:50.705880+0000 mgr.a (mgr.14388) 8496 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:52.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:52 smithi044 bash[22676]: audit 2024-09-21T01:30:52.028141+0000 mon.a (mon.0) 7188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:52 smithi044 bash[22676]: audit 2024-09-21T01:30:52.033900+0000 mon.a (mon.0) 7189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:52 smithi044 bash[22676]: audit 2024-09-21T01:30:52.039444+0000 mon.a (mon.0) 7190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:52 smithi179 bash[23186]: cluster 2024-09-21T01:30:50.705880+0000 mgr.a (mgr.14388) 8496 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:52 smithi179 bash[23186]: audit 2024-09-21T01:30:52.028141+0000 mon.a (mon.0) 7188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:52 smithi179 bash[23186]: audit 2024-09-21T01:30:52.033900+0000 mon.a (mon.0) 7189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:52 smithi179 bash[23186]: audit 2024-09-21T01:30:52.039444+0000 mon.a (mon.0) 7190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:52 smithi049 bash[23528]: cluster 2024-09-21T01:30:50.705880+0000 mgr.a (mgr.14388) 8496 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:52 smithi049 bash[23528]: audit 2024-09-21T01:30:52.028141+0000 mon.a (mon.0) 7188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:52 smithi049 bash[23528]: audit 2024-09-21T01:30:52.033900+0000 mon.a (mon.0) 7189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:52 smithi049 bash[23528]: audit 2024-09-21T01:30:52.039444+0000 mon.a (mon.0) 7190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:53.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:53.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:53.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:53.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:53 smithi044 bash[22676]: audit 2024-09-21T01:30:52.559794+0000 mon.a (mon.0) 7191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:53.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:53 smithi044 bash[22676]: audit 2024-09-21T01:30:52.570220+0000 mon.a (mon.0) 7192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:53.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:53 smithi044 bash[22676]: audit 2024-09-21T01:30:52.581927+0000 mon.a (mon.0) 7193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:53.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:53 smithi044 bash[22676]: cluster 2024-09-21T01:30:52.706706+0000 mgr.a (mgr.14388) 8497 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:53 smithi179 bash[23186]: audit 2024-09-21T01:30:52.559794+0000 mon.a (mon.0) 7191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:53 smithi179 bash[23186]: audit 2024-09-21T01:30:52.570220+0000 mon.a (mon.0) 7192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:53 smithi179 bash[23186]: audit 2024-09-21T01:30:52.581927+0000 mon.a (mon.0) 7193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:53 smithi179 bash[23186]: cluster 2024-09-21T01:30:52.706706+0000 mgr.a (mgr.14388) 8497 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:53 smithi049 bash[23528]: audit 2024-09-21T01:30:52.559794+0000 mon.a (mon.0) 7191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:53 smithi049 bash[23528]: audit 2024-09-21T01:30:52.570220+0000 mon.a (mon.0) 7192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:53 smithi049 bash[23528]: audit 2024-09-21T01:30:52.581927+0000 mon.a (mon.0) 7193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:53 smithi049 bash[23528]: cluster 2024-09-21T01:30:52.706706+0000 mgr.a (mgr.14388) 8497 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:30:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:30:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:30:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:30:54.522 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:30:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:54 smithi044 bash[22676]: audit 2024-09-21T01:30:54.086017+0000 mgr.a (mgr.14388) 8498 : audit [DBG] from='client.190182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:54 smithi179 bash[23186]: audit 2024-09-21T01:30:54.086017+0000 mgr.a (mgr.14388) 8498 : audit [DBG] from='client.190182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:54 smithi049 bash[23528]: audit 2024-09-21T01:30:54.086017+0000 mgr.a (mgr.14388) 8498 : audit [DBG] from='client.190182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:30:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:55 smithi044 bash[22676]: cluster 2024-09-21T01:30:54.707703+0000 mgr.a (mgr.14388) 8499 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:55 smithi179 bash[23186]: cluster 2024-09-21T01:30:54.707703+0000 mgr.a (mgr.14388) 8499 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:55 smithi049 bash[23528]: cluster 2024-09-21T01:30:54.707703+0000 mgr.a (mgr.14388) 8499 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:30:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:57 smithi049 bash[23528]: cluster 2024-09-21T01:30:56.709425+0000 mgr.a (mgr.14388) 8500 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:57 smithi044 bash[22676]: cluster 2024-09-21T01:30:56.709425+0000 mgr.a (mgr.14388) 8500 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:57 smithi179 bash[23186]: cluster 2024-09-21T01:30:56.709425+0000 mgr.a (mgr.14388) 8500 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:30:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:59 smithi044 bash[22676]: audit 2024-09-21T01:30:58.155321+0000 mon.a (mon.0) 7194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:59 smithi044 bash[22676]: audit 2024-09-21T01:30:58.164343+0000 mon.a (mon.0) 7195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:30:59 smithi044 bash[22676]: audit 2024-09-21T01:30:58.175362+0000 mon.a (mon.0) 7196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:59 smithi179 bash[23186]: audit 2024-09-21T01:30:58.155321+0000 mon.a (mon.0) 7194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:59 smithi179 bash[23186]: audit 2024-09-21T01:30:58.164343+0000 mon.a (mon.0) 7195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:30:59 smithi179 bash[23186]: audit 2024-09-21T01:30:58.175362+0000 mon.a (mon.0) 7196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:30:59.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:30:59.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:30:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:59 smithi049 bash[23528]: audit 2024-09-21T01:30:58.155321+0000 mon.a (mon.0) 7194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:59 smithi049 bash[23528]: audit 2024-09-21T01:30:58.164343+0000 mon.a (mon.0) 7195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:30:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:30:59 smithi049 bash[23528]: audit 2024-09-21T01:30:58.175362+0000 mon.a (mon.0) 7196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:00.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:00.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:00.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:00.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:00.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:00 smithi044 bash[22676]: cluster 2024-09-21T01:30:58.710205+0000 mgr.a (mgr.14388) 8501 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:00 smithi179 bash[23186]: cluster 2024-09-21T01:30:58.710205+0000 mgr.a (mgr.14388) 8501 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:00 smithi049 bash[23528]: cluster 2024-09-21T01:30:58.710205+0000 mgr.a (mgr.14388) 8501 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:01 smithi044 bash[22676]: audit 2024-09-21T01:30:59.859808+0000 mgr.a (mgr.14388) 8502 : audit [DBG] from='client.190254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:01 smithi179 bash[23186]: audit 2024-09-21T01:30:59.859808+0000 mgr.a (mgr.14388) 8502 : audit [DBG] from='client.190254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:01 smithi049 bash[23528]: audit 2024-09-21T01:30:59.859808+0000 mgr.a (mgr.14388) 8502 : audit [DBG] from='client.190254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:02 smithi044 bash[22676]: cluster 2024-09-21T01:31:00.713078+0000 mgr.a (mgr.14388) 8503 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:02 smithi179 bash[23186]: cluster 2024-09-21T01:31:00.713078+0000 mgr.a (mgr.14388) 8503 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:02 smithi049 bash[23528]: cluster 2024-09-21T01:31:00.713078+0000 mgr.a (mgr.14388) 8503 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:03.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22930]: debug 2024-09-21T01:31:03.037+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:31:03.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22930]: debug 2024-09-21T01:31:03.037+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:31:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22676]: audit 2024-09-21T01:31:02.225034+0000 mon.a (mon.0) 7197 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:31:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22676]: audit 2024-09-21T01:31:02.233131+0000 mon.a (mon.0) 7198 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:31:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22676]: audit 2024-09-21T01:31:02.235023+0000 mon.a (mon.0) 7199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:31:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22676]: audit 2024-09-21T01:31:02.246083+0000 mon.a (mon.0) 7200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22676]: audit 2024-09-21T01:31:02.252419+0000 mon.a (mon.0) 7201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:31:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:03 smithi044 bash[22676]: audit 2024-09-21T01:31:02.254940+0000 mgr.a (mgr.14388) 8504 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:31:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:03 smithi179 bash[23186]: audit 2024-09-21T01:31:02.225034+0000 mon.a (mon.0) 7197 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:31:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:03 smithi179 bash[23186]: audit 2024-09-21T01:31:02.233131+0000 mon.a (mon.0) 7198 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:31:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:03 smithi179 bash[23186]: audit 2024-09-21T01:31:02.235023+0000 mon.a (mon.0) 7199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:31:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:03 smithi179 bash[23186]: audit 2024-09-21T01:31:02.246083+0000 mon.a (mon.0) 7200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:03 smithi179 bash[23186]: audit 2024-09-21T01:31:02.252419+0000 mon.a (mon.0) 7201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:31:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:03 smithi179 bash[23186]: audit 2024-09-21T01:31:02.254940+0000 mgr.a (mgr.14388) 8504 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:31:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:03 smithi049 bash[23528]: audit 2024-09-21T01:31:02.225034+0000 mon.a (mon.0) 7197 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:31:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:03 smithi049 bash[23528]: audit 2024-09-21T01:31:02.233131+0000 mon.a (mon.0) 7198 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:31:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:03 smithi049 bash[23528]: audit 2024-09-21T01:31:02.235023+0000 mon.a (mon.0) 7199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:31:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:03 smithi049 bash[23528]: audit 2024-09-21T01:31:02.246083+0000 mon.a (mon.0) 7200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:03 smithi049 bash[23528]: audit 2024-09-21T01:31:02.252419+0000 mon.a (mon.0) 7201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:31:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:03 smithi049 bash[23528]: audit 2024-09-21T01:31:02.254940+0000 mgr.a (mgr.14388) 8504 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:31:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:04 smithi179 bash[23186]: cluster 2024-09-21T01:31:02.718605+0000 mgr.a (mgr.14388) 8505 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:04 smithi179 bash[23186]: audit 2024-09-21T01:31:03.037996+0000 mgr.a (mgr.14388) 8506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:31:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:04 smithi179 bash[23186]: cephadm 2024-09-21T01:31:03.039174+0000 mgr.a (mgr.14388) 8507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:31:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:04 smithi049 bash[23528]: cluster 2024-09-21T01:31:02.718605+0000 mgr.a (mgr.14388) 8505 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:04 smithi049 bash[23528]: audit 2024-09-21T01:31:03.037996+0000 mgr.a (mgr.14388) 8506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:31:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:04 smithi049 bash[23528]: cephadm 2024-09-21T01:31:03.039174+0000 mgr.a (mgr.14388) 8507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:31:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:04 smithi044 bash[22676]: cluster 2024-09-21T01:31:02.718605+0000 mgr.a (mgr.14388) 8505 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:04 smithi044 bash[22676]: audit 2024-09-21T01:31:03.037996+0000 mgr.a (mgr.14388) 8506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:31:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:04 smithi044 bash[22676]: cephadm 2024-09-21T01:31:03.039174+0000 mgr.a (mgr.14388) 8507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:31:05.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:05.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:05.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:06.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:06.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:06.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:06.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:06.074 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:06 smithi049 bash[23528]: cluster 2024-09-21T01:31:04.719522+0000 mgr.a (mgr.14388) 8508 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:06 smithi044 bash[22676]: cluster 2024-09-21T01:31:04.719522+0000 mgr.a (mgr.14388) 8508 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:06 smithi179 bash[23186]: cluster 2024-09-21T01:31:04.719522+0000 mgr.a (mgr.14388) 8508 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:07 smithi049 bash[23528]: audit 2024-09-21T01:31:05.648837+0000 mgr.a (mgr.14388) 8509 : audit [DBG] from='client.190434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:07 smithi044 bash[22676]: audit 2024-09-21T01:31:05.648837+0000 mgr.a (mgr.14388) 8509 : audit [DBG] from='client.190434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:07 smithi179 bash[23186]: audit 2024-09-21T01:31:05.648837+0000 mgr.a (mgr.14388) 8509 : audit [DBG] from='client.190434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:08 smithi179 bash[23186]: cluster 2024-09-21T01:31:06.722425+0000 mgr.a (mgr.14388) 8510 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:08 smithi049 bash[23528]: cluster 2024-09-21T01:31:06.722425+0000 mgr.a (mgr.14388) 8510 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:08 smithi044 bash[22676]: cluster 2024-09-21T01:31:06.722425+0000 mgr.a (mgr.14388) 8510 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:10 smithi049 bash[23528]: cluster 2024-09-21T01:31:08.723249+0000 mgr.a (mgr.14388) 8511 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:31:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:10 smithi044 bash[22676]: cluster 2024-09-21T01:31:08.723249+0000 mgr.a (mgr.14388) 8511 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:31:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:10 smithi179 bash[23186]: cluster 2024-09-21T01:31:08.723249+0000 mgr.a (mgr.14388) 8511 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:31:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:11.826 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:11.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:11.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:11.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:11.826 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:12.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:12 smithi044 bash[22676]: cluster 2024-09-21T01:31:10.725303+0000 mgr.a (mgr.14388) 8512 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:12.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:12 smithi044 bash[22676]: audit 2024-09-21T01:31:11.406936+0000 mgr.a (mgr.14388) 8513 : audit [DBG] from='client.190512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:12.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:12 smithi044 bash[22676]: audit 2024-09-21T01:31:12.206023+0000 mon.a (mon.0) 7202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:12 smithi044 bash[22676]: audit 2024-09-21T01:31:12.212326+0000 mon.a (mon.0) 7203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:12 smithi044 bash[22676]: audit 2024-09-21T01:31:12.218246+0000 mon.a (mon.0) 7204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:12 smithi179 bash[23186]: cluster 2024-09-21T01:31:10.725303+0000 mgr.a (mgr.14388) 8512 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:12 smithi179 bash[23186]: audit 2024-09-21T01:31:11.406936+0000 mgr.a (mgr.14388) 8513 : audit [DBG] from='client.190512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:12 smithi179 bash[23186]: audit 2024-09-21T01:31:12.206023+0000 mon.a (mon.0) 7202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:12 smithi179 bash[23186]: audit 2024-09-21T01:31:12.212326+0000 mon.a (mon.0) 7203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:12 smithi179 bash[23186]: audit 2024-09-21T01:31:12.218246+0000 mon.a (mon.0) 7204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:12 smithi049 bash[23528]: cluster 2024-09-21T01:31:10.725303+0000 mgr.a (mgr.14388) 8512 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:12 smithi049 bash[23528]: audit 2024-09-21T01:31:11.406936+0000 mgr.a (mgr.14388) 8513 : audit [DBG] from='client.190512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:12 smithi049 bash[23528]: audit 2024-09-21T01:31:12.206023+0000 mon.a (mon.0) 7202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:12 smithi049 bash[23528]: audit 2024-09-21T01:31:12.212326+0000 mon.a (mon.0) 7203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:12 smithi049 bash[23528]: audit 2024-09-21T01:31:12.218246+0000 mon.a (mon.0) 7204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:13 smithi049 bash[23528]: cluster 2024-09-21T01:31:12.725907+0000 mgr.a (mgr.14388) 8514 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:13 smithi049 bash[23528]: audit 2024-09-21T01:31:12.766766+0000 mon.a (mon.0) 7205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:13 smithi049 bash[23528]: audit 2024-09-21T01:31:12.774960+0000 mon.a (mon.0) 7206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:13 smithi049 bash[23528]: audit 2024-09-21T01:31:12.785536+0000 mon.a (mon.0) 7207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:13 smithi044 bash[22676]: cluster 2024-09-21T01:31:12.725907+0000 mgr.a (mgr.14388) 8514 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:13 smithi044 bash[22676]: audit 2024-09-21T01:31:12.766766+0000 mon.a (mon.0) 7205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:13 smithi044 bash[22676]: audit 2024-09-21T01:31:12.774960+0000 mon.a (mon.0) 7206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:13 smithi044 bash[22676]: audit 2024-09-21T01:31:12.785536+0000 mon.a (mon.0) 7207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:13 smithi179 bash[23186]: cluster 2024-09-21T01:31:12.725907+0000 mgr.a (mgr.14388) 8514 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:13 smithi179 bash[23186]: audit 2024-09-21T01:31:12.766766+0000 mon.a (mon.0) 7205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:13 smithi179 bash[23186]: audit 2024-09-21T01:31:12.774960+0000 mon.a (mon.0) 7206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:13 smithi179 bash[23186]: audit 2024-09-21T01:31:12.785536+0000 mon.a (mon.0) 7207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:15 smithi049 bash[23528]: cluster 2024-09-21T01:31:14.726671+0000 mgr.a (mgr.14388) 8515 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:15 smithi044 bash[22676]: cluster 2024-09-21T01:31:14.726671+0000 mgr.a (mgr.14388) 8515 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:15 smithi179 bash[23186]: cluster 2024-09-21T01:31:14.726671+0000 mgr.a (mgr.14388) 8515 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:16.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:16.828 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:16.828 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:17.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:17.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:17.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:17.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:17.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:17 smithi049 bash[23528]: cluster 2024-09-21T01:31:16.728886+0000 mgr.a (mgr.14388) 8516 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:17 smithi049 bash[23528]: audit 2024-09-21T01:31:17.157920+0000 mgr.a (mgr.14388) 8517 : audit [DBG] from='client.190587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:17 smithi044 bash[22676]: cluster 2024-09-21T01:31:16.728886+0000 mgr.a (mgr.14388) 8516 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:17 smithi044 bash[22676]: audit 2024-09-21T01:31:17.157920+0000 mgr.a (mgr.14388) 8517 : audit [DBG] from='client.190587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:17 smithi179 bash[23186]: cluster 2024-09-21T01:31:16.728886+0000 mgr.a (mgr.14388) 8516 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:31:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:17 smithi179 bash[23186]: audit 2024-09-21T01:31:17.157920+0000 mgr.a (mgr.14388) 8517 : audit [DBG] from='client.190587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:19 smithi044 bash[22676]: audit 2024-09-21T01:31:18.384410+0000 mon.a (mon.0) 7208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:19 smithi044 bash[22676]: audit 2024-09-21T01:31:18.392762+0000 mon.a (mon.0) 7209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:19 smithi044 bash[22676]: audit 2024-09-21T01:31:18.403175+0000 mon.a (mon.0) 7210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:19 smithi179 bash[23186]: audit 2024-09-21T01:31:18.384410+0000 mon.a (mon.0) 7208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:19 smithi179 bash[23186]: audit 2024-09-21T01:31:18.392762+0000 mon.a (mon.0) 7209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:19 smithi179 bash[23186]: audit 2024-09-21T01:31:18.403175+0000 mon.a (mon.0) 7210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:19 smithi049 bash[23528]: audit 2024-09-21T01:31:18.384410+0000 mon.a (mon.0) 7208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:19 smithi049 bash[23528]: audit 2024-09-21T01:31:18.392762+0000 mon.a (mon.0) 7209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:19 smithi049 bash[23528]: audit 2024-09-21T01:31:18.403175+0000 mon.a (mon.0) 7210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:20 smithi044 bash[22676]: cluster 2024-09-21T01:31:18.729869+0000 mgr.a (mgr.14388) 8518 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:20 smithi179 bash[23186]: cluster 2024-09-21T01:31:18.729869+0000 mgr.a (mgr.14388) 8518 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:20 smithi049 bash[23528]: cluster 2024-09-21T01:31:18.729869+0000 mgr.a (mgr.14388) 8518 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:22.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:22.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:22.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:22 smithi044 bash[22676]: cluster 2024-09-21T01:31:20.732117+0000 mgr.a (mgr.14388) 8519 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:22 smithi179 bash[23186]: cluster 2024-09-21T01:31:20.732117+0000 mgr.a (mgr.14388) 8519 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:22 smithi049 bash[23528]: cluster 2024-09-21T01:31:20.732117+0000 mgr.a (mgr.14388) 8519 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:23.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:23.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:24 smithi044 bash[22676]: cluster 2024-09-21T01:31:22.732675+0000 mgr.a (mgr.14388) 8520 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:24 smithi044 bash[22676]: audit 2024-09-21T01:31:22.915166+0000 mgr.a (mgr.14388) 8521 : audit [DBG] from='client.190665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:24.736 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:24 smithi049 bash[23528]: cluster 2024-09-21T01:31:22.732675+0000 mgr.a (mgr.14388) 8520 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:24.737 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:24 smithi049 bash[23528]: audit 2024-09-21T01:31:22.915166+0000 mgr.a (mgr.14388) 8521 : audit [DBG] from='client.190665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:24 smithi179 bash[23186]: cluster 2024-09-21T01:31:22.732675+0000 mgr.a (mgr.14388) 8520 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:24 smithi179 bash[23186]: audit 2024-09-21T01:31:22.915166+0000 mgr.a (mgr.14388) 8521 : audit [DBG] from='client.190665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:26 smithi044 bash[22676]: cluster 2024-09-21T01:31:24.733615+0000 mgr.a (mgr.14388) 8522 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:26 smithi179 bash[23186]: cluster 2024-09-21T01:31:24.733615+0000 mgr.a (mgr.14388) 8522 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:26 smithi049 bash[23528]: cluster 2024-09-21T01:31:24.733615+0000 mgr.a (mgr.14388) 8522 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:28.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:28.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:28.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:28 smithi044 bash[22676]: cluster 2024-09-21T01:31:26.736011+0000 mgr.a (mgr.14388) 8523 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:28 smithi179 bash[23186]: cluster 2024-09-21T01:31:26.736011+0000 mgr.a (mgr.14388) 8523 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:28 smithi049 bash[23528]: cluster 2024-09-21T01:31:26.736011+0000 mgr.a (mgr.14388) 8523 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:29.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:29.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:29.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:29.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:30 smithi044 bash[22676]: audit 2024-09-21T01:31:28.709845+0000 mgr.a (mgr.14388) 8524 : audit [DBG] from='client.190740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:30 smithi044 bash[22676]: cluster 2024-09-21T01:31:28.737170+0000 mgr.a (mgr.14388) 8525 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:30 smithi179 bash[23186]: audit 2024-09-21T01:31:28.709845+0000 mgr.a (mgr.14388) 8524 : audit [DBG] from='client.190740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:30 smithi179 bash[23186]: cluster 2024-09-21T01:31:28.737170+0000 mgr.a (mgr.14388) 8525 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:30 smithi049 bash[23528]: audit 2024-09-21T01:31:28.709845+0000 mgr.a (mgr.14388) 8524 : audit [DBG] from='client.190740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:30 smithi049 bash[23528]: cluster 2024-09-21T01:31:28.737170+0000 mgr.a (mgr.14388) 8525 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:32.562 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:32 smithi044 bash[22676]: cluster 2024-09-21T01:31:30.739538+0000 mgr.a (mgr.14388) 8526 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:32.562 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:32 smithi044 bash[22676]: audit 2024-09-21T01:31:32.403245+0000 mon.a (mon.0) 7211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.562 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:32 smithi044 bash[22676]: audit 2024-09-21T01:31:32.407644+0000 mon.a (mon.0) 7212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:32 smithi044 bash[22676]: audit 2024-09-21T01:31:32.412812+0000 mon.a (mon.0) 7213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:32 smithi179 bash[23186]: cluster 2024-09-21T01:31:30.739538+0000 mgr.a (mgr.14388) 8526 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:32.771 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:32 smithi179 bash[23186]: audit 2024-09-21T01:31:32.403245+0000 mon.a (mon.0) 7211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:32 smithi179 bash[23186]: audit 2024-09-21T01:31:32.407644+0000 mon.a (mon.0) 7212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:32 smithi179 bash[23186]: audit 2024-09-21T01:31:32.412812+0000 mon.a (mon.0) 7213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:32 smithi049 bash[23528]: cluster 2024-09-21T01:31:30.739538+0000 mgr.a (mgr.14388) 8526 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:32 smithi049 bash[23528]: audit 2024-09-21T01:31:32.403245+0000 mon.a (mon.0) 7211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:32 smithi049 bash[23528]: audit 2024-09-21T01:31:32.407644+0000 mon.a (mon.0) 7212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:32 smithi049 bash[23528]: audit 2024-09-21T01:31:32.412812+0000 mon.a (mon.0) 7213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:33 smithi044 bash[22676]: cluster 2024-09-21T01:31:32.740334+0000 mgr.a (mgr.14388) 8527 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:33 smithi044 bash[22676]: audit 2024-09-21T01:31:32.946901+0000 mon.a (mon.0) 7214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:33 smithi044 bash[22676]: audit 2024-09-21T01:31:32.955071+0000 mon.a (mon.0) 7215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:33 smithi044 bash[22676]: audit 2024-09-21T01:31:32.965309+0000 mon.a (mon.0) 7216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:33 smithi179 bash[23186]: cluster 2024-09-21T01:31:32.740334+0000 mgr.a (mgr.14388) 8527 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:33 smithi179 bash[23186]: audit 2024-09-21T01:31:32.946901+0000 mon.a (mon.0) 7214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:33 smithi179 bash[23186]: audit 2024-09-21T01:31:32.955071+0000 mon.a (mon.0) 7215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:33 smithi179 bash[23186]: audit 2024-09-21T01:31:32.965309+0000 mon.a (mon.0) 7216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:33 smithi049 bash[23528]: cluster 2024-09-21T01:31:32.740334+0000 mgr.a (mgr.14388) 8527 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:33 smithi049 bash[23528]: audit 2024-09-21T01:31:32.946901+0000 mon.a (mon.0) 7214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:33 smithi049 bash[23528]: audit 2024-09-21T01:31:32.955071+0000 mon.a (mon.0) 7215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:33 smithi049 bash[23528]: audit 2024-09-21T01:31:32.965309+0000 mon.a (mon.0) 7216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:34.910 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:34.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:34.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:34.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:34.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:34 smithi044 bash[22676]: audit 2024-09-21T01:31:34.485426+0000 mgr.a (mgr.14388) 8528 : audit [DBG] from='client.190818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:34 smithi179 bash[23186]: audit 2024-09-21T01:31:34.485426+0000 mgr.a (mgr.14388) 8528 : audit [DBG] from='client.190818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:34 smithi049 bash[23528]: audit 2024-09-21T01:31:34.485426+0000 mgr.a (mgr.14388) 8528 : audit [DBG] from='client.190818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:35 smithi044 bash[22676]: cluster 2024-09-21T01:31:34.740886+0000 mgr.a (mgr.14388) 8529 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:35 smithi179 bash[23186]: cluster 2024-09-21T01:31:34.740886+0000 mgr.a (mgr.14388) 8529 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:35 smithi049 bash[23528]: cluster 2024-09-21T01:31:34.740886+0000 mgr.a (mgr.14388) 8529 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:37 smithi044 bash[22676]: cluster 2024-09-21T01:31:36.743231+0000 mgr.a (mgr.14388) 8530 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:37 smithi179 bash[23186]: cluster 2024-09-21T01:31:36.743231+0000 mgr.a (mgr.14388) 8530 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:37 smithi049 bash[23528]: cluster 2024-09-21T01:31:36.743231+0000 mgr.a (mgr.14388) 8530 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:39 smithi044 bash[22676]: audit 2024-09-21T01:31:38.595840+0000 mon.a (mon.0) 7217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:39 smithi044 bash[22676]: audit 2024-09-21T01:31:38.605756+0000 mon.a (mon.0) 7218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:39 smithi044 bash[22676]: audit 2024-09-21T01:31:38.617999+0000 mon.a (mon.0) 7219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:39 smithi044 bash[22676]: cluster 2024-09-21T01:31:38.744157+0000 mgr.a (mgr.14388) 8531 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:39 smithi179 bash[23186]: audit 2024-09-21T01:31:38.595840+0000 mon.a (mon.0) 7217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:39 smithi179 bash[23186]: audit 2024-09-21T01:31:38.605756+0000 mon.a (mon.0) 7218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:39 smithi179 bash[23186]: audit 2024-09-21T01:31:38.617999+0000 mon.a (mon.0) 7219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:39 smithi179 bash[23186]: cluster 2024-09-21T01:31:38.744157+0000 mgr.a (mgr.14388) 8531 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:39 smithi049 bash[23528]: audit 2024-09-21T01:31:38.595840+0000 mon.a (mon.0) 7217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:39 smithi049 bash[23528]: audit 2024-09-21T01:31:38.605756+0000 mon.a (mon.0) 7218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:39 smithi049 bash[23528]: audit 2024-09-21T01:31:38.617999+0000 mon.a (mon.0) 7219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:39 smithi049 bash[23528]: cluster 2024-09-21T01:31:38.744157+0000 mgr.a (mgr.14388) 8531 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:40.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:40.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:40.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:40.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:40.702 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:40 smithi044 bash[22676]: audit 2024-09-21T01:31:40.248180+0000 mgr.a (mgr.14388) 8532 : audit [DBG] from='client.190896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:40 smithi179 bash[23186]: audit 2024-09-21T01:31:40.248180+0000 mgr.a (mgr.14388) 8532 : audit [DBG] from='client.190896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:40 smithi049 bash[23528]: audit 2024-09-21T01:31:40.248180+0000 mgr.a (mgr.14388) 8532 : audit [DBG] from='client.190896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:41 smithi044 bash[22676]: cluster 2024-09-21T01:31:40.745559+0000 mgr.a (mgr.14388) 8533 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:41 smithi179 bash[23186]: cluster 2024-09-21T01:31:40.745559+0000 mgr.a (mgr.14388) 8533 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:41 smithi049 bash[23528]: cluster 2024-09-21T01:31:40.745559+0000 mgr.a (mgr.14388) 8533 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:43 smithi044 bash[22676]: cluster 2024-09-21T01:31:42.746257+0000 mgr.a (mgr.14388) 8534 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:31:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:43 smithi179 bash[23186]: cluster 2024-09-21T01:31:42.746257+0000 mgr.a (mgr.14388) 8534 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:31:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:43 smithi049 bash[23528]: cluster 2024-09-21T01:31:42.746257+0000 mgr.a (mgr.14388) 8534 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:31:45.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:45.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:45.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:45 smithi044 bash[22676]: cluster 2024-09-21T01:31:44.747022+0000 mgr.a (mgr.14388) 8535 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:31:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:45 smithi179 bash[23186]: cluster 2024-09-21T01:31:44.747022+0000 mgr.a (mgr.14388) 8535 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:31:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:45 smithi049 bash[23528]: cluster 2024-09-21T01:31:44.747022+0000 mgr.a (mgr.14388) 8535 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:31:46.493 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:46.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:46.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:46.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:46.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:46 smithi044 bash[22676]: audit 2024-09-21T01:31:46.042706+0000 mgr.a (mgr.14388) 8536 : audit [DBG] from='client.190971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:46 smithi179 bash[23186]: audit 2024-09-21T01:31:46.042706+0000 mgr.a (mgr.14388) 8536 : audit [DBG] from='client.190971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:46 smithi049 bash[23528]: audit 2024-09-21T01:31:46.042706+0000 mgr.a (mgr.14388) 8536 : audit [DBG] from='client.190971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:47 smithi044 bash[22676]: cluster 2024-09-21T01:31:46.749832+0000 mgr.a (mgr.14388) 8537 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:47 smithi179 bash[23186]: cluster 2024-09-21T01:31:46.749832+0000 mgr.a (mgr.14388) 8537 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:47 smithi049 bash[23528]: cluster 2024-09-21T01:31:46.749832+0000 mgr.a (mgr.14388) 8537 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:49.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:49 smithi049 bash[23528]: cluster 2024-09-21T01:31:48.750617+0000 mgr.a (mgr.14388) 8538 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:49 smithi179 bash[23186]: cluster 2024-09-21T01:31:48.750617+0000 mgr.a (mgr.14388) 8538 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:49 smithi044 bash[22676]: cluster 2024-09-21T01:31:48.750617+0000 mgr.a (mgr.14388) 8538 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:31:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:52.108 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:51 smithi049 bash[23528]: cluster 2024-09-21T01:31:50.752626+0000 mgr.a (mgr.14388) 8539 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:52.170 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:51 smithi179 bash[23186]: cluster 2024-09-21T01:31:50.752626+0000 mgr.a (mgr.14388) 8539 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:51 smithi044 bash[22676]: cluster 2024-09-21T01:31:50.752626+0000 mgr.a (mgr.14388) 8539 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:52.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:52.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:52.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:52.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:52.280 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:52 smithi179 bash[23186]: audit 2024-09-21T01:31:51.832567+0000 mgr.a (mgr.14388) 8540 : audit [DBG] from='client.191046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:52 smithi179 bash[23186]: audit 2024-09-21T01:31:52.601980+0000 mon.a (mon.0) 7220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:52 smithi179 bash[23186]: audit 2024-09-21T01:31:52.608936+0000 mon.a (mon.0) 7221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:52 smithi179 bash[23186]: audit 2024-09-21T01:31:52.618854+0000 mon.a (mon.0) 7222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.147 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:52 smithi044 bash[22676]: audit 2024-09-21T01:31:51.832567+0000 mgr.a (mgr.14388) 8540 : audit [DBG] from='client.191046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:53.147 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:52 smithi044 bash[22676]: audit 2024-09-21T01:31:52.601980+0000 mon.a (mon.0) 7220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.147 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:52 smithi044 bash[22676]: audit 2024-09-21T01:31:52.608936+0000 mon.a (mon.0) 7221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.148 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:52 smithi044 bash[22676]: audit 2024-09-21T01:31:52.618854+0000 mon.a (mon.0) 7222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:52 smithi049 bash[23528]: audit 2024-09-21T01:31:51.832567+0000 mgr.a (mgr.14388) 8540 : audit [DBG] from='client.191046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:52 smithi049 bash[23528]: audit 2024-09-21T01:31:52.601980+0000 mon.a (mon.0) 7220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:52 smithi049 bash[23528]: audit 2024-09-21T01:31:52.608936+0000 mon.a (mon.0) 7221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:52 smithi049 bash[23528]: audit 2024-09-21T01:31:52.618854+0000 mon.a (mon.0) 7222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:54 smithi044 bash[22676]: cluster 2024-09-21T01:31:52.753596+0000 mgr.a (mgr.14388) 8541 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:54 smithi044 bash[22676]: audit 2024-09-21T01:31:53.135190+0000 mon.a (mon.0) 7223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:54 smithi044 bash[22676]: audit 2024-09-21T01:31:53.141390+0000 mon.a (mon.0) 7224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:54 smithi044 bash[22676]: audit 2024-09-21T01:31:53.147322+0000 mon.a (mon.0) 7225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:54 smithi179 bash[23186]: cluster 2024-09-21T01:31:52.753596+0000 mgr.a (mgr.14388) 8541 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:54 smithi179 bash[23186]: audit 2024-09-21T01:31:53.135190+0000 mon.a (mon.0) 7223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:54 smithi179 bash[23186]: audit 2024-09-21T01:31:53.141390+0000 mon.a (mon.0) 7224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:54 smithi179 bash[23186]: audit 2024-09-21T01:31:53.147322+0000 mon.a (mon.0) 7225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:54 smithi049 bash[23528]: cluster 2024-09-21T01:31:52.753596+0000 mgr.a (mgr.14388) 8541 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:54 smithi049 bash[23528]: audit 2024-09-21T01:31:53.135190+0000 mon.a (mon.0) 7223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:54 smithi049 bash[23528]: audit 2024-09-21T01:31:53.141390+0000 mon.a (mon.0) 7224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:54 smithi049 bash[23528]: audit 2024-09-21T01:31:53.147322+0000 mon.a (mon.0) 7225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:56 smithi044 bash[22676]: cluster 2024-09-21T01:31:54.754393+0000 mgr.a (mgr.14388) 8542 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:56 smithi179 bash[23186]: cluster 2024-09-21T01:31:54.754393+0000 mgr.a (mgr.14388) 8542 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:56 smithi049 bash[23528]: cluster 2024-09-21T01:31:54.754393+0000 mgr.a (mgr.14388) 8542 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:31:57.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:31:57.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:31:57.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:31:58.052 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:31:58.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:31:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:31:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:31:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:31:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:58 smithi044 bash[22676]: cluster 2024-09-21T01:31:56.756623+0000 mgr.a (mgr.14388) 8543 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:58 smithi179 bash[23186]: cluster 2024-09-21T01:31:56.756623+0000 mgr.a (mgr.14388) 8543 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:58 smithi049 bash[23528]: cluster 2024-09-21T01:31:56.756623+0000 mgr.a (mgr.14388) 8543 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:31:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:59 smithi044 bash[22676]: audit 2024-09-21T01:31:57.623535+0000 mgr.a (mgr.14388) 8544 : audit [DBG] from='client.191121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:59 smithi044 bash[22676]: audit 2024-09-21T01:31:58.834918+0000 mon.a (mon.0) 7226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:59 smithi044 bash[22676]: audit 2024-09-21T01:31:58.843614+0000 mon.a (mon.0) 7227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:31:59 smithi044 bash[22676]: audit 2024-09-21T01:31:58.855583+0000 mon.a (mon.0) 7228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:59 smithi179 bash[23186]: audit 2024-09-21T01:31:57.623535+0000 mgr.a (mgr.14388) 8544 : audit [DBG] from='client.191121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:59 smithi179 bash[23186]: audit 2024-09-21T01:31:58.834918+0000 mon.a (mon.0) 7226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:59 smithi179 bash[23186]: audit 2024-09-21T01:31:58.843614+0000 mon.a (mon.0) 7227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:31:59 smithi179 bash[23186]: audit 2024-09-21T01:31:58.855583+0000 mon.a (mon.0) 7228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:59 smithi049 bash[23528]: audit 2024-09-21T01:31:57.623535+0000 mgr.a (mgr.14388) 8544 : audit [DBG] from='client.191121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:59 smithi049 bash[23528]: audit 2024-09-21T01:31:58.834918+0000 mon.a (mon.0) 7226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:59 smithi049 bash[23528]: audit 2024-09-21T01:31:58.843614+0000 mon.a (mon.0) 7227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:31:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:31:59 smithi049 bash[23528]: audit 2024-09-21T01:31:58.855583+0000 mon.a (mon.0) 7228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:00 smithi044 bash[22676]: cluster 2024-09-21T01:31:58.757647+0000 mgr.a (mgr.14388) 8545 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:00 smithi179 bash[23186]: cluster 2024-09-21T01:31:58.757647+0000 mgr.a (mgr.14388) 8545 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:00 smithi049 bash[23528]: cluster 2024-09-21T01:31:58.757647+0000 mgr.a (mgr.14388) 8545 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:02 smithi044 bash[22676]: cluster 2024-09-21T01:32:00.759915+0000 mgr.a (mgr.14388) 8546 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:02 smithi179 bash[23186]: cluster 2024-09-21T01:32:00.759915+0000 mgr.a (mgr.14388) 8546 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:02 smithi049 bash[23528]: cluster 2024-09-21T01:32:00.759915+0000 mgr.a (mgr.14388) 8546 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:03.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:03.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:03.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:03 smithi044 bash[22676]: audit 2024-09-21T01:32:03.095949+0000 mon.a (mon.0) 7229 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:32:03.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:03 smithi044 bash[22676]: audit 2024-09-21T01:32:03.100980+0000 mon.a (mon.0) 7230 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:32:03.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:03 smithi044 bash[22676]: audit 2024-09-21T01:32:03.102712+0000 mon.a (mon.0) 7231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:32:03.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:03 smithi044 bash[22676]: audit 2024-09-21T01:32:03.113509+0000 mon.a (mon.0) 7232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:03.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:03 smithi044 bash[22676]: audit 2024-09-21T01:32:03.119711+0000 mon.a (mon.0) 7233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:32:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:03 smithi179 bash[23186]: audit 2024-09-21T01:32:03.095949+0000 mon.a (mon.0) 7229 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:32:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:03 smithi179 bash[23186]: audit 2024-09-21T01:32:03.100980+0000 mon.a (mon.0) 7230 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:32:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:03 smithi179 bash[23186]: audit 2024-09-21T01:32:03.102712+0000 mon.a (mon.0) 7231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:32:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:03 smithi179 bash[23186]: audit 2024-09-21T01:32:03.113509+0000 mon.a (mon.0) 7232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:03 smithi179 bash[23186]: audit 2024-09-21T01:32:03.119711+0000 mon.a (mon.0) 7233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:32:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:03 smithi049 bash[23528]: audit 2024-09-21T01:32:03.095949+0000 mon.a (mon.0) 7229 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:32:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:03 smithi049 bash[23528]: audit 2024-09-21T01:32:03.100980+0000 mon.a (mon.0) 7230 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:32:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:03 smithi049 bash[23528]: audit 2024-09-21T01:32:03.102712+0000 mon.a (mon.0) 7231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:32:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:03 smithi049 bash[23528]: audit 2024-09-21T01:32:03.113509+0000 mon.a (mon.0) 7232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:03 smithi049 bash[23528]: audit 2024-09-21T01:32:03.119711+0000 mon.a (mon.0) 7233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:32:04.169 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:32:03 smithi044 bash[22930]: debug 2024-09-21T01:32:03.896+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:32:04.169 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:32:03 smithi044 bash[22930]: debug 2024-09-21T01:32:03.908+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:32:04.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:04.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:04.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:04 smithi044 bash[22676]: cluster 2024-09-21T01:32:02.760680+0000 mgr.a (mgr.14388) 8547 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:04 smithi044 bash[22676]: audit 2024-09-21T01:32:03.122080+0000 mgr.a (mgr.14388) 8548 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:32:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:04 smithi044 bash[22676]: audit 2024-09-21T01:32:03.413843+0000 mgr.a (mgr.14388) 8549 : audit [DBG] from='client.191196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:04 smithi179 bash[23186]: cluster 2024-09-21T01:32:02.760680+0000 mgr.a (mgr.14388) 8547 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:04 smithi179 bash[23186]: audit 2024-09-21T01:32:03.122080+0000 mgr.a (mgr.14388) 8548 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:32:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:04 smithi179 bash[23186]: audit 2024-09-21T01:32:03.413843+0000 mgr.a (mgr.14388) 8549 : audit [DBG] from='client.191196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:04 smithi049 bash[23528]: cluster 2024-09-21T01:32:02.760680+0000 mgr.a (mgr.14388) 8547 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:04 smithi049 bash[23528]: audit 2024-09-21T01:32:03.122080+0000 mgr.a (mgr.14388) 8548 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:32:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:04 smithi049 bash[23528]: audit 2024-09-21T01:32:03.413843+0000 mgr.a (mgr.14388) 8549 : audit [DBG] from='client.191196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:05 smithi044 bash[22676]: audit 2024-09-21T01:32:03.899091+0000 mgr.a (mgr.14388) 8550 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:32:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:05 smithi044 bash[22676]: cephadm 2024-09-21T01:32:03.910495+0000 mgr.a (mgr.14388) 8551 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:32:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:05 smithi179 bash[23186]: audit 2024-09-21T01:32:03.899091+0000 mgr.a (mgr.14388) 8550 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:32:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:05 smithi179 bash[23186]: cephadm 2024-09-21T01:32:03.910495+0000 mgr.a (mgr.14388) 8551 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:32:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:05 smithi049 bash[23528]: audit 2024-09-21T01:32:03.899091+0000 mgr.a (mgr.14388) 8550 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:32:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:05 smithi049 bash[23528]: cephadm 2024-09-21T01:32:03.910495+0000 mgr.a (mgr.14388) 8551 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:32:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:06 smithi049 bash[23528]: cluster 2024-09-21T01:32:04.761867+0000 mgr.a (mgr.14388) 8552 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:06 smithi044 bash[22676]: cluster 2024-09-21T01:32:04.761867+0000 mgr.a (mgr.14388) 8552 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:06 smithi179 bash[23186]: cluster 2024-09-21T01:32:04.761867+0000 mgr.a (mgr.14388) 8552 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:08 smithi044 bash[22676]: cluster 2024-09-21T01:32:06.764178+0000 mgr.a (mgr.14388) 8553 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:08 smithi179 bash[23186]: cluster 2024-09-21T01:32:06.764178+0000 mgr.a (mgr.14388) 8553 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:08 smithi049 bash[23528]: cluster 2024-09-21T01:32:06.764178+0000 mgr.a (mgr.14388) 8553 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:09.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:09.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:09.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:10.062 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:10 smithi044 bash[22676]: cluster 2024-09-21T01:32:08.764973+0000 mgr.a (mgr.14388) 8554 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:10 smithi179 bash[23186]: cluster 2024-09-21T01:32:08.764973+0000 mgr.a (mgr.14388) 8554 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:10 smithi049 bash[23528]: cluster 2024-09-21T01:32:08.764973+0000 mgr.a (mgr.14388) 8554 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:11 smithi044 bash[22676]: audit 2024-09-21T01:32:09.640526+0000 mgr.a (mgr.14388) 8555 : audit [DBG] from='client.191373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:11 smithi179 bash[23186]: audit 2024-09-21T01:32:09.640526+0000 mgr.a (mgr.14388) 8555 : audit [DBG] from='client.191373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:11 smithi049 bash[23528]: audit 2024-09-21T01:32:09.640526+0000 mgr.a (mgr.14388) 8555 : audit [DBG] from='client.191373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:12.454 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:12 smithi044 bash[22676]: cluster 2024-09-21T01:32:10.767856+0000 mgr.a (mgr.14388) 8556 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:12 smithi179 bash[23186]: cluster 2024-09-21T01:32:10.767856+0000 mgr.a (mgr.14388) 8556 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:12.523 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:12 smithi049 bash[23528]: cluster 2024-09-21T01:32:10.767856+0000 mgr.a (mgr.14388) 8556 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:13 smithi044 bash[22676]: cluster 2024-09-21T01:32:12.768713+0000 mgr.a (mgr.14388) 8557 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:32:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:13 smithi044 bash[22676]: audit 2024-09-21T01:32:12.831702+0000 mon.a (mon.0) 7234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:13 smithi044 bash[22676]: audit 2024-09-21T01:32:12.841073+0000 mon.a (mon.0) 7235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:13 smithi044 bash[22676]: audit 2024-09-21T01:32:12.851628+0000 mon.a (mon.0) 7236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:13 smithi044 bash[22676]: audit 2024-09-21T01:32:13.320746+0000 mon.a (mon.0) 7237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:13 smithi044 bash[22676]: audit 2024-09-21T01:32:13.325768+0000 mon.a (mon.0) 7238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:13 smithi044 bash[22676]: audit 2024-09-21T01:32:13.332208+0000 mon.a (mon.0) 7239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:13 smithi179 bash[23186]: cluster 2024-09-21T01:32:12.768713+0000 mgr.a (mgr.14388) 8557 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:32:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:13 smithi179 bash[23186]: audit 2024-09-21T01:32:12.831702+0000 mon.a (mon.0) 7234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:13 smithi179 bash[23186]: audit 2024-09-21T01:32:12.841073+0000 mon.a (mon.0) 7235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:13 smithi179 bash[23186]: audit 2024-09-21T01:32:12.851628+0000 mon.a (mon.0) 7236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:13 smithi179 bash[23186]: audit 2024-09-21T01:32:13.320746+0000 mon.a (mon.0) 7237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:13 smithi179 bash[23186]: audit 2024-09-21T01:32:13.325768+0000 mon.a (mon.0) 7238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:13 smithi179 bash[23186]: audit 2024-09-21T01:32:13.332208+0000 mon.a (mon.0) 7239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:13 smithi049 bash[23528]: cluster 2024-09-21T01:32:12.768713+0000 mgr.a (mgr.14388) 8557 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:32:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:13 smithi049 bash[23528]: audit 2024-09-21T01:32:12.831702+0000 mon.a (mon.0) 7234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:13 smithi049 bash[23528]: audit 2024-09-21T01:32:12.841073+0000 mon.a (mon.0) 7235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:13 smithi049 bash[23528]: audit 2024-09-21T01:32:12.851628+0000 mon.a (mon.0) 7236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:13 smithi049 bash[23528]: audit 2024-09-21T01:32:13.320746+0000 mon.a (mon.0) 7237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:13 smithi049 bash[23528]: audit 2024-09-21T01:32:13.325768+0000 mon.a (mon.0) 7238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:14.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:13 smithi049 bash[23528]: audit 2024-09-21T01:32:13.332208+0000 mon.a (mon.0) 7239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:15.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:15.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:15.857 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:15.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:15.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:15.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:15.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:15 smithi044 bash[22676]: cluster 2024-09-21T01:32:14.769680+0000 mgr.a (mgr.14388) 8558 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:32:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:15 smithi044 bash[22676]: audit 2024-09-21T01:32:15.396638+0000 mgr.a (mgr.14388) 8559 : audit [DBG] from='client.191448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:15 smithi179 bash[23186]: cluster 2024-09-21T01:32:14.769680+0000 mgr.a (mgr.14388) 8558 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:32:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:15 smithi179 bash[23186]: audit 2024-09-21T01:32:15.396638+0000 mgr.a (mgr.14388) 8559 : audit [DBG] from='client.191448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:15 smithi049 bash[23528]: cluster 2024-09-21T01:32:14.769680+0000 mgr.a (mgr.14388) 8558 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:32:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:15 smithi049 bash[23528]: audit 2024-09-21T01:32:15.396638+0000 mgr.a (mgr.14388) 8559 : audit [DBG] from='client.191448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:17 smithi044 bash[22676]: cluster 2024-09-21T01:32:16.772492+0000 mgr.a (mgr.14388) 8560 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:17 smithi179 bash[23186]: cluster 2024-09-21T01:32:16.772492+0000 mgr.a (mgr.14388) 8560 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:17 smithi049 bash[23528]: cluster 2024-09-21T01:32:16.772492+0000 mgr.a (mgr.14388) 8560 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:32:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:20 smithi044 bash[22676]: cluster 2024-09-21T01:32:18.773318+0000 mgr.a (mgr.14388) 8561 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:32:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:20 smithi044 bash[22676]: audit 2024-09-21T01:32:19.072063+0000 mon.a (mon.0) 7240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:20 smithi044 bash[22676]: audit 2024-09-21T01:32:19.082029+0000 mon.a (mon.0) 7241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:20 smithi044 bash[22676]: audit 2024-09-21T01:32:19.092914+0000 mon.a (mon.0) 7242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:20 smithi179 bash[23186]: cluster 2024-09-21T01:32:18.773318+0000 mgr.a (mgr.14388) 8561 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:32:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:20 smithi179 bash[23186]: audit 2024-09-21T01:32:19.072063+0000 mon.a (mon.0) 7240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:20 smithi179 bash[23186]: audit 2024-09-21T01:32:19.082029+0000 mon.a (mon.0) 7241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:20 smithi179 bash[23186]: audit 2024-09-21T01:32:19.092914+0000 mon.a (mon.0) 7242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:20 smithi049 bash[23528]: cluster 2024-09-21T01:32:18.773318+0000 mgr.a (mgr.14388) 8561 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:32:20.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:20 smithi049 bash[23528]: audit 2024-09-21T01:32:19.072063+0000 mon.a (mon.0) 7240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:20 smithi049 bash[23528]: audit 2024-09-21T01:32:19.082029+0000 mon.a (mon.0) 7241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:20 smithi049 bash[23528]: audit 2024-09-21T01:32:19.092914+0000 mon.a (mon.0) 7242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:20.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:20.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:20.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:21.647 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:21.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:21.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:21.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:21.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:22 smithi044 bash[22676]: cluster 2024-09-21T01:32:20.775329+0000 mgr.a (mgr.14388) 8562 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:22 smithi044 bash[22676]: audit 2024-09-21T01:32:21.197216+0000 mgr.a (mgr.14388) 8563 : audit [DBG] from='client.191526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:22 smithi179 bash[23186]: cluster 2024-09-21T01:32:20.775329+0000 mgr.a (mgr.14388) 8562 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:22 smithi179 bash[23186]: audit 2024-09-21T01:32:21.197216+0000 mgr.a (mgr.14388) 8563 : audit [DBG] from='client.191526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:22 smithi049 bash[23528]: cluster 2024-09-21T01:32:20.775329+0000 mgr.a (mgr.14388) 8562 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:22 smithi049 bash[23528]: audit 2024-09-21T01:32:21.197216+0000 mgr.a (mgr.14388) 8563 : audit [DBG] from='client.191526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:24 smithi044 bash[22676]: cluster 2024-09-21T01:32:22.776337+0000 mgr.a (mgr.14388) 8564 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:32:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:24 smithi179 bash[23186]: cluster 2024-09-21T01:32:22.776337+0000 mgr.a (mgr.14388) 8564 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:32:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:24 smithi049 bash[23528]: cluster 2024-09-21T01:32:22.776337+0000 mgr.a (mgr.14388) 8564 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:32:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:26 smithi044 bash[22676]: cluster 2024-09-21T01:32:24.777127+0000 mgr.a (mgr.14388) 8565 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:32:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:26 smithi179 bash[23186]: cluster 2024-09-21T01:32:24.777127+0000 mgr.a (mgr.14388) 8565 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:32:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:26 smithi049 bash[23528]: cluster 2024-09-21T01:32:24.777127+0000 mgr.a (mgr.14388) 8565 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:32:26.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:26.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:26.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:27.401 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:27.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:27.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:27.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:27.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:28 smithi044 bash[22676]: cluster 2024-09-21T01:32:26.778164+0000 mgr.a (mgr.14388) 8566 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:32:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:28 smithi044 bash[22676]: audit 2024-09-21T01:32:26.981841+0000 mgr.a (mgr.14388) 8567 : audit [DBG] from='client.191601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:28 smithi179 bash[23186]: cluster 2024-09-21T01:32:26.778164+0000 mgr.a (mgr.14388) 8566 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:32:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:28 smithi179 bash[23186]: audit 2024-09-21T01:32:26.981841+0000 mgr.a (mgr.14388) 8567 : audit [DBG] from='client.191601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:28 smithi049 bash[23528]: cluster 2024-09-21T01:32:26.778164+0000 mgr.a (mgr.14388) 8566 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:32:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:28 smithi049 bash[23528]: audit 2024-09-21T01:32:26.981841+0000 mgr.a (mgr.14388) 8567 : audit [DBG] from='client.191601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:30 smithi179 bash[23186]: cluster 2024-09-21T01:32:28.779010+0000 mgr.a (mgr.14388) 8568 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:30.454 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:30 smithi049 bash[23528]: cluster 2024-09-21T01:32:28.779010+0000 mgr.a (mgr.14388) 8568 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:30 smithi044 bash[22676]: cluster 2024-09-21T01:32:28.779010+0000 mgr.a (mgr.14388) 8568 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:32 smithi044 bash[22676]: cluster 2024-09-21T01:32:30.781227+0000 mgr.a (mgr.14388) 8569 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:32 smithi049 bash[23528]: cluster 2024-09-21T01:32:30.781227+0000 mgr.a (mgr.14388) 8569 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:32.373 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:32 smithi179 bash[23186]: cluster 2024-09-21T01:32:30.781227+0000 mgr.a (mgr.14388) 8569 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:32.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:32.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:32.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:33.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:33.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:33.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:33.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:33.186 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: audit 2024-09-21T01:32:32.739330+0000 mgr.a (mgr.14388) 8570 : audit [DBG] from='client.191676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: cluster 2024-09-21T01:32:32.782573+0000 mgr.a (mgr.14388) 8571 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: audit 2024-09-21T01:32:33.046151+0000 mon.a (mon.0) 7243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: audit 2024-09-21T01:32:33.052685+0000 mon.a (mon.0) 7244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: audit 2024-09-21T01:32:33.059565+0000 mon.a (mon.0) 7245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: audit 2024-09-21T01:32:33.502754+0000 mon.a (mon.0) 7246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: audit 2024-09-21T01:32:33.510526+0000 mon.a (mon.0) 7247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:34 smithi049 bash[23528]: audit 2024-09-21T01:32:33.519436+0000 mon.a (mon.0) 7248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: audit 2024-09-21T01:32:32.739330+0000 mgr.a (mgr.14388) 8570 : audit [DBG] from='client.191676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: cluster 2024-09-21T01:32:32.782573+0000 mgr.a (mgr.14388) 8571 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: audit 2024-09-21T01:32:33.046151+0000 mon.a (mon.0) 7243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: audit 2024-09-21T01:32:33.052685+0000 mon.a (mon.0) 7244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: audit 2024-09-21T01:32:33.059565+0000 mon.a (mon.0) 7245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: audit 2024-09-21T01:32:33.502754+0000 mon.a (mon.0) 7246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: audit 2024-09-21T01:32:33.510526+0000 mon.a (mon.0) 7247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:34 smithi044 bash[22676]: audit 2024-09-21T01:32:33.519436+0000 mon.a (mon.0) 7248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: audit 2024-09-21T01:32:32.739330+0000 mgr.a (mgr.14388) 8570 : audit [DBG] from='client.191676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: cluster 2024-09-21T01:32:32.782573+0000 mgr.a (mgr.14388) 8571 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: audit 2024-09-21T01:32:33.046151+0000 mon.a (mon.0) 7243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: audit 2024-09-21T01:32:33.052685+0000 mon.a (mon.0) 7244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: audit 2024-09-21T01:32:33.059565+0000 mon.a (mon.0) 7245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: audit 2024-09-21T01:32:33.502754+0000 mon.a (mon.0) 7246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: audit 2024-09-21T01:32:33.510526+0000 mon.a (mon.0) 7247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:34.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:34 smithi179 bash[23186]: audit 2024-09-21T01:32:33.519436+0000 mon.a (mon.0) 7248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:36 smithi049 bash[23528]: cluster 2024-09-21T01:32:34.783572+0000 mgr.a (mgr.14388) 8572 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:36 smithi044 bash[22676]: cluster 2024-09-21T01:32:34.783572+0000 mgr.a (mgr.14388) 8572 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:36 smithi179 bash[23186]: cluster 2024-09-21T01:32:34.783572+0000 mgr.a (mgr.14388) 8572 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:38.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:38.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:38.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:38 smithi044 bash[22676]: cluster 2024-09-21T01:32:36.785840+0000 mgr.a (mgr.14388) 8573 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:38 smithi179 bash[23186]: cluster 2024-09-21T01:32:36.785840+0000 mgr.a (mgr.14388) 8573 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:38 smithi049 bash[23528]: cluster 2024-09-21T01:32:36.785840+0000 mgr.a (mgr.14388) 8573 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:38.967 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:39.325 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:39 smithi049 bash[23528]: audit 2024-09-21T01:32:38.527364+0000 mgr.a (mgr.14388) 8574 : audit [DBG] from='client.191751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:39 smithi044 bash[22676]: audit 2024-09-21T01:32:38.527364+0000 mgr.a (mgr.14388) 8574 : audit [DBG] from='client.191751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:39 smithi179 bash[23186]: audit 2024-09-21T01:32:38.527364+0000 mgr.a (mgr.14388) 8574 : audit [DBG] from='client.191751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:40 smithi044 bash[22676]: cluster 2024-09-21T01:32:38.786446+0000 mgr.a (mgr.14388) 8575 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:40 smithi044 bash[22676]: audit 2024-09-21T01:32:39.305444+0000 mon.a (mon.0) 7249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:40 smithi044 bash[22676]: audit 2024-09-21T01:32:39.314091+0000 mon.a (mon.0) 7250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:40 smithi044 bash[22676]: audit 2024-09-21T01:32:39.324367+0000 mon.a (mon.0) 7251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:40 smithi179 bash[23186]: cluster 2024-09-21T01:32:38.786446+0000 mgr.a (mgr.14388) 8575 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:40 smithi179 bash[23186]: audit 2024-09-21T01:32:39.305444+0000 mon.a (mon.0) 7249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:40 smithi179 bash[23186]: audit 2024-09-21T01:32:39.314091+0000 mon.a (mon.0) 7250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:40 smithi179 bash[23186]: audit 2024-09-21T01:32:39.324367+0000 mon.a (mon.0) 7251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:40 smithi049 bash[23528]: cluster 2024-09-21T01:32:38.786446+0000 mgr.a (mgr.14388) 8575 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:40 smithi049 bash[23528]: audit 2024-09-21T01:32:39.305444+0000 mon.a (mon.0) 7249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:40 smithi049 bash[23528]: audit 2024-09-21T01:32:39.314091+0000 mon.a (mon.0) 7250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:40 smithi049 bash[23528]: audit 2024-09-21T01:32:39.324367+0000 mon.a (mon.0) 7251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:42 smithi044 bash[22676]: cluster 2024-09-21T01:32:40.788725+0000 mgr.a (mgr.14388) 8576 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:42 smithi179 bash[23186]: cluster 2024-09-21T01:32:40.788725+0000 mgr.a (mgr.14388) 8576 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:42 smithi049 bash[23528]: cluster 2024-09-21T01:32:40.788725+0000 mgr.a (mgr.14388) 8576 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:44 smithi044 bash[22676]: cluster 2024-09-21T01:32:42.789553+0000 mgr.a (mgr.14388) 8577 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:44.736 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:44.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:44.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:44.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:44.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:44 smithi179 bash[23186]: cluster 2024-09-21T01:32:42.789553+0000 mgr.a (mgr.14388) 8577 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:44 smithi049 bash[23528]: cluster 2024-09-21T01:32:42.789553+0000 mgr.a (mgr.14388) 8577 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:45 smithi044 bash[22676]: audit 2024-09-21T01:32:44.304235+0000 mgr.a (mgr.14388) 8578 : audit [DBG] from='client.191829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:45 smithi179 bash[23186]: audit 2024-09-21T01:32:44.304235+0000 mgr.a (mgr.14388) 8578 : audit [DBG] from='client.191829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:45 smithi049 bash[23528]: audit 2024-09-21T01:32:44.304235+0000 mgr.a (mgr.14388) 8578 : audit [DBG] from='client.191829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:46 smithi044 bash[22676]: cluster 2024-09-21T01:32:44.790061+0000 mgr.a (mgr.14388) 8579 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:46 smithi179 bash[23186]: cluster 2024-09-21T01:32:44.790061+0000 mgr.a (mgr.14388) 8579 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:46 smithi049 bash[23528]: cluster 2024-09-21T01:32:44.790061+0000 mgr.a (mgr.14388) 8579 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:48 smithi044 bash[22676]: cluster 2024-09-21T01:32:46.792232+0000 mgr.a (mgr.14388) 8580 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:48 smithi179 bash[23186]: cluster 2024-09-21T01:32:46.792232+0000 mgr.a (mgr.14388) 8580 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:48 smithi049 bash[23528]: cluster 2024-09-21T01:32:46.792232+0000 mgr.a (mgr.14388) 8580 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:32:49.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:49.739 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:49.739 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:50.483 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:50.651 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:50 smithi049 bash[23528]: cluster 2024-09-21T01:32:48.793043+0000 mgr.a (mgr.14388) 8581 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:50 smithi044 bash[22676]: cluster 2024-09-21T01:32:48.793043+0000 mgr.a (mgr.14388) 8581 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:50 smithi179 bash[23186]: cluster 2024-09-21T01:32:48.793043+0000 mgr.a (mgr.14388) 8581 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:51 smithi044 bash[22676]: audit 2024-09-21T01:32:50.071537+0000 mgr.a (mgr.14388) 8582 : audit [DBG] from='client.191907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:51 smithi179 bash[23186]: audit 2024-09-21T01:32:50.071537+0000 mgr.a (mgr.14388) 8582 : audit [DBG] from='client.191907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:51 smithi049 bash[23528]: audit 2024-09-21T01:32:50.071537+0000 mgr.a (mgr.14388) 8582 : audit [DBG] from='client.191907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:52 smithi049 bash[23528]: cluster 2024-09-21T01:32:50.795852+0000 mgr.a (mgr.14388) 8583 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:52.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:52 smithi179 bash[23186]: cluster 2024-09-21T01:32:50.795852+0000 mgr.a (mgr.14388) 8583 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:52 smithi044 bash[22676]: cluster 2024-09-21T01:32:50.795852+0000 mgr.a (mgr.14388) 8583 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:54 smithi044 bash[22676]: cluster 2024-09-21T01:32:52.796654+0000 mgr.a (mgr.14388) 8584 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:32:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:54 smithi044 bash[22676]: audit 2024-09-21T01:32:53.253975+0000 mon.a (mon.0) 7252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:54 smithi044 bash[22676]: audit 2024-09-21T01:32:53.261235+0000 mon.a (mon.0) 7253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:54 smithi044 bash[22676]: audit 2024-09-21T01:32:53.268863+0000 mon.a (mon.0) 7254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:54 smithi044 bash[22676]: audit 2024-09-21T01:32:53.715519+0000 mon.a (mon.0) 7255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:54 smithi044 bash[22676]: audit 2024-09-21T01:32:53.723206+0000 mon.a (mon.0) 7256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:54 smithi044 bash[22676]: audit 2024-09-21T01:32:53.732649+0000 mon.a (mon.0) 7257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:54 smithi179 bash[23186]: cluster 2024-09-21T01:32:52.796654+0000 mgr.a (mgr.14388) 8584 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:32:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:54 smithi179 bash[23186]: audit 2024-09-21T01:32:53.253975+0000 mon.a (mon.0) 7252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:54 smithi179 bash[23186]: audit 2024-09-21T01:32:53.261235+0000 mon.a (mon.0) 7253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:54 smithi179 bash[23186]: audit 2024-09-21T01:32:53.268863+0000 mon.a (mon.0) 7254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:54 smithi179 bash[23186]: audit 2024-09-21T01:32:53.715519+0000 mon.a (mon.0) 7255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:54 smithi179 bash[23186]: audit 2024-09-21T01:32:53.723206+0000 mon.a (mon.0) 7256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:54 smithi179 bash[23186]: audit 2024-09-21T01:32:53.732649+0000 mon.a (mon.0) 7257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:54 smithi049 bash[23528]: cluster 2024-09-21T01:32:52.796654+0000 mgr.a (mgr.14388) 8584 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:32:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:54 smithi049 bash[23528]: audit 2024-09-21T01:32:53.253975+0000 mon.a (mon.0) 7252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:54 smithi049 bash[23528]: audit 2024-09-21T01:32:53.261235+0000 mon.a (mon.0) 7253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:54 smithi049 bash[23528]: audit 2024-09-21T01:32:53.268863+0000 mon.a (mon.0) 7254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:54 smithi049 bash[23528]: audit 2024-09-21T01:32:53.715519+0000 mon.a (mon.0) 7255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:54 smithi049 bash[23528]: audit 2024-09-21T01:32:53.723206+0000 mon.a (mon.0) 7256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:54 smithi049 bash[23528]: audit 2024-09-21T01:32:53.732649+0000 mon.a (mon.0) 7257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:32:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:32:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:32:55.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:32:56.263 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:32:56.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:32:56.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:32:56.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:32:56.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:32:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:56 smithi049 bash[23528]: cluster 2024-09-21T01:32:54.797515+0000 mgr.a (mgr.14388) 8585 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:32:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:56 smithi044 bash[22676]: cluster 2024-09-21T01:32:54.797515+0000 mgr.a (mgr.14388) 8585 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:32:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:56 smithi179 bash[23186]: cluster 2024-09-21T01:32:54.797515+0000 mgr.a (mgr.14388) 8585 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:32:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:57 smithi049 bash[23528]: audit 2024-09-21T01:32:55.823815+0000 mgr.a (mgr.14388) 8586 : audit [DBG] from='client.191985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:57 smithi044 bash[22676]: audit 2024-09-21T01:32:55.823815+0000 mgr.a (mgr.14388) 8586 : audit [DBG] from='client.191985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:57 smithi179 bash[23186]: audit 2024-09-21T01:32:55.823815+0000 mgr.a (mgr.14388) 8586 : audit [DBG] from='client.191985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:32:58 smithi049 bash[23528]: cluster 2024-09-21T01:32:56.800290+0000 mgr.a (mgr.14388) 8587 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:32:58 smithi044 bash[22676]: cluster 2024-09-21T01:32:56.800290+0000 mgr.a (mgr.14388) 8587 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:32:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:32:58 smithi179 bash[23186]: cluster 2024-09-21T01:32:56.800290+0000 mgr.a (mgr.14388) 8587 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:00 smithi049 bash[23528]: cluster 2024-09-21T01:32:58.801071+0000 mgr.a (mgr.14388) 8588 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:33:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:00 smithi049 bash[23528]: audit 2024-09-21T01:32:59.540189+0000 mon.a (mon.0) 7258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:00 smithi049 bash[23528]: audit 2024-09-21T01:32:59.548848+0000 mon.a (mon.0) 7259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:00 smithi049 bash[23528]: audit 2024-09-21T01:32:59.559442+0000 mon.a (mon.0) 7260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:00 smithi044 bash[22676]: cluster 2024-09-21T01:32:58.801071+0000 mgr.a (mgr.14388) 8588 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:33:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:00 smithi044 bash[22676]: audit 2024-09-21T01:32:59.540189+0000 mon.a (mon.0) 7258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:00 smithi044 bash[22676]: audit 2024-09-21T01:32:59.548848+0000 mon.a (mon.0) 7259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:00 smithi044 bash[22676]: audit 2024-09-21T01:32:59.559442+0000 mon.a (mon.0) 7260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:00 smithi179 bash[23186]: cluster 2024-09-21T01:32:58.801071+0000 mgr.a (mgr.14388) 8588 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:33:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:00 smithi179 bash[23186]: audit 2024-09-21T01:32:59.540189+0000 mon.a (mon.0) 7258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:00 smithi179 bash[23186]: audit 2024-09-21T01:32:59.548848+0000 mon.a (mon.0) 7259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:00 smithi179 bash[23186]: audit 2024-09-21T01:32:59.559442+0000 mon.a (mon.0) 7260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:01.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:01.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:02.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:02.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:02.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:02.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:02.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:02 smithi049 bash[23528]: cluster 2024-09-21T01:33:00.803069+0000 mgr.a (mgr.14388) 8589 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:02 smithi044 bash[22676]: cluster 2024-09-21T01:33:00.803069+0000 mgr.a (mgr.14388) 8589 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:02 smithi179 bash[23186]: cluster 2024-09-21T01:33:00.803069+0000 mgr.a (mgr.14388) 8589 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:03 smithi049 bash[23528]: audit 2024-09-21T01:33:01.600651+0000 mgr.a (mgr.14388) 8590 : audit [DBG] from='client.192063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:03 smithi044 bash[22676]: audit 2024-09-21T01:33:01.600651+0000 mgr.a (mgr.14388) 8590 : audit [DBG] from='client.192063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:03 smithi179 bash[23186]: audit 2024-09-21T01:33:01.600651+0000 mgr.a (mgr.14388) 8590 : audit [DBG] from='client.192063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:04 smithi044 bash[22676]: cluster 2024-09-21T01:33:02.804037+0000 mgr.a (mgr.14388) 8591 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:04 smithi044 bash[22676]: audit 2024-09-21T01:33:03.972970+0000 mon.a (mon.0) 7261 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:33:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:04 smithi179 bash[23186]: cluster 2024-09-21T01:33:02.804037+0000 mgr.a (mgr.14388) 8591 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:04 smithi179 bash[23186]: audit 2024-09-21T01:33:03.972970+0000 mon.a (mon.0) 7261 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:33:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:04 smithi049 bash[23528]: cluster 2024-09-21T01:33:02.804037+0000 mgr.a (mgr.14388) 8591 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:04 smithi049 bash[23528]: audit 2024-09-21T01:33:03.972970+0000 mon.a (mon.0) 7261 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:33:05.580 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22930]: debug 2024-09-21T01:33:05.319+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:33:05.580 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22930]: debug 2024-09-21T01:33:05.319+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:33:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.579849+0000 mon.a (mon.0) 7262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.584689+0000 mon.a (mon.0) 7263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.590107+0000 mon.a (mon.0) 7264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.595298+0000 mon.a (mon.0) 7265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.596261+0000 mon.a (mon.0) 7266 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.597083+0000 mon.a (mon.0) 7267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.604291+0000 mon.a (mon.0) 7268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.609772+0000 mon.a (mon.0) 7269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:04.610787+0000 mgr.a (mgr.14388) 8592 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: cluster 2024-09-21T01:33:04.804590+0000 mgr.a (mgr.14388) 8593 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: audit 2024-09-21T01:33:05.321361+0000 mgr.a (mgr.14388) 8594 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:33:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:05 smithi044 bash[22676]: cephadm 2024-09-21T01:33:05.322614+0000 mgr.a (mgr.14388) 8595 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:33:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.579849+0000 mon.a (mon.0) 7262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.584689+0000 mon.a (mon.0) 7263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.590107+0000 mon.a (mon.0) 7264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.595298+0000 mon.a (mon.0) 7265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.596261+0000 mon.a (mon.0) 7266 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:33:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.597083+0000 mon.a (mon.0) 7267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:33:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.604291+0000 mon.a (mon.0) 7268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.609772+0000 mon.a (mon.0) 7269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:33:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:04.610787+0000 mgr.a (mgr.14388) 8592 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:33:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: cluster 2024-09-21T01:33:04.804590+0000 mgr.a (mgr.14388) 8593 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: audit 2024-09-21T01:33:05.321361+0000 mgr.a (mgr.14388) 8594 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:33:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:05 smithi179 bash[23186]: cephadm 2024-09-21T01:33:05.322614+0000 mgr.a (mgr.14388) 8595 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:33:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.579849+0000 mon.a (mon.0) 7262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.584689+0000 mon.a (mon.0) 7263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.590107+0000 mon.a (mon.0) 7264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.595298+0000 mon.a (mon.0) 7265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.596261+0000 mon.a (mon.0) 7266 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.597083+0000 mon.a (mon.0) 7267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.604291+0000 mon.a (mon.0) 7268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.609772+0000 mon.a (mon.0) 7269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:04.610787+0000 mgr.a (mgr.14388) 8592 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: cluster 2024-09-21T01:33:04.804590+0000 mgr.a (mgr.14388) 8593 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: audit 2024-09-21T01:33:05.321361+0000 mgr.a (mgr.14388) 8594 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:33:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:05 smithi049 bash[23528]: cephadm 2024-09-21T01:33:05.322614+0000 mgr.a (mgr.14388) 8595 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:33:07.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:07.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:07.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:07.782 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:07.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:07.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:07.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:07.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:08.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:07 smithi049 bash[23528]: cluster 2024-09-21T01:33:06.807340+0000 mgr.a (mgr.14388) 8596 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:33:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:07 smithi049 bash[23528]: audit 2024-09-21T01:33:07.364826+0000 mgr.a (mgr.14388) 8597 : audit [DBG] from='client.192240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:07 smithi044 bash[22676]: cluster 2024-09-21T01:33:06.807340+0000 mgr.a (mgr.14388) 8596 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:33:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:07 smithi044 bash[22676]: audit 2024-09-21T01:33:07.364826+0000 mgr.a (mgr.14388) 8597 : audit [DBG] from='client.192240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:07 smithi179 bash[23186]: cluster 2024-09-21T01:33:06.807340+0000 mgr.a (mgr.14388) 8596 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:33:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:07 smithi179 bash[23186]: audit 2024-09-21T01:33:07.364826+0000 mgr.a (mgr.14388) 8597 : audit [DBG] from='client.192240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:10.198 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:09 smithi179 bash[23186]: cluster 2024-09-21T01:33:08.808248+0000 mgr.a (mgr.14388) 8598 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:33:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:09 smithi044 bash[22676]: cluster 2024-09-21T01:33:08.808248+0000 mgr.a (mgr.14388) 8598 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:33:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:09 smithi049 bash[23528]: cluster 2024-09-21T01:33:08.808248+0000 mgr.a (mgr.14388) 8598 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:33:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:11 smithi044 bash[22676]: cluster 2024-09-21T01:33:10.810614+0000 mgr.a (mgr.14388) 8599 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:11 smithi179 bash[23186]: cluster 2024-09-21T01:33:10.810614+0000 mgr.a (mgr.14388) 8599 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:11 smithi049 bash[23528]: cluster 2024-09-21T01:33:10.810614+0000 mgr.a (mgr.14388) 8599 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:12.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:12.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:12.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:13.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:13.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:13.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:13.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:13.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: cluster 2024-09-21T01:33:12.811437+0000 mgr.a (mgr.14388) 8600 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: audit 2024-09-21T01:33:13.120895+0000 mgr.a (mgr.14388) 8601 : audit [DBG] from='client.192318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: audit 2024-09-21T01:33:13.421426+0000 mon.a (mon.0) 7270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: audit 2024-09-21T01:33:13.427085+0000 mon.a (mon.0) 7271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: audit 2024-09-21T01:33:13.433645+0000 mon.a (mon.0) 7272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: audit 2024-09-21T01:33:13.876137+0000 mon.a (mon.0) 7273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: audit 2024-09-21T01:33:13.882685+0000 mon.a (mon.0) 7274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:14 smithi044 bash[22676]: audit 2024-09-21T01:33:13.891873+0000 mon.a (mon.0) 7275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: cluster 2024-09-21T01:33:12.811437+0000 mgr.a (mgr.14388) 8600 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: audit 2024-09-21T01:33:13.120895+0000 mgr.a (mgr.14388) 8601 : audit [DBG] from='client.192318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: audit 2024-09-21T01:33:13.421426+0000 mon.a (mon.0) 7270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: audit 2024-09-21T01:33:13.427085+0000 mon.a (mon.0) 7271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: audit 2024-09-21T01:33:13.433645+0000 mon.a (mon.0) 7272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: audit 2024-09-21T01:33:13.876137+0000 mon.a (mon.0) 7273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: audit 2024-09-21T01:33:13.882685+0000 mon.a (mon.0) 7274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:14 smithi179 bash[23186]: audit 2024-09-21T01:33:13.891873+0000 mon.a (mon.0) 7275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: cluster 2024-09-21T01:33:12.811437+0000 mgr.a (mgr.14388) 8600 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: audit 2024-09-21T01:33:13.120895+0000 mgr.a (mgr.14388) 8601 : audit [DBG] from='client.192318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: audit 2024-09-21T01:33:13.421426+0000 mon.a (mon.0) 7270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: audit 2024-09-21T01:33:13.427085+0000 mon.a (mon.0) 7271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: audit 2024-09-21T01:33:13.433645+0000 mon.a (mon.0) 7272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: audit 2024-09-21T01:33:13.876137+0000 mon.a (mon.0) 7273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: audit 2024-09-21T01:33:13.882685+0000 mon.a (mon.0) 7274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:14 smithi049 bash[23528]: audit 2024-09-21T01:33:13.891873+0000 mon.a (mon.0) 7275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:16 smithi044 bash[22676]: cluster 2024-09-21T01:33:14.812358+0000 mgr.a (mgr.14388) 8602 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:16 smithi179 bash[23186]: cluster 2024-09-21T01:33:14.812358+0000 mgr.a (mgr.14388) 8602 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:16 smithi049 bash[23528]: cluster 2024-09-21T01:33:14.812358+0000 mgr.a (mgr.14388) 8602 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:18.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:18.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:18.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:18 smithi044 bash[22676]: cluster 2024-09-21T01:33:16.814659+0000 mgr.a (mgr.14388) 8603 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:18 smithi179 bash[23186]: cluster 2024-09-21T01:33:16.814659+0000 mgr.a (mgr.14388) 8603 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:18 smithi049 bash[23528]: cluster 2024-09-21T01:33:16.814659+0000 mgr.a (mgr.14388) 8603 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:33:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:19.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:19.352 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:20 smithi044 bash[22676]: cluster 2024-09-21T01:33:18.815401+0000 mgr.a (mgr.14388) 8604 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:33:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:20 smithi044 bash[22676]: audit 2024-09-21T01:33:18.907439+0000 mgr.a (mgr.14388) 8605 : audit [DBG] from='client.192396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:20 smithi044 bash[22676]: audit 2024-09-21T01:33:19.774480+0000 mon.a (mon.0) 7276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:20 smithi044 bash[22676]: audit 2024-09-21T01:33:19.783562+0000 mon.a (mon.0) 7277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:20 smithi044 bash[22676]: audit 2024-09-21T01:33:19.794434+0000 mon.a (mon.0) 7278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:20 smithi179 bash[23186]: cluster 2024-09-21T01:33:18.815401+0000 mgr.a (mgr.14388) 8604 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:33:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:20 smithi179 bash[23186]: audit 2024-09-21T01:33:18.907439+0000 mgr.a (mgr.14388) 8605 : audit [DBG] from='client.192396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:20 smithi179 bash[23186]: audit 2024-09-21T01:33:19.774480+0000 mon.a (mon.0) 7276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:20 smithi179 bash[23186]: audit 2024-09-21T01:33:19.783562+0000 mon.a (mon.0) 7277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:20 smithi179 bash[23186]: audit 2024-09-21T01:33:19.794434+0000 mon.a (mon.0) 7278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:20 smithi049 bash[23528]: cluster 2024-09-21T01:33:18.815401+0000 mgr.a (mgr.14388) 8604 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:33:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:20 smithi049 bash[23528]: audit 2024-09-21T01:33:18.907439+0000 mgr.a (mgr.14388) 8605 : audit [DBG] from='client.192396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:20 smithi049 bash[23528]: audit 2024-09-21T01:33:19.774480+0000 mon.a (mon.0) 7276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:20 smithi049 bash[23528]: audit 2024-09-21T01:33:19.783562+0000 mon.a (mon.0) 7277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:20 smithi049 bash[23528]: audit 2024-09-21T01:33:19.794434+0000 mon.a (mon.0) 7278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:22 smithi044 bash[22676]: cluster 2024-09-21T01:33:20.817728+0000 mgr.a (mgr.14388) 8606 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T01:33:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:22 smithi179 bash[23186]: cluster 2024-09-21T01:33:20.817728+0000 mgr.a (mgr.14388) 8606 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T01:33:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:22 smithi049 bash[23528]: cluster 2024-09-21T01:33:20.817728+0000 mgr.a (mgr.14388) 8606 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T01:33:24.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:24.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:24.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:24 smithi044 bash[22676]: cluster 2024-09-21T01:33:22.818538+0000 mgr.a (mgr.14388) 8607 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:24 smithi179 bash[23186]: cluster 2024-09-21T01:33:22.818538+0000 mgr.a (mgr.14388) 8607 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:24 smithi049 bash[23528]: cluster 2024-09-21T01:33:22.818538+0000 mgr.a (mgr.14388) 8607 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:25.103 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:25.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:26 smithi044 bash[22676]: audit 2024-09-21T01:33:24.685356+0000 mgr.a (mgr.14388) 8608 : audit [DBG] from='client.192471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:26 smithi044 bash[22676]: cluster 2024-09-21T01:33:24.819464+0000 mgr.a (mgr.14388) 8609 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:26 smithi179 bash[23186]: audit 2024-09-21T01:33:24.685356+0000 mgr.a (mgr.14388) 8608 : audit [DBG] from='client.192471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:26 smithi179 bash[23186]: cluster 2024-09-21T01:33:24.819464+0000 mgr.a (mgr.14388) 8609 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:26 smithi049 bash[23528]: audit 2024-09-21T01:33:24.685356+0000 mgr.a (mgr.14388) 8608 : audit [DBG] from='client.192471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:26 smithi049 bash[23528]: cluster 2024-09-21T01:33:24.819464+0000 mgr.a (mgr.14388) 8609 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:28 smithi044 bash[22676]: cluster 2024-09-21T01:33:26.822237+0000 mgr.a (mgr.14388) 8610 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:33:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:28 smithi179 bash[23186]: cluster 2024-09-21T01:33:26.822237+0000 mgr.a (mgr.14388) 8610 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:33:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:28 smithi049 bash[23528]: cluster 2024-09-21T01:33:26.822237+0000 mgr.a (mgr.14388) 8610 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:33:30.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:30.105 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:30.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:30 smithi044 bash[22676]: cluster 2024-09-21T01:33:28.823062+0000 mgr.a (mgr.14388) 8611 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:33:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:30 smithi179 bash[23186]: cluster 2024-09-21T01:33:28.823062+0000 mgr.a (mgr.14388) 8611 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:33:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:30 smithi049 bash[23528]: cluster 2024-09-21T01:33:28.823062+0000 mgr.a (mgr.14388) 8611 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:33:30.851 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:30.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:30.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:30.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:30.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:31 smithi049 bash[23528]: audit 2024-09-21T01:33:30.438478+0000 mgr.a (mgr.14388) 8612 : audit [DBG] from='client.192549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:31 smithi044 bash[22676]: audit 2024-09-21T01:33:30.438478+0000 mgr.a (mgr.14388) 8612 : audit [DBG] from='client.192549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:31 smithi179 bash[23186]: audit 2024-09-21T01:33:30.438478+0000 mgr.a (mgr.14388) 8612 : audit [DBG] from='client.192549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:32 smithi044 bash[22676]: cluster 2024-09-21T01:33:30.824290+0000 mgr.a (mgr.14388) 8613 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:32 smithi179 bash[23186]: cluster 2024-09-21T01:33:30.824290+0000 mgr.a (mgr.14388) 8613 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:32 smithi049 bash[23528]: cluster 2024-09-21T01:33:30.824290+0000 mgr.a (mgr.14388) 8613 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:34 smithi044 bash[22676]: cluster 2024-09-21T01:33:32.825017+0000 mgr.a (mgr.14388) 8614 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:33:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:34 smithi044 bash[22676]: audit 2024-09-21T01:33:33.596030+0000 mon.a (mon.0) 7279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:34 smithi044 bash[22676]: audit 2024-09-21T01:33:33.601852+0000 mon.a (mon.0) 7280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:34 smithi044 bash[22676]: audit 2024-09-21T01:33:33.607967+0000 mon.a (mon.0) 7281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:34 smithi044 bash[22676]: audit 2024-09-21T01:33:34.069605+0000 mon.a (mon.0) 7282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:34 smithi044 bash[22676]: audit 2024-09-21T01:33:34.077948+0000 mon.a (mon.0) 7283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:34 smithi044 bash[22676]: audit 2024-09-21T01:33:34.088440+0000 mon.a (mon.0) 7284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:34 smithi179 bash[23186]: cluster 2024-09-21T01:33:32.825017+0000 mgr.a (mgr.14388) 8614 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:33:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:34 smithi179 bash[23186]: audit 2024-09-21T01:33:33.596030+0000 mon.a (mon.0) 7279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:34 smithi179 bash[23186]: audit 2024-09-21T01:33:33.601852+0000 mon.a (mon.0) 7280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:34 smithi179 bash[23186]: audit 2024-09-21T01:33:33.607967+0000 mon.a (mon.0) 7281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:34 smithi179 bash[23186]: audit 2024-09-21T01:33:34.069605+0000 mon.a (mon.0) 7282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:34 smithi179 bash[23186]: audit 2024-09-21T01:33:34.077948+0000 mon.a (mon.0) 7283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:34 smithi179 bash[23186]: audit 2024-09-21T01:33:34.088440+0000 mon.a (mon.0) 7284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:34 smithi049 bash[23528]: cluster 2024-09-21T01:33:32.825017+0000 mgr.a (mgr.14388) 8614 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:33:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:34 smithi049 bash[23528]: audit 2024-09-21T01:33:33.596030+0000 mon.a (mon.0) 7279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:34 smithi049 bash[23528]: audit 2024-09-21T01:33:33.601852+0000 mon.a (mon.0) 7280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:34 smithi049 bash[23528]: audit 2024-09-21T01:33:33.607967+0000 mon.a (mon.0) 7281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:34 smithi049 bash[23528]: audit 2024-09-21T01:33:34.069605+0000 mon.a (mon.0) 7282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:34 smithi049 bash[23528]: audit 2024-09-21T01:33:34.077948+0000 mon.a (mon.0) 7283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:34 smithi049 bash[23528]: audit 2024-09-21T01:33:34.088440+0000 mon.a (mon.0) 7284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:35.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:36.612 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:36.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:36.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:36.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:36.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:36 smithi044 bash[22676]: cluster 2024-09-21T01:33:34.825813+0000 mgr.a (mgr.14388) 8615 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:33:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:36 smithi179 bash[23186]: cluster 2024-09-21T01:33:34.825813+0000 mgr.a (mgr.14388) 8615 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:33:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:36 smithi049 bash[23528]: cluster 2024-09-21T01:33:34.825813+0000 mgr.a (mgr.14388) 8615 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:33:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:37 smithi044 bash[22676]: audit 2024-09-21T01:33:36.184799+0000 mgr.a (mgr.14388) 8616 : audit [DBG] from='client.192624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:37 smithi179 bash[23186]: audit 2024-09-21T01:33:36.184799+0000 mgr.a (mgr.14388) 8616 : audit [DBG] from='client.192624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:37 smithi049 bash[23528]: audit 2024-09-21T01:33:36.184799+0000 mgr.a (mgr.14388) 8616 : audit [DBG] from='client.192624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:38 smithi179 bash[23186]: cluster 2024-09-21T01:33:36.828526+0000 mgr.a (mgr.14388) 8617 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:38 smithi049 bash[23528]: cluster 2024-09-21T01:33:36.828526+0000 mgr.a (mgr.14388) 8617 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:38 smithi044 bash[22676]: cluster 2024-09-21T01:33:36.828526+0000 mgr.a (mgr.14388) 8617 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:40 smithi179 bash[23186]: cluster 2024-09-21T01:33:38.829336+0000 mgr.a (mgr.14388) 8618 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:33:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:40 smithi179 bash[23186]: audit 2024-09-21T01:33:39.977330+0000 mon.a (mon.0) 7285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:40 smithi179 bash[23186]: audit 2024-09-21T01:33:39.986341+0000 mon.a (mon.0) 7286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:40 smithi179 bash[23186]: audit 2024-09-21T01:33:39.997173+0000 mon.a (mon.0) 7287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:40 smithi049 bash[23528]: cluster 2024-09-21T01:33:38.829336+0000 mgr.a (mgr.14388) 8618 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:33:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:40 smithi049 bash[23528]: audit 2024-09-21T01:33:39.977330+0000 mon.a (mon.0) 7285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:40 smithi049 bash[23528]: audit 2024-09-21T01:33:39.986341+0000 mon.a (mon.0) 7286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:40 smithi049 bash[23528]: audit 2024-09-21T01:33:39.997173+0000 mon.a (mon.0) 7287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:40 smithi044 bash[22676]: cluster 2024-09-21T01:33:38.829336+0000 mgr.a (mgr.14388) 8618 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:33:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:40 smithi044 bash[22676]: audit 2024-09-21T01:33:39.977330+0000 mon.a (mon.0) 7285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:40 smithi044 bash[22676]: audit 2024-09-21T01:33:39.986341+0000 mon.a (mon.0) 7286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:40 smithi044 bash[22676]: audit 2024-09-21T01:33:39.997173+0000 mon.a (mon.0) 7287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:41.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:41.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:41.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:42.404 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:42.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:42.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:42.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:42.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:42 smithi179 bash[23186]: cluster 2024-09-21T01:33:40.831268+0000 mgr.a (mgr.14388) 8619 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:33:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:42 smithi049 bash[23528]: cluster 2024-09-21T01:33:40.831268+0000 mgr.a (mgr.14388) 8619 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:33:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:42 smithi044 bash[22676]: cluster 2024-09-21T01:33:40.831268+0000 mgr.a (mgr.14388) 8619 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:33:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:43 smithi049 bash[23528]: audit 2024-09-21T01:33:41.953917+0000 mgr.a (mgr.14388) 8620 : audit [DBG] from='client.192699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:43 smithi044 bash[22676]: audit 2024-09-21T01:33:41.953917+0000 mgr.a (mgr.14388) 8620 : audit [DBG] from='client.192699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:43 smithi179 bash[23186]: audit 2024-09-21T01:33:41.953917+0000 mgr.a (mgr.14388) 8620 : audit [DBG] from='client.192699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:44 smithi049 bash[23528]: cluster 2024-09-21T01:33:42.832326+0000 mgr.a (mgr.14388) 8621 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:44 smithi044 bash[22676]: cluster 2024-09-21T01:33:42.832326+0000 mgr.a (mgr.14388) 8621 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:44 smithi179 bash[23186]: cluster 2024-09-21T01:33:42.832326+0000 mgr.a (mgr.14388) 8621 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:46 smithi049 bash[23528]: cluster 2024-09-21T01:33:44.833327+0000 mgr.a (mgr.14388) 8622 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:46 smithi044 bash[22676]: cluster 2024-09-21T01:33:44.833327+0000 mgr.a (mgr.14388) 8622 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:46 smithi179 bash[23186]: cluster 2024-09-21T01:33:44.833327+0000 mgr.a (mgr.14388) 8622 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:47.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:47.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:47.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:48.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:48.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:48.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:48.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:48.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:48 smithi049 bash[23528]: cluster 2024-09-21T01:33:46.835565+0000 mgr.a (mgr.14388) 8623 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:48 smithi044 bash[22676]: cluster 2024-09-21T01:33:46.835565+0000 mgr.a (mgr.14388) 8623 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:48 smithi179 bash[23186]: cluster 2024-09-21T01:33:46.835565+0000 mgr.a (mgr.14388) 8623 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:49 smithi049 bash[23528]: audit 2024-09-21T01:33:47.735259+0000 mgr.a (mgr.14388) 8624 : audit [DBG] from='client.192777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:49 smithi044 bash[22676]: audit 2024-09-21T01:33:47.735259+0000 mgr.a (mgr.14388) 8624 : audit [DBG] from='client.192777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:49 smithi179 bash[23186]: audit 2024-09-21T01:33:47.735259+0000 mgr.a (mgr.14388) 8624 : audit [DBG] from='client.192777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:50 smithi049 bash[23528]: cluster 2024-09-21T01:33:48.836742+0000 mgr.a (mgr.14388) 8625 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:50.878 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:50 smithi179 bash[23186]: cluster 2024-09-21T01:33:48.836742+0000 mgr.a (mgr.14388) 8625 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:50 smithi044 bash[22676]: cluster 2024-09-21T01:33:48.836742+0000 mgr.a (mgr.14388) 8625 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:52 smithi179 bash[23186]: cluster 2024-09-21T01:33:50.839056+0000 mgr.a (mgr.14388) 8626 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:52 smithi049 bash[23528]: cluster 2024-09-21T01:33:50.839056+0000 mgr.a (mgr.14388) 8626 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:52.808 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:52 smithi044 bash[22676]: cluster 2024-09-21T01:33:50.839056+0000 mgr.a (mgr.14388) 8626 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:53.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:53.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:53.965 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:33:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: cluster 2024-09-21T01:33:52.840017+0000 mgr.a (mgr.14388) 8627 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: audit 2024-09-21T01:33:53.518103+0000 mgr.a (mgr.14388) 8628 : audit [DBG] from='client.192855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: audit 2024-09-21T01:33:53.769218+0000 mon.a (mon.0) 7288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: audit 2024-09-21T01:33:53.774907+0000 mon.a (mon.0) 7289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: audit 2024-09-21T01:33:53.780247+0000 mon.a (mon.0) 7290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: audit 2024-09-21T01:33:54.241591+0000 mon.a (mon.0) 7291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: audit 2024-09-21T01:33:54.249243+0000 mon.a (mon.0) 7292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:54 smithi049 bash[23528]: audit 2024-09-21T01:33:54.258855+0000 mon.a (mon.0) 7293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: cluster 2024-09-21T01:33:52.840017+0000 mgr.a (mgr.14388) 8627 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: audit 2024-09-21T01:33:53.518103+0000 mgr.a (mgr.14388) 8628 : audit [DBG] from='client.192855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: audit 2024-09-21T01:33:53.769218+0000 mon.a (mon.0) 7288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: audit 2024-09-21T01:33:53.774907+0000 mon.a (mon.0) 7289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: audit 2024-09-21T01:33:53.780247+0000 mon.a (mon.0) 7290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: audit 2024-09-21T01:33:54.241591+0000 mon.a (mon.0) 7291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: audit 2024-09-21T01:33:54.249243+0000 mon.a (mon.0) 7292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:54 smithi044 bash[22676]: audit 2024-09-21T01:33:54.258855+0000 mon.a (mon.0) 7293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: cluster 2024-09-21T01:33:52.840017+0000 mgr.a (mgr.14388) 8627 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: audit 2024-09-21T01:33:53.518103+0000 mgr.a (mgr.14388) 8628 : audit [DBG] from='client.192855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: audit 2024-09-21T01:33:53.769218+0000 mon.a (mon.0) 7288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: audit 2024-09-21T01:33:53.774907+0000 mon.a (mon.0) 7289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: audit 2024-09-21T01:33:53.780247+0000 mon.a (mon.0) 7290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: audit 2024-09-21T01:33:54.241591+0000 mon.a (mon.0) 7291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: audit 2024-09-21T01:33:54.249243+0000 mon.a (mon.0) 7292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:54 smithi179 bash[23186]: audit 2024-09-21T01:33:54.258855+0000 mon.a (mon.0) 7293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:33:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:56 smithi044 bash[22676]: cluster 2024-09-21T01:33:54.841023+0000 mgr.a (mgr.14388) 8629 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:56 smithi049 bash[23528]: cluster 2024-09-21T01:33:54.841023+0000 mgr.a (mgr.14388) 8629 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:56 smithi179 bash[23186]: cluster 2024-09-21T01:33:54.841023+0000 mgr.a (mgr.14388) 8629 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:33:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:33:58 smithi049 bash[23528]: cluster 2024-09-21T01:33:56.843300+0000 mgr.a (mgr.14388) 8630 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:58.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:33:58.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:33:58.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:33:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:33:58 smithi044 bash[22676]: cluster 2024-09-21T01:33:56.843300+0000 mgr.a (mgr.14388) 8630 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:33:58 smithi179 bash[23186]: cluster 2024-09-21T01:33:56.843300+0000 mgr.a (mgr.14388) 8630 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:33:59.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:33:59.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:33:59.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:33:59.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:33:59.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:00 smithi049 bash[23528]: cluster 2024-09-21T01:33:58.844092+0000 mgr.a (mgr.14388) 8631 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:00 smithi049 bash[23528]: audit 2024-09-21T01:33:59.303688+0000 mgr.a (mgr.14388) 8632 : audit [DBG] from='client.192930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:00 smithi049 bash[23528]: audit 2024-09-21T01:34:00.210484+0000 mon.a (mon.0) 7294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:00 smithi049 bash[23528]: audit 2024-09-21T01:34:00.219606+0000 mon.a (mon.0) 7295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:00 smithi049 bash[23528]: audit 2024-09-21T01:34:00.230782+0000 mon.a (mon.0) 7296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:00 smithi044 bash[22676]: cluster 2024-09-21T01:33:58.844092+0000 mgr.a (mgr.14388) 8631 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:00 smithi044 bash[22676]: audit 2024-09-21T01:33:59.303688+0000 mgr.a (mgr.14388) 8632 : audit [DBG] from='client.192930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:00 smithi044 bash[22676]: audit 2024-09-21T01:34:00.210484+0000 mon.a (mon.0) 7294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:00 smithi044 bash[22676]: audit 2024-09-21T01:34:00.219606+0000 mon.a (mon.0) 7295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:00 smithi044 bash[22676]: audit 2024-09-21T01:34:00.230782+0000 mon.a (mon.0) 7296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:00 smithi179 bash[23186]: cluster 2024-09-21T01:33:58.844092+0000 mgr.a (mgr.14388) 8631 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:00 smithi179 bash[23186]: audit 2024-09-21T01:33:59.303688+0000 mgr.a (mgr.14388) 8632 : audit [DBG] from='client.192930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:00 smithi179 bash[23186]: audit 2024-09-21T01:34:00.210484+0000 mon.a (mon.0) 7294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:00 smithi179 bash[23186]: audit 2024-09-21T01:34:00.219606+0000 mon.a (mon.0) 7295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:00 smithi179 bash[23186]: audit 2024-09-21T01:34:00.230782+0000 mon.a (mon.0) 7296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:02 smithi044 bash[22676]: cluster 2024-09-21T01:34:00.846480+0000 mgr.a (mgr.14388) 8633 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:02 smithi179 bash[23186]: cluster 2024-09-21T01:34:00.846480+0000 mgr.a (mgr.14388) 8633 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:02 smithi049 bash[23528]: cluster 2024-09-21T01:34:00.846480+0000 mgr.a (mgr.14388) 8633 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:04.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:04.754 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:04 smithi044 bash[22676]: cluster 2024-09-21T01:34:02.847252+0000 mgr.a (mgr.14388) 8634 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:04 smithi179 bash[23186]: cluster 2024-09-21T01:34:02.847252+0000 mgr.a (mgr.14388) 8634 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:04 smithi049 bash[23528]: cluster 2024-09-21T01:34:02.847252+0000 mgr.a (mgr.14388) 8634 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:05.506 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:05 smithi044 bash[22676]: audit 2024-09-21T01:34:05.387610+0000 mon.a (mon.0) 7297 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:34:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:05 smithi179 bash[23186]: audit 2024-09-21T01:34:05.387610+0000 mon.a (mon.0) 7297 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:34:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:05 smithi049 bash[23528]: audit 2024-09-21T01:34:05.387610+0000 mon.a (mon.0) 7297 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:34:06.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22930]: debug 2024-09-21T01:34:06.746+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:34:06.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22930]: debug 2024-09-21T01:34:06.750+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:34:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: cluster 2024-09-21T01:34:04.847918+0000 mgr.a (mgr.14388) 8635 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: audit 2024-09-21T01:34:05.088387+0000 mgr.a (mgr.14388) 8636 : audit [DBG] from='client.193008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: audit 2024-09-21T01:34:05.946564+0000 mon.a (mon.0) 7298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: audit 2024-09-21T01:34:05.955896+0000 mon.a (mon.0) 7299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: audit 2024-09-21T01:34:05.958501+0000 mon.a (mon.0) 7300 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:34:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: audit 2024-09-21T01:34:05.960553+0000 mon.a (mon.0) 7301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:34:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: audit 2024-09-21T01:34:05.972292+0000 mon.a (mon.0) 7302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:06 smithi044 bash[22676]: audit 2024-09-21T01:34:05.988437+0000 mon.a (mon.0) 7303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: cluster 2024-09-21T01:34:04.847918+0000 mgr.a (mgr.14388) 8635 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: audit 2024-09-21T01:34:05.088387+0000 mgr.a (mgr.14388) 8636 : audit [DBG] from='client.193008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: audit 2024-09-21T01:34:05.946564+0000 mon.a (mon.0) 7298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: audit 2024-09-21T01:34:05.955896+0000 mon.a (mon.0) 7299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: audit 2024-09-21T01:34:05.958501+0000 mon.a (mon.0) 7300 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: audit 2024-09-21T01:34:05.960553+0000 mon.a (mon.0) 7301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: audit 2024-09-21T01:34:05.972292+0000 mon.a (mon.0) 7302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:06 smithi179 bash[23186]: audit 2024-09-21T01:34:05.988437+0000 mon.a (mon.0) 7303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: cluster 2024-09-21T01:34:04.847918+0000 mgr.a (mgr.14388) 8635 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: audit 2024-09-21T01:34:05.088387+0000 mgr.a (mgr.14388) 8636 : audit [DBG] from='client.193008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: audit 2024-09-21T01:34:05.946564+0000 mon.a (mon.0) 7298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: audit 2024-09-21T01:34:05.955896+0000 mon.a (mon.0) 7299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: audit 2024-09-21T01:34:05.958501+0000 mon.a (mon.0) 7300 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: audit 2024-09-21T01:34:05.960553+0000 mon.a (mon.0) 7301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:34:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: audit 2024-09-21T01:34:05.972292+0000 mon.a (mon.0) 7302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:06 smithi049 bash[23528]: audit 2024-09-21T01:34:05.988437+0000 mon.a (mon.0) 7303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:34:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:07 smithi044 bash[22676]: audit 2024-09-21T01:34:05.992113+0000 mgr.a (mgr.14388) 8637 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:34:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:07 smithi179 bash[23186]: audit 2024-09-21T01:34:05.992113+0000 mgr.a (mgr.14388) 8637 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:34:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:07 smithi049 bash[23528]: audit 2024-09-21T01:34:05.992113+0000 mgr.a (mgr.14388) 8637 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:34:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:08 smithi044 bash[22676]: audit 2024-09-21T01:34:06.752840+0000 mgr.a (mgr.14388) 8638 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:34:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:08 smithi044 bash[22676]: cephadm 2024-09-21T01:34:06.754430+0000 mgr.a (mgr.14388) 8639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:34:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:08 smithi044 bash[22676]: cluster 2024-09-21T01:34:06.850667+0000 mgr.a (mgr.14388) 8640 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:08 smithi179 bash[23186]: audit 2024-09-21T01:34:06.752840+0000 mgr.a (mgr.14388) 8638 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:34:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:08 smithi179 bash[23186]: cephadm 2024-09-21T01:34:06.754430+0000 mgr.a (mgr.14388) 8639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:34:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:08 smithi179 bash[23186]: cluster 2024-09-21T01:34:06.850667+0000 mgr.a (mgr.14388) 8640 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:08 smithi049 bash[23528]: audit 2024-09-21T01:34:06.752840+0000 mgr.a (mgr.14388) 8638 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:34:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:08 smithi049 bash[23528]: cephadm 2024-09-21T01:34:06.754430+0000 mgr.a (mgr.14388) 8639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:34:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:08 smithi049 bash[23528]: cluster 2024-09-21T01:34:06.850667+0000 mgr.a (mgr.14388) 8640 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:09 smithi044 bash[22676]: cluster 2024-09-21T01:34:08.851612+0000 mgr.a (mgr.14388) 8641 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:34:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:09 smithi179 bash[23186]: cluster 2024-09-21T01:34:08.851612+0000 mgr.a (mgr.14388) 8641 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:34:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:09 smithi049 bash[23528]: cluster 2024-09-21T01:34:08.851612+0000 mgr.a (mgr.14388) 8641 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:34:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:11.258 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:11 smithi179 bash[23186]: audit 2024-09-21T01:34:10.844672+0000 mgr.a (mgr.14388) 8642 : audit [DBG] from='client.193191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:11 smithi179 bash[23186]: cluster 2024-09-21T01:34:10.867037+0000 mgr.a (mgr.14388) 8643 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:11 smithi049 bash[23528]: audit 2024-09-21T01:34:10.844672+0000 mgr.a (mgr.14388) 8642 : audit [DBG] from='client.193191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:11 smithi049 bash[23528]: cluster 2024-09-21T01:34:10.867037+0000 mgr.a (mgr.14388) 8643 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:11 smithi044 bash[22676]: audit 2024-09-21T01:34:10.844672+0000 mgr.a (mgr.14388) 8642 : audit [DBG] from='client.193191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:11 smithi044 bash[22676]: cluster 2024-09-21T01:34:10.867037+0000 mgr.a (mgr.14388) 8643 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:14.100 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:13 smithi044 bash[22676]: cluster 2024-09-21T01:34:12.868140+0000 mgr.a (mgr.14388) 8644 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T01:34:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:13 smithi179 bash[23186]: cluster 2024-09-21T01:34:12.868140+0000 mgr.a (mgr.14388) 8644 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T01:34:14.265 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:13 smithi049 bash[23528]: cluster 2024-09-21T01:34:12.868140+0000 mgr.a (mgr.14388) 8644 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T01:34:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:14 smithi044 bash[22676]: audit 2024-09-21T01:34:13.973096+0000 mon.a (mon.0) 7304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:14 smithi044 bash[22676]: audit 2024-09-21T01:34:13.978842+0000 mon.a (mon.0) 7305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:14 smithi044 bash[22676]: audit 2024-09-21T01:34:13.984275+0000 mon.a (mon.0) 7306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:14 smithi044 bash[22676]: audit 2024-09-21T01:34:14.466992+0000 mon.a (mon.0) 7307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:14 smithi044 bash[22676]: audit 2024-09-21T01:34:14.476599+0000 mon.a (mon.0) 7308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:14 smithi044 bash[22676]: audit 2024-09-21T01:34:14.487988+0000 mon.a (mon.0) 7309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:14 smithi179 bash[23186]: audit 2024-09-21T01:34:13.973096+0000 mon.a (mon.0) 7304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:14 smithi179 bash[23186]: audit 2024-09-21T01:34:13.978842+0000 mon.a (mon.0) 7305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:14 smithi179 bash[23186]: audit 2024-09-21T01:34:13.984275+0000 mon.a (mon.0) 7306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:14 smithi179 bash[23186]: audit 2024-09-21T01:34:14.466992+0000 mon.a (mon.0) 7307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:14 smithi179 bash[23186]: audit 2024-09-21T01:34:14.476599+0000 mon.a (mon.0) 7308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:14 smithi179 bash[23186]: audit 2024-09-21T01:34:14.487988+0000 mon.a (mon.0) 7309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:14 smithi049 bash[23528]: audit 2024-09-21T01:34:13.973096+0000 mon.a (mon.0) 7304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:14 smithi049 bash[23528]: audit 2024-09-21T01:34:13.978842+0000 mon.a (mon.0) 7305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:14 smithi049 bash[23528]: audit 2024-09-21T01:34:13.984275+0000 mon.a (mon.0) 7306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:14 smithi049 bash[23528]: audit 2024-09-21T01:34:14.466992+0000 mon.a (mon.0) 7307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:14 smithi049 bash[23528]: audit 2024-09-21T01:34:14.476599+0000 mon.a (mon.0) 7308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:14 smithi049 bash[23528]: audit 2024-09-21T01:34:14.487988+0000 mon.a (mon.0) 7309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:16.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:16.260 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:16 smithi044 bash[22676]: cluster 2024-09-21T01:34:14.868987+0000 mgr.a (mgr.14388) 8645 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T01:34:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:16 smithi179 bash[23186]: cluster 2024-09-21T01:34:14.868987+0000 mgr.a (mgr.14388) 8645 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T01:34:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:16 smithi049 bash[23528]: cluster 2024-09-21T01:34:14.868987+0000 mgr.a (mgr.14388) 8645 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-21T01:34:17.050 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:17.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:17.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:17.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:17.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:18 smithi179 bash[23186]: audit 2024-09-21T01:34:16.596091+0000 mgr.a (mgr.14388) 8646 : audit [DBG] from='client.193266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:18 smithi179 bash[23186]: cluster 2024-09-21T01:34:16.870389+0000 mgr.a (mgr.14388) 8647 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:18 smithi049 bash[23528]: audit 2024-09-21T01:34:16.596091+0000 mgr.a (mgr.14388) 8646 : audit [DBG] from='client.193266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:18 smithi049 bash[23528]: cluster 2024-09-21T01:34:16.870389+0000 mgr.a (mgr.14388) 8647 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:18 smithi044 bash[22676]: audit 2024-09-21T01:34:16.596091+0000 mgr.a (mgr.14388) 8646 : audit [DBG] from='client.193266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:18 smithi044 bash[22676]: cluster 2024-09-21T01:34:16.870389+0000 mgr.a (mgr.14388) 8647 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:20 smithi179 bash[23186]: cluster 2024-09-21T01:34:18.871274+0000 mgr.a (mgr.14388) 8648 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:20 smithi179 bash[23186]: audit 2024-09-21T01:34:20.443346+0000 mon.a (mon.0) 7310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:20 smithi179 bash[23186]: audit 2024-09-21T01:34:20.453023+0000 mon.a (mon.0) 7311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:20 smithi179 bash[23186]: audit 2024-09-21T01:34:20.463567+0000 mon.a (mon.0) 7312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:20 smithi049 bash[23528]: cluster 2024-09-21T01:34:18.871274+0000 mgr.a (mgr.14388) 8648 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:20 smithi049 bash[23528]: audit 2024-09-21T01:34:20.443346+0000 mon.a (mon.0) 7310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:20 smithi049 bash[23528]: audit 2024-09-21T01:34:20.453023+0000 mon.a (mon.0) 7311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:20 smithi049 bash[23528]: audit 2024-09-21T01:34:20.463567+0000 mon.a (mon.0) 7312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:20 smithi044 bash[22676]: cluster 2024-09-21T01:34:18.871274+0000 mgr.a (mgr.14388) 8648 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:20 smithi044 bash[22676]: audit 2024-09-21T01:34:20.443346+0000 mon.a (mon.0) 7310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:20 smithi044 bash[22676]: audit 2024-09-21T01:34:20.453023+0000 mon.a (mon.0) 7311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:20 smithi044 bash[22676]: audit 2024-09-21T01:34:20.463567+0000 mon.a (mon.0) 7312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:22.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:22.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:22.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:22 smithi049 bash[23528]: cluster 2024-09-21T01:34:20.873532+0000 mgr.a (mgr.14388) 8649 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:22.817 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:22.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:22.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:22.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:22.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:22 smithi044 bash[22676]: cluster 2024-09-21T01:34:20.873532+0000 mgr.a (mgr.14388) 8649 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:22 smithi179 bash[23186]: cluster 2024-09-21T01:34:20.873532+0000 mgr.a (mgr.14388) 8649 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T01:34:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:23 smithi049 bash[23528]: audit 2024-09-21T01:34:22.386625+0000 mgr.a (mgr.14388) 8650 : audit [DBG] from='client.193344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:23.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:23 smithi179 bash[23186]: audit 2024-09-21T01:34:22.386625+0000 mgr.a (mgr.14388) 8650 : audit [DBG] from='client.193344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:23 smithi044 bash[22676]: audit 2024-09-21T01:34:22.386625+0000 mgr.a (mgr.14388) 8650 : audit [DBG] from='client.193344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:24 smithi049 bash[23528]: cluster 2024-09-21T01:34:22.874299+0000 mgr.a (mgr.14388) 8651 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:24 smithi044 bash[22676]: cluster 2024-09-21T01:34:22.874299+0000 mgr.a (mgr.14388) 8651 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:24 smithi179 bash[23186]: cluster 2024-09-21T01:34:22.874299+0000 mgr.a (mgr.14388) 8651 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:26 smithi049 bash[23528]: cluster 2024-09-21T01:34:24.875072+0000 mgr.a (mgr.14388) 8652 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:26 smithi044 bash[22676]: cluster 2024-09-21T01:34:24.875072+0000 mgr.a (mgr.14388) 8652 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:26 smithi179 bash[23186]: cluster 2024-09-21T01:34:24.875072+0000 mgr.a (mgr.14388) 8652 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:27.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:27.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:27.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:28.579 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:28 smithi049 bash[23528]: cluster 2024-09-21T01:34:26.877468+0000 mgr.a (mgr.14388) 8653 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:28 smithi044 bash[22676]: cluster 2024-09-21T01:34:26.877468+0000 mgr.a (mgr.14388) 8653 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:28 smithi179 bash[23186]: cluster 2024-09-21T01:34:26.877468+0000 mgr.a (mgr.14388) 8653 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:29 smithi049 bash[23528]: audit 2024-09-21T01:34:28.148239+0000 mgr.a (mgr.14388) 8654 : audit [DBG] from='client.193419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:29 smithi044 bash[22676]: audit 2024-09-21T01:34:28.148239+0000 mgr.a (mgr.14388) 8654 : audit [DBG] from='client.193419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:29 smithi179 bash[23186]: audit 2024-09-21T01:34:28.148239+0000 mgr.a (mgr.14388) 8654 : audit [DBG] from='client.193419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:30 smithi049 bash[23528]: cluster 2024-09-21T01:34:28.878462+0000 mgr.a (mgr.14388) 8655 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:30 smithi044 bash[22676]: cluster 2024-09-21T01:34:28.878462+0000 mgr.a (mgr.14388) 8655 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:30 smithi179 bash[23186]: cluster 2024-09-21T01:34:28.878462+0000 mgr.a (mgr.14388) 8655 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:32 smithi049 bash[23528]: cluster 2024-09-21T01:34:30.880669+0000 mgr.a (mgr.14388) 8656 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:32.887 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:32 smithi179 bash[23186]: cluster 2024-09-21T01:34:30.880669+0000 mgr.a (mgr.14388) 8656 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:32 smithi044 bash[22676]: cluster 2024-09-21T01:34:30.880669+0000 mgr.a (mgr.14388) 8656 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:33.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:33.581 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:33.581 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:34.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:34.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:34.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:34.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:34.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:34.691 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:34 smithi044 bash[22676]: cluster 2024-09-21T01:34:32.881530+0000 mgr.a (mgr.14388) 8657 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:34.691 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:34 smithi044 bash[22676]: audit 2024-09-21T01:34:34.176290+0000 mon.a (mon.0) 7313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:34.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:34 smithi044 bash[22676]: audit 2024-09-21T01:34:34.182129+0000 mon.a (mon.0) 7314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:34.692 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:34 smithi044 bash[22676]: audit 2024-09-21T01:34:34.188402+0000 mon.a (mon.0) 7315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:34 smithi049 bash[23528]: cluster 2024-09-21T01:34:32.881530+0000 mgr.a (mgr.14388) 8657 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:34 smithi049 bash[23528]: audit 2024-09-21T01:34:34.176290+0000 mon.a (mon.0) 7313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:34 smithi049 bash[23528]: audit 2024-09-21T01:34:34.182129+0000 mon.a (mon.0) 7314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:34 smithi049 bash[23528]: audit 2024-09-21T01:34:34.188402+0000 mon.a (mon.0) 7315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:34 smithi179 bash[23186]: cluster 2024-09-21T01:34:32.881530+0000 mgr.a (mgr.14388) 8657 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:34 smithi179 bash[23186]: audit 2024-09-21T01:34:34.176290+0000 mon.a (mon.0) 7313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:34 smithi179 bash[23186]: audit 2024-09-21T01:34:34.182129+0000 mon.a (mon.0) 7314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:34 smithi179 bash[23186]: audit 2024-09-21T01:34:34.188402+0000 mon.a (mon.0) 7315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:35 smithi049 bash[23528]: audit 2024-09-21T01:34:33.924593+0000 mgr.a (mgr.14388) 8658 : audit [DBG] from='client.193497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:35 smithi049 bash[23528]: audit 2024-09-21T01:34:34.673868+0000 mon.a (mon.0) 7316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:35 smithi049 bash[23528]: audit 2024-09-21T01:34:34.680164+0000 mon.a (mon.0) 7317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:35 smithi049 bash[23528]: audit 2024-09-21T01:34:34.690080+0000 mon.a (mon.0) 7318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:35 smithi044 bash[22676]: audit 2024-09-21T01:34:33.924593+0000 mgr.a (mgr.14388) 8658 : audit [DBG] from='client.193497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:35.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:35 smithi044 bash[22676]: audit 2024-09-21T01:34:34.673868+0000 mon.a (mon.0) 7316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:35 smithi044 bash[22676]: audit 2024-09-21T01:34:34.680164+0000 mon.a (mon.0) 7317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:35.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:35 smithi044 bash[22676]: audit 2024-09-21T01:34:34.690080+0000 mon.a (mon.0) 7318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:35 smithi179 bash[23186]: audit 2024-09-21T01:34:33.924593+0000 mgr.a (mgr.14388) 8658 : audit [DBG] from='client.193497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:35 smithi179 bash[23186]: audit 2024-09-21T01:34:34.673868+0000 mon.a (mon.0) 7316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:35 smithi179 bash[23186]: audit 2024-09-21T01:34:34.680164+0000 mon.a (mon.0) 7317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:35 smithi179 bash[23186]: audit 2024-09-21T01:34:34.690080+0000 mon.a (mon.0) 7318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:36 smithi049 bash[23528]: cluster 2024-09-21T01:34:34.882450+0000 mgr.a (mgr.14388) 8659 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:36.813 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:36 smithi044 bash[22676]: cluster 2024-09-21T01:34:34.882450+0000 mgr.a (mgr.14388) 8659 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:36 smithi179 bash[23186]: cluster 2024-09-21T01:34:34.882450+0000 mgr.a (mgr.14388) 8659 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:38 smithi049 bash[23528]: cluster 2024-09-21T01:34:36.884711+0000 mgr.a (mgr.14388) 8660 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:38 smithi044 bash[22676]: cluster 2024-09-21T01:34:36.884711+0000 mgr.a (mgr.14388) 8660 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:38 smithi179 bash[23186]: cluster 2024-09-21T01:34:36.884711+0000 mgr.a (mgr.14388) 8660 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:34:39.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:39.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:39.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:40.125 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:40.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:40.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:40.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:40.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:40 smithi044 bash[22676]: cluster 2024-09-21T01:34:38.885706+0000 mgr.a (mgr.14388) 8661 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:40 smithi179 bash[23186]: cluster 2024-09-21T01:34:38.885706+0000 mgr.a (mgr.14388) 8661 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:40 smithi049 bash[23528]: cluster 2024-09-21T01:34:38.885706+0000 mgr.a (mgr.14388) 8661 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:41 smithi044 bash[22676]: audit 2024-09-21T01:34:39.703350+0000 mgr.a (mgr.14388) 8662 : audit [DBG] from='client.193572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:41 smithi044 bash[22676]: audit 2024-09-21T01:34:40.683429+0000 mon.a (mon.0) 7319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:41 smithi044 bash[22676]: audit 2024-09-21T01:34:40.693386+0000 mon.a (mon.0) 7320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:41 smithi044 bash[22676]: audit 2024-09-21T01:34:40.705328+0000 mon.a (mon.0) 7321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:41 smithi179 bash[23186]: audit 2024-09-21T01:34:39.703350+0000 mgr.a (mgr.14388) 8662 : audit [DBG] from='client.193572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:41 smithi179 bash[23186]: audit 2024-09-21T01:34:40.683429+0000 mon.a (mon.0) 7319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:41 smithi179 bash[23186]: audit 2024-09-21T01:34:40.693386+0000 mon.a (mon.0) 7320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:41 smithi179 bash[23186]: audit 2024-09-21T01:34:40.705328+0000 mon.a (mon.0) 7321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:41 smithi049 bash[23528]: audit 2024-09-21T01:34:39.703350+0000 mgr.a (mgr.14388) 8662 : audit [DBG] from='client.193572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:41 smithi049 bash[23528]: audit 2024-09-21T01:34:40.683429+0000 mon.a (mon.0) 7319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:41 smithi049 bash[23528]: audit 2024-09-21T01:34:40.693386+0000 mon.a (mon.0) 7320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:41 smithi049 bash[23528]: audit 2024-09-21T01:34:40.705328+0000 mon.a (mon.0) 7321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:42 smithi044 bash[22676]: cluster 2024-09-21T01:34:40.888566+0000 mgr.a (mgr.14388) 8663 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:34:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:42 smithi179 bash[23186]: cluster 2024-09-21T01:34:40.888566+0000 mgr.a (mgr.14388) 8663 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:34:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:42 smithi049 bash[23528]: cluster 2024-09-21T01:34:40.888566+0000 mgr.a (mgr.14388) 8663 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:34:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:44 smithi179 bash[23186]: cluster 2024-09-21T01:34:42.889373+0000 mgr.a (mgr.14388) 8664 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:34:44.857 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:44 smithi044 bash[22676]: cluster 2024-09-21T01:34:42.889373+0000 mgr.a (mgr.14388) 8664 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:34:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:44 smithi049 bash[23528]: cluster 2024-09-21T01:34:42.889373+0000 mgr.a (mgr.14388) 8664 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:34:45.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:45.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:45.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:45.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:46 smithi044 bash[22676]: cluster 2024-09-21T01:34:44.889819+0000 mgr.a (mgr.14388) 8665 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:34:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:46 smithi044 bash[22676]: audit 2024-09-21T01:34:45.462238+0000 mgr.a (mgr.14388) 8666 : audit [DBG] from='client.193650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:46 smithi179 bash[23186]: cluster 2024-09-21T01:34:44.889819+0000 mgr.a (mgr.14388) 8665 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:34:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:46 smithi179 bash[23186]: audit 2024-09-21T01:34:45.462238+0000 mgr.a (mgr.14388) 8666 : audit [DBG] from='client.193650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:46 smithi049 bash[23528]: cluster 2024-09-21T01:34:44.889819+0000 mgr.a (mgr.14388) 8665 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:34:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:46 smithi049 bash[23528]: audit 2024-09-21T01:34:45.462238+0000 mgr.a (mgr.14388) 8666 : audit [DBG] from='client.193650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:48 smithi044 bash[22676]: cluster 2024-09-21T01:34:46.892647+0000 mgr.a (mgr.14388) 8667 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:48 smithi179 bash[23186]: cluster 2024-09-21T01:34:46.892647+0000 mgr.a (mgr.14388) 8667 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:48 smithi049 bash[23528]: cluster 2024-09-21T01:34:46.892647+0000 mgr.a (mgr.14388) 8667 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:50.848 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:50 smithi049 bash[23528]: cluster 2024-09-21T01:34:48.893478+0000 mgr.a (mgr.14388) 8668 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:34:50.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:50.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:50.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:50 smithi044 bash[22676]: cluster 2024-09-21T01:34:48.893478+0000 mgr.a (mgr.14388) 8668 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:34:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:50 smithi179 bash[23186]: cluster 2024-09-21T01:34:48.893478+0000 mgr.a (mgr.14388) 8668 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:34:51.686 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:51.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:51.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:51.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:51.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:52.738 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:52 smithi049 bash[23528]: cluster 2024-09-21T01:34:50.895488+0000 mgr.a (mgr.14388) 8669 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:52.738 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:52 smithi049 bash[23528]: audit 2024-09-21T01:34:51.256314+0000 mgr.a (mgr.14388) 8670 : audit [DBG] from='client.193725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:52 smithi044 bash[22676]: cluster 2024-09-21T01:34:50.895488+0000 mgr.a (mgr.14388) 8669 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:52 smithi044 bash[22676]: audit 2024-09-21T01:34:51.256314+0000 mgr.a (mgr.14388) 8670 : audit [DBG] from='client.193725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:52 smithi179 bash[23186]: cluster 2024-09-21T01:34:50.895488+0000 mgr.a (mgr.14388) 8669 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:34:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:52 smithi179 bash[23186]: audit 2024-09-21T01:34:51.256314+0000 mgr.a (mgr.14388) 8670 : audit [DBG] from='client.193725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:54 smithi179 bash[23186]: cluster 2024-09-21T01:34:52.896490+0000 mgr.a (mgr.14388) 8671 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:34:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:54 smithi179 bash[23186]: audit 2024-09-21T01:34:54.382838+0000 mon.a (mon.0) 7322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:54 smithi179 bash[23186]: audit 2024-09-21T01:34:54.387874+0000 mon.a (mon.0) 7323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:54 smithi179 bash[23186]: audit 2024-09-21T01:34:54.394549+0000 mon.a (mon.0) 7324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:54 smithi044 bash[22676]: cluster 2024-09-21T01:34:52.896490+0000 mgr.a (mgr.14388) 8671 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:34:54.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:54 smithi044 bash[22676]: audit 2024-09-21T01:34:54.382838+0000 mon.a (mon.0) 7322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:54 smithi044 bash[22676]: audit 2024-09-21T01:34:54.387874+0000 mon.a (mon.0) 7323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:54 smithi044 bash[22676]: audit 2024-09-21T01:34:54.394549+0000 mon.a (mon.0) 7324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.973 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:54 smithi049 bash[23528]: cluster 2024-09-21T01:34:52.896490+0000 mgr.a (mgr.14388) 8671 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:34:54.973 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:54 smithi049 bash[23528]: audit 2024-09-21T01:34:54.382838+0000 mon.a (mon.0) 7322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.974 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:54 smithi049 bash[23528]: audit 2024-09-21T01:34:54.387874+0000 mon.a (mon.0) 7323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:54.974 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:54 smithi049 bash[23528]: audit 2024-09-21T01:34:54.394549+0000 mon.a (mon.0) 7324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:55 smithi044 bash[22676]: cluster 2024-09-21T01:34:54.897281+0000 mgr.a (mgr.14388) 8672 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:34:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:55 smithi044 bash[22676]: audit 2024-09-21T01:34:54.899369+0000 mon.a (mon.0) 7325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:55 smithi044 bash[22676]: audit 2024-09-21T01:34:54.908066+0000 mon.a (mon.0) 7326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:55 smithi044 bash[22676]: audit 2024-09-21T01:34:54.918331+0000 mon.a (mon.0) 7327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:55 smithi179 bash[23186]: cluster 2024-09-21T01:34:54.897281+0000 mgr.a (mgr.14388) 8672 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:34:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:55 smithi179 bash[23186]: audit 2024-09-21T01:34:54.899369+0000 mon.a (mon.0) 7325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:55 smithi179 bash[23186]: audit 2024-09-21T01:34:54.908066+0000 mon.a (mon.0) 7326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:55 smithi179 bash[23186]: audit 2024-09-21T01:34:54.918331+0000 mon.a (mon.0) 7327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:55 smithi049 bash[23528]: cluster 2024-09-21T01:34:54.897281+0000 mgr.a (mgr.14388) 8672 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:34:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:55 smithi049 bash[23528]: audit 2024-09-21T01:34:54.899369+0000 mon.a (mon.0) 7325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:55 smithi049 bash[23528]: audit 2024-09-21T01:34:54.908066+0000 mon.a (mon.0) 7326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:55 smithi049 bash[23528]: audit 2024-09-21T01:34:54.918331+0000 mon.a (mon.0) 7327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:34:56.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:34:56.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:34:56.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:34:57.444 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:34:57.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:34:57.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:34:57.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:34:57.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:34:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:57 smithi044 bash[22676]: cluster 2024-09-21T01:34:56.898653+0000 mgr.a (mgr.14388) 8673 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:34:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:57 smithi044 bash[22676]: audit 2024-09-21T01:34:57.024536+0000 mgr.a (mgr.14388) 8674 : audit [DBG] from='client.193803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:57 smithi179 bash[23186]: cluster 2024-09-21T01:34:56.898653+0000 mgr.a (mgr.14388) 8673 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:34:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:57 smithi179 bash[23186]: audit 2024-09-21T01:34:57.024536+0000 mgr.a (mgr.14388) 8674 : audit [DBG] from='client.193803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:57 smithi049 bash[23528]: cluster 2024-09-21T01:34:56.898653+0000 mgr.a (mgr.14388) 8673 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:34:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:57 smithi049 bash[23528]: audit 2024-09-21T01:34:57.024536+0000 mgr.a (mgr.14388) 8674 : audit [DBG] from='client.193803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:34:59 smithi044 bash[22676]: cluster 2024-09-21T01:34:58.899522+0000 mgr.a (mgr.14388) 8675 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:34:59 smithi179 bash[23186]: cluster 2024-09-21T01:34:58.899522+0000 mgr.a (mgr.14388) 8675 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:34:59 smithi049 bash[23528]: cluster 2024-09-21T01:34:58.899522+0000 mgr.a (mgr.14388) 8675 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:01 smithi044 bash[22676]: cluster 2024-09-21T01:35:00.901749+0000 mgr.a (mgr.14388) 8676 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:01 smithi044 bash[22676]: audit 2024-09-21T01:35:00.928096+0000 mon.a (mon.0) 7328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:01 smithi044 bash[22676]: audit 2024-09-21T01:35:00.936639+0000 mon.a (mon.0) 7329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:01 smithi044 bash[22676]: audit 2024-09-21T01:35:00.947098+0000 mon.a (mon.0) 7330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:01 smithi179 bash[23186]: cluster 2024-09-21T01:35:00.901749+0000 mgr.a (mgr.14388) 8676 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:01 smithi179 bash[23186]: audit 2024-09-21T01:35:00.928096+0000 mon.a (mon.0) 7328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:01 smithi179 bash[23186]: audit 2024-09-21T01:35:00.936639+0000 mon.a (mon.0) 7329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:01 smithi179 bash[23186]: audit 2024-09-21T01:35:00.947098+0000 mon.a (mon.0) 7330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:01 smithi049 bash[23528]: cluster 2024-09-21T01:35:00.901749+0000 mgr.a (mgr.14388) 8676 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:01 smithi049 bash[23528]: audit 2024-09-21T01:35:00.928096+0000 mon.a (mon.0) 7328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:01 smithi049 bash[23528]: audit 2024-09-21T01:35:00.936639+0000 mon.a (mon.0) 7329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:01 smithi049 bash[23528]: audit 2024-09-21T01:35:00.947098+0000 mon.a (mon.0) 7330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:02.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:02.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:02.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:03.229 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:03.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:03.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:03.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:03.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:03 smithi044 bash[22676]: audit 2024-09-21T01:35:02.783173+0000 mgr.a (mgr.14388) 8677 : audit [DBG] from='client.193878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:03 smithi044 bash[22676]: cluster 2024-09-21T01:35:02.902281+0000 mgr.a (mgr.14388) 8678 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:03 smithi179 bash[23186]: audit 2024-09-21T01:35:02.783173+0000 mgr.a (mgr.14388) 8677 : audit [DBG] from='client.193878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:03 smithi179 bash[23186]: cluster 2024-09-21T01:35:02.902281+0000 mgr.a (mgr.14388) 8678 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:03 smithi049 bash[23528]: audit 2024-09-21T01:35:02.783173+0000 mgr.a (mgr.14388) 8677 : audit [DBG] from='client.193878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:03 smithi049 bash[23528]: cluster 2024-09-21T01:35:02.902281+0000 mgr.a (mgr.14388) 8678 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:05 smithi044 bash[22676]: cluster 2024-09-21T01:35:04.903166+0000 mgr.a (mgr.14388) 8679 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:05 smithi179 bash[23186]: cluster 2024-09-21T01:35:04.903166+0000 mgr.a (mgr.14388) 8679 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:05 smithi049 bash[23528]: cluster 2024-09-21T01:35:04.903166+0000 mgr.a (mgr.14388) 8679 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:06 smithi044 bash[22676]: audit 2024-09-21T01:35:06.819521+0000 mon.a (mon.0) 7331 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:35:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:06 smithi044 bash[22676]: audit 2024-09-21T01:35:06.826703+0000 mon.a (mon.0) 7332 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:35:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:06 smithi044 bash[22676]: audit 2024-09-21T01:35:06.828624+0000 mon.a (mon.0) 7333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:35:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:06 smithi044 bash[22676]: audit 2024-09-21T01:35:06.840105+0000 mon.a (mon.0) 7334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:06 smithi044 bash[22676]: audit 2024-09-21T01:35:06.847382+0000 mon.a (mon.0) 7335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:35:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:06 smithi179 bash[23186]: audit 2024-09-21T01:35:06.819521+0000 mon.a (mon.0) 7331 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:35:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:06 smithi179 bash[23186]: audit 2024-09-21T01:35:06.826703+0000 mon.a (mon.0) 7332 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:35:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:06 smithi179 bash[23186]: audit 2024-09-21T01:35:06.828624+0000 mon.a (mon.0) 7333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:35:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:06 smithi179 bash[23186]: audit 2024-09-21T01:35:06.840105+0000 mon.a (mon.0) 7334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:06 smithi179 bash[23186]: audit 2024-09-21T01:35:06.847382+0000 mon.a (mon.0) 7335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:35:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:06 smithi049 bash[23528]: audit 2024-09-21T01:35:06.819521+0000 mon.a (mon.0) 7331 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:35:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:06 smithi049 bash[23528]: audit 2024-09-21T01:35:06.826703+0000 mon.a (mon.0) 7332 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:35:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:06 smithi049 bash[23528]: audit 2024-09-21T01:35:06.828624+0000 mon.a (mon.0) 7333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:35:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:06 smithi049 bash[23528]: audit 2024-09-21T01:35:06.840105+0000 mon.a (mon.0) 7334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:06 smithi049 bash[23528]: audit 2024-09-21T01:35:06.847382+0000 mon.a (mon.0) 7335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:35:07.938 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:35:07 smithi044 bash[22930]: debug 2024-09-21T01:35:07.629+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:35:07.938 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:35:07 smithi044 bash[22930]: debug 2024-09-21T01:35:07.629+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:35:08.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:08.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:08.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:07 smithi044 bash[22676]: audit 2024-09-21T01:35:06.849849+0000 mgr.a (mgr.14388) 8680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:35:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:07 smithi044 bash[22676]: cluster 2024-09-21T01:35:06.906332+0000 mgr.a (mgr.14388) 8681 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:07 smithi179 bash[23186]: audit 2024-09-21T01:35:06.849849+0000 mgr.a (mgr.14388) 8680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:35:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:07 smithi179 bash[23186]: cluster 2024-09-21T01:35:06.906332+0000 mgr.a (mgr.14388) 8681 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:07 smithi049 bash[23528]: audit 2024-09-21T01:35:06.849849+0000 mgr.a (mgr.14388) 8680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:35:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:07 smithi049 bash[23528]: cluster 2024-09-21T01:35:06.906332+0000 mgr.a (mgr.14388) 8681 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:08.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:08.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:08.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:08.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:08.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:08 smithi044 bash[22676]: audit 2024-09-21T01:35:07.635419+0000 mgr.a (mgr.14388) 8682 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:35:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:08 smithi044 bash[22676]: cephadm 2024-09-21T01:35:07.636624+0000 mgr.a (mgr.14388) 8683 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:35:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:08 smithi044 bash[22676]: audit 2024-09-21T01:35:08.564053+0000 mgr.a (mgr.14388) 8684 : audit [DBG] from='client.194061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:08 smithi179 bash[23186]: audit 2024-09-21T01:35:07.635419+0000 mgr.a (mgr.14388) 8682 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:35:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:08 smithi179 bash[23186]: cephadm 2024-09-21T01:35:07.636624+0000 mgr.a (mgr.14388) 8683 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:35:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:08 smithi179 bash[23186]: audit 2024-09-21T01:35:08.564053+0000 mgr.a (mgr.14388) 8684 : audit [DBG] from='client.194061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:08 smithi049 bash[23528]: audit 2024-09-21T01:35:07.635419+0000 mgr.a (mgr.14388) 8682 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:35:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:08 smithi049 bash[23528]: cephadm 2024-09-21T01:35:07.636624+0000 mgr.a (mgr.14388) 8683 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:35:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:08 smithi049 bash[23528]: audit 2024-09-21T01:35:08.564053+0000 mgr.a (mgr.14388) 8684 : audit [DBG] from='client.194061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:09 smithi044 bash[22676]: cluster 2024-09-21T01:35:08.906941+0000 mgr.a (mgr.14388) 8685 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:09 smithi179 bash[23186]: cluster 2024-09-21T01:35:08.906941+0000 mgr.a (mgr.14388) 8685 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:09 smithi049 bash[23528]: cluster 2024-09-21T01:35:08.906941+0000 mgr.a (mgr.14388) 8685 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:11 smithi049 bash[23528]: cluster 2024-09-21T01:35:10.909222+0000 mgr.a (mgr.14388) 8686 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:11 smithi044 bash[22676]: cluster 2024-09-21T01:35:10.909222+0000 mgr.a (mgr.14388) 8686 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:11 smithi179 bash[23186]: cluster 2024-09-21T01:35:10.909222+0000 mgr.a (mgr.14388) 8686 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:13.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:13.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:13.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:13 smithi049 bash[23528]: cluster 2024-09-21T01:35:12.910016+0000 mgr.a (mgr.14388) 8687 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:13 smithi044 bash[22676]: cluster 2024-09-21T01:35:12.910016+0000 mgr.a (mgr.14388) 8687 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:13 smithi179 bash[23186]: cluster 2024-09-21T01:35:12.910016+0000 mgr.a (mgr.14388) 8687 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:14.754 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:14.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:14.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:14.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:14.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:15 smithi049 bash[23528]: audit 2024-09-21T01:35:14.326727+0000 mgr.a (mgr.14388) 8688 : audit [DBG] from='client.194136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:15 smithi049 bash[23528]: audit 2024-09-21T01:35:14.587383+0000 mon.a (mon.0) 7336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:15 smithi049 bash[23528]: audit 2024-09-21T01:35:14.592691+0000 mon.a (mon.0) 7337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:15 smithi049 bash[23528]: audit 2024-09-21T01:35:14.598372+0000 mon.a (mon.0) 7338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:15 smithi049 bash[23528]: audit 2024-09-21T01:35:15.118990+0000 mon.a (mon.0) 7339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:15 smithi049 bash[23528]: audit 2024-09-21T01:35:15.125120+0000 mon.a (mon.0) 7340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:15 smithi049 bash[23528]: audit 2024-09-21T01:35:15.130996+0000 mon.a (mon.0) 7341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:15 smithi044 bash[22676]: audit 2024-09-21T01:35:14.326727+0000 mgr.a (mgr.14388) 8688 : audit [DBG] from='client.194136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:15 smithi044 bash[22676]: audit 2024-09-21T01:35:14.587383+0000 mon.a (mon.0) 7336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:15 smithi044 bash[22676]: audit 2024-09-21T01:35:14.592691+0000 mon.a (mon.0) 7337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:15 smithi044 bash[22676]: audit 2024-09-21T01:35:14.598372+0000 mon.a (mon.0) 7338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:15 smithi044 bash[22676]: audit 2024-09-21T01:35:15.118990+0000 mon.a (mon.0) 7339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:15 smithi044 bash[22676]: audit 2024-09-21T01:35:15.125120+0000 mon.a (mon.0) 7340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:15 smithi044 bash[22676]: audit 2024-09-21T01:35:15.130996+0000 mon.a (mon.0) 7341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:15 smithi179 bash[23186]: audit 2024-09-21T01:35:14.326727+0000 mgr.a (mgr.14388) 8688 : audit [DBG] from='client.194136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:15 smithi179 bash[23186]: audit 2024-09-21T01:35:14.587383+0000 mon.a (mon.0) 7336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:15 smithi179 bash[23186]: audit 2024-09-21T01:35:14.592691+0000 mon.a (mon.0) 7337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:15 smithi179 bash[23186]: audit 2024-09-21T01:35:14.598372+0000 mon.a (mon.0) 7338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:15 smithi179 bash[23186]: audit 2024-09-21T01:35:15.118990+0000 mon.a (mon.0) 7339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:15 smithi179 bash[23186]: audit 2024-09-21T01:35:15.125120+0000 mon.a (mon.0) 7340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:15 smithi179 bash[23186]: audit 2024-09-21T01:35:15.130996+0000 mon.a (mon.0) 7341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:16.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:16 smithi044 bash[22676]: cluster 2024-09-21T01:35:14.910891+0000 mgr.a (mgr.14388) 8689 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:16 smithi179 bash[23186]: cluster 2024-09-21T01:35:14.910891+0000 mgr.a (mgr.14388) 8689 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:16 smithi049 bash[23528]: cluster 2024-09-21T01:35:14.910891+0000 mgr.a (mgr.14388) 8689 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:18 smithi044 bash[22676]: cluster 2024-09-21T01:35:16.912846+0000 mgr.a (mgr.14388) 8690 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:18 smithi179 bash[23186]: cluster 2024-09-21T01:35:16.912846+0000 mgr.a (mgr.14388) 8690 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:18 smithi049 bash[23528]: cluster 2024-09-21T01:35:16.912846+0000 mgr.a (mgr.14388) 8690 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:19.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:19.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:19.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:19 smithi044 bash[22676]: cluster 2024-09-21T01:35:18.913658+0000 mgr.a (mgr.14388) 8691 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:19 smithi179 bash[23186]: cluster 2024-09-21T01:35:18.913658+0000 mgr.a (mgr.14388) 8691 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:19 smithi049 bash[23528]: cluster 2024-09-21T01:35:18.913658+0000 mgr.a (mgr.14388) 8691 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:20.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:20.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:20.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:20.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:20.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:20 smithi044 bash[22676]: audit 2024-09-21T01:35:20.094265+0000 mgr.a (mgr.14388) 8692 : audit [DBG] from='client.194211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:20 smithi179 bash[23186]: audit 2024-09-21T01:35:20.094265+0000 mgr.a (mgr.14388) 8692 : audit [DBG] from='client.194211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:20 smithi049 bash[23528]: audit 2024-09-21T01:35:20.094265+0000 mgr.a (mgr.14388) 8692 : audit [DBG] from='client.194211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:22 smithi044 bash[22676]: cluster 2024-09-21T01:35:20.916535+0000 mgr.a (mgr.14388) 8693 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:22 smithi044 bash[22676]: audit 2024-09-21T01:35:21.162834+0000 mon.a (mon.0) 7342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:22 smithi044 bash[22676]: audit 2024-09-21T01:35:21.172909+0000 mon.a (mon.0) 7343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:22 smithi044 bash[22676]: audit 2024-09-21T01:35:21.185029+0000 mon.a (mon.0) 7344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:22 smithi179 bash[23186]: cluster 2024-09-21T01:35:20.916535+0000 mgr.a (mgr.14388) 8693 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:22 smithi179 bash[23186]: audit 2024-09-21T01:35:21.162834+0000 mon.a (mon.0) 7342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:22 smithi179 bash[23186]: audit 2024-09-21T01:35:21.172909+0000 mon.a (mon.0) 7343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:22 smithi179 bash[23186]: audit 2024-09-21T01:35:21.185029+0000 mon.a (mon.0) 7344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:22 smithi049 bash[23528]: cluster 2024-09-21T01:35:20.916535+0000 mgr.a (mgr.14388) 8693 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:35:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:22 smithi049 bash[23528]: audit 2024-09-21T01:35:21.162834+0000 mon.a (mon.0) 7342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:22 smithi049 bash[23528]: audit 2024-09-21T01:35:21.172909+0000 mon.a (mon.0) 7343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:22 smithi049 bash[23528]: audit 2024-09-21T01:35:21.185029+0000 mon.a (mon.0) 7344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:24 smithi044 bash[22676]: cluster 2024-09-21T01:35:22.917376+0000 mgr.a (mgr.14388) 8694 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:35:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:24 smithi179 bash[23186]: cluster 2024-09-21T01:35:22.917376+0000 mgr.a (mgr.14388) 8694 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:35:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:24 smithi049 bash[23528]: cluster 2024-09-21T01:35:22.917376+0000 mgr.a (mgr.14388) 8694 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:35:25.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:25.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:25.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:26.311 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:26 smithi044 bash[22676]: cluster 2024-09-21T01:35:24.918141+0000 mgr.a (mgr.14388) 8695 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:35:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:26 smithi179 bash[23186]: cluster 2024-09-21T01:35:24.918141+0000 mgr.a (mgr.14388) 8695 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:35:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:26 smithi049 bash[23528]: cluster 2024-09-21T01:35:24.918141+0000 mgr.a (mgr.14388) 8695 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:35:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:27 smithi044 bash[22676]: audit 2024-09-21T01:35:25.880925+0000 mgr.a (mgr.14388) 8696 : audit [DBG] from='client.194286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:27 smithi179 bash[23186]: audit 2024-09-21T01:35:25.880925+0000 mgr.a (mgr.14388) 8696 : audit [DBG] from='client.194286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:27 smithi049 bash[23528]: audit 2024-09-21T01:35:25.880925+0000 mgr.a (mgr.14388) 8696 : audit [DBG] from='client.194286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:28 smithi044 bash[22676]: cluster 2024-09-21T01:35:26.921027+0000 mgr.a (mgr.14388) 8697 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:28 smithi179 bash[23186]: cluster 2024-09-21T01:35:26.921027+0000 mgr.a (mgr.14388) 8697 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:28 smithi049 bash[23528]: cluster 2024-09-21T01:35:26.921027+0000 mgr.a (mgr.14388) 8697 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:30 smithi044 bash[22676]: cluster 2024-09-21T01:35:28.921849+0000 mgr.a (mgr.14388) 8698 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:35:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:30 smithi179 bash[23186]: cluster 2024-09-21T01:35:28.921849+0000 mgr.a (mgr.14388) 8698 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:35:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:30 smithi049 bash[23528]: cluster 2024-09-21T01:35:28.921849+0000 mgr.a (mgr.14388) 8698 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:35:31.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:31.314 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:31.314 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:32.073 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:32 smithi044 bash[22676]: cluster 2024-09-21T01:35:30.923859+0000 mgr.a (mgr.14388) 8699 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:32 smithi179 bash[23186]: cluster 2024-09-21T01:35:30.923859+0000 mgr.a (mgr.14388) 8699 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:32 smithi049 bash[23528]: cluster 2024-09-21T01:35:30.923859+0000 mgr.a (mgr.14388) 8699 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:33 smithi044 bash[22676]: audit 2024-09-21T01:35:31.649638+0000 mgr.a (mgr.14388) 8700 : audit [DBG] from='client.194361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:33.490 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:33 smithi049 bash[23528]: audit 2024-09-21T01:35:31.649638+0000 mgr.a (mgr.14388) 8700 : audit [DBG] from='client.194361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:33 smithi179 bash[23186]: audit 2024-09-21T01:35:31.649638+0000 mgr.a (mgr.14388) 8700 : audit [DBG] from='client.194361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:34 smithi044 bash[22676]: cluster 2024-09-21T01:35:32.924744+0000 mgr.a (mgr.14388) 8701 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:34 smithi179 bash[23186]: cluster 2024-09-21T01:35:32.924744+0000 mgr.a (mgr.14388) 8701 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:34 smithi049 bash[23528]: cluster 2024-09-21T01:35:32.924744+0000 mgr.a (mgr.14388) 8701 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:35 smithi044 bash[22676]: audit 2024-09-21T01:35:34.789770+0000 mon.a (mon.0) 7345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:35 smithi044 bash[22676]: audit 2024-09-21T01:35:34.796844+0000 mon.a (mon.0) 7346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:35 smithi044 bash[22676]: audit 2024-09-21T01:35:34.803637+0000 mon.a (mon.0) 7347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:35 smithi044 bash[22676]: cluster 2024-09-21T01:35:34.925558+0000 mgr.a (mgr.14388) 8702 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:35 smithi044 bash[22676]: audit 2024-09-21T01:35:35.283923+0000 mon.a (mon.0) 7348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:35 smithi044 bash[22676]: audit 2024-09-21T01:35:35.289460+0000 mon.a (mon.0) 7349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:35 smithi044 bash[22676]: audit 2024-09-21T01:35:35.297127+0000 mon.a (mon.0) 7350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:35 smithi049 bash[23528]: audit 2024-09-21T01:35:34.789770+0000 mon.a (mon.0) 7345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:35 smithi049 bash[23528]: audit 2024-09-21T01:35:34.796844+0000 mon.a (mon.0) 7346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:35 smithi049 bash[23528]: audit 2024-09-21T01:35:34.803637+0000 mon.a (mon.0) 7347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:35 smithi049 bash[23528]: cluster 2024-09-21T01:35:34.925558+0000 mgr.a (mgr.14388) 8702 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:35 smithi049 bash[23528]: audit 2024-09-21T01:35:35.283923+0000 mon.a (mon.0) 7348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:35 smithi049 bash[23528]: audit 2024-09-21T01:35:35.289460+0000 mon.a (mon.0) 7349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:35 smithi049 bash[23528]: audit 2024-09-21T01:35:35.297127+0000 mon.a (mon.0) 7350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:35 smithi179 bash[23186]: audit 2024-09-21T01:35:34.789770+0000 mon.a (mon.0) 7345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:35 smithi179 bash[23186]: audit 2024-09-21T01:35:34.796844+0000 mon.a (mon.0) 7346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:35 smithi179 bash[23186]: audit 2024-09-21T01:35:34.803637+0000 mon.a (mon.0) 7347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:35 smithi179 bash[23186]: cluster 2024-09-21T01:35:34.925558+0000 mgr.a (mgr.14388) 8702 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:35 smithi179 bash[23186]: audit 2024-09-21T01:35:35.283923+0000 mon.a (mon.0) 7348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:35 smithi179 bash[23186]: audit 2024-09-21T01:35:35.289460+0000 mon.a (mon.0) 7349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:35 smithi179 bash[23186]: audit 2024-09-21T01:35:35.297127+0000 mon.a (mon.0) 7350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:37.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:37.852 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:37.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:37.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:37.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:37.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:37 smithi044 bash[22676]: cluster 2024-09-21T01:35:36.927735+0000 mgr.a (mgr.14388) 8703 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:37 smithi044 bash[22676]: audit 2024-09-21T01:35:37.410380+0000 mgr.a (mgr.14388) 8704 : audit [DBG] from='client.194436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:37 smithi179 bash[23186]: cluster 2024-09-21T01:35:36.927735+0000 mgr.a (mgr.14388) 8703 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:37 smithi179 bash[23186]: audit 2024-09-21T01:35:37.410380+0000 mgr.a (mgr.14388) 8704 : audit [DBG] from='client.194436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:37 smithi049 bash[23528]: cluster 2024-09-21T01:35:36.927735+0000 mgr.a (mgr.14388) 8703 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:37 smithi049 bash[23528]: audit 2024-09-21T01:35:37.410380+0000 mgr.a (mgr.14388) 8704 : audit [DBG] from='client.194436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:39 smithi179 bash[23186]: cluster 2024-09-21T01:35:38.928683+0000 mgr.a (mgr.14388) 8705 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:39 smithi049 bash[23528]: cluster 2024-09-21T01:35:38.928683+0000 mgr.a (mgr.14388) 8705 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:39 smithi044 bash[22676]: cluster 2024-09-21T01:35:38.928683+0000 mgr.a (mgr.14388) 8705 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:42 smithi044 bash[22676]: cluster 2024-09-21T01:35:40.930942+0000 mgr.a (mgr.14388) 8706 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:42 smithi044 bash[22676]: audit 2024-09-21T01:35:41.402274+0000 mon.a (mon.0) 7351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:42 smithi044 bash[22676]: audit 2024-09-21T01:35:41.412765+0000 mon.a (mon.0) 7352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:42 smithi044 bash[22676]: audit 2024-09-21T01:35:41.424911+0000 mon.a (mon.0) 7353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:42 smithi179 bash[23186]: cluster 2024-09-21T01:35:40.930942+0000 mgr.a (mgr.14388) 8706 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:42 smithi179 bash[23186]: audit 2024-09-21T01:35:41.402274+0000 mon.a (mon.0) 7351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:42 smithi179 bash[23186]: audit 2024-09-21T01:35:41.412765+0000 mon.a (mon.0) 7352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:42 smithi179 bash[23186]: audit 2024-09-21T01:35:41.424911+0000 mon.a (mon.0) 7353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:42 smithi049 bash[23528]: cluster 2024-09-21T01:35:40.930942+0000 mgr.a (mgr.14388) 8706 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:42 smithi049 bash[23528]: audit 2024-09-21T01:35:41.402274+0000 mon.a (mon.0) 7351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:42 smithi049 bash[23528]: audit 2024-09-21T01:35:41.412765+0000 mon.a (mon.0) 7352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:42 smithi049 bash[23528]: audit 2024-09-21T01:35:41.424911+0000 mon.a (mon.0) 7353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:42.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:42.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:42.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:43.652 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:44 smithi044 bash[22676]: cluster 2024-09-21T01:35:42.931477+0000 mgr.a (mgr.14388) 8707 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:44 smithi044 bash[22676]: audit 2024-09-21T01:35:43.191394+0000 mgr.a (mgr.14388) 8708 : audit [DBG] from='client.194514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:44 smithi179 bash[23186]: cluster 2024-09-21T01:35:42.931477+0000 mgr.a (mgr.14388) 8707 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:44 smithi179 bash[23186]: audit 2024-09-21T01:35:43.191394+0000 mgr.a (mgr.14388) 8708 : audit [DBG] from='client.194514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:44 smithi049 bash[23528]: cluster 2024-09-21T01:35:42.931477+0000 mgr.a (mgr.14388) 8707 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:44 smithi049 bash[23528]: audit 2024-09-21T01:35:43.191394+0000 mgr.a (mgr.14388) 8708 : audit [DBG] from='client.194514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:46 smithi179 bash[23186]: cluster 2024-09-21T01:35:44.932372+0000 mgr.a (mgr.14388) 8709 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:46 smithi044 bash[22676]: cluster 2024-09-21T01:35:44.932372+0000 mgr.a (mgr.14388) 8709 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:46 smithi049 bash[23528]: cluster 2024-09-21T01:35:44.932372+0000 mgr.a (mgr.14388) 8709 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:48.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:48.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:48.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:48 smithi044 bash[22676]: cluster 2024-09-21T01:35:46.934735+0000 mgr.a (mgr.14388) 8710 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:48 smithi179 bash[23186]: cluster 2024-09-21T01:35:46.934735+0000 mgr.a (mgr.14388) 8710 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:48 smithi049 bash[23528]: cluster 2024-09-21T01:35:46.934735+0000 mgr.a (mgr.14388) 8710 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:35:49.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:49.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:49.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:50 smithi044 bash[22676]: cluster 2024-09-21T01:35:48.935473+0000 mgr.a (mgr.14388) 8711 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:50 smithi044 bash[22676]: audit 2024-09-21T01:35:49.001496+0000 mgr.a (mgr.14388) 8712 : audit [DBG] from='client.194589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:50 smithi179 bash[23186]: cluster 2024-09-21T01:35:48.935473+0000 mgr.a (mgr.14388) 8711 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:50 smithi179 bash[23186]: audit 2024-09-21T01:35:49.001496+0000 mgr.a (mgr.14388) 8712 : audit [DBG] from='client.194589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:50 smithi049 bash[23528]: cluster 2024-09-21T01:35:48.935473+0000 mgr.a (mgr.14388) 8711 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:35:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:50 smithi049 bash[23528]: audit 2024-09-21T01:35:49.001496+0000 mgr.a (mgr.14388) 8712 : audit [DBG] from='client.194589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:52 smithi179 bash[23186]: cluster 2024-09-21T01:35:50.937829+0000 mgr.a (mgr.14388) 8713 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:35:52.677 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:52 smithi049 bash[23528]: cluster 2024-09-21T01:35:50.937829+0000 mgr.a (mgr.14388) 8713 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:35:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:52 smithi044 bash[22676]: cluster 2024-09-21T01:35:50.937829+0000 mgr.a (mgr.14388) 8713 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:35:54.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:35:54.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:35:54.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:35:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:54 smithi044 bash[22676]: cluster 2024-09-21T01:35:52.938616+0000 mgr.a (mgr.14388) 8714 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:54 smithi179 bash[23186]: cluster 2024-09-21T01:35:52.938616+0000 mgr.a (mgr.14388) 8714 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:54 smithi049 bash[23528]: cluster 2024-09-21T01:35:52.938616+0000 mgr.a (mgr.14388) 8714 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:55.199 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:35:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:35:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:35:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:35:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:35:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: audit 2024-09-21T01:35:54.774287+0000 mgr.a (mgr.14388) 8715 : audit [DBG] from='client.194667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: cluster 2024-09-21T01:35:54.939157+0000 mgr.a (mgr.14388) 8716 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: audit 2024-09-21T01:35:54.998868+0000 mon.a (mon.0) 7354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: audit 2024-09-21T01:35:55.004817+0000 mon.a (mon.0) 7355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: audit 2024-09-21T01:35:55.011678+0000 mon.a (mon.0) 7356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: audit 2024-09-21T01:35:55.470004+0000 mon.a (mon.0) 7357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: audit 2024-09-21T01:35:55.475527+0000 mon.a (mon.0) 7358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:56 smithi179 bash[23186]: audit 2024-09-21T01:35:55.481555+0000 mon.a (mon.0) 7359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.255 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: audit 2024-09-21T01:35:54.774287+0000 mgr.a (mgr.14388) 8715 : audit [DBG] from='client.194667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:56.255 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: cluster 2024-09-21T01:35:54.939157+0000 mgr.a (mgr.14388) 8716 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:56.255 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: audit 2024-09-21T01:35:54.998868+0000 mon.a (mon.0) 7354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.255 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: audit 2024-09-21T01:35:55.004817+0000 mon.a (mon.0) 7355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.255 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: audit 2024-09-21T01:35:55.011678+0000 mon.a (mon.0) 7356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.255 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: audit 2024-09-21T01:35:55.470004+0000 mon.a (mon.0) 7357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.256 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: audit 2024-09-21T01:35:55.475527+0000 mon.a (mon.0) 7358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.256 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:56 smithi049 bash[23528]: audit 2024-09-21T01:35:55.481555+0000 mon.a (mon.0) 7359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: audit 2024-09-21T01:35:54.774287+0000 mgr.a (mgr.14388) 8715 : audit [DBG] from='client.194667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: cluster 2024-09-21T01:35:54.939157+0000 mgr.a (mgr.14388) 8716 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: audit 2024-09-21T01:35:54.998868+0000 mon.a (mon.0) 7354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: audit 2024-09-21T01:35:55.004817+0000 mon.a (mon.0) 7355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: audit 2024-09-21T01:35:55.011678+0000 mon.a (mon.0) 7356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: audit 2024-09-21T01:35:55.470004+0000 mon.a (mon.0) 7357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: audit 2024-09-21T01:35:55.475527+0000 mon.a (mon.0) 7358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:56 smithi044 bash[22676]: audit 2024-09-21T01:35:55.481555+0000 mon.a (mon.0) 7359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:35:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:35:58 smithi044 bash[22676]: cluster 2024-09-21T01:35:56.941885+0000 mgr.a (mgr.14388) 8717 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:35:58 smithi049 bash[23528]: cluster 2024-09-21T01:35:56.941885+0000 mgr.a (mgr.14388) 8717 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:35:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:35:58 smithi179 bash[23186]: cluster 2024-09-21T01:35:56.941885+0000 mgr.a (mgr.14388) 8717 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:36:00.201 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:00.202 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:00.202 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:00 smithi049 bash[23528]: cluster 2024-09-21T01:35:58.942671+0000 mgr.a (mgr.14388) 8718 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:36:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:00 smithi044 bash[22676]: cluster 2024-09-21T01:35:58.942671+0000 mgr.a (mgr.14388) 8718 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:36:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:00 smithi179 bash[23186]: cluster 2024-09-21T01:35:58.942671+0000 mgr.a (mgr.14388) 8718 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:36:01.005 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:01.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:01.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:01.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:01.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:01 smithi049 bash[23528]: audit 2024-09-21T01:36:00.536084+0000 mgr.a (mgr.14388) 8719 : audit [DBG] from='client.194745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:01 smithi044 bash[22676]: audit 2024-09-21T01:36:00.536084+0000 mgr.a (mgr.14388) 8719 : audit [DBG] from='client.194745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:01 smithi179 bash[23186]: audit 2024-09-21T01:36:00.536084+0000 mgr.a (mgr.14388) 8719 : audit [DBG] from='client.194745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:02 smithi049 bash[23528]: cluster 2024-09-21T01:36:00.944519+0000 mgr.a (mgr.14388) 8720 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:36:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:02 smithi049 bash[23528]: audit 2024-09-21T01:36:01.620313+0000 mon.a (mon.0) 7360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:02 smithi049 bash[23528]: audit 2024-09-21T01:36:01.630265+0000 mon.a (mon.0) 7361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:02 smithi049 bash[23528]: audit 2024-09-21T01:36:01.642019+0000 mon.a (mon.0) 7362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:02 smithi044 bash[22676]: cluster 2024-09-21T01:36:00.944519+0000 mgr.a (mgr.14388) 8720 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:36:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:02 smithi044 bash[22676]: audit 2024-09-21T01:36:01.620313+0000 mon.a (mon.0) 7360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:02 smithi044 bash[22676]: audit 2024-09-21T01:36:01.630265+0000 mon.a (mon.0) 7361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:02 smithi044 bash[22676]: audit 2024-09-21T01:36:01.642019+0000 mon.a (mon.0) 7362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:02 smithi179 bash[23186]: cluster 2024-09-21T01:36:00.944519+0000 mgr.a (mgr.14388) 8720 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:36:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:02 smithi179 bash[23186]: audit 2024-09-21T01:36:01.620313+0000 mon.a (mon.0) 7360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:02 smithi179 bash[23186]: audit 2024-09-21T01:36:01.630265+0000 mon.a (mon.0) 7361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:02 smithi179 bash[23186]: audit 2024-09-21T01:36:01.642019+0000 mon.a (mon.0) 7362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:04 smithi049 bash[23528]: cluster 2024-09-21T01:36:02.945464+0000 mgr.a (mgr.14388) 8721 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:04 smithi044 bash[22676]: cluster 2024-09-21T01:36:02.945464+0000 mgr.a (mgr.14388) 8721 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:04 smithi179 bash[23186]: cluster 2024-09-21T01:36:02.945464+0000 mgr.a (mgr.14388) 8721 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:06.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:06 smithi049 bash[23528]: cluster 2024-09-21T01:36:04.946230+0000 mgr.a (mgr.14388) 8722 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:36:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:06 smithi044 bash[22676]: cluster 2024-09-21T01:36:04.946230+0000 mgr.a (mgr.14388) 8722 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:36:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:06 smithi179 bash[23186]: cluster 2024-09-21T01:36:04.946230+0000 mgr.a (mgr.14388) 8722 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:36:06.797 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:07 smithi179 bash[23186]: audit 2024-09-21T01:36:06.343283+0000 mgr.a (mgr.14388) 8723 : audit [DBG] from='client.194823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:07 smithi049 bash[23528]: audit 2024-09-21T01:36:06.343283+0000 mgr.a (mgr.14388) 8723 : audit [DBG] from='client.194823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:07 smithi044 bash[22676]: audit 2024-09-21T01:36:06.343283+0000 mgr.a (mgr.14388) 8723 : audit [DBG] from='client.194823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:08 smithi049 bash[23528]: cluster 2024-09-21T01:36:06.949399+0000 mgr.a (mgr.14388) 8724 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T01:36:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:08 smithi049 bash[23528]: audit 2024-09-21T01:36:07.695657+0000 mon.a (mon.0) 7363 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:36:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:08 smithi049 bash[23528]: audit 2024-09-21T01:36:07.703119+0000 mon.a (mon.0) 7364 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:36:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:08 smithi049 bash[23528]: audit 2024-09-21T01:36:07.705190+0000 mon.a (mon.0) 7365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:36:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:08 smithi049 bash[23528]: audit 2024-09-21T01:36:07.717165+0000 mon.a (mon.0) 7366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:08 smithi049 bash[23528]: audit 2024-09-21T01:36:07.723584+0000 mon.a (mon.0) 7367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:36:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22676]: cluster 2024-09-21T01:36:06.949399+0000 mgr.a (mgr.14388) 8724 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T01:36:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22676]: audit 2024-09-21T01:36:07.695657+0000 mon.a (mon.0) 7363 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:36:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22676]: audit 2024-09-21T01:36:07.703119+0000 mon.a (mon.0) 7364 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:36:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22676]: audit 2024-09-21T01:36:07.705190+0000 mon.a (mon.0) 7365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:36:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22676]: audit 2024-09-21T01:36:07.717165+0000 mon.a (mon.0) 7366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22676]: audit 2024-09-21T01:36:07.723584+0000 mon.a (mon.0) 7367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:36:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:08 smithi179 bash[23186]: cluster 2024-09-21T01:36:06.949399+0000 mgr.a (mgr.14388) 8724 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T01:36:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:08 smithi179 bash[23186]: audit 2024-09-21T01:36:07.695657+0000 mon.a (mon.0) 7363 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:36:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:08 smithi179 bash[23186]: audit 2024-09-21T01:36:07.703119+0000 mon.a (mon.0) 7364 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:36:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:08 smithi179 bash[23186]: audit 2024-09-21T01:36:07.705190+0000 mon.a (mon.0) 7365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:36:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:08 smithi179 bash[23186]: audit 2024-09-21T01:36:07.717165+0000 mon.a (mon.0) 7366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:08 smithi179 bash[23186]: audit 2024-09-21T01:36:07.723584+0000 mon.a (mon.0) 7367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:36:08.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22930]: debug 2024-09-21T01:36:08.512+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:36:08.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:36:08 smithi044 bash[22930]: debug 2024-09-21T01:36:08.516+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:36:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:09 smithi049 bash[23528]: audit 2024-09-21T01:36:07.726476+0000 mgr.a (mgr.14388) 8725 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:36:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:09 smithi049 bash[23528]: audit 2024-09-21T01:36:08.516107+0000 mgr.a (mgr.14388) 8726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:36:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:09 smithi049 bash[23528]: cephadm 2024-09-21T01:36:08.517519+0000 mgr.a (mgr.14388) 8727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:36:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:09 smithi044 bash[22676]: audit 2024-09-21T01:36:07.726476+0000 mgr.a (mgr.14388) 8725 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:36:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:09 smithi044 bash[22676]: audit 2024-09-21T01:36:08.516107+0000 mgr.a (mgr.14388) 8726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:36:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:09 smithi044 bash[22676]: cephadm 2024-09-21T01:36:08.517519+0000 mgr.a (mgr.14388) 8727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:36:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:09 smithi179 bash[23186]: audit 2024-09-21T01:36:07.726476+0000 mgr.a (mgr.14388) 8725 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:36:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:09 smithi179 bash[23186]: audit 2024-09-21T01:36:08.516107+0000 mgr.a (mgr.14388) 8726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:36:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:09 smithi179 bash[23186]: cephadm 2024-09-21T01:36:08.517519+0000 mgr.a (mgr.14388) 8727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:36:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:10 smithi049 bash[23528]: cluster 2024-09-21T01:36:08.950405+0000 mgr.a (mgr.14388) 8728 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T01:36:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:10 smithi044 bash[22676]: cluster 2024-09-21T01:36:08.950405+0000 mgr.a (mgr.14388) 8728 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T01:36:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:10 smithi179 bash[23186]: cluster 2024-09-21T01:36:08.950405+0000 mgr.a (mgr.14388) 8728 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T01:36:11.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:11.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:11.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:12 smithi179 bash[23186]: cluster 2024-09-21T01:36:10.952637+0000 mgr.a (mgr.14388) 8729 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T01:36:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:12 smithi044 bash[22676]: cluster 2024-09-21T01:36:10.952637+0000 mgr.a (mgr.14388) 8729 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T01:36:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:12 smithi049 bash[23528]: cluster 2024-09-21T01:36:10.952637+0000 mgr.a (mgr.14388) 8729 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T01:36:12.587 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:12.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:12.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:12.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:12.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:13 smithi179 bash[23186]: audit 2024-09-21T01:36:12.135921+0000 mgr.a (mgr.14388) 8730 : audit [DBG] from='client.195006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:13 smithi044 bash[22676]: audit 2024-09-21T01:36:12.135921+0000 mgr.a (mgr.14388) 8730 : audit [DBG] from='client.195006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:13 smithi049 bash[23528]: audit 2024-09-21T01:36:12.135921+0000 mgr.a (mgr.14388) 8730 : audit [DBG] from='client.195006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:14.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:14 smithi179 bash[23186]: cluster 2024-09-21T01:36:12.953671+0000 mgr.a (mgr.14388) 8731 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T01:36:14.465 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:14 smithi049 bash[23528]: cluster 2024-09-21T01:36:12.953671+0000 mgr.a (mgr.14388) 8731 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T01:36:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:14 smithi044 bash[22676]: cluster 2024-09-21T01:36:12.953671+0000 mgr.a (mgr.14388) 8731 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T01:36:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:16 smithi044 bash[22676]: cluster 2024-09-21T01:36:14.955078+0000 mgr.a (mgr.14388) 8732 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T01:36:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:16 smithi044 bash[22676]: audit 2024-09-21T01:36:15.220891+0000 mon.a (mon.0) 7368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:16 smithi044 bash[22676]: audit 2024-09-21T01:36:15.229269+0000 mon.a (mon.0) 7369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:16 smithi044 bash[22676]: audit 2024-09-21T01:36:15.239923+0000 mon.a (mon.0) 7370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:16 smithi044 bash[22676]: audit 2024-09-21T01:36:15.604084+0000 mon.a (mon.0) 7371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:16 smithi044 bash[22676]: audit 2024-09-21T01:36:15.610351+0000 mon.a (mon.0) 7372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:16 smithi044 bash[22676]: audit 2024-09-21T01:36:15.616962+0000 mon.a (mon.0) 7373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:16 smithi179 bash[23186]: cluster 2024-09-21T01:36:14.955078+0000 mgr.a (mgr.14388) 8732 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T01:36:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:16 smithi179 bash[23186]: audit 2024-09-21T01:36:15.220891+0000 mon.a (mon.0) 7368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:16 smithi179 bash[23186]: audit 2024-09-21T01:36:15.229269+0000 mon.a (mon.0) 7369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:16 smithi179 bash[23186]: audit 2024-09-21T01:36:15.239923+0000 mon.a (mon.0) 7370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:16 smithi179 bash[23186]: audit 2024-09-21T01:36:15.604084+0000 mon.a (mon.0) 7371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:16 smithi179 bash[23186]: audit 2024-09-21T01:36:15.610351+0000 mon.a (mon.0) 7372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:16 smithi179 bash[23186]: audit 2024-09-21T01:36:15.616962+0000 mon.a (mon.0) 7373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:16 smithi049 bash[23528]: cluster 2024-09-21T01:36:14.955078+0000 mgr.a (mgr.14388) 8732 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T01:36:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:16 smithi049 bash[23528]: audit 2024-09-21T01:36:15.220891+0000 mon.a (mon.0) 7368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:16 smithi049 bash[23528]: audit 2024-09-21T01:36:15.229269+0000 mon.a (mon.0) 7369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:16 smithi049 bash[23528]: audit 2024-09-21T01:36:15.239923+0000 mon.a (mon.0) 7370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:16 smithi049 bash[23528]: audit 2024-09-21T01:36:15.604084+0000 mon.a (mon.0) 7371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:16 smithi049 bash[23528]: audit 2024-09-21T01:36:15.610351+0000 mon.a (mon.0) 7372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:16 smithi049 bash[23528]: audit 2024-09-21T01:36:15.616962+0000 mon.a (mon.0) 7373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:17.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:17.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:17.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:18.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:18.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:18.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:18.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:18.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:18 smithi044 bash[22676]: cluster 2024-09-21T01:36:16.956739+0000 mgr.a (mgr.14388) 8733 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T01:36:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:18 smithi179 bash[23186]: cluster 2024-09-21T01:36:16.956739+0000 mgr.a (mgr.14388) 8733 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T01:36:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:18 smithi049 bash[23528]: cluster 2024-09-21T01:36:16.956739+0000 mgr.a (mgr.14388) 8733 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 64 op/s 2024-09-21T01:36:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:19 smithi044 bash[22676]: audit 2024-09-21T01:36:17.915320+0000 mgr.a (mgr.14388) 8734 : audit [DBG] from='client.195081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:19 smithi179 bash[23186]: audit 2024-09-21T01:36:17.915320+0000 mgr.a (mgr.14388) 8734 : audit [DBG] from='client.195081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:19 smithi049 bash[23528]: audit 2024-09-21T01:36:17.915320+0000 mgr.a (mgr.14388) 8734 : audit [DBG] from='client.195081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:20 smithi179 bash[23186]: cluster 2024-09-21T01:36:18.957718+0000 mgr.a (mgr.14388) 8735 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:36:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:20 smithi049 bash[23528]: cluster 2024-09-21T01:36:18.957718+0000 mgr.a (mgr.14388) 8735 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:36:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:20 smithi044 bash[22676]: cluster 2024-09-21T01:36:18.957718+0000 mgr.a (mgr.14388) 8735 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:36:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:22 smithi179 bash[23186]: cluster 2024-09-21T01:36:20.959946+0000 mgr.a (mgr.14388) 8736 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:36:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:22 smithi179 bash[23186]: audit 2024-09-21T01:36:21.858891+0000 mon.a (mon.0) 7374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:22 smithi179 bash[23186]: audit 2024-09-21T01:36:21.867625+0000 mon.a (mon.0) 7375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:22 smithi179 bash[23186]: audit 2024-09-21T01:36:21.878212+0000 mon.a (mon.0) 7376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:22 smithi049 bash[23528]: cluster 2024-09-21T01:36:20.959946+0000 mgr.a (mgr.14388) 8736 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:36:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:22 smithi049 bash[23528]: audit 2024-09-21T01:36:21.858891+0000 mon.a (mon.0) 7374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:22 smithi049 bash[23528]: audit 2024-09-21T01:36:21.867625+0000 mon.a (mon.0) 7375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:22 smithi049 bash[23528]: audit 2024-09-21T01:36:21.878212+0000 mon.a (mon.0) 7376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:22 smithi044 bash[22676]: cluster 2024-09-21T01:36:20.959946+0000 mgr.a (mgr.14388) 8736 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:36:22.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:22 smithi044 bash[22676]: audit 2024-09-21T01:36:21.858891+0000 mon.a (mon.0) 7374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:22 smithi044 bash[22676]: audit 2024-09-21T01:36:21.867625+0000 mon.a (mon.0) 7375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:22.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:22 smithi044 bash[22676]: audit 2024-09-21T01:36:21.878212+0000 mon.a (mon.0) 7376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:23.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:23.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:24.091 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:24.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:24 smithi179 bash[23186]: cluster 2024-09-21T01:36:22.960715+0000 mgr.a (mgr.14388) 8737 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:24 smithi049 bash[23528]: cluster 2024-09-21T01:36:22.960715+0000 mgr.a (mgr.14388) 8737 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:24 smithi044 bash[22676]: cluster 2024-09-21T01:36:22.960715+0000 mgr.a (mgr.14388) 8737 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:25 smithi049 bash[23528]: audit 2024-09-21T01:36:23.676350+0000 mgr.a (mgr.14388) 8738 : audit [DBG] from='client.195159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:25 smithi044 bash[22676]: audit 2024-09-21T01:36:23.676350+0000 mgr.a (mgr.14388) 8738 : audit [DBG] from='client.195159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:25 smithi179 bash[23186]: audit 2024-09-21T01:36:23.676350+0000 mgr.a (mgr.14388) 8738 : audit [DBG] from='client.195159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:26 smithi049 bash[23528]: cluster 2024-09-21T01:36:24.962472+0000 mgr.a (mgr.14388) 8739 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T01:36:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:26 smithi044 bash[22676]: cluster 2024-09-21T01:36:24.962472+0000 mgr.a (mgr.14388) 8739 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T01:36:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:26 smithi179 bash[23186]: cluster 2024-09-21T01:36:24.962472+0000 mgr.a (mgr.14388) 8739 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T01:36:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:28 smithi049 bash[23528]: cluster 2024-09-21T01:36:26.964142+0000 mgr.a (mgr.14388) 8740 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:28 smithi044 bash[22676]: cluster 2024-09-21T01:36:26.964142+0000 mgr.a (mgr.14388) 8740 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:28 smithi179 bash[23186]: cluster 2024-09-21T01:36:26.964142+0000 mgr.a (mgr.14388) 8740 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:29.094 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:29.884 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:30 smithi049 bash[23528]: cluster 2024-09-21T01:36:28.964912+0000 mgr.a (mgr.14388) 8741 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:30 smithi049 bash[23528]: audit 2024-09-21T01:36:29.431162+0000 mgr.a (mgr.14388) 8742 : audit [DBG] from='client.195231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:30 smithi044 bash[22676]: cluster 2024-09-21T01:36:28.964912+0000 mgr.a (mgr.14388) 8741 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:30 smithi044 bash[22676]: audit 2024-09-21T01:36:29.431162+0000 mgr.a (mgr.14388) 8742 : audit [DBG] from='client.195231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:30 smithi179 bash[23186]: cluster 2024-09-21T01:36:28.964912+0000 mgr.a (mgr.14388) 8741 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:30 smithi179 bash[23186]: audit 2024-09-21T01:36:29.431162+0000 mgr.a (mgr.14388) 8742 : audit [DBG] from='client.195231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:32 smithi179 bash[23186]: cluster 2024-09-21T01:36:30.967206+0000 mgr.a (mgr.14388) 8743 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:32 smithi049 bash[23528]: cluster 2024-09-21T01:36:30.967206+0000 mgr.a (mgr.14388) 8743 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:32 smithi044 bash[22676]: cluster 2024-09-21T01:36:30.967206+0000 mgr.a (mgr.14388) 8743 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:34 smithi049 bash[23528]: cluster 2024-09-21T01:36:32.967965+0000 mgr.a (mgr.14388) 8744 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:34.611 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:34 smithi179 bash[23186]: cluster 2024-09-21T01:36:32.967965+0000 mgr.a (mgr.14388) 8744 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:34.704 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:34 smithi044 bash[22676]: cluster 2024-09-21T01:36:32.967965+0000 mgr.a (mgr.14388) 8744 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:34.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:34.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:34.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:35.711 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:35.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:35.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:35.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:35.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: cluster 2024-09-21T01:36:34.969468+0000 mgr.a (mgr.14388) 8745 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: audit 2024-09-21T01:36:35.234395+0000 mgr.a (mgr.14388) 8746 : audit [DBG] from='client.92035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: audit 2024-09-21T01:36:35.438569+0000 mon.a (mon.0) 7377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: audit 2024-09-21T01:36:35.444278+0000 mon.a (mon.0) 7378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: audit 2024-09-21T01:36:35.449938+0000 mon.a (mon.0) 7379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: audit 2024-09-21T01:36:35.754385+0000 mon.a (mon.0) 7380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: audit 2024-09-21T01:36:35.759946+0000 mon.a (mon.0) 7381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:36 smithi044 bash[22676]: audit 2024-09-21T01:36:35.765421+0000 mon.a (mon.0) 7382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: cluster 2024-09-21T01:36:34.969468+0000 mgr.a (mgr.14388) 8745 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: audit 2024-09-21T01:36:35.234395+0000 mgr.a (mgr.14388) 8746 : audit [DBG] from='client.92035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: audit 2024-09-21T01:36:35.438569+0000 mon.a (mon.0) 7377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: audit 2024-09-21T01:36:35.444278+0000 mon.a (mon.0) 7378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: audit 2024-09-21T01:36:35.449938+0000 mon.a (mon.0) 7379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: audit 2024-09-21T01:36:35.754385+0000 mon.a (mon.0) 7380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: audit 2024-09-21T01:36:35.759946+0000 mon.a (mon.0) 7381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:36 smithi179 bash[23186]: audit 2024-09-21T01:36:35.765421+0000 mon.a (mon.0) 7382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: cluster 2024-09-21T01:36:34.969468+0000 mgr.a (mgr.14388) 8745 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: audit 2024-09-21T01:36:35.234395+0000 mgr.a (mgr.14388) 8746 : audit [DBG] from='client.92035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: audit 2024-09-21T01:36:35.438569+0000 mon.a (mon.0) 7377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: audit 2024-09-21T01:36:35.444278+0000 mon.a (mon.0) 7378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: audit 2024-09-21T01:36:35.449938+0000 mon.a (mon.0) 7379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: audit 2024-09-21T01:36:35.754385+0000 mon.a (mon.0) 7380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: audit 2024-09-21T01:36:35.759946+0000 mon.a (mon.0) 7381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:36 smithi049 bash[23528]: audit 2024-09-21T01:36:35.765421+0000 mon.a (mon.0) 7382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:38 smithi044 bash[22676]: cluster 2024-09-21T01:36:36.971137+0000 mgr.a (mgr.14388) 8747 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T01:36:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:38 smithi179 bash[23186]: cluster 2024-09-21T01:36:36.971137+0000 mgr.a (mgr.14388) 8747 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T01:36:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:38 smithi049 bash[23528]: cluster 2024-09-21T01:36:36.971137+0000 mgr.a (mgr.14388) 8747 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T01:36:40.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:40 smithi044 bash[22676]: cluster 2024-09-21T01:36:38.972094+0000 mgr.a (mgr.14388) 8748 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:40 smithi179 bash[23186]: cluster 2024-09-21T01:36:38.972094+0000 mgr.a (mgr.14388) 8748 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:40 smithi049 bash[23528]: cluster 2024-09-21T01:36:38.972094+0000 mgr.a (mgr.14388) 8748 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:41.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:41.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:41.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:41.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:41.499 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:42 smithi044 bash[22676]: cluster 2024-09-21T01:36:40.973944+0000 mgr.a (mgr.14388) 8749 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:42 smithi044 bash[22676]: audit 2024-09-21T01:36:41.056952+0000 mgr.a (mgr.14388) 8750 : audit [DBG] from='client.195384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:42 smithi044 bash[22676]: audit 2024-09-21T01:36:42.074425+0000 mon.a (mon.0) 7383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:42 smithi044 bash[22676]: audit 2024-09-21T01:36:42.083259+0000 mon.a (mon.0) 7384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:42 smithi044 bash[22676]: audit 2024-09-21T01:36:42.094109+0000 mon.a (mon.0) 7385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:42 smithi179 bash[23186]: cluster 2024-09-21T01:36:40.973944+0000 mgr.a (mgr.14388) 8749 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:42 smithi179 bash[23186]: audit 2024-09-21T01:36:41.056952+0000 mgr.a (mgr.14388) 8750 : audit [DBG] from='client.195384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:42 smithi179 bash[23186]: audit 2024-09-21T01:36:42.074425+0000 mon.a (mon.0) 7383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:42 smithi179 bash[23186]: audit 2024-09-21T01:36:42.083259+0000 mon.a (mon.0) 7384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:42 smithi179 bash[23186]: audit 2024-09-21T01:36:42.094109+0000 mon.a (mon.0) 7385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:42 smithi049 bash[23528]: cluster 2024-09-21T01:36:40.973944+0000 mgr.a (mgr.14388) 8749 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:42 smithi049 bash[23528]: audit 2024-09-21T01:36:41.056952+0000 mgr.a (mgr.14388) 8750 : audit [DBG] from='client.195384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:42 smithi049 bash[23528]: audit 2024-09-21T01:36:42.074425+0000 mon.a (mon.0) 7383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:42 smithi049 bash[23528]: audit 2024-09-21T01:36:42.083259+0000 mon.a (mon.0) 7384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:42 smithi049 bash[23528]: audit 2024-09-21T01:36:42.094109+0000 mon.a (mon.0) 7385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:44 smithi044 bash[22676]: cluster 2024-09-21T01:36:42.975003+0000 mgr.a (mgr.14388) 8751 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:44 smithi179 bash[23186]: cluster 2024-09-21T01:36:42.975003+0000 mgr.a (mgr.14388) 8751 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:44 smithi049 bash[23528]: cluster 2024-09-21T01:36:42.975003+0000 mgr.a (mgr.14388) 8751 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:36:46.500 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:46.501 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:46.501 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:46 smithi044 bash[22676]: cluster 2024-09-21T01:36:44.977287+0000 mgr.a (mgr.14388) 8752 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:46 smithi179 bash[23186]: cluster 2024-09-21T01:36:44.977287+0000 mgr.a (mgr.14388) 8752 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:46 smithi049 bash[23528]: cluster 2024-09-21T01:36:44.977287+0000 mgr.a (mgr.14388) 8752 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:47.257 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:47.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:47.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:47.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:47.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:48 smithi044 bash[22676]: audit 2024-09-21T01:36:46.833234+0000 mgr.a (mgr.14388) 8753 : audit [DBG] from='client.195459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:48 smithi044 bash[22676]: cluster 2024-09-21T01:36:46.977866+0000 mgr.a (mgr.14388) 8754 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:48 smithi179 bash[23186]: audit 2024-09-21T01:36:46.833234+0000 mgr.a (mgr.14388) 8753 : audit [DBG] from='client.195459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:48 smithi179 bash[23186]: cluster 2024-09-21T01:36:46.977866+0000 mgr.a (mgr.14388) 8754 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:48 smithi049 bash[23528]: audit 2024-09-21T01:36:46.833234+0000 mgr.a (mgr.14388) 8753 : audit [DBG] from='client.195459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:48 smithi049 bash[23528]: cluster 2024-09-21T01:36:46.977866+0000 mgr.a (mgr.14388) 8754 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:50 smithi044 bash[22676]: cluster 2024-09-21T01:36:48.978733+0000 mgr.a (mgr.14388) 8755 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:50 smithi179 bash[23186]: cluster 2024-09-21T01:36:48.978733+0000 mgr.a (mgr.14388) 8755 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:50 smithi049 bash[23528]: cluster 2024-09-21T01:36:48.978733+0000 mgr.a (mgr.14388) 8755 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:52.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:52.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:52.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:52.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:52 smithi179 bash[23186]: cluster 2024-09-21T01:36:50.980980+0000 mgr.a (mgr.14388) 8756 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:52 smithi044 bash[22676]: cluster 2024-09-21T01:36:50.980980+0000 mgr.a (mgr.14388) 8756 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:52.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:52 smithi049 bash[23528]: cluster 2024-09-21T01:36:50.980980+0000 mgr.a (mgr.14388) 8756 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:53.028 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:53.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:53.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:53.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:53.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:53 smithi179 bash[23186]: audit 2024-09-21T01:36:52.593451+0000 mgr.a (mgr.14388) 8757 : audit [DBG] from='client.195534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:53 smithi049 bash[23528]: audit 2024-09-21T01:36:52.593451+0000 mgr.a (mgr.14388) 8757 : audit [DBG] from='client.195534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:53 smithi044 bash[22676]: audit 2024-09-21T01:36:52.593451+0000 mgr.a (mgr.14388) 8757 : audit [DBG] from='client.195534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:54 smithi179 bash[23186]: cluster 2024-09-21T01:36:52.981574+0000 mgr.a (mgr.14388) 8758 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:54 smithi049 bash[23528]: cluster 2024-09-21T01:36:52.981574+0000 mgr.a (mgr.14388) 8758 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:54.815 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:54 smithi044 bash[22676]: cluster 2024-09-21T01:36:52.981574+0000 mgr.a (mgr.14388) 8758 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:56.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:56 smithi049 bash[23528]: cluster 2024-09-21T01:36:54.983700+0000 mgr.a (mgr.14388) 8759 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:56.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:56 smithi049 bash[23528]: audit 2024-09-21T01:36:55.640739+0000 mon.a (mon.0) 7386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:56 smithi049 bash[23528]: audit 2024-09-21T01:36:55.649704+0000 mon.a (mon.0) 7387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:56 smithi049 bash[23528]: audit 2024-09-21T01:36:55.660310+0000 mon.a (mon.0) 7388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:56 smithi049 bash[23528]: audit 2024-09-21T01:36:55.898852+0000 mon.a (mon.0) 7389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:56 smithi049 bash[23528]: audit 2024-09-21T01:36:55.903911+0000 mon.a (mon.0) 7390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:56 smithi049 bash[23528]: audit 2024-09-21T01:36:55.908968+0000 mon.a (mon.0) 7391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:56 smithi179 bash[23186]: cluster 2024-09-21T01:36:54.983700+0000 mgr.a (mgr.14388) 8759 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:56 smithi179 bash[23186]: audit 2024-09-21T01:36:55.640739+0000 mon.a (mon.0) 7386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:56 smithi179 bash[23186]: audit 2024-09-21T01:36:55.649704+0000 mon.a (mon.0) 7387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:56 smithi179 bash[23186]: audit 2024-09-21T01:36:55.660310+0000 mon.a (mon.0) 7388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:56 smithi179 bash[23186]: audit 2024-09-21T01:36:55.898852+0000 mon.a (mon.0) 7389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:56 smithi179 bash[23186]: audit 2024-09-21T01:36:55.903911+0000 mon.a (mon.0) 7390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:56 smithi179 bash[23186]: audit 2024-09-21T01:36:55.908968+0000 mon.a (mon.0) 7391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:56 smithi044 bash[22676]: cluster 2024-09-21T01:36:54.983700+0000 mgr.a (mgr.14388) 8759 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:36:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:56 smithi044 bash[22676]: audit 2024-09-21T01:36:55.640739+0000 mon.a (mon.0) 7386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:56 smithi044 bash[22676]: audit 2024-09-21T01:36:55.649704+0000 mon.a (mon.0) 7387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:56 smithi044 bash[22676]: audit 2024-09-21T01:36:55.660310+0000 mon.a (mon.0) 7388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:56 smithi044 bash[22676]: audit 2024-09-21T01:36:55.898852+0000 mon.a (mon.0) 7389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:56 smithi044 bash[22676]: audit 2024-09-21T01:36:55.903911+0000 mon.a (mon.0) 7390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:56 smithi044 bash[22676]: audit 2024-09-21T01:36:55.908968+0000 mon.a (mon.0) 7391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:36:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:36:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:36:58.032 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:36:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:58 smithi044 bash[22676]: cluster 2024-09-21T01:36:56.984485+0000 mgr.a (mgr.14388) 8760 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:58 smithi179 bash[23186]: cluster 2024-09-21T01:36:56.984485+0000 mgr.a (mgr.14388) 8760 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:58.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:36:58.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:36:58.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:36:58.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:36:58.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:36:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:58 smithi049 bash[23528]: cluster 2024-09-21T01:36:56.984485+0000 mgr.a (mgr.14388) 8760 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:36:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:36:59 smithi049 bash[23528]: audit 2024-09-21T01:36:58.375833+0000 mgr.a (mgr.14388) 8761 : audit [DBG] from='client.195609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:59.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:36:59 smithi044 bash[22676]: audit 2024-09-21T01:36:58.375833+0000 mgr.a (mgr.14388) 8761 : audit [DBG] from='client.195609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:36:59 smithi179 bash[23186]: audit 2024-09-21T01:36:58.375833+0000 mgr.a (mgr.14388) 8761 : audit [DBG] from='client.195609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:00 smithi049 bash[23528]: cluster 2024-09-21T01:36:58.985498+0000 mgr.a (mgr.14388) 8762 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:00 smithi044 bash[22676]: cluster 2024-09-21T01:36:58.985498+0000 mgr.a (mgr.14388) 8762 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:00 smithi179 bash[23186]: cluster 2024-09-21T01:36:58.985498+0000 mgr.a (mgr.14388) 8762 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:02 smithi049 bash[23528]: cluster 2024-09-21T01:37:00.987848+0000 mgr.a (mgr.14388) 8763 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:02 smithi049 bash[23528]: audit 2024-09-21T01:37:02.307759+0000 mon.a (mon.0) 7392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:02 smithi049 bash[23528]: audit 2024-09-21T01:37:02.318284+0000 mon.a (mon.0) 7393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:02 smithi049 bash[23528]: audit 2024-09-21T01:37:02.330735+0000 mon.a (mon.0) 7394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:02 smithi044 bash[22676]: cluster 2024-09-21T01:37:00.987848+0000 mgr.a (mgr.14388) 8763 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:02 smithi044 bash[22676]: audit 2024-09-21T01:37:02.307759+0000 mon.a (mon.0) 7392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:02 smithi044 bash[22676]: audit 2024-09-21T01:37:02.318284+0000 mon.a (mon.0) 7393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:02 smithi044 bash[22676]: audit 2024-09-21T01:37:02.330735+0000 mon.a (mon.0) 7394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:02 smithi179 bash[23186]: cluster 2024-09-21T01:37:00.987848+0000 mgr.a (mgr.14388) 8763 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:02 smithi179 bash[23186]: audit 2024-09-21T01:37:02.307759+0000 mon.a (mon.0) 7392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:02 smithi179 bash[23186]: audit 2024-09-21T01:37:02.318284+0000 mon.a (mon.0) 7393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:02 smithi179 bash[23186]: audit 2024-09-21T01:37:02.330735+0000 mon.a (mon.0) 7394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:03.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:03.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:03.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:04.595 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:04.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:04.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:04.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:04.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:04 smithi049 bash[23528]: cluster 2024-09-21T01:37:02.988559+0000 mgr.a (mgr.14388) 8764 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:04 smithi044 bash[22676]: cluster 2024-09-21T01:37:02.988559+0000 mgr.a (mgr.14388) 8764 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:04 smithi179 bash[23186]: cluster 2024-09-21T01:37:02.988559+0000 mgr.a (mgr.14388) 8764 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:05 smithi049 bash[23528]: audit 2024-09-21T01:37:04.139918+0000 mgr.a (mgr.14388) 8765 : audit [DBG] from='client.195687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:05 smithi044 bash[22676]: audit 2024-09-21T01:37:04.139918+0000 mgr.a (mgr.14388) 8765 : audit [DBG] from='client.195687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:05 smithi179 bash[23186]: audit 2024-09-21T01:37:04.139918+0000 mgr.a (mgr.14388) 8765 : audit [DBG] from='client.195687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:06 smithi049 bash[23528]: cluster 2024-09-21T01:37:04.990990+0000 mgr.a (mgr.14388) 8766 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:06 smithi044 bash[22676]: cluster 2024-09-21T01:37:04.990990+0000 mgr.a (mgr.14388) 8766 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:06 smithi179 bash[23186]: cluster 2024-09-21T01:37:04.990990+0000 mgr.a (mgr.14388) 8766 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:08 smithi049 bash[23528]: cluster 2024-09-21T01:37:06.991804+0000 mgr.a (mgr.14388) 8767 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:08 smithi044 bash[22676]: cluster 2024-09-21T01:37:06.991804+0000 mgr.a (mgr.14388) 8767 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:08 smithi179 bash[23186]: cluster 2024-09-21T01:37:06.991804+0000 mgr.a (mgr.14388) 8767 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:09.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:09.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:09.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:09.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22930]: debug 2024-09-21T01:37:09.371+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:37:09.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22930]: debug 2024-09-21T01:37:09.371+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:37:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22676]: audit 2024-09-21T01:37:08.580228+0000 mon.a (mon.0) 7395 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:37:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22676]: audit 2024-09-21T01:37:08.586964+0000 mon.a (mon.0) 7396 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:37:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22676]: audit 2024-09-21T01:37:08.588930+0000 mon.a (mon.0) 7397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:37:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22676]: audit 2024-09-21T01:37:08.599614+0000 mon.a (mon.0) 7398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22676]: audit 2024-09-21T01:37:08.605626+0000 mon.a (mon.0) 7399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:37:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:09 smithi044 bash[22676]: audit 2024-09-21T01:37:08.607968+0000 mgr.a (mgr.14388) 8768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:37:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:09 smithi049 bash[23528]: audit 2024-09-21T01:37:08.580228+0000 mon.a (mon.0) 7395 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:37:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:09 smithi049 bash[23528]: audit 2024-09-21T01:37:08.586964+0000 mon.a (mon.0) 7396 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:37:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:09 smithi049 bash[23528]: audit 2024-09-21T01:37:08.588930+0000 mon.a (mon.0) 7397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:37:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:09 smithi049 bash[23528]: audit 2024-09-21T01:37:08.599614+0000 mon.a (mon.0) 7398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:09 smithi049 bash[23528]: audit 2024-09-21T01:37:08.605626+0000 mon.a (mon.0) 7399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:37:09.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:09 smithi049 bash[23528]: audit 2024-09-21T01:37:08.607968+0000 mgr.a (mgr.14388) 8768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:37:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:09 smithi179 bash[23186]: audit 2024-09-21T01:37:08.580228+0000 mon.a (mon.0) 7395 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:37:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:09 smithi179 bash[23186]: audit 2024-09-21T01:37:08.586964+0000 mon.a (mon.0) 7396 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:37:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:09 smithi179 bash[23186]: audit 2024-09-21T01:37:08.588930+0000 mon.a (mon.0) 7397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:37:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:09 smithi179 bash[23186]: audit 2024-09-21T01:37:08.599614+0000 mon.a (mon.0) 7398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:09 smithi179 bash[23186]: audit 2024-09-21T01:37:08.605626+0000 mon.a (mon.0) 7399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:37:10.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:09 smithi179 bash[23186]: audit 2024-09-21T01:37:08.607968+0000 mgr.a (mgr.14388) 8768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:37:10.374 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:10.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:10 smithi044 bash[22676]: cluster 2024-09-21T01:37:08.992372+0000 mgr.a (mgr.14388) 8769 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:10 smithi044 bash[22676]: audit 2024-09-21T01:37:09.375296+0000 mgr.a (mgr.14388) 8770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:37:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:10 smithi044 bash[22676]: cephadm 2024-09-21T01:37:09.376532+0000 mgr.a (mgr.14388) 8771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:37:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:10 smithi179 bash[23186]: cluster 2024-09-21T01:37:08.992372+0000 mgr.a (mgr.14388) 8769 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:10 smithi179 bash[23186]: audit 2024-09-21T01:37:09.375296+0000 mgr.a (mgr.14388) 8770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:37:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:10 smithi179 bash[23186]: cephadm 2024-09-21T01:37:09.376532+0000 mgr.a (mgr.14388) 8771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:37:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:10 smithi049 bash[23528]: cluster 2024-09-21T01:37:08.992372+0000 mgr.a (mgr.14388) 8769 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:10 smithi049 bash[23528]: audit 2024-09-21T01:37:09.375296+0000 mgr.a (mgr.14388) 8770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:37:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:10 smithi049 bash[23528]: cephadm 2024-09-21T01:37:09.376532+0000 mgr.a (mgr.14388) 8771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:37:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:11 smithi044 bash[22676]: audit 2024-09-21T01:37:09.934736+0000 mgr.a (mgr.14388) 8772 : audit [DBG] from='client.195870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:11 smithi179 bash[23186]: audit 2024-09-21T01:37:09.934736+0000 mgr.a (mgr.14388) 8772 : audit [DBG] from='client.195870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:11 smithi049 bash[23528]: audit 2024-09-21T01:37:09.934736+0000 mgr.a (mgr.14388) 8772 : audit [DBG] from='client.195870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:12.932 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:12 smithi179 bash[23186]: cluster 2024-09-21T01:37:10.995083+0000 mgr.a (mgr.14388) 8773 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:12 smithi044 bash[22676]: cluster 2024-09-21T01:37:10.995083+0000 mgr.a (mgr.14388) 8773 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:12 smithi049 bash[23528]: cluster 2024-09-21T01:37:10.995083+0000 mgr.a (mgr.14388) 8773 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:14 smithi179 bash[23186]: cluster 2024-09-21T01:37:12.995837+0000 mgr.a (mgr.14388) 8774 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:14 smithi044 bash[22676]: cluster 2024-09-21T01:37:12.995837+0000 mgr.a (mgr.14388) 8774 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:14 smithi049 bash[23528]: cluster 2024-09-21T01:37:12.995837+0000 mgr.a (mgr.14388) 8774 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:15.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:15.376 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:16.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:16.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:16 smithi044 bash[22676]: cluster 2024-09-21T01:37:14.997777+0000 mgr.a (mgr.14388) 8775 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:16 smithi044 bash[22676]: audit 2024-09-21T01:37:15.852484+0000 mon.a (mon.0) 7400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:16 smithi044 bash[22676]: audit 2024-09-21T01:37:15.858898+0000 mon.a (mon.0) 7401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:16 smithi044 bash[22676]: audit 2024-09-21T01:37:15.864300+0000 mon.a (mon.0) 7402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:16 smithi044 bash[22676]: audit 2024-09-21T01:37:16.042019+0000 mon.a (mon.0) 7403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:16 smithi044 bash[22676]: audit 2024-09-21T01:37:16.046921+0000 mon.a (mon.0) 7404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:16 smithi044 bash[22676]: audit 2024-09-21T01:37:16.052327+0000 mon.a (mon.0) 7405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:16 smithi179 bash[23186]: cluster 2024-09-21T01:37:14.997777+0000 mgr.a (mgr.14388) 8775 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:16 smithi179 bash[23186]: audit 2024-09-21T01:37:15.852484+0000 mon.a (mon.0) 7400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:16 smithi179 bash[23186]: audit 2024-09-21T01:37:15.858898+0000 mon.a (mon.0) 7401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:16 smithi179 bash[23186]: audit 2024-09-21T01:37:15.864300+0000 mon.a (mon.0) 7402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:16 smithi179 bash[23186]: audit 2024-09-21T01:37:16.042019+0000 mon.a (mon.0) 7403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:16 smithi179 bash[23186]: audit 2024-09-21T01:37:16.046921+0000 mon.a (mon.0) 7404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:16 smithi179 bash[23186]: audit 2024-09-21T01:37:16.052327+0000 mon.a (mon.0) 7405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:16 smithi049 bash[23528]: cluster 2024-09-21T01:37:14.997777+0000 mgr.a (mgr.14388) 8775 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:16 smithi049 bash[23528]: audit 2024-09-21T01:37:15.852484+0000 mon.a (mon.0) 7400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:16 smithi049 bash[23528]: audit 2024-09-21T01:37:15.858898+0000 mon.a (mon.0) 7401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:16 smithi049 bash[23528]: audit 2024-09-21T01:37:15.864300+0000 mon.a (mon.0) 7402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:16 smithi049 bash[23528]: audit 2024-09-21T01:37:16.042019+0000 mon.a (mon.0) 7403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:16 smithi049 bash[23528]: audit 2024-09-21T01:37:16.046921+0000 mon.a (mon.0) 7404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:16 smithi049 bash[23528]: audit 2024-09-21T01:37:16.052327+0000 mon.a (mon.0) 7405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:17.980 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:17 smithi049 bash[23528]: audit 2024-09-21T01:37:15.708235+0000 mgr.a (mgr.14388) 8776 : audit [DBG] from='client.195948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:17.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:17 smithi044 bash[22676]: audit 2024-09-21T01:37:15.708235+0000 mgr.a (mgr.14388) 8776 : audit [DBG] from='client.195948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:17 smithi179 bash[23186]: audit 2024-09-21T01:37:15.708235+0000 mgr.a (mgr.14388) 8776 : audit [DBG] from='client.195948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:18 smithi044 bash[22676]: cluster 2024-09-21T01:37:16.998645+0000 mgr.a (mgr.14388) 8777 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:18 smithi179 bash[23186]: cluster 2024-09-21T01:37:16.998645+0000 mgr.a (mgr.14388) 8777 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:18 smithi049 bash[23528]: cluster 2024-09-21T01:37:16.998645+0000 mgr.a (mgr.14388) 8777 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:19 smithi044 bash[22676]: cluster 2024-09-21T01:37:18.999409+0000 mgr.a (mgr.14388) 8778 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:19 smithi179 bash[23186]: cluster 2024-09-21T01:37:18.999409+0000 mgr.a (mgr.14388) 8778 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:19 smithi049 bash[23528]: cluster 2024-09-21T01:37:18.999409+0000 mgr.a (mgr.14388) 8778 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:37:21.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:21.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:21.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:21.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:21.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:21.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:21.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:21.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:22 smithi044 bash[22676]: cluster 2024-09-21T01:37:21.001590+0000 mgr.a (mgr.14388) 8779 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:22 smithi044 bash[22676]: audit 2024-09-21T01:37:21.472138+0000 mgr.a (mgr.14388) 8780 : audit [DBG] from='client.196023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:22 smithi179 bash[23186]: cluster 2024-09-21T01:37:21.001590+0000 mgr.a (mgr.14388) 8779 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:22 smithi179 bash[23186]: audit 2024-09-21T01:37:21.472138+0000 mgr.a (mgr.14388) 8780 : audit [DBG] from='client.196023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:22 smithi049 bash[23528]: cluster 2024-09-21T01:37:21.001590+0000 mgr.a (mgr.14388) 8779 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:37:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:22 smithi049 bash[23528]: audit 2024-09-21T01:37:21.472138+0000 mgr.a (mgr.14388) 8780 : audit [DBG] from='client.196023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:23 smithi049 bash[23528]: audit 2024-09-21T01:37:22.550145+0000 mon.a (mon.0) 7406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:23 smithi049 bash[23528]: audit 2024-09-21T01:37:22.559968+0000 mon.a (mon.0) 7407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:23 smithi049 bash[23528]: audit 2024-09-21T01:37:22.571973+0000 mon.a (mon.0) 7408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:23 smithi044 bash[22676]: audit 2024-09-21T01:37:22.550145+0000 mon.a (mon.0) 7406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:23 smithi044 bash[22676]: audit 2024-09-21T01:37:22.559968+0000 mon.a (mon.0) 7407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:23 smithi044 bash[22676]: audit 2024-09-21T01:37:22.571973+0000 mon.a (mon.0) 7408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:23 smithi179 bash[23186]: audit 2024-09-21T01:37:22.550145+0000 mon.a (mon.0) 7406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:23 smithi179 bash[23186]: audit 2024-09-21T01:37:22.559968+0000 mon.a (mon.0) 7407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:23 smithi179 bash[23186]: audit 2024-09-21T01:37:22.571973+0000 mon.a (mon.0) 7408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:24.813 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:24 smithi049 bash[23528]: cluster 2024-09-21T01:37:23.002513+0000 mgr.a (mgr.14388) 8781 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:24 smithi044 bash[22676]: cluster 2024-09-21T01:37:23.002513+0000 mgr.a (mgr.14388) 8781 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:24 smithi179 bash[23186]: cluster 2024-09-21T01:37:23.002513+0000 mgr.a (mgr.14388) 8781 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:26.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:26.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:26 smithi044 bash[22676]: cluster 2024-09-21T01:37:25.004626+0000 mgr.a (mgr.14388) 8782 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:26 smithi179 bash[23186]: cluster 2024-09-21T01:37:25.004626+0000 mgr.a (mgr.14388) 8782 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:26 smithi049 bash[23528]: cluster 2024-09-21T01:37:25.004626+0000 mgr.a (mgr.14388) 8782 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:27.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:27.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:27.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:27.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:28 smithi044 bash[22676]: cluster 2024-09-21T01:37:27.005082+0000 mgr.a (mgr.14388) 8783 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:28 smithi044 bash[22676]: audit 2024-09-21T01:37:27.248713+0000 mgr.a (mgr.14388) 8784 : audit [DBG] from='client.196101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:28 smithi179 bash[23186]: cluster 2024-09-21T01:37:27.005082+0000 mgr.a (mgr.14388) 8783 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:28 smithi179 bash[23186]: audit 2024-09-21T01:37:27.248713+0000 mgr.a (mgr.14388) 8784 : audit [DBG] from='client.196101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:28 smithi049 bash[23528]: cluster 2024-09-21T01:37:27.005082+0000 mgr.a (mgr.14388) 8783 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:28 smithi049 bash[23528]: audit 2024-09-21T01:37:27.248713+0000 mgr.a (mgr.14388) 8784 : audit [DBG] from='client.196101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:30 smithi044 bash[22676]: cluster 2024-09-21T01:37:29.005968+0000 mgr.a (mgr.14388) 8785 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:30 smithi179 bash[23186]: cluster 2024-09-21T01:37:29.005968+0000 mgr.a (mgr.14388) 8785 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:30 smithi049 bash[23528]: cluster 2024-09-21T01:37:29.005968+0000 mgr.a (mgr.14388) 8785 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:32.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:32.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:32.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:32.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:32 smithi179 bash[23186]: cluster 2024-09-21T01:37:31.008146+0000 mgr.a (mgr.14388) 8786 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:32 smithi044 bash[22676]: cluster 2024-09-21T01:37:31.008146+0000 mgr.a (mgr.14388) 8786 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:32 smithi049 bash[23528]: cluster 2024-09-21T01:37:31.008146+0000 mgr.a (mgr.14388) 8786 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:33.458 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:33.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:33.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:33.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:33.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:34 smithi044 bash[22676]: cluster 2024-09-21T01:37:33.008996+0000 mgr.a (mgr.14388) 8787 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:34 smithi044 bash[22676]: audit 2024-09-21T01:37:33.015950+0000 mgr.a (mgr.14388) 8788 : audit [DBG] from='client.196179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:34 smithi179 bash[23186]: cluster 2024-09-21T01:37:33.008996+0000 mgr.a (mgr.14388) 8787 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:34 smithi179 bash[23186]: audit 2024-09-21T01:37:33.015950+0000 mgr.a (mgr.14388) 8788 : audit [DBG] from='client.196179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:34 smithi049 bash[23528]: cluster 2024-09-21T01:37:33.008996+0000 mgr.a (mgr.14388) 8787 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:34 smithi049 bash[23528]: audit 2024-09-21T01:37:33.015950+0000 mgr.a (mgr.14388) 8788 : audit [DBG] from='client.196179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:36 smithi049 bash[23528]: cluster 2024-09-21T01:37:35.011337+0000 mgr.a (mgr.14388) 8789 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:36 smithi049 bash[23528]: audit 2024-09-21T01:37:36.051282+0000 mon.a (mon.0) 7409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:36 smithi049 bash[23528]: audit 2024-09-21T01:37:36.057196+0000 mon.a (mon.0) 7410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:36 smithi049 bash[23528]: audit 2024-09-21T01:37:36.063545+0000 mon.a (mon.0) 7411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:36 smithi049 bash[23528]: audit 2024-09-21T01:37:36.181734+0000 mon.a (mon.0) 7412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:36 smithi049 bash[23528]: audit 2024-09-21T01:37:36.186180+0000 mon.a (mon.0) 7413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:36 smithi049 bash[23528]: audit 2024-09-21T01:37:36.191226+0000 mon.a (mon.0) 7414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:36 smithi044 bash[22676]: cluster 2024-09-21T01:37:35.011337+0000 mgr.a (mgr.14388) 8789 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:36.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:36 smithi044 bash[22676]: audit 2024-09-21T01:37:36.051282+0000 mon.a (mon.0) 7409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:36 smithi044 bash[22676]: audit 2024-09-21T01:37:36.057196+0000 mon.a (mon.0) 7410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:36 smithi044 bash[22676]: audit 2024-09-21T01:37:36.063545+0000 mon.a (mon.0) 7411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:36 smithi044 bash[22676]: audit 2024-09-21T01:37:36.181734+0000 mon.a (mon.0) 7412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:36 smithi044 bash[22676]: audit 2024-09-21T01:37:36.186180+0000 mon.a (mon.0) 7413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:36.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:36 smithi044 bash[22676]: audit 2024-09-21T01:37:36.191226+0000 mon.a (mon.0) 7414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:36 smithi179 bash[23186]: cluster 2024-09-21T01:37:35.011337+0000 mgr.a (mgr.14388) 8789 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:36 smithi179 bash[23186]: audit 2024-09-21T01:37:36.051282+0000 mon.a (mon.0) 7409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:36 smithi179 bash[23186]: audit 2024-09-21T01:37:36.057196+0000 mon.a (mon.0) 7410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:36 smithi179 bash[23186]: audit 2024-09-21T01:37:36.063545+0000 mon.a (mon.0) 7411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:36 smithi179 bash[23186]: audit 2024-09-21T01:37:36.181734+0000 mon.a (mon.0) 7412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:36 smithi179 bash[23186]: audit 2024-09-21T01:37:36.186180+0000 mon.a (mon.0) 7413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:36 smithi179 bash[23186]: audit 2024-09-21T01:37:36.191226+0000 mon.a (mon.0) 7414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:38.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:38.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:38.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:38.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:38 smithi044 bash[22676]: cluster 2024-09-21T01:37:37.012084+0000 mgr.a (mgr.14388) 8790 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:38 smithi179 bash[23186]: cluster 2024-09-21T01:37:37.012084+0000 mgr.a (mgr.14388) 8790 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:38 smithi049 bash[23528]: cluster 2024-09-21T01:37:37.012084+0000 mgr.a (mgr.14388) 8790 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:39.252 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:40 smithi044 bash[22676]: audit 2024-09-21T01:37:38.798664+0000 mgr.a (mgr.14388) 8791 : audit [DBG] from='client.196254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:40 smithi044 bash[22676]: cluster 2024-09-21T01:37:39.013044+0000 mgr.a (mgr.14388) 8792 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:40 smithi179 bash[23186]: audit 2024-09-21T01:37:38.798664+0000 mgr.a (mgr.14388) 8791 : audit [DBG] from='client.196254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:40 smithi179 bash[23186]: cluster 2024-09-21T01:37:39.013044+0000 mgr.a (mgr.14388) 8792 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:40 smithi049 bash[23528]: audit 2024-09-21T01:37:38.798664+0000 mgr.a (mgr.14388) 8791 : audit [DBG] from='client.196254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:40 smithi049 bash[23528]: cluster 2024-09-21T01:37:39.013044+0000 mgr.a (mgr.14388) 8792 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:42 smithi044 bash[22676]: cluster 2024-09-21T01:37:41.015459+0000 mgr.a (mgr.14388) 8793 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:42 smithi179 bash[23186]: cluster 2024-09-21T01:37:41.015459+0000 mgr.a (mgr.14388) 8793 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:42 smithi049 bash[23528]: cluster 2024-09-21T01:37:41.015459+0000 mgr.a (mgr.14388) 8793 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:37:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:43 smithi049 bash[23528]: audit 2024-09-21T01:37:42.765199+0000 mon.a (mon.0) 7415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:43 smithi049 bash[23528]: audit 2024-09-21T01:37:42.773551+0000 mon.a (mon.0) 7416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:43 smithi049 bash[23528]: audit 2024-09-21T01:37:42.785480+0000 mon.a (mon.0) 7417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:43 smithi049 bash[23528]: cluster 2024-09-21T01:37:43.016251+0000 mgr.a (mgr.14388) 8794 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:43 smithi044 bash[22676]: audit 2024-09-21T01:37:42.765199+0000 mon.a (mon.0) 7415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:43 smithi044 bash[22676]: audit 2024-09-21T01:37:42.773551+0000 mon.a (mon.0) 7416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:43 smithi044 bash[22676]: audit 2024-09-21T01:37:42.785480+0000 mon.a (mon.0) 7417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:43 smithi044 bash[22676]: cluster 2024-09-21T01:37:43.016251+0000 mgr.a (mgr.14388) 8794 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:43 smithi179 bash[23186]: audit 2024-09-21T01:37:42.765199+0000 mon.a (mon.0) 7415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:43 smithi179 bash[23186]: audit 2024-09-21T01:37:42.773551+0000 mon.a (mon.0) 7416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:43 smithi179 bash[23186]: audit 2024-09-21T01:37:42.785480+0000 mon.a (mon.0) 7417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:43 smithi179 bash[23186]: cluster 2024-09-21T01:37:43.016251+0000 mgr.a (mgr.14388) 8794 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:45.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:44 smithi049 bash[23528]: audit 2024-09-21T01:37:44.586540+0000 mgr.a (mgr.14388) 8795 : audit [DBG] from='client.196326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:44 smithi044 bash[22676]: audit 2024-09-21T01:37:44.586540+0000 mgr.a (mgr.14388) 8795 : audit [DBG] from='client.196326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:44 smithi179 bash[23186]: audit 2024-09-21T01:37:44.586540+0000 mgr.a (mgr.14388) 8795 : audit [DBG] from='client.196326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:45 smithi049 bash[23528]: cluster 2024-09-21T01:37:45.017504+0000 mgr.a (mgr.14388) 8796 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:37:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:45 smithi044 bash[22676]: cluster 2024-09-21T01:37:45.017504+0000 mgr.a (mgr.14388) 8796 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:37:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:45 smithi179 bash[23186]: cluster 2024-09-21T01:37:45.017504+0000 mgr.a (mgr.14388) 8796 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:37:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:48 smithi044 bash[22676]: cluster 2024-09-21T01:37:47.018246+0000 mgr.a (mgr.14388) 8797 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:37:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:48 smithi179 bash[23186]: cluster 2024-09-21T01:37:47.018246+0000 mgr.a (mgr.14388) 8797 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:37:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:48 smithi049 bash[23528]: cluster 2024-09-21T01:37:47.018246+0000 mgr.a (mgr.14388) 8797 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:37:50.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:50.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:50.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:50 smithi179 bash[23186]: cluster 2024-09-21T01:37:49.019050+0000 mgr.a (mgr.14388) 8798 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:37:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:50 smithi044 bash[22676]: cluster 2024-09-21T01:37:49.019050+0000 mgr.a (mgr.14388) 8798 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:37:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:50 smithi049 bash[23528]: cluster 2024-09-21T01:37:49.019050+0000 mgr.a (mgr.14388) 8798 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:37:50.783 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:50.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:50.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:50.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:50.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:51 smithi044 bash[22676]: audit 2024-09-21T01:37:50.357665+0000 mgr.a (mgr.14388) 8799 : audit [DBG] from='client.196398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:51 smithi179 bash[23186]: audit 2024-09-21T01:37:50.357665+0000 mgr.a (mgr.14388) 8799 : audit [DBG] from='client.196398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:51 smithi049 bash[23528]: audit 2024-09-21T01:37:50.357665+0000 mgr.a (mgr.14388) 8799 : audit [DBG] from='client.196398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:52 smithi044 bash[22676]: cluster 2024-09-21T01:37:51.021880+0000 mgr.a (mgr.14388) 8800 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:52 smithi179 bash[23186]: cluster 2024-09-21T01:37:51.021880+0000 mgr.a (mgr.14388) 8800 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:52 smithi049 bash[23528]: cluster 2024-09-21T01:37:51.021880+0000 mgr.a (mgr.14388) 8800 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:54 smithi179 bash[23186]: cluster 2024-09-21T01:37:53.022706+0000 mgr.a (mgr.14388) 8801 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:37:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:54 smithi044 bash[22676]: cluster 2024-09-21T01:37:53.022706+0000 mgr.a (mgr.14388) 8801 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:37:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:54 smithi049 bash[23528]: cluster 2024-09-21T01:37:53.022706+0000 mgr.a (mgr.14388) 8801 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:37:55.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:37:55.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:37:55.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:37:56.349 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:56 smithi044 bash[22676]: cluster 2024-09-21T01:37:55.024587+0000 mgr.a (mgr.14388) 8802 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:56 smithi179 bash[23186]: cluster 2024-09-21T01:37:55.024587+0000 mgr.a (mgr.14388) 8802 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:56 smithi049 bash[23528]: cluster 2024-09-21T01:37:55.024587+0000 mgr.a (mgr.14388) 8802 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:37:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:37:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:37:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:37:56.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:37:56.583 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:57 smithi044 bash[22676]: audit 2024-09-21T01:37:56.123195+0000 mgr.a (mgr.14388) 8803 : audit [DBG] from='client.196473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:57 smithi044 bash[22676]: audit 2024-09-21T01:37:56.248655+0000 mon.a (mon.0) 7418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:57 smithi044 bash[22676]: audit 2024-09-21T01:37:56.253631+0000 mon.a (mon.0) 7419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:57 smithi044 bash[22676]: audit 2024-09-21T01:37:56.258830+0000 mon.a (mon.0) 7420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:57 smithi044 bash[22676]: audit 2024-09-21T01:37:56.337459+0000 mon.a (mon.0) 7421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:57 smithi044 bash[22676]: audit 2024-09-21T01:37:56.342537+0000 mon.a (mon.0) 7422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:57 smithi044 bash[22676]: audit 2024-09-21T01:37:56.349449+0000 mon.a (mon.0) 7423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:57 smithi179 bash[23186]: audit 2024-09-21T01:37:56.123195+0000 mgr.a (mgr.14388) 8803 : audit [DBG] from='client.196473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:57 smithi179 bash[23186]: audit 2024-09-21T01:37:56.248655+0000 mon.a (mon.0) 7418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:57 smithi179 bash[23186]: audit 2024-09-21T01:37:56.253631+0000 mon.a (mon.0) 7419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:57 smithi179 bash[23186]: audit 2024-09-21T01:37:56.258830+0000 mon.a (mon.0) 7420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:57 smithi179 bash[23186]: audit 2024-09-21T01:37:56.337459+0000 mon.a (mon.0) 7421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:57 smithi179 bash[23186]: audit 2024-09-21T01:37:56.342537+0000 mon.a (mon.0) 7422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:57 smithi179 bash[23186]: audit 2024-09-21T01:37:56.349449+0000 mon.a (mon.0) 7423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:57 smithi049 bash[23528]: audit 2024-09-21T01:37:56.123195+0000 mgr.a (mgr.14388) 8803 : audit [DBG] from='client.196473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:57 smithi049 bash[23528]: audit 2024-09-21T01:37:56.248655+0000 mon.a (mon.0) 7418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:57 smithi049 bash[23528]: audit 2024-09-21T01:37:56.253631+0000 mon.a (mon.0) 7419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:57 smithi049 bash[23528]: audit 2024-09-21T01:37:56.258830+0000 mon.a (mon.0) 7420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:57 smithi049 bash[23528]: audit 2024-09-21T01:37:56.337459+0000 mon.a (mon.0) 7421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:57 smithi049 bash[23528]: audit 2024-09-21T01:37:56.342537+0000 mon.a (mon.0) 7422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:57 smithi049 bash[23528]: audit 2024-09-21T01:37:56.349449+0000 mon.a (mon.0) 7423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:37:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:37:58 smithi044 bash[22676]: cluster 2024-09-21T01:37:57.025513+0000 mgr.a (mgr.14388) 8804 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:37:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:37:58 smithi179 bash[23186]: cluster 2024-09-21T01:37:57.025513+0000 mgr.a (mgr.14388) 8804 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:37:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:37:58 smithi049 bash[23528]: cluster 2024-09-21T01:37:57.025513+0000 mgr.a (mgr.14388) 8804 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:38:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:00 smithi044 bash[22676]: cluster 2024-09-21T01:37:59.026296+0000 mgr.a (mgr.14388) 8805 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:38:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:00 smithi179 bash[23186]: cluster 2024-09-21T01:37:59.026296+0000 mgr.a (mgr.14388) 8805 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:38:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:00 smithi049 bash[23528]: cluster 2024-09-21T01:37:59.026296+0000 mgr.a (mgr.14388) 8805 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:38:01.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:01.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:01.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:02.338 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:02.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:02.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:02.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:02.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:02 smithi044 bash[22676]: cluster 2024-09-21T01:38:01.028626+0000 mgr.a (mgr.14388) 8806 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:38:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:02 smithi179 bash[23186]: cluster 2024-09-21T01:38:01.028626+0000 mgr.a (mgr.14388) 8806 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:38:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:02 smithi049 bash[23528]: cluster 2024-09-21T01:38:01.028626+0000 mgr.a (mgr.14388) 8806 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:38:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:03 smithi044 bash[22676]: audit 2024-09-21T01:38:01.912400+0000 mgr.a (mgr.14388) 8807 : audit [DBG] from='client.196548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:03 smithi044 bash[22676]: audit 2024-09-21T01:38:03.001422+0000 mon.a (mon.0) 7424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:03 smithi044 bash[22676]: audit 2024-09-21T01:38:03.009907+0000 mon.a (mon.0) 7425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:03 smithi044 bash[22676]: audit 2024-09-21T01:38:03.020301+0000 mon.a (mon.0) 7426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:03 smithi179 bash[23186]: audit 2024-09-21T01:38:01.912400+0000 mgr.a (mgr.14388) 8807 : audit [DBG] from='client.196548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:03 smithi179 bash[23186]: audit 2024-09-21T01:38:03.001422+0000 mon.a (mon.0) 7424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:03 smithi179 bash[23186]: audit 2024-09-21T01:38:03.009907+0000 mon.a (mon.0) 7425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:03 smithi179 bash[23186]: audit 2024-09-21T01:38:03.020301+0000 mon.a (mon.0) 7426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:03 smithi049 bash[23528]: audit 2024-09-21T01:38:01.912400+0000 mgr.a (mgr.14388) 8807 : audit [DBG] from='client.196548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:03 smithi049 bash[23528]: audit 2024-09-21T01:38:03.001422+0000 mon.a (mon.0) 7424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:03 smithi049 bash[23528]: audit 2024-09-21T01:38:03.009907+0000 mon.a (mon.0) 7425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:03 smithi049 bash[23528]: audit 2024-09-21T01:38:03.020301+0000 mon.a (mon.0) 7426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:04 smithi044 bash[22676]: cluster 2024-09-21T01:38:03.029635+0000 mgr.a (mgr.14388) 8808 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:04 smithi179 bash[23186]: cluster 2024-09-21T01:38:03.029635+0000 mgr.a (mgr.14388) 8808 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:04 smithi049 bash[23528]: cluster 2024-09-21T01:38:03.029635+0000 mgr.a (mgr.14388) 8808 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:06 smithi044 bash[22676]: cluster 2024-09-21T01:38:05.031905+0000 mgr.a (mgr.14388) 8809 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:06 smithi179 bash[23186]: cluster 2024-09-21T01:38:05.031905+0000 mgr.a (mgr.14388) 8809 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:06 smithi049 bash[23528]: cluster 2024-09-21T01:38:05.031905+0000 mgr.a (mgr.14388) 8809 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:07.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:08.104 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:08.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:08 smithi044 bash[22676]: cluster 2024-09-21T01:38:07.032718+0000 mgr.a (mgr.14388) 8810 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:08 smithi179 bash[23186]: cluster 2024-09-21T01:38:07.032718+0000 mgr.a (mgr.14388) 8810 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:08 smithi049 bash[23528]: cluster 2024-09-21T01:38:07.032718+0000 mgr.a (mgr.14388) 8810 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:09 smithi044 bash[22676]: audit 2024-09-21T01:38:07.676642+0000 mgr.a (mgr.14388) 8811 : audit [DBG] from='client.196623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:09 smithi179 bash[23186]: audit 2024-09-21T01:38:07.676642+0000 mgr.a (mgr.14388) 8811 : audit [DBG] from='client.196623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:09 smithi049 bash[23528]: audit 2024-09-21T01:38:07.676642+0000 mgr.a (mgr.14388) 8811 : audit [DBG] from='client.196623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:10.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22930]: debug 2024-09-21T01:38:10.234+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:38:10.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22930]: debug 2024-09-21T01:38:10.234+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:38:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22676]: cluster 2024-09-21T01:38:09.033740+0000 mgr.a (mgr.14388) 8812 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22676]: audit 2024-09-21T01:38:09.432388+0000 mon.a (mon.0) 7427 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:38:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22676]: audit 2024-09-21T01:38:09.439795+0000 mon.a (mon.0) 7428 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:38:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22676]: audit 2024-09-21T01:38:09.441702+0000 mon.a (mon.0) 7429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:38:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22676]: audit 2024-09-21T01:38:09.452496+0000 mon.a (mon.0) 7430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22676]: audit 2024-09-21T01:38:09.459003+0000 mon.a (mon.0) 7431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:38:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:10 smithi044 bash[22676]: audit 2024-09-21T01:38:09.461530+0000 mgr.a (mgr.14388) 8813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:38:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:10 smithi179 bash[23186]: cluster 2024-09-21T01:38:09.033740+0000 mgr.a (mgr.14388) 8812 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:10 smithi179 bash[23186]: audit 2024-09-21T01:38:09.432388+0000 mon.a (mon.0) 7427 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:38:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:10 smithi179 bash[23186]: audit 2024-09-21T01:38:09.439795+0000 mon.a (mon.0) 7428 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:38:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:10 smithi179 bash[23186]: audit 2024-09-21T01:38:09.441702+0000 mon.a (mon.0) 7429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:38:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:10 smithi179 bash[23186]: audit 2024-09-21T01:38:09.452496+0000 mon.a (mon.0) 7430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:10 smithi179 bash[23186]: audit 2024-09-21T01:38:09.459003+0000 mon.a (mon.0) 7431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:38:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:10 smithi179 bash[23186]: audit 2024-09-21T01:38:09.461530+0000 mgr.a (mgr.14388) 8813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:38:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:10 smithi049 bash[23528]: cluster 2024-09-21T01:38:09.033740+0000 mgr.a (mgr.14388) 8812 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:10 smithi049 bash[23528]: audit 2024-09-21T01:38:09.432388+0000 mon.a (mon.0) 7427 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:38:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:10 smithi049 bash[23528]: audit 2024-09-21T01:38:09.439795+0000 mon.a (mon.0) 7428 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:38:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:10 smithi049 bash[23528]: audit 2024-09-21T01:38:09.441702+0000 mon.a (mon.0) 7429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:38:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:10 smithi049 bash[23528]: audit 2024-09-21T01:38:09.452496+0000 mon.a (mon.0) 7430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:10 smithi049 bash[23528]: audit 2024-09-21T01:38:09.459003+0000 mon.a (mon.0) 7431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:38:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:10 smithi049 bash[23528]: audit 2024-09-21T01:38:09.461530+0000 mgr.a (mgr.14388) 8813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:38:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:11 smithi044 bash[22676]: audit 2024-09-21T01:38:10.238170+0000 mgr.a (mgr.14388) 8814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:38:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:11 smithi044 bash[22676]: cephadm 2024-09-21T01:38:10.239853+0000 mgr.a (mgr.14388) 8815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:38:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:11 smithi179 bash[23186]: audit 2024-09-21T01:38:10.238170+0000 mgr.a (mgr.14388) 8814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:38:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:11 smithi179 bash[23186]: cephadm 2024-09-21T01:38:10.239853+0000 mgr.a (mgr.14388) 8815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:38:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:11 smithi049 bash[23528]: audit 2024-09-21T01:38:10.238170+0000 mgr.a (mgr.14388) 8814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:38:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:11 smithi049 bash[23528]: cephadm 2024-09-21T01:38:10.239853+0000 mgr.a (mgr.14388) 8815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:38:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:12 smithi044 bash[22676]: cluster 2024-09-21T01:38:11.036637+0000 mgr.a (mgr.14388) 8816 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:38:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:12 smithi179 bash[23186]: cluster 2024-09-21T01:38:11.036637+0000 mgr.a (mgr.14388) 8816 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:38:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:12 smithi049 bash[23528]: cluster 2024-09-21T01:38:11.036637+0000 mgr.a (mgr.14388) 8816 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:38:13.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:13.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:13.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:13.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:13.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:13.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:13.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:13.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:14 smithi044 bash[22676]: cluster 2024-09-21T01:38:13.037437+0000 mgr.a (mgr.14388) 8817 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:38:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:14 smithi044 bash[22676]: audit 2024-09-21T01:38:13.440880+0000 mgr.a (mgr.14388) 8818 : audit [DBG] from='client.196806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:14 smithi179 bash[23186]: cluster 2024-09-21T01:38:13.037437+0000 mgr.a (mgr.14388) 8817 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:38:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:14 smithi179 bash[23186]: audit 2024-09-21T01:38:13.440880+0000 mgr.a (mgr.14388) 8818 : audit [DBG] from='client.196806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:14 smithi049 bash[23528]: cluster 2024-09-21T01:38:13.037437+0000 mgr.a (mgr.14388) 8817 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:38:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:14 smithi049 bash[23528]: audit 2024-09-21T01:38:13.440880+0000 mgr.a (mgr.14388) 8818 : audit [DBG] from='client.196806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:16 smithi044 bash[22676]: cluster 2024-09-21T01:38:15.039780+0000 mgr.a (mgr.14388) 8819 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:16 smithi179 bash[23186]: cluster 2024-09-21T01:38:15.039780+0000 mgr.a (mgr.14388) 8819 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:16 smithi049 bash[23528]: cluster 2024-09-21T01:38:15.039780+0000 mgr.a (mgr.14388) 8819 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:17 smithi044 bash[22676]: audit 2024-09-21T01:38:16.483287+0000 mon.a (mon.0) 7432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:17 smithi044 bash[22676]: audit 2024-09-21T01:38:16.490435+0000 mon.a (mon.0) 7433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:17 smithi044 bash[22676]: audit 2024-09-21T01:38:16.497710+0000 mon.a (mon.0) 7434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:17 smithi044 bash[22676]: audit 2024-09-21T01:38:16.552830+0000 mon.a (mon.0) 7435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:17 smithi044 bash[22676]: audit 2024-09-21T01:38:16.559239+0000 mon.a (mon.0) 7436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:17 smithi044 bash[22676]: audit 2024-09-21T01:38:16.568123+0000 mon.a (mon.0) 7437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:17 smithi179 bash[23186]: audit 2024-09-21T01:38:16.483287+0000 mon.a (mon.0) 7432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:17 smithi179 bash[23186]: audit 2024-09-21T01:38:16.490435+0000 mon.a (mon.0) 7433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:17 smithi179 bash[23186]: audit 2024-09-21T01:38:16.497710+0000 mon.a (mon.0) 7434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:17 smithi179 bash[23186]: audit 2024-09-21T01:38:16.552830+0000 mon.a (mon.0) 7435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:17 smithi179 bash[23186]: audit 2024-09-21T01:38:16.559239+0000 mon.a (mon.0) 7436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:17 smithi179 bash[23186]: audit 2024-09-21T01:38:16.568123+0000 mon.a (mon.0) 7437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:17 smithi049 bash[23528]: audit 2024-09-21T01:38:16.483287+0000 mon.a (mon.0) 7432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:17 smithi049 bash[23528]: audit 2024-09-21T01:38:16.490435+0000 mon.a (mon.0) 7433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:17 smithi049 bash[23528]: audit 2024-09-21T01:38:16.497710+0000 mon.a (mon.0) 7434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:17 smithi049 bash[23528]: audit 2024-09-21T01:38:16.552830+0000 mon.a (mon.0) 7435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:17 smithi049 bash[23528]: audit 2024-09-21T01:38:16.559239+0000 mon.a (mon.0) 7436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:17 smithi049 bash[23528]: audit 2024-09-21T01:38:16.568123+0000 mon.a (mon.0) 7437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:18 smithi049 bash[23528]: cluster 2024-09-21T01:38:17.040621+0000 mgr.a (mgr.14388) 8820 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:18.836 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:18 smithi044 bash[22676]: cluster 2024-09-21T01:38:17.040621+0000 mgr.a (mgr.14388) 8820 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:18.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:18.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:18 smithi179 bash[23186]: cluster 2024-09-21T01:38:17.040621+0000 mgr.a (mgr.14388) 8820 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:19.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:19.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:19.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:20 smithi044 bash[22676]: cluster 2024-09-21T01:38:19.041193+0000 mgr.a (mgr.14388) 8821 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:20 smithi044 bash[22676]: audit 2024-09-21T01:38:19.179284+0000 mgr.a (mgr.14388) 8822 : audit [DBG] from='client.196878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:20 smithi179 bash[23186]: cluster 2024-09-21T01:38:19.041193+0000 mgr.a (mgr.14388) 8821 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:20 smithi179 bash[23186]: audit 2024-09-21T01:38:19.179284+0000 mgr.a (mgr.14388) 8822 : audit [DBG] from='client.196878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:20 smithi049 bash[23528]: cluster 2024-09-21T01:38:19.041193+0000 mgr.a (mgr.14388) 8821 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:20 smithi049 bash[23528]: audit 2024-09-21T01:38:19.179284+0000 mgr.a (mgr.14388) 8822 : audit [DBG] from='client.196878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:22 smithi044 bash[22676]: cluster 2024-09-21T01:38:21.043654+0000 mgr.a (mgr.14388) 8823 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:22 smithi179 bash[23186]: cluster 2024-09-21T01:38:21.043654+0000 mgr.a (mgr.14388) 8823 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:22 smithi049 bash[23528]: cluster 2024-09-21T01:38:21.043654+0000 mgr.a (mgr.14388) 8823 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:38:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:24 smithi044 bash[22676]: cluster 2024-09-21T01:38:23.044469+0000 mgr.a (mgr.14388) 8824 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:38:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:24 smithi044 bash[22676]: audit 2024-09-21T01:38:23.236280+0000 mon.a (mon.0) 7438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:24 smithi044 bash[22676]: audit 2024-09-21T01:38:23.244871+0000 mon.a (mon.0) 7439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:24 smithi044 bash[22676]: audit 2024-09-21T01:38:23.255224+0000 mon.a (mon.0) 7440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:24 smithi179 bash[23186]: cluster 2024-09-21T01:38:23.044469+0000 mgr.a (mgr.14388) 8824 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:38:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:24 smithi179 bash[23186]: audit 2024-09-21T01:38:23.236280+0000 mon.a (mon.0) 7438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:24 smithi179 bash[23186]: audit 2024-09-21T01:38:23.244871+0000 mon.a (mon.0) 7439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:24 smithi179 bash[23186]: audit 2024-09-21T01:38:23.255224+0000 mon.a (mon.0) 7440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:24 smithi049 bash[23528]: cluster 2024-09-21T01:38:23.044469+0000 mgr.a (mgr.14388) 8824 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:38:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:24 smithi049 bash[23528]: audit 2024-09-21T01:38:23.236280+0000 mon.a (mon.0) 7438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:24 smithi049 bash[23528]: audit 2024-09-21T01:38:23.244871+0000 mon.a (mon.0) 7439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:24 smithi049 bash[23528]: audit 2024-09-21T01:38:23.255224+0000 mon.a (mon.0) 7440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:24.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:24.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:24.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:25.389 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:25.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:26 smithi179 bash[23186]: audit 2024-09-21T01:38:24.965054+0000 mgr.a (mgr.14388) 8825 : audit [DBG] from='client.196953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:26 smithi179 bash[23186]: cluster 2024-09-21T01:38:25.045651+0000 mgr.a (mgr.14388) 8826 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:38:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:26 smithi049 bash[23528]: audit 2024-09-21T01:38:24.965054+0000 mgr.a (mgr.14388) 8825 : audit [DBG] from='client.196953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:26 smithi049 bash[23528]: cluster 2024-09-21T01:38:25.045651+0000 mgr.a (mgr.14388) 8826 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:38:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:26 smithi044 bash[22676]: audit 2024-09-21T01:38:24.965054+0000 mgr.a (mgr.14388) 8825 : audit [DBG] from='client.196953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:26 smithi044 bash[22676]: cluster 2024-09-21T01:38:25.045651+0000 mgr.a (mgr.14388) 8826 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:38:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:28 smithi179 bash[23186]: cluster 2024-09-21T01:38:27.046699+0000 mgr.a (mgr.14388) 8827 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:38:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:28 smithi049 bash[23528]: cluster 2024-09-21T01:38:27.046699+0000 mgr.a (mgr.14388) 8827 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:38:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:28 smithi044 bash[22676]: cluster 2024-09-21T01:38:27.046699+0000 mgr.a (mgr.14388) 8827 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:38:30.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:30.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:30.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:30 smithi179 bash[23186]: cluster 2024-09-21T01:38:29.047707+0000 mgr.a (mgr.14388) 8828 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:38:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:30 smithi049 bash[23528]: cluster 2024-09-21T01:38:29.047707+0000 mgr.a (mgr.14388) 8828 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:38:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:30 smithi044 bash[22676]: cluster 2024-09-21T01:38:29.047707+0000 mgr.a (mgr.14388) 8828 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:38:31.148 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:32 smithi179 bash[23186]: audit 2024-09-21T01:38:30.724836+0000 mgr.a (mgr.14388) 8829 : audit [DBG] from='client.197031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:32 smithi179 bash[23186]: cluster 2024-09-21T01:38:31.050838+0000 mgr.a (mgr.14388) 8830 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:32 smithi049 bash[23528]: audit 2024-09-21T01:38:30.724836+0000 mgr.a (mgr.14388) 8829 : audit [DBG] from='client.197031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:32 smithi049 bash[23528]: cluster 2024-09-21T01:38:31.050838+0000 mgr.a (mgr.14388) 8830 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:32 smithi044 bash[22676]: audit 2024-09-21T01:38:30.724836+0000 mgr.a (mgr.14388) 8829 : audit [DBG] from='client.197031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:32 smithi044 bash[22676]: cluster 2024-09-21T01:38:31.050838+0000 mgr.a (mgr.14388) 8830 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:34 smithi049 bash[23528]: cluster 2024-09-21T01:38:33.051638+0000 mgr.a (mgr.14388) 8831 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:38:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:34 smithi044 bash[22676]: cluster 2024-09-21T01:38:33.051638+0000 mgr.a (mgr.14388) 8831 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:38:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:34 smithi179 bash[23186]: cluster 2024-09-21T01:38:33.051638+0000 mgr.a (mgr.14388) 8831 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:38:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:36 smithi044 bash[22676]: cluster 2024-09-21T01:38:35.053570+0000 mgr.a (mgr.14388) 8832 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:36 smithi179 bash[23186]: cluster 2024-09-21T01:38:35.053570+0000 mgr.a (mgr.14388) 8832 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:36.512 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:36 smithi049 bash[23528]: cluster 2024-09-21T01:38:35.053570+0000 mgr.a (mgr.14388) 8832 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:36.935 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:37 smithi044 bash[22676]: audit 2024-09-21T01:38:36.483016+0000 mgr.a (mgr.14388) 8833 : audit [DBG] from='client.197109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:37 smithi044 bash[22676]: audit 2024-09-21T01:38:36.674586+0000 mon.a (mon.0) 7441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:37 smithi044 bash[22676]: audit 2024-09-21T01:38:36.681050+0000 mon.a (mon.0) 7442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:37 smithi044 bash[22676]: audit 2024-09-21T01:38:36.688426+0000 mon.a (mon.0) 7443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:37 smithi044 bash[22676]: audit 2024-09-21T01:38:36.708014+0000 mon.a (mon.0) 7444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:37 smithi044 bash[22676]: audit 2024-09-21T01:38:36.713093+0000 mon.a (mon.0) 7445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:37 smithi044 bash[22676]: audit 2024-09-21T01:38:36.718438+0000 mon.a (mon.0) 7446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:37 smithi049 bash[23528]: audit 2024-09-21T01:38:36.483016+0000 mgr.a (mgr.14388) 8833 : audit [DBG] from='client.197109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:37 smithi049 bash[23528]: audit 2024-09-21T01:38:36.674586+0000 mon.a (mon.0) 7441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:37 smithi049 bash[23528]: audit 2024-09-21T01:38:36.681050+0000 mon.a (mon.0) 7442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:37 smithi049 bash[23528]: audit 2024-09-21T01:38:36.688426+0000 mon.a (mon.0) 7443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:37 smithi049 bash[23528]: audit 2024-09-21T01:38:36.708014+0000 mon.a (mon.0) 7444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:37 smithi049 bash[23528]: audit 2024-09-21T01:38:36.713093+0000 mon.a (mon.0) 7445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:37 smithi049 bash[23528]: audit 2024-09-21T01:38:36.718438+0000 mon.a (mon.0) 7446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:37 smithi179 bash[23186]: audit 2024-09-21T01:38:36.483016+0000 mgr.a (mgr.14388) 8833 : audit [DBG] from='client.197109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:37 smithi179 bash[23186]: audit 2024-09-21T01:38:36.674586+0000 mon.a (mon.0) 7441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:37 smithi179 bash[23186]: audit 2024-09-21T01:38:36.681050+0000 mon.a (mon.0) 7442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:37 smithi179 bash[23186]: audit 2024-09-21T01:38:36.688426+0000 mon.a (mon.0) 7443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:37 smithi179 bash[23186]: audit 2024-09-21T01:38:36.708014+0000 mon.a (mon.0) 7444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:37 smithi179 bash[23186]: audit 2024-09-21T01:38:36.713093+0000 mon.a (mon.0) 7445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:37 smithi179 bash[23186]: audit 2024-09-21T01:38:36.718438+0000 mon.a (mon.0) 7446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:38 smithi049 bash[23528]: cluster 2024-09-21T01:38:37.054670+0000 mgr.a (mgr.14388) 8834 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:38 smithi044 bash[22676]: cluster 2024-09-21T01:38:37.054670+0000 mgr.a (mgr.14388) 8834 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:38 smithi179 bash[23186]: cluster 2024-09-21T01:38:37.054670+0000 mgr.a (mgr.14388) 8834 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:40 smithi049 bash[23528]: cluster 2024-09-21T01:38:39.055692+0000 mgr.a (mgr.14388) 8835 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:40 smithi044 bash[22676]: cluster 2024-09-21T01:38:39.055692+0000 mgr.a (mgr.14388) 8835 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:40 smithi179 bash[23186]: cluster 2024-09-21T01:38:39.055692+0000 mgr.a (mgr.14388) 8835 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:41.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:41.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:41.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:42 smithi049 bash[23528]: cluster 2024-09-21T01:38:41.058102+0000 mgr.a (mgr.14388) 8836 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:42.716 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:42.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:42.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:42.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:42.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:42.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:42 smithi044 bash[22676]: cluster 2024-09-21T01:38:41.058102+0000 mgr.a (mgr.14388) 8836 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:42 smithi179 bash[23186]: cluster 2024-09-21T01:38:41.058102+0000 mgr.a (mgr.14388) 8836 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:43 smithi049 bash[23528]: audit 2024-09-21T01:38:42.271191+0000 mgr.a (mgr.14388) 8837 : audit [DBG] from='client.197184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:43 smithi044 bash[22676]: audit 2024-09-21T01:38:42.271191+0000 mgr.a (mgr.14388) 8837 : audit [DBG] from='client.197184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:43 smithi179 bash[23186]: audit 2024-09-21T01:38:42.271191+0000 mgr.a (mgr.14388) 8837 : audit [DBG] from='client.197184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:44 smithi044 bash[22676]: cluster 2024-09-21T01:38:43.059152+0000 mgr.a (mgr.14388) 8838 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:44 smithi044 bash[22676]: audit 2024-09-21T01:38:43.452371+0000 mon.a (mon.0) 7447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:44 smithi044 bash[22676]: audit 2024-09-21T01:38:43.461196+0000 mon.a (mon.0) 7448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:44 smithi044 bash[22676]: audit 2024-09-21T01:38:43.471651+0000 mon.a (mon.0) 7449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:44 smithi179 bash[23186]: cluster 2024-09-21T01:38:43.059152+0000 mgr.a (mgr.14388) 8838 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:44 smithi179 bash[23186]: audit 2024-09-21T01:38:43.452371+0000 mon.a (mon.0) 7447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:44 smithi179 bash[23186]: audit 2024-09-21T01:38:43.461196+0000 mon.a (mon.0) 7448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:44 smithi179 bash[23186]: audit 2024-09-21T01:38:43.471651+0000 mon.a (mon.0) 7449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:44 smithi049 bash[23528]: cluster 2024-09-21T01:38:43.059152+0000 mgr.a (mgr.14388) 8838 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:44 smithi049 bash[23528]: audit 2024-09-21T01:38:43.452371+0000 mon.a (mon.0) 7447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:44 smithi049 bash[23528]: audit 2024-09-21T01:38:43.461196+0000 mon.a (mon.0) 7448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:44 smithi049 bash[23528]: audit 2024-09-21T01:38:43.471651+0000 mon.a (mon.0) 7449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:46 smithi044 bash[22676]: cluster 2024-09-21T01:38:45.061326+0000 mgr.a (mgr.14388) 8839 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:46 smithi179 bash[23186]: cluster 2024-09-21T01:38:45.061326+0000 mgr.a (mgr.14388) 8839 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:46 smithi049 bash[23528]: cluster 2024-09-21T01:38:45.061326+0000 mgr.a (mgr.14388) 8839 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:47.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:47.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:47.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:48.492 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:48.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:48.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:48.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:48.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:48 smithi044 bash[22676]: cluster 2024-09-21T01:38:47.062115+0000 mgr.a (mgr.14388) 8840 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:48 smithi179 bash[23186]: cluster 2024-09-21T01:38:47.062115+0000 mgr.a (mgr.14388) 8840 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:48 smithi049 bash[23528]: cluster 2024-09-21T01:38:47.062115+0000 mgr.a (mgr.14388) 8840 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:49 smithi044 bash[22676]: audit 2024-09-21T01:38:48.054769+0000 mgr.a (mgr.14388) 8841 : audit [DBG] from='client.197262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:49 smithi179 bash[23186]: audit 2024-09-21T01:38:48.054769+0000 mgr.a (mgr.14388) 8841 : audit [DBG] from='client.197262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:49 smithi049 bash[23528]: audit 2024-09-21T01:38:48.054769+0000 mgr.a (mgr.14388) 8841 : audit [DBG] from='client.197262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:50 smithi044 bash[22676]: cluster 2024-09-21T01:38:49.063141+0000 mgr.a (mgr.14388) 8842 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:50 smithi179 bash[23186]: cluster 2024-09-21T01:38:49.063141+0000 mgr.a (mgr.14388) 8842 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:50 smithi049 bash[23528]: cluster 2024-09-21T01:38:49.063141+0000 mgr.a (mgr.14388) 8842 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:52 smithi044 bash[22676]: cluster 2024-09-21T01:38:51.065420+0000 mgr.a (mgr.14388) 8843 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:52 smithi179 bash[23186]: cluster 2024-09-21T01:38:51.065420+0000 mgr.a (mgr.14388) 8843 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:52 smithi049 bash[23528]: cluster 2024-09-21T01:38:51.065420+0000 mgr.a (mgr.14388) 8843 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:53.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:53.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:38:54.252 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:38:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:38:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:38:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:38:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:38:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:54 smithi044 bash[22676]: cluster 2024-09-21T01:38:53.066225+0000 mgr.a (mgr.14388) 8844 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:54 smithi179 bash[23186]: cluster 2024-09-21T01:38:53.066225+0000 mgr.a (mgr.14388) 8844 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:54 smithi049 bash[23528]: cluster 2024-09-21T01:38:53.066225+0000 mgr.a (mgr.14388) 8844 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:55.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:55 smithi179 bash[23186]: audit 2024-09-21T01:38:53.830671+0000 mgr.a (mgr.14388) 8845 : audit [DBG] from='client.197340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:55 smithi049 bash[23528]: audit 2024-09-21T01:38:53.830671+0000 mgr.a (mgr.14388) 8845 : audit [DBG] from='client.197340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:55 smithi044 bash[22676]: audit 2024-09-21T01:38:53.830671+0000 mgr.a (mgr.14388) 8845 : audit [DBG] from='client.197340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:56 smithi179 bash[23186]: cluster 2024-09-21T01:38:55.068683+0000 mgr.a (mgr.14388) 8846 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:56 smithi049 bash[23528]: cluster 2024-09-21T01:38:55.068683+0000 mgr.a (mgr.14388) 8846 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:56.919 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:56 smithi044 bash[22676]: cluster 2024-09-21T01:38:55.068683+0000 mgr.a (mgr.14388) 8846 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:38:58.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:57 smithi044 bash[22676]: audit 2024-09-21T01:38:56.874914+0000 mon.a (mon.0) 7450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:57 smithi044 bash[22676]: audit 2024-09-21T01:38:56.881424+0000 mon.a (mon.0) 7451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:57 smithi044 bash[22676]: audit 2024-09-21T01:38:56.890072+0000 mon.a (mon.0) 7452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:57 smithi044 bash[22676]: audit 2024-09-21T01:38:56.898918+0000 mon.a (mon.0) 7453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:57 smithi044 bash[22676]: audit 2024-09-21T01:38:56.906785+0000 mon.a (mon.0) 7454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:57 smithi044 bash[22676]: audit 2024-09-21T01:38:56.918223+0000 mon.a (mon.0) 7455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:38:57 smithi044 bash[22676]: cluster 2024-09-21T01:38:57.069603+0000 mgr.a (mgr.14388) 8847 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:57 smithi179 bash[23186]: audit 2024-09-21T01:38:56.874914+0000 mon.a (mon.0) 7450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:57 smithi179 bash[23186]: audit 2024-09-21T01:38:56.881424+0000 mon.a (mon.0) 7451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:57 smithi179 bash[23186]: audit 2024-09-21T01:38:56.890072+0000 mon.a (mon.0) 7452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:57 smithi179 bash[23186]: audit 2024-09-21T01:38:56.898918+0000 mon.a (mon.0) 7453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:57 smithi179 bash[23186]: audit 2024-09-21T01:38:56.906785+0000 mon.a (mon.0) 7454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:57 smithi179 bash[23186]: audit 2024-09-21T01:38:56.918223+0000 mon.a (mon.0) 7455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:38:57 smithi179 bash[23186]: cluster 2024-09-21T01:38:57.069603+0000 mgr.a (mgr.14388) 8847 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:57 smithi049 bash[23528]: audit 2024-09-21T01:38:56.874914+0000 mon.a (mon.0) 7450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:57 smithi049 bash[23528]: audit 2024-09-21T01:38:56.881424+0000 mon.a (mon.0) 7451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:57 smithi049 bash[23528]: audit 2024-09-21T01:38:56.890072+0000 mon.a (mon.0) 7452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:57 smithi049 bash[23528]: audit 2024-09-21T01:38:56.898918+0000 mon.a (mon.0) 7453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:57 smithi049 bash[23528]: audit 2024-09-21T01:38:56.906785+0000 mon.a (mon.0) 7454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:57 smithi049 bash[23528]: audit 2024-09-21T01:38:56.918223+0000 mon.a (mon.0) 7455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:38:58.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:38:57 smithi049 bash[23528]: cluster 2024-09-21T01:38:57.069603+0000 mgr.a (mgr.14388) 8847 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:38:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:38:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:38:59.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:00.049 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:00.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:00.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:00.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:00.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:00 smithi044 bash[22676]: cluster 2024-09-21T01:38:59.070431+0000 mgr.a (mgr.14388) 8848 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:00 smithi044 bash[22676]: audit 2024-09-21T01:38:59.595766+0000 mgr.a (mgr.14388) 8849 : audit [DBG] from='client.197415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:00 smithi179 bash[23186]: cluster 2024-09-21T01:38:59.070431+0000 mgr.a (mgr.14388) 8848 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:00 smithi179 bash[23186]: audit 2024-09-21T01:38:59.595766+0000 mgr.a (mgr.14388) 8849 : audit [DBG] from='client.197415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:00 smithi049 bash[23528]: cluster 2024-09-21T01:38:59.070431+0000 mgr.a (mgr.14388) 8848 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:00 smithi049 bash[23528]: audit 2024-09-21T01:38:59.595766+0000 mgr.a (mgr.14388) 8849 : audit [DBG] from='client.197415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:02 smithi044 bash[22676]: cluster 2024-09-21T01:39:01.072844+0000 mgr.a (mgr.14388) 8850 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:39:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:02 smithi179 bash[23186]: cluster 2024-09-21T01:39:01.072844+0000 mgr.a (mgr.14388) 8850 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:39:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:02 smithi049 bash[23528]: cluster 2024-09-21T01:39:01.072844+0000 mgr.a (mgr.14388) 8850 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:39:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:04 smithi044 bash[22676]: cluster 2024-09-21T01:39:03.073662+0000 mgr.a (mgr.14388) 8851 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:39:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:04 smithi044 bash[22676]: audit 2024-09-21T01:39:03.688752+0000 mon.a (mon.0) 7456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:04 smithi044 bash[22676]: audit 2024-09-21T01:39:03.697270+0000 mon.a (mon.0) 7457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:04 smithi044 bash[22676]: audit 2024-09-21T01:39:03.707517+0000 mon.a (mon.0) 7458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:04 smithi179 bash[23186]: cluster 2024-09-21T01:39:03.073662+0000 mgr.a (mgr.14388) 8851 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:39:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:04 smithi179 bash[23186]: audit 2024-09-21T01:39:03.688752+0000 mon.a (mon.0) 7456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:04 smithi179 bash[23186]: audit 2024-09-21T01:39:03.697270+0000 mon.a (mon.0) 7457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:04 smithi179 bash[23186]: audit 2024-09-21T01:39:03.707517+0000 mon.a (mon.0) 7458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:04 smithi049 bash[23528]: cluster 2024-09-21T01:39:03.073662+0000 mgr.a (mgr.14388) 8851 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:39:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:04 smithi049 bash[23528]: audit 2024-09-21T01:39:03.688752+0000 mon.a (mon.0) 7456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:04 smithi049 bash[23528]: audit 2024-09-21T01:39:03.697270+0000 mon.a (mon.0) 7457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:04 smithi049 bash[23528]: audit 2024-09-21T01:39:03.707517+0000 mon.a (mon.0) 7458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:05.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:05.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:05.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:06 smithi044 bash[22676]: cluster 2024-09-21T01:39:05.075123+0000 mgr.a (mgr.14388) 8852 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:06 smithi044 bash[22676]: audit 2024-09-21T01:39:05.385379+0000 mgr.a (mgr.14388) 8853 : audit [DBG] from='client.197490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:06 smithi179 bash[23186]: cluster 2024-09-21T01:39:05.075123+0000 mgr.a (mgr.14388) 8852 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:06 smithi179 bash[23186]: audit 2024-09-21T01:39:05.385379+0000 mgr.a (mgr.14388) 8853 : audit [DBG] from='client.197490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:06 smithi049 bash[23528]: cluster 2024-09-21T01:39:05.075123+0000 mgr.a (mgr.14388) 8852 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:06 smithi049 bash[23528]: audit 2024-09-21T01:39:05.385379+0000 mgr.a (mgr.14388) 8853 : audit [DBG] from='client.197490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:08 smithi044 bash[22676]: cluster 2024-09-21T01:39:07.076057+0000 mgr.a (mgr.14388) 8854 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:08 smithi179 bash[23186]: cluster 2024-09-21T01:39:07.076057+0000 mgr.a (mgr.14388) 8854 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:08 smithi049 bash[23528]: cluster 2024-09-21T01:39:07.076057+0000 mgr.a (mgr.14388) 8854 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:10 smithi044 bash[22676]: cluster 2024-09-21T01:39:09.077005+0000 mgr.a (mgr.14388) 8855 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:39:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:10 smithi179 bash[23186]: cluster 2024-09-21T01:39:09.077005+0000 mgr.a (mgr.14388) 8855 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:39:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:10 smithi049 bash[23528]: cluster 2024-09-21T01:39:09.077005+0000 mgr.a (mgr.14388) 8855 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:39:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22930]: debug 2024-09-21T01:39:11.117+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22930]: debug 2024-09-21T01:39:11.121+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22676]: audit 2024-09-21T01:39:10.303766+0000 mon.a (mon.0) 7459 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22676]: audit 2024-09-21T01:39:10.314766+0000 mon.a (mon.0) 7460 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22676]: audit 2024-09-21T01:39:10.316584+0000 mon.a (mon.0) 7461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22676]: audit 2024-09-21T01:39:10.328150+0000 mon.a (mon.0) 7462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22676]: audit 2024-09-21T01:39:10.334539+0000 mon.a (mon.0) 7463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:39:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:11 smithi044 bash[22676]: audit 2024-09-21T01:39:10.336855+0000 mgr.a (mgr.14388) 8856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:39:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:11 smithi179 bash[23186]: audit 2024-09-21T01:39:10.303766+0000 mon.a (mon.0) 7459 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:39:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:11 smithi179 bash[23186]: audit 2024-09-21T01:39:10.314766+0000 mon.a (mon.0) 7460 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:39:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:11 smithi179 bash[23186]: audit 2024-09-21T01:39:10.316584+0000 mon.a (mon.0) 7461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:39:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:11 smithi179 bash[23186]: audit 2024-09-21T01:39:10.328150+0000 mon.a (mon.0) 7462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:11 smithi179 bash[23186]: audit 2024-09-21T01:39:10.334539+0000 mon.a (mon.0) 7463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:39:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:11 smithi179 bash[23186]: audit 2024-09-21T01:39:10.336855+0000 mgr.a (mgr.14388) 8856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:39:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:11 smithi049 bash[23528]: audit 2024-09-21T01:39:10.303766+0000 mon.a (mon.0) 7459 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:39:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:11 smithi049 bash[23528]: audit 2024-09-21T01:39:10.314766+0000 mon.a (mon.0) 7460 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:39:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:11 smithi049 bash[23528]: audit 2024-09-21T01:39:10.316584+0000 mon.a (mon.0) 7461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:39:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:11 smithi049 bash[23528]: audit 2024-09-21T01:39:10.328150+0000 mon.a (mon.0) 7462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:11 smithi049 bash[23528]: audit 2024-09-21T01:39:10.334539+0000 mon.a (mon.0) 7463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:39:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:11 smithi049 bash[23528]: audit 2024-09-21T01:39:10.336855+0000 mgr.a (mgr.14388) 8856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:39:11.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:11.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:11.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:11.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:11.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:12 smithi179 bash[23186]: cluster 2024-09-21T01:39:11.078504+0000 mgr.a (mgr.14388) 8857 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:12 smithi179 bash[23186]: audit 2024-09-21T01:39:11.124723+0000 mgr.a (mgr.14388) 8858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:39:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:12 smithi179 bash[23186]: cephadm 2024-09-21T01:39:11.125898+0000 mgr.a (mgr.14388) 8859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:39:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:12 smithi179 bash[23186]: audit 2024-09-21T01:39:11.165261+0000 mgr.a (mgr.14388) 8860 : audit [DBG] from='client.197655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:12.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:12 smithi044 bash[22676]: cluster 2024-09-21T01:39:11.078504+0000 mgr.a (mgr.14388) 8857 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:12.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:12 smithi044 bash[22676]: audit 2024-09-21T01:39:11.124723+0000 mgr.a (mgr.14388) 8858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:39:12.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:12 smithi044 bash[22676]: cephadm 2024-09-21T01:39:11.125898+0000 mgr.a (mgr.14388) 8859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:39:12.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:12 smithi044 bash[22676]: audit 2024-09-21T01:39:11.165261+0000 mgr.a (mgr.14388) 8860 : audit [DBG] from='client.197655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:12 smithi049 bash[23528]: cluster 2024-09-21T01:39:11.078504+0000 mgr.a (mgr.14388) 8857 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:12 smithi049 bash[23528]: audit 2024-09-21T01:39:11.124723+0000 mgr.a (mgr.14388) 8858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:39:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:12 smithi049 bash[23528]: cephadm 2024-09-21T01:39:11.125898+0000 mgr.a (mgr.14388) 8859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:39:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:12 smithi049 bash[23528]: audit 2024-09-21T01:39:11.165261+0000 mgr.a (mgr.14388) 8860 : audit [DBG] from='client.197655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:14 smithi044 bash[22676]: cluster 2024-09-21T01:39:13.079434+0000 mgr.a (mgr.14388) 8861 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:39:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:14 smithi179 bash[23186]: cluster 2024-09-21T01:39:13.079434+0000 mgr.a (mgr.14388) 8861 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:39:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:14 smithi049 bash[23528]: cluster 2024-09-21T01:39:13.079434+0000 mgr.a (mgr.14388) 8861 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:39:16.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:16.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:16.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:16.648 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:16 smithi179 bash[23186]: cluster 2024-09-21T01:39:15.081593+0000 mgr.a (mgr.14388) 8862 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:16.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:16 smithi044 bash[22676]: cluster 2024-09-21T01:39:15.081593+0000 mgr.a (mgr.14388) 8862 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:16 smithi049 bash[23528]: cluster 2024-09-21T01:39:15.081593+0000 mgr.a (mgr.14388) 8862 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: audit 2024-09-21T01:39:16.917711+0000 mgr.a (mgr.14388) 8863 : audit [DBG] from='client.197751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: audit 2024-09-21T01:39:17.077108+0000 mon.a (mon.0) 7464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: cluster 2024-09-21T01:39:17.082176+0000 mgr.a (mgr.14388) 8864 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: audit 2024-09-21T01:39:17.083195+0000 mon.a (mon.0) 7465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: audit 2024-09-21T01:39:17.089447+0000 mon.a (mon.0) 7466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: audit 2024-09-21T01:39:17.094922+0000 mon.a (mon.0) 7467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: audit 2024-09-21T01:39:17.100882+0000 mon.a (mon.0) 7468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:18 smithi044 bash[22676]: audit 2024-09-21T01:39:17.107950+0000 mon.a (mon.0) 7469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: audit 2024-09-21T01:39:16.917711+0000 mgr.a (mgr.14388) 8863 : audit [DBG] from='client.197751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: audit 2024-09-21T01:39:17.077108+0000 mon.a (mon.0) 7464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: cluster 2024-09-21T01:39:17.082176+0000 mgr.a (mgr.14388) 8864 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: audit 2024-09-21T01:39:17.083195+0000 mon.a (mon.0) 7465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: audit 2024-09-21T01:39:17.089447+0000 mon.a (mon.0) 7466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: audit 2024-09-21T01:39:17.094922+0000 mon.a (mon.0) 7467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: audit 2024-09-21T01:39:17.100882+0000 mon.a (mon.0) 7468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:18 smithi179 bash[23186]: audit 2024-09-21T01:39:17.107950+0000 mon.a (mon.0) 7469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: audit 2024-09-21T01:39:16.917711+0000 mgr.a (mgr.14388) 8863 : audit [DBG] from='client.197751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: audit 2024-09-21T01:39:17.077108+0000 mon.a (mon.0) 7464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: cluster 2024-09-21T01:39:17.082176+0000 mgr.a (mgr.14388) 8864 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: audit 2024-09-21T01:39:17.083195+0000 mon.a (mon.0) 7465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: audit 2024-09-21T01:39:17.089447+0000 mon.a (mon.0) 7466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: audit 2024-09-21T01:39:17.094922+0000 mon.a (mon.0) 7467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: audit 2024-09-21T01:39:17.100882+0000 mon.a (mon.0) 7468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:18 smithi049 bash[23528]: audit 2024-09-21T01:39:17.107950+0000 mon.a (mon.0) 7469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:20 smithi044 bash[22676]: cluster 2024-09-21T01:39:19.083108+0000 mgr.a (mgr.14388) 8865 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:20 smithi049 bash[23528]: cluster 2024-09-21T01:39:19.083108+0000 mgr.a (mgr.14388) 8865 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:20 smithi179 bash[23186]: cluster 2024-09-21T01:39:19.083108+0000 mgr.a (mgr.14388) 8865 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:22.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:22.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:22.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:22 smithi044 bash[22676]: cluster 2024-09-21T01:39:21.085402+0000 mgr.a (mgr.14388) 8866 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:22 smithi179 bash[23186]: cluster 2024-09-21T01:39:21.085402+0000 mgr.a (mgr.14388) 8866 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:22 smithi049 bash[23528]: cluster 2024-09-21T01:39:21.085402+0000 mgr.a (mgr.14388) 8866 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:23.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:23.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:23.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:23.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:23.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:24 smithi049 bash[23528]: audit 2024-09-21T01:39:22.690747+0000 mgr.a (mgr.14388) 8867 : audit [DBG] from='client.197826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:24 smithi049 bash[23528]: cluster 2024-09-21T01:39:23.085945+0000 mgr.a (mgr.14388) 8868 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:24 smithi049 bash[23528]: audit 2024-09-21T01:39:23.928914+0000 mon.a (mon.0) 7470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:24 smithi049 bash[23528]: audit 2024-09-21T01:39:23.937562+0000 mon.a (mon.0) 7471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:24 smithi049 bash[23528]: audit 2024-09-21T01:39:23.948123+0000 mon.a (mon.0) 7472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:24 smithi044 bash[22676]: audit 2024-09-21T01:39:22.690747+0000 mgr.a (mgr.14388) 8867 : audit [DBG] from='client.197826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:24 smithi044 bash[22676]: cluster 2024-09-21T01:39:23.085945+0000 mgr.a (mgr.14388) 8868 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:24 smithi044 bash[22676]: audit 2024-09-21T01:39:23.928914+0000 mon.a (mon.0) 7470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:24 smithi044 bash[22676]: audit 2024-09-21T01:39:23.937562+0000 mon.a (mon.0) 7471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:24 smithi044 bash[22676]: audit 2024-09-21T01:39:23.948123+0000 mon.a (mon.0) 7472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:24 smithi179 bash[23186]: audit 2024-09-21T01:39:22.690747+0000 mgr.a (mgr.14388) 8867 : audit [DBG] from='client.197826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:24 smithi179 bash[23186]: cluster 2024-09-21T01:39:23.085945+0000 mgr.a (mgr.14388) 8868 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:24 smithi179 bash[23186]: audit 2024-09-21T01:39:23.928914+0000 mon.a (mon.0) 7470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:24 smithi179 bash[23186]: audit 2024-09-21T01:39:23.937562+0000 mon.a (mon.0) 7471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:24 smithi179 bash[23186]: audit 2024-09-21T01:39:23.948123+0000 mon.a (mon.0) 7472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:26 smithi044 bash[22676]: cluster 2024-09-21T01:39:25.088039+0000 mgr.a (mgr.14388) 8869 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:26 smithi179 bash[23186]: cluster 2024-09-21T01:39:25.088039+0000 mgr.a (mgr.14388) 8869 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:26 smithi049 bash[23528]: cluster 2024-09-21T01:39:25.088039+0000 mgr.a (mgr.14388) 8869 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:39:28.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:28.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:28.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:28 smithi044 bash[22676]: cluster 2024-09-21T01:39:27.088822+0000 mgr.a (mgr.14388) 8870 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:28 smithi179 bash[23186]: cluster 2024-09-21T01:39:27.088822+0000 mgr.a (mgr.14388) 8870 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:28 smithi049 bash[23528]: cluster 2024-09-21T01:39:27.088822+0000 mgr.a (mgr.14388) 8870 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:28.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:29 smithi044 bash[22676]: audit 2024-09-21T01:39:28.474799+0000 mgr.a (mgr.14388) 8871 : audit [DBG] from='client.197901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:29 smithi179 bash[23186]: audit 2024-09-21T01:39:28.474799+0000 mgr.a (mgr.14388) 8871 : audit [DBG] from='client.197901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:29 smithi049 bash[23528]: audit 2024-09-21T01:39:28.474799+0000 mgr.a (mgr.14388) 8871 : audit [DBG] from='client.197901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:30 smithi044 bash[22676]: cluster 2024-09-21T01:39:29.089805+0000 mgr.a (mgr.14388) 8872 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:30 smithi179 bash[23186]: cluster 2024-09-21T01:39:29.089805+0000 mgr.a (mgr.14388) 8872 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:30 smithi049 bash[23528]: cluster 2024-09-21T01:39:29.089805+0000 mgr.a (mgr.14388) 8872 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:32 smithi044 bash[22676]: cluster 2024-09-21T01:39:31.092090+0000 mgr.a (mgr.14388) 8873 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:32 smithi179 bash[23186]: cluster 2024-09-21T01:39:31.092090+0000 mgr.a (mgr.14388) 8873 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:32 smithi049 bash[23528]: cluster 2024-09-21T01:39:31.092090+0000 mgr.a (mgr.14388) 8873 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:33.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:33.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:33.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:34.430 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:34 smithi179 bash[23186]: cluster 2024-09-21T01:39:33.092880+0000 mgr.a (mgr.14388) 8874 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:34.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:34 smithi044 bash[22676]: cluster 2024-09-21T01:39:33.092880+0000 mgr.a (mgr.14388) 8874 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:34 smithi049 bash[23528]: cluster 2024-09-21T01:39:33.092880+0000 mgr.a (mgr.14388) 8874 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:34.688 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:34.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:34.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:34.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:34.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:35 smithi044 bash[22676]: audit 2024-09-21T01:39:34.256729+0000 mgr.a (mgr.14388) 8875 : audit [DBG] from='client.197976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:35 smithi179 bash[23186]: audit 2024-09-21T01:39:34.256729+0000 mgr.a (mgr.14388) 8875 : audit [DBG] from='client.197976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:35 smithi049 bash[23528]: audit 2024-09-21T01:39:34.256729+0000 mgr.a (mgr.14388) 8875 : audit [DBG] from='client.197976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:36 smithi179 bash[23186]: cluster 2024-09-21T01:39:35.095227+0000 mgr.a (mgr.14388) 8876 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:36 smithi044 bash[22676]: cluster 2024-09-21T01:39:35.095227+0000 mgr.a (mgr.14388) 8876 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:36 smithi049 bash[23528]: cluster 2024-09-21T01:39:35.095227+0000 mgr.a (mgr.14388) 8876 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:38 smithi049 bash[23528]: cluster 2024-09-21T01:39:37.096253+0000 mgr.a (mgr.14388) 8877 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:38 smithi049 bash[23528]: audit 2024-09-21T01:39:37.276628+0000 mon.a (mon.0) 7473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:38 smithi049 bash[23528]: audit 2024-09-21T01:39:37.286217+0000 mon.a (mon.0) 7474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:38 smithi049 bash[23528]: audit 2024-09-21T01:39:37.296244+0000 mon.a (mon.0) 7475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:38 smithi049 bash[23528]: audit 2024-09-21T01:39:37.306532+0000 mon.a (mon.0) 7476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:38 smithi049 bash[23528]: audit 2024-09-21T01:39:37.313534+0000 mon.a (mon.0) 7477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:38 smithi049 bash[23528]: audit 2024-09-21T01:39:37.322310+0000 mon.a (mon.0) 7478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:38 smithi044 bash[22676]: cluster 2024-09-21T01:39:37.096253+0000 mgr.a (mgr.14388) 8877 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:38.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:38 smithi044 bash[22676]: audit 2024-09-21T01:39:37.276628+0000 mon.a (mon.0) 7473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:38 smithi044 bash[22676]: audit 2024-09-21T01:39:37.286217+0000 mon.a (mon.0) 7474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:38 smithi044 bash[22676]: audit 2024-09-21T01:39:37.296244+0000 mon.a (mon.0) 7475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:38 smithi044 bash[22676]: audit 2024-09-21T01:39:37.306532+0000 mon.a (mon.0) 7476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:38 smithi044 bash[22676]: audit 2024-09-21T01:39:37.313534+0000 mon.a (mon.0) 7477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:38 smithi044 bash[22676]: audit 2024-09-21T01:39:37.322310+0000 mon.a (mon.0) 7478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:38 smithi179 bash[23186]: cluster 2024-09-21T01:39:37.096253+0000 mgr.a (mgr.14388) 8877 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:38 smithi179 bash[23186]: audit 2024-09-21T01:39:37.276628+0000 mon.a (mon.0) 7473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:38 smithi179 bash[23186]: audit 2024-09-21T01:39:37.286217+0000 mon.a (mon.0) 7474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:38 smithi179 bash[23186]: audit 2024-09-21T01:39:37.296244+0000 mon.a (mon.0) 7475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:38 smithi179 bash[23186]: audit 2024-09-21T01:39:37.306532+0000 mon.a (mon.0) 7476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:38 smithi179 bash[23186]: audit 2024-09-21T01:39:37.313534+0000 mon.a (mon.0) 7477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:38 smithi179 bash[23186]: audit 2024-09-21T01:39:37.322310+0000 mon.a (mon.0) 7478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:39.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:39.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:39.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:40.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:40.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:40.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:40.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:40.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:40.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:40 smithi044 bash[22676]: cluster 2024-09-21T01:39:39.097294+0000 mgr.a (mgr.14388) 8878 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:40 smithi049 bash[23528]: cluster 2024-09-21T01:39:39.097294+0000 mgr.a (mgr.14388) 8878 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:40 smithi179 bash[23186]: cluster 2024-09-21T01:39:39.097294+0000 mgr.a (mgr.14388) 8878 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:41 smithi049 bash[23528]: audit 2024-09-21T01:39:40.031748+0000 mgr.a (mgr.14388) 8879 : audit [DBG] from='client.198054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:41 smithi044 bash[22676]: audit 2024-09-21T01:39:40.031748+0000 mgr.a (mgr.14388) 8879 : audit [DBG] from='client.198054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:41 smithi179 bash[23186]: audit 2024-09-21T01:39:40.031748+0000 mgr.a (mgr.14388) 8879 : audit [DBG] from='client.198054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:42 smithi049 bash[23528]: cluster 2024-09-21T01:39:41.100167+0000 mgr.a (mgr.14388) 8880 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:42 smithi044 bash[22676]: cluster 2024-09-21T01:39:41.100167+0000 mgr.a (mgr.14388) 8880 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:42 smithi179 bash[23186]: cluster 2024-09-21T01:39:41.100167+0000 mgr.a (mgr.14388) 8880 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:44 smithi049 bash[23528]: cluster 2024-09-21T01:39:43.100992+0000 mgr.a (mgr.14388) 8881 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:44 smithi049 bash[23528]: audit 2024-09-21T01:39:44.162451+0000 mon.a (mon.0) 7479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:44 smithi049 bash[23528]: audit 2024-09-21T01:39:44.172402+0000 mon.a (mon.0) 7480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:44 smithi049 bash[23528]: audit 2024-09-21T01:39:44.188114+0000 mon.a (mon.0) 7481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:44 smithi044 bash[22676]: cluster 2024-09-21T01:39:43.100992+0000 mgr.a (mgr.14388) 8881 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:44 smithi044 bash[22676]: audit 2024-09-21T01:39:44.162451+0000 mon.a (mon.0) 7479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:44 smithi044 bash[22676]: audit 2024-09-21T01:39:44.172402+0000 mon.a (mon.0) 7480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:44 smithi044 bash[22676]: audit 2024-09-21T01:39:44.188114+0000 mon.a (mon.0) 7481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:44 smithi179 bash[23186]: cluster 2024-09-21T01:39:43.100992+0000 mgr.a (mgr.14388) 8881 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:44 smithi179 bash[23186]: audit 2024-09-21T01:39:44.162451+0000 mon.a (mon.0) 7479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:44 smithi179 bash[23186]: audit 2024-09-21T01:39:44.172402+0000 mon.a (mon.0) 7480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:44 smithi179 bash[23186]: audit 2024-09-21T01:39:44.188114+0000 mon.a (mon.0) 7481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:45.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:46.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:46 smithi049 bash[23528]: cluster 2024-09-21T01:39:45.102917+0000 mgr.a (mgr.14388) 8882 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:46 smithi044 bash[22676]: cluster 2024-09-21T01:39:45.102917+0000 mgr.a (mgr.14388) 8882 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:46 smithi179 bash[23186]: cluster 2024-09-21T01:39:45.102917+0000 mgr.a (mgr.14388) 8882 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:47 smithi044 bash[22676]: audit 2024-09-21T01:39:45.815403+0000 mgr.a (mgr.14388) 8883 : audit [DBG] from='client.198132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:47 smithi179 bash[23186]: audit 2024-09-21T01:39:45.815403+0000 mgr.a (mgr.14388) 8883 : audit [DBG] from='client.198132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:47 smithi049 bash[23528]: audit 2024-09-21T01:39:45.815403+0000 mgr.a (mgr.14388) 8883 : audit [DBG] from='client.198132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:48 smithi044 bash[22676]: cluster 2024-09-21T01:39:47.104003+0000 mgr.a (mgr.14388) 8884 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:48 smithi179 bash[23186]: cluster 2024-09-21T01:39:47.104003+0000 mgr.a (mgr.14388) 8884 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:48 smithi049 bash[23528]: cluster 2024-09-21T01:39:47.104003+0000 mgr.a (mgr.14388) 8884 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:50 smithi044 bash[22676]: cluster 2024-09-21T01:39:49.104983+0000 mgr.a (mgr.14388) 8885 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:50 smithi179 bash[23186]: cluster 2024-09-21T01:39:49.104983+0000 mgr.a (mgr.14388) 8885 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:50 smithi049 bash[23528]: cluster 2024-09-21T01:39:49.104983+0000 mgr.a (mgr.14388) 8885 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:39:51.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:51.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:51.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:52.001 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:52.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:52.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:52.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:52.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:52 smithi044 bash[22676]: cluster 2024-09-21T01:39:51.107384+0000 mgr.a (mgr.14388) 8886 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:52 smithi044 bash[22676]: audit 2024-09-21T01:39:51.572964+0000 mgr.a (mgr.14388) 8887 : audit [DBG] from='client.198204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:52 smithi179 bash[23186]: cluster 2024-09-21T01:39:51.107384+0000 mgr.a (mgr.14388) 8886 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:52 smithi179 bash[23186]: audit 2024-09-21T01:39:51.572964+0000 mgr.a (mgr.14388) 8887 : audit [DBG] from='client.198204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:52 smithi049 bash[23528]: cluster 2024-09-21T01:39:51.107384+0000 mgr.a (mgr.14388) 8886 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:52 smithi049 bash[23528]: audit 2024-09-21T01:39:51.572964+0000 mgr.a (mgr.14388) 8887 : audit [DBG] from='client.198204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:54.651 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:54 smithi179 bash[23186]: cluster 2024-09-21T01:39:53.108375+0000 mgr.a (mgr.14388) 8888 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:54 smithi044 bash[22676]: cluster 2024-09-21T01:39:53.108375+0000 mgr.a (mgr.14388) 8888 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:54 smithi049 bash[23528]: cluster 2024-09-21T01:39:53.108375+0000 mgr.a (mgr.14388) 8888 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:56 smithi044 bash[22676]: cluster 2024-09-21T01:39:55.110563+0000 mgr.a (mgr.14388) 8889 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:56 smithi179 bash[23186]: cluster 2024-09-21T01:39:55.110563+0000 mgr.a (mgr.14388) 8889 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:56 smithi049 bash[23528]: cluster 2024-09-21T01:39:55.110563+0000 mgr.a (mgr.14388) 8889 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:39:57.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:39:57.003 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:39:57.003 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:39:57.801 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:39:57.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:39:57.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:39:57.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:39:57.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: cluster 2024-09-21T01:39:57.111076+0000 mgr.a (mgr.14388) 8890 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: audit 2024-09-21T01:39:57.342334+0000 mgr.a (mgr.14388) 8891 : audit [DBG] from='client.198279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: audit 2024-09-21T01:39:57.470584+0000 mon.a (mon.0) 7482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: audit 2024-09-21T01:39:57.475570+0000 mon.a (mon.0) 7483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: audit 2024-09-21T01:39:57.490548+0000 mon.a (mon.0) 7484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: audit 2024-09-21T01:39:57.517296+0000 mon.a (mon.0) 7485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: audit 2024-09-21T01:39:57.522720+0000 mon.a (mon.0) 7486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:39:58 smithi044 bash[22676]: audit 2024-09-21T01:39:57.528531+0000 mon.a (mon.0) 7487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: cluster 2024-09-21T01:39:57.111076+0000 mgr.a (mgr.14388) 8890 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: audit 2024-09-21T01:39:57.342334+0000 mgr.a (mgr.14388) 8891 : audit [DBG] from='client.198279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: audit 2024-09-21T01:39:57.470584+0000 mon.a (mon.0) 7482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: audit 2024-09-21T01:39:57.475570+0000 mon.a (mon.0) 7483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: audit 2024-09-21T01:39:57.490548+0000 mon.a (mon.0) 7484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: audit 2024-09-21T01:39:57.517296+0000 mon.a (mon.0) 7485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: audit 2024-09-21T01:39:57.522720+0000 mon.a (mon.0) 7486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:39:58 smithi179 bash[23186]: audit 2024-09-21T01:39:57.528531+0000 mon.a (mon.0) 7487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: cluster 2024-09-21T01:39:57.111076+0000 mgr.a (mgr.14388) 8890 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:39:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: audit 2024-09-21T01:39:57.342334+0000 mgr.a (mgr.14388) 8891 : audit [DBG] from='client.198279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: audit 2024-09-21T01:39:57.470584+0000 mon.a (mon.0) 7482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: audit 2024-09-21T01:39:57.475570+0000 mon.a (mon.0) 7483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: audit 2024-09-21T01:39:57.490548+0000 mon.a (mon.0) 7484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: audit 2024-09-21T01:39:57.517296+0000 mon.a (mon.0) 7485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: audit 2024-09-21T01:39:57.522720+0000 mon.a (mon.0) 7486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:39:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:39:58 smithi049 bash[23528]: audit 2024-09-21T01:39:57.528531+0000 mon.a (mon.0) 7487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:00 smithi044 bash[22676]: cluster 2024-09-21T01:39:59.112153+0000 mgr.a (mgr.14388) 8892 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:00 smithi044 bash[22676]: cluster 2024-09-21T01:40:00.000157+0000 mon.a (mon.0) 7488 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:40:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:00 smithi179 bash[23186]: cluster 2024-09-21T01:39:59.112153+0000 mgr.a (mgr.14388) 8892 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:00 smithi179 bash[23186]: cluster 2024-09-21T01:40:00.000157+0000 mon.a (mon.0) 7488 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:40:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:00 smithi049 bash[23528]: cluster 2024-09-21T01:39:59.112153+0000 mgr.a (mgr.14388) 8892 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:00 smithi049 bash[23528]: cluster 2024-09-21T01:40:00.000157+0000 mon.a (mon.0) 7488 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:40:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:02 smithi044 bash[22676]: cluster 2024-09-21T01:40:01.113470+0000 mgr.a (mgr.14388) 8893 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:02 smithi179 bash[23186]: cluster 2024-09-21T01:40:01.113470+0000 mgr.a (mgr.14388) 8893 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:02 smithi049 bash[23528]: cluster 2024-09-21T01:40:01.113470+0000 mgr.a (mgr.14388) 8893 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:02.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:02.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:02.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:03.591 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:04 smithi044 bash[22676]: cluster 2024-09-21T01:40:03.114343+0000 mgr.a (mgr.14388) 8894 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:04 smithi044 bash[22676]: audit 2024-09-21T01:40:03.146499+0000 mgr.a (mgr.14388) 8895 : audit [DBG] from='client.198357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:04 smithi044 bash[22676]: audit 2024-09-21T01:40:04.406750+0000 mon.a (mon.0) 7489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:04 smithi044 bash[22676]: audit 2024-09-21T01:40:04.415654+0000 mon.a (mon.0) 7490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:04 smithi044 bash[22676]: audit 2024-09-21T01:40:04.426559+0000 mon.a (mon.0) 7491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:04 smithi179 bash[23186]: cluster 2024-09-21T01:40:03.114343+0000 mgr.a (mgr.14388) 8894 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:04 smithi179 bash[23186]: audit 2024-09-21T01:40:03.146499+0000 mgr.a (mgr.14388) 8895 : audit [DBG] from='client.198357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:04 smithi179 bash[23186]: audit 2024-09-21T01:40:04.406750+0000 mon.a (mon.0) 7489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:04 smithi179 bash[23186]: audit 2024-09-21T01:40:04.415654+0000 mon.a (mon.0) 7490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:04 smithi179 bash[23186]: audit 2024-09-21T01:40:04.426559+0000 mon.a (mon.0) 7491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:04 smithi049 bash[23528]: cluster 2024-09-21T01:40:03.114343+0000 mgr.a (mgr.14388) 8894 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:04 smithi049 bash[23528]: audit 2024-09-21T01:40:03.146499+0000 mgr.a (mgr.14388) 8895 : audit [DBG] from='client.198357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:04 smithi049 bash[23528]: audit 2024-09-21T01:40:04.406750+0000 mon.a (mon.0) 7489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:04 smithi049 bash[23528]: audit 2024-09-21T01:40:04.415654+0000 mon.a (mon.0) 7490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:04 smithi049 bash[23528]: audit 2024-09-21T01:40:04.426559+0000 mon.a (mon.0) 7491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:06 smithi179 bash[23186]: cluster 2024-09-21T01:40:05.116589+0000 mgr.a (mgr.14388) 8896 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:06 smithi049 bash[23528]: cluster 2024-09-21T01:40:05.116589+0000 mgr.a (mgr.14388) 8896 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:06 smithi044 bash[22676]: cluster 2024-09-21T01:40:05.116589+0000 mgr.a (mgr.14388) 8896 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:08.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:08.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:08.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:08 smithi179 bash[23186]: cluster 2024-09-21T01:40:07.117480+0000 mgr.a (mgr.14388) 8897 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:08 smithi049 bash[23528]: cluster 2024-09-21T01:40:07.117480+0000 mgr.a (mgr.14388) 8897 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:08 smithi044 bash[22676]: cluster 2024-09-21T01:40:07.117480+0000 mgr.a (mgr.14388) 8897 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:09.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:09.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:09.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:09.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:09.371 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:10 smithi179 bash[23186]: audit 2024-09-21T01:40:08.930625+0000 mgr.a (mgr.14388) 8898 : audit [DBG] from='client.198432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:10 smithi179 bash[23186]: cluster 2024-09-21T01:40:09.118060+0000 mgr.a (mgr.14388) 8899 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:10 smithi049 bash[23528]: audit 2024-09-21T01:40:08.930625+0000 mgr.a (mgr.14388) 8898 : audit [DBG] from='client.198432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:10 smithi049 bash[23528]: cluster 2024-09-21T01:40:09.118060+0000 mgr.a (mgr.14388) 8899 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:10 smithi044 bash[22676]: audit 2024-09-21T01:40:08.930625+0000 mgr.a (mgr.14388) 8898 : audit [DBG] from='client.198432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:10 smithi044 bash[22676]: cluster 2024-09-21T01:40:09.118060+0000 mgr.a (mgr.14388) 8899 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:11 smithi179 bash[23186]: audit 2024-09-21T01:40:11.200381+0000 mon.a (mon.0) 7492 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:11 smithi179 bash[23186]: audit 2024-09-21T01:40:11.208344+0000 mon.a (mon.0) 7493 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:11 smithi179 bash[23186]: audit 2024-09-21T01:40:11.210669+0000 mon.a (mon.0) 7494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:11 smithi179 bash[23186]: audit 2024-09-21T01:40:11.223137+0000 mon.a (mon.0) 7495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:11 smithi179 bash[23186]: audit 2024-09-21T01:40:11.229582+0000 mon.a (mon.0) 7496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:11 smithi049 bash[23528]: audit 2024-09-21T01:40:11.200381+0000 mon.a (mon.0) 7492 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:11 smithi049 bash[23528]: audit 2024-09-21T01:40:11.208344+0000 mon.a (mon.0) 7493 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:11 smithi049 bash[23528]: audit 2024-09-21T01:40:11.210669+0000 mon.a (mon.0) 7494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:11 smithi049 bash[23528]: audit 2024-09-21T01:40:11.223137+0000 mon.a (mon.0) 7495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:11 smithi049 bash[23528]: audit 2024-09-21T01:40:11.229582+0000 mon.a (mon.0) 7496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:40:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:11 smithi044 bash[22676]: audit 2024-09-21T01:40:11.200381+0000 mon.a (mon.0) 7492 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:40:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:11 smithi044 bash[22676]: audit 2024-09-21T01:40:11.208344+0000 mon.a (mon.0) 7493 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:40:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:11 smithi044 bash[22676]: audit 2024-09-21T01:40:11.210669+0000 mon.a (mon.0) 7494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:40:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:11 smithi044 bash[22676]: audit 2024-09-21T01:40:11.223137+0000 mon.a (mon.0) 7495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:11.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:11 smithi044 bash[22676]: audit 2024-09-21T01:40:11.229582+0000 mon.a (mon.0) 7496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:40:12.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:40:11 smithi044 bash[22930]: debug 2024-09-21T01:40:11.984+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:40:12.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:40:11 smithi044 bash[22930]: debug 2024-09-21T01:40:11.984+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:40:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:12 smithi049 bash[23528]: cluster 2024-09-21T01:40:11.120339+0000 mgr.a (mgr.14388) 8900 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:12 smithi049 bash[23528]: audit 2024-09-21T01:40:11.231905+0000 mgr.a (mgr.14388) 8901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:40:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:12 smithi044 bash[22676]: cluster 2024-09-21T01:40:11.120339+0000 mgr.a (mgr.14388) 8900 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:12 smithi044 bash[22676]: audit 2024-09-21T01:40:11.231905+0000 mgr.a (mgr.14388) 8901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:40:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:12 smithi179 bash[23186]: cluster 2024-09-21T01:40:11.120339+0000 mgr.a (mgr.14388) 8900 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:12 smithi179 bash[23186]: audit 2024-09-21T01:40:11.231905+0000 mgr.a (mgr.14388) 8901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:40:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:13 smithi049 bash[23528]: audit 2024-09-21T01:40:11.986542+0000 mgr.a (mgr.14388) 8902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:40:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:13 smithi049 bash[23528]: cephadm 2024-09-21T01:40:11.988050+0000 mgr.a (mgr.14388) 8903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:40:13.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:13 smithi179 bash[23186]: audit 2024-09-21T01:40:11.986542+0000 mgr.a (mgr.14388) 8902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:40:13.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:13 smithi179 bash[23186]: cephadm 2024-09-21T01:40:11.988050+0000 mgr.a (mgr.14388) 8903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:40:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:13 smithi044 bash[22676]: audit 2024-09-21T01:40:11.986542+0000 mgr.a (mgr.14388) 8902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:40:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:13 smithi044 bash[22676]: cephadm 2024-09-21T01:40:11.988050+0000 mgr.a (mgr.14388) 8903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:40:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:14 smithi044 bash[22676]: cluster 2024-09-21T01:40:13.121329+0000 mgr.a (mgr.14388) 8904 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:14 smithi049 bash[23528]: cluster 2024-09-21T01:40:13.121329+0000 mgr.a (mgr.14388) 8904 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:14.832 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:14 smithi179 bash[23186]: cluster 2024-09-21T01:40:13.121329+0000 mgr.a (mgr.14388) 8904 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:15.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:15.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:15.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:15.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:16 smithi179 bash[23186]: audit 2024-09-21T01:40:14.714255+0000 mgr.a (mgr.14388) 8905 : audit [DBG] from='client.198609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:16 smithi179 bash[23186]: cluster 2024-09-21T01:40:15.122673+0000 mgr.a (mgr.14388) 8906 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:16 smithi049 bash[23528]: audit 2024-09-21T01:40:14.714255+0000 mgr.a (mgr.14388) 8905 : audit [DBG] from='client.198609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:16 smithi049 bash[23528]: cluster 2024-09-21T01:40:15.122673+0000 mgr.a (mgr.14388) 8906 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:16 smithi044 bash[22676]: audit 2024-09-21T01:40:14.714255+0000 mgr.a (mgr.14388) 8905 : audit [DBG] from='client.198609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:16 smithi044 bash[22676]: cluster 2024-09-21T01:40:15.122673+0000 mgr.a (mgr.14388) 8906 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:18.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:18 smithi049 bash[23528]: cluster 2024-09-21T01:40:17.123436+0000 mgr.a (mgr.14388) 8907 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:18.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:18 smithi049 bash[23528]: audit 2024-09-21T01:40:17.709822+0000 mon.a (mon.0) 7497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:18 smithi049 bash[23528]: audit 2024-09-21T01:40:17.716721+0000 mon.a (mon.0) 7498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:18 smithi049 bash[23528]: audit 2024-09-21T01:40:17.726290+0000 mon.a (mon.0) 7499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:18 smithi049 bash[23528]: audit 2024-09-21T01:40:17.730916+0000 mon.a (mon.0) 7500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:18 smithi049 bash[23528]: audit 2024-09-21T01:40:17.734908+0000 mon.a (mon.0) 7501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:18 smithi049 bash[23528]: audit 2024-09-21T01:40:17.739811+0000 mon.a (mon.0) 7502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.796 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:18 smithi044 bash[22676]: cluster 2024-09-21T01:40:17.123436+0000 mgr.a (mgr.14388) 8907 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:18.796 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:18 smithi044 bash[22676]: audit 2024-09-21T01:40:17.709822+0000 mon.a (mon.0) 7497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.796 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:18 smithi044 bash[22676]: audit 2024-09-21T01:40:17.716721+0000 mon.a (mon.0) 7498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.796 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:18 smithi044 bash[22676]: audit 2024-09-21T01:40:17.726290+0000 mon.a (mon.0) 7499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.796 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:18 smithi044 bash[22676]: audit 2024-09-21T01:40:17.730916+0000 mon.a (mon.0) 7500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.796 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:18 smithi044 bash[22676]: audit 2024-09-21T01:40:17.734908+0000 mon.a (mon.0) 7501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:18.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:18 smithi044 bash[22676]: audit 2024-09-21T01:40:17.739811+0000 mon.a (mon.0) 7502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:18 smithi179 bash[23186]: cluster 2024-09-21T01:40:17.123436+0000 mgr.a (mgr.14388) 8907 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:18 smithi179 bash[23186]: audit 2024-09-21T01:40:17.709822+0000 mon.a (mon.0) 7497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:18 smithi179 bash[23186]: audit 2024-09-21T01:40:17.716721+0000 mon.a (mon.0) 7498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:18 smithi179 bash[23186]: audit 2024-09-21T01:40:17.726290+0000 mon.a (mon.0) 7499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:18 smithi179 bash[23186]: audit 2024-09-21T01:40:17.730916+0000 mon.a (mon.0) 7500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:18 smithi179 bash[23186]: audit 2024-09-21T01:40:17.734908+0000 mon.a (mon.0) 7501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:18 smithi179 bash[23186]: audit 2024-09-21T01:40:17.739811+0000 mon.a (mon.0) 7502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:20.143 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:20 smithi049 bash[23528]: cluster 2024-09-21T01:40:19.124255+0000 mgr.a (mgr.14388) 8908 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:20.934 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:20.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:20 smithi044 bash[22676]: cluster 2024-09-21T01:40:19.124255+0000 mgr.a (mgr.14388) 8908 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:20 smithi179 bash[23186]: cluster 2024-09-21T01:40:19.124255+0000 mgr.a (mgr.14388) 8908 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:21 smithi049 bash[23528]: audit 2024-09-21T01:40:20.485723+0000 mgr.a (mgr.14388) 8909 : audit [DBG] from='client.198678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:21 smithi044 bash[22676]: audit 2024-09-21T01:40:20.485723+0000 mgr.a (mgr.14388) 8909 : audit [DBG] from='client.198678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:21 smithi179 bash[23186]: audit 2024-09-21T01:40:20.485723+0000 mgr.a (mgr.14388) 8909 : audit [DBG] from='client.198678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:22 smithi049 bash[23528]: cluster 2024-09-21T01:40:21.127058+0000 mgr.a (mgr.14388) 8910 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:22 smithi044 bash[22676]: cluster 2024-09-21T01:40:21.127058+0000 mgr.a (mgr.14388) 8910 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:22 smithi179 bash[23186]: cluster 2024-09-21T01:40:21.127058+0000 mgr.a (mgr.14388) 8910 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:24 smithi044 bash[22676]: cluster 2024-09-21T01:40:23.127872+0000 mgr.a (mgr.14388) 8911 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:24 smithi179 bash[23186]: cluster 2024-09-21T01:40:23.127872+0000 mgr.a (mgr.14388) 8911 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:24 smithi049 bash[23528]: cluster 2024-09-21T01:40:23.127872+0000 mgr.a (mgr.14388) 8911 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:40:25.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:25 smithi044 bash[22676]: audit 2024-09-21T01:40:24.639903+0000 mon.a (mon.0) 7503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:25 smithi044 bash[22676]: audit 2024-09-21T01:40:24.649316+0000 mon.a (mon.0) 7504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:25 smithi044 bash[22676]: audit 2024-09-21T01:40:24.660285+0000 mon.a (mon.0) 7505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:25 smithi179 bash[23186]: audit 2024-09-21T01:40:24.639903+0000 mon.a (mon.0) 7503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:25 smithi179 bash[23186]: audit 2024-09-21T01:40:24.649316+0000 mon.a (mon.0) 7504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:25 smithi179 bash[23186]: audit 2024-09-21T01:40:24.660285+0000 mon.a (mon.0) 7505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:25 smithi049 bash[23528]: audit 2024-09-21T01:40:24.639903+0000 mon.a (mon.0) 7503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:25 smithi049 bash[23528]: audit 2024-09-21T01:40:24.649316+0000 mon.a (mon.0) 7504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:25 smithi049 bash[23528]: audit 2024-09-21T01:40:24.660285+0000 mon.a (mon.0) 7505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:26.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:26.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:26.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:26.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:26.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:26 smithi044 bash[22676]: cluster 2024-09-21T01:40:25.129796+0000 mgr.a (mgr.14388) 8912 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:26 smithi179 bash[23186]: cluster 2024-09-21T01:40:25.129796+0000 mgr.a (mgr.14388) 8912 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:26 smithi049 bash[23528]: cluster 2024-09-21T01:40:25.129796+0000 mgr.a (mgr.14388) 8912 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:40:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:27 smithi044 bash[22676]: audit 2024-09-21T01:40:26.275440+0000 mgr.a (mgr.14388) 8913 : audit [DBG] from='client.198756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:27 smithi179 bash[23186]: audit 2024-09-21T01:40:26.275440+0000 mgr.a (mgr.14388) 8913 : audit [DBG] from='client.198756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:27 smithi049 bash[23528]: audit 2024-09-21T01:40:26.275440+0000 mgr.a (mgr.14388) 8913 : audit [DBG] from='client.198756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:28 smithi044 bash[22676]: cluster 2024-09-21T01:40:27.130900+0000 mgr.a (mgr.14388) 8914 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:40:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:28 smithi179 bash[23186]: cluster 2024-09-21T01:40:27.130900+0000 mgr.a (mgr.14388) 8914 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:40:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:28 smithi049 bash[23528]: cluster 2024-09-21T01:40:27.130900+0000 mgr.a (mgr.14388) 8914 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:40:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:30 smithi044 bash[22676]: cluster 2024-09-21T01:40:29.131765+0000 mgr.a (mgr.14388) 8915 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:40:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:30 smithi179 bash[23186]: cluster 2024-09-21T01:40:29.131765+0000 mgr.a (mgr.14388) 8915 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:40:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:30 smithi049 bash[23528]: cluster 2024-09-21T01:40:29.131765+0000 mgr.a (mgr.14388) 8915 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:40:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:31.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:31 smithi044 bash[22676]: cluster 2024-09-21T01:40:31.134025+0000 mgr.a (mgr.14388) 8916 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:40:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:31 smithi179 bash[23186]: cluster 2024-09-21T01:40:31.134025+0000 mgr.a (mgr.14388) 8916 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:40:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:31 smithi049 bash[23528]: cluster 2024-09-21T01:40:31.134025+0000 mgr.a (mgr.14388) 8916 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:40:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:32.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:32.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:32.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:32.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:32 smithi044 bash[22676]: audit 2024-09-21T01:40:32.067626+0000 mgr.a (mgr.14388) 8917 : audit [DBG] from='client.198834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:32 smithi179 bash[23186]: audit 2024-09-21T01:40:32.067626+0000 mgr.a (mgr.14388) 8917 : audit [DBG] from='client.198834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:32 smithi049 bash[23528]: audit 2024-09-21T01:40:32.067626+0000 mgr.a (mgr.14388) 8917 : audit [DBG] from='client.198834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:33 smithi179 bash[23186]: cluster 2024-09-21T01:40:33.134977+0000 mgr.a (mgr.14388) 8918 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:33 smithi049 bash[23528]: cluster 2024-09-21T01:40:33.134977+0000 mgr.a (mgr.14388) 8918 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:33 smithi044 bash[22676]: cluster 2024-09-21T01:40:33.134977+0000 mgr.a (mgr.14388) 8918 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:36.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:36 smithi179 bash[23186]: cluster 2024-09-21T01:40:35.137377+0000 mgr.a (mgr.14388) 8919 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:36 smithi044 bash[22676]: cluster 2024-09-21T01:40:35.137377+0000 mgr.a (mgr.14388) 8919 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:36 smithi049 bash[23528]: cluster 2024-09-21T01:40:35.137377+0000 mgr.a (mgr.14388) 8919 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:37.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:37.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:37.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:38.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:38.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:38.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:38.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:38.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:38 smithi044 bash[22676]: cluster 2024-09-21T01:40:37.138301+0000 mgr.a (mgr.14388) 8920 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:38 smithi044 bash[22676]: audit 2024-09-21T01:40:37.888458+0000 mon.a (mon.0) 7506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:38 smithi044 bash[22676]: audit 2024-09-21T01:40:37.893269+0000 mon.a (mon.0) 7507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:38 smithi044 bash[22676]: audit 2024-09-21T01:40:37.912662+0000 mon.a (mon.0) 7508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:38 smithi044 bash[22676]: audit 2024-09-21T01:40:37.924067+0000 mon.a (mon.0) 7509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:38 smithi044 bash[22676]: audit 2024-09-21T01:40:37.929858+0000 mon.a (mon.0) 7510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:38 smithi044 bash[22676]: audit 2024-09-21T01:40:37.937177+0000 mon.a (mon.0) 7511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:38 smithi179 bash[23186]: cluster 2024-09-21T01:40:37.138301+0000 mgr.a (mgr.14388) 8920 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:38 smithi179 bash[23186]: audit 2024-09-21T01:40:37.888458+0000 mon.a (mon.0) 7506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:38 smithi179 bash[23186]: audit 2024-09-21T01:40:37.893269+0000 mon.a (mon.0) 7507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:38 smithi179 bash[23186]: audit 2024-09-21T01:40:37.912662+0000 mon.a (mon.0) 7508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:38 smithi179 bash[23186]: audit 2024-09-21T01:40:37.924067+0000 mon.a (mon.0) 7509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:38 smithi179 bash[23186]: audit 2024-09-21T01:40:37.929858+0000 mon.a (mon.0) 7510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:38 smithi179 bash[23186]: audit 2024-09-21T01:40:37.937177+0000 mon.a (mon.0) 7511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:38 smithi049 bash[23528]: cluster 2024-09-21T01:40:37.138301+0000 mgr.a (mgr.14388) 8920 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:38 smithi049 bash[23528]: audit 2024-09-21T01:40:37.888458+0000 mon.a (mon.0) 7506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:38 smithi049 bash[23528]: audit 2024-09-21T01:40:37.893269+0000 mon.a (mon.0) 7507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:38 smithi049 bash[23528]: audit 2024-09-21T01:40:37.912662+0000 mon.a (mon.0) 7508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:38 smithi049 bash[23528]: audit 2024-09-21T01:40:37.924067+0000 mon.a (mon.0) 7509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:38 smithi049 bash[23528]: audit 2024-09-21T01:40:37.929858+0000 mon.a (mon.0) 7510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:38 smithi049 bash[23528]: audit 2024-09-21T01:40:37.937177+0000 mon.a (mon.0) 7511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:39.291 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:39 smithi044 bash[22676]: audit 2024-09-21T01:40:37.890659+0000 mgr.a (mgr.14388) 8921 : audit [DBG] from='client.198906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:39 smithi179 bash[23186]: audit 2024-09-21T01:40:37.890659+0000 mgr.a (mgr.14388) 8921 : audit [DBG] from='client.198906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:39 smithi049 bash[23528]: audit 2024-09-21T01:40:37.890659+0000 mgr.a (mgr.14388) 8921 : audit [DBG] from='client.198906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:40 smithi044 bash[22676]: cluster 2024-09-21T01:40:39.138904+0000 mgr.a (mgr.14388) 8922 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:40 smithi179 bash[23186]: cluster 2024-09-21T01:40:39.138904+0000 mgr.a (mgr.14388) 8922 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:40 smithi049 bash[23528]: cluster 2024-09-21T01:40:39.138904+0000 mgr.a (mgr.14388) 8922 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:42 smithi044 bash[22676]: cluster 2024-09-21T01:40:41.141072+0000 mgr.a (mgr.14388) 8923 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:42 smithi179 bash[23186]: cluster 2024-09-21T01:40:41.141072+0000 mgr.a (mgr.14388) 8923 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:42 smithi049 bash[23528]: cluster 2024-09-21T01:40:41.141072+0000 mgr.a (mgr.14388) 8923 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:43.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:43.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:43.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:44.081 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:44.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:44.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:44.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:44.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:44 smithi044 bash[22676]: cluster 2024-09-21T01:40:43.141847+0000 mgr.a (mgr.14388) 8924 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:44 smithi044 bash[22676]: audit 2024-09-21T01:40:43.666803+0000 mgr.a (mgr.14388) 8925 : audit [DBG] from='client.198984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:44 smithi179 bash[23186]: cluster 2024-09-21T01:40:43.141847+0000 mgr.a (mgr.14388) 8924 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:44 smithi179 bash[23186]: audit 2024-09-21T01:40:43.666803+0000 mgr.a (mgr.14388) 8925 : audit [DBG] from='client.198984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:44 smithi049 bash[23528]: cluster 2024-09-21T01:40:43.141847+0000 mgr.a (mgr.14388) 8924 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:44 smithi049 bash[23528]: audit 2024-09-21T01:40:43.666803+0000 mgr.a (mgr.14388) 8925 : audit [DBG] from='client.198984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:45 smithi044 bash[22676]: audit 2024-09-21T01:40:44.875856+0000 mon.a (mon.0) 7512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:45 smithi044 bash[22676]: audit 2024-09-21T01:40:44.884608+0000 mon.a (mon.0) 7513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:45 smithi044 bash[22676]: audit 2024-09-21T01:40:44.895111+0000 mon.a (mon.0) 7514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:45 smithi044 bash[22676]: cluster 2024-09-21T01:40:45.144088+0000 mgr.a (mgr.14388) 8926 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:45 smithi179 bash[23186]: audit 2024-09-21T01:40:44.875856+0000 mon.a (mon.0) 7512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:45 smithi179 bash[23186]: audit 2024-09-21T01:40:44.884608+0000 mon.a (mon.0) 7513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:45 smithi179 bash[23186]: audit 2024-09-21T01:40:44.895111+0000 mon.a (mon.0) 7514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:45 smithi179 bash[23186]: cluster 2024-09-21T01:40:45.144088+0000 mgr.a (mgr.14388) 8926 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:45 smithi049 bash[23528]: audit 2024-09-21T01:40:44.875856+0000 mon.a (mon.0) 7512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:45 smithi049 bash[23528]: audit 2024-09-21T01:40:44.884608+0000 mon.a (mon.0) 7513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:45 smithi049 bash[23528]: audit 2024-09-21T01:40:44.895111+0000 mon.a (mon.0) 7514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:45 smithi049 bash[23528]: cluster 2024-09-21T01:40:45.144088+0000 mgr.a (mgr.14388) 8926 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:48 smithi044 bash[22676]: cluster 2024-09-21T01:40:47.144878+0000 mgr.a (mgr.14388) 8927 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:48 smithi179 bash[23186]: cluster 2024-09-21T01:40:47.144878+0000 mgr.a (mgr.14388) 8927 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:48 smithi049 bash[23528]: cluster 2024-09-21T01:40:47.144878+0000 mgr.a (mgr.14388) 8927 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:49.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:49.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:49.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:49.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:49.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:50 smithi044 bash[22676]: cluster 2024-09-21T01:40:49.145684+0000 mgr.a (mgr.14388) 8928 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:50 smithi044 bash[22676]: audit 2024-09-21T01:40:49.417912+0000 mgr.a (mgr.14388) 8929 : audit [DBG] from='client.199062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:50 smithi179 bash[23186]: cluster 2024-09-21T01:40:49.145684+0000 mgr.a (mgr.14388) 8928 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:50 smithi179 bash[23186]: audit 2024-09-21T01:40:49.417912+0000 mgr.a (mgr.14388) 8929 : audit [DBG] from='client.199062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:50 smithi049 bash[23528]: cluster 2024-09-21T01:40:49.145684+0000 mgr.a (mgr.14388) 8928 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:50 smithi049 bash[23528]: audit 2024-09-21T01:40:49.417912+0000 mgr.a (mgr.14388) 8929 : audit [DBG] from='client.199062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:52 smithi044 bash[22676]: cluster 2024-09-21T01:40:51.147984+0000 mgr.a (mgr.14388) 8930 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:52 smithi179 bash[23186]: cluster 2024-09-21T01:40:51.147984+0000 mgr.a (mgr.14388) 8930 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:52 smithi049 bash[23528]: cluster 2024-09-21T01:40:51.147984+0000 mgr.a (mgr.14388) 8930 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:40:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:53 smithi044 bash[22676]: cluster 2024-09-21T01:40:53.148792+0000 mgr.a (mgr.14388) 8931 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:53 smithi179 bash[23186]: cluster 2024-09-21T01:40:53.148792+0000 mgr.a (mgr.14388) 8931 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:53 smithi049 bash[23528]: cluster 2024-09-21T01:40:53.148792+0000 mgr.a (mgr.14388) 8931 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:54.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:40:54.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:40:54.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:40:55.657 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:40:55.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:40:55.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:40:55.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:40:55.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:40:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:56 smithi044 bash[22676]: cluster 2024-09-21T01:40:55.150099+0000 mgr.a (mgr.14388) 8932 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:56 smithi044 bash[22676]: audit 2024-09-21T01:40:55.202383+0000 mgr.a (mgr.14388) 8933 : audit [DBG] from='client.199137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:56 smithi179 bash[23186]: cluster 2024-09-21T01:40:55.150099+0000 mgr.a (mgr.14388) 8932 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:56 smithi179 bash[23186]: audit 2024-09-21T01:40:55.202383+0000 mgr.a (mgr.14388) 8933 : audit [DBG] from='client.199137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:56 smithi049 bash[23528]: cluster 2024-09-21T01:40:55.150099+0000 mgr.a (mgr.14388) 8932 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:40:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:56 smithi049 bash[23528]: audit 2024-09-21T01:40:55.202383+0000 mgr.a (mgr.14388) 8933 : audit [DBG] from='client.199137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:58 smithi044 bash[22676]: cluster 2024-09-21T01:40:57.151145+0000 mgr.a (mgr.14388) 8934 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:40:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:58 smithi044 bash[22676]: audit 2024-09-21T01:40:58.114672+0000 mon.a (mon.0) 7515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:58 smithi044 bash[22676]: audit 2024-09-21T01:40:58.120594+0000 mon.a (mon.0) 7516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:58 smithi044 bash[22676]: audit 2024-09-21T01:40:58.128742+0000 mon.a (mon.0) 7517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:58 smithi044 bash[22676]: audit 2024-09-21T01:40:58.139799+0000 mon.a (mon.0) 7518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:58 smithi044 bash[22676]: audit 2024-09-21T01:40:58.144624+0000 mon.a (mon.0) 7519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:40:58 smithi044 bash[22676]: audit 2024-09-21T01:40:58.153633+0000 mon.a (mon.0) 7520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:58 smithi179 bash[23186]: cluster 2024-09-21T01:40:57.151145+0000 mgr.a (mgr.14388) 8934 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:40:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:58 smithi179 bash[23186]: audit 2024-09-21T01:40:58.114672+0000 mon.a (mon.0) 7515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:58 smithi179 bash[23186]: audit 2024-09-21T01:40:58.120594+0000 mon.a (mon.0) 7516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:58 smithi179 bash[23186]: audit 2024-09-21T01:40:58.128742+0000 mon.a (mon.0) 7517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:58 smithi179 bash[23186]: audit 2024-09-21T01:40:58.139799+0000 mon.a (mon.0) 7518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:58 smithi179 bash[23186]: audit 2024-09-21T01:40:58.144624+0000 mon.a (mon.0) 7519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:40:58 smithi179 bash[23186]: audit 2024-09-21T01:40:58.153633+0000 mon.a (mon.0) 7520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:58 smithi049 bash[23528]: cluster 2024-09-21T01:40:57.151145+0000 mgr.a (mgr.14388) 8934 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:40:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:58 smithi049 bash[23528]: audit 2024-09-21T01:40:58.114672+0000 mon.a (mon.0) 7515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:58 smithi049 bash[23528]: audit 2024-09-21T01:40:58.120594+0000 mon.a (mon.0) 7516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:58 smithi049 bash[23528]: audit 2024-09-21T01:40:58.128742+0000 mon.a (mon.0) 7517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:58 smithi049 bash[23528]: audit 2024-09-21T01:40:58.139799+0000 mon.a (mon.0) 7518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:58 smithi049 bash[23528]: audit 2024-09-21T01:40:58.144624+0000 mon.a (mon.0) 7519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:40:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:40:58 smithi049 bash[23528]: audit 2024-09-21T01:40:58.153633+0000 mon.a (mon.0) 7520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:00 smithi044 bash[22676]: cluster 2024-09-21T01:40:59.151999+0000 mgr.a (mgr.14388) 8935 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:00 smithi179 bash[23186]: cluster 2024-09-21T01:40:59.151999+0000 mgr.a (mgr.14388) 8935 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:00 smithi049 bash[23528]: cluster 2024-09-21T01:40:59.151999+0000 mgr.a (mgr.14388) 8935 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:00.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:00.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:00.661 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:01.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:01.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:01.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:01.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:01.456 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:02 smithi049 bash[23528]: audit 2024-09-21T01:41:00.999466+0000 mgr.a (mgr.14388) 8936 : audit [DBG] from='client.199215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:02 smithi049 bash[23528]: cluster 2024-09-21T01:41:01.153459+0000 mgr.a (mgr.14388) 8937 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:02 smithi044 bash[22676]: audit 2024-09-21T01:41:00.999466+0000 mgr.a (mgr.14388) 8936 : audit [DBG] from='client.199215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:02 smithi044 bash[22676]: cluster 2024-09-21T01:41:01.153459+0000 mgr.a (mgr.14388) 8937 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:02 smithi179 bash[23186]: audit 2024-09-21T01:41:00.999466+0000 mgr.a (mgr.14388) 8936 : audit [DBG] from='client.199215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:02 smithi179 bash[23186]: cluster 2024-09-21T01:41:01.153459+0000 mgr.a (mgr.14388) 8937 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:04 smithi044 bash[22676]: cluster 2024-09-21T01:41:03.154355+0000 mgr.a (mgr.14388) 8938 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:04 smithi179 bash[23186]: cluster 2024-09-21T01:41:03.154355+0000 mgr.a (mgr.14388) 8938 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:04 smithi049 bash[23528]: cluster 2024-09-21T01:41:03.154355+0000 mgr.a (mgr.14388) 8938 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:06.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:06.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:06 smithi044 bash[22676]: audit 2024-09-21T01:41:05.107363+0000 mon.a (mon.0) 7521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:06 smithi044 bash[22676]: audit 2024-09-21T01:41:05.116115+0000 mon.a (mon.0) 7522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:06 smithi044 bash[22676]: audit 2024-09-21T01:41:05.126802+0000 mon.a (mon.0) 7523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:06 smithi044 bash[22676]: cluster 2024-09-21T01:41:05.156581+0000 mgr.a (mgr.14388) 8939 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:06 smithi179 bash[23186]: audit 2024-09-21T01:41:05.107363+0000 mon.a (mon.0) 7521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:06 smithi179 bash[23186]: audit 2024-09-21T01:41:05.116115+0000 mon.a (mon.0) 7522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:06 smithi179 bash[23186]: audit 2024-09-21T01:41:05.126802+0000 mon.a (mon.0) 7523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:06 smithi179 bash[23186]: cluster 2024-09-21T01:41:05.156581+0000 mgr.a (mgr.14388) 8939 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:06 smithi049 bash[23528]: audit 2024-09-21T01:41:05.107363+0000 mon.a (mon.0) 7521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:06 smithi049 bash[23528]: audit 2024-09-21T01:41:05.116115+0000 mon.a (mon.0) 7522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:06 smithi049 bash[23528]: audit 2024-09-21T01:41:05.126802+0000 mon.a (mon.0) 7523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:06 smithi049 bash[23528]: cluster 2024-09-21T01:41:05.156581+0000 mgr.a (mgr.14388) 8939 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:07.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:07.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:07.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:07.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:07.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:08 smithi044 bash[22676]: audit 2024-09-21T01:41:06.799663+0000 mgr.a (mgr.14388) 8940 : audit [DBG] from='client.199287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:08 smithi044 bash[22676]: cluster 2024-09-21T01:41:07.157132+0000 mgr.a (mgr.14388) 8941 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:08 smithi179 bash[23186]: audit 2024-09-21T01:41:06.799663+0000 mgr.a (mgr.14388) 8940 : audit [DBG] from='client.199287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:08 smithi179 bash[23186]: cluster 2024-09-21T01:41:07.157132+0000 mgr.a (mgr.14388) 8941 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:08 smithi049 bash[23528]: audit 2024-09-21T01:41:06.799663+0000 mgr.a (mgr.14388) 8940 : audit [DBG] from='client.199287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:08 smithi049 bash[23528]: cluster 2024-09-21T01:41:07.157132+0000 mgr.a (mgr.14388) 8941 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:10 smithi044 bash[22676]: cluster 2024-09-21T01:41:09.157867+0000 mgr.a (mgr.14388) 8942 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:10 smithi179 bash[23186]: cluster 2024-09-21T01:41:09.157867+0000 mgr.a (mgr.14388) 8942 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:10 smithi049 bash[23528]: cluster 2024-09-21T01:41:09.157867+0000 mgr.a (mgr.14388) 8942 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22676]: cluster 2024-09-21T01:41:11.160121+0000 mgr.a (mgr.14388) 8943 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22676]: audit 2024-09-21T01:41:12.041692+0000 mon.a (mon.0) 7524 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22676]: audit 2024-09-21T01:41:12.048986+0000 mon.a (mon.0) 7525 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22676]: audit 2024-09-21T01:41:12.050829+0000 mon.a (mon.0) 7526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22676]: audit 2024-09-21T01:41:12.061753+0000 mon.a (mon.0) 7527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22676]: audit 2024-09-21T01:41:12.068168+0000 mon.a (mon.0) 7528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:41:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:12 smithi179 bash[23186]: cluster 2024-09-21T01:41:11.160121+0000 mgr.a (mgr.14388) 8943 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:12 smithi179 bash[23186]: audit 2024-09-21T01:41:12.041692+0000 mon.a (mon.0) 7524 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:41:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:12 smithi179 bash[23186]: audit 2024-09-21T01:41:12.048986+0000 mon.a (mon.0) 7525 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:41:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:12 smithi179 bash[23186]: audit 2024-09-21T01:41:12.050829+0000 mon.a (mon.0) 7526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:41:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:12 smithi179 bash[23186]: audit 2024-09-21T01:41:12.061753+0000 mon.a (mon.0) 7527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:12 smithi179 bash[23186]: audit 2024-09-21T01:41:12.068168+0000 mon.a (mon.0) 7528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:41:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:12 smithi049 bash[23528]: cluster 2024-09-21T01:41:11.160121+0000 mgr.a (mgr.14388) 8943 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:12 smithi049 bash[23528]: audit 2024-09-21T01:41:12.041692+0000 mon.a (mon.0) 7524 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:41:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:12 smithi049 bash[23528]: audit 2024-09-21T01:41:12.048986+0000 mon.a (mon.0) 7525 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:41:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:12 smithi049 bash[23528]: audit 2024-09-21T01:41:12.050829+0000 mon.a (mon.0) 7526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:41:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:12 smithi049 bash[23528]: audit 2024-09-21T01:41:12.061753+0000 mon.a (mon.0) 7527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:12 smithi049 bash[23528]: audit 2024-09-21T01:41:12.068168+0000 mon.a (mon.0) 7528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:41:13.228 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22930]: debug 2024-09-21T01:41:12.843+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:41:13.228 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:41:12 smithi044 bash[22930]: debug 2024-09-21T01:41:12.855+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:41:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:13.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:13.253 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:13 smithi044 bash[22676]: audit 2024-09-21T01:41:12.070598+0000 mgr.a (mgr.14388) 8944 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:41:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:13 smithi044 bash[22676]: audit 2024-09-21T01:41:12.589960+0000 mgr.a (mgr.14388) 8945 : audit [DBG] from='client.199401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:13 smithi179 bash[23186]: audit 2024-09-21T01:41:12.070598+0000 mgr.a (mgr.14388) 8944 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:41:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:13 smithi179 bash[23186]: audit 2024-09-21T01:41:12.589960+0000 mgr.a (mgr.14388) 8945 : audit [DBG] from='client.199401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:13 smithi049 bash[23528]: audit 2024-09-21T01:41:12.070598+0000 mgr.a (mgr.14388) 8944 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:41:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:13 smithi049 bash[23528]: audit 2024-09-21T01:41:12.589960+0000 mgr.a (mgr.14388) 8945 : audit [DBG] from='client.199401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:14 smithi044 bash[22676]: audit 2024-09-21T01:41:12.848357+0000 mgr.a (mgr.14388) 8946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:41:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:14 smithi044 bash[22676]: cephadm 2024-09-21T01:41:12.859860+0000 mgr.a (mgr.14388) 8947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:41:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:14 smithi044 bash[22676]: cluster 2024-09-21T01:41:13.160929+0000 mgr.a (mgr.14388) 8948 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:14 smithi179 bash[23186]: audit 2024-09-21T01:41:12.848357+0000 mgr.a (mgr.14388) 8946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:41:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:14 smithi179 bash[23186]: cephadm 2024-09-21T01:41:12.859860+0000 mgr.a (mgr.14388) 8947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:41:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:14 smithi179 bash[23186]: cluster 2024-09-21T01:41:13.160929+0000 mgr.a (mgr.14388) 8948 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:14 smithi049 bash[23528]: audit 2024-09-21T01:41:12.848357+0000 mgr.a (mgr.14388) 8946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:41:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:14 smithi049 bash[23528]: cephadm 2024-09-21T01:41:12.859860+0000 mgr.a (mgr.14388) 8947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:41:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:14 smithi049 bash[23528]: cluster 2024-09-21T01:41:13.160929+0000 mgr.a (mgr.14388) 8948 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:16 smithi044 bash[22676]: cluster 2024-09-21T01:41:15.163069+0000 mgr.a (mgr.14388) 8949 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:16 smithi179 bash[23186]: cluster 2024-09-21T01:41:15.163069+0000 mgr.a (mgr.14388) 8949 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:16 smithi049 bash[23528]: cluster 2024-09-21T01:41:15.163069+0000 mgr.a (mgr.14388) 8949 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:18.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:18.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:18.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:18 smithi179 bash[23186]: cluster 2024-09-21T01:41:17.163823+0000 mgr.a (mgr.14388) 8950 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:18 smithi049 bash[23528]: cluster 2024-09-21T01:41:17.163823+0000 mgr.a (mgr.14388) 8950 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:18.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:18 smithi044 bash[22676]: cluster 2024-09-21T01:41:17.163823+0000 mgr.a (mgr.14388) 8950 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:19.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:19.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:19.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:19.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:19.032 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:19.660 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:19 smithi049 bash[23528]: audit 2024-09-21T01:41:18.321220+0000 mon.a (mon.0) 7529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.660 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:19 smithi049 bash[23528]: audit 2024-09-21T01:41:18.327297+0000 mon.a (mon.0) 7530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.660 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:19 smithi049 bash[23528]: audit 2024-09-21T01:41:18.333446+0000 mon.a (mon.0) 7531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.660 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:19 smithi049 bash[23528]: audit 2024-09-21T01:41:18.338311+0000 mon.a (mon.0) 7532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.660 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:19 smithi049 bash[23528]: audit 2024-09-21T01:41:18.344517+0000 mon.a (mon.0) 7533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.660 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:19 smithi049 bash[23528]: audit 2024-09-21T01:41:18.352230+0000 mon.a (mon.0) 7534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.660 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:19 smithi049 bash[23528]: audit 2024-09-21T01:41:18.591451+0000 mgr.a (mgr.14388) 8951 : audit [DBG] from='client.199548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:19.708 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:19 smithi044 bash[22676]: audit 2024-09-21T01:41:18.321220+0000 mon.a (mon.0) 7529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.708 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:19 smithi044 bash[22676]: audit 2024-09-21T01:41:18.327297+0000 mon.a (mon.0) 7530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.708 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:19 smithi044 bash[22676]: audit 2024-09-21T01:41:18.333446+0000 mon.a (mon.0) 7531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.708 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:19 smithi044 bash[22676]: audit 2024-09-21T01:41:18.338311+0000 mon.a (mon.0) 7532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.708 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:19 smithi044 bash[22676]: audit 2024-09-21T01:41:18.344517+0000 mon.a (mon.0) 7533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.708 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:19 smithi044 bash[22676]: audit 2024-09-21T01:41:18.352230+0000 mon.a (mon.0) 7534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.708 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:19 smithi044 bash[22676]: audit 2024-09-21T01:41:18.591451+0000 mgr.a (mgr.14388) 8951 : audit [DBG] from='client.199548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:19 smithi179 bash[23186]: audit 2024-09-21T01:41:18.321220+0000 mon.a (mon.0) 7529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:19 smithi179 bash[23186]: audit 2024-09-21T01:41:18.327297+0000 mon.a (mon.0) 7530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:19 smithi179 bash[23186]: audit 2024-09-21T01:41:18.333446+0000 mon.a (mon.0) 7531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:19 smithi179 bash[23186]: audit 2024-09-21T01:41:18.338311+0000 mon.a (mon.0) 7532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:19 smithi179 bash[23186]: audit 2024-09-21T01:41:18.344517+0000 mon.a (mon.0) 7533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:19 smithi179 bash[23186]: audit 2024-09-21T01:41:18.352230+0000 mon.a (mon.0) 7534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:19 smithi179 bash[23186]: audit 2024-09-21T01:41:18.591451+0000 mgr.a (mgr.14388) 8951 : audit [DBG] from='client.199548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:20.673 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:20 smithi044 bash[22676]: cluster 2024-09-21T01:41:19.164636+0000 mgr.a (mgr.14388) 8952 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:20 smithi179 bash[23186]: cluster 2024-09-21T01:41:19.164636+0000 mgr.a (mgr.14388) 8952 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:20 smithi049 bash[23528]: cluster 2024-09-21T01:41:19.164636+0000 mgr.a (mgr.14388) 8952 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:22 smithi049 bash[23528]: cluster 2024-09-21T01:41:21.166900+0000 mgr.a (mgr.14388) 8953 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:22 smithi044 bash[22676]: cluster 2024-09-21T01:41:21.166900+0000 mgr.a (mgr.14388) 8953 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:22 smithi179 bash[23186]: cluster 2024-09-21T01:41:21.166900+0000 mgr.a (mgr.14388) 8953 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:24.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:24.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:24 smithi044 bash[22676]: cluster 2024-09-21T01:41:23.167664+0000 mgr.a (mgr.14388) 8954 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:24 smithi179 bash[23186]: cluster 2024-09-21T01:41:23.167664+0000 mgr.a (mgr.14388) 8954 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:24.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:24 smithi049 bash[23528]: cluster 2024-09-21T01:41:23.167664+0000 mgr.a (mgr.14388) 8954 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:24.816 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:24.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:24.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:24.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:24.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:25 smithi044 bash[22676]: audit 2024-09-21T01:41:24.368833+0000 mgr.a (mgr.14388) 8955 : audit [DBG] from='client.199626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:25 smithi044 bash[22676]: audit 2024-09-21T01:41:25.345440+0000 mon.a (mon.0) 7535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:25 smithi044 bash[22676]: audit 2024-09-21T01:41:25.354015+0000 mon.a (mon.0) 7536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:25 smithi179 bash[23186]: audit 2024-09-21T01:41:24.368833+0000 mgr.a (mgr.14388) 8955 : audit [DBG] from='client.199626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:25 smithi179 bash[23186]: audit 2024-09-21T01:41:25.345440+0000 mon.a (mon.0) 7535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:25 smithi179 bash[23186]: audit 2024-09-21T01:41:25.354015+0000 mon.a (mon.0) 7536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:25 smithi049 bash[23528]: audit 2024-09-21T01:41:24.368833+0000 mgr.a (mgr.14388) 8955 : audit [DBG] from='client.199626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:25 smithi049 bash[23528]: audit 2024-09-21T01:41:25.345440+0000 mon.a (mon.0) 7535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:25 smithi049 bash[23528]: audit 2024-09-21T01:41:25.354015+0000 mon.a (mon.0) 7536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:26 smithi044 bash[22676]: cluster 2024-09-21T01:41:25.169964+0000 mgr.a (mgr.14388) 8956 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:26 smithi044 bash[22676]: audit 2024-09-21T01:41:25.364521+0000 mon.a (mon.0) 7537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:26 smithi179 bash[23186]: cluster 2024-09-21T01:41:25.169964+0000 mgr.a (mgr.14388) 8956 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:26 smithi179 bash[23186]: audit 2024-09-21T01:41:25.364521+0000 mon.a (mon.0) 7537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:26 smithi049 bash[23528]: cluster 2024-09-21T01:41:25.169964+0000 mgr.a (mgr.14388) 8956 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:41:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:26 smithi049 bash[23528]: audit 2024-09-21T01:41:25.364521+0000 mon.a (mon.0) 7537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:28 smithi044 bash[22676]: cluster 2024-09-21T01:41:27.170699+0000 mgr.a (mgr.14388) 8957 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:28 smithi179 bash[23186]: cluster 2024-09-21T01:41:27.170699+0000 mgr.a (mgr.14388) 8957 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:28 smithi049 bash[23528]: cluster 2024-09-21T01:41:27.170699+0000 mgr.a (mgr.14388) 8957 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:29.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:29.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:29.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:30.603 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:30 smithi044 bash[22676]: cluster 2024-09-21T01:41:29.171453+0000 mgr.a (mgr.14388) 8958 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:30 smithi179 bash[23186]: cluster 2024-09-21T01:41:29.171453+0000 mgr.a (mgr.14388) 8958 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:30.908 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:30 smithi049 bash[23528]: cluster 2024-09-21T01:41:29.171453+0000 mgr.a (mgr.14388) 8958 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:31 smithi044 bash[22676]: audit 2024-09-21T01:41:30.154667+0000 mgr.a (mgr.14388) 8959 : audit [DBG] from='client.199704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:31 smithi179 bash[23186]: audit 2024-09-21T01:41:30.154667+0000 mgr.a (mgr.14388) 8959 : audit [DBG] from='client.199704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:31 smithi049 bash[23528]: audit 2024-09-21T01:41:30.154667+0000 mgr.a (mgr.14388) 8959 : audit [DBG] from='client.199704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:32 smithi044 bash[22676]: cluster 2024-09-21T01:41:31.174304+0000 mgr.a (mgr.14388) 8960 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:32 smithi179 bash[23186]: cluster 2024-09-21T01:41:31.174304+0000 mgr.a (mgr.14388) 8960 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:32 smithi049 bash[23528]: cluster 2024-09-21T01:41:31.174304+0000 mgr.a (mgr.14388) 8960 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:34 smithi179 bash[23186]: cluster 2024-09-21T01:41:33.175103+0000 mgr.a (mgr.14388) 8961 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:41:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:34 smithi044 bash[22676]: cluster 2024-09-21T01:41:33.175103+0000 mgr.a (mgr.14388) 8961 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:41:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:34 smithi049 bash[23528]: cluster 2024-09-21T01:41:33.175103+0000 mgr.a (mgr.14388) 8961 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:41:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:35.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:35.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:36.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:36 smithi044 bash[22676]: cluster 2024-09-21T01:41:35.177014+0000 mgr.a (mgr.14388) 8962 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:36 smithi179 bash[23186]: cluster 2024-09-21T01:41:35.177014+0000 mgr.a (mgr.14388) 8962 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:36 smithi049 bash[23528]: cluster 2024-09-21T01:41:35.177014+0000 mgr.a (mgr.14388) 8962 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:37.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:37 smithi179 bash[23186]: audit 2024-09-21T01:41:35.937753+0000 mgr.a (mgr.14388) 8963 : audit [DBG] from='client.199779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:37 smithi044 bash[22676]: audit 2024-09-21T01:41:35.937753+0000 mgr.a (mgr.14388) 8963 : audit [DBG] from='client.199779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:37 smithi049 bash[23528]: audit 2024-09-21T01:41:35.937753+0000 mgr.a (mgr.14388) 8963 : audit [DBG] from='client.199779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:38 smithi044 bash[22676]: cluster 2024-09-21T01:41:37.178048+0000 mgr.a (mgr.14388) 8964 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:41:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:38 smithi179 bash[23186]: cluster 2024-09-21T01:41:37.178048+0000 mgr.a (mgr.14388) 8964 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:41:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:38 smithi049 bash[23528]: cluster 2024-09-21T01:41:37.178048+0000 mgr.a (mgr.14388) 8964 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:41:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:39 smithi049 bash[23528]: audit 2024-09-21T01:41:38.550056+0000 mon.a (mon.0) 7538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:39 smithi049 bash[23528]: audit 2024-09-21T01:41:38.555814+0000 mon.a (mon.0) 7539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:39 smithi049 bash[23528]: audit 2024-09-21T01:41:38.562328+0000 mon.a (mon.0) 7540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:39 smithi049 bash[23528]: audit 2024-09-21T01:41:38.576729+0000 mon.a (mon.0) 7541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:39 smithi049 bash[23528]: audit 2024-09-21T01:41:38.583906+0000 mon.a (mon.0) 7542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:39 smithi049 bash[23528]: audit 2024-09-21T01:41:38.593804+0000 mon.a (mon.0) 7543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:39 smithi044 bash[22676]: audit 2024-09-21T01:41:38.550056+0000 mon.a (mon.0) 7538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:39 smithi044 bash[22676]: audit 2024-09-21T01:41:38.555814+0000 mon.a (mon.0) 7539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:39 smithi044 bash[22676]: audit 2024-09-21T01:41:38.562328+0000 mon.a (mon.0) 7540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:39 smithi044 bash[22676]: audit 2024-09-21T01:41:38.576729+0000 mon.a (mon.0) 7541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:39 smithi044 bash[22676]: audit 2024-09-21T01:41:38.583906+0000 mon.a (mon.0) 7542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:39 smithi044 bash[22676]: audit 2024-09-21T01:41:38.593804+0000 mon.a (mon.0) 7543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:39 smithi179 bash[23186]: audit 2024-09-21T01:41:38.550056+0000 mon.a (mon.0) 7538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:39 smithi179 bash[23186]: audit 2024-09-21T01:41:38.555814+0000 mon.a (mon.0) 7539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:39 smithi179 bash[23186]: audit 2024-09-21T01:41:38.562328+0000 mon.a (mon.0) 7540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:39 smithi179 bash[23186]: audit 2024-09-21T01:41:38.576729+0000 mon.a (mon.0) 7541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:39 smithi179 bash[23186]: audit 2024-09-21T01:41:38.583906+0000 mon.a (mon.0) 7542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:39 smithi179 bash[23186]: audit 2024-09-21T01:41:38.593804+0000 mon.a (mon.0) 7543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:40 smithi044 bash[22676]: cluster 2024-09-21T01:41:39.178932+0000 mgr.a (mgr.14388) 8965 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:40 smithi049 bash[23528]: cluster 2024-09-21T01:41:39.178932+0000 mgr.a (mgr.14388) 8965 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:40 smithi179 bash[23186]: cluster 2024-09-21T01:41:39.178932+0000 mgr.a (mgr.14388) 8965 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:41:41.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:41.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:42.126 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:42.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:42.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:42.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:42.958 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:42 smithi044 bash[22676]: cluster 2024-09-21T01:41:41.181186+0000 mgr.a (mgr.14388) 8966 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:42 smithi179 bash[23186]: cluster 2024-09-21T01:41:41.181186+0000 mgr.a (mgr.14388) 8966 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:42 smithi049 bash[23528]: cluster 2024-09-21T01:41:41.181186+0000 mgr.a (mgr.14388) 8966 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:43 smithi044 bash[22676]: audit 2024-09-21T01:41:41.691600+0000 mgr.a (mgr.14388) 8967 : audit [DBG] from='client.199857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:43 smithi179 bash[23186]: audit 2024-09-21T01:41:41.691600+0000 mgr.a (mgr.14388) 8967 : audit [DBG] from='client.199857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:43 smithi049 bash[23528]: audit 2024-09-21T01:41:41.691600+0000 mgr.a (mgr.14388) 8967 : audit [DBG] from='client.199857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:44 smithi044 bash[22676]: cluster 2024-09-21T01:41:43.182379+0000 mgr.a (mgr.14388) 8968 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:44 smithi179 bash[23186]: cluster 2024-09-21T01:41:43.182379+0000 mgr.a (mgr.14388) 8968 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:44 smithi049 bash[23528]: cluster 2024-09-21T01:41:43.182379+0000 mgr.a (mgr.14388) 8968 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:46 smithi044 bash[22676]: cluster 2024-09-21T01:41:45.184596+0000 mgr.a (mgr.14388) 8969 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:46 smithi044 bash[22676]: audit 2024-09-21T01:41:45.586395+0000 mon.a (mon.0) 7544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:46 smithi044 bash[22676]: audit 2024-09-21T01:41:45.595021+0000 mon.a (mon.0) 7545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:46 smithi044 bash[22676]: audit 2024-09-21T01:41:45.605767+0000 mon.a (mon.0) 7546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:46 smithi179 bash[23186]: cluster 2024-09-21T01:41:45.184596+0000 mgr.a (mgr.14388) 8969 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:46 smithi179 bash[23186]: audit 2024-09-21T01:41:45.586395+0000 mon.a (mon.0) 7544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:46 smithi179 bash[23186]: audit 2024-09-21T01:41:45.595021+0000 mon.a (mon.0) 7545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:46 smithi179 bash[23186]: audit 2024-09-21T01:41:45.605767+0000 mon.a (mon.0) 7546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:46 smithi049 bash[23528]: cluster 2024-09-21T01:41:45.184596+0000 mgr.a (mgr.14388) 8969 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:46 smithi049 bash[23528]: audit 2024-09-21T01:41:45.586395+0000 mon.a (mon.0) 7544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:46 smithi049 bash[23528]: audit 2024-09-21T01:41:45.595021+0000 mon.a (mon.0) 7545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:46 smithi049 bash[23528]: audit 2024-09-21T01:41:45.605767+0000 mon.a (mon.0) 7546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:41:47.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:47.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:47.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:47.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:47.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:47.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:47.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:47.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:48 smithi044 bash[22676]: cluster 2024-09-21T01:41:47.185288+0000 mgr.a (mgr.14388) 8970 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:48 smithi044 bash[22676]: audit 2024-09-21T01:41:47.470781+0000 mgr.a (mgr.14388) 8971 : audit [DBG] from='client.199935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:48 smithi179 bash[23186]: cluster 2024-09-21T01:41:47.185288+0000 mgr.a (mgr.14388) 8970 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:48 smithi179 bash[23186]: audit 2024-09-21T01:41:47.470781+0000 mgr.a (mgr.14388) 8971 : audit [DBG] from='client.199935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:48 smithi049 bash[23528]: cluster 2024-09-21T01:41:47.185288+0000 mgr.a (mgr.14388) 8970 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:48 smithi049 bash[23528]: audit 2024-09-21T01:41:47.470781+0000 mgr.a (mgr.14388) 8971 : audit [DBG] from='client.199935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:50 smithi044 bash[22676]: cluster 2024-09-21T01:41:49.186322+0000 mgr.a (mgr.14388) 8972 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:50 smithi179 bash[23186]: cluster 2024-09-21T01:41:49.186322+0000 mgr.a (mgr.14388) 8972 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:50 smithi049 bash[23528]: cluster 2024-09-21T01:41:49.186322+0000 mgr.a (mgr.14388) 8972 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:52.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:52.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:52.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:52 smithi044 bash[22676]: cluster 2024-09-21T01:41:51.188510+0000 mgr.a (mgr.14388) 8973 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:52 smithi179 bash[23186]: cluster 2024-09-21T01:41:51.188510+0000 mgr.a (mgr.14388) 8973 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:52 smithi049 bash[23528]: cluster 2024-09-21T01:41:51.188510+0000 mgr.a (mgr.14388) 8973 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:53.726 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:53.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:53.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:53.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:53.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:41:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:54 smithi179 bash[23186]: cluster 2024-09-21T01:41:53.189270+0000 mgr.a (mgr.14388) 8974 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:54 smithi179 bash[23186]: audit 2024-09-21T01:41:53.279260+0000 mgr.a (mgr.14388) 8975 : audit [DBG] from='client.200010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:54 smithi044 bash[22676]: cluster 2024-09-21T01:41:53.189270+0000 mgr.a (mgr.14388) 8974 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:54 smithi044 bash[22676]: audit 2024-09-21T01:41:53.279260+0000 mgr.a (mgr.14388) 8975 : audit [DBG] from='client.200010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:54 smithi049 bash[23528]: cluster 2024-09-21T01:41:53.189270+0000 mgr.a (mgr.14388) 8974 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:54 smithi049 bash[23528]: audit 2024-09-21T01:41:53.279260+0000 mgr.a (mgr.14388) 8975 : audit [DBG] from='client.200010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:56 smithi044 bash[22676]: cluster 2024-09-21T01:41:55.191537+0000 mgr.a (mgr.14388) 8976 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:56 smithi179 bash[23186]: cluster 2024-09-21T01:41:55.191537+0000 mgr.a (mgr.14388) 8976 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:56 smithi049 bash[23528]: cluster 2024-09-21T01:41:55.191537+0000 mgr.a (mgr.14388) 8976 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:41:58.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:41:58.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:41:58.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:41:58.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:58 smithi044 bash[22676]: cluster 2024-09-21T01:41:57.192344+0000 mgr.a (mgr.14388) 8977 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:58 smithi179 bash[23186]: cluster 2024-09-21T01:41:57.192344+0000 mgr.a (mgr.14388) 8977 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:58 smithi049 bash[23528]: cluster 2024-09-21T01:41:57.192344+0000 mgr.a (mgr.14388) 8977 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:41:59.523 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:41:59.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:41:59.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:41:59.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:41:59.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: audit 2024-09-21T01:41:58.752993+0000 mon.a (mon.0) 7547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: audit 2024-09-21T01:41:58.770439+0000 mon.a (mon.0) 7548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: audit 2024-09-21T01:41:58.777541+0000 mon.a (mon.0) 7549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: audit 2024-09-21T01:41:58.782890+0000 mon.a (mon.0) 7550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: audit 2024-09-21T01:41:58.788450+0000 mon.a (mon.0) 7551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: audit 2024-09-21T01:41:58.795816+0000 mon.a (mon.0) 7552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: audit 2024-09-21T01:41:59.070400+0000 mgr.a (mgr.14388) 8978 : audit [DBG] from='client.200088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:41:59 smithi179 bash[23186]: cluster 2024-09-21T01:41:59.193170+0000 mgr.a (mgr.14388) 8979 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: audit 2024-09-21T01:41:58.752993+0000 mon.a (mon.0) 7547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: audit 2024-09-21T01:41:58.770439+0000 mon.a (mon.0) 7548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: audit 2024-09-21T01:41:58.777541+0000 mon.a (mon.0) 7549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: audit 2024-09-21T01:41:58.782890+0000 mon.a (mon.0) 7550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: audit 2024-09-21T01:41:58.788450+0000 mon.a (mon.0) 7551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: audit 2024-09-21T01:41:58.795816+0000 mon.a (mon.0) 7552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: audit 2024-09-21T01:41:59.070400+0000 mgr.a (mgr.14388) 8978 : audit [DBG] from='client.200088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:41:59 smithi049 bash[23528]: cluster 2024-09-21T01:41:59.193170+0000 mgr.a (mgr.14388) 8979 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: audit 2024-09-21T01:41:58.752993+0000 mon.a (mon.0) 7547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: audit 2024-09-21T01:41:58.770439+0000 mon.a (mon.0) 7548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: audit 2024-09-21T01:41:58.777541+0000 mon.a (mon.0) 7549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: audit 2024-09-21T01:41:58.782890+0000 mon.a (mon.0) 7550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: audit 2024-09-21T01:41:58.788450+0000 mon.a (mon.0) 7551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: audit 2024-09-21T01:41:58.795816+0000 mon.a (mon.0) 7552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: audit 2024-09-21T01:41:59.070400+0000 mgr.a (mgr.14388) 8978 : audit [DBG] from='client.200088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:41:59 smithi044 bash[22676]: cluster 2024-09-21T01:41:59.193170+0000 mgr.a (mgr.14388) 8979 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:02 smithi179 bash[23186]: cluster 2024-09-21T01:42:01.195541+0000 mgr.a (mgr.14388) 8980 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:02 smithi049 bash[23528]: cluster 2024-09-21T01:42:01.195541+0000 mgr.a (mgr.14388) 8980 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:02 smithi044 bash[22676]: cluster 2024-09-21T01:42:01.195541+0000 mgr.a (mgr.14388) 8980 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:04.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:04.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:04 smithi049 bash[23528]: cluster 2024-09-21T01:42:03.196245+0000 mgr.a (mgr.14388) 8981 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:04.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:04 smithi044 bash[22676]: cluster 2024-09-21T01:42:03.196245+0000 mgr.a (mgr.14388) 8981 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:04 smithi179 bash[23186]: cluster 2024-09-21T01:42:03.196245+0000 mgr.a (mgr.14388) 8981 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:05.270 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:05.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:05.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:05.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:05.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:06 smithi049 bash[23528]: audit 2024-09-21T01:42:04.860248+0000 mgr.a (mgr.14388) 8982 : audit [DBG] from='client.200166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:06 smithi049 bash[23528]: cluster 2024-09-21T01:42:05.197538+0000 mgr.a (mgr.14388) 8983 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:06 smithi049 bash[23528]: audit 2024-09-21T01:42:05.820280+0000 mon.a (mon.0) 7553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:06 smithi049 bash[23528]: audit 2024-09-21T01:42:05.828938+0000 mon.a (mon.0) 7554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:06 smithi049 bash[23528]: audit 2024-09-21T01:42:05.839675+0000 mon.a (mon.0) 7555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:06 smithi044 bash[22676]: audit 2024-09-21T01:42:04.860248+0000 mgr.a (mgr.14388) 8982 : audit [DBG] from='client.200166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:06 smithi044 bash[22676]: cluster 2024-09-21T01:42:05.197538+0000 mgr.a (mgr.14388) 8983 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:06 smithi044 bash[22676]: audit 2024-09-21T01:42:05.820280+0000 mon.a (mon.0) 7553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:06 smithi044 bash[22676]: audit 2024-09-21T01:42:05.828938+0000 mon.a (mon.0) 7554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:06 smithi044 bash[22676]: audit 2024-09-21T01:42:05.839675+0000 mon.a (mon.0) 7555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:06 smithi179 bash[23186]: audit 2024-09-21T01:42:04.860248+0000 mgr.a (mgr.14388) 8982 : audit [DBG] from='client.200166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:06 smithi179 bash[23186]: cluster 2024-09-21T01:42:05.197538+0000 mgr.a (mgr.14388) 8983 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:06 smithi179 bash[23186]: audit 2024-09-21T01:42:05.820280+0000 mon.a (mon.0) 7553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:06 smithi179 bash[23186]: audit 2024-09-21T01:42:05.828938+0000 mon.a (mon.0) 7554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:06 smithi179 bash[23186]: audit 2024-09-21T01:42:05.839675+0000 mon.a (mon.0) 7555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:08 smithi049 bash[23528]: cluster 2024-09-21T01:42:07.198304+0000 mgr.a (mgr.14388) 8984 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:08 smithi044 bash[22676]: cluster 2024-09-21T01:42:07.198304+0000 mgr.a (mgr.14388) 8984 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:08 smithi179 bash[23186]: cluster 2024-09-21T01:42:07.198304+0000 mgr.a (mgr.14388) 8984 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:10.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:10.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:10 smithi049 bash[23528]: cluster 2024-09-21T01:42:09.199092+0000 mgr.a (mgr.14388) 8985 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:10.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:10 smithi044 bash[22676]: cluster 2024-09-21T01:42:09.199092+0000 mgr.a (mgr.14388) 8985 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:10 smithi179 bash[23186]: cluster 2024-09-21T01:42:09.199092+0000 mgr.a (mgr.14388) 8985 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:11.033 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:11.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:11.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:11.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:11.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:11 smithi049 bash[23528]: audit 2024-09-21T01:42:10.604395+0000 mgr.a (mgr.14388) 8986 : audit [DBG] from='client.200244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:11 smithi044 bash[22676]: audit 2024-09-21T01:42:10.604395+0000 mgr.a (mgr.14388) 8986 : audit [DBG] from='client.200244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:11 smithi179 bash[23186]: audit 2024-09-21T01:42:10.604395+0000 mgr.a (mgr.14388) 8986 : audit [DBG] from='client.200244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:12 smithi049 bash[23528]: cluster 2024-09-21T01:42:11.201916+0000 mgr.a (mgr.14388) 8987 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:12 smithi044 bash[22676]: cluster 2024-09-21T01:42:11.201916+0000 mgr.a (mgr.14388) 8987 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:12 smithi179 bash[23186]: cluster 2024-09-21T01:42:11.201916+0000 mgr.a (mgr.14388) 8987 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:13 smithi049 bash[23528]: audit 2024-09-21T01:42:12.928925+0000 mon.a (mon.0) 7556 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:42:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:13 smithi049 bash[23528]: audit 2024-09-21T01:42:12.936412+0000 mon.a (mon.0) 7557 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:42:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:13 smithi049 bash[23528]: audit 2024-09-21T01:42:12.938406+0000 mon.a (mon.0) 7558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:42:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:13 smithi049 bash[23528]: audit 2024-09-21T01:42:12.950015+0000 mon.a (mon.0) 7559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:13 smithi049 bash[23528]: audit 2024-09-21T01:42:12.956467+0000 mon.a (mon.0) 7560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:42:13.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:13 smithi044 bash[22676]: audit 2024-09-21T01:42:12.928925+0000 mon.a (mon.0) 7556 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:42:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:13 smithi044 bash[22676]: audit 2024-09-21T01:42:12.936412+0000 mon.a (mon.0) 7557 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:42:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:13 smithi044 bash[22676]: audit 2024-09-21T01:42:12.938406+0000 mon.a (mon.0) 7558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:42:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:13 smithi044 bash[22676]: audit 2024-09-21T01:42:12.950015+0000 mon.a (mon.0) 7559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:13 smithi044 bash[22676]: audit 2024-09-21T01:42:12.956467+0000 mon.a (mon.0) 7560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:13 smithi179 bash[23186]: audit 2024-09-21T01:42:12.928925+0000 mon.a (mon.0) 7556 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:13 smithi179 bash[23186]: audit 2024-09-21T01:42:12.936412+0000 mon.a (mon.0) 7557 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:13 smithi179 bash[23186]: audit 2024-09-21T01:42:12.938406+0000 mon.a (mon.0) 7558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:13 smithi179 bash[23186]: audit 2024-09-21T01:42:12.950015+0000 mon.a (mon.0) 7559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:13 smithi179 bash[23186]: audit 2024-09-21T01:42:12.956467+0000 mon.a (mon.0) 7560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:42:14.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:42:13 smithi044 bash[22930]: debug 2024-09-21T01:42:13.742+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:42:14.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:42:13 smithi044 bash[22930]: debug 2024-09-21T01:42:13.742+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:42:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:14 smithi049 bash[23528]: audit 2024-09-21T01:42:12.959093+0000 mgr.a (mgr.14388) 8988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:42:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:14 smithi049 bash[23528]: cluster 2024-09-21T01:42:13.202558+0000 mgr.a (mgr.14388) 8989 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:14 smithi044 bash[22676]: audit 2024-09-21T01:42:12.959093+0000 mgr.a (mgr.14388) 8988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:42:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:14 smithi044 bash[22676]: cluster 2024-09-21T01:42:13.202558+0000 mgr.a (mgr.14388) 8989 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:14 smithi179 bash[23186]: audit 2024-09-21T01:42:12.959093+0000 mgr.a (mgr.14388) 8988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:42:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:14 smithi179 bash[23186]: cluster 2024-09-21T01:42:13.202558+0000 mgr.a (mgr.14388) 8989 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:15 smithi049 bash[23528]: audit 2024-09-21T01:42:13.745519+0000 mgr.a (mgr.14388) 8990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:42:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:15 smithi049 bash[23528]: cephadm 2024-09-21T01:42:13.746725+0000 mgr.a (mgr.14388) 8991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:42:15.686 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:15 smithi179 bash[23186]: audit 2024-09-21T01:42:13.745519+0000 mgr.a (mgr.14388) 8990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:42:15.686 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:15 smithi179 bash[23186]: cephadm 2024-09-21T01:42:13.746725+0000 mgr.a (mgr.14388) 8991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:42:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:15 smithi044 bash[22676]: audit 2024-09-21T01:42:13.745519+0000 mgr.a (mgr.14388) 8990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:42:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:15 smithi044 bash[22676]: cephadm 2024-09-21T01:42:13.746725+0000 mgr.a (mgr.14388) 8991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:42:16.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:16.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:16.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:16 smithi049 bash[23528]: cluster 2024-09-21T01:42:15.204820+0000 mgr.a (mgr.14388) 8992 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:16.644 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:16 smithi179 bash[23186]: cluster 2024-09-21T01:42:15.204820+0000 mgr.a (mgr.14388) 8992 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:16.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:16 smithi044 bash[22676]: cluster 2024-09-21T01:42:15.204820+0000 mgr.a (mgr.14388) 8992 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:16.792 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:16.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:16.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:16.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:16.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:17 smithi049 bash[23528]: audit 2024-09-21T01:42:16.368302+0000 mgr.a (mgr.14388) 8993 : audit [DBG] from='client.200427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:17.604 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:17 smithi179 bash[23186]: audit 2024-09-21T01:42:16.368302+0000 mgr.a (mgr.14388) 8993 : audit [DBG] from='client.200427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:17 smithi044 bash[22676]: audit 2024-09-21T01:42:16.368302+0000 mgr.a (mgr.14388) 8993 : audit [DBG] from='client.200427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:18.343 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:18 smithi179 bash[23186]: cluster 2024-09-21T01:42:17.205822+0000 mgr.a (mgr.14388) 8994 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:18 smithi044 bash[22676]: cluster 2024-09-21T01:42:17.205822+0000 mgr.a (mgr.14388) 8994 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:18 smithi049 bash[23528]: cluster 2024-09-21T01:42:17.205822+0000 mgr.a (mgr.14388) 8994 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:19 smithi044 bash[22676]: audit 2024-09-21T01:42:18.963384+0000 mon.a (mon.0) 7561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:19 smithi044 bash[22676]: audit 2024-09-21T01:42:18.974426+0000 mon.a (mon.0) 7562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:19 smithi044 bash[22676]: audit 2024-09-21T01:42:18.987545+0000 mon.a (mon.0) 7563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:19 smithi044 bash[22676]: audit 2024-09-21T01:42:19.024110+0000 mon.a (mon.0) 7564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:19 smithi044 bash[22676]: audit 2024-09-21T01:42:19.032270+0000 mon.a (mon.0) 7565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:19 smithi044 bash[22676]: audit 2024-09-21T01:42:19.042201+0000 mon.a (mon.0) 7566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:19 smithi044 bash[22676]: cluster 2024-09-21T01:42:19.206788+0000 mgr.a (mgr.14388) 8995 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:19 smithi179 bash[23186]: audit 2024-09-21T01:42:18.963384+0000 mon.a (mon.0) 7561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:19 smithi179 bash[23186]: audit 2024-09-21T01:42:18.974426+0000 mon.a (mon.0) 7562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:19 smithi179 bash[23186]: audit 2024-09-21T01:42:18.987545+0000 mon.a (mon.0) 7563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:19 smithi179 bash[23186]: audit 2024-09-21T01:42:19.024110+0000 mon.a (mon.0) 7564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:19 smithi179 bash[23186]: audit 2024-09-21T01:42:19.032270+0000 mon.a (mon.0) 7565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:19 smithi179 bash[23186]: audit 2024-09-21T01:42:19.042201+0000 mon.a (mon.0) 7566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:19 smithi179 bash[23186]: cluster 2024-09-21T01:42:19.206788+0000 mgr.a (mgr.14388) 8995 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:19 smithi049 bash[23528]: audit 2024-09-21T01:42:18.963384+0000 mon.a (mon.0) 7561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:19 smithi049 bash[23528]: audit 2024-09-21T01:42:18.974426+0000 mon.a (mon.0) 7562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:19 smithi049 bash[23528]: audit 2024-09-21T01:42:18.987545+0000 mon.a (mon.0) 7563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:19 smithi049 bash[23528]: audit 2024-09-21T01:42:19.024110+0000 mon.a (mon.0) 7564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:19 smithi049 bash[23528]: audit 2024-09-21T01:42:19.032270+0000 mon.a (mon.0) 7565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:19 smithi049 bash[23528]: audit 2024-09-21T01:42:19.042201+0000 mon.a (mon.0) 7566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:19 smithi049 bash[23528]: cluster 2024-09-21T01:42:19.206788+0000 mgr.a (mgr.14388) 8995 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:21.794 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:22 smithi049 bash[23528]: cluster 2024-09-21T01:42:21.208014+0000 mgr.a (mgr.14388) 8996 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:22.570 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:22.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:22 smithi044 bash[22676]: cluster 2024-09-21T01:42:21.208014+0000 mgr.a (mgr.14388) 8996 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:22 smithi179 bash[23186]: cluster 2024-09-21T01:42:21.208014+0000 mgr.a (mgr.14388) 8996 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:23 smithi049 bash[23528]: audit 2024-09-21T01:42:22.127783+0000 mgr.a (mgr.14388) 8997 : audit [DBG] from='client.200505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:23.597 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:23 smithi044 bash[22676]: audit 2024-09-21T01:42:22.127783+0000 mgr.a (mgr.14388) 8997 : audit [DBG] from='client.200505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:23 smithi179 bash[23186]: audit 2024-09-21T01:42:22.127783+0000 mgr.a (mgr.14388) 8997 : audit [DBG] from='client.200505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:24 smithi049 bash[23528]: cluster 2024-09-21T01:42:23.208902+0000 mgr.a (mgr.14388) 8998 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:24 smithi044 bash[22676]: cluster 2024-09-21T01:42:23.208902+0000 mgr.a (mgr.14388) 8998 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:24 smithi179 bash[23186]: cluster 2024-09-21T01:42:23.208902+0000 mgr.a (mgr.14388) 8998 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:26 smithi049 bash[23528]: cluster 2024-09-21T01:42:25.211066+0000 mgr.a (mgr.14388) 8999 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:26 smithi049 bash[23528]: audit 2024-09-21T01:42:25.998032+0000 mon.a (mon.0) 7567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:26 smithi049 bash[23528]: audit 2024-09-21T01:42:26.006861+0000 mon.a (mon.0) 7568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:26 smithi049 bash[23528]: audit 2024-09-21T01:42:26.017233+0000 mon.a (mon.0) 7569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:26 smithi044 bash[22676]: cluster 2024-09-21T01:42:25.211066+0000 mgr.a (mgr.14388) 8999 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:26 smithi044 bash[22676]: audit 2024-09-21T01:42:25.998032+0000 mon.a (mon.0) 7567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:26 smithi044 bash[22676]: audit 2024-09-21T01:42:26.006861+0000 mon.a (mon.0) 7568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:26 smithi044 bash[22676]: audit 2024-09-21T01:42:26.017233+0000 mon.a (mon.0) 7569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:26 smithi179 bash[23186]: cluster 2024-09-21T01:42:25.211066+0000 mgr.a (mgr.14388) 8999 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:42:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:26 smithi179 bash[23186]: audit 2024-09-21T01:42:25.998032+0000 mon.a (mon.0) 7567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:26 smithi179 bash[23186]: audit 2024-09-21T01:42:26.006861+0000 mon.a (mon.0) 7568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:26 smithi179 bash[23186]: audit 2024-09-21T01:42:26.017233+0000 mon.a (mon.0) 7569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:27.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:28.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:28.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:28 smithi049 bash[23528]: cluster 2024-09-21T01:42:27.211868+0000 mgr.a (mgr.14388) 9000 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:28 smithi044 bash[22676]: cluster 2024-09-21T01:42:27.211868+0000 mgr.a (mgr.14388) 9000 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:28 smithi179 bash[23186]: cluster 2024-09-21T01:42:27.211868+0000 mgr.a (mgr.14388) 9000 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:29 smithi049 bash[23528]: audit 2024-09-21T01:42:27.910898+0000 mgr.a (mgr.14388) 9001 : audit [DBG] from='client.200583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:29 smithi044 bash[22676]: audit 2024-09-21T01:42:27.910898+0000 mgr.a (mgr.14388) 9001 : audit [DBG] from='client.200583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:29.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:29 smithi179 bash[23186]: audit 2024-09-21T01:42:27.910898+0000 mgr.a (mgr.14388) 9001 : audit [DBG] from='client.200583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:30 smithi049 bash[23528]: cluster 2024-09-21T01:42:29.212822+0000 mgr.a (mgr.14388) 9002 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:30 smithi044 bash[22676]: cluster 2024-09-21T01:42:29.212822+0000 mgr.a (mgr.14388) 9002 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:30 smithi179 bash[23186]: cluster 2024-09-21T01:42:29.212822+0000 mgr.a (mgr.14388) 9002 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:32 smithi049 bash[23528]: cluster 2024-09-21T01:42:31.215084+0000 mgr.a (mgr.14388) 9003 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:32 smithi044 bash[22676]: cluster 2024-09-21T01:42:31.215084+0000 mgr.a (mgr.14388) 9003 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:32.975 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:32 smithi179 bash[23186]: cluster 2024-09-21T01:42:31.215084+0000 mgr.a (mgr.14388) 9003 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:33.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:33.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:33.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:34.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:34.102 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:34 smithi049 bash[23528]: cluster 2024-09-21T01:42:33.215844+0000 mgr.a (mgr.14388) 9004 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:34 smithi049 bash[23528]: audit 2024-09-21T01:42:33.662337+0000 mgr.a (mgr.14388) 9005 : audit [DBG] from='client.200661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:34 smithi044 bash[22676]: cluster 2024-09-21T01:42:33.215844+0000 mgr.a (mgr.14388) 9004 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:34 smithi044 bash[22676]: audit 2024-09-21T01:42:33.662337+0000 mgr.a (mgr.14388) 9005 : audit [DBG] from='client.200661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:34 smithi179 bash[23186]: cluster 2024-09-21T01:42:33.215844+0000 mgr.a (mgr.14388) 9004 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:34 smithi179 bash[23186]: audit 2024-09-21T01:42:33.662337+0000 mgr.a (mgr.14388) 9005 : audit [DBG] from='client.200661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:36.411 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:36 smithi179 bash[23186]: cluster 2024-09-21T01:42:35.218341+0000 mgr.a (mgr.14388) 9006 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:36 smithi044 bash[22676]: cluster 2024-09-21T01:42:35.218341+0000 mgr.a (mgr.14388) 9006 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:36 smithi049 bash[23528]: cluster 2024-09-21T01:42:35.218341+0000 mgr.a (mgr.14388) 9006 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:38.571 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:38 smithi179 bash[23186]: cluster 2024-09-21T01:42:37.219364+0000 mgr.a (mgr.14388) 9007 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:38.643 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:38 smithi044 bash[22676]: cluster 2024-09-21T01:42:37.219364+0000 mgr.a (mgr.14388) 9007 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:38 smithi049 bash[23528]: cluster 2024-09-21T01:42:37.219364+0000 mgr.a (mgr.14388) 9007 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:39.894 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:39.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:39.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:39.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: audit 2024-09-21T01:42:39.152673+0000 mon.a (mon.0) 7570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: audit 2024-09-21T01:42:39.160526+0000 mon.a (mon.0) 7571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: audit 2024-09-21T01:42:39.172264+0000 mon.a (mon.0) 7572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: cluster 2024-09-21T01:42:39.219863+0000 mgr.a (mgr.14388) 9008 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: audit 2024-09-21T01:42:39.232771+0000 mon.a (mon.0) 7573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: audit 2024-09-21T01:42:39.239472+0000 mon.a (mon.0) 7574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: audit 2024-09-21T01:42:39.247558+0000 mon.a (mon.0) 7575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:40 smithi044 bash[22676]: audit 2024-09-21T01:42:39.446133+0000 mgr.a (mgr.14388) 9009 : audit [DBG] from='client.200739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: audit 2024-09-21T01:42:39.152673+0000 mon.a (mon.0) 7570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: audit 2024-09-21T01:42:39.160526+0000 mon.a (mon.0) 7571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: audit 2024-09-21T01:42:39.172264+0000 mon.a (mon.0) 7572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: cluster 2024-09-21T01:42:39.219863+0000 mgr.a (mgr.14388) 9008 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: audit 2024-09-21T01:42:39.232771+0000 mon.a (mon.0) 7573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: audit 2024-09-21T01:42:39.239472+0000 mon.a (mon.0) 7574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: audit 2024-09-21T01:42:39.247558+0000 mon.a (mon.0) 7575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:40 smithi179 bash[23186]: audit 2024-09-21T01:42:39.446133+0000 mgr.a (mgr.14388) 9009 : audit [DBG] from='client.200739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: audit 2024-09-21T01:42:39.152673+0000 mon.a (mon.0) 7570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: audit 2024-09-21T01:42:39.160526+0000 mon.a (mon.0) 7571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: audit 2024-09-21T01:42:39.172264+0000 mon.a (mon.0) 7572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: cluster 2024-09-21T01:42:39.219863+0000 mgr.a (mgr.14388) 9008 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: audit 2024-09-21T01:42:39.232771+0000 mon.a (mon.0) 7573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: audit 2024-09-21T01:42:39.239472+0000 mon.a (mon.0) 7574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: audit 2024-09-21T01:42:39.247558+0000 mon.a (mon.0) 7575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:40.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:40 smithi049 bash[23528]: audit 2024-09-21T01:42:39.446133+0000 mgr.a (mgr.14388) 9009 : audit [DBG] from='client.200739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:42 smithi049 bash[23528]: cluster 2024-09-21T01:42:41.222177+0000 mgr.a (mgr.14388) 9010 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:42 smithi044 bash[22676]: cluster 2024-09-21T01:42:41.222177+0000 mgr.a (mgr.14388) 9010 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:42 smithi179 bash[23186]: cluster 2024-09-21T01:42:41.222177+0000 mgr.a (mgr.14388) 9010 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:42:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:44 smithi049 bash[23528]: cluster 2024-09-21T01:42:43.223005+0000 mgr.a (mgr.14388) 9011 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:44 smithi044 bash[22676]: cluster 2024-09-21T01:42:43.223005+0000 mgr.a (mgr.14388) 9011 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:44 smithi179 bash[23186]: cluster 2024-09-21T01:42:43.223005+0000 mgr.a (mgr.14388) 9011 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:44.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:44.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:44.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:45.679 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:45.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:45.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:45.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:45.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:46 smithi049 bash[23528]: cluster 2024-09-21T01:42:45.224944+0000 mgr.a (mgr.14388) 9012 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:46 smithi049 bash[23528]: audit 2024-09-21T01:42:45.238901+0000 mgr.a (mgr.14388) 9013 : audit [DBG] from='client.200814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:46 smithi049 bash[23528]: audit 2024-09-21T01:42:46.232849+0000 mon.a (mon.0) 7576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:46 smithi049 bash[23528]: audit 2024-09-21T01:42:46.241963+0000 mon.a (mon.0) 7577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:46 smithi049 bash[23528]: audit 2024-09-21T01:42:46.252389+0000 mon.a (mon.0) 7578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:46 smithi044 bash[22676]: cluster 2024-09-21T01:42:45.224944+0000 mgr.a (mgr.14388) 9012 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:46 smithi044 bash[22676]: audit 2024-09-21T01:42:45.238901+0000 mgr.a (mgr.14388) 9013 : audit [DBG] from='client.200814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:46 smithi044 bash[22676]: audit 2024-09-21T01:42:46.232849+0000 mon.a (mon.0) 7576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:46 smithi044 bash[22676]: audit 2024-09-21T01:42:46.241963+0000 mon.a (mon.0) 7577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:46 smithi044 bash[22676]: audit 2024-09-21T01:42:46.252389+0000 mon.a (mon.0) 7578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:46 smithi179 bash[23186]: cluster 2024-09-21T01:42:45.224944+0000 mgr.a (mgr.14388) 9012 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:46 smithi179 bash[23186]: audit 2024-09-21T01:42:45.238901+0000 mgr.a (mgr.14388) 9013 : audit [DBG] from='client.200814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:46 smithi179 bash[23186]: audit 2024-09-21T01:42:46.232849+0000 mon.a (mon.0) 7576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:46 smithi179 bash[23186]: audit 2024-09-21T01:42:46.241963+0000 mon.a (mon.0) 7577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:46 smithi179 bash[23186]: audit 2024-09-21T01:42:46.252389+0000 mon.a (mon.0) 7578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:42:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:48 smithi049 bash[23528]: cluster 2024-09-21T01:42:47.225936+0000 mgr.a (mgr.14388) 9014 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:48 smithi044 bash[22676]: cluster 2024-09-21T01:42:47.225936+0000 mgr.a (mgr.14388) 9014 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:48 smithi179 bash[23186]: cluster 2024-09-21T01:42:47.225936+0000 mgr.a (mgr.14388) 9014 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:50 smithi049 bash[23528]: cluster 2024-09-21T01:42:49.226773+0000 mgr.a (mgr.14388) 9015 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:50.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:50.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:50.682 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:50 smithi044 bash[22676]: cluster 2024-09-21T01:42:49.226773+0000 mgr.a (mgr.14388) 9015 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:50 smithi179 bash[23186]: cluster 2024-09-21T01:42:49.226773+0000 mgr.a (mgr.14388) 9015 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:42:51.469 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:52 smithi049 bash[23528]: audit 2024-09-21T01:42:51.017145+0000 mgr.a (mgr.14388) 9016 : audit [DBG] from='client.200892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:52 smithi049 bash[23528]: cluster 2024-09-21T01:42:51.228415+0000 mgr.a (mgr.14388) 9017 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:52 smithi044 bash[22676]: audit 2024-09-21T01:42:51.017145+0000 mgr.a (mgr.14388) 9016 : audit [DBG] from='client.200892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:52 smithi044 bash[22676]: cluster 2024-09-21T01:42:51.228415+0000 mgr.a (mgr.14388) 9017 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:52 smithi179 bash[23186]: audit 2024-09-21T01:42:51.017145+0000 mgr.a (mgr.14388) 9016 : audit [DBG] from='client.200892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:52 smithi179 bash[23186]: cluster 2024-09-21T01:42:51.228415+0000 mgr.a (mgr.14388) 9017 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:54 smithi044 bash[22676]: cluster 2024-09-21T01:42:53.229295+0000 mgr.a (mgr.14388) 9018 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:54 smithi179 bash[23186]: cluster 2024-09-21T01:42:53.229295+0000 mgr.a (mgr.14388) 9018 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:54 smithi049 bash[23528]: cluster 2024-09-21T01:42:53.229295+0000 mgr.a (mgr.14388) 9018 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:42:56.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:42:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:42:56.471 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:42:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:56 smithi179 bash[23186]: cluster 2024-09-21T01:42:55.231577+0000 mgr.a (mgr.14388) 9019 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:56 smithi044 bash[22676]: cluster 2024-09-21T01:42:55.231577+0000 mgr.a (mgr.14388) 9019 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:56 smithi049 bash[23528]: cluster 2024-09-21T01:42:55.231577+0000 mgr.a (mgr.14388) 9019 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:57.226 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:42:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:42:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:42:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:42:57.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:42:58.700 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:58 smithi179 bash[23186]: audit 2024-09-21T01:42:56.807088+0000 mgr.a (mgr.14388) 9020 : audit [DBG] from='client.200967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:58.701 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:42:58 smithi179 bash[23186]: cluster 2024-09-21T01:42:57.232200+0000 mgr.a (mgr.14388) 9021 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:58.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:58 smithi044 bash[22676]: audit 2024-09-21T01:42:56.807088+0000 mgr.a (mgr.14388) 9020 : audit [DBG] from='client.200967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:58.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:42:58 smithi044 bash[22676]: cluster 2024-09-21T01:42:57.232200+0000 mgr.a (mgr.14388) 9021 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:42:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:58 smithi049 bash[23528]: audit 2024-09-21T01:42:56.807088+0000 mgr.a (mgr.14388) 9020 : audit [DBG] from='client.200967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:42:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:42:58 smithi049 bash[23528]: cluster 2024-09-21T01:42:57.232200+0000 mgr.a (mgr.14388) 9021 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:00 smithi049 bash[23528]: cluster 2024-09-21T01:42:59.232725+0000 mgr.a (mgr.14388) 9022 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:00 smithi049 bash[23528]: audit 2024-09-21T01:42:59.365322+0000 mon.a (mon.0) 7579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:00 smithi049 bash[23528]: audit 2024-09-21T01:42:59.371890+0000 mon.a (mon.0) 7580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:00 smithi049 bash[23528]: audit 2024-09-21T01:42:59.377394+0000 mon.a (mon.0) 7581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:00 smithi049 bash[23528]: audit 2024-09-21T01:42:59.390620+0000 mon.a (mon.0) 7582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:00 smithi049 bash[23528]: audit 2024-09-21T01:42:59.395325+0000 mon.a (mon.0) 7583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:00 smithi049 bash[23528]: audit 2024-09-21T01:42:59.402167+0000 mon.a (mon.0) 7584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:00 smithi044 bash[22676]: cluster 2024-09-21T01:42:59.232725+0000 mgr.a (mgr.14388) 9022 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:00.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:00 smithi044 bash[22676]: audit 2024-09-21T01:42:59.365322+0000 mon.a (mon.0) 7579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:00 smithi044 bash[22676]: audit 2024-09-21T01:42:59.371890+0000 mon.a (mon.0) 7580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:00 smithi044 bash[22676]: audit 2024-09-21T01:42:59.377394+0000 mon.a (mon.0) 7581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:00 smithi044 bash[22676]: audit 2024-09-21T01:42:59.390620+0000 mon.a (mon.0) 7582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:00 smithi044 bash[22676]: audit 2024-09-21T01:42:59.395325+0000 mon.a (mon.0) 7583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:00 smithi044 bash[22676]: audit 2024-09-21T01:42:59.402167+0000 mon.a (mon.0) 7584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:00 smithi179 bash[23186]: cluster 2024-09-21T01:42:59.232725+0000 mgr.a (mgr.14388) 9022 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:00 smithi179 bash[23186]: audit 2024-09-21T01:42:59.365322+0000 mon.a (mon.0) 7579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:00 smithi179 bash[23186]: audit 2024-09-21T01:42:59.371890+0000 mon.a (mon.0) 7580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:00 smithi179 bash[23186]: audit 2024-09-21T01:42:59.377394+0000 mon.a (mon.0) 7581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:00 smithi179 bash[23186]: audit 2024-09-21T01:42:59.390620+0000 mon.a (mon.0) 7582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:00 smithi179 bash[23186]: audit 2024-09-21T01:42:59.395325+0000 mon.a (mon.0) 7583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:00 smithi179 bash[23186]: audit 2024-09-21T01:42:59.402167+0000 mon.a (mon.0) 7584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:02.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:02.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:02 smithi044 bash[22676]: cluster 2024-09-21T01:43:01.234915+0000 mgr.a (mgr.14388) 9023 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:02 smithi179 bash[23186]: cluster 2024-09-21T01:43:01.234915+0000 mgr.a (mgr.14388) 9023 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:02.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:02 smithi049 bash[23528]: cluster 2024-09-21T01:43:01.234915+0000 mgr.a (mgr.14388) 9023 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:02.998 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:02.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:02.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:02.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:03 smithi049 bash[23528]: audit 2024-09-21T01:43:02.569276+0000 mgr.a (mgr.14388) 9024 : audit [DBG] from='client.201045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:03 smithi044 bash[22676]: audit 2024-09-21T01:43:02.569276+0000 mgr.a (mgr.14388) 9024 : audit [DBG] from='client.201045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:03 smithi179 bash[23186]: audit 2024-09-21T01:43:02.569276+0000 mgr.a (mgr.14388) 9024 : audit [DBG] from='client.201045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:04 smithi044 bash[22676]: cluster 2024-09-21T01:43:03.235979+0000 mgr.a (mgr.14388) 9025 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:04 smithi179 bash[23186]: cluster 2024-09-21T01:43:03.235979+0000 mgr.a (mgr.14388) 9025 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:04 smithi049 bash[23528]: cluster 2024-09-21T01:43:03.235979+0000 mgr.a (mgr.14388) 9025 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:06 smithi044 bash[22676]: cluster 2024-09-21T01:43:05.238186+0000 mgr.a (mgr.14388) 9026 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:06 smithi179 bash[23186]: cluster 2024-09-21T01:43:05.238186+0000 mgr.a (mgr.14388) 9026 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:06 smithi049 bash[23528]: cluster 2024-09-21T01:43:05.238186+0000 mgr.a (mgr.14388) 9026 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:07 smithi044 bash[22676]: audit 2024-09-21T01:43:06.468839+0000 mon.a (mon.0) 7585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:07 smithi044 bash[22676]: audit 2024-09-21T01:43:06.478811+0000 mon.a (mon.0) 7586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:07 smithi044 bash[22676]: audit 2024-09-21T01:43:06.490756+0000 mon.a (mon.0) 7587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:07 smithi179 bash[23186]: audit 2024-09-21T01:43:06.468839+0000 mon.a (mon.0) 7585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:07 smithi179 bash[23186]: audit 2024-09-21T01:43:06.478811+0000 mon.a (mon.0) 7586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:07 smithi179 bash[23186]: audit 2024-09-21T01:43:06.490756+0000 mon.a (mon.0) 7587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:07 smithi049 bash[23528]: audit 2024-09-21T01:43:06.468839+0000 mon.a (mon.0) 7585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:07 smithi049 bash[23528]: audit 2024-09-21T01:43:06.478811+0000 mon.a (mon.0) 7586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:07 smithi049 bash[23528]: audit 2024-09-21T01:43:06.490756+0000 mon.a (mon.0) 7587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:08.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:08.000 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:08.000 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:08 smithi179 bash[23186]: cluster 2024-09-21T01:43:07.238944+0000 mgr.a (mgr.14388) 9027 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:08.782 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:08.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:08.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:08.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:08.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:08 smithi049 bash[23528]: cluster 2024-09-21T01:43:07.238944+0000 mgr.a (mgr.14388) 9027 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:08 smithi044 bash[22676]: cluster 2024-09-21T01:43:07.238944+0000 mgr.a (mgr.14388) 9027 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:09 smithi179 bash[23186]: audit 2024-09-21T01:43:08.336902+0000 mgr.a (mgr.14388) 9028 : audit [DBG] from='client.201123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:09 smithi049 bash[23528]: audit 2024-09-21T01:43:08.336902+0000 mgr.a (mgr.14388) 9028 : audit [DBG] from='client.201123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:09 smithi044 bash[22676]: audit 2024-09-21T01:43:08.336902+0000 mgr.a (mgr.14388) 9028 : audit [DBG] from='client.201123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:10 smithi179 bash[23186]: cluster 2024-09-21T01:43:09.239967+0000 mgr.a (mgr.14388) 9029 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:10 smithi049 bash[23528]: cluster 2024-09-21T01:43:09.239967+0000 mgr.a (mgr.14388) 9029 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:10 smithi044 bash[22676]: cluster 2024-09-21T01:43:09.239967+0000 mgr.a (mgr.14388) 9029 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:12 smithi049 bash[23528]: cluster 2024-09-21T01:43:11.242262+0000 mgr.a (mgr.14388) 9030 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:12 smithi044 bash[22676]: cluster 2024-09-21T01:43:11.242262+0000 mgr.a (mgr.14388) 9030 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:12 smithi179 bash[23186]: cluster 2024-09-21T01:43:11.242262+0000 mgr.a (mgr.14388) 9030 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:13.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:13.785 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:13.785 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:14.554 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:14.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:14.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: cluster 2024-09-21T01:43:13.243029+0000 mgr.a (mgr.14388) 9031 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:13.812859+0000 mon.a (mon.0) 7588 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:43:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.416299+0000 mon.a (mon.0) 7589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.421771+0000 mon.a (mon.0) 7590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.426224+0000 mon.a (mon.0) 7591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.431600+0000 mon.a (mon.0) 7592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.433059+0000 mon.a (mon.0) 7593 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:43:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.434124+0000 mon.a (mon.0) 7594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:43:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.439575+0000 mon.a (mon.0) 7595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:14 smithi049 bash[23528]: audit 2024-09-21T01:43:14.442155+0000 mon.a (mon.0) 7596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:43:14.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: cluster 2024-09-21T01:43:13.243029+0000 mgr.a (mgr.14388) 9031 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:13.812859+0000 mon.a (mon.0) 7588 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.416299+0000 mon.a (mon.0) 7589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.421771+0000 mon.a (mon.0) 7590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.426224+0000 mon.a (mon.0) 7591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.431600+0000 mon.a (mon.0) 7592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.433059+0000 mon.a (mon.0) 7593 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.434124+0000 mon.a (mon.0) 7594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.439575+0000 mon.a (mon.0) 7595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:14 smithi044 bash[22676]: audit 2024-09-21T01:43:14.442155+0000 mon.a (mon.0) 7596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: cluster 2024-09-21T01:43:13.243029+0000 mgr.a (mgr.14388) 9031 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:13.812859+0000 mon.a (mon.0) 7588 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.416299+0000 mon.a (mon.0) 7589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.421771+0000 mon.a (mon.0) 7590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.426224+0000 mon.a (mon.0) 7591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.431600+0000 mon.a (mon.0) 7592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.433059+0000 mon.a (mon.0) 7593 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.434124+0000 mon.a (mon.0) 7594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.439575+0000 mon.a (mon.0) 7595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:14 smithi179 bash[23186]: audit 2024-09-21T01:43:14.442155+0000 mon.a (mon.0) 7596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:43:15.517 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:43:15 smithi044 bash[22930]: debug 2024-09-21T01:43:15.257+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:43:15.517 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:43:15 smithi044 bash[22930]: debug 2024-09-21T01:43:15.257+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:43:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:15 smithi179 bash[23186]: audit 2024-09-21T01:43:14.123157+0000 mgr.a (mgr.14388) 9032 : audit [DBG] from='client.201201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:15 smithi179 bash[23186]: audit 2024-09-21T01:43:14.453160+0000 mgr.a (mgr.14388) 9033 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:43:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:15 smithi049 bash[23528]: audit 2024-09-21T01:43:14.123157+0000 mgr.a (mgr.14388) 9032 : audit [DBG] from='client.201201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:15 smithi049 bash[23528]: audit 2024-09-21T01:43:14.453160+0000 mgr.a (mgr.14388) 9033 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:43:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:15 smithi044 bash[22676]: audit 2024-09-21T01:43:14.123157+0000 mgr.a (mgr.14388) 9032 : audit [DBG] from='client.201201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:15 smithi044 bash[22676]: audit 2024-09-21T01:43:14.453160+0000 mgr.a (mgr.14388) 9033 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:43:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:16 smithi049 bash[23528]: cluster 2024-09-21T01:43:15.244865+0000 mgr.a (mgr.14388) 9034 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:16 smithi049 bash[23528]: audit 2024-09-21T01:43:15.262051+0000 mgr.a (mgr.14388) 9035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:43:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:16 smithi049 bash[23528]: cephadm 2024-09-21T01:43:15.263504+0000 mgr.a (mgr.14388) 9036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:43:16.873 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:16 smithi179 bash[23186]: cluster 2024-09-21T01:43:15.244865+0000 mgr.a (mgr.14388) 9034 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:16.873 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:16 smithi179 bash[23186]: audit 2024-09-21T01:43:15.262051+0000 mgr.a (mgr.14388) 9035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:43:16.873 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:16 smithi179 bash[23186]: cephadm 2024-09-21T01:43:15.263504+0000 mgr.a (mgr.14388) 9036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:43:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:16 smithi044 bash[22676]: cluster 2024-09-21T01:43:15.244865+0000 mgr.a (mgr.14388) 9034 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:16 smithi044 bash[22676]: audit 2024-09-21T01:43:15.262051+0000 mgr.a (mgr.14388) 9035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:43:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:16 smithi044 bash[22676]: cephadm 2024-09-21T01:43:15.263504+0000 mgr.a (mgr.14388) 9036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:43:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:18 smithi179 bash[23186]: cluster 2024-09-21T01:43:17.245648+0000 mgr.a (mgr.14388) 9037 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:18 smithi049 bash[23528]: cluster 2024-09-21T01:43:17.245648+0000 mgr.a (mgr.14388) 9037 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:18 smithi044 bash[22676]: cluster 2024-09-21T01:43:17.245648+0000 mgr.a (mgr.14388) 9037 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:19.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:19.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:19.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:20.348 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:20.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:20.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:20.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:20.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:20 smithi179 bash[23186]: cluster 2024-09-21T01:43:19.246421+0000 mgr.a (mgr.14388) 9038 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:20 smithi179 bash[23186]: audit 2024-09-21T01:43:19.586382+0000 mon.a (mon.0) 7597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:20 smithi179 bash[23186]: audit 2024-09-21T01:43:19.594137+0000 mon.a (mon.0) 7598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:20 smithi179 bash[23186]: audit 2024-09-21T01:43:19.601406+0000 mon.a (mon.0) 7599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:20 smithi179 bash[23186]: audit 2024-09-21T01:43:19.612695+0000 mon.a (mon.0) 7600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:20 smithi179 bash[23186]: audit 2024-09-21T01:43:19.618533+0000 mon.a (mon.0) 7601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:20 smithi179 bash[23186]: audit 2024-09-21T01:43:19.626725+0000 mon.a (mon.0) 7602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:20 smithi044 bash[22676]: cluster 2024-09-21T01:43:19.246421+0000 mgr.a (mgr.14388) 9038 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:20 smithi044 bash[22676]: audit 2024-09-21T01:43:19.586382+0000 mon.a (mon.0) 7597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:20 smithi044 bash[22676]: audit 2024-09-21T01:43:19.594137+0000 mon.a (mon.0) 7598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:20 smithi044 bash[22676]: audit 2024-09-21T01:43:19.601406+0000 mon.a (mon.0) 7599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:20 smithi044 bash[22676]: audit 2024-09-21T01:43:19.612695+0000 mon.a (mon.0) 7600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:20 smithi044 bash[22676]: audit 2024-09-21T01:43:19.618533+0000 mon.a (mon.0) 7601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:20 smithi044 bash[22676]: audit 2024-09-21T01:43:19.626725+0000 mon.a (mon.0) 7602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:20 smithi049 bash[23528]: cluster 2024-09-21T01:43:19.246421+0000 mgr.a (mgr.14388) 9038 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:20 smithi049 bash[23528]: audit 2024-09-21T01:43:19.586382+0000 mon.a (mon.0) 7597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:20 smithi049 bash[23528]: audit 2024-09-21T01:43:19.594137+0000 mon.a (mon.0) 7598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:20 smithi049 bash[23528]: audit 2024-09-21T01:43:19.601406+0000 mon.a (mon.0) 7599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:20 smithi049 bash[23528]: audit 2024-09-21T01:43:19.612695+0000 mon.a (mon.0) 7600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:20 smithi049 bash[23528]: audit 2024-09-21T01:43:19.618533+0000 mon.a (mon.0) 7601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:20 smithi049 bash[23528]: audit 2024-09-21T01:43:19.626725+0000 mon.a (mon.0) 7602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:21.920 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:21 smithi049 bash[23528]: audit 2024-09-21T01:43:19.907182+0000 mgr.a (mgr.14388) 9039 : audit [DBG] from='client.201387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:21 smithi044 bash[22676]: audit 2024-09-21T01:43:19.907182+0000 mgr.a (mgr.14388) 9039 : audit [DBG] from='client.201387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:21 smithi179 bash[23186]: audit 2024-09-21T01:43:19.907182+0000 mgr.a (mgr.14388) 9039 : audit [DBG] from='client.201387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:22 smithi044 bash[22676]: cluster 2024-09-21T01:43:21.249341+0000 mgr.a (mgr.14388) 9040 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:43:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:22 smithi179 bash[23186]: cluster 2024-09-21T01:43:21.249341+0000 mgr.a (mgr.14388) 9040 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:43:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:22 smithi049 bash[23528]: cluster 2024-09-21T01:43:21.249341+0000 mgr.a (mgr.14388) 9040 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:43:24.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:24 smithi044 bash[22676]: cluster 2024-09-21T01:43:23.249881+0000 mgr.a (mgr.14388) 9041 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:43:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:24 smithi179 bash[23186]: cluster 2024-09-21T01:43:23.249881+0000 mgr.a (mgr.14388) 9041 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:43:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:24 smithi049 bash[23528]: cluster 2024-09-21T01:43:23.249881+0000 mgr.a (mgr.14388) 9041 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:43:25.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:25.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:25.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:26.123 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:26.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:26.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:26.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:26 smithi044 bash[22676]: cluster 2024-09-21T01:43:25.251869+0000 mgr.a (mgr.14388) 9042 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:43:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:26 smithi044 bash[22676]: audit 2024-09-21T01:43:25.690326+0000 mgr.a (mgr.14388) 9043 : audit [DBG] from='client.201459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:26 smithi179 bash[23186]: cluster 2024-09-21T01:43:25.251869+0000 mgr.a (mgr.14388) 9042 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:43:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:26 smithi179 bash[23186]: audit 2024-09-21T01:43:25.690326+0000 mgr.a (mgr.14388) 9043 : audit [DBG] from='client.201459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:26 smithi049 bash[23528]: cluster 2024-09-21T01:43:25.251869+0000 mgr.a (mgr.14388) 9042 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:43:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:26 smithi049 bash[23528]: audit 2024-09-21T01:43:25.690326+0000 mgr.a (mgr.14388) 9043 : audit [DBG] from='client.201459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:27 smithi044 bash[22676]: audit 2024-09-21T01:43:26.698588+0000 mon.a (mon.0) 7603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:27 smithi044 bash[22676]: audit 2024-09-21T01:43:26.708539+0000 mon.a (mon.0) 7604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:27 smithi044 bash[22676]: audit 2024-09-21T01:43:26.719088+0000 mon.a (mon.0) 7605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:27 smithi179 bash[23186]: audit 2024-09-21T01:43:26.698588+0000 mon.a (mon.0) 7603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:27 smithi179 bash[23186]: audit 2024-09-21T01:43:26.708539+0000 mon.a (mon.0) 7604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:27 smithi179 bash[23186]: audit 2024-09-21T01:43:26.719088+0000 mon.a (mon.0) 7605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:27 smithi049 bash[23528]: audit 2024-09-21T01:43:26.698588+0000 mon.a (mon.0) 7603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:27 smithi049 bash[23528]: audit 2024-09-21T01:43:26.708539+0000 mon.a (mon.0) 7604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:27 smithi049 bash[23528]: audit 2024-09-21T01:43:26.719088+0000 mon.a (mon.0) 7605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:28 smithi044 bash[22676]: cluster 2024-09-21T01:43:27.252782+0000 mgr.a (mgr.14388) 9044 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T01:43:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:28 smithi179 bash[23186]: cluster 2024-09-21T01:43:27.252782+0000 mgr.a (mgr.14388) 9044 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T01:43:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:28 smithi049 bash[23528]: cluster 2024-09-21T01:43:27.252782+0000 mgr.a (mgr.14388) 9044 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T01:43:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:30 smithi044 bash[22676]: cluster 2024-09-21T01:43:29.253589+0000 mgr.a (mgr.14388) 9045 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T01:43:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:30 smithi179 bash[23186]: cluster 2024-09-21T01:43:29.253589+0000 mgr.a (mgr.14388) 9045 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T01:43:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:30 smithi049 bash[23528]: cluster 2024-09-21T01:43:29.253589+0000 mgr.a (mgr.14388) 9045 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T01:43:31.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:31.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:31.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:31.881 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:32 smithi044 bash[22676]: cluster 2024-09-21T01:43:31.255680+0000 mgr.a (mgr.14388) 9046 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:43:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:32 smithi044 bash[22676]: audit 2024-09-21T01:43:31.456796+0000 mgr.a (mgr.14388) 9047 : audit [DBG] from='client.201534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:32 smithi179 bash[23186]: cluster 2024-09-21T01:43:31.255680+0000 mgr.a (mgr.14388) 9046 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:43:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:32 smithi179 bash[23186]: audit 2024-09-21T01:43:31.456796+0000 mgr.a (mgr.14388) 9047 : audit [DBG] from='client.201534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:32 smithi049 bash[23528]: cluster 2024-09-21T01:43:31.255680+0000 mgr.a (mgr.14388) 9046 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:43:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:32 smithi049 bash[23528]: audit 2024-09-21T01:43:31.456796+0000 mgr.a (mgr.14388) 9047 : audit [DBG] from='client.201534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:34 smithi044 bash[22676]: cluster 2024-09-21T01:43:33.256609+0000 mgr.a (mgr.14388) 9048 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:34 smithi179 bash[23186]: cluster 2024-09-21T01:43:33.256609+0000 mgr.a (mgr.14388) 9048 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:34 smithi049 bash[23528]: cluster 2024-09-21T01:43:33.256609+0000 mgr.a (mgr.14388) 9048 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:36.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:36.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:36.960 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:36 smithi179 bash[23186]: cluster 2024-09-21T01:43:35.258801+0000 mgr.a (mgr.14388) 9049 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:36.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:36 smithi044 bash[22676]: cluster 2024-09-21T01:43:35.258801+0000 mgr.a (mgr.14388) 9049 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:36 smithi049 bash[23528]: cluster 2024-09-21T01:43:35.258801+0000 mgr.a (mgr.14388) 9049 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:37.672 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:37.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:37 smithi044 bash[22676]: audit 2024-09-21T01:43:37.225928+0000 mgr.a (mgr.14388) 9050 : audit [DBG] from='client.201609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:37 smithi044 bash[22676]: cluster 2024-09-21T01:43:37.259635+0000 mgr.a (mgr.14388) 9051 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:37 smithi179 bash[23186]: audit 2024-09-21T01:43:37.225928+0000 mgr.a (mgr.14388) 9050 : audit [DBG] from='client.201609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:37 smithi179 bash[23186]: cluster 2024-09-21T01:43:37.259635+0000 mgr.a (mgr.14388) 9051 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:37 smithi049 bash[23528]: audit 2024-09-21T01:43:37.225928+0000 mgr.a (mgr.14388) 9050 : audit [DBG] from='client.201609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:37 smithi049 bash[23528]: cluster 2024-09-21T01:43:37.259635+0000 mgr.a (mgr.14388) 9051 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:40 smithi044 bash[22676]: cluster 2024-09-21T01:43:39.260583+0000 mgr.a (mgr.14388) 9052 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:40 smithi044 bash[22676]: audit 2024-09-21T01:43:39.787343+0000 mon.a (mon.0) 7606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:40 smithi044 bash[22676]: audit 2024-09-21T01:43:39.792738+0000 mon.a (mon.0) 7607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:40 smithi044 bash[22676]: audit 2024-09-21T01:43:39.800345+0000 mon.a (mon.0) 7608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:40 smithi044 bash[22676]: audit 2024-09-21T01:43:39.835240+0000 mon.a (mon.0) 7609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:40 smithi044 bash[22676]: audit 2024-09-21T01:43:39.843555+0000 mon.a (mon.0) 7610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:40 smithi044 bash[22676]: audit 2024-09-21T01:43:39.853744+0000 mon.a (mon.0) 7611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:40 smithi179 bash[23186]: cluster 2024-09-21T01:43:39.260583+0000 mgr.a (mgr.14388) 9052 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:40 smithi179 bash[23186]: audit 2024-09-21T01:43:39.787343+0000 mon.a (mon.0) 7606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:40 smithi179 bash[23186]: audit 2024-09-21T01:43:39.792738+0000 mon.a (mon.0) 7607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:40 smithi179 bash[23186]: audit 2024-09-21T01:43:39.800345+0000 mon.a (mon.0) 7608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:40 smithi179 bash[23186]: audit 2024-09-21T01:43:39.835240+0000 mon.a (mon.0) 7609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:40 smithi179 bash[23186]: audit 2024-09-21T01:43:39.843555+0000 mon.a (mon.0) 7610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:40 smithi179 bash[23186]: audit 2024-09-21T01:43:39.853744+0000 mon.a (mon.0) 7611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:40 smithi049 bash[23528]: cluster 2024-09-21T01:43:39.260583+0000 mgr.a (mgr.14388) 9052 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:40 smithi049 bash[23528]: audit 2024-09-21T01:43:39.787343+0000 mon.a (mon.0) 7606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:40 smithi049 bash[23528]: audit 2024-09-21T01:43:39.792738+0000 mon.a (mon.0) 7607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:40 smithi049 bash[23528]: audit 2024-09-21T01:43:39.800345+0000 mon.a (mon.0) 7608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:40 smithi049 bash[23528]: audit 2024-09-21T01:43:39.835240+0000 mon.a (mon.0) 7609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:40 smithi049 bash[23528]: audit 2024-09-21T01:43:39.843555+0000 mon.a (mon.0) 7610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:40 smithi049 bash[23528]: audit 2024-09-21T01:43:39.853744+0000 mon.a (mon.0) 7611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:42.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:42 smithi044 bash[22676]: cluster 2024-09-21T01:43:41.262820+0000 mgr.a (mgr.14388) 9053 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:42.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:42.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:42.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:42 smithi179 bash[23186]: cluster 2024-09-21T01:43:41.262820+0000 mgr.a (mgr.14388) 9053 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:42 smithi049 bash[23528]: cluster 2024-09-21T01:43:41.262820+0000 mgr.a (mgr.14388) 9053 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:43.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:43.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:43.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:43.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:44.690 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:44 smithi049 bash[23528]: audit 2024-09-21T01:43:43.006598+0000 mgr.a (mgr.14388) 9054 : audit [DBG] from='client.201684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:44.691 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:44 smithi049 bash[23528]: cluster 2024-09-21T01:43:43.263397+0000 mgr.a (mgr.14388) 9055 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:44 smithi044 bash[22676]: audit 2024-09-21T01:43:43.006598+0000 mgr.a (mgr.14388) 9054 : audit [DBG] from='client.201684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:44 smithi044 bash[22676]: cluster 2024-09-21T01:43:43.263397+0000 mgr.a (mgr.14388) 9055 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:44 smithi179 bash[23186]: audit 2024-09-21T01:43:43.006598+0000 mgr.a (mgr.14388) 9054 : audit [DBG] from='client.201684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:44 smithi179 bash[23186]: cluster 2024-09-21T01:43:43.263397+0000 mgr.a (mgr.14388) 9055 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:46 smithi044 bash[22676]: cluster 2024-09-21T01:43:45.264692+0000 mgr.a (mgr.14388) 9056 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:46 smithi179 bash[23186]: cluster 2024-09-21T01:43:45.264692+0000 mgr.a (mgr.14388) 9056 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:46 smithi049 bash[23528]: cluster 2024-09-21T01:43:45.264692+0000 mgr.a (mgr.14388) 9056 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:47 smithi044 bash[22676]: audit 2024-09-21T01:43:46.933658+0000 mon.a (mon.0) 7612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:47 smithi044 bash[22676]: audit 2024-09-21T01:43:46.942241+0000 mon.a (mon.0) 7613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:47 smithi044 bash[22676]: audit 2024-09-21T01:43:46.952615+0000 mon.a (mon.0) 7614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:47 smithi044 bash[22676]: cluster 2024-09-21T01:43:47.265459+0000 mgr.a (mgr.14388) 9057 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:47 smithi179 bash[23186]: audit 2024-09-21T01:43:46.933658+0000 mon.a (mon.0) 7612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:47 smithi179 bash[23186]: audit 2024-09-21T01:43:46.942241+0000 mon.a (mon.0) 7613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:47 smithi179 bash[23186]: audit 2024-09-21T01:43:46.952615+0000 mon.a (mon.0) 7614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:47 smithi179 bash[23186]: cluster 2024-09-21T01:43:47.265459+0000 mgr.a (mgr.14388) 9057 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:48.287 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:47 smithi049 bash[23528]: audit 2024-09-21T01:43:46.933658+0000 mon.a (mon.0) 7612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:47 smithi049 bash[23528]: audit 2024-09-21T01:43:46.942241+0000 mon.a (mon.0) 7613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:47 smithi049 bash[23528]: audit 2024-09-21T01:43:46.952615+0000 mon.a (mon.0) 7614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:43:48.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:47 smithi049 bash[23528]: cluster 2024-09-21T01:43:47.265459+0000 mgr.a (mgr.14388) 9057 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:48.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:48.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:48.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:49.232 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:50 smithi044 bash[22676]: audit 2024-09-21T01:43:48.791995+0000 mgr.a (mgr.14388) 9058 : audit [DBG] from='client.201756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:50 smithi044 bash[22676]: cluster 2024-09-21T01:43:49.265986+0000 mgr.a (mgr.14388) 9059 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:50 smithi179 bash[23186]: audit 2024-09-21T01:43:48.791995+0000 mgr.a (mgr.14388) 9058 : audit [DBG] from='client.201756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:50 smithi179 bash[23186]: cluster 2024-09-21T01:43:49.265986+0000 mgr.a (mgr.14388) 9059 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:50 smithi049 bash[23528]: audit 2024-09-21T01:43:48.791995+0000 mgr.a (mgr.14388) 9058 : audit [DBG] from='client.201756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:50 smithi049 bash[23528]: cluster 2024-09-21T01:43:49.265986+0000 mgr.a (mgr.14388) 9059 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:52 smithi044 bash[22676]: cluster 2024-09-21T01:43:51.268121+0000 mgr.a (mgr.14388) 9060 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:52 smithi179 bash[23186]: cluster 2024-09-21T01:43:51.268121+0000 mgr.a (mgr.14388) 9060 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:52.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:52 smithi049 bash[23528]: cluster 2024-09-21T01:43:51.268121+0000 mgr.a (mgr.14388) 9060 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:54.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:54.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:54.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:43:54.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:54 smithi044 bash[22676]: cluster 2024-09-21T01:43:53.268909+0000 mgr.a (mgr.14388) 9061 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:54 smithi179 bash[23186]: cluster 2024-09-21T01:43:53.268909+0000 mgr.a (mgr.14388) 9061 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:54 smithi049 bash[23528]: cluster 2024-09-21T01:43:53.268909+0000 mgr.a (mgr.14388) 9061 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:54.989 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:43:54.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:43:54.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:43:54.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:43:54.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:43:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:55 smithi044 bash[22676]: audit 2024-09-21T01:43:54.562891+0000 mgr.a (mgr.14388) 9062 : audit [DBG] from='client.201834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:55 smithi179 bash[23186]: audit 2024-09-21T01:43:54.562891+0000 mgr.a (mgr.14388) 9062 : audit [DBG] from='client.201834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:55.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:55 smithi049 bash[23528]: audit 2024-09-21T01:43:54.562891+0000 mgr.a (mgr.14388) 9062 : audit [DBG] from='client.201834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:43:56.704 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:56 smithi179 bash[23186]: cluster 2024-09-21T01:43:55.271237+0000 mgr.a (mgr.14388) 9063 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:56 smithi044 bash[22676]: cluster 2024-09-21T01:43:55.271237+0000 mgr.a (mgr.14388) 9063 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:56 smithi049 bash[23528]: cluster 2024-09-21T01:43:55.271237+0000 mgr.a (mgr.14388) 9063 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:43:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:43:58 smithi044 bash[22676]: cluster 2024-09-21T01:43:57.272025+0000 mgr.a (mgr.14388) 9064 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:43:58 smithi179 bash[23186]: cluster 2024-09-21T01:43:57.272025+0000 mgr.a (mgr.14388) 9064 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:58.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:43:58 smithi049 bash[23528]: cluster 2024-09-21T01:43:57.272025+0000 mgr.a (mgr.14388) 9064 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:43:59.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:43:59.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:43:59.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:00.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:00 smithi044 bash[22676]: cluster 2024-09-21T01:43:59.272801+0000 mgr.a (mgr.14388) 9065 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:00 smithi044 bash[22676]: audit 2024-09-21T01:44:00.007882+0000 mon.a (mon.0) 7615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:00 smithi044 bash[22676]: audit 2024-09-21T01:44:00.013618+0000 mon.a (mon.0) 7616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:00 smithi044 bash[22676]: audit 2024-09-21T01:44:00.021367+0000 mon.a (mon.0) 7617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:00 smithi044 bash[22676]: audit 2024-09-21T01:44:00.049274+0000 mon.a (mon.0) 7618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:00 smithi044 bash[22676]: audit 2024-09-21T01:44:00.055093+0000 mon.a (mon.0) 7619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:00 smithi044 bash[22676]: audit 2024-09-21T01:44:00.062686+0000 mon.a (mon.0) 7620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:00 smithi179 bash[23186]: cluster 2024-09-21T01:43:59.272801+0000 mgr.a (mgr.14388) 9065 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:00 smithi179 bash[23186]: audit 2024-09-21T01:44:00.007882+0000 mon.a (mon.0) 7615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:00 smithi179 bash[23186]: audit 2024-09-21T01:44:00.013618+0000 mon.a (mon.0) 7616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:00 smithi179 bash[23186]: audit 2024-09-21T01:44:00.021367+0000 mon.a (mon.0) 7617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:00 smithi179 bash[23186]: audit 2024-09-21T01:44:00.049274+0000 mon.a (mon.0) 7618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:00 smithi179 bash[23186]: audit 2024-09-21T01:44:00.055093+0000 mon.a (mon.0) 7619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:00 smithi179 bash[23186]: audit 2024-09-21T01:44:00.062686+0000 mon.a (mon.0) 7620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.787 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:00.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:00.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:00.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:00 smithi049 bash[23528]: cluster 2024-09-21T01:43:59.272801+0000 mgr.a (mgr.14388) 9065 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:00 smithi049 bash[23528]: audit 2024-09-21T01:44:00.007882+0000 mon.a (mon.0) 7615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:00 smithi049 bash[23528]: audit 2024-09-21T01:44:00.013618+0000 mon.a (mon.0) 7616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:00 smithi049 bash[23528]: audit 2024-09-21T01:44:00.021367+0000 mon.a (mon.0) 7617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:00 smithi049 bash[23528]: audit 2024-09-21T01:44:00.049274+0000 mon.a (mon.0) 7618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:00 smithi049 bash[23528]: audit 2024-09-21T01:44:00.055093+0000 mon.a (mon.0) 7619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:00 smithi049 bash[23528]: audit 2024-09-21T01:44:00.062686+0000 mon.a (mon.0) 7620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:01 smithi179 bash[23186]: audit 2024-09-21T01:44:00.329459+0000 mgr.a (mgr.14388) 9066 : audit [DBG] from='client.201909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:01 smithi049 bash[23528]: audit 2024-09-21T01:44:00.329459+0000 mgr.a (mgr.14388) 9066 : audit [DBG] from='client.201909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:01 smithi044 bash[22676]: audit 2024-09-21T01:44:00.329459+0000 mgr.a (mgr.14388) 9066 : audit [DBG] from='client.201909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:02 smithi049 bash[23528]: cluster 2024-09-21T01:44:01.275723+0000 mgr.a (mgr.14388) 9067 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:02 smithi044 bash[22676]: cluster 2024-09-21T01:44:01.275723+0000 mgr.a (mgr.14388) 9067 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:02 smithi179 bash[23186]: cluster 2024-09-21T01:44:01.275723+0000 mgr.a (mgr.14388) 9067 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:04 smithi044 bash[22676]: cluster 2024-09-21T01:44:03.276545+0000 mgr.a (mgr.14388) 9068 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:44:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:04 smithi179 bash[23186]: cluster 2024-09-21T01:44:03.276545+0000 mgr.a (mgr.14388) 9068 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:44:04.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:04 smithi049 bash[23528]: cluster 2024-09-21T01:44:03.276545+0000 mgr.a (mgr.14388) 9068 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:44:05.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:05.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:05.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:06.577 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:06.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:06.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:06.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:06.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:06 smithi044 bash[22676]: cluster 2024-09-21T01:44:05.277722+0000 mgr.a (mgr.14388) 9069 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:06 smithi179 bash[23186]: cluster 2024-09-21T01:44:05.277722+0000 mgr.a (mgr.14388) 9069 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:06 smithi049 bash[23528]: cluster 2024-09-21T01:44:05.277722+0000 mgr.a (mgr.14388) 9069 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:07 smithi049 bash[23528]: audit 2024-09-21T01:44:06.125734+0000 mgr.a (mgr.14388) 9070 : audit [DBG] from='client.201981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:07 smithi049 bash[23528]: audit 2024-09-21T01:44:07.168008+0000 mon.a (mon.0) 7621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:07 smithi049 bash[23528]: audit 2024-09-21T01:44:07.177954+0000 mon.a (mon.0) 7622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:07 smithi049 bash[23528]: audit 2024-09-21T01:44:07.188624+0000 mon.a (mon.0) 7623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:07 smithi044 bash[22676]: audit 2024-09-21T01:44:06.125734+0000 mgr.a (mgr.14388) 9070 : audit [DBG] from='client.201981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:07 smithi044 bash[22676]: audit 2024-09-21T01:44:07.168008+0000 mon.a (mon.0) 7621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:07 smithi044 bash[22676]: audit 2024-09-21T01:44:07.177954+0000 mon.a (mon.0) 7622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:07 smithi044 bash[22676]: audit 2024-09-21T01:44:07.188624+0000 mon.a (mon.0) 7623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:07 smithi179 bash[23186]: audit 2024-09-21T01:44:06.125734+0000 mgr.a (mgr.14388) 9070 : audit [DBG] from='client.201981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:07 smithi179 bash[23186]: audit 2024-09-21T01:44:07.168008+0000 mon.a (mon.0) 7621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:07 smithi179 bash[23186]: audit 2024-09-21T01:44:07.177954+0000 mon.a (mon.0) 7622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:07 smithi179 bash[23186]: audit 2024-09-21T01:44:07.188624+0000 mon.a (mon.0) 7623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:08 smithi044 bash[22676]: cluster 2024-09-21T01:44:07.278546+0000 mgr.a (mgr.14388) 9071 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:44:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:08 smithi179 bash[23186]: cluster 2024-09-21T01:44:07.278546+0000 mgr.a (mgr.14388) 9071 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:44:08.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:08 smithi049 bash[23528]: cluster 2024-09-21T01:44:07.278546+0000 mgr.a (mgr.14388) 9071 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:44:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:10 smithi044 bash[22676]: cluster 2024-09-21T01:44:09.279338+0000 mgr.a (mgr.14388) 9072 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:10 smithi179 bash[23186]: cluster 2024-09-21T01:44:09.279338+0000 mgr.a (mgr.14388) 9072 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:10.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:10 smithi049 bash[23528]: cluster 2024-09-21T01:44:09.279338+0000 mgr.a (mgr.14388) 9072 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:11.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:11.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:11.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:12.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:12.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:12.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:12.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:12.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:12 smithi044 bash[22676]: cluster 2024-09-21T01:44:11.281465+0000 mgr.a (mgr.14388) 9073 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:12 smithi179 bash[23186]: cluster 2024-09-21T01:44:11.281465+0000 mgr.a (mgr.14388) 9073 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:12 smithi049 bash[23528]: cluster 2024-09-21T01:44:11.281465+0000 mgr.a (mgr.14388) 9073 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:13 smithi044 bash[22676]: audit 2024-09-21T01:44:11.917725+0000 mgr.a (mgr.14388) 9074 : audit [DBG] from='client.202056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:13 smithi179 bash[23186]: audit 2024-09-21T01:44:11.917725+0000 mgr.a (mgr.14388) 9074 : audit [DBG] from='client.202056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:13.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:13 smithi049 bash[23528]: audit 2024-09-21T01:44:11.917725+0000 mgr.a (mgr.14388) 9074 : audit [DBG] from='client.202056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:14 smithi044 bash[22676]: cluster 2024-09-21T01:44:13.282389+0000 mgr.a (mgr.14388) 9075 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:14 smithi179 bash[23186]: cluster 2024-09-21T01:44:13.282389+0000 mgr.a (mgr.14388) 9075 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:14 smithi049 bash[23528]: cluster 2024-09-21T01:44:13.282389+0000 mgr.a (mgr.14388) 9075 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:15 smithi044 bash[22676]: audit 2024-09-21T01:44:15.327699+0000 mon.a (mon.0) 7624 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:44:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:15 smithi179 bash[23186]: audit 2024-09-21T01:44:15.327699+0000 mon.a (mon.0) 7624 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:44:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:15 smithi049 bash[23528]: audit 2024-09-21T01:44:15.327699+0000 mon.a (mon.0) 7624 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:44:16.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22676]: cluster 2024-09-21T01:44:15.284531+0000 mgr.a (mgr.14388) 9076 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:16.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22676]: audit 2024-09-21T01:44:15.903192+0000 mon.a (mon.0) 7625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22676]: audit 2024-09-21T01:44:15.911811+0000 mon.a (mon.0) 7626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22676]: audit 2024-09-21T01:44:15.914471+0000 mon.a (mon.0) 7627 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:44:16.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22676]: audit 2024-09-21T01:44:15.916648+0000 mon.a (mon.0) 7628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:44:16.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22676]: audit 2024-09-21T01:44:15.927330+0000 mon.a (mon.0) 7629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22676]: audit 2024-09-21T01:44:15.933655+0000 mon.a (mon.0) 7630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:44:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:16 smithi179 bash[23186]: cluster 2024-09-21T01:44:15.284531+0000 mgr.a (mgr.14388) 9076 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:16 smithi179 bash[23186]: audit 2024-09-21T01:44:15.903192+0000 mon.a (mon.0) 7625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:16 smithi179 bash[23186]: audit 2024-09-21T01:44:15.911811+0000 mon.a (mon.0) 7626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:16 smithi179 bash[23186]: audit 2024-09-21T01:44:15.914471+0000 mon.a (mon.0) 7627 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:44:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:16 smithi179 bash[23186]: audit 2024-09-21T01:44:15.916648+0000 mon.a (mon.0) 7628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:44:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:16 smithi179 bash[23186]: audit 2024-09-21T01:44:15.927330+0000 mon.a (mon.0) 7629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:16 smithi179 bash[23186]: audit 2024-09-21T01:44:15.933655+0000 mon.a (mon.0) 7630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:44:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:16 smithi049 bash[23528]: cluster 2024-09-21T01:44:15.284531+0000 mgr.a (mgr.14388) 9076 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:16 smithi049 bash[23528]: audit 2024-09-21T01:44:15.903192+0000 mon.a (mon.0) 7625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:16 smithi049 bash[23528]: audit 2024-09-21T01:44:15.911811+0000 mon.a (mon.0) 7626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:16 smithi049 bash[23528]: audit 2024-09-21T01:44:15.914471+0000 mon.a (mon.0) 7627 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:44:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:16 smithi049 bash[23528]: audit 2024-09-21T01:44:15.916648+0000 mon.a (mon.0) 7628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:44:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:16 smithi049 bash[23528]: audit 2024-09-21T01:44:15.927330+0000 mon.a (mon.0) 7629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:16 smithi049 bash[23528]: audit 2024-09-21T01:44:15.933655+0000 mon.a (mon.0) 7630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:44:16.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22930]: debug 2024-09-21T01:44:16.725+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:44:16.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:44:16 smithi044 bash[22930]: debug 2024-09-21T01:44:16.729+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:44:17.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:17.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:17.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:17 smithi044 bash[22676]: audit 2024-09-21T01:44:15.936083+0000 mgr.a (mgr.14388) 9077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:44:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:17 smithi179 bash[23186]: audit 2024-09-21T01:44:15.936083+0000 mgr.a (mgr.14388) 9077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:44:17.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:17 smithi049 bash[23528]: audit 2024-09-21T01:44:15.936083+0000 mgr.a (mgr.14388) 9077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:44:18.162 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:18.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:18 smithi044 bash[22676]: audit 2024-09-21T01:44:16.728711+0000 mgr.a (mgr.14388) 9078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:44:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:18 smithi044 bash[22676]: cephadm 2024-09-21T01:44:16.730389+0000 mgr.a (mgr.14388) 9079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:44:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:18 smithi044 bash[22676]: cluster 2024-09-21T01:44:17.285603+0000 mgr.a (mgr.14388) 9080 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:18 smithi044 bash[22676]: audit 2024-09-21T01:44:17.710594+0000 mgr.a (mgr.14388) 9081 : audit [DBG] from='client.202236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:18 smithi179 bash[23186]: audit 2024-09-21T01:44:16.728711+0000 mgr.a (mgr.14388) 9078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:44:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:18 smithi179 bash[23186]: cephadm 2024-09-21T01:44:16.730389+0000 mgr.a (mgr.14388) 9079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:44:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:18 smithi179 bash[23186]: cluster 2024-09-21T01:44:17.285603+0000 mgr.a (mgr.14388) 9080 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:18 smithi179 bash[23186]: audit 2024-09-21T01:44:17.710594+0000 mgr.a (mgr.14388) 9081 : audit [DBG] from='client.202236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:18 smithi049 bash[23528]: audit 2024-09-21T01:44:16.728711+0000 mgr.a (mgr.14388) 9078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:44:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:18 smithi049 bash[23528]: cephadm 2024-09-21T01:44:16.730389+0000 mgr.a (mgr.14388) 9079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:44:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:18 smithi049 bash[23528]: cluster 2024-09-21T01:44:17.285603+0000 mgr.a (mgr.14388) 9080 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:18 smithi049 bash[23528]: audit 2024-09-21T01:44:17.710594+0000 mgr.a (mgr.14388) 9081 : audit [DBG] from='client.202236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:20 smithi179 bash[23186]: cluster 2024-09-21T01:44:19.286588+0000 mgr.a (mgr.14388) 9082 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:20 smithi179 bash[23186]: audit 2024-09-21T01:44:20.170047+0000 mon.a (mon.0) 7631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:20 smithi179 bash[23186]: audit 2024-09-21T01:44:20.177823+0000 mon.a (mon.0) 7632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:20 smithi179 bash[23186]: audit 2024-09-21T01:44:20.187473+0000 mon.a (mon.0) 7633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:20 smithi179 bash[23186]: audit 2024-09-21T01:44:20.247592+0000 mon.a (mon.0) 7634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:20 smithi179 bash[23186]: audit 2024-09-21T01:44:20.255318+0000 mon.a (mon.0) 7635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:20 smithi179 bash[23186]: audit 2024-09-21T01:44:20.265309+0000 mon.a (mon.0) 7636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:20 smithi044 bash[22676]: cluster 2024-09-21T01:44:19.286588+0000 mgr.a (mgr.14388) 9082 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:20 smithi044 bash[22676]: audit 2024-09-21T01:44:20.170047+0000 mon.a (mon.0) 7631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:20 smithi044 bash[22676]: audit 2024-09-21T01:44:20.177823+0000 mon.a (mon.0) 7632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:20 smithi044 bash[22676]: audit 2024-09-21T01:44:20.187473+0000 mon.a (mon.0) 7633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:20 smithi044 bash[22676]: audit 2024-09-21T01:44:20.247592+0000 mon.a (mon.0) 7634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:20 smithi044 bash[22676]: audit 2024-09-21T01:44:20.255318+0000 mon.a (mon.0) 7635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:20 smithi044 bash[22676]: audit 2024-09-21T01:44:20.265309+0000 mon.a (mon.0) 7636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:20 smithi049 bash[23528]: cluster 2024-09-21T01:44:19.286588+0000 mgr.a (mgr.14388) 9082 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:20 smithi049 bash[23528]: audit 2024-09-21T01:44:20.170047+0000 mon.a (mon.0) 7631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:20 smithi049 bash[23528]: audit 2024-09-21T01:44:20.177823+0000 mon.a (mon.0) 7632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:20 smithi049 bash[23528]: audit 2024-09-21T01:44:20.187473+0000 mon.a (mon.0) 7633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:20 smithi049 bash[23528]: audit 2024-09-21T01:44:20.247592+0000 mon.a (mon.0) 7634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:20 smithi049 bash[23528]: audit 2024-09-21T01:44:20.255318+0000 mon.a (mon.0) 7635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:20 smithi049 bash[23528]: audit 2024-09-21T01:44:20.265309+0000 mon.a (mon.0) 7636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:22.680 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:22 smithi049 bash[23528]: cluster 2024-09-21T01:44:21.288945+0000 mgr.a (mgr.14388) 9083 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:22.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:22 smithi044 bash[22676]: cluster 2024-09-21T01:44:21.288945+0000 mgr.a (mgr.14388) 9083 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:22 smithi179 bash[23186]: cluster 2024-09-21T01:44:21.288945+0000 mgr.a (mgr.14388) 9083 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:23.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:23.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:23.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:23.921 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:24 smithi044 bash[22676]: cluster 2024-09-21T01:44:23.289552+0000 mgr.a (mgr.14388) 9084 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:24 smithi044 bash[22676]: audit 2024-09-21T01:44:23.500390+0000 mgr.a (mgr.14388) 9085 : audit [DBG] from='client.202311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:24 smithi179 bash[23186]: cluster 2024-09-21T01:44:23.289552+0000 mgr.a (mgr.14388) 9084 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:24 smithi179 bash[23186]: audit 2024-09-21T01:44:23.500390+0000 mgr.a (mgr.14388) 9085 : audit [DBG] from='client.202311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:24 smithi049 bash[23528]: cluster 2024-09-21T01:44:23.289552+0000 mgr.a (mgr.14388) 9084 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:24 smithi049 bash[23528]: audit 2024-09-21T01:44:23.500390+0000 mgr.a (mgr.14388) 9085 : audit [DBG] from='client.202311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:26 smithi044 bash[22676]: cluster 2024-09-21T01:44:25.291505+0000 mgr.a (mgr.14388) 9086 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:26 smithi179 bash[23186]: cluster 2024-09-21T01:44:25.291505+0000 mgr.a (mgr.14388) 9086 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:26 smithi049 bash[23528]: cluster 2024-09-21T01:44:25.291505+0000 mgr.a (mgr.14388) 9086 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:28 smithi044 bash[22676]: cluster 2024-09-21T01:44:27.292440+0000 mgr.a (mgr.14388) 9087 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:28 smithi044 bash[22676]: audit 2024-09-21T01:44:27.380857+0000 mon.a (mon.0) 7637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:28 smithi044 bash[22676]: audit 2024-09-21T01:44:27.389902+0000 mon.a (mon.0) 7638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:28 smithi044 bash[22676]: audit 2024-09-21T01:44:27.400854+0000 mon.a (mon.0) 7639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:28 smithi179 bash[23186]: cluster 2024-09-21T01:44:27.292440+0000 mgr.a (mgr.14388) 9087 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:28 smithi179 bash[23186]: audit 2024-09-21T01:44:27.380857+0000 mon.a (mon.0) 7637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:28 smithi179 bash[23186]: audit 2024-09-21T01:44:27.389902+0000 mon.a (mon.0) 7638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:28 smithi179 bash[23186]: audit 2024-09-21T01:44:27.400854+0000 mon.a (mon.0) 7639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:28 smithi049 bash[23528]: cluster 2024-09-21T01:44:27.292440+0000 mgr.a (mgr.14388) 9087 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:28 smithi049 bash[23528]: audit 2024-09-21T01:44:27.380857+0000 mon.a (mon.0) 7637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:28 smithi049 bash[23528]: audit 2024-09-21T01:44:27.389902+0000 mon.a (mon.0) 7638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:28 smithi049 bash[23528]: audit 2024-09-21T01:44:27.400854+0000 mon.a (mon.0) 7639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:28.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:28.924 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:30 smithi044 bash[22676]: audit 2024-09-21T01:44:29.261007+0000 mgr.a (mgr.14388) 9088 : audit [DBG] from='client.202386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:30 smithi044 bash[22676]: cluster 2024-09-21T01:44:29.293517+0000 mgr.a (mgr.14388) 9089 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:30 smithi179 bash[23186]: audit 2024-09-21T01:44:29.261007+0000 mgr.a (mgr.14388) 9088 : audit [DBG] from='client.202386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:30 smithi179 bash[23186]: cluster 2024-09-21T01:44:29.293517+0000 mgr.a (mgr.14388) 9089 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:30 smithi049 bash[23528]: audit 2024-09-21T01:44:29.261007+0000 mgr.a (mgr.14388) 9088 : audit [DBG] from='client.202386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:30 smithi049 bash[23528]: cluster 2024-09-21T01:44:29.293517+0000 mgr.a (mgr.14388) 9089 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:32 smithi044 bash[22676]: cluster 2024-09-21T01:44:31.295818+0000 mgr.a (mgr.14388) 9090 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:32 smithi179 bash[23186]: cluster 2024-09-21T01:44:31.295818+0000 mgr.a (mgr.14388) 9090 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:32 smithi049 bash[23528]: cluster 2024-09-21T01:44:31.295818+0000 mgr.a (mgr.14388) 9090 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:44:34.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:34.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:34 smithi044 bash[22676]: cluster 2024-09-21T01:44:33.296581+0000 mgr.a (mgr.14388) 9091 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:34 smithi179 bash[23186]: cluster 2024-09-21T01:44:33.296581+0000 mgr.a (mgr.14388) 9091 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:34 smithi049 bash[23528]: cluster 2024-09-21T01:44:33.296581+0000 mgr.a (mgr.14388) 9091 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:35.488 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:35.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:35.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:35.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:35.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:36 smithi044 bash[22676]: audit 2024-09-21T01:44:35.045997+0000 mgr.a (mgr.14388) 9092 : audit [DBG] from='client.202461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:36 smithi044 bash[22676]: cluster 2024-09-21T01:44:35.297978+0000 mgr.a (mgr.14388) 9093 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:36 smithi179 bash[23186]: audit 2024-09-21T01:44:35.045997+0000 mgr.a (mgr.14388) 9092 : audit [DBG] from='client.202461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:36 smithi179 bash[23186]: cluster 2024-09-21T01:44:35.297978+0000 mgr.a (mgr.14388) 9093 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:36 smithi049 bash[23528]: audit 2024-09-21T01:44:35.045997+0000 mgr.a (mgr.14388) 9092 : audit [DBG] from='client.202461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:36 smithi049 bash[23528]: cluster 2024-09-21T01:44:35.297978+0000 mgr.a (mgr.14388) 9093 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:38 smithi044 bash[22676]: cluster 2024-09-21T01:44:37.298845+0000 mgr.a (mgr.14388) 9094 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:38 smithi179 bash[23186]: cluster 2024-09-21T01:44:37.298845+0000 mgr.a (mgr.14388) 9094 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:38 smithi049 bash[23528]: cluster 2024-09-21T01:44:37.298845+0000 mgr.a (mgr.14388) 9094 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:40.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:40.490 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:40.490 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:40 smithi044 bash[22676]: cluster 2024-09-21T01:44:39.299644+0000 mgr.a (mgr.14388) 9095 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:40.786 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:40 smithi044 bash[22676]: audit 2024-09-21T01:44:40.380352+0000 mon.a (mon.0) 7640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.786 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:40 smithi044 bash[22676]: audit 2024-09-21T01:44:40.388266+0000 mon.a (mon.0) 7641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.787 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:40 smithi044 bash[22676]: audit 2024-09-21T01:44:40.398651+0000 mon.a (mon.0) 7642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.787 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:40 smithi179 bash[23186]: cluster 2024-09-21T01:44:39.299644+0000 mgr.a (mgr.14388) 9095 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:40.787 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:40 smithi179 bash[23186]: audit 2024-09-21T01:44:40.380352+0000 mon.a (mon.0) 7640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.787 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:40 smithi179 bash[23186]: audit 2024-09-21T01:44:40.388266+0000 mon.a (mon.0) 7641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.787 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:40 smithi179 bash[23186]: audit 2024-09-21T01:44:40.398651+0000 mon.a (mon.0) 7642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:40 smithi049 bash[23528]: cluster 2024-09-21T01:44:39.299644+0000 mgr.a (mgr.14388) 9095 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:40 smithi049 bash[23528]: audit 2024-09-21T01:44:40.380352+0000 mon.a (mon.0) 7640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:40 smithi049 bash[23528]: audit 2024-09-21T01:44:40.388266+0000 mon.a (mon.0) 7641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:40 smithi049 bash[23528]: audit 2024-09-21T01:44:40.398651+0000 mon.a (mon.0) 7642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.276 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:41 smithi044 bash[22676]: audit 2024-09-21T01:44:40.470159+0000 mon.a (mon.0) 7643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:41 smithi044 bash[22676]: audit 2024-09-21T01:44:40.476389+0000 mon.a (mon.0) 7644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:41 smithi044 bash[22676]: audit 2024-09-21T01:44:40.482658+0000 mon.a (mon.0) 7645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:41 smithi179 bash[23186]: audit 2024-09-21T01:44:40.470159+0000 mon.a (mon.0) 7643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:41 smithi179 bash[23186]: audit 2024-09-21T01:44:40.476389+0000 mon.a (mon.0) 7644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:41 smithi179 bash[23186]: audit 2024-09-21T01:44:40.482658+0000 mon.a (mon.0) 7645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:41 smithi049 bash[23528]: audit 2024-09-21T01:44:40.470159+0000 mon.a (mon.0) 7643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:41 smithi049 bash[23528]: audit 2024-09-21T01:44:40.476389+0000 mon.a (mon.0) 7644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:41 smithi049 bash[23528]: audit 2024-09-21T01:44:40.482658+0000 mon.a (mon.0) 7645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:42 smithi044 bash[22676]: audit 2024-09-21T01:44:40.823356+0000 mgr.a (mgr.14388) 9096 : audit [DBG] from='client.202539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:42 smithi044 bash[22676]: cluster 2024-09-21T01:44:41.301234+0000 mgr.a (mgr.14388) 9097 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:42 smithi179 bash[23186]: audit 2024-09-21T01:44:40.823356+0000 mgr.a (mgr.14388) 9096 : audit [DBG] from='client.202539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:42 smithi179 bash[23186]: cluster 2024-09-21T01:44:41.301234+0000 mgr.a (mgr.14388) 9097 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:42 smithi049 bash[23528]: audit 2024-09-21T01:44:40.823356+0000 mgr.a (mgr.14388) 9096 : audit [DBG] from='client.202539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:42 smithi049 bash[23528]: cluster 2024-09-21T01:44:41.301234+0000 mgr.a (mgr.14388) 9097 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:44.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:44 smithi044 bash[22676]: cluster 2024-09-21T01:44:43.301978+0000 mgr.a (mgr.14388) 9098 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:44 smithi179 bash[23186]: cluster 2024-09-21T01:44:43.301978+0000 mgr.a (mgr.14388) 9098 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:44.777 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:44 smithi049 bash[23528]: cluster 2024-09-21T01:44:43.301978+0000 mgr.a (mgr.14388) 9098 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:44:46.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:46.278 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:46.279 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:46 smithi179 bash[23186]: cluster 2024-09-21T01:44:45.303544+0000 mgr.a (mgr.14388) 9099 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:46 smithi049 bash[23528]: cluster 2024-09-21T01:44:45.303544+0000 mgr.a (mgr.14388) 9099 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:46.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:46 smithi044 bash[22676]: cluster 2024-09-21T01:44:45.303544+0000 mgr.a (mgr.14388) 9099 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:47.057 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:47 smithi179 bash[23186]: audit 2024-09-21T01:44:46.614711+0000 mgr.a (mgr.14388) 9100 : audit [DBG] from='client.202614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:47 smithi049 bash[23528]: audit 2024-09-21T01:44:46.614711+0000 mgr.a (mgr.14388) 9100 : audit [DBG] from='client.202614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:47 smithi044 bash[22676]: audit 2024-09-21T01:44:46.614711+0000 mgr.a (mgr.14388) 9100 : audit [DBG] from='client.202614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:48 smithi044 bash[22676]: cluster 2024-09-21T01:44:47.304457+0000 mgr.a (mgr.14388) 9101 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:48 smithi044 bash[22676]: audit 2024-09-21T01:44:47.617737+0000 mon.a (mon.0) 7646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:48 smithi044 bash[22676]: audit 2024-09-21T01:44:47.628082+0000 mon.a (mon.0) 7647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:48 smithi044 bash[22676]: audit 2024-09-21T01:44:47.640519+0000 mon.a (mon.0) 7648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:48 smithi179 bash[23186]: cluster 2024-09-21T01:44:47.304457+0000 mgr.a (mgr.14388) 9101 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:48 smithi179 bash[23186]: audit 2024-09-21T01:44:47.617737+0000 mon.a (mon.0) 7646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:48 smithi179 bash[23186]: audit 2024-09-21T01:44:47.628082+0000 mon.a (mon.0) 7647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:48 smithi179 bash[23186]: audit 2024-09-21T01:44:47.640519+0000 mon.a (mon.0) 7648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:48 smithi049 bash[23528]: cluster 2024-09-21T01:44:47.304457+0000 mgr.a (mgr.14388) 9101 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:48 smithi049 bash[23528]: audit 2024-09-21T01:44:47.617737+0000 mon.a (mon.0) 7646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:48 smithi049 bash[23528]: audit 2024-09-21T01:44:47.628082+0000 mon.a (mon.0) 7647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:48 smithi049 bash[23528]: audit 2024-09-21T01:44:47.640519+0000 mon.a (mon.0) 7648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:44:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:50 smithi044 bash[22676]: cluster 2024-09-21T01:44:49.305317+0000 mgr.a (mgr.14388) 9102 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:51.010 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:50 smithi179 bash[23186]: cluster 2024-09-21T01:44:49.305317+0000 mgr.a (mgr.14388) 9102 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:50 smithi049 bash[23528]: cluster 2024-09-21T01:44:49.305317+0000 mgr.a (mgr.14388) 9102 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:52.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:52.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:52.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:52.852 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:52 smithi044 bash[22676]: cluster 2024-09-21T01:44:51.307492+0000 mgr.a (mgr.14388) 9103 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:52 smithi179 bash[23186]: cluster 2024-09-21T01:44:51.307492+0000 mgr.a (mgr.14388) 9103 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:52 smithi049 bash[23528]: cluster 2024-09-21T01:44:51.307492+0000 mgr.a (mgr.14388) 9103 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:53 smithi044 bash[22676]: audit 2024-09-21T01:44:52.398068+0000 mgr.a (mgr.14388) 9104 : audit [DBG] from='client.202689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:53 smithi179 bash[23186]: audit 2024-09-21T01:44:52.398068+0000 mgr.a (mgr.14388) 9104 : audit [DBG] from='client.202689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:53 smithi049 bash[23528]: audit 2024-09-21T01:44:52.398068+0000 mgr.a (mgr.14388) 9104 : audit [DBG] from='client.202689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:54 smithi044 bash[22676]: cluster 2024-09-21T01:44:53.308426+0000 mgr.a (mgr.14388) 9105 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:54 smithi179 bash[23186]: cluster 2024-09-21T01:44:53.308426+0000 mgr.a (mgr.14388) 9105 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:54 smithi049 bash[23528]: cluster 2024-09-21T01:44:53.308426+0000 mgr.a (mgr.14388) 9105 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:56 smithi179 bash[23186]: cluster 2024-09-21T01:44:55.310611+0000 mgr.a (mgr.14388) 9106 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:56 smithi044 bash[22676]: cluster 2024-09-21T01:44:55.310611+0000 mgr.a (mgr.14388) 9106 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:56 smithi049 bash[23528]: cluster 2024-09-21T01:44:55.310611+0000 mgr.a (mgr.14388) 9106 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:44:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:44:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:44:57.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:44:58.628 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:44:58.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:44:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:44:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:44:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:44:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:58 smithi044 bash[22676]: cluster 2024-09-21T01:44:57.311362+0000 mgr.a (mgr.14388) 9107 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:58 smithi179 bash[23186]: cluster 2024-09-21T01:44:57.311362+0000 mgr.a (mgr.14388) 9107 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:58 smithi049 bash[23528]: cluster 2024-09-21T01:44:57.311362+0000 mgr.a (mgr.14388) 9107 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:44:59.973 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:44:59 smithi179 bash[23186]: audit 2024-09-21T01:44:58.191755+0000 mgr.a (mgr.14388) 9108 : audit [DBG] from='client.202767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:44:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:44:59 smithi044 bash[22676]: audit 2024-09-21T01:44:58.191755+0000 mgr.a (mgr.14388) 9108 : audit [DBG] from='client.202767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:44:59 smithi049 bash[23528]: audit 2024-09-21T01:44:58.191755+0000 mgr.a (mgr.14388) 9108 : audit [DBG] from='client.202767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:00 smithi044 bash[22676]: cluster 2024-09-21T01:44:59.312238+0000 mgr.a (mgr.14388) 9109 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:00 smithi044 bash[22676]: audit 2024-09-21T01:45:00.592465+0000 mon.a (mon.0) 7649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:00 smithi044 bash[22676]: audit 2024-09-21T01:45:00.600032+0000 mon.a (mon.0) 7650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:00 smithi044 bash[22676]: audit 2024-09-21T01:45:00.609306+0000 mon.a (mon.0) 7651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:00 smithi179 bash[23186]: cluster 2024-09-21T01:44:59.312238+0000 mgr.a (mgr.14388) 9109 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:00 smithi179 bash[23186]: audit 2024-09-21T01:45:00.592465+0000 mon.a (mon.0) 7649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:00 smithi179 bash[23186]: audit 2024-09-21T01:45:00.600032+0000 mon.a (mon.0) 7650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:00 smithi179 bash[23186]: audit 2024-09-21T01:45:00.609306+0000 mon.a (mon.0) 7651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:00 smithi049 bash[23528]: cluster 2024-09-21T01:44:59.312238+0000 mgr.a (mgr.14388) 9109 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:00 smithi049 bash[23528]: audit 2024-09-21T01:45:00.592465+0000 mon.a (mon.0) 7649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:00 smithi049 bash[23528]: audit 2024-09-21T01:45:00.600032+0000 mon.a (mon.0) 7650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:00 smithi049 bash[23528]: audit 2024-09-21T01:45:00.609306+0000 mon.a (mon.0) 7651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:01 smithi179 bash[23186]: audit 2024-09-21T01:45:00.688950+0000 mon.a (mon.0) 7652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.941 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:01 smithi179 bash[23186]: audit 2024-09-21T01:45:00.696881+0000 mon.a (mon.0) 7653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.941 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:01 smithi179 bash[23186]: audit 2024-09-21T01:45:00.705855+0000 mon.a (mon.0) 7654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.950 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:01 smithi044 bash[22676]: audit 2024-09-21T01:45:00.688950+0000 mon.a (mon.0) 7652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.950 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:01 smithi044 bash[22676]: audit 2024-09-21T01:45:00.696881+0000 mon.a (mon.0) 7653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:01.950 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:01 smithi044 bash[22676]: audit 2024-09-21T01:45:00.705855+0000 mon.a (mon.0) 7654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:01 smithi049 bash[23528]: audit 2024-09-21T01:45:00.688950+0000 mon.a (mon.0) 7652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:01 smithi049 bash[23528]: audit 2024-09-21T01:45:00.696881+0000 mon.a (mon.0) 7653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:01 smithi049 bash[23528]: audit 2024-09-21T01:45:00.705855+0000 mon.a (mon.0) 7654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:02 smithi044 bash[22676]: cluster 2024-09-21T01:45:01.314102+0000 mgr.a (mgr.14388) 9110 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:02 smithi179 bash[23186]: cluster 2024-09-21T01:45:01.314102+0000 mgr.a (mgr.14388) 9110 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:02 smithi049 bash[23528]: cluster 2024-09-21T01:45:01.314102+0000 mgr.a (mgr.14388) 9110 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:03.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:04.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:04.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:04.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:04.405 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:04 smithi044 bash[22676]: cluster 2024-09-21T01:45:03.314880+0000 mgr.a (mgr.14388) 9111 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:04.990 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:04 smithi049 bash[23528]: cluster 2024-09-21T01:45:03.314880+0000 mgr.a (mgr.14388) 9111 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:04 smithi179 bash[23186]: cluster 2024-09-21T01:45:03.314880+0000 mgr.a (mgr.14388) 9111 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:05 smithi044 bash[22676]: audit 2024-09-21T01:45:03.968179+0000 mgr.a (mgr.14388) 9112 : audit [DBG] from='client.202845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:05 smithi179 bash[23186]: audit 2024-09-21T01:45:03.968179+0000 mgr.a (mgr.14388) 9112 : audit [DBG] from='client.202845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:05 smithi049 bash[23528]: audit 2024-09-21T01:45:03.968179+0000 mgr.a (mgr.14388) 9112 : audit [DBG] from='client.202845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:06 smithi044 bash[22676]: cluster 2024-09-21T01:45:05.317139+0000 mgr.a (mgr.14388) 9113 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:06 smithi179 bash[23186]: cluster 2024-09-21T01:45:05.317139+0000 mgr.a (mgr.14388) 9113 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:06 smithi049 bash[23528]: cluster 2024-09-21T01:45:05.317139+0000 mgr.a (mgr.14388) 9113 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:08 smithi044 bash[22676]: cluster 2024-09-21T01:45:07.317895+0000 mgr.a (mgr.14388) 9114 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:08 smithi044 bash[22676]: audit 2024-09-21T01:45:07.856309+0000 mon.a (mon.0) 7655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:08 smithi044 bash[22676]: audit 2024-09-21T01:45:07.865593+0000 mon.a (mon.0) 7656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:08 smithi044 bash[22676]: audit 2024-09-21T01:45:07.876199+0000 mon.a (mon.0) 7657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:08 smithi179 bash[23186]: cluster 2024-09-21T01:45:07.317895+0000 mgr.a (mgr.14388) 9114 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:08 smithi179 bash[23186]: audit 2024-09-21T01:45:07.856309+0000 mon.a (mon.0) 7655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:08 smithi179 bash[23186]: audit 2024-09-21T01:45:07.865593+0000 mon.a (mon.0) 7656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:08 smithi179 bash[23186]: audit 2024-09-21T01:45:07.876199+0000 mon.a (mon.0) 7657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:08 smithi049 bash[23528]: cluster 2024-09-21T01:45:07.317895+0000 mgr.a (mgr.14388) 9114 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:08 smithi049 bash[23528]: audit 2024-09-21T01:45:07.856309+0000 mon.a (mon.0) 7655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:08 smithi049 bash[23528]: audit 2024-09-21T01:45:07.865593+0000 mon.a (mon.0) 7656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:08 smithi049 bash[23528]: audit 2024-09-21T01:45:07.876199+0000 mon.a (mon.0) 7657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:09.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:09.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:09.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:10.190 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:10.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:10.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:10 smithi044 bash[22676]: cluster 2024-09-21T01:45:09.318765+0000 mgr.a (mgr.14388) 9115 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:10 smithi179 bash[23186]: cluster 2024-09-21T01:45:09.318765+0000 mgr.a (mgr.14388) 9115 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:10 smithi049 bash[23528]: cluster 2024-09-21T01:45:09.318765+0000 mgr.a (mgr.14388) 9115 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:11 smithi179 bash[23186]: audit 2024-09-21T01:45:09.748277+0000 mgr.a (mgr.14388) 9116 : audit [DBG] from='client.202917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:11 smithi049 bash[23528]: audit 2024-09-21T01:45:09.748277+0000 mgr.a (mgr.14388) 9116 : audit [DBG] from='client.202917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:11 smithi044 bash[22676]: audit 2024-09-21T01:45:09.748277+0000 mgr.a (mgr.14388) 9116 : audit [DBG] from='client.202917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:12 smithi179 bash[23186]: cluster 2024-09-21T01:45:11.321149+0000 mgr.a (mgr.14388) 9117 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:45:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:12 smithi049 bash[23528]: cluster 2024-09-21T01:45:11.321149+0000 mgr.a (mgr.14388) 9117 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:45:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:12 smithi044 bash[22676]: cluster 2024-09-21T01:45:11.321149+0000 mgr.a (mgr.14388) 9117 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:45:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:13 smithi049 bash[23528]: cluster 2024-09-21T01:45:13.321935+0000 mgr.a (mgr.14388) 9118 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:45:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:13 smithi044 bash[22676]: cluster 2024-09-21T01:45:13.321935+0000 mgr.a (mgr.14388) 9118 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:45:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:13 smithi179 bash[23186]: cluster 2024-09-21T01:45:13.321935+0000 mgr.a (mgr.14388) 9118 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:45:15.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:15.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:15.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:15.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:15.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:16 smithi044 bash[22676]: cluster 2024-09-21T01:45:15.322956+0000 mgr.a (mgr.14388) 9119 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:16 smithi044 bash[22676]: audit 2024-09-21T01:45:15.533041+0000 mgr.a (mgr.14388) 9120 : audit [DBG] from='client.202995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:16 smithi179 bash[23186]: cluster 2024-09-21T01:45:15.322956+0000 mgr.a (mgr.14388) 9119 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:16 smithi179 bash[23186]: audit 2024-09-21T01:45:15.533041+0000 mgr.a (mgr.14388) 9120 : audit [DBG] from='client.202995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:16 smithi049 bash[23528]: cluster 2024-09-21T01:45:15.322956+0000 mgr.a (mgr.14388) 9119 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:16 smithi049 bash[23528]: audit 2024-09-21T01:45:15.533041+0000 mgr.a (mgr.14388) 9120 : audit [DBG] from='client.202995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:17.670 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:17 smithi179 bash[23186]: audit 2024-09-21T01:45:16.801269+0000 mon.a (mon.0) 7658 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:45:17.670 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:17 smithi179 bash[23186]: audit 2024-09-21T01:45:16.808785+0000 mon.a (mon.0) 7659 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:45:17.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:17 smithi179 bash[23186]: audit 2024-09-21T01:45:16.810761+0000 mon.a (mon.0) 7660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:45:17.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:17 smithi179 bash[23186]: audit 2024-09-21T01:45:16.822281+0000 mon.a (mon.0) 7661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:17.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:17 smithi179 bash[23186]: audit 2024-09-21T01:45:16.828639+0000 mon.a (mon.0) 7662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:45:17.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:45:17 smithi044 bash[22930]: debug 2024-09-21T01:45:17.568+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:45:17.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:45:17 smithi044 bash[22930]: debug 2024-09-21T01:45:17.568+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:45:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:17 smithi044 bash[22676]: audit 2024-09-21T01:45:16.801269+0000 mon.a (mon.0) 7658 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:45:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:17 smithi044 bash[22676]: audit 2024-09-21T01:45:16.808785+0000 mon.a (mon.0) 7659 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:45:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:17 smithi044 bash[22676]: audit 2024-09-21T01:45:16.810761+0000 mon.a (mon.0) 7660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:45:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:17 smithi044 bash[22676]: audit 2024-09-21T01:45:16.822281+0000 mon.a (mon.0) 7661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:17 smithi044 bash[22676]: audit 2024-09-21T01:45:16.828639+0000 mon.a (mon.0) 7662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:17 smithi049 bash[23528]: audit 2024-09-21T01:45:16.801269+0000 mon.a (mon.0) 7658 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:17 smithi049 bash[23528]: audit 2024-09-21T01:45:16.808785+0000 mon.a (mon.0) 7659 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:17 smithi049 bash[23528]: audit 2024-09-21T01:45:16.810761+0000 mon.a (mon.0) 7660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:17 smithi049 bash[23528]: audit 2024-09-21T01:45:16.822281+0000 mon.a (mon.0) 7661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:17 smithi049 bash[23528]: audit 2024-09-21T01:45:16.828639+0000 mon.a (mon.0) 7662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:45:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:18 smithi044 bash[22676]: audit 2024-09-21T01:45:16.831612+0000 mgr.a (mgr.14388) 9121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:45:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:18 smithi044 bash[22676]: cluster 2024-09-21T01:45:17.323465+0000 mgr.a (mgr.14388) 9122 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:45:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:18 smithi044 bash[22676]: audit 2024-09-21T01:45:17.569473+0000 mgr.a (mgr.14388) 9123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:45:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:18 smithi044 bash[22676]: cephadm 2024-09-21T01:45:17.570649+0000 mgr.a (mgr.14388) 9124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:45:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:18 smithi179 bash[23186]: audit 2024-09-21T01:45:16.831612+0000 mgr.a (mgr.14388) 9121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:45:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:18 smithi179 bash[23186]: cluster 2024-09-21T01:45:17.323465+0000 mgr.a (mgr.14388) 9122 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:45:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:18 smithi179 bash[23186]: audit 2024-09-21T01:45:17.569473+0000 mgr.a (mgr.14388) 9123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:45:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:18 smithi179 bash[23186]: cephadm 2024-09-21T01:45:17.570649+0000 mgr.a (mgr.14388) 9124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:45:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:18 smithi049 bash[23528]: audit 2024-09-21T01:45:16.831612+0000 mgr.a (mgr.14388) 9121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:45:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:18 smithi049 bash[23528]: cluster 2024-09-21T01:45:17.323465+0000 mgr.a (mgr.14388) 9122 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:45:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:18 smithi049 bash[23528]: audit 2024-09-21T01:45:17.569473+0000 mgr.a (mgr.14388) 9123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:45:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:18 smithi049 bash[23528]: cephadm 2024-09-21T01:45:17.570649+0000 mgr.a (mgr.14388) 9124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:45:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:20 smithi179 bash[23186]: cluster 2024-09-21T01:45:19.324357+0000 mgr.a (mgr.14388) 9125 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:45:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:20 smithi044 bash[22676]: cluster 2024-09-21T01:45:19.324357+0000 mgr.a (mgr.14388) 9125 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:45:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:20 smithi049 bash[23528]: cluster 2024-09-21T01:45:19.324357+0000 mgr.a (mgr.14388) 9125 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:45:20.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:20.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:20.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:21.762 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: audit 2024-09-21T01:45:20.796699+0000 mon.a (mon.0) 7663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: audit 2024-09-21T01:45:20.808260+0000 mon.a (mon.0) 7664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: audit 2024-09-21T01:45:20.822386+0000 mon.a (mon.0) 7665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: audit 2024-09-21T01:45:20.901510+0000 mon.a (mon.0) 7666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: audit 2024-09-21T01:45:20.908240+0000 mon.a (mon.0) 7667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: audit 2024-09-21T01:45:20.913293+0000 mon.a (mon.0) 7668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: audit 2024-09-21T01:45:21.309523+0000 mgr.a (mgr.14388) 9126 : audit [DBG] from='client.203175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:21 smithi049 bash[23528]: cluster 2024-09-21T01:45:21.332449+0000 mgr.a (mgr.14388) 9127 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: audit 2024-09-21T01:45:20.796699+0000 mon.a (mon.0) 7663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: audit 2024-09-21T01:45:20.808260+0000 mon.a (mon.0) 7664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: audit 2024-09-21T01:45:20.822386+0000 mon.a (mon.0) 7665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: audit 2024-09-21T01:45:20.901510+0000 mon.a (mon.0) 7666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: audit 2024-09-21T01:45:20.908240+0000 mon.a (mon.0) 7667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: audit 2024-09-21T01:45:20.913293+0000 mon.a (mon.0) 7668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: audit 2024-09-21T01:45:21.309523+0000 mgr.a (mgr.14388) 9126 : audit [DBG] from='client.203175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:21 smithi044 bash[22676]: cluster 2024-09-21T01:45:21.332449+0000 mgr.a (mgr.14388) 9127 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: audit 2024-09-21T01:45:20.796699+0000 mon.a (mon.0) 7663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: audit 2024-09-21T01:45:20.808260+0000 mon.a (mon.0) 7664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: audit 2024-09-21T01:45:20.822386+0000 mon.a (mon.0) 7665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: audit 2024-09-21T01:45:20.901510+0000 mon.a (mon.0) 7666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: audit 2024-09-21T01:45:20.908240+0000 mon.a (mon.0) 7667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: audit 2024-09-21T01:45:20.913293+0000 mon.a (mon.0) 7668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: audit 2024-09-21T01:45:21.309523+0000 mgr.a (mgr.14388) 9126 : audit [DBG] from='client.203175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:21 smithi179 bash[23186]: cluster 2024-09-21T01:45:21.332449+0000 mgr.a (mgr.14388) 9127 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:24 smithi044 bash[22676]: cluster 2024-09-21T01:45:23.333085+0000 mgr.a (mgr.14388) 9128 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:45:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:24 smithi049 bash[23528]: cluster 2024-09-21T01:45:23.333085+0000 mgr.a (mgr.14388) 9128 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:45:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:24 smithi179 bash[23186]: cluster 2024-09-21T01:45:23.333085+0000 mgr.a (mgr.14388) 9128 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:45:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:26 smithi044 bash[22676]: cluster 2024-09-21T01:45:25.335187+0000 mgr.a (mgr.14388) 9129 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:26 smithi179 bash[23186]: cluster 2024-09-21T01:45:25.335187+0000 mgr.a (mgr.14388) 9129 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:26.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:26.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:26.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:26 smithi049 bash[23528]: cluster 2024-09-21T01:45:25.335187+0000 mgr.a (mgr.14388) 9129 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:27.535 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:27.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:27.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:27.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:27.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:28 smithi044 bash[22676]: audit 2024-09-21T01:45:27.100427+0000 mgr.a (mgr.14388) 9130 : audit [DBG] from='client.203250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:28 smithi044 bash[22676]: cluster 2024-09-21T01:45:27.339693+0000 mgr.a (mgr.14388) 9131 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:28 smithi044 bash[22676]: audit 2024-09-21T01:45:28.092160+0000 mon.a (mon.0) 7669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:28 smithi044 bash[22676]: audit 2024-09-21T01:45:28.101121+0000 mon.a (mon.0) 7670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:28 smithi044 bash[22676]: audit 2024-09-21T01:45:28.112142+0000 mon.a (mon.0) 7671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:28 smithi179 bash[23186]: audit 2024-09-21T01:45:27.100427+0000 mgr.a (mgr.14388) 9130 : audit [DBG] from='client.203250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:28 smithi179 bash[23186]: cluster 2024-09-21T01:45:27.339693+0000 mgr.a (mgr.14388) 9131 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:28 smithi179 bash[23186]: audit 2024-09-21T01:45:28.092160+0000 mon.a (mon.0) 7669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:28 smithi179 bash[23186]: audit 2024-09-21T01:45:28.101121+0000 mon.a (mon.0) 7670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:28 smithi179 bash[23186]: audit 2024-09-21T01:45:28.112142+0000 mon.a (mon.0) 7671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:28 smithi049 bash[23528]: audit 2024-09-21T01:45:27.100427+0000 mgr.a (mgr.14388) 9130 : audit [DBG] from='client.203250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:28 smithi049 bash[23528]: cluster 2024-09-21T01:45:27.339693+0000 mgr.a (mgr.14388) 9131 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:28 smithi049 bash[23528]: audit 2024-09-21T01:45:28.092160+0000 mon.a (mon.0) 7669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:28 smithi049 bash[23528]: audit 2024-09-21T01:45:28.101121+0000 mon.a (mon.0) 7670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:28 smithi049 bash[23528]: audit 2024-09-21T01:45:28.112142+0000 mon.a (mon.0) 7671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:30 smithi044 bash[22676]: cluster 2024-09-21T01:45:29.340602+0000 mgr.a (mgr.14388) 9132 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:30 smithi179 bash[23186]: cluster 2024-09-21T01:45:29.340602+0000 mgr.a (mgr.14388) 9132 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:30 smithi049 bash[23528]: cluster 2024-09-21T01:45:29.340602+0000 mgr.a (mgr.14388) 9132 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:32.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:32.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:32.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:32 smithi044 bash[22676]: cluster 2024-09-21T01:45:31.342826+0000 mgr.a (mgr.14388) 9133 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:32 smithi179 bash[23186]: cluster 2024-09-21T01:45:31.342826+0000 mgr.a (mgr.14388) 9133 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:32 smithi049 bash[23528]: cluster 2024-09-21T01:45:31.342826+0000 mgr.a (mgr.14388) 9133 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:45:33.332 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:34 smithi044 bash[22676]: audit 2024-09-21T01:45:32.878427+0000 mgr.a (mgr.14388) 9134 : audit [DBG] from='client.203325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:34 smithi044 bash[22676]: cluster 2024-09-21T01:45:33.343419+0000 mgr.a (mgr.14388) 9135 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:34 smithi179 bash[23186]: audit 2024-09-21T01:45:32.878427+0000 mgr.a (mgr.14388) 9134 : audit [DBG] from='client.203325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:34 smithi179 bash[23186]: cluster 2024-09-21T01:45:33.343419+0000 mgr.a (mgr.14388) 9135 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:34.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:34 smithi049 bash[23528]: audit 2024-09-21T01:45:32.878427+0000 mgr.a (mgr.14388) 9134 : audit [DBG] from='client.203325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:34 smithi049 bash[23528]: cluster 2024-09-21T01:45:33.343419+0000 mgr.a (mgr.14388) 9135 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:36 smithi044 bash[22676]: cluster 2024-09-21T01:45:35.345734+0000 mgr.a (mgr.14388) 9136 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:36 smithi179 bash[23186]: cluster 2024-09-21T01:45:35.345734+0000 mgr.a (mgr.14388) 9136 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:36 smithi049 bash[23528]: cluster 2024-09-21T01:45:35.345734+0000 mgr.a (mgr.14388) 9136 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:38.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:38.334 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:38.335 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:38.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:38 smithi044 bash[22676]: cluster 2024-09-21T01:45:37.346596+0000 mgr.a (mgr.14388) 9137 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:38 smithi179 bash[23186]: cluster 2024-09-21T01:45:37.346596+0000 mgr.a (mgr.14388) 9137 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:38.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:38 smithi049 bash[23528]: cluster 2024-09-21T01:45:37.346596+0000 mgr.a (mgr.14388) 9137 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:39.082 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:39.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:39.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:39.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:39.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:39 smithi044 bash[22676]: audit 2024-09-21T01:45:38.668794+0000 mgr.a (mgr.14388) 9138 : audit [DBG] from='client.203400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:39 smithi179 bash[23186]: audit 2024-09-21T01:45:38.668794+0000 mgr.a (mgr.14388) 9138 : audit [DBG] from='client.203400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:39.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:39 smithi049 bash[23528]: audit 2024-09-21T01:45:38.668794+0000 mgr.a (mgr.14388) 9138 : audit [DBG] from='client.203400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:40 smithi179 bash[23186]: cluster 2024-09-21T01:45:39.347603+0000 mgr.a (mgr.14388) 9139 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:40 smithi044 bash[22676]: cluster 2024-09-21T01:45:39.347603+0000 mgr.a (mgr.14388) 9139 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:40 smithi049 bash[23528]: cluster 2024-09-21T01:45:39.347603+0000 mgr.a (mgr.14388) 9139 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:42 smithi049 bash[23528]: audit 2024-09-21T01:45:41.022941+0000 mon.a (mon.0) 7672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:42 smithi049 bash[23528]: audit 2024-09-21T01:45:41.030097+0000 mon.a (mon.0) 7673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:42 smithi049 bash[23528]: audit 2024-09-21T01:45:41.039449+0000 mon.a (mon.0) 7674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:42 smithi049 bash[23528]: audit 2024-09-21T01:45:41.128352+0000 mon.a (mon.0) 7675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:42 smithi049 bash[23528]: audit 2024-09-21T01:45:41.136476+0000 mon.a (mon.0) 7676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:42 smithi049 bash[23528]: audit 2024-09-21T01:45:41.146570+0000 mon.a (mon.0) 7677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:42 smithi049 bash[23528]: cluster 2024-09-21T01:45:41.349885+0000 mgr.a (mgr.14388) 9140 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:42 smithi044 bash[22676]: audit 2024-09-21T01:45:41.022941+0000 mon.a (mon.0) 7672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:42 smithi044 bash[22676]: audit 2024-09-21T01:45:41.030097+0000 mon.a (mon.0) 7673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:42 smithi044 bash[22676]: audit 2024-09-21T01:45:41.039449+0000 mon.a (mon.0) 7674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:42 smithi044 bash[22676]: audit 2024-09-21T01:45:41.128352+0000 mon.a (mon.0) 7675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:42 smithi044 bash[22676]: audit 2024-09-21T01:45:41.136476+0000 mon.a (mon.0) 7676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:42 smithi044 bash[22676]: audit 2024-09-21T01:45:41.146570+0000 mon.a (mon.0) 7677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:42 smithi044 bash[22676]: cluster 2024-09-21T01:45:41.349885+0000 mgr.a (mgr.14388) 9140 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:42 smithi179 bash[23186]: audit 2024-09-21T01:45:41.022941+0000 mon.a (mon.0) 7672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:42 smithi179 bash[23186]: audit 2024-09-21T01:45:41.030097+0000 mon.a (mon.0) 7673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:42 smithi179 bash[23186]: audit 2024-09-21T01:45:41.039449+0000 mon.a (mon.0) 7674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:42 smithi179 bash[23186]: audit 2024-09-21T01:45:41.128352+0000 mon.a (mon.0) 7675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:42 smithi179 bash[23186]: audit 2024-09-21T01:45:41.136476+0000 mon.a (mon.0) 7676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:42 smithi179 bash[23186]: audit 2024-09-21T01:45:41.146570+0000 mon.a (mon.0) 7677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:42.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:42 smithi179 bash[23186]: cluster 2024-09-21T01:45:41.349885+0000 mgr.a (mgr.14388) 9140 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:44.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:44.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:44.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:44 smithi179 bash[23186]: cluster 2024-09-21T01:45:43.350662+0000 mgr.a (mgr.14388) 9141 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:44.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:44 smithi044 bash[22676]: cluster 2024-09-21T01:45:43.350662+0000 mgr.a (mgr.14388) 9141 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:44 smithi049 bash[23528]: cluster 2024-09-21T01:45:43.350662+0000 mgr.a (mgr.14388) 9141 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:44.861 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:44.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:44.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:44.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:44.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:45.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:45 smithi044 bash[22676]: audit 2024-09-21T01:45:44.420330+0000 mgr.a (mgr.14388) 9142 : audit [DBG] from='client.203478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:45 smithi179 bash[23186]: audit 2024-09-21T01:45:44.420330+0000 mgr.a (mgr.14388) 9142 : audit [DBG] from='client.203478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:45 smithi049 bash[23528]: audit 2024-09-21T01:45:44.420330+0000 mgr.a (mgr.14388) 9142 : audit [DBG] from='client.203478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:46 smithi049 bash[23528]: cluster 2024-09-21T01:45:45.353116+0000 mgr.a (mgr.14388) 9143 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:46 smithi044 bash[22676]: cluster 2024-09-21T01:45:45.353116+0000 mgr.a (mgr.14388) 9143 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:46 smithi179 bash[23186]: cluster 2024-09-21T01:45:45.353116+0000 mgr.a (mgr.14388) 9143 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:45:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:48 smithi044 bash[22676]: cluster 2024-09-21T01:45:47.353940+0000 mgr.a (mgr.14388) 9144 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:48 smithi044 bash[22676]: audit 2024-09-21T01:45:48.328260+0000 mon.a (mon.0) 7678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:48 smithi044 bash[22676]: audit 2024-09-21T01:45:48.338760+0000 mon.a (mon.0) 7679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:48 smithi044 bash[22676]: audit 2024-09-21T01:45:48.350975+0000 mon.a (mon.0) 7680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:48 smithi179 bash[23186]: cluster 2024-09-21T01:45:47.353940+0000 mgr.a (mgr.14388) 9144 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:48 smithi179 bash[23186]: audit 2024-09-21T01:45:48.328260+0000 mon.a (mon.0) 7678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:48 smithi179 bash[23186]: audit 2024-09-21T01:45:48.338760+0000 mon.a (mon.0) 7679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:48 smithi179 bash[23186]: audit 2024-09-21T01:45:48.350975+0000 mon.a (mon.0) 7680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:48 smithi049 bash[23528]: cluster 2024-09-21T01:45:47.353940+0000 mgr.a (mgr.14388) 9144 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:48 smithi049 bash[23528]: audit 2024-09-21T01:45:48.328260+0000 mon.a (mon.0) 7678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:48 smithi049 bash[23528]: audit 2024-09-21T01:45:48.338760+0000 mon.a (mon.0) 7679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:48 smithi049 bash[23528]: audit 2024-09-21T01:45:48.350975+0000 mon.a (mon.0) 7680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:45:49.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:49.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:49.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:50.626 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:50.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:50 smithi044 bash[22676]: cluster 2024-09-21T01:45:49.354755+0000 mgr.a (mgr.14388) 9145 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:50 smithi179 bash[23186]: cluster 2024-09-21T01:45:49.354755+0000 mgr.a (mgr.14388) 9145 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:50 smithi049 bash[23528]: cluster 2024-09-21T01:45:49.354755+0000 mgr.a (mgr.14388) 9145 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:45:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:51 smithi044 bash[22676]: audit 2024-09-21T01:45:50.199355+0000 mgr.a (mgr.14388) 9146 : audit [DBG] from='client.203553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:51 smithi179 bash[23186]: audit 2024-09-21T01:45:50.199355+0000 mgr.a (mgr.14388) 9146 : audit [DBG] from='client.203553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:51 smithi049 bash[23528]: audit 2024-09-21T01:45:50.199355+0000 mgr.a (mgr.14388) 9146 : audit [DBG] from='client.203553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:52 smithi044 bash[22676]: cluster 2024-09-21T01:45:51.357694+0000 mgr.a (mgr.14388) 9147 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:45:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:52 smithi179 bash[23186]: cluster 2024-09-21T01:45:51.357694+0000 mgr.a (mgr.14388) 9147 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:45:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:52 smithi049 bash[23528]: cluster 2024-09-21T01:45:51.357694+0000 mgr.a (mgr.14388) 9147 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:45:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:54 smithi044 bash[22676]: cluster 2024-09-21T01:45:53.358480+0000 mgr.a (mgr.14388) 9148 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:45:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:54 smithi179 bash[23186]: cluster 2024-09-21T01:45:53.358480+0000 mgr.a (mgr.14388) 9148 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:45:54.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:54 smithi049 bash[23528]: cluster 2024-09-21T01:45:53.358480+0000 mgr.a (mgr.14388) 9148 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:45:55.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:45:55.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:45:55.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:45:56.409 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:45:56.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:45:56.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:45:56.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:45:56.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:45:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:56 smithi044 bash[22676]: cluster 2024-09-21T01:45:55.360459+0000 mgr.a (mgr.14388) 9149 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:45:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:56 smithi179 bash[23186]: cluster 2024-09-21T01:45:55.360459+0000 mgr.a (mgr.14388) 9149 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:45:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:56 smithi049 bash[23528]: cluster 2024-09-21T01:45:55.360459+0000 mgr.a (mgr.14388) 9149 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:45:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:57 smithi044 bash[22676]: audit 2024-09-21T01:45:55.968691+0000 mgr.a (mgr.14388) 9150 : audit [DBG] from='client.203631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:57.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:57 smithi179 bash[23186]: audit 2024-09-21T01:45:55.968691+0000 mgr.a (mgr.14388) 9150 : audit [DBG] from='client.203631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:57 smithi049 bash[23528]: audit 2024-09-21T01:45:55.968691+0000 mgr.a (mgr.14388) 9150 : audit [DBG] from='client.203631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:45:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:45:58 smithi044 bash[22676]: cluster 2024-09-21T01:45:57.361504+0000 mgr.a (mgr.14388) 9151 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:45:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:45:58 smithi179 bash[23186]: cluster 2024-09-21T01:45:57.361504+0000 mgr.a (mgr.14388) 9151 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:45:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:45:58 smithi049 bash[23528]: cluster 2024-09-21T01:45:57.361504+0000 mgr.a (mgr.14388) 9151 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:46:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:00 smithi044 bash[22676]: cluster 2024-09-21T01:45:59.362321+0000 mgr.a (mgr.14388) 9152 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:46:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:00 smithi179 bash[23186]: cluster 2024-09-21T01:45:59.362321+0000 mgr.a (mgr.14388) 9152 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:46:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:00 smithi049 bash[23528]: cluster 2024-09-21T01:45:59.362321+0000 mgr.a (mgr.14388) 9152 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T01:46:01.411 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:01.412 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:01.412 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:02.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:02 smithi044 bash[22676]: audit 2024-09-21T01:46:01.231273+0000 mon.a (mon.0) 7681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:02 smithi044 bash[22676]: audit 2024-09-21T01:46:01.240969+0000 mon.a (mon.0) 7682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:02 smithi044 bash[22676]: audit 2024-09-21T01:46:01.251648+0000 mon.a (mon.0) 7683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:02 smithi044 bash[22676]: audit 2024-09-21T01:46:01.354447+0000 mon.a (mon.0) 7684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:02 smithi044 bash[22676]: audit 2024-09-21T01:46:01.363100+0000 mon.a (mon.0) 7685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:02 smithi044 bash[22676]: cluster 2024-09-21T01:46:01.364547+0000 mgr.a (mgr.14388) 9153 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:46:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:02 smithi044 bash[22676]: audit 2024-09-21T01:46:01.374823+0000 mon.a (mon.0) 7686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:02 smithi179 bash[23186]: audit 2024-09-21T01:46:01.231273+0000 mon.a (mon.0) 7681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:02 smithi179 bash[23186]: audit 2024-09-21T01:46:01.240969+0000 mon.a (mon.0) 7682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:02 smithi179 bash[23186]: audit 2024-09-21T01:46:01.251648+0000 mon.a (mon.0) 7683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:02 smithi179 bash[23186]: audit 2024-09-21T01:46:01.354447+0000 mon.a (mon.0) 7684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:02 smithi179 bash[23186]: audit 2024-09-21T01:46:01.363100+0000 mon.a (mon.0) 7685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:02 smithi179 bash[23186]: cluster 2024-09-21T01:46:01.364547+0000 mgr.a (mgr.14388) 9153 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:46:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:02 smithi179 bash[23186]: audit 2024-09-21T01:46:01.374823+0000 mon.a (mon.0) 7686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:02 smithi049 bash[23528]: audit 2024-09-21T01:46:01.231273+0000 mon.a (mon.0) 7681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:02 smithi049 bash[23528]: audit 2024-09-21T01:46:01.240969+0000 mon.a (mon.0) 7682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:02 smithi049 bash[23528]: audit 2024-09-21T01:46:01.251648+0000 mon.a (mon.0) 7683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:02 smithi049 bash[23528]: audit 2024-09-21T01:46:01.354447+0000 mon.a (mon.0) 7684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:02 smithi049 bash[23528]: audit 2024-09-21T01:46:01.363100+0000 mon.a (mon.0) 7685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:02 smithi049 bash[23528]: cluster 2024-09-21T01:46:01.364547+0000 mgr.a (mgr.14388) 9153 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:46:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:02 smithi049 bash[23528]: audit 2024-09-21T01:46:01.374823+0000 mon.a (mon.0) 7686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:03.713 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:03 smithi044 bash[22676]: audit 2024-09-21T01:46:01.774484+0000 mgr.a (mgr.14388) 9154 : audit [DBG] from='client.203706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:03 smithi179 bash[23186]: audit 2024-09-21T01:46:01.774484+0000 mgr.a (mgr.14388) 9154 : audit [DBG] from='client.203706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:03 smithi049 bash[23528]: audit 2024-09-21T01:46:01.774484+0000 mgr.a (mgr.14388) 9154 : audit [DBG] from='client.203706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:04 smithi049 bash[23528]: cluster 2024-09-21T01:46:03.365556+0000 mgr.a (mgr.14388) 9155 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:04.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:04 smithi044 bash[22676]: cluster 2024-09-21T01:46:03.365556+0000 mgr.a (mgr.14388) 9155 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:04 smithi179 bash[23186]: cluster 2024-09-21T01:46:03.365556+0000 mgr.a (mgr.14388) 9155 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:06.641 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:06 smithi044 bash[22676]: cluster 2024-09-21T01:46:05.367861+0000 mgr.a (mgr.14388) 9156 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:06 smithi179 bash[23186]: cluster 2024-09-21T01:46:05.367861+0000 mgr.a (mgr.14388) 9156 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:06.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:06 smithi049 bash[23528]: cluster 2024-09-21T01:46:05.367861+0000 mgr.a (mgr.14388) 9156 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:08.033 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:08.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:08 smithi049 bash[23528]: cluster 2024-09-21T01:46:07.368325+0000 mgr.a (mgr.14388) 9157 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:08.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:08 smithi049 bash[23528]: audit 2024-09-21T01:46:07.582327+0000 mgr.a (mgr.14388) 9158 : audit [DBG] from='client.203781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:08 smithi044 bash[22676]: cluster 2024-09-21T01:46:07.368325+0000 mgr.a (mgr.14388) 9157 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:08 smithi044 bash[22676]: audit 2024-09-21T01:46:07.582327+0000 mgr.a (mgr.14388) 9158 : audit [DBG] from='client.203781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:08 smithi179 bash[23186]: cluster 2024-09-21T01:46:07.368325+0000 mgr.a (mgr.14388) 9157 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:08 smithi179 bash[23186]: audit 2024-09-21T01:46:07.582327+0000 mgr.a (mgr.14388) 9158 : audit [DBG] from='client.203781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:09 smithi044 bash[22676]: audit 2024-09-21T01:46:08.565600+0000 mon.a (mon.0) 7687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:09 smithi044 bash[22676]: audit 2024-09-21T01:46:08.574826+0000 mon.a (mon.0) 7688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:09 smithi044 bash[22676]: audit 2024-09-21T01:46:08.587090+0000 mon.a (mon.0) 7689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:09 smithi179 bash[23186]: audit 2024-09-21T01:46:08.565600+0000 mon.a (mon.0) 7687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:09 smithi179 bash[23186]: audit 2024-09-21T01:46:08.574826+0000 mon.a (mon.0) 7688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:09 smithi179 bash[23186]: audit 2024-09-21T01:46:08.587090+0000 mon.a (mon.0) 7689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:09 smithi049 bash[23528]: audit 2024-09-21T01:46:08.565600+0000 mon.a (mon.0) 7687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:10.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:09 smithi049 bash[23528]: audit 2024-09-21T01:46:08.574826+0000 mon.a (mon.0) 7688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:09 smithi049 bash[23528]: audit 2024-09-21T01:46:08.587090+0000 mon.a (mon.0) 7689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:10 smithi044 bash[22676]: cluster 2024-09-21T01:46:09.369297+0000 mgr.a (mgr.14388) 9159 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:10 smithi179 bash[23186]: cluster 2024-09-21T01:46:09.369297+0000 mgr.a (mgr.14388) 9159 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:10 smithi049 bash[23528]: cluster 2024-09-21T01:46:09.369297+0000 mgr.a (mgr.14388) 9159 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:12 smithi044 bash[22676]: cluster 2024-09-21T01:46:11.371584+0000 mgr.a (mgr.14388) 9160 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:12 smithi179 bash[23186]: cluster 2024-09-21T01:46:11.371584+0000 mgr.a (mgr.14388) 9160 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:13.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:13.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:13.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:12 smithi049 bash[23528]: cluster 2024-09-21T01:46:11.371584+0000 mgr.a (mgr.14388) 9160 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:14 smithi044 bash[22676]: audit 2024-09-21T01:46:13.372799+0000 mgr.a (mgr.14388) 9161 : audit [DBG] from='client.203859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:14 smithi044 bash[22676]: cluster 2024-09-21T01:46:13.373458+0000 mgr.a (mgr.14388) 9162 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:14 smithi179 bash[23186]: audit 2024-09-21T01:46:13.372799+0000 mgr.a (mgr.14388) 9161 : audit [DBG] from='client.203859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:14 smithi179 bash[23186]: cluster 2024-09-21T01:46:13.373458+0000 mgr.a (mgr.14388) 9162 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:14 smithi049 bash[23528]: audit 2024-09-21T01:46:13.372799+0000 mgr.a (mgr.14388) 9161 : audit [DBG] from='client.203859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:14 smithi049 bash[23528]: cluster 2024-09-21T01:46:13.373458+0000 mgr.a (mgr.14388) 9162 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:46:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:16 smithi044 bash[22676]: cluster 2024-09-21T01:46:15.375801+0000 mgr.a (mgr.14388) 9163 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:16 smithi179 bash[23186]: cluster 2024-09-21T01:46:15.375801+0000 mgr.a (mgr.14388) 9163 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:16 smithi049 bash[23528]: cluster 2024-09-21T01:46:15.375801+0000 mgr.a (mgr.14388) 9163 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:46:18.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22930]: debug 2024-09-21T01:46:18.415+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:46:18.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22930]: debug 2024-09-21T01:46:18.415+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:46:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22676]: cluster 2024-09-21T01:46:17.376629+0000 mgr.a (mgr.14388) 9164 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22676]: audit 2024-09-21T01:46:17.623031+0000 mon.a (mon.0) 7690 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:46:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22676]: audit 2024-09-21T01:46:17.629991+0000 mon.a (mon.0) 7691 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:46:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22676]: audit 2024-09-21T01:46:17.631733+0000 mon.a (mon.0) 7692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:46:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22676]: audit 2024-09-21T01:46:17.643065+0000 mon.a (mon.0) 7693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22676]: audit 2024-09-21T01:46:17.649641+0000 mon.a (mon.0) 7694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:46:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:18 smithi044 bash[22676]: audit 2024-09-21T01:46:17.652023+0000 mgr.a (mgr.14388) 9165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:46:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:18.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:18 smithi179 bash[23186]: cluster 2024-09-21T01:46:17.376629+0000 mgr.a (mgr.14388) 9164 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:18.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:18 smithi179 bash[23186]: audit 2024-09-21T01:46:17.623031+0000 mon.a (mon.0) 7690 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:46:18.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:18 smithi179 bash[23186]: audit 2024-09-21T01:46:17.629991+0000 mon.a (mon.0) 7691 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:46:18.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:18 smithi179 bash[23186]: audit 2024-09-21T01:46:17.631733+0000 mon.a (mon.0) 7692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:46:18.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:18 smithi179 bash[23186]: audit 2024-09-21T01:46:17.643065+0000 mon.a (mon.0) 7693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:18.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:18 smithi179 bash[23186]: audit 2024-09-21T01:46:17.649641+0000 mon.a (mon.0) 7694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:46:18.902 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:18 smithi179 bash[23186]: audit 2024-09-21T01:46:17.652023+0000 mgr.a (mgr.14388) 9165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:46:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:18 smithi049 bash[23528]: cluster 2024-09-21T01:46:17.376629+0000 mgr.a (mgr.14388) 9164 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:18 smithi049 bash[23528]: audit 2024-09-21T01:46:17.623031+0000 mon.a (mon.0) 7690 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:46:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:18 smithi049 bash[23528]: audit 2024-09-21T01:46:17.629991+0000 mon.a (mon.0) 7691 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:46:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:18 smithi049 bash[23528]: audit 2024-09-21T01:46:17.631733+0000 mon.a (mon.0) 7692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:46:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:18 smithi049 bash[23528]: audit 2024-09-21T01:46:17.643065+0000 mon.a (mon.0) 7693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:18 smithi049 bash[23528]: audit 2024-09-21T01:46:17.649641+0000 mon.a (mon.0) 7694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:46:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:18 smithi049 bash[23528]: audit 2024-09-21T01:46:17.652023+0000 mgr.a (mgr.14388) 9165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:46:19.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:19.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:19.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:19.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:19.867 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:19 smithi179 bash[23186]: audit 2024-09-21T01:46:18.419629+0000 mgr.a (mgr.14388) 9166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:46:19.867 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:19 smithi179 bash[23186]: cephadm 2024-09-21T01:46:18.420864+0000 mgr.a (mgr.14388) 9167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:46:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:19 smithi044 bash[22676]: audit 2024-09-21T01:46:18.419629+0000 mgr.a (mgr.14388) 9166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:46:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:19 smithi044 bash[22676]: cephadm 2024-09-21T01:46:18.420864+0000 mgr.a (mgr.14388) 9167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:46:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:19 smithi049 bash[23528]: audit 2024-09-21T01:46:18.419629+0000 mgr.a (mgr.14388) 9166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:46:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:19 smithi049 bash[23528]: cephadm 2024-09-21T01:46:18.420864+0000 mgr.a (mgr.14388) 9167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:46:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:20 smithi044 bash[22676]: audit 2024-09-21T01:46:19.173227+0000 mgr.a (mgr.14388) 9168 : audit [DBG] from='client.204039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:20 smithi044 bash[22676]: cluster 2024-09-21T01:46:19.377292+0000 mgr.a (mgr.14388) 9169 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:20 smithi179 bash[23186]: audit 2024-09-21T01:46:19.173227+0000 mgr.a (mgr.14388) 9168 : audit [DBG] from='client.204039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:20 smithi179 bash[23186]: cluster 2024-09-21T01:46:19.377292+0000 mgr.a (mgr.14388) 9169 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:20 smithi049 bash[23528]: audit 2024-09-21T01:46:19.173227+0000 mgr.a (mgr.14388) 9168 : audit [DBG] from='client.204039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:20 smithi049 bash[23528]: cluster 2024-09-21T01:46:19.377292+0000 mgr.a (mgr.14388) 9169 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:22 smithi044 bash[22676]: cluster 2024-09-21T01:46:21.379633+0000 mgr.a (mgr.14388) 9170 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:22 smithi044 bash[22676]: audit 2024-09-21T01:46:21.442400+0000 mon.a (mon.0) 7695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:22 smithi044 bash[22676]: audit 2024-09-21T01:46:21.448864+0000 mon.a (mon.0) 7696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:22 smithi044 bash[22676]: audit 2024-09-21T01:46:21.458095+0000 mon.a (mon.0) 7697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:22 smithi044 bash[22676]: audit 2024-09-21T01:46:21.592910+0000 mon.a (mon.0) 7698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:22 smithi044 bash[22676]: audit 2024-09-21T01:46:21.602571+0000 mon.a (mon.0) 7699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:22 smithi044 bash[22676]: audit 2024-09-21T01:46:21.613664+0000 mon.a (mon.0) 7700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:22 smithi179 bash[23186]: cluster 2024-09-21T01:46:21.379633+0000 mgr.a (mgr.14388) 9170 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:22 smithi179 bash[23186]: audit 2024-09-21T01:46:21.442400+0000 mon.a (mon.0) 7695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:22 smithi179 bash[23186]: audit 2024-09-21T01:46:21.448864+0000 mon.a (mon.0) 7696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:22 smithi179 bash[23186]: audit 2024-09-21T01:46:21.458095+0000 mon.a (mon.0) 7697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:22 smithi179 bash[23186]: audit 2024-09-21T01:46:21.592910+0000 mon.a (mon.0) 7698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:22 smithi179 bash[23186]: audit 2024-09-21T01:46:21.602571+0000 mon.a (mon.0) 7699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:22 smithi179 bash[23186]: audit 2024-09-21T01:46:21.613664+0000 mon.a (mon.0) 7700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:22 smithi049 bash[23528]: cluster 2024-09-21T01:46:21.379633+0000 mgr.a (mgr.14388) 9170 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:22 smithi049 bash[23528]: audit 2024-09-21T01:46:21.442400+0000 mon.a (mon.0) 7695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:22 smithi049 bash[23528]: audit 2024-09-21T01:46:21.448864+0000 mon.a (mon.0) 7696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:22 smithi049 bash[23528]: audit 2024-09-21T01:46:21.458095+0000 mon.a (mon.0) 7697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:22 smithi049 bash[23528]: audit 2024-09-21T01:46:21.592910+0000 mon.a (mon.0) 7698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:22 smithi049 bash[23528]: audit 2024-09-21T01:46:21.602571+0000 mon.a (mon.0) 7699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:22 smithi049 bash[23528]: audit 2024-09-21T01:46:21.613664+0000 mon.a (mon.0) 7700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:24.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:24.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:24.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:24.708 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:24 smithi049 bash[23528]: cluster 2024-09-21T01:46:23.380433+0000 mgr.a (mgr.14388) 9171 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:24.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:24 smithi044 bash[22676]: cluster 2024-09-21T01:46:23.380433+0000 mgr.a (mgr.14388) 9171 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:24 smithi179 bash[23186]: cluster 2024-09-21T01:46:23.380433+0000 mgr.a (mgr.14388) 9171 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:25.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:26.713 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:26 smithi044 bash[22676]: audit 2024-09-21T01:46:24.954518+0000 mgr.a (mgr.14388) 9172 : audit [DBG] from='client.204117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:26.713 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:26 smithi044 bash[22676]: cluster 2024-09-21T01:46:25.381816+0000 mgr.a (mgr.14388) 9173 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:26 smithi179 bash[23186]: audit 2024-09-21T01:46:24.954518+0000 mgr.a (mgr.14388) 9172 : audit [DBG] from='client.204117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:26 smithi179 bash[23186]: cluster 2024-09-21T01:46:25.381816+0000 mgr.a (mgr.14388) 9173 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:26 smithi049 bash[23528]: audit 2024-09-21T01:46:24.954518+0000 mgr.a (mgr.14388) 9172 : audit [DBG] from='client.204117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:26 smithi049 bash[23528]: cluster 2024-09-21T01:46:25.381816+0000 mgr.a (mgr.14388) 9173 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:28 smithi044 bash[22676]: cluster 2024-09-21T01:46:27.382583+0000 mgr.a (mgr.14388) 9174 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:46:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:28 smithi179 bash[23186]: cluster 2024-09-21T01:46:27.382583+0000 mgr.a (mgr.14388) 9174 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:46:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:28 smithi049 bash[23528]: cluster 2024-09-21T01:46:27.382583+0000 mgr.a (mgr.14388) 9174 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:46:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:29 smithi049 bash[23528]: audit 2024-09-21T01:46:28.802076+0000 mon.a (mon.0) 7701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:29 smithi049 bash[23528]: audit 2024-09-21T01:46:28.811013+0000 mon.a (mon.0) 7702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:29 smithi049 bash[23528]: audit 2024-09-21T01:46:28.822838+0000 mon.a (mon.0) 7703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:29 smithi049 bash[23528]: cluster 2024-09-21T01:46:29.383392+0000 mgr.a (mgr.14388) 9175 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:46:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:29 smithi044 bash[22676]: audit 2024-09-21T01:46:28.802076+0000 mon.a (mon.0) 7701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:29 smithi044 bash[22676]: audit 2024-09-21T01:46:28.811013+0000 mon.a (mon.0) 7702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:29 smithi044 bash[22676]: audit 2024-09-21T01:46:28.822838+0000 mon.a (mon.0) 7703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:29 smithi044 bash[22676]: cluster 2024-09-21T01:46:29.383392+0000 mgr.a (mgr.14388) 9175 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:46:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:29 smithi179 bash[23186]: audit 2024-09-21T01:46:28.802076+0000 mon.a (mon.0) 7701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:29 smithi179 bash[23186]: audit 2024-09-21T01:46:28.811013+0000 mon.a (mon.0) 7702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:29 smithi179 bash[23186]: audit 2024-09-21T01:46:28.822838+0000 mon.a (mon.0) 7703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:29 smithi179 bash[23186]: cluster 2024-09-21T01:46:29.383392+0000 mgr.a (mgr.14388) 9175 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:46:30.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:30.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:30.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:31.126 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:31.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:31.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:31.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:31.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:31.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:30 smithi044 bash[22676]: audit 2024-09-21T01:46:30.694330+0000 mgr.a (mgr.14388) 9176 : audit [DBG] from='client.204195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:30 smithi179 bash[23186]: audit 2024-09-21T01:46:30.694330+0000 mgr.a (mgr.14388) 9176 : audit [DBG] from='client.204195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:30 smithi049 bash[23528]: audit 2024-09-21T01:46:30.694330+0000 mgr.a (mgr.14388) 9176 : audit [DBG] from='client.204195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:31 smithi044 bash[22676]: cluster 2024-09-21T01:46:31.386222+0000 mgr.a (mgr.14388) 9177 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:31 smithi179 bash[23186]: cluster 2024-09-21T01:46:31.386222+0000 mgr.a (mgr.14388) 9177 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:31 smithi049 bash[23528]: cluster 2024-09-21T01:46:31.386222+0000 mgr.a (mgr.14388) 9177 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:46:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:34 smithi044 bash[22676]: cluster 2024-09-21T01:46:33.387007+0000 mgr.a (mgr.14388) 9178 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:46:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:34 smithi179 bash[23186]: cluster 2024-09-21T01:46:33.387007+0000 mgr.a (mgr.14388) 9178 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:46:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:34 smithi049 bash[23528]: cluster 2024-09-21T01:46:33.387007+0000 mgr.a (mgr.14388) 9178 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:46:36.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:36.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:36.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:36.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:36 smithi044 bash[22676]: cluster 2024-09-21T01:46:35.388923+0000 mgr.a (mgr.14388) 9179 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:36 smithi179 bash[23186]: cluster 2024-09-21T01:46:35.388923+0000 mgr.a (mgr.14388) 9179 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:36 smithi049 bash[23528]: cluster 2024-09-21T01:46:35.388923+0000 mgr.a (mgr.14388) 9179 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:36.904 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:36.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:36.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:36.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:36.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:37 smithi044 bash[22676]: audit 2024-09-21T01:46:36.462294+0000 mgr.a (mgr.14388) 9180 : audit [DBG] from='client.204273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:37 smithi179 bash[23186]: audit 2024-09-21T01:46:36.462294+0000 mgr.a (mgr.14388) 9180 : audit [DBG] from='client.204273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:37.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:37 smithi049 bash[23528]: audit 2024-09-21T01:46:36.462294+0000 mgr.a (mgr.14388) 9180 : audit [DBG] from='client.204273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:38.676 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:38 smithi179 bash[23186]: cluster 2024-09-21T01:46:37.390126+0000 mgr.a (mgr.14388) 9181 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:38 smithi044 bash[22676]: cluster 2024-09-21T01:46:37.390126+0000 mgr.a (mgr.14388) 9181 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:38 smithi049 bash[23528]: cluster 2024-09-21T01:46:37.390126+0000 mgr.a (mgr.14388) 9181 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:40 smithi044 bash[22676]: cluster 2024-09-21T01:46:39.391005+0000 mgr.a (mgr.14388) 9182 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:40 smithi179 bash[23186]: cluster 2024-09-21T01:46:39.391005+0000 mgr.a (mgr.14388) 9182 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:40 smithi049 bash[23528]: cluster 2024-09-21T01:46:39.391005+0000 mgr.a (mgr.14388) 9182 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:41.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:42.669 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:42.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:42.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:42.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:42.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:42 smithi044 bash[22676]: cluster 2024-09-21T01:46:41.393264+0000 mgr.a (mgr.14388) 9183 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:42 smithi044 bash[22676]: audit 2024-09-21T01:46:41.654540+0000 mon.a (mon.0) 7704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:42 smithi044 bash[22676]: audit 2024-09-21T01:46:41.662276+0000 mon.a (mon.0) 7705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:42 smithi044 bash[22676]: audit 2024-09-21T01:46:41.674095+0000 mon.a (mon.0) 7706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:42 smithi044 bash[22676]: audit 2024-09-21T01:46:41.835601+0000 mon.a (mon.0) 7707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:42 smithi044 bash[22676]: audit 2024-09-21T01:46:41.843989+0000 mon.a (mon.0) 7708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:42 smithi044 bash[22676]: audit 2024-09-21T01:46:41.853994+0000 mon.a (mon.0) 7709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:42 smithi179 bash[23186]: cluster 2024-09-21T01:46:41.393264+0000 mgr.a (mgr.14388) 9183 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:42 smithi179 bash[23186]: audit 2024-09-21T01:46:41.654540+0000 mon.a (mon.0) 7704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:42 smithi179 bash[23186]: audit 2024-09-21T01:46:41.662276+0000 mon.a (mon.0) 7705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:42 smithi179 bash[23186]: audit 2024-09-21T01:46:41.674095+0000 mon.a (mon.0) 7706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:42 smithi179 bash[23186]: audit 2024-09-21T01:46:41.835601+0000 mon.a (mon.0) 7707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:42 smithi179 bash[23186]: audit 2024-09-21T01:46:41.843989+0000 mon.a (mon.0) 7708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:42 smithi179 bash[23186]: audit 2024-09-21T01:46:41.853994+0000 mon.a (mon.0) 7709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:42 smithi049 bash[23528]: cluster 2024-09-21T01:46:41.393264+0000 mgr.a (mgr.14388) 9183 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:42 smithi049 bash[23528]: audit 2024-09-21T01:46:41.654540+0000 mon.a (mon.0) 7704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:42 smithi049 bash[23528]: audit 2024-09-21T01:46:41.662276+0000 mon.a (mon.0) 7705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:42 smithi049 bash[23528]: audit 2024-09-21T01:46:41.674095+0000 mon.a (mon.0) 7706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:42 smithi049 bash[23528]: audit 2024-09-21T01:46:41.835601+0000 mon.a (mon.0) 7707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:42 smithi049 bash[23528]: audit 2024-09-21T01:46:41.843989+0000 mon.a (mon.0) 7708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:42 smithi049 bash[23528]: audit 2024-09-21T01:46:41.853994+0000 mon.a (mon.0) 7709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:43 smithi044 bash[22676]: audit 2024-09-21T01:46:42.244251+0000 mgr.a (mgr.14388) 9184 : audit [DBG] from='client.204351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:43.939 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:43 smithi049 bash[23528]: audit 2024-09-21T01:46:42.244251+0000 mgr.a (mgr.14388) 9184 : audit [DBG] from='client.204351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:43 smithi179 bash[23186]: audit 2024-09-21T01:46:42.244251+0000 mgr.a (mgr.14388) 9184 : audit [DBG] from='client.204351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:44.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:44 smithi049 bash[23528]: cluster 2024-09-21T01:46:43.394279+0000 mgr.a (mgr.14388) 9185 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:44 smithi044 bash[22676]: cluster 2024-09-21T01:46:43.394279+0000 mgr.a (mgr.14388) 9185 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:44 smithi179 bash[23186]: cluster 2024-09-21T01:46:43.394279+0000 mgr.a (mgr.14388) 9185 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:46.927 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:46 smithi044 bash[22676]: cluster 2024-09-21T01:46:45.395692+0000 mgr.a (mgr.14388) 9186 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:46 smithi179 bash[23186]: cluster 2024-09-21T01:46:45.395692+0000 mgr.a (mgr.14388) 9186 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:46 smithi049 bash[23528]: cluster 2024-09-21T01:46:45.395692+0000 mgr.a (mgr.14388) 9186 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:47.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:47.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:47.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:48.458 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:48.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:48.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:48.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:48.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:48 smithi044 bash[22676]: cluster 2024-09-21T01:46:47.396442+0000 mgr.a (mgr.14388) 9187 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:48 smithi179 bash[23186]: cluster 2024-09-21T01:46:47.396442+0000 mgr.a (mgr.14388) 9187 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:48 smithi049 bash[23528]: cluster 2024-09-21T01:46:47.396442+0000 mgr.a (mgr.14388) 9187 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:49 smithi044 bash[22676]: audit 2024-09-21T01:46:48.007506+0000 mgr.a (mgr.14388) 9188 : audit [DBG] from='client.204426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:49 smithi044 bash[22676]: audit 2024-09-21T01:46:49.038015+0000 mon.a (mon.0) 7710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:49 smithi044 bash[22676]: audit 2024-09-21T01:46:49.046567+0000 mon.a (mon.0) 7711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:49 smithi044 bash[22676]: audit 2024-09-21T01:46:49.057167+0000 mon.a (mon.0) 7712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:49 smithi179 bash[23186]: audit 2024-09-21T01:46:48.007506+0000 mgr.a (mgr.14388) 9188 : audit [DBG] from='client.204426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:49 smithi179 bash[23186]: audit 2024-09-21T01:46:49.038015+0000 mon.a (mon.0) 7710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:49 smithi179 bash[23186]: audit 2024-09-21T01:46:49.046567+0000 mon.a (mon.0) 7711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:49 smithi179 bash[23186]: audit 2024-09-21T01:46:49.057167+0000 mon.a (mon.0) 7712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:49 smithi049 bash[23528]: audit 2024-09-21T01:46:48.007506+0000 mgr.a (mgr.14388) 9188 : audit [DBG] from='client.204426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:49 smithi049 bash[23528]: audit 2024-09-21T01:46:49.038015+0000 mon.a (mon.0) 7710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:49 smithi049 bash[23528]: audit 2024-09-21T01:46:49.046567+0000 mon.a (mon.0) 7711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:49 smithi049 bash[23528]: audit 2024-09-21T01:46:49.057167+0000 mon.a (mon.0) 7712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:46:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:50 smithi044 bash[22676]: cluster 2024-09-21T01:46:49.397457+0000 mgr.a (mgr.14388) 9189 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:50 smithi179 bash[23186]: cluster 2024-09-21T01:46:49.397457+0000 mgr.a (mgr.14388) 9189 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:50 smithi049 bash[23528]: cluster 2024-09-21T01:46:49.397457+0000 mgr.a (mgr.14388) 9189 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:52 smithi044 bash[22676]: cluster 2024-09-21T01:46:51.399652+0000 mgr.a (mgr.14388) 9190 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:52 smithi179 bash[23186]: cluster 2024-09-21T01:46:51.399652+0000 mgr.a (mgr.14388) 9190 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:53.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:52 smithi049 bash[23528]: cluster 2024-09-21T01:46:51.399652+0000 mgr.a (mgr.14388) 9190 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:53.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:53.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:53.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:46:54.248 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:46:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:46:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:46:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:46:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:46:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:54 smithi044 bash[22676]: cluster 2024-09-21T01:46:53.400403+0000 mgr.a (mgr.14388) 9191 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:54 smithi179 bash[23186]: cluster 2024-09-21T01:46:53.400403+0000 mgr.a (mgr.14388) 9191 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:54 smithi049 bash[23528]: cluster 2024-09-21T01:46:53.400403+0000 mgr.a (mgr.14388) 9191 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:55 smithi044 bash[22676]: audit 2024-09-21T01:46:53.797589+0000 mgr.a (mgr.14388) 9192 : audit [DBG] from='client.204504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:55 smithi179 bash[23186]: audit 2024-09-21T01:46:53.797589+0000 mgr.a (mgr.14388) 9192 : audit [DBG] from='client.204504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:55 smithi049 bash[23528]: audit 2024-09-21T01:46:53.797589+0000 mgr.a (mgr.14388) 9192 : audit [DBG] from='client.204504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:46:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:56 smithi044 bash[22676]: cluster 2024-09-21T01:46:55.402740+0000 mgr.a (mgr.14388) 9193 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:56 smithi179 bash[23186]: cluster 2024-09-21T01:46:55.402740+0000 mgr.a (mgr.14388) 9193 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:56 smithi049 bash[23528]: cluster 2024-09-21T01:46:55.402740+0000 mgr.a (mgr.14388) 9193 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:46:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:46:58 smithi044 bash[22676]: cluster 2024-09-21T01:46:57.403539+0000 mgr.a (mgr.14388) 9194 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:46:58 smithi179 bash[23186]: cluster 2024-09-21T01:46:57.403539+0000 mgr.a (mgr.14388) 9194 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:46:58 smithi049 bash[23528]: cluster 2024-09-21T01:46:57.403539+0000 mgr.a (mgr.14388) 9194 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:46:59.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:46:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:46:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:00.039 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:00.979 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:00 smithi179 bash[23186]: cluster 2024-09-21T01:46:59.404283+0000 mgr.a (mgr.14388) 9195 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:00.980 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:00 smithi179 bash[23186]: audit 2024-09-21T01:46:59.586730+0000 mgr.a (mgr.14388) 9196 : audit [DBG] from='client.204579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:00 smithi044 bash[22676]: cluster 2024-09-21T01:46:59.404283+0000 mgr.a (mgr.14388) 9195 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:00 smithi044 bash[22676]: audit 2024-09-21T01:46:59.586730+0000 mgr.a (mgr.14388) 9196 : audit [DBG] from='client.204579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:00 smithi049 bash[23528]: cluster 2024-09-21T01:46:59.404283+0000 mgr.a (mgr.14388) 9195 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:00 smithi049 bash[23528]: audit 2024-09-21T01:46:59.586730+0000 mgr.a (mgr.14388) 9196 : audit [DBG] from='client.204579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:02 smithi044 bash[22676]: cluster 2024-09-21T01:47:01.407058+0000 mgr.a (mgr.14388) 9197 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:47:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:02 smithi044 bash[22676]: audit 2024-09-21T01:47:01.862784+0000 mon.a (mon.0) 7713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:02 smithi044 bash[22676]: audit 2024-09-21T01:47:01.870472+0000 mon.a (mon.0) 7714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:02 smithi044 bash[22676]: audit 2024-09-21T01:47:01.879219+0000 mon.a (mon.0) 7715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:02 smithi044 bash[22676]: audit 2024-09-21T01:47:02.038948+0000 mon.a (mon.0) 7716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:02 smithi044 bash[22676]: audit 2024-09-21T01:47:02.048676+0000 mon.a (mon.0) 7717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:02 smithi044 bash[22676]: audit 2024-09-21T01:47:02.060245+0000 mon.a (mon.0) 7718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:02 smithi179 bash[23186]: cluster 2024-09-21T01:47:01.407058+0000 mgr.a (mgr.14388) 9197 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:47:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:02 smithi179 bash[23186]: audit 2024-09-21T01:47:01.862784+0000 mon.a (mon.0) 7713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:02 smithi179 bash[23186]: audit 2024-09-21T01:47:01.870472+0000 mon.a (mon.0) 7714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:02 smithi179 bash[23186]: audit 2024-09-21T01:47:01.879219+0000 mon.a (mon.0) 7715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:02 smithi179 bash[23186]: audit 2024-09-21T01:47:02.038948+0000 mon.a (mon.0) 7716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:02 smithi179 bash[23186]: audit 2024-09-21T01:47:02.048676+0000 mon.a (mon.0) 7717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:02 smithi179 bash[23186]: audit 2024-09-21T01:47:02.060245+0000 mon.a (mon.0) 7718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:02 smithi049 bash[23528]: cluster 2024-09-21T01:47:01.407058+0000 mgr.a (mgr.14388) 9197 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:47:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:02 smithi049 bash[23528]: audit 2024-09-21T01:47:01.862784+0000 mon.a (mon.0) 7713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:02 smithi049 bash[23528]: audit 2024-09-21T01:47:01.870472+0000 mon.a (mon.0) 7714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:02 smithi049 bash[23528]: audit 2024-09-21T01:47:01.879219+0000 mon.a (mon.0) 7715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:02 smithi049 bash[23528]: audit 2024-09-21T01:47:02.038948+0000 mon.a (mon.0) 7716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:02 smithi049 bash[23528]: audit 2024-09-21T01:47:02.048676+0000 mon.a (mon.0) 7717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:02 smithi049 bash[23528]: audit 2024-09-21T01:47:02.060245+0000 mon.a (mon.0) 7718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:04.971 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:04 smithi044 bash[22676]: cluster 2024-09-21T01:47:03.407827+0000 mgr.a (mgr.14388) 9198 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:47:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:04 smithi179 bash[23186]: cluster 2024-09-21T01:47:03.407827+0000 mgr.a (mgr.14388) 9198 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:47:05.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:05.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:05.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:04 smithi049 bash[23528]: cluster 2024-09-21T01:47:03.407827+0000 mgr.a (mgr.14388) 9198 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:47:05.828 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:05.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:05.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:05.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:05.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:06 smithi044 bash[22676]: audit 2024-09-21T01:47:05.381751+0000 mgr.a (mgr.14388) 9199 : audit [DBG] from='client.204654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:06 smithi044 bash[22676]: cluster 2024-09-21T01:47:05.410754+0000 mgr.a (mgr.14388) 9200 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:06 smithi179 bash[23186]: audit 2024-09-21T01:47:05.381751+0000 mgr.a (mgr.14388) 9199 : audit [DBG] from='client.204654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:06 smithi179 bash[23186]: cluster 2024-09-21T01:47:05.410754+0000 mgr.a (mgr.14388) 9200 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:06 smithi049 bash[23528]: audit 2024-09-21T01:47:05.381751+0000 mgr.a (mgr.14388) 9199 : audit [DBG] from='client.204654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:06 smithi049 bash[23528]: cluster 2024-09-21T01:47:05.410754+0000 mgr.a (mgr.14388) 9200 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:08 smithi044 bash[22676]: cluster 2024-09-21T01:47:07.411710+0000 mgr.a (mgr.14388) 9201 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:08 smithi179 bash[23186]: cluster 2024-09-21T01:47:07.411710+0000 mgr.a (mgr.14388) 9201 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:08 smithi049 bash[23528]: cluster 2024-09-21T01:47:07.411710+0000 mgr.a (mgr.14388) 9201 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:10 smithi049 bash[23528]: audit 2024-09-21T01:47:09.278763+0000 mon.a (mon.0) 7719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:10 smithi049 bash[23528]: audit 2024-09-21T01:47:09.288652+0000 mon.a (mon.0) 7720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:10 smithi049 bash[23528]: audit 2024-09-21T01:47:09.299457+0000 mon.a (mon.0) 7721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:10 smithi049 bash[23528]: cluster 2024-09-21T01:47:09.412526+0000 mgr.a (mgr.14388) 9202 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:10 smithi044 bash[22676]: audit 2024-09-21T01:47:09.278763+0000 mon.a (mon.0) 7719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:10 smithi044 bash[22676]: audit 2024-09-21T01:47:09.288652+0000 mon.a (mon.0) 7720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:10 smithi044 bash[22676]: audit 2024-09-21T01:47:09.299457+0000 mon.a (mon.0) 7721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:10 smithi044 bash[22676]: cluster 2024-09-21T01:47:09.412526+0000 mgr.a (mgr.14388) 9202 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:10 smithi179 bash[23186]: audit 2024-09-21T01:47:09.278763+0000 mon.a (mon.0) 7719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:10 smithi179 bash[23186]: audit 2024-09-21T01:47:09.288652+0000 mon.a (mon.0) 7720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:10 smithi179 bash[23186]: audit 2024-09-21T01:47:09.299457+0000 mon.a (mon.0) 7721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:10 smithi179 bash[23186]: cluster 2024-09-21T01:47:09.412526+0000 mgr.a (mgr.14388) 9202 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:11.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:11.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:11.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:11.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:11.610 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:12 smithi044 bash[22676]: audit 2024-09-21T01:47:11.167897+0000 mgr.a (mgr.14388) 9203 : audit [DBG] from='client.95776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:12 smithi044 bash[22676]: cluster 2024-09-21T01:47:11.413927+0000 mgr.a (mgr.14388) 9204 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:12 smithi179 bash[23186]: audit 2024-09-21T01:47:11.167897+0000 mgr.a (mgr.14388) 9203 : audit [DBG] from='client.95776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:12 smithi179 bash[23186]: cluster 2024-09-21T01:47:11.413927+0000 mgr.a (mgr.14388) 9204 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:12.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:12 smithi049 bash[23528]: audit 2024-09-21T01:47:11.167897+0000 mgr.a (mgr.14388) 9203 : audit [DBG] from='client.95776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:12 smithi049 bash[23528]: cluster 2024-09-21T01:47:11.413927+0000 mgr.a (mgr.14388) 9204 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:14 smithi044 bash[22676]: cluster 2024-09-21T01:47:13.414775+0000 mgr.a (mgr.14388) 9205 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:47:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:14 smithi179 bash[23186]: cluster 2024-09-21T01:47:13.414775+0000 mgr.a (mgr.14388) 9205 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:47:14.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:14 smithi049 bash[23528]: cluster 2024-09-21T01:47:13.414775+0000 mgr.a (mgr.14388) 9205 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:47:16.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:16.612 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:16.612 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:16.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:16 smithi044 bash[22676]: cluster 2024-09-21T01:47:15.416978+0000 mgr.a (mgr.14388) 9206 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:47:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:16 smithi179 bash[23186]: cluster 2024-09-21T01:47:15.416978+0000 mgr.a (mgr.14388) 9206 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:47:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:16 smithi049 bash[23528]: cluster 2024-09-21T01:47:15.416978+0000 mgr.a (mgr.14388) 9206 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:47:17.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:17.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:17.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:17.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:17.366 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:18 smithi044 bash[22676]: audit 2024-09-21T01:47:16.946614+0000 mgr.a (mgr.14388) 9207 : audit [DBG] from='client.204810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:18 smithi044 bash[22676]: cluster 2024-09-21T01:47:17.417660+0000 mgr.a (mgr.14388) 9208 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:18.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:18 smithi179 bash[23186]: audit 2024-09-21T01:47:16.946614+0000 mgr.a (mgr.14388) 9207 : audit [DBG] from='client.204810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:18.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:18 smithi179 bash[23186]: cluster 2024-09-21T01:47:17.417660+0000 mgr.a (mgr.14388) 9208 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:18 smithi049 bash[23528]: audit 2024-09-21T01:47:16.946614+0000 mgr.a (mgr.14388) 9207 : audit [DBG] from='client.204810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:18 smithi049 bash[23528]: cluster 2024-09-21T01:47:17.417660+0000 mgr.a (mgr.14388) 9208 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:19.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22930]: debug 2024-09-21T01:47:19.266+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:47:19.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22930]: debug 2024-09-21T01:47:19.266+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:47:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22676]: audit 2024-09-21T01:47:18.481301+0000 mon.a (mon.0) 7722 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:47:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22676]: audit 2024-09-21T01:47:18.494054+0000 mon.a (mon.0) 7723 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:47:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22676]: audit 2024-09-21T01:47:18.496099+0000 mon.a (mon.0) 7724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:47:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22676]: audit 2024-09-21T01:47:18.507400+0000 mon.a (mon.0) 7725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22676]: audit 2024-09-21T01:47:18.513906+0000 mon.a (mon.0) 7726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:47:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:19 smithi044 bash[22676]: audit 2024-09-21T01:47:18.516739+0000 mgr.a (mgr.14388) 9209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:47:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:19 smithi179 bash[23186]: audit 2024-09-21T01:47:18.481301+0000 mon.a (mon.0) 7722 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:47:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:19 smithi179 bash[23186]: audit 2024-09-21T01:47:18.494054+0000 mon.a (mon.0) 7723 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:47:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:19 smithi179 bash[23186]: audit 2024-09-21T01:47:18.496099+0000 mon.a (mon.0) 7724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:47:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:19 smithi179 bash[23186]: audit 2024-09-21T01:47:18.507400+0000 mon.a (mon.0) 7725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:19 smithi179 bash[23186]: audit 2024-09-21T01:47:18.513906+0000 mon.a (mon.0) 7726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:47:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:19 smithi179 bash[23186]: audit 2024-09-21T01:47:18.516739+0000 mgr.a (mgr.14388) 9209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:47:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:19 smithi049 bash[23528]: audit 2024-09-21T01:47:18.481301+0000 mon.a (mon.0) 7722 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:47:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:19 smithi049 bash[23528]: audit 2024-09-21T01:47:18.494054+0000 mon.a (mon.0) 7723 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:47:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:19 smithi049 bash[23528]: audit 2024-09-21T01:47:18.496099+0000 mon.a (mon.0) 7724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:47:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:19 smithi049 bash[23528]: audit 2024-09-21T01:47:18.507400+0000 mon.a (mon.0) 7725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:19 smithi049 bash[23528]: audit 2024-09-21T01:47:18.513906+0000 mon.a (mon.0) 7726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:47:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:19 smithi049 bash[23528]: audit 2024-09-21T01:47:18.516739+0000 mgr.a (mgr.14388) 9209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:47:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:20 smithi049 bash[23528]: audit 2024-09-21T01:47:19.271746+0000 mgr.a (mgr.14388) 9210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:47:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:20 smithi049 bash[23528]: cephadm 2024-09-21T01:47:19.272968+0000 mgr.a (mgr.14388) 9211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:47:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:20 smithi049 bash[23528]: cluster 2024-09-21T01:47:19.418584+0000 mgr.a (mgr.14388) 9212 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:20 smithi044 bash[22676]: audit 2024-09-21T01:47:19.271746+0000 mgr.a (mgr.14388) 9210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:47:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:20 smithi044 bash[22676]: cephadm 2024-09-21T01:47:19.272968+0000 mgr.a (mgr.14388) 9211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:47:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:20 smithi044 bash[22676]: cluster 2024-09-21T01:47:19.418584+0000 mgr.a (mgr.14388) 9212 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:20 smithi179 bash[23186]: audit 2024-09-21T01:47:19.271746+0000 mgr.a (mgr.14388) 9210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:47:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:20 smithi179 bash[23186]: cephadm 2024-09-21T01:47:19.272968+0000 mgr.a (mgr.14388) 9211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:47:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:20 smithi179 bash[23186]: cluster 2024-09-21T01:47:19.418584+0000 mgr.a (mgr.14388) 9212 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:22.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:22.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:22.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:22 smithi044 bash[22676]: cluster 2024-09-21T01:47:21.420848+0000 mgr.a (mgr.14388) 9213 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:22 smithi044 bash[22676]: audit 2024-09-21T01:47:22.081807+0000 mon.a (mon.0) 7727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:22 smithi044 bash[22676]: audit 2024-09-21T01:47:22.089292+0000 mon.a (mon.0) 7728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:22 smithi044 bash[22676]: audit 2024-09-21T01:47:22.098453+0000 mon.a (mon.0) 7729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:22 smithi044 bash[22676]: audit 2024-09-21T01:47:22.268562+0000 mon.a (mon.0) 7730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:22 smithi044 bash[22676]: audit 2024-09-21T01:47:22.277899+0000 mon.a (mon.0) 7731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:22 smithi044 bash[22676]: audit 2024-09-21T01:47:22.288047+0000 mon.a (mon.0) 7732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:22 smithi049 bash[23528]: cluster 2024-09-21T01:47:21.420848+0000 mgr.a (mgr.14388) 9213 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:22 smithi049 bash[23528]: audit 2024-09-21T01:47:22.081807+0000 mon.a (mon.0) 7727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:22 smithi049 bash[23528]: audit 2024-09-21T01:47:22.089292+0000 mon.a (mon.0) 7728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:22 smithi049 bash[23528]: audit 2024-09-21T01:47:22.098453+0000 mon.a (mon.0) 7729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:22 smithi049 bash[23528]: audit 2024-09-21T01:47:22.268562+0000 mon.a (mon.0) 7730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:22 smithi049 bash[23528]: audit 2024-09-21T01:47:22.277899+0000 mon.a (mon.0) 7731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:22 smithi049 bash[23528]: audit 2024-09-21T01:47:22.288047+0000 mon.a (mon.0) 7732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:22 smithi179 bash[23186]: cluster 2024-09-21T01:47:21.420848+0000 mgr.a (mgr.14388) 9213 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:22 smithi179 bash[23186]: audit 2024-09-21T01:47:22.081807+0000 mon.a (mon.0) 7727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:22 smithi179 bash[23186]: audit 2024-09-21T01:47:22.089292+0000 mon.a (mon.0) 7728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:22 smithi179 bash[23186]: audit 2024-09-21T01:47:22.098453+0000 mon.a (mon.0) 7729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:22 smithi179 bash[23186]: audit 2024-09-21T01:47:22.268562+0000 mon.a (mon.0) 7730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:22 smithi179 bash[23186]: audit 2024-09-21T01:47:22.277899+0000 mon.a (mon.0) 7731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:22 smithi179 bash[23186]: audit 2024-09-21T01:47:22.288047+0000 mon.a (mon.0) 7732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:23.114 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:23 smithi049 bash[23528]: audit 2024-09-21T01:47:22.696538+0000 mgr.a (mgr.14388) 9214 : audit [DBG] from='client.204993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:23.862 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:23 smithi044 bash[22676]: audit 2024-09-21T01:47:22.696538+0000 mgr.a (mgr.14388) 9214 : audit [DBG] from='client.204993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:23 smithi179 bash[23186]: audit 2024-09-21T01:47:22.696538+0000 mgr.a (mgr.14388) 9214 : audit [DBG] from='client.204993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:24 smithi049 bash[23528]: cluster 2024-09-21T01:47:23.421864+0000 mgr.a (mgr.14388) 9215 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:24.834 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:24 smithi044 bash[22676]: cluster 2024-09-21T01:47:23.421864+0000 mgr.a (mgr.14388) 9215 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:24 smithi179 bash[23186]: cluster 2024-09-21T01:47:23.421864+0000 mgr.a (mgr.14388) 9215 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:26 smithi049 bash[23528]: cluster 2024-09-21T01:47:25.424108+0000 mgr.a (mgr.14388) 9216 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:26 smithi044 bash[22676]: cluster 2024-09-21T01:47:25.424108+0000 mgr.a (mgr.14388) 9216 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:26 smithi179 bash[23186]: cluster 2024-09-21T01:47:25.424108+0000 mgr.a (mgr.14388) 9216 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:28.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:28.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:28.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:28.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:28 smithi044 bash[22676]: cluster 2024-09-21T01:47:27.424706+0000 mgr.a (mgr.14388) 9217 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:28.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:28 smithi049 bash[23528]: cluster 2024-09-21T01:47:27.424706+0000 mgr.a (mgr.14388) 9217 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:28.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:28 smithi179 bash[23186]: cluster 2024-09-21T01:47:27.424706+0000 mgr.a (mgr.14388) 9217 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:29 smithi049 bash[23528]: audit 2024-09-21T01:47:28.462850+0000 mgr.a (mgr.14388) 9218 : audit [DBG] from='client.205068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:29 smithi049 bash[23528]: audit 2024-09-21T01:47:29.518302+0000 mon.a (mon.0) 7733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:29 smithi049 bash[23528]: audit 2024-09-21T01:47:29.528278+0000 mon.a (mon.0) 7734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:29 smithi044 bash[22676]: audit 2024-09-21T01:47:28.462850+0000 mgr.a (mgr.14388) 9218 : audit [DBG] from='client.205068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:29 smithi044 bash[22676]: audit 2024-09-21T01:47:29.518302+0000 mon.a (mon.0) 7733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:29 smithi044 bash[22676]: audit 2024-09-21T01:47:29.528278+0000 mon.a (mon.0) 7734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:29 smithi179 bash[23186]: audit 2024-09-21T01:47:28.462850+0000 mgr.a (mgr.14388) 9218 : audit [DBG] from='client.205068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:29 smithi179 bash[23186]: audit 2024-09-21T01:47:29.518302+0000 mon.a (mon.0) 7733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:29 smithi179 bash[23186]: audit 2024-09-21T01:47:29.528278+0000 mon.a (mon.0) 7734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:30 smithi049 bash[23528]: cluster 2024-09-21T01:47:29.425745+0000 mgr.a (mgr.14388) 9219 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:30 smithi049 bash[23528]: audit 2024-09-21T01:47:29.538984+0000 mon.a (mon.0) 7735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:30 smithi044 bash[22676]: cluster 2024-09-21T01:47:29.425745+0000 mgr.a (mgr.14388) 9219 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:30 smithi044 bash[22676]: audit 2024-09-21T01:47:29.538984+0000 mon.a (mon.0) 7735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:30 smithi179 bash[23186]: cluster 2024-09-21T01:47:29.425745+0000 mgr.a (mgr.14388) 9219 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:30 smithi179 bash[23186]: audit 2024-09-21T01:47:29.538984+0000 mon.a (mon.0) 7735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:32 smithi049 bash[23528]: cluster 2024-09-21T01:47:31.427947+0000 mgr.a (mgr.14388) 9220 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:32 smithi044 bash[22676]: cluster 2024-09-21T01:47:31.427947+0000 mgr.a (mgr.14388) 9220 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:32 smithi179 bash[23186]: cluster 2024-09-21T01:47:31.427947+0000 mgr.a (mgr.14388) 9220 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:47:33.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:34 smithi044 bash[22676]: cluster 2024-09-21T01:47:33.428721+0000 mgr.a (mgr.14388) 9221 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:34 smithi179 bash[23186]: cluster 2024-09-21T01:47:33.428721+0000 mgr.a (mgr.14388) 9221 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:34 smithi049 bash[23528]: cluster 2024-09-21T01:47:33.428721+0000 mgr.a (mgr.14388) 9221 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:34.666 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:34.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:35 smithi049 bash[23528]: audit 2024-09-21T01:47:34.219135+0000 mgr.a (mgr.14388) 9222 : audit [DBG] from='client.205146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:35 smithi044 bash[22676]: audit 2024-09-21T01:47:34.219135+0000 mgr.a (mgr.14388) 9222 : audit [DBG] from='client.205146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:35 smithi179 bash[23186]: audit 2024-09-21T01:47:34.219135+0000 mgr.a (mgr.14388) 9222 : audit [DBG] from='client.205146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:36 smithi044 bash[22676]: cluster 2024-09-21T01:47:35.431130+0000 mgr.a (mgr.14388) 9223 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:47:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:36 smithi179 bash[23186]: cluster 2024-09-21T01:47:35.431130+0000 mgr.a (mgr.14388) 9223 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:47:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:36 smithi049 bash[23528]: cluster 2024-09-21T01:47:35.431130+0000 mgr.a (mgr.14388) 9223 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:47:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:38 smithi179 bash[23186]: cluster 2024-09-21T01:47:37.431905+0000 mgr.a (mgr.14388) 9224 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:38 smithi049 bash[23528]: cluster 2024-09-21T01:47:37.431905+0000 mgr.a (mgr.14388) 9224 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:38 smithi044 bash[22676]: cluster 2024-09-21T01:47:37.431905+0000 mgr.a (mgr.14388) 9224 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:39.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:39.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:39.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:40.451 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:40 smithi179 bash[23186]: cluster 2024-09-21T01:47:39.432664+0000 mgr.a (mgr.14388) 9225 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:40 smithi049 bash[23528]: cluster 2024-09-21T01:47:39.432664+0000 mgr.a (mgr.14388) 9225 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:40 smithi044 bash[22676]: cluster 2024-09-21T01:47:39.432664+0000 mgr.a (mgr.14388) 9225 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:41 smithi179 bash[23186]: audit 2024-09-21T01:47:40.009241+0000 mgr.a (mgr.14388) 9226 : audit [DBG] from='client.205224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:41 smithi049 bash[23528]: audit 2024-09-21T01:47:40.009241+0000 mgr.a (mgr.14388) 9226 : audit [DBG] from='client.205224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:41 smithi044 bash[22676]: audit 2024-09-21T01:47:40.009241+0000 mgr.a (mgr.14388) 9226 : audit [DBG] from='client.205224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:42 smithi044 bash[22676]: cluster 2024-09-21T01:47:41.435432+0000 mgr.a (mgr.14388) 9227 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:42 smithi044 bash[22676]: audit 2024-09-21T01:47:42.306498+0000 mon.a (mon.0) 7736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:42 smithi044 bash[22676]: audit 2024-09-21T01:47:42.311939+0000 mon.a (mon.0) 7737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:42 smithi044 bash[22676]: audit 2024-09-21T01:47:42.318448+0000 mon.a (mon.0) 7738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:42 smithi044 bash[22676]: audit 2024-09-21T01:47:42.466273+0000 mon.a (mon.0) 7739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:42 smithi044 bash[22676]: audit 2024-09-21T01:47:42.472390+0000 mon.a (mon.0) 7740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:42 smithi044 bash[22676]: audit 2024-09-21T01:47:42.479771+0000 mon.a (mon.0) 7741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:42 smithi179 bash[23186]: cluster 2024-09-21T01:47:41.435432+0000 mgr.a (mgr.14388) 9227 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:42 smithi179 bash[23186]: audit 2024-09-21T01:47:42.306498+0000 mon.a (mon.0) 7736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:42 smithi179 bash[23186]: audit 2024-09-21T01:47:42.311939+0000 mon.a (mon.0) 7737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:42 smithi179 bash[23186]: audit 2024-09-21T01:47:42.318448+0000 mon.a (mon.0) 7738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:42 smithi179 bash[23186]: audit 2024-09-21T01:47:42.466273+0000 mon.a (mon.0) 7739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:42 smithi179 bash[23186]: audit 2024-09-21T01:47:42.472390+0000 mon.a (mon.0) 7740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:42 smithi179 bash[23186]: audit 2024-09-21T01:47:42.479771+0000 mon.a (mon.0) 7741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:42 smithi049 bash[23528]: cluster 2024-09-21T01:47:41.435432+0000 mgr.a (mgr.14388) 9227 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:42 smithi049 bash[23528]: audit 2024-09-21T01:47:42.306498+0000 mon.a (mon.0) 7736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:42 smithi049 bash[23528]: audit 2024-09-21T01:47:42.311939+0000 mon.a (mon.0) 7737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:42 smithi049 bash[23528]: audit 2024-09-21T01:47:42.318448+0000 mon.a (mon.0) 7738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:42 smithi049 bash[23528]: audit 2024-09-21T01:47:42.466273+0000 mon.a (mon.0) 7739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:42 smithi049 bash[23528]: audit 2024-09-21T01:47:42.472390+0000 mon.a (mon.0) 7740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:42 smithi049 bash[23528]: audit 2024-09-21T01:47:42.479771+0000 mon.a (mon.0) 7741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:44 smithi049 bash[23528]: cluster 2024-09-21T01:47:43.436204+0000 mgr.a (mgr.14388) 9228 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:44 smithi044 bash[22676]: cluster 2024-09-21T01:47:43.436204+0000 mgr.a (mgr.14388) 9228 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:44 smithi179 bash[23186]: cluster 2024-09-21T01:47:43.436204+0000 mgr.a (mgr.14388) 9228 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:45.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:46.212 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:46 smithi049 bash[23528]: cluster 2024-09-21T01:47:45.439028+0000 mgr.a (mgr.14388) 9229 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:46.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:46 smithi044 bash[22676]: cluster 2024-09-21T01:47:45.439028+0000 mgr.a (mgr.14388) 9229 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:46 smithi179 bash[23186]: cluster 2024-09-21T01:47:45.439028+0000 mgr.a (mgr.14388) 9229 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:47 smithi049 bash[23528]: audit 2024-09-21T01:47:45.782198+0000 mgr.a (mgr.14388) 9230 : audit [DBG] from='client.205302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:47 smithi044 bash[22676]: audit 2024-09-21T01:47:45.782198+0000 mgr.a (mgr.14388) 9230 : audit [DBG] from='client.205302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:47 smithi179 bash[23186]: audit 2024-09-21T01:47:45.782198+0000 mgr.a (mgr.14388) 9230 : audit [DBG] from='client.205302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:48.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:48 smithi049 bash[23528]: cluster 2024-09-21T01:47:47.439967+0000 mgr.a (mgr.14388) 9231 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:48 smithi044 bash[22676]: cluster 2024-09-21T01:47:47.439967+0000 mgr.a (mgr.14388) 9231 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:48 smithi179 bash[23186]: cluster 2024-09-21T01:47:47.439967+0000 mgr.a (mgr.14388) 9231 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:50 smithi044 bash[22676]: cluster 2024-09-21T01:47:49.440768+0000 mgr.a (mgr.14388) 9232 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:50 smithi044 bash[22676]: audit 2024-09-21T01:47:49.732885+0000 mon.a (mon.0) 7742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:50 smithi044 bash[22676]: audit 2024-09-21T01:47:49.741939+0000 mon.a (mon.0) 7743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:50 smithi044 bash[22676]: audit 2024-09-21T01:47:49.752827+0000 mon.a (mon.0) 7744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:50 smithi179 bash[23186]: cluster 2024-09-21T01:47:49.440768+0000 mgr.a (mgr.14388) 9232 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:50 smithi179 bash[23186]: audit 2024-09-21T01:47:49.732885+0000 mon.a (mon.0) 7742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:50 smithi179 bash[23186]: audit 2024-09-21T01:47:49.741939+0000 mon.a (mon.0) 7743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:50 smithi179 bash[23186]: audit 2024-09-21T01:47:49.752827+0000 mon.a (mon.0) 7744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:50 smithi049 bash[23528]: cluster 2024-09-21T01:47:49.440768+0000 mgr.a (mgr.14388) 9232 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:47:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:50 smithi049 bash[23528]: audit 2024-09-21T01:47:49.732885+0000 mon.a (mon.0) 7742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:50 smithi049 bash[23528]: audit 2024-09-21T01:47:49.741939+0000 mon.a (mon.0) 7743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:50 smithi049 bash[23528]: audit 2024-09-21T01:47:49.752827+0000 mon.a (mon.0) 7744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:47:51.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:51.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:51.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:51.997 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:52 smithi044 bash[22676]: cluster 2024-09-21T01:47:51.442929+0000 mgr.a (mgr.14388) 9233 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:52 smithi044 bash[22676]: audit 2024-09-21T01:47:51.549636+0000 mgr.a (mgr.14388) 9234 : audit [DBG] from='client.205380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:52 smithi179 bash[23186]: cluster 2024-09-21T01:47:51.442929+0000 mgr.a (mgr.14388) 9233 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:52 smithi179 bash[23186]: audit 2024-09-21T01:47:51.549636+0000 mgr.a (mgr.14388) 9234 : audit [DBG] from='client.205380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:52 smithi049 bash[23528]: cluster 2024-09-21T01:47:51.442929+0000 mgr.a (mgr.14388) 9233 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:52 smithi049 bash[23528]: audit 2024-09-21T01:47:51.549636+0000 mgr.a (mgr.14388) 9234 : audit [DBG] from='client.205380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:54 smithi179 bash[23186]: cluster 2024-09-21T01:47:53.443834+0000 mgr.a (mgr.14388) 9235 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:54 smithi049 bash[23528]: cluster 2024-09-21T01:47:53.443834+0000 mgr.a (mgr.14388) 9235 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:54 smithi044 bash[22676]: cluster 2024-09-21T01:47:53.443834+0000 mgr.a (mgr.14388) 9235 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:56.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:47:56.999 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:47:56.999 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:47:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:56 smithi179 bash[23186]: cluster 2024-09-21T01:47:55.446068+0000 mgr.a (mgr.14388) 9236 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:47:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:56 smithi049 bash[23528]: cluster 2024-09-21T01:47:55.446068+0000 mgr.a (mgr.14388) 9236 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:47:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:56 smithi044 bash[22676]: cluster 2024-09-21T01:47:55.446068+0000 mgr.a (mgr.14388) 9236 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:47:57.794 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:47:57.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:47:57.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:47:57.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:47:57.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:47:58.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:58 smithi179 bash[23186]: audit 2024-09-21T01:47:57.337295+0000 mgr.a (mgr.14388) 9237 : audit [DBG] from='client.205458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:58.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:47:58 smithi179 bash[23186]: cluster 2024-09-21T01:47:57.446625+0000 mgr.a (mgr.14388) 9238 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:58 smithi049 bash[23528]: audit 2024-09-21T01:47:57.337295+0000 mgr.a (mgr.14388) 9237 : audit [DBG] from='client.205458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:47:58 smithi049 bash[23528]: cluster 2024-09-21T01:47:57.446625+0000 mgr.a (mgr.14388) 9238 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:47:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:58 smithi044 bash[22676]: audit 2024-09-21T01:47:57.337295+0000 mgr.a (mgr.14388) 9237 : audit [DBG] from='client.205458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:47:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:47:58 smithi044 bash[22676]: cluster 2024-09-21T01:47:57.446625+0000 mgr.a (mgr.14388) 9238 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:00 smithi179 bash[23186]: cluster 2024-09-21T01:47:59.447508+0000 mgr.a (mgr.14388) 9239 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:00 smithi049 bash[23528]: cluster 2024-09-21T01:47:59.447508+0000 mgr.a (mgr.14388) 9239 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:00 smithi044 bash[22676]: cluster 2024-09-21T01:47:59.447508+0000 mgr.a (mgr.14388) 9239 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:02.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:02.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:02.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:02 smithi044 bash[22676]: cluster 2024-09-21T01:48:01.449718+0000 mgr.a (mgr.14388) 9240 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:02 smithi044 bash[22676]: audit 2024-09-21T01:48:02.531244+0000 mon.a (mon.0) 7745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:02 smithi044 bash[22676]: audit 2024-09-21T01:48:02.536457+0000 mon.a (mon.0) 7746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:02 smithi044 bash[22676]: audit 2024-09-21T01:48:02.542779+0000 mon.a (mon.0) 7747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:02 smithi044 bash[22676]: audit 2024-09-21T01:48:02.705482+0000 mon.a (mon.0) 7748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:02 smithi044 bash[22676]: audit 2024-09-21T01:48:02.713950+0000 mon.a (mon.0) 7749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:02 smithi044 bash[22676]: audit 2024-09-21T01:48:02.723947+0000 mon.a (mon.0) 7750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:02 smithi179 bash[23186]: cluster 2024-09-21T01:48:01.449718+0000 mgr.a (mgr.14388) 9240 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:02 smithi179 bash[23186]: audit 2024-09-21T01:48:02.531244+0000 mon.a (mon.0) 7745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:02 smithi179 bash[23186]: audit 2024-09-21T01:48:02.536457+0000 mon.a (mon.0) 7746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:02 smithi179 bash[23186]: audit 2024-09-21T01:48:02.542779+0000 mon.a (mon.0) 7747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:02 smithi179 bash[23186]: audit 2024-09-21T01:48:02.705482+0000 mon.a (mon.0) 7748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:02 smithi179 bash[23186]: audit 2024-09-21T01:48:02.713950+0000 mon.a (mon.0) 7749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:02 smithi179 bash[23186]: audit 2024-09-21T01:48:02.723947+0000 mon.a (mon.0) 7750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:02 smithi049 bash[23528]: cluster 2024-09-21T01:48:01.449718+0000 mgr.a (mgr.14388) 9240 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:02 smithi049 bash[23528]: audit 2024-09-21T01:48:02.531244+0000 mon.a (mon.0) 7745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:02 smithi049 bash[23528]: audit 2024-09-21T01:48:02.536457+0000 mon.a (mon.0) 7746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:02 smithi049 bash[23528]: audit 2024-09-21T01:48:02.542779+0000 mon.a (mon.0) 7747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:02 smithi049 bash[23528]: audit 2024-09-21T01:48:02.705482+0000 mon.a (mon.0) 7748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:02 smithi049 bash[23528]: audit 2024-09-21T01:48:02.713950+0000 mon.a (mon.0) 7749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:02 smithi049 bash[23528]: audit 2024-09-21T01:48:02.723947+0000 mon.a (mon.0) 7750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:03.584 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:03.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:04 smithi049 bash[23528]: audit 2024-09-21T01:48:03.132846+0000 mgr.a (mgr.14388) 9241 : audit [DBG] from='client.205536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:04 smithi049 bash[23528]: cluster 2024-09-21T01:48:03.450300+0000 mgr.a (mgr.14388) 9242 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:04 smithi044 bash[22676]: audit 2024-09-21T01:48:03.132846+0000 mgr.a (mgr.14388) 9241 : audit [DBG] from='client.205536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:04 smithi044 bash[22676]: cluster 2024-09-21T01:48:03.450300+0000 mgr.a (mgr.14388) 9242 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:04 smithi179 bash[23186]: audit 2024-09-21T01:48:03.132846+0000 mgr.a (mgr.14388) 9241 : audit [DBG] from='client.205536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:04 smithi179 bash[23186]: cluster 2024-09-21T01:48:03.450300+0000 mgr.a (mgr.14388) 9242 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:06 smithi049 bash[23528]: cluster 2024-09-21T01:48:05.451819+0000 mgr.a (mgr.14388) 9243 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:06 smithi044 bash[22676]: cluster 2024-09-21T01:48:05.451819+0000 mgr.a (mgr.14388) 9243 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:06 smithi179 bash[23186]: cluster 2024-09-21T01:48:05.451819+0000 mgr.a (mgr.14388) 9243 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:08.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:08.586 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:08.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:08 smithi049 bash[23528]: cluster 2024-09-21T01:48:07.452540+0000 mgr.a (mgr.14388) 9244 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:09.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:08 smithi044 bash[22676]: cluster 2024-09-21T01:48:07.452540+0000 mgr.a (mgr.14388) 9244 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:08 smithi179 bash[23186]: cluster 2024-09-21T01:48:07.452540+0000 mgr.a (mgr.14388) 9244 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:09.379 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:09.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:09.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:09.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:09.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:10 smithi049 bash[23528]: audit 2024-09-21T01:48:08.927732+0000 mgr.a (mgr.14388) 9245 : audit [DBG] from='client.205614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:10 smithi049 bash[23528]: cluster 2024-09-21T01:48:09.453576+0000 mgr.a (mgr.14388) 9246 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:10 smithi049 bash[23528]: audit 2024-09-21T01:48:09.944983+0000 mon.a (mon.0) 7751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:10 smithi049 bash[23528]: audit 2024-09-21T01:48:09.953484+0000 mon.a (mon.0) 7752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:10 smithi049 bash[23528]: audit 2024-09-21T01:48:09.964071+0000 mon.a (mon.0) 7753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:10 smithi044 bash[22676]: audit 2024-09-21T01:48:08.927732+0000 mgr.a (mgr.14388) 9245 : audit [DBG] from='client.205614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:10 smithi044 bash[22676]: cluster 2024-09-21T01:48:09.453576+0000 mgr.a (mgr.14388) 9246 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:10 smithi044 bash[22676]: audit 2024-09-21T01:48:09.944983+0000 mon.a (mon.0) 7751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:10 smithi044 bash[22676]: audit 2024-09-21T01:48:09.953484+0000 mon.a (mon.0) 7752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:10 smithi044 bash[22676]: audit 2024-09-21T01:48:09.964071+0000 mon.a (mon.0) 7753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:10 smithi179 bash[23186]: audit 2024-09-21T01:48:08.927732+0000 mgr.a (mgr.14388) 9245 : audit [DBG] from='client.205614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:10 smithi179 bash[23186]: cluster 2024-09-21T01:48:09.453576+0000 mgr.a (mgr.14388) 9246 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:10 smithi179 bash[23186]: audit 2024-09-21T01:48:09.944983+0000 mon.a (mon.0) 7751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:10 smithi179 bash[23186]: audit 2024-09-21T01:48:09.953484+0000 mon.a (mon.0) 7752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:10 smithi179 bash[23186]: audit 2024-09-21T01:48:09.964071+0000 mon.a (mon.0) 7753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:12 smithi049 bash[23528]: cluster 2024-09-21T01:48:11.455883+0000 mgr.a (mgr.14388) 9247 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:12 smithi044 bash[22676]: cluster 2024-09-21T01:48:11.455883+0000 mgr.a (mgr.14388) 9247 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:12 smithi179 bash[23186]: cluster 2024-09-21T01:48:11.455883+0000 mgr.a (mgr.14388) 9247 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:13 smithi049 bash[23528]: cluster 2024-09-21T01:48:13.456813+0000 mgr.a (mgr.14388) 9248 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:13 smithi044 bash[22676]: cluster 2024-09-21T01:48:13.456813+0000 mgr.a (mgr.14388) 9248 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:13 smithi179 bash[23186]: cluster 2024-09-21T01:48:13.456813+0000 mgr.a (mgr.14388) 9248 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:14.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:14.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:14.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:14 smithi049 bash[23528]: audit 2024-09-21T01:48:14.721215+0000 mgr.a (mgr.14388) 9249 : audit [DBG] from='client.205692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:15.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:15.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:15.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:14 smithi044 bash[22676]: audit 2024-09-21T01:48:14.721215+0000 mgr.a (mgr.14388) 9249 : audit [DBG] from='client.205692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:14 smithi179 bash[23186]: audit 2024-09-21T01:48:14.721215+0000 mgr.a (mgr.14388) 9249 : audit [DBG] from='client.205692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:15 smithi049 bash[23528]: cluster 2024-09-21T01:48:15.459741+0000 mgr.a (mgr.14388) 9250 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:15 smithi044 bash[22676]: cluster 2024-09-21T01:48:15.459741+0000 mgr.a (mgr.14388) 9250 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:15 smithi179 bash[23186]: cluster 2024-09-21T01:48:15.459741+0000 mgr.a (mgr.14388) 9250 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:18 smithi049 bash[23528]: cluster 2024-09-21T01:48:17.460586+0000 mgr.a (mgr.14388) 9251 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:48:18.875 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:18 smithi179 bash[23186]: cluster 2024-09-21T01:48:17.460586+0000 mgr.a (mgr.14388) 9251 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:48:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:18 smithi044 bash[22676]: cluster 2024-09-21T01:48:17.460586+0000 mgr.a (mgr.14388) 9251 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:48:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:19 smithi049 bash[23528]: audit 2024-09-21T01:48:19.346904+0000 mon.a (mon.0) 7754 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:48:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:19 smithi049 bash[23528]: audit 2024-09-21T01:48:19.354063+0000 mon.a (mon.0) 7755 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:48:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:19 smithi049 bash[23528]: audit 2024-09-21T01:48:19.355814+0000 mon.a (mon.0) 7756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:48:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:19 smithi049 bash[23528]: audit 2024-09-21T01:48:19.367663+0000 mon.a (mon.0) 7757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:19 smithi049 bash[23528]: audit 2024-09-21T01:48:19.374821+0000 mon.a (mon.0) 7758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:48:19.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:19 smithi179 bash[23186]: audit 2024-09-21T01:48:19.346904+0000 mon.a (mon.0) 7754 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:48:19.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:19 smithi179 bash[23186]: audit 2024-09-21T01:48:19.354063+0000 mon.a (mon.0) 7755 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:48:19.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:19 smithi179 bash[23186]: audit 2024-09-21T01:48:19.355814+0000 mon.a (mon.0) 7756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:48:19.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:19 smithi179 bash[23186]: audit 2024-09-21T01:48:19.367663+0000 mon.a (mon.0) 7757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:19.832 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:19 smithi179 bash[23186]: audit 2024-09-21T01:48:19.374821+0000 mon.a (mon.0) 7758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:48:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:19 smithi044 bash[22676]: audit 2024-09-21T01:48:19.346904+0000 mon.a (mon.0) 7754 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:48:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:19 smithi044 bash[22676]: audit 2024-09-21T01:48:19.354063+0000 mon.a (mon.0) 7755 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:48:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:19 smithi044 bash[22676]: audit 2024-09-21T01:48:19.355814+0000 mon.a (mon.0) 7756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:48:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:19 smithi044 bash[22676]: audit 2024-09-21T01:48:19.367663+0000 mon.a (mon.0) 7757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:19 smithi044 bash[22676]: audit 2024-09-21T01:48:19.374821+0000 mon.a (mon.0) 7758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:48:20.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:20.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:20.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:20.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:48:20 smithi044 bash[22930]: debug 2024-09-21T01:48:20.169+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:48:20.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:48:20 smithi044 bash[22930]: debug 2024-09-21T01:48:20.169+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:48:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:20 smithi049 bash[23528]: audit 2024-09-21T01:48:19.377395+0000 mgr.a (mgr.14388) 9252 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:48:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:20 smithi049 bash[23528]: cluster 2024-09-21T01:48:19.461386+0000 mgr.a (mgr.14388) 9253 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:48:20.809 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:20 smithi179 bash[23186]: audit 2024-09-21T01:48:19.377395+0000 mgr.a (mgr.14388) 9252 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:48:20.809 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:20 smithi179 bash[23186]: cluster 2024-09-21T01:48:19.461386+0000 mgr.a (mgr.14388) 9253 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:48:20.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:20.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:20.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:20.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:20.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:20 smithi044 bash[22676]: audit 2024-09-21T01:48:19.377395+0000 mgr.a (mgr.14388) 9252 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:48:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:20 smithi044 bash[22676]: cluster 2024-09-21T01:48:19.461386+0000 mgr.a (mgr.14388) 9253 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:48:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:21 smithi179 bash[23186]: audit 2024-09-21T01:48:20.169919+0000 mgr.a (mgr.14388) 9254 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:48:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:21 smithi179 bash[23186]: cephadm 2024-09-21T01:48:20.171447+0000 mgr.a (mgr.14388) 9255 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:48:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:21 smithi179 bash[23186]: audit 2024-09-21T01:48:20.495394+0000 mgr.a (mgr.14388) 9256 : audit [DBG] from='client.205875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:21 smithi049 bash[23528]: audit 2024-09-21T01:48:20.169919+0000 mgr.a (mgr.14388) 9254 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:48:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:21 smithi049 bash[23528]: cephadm 2024-09-21T01:48:20.171447+0000 mgr.a (mgr.14388) 9255 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:48:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:21 smithi049 bash[23528]: audit 2024-09-21T01:48:20.495394+0000 mgr.a (mgr.14388) 9256 : audit [DBG] from='client.205875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:21.994 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:21 smithi044 bash[22676]: audit 2024-09-21T01:48:20.169919+0000 mgr.a (mgr.14388) 9254 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:48:21.995 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:21 smithi044 bash[22676]: cephadm 2024-09-21T01:48:20.171447+0000 mgr.a (mgr.14388) 9255 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:48:21.995 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:21 smithi044 bash[22676]: audit 2024-09-21T01:48:20.495394+0000 mgr.a (mgr.14388) 9256 : audit [DBG] from='client.205875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:22 smithi049 bash[23528]: cluster 2024-09-21T01:48:21.464168+0000 mgr.a (mgr.14388) 9257 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:48:22.925 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:22 smithi044 bash[22676]: cluster 2024-09-21T01:48:21.464168+0000 mgr.a (mgr.14388) 9257 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:48:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:22 smithi179 bash[23186]: cluster 2024-09-21T01:48:21.464168+0000 mgr.a (mgr.14388) 9257 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T01:48:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:23 smithi049 bash[23528]: audit 2024-09-21T01:48:22.759713+0000 mon.a (mon.0) 7759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:23 smithi049 bash[23528]: audit 2024-09-21T01:48:22.765961+0000 mon.a (mon.0) 7760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:23 smithi049 bash[23528]: audit 2024-09-21T01:48:22.773407+0000 mon.a (mon.0) 7761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:23 smithi049 bash[23528]: audit 2024-09-21T01:48:22.908567+0000 mon.a (mon.0) 7762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:23 smithi049 bash[23528]: audit 2024-09-21T01:48:22.914797+0000 mon.a (mon.0) 7763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:23 smithi049 bash[23528]: audit 2024-09-21T01:48:22.924629+0000 mon.a (mon.0) 7764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:23 smithi044 bash[22676]: audit 2024-09-21T01:48:22.759713+0000 mon.a (mon.0) 7759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:23 smithi044 bash[22676]: audit 2024-09-21T01:48:22.765961+0000 mon.a (mon.0) 7760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:23 smithi044 bash[22676]: audit 2024-09-21T01:48:22.773407+0000 mon.a (mon.0) 7761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:23 smithi044 bash[22676]: audit 2024-09-21T01:48:22.908567+0000 mon.a (mon.0) 7762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:23 smithi044 bash[22676]: audit 2024-09-21T01:48:22.914797+0000 mon.a (mon.0) 7763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:23 smithi044 bash[22676]: audit 2024-09-21T01:48:22.924629+0000 mon.a (mon.0) 7764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:23 smithi179 bash[23186]: audit 2024-09-21T01:48:22.759713+0000 mon.a (mon.0) 7759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:23 smithi179 bash[23186]: audit 2024-09-21T01:48:22.765961+0000 mon.a (mon.0) 7760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:23 smithi179 bash[23186]: audit 2024-09-21T01:48:22.773407+0000 mon.a (mon.0) 7761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:23 smithi179 bash[23186]: audit 2024-09-21T01:48:22.908567+0000 mon.a (mon.0) 7762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:23 smithi179 bash[23186]: audit 2024-09-21T01:48:22.914797+0000 mon.a (mon.0) 7763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:23 smithi179 bash[23186]: audit 2024-09-21T01:48:22.924629+0000 mon.a (mon.0) 7764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:24 smithi044 bash[22676]: cluster 2024-09-21T01:48:23.464940+0000 mgr.a (mgr.14388) 9258 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:48:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:24 smithi049 bash[23528]: cluster 2024-09-21T01:48:23.464940+0000 mgr.a (mgr.14388) 9258 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:48:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:24 smithi179 bash[23186]: cluster 2024-09-21T01:48:23.464940+0000 mgr.a (mgr.14388) 9258 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T01:48:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:26.687 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:26.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:26.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:26.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:26.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:26.944 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:26 smithi049 bash[23528]: cluster 2024-09-21T01:48:25.467007+0000 mgr.a (mgr.14388) 9259 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:26 smithi044 bash[22676]: cluster 2024-09-21T01:48:25.467007+0000 mgr.a (mgr.14388) 9259 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:26 smithi179 bash[23186]: cluster 2024-09-21T01:48:25.467007+0000 mgr.a (mgr.14388) 9259 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:27 smithi044 bash[22676]: audit 2024-09-21T01:48:26.249599+0000 mgr.a (mgr.14388) 9260 : audit [DBG] from='client.205950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:27 smithi049 bash[23528]: audit 2024-09-21T01:48:26.249599+0000 mgr.a (mgr.14388) 9260 : audit [DBG] from='client.205950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:27 smithi179 bash[23186]: audit 2024-09-21T01:48:26.249599+0000 mgr.a (mgr.14388) 9260 : audit [DBG] from='client.205950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:28 smithi049 bash[23528]: cluster 2024-09-21T01:48:27.467915+0000 mgr.a (mgr.14388) 9261 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:28 smithi044 bash[22676]: cluster 2024-09-21T01:48:27.467915+0000 mgr.a (mgr.14388) 9261 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:28 smithi179 bash[23186]: cluster 2024-09-21T01:48:27.467915+0000 mgr.a (mgr.14388) 9261 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:30 smithi049 bash[23528]: cluster 2024-09-21T01:48:29.468752+0000 mgr.a (mgr.14388) 9262 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:30 smithi049 bash[23528]: audit 2024-09-21T01:48:30.156913+0000 mon.a (mon.0) 7765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:30 smithi049 bash[23528]: audit 2024-09-21T01:48:30.165541+0000 mon.a (mon.0) 7766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:30 smithi049 bash[23528]: audit 2024-09-21T01:48:30.175983+0000 mon.a (mon.0) 7767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:30 smithi044 bash[22676]: cluster 2024-09-21T01:48:29.468752+0000 mgr.a (mgr.14388) 9262 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:30 smithi044 bash[22676]: audit 2024-09-21T01:48:30.156913+0000 mon.a (mon.0) 7765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:30 smithi044 bash[22676]: audit 2024-09-21T01:48:30.165541+0000 mon.a (mon.0) 7766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:30 smithi044 bash[22676]: audit 2024-09-21T01:48:30.175983+0000 mon.a (mon.0) 7767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:30 smithi179 bash[23186]: cluster 2024-09-21T01:48:29.468752+0000 mgr.a (mgr.14388) 9262 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:30 smithi179 bash[23186]: audit 2024-09-21T01:48:30.156913+0000 mon.a (mon.0) 7765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:30 smithi179 bash[23186]: audit 2024-09-21T01:48:30.165541+0000 mon.a (mon.0) 7766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:30 smithi179 bash[23186]: audit 2024-09-21T01:48:30.175983+0000 mon.a (mon.0) 7767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:31.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:31.689 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:31.689 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:31 smithi049 bash[23528]: cluster 2024-09-21T01:48:31.471009+0000 mgr.a (mgr.14388) 9263 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:31 smithi044 bash[22676]: cluster 2024-09-21T01:48:31.471009+0000 mgr.a (mgr.14388) 9263 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:31 smithi179 bash[23186]: cluster 2024-09-21T01:48:31.471009+0000 mgr.a (mgr.14388) 9263 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:48:32.447 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:32.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:32 smithi049 bash[23528]: audit 2024-09-21T01:48:32.023619+0000 mgr.a (mgr.14388) 9264 : audit [DBG] from='client.206028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:32 smithi044 bash[22676]: audit 2024-09-21T01:48:32.023619+0000 mgr.a (mgr.14388) 9264 : audit [DBG] from='client.206028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:32 smithi179 bash[23186]: audit 2024-09-21T01:48:32.023619+0000 mgr.a (mgr.14388) 9264 : audit [DBG] from='client.206028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:33 smithi049 bash[23528]: cluster 2024-09-21T01:48:33.471930+0000 mgr.a (mgr.14388) 9265 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:48:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:33 smithi044 bash[22676]: cluster 2024-09-21T01:48:33.471930+0000 mgr.a (mgr.14388) 9265 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:48:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:33 smithi179 bash[23186]: cluster 2024-09-21T01:48:33.471930+0000 mgr.a (mgr.14388) 9265 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T01:48:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:36 smithi049 bash[23528]: cluster 2024-09-21T01:48:35.474122+0000 mgr.a (mgr.14388) 9266 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:48:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:36 smithi044 bash[22676]: cluster 2024-09-21T01:48:35.474122+0000 mgr.a (mgr.14388) 9266 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:48:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:36 smithi179 bash[23186]: cluster 2024-09-21T01:48:35.474122+0000 mgr.a (mgr.14388) 9266 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:48:37.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:38.201 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:38.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:38.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:38.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:38.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:38 smithi049 bash[23528]: cluster 2024-09-21T01:48:37.474916+0000 mgr.a (mgr.14388) 9267 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:38 smithi049 bash[23528]: audit 2024-09-21T01:48:37.777148+0000 mgr.a (mgr.14388) 9268 : audit [DBG] from='client.206106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:38 smithi044 bash[22676]: cluster 2024-09-21T01:48:37.474916+0000 mgr.a (mgr.14388) 9267 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:38 smithi044 bash[22676]: audit 2024-09-21T01:48:37.777148+0000 mgr.a (mgr.14388) 9268 : audit [DBG] from='client.206106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:38 smithi179 bash[23186]: cluster 2024-09-21T01:48:37.474916+0000 mgr.a (mgr.14388) 9267 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:38 smithi179 bash[23186]: audit 2024-09-21T01:48:37.777148+0000 mgr.a (mgr.14388) 9268 : audit [DBG] from='client.206106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:40 smithi049 bash[23528]: cluster 2024-09-21T01:48:39.475815+0000 mgr.a (mgr.14388) 9269 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:40 smithi044 bash[22676]: cluster 2024-09-21T01:48:39.475815+0000 mgr.a (mgr.14388) 9269 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:40 smithi179 bash[23186]: cluster 2024-09-21T01:48:39.475815+0000 mgr.a (mgr.14388) 9269 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:42 smithi049 bash[23528]: cluster 2024-09-21T01:48:41.478049+0000 mgr.a (mgr.14388) 9270 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:42 smithi044 bash[22676]: cluster 2024-09-21T01:48:41.478049+0000 mgr.a (mgr.14388) 9270 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:42.992 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:42 smithi179 bash[23186]: cluster 2024-09-21T01:48:41.478049+0000 mgr.a (mgr.14388) 9270 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:43.204 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:43.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: audit 2024-09-21T01:48:42.970522+0000 mon.a (mon.0) 7768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: audit 2024-09-21T01:48:42.980528+0000 mon.a (mon.0) 7769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: audit 2024-09-21T01:48:42.991832+0000 mon.a (mon.0) 7770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: audit 2024-09-21T01:48:43.145947+0000 mon.a (mon.0) 7771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: audit 2024-09-21T01:48:43.154198+0000 mon.a (mon.0) 7772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: audit 2024-09-21T01:48:43.164640+0000 mon.a (mon.0) 7773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: cluster 2024-09-21T01:48:43.478747+0000 mgr.a (mgr.14388) 9271 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:43 smithi044 bash[22676]: audit 2024-09-21T01:48:43.537034+0000 mgr.a (mgr.14388) 9272 : audit [DBG] from='client.206181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: audit 2024-09-21T01:48:42.970522+0000 mon.a (mon.0) 7768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: audit 2024-09-21T01:48:42.980528+0000 mon.a (mon.0) 7769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: audit 2024-09-21T01:48:42.991832+0000 mon.a (mon.0) 7770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: audit 2024-09-21T01:48:43.145947+0000 mon.a (mon.0) 7771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: audit 2024-09-21T01:48:43.154198+0000 mon.a (mon.0) 7772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: audit 2024-09-21T01:48:43.164640+0000 mon.a (mon.0) 7773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: cluster 2024-09-21T01:48:43.478747+0000 mgr.a (mgr.14388) 9271 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:43 smithi179 bash[23186]: audit 2024-09-21T01:48:43.537034+0000 mgr.a (mgr.14388) 9272 : audit [DBG] from='client.206181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: audit 2024-09-21T01:48:42.970522+0000 mon.a (mon.0) 7768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: audit 2024-09-21T01:48:42.980528+0000 mon.a (mon.0) 7769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: audit 2024-09-21T01:48:42.991832+0000 mon.a (mon.0) 7770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: audit 2024-09-21T01:48:43.145947+0000 mon.a (mon.0) 7771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: audit 2024-09-21T01:48:43.154198+0000 mon.a (mon.0) 7772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: audit 2024-09-21T01:48:43.164640+0000 mon.a (mon.0) 7773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: cluster 2024-09-21T01:48:43.478747+0000 mgr.a (mgr.14388) 9271 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:43 smithi049 bash[23528]: audit 2024-09-21T01:48:43.537034+0000 mgr.a (mgr.14388) 9272 : audit [DBG] from='client.206181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:46.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:46 smithi049 bash[23528]: cluster 2024-09-21T01:48:45.481052+0000 mgr.a (mgr.14388) 9273 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:46.861 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:46 smithi044 bash[22676]: cluster 2024-09-21T01:48:45.481052+0000 mgr.a (mgr.14388) 9273 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:46 smithi179 bash[23186]: cluster 2024-09-21T01:48:45.481052+0000 mgr.a (mgr.14388) 9273 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:48 smithi044 bash[22676]: cluster 2024-09-21T01:48:47.481856+0000 mgr.a (mgr.14388) 9274 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:48.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:48 smithi049 bash[23528]: cluster 2024-09-21T01:48:47.481856+0000 mgr.a (mgr.14388) 9274 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:48.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:48.980 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:48.980 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:48 smithi179 bash[23186]: cluster 2024-09-21T01:48:47.481856+0000 mgr.a (mgr.14388) 9274 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:49.746 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:49.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:49.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:49.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:49.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:50 smithi049 bash[23528]: audit 2024-09-21T01:48:49.319376+0000 mgr.a (mgr.14388) 9275 : audit [DBG] from='client.206256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:50 smithi049 bash[23528]: cluster 2024-09-21T01:48:49.482506+0000 mgr.a (mgr.14388) 9276 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:50 smithi049 bash[23528]: audit 2024-09-21T01:48:50.395101+0000 mon.a (mon.0) 7774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:50 smithi049 bash[23528]: audit 2024-09-21T01:48:50.403854+0000 mon.a (mon.0) 7775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:50 smithi049 bash[23528]: audit 2024-09-21T01:48:50.414230+0000 mon.a (mon.0) 7776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:50 smithi044 bash[22676]: audit 2024-09-21T01:48:49.319376+0000 mgr.a (mgr.14388) 9275 : audit [DBG] from='client.206256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:50 smithi044 bash[22676]: cluster 2024-09-21T01:48:49.482506+0000 mgr.a (mgr.14388) 9276 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:50 smithi044 bash[22676]: audit 2024-09-21T01:48:50.395101+0000 mon.a (mon.0) 7774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:50 smithi044 bash[22676]: audit 2024-09-21T01:48:50.403854+0000 mon.a (mon.0) 7775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:50 smithi044 bash[22676]: audit 2024-09-21T01:48:50.414230+0000 mon.a (mon.0) 7776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:50 smithi179 bash[23186]: audit 2024-09-21T01:48:49.319376+0000 mgr.a (mgr.14388) 9275 : audit [DBG] from='client.206256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:50 smithi179 bash[23186]: cluster 2024-09-21T01:48:49.482506+0000 mgr.a (mgr.14388) 9276 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:50 smithi179 bash[23186]: audit 2024-09-21T01:48:50.395101+0000 mon.a (mon.0) 7774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:50 smithi179 bash[23186]: audit 2024-09-21T01:48:50.403854+0000 mon.a (mon.0) 7775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:50 smithi179 bash[23186]: audit 2024-09-21T01:48:50.414230+0000 mon.a (mon.0) 7776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:48:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:52 smithi049 bash[23528]: cluster 2024-09-21T01:48:51.484864+0000 mgr.a (mgr.14388) 9277 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:52 smithi044 bash[22676]: cluster 2024-09-21T01:48:51.484864+0000 mgr.a (mgr.14388) 9277 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:52 smithi179 bash[23186]: cluster 2024-09-21T01:48:51.484864+0000 mgr.a (mgr.14388) 9277 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:48:54.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:48:54.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:48:54.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:48:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:54 smithi044 bash[22676]: cluster 2024-09-21T01:48:53.485727+0000 mgr.a (mgr.14388) 9278 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:54 smithi179 bash[23186]: cluster 2024-09-21T01:48:53.485727+0000 mgr.a (mgr.14388) 9278 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:54 smithi049 bash[23528]: cluster 2024-09-21T01:48:53.485727+0000 mgr.a (mgr.14388) 9278 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:55.536 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:48:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:48:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:48:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:48:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:48:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:56 smithi044 bash[22676]: audit 2024-09-21T01:48:55.085471+0000 mgr.a (mgr.14388) 9279 : audit [DBG] from='client.206331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:56 smithi044 bash[22676]: cluster 2024-09-21T01:48:55.487082+0000 mgr.a (mgr.14388) 9280 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:56 smithi179 bash[23186]: audit 2024-09-21T01:48:55.085471+0000 mgr.a (mgr.14388) 9279 : audit [DBG] from='client.206331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:56 smithi179 bash[23186]: cluster 2024-09-21T01:48:55.487082+0000 mgr.a (mgr.14388) 9280 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:57.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:56 smithi049 bash[23528]: audit 2024-09-21T01:48:55.085471+0000 mgr.a (mgr.14388) 9279 : audit [DBG] from='client.206331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:48:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:56 smithi049 bash[23528]: cluster 2024-09-21T01:48:55.487082+0000 mgr.a (mgr.14388) 9280 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:48:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:48:58 smithi179 bash[23186]: cluster 2024-09-21T01:48:57.487853+0000 mgr.a (mgr.14388) 9281 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:48:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:48:58 smithi044 bash[22676]: cluster 2024-09-21T01:48:57.487853+0000 mgr.a (mgr.14388) 9281 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:48:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:48:58 smithi049 bash[23528]: cluster 2024-09-21T01:48:57.487853+0000 mgr.a (mgr.14388) 9281 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:49:00.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:00.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:00.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:00.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:00 smithi044 bash[22676]: cluster 2024-09-21T01:48:59.488666+0000 mgr.a (mgr.14388) 9282 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:49:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:00 smithi179 bash[23186]: cluster 2024-09-21T01:48:59.488666+0000 mgr.a (mgr.14388) 9282 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:49:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:00 smithi049 bash[23528]: cluster 2024-09-21T01:48:59.488666+0000 mgr.a (mgr.14388) 9282 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:49:01.304 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:01.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:02 smithi044 bash[22676]: audit 2024-09-21T01:49:00.874520+0000 mgr.a (mgr.14388) 9283 : audit [DBG] from='client.206409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:02 smithi044 bash[22676]: cluster 2024-09-21T01:49:01.490940+0000 mgr.a (mgr.14388) 9284 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:02 smithi179 bash[23186]: audit 2024-09-21T01:49:00.874520+0000 mgr.a (mgr.14388) 9283 : audit [DBG] from='client.206409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:02 smithi179 bash[23186]: cluster 2024-09-21T01:49:01.490940+0000 mgr.a (mgr.14388) 9284 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:02 smithi049 bash[23528]: audit 2024-09-21T01:49:00.874520+0000 mgr.a (mgr.14388) 9283 : audit [DBG] from='client.206409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:02 smithi049 bash[23528]: cluster 2024-09-21T01:49:01.490940+0000 mgr.a (mgr.14388) 9284 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:04 smithi044 bash[22676]: audit 2024-09-21T01:49:03.208826+0000 mon.a (mon.0) 7777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:04 smithi044 bash[22676]: audit 2024-09-21T01:49:03.216249+0000 mon.a (mon.0) 7778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:04 smithi044 bash[22676]: audit 2024-09-21T01:49:03.224760+0000 mon.a (mon.0) 7779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:04 smithi044 bash[22676]: audit 2024-09-21T01:49:03.385083+0000 mon.a (mon.0) 7780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:04 smithi044 bash[22676]: audit 2024-09-21T01:49:03.393146+0000 mon.a (mon.0) 7781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:04 smithi044 bash[22676]: audit 2024-09-21T01:49:03.403116+0000 mon.a (mon.0) 7782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:04 smithi044 bash[22676]: cluster 2024-09-21T01:49:03.491716+0000 mgr.a (mgr.14388) 9285 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:49:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:04 smithi179 bash[23186]: audit 2024-09-21T01:49:03.208826+0000 mon.a (mon.0) 7777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:04 smithi179 bash[23186]: audit 2024-09-21T01:49:03.216249+0000 mon.a (mon.0) 7778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:04 smithi179 bash[23186]: audit 2024-09-21T01:49:03.224760+0000 mon.a (mon.0) 7779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:04 smithi179 bash[23186]: audit 2024-09-21T01:49:03.385083+0000 mon.a (mon.0) 7780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:04 smithi179 bash[23186]: audit 2024-09-21T01:49:03.393146+0000 mon.a (mon.0) 7781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:04 smithi179 bash[23186]: audit 2024-09-21T01:49:03.403116+0000 mon.a (mon.0) 7782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:04 smithi179 bash[23186]: cluster 2024-09-21T01:49:03.491716+0000 mgr.a (mgr.14388) 9285 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:49:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:04 smithi049 bash[23528]: audit 2024-09-21T01:49:03.208826+0000 mon.a (mon.0) 7777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:04 smithi049 bash[23528]: audit 2024-09-21T01:49:03.216249+0000 mon.a (mon.0) 7778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:04 smithi049 bash[23528]: audit 2024-09-21T01:49:03.224760+0000 mon.a (mon.0) 7779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:04 smithi049 bash[23528]: audit 2024-09-21T01:49:03.385083+0000 mon.a (mon.0) 7780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:04 smithi049 bash[23528]: audit 2024-09-21T01:49:03.393146+0000 mon.a (mon.0) 7781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:04 smithi049 bash[23528]: audit 2024-09-21T01:49:03.403116+0000 mon.a (mon.0) 7782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:04 smithi049 bash[23528]: cluster 2024-09-21T01:49:03.491716+0000 mgr.a (mgr.14388) 9285 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:49:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:06.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:06.306 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:06 smithi049 bash[23528]: cluster 2024-09-21T01:49:05.493894+0000 mgr.a (mgr.14388) 9286 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:06.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:06 smithi044 bash[22676]: cluster 2024-09-21T01:49:05.493894+0000 mgr.a (mgr.14388) 9286 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:06 smithi179 bash[23186]: cluster 2024-09-21T01:49:05.493894+0000 mgr.a (mgr.14388) 9286 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:07.066 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:07 smithi049 bash[23528]: audit 2024-09-21T01:49:06.629031+0000 mgr.a (mgr.14388) 9287 : audit [DBG] from='client.206484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:07 smithi044 bash[22676]: audit 2024-09-21T01:49:06.629031+0000 mgr.a (mgr.14388) 9287 : audit [DBG] from='client.206484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:07 smithi179 bash[23186]: audit 2024-09-21T01:49:06.629031+0000 mgr.a (mgr.14388) 9287 : audit [DBG] from='client.206484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:08.909 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:08 smithi044 bash[22676]: cluster 2024-09-21T01:49:07.494897+0000 mgr.a (mgr.14388) 9288 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:08 smithi179 bash[23186]: cluster 2024-09-21T01:49:07.494897+0000 mgr.a (mgr.14388) 9288 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:08 smithi049 bash[23528]: cluster 2024-09-21T01:49:07.494897+0000 mgr.a (mgr.14388) 9288 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:10 smithi044 bash[22676]: cluster 2024-09-21T01:49:09.495745+0000 mgr.a (mgr.14388) 9289 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:10 smithi179 bash[23186]: cluster 2024-09-21T01:49:09.495745+0000 mgr.a (mgr.14388) 9289 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:10 smithi049 bash[23528]: cluster 2024-09-21T01:49:09.495745+0000 mgr.a (mgr.14388) 9289 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:11 smithi044 bash[22676]: audit 2024-09-21T01:49:10.604230+0000 mon.a (mon.0) 7783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:11 smithi044 bash[22676]: audit 2024-09-21T01:49:10.613276+0000 mon.a (mon.0) 7784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:11 smithi044 bash[22676]: audit 2024-09-21T01:49:10.624042+0000 mon.a (mon.0) 7785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:11 smithi179 bash[23186]: audit 2024-09-21T01:49:10.604230+0000 mon.a (mon.0) 7783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:11 smithi179 bash[23186]: audit 2024-09-21T01:49:10.613276+0000 mon.a (mon.0) 7784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:11 smithi179 bash[23186]: audit 2024-09-21T01:49:10.624042+0000 mon.a (mon.0) 7785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:11 smithi049 bash[23528]: audit 2024-09-21T01:49:10.604230+0000 mon.a (mon.0) 7783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:11 smithi049 bash[23528]: audit 2024-09-21T01:49:10.613276+0000 mon.a (mon.0) 7784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:11 smithi049 bash[23528]: audit 2024-09-21T01:49:10.624042+0000 mon.a (mon.0) 7785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:12.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:12.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:12.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:12.826 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:12 smithi044 bash[22676]: cluster 2024-09-21T01:49:11.497674+0000 mgr.a (mgr.14388) 9290 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:12 smithi179 bash[23186]: cluster 2024-09-21T01:49:11.497674+0000 mgr.a (mgr.14388) 9290 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:12 smithi049 bash[23528]: cluster 2024-09-21T01:49:11.497674+0000 mgr.a (mgr.14388) 9290 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:13 smithi044 bash[22676]: audit 2024-09-21T01:49:12.402851+0000 mgr.a (mgr.14388) 9291 : audit [DBG] from='client.206562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:13 smithi179 bash[23186]: audit 2024-09-21T01:49:12.402851+0000 mgr.a (mgr.14388) 9291 : audit [DBG] from='client.206562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:13 smithi049 bash[23528]: audit 2024-09-21T01:49:12.402851+0000 mgr.a (mgr.14388) 9291 : audit [DBG] from='client.206562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:14 smithi044 bash[22676]: cluster 2024-09-21T01:49:13.498638+0000 mgr.a (mgr.14388) 9292 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:14 smithi179 bash[23186]: cluster 2024-09-21T01:49:13.498638+0000 mgr.a (mgr.14388) 9292 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:14 smithi049 bash[23528]: cluster 2024-09-21T01:49:13.498638+0000 mgr.a (mgr.14388) 9292 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:16 smithi044 bash[22676]: cluster 2024-09-21T01:49:15.500836+0000 mgr.a (mgr.14388) 9293 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:16 smithi179 bash[23186]: cluster 2024-09-21T01:49:15.500836+0000 mgr.a (mgr.14388) 9293 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:16 smithi049 bash[23528]: cluster 2024-09-21T01:49:15.500836+0000 mgr.a (mgr.14388) 9293 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:18.609 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:18.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:18.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:18.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:18.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:18 smithi044 bash[22676]: cluster 2024-09-21T01:49:17.501640+0000 mgr.a (mgr.14388) 9294 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:18 smithi179 bash[23186]: cluster 2024-09-21T01:49:17.501640+0000 mgr.a (mgr.14388) 9294 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:18 smithi049 bash[23528]: cluster 2024-09-21T01:49:17.501640+0000 mgr.a (mgr.14388) 9294 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:19 smithi179 bash[23186]: audit 2024-09-21T01:49:18.161372+0000 mgr.a (mgr.14388) 9295 : audit [DBG] from='client.206637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:19 smithi044 bash[22676]: audit 2024-09-21T01:49:18.161372+0000 mgr.a (mgr.14388) 9295 : audit [DBG] from='client.206637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:19 smithi049 bash[23528]: audit 2024-09-21T01:49:18.161372+0000 mgr.a (mgr.14388) 9295 : audit [DBG] from='client.206637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:20 smithi179 bash[23186]: cluster 2024-09-21T01:49:19.502652+0000 mgr.a (mgr.14388) 9296 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:20 smithi179 bash[23186]: audit 2024-09-21T01:49:20.237130+0000 mon.a (mon.0) 7786 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:49:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:20 smithi179 bash[23186]: audit 2024-09-21T01:49:20.249061+0000 mon.a (mon.0) 7787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:49:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:20 smithi179 bash[23186]: audit 2024-09-21T01:49:20.251283+0000 mon.a (mon.0) 7788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:49:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:20 smithi179 bash[23186]: audit 2024-09-21T01:49:20.263149+0000 mon.a (mon.0) 7789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:20 smithi179 bash[23186]: audit 2024-09-21T01:49:20.269671+0000 mon.a (mon.0) 7790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:49:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:20 smithi044 bash[22676]: cluster 2024-09-21T01:49:19.502652+0000 mgr.a (mgr.14388) 9296 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:20 smithi044 bash[22676]: audit 2024-09-21T01:49:20.237130+0000 mon.a (mon.0) 7786 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:49:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:20 smithi044 bash[22676]: audit 2024-09-21T01:49:20.249061+0000 mon.a (mon.0) 7787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:49:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:20 smithi044 bash[22676]: audit 2024-09-21T01:49:20.251283+0000 mon.a (mon.0) 7788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:49:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:20 smithi044 bash[22676]: audit 2024-09-21T01:49:20.263149+0000 mon.a (mon.0) 7789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:20 smithi044 bash[22676]: audit 2024-09-21T01:49:20.269671+0000 mon.a (mon.0) 7790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:49:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:20 smithi049 bash[23528]: cluster 2024-09-21T01:49:19.502652+0000 mgr.a (mgr.14388) 9296 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:20 smithi049 bash[23528]: audit 2024-09-21T01:49:20.237130+0000 mon.a (mon.0) 7786 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:49:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:20 smithi049 bash[23528]: audit 2024-09-21T01:49:20.249061+0000 mon.a (mon.0) 7787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:49:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:20 smithi049 bash[23528]: audit 2024-09-21T01:49:20.251283+0000 mon.a (mon.0) 7788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:49:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:20 smithi049 bash[23528]: audit 2024-09-21T01:49:20.263149+0000 mon.a (mon.0) 7789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:20 smithi049 bash[23528]: audit 2024-09-21T01:49:20.269671+0000 mon.a (mon.0) 7790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:49:21.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:49:21 smithi044 bash[22930]: debug 2024-09-21T01:49:21.036+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:49:21.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:49:21 smithi044 bash[22930]: debug 2024-09-21T01:49:21.036+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:49:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:21 smithi044 bash[22676]: audit 2024-09-21T01:49:20.272075+0000 mgr.a (mgr.14388) 9297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:49:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:21 smithi179 bash[23186]: audit 2024-09-21T01:49:20.272075+0000 mgr.a (mgr.14388) 9297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:49:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:21 smithi049 bash[23528]: audit 2024-09-21T01:49:20.272075+0000 mgr.a (mgr.14388) 9297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:49:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:22 smithi044 bash[22676]: audit 2024-09-21T01:49:21.037579+0000 mgr.a (mgr.14388) 9298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:49:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:22 smithi044 bash[22676]: cephadm 2024-09-21T01:49:21.038822+0000 mgr.a (mgr.14388) 9299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:49:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:22 smithi044 bash[22676]: cluster 2024-09-21T01:49:21.505572+0000 mgr.a (mgr.14388) 9300 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:22 smithi179 bash[23186]: audit 2024-09-21T01:49:21.037579+0000 mgr.a (mgr.14388) 9298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:49:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:22 smithi179 bash[23186]: cephadm 2024-09-21T01:49:21.038822+0000 mgr.a (mgr.14388) 9299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:49:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:22 smithi179 bash[23186]: cluster 2024-09-21T01:49:21.505572+0000 mgr.a (mgr.14388) 9300 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:22 smithi049 bash[23528]: audit 2024-09-21T01:49:21.037579+0000 mgr.a (mgr.14388) 9298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:49:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:22 smithi049 bash[23528]: cephadm 2024-09-21T01:49:21.038822+0000 mgr.a (mgr.14388) 9299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:49:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:22 smithi049 bash[23528]: cluster 2024-09-21T01:49:21.505572+0000 mgr.a (mgr.14388) 9300 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:23.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:23.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:24.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:24.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:24.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:24.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:24.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:24 smithi044 bash[22676]: audit 2024-09-21T01:49:23.434271+0000 mon.a (mon.0) 7791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:24 smithi044 bash[22676]: audit 2024-09-21T01:49:23.441469+0000 mon.a (mon.0) 7792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:24 smithi044 bash[22676]: audit 2024-09-21T01:49:23.452133+0000 mon.a (mon.0) 7793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:24 smithi044 bash[22676]: cluster 2024-09-21T01:49:23.506293+0000 mgr.a (mgr.14388) 9301 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:24 smithi044 bash[22676]: audit 2024-09-21T01:49:23.624542+0000 mon.a (mon.0) 7794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:24 smithi044 bash[22676]: audit 2024-09-21T01:49:23.630995+0000 mon.a (mon.0) 7795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:24 smithi044 bash[22676]: audit 2024-09-21T01:49:23.638333+0000 mon.a (mon.0) 7796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:24 smithi179 bash[23186]: audit 2024-09-21T01:49:23.434271+0000 mon.a (mon.0) 7791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:24 smithi179 bash[23186]: audit 2024-09-21T01:49:23.441469+0000 mon.a (mon.0) 7792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:24 smithi179 bash[23186]: audit 2024-09-21T01:49:23.452133+0000 mon.a (mon.0) 7793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:24 smithi179 bash[23186]: cluster 2024-09-21T01:49:23.506293+0000 mgr.a (mgr.14388) 9301 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:24 smithi179 bash[23186]: audit 2024-09-21T01:49:23.624542+0000 mon.a (mon.0) 7794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:24 smithi179 bash[23186]: audit 2024-09-21T01:49:23.630995+0000 mon.a (mon.0) 7795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:24 smithi179 bash[23186]: audit 2024-09-21T01:49:23.638333+0000 mon.a (mon.0) 7796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:24 smithi049 bash[23528]: audit 2024-09-21T01:49:23.434271+0000 mon.a (mon.0) 7791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:24 smithi049 bash[23528]: audit 2024-09-21T01:49:23.441469+0000 mon.a (mon.0) 7792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:24 smithi049 bash[23528]: audit 2024-09-21T01:49:23.452133+0000 mon.a (mon.0) 7793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:24 smithi049 bash[23528]: cluster 2024-09-21T01:49:23.506293+0000 mgr.a (mgr.14388) 9301 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:24 smithi049 bash[23528]: audit 2024-09-21T01:49:23.624542+0000 mon.a (mon.0) 7794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:24 smithi049 bash[23528]: audit 2024-09-21T01:49:23.630995+0000 mon.a (mon.0) 7795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:24 smithi049 bash[23528]: audit 2024-09-21T01:49:23.638333+0000 mon.a (mon.0) 7796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:25 smithi044 bash[22676]: audit 2024-09-21T01:49:23.946942+0000 mgr.a (mgr.14388) 9302 : audit [DBG] from='client.206817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:25 smithi179 bash[23186]: audit 2024-09-21T01:49:23.946942+0000 mgr.a (mgr.14388) 9302 : audit [DBG] from='client.206817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:25 smithi049 bash[23528]: audit 2024-09-21T01:49:23.946942+0000 mgr.a (mgr.14388) 9302 : audit [DBG] from='client.206817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:26 smithi044 bash[22676]: cluster 2024-09-21T01:49:25.508734+0000 mgr.a (mgr.14388) 9303 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:26 smithi179 bash[23186]: cluster 2024-09-21T01:49:25.508734+0000 mgr.a (mgr.14388) 9303 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:26 smithi049 bash[23528]: cluster 2024-09-21T01:49:25.508734+0000 mgr.a (mgr.14388) 9303 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:28 smithi044 bash[22676]: cluster 2024-09-21T01:49:27.509544+0000 mgr.a (mgr.14388) 9304 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:28 smithi049 bash[23528]: cluster 2024-09-21T01:49:27.509544+0000 mgr.a (mgr.14388) 9304 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:28 smithi179 bash[23186]: cluster 2024-09-21T01:49:27.509544+0000 mgr.a (mgr.14388) 9304 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:29.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:29.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:29.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:30.132 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:30.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:30.862 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:30 smithi049 bash[23528]: cluster 2024-09-21T01:49:29.509995+0000 mgr.a (mgr.14388) 9305 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:30.862 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:30 smithi049 bash[23528]: audit 2024-09-21T01:49:29.702178+0000 mgr.a (mgr.14388) 9306 : audit [DBG] from='client.206892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:30 smithi044 bash[22676]: cluster 2024-09-21T01:49:29.509995+0000 mgr.a (mgr.14388) 9305 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:30 smithi044 bash[22676]: audit 2024-09-21T01:49:29.702178+0000 mgr.a (mgr.14388) 9306 : audit [DBG] from='client.206892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:30 smithi179 bash[23186]: cluster 2024-09-21T01:49:29.509995+0000 mgr.a (mgr.14388) 9305 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:30 smithi179 bash[23186]: audit 2024-09-21T01:49:29.702178+0000 mgr.a (mgr.14388) 9306 : audit [DBG] from='client.206892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:31 smithi044 bash[22676]: audit 2024-09-21T01:49:30.841669+0000 mon.a (mon.0) 7797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:31 smithi044 bash[22676]: audit 2024-09-21T01:49:30.850398+0000 mon.a (mon.0) 7798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:31 smithi044 bash[22676]: audit 2024-09-21T01:49:30.860673+0000 mon.a (mon.0) 7799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:31 smithi044 bash[22676]: cluster 2024-09-21T01:49:31.512847+0000 mgr.a (mgr.14388) 9307 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:31 smithi179 bash[23186]: audit 2024-09-21T01:49:30.841669+0000 mon.a (mon.0) 7797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:31 smithi179 bash[23186]: audit 2024-09-21T01:49:30.850398+0000 mon.a (mon.0) 7798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:31 smithi179 bash[23186]: audit 2024-09-21T01:49:30.860673+0000 mon.a (mon.0) 7799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:31 smithi179 bash[23186]: cluster 2024-09-21T01:49:31.512847+0000 mgr.a (mgr.14388) 9307 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:31 smithi049 bash[23528]: audit 2024-09-21T01:49:30.841669+0000 mon.a (mon.0) 7797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:31 smithi049 bash[23528]: audit 2024-09-21T01:49:30.850398+0000 mon.a (mon.0) 7798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:31 smithi049 bash[23528]: audit 2024-09-21T01:49:30.860673+0000 mon.a (mon.0) 7799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:31 smithi049 bash[23528]: cluster 2024-09-21T01:49:31.512847+0000 mgr.a (mgr.14388) 9307 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:34 smithi044 bash[22676]: cluster 2024-09-21T01:49:33.513830+0000 mgr.a (mgr.14388) 9308 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:49:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:34 smithi179 bash[23186]: cluster 2024-09-21T01:49:33.513830+0000 mgr.a (mgr.14388) 9308 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:49:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:34 smithi049 bash[23528]: cluster 2024-09-21T01:49:33.513830+0000 mgr.a (mgr.14388) 9308 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:49:35.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:35.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:35.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:35.902 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:36 smithi044 bash[22676]: audit 2024-09-21T01:49:35.470472+0000 mgr.a (mgr.14388) 9309 : audit [DBG] from='client.206970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:36 smithi044 bash[22676]: cluster 2024-09-21T01:49:35.517044+0000 mgr.a (mgr.14388) 9310 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:36 smithi179 bash[23186]: audit 2024-09-21T01:49:35.470472+0000 mgr.a (mgr.14388) 9309 : audit [DBG] from='client.206970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:36 smithi179 bash[23186]: cluster 2024-09-21T01:49:35.517044+0000 mgr.a (mgr.14388) 9310 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:36 smithi049 bash[23528]: audit 2024-09-21T01:49:35.470472+0000 mgr.a (mgr.14388) 9309 : audit [DBG] from='client.206970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:36 smithi049 bash[23528]: cluster 2024-09-21T01:49:35.517044+0000 mgr.a (mgr.14388) 9310 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:49:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:38 smithi044 bash[22676]: cluster 2024-09-21T01:49:37.518055+0000 mgr.a (mgr.14388) 9311 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:49:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:38 smithi179 bash[23186]: cluster 2024-09-21T01:49:37.518055+0000 mgr.a (mgr.14388) 9311 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:49:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:38 smithi049 bash[23528]: cluster 2024-09-21T01:49:37.518055+0000 mgr.a (mgr.14388) 9311 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:49:40.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:40 smithi044 bash[22676]: cluster 2024-09-21T01:49:39.518865+0000 mgr.a (mgr.14388) 9312 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:49:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:40 smithi179 bash[23186]: cluster 2024-09-21T01:49:39.518865+0000 mgr.a (mgr.14388) 9312 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:49:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:40 smithi049 bash[23528]: cluster 2024-09-21T01:49:39.518865+0000 mgr.a (mgr.14388) 9312 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:49:41.687 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:41.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:41.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:41.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:41.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:42 smithi044 bash[22676]: audit 2024-09-21T01:49:41.240429+0000 mgr.a (mgr.14388) 9313 : audit [DBG] from='client.207045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:42 smithi044 bash[22676]: cluster 2024-09-21T01:49:41.520239+0000 mgr.a (mgr.14388) 9314 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:42 smithi179 bash[23186]: audit 2024-09-21T01:49:41.240429+0000 mgr.a (mgr.14388) 9313 : audit [DBG] from='client.207045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:42 smithi179 bash[23186]: cluster 2024-09-21T01:49:41.520239+0000 mgr.a (mgr.14388) 9314 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:42 smithi049 bash[23528]: audit 2024-09-21T01:49:41.240429+0000 mgr.a (mgr.14388) 9313 : audit [DBG] from='client.207045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:42 smithi049 bash[23528]: cluster 2024-09-21T01:49:41.520239+0000 mgr.a (mgr.14388) 9314 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:44 smithi044 bash[22676]: cluster 2024-09-21T01:49:43.521151+0000 mgr.a (mgr.14388) 9315 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:49:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:44 smithi044 bash[22676]: audit 2024-09-21T01:49:43.668595+0000 mon.a (mon.0) 7800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:44 smithi044 bash[22676]: audit 2024-09-21T01:49:43.677402+0000 mon.a (mon.0) 7801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:44 smithi044 bash[22676]: audit 2024-09-21T01:49:43.690817+0000 mon.a (mon.0) 7802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:44 smithi044 bash[22676]: audit 2024-09-21T01:49:43.860812+0000 mon.a (mon.0) 7803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:44 smithi044 bash[22676]: audit 2024-09-21T01:49:43.869135+0000 mon.a (mon.0) 7804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:44 smithi044 bash[22676]: audit 2024-09-21T01:49:43.888197+0000 mon.a (mon.0) 7805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:44 smithi179 bash[23186]: cluster 2024-09-21T01:49:43.521151+0000 mgr.a (mgr.14388) 9315 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:49:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:44 smithi179 bash[23186]: audit 2024-09-21T01:49:43.668595+0000 mon.a (mon.0) 7800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:44 smithi179 bash[23186]: audit 2024-09-21T01:49:43.677402+0000 mon.a (mon.0) 7801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:44 smithi179 bash[23186]: audit 2024-09-21T01:49:43.690817+0000 mon.a (mon.0) 7802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:44 smithi179 bash[23186]: audit 2024-09-21T01:49:43.860812+0000 mon.a (mon.0) 7803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:44 smithi179 bash[23186]: audit 2024-09-21T01:49:43.869135+0000 mon.a (mon.0) 7804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:44 smithi179 bash[23186]: audit 2024-09-21T01:49:43.888197+0000 mon.a (mon.0) 7805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:44 smithi049 bash[23528]: cluster 2024-09-21T01:49:43.521151+0000 mgr.a (mgr.14388) 9315 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:49:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:44 smithi049 bash[23528]: audit 2024-09-21T01:49:43.668595+0000 mon.a (mon.0) 7800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:44 smithi049 bash[23528]: audit 2024-09-21T01:49:43.677402+0000 mon.a (mon.0) 7801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:44 smithi049 bash[23528]: audit 2024-09-21T01:49:43.690817+0000 mon.a (mon.0) 7802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:44 smithi049 bash[23528]: audit 2024-09-21T01:49:43.860812+0000 mon.a (mon.0) 7803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:44 smithi049 bash[23528]: audit 2024-09-21T01:49:43.869135+0000 mon.a (mon.0) 7804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:44 smithi049 bash[23528]: audit 2024-09-21T01:49:43.888197+0000 mon.a (mon.0) 7805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:46 smithi044 bash[22676]: cluster 2024-09-21T01:49:45.523359+0000 mgr.a (mgr.14388) 9316 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:49:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:46 smithi179 bash[23186]: cluster 2024-09-21T01:49:45.523359+0000 mgr.a (mgr.14388) 9316 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:49:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:46 smithi049 bash[23528]: cluster 2024-09-21T01:49:45.523359+0000 mgr.a (mgr.14388) 9316 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:49:47.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:47.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:47.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:47.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:47.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:48 smithi044 bash[22676]: audit 2024-09-21T01:49:47.026126+0000 mgr.a (mgr.14388) 9317 : audit [DBG] from='client.207120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:48 smithi044 bash[22676]: cluster 2024-09-21T01:49:47.523972+0000 mgr.a (mgr.14388) 9318 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:48 smithi179 bash[23186]: audit 2024-09-21T01:49:47.026126+0000 mgr.a (mgr.14388) 9317 : audit [DBG] from='client.207120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:48 smithi179 bash[23186]: cluster 2024-09-21T01:49:47.523972+0000 mgr.a (mgr.14388) 9318 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:48 smithi049 bash[23528]: audit 2024-09-21T01:49:47.026126+0000 mgr.a (mgr.14388) 9317 : audit [DBG] from='client.207120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:48 smithi049 bash[23528]: cluster 2024-09-21T01:49:47.523972+0000 mgr.a (mgr.14388) 9318 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:50 smithi044 bash[22676]: cluster 2024-09-21T01:49:49.524767+0000 mgr.a (mgr.14388) 9319 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:50 smithi179 bash[23186]: cluster 2024-09-21T01:49:49.524767+0000 mgr.a (mgr.14388) 9319 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:50 smithi049 bash[23528]: cluster 2024-09-21T01:49:49.524767+0000 mgr.a (mgr.14388) 9319 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:52 smithi049 bash[23528]: audit 2024-09-21T01:49:51.051244+0000 mon.a (mon.0) 7806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:52 smithi049 bash[23528]: audit 2024-09-21T01:49:51.059983+0000 mon.a (mon.0) 7807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:52 smithi049 bash[23528]: audit 2024-09-21T01:49:51.070501+0000 mon.a (mon.0) 7808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:52 smithi049 bash[23528]: cluster 2024-09-21T01:49:51.527038+0000 mgr.a (mgr.14388) 9320 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:52.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:52.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:52.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:52 smithi044 bash[22676]: audit 2024-09-21T01:49:51.051244+0000 mon.a (mon.0) 7806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:52 smithi044 bash[22676]: audit 2024-09-21T01:49:51.059983+0000 mon.a (mon.0) 7807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:52 smithi044 bash[22676]: audit 2024-09-21T01:49:51.070501+0000 mon.a (mon.0) 7808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:52 smithi044 bash[22676]: cluster 2024-09-21T01:49:51.527038+0000 mgr.a (mgr.14388) 9320 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:52 smithi179 bash[23186]: audit 2024-09-21T01:49:51.051244+0000 mon.a (mon.0) 7806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:52 smithi179 bash[23186]: audit 2024-09-21T01:49:51.059983+0000 mon.a (mon.0) 7807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:52 smithi179 bash[23186]: audit 2024-09-21T01:49:51.070501+0000 mon.a (mon.0) 7808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:49:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:52 smithi179 bash[23186]: cluster 2024-09-21T01:49:51.527038+0000 mgr.a (mgr.14388) 9320 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:53.235 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:53.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:53.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:53.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:53.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:53 smithi044 bash[22676]: audit 2024-09-21T01:49:52.786556+0000 mgr.a (mgr.14388) 9321 : audit [DBG] from='client.207198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:53 smithi179 bash[23186]: audit 2024-09-21T01:49:52.786556+0000 mgr.a (mgr.14388) 9321 : audit [DBG] from='client.207198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:53 smithi049 bash[23528]: audit 2024-09-21T01:49:52.786556+0000 mgr.a (mgr.14388) 9321 : audit [DBG] from='client.207198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:54 smithi044 bash[22676]: cluster 2024-09-21T01:49:53.528018+0000 mgr.a (mgr.14388) 9322 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:54 smithi179 bash[23186]: cluster 2024-09-21T01:49:53.528018+0000 mgr.a (mgr.14388) 9322 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:54 smithi049 bash[23528]: cluster 2024-09-21T01:49:53.528018+0000 mgr.a (mgr.14388) 9322 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:56 smithi044 bash[22676]: cluster 2024-09-21T01:49:55.530197+0000 mgr.a (mgr.14388) 9323 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:56 smithi179 bash[23186]: cluster 2024-09-21T01:49:55.530197+0000 mgr.a (mgr.14388) 9323 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:56 smithi049 bash[23528]: cluster 2024-09-21T01:49:55.530197+0000 mgr.a (mgr.14388) 9323 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:49:58.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:49:58.238 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:49:58.238 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:49:58.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:58 smithi044 bash[22676]: cluster 2024-09-21T01:49:57.530982+0000 mgr.a (mgr.14388) 9324 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:58 smithi179 bash[23186]: cluster 2024-09-21T01:49:57.530982+0000 mgr.a (mgr.14388) 9324 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:59.010 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:49:59.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:49:59.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:49:59.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:49:59.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:49:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:58 smithi049 bash[23528]: cluster 2024-09-21T01:49:57.530982+0000 mgr.a (mgr.14388) 9324 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:49:59.849 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:49:59 smithi179 bash[23186]: audit 2024-09-21T01:49:58.572258+0000 mgr.a (mgr.14388) 9325 : audit [DBG] from='client.207276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:49:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:49:59 smithi044 bash[22676]: audit 2024-09-21T01:49:58.572258+0000 mgr.a (mgr.14388) 9325 : audit [DBG] from='client.207276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:00.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:49:59 smithi049 bash[23528]: audit 2024-09-21T01:49:58.572258+0000 mgr.a (mgr.14388) 9325 : audit [DBG] from='client.207276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:00 smithi044 bash[22676]: cluster 2024-09-21T01:49:59.532171+0000 mgr.a (mgr.14388) 9326 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:00 smithi044 bash[22676]: cluster 2024-09-21T01:50:00.000152+0000 mon.a (mon.0) 7809 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:50:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:00 smithi179 bash[23186]: cluster 2024-09-21T01:49:59.532171+0000 mgr.a (mgr.14388) 9326 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:00 smithi179 bash[23186]: cluster 2024-09-21T01:50:00.000152+0000 mon.a (mon.0) 7809 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:50:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:00 smithi049 bash[23528]: cluster 2024-09-21T01:49:59.532171+0000 mgr.a (mgr.14388) 9326 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:00 smithi049 bash[23528]: cluster 2024-09-21T01:50:00.000152+0000 mon.a (mon.0) 7809 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T01:50:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:02 smithi044 bash[22676]: cluster 2024-09-21T01:50:01.534518+0000 mgr.a (mgr.14388) 9327 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:02 smithi179 bash[23186]: cluster 2024-09-21T01:50:01.534518+0000 mgr.a (mgr.14388) 9327 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:02 smithi049 bash[23528]: cluster 2024-09-21T01:50:01.534518+0000 mgr.a (mgr.14388) 9327 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:04.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:04.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:04.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:04.794 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:04.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:04.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:04.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:04.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:04 smithi044 bash[22676]: cluster 2024-09-21T01:50:03.535282+0000 mgr.a (mgr.14388) 9328 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:04 smithi044 bash[22676]: audit 2024-09-21T01:50:03.898621+0000 mon.a (mon.0) 7810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:04 smithi044 bash[22676]: audit 2024-09-21T01:50:03.907383+0000 mon.a (mon.0) 7811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:04 smithi044 bash[22676]: audit 2024-09-21T01:50:03.917929+0000 mon.a (mon.0) 7812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:04 smithi044 bash[22676]: audit 2024-09-21T01:50:04.097216+0000 mon.a (mon.0) 7813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:04 smithi044 bash[22676]: audit 2024-09-21T01:50:04.101797+0000 mon.a (mon.0) 7814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:04 smithi044 bash[22676]: audit 2024-09-21T01:50:04.107124+0000 mon.a (mon.0) 7815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:04 smithi179 bash[23186]: cluster 2024-09-21T01:50:03.535282+0000 mgr.a (mgr.14388) 9328 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:04 smithi179 bash[23186]: audit 2024-09-21T01:50:03.898621+0000 mon.a (mon.0) 7810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:04 smithi179 bash[23186]: audit 2024-09-21T01:50:03.907383+0000 mon.a (mon.0) 7811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:04 smithi179 bash[23186]: audit 2024-09-21T01:50:03.917929+0000 mon.a (mon.0) 7812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:04 smithi179 bash[23186]: audit 2024-09-21T01:50:04.097216+0000 mon.a (mon.0) 7813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:04 smithi179 bash[23186]: audit 2024-09-21T01:50:04.101797+0000 mon.a (mon.0) 7814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:04 smithi179 bash[23186]: audit 2024-09-21T01:50:04.107124+0000 mon.a (mon.0) 7815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:04 smithi049 bash[23528]: cluster 2024-09-21T01:50:03.535282+0000 mgr.a (mgr.14388) 9328 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:04 smithi049 bash[23528]: audit 2024-09-21T01:50:03.898621+0000 mon.a (mon.0) 7810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:04 smithi049 bash[23528]: audit 2024-09-21T01:50:03.907383+0000 mon.a (mon.0) 7811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:04 smithi049 bash[23528]: audit 2024-09-21T01:50:03.917929+0000 mon.a (mon.0) 7812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:04 smithi049 bash[23528]: audit 2024-09-21T01:50:04.097216+0000 mon.a (mon.0) 7813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:04 smithi049 bash[23528]: audit 2024-09-21T01:50:04.101797+0000 mon.a (mon.0) 7814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:04 smithi049 bash[23528]: audit 2024-09-21T01:50:04.107124+0000 mon.a (mon.0) 7815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:05 smithi044 bash[22676]: audit 2024-09-21T01:50:04.347260+0000 mgr.a (mgr.14388) 9329 : audit [DBG] from='client.207354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:05 smithi179 bash[23186]: audit 2024-09-21T01:50:04.347260+0000 mgr.a (mgr.14388) 9329 : audit [DBG] from='client.207354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:05 smithi049 bash[23528]: audit 2024-09-21T01:50:04.347260+0000 mgr.a (mgr.14388) 9329 : audit [DBG] from='client.207354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:06.884 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:06 smithi044 bash[22676]: cluster 2024-09-21T01:50:05.537648+0000 mgr.a (mgr.14388) 9330 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:06.961 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:06 smithi049 bash[23528]: cluster 2024-09-21T01:50:05.537648+0000 mgr.a (mgr.14388) 9330 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:06 smithi179 bash[23186]: cluster 2024-09-21T01:50:05.537648+0000 mgr.a (mgr.14388) 9330 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:08.953 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:08 smithi049 bash[23528]: cluster 2024-09-21T01:50:07.538181+0000 mgr.a (mgr.14388) 9331 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:08 smithi044 bash[22676]: cluster 2024-09-21T01:50:07.538181+0000 mgr.a (mgr.14388) 9331 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:08 smithi179 bash[23186]: cluster 2024-09-21T01:50:07.538181+0000 mgr.a (mgr.14388) 9331 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:09.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:09.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:09.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:10.558 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:10.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:10.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:10.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:10.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:10 smithi044 bash[22676]: cluster 2024-09-21T01:50:09.539203+0000 mgr.a (mgr.14388) 9332 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:10 smithi179 bash[23186]: cluster 2024-09-21T01:50:09.539203+0000 mgr.a (mgr.14388) 9332 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:10 smithi049 bash[23528]: cluster 2024-09-21T01:50:09.539203+0000 mgr.a (mgr.14388) 9332 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:11.932 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:11 smithi179 bash[23186]: audit 2024-09-21T01:50:10.132913+0000 mgr.a (mgr.14388) 9333 : audit [DBG] from='client.207432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:11.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:11 smithi179 bash[23186]: audit 2024-09-21T01:50:11.293707+0000 mon.a (mon.0) 7816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:11.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:11 smithi179 bash[23186]: audit 2024-09-21T01:50:11.302423+0000 mon.a (mon.0) 7817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:11.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:11 smithi179 bash[23186]: audit 2024-09-21T01:50:11.312864+0000 mon.a (mon.0) 7818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:11 smithi044 bash[22676]: audit 2024-09-21T01:50:10.132913+0000 mgr.a (mgr.14388) 9333 : audit [DBG] from='client.207432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:11 smithi044 bash[22676]: audit 2024-09-21T01:50:11.293707+0000 mon.a (mon.0) 7816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:11 smithi044 bash[22676]: audit 2024-09-21T01:50:11.302423+0000 mon.a (mon.0) 7817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:11 smithi044 bash[22676]: audit 2024-09-21T01:50:11.312864+0000 mon.a (mon.0) 7818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:11 smithi049 bash[23528]: audit 2024-09-21T01:50:10.132913+0000 mgr.a (mgr.14388) 9333 : audit [DBG] from='client.207432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:11 smithi049 bash[23528]: audit 2024-09-21T01:50:11.293707+0000 mon.a (mon.0) 7816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:11 smithi049 bash[23528]: audit 2024-09-21T01:50:11.302423+0000 mon.a (mon.0) 7817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:11 smithi049 bash[23528]: audit 2024-09-21T01:50:11.312864+0000 mon.a (mon.0) 7818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:12 smithi044 bash[22676]: cluster 2024-09-21T01:50:11.542056+0000 mgr.a (mgr.14388) 9334 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:12 smithi179 bash[23186]: cluster 2024-09-21T01:50:11.542056+0000 mgr.a (mgr.14388) 9334 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:12 smithi049 bash[23528]: cluster 2024-09-21T01:50:11.542056+0000 mgr.a (mgr.14388) 9334 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:14 smithi044 bash[22676]: cluster 2024-09-21T01:50:13.542795+0000 mgr.a (mgr.14388) 9335 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:14 smithi179 bash[23186]: cluster 2024-09-21T01:50:13.542795+0000 mgr.a (mgr.14388) 9335 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:15.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:14 smithi049 bash[23528]: cluster 2024-09-21T01:50:13.542795+0000 mgr.a (mgr.14388) 9335 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:15.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:15.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:16.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:16 smithi044 bash[22676]: cluster 2024-09-21T01:50:15.544717+0000 mgr.a (mgr.14388) 9336 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:16 smithi179 bash[23186]: cluster 2024-09-21T01:50:15.544717+0000 mgr.a (mgr.14388) 9336 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:16 smithi049 bash[23528]: cluster 2024-09-21T01:50:15.544717+0000 mgr.a (mgr.14388) 9336 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:17 smithi044 bash[22676]: audit 2024-09-21T01:50:15.895407+0000 mgr.a (mgr.14388) 9337 : audit [DBG] from='client.207507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:17 smithi179 bash[23186]: audit 2024-09-21T01:50:15.895407+0000 mgr.a (mgr.14388) 9337 : audit [DBG] from='client.207507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:17 smithi049 bash[23528]: audit 2024-09-21T01:50:15.895407+0000 mgr.a (mgr.14388) 9337 : audit [DBG] from='client.207507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:18 smithi044 bash[22676]: cluster 2024-09-21T01:50:17.545661+0000 mgr.a (mgr.14388) 9338 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:18 smithi179 bash[23186]: cluster 2024-09-21T01:50:17.545661+0000 mgr.a (mgr.14388) 9338 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:18 smithi049 bash[23528]: cluster 2024-09-21T01:50:17.545661+0000 mgr.a (mgr.14388) 9338 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:20 smithi044 bash[22676]: cluster 2024-09-21T01:50:19.546620+0000 mgr.a (mgr.14388) 9339 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:50:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:20 smithi179 bash[23186]: cluster 2024-09-21T01:50:19.546620+0000 mgr.a (mgr.14388) 9339 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:50:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:20 smithi049 bash[23528]: cluster 2024-09-21T01:50:19.546620+0000 mgr.a (mgr.14388) 9339 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:50:21.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:21.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:21.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:21.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:50:21 smithi044 bash[22930]: debug 2024-09-21T01:50:21.891+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:50:21.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:50:21 smithi044 bash[22930]: debug 2024-09-21T01:50:21.903+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:50:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:21 smithi044 bash[22676]: audit 2024-09-21T01:50:21.095572+0000 mon.a (mon.0) 7819 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:50:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:21 smithi044 bash[22676]: audit 2024-09-21T01:50:21.102373+0000 mon.a (mon.0) 7820 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:50:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:21 smithi044 bash[22676]: audit 2024-09-21T01:50:21.104213+0000 mon.a (mon.0) 7821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:50:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:21 smithi044 bash[22676]: audit 2024-09-21T01:50:21.115807+0000 mon.a (mon.0) 7822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:21 smithi044 bash[22676]: audit 2024-09-21T01:50:21.122237+0000 mon.a (mon.0) 7823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:50:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:21 smithi179 bash[23186]: audit 2024-09-21T01:50:21.095572+0000 mon.a (mon.0) 7819 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:50:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:21 smithi179 bash[23186]: audit 2024-09-21T01:50:21.102373+0000 mon.a (mon.0) 7820 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:50:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:21 smithi179 bash[23186]: audit 2024-09-21T01:50:21.104213+0000 mon.a (mon.0) 7821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:50:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:21 smithi179 bash[23186]: audit 2024-09-21T01:50:21.115807+0000 mon.a (mon.0) 7822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:21 smithi179 bash[23186]: audit 2024-09-21T01:50:21.122237+0000 mon.a (mon.0) 7823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:50:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:21 smithi049 bash[23528]: audit 2024-09-21T01:50:21.095572+0000 mon.a (mon.0) 7819 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:50:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:21 smithi049 bash[23528]: audit 2024-09-21T01:50:21.102373+0000 mon.a (mon.0) 7820 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:50:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:21 smithi049 bash[23528]: audit 2024-09-21T01:50:21.104213+0000 mon.a (mon.0) 7821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:50:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:21 smithi049 bash[23528]: audit 2024-09-21T01:50:21.115807+0000 mon.a (mon.0) 7822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:21 smithi049 bash[23528]: audit 2024-09-21T01:50:21.122237+0000 mon.a (mon.0) 7823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:50:22.315 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:22.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:22 smithi044 bash[22676]: audit 2024-09-21T01:50:21.124624+0000 mgr.a (mgr.14388) 9340 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:50:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:22 smithi044 bash[22676]: cluster 2024-09-21T01:50:21.548564+0000 mgr.a (mgr.14388) 9341 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:22 smithi044 bash[22676]: audit 2024-09-21T01:50:21.660288+0000 mgr.a (mgr.14388) 9342 : audit [DBG] from='client.207621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:22 smithi179 bash[23186]: audit 2024-09-21T01:50:21.124624+0000 mgr.a (mgr.14388) 9340 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:50:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:22 smithi179 bash[23186]: cluster 2024-09-21T01:50:21.548564+0000 mgr.a (mgr.14388) 9341 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:22 smithi179 bash[23186]: audit 2024-09-21T01:50:21.660288+0000 mgr.a (mgr.14388) 9342 : audit [DBG] from='client.207621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:22 smithi049 bash[23528]: audit 2024-09-21T01:50:21.124624+0000 mgr.a (mgr.14388) 9340 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:50:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:22 smithi049 bash[23528]: cluster 2024-09-21T01:50:21.548564+0000 mgr.a (mgr.14388) 9341 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:22 smithi049 bash[23528]: audit 2024-09-21T01:50:21.660288+0000 mgr.a (mgr.14388) 9342 : audit [DBG] from='client.207621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:23 smithi044 bash[22676]: audit 2024-09-21T01:50:21.896090+0000 mgr.a (mgr.14388) 9343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:50:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:23 smithi044 bash[22676]: cephadm 2024-09-21T01:50:21.907691+0000 mgr.a (mgr.14388) 9344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:50:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:23 smithi179 bash[23186]: audit 2024-09-21T01:50:21.896090+0000 mgr.a (mgr.14388) 9343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:50:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:23 smithi179 bash[23186]: cephadm 2024-09-21T01:50:21.907691+0000 mgr.a (mgr.14388) 9344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:50:24.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:23 smithi049 bash[23528]: audit 2024-09-21T01:50:21.896090+0000 mgr.a (mgr.14388) 9343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:50:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:23 smithi049 bash[23528]: cephadm 2024-09-21T01:50:21.907691+0000 mgr.a (mgr.14388) 9344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:50:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:24 smithi044 bash[22676]: cluster 2024-09-21T01:50:23.549640+0000 mgr.a (mgr.14388) 9345 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:24 smithi044 bash[22676]: audit 2024-09-21T01:50:24.092998+0000 mon.a (mon.0) 7824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:24 smithi044 bash[22676]: audit 2024-09-21T01:50:24.101569+0000 mon.a (mon.0) 7825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:24 smithi044 bash[22676]: audit 2024-09-21T01:50:24.112337+0000 mon.a (mon.0) 7826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:24 smithi044 bash[22676]: audit 2024-09-21T01:50:24.315122+0000 mon.a (mon.0) 7827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:24 smithi044 bash[22676]: audit 2024-09-21T01:50:24.322829+0000 mon.a (mon.0) 7828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:24 smithi044 bash[22676]: audit 2024-09-21T01:50:24.333030+0000 mon.a (mon.0) 7829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:24 smithi179 bash[23186]: cluster 2024-09-21T01:50:23.549640+0000 mgr.a (mgr.14388) 9345 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:24 smithi179 bash[23186]: audit 2024-09-21T01:50:24.092998+0000 mon.a (mon.0) 7824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:24 smithi179 bash[23186]: audit 2024-09-21T01:50:24.101569+0000 mon.a (mon.0) 7825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:24 smithi179 bash[23186]: audit 2024-09-21T01:50:24.112337+0000 mon.a (mon.0) 7826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:24 smithi179 bash[23186]: audit 2024-09-21T01:50:24.315122+0000 mon.a (mon.0) 7827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:24 smithi179 bash[23186]: audit 2024-09-21T01:50:24.322829+0000 mon.a (mon.0) 7828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:24 smithi179 bash[23186]: audit 2024-09-21T01:50:24.333030+0000 mon.a (mon.0) 7829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:24 smithi049 bash[23528]: cluster 2024-09-21T01:50:23.549640+0000 mgr.a (mgr.14388) 9345 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:24 smithi049 bash[23528]: audit 2024-09-21T01:50:24.092998+0000 mon.a (mon.0) 7824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:24 smithi049 bash[23528]: audit 2024-09-21T01:50:24.101569+0000 mon.a (mon.0) 7825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:24 smithi049 bash[23528]: audit 2024-09-21T01:50:24.112337+0000 mon.a (mon.0) 7826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:24 smithi049 bash[23528]: audit 2024-09-21T01:50:24.315122+0000 mon.a (mon.0) 7827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:24 smithi049 bash[23528]: audit 2024-09-21T01:50:24.322829+0000 mon.a (mon.0) 7828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:24 smithi049 bash[23528]: audit 2024-09-21T01:50:24.333030+0000 mon.a (mon.0) 7829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:26.931 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:26 smithi044 bash[22676]: cluster 2024-09-21T01:50:25.551803+0000 mgr.a (mgr.14388) 9346 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:26 smithi179 bash[23186]: cluster 2024-09-21T01:50:25.551803+0000 mgr.a (mgr.14388) 9346 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:26 smithi049 bash[23528]: cluster 2024-09-21T01:50:25.551803+0000 mgr.a (mgr.14388) 9346 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:27.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:28.074 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:28.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:28.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:28.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:28.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:28 smithi044 bash[22676]: cluster 2024-09-21T01:50:27.552546+0000 mgr.a (mgr.14388) 9347 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:28 smithi044 bash[22676]: audit 2024-09-21T01:50:27.654889+0000 mgr.a (mgr.14388) 9348 : audit [DBG] from='client.207771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:28 smithi179 bash[23186]: cluster 2024-09-21T01:50:27.552546+0000 mgr.a (mgr.14388) 9347 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:28 smithi179 bash[23186]: audit 2024-09-21T01:50:27.654889+0000 mgr.a (mgr.14388) 9348 : audit [DBG] from='client.207771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:28 smithi049 bash[23528]: cluster 2024-09-21T01:50:27.552546+0000 mgr.a (mgr.14388) 9347 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:28 smithi049 bash[23528]: audit 2024-09-21T01:50:27.654889+0000 mgr.a (mgr.14388) 9348 : audit [DBG] from='client.207771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:30.979 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:30 smithi049 bash[23528]: cluster 2024-09-21T01:50:29.553482+0000 mgr.a (mgr.14388) 9349 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:30 smithi044 bash[22676]: cluster 2024-09-21T01:50:29.553482+0000 mgr.a (mgr.14388) 9349 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:30 smithi179 bash[23186]: cluster 2024-09-21T01:50:29.553482+0000 mgr.a (mgr.14388) 9349 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:32 smithi049 bash[23528]: audit 2024-09-21T01:50:31.527621+0000 mon.a (mon.0) 7830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:32 smithi049 bash[23528]: audit 2024-09-21T01:50:31.536450+0000 mon.a (mon.0) 7831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:32 smithi049 bash[23528]: audit 2024-09-21T01:50:31.546980+0000 mon.a (mon.0) 7832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:32 smithi049 bash[23528]: cluster 2024-09-21T01:50:31.555665+0000 mgr.a (mgr.14388) 9350 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:32 smithi044 bash[22676]: audit 2024-09-21T01:50:31.527621+0000 mon.a (mon.0) 7830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:32 smithi044 bash[22676]: audit 2024-09-21T01:50:31.536450+0000 mon.a (mon.0) 7831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:32 smithi044 bash[22676]: audit 2024-09-21T01:50:31.546980+0000 mon.a (mon.0) 7832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:32 smithi044 bash[22676]: cluster 2024-09-21T01:50:31.555665+0000 mgr.a (mgr.14388) 9350 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:32 smithi179 bash[23186]: audit 2024-09-21T01:50:31.527621+0000 mon.a (mon.0) 7830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:32 smithi179 bash[23186]: audit 2024-09-21T01:50:31.536450+0000 mon.a (mon.0) 7831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:32 smithi179 bash[23186]: audit 2024-09-21T01:50:31.546980+0000 mon.a (mon.0) 7832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:32 smithi179 bash[23186]: cluster 2024-09-21T01:50:31.555665+0000 mgr.a (mgr.14388) 9350 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:33.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:33.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:33.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:33.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:33.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:33.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:33.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:33.862 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:34 smithi044 bash[22676]: audit 2024-09-21T01:50:33.415555+0000 mgr.a (mgr.14388) 9351 : audit [DBG] from='client.207849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:34 smithi044 bash[22676]: cluster 2024-09-21T01:50:33.559125+0000 mgr.a (mgr.14388) 9352 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:34 smithi179 bash[23186]: audit 2024-09-21T01:50:33.415555+0000 mgr.a (mgr.14388) 9351 : audit [DBG] from='client.207849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:34 smithi179 bash[23186]: cluster 2024-09-21T01:50:33.559125+0000 mgr.a (mgr.14388) 9352 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:34 smithi049 bash[23528]: audit 2024-09-21T01:50:33.415555+0000 mgr.a (mgr.14388) 9351 : audit [DBG] from='client.207849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:34 smithi049 bash[23528]: cluster 2024-09-21T01:50:33.559125+0000 mgr.a (mgr.14388) 9352 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:36 smithi044 bash[22676]: cluster 2024-09-21T01:50:35.561430+0000 mgr.a (mgr.14388) 9353 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:36 smithi179 bash[23186]: cluster 2024-09-21T01:50:35.561430+0000 mgr.a (mgr.14388) 9353 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:36 smithi049 bash[23528]: cluster 2024-09-21T01:50:35.561430+0000 mgr.a (mgr.14388) 9353 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:50:38.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:38.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:38.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:38 smithi044 bash[22676]: cluster 2024-09-21T01:50:37.562246+0000 mgr.a (mgr.14388) 9354 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:38 smithi179 bash[23186]: cluster 2024-09-21T01:50:37.562246+0000 mgr.a (mgr.14388) 9354 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:38 smithi049 bash[23528]: cluster 2024-09-21T01:50:37.562246+0000 mgr.a (mgr.14388) 9354 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:39.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:39.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:39.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:39.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:40 smithi179 bash[23186]: audit 2024-09-21T01:50:39.200534+0000 mgr.a (mgr.14388) 9355 : audit [DBG] from='client.207927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:40 smithi179 bash[23186]: cluster 2024-09-21T01:50:39.562983+0000 mgr.a (mgr.14388) 9356 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:40 smithi049 bash[23528]: audit 2024-09-21T01:50:39.200534+0000 mgr.a (mgr.14388) 9355 : audit [DBG] from='client.207927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:40 smithi049 bash[23528]: cluster 2024-09-21T01:50:39.562983+0000 mgr.a (mgr.14388) 9356 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:40 smithi044 bash[22676]: audit 2024-09-21T01:50:39.200534+0000 mgr.a (mgr.14388) 9355 : audit [DBG] from='client.207927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:40 smithi044 bash[22676]: cluster 2024-09-21T01:50:39.562983+0000 mgr.a (mgr.14388) 9356 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:42 smithi044 bash[22676]: cluster 2024-09-21T01:50:41.565303+0000 mgr.a (mgr.14388) 9357 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:42 smithi179 bash[23186]: cluster 2024-09-21T01:50:41.565303+0000 mgr.a (mgr.14388) 9357 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:42 smithi049 bash[23528]: cluster 2024-09-21T01:50:41.565303+0000 mgr.a (mgr.14388) 9357 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:50:44.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:44.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:44.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:44 smithi044 bash[22676]: cluster 2024-09-21T01:50:43.566203+0000 mgr.a (mgr.14388) 9358 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:44 smithi044 bash[22676]: audit 2024-09-21T01:50:44.323683+0000 mon.a (mon.0) 7833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:44 smithi044 bash[22676]: audit 2024-09-21T01:50:44.332756+0000 mon.a (mon.0) 7834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:44 smithi044 bash[22676]: audit 2024-09-21T01:50:44.342364+0000 mon.a (mon.0) 7835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:44 smithi044 bash[22676]: audit 2024-09-21T01:50:44.545802+0000 mon.a (mon.0) 7836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:44 smithi044 bash[22676]: audit 2024-09-21T01:50:44.554140+0000 mon.a (mon.0) 7837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:44 smithi044 bash[22676]: audit 2024-09-21T01:50:44.564078+0000 mon.a (mon.0) 7838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:44 smithi179 bash[23186]: cluster 2024-09-21T01:50:43.566203+0000 mgr.a (mgr.14388) 9358 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:44 smithi179 bash[23186]: audit 2024-09-21T01:50:44.323683+0000 mon.a (mon.0) 7833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:44 smithi179 bash[23186]: audit 2024-09-21T01:50:44.332756+0000 mon.a (mon.0) 7834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:44 smithi179 bash[23186]: audit 2024-09-21T01:50:44.342364+0000 mon.a (mon.0) 7835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:44 smithi179 bash[23186]: audit 2024-09-21T01:50:44.545802+0000 mon.a (mon.0) 7836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:44 smithi179 bash[23186]: audit 2024-09-21T01:50:44.554140+0000 mon.a (mon.0) 7837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:44 smithi179 bash[23186]: audit 2024-09-21T01:50:44.564078+0000 mon.a (mon.0) 7838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:44 smithi049 bash[23528]: cluster 2024-09-21T01:50:43.566203+0000 mgr.a (mgr.14388) 9358 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:44 smithi049 bash[23528]: audit 2024-09-21T01:50:44.323683+0000 mon.a (mon.0) 7833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:44 smithi049 bash[23528]: audit 2024-09-21T01:50:44.332756+0000 mon.a (mon.0) 7834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:44 smithi049 bash[23528]: audit 2024-09-21T01:50:44.342364+0000 mon.a (mon.0) 7835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:44 smithi049 bash[23528]: audit 2024-09-21T01:50:44.545802+0000 mon.a (mon.0) 7836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:44 smithi049 bash[23528]: audit 2024-09-21T01:50:44.554140+0000 mon.a (mon.0) 7837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:44 smithi049 bash[23528]: audit 2024-09-21T01:50:44.564078+0000 mon.a (mon.0) 7838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:45.396 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:45.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:45.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:45.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:45.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:46 smithi044 bash[22676]: audit 2024-09-21T01:50:44.980730+0000 mgr.a (mgr.14388) 9359 : audit [DBG] from='client.208002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:46 smithi044 bash[22676]: cluster 2024-09-21T01:50:45.569029+0000 mgr.a (mgr.14388) 9360 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:46 smithi179 bash[23186]: audit 2024-09-21T01:50:44.980730+0000 mgr.a (mgr.14388) 9359 : audit [DBG] from='client.208002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:46 smithi179 bash[23186]: cluster 2024-09-21T01:50:45.569029+0000 mgr.a (mgr.14388) 9360 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:46 smithi049 bash[23528]: audit 2024-09-21T01:50:44.980730+0000 mgr.a (mgr.14388) 9359 : audit [DBG] from='client.208002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:46 smithi049 bash[23528]: cluster 2024-09-21T01:50:45.569029+0000 mgr.a (mgr.14388) 9360 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:48.904 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:48 smithi049 bash[23528]: cluster 2024-09-21T01:50:47.569869+0000 mgr.a (mgr.14388) 9361 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:48 smithi044 bash[22676]: cluster 2024-09-21T01:50:47.569869+0000 mgr.a (mgr.14388) 9361 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:48 smithi179 bash[23186]: cluster 2024-09-21T01:50:47.569869+0000 mgr.a (mgr.14388) 9361 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:50.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:50.399 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:50.399 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:50 smithi044 bash[22676]: cluster 2024-09-21T01:50:49.570583+0000 mgr.a (mgr.14388) 9362 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:50:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:50 smithi179 bash[23186]: cluster 2024-09-21T01:50:49.570583+0000 mgr.a (mgr.14388) 9362 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:50:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:50 smithi049 bash[23528]: cluster 2024-09-21T01:50:49.570583+0000 mgr.a (mgr.14388) 9362 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:50:51.185 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:51.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:51.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:51.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:51.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:51 smithi044 bash[22676]: audit 2024-09-21T01:50:50.737056+0000 mgr.a (mgr.14388) 9363 : audit [DBG] from='client.208080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:51 smithi179 bash[23186]: audit 2024-09-21T01:50:50.737056+0000 mgr.a (mgr.14388) 9363 : audit [DBG] from='client.208080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:51 smithi049 bash[23528]: audit 2024-09-21T01:50:50.737056+0000 mgr.a (mgr.14388) 9363 : audit [DBG] from='client.208080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:52 smithi044 bash[22676]: cluster 2024-09-21T01:50:51.573560+0000 mgr.a (mgr.14388) 9364 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:52 smithi044 bash[22676]: audit 2024-09-21T01:50:51.725806+0000 mon.a (mon.0) 7839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:52 smithi044 bash[22676]: audit 2024-09-21T01:50:51.732183+0000 mon.a (mon.0) 7840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:52 smithi044 bash[22676]: audit 2024-09-21T01:50:51.737206+0000 mon.a (mon.0) 7841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:52 smithi179 bash[23186]: cluster 2024-09-21T01:50:51.573560+0000 mgr.a (mgr.14388) 9364 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:52 smithi179 bash[23186]: audit 2024-09-21T01:50:51.725806+0000 mon.a (mon.0) 7839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:52 smithi179 bash[23186]: audit 2024-09-21T01:50:51.732183+0000 mon.a (mon.0) 7840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:52 smithi179 bash[23186]: audit 2024-09-21T01:50:51.737206+0000 mon.a (mon.0) 7841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:52 smithi049 bash[23528]: cluster 2024-09-21T01:50:51.573560+0000 mgr.a (mgr.14388) 9364 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:52 smithi049 bash[23528]: audit 2024-09-21T01:50:51.725806+0000 mon.a (mon.0) 7839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:52 smithi049 bash[23528]: audit 2024-09-21T01:50:51.732183+0000 mon.a (mon.0) 7840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:52 smithi049 bash[23528]: audit 2024-09-21T01:50:51.737206+0000 mon.a (mon.0) 7841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:50:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:54 smithi044 bash[22676]: cluster 2024-09-21T01:50:53.574354+0000 mgr.a (mgr.14388) 9365 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:54 smithi179 bash[23186]: cluster 2024-09-21T01:50:53.574354+0000 mgr.a (mgr.14388) 9365 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:54 smithi049 bash[23528]: cluster 2024-09-21T01:50:53.574354+0000 mgr.a (mgr.14388) 9365 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:50:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:50:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:50:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:50:56.951 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:50:56.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:50:56.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:50:56.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:50:56.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:50:56.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:56 smithi044 bash[22676]: cluster 2024-09-21T01:50:55.576277+0000 mgr.a (mgr.14388) 9366 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:56 smithi179 bash[23186]: cluster 2024-09-21T01:50:55.576277+0000 mgr.a (mgr.14388) 9366 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:56 smithi049 bash[23528]: cluster 2024-09-21T01:50:55.576277+0000 mgr.a (mgr.14388) 9366 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:57 smithi044 bash[22676]: audit 2024-09-21T01:50:56.517089+0000 mgr.a (mgr.14388) 9367 : audit [DBG] from='client.208155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:57 smithi179 bash[23186]: audit 2024-09-21T01:50:56.517089+0000 mgr.a (mgr.14388) 9367 : audit [DBG] from='client.208155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:57 smithi049 bash[23528]: audit 2024-09-21T01:50:56.517089+0000 mgr.a (mgr.14388) 9367 : audit [DBG] from='client.208155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:50:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:50:58 smithi179 bash[23186]: cluster 2024-09-21T01:50:57.577290+0000 mgr.a (mgr.14388) 9368 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:50:58 smithi049 bash[23528]: cluster 2024-09-21T01:50:57.577290+0000 mgr.a (mgr.14388) 9368 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:50:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:50:58 smithi044 bash[22676]: cluster 2024-09-21T01:50:57.577290+0000 mgr.a (mgr.14388) 9368 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:00 smithi179 bash[23186]: cluster 2024-09-21T01:50:59.578096+0000 mgr.a (mgr.14388) 9369 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:00 smithi049 bash[23528]: cluster 2024-09-21T01:50:59.578096+0000 mgr.a (mgr.14388) 9369 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:00 smithi044 bash[22676]: cluster 2024-09-21T01:50:59.578096+0000 mgr.a (mgr.14388) 9369 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:01.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:01.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:01.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:02.729 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:02.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:02 smithi179 bash[23186]: cluster 2024-09-21T01:51:01.580314+0000 mgr.a (mgr.14388) 9370 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:02 smithi049 bash[23528]: cluster 2024-09-21T01:51:01.580314+0000 mgr.a (mgr.14388) 9370 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:02 smithi044 bash[22676]: cluster 2024-09-21T01:51:01.580314+0000 mgr.a (mgr.14388) 9370 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:03 smithi049 bash[23528]: audit 2024-09-21T01:51:02.290070+0000 mgr.a (mgr.14388) 9371 : audit [DBG] from='client.208227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:03 smithi044 bash[22676]: audit 2024-09-21T01:51:02.290070+0000 mgr.a (mgr.14388) 9371 : audit [DBG] from='client.208227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:03 smithi179 bash[23186]: audit 2024-09-21T01:51:02.290070+0000 mgr.a (mgr.14388) 9371 : audit [DBG] from='client.208227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:04 smithi179 bash[23186]: cluster 2024-09-21T01:51:03.581222+0000 mgr.a (mgr.14388) 9372 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:04 smithi179 bash[23186]: audit 2024-09-21T01:51:04.556643+0000 mon.a (mon.0) 7842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:04 smithi179 bash[23186]: audit 2024-09-21T01:51:04.564851+0000 mon.a (mon.0) 7843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:04 smithi179 bash[23186]: audit 2024-09-21T01:51:04.573901+0000 mon.a (mon.0) 7844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:04 smithi179 bash[23186]: audit 2024-09-21T01:51:04.744149+0000 mon.a (mon.0) 7845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:04 smithi179 bash[23186]: audit 2024-09-21T01:51:04.749317+0000 mon.a (mon.0) 7846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:04 smithi179 bash[23186]: audit 2024-09-21T01:51:04.756612+0000 mon.a (mon.0) 7847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:04 smithi049 bash[23528]: cluster 2024-09-21T01:51:03.581222+0000 mgr.a (mgr.14388) 9372 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:04 smithi049 bash[23528]: audit 2024-09-21T01:51:04.556643+0000 mon.a (mon.0) 7842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:04 smithi049 bash[23528]: audit 2024-09-21T01:51:04.564851+0000 mon.a (mon.0) 7843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:04 smithi049 bash[23528]: audit 2024-09-21T01:51:04.573901+0000 mon.a (mon.0) 7844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:04 smithi049 bash[23528]: audit 2024-09-21T01:51:04.744149+0000 mon.a (mon.0) 7845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:04 smithi049 bash[23528]: audit 2024-09-21T01:51:04.749317+0000 mon.a (mon.0) 7846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:04 smithi049 bash[23528]: audit 2024-09-21T01:51:04.756612+0000 mon.a (mon.0) 7847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:04 smithi044 bash[22676]: cluster 2024-09-21T01:51:03.581222+0000 mgr.a (mgr.14388) 9372 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:04 smithi044 bash[22676]: audit 2024-09-21T01:51:04.556643+0000 mon.a (mon.0) 7842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:04 smithi044 bash[22676]: audit 2024-09-21T01:51:04.564851+0000 mon.a (mon.0) 7843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:04 smithi044 bash[22676]: audit 2024-09-21T01:51:04.573901+0000 mon.a (mon.0) 7844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:04 smithi044 bash[22676]: audit 2024-09-21T01:51:04.744149+0000 mon.a (mon.0) 7845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:04 smithi044 bash[22676]: audit 2024-09-21T01:51:04.749317+0000 mon.a (mon.0) 7846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:04 smithi044 bash[22676]: audit 2024-09-21T01:51:04.756612+0000 mon.a (mon.0) 7847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:06 smithi044 bash[22676]: cluster 2024-09-21T01:51:05.583348+0000 mgr.a (mgr.14388) 9373 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:06 smithi049 bash[23528]: cluster 2024-09-21T01:51:05.583348+0000 mgr.a (mgr.14388) 9373 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:06 smithi179 bash[23186]: cluster 2024-09-21T01:51:05.583348+0000 mgr.a (mgr.14388) 9373 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:07.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:07.731 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:07.735 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:08.494 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:09.025 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:08 smithi049 bash[23528]: cluster 2024-09-21T01:51:07.584105+0000 mgr.a (mgr.14388) 9374 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:08 smithi044 bash[22676]: cluster 2024-09-21T01:51:07.584105+0000 mgr.a (mgr.14388) 9374 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:08 smithi179 bash[23186]: cluster 2024-09-21T01:51:07.584105+0000 mgr.a (mgr.14388) 9374 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:09 smithi049 bash[23528]: audit 2024-09-21T01:51:08.060207+0000 mgr.a (mgr.14388) 9375 : audit [DBG] from='client.208305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:09 smithi044 bash[22676]: audit 2024-09-21T01:51:08.060207+0000 mgr.a (mgr.14388) 9375 : audit [DBG] from='client.208305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:09 smithi179 bash[23186]: audit 2024-09-21T01:51:08.060207+0000 mgr.a (mgr.14388) 9375 : audit [DBG] from='client.208305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:10 smithi049 bash[23528]: cluster 2024-09-21T01:51:09.584765+0000 mgr.a (mgr.14388) 9376 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:10 smithi044 bash[22676]: cluster 2024-09-21T01:51:09.584765+0000 mgr.a (mgr.14388) 9376 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:10 smithi179 bash[23186]: cluster 2024-09-21T01:51:09.584765+0000 mgr.a (mgr.14388) 9376 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:12 smithi049 bash[23528]: cluster 2024-09-21T01:51:11.587016+0000 mgr.a (mgr.14388) 9377 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:12 smithi049 bash[23528]: audit 2024-09-21T01:51:11.865550+0000 mon.a (mon.0) 7848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:12 smithi049 bash[23528]: audit 2024-09-21T01:51:11.874078+0000 mon.a (mon.0) 7849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:12 smithi049 bash[23528]: audit 2024-09-21T01:51:11.884495+0000 mon.a (mon.0) 7850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:12 smithi044 bash[22676]: cluster 2024-09-21T01:51:11.587016+0000 mgr.a (mgr.14388) 9377 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:12 smithi044 bash[22676]: audit 2024-09-21T01:51:11.865550+0000 mon.a (mon.0) 7848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:12 smithi044 bash[22676]: audit 2024-09-21T01:51:11.874078+0000 mon.a (mon.0) 7849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:12 smithi044 bash[22676]: audit 2024-09-21T01:51:11.884495+0000 mon.a (mon.0) 7850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:12 smithi179 bash[23186]: cluster 2024-09-21T01:51:11.587016+0000 mgr.a (mgr.14388) 9377 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:12 smithi179 bash[23186]: audit 2024-09-21T01:51:11.865550+0000 mon.a (mon.0) 7848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:12 smithi179 bash[23186]: audit 2024-09-21T01:51:11.874078+0000 mon.a (mon.0) 7849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:12 smithi179 bash[23186]: audit 2024-09-21T01:51:11.884495+0000 mon.a (mon.0) 7850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:13.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:13.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:13.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:14.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:14.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:14.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:14.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:14.290 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:14 smithi049 bash[23528]: cluster 2024-09-21T01:51:13.587743+0000 mgr.a (mgr.14388) 9378 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:14 smithi044 bash[22676]: cluster 2024-09-21T01:51:13.587743+0000 mgr.a (mgr.14388) 9378 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:14 smithi179 bash[23186]: cluster 2024-09-21T01:51:13.587743+0000 mgr.a (mgr.14388) 9378 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:15 smithi049 bash[23528]: audit 2024-09-21T01:51:13.832491+0000 mgr.a (mgr.14388) 9379 : audit [DBG] from='client.208383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:15 smithi044 bash[22676]: audit 2024-09-21T01:51:13.832491+0000 mgr.a (mgr.14388) 9379 : audit [DBG] from='client.208383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:15 smithi179 bash[23186]: audit 2024-09-21T01:51:13.832491+0000 mgr.a (mgr.14388) 9379 : audit [DBG] from='client.208383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:16 smithi044 bash[22676]: cluster 2024-09-21T01:51:15.590000+0000 mgr.a (mgr.14388) 9380 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:16 smithi179 bash[23186]: cluster 2024-09-21T01:51:15.590000+0000 mgr.a (mgr.14388) 9380 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:16 smithi049 bash[23528]: cluster 2024-09-21T01:51:15.590000+0000 mgr.a (mgr.14388) 9380 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:18 smithi044 bash[22676]: cluster 2024-09-21T01:51:17.590771+0000 mgr.a (mgr.14388) 9381 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:18 smithi179 bash[23186]: cluster 2024-09-21T01:51:17.590771+0000 mgr.a (mgr.14388) 9381 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:19.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:18 smithi049 bash[23528]: cluster 2024-09-21T01:51:17.590771+0000 mgr.a (mgr.14388) 9381 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:20.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:20.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:20.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:20.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:20 smithi044 bash[22676]: cluster 2024-09-21T01:51:19.591475+0000 mgr.a (mgr.14388) 9382 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:20 smithi044 bash[22676]: audit 2024-09-21T01:51:19.628016+0000 mgr.a (mgr.14388) 9383 : audit [DBG] from='client.208461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:20 smithi179 bash[23186]: cluster 2024-09-21T01:51:19.591475+0000 mgr.a (mgr.14388) 9382 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:20 smithi179 bash[23186]: audit 2024-09-21T01:51:19.628016+0000 mgr.a (mgr.14388) 9383 : audit [DBG] from='client.208461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:20 smithi049 bash[23528]: cluster 2024-09-21T01:51:19.591475+0000 mgr.a (mgr.14388) 9382 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:20 smithi049 bash[23528]: audit 2024-09-21T01:51:19.628016+0000 mgr.a (mgr.14388) 9383 : audit [DBG] from='client.208461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:22.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22930]: debug 2024-09-21T01:51:22.718+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:51:22.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22930]: debug 2024-09-21T01:51:22.718+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:51:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22676]: cluster 2024-09-21T01:51:21.594222+0000 mgr.a (mgr.14388) 9384 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:51:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22676]: audit 2024-09-21T01:51:21.959733+0000 mon.a (mon.0) 7851 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:51:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22676]: audit 2024-09-21T01:51:21.967412+0000 mon.a (mon.0) 7852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:51:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22676]: audit 2024-09-21T01:51:21.969377+0000 mon.a (mon.0) 7853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:51:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22676]: audit 2024-09-21T01:51:21.980511+0000 mon.a (mon.0) 7854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:22 smithi044 bash[22676]: audit 2024-09-21T01:51:21.986903+0000 mon.a (mon.0) 7855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:51:23.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:22 smithi179 bash[23186]: cluster 2024-09-21T01:51:21.594222+0000 mgr.a (mgr.14388) 9384 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:51:23.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:22 smithi179 bash[23186]: audit 2024-09-21T01:51:21.959733+0000 mon.a (mon.0) 7851 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:51:23.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:22 smithi179 bash[23186]: audit 2024-09-21T01:51:21.967412+0000 mon.a (mon.0) 7852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:51:23.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:22 smithi179 bash[23186]: audit 2024-09-21T01:51:21.969377+0000 mon.a (mon.0) 7853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:51:23.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:22 smithi179 bash[23186]: audit 2024-09-21T01:51:21.980511+0000 mon.a (mon.0) 7854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:23.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:22 smithi179 bash[23186]: audit 2024-09-21T01:51:21.986903+0000 mon.a (mon.0) 7855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:51:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:22 smithi049 bash[23528]: cluster 2024-09-21T01:51:21.594222+0000 mgr.a (mgr.14388) 9384 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:51:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:22 smithi049 bash[23528]: audit 2024-09-21T01:51:21.959733+0000 mon.a (mon.0) 7851 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:51:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:22 smithi049 bash[23528]: audit 2024-09-21T01:51:21.967412+0000 mon.a (mon.0) 7852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:51:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:22 smithi049 bash[23528]: audit 2024-09-21T01:51:21.969377+0000 mon.a (mon.0) 7853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:51:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:22 smithi049 bash[23528]: audit 2024-09-21T01:51:21.980511+0000 mon.a (mon.0) 7854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:22 smithi049 bash[23528]: audit 2024-09-21T01:51:21.986903+0000 mon.a (mon.0) 7855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:51:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:23 smithi044 bash[22676]: audit 2024-09-21T01:51:21.989441+0000 mgr.a (mgr.14388) 9385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:51:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:23 smithi044 bash[22676]: audit 2024-09-21T01:51:22.722105+0000 mgr.a (mgr.14388) 9386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:51:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:23 smithi044 bash[22676]: cephadm 2024-09-21T01:51:22.723239+0000 mgr.a (mgr.14388) 9387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:51:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:23 smithi179 bash[23186]: audit 2024-09-21T01:51:21.989441+0000 mgr.a (mgr.14388) 9385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:51:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:23 smithi179 bash[23186]: audit 2024-09-21T01:51:22.722105+0000 mgr.a (mgr.14388) 9386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:51:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:23 smithi179 bash[23186]: cephadm 2024-09-21T01:51:22.723239+0000 mgr.a (mgr.14388) 9387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:51:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:23 smithi049 bash[23528]: audit 2024-09-21T01:51:21.989441+0000 mgr.a (mgr.14388) 9385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:51:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:23 smithi049 bash[23528]: audit 2024-09-21T01:51:22.722105+0000 mgr.a (mgr.14388) 9386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:51:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:23 smithi049 bash[23528]: cephadm 2024-09-21T01:51:22.723239+0000 mgr.a (mgr.14388) 9387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:51:25.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:25.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:25.089 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:24 smithi044 bash[22676]: cluster 2024-09-21T01:51:23.595310+0000 mgr.a (mgr.14388) 9388 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:51:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:24 smithi044 bash[22676]: audit 2024-09-21T01:51:24.782761+0000 mon.a (mon.0) 7856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:24 smithi044 bash[22676]: audit 2024-09-21T01:51:24.789844+0000 mon.a (mon.0) 7857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:24 smithi044 bash[22676]: audit 2024-09-21T01:51:24.797893+0000 mon.a (mon.0) 7858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:24 smithi179 bash[23186]: cluster 2024-09-21T01:51:23.595310+0000 mgr.a (mgr.14388) 9388 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:51:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:24 smithi179 bash[23186]: audit 2024-09-21T01:51:24.782761+0000 mon.a (mon.0) 7856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:24 smithi179 bash[23186]: audit 2024-09-21T01:51:24.789844+0000 mon.a (mon.0) 7857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:24 smithi179 bash[23186]: audit 2024-09-21T01:51:24.797893+0000 mon.a (mon.0) 7858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:24 smithi049 bash[23528]: cluster 2024-09-21T01:51:23.595310+0000 mgr.a (mgr.14388) 9388 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:51:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:24 smithi049 bash[23528]: audit 2024-09-21T01:51:24.782761+0000 mon.a (mon.0) 7856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:24 smithi049 bash[23528]: audit 2024-09-21T01:51:24.789844+0000 mon.a (mon.0) 7857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:24 smithi049 bash[23528]: audit 2024-09-21T01:51:24.797893+0000 mon.a (mon.0) 7858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:25.848 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:25.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:25.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:25.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:25.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:25 smithi044 bash[22676]: audit 2024-09-21T01:51:24.975342+0000 mon.a (mon.0) 7859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:25 smithi044 bash[22676]: audit 2024-09-21T01:51:24.983317+0000 mon.a (mon.0) 7860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:25 smithi044 bash[22676]: audit 2024-09-21T01:51:24.991840+0000 mon.a (mon.0) 7861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:25 smithi044 bash[22676]: audit 2024-09-21T01:51:25.421015+0000 mgr.a (mgr.14388) 9389 : audit [DBG] from='client.208644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:25 smithi044 bash[22676]: cluster 2024-09-21T01:51:25.596637+0000 mgr.a (mgr.14388) 9390 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:25 smithi179 bash[23186]: audit 2024-09-21T01:51:24.975342+0000 mon.a (mon.0) 7859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:25 smithi179 bash[23186]: audit 2024-09-21T01:51:24.983317+0000 mon.a (mon.0) 7860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:25 smithi179 bash[23186]: audit 2024-09-21T01:51:24.991840+0000 mon.a (mon.0) 7861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:25 smithi179 bash[23186]: audit 2024-09-21T01:51:25.421015+0000 mgr.a (mgr.14388) 9389 : audit [DBG] from='client.208644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:25 smithi179 bash[23186]: cluster 2024-09-21T01:51:25.596637+0000 mgr.a (mgr.14388) 9390 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:25 smithi049 bash[23528]: audit 2024-09-21T01:51:24.975342+0000 mon.a (mon.0) 7859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:25 smithi049 bash[23528]: audit 2024-09-21T01:51:24.983317+0000 mon.a (mon.0) 7860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:25 smithi049 bash[23528]: audit 2024-09-21T01:51:24.991840+0000 mon.a (mon.0) 7861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:25 smithi049 bash[23528]: audit 2024-09-21T01:51:25.421015+0000 mgr.a (mgr.14388) 9389 : audit [DBG] from='client.208644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:25 smithi049 bash[23528]: cluster 2024-09-21T01:51:25.596637+0000 mgr.a (mgr.14388) 9390 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:28 smithi049 bash[23528]: cluster 2024-09-21T01:51:27.597541+0000 mgr.a (mgr.14388) 9391 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:28 smithi044 bash[22676]: cluster 2024-09-21T01:51:27.597541+0000 mgr.a (mgr.14388) 9391 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:28 smithi179 bash[23186]: cluster 2024-09-21T01:51:27.597541+0000 mgr.a (mgr.14388) 9391 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:30 smithi049 bash[23528]: cluster 2024-09-21T01:51:29.598342+0000 mgr.a (mgr.14388) 9392 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:30.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:30.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:30.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:30 smithi044 bash[22676]: cluster 2024-09-21T01:51:29.598342+0000 mgr.a (mgr.14388) 9392 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:30 smithi179 bash[23186]: cluster 2024-09-21T01:51:29.598342+0000 mgr.a (mgr.14388) 9392 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:31.613 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:31.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:31.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:31.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:31.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:32 smithi044 bash[22676]: audit 2024-09-21T01:51:31.185936+0000 mgr.a (mgr.14388) 9393 : audit [DBG] from='client.208719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:32 smithi044 bash[22676]: cluster 2024-09-21T01:51:31.599893+0000 mgr.a (mgr.14388) 9394 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:32 smithi044 bash[22676]: audit 2024-09-21T01:51:32.092242+0000 mon.a (mon.0) 7862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:32 smithi044 bash[22676]: audit 2024-09-21T01:51:32.101110+0000 mon.a (mon.0) 7863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:32 smithi044 bash[22676]: audit 2024-09-21T01:51:32.111749+0000 mon.a (mon.0) 7864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:32 smithi179 bash[23186]: audit 2024-09-21T01:51:31.185936+0000 mgr.a (mgr.14388) 9393 : audit [DBG] from='client.208719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:32 smithi179 bash[23186]: cluster 2024-09-21T01:51:31.599893+0000 mgr.a (mgr.14388) 9394 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:32 smithi179 bash[23186]: audit 2024-09-21T01:51:32.092242+0000 mon.a (mon.0) 7862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:32 smithi179 bash[23186]: audit 2024-09-21T01:51:32.101110+0000 mon.a (mon.0) 7863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:32 smithi179 bash[23186]: audit 2024-09-21T01:51:32.111749+0000 mon.a (mon.0) 7864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:32 smithi049 bash[23528]: audit 2024-09-21T01:51:31.185936+0000 mgr.a (mgr.14388) 9393 : audit [DBG] from='client.208719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:32 smithi049 bash[23528]: cluster 2024-09-21T01:51:31.599893+0000 mgr.a (mgr.14388) 9394 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:32 smithi049 bash[23528]: audit 2024-09-21T01:51:32.092242+0000 mon.a (mon.0) 7862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:32 smithi049 bash[23528]: audit 2024-09-21T01:51:32.101110+0000 mon.a (mon.0) 7863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:32 smithi049 bash[23528]: audit 2024-09-21T01:51:32.111749+0000 mon.a (mon.0) 7864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:34 smithi044 bash[22676]: cluster 2024-09-21T01:51:33.600648+0000 mgr.a (mgr.14388) 9395 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:34 smithi179 bash[23186]: cluster 2024-09-21T01:51:33.600648+0000 mgr.a (mgr.14388) 9395 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:34 smithi049 bash[23528]: cluster 2024-09-21T01:51:33.600648+0000 mgr.a (mgr.14388) 9395 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:51:36.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:36.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:36.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:36 smithi044 bash[22676]: cluster 2024-09-21T01:51:35.602824+0000 mgr.a (mgr.14388) 9396 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:36 smithi179 bash[23186]: cluster 2024-09-21T01:51:35.602824+0000 mgr.a (mgr.14388) 9396 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:36 smithi049 bash[23528]: cluster 2024-09-21T01:51:35.602824+0000 mgr.a (mgr.14388) 9396 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:51:37.403 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:37.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:38 smithi044 bash[22676]: audit 2024-09-21T01:51:36.961498+0000 mgr.a (mgr.14388) 9397 : audit [DBG] from='client.208797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:38 smithi044 bash[22676]: cluster 2024-09-21T01:51:37.603852+0000 mgr.a (mgr.14388) 9398 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:38 smithi179 bash[23186]: audit 2024-09-21T01:51:36.961498+0000 mgr.a (mgr.14388) 9397 : audit [DBG] from='client.208797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:38 smithi179 bash[23186]: cluster 2024-09-21T01:51:37.603852+0000 mgr.a (mgr.14388) 9398 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:38 smithi049 bash[23528]: audit 2024-09-21T01:51:36.961498+0000 mgr.a (mgr.14388) 9397 : audit [DBG] from='client.208797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:38 smithi049 bash[23528]: cluster 2024-09-21T01:51:37.603852+0000 mgr.a (mgr.14388) 9398 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:40 smithi044 bash[22676]: cluster 2024-09-21T01:51:39.604638+0000 mgr.a (mgr.14388) 9399 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:40.990 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:40 smithi179 bash[23186]: cluster 2024-09-21T01:51:39.604638+0000 mgr.a (mgr.14388) 9399 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:40 smithi049 bash[23528]: cluster 2024-09-21T01:51:39.604638+0000 mgr.a (mgr.14388) 9399 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:42.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:42.405 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:42.405 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:42 smithi044 bash[22676]: cluster 2024-09-21T01:51:41.606890+0000 mgr.a (mgr.14388) 9400 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:42 smithi179 bash[23186]: cluster 2024-09-21T01:51:41.606890+0000 mgr.a (mgr.14388) 9400 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:42 smithi049 bash[23528]: cluster 2024-09-21T01:51:41.606890+0000 mgr.a (mgr.14388) 9400 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:43.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:43.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:43.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:43.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:43.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:43 smithi044 bash[22676]: audit 2024-09-21T01:51:42.740531+0000 mgr.a (mgr.14388) 9401 : audit [DBG] from='client.208872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:43 smithi179 bash[23186]: audit 2024-09-21T01:51:42.740531+0000 mgr.a (mgr.14388) 9401 : audit [DBG] from='client.208872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:43 smithi049 bash[23528]: audit 2024-09-21T01:51:42.740531+0000 mgr.a (mgr.14388) 9401 : audit [DBG] from='client.208872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:44 smithi044 bash[22676]: cluster 2024-09-21T01:51:43.607900+0000 mgr.a (mgr.14388) 9402 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:44 smithi179 bash[23186]: cluster 2024-09-21T01:51:43.607900+0000 mgr.a (mgr.14388) 9402 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:44 smithi049 bash[23528]: cluster 2024-09-21T01:51:43.607900+0000 mgr.a (mgr.14388) 9402 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:46 smithi049 bash[23528]: audit 2024-09-21T01:51:45.005124+0000 mon.a (mon.0) 7865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:46 smithi049 bash[23528]: audit 2024-09-21T01:51:45.013131+0000 mon.a (mon.0) 7866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:46 smithi049 bash[23528]: audit 2024-09-21T01:51:45.023051+0000 mon.a (mon.0) 7867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:46 smithi049 bash[23528]: audit 2024-09-21T01:51:45.210699+0000 mon.a (mon.0) 7868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:46 smithi049 bash[23528]: audit 2024-09-21T01:51:45.218036+0000 mon.a (mon.0) 7869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:46 smithi049 bash[23528]: audit 2024-09-21T01:51:45.227744+0000 mon.a (mon.0) 7870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:46 smithi049 bash[23528]: cluster 2024-09-21T01:51:45.610207+0000 mgr.a (mgr.14388) 9403 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:46 smithi044 bash[22676]: audit 2024-09-21T01:51:45.005124+0000 mon.a (mon.0) 7865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:46 smithi044 bash[22676]: audit 2024-09-21T01:51:45.013131+0000 mon.a (mon.0) 7866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:46 smithi044 bash[22676]: audit 2024-09-21T01:51:45.023051+0000 mon.a (mon.0) 7867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:46 smithi044 bash[22676]: audit 2024-09-21T01:51:45.210699+0000 mon.a (mon.0) 7868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:46 smithi044 bash[22676]: audit 2024-09-21T01:51:45.218036+0000 mon.a (mon.0) 7869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:46 smithi044 bash[22676]: audit 2024-09-21T01:51:45.227744+0000 mon.a (mon.0) 7870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:46 smithi044 bash[22676]: cluster 2024-09-21T01:51:45.610207+0000 mgr.a (mgr.14388) 9403 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:46 smithi179 bash[23186]: audit 2024-09-21T01:51:45.005124+0000 mon.a (mon.0) 7865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:46 smithi179 bash[23186]: audit 2024-09-21T01:51:45.013131+0000 mon.a (mon.0) 7866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:46 smithi179 bash[23186]: audit 2024-09-21T01:51:45.023051+0000 mon.a (mon.0) 7867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:46 smithi179 bash[23186]: audit 2024-09-21T01:51:45.210699+0000 mon.a (mon.0) 7868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:46 smithi179 bash[23186]: audit 2024-09-21T01:51:45.218036+0000 mon.a (mon.0) 7869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:46 smithi179 bash[23186]: audit 2024-09-21T01:51:45.227744+0000 mon.a (mon.0) 7870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:46 smithi179 bash[23186]: cluster 2024-09-21T01:51:45.610207+0000 mgr.a (mgr.14388) 9403 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:48.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:48.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:48.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:48.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:48.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:48.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:48.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:48.941 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:48 smithi044 bash[22676]: cluster 2024-09-21T01:51:47.611020+0000 mgr.a (mgr.14388) 9404 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:48 smithi179 bash[23186]: cluster 2024-09-21T01:51:47.611020+0000 mgr.a (mgr.14388) 9404 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:48 smithi049 bash[23528]: cluster 2024-09-21T01:51:47.611020+0000 mgr.a (mgr.14388) 9404 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:49.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:49 smithi049 bash[23528]: audit 2024-09-21T01:51:48.513273+0000 mgr.a (mgr.14388) 9405 : audit [DBG] from='client.208944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:49 smithi044 bash[22676]: audit 2024-09-21T01:51:48.513273+0000 mgr.a (mgr.14388) 9405 : audit [DBG] from='client.208944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:49 smithi179 bash[23186]: audit 2024-09-21T01:51:48.513273+0000 mgr.a (mgr.14388) 9405 : audit [DBG] from='client.208944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:50 smithi044 bash[22676]: cluster 2024-09-21T01:51:49.611939+0000 mgr.a (mgr.14388) 9406 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:50 smithi179 bash[23186]: cluster 2024-09-21T01:51:49.611939+0000 mgr.a (mgr.14388) 9406 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:51.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:50 smithi049 bash[23528]: cluster 2024-09-21T01:51:49.611939+0000 mgr.a (mgr.14388) 9406 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:52 smithi044 bash[22676]: cluster 2024-09-21T01:51:51.614268+0000 mgr.a (mgr.14388) 9407 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:52 smithi044 bash[22676]: audit 2024-09-21T01:51:52.296817+0000 mon.a (mon.0) 7871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:52 smithi044 bash[22676]: audit 2024-09-21T01:51:52.305483+0000 mon.a (mon.0) 7872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:52 smithi044 bash[22676]: audit 2024-09-21T01:51:52.316149+0000 mon.a (mon.0) 7873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:52 smithi179 bash[23186]: cluster 2024-09-21T01:51:51.614268+0000 mgr.a (mgr.14388) 9407 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:52 smithi179 bash[23186]: audit 2024-09-21T01:51:52.296817+0000 mon.a (mon.0) 7871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:52 smithi179 bash[23186]: audit 2024-09-21T01:51:52.305483+0000 mon.a (mon.0) 7872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:52 smithi179 bash[23186]: audit 2024-09-21T01:51:52.316149+0000 mon.a (mon.0) 7873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:52 smithi049 bash[23528]: cluster 2024-09-21T01:51:51.614268+0000 mgr.a (mgr.14388) 9407 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:52 smithi049 bash[23528]: audit 2024-09-21T01:51:52.296817+0000 mon.a (mon.0) 7871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:52 smithi049 bash[23528]: audit 2024-09-21T01:51:52.305483+0000 mon.a (mon.0) 7872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:52 smithi049 bash[23528]: audit 2024-09-21T01:51:52.316149+0000 mon.a (mon.0) 7873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:51:53.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:53.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:53.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:51:54.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:51:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:51:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:51:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:51:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:51:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:54 smithi044 bash[22676]: cluster 2024-09-21T01:51:53.615091+0000 mgr.a (mgr.14388) 9408 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:54 smithi179 bash[23186]: cluster 2024-09-21T01:51:53.615091+0000 mgr.a (mgr.14388) 9408 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:54 smithi049 bash[23528]: cluster 2024-09-21T01:51:53.615091+0000 mgr.a (mgr.14388) 9408 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:55 smithi044 bash[22676]: audit 2024-09-21T01:51:54.273524+0000 mgr.a (mgr.14388) 9409 : audit [DBG] from='client.209022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:55 smithi179 bash[23186]: audit 2024-09-21T01:51:54.273524+0000 mgr.a (mgr.14388) 9409 : audit [DBG] from='client.209022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:55 smithi049 bash[23528]: audit 2024-09-21T01:51:54.273524+0000 mgr.a (mgr.14388) 9409 : audit [DBG] from='client.209022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:56 smithi044 bash[22676]: cluster 2024-09-21T01:51:55.617440+0000 mgr.a (mgr.14388) 9410 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:56 smithi179 bash[23186]: cluster 2024-09-21T01:51:55.617440+0000 mgr.a (mgr.14388) 9410 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:56 smithi049 bash[23528]: cluster 2024-09-21T01:51:55.617440+0000 mgr.a (mgr.14388) 9410 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:51:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:51:58 smithi044 bash[22676]: cluster 2024-09-21T01:51:57.618350+0000 mgr.a (mgr.14388) 9411 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:51:58 smithi179 bash[23186]: cluster 2024-09-21T01:51:57.618350+0000 mgr.a (mgr.14388) 9411 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:51:58 smithi049 bash[23528]: cluster 2024-09-21T01:51:57.618350+0000 mgr.a (mgr.14388) 9411 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:00 smithi044 bash[22676]: cluster 2024-09-21T01:51:59.619298+0000 mgr.a (mgr.14388) 9412 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:00 smithi179 bash[23186]: cluster 2024-09-21T01:51:59.619298+0000 mgr.a (mgr.14388) 9412 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:00 smithi049 bash[23528]: cluster 2024-09-21T01:51:59.619298+0000 mgr.a (mgr.14388) 9412 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:01 smithi044 bash[22676]: audit 2024-09-21T01:52:00.033995+0000 mgr.a (mgr.14388) 9413 : audit [DBG] from='client.209100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:01 smithi179 bash[23186]: audit 2024-09-21T01:52:00.033995+0000 mgr.a (mgr.14388) 9413 : audit [DBG] from='client.209100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:01 smithi049 bash[23528]: audit 2024-09-21T01:52:00.033995+0000 mgr.a (mgr.14388) 9413 : audit [DBG] from='client.209100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:02 smithi044 bash[22676]: cluster 2024-09-21T01:52:01.622102+0000 mgr.a (mgr.14388) 9414 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:02 smithi179 bash[23186]: cluster 2024-09-21T01:52:01.622102+0000 mgr.a (mgr.14388) 9414 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:02 smithi049 bash[23528]: cluster 2024-09-21T01:52:01.622102+0000 mgr.a (mgr.14388) 9414 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:04 smithi044 bash[22676]: cluster 2024-09-21T01:52:03.623010+0000 mgr.a (mgr.14388) 9415 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:04 smithi179 bash[23186]: cluster 2024-09-21T01:52:03.623010+0000 mgr.a (mgr.14388) 9415 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:04 smithi049 bash[23528]: cluster 2024-09-21T01:52:03.623010+0000 mgr.a (mgr.14388) 9415 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:05.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:05.490 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:05.490 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:06.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:06.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:06.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:06.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:06.273 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: audit 2024-09-21T01:52:05.228855+0000 mon.a (mon.0) 7874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: audit 2024-09-21T01:52:05.238452+0000 mon.a (mon.0) 7875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: audit 2024-09-21T01:52:05.248474+0000 mon.a (mon.0) 7876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: audit 2024-09-21T01:52:05.416600+0000 mon.a (mon.0) 7877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: audit 2024-09-21T01:52:05.424768+0000 mon.a (mon.0) 7878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: audit 2024-09-21T01:52:05.434795+0000 mon.a (mon.0) 7879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: cluster 2024-09-21T01:52:05.624057+0000 mgr.a (mgr.14388) 9416 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:06 smithi044 bash[22676]: audit 2024-09-21T01:52:05.827245+0000 mgr.a (mgr.14388) 9417 : audit [DBG] from='client.209178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: audit 2024-09-21T01:52:05.228855+0000 mon.a (mon.0) 7874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: audit 2024-09-21T01:52:05.238452+0000 mon.a (mon.0) 7875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: audit 2024-09-21T01:52:05.248474+0000 mon.a (mon.0) 7876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: audit 2024-09-21T01:52:05.416600+0000 mon.a (mon.0) 7877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: audit 2024-09-21T01:52:05.424768+0000 mon.a (mon.0) 7878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: audit 2024-09-21T01:52:05.434795+0000 mon.a (mon.0) 7879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: cluster 2024-09-21T01:52:05.624057+0000 mgr.a (mgr.14388) 9416 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:06 smithi179 bash[23186]: audit 2024-09-21T01:52:05.827245+0000 mgr.a (mgr.14388) 9417 : audit [DBG] from='client.209178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: audit 2024-09-21T01:52:05.228855+0000 mon.a (mon.0) 7874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: audit 2024-09-21T01:52:05.238452+0000 mon.a (mon.0) 7875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: audit 2024-09-21T01:52:05.248474+0000 mon.a (mon.0) 7876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: audit 2024-09-21T01:52:05.416600+0000 mon.a (mon.0) 7877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: audit 2024-09-21T01:52:05.424768+0000 mon.a (mon.0) 7878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: audit 2024-09-21T01:52:05.434795+0000 mon.a (mon.0) 7879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: cluster 2024-09-21T01:52:05.624057+0000 mgr.a (mgr.14388) 9416 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:06 smithi049 bash[23528]: audit 2024-09-21T01:52:05.827245+0000 mgr.a (mgr.14388) 9417 : audit [DBG] from='client.209178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:08 smithi044 bash[22676]: cluster 2024-09-21T01:52:07.624935+0000 mgr.a (mgr.14388) 9418 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:08 smithi179 bash[23186]: cluster 2024-09-21T01:52:07.624935+0000 mgr.a (mgr.14388) 9418 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:08 smithi049 bash[23528]: cluster 2024-09-21T01:52:07.624935+0000 mgr.a (mgr.14388) 9418 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:10 smithi044 bash[22676]: cluster 2024-09-21T01:52:09.625781+0000 mgr.a (mgr.14388) 9419 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:52:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:10 smithi179 bash[23186]: cluster 2024-09-21T01:52:09.625781+0000 mgr.a (mgr.14388) 9419 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:52:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:10 smithi049 bash[23528]: cluster 2024-09-21T01:52:09.625781+0000 mgr.a (mgr.14388) 9419 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:52:11.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:11.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:11.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:12.049 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:12.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:12 smithi049 bash[23528]: audit 2024-09-21T01:52:11.607713+0000 mgr.a (mgr.14388) 9420 : audit [DBG] from='client.209253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:12 smithi049 bash[23528]: cluster 2024-09-21T01:52:11.630293+0000 mgr.a (mgr.14388) 9421 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:12 smithi049 bash[23528]: audit 2024-09-21T01:52:12.487459+0000 mon.a (mon.0) 7880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:12 smithi049 bash[23528]: audit 2024-09-21T01:52:12.496089+0000 mon.a (mon.0) 7881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:12 smithi049 bash[23528]: audit 2024-09-21T01:52:12.506725+0000 mon.a (mon.0) 7882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:12 smithi044 bash[22676]: audit 2024-09-21T01:52:11.607713+0000 mgr.a (mgr.14388) 9420 : audit [DBG] from='client.209253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:12 smithi044 bash[22676]: cluster 2024-09-21T01:52:11.630293+0000 mgr.a (mgr.14388) 9421 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:12 smithi044 bash[22676]: audit 2024-09-21T01:52:12.487459+0000 mon.a (mon.0) 7880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:12 smithi044 bash[22676]: audit 2024-09-21T01:52:12.496089+0000 mon.a (mon.0) 7881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:12 smithi044 bash[22676]: audit 2024-09-21T01:52:12.506725+0000 mon.a (mon.0) 7882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:12 smithi179 bash[23186]: audit 2024-09-21T01:52:11.607713+0000 mgr.a (mgr.14388) 9420 : audit [DBG] from='client.209253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:12 smithi179 bash[23186]: cluster 2024-09-21T01:52:11.630293+0000 mgr.a (mgr.14388) 9421 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:12 smithi179 bash[23186]: audit 2024-09-21T01:52:12.487459+0000 mon.a (mon.0) 7880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:12 smithi179 bash[23186]: audit 2024-09-21T01:52:12.496089+0000 mon.a (mon.0) 7881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:12 smithi179 bash[23186]: audit 2024-09-21T01:52:12.506725+0000 mon.a (mon.0) 7882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:14 smithi044 bash[22676]: cluster 2024-09-21T01:52:13.631325+0000 mgr.a (mgr.14388) 9422 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:14 smithi179 bash[23186]: cluster 2024-09-21T01:52:13.631325+0000 mgr.a (mgr.14388) 9422 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:14 smithi049 bash[23528]: cluster 2024-09-21T01:52:13.631325+0000 mgr.a (mgr.14388) 9422 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:16 smithi044 bash[22676]: cluster 2024-09-21T01:52:15.633711+0000 mgr.a (mgr.14388) 9423 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:16 smithi179 bash[23186]: cluster 2024-09-21T01:52:15.633711+0000 mgr.a (mgr.14388) 9423 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:16 smithi049 bash[23528]: cluster 2024-09-21T01:52:15.633711+0000 mgr.a (mgr.14388) 9423 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:17.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:17.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:18 smithi044 bash[22676]: audit 2024-09-21T01:52:17.382178+0000 mgr.a (mgr.14388) 9424 : audit [DBG] from='client.209328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:18 smithi044 bash[22676]: cluster 2024-09-21T01:52:17.634272+0000 mgr.a (mgr.14388) 9425 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:18 smithi179 bash[23186]: audit 2024-09-21T01:52:17.382178+0000 mgr.a (mgr.14388) 9424 : audit [DBG] from='client.209328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:18 smithi179 bash[23186]: cluster 2024-09-21T01:52:17.634272+0000 mgr.a (mgr.14388) 9425 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:18 smithi049 bash[23528]: audit 2024-09-21T01:52:17.382178+0000 mgr.a (mgr.14388) 9424 : audit [DBG] from='client.209328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:18 smithi049 bash[23528]: cluster 2024-09-21T01:52:17.634272+0000 mgr.a (mgr.14388) 9425 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:20.962 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:20 smithi179 bash[23186]: cluster 2024-09-21T01:52:19.635149+0000 mgr.a (mgr.14388) 9426 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:20 smithi044 bash[22676]: cluster 2024-09-21T01:52:19.635149+0000 mgr.a (mgr.14388) 9426 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:20 smithi049 bash[23528]: cluster 2024-09-21T01:52:19.635149+0000 mgr.a (mgr.14388) 9426 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:22.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:22.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:22.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:22 smithi044 bash[22676]: cluster 2024-09-21T01:52:21.637414+0000 mgr.a (mgr.14388) 9427 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:22 smithi179 bash[23186]: cluster 2024-09-21T01:52:21.637414+0000 mgr.a (mgr.14388) 9427 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:22 smithi049 bash[23528]: cluster 2024-09-21T01:52:21.637414+0000 mgr.a (mgr.14388) 9427 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:23.967 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:23.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:23.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:23.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:23.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22930]: debug 2024-09-21T01:52:23.557+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22930]: debug 2024-09-21T01:52:23.573+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22676]: audit 2024-09-21T01:52:22.772359+0000 mon.a (mon.0) 7883 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22676]: audit 2024-09-21T01:52:22.779891+0000 mon.a (mon.0) 7884 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22676]: audit 2024-09-21T01:52:22.781850+0000 mon.a (mon.0) 7885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22676]: audit 2024-09-21T01:52:22.793008+0000 mon.a (mon.0) 7886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22676]: audit 2024-09-21T01:52:22.799461+0000 mon.a (mon.0) 7887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:52:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:23 smithi044 bash[22676]: audit 2024-09-21T01:52:22.802124+0000 mgr.a (mgr.14388) 9428 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:52:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:23 smithi179 bash[23186]: audit 2024-09-21T01:52:22.772359+0000 mon.a (mon.0) 7883 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:52:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:23 smithi179 bash[23186]: audit 2024-09-21T01:52:22.779891+0000 mon.a (mon.0) 7884 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:52:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:23 smithi179 bash[23186]: audit 2024-09-21T01:52:22.781850+0000 mon.a (mon.0) 7885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:52:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:23 smithi179 bash[23186]: audit 2024-09-21T01:52:22.793008+0000 mon.a (mon.0) 7886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:23 smithi179 bash[23186]: audit 2024-09-21T01:52:22.799461+0000 mon.a (mon.0) 7887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:52:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:23 smithi179 bash[23186]: audit 2024-09-21T01:52:22.802124+0000 mgr.a (mgr.14388) 9428 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:52:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:23 smithi049 bash[23528]: audit 2024-09-21T01:52:22.772359+0000 mon.a (mon.0) 7883 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:52:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:23 smithi049 bash[23528]: audit 2024-09-21T01:52:22.779891+0000 mon.a (mon.0) 7884 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:52:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:23 smithi049 bash[23528]: audit 2024-09-21T01:52:22.781850+0000 mon.a (mon.0) 7885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:52:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:23 smithi049 bash[23528]: audit 2024-09-21T01:52:22.793008+0000 mon.a (mon.0) 7886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:23 smithi049 bash[23528]: audit 2024-09-21T01:52:22.799461+0000 mon.a (mon.0) 7887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:52:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:23 smithi049 bash[23528]: audit 2024-09-21T01:52:22.802124+0000 mgr.a (mgr.14388) 9428 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:52:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:24 smithi049 bash[23528]: audit 2024-09-21T01:52:23.157164+0000 mgr.a (mgr.14388) 9429 : audit [DBG] from='client.209421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:24 smithi049 bash[23528]: audit 2024-09-21T01:52:23.563541+0000 mgr.a (mgr.14388) 9430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:52:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:24 smithi049 bash[23528]: cephadm 2024-09-21T01:52:23.576510+0000 mgr.a (mgr.14388) 9431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:52:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:24 smithi049 bash[23528]: cluster 2024-09-21T01:52:23.637986+0000 mgr.a (mgr.14388) 9432 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:24 smithi044 bash[22676]: audit 2024-09-21T01:52:23.157164+0000 mgr.a (mgr.14388) 9429 : audit [DBG] from='client.209421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:24 smithi044 bash[22676]: audit 2024-09-21T01:52:23.563541+0000 mgr.a (mgr.14388) 9430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:52:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:24 smithi044 bash[22676]: cephadm 2024-09-21T01:52:23.576510+0000 mgr.a (mgr.14388) 9431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:52:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:24 smithi044 bash[22676]: cluster 2024-09-21T01:52:23.637986+0000 mgr.a (mgr.14388) 9432 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:24 smithi179 bash[23186]: audit 2024-09-21T01:52:23.157164+0000 mgr.a (mgr.14388) 9429 : audit [DBG] from='client.209421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:24 smithi179 bash[23186]: audit 2024-09-21T01:52:23.563541+0000 mgr.a (mgr.14388) 9430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:24 smithi179 bash[23186]: cephadm 2024-09-21T01:52:23.576510+0000 mgr.a (mgr.14388) 9431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:24 smithi179 bash[23186]: cluster 2024-09-21T01:52:23.637986+0000 mgr.a (mgr.14388) 9432 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:26 smithi044 bash[22676]: audit 2024-09-21T01:52:25.454288+0000 mon.a (mon.0) 7888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:26 smithi044 bash[22676]: audit 2024-09-21T01:52:25.460897+0000 mon.a (mon.0) 7889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:26 smithi044 bash[22676]: audit 2024-09-21T01:52:25.468843+0000 mon.a (mon.0) 7890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:26 smithi044 bash[22676]: audit 2024-09-21T01:52:25.630198+0000 mon.a (mon.0) 7891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:26 smithi044 bash[22676]: audit 2024-09-21T01:52:25.639413+0000 mon.a (mon.0) 7892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:26 smithi044 bash[22676]: cluster 2024-09-21T01:52:25.640209+0000 mgr.a (mgr.14388) 9433 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:26 smithi044 bash[22676]: audit 2024-09-21T01:52:25.650512+0000 mon.a (mon.0) 7893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:26 smithi179 bash[23186]: audit 2024-09-21T01:52:25.454288+0000 mon.a (mon.0) 7888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:26 smithi179 bash[23186]: audit 2024-09-21T01:52:25.460897+0000 mon.a (mon.0) 7889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:26 smithi179 bash[23186]: audit 2024-09-21T01:52:25.468843+0000 mon.a (mon.0) 7890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:26 smithi179 bash[23186]: audit 2024-09-21T01:52:25.630198+0000 mon.a (mon.0) 7891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:26 smithi179 bash[23186]: audit 2024-09-21T01:52:25.639413+0000 mon.a (mon.0) 7892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:26 smithi179 bash[23186]: cluster 2024-09-21T01:52:25.640209+0000 mgr.a (mgr.14388) 9433 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:26 smithi179 bash[23186]: audit 2024-09-21T01:52:25.650512+0000 mon.a (mon.0) 7893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:26 smithi049 bash[23528]: audit 2024-09-21T01:52:25.454288+0000 mon.a (mon.0) 7888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:26 smithi049 bash[23528]: audit 2024-09-21T01:52:25.460897+0000 mon.a (mon.0) 7889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:26 smithi049 bash[23528]: audit 2024-09-21T01:52:25.468843+0000 mon.a (mon.0) 7890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:26 smithi049 bash[23528]: audit 2024-09-21T01:52:25.630198+0000 mon.a (mon.0) 7891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:26 smithi049 bash[23528]: audit 2024-09-21T01:52:25.639413+0000 mon.a (mon.0) 7892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:26 smithi049 bash[23528]: cluster 2024-09-21T01:52:25.640209+0000 mgr.a (mgr.14388) 9433 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:26 smithi049 bash[23528]: audit 2024-09-21T01:52:25.650512+0000 mon.a (mon.0) 7893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:28.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:28.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:28.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:28.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:28 smithi044 bash[22676]: cluster 2024-09-21T01:52:27.641005+0000 mgr.a (mgr.14388) 9434 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:28 smithi179 bash[23186]: cluster 2024-09-21T01:52:27.641005+0000 mgr.a (mgr.14388) 9434 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:28 smithi049 bash[23528]: cluster 2024-09-21T01:52:27.641005+0000 mgr.a (mgr.14388) 9434 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:30 smithi044 bash[22676]: audit 2024-09-21T01:52:29.294162+0000 mgr.a (mgr.14388) 9435 : audit [DBG] from='client.209586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:30 smithi044 bash[22676]: cluster 2024-09-21T01:52:29.641710+0000 mgr.a (mgr.14388) 9436 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:30.995 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:30 smithi049 bash[23528]: audit 2024-09-21T01:52:29.294162+0000 mgr.a (mgr.14388) 9435 : audit [DBG] from='client.209586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:30.995 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:30 smithi049 bash[23528]: cluster 2024-09-21T01:52:29.641710+0000 mgr.a (mgr.14388) 9436 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:30 smithi179 bash[23186]: audit 2024-09-21T01:52:29.294162+0000 mgr.a (mgr.14388) 9435 : audit [DBG] from='client.209586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:30 smithi179 bash[23186]: cluster 2024-09-21T01:52:29.641710+0000 mgr.a (mgr.14388) 9436 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:32 smithi049 bash[23528]: cluster 2024-09-21T01:52:31.644057+0000 mgr.a (mgr.14388) 9437 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:32 smithi049 bash[23528]: audit 2024-09-21T01:52:32.670714+0000 mon.a (mon.0) 7894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:32 smithi049 bash[23528]: audit 2024-09-21T01:52:32.679859+0000 mon.a (mon.0) 7895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:32 smithi049 bash[23528]: audit 2024-09-21T01:52:32.690760+0000 mon.a (mon.0) 7896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:32 smithi044 bash[22676]: cluster 2024-09-21T01:52:31.644057+0000 mgr.a (mgr.14388) 9437 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:32 smithi044 bash[22676]: audit 2024-09-21T01:52:32.670714+0000 mon.a (mon.0) 7894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:32 smithi044 bash[22676]: audit 2024-09-21T01:52:32.679859+0000 mon.a (mon.0) 7895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:32 smithi044 bash[22676]: audit 2024-09-21T01:52:32.690760+0000 mon.a (mon.0) 7896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:32 smithi179 bash[23186]: cluster 2024-09-21T01:52:31.644057+0000 mgr.a (mgr.14388) 9437 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:32 smithi179 bash[23186]: audit 2024-09-21T01:52:32.670714+0000 mon.a (mon.0) 7894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:32 smithi179 bash[23186]: audit 2024-09-21T01:52:32.679859+0000 mon.a (mon.0) 7895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:32 smithi179 bash[23186]: audit 2024-09-21T01:52:32.690760+0000 mon.a (mon.0) 7896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:34.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:34.739 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:34.739 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:34 smithi044 bash[22676]: cluster 2024-09-21T01:52:33.644868+0000 mgr.a (mgr.14388) 9438 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:34 smithi179 bash[23186]: cluster 2024-09-21T01:52:33.644868+0000 mgr.a (mgr.14388) 9438 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:34 smithi049 bash[23528]: cluster 2024-09-21T01:52:33.644868+0000 mgr.a (mgr.14388) 9438 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:35.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:36 smithi044 bash[22676]: audit 2024-09-21T01:52:35.061992+0000 mgr.a (mgr.14388) 9439 : audit [DBG] from='client.209661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:36 smithi044 bash[22676]: cluster 2024-09-21T01:52:35.647526+0000 mgr.a (mgr.14388) 9440 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:36 smithi179 bash[23186]: audit 2024-09-21T01:52:35.061992+0000 mgr.a (mgr.14388) 9439 : audit [DBG] from='client.209661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:36 smithi179 bash[23186]: cluster 2024-09-21T01:52:35.647526+0000 mgr.a (mgr.14388) 9440 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:36 smithi049 bash[23528]: audit 2024-09-21T01:52:35.061992+0000 mgr.a (mgr.14388) 9439 : audit [DBG] from='client.209661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:36 smithi049 bash[23528]: cluster 2024-09-21T01:52:35.647526+0000 mgr.a (mgr.14388) 9440 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:52:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:38 smithi044 bash[22676]: cluster 2024-09-21T01:52:37.648303+0000 mgr.a (mgr.14388) 9441 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:38 smithi179 bash[23186]: cluster 2024-09-21T01:52:37.648303+0000 mgr.a (mgr.14388) 9441 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:38 smithi049 bash[23528]: cluster 2024-09-21T01:52:37.648303+0000 mgr.a (mgr.14388) 9441 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:40.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:40.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:40.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:40.974 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:40 smithi179 bash[23186]: cluster 2024-09-21T01:52:39.649075+0000 mgr.a (mgr.14388) 9442 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:52:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:40 smithi044 bash[22676]: cluster 2024-09-21T01:52:39.649075+0000 mgr.a (mgr.14388) 9442 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:52:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:40 smithi049 bash[23528]: cluster 2024-09-21T01:52:39.649075+0000 mgr.a (mgr.14388) 9442 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:52:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:41.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:41.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:41.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:41.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:41 smithi044 bash[22676]: audit 2024-09-21T01:52:40.837292+0000 mgr.a (mgr.14388) 9443 : audit [DBG] from='client.209739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:41 smithi179 bash[23186]: audit 2024-09-21T01:52:40.837292+0000 mgr.a (mgr.14388) 9443 : audit [DBG] from='client.209739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:41 smithi049 bash[23528]: audit 2024-09-21T01:52:40.837292+0000 mgr.a (mgr.14388) 9443 : audit [DBG] from='client.209739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:42 smithi044 bash[22676]: cluster 2024-09-21T01:52:41.651811+0000 mgr.a (mgr.14388) 9444 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:42 smithi179 bash[23186]: cluster 2024-09-21T01:52:41.651811+0000 mgr.a (mgr.14388) 9444 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:42 smithi049 bash[23528]: cluster 2024-09-21T01:52:41.651811+0000 mgr.a (mgr.14388) 9444 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:44 smithi179 bash[23186]: cluster 2024-09-21T01:52:43.652581+0000 mgr.a (mgr.14388) 9445 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:44 smithi049 bash[23528]: cluster 2024-09-21T01:52:43.652581+0000 mgr.a (mgr.14388) 9445 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:44 smithi044 bash[22676]: cluster 2024-09-21T01:52:43.652581+0000 mgr.a (mgr.14388) 9445 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:52:46.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:46.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:46.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:46 smithi044 bash[22676]: cluster 2024-09-21T01:52:45.654555+0000 mgr.a (mgr.14388) 9446 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:46 smithi044 bash[22676]: audit 2024-09-21T01:52:45.679144+0000 mon.a (mon.0) 7897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:46 smithi044 bash[22676]: audit 2024-09-21T01:52:45.686945+0000 mon.a (mon.0) 7898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:46 smithi044 bash[22676]: audit 2024-09-21T01:52:45.694154+0000 mon.a (mon.0) 7899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:46 smithi044 bash[22676]: audit 2024-09-21T01:52:45.873886+0000 mon.a (mon.0) 7900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:46 smithi044 bash[22676]: audit 2024-09-21T01:52:45.882421+0000 mon.a (mon.0) 7901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:46 smithi044 bash[22676]: audit 2024-09-21T01:52:45.894249+0000 mon.a (mon.0) 7902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:46 smithi179 bash[23186]: cluster 2024-09-21T01:52:45.654555+0000 mgr.a (mgr.14388) 9446 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:46 smithi179 bash[23186]: audit 2024-09-21T01:52:45.679144+0000 mon.a (mon.0) 7897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:46 smithi179 bash[23186]: audit 2024-09-21T01:52:45.686945+0000 mon.a (mon.0) 7898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:46 smithi179 bash[23186]: audit 2024-09-21T01:52:45.694154+0000 mon.a (mon.0) 7899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:46 smithi179 bash[23186]: audit 2024-09-21T01:52:45.873886+0000 mon.a (mon.0) 7900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:46 smithi179 bash[23186]: audit 2024-09-21T01:52:45.882421+0000 mon.a (mon.0) 7901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:46 smithi179 bash[23186]: audit 2024-09-21T01:52:45.894249+0000 mon.a (mon.0) 7902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:46 smithi049 bash[23528]: cluster 2024-09-21T01:52:45.654555+0000 mgr.a (mgr.14388) 9446 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:46 smithi049 bash[23528]: audit 2024-09-21T01:52:45.679144+0000 mon.a (mon.0) 7897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:46 smithi049 bash[23528]: audit 2024-09-21T01:52:45.686945+0000 mon.a (mon.0) 7898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:46 smithi049 bash[23528]: audit 2024-09-21T01:52:45.694154+0000 mon.a (mon.0) 7899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:46 smithi049 bash[23528]: audit 2024-09-21T01:52:45.873886+0000 mon.a (mon.0) 7900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:46 smithi049 bash[23528]: audit 2024-09-21T01:52:45.882421+0000 mon.a (mon.0) 7901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:46 smithi049 bash[23528]: audit 2024-09-21T01:52:45.894249+0000 mon.a (mon.0) 7902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:47.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:47 smithi044 bash[22676]: audit 2024-09-21T01:52:46.618002+0000 mgr.a (mgr.14388) 9447 : audit [DBG] from='client.209814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:47 smithi179 bash[23186]: audit 2024-09-21T01:52:46.618002+0000 mgr.a (mgr.14388) 9447 : audit [DBG] from='client.209814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:47 smithi049 bash[23528]: audit 2024-09-21T01:52:46.618002+0000 mgr.a (mgr.14388) 9447 : audit [DBG] from='client.209814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:48.936 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:48 smithi044 bash[22676]: cluster 2024-09-21T01:52:47.655615+0000 mgr.a (mgr.14388) 9448 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:48 smithi179 bash[23186]: cluster 2024-09-21T01:52:47.655615+0000 mgr.a (mgr.14388) 9448 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:48 smithi049 bash[23528]: cluster 2024-09-21T01:52:47.655615+0000 mgr.a (mgr.14388) 9448 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:50.977 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:50 smithi049 bash[23528]: cluster 2024-09-21T01:52:49.656420+0000 mgr.a (mgr.14388) 9449 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:50 smithi044 bash[22676]: cluster 2024-09-21T01:52:49.656420+0000 mgr.a (mgr.14388) 9449 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:50 smithi179 bash[23186]: cluster 2024-09-21T01:52:49.656420+0000 mgr.a (mgr.14388) 9449 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:52.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:52.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:52.832 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:52.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:52 smithi044 bash[22676]: cluster 2024-09-21T01:52:51.658719+0000 mgr.a (mgr.14388) 9450 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:52 smithi179 bash[23186]: cluster 2024-09-21T01:52:51.658719+0000 mgr.a (mgr.14388) 9450 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:52 smithi049 bash[23528]: cluster 2024-09-21T01:52:51.658719+0000 mgr.a (mgr.14388) 9450 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:53 smithi044 bash[22676]: audit 2024-09-21T01:52:52.410558+0000 mgr.a (mgr.14388) 9451 : audit [DBG] from='client.209889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:53 smithi044 bash[22676]: audit 2024-09-21T01:52:52.849959+0000 mon.a (mon.0) 7903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:53 smithi044 bash[22676]: audit 2024-09-21T01:52:52.854599+0000 mon.a (mon.0) 7904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:53 smithi044 bash[22676]: audit 2024-09-21T01:52:52.859543+0000 mon.a (mon.0) 7905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:53 smithi179 bash[23186]: audit 2024-09-21T01:52:52.410558+0000 mgr.a (mgr.14388) 9451 : audit [DBG] from='client.209889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:53 smithi179 bash[23186]: audit 2024-09-21T01:52:52.849959+0000 mon.a (mon.0) 7903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:53 smithi179 bash[23186]: audit 2024-09-21T01:52:52.854599+0000 mon.a (mon.0) 7904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:53 smithi179 bash[23186]: audit 2024-09-21T01:52:52.859543+0000 mon.a (mon.0) 7905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:53 smithi049 bash[23528]: audit 2024-09-21T01:52:52.410558+0000 mgr.a (mgr.14388) 9451 : audit [DBG] from='client.209889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:52:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:53 smithi049 bash[23528]: audit 2024-09-21T01:52:52.849959+0000 mon.a (mon.0) 7903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:53 smithi049 bash[23528]: audit 2024-09-21T01:52:52.854599+0000 mon.a (mon.0) 7904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:53 smithi049 bash[23528]: audit 2024-09-21T01:52:52.859543+0000 mon.a (mon.0) 7905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:52:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:54 smithi044 bash[22676]: cluster 2024-09-21T01:52:53.659639+0000 mgr.a (mgr.14388) 9452 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:54 smithi179 bash[23186]: cluster 2024-09-21T01:52:53.659639+0000 mgr.a (mgr.14388) 9452 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:54 smithi049 bash[23528]: cluster 2024-09-21T01:52:53.659639+0000 mgr.a (mgr.14388) 9452 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:56 smithi179 bash[23186]: cluster 2024-09-21T01:52:55.661928+0000 mgr.a (mgr.14388) 9453 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:56 smithi044 bash[22676]: cluster 2024-09-21T01:52:55.661928+0000 mgr.a (mgr.14388) 9453 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:56 smithi049 bash[23528]: cluster 2024-09-21T01:52:55.661928+0000 mgr.a (mgr.14388) 9453 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:52:57.833 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:52:57.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:52:57.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:52:58.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:52:58.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:52:58.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:52:58.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:52:58.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:52:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:58 smithi044 bash[22676]: cluster 2024-09-21T01:52:57.662704+0000 mgr.a (mgr.14388) 9454 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:58 smithi179 bash[23186]: cluster 2024-09-21T01:52:57.662704+0000 mgr.a (mgr.14388) 9454 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:52:59.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:58 smithi049 bash[23528]: cluster 2024-09-21T01:52:57.662704+0000 mgr.a (mgr.14388) 9454 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:52:59 smithi044 bash[22676]: audit 2024-09-21T01:52:58.169456+0000 mgr.a (mgr.14388) 9455 : audit [DBG] from='client.209964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:00.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:52:59 smithi179 bash[23186]: audit 2024-09-21T01:52:58.169456+0000 mgr.a (mgr.14388) 9455 : audit [DBG] from='client.209964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:52:59 smithi049 bash[23528]: audit 2024-09-21T01:52:58.169456+0000 mgr.a (mgr.14388) 9455 : audit [DBG] from='client.209964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:01.138 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:00 smithi179 bash[23186]: cluster 2024-09-21T01:52:59.663701+0000 mgr.a (mgr.14388) 9456 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:00 smithi044 bash[22676]: cluster 2024-09-21T01:52:59.663701+0000 mgr.a (mgr.14388) 9456 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:00 smithi049 bash[23528]: cluster 2024-09-21T01:52:59.663701+0000 mgr.a (mgr.14388) 9456 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:01 smithi044 bash[22676]: cluster 2024-09-21T01:53:01.666013+0000 mgr.a (mgr.14388) 9457 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:01 smithi179 bash[23186]: cluster 2024-09-21T01:53:01.666013+0000 mgr.a (mgr.14388) 9457 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:01 smithi049 bash[23528]: cluster 2024-09-21T01:53:01.666013+0000 mgr.a (mgr.14388) 9457 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:03.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:03.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:03.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:04.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:04.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:04.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:04.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:04.387 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:04 smithi044 bash[22676]: cluster 2024-09-21T01:53:03.666751+0000 mgr.a (mgr.14388) 9458 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:04 smithi179 bash[23186]: cluster 2024-09-21T01:53:03.666751+0000 mgr.a (mgr.14388) 9458 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:04 smithi049 bash[23528]: cluster 2024-09-21T01:53:03.666751+0000 mgr.a (mgr.14388) 9458 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:05 smithi044 bash[22676]: audit 2024-09-21T01:53:03.962273+0000 mgr.a (mgr.14388) 9459 : audit [DBG] from='client.210039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:05 smithi179 bash[23186]: audit 2024-09-21T01:53:03.962273+0000 mgr.a (mgr.14388) 9459 : audit [DBG] from='client.210039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:05 smithi049 bash[23528]: audit 2024-09-21T01:53:03.962273+0000 mgr.a (mgr.14388) 9459 : audit [DBG] from='client.210039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:06 smithi044 bash[22676]: cluster 2024-09-21T01:53:05.669101+0000 mgr.a (mgr.14388) 9460 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:06 smithi044 bash[22676]: audit 2024-09-21T01:53:05.892725+0000 mon.a (mon.0) 7906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:06 smithi044 bash[22676]: audit 2024-09-21T01:53:05.901450+0000 mon.a (mon.0) 7907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:06 smithi044 bash[22676]: audit 2024-09-21T01:53:05.910565+0000 mon.a (mon.0) 7908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:06 smithi044 bash[22676]: audit 2024-09-21T01:53:06.056269+0000 mon.a (mon.0) 7909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:06 smithi044 bash[22676]: audit 2024-09-21T01:53:06.061051+0000 mon.a (mon.0) 7910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:06 smithi044 bash[22676]: audit 2024-09-21T01:53:06.066522+0000 mon.a (mon.0) 7911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:06 smithi179 bash[23186]: cluster 2024-09-21T01:53:05.669101+0000 mgr.a (mgr.14388) 9460 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:06 smithi179 bash[23186]: audit 2024-09-21T01:53:05.892725+0000 mon.a (mon.0) 7906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:06 smithi179 bash[23186]: audit 2024-09-21T01:53:05.901450+0000 mon.a (mon.0) 7907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:06 smithi179 bash[23186]: audit 2024-09-21T01:53:05.910565+0000 mon.a (mon.0) 7908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:06 smithi179 bash[23186]: audit 2024-09-21T01:53:06.056269+0000 mon.a (mon.0) 7909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:06 smithi179 bash[23186]: audit 2024-09-21T01:53:06.061051+0000 mon.a (mon.0) 7910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:06 smithi179 bash[23186]: audit 2024-09-21T01:53:06.066522+0000 mon.a (mon.0) 7911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:06 smithi049 bash[23528]: cluster 2024-09-21T01:53:05.669101+0000 mgr.a (mgr.14388) 9460 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:06 smithi049 bash[23528]: audit 2024-09-21T01:53:05.892725+0000 mon.a (mon.0) 7906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:06 smithi049 bash[23528]: audit 2024-09-21T01:53:05.901450+0000 mon.a (mon.0) 7907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:06 smithi049 bash[23528]: audit 2024-09-21T01:53:05.910565+0000 mon.a (mon.0) 7908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:06 smithi049 bash[23528]: audit 2024-09-21T01:53:06.056269+0000 mon.a (mon.0) 7909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:06 smithi049 bash[23528]: audit 2024-09-21T01:53:06.061051+0000 mon.a (mon.0) 7910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:06 smithi049 bash[23528]: audit 2024-09-21T01:53:06.066522+0000 mon.a (mon.0) 7911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:08.993 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:08 smithi044 bash[22676]: cluster 2024-09-21T01:53:07.670003+0000 mgr.a (mgr.14388) 9461 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:09.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:08 smithi179 bash[23186]: cluster 2024-09-21T01:53:07.670003+0000 mgr.a (mgr.14388) 9461 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:08 smithi049 bash[23528]: cluster 2024-09-21T01:53:07.670003+0000 mgr.a (mgr.14388) 9461 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:09.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:09.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:09.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:10.184 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:10.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:10.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:10.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:10.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:10 smithi179 bash[23186]: cluster 2024-09-21T01:53:09.670765+0000 mgr.a (mgr.14388) 9462 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:10 smithi179 bash[23186]: audit 2024-09-21T01:53:09.720296+0000 mgr.a (mgr.14388) 9463 : audit [DBG] from='client.210111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:10 smithi049 bash[23528]: cluster 2024-09-21T01:53:09.670765+0000 mgr.a (mgr.14388) 9462 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:10 smithi049 bash[23528]: audit 2024-09-21T01:53:09.720296+0000 mgr.a (mgr.14388) 9463 : audit [DBG] from='client.210111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:10 smithi044 bash[22676]: cluster 2024-09-21T01:53:09.670765+0000 mgr.a (mgr.14388) 9462 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:10 smithi044 bash[22676]: audit 2024-09-21T01:53:09.720296+0000 mgr.a (mgr.14388) 9463 : audit [DBG] from='client.210111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:13.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:12 smithi179 bash[23186]: cluster 2024-09-21T01:53:11.672509+0000 mgr.a (mgr.14388) 9464 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:53:13.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:12 smithi049 bash[23528]: cluster 2024-09-21T01:53:11.672509+0000 mgr.a (mgr.14388) 9464 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:53:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:12 smithi044 bash[22676]: cluster 2024-09-21T01:53:11.672509+0000 mgr.a (mgr.14388) 9464 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:53:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:14 smithi049 bash[23528]: audit 2024-09-21T01:53:13.047017+0000 mon.a (mon.0) 7912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:14 smithi049 bash[23528]: audit 2024-09-21T01:53:13.056175+0000 mon.a (mon.0) 7913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:14 smithi049 bash[23528]: audit 2024-09-21T01:53:13.067161+0000 mon.a (mon.0) 7914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:14 smithi049 bash[23528]: cluster 2024-09-21T01:53:13.673278+0000 mgr.a (mgr.14388) 9465 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:53:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:14 smithi044 bash[22676]: audit 2024-09-21T01:53:13.047017+0000 mon.a (mon.0) 7912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:14 smithi044 bash[22676]: audit 2024-09-21T01:53:13.056175+0000 mon.a (mon.0) 7913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:14 smithi044 bash[22676]: audit 2024-09-21T01:53:13.067161+0000 mon.a (mon.0) 7914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:14 smithi044 bash[22676]: cluster 2024-09-21T01:53:13.673278+0000 mgr.a (mgr.14388) 9465 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:53:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:14 smithi179 bash[23186]: audit 2024-09-21T01:53:13.047017+0000 mon.a (mon.0) 7912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:14 smithi179 bash[23186]: audit 2024-09-21T01:53:13.056175+0000 mon.a (mon.0) 7913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:14 smithi179 bash[23186]: audit 2024-09-21T01:53:13.067161+0000 mon.a (mon.0) 7914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:14 smithi179 bash[23186]: cluster 2024-09-21T01:53:13.673278+0000 mgr.a (mgr.14388) 9465 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:53:15.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:15.187 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:15.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:15.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:15.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:15.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:16 smithi044 bash[22676]: audit 2024-09-21T01:53:15.518996+0000 mgr.a (mgr.14388) 9466 : audit [DBG] from='client.210189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:16 smithi044 bash[22676]: cluster 2024-09-21T01:53:15.674581+0000 mgr.a (mgr.14388) 9467 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:16 smithi179 bash[23186]: audit 2024-09-21T01:53:15.518996+0000 mgr.a (mgr.14388) 9466 : audit [DBG] from='client.210189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:16 smithi179 bash[23186]: cluster 2024-09-21T01:53:15.674581+0000 mgr.a (mgr.14388) 9467 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:17.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:16 smithi049 bash[23528]: audit 2024-09-21T01:53:15.518996+0000 mgr.a (mgr.14388) 9466 : audit [DBG] from='client.210189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:16 smithi049 bash[23528]: cluster 2024-09-21T01:53:15.674581+0000 mgr.a (mgr.14388) 9467 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:18 smithi044 bash[22676]: cluster 2024-09-21T01:53:17.675631+0000 mgr.a (mgr.14388) 9468 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:53:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:18 smithi179 bash[23186]: cluster 2024-09-21T01:53:17.675631+0000 mgr.a (mgr.14388) 9468 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:53:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:18 smithi049 bash[23528]: cluster 2024-09-21T01:53:17.675631+0000 mgr.a (mgr.14388) 9468 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:53:20.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:20.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:20.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:20 smithi179 bash[23186]: cluster 2024-09-21T01:53:19.676618+0000 mgr.a (mgr.14388) 9469 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:53:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:20 smithi049 bash[23528]: cluster 2024-09-21T01:53:19.676618+0000 mgr.a (mgr.14388) 9469 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:53:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:20 smithi044 bash[22676]: cluster 2024-09-21T01:53:19.676618+0000 mgr.a (mgr.14388) 9469 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:53:21.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:21.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:21.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:21.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:21.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:22 smithi179 bash[23186]: audit 2024-09-21T01:53:21.285561+0000 mgr.a (mgr.14388) 9470 : audit [DBG] from='client.210264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:22 smithi179 bash[23186]: cluster 2024-09-21T01:53:21.677850+0000 mgr.a (mgr.14388) 9471 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:22 smithi049 bash[23528]: audit 2024-09-21T01:53:21.285561+0000 mgr.a (mgr.14388) 9470 : audit [DBG] from='client.210264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:22 smithi049 bash[23528]: cluster 2024-09-21T01:53:21.677850+0000 mgr.a (mgr.14388) 9471 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:22 smithi044 bash[22676]: audit 2024-09-21T01:53:21.285561+0000 mgr.a (mgr.14388) 9470 : audit [DBG] from='client.210264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:22 smithi044 bash[22676]: cluster 2024-09-21T01:53:21.677850+0000 mgr.a (mgr.14388) 9471 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:23 smithi179 bash[23186]: audit 2024-09-21T01:53:23.638208+0000 mon.a (mon.0) 7915 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:53:24.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:23 smithi049 bash[23528]: audit 2024-09-21T01:53:23.638208+0000 mon.a (mon.0) 7915 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:53:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:23 smithi044 bash[22676]: audit 2024-09-21T01:53:23.638208+0000 mon.a (mon.0) 7915 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:53:25.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: cluster 2024-09-21T01:53:23.678585+0000 mgr.a (mgr.14388) 9472 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.244716+0000 mon.a (mon.0) 7916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.250484+0000 mon.a (mon.0) 7917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.256051+0000 mon.a (mon.0) 7918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.260450+0000 mon.a (mon.0) 7919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.261469+0000 mon.a (mon.0) 7920 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.262229+0000 mon.a (mon.0) 7921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.268379+0000 mon.a (mon.0) 7922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:24 smithi044 bash[22676]: audit 2024-09-21T01:53:24.271006+0000 mon.a (mon.0) 7923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: cluster 2024-09-21T01:53:23.678585+0000 mgr.a (mgr.14388) 9472 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.244716+0000 mon.a (mon.0) 7916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.250484+0000 mon.a (mon.0) 7917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.256051+0000 mon.a (mon.0) 7918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.260450+0000 mon.a (mon.0) 7919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.261469+0000 mon.a (mon.0) 7920 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.262229+0000 mon.a (mon.0) 7921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.268379+0000 mon.a (mon.0) 7922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:24 smithi049 bash[23528]: audit 2024-09-21T01:53:24.271006+0000 mon.a (mon.0) 7923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: cluster 2024-09-21T01:53:23.678585+0000 mgr.a (mgr.14388) 9472 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.244716+0000 mon.a (mon.0) 7916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.250484+0000 mon.a (mon.0) 7917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.256051+0000 mon.a (mon.0) 7918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.260450+0000 mon.a (mon.0) 7919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.261469+0000 mon.a (mon.0) 7920 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.262229+0000 mon.a (mon.0) 7921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.268379+0000 mon.a (mon.0) 7922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:24 smithi179 bash[23186]: audit 2024-09-21T01:53:24.271006+0000 mon.a (mon.0) 7923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:53:25.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:53:25 smithi044 bash[22930]: debug 2024-09-21T01:53:25.012+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:53:25.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:53:25 smithi044 bash[22930]: debug 2024-09-21T01:53:25.016+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:53:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:25 smithi049 bash[23528]: audit 2024-09-21T01:53:24.273183+0000 mgr.a (mgr.14388) 9473 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:53:26.124 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:25 smithi179 bash[23186]: audit 2024-09-21T01:53:24.273183+0000 mgr.a (mgr.14388) 9473 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:53:26.235 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:25 smithi044 bash[22676]: audit 2024-09-21T01:53:24.273183+0000 mgr.a (mgr.14388) 9473 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:53:26.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:26.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:26.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: audit 2024-09-21T01:53:25.016712+0000 mgr.a (mgr.14388) 9474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:53:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: cephadm 2024-09-21T01:53:25.017945+0000 mgr.a (mgr.14388) 9475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:53:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: cluster 2024-09-21T01:53:25.680967+0000 mgr.a (mgr.14388) 9476 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: audit 2024-09-21T01:53:26.106473+0000 mon.a (mon.0) 7924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: audit 2024-09-21T01:53:26.114223+0000 mon.a (mon.0) 7925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: audit 2024-09-21T01:53:26.122701+0000 mon.a (mon.0) 7926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: audit 2024-09-21T01:53:26.235796+0000 mon.a (mon.0) 7927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: audit 2024-09-21T01:53:26.240794+0000 mon.a (mon.0) 7928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:26 smithi049 bash[23528]: audit 2024-09-21T01:53:26.246743+0000 mon.a (mon.0) 7929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: audit 2024-09-21T01:53:25.016712+0000 mgr.a (mgr.14388) 9474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:53:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: cephadm 2024-09-21T01:53:25.017945+0000 mgr.a (mgr.14388) 9475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:53:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: cluster 2024-09-21T01:53:25.680967+0000 mgr.a (mgr.14388) 9476 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: audit 2024-09-21T01:53:26.106473+0000 mon.a (mon.0) 7924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: audit 2024-09-21T01:53:26.114223+0000 mon.a (mon.0) 7925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: audit 2024-09-21T01:53:26.122701+0000 mon.a (mon.0) 7926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: audit 2024-09-21T01:53:26.235796+0000 mon.a (mon.0) 7927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: audit 2024-09-21T01:53:26.240794+0000 mon.a (mon.0) 7928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:26 smithi044 bash[22676]: audit 2024-09-21T01:53:26.246743+0000 mon.a (mon.0) 7929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: audit 2024-09-21T01:53:25.016712+0000 mgr.a (mgr.14388) 9474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: cephadm 2024-09-21T01:53:25.017945+0000 mgr.a (mgr.14388) 9475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: cluster 2024-09-21T01:53:25.680967+0000 mgr.a (mgr.14388) 9476 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: audit 2024-09-21T01:53:26.106473+0000 mon.a (mon.0) 7924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: audit 2024-09-21T01:53:26.114223+0000 mon.a (mon.0) 7925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: audit 2024-09-21T01:53:26.122701+0000 mon.a (mon.0) 7926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: audit 2024-09-21T01:53:26.235796+0000 mon.a (mon.0) 7927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: audit 2024-09-21T01:53:26.240794+0000 mon.a (mon.0) 7928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:26 smithi179 bash[23186]: audit 2024-09-21T01:53:26.246743+0000 mon.a (mon.0) 7929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:27.504 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:28 smithi049 bash[23528]: audit 2024-09-21T01:53:27.044715+0000 mgr.a (mgr.14388) 9477 : audit [DBG] from='client.210447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:28 smithi049 bash[23528]: cluster 2024-09-21T01:53:27.681981+0000 mgr.a (mgr.14388) 9478 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:28 smithi044 bash[22676]: audit 2024-09-21T01:53:27.044715+0000 mgr.a (mgr.14388) 9477 : audit [DBG] from='client.210447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:28 smithi044 bash[22676]: cluster 2024-09-21T01:53:27.681981+0000 mgr.a (mgr.14388) 9478 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:28 smithi179 bash[23186]: audit 2024-09-21T01:53:27.044715+0000 mgr.a (mgr.14388) 9477 : audit [DBG] from='client.210447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:28 smithi179 bash[23186]: cluster 2024-09-21T01:53:27.681981+0000 mgr.a (mgr.14388) 9478 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:30 smithi044 bash[22676]: cluster 2024-09-21T01:53:29.682788+0000 mgr.a (mgr.14388) 9479 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:30 smithi049 bash[23528]: cluster 2024-09-21T01:53:29.682788+0000 mgr.a (mgr.14388) 9479 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:30 smithi179 bash[23186]: cluster 2024-09-21T01:53:29.682788+0000 mgr.a (mgr.14388) 9479 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:32.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:32.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:32.506 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:33.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:32 smithi049 bash[23528]: cluster 2024-09-21T01:53:31.684221+0000 mgr.a (mgr.14388) 9480 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:32 smithi044 bash[22676]: cluster 2024-09-21T01:53:31.684221+0000 mgr.a (mgr.14388) 9480 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:32 smithi179 bash[23186]: cluster 2024-09-21T01:53:31.684221+0000 mgr.a (mgr.14388) 9480 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:33.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:33 smithi049 bash[23528]: audit 2024-09-21T01:53:32.847803+0000 mgr.a (mgr.14388) 9481 : audit [DBG] from='client.210516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:33 smithi049 bash[23528]: audit 2024-09-21T01:53:33.257321+0000 mon.a (mon.0) 7930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:33 smithi049 bash[23528]: audit 2024-09-21T01:53:33.262764+0000 mon.a (mon.0) 7931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:33 smithi049 bash[23528]: audit 2024-09-21T01:53:33.269240+0000 mon.a (mon.0) 7932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:33 smithi044 bash[22676]: audit 2024-09-21T01:53:32.847803+0000 mgr.a (mgr.14388) 9481 : audit [DBG] from='client.210516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:33 smithi044 bash[22676]: audit 2024-09-21T01:53:33.257321+0000 mon.a (mon.0) 7930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:33 smithi044 bash[22676]: audit 2024-09-21T01:53:33.262764+0000 mon.a (mon.0) 7931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:33 smithi044 bash[22676]: audit 2024-09-21T01:53:33.269240+0000 mon.a (mon.0) 7932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:33 smithi179 bash[23186]: audit 2024-09-21T01:53:32.847803+0000 mgr.a (mgr.14388) 9481 : audit [DBG] from='client.210516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:33 smithi179 bash[23186]: audit 2024-09-21T01:53:33.257321+0000 mon.a (mon.0) 7930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:33 smithi179 bash[23186]: audit 2024-09-21T01:53:33.262764+0000 mon.a (mon.0) 7931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:33 smithi179 bash[23186]: audit 2024-09-21T01:53:33.269240+0000 mon.a (mon.0) 7932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:34 smithi049 bash[23528]: cluster 2024-09-21T01:53:33.685334+0000 mgr.a (mgr.14388) 9482 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:34 smithi044 bash[22676]: cluster 2024-09-21T01:53:33.685334+0000 mgr.a (mgr.14388) 9482 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:34 smithi179 bash[23186]: cluster 2024-09-21T01:53:33.685334+0000 mgr.a (mgr.14388) 9482 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:36 smithi049 bash[23528]: cluster 2024-09-21T01:53:35.687500+0000 mgr.a (mgr.14388) 9483 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:36 smithi044 bash[22676]: cluster 2024-09-21T01:53:35.687500+0000 mgr.a (mgr.14388) 9483 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:36 smithi179 bash[23186]: cluster 2024-09-21T01:53:35.687500+0000 mgr.a (mgr.14388) 9483 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:53:38.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:38.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:38.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:38 smithi049 bash[23528]: cluster 2024-09-21T01:53:37.688297+0000 mgr.a (mgr.14388) 9484 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:39.084 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:38 smithi044 bash[22676]: cluster 2024-09-21T01:53:37.688297+0000 mgr.a (mgr.14388) 9484 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:39.103 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:38 smithi179 bash[23186]: cluster 2024-09-21T01:53:37.688297+0000 mgr.a (mgr.14388) 9484 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:39 smithi049 bash[23528]: audit 2024-09-21T01:53:38.648915+0000 mgr.a (mgr.14388) 9485 : audit [DBG] from='client.210594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:39 smithi044 bash[22676]: audit 2024-09-21T01:53:38.648915+0000 mgr.a (mgr.14388) 9485 : audit [DBG] from='client.210594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:39 smithi179 bash[23186]: audit 2024-09-21T01:53:38.648915+0000 mgr.a (mgr.14388) 9485 : audit [DBG] from='client.210594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:40 smithi179 bash[23186]: cluster 2024-09-21T01:53:39.689338+0000 mgr.a (mgr.14388) 9486 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:40 smithi044 bash[22676]: cluster 2024-09-21T01:53:39.689338+0000 mgr.a (mgr.14388) 9486 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:40 smithi049 bash[23528]: cluster 2024-09-21T01:53:39.689338+0000 mgr.a (mgr.14388) 9486 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:42 smithi044 bash[22676]: cluster 2024-09-21T01:53:41.691600+0000 mgr.a (mgr.14388) 9487 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:42 smithi179 bash[23186]: cluster 2024-09-21T01:53:41.691600+0000 mgr.a (mgr.14388) 9487 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:42 smithi049 bash[23528]: cluster 2024-09-21T01:53:41.691600+0000 mgr.a (mgr.14388) 9487 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:44.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:44.105 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:44.105 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:44.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:44.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:44.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:44.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:44 smithi044 bash[22676]: cluster 2024-09-21T01:53:43.692374+0000 mgr.a (mgr.14388) 9488 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:44 smithi179 bash[23186]: cluster 2024-09-21T01:53:43.692374+0000 mgr.a (mgr.14388) 9488 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:44 smithi049 bash[23528]: cluster 2024-09-21T01:53:43.692374+0000 mgr.a (mgr.14388) 9488 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:45 smithi044 bash[22676]: audit 2024-09-21T01:53:44.434690+0000 mgr.a (mgr.14388) 9489 : audit [DBG] from='client.210672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:45 smithi179 bash[23186]: audit 2024-09-21T01:53:44.434690+0000 mgr.a (mgr.14388) 9489 : audit [DBG] from='client.210672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:45 smithi049 bash[23528]: audit 2024-09-21T01:53:44.434690+0000 mgr.a (mgr.14388) 9489 : audit [DBG] from='client.210672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:46 smithi044 bash[22676]: cluster 2024-09-21T01:53:45.694767+0000 mgr.a (mgr.14388) 9490 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:46 smithi044 bash[22676]: audit 2024-09-21T01:53:46.353504+0000 mon.a (mon.0) 7933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:46 smithi044 bash[22676]: audit 2024-09-21T01:53:46.363360+0000 mon.a (mon.0) 7934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:46 smithi044 bash[22676]: audit 2024-09-21T01:53:46.375708+0000 mon.a (mon.0) 7935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:46 smithi044 bash[22676]: audit 2024-09-21T01:53:46.468318+0000 mon.a (mon.0) 7936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:46 smithi044 bash[22676]: audit 2024-09-21T01:53:46.476035+0000 mon.a (mon.0) 7937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:46 smithi044 bash[22676]: audit 2024-09-21T01:53:46.486424+0000 mon.a (mon.0) 7938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:46 smithi179 bash[23186]: cluster 2024-09-21T01:53:45.694767+0000 mgr.a (mgr.14388) 9490 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:46 smithi179 bash[23186]: audit 2024-09-21T01:53:46.353504+0000 mon.a (mon.0) 7933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:46 smithi179 bash[23186]: audit 2024-09-21T01:53:46.363360+0000 mon.a (mon.0) 7934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:46 smithi179 bash[23186]: audit 2024-09-21T01:53:46.375708+0000 mon.a (mon.0) 7935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:46 smithi179 bash[23186]: audit 2024-09-21T01:53:46.468318+0000 mon.a (mon.0) 7936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:46 smithi179 bash[23186]: audit 2024-09-21T01:53:46.476035+0000 mon.a (mon.0) 7937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:46 smithi179 bash[23186]: audit 2024-09-21T01:53:46.486424+0000 mon.a (mon.0) 7938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:46 smithi049 bash[23528]: cluster 2024-09-21T01:53:45.694767+0000 mgr.a (mgr.14388) 9490 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:53:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:46 smithi049 bash[23528]: audit 2024-09-21T01:53:46.353504+0000 mon.a (mon.0) 7933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:46 smithi049 bash[23528]: audit 2024-09-21T01:53:46.363360+0000 mon.a (mon.0) 7934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:46 smithi049 bash[23528]: audit 2024-09-21T01:53:46.375708+0000 mon.a (mon.0) 7935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:46 smithi049 bash[23528]: audit 2024-09-21T01:53:46.468318+0000 mon.a (mon.0) 7936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:46 smithi049 bash[23528]: audit 2024-09-21T01:53:46.476035+0000 mon.a (mon.0) 7937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:46 smithi049 bash[23528]: audit 2024-09-21T01:53:46.486424+0000 mon.a (mon.0) 7938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:48 smithi044 bash[22676]: cluster 2024-09-21T01:53:47.695560+0000 mgr.a (mgr.14388) 9491 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:48 smithi179 bash[23186]: cluster 2024-09-21T01:53:47.695560+0000 mgr.a (mgr.14388) 9491 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:48 smithi049 bash[23528]: cluster 2024-09-21T01:53:47.695560+0000 mgr.a (mgr.14388) 9491 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:49.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:49.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:49.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:50.628 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:50.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:50.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:50 smithi044 bash[22676]: cluster 2024-09-21T01:53:49.696318+0000 mgr.a (mgr.14388) 9492 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:50 smithi179 bash[23186]: cluster 2024-09-21T01:53:49.696318+0000 mgr.a (mgr.14388) 9492 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:50 smithi049 bash[23528]: cluster 2024-09-21T01:53:49.696318+0000 mgr.a (mgr.14388) 9492 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:52.127 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:51 smithi049 bash[23528]: audit 2024-09-21T01:53:50.193541+0000 mgr.a (mgr.14388) 9493 : audit [DBG] from='client.210750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:51 smithi044 bash[22676]: audit 2024-09-21T01:53:50.193541+0000 mgr.a (mgr.14388) 9493 : audit [DBG] from='client.210750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:51 smithi179 bash[23186]: audit 2024-09-21T01:53:50.193541+0000 mgr.a (mgr.14388) 9493 : audit [DBG] from='client.210750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:52 smithi044 bash[22676]: cluster 2024-09-21T01:53:51.699387+0000 mgr.a (mgr.14388) 9494 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:52 smithi179 bash[23186]: cluster 2024-09-21T01:53:51.699387+0000 mgr.a (mgr.14388) 9494 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:53.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:52 smithi049 bash[23528]: cluster 2024-09-21T01:53:51.699387+0000 mgr.a (mgr.14388) 9494 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:54 smithi044 bash[22676]: audit 2024-09-21T01:53:53.465521+0000 mon.a (mon.0) 7939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:54 smithi044 bash[22676]: audit 2024-09-21T01:53:53.475189+0000 mon.a (mon.0) 7940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:54 smithi044 bash[22676]: audit 2024-09-21T01:53:53.485729+0000 mon.a (mon.0) 7941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:54 smithi044 bash[22676]: cluster 2024-09-21T01:53:53.700117+0000 mgr.a (mgr.14388) 9495 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:53:54.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:54 smithi049 bash[23528]: audit 2024-09-21T01:53:53.465521+0000 mon.a (mon.0) 7939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:54 smithi049 bash[23528]: audit 2024-09-21T01:53:53.475189+0000 mon.a (mon.0) 7940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:54 smithi049 bash[23528]: audit 2024-09-21T01:53:53.485729+0000 mon.a (mon.0) 7941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.740 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:54 smithi049 bash[23528]: cluster 2024-09-21T01:53:53.700117+0000 mgr.a (mgr.14388) 9495 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:53:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:54 smithi179 bash[23186]: audit 2024-09-21T01:53:53.465521+0000 mon.a (mon.0) 7939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:54 smithi179 bash[23186]: audit 2024-09-21T01:53:53.475189+0000 mon.a (mon.0) 7940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:54 smithi179 bash[23186]: audit 2024-09-21T01:53:53.485729+0000 mon.a (mon.0) 7941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:53:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:54 smithi179 bash[23186]: cluster 2024-09-21T01:53:53.700117+0000 mgr.a (mgr.14388) 9495 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:53:55.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:53:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:53:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:53:56.418 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:53:56.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:53:56.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:53:56.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:53:56.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:53:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:56 smithi049 bash[23528]: cluster 2024-09-21T01:53:55.702100+0000 mgr.a (mgr.14388) 9496 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:56 smithi044 bash[22676]: cluster 2024-09-21T01:53:55.702100+0000 mgr.a (mgr.14388) 9496 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:56 smithi179 bash[23186]: cluster 2024-09-21T01:53:55.702100+0000 mgr.a (mgr.14388) 9496 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:53:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:57 smithi049 bash[23528]: audit 2024-09-21T01:53:55.970309+0000 mgr.a (mgr.14388) 9497 : audit [DBG] from='client.210828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:57 smithi044 bash[22676]: audit 2024-09-21T01:53:55.970309+0000 mgr.a (mgr.14388) 9497 : audit [DBG] from='client.210828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:57 smithi179 bash[23186]: audit 2024-09-21T01:53:55.970309+0000 mgr.a (mgr.14388) 9497 : audit [DBG] from='client.210828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:53:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:53:58 smithi049 bash[23528]: cluster 2024-09-21T01:53:57.703037+0000 mgr.a (mgr.14388) 9498 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:53:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:53:58 smithi044 bash[22676]: cluster 2024-09-21T01:53:57.703037+0000 mgr.a (mgr.14388) 9498 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:53:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:53:58 smithi179 bash[23186]: cluster 2024-09-21T01:53:57.703037+0000 mgr.a (mgr.14388) 9498 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:54:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:00 smithi049 bash[23528]: cluster 2024-09-21T01:53:59.703538+0000 mgr.a (mgr.14388) 9499 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:54:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:00 smithi044 bash[22676]: cluster 2024-09-21T01:53:59.703538+0000 mgr.a (mgr.14388) 9499 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:54:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:00 smithi179 bash[23186]: cluster 2024-09-21T01:53:59.703538+0000 mgr.a (mgr.14388) 9499 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:54:01.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:01.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:01.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:02.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:02.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:02.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:02.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:02.203 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:02 smithi179 bash[23186]: cluster 2024-09-21T01:54:01.704841+0000 mgr.a (mgr.14388) 9500 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:02 smithi179 bash[23186]: audit 2024-09-21T01:54:01.758618+0000 mgr.a (mgr.14388) 9501 : audit [DBG] from='client.210906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:03.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:02 smithi049 bash[23528]: cluster 2024-09-21T01:54:01.704841+0000 mgr.a (mgr.14388) 9500 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:02 smithi049 bash[23528]: audit 2024-09-21T01:54:01.758618+0000 mgr.a (mgr.14388) 9501 : audit [DBG] from='client.210906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:02 smithi044 bash[22676]: cluster 2024-09-21T01:54:01.704841+0000 mgr.a (mgr.14388) 9500 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:02 smithi044 bash[22676]: audit 2024-09-21T01:54:01.758618+0000 mgr.a (mgr.14388) 9501 : audit [DBG] from='client.210906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:04 smithi049 bash[23528]: cluster 2024-09-21T01:54:03.705711+0000 mgr.a (mgr.14388) 9502 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:04 smithi044 bash[22676]: cluster 2024-09-21T01:54:03.705711+0000 mgr.a (mgr.14388) 9502 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:04 smithi179 bash[23186]: cluster 2024-09-21T01:54:03.705711+0000 mgr.a (mgr.14388) 9502 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:06 smithi044 bash[22676]: cluster 2024-09-21T01:54:05.707828+0000 mgr.a (mgr.14388) 9503 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:06 smithi044 bash[22676]: audit 2024-09-21T01:54:06.588883+0000 mon.a (mon.0) 7942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:06 smithi044 bash[22676]: audit 2024-09-21T01:54:06.597787+0000 mon.a (mon.0) 7943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:06 smithi044 bash[22676]: audit 2024-09-21T01:54:06.608987+0000 mon.a (mon.0) 7944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:06 smithi044 bash[22676]: audit 2024-09-21T01:54:06.694308+0000 mon.a (mon.0) 7945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:06 smithi044 bash[22676]: audit 2024-09-21T01:54:06.701839+0000 mon.a (mon.0) 7946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:06 smithi044 bash[22676]: audit 2024-09-21T01:54:06.712133+0000 mon.a (mon.0) 7947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:06 smithi179 bash[23186]: cluster 2024-09-21T01:54:05.707828+0000 mgr.a (mgr.14388) 9503 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:07.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:06 smithi179 bash[23186]: audit 2024-09-21T01:54:06.588883+0000 mon.a (mon.0) 7942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:06 smithi179 bash[23186]: audit 2024-09-21T01:54:06.597787+0000 mon.a (mon.0) 7943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:06 smithi179 bash[23186]: audit 2024-09-21T01:54:06.608987+0000 mon.a (mon.0) 7944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:06 smithi179 bash[23186]: audit 2024-09-21T01:54:06.694308+0000 mon.a (mon.0) 7945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:06 smithi179 bash[23186]: audit 2024-09-21T01:54:06.701839+0000 mon.a (mon.0) 7946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:06 smithi179 bash[23186]: audit 2024-09-21T01:54:06.712133+0000 mon.a (mon.0) 7947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:06 smithi049 bash[23528]: cluster 2024-09-21T01:54:05.707828+0000 mgr.a (mgr.14388) 9503 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:06 smithi049 bash[23528]: audit 2024-09-21T01:54:06.588883+0000 mon.a (mon.0) 7942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:06 smithi049 bash[23528]: audit 2024-09-21T01:54:06.597787+0000 mon.a (mon.0) 7943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:06 smithi049 bash[23528]: audit 2024-09-21T01:54:06.608987+0000 mon.a (mon.0) 7944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:06 smithi049 bash[23528]: audit 2024-09-21T01:54:06.694308+0000 mon.a (mon.0) 7945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:06 smithi049 bash[23528]: audit 2024-09-21T01:54:06.701839+0000 mon.a (mon.0) 7946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:06 smithi049 bash[23528]: audit 2024-09-21T01:54:06.712133+0000 mon.a (mon.0) 7947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:07.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:07.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:07.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:07.999 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:07.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:07.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:07.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:07.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:08 smithi049 bash[23528]: audit 2024-09-21T01:54:07.542928+0000 mgr.a (mgr.14388) 9504 : audit [DBG] from='client.210984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:08 smithi049 bash[23528]: cluster 2024-09-21T01:54:07.708436+0000 mgr.a (mgr.14388) 9505 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:08 smithi044 bash[22676]: audit 2024-09-21T01:54:07.542928+0000 mgr.a (mgr.14388) 9504 : audit [DBG] from='client.210984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:08 smithi044 bash[22676]: cluster 2024-09-21T01:54:07.708436+0000 mgr.a (mgr.14388) 9505 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:08 smithi179 bash[23186]: audit 2024-09-21T01:54:07.542928+0000 mgr.a (mgr.14388) 9504 : audit [DBG] from='client.210984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:08 smithi179 bash[23186]: cluster 2024-09-21T01:54:07.708436+0000 mgr.a (mgr.14388) 9505 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:10 smithi049 bash[23528]: cluster 2024-09-21T01:54:09.709357+0000 mgr.a (mgr.14388) 9506 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:11.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:10 smithi044 bash[22676]: cluster 2024-09-21T01:54:09.709357+0000 mgr.a (mgr.14388) 9506 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:10 smithi179 bash[23186]: cluster 2024-09-21T01:54:09.709357+0000 mgr.a (mgr.14388) 9506 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:13.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:13.001 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:13.001 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:12 smithi049 bash[23528]: cluster 2024-09-21T01:54:11.711607+0000 mgr.a (mgr.14388) 9507 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:12 smithi044 bash[22676]: cluster 2024-09-21T01:54:11.711607+0000 mgr.a (mgr.14388) 9507 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:12 smithi179 bash[23186]: cluster 2024-09-21T01:54:11.711607+0000 mgr.a (mgr.14388) 9507 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:13.765 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:13.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:14 smithi044 bash[22676]: audit 2024-09-21T01:54:13.336934+0000 mgr.a (mgr.14388) 9508 : audit [DBG] from='client.211059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:14 smithi044 bash[22676]: audit 2024-09-21T01:54:13.682653+0000 mon.a (mon.0) 7948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:14 smithi044 bash[22676]: audit 2024-09-21T01:54:13.688757+0000 mon.a (mon.0) 7949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:14 smithi044 bash[22676]: audit 2024-09-21T01:54:13.695367+0000 mon.a (mon.0) 7950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:14 smithi044 bash[22676]: cluster 2024-09-21T01:54:13.712090+0000 mgr.a (mgr.14388) 9509 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:14 smithi179 bash[23186]: audit 2024-09-21T01:54:13.336934+0000 mgr.a (mgr.14388) 9508 : audit [DBG] from='client.211059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:14 smithi179 bash[23186]: audit 2024-09-21T01:54:13.682653+0000 mon.a (mon.0) 7948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:14 smithi179 bash[23186]: audit 2024-09-21T01:54:13.688757+0000 mon.a (mon.0) 7949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:14 smithi179 bash[23186]: audit 2024-09-21T01:54:13.695367+0000 mon.a (mon.0) 7950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:14 smithi179 bash[23186]: cluster 2024-09-21T01:54:13.712090+0000 mgr.a (mgr.14388) 9509 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:14 smithi049 bash[23528]: audit 2024-09-21T01:54:13.336934+0000 mgr.a (mgr.14388) 9508 : audit [DBG] from='client.211059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:14 smithi049 bash[23528]: audit 2024-09-21T01:54:13.682653+0000 mon.a (mon.0) 7948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:14 smithi049 bash[23528]: audit 2024-09-21T01:54:13.688757+0000 mon.a (mon.0) 7949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:14 smithi049 bash[23528]: audit 2024-09-21T01:54:13.695367+0000 mon.a (mon.0) 7950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:14 smithi049 bash[23528]: cluster 2024-09-21T01:54:13.712090+0000 mgr.a (mgr.14388) 9509 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:16 smithi049 bash[23528]: cluster 2024-09-21T01:54:15.714230+0000 mgr.a (mgr.14388) 9510 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:16 smithi044 bash[22676]: cluster 2024-09-21T01:54:15.714230+0000 mgr.a (mgr.14388) 9510 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:16 smithi179 bash[23186]: cluster 2024-09-21T01:54:15.714230+0000 mgr.a (mgr.14388) 9510 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:18.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:18.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:18.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:19.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:18 smithi179 bash[23186]: cluster 2024-09-21T01:54:17.715025+0000 mgr.a (mgr.14388) 9511 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:19.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:18 smithi049 bash[23528]: cluster 2024-09-21T01:54:17.715025+0000 mgr.a (mgr.14388) 9511 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:18 smithi044 bash[22676]: cluster 2024-09-21T01:54:17.715025+0000 mgr.a (mgr.14388) 9511 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:19.540 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:20 smithi179 bash[23186]: audit 2024-09-21T01:54:19.106204+0000 mgr.a (mgr.14388) 9512 : audit [DBG] from='client.211134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:20 smithi179 bash[23186]: cluster 2024-09-21T01:54:19.715980+0000 mgr.a (mgr.14388) 9513 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:20 smithi049 bash[23528]: audit 2024-09-21T01:54:19.106204+0000 mgr.a (mgr.14388) 9512 : audit [DBG] from='client.211134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:20 smithi049 bash[23528]: cluster 2024-09-21T01:54:19.715980+0000 mgr.a (mgr.14388) 9513 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:20 smithi044 bash[22676]: audit 2024-09-21T01:54:19.106204+0000 mgr.a (mgr.14388) 9512 : audit [DBG] from='client.211134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:20 smithi044 bash[22676]: cluster 2024-09-21T01:54:19.715980+0000 mgr.a (mgr.14388) 9513 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:22 smithi179 bash[23186]: cluster 2024-09-21T01:54:21.718273+0000 mgr.a (mgr.14388) 9514 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:22 smithi049 bash[23528]: cluster 2024-09-21T01:54:21.718273+0000 mgr.a (mgr.14388) 9514 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:22 smithi044 bash[22676]: cluster 2024-09-21T01:54:21.718273+0000 mgr.a (mgr.14388) 9514 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:24.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:24.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:24.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:25.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:24 smithi049 bash[23528]: cluster 2024-09-21T01:54:23.719036+0000 mgr.a (mgr.14388) 9515 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:24 smithi044 bash[22676]: cluster 2024-09-21T01:54:23.719036+0000 mgr.a (mgr.14388) 9515 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:24 smithi179 bash[23186]: cluster 2024-09-21T01:54:23.719036+0000 mgr.a (mgr.14388) 9515 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:25.342 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:25.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:25.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:25.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:25.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:24.884615+0000 mgr.a (mgr.14388) 9516 : audit [DBG] from='client.211212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:25.068424+0000 mon.a (mon.0) 7951 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:25.609510+0000 mon.a (mon.0) 7952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:25.618490+0000 mon.a (mon.0) 7953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:25.621559+0000 mon.a (mon.0) 7954 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:25.623674+0000 mon.a (mon.0) 7955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:25.634459+0000 mon.a (mon.0) 7956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:25 smithi049 bash[23528]: audit 2024-09-21T01:54:25.640843+0000 mon.a (mon.0) 7957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:24.884615+0000 mgr.a (mgr.14388) 9516 : audit [DBG] from='client.211212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:25.068424+0000 mon.a (mon.0) 7951 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:25.609510+0000 mon.a (mon.0) 7952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:25.618490+0000 mon.a (mon.0) 7953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:25.621559+0000 mon.a (mon.0) 7954 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:25.623674+0000 mon.a (mon.0) 7955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:25.634459+0000 mon.a (mon.0) 7956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:25 smithi044 bash[22676]: audit 2024-09-21T01:54:25.640843+0000 mon.a (mon.0) 7957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:24.884615+0000 mgr.a (mgr.14388) 9516 : audit [DBG] from='client.211212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:25.068424+0000 mon.a (mon.0) 7951 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:25.609510+0000 mon.a (mon.0) 7952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:25.618490+0000 mon.a (mon.0) 7953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:25.621559+0000 mon.a (mon.0) 7954 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:25.623674+0000 mon.a (mon.0) 7955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:25.634459+0000 mon.a (mon.0) 7956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:25 smithi179 bash[23186]: audit 2024-09-21T01:54:25.640843+0000 mon.a (mon.0) 7957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:54:26.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:54:26 smithi044 bash[22930]: debug 2024-09-21T01:54:26.423+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:54:26.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:54:26 smithi044 bash[22930]: debug 2024-09-21T01:54:26.423+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:54:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:26 smithi049 bash[23528]: audit 2024-09-21T01:54:25.643739+0000 mgr.a (mgr.14388) 9517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:54:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:26 smithi049 bash[23528]: cluster 2024-09-21T01:54:25.721028+0000 mgr.a (mgr.14388) 9518 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:26 smithi044 bash[22676]: audit 2024-09-21T01:54:25.643739+0000 mgr.a (mgr.14388) 9517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:54:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:26 smithi044 bash[22676]: cluster 2024-09-21T01:54:25.721028+0000 mgr.a (mgr.14388) 9518 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:26 smithi179 bash[23186]: audit 2024-09-21T01:54:25.643739+0000 mgr.a (mgr.14388) 9517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:54:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:26 smithi179 bash[23186]: cluster 2024-09-21T01:54:25.721028+0000 mgr.a (mgr.14388) 9518 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: audit 2024-09-21T01:54:26.426178+0000 mgr.a (mgr.14388) 9519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:54:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: cephadm 2024-09-21T01:54:26.428128+0000 mgr.a (mgr.14388) 9520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:54:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: audit 2024-09-21T01:54:26.808191+0000 mon.a (mon.0) 7958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: audit 2024-09-21T01:54:26.814635+0000 mon.a (mon.0) 7959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: audit 2024-09-21T01:54:26.823200+0000 mon.a (mon.0) 7960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: audit 2024-09-21T01:54:26.936256+0000 mon.a (mon.0) 7961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: audit 2024-09-21T01:54:26.944529+0000 mon.a (mon.0) 7962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:27 smithi044 bash[22676]: audit 2024-09-21T01:54:26.954807+0000 mon.a (mon.0) 7963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: audit 2024-09-21T01:54:26.426178+0000 mgr.a (mgr.14388) 9519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: cephadm 2024-09-21T01:54:26.428128+0000 mgr.a (mgr.14388) 9520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: audit 2024-09-21T01:54:26.808191+0000 mon.a (mon.0) 7958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: audit 2024-09-21T01:54:26.814635+0000 mon.a (mon.0) 7959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: audit 2024-09-21T01:54:26.823200+0000 mon.a (mon.0) 7960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: audit 2024-09-21T01:54:26.936256+0000 mon.a (mon.0) 7961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: audit 2024-09-21T01:54:26.944529+0000 mon.a (mon.0) 7962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:27 smithi179 bash[23186]: audit 2024-09-21T01:54:26.954807+0000 mon.a (mon.0) 7963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: audit 2024-09-21T01:54:26.426178+0000 mgr.a (mgr.14388) 9519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: cephadm 2024-09-21T01:54:26.428128+0000 mgr.a (mgr.14388) 9520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: audit 2024-09-21T01:54:26.808191+0000 mon.a (mon.0) 7958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: audit 2024-09-21T01:54:26.814635+0000 mon.a (mon.0) 7959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: audit 2024-09-21T01:54:26.823200+0000 mon.a (mon.0) 7960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: audit 2024-09-21T01:54:26.936256+0000 mon.a (mon.0) 7961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: audit 2024-09-21T01:54:26.944529+0000 mon.a (mon.0) 7962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:27 smithi049 bash[23528]: audit 2024-09-21T01:54:26.954807+0000 mon.a (mon.0) 7963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:28 smithi044 bash[22676]: cluster 2024-09-21T01:54:27.721931+0000 mgr.a (mgr.14388) 9521 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:54:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:28 smithi179 bash[23186]: cluster 2024-09-21T01:54:27.721931+0000 mgr.a (mgr.14388) 9521 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:54:29.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:28 smithi049 bash[23528]: cluster 2024-09-21T01:54:27.721931+0000 mgr.a (mgr.14388) 9521 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:54:30.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:30.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:30.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:30.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:30 smithi044 bash[22676]: cluster 2024-09-21T01:54:29.722710+0000 mgr.a (mgr.14388) 9522 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:54:31.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:31.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:31.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:31.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:31.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:30 smithi179 bash[23186]: cluster 2024-09-21T01:54:29.722710+0000 mgr.a (mgr.14388) 9522 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:54:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:30 smithi049 bash[23528]: cluster 2024-09-21T01:54:29.722710+0000 mgr.a (mgr.14388) 9522 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:54:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:31 smithi044 bash[22676]: audit 2024-09-21T01:54:30.692571+0000 mgr.a (mgr.14388) 9523 : audit [DBG] from='client.211395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:31 smithi179 bash[23186]: audit 2024-09-21T01:54:30.692571+0000 mgr.a (mgr.14388) 9523 : audit [DBG] from='client.211395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:31 smithi049 bash[23528]: audit 2024-09-21T01:54:30.692571+0000 mgr.a (mgr.14388) 9523 : audit [DBG] from='client.211395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:33.073 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:32 smithi044 bash[22676]: cluster 2024-09-21T01:54:31.725597+0000 mgr.a (mgr.14388) 9524 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:33.108 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:32 smithi049 bash[23528]: cluster 2024-09-21T01:54:31.725597+0000 mgr.a (mgr.14388) 9524 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:32 smithi179 bash[23186]: cluster 2024-09-21T01:54:31.725597+0000 mgr.a (mgr.14388) 9524 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:34 smithi044 bash[22676]: cluster 2024-09-21T01:54:33.726412+0000 mgr.a (mgr.14388) 9525 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:54:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:34 smithi044 bash[22676]: audit 2024-09-21T01:54:33.879156+0000 mon.a (mon.0) 7964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:34 smithi044 bash[22676]: audit 2024-09-21T01:54:33.887872+0000 mon.a (mon.0) 7965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:34 smithi044 bash[22676]: audit 2024-09-21T01:54:33.898228+0000 mon.a (mon.0) 7966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:34 smithi179 bash[23186]: cluster 2024-09-21T01:54:33.726412+0000 mgr.a (mgr.14388) 9525 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:54:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:34 smithi179 bash[23186]: audit 2024-09-21T01:54:33.879156+0000 mon.a (mon.0) 7964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:34 smithi179 bash[23186]: audit 2024-09-21T01:54:33.887872+0000 mon.a (mon.0) 7965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:34 smithi179 bash[23186]: audit 2024-09-21T01:54:33.898228+0000 mon.a (mon.0) 7966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:34 smithi049 bash[23528]: cluster 2024-09-21T01:54:33.726412+0000 mgr.a (mgr.14388) 9525 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:54:35.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:34 smithi049 bash[23528]: audit 2024-09-21T01:54:33.879156+0000 mon.a (mon.0) 7964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:34 smithi049 bash[23528]: audit 2024-09-21T01:54:33.887872+0000 mon.a (mon.0) 7965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:34 smithi049 bash[23528]: audit 2024-09-21T01:54:33.898228+0000 mon.a (mon.0) 7966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:36.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:36.884 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:36.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:36.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:36.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:36.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:36 smithi044 bash[22676]: cluster 2024-09-21T01:54:35.728326+0000 mgr.a (mgr.14388) 9526 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:36 smithi179 bash[23186]: cluster 2024-09-21T01:54:35.728326+0000 mgr.a (mgr.14388) 9526 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:37.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:36 smithi049 bash[23528]: cluster 2024-09-21T01:54:35.728326+0000 mgr.a (mgr.14388) 9526 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:37 smithi044 bash[22676]: audit 2024-09-21T01:54:36.465427+0000 mgr.a (mgr.14388) 9527 : audit [DBG] from='client.211473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:37 smithi179 bash[23186]: audit 2024-09-21T01:54:36.465427+0000 mgr.a (mgr.14388) 9527 : audit [DBG] from='client.211473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:37 smithi049 bash[23528]: audit 2024-09-21T01:54:36.465427+0000 mgr.a (mgr.14388) 9527 : audit [DBG] from='client.211473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:38 smithi044 bash[22676]: cluster 2024-09-21T01:54:37.729343+0000 mgr.a (mgr.14388) 9528 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:38 smithi179 bash[23186]: cluster 2024-09-21T01:54:37.729343+0000 mgr.a (mgr.14388) 9528 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:38 smithi049 bash[23528]: cluster 2024-09-21T01:54:37.729343+0000 mgr.a (mgr.14388) 9528 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:40 smithi044 bash[22676]: cluster 2024-09-21T01:54:39.730167+0000 mgr.a (mgr.14388) 9529 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:40 smithi179 bash[23186]: cluster 2024-09-21T01:54:39.730167+0000 mgr.a (mgr.14388) 9529 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:40 smithi049 bash[23528]: cluster 2024-09-21T01:54:39.730167+0000 mgr.a (mgr.14388) 9529 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:41.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:42.653 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:42.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:42.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:42.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:42.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:42 smithi179 bash[23186]: cluster 2024-09-21T01:54:41.732426+0000 mgr.a (mgr.14388) 9530 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:42 smithi044 bash[22676]: cluster 2024-09-21T01:54:41.732426+0000 mgr.a (mgr.14388) 9530 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:42 smithi049 bash[23528]: cluster 2024-09-21T01:54:41.732426+0000 mgr.a (mgr.14388) 9530 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:54:44.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:43 smithi179 bash[23186]: audit 2024-09-21T01:54:42.215532+0000 mgr.a (mgr.14388) 9531 : audit [DBG] from='client.211551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:43 smithi044 bash[22676]: audit 2024-09-21T01:54:42.215532+0000 mgr.a (mgr.14388) 9531 : audit [DBG] from='client.211551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:43 smithi049 bash[23528]: audit 2024-09-21T01:54:42.215532+0000 mgr.a (mgr.14388) 9531 : audit [DBG] from='client.211551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:44 smithi044 bash[22676]: cluster 2024-09-21T01:54:43.733341+0000 mgr.a (mgr.14388) 9532 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:44 smithi179 bash[23186]: cluster 2024-09-21T01:54:43.733341+0000 mgr.a (mgr.14388) 9532 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:44 smithi049 bash[23528]: cluster 2024-09-21T01:54:43.733341+0000 mgr.a (mgr.14388) 9532 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:45 smithi044 bash[22676]: cluster 2024-09-21T01:54:45.735500+0000 mgr.a (mgr.14388) 9533 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:45 smithi179 bash[23186]: cluster 2024-09-21T01:54:45.735500+0000 mgr.a (mgr.14388) 9533 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:45 smithi049 bash[23528]: cluster 2024-09-21T01:54:45.735500+0000 mgr.a (mgr.14388) 9533 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:47.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:47.654 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:47.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:48 smithi049 bash[23528]: audit 2024-09-21T01:54:47.029374+0000 mon.a (mon.0) 7967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:48 smithi049 bash[23528]: audit 2024-09-21T01:54:47.037448+0000 mon.a (mon.0) 7968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:48 smithi049 bash[23528]: audit 2024-09-21T01:54:47.048105+0000 mon.a (mon.0) 7969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:48 smithi049 bash[23528]: audit 2024-09-21T01:54:47.180657+0000 mon.a (mon.0) 7970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:48 smithi049 bash[23528]: audit 2024-09-21T01:54:47.188830+0000 mon.a (mon.0) 7971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:48 smithi049 bash[23528]: audit 2024-09-21T01:54:47.200543+0000 mon.a (mon.0) 7972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:48 smithi049 bash[23528]: cluster 2024-09-21T01:54:47.736062+0000 mgr.a (mgr.14388) 9534 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:48.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:48 smithi044 bash[22676]: audit 2024-09-21T01:54:47.029374+0000 mon.a (mon.0) 7967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:48 smithi044 bash[22676]: audit 2024-09-21T01:54:47.037448+0000 mon.a (mon.0) 7968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:48 smithi044 bash[22676]: audit 2024-09-21T01:54:47.048105+0000 mon.a (mon.0) 7969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:48 smithi044 bash[22676]: audit 2024-09-21T01:54:47.180657+0000 mon.a (mon.0) 7970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:48 smithi044 bash[22676]: audit 2024-09-21T01:54:47.188830+0000 mon.a (mon.0) 7971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:48 smithi044 bash[22676]: audit 2024-09-21T01:54:47.200543+0000 mon.a (mon.0) 7972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:48 smithi044 bash[22676]: cluster 2024-09-21T01:54:47.736062+0000 mgr.a (mgr.14388) 9534 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:48 smithi179 bash[23186]: audit 2024-09-21T01:54:47.029374+0000 mon.a (mon.0) 7967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:48 smithi179 bash[23186]: audit 2024-09-21T01:54:47.037448+0000 mon.a (mon.0) 7968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:48 smithi179 bash[23186]: audit 2024-09-21T01:54:47.048105+0000 mon.a (mon.0) 7969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:48 smithi179 bash[23186]: audit 2024-09-21T01:54:47.180657+0000 mon.a (mon.0) 7970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:48 smithi179 bash[23186]: audit 2024-09-21T01:54:47.188830+0000 mon.a (mon.0) 7971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:48 smithi179 bash[23186]: audit 2024-09-21T01:54:47.200543+0000 mon.a (mon.0) 7972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:48 smithi179 bash[23186]: cluster 2024-09-21T01:54:47.736062+0000 mgr.a (mgr.14388) 9534 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:49 smithi044 bash[22676]: audit 2024-09-21T01:54:47.992882+0000 mgr.a (mgr.14388) 9535 : audit [DBG] from='client.211626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:49 smithi179 bash[23186]: audit 2024-09-21T01:54:47.992882+0000 mgr.a (mgr.14388) 9535 : audit [DBG] from='client.211626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:49.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:49 smithi049 bash[23528]: audit 2024-09-21T01:54:47.992882+0000 mgr.a (mgr.14388) 9535 : audit [DBG] from='client.211626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:50 smithi044 bash[22676]: cluster 2024-09-21T01:54:49.736711+0000 mgr.a (mgr.14388) 9536 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:50 smithi179 bash[23186]: cluster 2024-09-21T01:54:49.736711+0000 mgr.a (mgr.14388) 9536 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:50 smithi049 bash[23528]: cluster 2024-09-21T01:54:49.736711+0000 mgr.a (mgr.14388) 9536 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:52 smithi049 bash[23528]: cluster 2024-09-21T01:54:51.738998+0000 mgr.a (mgr.14388) 9537 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:52 smithi044 bash[22676]: cluster 2024-09-21T01:54:51.738998+0000 mgr.a (mgr.14388) 9537 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:52 smithi179 bash[23186]: cluster 2024-09-21T01:54:51.738998+0000 mgr.a (mgr.14388) 9537 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:53.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:53.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:53.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:54.250 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:54:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:54:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:54:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:54:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:54:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:54 smithi049 bash[23528]: cluster 2024-09-21T01:54:53.739535+0000 mgr.a (mgr.14388) 9538 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:54 smithi049 bash[23528]: audit 2024-09-21T01:54:53.798234+0000 mgr.a (mgr.14388) 9539 : audit [DBG] from='client.211704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:54 smithi049 bash[23528]: audit 2024-09-21T01:54:54.034209+0000 mon.a (mon.0) 7973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:54 smithi049 bash[23528]: audit 2024-09-21T01:54:54.049939+0000 mon.a (mon.0) 7974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:54 smithi049 bash[23528]: audit 2024-09-21T01:54:54.056669+0000 mon.a (mon.0) 7975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:54 smithi044 bash[22676]: cluster 2024-09-21T01:54:53.739535+0000 mgr.a (mgr.14388) 9538 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:54 smithi044 bash[22676]: audit 2024-09-21T01:54:53.798234+0000 mgr.a (mgr.14388) 9539 : audit [DBG] from='client.211704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:54 smithi044 bash[22676]: audit 2024-09-21T01:54:54.034209+0000 mon.a (mon.0) 7973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:54 smithi044 bash[22676]: audit 2024-09-21T01:54:54.049939+0000 mon.a (mon.0) 7974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:54 smithi044 bash[22676]: audit 2024-09-21T01:54:54.056669+0000 mon.a (mon.0) 7975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:54 smithi179 bash[23186]: cluster 2024-09-21T01:54:53.739535+0000 mgr.a (mgr.14388) 9538 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:54 smithi179 bash[23186]: audit 2024-09-21T01:54:53.798234+0000 mgr.a (mgr.14388) 9539 : audit [DBG] from='client.211704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:54:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:54 smithi179 bash[23186]: audit 2024-09-21T01:54:54.034209+0000 mon.a (mon.0) 7973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:54 smithi179 bash[23186]: audit 2024-09-21T01:54:54.049939+0000 mon.a (mon.0) 7974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:54 smithi179 bash[23186]: audit 2024-09-21T01:54:54.056669+0000 mon.a (mon.0) 7975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:54:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:56 smithi044 bash[22676]: cluster 2024-09-21T01:54:55.741800+0000 mgr.a (mgr.14388) 9540 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:56 smithi179 bash[23186]: cluster 2024-09-21T01:54:55.741800+0000 mgr.a (mgr.14388) 9540 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:57.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:56 smithi049 bash[23528]: cluster 2024-09-21T01:54:55.741800+0000 mgr.a (mgr.14388) 9540 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:54:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:54:58 smithi044 bash[22676]: cluster 2024-09-21T01:54:57.742591+0000 mgr.a (mgr.14388) 9541 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:54:58 smithi179 bash[23186]: cluster 2024-09-21T01:54:57.742591+0000 mgr.a (mgr.14388) 9541 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:54:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:54:59.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:54:59.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:54:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:54:58 smithi049 bash[23528]: cluster 2024-09-21T01:54:57.742591+0000 mgr.a (mgr.14388) 9541 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:00.008 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:00.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:00.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:00.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:00.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:00 smithi044 bash[22676]: audit 2024-09-21T01:54:59.587075+0000 mgr.a (mgr.14388) 9542 : audit [DBG] from='client.211779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:00 smithi044 bash[22676]: cluster 2024-09-21T01:54:59.743134+0000 mgr.a (mgr.14388) 9543 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:00 smithi179 bash[23186]: audit 2024-09-21T01:54:59.587075+0000 mgr.a (mgr.14388) 9542 : audit [DBG] from='client.211779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:00 smithi179 bash[23186]: cluster 2024-09-21T01:54:59.743134+0000 mgr.a (mgr.14388) 9543 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:00 smithi049 bash[23528]: audit 2024-09-21T01:54:59.587075+0000 mgr.a (mgr.14388) 9542 : audit [DBG] from='client.211779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:00 smithi049 bash[23528]: cluster 2024-09-21T01:54:59.743134+0000 mgr.a (mgr.14388) 9543 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:02 smithi044 bash[22676]: cluster 2024-09-21T01:55:01.745498+0000 mgr.a (mgr.14388) 9544 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:02 smithi179 bash[23186]: cluster 2024-09-21T01:55:01.745498+0000 mgr.a (mgr.14388) 9544 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:02 smithi049 bash[23528]: cluster 2024-09-21T01:55:01.745498+0000 mgr.a (mgr.14388) 9544 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:05.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:05.010 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:05.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:04 smithi044 bash[22676]: cluster 2024-09-21T01:55:03.746273+0000 mgr.a (mgr.14388) 9545 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:04 smithi179 bash[23186]: cluster 2024-09-21T01:55:03.746273+0000 mgr.a (mgr.14388) 9545 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:04 smithi049 bash[23528]: cluster 2024-09-21T01:55:03.746273+0000 mgr.a (mgr.14388) 9545 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:05.804 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:05.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:06 smithi044 bash[22676]: audit 2024-09-21T01:55:05.348699+0000 mgr.a (mgr.14388) 9546 : audit [DBG] from='client.211857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:06 smithi044 bash[22676]: cluster 2024-09-21T01:55:05.747625+0000 mgr.a (mgr.14388) 9547 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:06 smithi179 bash[23186]: audit 2024-09-21T01:55:05.348699+0000 mgr.a (mgr.14388) 9546 : audit [DBG] from='client.211857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:06 smithi179 bash[23186]: cluster 2024-09-21T01:55:05.747625+0000 mgr.a (mgr.14388) 9547 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:06 smithi049 bash[23528]: audit 2024-09-21T01:55:05.348699+0000 mgr.a (mgr.14388) 9546 : audit [DBG] from='client.211857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:06 smithi049 bash[23528]: cluster 2024-09-21T01:55:05.747625+0000 mgr.a (mgr.14388) 9547 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:08 smithi049 bash[23528]: audit 2024-09-21T01:55:07.254603+0000 mon.a (mon.0) 7976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:08 smithi049 bash[23528]: audit 2024-09-21T01:55:07.262509+0000 mon.a (mon.0) 7977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:08 smithi049 bash[23528]: audit 2024-09-21T01:55:07.270753+0000 mon.a (mon.0) 7978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:08 smithi049 bash[23528]: audit 2024-09-21T01:55:07.378728+0000 mon.a (mon.0) 7979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:08 smithi049 bash[23528]: audit 2024-09-21T01:55:07.387121+0000 mon.a (mon.0) 7980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:08 smithi049 bash[23528]: audit 2024-09-21T01:55:07.397095+0000 mon.a (mon.0) 7981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:08 smithi049 bash[23528]: cluster 2024-09-21T01:55:07.748391+0000 mgr.a (mgr.14388) 9548 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:55:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:08 smithi044 bash[22676]: audit 2024-09-21T01:55:07.254603+0000 mon.a (mon.0) 7976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:08 smithi044 bash[22676]: audit 2024-09-21T01:55:07.262509+0000 mon.a (mon.0) 7977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:08 smithi044 bash[22676]: audit 2024-09-21T01:55:07.270753+0000 mon.a (mon.0) 7978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:08 smithi044 bash[22676]: audit 2024-09-21T01:55:07.378728+0000 mon.a (mon.0) 7979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:08 smithi044 bash[22676]: audit 2024-09-21T01:55:07.387121+0000 mon.a (mon.0) 7980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:08 smithi044 bash[22676]: audit 2024-09-21T01:55:07.397095+0000 mon.a (mon.0) 7981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:08 smithi044 bash[22676]: cluster 2024-09-21T01:55:07.748391+0000 mgr.a (mgr.14388) 9548 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:55:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:08 smithi179 bash[23186]: audit 2024-09-21T01:55:07.254603+0000 mon.a (mon.0) 7976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:08 smithi179 bash[23186]: audit 2024-09-21T01:55:07.262509+0000 mon.a (mon.0) 7977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:08 smithi179 bash[23186]: audit 2024-09-21T01:55:07.270753+0000 mon.a (mon.0) 7978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:08 smithi179 bash[23186]: audit 2024-09-21T01:55:07.378728+0000 mon.a (mon.0) 7979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:08 smithi179 bash[23186]: audit 2024-09-21T01:55:07.387121+0000 mon.a (mon.0) 7980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:08 smithi179 bash[23186]: audit 2024-09-21T01:55:07.397095+0000 mon.a (mon.0) 7981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:08 smithi179 bash[23186]: cluster 2024-09-21T01:55:07.748391+0000 mgr.a (mgr.14388) 9548 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:55:10.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:10.807 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:10.807 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:10 smithi044 bash[22676]: cluster 2024-09-21T01:55:09.749148+0000 mgr.a (mgr.14388) 9549 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:55:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:10 smithi179 bash[23186]: cluster 2024-09-21T01:55:09.749148+0000 mgr.a (mgr.14388) 9549 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:55:11.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:10 smithi049 bash[23528]: cluster 2024-09-21T01:55:09.749148+0000 mgr.a (mgr.14388) 9549 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:55:11.571 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:11.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:11.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:11.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:11.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:13.068 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:12 smithi044 bash[22676]: audit 2024-09-21T01:55:11.140945+0000 mgr.a (mgr.14388) 9550 : audit [DBG] from='client.211932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:13.068 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:12 smithi044 bash[22676]: cluster 2024-09-21T01:55:11.751962+0000 mgr.a (mgr.14388) 9551 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:13.088 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:12 smithi049 bash[23528]: audit 2024-09-21T01:55:11.140945+0000 mgr.a (mgr.14388) 9550 : audit [DBG] from='client.211932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:13.088 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:12 smithi049 bash[23528]: cluster 2024-09-21T01:55:11.751962+0000 mgr.a (mgr.14388) 9551 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:12 smithi179 bash[23186]: audit 2024-09-21T01:55:11.140945+0000 mgr.a (mgr.14388) 9550 : audit [DBG] from='client.211932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:12 smithi179 bash[23186]: cluster 2024-09-21T01:55:11.751962+0000 mgr.a (mgr.14388) 9551 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:14 smithi044 bash[22676]: cluster 2024-09-21T01:55:13.752718+0000 mgr.a (mgr.14388) 9552 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:14 smithi044 bash[22676]: audit 2024-09-21T01:55:14.219623+0000 mon.a (mon.0) 7982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:14 smithi044 bash[22676]: audit 2024-09-21T01:55:14.229681+0000 mon.a (mon.0) 7983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:14 smithi044 bash[22676]: audit 2024-09-21T01:55:14.241599+0000 mon.a (mon.0) 7984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:14 smithi179 bash[23186]: cluster 2024-09-21T01:55:13.752718+0000 mgr.a (mgr.14388) 9552 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:14 smithi179 bash[23186]: audit 2024-09-21T01:55:14.219623+0000 mon.a (mon.0) 7982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:14 smithi179 bash[23186]: audit 2024-09-21T01:55:14.229681+0000 mon.a (mon.0) 7983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:14 smithi179 bash[23186]: audit 2024-09-21T01:55:14.241599+0000 mon.a (mon.0) 7984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:14 smithi049 bash[23528]: cluster 2024-09-21T01:55:13.752718+0000 mgr.a (mgr.14388) 9552 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:14 smithi049 bash[23528]: audit 2024-09-21T01:55:14.219623+0000 mon.a (mon.0) 7982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:14 smithi049 bash[23528]: audit 2024-09-21T01:55:14.229681+0000 mon.a (mon.0) 7983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:14 smithi049 bash[23528]: audit 2024-09-21T01:55:14.241599+0000 mon.a (mon.0) 7984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:16.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:16.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:16.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:16 smithi049 bash[23528]: cluster 2024-09-21T01:55:15.754690+0000 mgr.a (mgr.14388) 9553 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:16 smithi044 bash[22676]: cluster 2024-09-21T01:55:15.754690+0000 mgr.a (mgr.14388) 9553 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:16 smithi179 bash[23186]: cluster 2024-09-21T01:55:15.754690+0000 mgr.a (mgr.14388) 9553 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:17.349 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:17.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:17.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:17.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:17.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:17 smithi044 bash[22676]: audit 2024-09-21T01:55:16.908857+0000 mgr.a (mgr.14388) 9554 : audit [DBG] from='client.212004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:17 smithi179 bash[23186]: audit 2024-09-21T01:55:16.908857+0000 mgr.a (mgr.14388) 9554 : audit [DBG] from='client.212004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:17 smithi049 bash[23528]: audit 2024-09-21T01:55:16.908857+0000 mgr.a (mgr.14388) 9554 : audit [DBG] from='client.212004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:18 smithi044 bash[22676]: cluster 2024-09-21T01:55:17.755665+0000 mgr.a (mgr.14388) 9555 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:18 smithi179 bash[23186]: cluster 2024-09-21T01:55:17.755665+0000 mgr.a (mgr.14388) 9555 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:18 smithi049 bash[23528]: cluster 2024-09-21T01:55:17.755665+0000 mgr.a (mgr.14388) 9555 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:21.203 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:20 smithi179 bash[23186]: cluster 2024-09-21T01:55:19.756644+0000 mgr.a (mgr.14388) 9556 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:20 smithi044 bash[22676]: cluster 2024-09-21T01:55:19.756644+0000 mgr.a (mgr.14388) 9556 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:20 smithi049 bash[23528]: cluster 2024-09-21T01:55:19.756644+0000 mgr.a (mgr.14388) 9556 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:22.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:22.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:22.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:23.140 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:23.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:23.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:23.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:23.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:22 smithi044 bash[22676]: cluster 2024-09-21T01:55:21.759057+0000 mgr.a (mgr.14388) 9557 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:22 smithi179 bash[23186]: cluster 2024-09-21T01:55:21.759057+0000 mgr.a (mgr.14388) 9557 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:22 smithi049 bash[23528]: cluster 2024-09-21T01:55:21.759057+0000 mgr.a (mgr.14388) 9557 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:23 smithi044 bash[22676]: audit 2024-09-21T01:55:22.695750+0000 mgr.a (mgr.14388) 9558 : audit [DBG] from='client.212082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:23 smithi179 bash[23186]: audit 2024-09-21T01:55:22.695750+0000 mgr.a (mgr.14388) 9558 : audit [DBG] from='client.212082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:23 smithi049 bash[23528]: audit 2024-09-21T01:55:22.695750+0000 mgr.a (mgr.14388) 9558 : audit [DBG] from='client.212082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:24 smithi044 bash[22676]: cluster 2024-09-21T01:55:23.759994+0000 mgr.a (mgr.14388) 9559 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:24 smithi179 bash[23186]: cluster 2024-09-21T01:55:23.759994+0000 mgr.a (mgr.14388) 9559 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:24 smithi049 bash[23528]: cluster 2024-09-21T01:55:23.759994+0000 mgr.a (mgr.14388) 9559 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:26 smithi044 bash[22676]: cluster 2024-09-21T01:55:25.762182+0000 mgr.a (mgr.14388) 9560 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:26 smithi044 bash[22676]: audit 2024-09-21T01:55:26.496318+0000 mon.a (mon.0) 7985 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:55:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:26 smithi044 bash[22676]: audit 2024-09-21T01:55:26.503550+0000 mon.a (mon.0) 7986 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:55:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:26 smithi044 bash[22676]: audit 2024-09-21T01:55:26.505656+0000 mon.a (mon.0) 7987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:55:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:26 smithi044 bash[22676]: audit 2024-09-21T01:55:26.517055+0000 mon.a (mon.0) 7988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:26 smithi044 bash[22676]: audit 2024-09-21T01:55:26.523491+0000 mon.a (mon.0) 7989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:55:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:26 smithi179 bash[23186]: cluster 2024-09-21T01:55:25.762182+0000 mgr.a (mgr.14388) 9560 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:26 smithi179 bash[23186]: audit 2024-09-21T01:55:26.496318+0000 mon.a (mon.0) 7985 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:55:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:26 smithi179 bash[23186]: audit 2024-09-21T01:55:26.503550+0000 mon.a (mon.0) 7986 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:55:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:26 smithi179 bash[23186]: audit 2024-09-21T01:55:26.505656+0000 mon.a (mon.0) 7987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:55:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:26 smithi179 bash[23186]: audit 2024-09-21T01:55:26.517055+0000 mon.a (mon.0) 7988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:26 smithi179 bash[23186]: audit 2024-09-21T01:55:26.523491+0000 mon.a (mon.0) 7989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:55:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:26 smithi049 bash[23528]: cluster 2024-09-21T01:55:25.762182+0000 mgr.a (mgr.14388) 9560 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:55:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:26 smithi049 bash[23528]: audit 2024-09-21T01:55:26.496318+0000 mon.a (mon.0) 7985 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:55:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:26 smithi049 bash[23528]: audit 2024-09-21T01:55:26.503550+0000 mon.a (mon.0) 7986 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:55:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:26 smithi049 bash[23528]: audit 2024-09-21T01:55:26.505656+0000 mon.a (mon.0) 7987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:55:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:26 smithi049 bash[23528]: audit 2024-09-21T01:55:26.517055+0000 mon.a (mon.0) 7988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:26 smithi049 bash[23528]: audit 2024-09-21T01:55:26.523491+0000 mon.a (mon.0) 7989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:55:27.612 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22930]: debug 2024-09-21T01:55:27.302+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:55:27.613 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22930]: debug 2024-09-21T01:55:27.302+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:55:28.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:28.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:28.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22676]: audit 2024-09-21T01:55:26.525871+0000 mgr.a (mgr.14388) 9561 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:55:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22676]: audit 2024-09-21T01:55:27.438075+0000 mon.a (mon.0) 7990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22676]: audit 2024-09-21T01:55:27.444178+0000 mon.a (mon.0) 7991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22676]: audit 2024-09-21T01:55:27.450962+0000 mon.a (mon.0) 7992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22676]: audit 2024-09-21T01:55:27.594425+0000 mon.a (mon.0) 7993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22676]: audit 2024-09-21T01:55:27.602328+0000 mon.a (mon.0) 7994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:27 smithi044 bash[22676]: audit 2024-09-21T01:55:27.612039+0000 mon.a (mon.0) 7995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:27 smithi179 bash[23186]: audit 2024-09-21T01:55:26.525871+0000 mgr.a (mgr.14388) 9561 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:55:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:27 smithi179 bash[23186]: audit 2024-09-21T01:55:27.438075+0000 mon.a (mon.0) 7990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:27 smithi179 bash[23186]: audit 2024-09-21T01:55:27.444178+0000 mon.a (mon.0) 7991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:27 smithi179 bash[23186]: audit 2024-09-21T01:55:27.450962+0000 mon.a (mon.0) 7992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:27 smithi179 bash[23186]: audit 2024-09-21T01:55:27.594425+0000 mon.a (mon.0) 7993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:27 smithi179 bash[23186]: audit 2024-09-21T01:55:27.602328+0000 mon.a (mon.0) 7994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:27 smithi179 bash[23186]: audit 2024-09-21T01:55:27.612039+0000 mon.a (mon.0) 7995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:27 smithi049 bash[23528]: audit 2024-09-21T01:55:26.525871+0000 mgr.a (mgr.14388) 9561 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:55:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:27 smithi049 bash[23528]: audit 2024-09-21T01:55:27.438075+0000 mon.a (mon.0) 7990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:27 smithi049 bash[23528]: audit 2024-09-21T01:55:27.444178+0000 mon.a (mon.0) 7991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:27 smithi049 bash[23528]: audit 2024-09-21T01:55:27.450962+0000 mon.a (mon.0) 7992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:27 smithi049 bash[23528]: audit 2024-09-21T01:55:27.594425+0000 mon.a (mon.0) 7993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:27 smithi049 bash[23528]: audit 2024-09-21T01:55:27.602328+0000 mon.a (mon.0) 7994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:27 smithi049 bash[23528]: audit 2024-09-21T01:55:27.612039+0000 mon.a (mon.0) 7995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:28.894 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:28.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:28 smithi044 bash[22676]: audit 2024-09-21T01:55:27.305427+0000 mgr.a (mgr.14388) 9562 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:55:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:28 smithi044 bash[22676]: cephadm 2024-09-21T01:55:27.306855+0000 mgr.a (mgr.14388) 9563 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:55:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:28 smithi044 bash[22676]: cluster 2024-09-21T01:55:27.763096+0000 mgr.a (mgr.14388) 9564 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:28 smithi179 bash[23186]: audit 2024-09-21T01:55:27.305427+0000 mgr.a (mgr.14388) 9562 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:55:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:28 smithi179 bash[23186]: cephadm 2024-09-21T01:55:27.306855+0000 mgr.a (mgr.14388) 9563 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:55:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:28 smithi179 bash[23186]: cluster 2024-09-21T01:55:27.763096+0000 mgr.a (mgr.14388) 9564 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:28 smithi049 bash[23528]: audit 2024-09-21T01:55:27.305427+0000 mgr.a (mgr.14388) 9562 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:55:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:28 smithi049 bash[23528]: cephadm 2024-09-21T01:55:27.306855+0000 mgr.a (mgr.14388) 9563 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:55:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:28 smithi049 bash[23528]: cluster 2024-09-21T01:55:27.763096+0000 mgr.a (mgr.14388) 9564 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:29 smithi044 bash[22676]: audit 2024-09-21T01:55:28.471892+0000 mgr.a (mgr.14388) 9565 : audit [DBG] from='client.212262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:29 smithi179 bash[23186]: audit 2024-09-21T01:55:28.471892+0000 mgr.a (mgr.14388) 9565 : audit [DBG] from='client.212262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:29 smithi049 bash[23528]: audit 2024-09-21T01:55:28.471892+0000 mgr.a (mgr.14388) 9565 : audit [DBG] from='client.212262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:30 smithi044 bash[22676]: cluster 2024-09-21T01:55:29.764027+0000 mgr.a (mgr.14388) 9566 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:30 smithi179 bash[23186]: cluster 2024-09-21T01:55:29.764027+0000 mgr.a (mgr.14388) 9566 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:30 smithi049 bash[23528]: cluster 2024-09-21T01:55:29.764027+0000 mgr.a (mgr.14388) 9566 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:32 smithi044 bash[22676]: cluster 2024-09-21T01:55:31.765394+0000 mgr.a (mgr.14388) 9567 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:32 smithi179 bash[23186]: cluster 2024-09-21T01:55:31.765394+0000 mgr.a (mgr.14388) 9567 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:32 smithi049 bash[23528]: cluster 2024-09-21T01:55:31.765394+0000 mgr.a (mgr.14388) 9567 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:33.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:33.898 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:33.898 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:34 smithi044 bash[22676]: cluster 2024-09-21T01:55:33.766092+0000 mgr.a (mgr.14388) 9568 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:34 smithi179 bash[23186]: cluster 2024-09-21T01:55:33.766092+0000 mgr.a (mgr.14388) 9568 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:34.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:34 smithi049 bash[23528]: cluster 2024-09-21T01:55:33.766092+0000 mgr.a (mgr.14388) 9568 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:34.641 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:35 smithi044 bash[22676]: audit 2024-09-21T01:55:34.223494+0000 mgr.a (mgr.14388) 9569 : audit [DBG] from='client.212337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:35 smithi044 bash[22676]: audit 2024-09-21T01:55:34.390173+0000 mon.a (mon.0) 7996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:35 smithi044 bash[22676]: audit 2024-09-21T01:55:34.395855+0000 mon.a (mon.0) 7997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:35 smithi044 bash[22676]: audit 2024-09-21T01:55:34.403917+0000 mon.a (mon.0) 7998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:35 smithi179 bash[23186]: audit 2024-09-21T01:55:34.223494+0000 mgr.a (mgr.14388) 9569 : audit [DBG] from='client.212337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:35 smithi179 bash[23186]: audit 2024-09-21T01:55:34.390173+0000 mon.a (mon.0) 7996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:35 smithi179 bash[23186]: audit 2024-09-21T01:55:34.395855+0000 mon.a (mon.0) 7997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:35 smithi179 bash[23186]: audit 2024-09-21T01:55:34.403917+0000 mon.a (mon.0) 7998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:35 smithi049 bash[23528]: audit 2024-09-21T01:55:34.223494+0000 mgr.a (mgr.14388) 9569 : audit [DBG] from='client.212337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:35 smithi049 bash[23528]: audit 2024-09-21T01:55:34.390173+0000 mon.a (mon.0) 7996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:35 smithi049 bash[23528]: audit 2024-09-21T01:55:34.395855+0000 mon.a (mon.0) 7997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:35 smithi049 bash[23528]: audit 2024-09-21T01:55:34.403917+0000 mon.a (mon.0) 7998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:36 smithi044 bash[22676]: cluster 2024-09-21T01:55:35.768581+0000 mgr.a (mgr.14388) 9570 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:36 smithi179 bash[23186]: cluster 2024-09-21T01:55:35.768581+0000 mgr.a (mgr.14388) 9570 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:36.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:36 smithi049 bash[23528]: cluster 2024-09-21T01:55:35.768581+0000 mgr.a (mgr.14388) 9570 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:38 smithi044 bash[22676]: cluster 2024-09-21T01:55:37.769547+0000 mgr.a (mgr.14388) 9571 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:38 smithi179 bash[23186]: cluster 2024-09-21T01:55:37.769547+0000 mgr.a (mgr.14388) 9571 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:38 smithi049 bash[23528]: cluster 2024-09-21T01:55:37.769547+0000 mgr.a (mgr.14388) 9571 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:39.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:39.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:40.426 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:40 smithi044 bash[22676]: cluster 2024-09-21T01:55:39.770030+0000 mgr.a (mgr.14388) 9572 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:40 smithi179 bash[23186]: cluster 2024-09-21T01:55:39.770030+0000 mgr.a (mgr.14388) 9572 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:40 smithi049 bash[23528]: cluster 2024-09-21T01:55:39.770030+0000 mgr.a (mgr.14388) 9572 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:41 smithi044 bash[22676]: audit 2024-09-21T01:55:39.984082+0000 mgr.a (mgr.14388) 9573 : audit [DBG] from='client.212415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:41 smithi179 bash[23186]: audit 2024-09-21T01:55:39.984082+0000 mgr.a (mgr.14388) 9573 : audit [DBG] from='client.212415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:41 smithi049 bash[23528]: audit 2024-09-21T01:55:39.984082+0000 mgr.a (mgr.14388) 9573 : audit [DBG] from='client.212415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:42 smithi044 bash[22676]: cluster 2024-09-21T01:55:41.772881+0000 mgr.a (mgr.14388) 9574 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:42 smithi179 bash[23186]: cluster 2024-09-21T01:55:41.772881+0000 mgr.a (mgr.14388) 9574 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:42 smithi049 bash[23528]: cluster 2024-09-21T01:55:41.772881+0000 mgr.a (mgr.14388) 9574 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:55:45.148 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:44 smithi179 bash[23186]: cluster 2024-09-21T01:55:43.773871+0000 mgr.a (mgr.14388) 9575 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:44 smithi044 bash[22676]: cluster 2024-09-21T01:55:43.773871+0000 mgr.a (mgr.14388) 9575 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:44 smithi049 bash[23528]: cluster 2024-09-21T01:55:43.773871+0000 mgr.a (mgr.14388) 9575 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:45.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:45.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:45.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:46.207 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:46.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:46.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:46.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:46.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:46 smithi044 bash[22676]: audit 2024-09-21T01:55:45.764903+0000 mgr.a (mgr.14388) 9576 : audit [DBG] from='client.212493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:46 smithi044 bash[22676]: cluster 2024-09-21T01:55:45.779346+0000 mgr.a (mgr.14388) 9577 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:46 smithi179 bash[23186]: audit 2024-09-21T01:55:45.764903+0000 mgr.a (mgr.14388) 9576 : audit [DBG] from='client.212493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:46 smithi179 bash[23186]: cluster 2024-09-21T01:55:45.779346+0000 mgr.a (mgr.14388) 9577 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:46 smithi049 bash[23528]: audit 2024-09-21T01:55:45.764903+0000 mgr.a (mgr.14388) 9576 : audit [DBG] from='client.212493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:46 smithi049 bash[23528]: cluster 2024-09-21T01:55:45.779346+0000 mgr.a (mgr.14388) 9577 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:55:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:48 smithi044 bash[22676]: audit 2024-09-21T01:55:47.658866+0000 mon.a (mon.0) 7999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:48 smithi044 bash[22676]: audit 2024-09-21T01:55:47.669914+0000 mon.a (mon.0) 8000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:48 smithi044 bash[22676]: audit 2024-09-21T01:55:47.681664+0000 mon.a (mon.0) 8001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:48 smithi044 bash[22676]: cluster 2024-09-21T01:55:47.779996+0000 mgr.a (mgr.14388) 9578 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:48 smithi044 bash[22676]: audit 2024-09-21T01:55:47.831738+0000 mon.a (mon.0) 8002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:48 smithi044 bash[22676]: audit 2024-09-21T01:55:47.839934+0000 mon.a (mon.0) 8003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:48 smithi044 bash[22676]: audit 2024-09-21T01:55:47.850146+0000 mon.a (mon.0) 8004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:48 smithi179 bash[23186]: audit 2024-09-21T01:55:47.658866+0000 mon.a (mon.0) 7999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:48 smithi179 bash[23186]: audit 2024-09-21T01:55:47.669914+0000 mon.a (mon.0) 8000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:48 smithi179 bash[23186]: audit 2024-09-21T01:55:47.681664+0000 mon.a (mon.0) 8001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:48 smithi179 bash[23186]: cluster 2024-09-21T01:55:47.779996+0000 mgr.a (mgr.14388) 9578 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:48 smithi179 bash[23186]: audit 2024-09-21T01:55:47.831738+0000 mon.a (mon.0) 8002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:48 smithi179 bash[23186]: audit 2024-09-21T01:55:47.839934+0000 mon.a (mon.0) 8003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:48 smithi179 bash[23186]: audit 2024-09-21T01:55:47.850146+0000 mon.a (mon.0) 8004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:48 smithi049 bash[23528]: audit 2024-09-21T01:55:47.658866+0000 mon.a (mon.0) 7999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:48 smithi049 bash[23528]: audit 2024-09-21T01:55:47.669914+0000 mon.a (mon.0) 8000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:48 smithi049 bash[23528]: audit 2024-09-21T01:55:47.681664+0000 mon.a (mon.0) 8001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:48 smithi049 bash[23528]: cluster 2024-09-21T01:55:47.779996+0000 mgr.a (mgr.14388) 9578 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:48 smithi049 bash[23528]: audit 2024-09-21T01:55:47.831738+0000 mon.a (mon.0) 8002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:48 smithi049 bash[23528]: audit 2024-09-21T01:55:47.839934+0000 mon.a (mon.0) 8003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:48 smithi049 bash[23528]: audit 2024-09-21T01:55:47.850146+0000 mon.a (mon.0) 8004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:51.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:51.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:51.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:50 smithi044 bash[22676]: cluster 2024-09-21T01:55:49.780771+0000 mgr.a (mgr.14388) 9579 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:50 smithi179 bash[23186]: cluster 2024-09-21T01:55:49.780771+0000 mgr.a (mgr.14388) 9579 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:50 smithi049 bash[23528]: cluster 2024-09-21T01:55:49.780771+0000 mgr.a (mgr.14388) 9579 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:55:52.015 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:52 smithi044 bash[22676]: audit 2024-09-21T01:55:51.547565+0000 mgr.a (mgr.14388) 9580 : audit [DBG] from='client.212565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:52 smithi044 bash[22676]: cluster 2024-09-21T01:55:51.782342+0000 mgr.a (mgr.14388) 9581 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:52 smithi179 bash[23186]: audit 2024-09-21T01:55:51.547565+0000 mgr.a (mgr.14388) 9580 : audit [DBG] from='client.212565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:52 smithi179 bash[23186]: cluster 2024-09-21T01:55:51.782342+0000 mgr.a (mgr.14388) 9581 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:52 smithi049 bash[23528]: audit 2024-09-21T01:55:51.547565+0000 mgr.a (mgr.14388) 9580 : audit [DBG] from='client.212565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:52 smithi049 bash[23528]: cluster 2024-09-21T01:55:51.782342+0000 mgr.a (mgr.14388) 9581 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:54.957 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:54 smithi049 bash[23528]: cluster 2024-09-21T01:55:53.782849+0000 mgr.a (mgr.14388) 9582 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:54.957 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:54 smithi049 bash[23528]: audit 2024-09-21T01:55:54.581203+0000 mon.a (mon.0) 8005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:54.957 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:54 smithi049 bash[23528]: audit 2024-09-21T01:55:54.590041+0000 mon.a (mon.0) 8006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:54.957 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:54 smithi049 bash[23528]: audit 2024-09-21T01:55:54.600766+0000 mon.a (mon.0) 8007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:54 smithi044 bash[22676]: cluster 2024-09-21T01:55:53.782849+0000 mgr.a (mgr.14388) 9582 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:54 smithi044 bash[22676]: audit 2024-09-21T01:55:54.581203+0000 mon.a (mon.0) 8005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:54 smithi044 bash[22676]: audit 2024-09-21T01:55:54.590041+0000 mon.a (mon.0) 8006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:54 smithi044 bash[22676]: audit 2024-09-21T01:55:54.600766+0000 mon.a (mon.0) 8007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:54 smithi179 bash[23186]: cluster 2024-09-21T01:55:53.782849+0000 mgr.a (mgr.14388) 9582 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:54 smithi179 bash[23186]: audit 2024-09-21T01:55:54.581203+0000 mon.a (mon.0) 8005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:54 smithi179 bash[23186]: audit 2024-09-21T01:55:54.590041+0000 mon.a (mon.0) 8006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:54 smithi179 bash[23186]: audit 2024-09-21T01:55:54.600766+0000 mon.a (mon.0) 8007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:55:57.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:55:57.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:55:57.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:55:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:56 smithi049 bash[23528]: cluster 2024-09-21T01:55:55.784948+0000 mgr.a (mgr.14388) 9583 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:55:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:56 smithi044 bash[22676]: cluster 2024-09-21T01:55:55.784948+0000 mgr.a (mgr.14388) 9583 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:55:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:56 smithi179 bash[23186]: cluster 2024-09-21T01:55:55.784948+0000 mgr.a (mgr.14388) 9583 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:55:57.804 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:55:57.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:55:57.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:55:57.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:55:57.805 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:55:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:58 smithi044 bash[22676]: audit 2024-09-21T01:55:57.354132+0000 mgr.a (mgr.14388) 9584 : audit [DBG] from='client.212643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:55:58 smithi044 bash[22676]: cluster 2024-09-21T01:55:57.785551+0000 mgr.a (mgr.14388) 9585 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:58 smithi179 bash[23186]: audit 2024-09-21T01:55:57.354132+0000 mgr.a (mgr.14388) 9584 : audit [DBG] from='client.212643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:55:58 smithi179 bash[23186]: cluster 2024-09-21T01:55:57.785551+0000 mgr.a (mgr.14388) 9585 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:55:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:58 smithi049 bash[23528]: audit 2024-09-21T01:55:57.354132+0000 mgr.a (mgr.14388) 9584 : audit [DBG] from='client.212643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:55:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:55:58 smithi049 bash[23528]: cluster 2024-09-21T01:55:57.785551+0000 mgr.a (mgr.14388) 9585 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:56:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:00 smithi044 bash[22676]: cluster 2024-09-21T01:55:59.786293+0000 mgr.a (mgr.14388) 9586 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:56:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:00 smithi179 bash[23186]: cluster 2024-09-21T01:55:59.786293+0000 mgr.a (mgr.14388) 9586 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:56:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:00 smithi049 bash[23528]: cluster 2024-09-21T01:55:59.786293+0000 mgr.a (mgr.14388) 9586 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T01:56:02.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:02.807 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:02.807 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:03.119 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:02 smithi179 bash[23186]: cluster 2024-09-21T01:56:01.788649+0000 mgr.a (mgr.14388) 9587 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:56:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:02 smithi044 bash[22676]: cluster 2024-09-21T01:56:01.788649+0000 mgr.a (mgr.14388) 9587 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:56:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:02 smithi049 bash[23528]: cluster 2024-09-21T01:56:01.788649+0000 mgr.a (mgr.14388) 9587 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T01:56:03.602 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:03.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:03.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:03.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:03.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:05.233 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:04 smithi179 bash[23186]: audit 2024-09-21T01:56:03.140250+0000 mgr.a (mgr.14388) 9588 : audit [DBG] from='client.212718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:05.233 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:04 smithi179 bash[23186]: cluster 2024-09-21T01:56:03.789788+0000 mgr.a (mgr.14388) 9589 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:04 smithi044 bash[22676]: audit 2024-09-21T01:56:03.140250+0000 mgr.a (mgr.14388) 9588 : audit [DBG] from='client.212718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:04 smithi044 bash[22676]: cluster 2024-09-21T01:56:03.789788+0000 mgr.a (mgr.14388) 9589 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:04 smithi049 bash[23528]: audit 2024-09-21T01:56:03.140250+0000 mgr.a (mgr.14388) 9588 : audit [DBG] from='client.212718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:04 smithi049 bash[23528]: cluster 2024-09-21T01:56:03.789788+0000 mgr.a (mgr.14388) 9589 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:06 smithi044 bash[22676]: cluster 2024-09-21T01:56:05.792012+0000 mgr.a (mgr.14388) 9590 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:06 smithi179 bash[23186]: cluster 2024-09-21T01:56:05.792012+0000 mgr.a (mgr.14388) 9590 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:06 smithi049 bash[23528]: cluster 2024-09-21T01:56:05.792012+0000 mgr.a (mgr.14388) 9590 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:08.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:08.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:08.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:08 smithi044 bash[22676]: cluster 2024-09-21T01:56:07.792766+0000 mgr.a (mgr.14388) 9591 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:08 smithi044 bash[22676]: audit 2024-09-21T01:56:07.852429+0000 mon.a (mon.0) 8008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:08 smithi044 bash[22676]: audit 2024-09-21T01:56:07.860350+0000 mon.a (mon.0) 8009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:08 smithi044 bash[22676]: audit 2024-09-21T01:56:07.867947+0000 mon.a (mon.0) 8010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:08 smithi044 bash[22676]: audit 2024-09-21T01:56:08.047425+0000 mon.a (mon.0) 8011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:08 smithi044 bash[22676]: audit 2024-09-21T01:56:08.055941+0000 mon.a (mon.0) 8012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:08 smithi044 bash[22676]: audit 2024-09-21T01:56:08.066532+0000 mon.a (mon.0) 8013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:08 smithi179 bash[23186]: cluster 2024-09-21T01:56:07.792766+0000 mgr.a (mgr.14388) 9591 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:08 smithi179 bash[23186]: audit 2024-09-21T01:56:07.852429+0000 mon.a (mon.0) 8008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:08 smithi179 bash[23186]: audit 2024-09-21T01:56:07.860350+0000 mon.a (mon.0) 8009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:08 smithi179 bash[23186]: audit 2024-09-21T01:56:07.867947+0000 mon.a (mon.0) 8010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:08 smithi179 bash[23186]: audit 2024-09-21T01:56:08.047425+0000 mon.a (mon.0) 8011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:08 smithi179 bash[23186]: audit 2024-09-21T01:56:08.055941+0000 mon.a (mon.0) 8012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:08 smithi179 bash[23186]: audit 2024-09-21T01:56:08.066532+0000 mon.a (mon.0) 8013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:08 smithi049 bash[23528]: cluster 2024-09-21T01:56:07.792766+0000 mgr.a (mgr.14388) 9591 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:08 smithi049 bash[23528]: audit 2024-09-21T01:56:07.852429+0000 mon.a (mon.0) 8008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:08 smithi049 bash[23528]: audit 2024-09-21T01:56:07.860350+0000 mon.a (mon.0) 8009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:08 smithi049 bash[23528]: audit 2024-09-21T01:56:07.867947+0000 mon.a (mon.0) 8010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:08 smithi049 bash[23528]: audit 2024-09-21T01:56:08.047425+0000 mon.a (mon.0) 8011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:08 smithi049 bash[23528]: audit 2024-09-21T01:56:08.055941+0000 mon.a (mon.0) 8012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:08 smithi049 bash[23528]: audit 2024-09-21T01:56:08.066532+0000 mon.a (mon.0) 8013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:09.395 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:09.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:09.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:09.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:09.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:10 smithi044 bash[22676]: audit 2024-09-21T01:56:08.943684+0000 mgr.a (mgr.14388) 9592 : audit [DBG] from='client.212796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:10 smithi044 bash[22676]: cluster 2024-09-21T01:56:09.793683+0000 mgr.a (mgr.14388) 9593 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:10 smithi179 bash[23186]: audit 2024-09-21T01:56:08.943684+0000 mgr.a (mgr.14388) 9592 : audit [DBG] from='client.212796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:10 smithi179 bash[23186]: cluster 2024-09-21T01:56:09.793683+0000 mgr.a (mgr.14388) 9593 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:10 smithi049 bash[23528]: audit 2024-09-21T01:56:08.943684+0000 mgr.a (mgr.14388) 9592 : audit [DBG] from='client.212796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:10 smithi049 bash[23528]: cluster 2024-09-21T01:56:09.793683+0000 mgr.a (mgr.14388) 9593 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:12 smithi044 bash[22676]: cluster 2024-09-21T01:56:11.795894+0000 mgr.a (mgr.14388) 9594 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:12 smithi179 bash[23186]: cluster 2024-09-21T01:56:11.795894+0000 mgr.a (mgr.14388) 9594 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:12 smithi049 bash[23528]: cluster 2024-09-21T01:56:11.795894+0000 mgr.a (mgr.14388) 9594 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:14.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:14.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:14 smithi044 bash[22676]: cluster 2024-09-21T01:56:13.796469+0000 mgr.a (mgr.14388) 9595 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:14 smithi044 bash[22676]: audit 2024-09-21T01:56:14.770960+0000 mon.a (mon.0) 8014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:14 smithi044 bash[22676]: audit 2024-09-21T01:56:14.777375+0000 mon.a (mon.0) 8015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:14 smithi044 bash[22676]: audit 2024-09-21T01:56:14.783465+0000 mon.a (mon.0) 8016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:14 smithi049 bash[23528]: cluster 2024-09-21T01:56:13.796469+0000 mgr.a (mgr.14388) 9595 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:14 smithi049 bash[23528]: audit 2024-09-21T01:56:14.770960+0000 mon.a (mon.0) 8014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:14 smithi049 bash[23528]: audit 2024-09-21T01:56:14.777375+0000 mon.a (mon.0) 8015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:15.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:14 smithi049 bash[23528]: audit 2024-09-21T01:56:14.783465+0000 mon.a (mon.0) 8016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:15.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:15.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:15.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:15.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:15.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:14 smithi179 bash[23186]: cluster 2024-09-21T01:56:13.796469+0000 mgr.a (mgr.14388) 9595 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T01:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:14 smithi179 bash[23186]: audit 2024-09-21T01:56:14.770960+0000 mon.a (mon.0) 8014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:14 smithi179 bash[23186]: audit 2024-09-21T01:56:14.777375+0000 mon.a (mon.0) 8015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:14 smithi179 bash[23186]: audit 2024-09-21T01:56:14.783465+0000 mon.a (mon.0) 8016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:16.118 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:15 smithi049 bash[23528]: audit 2024-09-21T01:56:14.722735+0000 mgr.a (mgr.14388) 9596 : audit [DBG] from='client.212874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:15 smithi044 bash[22676]: audit 2024-09-21T01:56:14.722735+0000 mgr.a (mgr.14388) 9596 : audit [DBG] from='client.212874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:15 smithi179 bash[23186]: audit 2024-09-21T01:56:14.722735+0000 mgr.a (mgr.14388) 9596 : audit [DBG] from='client.212874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:16 smithi044 bash[22676]: cluster 2024-09-21T01:56:15.798797+0000 mgr.a (mgr.14388) 9597 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:16 smithi179 bash[23186]: cluster 2024-09-21T01:56:15.798797+0000 mgr.a (mgr.14388) 9597 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:16 smithi049 bash[23528]: cluster 2024-09-21T01:56:15.798797+0000 mgr.a (mgr.14388) 9597 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T01:56:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:18 smithi044 bash[22676]: cluster 2024-09-21T01:56:17.799706+0000 mgr.a (mgr.14388) 9598 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:18 smithi179 bash[23186]: cluster 2024-09-21T01:56:17.799706+0000 mgr.a (mgr.14388) 9598 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:18 smithi049 bash[23528]: cluster 2024-09-21T01:56:17.799706+0000 mgr.a (mgr.14388) 9598 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:20.882 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:20 smithi044 bash[22676]: cluster 2024-09-21T01:56:19.800637+0000 mgr.a (mgr.14388) 9599 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:20 smithi179 bash[23186]: cluster 2024-09-21T01:56:19.800637+0000 mgr.a (mgr.14388) 9599 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:20 smithi049 bash[23528]: cluster 2024-09-21T01:56:19.800637+0000 mgr.a (mgr.14388) 9599 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:21 smithi044 bash[22676]: audit 2024-09-21T01:56:20.464885+0000 mgr.a (mgr.14388) 9600 : audit [DBG] from='client.212952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:21 smithi179 bash[23186]: audit 2024-09-21T01:56:20.464885+0000 mgr.a (mgr.14388) 9600 : audit [DBG] from='client.212952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:21 smithi049 bash[23528]: audit 2024-09-21T01:56:20.464885+0000 mgr.a (mgr.14388) 9600 : audit [DBG] from='client.212952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:23.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:22 smithi179 bash[23186]: cluster 2024-09-21T01:56:21.803505+0000 mgr.a (mgr.14388) 9601 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:22 smithi044 bash[22676]: cluster 2024-09-21T01:56:21.803505+0000 mgr.a (mgr.14388) 9601 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:22 smithi049 bash[23528]: cluster 2024-09-21T01:56:21.803505+0000 mgr.a (mgr.14388) 9601 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:24 smithi044 bash[22676]: cluster 2024-09-21T01:56:23.804455+0000 mgr.a (mgr.14388) 9602 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:56:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:24 smithi179 bash[23186]: cluster 2024-09-21T01:56:23.804455+0000 mgr.a (mgr.14388) 9602 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:56:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:24 smithi049 bash[23528]: cluster 2024-09-21T01:56:23.804455+0000 mgr.a (mgr.14388) 9602 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:56:25.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:25.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:25.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:26.663 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:26.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:26.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:26.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:26.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:26 smithi044 bash[22676]: cluster 2024-09-21T01:56:25.806602+0000 mgr.a (mgr.14388) 9603 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:26 smithi179 bash[23186]: cluster 2024-09-21T01:56:25.806602+0000 mgr.a (mgr.14388) 9603 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:26 smithi049 bash[23528]: cluster 2024-09-21T01:56:25.806602+0000 mgr.a (mgr.14388) 9603 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:28.200 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22930]: debug 2024-09-21T01:56:28.141+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:56:28.200 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22930]: debug 2024-09-21T01:56:28.145+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:56:28.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:27 smithi044 bash[22676]: audit 2024-09-21T01:56:26.219471+0000 mgr.a (mgr.14388) 9604 : audit [DBG] from='client.213030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:28.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:27 smithi044 bash[22676]: audit 2024-09-21T01:56:27.361527+0000 mon.a (mon.0) 8017 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:56:28.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:27 smithi044 bash[22676]: audit 2024-09-21T01:56:27.369003+0000 mon.a (mon.0) 8018 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:56:28.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:27 smithi044 bash[22676]: audit 2024-09-21T01:56:27.370976+0000 mon.a (mon.0) 8019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:56:28.201 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:27 smithi044 bash[22676]: audit 2024-09-21T01:56:27.383609+0000 mon.a (mon.0) 8020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:28.201 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:27 smithi044 bash[22676]: audit 2024-09-21T01:56:27.390219+0000 mon.a (mon.0) 8021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:56:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:27 smithi179 bash[23186]: audit 2024-09-21T01:56:26.219471+0000 mgr.a (mgr.14388) 9604 : audit [DBG] from='client.213030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:27 smithi179 bash[23186]: audit 2024-09-21T01:56:27.361527+0000 mon.a (mon.0) 8017 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:56:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:27 smithi179 bash[23186]: audit 2024-09-21T01:56:27.369003+0000 mon.a (mon.0) 8018 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:56:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:27 smithi179 bash[23186]: audit 2024-09-21T01:56:27.370976+0000 mon.a (mon.0) 8019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:56:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:27 smithi179 bash[23186]: audit 2024-09-21T01:56:27.383609+0000 mon.a (mon.0) 8020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:27 smithi179 bash[23186]: audit 2024-09-21T01:56:27.390219+0000 mon.a (mon.0) 8021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:56:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:27 smithi049 bash[23528]: audit 2024-09-21T01:56:26.219471+0000 mgr.a (mgr.14388) 9604 : audit [DBG] from='client.213030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:27 smithi049 bash[23528]: audit 2024-09-21T01:56:27.361527+0000 mon.a (mon.0) 8017 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:56:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:27 smithi049 bash[23528]: audit 2024-09-21T01:56:27.369003+0000 mon.a (mon.0) 8018 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:56:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:27 smithi049 bash[23528]: audit 2024-09-21T01:56:27.370976+0000 mon.a (mon.0) 8019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:56:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:27 smithi049 bash[23528]: audit 2024-09-21T01:56:27.383609+0000 mon.a (mon.0) 8020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:27 smithi049 bash[23528]: audit 2024-09-21T01:56:27.390219+0000 mon.a (mon.0) 8021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:56:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: audit 2024-09-21T01:56:27.393176+0000 mgr.a (mgr.14388) 9605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:56:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: cluster 2024-09-21T01:56:27.807081+0000 mgr.a (mgr.14388) 9606 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:56:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: audit 2024-09-21T01:56:28.062096+0000 mon.a (mon.0) 8022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: audit 2024-09-21T01:56:28.068207+0000 mon.a (mon.0) 8023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: audit 2024-09-21T01:56:28.073857+0000 mon.a (mon.0) 8024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: audit 2024-09-21T01:56:28.179837+0000 mon.a (mon.0) 8025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: audit 2024-09-21T01:56:28.192534+0000 mon.a (mon.0) 8026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:28 smithi044 bash[22676]: audit 2024-09-21T01:56:28.200311+0000 mon.a (mon.0) 8027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: audit 2024-09-21T01:56:27.393176+0000 mgr.a (mgr.14388) 9605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:56:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: cluster 2024-09-21T01:56:27.807081+0000 mgr.a (mgr.14388) 9606 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:56:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: audit 2024-09-21T01:56:28.062096+0000 mon.a (mon.0) 8022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: audit 2024-09-21T01:56:28.068207+0000 mon.a (mon.0) 8023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: audit 2024-09-21T01:56:28.073857+0000 mon.a (mon.0) 8024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: audit 2024-09-21T01:56:28.179837+0000 mon.a (mon.0) 8025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: audit 2024-09-21T01:56:28.192534+0000 mon.a (mon.0) 8026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:28 smithi179 bash[23186]: audit 2024-09-21T01:56:28.200311+0000 mon.a (mon.0) 8027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: audit 2024-09-21T01:56:27.393176+0000 mgr.a (mgr.14388) 9605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:56:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: cluster 2024-09-21T01:56:27.807081+0000 mgr.a (mgr.14388) 9606 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:56:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: audit 2024-09-21T01:56:28.062096+0000 mon.a (mon.0) 8022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: audit 2024-09-21T01:56:28.068207+0000 mon.a (mon.0) 8023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: audit 2024-09-21T01:56:28.073857+0000 mon.a (mon.0) 8024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: audit 2024-09-21T01:56:28.179837+0000 mon.a (mon.0) 8025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: audit 2024-09-21T01:56:28.192534+0000 mon.a (mon.0) 8026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:28 smithi049 bash[23528]: audit 2024-09-21T01:56:28.200311+0000 mon.a (mon.0) 8027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:29 smithi044 bash[22676]: audit 2024-09-21T01:56:28.148633+0000 mgr.a (mgr.14388) 9607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:56:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:29 smithi044 bash[22676]: cephadm 2024-09-21T01:56:28.149595+0000 mgr.a (mgr.14388) 9608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:56:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:29 smithi179 bash[23186]: audit 2024-09-21T01:56:28.148633+0000 mgr.a (mgr.14388) 9607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:56:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:29 smithi179 bash[23186]: cephadm 2024-09-21T01:56:28.149595+0000 mgr.a (mgr.14388) 9608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:56:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:29 smithi049 bash[23528]: audit 2024-09-21T01:56:28.148633+0000 mgr.a (mgr.14388) 9607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:56:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:29 smithi049 bash[23528]: cephadm 2024-09-21T01:56:28.149595+0000 mgr.a (mgr.14388) 9608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:56:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:30 smithi044 bash[22676]: cluster 2024-09-21T01:56:29.807901+0000 mgr.a (mgr.14388) 9609 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:56:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:30 smithi179 bash[23186]: cluster 2024-09-21T01:56:29.807901+0000 mgr.a (mgr.14388) 9609 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:56:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:30 smithi049 bash[23528]: cluster 2024-09-21T01:56:29.807901+0000 mgr.a (mgr.14388) 9609 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:56:31.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:31.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:31.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:32.433 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:32.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:32.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:32.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:32.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:32 smithi044 bash[22676]: cluster 2024-09-21T01:56:31.809731+0000 mgr.a (mgr.14388) 9610 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:32 smithi179 bash[23186]: cluster 2024-09-21T01:56:31.809731+0000 mgr.a (mgr.14388) 9610 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:32 smithi049 bash[23528]: cluster 2024-09-21T01:56:31.809731+0000 mgr.a (mgr.14388) 9610 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:33 smithi044 bash[22676]: audit 2024-09-21T01:56:32.000414+0000 mgr.a (mgr.14388) 9611 : audit [DBG] from='client.213216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:33 smithi179 bash[23186]: audit 2024-09-21T01:56:32.000414+0000 mgr.a (mgr.14388) 9611 : audit [DBG] from='client.213216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:33 smithi049 bash[23528]: audit 2024-09-21T01:56:32.000414+0000 mgr.a (mgr.14388) 9611 : audit [DBG] from='client.213216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:35.209 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:34 smithi044 bash[22676]: cluster 2024-09-21T01:56:33.810711+0000 mgr.a (mgr.14388) 9612 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:34 smithi179 bash[23186]: cluster 2024-09-21T01:56:33.810711+0000 mgr.a (mgr.14388) 9612 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:34 smithi049 bash[23528]: cluster 2024-09-21T01:56:33.810711+0000 mgr.a (mgr.14388) 9612 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:35 smithi044 bash[22676]: audit 2024-09-21T01:56:34.985545+0000 mon.a (mon.0) 8028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:35 smithi044 bash[22676]: audit 2024-09-21T01:56:34.991365+0000 mon.a (mon.0) 8029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:35 smithi044 bash[22676]: audit 2024-09-21T01:56:34.998153+0000 mon.a (mon.0) 8030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:35 smithi044 bash[22676]: cluster 2024-09-21T01:56:35.812980+0000 mgr.a (mgr.14388) 9613 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:35 smithi179 bash[23186]: audit 2024-09-21T01:56:34.985545+0000 mon.a (mon.0) 8028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:35 smithi179 bash[23186]: audit 2024-09-21T01:56:34.991365+0000 mon.a (mon.0) 8029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:35 smithi179 bash[23186]: audit 2024-09-21T01:56:34.998153+0000 mon.a (mon.0) 8030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:35 smithi179 bash[23186]: cluster 2024-09-21T01:56:35.812980+0000 mgr.a (mgr.14388) 9613 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:35 smithi049 bash[23528]: audit 2024-09-21T01:56:34.985545+0000 mon.a (mon.0) 8028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:35 smithi049 bash[23528]: audit 2024-09-21T01:56:34.991365+0000 mon.a (mon.0) 8029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:35 smithi049 bash[23528]: audit 2024-09-21T01:56:34.998153+0000 mon.a (mon.0) 8030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:35 smithi049 bash[23528]: cluster 2024-09-21T01:56:35.812980+0000 mgr.a (mgr.14388) 9613 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:37.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:37.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:37.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:38.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:38.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:38 smithi044 bash[22676]: audit 2024-09-21T01:56:37.768958+0000 mgr.a (mgr.14388) 9614 : audit [DBG] from='client.213291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:38 smithi044 bash[22676]: cluster 2024-09-21T01:56:37.814058+0000 mgr.a (mgr.14388) 9615 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:38 smithi179 bash[23186]: audit 2024-09-21T01:56:37.768958+0000 mgr.a (mgr.14388) 9614 : audit [DBG] from='client.213291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:38 smithi179 bash[23186]: cluster 2024-09-21T01:56:37.814058+0000 mgr.a (mgr.14388) 9615 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:38 smithi049 bash[23528]: audit 2024-09-21T01:56:37.768958+0000 mgr.a (mgr.14388) 9614 : audit [DBG] from='client.213291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:38 smithi049 bash[23528]: cluster 2024-09-21T01:56:37.814058+0000 mgr.a (mgr.14388) 9615 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:40 smithi044 bash[22676]: cluster 2024-09-21T01:56:39.815070+0000 mgr.a (mgr.14388) 9616 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:40 smithi179 bash[23186]: cluster 2024-09-21T01:56:39.815070+0000 mgr.a (mgr.14388) 9616 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:40 smithi049 bash[23528]: cluster 2024-09-21T01:56:39.815070+0000 mgr.a (mgr.14388) 9616 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:43.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:42 smithi179 bash[23186]: cluster 2024-09-21T01:56:41.817354+0000 mgr.a (mgr.14388) 9617 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:43.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:42 smithi044 bash[22676]: cluster 2024-09-21T01:56:41.817354+0000 mgr.a (mgr.14388) 9617 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:42 smithi049 bash[23528]: cluster 2024-09-21T01:56:41.817354+0000 mgr.a (mgr.14388) 9617 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:56:44.001 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:44 smithi044 bash[22676]: audit 2024-09-21T01:56:43.554923+0000 mgr.a (mgr.14388) 9618 : audit [DBG] from='client.213369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:44 smithi044 bash[22676]: cluster 2024-09-21T01:56:43.817926+0000 mgr.a (mgr.14388) 9619 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:44 smithi179 bash[23186]: audit 2024-09-21T01:56:43.554923+0000 mgr.a (mgr.14388) 9618 : audit [DBG] from='client.213369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:44 smithi179 bash[23186]: cluster 2024-09-21T01:56:43.817926+0000 mgr.a (mgr.14388) 9619 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:44 smithi049 bash[23528]: audit 2024-09-21T01:56:43.554923+0000 mgr.a (mgr.14388) 9618 : audit [DBG] from='client.213369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:44 smithi049 bash[23528]: cluster 2024-09-21T01:56:43.817926+0000 mgr.a (mgr.14388) 9619 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:46 smithi044 bash[22676]: cluster 2024-09-21T01:56:45.820183+0000 mgr.a (mgr.14388) 9620 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:56:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:46 smithi179 bash[23186]: cluster 2024-09-21T01:56:45.820183+0000 mgr.a (mgr.14388) 9620 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:56:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:46 smithi049 bash[23528]: cluster 2024-09-21T01:56:45.820183+0000 mgr.a (mgr.14388) 9620 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:56:49.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:49.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:49.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:48 smithi044 bash[22676]: cluster 2024-09-21T01:56:47.820964+0000 mgr.a (mgr.14388) 9621 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:48 smithi044 bash[22676]: audit 2024-09-21T01:56:48.268240+0000 mon.a (mon.0) 8031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:48 smithi044 bash[22676]: audit 2024-09-21T01:56:48.274962+0000 mon.a (mon.0) 8032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:48 smithi044 bash[22676]: audit 2024-09-21T01:56:48.283689+0000 mon.a (mon.0) 8033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:48 smithi044 bash[22676]: audit 2024-09-21T01:56:48.376560+0000 mon.a (mon.0) 8034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:48 smithi044 bash[22676]: audit 2024-09-21T01:56:48.381442+0000 mon.a (mon.0) 8035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:48 smithi044 bash[22676]: audit 2024-09-21T01:56:48.389620+0000 mon.a (mon.0) 8036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:48 smithi179 bash[23186]: cluster 2024-09-21T01:56:47.820964+0000 mgr.a (mgr.14388) 9621 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:48 smithi179 bash[23186]: audit 2024-09-21T01:56:48.268240+0000 mon.a (mon.0) 8031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:48 smithi179 bash[23186]: audit 2024-09-21T01:56:48.274962+0000 mon.a (mon.0) 8032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:48 smithi179 bash[23186]: audit 2024-09-21T01:56:48.283689+0000 mon.a (mon.0) 8033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:48 smithi179 bash[23186]: audit 2024-09-21T01:56:48.376560+0000 mon.a (mon.0) 8034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:48 smithi179 bash[23186]: audit 2024-09-21T01:56:48.381442+0000 mon.a (mon.0) 8035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:48 smithi179 bash[23186]: audit 2024-09-21T01:56:48.389620+0000 mon.a (mon.0) 8036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:48 smithi049 bash[23528]: cluster 2024-09-21T01:56:47.820964+0000 mgr.a (mgr.14388) 9621 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:48 smithi049 bash[23528]: audit 2024-09-21T01:56:48.268240+0000 mon.a (mon.0) 8031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:48 smithi049 bash[23528]: audit 2024-09-21T01:56:48.274962+0000 mon.a (mon.0) 8032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:48 smithi049 bash[23528]: audit 2024-09-21T01:56:48.283689+0000 mon.a (mon.0) 8033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:48 smithi049 bash[23528]: audit 2024-09-21T01:56:48.376560+0000 mon.a (mon.0) 8034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:48 smithi049 bash[23528]: audit 2024-09-21T01:56:48.381442+0000 mon.a (mon.0) 8035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:48 smithi049 bash[23528]: audit 2024-09-21T01:56:48.389620+0000 mon.a (mon.0) 8036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:49.788 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:49.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:50 smithi044 bash[22676]: audit 2024-09-21T01:56:49.346335+0000 mgr.a (mgr.14388) 9622 : audit [DBG] from='client.213447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:50 smithi044 bash[22676]: cluster 2024-09-21T01:56:49.821654+0000 mgr.a (mgr.14388) 9623 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:50 smithi179 bash[23186]: audit 2024-09-21T01:56:49.346335+0000 mgr.a (mgr.14388) 9622 : audit [DBG] from='client.213447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:50 smithi179 bash[23186]: cluster 2024-09-21T01:56:49.821654+0000 mgr.a (mgr.14388) 9623 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:50 smithi049 bash[23528]: audit 2024-09-21T01:56:49.346335+0000 mgr.a (mgr.14388) 9622 : audit [DBG] from='client.213447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:50 smithi049 bash[23528]: cluster 2024-09-21T01:56:49.821654+0000 mgr.a (mgr.14388) 9623 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:52 smithi044 bash[22676]: cluster 2024-09-21T01:56:51.823881+0000 mgr.a (mgr.14388) 9624 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:56:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:52 smithi179 bash[23186]: cluster 2024-09-21T01:56:51.823881+0000 mgr.a (mgr.14388) 9624 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:56:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:52 smithi049 bash[23528]: cluster 2024-09-21T01:56:51.823881+0000 mgr.a (mgr.14388) 9624 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:56:54.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:56:54.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:56:54.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:56:55.161 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:54 smithi049 bash[23528]: cluster 2024-09-21T01:56:53.824674+0000 mgr.a (mgr.14388) 9625 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:54 smithi044 bash[22676]: cluster 2024-09-21T01:56:53.824674+0000 mgr.a (mgr.14388) 9625 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:54 smithi179 bash[23186]: cluster 2024-09-21T01:56:53.824674+0000 mgr.a (mgr.14388) 9625 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:56:55.540 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:56:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:56:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:56:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:56:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:56:56.483 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:56 smithi049 bash[23528]: audit 2024-09-21T01:56:55.120613+0000 mgr.a (mgr.14388) 9626 : audit [DBG] from='client.213525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:56.483 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:56 smithi049 bash[23528]: audit 2024-09-21T01:56:55.146794+0000 mon.a (mon.0) 8037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.483 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:56 smithi049 bash[23528]: audit 2024-09-21T01:56:55.153059+0000 mon.a (mon.0) 8038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.483 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:56 smithi049 bash[23528]: audit 2024-09-21T01:56:55.160364+0000 mon.a (mon.0) 8039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.484 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:56 smithi049 bash[23528]: cluster 2024-09-21T01:56:55.827476+0000 mgr.a (mgr.14388) 9627 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:56:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:56 smithi044 bash[22676]: audit 2024-09-21T01:56:55.120613+0000 mgr.a (mgr.14388) 9626 : audit [DBG] from='client.213525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:56 smithi044 bash[22676]: audit 2024-09-21T01:56:55.146794+0000 mon.a (mon.0) 8037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:56 smithi044 bash[22676]: audit 2024-09-21T01:56:55.153059+0000 mon.a (mon.0) 8038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:56 smithi044 bash[22676]: audit 2024-09-21T01:56:55.160364+0000 mon.a (mon.0) 8039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:56 smithi044 bash[22676]: cluster 2024-09-21T01:56:55.827476+0000 mgr.a (mgr.14388) 9627 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:56:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:56 smithi179 bash[23186]: audit 2024-09-21T01:56:55.120613+0000 mgr.a (mgr.14388) 9626 : audit [DBG] from='client.213525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:56:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:56 smithi179 bash[23186]: audit 2024-09-21T01:56:55.146794+0000 mon.a (mon.0) 8037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:56 smithi179 bash[23186]: audit 2024-09-21T01:56:55.153059+0000 mon.a (mon.0) 8038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:56 smithi179 bash[23186]: audit 2024-09-21T01:56:55.160364+0000 mon.a (mon.0) 8039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:56:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:56 smithi179 bash[23186]: cluster 2024-09-21T01:56:55.827476+0000 mgr.a (mgr.14388) 9627 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:56:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:56:58 smithi049 bash[23528]: cluster 2024-09-21T01:56:57.828287+0000 mgr.a (mgr.14388) 9628 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:56:58 smithi044 bash[22676]: cluster 2024-09-21T01:56:57.828287+0000 mgr.a (mgr.14388) 9628 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:56:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:56:58 smithi179 bash[23186]: cluster 2024-09-21T01:56:57.828287+0000 mgr.a (mgr.14388) 9628 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:57:00.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:00.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:00.542 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:00 smithi044 bash[22676]: cluster 2024-09-21T01:56:59.829067+0000 mgr.a (mgr.14388) 9629 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:57:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:00 smithi179 bash[23186]: cluster 2024-09-21T01:56:59.829067+0000 mgr.a (mgr.14388) 9629 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:57:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:00 smithi049 bash[23528]: cluster 2024-09-21T01:56:59.829067+0000 mgr.a (mgr.14388) 9629 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:57:01.305 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:01.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:01.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:01 smithi044 bash[22676]: audit 2024-09-21T01:57:00.881637+0000 mgr.a (mgr.14388) 9630 : audit [DBG] from='client.213603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:02.242 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:01 smithi179 bash[23186]: audit 2024-09-21T01:57:00.881637+0000 mgr.a (mgr.14388) 9630 : audit [DBG] from='client.213603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:02.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:01 smithi049 bash[23528]: audit 2024-09-21T01:57:00.881637+0000 mgr.a (mgr.14388) 9630 : audit [DBG] from='client.213603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:03.170 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:02 smithi179 bash[23186]: cluster 2024-09-21T01:57:01.831940+0000 mgr.a (mgr.14388) 9631 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:57:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:02 smithi044 bash[22676]: cluster 2024-09-21T01:57:01.831940+0000 mgr.a (mgr.14388) 9631 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:57:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:02 smithi049 bash[23528]: cluster 2024-09-21T01:57:01.831940+0000 mgr.a (mgr.14388) 9631 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:57:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:04 smithi044 bash[22676]: cluster 2024-09-21T01:57:03.832759+0000 mgr.a (mgr.14388) 9632 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:57:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:04 smithi179 bash[23186]: cluster 2024-09-21T01:57:03.832759+0000 mgr.a (mgr.14388) 9632 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:57:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:04 smithi049 bash[23528]: cluster 2024-09-21T01:57:03.832759+0000 mgr.a (mgr.14388) 9632 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T01:57:06.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:06.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:06.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:07.069 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:07.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:07.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:07.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:07.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:06 smithi044 bash[22676]: cluster 2024-09-21T01:57:05.834799+0000 mgr.a (mgr.14388) 9633 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:57:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:06 smithi179 bash[23186]: cluster 2024-09-21T01:57:05.834799+0000 mgr.a (mgr.14388) 9633 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:57:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:06 smithi049 bash[23528]: cluster 2024-09-21T01:57:05.834799+0000 mgr.a (mgr.14388) 9633 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T01:57:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:07 smithi044 bash[22676]: audit 2024-09-21T01:57:06.640945+0000 mgr.a (mgr.14388) 9634 : audit [DBG] from='client.213681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:07 smithi179 bash[23186]: audit 2024-09-21T01:57:06.640945+0000 mgr.a (mgr.14388) 9634 : audit [DBG] from='client.213681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:07 smithi049 bash[23528]: audit 2024-09-21T01:57:06.640945+0000 mgr.a (mgr.14388) 9634 : audit [DBG] from='client.213681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:08 smithi044 bash[22676]: cluster 2024-09-21T01:57:07.835846+0000 mgr.a (mgr.14388) 9635 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:08 smithi044 bash[22676]: audit 2024-09-21T01:57:08.496384+0000 mon.a (mon.0) 8040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:08 smithi044 bash[22676]: audit 2024-09-21T01:57:08.503414+0000 mon.a (mon.0) 8041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:08 smithi044 bash[22676]: audit 2024-09-21T01:57:08.512310+0000 mon.a (mon.0) 8042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:08 smithi044 bash[22676]: audit 2024-09-21T01:57:08.578845+0000 mon.a (mon.0) 8043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:08 smithi044 bash[22676]: audit 2024-09-21T01:57:08.584944+0000 mon.a (mon.0) 8044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:08 smithi044 bash[22676]: audit 2024-09-21T01:57:08.591788+0000 mon.a (mon.0) 8045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:08 smithi179 bash[23186]: cluster 2024-09-21T01:57:07.835846+0000 mgr.a (mgr.14388) 9635 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:08 smithi179 bash[23186]: audit 2024-09-21T01:57:08.496384+0000 mon.a (mon.0) 8040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:08 smithi179 bash[23186]: audit 2024-09-21T01:57:08.503414+0000 mon.a (mon.0) 8041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:08 smithi179 bash[23186]: audit 2024-09-21T01:57:08.512310+0000 mon.a (mon.0) 8042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:08 smithi179 bash[23186]: audit 2024-09-21T01:57:08.578845+0000 mon.a (mon.0) 8043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:08 smithi179 bash[23186]: audit 2024-09-21T01:57:08.584944+0000 mon.a (mon.0) 8044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:08 smithi179 bash[23186]: audit 2024-09-21T01:57:08.591788+0000 mon.a (mon.0) 8045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:08 smithi049 bash[23528]: cluster 2024-09-21T01:57:07.835846+0000 mgr.a (mgr.14388) 9635 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:08 smithi049 bash[23528]: audit 2024-09-21T01:57:08.496384+0000 mon.a (mon.0) 8040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:08 smithi049 bash[23528]: audit 2024-09-21T01:57:08.503414+0000 mon.a (mon.0) 8041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:08 smithi049 bash[23528]: audit 2024-09-21T01:57:08.512310+0000 mon.a (mon.0) 8042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:08 smithi049 bash[23528]: audit 2024-09-21T01:57:08.578845+0000 mon.a (mon.0) 8043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:08 smithi049 bash[23528]: audit 2024-09-21T01:57:08.584944+0000 mon.a (mon.0) 8044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:08 smithi049 bash[23528]: audit 2024-09-21T01:57:08.591788+0000 mon.a (mon.0) 8045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:10 smithi044 bash[22676]: cluster 2024-09-21T01:57:09.836625+0000 mgr.a (mgr.14388) 9636 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:10 smithi179 bash[23186]: cluster 2024-09-21T01:57:09.836625+0000 mgr.a (mgr.14388) 9636 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:10 smithi049 bash[23528]: cluster 2024-09-21T01:57:09.836625+0000 mgr.a (mgr.14388) 9636 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:12.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:12.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:12.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:12.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:12.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:12.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:12.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:12.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:13.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:12 smithi044 bash[22676]: cluster 2024-09-21T01:57:11.838869+0000 mgr.a (mgr.14388) 9637 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:12 smithi179 bash[23186]: cluster 2024-09-21T01:57:11.838869+0000 mgr.a (mgr.14388) 9637 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:12 smithi049 bash[23528]: cluster 2024-09-21T01:57:11.838869+0000 mgr.a (mgr.14388) 9637 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:13 smithi044 bash[22676]: audit 2024-09-21T01:57:12.407765+0000 mgr.a (mgr.14388) 9638 : audit [DBG] from='client.213756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:13 smithi179 bash[23186]: audit 2024-09-21T01:57:12.407765+0000 mgr.a (mgr.14388) 9638 : audit [DBG] from='client.213756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:13 smithi049 bash[23528]: audit 2024-09-21T01:57:12.407765+0000 mgr.a (mgr.14388) 9638 : audit [DBG] from='client.213756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:14 smithi044 bash[22676]: cluster 2024-09-21T01:57:13.839859+0000 mgr.a (mgr.14388) 9639 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:14 smithi179 bash[23186]: cluster 2024-09-21T01:57:13.839859+0000 mgr.a (mgr.14388) 9639 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:14 smithi049 bash[23528]: cluster 2024-09-21T01:57:13.839859+0000 mgr.a (mgr.14388) 9639 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:16.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:16 smithi049 bash[23528]: audit 2024-09-21T01:57:15.358226+0000 mon.a (mon.0) 8046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:16 smithi049 bash[23528]: audit 2024-09-21T01:57:15.367438+0000 mon.a (mon.0) 8047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.649 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:16 smithi049 bash[23528]: audit 2024-09-21T01:57:15.377016+0000 mon.a (mon.0) 8048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.649 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:16 smithi049 bash[23528]: cluster 2024-09-21T01:57:15.842155+0000 mgr.a (mgr.14388) 9640 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:16 smithi044 bash[22676]: audit 2024-09-21T01:57:15.358226+0000 mon.a (mon.0) 8046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:16 smithi044 bash[22676]: audit 2024-09-21T01:57:15.367438+0000 mon.a (mon.0) 8047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:16 smithi044 bash[22676]: audit 2024-09-21T01:57:15.377016+0000 mon.a (mon.0) 8048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:16 smithi044 bash[22676]: cluster 2024-09-21T01:57:15.842155+0000 mgr.a (mgr.14388) 9640 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:16 smithi179 bash[23186]: audit 2024-09-21T01:57:15.358226+0000 mon.a (mon.0) 8046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:16 smithi179 bash[23186]: audit 2024-09-21T01:57:15.367438+0000 mon.a (mon.0) 8047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:16 smithi179 bash[23186]: audit 2024-09-21T01:57:15.377016+0000 mon.a (mon.0) 8048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:16 smithi179 bash[23186]: cluster 2024-09-21T01:57:15.842155+0000 mgr.a (mgr.14388) 9640 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:17.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:17.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:17.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:18.593 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:18.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:18.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:18.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:18.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:18 smithi044 bash[22676]: cluster 2024-09-21T01:57:17.842952+0000 mgr.a (mgr.14388) 9641 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:18 smithi179 bash[23186]: cluster 2024-09-21T01:57:17.842952+0000 mgr.a (mgr.14388) 9641 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:19.254 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:18 smithi049 bash[23528]: cluster 2024-09-21T01:57:17.842952+0000 mgr.a (mgr.14388) 9641 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:19 smithi044 bash[22676]: audit 2024-09-21T01:57:18.166124+0000 mgr.a (mgr.14388) 9642 : audit [DBG] from='client.213834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:19 smithi179 bash[23186]: audit 2024-09-21T01:57:18.166124+0000 mgr.a (mgr.14388) 9642 : audit [DBG] from='client.213834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:19 smithi049 bash[23528]: audit 2024-09-21T01:57:18.166124+0000 mgr.a (mgr.14388) 9642 : audit [DBG] from='client.213834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:20 smithi044 bash[22676]: cluster 2024-09-21T01:57:19.843886+0000 mgr.a (mgr.14388) 9643 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:20 smithi179 bash[23186]: cluster 2024-09-21T01:57:19.843886+0000 mgr.a (mgr.14388) 9643 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:20 smithi049 bash[23528]: cluster 2024-09-21T01:57:19.843886+0000 mgr.a (mgr.14388) 9643 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:22 smithi044 bash[22676]: cluster 2024-09-21T01:57:21.846156+0000 mgr.a (mgr.14388) 9644 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:22 smithi179 bash[23186]: cluster 2024-09-21T01:57:21.846156+0000 mgr.a (mgr.14388) 9644 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:22 smithi049 bash[23528]: cluster 2024-09-21T01:57:21.846156+0000 mgr.a (mgr.14388) 9644 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:24.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:24.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:24.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:24.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:24.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:24 smithi044 bash[22676]: cluster 2024-09-21T01:57:23.847023+0000 mgr.a (mgr.14388) 9645 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:24 smithi044 bash[22676]: audit 2024-09-21T01:57:23.934234+0000 mgr.a (mgr.14388) 9646 : audit [DBG] from='client.213909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:24 smithi179 bash[23186]: cluster 2024-09-21T01:57:23.847023+0000 mgr.a (mgr.14388) 9645 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:24 smithi179 bash[23186]: audit 2024-09-21T01:57:23.934234+0000 mgr.a (mgr.14388) 9646 : audit [DBG] from='client.213909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:24 smithi049 bash[23528]: cluster 2024-09-21T01:57:23.847023+0000 mgr.a (mgr.14388) 9645 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:24 smithi049 bash[23528]: audit 2024-09-21T01:57:23.934234+0000 mgr.a (mgr.14388) 9646 : audit [DBG] from='client.213909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:26 smithi044 bash[22676]: cluster 2024-09-21T01:57:25.849448+0000 mgr.a (mgr.14388) 9647 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:26 smithi179 bash[23186]: cluster 2024-09-21T01:57:25.849448+0000 mgr.a (mgr.14388) 9647 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:26 smithi049 bash[23528]: cluster 2024-09-21T01:57:25.849448+0000 mgr.a (mgr.14388) 9647 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: cluster 2024-09-21T01:57:27.850394+0000 mgr.a (mgr.14388) 9648 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.206625+0000 mon.a (mon.0) 8049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.213612+0000 mon.a (mon.0) 8050 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.215626+0000 mon.a (mon.0) 8051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.227121+0000 mon.a (mon.0) 8052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.234250+0000 mon.a (mon.0) 8053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.703655+0000 mon.a (mon.0) 8054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.716809+0000 mon.a (mon.0) 8055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.722542+0000 mon.a (mon.0) 8056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.729871+0000 mon.a (mon.0) 8057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.736810+0000 mon.a (mon.0) 8058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:28 smithi179 bash[23186]: audit 2024-09-21T01:57:28.744391+0000 mon.a (mon.0) 8059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: cluster 2024-09-21T01:57:27.850394+0000 mgr.a (mgr.14388) 9648 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.206625+0000 mon.a (mon.0) 8049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.213612+0000 mon.a (mon.0) 8050 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.215626+0000 mon.a (mon.0) 8051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.227121+0000 mon.a (mon.0) 8052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.234250+0000 mon.a (mon.0) 8053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.703655+0000 mon.a (mon.0) 8054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.716809+0000 mon.a (mon.0) 8055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.722542+0000 mon.a (mon.0) 8056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.729871+0000 mon.a (mon.0) 8057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.736810+0000 mon.a (mon.0) 8058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:28 smithi044 bash[22676]: audit 2024-09-21T01:57:28.744391+0000 mon.a (mon.0) 8059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: cluster 2024-09-21T01:57:27.850394+0000 mgr.a (mgr.14388) 9648 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.206625+0000 mon.a (mon.0) 8049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:57:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.213612+0000 mon.a (mon.0) 8050 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:57:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.215626+0000 mon.a (mon.0) 8051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.227121+0000 mon.a (mon.0) 8052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.234250+0000 mon.a (mon.0) 8053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.703655+0000 mon.a (mon.0) 8054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.716809+0000 mon.a (mon.0) 8055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.722542+0000 mon.a (mon.0) 8056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.729871+0000 mon.a (mon.0) 8057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.736810+0000 mon.a (mon.0) 8058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:28 smithi049 bash[23528]: audit 2024-09-21T01:57:28.744391+0000 mon.a (mon.0) 8059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:29.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:29.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:29.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:29.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:57:29 smithi044 bash[22930]: debug 2024-09-21T01:57:29.016+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:57:29.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:57:29 smithi044 bash[22930]: debug 2024-09-21T01:57:29.016+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:57:30.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:30.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:29 smithi044 bash[22676]: audit 2024-09-21T01:57:28.236652+0000 mgr.a (mgr.14388) 9649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:57:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:29 smithi179 bash[23186]: audit 2024-09-21T01:57:28.236652+0000 mgr.a (mgr.14388) 9649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:57:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:29 smithi049 bash[23528]: audit 2024-09-21T01:57:28.236652+0000 mgr.a (mgr.14388) 9649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:57:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:30 smithi044 bash[22676]: audit 2024-09-21T01:57:29.018261+0000 mgr.a (mgr.14388) 9650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:57:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:30 smithi044 bash[22676]: cephadm 2024-09-21T01:57:29.019622+0000 mgr.a (mgr.14388) 9651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:57:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:30 smithi044 bash[22676]: audit 2024-09-21T01:57:29.704457+0000 mgr.a (mgr.14388) 9652 : audit [DBG] from='client.214095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:30 smithi044 bash[22676]: cluster 2024-09-21T01:57:29.851076+0000 mgr.a (mgr.14388) 9653 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:30 smithi179 bash[23186]: audit 2024-09-21T01:57:29.018261+0000 mgr.a (mgr.14388) 9650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:57:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:30 smithi179 bash[23186]: cephadm 2024-09-21T01:57:29.019622+0000 mgr.a (mgr.14388) 9651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:57:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:30 smithi179 bash[23186]: audit 2024-09-21T01:57:29.704457+0000 mgr.a (mgr.14388) 9652 : audit [DBG] from='client.214095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:30 smithi179 bash[23186]: cluster 2024-09-21T01:57:29.851076+0000 mgr.a (mgr.14388) 9653 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:30 smithi049 bash[23528]: audit 2024-09-21T01:57:29.018261+0000 mgr.a (mgr.14388) 9650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:57:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:30 smithi049 bash[23528]: cephadm 2024-09-21T01:57:29.019622+0000 mgr.a (mgr.14388) 9651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:57:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:30 smithi049 bash[23528]: audit 2024-09-21T01:57:29.704457+0000 mgr.a (mgr.14388) 9652 : audit [DBG] from='client.214095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:30 smithi049 bash[23528]: cluster 2024-09-21T01:57:29.851076+0000 mgr.a (mgr.14388) 9653 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:32 smithi049 bash[23528]: cluster 2024-09-21T01:57:31.853441+0000 mgr.a (mgr.14388) 9654 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:32 smithi044 bash[22676]: cluster 2024-09-21T01:57:31.853441+0000 mgr.a (mgr.14388) 9654 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:32 smithi179 bash[23186]: cluster 2024-09-21T01:57:31.853441+0000 mgr.a (mgr.14388) 9654 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:35.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:34 smithi044 bash[22676]: cluster 2024-09-21T01:57:33.854279+0000 mgr.a (mgr.14388) 9655 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:34 smithi179 bash[23186]: cluster 2024-09-21T01:57:33.854279+0000 mgr.a (mgr.14388) 9655 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:34 smithi049 bash[23528]: cluster 2024-09-21T01:57:33.854279+0000 mgr.a (mgr.14388) 9655 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:35.890 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:35.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:35.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:35.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:35.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:36.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:36 smithi049 bash[23528]: audit 2024-09-21T01:57:35.451546+0000 mgr.a (mgr.14388) 9656 : audit [DBG] from='client.214173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:36.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:36 smithi049 bash[23528]: audit 2024-09-21T01:57:35.571936+0000 mon.a (mon.0) 8060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:36.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:36 smithi049 bash[23528]: audit 2024-09-21T01:57:35.579262+0000 mon.a (mon.0) 8061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:36.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:36 smithi049 bash[23528]: audit 2024-09-21T01:57:35.587782+0000 mon.a (mon.0) 8062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:36.856 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:36 smithi049 bash[23528]: cluster 2024-09-21T01:57:35.855810+0000 mgr.a (mgr.14388) 9657 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:36 smithi044 bash[22676]: audit 2024-09-21T01:57:35.451546+0000 mgr.a (mgr.14388) 9656 : audit [DBG] from='client.214173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:36 smithi044 bash[22676]: audit 2024-09-21T01:57:35.571936+0000 mon.a (mon.0) 8060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:36 smithi044 bash[22676]: audit 2024-09-21T01:57:35.579262+0000 mon.a (mon.0) 8061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:36 smithi044 bash[22676]: audit 2024-09-21T01:57:35.587782+0000 mon.a (mon.0) 8062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:36 smithi044 bash[22676]: cluster 2024-09-21T01:57:35.855810+0000 mgr.a (mgr.14388) 9657 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:36 smithi179 bash[23186]: audit 2024-09-21T01:57:35.451546+0000 mgr.a (mgr.14388) 9656 : audit [DBG] from='client.214173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:36 smithi179 bash[23186]: audit 2024-09-21T01:57:35.571936+0000 mon.a (mon.0) 8060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:36 smithi179 bash[23186]: audit 2024-09-21T01:57:35.579262+0000 mon.a (mon.0) 8061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:36 smithi179 bash[23186]: audit 2024-09-21T01:57:35.587782+0000 mon.a (mon.0) 8062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:36 smithi179 bash[23186]: cluster 2024-09-21T01:57:35.855810+0000 mgr.a (mgr.14388) 9657 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:38 smithi049 bash[23528]: cluster 2024-09-21T01:57:37.856558+0000 mgr.a (mgr.14388) 9658 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:38 smithi044 bash[22676]: cluster 2024-09-21T01:57:37.856558+0000 mgr.a (mgr.14388) 9658 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:38 smithi179 bash[23186]: cluster 2024-09-21T01:57:37.856558+0000 mgr.a (mgr.14388) 9658 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:40 smithi044 bash[22676]: cluster 2024-09-21T01:57:39.857369+0000 mgr.a (mgr.14388) 9659 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:40 smithi179 bash[23186]: cluster 2024-09-21T01:57:39.857369+0000 mgr.a (mgr.14388) 9659 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:40 smithi049 bash[23528]: cluster 2024-09-21T01:57:39.857369+0000 mgr.a (mgr.14388) 9659 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:57:41.675 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:41.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:41.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:41.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:41.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:42 smithi044 bash[22676]: audit 2024-09-21T01:57:41.229104+0000 mgr.a (mgr.14388) 9660 : audit [DBG] from='client.214251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:42 smithi044 bash[22676]: cluster 2024-09-21T01:57:41.860238+0000 mgr.a (mgr.14388) 9661 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:42 smithi179 bash[23186]: audit 2024-09-21T01:57:41.229104+0000 mgr.a (mgr.14388) 9660 : audit [DBG] from='client.214251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:42 smithi179 bash[23186]: cluster 2024-09-21T01:57:41.860238+0000 mgr.a (mgr.14388) 9661 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:43.311 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:42 smithi049 bash[23528]: audit 2024-09-21T01:57:41.229104+0000 mgr.a (mgr.14388) 9660 : audit [DBG] from='client.214251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:43.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:42 smithi049 bash[23528]: cluster 2024-09-21T01:57:41.860238+0000 mgr.a (mgr.14388) 9661 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:57:45.185 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:44 smithi179 bash[23186]: cluster 2024-09-21T01:57:43.861048+0000 mgr.a (mgr.14388) 9662 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:57:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:44 smithi044 bash[22676]: cluster 2024-09-21T01:57:43.861048+0000 mgr.a (mgr.14388) 9662 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:57:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:44 smithi049 bash[23528]: cluster 2024-09-21T01:57:43.861048+0000 mgr.a (mgr.14388) 9662 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:57:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:46 smithi044 bash[22676]: cluster 2024-09-21T01:57:45.863241+0000 mgr.a (mgr.14388) 9663 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:57:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:46 smithi179 bash[23186]: cluster 2024-09-21T01:57:45.863241+0000 mgr.a (mgr.14388) 9663 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:57:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:46 smithi049 bash[23528]: cluster 2024-09-21T01:57:45.863241+0000 mgr.a (mgr.14388) 9663 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:57:47.460 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:47.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:47.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:47.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:47.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:48 smithi044 bash[22676]: audit 2024-09-21T01:57:47.013987+0000 mgr.a (mgr.14388) 9664 : audit [DBG] from='client.214329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:48 smithi044 bash[22676]: cluster 2024-09-21T01:57:47.864241+0000 mgr.a (mgr.14388) 9665 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:48 smithi179 bash[23186]: audit 2024-09-21T01:57:47.013987+0000 mgr.a (mgr.14388) 9664 : audit [DBG] from='client.214329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:48 smithi179 bash[23186]: cluster 2024-09-21T01:57:47.864241+0000 mgr.a (mgr.14388) 9665 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:48 smithi049 bash[23528]: audit 2024-09-21T01:57:47.013987+0000 mgr.a (mgr.14388) 9664 : audit [DBG] from='client.214329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:48 smithi049 bash[23528]: cluster 2024-09-21T01:57:47.864241+0000 mgr.a (mgr.14388) 9665 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:49 smithi044 bash[22676]: audit 2024-09-21T01:57:48.951047+0000 mon.a (mon.0) 8063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:49 smithi044 bash[22676]: audit 2024-09-21T01:57:48.960194+0000 mon.a (mon.0) 8064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:49 smithi044 bash[22676]: audit 2024-09-21T01:57:48.967259+0000 mon.a (mon.0) 8065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:49 smithi044 bash[22676]: audit 2024-09-21T01:57:48.974379+0000 mon.a (mon.0) 8066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:49 smithi044 bash[22676]: audit 2024-09-21T01:57:48.980831+0000 mon.a (mon.0) 8067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:49 smithi044 bash[22676]: audit 2024-09-21T01:57:48.990674+0000 mon.a (mon.0) 8068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:49 smithi179 bash[23186]: audit 2024-09-21T01:57:48.951047+0000 mon.a (mon.0) 8063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:49 smithi179 bash[23186]: audit 2024-09-21T01:57:48.960194+0000 mon.a (mon.0) 8064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:49 smithi179 bash[23186]: audit 2024-09-21T01:57:48.967259+0000 mon.a (mon.0) 8065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:49 smithi179 bash[23186]: audit 2024-09-21T01:57:48.974379+0000 mon.a (mon.0) 8066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:49 smithi179 bash[23186]: audit 2024-09-21T01:57:48.980831+0000 mon.a (mon.0) 8067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:49 smithi179 bash[23186]: audit 2024-09-21T01:57:48.990674+0000 mon.a (mon.0) 8068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:49 smithi049 bash[23528]: audit 2024-09-21T01:57:48.951047+0000 mon.a (mon.0) 8063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:49 smithi049 bash[23528]: audit 2024-09-21T01:57:48.960194+0000 mon.a (mon.0) 8064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:49 smithi049 bash[23528]: audit 2024-09-21T01:57:48.967259+0000 mon.a (mon.0) 8065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:49 smithi049 bash[23528]: audit 2024-09-21T01:57:48.974379+0000 mon.a (mon.0) 8066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:49 smithi049 bash[23528]: audit 2024-09-21T01:57:48.980831+0000 mon.a (mon.0) 8067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:49 smithi049 bash[23528]: audit 2024-09-21T01:57:48.990674+0000 mon.a (mon.0) 8068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:50 smithi044 bash[22676]: cluster 2024-09-21T01:57:49.865042+0000 mgr.a (mgr.14388) 9666 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:50 smithi179 bash[23186]: cluster 2024-09-21T01:57:49.865042+0000 mgr.a (mgr.14388) 9666 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:50 smithi049 bash[23528]: cluster 2024-09-21T01:57:49.865042+0000 mgr.a (mgr.14388) 9666 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:52.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:52.463 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:52.463 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:52 smithi044 bash[22676]: cluster 2024-09-21T01:57:51.867411+0000 mgr.a (mgr.14388) 9667 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:52 smithi179 bash[23186]: cluster 2024-09-21T01:57:51.867411+0000 mgr.a (mgr.14388) 9667 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:53.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:53.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:53.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:53.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:53.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:52 smithi049 bash[23528]: cluster 2024-09-21T01:57:51.867411+0000 mgr.a (mgr.14388) 9667 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:53 smithi044 bash[22676]: audit 2024-09-21T01:57:52.795987+0000 mgr.a (mgr.14388) 9668 : audit [DBG] from='client.214407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:53 smithi179 bash[23186]: audit 2024-09-21T01:57:52.795987+0000 mgr.a (mgr.14388) 9668 : audit [DBG] from='client.214407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:53 smithi049 bash[23528]: audit 2024-09-21T01:57:52.795987+0000 mgr.a (mgr.14388) 9668 : audit [DBG] from='client.214407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:57:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:54 smithi044 bash[22676]: cluster 2024-09-21T01:57:53.868429+0000 mgr.a (mgr.14388) 9669 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:54 smithi179 bash[23186]: cluster 2024-09-21T01:57:53.868429+0000 mgr.a (mgr.14388) 9669 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:54 smithi049 bash[23528]: cluster 2024-09-21T01:57:53.868429+0000 mgr.a (mgr.14388) 9669 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:57.077 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:56 smithi049 bash[23528]: audit 2024-09-21T01:57:55.811507+0000 mon.a (mon.0) 8069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.077 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:56 smithi049 bash[23528]: audit 2024-09-21T01:57:55.817577+0000 mon.a (mon.0) 8070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.077 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:56 smithi049 bash[23528]: audit 2024-09-21T01:57:55.824482+0000 mon.a (mon.0) 8071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.077 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:56 smithi049 bash[23528]: cluster 2024-09-21T01:57:55.869976+0000 mgr.a (mgr.14388) 9670 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:56 smithi044 bash[22676]: audit 2024-09-21T01:57:55.811507+0000 mon.a (mon.0) 8069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:56 smithi044 bash[22676]: audit 2024-09-21T01:57:55.817577+0000 mon.a (mon.0) 8070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:56 smithi044 bash[22676]: audit 2024-09-21T01:57:55.824482+0000 mon.a (mon.0) 8071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:56 smithi044 bash[22676]: cluster 2024-09-21T01:57:55.869976+0000 mgr.a (mgr.14388) 9670 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:56 smithi179 bash[23186]: audit 2024-09-21T01:57:55.811507+0000 mon.a (mon.0) 8069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:56 smithi179 bash[23186]: audit 2024-09-21T01:57:55.817577+0000 mon.a (mon.0) 8070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:56 smithi179 bash[23186]: audit 2024-09-21T01:57:55.824482+0000 mon.a (mon.0) 8071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:57:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:56 smithi179 bash[23186]: cluster 2024-09-21T01:57:55.869976+0000 mgr.a (mgr.14388) 9670 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:57:58.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:57:58.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:57:58.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:57:59.054 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:57:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:57:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:57:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:57:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:57:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:58 smithi044 bash[22676]: cluster 2024-09-21T01:57:57.870703+0000 mgr.a (mgr.14388) 9671 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:58 smithi179 bash[23186]: cluster 2024-09-21T01:57:57.870703+0000 mgr.a (mgr.14388) 9671 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:57:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:58 smithi049 bash[23528]: cluster 2024-09-21T01:57:57.870703+0000 mgr.a (mgr.14388) 9671 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:57:59 smithi044 bash[22676]: audit 2024-09-21T01:57:58.594957+0000 mgr.a (mgr.14388) 9672 : audit [DBG] from='client.214482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:57:59 smithi179 bash[23186]: audit 2024-09-21T01:57:58.594957+0000 mgr.a (mgr.14388) 9672 : audit [DBG] from='client.214482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:57:59 smithi049 bash[23528]: audit 2024-09-21T01:57:58.594957+0000 mgr.a (mgr.14388) 9672 : audit [DBG] from='client.214482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:00 smithi044 bash[22676]: cluster 2024-09-21T01:57:59.871693+0000 mgr.a (mgr.14388) 9673 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:00 smithi179 bash[23186]: cluster 2024-09-21T01:57:59.871693+0000 mgr.a (mgr.14388) 9673 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:00 smithi049 bash[23528]: cluster 2024-09-21T01:57:59.871693+0000 mgr.a (mgr.14388) 9673 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:02 smithi044 bash[22676]: cluster 2024-09-21T01:58:01.874003+0000 mgr.a (mgr.14388) 9674 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:02 smithi179 bash[23186]: cluster 2024-09-21T01:58:01.874003+0000 mgr.a (mgr.14388) 9674 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:02 smithi049 bash[23528]: cluster 2024-09-21T01:58:01.874003+0000 mgr.a (mgr.14388) 9674 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:04.840 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:04.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:04.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:04.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:04.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:05.223 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:04 smithi179 bash[23186]: cluster 2024-09-21T01:58:03.874761+0000 mgr.a (mgr.14388) 9675 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:04 smithi044 bash[22676]: cluster 2024-09-21T01:58:03.874761+0000 mgr.a (mgr.14388) 9675 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:04 smithi049 bash[23528]: cluster 2024-09-21T01:58:03.874761+0000 mgr.a (mgr.14388) 9675 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:05 smithi044 bash[22676]: audit 2024-09-21T01:58:04.390221+0000 mgr.a (mgr.14388) 9676 : audit [DBG] from='client.214560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:05 smithi179 bash[23186]: audit 2024-09-21T01:58:04.390221+0000 mgr.a (mgr.14388) 9676 : audit [DBG] from='client.214560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:05 smithi049 bash[23528]: audit 2024-09-21T01:58:04.390221+0000 mgr.a (mgr.14388) 9676 : audit [DBG] from='client.214560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:06 smithi044 bash[22676]: cluster 2024-09-21T01:58:05.877158+0000 mgr.a (mgr.14388) 9677 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:06 smithi179 bash[23186]: cluster 2024-09-21T01:58:05.877158+0000 mgr.a (mgr.14388) 9677 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:06 smithi049 bash[23528]: cluster 2024-09-21T01:58:05.877158+0000 mgr.a (mgr.14388) 9677 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:09.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:08 smithi044 bash[22676]: cluster 2024-09-21T01:58:07.877993+0000 mgr.a (mgr.14388) 9678 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:08 smithi179 bash[23186]: cluster 2024-09-21T01:58:07.877993+0000 mgr.a (mgr.14388) 9678 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:08 smithi049 bash[23528]: cluster 2024-09-21T01:58:07.877993+0000 mgr.a (mgr.14388) 9678 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:09.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:09.837 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:09.837 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:10 smithi044 bash[22676]: audit 2024-09-21T01:58:09.176729+0000 mon.a (mon.0) 8072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:10 smithi044 bash[22676]: audit 2024-09-21T01:58:09.185030+0000 mon.a (mon.0) 8073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:10 smithi044 bash[22676]: audit 2024-09-21T01:58:09.196672+0000 mon.a (mon.0) 8074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:10 smithi044 bash[22676]: audit 2024-09-21T01:58:09.203484+0000 mon.a (mon.0) 8075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:10 smithi044 bash[22676]: audit 2024-09-21T01:58:09.211439+0000 mon.a (mon.0) 8076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:10 smithi044 bash[22676]: audit 2024-09-21T01:58:09.221441+0000 mon.a (mon.0) 8077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:10 smithi044 bash[22676]: cluster 2024-09-21T01:58:09.878608+0000 mgr.a (mgr.14388) 9679 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:10 smithi179 bash[23186]: audit 2024-09-21T01:58:09.176729+0000 mon.a (mon.0) 8072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:10 smithi179 bash[23186]: audit 2024-09-21T01:58:09.185030+0000 mon.a (mon.0) 8073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:10 smithi179 bash[23186]: audit 2024-09-21T01:58:09.196672+0000 mon.a (mon.0) 8074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:10 smithi179 bash[23186]: audit 2024-09-21T01:58:09.203484+0000 mon.a (mon.0) 8075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:10 smithi179 bash[23186]: audit 2024-09-21T01:58:09.211439+0000 mon.a (mon.0) 8076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:10 smithi179 bash[23186]: audit 2024-09-21T01:58:09.221441+0000 mon.a (mon.0) 8077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:10 smithi179 bash[23186]: cluster 2024-09-21T01:58:09.878608+0000 mgr.a (mgr.14388) 9679 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:10 smithi049 bash[23528]: audit 2024-09-21T01:58:09.176729+0000 mon.a (mon.0) 8072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:10 smithi049 bash[23528]: audit 2024-09-21T01:58:09.185030+0000 mon.a (mon.0) 8073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:10 smithi049 bash[23528]: audit 2024-09-21T01:58:09.196672+0000 mon.a (mon.0) 8074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:10 smithi049 bash[23528]: audit 2024-09-21T01:58:09.203484+0000 mon.a (mon.0) 8075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:10 smithi049 bash[23528]: audit 2024-09-21T01:58:09.211439+0000 mon.a (mon.0) 8076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:10 smithi049 bash[23528]: audit 2024-09-21T01:58:09.221441+0000 mon.a (mon.0) 8077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:10 smithi049 bash[23528]: cluster 2024-09-21T01:58:09.878608+0000 mgr.a (mgr.14388) 9679 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:10.616 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:10.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:10.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:10.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:10.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:11 smithi044 bash[22676]: audit 2024-09-21T01:58:10.174850+0000 mgr.a (mgr.14388) 9680 : audit [DBG] from='client.214635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:11 smithi179 bash[23186]: audit 2024-09-21T01:58:10.174850+0000 mgr.a (mgr.14388) 9680 : audit [DBG] from='client.214635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:11 smithi049 bash[23528]: audit 2024-09-21T01:58:10.174850+0000 mgr.a (mgr.14388) 9680 : audit [DBG] from='client.214635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:12 smithi044 bash[22676]: cluster 2024-09-21T01:58:11.881354+0000 mgr.a (mgr.14388) 9681 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:12 smithi179 bash[23186]: cluster 2024-09-21T01:58:11.881354+0000 mgr.a (mgr.14388) 9681 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:12 smithi049 bash[23528]: cluster 2024-09-21T01:58:11.881354+0000 mgr.a (mgr.14388) 9681 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:14 smithi044 bash[22676]: cluster 2024-09-21T01:58:13.882193+0000 mgr.a (mgr.14388) 9682 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:58:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:14 smithi179 bash[23186]: cluster 2024-09-21T01:58:13.882193+0000 mgr.a (mgr.14388) 9682 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:58:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:14 smithi049 bash[23528]: cluster 2024-09-21T01:58:13.882193+0000 mgr.a (mgr.14388) 9682 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:58:15.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:16.406 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:16 smithi044 bash[22676]: cluster 2024-09-21T01:58:15.883206+0000 mgr.a (mgr.14388) 9683 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:16 smithi044 bash[22676]: audit 2024-09-21T01:58:15.948483+0000 mgr.a (mgr.14388) 9684 : audit [DBG] from='client.214713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:16 smithi044 bash[22676]: audit 2024-09-21T01:58:16.027983+0000 mon.a (mon.0) 8078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:16 smithi044 bash[22676]: audit 2024-09-21T01:58:16.034406+0000 mon.a (mon.0) 8079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:16 smithi044 bash[22676]: audit 2024-09-21T01:58:16.042417+0000 mon.a (mon.0) 8080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:16 smithi179 bash[23186]: cluster 2024-09-21T01:58:15.883206+0000 mgr.a (mgr.14388) 9683 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:16 smithi179 bash[23186]: audit 2024-09-21T01:58:15.948483+0000 mgr.a (mgr.14388) 9684 : audit [DBG] from='client.214713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:16 smithi179 bash[23186]: audit 2024-09-21T01:58:16.027983+0000 mon.a (mon.0) 8078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:16 smithi179 bash[23186]: audit 2024-09-21T01:58:16.034406+0000 mon.a (mon.0) 8079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:16 smithi179 bash[23186]: audit 2024-09-21T01:58:16.042417+0000 mon.a (mon.0) 8080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:16 smithi049 bash[23528]: cluster 2024-09-21T01:58:15.883206+0000 mgr.a (mgr.14388) 9683 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:17.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:16 smithi049 bash[23528]: audit 2024-09-21T01:58:15.948483+0000 mgr.a (mgr.14388) 9684 : audit [DBG] from='client.214713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:17.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:16 smithi049 bash[23528]: audit 2024-09-21T01:58:16.027983+0000 mon.a (mon.0) 8078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:16 smithi049 bash[23528]: audit 2024-09-21T01:58:16.034406+0000 mon.a (mon.0) 8079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:17.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:16 smithi049 bash[23528]: audit 2024-09-21T01:58:16.042417+0000 mon.a (mon.0) 8080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:18 smithi044 bash[22676]: cluster 2024-09-21T01:58:17.884097+0000 mgr.a (mgr.14388) 9685 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:58:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:18 smithi179 bash[23186]: cluster 2024-09-21T01:58:17.884097+0000 mgr.a (mgr.14388) 9685 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:58:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:18 smithi049 bash[23528]: cluster 2024-09-21T01:58:17.884097+0000 mgr.a (mgr.14388) 9685 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:58:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:20 smithi044 bash[22676]: cluster 2024-09-21T01:58:19.884947+0000 mgr.a (mgr.14388) 9686 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:58:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:20 smithi179 bash[23186]: cluster 2024-09-21T01:58:19.884947+0000 mgr.a (mgr.14388) 9686 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:58:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:20 smithi049 bash[23528]: cluster 2024-09-21T01:58:19.884947+0000 mgr.a (mgr.14388) 9686 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:58:21.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:21.409 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:21.409 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:22.159 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:22 smithi044 bash[22676]: audit 2024-09-21T01:58:21.735357+0000 mgr.a (mgr.14388) 9687 : audit [DBG] from='client.214791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:22 smithi044 bash[22676]: cluster 2024-09-21T01:58:21.886606+0000 mgr.a (mgr.14388) 9688 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:22 smithi179 bash[23186]: audit 2024-09-21T01:58:21.735357+0000 mgr.a (mgr.14388) 9687 : audit [DBG] from='client.214791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:22 smithi179 bash[23186]: cluster 2024-09-21T01:58:21.886606+0000 mgr.a (mgr.14388) 9688 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:22 smithi049 bash[23528]: audit 2024-09-21T01:58:21.735357+0000 mgr.a (mgr.14388) 9687 : audit [DBG] from='client.214791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:22 smithi049 bash[23528]: cluster 2024-09-21T01:58:21.886606+0000 mgr.a (mgr.14388) 9688 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:24 smithi044 bash[22676]: cluster 2024-09-21T01:58:23.887645+0000 mgr.a (mgr.14388) 9689 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:24 smithi179 bash[23186]: cluster 2024-09-21T01:58:23.887645+0000 mgr.a (mgr.14388) 9689 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:24 smithi049 bash[23528]: cluster 2024-09-21T01:58:23.887645+0000 mgr.a (mgr.14388) 9689 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:27.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:27.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:27.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:26 smithi044 bash[22676]: cluster 2024-09-21T01:58:25.890029+0000 mgr.a (mgr.14388) 9690 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:26 smithi179 bash[23186]: cluster 2024-09-21T01:58:25.890029+0000 mgr.a (mgr.14388) 9690 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:26 smithi049 bash[23528]: cluster 2024-09-21T01:58:25.890029+0000 mgr.a (mgr.14388) 9690 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:58:27.913 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:27.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:27.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:27.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:27.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:28 smithi044 bash[22676]: audit 2024-09-21T01:58:27.493154+0000 mgr.a (mgr.14388) 9691 : audit [DBG] from='client.214866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:28 smithi044 bash[22676]: cluster 2024-09-21T01:58:27.890586+0000 mgr.a (mgr.14388) 9692 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:28 smithi179 bash[23186]: audit 2024-09-21T01:58:27.493154+0000 mgr.a (mgr.14388) 9691 : audit [DBG] from='client.214866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:28 smithi179 bash[23186]: cluster 2024-09-21T01:58:27.890586+0000 mgr.a (mgr.14388) 9692 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:28 smithi049 bash[23528]: audit 2024-09-21T01:58:27.493154+0000 mgr.a (mgr.14388) 9691 : audit [DBG] from='client.214866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:28 smithi049 bash[23528]: cluster 2024-09-21T01:58:27.890586+0000 mgr.a (mgr.14388) 9692 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:30.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22930]: debug 2024-09-21T01:58:29.871+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:58:30.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22930]: debug 2024-09-21T01:58:29.871+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.080502+0000 mon.a (mon.0) 8081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.087660+0000 mon.a (mon.0) 8082 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.089670+0000 mon.a (mon.0) 8083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.100620+0000 mon.a (mon.0) 8084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.106945+0000 mon.a (mon.0) 8085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.365396+0000 mon.a (mon.0) 8086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.370470+0000 mon.a (mon.0) 8087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.375164+0000 mon.a (mon.0) 8088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.379741+0000 mon.a (mon.0) 8089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.384509+0000 mon.a (mon.0) 8090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:29 smithi044 bash[22676]: audit 2024-09-21T01:58:29.390522+0000 mon.a (mon.0) 8091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.080502+0000 mon.a (mon.0) 8081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.087660+0000 mon.a (mon.0) 8082 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.089670+0000 mon.a (mon.0) 8083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.100620+0000 mon.a (mon.0) 8084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.106945+0000 mon.a (mon.0) 8085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:58:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.365396+0000 mon.a (mon.0) 8086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.370470+0000 mon.a (mon.0) 8087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.375164+0000 mon.a (mon.0) 8088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.379741+0000 mon.a (mon.0) 8089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.384509+0000 mon.a (mon.0) 8090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:29 smithi179 bash[23186]: audit 2024-09-21T01:58:29.390522+0000 mon.a (mon.0) 8091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.080502+0000 mon.a (mon.0) 8081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.087660+0000 mon.a (mon.0) 8082 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.089670+0000 mon.a (mon.0) 8083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.100620+0000 mon.a (mon.0) 8084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.106945+0000 mon.a (mon.0) 8085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.365396+0000 mon.a (mon.0) 8086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.370470+0000 mon.a (mon.0) 8087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.375164+0000 mon.a (mon.0) 8088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.379741+0000 mon.a (mon.0) 8089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.384509+0000 mon.a (mon.0) 8090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:29 smithi049 bash[23528]: audit 2024-09-21T01:58:29.390522+0000 mon.a (mon.0) 8091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:30 smithi044 bash[22676]: audit 2024-09-21T01:58:29.109493+0000 mgr.a (mgr.14388) 9693 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:58:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:30 smithi044 bash[22676]: audit 2024-09-21T01:58:29.874996+0000 mgr.a (mgr.14388) 9694 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:58:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:30 smithi044 bash[22676]: cephadm 2024-09-21T01:58:29.876322+0000 mgr.a (mgr.14388) 9695 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:58:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:30 smithi044 bash[22676]: cluster 2024-09-21T01:58:29.891127+0000 mgr.a (mgr.14388) 9696 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:30 smithi179 bash[23186]: audit 2024-09-21T01:58:29.109493+0000 mgr.a (mgr.14388) 9693 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:58:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:30 smithi179 bash[23186]: audit 2024-09-21T01:58:29.874996+0000 mgr.a (mgr.14388) 9694 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:58:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:30 smithi179 bash[23186]: cephadm 2024-09-21T01:58:29.876322+0000 mgr.a (mgr.14388) 9695 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:58:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:30 smithi179 bash[23186]: cluster 2024-09-21T01:58:29.891127+0000 mgr.a (mgr.14388) 9696 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:30 smithi049 bash[23528]: audit 2024-09-21T01:58:29.109493+0000 mgr.a (mgr.14388) 9693 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:58:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:30 smithi049 bash[23528]: audit 2024-09-21T01:58:29.874996+0000 mgr.a (mgr.14388) 9694 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:58:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:30 smithi049 bash[23528]: cephadm 2024-09-21T01:58:29.876322+0000 mgr.a (mgr.14388) 9695 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:58:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:30 smithi049 bash[23528]: cluster 2024-09-21T01:58:29.891127+0000 mgr.a (mgr.14388) 9696 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:32 smithi049 bash[23528]: cluster 2024-09-21T01:58:31.893359+0000 mgr.a (mgr.14388) 9697 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:32 smithi044 bash[22676]: cluster 2024-09-21T01:58:31.893359+0000 mgr.a (mgr.14388) 9697 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:32 smithi179 bash[23186]: cluster 2024-09-21T01:58:31.893359+0000 mgr.a (mgr.14388) 9697 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:33.699 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:33.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:33.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:33.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:33.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:34 smithi044 bash[22676]: audit 2024-09-21T01:58:33.252768+0000 mgr.a (mgr.14388) 9698 : audit [DBG] from='client.215049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:34 smithi044 bash[22676]: cluster 2024-09-21T01:58:33.894085+0000 mgr.a (mgr.14388) 9699 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:34 smithi179 bash[23186]: audit 2024-09-21T01:58:33.252768+0000 mgr.a (mgr.14388) 9698 : audit [DBG] from='client.215049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:34 smithi179 bash[23186]: cluster 2024-09-21T01:58:33.894085+0000 mgr.a (mgr.14388) 9699 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:34 smithi049 bash[23528]: audit 2024-09-21T01:58:33.252768+0000 mgr.a (mgr.14388) 9698 : audit [DBG] from='client.215049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:34 smithi049 bash[23528]: cluster 2024-09-21T01:58:33.894085+0000 mgr.a (mgr.14388) 9699 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:36 smithi044 bash[22676]: cluster 2024-09-21T01:58:35.895185+0000 mgr.a (mgr.14388) 9700 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:36 smithi044 bash[22676]: audit 2024-09-21T01:58:36.261461+0000 mon.a (mon.0) 8092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:36 smithi044 bash[22676]: audit 2024-09-21T01:58:36.270341+0000 mon.a (mon.0) 8093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:36 smithi044 bash[22676]: audit 2024-09-21T01:58:36.281031+0000 mon.a (mon.0) 8094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:36 smithi179 bash[23186]: cluster 2024-09-21T01:58:35.895185+0000 mgr.a (mgr.14388) 9700 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:36 smithi179 bash[23186]: audit 2024-09-21T01:58:36.261461+0000 mon.a (mon.0) 8092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:36 smithi179 bash[23186]: audit 2024-09-21T01:58:36.270341+0000 mon.a (mon.0) 8093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:36 smithi179 bash[23186]: audit 2024-09-21T01:58:36.281031+0000 mon.a (mon.0) 8094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.278 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:36 smithi049 bash[23528]: cluster 2024-09-21T01:58:35.895185+0000 mgr.a (mgr.14388) 9700 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:37.279 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:36 smithi049 bash[23528]: audit 2024-09-21T01:58:36.261461+0000 mon.a (mon.0) 8092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.279 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:36 smithi049 bash[23528]: audit 2024-09-21T01:58:36.270341+0000 mon.a (mon.0) 8093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:37.279 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:36 smithi049 bash[23528]: audit 2024-09-21T01:58:36.281031+0000 mon.a (mon.0) 8094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:38 smithi044 bash[22676]: cluster 2024-09-21T01:58:37.896068+0000 mgr.a (mgr.14388) 9701 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:38 smithi179 bash[23186]: cluster 2024-09-21T01:58:37.896068+0000 mgr.a (mgr.14388) 9701 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:38 smithi049 bash[23528]: cluster 2024-09-21T01:58:37.896068+0000 mgr.a (mgr.14388) 9701 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:39.493 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:39.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:39.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:40 smithi044 bash[22676]: audit 2024-09-21T01:58:39.041232+0000 mgr.a (mgr.14388) 9702 : audit [DBG] from='client.215127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:40 smithi044 bash[22676]: cluster 2024-09-21T01:58:39.897122+0000 mgr.a (mgr.14388) 9703 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:40 smithi179 bash[23186]: audit 2024-09-21T01:58:39.041232+0000 mgr.a (mgr.14388) 9702 : audit [DBG] from='client.215127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:40 smithi179 bash[23186]: cluster 2024-09-21T01:58:39.897122+0000 mgr.a (mgr.14388) 9703 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:40 smithi049 bash[23528]: audit 2024-09-21T01:58:39.041232+0000 mgr.a (mgr.14388) 9702 : audit [DBG] from='client.215127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:40 smithi049 bash[23528]: cluster 2024-09-21T01:58:39.897122+0000 mgr.a (mgr.14388) 9703 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:42 smithi044 bash[22676]: cluster 2024-09-21T01:58:41.899436+0000 mgr.a (mgr.14388) 9704 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:42 smithi179 bash[23186]: cluster 2024-09-21T01:58:41.899436+0000 mgr.a (mgr.14388) 9704 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:42 smithi049 bash[23528]: cluster 2024-09-21T01:58:41.899436+0000 mgr.a (mgr.14388) 9704 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:58:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:44.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:44 smithi044 bash[22676]: cluster 2024-09-21T01:58:43.900240+0000 mgr.a (mgr.14388) 9705 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:44 smithi179 bash[23186]: cluster 2024-09-21T01:58:43.900240+0000 mgr.a (mgr.14388) 9705 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:45.288 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:45.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:45.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:45.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:45.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:44 smithi049 bash[23528]: cluster 2024-09-21T01:58:43.900240+0000 mgr.a (mgr.14388) 9705 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:45 smithi044 bash[22676]: audit 2024-09-21T01:58:44.835164+0000 mgr.a (mgr.14388) 9706 : audit [DBG] from='client.215199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:45 smithi179 bash[23186]: audit 2024-09-21T01:58:44.835164+0000 mgr.a (mgr.14388) 9706 : audit [DBG] from='client.215199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:45 smithi049 bash[23528]: audit 2024-09-21T01:58:44.835164+0000 mgr.a (mgr.14388) 9706 : audit [DBG] from='client.215199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:46 smithi044 bash[22676]: cluster 2024-09-21T01:58:45.903172+0000 mgr.a (mgr.14388) 9707 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:58:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:46 smithi179 bash[23186]: cluster 2024-09-21T01:58:45.903172+0000 mgr.a (mgr.14388) 9707 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:58:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:46 smithi049 bash[23528]: cluster 2024-09-21T01:58:45.903172+0000 mgr.a (mgr.14388) 9707 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T01:58:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:48 smithi179 bash[23186]: cluster 2024-09-21T01:58:47.904024+0000 mgr.a (mgr.14388) 9708 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:58:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:48 smithi049 bash[23528]: cluster 2024-09-21T01:58:47.904024+0000 mgr.a (mgr.14388) 9708 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:58:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:48 smithi044 bash[22676]: cluster 2024-09-21T01:58:47.904024+0000 mgr.a (mgr.14388) 9708 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:58:50.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:50 smithi044 bash[22676]: audit 2024-09-21T01:58:49.586526+0000 mon.a (mon.0) 8095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:50 smithi044 bash[22676]: audit 2024-09-21T01:58:49.594153+0000 mon.a (mon.0) 8096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:50 smithi044 bash[22676]: audit 2024-09-21T01:58:49.604973+0000 mon.a (mon.0) 8097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:50 smithi044 bash[22676]: audit 2024-09-21T01:58:49.618789+0000 mon.a (mon.0) 8098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:50 smithi044 bash[22676]: audit 2024-09-21T01:58:49.627237+0000 mon.a (mon.0) 8099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:50 smithi044 bash[22676]: audit 2024-09-21T01:58:49.637209+0000 mon.a (mon.0) 8100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:50 smithi044 bash[22676]: cluster 2024-09-21T01:58:49.904813+0000 mgr.a (mgr.14388) 9709 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:58:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:50 smithi179 bash[23186]: audit 2024-09-21T01:58:49.586526+0000 mon.a (mon.0) 8095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:50 smithi179 bash[23186]: audit 2024-09-21T01:58:49.594153+0000 mon.a (mon.0) 8096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:50 smithi179 bash[23186]: audit 2024-09-21T01:58:49.604973+0000 mon.a (mon.0) 8097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:50 smithi179 bash[23186]: audit 2024-09-21T01:58:49.618789+0000 mon.a (mon.0) 8098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:50 smithi179 bash[23186]: audit 2024-09-21T01:58:49.627237+0000 mon.a (mon.0) 8099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:50 smithi179 bash[23186]: audit 2024-09-21T01:58:49.637209+0000 mon.a (mon.0) 8100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:50 smithi179 bash[23186]: cluster 2024-09-21T01:58:49.904813+0000 mgr.a (mgr.14388) 9709 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:58:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:50 smithi049 bash[23528]: audit 2024-09-21T01:58:49.586526+0000 mon.a (mon.0) 8095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:50 smithi049 bash[23528]: audit 2024-09-21T01:58:49.594153+0000 mon.a (mon.0) 8096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:50 smithi049 bash[23528]: audit 2024-09-21T01:58:49.604973+0000 mon.a (mon.0) 8097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:50 smithi049 bash[23528]: audit 2024-09-21T01:58:49.618789+0000 mon.a (mon.0) 8098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:50 smithi049 bash[23528]: audit 2024-09-21T01:58:49.627237+0000 mon.a (mon.0) 8099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:50 smithi049 bash[23528]: audit 2024-09-21T01:58:49.637209+0000 mon.a (mon.0) 8100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:50 smithi049 bash[23528]: cluster 2024-09-21T01:58:49.904813+0000 mgr.a (mgr.14388) 9709 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:58:51.053 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:51 smithi044 bash[22676]: audit 2024-09-21T01:58:50.624064+0000 mgr.a (mgr.14388) 9710 : audit [DBG] from='client.215277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:51 smithi179 bash[23186]: audit 2024-09-21T01:58:50.624064+0000 mgr.a (mgr.14388) 9710 : audit [DBG] from='client.215277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:51 smithi049 bash[23528]: audit 2024-09-21T01:58:50.624064+0000 mgr.a (mgr.14388) 9710 : audit [DBG] from='client.215277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:52 smithi044 bash[22676]: cluster 2024-09-21T01:58:51.907638+0000 mgr.a (mgr.14388) 9711 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:52 smithi179 bash[23186]: cluster 2024-09-21T01:58:51.907638+0000 mgr.a (mgr.14388) 9711 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:52 smithi049 bash[23528]: cluster 2024-09-21T01:58:51.907638+0000 mgr.a (mgr.14388) 9711 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:54 smithi044 bash[22676]: cluster 2024-09-21T01:58:53.908489+0000 mgr.a (mgr.14388) 9712 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:58:55.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:54 smithi179 bash[23186]: cluster 2024-09-21T01:58:53.908489+0000 mgr.a (mgr.14388) 9712 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:58:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:54 smithi049 bash[23528]: cluster 2024-09-21T01:58:53.908489+0000 mgr.a (mgr.14388) 9712 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:58:56.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:58:56.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:58:56.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:58:56.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:58:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:58:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:58:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:58:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:58:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:56 smithi044 bash[22676]: cluster 2024-09-21T01:58:55.910115+0000 mgr.a (mgr.14388) 9713 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:56 smithi044 bash[22676]: audit 2024-09-21T01:58:56.475570+0000 mon.a (mon.0) 8101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:56 smithi044 bash[22676]: audit 2024-09-21T01:58:56.480959+0000 mon.a (mon.0) 8102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:56 smithi044 bash[22676]: audit 2024-09-21T01:58:56.487500+0000 mon.a (mon.0) 8103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:56 smithi179 bash[23186]: cluster 2024-09-21T01:58:55.910115+0000 mgr.a (mgr.14388) 9713 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:56 smithi179 bash[23186]: audit 2024-09-21T01:58:56.475570+0000 mon.a (mon.0) 8101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:56 smithi179 bash[23186]: audit 2024-09-21T01:58:56.480959+0000 mon.a (mon.0) 8102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:56 smithi179 bash[23186]: audit 2024-09-21T01:58:56.487500+0000 mon.a (mon.0) 8103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:56 smithi049 bash[23528]: cluster 2024-09-21T01:58:55.910115+0000 mgr.a (mgr.14388) 9713 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:58:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:56 smithi049 bash[23528]: audit 2024-09-21T01:58:56.475570+0000 mon.a (mon.0) 8101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:56 smithi049 bash[23528]: audit 2024-09-21T01:58:56.480959+0000 mon.a (mon.0) 8102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:56 smithi049 bash[23528]: audit 2024-09-21T01:58:56.487500+0000 mon.a (mon.0) 8103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:58:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:57 smithi049 bash[23528]: audit 2024-09-21T01:58:56.390070+0000 mgr.a (mgr.14388) 9714 : audit [DBG] from='client.215352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:57 smithi044 bash[22676]: audit 2024-09-21T01:58:56.390070+0000 mgr.a (mgr.14388) 9714 : audit [DBG] from='client.215352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:57 smithi179 bash[23186]: audit 2024-09-21T01:58:56.390070+0000 mgr.a (mgr.14388) 9714 : audit [DBG] from='client.215352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:58:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:58 smithi044 bash[22676]: cluster 2024-09-21T01:58:57.910976+0000 mgr.a (mgr.14388) 9715 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:58:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:58 smithi179 bash[23186]: cluster 2024-09-21T01:58:57.910976+0000 mgr.a (mgr.14388) 9715 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:58:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:58 smithi049 bash[23528]: cluster 2024-09-21T01:58:57.910976+0000 mgr.a (mgr.14388) 9715 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:59:00.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:58:59 smithi049 bash[23528]: cluster 2024-09-21T01:58:59.911800+0000 mgr.a (mgr.14388) 9716 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:59:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:58:59 smithi179 bash[23186]: cluster 2024-09-21T01:58:59.911800+0000 mgr.a (mgr.14388) 9716 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:59:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:58:59 smithi044 bash[22676]: cluster 2024-09-21T01:58:59.911800+0000 mgr.a (mgr.14388) 9716 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T01:59:01.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:01.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:01.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:02.555 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:02.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:02 smithi044 bash[22676]: cluster 2024-09-21T01:59:01.912893+0000 mgr.a (mgr.14388) 9717 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:59:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:02 smithi179 bash[23186]: cluster 2024-09-21T01:59:01.912893+0000 mgr.a (mgr.14388) 9717 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:59:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:02 smithi049 bash[23528]: cluster 2024-09-21T01:59:01.912893+0000 mgr.a (mgr.14388) 9717 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T01:59:04.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:03 smithi179 bash[23186]: audit 2024-09-21T01:59:02.130580+0000 mgr.a (mgr.14388) 9718 : audit [DBG] from='client.215427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:03 smithi044 bash[22676]: audit 2024-09-21T01:59:02.130580+0000 mgr.a (mgr.14388) 9718 : audit [DBG] from='client.215427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:03 smithi049 bash[23528]: audit 2024-09-21T01:59:02.130580+0000 mgr.a (mgr.14388) 9718 : audit [DBG] from='client.215427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:04 smithi044 bash[22676]: cluster 2024-09-21T01:59:03.913701+0000 mgr.a (mgr.14388) 9719 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:04 smithi179 bash[23186]: cluster 2024-09-21T01:59:03.913701+0000 mgr.a (mgr.14388) 9719 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:05.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:04 smithi049 bash[23528]: cluster 2024-09-21T01:59:03.913701+0000 mgr.a (mgr.14388) 9719 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:06 smithi049 bash[23528]: cluster 2024-09-21T01:59:05.915909+0000 mgr.a (mgr.14388) 9720 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:06.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:06 smithi179 bash[23186]: cluster 2024-09-21T01:59:05.915909+0000 mgr.a (mgr.14388) 9720 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:06 smithi044 bash[22676]: cluster 2024-09-21T01:59:05.915909+0000 mgr.a (mgr.14388) 9720 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:07.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:07.557 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:07.557 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:08.333 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:08 smithi044 bash[22676]: audit 2024-09-21T01:59:07.897203+0000 mgr.a (mgr.14388) 9721 : audit [DBG] from='client.215505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:08 smithi044 bash[22676]: cluster 2024-09-21T01:59:07.917530+0000 mgr.a (mgr.14388) 9722 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:08 smithi179 bash[23186]: audit 2024-09-21T01:59:07.897203+0000 mgr.a (mgr.14388) 9721 : audit [DBG] from='client.215505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:08 smithi179 bash[23186]: cluster 2024-09-21T01:59:07.917530+0000 mgr.a (mgr.14388) 9722 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:08 smithi049 bash[23528]: audit 2024-09-21T01:59:07.897203+0000 mgr.a (mgr.14388) 9721 : audit [DBG] from='client.215505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:08 smithi049 bash[23528]: cluster 2024-09-21T01:59:07.917530+0000 mgr.a (mgr.14388) 9722 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:10.808 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:10 smithi044 bash[22676]: audit 2024-09-21T01:59:09.807474+0000 mon.a (mon.0) 8104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:10.808 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:10 smithi044 bash[22676]: audit 2024-09-21T01:59:09.816016+0000 mon.a (mon.0) 8105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:10.808 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:10 smithi044 bash[22676]: audit 2024-09-21T01:59:09.828010+0000 mon.a (mon.0) 8106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:10.809 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:10 smithi044 bash[22676]: audit 2024-09-21T01:59:09.836354+0000 mon.a (mon.0) 8107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:10 smithi044 bash[22676]: audit 2024-09-21T01:59:09.844501+0000 mon.a (mon.0) 8108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:10 smithi044 bash[22676]: audit 2024-09-21T01:59:09.854751+0000 mon.a (mon.0) 8109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:10 smithi044 bash[22676]: cluster 2024-09-21T01:59:09.918517+0000 mgr.a (mgr.14388) 9723 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:10 smithi179 bash[23186]: audit 2024-09-21T01:59:09.807474+0000 mon.a (mon.0) 8104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:10 smithi179 bash[23186]: audit 2024-09-21T01:59:09.816016+0000 mon.a (mon.0) 8105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:10 smithi179 bash[23186]: audit 2024-09-21T01:59:09.828010+0000 mon.a (mon.0) 8106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:10 smithi179 bash[23186]: audit 2024-09-21T01:59:09.836354+0000 mon.a (mon.0) 8107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:10 smithi179 bash[23186]: audit 2024-09-21T01:59:09.844501+0000 mon.a (mon.0) 8108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:10 smithi179 bash[23186]: audit 2024-09-21T01:59:09.854751+0000 mon.a (mon.0) 8109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:10 smithi179 bash[23186]: cluster 2024-09-21T01:59:09.918517+0000 mgr.a (mgr.14388) 9723 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:10 smithi049 bash[23528]: audit 2024-09-21T01:59:09.807474+0000 mon.a (mon.0) 8104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:10 smithi049 bash[23528]: audit 2024-09-21T01:59:09.816016+0000 mon.a (mon.0) 8105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:10 smithi049 bash[23528]: audit 2024-09-21T01:59:09.828010+0000 mon.a (mon.0) 8106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:10 smithi049 bash[23528]: audit 2024-09-21T01:59:09.836354+0000 mon.a (mon.0) 8107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:10 smithi049 bash[23528]: audit 2024-09-21T01:59:09.844501+0000 mon.a (mon.0) 8108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:10 smithi049 bash[23528]: audit 2024-09-21T01:59:09.854751+0000 mon.a (mon.0) 8109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:10 smithi049 bash[23528]: cluster 2024-09-21T01:59:09.918517+0000 mgr.a (mgr.14388) 9723 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:12 smithi044 bash[22676]: cluster 2024-09-21T01:59:11.920754+0000 mgr.a (mgr.14388) 9724 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:12 smithi179 bash[23186]: cluster 2024-09-21T01:59:11.920754+0000 mgr.a (mgr.14388) 9724 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:12 smithi049 bash[23528]: cluster 2024-09-21T01:59:11.920754+0000 mgr.a (mgr.14388) 9724 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:13.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:13.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:13.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:14.134 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:14 smithi044 bash[22676]: audit 2024-09-21T01:59:13.678366+0000 mgr.a (mgr.14388) 9725 : audit [DBG] from='client.215583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:14 smithi044 bash[22676]: cluster 2024-09-21T01:59:13.921549+0000 mgr.a (mgr.14388) 9726 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:14 smithi179 bash[23186]: audit 2024-09-21T01:59:13.678366+0000 mgr.a (mgr.14388) 9725 : audit [DBG] from='client.215583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:14 smithi179 bash[23186]: cluster 2024-09-21T01:59:13.921549+0000 mgr.a (mgr.14388) 9726 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:14 smithi049 bash[23528]: audit 2024-09-21T01:59:13.678366+0000 mgr.a (mgr.14388) 9725 : audit [DBG] from='client.215583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:14 smithi049 bash[23528]: cluster 2024-09-21T01:59:13.921549+0000 mgr.a (mgr.14388) 9726 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:16 smithi049 bash[23528]: cluster 2024-09-21T01:59:15.923636+0000 mgr.a (mgr.14388) 9727 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:16.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:16 smithi044 bash[22676]: cluster 2024-09-21T01:59:15.923636+0000 mgr.a (mgr.14388) 9727 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:16 smithi179 bash[23186]: cluster 2024-09-21T01:59:15.923636+0000 mgr.a (mgr.14388) 9727 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:17.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:17 smithi049 bash[23528]: audit 2024-09-21T01:59:16.677135+0000 mon.a (mon.0) 8110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:17.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:17 smithi049 bash[23528]: audit 2024-09-21T01:59:16.685783+0000 mon.a (mon.0) 8111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:17.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:17 smithi049 bash[23528]: audit 2024-09-21T01:59:16.699229+0000 mon.a (mon.0) 8112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:17 smithi044 bash[22676]: audit 2024-09-21T01:59:16.677135+0000 mon.a (mon.0) 8110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:17 smithi044 bash[22676]: audit 2024-09-21T01:59:16.685783+0000 mon.a (mon.0) 8111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:17 smithi044 bash[22676]: audit 2024-09-21T01:59:16.699229+0000 mon.a (mon.0) 8112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:17 smithi179 bash[23186]: audit 2024-09-21T01:59:16.677135+0000 mon.a (mon.0) 8110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:17 smithi179 bash[23186]: audit 2024-09-21T01:59:16.685783+0000 mon.a (mon.0) 8111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:17 smithi179 bash[23186]: audit 2024-09-21T01:59:16.699229+0000 mon.a (mon.0) 8112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:18 smithi044 bash[22676]: cluster 2024-09-21T01:59:17.924425+0000 mgr.a (mgr.14388) 9728 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:18 smithi179 bash[23186]: cluster 2024-09-21T01:59:17.924425+0000 mgr.a (mgr.14388) 9728 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:18 smithi049 bash[23528]: cluster 2024-09-21T01:59:17.924425+0000 mgr.a (mgr.14388) 9728 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:19.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:19.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:19.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:19.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:19.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:19.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:19.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:19.902 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:20 smithi044 bash[22676]: audit 2024-09-21T01:59:19.472286+0000 mgr.a (mgr.14388) 9729 : audit [DBG] from='client.215661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:20 smithi044 bash[22676]: cluster 2024-09-21T01:59:19.925107+0000 mgr.a (mgr.14388) 9730 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:20 smithi179 bash[23186]: audit 2024-09-21T01:59:19.472286+0000 mgr.a (mgr.14388) 9729 : audit [DBG] from='client.215661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:20 smithi179 bash[23186]: cluster 2024-09-21T01:59:19.925107+0000 mgr.a (mgr.14388) 9730 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:20 smithi049 bash[23528]: audit 2024-09-21T01:59:19.472286+0000 mgr.a (mgr.14388) 9729 : audit [DBG] from='client.215661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:20 smithi049 bash[23528]: cluster 2024-09-21T01:59:19.925107+0000 mgr.a (mgr.14388) 9730 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:22 smithi044 bash[22676]: cluster 2024-09-21T01:59:21.927289+0000 mgr.a (mgr.14388) 9731 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:22 smithi179 bash[23186]: cluster 2024-09-21T01:59:21.927289+0000 mgr.a (mgr.14388) 9731 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:22 smithi049 bash[23528]: cluster 2024-09-21T01:59:21.927289+0000 mgr.a (mgr.14388) 9731 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:23 smithi179 bash[23186]: cluster 2024-09-21T01:59:23.928026+0000 mgr.a (mgr.14388) 9732 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:23 smithi049 bash[23528]: cluster 2024-09-21T01:59:23.928026+0000 mgr.a (mgr.14388) 9732 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:23 smithi044 bash[22676]: cluster 2024-09-21T01:59:23.928026+0000 mgr.a (mgr.14388) 9732 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:24.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:24.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:24.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:25.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:26 smithi179 bash[23186]: audit 2024-09-21T01:59:25.239315+0000 mgr.a (mgr.14388) 9733 : audit [DBG] from='client.215733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:26 smithi179 bash[23186]: cluster 2024-09-21T01:59:25.930893+0000 mgr.a (mgr.14388) 9734 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:26 smithi049 bash[23528]: audit 2024-09-21T01:59:25.239315+0000 mgr.a (mgr.14388) 9733 : audit [DBG] from='client.215733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:26 smithi049 bash[23528]: cluster 2024-09-21T01:59:25.930893+0000 mgr.a (mgr.14388) 9734 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:26 smithi044 bash[22676]: audit 2024-09-21T01:59:25.239315+0000 mgr.a (mgr.14388) 9733 : audit [DBG] from='client.215733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:26 smithi044 bash[22676]: cluster 2024-09-21T01:59:25.930893+0000 mgr.a (mgr.14388) 9734 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:28 smithi049 bash[23528]: cluster 2024-09-21T01:59:27.931709+0000 mgr.a (mgr.14388) 9735 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:59:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:28 smithi044 bash[22676]: cluster 2024-09-21T01:59:27.931709+0000 mgr.a (mgr.14388) 9735 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:59:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:28 smithi179 bash[23186]: cluster 2024-09-21T01:59:27.931709+0000 mgr.a (mgr.14388) 9735 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T01:59:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:29 smithi044 bash[22676]: audit 2024-09-21T01:59:29.931588+0000 mon.a (mon.0) 8113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:59:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:29 smithi044 bash[22676]: audit 2024-09-21T01:59:29.940148+0000 mon.a (mon.0) 8114 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:59:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:29 smithi044 bash[22676]: audit 2024-09-21T01:59:29.941742+0000 mon.a (mon.0) 8115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:59:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:29 smithi044 bash[22676]: audit 2024-09-21T01:59:29.952024+0000 mon.a (mon.0) 8116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:29 smithi044 bash[22676]: audit 2024-09-21T01:59:29.956466+0000 mon.a (mon.0) 8117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:59:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:29 smithi179 bash[23186]: audit 2024-09-21T01:59:29.931588+0000 mon.a (mon.0) 8113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:59:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:29 smithi179 bash[23186]: audit 2024-09-21T01:59:29.940148+0000 mon.a (mon.0) 8114 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:59:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:29 smithi179 bash[23186]: audit 2024-09-21T01:59:29.941742+0000 mon.a (mon.0) 8115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:59:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:29 smithi179 bash[23186]: audit 2024-09-21T01:59:29.952024+0000 mon.a (mon.0) 8116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:29 smithi179 bash[23186]: audit 2024-09-21T01:59:29.956466+0000 mon.a (mon.0) 8117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:59:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:29 smithi049 bash[23528]: audit 2024-09-21T01:59:29.931588+0000 mon.a (mon.0) 8113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:59:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:29 smithi049 bash[23528]: audit 2024-09-21T01:59:29.940148+0000 mon.a (mon.0) 8114 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:59:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:29 smithi049 bash[23528]: audit 2024-09-21T01:59:29.941742+0000 mon.a (mon.0) 8115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:59:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:29 smithi049 bash[23528]: audit 2024-09-21T01:59:29.952024+0000 mon.a (mon.0) 8116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:29 smithi049 bash[23528]: audit 2024-09-21T01:59:29.956466+0000 mon.a (mon.0) 8117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:59:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:31.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22930]: debug 2024-09-21T01:59:30.742+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:59:31.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22930]: debug 2024-09-21T01:59:30.742+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:59:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: cluster 2024-09-21T01:59:29.932257+0000 mgr.a (mgr.14388) 9736 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:59:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: audit 2024-09-21T01:59:29.960200+0000 mgr.a (mgr.14388) 9737 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:59:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: audit 2024-09-21T01:59:30.022175+0000 mon.a (mon.0) 8118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: audit 2024-09-21T01:59:30.028511+0000 mon.a (mon.0) 8119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: audit 2024-09-21T01:59:30.035923+0000 mon.a (mon.0) 8120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: audit 2024-09-21T01:59:30.047370+0000 mon.a (mon.0) 8121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: audit 2024-09-21T01:59:30.052876+0000 mon.a (mon.0) 8122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:30 smithi044 bash[22676]: audit 2024-09-21T01:59:30.058129+0000 mon.a (mon.0) 8123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: cluster 2024-09-21T01:59:29.932257+0000 mgr.a (mgr.14388) 9736 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:59:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: audit 2024-09-21T01:59:29.960200+0000 mgr.a (mgr.14388) 9737 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:59:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: audit 2024-09-21T01:59:30.022175+0000 mon.a (mon.0) 8118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: audit 2024-09-21T01:59:30.028511+0000 mon.a (mon.0) 8119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: audit 2024-09-21T01:59:30.035923+0000 mon.a (mon.0) 8120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: audit 2024-09-21T01:59:30.047370+0000 mon.a (mon.0) 8121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: audit 2024-09-21T01:59:30.052876+0000 mon.a (mon.0) 8122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:30 smithi179 bash[23186]: audit 2024-09-21T01:59:30.058129+0000 mon.a (mon.0) 8123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: cluster 2024-09-21T01:59:29.932257+0000 mgr.a (mgr.14388) 9736 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T01:59:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: audit 2024-09-21T01:59:29.960200+0000 mgr.a (mgr.14388) 9737 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T01:59:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: audit 2024-09-21T01:59:30.022175+0000 mon.a (mon.0) 8118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: audit 2024-09-21T01:59:30.028511+0000 mon.a (mon.0) 8119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: audit 2024-09-21T01:59:30.035923+0000 mon.a (mon.0) 8120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: audit 2024-09-21T01:59:30.047370+0000 mon.a (mon.0) 8121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: audit 2024-09-21T01:59:30.052876+0000 mon.a (mon.0) 8122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:30 smithi049 bash[23528]: audit 2024-09-21T01:59:30.058129+0000 mon.a (mon.0) 8123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:31.426 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:31 smithi179 bash[23186]: audit 2024-09-21T01:59:30.747331+0000 mgr.a (mgr.14388) 9738 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:59:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:31 smithi179 bash[23186]: cephadm 2024-09-21T01:59:30.748705+0000 mgr.a (mgr.14388) 9739 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:59:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:31 smithi179 bash[23186]: audit 2024-09-21T01:59:30.997323+0000 mgr.a (mgr.14388) 9740 : audit [DBG] from='client.215916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:31 smithi179 bash[23186]: cluster 2024-09-21T01:59:31.935024+0000 mgr.a (mgr.14388) 9741 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:59:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:31 smithi049 bash[23528]: audit 2024-09-21T01:59:30.747331+0000 mgr.a (mgr.14388) 9738 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:59:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:31 smithi049 bash[23528]: cephadm 2024-09-21T01:59:30.748705+0000 mgr.a (mgr.14388) 9739 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:59:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:31 smithi049 bash[23528]: audit 2024-09-21T01:59:30.997323+0000 mgr.a (mgr.14388) 9740 : audit [DBG] from='client.215916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:31 smithi049 bash[23528]: cluster 2024-09-21T01:59:31.935024+0000 mgr.a (mgr.14388) 9741 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:59:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:31 smithi044 bash[22676]: audit 2024-09-21T01:59:30.747331+0000 mgr.a (mgr.14388) 9738 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T01:59:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:31 smithi044 bash[22676]: cephadm 2024-09-21T01:59:30.748705+0000 mgr.a (mgr.14388) 9739 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T01:59:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:31 smithi044 bash[22676]: audit 2024-09-21T01:59:30.997323+0000 mgr.a (mgr.14388) 9740 : audit [DBG] from='client.215916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:31 smithi044 bash[22676]: cluster 2024-09-21T01:59:31.935024+0000 mgr.a (mgr.14388) 9741 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T01:59:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:34 smithi049 bash[23528]: cluster 2024-09-21T01:59:33.935833+0000 mgr.a (mgr.14388) 9742 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:59:34.414 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:34 smithi044 bash[22676]: cluster 2024-09-21T01:59:33.935833+0000 mgr.a (mgr.14388) 9742 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:59:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:34 smithi179 bash[23186]: cluster 2024-09-21T01:59:33.935833+0000 mgr.a (mgr.14388) 9742 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T01:59:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:36 smithi049 bash[23528]: cluster 2024-09-21T01:59:35.937921+0000 mgr.a (mgr.14388) 9743 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:36.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:36.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:36.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:36 smithi044 bash[22676]: cluster 2024-09-21T01:59:35.937921+0000 mgr.a (mgr.14388) 9743 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:36 smithi179 bash[23186]: cluster 2024-09-21T01:59:35.937921+0000 mgr.a (mgr.14388) 9743 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:37.246 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:37.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:37.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:37.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:37.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:37 smithi044 bash[22676]: audit 2024-09-21T01:59:36.802228+0000 mgr.a (mgr.14388) 9744 : audit [DBG] from='client.215994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:37 smithi044 bash[22676]: audit 2024-09-21T01:59:36.864600+0000 mon.a (mon.0) 8124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:37 smithi044 bash[22676]: audit 2024-09-21T01:59:36.869999+0000 mon.a (mon.0) 8125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:37 smithi044 bash[22676]: audit 2024-09-21T01:59:36.876211+0000 mon.a (mon.0) 8126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:37 smithi179 bash[23186]: audit 2024-09-21T01:59:36.802228+0000 mgr.a (mgr.14388) 9744 : audit [DBG] from='client.215994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:37 smithi179 bash[23186]: audit 2024-09-21T01:59:36.864600+0000 mon.a (mon.0) 8124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:37 smithi179 bash[23186]: audit 2024-09-21T01:59:36.869999+0000 mon.a (mon.0) 8125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:37 smithi179 bash[23186]: audit 2024-09-21T01:59:36.876211+0000 mon.a (mon.0) 8126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:37 smithi049 bash[23528]: audit 2024-09-21T01:59:36.802228+0000 mgr.a (mgr.14388) 9744 : audit [DBG] from='client.215994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:37 smithi049 bash[23528]: audit 2024-09-21T01:59:36.864600+0000 mon.a (mon.0) 8124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:37 smithi049 bash[23528]: audit 2024-09-21T01:59:36.869999+0000 mon.a (mon.0) 8125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:38.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:37 smithi049 bash[23528]: audit 2024-09-21T01:59:36.876211+0000 mon.a (mon.0) 8126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:38 smithi049 bash[23528]: cluster 2024-09-21T01:59:37.939089+0000 mgr.a (mgr.14388) 9745 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:38 smithi044 bash[22676]: cluster 2024-09-21T01:59:37.939089+0000 mgr.a (mgr.14388) 9745 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:38 smithi179 bash[23186]: cluster 2024-09-21T01:59:37.939089+0000 mgr.a (mgr.14388) 9745 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:40 smithi049 bash[23528]: cluster 2024-09-21T01:59:39.940057+0000 mgr.a (mgr.14388) 9746 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:40 smithi044 bash[22676]: cluster 2024-09-21T01:59:39.940057+0000 mgr.a (mgr.14388) 9746 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:40 smithi179 bash[23186]: cluster 2024-09-21T01:59:39.940057+0000 mgr.a (mgr.14388) 9746 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:42.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:42 smithi049 bash[23528]: cluster 2024-09-21T01:59:41.942440+0000 mgr.a (mgr.14388) 9747 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:42 smithi044 bash[22676]: cluster 2024-09-21T01:59:41.942440+0000 mgr.a (mgr.14388) 9747 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:42 smithi179 bash[23186]: cluster 2024-09-21T01:59:41.942440+0000 mgr.a (mgr.14388) 9747 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:43.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:43 smithi049 bash[23528]: audit 2024-09-21T01:59:42.586113+0000 mgr.a (mgr.14388) 9748 : audit [DBG] from='client.216072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:43 smithi044 bash[22676]: audit 2024-09-21T01:59:42.586113+0000 mgr.a (mgr.14388) 9748 : audit [DBG] from='client.216072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:43 smithi179 bash[23186]: audit 2024-09-21T01:59:42.586113+0000 mgr.a (mgr.14388) 9748 : audit [DBG] from='client.216072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:44 smithi049 bash[23528]: cluster 2024-09-21T01:59:43.943382+0000 mgr.a (mgr.14388) 9749 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:59:44.391 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:44 smithi179 bash[23186]: cluster 2024-09-21T01:59:43.943382+0000 mgr.a (mgr.14388) 9749 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:59:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:44 smithi044 bash[22676]: cluster 2024-09-21T01:59:43.943382+0000 mgr.a (mgr.14388) 9749 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:59:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:46 smithi179 bash[23186]: cluster 2024-09-21T01:59:45.945568+0000 mgr.a (mgr.14388) 9750 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:46 smithi049 bash[23528]: cluster 2024-09-21T01:59:45.945568+0000 mgr.a (mgr.14388) 9750 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:46 smithi044 bash[22676]: cluster 2024-09-21T01:59:45.945568+0000 mgr.a (mgr.14388) 9750 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T01:59:48.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:48.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:48 smithi049 bash[23528]: cluster 2024-09-21T01:59:47.946316+0000 mgr.a (mgr.14388) 9751 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:48 smithi044 bash[22676]: cluster 2024-09-21T01:59:47.946316+0000 mgr.a (mgr.14388) 9751 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:48 smithi179 bash[23186]: cluster 2024-09-21T01:59:47.946316+0000 mgr.a (mgr.14388) 9751 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:48.814 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:48.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:48.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:48.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:48.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:49 smithi179 bash[23186]: audit 2024-09-21T01:59:48.361789+0000 mgr.a (mgr.14388) 9752 : audit [DBG] from='client.216150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:49 smithi049 bash[23528]: audit 2024-09-21T01:59:48.361789+0000 mgr.a (mgr.14388) 9752 : audit [DBG] from='client.216150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:49 smithi044 bash[22676]: audit 2024-09-21T01:59:48.361789+0000 mgr.a (mgr.14388) 9752 : audit [DBG] from='client.216150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:50 smithi044 bash[22676]: cluster 2024-09-21T01:59:49.946925+0000 mgr.a (mgr.14388) 9753 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:50 smithi049 bash[23528]: cluster 2024-09-21T01:59:49.946925+0000 mgr.a (mgr.14388) 9753 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:50 smithi179 bash[23186]: cluster 2024-09-21T01:59:49.946925+0000 mgr.a (mgr.14388) 9753 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:51 smithi044 bash[22676]: audit 2024-09-21T01:59:50.234710+0000 mon.a (mon.0) 8127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:51 smithi044 bash[22676]: audit 2024-09-21T01:59:50.243005+0000 mon.a (mon.0) 8128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:51 smithi044 bash[22676]: audit 2024-09-21T01:59:50.253363+0000 mon.a (mon.0) 8129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:51 smithi044 bash[22676]: audit 2024-09-21T01:59:50.269012+0000 mon.a (mon.0) 8130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:51 smithi044 bash[22676]: audit 2024-09-21T01:59:50.277801+0000 mon.a (mon.0) 8131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:51 smithi044 bash[22676]: audit 2024-09-21T01:59:50.288040+0000 mon.a (mon.0) 8132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:51 smithi179 bash[23186]: audit 2024-09-21T01:59:50.234710+0000 mon.a (mon.0) 8127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:51 smithi179 bash[23186]: audit 2024-09-21T01:59:50.243005+0000 mon.a (mon.0) 8128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:51 smithi179 bash[23186]: audit 2024-09-21T01:59:50.253363+0000 mon.a (mon.0) 8129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:51 smithi179 bash[23186]: audit 2024-09-21T01:59:50.269012+0000 mon.a (mon.0) 8130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:51 smithi179 bash[23186]: audit 2024-09-21T01:59:50.277801+0000 mon.a (mon.0) 8131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:51 smithi179 bash[23186]: audit 2024-09-21T01:59:50.288040+0000 mon.a (mon.0) 8132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:51 smithi049 bash[23528]: audit 2024-09-21T01:59:50.234710+0000 mon.a (mon.0) 8127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:51 smithi049 bash[23528]: audit 2024-09-21T01:59:50.243005+0000 mon.a (mon.0) 8128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:51 smithi049 bash[23528]: audit 2024-09-21T01:59:50.253363+0000 mon.a (mon.0) 8129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:51 smithi049 bash[23528]: audit 2024-09-21T01:59:50.269012+0000 mon.a (mon.0) 8130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:51 smithi049 bash[23528]: audit 2024-09-21T01:59:50.277801+0000 mon.a (mon.0) 8131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:51.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:51 smithi049 bash[23528]: audit 2024-09-21T01:59:50.288040+0000 mon.a (mon.0) 8132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:52 smithi179 bash[23186]: cluster 2024-09-21T01:59:51.949114+0000 mgr.a (mgr.14388) 9754 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:52 smithi049 bash[23528]: cluster 2024-09-21T01:59:51.949114+0000 mgr.a (mgr.14388) 9754 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:52 smithi044 bash[22676]: cluster 2024-09-21T01:59:51.949114+0000 mgr.a (mgr.14388) 9754 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:53.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:53.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:53.817 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T01:59:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:54 smithi049 bash[23528]: cluster 2024-09-21T01:59:53.949576+0000 mgr.a (mgr.14388) 9755 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:54.468 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:54 smithi044 bash[22676]: cluster 2024-09-21T01:59:53.949576+0000 mgr.a (mgr.14388) 9755 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:54 smithi179 bash[23186]: cluster 2024-09-21T01:59:53.949576+0000 mgr.a (mgr.14388) 9755 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:54.606 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T01:59:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T01:59:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T01:59:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T01:59:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T01:59:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:55 smithi049 bash[23528]: audit 2024-09-21T01:59:54.157461+0000 mgr.a (mgr.14388) 9756 : audit [DBG] from='client.216228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:55.332 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:55 smithi044 bash[22676]: audit 2024-09-21T01:59:54.157461+0000 mgr.a (mgr.14388) 9756 : audit [DBG] from='client.216228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:55 smithi179 bash[23186]: audit 2024-09-21T01:59:54.157461+0000 mgr.a (mgr.14388) 9756 : audit [DBG] from='client.216228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:59:56.314 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:56 smithi044 bash[22676]: cluster 2024-09-21T01:59:55.951796+0000 mgr.a (mgr.14388) 9757 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:56 smithi179 bash[23186]: cluster 2024-09-21T01:59:55.951796+0000 mgr.a (mgr.14388) 9757 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:56 smithi049 bash[23528]: cluster 2024-09-21T01:59:55.951796+0000 mgr.a (mgr.14388) 9757 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T01:59:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:58 smithi044 bash[22676]: audit 2024-09-21T01:59:57.056773+0000 mon.a (mon.0) 8133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:58 smithi044 bash[22676]: audit 2024-09-21T01:59:57.062053+0000 mon.a (mon.0) 8134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:58 smithi044 bash[22676]: audit 2024-09-21T01:59:57.067958+0000 mon.a (mon.0) 8135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 01:59:58 smithi044 bash[22676]: cluster 2024-09-21T01:59:57.952566+0000 mgr.a (mgr.14388) 9758 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:58 smithi179 bash[23186]: audit 2024-09-21T01:59:57.056773+0000 mon.a (mon.0) 8133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:58 smithi179 bash[23186]: audit 2024-09-21T01:59:57.062053+0000 mon.a (mon.0) 8134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:58 smithi179 bash[23186]: audit 2024-09-21T01:59:57.067958+0000 mon.a (mon.0) 8135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 01:59:58 smithi179 bash[23186]: cluster 2024-09-21T01:59:57.952566+0000 mgr.a (mgr.14388) 9758 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:58 smithi049 bash[23528]: audit 2024-09-21T01:59:57.056773+0000 mon.a (mon.0) 8133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:58 smithi049 bash[23528]: audit 2024-09-21T01:59:57.062053+0000 mon.a (mon.0) 8134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:58 smithi049 bash[23528]: audit 2024-09-21T01:59:57.067958+0000 mon.a (mon.0) 8135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T01:59:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 01:59:58 smithi049 bash[23528]: cluster 2024-09-21T01:59:57.952566+0000 mgr.a (mgr.14388) 9758 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T01:59:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T01:59:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T01:59:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:00 smithi049 bash[23528]: audit 2024-09-21T01:59:59.944024+0000 mgr.a (mgr.14388) 9759 : audit [DBG] from='client.216306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:00 smithi049 bash[23528]: cluster 2024-09-21T01:59:59.961947+0000 mgr.a (mgr.14388) 9760 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:00 smithi049 bash[23528]: cluster 2024-09-21T02:00:00.000096+0000 mon.a (mon.0) 8136 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:00:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:00.366 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:00 smithi044 bash[22676]: audit 2024-09-21T01:59:59.944024+0000 mgr.a (mgr.14388) 9759 : audit [DBG] from='client.216306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:00 smithi044 bash[22676]: cluster 2024-09-21T01:59:59.961947+0000 mgr.a (mgr.14388) 9760 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:00 smithi044 bash[22676]: cluster 2024-09-21T02:00:00.000096+0000 mon.a (mon.0) 8136 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:00:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:00 smithi179 bash[23186]: audit 2024-09-21T01:59:59.944024+0000 mgr.a (mgr.14388) 9759 : audit [DBG] from='client.216306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:00 smithi179 bash[23186]: cluster 2024-09-21T01:59:59.961947+0000 mgr.a (mgr.14388) 9760 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:00 smithi179 bash[23186]: cluster 2024-09-21T02:00:00.000096+0000 mon.a (mon.0) 8136 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:00:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:02 smithi049 bash[23528]: cluster 2024-09-21T02:00:01.964832+0000 mgr.a (mgr.14388) 9761 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:02 smithi044 bash[22676]: cluster 2024-09-21T02:00:01.964832+0000 mgr.a (mgr.14388) 9761 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:02 smithi179 bash[23186]: cluster 2024-09-21T02:00:01.964832+0000 mgr.a (mgr.14388) 9761 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:04.298 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:04 smithi179 bash[23186]: cluster 2024-09-21T02:00:03.965633+0000 mgr.a (mgr.14388) 9762 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:04 smithi049 bash[23528]: cluster 2024-09-21T02:00:03.965633+0000 mgr.a (mgr.14388) 9762 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:04 smithi044 bash[22676]: cluster 2024-09-21T02:00:03.965633+0000 mgr.a (mgr.14388) 9762 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:05.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:05.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:05.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:06.112 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:06.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:06.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:06 smithi049 bash[23528]: audit 2024-09-21T02:00:05.701768+0000 mgr.a (mgr.14388) 9763 : audit [DBG] from='client.216384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:06 smithi049 bash[23528]: cluster 2024-09-21T02:00:05.966907+0000 mgr.a (mgr.14388) 9764 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:06 smithi044 bash[22676]: audit 2024-09-21T02:00:05.701768+0000 mgr.a (mgr.14388) 9763 : audit [DBG] from='client.216384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:06 smithi044 bash[22676]: cluster 2024-09-21T02:00:05.966907+0000 mgr.a (mgr.14388) 9764 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:06 smithi179 bash[23186]: audit 2024-09-21T02:00:05.701768+0000 mgr.a (mgr.14388) 9763 : audit [DBG] from='client.216384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:06 smithi179 bash[23186]: cluster 2024-09-21T02:00:05.966907+0000 mgr.a (mgr.14388) 9764 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:08 smithi049 bash[23528]: cluster 2024-09-21T02:00:07.967447+0000 mgr.a (mgr.14388) 9765 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:08 smithi044 bash[22676]: cluster 2024-09-21T02:00:07.967447+0000 mgr.a (mgr.14388) 9765 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:08 smithi179 bash[23186]: cluster 2024-09-21T02:00:07.967447+0000 mgr.a (mgr.14388) 9765 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:10 smithi049 bash[23528]: cluster 2024-09-21T02:00:09.968164+0000 mgr.a (mgr.14388) 9766 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:10.483 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:10 smithi044 bash[22676]: cluster 2024-09-21T02:00:09.968164+0000 mgr.a (mgr.14388) 9766 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:10 smithi179 bash[23186]: cluster 2024-09-21T02:00:09.968164+0000 mgr.a (mgr.14388) 9766 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:00:11.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:11.115 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:11.115 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:11 smithi044 bash[22676]: audit 2024-09-21T02:00:10.462324+0000 mon.a (mon.0) 8137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:11 smithi044 bash[22676]: audit 2024-09-21T02:00:10.470726+0000 mon.a (mon.0) 8138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:11 smithi044 bash[22676]: audit 2024-09-21T02:00:10.481387+0000 mon.a (mon.0) 8139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:11 smithi044 bash[22676]: audit 2024-09-21T02:00:10.491352+0000 mon.a (mon.0) 8140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:11 smithi044 bash[22676]: audit 2024-09-21T02:00:10.500596+0000 mon.a (mon.0) 8141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:11 smithi044 bash[22676]: audit 2024-09-21T02:00:10.509373+0000 mon.a (mon.0) 8142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:11 smithi179 bash[23186]: audit 2024-09-21T02:00:10.462324+0000 mon.a (mon.0) 8137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:11 smithi179 bash[23186]: audit 2024-09-21T02:00:10.470726+0000 mon.a (mon.0) 8138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:11 smithi179 bash[23186]: audit 2024-09-21T02:00:10.481387+0000 mon.a (mon.0) 8139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:11 smithi179 bash[23186]: audit 2024-09-21T02:00:10.491352+0000 mon.a (mon.0) 8140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:11 smithi179 bash[23186]: audit 2024-09-21T02:00:10.500596+0000 mon.a (mon.0) 8141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:11 smithi179 bash[23186]: audit 2024-09-21T02:00:10.509373+0000 mon.a (mon.0) 8142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:11 smithi049 bash[23528]: audit 2024-09-21T02:00:10.462324+0000 mon.a (mon.0) 8137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:11 smithi049 bash[23528]: audit 2024-09-21T02:00:10.470726+0000 mon.a (mon.0) 8138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:11 smithi049 bash[23528]: audit 2024-09-21T02:00:10.481387+0000 mon.a (mon.0) 8139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:11 smithi049 bash[23528]: audit 2024-09-21T02:00:10.491352+0000 mon.a (mon.0) 8140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:11 smithi049 bash[23528]: audit 2024-09-21T02:00:10.500596+0000 mon.a (mon.0) 8141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:11 smithi049 bash[23528]: audit 2024-09-21T02:00:10.509373+0000 mon.a (mon.0) 8142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:11.908 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:11.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:11.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:11.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:11.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:12 smithi044 bash[22676]: audit 2024-09-21T02:00:11.455028+0000 mgr.a (mgr.14388) 9767 : audit [DBG] from='client.216462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:12 smithi044 bash[22676]: cluster 2024-09-21T02:00:11.970213+0000 mgr.a (mgr.14388) 9768 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:12 smithi179 bash[23186]: audit 2024-09-21T02:00:11.455028+0000 mgr.a (mgr.14388) 9767 : audit [DBG] from='client.216462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:12 smithi179 bash[23186]: cluster 2024-09-21T02:00:11.970213+0000 mgr.a (mgr.14388) 9768 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:12 smithi049 bash[23528]: audit 2024-09-21T02:00:11.455028+0000 mgr.a (mgr.14388) 9767 : audit [DBG] from='client.216462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:12 smithi049 bash[23528]: cluster 2024-09-21T02:00:11.970213+0000 mgr.a (mgr.14388) 9768 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:14 smithi049 bash[23528]: cluster 2024-09-21T02:00:13.970929+0000 mgr.a (mgr.14388) 9769 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:14 smithi044 bash[22676]: cluster 2024-09-21T02:00:13.970929+0000 mgr.a (mgr.14388) 9769 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:14 smithi179 bash[23186]: cluster 2024-09-21T02:00:13.970929+0000 mgr.a (mgr.14388) 9769 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:16 smithi049 bash[23528]: cluster 2024-09-21T02:00:15.972953+0000 mgr.a (mgr.14388) 9770 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:16 smithi044 bash[22676]: cluster 2024-09-21T02:00:15.972953+0000 mgr.a (mgr.14388) 9770 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:16 smithi179 bash[23186]: cluster 2024-09-21T02:00:15.972953+0000 mgr.a (mgr.14388) 9770 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:16.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:16.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:16.910 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:17.689 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:17.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:17.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:17.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:17.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:18 smithi044 bash[22676]: audit 2024-09-21T02:00:17.235850+0000 mon.a (mon.0) 8143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:18 smithi044 bash[22676]: audit 2024-09-21T02:00:17.240232+0000 mgr.a (mgr.14388) 9771 : audit [DBG] from='client.216540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:18 smithi044 bash[22676]: audit 2024-09-21T02:00:17.241522+0000 mon.a (mon.0) 8144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:18 smithi044 bash[22676]: audit 2024-09-21T02:00:17.265144+0000 mon.a (mon.0) 8145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:18 smithi044 bash[22676]: cluster 2024-09-21T02:00:17.973821+0000 mgr.a (mgr.14388) 9772 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:18 smithi179 bash[23186]: audit 2024-09-21T02:00:17.235850+0000 mon.a (mon.0) 8143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:18 smithi179 bash[23186]: audit 2024-09-21T02:00:17.240232+0000 mgr.a (mgr.14388) 9771 : audit [DBG] from='client.216540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:18 smithi179 bash[23186]: audit 2024-09-21T02:00:17.241522+0000 mon.a (mon.0) 8144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:18 smithi179 bash[23186]: audit 2024-09-21T02:00:17.265144+0000 mon.a (mon.0) 8145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:18 smithi179 bash[23186]: cluster 2024-09-21T02:00:17.973821+0000 mgr.a (mgr.14388) 9772 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:18 smithi049 bash[23528]: audit 2024-09-21T02:00:17.235850+0000 mon.a (mon.0) 8143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:18 smithi049 bash[23528]: audit 2024-09-21T02:00:17.240232+0000 mgr.a (mgr.14388) 9771 : audit [DBG] from='client.216540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:18 smithi049 bash[23528]: audit 2024-09-21T02:00:17.241522+0000 mon.a (mon.0) 8144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:18 smithi049 bash[23528]: audit 2024-09-21T02:00:17.265144+0000 mon.a (mon.0) 8145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:18 smithi049 bash[23528]: cluster 2024-09-21T02:00:17.973821+0000 mgr.a (mgr.14388) 9772 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:20 smithi049 bash[23528]: cluster 2024-09-21T02:00:19.974633+0000 mgr.a (mgr.14388) 9773 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:20 smithi044 bash[22676]: cluster 2024-09-21T02:00:19.974633+0000 mgr.a (mgr.14388) 9773 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:20 smithi179 bash[23186]: cluster 2024-09-21T02:00:19.974633+0000 mgr.a (mgr.14388) 9773 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:22 smithi049 bash[23528]: cluster 2024-09-21T02:00:21.976799+0000 mgr.a (mgr.14388) 9774 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:22 smithi044 bash[22676]: cluster 2024-09-21T02:00:21.976799+0000 mgr.a (mgr.14388) 9774 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:22 smithi179 bash[23186]: cluster 2024-09-21T02:00:21.976799+0000 mgr.a (mgr.14388) 9774 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:22.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:22.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:22.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:23.444 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:23.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:24 smithi049 bash[23528]: audit 2024-09-21T02:00:23.016098+0000 mgr.a (mgr.14388) 9775 : audit [DBG] from='client.216615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:24 smithi049 bash[23528]: cluster 2024-09-21T02:00:23.977823+0000 mgr.a (mgr.14388) 9776 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:24.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:24 smithi179 bash[23186]: audit 2024-09-21T02:00:23.016098+0000 mgr.a (mgr.14388) 9775 : audit [DBG] from='client.216615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:24.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:24 smithi179 bash[23186]: cluster 2024-09-21T02:00:23.977823+0000 mgr.a (mgr.14388) 9776 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:24 smithi044 bash[22676]: audit 2024-09-21T02:00:23.016098+0000 mgr.a (mgr.14388) 9775 : audit [DBG] from='client.216615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:24 smithi044 bash[22676]: cluster 2024-09-21T02:00:23.977823+0000 mgr.a (mgr.14388) 9776 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:26 smithi049 bash[23528]: cluster 2024-09-21T02:00:25.980023+0000 mgr.a (mgr.14388) 9777 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:26 smithi044 bash[22676]: cluster 2024-09-21T02:00:25.980023+0000 mgr.a (mgr.14388) 9777 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:26 smithi179 bash[23186]: cluster 2024-09-21T02:00:25.980023+0000 mgr.a (mgr.14388) 9777 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:28 smithi049 bash[23528]: cluster 2024-09-21T02:00:27.980820+0000 mgr.a (mgr.14388) 9778 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:28.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:28.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:28.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:28 smithi044 bash[22676]: cluster 2024-09-21T02:00:27.980820+0000 mgr.a (mgr.14388) 9778 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:28 smithi179 bash[23186]: cluster 2024-09-21T02:00:27.980820+0000 mgr.a (mgr.14388) 9778 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:29.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:29.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:29.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:29.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:29.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:29 smithi179 bash[23186]: audit 2024-09-21T02:00:28.800041+0000 mgr.a (mgr.14388) 9779 : audit [DBG] from='client.216690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:29.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:29 smithi049 bash[23528]: audit 2024-09-21T02:00:28.800041+0000 mgr.a (mgr.14388) 9779 : audit [DBG] from='client.216690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:29 smithi044 bash[22676]: audit 2024-09-21T02:00:28.800041+0000 mgr.a (mgr.14388) 9779 : audit [DBG] from='client.216690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:30 smithi179 bash[23186]: cluster 2024-09-21T02:00:29.983211+0000 mgr.a (mgr.14388) 9780 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:30 smithi049 bash[23528]: cluster 2024-09-21T02:00:29.983211+0000 mgr.a (mgr.14388) 9780 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:30.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:30 smithi044 bash[22676]: cluster 2024-09-21T02:00:29.983211+0000 mgr.a (mgr.14388) 9780 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:31.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22930]: debug 2024-09-21T02:00:31.637+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:00:31.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22930]: debug 2024-09-21T02:00:31.641+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.702719+0000 mon.a (mon.0) 8146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.710502+0000 mon.a (mon.0) 8147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.725343+0000 mon.a (mon.0) 8148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.734155+0000 mon.a (mon.0) 8149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.742444+0000 mon.a (mon.0) 8150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.752488+0000 mon.a (mon.0) 8151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.801181+0000 mon.a (mon.0) 8152 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.807797+0000 mon.a (mon.0) 8153 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.809670+0000 mon.a (mon.0) 8154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.820407+0000 mon.a (mon.0) 8155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.826726+0000 mon.a (mon.0) 8156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:00:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:31 smithi044 bash[22676]: audit 2024-09-21T02:00:30.829121+0000 mgr.a (mgr.14388) 9781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.702719+0000 mon.a (mon.0) 8146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.710502+0000 mon.a (mon.0) 8147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.725343+0000 mon.a (mon.0) 8148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.734155+0000 mon.a (mon.0) 8149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.742444+0000 mon.a (mon.0) 8150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.752488+0000 mon.a (mon.0) 8151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.801181+0000 mon.a (mon.0) 8152 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.807797+0000 mon.a (mon.0) 8153 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.809670+0000 mon.a (mon.0) 8154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.820407+0000 mon.a (mon.0) 8155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.826726+0000 mon.a (mon.0) 8156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:00:32.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:31 smithi179 bash[23186]: audit 2024-09-21T02:00:30.829121+0000 mgr.a (mgr.14388) 9781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:00:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.702719+0000 mon.a (mon.0) 8146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.710502+0000 mon.a (mon.0) 8147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.725343+0000 mon.a (mon.0) 8148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.734155+0000 mon.a (mon.0) 8149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.742444+0000 mon.a (mon.0) 8150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.752488+0000 mon.a (mon.0) 8151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.801181+0000 mon.a (mon.0) 8152 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.807797+0000 mon.a (mon.0) 8153 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.809670+0000 mon.a (mon.0) 8154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.820407+0000 mon.a (mon.0) 8155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.826726+0000 mon.a (mon.0) 8156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:00:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:31 smithi049 bash[23528]: audit 2024-09-21T02:00:30.829121+0000 mgr.a (mgr.14388) 9781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:00:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:32 smithi044 bash[22676]: audit 2024-09-21T02:00:31.644960+0000 mgr.a (mgr.14388) 9782 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:00:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:32 smithi044 bash[22676]: cephadm 2024-09-21T02:00:31.646917+0000 mgr.a (mgr.14388) 9783 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:00:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:32 smithi044 bash[22676]: cluster 2024-09-21T02:00:31.984188+0000 mgr.a (mgr.14388) 9784 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:32 smithi179 bash[23186]: audit 2024-09-21T02:00:31.644960+0000 mgr.a (mgr.14388) 9782 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:00:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:32 smithi179 bash[23186]: cephadm 2024-09-21T02:00:31.646917+0000 mgr.a (mgr.14388) 9783 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:00:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:32 smithi179 bash[23186]: cluster 2024-09-21T02:00:31.984188+0000 mgr.a (mgr.14388) 9784 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:32 smithi049 bash[23528]: audit 2024-09-21T02:00:31.644960+0000 mgr.a (mgr.14388) 9782 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:00:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:32 smithi049 bash[23528]: cephadm 2024-09-21T02:00:31.646917+0000 mgr.a (mgr.14388) 9783 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:00:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:32 smithi049 bash[23528]: cluster 2024-09-21T02:00:31.984188+0000 mgr.a (mgr.14388) 9784 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:34.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:34.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:34.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:34 smithi049 bash[23528]: cluster 2024-09-21T02:00:33.984976+0000 mgr.a (mgr.14388) 9785 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:34 smithi044 bash[22676]: cluster 2024-09-21T02:00:33.984976+0000 mgr.a (mgr.14388) 9785 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:34 smithi179 bash[23186]: cluster 2024-09-21T02:00:33.984976+0000 mgr.a (mgr.14388) 9785 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:34.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:34.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:34.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:34.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:34.997 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:35 smithi049 bash[23528]: audit 2024-09-21T02:00:34.555707+0000 mgr.a (mgr.14388) 9786 : audit [DBG] from='client.216867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:35.316 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:35 smithi044 bash[22676]: audit 2024-09-21T02:00:34.555707+0000 mgr.a (mgr.14388) 9786 : audit [DBG] from='client.216867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:35 smithi179 bash[23186]: audit 2024-09-21T02:00:34.555707+0000 mgr.a (mgr.14388) 9786 : audit [DBG] from='client.216867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:36 smithi044 bash[22676]: cluster 2024-09-21T02:00:35.987401+0000 mgr.a (mgr.14388) 9787 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:36 smithi179 bash[23186]: cluster 2024-09-21T02:00:35.987401+0000 mgr.a (mgr.14388) 9787 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:36 smithi049 bash[23528]: cluster 2024-09-21T02:00:35.987401+0000 mgr.a (mgr.14388) 9787 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:38 smithi049 bash[23528]: audit 2024-09-21T02:00:37.467356+0000 mon.a (mon.0) 8157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:38 smithi049 bash[23528]: audit 2024-09-21T02:00:37.473450+0000 mon.a (mon.0) 8158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:38 smithi049 bash[23528]: audit 2024-09-21T02:00:37.481713+0000 mon.a (mon.0) 8159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:38 smithi049 bash[23528]: cluster 2024-09-21T02:00:37.988064+0000 mgr.a (mgr.14388) 9788 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:38 smithi044 bash[22676]: audit 2024-09-21T02:00:37.467356+0000 mon.a (mon.0) 8157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:38 smithi044 bash[22676]: audit 2024-09-21T02:00:37.473450+0000 mon.a (mon.0) 8158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:38 smithi044 bash[22676]: audit 2024-09-21T02:00:37.481713+0000 mon.a (mon.0) 8159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:38 smithi044 bash[22676]: cluster 2024-09-21T02:00:37.988064+0000 mgr.a (mgr.14388) 9788 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:38 smithi179 bash[23186]: audit 2024-09-21T02:00:37.467356+0000 mon.a (mon.0) 8157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:38 smithi179 bash[23186]: audit 2024-09-21T02:00:37.473450+0000 mon.a (mon.0) 8158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:38 smithi179 bash[23186]: audit 2024-09-21T02:00:37.481713+0000 mon.a (mon.0) 8159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:38 smithi179 bash[23186]: cluster 2024-09-21T02:00:37.988064+0000 mgr.a (mgr.14388) 9788 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:39.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:39.999 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:40.000 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:40 smithi049 bash[23528]: cluster 2024-09-21T02:00:39.990019+0000 mgr.a (mgr.14388) 9789 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:40 smithi044 bash[22676]: cluster 2024-09-21T02:00:39.990019+0000 mgr.a (mgr.14388) 9789 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:40 smithi179 bash[23186]: cluster 2024-09-21T02:00:39.990019+0000 mgr.a (mgr.14388) 9789 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:40.784 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:41 smithi044 bash[22676]: audit 2024-09-21T02:00:40.338169+0000 mgr.a (mgr.14388) 9790 : audit [DBG] from='client.216942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:41.494 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:41 smithi049 bash[23528]: audit 2024-09-21T02:00:40.338169+0000 mgr.a (mgr.14388) 9790 : audit [DBG] from='client.216942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:41 smithi179 bash[23186]: audit 2024-09-21T02:00:40.338169+0000 mgr.a (mgr.14388) 9790 : audit [DBG] from='client.216942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:42.379 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:42 smithi049 bash[23528]: cluster 2024-09-21T02:00:41.991083+0000 mgr.a (mgr.14388) 9791 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:42 smithi044 bash[22676]: cluster 2024-09-21T02:00:41.991083+0000 mgr.a (mgr.14388) 9791 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:42 smithi179 bash[23186]: cluster 2024-09-21T02:00:41.991083+0000 mgr.a (mgr.14388) 9791 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:44.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:44 smithi179 bash[23186]: cluster 2024-09-21T02:00:43.991875+0000 mgr.a (mgr.14388) 9792 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:44 smithi044 bash[22676]: cluster 2024-09-21T02:00:43.991875+0000 mgr.a (mgr.14388) 9792 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:44 smithi049 bash[23528]: cluster 2024-09-21T02:00:43.991875+0000 mgr.a (mgr.14388) 9792 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:00:45.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:45.785 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:45.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:46 smithi044 bash[22676]: cluster 2024-09-21T02:00:45.994050+0000 mgr.a (mgr.14388) 9793 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:46 smithi179 bash[23186]: cluster 2024-09-21T02:00:45.994050+0000 mgr.a (mgr.14388) 9793 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:46 smithi049 bash[23528]: cluster 2024-09-21T02:00:45.994050+0000 mgr.a (mgr.14388) 9793 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:00:46.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:46.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:46.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:46.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:46.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:47 smithi179 bash[23186]: audit 2024-09-21T02:00:46.122590+0000 mgr.a (mgr.14388) 9794 : audit [DBG] from='client.217020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:47 smithi044 bash[22676]: audit 2024-09-21T02:00:46.122590+0000 mgr.a (mgr.14388) 9794 : audit [DBG] from='client.217020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:47 smithi049 bash[23528]: audit 2024-09-21T02:00:46.122590+0000 mgr.a (mgr.14388) 9794 : audit [DBG] from='client.217020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:48 smithi044 bash[22676]: cluster 2024-09-21T02:00:47.995080+0000 mgr.a (mgr.14388) 9795 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:00:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:48 smithi179 bash[23186]: cluster 2024-09-21T02:00:47.995080+0000 mgr.a (mgr.14388) 9795 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:00:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:48 smithi049 bash[23528]: cluster 2024-09-21T02:00:47.995080+0000 mgr.a (mgr.14388) 9795 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:00:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:50 smithi044 bash[22676]: cluster 2024-09-21T02:00:49.997305+0000 mgr.a (mgr.14388) 9796 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:00:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:50 smithi179 bash[23186]: cluster 2024-09-21T02:00:49.997305+0000 mgr.a (mgr.14388) 9796 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:00:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:50 smithi049 bash[23528]: cluster 2024-09-21T02:00:49.997305+0000 mgr.a (mgr.14388) 9796 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:00:51.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:51.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:51.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:51 smithi044 bash[22676]: audit 2024-09-21T02:00:50.946557+0000 mon.a (mon.0) 8160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:51 smithi044 bash[22676]: audit 2024-09-21T02:00:50.957734+0000 mon.a (mon.0) 8161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:51 smithi044 bash[22676]: audit 2024-09-21T02:00:50.968726+0000 mon.a (mon.0) 8162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:51 smithi044 bash[22676]: audit 2024-09-21T02:00:50.978013+0000 mon.a (mon.0) 8163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:51 smithi044 bash[22676]: audit 2024-09-21T02:00:50.986383+0000 mon.a (mon.0) 8164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:51 smithi044 bash[22676]: audit 2024-09-21T02:00:50.996551+0000 mon.a (mon.0) 8165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:51 smithi179 bash[23186]: audit 2024-09-21T02:00:50.946557+0000 mon.a (mon.0) 8160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:51 smithi179 bash[23186]: audit 2024-09-21T02:00:50.957734+0000 mon.a (mon.0) 8161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:51 smithi179 bash[23186]: audit 2024-09-21T02:00:50.968726+0000 mon.a (mon.0) 8162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:51 smithi179 bash[23186]: audit 2024-09-21T02:00:50.978013+0000 mon.a (mon.0) 8163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:51 smithi179 bash[23186]: audit 2024-09-21T02:00:50.986383+0000 mon.a (mon.0) 8164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:51 smithi179 bash[23186]: audit 2024-09-21T02:00:50.996551+0000 mon.a (mon.0) 8165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:51 smithi049 bash[23528]: audit 2024-09-21T02:00:50.946557+0000 mon.a (mon.0) 8160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:51 smithi049 bash[23528]: audit 2024-09-21T02:00:50.957734+0000 mon.a (mon.0) 8161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:51 smithi049 bash[23528]: audit 2024-09-21T02:00:50.968726+0000 mon.a (mon.0) 8162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:51 smithi049 bash[23528]: audit 2024-09-21T02:00:50.978013+0000 mon.a (mon.0) 8163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:51 smithi049 bash[23528]: audit 2024-09-21T02:00:50.986383+0000 mon.a (mon.0) 8164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:51 smithi049 bash[23528]: audit 2024-09-21T02:00:50.996551+0000 mon.a (mon.0) 8165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:52.362 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:52.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:52.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:52 smithi044 bash[22676]: audit 2024-09-21T02:00:51.919396+0000 mgr.a (mgr.14388) 9797 : audit [DBG] from='client.217095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:52 smithi044 bash[22676]: cluster 2024-09-21T02:00:51.997965+0000 mgr.a (mgr.14388) 9798 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:52 smithi179 bash[23186]: audit 2024-09-21T02:00:51.919396+0000 mgr.a (mgr.14388) 9797 : audit [DBG] from='client.217095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:52 smithi179 bash[23186]: cluster 2024-09-21T02:00:51.997965+0000 mgr.a (mgr.14388) 9798 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:52 smithi049 bash[23528]: audit 2024-09-21T02:00:51.919396+0000 mgr.a (mgr.14388) 9797 : audit [DBG] from='client.217095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:52 smithi049 bash[23528]: cluster 2024-09-21T02:00:51.997965+0000 mgr.a (mgr.14388) 9798 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:54 smithi044 bash[22676]: cluster 2024-09-21T02:00:53.998885+0000 mgr.a (mgr.14388) 9799 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:54 smithi179 bash[23186]: cluster 2024-09-21T02:00:53.998885+0000 mgr.a (mgr.14388) 9799 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:54 smithi049 bash[23528]: cluster 2024-09-21T02:00:53.998885+0000 mgr.a (mgr.14388) 9799 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:56 smithi044 bash[22676]: cluster 2024-09-21T02:00:56.001193+0000 mgr.a (mgr.14388) 9800 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:56 smithi179 bash[23186]: cluster 2024-09-21T02:00:56.001193+0000 mgr.a (mgr.14388) 9800 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:56 smithi049 bash[23528]: cluster 2024-09-21T02:00:56.001193+0000 mgr.a (mgr.14388) 9800 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:00:57.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:00:57.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:00:57.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:00:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:00:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:00:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:00:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:00:58.131 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:00:58.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:58 smithi049 bash[23528]: audit 2024-09-21T02:00:57.660884+0000 mon.a (mon.0) 8166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:58.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:58 smithi049 bash[23528]: audit 2024-09-21T02:00:57.665956+0000 mon.a (mon.0) 8167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:58.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:58 smithi049 bash[23528]: audit 2024-09-21T02:00:57.672645+0000 mon.a (mon.0) 8168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:58.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:58 smithi049 bash[23528]: audit 2024-09-21T02:00:57.714437+0000 mgr.a (mgr.14388) 9801 : audit [DBG] from='client.217173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:58.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:00:58 smithi049 bash[23528]: cluster 2024-09-21T02:00:58.001766+0000 mgr.a (mgr.14388) 9802 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:58 smithi044 bash[22676]: audit 2024-09-21T02:00:57.660884+0000 mon.a (mon.0) 8166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:58 smithi044 bash[22676]: audit 2024-09-21T02:00:57.665956+0000 mon.a (mon.0) 8167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:58 smithi044 bash[22676]: audit 2024-09-21T02:00:57.672645+0000 mon.a (mon.0) 8168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:58 smithi044 bash[22676]: audit 2024-09-21T02:00:57.714437+0000 mgr.a (mgr.14388) 9801 : audit [DBG] from='client.217173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:00:58 smithi044 bash[22676]: cluster 2024-09-21T02:00:58.001766+0000 mgr.a (mgr.14388) 9802 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:00:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:58 smithi179 bash[23186]: audit 2024-09-21T02:00:57.660884+0000 mon.a (mon.0) 8166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:58 smithi179 bash[23186]: audit 2024-09-21T02:00:57.665956+0000 mon.a (mon.0) 8167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:58 smithi179 bash[23186]: audit 2024-09-21T02:00:57.672645+0000 mon.a (mon.0) 8168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:00:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:58 smithi179 bash[23186]: audit 2024-09-21T02:00:57.714437+0000 mgr.a (mgr.14388) 9801 : audit [DBG] from='client.217173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:00:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:00:58 smithi179 bash[23186]: cluster 2024-09-21T02:00:58.001766+0000 mgr.a (mgr.14388) 9802 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:01 smithi044 bash[22676]: cluster 2024-09-21T02:01:00.003984+0000 mgr.a (mgr.14388) 9803 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:01 smithi179 bash[23186]: cluster 2024-09-21T02:01:00.003984+0000 mgr.a (mgr.14388) 9803 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:01 smithi049 bash[23528]: cluster 2024-09-21T02:01:00.003984+0000 mgr.a (mgr.14388) 9803 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:03.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:03.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:03 smithi044 bash[22676]: cluster 2024-09-21T02:01:02.004772+0000 mgr.a (mgr.14388) 9804 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:03 smithi179 bash[23186]: cluster 2024-09-21T02:01:02.004772+0000 mgr.a (mgr.14388) 9804 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:03 smithi049 bash[23528]: cluster 2024-09-21T02:01:02.004772+0000 mgr.a (mgr.14388) 9804 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:03.891 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:03.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:03.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:03.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:03.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:04 smithi044 bash[22676]: audit 2024-09-21T02:01:03.464883+0000 mgr.a (mgr.14388) 9805 : audit [DBG] from='client.217251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:04 smithi179 bash[23186]: audit 2024-09-21T02:01:03.464883+0000 mgr.a (mgr.14388) 9805 : audit [DBG] from='client.217251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:04 smithi049 bash[23528]: audit 2024-09-21T02:01:03.464883+0000 mgr.a (mgr.14388) 9805 : audit [DBG] from='client.217251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:05 smithi044 bash[22676]: cluster 2024-09-21T02:01:04.005769+0000 mgr.a (mgr.14388) 9806 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:05 smithi179 bash[23186]: cluster 2024-09-21T02:01:04.005769+0000 mgr.a (mgr.14388) 9806 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:05 smithi049 bash[23528]: cluster 2024-09-21T02:01:04.005769+0000 mgr.a (mgr.14388) 9806 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:07.451 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:07 smithi179 bash[23186]: cluster 2024-09-21T02:01:06.007935+0000 mgr.a (mgr.14388) 9807 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:07 smithi044 bash[22676]: cluster 2024-09-21T02:01:06.007935+0000 mgr.a (mgr.14388) 9807 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:07 smithi049 bash[23528]: cluster 2024-09-21T02:01:06.007935+0000 mgr.a (mgr.14388) 9807 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:08.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:09 smithi044 bash[22676]: cluster 2024-09-21T02:01:08.008741+0000 mgr.a (mgr.14388) 9808 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:09 smithi179 bash[23186]: cluster 2024-09-21T02:01:08.008741+0000 mgr.a (mgr.14388) 9808 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:09 smithi049 bash[23528]: cluster 2024-09-21T02:01:08.008741+0000 mgr.a (mgr.14388) 9808 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:09.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:09.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:10 smithi044 bash[22676]: audit 2024-09-21T02:01:09.229550+0000 mgr.a (mgr.14388) 9809 : audit [DBG] from='client.217323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:10 smithi179 bash[23186]: audit 2024-09-21T02:01:09.229550+0000 mgr.a (mgr.14388) 9809 : audit [DBG] from='client.217323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:10 smithi049 bash[23528]: audit 2024-09-21T02:01:09.229550+0000 mgr.a (mgr.14388) 9809 : audit [DBG] from='client.217323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:11 smithi044 bash[22676]: cluster 2024-09-21T02:01:10.011053+0000 mgr.a (mgr.14388) 9810 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:11 smithi179 bash[23186]: cluster 2024-09-21T02:01:10.011053+0000 mgr.a (mgr.14388) 9810 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:11 smithi049 bash[23528]: cluster 2024-09-21T02:01:10.011053+0000 mgr.a (mgr.14388) 9810 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:12 smithi044 bash[22676]: audit 2024-09-21T02:01:11.180253+0000 mon.a (mon.0) 8169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:12 smithi044 bash[22676]: audit 2024-09-21T02:01:11.186558+0000 mon.a (mon.0) 8170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:12 smithi044 bash[22676]: audit 2024-09-21T02:01:11.195563+0000 mon.a (mon.0) 8171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:12 smithi044 bash[22676]: audit 2024-09-21T02:01:11.206547+0000 mon.a (mon.0) 8172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:12 smithi044 bash[22676]: audit 2024-09-21T02:01:11.213815+0000 mon.a (mon.0) 8173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:12 smithi044 bash[22676]: audit 2024-09-21T02:01:11.224885+0000 mon.a (mon.0) 8174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:12 smithi179 bash[23186]: audit 2024-09-21T02:01:11.180253+0000 mon.a (mon.0) 8169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:12 smithi179 bash[23186]: audit 2024-09-21T02:01:11.186558+0000 mon.a (mon.0) 8170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:12 smithi179 bash[23186]: audit 2024-09-21T02:01:11.195563+0000 mon.a (mon.0) 8171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:12 smithi179 bash[23186]: audit 2024-09-21T02:01:11.206547+0000 mon.a (mon.0) 8172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:12 smithi179 bash[23186]: audit 2024-09-21T02:01:11.213815+0000 mon.a (mon.0) 8173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:12 smithi179 bash[23186]: audit 2024-09-21T02:01:11.224885+0000 mon.a (mon.0) 8174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:12 smithi049 bash[23528]: audit 2024-09-21T02:01:11.180253+0000 mon.a (mon.0) 8169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:12 smithi049 bash[23528]: audit 2024-09-21T02:01:11.186558+0000 mon.a (mon.0) 8170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:12 smithi049 bash[23528]: audit 2024-09-21T02:01:11.195563+0000 mon.a (mon.0) 8171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:12 smithi049 bash[23528]: audit 2024-09-21T02:01:11.206547+0000 mon.a (mon.0) 8172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:12 smithi049 bash[23528]: audit 2024-09-21T02:01:11.213815+0000 mon.a (mon.0) 8173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:12 smithi049 bash[23528]: audit 2024-09-21T02:01:11.224885+0000 mon.a (mon.0) 8174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:13 smithi044 bash[22676]: cluster 2024-09-21T02:01:12.011872+0000 mgr.a (mgr.14388) 9811 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:13 smithi179 bash[23186]: cluster 2024-09-21T02:01:12.011872+0000 mgr.a (mgr.14388) 9811 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:13 smithi049 bash[23528]: cluster 2024-09-21T02:01:12.011872+0000 mgr.a (mgr.14388) 9811 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:14.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:14.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:14.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:15.428 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:15.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:15.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:15 smithi044 bash[22676]: cluster 2024-09-21T02:01:14.012650+0000 mgr.a (mgr.14388) 9812 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:15 smithi044 bash[22676]: audit 2024-09-21T02:01:15.004618+0000 mgr.a (mgr.14388) 9813 : audit [DBG] from='client.217401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:15 smithi179 bash[23186]: cluster 2024-09-21T02:01:14.012650+0000 mgr.a (mgr.14388) 9812 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:15 smithi179 bash[23186]: audit 2024-09-21T02:01:15.004618+0000 mgr.a (mgr.14388) 9813 : audit [DBG] from='client.217401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:15 smithi049 bash[23528]: cluster 2024-09-21T02:01:14.012650+0000 mgr.a (mgr.14388) 9812 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:15 smithi049 bash[23528]: audit 2024-09-21T02:01:15.004618+0000 mgr.a (mgr.14388) 9813 : audit [DBG] from='client.217401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:16.414 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:16 smithi044 bash[22676]: cluster 2024-09-21T02:01:16.015672+0000 mgr.a (mgr.14388) 9814 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:16 smithi179 bash[23186]: cluster 2024-09-21T02:01:16.015672+0000 mgr.a (mgr.14388) 9814 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:16 smithi049 bash[23528]: cluster 2024-09-21T02:01:16.015672+0000 mgr.a (mgr.14388) 9814 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:19.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:18 smithi049 bash[23528]: audit 2024-09-21T02:01:17.888541+0000 mon.a (mon.0) 8175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:18 smithi049 bash[23528]: audit 2024-09-21T02:01:17.894287+0000 mon.a (mon.0) 8176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:18 smithi049 bash[23528]: audit 2024-09-21T02:01:17.899661+0000 mon.a (mon.0) 8177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:18 smithi049 bash[23528]: cluster 2024-09-21T02:01:18.016205+0000 mgr.a (mgr.14388) 9815 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:18 smithi044 bash[22676]: audit 2024-09-21T02:01:17.888541+0000 mon.a (mon.0) 8175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:18 smithi044 bash[22676]: audit 2024-09-21T02:01:17.894287+0000 mon.a (mon.0) 8176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:18 smithi044 bash[22676]: audit 2024-09-21T02:01:17.899661+0000 mon.a (mon.0) 8177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:18 smithi044 bash[22676]: cluster 2024-09-21T02:01:18.016205+0000 mgr.a (mgr.14388) 9815 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:18 smithi179 bash[23186]: audit 2024-09-21T02:01:17.888541+0000 mon.a (mon.0) 8175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:18 smithi179 bash[23186]: audit 2024-09-21T02:01:17.894287+0000 mon.a (mon.0) 8176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:18 smithi179 bash[23186]: audit 2024-09-21T02:01:17.899661+0000 mon.a (mon.0) 8177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:18 smithi179 bash[23186]: cluster 2024-09-21T02:01:18.016205+0000 mgr.a (mgr.14388) 9815 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:20.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:20.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:20.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:21.198 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:21.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:21 smithi044 bash[22676]: cluster 2024-09-21T02:01:20.018099+0000 mgr.a (mgr.14388) 9816 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:21 smithi044 bash[22676]: audit 2024-09-21T02:01:20.764148+0000 mgr.a (mgr.14388) 9817 : audit [DBG] from='client.217479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:21 smithi179 bash[23186]: cluster 2024-09-21T02:01:20.018099+0000 mgr.a (mgr.14388) 9816 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:21 smithi179 bash[23186]: audit 2024-09-21T02:01:20.764148+0000 mgr.a (mgr.14388) 9817 : audit [DBG] from='client.217479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:21 smithi049 bash[23528]: cluster 2024-09-21T02:01:20.018099+0000 mgr.a (mgr.14388) 9816 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:21 smithi049 bash[23528]: audit 2024-09-21T02:01:20.764148+0000 mgr.a (mgr.14388) 9817 : audit [DBG] from='client.217479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:23 smithi049 bash[23528]: cluster 2024-09-21T02:01:22.019112+0000 mgr.a (mgr.14388) 9818 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:23 smithi044 bash[22676]: cluster 2024-09-21T02:01:22.019112+0000 mgr.a (mgr.14388) 9818 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:23 smithi179 bash[23186]: cluster 2024-09-21T02:01:22.019112+0000 mgr.a (mgr.14388) 9818 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:25.239 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:25 smithi179 bash[23186]: cluster 2024-09-21T02:01:24.019929+0000 mgr.a (mgr.14388) 9819 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:25 smithi044 bash[22676]: cluster 2024-09-21T02:01:24.019929+0000 mgr.a (mgr.14388) 9819 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:25 smithi049 bash[23528]: cluster 2024-09-21T02:01:24.019929+0000 mgr.a (mgr.14388) 9819 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:26.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:26.200 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:26.201 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:26.966 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:27.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:27 smithi179 bash[23186]: cluster 2024-09-21T02:01:26.022283+0000 mgr.a (mgr.14388) 9820 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:27.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:27 smithi179 bash[23186]: audit 2024-09-21T02:01:26.534054+0000 mgr.a (mgr.14388) 9821 : audit [DBG] from='client.217554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:27 smithi044 bash[22676]: cluster 2024-09-21T02:01:26.022283+0000 mgr.a (mgr.14388) 9820 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:27 smithi044 bash[22676]: audit 2024-09-21T02:01:26.534054+0000 mgr.a (mgr.14388) 9821 : audit [DBG] from='client.217554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:27 smithi049 bash[23528]: cluster 2024-09-21T02:01:26.022283+0000 mgr.a (mgr.14388) 9820 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:27 smithi049 bash[23528]: audit 2024-09-21T02:01:26.534054+0000 mgr.a (mgr.14388) 9821 : audit [DBG] from='client.217554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:29 smithi044 bash[22676]: cluster 2024-09-21T02:01:28.023295+0000 mgr.a (mgr.14388) 9822 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:29 smithi179 bash[23186]: cluster 2024-09-21T02:01:28.023295+0000 mgr.a (mgr.14388) 9822 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:29 smithi049 bash[23528]: cluster 2024-09-21T02:01:28.023295+0000 mgr.a (mgr.14388) 9822 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:31.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:31 smithi179 bash[23186]: cluster 2024-09-21T02:01:30.025450+0000 mgr.a (mgr.14388) 9823 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:31.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:31 smithi044 bash[22676]: cluster 2024-09-21T02:01:30.025450+0000 mgr.a (mgr.14388) 9823 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:31 smithi049 bash[23528]: cluster 2024-09-21T02:01:30.025450+0000 mgr.a (mgr.14388) 9823 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:01:31.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:32.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22930]: debug 2024-09-21T02:01:32.544+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:01:32.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22930]: debug 2024-09-21T02:01:32.556+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:01:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.397322+0000 mon.a (mon.0) 8178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.403330+0000 mon.a (mon.0) 8179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.412631+0000 mon.a (mon.0) 8180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.431018+0000 mon.a (mon.0) 8181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.439373+0000 mon.a (mon.0) 8182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.448673+0000 mon.a (mon.0) 8183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.715784+0000 mon.a (mon.0) 8184 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.722026+0000 mon.a (mon.0) 8185 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.723883+0000 mon.a (mon.0) 8186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.734809+0000 mon.a (mon.0) 8187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.741047+0000 mon.a (mon.0) 8188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:01:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:32 smithi044 bash[22676]: audit 2024-09-21T02:01:31.743380+0000 mgr.a (mgr.14388) 9824 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.397322+0000 mon.a (mon.0) 8178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.403330+0000 mon.a (mon.0) 8179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.412631+0000 mon.a (mon.0) 8180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.431018+0000 mon.a (mon.0) 8181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.439373+0000 mon.a (mon.0) 8182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.448673+0000 mon.a (mon.0) 8183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.715784+0000 mon.a (mon.0) 8184 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.722026+0000 mon.a (mon.0) 8185 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.723883+0000 mon.a (mon.0) 8186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.734809+0000 mon.a (mon.0) 8187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.741047+0000 mon.a (mon.0) 8188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:01:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:32 smithi179 bash[23186]: audit 2024-09-21T02:01:31.743380+0000 mgr.a (mgr.14388) 9824 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:01:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.397322+0000 mon.a (mon.0) 8178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.403330+0000 mon.a (mon.0) 8179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.412631+0000 mon.a (mon.0) 8180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.431018+0000 mon.a (mon.0) 8181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.439373+0000 mon.a (mon.0) 8182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.448673+0000 mon.a (mon.0) 8183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.715784+0000 mon.a (mon.0) 8184 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:01:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.722026+0000 mon.a (mon.0) 8185 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:01:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.723883+0000 mon.a (mon.0) 8186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:01:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.734809+0000 mon.a (mon.0) 8187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.741047+0000 mon.a (mon.0) 8188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:01:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:32 smithi049 bash[23528]: audit 2024-09-21T02:01:31.743380+0000 mgr.a (mgr.14388) 9824 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:01:32.984 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:33 smithi044 bash[22676]: cluster 2024-09-21T02:01:32.026082+0000 mgr.a (mgr.14388) 9825 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:33 smithi044 bash[22676]: audit 2024-09-21T02:01:32.318367+0000 mgr.a (mgr.14388) 9826 : audit [DBG] from='client.217665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:33 smithi044 bash[22676]: audit 2024-09-21T02:01:32.545606+0000 mgr.a (mgr.14388) 9827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:01:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:33 smithi044 bash[22676]: cephadm 2024-09-21T02:01:32.559964+0000 mgr.a (mgr.14388) 9828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:01:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:33 smithi179 bash[23186]: cluster 2024-09-21T02:01:32.026082+0000 mgr.a (mgr.14388) 9825 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:33 smithi179 bash[23186]: audit 2024-09-21T02:01:32.318367+0000 mgr.a (mgr.14388) 9826 : audit [DBG] from='client.217665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:33 smithi179 bash[23186]: audit 2024-09-21T02:01:32.545606+0000 mgr.a (mgr.14388) 9827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:01:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:33 smithi179 bash[23186]: cephadm 2024-09-21T02:01:32.559964+0000 mgr.a (mgr.14388) 9828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:01:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:33 smithi049 bash[23528]: cluster 2024-09-21T02:01:32.026082+0000 mgr.a (mgr.14388) 9825 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:33 smithi049 bash[23528]: audit 2024-09-21T02:01:32.318367+0000 mgr.a (mgr.14388) 9826 : audit [DBG] from='client.217665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:33 smithi049 bash[23528]: audit 2024-09-21T02:01:32.545606+0000 mgr.a (mgr.14388) 9827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:01:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:33 smithi049 bash[23528]: cephadm 2024-09-21T02:01:32.559964+0000 mgr.a (mgr.14388) 9828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:01:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:35 smithi179 bash[23186]: cluster 2024-09-21T02:01:34.027030+0000 mgr.a (mgr.14388) 9829 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:35 smithi049 bash[23528]: cluster 2024-09-21T02:01:34.027030+0000 mgr.a (mgr.14388) 9829 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:35 smithi044 bash[22676]: cluster 2024-09-21T02:01:34.027030+0000 mgr.a (mgr.14388) 9829 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:37.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:37 smithi179 bash[23186]: cluster 2024-09-21T02:01:36.029301+0000 mgr.a (mgr.14388) 9830 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:37 smithi049 bash[23528]: cluster 2024-09-21T02:01:36.029301+0000 mgr.a (mgr.14388) 9830 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:38.131 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:37 smithi044 bash[22676]: cluster 2024-09-21T02:01:36.029301+0000 mgr.a (mgr.14388) 9830 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:38.773 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:38.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:38.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:38.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:38.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:39 smithi044 bash[22676]: cluster 2024-09-21T02:01:38.030045+0000 mgr.a (mgr.14388) 9831 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:39 smithi044 bash[22676]: audit 2024-09-21T02:01:38.114261+0000 mon.a (mon.0) 8189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:39 smithi044 bash[22676]: audit 2024-09-21T02:01:38.119729+0000 mon.a (mon.0) 8190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:39 smithi044 bash[22676]: audit 2024-09-21T02:01:38.125676+0000 mon.a (mon.0) 8191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:39 smithi044 bash[22676]: audit 2024-09-21T02:01:38.345140+0000 mgr.a (mgr.14388) 9832 : audit [DBG] from='client.217806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:39 smithi179 bash[23186]: cluster 2024-09-21T02:01:38.030045+0000 mgr.a (mgr.14388) 9831 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:39 smithi179 bash[23186]: audit 2024-09-21T02:01:38.114261+0000 mon.a (mon.0) 8189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:39 smithi179 bash[23186]: audit 2024-09-21T02:01:38.119729+0000 mon.a (mon.0) 8190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:39 smithi179 bash[23186]: audit 2024-09-21T02:01:38.125676+0000 mon.a (mon.0) 8191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:39 smithi179 bash[23186]: audit 2024-09-21T02:01:38.345140+0000 mgr.a (mgr.14388) 9832 : audit [DBG] from='client.217806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:39 smithi049 bash[23528]: cluster 2024-09-21T02:01:38.030045+0000 mgr.a (mgr.14388) 9831 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:39 smithi049 bash[23528]: audit 2024-09-21T02:01:38.114261+0000 mon.a (mon.0) 8189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:39 smithi049 bash[23528]: audit 2024-09-21T02:01:38.119729+0000 mon.a (mon.0) 8190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:39 smithi049 bash[23528]: audit 2024-09-21T02:01:38.125676+0000 mon.a (mon.0) 8191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:39 smithi049 bash[23528]: audit 2024-09-21T02:01:38.345140+0000 mgr.a (mgr.14388) 9832 : audit [DBG] from='client.217806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:41 smithi049 bash[23528]: cluster 2024-09-21T02:01:40.032330+0000 mgr.a (mgr.14388) 9833 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:41 smithi044 bash[22676]: cluster 2024-09-21T02:01:40.032330+0000 mgr.a (mgr.14388) 9833 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:41 smithi179 bash[23186]: cluster 2024-09-21T02:01:40.032330+0000 mgr.a (mgr.14388) 9833 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:43.386 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:43 smithi049 bash[23528]: cluster 2024-09-21T02:01:42.033150+0000 mgr.a (mgr.14388) 9834 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:43 smithi044 bash[22676]: cluster 2024-09-21T02:01:42.033150+0000 mgr.a (mgr.14388) 9834 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:43 smithi179 bash[23186]: cluster 2024-09-21T02:01:42.033150+0000 mgr.a (mgr.14388) 9834 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:43.776 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:44.522 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:44.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:44.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:45.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:45 smithi179 bash[23186]: cluster 2024-09-21T02:01:44.033844+0000 mgr.a (mgr.14388) 9835 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:45.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:45 smithi179 bash[23186]: audit 2024-09-21T02:01:44.102873+0000 mgr.a (mgr.14388) 9836 : audit [DBG] from='client.217878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:45 smithi044 bash[22676]: cluster 2024-09-21T02:01:44.033844+0000 mgr.a (mgr.14388) 9835 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:45 smithi044 bash[22676]: audit 2024-09-21T02:01:44.102873+0000 mgr.a (mgr.14388) 9836 : audit [DBG] from='client.217878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:45 smithi049 bash[23528]: cluster 2024-09-21T02:01:44.033844+0000 mgr.a (mgr.14388) 9835 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:45 smithi049 bash[23528]: audit 2024-09-21T02:01:44.102873+0000 mgr.a (mgr.14388) 9836 : audit [DBG] from='client.217878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:47 smithi179 bash[23186]: cluster 2024-09-21T02:01:46.036178+0000 mgr.a (mgr.14388) 9837 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:47 smithi044 bash[22676]: cluster 2024-09-21T02:01:46.036178+0000 mgr.a (mgr.14388) 9837 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:47 smithi049 bash[23528]: cluster 2024-09-21T02:01:46.036178+0000 mgr.a (mgr.14388) 9837 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:01:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:49 smithi044 bash[22676]: cluster 2024-09-21T02:01:48.036994+0000 mgr.a (mgr.14388) 9838 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:49 smithi179 bash[23186]: cluster 2024-09-21T02:01:48.036994+0000 mgr.a (mgr.14388) 9838 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:49 smithi049 bash[23528]: cluster 2024-09-21T02:01:48.036994+0000 mgr.a (mgr.14388) 9838 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:50.314 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:50 smithi044 bash[22676]: audit 2024-09-21T02:01:49.861141+0000 mgr.a (mgr.14388) 9839 : audit [DBG] from='client.217956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:50 smithi179 bash[23186]: audit 2024-09-21T02:01:49.861141+0000 mgr.a (mgr.14388) 9839 : audit [DBG] from='client.217956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:50 smithi049 bash[23528]: audit 2024-09-21T02:01:49.861141+0000 mgr.a (mgr.14388) 9839 : audit [DBG] from='client.217956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:51 smithi044 bash[22676]: cluster 2024-09-21T02:01:50.038885+0000 mgr.a (mgr.14388) 9840 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:51 smithi179 bash[23186]: cluster 2024-09-21T02:01:50.038885+0000 mgr.a (mgr.14388) 9840 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:51 smithi049 bash[23528]: cluster 2024-09-21T02:01:50.038885+0000 mgr.a (mgr.14388) 9840 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:52 smithi179 bash[23186]: audit 2024-09-21T02:01:51.583296+0000 mon.a (mon.0) 8192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:52 smithi179 bash[23186]: audit 2024-09-21T02:01:51.590967+0000 mon.a (mon.0) 8193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:52 smithi179 bash[23186]: audit 2024-09-21T02:01:51.602026+0000 mon.a (mon.0) 8194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:52 smithi179 bash[23186]: audit 2024-09-21T02:01:51.660511+0000 mon.a (mon.0) 8195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:52 smithi179 bash[23186]: audit 2024-09-21T02:01:51.668120+0000 mon.a (mon.0) 8196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:52 smithi179 bash[23186]: audit 2024-09-21T02:01:51.677557+0000 mon.a (mon.0) 8197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:52 smithi044 bash[22676]: audit 2024-09-21T02:01:51.583296+0000 mon.a (mon.0) 8192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:52 smithi044 bash[22676]: audit 2024-09-21T02:01:51.590967+0000 mon.a (mon.0) 8193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:52 smithi044 bash[22676]: audit 2024-09-21T02:01:51.602026+0000 mon.a (mon.0) 8194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:52 smithi044 bash[22676]: audit 2024-09-21T02:01:51.660511+0000 mon.a (mon.0) 8195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:52 smithi044 bash[22676]: audit 2024-09-21T02:01:51.668120+0000 mon.a (mon.0) 8196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:52 smithi044 bash[22676]: audit 2024-09-21T02:01:51.677557+0000 mon.a (mon.0) 8197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:52 smithi049 bash[23528]: audit 2024-09-21T02:01:51.583296+0000 mon.a (mon.0) 8192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:52 smithi049 bash[23528]: audit 2024-09-21T02:01:51.590967+0000 mon.a (mon.0) 8193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:52 smithi049 bash[23528]: audit 2024-09-21T02:01:51.602026+0000 mon.a (mon.0) 8194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:52 smithi049 bash[23528]: audit 2024-09-21T02:01:51.660511+0000 mon.a (mon.0) 8195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:52 smithi049 bash[23528]: audit 2024-09-21T02:01:51.668120+0000 mon.a (mon.0) 8196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:52 smithi049 bash[23528]: audit 2024-09-21T02:01:51.677557+0000 mon.a (mon.0) 8197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:53 smithi044 bash[22676]: cluster 2024-09-21T02:01:52.039780+0000 mgr.a (mgr.14388) 9841 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:53 smithi179 bash[23186]: cluster 2024-09-21T02:01:52.039780+0000 mgr.a (mgr.14388) 9841 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:53 smithi049 bash[23528]: cluster 2024-09-21T02:01:52.039780+0000 mgr.a (mgr.14388) 9841 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:01:55.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:01:55.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:01:55.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:01:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:55 smithi044 bash[22676]: cluster 2024-09-21T02:01:54.040579+0000 mgr.a (mgr.14388) 9842 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:55 smithi179 bash[23186]: cluster 2024-09-21T02:01:54.040579+0000 mgr.a (mgr.14388) 9842 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:55 smithi049 bash[23528]: cluster 2024-09-21T02:01:54.040579+0000 mgr.a (mgr.14388) 9842 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:56.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:01:56.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:01:56.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:01:56.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:01:56.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:01:56.801 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:56 smithi044 bash[22676]: audit 2024-09-21T02:01:55.650282+0000 mgr.a (mgr.14388) 9843 : audit [DBG] from='client.218034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:56 smithi179 bash[23186]: audit 2024-09-21T02:01:55.650282+0000 mgr.a (mgr.14388) 9843 : audit [DBG] from='client.218034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:56 smithi049 bash[23528]: audit 2024-09-21T02:01:55.650282+0000 mgr.a (mgr.14388) 9843 : audit [DBG] from='client.218034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:01:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:57 smithi044 bash[22676]: cluster 2024-09-21T02:01:56.041870+0000 mgr.a (mgr.14388) 9844 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:57 smithi179 bash[23186]: cluster 2024-09-21T02:01:56.041870+0000 mgr.a (mgr.14388) 9844 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:57 smithi049 bash[23528]: cluster 2024-09-21T02:01:56.041870+0000 mgr.a (mgr.14388) 9844 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:01:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:59 smithi044 bash[22676]: cluster 2024-09-21T02:01:58.042621+0000 mgr.a (mgr.14388) 9845 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:59 smithi044 bash[22676]: audit 2024-09-21T02:01:58.275380+0000 mon.a (mon.0) 8198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:59 smithi044 bash[22676]: audit 2024-09-21T02:01:58.286119+0000 mon.a (mon.0) 8199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:01:59 smithi044 bash[22676]: audit 2024-09-21T02:01:58.298526+0000 mon.a (mon.0) 8200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:59 smithi049 bash[23528]: cluster 2024-09-21T02:01:58.042621+0000 mgr.a (mgr.14388) 9845 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:59 smithi049 bash[23528]: audit 2024-09-21T02:01:58.275380+0000 mon.a (mon.0) 8198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:59 smithi049 bash[23528]: audit 2024-09-21T02:01:58.286119+0000 mon.a (mon.0) 8199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:01:59 smithi049 bash[23528]: audit 2024-09-21T02:01:58.298526+0000 mon.a (mon.0) 8200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:59 smithi179 bash[23186]: cluster 2024-09-21T02:01:58.042621+0000 mgr.a (mgr.14388) 9845 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:01:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:59 smithi179 bash[23186]: audit 2024-09-21T02:01:58.275380+0000 mon.a (mon.0) 8198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:59 smithi179 bash[23186]: audit 2024-09-21T02:01:58.286119+0000 mon.a (mon.0) 8199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:01:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:01:59 smithi179 bash[23186]: audit 2024-09-21T02:01:58.298526+0000 mon.a (mon.0) 8200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:01.466 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:01 smithi049 bash[23528]: cluster 2024-09-21T02:02:00.044507+0000 mgr.a (mgr.14388) 9846 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:01 smithi044 bash[22676]: cluster 2024-09-21T02:02:00.044507+0000 mgr.a (mgr.14388) 9846 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:01 smithi179 bash[23186]: cluster 2024-09-21T02:02:00.044507+0000 mgr.a (mgr.14388) 9846 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:01.862 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:02 smithi049 bash[23528]: audit 2024-09-21T02:02:01.416406+0000 mgr.a (mgr.14388) 9847 : audit [DBG] from='client.218112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:02 smithi044 bash[22676]: audit 2024-09-21T02:02:01.416406+0000 mgr.a (mgr.14388) 9847 : audit [DBG] from='client.218112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:02 smithi179 bash[23186]: audit 2024-09-21T02:02:01.416406+0000 mgr.a (mgr.14388) 9847 : audit [DBG] from='client.218112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:03 smithi049 bash[23528]: cluster 2024-09-21T02:02:02.045534+0000 mgr.a (mgr.14388) 9848 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:03 smithi044 bash[22676]: cluster 2024-09-21T02:02:02.045534+0000 mgr.a (mgr.14388) 9848 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:03 smithi179 bash[23186]: cluster 2024-09-21T02:02:02.045534+0000 mgr.a (mgr.14388) 9848 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:05.460 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:05 smithi179 bash[23186]: cluster 2024-09-21T02:02:04.046311+0000 mgr.a (mgr.14388) 9849 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:05 smithi049 bash[23528]: cluster 2024-09-21T02:02:04.046311+0000 mgr.a (mgr.14388) 9849 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:05 smithi044 bash[22676]: cluster 2024-09-21T02:02:04.046311+0000 mgr.a (mgr.14388) 9849 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:06.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:06.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:06.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:07 smithi049 bash[23528]: cluster 2024-09-21T02:02:06.048515+0000 mgr.a (mgr.14388) 9850 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:07.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:07.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:07.636 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:07 smithi179 bash[23186]: cluster 2024-09-21T02:02:06.048515+0000 mgr.a (mgr.14388) 9850 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:07 smithi044 bash[22676]: cluster 2024-09-21T02:02:06.048515+0000 mgr.a (mgr.14388) 9850 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:08 smithi044 bash[22676]: audit 2024-09-21T02:02:07.194348+0000 mgr.a (mgr.14388) 9851 : audit [DBG] from='client.218190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:08 smithi179 bash[23186]: audit 2024-09-21T02:02:07.194348+0000 mgr.a (mgr.14388) 9851 : audit [DBG] from='client.218190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:08 smithi049 bash[23528]: audit 2024-09-21T02:02:07.194348+0000 mgr.a (mgr.14388) 9851 : audit [DBG] from='client.218190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:09 smithi044 bash[22676]: cluster 2024-09-21T02:02:08.049598+0000 mgr.a (mgr.14388) 9852 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:09 smithi179 bash[23186]: cluster 2024-09-21T02:02:08.049598+0000 mgr.a (mgr.14388) 9852 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:09 smithi049 bash[23528]: cluster 2024-09-21T02:02:08.049598+0000 mgr.a (mgr.14388) 9852 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:11 smithi044 bash[22676]: cluster 2024-09-21T02:02:10.051998+0000 mgr.a (mgr.14388) 9853 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:11 smithi179 bash[23186]: cluster 2024-09-21T02:02:10.051998+0000 mgr.a (mgr.14388) 9853 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:11 smithi049 bash[23528]: cluster 2024-09-21T02:02:10.051998+0000 mgr.a (mgr.14388) 9853 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:12.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:12.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:12.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:12 smithi049 bash[23528]: audit 2024-09-21T02:02:11.797044+0000 mon.a (mon.0) 8201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:12 smithi049 bash[23528]: audit 2024-09-21T02:02:11.803566+0000 mon.a (mon.0) 8202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:12 smithi049 bash[23528]: audit 2024-09-21T02:02:11.811618+0000 mon.a (mon.0) 8203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:12 smithi049 bash[23528]: audit 2024-09-21T02:02:11.871416+0000 mon.a (mon.0) 8204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:12 smithi049 bash[23528]: audit 2024-09-21T02:02:11.879164+0000 mon.a (mon.0) 8205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:12 smithi049 bash[23528]: audit 2024-09-21T02:02:11.889009+0000 mon.a (mon.0) 8206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:12 smithi044 bash[22676]: audit 2024-09-21T02:02:11.797044+0000 mon.a (mon.0) 8201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:12 smithi044 bash[22676]: audit 2024-09-21T02:02:11.803566+0000 mon.a (mon.0) 8202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:12 smithi044 bash[22676]: audit 2024-09-21T02:02:11.811618+0000 mon.a (mon.0) 8203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:12 smithi044 bash[22676]: audit 2024-09-21T02:02:11.871416+0000 mon.a (mon.0) 8204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:12 smithi044 bash[22676]: audit 2024-09-21T02:02:11.879164+0000 mon.a (mon.0) 8205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:12 smithi044 bash[22676]: audit 2024-09-21T02:02:11.889009+0000 mon.a (mon.0) 8206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:12 smithi179 bash[23186]: audit 2024-09-21T02:02:11.797044+0000 mon.a (mon.0) 8201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:12 smithi179 bash[23186]: audit 2024-09-21T02:02:11.803566+0000 mon.a (mon.0) 8202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:12 smithi179 bash[23186]: audit 2024-09-21T02:02:11.811618+0000 mon.a (mon.0) 8203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:12 smithi179 bash[23186]: audit 2024-09-21T02:02:11.871416+0000 mon.a (mon.0) 8204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:12 smithi179 bash[23186]: audit 2024-09-21T02:02:11.879164+0000 mon.a (mon.0) 8205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:12 smithi179 bash[23186]: audit 2024-09-21T02:02:11.889009+0000 mon.a (mon.0) 8206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:13.418 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:13.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:13 smithi044 bash[22676]: cluster 2024-09-21T02:02:12.052802+0000 mgr.a (mgr.14388) 9854 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:13 smithi044 bash[22676]: audit 2024-09-21T02:02:12.970670+0000 mgr.a (mgr.14388) 9855 : audit [DBG] from='client.218268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:13 smithi179 bash[23186]: cluster 2024-09-21T02:02:12.052802+0000 mgr.a (mgr.14388) 9854 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:13 smithi179 bash[23186]: audit 2024-09-21T02:02:12.970670+0000 mgr.a (mgr.14388) 9855 : audit [DBG] from='client.218268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:13 smithi049 bash[23528]: cluster 2024-09-21T02:02:12.052802+0000 mgr.a (mgr.14388) 9854 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:13 smithi049 bash[23528]: audit 2024-09-21T02:02:12.970670+0000 mgr.a (mgr.14388) 9855 : audit [DBG] from='client.218268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:15 smithi044 bash[22676]: cluster 2024-09-21T02:02:14.053812+0000 mgr.a (mgr.14388) 9856 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:15 smithi179 bash[23186]: cluster 2024-09-21T02:02:14.053812+0000 mgr.a (mgr.14388) 9856 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:15 smithi049 bash[23528]: cluster 2024-09-21T02:02:14.053812+0000 mgr.a (mgr.14388) 9856 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:17 smithi044 bash[22676]: cluster 2024-09-21T02:02:16.056106+0000 mgr.a (mgr.14388) 9857 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:17 smithi179 bash[23186]: cluster 2024-09-21T02:02:16.056106+0000 mgr.a (mgr.14388) 9857 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:17 smithi049 bash[23528]: cluster 2024-09-21T02:02:16.056106+0000 mgr.a (mgr.14388) 9857 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:18.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:18.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:18.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:19.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:19 smithi044 bash[22676]: cluster 2024-09-21T02:02:18.056914+0000 mgr.a (mgr.14388) 9858 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:19 smithi044 bash[22676]: audit 2024-09-21T02:02:18.507255+0000 mon.a (mon.0) 8207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:19 smithi044 bash[22676]: audit 2024-09-21T02:02:18.512337+0000 mon.a (mon.0) 8208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:19 smithi044 bash[22676]: audit 2024-09-21T02:02:18.522323+0000 mon.a (mon.0) 8209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:19 smithi044 bash[22676]: audit 2024-09-21T02:02:18.764859+0000 mgr.a (mgr.14388) 9859 : audit [DBG] from='client.218343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:19 smithi049 bash[23528]: cluster 2024-09-21T02:02:18.056914+0000 mgr.a (mgr.14388) 9858 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:19 smithi049 bash[23528]: audit 2024-09-21T02:02:18.507255+0000 mon.a (mon.0) 8207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:19 smithi049 bash[23528]: audit 2024-09-21T02:02:18.512337+0000 mon.a (mon.0) 8208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:19 smithi049 bash[23528]: audit 2024-09-21T02:02:18.522323+0000 mon.a (mon.0) 8209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:19 smithi049 bash[23528]: audit 2024-09-21T02:02:18.764859+0000 mgr.a (mgr.14388) 9859 : audit [DBG] from='client.218343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:19 smithi179 bash[23186]: cluster 2024-09-21T02:02:18.056914+0000 mgr.a (mgr.14388) 9858 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:19 smithi179 bash[23186]: audit 2024-09-21T02:02:18.507255+0000 mon.a (mon.0) 8207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:19 smithi179 bash[23186]: audit 2024-09-21T02:02:18.512337+0000 mon.a (mon.0) 8208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:19 smithi179 bash[23186]: audit 2024-09-21T02:02:18.522323+0000 mon.a (mon.0) 8209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:19 smithi179 bash[23186]: audit 2024-09-21T02:02:18.764859+0000 mgr.a (mgr.14388) 9859 : audit [DBG] from='client.218343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:21.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:21 smithi049 bash[23528]: cluster 2024-09-21T02:02:20.059256+0000 mgr.a (mgr.14388) 9860 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:21 smithi044 bash[22676]: cluster 2024-09-21T02:02:20.059256+0000 mgr.a (mgr.14388) 9860 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:21 smithi179 bash[23186]: cluster 2024-09-21T02:02:20.059256+0000 mgr.a (mgr.14388) 9860 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:23 smithi049 bash[23528]: cluster 2024-09-21T02:02:22.060034+0000 mgr.a (mgr.14388) 9861 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:23 smithi044 bash[22676]: cluster 2024-09-21T02:02:22.060034+0000 mgr.a (mgr.14388) 9861 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:23 smithi179 bash[23186]: cluster 2024-09-21T02:02:22.060034+0000 mgr.a (mgr.14388) 9861 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:24.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:24.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:24.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:24.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:24.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:24.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:24.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:24.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:25.614 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:25 smithi179 bash[23186]: cluster 2024-09-21T02:02:24.060825+0000 mgr.a (mgr.14388) 9862 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:25.614 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:25 smithi179 bash[23186]: audit 2024-09-21T02:02:24.552537+0000 mgr.a (mgr.14388) 9863 : audit [DBG] from='client.218418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:25 smithi049 bash[23528]: cluster 2024-09-21T02:02:24.060825+0000 mgr.a (mgr.14388) 9862 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:25 smithi049 bash[23528]: audit 2024-09-21T02:02:24.552537+0000 mgr.a (mgr.14388) 9863 : audit [DBG] from='client.218418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:25 smithi044 bash[22676]: cluster 2024-09-21T02:02:24.060825+0000 mgr.a (mgr.14388) 9862 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:25 smithi044 bash[22676]: audit 2024-09-21T02:02:24.552537+0000 mgr.a (mgr.14388) 9863 : audit [DBG] from='client.218418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:27 smithi049 bash[23528]: cluster 2024-09-21T02:02:26.063176+0000 mgr.a (mgr.14388) 9864 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:02:27.816 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:27 smithi179 bash[23186]: cluster 2024-09-21T02:02:26.063176+0000 mgr.a (mgr.14388) 9864 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:02:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:27 smithi044 bash[22676]: cluster 2024-09-21T02:02:26.063176+0000 mgr.a (mgr.14388) 9864 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:02:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:29 smithi049 bash[23528]: cluster 2024-09-21T02:02:28.064123+0000 mgr.a (mgr.14388) 9865 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:02:29.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:29.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:29.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:29 smithi044 bash[22676]: cluster 2024-09-21T02:02:28.064123+0000 mgr.a (mgr.14388) 9865 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:02:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:29 smithi179 bash[23186]: cluster 2024-09-21T02:02:28.064123+0000 mgr.a (mgr.14388) 9865 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:02:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:30.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:31 smithi049 bash[23528]: cluster 2024-09-21T02:02:30.066270+0000 mgr.a (mgr.14388) 9866 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:31 smithi049 bash[23528]: audit 2024-09-21T02:02:30.320748+0000 mgr.a (mgr.14388) 9867 : audit [DBG] from='client.218496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:31 smithi044 bash[22676]: cluster 2024-09-21T02:02:30.066270+0000 mgr.a (mgr.14388) 9866 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:31 smithi044 bash[22676]: audit 2024-09-21T02:02:30.320748+0000 mgr.a (mgr.14388) 9867 : audit [DBG] from='client.218496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:31 smithi179 bash[23186]: cluster 2024-09-21T02:02:30.066270+0000 mgr.a (mgr.14388) 9866 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:31 smithi179 bash[23186]: audit 2024-09-21T02:02:30.320748+0000 mgr.a (mgr.14388) 9867 : audit [DBG] from='client.218496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.031163+0000 mon.a (mon.0) 8210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.038781+0000 mon.a (mon.0) 8211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.049470+0000 mon.a (mon.0) 8212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.098603+0000 mon.a (mon.0) 8213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.107345+0000 mon.a (mon.0) 8214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.115868+0000 mon.a (mon.0) 8215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.628784+0000 mon.a (mon.0) 8216 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:02:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.635323+0000 mon.a (mon.0) 8217 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:02:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.637362+0000 mon.a (mon.0) 8218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:02:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.648784+0000 mon.a (mon.0) 8219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:33 smithi049 bash[23528]: audit 2024-09-21T02:02:32.655119+0000 mon.a (mon.0) 8220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:02:33.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.031163+0000 mon.a (mon.0) 8210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.038781+0000 mon.a (mon.0) 8211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.049470+0000 mon.a (mon.0) 8212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.098603+0000 mon.a (mon.0) 8213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.107345+0000 mon.a (mon.0) 8214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.115868+0000 mon.a (mon.0) 8215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.628784+0000 mon.a (mon.0) 8216 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.635323+0000 mon.a (mon.0) 8217 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.637362+0000 mon.a (mon.0) 8218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.648784+0000 mon.a (mon.0) 8219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22676]: audit 2024-09-21T02:02:32.655119+0000 mon.a (mon.0) 8220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:02:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.031163+0000 mon.a (mon.0) 8210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.038781+0000 mon.a (mon.0) 8211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.049470+0000 mon.a (mon.0) 8212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.098603+0000 mon.a (mon.0) 8213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.107345+0000 mon.a (mon.0) 8214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.115868+0000 mon.a (mon.0) 8215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.628784+0000 mon.a (mon.0) 8216 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:02:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.635323+0000 mon.a (mon.0) 8217 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:02:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.637362+0000 mon.a (mon.0) 8218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:02:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.648784+0000 mon.a (mon.0) 8219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:33 smithi179 bash[23186]: audit 2024-09-21T02:02:32.655119+0000 mon.a (mon.0) 8220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:02:33.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22930]: debug 2024-09-21T02:02:33.455+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:02:33.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:02:33 smithi044 bash[22930]: debug 2024-09-21T02:02:33.455+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:02:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:34 smithi049 bash[23528]: cluster 2024-09-21T02:02:32.067329+0000 mgr.a (mgr.14388) 9868 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:02:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:34 smithi049 bash[23528]: audit 2024-09-21T02:02:32.657630+0000 mgr.a (mgr.14388) 9869 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:02:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:34 smithi044 bash[22676]: cluster 2024-09-21T02:02:32.067329+0000 mgr.a (mgr.14388) 9868 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:02:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:34 smithi044 bash[22676]: audit 2024-09-21T02:02:32.657630+0000 mgr.a (mgr.14388) 9869 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:02:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:34 smithi179 bash[23186]: cluster 2024-09-21T02:02:32.067329+0000 mgr.a (mgr.14388) 9868 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:02:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:34 smithi179 bash[23186]: audit 2024-09-21T02:02:32.657630+0000 mgr.a (mgr.14388) 9869 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:02:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:35 smithi049 bash[23528]: audit 2024-09-21T02:02:33.458611+0000 mgr.a (mgr.14388) 9870 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:02:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:35 smithi049 bash[23528]: cephadm 2024-09-21T02:02:33.460232+0000 mgr.a (mgr.14388) 9871 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:02:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:35 smithi044 bash[22676]: audit 2024-09-21T02:02:33.458611+0000 mgr.a (mgr.14388) 9870 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:02:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:35 smithi044 bash[22676]: cephadm 2024-09-21T02:02:33.460232+0000 mgr.a (mgr.14388) 9871 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:02:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:35 smithi179 bash[23186]: audit 2024-09-21T02:02:33.458611+0000 mgr.a (mgr.14388) 9870 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:02:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:35 smithi179 bash[23186]: cephadm 2024-09-21T02:02:33.460232+0000 mgr.a (mgr.14388) 9871 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:02:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:36 smithi049 bash[23528]: cluster 2024-09-21T02:02:34.068290+0000 mgr.a (mgr.14388) 9872 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:02:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:36 smithi044 bash[22676]: cluster 2024-09-21T02:02:34.068290+0000 mgr.a (mgr.14388) 9872 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:02:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:36 smithi179 bash[23186]: cluster 2024-09-21T02:02:34.068290+0000 mgr.a (mgr.14388) 9872 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:02:36.509 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:36.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:36.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:36.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:36.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:37 smithi049 bash[23528]: cluster 2024-09-21T02:02:36.069568+0000 mgr.a (mgr.14388) 9873 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:37 smithi049 bash[23528]: audit 2024-09-21T02:02:36.099243+0000 mgr.a (mgr.14388) 9874 : audit [DBG] from='client.218682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:37.421 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:37 smithi044 bash[22676]: cluster 2024-09-21T02:02:36.069568+0000 mgr.a (mgr.14388) 9873 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:37.421 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:37 smithi044 bash[22676]: audit 2024-09-21T02:02:36.099243+0000 mgr.a (mgr.14388) 9874 : audit [DBG] from='client.218682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:37 smithi179 bash[23186]: cluster 2024-09-21T02:02:36.069568+0000 mgr.a (mgr.14388) 9873 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:37 smithi179 bash[23186]: audit 2024-09-21T02:02:36.099243+0000 mgr.a (mgr.14388) 9874 : audit [DBG] from='client.218682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:39 smithi044 bash[22676]: cluster 2024-09-21T02:02:38.070485+0000 mgr.a (mgr.14388) 9875 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:02:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:39 smithi044 bash[22676]: audit 2024-09-21T02:02:38.744482+0000 mon.a (mon.0) 8221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:39 smithi044 bash[22676]: audit 2024-09-21T02:02:38.753393+0000 mon.a (mon.0) 8222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:39 smithi044 bash[22676]: audit 2024-09-21T02:02:38.763979+0000 mon.a (mon.0) 8223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:39 smithi179 bash[23186]: cluster 2024-09-21T02:02:38.070485+0000 mgr.a (mgr.14388) 9875 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:02:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:39 smithi179 bash[23186]: audit 2024-09-21T02:02:38.744482+0000 mon.a (mon.0) 8221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:39 smithi179 bash[23186]: audit 2024-09-21T02:02:38.753393+0000 mon.a (mon.0) 8222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:39 smithi179 bash[23186]: audit 2024-09-21T02:02:38.763979+0000 mon.a (mon.0) 8223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:39 smithi049 bash[23528]: cluster 2024-09-21T02:02:38.070485+0000 mgr.a (mgr.14388) 9875 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:02:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:39 smithi049 bash[23528]: audit 2024-09-21T02:02:38.744482+0000 mon.a (mon.0) 8221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:39 smithi049 bash[23528]: audit 2024-09-21T02:02:38.753393+0000 mon.a (mon.0) 8222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:39 smithi049 bash[23528]: audit 2024-09-21T02:02:38.763979+0000 mon.a (mon.0) 8223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:41.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:41.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:41 smithi179 bash[23186]: cluster 2024-09-21T02:02:40.072799+0000 mgr.a (mgr.14388) 9876 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:41 smithi049 bash[23528]: cluster 2024-09-21T02:02:40.072799+0000 mgr.a (mgr.14388) 9876 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:41 smithi044 bash[22676]: cluster 2024-09-21T02:02:40.072799+0000 mgr.a (mgr.14388) 9876 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:42.292 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:42.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:42.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:42.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:42.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:42 smithi049 bash[23528]: audit 2024-09-21T02:02:41.848850+0000 mgr.a (mgr.14388) 9877 : audit [DBG] from='client.218760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:42 smithi044 bash[22676]: audit 2024-09-21T02:02:41.848850+0000 mgr.a (mgr.14388) 9877 : audit [DBG] from='client.218760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:42 smithi179 bash[23186]: audit 2024-09-21T02:02:41.848850+0000 mgr.a (mgr.14388) 9877 : audit [DBG] from='client.218760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:43 smithi049 bash[23528]: cluster 2024-09-21T02:02:42.073362+0000 mgr.a (mgr.14388) 9878 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:43 smithi044 bash[22676]: cluster 2024-09-21T02:02:42.073362+0000 mgr.a (mgr.14388) 9878 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:44.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:43 smithi179 bash[23186]: cluster 2024-09-21T02:02:42.073362+0000 mgr.a (mgr.14388) 9878 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:45 smithi049 bash[23528]: cluster 2024-09-21T02:02:44.074267+0000 mgr.a (mgr.14388) 9879 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:45 smithi044 bash[22676]: cluster 2024-09-21T02:02:44.074267+0000 mgr.a (mgr.14388) 9879 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:45 smithi179 bash[23186]: cluster 2024-09-21T02:02:44.074267+0000 mgr.a (mgr.14388) 9879 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:47.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:47.295 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:47.295 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:48.050 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:48.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:48.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:48.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:48.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:47 smithi049 bash[23528]: cluster 2024-09-21T02:02:46.076671+0000 mgr.a (mgr.14388) 9880 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:48.111 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:47 smithi179 bash[23186]: cluster 2024-09-21T02:02:46.076671+0000 mgr.a (mgr.14388) 9880 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:47 smithi044 bash[22676]: cluster 2024-09-21T02:02:46.076671+0000 mgr.a (mgr.14388) 9880 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:02:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:48 smithi049 bash[23528]: audit 2024-09-21T02:02:47.627373+0000 mgr.a (mgr.14388) 9881 : audit [DBG] from='client.218838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:48 smithi044 bash[22676]: audit 2024-09-21T02:02:47.627373+0000 mgr.a (mgr.14388) 9881 : audit [DBG] from='client.218838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:48 smithi179 bash[23186]: audit 2024-09-21T02:02:47.627373+0000 mgr.a (mgr.14388) 9881 : audit [DBG] from='client.218838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:49 smithi049 bash[23528]: cluster 2024-09-21T02:02:48.077283+0000 mgr.a (mgr.14388) 9882 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:49 smithi044 bash[22676]: cluster 2024-09-21T02:02:48.077283+0000 mgr.a (mgr.14388) 9882 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:49 smithi179 bash[23186]: cluster 2024-09-21T02:02:48.077283+0000 mgr.a (mgr.14388) 9882 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:51 smithi049 bash[23528]: cluster 2024-09-21T02:02:50.079384+0000 mgr.a (mgr.14388) 9883 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:51 smithi044 bash[22676]: cluster 2024-09-21T02:02:50.079384+0000 mgr.a (mgr.14388) 9883 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:51 smithi179 bash[23186]: cluster 2024-09-21T02:02:50.079384+0000 mgr.a (mgr.14388) 9883 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:53.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:53 smithi179 bash[23186]: cluster 2024-09-21T02:02:52.080164+0000 mgr.a (mgr.14388) 9884 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:53 smithi179 bash[23186]: audit 2024-09-21T02:02:52.245679+0000 mon.a (mon.0) 8224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:53 smithi179 bash[23186]: audit 2024-09-21T02:02:52.251595+0000 mon.a (mon.0) 8225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:53 smithi179 bash[23186]: audit 2024-09-21T02:02:52.261463+0000 mon.a (mon.0) 8226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:53 smithi179 bash[23186]: audit 2024-09-21T02:02:52.300087+0000 mon.a (mon.0) 8227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:53 smithi179 bash[23186]: audit 2024-09-21T02:02:52.306279+0000 mon.a (mon.0) 8228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:53 smithi179 bash[23186]: audit 2024-09-21T02:02:52.313438+0000 mon.a (mon.0) 8229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:53 smithi049 bash[23528]: cluster 2024-09-21T02:02:52.080164+0000 mgr.a (mgr.14388) 9884 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:53 smithi049 bash[23528]: audit 2024-09-21T02:02:52.245679+0000 mon.a (mon.0) 8224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:53 smithi049 bash[23528]: audit 2024-09-21T02:02:52.251595+0000 mon.a (mon.0) 8225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:53 smithi049 bash[23528]: audit 2024-09-21T02:02:52.261463+0000 mon.a (mon.0) 8226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:53 smithi049 bash[23528]: audit 2024-09-21T02:02:52.300087+0000 mon.a (mon.0) 8227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:53 smithi049 bash[23528]: audit 2024-09-21T02:02:52.306279+0000 mon.a (mon.0) 8228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:53 smithi049 bash[23528]: audit 2024-09-21T02:02:52.313438+0000 mon.a (mon.0) 8229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:53 smithi044 bash[22676]: cluster 2024-09-21T02:02:52.080164+0000 mgr.a (mgr.14388) 9884 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:53 smithi044 bash[22676]: audit 2024-09-21T02:02:52.245679+0000 mon.a (mon.0) 8224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:53 smithi044 bash[22676]: audit 2024-09-21T02:02:52.251595+0000 mon.a (mon.0) 8225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:53 smithi044 bash[22676]: audit 2024-09-21T02:02:52.261463+0000 mon.a (mon.0) 8226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:53 smithi044 bash[22676]: audit 2024-09-21T02:02:52.300087+0000 mon.a (mon.0) 8227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:53 smithi044 bash[22676]: audit 2024-09-21T02:02:52.306279+0000 mon.a (mon.0) 8228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:53 smithi044 bash[22676]: audit 2024-09-21T02:02:52.313438+0000 mon.a (mon.0) 8229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:02:53.838 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:53.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:53.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:53.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:53.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:02:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:54 smithi179 bash[23186]: audit 2024-09-21T02:02:53.393484+0000 mgr.a (mgr.14388) 9885 : audit [DBG] from='client.218916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:54 smithi049 bash[23528]: audit 2024-09-21T02:02:53.393484+0000 mgr.a (mgr.14388) 9885 : audit [DBG] from='client.218916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:54 smithi044 bash[22676]: audit 2024-09-21T02:02:53.393484+0000 mgr.a (mgr.14388) 9885 : audit [DBG] from='client.218916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:02:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:55 smithi049 bash[23528]: cluster 2024-09-21T02:02:54.081106+0000 mgr.a (mgr.14388) 9886 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:55 smithi044 bash[22676]: cluster 2024-09-21T02:02:54.081106+0000 mgr.a (mgr.14388) 9886 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:55 smithi179 bash[23186]: cluster 2024-09-21T02:02:54.081106+0000 mgr.a (mgr.14388) 9886 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:02:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:57 smithi049 bash[23528]: cluster 2024-09-21T02:02:56.083359+0000 mgr.a (mgr.14388) 9887 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:57.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:57 smithi044 bash[22676]: cluster 2024-09-21T02:02:56.083359+0000 mgr.a (mgr.14388) 9887 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:57.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:57 smithi179 bash[23186]: cluster 2024-09-21T02:02:56.083359+0000 mgr.a (mgr.14388) 9887 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:02:58.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:02:58.841 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:02:58.841 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:02:59.600 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:02:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:02:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:02:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:02:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:59 smithi044 bash[22676]: cluster 2024-09-21T02:02:58.084126+0000 mgr.a (mgr.14388) 9888 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:59 smithi044 bash[22676]: audit 2024-09-21T02:02:58.957827+0000 mon.a (mon.0) 8230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:59 smithi044 bash[22676]: audit 2024-09-21T02:02:58.963170+0000 mon.a (mon.0) 8231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:02:59 smithi044 bash[22676]: audit 2024-09-21T02:02:58.970159+0000 mon.a (mon.0) 8232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:59 smithi179 bash[23186]: cluster 2024-09-21T02:02:58.084126+0000 mgr.a (mgr.14388) 9888 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:59 smithi179 bash[23186]: audit 2024-09-21T02:02:58.957827+0000 mon.a (mon.0) 8230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:59 smithi179 bash[23186]: audit 2024-09-21T02:02:58.963170+0000 mon.a (mon.0) 8231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:02:59 smithi179 bash[23186]: audit 2024-09-21T02:02:58.970159+0000 mon.a (mon.0) 8232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:59 smithi049 bash[23528]: cluster 2024-09-21T02:02:58.084126+0000 mgr.a (mgr.14388) 9888 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:59 smithi049 bash[23528]: audit 2024-09-21T02:02:58.957827+0000 mon.a (mon.0) 8230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:59 smithi049 bash[23528]: audit 2024-09-21T02:02:58.963170+0000 mon.a (mon.0) 8231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:02:59 smithi049 bash[23528]: audit 2024-09-21T02:02:58.970159+0000 mon.a (mon.0) 8232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:00 smithi044 bash[22676]: audit 2024-09-21T02:02:59.181537+0000 mgr.a (mgr.14388) 9889 : audit [DBG] from='client.218994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:00 smithi179 bash[23186]: audit 2024-09-21T02:02:59.181537+0000 mgr.a (mgr.14388) 9889 : audit [DBG] from='client.218994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:00 smithi049 bash[23528]: audit 2024-09-21T02:02:59.181537+0000 mgr.a (mgr.14388) 9889 : audit [DBG] from='client.218994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:01 smithi044 bash[22676]: cluster 2024-09-21T02:03:00.086592+0000 mgr.a (mgr.14388) 9890 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:01 smithi179 bash[23186]: cluster 2024-09-21T02:03:00.086592+0000 mgr.a (mgr.14388) 9890 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:01 smithi049 bash[23528]: cluster 2024-09-21T02:03:00.086592+0000 mgr.a (mgr.14388) 9890 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:04.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:03 smithi049 bash[23528]: cluster 2024-09-21T02:03:02.087432+0000 mgr.a (mgr.14388) 9891 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:03 smithi044 bash[22676]: cluster 2024-09-21T02:03:02.087432+0000 mgr.a (mgr.14388) 9891 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:03 smithi179 bash[23186]: cluster 2024-09-21T02:03:02.087432+0000 mgr.a (mgr.14388) 9891 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:04.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:04.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:04.603 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:05.368 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:05.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:05.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:05.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:05.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:05 smithi044 bash[22676]: cluster 2024-09-21T02:03:04.088239+0000 mgr.a (mgr.14388) 9892 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:05 smithi044 bash[22676]: audit 2024-09-21T02:03:04.936059+0000 mgr.a (mgr.14388) 9893 : audit [DBG] from='client.219072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:05 smithi179 bash[23186]: cluster 2024-09-21T02:03:04.088239+0000 mgr.a (mgr.14388) 9892 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:05 smithi179 bash[23186]: audit 2024-09-21T02:03:04.936059+0000 mgr.a (mgr.14388) 9893 : audit [DBG] from='client.219072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:05 smithi049 bash[23528]: cluster 2024-09-21T02:03:04.088239+0000 mgr.a (mgr.14388) 9892 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:05 smithi049 bash[23528]: audit 2024-09-21T02:03:04.936059+0000 mgr.a (mgr.14388) 9893 : audit [DBG] from='client.219072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:07 smithi044 bash[22676]: cluster 2024-09-21T02:03:06.091075+0000 mgr.a (mgr.14388) 9894 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:07 smithi179 bash[23186]: cluster 2024-09-21T02:03:06.091075+0000 mgr.a (mgr.14388) 9894 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:07 smithi049 bash[23528]: cluster 2024-09-21T02:03:06.091075+0000 mgr.a (mgr.14388) 9894 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:09 smithi179 bash[23186]: cluster 2024-09-21T02:03:08.091846+0000 mgr.a (mgr.14388) 9895 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:03:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:09 smithi049 bash[23528]: cluster 2024-09-21T02:03:08.091846+0000 mgr.a (mgr.14388) 9895 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:03:10.370 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:10.370 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:10.370 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:09 smithi044 bash[22676]: cluster 2024-09-21T02:03:08.091846+0000 mgr.a (mgr.14388) 9895 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:03:11.167 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:11.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:11 smithi179 bash[23186]: cluster 2024-09-21T02:03:10.093822+0000 mgr.a (mgr.14388) 9896 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:11 smithi179 bash[23186]: audit 2024-09-21T02:03:10.713794+0000 mgr.a (mgr.14388) 9897 : audit [DBG] from='client.219150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:11 smithi049 bash[23528]: cluster 2024-09-21T02:03:10.093822+0000 mgr.a (mgr.14388) 9896 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:11 smithi049 bash[23528]: audit 2024-09-21T02:03:10.713794+0000 mgr.a (mgr.14388) 9897 : audit [DBG] from='client.219150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:11 smithi044 bash[22676]: cluster 2024-09-21T02:03:10.093822+0000 mgr.a (mgr.14388) 9896 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:11 smithi044 bash[22676]: audit 2024-09-21T02:03:10.713794+0000 mgr.a (mgr.14388) 9897 : audit [DBG] from='client.219150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:13 smithi044 bash[22676]: cluster 2024-09-21T02:03:12.094771+0000 mgr.a (mgr.14388) 9898 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:03:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:13 smithi044 bash[22676]: audit 2024-09-21T02:03:12.457489+0000 mon.a (mon.0) 8233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:13 smithi044 bash[22676]: audit 2024-09-21T02:03:12.465625+0000 mon.a (mon.0) 8234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:13 smithi044 bash[22676]: audit 2024-09-21T02:03:12.476492+0000 mon.a (mon.0) 8235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:13 smithi044 bash[22676]: audit 2024-09-21T02:03:12.521026+0000 mon.a (mon.0) 8236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:13 smithi044 bash[22676]: audit 2024-09-21T02:03:12.528664+0000 mon.a (mon.0) 8237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:13 smithi044 bash[22676]: audit 2024-09-21T02:03:12.537199+0000 mon.a (mon.0) 8238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:13 smithi179 bash[23186]: cluster 2024-09-21T02:03:12.094771+0000 mgr.a (mgr.14388) 9898 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:03:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:13 smithi179 bash[23186]: audit 2024-09-21T02:03:12.457489+0000 mon.a (mon.0) 8233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:13 smithi179 bash[23186]: audit 2024-09-21T02:03:12.465625+0000 mon.a (mon.0) 8234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:13 smithi179 bash[23186]: audit 2024-09-21T02:03:12.476492+0000 mon.a (mon.0) 8235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:13 smithi179 bash[23186]: audit 2024-09-21T02:03:12.521026+0000 mon.a (mon.0) 8236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:13 smithi179 bash[23186]: audit 2024-09-21T02:03:12.528664+0000 mon.a (mon.0) 8237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:13 smithi179 bash[23186]: audit 2024-09-21T02:03:12.537199+0000 mon.a (mon.0) 8238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:13 smithi049 bash[23528]: cluster 2024-09-21T02:03:12.094771+0000 mgr.a (mgr.14388) 9898 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:03:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:13 smithi049 bash[23528]: audit 2024-09-21T02:03:12.457489+0000 mon.a (mon.0) 8233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:13 smithi049 bash[23528]: audit 2024-09-21T02:03:12.465625+0000 mon.a (mon.0) 8234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:13 smithi049 bash[23528]: audit 2024-09-21T02:03:12.476492+0000 mon.a (mon.0) 8235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:13 smithi049 bash[23528]: audit 2024-09-21T02:03:12.521026+0000 mon.a (mon.0) 8236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:13 smithi049 bash[23528]: audit 2024-09-21T02:03:12.528664+0000 mon.a (mon.0) 8237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:13 smithi049 bash[23528]: audit 2024-09-21T02:03:12.537199+0000 mon.a (mon.0) 8238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:15 smithi044 bash[22676]: cluster 2024-09-21T02:03:14.095588+0000 mgr.a (mgr.14388) 9899 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:03:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:15 smithi179 bash[23186]: cluster 2024-09-21T02:03:14.095588+0000 mgr.a (mgr.14388) 9899 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:03:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:15 smithi049 bash[23528]: cluster 2024-09-21T02:03:14.095588+0000 mgr.a (mgr.14388) 9899 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:03:16.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:16.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:16.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:16.946 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:17 smithi044 bash[22676]: cluster 2024-09-21T02:03:16.097834+0000 mgr.a (mgr.14388) 9900 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:17 smithi044 bash[22676]: audit 2024-09-21T02:03:16.503583+0000 mgr.a (mgr.14388) 9901 : audit [DBG] from='client.219228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:17 smithi179 bash[23186]: cluster 2024-09-21T02:03:16.097834+0000 mgr.a (mgr.14388) 9900 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:17 smithi179 bash[23186]: audit 2024-09-21T02:03:16.503583+0000 mgr.a (mgr.14388) 9901 : audit [DBG] from='client.219228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:17 smithi049 bash[23528]: cluster 2024-09-21T02:03:16.097834+0000 mgr.a (mgr.14388) 9900 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:17 smithi049 bash[23528]: audit 2024-09-21T02:03:16.503583+0000 mgr.a (mgr.14388) 9901 : audit [DBG] from='client.219228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:19 smithi044 bash[22676]: cluster 2024-09-21T02:03:18.098779+0000 mgr.a (mgr.14388) 9902 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:19 smithi044 bash[22676]: audit 2024-09-21T02:03:19.190407+0000 mon.a (mon.0) 8239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:19 smithi044 bash[22676]: audit 2024-09-21T02:03:19.199091+0000 mon.a (mon.0) 8240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:19 smithi044 bash[22676]: audit 2024-09-21T02:03:19.210236+0000 mon.a (mon.0) 8241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:19 smithi179 bash[23186]: cluster 2024-09-21T02:03:18.098779+0000 mgr.a (mgr.14388) 9902 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:19 smithi179 bash[23186]: audit 2024-09-21T02:03:19.190407+0000 mon.a (mon.0) 8239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:19 smithi179 bash[23186]: audit 2024-09-21T02:03:19.199091+0000 mon.a (mon.0) 8240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:19 smithi179 bash[23186]: audit 2024-09-21T02:03:19.210236+0000 mon.a (mon.0) 8241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:19 smithi049 bash[23528]: cluster 2024-09-21T02:03:18.098779+0000 mgr.a (mgr.14388) 9902 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:19 smithi049 bash[23528]: audit 2024-09-21T02:03:19.190407+0000 mon.a (mon.0) 8239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:19 smithi049 bash[23528]: audit 2024-09-21T02:03:19.199091+0000 mon.a (mon.0) 8240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:19 smithi049 bash[23528]: audit 2024-09-21T02:03:19.210236+0000 mon.a (mon.0) 8241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:21 smithi044 bash[22676]: cluster 2024-09-21T02:03:20.100281+0000 mgr.a (mgr.14388) 9903 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:21 smithi179 bash[23186]: cluster 2024-09-21T02:03:20.100281+0000 mgr.a (mgr.14388) 9903 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:21 smithi049 bash[23528]: cluster 2024-09-21T02:03:20.100281+0000 mgr.a (mgr.14388) 9903 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:21.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:21.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:22.750 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:22.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:23 smithi044 bash[22676]: cluster 2024-09-21T02:03:22.100760+0000 mgr.a (mgr.14388) 9904 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:23 smithi044 bash[22676]: audit 2024-09-21T02:03:22.287722+0000 mgr.a (mgr.14388) 9905 : audit [DBG] from='client.219306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:23 smithi179 bash[23186]: cluster 2024-09-21T02:03:22.100760+0000 mgr.a (mgr.14388) 9904 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:23 smithi179 bash[23186]: audit 2024-09-21T02:03:22.287722+0000 mgr.a (mgr.14388) 9905 : audit [DBG] from='client.219306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:23 smithi049 bash[23528]: cluster 2024-09-21T02:03:22.100760+0000 mgr.a (mgr.14388) 9904 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:23 smithi049 bash[23528]: audit 2024-09-21T02:03:22.287722+0000 mgr.a (mgr.14388) 9905 : audit [DBG] from='client.219306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:25 smithi044 bash[22676]: cluster 2024-09-21T02:03:24.101790+0000 mgr.a (mgr.14388) 9906 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:25 smithi179 bash[23186]: cluster 2024-09-21T02:03:24.101790+0000 mgr.a (mgr.14388) 9906 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:25 smithi049 bash[23528]: cluster 2024-09-21T02:03:24.101790+0000 mgr.a (mgr.14388) 9906 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:27 smithi044 bash[22676]: cluster 2024-09-21T02:03:26.104172+0000 mgr.a (mgr.14388) 9907 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:27 smithi179 bash[23186]: cluster 2024-09-21T02:03:26.104172+0000 mgr.a (mgr.14388) 9907 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:27.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:27.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:27.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:27 smithi049 bash[23528]: cluster 2024-09-21T02:03:26.104172+0000 mgr.a (mgr.14388) 9907 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:28.498 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:28.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:28.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:28.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:28.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:29 smithi179 bash[23186]: audit 2024-09-21T02:03:28.077211+0000 mgr.a (mgr.14388) 9908 : audit [DBG] from='client.219384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:29 smithi179 bash[23186]: cluster 2024-09-21T02:03:28.105282+0000 mgr.a (mgr.14388) 9909 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:29 smithi049 bash[23528]: audit 2024-09-21T02:03:28.077211+0000 mgr.a (mgr.14388) 9908 : audit [DBG] from='client.219384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:29 smithi049 bash[23528]: cluster 2024-09-21T02:03:28.105282+0000 mgr.a (mgr.14388) 9909 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:29 smithi044 bash[22676]: audit 2024-09-21T02:03:28.077211+0000 mgr.a (mgr.14388) 9908 : audit [DBG] from='client.219384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:29 smithi044 bash[22676]: cluster 2024-09-21T02:03:28.105282+0000 mgr.a (mgr.14388) 9909 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:31 smithi179 bash[23186]: cluster 2024-09-21T02:03:30.107575+0000 mgr.a (mgr.14388) 9910 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:31 smithi049 bash[23528]: cluster 2024-09-21T02:03:30.107575+0000 mgr.a (mgr.14388) 9910 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:31 smithi044 bash[22676]: cluster 2024-09-21T02:03:30.107575+0000 mgr.a (mgr.14388) 9910 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:03:33.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:33.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:33.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: cluster 2024-09-21T02:03:32.108476+0000 mgr.a (mgr.14388) 9911 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: audit 2024-09-21T02:03:32.688248+0000 mon.a (mon.0) 8242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: audit 2024-09-21T02:03:32.695125+0000 mon.a (mon.0) 8243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: audit 2024-09-21T02:03:32.701424+0000 mon.a (mon.0) 8244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: audit 2024-09-21T02:03:32.747868+0000 mon.a (mon.0) 8245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: audit 2024-09-21T02:03:32.756893+0000 mon.a (mon.0) 8246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: audit 2024-09-21T02:03:32.767137+0000 mon.a (mon.0) 8247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:33 smithi044 bash[22676]: audit 2024-09-21T02:03:33.519977+0000 mon.a (mon.0) 8248 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:03:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: cluster 2024-09-21T02:03:32.108476+0000 mgr.a (mgr.14388) 9911 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: audit 2024-09-21T02:03:32.688248+0000 mon.a (mon.0) 8242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: audit 2024-09-21T02:03:32.695125+0000 mon.a (mon.0) 8243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: audit 2024-09-21T02:03:32.701424+0000 mon.a (mon.0) 8244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: audit 2024-09-21T02:03:32.747868+0000 mon.a (mon.0) 8245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: audit 2024-09-21T02:03:32.756893+0000 mon.a (mon.0) 8246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: audit 2024-09-21T02:03:32.767137+0000 mon.a (mon.0) 8247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:33 smithi179 bash[23186]: audit 2024-09-21T02:03:33.519977+0000 mon.a (mon.0) 8248 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:03:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: cluster 2024-09-21T02:03:32.108476+0000 mgr.a (mgr.14388) 9911 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: audit 2024-09-21T02:03:32.688248+0000 mon.a (mon.0) 8242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: audit 2024-09-21T02:03:32.695125+0000 mon.a (mon.0) 8243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: audit 2024-09-21T02:03:32.701424+0000 mon.a (mon.0) 8244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: audit 2024-09-21T02:03:32.747868+0000 mon.a (mon.0) 8245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: audit 2024-09-21T02:03:32.756893+0000 mon.a (mon.0) 8246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: audit 2024-09-21T02:03:32.767137+0000 mon.a (mon.0) 8247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:33 smithi049 bash[23528]: audit 2024-09-21T02:03:33.519977+0000 mon.a (mon.0) 8248 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:03:34.295 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:34.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:34.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:34.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:34.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:33.856305+0000 mgr.a (mgr.14388) 9912 : audit [DBG] from='client.219462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.108411+0000 mon.a (mon.0) 8249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.114183+0000 mon.a (mon.0) 8250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.118831+0000 mon.a (mon.0) 8251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.123653+0000 mon.a (mon.0) 8252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.124784+0000 mon.a (mon.0) 8253 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:03:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.125478+0000 mon.a (mon.0) 8254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:03:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.130266+0000 mon.a (mon.0) 8255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:34 smithi044 bash[22676]: audit 2024-09-21T02:03:34.132691+0000 mon.a (mon.0) 8256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:03:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:33.856305+0000 mgr.a (mgr.14388) 9912 : audit [DBG] from='client.219462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.108411+0000 mon.a (mon.0) 8249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.114183+0000 mon.a (mon.0) 8250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.118831+0000 mon.a (mon.0) 8251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.123653+0000 mon.a (mon.0) 8252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.124784+0000 mon.a (mon.0) 8253 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:03:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.125478+0000 mon.a (mon.0) 8254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:03:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.130266+0000 mon.a (mon.0) 8255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:34 smithi179 bash[23186]: audit 2024-09-21T02:03:34.132691+0000 mon.a (mon.0) 8256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:33.856305+0000 mgr.a (mgr.14388) 9912 : audit [DBG] from='client.219462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.108411+0000 mon.a (mon.0) 8249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.114183+0000 mon.a (mon.0) 8250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.118831+0000 mon.a (mon.0) 8251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.123653+0000 mon.a (mon.0) 8252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.124784+0000 mon.a (mon.0) 8253 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.125478+0000 mon.a (mon.0) 8254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.130266+0000 mon.a (mon.0) 8255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:34 smithi049 bash[23528]: audit 2024-09-21T02:03:34.132691+0000 mon.a (mon.0) 8256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:03:35.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:03:35 smithi044 bash[22930]: debug 2024-09-21T02:03:34.994+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:03:35.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:03:35 smithi044 bash[22930]: debug 2024-09-21T02:03:34.998+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:03:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:35 smithi044 bash[22676]: cluster 2024-09-21T02:03:34.109028+0000 mgr.a (mgr.14388) 9913 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:35 smithi044 bash[22676]: audit 2024-09-21T02:03:34.134315+0000 mgr.a (mgr.14388) 9914 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:03:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:35 smithi044 bash[22676]: audit 2024-09-21T02:03:35.000798+0000 mgr.a (mgr.14388) 9915 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:03:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:35 smithi044 bash[22676]: cephadm 2024-09-21T02:03:35.002123+0000 mgr.a (mgr.14388) 9916 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:03:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:35 smithi179 bash[23186]: cluster 2024-09-21T02:03:34.109028+0000 mgr.a (mgr.14388) 9913 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:35 smithi179 bash[23186]: audit 2024-09-21T02:03:34.134315+0000 mgr.a (mgr.14388) 9914 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:03:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:35 smithi179 bash[23186]: audit 2024-09-21T02:03:35.000798+0000 mgr.a (mgr.14388) 9915 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:03:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:35 smithi179 bash[23186]: cephadm 2024-09-21T02:03:35.002123+0000 mgr.a (mgr.14388) 9916 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:03:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:35 smithi049 bash[23528]: cluster 2024-09-21T02:03:34.109028+0000 mgr.a (mgr.14388) 9913 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:35 smithi049 bash[23528]: audit 2024-09-21T02:03:34.134315+0000 mgr.a (mgr.14388) 9914 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:03:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:35 smithi049 bash[23528]: audit 2024-09-21T02:03:35.000798+0000 mgr.a (mgr.14388) 9915 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:03:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:35 smithi049 bash[23528]: cephadm 2024-09-21T02:03:35.002123+0000 mgr.a (mgr.14388) 9916 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:03:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:37 smithi044 bash[22676]: cluster 2024-09-21T02:03:36.111396+0000 mgr.a (mgr.14388) 9917 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:03:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:37 smithi179 bash[23186]: cluster 2024-09-21T02:03:36.111396+0000 mgr.a (mgr.14388) 9917 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:03:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:37 smithi049 bash[23528]: cluster 2024-09-21T02:03:36.111396+0000 mgr.a (mgr.14388) 9917 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:03:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:39 smithi044 bash[22676]: cluster 2024-09-21T02:03:38.112215+0000 mgr.a (mgr.14388) 9918 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:03:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:39 smithi044 bash[22676]: audit 2024-09-21T02:03:39.412176+0000 mon.a (mon.0) 8257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:39 smithi044 bash[22676]: audit 2024-09-21T02:03:39.419101+0000 mon.a (mon.0) 8258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:39 smithi044 bash[22676]: audit 2024-09-21T02:03:39.427840+0000 mon.a (mon.0) 8259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:39 smithi179 bash[23186]: cluster 2024-09-21T02:03:38.112215+0000 mgr.a (mgr.14388) 9918 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:03:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:39 smithi179 bash[23186]: audit 2024-09-21T02:03:39.412176+0000 mon.a (mon.0) 8257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:39 smithi179 bash[23186]: audit 2024-09-21T02:03:39.419101+0000 mon.a (mon.0) 8258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:39 smithi179 bash[23186]: audit 2024-09-21T02:03:39.427840+0000 mon.a (mon.0) 8259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:39 smithi049 bash[23528]: cluster 2024-09-21T02:03:38.112215+0000 mgr.a (mgr.14388) 9918 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:03:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:39 smithi049 bash[23528]: audit 2024-09-21T02:03:39.412176+0000 mon.a (mon.0) 8257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:39 smithi049 bash[23528]: audit 2024-09-21T02:03:39.419101+0000 mon.a (mon.0) 8258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:39 smithi049 bash[23528]: audit 2024-09-21T02:03:39.427840+0000 mon.a (mon.0) 8259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:40.084 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:40 smithi044 bash[22676]: audit 2024-09-21T02:03:39.644665+0000 mgr.a (mgr.14388) 9919 : audit [DBG] from='client.219645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:40 smithi179 bash[23186]: audit 2024-09-21T02:03:39.644665+0000 mgr.a (mgr.14388) 9919 : audit [DBG] from='client.219645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:40 smithi049 bash[23528]: audit 2024-09-21T02:03:39.644665+0000 mgr.a (mgr.14388) 9919 : audit [DBG] from='client.219645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:41.969 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:41 smithi049 bash[23528]: cluster 2024-09-21T02:03:40.113432+0000 mgr.a (mgr.14388) 9920 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:03:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:41 smithi044 bash[22676]: cluster 2024-09-21T02:03:40.113432+0000 mgr.a (mgr.14388) 9920 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:03:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:41 smithi179 bash[23186]: cluster 2024-09-21T02:03:40.113432+0000 mgr.a (mgr.14388) 9920 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:03:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:43 smithi044 bash[22676]: cluster 2024-09-21T02:03:42.114178+0000 mgr.a (mgr.14388) 9921 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:03:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:43 smithi179 bash[23186]: cluster 2024-09-21T02:03:42.114178+0000 mgr.a (mgr.14388) 9921 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:03:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:43 smithi049 bash[23528]: cluster 2024-09-21T02:03:42.114178+0000 mgr.a (mgr.14388) 9921 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:03:45.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:45.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:45.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:45.838 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:45.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:45.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:45.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:45.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:45.985 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:45 smithi179 bash[23186]: cluster 2024-09-21T02:03:44.114951+0000 mgr.a (mgr.14388) 9922 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:03:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:45 smithi044 bash[22676]: cluster 2024-09-21T02:03:44.114951+0000 mgr.a (mgr.14388) 9922 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:03:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:45 smithi049 bash[23528]: cluster 2024-09-21T02:03:44.114951+0000 mgr.a (mgr.14388) 9922 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:03:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:46 smithi044 bash[22676]: audit 2024-09-21T02:03:45.416075+0000 mgr.a (mgr.14388) 9923 : audit [DBG] from='client.219720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:46 smithi179 bash[23186]: audit 2024-09-21T02:03:45.416075+0000 mgr.a (mgr.14388) 9923 : audit [DBG] from='client.219720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:46 smithi049 bash[23528]: audit 2024-09-21T02:03:45.416075+0000 mgr.a (mgr.14388) 9923 : audit [DBG] from='client.219720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:47 smithi044 bash[22676]: cluster 2024-09-21T02:03:46.117646+0000 mgr.a (mgr.14388) 9924 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:03:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:47 smithi179 bash[23186]: cluster 2024-09-21T02:03:46.117646+0000 mgr.a (mgr.14388) 9924 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:03:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:47 smithi049 bash[23528]: cluster 2024-09-21T02:03:46.117646+0000 mgr.a (mgr.14388) 9924 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:03:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:49 smithi179 bash[23186]: cluster 2024-09-21T02:03:48.118452+0000 mgr.a (mgr.14388) 9925 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-21T02:03:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:49 smithi049 bash[23528]: cluster 2024-09-21T02:03:48.118452+0000 mgr.a (mgr.14388) 9925 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-21T02:03:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:49 smithi044 bash[22676]: cluster 2024-09-21T02:03:48.118452+0000 mgr.a (mgr.14388) 9925 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-21T02:03:50.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:50.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:51.596 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:51 smithi179 bash[23186]: cluster 2024-09-21T02:03:50.120405+0000 mgr.a (mgr.14388) 9926 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T02:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:51 smithi049 bash[23528]: cluster 2024-09-21T02:03:50.120405+0000 mgr.a (mgr.14388) 9926 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T02:03:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:51 smithi044 bash[22676]: cluster 2024-09-21T02:03:50.120405+0000 mgr.a (mgr.14388) 9926 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T02:03:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:52 smithi179 bash[23186]: audit 2024-09-21T02:03:51.174256+0000 mgr.a (mgr.14388) 9927 : audit [DBG] from='client.219798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:52 smithi049 bash[23528]: audit 2024-09-21T02:03:51.174256+0000 mgr.a (mgr.14388) 9927 : audit [DBG] from='client.219798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:52 smithi044 bash[22676]: audit 2024-09-21T02:03:51.174256+0000 mgr.a (mgr.14388) 9927 : audit [DBG] from='client.219798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:53 smithi044 bash[22676]: cluster 2024-09-21T02:03:52.121357+0000 mgr.a (mgr.14388) 9928 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:03:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:53 smithi044 bash[22676]: audit 2024-09-21T02:03:52.872811+0000 mon.a (mon.0) 8260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:53 smithi044 bash[22676]: audit 2024-09-21T02:03:52.880546+0000 mon.a (mon.0) 8261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:53 smithi044 bash[22676]: audit 2024-09-21T02:03:52.890121+0000 mon.a (mon.0) 8262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:53 smithi044 bash[22676]: audit 2024-09-21T02:03:52.980406+0000 mon.a (mon.0) 8263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:53 smithi044 bash[22676]: audit 2024-09-21T02:03:52.988929+0000 mon.a (mon.0) 8264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:53 smithi044 bash[22676]: audit 2024-09-21T02:03:52.997884+0000 mon.a (mon.0) 8265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:53 smithi179 bash[23186]: cluster 2024-09-21T02:03:52.121357+0000 mgr.a (mgr.14388) 9928 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:03:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:53 smithi179 bash[23186]: audit 2024-09-21T02:03:52.872811+0000 mon.a (mon.0) 8260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:53 smithi179 bash[23186]: audit 2024-09-21T02:03:52.880546+0000 mon.a (mon.0) 8261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:53 smithi179 bash[23186]: audit 2024-09-21T02:03:52.890121+0000 mon.a (mon.0) 8262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:53 smithi179 bash[23186]: audit 2024-09-21T02:03:52.980406+0000 mon.a (mon.0) 8263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:53 smithi179 bash[23186]: audit 2024-09-21T02:03:52.988929+0000 mon.a (mon.0) 8264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:53 smithi179 bash[23186]: audit 2024-09-21T02:03:52.997884+0000 mon.a (mon.0) 8265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:53 smithi049 bash[23528]: cluster 2024-09-21T02:03:52.121357+0000 mgr.a (mgr.14388) 9928 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:03:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:53 smithi049 bash[23528]: audit 2024-09-21T02:03:52.872811+0000 mon.a (mon.0) 8260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:53 smithi049 bash[23528]: audit 2024-09-21T02:03:52.880546+0000 mon.a (mon.0) 8261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:53 smithi049 bash[23528]: audit 2024-09-21T02:03:52.890121+0000 mon.a (mon.0) 8262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:53 smithi049 bash[23528]: audit 2024-09-21T02:03:52.980406+0000 mon.a (mon.0) 8263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:53 smithi049 bash[23528]: audit 2024-09-21T02:03:52.988929+0000 mon.a (mon.0) 8264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:53 smithi049 bash[23528]: audit 2024-09-21T02:03:52.997884+0000 mon.a (mon.0) 8265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:55 smithi044 bash[22676]: cluster 2024-09-21T02:03:54.122146+0000 mgr.a (mgr.14388) 9929 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:03:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:55 smithi179 bash[23186]: cluster 2024-09-21T02:03:54.122146+0000 mgr.a (mgr.14388) 9929 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:03:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:55 smithi049 bash[23528]: cluster 2024-09-21T02:03:54.122146+0000 mgr.a (mgr.14388) 9929 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:03:56.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:03:56.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:03:56.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:03:57.380 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:03:57.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:03:57.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:03:57.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:03:57.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:03:58.148 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:57 smithi044 bash[22676]: cluster 2024-09-21T02:03:56.124330+0000 mgr.a (mgr.14388) 9930 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:03:58.148 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:57 smithi044 bash[22676]: audit 2024-09-21T02:03:56.934163+0000 mgr.a (mgr.14388) 9931 : audit [DBG] from='client.219873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:57 smithi179 bash[23186]: cluster 2024-09-21T02:03:56.124330+0000 mgr.a (mgr.14388) 9930 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:03:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:57 smithi179 bash[23186]: audit 2024-09-21T02:03:56.934163+0000 mgr.a (mgr.14388) 9931 : audit [DBG] from='client.219873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:57 smithi049 bash[23528]: cluster 2024-09-21T02:03:56.124330+0000 mgr.a (mgr.14388) 9930 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:03:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:57 smithi049 bash[23528]: audit 2024-09-21T02:03:56.934163+0000 mgr.a (mgr.14388) 9931 : audit [DBG] from='client.219873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:03:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:59 smithi044 bash[22676]: cluster 2024-09-21T02:03:58.124830+0000 mgr.a (mgr.14388) 9932 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:59 smithi044 bash[22676]: audit 2024-09-21T02:03:59.646559+0000 mon.a (mon.0) 8266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:59 smithi044 bash[22676]: audit 2024-09-21T02:03:59.655916+0000 mon.a (mon.0) 8267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:03:59 smithi044 bash[22676]: audit 2024-09-21T02:03:59.666757+0000 mon.a (mon.0) 8268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:59 smithi049 bash[23528]: cluster 2024-09-21T02:03:58.124830+0000 mgr.a (mgr.14388) 9932 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:59 smithi049 bash[23528]: audit 2024-09-21T02:03:59.646559+0000 mon.a (mon.0) 8266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:59 smithi049 bash[23528]: audit 2024-09-21T02:03:59.655916+0000 mon.a (mon.0) 8267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:03:59 smithi049 bash[23528]: audit 2024-09-21T02:03:59.666757+0000 mon.a (mon.0) 8268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:59 smithi179 bash[23186]: cluster 2024-09-21T02:03:58.124830+0000 mgr.a (mgr.14388) 9932 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:59 smithi179 bash[23186]: audit 2024-09-21T02:03:59.646559+0000 mon.a (mon.0) 8266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:59 smithi179 bash[23186]: audit 2024-09-21T02:03:59.655916+0000 mon.a (mon.0) 8267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:03:59 smithi179 bash[23186]: audit 2024-09-21T02:03:59.666757+0000 mon.a (mon.0) 8268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:01 smithi044 bash[22676]: cluster 2024-09-21T02:04:00.126602+0000 mgr.a (mgr.14388) 9933 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:01 smithi179 bash[23186]: cluster 2024-09-21T02:04:00.126602+0000 mgr.a (mgr.14388) 9933 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:01 smithi049 bash[23528]: cluster 2024-09-21T02:04:00.126602+0000 mgr.a (mgr.14388) 9933 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:02.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:02.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:03.131 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:03 smithi049 bash[23528]: cluster 2024-09-21T02:04:02.127380+0000 mgr.a (mgr.14388) 9934 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:03 smithi049 bash[23528]: audit 2024-09-21T02:04:02.714513+0000 mgr.a (mgr.14388) 9935 : audit [DBG] from='client.219948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:03 smithi044 bash[22676]: cluster 2024-09-21T02:04:02.127380+0000 mgr.a (mgr.14388) 9934 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:03 smithi044 bash[22676]: audit 2024-09-21T02:04:02.714513+0000 mgr.a (mgr.14388) 9935 : audit [DBG] from='client.219948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:03 smithi179 bash[23186]: cluster 2024-09-21T02:04:02.127380+0000 mgr.a (mgr.14388) 9934 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:03 smithi179 bash[23186]: audit 2024-09-21T02:04:02.714513+0000 mgr.a (mgr.14388) 9935 : audit [DBG] from='client.219948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:05 smithi044 bash[22676]: cluster 2024-09-21T02:04:04.128266+0000 mgr.a (mgr.14388) 9936 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:05 smithi179 bash[23186]: cluster 2024-09-21T02:04:04.128266+0000 mgr.a (mgr.14388) 9936 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:06.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:05 smithi049 bash[23528]: cluster 2024-09-21T02:04:04.128266+0000 mgr.a (mgr.14388) 9936 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:08.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:08.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:08.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:07 smithi044 bash[22676]: cluster 2024-09-21T02:04:06.130529+0000 mgr.a (mgr.14388) 9937 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:07 smithi179 bash[23186]: cluster 2024-09-21T02:04:06.130529+0000 mgr.a (mgr.14388) 9937 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:07 smithi049 bash[23528]: cluster 2024-09-21T02:04:06.130529+0000 mgr.a (mgr.14388) 9937 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:08.925 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:08.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:08.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:08.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:08.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:09 smithi044 bash[22676]: cluster 2024-09-21T02:04:08.131325+0000 mgr.a (mgr.14388) 9938 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:09 smithi044 bash[22676]: audit 2024-09-21T02:04:08.476020+0000 mgr.a (mgr.14388) 9939 : audit [DBG] from='client.220020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:09 smithi179 bash[23186]: cluster 2024-09-21T02:04:08.131325+0000 mgr.a (mgr.14388) 9938 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:09 smithi179 bash[23186]: audit 2024-09-21T02:04:08.476020+0000 mgr.a (mgr.14388) 9939 : audit [DBG] from='client.220020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:09 smithi049 bash[23528]: cluster 2024-09-21T02:04:08.131325+0000 mgr.a (mgr.14388) 9938 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:09 smithi049 bash[23528]: audit 2024-09-21T02:04:08.476020+0000 mgr.a (mgr.14388) 9939 : audit [DBG] from='client.220020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:11 smithi044 bash[22676]: cluster 2024-09-21T02:04:10.133685+0000 mgr.a (mgr.14388) 9940 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:11 smithi179 bash[23186]: cluster 2024-09-21T02:04:10.133685+0000 mgr.a (mgr.14388) 9940 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:11 smithi049 bash[23528]: cluster 2024-09-21T02:04:10.133685+0000 mgr.a (mgr.14388) 9940 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:13.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:13.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:13.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:13 smithi044 bash[22676]: cluster 2024-09-21T02:04:12.134544+0000 mgr.a (mgr.14388) 9941 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:13 smithi044 bash[22676]: audit 2024-09-21T02:04:13.075479+0000 mon.a (mon.0) 8269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:13 smithi044 bash[22676]: audit 2024-09-21T02:04:13.081087+0000 mon.a (mon.0) 8270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:13 smithi044 bash[22676]: audit 2024-09-21T02:04:13.088066+0000 mon.a (mon.0) 8271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:13 smithi044 bash[22676]: audit 2024-09-21T02:04:13.179643+0000 mon.a (mon.0) 8272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:13 smithi044 bash[22676]: audit 2024-09-21T02:04:13.187182+0000 mon.a (mon.0) 8273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:13 smithi044 bash[22676]: audit 2024-09-21T02:04:13.196629+0000 mon.a (mon.0) 8274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:13 smithi179 bash[23186]: cluster 2024-09-21T02:04:12.134544+0000 mgr.a (mgr.14388) 9941 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:13 smithi179 bash[23186]: audit 2024-09-21T02:04:13.075479+0000 mon.a (mon.0) 8269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:13 smithi179 bash[23186]: audit 2024-09-21T02:04:13.081087+0000 mon.a (mon.0) 8270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:13 smithi179 bash[23186]: audit 2024-09-21T02:04:13.088066+0000 mon.a (mon.0) 8271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:13 smithi179 bash[23186]: audit 2024-09-21T02:04:13.179643+0000 mon.a (mon.0) 8272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:13 smithi179 bash[23186]: audit 2024-09-21T02:04:13.187182+0000 mon.a (mon.0) 8273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:13 smithi179 bash[23186]: audit 2024-09-21T02:04:13.196629+0000 mon.a (mon.0) 8274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:13 smithi049 bash[23528]: cluster 2024-09-21T02:04:12.134544+0000 mgr.a (mgr.14388) 9941 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:13 smithi049 bash[23528]: audit 2024-09-21T02:04:13.075479+0000 mon.a (mon.0) 8269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:13 smithi049 bash[23528]: audit 2024-09-21T02:04:13.081087+0000 mon.a (mon.0) 8270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:13 smithi049 bash[23528]: audit 2024-09-21T02:04:13.088066+0000 mon.a (mon.0) 8271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:13 smithi049 bash[23528]: audit 2024-09-21T02:04:13.179643+0000 mon.a (mon.0) 8272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:13 smithi049 bash[23528]: audit 2024-09-21T02:04:13.187182+0000 mon.a (mon.0) 8273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:13 smithi049 bash[23528]: audit 2024-09-21T02:04:13.196629+0000 mon.a (mon.0) 8274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:14.706 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:14.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:15 smithi044 bash[22676]: cluster 2024-09-21T02:04:14.135132+0000 mgr.a (mgr.14388) 9942 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:15 smithi044 bash[22676]: audit 2024-09-21T02:04:14.260812+0000 mgr.a (mgr.14388) 9943 : audit [DBG] from='client.220098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:15 smithi179 bash[23186]: cluster 2024-09-21T02:04:14.135132+0000 mgr.a (mgr.14388) 9942 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:15 smithi179 bash[23186]: audit 2024-09-21T02:04:14.260812+0000 mgr.a (mgr.14388) 9943 : audit [DBG] from='client.220098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:15 smithi049 bash[23528]: cluster 2024-09-21T02:04:14.135132+0000 mgr.a (mgr.14388) 9942 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:15 smithi049 bash[23528]: audit 2024-09-21T02:04:14.260812+0000 mgr.a (mgr.14388) 9943 : audit [DBG] from='client.220098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:17 smithi044 bash[22676]: cluster 2024-09-21T02:04:16.137574+0000 mgr.a (mgr.14388) 9944 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:17 smithi179 bash[23186]: cluster 2024-09-21T02:04:16.137574+0000 mgr.a (mgr.14388) 9944 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:17 smithi049 bash[23528]: cluster 2024-09-21T02:04:16.137574+0000 mgr.a (mgr.14388) 9944 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:19 smithi044 bash[22676]: cluster 2024-09-21T02:04:18.138342+0000 mgr.a (mgr.14388) 9945 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:19 smithi044 bash[22676]: audit 2024-09-21T02:04:19.851021+0000 mon.a (mon.0) 8275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:19 smithi044 bash[22676]: audit 2024-09-21T02:04:19.857071+0000 mon.a (mon.0) 8276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:19 smithi044 bash[22676]: audit 2024-09-21T02:04:19.868214+0000 mon.a (mon.0) 8277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:19 smithi179 bash[23186]: cluster 2024-09-21T02:04:18.138342+0000 mgr.a (mgr.14388) 9945 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:19 smithi179 bash[23186]: audit 2024-09-21T02:04:19.851021+0000 mon.a (mon.0) 8275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:19 smithi179 bash[23186]: audit 2024-09-21T02:04:19.857071+0000 mon.a (mon.0) 8276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:19 smithi179 bash[23186]: audit 2024-09-21T02:04:19.868214+0000 mon.a (mon.0) 8277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:19 smithi049 bash[23528]: cluster 2024-09-21T02:04:18.138342+0000 mgr.a (mgr.14388) 9945 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:19 smithi049 bash[23528]: audit 2024-09-21T02:04:19.851021+0000 mon.a (mon.0) 8275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:19 smithi049 bash[23528]: audit 2024-09-21T02:04:19.857071+0000 mon.a (mon.0) 8276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:19 smithi049 bash[23528]: audit 2024-09-21T02:04:19.868214+0000 mon.a (mon.0) 8277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:20.480 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:20.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:20.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:20.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:20.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:21 smithi044 bash[22676]: audit 2024-09-21T02:04:20.057409+0000 mgr.a (mgr.14388) 9946 : audit [DBG] from='client.220176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:21 smithi044 bash[22676]: cluster 2024-09-21T02:04:20.139777+0000 mgr.a (mgr.14388) 9947 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:21 smithi179 bash[23186]: audit 2024-09-21T02:04:20.057409+0000 mgr.a (mgr.14388) 9946 : audit [DBG] from='client.220176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:21 smithi179 bash[23186]: cluster 2024-09-21T02:04:20.139777+0000 mgr.a (mgr.14388) 9947 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:21 smithi049 bash[23528]: audit 2024-09-21T02:04:20.057409+0000 mgr.a (mgr.14388) 9946 : audit [DBG] from='client.220176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:21 smithi049 bash[23528]: cluster 2024-09-21T02:04:20.139777+0000 mgr.a (mgr.14388) 9947 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:23 smithi049 bash[23528]: cluster 2024-09-21T02:04:22.140725+0000 mgr.a (mgr.14388) 9948 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:23 smithi044 bash[22676]: cluster 2024-09-21T02:04:22.140725+0000 mgr.a (mgr.14388) 9948 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:23 smithi179 bash[23186]: cluster 2024-09-21T02:04:22.140725+0000 mgr.a (mgr.14388) 9948 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:25.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:26.229 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:25 smithi049 bash[23528]: cluster 2024-09-21T02:04:24.141562+0000 mgr.a (mgr.14388) 9949 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:25 smithi044 bash[22676]: cluster 2024-09-21T02:04:24.141562+0000 mgr.a (mgr.14388) 9949 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:25 smithi179 bash[23186]: cluster 2024-09-21T02:04:24.141562+0000 mgr.a (mgr.14388) 9949 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:26.269 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:26.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:26.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:26.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:26.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:26 smithi044 bash[22676]: audit 2024-09-21T02:04:25.816581+0000 mgr.a (mgr.14388) 9950 : audit [DBG] from='client.220254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:26 smithi179 bash[23186]: audit 2024-09-21T02:04:25.816581+0000 mgr.a (mgr.14388) 9950 : audit [DBG] from='client.220254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:26 smithi049 bash[23528]: audit 2024-09-21T02:04:25.816581+0000 mgr.a (mgr.14388) 9950 : audit [DBG] from='client.220254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:27 smithi044 bash[22676]: cluster 2024-09-21T02:04:26.143147+0000 mgr.a (mgr.14388) 9951 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:27 smithi179 bash[23186]: cluster 2024-09-21T02:04:26.143147+0000 mgr.a (mgr.14388) 9951 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:27 smithi049 bash[23528]: cluster 2024-09-21T02:04:26.143147+0000 mgr.a (mgr.14388) 9951 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:29 smithi044 bash[22676]: cluster 2024-09-21T02:04:28.144201+0000 mgr.a (mgr.14388) 9952 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:29 smithi179 bash[23186]: cluster 2024-09-21T02:04:28.144201+0000 mgr.a (mgr.14388) 9952 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:30.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:29 smithi049 bash[23528]: cluster 2024-09-21T02:04:28.144201+0000 mgr.a (mgr.14388) 9952 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:04:31.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:32.020 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:31 smithi044 bash[22676]: cluster 2024-09-21T02:04:30.146586+0000 mgr.a (mgr.14388) 9953 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:31 smithi179 bash[23186]: cluster 2024-09-21T02:04:30.146586+0000 mgr.a (mgr.14388) 9953 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:31 smithi049 bash[23528]: cluster 2024-09-21T02:04:30.146586+0000 mgr.a (mgr.14388) 9953 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:32 smithi044 bash[22676]: audit 2024-09-21T02:04:31.605153+0000 mgr.a (mgr.14388) 9954 : audit [DBG] from='client.220332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:32 smithi179 bash[23186]: audit 2024-09-21T02:04:31.605153+0000 mgr.a (mgr.14388) 9954 : audit [DBG] from='client.220332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:32 smithi049 bash[23528]: audit 2024-09-21T02:04:31.605153+0000 mgr.a (mgr.14388) 9954 : audit [DBG] from='client.220332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:33 smithi044 bash[22676]: cluster 2024-09-21T02:04:32.147565+0000 mgr.a (mgr.14388) 9955 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:33 smithi044 bash[22676]: audit 2024-09-21T02:04:33.272573+0000 mon.a (mon.0) 8278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:33 smithi044 bash[22676]: audit 2024-09-21T02:04:33.279964+0000 mon.a (mon.0) 8279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:33 smithi044 bash[22676]: audit 2024-09-21T02:04:33.293223+0000 mon.a (mon.0) 8280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:33 smithi044 bash[22676]: audit 2024-09-21T02:04:33.411961+0000 mon.a (mon.0) 8281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:33 smithi044 bash[22676]: audit 2024-09-21T02:04:33.419588+0000 mon.a (mon.0) 8282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:33 smithi044 bash[22676]: audit 2024-09-21T02:04:33.429547+0000 mon.a (mon.0) 8283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:33 smithi179 bash[23186]: cluster 2024-09-21T02:04:32.147565+0000 mgr.a (mgr.14388) 9955 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:33 smithi179 bash[23186]: audit 2024-09-21T02:04:33.272573+0000 mon.a (mon.0) 8278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:33 smithi179 bash[23186]: audit 2024-09-21T02:04:33.279964+0000 mon.a (mon.0) 8279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:33 smithi179 bash[23186]: audit 2024-09-21T02:04:33.293223+0000 mon.a (mon.0) 8280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:33 smithi179 bash[23186]: audit 2024-09-21T02:04:33.411961+0000 mon.a (mon.0) 8281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:33 smithi179 bash[23186]: audit 2024-09-21T02:04:33.419588+0000 mon.a (mon.0) 8282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:33 smithi179 bash[23186]: audit 2024-09-21T02:04:33.429547+0000 mon.a (mon.0) 8283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:33 smithi049 bash[23528]: cluster 2024-09-21T02:04:32.147565+0000 mgr.a (mgr.14388) 9955 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:33 smithi049 bash[23528]: audit 2024-09-21T02:04:33.272573+0000 mon.a (mon.0) 8278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:33 smithi049 bash[23528]: audit 2024-09-21T02:04:33.279964+0000 mon.a (mon.0) 8279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:33 smithi049 bash[23528]: audit 2024-09-21T02:04:33.293223+0000 mon.a (mon.0) 8280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:33 smithi049 bash[23528]: audit 2024-09-21T02:04:33.411961+0000 mon.a (mon.0) 8281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:33 smithi049 bash[23528]: audit 2024-09-21T02:04:33.419588+0000 mon.a (mon.0) 8282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:33 smithi049 bash[23528]: audit 2024-09-21T02:04:33.429547+0000 mon.a (mon.0) 8283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: cluster 2024-09-21T02:04:34.148458+0000 mgr.a (mgr.14388) 9956 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: audit 2024-09-21T02:04:35.060378+0000 mon.a (mon.0) 8284 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:04:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: audit 2024-09-21T02:04:35.635291+0000 mon.a (mon.0) 8285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: audit 2024-09-21T02:04:35.644094+0000 mon.a (mon.0) 8286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: audit 2024-09-21T02:04:35.646402+0000 mon.a (mon.0) 8287 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:04:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: audit 2024-09-21T02:04:35.648354+0000 mon.a (mon.0) 8288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:04:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: audit 2024-09-21T02:04:35.660585+0000 mon.a (mon.0) 8289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:35 smithi044 bash[22676]: audit 2024-09-21T02:04:35.666943+0000 mon.a (mon.0) 8290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:04:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: cluster 2024-09-21T02:04:34.148458+0000 mgr.a (mgr.14388) 9956 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: audit 2024-09-21T02:04:35.060378+0000 mon.a (mon.0) 8284 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: audit 2024-09-21T02:04:35.635291+0000 mon.a (mon.0) 8285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: audit 2024-09-21T02:04:35.644094+0000 mon.a (mon.0) 8286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: audit 2024-09-21T02:04:35.646402+0000 mon.a (mon.0) 8287 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: audit 2024-09-21T02:04:35.648354+0000 mon.a (mon.0) 8288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: audit 2024-09-21T02:04:35.660585+0000 mon.a (mon.0) 8289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:35 smithi179 bash[23186]: audit 2024-09-21T02:04:35.666943+0000 mon.a (mon.0) 8290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: cluster 2024-09-21T02:04:34.148458+0000 mgr.a (mgr.14388) 9956 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: audit 2024-09-21T02:04:35.060378+0000 mon.a (mon.0) 8284 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: audit 2024-09-21T02:04:35.635291+0000 mon.a (mon.0) 8285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: audit 2024-09-21T02:04:35.644094+0000 mon.a (mon.0) 8286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: audit 2024-09-21T02:04:35.646402+0000 mon.a (mon.0) 8287 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:04:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: audit 2024-09-21T02:04:35.648354+0000 mon.a (mon.0) 8288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:04:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: audit 2024-09-21T02:04:35.660585+0000 mon.a (mon.0) 8289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:35 smithi049 bash[23528]: audit 2024-09-21T02:04:35.666943+0000 mon.a (mon.0) 8290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:04:36.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:04:36 smithi044 bash[22930]: debug 2024-09-21T02:04:36.465+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:04:36.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:04:36 smithi044 bash[22930]: debug 2024-09-21T02:04:36.465+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:04:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:36 smithi044 bash[22676]: audit 2024-09-21T02:04:35.669469+0000 mgr.a (mgr.14388) 9957 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:04:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:36 smithi179 bash[23186]: audit 2024-09-21T02:04:35.669469+0000 mgr.a (mgr.14388) 9957 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:04:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:36 smithi049 bash[23528]: audit 2024-09-21T02:04:35.669469+0000 mgr.a (mgr.14388) 9957 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:04:37.791 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:37.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:37 smithi044 bash[22676]: cluster 2024-09-21T02:04:36.150065+0000 mgr.a (mgr.14388) 9958 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:37 smithi044 bash[22676]: audit 2024-09-21T02:04:36.470562+0000 mgr.a (mgr.14388) 9959 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:04:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:37 smithi044 bash[22676]: cephadm 2024-09-21T02:04:36.472028+0000 mgr.a (mgr.14388) 9960 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:04:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:37 smithi179 bash[23186]: cluster 2024-09-21T02:04:36.150065+0000 mgr.a (mgr.14388) 9958 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:37 smithi179 bash[23186]: audit 2024-09-21T02:04:36.470562+0000 mgr.a (mgr.14388) 9959 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:04:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:37 smithi179 bash[23186]: cephadm 2024-09-21T02:04:36.472028+0000 mgr.a (mgr.14388) 9960 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:04:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:37 smithi049 bash[23528]: cluster 2024-09-21T02:04:36.150065+0000 mgr.a (mgr.14388) 9958 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:04:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:37 smithi049 bash[23528]: audit 2024-09-21T02:04:36.470562+0000 mgr.a (mgr.14388) 9959 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:04:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:37 smithi049 bash[23528]: cephadm 2024-09-21T02:04:36.472028+0000 mgr.a (mgr.14388) 9960 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:04:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:38 smithi179 bash[23186]: audit 2024-09-21T02:04:37.358231+0000 mgr.a (mgr.14388) 9961 : audit [DBG] from='client.220518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:39.268 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:38 smithi044 bash[22676]: audit 2024-09-21T02:04:37.358231+0000 mgr.a (mgr.14388) 9961 : audit [DBG] from='client.220518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:38 smithi049 bash[23528]: audit 2024-09-21T02:04:37.358231+0000 mgr.a (mgr.14388) 9961 : audit [DBG] from='client.220518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:39 smithi179 bash[23186]: cluster 2024-09-21T02:04:38.150976+0000 mgr.a (mgr.14388) 9962 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:40.254 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:39 smithi044 bash[22676]: cluster 2024-09-21T02:04:38.150976+0000 mgr.a (mgr.14388) 9962 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:39 smithi049 bash[23528]: cluster 2024-09-21T02:04:38.150976+0000 mgr.a (mgr.14388) 9962 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:41 smithi044 bash[22676]: audit 2024-09-21T02:04:40.087146+0000 mon.a (mon.0) 8291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:41 smithi044 bash[22676]: audit 2024-09-21T02:04:40.096104+0000 mon.a (mon.0) 8292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:41 smithi044 bash[22676]: audit 2024-09-21T02:04:40.106814+0000 mon.a (mon.0) 8293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:41 smithi044 bash[22676]: cluster 2024-09-21T02:04:40.153422+0000 mgr.a (mgr.14388) 9963 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:41 smithi179 bash[23186]: audit 2024-09-21T02:04:40.087146+0000 mon.a (mon.0) 8291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:41 smithi179 bash[23186]: audit 2024-09-21T02:04:40.096104+0000 mon.a (mon.0) 8292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:41 smithi179 bash[23186]: audit 2024-09-21T02:04:40.106814+0000 mon.a (mon.0) 8293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:41 smithi179 bash[23186]: cluster 2024-09-21T02:04:40.153422+0000 mgr.a (mgr.14388) 9963 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:41 smithi049 bash[23528]: audit 2024-09-21T02:04:40.087146+0000 mon.a (mon.0) 8291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:41 smithi049 bash[23528]: audit 2024-09-21T02:04:40.096104+0000 mon.a (mon.0) 8292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:41 smithi049 bash[23528]: audit 2024-09-21T02:04:40.106814+0000 mon.a (mon.0) 8293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:41 smithi049 bash[23528]: cluster 2024-09-21T02:04:40.153422+0000 mgr.a (mgr.14388) 9963 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:42.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:43 smithi049 bash[23528]: cluster 2024-09-21T02:04:42.154232+0000 mgr.a (mgr.14388) 9964 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:43 smithi044 bash[22676]: cluster 2024-09-21T02:04:42.154232+0000 mgr.a (mgr.14388) 9964 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:43 smithi179 bash[23186]: cluster 2024-09-21T02:04:42.154232+0000 mgr.a (mgr.14388) 9964 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:43.583 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:43.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:43.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:43.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:43.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:44.380 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:44 smithi049 bash[23528]: audit 2024-09-21T02:04:43.129007+0000 mgr.a (mgr.14388) 9965 : audit [DBG] from='client.220593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:44 smithi044 bash[22676]: audit 2024-09-21T02:04:43.129007+0000 mgr.a (mgr.14388) 9965 : audit [DBG] from='client.220593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:44.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:44 smithi179 bash[23186]: audit 2024-09-21T02:04:43.129007+0000 mgr.a (mgr.14388) 9965 : audit [DBG] from='client.220593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:45 smithi044 bash[22676]: cluster 2024-09-21T02:04:44.155210+0000 mgr.a (mgr.14388) 9966 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:45 smithi179 bash[23186]: cluster 2024-09-21T02:04:44.155210+0000 mgr.a (mgr.14388) 9966 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:45 smithi049 bash[23528]: cluster 2024-09-21T02:04:44.155210+0000 mgr.a (mgr.14388) 9966 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:47 smithi044 bash[22676]: cluster 2024-09-21T02:04:46.157444+0000 mgr.a (mgr.14388) 9967 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:47 smithi179 bash[23186]: cluster 2024-09-21T02:04:46.157444+0000 mgr.a (mgr.14388) 9967 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:47 smithi049 bash[23528]: cluster 2024-09-21T02:04:46.157444+0000 mgr.a (mgr.14388) 9967 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:49.327 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:49.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:49.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:49.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:49.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:49 smithi044 bash[22676]: cluster 2024-09-21T02:04:48.158362+0000 mgr.a (mgr.14388) 9968 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:49 smithi044 bash[22676]: audit 2024-09-21T02:04:48.907061+0000 mgr.a (mgr.14388) 9969 : audit [DBG] from='client.220668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:49 smithi179 bash[23186]: cluster 2024-09-21T02:04:48.158362+0000 mgr.a (mgr.14388) 9968 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:49 smithi179 bash[23186]: audit 2024-09-21T02:04:48.907061+0000 mgr.a (mgr.14388) 9969 : audit [DBG] from='client.220668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:49.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:49 smithi049 bash[23528]: cluster 2024-09-21T02:04:48.158362+0000 mgr.a (mgr.14388) 9968 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:49 smithi049 bash[23528]: audit 2024-09-21T02:04:48.907061+0000 mgr.a (mgr.14388) 9969 : audit [DBG] from='client.220668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:51 smithi044 bash[22676]: cluster 2024-09-21T02:04:50.160881+0000 mgr.a (mgr.14388) 9970 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:51 smithi179 bash[23186]: cluster 2024-09-21T02:04:50.160881+0000 mgr.a (mgr.14388) 9970 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:51 smithi049 bash[23528]: cluster 2024-09-21T02:04:50.160881+0000 mgr.a (mgr.14388) 9970 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:04:53.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:53 smithi044 bash[22676]: cluster 2024-09-21T02:04:52.161743+0000 mgr.a (mgr.14388) 9971 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:53 smithi179 bash[23186]: cluster 2024-09-21T02:04:52.161743+0000 mgr.a (mgr.14388) 9971 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:53 smithi049 bash[23528]: cluster 2024-09-21T02:04:52.161743+0000 mgr.a (mgr.14388) 9971 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:54.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:04:54.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:04:54.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:04:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:54 smithi044 bash[22676]: audit 2024-09-21T02:04:53.474386+0000 mon.a (mon.0) 8294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:54 smithi044 bash[22676]: audit 2024-09-21T02:04:53.485001+0000 mon.a (mon.0) 8295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:54 smithi044 bash[22676]: audit 2024-09-21T02:04:53.497886+0000 mon.a (mon.0) 8296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:54 smithi044 bash[22676]: audit 2024-09-21T02:04:53.655902+0000 mon.a (mon.0) 8297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:54 smithi044 bash[22676]: audit 2024-09-21T02:04:53.664418+0000 mon.a (mon.0) 8298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:54 smithi044 bash[22676]: audit 2024-09-21T02:04:53.674586+0000 mon.a (mon.0) 8299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:54 smithi179 bash[23186]: audit 2024-09-21T02:04:53.474386+0000 mon.a (mon.0) 8294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:54 smithi179 bash[23186]: audit 2024-09-21T02:04:53.485001+0000 mon.a (mon.0) 8295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:54 smithi179 bash[23186]: audit 2024-09-21T02:04:53.497886+0000 mon.a (mon.0) 8296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:54 smithi179 bash[23186]: audit 2024-09-21T02:04:53.655902+0000 mon.a (mon.0) 8297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:54 smithi179 bash[23186]: audit 2024-09-21T02:04:53.664418+0000 mon.a (mon.0) 8298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:54 smithi179 bash[23186]: audit 2024-09-21T02:04:53.674586+0000 mon.a (mon.0) 8299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:54 smithi049 bash[23528]: audit 2024-09-21T02:04:53.474386+0000 mon.a (mon.0) 8294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:54 smithi049 bash[23528]: audit 2024-09-21T02:04:53.485001+0000 mon.a (mon.0) 8295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:54 smithi049 bash[23528]: audit 2024-09-21T02:04:53.497886+0000 mon.a (mon.0) 8296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:54 smithi049 bash[23528]: audit 2024-09-21T02:04:53.655902+0000 mon.a (mon.0) 8297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:54 smithi049 bash[23528]: audit 2024-09-21T02:04:53.664418+0000 mon.a (mon.0) 8298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:54 smithi049 bash[23528]: audit 2024-09-21T02:04:53.674586+0000 mon.a (mon.0) 8299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:04:55.101 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:04:55.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:04:55.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:04:55.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:04:55.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:04:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:55 smithi044 bash[22676]: cluster 2024-09-21T02:04:54.162502+0000 mgr.a (mgr.14388) 9972 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:55 smithi044 bash[22676]: audit 2024-09-21T02:04:54.669175+0000 mgr.a (mgr.14388) 9973 : audit [DBG] from='client.220746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:55 smithi179 bash[23186]: cluster 2024-09-21T02:04:54.162502+0000 mgr.a (mgr.14388) 9972 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:55 smithi179 bash[23186]: audit 2024-09-21T02:04:54.669175+0000 mgr.a (mgr.14388) 9973 : audit [DBG] from='client.220746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:55 smithi049 bash[23528]: cluster 2024-09-21T02:04:54.162502+0000 mgr.a (mgr.14388) 9972 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:04:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:55 smithi049 bash[23528]: audit 2024-09-21T02:04:54.669175+0000 mgr.a (mgr.14388) 9973 : audit [DBG] from='client.220746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:04:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:57 smithi044 bash[22676]: cluster 2024-09-21T02:04:56.165414+0000 mgr.a (mgr.14388) 9974 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:04:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:57 smithi179 bash[23186]: cluster 2024-09-21T02:04:56.165414+0000 mgr.a (mgr.14388) 9974 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:04:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:57 smithi049 bash[23528]: cluster 2024-09-21T02:04:56.165414+0000 mgr.a (mgr.14388) 9974 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:04:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:04:59 smithi044 bash[22676]: cluster 2024-09-21T02:04:58.166427+0000 mgr.a (mgr.14388) 9975 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:05:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:04:59 smithi179 bash[23186]: cluster 2024-09-21T02:04:58.166427+0000 mgr.a (mgr.14388) 9975 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:05:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:04:59 smithi049 bash[23528]: cluster 2024-09-21T02:04:58.166427+0000 mgr.a (mgr.14388) 9975 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:05:00.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:00.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:00.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:00.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:01 smithi044 bash[22676]: cluster 2024-09-21T02:05:00.168569+0000 mgr.a (mgr.14388) 9976 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:01 smithi044 bash[22676]: audit 2024-09-21T02:05:00.313166+0000 mon.a (mon.0) 8300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:01 smithi044 bash[22676]: audit 2024-09-21T02:05:00.321281+0000 mon.a (mon.0) 8301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:01 smithi044 bash[22676]: audit 2024-09-21T02:05:00.330515+0000 mon.a (mon.0) 8302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:01 smithi044 bash[22676]: audit 2024-09-21T02:05:00.445926+0000 mgr.a (mgr.14388) 9977 : audit [DBG] from='client.220824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:01 smithi179 bash[23186]: cluster 2024-09-21T02:05:00.168569+0000 mgr.a (mgr.14388) 9976 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:01 smithi179 bash[23186]: audit 2024-09-21T02:05:00.313166+0000 mon.a (mon.0) 8300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:01 smithi179 bash[23186]: audit 2024-09-21T02:05:00.321281+0000 mon.a (mon.0) 8301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:01 smithi179 bash[23186]: audit 2024-09-21T02:05:00.330515+0000 mon.a (mon.0) 8302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:01 smithi179 bash[23186]: audit 2024-09-21T02:05:00.445926+0000 mgr.a (mgr.14388) 9977 : audit [DBG] from='client.220824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:01 smithi049 bash[23528]: cluster 2024-09-21T02:05:00.168569+0000 mgr.a (mgr.14388) 9976 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:01 smithi049 bash[23528]: audit 2024-09-21T02:05:00.313166+0000 mon.a (mon.0) 8300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:01 smithi049 bash[23528]: audit 2024-09-21T02:05:00.321281+0000 mon.a (mon.0) 8301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:01 smithi049 bash[23528]: audit 2024-09-21T02:05:00.330515+0000 mon.a (mon.0) 8302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:01 smithi049 bash[23528]: audit 2024-09-21T02:05:00.445926+0000 mgr.a (mgr.14388) 9977 : audit [DBG] from='client.220824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:03 smithi044 bash[22676]: cluster 2024-09-21T02:05:02.169790+0000 mgr.a (mgr.14388) 9978 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:03 smithi179 bash[23186]: cluster 2024-09-21T02:05:02.169790+0000 mgr.a (mgr.14388) 9978 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:03 smithi049 bash[23528]: cluster 2024-09-21T02:05:02.169790+0000 mgr.a (mgr.14388) 9978 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:05 smithi044 bash[22676]: cluster 2024-09-21T02:05:04.170782+0000 mgr.a (mgr.14388) 9979 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:05 smithi179 bash[23186]: cluster 2024-09-21T02:05:04.170782+0000 mgr.a (mgr.14388) 9979 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:05 smithi049 bash[23528]: cluster 2024-09-21T02:05:04.170782+0000 mgr.a (mgr.14388) 9979 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:05.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:05.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:05.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:06.679 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:06.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:06.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:06.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:06.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:07 smithi049 bash[23528]: cluster 2024-09-21T02:05:06.172175+0000 mgr.a (mgr.14388) 9980 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:07 smithi049 bash[23528]: audit 2024-09-21T02:05:06.250769+0000 mgr.a (mgr.14388) 9981 : audit [DBG] from='client.220899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:07 smithi044 bash[22676]: cluster 2024-09-21T02:05:06.172175+0000 mgr.a (mgr.14388) 9980 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:07 smithi044 bash[22676]: audit 2024-09-21T02:05:06.250769+0000 mgr.a (mgr.14388) 9981 : audit [DBG] from='client.220899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:07 smithi179 bash[23186]: cluster 2024-09-21T02:05:06.172175+0000 mgr.a (mgr.14388) 9980 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:07 smithi179 bash[23186]: audit 2024-09-21T02:05:06.250769+0000 mgr.a (mgr.14388) 9981 : audit [DBG] from='client.220899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:09 smithi044 bash[22676]: cluster 2024-09-21T02:05:08.173220+0000 mgr.a (mgr.14388) 9982 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:05:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:09 smithi179 bash[23186]: cluster 2024-09-21T02:05:08.173220+0000 mgr.a (mgr.14388) 9982 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:05:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:09 smithi049 bash[23528]: cluster 2024-09-21T02:05:08.173220+0000 mgr.a (mgr.14388) 9982 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:05:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:11.682 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:11 smithi044 bash[22676]: cluster 2024-09-21T02:05:10.175567+0000 mgr.a (mgr.14388) 9983 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:05:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:11 smithi179 bash[23186]: cluster 2024-09-21T02:05:10.175567+0000 mgr.a (mgr.14388) 9983 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:05:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:11 smithi049 bash[23528]: cluster 2024-09-21T02:05:10.175567+0000 mgr.a (mgr.14388) 9983 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:05:12.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:12.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:12.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:12.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:12.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:12 smithi044 bash[22676]: audit 2024-09-21T02:05:12.018817+0000 mgr.a (mgr.14388) 9984 : audit [DBG] from='client.220974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:12 smithi179 bash[23186]: audit 2024-09-21T02:05:12.018817+0000 mgr.a (mgr.14388) 9984 : audit [DBG] from='client.220974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:12 smithi049 bash[23528]: audit 2024-09-21T02:05:12.018817+0000 mgr.a (mgr.14388) 9984 : audit [DBG] from='client.220974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:13.719 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:13 smithi179 bash[23186]: cluster 2024-09-21T02:05:12.176176+0000 mgr.a (mgr.14388) 9985 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:13 smithi044 bash[22676]: cluster 2024-09-21T02:05:12.176176+0000 mgr.a (mgr.14388) 9985 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:13 smithi049 bash[23528]: cluster 2024-09-21T02:05:12.176176+0000 mgr.a (mgr.14388) 9985 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:14 smithi044 bash[22676]: audit 2024-09-21T02:05:13.701720+0000 mon.a (mon.0) 8303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:14 smithi044 bash[22676]: audit 2024-09-21T02:05:13.709470+0000 mon.a (mon.0) 8304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:14 smithi044 bash[22676]: audit 2024-09-21T02:05:13.718057+0000 mon.a (mon.0) 8305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:14 smithi044 bash[22676]: audit 2024-09-21T02:05:13.839044+0000 mon.a (mon.0) 8306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:14 smithi044 bash[22676]: audit 2024-09-21T02:05:13.847885+0000 mon.a (mon.0) 8307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:14 smithi044 bash[22676]: audit 2024-09-21T02:05:13.859602+0000 mon.a (mon.0) 8308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:14 smithi179 bash[23186]: audit 2024-09-21T02:05:13.701720+0000 mon.a (mon.0) 8303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:14 smithi179 bash[23186]: audit 2024-09-21T02:05:13.709470+0000 mon.a (mon.0) 8304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:14 smithi179 bash[23186]: audit 2024-09-21T02:05:13.718057+0000 mon.a (mon.0) 8305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:14 smithi179 bash[23186]: audit 2024-09-21T02:05:13.839044+0000 mon.a (mon.0) 8306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:14 smithi179 bash[23186]: audit 2024-09-21T02:05:13.847885+0000 mon.a (mon.0) 8307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:14 smithi179 bash[23186]: audit 2024-09-21T02:05:13.859602+0000 mon.a (mon.0) 8308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:14 smithi049 bash[23528]: audit 2024-09-21T02:05:13.701720+0000 mon.a (mon.0) 8303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:14 smithi049 bash[23528]: audit 2024-09-21T02:05:13.709470+0000 mon.a (mon.0) 8304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:14 smithi049 bash[23528]: audit 2024-09-21T02:05:13.718057+0000 mon.a (mon.0) 8305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:14 smithi049 bash[23528]: audit 2024-09-21T02:05:13.839044+0000 mon.a (mon.0) 8306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:14 smithi049 bash[23528]: audit 2024-09-21T02:05:13.847885+0000 mon.a (mon.0) 8307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:14 smithi049 bash[23528]: audit 2024-09-21T02:05:13.859602+0000 mon.a (mon.0) 8308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:15 smithi044 bash[22676]: cluster 2024-09-21T02:05:14.177062+0000 mgr.a (mgr.14388) 9986 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:15 smithi179 bash[23186]: cluster 2024-09-21T02:05:14.177062+0000 mgr.a (mgr.14388) 9986 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:15 smithi049 bash[23528]: cluster 2024-09-21T02:05:14.177062+0000 mgr.a (mgr.14388) 9986 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:17 smithi044 bash[22676]: cluster 2024-09-21T02:05:16.179264+0000 mgr.a (mgr.14388) 9987 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:18.246 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:18.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:18.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:18.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:18.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:17 smithi179 bash[23186]: cluster 2024-09-21T02:05:16.179264+0000 mgr.a (mgr.14388) 9987 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:17 smithi049 bash[23528]: cluster 2024-09-21T02:05:16.179264+0000 mgr.a (mgr.14388) 9987 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:18 smithi044 bash[22676]: audit 2024-09-21T02:05:17.793800+0000 mgr.a (mgr.14388) 9988 : audit [DBG] from='client.221052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:18 smithi179 bash[23186]: audit 2024-09-21T02:05:17.793800+0000 mgr.a (mgr.14388) 9988 : audit [DBG] from='client.221052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:18 smithi049 bash[23528]: audit 2024-09-21T02:05:17.793800+0000 mgr.a (mgr.14388) 9988 : audit [DBG] from='client.221052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:19 smithi044 bash[22676]: cluster 2024-09-21T02:05:18.180269+0000 mgr.a (mgr.14388) 9989 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:19 smithi179 bash[23186]: cluster 2024-09-21T02:05:18.180269+0000 mgr.a (mgr.14388) 9989 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:19 smithi049 bash[23528]: cluster 2024-09-21T02:05:18.180269+0000 mgr.a (mgr.14388) 9989 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:21.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:21 smithi044 bash[22676]: cluster 2024-09-21T02:05:20.182466+0000 mgr.a (mgr.14388) 9990 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:21.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:21 smithi044 bash[22676]: audit 2024-09-21T02:05:20.521492+0000 mon.a (mon.0) 8309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:21.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:21 smithi044 bash[22676]: audit 2024-09-21T02:05:20.531455+0000 mon.a (mon.0) 8310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:21.800 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:21 smithi044 bash[22676]: audit 2024-09-21T02:05:20.541352+0000 mon.a (mon.0) 8311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:21 smithi049 bash[23528]: cluster 2024-09-21T02:05:20.182466+0000 mgr.a (mgr.14388) 9990 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:21 smithi049 bash[23528]: audit 2024-09-21T02:05:20.521492+0000 mon.a (mon.0) 8309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:21 smithi049 bash[23528]: audit 2024-09-21T02:05:20.531455+0000 mon.a (mon.0) 8310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:21 smithi049 bash[23528]: audit 2024-09-21T02:05:20.541352+0000 mon.a (mon.0) 8311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:21 smithi179 bash[23186]: cluster 2024-09-21T02:05:20.182466+0000 mgr.a (mgr.14388) 9990 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:21 smithi179 bash[23186]: audit 2024-09-21T02:05:20.521492+0000 mon.a (mon.0) 8309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:21 smithi179 bash[23186]: audit 2024-09-21T02:05:20.531455+0000 mon.a (mon.0) 8310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:21 smithi179 bash[23186]: audit 2024-09-21T02:05:20.541352+0000 mon.a (mon.0) 8311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:23 smithi049 bash[23528]: cluster 2024-09-21T02:05:22.183231+0000 mgr.a (mgr.14388) 9991 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:23 smithi044 bash[22676]: cluster 2024-09-21T02:05:22.183231+0000 mgr.a (mgr.14388) 9991 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:23 smithi179 bash[23186]: cluster 2024-09-21T02:05:22.183231+0000 mgr.a (mgr.14388) 9991 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:24.015 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:24 smithi049 bash[23528]: audit 2024-09-21T02:05:23.589047+0000 mgr.a (mgr.14388) 9992 : audit [DBG] from='client.221130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:24 smithi044 bash[22676]: audit 2024-09-21T02:05:23.589047+0000 mgr.a (mgr.14388) 9992 : audit [DBG] from='client.221130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:24 smithi179 bash[23186]: audit 2024-09-21T02:05:23.589047+0000 mgr.a (mgr.14388) 9992 : audit [DBG] from='client.221130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:25 smithi049 bash[23528]: cluster 2024-09-21T02:05:24.184295+0000 mgr.a (mgr.14388) 9993 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:25 smithi044 bash[22676]: cluster 2024-09-21T02:05:24.184295+0000 mgr.a (mgr.14388) 9993 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:25 smithi179 bash[23186]: cluster 2024-09-21T02:05:24.184295+0000 mgr.a (mgr.14388) 9993 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:27 smithi049 bash[23528]: cluster 2024-09-21T02:05:26.186628+0000 mgr.a (mgr.14388) 9994 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:27 smithi044 bash[22676]: cluster 2024-09-21T02:05:26.186628+0000 mgr.a (mgr.14388) 9994 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:27 smithi179 bash[23186]: cluster 2024-09-21T02:05:26.186628+0000 mgr.a (mgr.14388) 9994 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:29.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:29.017 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:29.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:29.771 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:29.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:29.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:29.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:29.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:29 smithi044 bash[22676]: cluster 2024-09-21T02:05:28.187398+0000 mgr.a (mgr.14388) 9995 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:29 smithi179 bash[23186]: cluster 2024-09-21T02:05:28.187398+0000 mgr.a (mgr.14388) 9995 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:29 smithi049 bash[23528]: cluster 2024-09-21T02:05:28.187398+0000 mgr.a (mgr.14388) 9995 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:30 smithi044 bash[22676]: audit 2024-09-21T02:05:29.345650+0000 mgr.a (mgr.14388) 9996 : audit [DBG] from='client.221205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:31.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:30 smithi179 bash[23186]: audit 2024-09-21T02:05:29.345650+0000 mgr.a (mgr.14388) 9996 : audit [DBG] from='client.221205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:30 smithi049 bash[23528]: audit 2024-09-21T02:05:29.345650+0000 mgr.a (mgr.14388) 9996 : audit [DBG] from='client.221205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:31 smithi044 bash[22676]: cluster 2024-09-21T02:05:30.189730+0000 mgr.a (mgr.14388) 9997 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:31 smithi179 bash[23186]: cluster 2024-09-21T02:05:30.189730+0000 mgr.a (mgr.14388) 9997 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:31 smithi049 bash[23528]: cluster 2024-09-21T02:05:30.189730+0000 mgr.a (mgr.14388) 9997 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:05:33.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:33 smithi179 bash[23186]: cluster 2024-09-21T02:05:32.190706+0000 mgr.a (mgr.14388) 9998 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:33 smithi044 bash[22676]: cluster 2024-09-21T02:05:32.190706+0000 mgr.a (mgr.14388) 9998 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:33 smithi049 bash[23528]: cluster 2024-09-21T02:05:32.190706+0000 mgr.a (mgr.14388) 9998 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:34.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:34.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:34.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:34 smithi044 bash[22676]: audit 2024-09-21T02:05:33.918455+0000 mon.a (mon.0) 8312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:34 smithi044 bash[22676]: audit 2024-09-21T02:05:33.923985+0000 mon.a (mon.0) 8313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:34 smithi044 bash[22676]: audit 2024-09-21T02:05:33.932226+0000 mon.a (mon.0) 8314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:34 smithi044 bash[22676]: audit 2024-09-21T02:05:34.060323+0000 mon.a (mon.0) 8315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:34 smithi044 bash[22676]: audit 2024-09-21T02:05:34.068204+0000 mon.a (mon.0) 8316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:34 smithi044 bash[22676]: audit 2024-09-21T02:05:34.078159+0000 mon.a (mon.0) 8317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:34 smithi179 bash[23186]: audit 2024-09-21T02:05:33.918455+0000 mon.a (mon.0) 8312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:34 smithi179 bash[23186]: audit 2024-09-21T02:05:33.923985+0000 mon.a (mon.0) 8313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:34 smithi179 bash[23186]: audit 2024-09-21T02:05:33.932226+0000 mon.a (mon.0) 8314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:34 smithi179 bash[23186]: audit 2024-09-21T02:05:34.060323+0000 mon.a (mon.0) 8315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:34 smithi179 bash[23186]: audit 2024-09-21T02:05:34.068204+0000 mon.a (mon.0) 8316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:34 smithi179 bash[23186]: audit 2024-09-21T02:05:34.078159+0000 mon.a (mon.0) 8317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:34 smithi049 bash[23528]: audit 2024-09-21T02:05:33.918455+0000 mon.a (mon.0) 8312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:34 smithi049 bash[23528]: audit 2024-09-21T02:05:33.923985+0000 mon.a (mon.0) 8313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:34 smithi049 bash[23528]: audit 2024-09-21T02:05:33.932226+0000 mon.a (mon.0) 8314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:34 smithi049 bash[23528]: audit 2024-09-21T02:05:34.060323+0000 mon.a (mon.0) 8315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:34 smithi049 bash[23528]: audit 2024-09-21T02:05:34.068204+0000 mon.a (mon.0) 8316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:34 smithi049 bash[23528]: audit 2024-09-21T02:05:34.078159+0000 mon.a (mon.0) 8317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:35.564 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:35.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:35.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:35.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:35.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:35 smithi044 bash[22676]: cluster 2024-09-21T02:05:34.191487+0000 mgr.a (mgr.14388) 9999 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:35 smithi179 bash[23186]: cluster 2024-09-21T02:05:34.191487+0000 mgr.a (mgr.14388) 9999 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:35 smithi049 bash[23528]: cluster 2024-09-21T02:05:34.191487+0000 mgr.a (mgr.14388) 9999 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:36 smithi044 bash[22676]: audit 2024-09-21T02:05:35.111619+0000 mgr.a (mgr.14388) 10000 : audit [DBG] from='client.221280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:36 smithi044 bash[22676]: audit 2024-09-21T02:05:36.538186+0000 mon.a (mon.0) 8318 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:05:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:36 smithi044 bash[22676]: audit 2024-09-21T02:05:36.545232+0000 mon.a (mon.0) 8319 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:05:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:36 smithi044 bash[22676]: audit 2024-09-21T02:05:36.547090+0000 mon.a (mon.0) 8320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:05:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:36 smithi044 bash[22676]: audit 2024-09-21T02:05:36.558752+0000 mon.a (mon.0) 8321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:36 smithi044 bash[22676]: audit 2024-09-21T02:05:36.565166+0000 mon.a (mon.0) 8322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:05:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:36 smithi179 bash[23186]: audit 2024-09-21T02:05:35.111619+0000 mgr.a (mgr.14388) 10000 : audit [DBG] from='client.221280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:36 smithi179 bash[23186]: audit 2024-09-21T02:05:36.538186+0000 mon.a (mon.0) 8318 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:05:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:36 smithi179 bash[23186]: audit 2024-09-21T02:05:36.545232+0000 mon.a (mon.0) 8319 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:05:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:36 smithi179 bash[23186]: audit 2024-09-21T02:05:36.547090+0000 mon.a (mon.0) 8320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:05:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:36 smithi179 bash[23186]: audit 2024-09-21T02:05:36.558752+0000 mon.a (mon.0) 8321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:36 smithi179 bash[23186]: audit 2024-09-21T02:05:36.565166+0000 mon.a (mon.0) 8322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:05:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:36 smithi049 bash[23528]: audit 2024-09-21T02:05:35.111619+0000 mgr.a (mgr.14388) 10000 : audit [DBG] from='client.221280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:36 smithi049 bash[23528]: audit 2024-09-21T02:05:36.538186+0000 mon.a (mon.0) 8318 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:05:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:36 smithi049 bash[23528]: audit 2024-09-21T02:05:36.545232+0000 mon.a (mon.0) 8319 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:05:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:36 smithi049 bash[23528]: audit 2024-09-21T02:05:36.547090+0000 mon.a (mon.0) 8320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:05:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:36 smithi049 bash[23528]: audit 2024-09-21T02:05:36.558752+0000 mon.a (mon.0) 8321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:36 smithi049 bash[23528]: audit 2024-09-21T02:05:36.565166+0000 mon.a (mon.0) 8322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:05:37.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:05:37 smithi044 bash[22930]: debug 2024-09-21T02:05:37.356+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:05:37.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:05:37 smithi044 bash[22930]: debug 2024-09-21T02:05:37.356+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:05:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:37 smithi044 bash[22676]: cluster 2024-09-21T02:05:36.194356+0000 mgr.a (mgr.14388) 10001 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:37 smithi044 bash[22676]: audit 2024-09-21T02:05:36.567934+0000 mgr.a (mgr.14388) 10002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:05:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:37 smithi179 bash[23186]: cluster 2024-09-21T02:05:36.194356+0000 mgr.a (mgr.14388) 10001 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:37 smithi179 bash[23186]: audit 2024-09-21T02:05:36.567934+0000 mgr.a (mgr.14388) 10002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:05:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:37 smithi049 bash[23528]: cluster 2024-09-21T02:05:36.194356+0000 mgr.a (mgr.14388) 10001 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:05:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:37 smithi049 bash[23528]: audit 2024-09-21T02:05:36.567934+0000 mgr.a (mgr.14388) 10002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:05:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:38 smithi044 bash[22676]: audit 2024-09-21T02:05:37.358312+0000 mgr.a (mgr.14388) 10003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:05:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:38 smithi044 bash[22676]: cephadm 2024-09-21T02:05:37.359688+0000 mgr.a (mgr.14388) 10004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:05:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:38 smithi179 bash[23186]: audit 2024-09-21T02:05:37.358312+0000 mgr.a (mgr.14388) 10003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:05:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:38 smithi179 bash[23186]: cephadm 2024-09-21T02:05:37.359688+0000 mgr.a (mgr.14388) 10004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:05:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:38 smithi049 bash[23528]: audit 2024-09-21T02:05:37.358312+0000 mgr.a (mgr.14388) 10003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:05:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:38 smithi049 bash[23528]: cephadm 2024-09-21T02:05:37.359688+0000 mgr.a (mgr.14388) 10004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:05:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:39 smithi044 bash[22676]: cluster 2024-09-21T02:05:38.195333+0000 mgr.a (mgr.14388) 10005 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:39 smithi179 bash[23186]: cluster 2024-09-21T02:05:38.195333+0000 mgr.a (mgr.14388) 10005 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:39 smithi049 bash[23528]: cluster 2024-09-21T02:05:38.195333+0000 mgr.a (mgr.14388) 10005 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:05:40.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:40.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:40.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:41.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:41 smithi044 bash[22676]: cluster 2024-09-21T02:05:40.196529+0000 mgr.a (mgr.14388) 10006 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:41 smithi044 bash[22676]: audit 2024-09-21T02:05:40.738208+0000 mon.a (mon.0) 8323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:41 smithi044 bash[22676]: audit 2024-09-21T02:05:40.747316+0000 mon.a (mon.0) 8324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:41 smithi044 bash[22676]: audit 2024-09-21T02:05:40.757314+0000 mon.a (mon.0) 8325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:41 smithi044 bash[22676]: audit 2024-09-21T02:05:40.899632+0000 mgr.a (mgr.14388) 10007 : audit [DBG] from='client.221454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:41 smithi179 bash[23186]: cluster 2024-09-21T02:05:40.196529+0000 mgr.a (mgr.14388) 10006 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:41 smithi179 bash[23186]: audit 2024-09-21T02:05:40.738208+0000 mon.a (mon.0) 8323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:41 smithi179 bash[23186]: audit 2024-09-21T02:05:40.747316+0000 mon.a (mon.0) 8324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:41 smithi179 bash[23186]: audit 2024-09-21T02:05:40.757314+0000 mon.a (mon.0) 8325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:41 smithi179 bash[23186]: audit 2024-09-21T02:05:40.899632+0000 mgr.a (mgr.14388) 10007 : audit [DBG] from='client.221454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:41 smithi049 bash[23528]: cluster 2024-09-21T02:05:40.196529+0000 mgr.a (mgr.14388) 10006 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:41 smithi049 bash[23528]: audit 2024-09-21T02:05:40.738208+0000 mon.a (mon.0) 8323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:41 smithi049 bash[23528]: audit 2024-09-21T02:05:40.747316+0000 mon.a (mon.0) 8324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:41 smithi049 bash[23528]: audit 2024-09-21T02:05:40.757314+0000 mon.a (mon.0) 8325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:41 smithi049 bash[23528]: audit 2024-09-21T02:05:40.899632+0000 mgr.a (mgr.14388) 10007 : audit [DBG] from='client.221454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:43 smithi179 bash[23186]: cluster 2024-09-21T02:05:42.197089+0000 mgr.a (mgr.14388) 10008 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:05:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:43 smithi049 bash[23528]: cluster 2024-09-21T02:05:42.197089+0000 mgr.a (mgr.14388) 10008 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:05:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:43 smithi044 bash[22676]: cluster 2024-09-21T02:05:42.197089+0000 mgr.a (mgr.14388) 10008 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:05:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:45 smithi179 bash[23186]: cluster 2024-09-21T02:05:44.197858+0000 mgr.a (mgr.14388) 10009 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:05:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:45 smithi049 bash[23528]: cluster 2024-09-21T02:05:44.197858+0000 mgr.a (mgr.14388) 10009 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:05:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:45 smithi044 bash[22676]: cluster 2024-09-21T02:05:44.197858+0000 mgr.a (mgr.14388) 10009 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:05:46.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:46.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:46.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:47.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:47 smithi179 bash[23186]: cluster 2024-09-21T02:05:46.200168+0000 mgr.a (mgr.14388) 10010 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:47 smithi179 bash[23186]: audit 2024-09-21T02:05:46.659814+0000 mgr.a (mgr.14388) 10011 : audit [DBG] from='client.221532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:48.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:47 smithi049 bash[23528]: cluster 2024-09-21T02:05:46.200168+0000 mgr.a (mgr.14388) 10010 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:48.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:47 smithi049 bash[23528]: audit 2024-09-21T02:05:46.659814+0000 mgr.a (mgr.14388) 10011 : audit [DBG] from='client.221532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:47 smithi044 bash[22676]: cluster 2024-09-21T02:05:46.200168+0000 mgr.a (mgr.14388) 10010 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:47 smithi044 bash[22676]: audit 2024-09-21T02:05:46.659814+0000 mgr.a (mgr.14388) 10011 : audit [DBG] from='client.221532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:49 smithi049 bash[23528]: cluster 2024-09-21T02:05:48.201102+0000 mgr.a (mgr.14388) 10012 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:49 smithi044 bash[22676]: cluster 2024-09-21T02:05:48.201102+0000 mgr.a (mgr.14388) 10012 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:50.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:49 smithi179 bash[23186]: cluster 2024-09-21T02:05:48.201102+0000 mgr.a (mgr.14388) 10012 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:05:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:51 smithi049 bash[23528]: cluster 2024-09-21T02:05:50.203256+0000 mgr.a (mgr.14388) 10013 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T02:05:52.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:52.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:52.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:51 smithi044 bash[22676]: cluster 2024-09-21T02:05:50.203256+0000 mgr.a (mgr.14388) 10013 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T02:05:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:51 smithi179 bash[23186]: cluster 2024-09-21T02:05:50.203256+0000 mgr.a (mgr.14388) 10013 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T02:05:52.842 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:52.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:52.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:52.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:52.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:53 smithi049 bash[23528]: cluster 2024-09-21T02:05:52.203707+0000 mgr.a (mgr.14388) 10014 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:53 smithi049 bash[23528]: audit 2024-09-21T02:05:52.406595+0000 mgr.a (mgr.14388) 10015 : audit [DBG] from='client.221610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:54.152 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:53 smithi179 bash[23186]: cluster 2024-09-21T02:05:52.203707+0000 mgr.a (mgr.14388) 10014 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:54.152 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:53 smithi179 bash[23186]: audit 2024-09-21T02:05:52.406595+0000 mgr.a (mgr.14388) 10015 : audit [DBG] from='client.221610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:53 smithi044 bash[22676]: cluster 2024-09-21T02:05:52.203707+0000 mgr.a (mgr.14388) 10014 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:53 smithi044 bash[22676]: audit 2024-09-21T02:05:52.406595+0000 mgr.a (mgr.14388) 10015 : audit [DBG] from='client.221610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:55 smithi044 bash[22676]: audit 2024-09-21T02:05:54.133099+0000 mon.a (mon.0) 8326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:55 smithi044 bash[22676]: audit 2024-09-21T02:05:54.141706+0000 mon.a (mon.0) 8327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:55 smithi044 bash[22676]: audit 2024-09-21T02:05:54.150610+0000 mon.a (mon.0) 8328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:55 smithi044 bash[22676]: cluster 2024-09-21T02:05:54.204296+0000 mgr.a (mgr.14388) 10016 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:55 smithi044 bash[22676]: audit 2024-09-21T02:05:54.250439+0000 mon.a (mon.0) 8329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:55 smithi044 bash[22676]: audit 2024-09-21T02:05:54.258887+0000 mon.a (mon.0) 8330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:55 smithi044 bash[22676]: audit 2024-09-21T02:05:54.269598+0000 mon.a (mon.0) 8331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:55 smithi179 bash[23186]: audit 2024-09-21T02:05:54.133099+0000 mon.a (mon.0) 8326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:55 smithi179 bash[23186]: audit 2024-09-21T02:05:54.141706+0000 mon.a (mon.0) 8327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:55 smithi179 bash[23186]: audit 2024-09-21T02:05:54.150610+0000 mon.a (mon.0) 8328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:55 smithi179 bash[23186]: cluster 2024-09-21T02:05:54.204296+0000 mgr.a (mgr.14388) 10016 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:55 smithi179 bash[23186]: audit 2024-09-21T02:05:54.250439+0000 mon.a (mon.0) 8329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:55 smithi179 bash[23186]: audit 2024-09-21T02:05:54.258887+0000 mon.a (mon.0) 8330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:55 smithi179 bash[23186]: audit 2024-09-21T02:05:54.269598+0000 mon.a (mon.0) 8331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:55 smithi049 bash[23528]: audit 2024-09-21T02:05:54.133099+0000 mon.a (mon.0) 8326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:55 smithi049 bash[23528]: audit 2024-09-21T02:05:54.141706+0000 mon.a (mon.0) 8327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:55 smithi049 bash[23528]: audit 2024-09-21T02:05:54.150610+0000 mon.a (mon.0) 8328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:55 smithi049 bash[23528]: cluster 2024-09-21T02:05:54.204296+0000 mgr.a (mgr.14388) 10016 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:55 smithi049 bash[23528]: audit 2024-09-21T02:05:54.250439+0000 mon.a (mon.0) 8329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:55 smithi049 bash[23528]: audit 2024-09-21T02:05:54.258887+0000 mon.a (mon.0) 8330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:55 smithi049 bash[23528]: audit 2024-09-21T02:05:54.269598+0000 mon.a (mon.0) 8331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:05:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:57 smithi049 bash[23528]: cluster 2024-09-21T02:05:56.206537+0000 mgr.a (mgr.14388) 10017 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:05:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:57 smithi044 bash[22676]: cluster 2024-09-21T02:05:56.206537+0000 mgr.a (mgr.14388) 10017 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:05:57.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:57 smithi179 bash[23186]: cluster 2024-09-21T02:05:56.206537+0000 mgr.a (mgr.14388) 10017 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:05:57.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:05:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:05:57.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:05:58.638 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:05:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:05:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:05:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:05:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:05:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:59 smithi049 bash[23528]: audit 2024-09-21T02:05:58.185495+0000 mgr.a (mgr.14388) 10018 : audit [DBG] from='client.221688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:05:59 smithi049 bash[23528]: cluster 2024-09-21T02:05:58.208065+0000 mgr.a (mgr.14388) 10019 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:59 smithi044 bash[22676]: audit 2024-09-21T02:05:58.185495+0000 mgr.a (mgr.14388) 10018 : audit [DBG] from='client.221688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:05:59 smithi044 bash[22676]: cluster 2024-09-21T02:05:58.208065+0000 mgr.a (mgr.14388) 10019 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:05:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:59 smithi179 bash[23186]: audit 2024-09-21T02:05:58.185495+0000 mgr.a (mgr.14388) 10018 : audit [DBG] from='client.221688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:05:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:05:59 smithi179 bash[23186]: cluster 2024-09-21T02:05:58.208065+0000 mgr.a (mgr.14388) 10019 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:06:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:01 smithi044 bash[22676]: cluster 2024-09-21T02:06:00.210633+0000 mgr.a (mgr.14388) 10020 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:06:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:01 smithi044 bash[22676]: audit 2024-09-21T02:06:00.975149+0000 mon.a (mon.0) 8332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:01 smithi044 bash[22676]: audit 2024-09-21T02:06:00.984221+0000 mon.a (mon.0) 8333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:01 smithi044 bash[22676]: audit 2024-09-21T02:06:00.996272+0000 mon.a (mon.0) 8334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:01 smithi179 bash[23186]: cluster 2024-09-21T02:06:00.210633+0000 mgr.a (mgr.14388) 10020 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:06:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:01 smithi179 bash[23186]: audit 2024-09-21T02:06:00.975149+0000 mon.a (mon.0) 8332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:01 smithi179 bash[23186]: audit 2024-09-21T02:06:00.984221+0000 mon.a (mon.0) 8333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:01 smithi179 bash[23186]: audit 2024-09-21T02:06:00.996272+0000 mon.a (mon.0) 8334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:01 smithi049 bash[23528]: cluster 2024-09-21T02:06:00.210633+0000 mgr.a (mgr.14388) 10020 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:06:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:01 smithi049 bash[23528]: audit 2024-09-21T02:06:00.975149+0000 mon.a (mon.0) 8332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:01 smithi049 bash[23528]: audit 2024-09-21T02:06:00.984221+0000 mon.a (mon.0) 8333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:01 smithi049 bash[23528]: audit 2024-09-21T02:06:00.996272+0000 mon.a (mon.0) 8334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:03.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:03.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:03.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:03 smithi044 bash[22676]: cluster 2024-09-21T02:06:02.211456+0000 mgr.a (mgr.14388) 10021 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:03 smithi179 bash[23186]: cluster 2024-09-21T02:06:02.211456+0000 mgr.a (mgr.14388) 10021 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:03 smithi049 bash[23528]: cluster 2024-09-21T02:06:02.211456+0000 mgr.a (mgr.14388) 10021 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:04.428 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:04.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:04.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:04.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:04.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:04 smithi179 bash[23186]: audit 2024-09-21T02:06:03.980241+0000 mgr.a (mgr.14388) 10022 : audit [DBG] from='client.221763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:04 smithi049 bash[23528]: audit 2024-09-21T02:06:03.980241+0000 mgr.a (mgr.14388) 10022 : audit [DBG] from='client.221763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:04 smithi044 bash[22676]: audit 2024-09-21T02:06:03.980241+0000 mgr.a (mgr.14388) 10022 : audit [DBG] from='client.221763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:05 smithi179 bash[23186]: cluster 2024-09-21T02:06:04.222086+0000 mgr.a (mgr.14388) 10023 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:05 smithi049 bash[23528]: cluster 2024-09-21T02:06:04.222086+0000 mgr.a (mgr.14388) 10023 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:05 smithi044 bash[22676]: cluster 2024-09-21T02:06:04.222086+0000 mgr.a (mgr.14388) 10023 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:07 smithi179 bash[23186]: cluster 2024-09-21T02:06:06.224370+0000 mgr.a (mgr.14388) 10024 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:06:08.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:07 smithi049 bash[23528]: cluster 2024-09-21T02:06:06.224370+0000 mgr.a (mgr.14388) 10024 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:06:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:07 smithi044 bash[22676]: cluster 2024-09-21T02:06:06.224370+0000 mgr.a (mgr.14388) 10024 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:06:09.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:09.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:09.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:10.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:10.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:10.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:10.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:10.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:09 smithi179 bash[23186]: cluster 2024-09-21T02:06:08.225149+0000 mgr.a (mgr.14388) 10025 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:09 smithi049 bash[23528]: cluster 2024-09-21T02:06:08.225149+0000 mgr.a (mgr.14388) 10025 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:09 smithi044 bash[22676]: cluster 2024-09-21T02:06:08.225149+0000 mgr.a (mgr.14388) 10025 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:11 smithi049 bash[23528]: audit 2024-09-21T02:06:09.760379+0000 mgr.a (mgr.14388) 10026 : audit [DBG] from='client.221841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:11 smithi044 bash[22676]: audit 2024-09-21T02:06:09.760379+0000 mgr.a (mgr.14388) 10026 : audit [DBG] from='client.221841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:11 smithi179 bash[23186]: audit 2024-09-21T02:06:09.760379+0000 mgr.a (mgr.14388) 10026 : audit [DBG] from='client.221841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:12 smithi049 bash[23528]: cluster 2024-09-21T02:06:10.226578+0000 mgr.a (mgr.14388) 10027 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:12 smithi044 bash[22676]: cluster 2024-09-21T02:06:10.226578+0000 mgr.a (mgr.14388) 10027 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:12 smithi179 bash[23186]: cluster 2024-09-21T02:06:10.226578+0000 mgr.a (mgr.14388) 10027 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:14 smithi049 bash[23528]: cluster 2024-09-21T02:06:12.227317+0000 mgr.a (mgr.14388) 10028 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:06:14.390 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:14 smithi179 bash[23186]: cluster 2024-09-21T02:06:12.227317+0000 mgr.a (mgr.14388) 10028 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:06:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:14 smithi044 bash[22676]: cluster 2024-09-21T02:06:12.227317+0000 mgr.a (mgr.14388) 10028 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:06:15.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:15.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:15 smithi044 bash[22676]: cluster 2024-09-21T02:06:14.228088+0000 mgr.a (mgr.14388) 10029 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:06:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:15 smithi044 bash[22676]: audit 2024-09-21T02:06:14.371408+0000 mon.a (mon.0) 8335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:15 smithi044 bash[22676]: audit 2024-09-21T02:06:14.378617+0000 mon.a (mon.0) 8336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:15 smithi044 bash[22676]: audit 2024-09-21T02:06:14.389149+0000 mon.a (mon.0) 8337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:15 smithi044 bash[22676]: audit 2024-09-21T02:06:14.492322+0000 mon.a (mon.0) 8338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:15 smithi044 bash[22676]: audit 2024-09-21T02:06:14.497366+0000 mon.a (mon.0) 8339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:15 smithi044 bash[22676]: audit 2024-09-21T02:06:14.504994+0000 mon.a (mon.0) 8340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:15 smithi179 bash[23186]: cluster 2024-09-21T02:06:14.228088+0000 mgr.a (mgr.14388) 10029 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:06:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:15 smithi179 bash[23186]: audit 2024-09-21T02:06:14.371408+0000 mon.a (mon.0) 8335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:15 smithi179 bash[23186]: audit 2024-09-21T02:06:14.378617+0000 mon.a (mon.0) 8336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:15 smithi179 bash[23186]: audit 2024-09-21T02:06:14.389149+0000 mon.a (mon.0) 8337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:15 smithi179 bash[23186]: audit 2024-09-21T02:06:14.492322+0000 mon.a (mon.0) 8338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:15 smithi179 bash[23186]: audit 2024-09-21T02:06:14.497366+0000 mon.a (mon.0) 8339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:15 smithi179 bash[23186]: audit 2024-09-21T02:06:14.504994+0000 mon.a (mon.0) 8340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:15 smithi049 bash[23528]: cluster 2024-09-21T02:06:14.228088+0000 mgr.a (mgr.14388) 10029 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:06:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:15 smithi049 bash[23528]: audit 2024-09-21T02:06:14.371408+0000 mon.a (mon.0) 8335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:15 smithi049 bash[23528]: audit 2024-09-21T02:06:14.378617+0000 mon.a (mon.0) 8336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:15 smithi049 bash[23528]: audit 2024-09-21T02:06:14.389149+0000 mon.a (mon.0) 8337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:15 smithi049 bash[23528]: audit 2024-09-21T02:06:14.492322+0000 mon.a (mon.0) 8338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:15 smithi049 bash[23528]: audit 2024-09-21T02:06:14.497366+0000 mon.a (mon.0) 8339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:15 smithi049 bash[23528]: audit 2024-09-21T02:06:14.504994+0000 mon.a (mon.0) 8340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:15.969 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:16 smithi044 bash[22676]: audit 2024-09-21T02:06:15.515139+0000 mgr.a (mgr.14388) 10030 : audit [DBG] from='client.221916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:16 smithi179 bash[23186]: audit 2024-09-21T02:06:15.515139+0000 mgr.a (mgr.14388) 10030 : audit [DBG] from='client.221916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:16 smithi049 bash[23528]: audit 2024-09-21T02:06:15.515139+0000 mgr.a (mgr.14388) 10030 : audit [DBG] from='client.221916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:17 smithi044 bash[22676]: cluster 2024-09-21T02:06:16.231046+0000 mgr.a (mgr.14388) 10031 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:17 smithi179 bash[23186]: cluster 2024-09-21T02:06:16.231046+0000 mgr.a (mgr.14388) 10031 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:17 smithi049 bash[23528]: cluster 2024-09-21T02:06:16.231046+0000 mgr.a (mgr.14388) 10031 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:06:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:19 smithi044 bash[22676]: cluster 2024-09-21T02:06:18.231844+0000 mgr.a (mgr.14388) 10032 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:06:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:19 smithi179 bash[23186]: cluster 2024-09-21T02:06:18.231844+0000 mgr.a (mgr.14388) 10032 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:06:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:19 smithi049 bash[23528]: cluster 2024-09-21T02:06:18.231844+0000 mgr.a (mgr.14388) 10032 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:06:20.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:20.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:21 smithi049 bash[23528]: cluster 2024-09-21T02:06:20.233799+0000 mgr.a (mgr.14388) 10033 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:21 smithi049 bash[23528]: audit 2024-09-21T02:06:21.189355+0000 mon.a (mon.0) 8341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:21 smithi049 bash[23528]: audit 2024-09-21T02:06:21.195439+0000 mon.a (mon.0) 8342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:21 smithi049 bash[23528]: audit 2024-09-21T02:06:21.202484+0000 mon.a (mon.0) 8343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:21.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:21.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:21.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:21.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:21 smithi044 bash[22676]: cluster 2024-09-21T02:06:20.233799+0000 mgr.a (mgr.14388) 10033 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:21 smithi044 bash[22676]: audit 2024-09-21T02:06:21.189355+0000 mon.a (mon.0) 8341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:21 smithi044 bash[22676]: audit 2024-09-21T02:06:21.195439+0000 mon.a (mon.0) 8342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:21 smithi044 bash[22676]: audit 2024-09-21T02:06:21.202484+0000 mon.a (mon.0) 8343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:21 smithi179 bash[23186]: cluster 2024-09-21T02:06:20.233799+0000 mgr.a (mgr.14388) 10033 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:21 smithi179 bash[23186]: audit 2024-09-21T02:06:21.189355+0000 mon.a (mon.0) 8341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:21 smithi179 bash[23186]: audit 2024-09-21T02:06:21.195439+0000 mon.a (mon.0) 8342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:21 smithi179 bash[23186]: audit 2024-09-21T02:06:21.202484+0000 mon.a (mon.0) 8343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:22 smithi044 bash[22676]: audit 2024-09-21T02:06:21.313005+0000 mgr.a (mgr.14388) 10034 : audit [DBG] from='client.221991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:22 smithi179 bash[23186]: audit 2024-09-21T02:06:21.313005+0000 mgr.a (mgr.14388) 10034 : audit [DBG] from='client.221991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:22 smithi049 bash[23528]: audit 2024-09-21T02:06:21.313005+0000 mgr.a (mgr.14388) 10034 : audit [DBG] from='client.221991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:23 smithi044 bash[22676]: cluster 2024-09-21T02:06:22.234362+0000 mgr.a (mgr.14388) 10035 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:06:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:23 smithi179 bash[23186]: cluster 2024-09-21T02:06:22.234362+0000 mgr.a (mgr.14388) 10035 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:06:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:23 smithi049 bash[23528]: cluster 2024-09-21T02:06:22.234362+0000 mgr.a (mgr.14388) 10035 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:06:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:25 smithi044 bash[22676]: cluster 2024-09-21T02:06:24.235263+0000 mgr.a (mgr.14388) 10036 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:06:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:25 smithi179 bash[23186]: cluster 2024-09-21T02:06:24.235263+0000 mgr.a (mgr.14388) 10036 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:06:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:25 smithi049 bash[23528]: cluster 2024-09-21T02:06:24.235263+0000 mgr.a (mgr.14388) 10036 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:06:26.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:26.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:26.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:27.479 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:27 smithi044 bash[22676]: cluster 2024-09-21T02:06:26.237681+0000 mgr.a (mgr.14388) 10037 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:06:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:27 smithi044 bash[22676]: audit 2024-09-21T02:06:27.065765+0000 mgr.a (mgr.14388) 10038 : audit [DBG] from='client.222066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:27 smithi179 bash[23186]: cluster 2024-09-21T02:06:26.237681+0000 mgr.a (mgr.14388) 10037 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:06:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:27 smithi179 bash[23186]: audit 2024-09-21T02:06:27.065765+0000 mgr.a (mgr.14388) 10038 : audit [DBG] from='client.222066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:27 smithi049 bash[23528]: cluster 2024-09-21T02:06:26.237681+0000 mgr.a (mgr.14388) 10037 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:06:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:27 smithi049 bash[23528]: audit 2024-09-21T02:06:27.065765+0000 mgr.a (mgr.14388) 10038 : audit [DBG] from='client.222066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:29.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:29 smithi179 bash[23186]: cluster 2024-09-21T02:06:28.238618+0000 mgr.a (mgr.14388) 10039 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:29 smithi044 bash[22676]: cluster 2024-09-21T02:06:28.238618+0000 mgr.a (mgr.14388) 10039 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:29 smithi049 bash[23528]: cluster 2024-09-21T02:06:28.238618+0000 mgr.a (mgr.14388) 10039 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:31 smithi044 bash[22676]: cluster 2024-09-21T02:06:30.240734+0000 mgr.a (mgr.14388) 10040 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:06:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:31 smithi179 bash[23186]: cluster 2024-09-21T02:06:30.240734+0000 mgr.a (mgr.14388) 10040 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:06:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:31 smithi049 bash[23528]: cluster 2024-09-21T02:06:30.240734+0000 mgr.a (mgr.14388) 10040 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:06:32.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:32.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:32.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:33.267 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:33.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:33.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:33.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:33.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:33 smithi044 bash[22676]: cluster 2024-09-21T02:06:32.241531+0000 mgr.a (mgr.14388) 10041 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:33 smithi044 bash[22676]: audit 2024-09-21T02:06:32.824127+0000 mgr.a (mgr.14388) 10042 : audit [DBG] from='client.222144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:33 smithi179 bash[23186]: cluster 2024-09-21T02:06:32.241531+0000 mgr.a (mgr.14388) 10041 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:33 smithi179 bash[23186]: audit 2024-09-21T02:06:32.824127+0000 mgr.a (mgr.14388) 10042 : audit [DBG] from='client.222144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:33 smithi049 bash[23528]: cluster 2024-09-21T02:06:32.241531+0000 mgr.a (mgr.14388) 10041 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:33 smithi049 bash[23528]: audit 2024-09-21T02:06:32.824127+0000 mgr.a (mgr.14388) 10042 : audit [DBG] from='client.222144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:35 smithi044 bash[22676]: cluster 2024-09-21T02:06:34.242428+0000 mgr.a (mgr.14388) 10043 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:35 smithi044 bash[22676]: audit 2024-09-21T02:06:34.572451+0000 mon.a (mon.0) 8344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:35 smithi044 bash[22676]: audit 2024-09-21T02:06:34.580404+0000 mon.a (mon.0) 8345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:35 smithi044 bash[22676]: audit 2024-09-21T02:06:34.589087+0000 mon.a (mon.0) 8346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:35 smithi044 bash[22676]: audit 2024-09-21T02:06:34.728298+0000 mon.a (mon.0) 8347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:35 smithi044 bash[22676]: audit 2024-09-21T02:06:34.736674+0000 mon.a (mon.0) 8348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:35 smithi044 bash[22676]: audit 2024-09-21T02:06:34.746708+0000 mon.a (mon.0) 8349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:35 smithi179 bash[23186]: cluster 2024-09-21T02:06:34.242428+0000 mgr.a (mgr.14388) 10043 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:35 smithi179 bash[23186]: audit 2024-09-21T02:06:34.572451+0000 mon.a (mon.0) 8344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:35 smithi179 bash[23186]: audit 2024-09-21T02:06:34.580404+0000 mon.a (mon.0) 8345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:35 smithi179 bash[23186]: audit 2024-09-21T02:06:34.589087+0000 mon.a (mon.0) 8346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:35 smithi179 bash[23186]: audit 2024-09-21T02:06:34.728298+0000 mon.a (mon.0) 8347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:35 smithi179 bash[23186]: audit 2024-09-21T02:06:34.736674+0000 mon.a (mon.0) 8348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:35 smithi179 bash[23186]: audit 2024-09-21T02:06:34.746708+0000 mon.a (mon.0) 8349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:35 smithi049 bash[23528]: cluster 2024-09-21T02:06:34.242428+0000 mgr.a (mgr.14388) 10043 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:35 smithi049 bash[23528]: audit 2024-09-21T02:06:34.572451+0000 mon.a (mon.0) 8344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:35 smithi049 bash[23528]: audit 2024-09-21T02:06:34.580404+0000 mon.a (mon.0) 8345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:35 smithi049 bash[23528]: audit 2024-09-21T02:06:34.589087+0000 mon.a (mon.0) 8346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:35 smithi049 bash[23528]: audit 2024-09-21T02:06:34.728298+0000 mon.a (mon.0) 8347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:35 smithi049 bash[23528]: audit 2024-09-21T02:06:34.736674+0000 mon.a (mon.0) 8348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:35 smithi049 bash[23528]: audit 2024-09-21T02:06:34.746708+0000 mon.a (mon.0) 8349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:37 smithi044 bash[22676]: cluster 2024-09-21T02:06:36.244627+0000 mgr.a (mgr.14388) 10044 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:06:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:37 smithi044 bash[22676]: audit 2024-09-21T02:06:37.411697+0000 mon.a (mon.0) 8350 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:06:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:37 smithi044 bash[22676]: audit 2024-09-21T02:06:37.419379+0000 mon.a (mon.0) 8351 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:06:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:37 smithi044 bash[22676]: audit 2024-09-21T02:06:37.421370+0000 mon.a (mon.0) 8352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:06:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:37 smithi044 bash[22676]: audit 2024-09-21T02:06:37.432863+0000 mon.a (mon.0) 8353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:37 smithi044 bash[22676]: audit 2024-09-21T02:06:37.439874+0000 mon.a (mon.0) 8354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:06:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:37 smithi179 bash[23186]: cluster 2024-09-21T02:06:36.244627+0000 mgr.a (mgr.14388) 10044 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:06:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:37 smithi179 bash[23186]: audit 2024-09-21T02:06:37.411697+0000 mon.a (mon.0) 8350 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:06:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:37 smithi179 bash[23186]: audit 2024-09-21T02:06:37.419379+0000 mon.a (mon.0) 8351 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:06:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:37 smithi179 bash[23186]: audit 2024-09-21T02:06:37.421370+0000 mon.a (mon.0) 8352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:06:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:37 smithi179 bash[23186]: audit 2024-09-21T02:06:37.432863+0000 mon.a (mon.0) 8353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:37 smithi179 bash[23186]: audit 2024-09-21T02:06:37.439874+0000 mon.a (mon.0) 8354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:06:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:37 smithi049 bash[23528]: cluster 2024-09-21T02:06:36.244627+0000 mgr.a (mgr.14388) 10044 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:06:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:37 smithi049 bash[23528]: audit 2024-09-21T02:06:37.411697+0000 mon.a (mon.0) 8350 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:06:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:37 smithi049 bash[23528]: audit 2024-09-21T02:06:37.419379+0000 mon.a (mon.0) 8351 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:06:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:37 smithi049 bash[23528]: audit 2024-09-21T02:06:37.421370+0000 mon.a (mon.0) 8352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:06:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:37 smithi049 bash[23528]: audit 2024-09-21T02:06:37.432863+0000 mon.a (mon.0) 8353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:37 smithi049 bash[23528]: audit 2024-09-21T02:06:37.439874+0000 mon.a (mon.0) 8354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:06:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:38.269 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:38.269 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:38.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:06:38 smithi044 bash[22930]: debug 2024-09-21T02:06:38.203+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:06:38.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:06:38 smithi044 bash[22930]: debug 2024-09-21T02:06:38.203+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:06:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:38 smithi044 bash[22676]: audit 2024-09-21T02:06:37.442257+0000 mgr.a (mgr.14388) 10045 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:06:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:38 smithi179 bash[23186]: audit 2024-09-21T02:06:37.442257+0000 mgr.a (mgr.14388) 10045 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:06:39.028 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:39.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:39.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:38 smithi049 bash[23528]: audit 2024-09-21T02:06:37.442257+0000 mgr.a (mgr.14388) 10045 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:06:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:39 smithi044 bash[22676]: audit 2024-09-21T02:06:38.205801+0000 mgr.a (mgr.14388) 10046 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:06:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:39 smithi044 bash[22676]: cephadm 2024-09-21T02:06:38.207044+0000 mgr.a (mgr.14388) 10047 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:06:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:39 smithi044 bash[22676]: cluster 2024-09-21T02:06:38.245484+0000 mgr.a (mgr.14388) 10048 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:39 smithi044 bash[22676]: audit 2024-09-21T02:06:38.591315+0000 mgr.a (mgr.14388) 10049 : audit [DBG] from='client.222330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:39 smithi179 bash[23186]: audit 2024-09-21T02:06:38.205801+0000 mgr.a (mgr.14388) 10046 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:06:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:39 smithi179 bash[23186]: cephadm 2024-09-21T02:06:38.207044+0000 mgr.a (mgr.14388) 10047 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:06:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:39 smithi179 bash[23186]: cluster 2024-09-21T02:06:38.245484+0000 mgr.a (mgr.14388) 10048 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:39 smithi179 bash[23186]: audit 2024-09-21T02:06:38.591315+0000 mgr.a (mgr.14388) 10049 : audit [DBG] from='client.222330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:39 smithi049 bash[23528]: audit 2024-09-21T02:06:38.205801+0000 mgr.a (mgr.14388) 10046 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:39 smithi049 bash[23528]: cephadm 2024-09-21T02:06:38.207044+0000 mgr.a (mgr.14388) 10047 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:39 smithi049 bash[23528]: cluster 2024-09-21T02:06:38.245484+0000 mgr.a (mgr.14388) 10048 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:39 smithi049 bash[23528]: audit 2024-09-21T02:06:38.591315+0000 mgr.a (mgr.14388) 10049 : audit [DBG] from='client.222330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:41 smithi044 bash[22676]: cluster 2024-09-21T02:06:40.247883+0000 mgr.a (mgr.14388) 10050 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:41 smithi044 bash[22676]: audit 2024-09-21T02:06:41.400259+0000 mon.a (mon.0) 8355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:41 smithi044 bash[22676]: audit 2024-09-21T02:06:41.406380+0000 mon.a (mon.0) 8356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:41 smithi044 bash[22676]: audit 2024-09-21T02:06:41.415941+0000 mon.a (mon.0) 8357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:41 smithi049 bash[23528]: cluster 2024-09-21T02:06:40.247883+0000 mgr.a (mgr.14388) 10050 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:41 smithi049 bash[23528]: audit 2024-09-21T02:06:41.400259+0000 mon.a (mon.0) 8355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:41 smithi049 bash[23528]: audit 2024-09-21T02:06:41.406380+0000 mon.a (mon.0) 8356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:41 smithi049 bash[23528]: audit 2024-09-21T02:06:41.415941+0000 mon.a (mon.0) 8357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:41 smithi179 bash[23186]: cluster 2024-09-21T02:06:40.247883+0000 mgr.a (mgr.14388) 10050 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:41 smithi179 bash[23186]: audit 2024-09-21T02:06:41.400259+0000 mon.a (mon.0) 8355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:41 smithi179 bash[23186]: audit 2024-09-21T02:06:41.406380+0000 mon.a (mon.0) 8356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:41 smithi179 bash[23186]: audit 2024-09-21T02:06:41.415941+0000 mon.a (mon.0) 8357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:43 smithi044 bash[22676]: cluster 2024-09-21T02:06:42.248720+0000 mgr.a (mgr.14388) 10051 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:43 smithi179 bash[23186]: cluster 2024-09-21T02:06:42.248720+0000 mgr.a (mgr.14388) 10051 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:44.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:44.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:44.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:43 smithi049 bash[23528]: cluster 2024-09-21T02:06:42.248720+0000 mgr.a (mgr.14388) 10051 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:44.809 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:45 smithi049 bash[23528]: cluster 2024-09-21T02:06:44.249497+0000 mgr.a (mgr.14388) 10052 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:45 smithi049 bash[23528]: audit 2024-09-21T02:06:44.365319+0000 mgr.a (mgr.14388) 10053 : audit [DBG] from='client.222408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:45 smithi044 bash[22676]: cluster 2024-09-21T02:06:44.249497+0000 mgr.a (mgr.14388) 10052 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:45 smithi044 bash[22676]: audit 2024-09-21T02:06:44.365319+0000 mgr.a (mgr.14388) 10053 : audit [DBG] from='client.222408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:45 smithi179 bash[23186]: cluster 2024-09-21T02:06:44.249497+0000 mgr.a (mgr.14388) 10052 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:45 smithi179 bash[23186]: audit 2024-09-21T02:06:44.365319+0000 mgr.a (mgr.14388) 10053 : audit [DBG] from='client.222408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:47.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:47 smithi179 bash[23186]: cluster 2024-09-21T02:06:46.251759+0000 mgr.a (mgr.14388) 10054 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:47 smithi044 bash[22676]: cluster 2024-09-21T02:06:46.251759+0000 mgr.a (mgr.14388) 10054 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:47 smithi049 bash[23528]: cluster 2024-09-21T02:06:46.251759+0000 mgr.a (mgr.14388) 10054 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:49.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:49.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:49.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:49.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:49 smithi179 bash[23186]: cluster 2024-09-21T02:06:48.252531+0000 mgr.a (mgr.14388) 10055 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:49 smithi044 bash[22676]: cluster 2024-09-21T02:06:48.252531+0000 mgr.a (mgr.14388) 10055 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:49 smithi049 bash[23528]: cluster 2024-09-21T02:06:48.252531+0000 mgr.a (mgr.14388) 10055 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:50.596 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:50.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:51 smithi044 bash[22676]: audit 2024-09-21T02:06:50.151444+0000 mgr.a (mgr.14388) 10056 : audit [DBG] from='client.222483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:51 smithi044 bash[22676]: cluster 2024-09-21T02:06:50.253992+0000 mgr.a (mgr.14388) 10057 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:51 smithi179 bash[23186]: audit 2024-09-21T02:06:50.151444+0000 mgr.a (mgr.14388) 10056 : audit [DBG] from='client.222483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:51 smithi179 bash[23186]: cluster 2024-09-21T02:06:50.253992+0000 mgr.a (mgr.14388) 10057 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:51 smithi049 bash[23528]: audit 2024-09-21T02:06:50.151444+0000 mgr.a (mgr.14388) 10056 : audit [DBG] from='client.222483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:51 smithi049 bash[23528]: cluster 2024-09-21T02:06:50.253992+0000 mgr.a (mgr.14388) 10057 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:06:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:53 smithi044 bash[22676]: cluster 2024-09-21T02:06:52.254841+0000 mgr.a (mgr.14388) 10058 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:06:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:53 smithi179 bash[23186]: cluster 2024-09-21T02:06:52.254841+0000 mgr.a (mgr.14388) 10058 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:06:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:53 smithi049 bash[23528]: cluster 2024-09-21T02:06:52.254841+0000 mgr.a (mgr.14388) 10058 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:06:55.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:06:55.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:06:55.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:06:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:55 smithi049 bash[23528]: cluster 2024-09-21T02:06:54.255618+0000 mgr.a (mgr.14388) 10059 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:06:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:55 smithi049 bash[23528]: audit 2024-09-21T02:06:54.798599+0000 mon.a (mon.0) 8358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:55 smithi049 bash[23528]: audit 2024-09-21T02:06:54.806218+0000 mon.a (mon.0) 8359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:55 smithi049 bash[23528]: audit 2024-09-21T02:06:54.815010+0000 mon.a (mon.0) 8360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:55 smithi049 bash[23528]: audit 2024-09-21T02:06:54.975128+0000 mon.a (mon.0) 8361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:55 smithi049 bash[23528]: audit 2024-09-21T02:06:54.983906+0000 mon.a (mon.0) 8362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:55 smithi049 bash[23528]: audit 2024-09-21T02:06:54.994754+0000 mon.a (mon.0) 8363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:55 smithi044 bash[22676]: cluster 2024-09-21T02:06:54.255618+0000 mgr.a (mgr.14388) 10059 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:55 smithi044 bash[22676]: audit 2024-09-21T02:06:54.798599+0000 mon.a (mon.0) 8358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:55 smithi044 bash[22676]: audit 2024-09-21T02:06:54.806218+0000 mon.a (mon.0) 8359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:55 smithi044 bash[22676]: audit 2024-09-21T02:06:54.815010+0000 mon.a (mon.0) 8360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:55 smithi044 bash[22676]: audit 2024-09-21T02:06:54.975128+0000 mon.a (mon.0) 8361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:55 smithi044 bash[22676]: audit 2024-09-21T02:06:54.983906+0000 mon.a (mon.0) 8362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:55 smithi044 bash[22676]: audit 2024-09-21T02:06:54.994754+0000 mon.a (mon.0) 8363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:55 smithi179 bash[23186]: cluster 2024-09-21T02:06:54.255618+0000 mgr.a (mgr.14388) 10059 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:06:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:55 smithi179 bash[23186]: audit 2024-09-21T02:06:54.798599+0000 mon.a (mon.0) 8358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:55 smithi179 bash[23186]: audit 2024-09-21T02:06:54.806218+0000 mon.a (mon.0) 8359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:55 smithi179 bash[23186]: audit 2024-09-21T02:06:54.815010+0000 mon.a (mon.0) 8360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:55 smithi179 bash[23186]: audit 2024-09-21T02:06:54.975128+0000 mon.a (mon.0) 8361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:55 smithi179 bash[23186]: audit 2024-09-21T02:06:54.983906+0000 mon.a (mon.0) 8362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:55 smithi179 bash[23186]: audit 2024-09-21T02:06:54.994754+0000 mon.a (mon.0) 8363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:06:56.395 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:06:56.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:06:56.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:06:56.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:06:56.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:06:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:56 smithi044 bash[22676]: audit 2024-09-21T02:06:55.943482+0000 mgr.a (mgr.14388) 10060 : audit [DBG] from='client.222561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:56 smithi179 bash[23186]: audit 2024-09-21T02:06:55.943482+0000 mgr.a (mgr.14388) 10060 : audit [DBG] from='client.222561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:56 smithi049 bash[23528]: audit 2024-09-21T02:06:55.943482+0000 mgr.a (mgr.14388) 10060 : audit [DBG] from='client.222561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:06:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:57 smithi044 bash[22676]: cluster 2024-09-21T02:06:56.257163+0000 mgr.a (mgr.14388) 10061 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:57 smithi179 bash[23186]: cluster 2024-09-21T02:06:56.257163+0000 mgr.a (mgr.14388) 10061 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:06:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:57 smithi049 bash[23528]: cluster 2024-09-21T02:06:56.257163+0000 mgr.a (mgr.14388) 10061 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:06:59 smithi044 bash[22676]: cluster 2024-09-21T02:06:58.257952+0000 mgr.a (mgr.14388) 10062 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:07:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:06:59 smithi179 bash[23186]: cluster 2024-09-21T02:06:58.257952+0000 mgr.a (mgr.14388) 10062 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:07:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:06:59 smithi049 bash[23528]: cluster 2024-09-21T02:06:58.257952+0000 mgr.a (mgr.14388) 10062 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:07:01.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:01.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:01.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:01 smithi049 bash[23528]: cluster 2024-09-21T02:07:00.260101+0000 mgr.a (mgr.14388) 10063 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:01 smithi049 bash[23528]: audit 2024-09-21T02:07:01.633881+0000 mon.a (mon.0) 8364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:01 smithi049 bash[23528]: audit 2024-09-21T02:07:01.641600+0000 mon.a (mon.0) 8365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:01 smithi049 bash[23528]: audit 2024-09-21T02:07:01.651414+0000 mon.a (mon.0) 8366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.190 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:02.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:02.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:02.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:02.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:01 smithi044 bash[22676]: cluster 2024-09-21T02:07:00.260101+0000 mgr.a (mgr.14388) 10063 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:01 smithi044 bash[22676]: audit 2024-09-21T02:07:01.633881+0000 mon.a (mon.0) 8364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:01 smithi044 bash[22676]: audit 2024-09-21T02:07:01.641600+0000 mon.a (mon.0) 8365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:01 smithi044 bash[22676]: audit 2024-09-21T02:07:01.651414+0000 mon.a (mon.0) 8366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:01 smithi179 bash[23186]: cluster 2024-09-21T02:07:00.260101+0000 mgr.a (mgr.14388) 10063 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:01 smithi179 bash[23186]: audit 2024-09-21T02:07:01.633881+0000 mon.a (mon.0) 8364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:01 smithi179 bash[23186]: audit 2024-09-21T02:07:01.641600+0000 mon.a (mon.0) 8365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:01 smithi179 bash[23186]: audit 2024-09-21T02:07:01.651414+0000 mon.a (mon.0) 8366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:02 smithi044 bash[22676]: audit 2024-09-21T02:07:01.741113+0000 mgr.a (mgr.14388) 10064 : audit [DBG] from='client.222639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:02 smithi179 bash[23186]: audit 2024-09-21T02:07:01.741113+0000 mgr.a (mgr.14388) 10064 : audit [DBG] from='client.222639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:02 smithi049 bash[23528]: audit 2024-09-21T02:07:01.741113+0000 mgr.a (mgr.14388) 10064 : audit [DBG] from='client.222639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:03 smithi044 bash[22676]: cluster 2024-09-21T02:07:02.260768+0000 mgr.a (mgr.14388) 10065 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:03 smithi179 bash[23186]: cluster 2024-09-21T02:07:02.260768+0000 mgr.a (mgr.14388) 10065 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:03 smithi049 bash[23528]: cluster 2024-09-21T02:07:02.260768+0000 mgr.a (mgr.14388) 10065 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:05 smithi044 bash[22676]: cluster 2024-09-21T02:07:04.261784+0000 mgr.a (mgr.14388) 10066 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:05 smithi179 bash[23186]: cluster 2024-09-21T02:07:04.261784+0000 mgr.a (mgr.14388) 10066 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:05 smithi049 bash[23528]: cluster 2024-09-21T02:07:04.261784+0000 mgr.a (mgr.14388) 10066 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:07.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:07.194 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:07.195 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:07.975 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:07.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:07.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:07.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:07.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:07 smithi179 bash[23186]: cluster 2024-09-21T02:07:06.264181+0000 mgr.a (mgr.14388) 10067 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:07 smithi049 bash[23528]: cluster 2024-09-21T02:07:06.264181+0000 mgr.a (mgr.14388) 10067 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:07 smithi044 bash[22676]: cluster 2024-09-21T02:07:06.264181+0000 mgr.a (mgr.14388) 10067 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:08 smithi049 bash[23528]: audit 2024-09-21T02:07:07.526984+0000 mgr.a (mgr.14388) 10068 : audit [DBG] from='client.222714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:08 smithi044 bash[22676]: audit 2024-09-21T02:07:07.526984+0000 mgr.a (mgr.14388) 10068 : audit [DBG] from='client.222714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:08 smithi179 bash[23186]: audit 2024-09-21T02:07:07.526984+0000 mgr.a (mgr.14388) 10068 : audit [DBG] from='client.222714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:10.115 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:09 smithi179 bash[23186]: cluster 2024-09-21T02:07:08.265138+0000 mgr.a (mgr.14388) 10069 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:09 smithi044 bash[22676]: cluster 2024-09-21T02:07:08.265138+0000 mgr.a (mgr.14388) 10069 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:09 smithi049 bash[23528]: cluster 2024-09-21T02:07:08.265138+0000 mgr.a (mgr.14388) 10069 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:11 smithi044 bash[22676]: cluster 2024-09-21T02:07:10.267265+0000 mgr.a (mgr.14388) 10070 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:11 smithi179 bash[23186]: cluster 2024-09-21T02:07:10.267265+0000 mgr.a (mgr.14388) 10070 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:11 smithi049 bash[23528]: cluster 2024-09-21T02:07:10.267265+0000 mgr.a (mgr.14388) 10070 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:12.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:12.978 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:12.978 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:13.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:13.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:13 smithi044 bash[22676]: cluster 2024-09-21T02:07:12.268023+0000 mgr.a (mgr.14388) 10071 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:13 smithi179 bash[23186]: cluster 2024-09-21T02:07:12.268023+0000 mgr.a (mgr.14388) 10071 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:13 smithi049 bash[23528]: cluster 2024-09-21T02:07:12.268023+0000 mgr.a (mgr.14388) 10071 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:14 smithi044 bash[22676]: audit 2024-09-21T02:07:13.314499+0000 mgr.a (mgr.14388) 10072 : audit [DBG] from='client.222789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:14 smithi179 bash[23186]: audit 2024-09-21T02:07:13.314499+0000 mgr.a (mgr.14388) 10072 : audit [DBG] from='client.222789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:14 smithi049 bash[23528]: audit 2024-09-21T02:07:13.314499+0000 mgr.a (mgr.14388) 10072 : audit [DBG] from='client.222789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:16 smithi049 bash[23528]: cluster 2024-09-21T02:07:14.269075+0000 mgr.a (mgr.14388) 10073 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:16 smithi049 bash[23528]: audit 2024-09-21T02:07:15.024759+0000 mon.a (mon.0) 8367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:16 smithi049 bash[23528]: audit 2024-09-21T02:07:15.032742+0000 mon.a (mon.0) 8368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:16 smithi049 bash[23528]: audit 2024-09-21T02:07:15.039951+0000 mon.a (mon.0) 8369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:16 smithi049 bash[23528]: audit 2024-09-21T02:07:15.218310+0000 mon.a (mon.0) 8370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:16 smithi049 bash[23528]: audit 2024-09-21T02:07:15.227269+0000 mon.a (mon.0) 8371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:16 smithi049 bash[23528]: audit 2024-09-21T02:07:15.237825+0000 mon.a (mon.0) 8372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:16 smithi044 bash[22676]: cluster 2024-09-21T02:07:14.269075+0000 mgr.a (mgr.14388) 10073 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:16 smithi044 bash[22676]: audit 2024-09-21T02:07:15.024759+0000 mon.a (mon.0) 8367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:16 smithi044 bash[22676]: audit 2024-09-21T02:07:15.032742+0000 mon.a (mon.0) 8368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:16 smithi044 bash[22676]: audit 2024-09-21T02:07:15.039951+0000 mon.a (mon.0) 8369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:16 smithi044 bash[22676]: audit 2024-09-21T02:07:15.218310+0000 mon.a (mon.0) 8370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:16 smithi044 bash[22676]: audit 2024-09-21T02:07:15.227269+0000 mon.a (mon.0) 8371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:16 smithi044 bash[22676]: audit 2024-09-21T02:07:15.237825+0000 mon.a (mon.0) 8372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:16 smithi179 bash[23186]: cluster 2024-09-21T02:07:14.269075+0000 mgr.a (mgr.14388) 10073 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:16 smithi179 bash[23186]: audit 2024-09-21T02:07:15.024759+0000 mon.a (mon.0) 8367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:16 smithi179 bash[23186]: audit 2024-09-21T02:07:15.032742+0000 mon.a (mon.0) 8368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:16 smithi179 bash[23186]: audit 2024-09-21T02:07:15.039951+0000 mon.a (mon.0) 8369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:16 smithi179 bash[23186]: audit 2024-09-21T02:07:15.218310+0000 mon.a (mon.0) 8370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:16 smithi179 bash[23186]: audit 2024-09-21T02:07:15.227269+0000 mon.a (mon.0) 8371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:16 smithi179 bash[23186]: audit 2024-09-21T02:07:15.237825+0000 mon.a (mon.0) 8372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:18 smithi049 bash[23528]: cluster 2024-09-21T02:07:16.271345+0000 mgr.a (mgr.14388) 10074 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:18 smithi044 bash[22676]: cluster 2024-09-21T02:07:16.271345+0000 mgr.a (mgr.14388) 10074 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:18 smithi179 bash[23186]: cluster 2024-09-21T02:07:16.271345+0000 mgr.a (mgr.14388) 10074 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:18.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:18.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:19.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:19.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:19.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:19.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:20 smithi049 bash[23528]: cluster 2024-09-21T02:07:18.272131+0000 mgr.a (mgr.14388) 10075 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:20 smithi044 bash[22676]: cluster 2024-09-21T02:07:18.272131+0000 mgr.a (mgr.14388) 10075 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:20 smithi179 bash[23186]: cluster 2024-09-21T02:07:18.272131+0000 mgr.a (mgr.14388) 10075 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:21 smithi049 bash[23528]: audit 2024-09-21T02:07:19.106747+0000 mgr.a (mgr.14388) 10076 : audit [DBG] from='client.222864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:21.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:21 smithi044 bash[22676]: audit 2024-09-21T02:07:19.106747+0000 mgr.a (mgr.14388) 10076 : audit [DBG] from='client.222864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:21 smithi179 bash[23186]: audit 2024-09-21T02:07:19.106747+0000 mgr.a (mgr.14388) 10076 : audit [DBG] from='client.222864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:22 smithi179 bash[23186]: cluster 2024-09-21T02:07:20.274449+0000 mgr.a (mgr.14388) 10077 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:22 smithi179 bash[23186]: audit 2024-09-21T02:07:21.867007+0000 mon.a (mon.0) 8373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:22 smithi179 bash[23186]: audit 2024-09-21T02:07:21.876090+0000 mon.a (mon.0) 8374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:22 smithi179 bash[23186]: audit 2024-09-21T02:07:21.886640+0000 mon.a (mon.0) 8375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:22 smithi049 bash[23528]: cluster 2024-09-21T02:07:20.274449+0000 mgr.a (mgr.14388) 10077 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:22 smithi049 bash[23528]: audit 2024-09-21T02:07:21.867007+0000 mon.a (mon.0) 8373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:22 smithi049 bash[23528]: audit 2024-09-21T02:07:21.876090+0000 mon.a (mon.0) 8374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:22 smithi049 bash[23528]: audit 2024-09-21T02:07:21.886640+0000 mon.a (mon.0) 8375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:22 smithi044 bash[22676]: cluster 2024-09-21T02:07:20.274449+0000 mgr.a (mgr.14388) 10077 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:22 smithi044 bash[22676]: audit 2024-09-21T02:07:21.867007+0000 mon.a (mon.0) 8373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:22 smithi044 bash[22676]: audit 2024-09-21T02:07:21.876090+0000 mon.a (mon.0) 8374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:22 smithi044 bash[22676]: audit 2024-09-21T02:07:21.886640+0000 mon.a (mon.0) 8375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:24 smithi044 bash[22676]: cluster 2024-09-21T02:07:22.275224+0000 mgr.a (mgr.14388) 10078 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:24 smithi049 bash[23528]: cluster 2024-09-21T02:07:22.275224+0000 mgr.a (mgr.14388) 10078 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:24 smithi179 bash[23186]: cluster 2024-09-21T02:07:22.275224+0000 mgr.a (mgr.14388) 10078 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:25.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:25.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:25.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:25.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:25.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:26 smithi049 bash[23528]: cluster 2024-09-21T02:07:24.275967+0000 mgr.a (mgr.14388) 10079 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:26 smithi049 bash[23528]: audit 2024-09-21T02:07:24.896153+0000 mgr.a (mgr.14388) 10080 : audit [DBG] from='client.222942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:26 smithi044 bash[22676]: cluster 2024-09-21T02:07:24.275967+0000 mgr.a (mgr.14388) 10079 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:26 smithi044 bash[22676]: audit 2024-09-21T02:07:24.896153+0000 mgr.a (mgr.14388) 10080 : audit [DBG] from='client.222942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:26 smithi179 bash[23186]: cluster 2024-09-21T02:07:24.275967+0000 mgr.a (mgr.14388) 10079 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:26 smithi179 bash[23186]: audit 2024-09-21T02:07:24.896153+0000 mgr.a (mgr.14388) 10080 : audit [DBG] from='client.222942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:28 smithi179 bash[23186]: cluster 2024-09-21T02:07:26.278795+0000 mgr.a (mgr.14388) 10081 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:28 smithi049 bash[23528]: cluster 2024-09-21T02:07:26.278795+0000 mgr.a (mgr.14388) 10081 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:28 smithi044 bash[22676]: cluster 2024-09-21T02:07:26.278795+0000 mgr.a (mgr.14388) 10081 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:30.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:30.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:30 smithi044 bash[22676]: cluster 2024-09-21T02:07:28.279770+0000 mgr.a (mgr.14388) 10082 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:07:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:30 smithi179 bash[23186]: cluster 2024-09-21T02:07:28.279770+0000 mgr.a (mgr.14388) 10082 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:07:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:30 smithi049 bash[23528]: cluster 2024-09-21T02:07:28.279770+0000 mgr.a (mgr.14388) 10082 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:07:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:32 smithi044 bash[22676]: cluster 2024-09-21T02:07:30.281932+0000 mgr.a (mgr.14388) 10083 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:32 smithi044 bash[22676]: audit 2024-09-21T02:07:30.689078+0000 mgr.a (mgr.14388) 10084 : audit [DBG] from='client.223020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:32 smithi179 bash[23186]: cluster 2024-09-21T02:07:30.281932+0000 mgr.a (mgr.14388) 10083 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:32 smithi179 bash[23186]: audit 2024-09-21T02:07:30.689078+0000 mgr.a (mgr.14388) 10084 : audit [DBG] from='client.223020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:32.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:32 smithi049 bash[23528]: cluster 2024-09-21T02:07:30.281932+0000 mgr.a (mgr.14388) 10083 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:32 smithi049 bash[23528]: audit 2024-09-21T02:07:30.689078+0000 mgr.a (mgr.14388) 10084 : audit [DBG] from='client.223020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:34 smithi044 bash[22676]: cluster 2024-09-21T02:07:32.282825+0000 mgr.a (mgr.14388) 10085 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:07:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:34 smithi179 bash[23186]: cluster 2024-09-21T02:07:32.282825+0000 mgr.a (mgr.14388) 10085 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:07:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:34 smithi049 bash[23528]: cluster 2024-09-21T02:07:32.282825+0000 mgr.a (mgr.14388) 10085 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:07:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:36 smithi044 bash[22676]: cluster 2024-09-21T02:07:34.283623+0000 mgr.a (mgr.14388) 10086 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:07:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:36 smithi044 bash[22676]: audit 2024-09-21T02:07:35.215262+0000 mon.a (mon.0) 8376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:36 smithi044 bash[22676]: audit 2024-09-21T02:07:35.223809+0000 mon.a (mon.0) 8377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:36 smithi044 bash[22676]: audit 2024-09-21T02:07:35.235424+0000 mon.a (mon.0) 8378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:36 smithi044 bash[22676]: audit 2024-09-21T02:07:35.453813+0000 mon.a (mon.0) 8379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:36 smithi044 bash[22676]: audit 2024-09-21T02:07:35.463278+0000 mon.a (mon.0) 8380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:36 smithi044 bash[22676]: audit 2024-09-21T02:07:35.473383+0000 mon.a (mon.0) 8381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:36 smithi179 bash[23186]: cluster 2024-09-21T02:07:34.283623+0000 mgr.a (mgr.14388) 10086 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:07:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:36 smithi179 bash[23186]: audit 2024-09-21T02:07:35.215262+0000 mon.a (mon.0) 8376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:36 smithi179 bash[23186]: audit 2024-09-21T02:07:35.223809+0000 mon.a (mon.0) 8377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:36 smithi179 bash[23186]: audit 2024-09-21T02:07:35.235424+0000 mon.a (mon.0) 8378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:36 smithi179 bash[23186]: audit 2024-09-21T02:07:35.453813+0000 mon.a (mon.0) 8379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:36 smithi179 bash[23186]: audit 2024-09-21T02:07:35.463278+0000 mon.a (mon.0) 8380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:36 smithi179 bash[23186]: audit 2024-09-21T02:07:35.473383+0000 mon.a (mon.0) 8381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:36 smithi049 bash[23528]: cluster 2024-09-21T02:07:34.283623+0000 mgr.a (mgr.14388) 10086 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:07:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:36 smithi049 bash[23528]: audit 2024-09-21T02:07:35.215262+0000 mon.a (mon.0) 8376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:36 smithi049 bash[23528]: audit 2024-09-21T02:07:35.223809+0000 mon.a (mon.0) 8377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:36 smithi049 bash[23528]: audit 2024-09-21T02:07:35.235424+0000 mon.a (mon.0) 8378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:36 smithi049 bash[23528]: audit 2024-09-21T02:07:35.453813+0000 mon.a (mon.0) 8379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:36 smithi049 bash[23528]: audit 2024-09-21T02:07:35.463278+0000 mon.a (mon.0) 8380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:36 smithi049 bash[23528]: audit 2024-09-21T02:07:35.473383+0000 mon.a (mon.0) 8381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:36.900 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:38 smithi044 bash[22676]: cluster 2024-09-21T02:07:36.285019+0000 mgr.a (mgr.14388) 10087 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:38 smithi044 bash[22676]: audit 2024-09-21T02:07:36.465870+0000 mgr.a (mgr.14388) 10088 : audit [DBG] from='client.223098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:38 smithi179 bash[23186]: cluster 2024-09-21T02:07:36.285019+0000 mgr.a (mgr.14388) 10087 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:38 smithi179 bash[23186]: audit 2024-09-21T02:07:36.465870+0000 mgr.a (mgr.14388) 10088 : audit [DBG] from='client.223098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:38 smithi049 bash[23528]: cluster 2024-09-21T02:07:36.285019+0000 mgr.a (mgr.14388) 10087 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:38 smithi049 bash[23528]: audit 2024-09-21T02:07:36.465870+0000 mgr.a (mgr.14388) 10088 : audit [DBG] from='client.223098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:39.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:07:39 smithi044 bash[22930]: debug 2024-09-21T02:07:39.042+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:07:39.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:07:39 smithi044 bash[22930]: debug 2024-09-21T02:07:39.042+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:07:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:39 smithi044 bash[22676]: audit 2024-09-21T02:07:38.259075+0000 mon.a (mon.0) 8382 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:07:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:39 smithi044 bash[22676]: audit 2024-09-21T02:07:38.266001+0000 mon.a (mon.0) 8383 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:07:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:39 smithi044 bash[22676]: audit 2024-09-21T02:07:38.267855+0000 mon.a (mon.0) 8384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:07:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:39 smithi044 bash[22676]: audit 2024-09-21T02:07:38.279510+0000 mon.a (mon.0) 8385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:39 smithi044 bash[22676]: audit 2024-09-21T02:07:38.286052+0000 mon.a (mon.0) 8386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:07:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:39 smithi179 bash[23186]: audit 2024-09-21T02:07:38.259075+0000 mon.a (mon.0) 8382 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:07:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:39 smithi179 bash[23186]: audit 2024-09-21T02:07:38.266001+0000 mon.a (mon.0) 8383 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:07:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:39 smithi179 bash[23186]: audit 2024-09-21T02:07:38.267855+0000 mon.a (mon.0) 8384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:07:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:39 smithi179 bash[23186]: audit 2024-09-21T02:07:38.279510+0000 mon.a (mon.0) 8385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:39.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:39 smithi179 bash[23186]: audit 2024-09-21T02:07:38.286052+0000 mon.a (mon.0) 8386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:07:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:39 smithi049 bash[23528]: audit 2024-09-21T02:07:38.259075+0000 mon.a (mon.0) 8382 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:07:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:39 smithi049 bash[23528]: audit 2024-09-21T02:07:38.266001+0000 mon.a (mon.0) 8383 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:07:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:39 smithi049 bash[23528]: audit 2024-09-21T02:07:38.267855+0000 mon.a (mon.0) 8384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:07:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:39 smithi049 bash[23528]: audit 2024-09-21T02:07:38.279510+0000 mon.a (mon.0) 8385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:39 smithi049 bash[23528]: audit 2024-09-21T02:07:38.286052+0000 mon.a (mon.0) 8386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:07:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:40 smithi044 bash[22676]: cluster 2024-09-21T02:07:38.286020+0000 mgr.a (mgr.14388) 10089 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:40 smithi044 bash[22676]: audit 2024-09-21T02:07:38.288701+0000 mgr.a (mgr.14388) 10090 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:07:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:40 smithi044 bash[22676]: audit 2024-09-21T02:07:39.046123+0000 mgr.a (mgr.14388) 10091 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:07:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:40 smithi044 bash[22676]: cephadm 2024-09-21T02:07:39.047475+0000 mgr.a (mgr.14388) 10092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:07:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:40 smithi179 bash[23186]: cluster 2024-09-21T02:07:38.286020+0000 mgr.a (mgr.14388) 10089 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:40 smithi179 bash[23186]: audit 2024-09-21T02:07:38.288701+0000 mgr.a (mgr.14388) 10090 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:07:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:40 smithi179 bash[23186]: audit 2024-09-21T02:07:39.046123+0000 mgr.a (mgr.14388) 10091 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:07:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:40 smithi179 bash[23186]: cephadm 2024-09-21T02:07:39.047475+0000 mgr.a (mgr.14388) 10092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:07:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:40 smithi049 bash[23528]: cluster 2024-09-21T02:07:38.286020+0000 mgr.a (mgr.14388) 10089 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:40 smithi049 bash[23528]: audit 2024-09-21T02:07:38.288701+0000 mgr.a (mgr.14388) 10090 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:07:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:40 smithi049 bash[23528]: audit 2024-09-21T02:07:39.046123+0000 mgr.a (mgr.14388) 10091 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:07:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:40 smithi049 bash[23528]: cephadm 2024-09-21T02:07:39.047475+0000 mgr.a (mgr.14388) 10092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:07:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:42.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:42 smithi179 bash[23186]: cluster 2024-09-21T02:07:40.288349+0000 mgr.a (mgr.14388) 10093 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:42 smithi044 bash[22676]: cluster 2024-09-21T02:07:40.288349+0000 mgr.a (mgr.14388) 10093 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:42 smithi049 bash[23528]: cluster 2024-09-21T02:07:40.288349+0000 mgr.a (mgr.14388) 10093 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:42.659 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:42.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:42.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:42.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:42.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:43.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:43 smithi044 bash[22676]: audit 2024-09-21T02:07:42.101787+0000 mon.a (mon.0) 8387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:43 smithi044 bash[22676]: audit 2024-09-21T02:07:42.109800+0000 mon.a (mon.0) 8388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:43 smithi044 bash[22676]: audit 2024-09-21T02:07:42.118165+0000 mon.a (mon.0) 8389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:43 smithi179 bash[23186]: audit 2024-09-21T02:07:42.101787+0000 mon.a (mon.0) 8387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:43 smithi179 bash[23186]: audit 2024-09-21T02:07:42.109800+0000 mon.a (mon.0) 8388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:43 smithi179 bash[23186]: audit 2024-09-21T02:07:42.118165+0000 mon.a (mon.0) 8389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:43 smithi049 bash[23528]: audit 2024-09-21T02:07:42.101787+0000 mon.a (mon.0) 8387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:43 smithi049 bash[23528]: audit 2024-09-21T02:07:42.109800+0000 mon.a (mon.0) 8388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:43 smithi049 bash[23528]: audit 2024-09-21T02:07:42.118165+0000 mon.a (mon.0) 8389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:44.406 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:44 smithi044 bash[22676]: audit 2024-09-21T02:07:42.245808+0000 mgr.a (mgr.14388) 10094 : audit [DBG] from='client.223281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:44.406 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:44 smithi044 bash[22676]: cluster 2024-09-21T02:07:42.288910+0000 mgr.a (mgr.14388) 10095 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:44 smithi179 bash[23186]: audit 2024-09-21T02:07:42.245808+0000 mgr.a (mgr.14388) 10094 : audit [DBG] from='client.223281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:44 smithi179 bash[23186]: cluster 2024-09-21T02:07:42.288910+0000 mgr.a (mgr.14388) 10095 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:44 smithi049 bash[23528]: audit 2024-09-21T02:07:42.245808+0000 mgr.a (mgr.14388) 10094 : audit [DBG] from='client.223281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:44 smithi049 bash[23528]: cluster 2024-09-21T02:07:42.288910+0000 mgr.a (mgr.14388) 10095 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:45 smithi044 bash[22676]: cluster 2024-09-21T02:07:44.289692+0000 mgr.a (mgr.14388) 10096 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:45 smithi179 bash[23186]: cluster 2024-09-21T02:07:44.289692+0000 mgr.a (mgr.14388) 10096 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:45 smithi049 bash[23528]: cluster 2024-09-21T02:07:44.289692+0000 mgr.a (mgr.14388) 10096 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:47.625 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:47 smithi049 bash[23528]: cluster 2024-09-21T02:07:46.291986+0000 mgr.a (mgr.14388) 10097 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:47.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:47.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:47.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:47 smithi044 bash[22676]: cluster 2024-09-21T02:07:46.291986+0000 mgr.a (mgr.14388) 10097 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:47 smithi179 bash[23186]: cluster 2024-09-21T02:07:46.291986+0000 mgr.a (mgr.14388) 10097 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:48.441 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:48.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:48.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:48.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:48.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:48.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:48 smithi179 bash[23186]: audit 2024-09-21T02:07:48.001535+0000 mgr.a (mgr.14388) 10098 : audit [DBG] from='client.223356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:48 smithi044 bash[22676]: audit 2024-09-21T02:07:48.001535+0000 mgr.a (mgr.14388) 10098 : audit [DBG] from='client.223356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:48 smithi049 bash[23528]: audit 2024-09-21T02:07:48.001535+0000 mgr.a (mgr.14388) 10098 : audit [DBG] from='client.223356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:49 smithi049 bash[23528]: cluster 2024-09-21T02:07:48.292529+0000 mgr.a (mgr.14388) 10099 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:49.633 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:49 smithi179 bash[23186]: cluster 2024-09-21T02:07:48.292529+0000 mgr.a (mgr.14388) 10099 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:49 smithi044 bash[22676]: cluster 2024-09-21T02:07:48.292529+0000 mgr.a (mgr.14388) 10099 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:51 smithi044 bash[22676]: cluster 2024-09-21T02:07:50.294881+0000 mgr.a (mgr.14388) 10100 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:51 smithi179 bash[23186]: cluster 2024-09-21T02:07:50.294881+0000 mgr.a (mgr.14388) 10100 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:51 smithi049 bash[23528]: cluster 2024-09-21T02:07:50.294881+0000 mgr.a (mgr.14388) 10100 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:07:53.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:53.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:53.444 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:53 smithi044 bash[22676]: cluster 2024-09-21T02:07:52.295659+0000 mgr.a (mgr.14388) 10101 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:53 smithi179 bash[23186]: cluster 2024-09-21T02:07:52.295659+0000 mgr.a (mgr.14388) 10101 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:53 smithi049 bash[23528]: cluster 2024-09-21T02:07:52.295659+0000 mgr.a (mgr.14388) 10101 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:54.231 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:07:54.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:07:54.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:07:54.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:07:54.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:07:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:54 smithi044 bash[22676]: audit 2024-09-21T02:07:53.779796+0000 mgr.a (mgr.14388) 10102 : audit [DBG] from='client.223428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:54 smithi179 bash[23186]: audit 2024-09-21T02:07:53.779796+0000 mgr.a (mgr.14388) 10102 : audit [DBG] from='client.223428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:54 smithi049 bash[23528]: audit 2024-09-21T02:07:53.779796+0000 mgr.a (mgr.14388) 10102 : audit [DBG] from='client.223428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:07:55.709 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:55 smithi044 bash[22676]: cluster 2024-09-21T02:07:54.296408+0000 mgr.a (mgr.14388) 10103 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:55 smithi179 bash[23186]: cluster 2024-09-21T02:07:54.296408+0000 mgr.a (mgr.14388) 10103 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:55 smithi049 bash[23528]: cluster 2024-09-21T02:07:54.296408+0000 mgr.a (mgr.14388) 10103 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:07:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:56 smithi044 bash[22676]: audit 2024-09-21T02:07:55.441953+0000 mon.a (mon.0) 8390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:56 smithi044 bash[22676]: audit 2024-09-21T02:07:55.450553+0000 mon.a (mon.0) 8391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:56 smithi044 bash[22676]: audit 2024-09-21T02:07:55.461549+0000 mon.a (mon.0) 8392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:56 smithi044 bash[22676]: audit 2024-09-21T02:07:55.688796+0000 mon.a (mon.0) 8393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:56 smithi044 bash[22676]: audit 2024-09-21T02:07:55.697533+0000 mon.a (mon.0) 8394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:56 smithi044 bash[22676]: audit 2024-09-21T02:07:55.708031+0000 mon.a (mon.0) 8395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:56 smithi179 bash[23186]: audit 2024-09-21T02:07:55.441953+0000 mon.a (mon.0) 8390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:56 smithi179 bash[23186]: audit 2024-09-21T02:07:55.450553+0000 mon.a (mon.0) 8391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:56 smithi179 bash[23186]: audit 2024-09-21T02:07:55.461549+0000 mon.a (mon.0) 8392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:56 smithi179 bash[23186]: audit 2024-09-21T02:07:55.688796+0000 mon.a (mon.0) 8393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:56 smithi179 bash[23186]: audit 2024-09-21T02:07:55.697533+0000 mon.a (mon.0) 8394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:56 smithi179 bash[23186]: audit 2024-09-21T02:07:55.708031+0000 mon.a (mon.0) 8395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:56 smithi049 bash[23528]: audit 2024-09-21T02:07:55.441953+0000 mon.a (mon.0) 8390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:56 smithi049 bash[23528]: audit 2024-09-21T02:07:55.450553+0000 mon.a (mon.0) 8391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:56 smithi049 bash[23528]: audit 2024-09-21T02:07:55.461549+0000 mon.a (mon.0) 8392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:56 smithi049 bash[23528]: audit 2024-09-21T02:07:55.688796+0000 mon.a (mon.0) 8393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:56 smithi049 bash[23528]: audit 2024-09-21T02:07:55.697533+0000 mon.a (mon.0) 8394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:56 smithi049 bash[23528]: audit 2024-09-21T02:07:55.708031+0000 mon.a (mon.0) 8395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:07:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:57 smithi044 bash[22676]: cluster 2024-09-21T02:07:56.298670+0000 mgr.a (mgr.14388) 10104 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:57 smithi179 bash[23186]: cluster 2024-09-21T02:07:56.298670+0000 mgr.a (mgr.14388) 10104 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:57 smithi049 bash[23528]: cluster 2024-09-21T02:07:56.298670+0000 mgr.a (mgr.14388) 10104 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:07:59.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:07:59.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:07:59.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:07:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:07:59 smithi044 bash[22676]: cluster 2024-09-21T02:07:58.299439+0000 mgr.a (mgr.14388) 10105 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:07:59 smithi179 bash[23186]: cluster 2024-09-21T02:07:58.299439+0000 mgr.a (mgr.14388) 10105 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:00.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:00.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:00.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:00.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:00.002 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:07:59 smithi049 bash[23528]: cluster 2024-09-21T02:07:58.299439+0000 mgr.a (mgr.14388) 10105 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:00 smithi044 bash[22676]: audit 2024-09-21T02:07:59.567720+0000 mgr.a (mgr.14388) 10106 : audit [DBG] from='client.223503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:00 smithi179 bash[23186]: audit 2024-09-21T02:07:59.567720+0000 mgr.a (mgr.14388) 10106 : audit [DBG] from='client.223503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:00 smithi049 bash[23528]: audit 2024-09-21T02:07:59.567720+0000 mgr.a (mgr.14388) 10106 : audit [DBG] from='client.223503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:01 smithi044 bash[22676]: cluster 2024-09-21T02:08:00.301822+0000 mgr.a (mgr.14388) 10107 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:01 smithi179 bash[23186]: cluster 2024-09-21T02:08:00.301822+0000 mgr.a (mgr.14388) 10107 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:01 smithi049 bash[23528]: cluster 2024-09-21T02:08:00.301822+0000 mgr.a (mgr.14388) 10107 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:03.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:03 smithi044 bash[22676]: cluster 2024-09-21T02:08:02.302635+0000 mgr.a (mgr.14388) 10108 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:03.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:03 smithi044 bash[22676]: audit 2024-09-21T02:08:02.331596+0000 mon.a (mon.0) 8396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:03 smithi044 bash[22676]: audit 2024-09-21T02:08:02.341470+0000 mon.a (mon.0) 8397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:03 smithi044 bash[22676]: audit 2024-09-21T02:08:02.353103+0000 mon.a (mon.0) 8398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:03 smithi179 bash[23186]: cluster 2024-09-21T02:08:02.302635+0000 mgr.a (mgr.14388) 10108 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:03 smithi179 bash[23186]: audit 2024-09-21T02:08:02.331596+0000 mon.a (mon.0) 8396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:03 smithi179 bash[23186]: audit 2024-09-21T02:08:02.341470+0000 mon.a (mon.0) 8397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:03 smithi179 bash[23186]: audit 2024-09-21T02:08:02.353103+0000 mon.a (mon.0) 8398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:03 smithi049 bash[23528]: cluster 2024-09-21T02:08:02.302635+0000 mgr.a (mgr.14388) 10108 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:03 smithi049 bash[23528]: audit 2024-09-21T02:08:02.331596+0000 mon.a (mon.0) 8396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:03 smithi049 bash[23528]: audit 2024-09-21T02:08:02.341470+0000 mon.a (mon.0) 8397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:03 smithi049 bash[23528]: audit 2024-09-21T02:08:02.353103+0000 mon.a (mon.0) 8398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:05.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:05.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:05.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:05 smithi044 bash[22676]: cluster 2024-09-21T02:08:04.303256+0000 mgr.a (mgr.14388) 10109 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:05 smithi179 bash[23186]: cluster 2024-09-21T02:08:04.303256+0000 mgr.a (mgr.14388) 10109 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:05.783 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:05.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:05 smithi049 bash[23528]: cluster 2024-09-21T02:08:04.303256+0000 mgr.a (mgr.14388) 10109 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:06.694 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:06 smithi049 bash[23528]: audit 2024-09-21T02:08:05.337134+0000 mgr.a (mgr.14388) 10110 : audit [DBG] from='client.223581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:06 smithi044 bash[22676]: audit 2024-09-21T02:08:05.337134+0000 mgr.a (mgr.14388) 10110 : audit [DBG] from='client.223581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:06 smithi179 bash[23186]: audit 2024-09-21T02:08:05.337134+0000 mgr.a (mgr.14388) 10110 : audit [DBG] from='client.223581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:07 smithi179 bash[23186]: cluster 2024-09-21T02:08:06.306134+0000 mgr.a (mgr.14388) 10111 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:07.649 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:07 smithi049 bash[23528]: cluster 2024-09-21T02:08:06.306134+0000 mgr.a (mgr.14388) 10111 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:07 smithi044 bash[22676]: cluster 2024-09-21T02:08:06.306134+0000 mgr.a (mgr.14388) 10111 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:09 smithi044 bash[22676]: cluster 2024-09-21T02:08:08.307083+0000 mgr.a (mgr.14388) 10112 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:08:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:09 smithi179 bash[23186]: cluster 2024-09-21T02:08:08.307083+0000 mgr.a (mgr.14388) 10112 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:08:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:09 smithi049 bash[23528]: cluster 2024-09-21T02:08:08.307083+0000 mgr.a (mgr.14388) 10112 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:08:10.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:10.785 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:11.531 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:11 smithi044 bash[22676]: cluster 2024-09-21T02:08:10.309165+0000 mgr.a (mgr.14388) 10113 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:11 smithi179 bash[23186]: cluster 2024-09-21T02:08:10.309165+0000 mgr.a (mgr.14388) 10113 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:11 smithi049 bash[23528]: cluster 2024-09-21T02:08:10.309165+0000 mgr.a (mgr.14388) 10113 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:12 smithi044 bash[22676]: audit 2024-09-21T02:08:11.115309+0000 mgr.a (mgr.14388) 10114 : audit [DBG] from='client.223659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:12 smithi179 bash[23186]: audit 2024-09-21T02:08:11.115309+0000 mgr.a (mgr.14388) 10114 : audit [DBG] from='client.223659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:12 smithi049 bash[23528]: audit 2024-09-21T02:08:11.115309+0000 mgr.a (mgr.14388) 10114 : audit [DBG] from='client.223659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:13 smithi044 bash[22676]: cluster 2024-09-21T02:08:12.310197+0000 mgr.a (mgr.14388) 10115 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:08:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:13 smithi179 bash[23186]: cluster 2024-09-21T02:08:12.310197+0000 mgr.a (mgr.14388) 10115 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:08:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:13 smithi049 bash[23528]: cluster 2024-09-21T02:08:12.310197+0000 mgr.a (mgr.14388) 10115 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:08:15.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:15 smithi179 bash[23186]: cluster 2024-09-21T02:08:14.311055+0000 mgr.a (mgr.14388) 10116 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:08:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:15 smithi044 bash[22676]: cluster 2024-09-21T02:08:14.311055+0000 mgr.a (mgr.14388) 10116 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:08:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:15 smithi049 bash[23528]: cluster 2024-09-21T02:08:14.311055+0000 mgr.a (mgr.14388) 10116 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:08:16.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:16 smithi044 bash[22676]: audit 2024-09-21T02:08:15.670204+0000 mon.a (mon.0) 8399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:16 smithi044 bash[22676]: audit 2024-09-21T02:08:15.678702+0000 mon.a (mon.0) 8400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:16 smithi044 bash[22676]: audit 2024-09-21T02:08:15.689142+0000 mon.a (mon.0) 8401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:16 smithi044 bash[22676]: audit 2024-09-21T02:08:15.895607+0000 mon.a (mon.0) 8402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:16 smithi044 bash[22676]: audit 2024-09-21T02:08:15.903280+0000 mon.a (mon.0) 8403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:16 smithi044 bash[22676]: audit 2024-09-21T02:08:15.913537+0000 mon.a (mon.0) 8404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:16 smithi179 bash[23186]: audit 2024-09-21T02:08:15.670204+0000 mon.a (mon.0) 8399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:16 smithi179 bash[23186]: audit 2024-09-21T02:08:15.678702+0000 mon.a (mon.0) 8400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:16 smithi179 bash[23186]: audit 2024-09-21T02:08:15.689142+0000 mon.a (mon.0) 8401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:16 smithi179 bash[23186]: audit 2024-09-21T02:08:15.895607+0000 mon.a (mon.0) 8402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:16 smithi179 bash[23186]: audit 2024-09-21T02:08:15.903280+0000 mon.a (mon.0) 8403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:16 smithi179 bash[23186]: audit 2024-09-21T02:08:15.913537+0000 mon.a (mon.0) 8404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:16 smithi049 bash[23528]: audit 2024-09-21T02:08:15.670204+0000 mon.a (mon.0) 8399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:16 smithi049 bash[23528]: audit 2024-09-21T02:08:15.678702+0000 mon.a (mon.0) 8400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:16 smithi049 bash[23528]: audit 2024-09-21T02:08:15.689142+0000 mon.a (mon.0) 8401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:16 smithi049 bash[23528]: audit 2024-09-21T02:08:15.895607+0000 mon.a (mon.0) 8402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:16 smithi049 bash[23528]: audit 2024-09-21T02:08:15.903280+0000 mon.a (mon.0) 8403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:16 smithi049 bash[23528]: audit 2024-09-21T02:08:15.913537+0000 mon.a (mon.0) 8404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:17.320 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:17.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:17 smithi044 bash[22676]: cluster 2024-09-21T02:08:16.313345+0000 mgr.a (mgr.14388) 10117 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:17 smithi044 bash[22676]: audit 2024-09-21T02:08:16.869757+0000 mgr.a (mgr.14388) 10118 : audit [DBG] from='client.223737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:17 smithi179 bash[23186]: cluster 2024-09-21T02:08:16.313345+0000 mgr.a (mgr.14388) 10117 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:17 smithi179 bash[23186]: audit 2024-09-21T02:08:16.869757+0000 mgr.a (mgr.14388) 10118 : audit [DBG] from='client.223737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:17 smithi049 bash[23528]: cluster 2024-09-21T02:08:16.313345+0000 mgr.a (mgr.14388) 10117 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:17 smithi049 bash[23528]: audit 2024-09-21T02:08:16.869757+0000 mgr.a (mgr.14388) 10118 : audit [DBG] from='client.223737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:19 smithi044 bash[22676]: cluster 2024-09-21T02:08:18.314539+0000 mgr.a (mgr.14388) 10119 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:19 smithi179 bash[23186]: cluster 2024-09-21T02:08:18.314539+0000 mgr.a (mgr.14388) 10119 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:19 smithi049 bash[23528]: cluster 2024-09-21T02:08:18.314539+0000 mgr.a (mgr.14388) 10119 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:21 smithi044 bash[22676]: cluster 2024-09-21T02:08:20.316879+0000 mgr.a (mgr.14388) 10120 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:21 smithi179 bash[23186]: cluster 2024-09-21T02:08:20.316879+0000 mgr.a (mgr.14388) 10120 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:21 smithi049 bash[23528]: cluster 2024-09-21T02:08:20.316879+0000 mgr.a (mgr.14388) 10120 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:22.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:22.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:22.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:23.117 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:23.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:23.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:23 smithi044 bash[22676]: cluster 2024-09-21T02:08:22.317731+0000 mgr.a (mgr.14388) 10121 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:23.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:23 smithi044 bash[22676]: audit 2024-09-21T02:08:22.566486+0000 mon.a (mon.0) 8405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:23.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:23 smithi044 bash[22676]: audit 2024-09-21T02:08:22.574172+0000 mon.a (mon.0) 8406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:23.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:23 smithi044 bash[22676]: audit 2024-09-21T02:08:22.583130+0000 mon.a (mon.0) 8407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:23.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:23 smithi044 bash[22676]: audit 2024-09-21T02:08:22.661711+0000 mgr.a (mgr.14388) 10122 : audit [DBG] from='client.223815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:23 smithi179 bash[23186]: cluster 2024-09-21T02:08:22.317731+0000 mgr.a (mgr.14388) 10121 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:23 smithi179 bash[23186]: audit 2024-09-21T02:08:22.566486+0000 mon.a (mon.0) 8405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:23 smithi179 bash[23186]: audit 2024-09-21T02:08:22.574172+0000 mon.a (mon.0) 8406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:23 smithi179 bash[23186]: audit 2024-09-21T02:08:22.583130+0000 mon.a (mon.0) 8407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:23 smithi179 bash[23186]: audit 2024-09-21T02:08:22.661711+0000 mgr.a (mgr.14388) 10122 : audit [DBG] from='client.223815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:23 smithi049 bash[23528]: cluster 2024-09-21T02:08:22.317731+0000 mgr.a (mgr.14388) 10121 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:23 smithi049 bash[23528]: audit 2024-09-21T02:08:22.566486+0000 mon.a (mon.0) 8405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:23 smithi049 bash[23528]: audit 2024-09-21T02:08:22.574172+0000 mon.a (mon.0) 8406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:23 smithi049 bash[23528]: audit 2024-09-21T02:08:22.583130+0000 mon.a (mon.0) 8407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:23 smithi049 bash[23528]: audit 2024-09-21T02:08:22.661711+0000 mgr.a (mgr.14388) 10122 : audit [DBG] from='client.223815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:25 smithi044 bash[22676]: cluster 2024-09-21T02:08:24.318636+0000 mgr.a (mgr.14388) 10123 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:25 smithi179 bash[23186]: cluster 2024-09-21T02:08:24.318636+0000 mgr.a (mgr.14388) 10123 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:25 smithi049 bash[23528]: cluster 2024-09-21T02:08:24.318636+0000 mgr.a (mgr.14388) 10123 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:27 smithi179 bash[23186]: cluster 2024-09-21T02:08:26.320897+0000 mgr.a (mgr.14388) 10124 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:27.913 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:27 smithi049 bash[23528]: cluster 2024-09-21T02:08:26.320897+0000 mgr.a (mgr.14388) 10124 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:27 smithi044 bash[22676]: cluster 2024-09-21T02:08:26.320897+0000 mgr.a (mgr.14388) 10124 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:28.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:28.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:28.120 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:28.899 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:28.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:28.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:28.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:28.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:29.935 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:29 smithi179 bash[23186]: cluster 2024-09-21T02:08:28.321670+0000 mgr.a (mgr.14388) 10125 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:29.935 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:29 smithi179 bash[23186]: audit 2024-09-21T02:08:28.453703+0000 mgr.a (mgr.14388) 10126 : audit [DBG] from='client.223890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:29 smithi044 bash[22676]: cluster 2024-09-21T02:08:28.321670+0000 mgr.a (mgr.14388) 10125 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:29 smithi044 bash[22676]: audit 2024-09-21T02:08:28.453703+0000 mgr.a (mgr.14388) 10126 : audit [DBG] from='client.223890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:29 smithi049 bash[23528]: cluster 2024-09-21T02:08:28.321670+0000 mgr.a (mgr.14388) 10125 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:29 smithi049 bash[23528]: audit 2024-09-21T02:08:28.453703+0000 mgr.a (mgr.14388) 10126 : audit [DBG] from='client.223890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:31 smithi044 bash[22676]: cluster 2024-09-21T02:08:30.323967+0000 mgr.a (mgr.14388) 10127 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:31 smithi179 bash[23186]: cluster 2024-09-21T02:08:30.323967+0000 mgr.a (mgr.14388) 10127 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:31 smithi049 bash[23528]: cluster 2024-09-21T02:08:30.323967+0000 mgr.a (mgr.14388) 10127 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:33.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:33.900 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:33.900 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:33 smithi044 bash[22676]: cluster 2024-09-21T02:08:32.324798+0000 mgr.a (mgr.14388) 10128 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:33 smithi179 bash[23186]: cluster 2024-09-21T02:08:32.324798+0000 mgr.a (mgr.14388) 10128 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:34.037 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:33 smithi049 bash[23528]: cluster 2024-09-21T02:08:32.324798+0000 mgr.a (mgr.14388) 10128 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:34.686 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:34.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:34.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:34.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:34.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:35.923 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:35 smithi179 bash[23186]: audit 2024-09-21T02:08:34.234060+0000 mgr.a (mgr.14388) 10129 : audit [DBG] from='client.223968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:35.924 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:35 smithi179 bash[23186]: cluster 2024-09-21T02:08:34.325446+0000 mgr.a (mgr.14388) 10130 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:35 smithi044 bash[22676]: audit 2024-09-21T02:08:34.234060+0000 mgr.a (mgr.14388) 10129 : audit [DBG] from='client.223968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:35 smithi044 bash[22676]: cluster 2024-09-21T02:08:34.325446+0000 mgr.a (mgr.14388) 10130 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:35 smithi049 bash[23528]: audit 2024-09-21T02:08:34.234060+0000 mgr.a (mgr.14388) 10129 : audit [DBG] from='client.223968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:35 smithi049 bash[23528]: cluster 2024-09-21T02:08:34.325446+0000 mgr.a (mgr.14388) 10130 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:36 smithi044 bash[22676]: audit 2024-09-21T02:08:35.900803+0000 mon.a (mon.0) 8408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:36 smithi044 bash[22676]: audit 2024-09-21T02:08:35.910698+0000 mon.a (mon.0) 8409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:36 smithi044 bash[22676]: audit 2024-09-21T02:08:35.921533+0000 mon.a (mon.0) 8410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:36 smithi044 bash[22676]: audit 2024-09-21T02:08:36.120370+0000 mon.a (mon.0) 8411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:36 smithi044 bash[22676]: audit 2024-09-21T02:08:36.128868+0000 mon.a (mon.0) 8412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:36 smithi044 bash[22676]: audit 2024-09-21T02:08:36.139384+0000 mon.a (mon.0) 8413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:36 smithi179 bash[23186]: audit 2024-09-21T02:08:35.900803+0000 mon.a (mon.0) 8408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:36 smithi179 bash[23186]: audit 2024-09-21T02:08:35.910698+0000 mon.a (mon.0) 8409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:36 smithi179 bash[23186]: audit 2024-09-21T02:08:35.921533+0000 mon.a (mon.0) 8410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:36 smithi179 bash[23186]: audit 2024-09-21T02:08:36.120370+0000 mon.a (mon.0) 8411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:36 smithi179 bash[23186]: audit 2024-09-21T02:08:36.128868+0000 mon.a (mon.0) 8412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:36 smithi179 bash[23186]: audit 2024-09-21T02:08:36.139384+0000 mon.a (mon.0) 8413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:36 smithi049 bash[23528]: audit 2024-09-21T02:08:35.900803+0000 mon.a (mon.0) 8408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:36 smithi049 bash[23528]: audit 2024-09-21T02:08:35.910698+0000 mon.a (mon.0) 8409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:36 smithi049 bash[23528]: audit 2024-09-21T02:08:35.921533+0000 mon.a (mon.0) 8410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:36 smithi049 bash[23528]: audit 2024-09-21T02:08:36.120370+0000 mon.a (mon.0) 8411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:36 smithi049 bash[23528]: audit 2024-09-21T02:08:36.128868+0000 mon.a (mon.0) 8412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:36 smithi049 bash[23528]: audit 2024-09-21T02:08:36.139384+0000 mon.a (mon.0) 8413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:37 smithi044 bash[22676]: cluster 2024-09-21T02:08:36.327885+0000 mgr.a (mgr.14388) 10131 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:37 smithi179 bash[23186]: cluster 2024-09-21T02:08:36.327885+0000 mgr.a (mgr.14388) 10131 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:37 smithi049 bash[23528]: cluster 2024-09-21T02:08:36.327885+0000 mgr.a (mgr.14388) 10131 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:39.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:39.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:39.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:40.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22930]: debug 2024-09-21T02:08:39.929+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:08:40.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22930]: debug 2024-09-21T02:08:39.929+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:08:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22676]: cluster 2024-09-21T02:08:38.328843+0000 mgr.a (mgr.14388) 10132 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22676]: audit 2024-09-21T02:08:39.112786+0000 mon.a (mon.0) 8414 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:08:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22676]: audit 2024-09-21T02:08:39.118457+0000 mon.a (mon.0) 8415 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:08:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22676]: audit 2024-09-21T02:08:39.120274+0000 mon.a (mon.0) 8416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:08:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22676]: audit 2024-09-21T02:08:39.131266+0000 mon.a (mon.0) 8417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:39 smithi044 bash[22676]: audit 2024-09-21T02:08:39.138318+0000 mon.a (mon.0) 8418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:08:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:39 smithi179 bash[23186]: cluster 2024-09-21T02:08:38.328843+0000 mgr.a (mgr.14388) 10132 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:39 smithi179 bash[23186]: audit 2024-09-21T02:08:39.112786+0000 mon.a (mon.0) 8414 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:08:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:39 smithi179 bash[23186]: audit 2024-09-21T02:08:39.118457+0000 mon.a (mon.0) 8415 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:08:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:39 smithi179 bash[23186]: audit 2024-09-21T02:08:39.120274+0000 mon.a (mon.0) 8416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:08:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:39 smithi179 bash[23186]: audit 2024-09-21T02:08:39.131266+0000 mon.a (mon.0) 8417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:39 smithi179 bash[23186]: audit 2024-09-21T02:08:39.138318+0000 mon.a (mon.0) 8418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:39 smithi049 bash[23528]: cluster 2024-09-21T02:08:38.328843+0000 mgr.a (mgr.14388) 10132 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:39 smithi049 bash[23528]: audit 2024-09-21T02:08:39.112786+0000 mon.a (mon.0) 8414 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:39 smithi049 bash[23528]: audit 2024-09-21T02:08:39.118457+0000 mon.a (mon.0) 8415 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:39 smithi049 bash[23528]: audit 2024-09-21T02:08:39.120274+0000 mon.a (mon.0) 8416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:39 smithi049 bash[23528]: audit 2024-09-21T02:08:39.131266+0000 mon.a (mon.0) 8417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:39 smithi049 bash[23528]: audit 2024-09-21T02:08:39.138318+0000 mon.a (mon.0) 8418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:08:40.414 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:40 smithi044 bash[22676]: audit 2024-09-21T02:08:39.140727+0000 mgr.a (mgr.14388) 10133 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:08:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:40 smithi044 bash[22676]: audit 2024-09-21T02:08:39.934844+0000 mgr.a (mgr.14388) 10134 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:08:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:40 smithi044 bash[22676]: cephadm 2024-09-21T02:08:39.936020+0000 mgr.a (mgr.14388) 10135 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:08:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:40 smithi044 bash[22676]: audit 2024-09-21T02:08:40.014550+0000 mgr.a (mgr.14388) 10136 : audit [DBG] from='client.224136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:40 smithi179 bash[23186]: audit 2024-09-21T02:08:39.140727+0000 mgr.a (mgr.14388) 10133 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:08:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:40 smithi179 bash[23186]: audit 2024-09-21T02:08:39.934844+0000 mgr.a (mgr.14388) 10134 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:08:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:40 smithi179 bash[23186]: cephadm 2024-09-21T02:08:39.936020+0000 mgr.a (mgr.14388) 10135 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:08:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:40 smithi179 bash[23186]: audit 2024-09-21T02:08:40.014550+0000 mgr.a (mgr.14388) 10136 : audit [DBG] from='client.224136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:40 smithi049 bash[23528]: audit 2024-09-21T02:08:39.140727+0000 mgr.a (mgr.14388) 10133 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:40 smithi049 bash[23528]: audit 2024-09-21T02:08:39.934844+0000 mgr.a (mgr.14388) 10134 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:40 smithi049 bash[23528]: cephadm 2024-09-21T02:08:39.936020+0000 mgr.a (mgr.14388) 10135 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:08:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:40 smithi049 bash[23528]: audit 2024-09-21T02:08:40.014550+0000 mgr.a (mgr.14388) 10136 : audit [DBG] from='client.224136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:41 smithi044 bash[22676]: cluster 2024-09-21T02:08:40.330158+0000 mgr.a (mgr.14388) 10137 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:41 smithi179 bash[23186]: cluster 2024-09-21T02:08:40.330158+0000 mgr.a (mgr.14388) 10137 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:41 smithi049 bash[23528]: cluster 2024-09-21T02:08:40.330158+0000 mgr.a (mgr.14388) 10137 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:43 smithi049 bash[23528]: cluster 2024-09-21T02:08:42.330924+0000 mgr.a (mgr.14388) 10138 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:43 smithi049 bash[23528]: audit 2024-09-21T02:08:42.777796+0000 mon.a (mon.0) 8419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:43 smithi049 bash[23528]: audit 2024-09-21T02:08:42.786578+0000 mon.a (mon.0) 8420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:43 smithi049 bash[23528]: audit 2024-09-21T02:08:42.798666+0000 mon.a (mon.0) 8421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:43 smithi044 bash[22676]: cluster 2024-09-21T02:08:42.330924+0000 mgr.a (mgr.14388) 10138 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:44.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:43 smithi044 bash[22676]: audit 2024-09-21T02:08:42.777796+0000 mon.a (mon.0) 8419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:43 smithi044 bash[22676]: audit 2024-09-21T02:08:42.786578+0000 mon.a (mon.0) 8420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:43 smithi044 bash[22676]: audit 2024-09-21T02:08:42.798666+0000 mon.a (mon.0) 8421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.234 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:43 smithi179 bash[23186]: cluster 2024-09-21T02:08:42.330924+0000 mgr.a (mgr.14388) 10138 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:44.234 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:43 smithi179 bash[23186]: audit 2024-09-21T02:08:42.777796+0000 mon.a (mon.0) 8419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:43 smithi179 bash[23186]: audit 2024-09-21T02:08:42.786578+0000 mon.a (mon.0) 8420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:44.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:43 smithi179 bash[23186]: audit 2024-09-21T02:08:42.798666+0000 mon.a (mon.0) 8421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:45.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:45.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:45 smithi049 bash[23528]: cluster 2024-09-21T02:08:44.331531+0000 mgr.a (mgr.14388) 10139 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:46.182 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:46.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:46.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:46.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:46.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:45 smithi044 bash[22676]: cluster 2024-09-21T02:08:44.331531+0000 mgr.a (mgr.14388) 10139 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:45 smithi179 bash[23186]: cluster 2024-09-21T02:08:44.331531+0000 mgr.a (mgr.14388) 10139 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:46 smithi049 bash[23528]: audit 2024-09-21T02:08:45.749690+0000 mgr.a (mgr.14388) 10140 : audit [DBG] from='client.224229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:46 smithi044 bash[22676]: audit 2024-09-21T02:08:45.749690+0000 mgr.a (mgr.14388) 10140 : audit [DBG] from='client.224229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:46 smithi179 bash[23186]: audit 2024-09-21T02:08:45.749690+0000 mgr.a (mgr.14388) 10140 : audit [DBG] from='client.224229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:47 smithi049 bash[23528]: cluster 2024-09-21T02:08:46.334366+0000 mgr.a (mgr.14388) 10141 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:47 smithi044 bash[22676]: cluster 2024-09-21T02:08:46.334366+0000 mgr.a (mgr.14388) 10141 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:47 smithi179 bash[23186]: cluster 2024-09-21T02:08:46.334366+0000 mgr.a (mgr.14388) 10141 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:49 smithi049 bash[23528]: cluster 2024-09-21T02:08:48.335179+0000 mgr.a (mgr.14388) 10142 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:50.107 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:49 smithi179 bash[23186]: cluster 2024-09-21T02:08:48.335179+0000 mgr.a (mgr.14388) 10142 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:49 smithi044 bash[22676]: cluster 2024-09-21T02:08:48.335179+0000 mgr.a (mgr.14388) 10142 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:08:51.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:51.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:51.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:51.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:51 smithi049 bash[23528]: cluster 2024-09-21T02:08:50.337167+0000 mgr.a (mgr.14388) 10143 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:51 smithi044 bash[22676]: cluster 2024-09-21T02:08:50.337167+0000 mgr.a (mgr.14388) 10143 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:51 smithi179 bash[23186]: cluster 2024-09-21T02:08:50.337167+0000 mgr.a (mgr.14388) 10143 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:08:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:52 smithi044 bash[22676]: audit 2024-09-21T02:08:51.519429+0000 mgr.a (mgr.14388) 10144 : audit [DBG] from='client.224304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:52 smithi179 bash[23186]: audit 2024-09-21T02:08:51.519429+0000 mgr.a (mgr.14388) 10144 : audit [DBG] from='client.224304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:52 smithi049 bash[23528]: audit 2024-09-21T02:08:51.519429+0000 mgr.a (mgr.14388) 10144 : audit [DBG] from='client.224304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:53 smithi044 bash[22676]: cluster 2024-09-21T02:08:52.338362+0000 mgr.a (mgr.14388) 10145 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:53 smithi179 bash[23186]: cluster 2024-09-21T02:08:52.338362+0000 mgr.a (mgr.14388) 10145 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:53 smithi049 bash[23528]: cluster 2024-09-21T02:08:52.338362+0000 mgr.a (mgr.14388) 10145 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:56.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:55 smithi179 bash[23186]: cluster 2024-09-21T02:08:54.339239+0000 mgr.a (mgr.14388) 10146 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:55 smithi044 bash[22676]: cluster 2024-09-21T02:08:54.339239+0000 mgr.a (mgr.14388) 10146 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:55 smithi049 bash[23528]: cluster 2024-09-21T02:08:54.339239+0000 mgr.a (mgr.14388) 10146 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:56.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:08:56.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:08:56.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:08:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:57 smithi044 bash[22676]: audit 2024-09-21T02:08:56.135802+0000 mon.a (mon.0) 8422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:57 smithi044 bash[22676]: audit 2024-09-21T02:08:56.144106+0000 mon.a (mon.0) 8423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:57 smithi044 bash[22676]: audit 2024-09-21T02:08:56.156134+0000 mon.a (mon.0) 8424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:57 smithi044 bash[22676]: cluster 2024-09-21T02:08:56.341308+0000 mgr.a (mgr.14388) 10147 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:57 smithi044 bash[22676]: audit 2024-09-21T02:08:56.348029+0000 mon.a (mon.0) 8425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:57 smithi044 bash[22676]: audit 2024-09-21T02:08:56.357506+0000 mon.a (mon.0) 8426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:57 smithi044 bash[22676]: audit 2024-09-21T02:08:56.367094+0000 mon.a (mon.0) 8427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:57 smithi179 bash[23186]: audit 2024-09-21T02:08:56.135802+0000 mon.a (mon.0) 8422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:57 smithi179 bash[23186]: audit 2024-09-21T02:08:56.144106+0000 mon.a (mon.0) 8423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:57 smithi179 bash[23186]: audit 2024-09-21T02:08:56.156134+0000 mon.a (mon.0) 8424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:57 smithi179 bash[23186]: cluster 2024-09-21T02:08:56.341308+0000 mgr.a (mgr.14388) 10147 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:57 smithi179 bash[23186]: audit 2024-09-21T02:08:56.348029+0000 mon.a (mon.0) 8425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:57 smithi179 bash[23186]: audit 2024-09-21T02:08:56.357506+0000 mon.a (mon.0) 8426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:57 smithi179 bash[23186]: audit 2024-09-21T02:08:56.367094+0000 mon.a (mon.0) 8427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:57 smithi049 bash[23528]: audit 2024-09-21T02:08:56.135802+0000 mon.a (mon.0) 8422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:57 smithi049 bash[23528]: audit 2024-09-21T02:08:56.144106+0000 mon.a (mon.0) 8423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:57 smithi049 bash[23528]: audit 2024-09-21T02:08:56.156134+0000 mon.a (mon.0) 8424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:57 smithi049 bash[23528]: cluster 2024-09-21T02:08:56.341308+0000 mgr.a (mgr.14388) 10147 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:08:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:57 smithi049 bash[23528]: audit 2024-09-21T02:08:56.348029+0000 mon.a (mon.0) 8425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:57 smithi049 bash[23528]: audit 2024-09-21T02:08:56.357506+0000 mon.a (mon.0) 8426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:57 smithi049 bash[23528]: audit 2024-09-21T02:08:56.367094+0000 mon.a (mon.0) 8427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:08:57.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:08:57.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:08:57.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:08:57.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:08:57.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:08:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:58 smithi044 bash[22676]: audit 2024-09-21T02:08:57.312755+0000 mgr.a (mgr.14388) 10148 : audit [DBG] from='client.224382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:58 smithi179 bash[23186]: audit 2024-09-21T02:08:57.312755+0000 mgr.a (mgr.14388) 10148 : audit [DBG] from='client.224382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:58 smithi049 bash[23528]: audit 2024-09-21T02:08:57.312755+0000 mgr.a (mgr.14388) 10148 : audit [DBG] from='client.224382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:08:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:08:59 smithi044 bash[22676]: cluster 2024-09-21T02:08:58.342282+0000 mgr.a (mgr.14388) 10149 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:08:59 smithi179 bash[23186]: cluster 2024-09-21T02:08:58.342282+0000 mgr.a (mgr.14388) 10149 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:08:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:08:59 smithi049 bash[23528]: cluster 2024-09-21T02:08:58.342282+0000 mgr.a (mgr.14388) 10149 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:01 smithi044 bash[22676]: cluster 2024-09-21T02:09:00.344744+0000 mgr.a (mgr.14388) 10150 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:01 smithi179 bash[23186]: cluster 2024-09-21T02:09:00.344744+0000 mgr.a (mgr.14388) 10150 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:01 smithi049 bash[23528]: cluster 2024-09-21T02:09:00.344744+0000 mgr.a (mgr.14388) 10150 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:02.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:03.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:03.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:04 smithi049 bash[23528]: cluster 2024-09-21T02:09:02.345539+0000 mgr.a (mgr.14388) 10151 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:04 smithi049 bash[23528]: audit 2024-09-21T02:09:03.011540+0000 mon.a (mon.0) 8428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:04 smithi049 bash[23528]: audit 2024-09-21T02:09:03.019524+0000 mon.a (mon.0) 8429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:04 smithi049 bash[23528]: audit 2024-09-21T02:09:03.030513+0000 mon.a (mon.0) 8430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:04 smithi049 bash[23528]: audit 2024-09-21T02:09:03.081567+0000 mgr.a (mgr.14388) 10152 : audit [DBG] from='client.224460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:04 smithi044 bash[22676]: cluster 2024-09-21T02:09:02.345539+0000 mgr.a (mgr.14388) 10151 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:04 smithi044 bash[22676]: audit 2024-09-21T02:09:03.011540+0000 mon.a (mon.0) 8428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:04 smithi044 bash[22676]: audit 2024-09-21T02:09:03.019524+0000 mon.a (mon.0) 8429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:04 smithi044 bash[22676]: audit 2024-09-21T02:09:03.030513+0000 mon.a (mon.0) 8430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:04 smithi044 bash[22676]: audit 2024-09-21T02:09:03.081567+0000 mgr.a (mgr.14388) 10152 : audit [DBG] from='client.224460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:04 smithi179 bash[23186]: cluster 2024-09-21T02:09:02.345539+0000 mgr.a (mgr.14388) 10151 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:04 smithi179 bash[23186]: audit 2024-09-21T02:09:03.011540+0000 mon.a (mon.0) 8428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:04 smithi179 bash[23186]: audit 2024-09-21T02:09:03.019524+0000 mon.a (mon.0) 8429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:04 smithi179 bash[23186]: audit 2024-09-21T02:09:03.030513+0000 mon.a (mon.0) 8430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:04 smithi179 bash[23186]: audit 2024-09-21T02:09:03.081567+0000 mgr.a (mgr.14388) 10152 : audit [DBG] from='client.224460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:06 smithi049 bash[23528]: cluster 2024-09-21T02:09:04.346481+0000 mgr.a (mgr.14388) 10153 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:06 smithi044 bash[22676]: cluster 2024-09-21T02:09:04.346481+0000 mgr.a (mgr.14388) 10153 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:06 smithi179 bash[23186]: cluster 2024-09-21T02:09:04.346481+0000 mgr.a (mgr.14388) 10153 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:08 smithi049 bash[23528]: cluster 2024-09-21T02:09:06.348747+0000 mgr.a (mgr.14388) 10154 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:08.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:08 smithi179 bash[23186]: cluster 2024-09-21T02:09:06.348747+0000 mgr.a (mgr.14388) 10154 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:08 smithi044 bash[22676]: cluster 2024-09-21T02:09:06.348747+0000 mgr.a (mgr.14388) 10154 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:08.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:08.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:08.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:09.306 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:09.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:09.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:09.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:09.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:10 smithi049 bash[23528]: cluster 2024-09-21T02:09:08.349716+0000 mgr.a (mgr.14388) 10155 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:10 smithi049 bash[23528]: audit 2024-09-21T02:09:08.857349+0000 mgr.a (mgr.14388) 10156 : audit [DBG] from='client.224538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:10 smithi044 bash[22676]: cluster 2024-09-21T02:09:08.349716+0000 mgr.a (mgr.14388) 10155 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:10 smithi044 bash[22676]: audit 2024-09-21T02:09:08.857349+0000 mgr.a (mgr.14388) 10156 : audit [DBG] from='client.224538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:10 smithi179 bash[23186]: cluster 2024-09-21T02:09:08.349716+0000 mgr.a (mgr.14388) 10155 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:10 smithi179 bash[23186]: audit 2024-09-21T02:09:08.857349+0000 mgr.a (mgr.14388) 10156 : audit [DBG] from='client.224538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:12 smithi049 bash[23528]: cluster 2024-09-21T02:09:10.352172+0000 mgr.a (mgr.14388) 10157 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:12 smithi044 bash[22676]: cluster 2024-09-21T02:09:10.352172+0000 mgr.a (mgr.14388) 10157 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:12 smithi179 bash[23186]: cluster 2024-09-21T02:09:10.352172+0000 mgr.a (mgr.14388) 10157 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:14 smithi049 bash[23528]: cluster 2024-09-21T02:09:12.352954+0000 mgr.a (mgr.14388) 10158 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:14.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:14 smithi044 bash[22676]: cluster 2024-09-21T02:09:12.352954+0000 mgr.a (mgr.14388) 10158 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:14 smithi179 bash[23186]: cluster 2024-09-21T02:09:12.352954+0000 mgr.a (mgr.14388) 10158 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:15.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:15.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:15.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:15.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:15.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:16 smithi049 bash[23528]: cluster 2024-09-21T02:09:14.353528+0000 mgr.a (mgr.14388) 10159 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:16 smithi049 bash[23528]: audit 2024-09-21T02:09:14.635881+0000 mgr.a (mgr.14388) 10160 : audit [DBG] from='client.224616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:16.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:16 smithi179 bash[23186]: cluster 2024-09-21T02:09:14.353528+0000 mgr.a (mgr.14388) 10159 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:16.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:16 smithi179 bash[23186]: audit 2024-09-21T02:09:14.635881+0000 mgr.a (mgr.14388) 10160 : audit [DBG] from='client.224616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:16 smithi044 bash[22676]: cluster 2024-09-21T02:09:14.353528+0000 mgr.a (mgr.14388) 10159 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:16 smithi044 bash[22676]: audit 2024-09-21T02:09:14.635881+0000 mgr.a (mgr.14388) 10160 : audit [DBG] from='client.224616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:17 smithi044 bash[22676]: cluster 2024-09-21T02:09:16.355849+0000 mgr.a (mgr.14388) 10161 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:09:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:17 smithi044 bash[22676]: audit 2024-09-21T02:09:16.367040+0000 mon.a (mon.0) 8431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:17 smithi044 bash[22676]: audit 2024-09-21T02:09:16.377262+0000 mon.a (mon.0) 8432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:17 smithi044 bash[22676]: audit 2024-09-21T02:09:16.384716+0000 mon.a (mon.0) 8433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:17 smithi044 bash[22676]: audit 2024-09-21T02:09:16.537190+0000 mon.a (mon.0) 8434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:17 smithi044 bash[22676]: audit 2024-09-21T02:09:16.545420+0000 mon.a (mon.0) 8435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:17 smithi044 bash[22676]: audit 2024-09-21T02:09:16.556850+0000 mon.a (mon.0) 8436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:17 smithi179 bash[23186]: cluster 2024-09-21T02:09:16.355849+0000 mgr.a (mgr.14388) 10161 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:09:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:17 smithi179 bash[23186]: audit 2024-09-21T02:09:16.367040+0000 mon.a (mon.0) 8431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:17 smithi179 bash[23186]: audit 2024-09-21T02:09:16.377262+0000 mon.a (mon.0) 8432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:17 smithi179 bash[23186]: audit 2024-09-21T02:09:16.384716+0000 mon.a (mon.0) 8433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:17 smithi179 bash[23186]: audit 2024-09-21T02:09:16.537190+0000 mon.a (mon.0) 8434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:17 smithi179 bash[23186]: audit 2024-09-21T02:09:16.545420+0000 mon.a (mon.0) 8435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:17 smithi179 bash[23186]: audit 2024-09-21T02:09:16.556850+0000 mon.a (mon.0) 8436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:17 smithi049 bash[23528]: cluster 2024-09-21T02:09:16.355849+0000 mgr.a (mgr.14388) 10161 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:09:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:17 smithi049 bash[23528]: audit 2024-09-21T02:09:16.367040+0000 mon.a (mon.0) 8431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:17 smithi049 bash[23528]: audit 2024-09-21T02:09:16.377262+0000 mon.a (mon.0) 8432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:17 smithi049 bash[23528]: audit 2024-09-21T02:09:16.384716+0000 mon.a (mon.0) 8433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:17 smithi049 bash[23528]: audit 2024-09-21T02:09:16.537190+0000 mon.a (mon.0) 8434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:17 smithi049 bash[23528]: audit 2024-09-21T02:09:16.545420+0000 mon.a (mon.0) 8435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:17 smithi049 bash[23528]: audit 2024-09-21T02:09:16.556850+0000 mon.a (mon.0) 8436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:19 smithi044 bash[22676]: cluster 2024-09-21T02:09:18.356635+0000 mgr.a (mgr.14388) 10162 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:09:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:19 smithi179 bash[23186]: cluster 2024-09-21T02:09:18.356635+0000 mgr.a (mgr.14388) 10162 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:09:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:19 smithi049 bash[23528]: cluster 2024-09-21T02:09:18.356635+0000 mgr.a (mgr.14388) 10162 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:09:20.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:20.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:20.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:20.816 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:20.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:20.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:21 smithi044 bash[22676]: cluster 2024-09-21T02:09:20.357818+0000 mgr.a (mgr.14388) 10163 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:21 smithi044 bash[22676]: audit 2024-09-21T02:09:20.400868+0000 mgr.a (mgr.14388) 10164 : audit [DBG] from='client.224694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:21 smithi179 bash[23186]: cluster 2024-09-21T02:09:20.357818+0000 mgr.a (mgr.14388) 10163 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:21 smithi179 bash[23186]: audit 2024-09-21T02:09:20.400868+0000 mgr.a (mgr.14388) 10164 : audit [DBG] from='client.224694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:21 smithi049 bash[23528]: cluster 2024-09-21T02:09:20.357818+0000 mgr.a (mgr.14388) 10163 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:21 smithi049 bash[23528]: audit 2024-09-21T02:09:20.400868+0000 mgr.a (mgr.14388) 10164 : audit [DBG] from='client.224694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:23 smithi049 bash[23528]: cluster 2024-09-21T02:09:22.358717+0000 mgr.a (mgr.14388) 10165 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:09:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:23 smithi049 bash[23528]: audit 2024-09-21T02:09:23.239301+0000 mon.a (mon.0) 8437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:23 smithi049 bash[23528]: audit 2024-09-21T02:09:23.246437+0000 mon.a (mon.0) 8438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:23 smithi049 bash[23528]: audit 2024-09-21T02:09:23.255157+0000 mon.a (mon.0) 8439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:23 smithi044 bash[22676]: cluster 2024-09-21T02:09:22.358717+0000 mgr.a (mgr.14388) 10165 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:09:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:23 smithi044 bash[22676]: audit 2024-09-21T02:09:23.239301+0000 mon.a (mon.0) 8437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:23 smithi044 bash[22676]: audit 2024-09-21T02:09:23.246437+0000 mon.a (mon.0) 8438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:23 smithi044 bash[22676]: audit 2024-09-21T02:09:23.255157+0000 mon.a (mon.0) 8439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:23 smithi179 bash[23186]: cluster 2024-09-21T02:09:22.358717+0000 mgr.a (mgr.14388) 10165 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:09:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:23 smithi179 bash[23186]: audit 2024-09-21T02:09:23.239301+0000 mon.a (mon.0) 8437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:23 smithi179 bash[23186]: audit 2024-09-21T02:09:23.246437+0000 mon.a (mon.0) 8438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:23 smithi179 bash[23186]: audit 2024-09-21T02:09:23.255157+0000 mon.a (mon.0) 8439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:25 smithi044 bash[22676]: cluster 2024-09-21T02:09:24.359496+0000 mgr.a (mgr.14388) 10166 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:09:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:25 smithi179 bash[23186]: cluster 2024-09-21T02:09:24.359496+0000 mgr.a (mgr.14388) 10166 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:09:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:25 smithi049 bash[23528]: cluster 2024-09-21T02:09:24.359496+0000 mgr.a (mgr.14388) 10166 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:09:25.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:25.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:25.819 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:26.594 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:27 smithi044 bash[22676]: audit 2024-09-21T02:09:26.157020+0000 mgr.a (mgr.14388) 10167 : audit [DBG] from='client.224769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:27 smithi044 bash[22676]: cluster 2024-09-21T02:09:26.361096+0000 mgr.a (mgr.14388) 10168 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:27 smithi179 bash[23186]: audit 2024-09-21T02:09:26.157020+0000 mgr.a (mgr.14388) 10167 : audit [DBG] from='client.224769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:27 smithi179 bash[23186]: cluster 2024-09-21T02:09:26.361096+0000 mgr.a (mgr.14388) 10168 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:27 smithi049 bash[23528]: audit 2024-09-21T02:09:26.157020+0000 mgr.a (mgr.14388) 10167 : audit [DBG] from='client.224769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:27 smithi049 bash[23528]: cluster 2024-09-21T02:09:26.361096+0000 mgr.a (mgr.14388) 10168 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:29 smithi049 bash[23528]: cluster 2024-09-21T02:09:28.361715+0000 mgr.a (mgr.14388) 10169 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:09:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:29 smithi044 bash[22676]: cluster 2024-09-21T02:09:28.361715+0000 mgr.a (mgr.14388) 10169 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:09:29.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:29 smithi179 bash[23186]: cluster 2024-09-21T02:09:28.361715+0000 mgr.a (mgr.14388) 10169 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:09:31.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:31.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:31.598 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:31.724 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:31 smithi049 bash[23528]: cluster 2024-09-21T02:09:30.363932+0000 mgr.a (mgr.14388) 10170 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:09:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:31 smithi044 bash[22676]: cluster 2024-09-21T02:09:30.363932+0000 mgr.a (mgr.14388) 10170 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:09:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:31 smithi179 bash[23186]: cluster 2024-09-21T02:09:30.363932+0000 mgr.a (mgr.14388) 10170 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:09:32.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:32.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:32.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:32.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:32.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:32 smithi044 bash[22676]: audit 2024-09-21T02:09:31.931508+0000 mgr.a (mgr.14388) 10171 : audit [DBG] from='client.224847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:32 smithi179 bash[23186]: audit 2024-09-21T02:09:31.931508+0000 mgr.a (mgr.14388) 10171 : audit [DBG] from='client.224847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:32 smithi049 bash[23528]: audit 2024-09-21T02:09:31.931508+0000 mgr.a (mgr.14388) 10171 : audit [DBG] from='client.224847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:33 smithi044 bash[22676]: cluster 2024-09-21T02:09:32.364473+0000 mgr.a (mgr.14388) 10172 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:33 smithi179 bash[23186]: cluster 2024-09-21T02:09:32.364473+0000 mgr.a (mgr.14388) 10172 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:33 smithi049 bash[23528]: cluster 2024-09-21T02:09:32.364473+0000 mgr.a (mgr.14388) 10172 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:35 smithi044 bash[22676]: cluster 2024-09-21T02:09:34.365219+0000 mgr.a (mgr.14388) 10173 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:35 smithi179 bash[23186]: cluster 2024-09-21T02:09:34.365219+0000 mgr.a (mgr.14388) 10173 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:35 smithi049 bash[23528]: cluster 2024-09-21T02:09:34.365219+0000 mgr.a (mgr.14388) 10173 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:37.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:37.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:37.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:37 smithi044 bash[22676]: cluster 2024-09-21T02:09:36.367451+0000 mgr.a (mgr.14388) 10174 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:37 smithi044 bash[22676]: audit 2024-09-21T02:09:36.590505+0000 mon.a (mon.0) 8440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:37 smithi044 bash[22676]: audit 2024-09-21T02:09:36.598432+0000 mon.a (mon.0) 8441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:37 smithi044 bash[22676]: audit 2024-09-21T02:09:36.606395+0000 mon.a (mon.0) 8442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:37 smithi044 bash[22676]: audit 2024-09-21T02:09:36.783458+0000 mon.a (mon.0) 8443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:37 smithi044 bash[22676]: audit 2024-09-21T02:09:36.791920+0000 mon.a (mon.0) 8444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:37 smithi044 bash[22676]: audit 2024-09-21T02:09:36.802122+0000 mon.a (mon.0) 8445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:37 smithi179 bash[23186]: cluster 2024-09-21T02:09:36.367451+0000 mgr.a (mgr.14388) 10174 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:37 smithi179 bash[23186]: audit 2024-09-21T02:09:36.590505+0000 mon.a (mon.0) 8440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:37 smithi179 bash[23186]: audit 2024-09-21T02:09:36.598432+0000 mon.a (mon.0) 8441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:37 smithi179 bash[23186]: audit 2024-09-21T02:09:36.606395+0000 mon.a (mon.0) 8442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:37 smithi179 bash[23186]: audit 2024-09-21T02:09:36.783458+0000 mon.a (mon.0) 8443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:37 smithi179 bash[23186]: audit 2024-09-21T02:09:36.791920+0000 mon.a (mon.0) 8444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:37 smithi179 bash[23186]: audit 2024-09-21T02:09:36.802122+0000 mon.a (mon.0) 8445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:37 smithi049 bash[23528]: cluster 2024-09-21T02:09:36.367451+0000 mgr.a (mgr.14388) 10174 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:37 smithi049 bash[23528]: audit 2024-09-21T02:09:36.590505+0000 mon.a (mon.0) 8440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:37 smithi049 bash[23528]: audit 2024-09-21T02:09:36.598432+0000 mon.a (mon.0) 8441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:37 smithi049 bash[23528]: audit 2024-09-21T02:09:36.606395+0000 mon.a (mon.0) 8442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:37 smithi049 bash[23528]: audit 2024-09-21T02:09:36.783458+0000 mon.a (mon.0) 8443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:37 smithi049 bash[23528]: audit 2024-09-21T02:09:36.791920+0000 mon.a (mon.0) 8444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:37 smithi049 bash[23528]: audit 2024-09-21T02:09:36.802122+0000 mon.a (mon.0) 8445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:38.166 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:38.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:38.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:38.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:38.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:38 smithi044 bash[22676]: audit 2024-09-21T02:09:37.716104+0000 mgr.a (mgr.14388) 10175 : audit [DBG] from='client.224925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:39.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:38 smithi179 bash[23186]: audit 2024-09-21T02:09:37.716104+0000 mgr.a (mgr.14388) 10175 : audit [DBG] from='client.224925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:39.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:38 smithi049 bash[23528]: audit 2024-09-21T02:09:37.716104+0000 mgr.a (mgr.14388) 10175 : audit [DBG] from='client.224925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:39 smithi044 bash[22676]: cluster 2024-09-21T02:09:38.368390+0000 mgr.a (mgr.14388) 10176 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:39 smithi179 bash[23186]: cluster 2024-09-21T02:09:38.368390+0000 mgr.a (mgr.14388) 10176 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:39 smithi049 bash[23528]: cluster 2024-09-21T02:09:38.368390+0000 mgr.a (mgr.14388) 10176 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:40.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22930]: debug 2024-09-21T02:09:40.792+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:09:40.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22930]: debug 2024-09-21T02:09:40.796+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22676]: audit 2024-09-21T02:09:39.988288+0000 mon.a (mon.0) 8446 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22676]: audit 2024-09-21T02:09:39.999780+0000 mon.a (mon.0) 8447 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22676]: audit 2024-09-21T02:09:40.001636+0000 mon.a (mon.0) 8448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22676]: audit 2024-09-21T02:09:40.013446+0000 mon.a (mon.0) 8449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22676]: audit 2024-09-21T02:09:40.020750+0000 mon.a (mon.0) 8450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:09:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:40 smithi044 bash[22676]: audit 2024-09-21T02:09:40.023161+0000 mgr.a (mgr.14388) 10177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:09:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:40 smithi179 bash[23186]: audit 2024-09-21T02:09:39.988288+0000 mon.a (mon.0) 8446 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:09:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:40 smithi179 bash[23186]: audit 2024-09-21T02:09:39.999780+0000 mon.a (mon.0) 8447 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:09:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:40 smithi179 bash[23186]: audit 2024-09-21T02:09:40.001636+0000 mon.a (mon.0) 8448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:09:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:40 smithi179 bash[23186]: audit 2024-09-21T02:09:40.013446+0000 mon.a (mon.0) 8449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:40 smithi179 bash[23186]: audit 2024-09-21T02:09:40.020750+0000 mon.a (mon.0) 8450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:09:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:40 smithi179 bash[23186]: audit 2024-09-21T02:09:40.023161+0000 mgr.a (mgr.14388) 10177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:40 smithi049 bash[23528]: audit 2024-09-21T02:09:39.988288+0000 mon.a (mon.0) 8446 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:40 smithi049 bash[23528]: audit 2024-09-21T02:09:39.999780+0000 mon.a (mon.0) 8447 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:40 smithi049 bash[23528]: audit 2024-09-21T02:09:40.001636+0000 mon.a (mon.0) 8448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:40 smithi049 bash[23528]: audit 2024-09-21T02:09:40.013446+0000 mon.a (mon.0) 8449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:40 smithi049 bash[23528]: audit 2024-09-21T02:09:40.020750+0000 mon.a (mon.0) 8450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:40 smithi049 bash[23528]: audit 2024-09-21T02:09:40.023161+0000 mgr.a (mgr.14388) 10177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:09:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:42 smithi049 bash[23528]: cluster 2024-09-21T02:09:40.369711+0000 mgr.a (mgr.14388) 10178 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:42 smithi049 bash[23528]: audit 2024-09-21T02:09:40.796873+0000 mgr.a (mgr.14388) 10179 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:09:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:42 smithi049 bash[23528]: cephadm 2024-09-21T02:09:40.798212+0000 mgr.a (mgr.14388) 10180 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:09:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:42 smithi044 bash[22676]: cluster 2024-09-21T02:09:40.369711+0000 mgr.a (mgr.14388) 10178 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:42 smithi044 bash[22676]: audit 2024-09-21T02:09:40.796873+0000 mgr.a (mgr.14388) 10179 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:09:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:42 smithi044 bash[22676]: cephadm 2024-09-21T02:09:40.798212+0000 mgr.a (mgr.14388) 10180 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:09:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:42 smithi179 bash[23186]: cluster 2024-09-21T02:09:40.369711+0000 mgr.a (mgr.14388) 10178 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:09:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:42 smithi179 bash[23186]: audit 2024-09-21T02:09:40.796873+0000 mgr.a (mgr.14388) 10179 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:09:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:42 smithi179 bash[23186]: cephadm 2024-09-21T02:09:40.798212+0000 mgr.a (mgr.14388) 10180 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:09:43.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:43.921 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:44 smithi049 bash[23528]: cluster 2024-09-21T02:09:42.370614+0000 mgr.a (mgr.14388) 10181 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:44 smithi049 bash[23528]: audit 2024-09-21T02:09:43.471971+0000 mon.a (mon.0) 8451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:44 smithi049 bash[23528]: audit 2024-09-21T02:09:43.479744+0000 mon.a (mon.0) 8452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:44 smithi049 bash[23528]: audit 2024-09-21T02:09:43.490936+0000 mon.a (mon.0) 8453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:44 smithi044 bash[22676]: cluster 2024-09-21T02:09:42.370614+0000 mgr.a (mgr.14388) 10181 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:44 smithi044 bash[22676]: audit 2024-09-21T02:09:43.471971+0000 mon.a (mon.0) 8451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:44 smithi044 bash[22676]: audit 2024-09-21T02:09:43.479744+0000 mon.a (mon.0) 8452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:44 smithi044 bash[22676]: audit 2024-09-21T02:09:43.490936+0000 mon.a (mon.0) 8453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:44 smithi179 bash[23186]: cluster 2024-09-21T02:09:42.370614+0000 mgr.a (mgr.14388) 10181 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:44 smithi179 bash[23186]: audit 2024-09-21T02:09:43.471971+0000 mon.a (mon.0) 8451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:44 smithi179 bash[23186]: audit 2024-09-21T02:09:43.479744+0000 mon.a (mon.0) 8452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:44 smithi179 bash[23186]: audit 2024-09-21T02:09:43.490936+0000 mon.a (mon.0) 8453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:45 smithi049 bash[23528]: audit 2024-09-21T02:09:43.506181+0000 mgr.a (mgr.14388) 10182 : audit [DBG] from='client.225105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:45.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:45 smithi044 bash[22676]: audit 2024-09-21T02:09:43.506181+0000 mgr.a (mgr.14388) 10182 : audit [DBG] from='client.225105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:45 smithi179 bash[23186]: audit 2024-09-21T02:09:43.506181+0000 mgr.a (mgr.14388) 10182 : audit [DBG] from='client.225105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:46 smithi049 bash[23528]: cluster 2024-09-21T02:09:44.371590+0000 mgr.a (mgr.14388) 10183 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:46 smithi044 bash[22676]: cluster 2024-09-21T02:09:44.371590+0000 mgr.a (mgr.14388) 10183 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:46 smithi179 bash[23186]: cluster 2024-09-21T02:09:44.371590+0000 mgr.a (mgr.14388) 10183 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:09:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:48 smithi049 bash[23528]: cluster 2024-09-21T02:09:46.373927+0000 mgr.a (mgr.14388) 10184 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:48.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:48 smithi179 bash[23186]: cluster 2024-09-21T02:09:46.373927+0000 mgr.a (mgr.14388) 10184 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:48 smithi044 bash[22676]: cluster 2024-09-21T02:09:46.373927+0000 mgr.a (mgr.14388) 10184 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:48.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:48.923 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:48.923 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:49.682 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:50 smithi049 bash[23528]: cluster 2024-09-21T02:09:48.374739+0000 mgr.a (mgr.14388) 10185 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:50 smithi044 bash[22676]: cluster 2024-09-21T02:09:48.374739+0000 mgr.a (mgr.14388) 10185 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:50 smithi179 bash[23186]: cluster 2024-09-21T02:09:48.374739+0000 mgr.a (mgr.14388) 10185 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:51 smithi179 bash[23186]: audit 2024-09-21T02:09:49.257904+0000 mgr.a (mgr.14388) 10186 : audit [DBG] from='client.225180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:51 smithi049 bash[23528]: audit 2024-09-21T02:09:49.257904+0000 mgr.a (mgr.14388) 10186 : audit [DBG] from='client.225180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:51 smithi044 bash[22676]: audit 2024-09-21T02:09:49.257904+0000 mgr.a (mgr.14388) 10186 : audit [DBG] from='client.225180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:52 smithi049 bash[23528]: cluster 2024-09-21T02:09:50.377205+0000 mgr.a (mgr.14388) 10187 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:52 smithi044 bash[22676]: cluster 2024-09-21T02:09:50.377205+0000 mgr.a (mgr.14388) 10187 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:52 smithi179 bash[23186]: cluster 2024-09-21T02:09:50.377205+0000 mgr.a (mgr.14388) 10187 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:54 smithi049 bash[23528]: cluster 2024-09-21T02:09:52.377997+0000 mgr.a (mgr.14388) 10188 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:54 smithi044 bash[22676]: cluster 2024-09-21T02:09:52.377997+0000 mgr.a (mgr.14388) 10188 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:54 smithi179 bash[23186]: cluster 2024-09-21T02:09:52.377997+0000 mgr.a (mgr.14388) 10188 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:54.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:09:54.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:09:54.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:09:55.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:09:55.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:09:55.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:09:55.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:09:55.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:09:56.475 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:56 smithi049 bash[23528]: cluster 2024-09-21T02:09:54.378789+0000 mgr.a (mgr.14388) 10189 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:56.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:56 smithi049 bash[23528]: audit 2024-09-21T02:09:55.022388+0000 mgr.a (mgr.14388) 10190 : audit [DBG] from='client.225255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:56 smithi044 bash[22676]: cluster 2024-09-21T02:09:54.378789+0000 mgr.a (mgr.14388) 10189 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:56 smithi044 bash[22676]: audit 2024-09-21T02:09:55.022388+0000 mgr.a (mgr.14388) 10190 : audit [DBG] from='client.225255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:56 smithi179 bash[23186]: cluster 2024-09-21T02:09:54.378789+0000 mgr.a (mgr.14388) 10189 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:56 smithi179 bash[23186]: audit 2024-09-21T02:09:55.022388+0000 mgr.a (mgr.14388) 10190 : audit [DBG] from='client.225255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:09:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:57 smithi044 bash[22676]: cluster 2024-09-21T02:09:56.381578+0000 mgr.a (mgr.14388) 10191 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:57 smithi044 bash[22676]: audit 2024-09-21T02:09:56.820038+0000 mon.a (mon.0) 8454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:57 smithi044 bash[22676]: audit 2024-09-21T02:09:56.826301+0000 mon.a (mon.0) 8455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:57 smithi044 bash[22676]: audit 2024-09-21T02:09:56.833524+0000 mon.a (mon.0) 8456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:57 smithi044 bash[22676]: audit 2024-09-21T02:09:57.018054+0000 mon.a (mon.0) 8457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:57 smithi044 bash[22676]: audit 2024-09-21T02:09:57.026566+0000 mon.a (mon.0) 8458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:57 smithi044 bash[22676]: audit 2024-09-21T02:09:57.036911+0000 mon.a (mon.0) 8459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:57 smithi179 bash[23186]: cluster 2024-09-21T02:09:56.381578+0000 mgr.a (mgr.14388) 10191 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:09:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:57 smithi179 bash[23186]: audit 2024-09-21T02:09:56.820038+0000 mon.a (mon.0) 8454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:57 smithi179 bash[23186]: audit 2024-09-21T02:09:56.826301+0000 mon.a (mon.0) 8455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:57 smithi179 bash[23186]: audit 2024-09-21T02:09:56.833524+0000 mon.a (mon.0) 8456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:09:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:57 smithi179 bash[23186]: audit 2024-09-21T02:09:57.018054+0000 mon.a (mon.0) 8457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.133 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:57 smithi179 bash[23186]: audit 2024-09-21T02:09:57.026566+0000 mon.a (mon.0) 8458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.133 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:57 smithi179 bash[23186]: audit 2024-09-21T02:09:57.036911+0000 mon.a (mon.0) 8459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.135 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:09:59 smithi044 bash[22676]: cluster 2024-09-21T02:09:58.382354+0000 mgr.a (mgr.14388) 10192 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:05.137 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:09:59 smithi179 bash[23186]: cluster 2024-09-21T02:09:58.382354+0000 mgr.a (mgr.14388) 10192 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:05.137 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:00 smithi179 bash[23186]: cluster 2024-09-21T02:10:00.000148+0000 mon.a (mon.0) 8460 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:10:05.137 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:01 smithi179 bash[23186]: cluster 2024-09-21T02:10:00.384266+0000 mgr.a (mgr.14388) 10193 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:05.137 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:01 smithi179 bash[23186]: audit 2024-09-21T02:10:00.792118+0000 mgr.a (mgr.14388) 10194 : audit [DBG] from='client.225330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:05.138 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:03 smithi179 bash[23186]: cluster 2024-09-21T02:10:02.385179+0000 mgr.a (mgr.14388) 10195 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:05.138 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:03 smithi179 bash[23186]: audit 2024-09-21T02:10:03.692130+0000 mon.a (mon.0) 8461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.138 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:03 smithi179 bash[23186]: audit 2024-09-21T02:10:03.700980+0000 mon.a (mon.0) 8462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.138 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:03 smithi179 bash[23186]: audit 2024-09-21T02:10:03.711000+0000 mon.a (mon.0) 8463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:05.138 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:05.140 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:57 smithi049 bash[23528]: cluster 2024-09-21T02:09:56.381578+0000 mgr.a (mgr.14388) 10191 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:05.140 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:57 smithi049 bash[23528]: audit 2024-09-21T02:09:56.820038+0000 mon.a (mon.0) 8454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.140 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:57 smithi049 bash[23528]: audit 2024-09-21T02:09:56.826301+0000 mon.a (mon.0) 8455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.140 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:57 smithi049 bash[23528]: audit 2024-09-21T02:09:56.833524+0000 mon.a (mon.0) 8456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.140 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:57 smithi049 bash[23528]: audit 2024-09-21T02:09:57.018054+0000 mon.a (mon.0) 8457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.140 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:57 smithi049 bash[23528]: audit 2024-09-21T02:09:57.026566+0000 mon.a (mon.0) 8458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.141 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:57 smithi049 bash[23528]: audit 2024-09-21T02:09:57.036911+0000 mon.a (mon.0) 8459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.141 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:09:59 smithi049 bash[23528]: cluster 2024-09-21T02:09:58.382354+0000 mgr.a (mgr.14388) 10192 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:05.141 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:00 smithi049 bash[23528]: cluster 2024-09-21T02:10:00.000148+0000 mon.a (mon.0) 8460 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:10:05.141 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:01 smithi049 bash[23528]: cluster 2024-09-21T02:10:00.384266+0000 mgr.a (mgr.14388) 10193 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:05.141 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:01 smithi049 bash[23528]: audit 2024-09-21T02:10:00.792118+0000 mgr.a (mgr.14388) 10194 : audit [DBG] from='client.225330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:05.141 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:03 smithi049 bash[23528]: cluster 2024-09-21T02:10:02.385179+0000 mgr.a (mgr.14388) 10195 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:05.141 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:03 smithi049 bash[23528]: audit 2024-09-21T02:10:03.692130+0000 mon.a (mon.0) 8461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.142 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:03 smithi049 bash[23528]: audit 2024-09-21T02:10:03.700980+0000 mon.a (mon.0) 8462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.142 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:03 smithi049 bash[23528]: audit 2024-09-21T02:10:03.711000+0000 mon.a (mon.0) 8463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.142 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:05.143 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:00 smithi044 bash[22676]: cluster 2024-09-21T02:10:00.000148+0000 mon.a (mon.0) 8460 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:10:05.143 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:01 smithi044 bash[22676]: cluster 2024-09-21T02:10:00.384266+0000 mgr.a (mgr.14388) 10193 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:05.143 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:01 smithi044 bash[22676]: audit 2024-09-21T02:10:00.792118+0000 mgr.a (mgr.14388) 10194 : audit [DBG] from='client.225330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:05.143 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:03 smithi044 bash[22676]: cluster 2024-09-21T02:10:02.385179+0000 mgr.a (mgr.14388) 10195 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:05.143 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:03 smithi044 bash[22676]: audit 2024-09-21T02:10:03.692130+0000 mon.a (mon.0) 8461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.144 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:03 smithi044 bash[22676]: audit 2024-09-21T02:10:03.700980+0000 mon.a (mon.0) 8462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:05.144 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:03 smithi044 bash[22676]: audit 2024-09-21T02:10:03.711000+0000 mon.a (mon.0) 8463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:06.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:06.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:06.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:05 smithi044 bash[22676]: cluster 2024-09-21T02:10:04.386006+0000 mgr.a (mgr.14388) 10196 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:10:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:05 smithi179 bash[23186]: cluster 2024-09-21T02:10:04.386006+0000 mgr.a (mgr.14388) 10196 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:10:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:05 smithi049 bash[23528]: cluster 2024-09-21T02:10:04.386006+0000 mgr.a (mgr.14388) 10196 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:10:06.994 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:06.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:06.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:06.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:06.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:07 smithi179 bash[23186]: cluster 2024-09-21T02:10:06.387999+0000 mgr.a (mgr.14388) 10197 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:07 smithi179 bash[23186]: audit 2024-09-21T02:10:06.558463+0000 mgr.a (mgr.14388) 10198 : audit [DBG] from='client.225408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:07 smithi044 bash[22676]: cluster 2024-09-21T02:10:06.387999+0000 mgr.a (mgr.14388) 10197 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:07 smithi044 bash[22676]: audit 2024-09-21T02:10:06.558463+0000 mgr.a (mgr.14388) 10198 : audit [DBG] from='client.225408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:07 smithi049 bash[23528]: cluster 2024-09-21T02:10:06.387999+0000 mgr.a (mgr.14388) 10197 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:07 smithi049 bash[23528]: audit 2024-09-21T02:10:06.558463+0000 mgr.a (mgr.14388) 10198 : audit [DBG] from='client.225408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:10.017 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:09 smithi049 bash[23528]: cluster 2024-09-21T02:10:08.389070+0000 mgr.a (mgr.14388) 10199 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:09 smithi044 bash[22676]: cluster 2024-09-21T02:10:08.389070+0000 mgr.a (mgr.14388) 10199 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:09 smithi179 bash[23186]: cluster 2024-09-21T02:10:08.389070+0000 mgr.a (mgr.14388) 10199 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:11.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:11.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:11.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:11 smithi049 bash[23528]: cluster 2024-09-21T02:10:10.391398+0000 mgr.a (mgr.14388) 10200 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:11 smithi044 bash[22676]: cluster 2024-09-21T02:10:10.391398+0000 mgr.a (mgr.14388) 10200 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:11 smithi179 bash[23186]: cluster 2024-09-21T02:10:10.391398+0000 mgr.a (mgr.14388) 10200 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:12.757 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:12.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:12.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:12.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:12.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:13 smithi044 bash[22676]: audit 2024-09-21T02:10:12.332594+0000 mgr.a (mgr.14388) 10201 : audit [DBG] from='client.225486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:13 smithi044 bash[22676]: cluster 2024-09-21T02:10:12.392461+0000 mgr.a (mgr.14388) 10202 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:13 smithi179 bash[23186]: audit 2024-09-21T02:10:12.332594+0000 mgr.a (mgr.14388) 10201 : audit [DBG] from='client.225486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:13 smithi179 bash[23186]: cluster 2024-09-21T02:10:12.392461+0000 mgr.a (mgr.14388) 10202 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:13 smithi049 bash[23528]: audit 2024-09-21T02:10:12.332594+0000 mgr.a (mgr.14388) 10201 : audit [DBG] from='client.225486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:13 smithi049 bash[23528]: cluster 2024-09-21T02:10:12.392461+0000 mgr.a (mgr.14388) 10202 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:15 smithi044 bash[22676]: cluster 2024-09-21T02:10:14.393456+0000 mgr.a (mgr.14388) 10203 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:15 smithi179 bash[23186]: cluster 2024-09-21T02:10:14.393456+0000 mgr.a (mgr.14388) 10203 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:15 smithi049 bash[23528]: cluster 2024-09-21T02:10:14.393456+0000 mgr.a (mgr.14388) 10203 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:18 smithi049 bash[23528]: cluster 2024-09-21T02:10:16.395692+0000 mgr.a (mgr.14388) 10204 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:18 smithi049 bash[23528]: audit 2024-09-21T02:10:17.010828+0000 mon.a (mon.0) 8464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:18 smithi049 bash[23528]: audit 2024-09-21T02:10:17.019703+0000 mon.a (mon.0) 8465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:18 smithi049 bash[23528]: audit 2024-09-21T02:10:17.030330+0000 mon.a (mon.0) 8466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:18 smithi049 bash[23528]: audit 2024-09-21T02:10:17.224711+0000 mon.a (mon.0) 8467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:18 smithi049 bash[23528]: audit 2024-09-21T02:10:17.232722+0000 mon.a (mon.0) 8468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:18 smithi049 bash[23528]: audit 2024-09-21T02:10:17.243349+0000 mon.a (mon.0) 8469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:18 smithi044 bash[22676]: cluster 2024-09-21T02:10:16.395692+0000 mgr.a (mgr.14388) 10204 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:18 smithi044 bash[22676]: audit 2024-09-21T02:10:17.010828+0000 mon.a (mon.0) 8464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:18 smithi044 bash[22676]: audit 2024-09-21T02:10:17.019703+0000 mon.a (mon.0) 8465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:18 smithi044 bash[22676]: audit 2024-09-21T02:10:17.030330+0000 mon.a (mon.0) 8466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:18 smithi044 bash[22676]: audit 2024-09-21T02:10:17.224711+0000 mon.a (mon.0) 8467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:18 smithi044 bash[22676]: audit 2024-09-21T02:10:17.232722+0000 mon.a (mon.0) 8468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:18 smithi044 bash[22676]: audit 2024-09-21T02:10:17.243349+0000 mon.a (mon.0) 8469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:18 smithi179 bash[23186]: cluster 2024-09-21T02:10:16.395692+0000 mgr.a (mgr.14388) 10204 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:18 smithi179 bash[23186]: audit 2024-09-21T02:10:17.010828+0000 mon.a (mon.0) 8464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:18 smithi179 bash[23186]: audit 2024-09-21T02:10:17.019703+0000 mon.a (mon.0) 8465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:18 smithi179 bash[23186]: audit 2024-09-21T02:10:17.030330+0000 mon.a (mon.0) 8466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:18 smithi179 bash[23186]: audit 2024-09-21T02:10:17.224711+0000 mon.a (mon.0) 8467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:18 smithi179 bash[23186]: audit 2024-09-21T02:10:17.232722+0000 mon.a (mon.0) 8468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:18 smithi179 bash[23186]: audit 2024-09-21T02:10:17.243349+0000 mon.a (mon.0) 8469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:18.523 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:19 smithi049 bash[23528]: audit 2024-09-21T02:10:18.088202+0000 mgr.a (mgr.14388) 10205 : audit [DBG] from='client.225564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:19 smithi044 bash[22676]: audit 2024-09-21T02:10:18.088202+0000 mgr.a (mgr.14388) 10205 : audit [DBG] from='client.225564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:19 smithi179 bash[23186]: audit 2024-09-21T02:10:18.088202+0000 mgr.a (mgr.14388) 10205 : audit [DBG] from='client.225564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:20 smithi049 bash[23528]: cluster 2024-09-21T02:10:18.396278+0000 mgr.a (mgr.14388) 10206 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:20 smithi044 bash[22676]: cluster 2024-09-21T02:10:18.396278+0000 mgr.a (mgr.14388) 10206 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:20 smithi179 bash[23186]: cluster 2024-09-21T02:10:18.396278+0000 mgr.a (mgr.14388) 10206 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:22 smithi049 bash[23528]: cluster 2024-09-21T02:10:20.398620+0000 mgr.a (mgr.14388) 10207 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:22 smithi044 bash[22676]: cluster 2024-09-21T02:10:20.398620+0000 mgr.a (mgr.14388) 10207 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:22 smithi179 bash[23186]: cluster 2024-09-21T02:10:20.398620+0000 mgr.a (mgr.14388) 10207 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:23.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:23.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:24 smithi044 bash[22676]: cluster 2024-09-21T02:10:22.399362+0000 mgr.a (mgr.14388) 10208 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:24 smithi044 bash[22676]: audit 2024-09-21T02:10:23.870054+0000 mon.a (mon.0) 8470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:24 smithi044 bash[22676]: audit 2024-09-21T02:10:23.885057+0000 mon.a (mon.0) 8471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:24 smithi044 bash[22676]: audit 2024-09-21T02:10:23.891476+0000 mon.a (mon.0) 8472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:24 smithi049 bash[23528]: cluster 2024-09-21T02:10:22.399362+0000 mgr.a (mgr.14388) 10208 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:24 smithi049 bash[23528]: audit 2024-09-21T02:10:23.870054+0000 mon.a (mon.0) 8470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:24 smithi049 bash[23528]: audit 2024-09-21T02:10:23.885057+0000 mon.a (mon.0) 8471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:24 smithi049 bash[23528]: audit 2024-09-21T02:10:23.891476+0000 mon.a (mon.0) 8472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.310 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:24.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:24.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:24.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:24.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:24 smithi179 bash[23186]: cluster 2024-09-21T02:10:22.399362+0000 mgr.a (mgr.14388) 10208 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:24 smithi179 bash[23186]: audit 2024-09-21T02:10:23.870054+0000 mon.a (mon.0) 8470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:24 smithi179 bash[23186]: audit 2024-09-21T02:10:23.885057+0000 mon.a (mon.0) 8471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:24 smithi179 bash[23186]: audit 2024-09-21T02:10:23.891476+0000 mon.a (mon.0) 8472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:25 smithi044 bash[22676]: audit 2024-09-21T02:10:23.868476+0000 mgr.a (mgr.14388) 10209 : audit [DBG] from='client.225639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:25 smithi049 bash[23528]: audit 2024-09-21T02:10:23.868476+0000 mgr.a (mgr.14388) 10209 : audit [DBG] from='client.225639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:25 smithi179 bash[23186]: audit 2024-09-21T02:10:23.868476+0000 mgr.a (mgr.14388) 10209 : audit [DBG] from='client.225639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:26 smithi049 bash[23528]: cluster 2024-09-21T02:10:24.400345+0000 mgr.a (mgr.14388) 10210 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:26 smithi044 bash[22676]: cluster 2024-09-21T02:10:24.400345+0000 mgr.a (mgr.14388) 10210 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:26 smithi179 bash[23186]: cluster 2024-09-21T02:10:24.400345+0000 mgr.a (mgr.14388) 10210 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:28 smithi179 bash[23186]: cluster 2024-09-21T02:10:26.402678+0000 mgr.a (mgr.14388) 10211 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:28 smithi049 bash[23528]: cluster 2024-09-21T02:10:26.402678+0000 mgr.a (mgr.14388) 10211 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:28 smithi044 bash[22676]: cluster 2024-09-21T02:10:26.402678+0000 mgr.a (mgr.14388) 10211 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:10:29.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:29.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:29.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:29 smithi179 bash[23186]: cluster 2024-09-21T02:10:28.403494+0000 mgr.a (mgr.14388) 10212 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:29 smithi049 bash[23528]: cluster 2024-09-21T02:10:28.403494+0000 mgr.a (mgr.14388) 10212 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:29 smithi044 bash[22676]: cluster 2024-09-21T02:10:28.403494+0000 mgr.a (mgr.14388) 10212 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:30.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:30.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:30.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:30.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:30.539 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:30 smithi049 bash[23528]: audit 2024-09-21T02:10:29.653647+0000 mgr.a (mgr.14388) 10213 : audit [DBG] from='client.225717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:30 smithi044 bash[22676]: audit 2024-09-21T02:10:29.653647+0000 mgr.a (mgr.14388) 10213 : audit [DBG] from='client.225717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:30 smithi179 bash[23186]: audit 2024-09-21T02:10:29.653647+0000 mgr.a (mgr.14388) 10213 : audit [DBG] from='client.225717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:31 smithi049 bash[23528]: cluster 2024-09-21T02:10:30.405856+0000 mgr.a (mgr.14388) 10214 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:10:31.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:31 smithi179 bash[23186]: cluster 2024-09-21T02:10:30.405856+0000 mgr.a (mgr.14388) 10214 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:10:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:31 smithi044 bash[22676]: cluster 2024-09-21T02:10:30.405856+0000 mgr.a (mgr.14388) 10214 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:10:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:33 smithi044 bash[22676]: cluster 2024-09-21T02:10:32.406666+0000 mgr.a (mgr.14388) 10215 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:10:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:33 smithi179 bash[23186]: cluster 2024-09-21T02:10:32.406666+0000 mgr.a (mgr.14388) 10215 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:10:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:33 smithi049 bash[23528]: cluster 2024-09-21T02:10:32.406666+0000 mgr.a (mgr.14388) 10215 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:10:35.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:35.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:35.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:35 smithi044 bash[22676]: cluster 2024-09-21T02:10:34.407426+0000 mgr.a (mgr.14388) 10216 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:10:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:35 smithi179 bash[23186]: cluster 2024-09-21T02:10:34.407426+0000 mgr.a (mgr.14388) 10216 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:10:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:35 smithi049 bash[23528]: cluster 2024-09-21T02:10:34.407426+0000 mgr.a (mgr.14388) 10216 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:10:35.852 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:35.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:35.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:35.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:35.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:36 smithi044 bash[22676]: audit 2024-09-21T02:10:35.437537+0000 mgr.a (mgr.14388) 10217 : audit [DBG] from='client.225789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:36 smithi179 bash[23186]: audit 2024-09-21T02:10:35.437537+0000 mgr.a (mgr.14388) 10217 : audit [DBG] from='client.225789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:36 smithi049 bash[23528]: audit 2024-09-21T02:10:35.437537+0000 mgr.a (mgr.14388) 10217 : audit [DBG] from='client.225789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:37 smithi044 bash[22676]: cluster 2024-09-21T02:10:36.410179+0000 mgr.a (mgr.14388) 10218 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:37 smithi044 bash[22676]: audit 2024-09-21T02:10:37.245157+0000 mon.a (mon.0) 8473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:37 smithi044 bash[22676]: audit 2024-09-21T02:10:37.254270+0000 mon.a (mon.0) 8474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:37 smithi044 bash[22676]: audit 2024-09-21T02:10:37.265191+0000 mon.a (mon.0) 8475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:37 smithi044 bash[22676]: audit 2024-09-21T02:10:37.404704+0000 mon.a (mon.0) 8476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:37 smithi044 bash[22676]: audit 2024-09-21T02:10:37.410362+0000 mon.a (mon.0) 8477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:37 smithi044 bash[22676]: audit 2024-09-21T02:10:37.417986+0000 mon.a (mon.0) 8478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:37 smithi179 bash[23186]: cluster 2024-09-21T02:10:36.410179+0000 mgr.a (mgr.14388) 10218 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:37 smithi179 bash[23186]: audit 2024-09-21T02:10:37.245157+0000 mon.a (mon.0) 8473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:37 smithi179 bash[23186]: audit 2024-09-21T02:10:37.254270+0000 mon.a (mon.0) 8474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:37 smithi179 bash[23186]: audit 2024-09-21T02:10:37.265191+0000 mon.a (mon.0) 8475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:37 smithi179 bash[23186]: audit 2024-09-21T02:10:37.404704+0000 mon.a (mon.0) 8476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:37 smithi179 bash[23186]: audit 2024-09-21T02:10:37.410362+0000 mon.a (mon.0) 8477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:37 smithi179 bash[23186]: audit 2024-09-21T02:10:37.417986+0000 mon.a (mon.0) 8478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:37 smithi049 bash[23528]: cluster 2024-09-21T02:10:36.410179+0000 mgr.a (mgr.14388) 10218 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:37 smithi049 bash[23528]: audit 2024-09-21T02:10:37.245157+0000 mon.a (mon.0) 8473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:37 smithi049 bash[23528]: audit 2024-09-21T02:10:37.254270+0000 mon.a (mon.0) 8474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:37 smithi049 bash[23528]: audit 2024-09-21T02:10:37.265191+0000 mon.a (mon.0) 8475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:37 smithi049 bash[23528]: audit 2024-09-21T02:10:37.404704+0000 mon.a (mon.0) 8476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:37 smithi049 bash[23528]: audit 2024-09-21T02:10:37.410362+0000 mon.a (mon.0) 8477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:37 smithi049 bash[23528]: audit 2024-09-21T02:10:37.417986+0000 mon.a (mon.0) 8478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:39 smithi044 bash[22676]: cluster 2024-09-21T02:10:38.410929+0000 mgr.a (mgr.14388) 10219 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:39 smithi179 bash[23186]: cluster 2024-09-21T02:10:38.410929+0000 mgr.a (mgr.14388) 10219 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:39 smithi049 bash[23528]: cluster 2024-09-21T02:10:38.410929+0000 mgr.a (mgr.14388) 10219 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:10:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:41.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22930]: debug 2024-09-21T02:10:41.659+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:10:41.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22930]: debug 2024-09-21T02:10:41.671+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:10:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22676]: cluster 2024-09-21T02:10:40.412830+0000 mgr.a (mgr.14388) 10220 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22676]: audit 2024-09-21T02:10:40.858169+0000 mon.a (mon.0) 8479 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:10:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22676]: audit 2024-09-21T02:10:40.864174+0000 mon.a (mon.0) 8480 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:10:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22676]: audit 2024-09-21T02:10:40.865859+0000 mon.a (mon.0) 8481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:10:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22676]: audit 2024-09-21T02:10:40.876405+0000 mon.a (mon.0) 8482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22676]: audit 2024-09-21T02:10:40.882509+0000 mon.a (mon.0) 8483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:10:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:41 smithi044 bash[22676]: audit 2024-09-21T02:10:40.884744+0000 mgr.a (mgr.14388) 10221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:10:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:41 smithi179 bash[23186]: cluster 2024-09-21T02:10:40.412830+0000 mgr.a (mgr.14388) 10220 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:41 smithi179 bash[23186]: audit 2024-09-21T02:10:40.858169+0000 mon.a (mon.0) 8479 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:10:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:41 smithi179 bash[23186]: audit 2024-09-21T02:10:40.864174+0000 mon.a (mon.0) 8480 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:10:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:41 smithi179 bash[23186]: audit 2024-09-21T02:10:40.865859+0000 mon.a (mon.0) 8481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:10:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:41 smithi179 bash[23186]: audit 2024-09-21T02:10:40.876405+0000 mon.a (mon.0) 8482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:41 smithi179 bash[23186]: audit 2024-09-21T02:10:40.882509+0000 mon.a (mon.0) 8483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:10:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:41 smithi179 bash[23186]: audit 2024-09-21T02:10:40.884744+0000 mgr.a (mgr.14388) 10221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:10:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:41 smithi049 bash[23528]: cluster 2024-09-21T02:10:40.412830+0000 mgr.a (mgr.14388) 10220 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:41 smithi049 bash[23528]: audit 2024-09-21T02:10:40.858169+0000 mon.a (mon.0) 8479 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:10:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:41 smithi049 bash[23528]: audit 2024-09-21T02:10:40.864174+0000 mon.a (mon.0) 8480 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:10:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:41 smithi049 bash[23528]: audit 2024-09-21T02:10:40.865859+0000 mon.a (mon.0) 8481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:10:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:41 smithi049 bash[23528]: audit 2024-09-21T02:10:40.876405+0000 mon.a (mon.0) 8482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:41 smithi049 bash[23528]: audit 2024-09-21T02:10:40.882509+0000 mon.a (mon.0) 8483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:10:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:41 smithi049 bash[23528]: audit 2024-09-21T02:10:40.884744+0000 mgr.a (mgr.14388) 10221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:10:42.081 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:42 smithi044 bash[22676]: audit 2024-09-21T02:10:41.211572+0000 mgr.a (mgr.14388) 10222 : audit [DBG] from='client.225870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:42 smithi044 bash[22676]: audit 2024-09-21T02:10:41.662099+0000 mgr.a (mgr.14388) 10223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:10:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:42 smithi044 bash[22676]: cephadm 2024-09-21T02:10:41.676679+0000 mgr.a (mgr.14388) 10224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:10:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:42 smithi179 bash[23186]: audit 2024-09-21T02:10:41.211572+0000 mgr.a (mgr.14388) 10222 : audit [DBG] from='client.225870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:42 smithi179 bash[23186]: audit 2024-09-21T02:10:41.662099+0000 mgr.a (mgr.14388) 10223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:10:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:42 smithi179 bash[23186]: cephadm 2024-09-21T02:10:41.676679+0000 mgr.a (mgr.14388) 10224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:10:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:42 smithi049 bash[23528]: audit 2024-09-21T02:10:41.211572+0000 mgr.a (mgr.14388) 10222 : audit [DBG] from='client.225870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:42 smithi049 bash[23528]: audit 2024-09-21T02:10:41.662099+0000 mgr.a (mgr.14388) 10223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:10:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:42 smithi049 bash[23528]: cephadm 2024-09-21T02:10:41.676679+0000 mgr.a (mgr.14388) 10224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:10:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:43 smithi179 bash[23186]: cluster 2024-09-21T02:10:42.413718+0000 mgr.a (mgr.14388) 10225 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:10:43.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:43 smithi044 bash[22676]: cluster 2024-09-21T02:10:42.413718+0000 mgr.a (mgr.14388) 10225 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:10:43.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:43 smithi049 bash[23528]: cluster 2024-09-21T02:10:42.413718+0000 mgr.a (mgr.14388) 10225 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:10:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:45 smithi044 bash[22676]: audit 2024-09-21T02:10:44.108404+0000 mon.a (mon.0) 8484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:45 smithi044 bash[22676]: audit 2024-09-21T02:10:44.117491+0000 mon.a (mon.0) 8485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:45 smithi044 bash[22676]: audit 2024-09-21T02:10:44.128703+0000 mon.a (mon.0) 8486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:45 smithi179 bash[23186]: audit 2024-09-21T02:10:44.108404+0000 mon.a (mon.0) 8484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:45 smithi179 bash[23186]: audit 2024-09-21T02:10:44.117491+0000 mon.a (mon.0) 8485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:45 smithi179 bash[23186]: audit 2024-09-21T02:10:44.128703+0000 mon.a (mon.0) 8486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:45 smithi049 bash[23528]: audit 2024-09-21T02:10:44.108404+0000 mon.a (mon.0) 8484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:45 smithi049 bash[23528]: audit 2024-09-21T02:10:44.117491+0000 mon.a (mon.0) 8485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:45 smithi049 bash[23528]: audit 2024-09-21T02:10:44.128703+0000 mon.a (mon.0) 8486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:46 smithi044 bash[22676]: cluster 2024-09-21T02:10:44.414545+0000 mgr.a (mgr.14388) 10226 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:10:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:46 smithi179 bash[23186]: cluster 2024-09-21T02:10:44.414545+0000 mgr.a (mgr.14388) 10226 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:10:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:46 smithi049 bash[23528]: cluster 2024-09-21T02:10:44.414545+0000 mgr.a (mgr.14388) 10226 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:10:47.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:47.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:47.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:47.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:47.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:47.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:47.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:47.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:48 smithi044 bash[22676]: cluster 2024-09-21T02:10:46.416788+0000 mgr.a (mgr.14388) 10227 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:48 smithi179 bash[23186]: cluster 2024-09-21T02:10:46.416788+0000 mgr.a (mgr.14388) 10227 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:48 smithi049 bash[23528]: cluster 2024-09-21T02:10:46.416788+0000 mgr.a (mgr.14388) 10227 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:49 smithi044 bash[22676]: audit 2024-09-21T02:10:47.423293+0000 mgr.a (mgr.14388) 10228 : audit [DBG] from='client.226050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:49 smithi179 bash[23186]: audit 2024-09-21T02:10:47.423293+0000 mgr.a (mgr.14388) 10228 : audit [DBG] from='client.226050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:49 smithi049 bash[23528]: audit 2024-09-21T02:10:47.423293+0000 mgr.a (mgr.14388) 10228 : audit [DBG] from='client.226050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:50 smithi044 bash[22676]: cluster 2024-09-21T02:10:48.417724+0000 mgr.a (mgr.14388) 10229 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:50 smithi179 bash[23186]: cluster 2024-09-21T02:10:48.417724+0000 mgr.a (mgr.14388) 10229 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:50.547 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:50 smithi049 bash[23528]: cluster 2024-09-21T02:10:48.417724+0000 mgr.a (mgr.14388) 10229 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:51 smithi179 bash[23186]: cluster 2024-09-21T02:10:50.419967+0000 mgr.a (mgr.14388) 10230 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:51 smithi044 bash[22676]: cluster 2024-09-21T02:10:50.419967+0000 mgr.a (mgr.14388) 10230 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:51 smithi049 bash[23528]: cluster 2024-09-21T02:10:50.419967+0000 mgr.a (mgr.14388) 10230 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:52.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:52.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:52.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:53.633 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:53 smithi044 bash[22676]: cluster 2024-09-21T02:10:52.420736+0000 mgr.a (mgr.14388) 10231 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:53 smithi179 bash[23186]: cluster 2024-09-21T02:10:52.420736+0000 mgr.a (mgr.14388) 10231 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:53 smithi049 bash[23528]: cluster 2024-09-21T02:10:52.420736+0000 mgr.a (mgr.14388) 10231 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:54 smithi044 bash[22676]: audit 2024-09-21T02:10:53.190370+0000 mgr.a (mgr.14388) 10232 : audit [DBG] from='client.226125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:54 smithi179 bash[23186]: audit 2024-09-21T02:10:53.190370+0000 mgr.a (mgr.14388) 10232 : audit [DBG] from='client.226125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:54 smithi049 bash[23528]: audit 2024-09-21T02:10:53.190370+0000 mgr.a (mgr.14388) 10232 : audit [DBG] from='client.226125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:10:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:55 smithi179 bash[23186]: cluster 2024-09-21T02:10:54.421666+0000 mgr.a (mgr.14388) 10233 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:55 smithi049 bash[23528]: cluster 2024-09-21T02:10:54.421666+0000 mgr.a (mgr.14388) 10233 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:55 smithi044 bash[22676]: cluster 2024-09-21T02:10:54.421666+0000 mgr.a (mgr.14388) 10233 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:57 smithi179 bash[23186]: cluster 2024-09-21T02:10:56.423892+0000 mgr.a (mgr.14388) 10234 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:57 smithi179 bash[23186]: audit 2024-09-21T02:10:57.482671+0000 mon.a (mon.0) 8487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:57 smithi179 bash[23186]: audit 2024-09-21T02:10:57.490347+0000 mon.a (mon.0) 8488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:57 smithi049 bash[23528]: cluster 2024-09-21T02:10:56.423892+0000 mgr.a (mgr.14388) 10234 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:57 smithi049 bash[23528]: audit 2024-09-21T02:10:57.482671+0000 mon.a (mon.0) 8487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:57 smithi049 bash[23528]: audit 2024-09-21T02:10:57.490347+0000 mon.a (mon.0) 8488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:57 smithi044 bash[22676]: cluster 2024-09-21T02:10:56.423892+0000 mgr.a (mgr.14388) 10234 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:10:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:57 smithi044 bash[22676]: audit 2024-09-21T02:10:57.482671+0000 mon.a (mon.0) 8487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:57 smithi044 bash[22676]: audit 2024-09-21T02:10:57.490347+0000 mon.a (mon.0) 8488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:10:58.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:10:58.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:10:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:58 smithi049 bash[23528]: audit 2024-09-21T02:10:57.506159+0000 mon.a (mon.0) 8489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:58 smithi049 bash[23528]: audit 2024-09-21T02:10:57.611134+0000 mon.a (mon.0) 8490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:58 smithi049 bash[23528]: audit 2024-09-21T02:10:57.619420+0000 mon.a (mon.0) 8491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:58 smithi049 bash[23528]: audit 2024-09-21T02:10:57.629385+0000 mon.a (mon.0) 8492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:58 smithi044 bash[22676]: audit 2024-09-21T02:10:57.506159+0000 mon.a (mon.0) 8489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:58 smithi044 bash[22676]: audit 2024-09-21T02:10:57.611134+0000 mon.a (mon.0) 8490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:58 smithi044 bash[22676]: audit 2024-09-21T02:10:57.619420+0000 mon.a (mon.0) 8491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:58 smithi044 bash[22676]: audit 2024-09-21T02:10:57.629385+0000 mon.a (mon.0) 8492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:58 smithi179 bash[23186]: audit 2024-09-21T02:10:57.506159+0000 mon.a (mon.0) 8489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:58 smithi179 bash[23186]: audit 2024-09-21T02:10:57.611134+0000 mon.a (mon.0) 8490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:58 smithi179 bash[23186]: audit 2024-09-21T02:10:57.619420+0000 mon.a (mon.0) 8491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:58 smithi179 bash[23186]: audit 2024-09-21T02:10:57.629385+0000 mon.a (mon.0) 8492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:10:59.422 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:10:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:10:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:10:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:10:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:10:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:59 smithi044 bash[22676]: cluster 2024-09-21T02:10:58.424647+0000 mgr.a (mgr.14388) 10235 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:10:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:10:59 smithi044 bash[22676]: audit 2024-09-21T02:10:58.970657+0000 mgr.a (mgr.14388) 10236 : audit [DBG] from='client.226200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:59 smithi179 bash[23186]: cluster 2024-09-21T02:10:58.424647+0000 mgr.a (mgr.14388) 10235 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:10:59 smithi179 bash[23186]: audit 2024-09-21T02:10:58.970657+0000 mgr.a (mgr.14388) 10236 : audit [DBG] from='client.226200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:59 smithi049 bash[23528]: cluster 2024-09-21T02:10:58.424647+0000 mgr.a (mgr.14388) 10235 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:10:59 smithi049 bash[23528]: audit 2024-09-21T02:10:58.970657+0000 mgr.a (mgr.14388) 10236 : audit [DBG] from='client.226200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:01 smithi044 bash[22676]: cluster 2024-09-21T02:11:00.426896+0000 mgr.a (mgr.14388) 10237 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:01 smithi179 bash[23186]: cluster 2024-09-21T02:11:00.426896+0000 mgr.a (mgr.14388) 10237 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:01 smithi049 bash[23528]: cluster 2024-09-21T02:11:00.426896+0000 mgr.a (mgr.14388) 10237 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:03 smithi044 bash[22676]: cluster 2024-09-21T02:11:02.427655+0000 mgr.a (mgr.14388) 10238 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:03 smithi179 bash[23186]: cluster 2024-09-21T02:11:02.427655+0000 mgr.a (mgr.14388) 10238 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:03 smithi049 bash[23528]: cluster 2024-09-21T02:11:02.427655+0000 mgr.a (mgr.14388) 10238 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:04.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:04.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:04.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:05.195 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:05 smithi044 bash[22676]: audit 2024-09-21T02:11:04.339521+0000 mon.a (mon.0) 8493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:05 smithi044 bash[22676]: audit 2024-09-21T02:11:04.348092+0000 mon.a (mon.0) 8494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:05 smithi044 bash[22676]: audit 2024-09-21T02:11:04.358745+0000 mon.a (mon.0) 8495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:05 smithi044 bash[22676]: cluster 2024-09-21T02:11:04.428249+0000 mgr.a (mgr.14388) 10239 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:05 smithi044 bash[22676]: audit 2024-09-21T02:11:04.765013+0000 mgr.a (mgr.14388) 10240 : audit [DBG] from='client.226278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:05 smithi179 bash[23186]: audit 2024-09-21T02:11:04.339521+0000 mon.a (mon.0) 8493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:05 smithi179 bash[23186]: audit 2024-09-21T02:11:04.348092+0000 mon.a (mon.0) 8494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:05 smithi179 bash[23186]: audit 2024-09-21T02:11:04.358745+0000 mon.a (mon.0) 8495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:05 smithi179 bash[23186]: cluster 2024-09-21T02:11:04.428249+0000 mgr.a (mgr.14388) 10239 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:05.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:05 smithi179 bash[23186]: audit 2024-09-21T02:11:04.765013+0000 mgr.a (mgr.14388) 10240 : audit [DBG] from='client.226278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:05 smithi049 bash[23528]: audit 2024-09-21T02:11:04.339521+0000 mon.a (mon.0) 8493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:05 smithi049 bash[23528]: audit 2024-09-21T02:11:04.348092+0000 mon.a (mon.0) 8494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:05 smithi049 bash[23528]: audit 2024-09-21T02:11:04.358745+0000 mon.a (mon.0) 8495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:05 smithi049 bash[23528]: cluster 2024-09-21T02:11:04.428249+0000 mgr.a (mgr.14388) 10239 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:05 smithi049 bash[23528]: audit 2024-09-21T02:11:04.765013+0000 mgr.a (mgr.14388) 10240 : audit [DBG] from='client.226278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:07 smithi179 bash[23186]: cluster 2024-09-21T02:11:06.430997+0000 mgr.a (mgr.14388) 10241 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:11:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:07 smithi049 bash[23528]: cluster 2024-09-21T02:11:06.430997+0000 mgr.a (mgr.14388) 10241 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:11:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:07 smithi044 bash[22676]: cluster 2024-09-21T02:11:06.430997+0000 mgr.a (mgr.14388) 10241 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:11:09.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:09 smithi179 bash[23186]: cluster 2024-09-21T02:11:08.431771+0000 mgr.a (mgr.14388) 10242 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:11:09.763 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:09 smithi049 bash[23528]: cluster 2024-09-21T02:11:08.431771+0000 mgr.a (mgr.14388) 10242 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:11:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:09 smithi044 bash[22676]: cluster 2024-09-21T02:11:08.431771+0000 mgr.a (mgr.14388) 10242 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:11:10.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:10.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:10.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:10.944 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:10.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:10.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:10.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:10.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:11 smithi179 bash[23186]: cluster 2024-09-21T02:11:10.433847+0000 mgr.a (mgr.14388) 10243 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:11 smithi179 bash[23186]: audit 2024-09-21T02:11:10.530313+0000 mgr.a (mgr.14388) 10244 : audit [DBG] from='client.226356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:11 smithi049 bash[23528]: cluster 2024-09-21T02:11:10.433847+0000 mgr.a (mgr.14388) 10243 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:11 smithi049 bash[23528]: audit 2024-09-21T02:11:10.530313+0000 mgr.a (mgr.14388) 10244 : audit [DBG] from='client.226356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:11 smithi044 bash[22676]: cluster 2024-09-21T02:11:10.433847+0000 mgr.a (mgr.14388) 10243 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:11 smithi044 bash[22676]: audit 2024-09-21T02:11:10.530313+0000 mgr.a (mgr.14388) 10244 : audit [DBG] from='client.226356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:13 smithi049 bash[23528]: cluster 2024-09-21T02:11:12.434820+0000 mgr.a (mgr.14388) 10245 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:11:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:13 smithi179 bash[23186]: cluster 2024-09-21T02:11:12.434820+0000 mgr.a (mgr.14388) 10245 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:11:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:13 smithi044 bash[22676]: cluster 2024-09-21T02:11:12.434820+0000 mgr.a (mgr.14388) 10245 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:11:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:15 smithi049 bash[23528]: cluster 2024-09-21T02:11:14.435743+0000 mgr.a (mgr.14388) 10246 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:11:15.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:15.947 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:15.947 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:15 smithi044 bash[22676]: cluster 2024-09-21T02:11:14.435743+0000 mgr.a (mgr.14388) 10246 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:11:16.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:15 smithi179 bash[23186]: cluster 2024-09-21T02:11:14.435743+0000 mgr.a (mgr.14388) 10246 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:11:16.701 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:16.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:16.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:16.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:16.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:17 smithi049 bash[23528]: audit 2024-09-21T02:11:16.279538+0000 mgr.a (mgr.14388) 10247 : audit [DBG] from='client.226431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:17 smithi049 bash[23528]: cluster 2024-09-21T02:11:16.437164+0000 mgr.a (mgr.14388) 10248 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:17.854 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:17 smithi044 bash[22676]: audit 2024-09-21T02:11:16.279538+0000 mgr.a (mgr.14388) 10247 : audit [DBG] from='client.226431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:17.854 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:17 smithi044 bash[22676]: cluster 2024-09-21T02:11:16.437164+0000 mgr.a (mgr.14388) 10248 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:17 smithi179 bash[23186]: audit 2024-09-21T02:11:16.279538+0000 mgr.a (mgr.14388) 10247 : audit [DBG] from='client.226431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:17 smithi179 bash[23186]: cluster 2024-09-21T02:11:16.437164+0000 mgr.a (mgr.14388) 10248 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:18 smithi044 bash[22676]: audit 2024-09-21T02:11:17.675990+0000 mon.a (mon.0) 8496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:18.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:18 smithi044 bash[22676]: audit 2024-09-21T02:11:17.682136+0000 mon.a (mon.0) 8497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:18 smithi044 bash[22676]: audit 2024-09-21T02:11:17.689063+0000 mon.a (mon.0) 8498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:18 smithi044 bash[22676]: audit 2024-09-21T02:11:17.836914+0000 mon.a (mon.0) 8499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:18 smithi044 bash[22676]: audit 2024-09-21T02:11:17.844451+0000 mon.a (mon.0) 8500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:18 smithi044 bash[22676]: audit 2024-09-21T02:11:17.853090+0000 mon.a (mon.0) 8501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:18 smithi179 bash[23186]: audit 2024-09-21T02:11:17.675990+0000 mon.a (mon.0) 8496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:18 smithi179 bash[23186]: audit 2024-09-21T02:11:17.682136+0000 mon.a (mon.0) 8497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:18 smithi179 bash[23186]: audit 2024-09-21T02:11:17.689063+0000 mon.a (mon.0) 8498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:18 smithi179 bash[23186]: audit 2024-09-21T02:11:17.836914+0000 mon.a (mon.0) 8499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:18 smithi179 bash[23186]: audit 2024-09-21T02:11:17.844451+0000 mon.a (mon.0) 8500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:18 smithi179 bash[23186]: audit 2024-09-21T02:11:17.853090+0000 mon.a (mon.0) 8501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:18 smithi049 bash[23528]: audit 2024-09-21T02:11:17.675990+0000 mon.a (mon.0) 8496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:18 smithi049 bash[23528]: audit 2024-09-21T02:11:17.682136+0000 mon.a (mon.0) 8497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:18 smithi049 bash[23528]: audit 2024-09-21T02:11:17.689063+0000 mon.a (mon.0) 8498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:18 smithi049 bash[23528]: audit 2024-09-21T02:11:17.836914+0000 mon.a (mon.0) 8499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:18 smithi049 bash[23528]: audit 2024-09-21T02:11:17.844451+0000 mon.a (mon.0) 8500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:18 smithi049 bash[23528]: audit 2024-09-21T02:11:17.853090+0000 mon.a (mon.0) 8501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:19 smithi044 bash[22676]: cluster 2024-09-21T02:11:18.437969+0000 mgr.a (mgr.14388) 10249 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:11:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:19 smithi179 bash[23186]: cluster 2024-09-21T02:11:18.437969+0000 mgr.a (mgr.14388) 10249 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:11:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:19 smithi049 bash[23528]: cluster 2024-09-21T02:11:18.437969+0000 mgr.a (mgr.14388) 10249 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:11:21.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:21.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:21.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:21 smithi044 bash[22676]: cluster 2024-09-21T02:11:20.440085+0000 mgr.a (mgr.14388) 10250 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:11:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:21 smithi179 bash[23186]: cluster 2024-09-21T02:11:20.440085+0000 mgr.a (mgr.14388) 10250 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:11:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:21 smithi049 bash[23528]: cluster 2024-09-21T02:11:20.440085+0000 mgr.a (mgr.14388) 10250 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:11:22.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:22.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:22.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:22.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:22.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:22 smithi044 bash[22676]: audit 2024-09-21T02:11:22.031560+0000 mgr.a (mgr.14388) 10251 : audit [DBG] from='client.226506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:22 smithi179 bash[23186]: audit 2024-09-21T02:11:22.031560+0000 mgr.a (mgr.14388) 10251 : audit [DBG] from='client.226506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:22 smithi049 bash[23528]: audit 2024-09-21T02:11:22.031560+0000 mgr.a (mgr.14388) 10251 : audit [DBG] from='client.226506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:24.211 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:23 smithi044 bash[22676]: cluster 2024-09-21T02:11:22.440657+0000 mgr.a (mgr.14388) 10252 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:23 smithi179 bash[23186]: cluster 2024-09-21T02:11:22.440657+0000 mgr.a (mgr.14388) 10252 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:23 smithi049 bash[23528]: cluster 2024-09-21T02:11:22.440657+0000 mgr.a (mgr.14388) 10252 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:25 smithi044 bash[22676]: cluster 2024-09-21T02:11:24.441500+0000 mgr.a (mgr.14388) 10253 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:25 smithi044 bash[22676]: audit 2024-09-21T02:11:24.574248+0000 mon.a (mon.0) 8502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:25 smithi044 bash[22676]: audit 2024-09-21T02:11:24.584264+0000 mon.a (mon.0) 8503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:25 smithi044 bash[22676]: audit 2024-09-21T02:11:24.595268+0000 mon.a (mon.0) 8504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:25 smithi179 bash[23186]: cluster 2024-09-21T02:11:24.441500+0000 mgr.a (mgr.14388) 10253 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:25 smithi179 bash[23186]: audit 2024-09-21T02:11:24.574248+0000 mon.a (mon.0) 8502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:25 smithi179 bash[23186]: audit 2024-09-21T02:11:24.584264+0000 mon.a (mon.0) 8503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:25 smithi179 bash[23186]: audit 2024-09-21T02:11:24.595268+0000 mon.a (mon.0) 8504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:25 smithi049 bash[23528]: cluster 2024-09-21T02:11:24.441500+0000 mgr.a (mgr.14388) 10253 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:25 smithi049 bash[23528]: audit 2024-09-21T02:11:24.574248+0000 mon.a (mon.0) 8502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:25 smithi049 bash[23528]: audit 2024-09-21T02:11:24.584264+0000 mon.a (mon.0) 8503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:25 smithi049 bash[23528]: audit 2024-09-21T02:11:24.595268+0000 mon.a (mon.0) 8504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:27.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:27.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:27.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:27 smithi044 bash[22676]: cluster 2024-09-21T02:11:26.442616+0000 mgr.a (mgr.14388) 10254 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:27 smithi179 bash[23186]: cluster 2024-09-21T02:11:26.442616+0000 mgr.a (mgr.14388) 10254 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:27 smithi049 bash[23528]: cluster 2024-09-21T02:11:26.442616+0000 mgr.a (mgr.14388) 10254 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:28.253 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:28.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:28 smithi179 bash[23186]: audit 2024-09-21T02:11:27.802089+0000 mgr.a (mgr.14388) 10255 : audit [DBG] from='client.226584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:28 smithi044 bash[22676]: audit 2024-09-21T02:11:27.802089+0000 mgr.a (mgr.14388) 10255 : audit [DBG] from='client.226584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:28 smithi049 bash[23528]: audit 2024-09-21T02:11:27.802089+0000 mgr.a (mgr.14388) 10255 : audit [DBG] from='client.226584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:29.847 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:29 smithi179 bash[23186]: cluster 2024-09-21T02:11:28.443578+0000 mgr.a (mgr.14388) 10256 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:29 smithi044 bash[22676]: cluster 2024-09-21T02:11:28.443578+0000 mgr.a (mgr.14388) 10256 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:30.008 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:29 smithi049 bash[23528]: cluster 2024-09-21T02:11:28.443578+0000 mgr.a (mgr.14388) 10256 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:31 smithi179 bash[23186]: cluster 2024-09-21T02:11:30.445791+0000 mgr.a (mgr.14388) 10257 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:31.915 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:31 smithi049 bash[23528]: cluster 2024-09-21T02:11:30.445791+0000 mgr.a (mgr.14388) 10257 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:31 smithi044 bash[22676]: cluster 2024-09-21T02:11:30.445791+0000 mgr.a (mgr.14388) 10257 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:33.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:33.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:33.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:33 smithi044 bash[22676]: cluster 2024-09-21T02:11:32.446542+0000 mgr.a (mgr.14388) 10258 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:33 smithi179 bash[23186]: cluster 2024-09-21T02:11:32.446542+0000 mgr.a (mgr.14388) 10258 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:34.033 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:34.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:33 smithi049 bash[23528]: cluster 2024-09-21T02:11:32.446542+0000 mgr.a (mgr.14388) 10258 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:34 smithi044 bash[22676]: audit 2024-09-21T02:11:33.597361+0000 mgr.a (mgr.14388) 10259 : audit [DBG] from='client.226662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:34 smithi179 bash[23186]: audit 2024-09-21T02:11:33.597361+0000 mgr.a (mgr.14388) 10259 : audit [DBG] from='client.226662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:35.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:34 smithi049 bash[23528]: audit 2024-09-21T02:11:33.597361+0000 mgr.a (mgr.14388) 10259 : audit [DBG] from='client.226662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:35 smithi044 bash[22676]: cluster 2024-09-21T02:11:34.447531+0000 mgr.a (mgr.14388) 10260 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:35 smithi179 bash[23186]: cluster 2024-09-21T02:11:34.447531+0000 mgr.a (mgr.14388) 10260 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:35 smithi049 bash[23528]: cluster 2024-09-21T02:11:34.447531+0000 mgr.a (mgr.14388) 10260 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:37 smithi179 bash[23186]: cluster 2024-09-21T02:11:36.449853+0000 mgr.a (mgr.14388) 10261 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:37 smithi044 bash[22676]: cluster 2024-09-21T02:11:36.449853+0000 mgr.a (mgr.14388) 10261 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:37 smithi049 bash[23528]: cluster 2024-09-21T02:11:36.449853+0000 mgr.a (mgr.14388) 10261 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:39.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:39.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:39.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:38 smithi044 bash[22676]: audit 2024-09-21T02:11:37.894128+0000 mon.a (mon.0) 8505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:38 smithi044 bash[22676]: audit 2024-09-21T02:11:37.899849+0000 mon.a (mon.0) 8506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:38 smithi044 bash[22676]: audit 2024-09-21T02:11:37.907099+0000 mon.a (mon.0) 8507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:38 smithi044 bash[22676]: audit 2024-09-21T02:11:38.059471+0000 mon.a (mon.0) 8508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:38 smithi044 bash[22676]: audit 2024-09-21T02:11:38.067617+0000 mon.a (mon.0) 8509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:38 smithi044 bash[22676]: audit 2024-09-21T02:11:38.077381+0000 mon.a (mon.0) 8510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:38 smithi179 bash[23186]: audit 2024-09-21T02:11:37.894128+0000 mon.a (mon.0) 8505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:38 smithi179 bash[23186]: audit 2024-09-21T02:11:37.899849+0000 mon.a (mon.0) 8506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:38 smithi179 bash[23186]: audit 2024-09-21T02:11:37.907099+0000 mon.a (mon.0) 8507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:38 smithi179 bash[23186]: audit 2024-09-21T02:11:38.059471+0000 mon.a (mon.0) 8508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:38 smithi179 bash[23186]: audit 2024-09-21T02:11:38.067617+0000 mon.a (mon.0) 8509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:38 smithi179 bash[23186]: audit 2024-09-21T02:11:38.077381+0000 mon.a (mon.0) 8510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:38 smithi049 bash[23528]: audit 2024-09-21T02:11:37.894128+0000 mon.a (mon.0) 8505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:38 smithi049 bash[23528]: audit 2024-09-21T02:11:37.899849+0000 mon.a (mon.0) 8506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:38 smithi049 bash[23528]: audit 2024-09-21T02:11:37.907099+0000 mon.a (mon.0) 8507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:38 smithi049 bash[23528]: audit 2024-09-21T02:11:38.059471+0000 mon.a (mon.0) 8508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:38 smithi049 bash[23528]: audit 2024-09-21T02:11:38.067617+0000 mon.a (mon.0) 8509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:38 smithi049 bash[23528]: audit 2024-09-21T02:11:38.077381+0000 mon.a (mon.0) 8510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:39.796 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:39.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:39.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:39.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:39.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:40 smithi044 bash[22676]: cluster 2024-09-21T02:11:38.450626+0000 mgr.a (mgr.14388) 10262 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:40 smithi179 bash[23186]: cluster 2024-09-21T02:11:38.450626+0000 mgr.a (mgr.14388) 10262 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:40 smithi049 bash[23528]: cluster 2024-09-21T02:11:38.450626+0000 mgr.a (mgr.14388) 10262 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:41 smithi044 bash[22676]: audit 2024-09-21T02:11:39.370386+0000 mgr.a (mgr.14388) 10263 : audit [DBG] from='client.226740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:41 smithi179 bash[23186]: audit 2024-09-21T02:11:39.370386+0000 mgr.a (mgr.14388) 10263 : audit [DBG] from='client.226740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:41 smithi049 bash[23528]: audit 2024-09-21T02:11:39.370386+0000 mgr.a (mgr.14388) 10263 : audit [DBG] from='client.226740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22676]: cluster 2024-09-21T02:11:40.453012+0000 mgr.a (mgr.14388) 10264 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22676]: audit 2024-09-21T02:11:41.740306+0000 mon.a (mon.0) 8511 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:11:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22676]: audit 2024-09-21T02:11:41.747528+0000 mon.a (mon.0) 8512 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:11:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22676]: audit 2024-09-21T02:11:41.749396+0000 mon.a (mon.0) 8513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:11:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22676]: audit 2024-09-21T02:11:41.760706+0000 mon.a (mon.0) 8514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22676]: audit 2024-09-21T02:11:41.767119+0000 mon.a (mon.0) 8515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:11:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:42 smithi179 bash[23186]: cluster 2024-09-21T02:11:40.453012+0000 mgr.a (mgr.14388) 10264 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:42 smithi179 bash[23186]: audit 2024-09-21T02:11:41.740306+0000 mon.a (mon.0) 8511 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:11:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:42 smithi179 bash[23186]: audit 2024-09-21T02:11:41.747528+0000 mon.a (mon.0) 8512 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:11:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:42 smithi179 bash[23186]: audit 2024-09-21T02:11:41.749396+0000 mon.a (mon.0) 8513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:11:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:42 smithi179 bash[23186]: audit 2024-09-21T02:11:41.760706+0000 mon.a (mon.0) 8514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:42 smithi179 bash[23186]: audit 2024-09-21T02:11:41.767119+0000 mon.a (mon.0) 8515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:11:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:42 smithi049 bash[23528]: cluster 2024-09-21T02:11:40.453012+0000 mgr.a (mgr.14388) 10264 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:11:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:42 smithi049 bash[23528]: audit 2024-09-21T02:11:41.740306+0000 mon.a (mon.0) 8511 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:11:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:42 smithi049 bash[23528]: audit 2024-09-21T02:11:41.747528+0000 mon.a (mon.0) 8512 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:11:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:42 smithi049 bash[23528]: audit 2024-09-21T02:11:41.749396+0000 mon.a (mon.0) 8513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:11:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:42 smithi049 bash[23528]: audit 2024-09-21T02:11:41.760706+0000 mon.a (mon.0) 8514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:42 smithi049 bash[23528]: audit 2024-09-21T02:11:41.767119+0000 mon.a (mon.0) 8515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:11:42.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22930]: debug 2024-09-21T02:11:42.514+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:11:42.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:11:42 smithi044 bash[22930]: debug 2024-09-21T02:11:42.514+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:11:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:43 smithi044 bash[22676]: audit 2024-09-21T02:11:41.769509+0000 mgr.a (mgr.14388) 10265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:11:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:43 smithi179 bash[23186]: audit 2024-09-21T02:11:41.769509+0000 mgr.a (mgr.14388) 10265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:11:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:43 smithi049 bash[23528]: audit 2024-09-21T02:11:41.769509+0000 mgr.a (mgr.14388) 10265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:11:44.424 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:44 smithi044 bash[22676]: cluster 2024-09-21T02:11:42.453519+0000 mgr.a (mgr.14388) 10266 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:44.424 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:44 smithi044 bash[22676]: audit 2024-09-21T02:11:42.519862+0000 mgr.a (mgr.14388) 10267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:11:44.424 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:44 smithi044 bash[22676]: cephadm 2024-09-21T02:11:42.521042+0000 mgr.a (mgr.14388) 10268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:11:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:44 smithi179 bash[23186]: cluster 2024-09-21T02:11:42.453519+0000 mgr.a (mgr.14388) 10266 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:44 smithi179 bash[23186]: audit 2024-09-21T02:11:42.519862+0000 mgr.a (mgr.14388) 10267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:11:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:44 smithi179 bash[23186]: cephadm 2024-09-21T02:11:42.521042+0000 mgr.a (mgr.14388) 10268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:11:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:44 smithi049 bash[23528]: cluster 2024-09-21T02:11:42.453519+0000 mgr.a (mgr.14388) 10266 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:44 smithi049 bash[23528]: audit 2024-09-21T02:11:42.519862+0000 mgr.a (mgr.14388) 10267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:11:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:44 smithi049 bash[23528]: cephadm 2024-09-21T02:11:42.521042+0000 mgr.a (mgr.14388) 10268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:11:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:44.798 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:44.799 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:45.554 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:45.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:45.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:45.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:45.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:45 smithi049 bash[23528]: cluster 2024-09-21T02:11:44.454257+0000 mgr.a (mgr.14388) 10269 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:45 smithi049 bash[23528]: audit 2024-09-21T02:11:44.800808+0000 mon.a (mon.0) 8516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:45 smithi049 bash[23528]: audit 2024-09-21T02:11:44.810264+0000 mon.a (mon.0) 8517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:45 smithi049 bash[23528]: audit 2024-09-21T02:11:44.821099+0000 mon.a (mon.0) 8518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:45 smithi049 bash[23528]: audit 2024-09-21T02:11:45.138684+0000 mgr.a (mgr.14388) 10270 : audit [DBG] from='client.226923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:45 smithi044 bash[22676]: cluster 2024-09-21T02:11:44.454257+0000 mgr.a (mgr.14388) 10269 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:45 smithi044 bash[22676]: audit 2024-09-21T02:11:44.800808+0000 mon.a (mon.0) 8516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:45 smithi044 bash[22676]: audit 2024-09-21T02:11:44.810264+0000 mon.a (mon.0) 8517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:45 smithi044 bash[22676]: audit 2024-09-21T02:11:44.821099+0000 mon.a (mon.0) 8518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:45 smithi044 bash[22676]: audit 2024-09-21T02:11:45.138684+0000 mgr.a (mgr.14388) 10270 : audit [DBG] from='client.226923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:45 smithi179 bash[23186]: cluster 2024-09-21T02:11:44.454257+0000 mgr.a (mgr.14388) 10269 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:11:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:45 smithi179 bash[23186]: audit 2024-09-21T02:11:44.800808+0000 mon.a (mon.0) 8516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:45 smithi179 bash[23186]: audit 2024-09-21T02:11:44.810264+0000 mon.a (mon.0) 8517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:45 smithi179 bash[23186]: audit 2024-09-21T02:11:44.821099+0000 mon.a (mon.0) 8518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:45 smithi179 bash[23186]: audit 2024-09-21T02:11:45.138684+0000 mgr.a (mgr.14388) 10270 : audit [DBG] from='client.226923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:47 smithi044 bash[22676]: cluster 2024-09-21T02:11:46.455623+0000 mgr.a (mgr.14388) 10271 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:47 smithi179 bash[23186]: cluster 2024-09-21T02:11:46.455623+0000 mgr.a (mgr.14388) 10271 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:47 smithi049 bash[23528]: cluster 2024-09-21T02:11:46.455623+0000 mgr.a (mgr.14388) 10271 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:49.826 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:49 smithi179 bash[23186]: cluster 2024-09-21T02:11:48.456370+0000 mgr.a (mgr.14388) 10272 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:49 smithi044 bash[22676]: cluster 2024-09-21T02:11:48.456370+0000 mgr.a (mgr.14388) 10272 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:49 smithi049 bash[23528]: cluster 2024-09-21T02:11:48.456370+0000 mgr.a (mgr.14388) 10272 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:51.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:51.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:51.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:51.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:51.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:51 smithi049 bash[23528]: cluster 2024-09-21T02:11:50.458340+0000 mgr.a (mgr.14388) 10273 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:51 smithi049 bash[23528]: audit 2024-09-21T02:11:50.895326+0000 mgr.a (mgr.14388) 10274 : audit [DBG] from='client.227001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:52.087 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:51 smithi179 bash[23186]: cluster 2024-09-21T02:11:50.458340+0000 mgr.a (mgr.14388) 10273 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:52.087 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:51 smithi179 bash[23186]: audit 2024-09-21T02:11:50.895326+0000 mgr.a (mgr.14388) 10274 : audit [DBG] from='client.227001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:51 smithi044 bash[22676]: cluster 2024-09-21T02:11:50.458340+0000 mgr.a (mgr.14388) 10273 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:51 smithi044 bash[22676]: audit 2024-09-21T02:11:50.895326+0000 mgr.a (mgr.14388) 10274 : audit [DBG] from='client.227001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:54.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:53 smithi049 bash[23528]: cluster 2024-09-21T02:11:52.459113+0000 mgr.a (mgr.14388) 10275 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:53 smithi044 bash[22676]: cluster 2024-09-21T02:11:52.459113+0000 mgr.a (mgr.14388) 10275 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:53 smithi179 bash[23186]: cluster 2024-09-21T02:11:52.459113+0000 mgr.a (mgr.14388) 10275 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:55 smithi044 bash[22676]: cluster 2024-09-21T02:11:54.459877+0000 mgr.a (mgr.14388) 10276 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:55 smithi179 bash[23186]: cluster 2024-09-21T02:11:54.459877+0000 mgr.a (mgr.14388) 10276 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:55 smithi049 bash[23528]: cluster 2024-09-21T02:11:54.459877+0000 mgr.a (mgr.14388) 10276 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:11:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:11:56.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:11:56.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:11:57.087 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:11:57.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:11:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:11:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:11:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:11:58.131 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:57 smithi179 bash[23186]: cluster 2024-09-21T02:11:56.460971+0000 mgr.a (mgr.14388) 10277 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:58.131 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:57 smithi179 bash[23186]: audit 2024-09-21T02:11:56.661385+0000 mgr.a (mgr.14388) 10278 : audit [DBG] from='client.227079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:57 smithi044 bash[22676]: cluster 2024-09-21T02:11:56.460971+0000 mgr.a (mgr.14388) 10277 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:57 smithi044 bash[22676]: audit 2024-09-21T02:11:56.661385+0000 mgr.a (mgr.14388) 10278 : audit [DBG] from='client.227079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:57 smithi049 bash[23528]: cluster 2024-09-21T02:11:56.460971+0000 mgr.a (mgr.14388) 10277 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:11:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:57 smithi049 bash[23528]: audit 2024-09-21T02:11:56.661385+0000 mgr.a (mgr.14388) 10278 : audit [DBG] from='client.227079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:11:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:59 smithi044 bash[22676]: audit 2024-09-21T02:11:58.114377+0000 mon.a (mon.0) 8519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:59 smithi044 bash[22676]: audit 2024-09-21T02:11:58.121373+0000 mon.a (mon.0) 8520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:59 smithi044 bash[22676]: audit 2024-09-21T02:11:58.129554+0000 mon.a (mon.0) 8521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:59 smithi044 bash[22676]: audit 2024-09-21T02:11:58.273609+0000 mon.a (mon.0) 8522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:59 smithi044 bash[22676]: audit 2024-09-21T02:11:58.281955+0000 mon.a (mon.0) 8523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:11:59 smithi044 bash[22676]: audit 2024-09-21T02:11:58.292109+0000 mon.a (mon.0) 8524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:59 smithi179 bash[23186]: audit 2024-09-21T02:11:58.114377+0000 mon.a (mon.0) 8519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:59 smithi179 bash[23186]: audit 2024-09-21T02:11:58.121373+0000 mon.a (mon.0) 8520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:59 smithi179 bash[23186]: audit 2024-09-21T02:11:58.129554+0000 mon.a (mon.0) 8521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:59 smithi179 bash[23186]: audit 2024-09-21T02:11:58.273609+0000 mon.a (mon.0) 8522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:59 smithi179 bash[23186]: audit 2024-09-21T02:11:58.281955+0000 mon.a (mon.0) 8523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:11:59 smithi179 bash[23186]: audit 2024-09-21T02:11:58.292109+0000 mon.a (mon.0) 8524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:59 smithi049 bash[23528]: audit 2024-09-21T02:11:58.114377+0000 mon.a (mon.0) 8519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:59 smithi049 bash[23528]: audit 2024-09-21T02:11:58.121373+0000 mon.a (mon.0) 8520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:59 smithi049 bash[23528]: audit 2024-09-21T02:11:58.129554+0000 mon.a (mon.0) 8521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:59 smithi049 bash[23528]: audit 2024-09-21T02:11:58.273609+0000 mon.a (mon.0) 8522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:59 smithi049 bash[23528]: audit 2024-09-21T02:11:58.281955+0000 mon.a (mon.0) 8523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:11:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:11:59 smithi049 bash[23528]: audit 2024-09-21T02:11:58.292109+0000 mon.a (mon.0) 8524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:00 smithi044 bash[22676]: cluster 2024-09-21T02:11:58.461871+0000 mgr.a (mgr.14388) 10279 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:00 smithi179 bash[23186]: cluster 2024-09-21T02:11:58.461871+0000 mgr.a (mgr.14388) 10279 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:00 smithi049 bash[23528]: cluster 2024-09-21T02:11:58.461871+0000 mgr.a (mgr.14388) 10279 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:02.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:02.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:02.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:02 smithi044 bash[22676]: cluster 2024-09-21T02:12:00.464027+0000 mgr.a (mgr.14388) 10280 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:02 smithi179 bash[23186]: cluster 2024-09-21T02:12:00.464027+0000 mgr.a (mgr.14388) 10280 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:02 smithi049 bash[23528]: cluster 2024-09-21T02:12:00.464027+0000 mgr.a (mgr.14388) 10280 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:02.878 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:04.455 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:04 smithi044 bash[22676]: audit 2024-09-21T02:12:02.425746+0000 mgr.a (mgr.14388) 10281 : audit [DBG] from='client.227157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:04.455 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:04 smithi044 bash[22676]: cluster 2024-09-21T02:12:02.465015+0000 mgr.a (mgr.14388) 10282 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:04 smithi179 bash[23186]: audit 2024-09-21T02:12:02.425746+0000 mgr.a (mgr.14388) 10281 : audit [DBG] from='client.227157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:04 smithi179 bash[23186]: cluster 2024-09-21T02:12:02.465015+0000 mgr.a (mgr.14388) 10282 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:04 smithi049 bash[23528]: audit 2024-09-21T02:12:02.425746+0000 mgr.a (mgr.14388) 10281 : audit [DBG] from='client.227157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:04 smithi049 bash[23528]: cluster 2024-09-21T02:12:02.465015+0000 mgr.a (mgr.14388) 10282 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:06 smithi049 bash[23528]: cluster 2024-09-21T02:12:04.465989+0000 mgr.a (mgr.14388) 10283 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:06 smithi049 bash[23528]: audit 2024-09-21T02:12:05.030375+0000 mon.a (mon.0) 8525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:06 smithi049 bash[23528]: audit 2024-09-21T02:12:05.038904+0000 mon.a (mon.0) 8526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:06 smithi049 bash[23528]: audit 2024-09-21T02:12:05.048574+0000 mon.a (mon.0) 8527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:06 smithi044 bash[22676]: cluster 2024-09-21T02:12:04.465989+0000 mgr.a (mgr.14388) 10283 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:06 smithi044 bash[22676]: audit 2024-09-21T02:12:05.030375+0000 mon.a (mon.0) 8525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:06 smithi044 bash[22676]: audit 2024-09-21T02:12:05.038904+0000 mon.a (mon.0) 8526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:06 smithi044 bash[22676]: audit 2024-09-21T02:12:05.048574+0000 mon.a (mon.0) 8527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:06 smithi179 bash[23186]: cluster 2024-09-21T02:12:04.465989+0000 mgr.a (mgr.14388) 10283 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:06 smithi179 bash[23186]: audit 2024-09-21T02:12:05.030375+0000 mon.a (mon.0) 8525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:06 smithi179 bash[23186]: audit 2024-09-21T02:12:05.038904+0000 mon.a (mon.0) 8526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:06 smithi179 bash[23186]: audit 2024-09-21T02:12:05.048574+0000 mon.a (mon.0) 8527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:07.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:07.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:07.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:08 smithi049 bash[23528]: cluster 2024-09-21T02:12:06.467330+0000 mgr.a (mgr.14388) 10284 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:08 smithi044 bash[22676]: cluster 2024-09-21T02:12:06.467330+0000 mgr.a (mgr.14388) 10284 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:08 smithi179 bash[23186]: cluster 2024-09-21T02:12:06.467330+0000 mgr.a (mgr.14388) 10284 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:08.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:08.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:08.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:10.162 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:10 smithi179 bash[23186]: audit 2024-09-21T02:12:08.217545+0000 mgr.a (mgr.14388) 10285 : audit [DBG] from='client.227229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:10.162 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:10 smithi179 bash[23186]: cluster 2024-09-21T02:12:08.467906+0000 mgr.a (mgr.14388) 10286 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:10 smithi049 bash[23528]: audit 2024-09-21T02:12:08.217545+0000 mgr.a (mgr.14388) 10285 : audit [DBG] from='client.227229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:10 smithi049 bash[23528]: cluster 2024-09-21T02:12:08.467906+0000 mgr.a (mgr.14388) 10286 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:10 smithi044 bash[22676]: audit 2024-09-21T02:12:08.217545+0000 mgr.a (mgr.14388) 10285 : audit [DBG] from='client.227229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:10 smithi044 bash[22676]: cluster 2024-09-21T02:12:08.467906+0000 mgr.a (mgr.14388) 10286 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:12 smithi049 bash[23528]: cluster 2024-09-21T02:12:10.469234+0000 mgr.a (mgr.14388) 10287 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:12.444 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:12 smithi179 bash[23186]: cluster 2024-09-21T02:12:10.469234+0000 mgr.a (mgr.14388) 10287 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:12 smithi044 bash[22676]: cluster 2024-09-21T02:12:10.469234+0000 mgr.a (mgr.14388) 10287 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:13.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:13.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:13.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:14 smithi049 bash[23528]: cluster 2024-09-21T02:12:12.470042+0000 mgr.a (mgr.14388) 10288 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:14.416 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:14.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:14 smithi044 bash[22676]: cluster 2024-09-21T02:12:12.470042+0000 mgr.a (mgr.14388) 10288 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:14 smithi179 bash[23186]: cluster 2024-09-21T02:12:12.470042+0000 mgr.a (mgr.14388) 10288 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:15 smithi044 bash[22676]: audit 2024-09-21T02:12:13.992905+0000 mgr.a (mgr.14388) 10289 : audit [DBG] from='client.227304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:15 smithi179 bash[23186]: audit 2024-09-21T02:12:13.992905+0000 mgr.a (mgr.14388) 10289 : audit [DBG] from='client.227304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:15 smithi049 bash[23528]: audit 2024-09-21T02:12:13.992905+0000 mgr.a (mgr.14388) 10289 : audit [DBG] from='client.227304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:16 smithi044 bash[22676]: cluster 2024-09-21T02:12:14.471039+0000 mgr.a (mgr.14388) 10290 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:16 smithi179 bash[23186]: cluster 2024-09-21T02:12:14.471039+0000 mgr.a (mgr.14388) 10290 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:16 smithi049 bash[23528]: cluster 2024-09-21T02:12:14.471039+0000 mgr.a (mgr.14388) 10290 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:18.341 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:18 smithi179 bash[23186]: cluster 2024-09-21T02:12:16.473308+0000 mgr.a (mgr.14388) 10291 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:18 smithi044 bash[22676]: cluster 2024-09-21T02:12:16.473308+0000 mgr.a (mgr.14388) 10291 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:18 smithi049 bash[23528]: cluster 2024-09-21T02:12:16.473308+0000 mgr.a (mgr.14388) 10291 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:19.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:19.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:19.419 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:19 smithi044 bash[22676]: audit 2024-09-21T02:12:18.328233+0000 mon.a (mon.0) 8528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:19 smithi044 bash[22676]: audit 2024-09-21T02:12:18.333901+0000 mon.a (mon.0) 8529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:19 smithi044 bash[22676]: audit 2024-09-21T02:12:18.340807+0000 mon.a (mon.0) 8530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:19 smithi044 bash[22676]: cluster 2024-09-21T02:12:18.474069+0000 mgr.a (mgr.14388) 10292 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:19 smithi044 bash[22676]: audit 2024-09-21T02:12:18.503883+0000 mon.a (mon.0) 8531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:19 smithi044 bash[22676]: audit 2024-09-21T02:12:18.511647+0000 mon.a (mon.0) 8532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:19 smithi044 bash[22676]: audit 2024-09-21T02:12:18.519949+0000 mon.a (mon.0) 8533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:19 smithi179 bash[23186]: audit 2024-09-21T02:12:18.328233+0000 mon.a (mon.0) 8528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:19 smithi179 bash[23186]: audit 2024-09-21T02:12:18.333901+0000 mon.a (mon.0) 8529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:19 smithi179 bash[23186]: audit 2024-09-21T02:12:18.340807+0000 mon.a (mon.0) 8530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:19 smithi179 bash[23186]: cluster 2024-09-21T02:12:18.474069+0000 mgr.a (mgr.14388) 10292 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:19 smithi179 bash[23186]: audit 2024-09-21T02:12:18.503883+0000 mon.a (mon.0) 8531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:19 smithi179 bash[23186]: audit 2024-09-21T02:12:18.511647+0000 mon.a (mon.0) 8532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:19 smithi179 bash[23186]: audit 2024-09-21T02:12:18.519949+0000 mon.a (mon.0) 8533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:19 smithi049 bash[23528]: audit 2024-09-21T02:12:18.328233+0000 mon.a (mon.0) 8528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:19 smithi049 bash[23528]: audit 2024-09-21T02:12:18.333901+0000 mon.a (mon.0) 8529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:19 smithi049 bash[23528]: audit 2024-09-21T02:12:18.340807+0000 mon.a (mon.0) 8530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:19 smithi049 bash[23528]: cluster 2024-09-21T02:12:18.474069+0000 mgr.a (mgr.14388) 10292 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:19 smithi049 bash[23528]: audit 2024-09-21T02:12:18.503883+0000 mon.a (mon.0) 8531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:19 smithi049 bash[23528]: audit 2024-09-21T02:12:18.511647+0000 mon.a (mon.0) 8532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:19 smithi049 bash[23528]: audit 2024-09-21T02:12:18.519949+0000 mon.a (mon.0) 8533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:20 smithi044 bash[22676]: audit 2024-09-21T02:12:19.750468+0000 mgr.a (mgr.14388) 10293 : audit [DBG] from='client.227382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:20.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:20 smithi049 bash[23528]: audit 2024-09-21T02:12:19.750468+0000 mgr.a (mgr.14388) 10293 : audit [DBG] from='client.227382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:20 smithi179 bash[23186]: audit 2024-09-21T02:12:19.750468+0000 mgr.a (mgr.14388) 10293 : audit [DBG] from='client.227382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:21 smithi044 bash[22676]: cluster 2024-09-21T02:12:20.476985+0000 mgr.a (mgr.14388) 10294 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:12:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:21 smithi179 bash[23186]: cluster 2024-09-21T02:12:20.476985+0000 mgr.a (mgr.14388) 10294 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:12:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:21 smithi049 bash[23528]: cluster 2024-09-21T02:12:20.476985+0000 mgr.a (mgr.14388) 10294 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:12:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:23 smithi044 bash[22676]: cluster 2024-09-21T02:12:22.477958+0000 mgr.a (mgr.14388) 10295 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:12:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:23 smithi049 bash[23528]: cluster 2024-09-21T02:12:22.477958+0000 mgr.a (mgr.14388) 10295 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:12:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:23 smithi179 bash[23186]: cluster 2024-09-21T02:12:22.477958+0000 mgr.a (mgr.14388) 10295 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:12:25.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:25 smithi049 bash[23528]: cluster 2024-09-21T02:12:24.478763+0000 mgr.a (mgr.14388) 10296 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:12:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:25 smithi049 bash[23528]: audit 2024-09-21T02:12:25.230990+0000 mon.a (mon.0) 8534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:25 smithi049 bash[23528]: audit 2024-09-21T02:12:25.236810+0000 mon.a (mon.0) 8535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:25 smithi049 bash[23528]: audit 2024-09-21T02:12:25.245778+0000 mon.a (mon.0) 8536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:25.973 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:25.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:25.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:25.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:25.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:25 smithi044 bash[22676]: cluster 2024-09-21T02:12:24.478763+0000 mgr.a (mgr.14388) 10296 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:12:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:25 smithi044 bash[22676]: audit 2024-09-21T02:12:25.230990+0000 mon.a (mon.0) 8534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:25 smithi044 bash[22676]: audit 2024-09-21T02:12:25.236810+0000 mon.a (mon.0) 8535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:25 smithi044 bash[22676]: audit 2024-09-21T02:12:25.245778+0000 mon.a (mon.0) 8536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:25 smithi179 bash[23186]: cluster 2024-09-21T02:12:24.478763+0000 mgr.a (mgr.14388) 10296 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:12:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:25 smithi179 bash[23186]: audit 2024-09-21T02:12:25.230990+0000 mon.a (mon.0) 8534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:25 smithi179 bash[23186]: audit 2024-09-21T02:12:25.236810+0000 mon.a (mon.0) 8535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:25 smithi179 bash[23186]: audit 2024-09-21T02:12:25.245778+0000 mon.a (mon.0) 8536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:26 smithi049 bash[23528]: audit 2024-09-21T02:12:25.530917+0000 mgr.a (mgr.14388) 10297 : audit [DBG] from='client.227457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:26 smithi044 bash[22676]: audit 2024-09-21T02:12:25.530917+0000 mgr.a (mgr.14388) 10297 : audit [DBG] from='client.227457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:27.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:26 smithi179 bash[23186]: audit 2024-09-21T02:12:25.530917+0000 mgr.a (mgr.14388) 10297 : audit [DBG] from='client.227457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:27 smithi049 bash[23528]: cluster 2024-09-21T02:12:26.481611+0000 mgr.a (mgr.14388) 10298 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:27 smithi044 bash[22676]: cluster 2024-09-21T02:12:26.481611+0000 mgr.a (mgr.14388) 10298 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:27 smithi179 bash[23186]: cluster 2024-09-21T02:12:26.481611+0000 mgr.a (mgr.14388) 10298 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:29 smithi179 bash[23186]: cluster 2024-09-21T02:12:28.482393+0000 mgr.a (mgr.14388) 10299 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:12:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:29 smithi044 bash[22676]: cluster 2024-09-21T02:12:28.482393+0000 mgr.a (mgr.14388) 10299 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:12:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:29 smithi049 bash[23528]: cluster 2024-09-21T02:12:28.482393+0000 mgr.a (mgr.14388) 10299 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:12:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:30.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:31.755 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:31.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:31.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:31 smithi049 bash[23528]: cluster 2024-09-21T02:12:30.484327+0000 mgr.a (mgr.14388) 10300 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:31 smithi044 bash[22676]: cluster 2024-09-21T02:12:30.484327+0000 mgr.a (mgr.14388) 10300 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:31 smithi179 bash[23186]: cluster 2024-09-21T02:12:30.484327+0000 mgr.a (mgr.14388) 10300 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:32 smithi049 bash[23528]: audit 2024-09-21T02:12:31.309753+0000 mgr.a (mgr.14388) 10301 : audit [DBG] from='client.227532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:32.852 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:32 smithi179 bash[23186]: audit 2024-09-21T02:12:31.309753+0000 mgr.a (mgr.14388) 10301 : audit [DBG] from='client.227532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:32 smithi044 bash[22676]: audit 2024-09-21T02:12:31.309753+0000 mgr.a (mgr.14388) 10301 : audit [DBG] from='client.227532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:33.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:33 smithi049 bash[23528]: cluster 2024-09-21T02:12:32.485379+0000 mgr.a (mgr.14388) 10302 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:12:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:33 smithi044 bash[22676]: cluster 2024-09-21T02:12:32.485379+0000 mgr.a (mgr.14388) 10302 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:12:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:33 smithi179 bash[23186]: cluster 2024-09-21T02:12:32.485379+0000 mgr.a (mgr.14388) 10302 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:12:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:35 smithi044 bash[22676]: cluster 2024-09-21T02:12:34.486180+0000 mgr.a (mgr.14388) 10303 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:12:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:35 smithi179 bash[23186]: cluster 2024-09-21T02:12:34.486180+0000 mgr.a (mgr.14388) 10303 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:12:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:35 smithi049 bash[23528]: cluster 2024-09-21T02:12:34.486180+0000 mgr.a (mgr.14388) 10303 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:12:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:37.543 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:37.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:37.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:37.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:37.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:37 smithi044 bash[22676]: cluster 2024-09-21T02:12:36.488543+0000 mgr.a (mgr.14388) 10304 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:12:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:37 smithi044 bash[22676]: audit 2024-09-21T02:12:37.099219+0000 mgr.a (mgr.14388) 10305 : audit [DBG] from='client.227607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:37 smithi179 bash[23186]: cluster 2024-09-21T02:12:36.488543+0000 mgr.a (mgr.14388) 10304 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:12:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:37 smithi179 bash[23186]: audit 2024-09-21T02:12:37.099219+0000 mgr.a (mgr.14388) 10305 : audit [DBG] from='client.227607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:37 smithi049 bash[23528]: cluster 2024-09-21T02:12:36.488543+0000 mgr.a (mgr.14388) 10304 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:12:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:37 smithi049 bash[23528]: audit 2024-09-21T02:12:37.099219+0000 mgr.a (mgr.14388) 10305 : audit [DBG] from='client.227607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:39 smithi049 bash[23528]: cluster 2024-09-21T02:12:38.489724+0000 mgr.a (mgr.14388) 10306 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:39 smithi049 bash[23528]: audit 2024-09-21T02:12:38.545108+0000 mon.a (mon.0) 8537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:39 smithi049 bash[23528]: audit 2024-09-21T02:12:38.552902+0000 mon.a (mon.0) 8538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:39 smithi049 bash[23528]: audit 2024-09-21T02:12:38.561749+0000 mon.a (mon.0) 8539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:39 smithi049 bash[23528]: audit 2024-09-21T02:12:38.686215+0000 mon.a (mon.0) 8540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:39 smithi049 bash[23528]: audit 2024-09-21T02:12:38.692277+0000 mon.a (mon.0) 8541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:39 smithi049 bash[23528]: audit 2024-09-21T02:12:38.699794+0000 mon.a (mon.0) 8542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:39 smithi044 bash[22676]: cluster 2024-09-21T02:12:38.489724+0000 mgr.a (mgr.14388) 10306 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:39 smithi044 bash[22676]: audit 2024-09-21T02:12:38.545108+0000 mon.a (mon.0) 8537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:39 smithi044 bash[22676]: audit 2024-09-21T02:12:38.552902+0000 mon.a (mon.0) 8538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:39 smithi044 bash[22676]: audit 2024-09-21T02:12:38.561749+0000 mon.a (mon.0) 8539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:39 smithi044 bash[22676]: audit 2024-09-21T02:12:38.686215+0000 mon.a (mon.0) 8540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:39 smithi044 bash[22676]: audit 2024-09-21T02:12:38.692277+0000 mon.a (mon.0) 8541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:39 smithi044 bash[22676]: audit 2024-09-21T02:12:38.699794+0000 mon.a (mon.0) 8542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:39 smithi179 bash[23186]: cluster 2024-09-21T02:12:38.489724+0000 mgr.a (mgr.14388) 10306 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:39 smithi179 bash[23186]: audit 2024-09-21T02:12:38.545108+0000 mon.a (mon.0) 8537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:39 smithi179 bash[23186]: audit 2024-09-21T02:12:38.552902+0000 mon.a (mon.0) 8538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:39 smithi179 bash[23186]: audit 2024-09-21T02:12:38.561749+0000 mon.a (mon.0) 8539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:39 smithi179 bash[23186]: audit 2024-09-21T02:12:38.686215+0000 mon.a (mon.0) 8540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:39 smithi179 bash[23186]: audit 2024-09-21T02:12:38.692277+0000 mon.a (mon.0) 8541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:39 smithi179 bash[23186]: audit 2024-09-21T02:12:38.699794+0000 mon.a (mon.0) 8542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:41 smithi049 bash[23528]: cluster 2024-09-21T02:12:40.491896+0000 mgr.a (mgr.14388) 10307 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:41 smithi044 bash[22676]: cluster 2024-09-21T02:12:40.491896+0000 mgr.a (mgr.14388) 10307 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:41 smithi179 bash[23186]: cluster 2024-09-21T02:12:40.491896+0000 mgr.a (mgr.14388) 10307 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:43.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22930]: debug 2024-09-21T02:12:43.342+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:12:43.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22930]: debug 2024-09-21T02:12:43.354+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:12:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: cluster 2024-09-21T02:12:42.492659+0000 mgr.a (mgr.14388) 10308 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: audit 2024-09-21T02:12:42.569525+0000 mon.a (mon.0) 8543 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:12:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: audit 2024-09-21T02:12:42.574982+0000 mon.a (mon.0) 8544 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:12:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: audit 2024-09-21T02:12:42.576649+0000 mon.a (mon.0) 8545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:12:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: audit 2024-09-21T02:12:42.585657+0000 mon.a (mon.0) 8546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: audit 2024-09-21T02:12:42.590313+0000 mon.a (mon.0) 8547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:12:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: audit 2024-09-21T02:12:42.592602+0000 mgr.a (mgr.14388) 10309 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:12:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:43 smithi044 bash[22676]: audit 2024-09-21T02:12:42.905512+0000 mgr.a (mgr.14388) 10310 : audit [DBG] from='client.227685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:43.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:43.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:43.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:43.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: cluster 2024-09-21T02:12:42.492659+0000 mgr.a (mgr.14388) 10308 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: audit 2024-09-21T02:12:42.569525+0000 mon.a (mon.0) 8543 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: audit 2024-09-21T02:12:42.574982+0000 mon.a (mon.0) 8544 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: audit 2024-09-21T02:12:42.576649+0000 mon.a (mon.0) 8545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: audit 2024-09-21T02:12:42.585657+0000 mon.a (mon.0) 8546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: audit 2024-09-21T02:12:42.590313+0000 mon.a (mon.0) 8547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: audit 2024-09-21T02:12:42.592602+0000 mgr.a (mgr.14388) 10309 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:12:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:43 smithi049 bash[23528]: audit 2024-09-21T02:12:42.905512+0000 mgr.a (mgr.14388) 10310 : audit [DBG] from='client.227685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: cluster 2024-09-21T02:12:42.492659+0000 mgr.a (mgr.14388) 10308 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: audit 2024-09-21T02:12:42.569525+0000 mon.a (mon.0) 8543 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:12:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: audit 2024-09-21T02:12:42.574982+0000 mon.a (mon.0) 8544 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:12:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: audit 2024-09-21T02:12:42.576649+0000 mon.a (mon.0) 8545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:12:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: audit 2024-09-21T02:12:42.585657+0000 mon.a (mon.0) 8546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: audit 2024-09-21T02:12:42.590313+0000 mon.a (mon.0) 8547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:12:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: audit 2024-09-21T02:12:42.592602+0000 mgr.a (mgr.14388) 10309 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:12:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:43 smithi179 bash[23186]: audit 2024-09-21T02:12:42.905512+0000 mgr.a (mgr.14388) 10310 : audit [DBG] from='client.227685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:44.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:44 smithi044 bash[22676]: audit 2024-09-21T02:12:43.345698+0000 mgr.a (mgr.14388) 10311 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:12:44.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:44 smithi044 bash[22676]: cephadm 2024-09-21T02:12:43.361072+0000 mgr.a (mgr.14388) 10312 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:12:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:44 smithi179 bash[23186]: audit 2024-09-21T02:12:43.345698+0000 mgr.a (mgr.14388) 10311 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:12:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:44 smithi179 bash[23186]: cephadm 2024-09-21T02:12:43.361072+0000 mgr.a (mgr.14388) 10312 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:12:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:44 smithi049 bash[23528]: audit 2024-09-21T02:12:43.345698+0000 mgr.a (mgr.14388) 10311 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:12:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:44 smithi049 bash[23528]: cephadm 2024-09-21T02:12:43.361072+0000 mgr.a (mgr.14388) 10312 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:45 smithi049 bash[23528]: cluster 2024-09-21T02:12:44.493653+0000 mgr.a (mgr.14388) 10313 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:45 smithi049 bash[23528]: audit 2024-09-21T02:12:45.459721+0000 mon.a (mon.0) 8548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:45 smithi049 bash[23528]: audit 2024-09-21T02:12:45.469547+0000 mon.a (mon.0) 8549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:45 smithi049 bash[23528]: audit 2024-09-21T02:12:45.481617+0000 mon.a (mon.0) 8550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:45.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:45 smithi044 bash[22676]: cluster 2024-09-21T02:12:44.493653+0000 mgr.a (mgr.14388) 10313 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:45.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:45 smithi044 bash[22676]: audit 2024-09-21T02:12:45.459721+0000 mon.a (mon.0) 8548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:45.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:45 smithi044 bash[22676]: audit 2024-09-21T02:12:45.469547+0000 mon.a (mon.0) 8549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:45.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:45 smithi044 bash[22676]: audit 2024-09-21T02:12:45.481617+0000 mon.a (mon.0) 8550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:45 smithi179 bash[23186]: cluster 2024-09-21T02:12:44.493653+0000 mgr.a (mgr.14388) 10313 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:12:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:45 smithi179 bash[23186]: audit 2024-09-21T02:12:45.459721+0000 mon.a (mon.0) 8548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:45 smithi179 bash[23186]: audit 2024-09-21T02:12:45.469547+0000 mon.a (mon.0) 8549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:45 smithi179 bash[23186]: audit 2024-09-21T02:12:45.481617+0000 mon.a (mon.0) 8550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:12:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:47 smithi044 bash[22676]: cluster 2024-09-21T02:12:46.495897+0000 mgr.a (mgr.14388) 10314 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:47 smithi179 bash[23186]: cluster 2024-09-21T02:12:46.495897+0000 mgr.a (mgr.14388) 10314 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:47 smithi049 bash[23528]: cluster 2024-09-21T02:12:46.495897+0000 mgr.a (mgr.14388) 10314 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:48.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:48.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:48.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:49.569 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:49 smithi044 bash[22676]: cluster 2024-09-21T02:12:48.496664+0000 mgr.a (mgr.14388) 10315 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:49 smithi044 bash[22676]: audit 2024-09-21T02:12:49.121280+0000 mgr.a (mgr.14388) 10316 : audit [DBG] from='client.227871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:49 smithi179 bash[23186]: cluster 2024-09-21T02:12:48.496664+0000 mgr.a (mgr.14388) 10315 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:49 smithi179 bash[23186]: audit 2024-09-21T02:12:49.121280+0000 mgr.a (mgr.14388) 10316 : audit [DBG] from='client.227871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:49 smithi049 bash[23528]: cluster 2024-09-21T02:12:48.496664+0000 mgr.a (mgr.14388) 10315 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:49 smithi049 bash[23528]: audit 2024-09-21T02:12:49.121280+0000 mgr.a (mgr.14388) 10316 : audit [DBG] from='client.227871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:51 smithi179 bash[23186]: cluster 2024-09-21T02:12:50.499162+0000 mgr.a (mgr.14388) 10317 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:51 smithi044 bash[22676]: cluster 2024-09-21T02:12:50.499162+0000 mgr.a (mgr.14388) 10317 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:51 smithi049 bash[23528]: cluster 2024-09-21T02:12:50.499162+0000 mgr.a (mgr.14388) 10317 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:53 smithi044 bash[22676]: cluster 2024-09-21T02:12:52.500022+0000 mgr.a (mgr.14388) 10318 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:53 smithi179 bash[23186]: cluster 2024-09-21T02:12:52.500022+0000 mgr.a (mgr.14388) 10318 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:53 smithi049 bash[23528]: cluster 2024-09-21T02:12:52.500022+0000 mgr.a (mgr.14388) 10318 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:12:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:12:54.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:12:55.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:12:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:12:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:12:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:12:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:12:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:55 smithi044 bash[22676]: cluster 2024-09-21T02:12:54.500988+0000 mgr.a (mgr.14388) 10319 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:55 smithi044 bash[22676]: audit 2024-09-21T02:12:54.899834+0000 mgr.a (mgr.14388) 10320 : audit [DBG] from='client.227949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:55 smithi179 bash[23186]: cluster 2024-09-21T02:12:54.500988+0000 mgr.a (mgr.14388) 10319 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:55 smithi179 bash[23186]: audit 2024-09-21T02:12:54.899834+0000 mgr.a (mgr.14388) 10320 : audit [DBG] from='client.227949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:55 smithi049 bash[23528]: cluster 2024-09-21T02:12:54.500988+0000 mgr.a (mgr.14388) 10319 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:55 smithi049 bash[23528]: audit 2024-09-21T02:12:54.899834+0000 mgr.a (mgr.14388) 10320 : audit [DBG] from='client.227949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:12:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:57 smithi044 bash[22676]: cluster 2024-09-21T02:12:56.503796+0000 mgr.a (mgr.14388) 10321 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:57 smithi179 bash[23186]: cluster 2024-09-21T02:12:56.503796+0000 mgr.a (mgr.14388) 10321 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:12:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:57 smithi049 bash[23528]: cluster 2024-09-21T02:12:56.503796+0000 mgr.a (mgr.14388) 10321 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:59 smithi179 bash[23186]: cluster 2024-09-21T02:12:58.504563+0000 mgr.a (mgr.14388) 10322 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:59 smithi179 bash[23186]: audit 2024-09-21T02:12:58.742111+0000 mon.a (mon.0) 8551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:59 smithi179 bash[23186]: audit 2024-09-21T02:12:58.748099+0000 mon.a (mon.0) 8552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:59 smithi179 bash[23186]: audit 2024-09-21T02:12:58.758815+0000 mon.a (mon.0) 8553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:59 smithi179 bash[23186]: audit 2024-09-21T02:12:58.887059+0000 mon.a (mon.0) 8554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:59 smithi179 bash[23186]: audit 2024-09-21T02:12:58.895119+0000 mon.a (mon.0) 8555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:12:59 smithi179 bash[23186]: audit 2024-09-21T02:12:58.905328+0000 mon.a (mon.0) 8556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:59 smithi049 bash[23528]: cluster 2024-09-21T02:12:58.504563+0000 mgr.a (mgr.14388) 10322 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:59 smithi049 bash[23528]: audit 2024-09-21T02:12:58.742111+0000 mon.a (mon.0) 8551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:59 smithi049 bash[23528]: audit 2024-09-21T02:12:58.748099+0000 mon.a (mon.0) 8552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:59 smithi049 bash[23528]: audit 2024-09-21T02:12:58.758815+0000 mon.a (mon.0) 8553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:59 smithi049 bash[23528]: audit 2024-09-21T02:12:58.887059+0000 mon.a (mon.0) 8554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:59 smithi049 bash[23528]: audit 2024-09-21T02:12:58.895119+0000 mon.a (mon.0) 8555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:12:59 smithi049 bash[23528]: audit 2024-09-21T02:12:58.905328+0000 mon.a (mon.0) 8556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:59 smithi044 bash[22676]: cluster 2024-09-21T02:12:58.504563+0000 mgr.a (mgr.14388) 10322 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:59 smithi044 bash[22676]: audit 2024-09-21T02:12:58.742111+0000 mon.a (mon.0) 8551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:59 smithi044 bash[22676]: audit 2024-09-21T02:12:58.748099+0000 mon.a (mon.0) 8552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:59 smithi044 bash[22676]: audit 2024-09-21T02:12:58.758815+0000 mon.a (mon.0) 8553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:59 smithi044 bash[22676]: audit 2024-09-21T02:12:58.887059+0000 mon.a (mon.0) 8554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:59 smithi044 bash[22676]: audit 2024-09-21T02:12:58.895119+0000 mon.a (mon.0) 8555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:12:59 smithi044 bash[22676]: audit 2024-09-21T02:12:58.905328+0000 mon.a (mon.0) 8556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:00.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:01.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:01 smithi179 bash[23186]: cluster 2024-09-21T02:13:00.505856+0000 mgr.a (mgr.14388) 10323 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:01 smithi179 bash[23186]: audit 2024-09-21T02:13:00.674196+0000 mgr.a (mgr.14388) 10324 : audit [DBG] from='client.228027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:01 smithi049 bash[23528]: cluster 2024-09-21T02:13:00.505856+0000 mgr.a (mgr.14388) 10323 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:01 smithi049 bash[23528]: audit 2024-09-21T02:13:00.674196+0000 mgr.a (mgr.14388) 10324 : audit [DBG] from='client.228027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:01 smithi044 bash[22676]: cluster 2024-09-21T02:13:00.505856+0000 mgr.a (mgr.14388) 10323 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:01 smithi044 bash[22676]: audit 2024-09-21T02:13:00.674196+0000 mgr.a (mgr.14388) 10324 : audit [DBG] from='client.228027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:03 smithi179 bash[23186]: cluster 2024-09-21T02:13:02.506739+0000 mgr.a (mgr.14388) 10325 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:04.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:03 smithi049 bash[23528]: cluster 2024-09-21T02:13:02.506739+0000 mgr.a (mgr.14388) 10325 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:04.179 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:03 smithi044 bash[22676]: cluster 2024-09-21T02:13:02.506739+0000 mgr.a (mgr.14388) 10325 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:06.028 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:05 smithi044 bash[22676]: cluster 2024-09-21T02:13:04.507500+0000 mgr.a (mgr.14388) 10326 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:13:06.029 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:05 smithi044 bash[22676]: audit 2024-09-21T02:13:05.695162+0000 mon.a (mon.0) 8557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.029 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:05 smithi044 bash[22676]: audit 2024-09-21T02:13:05.705776+0000 mon.a (mon.0) 8558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.029 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:05 smithi044 bash[22676]: audit 2024-09-21T02:13:05.718213+0000 mon.a (mon.0) 8559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:05 smithi049 bash[23528]: cluster 2024-09-21T02:13:04.507500+0000 mgr.a (mgr.14388) 10326 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:13:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:05 smithi049 bash[23528]: audit 2024-09-21T02:13:05.695162+0000 mon.a (mon.0) 8557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:05 smithi049 bash[23528]: audit 2024-09-21T02:13:05.705776+0000 mon.a (mon.0) 8558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:05 smithi049 bash[23528]: audit 2024-09-21T02:13:05.718213+0000 mon.a (mon.0) 8559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:05 smithi179 bash[23186]: cluster 2024-09-21T02:13:04.507500+0000 mgr.a (mgr.14388) 10326 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:13:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:05 smithi179 bash[23186]: audit 2024-09-21T02:13:05.695162+0000 mon.a (mon.0) 8557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:05 smithi179 bash[23186]: audit 2024-09-21T02:13:05.705776+0000 mon.a (mon.0) 8558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:05 smithi179 bash[23186]: audit 2024-09-21T02:13:05.718213+0000 mon.a (mon.0) 8559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:06.900 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:06.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:06.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:06.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:06.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:07 smithi044 bash[22676]: audit 2024-09-21T02:13:06.471947+0000 mgr.a (mgr.14388) 10327 : audit [DBG] from='client.228099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:07 smithi044 bash[22676]: cluster 2024-09-21T02:13:06.510606+0000 mgr.a (mgr.14388) 10328 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:08.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:07 smithi049 bash[23528]: audit 2024-09-21T02:13:06.471947+0000 mgr.a (mgr.14388) 10327 : audit [DBG] from='client.228099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:07 smithi049 bash[23528]: cluster 2024-09-21T02:13:06.510606+0000 mgr.a (mgr.14388) 10328 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:07 smithi179 bash[23186]: audit 2024-09-21T02:13:06.471947+0000 mgr.a (mgr.14388) 10327 : audit [DBG] from='client.228099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:07 smithi179 bash[23186]: cluster 2024-09-21T02:13:06.510606+0000 mgr.a (mgr.14388) 10328 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:09 smithi049 bash[23528]: cluster 2024-09-21T02:13:08.511559+0000 mgr.a (mgr.14388) 10329 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:09 smithi044 bash[22676]: cluster 2024-09-21T02:13:08.511559+0000 mgr.a (mgr.14388) 10329 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:09 smithi179 bash[23186]: cluster 2024-09-21T02:13:08.511559+0000 mgr.a (mgr.14388) 10329 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:11 smithi049 bash[23528]: cluster 2024-09-21T02:13:10.513731+0000 mgr.a (mgr.14388) 10330 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:11 smithi179 bash[23186]: cluster 2024-09-21T02:13:10.513731+0000 mgr.a (mgr.14388) 10330 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:11 smithi044 bash[22676]: cluster 2024-09-21T02:13:10.513731+0000 mgr.a (mgr.14388) 10330 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:12.670 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:13 smithi049 bash[23528]: audit 2024-09-21T02:13:12.243004+0000 mgr.a (mgr.14388) 10331 : audit [DBG] from='client.228174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:13 smithi049 bash[23528]: cluster 2024-09-21T02:13:12.514286+0000 mgr.a (mgr.14388) 10332 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:13 smithi044 bash[22676]: audit 2024-09-21T02:13:12.243004+0000 mgr.a (mgr.14388) 10331 : audit [DBG] from='client.228174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:13 smithi044 bash[22676]: cluster 2024-09-21T02:13:12.514286+0000 mgr.a (mgr.14388) 10332 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:13 smithi179 bash[23186]: audit 2024-09-21T02:13:12.243004+0000 mgr.a (mgr.14388) 10331 : audit [DBG] from='client.228174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:13 smithi179 bash[23186]: cluster 2024-09-21T02:13:12.514286+0000 mgr.a (mgr.14388) 10332 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:15 smithi049 bash[23528]: cluster 2024-09-21T02:13:14.515203+0000 mgr.a (mgr.14388) 10333 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:15 smithi044 bash[22676]: cluster 2024-09-21T02:13:14.515203+0000 mgr.a (mgr.14388) 10333 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:15 smithi179 bash[23186]: cluster 2024-09-21T02:13:14.515203+0000 mgr.a (mgr.14388) 10333 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:17.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:17.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:17 smithi049 bash[23528]: cluster 2024-09-21T02:13:16.517581+0000 mgr.a (mgr.14388) 10334 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:17 smithi044 bash[22676]: cluster 2024-09-21T02:13:16.517581+0000 mgr.a (mgr.14388) 10334 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:17 smithi179 bash[23186]: cluster 2024-09-21T02:13:16.517581+0000 mgr.a (mgr.14388) 10334 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:18.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:18.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:18.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:18.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:18.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:18 smithi049 bash[23528]: audit 2024-09-21T02:13:18.009377+0000 mgr.a (mgr.14388) 10335 : audit [DBG] from='client.228246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:19.095 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:18 smithi044 bash[22676]: audit 2024-09-21T02:13:18.009377+0000 mgr.a (mgr.14388) 10335 : audit [DBG] from='client.228246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:18 smithi179 bash[23186]: audit 2024-09-21T02:13:18.009377+0000 mgr.a (mgr.14388) 10335 : audit [DBG] from='client.228246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:19 smithi044 bash[22676]: cluster 2024-09-21T02:13:18.518252+0000 mgr.a (mgr.14388) 10336 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:19 smithi044 bash[22676]: audit 2024-09-21T02:13:18.963658+0000 mon.a (mon.0) 8560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:19 smithi044 bash[22676]: audit 2024-09-21T02:13:18.970285+0000 mon.a (mon.0) 8561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:19 smithi044 bash[22676]: audit 2024-09-21T02:13:18.978314+0000 mon.a (mon.0) 8562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:19 smithi044 bash[22676]: audit 2024-09-21T02:13:19.080065+0000 mon.a (mon.0) 8563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:19 smithi044 bash[22676]: audit 2024-09-21T02:13:19.086409+0000 mon.a (mon.0) 8564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:19 smithi044 bash[22676]: audit 2024-09-21T02:13:19.094063+0000 mon.a (mon.0) 8565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:19 smithi179 bash[23186]: cluster 2024-09-21T02:13:18.518252+0000 mgr.a (mgr.14388) 10336 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:19 smithi179 bash[23186]: audit 2024-09-21T02:13:18.963658+0000 mon.a (mon.0) 8560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:19 smithi179 bash[23186]: audit 2024-09-21T02:13:18.970285+0000 mon.a (mon.0) 8561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:19 smithi179 bash[23186]: audit 2024-09-21T02:13:18.978314+0000 mon.a (mon.0) 8562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:19 smithi179 bash[23186]: audit 2024-09-21T02:13:19.080065+0000 mon.a (mon.0) 8563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:19 smithi179 bash[23186]: audit 2024-09-21T02:13:19.086409+0000 mon.a (mon.0) 8564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:19 smithi179 bash[23186]: audit 2024-09-21T02:13:19.094063+0000 mon.a (mon.0) 8565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:19 smithi049 bash[23528]: cluster 2024-09-21T02:13:18.518252+0000 mgr.a (mgr.14388) 10336 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:19 smithi049 bash[23528]: audit 2024-09-21T02:13:18.963658+0000 mon.a (mon.0) 8560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:19 smithi049 bash[23528]: audit 2024-09-21T02:13:18.970285+0000 mon.a (mon.0) 8561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:19 smithi049 bash[23528]: audit 2024-09-21T02:13:18.978314+0000 mon.a (mon.0) 8562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:19 smithi049 bash[23528]: audit 2024-09-21T02:13:19.080065+0000 mon.a (mon.0) 8563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:19 smithi049 bash[23528]: audit 2024-09-21T02:13:19.086409+0000 mon.a (mon.0) 8564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:19 smithi049 bash[23528]: audit 2024-09-21T02:13:19.094063+0000 mon.a (mon.0) 8565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:21 smithi044 bash[22676]: cluster 2024-09-21T02:13:20.520323+0000 mgr.a (mgr.14388) 10337 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:21 smithi179 bash[23186]: cluster 2024-09-21T02:13:20.520323+0000 mgr.a (mgr.14388) 10337 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:21 smithi049 bash[23528]: cluster 2024-09-21T02:13:20.520323+0000 mgr.a (mgr.14388) 10337 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:23.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:24.232 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:24.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:24.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:24.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:24.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:23 smithi044 bash[22676]: cluster 2024-09-21T02:13:22.521107+0000 mgr.a (mgr.14388) 10338 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:23 smithi179 bash[23186]: cluster 2024-09-21T02:13:22.521107+0000 mgr.a (mgr.14388) 10338 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:23 smithi049 bash[23528]: cluster 2024-09-21T02:13:22.521107+0000 mgr.a (mgr.14388) 10338 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:24 smithi044 bash[22676]: audit 2024-09-21T02:13:23.787360+0000 mgr.a (mgr.14388) 10339 : audit [DBG] from='client.228324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:25.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:24 smithi179 bash[23186]: audit 2024-09-21T02:13:23.787360+0000 mgr.a (mgr.14388) 10339 : audit [DBG] from='client.228324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:24 smithi049 bash[23528]: audit 2024-09-21T02:13:23.787360+0000 mgr.a (mgr.14388) 10339 : audit [DBG] from='client.228324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:25 smithi044 bash[22676]: cluster 2024-09-21T02:13:24.522107+0000 mgr.a (mgr.14388) 10340 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:25 smithi044 bash[22676]: audit 2024-09-21T02:13:25.935988+0000 mon.a (mon.0) 8566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:25 smithi044 bash[22676]: audit 2024-09-21T02:13:25.944982+0000 mon.a (mon.0) 8567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:25 smithi044 bash[22676]: audit 2024-09-21T02:13:25.955724+0000 mon.a (mon.0) 8568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:25 smithi179 bash[23186]: cluster 2024-09-21T02:13:24.522107+0000 mgr.a (mgr.14388) 10340 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:25 smithi179 bash[23186]: audit 2024-09-21T02:13:25.935988+0000 mon.a (mon.0) 8566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:25 smithi179 bash[23186]: audit 2024-09-21T02:13:25.944982+0000 mon.a (mon.0) 8567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:25 smithi179 bash[23186]: audit 2024-09-21T02:13:25.955724+0000 mon.a (mon.0) 8568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:25 smithi049 bash[23528]: cluster 2024-09-21T02:13:24.522107+0000 mgr.a (mgr.14388) 10340 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:25 smithi049 bash[23528]: audit 2024-09-21T02:13:25.935988+0000 mon.a (mon.0) 8566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:25 smithi049 bash[23528]: audit 2024-09-21T02:13:25.944982+0000 mon.a (mon.0) 8567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:25 smithi049 bash[23528]: audit 2024-09-21T02:13:25.955724+0000 mon.a (mon.0) 8568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:27 smithi044 bash[22676]: cluster 2024-09-21T02:13:26.524355+0000 mgr.a (mgr.14388) 10341 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:27 smithi179 bash[23186]: cluster 2024-09-21T02:13:26.524355+0000 mgr.a (mgr.14388) 10341 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:27 smithi049 bash[23528]: cluster 2024-09-21T02:13:26.524355+0000 mgr.a (mgr.14388) 10341 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:29.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:29.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:29.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:30.034 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:30.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:30.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:30.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:30.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:29 smithi179 bash[23186]: cluster 2024-09-21T02:13:28.525144+0000 mgr.a (mgr.14388) 10342 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:29 smithi049 bash[23528]: cluster 2024-09-21T02:13:28.525144+0000 mgr.a (mgr.14388) 10342 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:29 smithi044 bash[22676]: cluster 2024-09-21T02:13:28.525144+0000 mgr.a (mgr.14388) 10342 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:31 smithi179 bash[23186]: audit 2024-09-21T02:13:29.574169+0000 mgr.a (mgr.14388) 10343 : audit [DBG] from='client.228402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:31.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:31 smithi049 bash[23528]: audit 2024-09-21T02:13:29.574169+0000 mgr.a (mgr.14388) 10343 : audit [DBG] from='client.228402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:31 smithi044 bash[22676]: audit 2024-09-21T02:13:29.574169+0000 mgr.a (mgr.14388) 10343 : audit [DBG] from='client.228402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:32 smithi179 bash[23186]: cluster 2024-09-21T02:13:30.527491+0000 mgr.a (mgr.14388) 10344 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:32 smithi049 bash[23528]: cluster 2024-09-21T02:13:30.527491+0000 mgr.a (mgr.14388) 10344 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:32 smithi044 bash[22676]: cluster 2024-09-21T02:13:30.527491+0000 mgr.a (mgr.14388) 10344 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:13:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:34 smithi049 bash[23528]: cluster 2024-09-21T02:13:32.528276+0000 mgr.a (mgr.14388) 10345 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:34 smithi044 bash[22676]: cluster 2024-09-21T02:13:32.528276+0000 mgr.a (mgr.14388) 10345 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:34 smithi179 bash[23186]: cluster 2024-09-21T02:13:32.528276+0000 mgr.a (mgr.14388) 10345 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:35.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:35.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:35.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:35.785 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:35.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:35.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:35.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:35.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:36 smithi049 bash[23528]: cluster 2024-09-21T02:13:34.529056+0000 mgr.a (mgr.14388) 10346 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:36 smithi044 bash[22676]: cluster 2024-09-21T02:13:34.529056+0000 mgr.a (mgr.14388) 10346 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:36 smithi179 bash[23186]: cluster 2024-09-21T02:13:34.529056+0000 mgr.a (mgr.14388) 10346 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:37 smithi049 bash[23528]: audit 2024-09-21T02:13:35.369381+0000 mgr.a (mgr.14388) 10347 : audit [DBG] from='client.228480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:37 smithi044 bash[22676]: audit 2024-09-21T02:13:35.369381+0000 mgr.a (mgr.14388) 10347 : audit [DBG] from='client.228480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:37 smithi179 bash[23186]: audit 2024-09-21T02:13:35.369381+0000 mgr.a (mgr.14388) 10347 : audit [DBG] from='client.228480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:38 smithi049 bash[23528]: cluster 2024-09-21T02:13:36.532095+0000 mgr.a (mgr.14388) 10348 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:38 smithi044 bash[22676]: cluster 2024-09-21T02:13:36.532095+0000 mgr.a (mgr.14388) 10348 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:38 smithi179 bash[23186]: cluster 2024-09-21T02:13:36.532095+0000 mgr.a (mgr.14388) 10348 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:40 smithi049 bash[23528]: cluster 2024-09-21T02:13:38.533059+0000 mgr.a (mgr.14388) 10349 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:40 smithi049 bash[23528]: audit 2024-09-21T02:13:39.192495+0000 mon.a (mon.0) 8569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:40 smithi049 bash[23528]: audit 2024-09-21T02:13:39.202636+0000 mon.a (mon.0) 8570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:40 smithi049 bash[23528]: audit 2024-09-21T02:13:39.214696+0000 mon.a (mon.0) 8571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:40 smithi049 bash[23528]: audit 2024-09-21T02:13:39.298684+0000 mon.a (mon.0) 8572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:40 smithi049 bash[23528]: audit 2024-09-21T02:13:39.307317+0000 mon.a (mon.0) 8573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:40 smithi049 bash[23528]: audit 2024-09-21T02:13:39.315465+0000 mon.a (mon.0) 8574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:40 smithi044 bash[22676]: cluster 2024-09-21T02:13:38.533059+0000 mgr.a (mgr.14388) 10349 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:40 smithi044 bash[22676]: audit 2024-09-21T02:13:39.192495+0000 mon.a (mon.0) 8569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:40 smithi044 bash[22676]: audit 2024-09-21T02:13:39.202636+0000 mon.a (mon.0) 8570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:40 smithi044 bash[22676]: audit 2024-09-21T02:13:39.214696+0000 mon.a (mon.0) 8571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:40 smithi044 bash[22676]: audit 2024-09-21T02:13:39.298684+0000 mon.a (mon.0) 8572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:40 smithi044 bash[22676]: audit 2024-09-21T02:13:39.307317+0000 mon.a (mon.0) 8573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:40 smithi044 bash[22676]: audit 2024-09-21T02:13:39.315465+0000 mon.a (mon.0) 8574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:40 smithi179 bash[23186]: cluster 2024-09-21T02:13:38.533059+0000 mgr.a (mgr.14388) 10349 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:40 smithi179 bash[23186]: audit 2024-09-21T02:13:39.192495+0000 mon.a (mon.0) 8569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:40 smithi179 bash[23186]: audit 2024-09-21T02:13:39.202636+0000 mon.a (mon.0) 8570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:40 smithi179 bash[23186]: audit 2024-09-21T02:13:39.214696+0000 mon.a (mon.0) 8571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:40 smithi179 bash[23186]: audit 2024-09-21T02:13:39.298684+0000 mon.a (mon.0) 8572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:40 smithi179 bash[23186]: audit 2024-09-21T02:13:39.307317+0000 mon.a (mon.0) 8573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:40 smithi179 bash[23186]: audit 2024-09-21T02:13:39.315465+0000 mon.a (mon.0) 8574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:41.562 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:42 smithi049 bash[23528]: cluster 2024-09-21T02:13:40.535015+0000 mgr.a (mgr.14388) 10350 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:42 smithi049 bash[23528]: audit 2024-09-21T02:13:41.122714+0000 mgr.a (mgr.14388) 10351 : audit [DBG] from='client.228558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:42 smithi044 bash[22676]: cluster 2024-09-21T02:13:40.535015+0000 mgr.a (mgr.14388) 10350 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:42 smithi044 bash[22676]: audit 2024-09-21T02:13:41.122714+0000 mgr.a (mgr.14388) 10351 : audit [DBG] from='client.228558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:42 smithi179 bash[23186]: cluster 2024-09-21T02:13:40.535015+0000 mgr.a (mgr.14388) 10350 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:42 smithi179 bash[23186]: audit 2024-09-21T02:13:41.122714+0000 mgr.a (mgr.14388) 10351 : audit [DBG] from='client.228558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:44 smithi049 bash[23528]: cluster 2024-09-21T02:13:42.535946+0000 mgr.a (mgr.14388) 10352 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:44 smithi049 bash[23528]: audit 2024-09-21T02:13:43.431788+0000 mon.a (mon.0) 8575 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:13:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:44 smithi044 bash[22676]: cluster 2024-09-21T02:13:42.535946+0000 mgr.a (mgr.14388) 10352 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:44 smithi044 bash[22676]: audit 2024-09-21T02:13:43.431788+0000 mon.a (mon.0) 8575 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:13:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:44 smithi179 bash[23186]: cluster 2024-09-21T02:13:42.535946+0000 mgr.a (mgr.14388) 10352 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:13:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:44 smithi179 bash[23186]: audit 2024-09-21T02:13:43.431788+0000 mon.a (mon.0) 8575 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:13:45.046 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:13:44 smithi044 bash[22930]: debug 2024-09-21T02:13:44.805+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:13:45.046 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:13:44 smithi044 bash[22930]: debug 2024-09-21T02:13:44.809+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.044908+0000 mon.a (mon.0) 8576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.049671+0000 mon.a (mon.0) 8577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.054320+0000 mon.a (mon.0) 8578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.058946+0000 mon.a (mon.0) 8579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.060000+0000 mon.a (mon.0) 8580 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.060841+0000 mon.a (mon.0) 8581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:13:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.065880+0000 mon.a (mon.0) 8582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.069349+0000 mon.a (mon.0) 8583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:13:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:45 smithi049 bash[23528]: audit 2024-09-21T02:13:44.070654+0000 mgr.a (mgr.14388) 10353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:13:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.044908+0000 mon.a (mon.0) 8576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.049671+0000 mon.a (mon.0) 8577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.054320+0000 mon.a (mon.0) 8578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.058946+0000 mon.a (mon.0) 8579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.060000+0000 mon.a (mon.0) 8580 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.060841+0000 mon.a (mon.0) 8581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.065880+0000 mon.a (mon.0) 8582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.069349+0000 mon.a (mon.0) 8583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:13:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:45 smithi044 bash[22676]: audit 2024-09-21T02:13:44.070654+0000 mgr.a (mgr.14388) 10353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:13:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.044908+0000 mon.a (mon.0) 8576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.049671+0000 mon.a (mon.0) 8577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.054320+0000 mon.a (mon.0) 8578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.058946+0000 mon.a (mon.0) 8579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.060000+0000 mon.a (mon.0) 8580 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:13:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.060841+0000 mon.a (mon.0) 8581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:13:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.065880+0000 mon.a (mon.0) 8582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.069349+0000 mon.a (mon.0) 8583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:13:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:45 smithi179 bash[23186]: audit 2024-09-21T02:13:44.070654+0000 mgr.a (mgr.14388) 10353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:13:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:46 smithi044 bash[22676]: cluster 2024-09-21T02:13:44.536510+0000 mgr.a (mgr.14388) 10354 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:13:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:46 smithi044 bash[22676]: audit 2024-09-21T02:13:44.808149+0000 mgr.a (mgr.14388) 10355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:13:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:46 smithi044 bash[22676]: cephadm 2024-09-21T02:13:44.809402+0000 mgr.a (mgr.14388) 10356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:13:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:46 smithi179 bash[23186]: cluster 2024-09-21T02:13:44.536510+0000 mgr.a (mgr.14388) 10354 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:13:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:46 smithi179 bash[23186]: audit 2024-09-21T02:13:44.808149+0000 mgr.a (mgr.14388) 10355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:13:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:46 smithi179 bash[23186]: cephadm 2024-09-21T02:13:44.809402+0000 mgr.a (mgr.14388) 10356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:13:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:46 smithi049 bash[23528]: cluster 2024-09-21T02:13:44.536510+0000 mgr.a (mgr.14388) 10354 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:13:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:46 smithi049 bash[23528]: audit 2024-09-21T02:13:44.808149+0000 mgr.a (mgr.14388) 10355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:13:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:46 smithi049 bash[23528]: cephadm 2024-09-21T02:13:44.809402+0000 mgr.a (mgr.14388) 10356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:13:46.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:46.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:47.349 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:47 smithi044 bash[22676]: audit 2024-09-21T02:13:46.153926+0000 mon.a (mon.0) 8584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:47 smithi044 bash[22676]: audit 2024-09-21T02:13:46.160188+0000 mon.a (mon.0) 8585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:47 smithi044 bash[22676]: audit 2024-09-21T02:13:46.167293+0000 mon.a (mon.0) 8586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:47 smithi179 bash[23186]: audit 2024-09-21T02:13:46.153926+0000 mon.a (mon.0) 8584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:47 smithi179 bash[23186]: audit 2024-09-21T02:13:46.160188+0000 mon.a (mon.0) 8585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:47 smithi179 bash[23186]: audit 2024-09-21T02:13:46.167293+0000 mon.a (mon.0) 8586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:47 smithi049 bash[23528]: audit 2024-09-21T02:13:46.153926+0000 mon.a (mon.0) 8584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:47 smithi049 bash[23528]: audit 2024-09-21T02:13:46.160188+0000 mon.a (mon.0) 8585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:47 smithi049 bash[23528]: audit 2024-09-21T02:13:46.167293+0000 mon.a (mon.0) 8586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:48 smithi044 bash[22676]: cluster 2024-09-21T02:13:46.539037+0000 mgr.a (mgr.14388) 10357 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:48 smithi044 bash[22676]: audit 2024-09-21T02:13:46.904535+0000 mgr.a (mgr.14388) 10358 : audit [DBG] from='client.228741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:48 smithi179 bash[23186]: cluster 2024-09-21T02:13:46.539037+0000 mgr.a (mgr.14388) 10357 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:48 smithi179 bash[23186]: audit 2024-09-21T02:13:46.904535+0000 mgr.a (mgr.14388) 10358 : audit [DBG] from='client.228741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:48 smithi049 bash[23528]: cluster 2024-09-21T02:13:46.539037+0000 mgr.a (mgr.14388) 10357 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:48 smithi049 bash[23528]: audit 2024-09-21T02:13:46.904535+0000 mgr.a (mgr.14388) 10358 : audit [DBG] from='client.228741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:50 smithi044 bash[22676]: cluster 2024-09-21T02:13:48.540110+0000 mgr.a (mgr.14388) 10359 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:50 smithi179 bash[23186]: cluster 2024-09-21T02:13:48.540110+0000 mgr.a (mgr.14388) 10359 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:50 smithi049 bash[23528]: cluster 2024-09-21T02:13:48.540110+0000 mgr.a (mgr.14388) 10359 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:52.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:52.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:52.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:52 smithi044 bash[22676]: cluster 2024-09-21T02:13:50.542449+0000 mgr.a (mgr.14388) 10360 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:52 smithi179 bash[23186]: cluster 2024-09-21T02:13:50.542449+0000 mgr.a (mgr.14388) 10360 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:52 smithi049 bash[23528]: cluster 2024-09-21T02:13:50.542449+0000 mgr.a (mgr.14388) 10360 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:53.102 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:53.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:53.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:53.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:53.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:54 smithi044 bash[22676]: cluster 2024-09-21T02:13:52.543345+0000 mgr.a (mgr.14388) 10361 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:54 smithi044 bash[22676]: audit 2024-09-21T02:13:52.684567+0000 mgr.a (mgr.14388) 10362 : audit [DBG] from='client.228816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:54 smithi179 bash[23186]: cluster 2024-09-21T02:13:52.543345+0000 mgr.a (mgr.14388) 10361 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:54 smithi179 bash[23186]: audit 2024-09-21T02:13:52.684567+0000 mgr.a (mgr.14388) 10362 : audit [DBG] from='client.228816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:54 smithi049 bash[23528]: cluster 2024-09-21T02:13:52.543345+0000 mgr.a (mgr.14388) 10361 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:54 smithi049 bash[23528]: audit 2024-09-21T02:13:52.684567+0000 mgr.a (mgr.14388) 10362 : audit [DBG] from='client.228816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:55 smithi179 bash[23186]: cluster 2024-09-21T02:13:54.544330+0000 mgr.a (mgr.14388) 10363 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:55.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:55 smithi049 bash[23528]: cluster 2024-09-21T02:13:54.544330+0000 mgr.a (mgr.14388) 10363 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:55 smithi044 bash[22676]: cluster 2024-09-21T02:13:54.544330+0000 mgr.a (mgr.14388) 10363 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:57 smithi044 bash[22676]: cluster 2024-09-21T02:13:56.546611+0000 mgr.a (mgr.14388) 10364 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:57 smithi179 bash[23186]: cluster 2024-09-21T02:13:56.546611+0000 mgr.a (mgr.14388) 10364 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:57 smithi049 bash[23528]: cluster 2024-09-21T02:13:56.546611+0000 mgr.a (mgr.14388) 10364 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:13:58.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:13:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:13:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:13:58.854 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:13:58.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:13:58.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:13:58.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:13:58.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:13:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: audit 2024-09-21T02:13:58.437150+0000 mgr.a (mgr.14388) 10365 : audit [DBG] from='client.228894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: cluster 2024-09-21T02:13:58.547094+0000 mgr.a (mgr.14388) 10366 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: audit 2024-09-21T02:13:59.418528+0000 mon.a (mon.0) 8587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: audit 2024-09-21T02:13:59.428773+0000 mon.a (mon.0) 8588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: audit 2024-09-21T02:13:59.440389+0000 mon.a (mon.0) 8589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: audit 2024-09-21T02:13:59.532229+0000 mon.a (mon.0) 8590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: audit 2024-09-21T02:13:59.540411+0000 mon.a (mon.0) 8591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:13:59 smithi179 bash[23186]: audit 2024-09-21T02:13:59.548960+0000 mon.a (mon.0) 8592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: audit 2024-09-21T02:13:58.437150+0000 mgr.a (mgr.14388) 10365 : audit [DBG] from='client.228894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:13:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: cluster 2024-09-21T02:13:58.547094+0000 mgr.a (mgr.14388) 10366 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:13:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: audit 2024-09-21T02:13:59.418528+0000 mon.a (mon.0) 8587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: audit 2024-09-21T02:13:59.428773+0000 mon.a (mon.0) 8588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: audit 2024-09-21T02:13:59.440389+0000 mon.a (mon.0) 8589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: audit 2024-09-21T02:13:59.532229+0000 mon.a (mon.0) 8590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: audit 2024-09-21T02:13:59.540411+0000 mon.a (mon.0) 8591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:13:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:13:59 smithi044 bash[22676]: audit 2024-09-21T02:13:59.548960+0000 mon.a (mon.0) 8592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: audit 2024-09-21T02:13:58.437150+0000 mgr.a (mgr.14388) 10365 : audit [DBG] from='client.228894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: cluster 2024-09-21T02:13:58.547094+0000 mgr.a (mgr.14388) 10366 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: audit 2024-09-21T02:13:59.418528+0000 mon.a (mon.0) 8587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: audit 2024-09-21T02:13:59.428773+0000 mon.a (mon.0) 8588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: audit 2024-09-21T02:13:59.440389+0000 mon.a (mon.0) 8589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: audit 2024-09-21T02:13:59.532229+0000 mon.a (mon.0) 8590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: audit 2024-09-21T02:13:59.540411+0000 mon.a (mon.0) 8591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:13:59 smithi049 bash[23528]: audit 2024-09-21T02:13:59.548960+0000 mon.a (mon.0) 8592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:01 smithi044 bash[22676]: cluster 2024-09-21T02:14:00.549295+0000 mgr.a (mgr.14388) 10367 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:01 smithi179 bash[23186]: cluster 2024-09-21T02:14:00.549295+0000 mgr.a (mgr.14388) 10367 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:01 smithi049 bash[23528]: cluster 2024-09-21T02:14:00.549295+0000 mgr.a (mgr.14388) 10367 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:03.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:03.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:03.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:03 smithi044 bash[22676]: cluster 2024-09-21T02:14:02.550061+0000 mgr.a (mgr.14388) 10368 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:03 smithi179 bash[23186]: cluster 2024-09-21T02:14:02.550061+0000 mgr.a (mgr.14388) 10368 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:03 smithi049 bash[23528]: cluster 2024-09-21T02:14:02.550061+0000 mgr.a (mgr.14388) 10368 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:04.627 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:04.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:04.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:04.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:04.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:05 smithi044 bash[22676]: audit 2024-09-21T02:14:04.190258+0000 mgr.a (mgr.14388) 10369 : audit [DBG] from='client.228972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:05 smithi044 bash[22676]: cluster 2024-09-21T02:14:04.550626+0000 mgr.a (mgr.14388) 10370 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:05 smithi179 bash[23186]: audit 2024-09-21T02:14:04.190258+0000 mgr.a (mgr.14388) 10369 : audit [DBG] from='client.228972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:05 smithi179 bash[23186]: cluster 2024-09-21T02:14:04.550626+0000 mgr.a (mgr.14388) 10370 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:06.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:05 smithi049 bash[23528]: audit 2024-09-21T02:14:04.190258+0000 mgr.a (mgr.14388) 10369 : audit [DBG] from='client.228972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:05 smithi049 bash[23528]: cluster 2024-09-21T02:14:04.550626+0000 mgr.a (mgr.14388) 10370 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:07 smithi044 bash[22676]: audit 2024-09-21T02:14:06.392573+0000 mon.a (mon.0) 8593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:07 smithi044 bash[22676]: audit 2024-09-21T02:14:06.401055+0000 mon.a (mon.0) 8594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:07 smithi044 bash[22676]: audit 2024-09-21T02:14:06.411482+0000 mon.a (mon.0) 8595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:07 smithi044 bash[22676]: cluster 2024-09-21T02:14:06.552795+0000 mgr.a (mgr.14388) 10371 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:07 smithi179 bash[23186]: audit 2024-09-21T02:14:06.392573+0000 mon.a (mon.0) 8593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:07 smithi179 bash[23186]: audit 2024-09-21T02:14:06.401055+0000 mon.a (mon.0) 8594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:07 smithi179 bash[23186]: audit 2024-09-21T02:14:06.411482+0000 mon.a (mon.0) 8595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:07 smithi179 bash[23186]: cluster 2024-09-21T02:14:06.552795+0000 mgr.a (mgr.14388) 10371 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:07 smithi049 bash[23528]: audit 2024-09-21T02:14:06.392573+0000 mon.a (mon.0) 8593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:07 smithi049 bash[23528]: audit 2024-09-21T02:14:06.401055+0000 mon.a (mon.0) 8594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:07 smithi049 bash[23528]: audit 2024-09-21T02:14:06.411482+0000 mon.a (mon.0) 8595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:07 smithi049 bash[23528]: cluster 2024-09-21T02:14:06.552795+0000 mgr.a (mgr.14388) 10371 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:09.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:09.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:09 smithi044 bash[22676]: cluster 2024-09-21T02:14:08.553634+0000 mgr.a (mgr.14388) 10372 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:09 smithi179 bash[23186]: cluster 2024-09-21T02:14:08.553634+0000 mgr.a (mgr.14388) 10372 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:09 smithi049 bash[23528]: cluster 2024-09-21T02:14:08.553634+0000 mgr.a (mgr.14388) 10372 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:10.393 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:10.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:10.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:10.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:10.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:10 smithi179 bash[23186]: audit 2024-09-21T02:14:09.960945+0000 mgr.a (mgr.14388) 10373 : audit [DBG] from='client.229047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:10 smithi044 bash[22676]: audit 2024-09-21T02:14:09.960945+0000 mgr.a (mgr.14388) 10373 : audit [DBG] from='client.229047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:11.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:10 smithi049 bash[23528]: audit 2024-09-21T02:14:09.960945+0000 mgr.a (mgr.14388) 10373 : audit [DBG] from='client.229047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:11.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:11 smithi179 bash[23186]: cluster 2024-09-21T02:14:10.556456+0000 mgr.a (mgr.14388) 10374 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:11 smithi044 bash[22676]: cluster 2024-09-21T02:14:10.556456+0000 mgr.a (mgr.14388) 10374 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:11 smithi049 bash[23528]: cluster 2024-09-21T02:14:10.556456+0000 mgr.a (mgr.14388) 10374 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:13.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:13 smithi049 bash[23528]: cluster 2024-09-21T02:14:12.557301+0000 mgr.a (mgr.14388) 10375 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:14:13.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:13 smithi179 bash[23186]: cluster 2024-09-21T02:14:12.557301+0000 mgr.a (mgr.14388) 10375 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:14:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:13 smithi044 bash[22676]: cluster 2024-09-21T02:14:12.557301+0000 mgr.a (mgr.14388) 10375 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:14:15.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:15 smithi179 bash[23186]: cluster 2024-09-21T02:14:14.558035+0000 mgr.a (mgr.14388) 10376 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:14:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:15 smithi049 bash[23528]: cluster 2024-09-21T02:14:14.558035+0000 mgr.a (mgr.14388) 10376 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:14:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:15 smithi044 bash[22676]: cluster 2024-09-21T02:14:14.558035+0000 mgr.a (mgr.14388) 10376 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:14:16.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:16.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:16.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:16.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:16.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:16 smithi044 bash[22676]: audit 2024-09-21T02:14:15.729618+0000 mgr.a (mgr.14388) 10377 : audit [DBG] from='client.229122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:16 smithi179 bash[23186]: audit 2024-09-21T02:14:15.729618+0000 mgr.a (mgr.14388) 10377 : audit [DBG] from='client.229122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:16 smithi049 bash[23528]: audit 2024-09-21T02:14:15.729618+0000 mgr.a (mgr.14388) 10377 : audit [DBG] from='client.229122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:17 smithi044 bash[22676]: cluster 2024-09-21T02:14:16.560893+0000 mgr.a (mgr.14388) 10378 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:17 smithi179 bash[23186]: cluster 2024-09-21T02:14:16.560893+0000 mgr.a (mgr.14388) 10378 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:18.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:17 smithi049 bash[23528]: cluster 2024-09-21T02:14:16.560893+0000 mgr.a (mgr.14388) 10378 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:19 smithi044 bash[22676]: cluster 2024-09-21T02:14:18.561685+0000 mgr.a (mgr.14388) 10379 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:14:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:19 smithi044 bash[22676]: audit 2024-09-21T02:14:19.635758+0000 mon.a (mon.0) 8596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:19 smithi044 bash[22676]: audit 2024-09-21T02:14:19.643037+0000 mon.a (mon.0) 8597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:19 smithi179 bash[23186]: cluster 2024-09-21T02:14:18.561685+0000 mgr.a (mgr.14388) 10379 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:14:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:19 smithi179 bash[23186]: audit 2024-09-21T02:14:19.635758+0000 mon.a (mon.0) 8596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:19 smithi179 bash[23186]: audit 2024-09-21T02:14:19.643037+0000 mon.a (mon.0) 8597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:19 smithi049 bash[23528]: cluster 2024-09-21T02:14:18.561685+0000 mgr.a (mgr.14388) 10379 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:14:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:19 smithi049 bash[23528]: audit 2024-09-21T02:14:19.635758+0000 mon.a (mon.0) 8596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:19 smithi049 bash[23528]: audit 2024-09-21T02:14:19.643037+0000 mon.a (mon.0) 8597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:20 smithi044 bash[22676]: audit 2024-09-21T02:14:19.657735+0000 mon.a (mon.0) 8598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:20 smithi044 bash[22676]: audit 2024-09-21T02:14:19.759952+0000 mon.a (mon.0) 8599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:20 smithi044 bash[22676]: audit 2024-09-21T02:14:19.767666+0000 mon.a (mon.0) 8600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:20 smithi044 bash[22676]: audit 2024-09-21T02:14:19.778038+0000 mon.a (mon.0) 8601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:20 smithi179 bash[23186]: audit 2024-09-21T02:14:19.657735+0000 mon.a (mon.0) 8598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:20 smithi179 bash[23186]: audit 2024-09-21T02:14:19.759952+0000 mon.a (mon.0) 8599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:20 smithi179 bash[23186]: audit 2024-09-21T02:14:19.767666+0000 mon.a (mon.0) 8600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:20 smithi179 bash[23186]: audit 2024-09-21T02:14:19.778038+0000 mon.a (mon.0) 8601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:20 smithi049 bash[23528]: audit 2024-09-21T02:14:19.657735+0000 mon.a (mon.0) 8598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:20 smithi049 bash[23528]: audit 2024-09-21T02:14:19.759952+0000 mon.a (mon.0) 8599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:20 smithi049 bash[23528]: audit 2024-09-21T02:14:19.767666+0000 mon.a (mon.0) 8600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:20 smithi049 bash[23528]: audit 2024-09-21T02:14:19.778038+0000 mon.a (mon.0) 8601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:21.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:21.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:21.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:21.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:21.954 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:21 smithi049 bash[23528]: cluster 2024-09-21T02:14:20.563600+0000 mgr.a (mgr.14388) 10380 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:21 smithi044 bash[22676]: cluster 2024-09-21T02:14:20.563600+0000 mgr.a (mgr.14388) 10380 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:21 smithi179 bash[23186]: cluster 2024-09-21T02:14:20.563600+0000 mgr.a (mgr.14388) 10380 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:23.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:22 smithi049 bash[23528]: audit 2024-09-21T02:14:21.512752+0000 mgr.a (mgr.14388) 10381 : audit [DBG] from='client.229200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:22 smithi044 bash[22676]: audit 2024-09-21T02:14:21.512752+0000 mgr.a (mgr.14388) 10381 : audit [DBG] from='client.229200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:22 smithi179 bash[23186]: audit 2024-09-21T02:14:21.512752+0000 mgr.a (mgr.14388) 10381 : audit [DBG] from='client.229200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:23 smithi049 bash[23528]: cluster 2024-09-21T02:14:22.564486+0000 mgr.a (mgr.14388) 10382 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:23 smithi044 bash[22676]: cluster 2024-09-21T02:14:22.564486+0000 mgr.a (mgr.14388) 10382 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:23 smithi179 bash[23186]: cluster 2024-09-21T02:14:22.564486+0000 mgr.a (mgr.14388) 10382 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:25 smithi049 bash[23528]: cluster 2024-09-21T02:14:24.565320+0000 mgr.a (mgr.14388) 10383 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:25 smithi044 bash[22676]: cluster 2024-09-21T02:14:24.565320+0000 mgr.a (mgr.14388) 10383 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:25 smithi179 bash[23186]: cluster 2024-09-21T02:14:24.565320+0000 mgr.a (mgr.14388) 10383 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:27.742 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:27 smithi044 bash[22676]: cluster 2024-09-21T02:14:26.566544+0000 mgr.a (mgr.14388) 10384 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:27 smithi044 bash[22676]: audit 2024-09-21T02:14:26.607402+0000 mon.a (mon.0) 8602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:27 smithi044 bash[22676]: audit 2024-09-21T02:14:26.612338+0000 mon.a (mon.0) 8603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:27 smithi044 bash[22676]: audit 2024-09-21T02:14:26.619049+0000 mon.a (mon.0) 8604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:27 smithi179 bash[23186]: cluster 2024-09-21T02:14:26.566544+0000 mgr.a (mgr.14388) 10384 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:27 smithi179 bash[23186]: audit 2024-09-21T02:14:26.607402+0000 mon.a (mon.0) 8602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:27 smithi179 bash[23186]: audit 2024-09-21T02:14:26.612338+0000 mon.a (mon.0) 8603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:27 smithi179 bash[23186]: audit 2024-09-21T02:14:26.619049+0000 mon.a (mon.0) 8604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:27 smithi049 bash[23528]: cluster 2024-09-21T02:14:26.566544+0000 mgr.a (mgr.14388) 10384 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:27 smithi049 bash[23528]: audit 2024-09-21T02:14:26.607402+0000 mon.a (mon.0) 8602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:27 smithi049 bash[23528]: audit 2024-09-21T02:14:26.612338+0000 mon.a (mon.0) 8603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:27 smithi049 bash[23528]: audit 2024-09-21T02:14:26.619049+0000 mon.a (mon.0) 8604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:28 smithi044 bash[22676]: audit 2024-09-21T02:14:27.295768+0000 mgr.a (mgr.14388) 10385 : audit [DBG] from='client.229278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:29.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:28 smithi179 bash[23186]: audit 2024-09-21T02:14:27.295768+0000 mgr.a (mgr.14388) 10385 : audit [DBG] from='client.229278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:29.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:28 smithi049 bash[23528]: audit 2024-09-21T02:14:27.295768+0000 mgr.a (mgr.14388) 10385 : audit [DBG] from='client.229278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:29 smithi044 bash[22676]: cluster 2024-09-21T02:14:28.567102+0000 mgr.a (mgr.14388) 10386 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:29 smithi179 bash[23186]: cluster 2024-09-21T02:14:28.567102+0000 mgr.a (mgr.14388) 10386 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:29 smithi049 bash[23528]: cluster 2024-09-21T02:14:28.567102+0000 mgr.a (mgr.14388) 10386 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:31 smithi179 bash[23186]: cluster 2024-09-21T02:14:30.569163+0000 mgr.a (mgr.14388) 10387 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:31 smithi044 bash[22676]: cluster 2024-09-21T02:14:30.569163+0000 mgr.a (mgr.14388) 10387 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:31 smithi049 bash[23528]: cluster 2024-09-21T02:14:30.569163+0000 mgr.a (mgr.14388) 10387 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:32.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:32.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:32.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:33.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:33.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:33.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:33.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:33.505 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:33.919 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:33 smithi049 bash[23528]: cluster 2024-09-21T02:14:32.569946+0000 mgr.a (mgr.14388) 10388 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:33.919 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:33 smithi049 bash[23528]: audit 2024-09-21T02:14:33.078102+0000 mgr.a (mgr.14388) 10389 : audit [DBG] from='client.229356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:33.965 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:33 smithi179 bash[23186]: cluster 2024-09-21T02:14:32.569946+0000 mgr.a (mgr.14388) 10388 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:33.965 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:33 smithi179 bash[23186]: audit 2024-09-21T02:14:33.078102+0000 mgr.a (mgr.14388) 10389 : audit [DBG] from='client.229356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:33 smithi044 bash[22676]: cluster 2024-09-21T02:14:32.569946+0000 mgr.a (mgr.14388) 10388 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:33 smithi044 bash[22676]: audit 2024-09-21T02:14:33.078102+0000 mgr.a (mgr.14388) 10389 : audit [DBG] from='client.229356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:35 smithi044 bash[22676]: cluster 2024-09-21T02:14:34.570835+0000 mgr.a (mgr.14388) 10390 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:35 smithi179 bash[23186]: cluster 2024-09-21T02:14:34.570835+0000 mgr.a (mgr.14388) 10390 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:35 smithi049 bash[23528]: cluster 2024-09-21T02:14:34.570835+0000 mgr.a (mgr.14388) 10390 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:37 smithi044 bash[22676]: cluster 2024-09-21T02:14:36.573074+0000 mgr.a (mgr.14388) 10391 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:37 smithi179 bash[23186]: cluster 2024-09-21T02:14:36.573074+0000 mgr.a (mgr.14388) 10391 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:37 smithi049 bash[23528]: cluster 2024-09-21T02:14:36.573074+0000 mgr.a (mgr.14388) 10391 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:38.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:38.507 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:38.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:39.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:39.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:39.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:39.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:39 smithi044 bash[22676]: cluster 2024-09-21T02:14:38.573852+0000 mgr.a (mgr.14388) 10392 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:39 smithi044 bash[22676]: audit 2024-09-21T02:14:38.848125+0000 mgr.a (mgr.14388) 10393 : audit [DBG] from='client.229434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:39 smithi179 bash[23186]: cluster 2024-09-21T02:14:38.573852+0000 mgr.a (mgr.14388) 10392 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:39 smithi179 bash[23186]: audit 2024-09-21T02:14:38.848125+0000 mgr.a (mgr.14388) 10393 : audit [DBG] from='client.229434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:39 smithi049 bash[23528]: cluster 2024-09-21T02:14:38.573852+0000 mgr.a (mgr.14388) 10392 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:39 smithi049 bash[23528]: audit 2024-09-21T02:14:38.848125+0000 mgr.a (mgr.14388) 10393 : audit [DBG] from='client.229434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:40 smithi044 bash[22676]: audit 2024-09-21T02:14:39.851609+0000 mon.a (mon.0) 8605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:40 smithi044 bash[22676]: audit 2024-09-21T02:14:39.857760+0000 mon.a (mon.0) 8606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:40 smithi044 bash[22676]: audit 2024-09-21T02:14:39.866496+0000 mon.a (mon.0) 8607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:40 smithi044 bash[22676]: audit 2024-09-21T02:14:39.998340+0000 mon.a (mon.0) 8608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:40 smithi044 bash[22676]: audit 2024-09-21T02:14:40.006715+0000 mon.a (mon.0) 8609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:40 smithi044 bash[22676]: audit 2024-09-21T02:14:40.016893+0000 mon.a (mon.0) 8610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:40 smithi179 bash[23186]: audit 2024-09-21T02:14:39.851609+0000 mon.a (mon.0) 8605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:40 smithi179 bash[23186]: audit 2024-09-21T02:14:39.857760+0000 mon.a (mon.0) 8606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:40 smithi179 bash[23186]: audit 2024-09-21T02:14:39.866496+0000 mon.a (mon.0) 8607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:40 smithi179 bash[23186]: audit 2024-09-21T02:14:39.998340+0000 mon.a (mon.0) 8608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:40 smithi179 bash[23186]: audit 2024-09-21T02:14:40.006715+0000 mon.a (mon.0) 8609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:40 smithi179 bash[23186]: audit 2024-09-21T02:14:40.016893+0000 mon.a (mon.0) 8610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:40 smithi049 bash[23528]: audit 2024-09-21T02:14:39.851609+0000 mon.a (mon.0) 8605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:40 smithi049 bash[23528]: audit 2024-09-21T02:14:39.857760+0000 mon.a (mon.0) 8606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:40 smithi049 bash[23528]: audit 2024-09-21T02:14:39.866496+0000 mon.a (mon.0) 8607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:40 smithi049 bash[23528]: audit 2024-09-21T02:14:39.998340+0000 mon.a (mon.0) 8608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:40 smithi049 bash[23528]: audit 2024-09-21T02:14:40.006715+0000 mon.a (mon.0) 8609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:40 smithi049 bash[23528]: audit 2024-09-21T02:14:40.016893+0000 mon.a (mon.0) 8610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:42 smithi049 bash[23528]: cluster 2024-09-21T02:14:40.576113+0000 mgr.a (mgr.14388) 10394 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:42 smithi044 bash[22676]: cluster 2024-09-21T02:14:40.576113+0000 mgr.a (mgr.14388) 10394 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:42 smithi179 bash[23186]: cluster 2024-09-21T02:14:40.576113+0000 mgr.a (mgr.14388) 10394 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:44 smithi049 bash[23528]: cluster 2024-09-21T02:14:42.576866+0000 mgr.a (mgr.14388) 10395 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:44.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:44 smithi044 bash[22676]: cluster 2024-09-21T02:14:42.576866+0000 mgr.a (mgr.14388) 10395 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:44 smithi179 bash[23186]: cluster 2024-09-21T02:14:42.576866+0000 mgr.a (mgr.14388) 10395 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:45.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:45.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:45.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:45.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:45.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:45 smithi049 bash[23528]: audit 2024-09-21T02:14:44.865637+0000 mon.a (mon.0) 8611 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:14:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:45 smithi044 bash[22676]: audit 2024-09-21T02:14:44.865637+0000 mon.a (mon.0) 8611 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:14:45.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:45 smithi179 bash[23186]: audit 2024-09-21T02:14:44.865637+0000 mon.a (mon.0) 8611 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: cluster 2024-09-21T02:14:44.577603+0000 mgr.a (mgr.14388) 10396 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: audit 2024-09-21T02:14:44.642875+0000 mgr.a (mgr.14388) 10397 : audit [DBG] from='client.229509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: audit 2024-09-21T02:14:45.433418+0000 mon.a (mon.0) 8612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: audit 2024-09-21T02:14:45.441820+0000 mon.a (mon.0) 8613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: audit 2024-09-21T02:14:45.444747+0000 mon.a (mon.0) 8614 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: audit 2024-09-21T02:14:45.446787+0000 mon.a (mon.0) 8615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: audit 2024-09-21T02:14:45.457304+0000 mon.a (mon.0) 8616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:46 smithi049 bash[23528]: audit 2024-09-21T02:14:45.463774+0000 mon.a (mon.0) 8617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:14:46.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22930]: debug 2024-09-21T02:14:46.224+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:14:46.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22930]: debug 2024-09-21T02:14:46.228+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: cluster 2024-09-21T02:14:44.577603+0000 mgr.a (mgr.14388) 10396 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: audit 2024-09-21T02:14:44.642875+0000 mgr.a (mgr.14388) 10397 : audit [DBG] from='client.229509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: audit 2024-09-21T02:14:45.433418+0000 mon.a (mon.0) 8612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: audit 2024-09-21T02:14:45.441820+0000 mon.a (mon.0) 8613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: audit 2024-09-21T02:14:45.444747+0000 mon.a (mon.0) 8614 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: audit 2024-09-21T02:14:45.446787+0000 mon.a (mon.0) 8615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: audit 2024-09-21T02:14:45.457304+0000 mon.a (mon.0) 8616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:46 smithi044 bash[22676]: audit 2024-09-21T02:14:45.463774+0000 mon.a (mon.0) 8617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:14:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: cluster 2024-09-21T02:14:44.577603+0000 mgr.a (mgr.14388) 10396 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: audit 2024-09-21T02:14:44.642875+0000 mgr.a (mgr.14388) 10397 : audit [DBG] from='client.229509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: audit 2024-09-21T02:14:45.433418+0000 mon.a (mon.0) 8612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: audit 2024-09-21T02:14:45.441820+0000 mon.a (mon.0) 8613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: audit 2024-09-21T02:14:45.444747+0000 mon.a (mon.0) 8614 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:14:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: audit 2024-09-21T02:14:45.446787+0000 mon.a (mon.0) 8615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:14:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: audit 2024-09-21T02:14:45.457304+0000 mon.a (mon.0) 8616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:46 smithi179 bash[23186]: audit 2024-09-21T02:14:45.463774+0000 mon.a (mon.0) 8617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:47 smithi049 bash[23528]: audit 2024-09-21T02:14:45.466482+0000 mgr.a (mgr.14388) 10398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:47 smithi049 bash[23528]: audit 2024-09-21T02:14:46.835620+0000 mon.a (mon.0) 8618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:47 smithi049 bash[23528]: audit 2024-09-21T02:14:46.845769+0000 mon.a (mon.0) 8619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:47 smithi049 bash[23528]: audit 2024-09-21T02:14:46.857476+0000 mon.a (mon.0) 8620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:47 smithi044 bash[22676]: audit 2024-09-21T02:14:45.466482+0000 mgr.a (mgr.14388) 10398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:14:47.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:47 smithi044 bash[22676]: audit 2024-09-21T02:14:46.835620+0000 mon.a (mon.0) 8618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:47 smithi044 bash[22676]: audit 2024-09-21T02:14:46.845769+0000 mon.a (mon.0) 8619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:47 smithi044 bash[22676]: audit 2024-09-21T02:14:46.857476+0000 mon.a (mon.0) 8620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:47 smithi179 bash[23186]: audit 2024-09-21T02:14:45.466482+0000 mgr.a (mgr.14388) 10398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:14:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:47 smithi179 bash[23186]: audit 2024-09-21T02:14:46.835620+0000 mon.a (mon.0) 8618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:47 smithi179 bash[23186]: audit 2024-09-21T02:14:46.845769+0000 mon.a (mon.0) 8619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:47 smithi179 bash[23186]: audit 2024-09-21T02:14:46.857476+0000 mon.a (mon.0) 8620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:14:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:48 smithi049 bash[23528]: audit 2024-09-21T02:14:46.228040+0000 mgr.a (mgr.14388) 10399 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:14:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:48 smithi049 bash[23528]: cephadm 2024-09-21T02:14:46.229350+0000 mgr.a (mgr.14388) 10400 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:14:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:48 smithi049 bash[23528]: cluster 2024-09-21T02:14:46.580340+0000 mgr.a (mgr.14388) 10401 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:48 smithi044 bash[22676]: audit 2024-09-21T02:14:46.228040+0000 mgr.a (mgr.14388) 10399 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:14:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:48 smithi044 bash[22676]: cephadm 2024-09-21T02:14:46.229350+0000 mgr.a (mgr.14388) 10400 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:14:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:48 smithi044 bash[22676]: cluster 2024-09-21T02:14:46.580340+0000 mgr.a (mgr.14388) 10401 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:48 smithi179 bash[23186]: audit 2024-09-21T02:14:46.228040+0000 mgr.a (mgr.14388) 10399 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:14:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:48 smithi179 bash[23186]: cephadm 2024-09-21T02:14:46.229350+0000 mgr.a (mgr.14388) 10400 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:14:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:48 smithi179 bash[23186]: cluster 2024-09-21T02:14:46.580340+0000 mgr.a (mgr.14388) 10401 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:14:50.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:50 smithi049 bash[23528]: cluster 2024-09-21T02:14:48.581110+0000 mgr.a (mgr.14388) 10402 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:50 smithi044 bash[22676]: cluster 2024-09-21T02:14:48.581110+0000 mgr.a (mgr.14388) 10402 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:50 smithi179 bash[23186]: cluster 2024-09-21T02:14:48.581110+0000 mgr.a (mgr.14388) 10402 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:14:50.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:50.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:50.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:50.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:50.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:52 smithi179 bash[23186]: audit 2024-09-21T02:14:50.409996+0000 mgr.a (mgr.14388) 10403 : audit [DBG] from='client.229689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:52 smithi179 bash[23186]: cluster 2024-09-21T02:14:50.582509+0000 mgr.a (mgr.14388) 10404 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:14:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:52 smithi044 bash[22676]: audit 2024-09-21T02:14:50.409996+0000 mgr.a (mgr.14388) 10403 : audit [DBG] from='client.229689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:52 smithi044 bash[22676]: cluster 2024-09-21T02:14:50.582509+0000 mgr.a (mgr.14388) 10404 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:14:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:52 smithi049 bash[23528]: audit 2024-09-21T02:14:50.409996+0000 mgr.a (mgr.14388) 10403 : audit [DBG] from='client.229689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:52 smithi049 bash[23528]: cluster 2024-09-21T02:14:50.582509+0000 mgr.a (mgr.14388) 10404 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:14:54.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:54 smithi179 bash[23186]: cluster 2024-09-21T02:14:52.583411+0000 mgr.a (mgr.14388) 10405 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:14:54.347 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:54 smithi049 bash[23528]: cluster 2024-09-21T02:14:52.583411+0000 mgr.a (mgr.14388) 10405 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:14:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:54 smithi044 bash[22676]: cluster 2024-09-21T02:14:52.583411+0000 mgr.a (mgr.14388) 10405 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:14:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:14:55.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:14:55.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:14:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:56 smithi044 bash[22676]: cluster 2024-09-21T02:14:54.584181+0000 mgr.a (mgr.14388) 10406 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:14:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:56 smithi179 bash[23186]: cluster 2024-09-21T02:14:54.584181+0000 mgr.a (mgr.14388) 10406 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:14:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:56 smithi049 bash[23528]: cluster 2024-09-21T02:14:54.584181+0000 mgr.a (mgr.14388) 10406 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:14:56.609 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:14:56.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:14:56.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:14:56.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:14:56.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:14:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:57 smithi049 bash[23528]: audit 2024-09-21T02:14:56.174744+0000 mgr.a (mgr.14388) 10407 : audit [DBG] from='client.229761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:57 smithi044 bash[22676]: audit 2024-09-21T02:14:56.174744+0000 mgr.a (mgr.14388) 10407 : audit [DBG] from='client.229761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:57 smithi179 bash[23186]: audit 2024-09-21T02:14:56.174744+0000 mgr.a (mgr.14388) 10407 : audit [DBG] from='client.229761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:14:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:14:58 smithi044 bash[22676]: cluster 2024-09-21T02:14:56.585758+0000 mgr.a (mgr.14388) 10408 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:14:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:14:58 smithi179 bash[23186]: cluster 2024-09-21T02:14:56.585758+0000 mgr.a (mgr.14388) 10408 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:14:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:14:58 smithi049 bash[23528]: cluster 2024-09-21T02:14:56.585758+0000 mgr.a (mgr.14388) 10408 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:15:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:00 smithi044 bash[22676]: cluster 2024-09-21T02:14:58.586482+0000 mgr.a (mgr.14388) 10409 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:15:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:00 smithi044 bash[22676]: audit 2024-09-21T02:15:00.047507+0000 mon.a (mon.0) 8621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:00 smithi044 bash[22676]: audit 2024-09-21T02:15:00.056608+0000 mon.a (mon.0) 8622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:00 smithi044 bash[22676]: audit 2024-09-21T02:15:00.064993+0000 mon.a (mon.0) 8623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:00 smithi179 bash[23186]: cluster 2024-09-21T02:14:58.586482+0000 mgr.a (mgr.14388) 10409 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:15:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:00 smithi179 bash[23186]: audit 2024-09-21T02:15:00.047507+0000 mon.a (mon.0) 8621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:00 smithi179 bash[23186]: audit 2024-09-21T02:15:00.056608+0000 mon.a (mon.0) 8622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:00 smithi179 bash[23186]: audit 2024-09-21T02:15:00.064993+0000 mon.a (mon.0) 8623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:00 smithi049 bash[23528]: cluster 2024-09-21T02:14:58.586482+0000 mgr.a (mgr.14388) 10409 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:15:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:00 smithi049 bash[23528]: audit 2024-09-21T02:15:00.047507+0000 mon.a (mon.0) 8621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:00 smithi049 bash[23528]: audit 2024-09-21T02:15:00.056608+0000 mon.a (mon.0) 8622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:00 smithi049 bash[23528]: audit 2024-09-21T02:15:00.064993+0000 mon.a (mon.0) 8623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:01 smithi179 bash[23186]: audit 2024-09-21T02:15:00.240758+0000 mon.a (mon.0) 8624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:01 smithi179 bash[23186]: audit 2024-09-21T02:15:00.249320+0000 mon.a (mon.0) 8625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:01 smithi179 bash[23186]: audit 2024-09-21T02:15:00.259868+0000 mon.a (mon.0) 8626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:01 smithi179 bash[23186]: cluster 2024-09-21T02:15:00.588521+0000 mgr.a (mgr.14388) 10410 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:15:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:01 smithi049 bash[23528]: audit 2024-09-21T02:15:00.240758+0000 mon.a (mon.0) 8624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:01 smithi049 bash[23528]: audit 2024-09-21T02:15:00.249320+0000 mon.a (mon.0) 8625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:01 smithi049 bash[23528]: audit 2024-09-21T02:15:00.259868+0000 mon.a (mon.0) 8626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:01 smithi049 bash[23528]: cluster 2024-09-21T02:15:00.588521+0000 mgr.a (mgr.14388) 10410 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:15:01.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:01.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:01.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:01 smithi044 bash[22676]: audit 2024-09-21T02:15:00.240758+0000 mon.a (mon.0) 8624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:01 smithi044 bash[22676]: audit 2024-09-21T02:15:00.249320+0000 mon.a (mon.0) 8625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:01 smithi044 bash[22676]: audit 2024-09-21T02:15:00.259868+0000 mon.a (mon.0) 8626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:01 smithi044 bash[22676]: cluster 2024-09-21T02:15:00.588521+0000 mgr.a (mgr.14388) 10410 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:15:02.395 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:02.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:02.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:02 smithi049 bash[23528]: audit 2024-09-21T02:15:01.949957+0000 mgr.a (mgr.14388) 10411 : audit [DBG] from='client.229839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:02 smithi044 bash[22676]: audit 2024-09-21T02:15:01.949957+0000 mgr.a (mgr.14388) 10411 : audit [DBG] from='client.229839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:02 smithi179 bash[23186]: audit 2024-09-21T02:15:01.949957+0000 mgr.a (mgr.14388) 10411 : audit [DBG] from='client.229839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:03 smithi049 bash[23528]: cluster 2024-09-21T02:15:02.589404+0000 mgr.a (mgr.14388) 10412 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:03 smithi044 bash[22676]: cluster 2024-09-21T02:15:02.589404+0000 mgr.a (mgr.14388) 10412 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:03 smithi179 bash[23186]: cluster 2024-09-21T02:15:02.589404+0000 mgr.a (mgr.14388) 10412 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:05 smithi044 bash[22676]: cluster 2024-09-21T02:15:04.590179+0000 mgr.a (mgr.14388) 10413 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:05 smithi179 bash[23186]: cluster 2024-09-21T02:15:04.590179+0000 mgr.a (mgr.14388) 10413 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:05 smithi049 bash[23528]: cluster 2024-09-21T02:15:04.590179+0000 mgr.a (mgr.14388) 10413 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:07.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:07.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:07.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:08.170 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:08.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:08.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:08.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:08.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:08 smithi044 bash[22676]: cluster 2024-09-21T02:15:06.592437+0000 mgr.a (mgr.14388) 10414 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:08 smithi044 bash[22676]: audit 2024-09-21T02:15:07.033146+0000 mon.a (mon.0) 8627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:08 smithi044 bash[22676]: audit 2024-09-21T02:15:07.043649+0000 mon.a (mon.0) 8628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:08 smithi044 bash[22676]: audit 2024-09-21T02:15:07.054622+0000 mon.a (mon.0) 8629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:08 smithi049 bash[23528]: cluster 2024-09-21T02:15:06.592437+0000 mgr.a (mgr.14388) 10414 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:08 smithi049 bash[23528]: audit 2024-09-21T02:15:07.033146+0000 mon.a (mon.0) 8627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:08 smithi049 bash[23528]: audit 2024-09-21T02:15:07.043649+0000 mon.a (mon.0) 8628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:08 smithi049 bash[23528]: audit 2024-09-21T02:15:07.054622+0000 mon.a (mon.0) 8629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:08 smithi179 bash[23186]: cluster 2024-09-21T02:15:06.592437+0000 mgr.a (mgr.14388) 10414 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:08 smithi179 bash[23186]: audit 2024-09-21T02:15:07.033146+0000 mon.a (mon.0) 8627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:08 smithi179 bash[23186]: audit 2024-09-21T02:15:07.043649+0000 mon.a (mon.0) 8628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:08 smithi179 bash[23186]: audit 2024-09-21T02:15:07.054622+0000 mon.a (mon.0) 8629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:09.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:09 smithi049 bash[23528]: audit 2024-09-21T02:15:07.742508+0000 mgr.a (mgr.14388) 10415 : audit [DBG] from='client.229917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:09.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:09 smithi044 bash[22676]: audit 2024-09-21T02:15:07.742508+0000 mgr.a (mgr.14388) 10415 : audit [DBG] from='client.229917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:09 smithi179 bash[23186]: audit 2024-09-21T02:15:07.742508+0000 mgr.a (mgr.14388) 10415 : audit [DBG] from='client.229917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:10 smithi049 bash[23528]: cluster 2024-09-21T02:15:08.593376+0000 mgr.a (mgr.14388) 10416 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:10 smithi044 bash[22676]: cluster 2024-09-21T02:15:08.593376+0000 mgr.a (mgr.14388) 10416 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:10 smithi179 bash[23186]: cluster 2024-09-21T02:15:08.593376+0000 mgr.a (mgr.14388) 10416 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:12 smithi179 bash[23186]: cluster 2024-09-21T02:15:10.595611+0000 mgr.a (mgr.14388) 10417 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:12 smithi049 bash[23528]: cluster 2024-09-21T02:15:10.595611+0000 mgr.a (mgr.14388) 10417 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:12 smithi044 bash[22676]: cluster 2024-09-21T02:15:10.595611+0000 mgr.a (mgr.14388) 10417 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:13.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:13.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:13.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:13.964 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:13.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:13.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:13.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:13.965 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:14 smithi049 bash[23528]: cluster 2024-09-21T02:15:12.596369+0000 mgr.a (mgr.14388) 10418 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:14.369 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:14 smithi179 bash[23186]: cluster 2024-09-21T02:15:12.596369+0000 mgr.a (mgr.14388) 10418 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:14 smithi044 bash[22676]: cluster 2024-09-21T02:15:12.596369+0000 mgr.a (mgr.14388) 10418 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:15 smithi049 bash[23528]: audit 2024-09-21T02:15:13.508804+0000 mgr.a (mgr.14388) 10419 : audit [DBG] from='client.229992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:15 smithi044 bash[22676]: audit 2024-09-21T02:15:13.508804+0000 mgr.a (mgr.14388) 10419 : audit [DBG] from='client.229992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:15 smithi179 bash[23186]: audit 2024-09-21T02:15:13.508804+0000 mgr.a (mgr.14388) 10419 : audit [DBG] from='client.229992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:16 smithi044 bash[22676]: cluster 2024-09-21T02:15:14.597293+0000 mgr.a (mgr.14388) 10420 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:16 smithi179 bash[23186]: cluster 2024-09-21T02:15:14.597293+0000 mgr.a (mgr.14388) 10420 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:16 smithi049 bash[23528]: cluster 2024-09-21T02:15:14.597293+0000 mgr.a (mgr.14388) 10420 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:18.432 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:18 smithi044 bash[22676]: cluster 2024-09-21T02:15:16.599520+0000 mgr.a (mgr.14388) 10421 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:18 smithi179 bash[23186]: cluster 2024-09-21T02:15:16.599520+0000 mgr.a (mgr.14388) 10421 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:18 smithi049 bash[23528]: cluster 2024-09-21T02:15:16.599520+0000 mgr.a (mgr.14388) 10421 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:19.756 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:19.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:19.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:19.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:19.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:20.442 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:20 smithi044 bash[22676]: cluster 2024-09-21T02:15:18.600284+0000 mgr.a (mgr.14388) 10422 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:20 smithi179 bash[23186]: cluster 2024-09-21T02:15:18.600284+0000 mgr.a (mgr.14388) 10422 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:20 smithi049 bash[23528]: cluster 2024-09-21T02:15:18.600284+0000 mgr.a (mgr.14388) 10422 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:21 smithi044 bash[22676]: audit 2024-09-21T02:15:19.312132+0000 mgr.a (mgr.14388) 10423 : audit [DBG] from='client.230070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:21 smithi044 bash[22676]: audit 2024-09-21T02:15:20.277181+0000 mon.a (mon.0) 8630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:21 smithi044 bash[22676]: audit 2024-09-21T02:15:20.283202+0000 mon.a (mon.0) 8631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:21 smithi044 bash[22676]: audit 2024-09-21T02:15:20.291013+0000 mon.a (mon.0) 8632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:21 smithi044 bash[22676]: audit 2024-09-21T02:15:20.428806+0000 mon.a (mon.0) 8633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:21 smithi044 bash[22676]: audit 2024-09-21T02:15:20.433884+0000 mon.a (mon.0) 8634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:21 smithi044 bash[22676]: audit 2024-09-21T02:15:20.441172+0000 mon.a (mon.0) 8635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:21 smithi179 bash[23186]: audit 2024-09-21T02:15:19.312132+0000 mgr.a (mgr.14388) 10423 : audit [DBG] from='client.230070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:21 smithi179 bash[23186]: audit 2024-09-21T02:15:20.277181+0000 mon.a (mon.0) 8630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:21 smithi179 bash[23186]: audit 2024-09-21T02:15:20.283202+0000 mon.a (mon.0) 8631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:21 smithi179 bash[23186]: audit 2024-09-21T02:15:20.291013+0000 mon.a (mon.0) 8632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:21 smithi179 bash[23186]: audit 2024-09-21T02:15:20.428806+0000 mon.a (mon.0) 8633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:21 smithi179 bash[23186]: audit 2024-09-21T02:15:20.433884+0000 mon.a (mon.0) 8634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:21 smithi179 bash[23186]: audit 2024-09-21T02:15:20.441172+0000 mon.a (mon.0) 8635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:21 smithi049 bash[23528]: audit 2024-09-21T02:15:19.312132+0000 mgr.a (mgr.14388) 10423 : audit [DBG] from='client.230070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:21 smithi049 bash[23528]: audit 2024-09-21T02:15:20.277181+0000 mon.a (mon.0) 8630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:21 smithi049 bash[23528]: audit 2024-09-21T02:15:20.283202+0000 mon.a (mon.0) 8631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:21 smithi049 bash[23528]: audit 2024-09-21T02:15:20.291013+0000 mon.a (mon.0) 8632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:21 smithi049 bash[23528]: audit 2024-09-21T02:15:20.428806+0000 mon.a (mon.0) 8633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:21 smithi049 bash[23528]: audit 2024-09-21T02:15:20.433884+0000 mon.a (mon.0) 8634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:21 smithi049 bash[23528]: audit 2024-09-21T02:15:20.441172+0000 mon.a (mon.0) 8635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:22 smithi044 bash[22676]: cluster 2024-09-21T02:15:20.602609+0000 mgr.a (mgr.14388) 10424 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:22 smithi179 bash[23186]: cluster 2024-09-21T02:15:20.602609+0000 mgr.a (mgr.14388) 10424 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:22 smithi049 bash[23528]: cluster 2024-09-21T02:15:20.602609+0000 mgr.a (mgr.14388) 10424 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:24 smithi044 bash[22676]: cluster 2024-09-21T02:15:22.603371+0000 mgr.a (mgr.14388) 10425 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:24 smithi179 bash[23186]: cluster 2024-09-21T02:15:22.603371+0000 mgr.a (mgr.14388) 10425 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:24 smithi049 bash[23528]: cluster 2024-09-21T02:15:22.603371+0000 mgr.a (mgr.14388) 10425 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:24.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:24.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:24.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:25.526 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:25.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:25.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:25.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:25.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:26 smithi044 bash[22676]: cluster 2024-09-21T02:15:24.604129+0000 mgr.a (mgr.14388) 10426 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:26 smithi044 bash[22676]: audit 2024-09-21T02:15:25.089978+0000 mgr.a (mgr.14388) 10427 : audit [DBG] from='client.230148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:26 smithi179 bash[23186]: cluster 2024-09-21T02:15:24.604129+0000 mgr.a (mgr.14388) 10426 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:26 smithi179 bash[23186]: audit 2024-09-21T02:15:25.089978+0000 mgr.a (mgr.14388) 10427 : audit [DBG] from='client.230148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:26 smithi049 bash[23528]: cluster 2024-09-21T02:15:24.604129+0000 mgr.a (mgr.14388) 10426 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:26 smithi049 bash[23528]: audit 2024-09-21T02:15:25.089978+0000 mgr.a (mgr.14388) 10427 : audit [DBG] from='client.230148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:28 smithi044 bash[22676]: cluster 2024-09-21T02:15:26.606807+0000 mgr.a (mgr.14388) 10428 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:28 smithi044 bash[22676]: audit 2024-09-21T02:15:27.218266+0000 mon.a (mon.0) 8636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:28 smithi044 bash[22676]: audit 2024-09-21T02:15:27.228254+0000 mon.a (mon.0) 8637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:28 smithi044 bash[22676]: audit 2024-09-21T02:15:27.240229+0000 mon.a (mon.0) 8638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:28 smithi179 bash[23186]: cluster 2024-09-21T02:15:26.606807+0000 mgr.a (mgr.14388) 10428 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:28 smithi179 bash[23186]: audit 2024-09-21T02:15:27.218266+0000 mon.a (mon.0) 8636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:28 smithi179 bash[23186]: audit 2024-09-21T02:15:27.228254+0000 mon.a (mon.0) 8637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:28 smithi179 bash[23186]: audit 2024-09-21T02:15:27.240229+0000 mon.a (mon.0) 8638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:28 smithi049 bash[23528]: cluster 2024-09-21T02:15:26.606807+0000 mgr.a (mgr.14388) 10428 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:28 smithi049 bash[23528]: audit 2024-09-21T02:15:27.218266+0000 mon.a (mon.0) 8636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:28 smithi049 bash[23528]: audit 2024-09-21T02:15:27.228254+0000 mon.a (mon.0) 8637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:28 smithi049 bash[23528]: audit 2024-09-21T02:15:27.240229+0000 mon.a (mon.0) 8638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:30.343 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:30 smithi044 bash[22676]: cluster 2024-09-21T02:15:28.607561+0000 mgr.a (mgr.14388) 10429 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:15:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:30 smithi179 bash[23186]: cluster 2024-09-21T02:15:28.607561+0000 mgr.a (mgr.14388) 10429 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:15:30.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:30.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:30.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:30 smithi049 bash[23528]: cluster 2024-09-21T02:15:28.607561+0000 mgr.a (mgr.14388) 10429 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:15:31.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:31.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:31.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:31.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:31.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:32.359 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:32 smithi179 bash[23186]: cluster 2024-09-21T02:15:30.609571+0000 mgr.a (mgr.14388) 10430 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:32.359 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:32 smithi179 bash[23186]: audit 2024-09-21T02:15:30.868888+0000 mgr.a (mgr.14388) 10431 : audit [DBG] from='client.230223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:32 smithi044 bash[22676]: cluster 2024-09-21T02:15:30.609571+0000 mgr.a (mgr.14388) 10430 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:32 smithi044 bash[22676]: audit 2024-09-21T02:15:30.868888+0000 mgr.a (mgr.14388) 10431 : audit [DBG] from='client.230223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:32 smithi049 bash[23528]: cluster 2024-09-21T02:15:30.609571+0000 mgr.a (mgr.14388) 10430 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:32 smithi049 bash[23528]: audit 2024-09-21T02:15:30.868888+0000 mgr.a (mgr.14388) 10431 : audit [DBG] from='client.230223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:34.376 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:34 smithi049 bash[23528]: cluster 2024-09-21T02:15:32.610449+0000 mgr.a (mgr.14388) 10432 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:15:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:34 smithi044 bash[22676]: cluster 2024-09-21T02:15:32.610449+0000 mgr.a (mgr.14388) 10432 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:15:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:34 smithi179 bash[23186]: cluster 2024-09-21T02:15:32.610449+0000 mgr.a (mgr.14388) 10432 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:15:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:36.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:36.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:36.377 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:36 smithi049 bash[23528]: cluster 2024-09-21T02:15:34.611401+0000 mgr.a (mgr.14388) 10433 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:15:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:36 smithi044 bash[22676]: cluster 2024-09-21T02:15:34.611401+0000 mgr.a (mgr.14388) 10433 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:15:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:36 smithi179 bash[23186]: cluster 2024-09-21T02:15:34.611401+0000 mgr.a (mgr.14388) 10433 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:15:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:38 smithi049 bash[23528]: cluster 2024-09-21T02:15:36.613569+0000 mgr.a (mgr.14388) 10434 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:38 smithi049 bash[23528]: audit 2024-09-21T02:15:36.647627+0000 mgr.a (mgr.14388) 10435 : audit [DBG] from='client.230301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:38 smithi044 bash[22676]: cluster 2024-09-21T02:15:36.613569+0000 mgr.a (mgr.14388) 10434 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:38 smithi044 bash[22676]: audit 2024-09-21T02:15:36.647627+0000 mgr.a (mgr.14388) 10435 : audit [DBG] from='client.230301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:38 smithi179 bash[23186]: cluster 2024-09-21T02:15:36.613569+0000 mgr.a (mgr.14388) 10434 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:38 smithi179 bash[23186]: audit 2024-09-21T02:15:36.647627+0000 mgr.a (mgr.14388) 10435 : audit [DBG] from='client.230301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:40 smithi044 bash[22676]: cluster 2024-09-21T02:15:38.614574+0000 mgr.a (mgr.14388) 10436 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:40.495 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:40 smithi179 bash[23186]: cluster 2024-09-21T02:15:38.614574+0000 mgr.a (mgr.14388) 10436 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:40 smithi049 bash[23528]: cluster 2024-09-21T02:15:38.614574+0000 mgr.a (mgr.14388) 10436 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:41 smithi044 bash[22676]: audit 2024-09-21T02:15:40.480420+0000 mon.a (mon.0) 8639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:41 smithi044 bash[22676]: audit 2024-09-21T02:15:40.486945+0000 mon.a (mon.0) 8640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:41 smithi044 bash[22676]: audit 2024-09-21T02:15:40.494228+0000 mon.a (mon.0) 8641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:41 smithi044 bash[22676]: cluster 2024-09-21T02:15:40.615906+0000 mgr.a (mgr.14388) 10437 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:41 smithi044 bash[22676]: audit 2024-09-21T02:15:40.667394+0000 mon.a (mon.0) 8642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:41 smithi044 bash[22676]: audit 2024-09-21T02:15:40.675858+0000 mon.a (mon.0) 8643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:41 smithi044 bash[22676]: audit 2024-09-21T02:15:40.685833+0000 mon.a (mon.0) 8644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:41 smithi179 bash[23186]: audit 2024-09-21T02:15:40.480420+0000 mon.a (mon.0) 8639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:41 smithi179 bash[23186]: audit 2024-09-21T02:15:40.486945+0000 mon.a (mon.0) 8640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:41 smithi179 bash[23186]: audit 2024-09-21T02:15:40.494228+0000 mon.a (mon.0) 8641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:41 smithi179 bash[23186]: cluster 2024-09-21T02:15:40.615906+0000 mgr.a (mgr.14388) 10437 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:41 smithi179 bash[23186]: audit 2024-09-21T02:15:40.667394+0000 mon.a (mon.0) 8642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:41 smithi179 bash[23186]: audit 2024-09-21T02:15:40.675858+0000 mon.a (mon.0) 8643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:41 smithi179 bash[23186]: audit 2024-09-21T02:15:40.685833+0000 mon.a (mon.0) 8644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:41 smithi049 bash[23528]: audit 2024-09-21T02:15:40.480420+0000 mon.a (mon.0) 8639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:41 smithi049 bash[23528]: audit 2024-09-21T02:15:40.486945+0000 mon.a (mon.0) 8640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:41 smithi049 bash[23528]: audit 2024-09-21T02:15:40.494228+0000 mon.a (mon.0) 8641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:41 smithi049 bash[23528]: cluster 2024-09-21T02:15:40.615906+0000 mgr.a (mgr.14388) 10437 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:41 smithi049 bash[23528]: audit 2024-09-21T02:15:40.667394+0000 mon.a (mon.0) 8642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:41 smithi049 bash[23528]: audit 2024-09-21T02:15:40.675858+0000 mon.a (mon.0) 8643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:41 smithi049 bash[23528]: audit 2024-09-21T02:15:40.685833+0000 mon.a (mon.0) 8644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:42.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:42.867 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:43 smithi044 bash[22676]: audit 2024-09-21T02:15:42.426349+0000 mgr.a (mgr.14388) 10438 : audit [DBG] from='client.230379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:43 smithi044 bash[22676]: cluster 2024-09-21T02:15:42.616480+0000 mgr.a (mgr.14388) 10439 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:43 smithi179 bash[23186]: audit 2024-09-21T02:15:42.426349+0000 mgr.a (mgr.14388) 10438 : audit [DBG] from='client.230379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:43 smithi179 bash[23186]: cluster 2024-09-21T02:15:42.616480+0000 mgr.a (mgr.14388) 10439 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:44.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:43 smithi049 bash[23528]: audit 2024-09-21T02:15:42.426349+0000 mgr.a (mgr.14388) 10438 : audit [DBG] from='client.230379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:44.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:43 smithi049 bash[23528]: cluster 2024-09-21T02:15:42.616480+0000 mgr.a (mgr.14388) 10439 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:45 smithi044 bash[22676]: cluster 2024-09-21T02:15:44.617395+0000 mgr.a (mgr.14388) 10440 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:45 smithi179 bash[23186]: cluster 2024-09-21T02:15:44.617395+0000 mgr.a (mgr.14388) 10440 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:45 smithi049 bash[23528]: cluster 2024-09-21T02:15:44.617395+0000 mgr.a (mgr.14388) 10440 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:46 smithi044 bash[22676]: audit 2024-09-21T02:15:46.286982+0000 mon.a (mon.0) 8645 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:15:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:46 smithi044 bash[22676]: audit 2024-09-21T02:15:46.293978+0000 mon.a (mon.0) 8646 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:15:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:46 smithi044 bash[22676]: audit 2024-09-21T02:15:46.295954+0000 mon.a (mon.0) 8647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:15:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:46 smithi044 bash[22676]: audit 2024-09-21T02:15:46.308029+0000 mon.a (mon.0) 8648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:46 smithi044 bash[22676]: audit 2024-09-21T02:15:46.315210+0000 mon.a (mon.0) 8649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:15:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:46 smithi179 bash[23186]: audit 2024-09-21T02:15:46.286982+0000 mon.a (mon.0) 8645 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:15:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:46 smithi179 bash[23186]: audit 2024-09-21T02:15:46.293978+0000 mon.a (mon.0) 8646 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:15:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:46 smithi179 bash[23186]: audit 2024-09-21T02:15:46.295954+0000 mon.a (mon.0) 8647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:15:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:46 smithi179 bash[23186]: audit 2024-09-21T02:15:46.308029+0000 mon.a (mon.0) 8648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:46 smithi179 bash[23186]: audit 2024-09-21T02:15:46.315210+0000 mon.a (mon.0) 8649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:15:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:46 smithi049 bash[23528]: audit 2024-09-21T02:15:46.286982+0000 mon.a (mon.0) 8645 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:15:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:46 smithi049 bash[23528]: audit 2024-09-21T02:15:46.293978+0000 mon.a (mon.0) 8646 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:15:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:46 smithi049 bash[23528]: audit 2024-09-21T02:15:46.295954+0000 mon.a (mon.0) 8647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:15:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:46 smithi049 bash[23528]: audit 2024-09-21T02:15:46.308029+0000 mon.a (mon.0) 8648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:46 smithi049 bash[23528]: audit 2024-09-21T02:15:46.315210+0000 mon.a (mon.0) 8649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:15:47.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22930]: debug 2024-09-21T02:15:47.107+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:15:47.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22930]: debug 2024-09-21T02:15:47.107+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:15:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:47 smithi049 bash[23528]: audit 2024-09-21T02:15:46.317609+0000 mgr.a (mgr.14388) 10441 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:15:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:47 smithi049 bash[23528]: cluster 2024-09-21T02:15:46.618828+0000 mgr.a (mgr.14388) 10442 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:47 smithi049 bash[23528]: audit 2024-09-21T02:15:47.111975+0000 mgr.a (mgr.14388) 10443 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:15:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:47 smithi049 bash[23528]: cephadm 2024-09-21T02:15:47.113205+0000 mgr.a (mgr.14388) 10444 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:15:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:47 smithi049 bash[23528]: audit 2024-09-21T02:15:47.455999+0000 mon.a (mon.0) 8650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:47 smithi049 bash[23528]: audit 2024-09-21T02:15:47.465146+0000 mon.a (mon.0) 8651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:47 smithi049 bash[23528]: audit 2024-09-21T02:15:47.475935+0000 mon.a (mon.0) 8652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:47.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:47.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:47.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22676]: audit 2024-09-21T02:15:46.317609+0000 mgr.a (mgr.14388) 10441 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:15:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22676]: cluster 2024-09-21T02:15:46.618828+0000 mgr.a (mgr.14388) 10442 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22676]: audit 2024-09-21T02:15:47.111975+0000 mgr.a (mgr.14388) 10443 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:15:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22676]: cephadm 2024-09-21T02:15:47.113205+0000 mgr.a (mgr.14388) 10444 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:15:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22676]: audit 2024-09-21T02:15:47.455999+0000 mon.a (mon.0) 8650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22676]: audit 2024-09-21T02:15:47.465146+0000 mon.a (mon.0) 8651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:47 smithi044 bash[22676]: audit 2024-09-21T02:15:47.475935+0000 mon.a (mon.0) 8652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:47 smithi179 bash[23186]: audit 2024-09-21T02:15:46.317609+0000 mgr.a (mgr.14388) 10441 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:15:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:47 smithi179 bash[23186]: cluster 2024-09-21T02:15:46.618828+0000 mgr.a (mgr.14388) 10442 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:15:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:47 smithi179 bash[23186]: audit 2024-09-21T02:15:47.111975+0000 mgr.a (mgr.14388) 10443 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:15:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:47 smithi179 bash[23186]: cephadm 2024-09-21T02:15:47.113205+0000 mgr.a (mgr.14388) 10444 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:15:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:47 smithi179 bash[23186]: audit 2024-09-21T02:15:47.455999+0000 mon.a (mon.0) 8650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:47 smithi179 bash[23186]: audit 2024-09-21T02:15:47.465146+0000 mon.a (mon.0) 8651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:47 smithi179 bash[23186]: audit 2024-09-21T02:15:47.475935+0000 mon.a (mon.0) 8652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:15:48.690 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:49 smithi044 bash[22676]: audit 2024-09-21T02:15:48.230073+0000 mgr.a (mgr.14388) 10445 : audit [DBG] from='client.230562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:49 smithi044 bash[22676]: cluster 2024-09-21T02:15:48.619560+0000 mgr.a (mgr.14388) 10446 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:49 smithi179 bash[23186]: audit 2024-09-21T02:15:48.230073+0000 mgr.a (mgr.14388) 10445 : audit [DBG] from='client.230562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:49 smithi179 bash[23186]: cluster 2024-09-21T02:15:48.619560+0000 mgr.a (mgr.14388) 10446 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:49 smithi049 bash[23528]: audit 2024-09-21T02:15:48.230073+0000 mgr.a (mgr.14388) 10445 : audit [DBG] from='client.230562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:49 smithi049 bash[23528]: cluster 2024-09-21T02:15:48.619560+0000 mgr.a (mgr.14388) 10446 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:15:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:51 smithi044 bash[22676]: cluster 2024-09-21T02:15:50.620910+0000 mgr.a (mgr.14388) 10447 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T02:15:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:51 smithi179 bash[23186]: cluster 2024-09-21T02:15:50.620910+0000 mgr.a (mgr.14388) 10447 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T02:15:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:51 smithi049 bash[23528]: cluster 2024-09-21T02:15:50.620910+0000 mgr.a (mgr.14388) 10447 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T02:15:53.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:53.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:53.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:53 smithi044 bash[22676]: cluster 2024-09-21T02:15:52.621706+0000 mgr.a (mgr.14388) 10448 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:15:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:53 smithi179 bash[23186]: cluster 2024-09-21T02:15:52.621706+0000 mgr.a (mgr.14388) 10448 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:15:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:53 smithi049 bash[23528]: cluster 2024-09-21T02:15:52.621706+0000 mgr.a (mgr.14388) 10448 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:15:54.443 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:15:54.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:15:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:15:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:15:54.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:15:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:54 smithi044 bash[22676]: audit 2024-09-21T02:15:54.023166+0000 mgr.a (mgr.14388) 10449 : audit [DBG] from='client.230640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:55.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:54 smithi179 bash[23186]: audit 2024-09-21T02:15:54.023166+0000 mgr.a (mgr.14388) 10449 : audit [DBG] from='client.230640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:54 smithi049 bash[23528]: audit 2024-09-21T02:15:54.023166+0000 mgr.a (mgr.14388) 10449 : audit [DBG] from='client.230640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:15:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:55 smithi044 bash[22676]: cluster 2024-09-21T02:15:54.622700+0000 mgr.a (mgr.14388) 10450 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:15:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:55 smithi179 bash[23186]: cluster 2024-09-21T02:15:54.622700+0000 mgr.a (mgr.14388) 10450 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:15:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:55 smithi049 bash[23528]: cluster 2024-09-21T02:15:54.622700+0000 mgr.a (mgr.14388) 10450 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:15:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:57 smithi044 bash[22676]: cluster 2024-09-21T02:15:56.625017+0000 mgr.a (mgr.14388) 10451 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T02:15:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:57 smithi179 bash[23186]: cluster 2024-09-21T02:15:56.625017+0000 mgr.a (mgr.14388) 10451 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T02:15:58.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:57 smithi049 bash[23528]: cluster 2024-09-21T02:15:56.625017+0000 mgr.a (mgr.14388) 10451 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T02:15:59.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:15:59.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:15:59.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:15:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:15:59 smithi044 bash[22676]: cluster 2024-09-21T02:15:58.625831+0000 mgr.a (mgr.14388) 10452 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:16:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:15:59 smithi179 bash[23186]: cluster 2024-09-21T02:15:58.625831+0000 mgr.a (mgr.14388) 10452 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:16:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:15:59 smithi049 bash[23528]: cluster 2024-09-21T02:15:58.625831+0000 mgr.a (mgr.14388) 10452 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:16:00.211 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:00.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:00.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:00.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:00.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:00 smithi044 bash[22676]: audit 2024-09-21T02:15:59.779888+0000 mgr.a (mgr.14388) 10453 : audit [DBG] from='client.230712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:00 smithi044 bash[22676]: audit 2024-09-21T02:16:00.700339+0000 mon.a (mon.0) 8653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:00 smithi044 bash[22676]: audit 2024-09-21T02:16:00.708460+0000 mon.a (mon.0) 8654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:00 smithi044 bash[22676]: audit 2024-09-21T02:16:00.718164+0000 mon.a (mon.0) 8655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:00 smithi179 bash[23186]: audit 2024-09-21T02:15:59.779888+0000 mgr.a (mgr.14388) 10453 : audit [DBG] from='client.230712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:00 smithi179 bash[23186]: audit 2024-09-21T02:16:00.700339+0000 mon.a (mon.0) 8653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:00 smithi179 bash[23186]: audit 2024-09-21T02:16:00.708460+0000 mon.a (mon.0) 8654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:01.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:00 smithi179 bash[23186]: audit 2024-09-21T02:16:00.718164+0000 mon.a (mon.0) 8655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:00 smithi049 bash[23528]: audit 2024-09-21T02:15:59.779888+0000 mgr.a (mgr.14388) 10453 : audit [DBG] from='client.230712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:00 smithi049 bash[23528]: audit 2024-09-21T02:16:00.700339+0000 mon.a (mon.0) 8653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:00 smithi049 bash[23528]: audit 2024-09-21T02:16:00.708460+0000 mon.a (mon.0) 8654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:00 smithi049 bash[23528]: audit 2024-09-21T02:16:00.718164+0000 mon.a (mon.0) 8655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:01 smithi044 bash[22676]: cluster 2024-09-21T02:16:00.628594+0000 mgr.a (mgr.14388) 10454 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:16:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:01 smithi044 bash[22676]: audit 2024-09-21T02:16:00.873229+0000 mon.a (mon.0) 8656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:01 smithi044 bash[22676]: audit 2024-09-21T02:16:00.879707+0000 mon.a (mon.0) 8657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:01 smithi044 bash[22676]: audit 2024-09-21T02:16:00.889183+0000 mon.a (mon.0) 8658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:01 smithi179 bash[23186]: cluster 2024-09-21T02:16:00.628594+0000 mgr.a (mgr.14388) 10454 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:16:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:01 smithi179 bash[23186]: audit 2024-09-21T02:16:00.873229+0000 mon.a (mon.0) 8656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:01 smithi179 bash[23186]: audit 2024-09-21T02:16:00.879707+0000 mon.a (mon.0) 8657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:01 smithi179 bash[23186]: audit 2024-09-21T02:16:00.889183+0000 mon.a (mon.0) 8658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:01 smithi049 bash[23528]: cluster 2024-09-21T02:16:00.628594+0000 mgr.a (mgr.14388) 10454 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T02:16:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:01 smithi049 bash[23528]: audit 2024-09-21T02:16:00.873229+0000 mon.a (mon.0) 8656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:01 smithi049 bash[23528]: audit 2024-09-21T02:16:00.879707+0000 mon.a (mon.0) 8657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:01 smithi049 bash[23528]: audit 2024-09-21T02:16:00.889183+0000 mon.a (mon.0) 8658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:03 smithi044 bash[22676]: cluster 2024-09-21T02:16:02.629436+0000 mgr.a (mgr.14388) 10455 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:03 smithi179 bash[23186]: cluster 2024-09-21T02:16:02.629436+0000 mgr.a (mgr.14388) 10455 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:03 smithi049 bash[23528]: cluster 2024-09-21T02:16:02.629436+0000 mgr.a (mgr.14388) 10455 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:05.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:05.987 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:05 smithi044 bash[22676]: cluster 2024-09-21T02:16:04.630251+0000 mgr.a (mgr.14388) 10456 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:05 smithi179 bash[23186]: cluster 2024-09-21T02:16:04.630251+0000 mgr.a (mgr.14388) 10456 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:05 smithi049 bash[23528]: cluster 2024-09-21T02:16:04.630251+0000 mgr.a (mgr.14388) 10456 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:06 smithi044 bash[22676]: audit 2024-09-21T02:16:05.548566+0000 mgr.a (mgr.14388) 10457 : audit [DBG] from='client.230787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:06 smithi179 bash[23186]: audit 2024-09-21T02:16:05.548566+0000 mgr.a (mgr.14388) 10457 : audit [DBG] from='client.230787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:06 smithi049 bash[23528]: audit 2024-09-21T02:16:05.548566+0000 mgr.a (mgr.14388) 10457 : audit [DBG] from='client.230787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:07 smithi044 bash[22676]: cluster 2024-09-21T02:16:06.633322+0000 mgr.a (mgr.14388) 10458 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:07 smithi044 bash[22676]: audit 2024-09-21T02:16:07.632531+0000 mon.a (mon.0) 8659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:07 smithi044 bash[22676]: audit 2024-09-21T02:16:07.640701+0000 mon.a (mon.0) 8660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:07 smithi044 bash[22676]: audit 2024-09-21T02:16:07.649782+0000 mon.a (mon.0) 8661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:07 smithi179 bash[23186]: cluster 2024-09-21T02:16:06.633322+0000 mgr.a (mgr.14388) 10458 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:07 smithi179 bash[23186]: audit 2024-09-21T02:16:07.632531+0000 mon.a (mon.0) 8659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:07 smithi179 bash[23186]: audit 2024-09-21T02:16:07.640701+0000 mon.a (mon.0) 8660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:07 smithi179 bash[23186]: audit 2024-09-21T02:16:07.649782+0000 mon.a (mon.0) 8661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:07 smithi049 bash[23528]: cluster 2024-09-21T02:16:06.633322+0000 mgr.a (mgr.14388) 10458 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:07 smithi049 bash[23528]: audit 2024-09-21T02:16:07.632531+0000 mon.a (mon.0) 8659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:07 smithi049 bash[23528]: audit 2024-09-21T02:16:07.640701+0000 mon.a (mon.0) 8660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:07 smithi049 bash[23528]: audit 2024-09-21T02:16:07.649782+0000 mon.a (mon.0) 8661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:09 smithi044 bash[22676]: cluster 2024-09-21T02:16:08.634262+0000 mgr.a (mgr.14388) 10459 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:16:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:09 smithi179 bash[23186]: cluster 2024-09-21T02:16:08.634262+0000 mgr.a (mgr.14388) 10459 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:16:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:09 smithi049 bash[23528]: cluster 2024-09-21T02:16:08.634262+0000 mgr.a (mgr.14388) 10459 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:16:10.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:10.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:10.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:11.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:11 smithi179 bash[23186]: cluster 2024-09-21T02:16:10.635739+0000 mgr.a (mgr.14388) 10460 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:11 smithi044 bash[22676]: cluster 2024-09-21T02:16:10.635739+0000 mgr.a (mgr.14388) 10460 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:11 smithi049 bash[23528]: cluster 2024-09-21T02:16:10.635739+0000 mgr.a (mgr.14388) 10460 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:12.969 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:12 smithi179 bash[23186]: audit 2024-09-21T02:16:11.324454+0000 mgr.a (mgr.14388) 10461 : audit [DBG] from='client.230865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:12 smithi044 bash[22676]: audit 2024-09-21T02:16:11.324454+0000 mgr.a (mgr.14388) 10461 : audit [DBG] from='client.230865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:12 smithi049 bash[23528]: audit 2024-09-21T02:16:11.324454+0000 mgr.a (mgr.14388) 10461 : audit [DBG] from='client.230865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:13 smithi044 bash[22676]: cluster 2024-09-21T02:16:12.636818+0000 mgr.a (mgr.14388) 10462 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:13 smithi179 bash[23186]: cluster 2024-09-21T02:16:12.636818+0000 mgr.a (mgr.14388) 10462 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:14.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:13 smithi049 bash[23528]: cluster 2024-09-21T02:16:12.636818+0000 mgr.a (mgr.14388) 10462 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:16.226 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:15 smithi049 bash[23528]: cluster 2024-09-21T02:16:14.637637+0000 mgr.a (mgr.14388) 10463 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:15 smithi044 bash[22676]: cluster 2024-09-21T02:16:14.637637+0000 mgr.a (mgr.14388) 10463 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:15 smithi179 bash[23186]: cluster 2024-09-21T02:16:14.637637+0000 mgr.a (mgr.14388) 10463 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T02:16:16.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:16.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:16.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:18.235 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:17 smithi049 bash[23528]: cluster 2024-09-21T02:16:16.639900+0000 mgr.a (mgr.14388) 10464 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T02:16:18.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:17 smithi049 bash[23528]: audit 2024-09-21T02:16:17.093658+0000 mgr.a (mgr.14388) 10465 : audit [DBG] from='client.230940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:17 smithi044 bash[22676]: cluster 2024-09-21T02:16:16.639900+0000 mgr.a (mgr.14388) 10464 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T02:16:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:17 smithi044 bash[22676]: audit 2024-09-21T02:16:17.093658+0000 mgr.a (mgr.14388) 10465 : audit [DBG] from='client.230940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:17 smithi179 bash[23186]: cluster 2024-09-21T02:16:16.639900+0000 mgr.a (mgr.14388) 10464 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T02:16:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:17 smithi179 bash[23186]: audit 2024-09-21T02:16:17.093658+0000 mgr.a (mgr.14388) 10465 : audit [DBG] from='client.230940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:20.213 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:19 smithi044 bash[22676]: cluster 2024-09-21T02:16:18.640898+0000 mgr.a (mgr.14388) 10466 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:19 smithi179 bash[23186]: cluster 2024-09-21T02:16:18.640898+0000 mgr.a (mgr.14388) 10466 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:19 smithi049 bash[23528]: cluster 2024-09-21T02:16:18.640898+0000 mgr.a (mgr.14388) 10466 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:21 smithi044 bash[22676]: cluster 2024-09-21T02:16:20.643191+0000 mgr.a (mgr.14388) 10467 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:21 smithi044 bash[22676]: audit 2024-09-21T02:16:20.925864+0000 mon.a (mon.0) 8662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:21 smithi044 bash[22676]: audit 2024-09-21T02:16:20.935532+0000 mon.a (mon.0) 8663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:21 smithi044 bash[22676]: audit 2024-09-21T02:16:20.942934+0000 mon.a (mon.0) 8664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:21 smithi044 bash[22676]: audit 2024-09-21T02:16:21.101792+0000 mon.a (mon.0) 8665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:21 smithi044 bash[22676]: audit 2024-09-21T02:16:21.110651+0000 mon.a (mon.0) 8666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:21 smithi044 bash[22676]: audit 2024-09-21T02:16:21.121133+0000 mon.a (mon.0) 8667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:21 smithi179 bash[23186]: cluster 2024-09-21T02:16:20.643191+0000 mgr.a (mgr.14388) 10467 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:21 smithi179 bash[23186]: audit 2024-09-21T02:16:20.925864+0000 mon.a (mon.0) 8662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:21 smithi179 bash[23186]: audit 2024-09-21T02:16:20.935532+0000 mon.a (mon.0) 8663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:21 smithi179 bash[23186]: audit 2024-09-21T02:16:20.942934+0000 mon.a (mon.0) 8664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:21 smithi179 bash[23186]: audit 2024-09-21T02:16:21.101792+0000 mon.a (mon.0) 8665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:21 smithi179 bash[23186]: audit 2024-09-21T02:16:21.110651+0000 mon.a (mon.0) 8666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:21 smithi179 bash[23186]: audit 2024-09-21T02:16:21.121133+0000 mon.a (mon.0) 8667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:21 smithi049 bash[23528]: cluster 2024-09-21T02:16:20.643191+0000 mgr.a (mgr.14388) 10467 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:21 smithi049 bash[23528]: audit 2024-09-21T02:16:20.925864+0000 mon.a (mon.0) 8662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:21 smithi049 bash[23528]: audit 2024-09-21T02:16:20.935532+0000 mon.a (mon.0) 8663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:21 smithi049 bash[23528]: audit 2024-09-21T02:16:20.942934+0000 mon.a (mon.0) 8664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:21 smithi049 bash[23528]: audit 2024-09-21T02:16:21.101792+0000 mon.a (mon.0) 8665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:21 smithi049 bash[23528]: audit 2024-09-21T02:16:21.110651+0000 mon.a (mon.0) 8666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:21 smithi049 bash[23528]: audit 2024-09-21T02:16:21.121133+0000 mon.a (mon.0) 8667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:23.342 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:23 smithi044 bash[22676]: cluster 2024-09-21T02:16:22.643735+0000 mgr.a (mgr.14388) 10468 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:23 smithi044 bash[22676]: audit 2024-09-21T02:16:22.881775+0000 mgr.a (mgr.14388) 10469 : audit [DBG] from='client.231018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:23 smithi179 bash[23186]: cluster 2024-09-21T02:16:22.643735+0000 mgr.a (mgr.14388) 10468 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:23 smithi179 bash[23186]: audit 2024-09-21T02:16:22.881775+0000 mgr.a (mgr.14388) 10469 : audit [DBG] from='client.231018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:23 smithi049 bash[23528]: cluster 2024-09-21T02:16:22.643735+0000 mgr.a (mgr.14388) 10468 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:23 smithi049 bash[23528]: audit 2024-09-21T02:16:22.881775+0000 mgr.a (mgr.14388) 10469 : audit [DBG] from='client.231018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:25 smithi044 bash[22676]: cluster 2024-09-21T02:16:24.644720+0000 mgr.a (mgr.14388) 10470 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:25 smithi179 bash[23186]: cluster 2024-09-21T02:16:24.644720+0000 mgr.a (mgr.14388) 10470 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:26.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:25 smithi049 bash[23528]: cluster 2024-09-21T02:16:24.644720+0000 mgr.a (mgr.14388) 10470 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:27 smithi044 bash[22676]: cluster 2024-09-21T02:16:26.647085+0000 mgr.a (mgr.14388) 10471 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:27 smithi044 bash[22676]: audit 2024-09-21T02:16:27.868876+0000 mon.a (mon.0) 8668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:27 smithi044 bash[22676]: audit 2024-09-21T02:16:27.878080+0000 mon.a (mon.0) 8669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:27 smithi044 bash[22676]: audit 2024-09-21T02:16:27.887577+0000 mon.a (mon.0) 8670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:27 smithi179 bash[23186]: cluster 2024-09-21T02:16:26.647085+0000 mgr.a (mgr.14388) 10471 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:27 smithi179 bash[23186]: audit 2024-09-21T02:16:27.868876+0000 mon.a (mon.0) 8668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:27 smithi179 bash[23186]: audit 2024-09-21T02:16:27.878080+0000 mon.a (mon.0) 8669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:27 smithi179 bash[23186]: audit 2024-09-21T02:16:27.887577+0000 mon.a (mon.0) 8670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:27 smithi049 bash[23528]: cluster 2024-09-21T02:16:26.647085+0000 mgr.a (mgr.14388) 10471 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:27 smithi049 bash[23528]: audit 2024-09-21T02:16:27.868876+0000 mon.a (mon.0) 8668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:27 smithi049 bash[23528]: audit 2024-09-21T02:16:27.878080+0000 mon.a (mon.0) 8669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:27 smithi049 bash[23528]: audit 2024-09-21T02:16:27.887577+0000 mon.a (mon.0) 8670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:28.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:28.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:28.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:29.111 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:29 smithi044 bash[22676]: cluster 2024-09-21T02:16:28.647824+0000 mgr.a (mgr.14388) 10472 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:29 smithi044 bash[22676]: audit 2024-09-21T02:16:28.683520+0000 mgr.a (mgr.14388) 10473 : audit [DBG] from='client.231096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:29.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:29 smithi179 bash[23186]: cluster 2024-09-21T02:16:28.647824+0000 mgr.a (mgr.14388) 10472 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:29.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:29 smithi179 bash[23186]: audit 2024-09-21T02:16:28.683520+0000 mgr.a (mgr.14388) 10473 : audit [DBG] from='client.231096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:29.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:29 smithi049 bash[23528]: cluster 2024-09-21T02:16:28.647824+0000 mgr.a (mgr.14388) 10472 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:29 smithi049 bash[23528]: audit 2024-09-21T02:16:28.683520+0000 mgr.a (mgr.14388) 10473 : audit [DBG] from='client.231096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:31 smithi044 bash[22676]: cluster 2024-09-21T02:16:30.650180+0000 mgr.a (mgr.14388) 10474 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:31 smithi179 bash[23186]: cluster 2024-09-21T02:16:30.650180+0000 mgr.a (mgr.14388) 10474 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:31 smithi049 bash[23528]: cluster 2024-09-21T02:16:30.650180+0000 mgr.a (mgr.14388) 10474 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:33 smithi044 bash[22676]: cluster 2024-09-21T02:16:32.650972+0000 mgr.a (mgr.14388) 10475 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:33 smithi179 bash[23186]: cluster 2024-09-21T02:16:32.650972+0000 mgr.a (mgr.14388) 10475 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:33 smithi049 bash[23528]: cluster 2024-09-21T02:16:32.650972+0000 mgr.a (mgr.14388) 10475 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:34.114 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:34.867 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:34.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:34.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:34.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:34.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:35 smithi044 bash[22676]: audit 2024-09-21T02:16:34.444719+0000 mgr.a (mgr.14388) 10476 : audit [DBG] from='client.231174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:35 smithi044 bash[22676]: cluster 2024-09-21T02:16:34.651442+0000 mgr.a (mgr.14388) 10477 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:35 smithi179 bash[23186]: audit 2024-09-21T02:16:34.444719+0000 mgr.a (mgr.14388) 10476 : audit [DBG] from='client.231174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:35 smithi179 bash[23186]: cluster 2024-09-21T02:16:34.651442+0000 mgr.a (mgr.14388) 10477 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:35 smithi049 bash[23528]: audit 2024-09-21T02:16:34.444719+0000 mgr.a (mgr.14388) 10476 : audit [DBG] from='client.231174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:35 smithi049 bash[23528]: cluster 2024-09-21T02:16:34.651442+0000 mgr.a (mgr.14388) 10477 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:37 smithi044 bash[22676]: cluster 2024-09-21T02:16:36.653764+0000 mgr.a (mgr.14388) 10478 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:37 smithi179 bash[23186]: cluster 2024-09-21T02:16:36.653764+0000 mgr.a (mgr.14388) 10478 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:37 smithi049 bash[23528]: cluster 2024-09-21T02:16:36.653764+0000 mgr.a (mgr.14388) 10478 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:16:39.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:39.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:39.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:39 smithi044 bash[22676]: cluster 2024-09-21T02:16:38.654573+0000 mgr.a (mgr.14388) 10479 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:39 smithi179 bash[23186]: cluster 2024-09-21T02:16:38.654573+0000 mgr.a (mgr.14388) 10479 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:39 smithi049 bash[23528]: cluster 2024-09-21T02:16:38.654573+0000 mgr.a (mgr.14388) 10479 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:40.657 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:40.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:40.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:40.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:40.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:40 smithi044 bash[22676]: audit 2024-09-21T02:16:40.210735+0000 mgr.a (mgr.14388) 10480 : audit [DBG] from='client.231252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:41.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:40 smithi179 bash[23186]: audit 2024-09-21T02:16:40.210735+0000 mgr.a (mgr.14388) 10480 : audit [DBG] from='client.231252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:40 smithi049 bash[23528]: audit 2024-09-21T02:16:40.210735+0000 mgr.a (mgr.14388) 10480 : audit [DBG] from='client.231252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:42 smithi044 bash[22676]: cluster 2024-09-21T02:16:40.655912+0000 mgr.a (mgr.14388) 10481 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:42 smithi044 bash[22676]: audit 2024-09-21T02:16:41.150274+0000 mon.a (mon.0) 8671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:42 smithi044 bash[22676]: audit 2024-09-21T02:16:41.158399+0000 mon.a (mon.0) 8672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:42 smithi044 bash[22676]: audit 2024-09-21T02:16:41.167521+0000 mon.a (mon.0) 8673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:42 smithi044 bash[22676]: audit 2024-09-21T02:16:41.335544+0000 mon.a (mon.0) 8674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:42 smithi044 bash[22676]: audit 2024-09-21T02:16:41.343766+0000 mon.a (mon.0) 8675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:42 smithi044 bash[22676]: audit 2024-09-21T02:16:41.353530+0000 mon.a (mon.0) 8676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:42 smithi179 bash[23186]: cluster 2024-09-21T02:16:40.655912+0000 mgr.a (mgr.14388) 10481 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:42 smithi179 bash[23186]: audit 2024-09-21T02:16:41.150274+0000 mon.a (mon.0) 8671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:42 smithi179 bash[23186]: audit 2024-09-21T02:16:41.158399+0000 mon.a (mon.0) 8672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:42 smithi179 bash[23186]: audit 2024-09-21T02:16:41.167521+0000 mon.a (mon.0) 8673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:42 smithi179 bash[23186]: audit 2024-09-21T02:16:41.335544+0000 mon.a (mon.0) 8674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:42 smithi179 bash[23186]: audit 2024-09-21T02:16:41.343766+0000 mon.a (mon.0) 8675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:42 smithi179 bash[23186]: audit 2024-09-21T02:16:41.353530+0000 mon.a (mon.0) 8676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:42 smithi049 bash[23528]: cluster 2024-09-21T02:16:40.655912+0000 mgr.a (mgr.14388) 10481 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:42 smithi049 bash[23528]: audit 2024-09-21T02:16:41.150274+0000 mon.a (mon.0) 8671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:42 smithi049 bash[23528]: audit 2024-09-21T02:16:41.158399+0000 mon.a (mon.0) 8672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:42 smithi049 bash[23528]: audit 2024-09-21T02:16:41.167521+0000 mon.a (mon.0) 8673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:42 smithi049 bash[23528]: audit 2024-09-21T02:16:41.335544+0000 mon.a (mon.0) 8674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:42 smithi049 bash[23528]: audit 2024-09-21T02:16:41.343766+0000 mon.a (mon.0) 8675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:42 smithi049 bash[23528]: audit 2024-09-21T02:16:41.353530+0000 mon.a (mon.0) 8676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:44 smithi044 bash[22676]: cluster 2024-09-21T02:16:42.656646+0000 mgr.a (mgr.14388) 10482 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:16:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:44 smithi179 bash[23186]: cluster 2024-09-21T02:16:42.656646+0000 mgr.a (mgr.14388) 10482 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:16:44.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:44 smithi049 bash[23528]: cluster 2024-09-21T02:16:42.656646+0000 mgr.a (mgr.14388) 10482 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:16:45.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:46.466 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:46.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:46.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:46.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:46.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:46 smithi044 bash[22676]: cluster 2024-09-21T02:16:44.657480+0000 mgr.a (mgr.14388) 10483 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:16:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:46 smithi179 bash[23186]: cluster 2024-09-21T02:16:44.657480+0000 mgr.a (mgr.14388) 10483 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:16:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:46 smithi049 bash[23528]: cluster 2024-09-21T02:16:44.657480+0000 mgr.a (mgr.14388) 10483 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:16:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:47 smithi044 bash[22676]: audit 2024-09-21T02:16:45.999383+0000 mgr.a (mgr.14388) 10484 : audit [DBG] from='client.231330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:47 smithi179 bash[23186]: audit 2024-09-21T02:16:45.999383+0000 mgr.a (mgr.14388) 10484 : audit [DBG] from='client.231330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:47.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:47 smithi049 bash[23528]: audit 2024-09-21T02:16:45.999383+0000 mgr.a (mgr.14388) 10484 : audit [DBG] from='client.231330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:48.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:16:47 smithi044 bash[22930]: debug 2024-09-21T02:16:47.954+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:16:48.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:16:47 smithi044 bash[22930]: debug 2024-09-21T02:16:47.954+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:16:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: cluster 2024-09-21T02:16:46.660282+0000 mgr.a (mgr.14388) 10485 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:47.166403+0000 mon.a (mon.0) 8677 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:47.174846+0000 mon.a (mon.0) 8678 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:47.176759+0000 mon.a (mon.0) 8679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:47.188511+0000 mon.a (mon.0) 8680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:47.195695+0000 mon.a (mon.0) 8681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:47.198567+0000 mgr.a (mgr.14388) 10486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:48.057213+0000 mon.a (mon.0) 8682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:48.066265+0000 mon.a (mon.0) 8683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:48 smithi044 bash[22676]: audit 2024-09-21T02:16:48.076629+0000 mon.a (mon.0) 8684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: cluster 2024-09-21T02:16:46.660282+0000 mgr.a (mgr.14388) 10485 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:47.166403+0000 mon.a (mon.0) 8677 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:47.174846+0000 mon.a (mon.0) 8678 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:47.176759+0000 mon.a (mon.0) 8679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:47.188511+0000 mon.a (mon.0) 8680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:47.195695+0000 mon.a (mon.0) 8681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:47.198567+0000 mgr.a (mgr.14388) 10486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:48.057213+0000 mon.a (mon.0) 8682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:48.066265+0000 mon.a (mon.0) 8683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:48 smithi179 bash[23186]: audit 2024-09-21T02:16:48.076629+0000 mon.a (mon.0) 8684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: cluster 2024-09-21T02:16:46.660282+0000 mgr.a (mgr.14388) 10485 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:47.166403+0000 mon.a (mon.0) 8677 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:47.174846+0000 mon.a (mon.0) 8678 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:47.176759+0000 mon.a (mon.0) 8679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:47.188511+0000 mon.a (mon.0) 8680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:47.195695+0000 mon.a (mon.0) 8681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:47.198567+0000 mgr.a (mgr.14388) 10486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:48.057213+0000 mon.a (mon.0) 8682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:48.066265+0000 mon.a (mon.0) 8683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:48 smithi049 bash[23528]: audit 2024-09-21T02:16:48.076629+0000 mon.a (mon.0) 8684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:16:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:49 smithi044 bash[22676]: audit 2024-09-21T02:16:47.957477+0000 mgr.a (mgr.14388) 10487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:16:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:49 smithi044 bash[22676]: cephadm 2024-09-21T02:16:47.959477+0000 mgr.a (mgr.14388) 10488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:16:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:49 smithi179 bash[23186]: audit 2024-09-21T02:16:47.957477+0000 mgr.a (mgr.14388) 10487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:16:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:49 smithi179 bash[23186]: cephadm 2024-09-21T02:16:47.959477+0000 mgr.a (mgr.14388) 10488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:49 smithi049 bash[23528]: audit 2024-09-21T02:16:47.957477+0000 mgr.a (mgr.14388) 10487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:16:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:49 smithi049 bash[23528]: cephadm 2024-09-21T02:16:47.959477+0000 mgr.a (mgr.14388) 10488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:16:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:50 smithi044 bash[22676]: cluster 2024-09-21T02:16:48.661231+0000 mgr.a (mgr.14388) 10489 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:50 smithi179 bash[23186]: cluster 2024-09-21T02:16:48.661231+0000 mgr.a (mgr.14388) 10489 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:50 smithi049 bash[23528]: cluster 2024-09-21T02:16:48.661231+0000 mgr.a (mgr.14388) 10489 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:16:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:52.213 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:52.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:52.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:52.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:52.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:52 smithi044 bash[22676]: cluster 2024-09-21T02:16:50.663516+0000 mgr.a (mgr.14388) 10490 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:52 smithi179 bash[23186]: cluster 2024-09-21T02:16:50.663516+0000 mgr.a (mgr.14388) 10490 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:52 smithi049 bash[23528]: cluster 2024-09-21T02:16:50.663516+0000 mgr.a (mgr.14388) 10490 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:53.381 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:53 smithi179 bash[23186]: audit 2024-09-21T02:16:51.793830+0000 mgr.a (mgr.14388) 10491 : audit [DBG] from='client.231510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:53 smithi044 bash[22676]: audit 2024-09-21T02:16:51.793830+0000 mgr.a (mgr.14388) 10491 : audit [DBG] from='client.231510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:53 smithi049 bash[23528]: audit 2024-09-21T02:16:51.793830+0000 mgr.a (mgr.14388) 10491 : audit [DBG] from='client.231510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:54 smithi044 bash[22676]: cluster 2024-09-21T02:16:52.664517+0000 mgr.a (mgr.14388) 10492 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:54 smithi179 bash[23186]: cluster 2024-09-21T02:16:52.664517+0000 mgr.a (mgr.14388) 10492 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:54 smithi049 bash[23528]: cluster 2024-09-21T02:16:52.664517+0000 mgr.a (mgr.14388) 10492 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:56 smithi044 bash[22676]: cluster 2024-09-21T02:16:54.665359+0000 mgr.a (mgr.14388) 10493 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:56 smithi179 bash[23186]: cluster 2024-09-21T02:16:54.665359+0000 mgr.a (mgr.14388) 10493 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:56 smithi049 bash[23528]: cluster 2024-09-21T02:16:54.665359+0000 mgr.a (mgr.14388) 10493 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:16:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:16:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:16:57.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:16:57.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:16:57.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:16:57.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:16:57.970 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:16:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:58 smithi049 bash[23528]: cluster 2024-09-21T02:16:56.667611+0000 mgr.a (mgr.14388) 10494 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:58 smithi044 bash[22676]: cluster 2024-09-21T02:16:56.667611+0000 mgr.a (mgr.14388) 10494 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:58 smithi179 bash[23186]: cluster 2024-09-21T02:16:56.667611+0000 mgr.a (mgr.14388) 10494 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:16:59.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:16:59 smithi049 bash[23528]: audit 2024-09-21T02:16:57.548405+0000 mgr.a (mgr.14388) 10495 : audit [DBG] from='client.231588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:16:59 smithi044 bash[22676]: audit 2024-09-21T02:16:57.548405+0000 mgr.a (mgr.14388) 10495 : audit [DBG] from='client.231588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:16:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:16:59 smithi179 bash[23186]: audit 2024-09-21T02:16:57.548405+0000 mgr.a (mgr.14388) 10495 : audit [DBG] from='client.231588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:00 smithi044 bash[22676]: cluster 2024-09-21T02:16:58.668611+0000 mgr.a (mgr.14388) 10496 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:00 smithi179 bash[23186]: cluster 2024-09-21T02:16:58.668611+0000 mgr.a (mgr.14388) 10496 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:00 smithi049 bash[23528]: cluster 2024-09-21T02:16:58.668611+0000 mgr.a (mgr.14388) 10496 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:02 smithi179 bash[23186]: cluster 2024-09-21T02:17:00.670899+0000 mgr.a (mgr.14388) 10497 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:02 smithi179 bash[23186]: audit 2024-09-21T02:17:01.373787+0000 mon.a (mon.0) 8685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:02 smithi179 bash[23186]: audit 2024-09-21T02:17:01.380225+0000 mon.a (mon.0) 8686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:02 smithi179 bash[23186]: audit 2024-09-21T02:17:01.387510+0000 mon.a (mon.0) 8687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:02 smithi179 bash[23186]: audit 2024-09-21T02:17:01.515478+0000 mon.a (mon.0) 8688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:02 smithi179 bash[23186]: audit 2024-09-21T02:17:01.520289+0000 mon.a (mon.0) 8689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:02 smithi179 bash[23186]: audit 2024-09-21T02:17:01.527073+0000 mon.a (mon.0) 8690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:02 smithi044 bash[22676]: cluster 2024-09-21T02:17:00.670899+0000 mgr.a (mgr.14388) 10497 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:02 smithi044 bash[22676]: audit 2024-09-21T02:17:01.373787+0000 mon.a (mon.0) 8685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:02 smithi044 bash[22676]: audit 2024-09-21T02:17:01.380225+0000 mon.a (mon.0) 8686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:02 smithi044 bash[22676]: audit 2024-09-21T02:17:01.387510+0000 mon.a (mon.0) 8687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:02 smithi044 bash[22676]: audit 2024-09-21T02:17:01.515478+0000 mon.a (mon.0) 8688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:02 smithi044 bash[22676]: audit 2024-09-21T02:17:01.520289+0000 mon.a (mon.0) 8689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:02 smithi044 bash[22676]: audit 2024-09-21T02:17:01.527073+0000 mon.a (mon.0) 8690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:02 smithi049 bash[23528]: cluster 2024-09-21T02:17:00.670899+0000 mgr.a (mgr.14388) 10497 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:02 smithi049 bash[23528]: audit 2024-09-21T02:17:01.373787+0000 mon.a (mon.0) 8685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:02 smithi049 bash[23528]: audit 2024-09-21T02:17:01.380225+0000 mon.a (mon.0) 8686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:02 smithi049 bash[23528]: audit 2024-09-21T02:17:01.387510+0000 mon.a (mon.0) 8687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:02 smithi049 bash[23528]: audit 2024-09-21T02:17:01.515478+0000 mon.a (mon.0) 8688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:02 smithi049 bash[23528]: audit 2024-09-21T02:17:01.520289+0000 mon.a (mon.0) 8689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:02 smithi049 bash[23528]: audit 2024-09-21T02:17:01.527073+0000 mon.a (mon.0) 8690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:02.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:02.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:02.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:03.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:03.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:03.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:03.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:04 smithi044 bash[22676]: cluster 2024-09-21T02:17:02.671649+0000 mgr.a (mgr.14388) 10498 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:04 smithi179 bash[23186]: cluster 2024-09-21T02:17:02.671649+0000 mgr.a (mgr.14388) 10498 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:04 smithi049 bash[23528]: cluster 2024-09-21T02:17:02.671649+0000 mgr.a (mgr.14388) 10498 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:05 smithi179 bash[23186]: audit 2024-09-21T02:17:03.312604+0000 mgr.a (mgr.14388) 10499 : audit [DBG] from='client.231666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:05.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:05 smithi049 bash[23528]: audit 2024-09-21T02:17:03.312604+0000 mgr.a (mgr.14388) 10499 : audit [DBG] from='client.231666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:05 smithi044 bash[22676]: audit 2024-09-21T02:17:03.312604+0000 mgr.a (mgr.14388) 10499 : audit [DBG] from='client.231666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:06 smithi179 bash[23186]: cluster 2024-09-21T02:17:04.672647+0000 mgr.a (mgr.14388) 10500 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:06 smithi049 bash[23528]: cluster 2024-09-21T02:17:04.672647+0000 mgr.a (mgr.14388) 10500 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:06 smithi044 bash[22676]: cluster 2024-09-21T02:17:04.672647+0000 mgr.a (mgr.14388) 10500 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:07 smithi179 bash[23186]: cluster 2024-09-21T02:17:06.674953+0000 mgr.a (mgr.14388) 10501 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:07 smithi049 bash[23528]: cluster 2024-09-21T02:17:06.674953+0000 mgr.a (mgr.14388) 10501 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:07 smithi044 bash[22676]: cluster 2024-09-21T02:17:06.674953+0000 mgr.a (mgr.14388) 10501 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:08.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:09 smithi049 bash[23528]: audit 2024-09-21T02:17:08.291169+0000 mon.a (mon.0) 8691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:09 smithi049 bash[23528]: audit 2024-09-21T02:17:08.300544+0000 mon.a (mon.0) 8692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:09 smithi049 bash[23528]: audit 2024-09-21T02:17:08.309710+0000 mon.a (mon.0) 8693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:09 smithi049 bash[23528]: cluster 2024-09-21T02:17:08.675760+0000 mgr.a (mgr.14388) 10502 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:09 smithi049 bash[23528]: audit 2024-09-21T02:17:09.104464+0000 mgr.a (mgr.14388) 10503 : audit [DBG] from='client.231744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:09.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:09.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:09.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:09.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:09.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:09.636 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:09 smithi044 bash[22676]: audit 2024-09-21T02:17:08.291169+0000 mon.a (mon.0) 8691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.636 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:09 smithi044 bash[22676]: audit 2024-09-21T02:17:08.300544+0000 mon.a (mon.0) 8692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.636 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:09 smithi044 bash[22676]: audit 2024-09-21T02:17:08.309710+0000 mon.a (mon.0) 8693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.636 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:09 smithi044 bash[22676]: cluster 2024-09-21T02:17:08.675760+0000 mgr.a (mgr.14388) 10502 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:09.636 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:09 smithi044 bash[22676]: audit 2024-09-21T02:17:09.104464+0000 mgr.a (mgr.14388) 10503 : audit [DBG] from='client.231744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:09 smithi179 bash[23186]: audit 2024-09-21T02:17:08.291169+0000 mon.a (mon.0) 8691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:09 smithi179 bash[23186]: audit 2024-09-21T02:17:08.300544+0000 mon.a (mon.0) 8692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:09 smithi179 bash[23186]: audit 2024-09-21T02:17:08.309710+0000 mon.a (mon.0) 8693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:09 smithi179 bash[23186]: cluster 2024-09-21T02:17:08.675760+0000 mgr.a (mgr.14388) 10502 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:09 smithi179 bash[23186]: audit 2024-09-21T02:17:09.104464+0000 mgr.a (mgr.14388) 10503 : audit [DBG] from='client.231744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:11 smithi044 bash[22676]: cluster 2024-09-21T02:17:10.678193+0000 mgr.a (mgr.14388) 10504 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:11 smithi179 bash[23186]: cluster 2024-09-21T02:17:10.678193+0000 mgr.a (mgr.14388) 10504 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:11 smithi049 bash[23528]: cluster 2024-09-21T02:17:10.678193+0000 mgr.a (mgr.14388) 10504 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:13 smithi179 bash[23186]: cluster 2024-09-21T02:17:12.679059+0000 mgr.a (mgr.14388) 10505 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:14.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:13 smithi049 bash[23528]: cluster 2024-09-21T02:17:12.679059+0000 mgr.a (mgr.14388) 10505 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:13 smithi044 bash[22676]: cluster 2024-09-21T02:17:12.679059+0000 mgr.a (mgr.14388) 10505 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:15.359 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:15.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:15.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:15.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:15.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:16.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:15 smithi179 bash[23186]: cluster 2024-09-21T02:17:14.679505+0000 mgr.a (mgr.14388) 10506 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:15 smithi179 bash[23186]: audit 2024-09-21T02:17:14.915911+0000 mgr.a (mgr.14388) 10507 : audit [DBG] from='client.231819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:15 smithi049 bash[23528]: cluster 2024-09-21T02:17:14.679505+0000 mgr.a (mgr.14388) 10506 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:15 smithi049 bash[23528]: audit 2024-09-21T02:17:14.915911+0000 mgr.a (mgr.14388) 10507 : audit [DBG] from='client.231819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:15 smithi044 bash[22676]: cluster 2024-09-21T02:17:14.679505+0000 mgr.a (mgr.14388) 10506 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:15 smithi044 bash[22676]: audit 2024-09-21T02:17:14.915911+0000 mgr.a (mgr.14388) 10507 : audit [DBG] from='client.231819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:17 smithi179 bash[23186]: cluster 2024-09-21T02:17:16.682261+0000 mgr.a (mgr.14388) 10508 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:17 smithi049 bash[23528]: cluster 2024-09-21T02:17:16.682261+0000 mgr.a (mgr.14388) 10508 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:17 smithi044 bash[22676]: cluster 2024-09-21T02:17:16.682261+0000 mgr.a (mgr.14388) 10508 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:20.011 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:19 smithi049 bash[23528]: cluster 2024-09-21T02:17:18.683068+0000 mgr.a (mgr.14388) 10509 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:17:20.132 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:19 smithi179 bash[23186]: cluster 2024-09-21T02:17:18.683068+0000 mgr.a (mgr.14388) 10509 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:17:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:19 smithi044 bash[22676]: cluster 2024-09-21T02:17:18.683068+0000 mgr.a (mgr.14388) 10509 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:17:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:20.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:21.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: cluster 2024-09-21T02:17:20.684332+0000 mgr.a (mgr.14388) 10510 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: audit 2024-09-21T02:17:20.704829+0000 mgr.a (mgr.14388) 10511 : audit [DBG] from='client.231897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: audit 2024-09-21T02:17:21.582947+0000 mon.a (mon.0) 8694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: audit 2024-09-21T02:17:21.588567+0000 mon.a (mon.0) 8695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: audit 2024-09-21T02:17:21.595529+0000 mon.a (mon.0) 8696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: audit 2024-09-21T02:17:21.732240+0000 mon.a (mon.0) 8697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: audit 2024-09-21T02:17:21.740744+0000 mon.a (mon.0) 8698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:21 smithi179 bash[23186]: audit 2024-09-21T02:17:21.751611+0000 mon.a (mon.0) 8699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: cluster 2024-09-21T02:17:20.684332+0000 mgr.a (mgr.14388) 10510 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: audit 2024-09-21T02:17:20.704829+0000 mgr.a (mgr.14388) 10511 : audit [DBG] from='client.231897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: audit 2024-09-21T02:17:21.582947+0000 mon.a (mon.0) 8694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: audit 2024-09-21T02:17:21.588567+0000 mon.a (mon.0) 8695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: audit 2024-09-21T02:17:21.595529+0000 mon.a (mon.0) 8696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: audit 2024-09-21T02:17:21.732240+0000 mon.a (mon.0) 8697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: audit 2024-09-21T02:17:21.740744+0000 mon.a (mon.0) 8698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:21 smithi044 bash[22676]: audit 2024-09-21T02:17:21.751611+0000 mon.a (mon.0) 8699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: cluster 2024-09-21T02:17:20.684332+0000 mgr.a (mgr.14388) 10510 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: audit 2024-09-21T02:17:20.704829+0000 mgr.a (mgr.14388) 10511 : audit [DBG] from='client.231897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: audit 2024-09-21T02:17:21.582947+0000 mon.a (mon.0) 8694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: audit 2024-09-21T02:17:21.588567+0000 mon.a (mon.0) 8695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: audit 2024-09-21T02:17:21.595529+0000 mon.a (mon.0) 8696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: audit 2024-09-21T02:17:21.732240+0000 mon.a (mon.0) 8697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: audit 2024-09-21T02:17:21.740744+0000 mon.a (mon.0) 8698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:21 smithi049 bash[23528]: audit 2024-09-21T02:17:21.751611+0000 mon.a (mon.0) 8699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:23 smithi049 bash[23528]: cluster 2024-09-21T02:17:22.685191+0000 mgr.a (mgr.14388) 10512 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:17:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:23 smithi044 bash[22676]: cluster 2024-09-21T02:17:22.685191+0000 mgr.a (mgr.14388) 10512 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:17:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:23 smithi179 bash[23186]: cluster 2024-09-21T02:17:22.685191+0000 mgr.a (mgr.14388) 10512 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:17:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:25 smithi049 bash[23528]: cluster 2024-09-21T02:17:24.685986+0000 mgr.a (mgr.14388) 10513 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:17:26.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:26.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:26.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:25 smithi044 bash[22676]: cluster 2024-09-21T02:17:24.685986+0000 mgr.a (mgr.14388) 10513 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:17:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:25 smithi179 bash[23186]: cluster 2024-09-21T02:17:24.685986+0000 mgr.a (mgr.14388) 10513 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:17:26.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:26.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:26.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:26.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:26.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:27 smithi049 bash[23528]: audit 2024-09-21T02:17:26.481416+0000 mgr.a (mgr.14388) 10514 : audit [DBG] from='client.231972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:27 smithi049 bash[23528]: cluster 2024-09-21T02:17:26.687417+0000 mgr.a (mgr.14388) 10515 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:27 smithi044 bash[22676]: audit 2024-09-21T02:17:26.481416+0000 mgr.a (mgr.14388) 10514 : audit [DBG] from='client.231972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:27 smithi044 bash[22676]: cluster 2024-09-21T02:17:26.687417+0000 mgr.a (mgr.14388) 10515 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:27 smithi179 bash[23186]: audit 2024-09-21T02:17:26.481416+0000 mgr.a (mgr.14388) 10514 : audit [DBG] from='client.231972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:27 smithi179 bash[23186]: cluster 2024-09-21T02:17:26.687417+0000 mgr.a (mgr.14388) 10515 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:29 smithi049 bash[23528]: audit 2024-09-21T02:17:28.514907+0000 mon.a (mon.0) 8700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:29 smithi049 bash[23528]: audit 2024-09-21T02:17:28.520944+0000 mon.a (mon.0) 8701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:29 smithi049 bash[23528]: audit 2024-09-21T02:17:28.527587+0000 mon.a (mon.0) 8702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:29 smithi049 bash[23528]: cluster 2024-09-21T02:17:28.688299+0000 mgr.a (mgr.14388) 10516 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:29.864 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:29 smithi044 bash[22676]: audit 2024-09-21T02:17:28.514907+0000 mon.a (mon.0) 8700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:29.864 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:29 smithi044 bash[22676]: audit 2024-09-21T02:17:28.520944+0000 mon.a (mon.0) 8701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:29.864 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:29 smithi044 bash[22676]: audit 2024-09-21T02:17:28.527587+0000 mon.a (mon.0) 8702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:29.864 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:29 smithi044 bash[22676]: cluster 2024-09-21T02:17:28.688299+0000 mgr.a (mgr.14388) 10516 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:29 smithi179 bash[23186]: audit 2024-09-21T02:17:28.514907+0000 mon.a (mon.0) 8700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:29 smithi179 bash[23186]: audit 2024-09-21T02:17:28.520944+0000 mon.a (mon.0) 8701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:29 smithi179 bash[23186]: audit 2024-09-21T02:17:28.527587+0000 mon.a (mon.0) 8702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:29 smithi179 bash[23186]: cluster 2024-09-21T02:17:28.688299+0000 mgr.a (mgr.14388) 10516 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:31.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:31.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:31.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:31 smithi179 bash[23186]: cluster 2024-09-21T02:17:30.690607+0000 mgr.a (mgr.14388) 10517 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:32.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:31 smithi049 bash[23528]: cluster 2024-09-21T02:17:30.690607+0000 mgr.a (mgr.14388) 10517 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:32.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:31 smithi044 bash[22676]: cluster 2024-09-21T02:17:30.690607+0000 mgr.a (mgr.14388) 10517 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:32.671 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:32.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:32.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:33 smithi179 bash[23186]: audit 2024-09-21T02:17:32.249890+0000 mgr.a (mgr.14388) 10518 : audit [DBG] from='client.232047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:33 smithi179 bash[23186]: cluster 2024-09-21T02:17:32.691366+0000 mgr.a (mgr.14388) 10519 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:33 smithi049 bash[23528]: audit 2024-09-21T02:17:32.249890+0000 mgr.a (mgr.14388) 10518 : audit [DBG] from='client.232047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:33 smithi049 bash[23528]: cluster 2024-09-21T02:17:32.691366+0000 mgr.a (mgr.14388) 10519 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:33 smithi044 bash[22676]: audit 2024-09-21T02:17:32.249890+0000 mgr.a (mgr.14388) 10518 : audit [DBG] from='client.232047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:33 smithi044 bash[22676]: cluster 2024-09-21T02:17:32.691366+0000 mgr.a (mgr.14388) 10519 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:36.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:35 smithi179 bash[23186]: cluster 2024-09-21T02:17:34.692247+0000 mgr.a (mgr.14388) 10520 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:36.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:35 smithi049 bash[23528]: cluster 2024-09-21T02:17:34.692247+0000 mgr.a (mgr.14388) 10520 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:35 smithi044 bash[22676]: cluster 2024-09-21T02:17:34.692247+0000 mgr.a (mgr.14388) 10520 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:37 smithi049 bash[23528]: cluster 2024-09-21T02:17:36.694506+0000 mgr.a (mgr.14388) 10521 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:37 smithi044 bash[22676]: cluster 2024-09-21T02:17:36.694506+0000 mgr.a (mgr.14388) 10521 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:37 smithi179 bash[23186]: cluster 2024-09-21T02:17:36.694506+0000 mgr.a (mgr.14388) 10521 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:38.426 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:38.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:38 smithi049 bash[23528]: audit 2024-09-21T02:17:38.001134+0000 mgr.a (mgr.14388) 10522 : audit [DBG] from='client.232122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:38 smithi044 bash[22676]: audit 2024-09-21T02:17:38.001134+0000 mgr.a (mgr.14388) 10522 : audit [DBG] from='client.232122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:38 smithi179 bash[23186]: audit 2024-09-21T02:17:38.001134+0000 mgr.a (mgr.14388) 10522 : audit [DBG] from='client.232122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:39 smithi049 bash[23528]: cluster 2024-09-21T02:17:38.695587+0000 mgr.a (mgr.14388) 10523 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:39 smithi044 bash[22676]: cluster 2024-09-21T02:17:38.695587+0000 mgr.a (mgr.14388) 10523 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:39 smithi179 bash[23186]: cluster 2024-09-21T02:17:38.695587+0000 mgr.a (mgr.14388) 10523 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:41 smithi049 bash[23528]: cluster 2024-09-21T02:17:40.698023+0000 mgr.a (mgr.14388) 10524 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:41 smithi044 bash[22676]: cluster 2024-09-21T02:17:40.698023+0000 mgr.a (mgr.14388) 10524 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:41 smithi179 bash[23186]: cluster 2024-09-21T02:17:40.698023+0000 mgr.a (mgr.14388) 10524 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:42 smithi044 bash[22676]: audit 2024-09-21T02:17:41.796905+0000 mon.a (mon.0) 8703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:42 smithi044 bash[22676]: audit 2024-09-21T02:17:41.803295+0000 mon.a (mon.0) 8704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:42 smithi044 bash[22676]: audit 2024-09-21T02:17:41.811749+0000 mon.a (mon.0) 8705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:42 smithi044 bash[22676]: audit 2024-09-21T02:17:41.919137+0000 mon.a (mon.0) 8706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:42 smithi044 bash[22676]: audit 2024-09-21T02:17:41.927281+0000 mon.a (mon.0) 8707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:42 smithi044 bash[22676]: audit 2024-09-21T02:17:41.937809+0000 mon.a (mon.0) 8708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:42 smithi049 bash[23528]: audit 2024-09-21T02:17:41.796905+0000 mon.a (mon.0) 8703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:42 smithi049 bash[23528]: audit 2024-09-21T02:17:41.803295+0000 mon.a (mon.0) 8704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:42 smithi049 bash[23528]: audit 2024-09-21T02:17:41.811749+0000 mon.a (mon.0) 8705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:42 smithi049 bash[23528]: audit 2024-09-21T02:17:41.919137+0000 mon.a (mon.0) 8706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:42 smithi049 bash[23528]: audit 2024-09-21T02:17:41.927281+0000 mon.a (mon.0) 8707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:42 smithi049 bash[23528]: audit 2024-09-21T02:17:41.937809+0000 mon.a (mon.0) 8708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:42 smithi179 bash[23186]: audit 2024-09-21T02:17:41.796905+0000 mon.a (mon.0) 8703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:42 smithi179 bash[23186]: audit 2024-09-21T02:17:41.803295+0000 mon.a (mon.0) 8704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:42 smithi179 bash[23186]: audit 2024-09-21T02:17:41.811749+0000 mon.a (mon.0) 8705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:42 smithi179 bash[23186]: audit 2024-09-21T02:17:41.919137+0000 mon.a (mon.0) 8706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:42 smithi179 bash[23186]: audit 2024-09-21T02:17:41.927281+0000 mon.a (mon.0) 8707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:42 smithi179 bash[23186]: audit 2024-09-21T02:17:41.937809+0000 mon.a (mon.0) 8708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:43.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:43.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:43.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:44.186 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:44.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:44.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:44.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:44.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:43 smithi044 bash[22676]: cluster 2024-09-21T02:17:42.698867+0000 mgr.a (mgr.14388) 10525 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:44.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:43 smithi179 bash[23186]: cluster 2024-09-21T02:17:42.698867+0000 mgr.a (mgr.14388) 10525 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:43 smithi049 bash[23528]: cluster 2024-09-21T02:17:42.698867+0000 mgr.a (mgr.14388) 10525 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:44 smithi044 bash[22676]: audit 2024-09-21T02:17:43.763787+0000 mgr.a (mgr.14388) 10526 : audit [DBG] from='client.232197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:44 smithi179 bash[23186]: audit 2024-09-21T02:17:43.763787+0000 mgr.a (mgr.14388) 10526 : audit [DBG] from='client.232197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:45.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:44 smithi049 bash[23528]: audit 2024-09-21T02:17:43.763787+0000 mgr.a (mgr.14388) 10526 : audit [DBG] from='client.232197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:45 smithi044 bash[22676]: cluster 2024-09-21T02:17:44.699873+0000 mgr.a (mgr.14388) 10527 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:45 smithi179 bash[23186]: cluster 2024-09-21T02:17:44.699873+0000 mgr.a (mgr.14388) 10527 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:45 smithi049 bash[23528]: cluster 2024-09-21T02:17:44.699873+0000 mgr.a (mgr.14388) 10527 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:47 smithi044 bash[22676]: cluster 2024-09-21T02:17:46.702149+0000 mgr.a (mgr.14388) 10528 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:47 smithi179 bash[23186]: cluster 2024-09-21T02:17:46.702149+0000 mgr.a (mgr.14388) 10528 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:48.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:47 smithi049 bash[23528]: cluster 2024-09-21T02:17:46.702149+0000 mgr.a (mgr.14388) 10528 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.021510+0000 mon.a (mon.0) 8709 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.028926+0000 mon.a (mon.0) 8710 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.030871+0000 mon.a (mon.0) 8711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.043535+0000 mon.a (mon.0) 8712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.049898+0000 mon.a (mon.0) 8713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.052267+0000 mgr.a (mgr.14388) 10529 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.723539+0000 mon.a (mon.0) 8714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.729950+0000 mon.a (mon.0) 8715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:48 smithi049 bash[23528]: audit 2024-09-21T02:17:48.735265+0000 mon.a (mon.0) 8716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.086 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22930]: debug 2024-09-21T02:17:48.809+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:17:49.086 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22930]: debug 2024-09-21T02:17:48.809+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:17:49.086 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22676]: audit 2024-09-21T02:17:48.021510+0000 mon.a (mon.0) 8709 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:17:49.086 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22676]: audit 2024-09-21T02:17:48.028926+0000 mon.a (mon.0) 8710 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:17:49.086 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22676]: audit 2024-09-21T02:17:48.030871+0000 mon.a (mon.0) 8711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:17:49.086 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22676]: audit 2024-09-21T02:17:48.043535+0000 mon.a (mon.0) 8712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.087 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22676]: audit 2024-09-21T02:17:48.049898+0000 mon.a (mon.0) 8713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:17:49.087 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:48 smithi044 bash[22676]: audit 2024-09-21T02:17:48.052267+0000 mgr.a (mgr.14388) 10529 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:17:49.087 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:49 smithi044 bash[22676]: audit 2024-09-21T02:17:48.723539+0000 mon.a (mon.0) 8714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.087 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:49 smithi044 bash[22676]: audit 2024-09-21T02:17:48.729950+0000 mon.a (mon.0) 8715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.087 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:49 smithi044 bash[22676]: audit 2024-09-21T02:17:48.735265+0000 mon.a (mon.0) 8716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:49.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:49.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.021510+0000 mon.a (mon.0) 8709 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:17:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.028926+0000 mon.a (mon.0) 8710 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.030871+0000 mon.a (mon.0) 8711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.043535+0000 mon.a (mon.0) 8712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.049898+0000 mon.a (mon.0) 8713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.052267+0000 mgr.a (mgr.14388) 10529 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.723539+0000 mon.a (mon.0) 8714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.729950+0000 mon.a (mon.0) 8715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:48 smithi179 bash[23186]: audit 2024-09-21T02:17:48.735265+0000 mon.a (mon.0) 8716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:17:49.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:49.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:50 smithi049 bash[23528]: cluster 2024-09-21T02:17:48.702663+0000 mgr.a (mgr.14388) 10530 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:50 smithi049 bash[23528]: audit 2024-09-21T02:17:48.815770+0000 mgr.a (mgr.14388) 10531 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:17:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:50 smithi049 bash[23528]: cephadm 2024-09-21T02:17:48.816700+0000 mgr.a (mgr.14388) 10532 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:17:50.302 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:50 smithi044 bash[22676]: cluster 2024-09-21T02:17:48.702663+0000 mgr.a (mgr.14388) 10530 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:50.302 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:50 smithi044 bash[22676]: audit 2024-09-21T02:17:48.815770+0000 mgr.a (mgr.14388) 10531 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:17:50.302 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:50 smithi044 bash[22676]: cephadm 2024-09-21T02:17:48.816700+0000 mgr.a (mgr.14388) 10532 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:17:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:50 smithi179 bash[23186]: cluster 2024-09-21T02:17:48.702663+0000 mgr.a (mgr.14388) 10530 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:17:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:50 smithi179 bash[23186]: audit 2024-09-21T02:17:48.815770+0000 mgr.a (mgr.14388) 10531 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:17:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:50 smithi179 bash[23186]: cephadm 2024-09-21T02:17:48.816700+0000 mgr.a (mgr.14388) 10532 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:17:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:51 smithi044 bash[22676]: audit 2024-09-21T02:17:49.513632+0000 mgr.a (mgr.14388) 10533 : audit [DBG] from='client.232383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:51.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:51 smithi049 bash[23528]: audit 2024-09-21T02:17:49.513632+0000 mgr.a (mgr.14388) 10533 : audit [DBG] from='client.232383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:51 smithi179 bash[23186]: audit 2024-09-21T02:17:49.513632+0000 mgr.a (mgr.14388) 10533 : audit [DBG] from='client.232383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:52 smithi044 bash[22676]: cluster 2024-09-21T02:17:50.705139+0000 mgr.a (mgr.14388) 10534 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:52 smithi179 bash[23186]: cluster 2024-09-21T02:17:50.705139+0000 mgr.a (mgr.14388) 10534 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:52 smithi049 bash[23528]: cluster 2024-09-21T02:17:50.705139+0000 mgr.a (mgr.14388) 10534 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:54 smithi179 bash[23186]: cluster 2024-09-21T02:17:52.706175+0000 mgr.a (mgr.14388) 10535 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:54 smithi044 bash[22676]: cluster 2024-09-21T02:17:52.706175+0000 mgr.a (mgr.14388) 10535 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:54 smithi049 bash[23528]: cluster 2024-09-21T02:17:52.706175+0000 mgr.a (mgr.14388) 10535 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:54.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:17:54.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:17:54.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:17:55.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:17:55.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:17:55.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:17:55.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:17:55.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:17:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:56 smithi044 bash[22676]: cluster 2024-09-21T02:17:54.706979+0000 mgr.a (mgr.14388) 10536 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:56 smithi179 bash[23186]: cluster 2024-09-21T02:17:54.706979+0000 mgr.a (mgr.14388) 10536 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:56 smithi049 bash[23528]: cluster 2024-09-21T02:17:54.706979+0000 mgr.a (mgr.14388) 10536 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:57 smithi044 bash[22676]: audit 2024-09-21T02:17:55.270669+0000 mgr.a (mgr.14388) 10537 : audit [DBG] from='client.232461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:57 smithi179 bash[23186]: audit 2024-09-21T02:17:55.270669+0000 mgr.a (mgr.14388) 10537 : audit [DBG] from='client.232461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:57 smithi049 bash[23528]: audit 2024-09-21T02:17:55.270669+0000 mgr.a (mgr.14388) 10537 : audit [DBG] from='client.232461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:17:58.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:17:58 smithi049 bash[23528]: cluster 2024-09-21T02:17:56.709870+0000 mgr.a (mgr.14388) 10538 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:17:58 smithi044 bash[22676]: cluster 2024-09-21T02:17:56.709870+0000 mgr.a (mgr.14388) 10538 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:17:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:17:58 smithi179 bash[23186]: cluster 2024-09-21T02:17:56.709870+0000 mgr.a (mgr.14388) 10538 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:00 smithi044 bash[22676]: cluster 2024-09-21T02:17:58.710837+0000 mgr.a (mgr.14388) 10539 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:18:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:00 smithi179 bash[23186]: cluster 2024-09-21T02:17:58.710837+0000 mgr.a (mgr.14388) 10539 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:18:00.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:00 smithi049 bash[23528]: cluster 2024-09-21T02:17:58.710837+0000 mgr.a (mgr.14388) 10539 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:18:00.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:00.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:00.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:01.452 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:02 smithi044 bash[22676]: cluster 2024-09-21T02:18:00.712037+0000 mgr.a (mgr.14388) 10540 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:02 smithi044 bash[22676]: audit 2024-09-21T02:18:01.033257+0000 mgr.a (mgr.14388) 10541 : audit [DBG] from='client.232530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:02 smithi044 bash[22676]: audit 2024-09-21T02:18:02.011797+0000 mon.a (mon.0) 8717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:02 smithi044 bash[22676]: audit 2024-09-21T02:18:02.017699+0000 mon.a (mon.0) 8718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:02 smithi044 bash[22676]: audit 2024-09-21T02:18:02.026160+0000 mon.a (mon.0) 8719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:02 smithi179 bash[23186]: cluster 2024-09-21T02:18:00.712037+0000 mgr.a (mgr.14388) 10540 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:02 smithi179 bash[23186]: audit 2024-09-21T02:18:01.033257+0000 mgr.a (mgr.14388) 10541 : audit [DBG] from='client.232530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:02 smithi179 bash[23186]: audit 2024-09-21T02:18:02.011797+0000 mon.a (mon.0) 8717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:02 smithi179 bash[23186]: audit 2024-09-21T02:18:02.017699+0000 mon.a (mon.0) 8718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:02 smithi179 bash[23186]: audit 2024-09-21T02:18:02.026160+0000 mon.a (mon.0) 8719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:02 smithi049 bash[23528]: cluster 2024-09-21T02:18:00.712037+0000 mgr.a (mgr.14388) 10540 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:02 smithi049 bash[23528]: audit 2024-09-21T02:18:01.033257+0000 mgr.a (mgr.14388) 10541 : audit [DBG] from='client.232530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:02 smithi049 bash[23528]: audit 2024-09-21T02:18:02.011797+0000 mon.a (mon.0) 8717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:02 smithi049 bash[23528]: audit 2024-09-21T02:18:02.017699+0000 mon.a (mon.0) 8718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:02 smithi049 bash[23528]: audit 2024-09-21T02:18:02.026160+0000 mon.a (mon.0) 8719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:03 smithi044 bash[22676]: audit 2024-09-21T02:18:02.145120+0000 mon.a (mon.0) 8720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:03 smithi044 bash[22676]: audit 2024-09-21T02:18:02.153411+0000 mon.a (mon.0) 8721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:03 smithi044 bash[22676]: audit 2024-09-21T02:18:02.163431+0000 mon.a (mon.0) 8722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:03 smithi179 bash[23186]: audit 2024-09-21T02:18:02.145120+0000 mon.a (mon.0) 8720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:03 smithi179 bash[23186]: audit 2024-09-21T02:18:02.153411+0000 mon.a (mon.0) 8721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:03 smithi179 bash[23186]: audit 2024-09-21T02:18:02.163431+0000 mon.a (mon.0) 8722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:03 smithi049 bash[23528]: audit 2024-09-21T02:18:02.145120+0000 mon.a (mon.0) 8720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:03 smithi049 bash[23528]: audit 2024-09-21T02:18:02.153411+0000 mon.a (mon.0) 8721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:03 smithi049 bash[23528]: audit 2024-09-21T02:18:02.163431+0000 mon.a (mon.0) 8722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:04 smithi044 bash[22676]: cluster 2024-09-21T02:18:02.712910+0000 mgr.a (mgr.14388) 10542 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:04 smithi179 bash[23186]: cluster 2024-09-21T02:18:02.712910+0000 mgr.a (mgr.14388) 10542 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:04 smithi049 bash[23528]: cluster 2024-09-21T02:18:02.712910+0000 mgr.a (mgr.14388) 10542 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:06.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:06 smithi044 bash[22676]: cluster 2024-09-21T02:18:04.713711+0000 mgr.a (mgr.14388) 10543 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:18:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:06 smithi179 bash[23186]: cluster 2024-09-21T02:18:04.713711+0000 mgr.a (mgr.14388) 10543 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:18:06.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:06 smithi049 bash[23528]: cluster 2024-09-21T02:18:04.713711+0000 mgr.a (mgr.14388) 10543 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:18:07.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:07.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:07.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:07.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:07.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:08 smithi044 bash[22676]: cluster 2024-09-21T02:18:06.715068+0000 mgr.a (mgr.14388) 10544 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:08 smithi044 bash[22676]: audit 2024-09-21T02:18:06.794060+0000 mgr.a (mgr.14388) 10545 : audit [DBG] from='client.232608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:08 smithi179 bash[23186]: cluster 2024-09-21T02:18:06.715068+0000 mgr.a (mgr.14388) 10544 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:08 smithi179 bash[23186]: audit 2024-09-21T02:18:06.794060+0000 mgr.a (mgr.14388) 10545 : audit [DBG] from='client.232608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:08 smithi049 bash[23528]: cluster 2024-09-21T02:18:06.715068+0000 mgr.a (mgr.14388) 10544 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:08 smithi049 bash[23528]: audit 2024-09-21T02:18:06.794060+0000 mgr.a (mgr.14388) 10545 : audit [DBG] from='client.232608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:10.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:09 smithi044 bash[22676]: cluster 2024-09-21T02:18:08.715980+0000 mgr.a (mgr.14388) 10546 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:10.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:09 smithi044 bash[22676]: audit 2024-09-21T02:18:08.913396+0000 mon.a (mon.0) 8723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:09 smithi044 bash[22676]: audit 2024-09-21T02:18:08.922474+0000 mon.a (mon.0) 8724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:09 smithi044 bash[22676]: audit 2024-09-21T02:18:08.933493+0000 mon.a (mon.0) 8725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:09 smithi179 bash[23186]: cluster 2024-09-21T02:18:08.715980+0000 mgr.a (mgr.14388) 10546 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:09 smithi179 bash[23186]: audit 2024-09-21T02:18:08.913396+0000 mon.a (mon.0) 8723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:09 smithi179 bash[23186]: audit 2024-09-21T02:18:08.922474+0000 mon.a (mon.0) 8724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:09 smithi179 bash[23186]: audit 2024-09-21T02:18:08.933493+0000 mon.a (mon.0) 8725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:09 smithi049 bash[23528]: cluster 2024-09-21T02:18:08.715980+0000 mgr.a (mgr.14388) 10546 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:09 smithi049 bash[23528]: audit 2024-09-21T02:18:08.913396+0000 mon.a (mon.0) 8723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:09 smithi049 bash[23528]: audit 2024-09-21T02:18:08.922474+0000 mon.a (mon.0) 8724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:09 smithi049 bash[23528]: audit 2024-09-21T02:18:08.933493+0000 mon.a (mon.0) 8725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:11 smithi044 bash[22676]: cluster 2024-09-21T02:18:10.718255+0000 mgr.a (mgr.14388) 10547 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:11 smithi179 bash[23186]: cluster 2024-09-21T02:18:10.718255+0000 mgr.a (mgr.14388) 10547 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:11 smithi049 bash[23528]: cluster 2024-09-21T02:18:10.718255+0000 mgr.a (mgr.14388) 10547 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:12.986 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:12.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:12.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:12.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:12.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:13 smithi179 bash[23186]: audit 2024-09-21T02:18:12.574070+0000 mgr.a (mgr.14388) 10548 : audit [DBG] from='client.232683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:13 smithi179 bash[23186]: cluster 2024-09-21T02:18:12.718818+0000 mgr.a (mgr.14388) 10549 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:13 smithi044 bash[22676]: audit 2024-09-21T02:18:12.574070+0000 mgr.a (mgr.14388) 10548 : audit [DBG] from='client.232683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:13 smithi044 bash[22676]: cluster 2024-09-21T02:18:12.718818+0000 mgr.a (mgr.14388) 10549 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:13 smithi049 bash[23528]: audit 2024-09-21T02:18:12.574070+0000 mgr.a (mgr.14388) 10548 : audit [DBG] from='client.232683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:13 smithi049 bash[23528]: cluster 2024-09-21T02:18:12.718818+0000 mgr.a (mgr.14388) 10549 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:16.200 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:15 smithi179 bash[23186]: cluster 2024-09-21T02:18:14.719700+0000 mgr.a (mgr.14388) 10550 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:15 smithi044 bash[22676]: cluster 2024-09-21T02:18:14.719700+0000 mgr.a (mgr.14388) 10550 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:16.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:15 smithi049 bash[23528]: cluster 2024-09-21T02:18:14.719700+0000 mgr.a (mgr.14388) 10550 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:17.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:17.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:17.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:17 smithi044 bash[22676]: cluster 2024-09-21T02:18:16.721969+0000 mgr.a (mgr.14388) 10551 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:17 smithi049 bash[23528]: cluster 2024-09-21T02:18:16.721969+0000 mgr.a (mgr.14388) 10551 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:18.304 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:17 smithi179 bash[23186]: cluster 2024-09-21T02:18:16.721969+0000 mgr.a (mgr.14388) 10551 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:18.755 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:19 smithi049 bash[23528]: audit 2024-09-21T02:18:18.325387+0000 mgr.a (mgr.14388) 10552 : audit [DBG] from='client.232758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:19 smithi049 bash[23528]: cluster 2024-09-21T02:18:18.722478+0000 mgr.a (mgr.14388) 10553 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:19 smithi044 bash[22676]: audit 2024-09-21T02:18:18.325387+0000 mgr.a (mgr.14388) 10552 : audit [DBG] from='client.232758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:19 smithi044 bash[22676]: cluster 2024-09-21T02:18:18.722478+0000 mgr.a (mgr.14388) 10553 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:19 smithi179 bash[23186]: audit 2024-09-21T02:18:18.325387+0000 mgr.a (mgr.14388) 10552 : audit [DBG] from='client.232758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:19 smithi179 bash[23186]: cluster 2024-09-21T02:18:18.722478+0000 mgr.a (mgr.14388) 10553 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:21 smithi044 bash[22676]: cluster 2024-09-21T02:18:20.724644+0000 mgr.a (mgr.14388) 10554 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:22.244 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:21 smithi179 bash[23186]: cluster 2024-09-21T02:18:20.724644+0000 mgr.a (mgr.14388) 10554 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:21 smithi049 bash[23528]: cluster 2024-09-21T02:18:20.724644+0000 mgr.a (mgr.14388) 10554 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:23 smithi044 bash[22676]: audit 2024-09-21T02:18:22.225740+0000 mon.a (mon.0) 8726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:23 smithi044 bash[22676]: audit 2024-09-21T02:18:22.234478+0000 mon.a (mon.0) 8727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:23 smithi044 bash[22676]: audit 2024-09-21T02:18:22.243203+0000 mon.a (mon.0) 8728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:23 smithi044 bash[22676]: audit 2024-09-21T02:18:22.388896+0000 mon.a (mon.0) 8729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:23 smithi044 bash[22676]: audit 2024-09-21T02:18:22.396699+0000 mon.a (mon.0) 8730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:23 smithi044 bash[22676]: audit 2024-09-21T02:18:22.417340+0000 mon.a (mon.0) 8731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:23 smithi179 bash[23186]: audit 2024-09-21T02:18:22.225740+0000 mon.a (mon.0) 8726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:23 smithi179 bash[23186]: audit 2024-09-21T02:18:22.234478+0000 mon.a (mon.0) 8727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:23 smithi179 bash[23186]: audit 2024-09-21T02:18:22.243203+0000 mon.a (mon.0) 8728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:23 smithi179 bash[23186]: audit 2024-09-21T02:18:22.388896+0000 mon.a (mon.0) 8729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:23 smithi179 bash[23186]: audit 2024-09-21T02:18:22.396699+0000 mon.a (mon.0) 8730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:23 smithi179 bash[23186]: audit 2024-09-21T02:18:22.417340+0000 mon.a (mon.0) 8731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:23 smithi049 bash[23528]: audit 2024-09-21T02:18:22.225740+0000 mon.a (mon.0) 8726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:23 smithi049 bash[23528]: audit 2024-09-21T02:18:22.234478+0000 mon.a (mon.0) 8727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:23 smithi049 bash[23528]: audit 2024-09-21T02:18:22.243203+0000 mon.a (mon.0) 8728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:23 smithi049 bash[23528]: audit 2024-09-21T02:18:22.388896+0000 mon.a (mon.0) 8729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:23 smithi049 bash[23528]: audit 2024-09-21T02:18:22.396699+0000 mon.a (mon.0) 8730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:23 smithi049 bash[23528]: audit 2024-09-21T02:18:22.417340+0000 mon.a (mon.0) 8731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:24 smithi044 bash[22676]: cluster 2024-09-21T02:18:22.725475+0000 mgr.a (mgr.14388) 10555 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:24 smithi179 bash[23186]: cluster 2024-09-21T02:18:22.725475+0000 mgr.a (mgr.14388) 10555 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:24.534 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:24.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:24.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:24.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:24.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:24.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:24 smithi049 bash[23528]: cluster 2024-09-21T02:18:22.725475+0000 mgr.a (mgr.14388) 10555 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:25 smithi044 bash[22676]: audit 2024-09-21T02:18:24.090905+0000 mgr.a (mgr.14388) 10556 : audit [DBG] from='client.232836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:25 smithi179 bash[23186]: audit 2024-09-21T02:18:24.090905+0000 mgr.a (mgr.14388) 10556 : audit [DBG] from='client.232836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:25 smithi049 bash[23528]: audit 2024-09-21T02:18:24.090905+0000 mgr.a (mgr.14388) 10556 : audit [DBG] from='client.232836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:26 smithi179 bash[23186]: cluster 2024-09-21T02:18:24.726446+0000 mgr.a (mgr.14388) 10557 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:26 smithi049 bash[23528]: cluster 2024-09-21T02:18:24.726446+0000 mgr.a (mgr.14388) 10557 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:26 smithi044 bash[22676]: cluster 2024-09-21T02:18:24.726446+0000 mgr.a (mgr.14388) 10557 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:28 smithi179 bash[23186]: cluster 2024-09-21T02:18:26.728871+0000 mgr.a (mgr.14388) 10558 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:28.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:28 smithi049 bash[23528]: cluster 2024-09-21T02:18:26.728871+0000 mgr.a (mgr.14388) 10558 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:28 smithi044 bash[22676]: cluster 2024-09-21T02:18:26.728871+0000 mgr.a (mgr.14388) 10558 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:29.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:29.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:29.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:30.294 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:30.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:30.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:30.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:30 smithi044 bash[22676]: cluster 2024-09-21T02:18:28.729850+0000 mgr.a (mgr.14388) 10559 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:30 smithi044 bash[22676]: audit 2024-09-21T02:18:29.147378+0000 mon.a (mon.0) 8732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:30 smithi044 bash[22676]: audit 2024-09-21T02:18:29.156332+0000 mon.a (mon.0) 8733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:30 smithi044 bash[22676]: audit 2024-09-21T02:18:29.166902+0000 mon.a (mon.0) 8734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:30 smithi179 bash[23186]: cluster 2024-09-21T02:18:28.729850+0000 mgr.a (mgr.14388) 10559 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:30 smithi179 bash[23186]: audit 2024-09-21T02:18:29.147378+0000 mon.a (mon.0) 8732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:30 smithi179 bash[23186]: audit 2024-09-21T02:18:29.156332+0000 mon.a (mon.0) 8733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:30 smithi179 bash[23186]: audit 2024-09-21T02:18:29.166902+0000 mon.a (mon.0) 8734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:30 smithi049 bash[23528]: cluster 2024-09-21T02:18:28.729850+0000 mgr.a (mgr.14388) 10559 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:30 smithi049 bash[23528]: audit 2024-09-21T02:18:29.147378+0000 mon.a (mon.0) 8732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:30 smithi049 bash[23528]: audit 2024-09-21T02:18:29.156332+0000 mon.a (mon.0) 8733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:30 smithi049 bash[23528]: audit 2024-09-21T02:18:29.166902+0000 mon.a (mon.0) 8734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:31 smithi044 bash[22676]: audit 2024-09-21T02:18:29.865727+0000 mgr.a (mgr.14388) 10560 : audit [DBG] from='client.232914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:31 smithi179 bash[23186]: audit 2024-09-21T02:18:29.865727+0000 mgr.a (mgr.14388) 10560 : audit [DBG] from='client.232914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:31.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:31 smithi049 bash[23528]: audit 2024-09-21T02:18:29.865727+0000 mgr.a (mgr.14388) 10560 : audit [DBG] from='client.232914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:32 smithi044 bash[22676]: cluster 2024-09-21T02:18:30.732631+0000 mgr.a (mgr.14388) 10561 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:32 smithi179 bash[23186]: cluster 2024-09-21T02:18:30.732631+0000 mgr.a (mgr.14388) 10561 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:32 smithi049 bash[23528]: cluster 2024-09-21T02:18:30.732631+0000 mgr.a (mgr.14388) 10561 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:34 smithi044 bash[22676]: cluster 2024-09-21T02:18:32.733174+0000 mgr.a (mgr.14388) 10562 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:34 smithi179 bash[23186]: cluster 2024-09-21T02:18:32.733174+0000 mgr.a (mgr.14388) 10562 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:34 smithi049 bash[23528]: cluster 2024-09-21T02:18:32.733174+0000 mgr.a (mgr.14388) 10562 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:35.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:35.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:35.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:36.083 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:36.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:36.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:36.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:36.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:36 smithi044 bash[22676]: cluster 2024-09-21T02:18:34.733896+0000 mgr.a (mgr.14388) 10563 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:18:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:36 smithi179 bash[23186]: cluster 2024-09-21T02:18:34.733896+0000 mgr.a (mgr.14388) 10563 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:18:36.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:36 smithi049 bash[23528]: cluster 2024-09-21T02:18:34.733896+0000 mgr.a (mgr.14388) 10563 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:18:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:37 smithi044 bash[22676]: audit 2024-09-21T02:18:35.638048+0000 mgr.a (mgr.14388) 10564 : audit [DBG] from='client.232992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:37.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:37 smithi179 bash[23186]: audit 2024-09-21T02:18:35.638048+0000 mgr.a (mgr.14388) 10564 : audit [DBG] from='client.232992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:37 smithi049 bash[23528]: audit 2024-09-21T02:18:35.638048+0000 mgr.a (mgr.14388) 10564 : audit [DBG] from='client.232992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:38 smithi044 bash[22676]: cluster 2024-09-21T02:18:36.736647+0000 mgr.a (mgr.14388) 10565 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:38 smithi179 bash[23186]: cluster 2024-09-21T02:18:36.736647+0000 mgr.a (mgr.14388) 10565 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:38 smithi049 bash[23528]: cluster 2024-09-21T02:18:36.736647+0000 mgr.a (mgr.14388) 10565 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:40 smithi044 bash[22676]: cluster 2024-09-21T02:18:38.737660+0000 mgr.a (mgr.14388) 10566 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:40 smithi179 bash[23186]: cluster 2024-09-21T02:18:38.737660+0000 mgr.a (mgr.14388) 10566 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:40 smithi049 bash[23528]: cluster 2024-09-21T02:18:38.737660+0000 mgr.a (mgr.14388) 10566 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:18:41.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:41.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:41.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:41.873 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:41.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:41.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:41.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:41.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:42 smithi044 bash[22676]: cluster 2024-09-21T02:18:40.739686+0000 mgr.a (mgr.14388) 10567 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:42.486 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:42 smithi179 bash[23186]: cluster 2024-09-21T02:18:40.739686+0000 mgr.a (mgr.14388) 10567 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:42.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:42 smithi049 bash[23528]: cluster 2024-09-21T02:18:40.739686+0000 mgr.a (mgr.14388) 10567 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:43 smithi044 bash[22676]: audit 2024-09-21T02:18:41.424948+0000 mgr.a (mgr.14388) 10568 : audit [DBG] from='client.233070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:43 smithi044 bash[22676]: audit 2024-09-21T02:18:42.455665+0000 mon.a (mon.0) 8735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:43 smithi044 bash[22676]: audit 2024-09-21T02:18:42.464992+0000 mon.a (mon.0) 8736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:43 smithi044 bash[22676]: audit 2024-09-21T02:18:42.485558+0000 mon.a (mon.0) 8737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:43 smithi044 bash[22676]: audit 2024-09-21T02:18:42.622055+0000 mon.a (mon.0) 8738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:43 smithi044 bash[22676]: audit 2024-09-21T02:18:42.630305+0000 mon.a (mon.0) 8739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:43 smithi044 bash[22676]: audit 2024-09-21T02:18:42.640383+0000 mon.a (mon.0) 8740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:43 smithi179 bash[23186]: audit 2024-09-21T02:18:41.424948+0000 mgr.a (mgr.14388) 10568 : audit [DBG] from='client.233070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:43 smithi179 bash[23186]: audit 2024-09-21T02:18:42.455665+0000 mon.a (mon.0) 8735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:43 smithi179 bash[23186]: audit 2024-09-21T02:18:42.464992+0000 mon.a (mon.0) 8736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:43 smithi179 bash[23186]: audit 2024-09-21T02:18:42.485558+0000 mon.a (mon.0) 8737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:43 smithi179 bash[23186]: audit 2024-09-21T02:18:42.622055+0000 mon.a (mon.0) 8738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:43 smithi179 bash[23186]: audit 2024-09-21T02:18:42.630305+0000 mon.a (mon.0) 8739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:43 smithi179 bash[23186]: audit 2024-09-21T02:18:42.640383+0000 mon.a (mon.0) 8740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:43 smithi049 bash[23528]: audit 2024-09-21T02:18:41.424948+0000 mgr.a (mgr.14388) 10568 : audit [DBG] from='client.233070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:43 smithi049 bash[23528]: audit 2024-09-21T02:18:42.455665+0000 mon.a (mon.0) 8735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:43 smithi049 bash[23528]: audit 2024-09-21T02:18:42.464992+0000 mon.a (mon.0) 8736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:43 smithi049 bash[23528]: audit 2024-09-21T02:18:42.485558+0000 mon.a (mon.0) 8737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:43 smithi049 bash[23528]: audit 2024-09-21T02:18:42.622055+0000 mon.a (mon.0) 8738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:43 smithi049 bash[23528]: audit 2024-09-21T02:18:42.630305+0000 mon.a (mon.0) 8739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:43 smithi049 bash[23528]: audit 2024-09-21T02:18:42.640383+0000 mon.a (mon.0) 8740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:44 smithi044 bash[22676]: cluster 2024-09-21T02:18:42.740574+0000 mgr.a (mgr.14388) 10569 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:44 smithi179 bash[23186]: cluster 2024-09-21T02:18:42.740574+0000 mgr.a (mgr.14388) 10569 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:44 smithi049 bash[23528]: cluster 2024-09-21T02:18:42.740574+0000 mgr.a (mgr.14388) 10569 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:46 smithi044 bash[22676]: cluster 2024-09-21T02:18:44.741396+0000 mgr.a (mgr.14388) 10570 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:46 smithi179 bash[23186]: cluster 2024-09-21T02:18:44.741396+0000 mgr.a (mgr.14388) 10570 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:46 smithi049 bash[23528]: cluster 2024-09-21T02:18:44.741396+0000 mgr.a (mgr.14388) 10570 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:46.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:46.876 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:46.876 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:47.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:47.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:47.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:47.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:47.638 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:48 smithi044 bash[22676]: cluster 2024-09-21T02:18:46.744101+0000 mgr.a (mgr.14388) 10571 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:48 smithi044 bash[22676]: audit 2024-09-21T02:18:47.210618+0000 mgr.a (mgr.14388) 10572 : audit [DBG] from='client.233148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:48 smithi179 bash[23186]: cluster 2024-09-21T02:18:46.744101+0000 mgr.a (mgr.14388) 10571 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:48 smithi179 bash[23186]: audit 2024-09-21T02:18:47.210618+0000 mgr.a (mgr.14388) 10572 : audit [DBG] from='client.233148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:48 smithi049 bash[23528]: cluster 2024-09-21T02:18:46.744101+0000 mgr.a (mgr.14388) 10571 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:18:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:48 smithi049 bash[23528]: audit 2024-09-21T02:18:47.210618+0000 mgr.a (mgr.14388) 10572 : audit [DBG] from='client.233148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:49 smithi044 bash[22676]: audit 2024-09-21T02:18:48.865174+0000 mon.a (mon.0) 8741 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:18:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:49 smithi044 bash[22676]: audit 2024-09-21T02:18:48.872701+0000 mon.a (mon.0) 8742 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:18:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:49 smithi044 bash[22676]: audit 2024-09-21T02:18:48.874587+0000 mon.a (mon.0) 8743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:18:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:49 smithi044 bash[22676]: audit 2024-09-21T02:18:48.885981+0000 mon.a (mon.0) 8744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:49 smithi044 bash[22676]: audit 2024-09-21T02:18:48.892451+0000 mon.a (mon.0) 8745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:18:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:49 smithi179 bash[23186]: audit 2024-09-21T02:18:48.865174+0000 mon.a (mon.0) 8741 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:18:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:49 smithi179 bash[23186]: audit 2024-09-21T02:18:48.872701+0000 mon.a (mon.0) 8742 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:49 smithi179 bash[23186]: audit 2024-09-21T02:18:48.874587+0000 mon.a (mon.0) 8743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:49 smithi179 bash[23186]: audit 2024-09-21T02:18:48.885981+0000 mon.a (mon.0) 8744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:49 smithi179 bash[23186]: audit 2024-09-21T02:18:48.892451+0000 mon.a (mon.0) 8745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:49 smithi049 bash[23528]: audit 2024-09-21T02:18:48.865174+0000 mon.a (mon.0) 8741 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:49 smithi049 bash[23528]: audit 2024-09-21T02:18:48.872701+0000 mon.a (mon.0) 8742 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:49 smithi049 bash[23528]: audit 2024-09-21T02:18:48.874587+0000 mon.a (mon.0) 8743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:49 smithi049 bash[23528]: audit 2024-09-21T02:18:48.885981+0000 mon.a (mon.0) 8744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:49 smithi049 bash[23528]: audit 2024-09-21T02:18:48.892451+0000 mon.a (mon.0) 8745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:18:49.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:18:49 smithi044 bash[22930]: debug 2024-09-21T02:18:49.660+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:18:49.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:18:49 smithi044 bash[22930]: debug 2024-09-21T02:18:49.660+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:18:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:50 smithi044 bash[22676]: cluster 2024-09-21T02:18:48.745028+0000 mgr.a (mgr.14388) 10573 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:50 smithi044 bash[22676]: audit 2024-09-21T02:18:48.895061+0000 mgr.a (mgr.14388) 10574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:18:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:50 smithi044 bash[22676]: audit 2024-09-21T02:18:49.334084+0000 mon.a (mon.0) 8746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:50 smithi044 bash[22676]: audit 2024-09-21T02:18:49.345614+0000 mon.a (mon.0) 8747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:50 smithi044 bash[22676]: audit 2024-09-21T02:18:49.351513+0000 mon.a (mon.0) 8748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:50 smithi179 bash[23186]: cluster 2024-09-21T02:18:48.745028+0000 mgr.a (mgr.14388) 10573 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:50 smithi179 bash[23186]: audit 2024-09-21T02:18:48.895061+0000 mgr.a (mgr.14388) 10574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:18:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:50 smithi179 bash[23186]: audit 2024-09-21T02:18:49.334084+0000 mon.a (mon.0) 8746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:50 smithi179 bash[23186]: audit 2024-09-21T02:18:49.345614+0000 mon.a (mon.0) 8747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:50 smithi179 bash[23186]: audit 2024-09-21T02:18:49.351513+0000 mon.a (mon.0) 8748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:50 smithi049 bash[23528]: cluster 2024-09-21T02:18:48.745028+0000 mgr.a (mgr.14388) 10573 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:18:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:50 smithi049 bash[23528]: audit 2024-09-21T02:18:48.895061+0000 mgr.a (mgr.14388) 10574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:18:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:50 smithi049 bash[23528]: audit 2024-09-21T02:18:49.334084+0000 mon.a (mon.0) 8746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:50 smithi049 bash[23528]: audit 2024-09-21T02:18:49.345614+0000 mon.a (mon.0) 8747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:50 smithi049 bash[23528]: audit 2024-09-21T02:18:49.351513+0000 mon.a (mon.0) 8748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:18:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:51 smithi044 bash[22676]: audit 2024-09-21T02:18:49.663175+0000 mgr.a (mgr.14388) 10575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:18:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:51 smithi044 bash[22676]: cephadm 2024-09-21T02:18:49.664404+0000 mgr.a (mgr.14388) 10576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:18:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:51 smithi179 bash[23186]: audit 2024-09-21T02:18:49.663175+0000 mgr.a (mgr.14388) 10575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:18:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:51 smithi179 bash[23186]: cephadm 2024-09-21T02:18:49.664404+0000 mgr.a (mgr.14388) 10576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:18:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:51 smithi049 bash[23528]: audit 2024-09-21T02:18:49.663175+0000 mgr.a (mgr.14388) 10575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:18:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:51 smithi049 bash[23528]: cephadm 2024-09-21T02:18:49.664404+0000 mgr.a (mgr.14388) 10576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:18:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:52 smithi044 bash[22676]: cluster 2024-09-21T02:18:50.746461+0000 mgr.a (mgr.14388) 10577 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:52 smithi179 bash[23186]: cluster 2024-09-21T02:18:50.746461+0000 mgr.a (mgr.14388) 10577 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:52.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:52 smithi049 bash[23528]: cluster 2024-09-21T02:18:50.746461+0000 mgr.a (mgr.14388) 10577 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:52.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:52.640 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:53.381 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:53.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:53.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:53.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:53.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:18:54.346 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:54 smithi179 bash[23186]: cluster 2024-09-21T02:18:52.746861+0000 mgr.a (mgr.14388) 10578 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:54.346 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:54 smithi179 bash[23186]: audit 2024-09-21T02:18:52.968372+0000 mgr.a (mgr.14388) 10579 : audit [DBG] from='client.233328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:54 smithi044 bash[22676]: cluster 2024-09-21T02:18:52.746861+0000 mgr.a (mgr.14388) 10578 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:54 smithi044 bash[22676]: audit 2024-09-21T02:18:52.968372+0000 mgr.a (mgr.14388) 10579 : audit [DBG] from='client.233328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:54.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:54 smithi049 bash[23528]: cluster 2024-09-21T02:18:52.746861+0000 mgr.a (mgr.14388) 10578 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:54 smithi049 bash[23528]: audit 2024-09-21T02:18:52.968372+0000 mgr.a (mgr.14388) 10579 : audit [DBG] from='client.233328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:18:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:56 smithi044 bash[22676]: cluster 2024-09-21T02:18:54.747677+0000 mgr.a (mgr.14388) 10580 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:56 smithi179 bash[23186]: cluster 2024-09-21T02:18:54.747677+0000 mgr.a (mgr.14388) 10580 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:56.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:56 smithi049 bash[23528]: cluster 2024-09-21T02:18:54.747677+0000 mgr.a (mgr.14388) 10580 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:58.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:18:58.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:18:58.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:18:58.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:18:58 smithi044 bash[22676]: cluster 2024-09-21T02:18:56.749962+0000 mgr.a (mgr.14388) 10581 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:18:58 smithi179 bash[23186]: cluster 2024-09-21T02:18:56.749962+0000 mgr.a (mgr.14388) 10581 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:18:58 smithi049 bash[23528]: cluster 2024-09-21T02:18:56.749962+0000 mgr.a (mgr.14388) 10581 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:18:59.149 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:18:59.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:18:59.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:18:59.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:18:59.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:00.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:00 smithi049 bash[23528]: audit 2024-09-21T02:18:58.721824+0000 mgr.a (mgr.14388) 10582 : audit [DBG] from='client.233403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:00 smithi049 bash[23528]: cluster 2024-09-21T02:18:58.750804+0000 mgr.a (mgr.14388) 10583 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:00 smithi179 bash[23186]: audit 2024-09-21T02:18:58.721824+0000 mgr.a (mgr.14388) 10582 : audit [DBG] from='client.233403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:00 smithi179 bash[23186]: cluster 2024-09-21T02:18:58.750804+0000 mgr.a (mgr.14388) 10583 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:00 smithi044 bash[22676]: audit 2024-09-21T02:18:58.721824+0000 mgr.a (mgr.14388) 10582 : audit [DBG] from='client.233403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:00 smithi044 bash[22676]: cluster 2024-09-21T02:18:58.750804+0000 mgr.a (mgr.14388) 10583 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:02 smithi179 bash[23186]: cluster 2024-09-21T02:19:00.753288+0000 mgr.a (mgr.14388) 10584 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:02 smithi049 bash[23528]: cluster 2024-09-21T02:19:00.753288+0000 mgr.a (mgr.14388) 10584 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:02 smithi044 bash[22676]: cluster 2024-09-21T02:19:00.753288+0000 mgr.a (mgr.14388) 10584 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:03 smithi044 bash[22676]: audit 2024-09-21T02:19:02.680410+0000 mon.a (mon.0) 8749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:03 smithi044 bash[22676]: audit 2024-09-21T02:19:02.687692+0000 mon.a (mon.0) 8750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:03 smithi044 bash[22676]: audit 2024-09-21T02:19:02.695829+0000 mon.a (mon.0) 8751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:03 smithi044 bash[22676]: cluster 2024-09-21T02:19:02.753945+0000 mgr.a (mgr.14388) 10585 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:03 smithi044 bash[22676]: audit 2024-09-21T02:19:02.803871+0000 mon.a (mon.0) 8752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:03 smithi044 bash[22676]: audit 2024-09-21T02:19:02.810195+0000 mon.a (mon.0) 8753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:03 smithi044 bash[22676]: audit 2024-09-21T02:19:02.815689+0000 mon.a (mon.0) 8754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:03 smithi179 bash[23186]: audit 2024-09-21T02:19:02.680410+0000 mon.a (mon.0) 8749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:03 smithi179 bash[23186]: audit 2024-09-21T02:19:02.687692+0000 mon.a (mon.0) 8750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:03 smithi179 bash[23186]: audit 2024-09-21T02:19:02.695829+0000 mon.a (mon.0) 8751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:03 smithi179 bash[23186]: cluster 2024-09-21T02:19:02.753945+0000 mgr.a (mgr.14388) 10585 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:03 smithi179 bash[23186]: audit 2024-09-21T02:19:02.803871+0000 mon.a (mon.0) 8752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:03 smithi179 bash[23186]: audit 2024-09-21T02:19:02.810195+0000 mon.a (mon.0) 8753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:03 smithi179 bash[23186]: audit 2024-09-21T02:19:02.815689+0000 mon.a (mon.0) 8754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:03 smithi049 bash[23528]: audit 2024-09-21T02:19:02.680410+0000 mon.a (mon.0) 8749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:03 smithi049 bash[23528]: audit 2024-09-21T02:19:02.687692+0000 mon.a (mon.0) 8750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:03 smithi049 bash[23528]: audit 2024-09-21T02:19:02.695829+0000 mon.a (mon.0) 8751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:03 smithi049 bash[23528]: cluster 2024-09-21T02:19:02.753945+0000 mgr.a (mgr.14388) 10585 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:03 smithi049 bash[23528]: audit 2024-09-21T02:19:02.803871+0000 mon.a (mon.0) 8752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:03 smithi049 bash[23528]: audit 2024-09-21T02:19:02.810195+0000 mon.a (mon.0) 8753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:03 smithi049 bash[23528]: audit 2024-09-21T02:19:02.815689+0000 mon.a (mon.0) 8754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:04.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:04.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:04.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:04.890 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:04.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:04.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:04.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:04.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:05 smithi044 bash[22676]: audit 2024-09-21T02:19:04.483395+0000 mgr.a (mgr.14388) 10586 : audit [DBG] from='client.233481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:05 smithi044 bash[22676]: cluster 2024-09-21T02:19:04.754499+0000 mgr.a (mgr.14388) 10587 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:05 smithi179 bash[23186]: audit 2024-09-21T02:19:04.483395+0000 mgr.a (mgr.14388) 10586 : audit [DBG] from='client.233481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:05 smithi179 bash[23186]: cluster 2024-09-21T02:19:04.754499+0000 mgr.a (mgr.14388) 10587 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:06.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:05 smithi049 bash[23528]: audit 2024-09-21T02:19:04.483395+0000 mgr.a (mgr.14388) 10586 : audit [DBG] from='client.233481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:05 smithi049 bash[23528]: cluster 2024-09-21T02:19:04.754499+0000 mgr.a (mgr.14388) 10587 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:07 smithi044 bash[22676]: cluster 2024-09-21T02:19:06.756833+0000 mgr.a (mgr.14388) 10588 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:07 smithi179 bash[23186]: cluster 2024-09-21T02:19:06.756833+0000 mgr.a (mgr.14388) 10588 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:07 smithi049 bash[23528]: cluster 2024-09-21T02:19:06.756833+0000 mgr.a (mgr.14388) 10588 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:09.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:09 smithi049 bash[23528]: cluster 2024-09-21T02:19:08.757609+0000 mgr.a (mgr.14388) 10589 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:09 smithi049 bash[23528]: audit 2024-09-21T02:19:09.569602+0000 mon.a (mon.0) 8755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:09 smithi049 bash[23528]: audit 2024-09-21T02:19:09.579725+0000 mon.a (mon.0) 8756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:09 smithi049 bash[23528]: audit 2024-09-21T02:19:09.591545+0000 mon.a (mon.0) 8757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:09 smithi044 bash[22676]: cluster 2024-09-21T02:19:08.757609+0000 mgr.a (mgr.14388) 10589 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:09 smithi044 bash[22676]: audit 2024-09-21T02:19:09.569602+0000 mon.a (mon.0) 8755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:09 smithi044 bash[22676]: audit 2024-09-21T02:19:09.579725+0000 mon.a (mon.0) 8756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:09 smithi044 bash[22676]: audit 2024-09-21T02:19:09.591545+0000 mon.a (mon.0) 8757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:09 smithi179 bash[23186]: cluster 2024-09-21T02:19:08.757609+0000 mgr.a (mgr.14388) 10589 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:09 smithi179 bash[23186]: audit 2024-09-21T02:19:09.569602+0000 mon.a (mon.0) 8755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:09 smithi179 bash[23186]: audit 2024-09-21T02:19:09.579725+0000 mon.a (mon.0) 8756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:09 smithi179 bash[23186]: audit 2024-09-21T02:19:09.591545+0000 mon.a (mon.0) 8757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:10.649 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:10.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:10.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:10.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:10.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:11.141 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:10 smithi044 bash[22676]: audit 2024-09-21T02:19:10.224440+0000 mgr.a (mgr.14388) 10590 : audit [DBG] from='client.233556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:10 smithi179 bash[23186]: audit 2024-09-21T02:19:10.224440+0000 mgr.a (mgr.14388) 10590 : audit [DBG] from='client.233556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:11.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:10 smithi049 bash[23528]: audit 2024-09-21T02:19:10.224440+0000 mgr.a (mgr.14388) 10590 : audit [DBG] from='client.233556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:11 smithi044 bash[22676]: cluster 2024-09-21T02:19:10.760283+0000 mgr.a (mgr.14388) 10591 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:11 smithi179 bash[23186]: cluster 2024-09-21T02:19:10.760283+0000 mgr.a (mgr.14388) 10591 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:11 smithi049 bash[23528]: cluster 2024-09-21T02:19:10.760283+0000 mgr.a (mgr.14388) 10591 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:14.140 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:13 smithi179 bash[23186]: cluster 2024-09-21T02:19:12.761080+0000 mgr.a (mgr.14388) 10592 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:13 smithi044 bash[22676]: cluster 2024-09-21T02:19:12.761080+0000 mgr.a (mgr.14388) 10592 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:13 smithi049 bash[23528]: cluster 2024-09-21T02:19:12.761080+0000 mgr.a (mgr.14388) 10592 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:15.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:15.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:15.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:15 smithi044 bash[22676]: cluster 2024-09-21T02:19:14.761849+0000 mgr.a (mgr.14388) 10593 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:19:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:15 smithi179 bash[23186]: cluster 2024-09-21T02:19:14.761849+0000 mgr.a (mgr.14388) 10593 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:19:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:15 smithi049 bash[23528]: cluster 2024-09-21T02:19:14.761849+0000 mgr.a (mgr.14388) 10593 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:19:16.431 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:16 smithi179 bash[23186]: audit 2024-09-21T02:19:15.985593+0000 mgr.a (mgr.14388) 10594 : audit [DBG] from='client.233634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:16 smithi044 bash[22676]: audit 2024-09-21T02:19:15.985593+0000 mgr.a (mgr.14388) 10594 : audit [DBG] from='client.233634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:17.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:16 smithi049 bash[23528]: audit 2024-09-21T02:19:15.985593+0000 mgr.a (mgr.14388) 10594 : audit [DBG] from='client.233634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:17 smithi044 bash[22676]: cluster 2024-09-21T02:19:16.764689+0000 mgr.a (mgr.14388) 10595 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:17 smithi179 bash[23186]: cluster 2024-09-21T02:19:16.764689+0000 mgr.a (mgr.14388) 10595 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:17 smithi049 bash[23528]: cluster 2024-09-21T02:19:16.764689+0000 mgr.a (mgr.14388) 10595 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:20.112 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:19 smithi049 bash[23528]: cluster 2024-09-21T02:19:18.765526+0000 mgr.a (mgr.14388) 10596 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:19 smithi044 bash[22676]: cluster 2024-09-21T02:19:18.765526+0000 mgr.a (mgr.14388) 10596 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:19 smithi179 bash[23186]: cluster 2024-09-21T02:19:18.765526+0000 mgr.a (mgr.14388) 10596 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:21.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:21.434 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:21.434 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:22.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:22.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:22.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:22.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:22.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:21 smithi044 bash[22676]: cluster 2024-09-21T02:19:20.767934+0000 mgr.a (mgr.14388) 10597 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:21 smithi179 bash[23186]: cluster 2024-09-21T02:19:20.767934+0000 mgr.a (mgr.14388) 10597 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:21 smithi049 bash[23528]: cluster 2024-09-21T02:19:20.767934+0000 mgr.a (mgr.14388) 10597 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:22 smithi049 bash[23528]: audit 2024-09-21T02:19:21.770577+0000 mgr.a (mgr.14388) 10598 : audit [DBG] from='client.233712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:22 smithi044 bash[22676]: audit 2024-09-21T02:19:21.770577+0000 mgr.a (mgr.14388) 10598 : audit [DBG] from='client.233712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:22 smithi179 bash[23186]: audit 2024-09-21T02:19:21.770577+0000 mgr.a (mgr.14388) 10598 : audit [DBG] from='client.233712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:23 smithi179 bash[23186]: cluster 2024-09-21T02:19:22.768993+0000 mgr.a (mgr.14388) 10599 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:23 smithi179 bash[23186]: audit 2024-09-21T02:19:22.890742+0000 mon.a (mon.0) 8758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:23 smithi179 bash[23186]: audit 2024-09-21T02:19:22.896634+0000 mon.a (mon.0) 8759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:23 smithi179 bash[23186]: audit 2024-09-21T02:19:22.903340+0000 mon.a (mon.0) 8760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:23 smithi179 bash[23186]: audit 2024-09-21T02:19:22.990798+0000 mon.a (mon.0) 8761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:23 smithi179 bash[23186]: audit 2024-09-21T02:19:22.998232+0000 mon.a (mon.0) 8762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:23 smithi179 bash[23186]: audit 2024-09-21T02:19:23.006605+0000 mon.a (mon.0) 8763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:23 smithi044 bash[22676]: cluster 2024-09-21T02:19:22.768993+0000 mgr.a (mgr.14388) 10599 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:23 smithi044 bash[22676]: audit 2024-09-21T02:19:22.890742+0000 mon.a (mon.0) 8758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:23 smithi044 bash[22676]: audit 2024-09-21T02:19:22.896634+0000 mon.a (mon.0) 8759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:23 smithi044 bash[22676]: audit 2024-09-21T02:19:22.903340+0000 mon.a (mon.0) 8760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:23 smithi044 bash[22676]: audit 2024-09-21T02:19:22.990798+0000 mon.a (mon.0) 8761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:23 smithi044 bash[22676]: audit 2024-09-21T02:19:22.998232+0000 mon.a (mon.0) 8762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:23 smithi044 bash[22676]: audit 2024-09-21T02:19:23.006605+0000 mon.a (mon.0) 8763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:23 smithi049 bash[23528]: cluster 2024-09-21T02:19:22.768993+0000 mgr.a (mgr.14388) 10599 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:23 smithi049 bash[23528]: audit 2024-09-21T02:19:22.890742+0000 mon.a (mon.0) 8758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:23 smithi049 bash[23528]: audit 2024-09-21T02:19:22.896634+0000 mon.a (mon.0) 8759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:23 smithi049 bash[23528]: audit 2024-09-21T02:19:22.903340+0000 mon.a (mon.0) 8760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:23 smithi049 bash[23528]: audit 2024-09-21T02:19:22.990798+0000 mon.a (mon.0) 8761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:23 smithi049 bash[23528]: audit 2024-09-21T02:19:22.998232+0000 mon.a (mon.0) 8762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:23 smithi049 bash[23528]: audit 2024-09-21T02:19:23.006605+0000 mon.a (mon.0) 8763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:25 smithi044 bash[22676]: cluster 2024-09-21T02:19:24.769974+0000 mgr.a (mgr.14388) 10600 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:25 smithi179 bash[23186]: cluster 2024-09-21T02:19:24.769974+0000 mgr.a (mgr.14388) 10600 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:25 smithi049 bash[23528]: cluster 2024-09-21T02:19:24.769974+0000 mgr.a (mgr.14388) 10600 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:27.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:27.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:27.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:28.007 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:27 smithi044 bash[22676]: cluster 2024-09-21T02:19:26.772155+0000 mgr.a (mgr.14388) 10601 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:27 smithi179 bash[23186]: cluster 2024-09-21T02:19:26.772155+0000 mgr.a (mgr.14388) 10601 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:27 smithi049 bash[23528]: cluster 2024-09-21T02:19:26.772155+0000 mgr.a (mgr.14388) 10601 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:28 smithi044 bash[22676]: audit 2024-09-21T02:19:27.551860+0000 mgr.a (mgr.14388) 10602 : audit [DBG] from='client.233790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:28 smithi179 bash[23186]: audit 2024-09-21T02:19:27.551860+0000 mgr.a (mgr.14388) 10602 : audit [DBG] from='client.233790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:28 smithi049 bash[23528]: audit 2024-09-21T02:19:27.551860+0000 mgr.a (mgr.14388) 10602 : audit [DBG] from='client.233790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:30.194 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:29 smithi044 bash[22676]: cluster 2024-09-21T02:19:28.773078+0000 mgr.a (mgr.14388) 10603 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:30.194 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:29 smithi044 bash[22676]: audit 2024-09-21T02:19:29.799806+0000 mon.a (mon.0) 8764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.194 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:29 smithi044 bash[22676]: audit 2024-09-21T02:19:29.812451+0000 mon.a (mon.0) 8765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.195 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:29 smithi044 bash[22676]: audit 2024-09-21T02:19:29.822836+0000 mon.a (mon.0) 8766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:29 smithi179 bash[23186]: cluster 2024-09-21T02:19:28.773078+0000 mgr.a (mgr.14388) 10603 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:29 smithi179 bash[23186]: audit 2024-09-21T02:19:29.799806+0000 mon.a (mon.0) 8764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:29 smithi179 bash[23186]: audit 2024-09-21T02:19:29.812451+0000 mon.a (mon.0) 8765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:29 smithi179 bash[23186]: audit 2024-09-21T02:19:29.822836+0000 mon.a (mon.0) 8766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:29 smithi049 bash[23528]: cluster 2024-09-21T02:19:28.773078+0000 mgr.a (mgr.14388) 10603 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:29 smithi049 bash[23528]: audit 2024-09-21T02:19:29.799806+0000 mon.a (mon.0) 8764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:29 smithi049 bash[23528]: audit 2024-09-21T02:19:29.812451+0000 mon.a (mon.0) 8765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:29 smithi049 bash[23528]: audit 2024-09-21T02:19:29.822836+0000 mon.a (mon.0) 8766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:31 smithi044 bash[22676]: cluster 2024-09-21T02:19:30.775487+0000 mgr.a (mgr.14388) 10604 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:31 smithi179 bash[23186]: cluster 2024-09-21T02:19:30.775487+0000 mgr.a (mgr.14388) 10604 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:31 smithi049 bash[23528]: cluster 2024-09-21T02:19:30.775487+0000 mgr.a (mgr.14388) 10604 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:33.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:33.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:33.009 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:33.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:33.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:34.188 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:33 smithi179 bash[23186]: cluster 2024-09-21T02:19:32.776302+0000 mgr.a (mgr.14388) 10605 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:33 smithi044 bash[22676]: cluster 2024-09-21T02:19:32.776302+0000 mgr.a (mgr.14388) 10605 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:34.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:33 smithi049 bash[23528]: cluster 2024-09-21T02:19:32.776302+0000 mgr.a (mgr.14388) 10605 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:34 smithi044 bash[22676]: audit 2024-09-21T02:19:33.330390+0000 mgr.a (mgr.14388) 10606 : audit [DBG] from='client.233868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:35.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:34 smithi179 bash[23186]: audit 2024-09-21T02:19:33.330390+0000 mgr.a (mgr.14388) 10606 : audit [DBG] from='client.233868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:34 smithi049 bash[23528]: audit 2024-09-21T02:19:33.330390+0000 mgr.a (mgr.14388) 10606 : audit [DBG] from='client.233868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:35 smithi044 bash[22676]: cluster 2024-09-21T02:19:34.777341+0000 mgr.a (mgr.14388) 10607 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:35 smithi179 bash[23186]: cluster 2024-09-21T02:19:34.777341+0000 mgr.a (mgr.14388) 10607 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:36.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:35 smithi049 bash[23528]: cluster 2024-09-21T02:19:34.777341+0000 mgr.a (mgr.14388) 10607 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:37 smithi044 bash[22676]: cluster 2024-09-21T02:19:36.779528+0000 mgr.a (mgr.14388) 10608 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:37 smithi179 bash[23186]: cluster 2024-09-21T02:19:36.779528+0000 mgr.a (mgr.14388) 10608 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:37 smithi049 bash[23528]: cluster 2024-09-21T02:19:36.779528+0000 mgr.a (mgr.14388) 10608 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:38.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:38.752 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:38.752 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:39.516 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:39.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:39.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:39.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:39.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:39 smithi044 bash[22676]: cluster 2024-09-21T02:19:38.780165+0000 mgr.a (mgr.14388) 10609 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:39 smithi044 bash[22676]: audit 2024-09-21T02:19:39.084335+0000 mgr.a (mgr.14388) 10610 : audit [DBG] from='client.233946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:39 smithi179 bash[23186]: cluster 2024-09-21T02:19:38.780165+0000 mgr.a (mgr.14388) 10609 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:39 smithi179 bash[23186]: audit 2024-09-21T02:19:39.084335+0000 mgr.a (mgr.14388) 10610 : audit [DBG] from='client.233946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:39 smithi049 bash[23528]: cluster 2024-09-21T02:19:38.780165+0000 mgr.a (mgr.14388) 10609 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:39 smithi049 bash[23528]: audit 2024-09-21T02:19:39.084335+0000 mgr.a (mgr.14388) 10610 : audit [DBG] from='client.233946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:41 smithi044 bash[22676]: cluster 2024-09-21T02:19:40.782473+0000 mgr.a (mgr.14388) 10611 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:41 smithi179 bash[23186]: cluster 2024-09-21T02:19:40.782473+0000 mgr.a (mgr.14388) 10611 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:42.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:41 smithi049 bash[23528]: cluster 2024-09-21T02:19:40.782473+0000 mgr.a (mgr.14388) 10611 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:19:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:44 smithi044 bash[22676]: cluster 2024-09-21T02:19:42.783298+0000 mgr.a (mgr.14388) 10612 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:44 smithi044 bash[22676]: audit 2024-09-21T02:19:43.102659+0000 mon.a (mon.0) 8767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:44 smithi044 bash[22676]: audit 2024-09-21T02:19:43.109010+0000 mon.a (mon.0) 8768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:44 smithi044 bash[22676]: audit 2024-09-21T02:19:43.116049+0000 mon.a (mon.0) 8769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:44 smithi044 bash[22676]: audit 2024-09-21T02:19:43.177628+0000 mon.a (mon.0) 8770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:44 smithi044 bash[22676]: audit 2024-09-21T02:19:43.182799+0000 mon.a (mon.0) 8771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:44 smithi044 bash[22676]: audit 2024-09-21T02:19:43.188863+0000 mon.a (mon.0) 8772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:44 smithi179 bash[23186]: cluster 2024-09-21T02:19:42.783298+0000 mgr.a (mgr.14388) 10612 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:44 smithi179 bash[23186]: audit 2024-09-21T02:19:43.102659+0000 mon.a (mon.0) 8767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:44 smithi179 bash[23186]: audit 2024-09-21T02:19:43.109010+0000 mon.a (mon.0) 8768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:44 smithi179 bash[23186]: audit 2024-09-21T02:19:43.116049+0000 mon.a (mon.0) 8769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:44 smithi179 bash[23186]: audit 2024-09-21T02:19:43.177628+0000 mon.a (mon.0) 8770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:44 smithi179 bash[23186]: audit 2024-09-21T02:19:43.182799+0000 mon.a (mon.0) 8771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:44 smithi179 bash[23186]: audit 2024-09-21T02:19:43.188863+0000 mon.a (mon.0) 8772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:44 smithi049 bash[23528]: cluster 2024-09-21T02:19:42.783298+0000 mgr.a (mgr.14388) 10612 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:44 smithi049 bash[23528]: audit 2024-09-21T02:19:43.102659+0000 mon.a (mon.0) 8767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:44 smithi049 bash[23528]: audit 2024-09-21T02:19:43.109010+0000 mon.a (mon.0) 8768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:44 smithi049 bash[23528]: audit 2024-09-21T02:19:43.116049+0000 mon.a (mon.0) 8769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:44 smithi049 bash[23528]: audit 2024-09-21T02:19:43.177628+0000 mon.a (mon.0) 8770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:44 smithi049 bash[23528]: audit 2024-09-21T02:19:43.182799+0000 mon.a (mon.0) 8771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:44 smithi049 bash[23528]: audit 2024-09-21T02:19:43.188863+0000 mon.a (mon.0) 8772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:45.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:45.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:45.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:45.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:45.359 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:46 smithi044 bash[22676]: cluster 2024-09-21T02:19:44.784164+0000 mgr.a (mgr.14388) 10613 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:46 smithi044 bash[22676]: audit 2024-09-21T02:19:44.848938+0000 mgr.a (mgr.14388) 10614 : audit [DBG] from='client.234024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:46 smithi179 bash[23186]: cluster 2024-09-21T02:19:44.784164+0000 mgr.a (mgr.14388) 10613 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:46 smithi179 bash[23186]: audit 2024-09-21T02:19:44.848938+0000 mgr.a (mgr.14388) 10614 : audit [DBG] from='client.234024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:46 smithi049 bash[23528]: cluster 2024-09-21T02:19:44.784164+0000 mgr.a (mgr.14388) 10613 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:46 smithi049 bash[23528]: audit 2024-09-21T02:19:44.848938+0000 mgr.a (mgr.14388) 10614 : audit [DBG] from='client.234024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:48 smithi044 bash[22676]: cluster 2024-09-21T02:19:46.786951+0000 mgr.a (mgr.14388) 10615 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:48 smithi179 bash[23186]: cluster 2024-09-21T02:19:46.786951+0000 mgr.a (mgr.14388) 10615 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:48.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:48 smithi049 bash[23528]: cluster 2024-09-21T02:19:46.786951+0000 mgr.a (mgr.14388) 10615 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:19:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: cluster 2024-09-21T02:19:48.787742+0000 mgr.a (mgr.14388) 10616 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:49.721851+0000 mon.a (mon.0) 8773 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:49.733418+0000 mon.a (mon.0) 8774 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:49.735289+0000 mon.a (mon.0) 8775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:49.746839+0000 mon.a (mon.0) 8776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:49.753211+0000 mon.a (mon.0) 8777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:50.010185+0000 mon.a (mon.0) 8778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:50.016208+0000 mon.a (mon.0) 8779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:50 smithi049 bash[23528]: audit 2024-09-21T02:19:50.024329+0000 mon.a (mon.0) 8780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: cluster 2024-09-21T02:19:48.787742+0000 mgr.a (mgr.14388) 10616 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:49.721851+0000 mon.a (mon.0) 8773 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:49.733418+0000 mon.a (mon.0) 8774 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:49.735289+0000 mon.a (mon.0) 8775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:49.746839+0000 mon.a (mon.0) 8776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:49.753211+0000 mon.a (mon.0) 8777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:50.010185+0000 mon.a (mon.0) 8778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:50.016208+0000 mon.a (mon.0) 8779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22676]: audit 2024-09-21T02:19:50.024329+0000 mon.a (mon.0) 8780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: cluster 2024-09-21T02:19:48.787742+0000 mgr.a (mgr.14388) 10616 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:19:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:49.721851+0000 mon.a (mon.0) 8773 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:19:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:49.733418+0000 mon.a (mon.0) 8774 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:19:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:49.735289+0000 mon.a (mon.0) 8775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:19:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:49.746839+0000 mon.a (mon.0) 8776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:49.753211+0000 mon.a (mon.0) 8777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:19:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:50.010185+0000 mon.a (mon.0) 8778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:50.016208+0000 mon.a (mon.0) 8779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:50 smithi179 bash[23186]: audit 2024-09-21T02:19:50.024329+0000 mon.a (mon.0) 8780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:19:50.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22930]: debug 2024-09-21T02:19:50.555+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:19:50.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:19:50 smithi044 bash[22930]: debug 2024-09-21T02:19:50.555+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:19:51.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:51.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:51.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:51.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:51.013 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:51.379 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:51 smithi044 bash[22676]: audit 2024-09-21T02:19:49.755727+0000 mgr.a (mgr.14388) 10617 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:19:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:51 smithi179 bash[23186]: audit 2024-09-21T02:19:49.755727+0000 mgr.a (mgr.14388) 10617 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:19:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:51 smithi049 bash[23528]: audit 2024-09-21T02:19:49.755727+0000 mgr.a (mgr.14388) 10617 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:19:52.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:52 smithi044 bash[22676]: audit 2024-09-21T02:19:50.558502+0000 mgr.a (mgr.14388) 10618 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:19:52.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:52 smithi044 bash[22676]: cephadm 2024-09-21T02:19:50.559671+0000 mgr.a (mgr.14388) 10619 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:19:52.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:52 smithi044 bash[22676]: audit 2024-09-21T02:19:50.606179+0000 mgr.a (mgr.14388) 10620 : audit [DBG] from='client.234183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:52.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:52 smithi044 bash[22676]: cluster 2024-09-21T02:19:50.789136+0000 mgr.a (mgr.14388) 10621 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:19:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:52 smithi179 bash[23186]: audit 2024-09-21T02:19:50.558502+0000 mgr.a (mgr.14388) 10618 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:19:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:52 smithi179 bash[23186]: cephadm 2024-09-21T02:19:50.559671+0000 mgr.a (mgr.14388) 10619 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:19:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:52 smithi179 bash[23186]: audit 2024-09-21T02:19:50.606179+0000 mgr.a (mgr.14388) 10620 : audit [DBG] from='client.234183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:52 smithi179 bash[23186]: cluster 2024-09-21T02:19:50.789136+0000 mgr.a (mgr.14388) 10621 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:19:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:52 smithi049 bash[23528]: audit 2024-09-21T02:19:50.558502+0000 mgr.a (mgr.14388) 10618 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:19:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:52 smithi049 bash[23528]: cephadm 2024-09-21T02:19:50.559671+0000 mgr.a (mgr.14388) 10619 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:19:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:52 smithi049 bash[23528]: audit 2024-09-21T02:19:50.606179+0000 mgr.a (mgr.14388) 10620 : audit [DBG] from='client.234183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:52 smithi049 bash[23528]: cluster 2024-09-21T02:19:50.789136+0000 mgr.a (mgr.14388) 10621 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:19:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:54 smithi044 bash[22676]: cluster 2024-09-21T02:19:52.790024+0000 mgr.a (mgr.14388) 10622 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:19:54.427 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:54 smithi179 bash[23186]: cluster 2024-09-21T02:19:52.790024+0000 mgr.a (mgr.14388) 10622 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:19:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:54 smithi049 bash[23528]: cluster 2024-09-21T02:19:52.790024+0000 mgr.a (mgr.14388) 10622 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:19:56.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:19:56.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:19:56.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:19:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:56 smithi044 bash[22676]: cluster 2024-09-21T02:19:54.790830+0000 mgr.a (mgr.14388) 10623 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:19:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:56 smithi179 bash[23186]: cluster 2024-09-21T02:19:54.790830+0000 mgr.a (mgr.14388) 10623 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:19:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:56 smithi049 bash[23528]: cluster 2024-09-21T02:19:54.790830+0000 mgr.a (mgr.14388) 10623 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:19:56.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:19:56.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:19:56.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:19:56.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:19:56.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:19:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:58 smithi044 bash[22676]: audit 2024-09-21T02:19:56.353640+0000 mgr.a (mgr.14388) 10624 : audit [DBG] from='client.107074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:19:58 smithi044 bash[22676]: cluster 2024-09-21T02:19:56.792379+0000 mgr.a (mgr.14388) 10625 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:58 smithi179 bash[23186]: audit 2024-09-21T02:19:56.353640+0000 mgr.a (mgr.14388) 10624 : audit [DBG] from='client.107074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:19:58 smithi179 bash[23186]: cluster 2024-09-21T02:19:56.792379+0000 mgr.a (mgr.14388) 10625 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:19:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:58 smithi049 bash[23528]: audit 2024-09-21T02:19:56.353640+0000 mgr.a (mgr.14388) 10624 : audit [DBG] from='client.107074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:19:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:19:58 smithi049 bash[23528]: cluster 2024-09-21T02:19:56.792379+0000 mgr.a (mgr.14388) 10625 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:00 smithi044 bash[22676]: cluster 2024-09-21T02:19:58.793137+0000 mgr.a (mgr.14388) 10626 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:00 smithi044 bash[22676]: cluster 2024-09-21T02:20:00.000152+0000 mon.a (mon.0) 8781 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:20:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:00 smithi179 bash[23186]: cluster 2024-09-21T02:19:58.793137+0000 mgr.a (mgr.14388) 10626 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:00 smithi179 bash[23186]: cluster 2024-09-21T02:20:00.000152+0000 mon.a (mon.0) 8781 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:20:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:00 smithi049 bash[23528]: cluster 2024-09-21T02:19:58.793137+0000 mgr.a (mgr.14388) 10626 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:00 smithi049 bash[23528]: cluster 2024-09-21T02:20:00.000152+0000 mon.a (mon.0) 8781 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:20:01.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:02 smithi049 bash[23528]: cluster 2024-09-21T02:20:00.795160+0000 mgr.a (mgr.14388) 10627 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:02 smithi044 bash[22676]: cluster 2024-09-21T02:20:00.795160+0000 mgr.a (mgr.14388) 10627 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:02 smithi179 bash[23186]: cluster 2024-09-21T02:20:00.795160+0000 mgr.a (mgr.14388) 10627 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:02.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:03 smithi044 bash[22676]: audit 2024-09-21T02:20:02.119656+0000 mgr.a (mgr.14388) 10628 : audit [DBG] from='client.234357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:03 smithi179 bash[23186]: audit 2024-09-21T02:20:02.119656+0000 mgr.a (mgr.14388) 10628 : audit [DBG] from='client.234357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:03 smithi049 bash[23528]: audit 2024-09-21T02:20:02.119656+0000 mgr.a (mgr.14388) 10628 : audit [DBG] from='client.234357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:04 smithi044 bash[22676]: cluster 2024-09-21T02:20:02.796299+0000 mgr.a (mgr.14388) 10629 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:20:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:04 smithi044 bash[22676]: audit 2024-09-21T02:20:03.306196+0000 mon.a (mon.0) 8782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:04 smithi044 bash[22676]: audit 2024-09-21T02:20:03.312348+0000 mon.a (mon.0) 8783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:04 smithi044 bash[22676]: audit 2024-09-21T02:20:03.319101+0000 mon.a (mon.0) 8784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:04 smithi044 bash[22676]: audit 2024-09-21T02:20:03.330601+0000 mon.a (mon.0) 8785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:04 smithi044 bash[22676]: audit 2024-09-21T02:20:03.336236+0000 mon.a (mon.0) 8786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:04 smithi044 bash[22676]: audit 2024-09-21T02:20:03.341824+0000 mon.a (mon.0) 8787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:04 smithi179 bash[23186]: cluster 2024-09-21T02:20:02.796299+0000 mgr.a (mgr.14388) 10629 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:20:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:04 smithi179 bash[23186]: audit 2024-09-21T02:20:03.306196+0000 mon.a (mon.0) 8782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:04 smithi179 bash[23186]: audit 2024-09-21T02:20:03.312348+0000 mon.a (mon.0) 8783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:04 smithi179 bash[23186]: audit 2024-09-21T02:20:03.319101+0000 mon.a (mon.0) 8784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:04 smithi179 bash[23186]: audit 2024-09-21T02:20:03.330601+0000 mon.a (mon.0) 8785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:04 smithi179 bash[23186]: audit 2024-09-21T02:20:03.336236+0000 mon.a (mon.0) 8786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:04 smithi179 bash[23186]: audit 2024-09-21T02:20:03.341824+0000 mon.a (mon.0) 8787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:04 smithi049 bash[23528]: cluster 2024-09-21T02:20:02.796299+0000 mgr.a (mgr.14388) 10629 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:20:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:04 smithi049 bash[23528]: audit 2024-09-21T02:20:03.306196+0000 mon.a (mon.0) 8782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:04 smithi049 bash[23528]: audit 2024-09-21T02:20:03.312348+0000 mon.a (mon.0) 8783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:04 smithi049 bash[23528]: audit 2024-09-21T02:20:03.319101+0000 mon.a (mon.0) 8784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:04 smithi049 bash[23528]: audit 2024-09-21T02:20:03.330601+0000 mon.a (mon.0) 8785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:04 smithi049 bash[23528]: audit 2024-09-21T02:20:03.336236+0000 mon.a (mon.0) 8786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:04.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:04 smithi049 bash[23528]: audit 2024-09-21T02:20:03.341824+0000 mon.a (mon.0) 8787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:06 smithi044 bash[22676]: cluster 2024-09-21T02:20:04.797174+0000 mgr.a (mgr.14388) 10630 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:20:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:06 smithi179 bash[23186]: cluster 2024-09-21T02:20:04.797174+0000 mgr.a (mgr.14388) 10630 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:20:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:06 smithi049 bash[23528]: cluster 2024-09-21T02:20:04.797174+0000 mgr.a (mgr.14388) 10630 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:20:07.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:08.355 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:08.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:08 smithi044 bash[22676]: cluster 2024-09-21T02:20:06.798329+0000 mgr.a (mgr.14388) 10631 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:08 smithi179 bash[23186]: cluster 2024-09-21T02:20:06.798329+0000 mgr.a (mgr.14388) 10631 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:08 smithi049 bash[23528]: cluster 2024-09-21T02:20:06.798329+0000 mgr.a (mgr.14388) 10631 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:09 smithi044 bash[22676]: audit 2024-09-21T02:20:07.910663+0000 mgr.a (mgr.14388) 10632 : audit [DBG] from='client.234432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:09.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:09 smithi179 bash[23186]: audit 2024-09-21T02:20:07.910663+0000 mgr.a (mgr.14388) 10632 : audit [DBG] from='client.234432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:09 smithi049 bash[23528]: audit 2024-09-21T02:20:07.910663+0000 mgr.a (mgr.14388) 10632 : audit [DBG] from='client.234432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:10 smithi044 bash[22676]: cluster 2024-09-21T02:20:08.799278+0000 mgr.a (mgr.14388) 10633 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:10 smithi179 bash[23186]: cluster 2024-09-21T02:20:08.799278+0000 mgr.a (mgr.14388) 10633 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:10.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:10 smithi049 bash[23528]: cluster 2024-09-21T02:20:08.799278+0000 mgr.a (mgr.14388) 10633 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:11 smithi179 bash[23186]: audit 2024-09-21T02:20:10.243009+0000 mon.a (mon.0) 8788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:11 smithi179 bash[23186]: audit 2024-09-21T02:20:10.252902+0000 mon.a (mon.0) 8789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:11 smithi179 bash[23186]: audit 2024-09-21T02:20:10.263771+0000 mon.a (mon.0) 8790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:11 smithi049 bash[23528]: audit 2024-09-21T02:20:10.243009+0000 mon.a (mon.0) 8788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:11 smithi049 bash[23528]: audit 2024-09-21T02:20:10.252902+0000 mon.a (mon.0) 8789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:11 smithi049 bash[23528]: audit 2024-09-21T02:20:10.263771+0000 mon.a (mon.0) 8790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:11 smithi044 bash[22676]: audit 2024-09-21T02:20:10.243009+0000 mon.a (mon.0) 8788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:11 smithi044 bash[22676]: audit 2024-09-21T02:20:10.252902+0000 mon.a (mon.0) 8789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:11 smithi044 bash[22676]: audit 2024-09-21T02:20:10.263771+0000 mon.a (mon.0) 8790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:12 smithi044 bash[22676]: cluster 2024-09-21T02:20:10.801634+0000 mgr.a (mgr.14388) 10634 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:12 smithi049 bash[23528]: cluster 2024-09-21T02:20:10.801634+0000 mgr.a (mgr.14388) 10634 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:12 smithi179 bash[23186]: cluster 2024-09-21T02:20:10.801634+0000 mgr.a (mgr.14388) 10634 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:13.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:13.358 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:13.358 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:14.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:14.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:14.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:14.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:14.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:14.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:14 smithi179 bash[23186]: cluster 2024-09-21T02:20:12.802489+0000 mgr.a (mgr.14388) 10635 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:14 smithi049 bash[23528]: cluster 2024-09-21T02:20:12.802489+0000 mgr.a (mgr.14388) 10635 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:14 smithi044 bash[22676]: cluster 2024-09-21T02:20:12.802489+0000 mgr.a (mgr.14388) 10635 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:15 smithi049 bash[23528]: audit 2024-09-21T02:20:13.700038+0000 mgr.a (mgr.14388) 10636 : audit [DBG] from='client.234510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:15 smithi044 bash[22676]: audit 2024-09-21T02:20:13.700038+0000 mgr.a (mgr.14388) 10636 : audit [DBG] from='client.234510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:15 smithi179 bash[23186]: audit 2024-09-21T02:20:13.700038+0000 mgr.a (mgr.14388) 10636 : audit [DBG] from='client.234510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:16 smithi179 bash[23186]: cluster 2024-09-21T02:20:14.803481+0000 mgr.a (mgr.14388) 10637 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:16 smithi049 bash[23528]: cluster 2024-09-21T02:20:14.803481+0000 mgr.a (mgr.14388) 10637 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:16 smithi044 bash[22676]: cluster 2024-09-21T02:20:14.803481+0000 mgr.a (mgr.14388) 10637 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:17 smithi049 bash[23528]: cluster 2024-09-21T02:20:16.805780+0000 mgr.a (mgr.14388) 10638 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:17 smithi044 bash[22676]: cluster 2024-09-21T02:20:16.805780+0000 mgr.a (mgr.14388) 10638 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:17 smithi179 bash[23186]: cluster 2024-09-21T02:20:16.805780+0000 mgr.a (mgr.14388) 10638 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:19.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:19.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:19.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:19.927 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:19.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:19.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:19.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:19.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:19 smithi044 bash[22676]: cluster 2024-09-21T02:20:18.806555+0000 mgr.a (mgr.14388) 10639 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:19 smithi179 bash[23186]: cluster 2024-09-21T02:20:18.806555+0000 mgr.a (mgr.14388) 10639 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:19 smithi049 bash[23528]: cluster 2024-09-21T02:20:18.806555+0000 mgr.a (mgr.14388) 10639 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:20 smithi044 bash[22676]: audit 2024-09-21T02:20:19.472274+0000 mgr.a (mgr.14388) 10640 : audit [DBG] from='client.234585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:20 smithi179 bash[23186]: audit 2024-09-21T02:20:19.472274+0000 mgr.a (mgr.14388) 10640 : audit [DBG] from='client.234585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:21.279 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:20 smithi049 bash[23528]: audit 2024-09-21T02:20:19.472274+0000 mgr.a (mgr.14388) 10640 : audit [DBG] from='client.234585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:22.204 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:21 smithi049 bash[23528]: cluster 2024-09-21T02:20:20.808958+0000 mgr.a (mgr.14388) 10641 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:21 smithi044 bash[22676]: cluster 2024-09-21T02:20:20.808958+0000 mgr.a (mgr.14388) 10641 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:21 smithi179 bash[23186]: cluster 2024-09-21T02:20:20.808958+0000 mgr.a (mgr.14388) 10641 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:24.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:23 smithi049 bash[23528]: cluster 2024-09-21T02:20:22.809786+0000 mgr.a (mgr.14388) 10642 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:24.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:23 smithi049 bash[23528]: audit 2024-09-21T02:20:23.519826+0000 mon.a (mon.0) 8791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:23 smithi049 bash[23528]: audit 2024-09-21T02:20:23.526752+0000 mon.a (mon.0) 8792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:23 smithi049 bash[23528]: audit 2024-09-21T02:20:23.537021+0000 mon.a (mon.0) 8793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:23 smithi049 bash[23528]: audit 2024-09-21T02:20:23.554331+0000 mon.a (mon.0) 8794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:23 smithi049 bash[23528]: audit 2024-09-21T02:20:23.561631+0000 mon.a (mon.0) 8795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.157 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:23 smithi049 bash[23528]: audit 2024-09-21T02:20:23.571585+0000 mon.a (mon.0) 8796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:23 smithi044 bash[22676]: cluster 2024-09-21T02:20:22.809786+0000 mgr.a (mgr.14388) 10642 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:23 smithi044 bash[22676]: audit 2024-09-21T02:20:23.519826+0000 mon.a (mon.0) 8791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:23 smithi044 bash[22676]: audit 2024-09-21T02:20:23.526752+0000 mon.a (mon.0) 8792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:23 smithi044 bash[22676]: audit 2024-09-21T02:20:23.537021+0000 mon.a (mon.0) 8793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:23 smithi044 bash[22676]: audit 2024-09-21T02:20:23.554331+0000 mon.a (mon.0) 8794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:23 smithi044 bash[22676]: audit 2024-09-21T02:20:23.561631+0000 mon.a (mon.0) 8795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:23 smithi044 bash[22676]: audit 2024-09-21T02:20:23.571585+0000 mon.a (mon.0) 8796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:23 smithi179 bash[23186]: cluster 2024-09-21T02:20:22.809786+0000 mgr.a (mgr.14388) 10642 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:23 smithi179 bash[23186]: audit 2024-09-21T02:20:23.519826+0000 mon.a (mon.0) 8791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:23 smithi179 bash[23186]: audit 2024-09-21T02:20:23.526752+0000 mon.a (mon.0) 8792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:23 smithi179 bash[23186]: audit 2024-09-21T02:20:23.537021+0000 mon.a (mon.0) 8793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:23 smithi179 bash[23186]: audit 2024-09-21T02:20:23.554331+0000 mon.a (mon.0) 8794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:23 smithi179 bash[23186]: audit 2024-09-21T02:20:23.561631+0000 mon.a (mon.0) 8795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:23 smithi179 bash[23186]: audit 2024-09-21T02:20:23.571585+0000 mon.a (mon.0) 8796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:25.686 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:25.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:25.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:25 smithi044 bash[22676]: cluster 2024-09-21T02:20:24.810556+0000 mgr.a (mgr.14388) 10643 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:25 smithi044 bash[22676]: audit 2024-09-21T02:20:25.265699+0000 mgr.a (mgr.14388) 10644 : audit [DBG] from='client.234660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:25 smithi179 bash[23186]: cluster 2024-09-21T02:20:24.810556+0000 mgr.a (mgr.14388) 10643 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:25 smithi179 bash[23186]: audit 2024-09-21T02:20:25.265699+0000 mgr.a (mgr.14388) 10644 : audit [DBG] from='client.234660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:25 smithi049 bash[23528]: cluster 2024-09-21T02:20:24.810556+0000 mgr.a (mgr.14388) 10643 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:25 smithi049 bash[23528]: audit 2024-09-21T02:20:25.265699+0000 mgr.a (mgr.14388) 10644 : audit [DBG] from='client.234660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:27 smithi044 bash[22676]: cluster 2024-09-21T02:20:26.813583+0000 mgr.a (mgr.14388) 10645 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:27 smithi179 bash[23186]: cluster 2024-09-21T02:20:26.813583+0000 mgr.a (mgr.14388) 10645 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:27 smithi049 bash[23528]: cluster 2024-09-21T02:20:26.813583+0000 mgr.a (mgr.14388) 10645 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:29 smithi049 bash[23528]: cluster 2024-09-21T02:20:28.814410+0000 mgr.a (mgr.14388) 10646 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:20:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:29 smithi044 bash[22676]: cluster 2024-09-21T02:20:28.814410+0000 mgr.a (mgr.14388) 10646 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:20:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:29 smithi179 bash[23186]: cluster 2024-09-21T02:20:28.814410+0000 mgr.a (mgr.14388) 10646 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:20:30.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:30.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:30.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:31.463 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:31 smithi044 bash[22676]: audit 2024-09-21T02:20:30.475578+0000 mon.a (mon.0) 8797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:31 smithi044 bash[22676]: audit 2024-09-21T02:20:30.484354+0000 mon.a (mon.0) 8798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:31 smithi044 bash[22676]: audit 2024-09-21T02:20:30.494894+0000 mon.a (mon.0) 8799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:31 smithi044 bash[22676]: cluster 2024-09-21T02:20:30.815354+0000 mgr.a (mgr.14388) 10647 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:31 smithi044 bash[22676]: audit 2024-09-21T02:20:31.026193+0000 mgr.a (mgr.14388) 10648 : audit [DBG] from='client.234738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:31 smithi179 bash[23186]: audit 2024-09-21T02:20:30.475578+0000 mon.a (mon.0) 8797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:31 smithi179 bash[23186]: audit 2024-09-21T02:20:30.484354+0000 mon.a (mon.0) 8798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:31 smithi179 bash[23186]: audit 2024-09-21T02:20:30.494894+0000 mon.a (mon.0) 8799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:31 smithi179 bash[23186]: cluster 2024-09-21T02:20:30.815354+0000 mgr.a (mgr.14388) 10647 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:31 smithi179 bash[23186]: audit 2024-09-21T02:20:31.026193+0000 mgr.a (mgr.14388) 10648 : audit [DBG] from='client.234738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:31 smithi049 bash[23528]: audit 2024-09-21T02:20:30.475578+0000 mon.a (mon.0) 8797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:31 smithi049 bash[23528]: audit 2024-09-21T02:20:30.484354+0000 mon.a (mon.0) 8798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:31 smithi049 bash[23528]: audit 2024-09-21T02:20:30.494894+0000 mon.a (mon.0) 8799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:31 smithi049 bash[23528]: cluster 2024-09-21T02:20:30.815354+0000 mgr.a (mgr.14388) 10647 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:31 smithi049 bash[23528]: audit 2024-09-21T02:20:31.026193+0000 mgr.a (mgr.14388) 10648 : audit [DBG] from='client.234738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:33 smithi179 bash[23186]: cluster 2024-09-21T02:20:32.816194+0000 mgr.a (mgr.14388) 10649 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:20:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:33 smithi044 bash[22676]: cluster 2024-09-21T02:20:32.816194+0000 mgr.a (mgr.14388) 10649 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:20:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:33 smithi049 bash[23528]: cluster 2024-09-21T02:20:32.816194+0000 mgr.a (mgr.14388) 10649 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:20:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:35 smithi044 bash[22676]: cluster 2024-09-21T02:20:34.816799+0000 mgr.a (mgr.14388) 10650 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:20:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:35 smithi179 bash[23186]: cluster 2024-09-21T02:20:34.816799+0000 mgr.a (mgr.14388) 10650 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:20:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:35 smithi049 bash[23528]: cluster 2024-09-21T02:20:34.816799+0000 mgr.a (mgr.14388) 10650 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:20:36.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:36.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:36.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:37.226 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:37.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:37.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:37 smithi044 bash[22676]: audit 2024-09-21T02:20:36.799952+0000 mgr.a (mgr.14388) 10651 : audit [DBG] from='client.234816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:37 smithi044 bash[22676]: cluster 2024-09-21T02:20:36.821622+0000 mgr.a (mgr.14388) 10652 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:37 smithi179 bash[23186]: audit 2024-09-21T02:20:36.799952+0000 mgr.a (mgr.14388) 10651 : audit [DBG] from='client.234816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:37 smithi179 bash[23186]: cluster 2024-09-21T02:20:36.821622+0000 mgr.a (mgr.14388) 10652 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:37 smithi049 bash[23528]: audit 2024-09-21T02:20:36.799952+0000 mgr.a (mgr.14388) 10651 : audit [DBG] from='client.234816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:37 smithi049 bash[23528]: cluster 2024-09-21T02:20:36.821622+0000 mgr.a (mgr.14388) 10652 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:39 smithi044 bash[22676]: cluster 2024-09-21T02:20:38.822621+0000 mgr.a (mgr.14388) 10653 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:39 smithi179 bash[23186]: cluster 2024-09-21T02:20:38.822621+0000 mgr.a (mgr.14388) 10653 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:39 smithi049 bash[23528]: cluster 2024-09-21T02:20:38.822621+0000 mgr.a (mgr.14388) 10653 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:42.019 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:41 smithi049 bash[23528]: cluster 2024-09-21T02:20:40.824951+0000 mgr.a (mgr.14388) 10654 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:42.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:42.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:42.229 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:41 smithi044 bash[22676]: cluster 2024-09-21T02:20:40.824951+0000 mgr.a (mgr.14388) 10654 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:41 smithi179 bash[23186]: cluster 2024-09-21T02:20:40.824951+0000 mgr.a (mgr.14388) 10654 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:43.006 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: audit 2024-09-21T02:20:42.562911+0000 mgr.a (mgr.14388) 10655 : audit [DBG] from='client.234894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: cluster 2024-09-21T02:20:42.825680+0000 mgr.a (mgr.14388) 10656 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: audit 2024-09-21T02:20:43.675773+0000 mon.a (mon.0) 8800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: audit 2024-09-21T02:20:43.683788+0000 mon.a (mon.0) 8801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: audit 2024-09-21T02:20:43.703335+0000 mon.a (mon.0) 8802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: audit 2024-09-21T02:20:43.790279+0000 mon.a (mon.0) 8803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: audit 2024-09-21T02:20:43.797980+0000 mon.a (mon.0) 8804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:43 smithi179 bash[23186]: audit 2024-09-21T02:20:43.807921+0000 mon.a (mon.0) 8805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: audit 2024-09-21T02:20:42.562911+0000 mgr.a (mgr.14388) 10655 : audit [DBG] from='client.234894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: cluster 2024-09-21T02:20:42.825680+0000 mgr.a (mgr.14388) 10656 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: audit 2024-09-21T02:20:43.675773+0000 mon.a (mon.0) 8800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: audit 2024-09-21T02:20:43.683788+0000 mon.a (mon.0) 8801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: audit 2024-09-21T02:20:43.703335+0000 mon.a (mon.0) 8802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: audit 2024-09-21T02:20:43.790279+0000 mon.a (mon.0) 8803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: audit 2024-09-21T02:20:43.797980+0000 mon.a (mon.0) 8804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:43 smithi044 bash[22676]: audit 2024-09-21T02:20:43.807921+0000 mon.a (mon.0) 8805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: audit 2024-09-21T02:20:42.562911+0000 mgr.a (mgr.14388) 10655 : audit [DBG] from='client.234894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: cluster 2024-09-21T02:20:42.825680+0000 mgr.a (mgr.14388) 10656 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: audit 2024-09-21T02:20:43.675773+0000 mon.a (mon.0) 8800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: audit 2024-09-21T02:20:43.683788+0000 mon.a (mon.0) 8801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: audit 2024-09-21T02:20:43.703335+0000 mon.a (mon.0) 8802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: audit 2024-09-21T02:20:43.790279+0000 mon.a (mon.0) 8803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: audit 2024-09-21T02:20:43.797980+0000 mon.a (mon.0) 8804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:44.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:43 smithi049 bash[23528]: audit 2024-09-21T02:20:43.807921+0000 mon.a (mon.0) 8805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:45 smithi044 bash[22676]: cluster 2024-09-21T02:20:44.826544+0000 mgr.a (mgr.14388) 10657 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:45 smithi179 bash[23186]: cluster 2024-09-21T02:20:44.826544+0000 mgr.a (mgr.14388) 10657 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:45 smithi049 bash[23528]: cluster 2024-09-21T02:20:44.826544+0000 mgr.a (mgr.14388) 10657 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:48.007 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:48.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:48.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:47 smithi044 bash[22676]: cluster 2024-09-21T02:20:46.828811+0000 mgr.a (mgr.14388) 10658 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:47 smithi179 bash[23186]: cluster 2024-09-21T02:20:46.828811+0000 mgr.a (mgr.14388) 10658 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:47 smithi049 bash[23528]: cluster 2024-09-21T02:20:46.828811+0000 mgr.a (mgr.14388) 10658 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:48.763 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:48.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:48.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:48.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:48.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:49 smithi044 bash[22676]: audit 2024-09-21T02:20:48.332310+0000 mgr.a (mgr.14388) 10659 : audit [DBG] from='client.234969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:49 smithi044 bash[22676]: cluster 2024-09-21T02:20:48.829798+0000 mgr.a (mgr.14388) 10660 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:49 smithi179 bash[23186]: audit 2024-09-21T02:20:48.332310+0000 mgr.a (mgr.14388) 10659 : audit [DBG] from='client.234969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:49 smithi179 bash[23186]: cluster 2024-09-21T02:20:48.829798+0000 mgr.a (mgr.14388) 10660 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:49 smithi049 bash[23528]: audit 2024-09-21T02:20:48.332310+0000 mgr.a (mgr.14388) 10659 : audit [DBG] from='client.234969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:49 smithi049 bash[23528]: cluster 2024-09-21T02:20:48.829798+0000 mgr.a (mgr.14388) 10660 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.621595+0000 mon.a (mon.0) 8806 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:20:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.628465+0000 mon.a (mon.0) 8807 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:20:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.630311+0000 mon.a (mon.0) 8808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:20:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.641447+0000 mon.a (mon.0) 8809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.647788+0000 mon.a (mon.0) 8810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:20:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.714884+0000 mon.a (mon.0) 8811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.721706+0000 mon.a (mon.0) 8812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:50 smithi049 bash[23528]: audit 2024-09-21T02:20:50.727632+0000 mon.a (mon.0) 8813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.621595+0000 mon.a (mon.0) 8806 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:20:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.628465+0000 mon.a (mon.0) 8807 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:20:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.630311+0000 mon.a (mon.0) 8808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:20:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.641447+0000 mon.a (mon.0) 8809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.647788+0000 mon.a (mon.0) 8810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:20:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.714884+0000 mon.a (mon.0) 8811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.721706+0000 mon.a (mon.0) 8812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:50 smithi044 bash[22676]: audit 2024-09-21T02:20:50.727632+0000 mon.a (mon.0) 8813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.621595+0000 mon.a (mon.0) 8806 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:20:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.628465+0000 mon.a (mon.0) 8807 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:20:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.630311+0000 mon.a (mon.0) 8808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:20:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.641447+0000 mon.a (mon.0) 8809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.647788+0000 mon.a (mon.0) 8810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:20:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.714884+0000 mon.a (mon.0) 8811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.721706+0000 mon.a (mon.0) 8812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:50 smithi179 bash[23186]: audit 2024-09-21T02:20:50.727632+0000 mon.a (mon.0) 8813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:20:51.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:20:51 smithi044 bash[22930]: debug 2024-09-21T02:20:51.414+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:20:51.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:20:51 smithi044 bash[22930]: debug 2024-09-21T02:20:51.414+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:20:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:51 smithi044 bash[22676]: audit 2024-09-21T02:20:50.650282+0000 mgr.a (mgr.14388) 10661 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:20:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:51 smithi044 bash[22676]: cluster 2024-09-21T02:20:50.831166+0000 mgr.a (mgr.14388) 10662 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:51 smithi179 bash[23186]: audit 2024-09-21T02:20:50.650282+0000 mgr.a (mgr.14388) 10661 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:20:52.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:51 smithi179 bash[23186]: cluster 2024-09-21T02:20:50.831166+0000 mgr.a (mgr.14388) 10662 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:51 smithi049 bash[23528]: audit 2024-09-21T02:20:50.650282+0000 mgr.a (mgr.14388) 10661 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:20:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:51 smithi049 bash[23528]: cluster 2024-09-21T02:20:50.831166+0000 mgr.a (mgr.14388) 10662 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:20:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:52 smithi044 bash[22676]: audit 2024-09-21T02:20:51.417993+0000 mgr.a (mgr.14388) 10663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:20:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:52 smithi044 bash[22676]: cephadm 2024-09-21T02:20:51.419720+0000 mgr.a (mgr.14388) 10664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:20:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:52 smithi179 bash[23186]: audit 2024-09-21T02:20:51.417993+0000 mgr.a (mgr.14388) 10663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:20:53.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:52 smithi179 bash[23186]: cephadm 2024-09-21T02:20:51.419720+0000 mgr.a (mgr.14388) 10664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:20:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:52 smithi049 bash[23528]: audit 2024-09-21T02:20:51.417993+0000 mgr.a (mgr.14388) 10663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:20:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:52 smithi049 bash[23528]: cephadm 2024-09-21T02:20:51.419720+0000 mgr.a (mgr.14388) 10664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:20:53.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:53.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:53.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:20:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:53 smithi044 bash[22676]: cluster 2024-09-21T02:20:52.831886+0000 mgr.a (mgr.14388) 10665 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:53 smithi179 bash[23186]: cluster 2024-09-21T02:20:52.831886+0000 mgr.a (mgr.14388) 10665 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:53 smithi049 bash[23528]: cluster 2024-09-21T02:20:52.831886+0000 mgr.a (mgr.14388) 10665 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:54.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:20:54.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:20:54.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:20:54.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:20:54.545 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:20:55.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:54 smithi179 bash[23186]: audit 2024-09-21T02:20:54.099278+0000 mgr.a (mgr.14388) 10666 : audit [DBG] from='client.235155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:54 smithi044 bash[22676]: audit 2024-09-21T02:20:54.099278+0000 mgr.a (mgr.14388) 10666 : audit [DBG] from='client.235155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:54 smithi049 bash[23528]: audit 2024-09-21T02:20:54.099278+0000 mgr.a (mgr.14388) 10666 : audit [DBG] from='client.235155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:20:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:55 smithi044 bash[22676]: cluster 2024-09-21T02:20:54.832866+0000 mgr.a (mgr.14388) 10667 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:55 smithi179 bash[23186]: cluster 2024-09-21T02:20:54.832866+0000 mgr.a (mgr.14388) 10667 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:55 smithi049 bash[23528]: cluster 2024-09-21T02:20:54.832866+0000 mgr.a (mgr.14388) 10667 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:20:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:57 smithi044 bash[22676]: cluster 2024-09-21T02:20:56.835181+0000 mgr.a (mgr.14388) 10668 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:57 smithi179 bash[23186]: cluster 2024-09-21T02:20:56.835181+0000 mgr.a (mgr.14388) 10668 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:57 smithi049 bash[23528]: cluster 2024-09-21T02:20:56.835181+0000 mgr.a (mgr.14388) 10668 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:20:59.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:20:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:20:59.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:20:59 smithi044 bash[22676]: cluster 2024-09-21T02:20:58.836012+0000 mgr.a (mgr.14388) 10669 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:20:59 smithi179 bash[23186]: cluster 2024-09-21T02:20:58.836012+0000 mgr.a (mgr.14388) 10669 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:20:59 smithi049 bash[23528]: cluster 2024-09-21T02:20:58.836012+0000 mgr.a (mgr.14388) 10669 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:00.331 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:00.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:00.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:00.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:00.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:00 smithi044 bash[22676]: audit 2024-09-21T02:20:59.883445+0000 mgr.a (mgr.14388) 10670 : audit [DBG] from='client.235230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:00 smithi179 bash[23186]: audit 2024-09-21T02:20:59.883445+0000 mgr.a (mgr.14388) 10670 : audit [DBG] from='client.235230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:00 smithi049 bash[23528]: audit 2024-09-21T02:20:59.883445+0000 mgr.a (mgr.14388) 10670 : audit [DBG] from='client.235230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:01 smithi044 bash[22676]: cluster 2024-09-21T02:21:00.838983+0000 mgr.a (mgr.14388) 10671 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:01 smithi179 bash[23186]: cluster 2024-09-21T02:21:00.838983+0000 mgr.a (mgr.14388) 10671 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:01 smithi049 bash[23528]: cluster 2024-09-21T02:21:00.838983+0000 mgr.a (mgr.14388) 10671 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:03 smithi044 bash[22676]: cluster 2024-09-21T02:21:02.839781+0000 mgr.a (mgr.14388) 10672 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:21:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:03 smithi044 bash[22676]: audit 2024-09-21T02:21:03.854755+0000 mon.a (mon.0) 8814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:03 smithi044 bash[22676]: audit 2024-09-21T02:21:03.860307+0000 mon.a (mon.0) 8815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:03 smithi044 bash[22676]: audit 2024-09-21T02:21:03.866721+0000 mon.a (mon.0) 8816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:03 smithi179 bash[23186]: cluster 2024-09-21T02:21:02.839781+0000 mgr.a (mgr.14388) 10672 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:21:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:03 smithi179 bash[23186]: audit 2024-09-21T02:21:03.854755+0000 mon.a (mon.0) 8814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:03 smithi179 bash[23186]: audit 2024-09-21T02:21:03.860307+0000 mon.a (mon.0) 8815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:03 smithi179 bash[23186]: audit 2024-09-21T02:21:03.866721+0000 mon.a (mon.0) 8816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:03 smithi049 bash[23528]: cluster 2024-09-21T02:21:02.839781+0000 mgr.a (mgr.14388) 10672 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:21:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:03 smithi049 bash[23528]: audit 2024-09-21T02:21:03.854755+0000 mon.a (mon.0) 8814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:03 smithi049 bash[23528]: audit 2024-09-21T02:21:03.860307+0000 mon.a (mon.0) 8815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:03 smithi049 bash[23528]: audit 2024-09-21T02:21:03.866721+0000 mon.a (mon.0) 8816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:04 smithi179 bash[23186]: audit 2024-09-21T02:21:03.998209+0000 mon.a (mon.0) 8817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:04 smithi179 bash[23186]: audit 2024-09-21T02:21:04.003688+0000 mon.a (mon.0) 8818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:04 smithi179 bash[23186]: audit 2024-09-21T02:21:04.014109+0000 mon.a (mon.0) 8819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:04 smithi049 bash[23528]: audit 2024-09-21T02:21:03.998209+0000 mon.a (mon.0) 8817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:04 smithi049 bash[23528]: audit 2024-09-21T02:21:04.003688+0000 mon.a (mon.0) 8818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:04 smithi049 bash[23528]: audit 2024-09-21T02:21:04.014109+0000 mon.a (mon.0) 8819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:05.334 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:05.334 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:04 smithi044 bash[22676]: audit 2024-09-21T02:21:03.998209+0000 mon.a (mon.0) 8817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:04 smithi044 bash[22676]: audit 2024-09-21T02:21:04.003688+0000 mon.a (mon.0) 8818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:04 smithi044 bash[22676]: audit 2024-09-21T02:21:04.014109+0000 mon.a (mon.0) 8819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:06.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:06.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:06.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:06.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:06 smithi049 bash[23528]: cluster 2024-09-21T02:21:04.840570+0000 mgr.a (mgr.14388) 10673 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:21:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:06 smithi044 bash[22676]: cluster 2024-09-21T02:21:04.840570+0000 mgr.a (mgr.14388) 10673 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:21:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:06 smithi179 bash[23186]: cluster 2024-09-21T02:21:04.840570+0000 mgr.a (mgr.14388) 10673 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:21:07.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:07 smithi049 bash[23528]: audit 2024-09-21T02:21:05.662902+0000 mgr.a (mgr.14388) 10674 : audit [DBG] from='client.235308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:07 smithi044 bash[22676]: audit 2024-09-21T02:21:05.662902+0000 mgr.a (mgr.14388) 10674 : audit [DBG] from='client.235308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:07.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:07 smithi179 bash[23186]: audit 2024-09-21T02:21:05.662902+0000 mgr.a (mgr.14388) 10674 : audit [DBG] from='client.235308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:08 smithi049 bash[23528]: cluster 2024-09-21T02:21:06.843481+0000 mgr.a (mgr.14388) 10675 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:08 smithi044 bash[22676]: cluster 2024-09-21T02:21:06.843481+0000 mgr.a (mgr.14388) 10675 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:08 smithi179 bash[23186]: cluster 2024-09-21T02:21:06.843481+0000 mgr.a (mgr.14388) 10675 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:10 smithi049 bash[23528]: cluster 2024-09-21T02:21:08.844319+0000 mgr.a (mgr.14388) 10676 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:21:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:10 smithi044 bash[22676]: cluster 2024-09-21T02:21:08.844319+0000 mgr.a (mgr.14388) 10676 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:21:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:10 smithi179 bash[23186]: cluster 2024-09-21T02:21:08.844319+0000 mgr.a (mgr.14388) 10676 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:21:11.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:11.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:11.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:11.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:11.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:11.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:11 smithi044 bash[22676]: cluster 2024-09-21T02:21:10.846382+0000 mgr.a (mgr.14388) 10677 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:11 smithi044 bash[22676]: audit 2024-09-21T02:21:10.915246+0000 mon.a (mon.0) 8820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:11 smithi044 bash[22676]: audit 2024-09-21T02:21:10.924024+0000 mon.a (mon.0) 8821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:11 smithi044 bash[22676]: audit 2024-09-21T02:21:10.934478+0000 mon.a (mon.0) 8822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:11 smithi179 bash[23186]: cluster 2024-09-21T02:21:10.846382+0000 mgr.a (mgr.14388) 10677 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:11 smithi179 bash[23186]: audit 2024-09-21T02:21:10.915246+0000 mon.a (mon.0) 8820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:11 smithi179 bash[23186]: audit 2024-09-21T02:21:10.924024+0000 mon.a (mon.0) 8821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:11 smithi179 bash[23186]: audit 2024-09-21T02:21:10.934478+0000 mon.a (mon.0) 8822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:11 smithi049 bash[23528]: cluster 2024-09-21T02:21:10.846382+0000 mgr.a (mgr.14388) 10677 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:11 smithi049 bash[23528]: audit 2024-09-21T02:21:10.915246+0000 mon.a (mon.0) 8820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:11 smithi049 bash[23528]: audit 2024-09-21T02:21:10.924024+0000 mon.a (mon.0) 8821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:11 smithi049 bash[23528]: audit 2024-09-21T02:21:10.934478+0000 mon.a (mon.0) 8822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:13.065 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:12 smithi044 bash[22676]: audit 2024-09-21T02:21:11.454702+0000 mgr.a (mgr.14388) 10678 : audit [DBG] from='client.235386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:12 smithi179 bash[23186]: audit 2024-09-21T02:21:11.454702+0000 mgr.a (mgr.14388) 10678 : audit [DBG] from='client.235386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:12 smithi049 bash[23528]: audit 2024-09-21T02:21:11.454702+0000 mgr.a (mgr.14388) 10678 : audit [DBG] from='client.235386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:13 smithi044 bash[22676]: cluster 2024-09-21T02:21:12.846941+0000 mgr.a (mgr.14388) 10679 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:13 smithi179 bash[23186]: cluster 2024-09-21T02:21:12.846941+0000 mgr.a (mgr.14388) 10679 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:13 smithi049 bash[23528]: cluster 2024-09-21T02:21:12.846941+0000 mgr.a (mgr.14388) 10679 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:15 smithi044 bash[22676]: cluster 2024-09-21T02:21:14.847396+0000 mgr.a (mgr.14388) 10680 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:15 smithi179 bash[23186]: cluster 2024-09-21T02:21:14.847396+0000 mgr.a (mgr.14388) 10680 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:15 smithi049 bash[23528]: cluster 2024-09-21T02:21:14.847396+0000 mgr.a (mgr.14388) 10680 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:16.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:17.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:17.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:17 smithi044 bash[22676]: cluster 2024-09-21T02:21:16.849753+0000 mgr.a (mgr.14388) 10681 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:17 smithi044 bash[22676]: audit 2024-09-21T02:21:17.247381+0000 mgr.a (mgr.14388) 10682 : audit [DBG] from='client.235464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:17 smithi179 bash[23186]: cluster 2024-09-21T02:21:16.849753+0000 mgr.a (mgr.14388) 10681 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:17 smithi179 bash[23186]: audit 2024-09-21T02:21:17.247381+0000 mgr.a (mgr.14388) 10682 : audit [DBG] from='client.235464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:17 smithi049 bash[23528]: cluster 2024-09-21T02:21:16.849753+0000 mgr.a (mgr.14388) 10681 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:17 smithi049 bash[23528]: audit 2024-09-21T02:21:17.247381+0000 mgr.a (mgr.14388) 10682 : audit [DBG] from='client.235464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:19 smithi044 bash[22676]: cluster 2024-09-21T02:21:18.850825+0000 mgr.a (mgr.14388) 10683 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:19 smithi179 bash[23186]: cluster 2024-09-21T02:21:18.850825+0000 mgr.a (mgr.14388) 10683 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:19 smithi049 bash[23528]: cluster 2024-09-21T02:21:18.850825+0000 mgr.a (mgr.14388) 10683 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:21 smithi044 bash[22676]: cluster 2024-09-21T02:21:20.853169+0000 mgr.a (mgr.14388) 10684 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:21 smithi179 bash[23186]: cluster 2024-09-21T02:21:20.853169+0000 mgr.a (mgr.14388) 10684 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:22.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:21 smithi049 bash[23528]: cluster 2024-09-21T02:21:20.853169+0000 mgr.a (mgr.14388) 10684 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:22.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:22.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:22.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:23.442 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:23.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:24.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:23 smithi044 bash[22676]: cluster 2024-09-21T02:21:22.853984+0000 mgr.a (mgr.14388) 10685 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:24.233 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:23 smithi044 bash[22676]: audit 2024-09-21T02:21:23.006603+0000 mgr.a (mgr.14388) 10686 : audit [DBG] from='client.235542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:23 smithi179 bash[23186]: cluster 2024-09-21T02:21:22.853984+0000 mgr.a (mgr.14388) 10685 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:23 smithi179 bash[23186]: audit 2024-09-21T02:21:23.006603+0000 mgr.a (mgr.14388) 10686 : audit [DBG] from='client.235542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:23 smithi049 bash[23528]: cluster 2024-09-21T02:21:22.853984+0000 mgr.a (mgr.14388) 10685 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:23 smithi049 bash[23528]: audit 2024-09-21T02:21:23.006603+0000 mgr.a (mgr.14388) 10686 : audit [DBG] from='client.235542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:25 smithi044 bash[22676]: audit 2024-09-21T02:21:24.062836+0000 mon.a (mon.0) 8823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:25 smithi044 bash[22676]: audit 2024-09-21T02:21:24.069147+0000 mon.a (mon.0) 8824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:25 smithi044 bash[22676]: audit 2024-09-21T02:21:24.082969+0000 mon.a (mon.0) 8825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:25 smithi044 bash[22676]: audit 2024-09-21T02:21:24.210694+0000 mon.a (mon.0) 8826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:25 smithi044 bash[22676]: audit 2024-09-21T02:21:24.220265+0000 mon.a (mon.0) 8827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:25 smithi044 bash[22676]: audit 2024-09-21T02:21:24.231656+0000 mon.a (mon.0) 8828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:25 smithi179 bash[23186]: audit 2024-09-21T02:21:24.062836+0000 mon.a (mon.0) 8823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:25 smithi179 bash[23186]: audit 2024-09-21T02:21:24.069147+0000 mon.a (mon.0) 8824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:25 smithi179 bash[23186]: audit 2024-09-21T02:21:24.082969+0000 mon.a (mon.0) 8825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:25 smithi179 bash[23186]: audit 2024-09-21T02:21:24.210694+0000 mon.a (mon.0) 8826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:25 smithi179 bash[23186]: audit 2024-09-21T02:21:24.220265+0000 mon.a (mon.0) 8827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:25 smithi179 bash[23186]: audit 2024-09-21T02:21:24.231656+0000 mon.a (mon.0) 8828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:25 smithi049 bash[23528]: audit 2024-09-21T02:21:24.062836+0000 mon.a (mon.0) 8823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:25 smithi049 bash[23528]: audit 2024-09-21T02:21:24.069147+0000 mon.a (mon.0) 8824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:25 smithi049 bash[23528]: audit 2024-09-21T02:21:24.082969+0000 mon.a (mon.0) 8825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:25 smithi049 bash[23528]: audit 2024-09-21T02:21:24.210694+0000 mon.a (mon.0) 8826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:25 smithi049 bash[23528]: audit 2024-09-21T02:21:24.220265+0000 mon.a (mon.0) 8827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:25 smithi049 bash[23528]: audit 2024-09-21T02:21:24.231656+0000 mon.a (mon.0) 8828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:26 smithi044 bash[22676]: cluster 2024-09-21T02:21:24.854920+0000 mgr.a (mgr.14388) 10687 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:26 smithi179 bash[23186]: cluster 2024-09-21T02:21:24.854920+0000 mgr.a (mgr.14388) 10687 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:26 smithi049 bash[23528]: cluster 2024-09-21T02:21:24.854920+0000 mgr.a (mgr.14388) 10687 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:28.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:28.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:28.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:28 smithi179 bash[23186]: cluster 2024-09-21T02:21:26.857179+0000 mgr.a (mgr.14388) 10688 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:28 smithi049 bash[23528]: cluster 2024-09-21T02:21:26.857179+0000 mgr.a (mgr.14388) 10688 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:28 smithi044 bash[22676]: cluster 2024-09-21T02:21:26.857179+0000 mgr.a (mgr.14388) 10688 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:29.255 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:29.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:29.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:29.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:29.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:29 smithi044 bash[22676]: audit 2024-09-21T02:21:28.790217+0000 mgr.a (mgr.14388) 10689 : audit [DBG] from='client.235620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:29 smithi044 bash[22676]: cluster 2024-09-21T02:21:28.857769+0000 mgr.a (mgr.14388) 10690 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:29 smithi179 bash[23186]: audit 2024-09-21T02:21:28.790217+0000 mgr.a (mgr.14388) 10689 : audit [DBG] from='client.235620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:29 smithi179 bash[23186]: cluster 2024-09-21T02:21:28.857769+0000 mgr.a (mgr.14388) 10690 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:29 smithi049 bash[23528]: audit 2024-09-21T02:21:28.790217+0000 mgr.a (mgr.14388) 10689 : audit [DBG] from='client.235620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:29 smithi049 bash[23528]: cluster 2024-09-21T02:21:28.857769+0000 mgr.a (mgr.14388) 10690 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:32 smithi044 bash[22676]: cluster 2024-09-21T02:21:30.859956+0000 mgr.a (mgr.14388) 10691 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:32 smithi044 bash[22676]: audit 2024-09-21T02:21:31.147953+0000 mon.a (mon.0) 8829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:32 smithi044 bash[22676]: audit 2024-09-21T02:21:31.157060+0000 mon.a (mon.0) 8830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:32 smithi044 bash[22676]: audit 2024-09-21T02:21:31.167549+0000 mon.a (mon.0) 8831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:32 smithi179 bash[23186]: cluster 2024-09-21T02:21:30.859956+0000 mgr.a (mgr.14388) 10691 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:32 smithi179 bash[23186]: audit 2024-09-21T02:21:31.147953+0000 mon.a (mon.0) 8829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:32 smithi179 bash[23186]: audit 2024-09-21T02:21:31.157060+0000 mon.a (mon.0) 8830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:32 smithi179 bash[23186]: audit 2024-09-21T02:21:31.167549+0000 mon.a (mon.0) 8831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:32 smithi049 bash[23528]: cluster 2024-09-21T02:21:30.859956+0000 mgr.a (mgr.14388) 10691 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:21:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:32 smithi049 bash[23528]: audit 2024-09-21T02:21:31.147953+0000 mon.a (mon.0) 8829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:32 smithi049 bash[23528]: audit 2024-09-21T02:21:31.157060+0000 mon.a (mon.0) 8830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:32 smithi049 bash[23528]: audit 2024-09-21T02:21:31.167549+0000 mon.a (mon.0) 8831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:34 smithi044 bash[22676]: cluster 2024-09-21T02:21:32.860736+0000 mgr.a (mgr.14388) 10692 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:34.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:34.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:34 smithi179 bash[23186]: cluster 2024-09-21T02:21:32.860736+0000 mgr.a (mgr.14388) 10692 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:34 smithi049 bash[23528]: cluster 2024-09-21T02:21:32.860736+0000 mgr.a (mgr.14388) 10692 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:35.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:35.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:35.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:35.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:35.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:36 smithi044 bash[22676]: audit 2024-09-21T02:21:34.594637+0000 mgr.a (mgr.14388) 10693 : audit [DBG] from='client.235698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:36 smithi044 bash[22676]: cluster 2024-09-21T02:21:34.861433+0000 mgr.a (mgr.14388) 10694 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:36 smithi179 bash[23186]: audit 2024-09-21T02:21:34.594637+0000 mgr.a (mgr.14388) 10693 : audit [DBG] from='client.235698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:36 smithi179 bash[23186]: cluster 2024-09-21T02:21:34.861433+0000 mgr.a (mgr.14388) 10694 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:36 smithi049 bash[23528]: audit 2024-09-21T02:21:34.594637+0000 mgr.a (mgr.14388) 10693 : audit [DBG] from='client.235698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:36 smithi049 bash[23528]: cluster 2024-09-21T02:21:34.861433+0000 mgr.a (mgr.14388) 10694 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:38 smithi044 bash[22676]: cluster 2024-09-21T02:21:36.863886+0000 mgr.a (mgr.14388) 10695 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:21:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:38 smithi179 bash[23186]: cluster 2024-09-21T02:21:36.863886+0000 mgr.a (mgr.14388) 10695 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:21:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:38 smithi049 bash[23528]: cluster 2024-09-21T02:21:36.863886+0000 mgr.a (mgr.14388) 10695 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:21:40.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:40.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:40 smithi044 bash[22676]: cluster 2024-09-21T02:21:38.864685+0000 mgr.a (mgr.14388) 10696 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:21:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:40 smithi179 bash[23186]: cluster 2024-09-21T02:21:38.864685+0000 mgr.a (mgr.14388) 10696 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:21:40.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:40 smithi049 bash[23528]: cluster 2024-09-21T02:21:38.864685+0000 mgr.a (mgr.14388) 10696 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:21:40.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:42 smithi044 bash[22676]: audit 2024-09-21T02:21:40.405049+0000 mgr.a (mgr.14388) 10697 : audit [DBG] from='client.235776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:42 smithi044 bash[22676]: cluster 2024-09-21T02:21:40.865987+0000 mgr.a (mgr.14388) 10698 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:42 smithi179 bash[23186]: audit 2024-09-21T02:21:40.405049+0000 mgr.a (mgr.14388) 10697 : audit [DBG] from='client.235776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:42 smithi179 bash[23186]: cluster 2024-09-21T02:21:40.865987+0000 mgr.a (mgr.14388) 10698 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:42 smithi049 bash[23528]: audit 2024-09-21T02:21:40.405049+0000 mgr.a (mgr.14388) 10697 : audit [DBG] from='client.235776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:42 smithi049 bash[23528]: cluster 2024-09-21T02:21:40.865987+0000 mgr.a (mgr.14388) 10698 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:44.425 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:44 smithi049 bash[23528]: cluster 2024-09-21T02:21:42.866705+0000 mgr.a (mgr.14388) 10699 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:21:44.433 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:44 smithi044 bash[22676]: cluster 2024-09-21T02:21:42.866705+0000 mgr.a (mgr.14388) 10699 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:21:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:44 smithi179 bash[23186]: cluster 2024-09-21T02:21:42.866705+0000 mgr.a (mgr.14388) 10699 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:21:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:45 smithi049 bash[23528]: audit 2024-09-21T02:21:44.283780+0000 mon.a (mon.0) 8832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:45 smithi049 bash[23528]: audit 2024-09-21T02:21:44.293881+0000 mon.a (mon.0) 8833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:45 smithi049 bash[23528]: audit 2024-09-21T02:21:44.305657+0000 mon.a (mon.0) 8834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:45 smithi049 bash[23528]: audit 2024-09-21T02:21:44.416220+0000 mon.a (mon.0) 8835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:45 smithi049 bash[23528]: audit 2024-09-21T02:21:44.424856+0000 mon.a (mon.0) 8836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:45 smithi049 bash[23528]: audit 2024-09-21T02:21:44.432846+0000 mon.a (mon.0) 8837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:45 smithi044 bash[22676]: audit 2024-09-21T02:21:44.283780+0000 mon.a (mon.0) 8832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:45 smithi044 bash[22676]: audit 2024-09-21T02:21:44.293881+0000 mon.a (mon.0) 8833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:45 smithi044 bash[22676]: audit 2024-09-21T02:21:44.305657+0000 mon.a (mon.0) 8834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:45 smithi044 bash[22676]: audit 2024-09-21T02:21:44.416220+0000 mon.a (mon.0) 8835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:45 smithi044 bash[22676]: audit 2024-09-21T02:21:44.424856+0000 mon.a (mon.0) 8836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:45 smithi044 bash[22676]: audit 2024-09-21T02:21:44.432846+0000 mon.a (mon.0) 8837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:45 smithi179 bash[23186]: audit 2024-09-21T02:21:44.283780+0000 mon.a (mon.0) 8832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:45 smithi179 bash[23186]: audit 2024-09-21T02:21:44.293881+0000 mon.a (mon.0) 8833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:45 smithi179 bash[23186]: audit 2024-09-21T02:21:44.305657+0000 mon.a (mon.0) 8834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:45 smithi179 bash[23186]: audit 2024-09-21T02:21:44.416220+0000 mon.a (mon.0) 8835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:45 smithi179 bash[23186]: audit 2024-09-21T02:21:44.424856+0000 mon.a (mon.0) 8836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:45 smithi179 bash[23186]: audit 2024-09-21T02:21:44.432846+0000 mon.a (mon.0) 8837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:45.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:45.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:45.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:46.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:46 smithi049 bash[23528]: cluster 2024-09-21T02:21:44.867498+0000 mgr.a (mgr.14388) 10700 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:21:46.594 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:46.594 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:46 smithi044 bash[22676]: cluster 2024-09-21T02:21:44.867498+0000 mgr.a (mgr.14388) 10700 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:21:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:46 smithi179 bash[23186]: cluster 2024-09-21T02:21:44.867498+0000 mgr.a (mgr.14388) 10700 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:21:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:47 smithi049 bash[23528]: audit 2024-09-21T02:21:46.156051+0000 mgr.a (mgr.14388) 10701 : audit [DBG] from='client.235854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:47 smithi044 bash[22676]: audit 2024-09-21T02:21:46.156051+0000 mgr.a (mgr.14388) 10701 : audit [DBG] from='client.235854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:47 smithi179 bash[23186]: audit 2024-09-21T02:21:46.156051+0000 mgr.a (mgr.14388) 10701 : audit [DBG] from='client.235854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:48 smithi049 bash[23528]: cluster 2024-09-21T02:21:46.870336+0000 mgr.a (mgr.14388) 10702 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:48 smithi044 bash[22676]: cluster 2024-09-21T02:21:46.870336+0000 mgr.a (mgr.14388) 10702 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:48 smithi179 bash[23186]: cluster 2024-09-21T02:21:46.870336+0000 mgr.a (mgr.14388) 10702 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:50 smithi049 bash[23528]: cluster 2024-09-21T02:21:48.871146+0000 mgr.a (mgr.14388) 10703 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:21:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:50 smithi044 bash[22676]: cluster 2024-09-21T02:21:48.871146+0000 mgr.a (mgr.14388) 10703 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:21:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:50 smithi179 bash[23186]: cluster 2024-09-21T02:21:48.871146+0000 mgr.a (mgr.14388) 10703 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:21:51.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:51.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:52.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22930]: debug 2024-09-21T02:21:52.313+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:21:52.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22930]: debug 2024-09-21T02:21:52.325+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:21:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: cluster 2024-09-21T02:21:50.873316+0000 mgr.a (mgr.14388) 10704 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:21:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.383409+0000 mon.a (mon.0) 8838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.392202+0000 mon.a (mon.0) 8839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.403558+0000 mon.a (mon.0) 8840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.489778+0000 mon.a (mon.0) 8841 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:21:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.496449+0000 mon.a (mon.0) 8842 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:21:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.498222+0000 mon.a (mon.0) 8843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:21:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.509012+0000 mon.a (mon.0) 8844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:52 smithi044 bash[22676]: audit 2024-09-21T02:21:51.515369+0000 mon.a (mon.0) 8845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: cluster 2024-09-21T02:21:50.873316+0000 mgr.a (mgr.14388) 10704 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.383409+0000 mon.a (mon.0) 8838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.392202+0000 mon.a (mon.0) 8839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.403558+0000 mon.a (mon.0) 8840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.489778+0000 mon.a (mon.0) 8841 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.496449+0000 mon.a (mon.0) 8842 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.498222+0000 mon.a (mon.0) 8843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:21:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.509012+0000 mon.a (mon.0) 8844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:52 smithi049 bash[23528]: audit 2024-09-21T02:21:51.515369+0000 mon.a (mon.0) 8845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:21:52.736 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: cluster 2024-09-21T02:21:50.873316+0000 mgr.a (mgr.14388) 10704 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:21:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.383409+0000 mon.a (mon.0) 8838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.392202+0000 mon.a (mon.0) 8839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.403558+0000 mon.a (mon.0) 8840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.489778+0000 mon.a (mon.0) 8841 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.496449+0000 mon.a (mon.0) 8842 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.498222+0000 mon.a (mon.0) 8843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.509012+0000 mon.a (mon.0) 8844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:21:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:52 smithi179 bash[23186]: audit 2024-09-21T02:21:51.515369+0000 mon.a (mon.0) 8845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:21:53.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:53 smithi044 bash[22676]: audit 2024-09-21T02:21:51.517747+0000 mgr.a (mgr.14388) 10705 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:21:53.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:53 smithi044 bash[22676]: audit 2024-09-21T02:21:51.944674+0000 mgr.a (mgr.14388) 10706 : audit [DBG] from='client.235944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:53 smithi179 bash[23186]: audit 2024-09-21T02:21:51.517747+0000 mgr.a (mgr.14388) 10705 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:21:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:53 smithi179 bash[23186]: audit 2024-09-21T02:21:51.944674+0000 mgr.a (mgr.14388) 10706 : audit [DBG] from='client.235944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:53 smithi049 bash[23528]: audit 2024-09-21T02:21:51.517747+0000 mgr.a (mgr.14388) 10705 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:21:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:53 smithi049 bash[23528]: audit 2024-09-21T02:21:51.944674+0000 mgr.a (mgr.14388) 10706 : audit [DBG] from='client.235944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:54.571 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:54 smithi179 bash[23186]: audit 2024-09-21T02:21:52.320274+0000 mgr.a (mgr.14388) 10707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:21:54.571 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:54 smithi179 bash[23186]: cephadm 2024-09-21T02:21:52.331854+0000 mgr.a (mgr.14388) 10708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:21:54.571 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:54 smithi179 bash[23186]: cluster 2024-09-21T02:21:52.874246+0000 mgr.a (mgr.14388) 10709 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:54 smithi044 bash[22676]: audit 2024-09-21T02:21:52.320274+0000 mgr.a (mgr.14388) 10707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:21:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:54 smithi044 bash[22676]: cephadm 2024-09-21T02:21:52.331854+0000 mgr.a (mgr.14388) 10708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:21:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:54 smithi044 bash[22676]: cluster 2024-09-21T02:21:52.874246+0000 mgr.a (mgr.14388) 10709 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:54 smithi049 bash[23528]: audit 2024-09-21T02:21:52.320274+0000 mgr.a (mgr.14388) 10707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:21:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:54 smithi049 bash[23528]: cephadm 2024-09-21T02:21:52.331854+0000 mgr.a (mgr.14388) 10708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:21:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:54 smithi049 bash[23528]: cluster 2024-09-21T02:21:52.874246+0000 mgr.a (mgr.14388) 10709 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:55 smithi044 bash[22676]: cluster 2024-09-21T02:21:54.875092+0000 mgr.a (mgr.14388) 10710 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:55.614 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:55 smithi179 bash[23186]: cluster 2024-09-21T02:21:54.875092+0000 mgr.a (mgr.14388) 10710 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:55 smithi049 bash[23528]: cluster 2024-09-21T02:21:54.875092+0000 mgr.a (mgr.14388) 10710 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:21:57.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:21:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:21:57.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:21:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:57 smithi044 bash[22676]: cluster 2024-09-21T02:21:56.877346+0000 mgr.a (mgr.14388) 10711 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:57 smithi179 bash[23186]: cluster 2024-09-21T02:21:56.877346+0000 mgr.a (mgr.14388) 10711 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:57 smithi049 bash[23528]: cluster 2024-09-21T02:21:56.877346+0000 mgr.a (mgr.14388) 10711 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:21:58.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:21:58.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:21:58.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:21:58.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:21:58.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:21:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:58 smithi044 bash[22676]: audit 2024-09-21T02:21:58.071252+0000 mgr.a (mgr.14388) 10712 : audit [DBG] from='client.236109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:58 smithi179 bash[23186]: audit 2024-09-21T02:21:58.071252+0000 mgr.a (mgr.14388) 10712 : audit [DBG] from='client.236109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:21:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:58 smithi049 bash[23528]: audit 2024-09-21T02:21:58.071252+0000 mgr.a (mgr.14388) 10712 : audit [DBG] from='client.236109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:21:59 smithi044 bash[22676]: cluster 2024-09-21T02:21:58.878276+0000 mgr.a (mgr.14388) 10713 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:21:59 smithi179 bash[23186]: cluster 2024-09-21T02:21:58.878276+0000 mgr.a (mgr.14388) 10713 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:21:59 smithi049 bash[23528]: cluster 2024-09-21T02:21:58.878276+0000 mgr.a (mgr.14388) 10713 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:01 smithi044 bash[22676]: cluster 2024-09-21T02:22:00.880430+0000 mgr.a (mgr.14388) 10714 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:02.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:01 smithi179 bash[23186]: cluster 2024-09-21T02:22:00.880430+0000 mgr.a (mgr.14388) 10714 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:01 smithi049 bash[23528]: cluster 2024-09-21T02:22:00.880430+0000 mgr.a (mgr.14388) 10714 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:03.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:03.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:03 smithi044 bash[22676]: cluster 2024-09-21T02:22:02.881204+0000 mgr.a (mgr.14388) 10715 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:04.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:03 smithi179 bash[23186]: cluster 2024-09-21T02:22:02.881204+0000 mgr.a (mgr.14388) 10715 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:04.279 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:04.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:04.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:04.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:04.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:04.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:03 smithi049 bash[23528]: cluster 2024-09-21T02:22:02.881204+0000 mgr.a (mgr.14388) 10715 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:04 smithi049 bash[23528]: audit 2024-09-21T02:22:03.855089+0000 mgr.a (mgr.14388) 10716 : audit [DBG] from='client.236187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:04 smithi049 bash[23528]: audit 2024-09-21T02:22:04.497516+0000 mon.a (mon.0) 8846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:04 smithi049 bash[23528]: audit 2024-09-21T02:22:04.503123+0000 mon.a (mon.0) 8847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:04 smithi049 bash[23528]: audit 2024-09-21T02:22:04.508985+0000 mon.a (mon.0) 8848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:04 smithi049 bash[23528]: audit 2024-09-21T02:22:04.650302+0000 mon.a (mon.0) 8849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:04 smithi049 bash[23528]: audit 2024-09-21T02:22:04.658362+0000 mon.a (mon.0) 8850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:04 smithi049 bash[23528]: audit 2024-09-21T02:22:04.668509+0000 mon.a (mon.0) 8851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:04 smithi044 bash[22676]: audit 2024-09-21T02:22:03.855089+0000 mgr.a (mgr.14388) 10716 : audit [DBG] from='client.236187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:04 smithi044 bash[22676]: audit 2024-09-21T02:22:04.497516+0000 mon.a (mon.0) 8846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:04 smithi044 bash[22676]: audit 2024-09-21T02:22:04.503123+0000 mon.a (mon.0) 8847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:04 smithi044 bash[22676]: audit 2024-09-21T02:22:04.508985+0000 mon.a (mon.0) 8848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:04 smithi044 bash[22676]: audit 2024-09-21T02:22:04.650302+0000 mon.a (mon.0) 8849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:04 smithi044 bash[22676]: audit 2024-09-21T02:22:04.658362+0000 mon.a (mon.0) 8850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:04 smithi044 bash[22676]: audit 2024-09-21T02:22:04.668509+0000 mon.a (mon.0) 8851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:04 smithi179 bash[23186]: audit 2024-09-21T02:22:03.855089+0000 mgr.a (mgr.14388) 10716 : audit [DBG] from='client.236187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:05.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:04 smithi179 bash[23186]: audit 2024-09-21T02:22:04.497516+0000 mon.a (mon.0) 8846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:04 smithi179 bash[23186]: audit 2024-09-21T02:22:04.503123+0000 mon.a (mon.0) 8847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:04 smithi179 bash[23186]: audit 2024-09-21T02:22:04.508985+0000 mon.a (mon.0) 8848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:04 smithi179 bash[23186]: audit 2024-09-21T02:22:04.650302+0000 mon.a (mon.0) 8849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:04 smithi179 bash[23186]: audit 2024-09-21T02:22:04.658362+0000 mon.a (mon.0) 8850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:04 smithi179 bash[23186]: audit 2024-09-21T02:22:04.668509+0000 mon.a (mon.0) 8851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:05 smithi044 bash[22676]: cluster 2024-09-21T02:22:04.882063+0000 mgr.a (mgr.14388) 10717 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:05 smithi179 bash[23186]: cluster 2024-09-21T02:22:04.882063+0000 mgr.a (mgr.14388) 10717 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:05 smithi049 bash[23528]: cluster 2024-09-21T02:22:04.882063+0000 mgr.a (mgr.14388) 10717 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:07 smithi044 bash[22676]: cluster 2024-09-21T02:22:06.884332+0000 mgr.a (mgr.14388) 10718 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:07 smithi179 bash[23186]: cluster 2024-09-21T02:22:06.884332+0000 mgr.a (mgr.14388) 10718 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:07 smithi049 bash[23528]: cluster 2024-09-21T02:22:06.884332+0000 mgr.a (mgr.14388) 10718 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:09.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:09.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:09.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:10.047 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:10.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:10.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:10.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:10.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:09 smithi044 bash[22676]: cluster 2024-09-21T02:22:08.885065+0000 mgr.a (mgr.14388) 10719 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:09 smithi179 bash[23186]: cluster 2024-09-21T02:22:08.885065+0000 mgr.a (mgr.14388) 10719 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:09 smithi049 bash[23528]: cluster 2024-09-21T02:22:08.885065+0000 mgr.a (mgr.14388) 10719 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:10 smithi044 bash[22676]: audit 2024-09-21T02:22:09.616805+0000 mgr.a (mgr.14388) 10720 : audit [DBG] from='client.236265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:10 smithi179 bash[23186]: audit 2024-09-21T02:22:09.616805+0000 mgr.a (mgr.14388) 10720 : audit [DBG] from='client.236265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:10 smithi049 bash[23528]: audit 2024-09-21T02:22:09.616805+0000 mgr.a (mgr.14388) 10720 : audit [DBG] from='client.236265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:11 smithi044 bash[22676]: cluster 2024-09-21T02:22:10.887549+0000 mgr.a (mgr.14388) 10721 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:22:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:11 smithi044 bash[22676]: audit 2024-09-21T02:22:11.619622+0000 mon.a (mon.0) 8852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:11 smithi044 bash[22676]: audit 2024-09-21T02:22:11.629611+0000 mon.a (mon.0) 8853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:11 smithi044 bash[22676]: audit 2024-09-21T02:22:11.640255+0000 mon.a (mon.0) 8854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:11 smithi179 bash[23186]: cluster 2024-09-21T02:22:10.887549+0000 mgr.a (mgr.14388) 10721 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:22:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:11 smithi179 bash[23186]: audit 2024-09-21T02:22:11.619622+0000 mon.a (mon.0) 8852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:11 smithi179 bash[23186]: audit 2024-09-21T02:22:11.629611+0000 mon.a (mon.0) 8853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:11 smithi179 bash[23186]: audit 2024-09-21T02:22:11.640255+0000 mon.a (mon.0) 8854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:11 smithi049 bash[23528]: cluster 2024-09-21T02:22:10.887549+0000 mgr.a (mgr.14388) 10721 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:22:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:11 smithi049 bash[23528]: audit 2024-09-21T02:22:11.619622+0000 mon.a (mon.0) 8852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:11 smithi049 bash[23528]: audit 2024-09-21T02:22:11.629611+0000 mon.a (mon.0) 8853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:11 smithi049 bash[23528]: audit 2024-09-21T02:22:11.640255+0000 mon.a (mon.0) 8854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:13 smithi044 bash[22676]: cluster 2024-09-21T02:22:12.888540+0000 mgr.a (mgr.14388) 10722 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:22:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:13 smithi179 bash[23186]: cluster 2024-09-21T02:22:12.888540+0000 mgr.a (mgr.14388) 10722 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:22:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:13 smithi049 bash[23528]: cluster 2024-09-21T02:22:12.888540+0000 mgr.a (mgr.14388) 10722 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:22:15.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:15.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:15.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:15.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:15.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:16.234 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:15 smithi044 bash[22676]: cluster 2024-09-21T02:22:14.889385+0000 mgr.a (mgr.14388) 10723 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:22:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:15 smithi179 bash[23186]: cluster 2024-09-21T02:22:14.889385+0000 mgr.a (mgr.14388) 10723 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:22:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:15 smithi049 bash[23528]: cluster 2024-09-21T02:22:14.889385+0000 mgr.a (mgr.14388) 10723 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:22:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:16 smithi179 bash[23186]: audit 2024-09-21T02:22:15.388280+0000 mgr.a (mgr.14388) 10724 : audit [DBG] from='client.236340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:16 smithi049 bash[23528]: audit 2024-09-21T02:22:15.388280+0000 mgr.a (mgr.14388) 10724 : audit [DBG] from='client.236340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:16 smithi044 bash[22676]: audit 2024-09-21T02:22:15.388280+0000 mgr.a (mgr.14388) 10724 : audit [DBG] from='client.236340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:17 smithi179 bash[23186]: cluster 2024-09-21T02:22:16.892116+0000 mgr.a (mgr.14388) 10725 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:17 smithi049 bash[23528]: cluster 2024-09-21T02:22:16.892116+0000 mgr.a (mgr.14388) 10725 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:17 smithi044 bash[22676]: cluster 2024-09-21T02:22:16.892116+0000 mgr.a (mgr.14388) 10725 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:20 smithi179 bash[23186]: cluster 2024-09-21T02:22:18.892904+0000 mgr.a (mgr.14388) 10726 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:20 smithi049 bash[23528]: cluster 2024-09-21T02:22:18.892904+0000 mgr.a (mgr.14388) 10726 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:20 smithi044 bash[22676]: cluster 2024-09-21T02:22:18.892904+0000 mgr.a (mgr.14388) 10726 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:20.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:20.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:21.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:21.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:21.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:21.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:21.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:22 smithi049 bash[23528]: cluster 2024-09-21T02:22:20.894887+0000 mgr.a (mgr.14388) 10727 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:22 smithi049 bash[23528]: audit 2024-09-21T02:22:21.147647+0000 mgr.a (mgr.14388) 10728 : audit [DBG] from='client.236418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:22 smithi044 bash[22676]: cluster 2024-09-21T02:22:20.894887+0000 mgr.a (mgr.14388) 10727 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:22 smithi044 bash[22676]: audit 2024-09-21T02:22:21.147647+0000 mgr.a (mgr.14388) 10728 : audit [DBG] from='client.236418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:22 smithi179 bash[23186]: cluster 2024-09-21T02:22:20.894887+0000 mgr.a (mgr.14388) 10727 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:22 smithi179 bash[23186]: audit 2024-09-21T02:22:21.147647+0000 mgr.a (mgr.14388) 10728 : audit [DBG] from='client.236418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:24 smithi049 bash[23528]: cluster 2024-09-21T02:22:22.895789+0000 mgr.a (mgr.14388) 10729 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:22:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:24 smithi044 bash[22676]: cluster 2024-09-21T02:22:22.895789+0000 mgr.a (mgr.14388) 10729 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:22:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:24 smithi179 bash[23186]: cluster 2024-09-21T02:22:22.895789+0000 mgr.a (mgr.14388) 10729 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:22:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:25 smithi044 bash[22676]: audit 2024-09-21T02:22:24.708668+0000 mon.a (mon.0) 8855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:25 smithi044 bash[22676]: audit 2024-09-21T02:22:24.714184+0000 mon.a (mon.0) 8856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:25 smithi044 bash[22676]: audit 2024-09-21T02:22:24.722564+0000 mon.a (mon.0) 8857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:25 smithi044 bash[22676]: audit 2024-09-21T02:22:24.841001+0000 mon.a (mon.0) 8858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:25 smithi044 bash[22676]: audit 2024-09-21T02:22:24.848017+0000 mon.a (mon.0) 8859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:25 smithi044 bash[22676]: audit 2024-09-21T02:22:24.856530+0000 mon.a (mon.0) 8860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:25 smithi044 bash[22676]: cluster 2024-09-21T02:22:24.896590+0000 mgr.a (mgr.14388) 10730 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:22:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:25 smithi179 bash[23186]: audit 2024-09-21T02:22:24.708668+0000 mon.a (mon.0) 8855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:25 smithi179 bash[23186]: audit 2024-09-21T02:22:24.714184+0000 mon.a (mon.0) 8856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:25 smithi179 bash[23186]: audit 2024-09-21T02:22:24.722564+0000 mon.a (mon.0) 8857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:25 smithi179 bash[23186]: audit 2024-09-21T02:22:24.841001+0000 mon.a (mon.0) 8858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:25 smithi179 bash[23186]: audit 2024-09-21T02:22:24.848017+0000 mon.a (mon.0) 8859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:25 smithi179 bash[23186]: audit 2024-09-21T02:22:24.856530+0000 mon.a (mon.0) 8860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:25 smithi179 bash[23186]: cluster 2024-09-21T02:22:24.896590+0000 mgr.a (mgr.14388) 10730 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:22:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:25 smithi049 bash[23528]: audit 2024-09-21T02:22:24.708668+0000 mon.a (mon.0) 8855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:25 smithi049 bash[23528]: audit 2024-09-21T02:22:24.714184+0000 mon.a (mon.0) 8856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:25 smithi049 bash[23528]: audit 2024-09-21T02:22:24.722564+0000 mon.a (mon.0) 8857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:25 smithi049 bash[23528]: audit 2024-09-21T02:22:24.841001+0000 mon.a (mon.0) 8858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:25 smithi049 bash[23528]: audit 2024-09-21T02:22:24.848017+0000 mon.a (mon.0) 8859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:25 smithi049 bash[23528]: audit 2024-09-21T02:22:24.856530+0000 mon.a (mon.0) 8860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:25 smithi049 bash[23528]: cluster 2024-09-21T02:22:24.896590+0000 mgr.a (mgr.14388) 10730 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:22:26.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:26.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:26.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:27.377 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:27.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:27.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:27.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:27.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:27 smithi044 bash[22676]: cluster 2024-09-21T02:22:26.898731+0000 mgr.a (mgr.14388) 10731 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:22:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:27 smithi044 bash[22676]: audit 2024-09-21T02:22:26.927532+0000 mgr.a (mgr.14388) 10732 : audit [DBG] from='client.236493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:27 smithi179 bash[23186]: cluster 2024-09-21T02:22:26.898731+0000 mgr.a (mgr.14388) 10731 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:22:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:27 smithi179 bash[23186]: audit 2024-09-21T02:22:26.927532+0000 mgr.a (mgr.14388) 10732 : audit [DBG] from='client.236493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:27 smithi049 bash[23528]: cluster 2024-09-21T02:22:26.898731+0000 mgr.a (mgr.14388) 10731 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:22:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:27 smithi049 bash[23528]: audit 2024-09-21T02:22:26.927532+0000 mgr.a (mgr.14388) 10732 : audit [DBG] from='client.236493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:29 smithi044 bash[22676]: cluster 2024-09-21T02:22:28.899654+0000 mgr.a (mgr.14388) 10733 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:29 smithi179 bash[23186]: cluster 2024-09-21T02:22:28.899654+0000 mgr.a (mgr.14388) 10733 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:29 smithi049 bash[23528]: cluster 2024-09-21T02:22:28.899654+0000 mgr.a (mgr.14388) 10733 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:31 smithi044 bash[22676]: cluster 2024-09-21T02:22:30.901821+0000 mgr.a (mgr.14388) 10734 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:31 smithi044 bash[22676]: audit 2024-09-21T02:22:31.856642+0000 mon.a (mon.0) 8861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:31 smithi044 bash[22676]: audit 2024-09-21T02:22:31.865689+0000 mon.a (mon.0) 8862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:31 smithi044 bash[22676]: audit 2024-09-21T02:22:31.877085+0000 mon.a (mon.0) 8863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:31 smithi179 bash[23186]: cluster 2024-09-21T02:22:30.901821+0000 mgr.a (mgr.14388) 10734 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:31 smithi179 bash[23186]: audit 2024-09-21T02:22:31.856642+0000 mon.a (mon.0) 8861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:31 smithi179 bash[23186]: audit 2024-09-21T02:22:31.865689+0000 mon.a (mon.0) 8862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:31 smithi179 bash[23186]: audit 2024-09-21T02:22:31.877085+0000 mon.a (mon.0) 8863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:31 smithi049 bash[23528]: cluster 2024-09-21T02:22:30.901821+0000 mgr.a (mgr.14388) 10734 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:31 smithi049 bash[23528]: audit 2024-09-21T02:22:31.856642+0000 mon.a (mon.0) 8861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:31 smithi049 bash[23528]: audit 2024-09-21T02:22:31.865689+0000 mon.a (mon.0) 8862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:31 smithi049 bash[23528]: audit 2024-09-21T02:22:31.877085+0000 mon.a (mon.0) 8863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:32.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:32.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:33.140 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:33.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:33.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:33.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:33.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:33 smithi044 bash[22676]: audit 2024-09-21T02:22:32.715649+0000 mgr.a (mgr.14388) 10735 : audit [DBG] from='client.236571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:33 smithi044 bash[22676]: cluster 2024-09-21T02:22:32.902511+0000 mgr.a (mgr.14388) 10736 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:33 smithi179 bash[23186]: audit 2024-09-21T02:22:32.715649+0000 mgr.a (mgr.14388) 10735 : audit [DBG] from='client.236571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:34.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:33 smithi179 bash[23186]: cluster 2024-09-21T02:22:32.902511+0000 mgr.a (mgr.14388) 10736 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:33 smithi049 bash[23528]: audit 2024-09-21T02:22:32.715649+0000 mgr.a (mgr.14388) 10735 : audit [DBG] from='client.236571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:33 smithi049 bash[23528]: cluster 2024-09-21T02:22:32.902511+0000 mgr.a (mgr.14388) 10736 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:36.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:35 smithi044 bash[22676]: cluster 2024-09-21T02:22:34.903442+0000 mgr.a (mgr.14388) 10737 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:36.231 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:35 smithi179 bash[23186]: cluster 2024-09-21T02:22:34.903442+0000 mgr.a (mgr.14388) 10737 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:35 smithi049 bash[23528]: cluster 2024-09-21T02:22:34.903442+0000 mgr.a (mgr.14388) 10737 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:38.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:38.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:38.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:37 smithi044 bash[22676]: cluster 2024-09-21T02:22:36.905724+0000 mgr.a (mgr.14388) 10738 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:37 smithi179 bash[23186]: cluster 2024-09-21T02:22:36.905724+0000 mgr.a (mgr.14388) 10738 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:37 smithi049 bash[23528]: cluster 2024-09-21T02:22:36.905724+0000 mgr.a (mgr.14388) 10738 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:38.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:38.910 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:39 smithi044 bash[22676]: audit 2024-09-21T02:22:38.465569+0000 mgr.a (mgr.14388) 10739 : audit [DBG] from='client.236649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:39 smithi044 bash[22676]: cluster 2024-09-21T02:22:38.906234+0000 mgr.a (mgr.14388) 10740 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:39 smithi179 bash[23186]: audit 2024-09-21T02:22:38.465569+0000 mgr.a (mgr.14388) 10739 : audit [DBG] from='client.236649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:39 smithi179 bash[23186]: cluster 2024-09-21T02:22:38.906234+0000 mgr.a (mgr.14388) 10740 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:39 smithi049 bash[23528]: audit 2024-09-21T02:22:38.465569+0000 mgr.a (mgr.14388) 10739 : audit [DBG] from='client.236649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:39 smithi049 bash[23528]: cluster 2024-09-21T02:22:38.906234+0000 mgr.a (mgr.14388) 10740 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:41 smithi044 bash[22676]: cluster 2024-09-21T02:22:40.908351+0000 mgr.a (mgr.14388) 10741 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:41 smithi179 bash[23186]: cluster 2024-09-21T02:22:40.908351+0000 mgr.a (mgr.14388) 10741 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:41 smithi049 bash[23528]: cluster 2024-09-21T02:22:40.908351+0000 mgr.a (mgr.14388) 10741 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:44.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:43 smithi179 bash[23186]: cluster 2024-09-21T02:22:42.909100+0000 mgr.a (mgr.14388) 10742 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:43 smithi049 bash[23528]: cluster 2024-09-21T02:22:42.909100+0000 mgr.a (mgr.14388) 10742 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:43 smithi044 bash[22676]: cluster 2024-09-21T02:22:42.909100+0000 mgr.a (mgr.14388) 10742 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:44.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:44.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:44.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:44.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:45.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:44 smithi179 bash[23186]: audit 2024-09-21T02:22:44.238340+0000 mgr.a (mgr.14388) 10743 : audit [DBG] from='client.236727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:44 smithi179 bash[23186]: audit 2024-09-21T02:22:44.914075+0000 mon.a (mon.0) 8864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:44 smithi179 bash[23186]: audit 2024-09-21T02:22:44.919706+0000 mon.a (mon.0) 8865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:44 smithi179 bash[23186]: audit 2024-09-21T02:22:44.925857+0000 mon.a (mon.0) 8866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:44 smithi049 bash[23528]: audit 2024-09-21T02:22:44.238340+0000 mgr.a (mgr.14388) 10743 : audit [DBG] from='client.236727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:44 smithi049 bash[23528]: audit 2024-09-21T02:22:44.914075+0000 mon.a (mon.0) 8864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:44 smithi049 bash[23528]: audit 2024-09-21T02:22:44.919706+0000 mon.a (mon.0) 8865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:44 smithi049 bash[23528]: audit 2024-09-21T02:22:44.925857+0000 mon.a (mon.0) 8866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:44 smithi044 bash[22676]: audit 2024-09-21T02:22:44.238340+0000 mgr.a (mgr.14388) 10743 : audit [DBG] from='client.236727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:44 smithi044 bash[22676]: audit 2024-09-21T02:22:44.914075+0000 mon.a (mon.0) 8864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:44 smithi044 bash[22676]: audit 2024-09-21T02:22:44.919706+0000 mon.a (mon.0) 8865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:44 smithi044 bash[22676]: audit 2024-09-21T02:22:44.925857+0000 mon.a (mon.0) 8866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.315 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:46 smithi049 bash[23528]: cluster 2024-09-21T02:22:44.910208+0000 mgr.a (mgr.14388) 10744 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:46.315 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:46 smithi049 bash[23528]: audit 2024-09-21T02:22:45.063225+0000 mon.a (mon.0) 8867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.316 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:46 smithi049 bash[23528]: audit 2024-09-21T02:22:45.070763+0000 mon.a (mon.0) 8868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.316 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:46 smithi049 bash[23528]: audit 2024-09-21T02:22:45.078479+0000 mon.a (mon.0) 8869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:46 smithi044 bash[22676]: cluster 2024-09-21T02:22:44.910208+0000 mgr.a (mgr.14388) 10744 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:46 smithi044 bash[22676]: audit 2024-09-21T02:22:45.063225+0000 mon.a (mon.0) 8867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:46 smithi044 bash[22676]: audit 2024-09-21T02:22:45.070763+0000 mon.a (mon.0) 8868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:46 smithi044 bash[22676]: audit 2024-09-21T02:22:45.078479+0000 mon.a (mon.0) 8869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:46 smithi179 bash[23186]: cluster 2024-09-21T02:22:44.910208+0000 mgr.a (mgr.14388) 10744 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:46 smithi179 bash[23186]: audit 2024-09-21T02:22:45.063225+0000 mon.a (mon.0) 8867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:46 smithi179 bash[23186]: audit 2024-09-21T02:22:45.070763+0000 mon.a (mon.0) 8868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:46 smithi179 bash[23186]: audit 2024-09-21T02:22:45.078479+0000 mon.a (mon.0) 8869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:48 smithi044 bash[22676]: cluster 2024-09-21T02:22:46.912476+0000 mgr.a (mgr.14388) 10745 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:48 smithi179 bash[23186]: cluster 2024-09-21T02:22:46.912476+0000 mgr.a (mgr.14388) 10745 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:48 smithi049 bash[23528]: cluster 2024-09-21T02:22:46.912476+0000 mgr.a (mgr.14388) 10745 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:22:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:50.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:50.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:50.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:50.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:50.423 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:50 smithi044 bash[22676]: cluster 2024-09-21T02:22:48.913284+0000 mgr.a (mgr.14388) 10746 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:50 smithi179 bash[23186]: cluster 2024-09-21T02:22:48.913284+0000 mgr.a (mgr.14388) 10746 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:50 smithi049 bash[23528]: cluster 2024-09-21T02:22:48.913284+0000 mgr.a (mgr.14388) 10746 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:51 smithi044 bash[22676]: audit 2024-09-21T02:22:49.998566+0000 mgr.a (mgr.14388) 10747 : audit [DBG] from='client.236805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:51.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:51 smithi179 bash[23186]: audit 2024-09-21T02:22:49.998566+0000 mgr.a (mgr.14388) 10747 : audit [DBG] from='client.236805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:51.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:51 smithi049 bash[23528]: audit 2024-09-21T02:22:49.998566+0000 mgr.a (mgr.14388) 10747 : audit [DBG] from='client.236805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:52 smithi044 bash[22676]: cluster 2024-09-21T02:22:50.916033+0000 mgr.a (mgr.14388) 10748 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:52 smithi179 bash[23186]: cluster 2024-09-21T02:22:50.916033+0000 mgr.a (mgr.14388) 10748 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:52 smithi049 bash[23528]: cluster 2024-09-21T02:22:50.916033+0000 mgr.a (mgr.14388) 10748 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:22:53.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.096081+0000 mon.a (mon.0) 8870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.105106+0000 mon.a (mon.0) 8871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.115581+0000 mon.a (mon.0) 8872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.418788+0000 mon.a (mon.0) 8873 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:22:53.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.425389+0000 mon.a (mon.0) 8874 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:22:53.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.427289+0000 mon.a (mon.0) 8875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:22:53.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.438057+0000 mon.a (mon.0) 8876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22676]: audit 2024-09-21T02:22:52.444258+0000 mon.a (mon.0) 8877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:22:53.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22930]: debug 2024-09-21T02:22:53.228+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:22:53.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:22:53 smithi044 bash[22930]: debug 2024-09-21T02:22:53.232+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.096081+0000 mon.a (mon.0) 8870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.105106+0000 mon.a (mon.0) 8871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.115581+0000 mon.a (mon.0) 8872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.418788+0000 mon.a (mon.0) 8873 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.425389+0000 mon.a (mon.0) 8874 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.427289+0000 mon.a (mon.0) 8875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.438057+0000 mon.a (mon.0) 8876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:53 smithi179 bash[23186]: audit 2024-09-21T02:22:52.444258+0000 mon.a (mon.0) 8877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:22:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.096081+0000 mon.a (mon.0) 8870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.105106+0000 mon.a (mon.0) 8871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.115581+0000 mon.a (mon.0) 8872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.418788+0000 mon.a (mon.0) 8873 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:22:53.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.425389+0000 mon.a (mon.0) 8874 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:22:53.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.427289+0000 mon.a (mon.0) 8875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:22:53.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.438057+0000 mon.a (mon.0) 8876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:22:53.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:53 smithi049 bash[23528]: audit 2024-09-21T02:22:52.444258+0000 mon.a (mon.0) 8877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:22:54.363 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:54 smithi044 bash[22676]: audit 2024-09-21T02:22:52.446777+0000 mgr.a (mgr.14388) 10749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:22:54.363 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:54 smithi044 bash[22676]: cluster 2024-09-21T02:22:52.916893+0000 mgr.a (mgr.14388) 10750 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:54.363 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:54 smithi044 bash[22676]: audit 2024-09-21T02:22:53.232312+0000 mgr.a (mgr.14388) 10751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:22:54.363 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:54 smithi044 bash[22676]: cephadm 2024-09-21T02:22:53.233589+0000 mgr.a (mgr.14388) 10752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:22:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:54 smithi179 bash[23186]: audit 2024-09-21T02:22:52.446777+0000 mgr.a (mgr.14388) 10749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:22:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:54 smithi179 bash[23186]: cluster 2024-09-21T02:22:52.916893+0000 mgr.a (mgr.14388) 10750 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:54 smithi179 bash[23186]: audit 2024-09-21T02:22:53.232312+0000 mgr.a (mgr.14388) 10751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:22:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:54 smithi179 bash[23186]: cephadm 2024-09-21T02:22:53.233589+0000 mgr.a (mgr.14388) 10752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:22:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:54 smithi049 bash[23528]: audit 2024-09-21T02:22:52.446777+0000 mgr.a (mgr.14388) 10749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:22:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:54 smithi049 bash[23528]: cluster 2024-09-21T02:22:52.916893+0000 mgr.a (mgr.14388) 10750 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:54 smithi049 bash[23528]: audit 2024-09-21T02:22:53.232312+0000 mgr.a (mgr.14388) 10751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:22:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:54 smithi049 bash[23528]: cephadm 2024-09-21T02:22:53.233589+0000 mgr.a (mgr.14388) 10752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:22:55.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:22:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:22:55.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:22:56.196 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:22:56.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:22:56.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:22:56.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:22:56.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:22:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:56 smithi179 bash[23186]: cluster 2024-09-21T02:22:54.917586+0000 mgr.a (mgr.14388) 10753 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:56.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:56 smithi044 bash[22676]: cluster 2024-09-21T02:22:54.917586+0000 mgr.a (mgr.14388) 10753 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:56 smithi049 bash[23528]: cluster 2024-09-21T02:22:54.917586+0000 mgr.a (mgr.14388) 10753 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:22:57.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:57 smithi179 bash[23186]: audit 2024-09-21T02:22:55.761584+0000 mgr.a (mgr.14388) 10754 : audit [DBG] from='client.236988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:57 smithi044 bash[22676]: audit 2024-09-21T02:22:55.761584+0000 mgr.a (mgr.14388) 10754 : audit [DBG] from='client.236988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:57 smithi049 bash[23528]: audit 2024-09-21T02:22:55.761584+0000 mgr.a (mgr.14388) 10754 : audit [DBG] from='client.236988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:22:58.440 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:22:58 smithi179 bash[23186]: cluster 2024-09-21T02:22:56.920458+0000 mgr.a (mgr.14388) 10755 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:22:58 smithi044 bash[22676]: cluster 2024-09-21T02:22:56.920458+0000 mgr.a (mgr.14388) 10755 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:22:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:22:58 smithi049 bash[23528]: cluster 2024-09-21T02:22:56.920458+0000 mgr.a (mgr.14388) 10755 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:00 smithi044 bash[22676]: cluster 2024-09-21T02:22:58.921451+0000 mgr.a (mgr.14388) 10756 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:23:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:00 smithi179 bash[23186]: cluster 2024-09-21T02:22:58.921451+0000 mgr.a (mgr.14388) 10756 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:23:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:00 smithi049 bash[23528]: cluster 2024-09-21T02:22:58.921451+0000 mgr.a (mgr.14388) 10756 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:23:01.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:01.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:01.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:01.961 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:01.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:01.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:01.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:01.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:02 smithi044 bash[22676]: cluster 2024-09-21T02:23:00.923426+0000 mgr.a (mgr.14388) 10757 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:02 smithi179 bash[23186]: cluster 2024-09-21T02:23:00.923426+0000 mgr.a (mgr.14388) 10757 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:02 smithi049 bash[23528]: cluster 2024-09-21T02:23:00.923426+0000 mgr.a (mgr.14388) 10757 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:03 smithi044 bash[22676]: audit 2024-09-21T02:23:01.534458+0000 mgr.a (mgr.14388) 10758 : audit [DBG] from='client.237066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:03 smithi179 bash[23186]: audit 2024-09-21T02:23:01.534458+0000 mgr.a (mgr.14388) 10758 : audit [DBG] from='client.237066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:03 smithi049 bash[23528]: audit 2024-09-21T02:23:01.534458+0000 mgr.a (mgr.14388) 10758 : audit [DBG] from='client.237066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:04.287 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:04 smithi049 bash[23528]: cluster 2024-09-21T02:23:02.924431+0000 mgr.a (mgr.14388) 10759 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:04 smithi044 bash[22676]: cluster 2024-09-21T02:23:02.924431+0000 mgr.a (mgr.14388) 10759 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:04 smithi179 bash[23186]: cluster 2024-09-21T02:23:02.924431+0000 mgr.a (mgr.14388) 10759 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:06.486 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:06 smithi049 bash[23528]: cluster 2024-09-21T02:23:04.925284+0000 mgr.a (mgr.14388) 10760 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:06.486 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:06 smithi049 bash[23528]: audit 2024-09-21T02:23:05.098976+0000 mon.a (mon.0) 8878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.486 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:06 smithi049 bash[23528]: audit 2024-09-21T02:23:05.107202+0000 mon.a (mon.0) 8879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.486 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:06 smithi049 bash[23528]: audit 2024-09-21T02:23:05.115846+0000 mon.a (mon.0) 8880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.486 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:06 smithi049 bash[23528]: audit 2024-09-21T02:23:05.301362+0000 mon.a (mon.0) 8881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.486 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:06 smithi049 bash[23528]: audit 2024-09-21T02:23:05.309562+0000 mon.a (mon.0) 8882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:06 smithi049 bash[23528]: audit 2024-09-21T02:23:05.320083+0000 mon.a (mon.0) 8883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:06 smithi044 bash[22676]: cluster 2024-09-21T02:23:04.925284+0000 mgr.a (mgr.14388) 10760 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:06 smithi044 bash[22676]: audit 2024-09-21T02:23:05.098976+0000 mon.a (mon.0) 8878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:06 smithi044 bash[22676]: audit 2024-09-21T02:23:05.107202+0000 mon.a (mon.0) 8879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:06 smithi044 bash[22676]: audit 2024-09-21T02:23:05.115846+0000 mon.a (mon.0) 8880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:06 smithi044 bash[22676]: audit 2024-09-21T02:23:05.301362+0000 mon.a (mon.0) 8881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:06 smithi044 bash[22676]: audit 2024-09-21T02:23:05.309562+0000 mon.a (mon.0) 8882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:06 smithi044 bash[22676]: audit 2024-09-21T02:23:05.320083+0000 mon.a (mon.0) 8883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:06 smithi179 bash[23186]: cluster 2024-09-21T02:23:04.925284+0000 mgr.a (mgr.14388) 10760 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:06 smithi179 bash[23186]: audit 2024-09-21T02:23:05.098976+0000 mon.a (mon.0) 8878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:06 smithi179 bash[23186]: audit 2024-09-21T02:23:05.107202+0000 mon.a (mon.0) 8879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:06 smithi179 bash[23186]: audit 2024-09-21T02:23:05.115846+0000 mon.a (mon.0) 8880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:06 smithi179 bash[23186]: audit 2024-09-21T02:23:05.301362+0000 mon.a (mon.0) 8881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:06 smithi179 bash[23186]: audit 2024-09-21T02:23:05.309562+0000 mon.a (mon.0) 8882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:06 smithi179 bash[23186]: audit 2024-09-21T02:23:05.320083+0000 mon.a (mon.0) 8883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:06.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:06.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:06.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:07.748 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:07.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:07.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:07.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:07.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:08 smithi044 bash[22676]: cluster 2024-09-21T02:23:06.927505+0000 mgr.a (mgr.14388) 10761 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:08 smithi044 bash[22676]: audit 2024-09-21T02:23:07.299404+0000 mgr.a (mgr.14388) 10762 : audit [DBG] from='client.237144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:08 smithi179 bash[23186]: cluster 2024-09-21T02:23:06.927505+0000 mgr.a (mgr.14388) 10761 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:08 smithi179 bash[23186]: audit 2024-09-21T02:23:07.299404+0000 mgr.a (mgr.14388) 10762 : audit [DBG] from='client.237144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:08 smithi049 bash[23528]: cluster 2024-09-21T02:23:06.927505+0000 mgr.a (mgr.14388) 10761 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:08 smithi049 bash[23528]: audit 2024-09-21T02:23:07.299404+0000 mgr.a (mgr.14388) 10762 : audit [DBG] from='client.237144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:10 smithi044 bash[22676]: cluster 2024-09-21T02:23:08.928509+0000 mgr.a (mgr.14388) 10763 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:10 smithi179 bash[23186]: cluster 2024-09-21T02:23:08.928509+0000 mgr.a (mgr.14388) 10763 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:10 smithi049 bash[23528]: cluster 2024-09-21T02:23:08.928509+0000 mgr.a (mgr.14388) 10763 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:12 smithi044 bash[22676]: cluster 2024-09-21T02:23:10.930831+0000 mgr.a (mgr.14388) 10764 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:12 smithi179 bash[23186]: cluster 2024-09-21T02:23:10.930831+0000 mgr.a (mgr.14388) 10764 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:12 smithi049 bash[23528]: cluster 2024-09-21T02:23:10.930831+0000 mgr.a (mgr.14388) 10764 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:13 smithi044 bash[22676]: audit 2024-09-21T02:23:12.313213+0000 mon.a (mon.0) 8884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:13 smithi044 bash[22676]: audit 2024-09-21T02:23:12.318541+0000 mon.a (mon.0) 8885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:13 smithi044 bash[22676]: audit 2024-09-21T02:23:12.326507+0000 mon.a (mon.0) 8886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.503 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:13.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:13 smithi179 bash[23186]: audit 2024-09-21T02:23:12.313213+0000 mon.a (mon.0) 8884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:13 smithi179 bash[23186]: audit 2024-09-21T02:23:12.318541+0000 mon.a (mon.0) 8885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:13 smithi179 bash[23186]: audit 2024-09-21T02:23:12.326507+0000 mon.a (mon.0) 8886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:13 smithi049 bash[23528]: audit 2024-09-21T02:23:12.313213+0000 mon.a (mon.0) 8884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:13 smithi049 bash[23528]: audit 2024-09-21T02:23:12.318541+0000 mon.a (mon.0) 8885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:13 smithi049 bash[23528]: audit 2024-09-21T02:23:12.326507+0000 mon.a (mon.0) 8886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:14.652 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:14 smithi044 bash[22676]: cluster 2024-09-21T02:23:12.931615+0000 mgr.a (mgr.14388) 10765 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:14.652 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:14 smithi044 bash[22676]: audit 2024-09-21T02:23:13.084103+0000 mgr.a (mgr.14388) 10766 : audit [DBG] from='client.237222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:14 smithi179 bash[23186]: cluster 2024-09-21T02:23:12.931615+0000 mgr.a (mgr.14388) 10765 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:14 smithi179 bash[23186]: audit 2024-09-21T02:23:13.084103+0000 mgr.a (mgr.14388) 10766 : audit [DBG] from='client.237222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:14 smithi049 bash[23528]: cluster 2024-09-21T02:23:12.931615+0000 mgr.a (mgr.14388) 10765 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:14 smithi049 bash[23528]: audit 2024-09-21T02:23:13.084103+0000 mgr.a (mgr.14388) 10766 : audit [DBG] from='client.237222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:16 smithi044 bash[22676]: cluster 2024-09-21T02:23:14.932586+0000 mgr.a (mgr.14388) 10767 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:16 smithi179 bash[23186]: cluster 2024-09-21T02:23:14.932586+0000 mgr.a (mgr.14388) 10767 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:16 smithi049 bash[23528]: cluster 2024-09-21T02:23:14.932586+0000 mgr.a (mgr.14388) 10767 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:17 smithi044 bash[22676]: cluster 2024-09-21T02:23:16.934948+0000 mgr.a (mgr.14388) 10768 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:17 smithi179 bash[23186]: cluster 2024-09-21T02:23:16.934948+0000 mgr.a (mgr.14388) 10768 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:17 smithi049 bash[23528]: cluster 2024-09-21T02:23:16.934948+0000 mgr.a (mgr.14388) 10768 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:18.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:18.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:18.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:19.260 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:19.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:19.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:19.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:19.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:19 smithi179 bash[23186]: audit 2024-09-21T02:23:18.839087+0000 mgr.a (mgr.14388) 10769 : audit [DBG] from='client.237297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:19 smithi179 bash[23186]: cluster 2024-09-21T02:23:18.935489+0000 mgr.a (mgr.14388) 10770 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:19 smithi049 bash[23528]: audit 2024-09-21T02:23:18.839087+0000 mgr.a (mgr.14388) 10769 : audit [DBG] from='client.237297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:19 smithi049 bash[23528]: cluster 2024-09-21T02:23:18.935489+0000 mgr.a (mgr.14388) 10770 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:19 smithi044 bash[22676]: audit 2024-09-21T02:23:18.839087+0000 mgr.a (mgr.14388) 10769 : audit [DBG] from='client.237297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:19 smithi044 bash[22676]: cluster 2024-09-21T02:23:18.935489+0000 mgr.a (mgr.14388) 10770 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:21 smithi179 bash[23186]: cluster 2024-09-21T02:23:20.937844+0000 mgr.a (mgr.14388) 10771 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:21 smithi049 bash[23528]: cluster 2024-09-21T02:23:20.937844+0000 mgr.a (mgr.14388) 10771 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:21 smithi044 bash[22676]: cluster 2024-09-21T02:23:20.937844+0000 mgr.a (mgr.14388) 10771 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:24 smithi179 bash[23186]: cluster 2024-09-21T02:23:22.938685+0000 mgr.a (mgr.14388) 10772 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:24.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:24.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:24.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:24.287 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:24 smithi049 bash[23528]: cluster 2024-09-21T02:23:22.938685+0000 mgr.a (mgr.14388) 10772 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:24 smithi044 bash[22676]: cluster 2024-09-21T02:23:22.938685+0000 mgr.a (mgr.14388) 10772 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:25.027 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:25.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: audit 2024-09-21T02:23:24.596663+0000 mgr.a (mgr.14388) 10773 : audit [DBG] from='client.237375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: cluster 2024-09-21T02:23:24.939258+0000 mgr.a (mgr.14388) 10774 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: audit 2024-09-21T02:23:25.328511+0000 mon.a (mon.0) 8887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: audit 2024-09-21T02:23:25.335627+0000 mon.a (mon.0) 8888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: audit 2024-09-21T02:23:25.342702+0000 mon.a (mon.0) 8889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: audit 2024-09-21T02:23:25.506812+0000 mon.a (mon.0) 8890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: audit 2024-09-21T02:23:25.515091+0000 mon.a (mon.0) 8891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:26 smithi049 bash[23528]: audit 2024-09-21T02:23:25.524905+0000 mon.a (mon.0) 8892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: audit 2024-09-21T02:23:24.596663+0000 mgr.a (mgr.14388) 10773 : audit [DBG] from='client.237375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: cluster 2024-09-21T02:23:24.939258+0000 mgr.a (mgr.14388) 10774 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: audit 2024-09-21T02:23:25.328511+0000 mon.a (mon.0) 8887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: audit 2024-09-21T02:23:25.335627+0000 mon.a (mon.0) 8888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: audit 2024-09-21T02:23:25.342702+0000 mon.a (mon.0) 8889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: audit 2024-09-21T02:23:25.506812+0000 mon.a (mon.0) 8890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: audit 2024-09-21T02:23:25.515091+0000 mon.a (mon.0) 8891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:26 smithi044 bash[22676]: audit 2024-09-21T02:23:25.524905+0000 mon.a (mon.0) 8892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: audit 2024-09-21T02:23:24.596663+0000 mgr.a (mgr.14388) 10773 : audit [DBG] from='client.237375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: cluster 2024-09-21T02:23:24.939258+0000 mgr.a (mgr.14388) 10774 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: audit 2024-09-21T02:23:25.328511+0000 mon.a (mon.0) 8887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: audit 2024-09-21T02:23:25.335627+0000 mon.a (mon.0) 8888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: audit 2024-09-21T02:23:25.342702+0000 mon.a (mon.0) 8889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: audit 2024-09-21T02:23:25.506812+0000 mon.a (mon.0) 8890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: audit 2024-09-21T02:23:25.515091+0000 mon.a (mon.0) 8891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:26 smithi179 bash[23186]: audit 2024-09-21T02:23:25.524905+0000 mon.a (mon.0) 8892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:28 smithi049 bash[23528]: cluster 2024-09-21T02:23:26.941497+0000 mgr.a (mgr.14388) 10775 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:23:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:28 smithi044 bash[22676]: cluster 2024-09-21T02:23:26.941497+0000 mgr.a (mgr.14388) 10775 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:23:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:28 smithi179 bash[23186]: cluster 2024-09-21T02:23:26.941497+0000 mgr.a (mgr.14388) 10775 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:23:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:29 smithi044 bash[22676]: cluster 2024-09-21T02:23:28.942276+0000 mgr.a (mgr.14388) 10776 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:23:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:29 smithi179 bash[23186]: cluster 2024-09-21T02:23:28.942276+0000 mgr.a (mgr.14388) 10776 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:23:30.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:30.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:30.030 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:29 smithi049 bash[23528]: cluster 2024-09-21T02:23:28.942276+0000 mgr.a (mgr.14388) 10776 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:23:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:30.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:30.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:30.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:30.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:32 smithi179 bash[23186]: audit 2024-09-21T02:23:30.366934+0000 mgr.a (mgr.14388) 10777 : audit [DBG] from='client.237450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:32 smithi179 bash[23186]: cluster 2024-09-21T02:23:30.945062+0000 mgr.a (mgr.14388) 10778 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:32 smithi049 bash[23528]: audit 2024-09-21T02:23:30.366934+0000 mgr.a (mgr.14388) 10777 : audit [DBG] from='client.237450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:32 smithi049 bash[23528]: cluster 2024-09-21T02:23:30.945062+0000 mgr.a (mgr.14388) 10778 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:32 smithi044 bash[22676]: audit 2024-09-21T02:23:30.366934+0000 mgr.a (mgr.14388) 10777 : audit [DBG] from='client.237450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:32 smithi044 bash[22676]: cluster 2024-09-21T02:23:30.945062+0000 mgr.a (mgr.14388) 10778 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:33 smithi049 bash[23528]: audit 2024-09-21T02:23:32.540363+0000 mon.a (mon.0) 8893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:33 smithi049 bash[23528]: audit 2024-09-21T02:23:32.549124+0000 mon.a (mon.0) 8894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:33 smithi049 bash[23528]: audit 2024-09-21T02:23:32.559487+0000 mon.a (mon.0) 8895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:33 smithi049 bash[23528]: cluster 2024-09-21T02:23:32.945777+0000 mgr.a (mgr.14388) 10779 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:23:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:33 smithi044 bash[22676]: audit 2024-09-21T02:23:32.540363+0000 mon.a (mon.0) 8893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:33 smithi044 bash[22676]: audit 2024-09-21T02:23:32.549124+0000 mon.a (mon.0) 8894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:33 smithi044 bash[22676]: audit 2024-09-21T02:23:32.559487+0000 mon.a (mon.0) 8895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:33 smithi044 bash[22676]: cluster 2024-09-21T02:23:32.945777+0000 mgr.a (mgr.14388) 10779 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:23:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:33 smithi179 bash[23186]: audit 2024-09-21T02:23:32.540363+0000 mon.a (mon.0) 8893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:33 smithi179 bash[23186]: audit 2024-09-21T02:23:32.549124+0000 mon.a (mon.0) 8894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:34.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:33 smithi179 bash[23186]: audit 2024-09-21T02:23:32.559487+0000 mon.a (mon.0) 8895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:33 smithi179 bash[23186]: cluster 2024-09-21T02:23:32.945777+0000 mgr.a (mgr.14388) 10779 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:23:35.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:35.797 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:35.797 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:36 smithi049 bash[23528]: cluster 2024-09-21T02:23:34.946499+0000 mgr.a (mgr.14388) 10780 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:23:36.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:36 smithi044 bash[22676]: cluster 2024-09-21T02:23:34.946499+0000 mgr.a (mgr.14388) 10780 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:23:36.366 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:36 smithi179 bash[23186]: cluster 2024-09-21T02:23:34.946499+0000 mgr.a (mgr.14388) 10780 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:23:36.555 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:36.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:36.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:36.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:36.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:37 smithi179 bash[23186]: audit 2024-09-21T02:23:36.130385+0000 mgr.a (mgr.14388) 10781 : audit [DBG] from='client.237525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:37 smithi049 bash[23528]: audit 2024-09-21T02:23:36.130385+0000 mgr.a (mgr.14388) 10781 : audit [DBG] from='client.237525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:37 smithi044 bash[22676]: audit 2024-09-21T02:23:36.130385+0000 mgr.a (mgr.14388) 10781 : audit [DBG] from='client.237525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:38 smithi179 bash[23186]: cluster 2024-09-21T02:23:36.949591+0000 mgr.a (mgr.14388) 10782 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:38 smithi049 bash[23528]: cluster 2024-09-21T02:23:36.949591+0000 mgr.a (mgr.14388) 10782 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:38 smithi044 bash[22676]: cluster 2024-09-21T02:23:36.949591+0000 mgr.a (mgr.14388) 10782 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:40 smithi049 bash[23528]: cluster 2024-09-21T02:23:38.950448+0000 mgr.a (mgr.14388) 10783 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:23:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:40 smithi044 bash[22676]: cluster 2024-09-21T02:23:38.950448+0000 mgr.a (mgr.14388) 10783 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:23:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:40 smithi179 bash[23186]: cluster 2024-09-21T02:23:38.950448+0000 mgr.a (mgr.14388) 10783 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:23:41.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:42 smithi049 bash[23528]: cluster 2024-09-21T02:23:40.952469+0000 mgr.a (mgr.14388) 10784 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:23:42.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:42.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:42.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:42.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:42.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:42 smithi044 bash[22676]: cluster 2024-09-21T02:23:40.952469+0000 mgr.a (mgr.14388) 10784 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:23:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:42 smithi179 bash[23186]: cluster 2024-09-21T02:23:40.952469+0000 mgr.a (mgr.14388) 10784 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:23:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:43 smithi049 bash[23528]: audit 2024-09-21T02:23:41.894229+0000 mgr.a (mgr.14388) 10785 : audit [DBG] from='client.237603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:43 smithi044 bash[22676]: audit 2024-09-21T02:23:41.894229+0000 mgr.a (mgr.14388) 10785 : audit [DBG] from='client.237603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:43.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:43 smithi179 bash[23186]: audit 2024-09-21T02:23:41.894229+0000 mgr.a (mgr.14388) 10785 : audit [DBG] from='client.237603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:44 smithi049 bash[23528]: cluster 2024-09-21T02:23:42.953542+0000 mgr.a (mgr.14388) 10786 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:44 smithi044 bash[22676]: cluster 2024-09-21T02:23:42.953542+0000 mgr.a (mgr.14388) 10786 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:44 smithi179 bash[23186]: cluster 2024-09-21T02:23:42.953542+0000 mgr.a (mgr.14388) 10786 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:46 smithi049 bash[23528]: cluster 2024-09-21T02:23:44.954276+0000 mgr.a (mgr.14388) 10787 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:46 smithi049 bash[23528]: audit 2024-09-21T02:23:45.542993+0000 mon.a (mon.0) 8896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:46 smithi049 bash[23528]: audit 2024-09-21T02:23:45.548967+0000 mon.a (mon.0) 8897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:46 smithi049 bash[23528]: audit 2024-09-21T02:23:45.556024+0000 mon.a (mon.0) 8898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:46 smithi049 bash[23528]: audit 2024-09-21T02:23:45.705597+0000 mon.a (mon.0) 8899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:46 smithi049 bash[23528]: audit 2024-09-21T02:23:45.713716+0000 mon.a (mon.0) 8900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:46 smithi049 bash[23528]: audit 2024-09-21T02:23:45.723498+0000 mon.a (mon.0) 8901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:46 smithi044 bash[22676]: cluster 2024-09-21T02:23:44.954276+0000 mgr.a (mgr.14388) 10787 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:46 smithi044 bash[22676]: audit 2024-09-21T02:23:45.542993+0000 mon.a (mon.0) 8896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:46 smithi044 bash[22676]: audit 2024-09-21T02:23:45.548967+0000 mon.a (mon.0) 8897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:46 smithi044 bash[22676]: audit 2024-09-21T02:23:45.556024+0000 mon.a (mon.0) 8898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:46 smithi044 bash[22676]: audit 2024-09-21T02:23:45.705597+0000 mon.a (mon.0) 8899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:46 smithi044 bash[22676]: audit 2024-09-21T02:23:45.713716+0000 mon.a (mon.0) 8900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:46 smithi044 bash[22676]: audit 2024-09-21T02:23:45.723498+0000 mon.a (mon.0) 8901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:46 smithi179 bash[23186]: cluster 2024-09-21T02:23:44.954276+0000 mgr.a (mgr.14388) 10787 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:46 smithi179 bash[23186]: audit 2024-09-21T02:23:45.542993+0000 mon.a (mon.0) 8896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:46 smithi179 bash[23186]: audit 2024-09-21T02:23:45.548967+0000 mon.a (mon.0) 8897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:46 smithi179 bash[23186]: audit 2024-09-21T02:23:45.556024+0000 mon.a (mon.0) 8898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:46 smithi179 bash[23186]: audit 2024-09-21T02:23:45.705597+0000 mon.a (mon.0) 8899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:46 smithi179 bash[23186]: audit 2024-09-21T02:23:45.713716+0000 mon.a (mon.0) 8900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:46 smithi179 bash[23186]: audit 2024-09-21T02:23:45.723498+0000 mon.a (mon.0) 8901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:48.111 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:48.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:48.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:48.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:48.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:48 smithi049 bash[23528]: cluster 2024-09-21T02:23:46.956518+0000 mgr.a (mgr.14388) 10788 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:48 smithi044 bash[22676]: cluster 2024-09-21T02:23:46.956518+0000 mgr.a (mgr.14388) 10788 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:48 smithi179 bash[23186]: cluster 2024-09-21T02:23:46.956518+0000 mgr.a (mgr.14388) 10788 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:49 smithi044 bash[22676]: audit 2024-09-21T02:23:47.673895+0000 mgr.a (mgr.14388) 10789 : audit [DBG] from='client.237678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:49 smithi179 bash[23186]: audit 2024-09-21T02:23:47.673895+0000 mgr.a (mgr.14388) 10789 : audit [DBG] from='client.237678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:49 smithi049 bash[23528]: audit 2024-09-21T02:23:47.673895+0000 mgr.a (mgr.14388) 10789 : audit [DBG] from='client.237678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:50 smithi044 bash[22676]: cluster 2024-09-21T02:23:48.957529+0000 mgr.a (mgr.14388) 10790 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:50 smithi179 bash[23186]: cluster 2024-09-21T02:23:48.957529+0000 mgr.a (mgr.14388) 10790 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:50 smithi049 bash[23528]: cluster 2024-09-21T02:23:48.957529+0000 mgr.a (mgr.14388) 10790 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:52 smithi044 bash[22676]: cluster 2024-09-21T02:23:50.959778+0000 mgr.a (mgr.14388) 10791 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:52 smithi179 bash[23186]: cluster 2024-09-21T02:23:50.959778+0000 mgr.a (mgr.14388) 10791 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:52 smithi049 bash[23528]: cluster 2024-09-21T02:23:50.959778+0000 mgr.a (mgr.14388) 10791 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:23:53.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:53.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:53.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:53.902 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:53.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:53.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:53.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:53.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:23:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:53 smithi049 bash[23528]: audit 2024-09-21T02:23:52.772030+0000 mon.a (mon.0) 8902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:53 smithi049 bash[23528]: audit 2024-09-21T02:23:52.782877+0000 mon.a (mon.0) 8903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:53 smithi049 bash[23528]: audit 2024-09-21T02:23:52.795662+0000 mon.a (mon.0) 8904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:53 smithi049 bash[23528]: cluster 2024-09-21T02:23:52.960542+0000 mgr.a (mgr.14388) 10792 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:53 smithi049 bash[23528]: audit 2024-09-21T02:23:53.291869+0000 mon.a (mon.0) 8905 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:23:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:53 smithi044 bash[22676]: audit 2024-09-21T02:23:52.772030+0000 mon.a (mon.0) 8902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:53 smithi044 bash[22676]: audit 2024-09-21T02:23:52.782877+0000 mon.a (mon.0) 8903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:53 smithi044 bash[22676]: audit 2024-09-21T02:23:52.795662+0000 mon.a (mon.0) 8904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:53 smithi044 bash[22676]: cluster 2024-09-21T02:23:52.960542+0000 mgr.a (mgr.14388) 10792 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:53 smithi044 bash[22676]: audit 2024-09-21T02:23:53.291869+0000 mon.a (mon.0) 8905 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:23:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:53 smithi179 bash[23186]: audit 2024-09-21T02:23:52.772030+0000 mon.a (mon.0) 8902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:53 smithi179 bash[23186]: audit 2024-09-21T02:23:52.782877+0000 mon.a (mon.0) 8903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:53 smithi179 bash[23186]: audit 2024-09-21T02:23:52.795662+0000 mon.a (mon.0) 8904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:53 smithi179 bash[23186]: cluster 2024-09-21T02:23:52.960542+0000 mgr.a (mgr.14388) 10792 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:53 smithi179 bash[23186]: audit 2024-09-21T02:23:53.291869+0000 mon.a (mon.0) 8905 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:23:54.912 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22930]: debug 2024-09-21T02:23:54.651+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:23:54.912 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22930]: debug 2024-09-21T02:23:54.651+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:23:54.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.464960+0000 mgr.a (mgr.14388) 10793 : audit [DBG] from='client.237756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:54.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.898505+0000 mon.a (mon.0) 8906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.905999+0000 mon.a (mon.0) 8907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.922188+0000 mon.a (mon.0) 8908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.928514+0000 mon.a (mon.0) 8909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.929464+0000 mon.a (mon.0) 8910 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:23:54.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.930062+0000 mon.a (mon.0) 8911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:23:54.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.935244+0000 mon.a (mon.0) 8912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:54.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.937604+0000 mon.a (mon.0) 8913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:23:54.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:54 smithi044 bash[22676]: audit 2024-09-21T02:23:53.938621+0000 mgr.a (mgr.14388) 10794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:23:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.464960+0000 mgr.a (mgr.14388) 10793 : audit [DBG] from='client.237756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.898505+0000 mon.a (mon.0) 8906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.905999+0000 mon.a (mon.0) 8907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.922188+0000 mon.a (mon.0) 8908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.928514+0000 mon.a (mon.0) 8909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.929464+0000 mon.a (mon.0) 8910 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:23:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.930062+0000 mon.a (mon.0) 8911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:23:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.935244+0000 mon.a (mon.0) 8912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.937604+0000 mon.a (mon.0) 8913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:23:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:54 smithi179 bash[23186]: audit 2024-09-21T02:23:53.938621+0000 mgr.a (mgr.14388) 10794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:23:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.464960+0000 mgr.a (mgr.14388) 10793 : audit [DBG] from='client.237756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:23:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.898505+0000 mon.a (mon.0) 8906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.905999+0000 mon.a (mon.0) 8907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.922188+0000 mon.a (mon.0) 8908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.928514+0000 mon.a (mon.0) 8909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.929464+0000 mon.a (mon.0) 8910 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:23:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.930062+0000 mon.a (mon.0) 8911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:23:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.935244+0000 mon.a (mon.0) 8912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:23:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.937604+0000 mon.a (mon.0) 8913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:23:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:54 smithi049 bash[23528]: audit 2024-09-21T02:23:53.938621+0000 mgr.a (mgr.14388) 10794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:23:56.175 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:55 smithi179 bash[23186]: audit 2024-09-21T02:23:54.655371+0000 mgr.a (mgr.14388) 10795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:23:56.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:55 smithi179 bash[23186]: cephadm 2024-09-21T02:23:54.656792+0000 mgr.a (mgr.14388) 10796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:23:56.176 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:55 smithi179 bash[23186]: cluster 2024-09-21T02:23:54.961054+0000 mgr.a (mgr.14388) 10797 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:55 smithi044 bash[22676]: audit 2024-09-21T02:23:54.655371+0000 mgr.a (mgr.14388) 10795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:23:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:55 smithi044 bash[22676]: cephadm 2024-09-21T02:23:54.656792+0000 mgr.a (mgr.14388) 10796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:23:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:55 smithi044 bash[22676]: cluster 2024-09-21T02:23:54.961054+0000 mgr.a (mgr.14388) 10797 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:55 smithi049 bash[23528]: audit 2024-09-21T02:23:54.655371+0000 mgr.a (mgr.14388) 10795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:23:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:55 smithi049 bash[23528]: cephadm 2024-09-21T02:23:54.656792+0000 mgr.a (mgr.14388) 10796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:23:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:55 smithi049 bash[23528]: cluster 2024-09-21T02:23:54.961054+0000 mgr.a (mgr.14388) 10797 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:23:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:23:58 smithi179 bash[23186]: cluster 2024-09-21T02:23:56.962450+0000 mgr.a (mgr.14388) 10798 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:23:58 smithi049 bash[23528]: cluster 2024-09-21T02:23:56.962450+0000 mgr.a (mgr.14388) 10798 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:23:58 smithi044 bash[22676]: cluster 2024-09-21T02:23:56.962450+0000 mgr.a (mgr.14388) 10798 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:23:58.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:23:58.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:23:58.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:23:59.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:23:59.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:23:59.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:23:59.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:23:59.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:00 smithi049 bash[23528]: cluster 2024-09-21T02:23:58.963054+0000 mgr.a (mgr.14388) 10799 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:00 smithi049 bash[23528]: audit 2024-09-21T02:23:59.239205+0000 mgr.a (mgr.14388) 10800 : audit [DBG] from='client.237939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:00 smithi044 bash[22676]: cluster 2024-09-21T02:23:58.963054+0000 mgr.a (mgr.14388) 10799 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:00 smithi044 bash[22676]: audit 2024-09-21T02:23:59.239205+0000 mgr.a (mgr.14388) 10800 : audit [DBG] from='client.237939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:00 smithi179 bash[23186]: cluster 2024-09-21T02:23:58.963054+0000 mgr.a (mgr.14388) 10799 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:00 smithi179 bash[23186]: audit 2024-09-21T02:23:59.239205+0000 mgr.a (mgr.14388) 10800 : audit [DBG] from='client.237939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:02 smithi049 bash[23528]: cluster 2024-09-21T02:24:00.965441+0000 mgr.a (mgr.14388) 10801 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:02 smithi044 bash[22676]: cluster 2024-09-21T02:24:00.965441+0000 mgr.a (mgr.14388) 10801 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:02 smithi179 bash[23186]: cluster 2024-09-21T02:24:00.965441+0000 mgr.a (mgr.14388) 10801 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:04 smithi049 bash[23528]: cluster 2024-09-21T02:24:02.966343+0000 mgr.a (mgr.14388) 10802 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:04 smithi044 bash[22676]: cluster 2024-09-21T02:24:02.966343+0000 mgr.a (mgr.14388) 10802 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:04 smithi179 bash[23186]: cluster 2024-09-21T02:24:02.966343+0000 mgr.a (mgr.14388) 10802 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:04.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:04.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:04.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:05.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:05.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:05.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: cluster 2024-09-21T02:24:04.967080+0000 mgr.a (mgr.14388) 10803 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: audit 2024-09-21T02:24:05.001135+0000 mgr.a (mgr.14388) 10804 : audit [DBG] from='client.238014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: audit 2024-09-21T02:24:05.755273+0000 mon.a (mon.0) 8914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: audit 2024-09-21T02:24:05.761836+0000 mon.a (mon.0) 8915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: audit 2024-09-21T02:24:05.769524+0000 mon.a (mon.0) 8916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: audit 2024-09-21T02:24:05.887509+0000 mon.a (mon.0) 8917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: audit 2024-09-21T02:24:05.894850+0000 mon.a (mon.0) 8918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:06 smithi044 bash[22676]: audit 2024-09-21T02:24:05.901429+0000 mon.a (mon.0) 8919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: cluster 2024-09-21T02:24:04.967080+0000 mgr.a (mgr.14388) 10803 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: audit 2024-09-21T02:24:05.001135+0000 mgr.a (mgr.14388) 10804 : audit [DBG] from='client.238014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: audit 2024-09-21T02:24:05.755273+0000 mon.a (mon.0) 8914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: audit 2024-09-21T02:24:05.761836+0000 mon.a (mon.0) 8915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: audit 2024-09-21T02:24:05.769524+0000 mon.a (mon.0) 8916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: audit 2024-09-21T02:24:05.887509+0000 mon.a (mon.0) 8917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: audit 2024-09-21T02:24:05.894850+0000 mon.a (mon.0) 8918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:06 smithi049 bash[23528]: audit 2024-09-21T02:24:05.901429+0000 mon.a (mon.0) 8919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: cluster 2024-09-21T02:24:04.967080+0000 mgr.a (mgr.14388) 10803 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: audit 2024-09-21T02:24:05.001135+0000 mgr.a (mgr.14388) 10804 : audit [DBG] from='client.238014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: audit 2024-09-21T02:24:05.755273+0000 mon.a (mon.0) 8914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: audit 2024-09-21T02:24:05.761836+0000 mon.a (mon.0) 8915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: audit 2024-09-21T02:24:05.769524+0000 mon.a (mon.0) 8916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: audit 2024-09-21T02:24:05.887509+0000 mon.a (mon.0) 8917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: audit 2024-09-21T02:24:05.894850+0000 mon.a (mon.0) 8918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:06 smithi179 bash[23186]: audit 2024-09-21T02:24:05.901429+0000 mon.a (mon.0) 8919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:08 smithi049 bash[23528]: cluster 2024-09-21T02:24:06.969789+0000 mgr.a (mgr.14388) 10805 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:08 smithi044 bash[22676]: cluster 2024-09-21T02:24:06.969789+0000 mgr.a (mgr.14388) 10805 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:08 smithi179 bash[23186]: cluster 2024-09-21T02:24:06.969789+0000 mgr.a (mgr.14388) 10805 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:24:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:10 smithi049 bash[23528]: cluster 2024-09-21T02:24:08.970521+0000 mgr.a (mgr.14388) 10806 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:10.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:10 smithi044 bash[22676]: cluster 2024-09-21T02:24:08.970521+0000 mgr.a (mgr.14388) 10806 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:10 smithi179 bash[23186]: cluster 2024-09-21T02:24:08.970521+0000 mgr.a (mgr.14388) 10806 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:11.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:12 smithi049 bash[23528]: audit 2024-09-21T02:24:10.753638+0000 mgr.a (mgr.14388) 10807 : audit [DBG] from='client.238089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:12 smithi049 bash[23528]: cluster 2024-09-21T02:24:10.971835+0000 mgr.a (mgr.14388) 10808 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:12 smithi044 bash[22676]: audit 2024-09-21T02:24:10.753638+0000 mgr.a (mgr.14388) 10807 : audit [DBG] from='client.238089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:12 smithi044 bash[22676]: cluster 2024-09-21T02:24:10.971835+0000 mgr.a (mgr.14388) 10808 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:12 smithi179 bash[23186]: audit 2024-09-21T02:24:10.753638+0000 mgr.a (mgr.14388) 10807 : audit [DBG] from='client.238089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:12 smithi179 bash[23186]: cluster 2024-09-21T02:24:10.971835+0000 mgr.a (mgr.14388) 10808 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:13 smithi179 bash[23186]: cluster 2024-09-21T02:24:12.972695+0000 mgr.a (mgr.14388) 10809 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:13 smithi179 bash[23186]: audit 2024-09-21T02:24:12.997947+0000 mon.a (mon.0) 8920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:13 smithi179 bash[23186]: audit 2024-09-21T02:24:13.006615+0000 mon.a (mon.0) 8921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:13 smithi179 bash[23186]: audit 2024-09-21T02:24:13.017105+0000 mon.a (mon.0) 8922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:13 smithi049 bash[23528]: cluster 2024-09-21T02:24:12.972695+0000 mgr.a (mgr.14388) 10809 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:13 smithi049 bash[23528]: audit 2024-09-21T02:24:12.997947+0000 mon.a (mon.0) 8920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:13 smithi049 bash[23528]: audit 2024-09-21T02:24:13.006615+0000 mon.a (mon.0) 8921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:13 smithi049 bash[23528]: audit 2024-09-21T02:24:13.017105+0000 mon.a (mon.0) 8922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:13 smithi044 bash[22676]: cluster 2024-09-21T02:24:12.972695+0000 mgr.a (mgr.14388) 10809 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:13 smithi044 bash[22676]: audit 2024-09-21T02:24:12.997947+0000 mon.a (mon.0) 8920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:13 smithi044 bash[22676]: audit 2024-09-21T02:24:13.006615+0000 mon.a (mon.0) 8921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:13 smithi044 bash[22676]: audit 2024-09-21T02:24:13.017105+0000 mon.a (mon.0) 8922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:16.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:16.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:16.206 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:16 smithi044 bash[22676]: cluster 2024-09-21T02:24:14.973200+0000 mgr.a (mgr.14388) 10810 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:24:16.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:16 smithi179 bash[23186]: cluster 2024-09-21T02:24:14.973200+0000 mgr.a (mgr.14388) 10810 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:24:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:16 smithi049 bash[23528]: cluster 2024-09-21T02:24:14.973200+0000 mgr.a (mgr.14388) 10810 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:24:16.995 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:16.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:16.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:16.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:16.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:18 smithi049 bash[23528]: audit 2024-09-21T02:24:16.542171+0000 mgr.a (mgr.14388) 10811 : audit [DBG] from='client.238167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:18 smithi049 bash[23528]: cluster 2024-09-21T02:24:16.974802+0000 mgr.a (mgr.14388) 10812 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:18 smithi044 bash[22676]: audit 2024-09-21T02:24:16.542171+0000 mgr.a (mgr.14388) 10811 : audit [DBG] from='client.238167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:18 smithi044 bash[22676]: cluster 2024-09-21T02:24:16.974802+0000 mgr.a (mgr.14388) 10812 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:18 smithi179 bash[23186]: audit 2024-09-21T02:24:16.542171+0000 mgr.a (mgr.14388) 10811 : audit [DBG] from='client.238167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:18 smithi179 bash[23186]: cluster 2024-09-21T02:24:16.974802+0000 mgr.a (mgr.14388) 10812 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:20 smithi049 bash[23528]: cluster 2024-09-21T02:24:18.975715+0000 mgr.a (mgr.14388) 10813 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:20 smithi044 bash[22676]: cluster 2024-09-21T02:24:18.975715+0000 mgr.a (mgr.14388) 10813 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:20 smithi179 bash[23186]: cluster 2024-09-21T02:24:18.975715+0000 mgr.a (mgr.14388) 10813 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:22 smithi049 bash[23528]: cluster 2024-09-21T02:24:20.977729+0000 mgr.a (mgr.14388) 10814 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:22 smithi044 bash[22676]: cluster 2024-09-21T02:24:20.977729+0000 mgr.a (mgr.14388) 10814 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:22 smithi179 bash[23186]: cluster 2024-09-21T02:24:20.977729+0000 mgr.a (mgr.14388) 10814 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:22.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:22.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:22.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:22.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:22.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:24 smithi049 bash[23528]: audit 2024-09-21T02:24:22.340897+0000 mgr.a (mgr.14388) 10815 : audit [DBG] from='client.238242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:24 smithi049 bash[23528]: cluster 2024-09-21T02:24:22.978678+0000 mgr.a (mgr.14388) 10816 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:24 smithi044 bash[22676]: audit 2024-09-21T02:24:22.340897+0000 mgr.a (mgr.14388) 10815 : audit [DBG] from='client.238242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:24 smithi044 bash[22676]: cluster 2024-09-21T02:24:22.978678+0000 mgr.a (mgr.14388) 10816 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:24 smithi179 bash[23186]: audit 2024-09-21T02:24:22.340897+0000 mgr.a (mgr.14388) 10815 : audit [DBG] from='client.238242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:24 smithi179 bash[23186]: cluster 2024-09-21T02:24:22.978678+0000 mgr.a (mgr.14388) 10816 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:26 smithi179 bash[23186]: cluster 2024-09-21T02:24:24.979479+0000 mgr.a (mgr.14388) 10817 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:26 smithi179 bash[23186]: audit 2024-09-21T02:24:25.967534+0000 mon.a (mon.0) 8923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:26 smithi179 bash[23186]: audit 2024-09-21T02:24:25.975129+0000 mon.a (mon.0) 8924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:26 smithi179 bash[23186]: audit 2024-09-21T02:24:25.984925+0000 mon.a (mon.0) 8925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:26 smithi049 bash[23528]: cluster 2024-09-21T02:24:24.979479+0000 mgr.a (mgr.14388) 10817 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:26 smithi049 bash[23528]: audit 2024-09-21T02:24:25.967534+0000 mon.a (mon.0) 8923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:26 smithi049 bash[23528]: audit 2024-09-21T02:24:25.975129+0000 mon.a (mon.0) 8924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:26 smithi049 bash[23528]: audit 2024-09-21T02:24:25.984925+0000 mon.a (mon.0) 8925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:26 smithi044 bash[22676]: cluster 2024-09-21T02:24:24.979479+0000 mgr.a (mgr.14388) 10817 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:26 smithi044 bash[22676]: audit 2024-09-21T02:24:25.967534+0000 mon.a (mon.0) 8923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:26 smithi044 bash[22676]: audit 2024-09-21T02:24:25.975129+0000 mon.a (mon.0) 8924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:26 smithi044 bash[22676]: audit 2024-09-21T02:24:25.984925+0000 mon.a (mon.0) 8925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:27 smithi044 bash[22676]: audit 2024-09-21T02:24:26.086174+0000 mon.a (mon.0) 8926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:27 smithi044 bash[22676]: audit 2024-09-21T02:24:26.091810+0000 mon.a (mon.0) 8927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:27 smithi044 bash[22676]: audit 2024-09-21T02:24:26.097957+0000 mon.a (mon.0) 8928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:27 smithi179 bash[23186]: audit 2024-09-21T02:24:26.086174+0000 mon.a (mon.0) 8926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:27 smithi179 bash[23186]: audit 2024-09-21T02:24:26.091810+0000 mon.a (mon.0) 8927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:27 smithi179 bash[23186]: audit 2024-09-21T02:24:26.097957+0000 mon.a (mon.0) 8928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:27 smithi049 bash[23528]: audit 2024-09-21T02:24:26.086174+0000 mon.a (mon.0) 8926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:27 smithi049 bash[23528]: audit 2024-09-21T02:24:26.091810+0000 mon.a (mon.0) 8927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.504 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:27 smithi049 bash[23528]: audit 2024-09-21T02:24:26.097957+0000 mon.a (mon.0) 8928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:27.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:27.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:27.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:28.465 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:28 smithi049 bash[23528]: cluster 2024-09-21T02:24:26.981731+0000 mgr.a (mgr.14388) 10818 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:28 smithi044 bash[22676]: cluster 2024-09-21T02:24:26.981731+0000 mgr.a (mgr.14388) 10818 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:28 smithi179 bash[23186]: cluster 2024-09-21T02:24:26.981731+0000 mgr.a (mgr.14388) 10818 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:28.537 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:29 smithi044 bash[22676]: audit 2024-09-21T02:24:28.117719+0000 mgr.a (mgr.14388) 10819 : audit [DBG] from='client.238320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:29 smithi179 bash[23186]: audit 2024-09-21T02:24:28.117719+0000 mgr.a (mgr.14388) 10819 : audit [DBG] from='client.238320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:29 smithi049 bash[23528]: audit 2024-09-21T02:24:28.117719+0000 mgr.a (mgr.14388) 10819 : audit [DBG] from='client.238320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:30 smithi044 bash[22676]: cluster 2024-09-21T02:24:28.982936+0000 mgr.a (mgr.14388) 10820 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:30 smithi179 bash[23186]: cluster 2024-09-21T02:24:28.982936+0000 mgr.a (mgr.14388) 10820 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:30 smithi049 bash[23528]: cluster 2024-09-21T02:24:28.982936+0000 mgr.a (mgr.14388) 10820 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:32 smithi044 bash[22676]: cluster 2024-09-21T02:24:30.985356+0000 mgr.a (mgr.14388) 10821 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:32 smithi179 bash[23186]: cluster 2024-09-21T02:24:30.985356+0000 mgr.a (mgr.14388) 10821 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:32 smithi049 bash[23528]: cluster 2024-09-21T02:24:30.985356+0000 mgr.a (mgr.14388) 10821 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:33.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:33.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:34.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:34 smithi044 bash[22676]: cluster 2024-09-21T02:24:32.986179+0000 mgr.a (mgr.14388) 10822 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:34 smithi044 bash[22676]: audit 2024-09-21T02:24:33.231479+0000 mon.a (mon.0) 8929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:34 smithi044 bash[22676]: audit 2024-09-21T02:24:33.240116+0000 mon.a (mon.0) 8930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:34 smithi044 bash[22676]: audit 2024-09-21T02:24:33.250276+0000 mon.a (mon.0) 8931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:34 smithi179 bash[23186]: cluster 2024-09-21T02:24:32.986179+0000 mgr.a (mgr.14388) 10822 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:34 smithi179 bash[23186]: audit 2024-09-21T02:24:33.231479+0000 mon.a (mon.0) 8929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:34 smithi179 bash[23186]: audit 2024-09-21T02:24:33.240116+0000 mon.a (mon.0) 8930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:34 smithi179 bash[23186]: audit 2024-09-21T02:24:33.250276+0000 mon.a (mon.0) 8931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:34 smithi049 bash[23528]: cluster 2024-09-21T02:24:32.986179+0000 mgr.a (mgr.14388) 10822 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:34 smithi049 bash[23528]: audit 2024-09-21T02:24:33.231479+0000 mon.a (mon.0) 8929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:34 smithi049 bash[23528]: audit 2024-09-21T02:24:33.240116+0000 mon.a (mon.0) 8930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:34 smithi049 bash[23528]: audit 2024-09-21T02:24:33.250276+0000 mon.a (mon.0) 8931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:35.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:35 smithi044 bash[22676]: audit 2024-09-21T02:24:33.876549+0000 mgr.a (mgr.14388) 10823 : audit [DBG] from='client.238398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:35.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:35 smithi179 bash[23186]: audit 2024-09-21T02:24:33.876549+0000 mgr.a (mgr.14388) 10823 : audit [DBG] from='client.238398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:35 smithi049 bash[23528]: audit 2024-09-21T02:24:33.876549+0000 mgr.a (mgr.14388) 10823 : audit [DBG] from='client.238398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:36.495 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:36 smithi179 bash[23186]: cluster 2024-09-21T02:24:34.987237+0000 mgr.a (mgr.14388) 10824 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:36 smithi049 bash[23528]: cluster 2024-09-21T02:24:34.987237+0000 mgr.a (mgr.14388) 10824 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:36 smithi044 bash[22676]: cluster 2024-09-21T02:24:34.987237+0000 mgr.a (mgr.14388) 10824 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:38 smithi179 bash[23186]: cluster 2024-09-21T02:24:36.989645+0000 mgr.a (mgr.14388) 10825 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:38 smithi049 bash[23528]: cluster 2024-09-21T02:24:36.989645+0000 mgr.a (mgr.14388) 10825 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:38 smithi044 bash[22676]: cluster 2024-09-21T02:24:36.989645+0000 mgr.a (mgr.14388) 10825 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:24:39.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:39.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:39.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:40.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:40 smithi179 bash[23186]: cluster 2024-09-21T02:24:38.990407+0000 mgr.a (mgr.14388) 10826 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:40 smithi049 bash[23528]: cluster 2024-09-21T02:24:38.990407+0000 mgr.a (mgr.14388) 10826 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:40 smithi044 bash[22676]: cluster 2024-09-21T02:24:38.990407+0000 mgr.a (mgr.14388) 10826 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:41 smithi049 bash[23528]: audit 2024-09-21T02:24:39.676898+0000 mgr.a (mgr.14388) 10827 : audit [DBG] from='client.238473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:41 smithi044 bash[22676]: audit 2024-09-21T02:24:39.676898+0000 mgr.a (mgr.14388) 10827 : audit [DBG] from='client.238473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:41.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:41 smithi179 bash[23186]: audit 2024-09-21T02:24:39.676898+0000 mgr.a (mgr.14388) 10827 : audit [DBG] from='client.238473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:42 smithi049 bash[23528]: cluster 2024-09-21T02:24:40.992991+0000 mgr.a (mgr.14388) 10828 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:24:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:42 smithi044 bash[22676]: cluster 2024-09-21T02:24:40.992991+0000 mgr.a (mgr.14388) 10828 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:24:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:42 smithi179 bash[23186]: cluster 2024-09-21T02:24:40.992991+0000 mgr.a (mgr.14388) 10828 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:24:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:44 smithi049 bash[23528]: cluster 2024-09-21T02:24:42.993850+0000 mgr.a (mgr.14388) 10829 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:44 smithi044 bash[22676]: cluster 2024-09-21T02:24:42.993850+0000 mgr.a (mgr.14388) 10829 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:44 smithi179 bash[23186]: cluster 2024-09-21T02:24:42.993850+0000 mgr.a (mgr.14388) 10829 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:45.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:45.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:45.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:45.911 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:45.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:46.337 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:46 smithi049 bash[23528]: cluster 2024-09-21T02:24:44.994616+0000 mgr.a (mgr.14388) 10830 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:46.337 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:46 smithi049 bash[23528]: audit 2024-09-21T02:24:46.191147+0000 mon.a (mon.0) 8932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.337 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:46 smithi049 bash[23528]: audit 2024-09-21T02:24:46.199120+0000 mon.a (mon.0) 8933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.337 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:46 smithi049 bash[23528]: audit 2024-09-21T02:24:46.209828+0000 mon.a (mon.0) 8934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:46 smithi179 bash[23186]: cluster 2024-09-21T02:24:44.994616+0000 mgr.a (mgr.14388) 10830 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:46 smithi179 bash[23186]: audit 2024-09-21T02:24:46.191147+0000 mon.a (mon.0) 8932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:46 smithi179 bash[23186]: audit 2024-09-21T02:24:46.199120+0000 mon.a (mon.0) 8933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:46 smithi179 bash[23186]: audit 2024-09-21T02:24:46.209828+0000 mon.a (mon.0) 8934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:46 smithi044 bash[22676]: cluster 2024-09-21T02:24:44.994616+0000 mgr.a (mgr.14388) 10830 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:46 smithi044 bash[22676]: audit 2024-09-21T02:24:46.191147+0000 mon.a (mon.0) 8932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:46 smithi044 bash[22676]: audit 2024-09-21T02:24:46.199120+0000 mon.a (mon.0) 8933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:46 smithi044 bash[22676]: audit 2024-09-21T02:24:46.209828+0000 mon.a (mon.0) 8934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:47 smithi044 bash[22676]: audit 2024-09-21T02:24:45.469993+0000 mgr.a (mgr.14388) 10831 : audit [DBG] from='client.238548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:47 smithi044 bash[22676]: audit 2024-09-21T02:24:46.312510+0000 mon.a (mon.0) 8935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:47 smithi044 bash[22676]: audit 2024-09-21T02:24:46.320671+0000 mon.a (mon.0) 8936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:47 smithi044 bash[22676]: audit 2024-09-21T02:24:46.330615+0000 mon.a (mon.0) 8937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:47 smithi179 bash[23186]: audit 2024-09-21T02:24:45.469993+0000 mgr.a (mgr.14388) 10831 : audit [DBG] from='client.238548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:47 smithi179 bash[23186]: audit 2024-09-21T02:24:46.312510+0000 mon.a (mon.0) 8935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:47 smithi179 bash[23186]: audit 2024-09-21T02:24:46.320671+0000 mon.a (mon.0) 8936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:47 smithi179 bash[23186]: audit 2024-09-21T02:24:46.330615+0000 mon.a (mon.0) 8937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:47 smithi049 bash[23528]: audit 2024-09-21T02:24:45.469993+0000 mgr.a (mgr.14388) 10831 : audit [DBG] from='client.238548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:47 smithi049 bash[23528]: audit 2024-09-21T02:24:46.312510+0000 mon.a (mon.0) 8935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:47 smithi049 bash[23528]: audit 2024-09-21T02:24:46.320671+0000 mon.a (mon.0) 8936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:47 smithi049 bash[23528]: audit 2024-09-21T02:24:46.330615+0000 mon.a (mon.0) 8937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:48.626 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:48 smithi049 bash[23528]: cluster 2024-09-21T02:24:46.997359+0000 mgr.a (mgr.14388) 10832 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:48 smithi044 bash[22676]: cluster 2024-09-21T02:24:46.997359+0000 mgr.a (mgr.14388) 10832 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:48 smithi179 bash[23186]: cluster 2024-09-21T02:24:46.997359+0000 mgr.a (mgr.14388) 10832 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:50 smithi044 bash[22676]: cluster 2024-09-21T02:24:48.998134+0000 mgr.a (mgr.14388) 10833 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:50 smithi179 bash[23186]: cluster 2024-09-21T02:24:48.998134+0000 mgr.a (mgr.14388) 10833 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:50 smithi049 bash[23528]: cluster 2024-09-21T02:24:48.998134+0000 mgr.a (mgr.14388) 10833 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:24:50.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:50.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:51.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:51.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:51.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:51.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:51.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:51 smithi044 bash[22676]: cluster 2024-09-21T02:24:51.000082+0000 mgr.a (mgr.14388) 10834 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:51 smithi044 bash[22676]: audit 2024-09-21T02:24:51.250912+0000 mgr.a (mgr.14388) 10835 : audit [DBG] from='client.238626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:51 smithi179 bash[23186]: cluster 2024-09-21T02:24:51.000082+0000 mgr.a (mgr.14388) 10834 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:51 smithi179 bash[23186]: audit 2024-09-21T02:24:51.250912+0000 mgr.a (mgr.14388) 10835 : audit [DBG] from='client.238626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:51 smithi049 bash[23528]: cluster 2024-09-21T02:24:51.000082+0000 mgr.a (mgr.14388) 10834 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:24:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:51 smithi049 bash[23528]: audit 2024-09-21T02:24:51.250912+0000 mgr.a (mgr.14388) 10835 : audit [DBG] from='client.238626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:54 smithi044 bash[22676]: cluster 2024-09-21T02:24:53.001026+0000 mgr.a (mgr.14388) 10836 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:24:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:54 smithi044 bash[22676]: audit 2024-09-21T02:24:53.473524+0000 mon.a (mon.0) 8938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:54 smithi044 bash[22676]: audit 2024-09-21T02:24:53.482241+0000 mon.a (mon.0) 8939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:54 smithi044 bash[22676]: audit 2024-09-21T02:24:53.492857+0000 mon.a (mon.0) 8940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:54 smithi179 bash[23186]: cluster 2024-09-21T02:24:53.001026+0000 mgr.a (mgr.14388) 10836 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:24:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:54 smithi179 bash[23186]: audit 2024-09-21T02:24:53.473524+0000 mon.a (mon.0) 8938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:54 smithi179 bash[23186]: audit 2024-09-21T02:24:53.482241+0000 mon.a (mon.0) 8939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:54 smithi179 bash[23186]: audit 2024-09-21T02:24:53.492857+0000 mon.a (mon.0) 8940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:54 smithi049 bash[23528]: cluster 2024-09-21T02:24:53.001026+0000 mgr.a (mgr.14388) 10836 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:24:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:54 smithi049 bash[23528]: audit 2024-09-21T02:24:53.473524+0000 mon.a (mon.0) 8938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:54 smithi049 bash[23528]: audit 2024-09-21T02:24:53.482241+0000 mon.a (mon.0) 8939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:54 smithi049 bash[23528]: audit 2024-09-21T02:24:53.492857+0000 mon.a (mon.0) 8940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:55 smithi044 bash[22676]: audit 2024-09-21T02:24:54.716177+0000 mon.a (mon.0) 8941 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:24:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:55 smithi179 bash[23186]: audit 2024-09-21T02:24:54.716177+0000 mon.a (mon.0) 8941 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:24:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:55 smithi049 bash[23528]: audit 2024-09-21T02:24:54.716177+0000 mon.a (mon.0) 8941 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:24:56.357 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22930]: debug 2024-09-21T02:24:56.062+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:24:56.357 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22930]: debug 2024-09-21T02:24:56.062+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:24:56.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: cluster 2024-09-21T02:24:55.002670+0000 mgr.a (mgr.14388) 10837 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:56.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: audit 2024-09-21T02:24:55.281750+0000 mon.a (mon.0) 8942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: audit 2024-09-21T02:24:55.286355+0000 mon.a (mon.0) 8943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: audit 2024-09-21T02:24:55.287667+0000 mon.a (mon.0) 8944 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:24:56.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: audit 2024-09-21T02:24:55.288475+0000 mon.a (mon.0) 8945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:24:56.358 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: audit 2024-09-21T02:24:55.293703+0000 mon.a (mon.0) 8946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.358 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: audit 2024-09-21T02:24:55.296429+0000 mon.a (mon.0) 8947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:24:56.358 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:56 smithi044 bash[22676]: audit 2024-09-21T02:24:55.297410+0000 mgr.a (mgr.14388) 10838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:24:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: cluster 2024-09-21T02:24:55.002670+0000 mgr.a (mgr.14388) 10837 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: audit 2024-09-21T02:24:55.281750+0000 mon.a (mon.0) 8942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: audit 2024-09-21T02:24:55.286355+0000 mon.a (mon.0) 8943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: audit 2024-09-21T02:24:55.287667+0000 mon.a (mon.0) 8944 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:24:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: audit 2024-09-21T02:24:55.288475+0000 mon.a (mon.0) 8945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:24:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: audit 2024-09-21T02:24:55.293703+0000 mon.a (mon.0) 8946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: audit 2024-09-21T02:24:55.296429+0000 mon.a (mon.0) 8947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:24:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:56 smithi049 bash[23528]: audit 2024-09-21T02:24:55.297410+0000 mgr.a (mgr.14388) 10838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: cluster 2024-09-21T02:24:55.002670+0000 mgr.a (mgr.14388) 10837 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: audit 2024-09-21T02:24:55.281750+0000 mon.a (mon.0) 8942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: audit 2024-09-21T02:24:55.286355+0000 mon.a (mon.0) 8943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: audit 2024-09-21T02:24:55.287667+0000 mon.a (mon.0) 8944 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: audit 2024-09-21T02:24:55.288475+0000 mon.a (mon.0) 8945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: audit 2024-09-21T02:24:55.293703+0000 mon.a (mon.0) 8946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: audit 2024-09-21T02:24:55.296429+0000 mon.a (mon.0) 8947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:24:56.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:56 smithi179 bash[23186]: audit 2024-09-21T02:24:55.297410+0000 mgr.a (mgr.14388) 10838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:24:56.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:24:56.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:24:56.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:24:57.465 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:24:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:24:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:24:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:24:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:24:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:57 smithi044 bash[22676]: audit 2024-09-21T02:24:56.065401+0000 mgr.a (mgr.14388) 10839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:24:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:57 smithi044 bash[22676]: cephadm 2024-09-21T02:24:56.066902+0000 mgr.a (mgr.14388) 10840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:24:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:57 smithi049 bash[23528]: audit 2024-09-21T02:24:56.065401+0000 mgr.a (mgr.14388) 10839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:24:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:57 smithi049 bash[23528]: cephadm 2024-09-21T02:24:56.066902+0000 mgr.a (mgr.14388) 10840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:24:57.608 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:57 smithi179 bash[23186]: audit 2024-09-21T02:24:56.065401+0000 mgr.a (mgr.14388) 10839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:24:57.608 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:57 smithi179 bash[23186]: cephadm 2024-09-21T02:24:56.066902+0000 mgr.a (mgr.14388) 10840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:24:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:58 smithi044 bash[22676]: cluster 2024-09-21T02:24:57.003959+0000 mgr.a (mgr.14388) 10841 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:24:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:24:58 smithi044 bash[22676]: audit 2024-09-21T02:24:57.049768+0000 mgr.a (mgr.14388) 10842 : audit [DBG] from='client.238809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:58.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:58 smithi179 bash[23186]: cluster 2024-09-21T02:24:57.003959+0000 mgr.a (mgr.14388) 10841 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:24:58.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:24:58 smithi179 bash[23186]: audit 2024-09-21T02:24:57.049768+0000 mgr.a (mgr.14388) 10842 : audit [DBG] from='client.238809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:58 smithi049 bash[23528]: cluster 2024-09-21T02:24:57.003959+0000 mgr.a (mgr.14388) 10841 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:24:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:24:58 smithi049 bash[23528]: audit 2024-09-21T02:24:57.049768+0000 mgr.a (mgr.14388) 10842 : audit [DBG] from='client.238809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:00 smithi049 bash[23528]: cluster 2024-09-21T02:24:59.004846+0000 mgr.a (mgr.14388) 10843 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:00 smithi044 bash[22676]: cluster 2024-09-21T02:24:59.004846+0000 mgr.a (mgr.14388) 10843 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:00 smithi179 bash[23186]: cluster 2024-09-21T02:24:59.004846+0000 mgr.a (mgr.14388) 10843 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:02.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:02 smithi049 bash[23528]: cluster 2024-09-21T02:25:01.007102+0000 mgr.a (mgr.14388) 10844 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:02 smithi044 bash[22676]: cluster 2024-09-21T02:25:01.007102+0000 mgr.a (mgr.14388) 10844 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:02 smithi179 bash[23186]: cluster 2024-09-21T02:25:01.007102+0000 mgr.a (mgr.14388) 10844 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:03.220 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:04 smithi044 bash[22676]: audit 2024-09-21T02:25:02.798337+0000 mgr.a (mgr.14388) 10845 : audit [DBG] from='client.238887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:04 smithi044 bash[22676]: cluster 2024-09-21T02:25:03.007624+0000 mgr.a (mgr.14388) 10846 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:04 smithi179 bash[23186]: audit 2024-09-21T02:25:02.798337+0000 mgr.a (mgr.14388) 10845 : audit [DBG] from='client.238887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:04 smithi179 bash[23186]: cluster 2024-09-21T02:25:03.007624+0000 mgr.a (mgr.14388) 10846 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:04 smithi049 bash[23528]: audit 2024-09-21T02:25:02.798337+0000 mgr.a (mgr.14388) 10845 : audit [DBG] from='client.238887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:04 smithi049 bash[23528]: cluster 2024-09-21T02:25:03.007624+0000 mgr.a (mgr.14388) 10846 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:06.567 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:06 smithi044 bash[22676]: cluster 2024-09-21T02:25:05.009341+0000 mgr.a (mgr.14388) 10847 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:06.620 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:06 smithi049 bash[23528]: cluster 2024-09-21T02:25:05.009341+0000 mgr.a (mgr.14388) 10847 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:06 smithi179 bash[23186]: cluster 2024-09-21T02:25:05.009341+0000 mgr.a (mgr.14388) 10847 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:07 smithi044 bash[22676]: audit 2024-09-21T02:25:06.407752+0000 mon.a (mon.0) 8948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:07 smithi044 bash[22676]: audit 2024-09-21T02:25:06.416132+0000 mon.a (mon.0) 8949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:07 smithi044 bash[22676]: audit 2024-09-21T02:25:06.427344+0000 mon.a (mon.0) 8950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:07 smithi044 bash[22676]: audit 2024-09-21T02:25:06.547172+0000 mon.a (mon.0) 8951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:07 smithi044 bash[22676]: audit 2024-09-21T02:25:06.555694+0000 mon.a (mon.0) 8952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:07 smithi044 bash[22676]: audit 2024-09-21T02:25:06.566016+0000 mon.a (mon.0) 8953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:07 smithi044 bash[22676]: cluster 2024-09-21T02:25:07.011041+0000 mgr.a (mgr.14388) 10848 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:07 smithi179 bash[23186]: audit 2024-09-21T02:25:06.407752+0000 mon.a (mon.0) 8948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:07 smithi179 bash[23186]: audit 2024-09-21T02:25:06.416132+0000 mon.a (mon.0) 8949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:07 smithi179 bash[23186]: audit 2024-09-21T02:25:06.427344+0000 mon.a (mon.0) 8950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:07 smithi179 bash[23186]: audit 2024-09-21T02:25:06.547172+0000 mon.a (mon.0) 8951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:07 smithi179 bash[23186]: audit 2024-09-21T02:25:06.555694+0000 mon.a (mon.0) 8952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:07 smithi179 bash[23186]: audit 2024-09-21T02:25:06.566016+0000 mon.a (mon.0) 8953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:07 smithi179 bash[23186]: cluster 2024-09-21T02:25:07.011041+0000 mgr.a (mgr.14388) 10848 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:07 smithi049 bash[23528]: audit 2024-09-21T02:25:06.407752+0000 mon.a (mon.0) 8948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:07 smithi049 bash[23528]: audit 2024-09-21T02:25:06.416132+0000 mon.a (mon.0) 8949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:07 smithi049 bash[23528]: audit 2024-09-21T02:25:06.427344+0000 mon.a (mon.0) 8950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:07 smithi049 bash[23528]: audit 2024-09-21T02:25:06.547172+0000 mon.a (mon.0) 8951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:07 smithi049 bash[23528]: audit 2024-09-21T02:25:06.555694+0000 mon.a (mon.0) 8952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:07 smithi049 bash[23528]: audit 2024-09-21T02:25:06.566016+0000 mon.a (mon.0) 8953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:07 smithi049 bash[23528]: cluster 2024-09-21T02:25:07.011041+0000 mgr.a (mgr.14388) 10848 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:08.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:08.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:09.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:10 smithi044 bash[22676]: audit 2024-09-21T02:25:08.554098+0000 mgr.a (mgr.14388) 10849 : audit [DBG] from='client.238965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:10 smithi044 bash[22676]: cluster 2024-09-21T02:25:09.011572+0000 mgr.a (mgr.14388) 10850 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:10 smithi179 bash[23186]: audit 2024-09-21T02:25:08.554098+0000 mgr.a (mgr.14388) 10849 : audit [DBG] from='client.238965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:10 smithi179 bash[23186]: cluster 2024-09-21T02:25:09.011572+0000 mgr.a (mgr.14388) 10850 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:10 smithi049 bash[23528]: audit 2024-09-21T02:25:08.554098+0000 mgr.a (mgr.14388) 10849 : audit [DBG] from='client.238965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:10 smithi049 bash[23528]: cluster 2024-09-21T02:25:09.011572+0000 mgr.a (mgr.14388) 10850 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:12 smithi044 bash[22676]: cluster 2024-09-21T02:25:11.013828+0000 mgr.a (mgr.14388) 10851 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:12 smithi179 bash[23186]: cluster 2024-09-21T02:25:11.013828+0000 mgr.a (mgr.14388) 10851 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:12 smithi049 bash[23528]: cluster 2024-09-21T02:25:11.013828+0000 mgr.a (mgr.14388) 10851 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:25:14.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:14.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:14.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:14 smithi179 bash[23186]: cluster 2024-09-21T02:25:13.014599+0000 mgr.a (mgr.14388) 10852 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:14 smithi179 bash[23186]: audit 2024-09-21T02:25:13.707326+0000 mon.a (mon.0) 8954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:14 smithi179 bash[23186]: audit 2024-09-21T02:25:13.716009+0000 mon.a (mon.0) 8955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:14 smithi179 bash[23186]: audit 2024-09-21T02:25:13.726369+0000 mon.a (mon.0) 8956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:14 smithi044 bash[22676]: cluster 2024-09-21T02:25:13.014599+0000 mgr.a (mgr.14388) 10852 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:14 smithi044 bash[22676]: audit 2024-09-21T02:25:13.707326+0000 mon.a (mon.0) 8954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:14 smithi044 bash[22676]: audit 2024-09-21T02:25:13.716009+0000 mon.a (mon.0) 8955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:14 smithi044 bash[22676]: audit 2024-09-21T02:25:13.726369+0000 mon.a (mon.0) 8956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:14 smithi049 bash[23528]: cluster 2024-09-21T02:25:13.014599+0000 mgr.a (mgr.14388) 10852 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:14 smithi049 bash[23528]: audit 2024-09-21T02:25:13.707326+0000 mon.a (mon.0) 8954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:14 smithi049 bash[23528]: audit 2024-09-21T02:25:13.716009+0000 mon.a (mon.0) 8955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:14 smithi049 bash[23528]: audit 2024-09-21T02:25:13.726369+0000 mon.a (mon.0) 8956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:14.774 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:16 smithi044 bash[22676]: audit 2024-09-21T02:25:14.347352+0000 mgr.a (mgr.14388) 10853 : audit [DBG] from='client.239040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:16 smithi044 bash[22676]: cluster 2024-09-21T02:25:15.016317+0000 mgr.a (mgr.14388) 10854 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:16 smithi179 bash[23186]: audit 2024-09-21T02:25:14.347352+0000 mgr.a (mgr.14388) 10853 : audit [DBG] from='client.239040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:16 smithi179 bash[23186]: cluster 2024-09-21T02:25:15.016317+0000 mgr.a (mgr.14388) 10854 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:16 smithi049 bash[23528]: audit 2024-09-21T02:25:14.347352+0000 mgr.a (mgr.14388) 10853 : audit [DBG] from='client.239040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:16 smithi049 bash[23528]: cluster 2024-09-21T02:25:15.016317+0000 mgr.a (mgr.14388) 10854 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:18 smithi044 bash[22676]: cluster 2024-09-21T02:25:17.017713+0000 mgr.a (mgr.14388) 10855 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:18 smithi179 bash[23186]: cluster 2024-09-21T02:25:17.017713+0000 mgr.a (mgr.14388) 10855 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:18.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:18 smithi049 bash[23528]: cluster 2024-09-21T02:25:17.017713+0000 mgr.a (mgr.14388) 10855 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:19 smithi179 bash[23186]: cluster 2024-09-21T02:25:19.018224+0000 mgr.a (mgr.14388) 10856 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:19.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:19.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:19 smithi044 bash[22676]: cluster 2024-09-21T02:25:19.018224+0000 mgr.a (mgr.14388) 10856 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:19 smithi049 bash[23528]: cluster 2024-09-21T02:25:19.018224+0000 mgr.a (mgr.14388) 10856 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:20.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:20.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:20.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:20.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:20 smithi044 bash[22676]: audit 2024-09-21T02:25:20.118354+0000 mgr.a (mgr.14388) 10857 : audit [DBG] from='client.239118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:20 smithi179 bash[23186]: audit 2024-09-21T02:25:20.118354+0000 mgr.a (mgr.14388) 10857 : audit [DBG] from='client.239118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:21.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:20 smithi049 bash[23528]: audit 2024-09-21T02:25:20.118354+0000 mgr.a (mgr.14388) 10857 : audit [DBG] from='client.239118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:21 smithi044 bash[22676]: cluster 2024-09-21T02:25:21.021121+0000 mgr.a (mgr.14388) 10858 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:21 smithi179 bash[23186]: cluster 2024-09-21T02:25:21.021121+0000 mgr.a (mgr.14388) 10858 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:21 smithi049 bash[23528]: cluster 2024-09-21T02:25:21.021121+0000 mgr.a (mgr.14388) 10858 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:24 smithi049 bash[23528]: cluster 2024-09-21T02:25:23.021895+0000 mgr.a (mgr.14388) 10859 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:25:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:24 smithi044 bash[22676]: cluster 2024-09-21T02:25:23.021895+0000 mgr.a (mgr.14388) 10859 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:25:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:24 smithi179 bash[23186]: cluster 2024-09-21T02:25:23.021895+0000 mgr.a (mgr.14388) 10859 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:25:25.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:25.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:25.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:26 smithi049 bash[23528]: cluster 2024-09-21T02:25:25.023083+0000 mgr.a (mgr.14388) 10860 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T02:25:26.364 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:26 smithi044 bash[22676]: cluster 2024-09-21T02:25:25.023083+0000 mgr.a (mgr.14388) 10860 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T02:25:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:26 smithi179 bash[23186]: cluster 2024-09-21T02:25:25.023083+0000 mgr.a (mgr.14388) 10860 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T02:25:27.264 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:27 smithi049 bash[23528]: audit 2024-09-21T02:25:25.917026+0000 mgr.a (mgr.14388) 10861 : audit [DBG] from='client.239193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:27.264 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:27 smithi049 bash[23528]: audit 2024-09-21T02:25:26.653136+0000 mon.a (mon.0) 8957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.264 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:27 smithi049 bash[23528]: audit 2024-09-21T02:25:26.662262+0000 mon.a (mon.0) 8958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.264 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:27 smithi049 bash[23528]: audit 2024-09-21T02:25:26.673749+0000 mon.a (mon.0) 8959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.264 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:27 smithi049 bash[23528]: audit 2024-09-21T02:25:26.772526+0000 mon.a (mon.0) 8960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.264 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:27 smithi049 bash[23528]: audit 2024-09-21T02:25:26.781850+0000 mon.a (mon.0) 8961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.264 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:27 smithi049 bash[23528]: audit 2024-09-21T02:25:26.793323+0000 mon.a (mon.0) 8962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:27 smithi044 bash[22676]: audit 2024-09-21T02:25:25.917026+0000 mgr.a (mgr.14388) 10861 : audit [DBG] from='client.239193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:27 smithi044 bash[22676]: audit 2024-09-21T02:25:26.653136+0000 mon.a (mon.0) 8957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:27 smithi044 bash[22676]: audit 2024-09-21T02:25:26.662262+0000 mon.a (mon.0) 8958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:27 smithi044 bash[22676]: audit 2024-09-21T02:25:26.673749+0000 mon.a (mon.0) 8959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:27 smithi044 bash[22676]: audit 2024-09-21T02:25:26.772526+0000 mon.a (mon.0) 8960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:27 smithi044 bash[22676]: audit 2024-09-21T02:25:26.781850+0000 mon.a (mon.0) 8961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:27 smithi044 bash[22676]: audit 2024-09-21T02:25:26.793323+0000 mon.a (mon.0) 8962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:27 smithi179 bash[23186]: audit 2024-09-21T02:25:25.917026+0000 mgr.a (mgr.14388) 10861 : audit [DBG] from='client.239193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:27 smithi179 bash[23186]: audit 2024-09-21T02:25:26.653136+0000 mon.a (mon.0) 8957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:27 smithi179 bash[23186]: audit 2024-09-21T02:25:26.662262+0000 mon.a (mon.0) 8958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:27 smithi179 bash[23186]: audit 2024-09-21T02:25:26.673749+0000 mon.a (mon.0) 8959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:27 smithi179 bash[23186]: audit 2024-09-21T02:25:26.772526+0000 mon.a (mon.0) 8960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:27 smithi179 bash[23186]: audit 2024-09-21T02:25:26.781850+0000 mon.a (mon.0) 8961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:27 smithi179 bash[23186]: audit 2024-09-21T02:25:26.793323+0000 mon.a (mon.0) 8962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:28 smithi049 bash[23528]: cluster 2024-09-21T02:25:27.025320+0000 mgr.a (mgr.14388) 10862 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:25:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:28 smithi044 bash[22676]: cluster 2024-09-21T02:25:27.025320+0000 mgr.a (mgr.14388) 10862 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:25:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:28 smithi179 bash[23186]: cluster 2024-09-21T02:25:27.025320+0000 mgr.a (mgr.14388) 10862 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:25:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:30 smithi044 bash[22676]: cluster 2024-09-21T02:25:29.026118+0000 mgr.a (mgr.14388) 10863 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:25:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:30 smithi179 bash[23186]: cluster 2024-09-21T02:25:29.026118+0000 mgr.a (mgr.14388) 10863 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:25:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:30 smithi049 bash[23528]: cluster 2024-09-21T02:25:29.026118+0000 mgr.a (mgr.14388) 10863 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:25:31.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:32.157 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:32 smithi044 bash[22676]: cluster 2024-09-21T02:25:31.028143+0000 mgr.a (mgr.14388) 10864 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:32 smithi179 bash[23186]: cluster 2024-09-21T02:25:31.028143+0000 mgr.a (mgr.14388) 10864 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:32 smithi049 bash[23528]: cluster 2024-09-21T02:25:31.028143+0000 mgr.a (mgr.14388) 10864 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:33 smithi044 bash[22676]: audit 2024-09-21T02:25:31.704845+0000 mgr.a (mgr.14388) 10865 : audit [DBG] from='client.239271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:33.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:33 smithi179 bash[23186]: audit 2024-09-21T02:25:31.704845+0000 mgr.a (mgr.14388) 10865 : audit [DBG] from='client.239271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:33 smithi049 bash[23528]: audit 2024-09-21T02:25:31.704845+0000 mgr.a (mgr.14388) 10865 : audit [DBG] from='client.239271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:34 smithi049 bash[23528]: cluster 2024-09-21T02:25:33.028987+0000 mgr.a (mgr.14388) 10866 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:34 smithi049 bash[23528]: audit 2024-09-21T02:25:33.926679+0000 mon.a (mon.0) 8963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:34 smithi049 bash[23528]: audit 2024-09-21T02:25:33.932079+0000 mon.a (mon.0) 8964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:34 smithi049 bash[23528]: audit 2024-09-21T02:25:33.937394+0000 mon.a (mon.0) 8965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.438 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:34 smithi179 bash[23186]: cluster 2024-09-21T02:25:33.028987+0000 mgr.a (mgr.14388) 10866 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:34.439 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:34 smithi179 bash[23186]: audit 2024-09-21T02:25:33.926679+0000 mon.a (mon.0) 8963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.439 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:34 smithi179 bash[23186]: audit 2024-09-21T02:25:33.932079+0000 mon.a (mon.0) 8964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.439 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:34 smithi179 bash[23186]: audit 2024-09-21T02:25:33.937394+0000 mon.a (mon.0) 8965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:34 smithi044 bash[22676]: cluster 2024-09-21T02:25:33.028987+0000 mgr.a (mgr.14388) 10866 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:34 smithi044 bash[22676]: audit 2024-09-21T02:25:33.926679+0000 mon.a (mon.0) 8963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:34 smithi044 bash[22676]: audit 2024-09-21T02:25:33.932079+0000 mon.a (mon.0) 8964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:34 smithi044 bash[22676]: audit 2024-09-21T02:25:33.937394+0000 mon.a (mon.0) 8965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:36 smithi044 bash[22676]: cluster 2024-09-21T02:25:35.030390+0000 mgr.a (mgr.14388) 10867 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:36 smithi179 bash[23186]: cluster 2024-09-21T02:25:35.030390+0000 mgr.a (mgr.14388) 10867 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:36 smithi049 bash[23528]: cluster 2024-09-21T02:25:35.030390+0000 mgr.a (mgr.14388) 10867 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:37.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:37.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:37.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:37.894 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:37.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:37.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:38 smithi044 bash[22676]: cluster 2024-09-21T02:25:37.031292+0000 mgr.a (mgr.14388) 10868 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:38.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:38 smithi179 bash[23186]: cluster 2024-09-21T02:25:37.031292+0000 mgr.a (mgr.14388) 10868 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:38 smithi049 bash[23528]: cluster 2024-09-21T02:25:37.031292+0000 mgr.a (mgr.14388) 10868 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:39 smithi044 bash[22676]: audit 2024-09-21T02:25:37.479976+0000 mgr.a (mgr.14388) 10869 : audit [DBG] from='client.239346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:39.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:39 smithi179 bash[23186]: audit 2024-09-21T02:25:37.479976+0000 mgr.a (mgr.14388) 10869 : audit [DBG] from='client.239346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:39 smithi049 bash[23528]: audit 2024-09-21T02:25:37.479976+0000 mgr.a (mgr.14388) 10869 : audit [DBG] from='client.239346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:40 smithi044 bash[22676]: cluster 2024-09-21T02:25:39.031875+0000 mgr.a (mgr.14388) 10870 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:40 smithi179 bash[23186]: cluster 2024-09-21T02:25:39.031875+0000 mgr.a (mgr.14388) 10870 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:40 smithi049 bash[23528]: cluster 2024-09-21T02:25:39.031875+0000 mgr.a (mgr.14388) 10870 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:42 smithi044 bash[22676]: cluster 2024-09-21T02:25:41.034108+0000 mgr.a (mgr.14388) 10871 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:42 smithi179 bash[23186]: cluster 2024-09-21T02:25:41.034108+0000 mgr.a (mgr.14388) 10871 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:42 smithi049 bash[23528]: cluster 2024-09-21T02:25:41.034108+0000 mgr.a (mgr.14388) 10871 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:42.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:42.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:42.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:43.680 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:44 smithi044 bash[22676]: cluster 2024-09-21T02:25:43.034558+0000 mgr.a (mgr.14388) 10872 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:44 smithi044 bash[22676]: audit 2024-09-21T02:25:43.231707+0000 mgr.a (mgr.14388) 10873 : audit [DBG] from='client.239424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:44 smithi179 bash[23186]: cluster 2024-09-21T02:25:43.034558+0000 mgr.a (mgr.14388) 10872 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:44 smithi179 bash[23186]: audit 2024-09-21T02:25:43.231707+0000 mgr.a (mgr.14388) 10873 : audit [DBG] from='client.239424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:44 smithi049 bash[23528]: cluster 2024-09-21T02:25:43.034558+0000 mgr.a (mgr.14388) 10872 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:44 smithi049 bash[23528]: audit 2024-09-21T02:25:43.231707+0000 mgr.a (mgr.14388) 10873 : audit [DBG] from='client.239424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:46 smithi044 bash[22676]: cluster 2024-09-21T02:25:45.036192+0000 mgr.a (mgr.14388) 10874 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:46 smithi179 bash[23186]: cluster 2024-09-21T02:25:45.036192+0000 mgr.a (mgr.14388) 10874 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:46 smithi049 bash[23528]: cluster 2024-09-21T02:25:45.036192+0000 mgr.a (mgr.14388) 10874 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T02:25:48.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:47 smithi049 bash[23528]: audit 2024-09-21T02:25:46.875323+0000 mon.a (mon.0) 8966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:47 smithi049 bash[23528]: audit 2024-09-21T02:25:46.881794+0000 mon.a (mon.0) 8967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:47 smithi049 bash[23528]: audit 2024-09-21T02:25:46.888929+0000 mon.a (mon.0) 8968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:47 smithi049 bash[23528]: audit 2024-09-21T02:25:46.990057+0000 mon.a (mon.0) 8969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.186 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:47 smithi049 bash[23528]: audit 2024-09-21T02:25:46.999777+0000 mon.a (mon.0) 8970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.186 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:47 smithi049 bash[23528]: audit 2024-09-21T02:25:47.011290+0000 mon.a (mon.0) 8971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.186 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:47 smithi049 bash[23528]: cluster 2024-09-21T02:25:47.038189+0000 mgr.a (mgr.14388) 10875 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:47 smithi044 bash[22676]: audit 2024-09-21T02:25:46.875323+0000 mon.a (mon.0) 8966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:47 smithi044 bash[22676]: audit 2024-09-21T02:25:46.881794+0000 mon.a (mon.0) 8967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:47 smithi044 bash[22676]: audit 2024-09-21T02:25:46.888929+0000 mon.a (mon.0) 8968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:47 smithi044 bash[22676]: audit 2024-09-21T02:25:46.990057+0000 mon.a (mon.0) 8969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:47 smithi044 bash[22676]: audit 2024-09-21T02:25:46.999777+0000 mon.a (mon.0) 8970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:47 smithi044 bash[22676]: audit 2024-09-21T02:25:47.011290+0000 mon.a (mon.0) 8971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:47 smithi044 bash[22676]: cluster 2024-09-21T02:25:47.038189+0000 mgr.a (mgr.14388) 10875 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:47 smithi179 bash[23186]: audit 2024-09-21T02:25:46.875323+0000 mon.a (mon.0) 8966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:47 smithi179 bash[23186]: audit 2024-09-21T02:25:46.881794+0000 mon.a (mon.0) 8967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:47 smithi179 bash[23186]: audit 2024-09-21T02:25:46.888929+0000 mon.a (mon.0) 8968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:47 smithi179 bash[23186]: audit 2024-09-21T02:25:46.990057+0000 mon.a (mon.0) 8969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:47 smithi179 bash[23186]: audit 2024-09-21T02:25:46.999777+0000 mon.a (mon.0) 8970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:47 smithi179 bash[23186]: audit 2024-09-21T02:25:47.011290+0000 mon.a (mon.0) 8971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:47 smithi179 bash[23186]: cluster 2024-09-21T02:25:47.038189+0000 mgr.a (mgr.14388) 10875 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:25:48.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:48.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:48.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:49.472 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:50 smithi049 bash[23528]: audit 2024-09-21T02:25:49.014527+0000 mgr.a (mgr.14388) 10876 : audit [DBG] from='client.239499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:50 smithi049 bash[23528]: cluster 2024-09-21T02:25:49.039648+0000 mgr.a (mgr.14388) 10877 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:50 smithi044 bash[22676]: audit 2024-09-21T02:25:49.014527+0000 mgr.a (mgr.14388) 10876 : audit [DBG] from='client.239499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:50 smithi044 bash[22676]: cluster 2024-09-21T02:25:49.039648+0000 mgr.a (mgr.14388) 10877 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:50 smithi179 bash[23186]: audit 2024-09-21T02:25:49.014527+0000 mgr.a (mgr.14388) 10876 : audit [DBG] from='client.239499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:50 smithi179 bash[23186]: cluster 2024-09-21T02:25:49.039648+0000 mgr.a (mgr.14388) 10877 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:25:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:52 smithi044 bash[22676]: cluster 2024-09-21T02:25:51.042118+0000 mgr.a (mgr.14388) 10878 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:25:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:52 smithi179 bash[23186]: cluster 2024-09-21T02:25:51.042118+0000 mgr.a (mgr.14388) 10878 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:25:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:52 smithi049 bash[23528]: cluster 2024-09-21T02:25:51.042118+0000 mgr.a (mgr.14388) 10878 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:25:54.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:25:54.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:25:54.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:25:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:54 smithi044 bash[22676]: cluster 2024-09-21T02:25:53.042909+0000 mgr.a (mgr.14388) 10879 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:54 smithi179 bash[23186]: cluster 2024-09-21T02:25:53.042909+0000 mgr.a (mgr.14388) 10879 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:54 smithi049 bash[23528]: cluster 2024-09-21T02:25:53.042909+0000 mgr.a (mgr.14388) 10879 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:55.274 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:25:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:25:55.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:25:55.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:25:55.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:25:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:55 smithi044 bash[22676]: audit 2024-09-21T02:25:54.151100+0000 mon.a (mon.0) 8972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:55 smithi044 bash[22676]: audit 2024-09-21T02:25:54.159720+0000 mon.a (mon.0) 8973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:55 smithi044 bash[22676]: audit 2024-09-21T02:25:54.170178+0000 mon.a (mon.0) 8974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:55 smithi179 bash[23186]: audit 2024-09-21T02:25:54.151100+0000 mon.a (mon.0) 8972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:55 smithi179 bash[23186]: audit 2024-09-21T02:25:54.159720+0000 mon.a (mon.0) 8973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:55 smithi179 bash[23186]: audit 2024-09-21T02:25:54.170178+0000 mon.a (mon.0) 8974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:55 smithi049 bash[23528]: audit 2024-09-21T02:25:54.151100+0000 mon.a (mon.0) 8972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:55 smithi049 bash[23528]: audit 2024-09-21T02:25:54.159720+0000 mon.a (mon.0) 8973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:55 smithi049 bash[23528]: audit 2024-09-21T02:25:54.170178+0000 mon.a (mon.0) 8974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22676]: audit 2024-09-21T02:25:54.812591+0000 mgr.a (mgr.14388) 10880 : audit [DBG] from='client.239574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22676]: cluster 2024-09-21T02:25:55.044142+0000 mgr.a (mgr.14388) 10881 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22676]: audit 2024-09-21T02:25:56.132881+0000 mon.a (mon.0) 8975 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:25:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22676]: audit 2024-09-21T02:25:56.140555+0000 mon.a (mon.0) 8976 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:25:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22676]: audit 2024-09-21T02:25:56.142848+0000 mon.a (mon.0) 8977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:25:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22676]: audit 2024-09-21T02:25:56.154461+0000 mon.a (mon.0) 8978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22676]: audit 2024-09-21T02:25:56.160933+0000 mon.a (mon.0) 8979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:25:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:56 smithi179 bash[23186]: audit 2024-09-21T02:25:54.812591+0000 mgr.a (mgr.14388) 10880 : audit [DBG] from='client.239574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:56 smithi179 bash[23186]: cluster 2024-09-21T02:25:55.044142+0000 mgr.a (mgr.14388) 10881 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:56 smithi179 bash[23186]: audit 2024-09-21T02:25:56.132881+0000 mon.a (mon.0) 8975 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:25:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:56 smithi179 bash[23186]: audit 2024-09-21T02:25:56.140555+0000 mon.a (mon.0) 8976 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:25:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:56 smithi179 bash[23186]: audit 2024-09-21T02:25:56.142848+0000 mon.a (mon.0) 8977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:25:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:56 smithi179 bash[23186]: audit 2024-09-21T02:25:56.154461+0000 mon.a (mon.0) 8978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:56 smithi179 bash[23186]: audit 2024-09-21T02:25:56.160933+0000 mon.a (mon.0) 8979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:25:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:56 smithi049 bash[23528]: audit 2024-09-21T02:25:54.812591+0000 mgr.a (mgr.14388) 10880 : audit [DBG] from='client.239574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:25:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:56 smithi049 bash[23528]: cluster 2024-09-21T02:25:55.044142+0000 mgr.a (mgr.14388) 10881 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:56 smithi049 bash[23528]: audit 2024-09-21T02:25:56.132881+0000 mon.a (mon.0) 8975 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:25:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:56 smithi049 bash[23528]: audit 2024-09-21T02:25:56.140555+0000 mon.a (mon.0) 8976 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:25:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:56 smithi049 bash[23528]: audit 2024-09-21T02:25:56.142848+0000 mon.a (mon.0) 8977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:25:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:56 smithi049 bash[23528]: audit 2024-09-21T02:25:56.154461+0000 mon.a (mon.0) 8978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:25:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:56 smithi049 bash[23528]: audit 2024-09-21T02:25:56.160933+0000 mon.a (mon.0) 8979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:25:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:57 smithi044 bash[22676]: audit 2024-09-21T02:25:56.163850+0000 mgr.a (mgr.14388) 10882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:25:57.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22930]: debug 2024-09-21T02:25:56.957+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:25:57.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:25:56 smithi044 bash[22930]: debug 2024-09-21T02:25:56.957+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:25:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:57 smithi179 bash[23186]: audit 2024-09-21T02:25:56.163850+0000 mgr.a (mgr.14388) 10882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:25:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:57 smithi049 bash[23528]: audit 2024-09-21T02:25:56.163850+0000 mgr.a (mgr.14388) 10882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:25:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:58 smithi044 bash[22676]: audit 2024-09-21T02:25:56.961806+0000 mgr.a (mgr.14388) 10883 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:25:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:58 smithi044 bash[22676]: cephadm 2024-09-21T02:25:56.963501+0000 mgr.a (mgr.14388) 10884 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:25:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:25:58 smithi044 bash[22676]: cluster 2024-09-21T02:25:57.045159+0000 mgr.a (mgr.14388) 10885 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:58.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:58 smithi179 bash[23186]: audit 2024-09-21T02:25:56.961806+0000 mgr.a (mgr.14388) 10883 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:58 smithi179 bash[23186]: cephadm 2024-09-21T02:25:56.963501+0000 mgr.a (mgr.14388) 10884 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:25:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:25:58 smithi179 bash[23186]: cluster 2024-09-21T02:25:57.045159+0000 mgr.a (mgr.14388) 10885 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:25:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:58 smithi049 bash[23528]: audit 2024-09-21T02:25:56.961806+0000 mgr.a (mgr.14388) 10883 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:25:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:58 smithi049 bash[23528]: cephadm 2024-09-21T02:25:56.963501+0000 mgr.a (mgr.14388) 10884 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:25:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:25:58 smithi049 bash[23528]: cluster 2024-09-21T02:25:57.045159+0000 mgr.a (mgr.14388) 10885 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:26:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:00.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:00.277 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:00 smithi044 bash[22676]: cluster 2024-09-21T02:25:59.045913+0000 mgr.a (mgr.14388) 10886 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:26:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:00 smithi179 bash[23186]: cluster 2024-09-21T02:25:59.045913+0000 mgr.a (mgr.14388) 10886 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:26:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:00 smithi049 bash[23528]: cluster 2024-09-21T02:25:59.045913+0000 mgr.a (mgr.14388) 10886 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:26:01.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:02 smithi044 bash[22676]: audit 2024-09-21T02:26:00.619179+0000 mgr.a (mgr.14388) 10887 : audit [DBG] from='client.239757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:02 smithi044 bash[22676]: cluster 2024-09-21T02:26:01.047411+0000 mgr.a (mgr.14388) 10888 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T02:26:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:02 smithi179 bash[23186]: audit 2024-09-21T02:26:00.619179+0000 mgr.a (mgr.14388) 10887 : audit [DBG] from='client.239757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:02 smithi179 bash[23186]: cluster 2024-09-21T02:26:01.047411+0000 mgr.a (mgr.14388) 10888 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T02:26:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:02 smithi049 bash[23528]: audit 2024-09-21T02:26:00.619179+0000 mgr.a (mgr.14388) 10887 : audit [DBG] from='client.239757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:02 smithi049 bash[23528]: cluster 2024-09-21T02:26:01.047411+0000 mgr.a (mgr.14388) 10888 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T02:26:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:04 smithi044 bash[22676]: cluster 2024-09-21T02:26:03.048154+0000 mgr.a (mgr.14388) 10889 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:26:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:04 smithi179 bash[23186]: cluster 2024-09-21T02:26:03.048154+0000 mgr.a (mgr.14388) 10889 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:26:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:04 smithi049 bash[23528]: cluster 2024-09-21T02:26:03.048154+0000 mgr.a (mgr.14388) 10889 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:26:06.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:06.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:06.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:06 smithi044 bash[22676]: cluster 2024-09-21T02:26:05.049741+0000 mgr.a (mgr.14388) 10890 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 426 B/s wr, 56 op/s 2024-09-21T02:26:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:06 smithi179 bash[23186]: cluster 2024-09-21T02:26:05.049741+0000 mgr.a (mgr.14388) 10890 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 426 B/s wr, 56 op/s 2024-09-21T02:26:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:06 smithi049 bash[23528]: cluster 2024-09-21T02:26:05.049741+0000 mgr.a (mgr.14388) 10890 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 426 B/s wr, 56 op/s 2024-09-21T02:26:06.850 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:06.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:06.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:06.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:06.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: audit 2024-09-21T02:26:06.403596+0000 mgr.a (mgr.14388) 10891 : audit [DBG] from='client.239832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: cluster 2024-09-21T02:26:07.051103+0000 mgr.a (mgr.14388) 10892 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-09-21T02:26:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: audit 2024-09-21T02:26:07.084619+0000 mon.a (mon.0) 8980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: audit 2024-09-21T02:26:07.090624+0000 mon.a (mon.0) 8981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: audit 2024-09-21T02:26:07.097927+0000 mon.a (mon.0) 8982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: audit 2024-09-21T02:26:07.190502+0000 mon.a (mon.0) 8983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: audit 2024-09-21T02:26:07.197348+0000 mon.a (mon.0) 8984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:08 smithi044 bash[22676]: audit 2024-09-21T02:26:07.205389+0000 mon.a (mon.0) 8985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: audit 2024-09-21T02:26:06.403596+0000 mgr.a (mgr.14388) 10891 : audit [DBG] from='client.239832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: cluster 2024-09-21T02:26:07.051103+0000 mgr.a (mgr.14388) 10892 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-09-21T02:26:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: audit 2024-09-21T02:26:07.084619+0000 mon.a (mon.0) 8980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: audit 2024-09-21T02:26:07.090624+0000 mon.a (mon.0) 8981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: audit 2024-09-21T02:26:07.097927+0000 mon.a (mon.0) 8982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: audit 2024-09-21T02:26:07.190502+0000 mon.a (mon.0) 8983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: audit 2024-09-21T02:26:07.197348+0000 mon.a (mon.0) 8984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:08 smithi179 bash[23186]: audit 2024-09-21T02:26:07.205389+0000 mon.a (mon.0) 8985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: audit 2024-09-21T02:26:06.403596+0000 mgr.a (mgr.14388) 10891 : audit [DBG] from='client.239832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: cluster 2024-09-21T02:26:07.051103+0000 mgr.a (mgr.14388) 10892 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-09-21T02:26:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: audit 2024-09-21T02:26:07.084619+0000 mon.a (mon.0) 8980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: audit 2024-09-21T02:26:07.090624+0000 mon.a (mon.0) 8981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: audit 2024-09-21T02:26:07.097927+0000 mon.a (mon.0) 8982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: audit 2024-09-21T02:26:07.190502+0000 mon.a (mon.0) 8983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: audit 2024-09-21T02:26:07.197348+0000 mon.a (mon.0) 8984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:08 smithi049 bash[23528]: audit 2024-09-21T02:26:07.205389+0000 mon.a (mon.0) 8985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:10.341 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:10 smithi049 bash[23528]: cluster 2024-09-21T02:26:09.051857+0000 mgr.a (mgr.14388) 10893 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-09-21T02:26:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:10 smithi044 bash[22676]: cluster 2024-09-21T02:26:09.051857+0000 mgr.a (mgr.14388) 10893 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-09-21T02:26:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:10 smithi179 bash[23186]: cluster 2024-09-21T02:26:09.051857+0000 mgr.a (mgr.14388) 10893 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-09-21T02:26:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:12 smithi044 bash[22676]: cluster 2024-09-21T02:26:11.053923+0000 mgr.a (mgr.14388) 10894 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-09-21T02:26:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:12 smithi179 bash[23186]: cluster 2024-09-21T02:26:11.053923+0000 mgr.a (mgr.14388) 10894 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-09-21T02:26:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:12 smithi049 bash[23528]: cluster 2024-09-21T02:26:11.053923+0000 mgr.a (mgr.14388) 10894 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-09-21T02:26:12.607 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:12.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:12.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:12.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:12.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:13 smithi044 bash[22676]: audit 2024-09-21T02:26:12.184151+0000 mgr.a (mgr.14388) 10895 : audit [DBG] from='client.239910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:13.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:13 smithi179 bash[23186]: audit 2024-09-21T02:26:12.184151+0000 mgr.a (mgr.14388) 10895 : audit [DBG] from='client.239910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:13 smithi049 bash[23528]: audit 2024-09-21T02:26:12.184151+0000 mgr.a (mgr.14388) 10895 : audit [DBG] from='client.239910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:14.403 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:14 smithi049 bash[23528]: cluster 2024-09-21T02:26:13.054795+0000 mgr.a (mgr.14388) 10896 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 50 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T02:26:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:14 smithi044 bash[22676]: cluster 2024-09-21T02:26:13.054795+0000 mgr.a (mgr.14388) 10896 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 50 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T02:26:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:14 smithi179 bash[23186]: cluster 2024-09-21T02:26:13.054795+0000 mgr.a (mgr.14388) 10896 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 50 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T02:26:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:15 smithi044 bash[22676]: audit 2024-09-21T02:26:14.382153+0000 mon.a (mon.0) 8986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:15 smithi044 bash[22676]: audit 2024-09-21T02:26:14.391256+0000 mon.a (mon.0) 8987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:15 smithi044 bash[22676]: audit 2024-09-21T02:26:14.401853+0000 mon.a (mon.0) 8988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:15 smithi044 bash[22676]: cluster 2024-09-21T02:26:15.056970+0000 mgr.a (mgr.14388) 10897 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 51 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T02:26:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:15 smithi179 bash[23186]: audit 2024-09-21T02:26:14.382153+0000 mon.a (mon.0) 8986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:15 smithi179 bash[23186]: audit 2024-09-21T02:26:14.391256+0000 mon.a (mon.0) 8987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:15 smithi179 bash[23186]: audit 2024-09-21T02:26:14.401853+0000 mon.a (mon.0) 8988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:15 smithi179 bash[23186]: cluster 2024-09-21T02:26:15.056970+0000 mgr.a (mgr.14388) 10897 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 51 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T02:26:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:15 smithi049 bash[23528]: audit 2024-09-21T02:26:14.382153+0000 mon.a (mon.0) 8986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:15 smithi049 bash[23528]: audit 2024-09-21T02:26:14.391256+0000 mon.a (mon.0) 8987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:15 smithi049 bash[23528]: audit 2024-09-21T02:26:14.401853+0000 mon.a (mon.0) 8988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:15 smithi049 bash[23528]: cluster 2024-09-21T02:26:15.056970+0000 mgr.a (mgr.14388) 10897 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 51 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-21T02:26:17.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:17.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:17.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:18 smithi044 bash[22676]: cluster 2024-09-21T02:26:17.057762+0000 mgr.a (mgr.14388) 10898 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T02:26:18.360 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:18 smithi179 bash[23186]: cluster 2024-09-21T02:26:17.057762+0000 mgr.a (mgr.14388) 10898 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T02:26:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:18 smithi049 bash[23528]: cluster 2024-09-21T02:26:17.057762+0000 mgr.a (mgr.14388) 10898 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s 2024-09-21T02:26:19.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:19 smithi044 bash[22676]: audit 2024-09-21T02:26:17.937009+0000 mgr.a (mgr.14388) 10899 : audit [DBG] from='client.239988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:19.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:19 smithi179 bash[23186]: audit 2024-09-21T02:26:17.937009+0000 mgr.a (mgr.14388) 10899 : audit [DBG] from='client.239988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:19 smithi049 bash[23528]: audit 2024-09-21T02:26:17.937009+0000 mgr.a (mgr.14388) 10899 : audit [DBG] from='client.239988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:20 smithi044 bash[22676]: cluster 2024-09-21T02:26:19.058730+0000 mgr.a (mgr.14388) 10900 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:20 smithi179 bash[23186]: cluster 2024-09-21T02:26:19.058730+0000 mgr.a (mgr.14388) 10900 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:20 smithi049 bash[23528]: cluster 2024-09-21T02:26:19.058730+0000 mgr.a (mgr.14388) 10900 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:22 smithi044 bash[22676]: cluster 2024-09-21T02:26:21.060959+0000 mgr.a (mgr.14388) 10901 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:22 smithi179 bash[23186]: cluster 2024-09-21T02:26:21.060959+0000 mgr.a (mgr.14388) 10901 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:22 smithi049 bash[23528]: cluster 2024-09-21T02:26:21.060959+0000 mgr.a (mgr.14388) 10901 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:24.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:24.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:24.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:24.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:24.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:24 smithi044 bash[22676]: cluster 2024-09-21T02:26:23.061729+0000 mgr.a (mgr.14388) 10902 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:24 smithi179 bash[23186]: cluster 2024-09-21T02:26:23.061729+0000 mgr.a (mgr.14388) 10902 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:24 smithi049 bash[23528]: cluster 2024-09-21T02:26:23.061729+0000 mgr.a (mgr.14388) 10902 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:25 smithi044 bash[22676]: audit 2024-09-21T02:26:23.699975+0000 mgr.a (mgr.14388) 10903 : audit [DBG] from='client.240066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:25.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:25 smithi179 bash[23186]: audit 2024-09-21T02:26:23.699975+0000 mgr.a (mgr.14388) 10903 : audit [DBG] from='client.240066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:25 smithi049 bash[23528]: audit 2024-09-21T02:26:23.699975+0000 mgr.a (mgr.14388) 10903 : audit [DBG] from='client.240066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:26 smithi044 bash[22676]: cluster 2024-09-21T02:26:25.063975+0000 mgr.a (mgr.14388) 10904 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:26 smithi179 bash[23186]: cluster 2024-09-21T02:26:25.063975+0000 mgr.a (mgr.14388) 10904 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:26 smithi049 bash[23528]: cluster 2024-09-21T02:26:25.063975+0000 mgr.a (mgr.14388) 10904 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:28.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:28 smithi049 bash[23528]: cluster 2024-09-21T02:26:27.064764+0000 mgr.a (mgr.14388) 10905 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:28.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:28 smithi049 bash[23528]: audit 2024-09-21T02:26:27.297029+0000 mon.a (mon.0) 8989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:28 smithi049 bash[23528]: audit 2024-09-21T02:26:27.303175+0000 mon.a (mon.0) 8990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:28 smithi049 bash[23528]: audit 2024-09-21T02:26:27.309740+0000 mon.a (mon.0) 8991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:28 smithi049 bash[23528]: audit 2024-09-21T02:26:27.409116+0000 mon.a (mon.0) 8992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:28 smithi049 bash[23528]: audit 2024-09-21T02:26:27.415716+0000 mon.a (mon.0) 8993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.487 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:28 smithi049 bash[23528]: audit 2024-09-21T02:26:27.423594+0000 mon.a (mon.0) 8994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:28 smithi044 bash[22676]: cluster 2024-09-21T02:26:27.064764+0000 mgr.a (mgr.14388) 10905 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:28 smithi044 bash[22676]: audit 2024-09-21T02:26:27.297029+0000 mon.a (mon.0) 8989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:28 smithi044 bash[22676]: audit 2024-09-21T02:26:27.303175+0000 mon.a (mon.0) 8990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:28 smithi044 bash[22676]: audit 2024-09-21T02:26:27.309740+0000 mon.a (mon.0) 8991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:28 smithi044 bash[22676]: audit 2024-09-21T02:26:27.409116+0000 mon.a (mon.0) 8992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:28 smithi044 bash[22676]: audit 2024-09-21T02:26:27.415716+0000 mon.a (mon.0) 8993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:28 smithi044 bash[22676]: audit 2024-09-21T02:26:27.423594+0000 mon.a (mon.0) 8994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:28 smithi179 bash[23186]: cluster 2024-09-21T02:26:27.064764+0000 mgr.a (mgr.14388) 10905 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:28 smithi179 bash[23186]: audit 2024-09-21T02:26:27.297029+0000 mon.a (mon.0) 8989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:28 smithi179 bash[23186]: audit 2024-09-21T02:26:27.303175+0000 mon.a (mon.0) 8990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:28 smithi179 bash[23186]: audit 2024-09-21T02:26:27.309740+0000 mon.a (mon.0) 8991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:28 smithi179 bash[23186]: audit 2024-09-21T02:26:27.409116+0000 mon.a (mon.0) 8992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:28 smithi179 bash[23186]: audit 2024-09-21T02:26:27.415716+0000 mon.a (mon.0) 8993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:28 smithi179 bash[23186]: audit 2024-09-21T02:26:27.423594+0000 mon.a (mon.0) 8994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:29.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:29.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:29.954 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:30 smithi049 bash[23528]: cluster 2024-09-21T02:26:29.065534+0000 mgr.a (mgr.14388) 10906 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:30 smithi044 bash[22676]: cluster 2024-09-21T02:26:29.065534+0000 mgr.a (mgr.14388) 10906 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:30 smithi179 bash[23186]: cluster 2024-09-21T02:26:29.065534+0000 mgr.a (mgr.14388) 10906 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:31 smithi044 bash[22676]: audit 2024-09-21T02:26:29.501973+0000 mgr.a (mgr.14388) 10907 : audit [DBG] from='client.240141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:31 smithi179 bash[23186]: audit 2024-09-21T02:26:29.501973+0000 mgr.a (mgr.14388) 10907 : audit [DBG] from='client.240141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:31 smithi049 bash[23528]: audit 2024-09-21T02:26:29.501973+0000 mgr.a (mgr.14388) 10907 : audit [DBG] from='client.240141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:32 smithi044 bash[22676]: cluster 2024-09-21T02:26:31.068031+0000 mgr.a (mgr.14388) 10908 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:32 smithi179 bash[23186]: cluster 2024-09-21T02:26:31.068031+0000 mgr.a (mgr.14388) 10908 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:32 smithi049 bash[23528]: cluster 2024-09-21T02:26:31.068031+0000 mgr.a (mgr.14388) 10908 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:34.635 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:34 smithi049 bash[23528]: cluster 2024-09-21T02:26:33.069012+0000 mgr.a (mgr.14388) 10909 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:34 smithi044 bash[22676]: cluster 2024-09-21T02:26:33.069012+0000 mgr.a (mgr.14388) 10909 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:34 smithi179 bash[23186]: cluster 2024-09-21T02:26:33.069012+0000 mgr.a (mgr.14388) 10909 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:34.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:34.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:34.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:35.747 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:35 smithi044 bash[22676]: audit 2024-09-21T02:26:34.613766+0000 mon.a (mon.0) 8995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:35 smithi044 bash[22676]: audit 2024-09-21T02:26:34.622697+0000 mon.a (mon.0) 8996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:35 smithi044 bash[22676]: audit 2024-09-21T02:26:34.633485+0000 mon.a (mon.0) 8997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:35 smithi044 bash[22676]: cluster 2024-09-21T02:26:35.070015+0000 mgr.a (mgr.14388) 10910 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:35 smithi044 bash[22676]: audit 2024-09-21T02:26:35.295154+0000 mgr.a (mgr.14388) 10911 : audit [DBG] from='client.240216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:35 smithi179 bash[23186]: audit 2024-09-21T02:26:34.613766+0000 mon.a (mon.0) 8995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:35 smithi179 bash[23186]: audit 2024-09-21T02:26:34.622697+0000 mon.a (mon.0) 8996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:35 smithi179 bash[23186]: audit 2024-09-21T02:26:34.633485+0000 mon.a (mon.0) 8997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:35 smithi179 bash[23186]: cluster 2024-09-21T02:26:35.070015+0000 mgr.a (mgr.14388) 10910 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:35 smithi179 bash[23186]: audit 2024-09-21T02:26:35.295154+0000 mgr.a (mgr.14388) 10911 : audit [DBG] from='client.240216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:35 smithi049 bash[23528]: audit 2024-09-21T02:26:34.613766+0000 mon.a (mon.0) 8995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:35 smithi049 bash[23528]: audit 2024-09-21T02:26:34.622697+0000 mon.a (mon.0) 8996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:35 smithi049 bash[23528]: audit 2024-09-21T02:26:34.633485+0000 mon.a (mon.0) 8997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:35 smithi049 bash[23528]: cluster 2024-09-21T02:26:35.070015+0000 mgr.a (mgr.14388) 10910 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:35 smithi049 bash[23528]: audit 2024-09-21T02:26:35.295154+0000 mgr.a (mgr.14388) 10911 : audit [DBG] from='client.240216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:38.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:38 smithi044 bash[22676]: cluster 2024-09-21T02:26:37.070872+0000 mgr.a (mgr.14388) 10912 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:38 smithi179 bash[23186]: cluster 2024-09-21T02:26:37.070872+0000 mgr.a (mgr.14388) 10912 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:38 smithi049 bash[23528]: cluster 2024-09-21T02:26:37.070872+0000 mgr.a (mgr.14388) 10912 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:40 smithi179 bash[23186]: cluster 2024-09-21T02:26:39.071674+0000 mgr.a (mgr.14388) 10913 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:40.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:40 smithi044 bash[22676]: cluster 2024-09-21T02:26:39.071674+0000 mgr.a (mgr.14388) 10913 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:40 smithi049 bash[23528]: cluster 2024-09-21T02:26:39.071674+0000 mgr.a (mgr.14388) 10913 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:40.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:40.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:41.533 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:41.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:41.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:41.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:41.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:42 smithi044 bash[22676]: cluster 2024-09-21T02:26:41.073828+0000 mgr.a (mgr.14388) 10914 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:42 smithi044 bash[22676]: audit 2024-09-21T02:26:41.087044+0000 mgr.a (mgr.14388) 10915 : audit [DBG] from='client.240291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:42 smithi179 bash[23186]: cluster 2024-09-21T02:26:41.073828+0000 mgr.a (mgr.14388) 10914 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:42 smithi179 bash[23186]: audit 2024-09-21T02:26:41.087044+0000 mgr.a (mgr.14388) 10915 : audit [DBG] from='client.240291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:42 smithi049 bash[23528]: cluster 2024-09-21T02:26:41.073828+0000 mgr.a (mgr.14388) 10914 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:42 smithi049 bash[23528]: audit 2024-09-21T02:26:41.087044+0000 mgr.a (mgr.14388) 10915 : audit [DBG] from='client.240291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:44 smithi044 bash[22676]: cluster 2024-09-21T02:26:43.074732+0000 mgr.a (mgr.14388) 10916 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:44 smithi179 bash[23186]: cluster 2024-09-21T02:26:43.074732+0000 mgr.a (mgr.14388) 10916 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:44 smithi049 bash[23528]: cluster 2024-09-21T02:26:43.074732+0000 mgr.a (mgr.14388) 10916 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:26:46.434 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:46 smithi049 bash[23528]: cluster 2024-09-21T02:26:45.076906+0000 mgr.a (mgr.14388) 10917 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:46.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:46 smithi044 bash[22676]: cluster 2024-09-21T02:26:45.076906+0000 mgr.a (mgr.14388) 10917 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:46 smithi179 bash[23186]: cluster 2024-09-21T02:26:45.076906+0000 mgr.a (mgr.14388) 10917 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:46.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:46.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:46.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:47.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: audit 2024-09-21T02:26:46.876935+0000 mgr.a (mgr.14388) 10918 : audit [DBG] from='client.240369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: cluster 2024-09-21T02:26:47.077463+0000 mgr.a (mgr.14388) 10919 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: audit 2024-09-21T02:26:47.506437+0000 mon.a (mon.0) 8998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: audit 2024-09-21T02:26:47.514571+0000 mon.a (mon.0) 8999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: audit 2024-09-21T02:26:47.525636+0000 mon.a (mon.0) 9000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: audit 2024-09-21T02:26:47.644906+0000 mon.a (mon.0) 9001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: audit 2024-09-21T02:26:47.653416+0000 mon.a (mon.0) 9002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:48 smithi044 bash[22676]: audit 2024-09-21T02:26:47.663635+0000 mon.a (mon.0) 9003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: audit 2024-09-21T02:26:46.876935+0000 mgr.a (mgr.14388) 10918 : audit [DBG] from='client.240369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: cluster 2024-09-21T02:26:47.077463+0000 mgr.a (mgr.14388) 10919 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: audit 2024-09-21T02:26:47.506437+0000 mon.a (mon.0) 8998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: audit 2024-09-21T02:26:47.514571+0000 mon.a (mon.0) 8999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: audit 2024-09-21T02:26:47.525636+0000 mon.a (mon.0) 9000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: audit 2024-09-21T02:26:47.644906+0000 mon.a (mon.0) 9001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: audit 2024-09-21T02:26:47.653416+0000 mon.a (mon.0) 9002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:48 smithi179 bash[23186]: audit 2024-09-21T02:26:47.663635+0000 mon.a (mon.0) 9003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: audit 2024-09-21T02:26:46.876935+0000 mgr.a (mgr.14388) 10918 : audit [DBG] from='client.240369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: cluster 2024-09-21T02:26:47.077463+0000 mgr.a (mgr.14388) 10919 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: audit 2024-09-21T02:26:47.506437+0000 mon.a (mon.0) 8998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: audit 2024-09-21T02:26:47.514571+0000 mon.a (mon.0) 8999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: audit 2024-09-21T02:26:47.525636+0000 mon.a (mon.0) 9000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: audit 2024-09-21T02:26:47.644906+0000 mon.a (mon.0) 9001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: audit 2024-09-21T02:26:47.653416+0000 mon.a (mon.0) 9002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:48.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:48 smithi049 bash[23528]: audit 2024-09-21T02:26:47.663635+0000 mon.a (mon.0) 9003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:50 smithi044 bash[22676]: cluster 2024-09-21T02:26:49.078371+0000 mgr.a (mgr.14388) 10920 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:50 smithi179 bash[23186]: cluster 2024-09-21T02:26:49.078371+0000 mgr.a (mgr.14388) 10920 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:50 smithi049 bash[23528]: cluster 2024-09-21T02:26:49.078371+0000 mgr.a (mgr.14388) 10920 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:52.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:52.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:52.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:52 smithi044 bash[22676]: cluster 2024-09-21T02:26:51.080672+0000 mgr.a (mgr.14388) 10921 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:52 smithi179 bash[23186]: cluster 2024-09-21T02:26:51.080672+0000 mgr.a (mgr.14388) 10921 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:52 smithi049 bash[23528]: cluster 2024-09-21T02:26:51.080672+0000 mgr.a (mgr.14388) 10921 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:53.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:53.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:53.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:53.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:53.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:54 smithi044 bash[22676]: audit 2024-09-21T02:26:52.674960+0000 mgr.a (mgr.14388) 10922 : audit [DBG] from='client.240447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:54 smithi044 bash[22676]: cluster 2024-09-21T02:26:53.081226+0000 mgr.a (mgr.14388) 10923 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:54 smithi179 bash[23186]: audit 2024-09-21T02:26:52.674960+0000 mgr.a (mgr.14388) 10922 : audit [DBG] from='client.240447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:54 smithi179 bash[23186]: cluster 2024-09-21T02:26:53.081226+0000 mgr.a (mgr.14388) 10923 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:54 smithi049 bash[23528]: audit 2024-09-21T02:26:52.674960+0000 mgr.a (mgr.14388) 10922 : audit [DBG] from='client.240447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:26:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:54 smithi049 bash[23528]: cluster 2024-09-21T02:26:53.081226+0000 mgr.a (mgr.14388) 10923 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:55 smithi044 bash[22676]: audit 2024-09-21T02:26:54.849865+0000 mon.a (mon.0) 9004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:55 smithi044 bash[22676]: audit 2024-09-21T02:26:54.858661+0000 mon.a (mon.0) 9005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:55 smithi044 bash[22676]: audit 2024-09-21T02:26:54.870530+0000 mon.a (mon.0) 9006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:55 smithi044 bash[22676]: cluster 2024-09-21T02:26:55.083329+0000 mgr.a (mgr.14388) 10924 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:56.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:55 smithi179 bash[23186]: audit 2024-09-21T02:26:54.849865+0000 mon.a (mon.0) 9004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:55 smithi179 bash[23186]: audit 2024-09-21T02:26:54.858661+0000 mon.a (mon.0) 9005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:55 smithi179 bash[23186]: audit 2024-09-21T02:26:54.870530+0000 mon.a (mon.0) 9006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:55 smithi179 bash[23186]: cluster 2024-09-21T02:26:55.083329+0000 mgr.a (mgr.14388) 10924 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:55 smithi049 bash[23528]: audit 2024-09-21T02:26:54.849865+0000 mon.a (mon.0) 9004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:55 smithi049 bash[23528]: audit 2024-09-21T02:26:54.858661+0000 mon.a (mon.0) 9005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:55 smithi049 bash[23528]: audit 2024-09-21T02:26:54.870530+0000 mon.a (mon.0) 9006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:55 smithi049 bash[23528]: cluster 2024-09-21T02:26:55.083329+0000 mgr.a (mgr.14388) 10924 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:26:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:57 smithi044 bash[22676]: audit 2024-09-21T02:26:57.038768+0000 mon.a (mon.0) 9007 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:26:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:57 smithi044 bash[22676]: audit 2024-09-21T02:26:57.045308+0000 mon.a (mon.0) 9008 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:26:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:57 smithi044 bash[22676]: audit 2024-09-21T02:26:57.047190+0000 mon.a (mon.0) 9009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:26:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:57 smithi044 bash[22676]: audit 2024-09-21T02:26:57.058384+0000 mon.a (mon.0) 9010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:57 smithi044 bash[22676]: audit 2024-09-21T02:26:57.064652+0000 mon.a (mon.0) 9011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:26:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:57 smithi179 bash[23186]: audit 2024-09-21T02:26:57.038768+0000 mon.a (mon.0) 9007 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:26:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:57 smithi179 bash[23186]: audit 2024-09-21T02:26:57.045308+0000 mon.a (mon.0) 9008 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:26:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:57 smithi179 bash[23186]: audit 2024-09-21T02:26:57.047190+0000 mon.a (mon.0) 9009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:26:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:57 smithi179 bash[23186]: audit 2024-09-21T02:26:57.058384+0000 mon.a (mon.0) 9010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:57 smithi179 bash[23186]: audit 2024-09-21T02:26:57.064652+0000 mon.a (mon.0) 9011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:26:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:57 smithi049 bash[23528]: audit 2024-09-21T02:26:57.038768+0000 mon.a (mon.0) 9007 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:26:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:57 smithi049 bash[23528]: audit 2024-09-21T02:26:57.045308+0000 mon.a (mon.0) 9008 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:26:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:57 smithi049 bash[23528]: audit 2024-09-21T02:26:57.047190+0000 mon.a (mon.0) 9009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:26:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:57 smithi049 bash[23528]: audit 2024-09-21T02:26:57.058384+0000 mon.a (mon.0) 9010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:26:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:57 smithi049 bash[23528]: audit 2024-09-21T02:26:57.064652+0000 mon.a (mon.0) 9011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:26:58.093 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:26:57 smithi044 bash[22930]: debug 2024-09-21T02:26:57.840+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:26:58.093 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:26:57 smithi044 bash[22930]: debug 2024-09-21T02:26:57.840+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:26:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:26:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:26:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:26:58.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:58 smithi179 bash[23186]: audit 2024-09-21T02:26:57.067034+0000 mgr.a (mgr.14388) 10925 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:26:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:58 smithi179 bash[23186]: cluster 2024-09-21T02:26:57.087313+0000 mgr.a (mgr.14388) 10926 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:58 smithi044 bash[22676]: audit 2024-09-21T02:26:57.067034+0000 mgr.a (mgr.14388) 10925 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:26:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:58 smithi044 bash[22676]: cluster 2024-09-21T02:26:57.087313+0000 mgr.a (mgr.14388) 10926 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:58 smithi049 bash[23528]: audit 2024-09-21T02:26:57.067034+0000 mgr.a (mgr.14388) 10925 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:26:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:58 smithi049 bash[23528]: cluster 2024-09-21T02:26:57.087313+0000 mgr.a (mgr.14388) 10926 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:26:58.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:26:58.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:26:58.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:26:58.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:26:58.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:26:59.442 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:59 smithi179 bash[23186]: audit 2024-09-21T02:26:57.842597+0000 mgr.a (mgr.14388) 10927 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:26:59.442 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:26:59 smithi179 bash[23186]: cephadm 2024-09-21T02:26:57.844320+0000 mgr.a (mgr.14388) 10928 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:26:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:59 smithi044 bash[22676]: audit 2024-09-21T02:26:57.842597+0000 mgr.a (mgr.14388) 10927 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:26:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:26:59 smithi044 bash[22676]: cephadm 2024-09-21T02:26:57.844320+0000 mgr.a (mgr.14388) 10928 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:26:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:59 smithi049 bash[23528]: audit 2024-09-21T02:26:57.842597+0000 mgr.a (mgr.14388) 10927 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:26:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:26:59 smithi049 bash[23528]: cephadm 2024-09-21T02:26:57.844320+0000 mgr.a (mgr.14388) 10928 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:27:00.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:00 smithi179 bash[23186]: audit 2024-09-21T02:26:58.469804+0000 mgr.a (mgr.14388) 10929 : audit [DBG] from='client.240627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:00.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:00 smithi179 bash[23186]: cluster 2024-09-21T02:26:59.088450+0000 mgr.a (mgr.14388) 10930 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:00 smithi044 bash[22676]: audit 2024-09-21T02:26:58.469804+0000 mgr.a (mgr.14388) 10929 : audit [DBG] from='client.240627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:00 smithi044 bash[22676]: cluster 2024-09-21T02:26:59.088450+0000 mgr.a (mgr.14388) 10930 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:00 smithi049 bash[23528]: audit 2024-09-21T02:26:58.469804+0000 mgr.a (mgr.14388) 10929 : audit [DBG] from='client.240627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:00 smithi049 bash[23528]: cluster 2024-09-21T02:26:59.088450+0000 mgr.a (mgr.14388) 10930 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:02 smithi044 bash[22676]: cluster 2024-09-21T02:27:01.089767+0000 mgr.a (mgr.14388) 10931 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:02 smithi179 bash[23186]: cluster 2024-09-21T02:27:01.089767+0000 mgr.a (mgr.14388) 10931 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:02 smithi049 bash[23528]: cluster 2024-09-21T02:27:01.089767+0000 mgr.a (mgr.14388) 10931 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:03.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:03.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:04 smithi044 bash[22676]: cluster 2024-09-21T02:27:03.090670+0000 mgr.a (mgr.14388) 10932 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:04 smithi179 bash[23186]: cluster 2024-09-21T02:27:03.090670+0000 mgr.a (mgr.14388) 10932 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:04 smithi049 bash[23528]: cluster 2024-09-21T02:27:03.090670+0000 mgr.a (mgr.14388) 10932 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:04.720 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:04.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:04.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:04.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:05 smithi044 bash[22676]: audit 2024-09-21T02:27:04.262705+0000 mgr.a (mgr.14388) 10933 : audit [DBG] from='client.240705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:05.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:05 smithi179 bash[23186]: audit 2024-09-21T02:27:04.262705+0000 mgr.a (mgr.14388) 10933 : audit [DBG] from='client.240705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:05 smithi049 bash[23528]: audit 2024-09-21T02:27:04.262705+0000 mgr.a (mgr.14388) 10933 : audit [DBG] from='client.240705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:06 smithi044 bash[22676]: cluster 2024-09-21T02:27:05.093059+0000 mgr.a (mgr.14388) 10934 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:06 smithi179 bash[23186]: cluster 2024-09-21T02:27:05.093059+0000 mgr.a (mgr.14388) 10934 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:06 smithi049 bash[23528]: cluster 2024-09-21T02:27:05.093059+0000 mgr.a (mgr.14388) 10934 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:08 smithi044 bash[22676]: cluster 2024-09-21T02:27:07.093915+0000 mgr.a (mgr.14388) 10935 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:08 smithi044 bash[22676]: audit 2024-09-21T02:27:07.721588+0000 mon.a (mon.0) 9012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:08 smithi044 bash[22676]: audit 2024-09-21T02:27:07.727140+0000 mon.a (mon.0) 9013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:08 smithi044 bash[22676]: audit 2024-09-21T02:27:07.734352+0000 mon.a (mon.0) 9014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:08 smithi044 bash[22676]: audit 2024-09-21T02:27:07.887707+0000 mon.a (mon.0) 9015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:08 smithi044 bash[22676]: audit 2024-09-21T02:27:07.896510+0000 mon.a (mon.0) 9016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:08 smithi044 bash[22676]: audit 2024-09-21T02:27:07.907282+0000 mon.a (mon.0) 9017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:08 smithi049 bash[23528]: cluster 2024-09-21T02:27:07.093915+0000 mgr.a (mgr.14388) 10935 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:08 smithi049 bash[23528]: audit 2024-09-21T02:27:07.721588+0000 mon.a (mon.0) 9012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:08 smithi049 bash[23528]: audit 2024-09-21T02:27:07.727140+0000 mon.a (mon.0) 9013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:08 smithi049 bash[23528]: audit 2024-09-21T02:27:07.734352+0000 mon.a (mon.0) 9014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:08 smithi049 bash[23528]: audit 2024-09-21T02:27:07.887707+0000 mon.a (mon.0) 9015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:08 smithi049 bash[23528]: audit 2024-09-21T02:27:07.896510+0000 mon.a (mon.0) 9016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:08 smithi049 bash[23528]: audit 2024-09-21T02:27:07.907282+0000 mon.a (mon.0) 9017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:08 smithi179 bash[23186]: cluster 2024-09-21T02:27:07.093915+0000 mgr.a (mgr.14388) 10935 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:08 smithi179 bash[23186]: audit 2024-09-21T02:27:07.721588+0000 mon.a (mon.0) 9012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:08 smithi179 bash[23186]: audit 2024-09-21T02:27:07.727140+0000 mon.a (mon.0) 9013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:08 smithi179 bash[23186]: audit 2024-09-21T02:27:07.734352+0000 mon.a (mon.0) 9014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:08 smithi179 bash[23186]: audit 2024-09-21T02:27:07.887707+0000 mon.a (mon.0) 9015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:08 smithi179 bash[23186]: audit 2024-09-21T02:27:07.896510+0000 mon.a (mon.0) 9016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:08 smithi179 bash[23186]: audit 2024-09-21T02:27:07.907282+0000 mon.a (mon.0) 9017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:09.723 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:09.723 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:10 smithi049 bash[23528]: cluster 2024-09-21T02:27:09.094739+0000 mgr.a (mgr.14388) 10936 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:10 smithi044 bash[22676]: cluster 2024-09-21T02:27:09.094739+0000 mgr.a (mgr.14388) 10936 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:10 smithi179 bash[23186]: cluster 2024-09-21T02:27:09.094739+0000 mgr.a (mgr.14388) 10936 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:10.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:10.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:10.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:11 smithi044 bash[22676]: audit 2024-09-21T02:27:10.060066+0000 mgr.a (mgr.14388) 10937 : audit [DBG] from='client.240777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:11.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:11 smithi179 bash[23186]: audit 2024-09-21T02:27:10.060066+0000 mgr.a (mgr.14388) 10937 : audit [DBG] from='client.240777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:11 smithi049 bash[23528]: audit 2024-09-21T02:27:10.060066+0000 mgr.a (mgr.14388) 10937 : audit [DBG] from='client.240777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:12 smithi044 bash[22676]: cluster 2024-09-21T02:27:11.097715+0000 mgr.a (mgr.14388) 10938 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:12 smithi179 bash[23186]: cluster 2024-09-21T02:27:11.097715+0000 mgr.a (mgr.14388) 10938 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:12 smithi049 bash[23528]: cluster 2024-09-21T02:27:11.097715+0000 mgr.a (mgr.14388) 10938 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:27:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:14 smithi044 bash[22676]: cluster 2024-09-21T02:27:13.098501+0000 mgr.a (mgr.14388) 10939 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:14 smithi179 bash[23186]: cluster 2024-09-21T02:27:13.098501+0000 mgr.a (mgr.14388) 10939 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:14 smithi049 bash[23528]: cluster 2024-09-21T02:27:13.098501+0000 mgr.a (mgr.14388) 10939 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:15.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:16.251 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:16.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:16.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:16.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:16.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:16 smithi044 bash[22676]: audit 2024-09-21T02:27:15.087803+0000 mon.a (mon.0) 9018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:16 smithi044 bash[22676]: audit 2024-09-21T02:27:15.097004+0000 mon.a (mon.0) 9019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:16 smithi044 bash[22676]: cluster 2024-09-21T02:27:15.100433+0000 mgr.a (mgr.14388) 10940 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:16 smithi044 bash[22676]: audit 2024-09-21T02:27:15.108768+0000 mon.a (mon.0) 9020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:16 smithi179 bash[23186]: audit 2024-09-21T02:27:15.087803+0000 mon.a (mon.0) 9018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:16 smithi179 bash[23186]: audit 2024-09-21T02:27:15.097004+0000 mon.a (mon.0) 9019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:16 smithi179 bash[23186]: cluster 2024-09-21T02:27:15.100433+0000 mgr.a (mgr.14388) 10940 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:16 smithi179 bash[23186]: audit 2024-09-21T02:27:15.108768+0000 mon.a (mon.0) 9020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:16 smithi049 bash[23528]: audit 2024-09-21T02:27:15.087803+0000 mon.a (mon.0) 9018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:16 smithi049 bash[23528]: audit 2024-09-21T02:27:15.097004+0000 mon.a (mon.0) 9019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:16 smithi049 bash[23528]: cluster 2024-09-21T02:27:15.100433+0000 mgr.a (mgr.14388) 10940 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:16 smithi049 bash[23528]: audit 2024-09-21T02:27:15.108768+0000 mon.a (mon.0) 9020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:17.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:17 smithi179 bash[23186]: audit 2024-09-21T02:27:15.833873+0000 mgr.a (mgr.14388) 10941 : audit [DBG] from='client.240855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:17 smithi044 bash[22676]: audit 2024-09-21T02:27:15.833873+0000 mgr.a (mgr.14388) 10941 : audit [DBG] from='client.240855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:17 smithi049 bash[23528]: audit 2024-09-21T02:27:15.833873+0000 mgr.a (mgr.14388) 10941 : audit [DBG] from='client.240855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:18.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:18 smithi179 bash[23186]: cluster 2024-09-21T02:27:17.101717+0000 mgr.a (mgr.14388) 10942 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:18 smithi044 bash[22676]: cluster 2024-09-21T02:27:17.101717+0000 mgr.a (mgr.14388) 10942 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:18 smithi049 bash[23528]: cluster 2024-09-21T02:27:17.101717+0000 mgr.a (mgr.14388) 10942 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:20.474 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:20 smithi179 bash[23186]: cluster 2024-09-21T02:27:19.102657+0000 mgr.a (mgr.14388) 10943 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:20 smithi044 bash[22676]: cluster 2024-09-21T02:27:19.102657+0000 mgr.a (mgr.14388) 10943 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:20 smithi049 bash[23528]: cluster 2024-09-21T02:27:19.102657+0000 mgr.a (mgr.14388) 10943 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:21.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:22.016 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:22.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:22 smithi044 bash[22676]: cluster 2024-09-21T02:27:21.104723+0000 mgr.a (mgr.14388) 10944 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:22 smithi179 bash[23186]: cluster 2024-09-21T02:27:21.104723+0000 mgr.a (mgr.14388) 10944 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:22 smithi049 bash[23528]: cluster 2024-09-21T02:27:21.104723+0000 mgr.a (mgr.14388) 10944 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:23 smithi044 bash[22676]: audit 2024-09-21T02:27:21.591260+0000 mgr.a (mgr.14388) 10945 : audit [DBG] from='client.240933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:23 smithi179 bash[23186]: audit 2024-09-21T02:27:21.591260+0000 mgr.a (mgr.14388) 10945 : audit [DBG] from='client.240933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:23 smithi049 bash[23528]: audit 2024-09-21T02:27:21.591260+0000 mgr.a (mgr.14388) 10945 : audit [DBG] from='client.240933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:24 smithi044 bash[22676]: cluster 2024-09-21T02:27:23.105742+0000 mgr.a (mgr.14388) 10946 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:24 smithi179 bash[23186]: cluster 2024-09-21T02:27:23.105742+0000 mgr.a (mgr.14388) 10946 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:24 smithi049 bash[23528]: cluster 2024-09-21T02:27:23.105742+0000 mgr.a (mgr.14388) 10946 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:26 smithi044 bash[22676]: cluster 2024-09-21T02:27:25.107898+0000 mgr.a (mgr.14388) 10947 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:26 smithi179 bash[23186]: cluster 2024-09-21T02:27:25.107898+0000 mgr.a (mgr.14388) 10947 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:26 smithi049 bash[23528]: cluster 2024-09-21T02:27:25.107898+0000 mgr.a (mgr.14388) 10947 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:27.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:27.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:27.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:27.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:27.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:27.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:27.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:27.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:28 smithi179 bash[23186]: cluster 2024-09-21T02:27:27.108589+0000 mgr.a (mgr.14388) 10948 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:28 smithi179 bash[23186]: audit 2024-09-21T02:27:27.361368+0000 mgr.a (mgr.14388) 10949 : audit [DBG] from='client.241011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:28 smithi179 bash[23186]: audit 2024-09-21T02:27:27.942614+0000 mon.a (mon.0) 9021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:28 smithi179 bash[23186]: audit 2024-09-21T02:27:27.948477+0000 mon.a (mon.0) 9022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:28 smithi179 bash[23186]: audit 2024-09-21T02:27:27.955708+0000 mon.a (mon.0) 9023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:28 smithi179 bash[23186]: audit 2024-09-21T02:27:28.126244+0000 mon.a (mon.0) 9024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:28 smithi044 bash[22676]: cluster 2024-09-21T02:27:27.108589+0000 mgr.a (mgr.14388) 10948 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:28 smithi044 bash[22676]: audit 2024-09-21T02:27:27.361368+0000 mgr.a (mgr.14388) 10949 : audit [DBG] from='client.241011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:28 smithi044 bash[22676]: audit 2024-09-21T02:27:27.942614+0000 mon.a (mon.0) 9021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:28 smithi044 bash[22676]: audit 2024-09-21T02:27:27.948477+0000 mon.a (mon.0) 9022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:28 smithi044 bash[22676]: audit 2024-09-21T02:27:27.955708+0000 mon.a (mon.0) 9023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:28 smithi044 bash[22676]: audit 2024-09-21T02:27:28.126244+0000 mon.a (mon.0) 9024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:28 smithi049 bash[23528]: cluster 2024-09-21T02:27:27.108589+0000 mgr.a (mgr.14388) 10948 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:28 smithi049 bash[23528]: audit 2024-09-21T02:27:27.361368+0000 mgr.a (mgr.14388) 10949 : audit [DBG] from='client.241011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:28 smithi049 bash[23528]: audit 2024-09-21T02:27:27.942614+0000 mon.a (mon.0) 9021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:28 smithi049 bash[23528]: audit 2024-09-21T02:27:27.948477+0000 mon.a (mon.0) 9022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:28 smithi049 bash[23528]: audit 2024-09-21T02:27:27.955708+0000 mon.a (mon.0) 9023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:28 smithi049 bash[23528]: audit 2024-09-21T02:27:28.126244+0000 mon.a (mon.0) 9024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:29 smithi044 bash[22676]: audit 2024-09-21T02:27:28.134593+0000 mon.a (mon.0) 9025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:29 smithi044 bash[22676]: audit 2024-09-21T02:27:28.148522+0000 mon.a (mon.0) 9026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:29 smithi179 bash[23186]: audit 2024-09-21T02:27:28.134593+0000 mon.a (mon.0) 9025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:29.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:29 smithi179 bash[23186]: audit 2024-09-21T02:27:28.148522+0000 mon.a (mon.0) 9026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:29.530 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:29 smithi049 bash[23528]: audit 2024-09-21T02:27:28.134593+0000 mon.a (mon.0) 9025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:29.530 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:29 smithi049 bash[23528]: audit 2024-09-21T02:27:28.148522+0000 mon.a (mon.0) 9026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:30.453 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:30 smithi049 bash[23528]: cluster 2024-09-21T02:27:29.109525+0000 mgr.a (mgr.14388) 10950 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:30 smithi044 bash[22676]: cluster 2024-09-21T02:27:29.109525+0000 mgr.a (mgr.14388) 10950 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:30 smithi179 bash[23186]: cluster 2024-09-21T02:27:29.109525+0000 mgr.a (mgr.14388) 10950 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:32 smithi044 bash[22676]: cluster 2024-09-21T02:27:31.111700+0000 mgr.a (mgr.14388) 10951 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:32 smithi179 bash[23186]: cluster 2024-09-21T02:27:31.111700+0000 mgr.a (mgr.14388) 10951 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:32 smithi049 bash[23528]: cluster 2024-09-21T02:27:31.111700+0000 mgr.a (mgr.14388) 10951 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:32.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:32.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:32.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:33.605 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:33.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:33.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:33.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:33.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:34 smithi044 bash[22676]: cluster 2024-09-21T02:27:33.112421+0000 mgr.a (mgr.14388) 10952 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:34 smithi044 bash[22676]: audit 2024-09-21T02:27:33.164537+0000 mgr.a (mgr.14388) 10953 : audit [DBG] from='client.241089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:34 smithi179 bash[23186]: cluster 2024-09-21T02:27:33.112421+0000 mgr.a (mgr.14388) 10952 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:34 smithi179 bash[23186]: audit 2024-09-21T02:27:33.164537+0000 mgr.a (mgr.14388) 10953 : audit [DBG] from='client.241089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:34 smithi049 bash[23528]: cluster 2024-09-21T02:27:33.112421+0000 mgr.a (mgr.14388) 10952 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:34 smithi049 bash[23528]: audit 2024-09-21T02:27:33.164537+0000 mgr.a (mgr.14388) 10953 : audit [DBG] from='client.241089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:36 smithi044 bash[22676]: cluster 2024-09-21T02:27:35.114727+0000 mgr.a (mgr.14388) 10954 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:36 smithi044 bash[22676]: audit 2024-09-21T02:27:35.323599+0000 mon.a (mon.0) 9027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:36 smithi044 bash[22676]: audit 2024-09-21T02:27:35.332371+0000 mon.a (mon.0) 9028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:36 smithi044 bash[22676]: audit 2024-09-21T02:27:35.342852+0000 mon.a (mon.0) 9029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:36 smithi179 bash[23186]: cluster 2024-09-21T02:27:35.114727+0000 mgr.a (mgr.14388) 10954 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:36 smithi179 bash[23186]: audit 2024-09-21T02:27:35.323599+0000 mon.a (mon.0) 9027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:36 smithi179 bash[23186]: audit 2024-09-21T02:27:35.332371+0000 mon.a (mon.0) 9028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:36 smithi179 bash[23186]: audit 2024-09-21T02:27:35.342852+0000 mon.a (mon.0) 9029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:36 smithi049 bash[23528]: cluster 2024-09-21T02:27:35.114727+0000 mgr.a (mgr.14388) 10954 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:36 smithi049 bash[23528]: audit 2024-09-21T02:27:35.323599+0000 mon.a (mon.0) 9027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:36 smithi049 bash[23528]: audit 2024-09-21T02:27:35.332371+0000 mon.a (mon.0) 9028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:36 smithi049 bash[23528]: audit 2024-09-21T02:27:35.342852+0000 mon.a (mon.0) 9029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:38 smithi179 bash[23186]: cluster 2024-09-21T02:27:37.115506+0000 mgr.a (mgr.14388) 10955 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:38.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:38.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:38.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:38 smithi044 bash[22676]: cluster 2024-09-21T02:27:37.115506+0000 mgr.a (mgr.14388) 10955 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:38 smithi049 bash[23528]: cluster 2024-09-21T02:27:37.115506+0000 mgr.a (mgr.14388) 10955 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:39.407 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:39.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:39.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:39.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:39.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:40.621 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:40 smithi179 bash[23186]: audit 2024-09-21T02:27:38.945953+0000 mgr.a (mgr.14388) 10956 : audit [DBG] from='client.241164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:40.621 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:40 smithi179 bash[23186]: cluster 2024-09-21T02:27:39.116070+0000 mgr.a (mgr.14388) 10957 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:40 smithi044 bash[22676]: audit 2024-09-21T02:27:38.945953+0000 mgr.a (mgr.14388) 10956 : audit [DBG] from='client.241164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:40 smithi044 bash[22676]: cluster 2024-09-21T02:27:39.116070+0000 mgr.a (mgr.14388) 10957 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:40 smithi049 bash[23528]: audit 2024-09-21T02:27:38.945953+0000 mgr.a (mgr.14388) 10956 : audit [DBG] from='client.241164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:40 smithi049 bash[23528]: cluster 2024-09-21T02:27:39.116070+0000 mgr.a (mgr.14388) 10957 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:42 smithi044 bash[22676]: cluster 2024-09-21T02:27:41.117969+0000 mgr.a (mgr.14388) 10958 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:42 smithi179 bash[23186]: cluster 2024-09-21T02:27:41.117969+0000 mgr.a (mgr.14388) 10958 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:42 smithi049 bash[23528]: cluster 2024-09-21T02:27:41.117969+0000 mgr.a (mgr.14388) 10958 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:27:44.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:44.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:44.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:44 smithi044 bash[22676]: cluster 2024-09-21T02:27:43.118735+0000 mgr.a (mgr.14388) 10959 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:44 smithi179 bash[23186]: cluster 2024-09-21T02:27:43.118735+0000 mgr.a (mgr.14388) 10959 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:44 smithi049 bash[23528]: cluster 2024-09-21T02:27:43.118735+0000 mgr.a (mgr.14388) 10959 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:45.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:45.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:46 smithi044 bash[22676]: audit 2024-09-21T02:27:44.744484+0000 mgr.a (mgr.14388) 10960 : audit [DBG] from='client.241239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:46 smithi044 bash[22676]: cluster 2024-09-21T02:27:45.120773+0000 mgr.a (mgr.14388) 10961 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:27:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:46 smithi179 bash[23186]: audit 2024-09-21T02:27:44.744484+0000 mgr.a (mgr.14388) 10960 : audit [DBG] from='client.241239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:46 smithi179 bash[23186]: cluster 2024-09-21T02:27:45.120773+0000 mgr.a (mgr.14388) 10961 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:27:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:46 smithi049 bash[23528]: audit 2024-09-21T02:27:44.744484+0000 mgr.a (mgr.14388) 10960 : audit [DBG] from='client.241239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:46 smithi049 bash[23528]: cluster 2024-09-21T02:27:45.120773+0000 mgr.a (mgr.14388) 10961 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:27:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:48 smithi179 bash[23186]: cluster 2024-09-21T02:27:47.121674+0000 mgr.a (mgr.14388) 10962 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:27:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:48 smithi179 bash[23186]: audit 2024-09-21T02:27:48.161883+0000 mon.a (mon.0) 9030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:48 smithi179 bash[23186]: audit 2024-09-21T02:27:48.169580+0000 mon.a (mon.0) 9031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:48 smithi179 bash[23186]: audit 2024-09-21T02:27:48.176698+0000 mon.a (mon.0) 9032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:48 smithi049 bash[23528]: cluster 2024-09-21T02:27:47.121674+0000 mgr.a (mgr.14388) 10962 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:27:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:48 smithi049 bash[23528]: audit 2024-09-21T02:27:48.161883+0000 mon.a (mon.0) 9030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:48 smithi049 bash[23528]: audit 2024-09-21T02:27:48.169580+0000 mon.a (mon.0) 9031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:48 smithi049 bash[23528]: audit 2024-09-21T02:27:48.176698+0000 mon.a (mon.0) 9032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:48 smithi044 bash[22676]: cluster 2024-09-21T02:27:47.121674+0000 mgr.a (mgr.14388) 10962 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:27:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:48 smithi044 bash[22676]: audit 2024-09-21T02:27:48.161883+0000 mon.a (mon.0) 9030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:48 smithi044 bash[22676]: audit 2024-09-21T02:27:48.169580+0000 mon.a (mon.0) 9031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:48 smithi044 bash[22676]: audit 2024-09-21T02:27:48.176698+0000 mon.a (mon.0) 9032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:49 smithi044 bash[22676]: audit 2024-09-21T02:27:48.365440+0000 mon.a (mon.0) 9033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:49 smithi044 bash[22676]: audit 2024-09-21T02:27:48.373434+0000 mon.a (mon.0) 9034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:49 smithi044 bash[22676]: audit 2024-09-21T02:27:48.384634+0000 mon.a (mon.0) 9035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:49 smithi179 bash[23186]: audit 2024-09-21T02:27:48.365440+0000 mon.a (mon.0) 9033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:49 smithi179 bash[23186]: audit 2024-09-21T02:27:48.373434+0000 mon.a (mon.0) 9034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:49 smithi179 bash[23186]: audit 2024-09-21T02:27:48.384634+0000 mon.a (mon.0) 9035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:49 smithi049 bash[23528]: audit 2024-09-21T02:27:48.365440+0000 mon.a (mon.0) 9033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:49 smithi049 bash[23528]: audit 2024-09-21T02:27:48.373434+0000 mon.a (mon.0) 9034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:49 smithi049 bash[23528]: audit 2024-09-21T02:27:48.384634+0000 mon.a (mon.0) 9035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:50.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:50 smithi044 bash[22676]: cluster 2024-09-21T02:27:49.122452+0000 mgr.a (mgr.14388) 10963 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:27:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:50 smithi179 bash[23186]: cluster 2024-09-21T02:27:49.122452+0000 mgr.a (mgr.14388) 10963 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:27:50.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:50 smithi049 bash[23528]: cluster 2024-09-21T02:27:49.122452+0000 mgr.a (mgr.14388) 10963 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:27:50.944 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:51 smithi044 bash[22676]: audit 2024-09-21T02:27:50.514374+0000 mgr.a (mgr.14388) 10964 : audit [DBG] from='client.241314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:51 smithi044 bash[22676]: cluster 2024-09-21T02:27:51.125238+0000 mgr.a (mgr.14388) 10965 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:51 smithi179 bash[23186]: audit 2024-09-21T02:27:50.514374+0000 mgr.a (mgr.14388) 10964 : audit [DBG] from='client.241314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:51 smithi179 bash[23186]: cluster 2024-09-21T02:27:51.125238+0000 mgr.a (mgr.14388) 10965 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:51 smithi049 bash[23528]: audit 2024-09-21T02:27:50.514374+0000 mgr.a (mgr.14388) 10964 : audit [DBG] from='client.241314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:51 smithi049 bash[23528]: cluster 2024-09-21T02:27:51.125238+0000 mgr.a (mgr.14388) 10965 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:54 smithi044 bash[22676]: cluster 2024-09-21T02:27:53.126090+0000 mgr.a (mgr.14388) 10966 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:54.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:54 smithi179 bash[23186]: cluster 2024-09-21T02:27:53.126090+0000 mgr.a (mgr.14388) 10966 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:54 smithi049 bash[23528]: cluster 2024-09-21T02:27:53.126090+0000 mgr.a (mgr.14388) 10966 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:27:55.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:27:55.947 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:27:55.947 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:27:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:56 smithi044 bash[22676]: cluster 2024-09-21T02:27:55.128018+0000 mgr.a (mgr.14388) 10967 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:56 smithi044 bash[22676]: audit 2024-09-21T02:27:55.560872+0000 mon.a (mon.0) 9036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:56 smithi044 bash[22676]: audit 2024-09-21T02:27:55.569734+0000 mon.a (mon.0) 9037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:56 smithi044 bash[22676]: audit 2024-09-21T02:27:55.580203+0000 mon.a (mon.0) 9038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:56 smithi179 bash[23186]: cluster 2024-09-21T02:27:55.128018+0000 mgr.a (mgr.14388) 10967 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:56 smithi179 bash[23186]: audit 2024-09-21T02:27:55.560872+0000 mon.a (mon.0) 9036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:56 smithi179 bash[23186]: audit 2024-09-21T02:27:55.569734+0000 mon.a (mon.0) 9037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:56 smithi179 bash[23186]: audit 2024-09-21T02:27:55.580203+0000 mon.a (mon.0) 9038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:56 smithi049 bash[23528]: cluster 2024-09-21T02:27:55.128018+0000 mgr.a (mgr.14388) 10967 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:56 smithi049 bash[23528]: audit 2024-09-21T02:27:55.560872+0000 mon.a (mon.0) 9036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:56 smithi049 bash[23528]: audit 2024-09-21T02:27:55.569734+0000 mon.a (mon.0) 9037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:56 smithi049 bash[23528]: audit 2024-09-21T02:27:55.580203+0000 mon.a (mon.0) 9038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:56.718 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:27:56.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:27:56.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:27:56.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:27:56.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:27:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:57 smithi044 bash[22676]: audit 2024-09-21T02:27:56.285414+0000 mgr.a (mgr.14388) 10968 : audit [DBG] from='client.241389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:57.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:57 smithi179 bash[23186]: audit 2024-09-21T02:27:56.285414+0000 mgr.a (mgr.14388) 10968 : audit [DBG] from='client.241389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:57 smithi049 bash[23528]: audit 2024-09-21T02:27:56.285414+0000 mgr.a (mgr.14388) 10968 : audit [DBG] from='client.241389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:27:58.435 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:58 smithi179 bash[23186]: cluster 2024-09-21T02:27:57.129150+0000 mgr.a (mgr.14388) 10969 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:27:58.435 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:58 smithi179 bash[23186]: audit 2024-09-21T02:27:57.908388+0000 mon.a (mon.0) 9039 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:27:58.435 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:58 smithi179 bash[23186]: audit 2024-09-21T02:27:57.915979+0000 mon.a (mon.0) 9040 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:27:58.435 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:58 smithi179 bash[23186]: audit 2024-09-21T02:27:57.918030+0000 mon.a (mon.0) 9041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:27:58.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:58 smithi179 bash[23186]: audit 2024-09-21T02:27:57.929817+0000 mon.a (mon.0) 9042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:58.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:58 smithi179 bash[23186]: audit 2024-09-21T02:27:57.936104+0000 mon.a (mon.0) 9043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:27:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22676]: cluster 2024-09-21T02:27:57.129150+0000 mgr.a (mgr.14388) 10969 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:27:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22676]: audit 2024-09-21T02:27:57.908388+0000 mon.a (mon.0) 9039 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:27:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22676]: audit 2024-09-21T02:27:57.915979+0000 mon.a (mon.0) 9040 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:27:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22676]: audit 2024-09-21T02:27:57.918030+0000 mon.a (mon.0) 9041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:27:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22676]: audit 2024-09-21T02:27:57.929817+0000 mon.a (mon.0) 9042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:58.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22676]: audit 2024-09-21T02:27:57.936104+0000 mon.a (mon.0) 9043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:58 smithi049 bash[23528]: cluster 2024-09-21T02:27:57.129150+0000 mgr.a (mgr.14388) 10969 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:58 smithi049 bash[23528]: audit 2024-09-21T02:27:57.908388+0000 mon.a (mon.0) 9039 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:58 smithi049 bash[23528]: audit 2024-09-21T02:27:57.915979+0000 mon.a (mon.0) 9040 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:58 smithi049 bash[23528]: audit 2024-09-21T02:27:57.918030+0000 mon.a (mon.0) 9041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:58 smithi049 bash[23528]: audit 2024-09-21T02:27:57.929817+0000 mon.a (mon.0) 9042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:58 smithi049 bash[23528]: audit 2024-09-21T02:27:57.936104+0000 mon.a (mon.0) 9043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:27:58.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22930]: debug 2024-09-21T02:27:58.663+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:27:58.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:27:58 smithi044 bash[22930]: debug 2024-09-21T02:27:58.663+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:27:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:27:59 smithi044 bash[22676]: audit 2024-09-21T02:27:57.938720+0000 mgr.a (mgr.14388) 10970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:27:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:27:59 smithi179 bash[23186]: audit 2024-09-21T02:27:57.938720+0000 mgr.a (mgr.14388) 10970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:27:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:27:59 smithi049 bash[23528]: audit 2024-09-21T02:27:57.938720+0000 mgr.a (mgr.14388) 10970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:28:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:00 smithi044 bash[22676]: audit 2024-09-21T02:27:58.667395+0000 mgr.a (mgr.14388) 10971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:28:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:00 smithi044 bash[22676]: cephadm 2024-09-21T02:27:58.668533+0000 mgr.a (mgr.14388) 10972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:28:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:00 smithi044 bash[22676]: cluster 2024-09-21T02:27:59.130224+0000 mgr.a (mgr.14388) 10973 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:28:00.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:00 smithi179 bash[23186]: audit 2024-09-21T02:27:58.667395+0000 mgr.a (mgr.14388) 10971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:28:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:00 smithi179 bash[23186]: cephadm 2024-09-21T02:27:58.668533+0000 mgr.a (mgr.14388) 10972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:28:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:00 smithi179 bash[23186]: cluster 2024-09-21T02:27:59.130224+0000 mgr.a (mgr.14388) 10973 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:00 smithi049 bash[23528]: audit 2024-09-21T02:27:58.667395+0000 mgr.a (mgr.14388) 10971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:00 smithi049 bash[23528]: cephadm 2024-09-21T02:27:58.668533+0000 mgr.a (mgr.14388) 10972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:28:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:00 smithi049 bash[23528]: cluster 2024-09-21T02:27:59.130224+0000 mgr.a (mgr.14388) 10973 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:28:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:02.482 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:02.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:02.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:02.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:02.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:02 smithi044 bash[22676]: cluster 2024-09-21T02:28:01.132482+0000 mgr.a (mgr.14388) 10974 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:02.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:02 smithi179 bash[23186]: cluster 2024-09-21T02:28:01.132482+0000 mgr.a (mgr.14388) 10974 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:02 smithi049 bash[23528]: cluster 2024-09-21T02:28:01.132482+0000 mgr.a (mgr.14388) 10974 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:03 smithi044 bash[22676]: audit 2024-09-21T02:28:02.056250+0000 mgr.a (mgr.14388) 10975 : audit [DBG] from='client.241572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:03.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:03 smithi179 bash[23186]: audit 2024-09-21T02:28:02.056250+0000 mgr.a (mgr.14388) 10975 : audit [DBG] from='client.241572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:03 smithi049 bash[23528]: audit 2024-09-21T02:28:02.056250+0000 mgr.a (mgr.14388) 10975 : audit [DBG] from='client.241572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:04 smithi044 bash[22676]: cluster 2024-09-21T02:28:03.133380+0000 mgr.a (mgr.14388) 10976 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:04.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:04 smithi179 bash[23186]: cluster 2024-09-21T02:28:03.133380+0000 mgr.a (mgr.14388) 10976 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:04 smithi049 bash[23528]: cluster 2024-09-21T02:28:03.133380+0000 mgr.a (mgr.14388) 10976 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:06 smithi044 bash[22676]: cluster 2024-09-21T02:28:05.135677+0000 mgr.a (mgr.14388) 10977 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:06.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:06 smithi179 bash[23186]: cluster 2024-09-21T02:28:05.135677+0000 mgr.a (mgr.14388) 10977 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:06 smithi049 bash[23528]: cluster 2024-09-21T02:28:05.135677+0000 mgr.a (mgr.14388) 10977 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:07.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:07.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:07.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:08.278 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:08.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:08.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:08.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:08.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:08 smithi044 bash[22676]: cluster 2024-09-21T02:28:07.136630+0000 mgr.a (mgr.14388) 10978 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:08.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:08 smithi179 bash[23186]: cluster 2024-09-21T02:28:07.136630+0000 mgr.a (mgr.14388) 10978 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:08 smithi049 bash[23528]: cluster 2024-09-21T02:28:07.136630+0000 mgr.a (mgr.14388) 10978 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:09 smithi049 bash[23528]: audit 2024-09-21T02:28:07.823789+0000 mgr.a (mgr.14388) 10979 : audit [DBG] from='client.241647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:09 smithi049 bash[23528]: audit 2024-09-21T02:28:08.370378+0000 mon.a (mon.0) 9044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:09 smithi049 bash[23528]: audit 2024-09-21T02:28:08.377104+0000 mon.a (mon.0) 9045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:09 smithi049 bash[23528]: audit 2024-09-21T02:28:08.387230+0000 mon.a (mon.0) 9046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:09 smithi049 bash[23528]: audit 2024-09-21T02:28:08.572424+0000 mon.a (mon.0) 9047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:09 smithi049 bash[23528]: audit 2024-09-21T02:28:08.580319+0000 mon.a (mon.0) 9048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:09 smithi049 bash[23528]: audit 2024-09-21T02:28:08.588989+0000 mon.a (mon.0) 9049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:09 smithi044 bash[22676]: audit 2024-09-21T02:28:07.823789+0000 mgr.a (mgr.14388) 10979 : audit [DBG] from='client.241647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:09 smithi044 bash[22676]: audit 2024-09-21T02:28:08.370378+0000 mon.a (mon.0) 9044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:09 smithi044 bash[22676]: audit 2024-09-21T02:28:08.377104+0000 mon.a (mon.0) 9045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:09 smithi044 bash[22676]: audit 2024-09-21T02:28:08.387230+0000 mon.a (mon.0) 9046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:09 smithi044 bash[22676]: audit 2024-09-21T02:28:08.572424+0000 mon.a (mon.0) 9047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:09 smithi044 bash[22676]: audit 2024-09-21T02:28:08.580319+0000 mon.a (mon.0) 9048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:09 smithi044 bash[22676]: audit 2024-09-21T02:28:08.588989+0000 mon.a (mon.0) 9049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:09 smithi179 bash[23186]: audit 2024-09-21T02:28:07.823789+0000 mgr.a (mgr.14388) 10979 : audit [DBG] from='client.241647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:09 smithi179 bash[23186]: audit 2024-09-21T02:28:08.370378+0000 mon.a (mon.0) 9044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:09 smithi179 bash[23186]: audit 2024-09-21T02:28:08.377104+0000 mon.a (mon.0) 9045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:09 smithi179 bash[23186]: audit 2024-09-21T02:28:08.387230+0000 mon.a (mon.0) 9046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:09 smithi179 bash[23186]: audit 2024-09-21T02:28:08.572424+0000 mon.a (mon.0) 9047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:09 smithi179 bash[23186]: audit 2024-09-21T02:28:08.580319+0000 mon.a (mon.0) 9048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:09 smithi179 bash[23186]: audit 2024-09-21T02:28:08.588989+0000 mon.a (mon.0) 9049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:10.686 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:10 smithi049 bash[23528]: cluster 2024-09-21T02:28:09.137649+0000 mgr.a (mgr.14388) 10980 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:10 smithi044 bash[22676]: cluster 2024-09-21T02:28:09.137649+0000 mgr.a (mgr.14388) 10980 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:10 smithi179 bash[23186]: cluster 2024-09-21T02:28:09.137649+0000 mgr.a (mgr.14388) 10980 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:12 smithi049 bash[23528]: cluster 2024-09-21T02:28:11.139871+0000 mgr.a (mgr.14388) 10981 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:12 smithi044 bash[22676]: cluster 2024-09-21T02:28:11.139871+0000 mgr.a (mgr.14388) 10981 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:12 smithi179 bash[23186]: cluster 2024-09-21T02:28:11.139871+0000 mgr.a (mgr.14388) 10981 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:28:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:13.281 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:14.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:14.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:14.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:14.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:14.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:14 smithi044 bash[22676]: cluster 2024-09-21T02:28:13.140665+0000 mgr.a (mgr.14388) 10982 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:14 smithi179 bash[23186]: cluster 2024-09-21T02:28:13.140665+0000 mgr.a (mgr.14388) 10982 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:14 smithi049 bash[23528]: cluster 2024-09-21T02:28:13.140665+0000 mgr.a (mgr.14388) 10982 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:15 smithi044 bash[22676]: audit 2024-09-21T02:28:13.616490+0000 mgr.a (mgr.14388) 10983 : audit [DBG] from='client.241722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:15 smithi179 bash[23186]: audit 2024-09-21T02:28:13.616490+0000 mgr.a (mgr.14388) 10983 : audit [DBG] from='client.241722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:15 smithi049 bash[23528]: audit 2024-09-21T02:28:13.616490+0000 mgr.a (mgr.14388) 10983 : audit [DBG] from='client.241722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:16 smithi044 bash[22676]: cluster 2024-09-21T02:28:15.143021+0000 mgr.a (mgr.14388) 10984 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:16 smithi044 bash[22676]: audit 2024-09-21T02:28:15.797484+0000 mon.a (mon.0) 9050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:16 smithi044 bash[22676]: audit 2024-09-21T02:28:15.806071+0000 mon.a (mon.0) 9051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:16 smithi044 bash[22676]: audit 2024-09-21T02:28:15.816707+0000 mon.a (mon.0) 9052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:16 smithi179 bash[23186]: cluster 2024-09-21T02:28:15.143021+0000 mgr.a (mgr.14388) 10984 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:16 smithi179 bash[23186]: audit 2024-09-21T02:28:15.797484+0000 mon.a (mon.0) 9050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:16 smithi179 bash[23186]: audit 2024-09-21T02:28:15.806071+0000 mon.a (mon.0) 9051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:16 smithi179 bash[23186]: audit 2024-09-21T02:28:15.816707+0000 mon.a (mon.0) 9052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:16 smithi049 bash[23528]: cluster 2024-09-21T02:28:15.143021+0000 mgr.a (mgr.14388) 10984 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:16 smithi049 bash[23528]: audit 2024-09-21T02:28:15.797484+0000 mon.a (mon.0) 9050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:16 smithi049 bash[23528]: audit 2024-09-21T02:28:15.806071+0000 mon.a (mon.0) 9051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:16 smithi049 bash[23528]: audit 2024-09-21T02:28:15.816707+0000 mon.a (mon.0) 9052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:17 smithi044 bash[22676]: cluster 2024-09-21T02:28:17.143815+0000 mgr.a (mgr.14388) 10985 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:17.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:17 smithi179 bash[23186]: cluster 2024-09-21T02:28:17.143815+0000 mgr.a (mgr.14388) 10985 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:17 smithi049 bash[23528]: cluster 2024-09-21T02:28:17.143815+0000 mgr.a (mgr.14388) 10985 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:19.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:19.840 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:19.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:20 smithi044 bash[22676]: cluster 2024-09-21T02:28:19.144433+0000 mgr.a (mgr.14388) 10986 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:20 smithi179 bash[23186]: cluster 2024-09-21T02:28:19.144433+0000 mgr.a (mgr.14388) 10986 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:20 smithi049 bash[23528]: cluster 2024-09-21T02:28:19.144433+0000 mgr.a (mgr.14388) 10986 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:21 smithi044 bash[22676]: audit 2024-09-21T02:28:19.405530+0000 mgr.a (mgr.14388) 10987 : audit [DBG] from='client.241800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:21.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:21 smithi179 bash[23186]: audit 2024-09-21T02:28:19.405530+0000 mgr.a (mgr.14388) 10987 : audit [DBG] from='client.241800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:21 smithi049 bash[23528]: audit 2024-09-21T02:28:19.405530+0000 mgr.a (mgr.14388) 10987 : audit [DBG] from='client.241800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:22 smithi044 bash[22676]: cluster 2024-09-21T02:28:21.146808+0000 mgr.a (mgr.14388) 10988 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:22 smithi179 bash[23186]: cluster 2024-09-21T02:28:21.146808+0000 mgr.a (mgr.14388) 10988 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:22 smithi049 bash[23528]: cluster 2024-09-21T02:28:21.146808+0000 mgr.a (mgr.14388) 10988 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:24.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:24 smithi044 bash[22676]: cluster 2024-09-21T02:28:23.147628+0000 mgr.a (mgr.14388) 10989 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:24 smithi179 bash[23186]: cluster 2024-09-21T02:28:23.147628+0000 mgr.a (mgr.14388) 10989 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:24 smithi049 bash[23528]: cluster 2024-09-21T02:28:23.147628+0000 mgr.a (mgr.14388) 10989 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:24.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:24.843 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:25.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:25.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:25.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:25.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:25.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:26 smithi044 bash[22676]: cluster 2024-09-21T02:28:25.149526+0000 mgr.a (mgr.14388) 10990 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:26 smithi044 bash[22676]: audit 2024-09-21T02:28:25.178306+0000 mgr.a (mgr.14388) 10991 : audit [DBG] from='client.241878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:26 smithi179 bash[23186]: cluster 2024-09-21T02:28:25.149526+0000 mgr.a (mgr.14388) 10990 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:26.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:26 smithi179 bash[23186]: audit 2024-09-21T02:28:25.178306+0000 mgr.a (mgr.14388) 10991 : audit [DBG] from='client.241878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:26 smithi049 bash[23528]: cluster 2024-09-21T02:28:25.149526+0000 mgr.a (mgr.14388) 10990 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:26 smithi049 bash[23528]: audit 2024-09-21T02:28:25.178306+0000 mgr.a (mgr.14388) 10991 : audit [DBG] from='client.241878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:28 smithi044 bash[22676]: cluster 2024-09-21T02:28:27.150441+0000 mgr.a (mgr.14388) 10992 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:28:28.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:28 smithi179 bash[23186]: cluster 2024-09-21T02:28:27.150441+0000 mgr.a (mgr.14388) 10992 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:28:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:28 smithi049 bash[23528]: cluster 2024-09-21T02:28:27.150441+0000 mgr.a (mgr.14388) 10992 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:28:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:29 smithi049 bash[23528]: audit 2024-09-21T02:28:28.592054+0000 mon.a (mon.0) 9053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:29 smithi049 bash[23528]: audit 2024-09-21T02:28:28.599663+0000 mon.a (mon.0) 9054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:29 smithi049 bash[23528]: audit 2024-09-21T02:28:28.607847+0000 mon.a (mon.0) 9055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:29 smithi049 bash[23528]: audit 2024-09-21T02:28:28.776582+0000 mon.a (mon.0) 9056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:29 smithi049 bash[23528]: audit 2024-09-21T02:28:28.784288+0000 mon.a (mon.0) 9057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:29 smithi049 bash[23528]: audit 2024-09-21T02:28:28.794230+0000 mon.a (mon.0) 9058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:29 smithi049 bash[23528]: cluster 2024-09-21T02:28:29.151251+0000 mgr.a (mgr.14388) 10993 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:28:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:29 smithi044 bash[22676]: audit 2024-09-21T02:28:28.592054+0000 mon.a (mon.0) 9053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:29 smithi044 bash[22676]: audit 2024-09-21T02:28:28.599663+0000 mon.a (mon.0) 9054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:29 smithi044 bash[22676]: audit 2024-09-21T02:28:28.607847+0000 mon.a (mon.0) 9055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:29 smithi044 bash[22676]: audit 2024-09-21T02:28:28.776582+0000 mon.a (mon.0) 9056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:29 smithi044 bash[22676]: audit 2024-09-21T02:28:28.784288+0000 mon.a (mon.0) 9057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:29 smithi044 bash[22676]: audit 2024-09-21T02:28:28.794230+0000 mon.a (mon.0) 9058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:29 smithi044 bash[22676]: cluster 2024-09-21T02:28:29.151251+0000 mgr.a (mgr.14388) 10993 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:28:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:29 smithi179 bash[23186]: audit 2024-09-21T02:28:28.592054+0000 mon.a (mon.0) 9053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:29 smithi179 bash[23186]: audit 2024-09-21T02:28:28.599663+0000 mon.a (mon.0) 9054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:29 smithi179 bash[23186]: audit 2024-09-21T02:28:28.607847+0000 mon.a (mon.0) 9055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:29 smithi179 bash[23186]: audit 2024-09-21T02:28:28.776582+0000 mon.a (mon.0) 9056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:29 smithi179 bash[23186]: audit 2024-09-21T02:28:28.784288+0000 mon.a (mon.0) 9057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:29 smithi179 bash[23186]: audit 2024-09-21T02:28:28.794230+0000 mon.a (mon.0) 9058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:29 smithi179 bash[23186]: cluster 2024-09-21T02:28:29.151251+0000 mgr.a (mgr.14388) 10993 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:28:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:31.378 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:32 smithi044 bash[22676]: audit 2024-09-21T02:28:30.941156+0000 mgr.a (mgr.14388) 10994 : audit [DBG] from='client.241956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:32 smithi044 bash[22676]: cluster 2024-09-21T02:28:31.152590+0000 mgr.a (mgr.14388) 10995 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:32 smithi179 bash[23186]: audit 2024-09-21T02:28:30.941156+0000 mgr.a (mgr.14388) 10994 : audit [DBG] from='client.241956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:32 smithi179 bash[23186]: cluster 2024-09-21T02:28:31.152590+0000 mgr.a (mgr.14388) 10995 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:32 smithi049 bash[23528]: audit 2024-09-21T02:28:30.941156+0000 mgr.a (mgr.14388) 10994 : audit [DBG] from='client.241956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:32 smithi049 bash[23528]: cluster 2024-09-21T02:28:31.152590+0000 mgr.a (mgr.14388) 10995 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:34.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:34 smithi044 bash[22676]: cluster 2024-09-21T02:28:33.153493+0000 mgr.a (mgr.14388) 10996 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:28:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:34 smithi179 bash[23186]: cluster 2024-09-21T02:28:33.153493+0000 mgr.a (mgr.14388) 10996 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:28:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:34 smithi049 bash[23528]: cluster 2024-09-21T02:28:33.153493+0000 mgr.a (mgr.14388) 10996 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:28:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:36 smithi049 bash[23528]: cluster 2024-09-21T02:28:35.155618+0000 mgr.a (mgr.14388) 10997 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:36 smithi049 bash[23528]: audit 2024-09-21T02:28:36.001606+0000 mon.a (mon.0) 9059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:36 smithi049 bash[23528]: audit 2024-09-21T02:28:36.010617+0000 mon.a (mon.0) 9060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:36 smithi049 bash[23528]: audit 2024-09-21T02:28:36.021155+0000 mon.a (mon.0) 9061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:36 smithi044 bash[22676]: cluster 2024-09-21T02:28:35.155618+0000 mgr.a (mgr.14388) 10997 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:36 smithi044 bash[22676]: audit 2024-09-21T02:28:36.001606+0000 mon.a (mon.0) 9059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:36 smithi044 bash[22676]: audit 2024-09-21T02:28:36.010617+0000 mon.a (mon.0) 9060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:36 smithi044 bash[22676]: audit 2024-09-21T02:28:36.021155+0000 mon.a (mon.0) 9061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:36 smithi179 bash[23186]: cluster 2024-09-21T02:28:35.155618+0000 mgr.a (mgr.14388) 10997 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:36 smithi179 bash[23186]: audit 2024-09-21T02:28:36.001606+0000 mon.a (mon.0) 9059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:36 smithi179 bash[23186]: audit 2024-09-21T02:28:36.010617+0000 mon.a (mon.0) 9060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:36 smithi179 bash[23186]: audit 2024-09-21T02:28:36.021155+0000 mon.a (mon.0) 9061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:37.171 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:37.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:37.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:38 smithi044 bash[22676]: audit 2024-09-21T02:28:36.717000+0000 mgr.a (mgr.14388) 10998 : audit [DBG] from='client.242031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:38 smithi044 bash[22676]: cluster 2024-09-21T02:28:37.156136+0000 mgr.a (mgr.14388) 10999 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:38 smithi179 bash[23186]: audit 2024-09-21T02:28:36.717000+0000 mgr.a (mgr.14388) 10998 : audit [DBG] from='client.242031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:38.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:38 smithi179 bash[23186]: cluster 2024-09-21T02:28:37.156136+0000 mgr.a (mgr.14388) 10999 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:38 smithi049 bash[23528]: audit 2024-09-21T02:28:36.717000+0000 mgr.a (mgr.14388) 10998 : audit [DBG] from='client.242031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:38 smithi049 bash[23528]: cluster 2024-09-21T02:28:37.156136+0000 mgr.a (mgr.14388) 10999 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:40.478 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:40 smithi044 bash[22676]: cluster 2024-09-21T02:28:39.156872+0000 mgr.a (mgr.14388) 11000 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:40.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:40 smithi179 bash[23186]: cluster 2024-09-21T02:28:39.156872+0000 mgr.a (mgr.14388) 11000 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:40 smithi049 bash[23528]: cluster 2024-09-21T02:28:39.156872+0000 mgr.a (mgr.14388) 11000 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:42 smithi044 bash[22676]: cluster 2024-09-21T02:28:41.159067+0000 mgr.a (mgr.14388) 11001 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:42.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:42 smithi179 bash[23186]: cluster 2024-09-21T02:28:41.159067+0000 mgr.a (mgr.14388) 11001 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:42 smithi049 bash[23528]: cluster 2024-09-21T02:28:41.159067+0000 mgr.a (mgr.14388) 11001 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:42.948 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:44 smithi044 bash[22676]: audit 2024-09-21T02:28:42.526284+0000 mgr.a (mgr.14388) 11002 : audit [DBG] from='client.242109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:44 smithi044 bash[22676]: cluster 2024-09-21T02:28:43.160031+0000 mgr.a (mgr.14388) 11003 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:44 smithi179 bash[23186]: audit 2024-09-21T02:28:42.526284+0000 mgr.a (mgr.14388) 11002 : audit [DBG] from='client.242109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:44 smithi179 bash[23186]: cluster 2024-09-21T02:28:43.160031+0000 mgr.a (mgr.14388) 11003 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:44 smithi049 bash[23528]: audit 2024-09-21T02:28:42.526284+0000 mgr.a (mgr.14388) 11002 : audit [DBG] from='client.242109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:44 smithi049 bash[23528]: cluster 2024-09-21T02:28:43.160031+0000 mgr.a (mgr.14388) 11003 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:46.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:46 smithi179 bash[23186]: cluster 2024-09-21T02:28:45.162197+0000 mgr.a (mgr.14388) 11004 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:46 smithi049 bash[23528]: cluster 2024-09-21T02:28:45.162197+0000 mgr.a (mgr.14388) 11004 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:46 smithi044 bash[22676]: cluster 2024-09-21T02:28:45.162197+0000 mgr.a (mgr.14388) 11004 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:47.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:47.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:47.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:48.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:48 smithi179 bash[23186]: cluster 2024-09-21T02:28:47.162993+0000 mgr.a (mgr.14388) 11005 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:48 smithi049 bash[23528]: cluster 2024-09-21T02:28:47.162993+0000 mgr.a (mgr.14388) 11005 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:48 smithi044 bash[22676]: cluster 2024-09-21T02:28:47.162993+0000 mgr.a (mgr.14388) 11005 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:48.740 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:48.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:48.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:48.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:48.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:49 smithi179 bash[23186]: audit 2024-09-21T02:28:48.291267+0000 mgr.a (mgr.14388) 11006 : audit [DBG] from='client.242187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:49 smithi179 bash[23186]: audit 2024-09-21T02:28:48.800410+0000 mon.a (mon.0) 9062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:49 smithi179 bash[23186]: audit 2024-09-21T02:28:48.807477+0000 mon.a (mon.0) 9063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:49 smithi179 bash[23186]: audit 2024-09-21T02:28:48.823254+0000 mon.a (mon.0) 9064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:49 smithi179 bash[23186]: audit 2024-09-21T02:28:48.935843+0000 mon.a (mon.0) 9065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:49 smithi179 bash[23186]: audit 2024-09-21T02:28:48.941540+0000 mon.a (mon.0) 9066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:49 smithi179 bash[23186]: audit 2024-09-21T02:28:48.946963+0000 mon.a (mon.0) 9067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:49 smithi049 bash[23528]: audit 2024-09-21T02:28:48.291267+0000 mgr.a (mgr.14388) 11006 : audit [DBG] from='client.242187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:49 smithi049 bash[23528]: audit 2024-09-21T02:28:48.800410+0000 mon.a (mon.0) 9062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:49 smithi049 bash[23528]: audit 2024-09-21T02:28:48.807477+0000 mon.a (mon.0) 9063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:49 smithi049 bash[23528]: audit 2024-09-21T02:28:48.823254+0000 mon.a (mon.0) 9064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:49 smithi049 bash[23528]: audit 2024-09-21T02:28:48.935843+0000 mon.a (mon.0) 9065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:49 smithi049 bash[23528]: audit 2024-09-21T02:28:48.941540+0000 mon.a (mon.0) 9066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:49 smithi049 bash[23528]: audit 2024-09-21T02:28:48.946963+0000 mon.a (mon.0) 9067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:49 smithi044 bash[22676]: audit 2024-09-21T02:28:48.291267+0000 mgr.a (mgr.14388) 11006 : audit [DBG] from='client.242187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:49 smithi044 bash[22676]: audit 2024-09-21T02:28:48.800410+0000 mon.a (mon.0) 9062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:49 smithi044 bash[22676]: audit 2024-09-21T02:28:48.807477+0000 mon.a (mon.0) 9063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:49 smithi044 bash[22676]: audit 2024-09-21T02:28:48.823254+0000 mon.a (mon.0) 9064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:49 smithi044 bash[22676]: audit 2024-09-21T02:28:48.935843+0000 mon.a (mon.0) 9065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:49 smithi044 bash[22676]: audit 2024-09-21T02:28:48.941540+0000 mon.a (mon.0) 9066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:49 smithi044 bash[22676]: audit 2024-09-21T02:28:48.946963+0000 mon.a (mon.0) 9067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:50.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:50 smithi179 bash[23186]: cluster 2024-09-21T02:28:49.164078+0000 mgr.a (mgr.14388) 11007 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:50 smithi049 bash[23528]: cluster 2024-09-21T02:28:49.164078+0000 mgr.a (mgr.14388) 11007 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:50 smithi044 bash[22676]: cluster 2024-09-21T02:28:49.164078+0000 mgr.a (mgr.14388) 11007 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:52 smithi179 bash[23186]: cluster 2024-09-21T02:28:51.166337+0000 mgr.a (mgr.14388) 11008 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:52 smithi049 bash[23528]: cluster 2024-09-21T02:28:51.166337+0000 mgr.a (mgr.14388) 11008 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:52 smithi044 bash[22676]: cluster 2024-09-21T02:28:51.166337+0000 mgr.a (mgr.14388) 11008 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:53.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:54.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:28:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:28:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:54 smithi049 bash[23528]: cluster 2024-09-21T02:28:53.167122+0000 mgr.a (mgr.14388) 11009 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:54 smithi044 bash[22676]: cluster 2024-09-21T02:28:53.167122+0000 mgr.a (mgr.14388) 11009 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:54 smithi179 bash[23186]: cluster 2024-09-21T02:28:53.167122+0000 mgr.a (mgr.14388) 11009 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:55 smithi049 bash[23528]: audit 2024-09-21T02:28:54.072976+0000 mgr.a (mgr.14388) 11010 : audit [DBG] from='client.242259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:55 smithi044 bash[22676]: audit 2024-09-21T02:28:54.072976+0000 mgr.a (mgr.14388) 11010 : audit [DBG] from='client.242259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:55.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:55 smithi179 bash[23186]: audit 2024-09-21T02:28:54.072976+0000 mgr.a (mgr.14388) 11010 : audit [DBG] from='client.242259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:28:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:56 smithi049 bash[23528]: cluster 2024-09-21T02:28:55.169624+0000 mgr.a (mgr.14388) 11011 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:56 smithi049 bash[23528]: audit 2024-09-21T02:28:56.238094+0000 mon.a (mon.0) 9068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:56 smithi049 bash[23528]: audit 2024-09-21T02:28:56.247288+0000 mon.a (mon.0) 9069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:56 smithi049 bash[23528]: audit 2024-09-21T02:28:56.258245+0000 mon.a (mon.0) 9070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:56 smithi044 bash[22676]: cluster 2024-09-21T02:28:55.169624+0000 mgr.a (mgr.14388) 11011 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:56 smithi044 bash[22676]: audit 2024-09-21T02:28:56.238094+0000 mon.a (mon.0) 9068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:56 smithi044 bash[22676]: audit 2024-09-21T02:28:56.247288+0000 mon.a (mon.0) 9069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:56 smithi044 bash[22676]: audit 2024-09-21T02:28:56.258245+0000 mon.a (mon.0) 9070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:56 smithi179 bash[23186]: cluster 2024-09-21T02:28:55.169624+0000 mgr.a (mgr.14388) 11011 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:28:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:56 smithi179 bash[23186]: audit 2024-09-21T02:28:56.238094+0000 mon.a (mon.0) 9068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:56 smithi179 bash[23186]: audit 2024-09-21T02:28:56.247288+0000 mon.a (mon.0) 9069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:56 smithi179 bash[23186]: audit 2024-09-21T02:28:56.258245+0000 mon.a (mon.0) 9070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:58 smithi049 bash[23528]: cluster 2024-09-21T02:28:57.170465+0000 mgr.a (mgr.14388) 11012 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:58 smithi044 bash[22676]: cluster 2024-09-21T02:28:57.170465+0000 mgr.a (mgr.14388) 11012 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:58 smithi179 bash[23186]: cluster 2024-09-21T02:28:57.170465+0000 mgr.a (mgr.14388) 11012 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:28:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:28:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:28:59.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:28:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:59 smithi179 bash[23186]: audit 2024-09-21T02:28:58.720028+0000 mon.a (mon.0) 9071 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:28:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:59 smithi179 bash[23186]: audit 2024-09-21T02:28:58.726622+0000 mon.a (mon.0) 9072 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:28:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:59 smithi179 bash[23186]: audit 2024-09-21T02:28:58.728551+0000 mon.a (mon.0) 9073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:28:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:59 smithi179 bash[23186]: audit 2024-09-21T02:28:58.740056+0000 mon.a (mon.0) 9074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:28:59 smithi179 bash[23186]: audit 2024-09-21T02:28:58.746506+0000 mon.a (mon.0) 9075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:28:59.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:59 smithi044 bash[22676]: audit 2024-09-21T02:28:58.720028+0000 mon.a (mon.0) 9071 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:28:59.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:59 smithi044 bash[22676]: audit 2024-09-21T02:28:58.726622+0000 mon.a (mon.0) 9072 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:28:59.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:59 smithi044 bash[22676]: audit 2024-09-21T02:28:58.728551+0000 mon.a (mon.0) 9073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:28:59.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:59 smithi044 bash[22676]: audit 2024-09-21T02:28:58.740056+0000 mon.a (mon.0) 9074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:59.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:28:59 smithi044 bash[22676]: audit 2024-09-21T02:28:58.746506+0000 mon.a (mon.0) 9075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:28:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:59 smithi049 bash[23528]: audit 2024-09-21T02:28:58.720028+0000 mon.a (mon.0) 9071 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:28:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:59 smithi049 bash[23528]: audit 2024-09-21T02:28:58.726622+0000 mon.a (mon.0) 9072 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:28:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:59 smithi049 bash[23528]: audit 2024-09-21T02:28:58.728551+0000 mon.a (mon.0) 9073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:28:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:59 smithi049 bash[23528]: audit 2024-09-21T02:28:58.740056+0000 mon.a (mon.0) 9074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:28:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:28:59 smithi049 bash[23528]: audit 2024-09-21T02:28:58.746506+0000 mon.a (mon.0) 9075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:28:59.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:28:59 smithi044 bash[22930]: debug 2024-09-21T02:28:59.526+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:28:59.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:28:59 smithi044 bash[22930]: debug 2024-09-21T02:28:59.530+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:29:00.232 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:00.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:00.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:00.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:00.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:00.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:00 smithi179 bash[23186]: audit 2024-09-21T02:28:58.748901+0000 mgr.a (mgr.14388) 11013 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:29:00.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:00 smithi179 bash[23186]: cluster 2024-09-21T02:28:59.171101+0000 mgr.a (mgr.14388) 11014 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:00 smithi049 bash[23528]: audit 2024-09-21T02:28:58.748901+0000 mgr.a (mgr.14388) 11013 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:29:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:00 smithi049 bash[23528]: cluster 2024-09-21T02:28:59.171101+0000 mgr.a (mgr.14388) 11014 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:00.553 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:00 smithi044 bash[22676]: audit 2024-09-21T02:28:58.748901+0000 mgr.a (mgr.14388) 11013 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:29:00.553 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:00 smithi044 bash[22676]: cluster 2024-09-21T02:28:59.171101+0000 mgr.a (mgr.14388) 11014 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:01 smithi049 bash[23528]: audit 2024-09-21T02:28:59.532145+0000 mgr.a (mgr.14388) 11015 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:29:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:01 smithi049 bash[23528]: cephadm 2024-09-21T02:28:59.533320+0000 mgr.a (mgr.14388) 11016 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:29:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:01 smithi049 bash[23528]: audit 2024-09-21T02:28:59.808570+0000 mgr.a (mgr.14388) 11017 : audit [DBG] from='client.242445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:01.600 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:01 smithi179 bash[23186]: audit 2024-09-21T02:28:59.532145+0000 mgr.a (mgr.14388) 11015 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:29:01.600 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:01 smithi179 bash[23186]: cephadm 2024-09-21T02:28:59.533320+0000 mgr.a (mgr.14388) 11016 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:29:01.601 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:01 smithi179 bash[23186]: audit 2024-09-21T02:28:59.808570+0000 mgr.a (mgr.14388) 11017 : audit [DBG] from='client.242445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:01 smithi044 bash[22676]: audit 2024-09-21T02:28:59.532145+0000 mgr.a (mgr.14388) 11015 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:29:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:01 smithi044 bash[22676]: cephadm 2024-09-21T02:28:59.533320+0000 mgr.a (mgr.14388) 11016 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:29:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:01 smithi044 bash[22676]: audit 2024-09-21T02:28:59.808570+0000 mgr.a (mgr.14388) 11017 : audit [DBG] from='client.242445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:02 smithi049 bash[23528]: cluster 2024-09-21T02:29:01.173871+0000 mgr.a (mgr.14388) 11018 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:02 smithi044 bash[22676]: cluster 2024-09-21T02:29:01.173871+0000 mgr.a (mgr.14388) 11018 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:02 smithi179 bash[23186]: cluster 2024-09-21T02:29:01.173871+0000 mgr.a (mgr.14388) 11018 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:04 smithi049 bash[23528]: cluster 2024-09-21T02:29:03.174433+0000 mgr.a (mgr.14388) 11019 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:04 smithi044 bash[22676]: cluster 2024-09-21T02:29:03.174433+0000 mgr.a (mgr.14388) 11019 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:04 smithi179 bash[23186]: cluster 2024-09-21T02:29:03.174433+0000 mgr.a (mgr.14388) 11019 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:05.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:05.999 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:06.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:06.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:06.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:06.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:06 smithi049 bash[23528]: cluster 2024-09-21T02:29:05.176299+0000 mgr.a (mgr.14388) 11020 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:06 smithi044 bash[22676]: cluster 2024-09-21T02:29:05.176299+0000 mgr.a (mgr.14388) 11020 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:06 smithi179 bash[23186]: cluster 2024-09-21T02:29:05.176299+0000 mgr.a (mgr.14388) 11020 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:07 smithi044 bash[22676]: audit 2024-09-21T02:29:05.566652+0000 mgr.a (mgr.14388) 11021 : audit [DBG] from='client.242520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:07.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:07 smithi179 bash[23186]: audit 2024-09-21T02:29:05.566652+0000 mgr.a (mgr.14388) 11021 : audit [DBG] from='client.242520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:07 smithi049 bash[23528]: audit 2024-09-21T02:29:05.566652+0000 mgr.a (mgr.14388) 11021 : audit [DBG] from='client.242520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:08 smithi044 bash[22676]: cluster 2024-09-21T02:29:07.177164+0000 mgr.a (mgr.14388) 11022 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:08 smithi179 bash[23186]: cluster 2024-09-21T02:29:07.177164+0000 mgr.a (mgr.14388) 11022 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:08 smithi049 bash[23528]: cluster 2024-09-21T02:29:07.177164+0000 mgr.a (mgr.14388) 11022 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:10 smithi049 bash[23528]: audit 2024-09-21T02:29:09.019008+0000 mon.a (mon.0) 9076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:10 smithi049 bash[23528]: audit 2024-09-21T02:29:09.026076+0000 mon.a (mon.0) 9077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:10 smithi049 bash[23528]: audit 2024-09-21T02:29:09.033904+0000 mon.a (mon.0) 9078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:10 smithi049 bash[23528]: audit 2024-09-21T02:29:09.143193+0000 mon.a (mon.0) 9079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:10 smithi049 bash[23528]: audit 2024-09-21T02:29:09.151092+0000 mon.a (mon.0) 9080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:10 smithi049 bash[23528]: audit 2024-09-21T02:29:09.159601+0000 mon.a (mon.0) 9081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:10 smithi049 bash[23528]: cluster 2024-09-21T02:29:09.177695+0000 mgr.a (mgr.14388) 11023 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:10 smithi044 bash[22676]: audit 2024-09-21T02:29:09.019008+0000 mon.a (mon.0) 9076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:10 smithi044 bash[22676]: audit 2024-09-21T02:29:09.026076+0000 mon.a (mon.0) 9077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:10 smithi044 bash[22676]: audit 2024-09-21T02:29:09.033904+0000 mon.a (mon.0) 9078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:10 smithi044 bash[22676]: audit 2024-09-21T02:29:09.143193+0000 mon.a (mon.0) 9079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:10 smithi044 bash[22676]: audit 2024-09-21T02:29:09.151092+0000 mon.a (mon.0) 9080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:10 smithi044 bash[22676]: audit 2024-09-21T02:29:09.159601+0000 mon.a (mon.0) 9081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:10 smithi044 bash[22676]: cluster 2024-09-21T02:29:09.177695+0000 mgr.a (mgr.14388) 11023 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:10.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:10 smithi179 bash[23186]: audit 2024-09-21T02:29:09.019008+0000 mon.a (mon.0) 9076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:10 smithi179 bash[23186]: audit 2024-09-21T02:29:09.026076+0000 mon.a (mon.0) 9077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:10 smithi179 bash[23186]: audit 2024-09-21T02:29:09.033904+0000 mon.a (mon.0) 9078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:10 smithi179 bash[23186]: audit 2024-09-21T02:29:09.143193+0000 mon.a (mon.0) 9079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:10 smithi179 bash[23186]: audit 2024-09-21T02:29:09.151092+0000 mon.a (mon.0) 9080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:10 smithi179 bash[23186]: audit 2024-09-21T02:29:09.159601+0000 mon.a (mon.0) 9081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:10 smithi179 bash[23186]: cluster 2024-09-21T02:29:09.177695+0000 mgr.a (mgr.14388) 11023 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:29:11.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:11.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:11.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:11.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:11.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:11.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:11.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:11.793 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:12 smithi044 bash[22676]: cluster 2024-09-21T02:29:11.179801+0000 mgr.a (mgr.14388) 11024 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:12 smithi044 bash[22676]: audit 2024-09-21T02:29:11.338339+0000 mgr.a (mgr.14388) 11025 : audit [DBG] from='client.242595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:12 smithi179 bash[23186]: cluster 2024-09-21T02:29:11.179801+0000 mgr.a (mgr.14388) 11024 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:12.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:12 smithi179 bash[23186]: audit 2024-09-21T02:29:11.338339+0000 mgr.a (mgr.14388) 11025 : audit [DBG] from='client.242595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:12 smithi049 bash[23528]: cluster 2024-09-21T02:29:11.179801+0000 mgr.a (mgr.14388) 11024 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:29:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:12 smithi049 bash[23528]: audit 2024-09-21T02:29:11.338339+0000 mgr.a (mgr.14388) 11025 : audit [DBG] from='client.242595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:14 smithi049 bash[23528]: cluster 2024-09-21T02:29:13.180879+0000 mgr.a (mgr.14388) 11026 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:29:14.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:14 smithi179 bash[23186]: cluster 2024-09-21T02:29:13.180879+0000 mgr.a (mgr.14388) 11026 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:29:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:14 smithi044 bash[22676]: cluster 2024-09-21T02:29:13.180879+0000 mgr.a (mgr.14388) 11026 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:29:16.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:16 smithi179 bash[23186]: cluster 2024-09-21T02:29:15.183113+0000 mgr.a (mgr.14388) 11027 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:29:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:16 smithi049 bash[23528]: cluster 2024-09-21T02:29:15.183113+0000 mgr.a (mgr.14388) 11027 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:29:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:16 smithi044 bash[22676]: cluster 2024-09-21T02:29:15.183113+0000 mgr.a (mgr.14388) 11027 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:29:16.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:16.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:16.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:17.585 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:17.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:17.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:17.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:17.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:17 smithi044 bash[22676]: audit 2024-09-21T02:29:16.438841+0000 mon.a (mon.0) 9082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:17 smithi044 bash[22676]: audit 2024-09-21T02:29:16.447593+0000 mon.a (mon.0) 9083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:17 smithi044 bash[22676]: audit 2024-09-21T02:29:16.458097+0000 mon.a (mon.0) 9084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:17 smithi044 bash[22676]: audit 2024-09-21T02:29:17.136689+0000 mgr.a (mgr.14388) 11028 : audit [DBG] from='client.242673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:17 smithi044 bash[22676]: cluster 2024-09-21T02:29:17.183901+0000 mgr.a (mgr.14388) 11029 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:17 smithi179 bash[23186]: audit 2024-09-21T02:29:16.438841+0000 mon.a (mon.0) 9082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:17 smithi179 bash[23186]: audit 2024-09-21T02:29:16.447593+0000 mon.a (mon.0) 9083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:17 smithi179 bash[23186]: audit 2024-09-21T02:29:16.458097+0000 mon.a (mon.0) 9084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:17 smithi179 bash[23186]: audit 2024-09-21T02:29:17.136689+0000 mgr.a (mgr.14388) 11028 : audit [DBG] from='client.242673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:17 smithi179 bash[23186]: cluster 2024-09-21T02:29:17.183901+0000 mgr.a (mgr.14388) 11029 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:17 smithi049 bash[23528]: audit 2024-09-21T02:29:16.438841+0000 mon.a (mon.0) 9082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:17 smithi049 bash[23528]: audit 2024-09-21T02:29:16.447593+0000 mon.a (mon.0) 9083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:17 smithi049 bash[23528]: audit 2024-09-21T02:29:16.458097+0000 mon.a (mon.0) 9084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:17 smithi049 bash[23528]: audit 2024-09-21T02:29:17.136689+0000 mgr.a (mgr.14388) 11028 : audit [DBG] from='client.242673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:17 smithi049 bash[23528]: cluster 2024-09-21T02:29:17.183901+0000 mgr.a (mgr.14388) 11029 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:20 smithi044 bash[22676]: cluster 2024-09-21T02:29:19.184793+0000 mgr.a (mgr.14388) 11030 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:20 smithi179 bash[23186]: cluster 2024-09-21T02:29:19.184793+0000 mgr.a (mgr.14388) 11030 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:20 smithi049 bash[23528]: cluster 2024-09-21T02:29:19.184793+0000 mgr.a (mgr.14388) 11030 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:22 smithi044 bash[22676]: cluster 2024-09-21T02:29:21.186016+0000 mgr.a (mgr.14388) 11031 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:22.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:22 smithi179 bash[23186]: cluster 2024-09-21T02:29:21.186016+0000 mgr.a (mgr.14388) 11031 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:22 smithi049 bash[23528]: cluster 2024-09-21T02:29:21.186016+0000 mgr.a (mgr.14388) 11031 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:23.364 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:24 smithi179 bash[23186]: audit 2024-09-21T02:29:22.925698+0000 mgr.a (mgr.14388) 11032 : audit [DBG] from='client.242748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:24 smithi179 bash[23186]: cluster 2024-09-21T02:29:23.186565+0000 mgr.a (mgr.14388) 11033 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:24 smithi049 bash[23528]: audit 2024-09-21T02:29:22.925698+0000 mgr.a (mgr.14388) 11032 : audit [DBG] from='client.242748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:24 smithi049 bash[23528]: cluster 2024-09-21T02:29:23.186565+0000 mgr.a (mgr.14388) 11033 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:24 smithi044 bash[22676]: audit 2024-09-21T02:29:22.925698+0000 mgr.a (mgr.14388) 11032 : audit [DBG] from='client.242748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:24 smithi044 bash[22676]: cluster 2024-09-21T02:29:23.186565+0000 mgr.a (mgr.14388) 11033 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:26 smithi049 bash[23528]: cluster 2024-09-21T02:29:25.188816+0000 mgr.a (mgr.14388) 11034 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:26 smithi044 bash[22676]: cluster 2024-09-21T02:29:25.188816+0000 mgr.a (mgr.14388) 11034 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:26 smithi179 bash[23186]: cluster 2024-09-21T02:29:25.188816+0000 mgr.a (mgr.14388) 11034 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:28.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:28.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:28.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:28 smithi049 bash[23528]: cluster 2024-09-21T02:29:27.189625+0000 mgr.a (mgr.14388) 11035 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:28 smithi044 bash[22676]: cluster 2024-09-21T02:29:27.189625+0000 mgr.a (mgr.14388) 11035 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:28 smithi179 bash[23186]: cluster 2024-09-21T02:29:27.189625+0000 mgr.a (mgr.14388) 11035 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:29.119 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: audit 2024-09-21T02:29:28.698218+0000 mgr.a (mgr.14388) 11036 : audit [DBG] from='client.242823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:30.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: cluster 2024-09-21T02:29:29.190121+0000 mgr.a (mgr.14388) 11037 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: audit 2024-09-21T02:29:29.229922+0000 mon.a (mon.0) 9085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: audit 2024-09-21T02:29:29.234903+0000 mon.a (mon.0) 9086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: audit 2024-09-21T02:29:29.241558+0000 mon.a (mon.0) 9087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: audit 2024-09-21T02:29:29.314797+0000 mon.a (mon.0) 9088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: audit 2024-09-21T02:29:29.321239+0000 mon.a (mon.0) 9089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:30 smithi044 bash[22676]: audit 2024-09-21T02:29:29.328947+0000 mon.a (mon.0) 9090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: audit 2024-09-21T02:29:28.698218+0000 mgr.a (mgr.14388) 11036 : audit [DBG] from='client.242823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: cluster 2024-09-21T02:29:29.190121+0000 mgr.a (mgr.14388) 11037 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: audit 2024-09-21T02:29:29.229922+0000 mon.a (mon.0) 9085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: audit 2024-09-21T02:29:29.234903+0000 mon.a (mon.0) 9086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: audit 2024-09-21T02:29:29.241558+0000 mon.a (mon.0) 9087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: audit 2024-09-21T02:29:29.314797+0000 mon.a (mon.0) 9088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: audit 2024-09-21T02:29:29.321239+0000 mon.a (mon.0) 9089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:30 smithi179 bash[23186]: audit 2024-09-21T02:29:29.328947+0000 mon.a (mon.0) 9090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: audit 2024-09-21T02:29:28.698218+0000 mgr.a (mgr.14388) 11036 : audit [DBG] from='client.242823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: cluster 2024-09-21T02:29:29.190121+0000 mgr.a (mgr.14388) 11037 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: audit 2024-09-21T02:29:29.229922+0000 mon.a (mon.0) 9085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: audit 2024-09-21T02:29:29.234903+0000 mon.a (mon.0) 9086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: audit 2024-09-21T02:29:29.241558+0000 mon.a (mon.0) 9087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: audit 2024-09-21T02:29:29.314797+0000 mon.a (mon.0) 9088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: audit 2024-09-21T02:29:29.321239+0000 mon.a (mon.0) 9089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:30 smithi049 bash[23528]: audit 2024-09-21T02:29:29.328947+0000 mon.a (mon.0) 9090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:32 smithi044 bash[22676]: cluster 2024-09-21T02:29:31.192420+0000 mgr.a (mgr.14388) 11038 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:32.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:32 smithi179 bash[23186]: cluster 2024-09-21T02:29:31.192420+0000 mgr.a (mgr.14388) 11038 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:32 smithi049 bash[23528]: cluster 2024-09-21T02:29:31.192420+0000 mgr.a (mgr.14388) 11038 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:34.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:34.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:34.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:34 smithi179 bash[23186]: cluster 2024-09-21T02:29:33.193402+0000 mgr.a (mgr.14388) 11039 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:34.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:34 smithi049 bash[23528]: cluster 2024-09-21T02:29:33.193402+0000 mgr.a (mgr.14388) 11039 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:34 smithi044 bash[22676]: cluster 2024-09-21T02:29:33.193402+0000 mgr.a (mgr.14388) 11039 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:34.905 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:34.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:34.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:34.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:34.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:36 smithi179 bash[23186]: audit 2024-09-21T02:29:34.459726+0000 mgr.a (mgr.14388) 11040 : audit [DBG] from='client.242901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:36 smithi179 bash[23186]: cluster 2024-09-21T02:29:35.195738+0000 mgr.a (mgr.14388) 11041 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:36 smithi049 bash[23528]: audit 2024-09-21T02:29:34.459726+0000 mgr.a (mgr.14388) 11040 : audit [DBG] from='client.242901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:36 smithi049 bash[23528]: cluster 2024-09-21T02:29:35.195738+0000 mgr.a (mgr.14388) 11041 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:36 smithi044 bash[22676]: audit 2024-09-21T02:29:34.459726+0000 mgr.a (mgr.14388) 11040 : audit [DBG] from='client.242901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:36 smithi044 bash[22676]: cluster 2024-09-21T02:29:35.195738+0000 mgr.a (mgr.14388) 11041 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:37 smithi044 bash[22676]: audit 2024-09-21T02:29:36.675749+0000 mon.a (mon.0) 9091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:37 smithi044 bash[22676]: audit 2024-09-21T02:29:36.684854+0000 mon.a (mon.0) 9092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:37 smithi044 bash[22676]: audit 2024-09-21T02:29:36.695557+0000 mon.a (mon.0) 9093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:37 smithi044 bash[22676]: cluster 2024-09-21T02:29:37.196526+0000 mgr.a (mgr.14388) 11042 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:37 smithi179 bash[23186]: audit 2024-09-21T02:29:36.675749+0000 mon.a (mon.0) 9091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:37 smithi179 bash[23186]: audit 2024-09-21T02:29:36.684854+0000 mon.a (mon.0) 9092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:37 smithi179 bash[23186]: audit 2024-09-21T02:29:36.695557+0000 mon.a (mon.0) 9093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:37 smithi179 bash[23186]: cluster 2024-09-21T02:29:37.196526+0000 mgr.a (mgr.14388) 11042 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:37 smithi049 bash[23528]: audit 2024-09-21T02:29:36.675749+0000 mon.a (mon.0) 9091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:37 smithi049 bash[23528]: audit 2024-09-21T02:29:36.684854+0000 mon.a (mon.0) 9092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:37 smithi049 bash[23528]: audit 2024-09-21T02:29:36.695557+0000 mon.a (mon.0) 9093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:37 smithi049 bash[23528]: cluster 2024-09-21T02:29:37.196526+0000 mgr.a (mgr.14388) 11042 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:39.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:39.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:39.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:40 smithi049 bash[23528]: cluster 2024-09-21T02:29:39.197297+0000 mgr.a (mgr.14388) 11043 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:40.692 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:40.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:40 smithi044 bash[22676]: cluster 2024-09-21T02:29:39.197297+0000 mgr.a (mgr.14388) 11043 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:40 smithi179 bash[23186]: cluster 2024-09-21T02:29:39.197297+0000 mgr.a (mgr.14388) 11043 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:41 smithi044 bash[22676]: audit 2024-09-21T02:29:40.245905+0000 mgr.a (mgr.14388) 11044 : audit [DBG] from='client.242979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:41 smithi049 bash[23528]: audit 2024-09-21T02:29:40.245905+0000 mgr.a (mgr.14388) 11044 : audit [DBG] from='client.242979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:41.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:41 smithi179 bash[23186]: audit 2024-09-21T02:29:40.245905+0000 mgr.a (mgr.14388) 11044 : audit [DBG] from='client.242979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:42 smithi044 bash[22676]: cluster 2024-09-21T02:29:41.200400+0000 mgr.a (mgr.14388) 11045 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:42 smithi049 bash[23528]: cluster 2024-09-21T02:29:41.200400+0000 mgr.a (mgr.14388) 11045 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:42.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:42 smithi179 bash[23186]: cluster 2024-09-21T02:29:41.200400+0000 mgr.a (mgr.14388) 11045 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:44 smithi049 bash[23528]: cluster 2024-09-21T02:29:43.201390+0000 mgr.a (mgr.14388) 11046 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:44 smithi044 bash[22676]: cluster 2024-09-21T02:29:43.201390+0000 mgr.a (mgr.14388) 11046 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:44 smithi179 bash[23186]: cluster 2024-09-21T02:29:43.201390+0000 mgr.a (mgr.14388) 11046 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:45.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:45.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:45.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:46.479 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:46.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:46.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:46.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:46.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:46 smithi049 bash[23528]: cluster 2024-09-21T02:29:45.203517+0000 mgr.a (mgr.14388) 11047 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:46 smithi044 bash[22676]: cluster 2024-09-21T02:29:45.203517+0000 mgr.a (mgr.14388) 11047 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:46 smithi179 bash[23186]: cluster 2024-09-21T02:29:45.203517+0000 mgr.a (mgr.14388) 11047 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:47 smithi049 bash[23528]: audit 2024-09-21T02:29:46.032334+0000 mgr.a (mgr.14388) 11048 : audit [DBG] from='client.243057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:47 smithi044 bash[22676]: audit 2024-09-21T02:29:46.032334+0000 mgr.a (mgr.14388) 11048 : audit [DBG] from='client.243057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:47 smithi179 bash[23186]: audit 2024-09-21T02:29:46.032334+0000 mgr.a (mgr.14388) 11048 : audit [DBG] from='client.243057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:48 smithi049 bash[23528]: cluster 2024-09-21T02:29:47.204442+0000 mgr.a (mgr.14388) 11049 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:48 smithi044 bash[22676]: cluster 2024-09-21T02:29:47.204442+0000 mgr.a (mgr.14388) 11049 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:48 smithi179 bash[23186]: cluster 2024-09-21T02:29:47.204442+0000 mgr.a (mgr.14388) 11049 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:50 smithi049 bash[23528]: cluster 2024-09-21T02:29:49.205210+0000 mgr.a (mgr.14388) 11050 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:50 smithi049 bash[23528]: audit 2024-09-21T02:29:49.438224+0000 mon.a (mon.0) 9094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:50 smithi049 bash[23528]: audit 2024-09-21T02:29:49.444806+0000 mon.a (mon.0) 9095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:50 smithi049 bash[23528]: audit 2024-09-21T02:29:49.453781+0000 mon.a (mon.0) 9096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:50 smithi049 bash[23528]: audit 2024-09-21T02:29:49.548546+0000 mon.a (mon.0) 9097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:50 smithi049 bash[23528]: audit 2024-09-21T02:29:49.556595+0000 mon.a (mon.0) 9098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:50 smithi049 bash[23528]: audit 2024-09-21T02:29:49.566394+0000 mon.a (mon.0) 9099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:50 smithi044 bash[22676]: cluster 2024-09-21T02:29:49.205210+0000 mgr.a (mgr.14388) 11050 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:50 smithi044 bash[22676]: audit 2024-09-21T02:29:49.438224+0000 mon.a (mon.0) 9094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:50 smithi044 bash[22676]: audit 2024-09-21T02:29:49.444806+0000 mon.a (mon.0) 9095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:50 smithi044 bash[22676]: audit 2024-09-21T02:29:49.453781+0000 mon.a (mon.0) 9096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:50 smithi044 bash[22676]: audit 2024-09-21T02:29:49.548546+0000 mon.a (mon.0) 9097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:50 smithi044 bash[22676]: audit 2024-09-21T02:29:49.556595+0000 mon.a (mon.0) 9098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:50 smithi044 bash[22676]: audit 2024-09-21T02:29:49.566394+0000 mon.a (mon.0) 9099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:50 smithi179 bash[23186]: cluster 2024-09-21T02:29:49.205210+0000 mgr.a (mgr.14388) 11050 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:29:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:50 smithi179 bash[23186]: audit 2024-09-21T02:29:49.438224+0000 mon.a (mon.0) 9094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:50 smithi179 bash[23186]: audit 2024-09-21T02:29:49.444806+0000 mon.a (mon.0) 9095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:50 smithi179 bash[23186]: audit 2024-09-21T02:29:49.453781+0000 mon.a (mon.0) 9096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:50 smithi179 bash[23186]: audit 2024-09-21T02:29:49.548546+0000 mon.a (mon.0) 9097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:50 smithi179 bash[23186]: audit 2024-09-21T02:29:49.556595+0000 mon.a (mon.0) 9098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:50 smithi179 bash[23186]: audit 2024-09-21T02:29:49.566394+0000 mon.a (mon.0) 9099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:51.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:51.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:51.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:52.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:52.494 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:52 smithi049 bash[23528]: cluster 2024-09-21T02:29:51.207456+0000 mgr.a (mgr.14388) 11051 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:52 smithi044 bash[22676]: cluster 2024-09-21T02:29:51.207456+0000 mgr.a (mgr.14388) 11051 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:52 smithi179 bash[23186]: cluster 2024-09-21T02:29:51.207456+0000 mgr.a (mgr.14388) 11051 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:53 smithi049 bash[23528]: audit 2024-09-21T02:29:51.816495+0000 mgr.a (mgr.14388) 11052 : audit [DBG] from='client.243135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:53 smithi044 bash[22676]: audit 2024-09-21T02:29:51.816495+0000 mgr.a (mgr.14388) 11052 : audit [DBG] from='client.243135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:53 smithi179 bash[23186]: audit 2024-09-21T02:29:51.816495+0000 mgr.a (mgr.14388) 11052 : audit [DBG] from='client.243135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:54 smithi049 bash[23528]: cluster 2024-09-21T02:29:53.208530+0000 mgr.a (mgr.14388) 11053 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:54 smithi044 bash[22676]: cluster 2024-09-21T02:29:53.208530+0000 mgr.a (mgr.14388) 11053 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:54 smithi179 bash[23186]: cluster 2024-09-21T02:29:53.208530+0000 mgr.a (mgr.14388) 11053 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:56 smithi044 bash[22676]: cluster 2024-09-21T02:29:55.210757+0000 mgr.a (mgr.14388) 11054 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:56 smithi179 bash[23186]: cluster 2024-09-21T02:29:55.210757+0000 mgr.a (mgr.14388) 11054 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:56 smithi049 bash[23528]: cluster 2024-09-21T02:29:55.210757+0000 mgr.a (mgr.14388) 11054 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:29:57.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:29:57.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:29:57.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:29:57.998 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:29:57.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:29:57.998 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:29:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:29:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:29:58.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:57 smithi179 bash[23186]: audit 2024-09-21T02:29:56.908544+0000 mon.a (mon.0) 9100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:57 smithi179 bash[23186]: audit 2024-09-21T02:29:56.917550+0000 mon.a (mon.0) 9101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:57 smithi179 bash[23186]: audit 2024-09-21T02:29:56.928047+0000 mon.a (mon.0) 9102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.191 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:57 smithi179 bash[23186]: cluster 2024-09-21T02:29:57.211512+0000 mgr.a (mgr.14388) 11055 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:57 smithi044 bash[22676]: audit 2024-09-21T02:29:56.908544+0000 mon.a (mon.0) 9100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:57 smithi044 bash[22676]: audit 2024-09-21T02:29:56.917550+0000 mon.a (mon.0) 9101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:57 smithi044 bash[22676]: audit 2024-09-21T02:29:56.928047+0000 mon.a (mon.0) 9102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:57 smithi044 bash[22676]: cluster 2024-09-21T02:29:57.211512+0000 mgr.a (mgr.14388) 11055 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:57 smithi049 bash[23528]: audit 2024-09-21T02:29:56.908544+0000 mon.a (mon.0) 9100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:57 smithi049 bash[23528]: audit 2024-09-21T02:29:56.917550+0000 mon.a (mon.0) 9101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:57 smithi049 bash[23528]: audit 2024-09-21T02:29:56.928047+0000 mon.a (mon.0) 9102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:29:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:57 smithi049 bash[23528]: cluster 2024-09-21T02:29:57.211512+0000 mgr.a (mgr.14388) 11055 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:29:59.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:58 smithi179 bash[23186]: audit 2024-09-21T02:29:57.566945+0000 mgr.a (mgr.14388) 11056 : audit [DBG] from='client.243210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:58 smithi044 bash[22676]: audit 2024-09-21T02:29:57.566945+0000 mgr.a (mgr.14388) 11056 : audit [DBG] from='client.243210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:29:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:58 smithi049 bash[23528]: audit 2024-09-21T02:29:57.566945+0000 mgr.a (mgr.14388) 11056 : audit [DBG] from='client.243210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:59 smithi044 bash[22676]: cluster 2024-09-21T02:29:59.212411+0000 mgr.a (mgr.14388) 11057 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:59 smithi044 bash[22676]: audit 2024-09-21T02:29:59.584926+0000 mon.a (mon.0) 9103 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:30:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:59 smithi044 bash[22676]: audit 2024-09-21T02:29:59.596694+0000 mon.a (mon.0) 9104 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:30:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:59 smithi044 bash[22676]: audit 2024-09-21T02:29:59.598555+0000 mon.a (mon.0) 9105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:30:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:59 smithi044 bash[22676]: audit 2024-09-21T02:29:59.610075+0000 mon.a (mon.0) 9106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:29:59 smithi044 bash[22676]: audit 2024-09-21T02:29:59.616376+0000 mon.a (mon.0) 9107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:30:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:59 smithi179 bash[23186]: cluster 2024-09-21T02:29:59.212411+0000 mgr.a (mgr.14388) 11057 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:59 smithi179 bash[23186]: audit 2024-09-21T02:29:59.584926+0000 mon.a (mon.0) 9103 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:30:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:59 smithi179 bash[23186]: audit 2024-09-21T02:29:59.596694+0000 mon.a (mon.0) 9104 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:30:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:59 smithi179 bash[23186]: audit 2024-09-21T02:29:59.598555+0000 mon.a (mon.0) 9105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:30:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:59 smithi179 bash[23186]: audit 2024-09-21T02:29:59.610075+0000 mon.a (mon.0) 9106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:29:59 smithi179 bash[23186]: audit 2024-09-21T02:29:59.616376+0000 mon.a (mon.0) 9107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:30:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:59 smithi049 bash[23528]: cluster 2024-09-21T02:29:59.212411+0000 mgr.a (mgr.14388) 11057 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:59 smithi049 bash[23528]: audit 2024-09-21T02:29:59.584926+0000 mon.a (mon.0) 9103 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:30:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:59 smithi049 bash[23528]: audit 2024-09-21T02:29:59.596694+0000 mon.a (mon.0) 9104 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:30:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:59 smithi049 bash[23528]: audit 2024-09-21T02:29:59.598555+0000 mon.a (mon.0) 9105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:30:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:59 smithi049 bash[23528]: audit 2024-09-21T02:29:59.610075+0000 mon.a (mon.0) 9106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:00.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:29:59 smithi049 bash[23528]: audit 2024-09-21T02:29:59.616376+0000 mon.a (mon.0) 9107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:30:00.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:30:00 smithi044 bash[22930]: debug 2024-09-21T02:30:00.401+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:30:00.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:30:00 smithi044 bash[22930]: debug 2024-09-21T02:30:00.401+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:30:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:00 smithi044 bash[22676]: audit 2024-09-21T02:29:59.618987+0000 mgr.a (mgr.14388) 11058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:30:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:00 smithi044 bash[22676]: cluster 2024-09-21T02:30:00.000125+0000 mon.a (mon.0) 9108 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:30:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:00 smithi044 bash[22676]: audit 2024-09-21T02:30:00.407712+0000 mgr.a (mgr.14388) 11059 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:30:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:00 smithi044 bash[22676]: cephadm 2024-09-21T02:30:00.408993+0000 mgr.a (mgr.14388) 11060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:30:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:00 smithi179 bash[23186]: audit 2024-09-21T02:29:59.618987+0000 mgr.a (mgr.14388) 11058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:30:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:00 smithi179 bash[23186]: cluster 2024-09-21T02:30:00.000125+0000 mon.a (mon.0) 9108 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:30:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:00 smithi179 bash[23186]: audit 2024-09-21T02:30:00.407712+0000 mgr.a (mgr.14388) 11059 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:30:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:00 smithi179 bash[23186]: cephadm 2024-09-21T02:30:00.408993+0000 mgr.a (mgr.14388) 11060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:30:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:00 smithi049 bash[23528]: audit 2024-09-21T02:29:59.618987+0000 mgr.a (mgr.14388) 11058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:30:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:00 smithi049 bash[23528]: cluster 2024-09-21T02:30:00.000125+0000 mon.a (mon.0) 9108 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:30:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:00 smithi049 bash[23528]: audit 2024-09-21T02:30:00.407712+0000 mgr.a (mgr.14388) 11059 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:30:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:00 smithi049 bash[23528]: cephadm 2024-09-21T02:30:00.408993+0000 mgr.a (mgr.14388) 11060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:30:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:01 smithi179 bash[23186]: cluster 2024-09-21T02:30:01.215220+0000 mgr.a (mgr.14388) 11061 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:30:02.041 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:01 smithi044 bash[22676]: cluster 2024-09-21T02:30:01.215220+0000 mgr.a (mgr.14388) 11061 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:30:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:01 smithi049 bash[23528]: cluster 2024-09-21T02:30:01.215220+0000 mgr.a (mgr.14388) 11061 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:30:02.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:03.000 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:03.000 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:04 smithi049 bash[23528]: cluster 2024-09-21T02:30:03.215978+0000 mgr.a (mgr.14388) 11062 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:30:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:04 smithi049 bash[23528]: audit 2024-09-21T02:30:03.324431+0000 mgr.a (mgr.14388) 11063 : audit [DBG] from='client.243393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:04 smithi044 bash[22676]: cluster 2024-09-21T02:30:03.215978+0000 mgr.a (mgr.14388) 11062 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:30:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:04 smithi044 bash[22676]: audit 2024-09-21T02:30:03.324431+0000 mgr.a (mgr.14388) 11063 : audit [DBG] from='client.243393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:04 smithi179 bash[23186]: cluster 2024-09-21T02:30:03.215978+0000 mgr.a (mgr.14388) 11062 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:30:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:04 smithi179 bash[23186]: audit 2024-09-21T02:30:03.324431+0000 mgr.a (mgr.14388) 11063 : audit [DBG] from='client.243393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:06 smithi049 bash[23528]: cluster 2024-09-21T02:30:05.218266+0000 mgr.a (mgr.14388) 11064 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:06 smithi044 bash[22676]: cluster 2024-09-21T02:30:05.218266+0000 mgr.a (mgr.14388) 11064 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:06 smithi179 bash[23186]: cluster 2024-09-21T02:30:05.218266+0000 mgr.a (mgr.14388) 11064 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:08 smithi049 bash[23528]: cluster 2024-09-21T02:30:07.219050+0000 mgr.a (mgr.14388) 11065 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:08 smithi044 bash[22676]: cluster 2024-09-21T02:30:07.219050+0000 mgr.a (mgr.14388) 11065 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:08 smithi179 bash[23186]: cluster 2024-09-21T02:30:07.219050+0000 mgr.a (mgr.14388) 11065 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:08.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:08.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:08.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:09.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:09.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:09.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:09.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:09.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: audit 2024-09-21T02:30:09.125860+0000 mgr.a (mgr.14388) 11066 : audit [DBG] from='client.243468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: cluster 2024-09-21T02:30:09.219550+0000 mgr.a (mgr.14388) 11067 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: audit 2024-09-21T02:30:09.641819+0000 mon.a (mon.0) 9109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: audit 2024-09-21T02:30:09.646706+0000 mon.a (mon.0) 9110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: audit 2024-09-21T02:30:09.653007+0000 mon.a (mon.0) 9111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: audit 2024-09-21T02:30:09.688504+0000 mon.a (mon.0) 9112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: audit 2024-09-21T02:30:09.694355+0000 mon.a (mon.0) 9113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:10 smithi049 bash[23528]: audit 2024-09-21T02:30:09.700667+0000 mon.a (mon.0) 9114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: audit 2024-09-21T02:30:09.125860+0000 mgr.a (mgr.14388) 11066 : audit [DBG] from='client.243468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: cluster 2024-09-21T02:30:09.219550+0000 mgr.a (mgr.14388) 11067 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: audit 2024-09-21T02:30:09.641819+0000 mon.a (mon.0) 9109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: audit 2024-09-21T02:30:09.646706+0000 mon.a (mon.0) 9110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: audit 2024-09-21T02:30:09.653007+0000 mon.a (mon.0) 9111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: audit 2024-09-21T02:30:09.688504+0000 mon.a (mon.0) 9112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: audit 2024-09-21T02:30:09.694355+0000 mon.a (mon.0) 9113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:10 smithi044 bash[22676]: audit 2024-09-21T02:30:09.700667+0000 mon.a (mon.0) 9114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: audit 2024-09-21T02:30:09.125860+0000 mgr.a (mgr.14388) 11066 : audit [DBG] from='client.243468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: cluster 2024-09-21T02:30:09.219550+0000 mgr.a (mgr.14388) 11067 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: audit 2024-09-21T02:30:09.641819+0000 mon.a (mon.0) 9109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: audit 2024-09-21T02:30:09.646706+0000 mon.a (mon.0) 9110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: audit 2024-09-21T02:30:09.653007+0000 mon.a (mon.0) 9111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: audit 2024-09-21T02:30:09.688504+0000 mon.a (mon.0) 9112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: audit 2024-09-21T02:30:09.694355+0000 mon.a (mon.0) 9113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:10 smithi179 bash[23186]: audit 2024-09-21T02:30:09.700667+0000 mon.a (mon.0) 9114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:12 smithi049 bash[23528]: cluster 2024-09-21T02:30:11.222076+0000 mgr.a (mgr.14388) 11068 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:12 smithi044 bash[22676]: cluster 2024-09-21T02:30:11.222076+0000 mgr.a (mgr.14388) 11068 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:12 smithi179 bash[23186]: cluster 2024-09-21T02:30:11.222076+0000 mgr.a (mgr.14388) 11068 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:30:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:14 smithi049 bash[23528]: cluster 2024-09-21T02:30:13.222848+0000 mgr.a (mgr.14388) 11069 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:30:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:14 smithi044 bash[22676]: cluster 2024-09-21T02:30:13.222848+0000 mgr.a (mgr.14388) 11069 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:30:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:14 smithi179 bash[23186]: cluster 2024-09-21T02:30:13.222848+0000 mgr.a (mgr.14388) 11069 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:30:15.311 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:15.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:16 smithi049 bash[23528]: audit 2024-09-21T02:30:14.876935+0000 mgr.a (mgr.14388) 11070 : audit [DBG] from='client.243543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:16 smithi049 bash[23528]: cluster 2024-09-21T02:30:15.224202+0000 mgr.a (mgr.14388) 11071 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:30:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:16 smithi044 bash[22676]: audit 2024-09-21T02:30:14.876935+0000 mgr.a (mgr.14388) 11070 : audit [DBG] from='client.243543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:16 smithi044 bash[22676]: cluster 2024-09-21T02:30:15.224202+0000 mgr.a (mgr.14388) 11071 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:30:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:16 smithi179 bash[23186]: audit 2024-09-21T02:30:14.876935+0000 mgr.a (mgr.14388) 11070 : audit [DBG] from='client.243543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:16 smithi179 bash[23186]: cluster 2024-09-21T02:30:15.224202+0000 mgr.a (mgr.14388) 11071 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:30:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:18 smithi044 bash[22676]: audit 2024-09-21T02:30:17.144781+0000 mon.a (mon.0) 9115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:18 smithi044 bash[22676]: audit 2024-09-21T02:30:17.153747+0000 mon.a (mon.0) 9116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:18 smithi044 bash[22676]: audit 2024-09-21T02:30:17.164672+0000 mon.a (mon.0) 9117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:18 smithi044 bash[22676]: cluster 2024-09-21T02:30:17.224955+0000 mgr.a (mgr.14388) 11072 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:30:18.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:18 smithi179 bash[23186]: audit 2024-09-21T02:30:17.144781+0000 mon.a (mon.0) 9115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:18 smithi179 bash[23186]: audit 2024-09-21T02:30:17.153747+0000 mon.a (mon.0) 9116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:18 smithi179 bash[23186]: audit 2024-09-21T02:30:17.164672+0000 mon.a (mon.0) 9117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:18 smithi179 bash[23186]: cluster 2024-09-21T02:30:17.224955+0000 mgr.a (mgr.14388) 11072 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:30:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:18 smithi049 bash[23528]: audit 2024-09-21T02:30:17.144781+0000 mon.a (mon.0) 9115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:18 smithi049 bash[23528]: audit 2024-09-21T02:30:17.153747+0000 mon.a (mon.0) 9116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:18 smithi049 bash[23528]: audit 2024-09-21T02:30:17.164672+0000 mon.a (mon.0) 9117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:18 smithi049 bash[23528]: cluster 2024-09-21T02:30:17.224955+0000 mgr.a (mgr.14388) 11072 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:30:20.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:20.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:20.314 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:20 smithi049 bash[23528]: cluster 2024-09-21T02:30:19.225738+0000 mgr.a (mgr.14388) 11073 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:30:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:20 smithi044 bash[22676]: cluster 2024-09-21T02:30:19.225738+0000 mgr.a (mgr.14388) 11073 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:30:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:20 smithi179 bash[23186]: cluster 2024-09-21T02:30:19.225738+0000 mgr.a (mgr.14388) 11073 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:30:21.080 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:22 smithi044 bash[22676]: audit 2024-09-21T02:30:20.645158+0000 mgr.a (mgr.14388) 11074 : audit [DBG] from='client.243621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:22 smithi044 bash[22676]: cluster 2024-09-21T02:30:21.228353+0000 mgr.a (mgr.14388) 11075 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:22 smithi049 bash[23528]: audit 2024-09-21T02:30:20.645158+0000 mgr.a (mgr.14388) 11074 : audit [DBG] from='client.243621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:22 smithi049 bash[23528]: cluster 2024-09-21T02:30:21.228353+0000 mgr.a (mgr.14388) 11075 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:22 smithi179 bash[23186]: audit 2024-09-21T02:30:20.645158+0000 mgr.a (mgr.14388) 11074 : audit [DBG] from='client.243621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:22 smithi179 bash[23186]: cluster 2024-09-21T02:30:21.228353+0000 mgr.a (mgr.14388) 11075 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:24.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:24 smithi179 bash[23186]: cluster 2024-09-21T02:30:23.229273+0000 mgr.a (mgr.14388) 11076 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:30:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:24 smithi049 bash[23528]: cluster 2024-09-21T02:30:23.229273+0000 mgr.a (mgr.14388) 11076 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:30:24.565 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:24 smithi044 bash[22676]: cluster 2024-09-21T02:30:23.229273+0000 mgr.a (mgr.14388) 11076 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:30:26.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:26.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:26.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:26 smithi049 bash[23528]: cluster 2024-09-21T02:30:25.231214+0000 mgr.a (mgr.14388) 11077 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:26.683 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:26 smithi044 bash[22676]: cluster 2024-09-21T02:30:25.231214+0000 mgr.a (mgr.14388) 11077 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:26 smithi179 bash[23186]: cluster 2024-09-21T02:30:25.231214+0000 mgr.a (mgr.14388) 11077 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:26.870 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:26.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:26.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:26.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:26.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:28 smithi049 bash[23528]: audit 2024-09-21T02:30:26.419305+0000 mgr.a (mgr.14388) 11078 : audit [DBG] from='client.243699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:28 smithi049 bash[23528]: cluster 2024-09-21T02:30:27.232119+0000 mgr.a (mgr.14388) 11079 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:30:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:28 smithi044 bash[22676]: audit 2024-09-21T02:30:26.419305+0000 mgr.a (mgr.14388) 11078 : audit [DBG] from='client.243699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:28 smithi044 bash[22676]: cluster 2024-09-21T02:30:27.232119+0000 mgr.a (mgr.14388) 11079 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:30:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:28 smithi179 bash[23186]: audit 2024-09-21T02:30:26.419305+0000 mgr.a (mgr.14388) 11078 : audit [DBG] from='client.243699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:28 smithi179 bash[23186]: cluster 2024-09-21T02:30:27.232119+0000 mgr.a (mgr.14388) 11079 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:30:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:30 smithi044 bash[22676]: cluster 2024-09-21T02:30:29.232905+0000 mgr.a (mgr.14388) 11080 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:30:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:30 smithi044 bash[22676]: audit 2024-09-21T02:30:29.861349+0000 mon.a (mon.0) 9118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:30 smithi044 bash[22676]: audit 2024-09-21T02:30:29.871778+0000 mon.a (mon.0) 9119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:30 smithi044 bash[22676]: audit 2024-09-21T02:30:29.883204+0000 mon.a (mon.0) 9120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:30 smithi044 bash[22676]: audit 2024-09-21T02:30:29.923789+0000 mon.a (mon.0) 9121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:30 smithi044 bash[22676]: audit 2024-09-21T02:30:29.932183+0000 mon.a (mon.0) 9122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:30 smithi044 bash[22676]: audit 2024-09-21T02:30:29.941767+0000 mon.a (mon.0) 9123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:30 smithi179 bash[23186]: cluster 2024-09-21T02:30:29.232905+0000 mgr.a (mgr.14388) 11080 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:30:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:30 smithi179 bash[23186]: audit 2024-09-21T02:30:29.861349+0000 mon.a (mon.0) 9118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:30 smithi179 bash[23186]: audit 2024-09-21T02:30:29.871778+0000 mon.a (mon.0) 9119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:30 smithi179 bash[23186]: audit 2024-09-21T02:30:29.883204+0000 mon.a (mon.0) 9120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:30 smithi179 bash[23186]: audit 2024-09-21T02:30:29.923789+0000 mon.a (mon.0) 9121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:30 smithi179 bash[23186]: audit 2024-09-21T02:30:29.932183+0000 mon.a (mon.0) 9122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:30 smithi179 bash[23186]: audit 2024-09-21T02:30:29.941767+0000 mon.a (mon.0) 9123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:30 smithi049 bash[23528]: cluster 2024-09-21T02:30:29.232905+0000 mgr.a (mgr.14388) 11080 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T02:30:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:30 smithi049 bash[23528]: audit 2024-09-21T02:30:29.861349+0000 mon.a (mon.0) 9118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:30 smithi049 bash[23528]: audit 2024-09-21T02:30:29.871778+0000 mon.a (mon.0) 9119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:30 smithi049 bash[23528]: audit 2024-09-21T02:30:29.883204+0000 mon.a (mon.0) 9120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:30 smithi049 bash[23528]: audit 2024-09-21T02:30:29.923789+0000 mon.a (mon.0) 9121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:30 smithi049 bash[23528]: audit 2024-09-21T02:30:29.932183+0000 mon.a (mon.0) 9122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:30 smithi049 bash[23528]: audit 2024-09-21T02:30:29.941767+0000 mon.a (mon.0) 9123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:31.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:32.638 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:32 smithi044 bash[22676]: cluster 2024-09-21T02:30:31.235147+0000 mgr.a (mgr.14388) 11081 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:30:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:32 smithi179 bash[23186]: cluster 2024-09-21T02:30:31.235147+0000 mgr.a (mgr.14388) 11081 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:30:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:32 smithi049 bash[23528]: cluster 2024-09-21T02:30:31.235147+0000 mgr.a (mgr.14388) 11081 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:30:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:33 smithi049 bash[23528]: audit 2024-09-21T02:30:32.209067+0000 mgr.a (mgr.14388) 11082 : audit [DBG] from='client.243774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:33 smithi044 bash[22676]: audit 2024-09-21T02:30:32.209067+0000 mgr.a (mgr.14388) 11082 : audit [DBG] from='client.243774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:33 smithi179 bash[23186]: audit 2024-09-21T02:30:32.209067+0000 mgr.a (mgr.14388) 11082 : audit [DBG] from='client.243774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:34 smithi044 bash[22676]: cluster 2024-09-21T02:30:33.236137+0000 mgr.a (mgr.14388) 11083 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:34 smithi179 bash[23186]: cluster 2024-09-21T02:30:33.236137+0000 mgr.a (mgr.14388) 11083 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:34 smithi049 bash[23528]: cluster 2024-09-21T02:30:33.236137+0000 mgr.a (mgr.14388) 11083 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:36 smithi044 bash[22676]: cluster 2024-09-21T02:30:35.238363+0000 mgr.a (mgr.14388) 11084 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:36 smithi179 bash[23186]: cluster 2024-09-21T02:30:35.238363+0000 mgr.a (mgr.14388) 11084 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:36 smithi049 bash[23528]: cluster 2024-09-21T02:30:35.238363+0000 mgr.a (mgr.14388) 11084 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:37.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:38.425 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:38.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:38.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:38.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:38.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:38.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:38 smithi179 bash[23186]: cluster 2024-09-21T02:30:37.239179+0000 mgr.a (mgr.14388) 11085 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:38.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:38 smithi179 bash[23186]: audit 2024-09-21T02:30:37.379725+0000 mon.a (mon.0) 9124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:38 smithi179 bash[23186]: audit 2024-09-21T02:30:37.388385+0000 mon.a (mon.0) 9125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:38 smithi179 bash[23186]: audit 2024-09-21T02:30:37.398897+0000 mon.a (mon.0) 9126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:38 smithi044 bash[22676]: cluster 2024-09-21T02:30:37.239179+0000 mgr.a (mgr.14388) 11085 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:38 smithi044 bash[22676]: audit 2024-09-21T02:30:37.379725+0000 mon.a (mon.0) 9124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:38 smithi044 bash[22676]: audit 2024-09-21T02:30:37.388385+0000 mon.a (mon.0) 9125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:38 smithi044 bash[22676]: audit 2024-09-21T02:30:37.398897+0000 mon.a (mon.0) 9126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:38 smithi049 bash[23528]: cluster 2024-09-21T02:30:37.239179+0000 mgr.a (mgr.14388) 11085 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:38 smithi049 bash[23528]: audit 2024-09-21T02:30:37.379725+0000 mon.a (mon.0) 9124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:38 smithi049 bash[23528]: audit 2024-09-21T02:30:37.388385+0000 mon.a (mon.0) 9125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:38 smithi049 bash[23528]: audit 2024-09-21T02:30:37.398897+0000 mon.a (mon.0) 9126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:39.670 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:39 smithi179 bash[23186]: audit 2024-09-21T02:30:37.975769+0000 mgr.a (mgr.14388) 11086 : audit [DBG] from='client.243849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:39 smithi044 bash[22676]: audit 2024-09-21T02:30:37.975769+0000 mgr.a (mgr.14388) 11086 : audit [DBG] from='client.243849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:39 smithi049 bash[23528]: audit 2024-09-21T02:30:37.975769+0000 mgr.a (mgr.14388) 11086 : audit [DBG] from='client.243849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:40 smithi044 bash[22676]: cluster 2024-09-21T02:30:39.240210+0000 mgr.a (mgr.14388) 11087 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:40 smithi179 bash[23186]: cluster 2024-09-21T02:30:39.240210+0000 mgr.a (mgr.14388) 11087 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:40 smithi049 bash[23528]: cluster 2024-09-21T02:30:39.240210+0000 mgr.a (mgr.14388) 11087 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:42 smithi179 bash[23186]: cluster 2024-09-21T02:30:41.242507+0000 mgr.a (mgr.14388) 11088 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:42.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:42 smithi044 bash[22676]: cluster 2024-09-21T02:30:41.242507+0000 mgr.a (mgr.14388) 11088 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:42 smithi049 bash[23528]: cluster 2024-09-21T02:30:41.242507+0000 mgr.a (mgr.14388) 11088 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:43.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:43.427 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:43.427 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:44.193 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:44.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:44.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:44.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:44.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:44.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:44 smithi179 bash[23186]: cluster 2024-09-21T02:30:43.243311+0000 mgr.a (mgr.14388) 11089 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:44 smithi044 bash[22676]: cluster 2024-09-21T02:30:43.243311+0000 mgr.a (mgr.14388) 11089 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:44 smithi049 bash[23528]: cluster 2024-09-21T02:30:43.243311+0000 mgr.a (mgr.14388) 11089 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:45 smithi044 bash[22676]: audit 2024-09-21T02:30:43.759421+0000 mgr.a (mgr.14388) 11090 : audit [DBG] from='client.243927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:45.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:45 smithi179 bash[23186]: audit 2024-09-21T02:30:43.759421+0000 mgr.a (mgr.14388) 11090 : audit [DBG] from='client.243927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:45 smithi049 bash[23528]: audit 2024-09-21T02:30:43.759421+0000 mgr.a (mgr.14388) 11090 : audit [DBG] from='client.243927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:46 smithi044 bash[22676]: cluster 2024-09-21T02:30:45.245736+0000 mgr.a (mgr.14388) 11091 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:46 smithi179 bash[23186]: cluster 2024-09-21T02:30:45.245736+0000 mgr.a (mgr.14388) 11091 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:46 smithi049 bash[23528]: cluster 2024-09-21T02:30:45.245736+0000 mgr.a (mgr.14388) 11091 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:30:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:48 smithi044 bash[22676]: cluster 2024-09-21T02:30:47.246528+0000 mgr.a (mgr.14388) 11092 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:48 smithi179 bash[23186]: cluster 2024-09-21T02:30:47.246528+0000 mgr.a (mgr.14388) 11092 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:48 smithi049 bash[23528]: cluster 2024-09-21T02:30:47.246528+0000 mgr.a (mgr.14388) 11092 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:49.989 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:49.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:50 smithi044 bash[22676]: cluster 2024-09-21T02:30:49.247332+0000 mgr.a (mgr.14388) 11093 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:50 smithi044 bash[22676]: audit 2024-09-21T02:30:50.071300+0000 mon.a (mon.0) 9127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:50 smithi044 bash[22676]: audit 2024-09-21T02:30:50.077315+0000 mon.a (mon.0) 9128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:50 smithi044 bash[22676]: audit 2024-09-21T02:30:50.082950+0000 mon.a (mon.0) 9129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:50 smithi044 bash[22676]: audit 2024-09-21T02:30:50.088127+0000 mon.a (mon.0) 9130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:50 smithi044 bash[22676]: audit 2024-09-21T02:30:50.093341+0000 mon.a (mon.0) 9131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:50 smithi044 bash[22676]: audit 2024-09-21T02:30:50.099330+0000 mon.a (mon.0) 9132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:50 smithi179 bash[23186]: cluster 2024-09-21T02:30:49.247332+0000 mgr.a (mgr.14388) 11093 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:50 smithi179 bash[23186]: audit 2024-09-21T02:30:50.071300+0000 mon.a (mon.0) 9127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:50 smithi179 bash[23186]: audit 2024-09-21T02:30:50.077315+0000 mon.a (mon.0) 9128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:50 smithi179 bash[23186]: audit 2024-09-21T02:30:50.082950+0000 mon.a (mon.0) 9129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:50 smithi179 bash[23186]: audit 2024-09-21T02:30:50.088127+0000 mon.a (mon.0) 9130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:50 smithi179 bash[23186]: audit 2024-09-21T02:30:50.093341+0000 mon.a (mon.0) 9131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:50 smithi179 bash[23186]: audit 2024-09-21T02:30:50.099330+0000 mon.a (mon.0) 9132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:50 smithi049 bash[23528]: cluster 2024-09-21T02:30:49.247332+0000 mgr.a (mgr.14388) 11093 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:50 smithi049 bash[23528]: audit 2024-09-21T02:30:50.071300+0000 mon.a (mon.0) 9127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:50 smithi049 bash[23528]: audit 2024-09-21T02:30:50.077315+0000 mon.a (mon.0) 9128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:50 smithi049 bash[23528]: audit 2024-09-21T02:30:50.082950+0000 mon.a (mon.0) 9129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:50 smithi049 bash[23528]: audit 2024-09-21T02:30:50.088127+0000 mon.a (mon.0) 9130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:50 smithi049 bash[23528]: audit 2024-09-21T02:30:50.093341+0000 mon.a (mon.0) 9131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:50 smithi049 bash[23528]: audit 2024-09-21T02:30:50.099330+0000 mon.a (mon.0) 9132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:51 smithi044 bash[22676]: audit 2024-09-21T02:30:49.533992+0000 mgr.a (mgr.14388) 11094 : audit [DBG] from='client.244005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:51 smithi179 bash[23186]: audit 2024-09-21T02:30:49.533992+0000 mgr.a (mgr.14388) 11094 : audit [DBG] from='client.244005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:51 smithi049 bash[23528]: audit 2024-09-21T02:30:49.533992+0000 mgr.a (mgr.14388) 11094 : audit [DBG] from='client.244005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:52 smithi044 bash[22676]: cluster 2024-09-21T02:30:51.249795+0000 mgr.a (mgr.14388) 11095 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:30:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:52 smithi179 bash[23186]: cluster 2024-09-21T02:30:51.249795+0000 mgr.a (mgr.14388) 11095 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:30:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:52 smithi049 bash[23528]: cluster 2024-09-21T02:30:51.249795+0000 mgr.a (mgr.14388) 11095 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:30:53.726 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:53 smithi049 bash[23528]: cluster 2024-09-21T02:30:53.250584+0000 mgr.a (mgr.14388) 11096 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:30:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:53 smithi044 bash[22676]: cluster 2024-09-21T02:30:53.250584+0000 mgr.a (mgr.14388) 11096 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:30:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:53 smithi179 bash[23186]: cluster 2024-09-21T02:30:53.250584+0000 mgr.a (mgr.14388) 11096 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:30:54.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:30:54.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:30:54.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:30:55.742 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:30:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:30:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:30:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:30:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:30:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:56 smithi049 bash[23528]: cluster 2024-09-21T02:30:55.251789+0000 mgr.a (mgr.14388) 11097 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:56 smithi049 bash[23528]: audit 2024-09-21T02:30:55.323862+0000 mgr.a (mgr.14388) 11098 : audit [DBG] from='client.244083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:56 smithi044 bash[22676]: cluster 2024-09-21T02:30:55.251789+0000 mgr.a (mgr.14388) 11097 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:56 smithi044 bash[22676]: audit 2024-09-21T02:30:55.323862+0000 mgr.a (mgr.14388) 11098 : audit [DBG] from='client.244083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:56 smithi179 bash[23186]: cluster 2024-09-21T02:30:55.251789+0000 mgr.a (mgr.14388) 11097 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:30:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:56 smithi179 bash[23186]: audit 2024-09-21T02:30:55.323862+0000 mgr.a (mgr.14388) 11098 : audit [DBG] from='client.244083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:30:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:58 smithi044 bash[22676]: cluster 2024-09-21T02:30:57.252751+0000 mgr.a (mgr.14388) 11099 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:30:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:58 smithi044 bash[22676]: audit 2024-09-21T02:30:57.613318+0000 mon.a (mon.0) 9133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:58 smithi044 bash[22676]: audit 2024-09-21T02:30:57.622045+0000 mon.a (mon.0) 9134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:30:58 smithi044 bash[22676]: audit 2024-09-21T02:30:57.632549+0000 mon.a (mon.0) 9135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:58 smithi179 bash[23186]: cluster 2024-09-21T02:30:57.252751+0000 mgr.a (mgr.14388) 11099 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:30:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:58 smithi179 bash[23186]: audit 2024-09-21T02:30:57.613318+0000 mon.a (mon.0) 9133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:58 smithi179 bash[23186]: audit 2024-09-21T02:30:57.622045+0000 mon.a (mon.0) 9134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:30:58 smithi179 bash[23186]: audit 2024-09-21T02:30:57.632549+0000 mon.a (mon.0) 9135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:58 smithi049 bash[23528]: cluster 2024-09-21T02:30:57.252751+0000 mgr.a (mgr.14388) 11099 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:30:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:58 smithi049 bash[23528]: audit 2024-09-21T02:30:57.613318+0000 mon.a (mon.0) 9133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:58 smithi049 bash[23528]: audit 2024-09-21T02:30:57.622045+0000 mon.a (mon.0) 9134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:30:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:30:58 smithi049 bash[23528]: audit 2024-09-21T02:30:57.632549+0000 mon.a (mon.0) 9135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:00 smithi179 bash[23186]: cluster 2024-09-21T02:30:59.253549+0000 mgr.a (mgr.14388) 11100 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:31:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:00 smithi044 bash[22676]: cluster 2024-09-21T02:30:59.253549+0000 mgr.a (mgr.14388) 11100 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:31:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:00.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:00 smithi049 bash[23528]: cluster 2024-09-21T02:30:59.253549+0000 mgr.a (mgr.14388) 11100 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:31:01.608 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:31:01 smithi044 bash[22930]: debug 2024-09-21T02:31:01.272+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:31:01.608 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:31:01 smithi044 bash[22930]: debug 2024-09-21T02:31:01.284+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:31:01.608 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:01 smithi044 bash[22676]: audit 2024-09-21T02:31:00.465758+0000 mon.a (mon.0) 9136 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:31:01.608 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:01 smithi044 bash[22676]: audit 2024-09-21T02:31:00.472252+0000 mon.a (mon.0) 9137 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:31:01.608 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:01 smithi044 bash[22676]: audit 2024-09-21T02:31:00.474318+0000 mon.a (mon.0) 9138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:31:01.608 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:01 smithi044 bash[22676]: audit 2024-09-21T02:31:00.485676+0000 mon.a (mon.0) 9139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:01.608 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:01 smithi044 bash[22676]: audit 2024-09-21T02:31:00.491866+0000 mon.a (mon.0) 9140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:31:01.634 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:01 smithi179 bash[23186]: audit 2024-09-21T02:31:00.465758+0000 mon.a (mon.0) 9136 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:31:01.634 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:01 smithi179 bash[23186]: audit 2024-09-21T02:31:00.472252+0000 mon.a (mon.0) 9137 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:31:01.634 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:01 smithi179 bash[23186]: audit 2024-09-21T02:31:00.474318+0000 mon.a (mon.0) 9138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:31:01.634 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:01 smithi179 bash[23186]: audit 2024-09-21T02:31:00.485676+0000 mon.a (mon.0) 9139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:01.634 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:01 smithi179 bash[23186]: audit 2024-09-21T02:31:00.491866+0000 mon.a (mon.0) 9140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:31:01.681 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:01.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:01.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:01.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:01.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:01 smithi049 bash[23528]: audit 2024-09-21T02:31:00.465758+0000 mon.a (mon.0) 9136 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:31:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:01 smithi049 bash[23528]: audit 2024-09-21T02:31:00.472252+0000 mon.a (mon.0) 9137 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:31:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:01 smithi049 bash[23528]: audit 2024-09-21T02:31:00.474318+0000 mon.a (mon.0) 9138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:31:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:01 smithi049 bash[23528]: audit 2024-09-21T02:31:00.485676+0000 mon.a (mon.0) 9139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:01.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:01 smithi049 bash[23528]: audit 2024-09-21T02:31:00.491866+0000 mon.a (mon.0) 9140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:31:02.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:02 smithi044 bash[22676]: audit 2024-09-21T02:31:00.494267+0000 mgr.a (mgr.14388) 11101 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:31:02.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:02 smithi044 bash[22676]: audit 2024-09-21T02:31:01.083007+0000 mgr.a (mgr.14388) 11102 : audit [DBG] from='client.244215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:02.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:02 smithi044 bash[22676]: cluster 2024-09-21T02:31:01.255469+0000 mgr.a (mgr.14388) 11103 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:02.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:02 smithi044 bash[22676]: audit 2024-09-21T02:31:01.276515+0000 mgr.a (mgr.14388) 11104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:31:02.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:02 smithi044 bash[22676]: cephadm 2024-09-21T02:31:01.288065+0000 mgr.a (mgr.14388) 11105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:31:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:02 smithi179 bash[23186]: audit 2024-09-21T02:31:00.494267+0000 mgr.a (mgr.14388) 11101 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:31:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:02 smithi179 bash[23186]: audit 2024-09-21T02:31:01.083007+0000 mgr.a (mgr.14388) 11102 : audit [DBG] from='client.244215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:02 smithi179 bash[23186]: cluster 2024-09-21T02:31:01.255469+0000 mgr.a (mgr.14388) 11103 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:02 smithi179 bash[23186]: audit 2024-09-21T02:31:01.276515+0000 mgr.a (mgr.14388) 11104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:31:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:02 smithi179 bash[23186]: cephadm 2024-09-21T02:31:01.288065+0000 mgr.a (mgr.14388) 11105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:31:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:02 smithi049 bash[23528]: audit 2024-09-21T02:31:00.494267+0000 mgr.a (mgr.14388) 11101 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:31:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:02 smithi049 bash[23528]: audit 2024-09-21T02:31:01.083007+0000 mgr.a (mgr.14388) 11102 : audit [DBG] from='client.244215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:02 smithi049 bash[23528]: cluster 2024-09-21T02:31:01.255469+0000 mgr.a (mgr.14388) 11103 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:02 smithi049 bash[23528]: audit 2024-09-21T02:31:01.276515+0000 mgr.a (mgr.14388) 11104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:31:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:02 smithi049 bash[23528]: cephadm 2024-09-21T02:31:01.288065+0000 mgr.a (mgr.14388) 11105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:31:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:04 smithi044 bash[22676]: cluster 2024-09-21T02:31:03.256481+0000 mgr.a (mgr.14388) 11106 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:31:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:04 smithi179 bash[23186]: cluster 2024-09-21T02:31:03.256481+0000 mgr.a (mgr.14388) 11106 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:31:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:04 smithi049 bash[23528]: cluster 2024-09-21T02:31:03.256481+0000 mgr.a (mgr.14388) 11106 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:31:06.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:06.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:06.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:06 smithi044 bash[22676]: cluster 2024-09-21T02:31:05.258775+0000 mgr.a (mgr.14388) 11107 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:06 smithi179 bash[23186]: cluster 2024-09-21T02:31:05.258775+0000 mgr.a (mgr.14388) 11107 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:06 smithi049 bash[23528]: cluster 2024-09-21T02:31:05.258775+0000 mgr.a (mgr.14388) 11107 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:07.480 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:07.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:07.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:07.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:07.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:08 smithi044 bash[22676]: audit 2024-09-21T02:31:07.023713+0000 mgr.a (mgr.14388) 11108 : audit [DBG] from='client.244347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:08 smithi044 bash[22676]: cluster 2024-09-21T02:31:07.259344+0000 mgr.a (mgr.14388) 11109 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:08 smithi179 bash[23186]: audit 2024-09-21T02:31:07.023713+0000 mgr.a (mgr.14388) 11108 : audit [DBG] from='client.244347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:08 smithi179 bash[23186]: cluster 2024-09-21T02:31:07.259344+0000 mgr.a (mgr.14388) 11109 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:08 smithi049 bash[23528]: audit 2024-09-21T02:31:07.023713+0000 mgr.a (mgr.14388) 11108 : audit [DBG] from='client.244347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:08 smithi049 bash[23528]: cluster 2024-09-21T02:31:07.259344+0000 mgr.a (mgr.14388) 11109 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:10 smithi044 bash[22676]: cluster 2024-09-21T02:31:09.260266+0000 mgr.a (mgr.14388) 11110 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:10 smithi044 bash[22676]: audit 2024-09-21T02:31:10.302841+0000 mon.a (mon.0) 9141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:10 smithi044 bash[22676]: audit 2024-09-21T02:31:10.311225+0000 mon.a (mon.0) 9142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:10 smithi044 bash[22676]: audit 2024-09-21T02:31:10.326111+0000 mon.a (mon.0) 9143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:10 smithi044 bash[22676]: audit 2024-09-21T02:31:10.333957+0000 mon.a (mon.0) 9144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:10 smithi179 bash[23186]: cluster 2024-09-21T02:31:09.260266+0000 mgr.a (mgr.14388) 11110 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:10 smithi179 bash[23186]: audit 2024-09-21T02:31:10.302841+0000 mon.a (mon.0) 9141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:10 smithi179 bash[23186]: audit 2024-09-21T02:31:10.311225+0000 mon.a (mon.0) 9142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:10 smithi179 bash[23186]: audit 2024-09-21T02:31:10.326111+0000 mon.a (mon.0) 9143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:10 smithi179 bash[23186]: audit 2024-09-21T02:31:10.333957+0000 mon.a (mon.0) 9144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:10 smithi049 bash[23528]: cluster 2024-09-21T02:31:09.260266+0000 mgr.a (mgr.14388) 11110 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:10 smithi049 bash[23528]: audit 2024-09-21T02:31:10.302841+0000 mon.a (mon.0) 9141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:10 smithi049 bash[23528]: audit 2024-09-21T02:31:10.311225+0000 mon.a (mon.0) 9142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:10 smithi049 bash[23528]: audit 2024-09-21T02:31:10.326111+0000 mon.a (mon.0) 9143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:10 smithi049 bash[23528]: audit 2024-09-21T02:31:10.333957+0000 mon.a (mon.0) 9144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:11 smithi044 bash[22676]: audit 2024-09-21T02:31:10.350581+0000 mon.a (mon.0) 9145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:11 smithi044 bash[22676]: audit 2024-09-21T02:31:10.360698+0000 mon.a (mon.0) 9146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:11 smithi179 bash[23186]: audit 2024-09-21T02:31:10.350581+0000 mon.a (mon.0) 9145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:11 smithi179 bash[23186]: audit 2024-09-21T02:31:10.360698+0000 mon.a (mon.0) 9146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:11 smithi049 bash[23528]: audit 2024-09-21T02:31:10.350581+0000 mon.a (mon.0) 9145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:11 smithi049 bash[23528]: audit 2024-09-21T02:31:10.360698+0000 mon.a (mon.0) 9146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:12.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:12.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:12.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:12 smithi044 bash[22676]: cluster 2024-09-21T02:31:11.262568+0000 mgr.a (mgr.14388) 11111 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:12 smithi179 bash[23186]: cluster 2024-09-21T02:31:11.262568+0000 mgr.a (mgr.14388) 11111 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:12 smithi049 bash[23528]: cluster 2024-09-21T02:31:11.262568+0000 mgr.a (mgr.14388) 11111 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:13.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:13.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:14 smithi049 bash[23528]: audit 2024-09-21T02:31:12.817629+0000 mgr.a (mgr.14388) 11112 : audit [DBG] from='client.244422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:14 smithi049 bash[23528]: cluster 2024-09-21T02:31:13.263239+0000 mgr.a (mgr.14388) 11113 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:14 smithi044 bash[22676]: audit 2024-09-21T02:31:12.817629+0000 mgr.a (mgr.14388) 11112 : audit [DBG] from='client.244422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:14 smithi044 bash[22676]: cluster 2024-09-21T02:31:13.263239+0000 mgr.a (mgr.14388) 11113 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:14 smithi179 bash[23186]: audit 2024-09-21T02:31:12.817629+0000 mgr.a (mgr.14388) 11112 : audit [DBG] from='client.244422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:14 smithi179 bash[23186]: cluster 2024-09-21T02:31:13.263239+0000 mgr.a (mgr.14388) 11113 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:16.713 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:16 smithi049 bash[23528]: cluster 2024-09-21T02:31:15.265418+0000 mgr.a (mgr.14388) 11114 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:16 smithi044 bash[22676]: cluster 2024-09-21T02:31:15.265418+0000 mgr.a (mgr.14388) 11114 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:16 smithi179 bash[23186]: cluster 2024-09-21T02:31:15.265418+0000 mgr.a (mgr.14388) 11114 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:31:18.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:18.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:18.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:18 smithi044 bash[22676]: cluster 2024-09-21T02:31:17.266161+0000 mgr.a (mgr.14388) 11115 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:18 smithi044 bash[22676]: audit 2024-09-21T02:31:17.846622+0000 mon.a (mon.0) 9147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:18 smithi044 bash[22676]: audit 2024-09-21T02:31:17.855772+0000 mon.a (mon.0) 9148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:18 smithi044 bash[22676]: audit 2024-09-21T02:31:17.866581+0000 mon.a (mon.0) 9149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:18 smithi179 bash[23186]: cluster 2024-09-21T02:31:17.266161+0000 mgr.a (mgr.14388) 11115 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:18 smithi179 bash[23186]: audit 2024-09-21T02:31:17.846622+0000 mon.a (mon.0) 9147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:18 smithi179 bash[23186]: audit 2024-09-21T02:31:17.855772+0000 mon.a (mon.0) 9148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:18 smithi179 bash[23186]: audit 2024-09-21T02:31:17.866581+0000 mon.a (mon.0) 9149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:18 smithi049 bash[23528]: cluster 2024-09-21T02:31:17.266161+0000 mgr.a (mgr.14388) 11115 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:18 smithi049 bash[23528]: audit 2024-09-21T02:31:17.846622+0000 mon.a (mon.0) 9147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:18 smithi049 bash[23528]: audit 2024-09-21T02:31:17.855772+0000 mon.a (mon.0) 9148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:18 smithi049 bash[23528]: audit 2024-09-21T02:31:17.866581+0000 mon.a (mon.0) 9149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:19.040 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:20 smithi044 bash[22676]: audit 2024-09-21T02:31:18.583931+0000 mgr.a (mgr.14388) 11116 : audit [DBG] from='client.244500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:20 smithi044 bash[22676]: cluster 2024-09-21T02:31:19.267172+0000 mgr.a (mgr.14388) 11117 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:20 smithi179 bash[23186]: audit 2024-09-21T02:31:18.583931+0000 mgr.a (mgr.14388) 11116 : audit [DBG] from='client.244500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:20 smithi179 bash[23186]: cluster 2024-09-21T02:31:19.267172+0000 mgr.a (mgr.14388) 11117 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:20 smithi049 bash[23528]: audit 2024-09-21T02:31:18.583931+0000 mgr.a (mgr.14388) 11116 : audit [DBG] from='client.244500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:20 smithi049 bash[23528]: cluster 2024-09-21T02:31:19.267172+0000 mgr.a (mgr.14388) 11117 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:22.652 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:22 smithi044 bash[22676]: cluster 2024-09-21T02:31:21.269488+0000 mgr.a (mgr.14388) 11118 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:22.663 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:22 smithi179 bash[23186]: cluster 2024-09-21T02:31:21.269488+0000 mgr.a (mgr.14388) 11118 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:22 smithi049 bash[23528]: cluster 2024-09-21T02:31:21.269488+0000 mgr.a (mgr.14388) 11118 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:24.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:24 smithi044 bash[22676]: cluster 2024-09-21T02:31:23.270268+0000 mgr.a (mgr.14388) 11119 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:24 smithi179 bash[23186]: cluster 2024-09-21T02:31:23.270268+0000 mgr.a (mgr.14388) 11119 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:24 smithi049 bash[23528]: cluster 2024-09-21T02:31:23.270268+0000 mgr.a (mgr.14388) 11119 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:24.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:24.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:24.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:24.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:25 smithi044 bash[22676]: audit 2024-09-21T02:31:24.390261+0000 mgr.a (mgr.14388) 11120 : audit [DBG] from='client.244578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:25 smithi179 bash[23186]: audit 2024-09-21T02:31:24.390261+0000 mgr.a (mgr.14388) 11120 : audit [DBG] from='client.244578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:25 smithi049 bash[23528]: audit 2024-09-21T02:31:24.390261+0000 mgr.a (mgr.14388) 11120 : audit [DBG] from='client.244578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:26 smithi044 bash[22676]: cluster 2024-09-21T02:31:25.272994+0000 mgr.a (mgr.14388) 11121 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:26 smithi179 bash[23186]: cluster 2024-09-21T02:31:25.272994+0000 mgr.a (mgr.14388) 11121 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:26 smithi049 bash[23528]: cluster 2024-09-21T02:31:25.272994+0000 mgr.a (mgr.14388) 11121 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:28 smithi044 bash[22676]: cluster 2024-09-21T02:31:27.274015+0000 mgr.a (mgr.14388) 11122 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:28 smithi179 bash[23186]: cluster 2024-09-21T02:31:27.274015+0000 mgr.a (mgr.14388) 11122 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:28 smithi049 bash[23528]: cluster 2024-09-21T02:31:27.274015+0000 mgr.a (mgr.14388) 11122 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:29.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:29.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:29.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:30.587 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:30.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:30 smithi044 bash[22676]: cluster 2024-09-21T02:31:29.274991+0000 mgr.a (mgr.14388) 11123 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:30 smithi179 bash[23186]: cluster 2024-09-21T02:31:29.274991+0000 mgr.a (mgr.14388) 11123 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:30 smithi049 bash[23528]: cluster 2024-09-21T02:31:29.274991+0000 mgr.a (mgr.14388) 11123 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:31 smithi044 bash[22676]: audit 2024-09-21T02:31:30.136831+0000 mgr.a (mgr.14388) 11124 : audit [DBG] from='client.244653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:31 smithi044 bash[22676]: audit 2024-09-21T02:31:30.472891+0000 mon.a (mon.0) 9150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:31 smithi044 bash[22676]: audit 2024-09-21T02:31:30.481291+0000 mon.a (mon.0) 9151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:31 smithi044 bash[22676]: audit 2024-09-21T02:31:30.491828+0000 mon.a (mon.0) 9152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:31 smithi044 bash[22676]: audit 2024-09-21T02:31:30.556686+0000 mon.a (mon.0) 9153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:31 smithi044 bash[22676]: audit 2024-09-21T02:31:30.562219+0000 mon.a (mon.0) 9154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:31 smithi044 bash[22676]: audit 2024-09-21T02:31:30.567627+0000 mon.a (mon.0) 9155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:31 smithi179 bash[23186]: audit 2024-09-21T02:31:30.136831+0000 mgr.a (mgr.14388) 11124 : audit [DBG] from='client.244653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:31 smithi179 bash[23186]: audit 2024-09-21T02:31:30.472891+0000 mon.a (mon.0) 9150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:31 smithi179 bash[23186]: audit 2024-09-21T02:31:30.481291+0000 mon.a (mon.0) 9151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:31 smithi179 bash[23186]: audit 2024-09-21T02:31:30.491828+0000 mon.a (mon.0) 9152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:31 smithi179 bash[23186]: audit 2024-09-21T02:31:30.556686+0000 mon.a (mon.0) 9153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:31 smithi179 bash[23186]: audit 2024-09-21T02:31:30.562219+0000 mon.a (mon.0) 9154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:31 smithi179 bash[23186]: audit 2024-09-21T02:31:30.567627+0000 mon.a (mon.0) 9155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:31 smithi049 bash[23528]: audit 2024-09-21T02:31:30.136831+0000 mgr.a (mgr.14388) 11124 : audit [DBG] from='client.244653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:31 smithi049 bash[23528]: audit 2024-09-21T02:31:30.472891+0000 mon.a (mon.0) 9150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:31 smithi049 bash[23528]: audit 2024-09-21T02:31:30.481291+0000 mon.a (mon.0) 9151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:31 smithi049 bash[23528]: audit 2024-09-21T02:31:30.491828+0000 mon.a (mon.0) 9152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:31 smithi049 bash[23528]: audit 2024-09-21T02:31:30.556686+0000 mon.a (mon.0) 9153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:31 smithi049 bash[23528]: audit 2024-09-21T02:31:30.562219+0000 mon.a (mon.0) 9154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:31 smithi049 bash[23528]: audit 2024-09-21T02:31:30.567627+0000 mon.a (mon.0) 9155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:32 smithi044 bash[22676]: cluster 2024-09-21T02:31:31.277910+0000 mgr.a (mgr.14388) 11125 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:32.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:32 smithi179 bash[23186]: cluster 2024-09-21T02:31:31.277910+0000 mgr.a (mgr.14388) 11125 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:32 smithi049 bash[23528]: cluster 2024-09-21T02:31:31.277910+0000 mgr.a (mgr.14388) 11125 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:34 smithi049 bash[23528]: cluster 2024-09-21T02:31:33.278655+0000 mgr.a (mgr.14388) 11126 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:31:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:34 smithi044 bash[22676]: cluster 2024-09-21T02:31:33.278655+0000 mgr.a (mgr.14388) 11126 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:31:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:34 smithi179 bash[23186]: cluster 2024-09-21T02:31:33.278655+0000 mgr.a (mgr.14388) 11126 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:31:35.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:35.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:35.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:36.343 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:36 smithi049 bash[23528]: cluster 2024-09-21T02:31:35.280552+0000 mgr.a (mgr.14388) 11127 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:36 smithi044 bash[22676]: cluster 2024-09-21T02:31:35.280552+0000 mgr.a (mgr.14388) 11127 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:36 smithi179 bash[23186]: cluster 2024-09-21T02:31:35.280552+0000 mgr.a (mgr.14388) 11127 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:37 smithi044 bash[22676]: audit 2024-09-21T02:31:35.924583+0000 mgr.a (mgr.14388) 11128 : audit [DBG] from='client.244728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:37.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:37 smithi179 bash[23186]: audit 2024-09-21T02:31:35.924583+0000 mgr.a (mgr.14388) 11128 : audit [DBG] from='client.244728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:37 smithi049 bash[23528]: audit 2024-09-21T02:31:35.924583+0000 mgr.a (mgr.14388) 11128 : audit [DBG] from='client.244728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:38 smithi044 bash[22676]: cluster 2024-09-21T02:31:37.281578+0000 mgr.a (mgr.14388) 11129 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:31:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:38 smithi044 bash[22676]: audit 2024-09-21T02:31:38.068625+0000 mon.a (mon.0) 9156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:38 smithi044 bash[22676]: audit 2024-09-21T02:31:38.077741+0000 mon.a (mon.0) 9157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:38 smithi044 bash[22676]: audit 2024-09-21T02:31:38.088144+0000 mon.a (mon.0) 9158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:38 smithi179 bash[23186]: cluster 2024-09-21T02:31:37.281578+0000 mgr.a (mgr.14388) 11129 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:31:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:38 smithi179 bash[23186]: audit 2024-09-21T02:31:38.068625+0000 mon.a (mon.0) 9156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:38 smithi179 bash[23186]: audit 2024-09-21T02:31:38.077741+0000 mon.a (mon.0) 9157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:38 smithi179 bash[23186]: audit 2024-09-21T02:31:38.088144+0000 mon.a (mon.0) 9158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:38 smithi049 bash[23528]: cluster 2024-09-21T02:31:37.281578+0000 mgr.a (mgr.14388) 11129 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:31:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:38 smithi049 bash[23528]: audit 2024-09-21T02:31:38.068625+0000 mon.a (mon.0) 9156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:38 smithi049 bash[23528]: audit 2024-09-21T02:31:38.077741+0000 mon.a (mon.0) 9157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:38 smithi049 bash[23528]: audit 2024-09-21T02:31:38.088144+0000 mon.a (mon.0) 9158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:39 smithi044 bash[22676]: cluster 2024-09-21T02:31:39.282374+0000 mgr.a (mgr.14388) 11130 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:31:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:39 smithi179 bash[23186]: cluster 2024-09-21T02:31:39.282374+0000 mgr.a (mgr.14388) 11130 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:31:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:39 smithi049 bash[23528]: cluster 2024-09-21T02:31:39.282374+0000 mgr.a (mgr.14388) 11130 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:31:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:42.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:42.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:42.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:42.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:42.103 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:42 smithi044 bash[22676]: cluster 2024-09-21T02:31:41.284537+0000 mgr.a (mgr.14388) 11131 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:42 smithi179 bash[23186]: cluster 2024-09-21T02:31:41.284537+0000 mgr.a (mgr.14388) 11131 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:42 smithi049 bash[23528]: cluster 2024-09-21T02:31:41.284537+0000 mgr.a (mgr.14388) 11131 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:43.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:43 smithi044 bash[22676]: audit 2024-09-21T02:31:41.677778+0000 mgr.a (mgr.14388) 11132 : audit [DBG] from='client.244806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:43.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:43 smithi179 bash[23186]: audit 2024-09-21T02:31:41.677778+0000 mgr.a (mgr.14388) 11132 : audit [DBG] from='client.244806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:43 smithi049 bash[23528]: audit 2024-09-21T02:31:41.677778+0000 mgr.a (mgr.14388) 11132 : audit [DBG] from='client.244806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:44.642 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:44 smithi044 bash[22676]: cluster 2024-09-21T02:31:43.285550+0000 mgr.a (mgr.14388) 11133 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:44 smithi179 bash[23186]: cluster 2024-09-21T02:31:43.285550+0000 mgr.a (mgr.14388) 11133 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:44 smithi049 bash[23528]: cluster 2024-09-21T02:31:43.285550+0000 mgr.a (mgr.14388) 11133 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:46 smithi044 bash[22676]: cluster 2024-09-21T02:31:45.287031+0000 mgr.a (mgr.14388) 11134 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:46 smithi179 bash[23186]: cluster 2024-09-21T02:31:45.287031+0000 mgr.a (mgr.14388) 11134 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:46 smithi049 bash[23528]: cluster 2024-09-21T02:31:45.287031+0000 mgr.a (mgr.14388) 11134 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:47.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:47.105 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:47.105 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:47.874 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:48 smithi044 bash[22676]: cluster 2024-09-21T02:31:47.287589+0000 mgr.a (mgr.14388) 11135 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:48 smithi179 bash[23186]: cluster 2024-09-21T02:31:47.287589+0000 mgr.a (mgr.14388) 11135 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:48 smithi049 bash[23528]: cluster 2024-09-21T02:31:47.287589+0000 mgr.a (mgr.14388) 11135 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:49 smithi044 bash[22676]: audit 2024-09-21T02:31:47.440712+0000 mgr.a (mgr.14388) 11136 : audit [DBG] from='client.244884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:49.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:49 smithi179 bash[23186]: audit 2024-09-21T02:31:47.440712+0000 mgr.a (mgr.14388) 11136 : audit [DBG] from='client.244884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:49 smithi049 bash[23528]: audit 2024-09-21T02:31:47.440712+0000 mgr.a (mgr.14388) 11136 : audit [DBG] from='client.244884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:50.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:50 smithi044 bash[22676]: cluster 2024-09-21T02:31:49.288620+0000 mgr.a (mgr.14388) 11137 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:50 smithi179 bash[23186]: cluster 2024-09-21T02:31:49.288620+0000 mgr.a (mgr.14388) 11137 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:50 smithi049 bash[23528]: cluster 2024-09-21T02:31:49.288620+0000 mgr.a (mgr.14388) 11137 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:51 smithi044 bash[22676]: audit 2024-09-21T02:31:50.712134+0000 mon.a (mon.0) 9159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:51 smithi044 bash[22676]: audit 2024-09-21T02:31:50.720593+0000 mon.a (mon.0) 9160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:51 smithi044 bash[22676]: audit 2024-09-21T02:31:50.730880+0000 mon.a (mon.0) 9161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:51 smithi044 bash[22676]: audit 2024-09-21T02:31:50.778124+0000 mon.a (mon.0) 9162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:51 smithi044 bash[22676]: audit 2024-09-21T02:31:50.786976+0000 mon.a (mon.0) 9163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:51 smithi044 bash[22676]: audit 2024-09-21T02:31:50.799982+0000 mon.a (mon.0) 9164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:51 smithi044 bash[22676]: cluster 2024-09-21T02:31:51.290905+0000 mgr.a (mgr.14388) 11138 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:51 smithi179 bash[23186]: audit 2024-09-21T02:31:50.712134+0000 mon.a (mon.0) 9159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:51 smithi179 bash[23186]: audit 2024-09-21T02:31:50.720593+0000 mon.a (mon.0) 9160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:51 smithi179 bash[23186]: audit 2024-09-21T02:31:50.730880+0000 mon.a (mon.0) 9161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:51 smithi179 bash[23186]: audit 2024-09-21T02:31:50.778124+0000 mon.a (mon.0) 9162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:51 smithi179 bash[23186]: audit 2024-09-21T02:31:50.786976+0000 mon.a (mon.0) 9163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:51 smithi179 bash[23186]: audit 2024-09-21T02:31:50.799982+0000 mon.a (mon.0) 9164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:51 smithi179 bash[23186]: cluster 2024-09-21T02:31:51.290905+0000 mgr.a (mgr.14388) 11138 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:51 smithi049 bash[23528]: audit 2024-09-21T02:31:50.712134+0000 mon.a (mon.0) 9159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:51 smithi049 bash[23528]: audit 2024-09-21T02:31:50.720593+0000 mon.a (mon.0) 9160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:51 smithi049 bash[23528]: audit 2024-09-21T02:31:50.730880+0000 mon.a (mon.0) 9161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:51 smithi049 bash[23528]: audit 2024-09-21T02:31:50.778124+0000 mon.a (mon.0) 9162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:51 smithi049 bash[23528]: audit 2024-09-21T02:31:50.786976+0000 mon.a (mon.0) 9163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:51 smithi049 bash[23528]: audit 2024-09-21T02:31:50.799982+0000 mon.a (mon.0) 9164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:51 smithi049 bash[23528]: cluster 2024-09-21T02:31:51.290905+0000 mgr.a (mgr.14388) 11138 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:52.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:53.673 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:53.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:53.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:53.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:53.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:31:54.719 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:54 smithi049 bash[23528]: audit 2024-09-21T02:31:53.212818+0000 mgr.a (mgr.14388) 11139 : audit [DBG] from='client.244962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:54.719 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:54 smithi049 bash[23528]: cluster 2024-09-21T02:31:53.291479+0000 mgr.a (mgr.14388) 11140 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:54 smithi044 bash[22676]: audit 2024-09-21T02:31:53.212818+0000 mgr.a (mgr.14388) 11139 : audit [DBG] from='client.244962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:54 smithi044 bash[22676]: cluster 2024-09-21T02:31:53.291479+0000 mgr.a (mgr.14388) 11140 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:54 smithi179 bash[23186]: audit 2024-09-21T02:31:53.212818+0000 mgr.a (mgr.14388) 11139 : audit [DBG] from='client.244962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:54 smithi179 bash[23186]: cluster 2024-09-21T02:31:53.291479+0000 mgr.a (mgr.14388) 11140 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:56 smithi049 bash[23528]: cluster 2024-09-21T02:31:55.293756+0000 mgr.a (mgr.14388) 11141 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:56 smithi044 bash[22676]: cluster 2024-09-21T02:31:55.293756+0000 mgr.a (mgr.14388) 11141 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:56 smithi179 bash[23186]: cluster 2024-09-21T02:31:55.293756+0000 mgr.a (mgr.14388) 11141 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:31:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:58 smithi049 bash[23528]: cluster 2024-09-21T02:31:57.294540+0000 mgr.a (mgr.14388) 11142 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:58 smithi049 bash[23528]: audit 2024-09-21T02:31:58.261571+0000 mon.a (mon.0) 9165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:58 smithi049 bash[23528]: audit 2024-09-21T02:31:58.270154+0000 mon.a (mon.0) 9166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:31:58 smithi049 bash[23528]: audit 2024-09-21T02:31:58.280574+0000 mon.a (mon.0) 9167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:31:58.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:31:58.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:31:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:58 smithi044 bash[22676]: cluster 2024-09-21T02:31:57.294540+0000 mgr.a (mgr.14388) 11142 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:58 smithi044 bash[22676]: audit 2024-09-21T02:31:58.261571+0000 mon.a (mon.0) 9165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:58 smithi044 bash[22676]: audit 2024-09-21T02:31:58.270154+0000 mon.a (mon.0) 9166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:31:58 smithi044 bash[22676]: audit 2024-09-21T02:31:58.280574+0000 mon.a (mon.0) 9167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:58 smithi179 bash[23186]: cluster 2024-09-21T02:31:57.294540+0000 mgr.a (mgr.14388) 11142 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:31:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:58 smithi179 bash[23186]: audit 2024-09-21T02:31:58.261571+0000 mon.a (mon.0) 9165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:58 smithi179 bash[23186]: audit 2024-09-21T02:31:58.270154+0000 mon.a (mon.0) 9166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:31:58 smithi179 bash[23186]: audit 2024-09-21T02:31:58.280574+0000 mon.a (mon.0) 9167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:31:59.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:31:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:31:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:31:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:31:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:00.617 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:00 smithi179 bash[23186]: audit 2024-09-21T02:31:59.017798+0000 mgr.a (mgr.14388) 11143 : audit [DBG] from='client.245040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:00.617 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:00 smithi179 bash[23186]: cluster 2024-09-21T02:31:59.295103+0000 mgr.a (mgr.14388) 11144 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:00 smithi044 bash[22676]: audit 2024-09-21T02:31:59.017798+0000 mgr.a (mgr.14388) 11143 : audit [DBG] from='client.245040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:00 smithi044 bash[22676]: cluster 2024-09-21T02:31:59.295103+0000 mgr.a (mgr.14388) 11144 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:00 smithi049 bash[23528]: audit 2024-09-21T02:31:59.017798+0000 mgr.a (mgr.14388) 11143 : audit [DBG] from='client.245040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:00 smithi049 bash[23528]: cluster 2024-09-21T02:31:59.295103+0000 mgr.a (mgr.14388) 11144 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:01 smithi044 bash[22676]: audit 2024-09-21T02:32:01.345272+0000 mon.a (mon.0) 9168 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:32:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:01 smithi044 bash[22676]: audit 2024-09-21T02:32:01.352808+0000 mon.a (mon.0) 9169 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:32:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:01 smithi044 bash[22676]: audit 2024-09-21T02:32:01.354573+0000 mon.a (mon.0) 9170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:32:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:01 smithi179 bash[23186]: audit 2024-09-21T02:32:01.345272+0000 mon.a (mon.0) 9168 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:32:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:01 smithi179 bash[23186]: audit 2024-09-21T02:32:01.352808+0000 mon.a (mon.0) 9169 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:32:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:01 smithi179 bash[23186]: audit 2024-09-21T02:32:01.354573+0000 mon.a (mon.0) 9170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:32:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:01 smithi049 bash[23528]: audit 2024-09-21T02:32:01.345272+0000 mon.a (mon.0) 9168 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:32:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:01 smithi049 bash[23528]: audit 2024-09-21T02:32:01.352808+0000 mon.a (mon.0) 9169 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:32:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:01 smithi049 bash[23528]: audit 2024-09-21T02:32:01.354573+0000 mon.a (mon.0) 9170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:32:02.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:32:02 smithi044 bash[22930]: debug 2024-09-21T02:32:02.151+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:32:02.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:32:02 smithi044 bash[22930]: debug 2024-09-21T02:32:02.151+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:32:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:02 smithi044 bash[22676]: cluster 2024-09-21T02:32:01.297446+0000 mgr.a (mgr.14388) 11145 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:02 smithi044 bash[22676]: audit 2024-09-21T02:32:01.372003+0000 mon.a (mon.0) 9171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:02 smithi044 bash[22676]: audit 2024-09-21T02:32:01.378512+0000 mon.a (mon.0) 9172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:32:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:02 smithi044 bash[22676]: audit 2024-09-21T02:32:01.381009+0000 mgr.a (mgr.14388) 11146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:32:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:02 smithi179 bash[23186]: cluster 2024-09-21T02:32:01.297446+0000 mgr.a (mgr.14388) 11145 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:02 smithi179 bash[23186]: audit 2024-09-21T02:32:01.372003+0000 mon.a (mon.0) 9171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:02 smithi179 bash[23186]: audit 2024-09-21T02:32:01.378512+0000 mon.a (mon.0) 9172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:32:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:02 smithi179 bash[23186]: audit 2024-09-21T02:32:01.381009+0000 mgr.a (mgr.14388) 11146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:32:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:02 smithi049 bash[23528]: cluster 2024-09-21T02:32:01.297446+0000 mgr.a (mgr.14388) 11145 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:02 smithi049 bash[23528]: audit 2024-09-21T02:32:01.372003+0000 mon.a (mon.0) 9171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:02 smithi049 bash[23528]: audit 2024-09-21T02:32:01.378512+0000 mon.a (mon.0) 9172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:32:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:02 smithi049 bash[23528]: audit 2024-09-21T02:32:01.381009+0000 mgr.a (mgr.14388) 11146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:32:03.609 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:03 smithi044 bash[22676]: audit 2024-09-21T02:32:02.154185+0000 mgr.a (mgr.14388) 11147 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:32:03.609 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:03 smithi044 bash[22676]: cephadm 2024-09-21T02:32:02.155288+0000 mgr.a (mgr.14388) 11148 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:32:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:03 smithi179 bash[23186]: audit 2024-09-21T02:32:02.154185+0000 mgr.a (mgr.14388) 11147 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:32:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:03 smithi179 bash[23186]: cephadm 2024-09-21T02:32:02.155288+0000 mgr.a (mgr.14388) 11148 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:32:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:03 smithi049 bash[23528]: audit 2024-09-21T02:32:02.154185+0000 mgr.a (mgr.14388) 11147 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:32:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:03 smithi049 bash[23528]: cephadm 2024-09-21T02:32:02.155288+0000 mgr.a (mgr.14388) 11148 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:32:04.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:04.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:04.452 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:04.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:04 smithi044 bash[22676]: cluster 2024-09-21T02:32:03.298356+0000 mgr.a (mgr.14388) 11149 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:04 smithi179 bash[23186]: cluster 2024-09-21T02:32:03.298356+0000 mgr.a (mgr.14388) 11149 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:04 smithi049 bash[23528]: cluster 2024-09-21T02:32:03.298356+0000 mgr.a (mgr.14388) 11149 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:05.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:06 smithi044 bash[22676]: audit 2024-09-21T02:32:04.787643+0000 mgr.a (mgr.14388) 11150 : audit [DBG] from='client.245223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:06 smithi044 bash[22676]: cluster 2024-09-21T02:32:05.299769+0000 mgr.a (mgr.14388) 11151 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:06 smithi179 bash[23186]: audit 2024-09-21T02:32:04.787643+0000 mgr.a (mgr.14388) 11150 : audit [DBG] from='client.245223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:06 smithi179 bash[23186]: cluster 2024-09-21T02:32:05.299769+0000 mgr.a (mgr.14388) 11151 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:06 smithi049 bash[23528]: audit 2024-09-21T02:32:04.787643+0000 mgr.a (mgr.14388) 11150 : audit [DBG] from='client.245223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:06 smithi049 bash[23528]: cluster 2024-09-21T02:32:05.299769+0000 mgr.a (mgr.14388) 11151 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:08 smithi044 bash[22676]: cluster 2024-09-21T02:32:07.300568+0000 mgr.a (mgr.14388) 11152 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:08 smithi179 bash[23186]: cluster 2024-09-21T02:32:07.300568+0000 mgr.a (mgr.14388) 11152 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:08 smithi049 bash[23528]: cluster 2024-09-21T02:32:07.300568+0000 mgr.a (mgr.14388) 11152 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:10.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:10.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:10 smithi044 bash[22676]: cluster 2024-09-21T02:32:09.301386+0000 mgr.a (mgr.14388) 11153 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:10 smithi179 bash[23186]: cluster 2024-09-21T02:32:09.301386+0000 mgr.a (mgr.14388) 11153 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:10 smithi049 bash[23528]: cluster 2024-09-21T02:32:09.301386+0000 mgr.a (mgr.14388) 11153 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:11.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:11.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:11.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:11.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:11.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: audit 2024-09-21T02:32:10.575694+0000 mgr.a (mgr.14388) 11154 : audit [DBG] from='client.245298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: audit 2024-09-21T02:32:10.859470+0000 mon.a (mon.0) 9173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: audit 2024-09-21T02:32:10.866869+0000 mon.a (mon.0) 9174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: audit 2024-09-21T02:32:10.872407+0000 mon.a (mon.0) 9175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: audit 2024-09-21T02:32:10.971866+0000 mon.a (mon.0) 9176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: audit 2024-09-21T02:32:10.977640+0000 mon.a (mon.0) 9177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: audit 2024-09-21T02:32:10.982867+0000 mon.a (mon.0) 9178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:11 smithi044 bash[22676]: cluster 2024-09-21T02:32:11.304093+0000 mgr.a (mgr.14388) 11155 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: audit 2024-09-21T02:32:10.575694+0000 mgr.a (mgr.14388) 11154 : audit [DBG] from='client.245298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: audit 2024-09-21T02:32:10.859470+0000 mon.a (mon.0) 9173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: audit 2024-09-21T02:32:10.866869+0000 mon.a (mon.0) 9174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: audit 2024-09-21T02:32:10.872407+0000 mon.a (mon.0) 9175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: audit 2024-09-21T02:32:10.971866+0000 mon.a (mon.0) 9176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: audit 2024-09-21T02:32:10.977640+0000 mon.a (mon.0) 9177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: audit 2024-09-21T02:32:10.982867+0000 mon.a (mon.0) 9178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:11 smithi179 bash[23186]: cluster 2024-09-21T02:32:11.304093+0000 mgr.a (mgr.14388) 11155 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: audit 2024-09-21T02:32:10.575694+0000 mgr.a (mgr.14388) 11154 : audit [DBG] from='client.245298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: audit 2024-09-21T02:32:10.859470+0000 mon.a (mon.0) 9173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: audit 2024-09-21T02:32:10.866869+0000 mon.a (mon.0) 9174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: audit 2024-09-21T02:32:10.872407+0000 mon.a (mon.0) 9175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: audit 2024-09-21T02:32:10.971866+0000 mon.a (mon.0) 9176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: audit 2024-09-21T02:32:10.977640+0000 mon.a (mon.0) 9177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: audit 2024-09-21T02:32:10.982867+0000 mon.a (mon.0) 9178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:11 smithi049 bash[23528]: cluster 2024-09-21T02:32:11.304093+0000 mgr.a (mgr.14388) 11155 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:14 smithi044 bash[22676]: cluster 2024-09-21T02:32:13.304889+0000 mgr.a (mgr.14388) 11156 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:14 smithi179 bash[23186]: cluster 2024-09-21T02:32:13.304889+0000 mgr.a (mgr.14388) 11156 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:14 smithi049 bash[23528]: cluster 2024-09-21T02:32:13.304889+0000 mgr.a (mgr.14388) 11156 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:32:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:16.020 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:16.020 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:16 smithi044 bash[22676]: cluster 2024-09-21T02:32:15.306865+0000 mgr.a (mgr.14388) 11157 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:16 smithi179 bash[23186]: cluster 2024-09-21T02:32:15.306865+0000 mgr.a (mgr.14388) 11157 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:16.761 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:16.791 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:16 smithi049 bash[23528]: cluster 2024-09-21T02:32:15.306865+0000 mgr.a (mgr.14388) 11157 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:32:17.662 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:17 smithi049 bash[23528]: audit 2024-09-21T02:32:16.351386+0000 mgr.a (mgr.14388) 11158 : audit [DBG] from='client.245376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:17 smithi044 bash[22676]: audit 2024-09-21T02:32:16.351386+0000 mgr.a (mgr.14388) 11158 : audit [DBG] from='client.245376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:17 smithi179 bash[23186]: audit 2024-09-21T02:32:16.351386+0000 mgr.a (mgr.14388) 11158 : audit [DBG] from='client.245376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:18 smithi044 bash[22676]: cluster 2024-09-21T02:32:17.307884+0000 mgr.a (mgr.14388) 11159 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:18 smithi179 bash[23186]: cluster 2024-09-21T02:32:17.307884+0000 mgr.a (mgr.14388) 11159 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:18 smithi049 bash[23528]: cluster 2024-09-21T02:32:17.307884+0000 mgr.a (mgr.14388) 11159 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:19 smithi044 bash[22676]: audit 2024-09-21T02:32:18.479308+0000 mon.a (mon.0) 9179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:19 smithi044 bash[22676]: audit 2024-09-21T02:32:18.487949+0000 mon.a (mon.0) 9180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:19 smithi044 bash[22676]: audit 2024-09-21T02:32:18.498293+0000 mon.a (mon.0) 9181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:19 smithi044 bash[22676]: cluster 2024-09-21T02:32:19.308692+0000 mgr.a (mgr.14388) 11160 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:19 smithi179 bash[23186]: audit 2024-09-21T02:32:18.479308+0000 mon.a (mon.0) 9179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:19 smithi179 bash[23186]: audit 2024-09-21T02:32:18.487949+0000 mon.a (mon.0) 9180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:19 smithi179 bash[23186]: audit 2024-09-21T02:32:18.498293+0000 mon.a (mon.0) 9181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:19 smithi179 bash[23186]: cluster 2024-09-21T02:32:19.308692+0000 mgr.a (mgr.14388) 11160 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:19 smithi049 bash[23528]: audit 2024-09-21T02:32:18.479308+0000 mon.a (mon.0) 9179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:19 smithi049 bash[23528]: audit 2024-09-21T02:32:18.487949+0000 mon.a (mon.0) 9180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:19 smithi049 bash[23528]: audit 2024-09-21T02:32:18.498293+0000 mon.a (mon.0) 9181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:19 smithi049 bash[23528]: cluster 2024-09-21T02:32:19.308692+0000 mgr.a (mgr.14388) 11160 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:21.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:22.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:22.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:22.529 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:22.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:22 smithi044 bash[22676]: cluster 2024-09-21T02:32:21.310911+0000 mgr.a (mgr.14388) 11161 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:22.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:22 smithi179 bash[23186]: cluster 2024-09-21T02:32:21.310911+0000 mgr.a (mgr.14388) 11161 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:22 smithi049 bash[23528]: cluster 2024-09-21T02:32:21.310911+0000 mgr.a (mgr.14388) 11161 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:23.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:23 smithi044 bash[22676]: audit 2024-09-21T02:32:22.094691+0000 mgr.a (mgr.14388) 11162 : audit [DBG] from='client.245454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:23 smithi179 bash[23186]: audit 2024-09-21T02:32:22.094691+0000 mgr.a (mgr.14388) 11162 : audit [DBG] from='client.245454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:23 smithi049 bash[23528]: audit 2024-09-21T02:32:22.094691+0000 mgr.a (mgr.14388) 11162 : audit [DBG] from='client.245454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:24 smithi179 bash[23186]: cluster 2024-09-21T02:32:23.311913+0000 mgr.a (mgr.14388) 11163 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:24.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:24 smithi044 bash[22676]: cluster 2024-09-21T02:32:23.311913+0000 mgr.a (mgr.14388) 11163 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:24 smithi049 bash[23528]: cluster 2024-09-21T02:32:23.311913+0000 mgr.a (mgr.14388) 11163 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:26 smithi044 bash[22676]: cluster 2024-09-21T02:32:25.314225+0000 mgr.a (mgr.14388) 11164 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:26 smithi179 bash[23186]: cluster 2024-09-21T02:32:25.314225+0000 mgr.a (mgr.14388) 11164 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:26 smithi049 bash[23528]: cluster 2024-09-21T02:32:25.314225+0000 mgr.a (mgr.14388) 11164 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:27.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:27.531 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:27.531 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:28.294 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:28 smithi044 bash[22676]: cluster 2024-09-21T02:32:27.315060+0000 mgr.a (mgr.14388) 11165 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:28 smithi179 bash[23186]: cluster 2024-09-21T02:32:27.315060+0000 mgr.a (mgr.14388) 11165 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:28 smithi049 bash[23528]: cluster 2024-09-21T02:32:27.315060+0000 mgr.a (mgr.14388) 11165 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:29.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:29 smithi044 bash[22676]: audit 2024-09-21T02:32:27.869870+0000 mgr.a (mgr.14388) 11166 : audit [DBG] from='client.111274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:29.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:29 smithi179 bash[23186]: audit 2024-09-21T02:32:27.869870+0000 mgr.a (mgr.14388) 11166 : audit [DBG] from='client.111274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:29 smithi049 bash[23528]: audit 2024-09-21T02:32:27.869870+0000 mgr.a (mgr.14388) 11166 : audit [DBG] from='client.111274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:30 smithi044 bash[22676]: cluster 2024-09-21T02:32:29.316049+0000 mgr.a (mgr.14388) 11167 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:30 smithi179 bash[23186]: cluster 2024-09-21T02:32:29.316049+0000 mgr.a (mgr.14388) 11167 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:30 smithi049 bash[23528]: cluster 2024-09-21T02:32:29.316049+0000 mgr.a (mgr.14388) 11167 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:32 smithi044 bash[22676]: audit 2024-09-21T02:32:31.092599+0000 mon.a (mon.0) 9182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:32 smithi044 bash[22676]: audit 2024-09-21T02:32:31.101294+0000 mon.a (mon.0) 9183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:32 smithi044 bash[22676]: audit 2024-09-21T02:32:31.111877+0000 mon.a (mon.0) 9184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:32 smithi044 bash[22676]: audit 2024-09-21T02:32:31.191324+0000 mon.a (mon.0) 9185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:32 smithi044 bash[22676]: audit 2024-09-21T02:32:31.200303+0000 mon.a (mon.0) 9186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:32 smithi044 bash[22676]: audit 2024-09-21T02:32:31.210820+0000 mon.a (mon.0) 9187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:32 smithi044 bash[22676]: cluster 2024-09-21T02:32:31.318285+0000 mgr.a (mgr.14388) 11168 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:32 smithi179 bash[23186]: audit 2024-09-21T02:32:31.092599+0000 mon.a (mon.0) 9182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:32 smithi179 bash[23186]: audit 2024-09-21T02:32:31.101294+0000 mon.a (mon.0) 9183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:32 smithi179 bash[23186]: audit 2024-09-21T02:32:31.111877+0000 mon.a (mon.0) 9184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:32 smithi179 bash[23186]: audit 2024-09-21T02:32:31.191324+0000 mon.a (mon.0) 9185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:32 smithi179 bash[23186]: audit 2024-09-21T02:32:31.200303+0000 mon.a (mon.0) 9186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:32 smithi179 bash[23186]: audit 2024-09-21T02:32:31.210820+0000 mon.a (mon.0) 9187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:32 smithi179 bash[23186]: cluster 2024-09-21T02:32:31.318285+0000 mgr.a (mgr.14388) 11168 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:32 smithi049 bash[23528]: audit 2024-09-21T02:32:31.092599+0000 mon.a (mon.0) 9182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:32 smithi049 bash[23528]: audit 2024-09-21T02:32:31.101294+0000 mon.a (mon.0) 9183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:32 smithi049 bash[23528]: audit 2024-09-21T02:32:31.111877+0000 mon.a (mon.0) 9184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:32 smithi049 bash[23528]: audit 2024-09-21T02:32:31.191324+0000 mon.a (mon.0) 9185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:32 smithi049 bash[23528]: audit 2024-09-21T02:32:31.200303+0000 mon.a (mon.0) 9186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:32 smithi049 bash[23528]: audit 2024-09-21T02:32:31.210820+0000 mon.a (mon.0) 9187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:32.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:32 smithi049 bash[23528]: cluster 2024-09-21T02:32:31.318285+0000 mgr.a (mgr.14388) 11168 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:34.066 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:34.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:34 smithi049 bash[23528]: cluster 2024-09-21T02:32:33.318861+0000 mgr.a (mgr.14388) 11169 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:34 smithi044 bash[22676]: cluster 2024-09-21T02:32:33.318861+0000 mgr.a (mgr.14388) 11169 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:34 smithi179 bash[23186]: cluster 2024-09-21T02:32:33.318861+0000 mgr.a (mgr.14388) 11169 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:35.467 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:35 smithi049 bash[23528]: audit 2024-09-21T02:32:33.630749+0000 mgr.a (mgr.14388) 11170 : audit [DBG] from='client.245601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:35 smithi044 bash[22676]: audit 2024-09-21T02:32:33.630749+0000 mgr.a (mgr.14388) 11170 : audit [DBG] from='client.245601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:35.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:35 smithi179 bash[23186]: audit 2024-09-21T02:32:33.630749+0000 mgr.a (mgr.14388) 11170 : audit [DBG] from='client.245601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:36 smithi044 bash[22676]: cluster 2024-09-21T02:32:35.321114+0000 mgr.a (mgr.14388) 11171 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:36 smithi179 bash[23186]: cluster 2024-09-21T02:32:35.321114+0000 mgr.a (mgr.14388) 11171 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:36 smithi049 bash[23528]: cluster 2024-09-21T02:32:35.321114+0000 mgr.a (mgr.14388) 11171 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:38.690 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:38 smithi049 bash[23528]: cluster 2024-09-21T02:32:37.321895+0000 mgr.a (mgr.14388) 11172 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:38 smithi044 bash[22676]: cluster 2024-09-21T02:32:37.321895+0000 mgr.a (mgr.14388) 11172 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:38 smithi179 bash[23186]: cluster 2024-09-21T02:32:37.321895+0000 mgr.a (mgr.14388) 11172 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:39.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:39.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:39.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:39.861 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:39 smithi044 bash[22676]: audit 2024-09-21T02:32:38.668308+0000 mon.a (mon.0) 9188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:39 smithi044 bash[22676]: audit 2024-09-21T02:32:38.677435+0000 mon.a (mon.0) 9189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:39 smithi044 bash[22676]: audit 2024-09-21T02:32:38.688420+0000 mon.a (mon.0) 9190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:39 smithi044 bash[22676]: cluster 2024-09-21T02:32:39.322650+0000 mgr.a (mgr.14388) 11173 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:39 smithi044 bash[22676]: audit 2024-09-21T02:32:39.406380+0000 mgr.a (mgr.14388) 11174 : audit [DBG] from='client.245676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:39 smithi179 bash[23186]: audit 2024-09-21T02:32:38.668308+0000 mon.a (mon.0) 9188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:39 smithi179 bash[23186]: audit 2024-09-21T02:32:38.677435+0000 mon.a (mon.0) 9189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:39 smithi179 bash[23186]: audit 2024-09-21T02:32:38.688420+0000 mon.a (mon.0) 9190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:39 smithi179 bash[23186]: cluster 2024-09-21T02:32:39.322650+0000 mgr.a (mgr.14388) 11173 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:39 smithi179 bash[23186]: audit 2024-09-21T02:32:39.406380+0000 mgr.a (mgr.14388) 11174 : audit [DBG] from='client.245676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:39 smithi049 bash[23528]: audit 2024-09-21T02:32:38.668308+0000 mon.a (mon.0) 9188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:39 smithi049 bash[23528]: audit 2024-09-21T02:32:38.677435+0000 mon.a (mon.0) 9189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:39 smithi049 bash[23528]: audit 2024-09-21T02:32:38.688420+0000 mon.a (mon.0) 9190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:39 smithi049 bash[23528]: cluster 2024-09-21T02:32:39.322650+0000 mgr.a (mgr.14388) 11173 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:39 smithi049 bash[23528]: audit 2024-09-21T02:32:39.406380+0000 mgr.a (mgr.14388) 11174 : audit [DBG] from='client.245676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:42.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:42 smithi044 bash[22676]: cluster 2024-09-21T02:32:41.325019+0000 mgr.a (mgr.14388) 11175 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:42.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:42 smithi179 bash[23186]: cluster 2024-09-21T02:32:41.325019+0000 mgr.a (mgr.14388) 11175 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:42 smithi049 bash[23528]: cluster 2024-09-21T02:32:41.325019+0000 mgr.a (mgr.14388) 11175 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:32:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:44 smithi044 bash[22676]: cluster 2024-09-21T02:32:43.325837+0000 mgr.a (mgr.14388) 11176 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:44 smithi179 bash[23186]: cluster 2024-09-21T02:32:43.325837+0000 mgr.a (mgr.14388) 11176 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:44 smithi049 bash[23528]: cluster 2024-09-21T02:32:43.325837+0000 mgr.a (mgr.14388) 11176 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:44.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:44.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:44.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:45.654 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:46 smithi044 bash[22676]: audit 2024-09-21T02:32:45.202198+0000 mgr.a (mgr.14388) 11177 : audit [DBG] from='client.245754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:46 smithi044 bash[22676]: cluster 2024-09-21T02:32:45.327187+0000 mgr.a (mgr.14388) 11178 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:46 smithi179 bash[23186]: audit 2024-09-21T02:32:45.202198+0000 mgr.a (mgr.14388) 11177 : audit [DBG] from='client.245754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:46 smithi179 bash[23186]: cluster 2024-09-21T02:32:45.327187+0000 mgr.a (mgr.14388) 11178 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:46 smithi049 bash[23528]: audit 2024-09-21T02:32:45.202198+0000 mgr.a (mgr.14388) 11177 : audit [DBG] from='client.245754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:46 smithi049 bash[23528]: cluster 2024-09-21T02:32:45.327187+0000 mgr.a (mgr.14388) 11178 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:48 smithi044 bash[22676]: cluster 2024-09-21T02:32:47.328087+0000 mgr.a (mgr.14388) 11179 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:48 smithi179 bash[23186]: cluster 2024-09-21T02:32:47.328087+0000 mgr.a (mgr.14388) 11179 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:48 smithi049 bash[23528]: cluster 2024-09-21T02:32:47.328087+0000 mgr.a (mgr.14388) 11179 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:50.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:50 smithi044 bash[22676]: cluster 2024-09-21T02:32:49.328898+0000 mgr.a (mgr.14388) 11180 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:50 smithi179 bash[23186]: cluster 2024-09-21T02:32:49.328898+0000 mgr.a (mgr.14388) 11180 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:50 smithi049 bash[23528]: cluster 2024-09-21T02:32:49.328898+0000 mgr.a (mgr.14388) 11180 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:51.464 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:51.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:51.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:51.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:51.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: audit 2024-09-21T02:32:50.997868+0000 mgr.a (mgr.14388) 11181 : audit [DBG] from='client.245832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: audit 2024-09-21T02:32:51.256894+0000 mon.a (mon.0) 9191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: audit 2024-09-21T02:32:51.262345+0000 mon.a (mon.0) 9192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: audit 2024-09-21T02:32:51.268763+0000 mon.a (mon.0) 9193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: cluster 2024-09-21T02:32:51.330219+0000 mgr.a (mgr.14388) 11182 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: audit 2024-09-21T02:32:51.404018+0000 mon.a (mon.0) 9194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: audit 2024-09-21T02:32:51.411432+0000 mon.a (mon.0) 9195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:52 smithi049 bash[23528]: audit 2024-09-21T02:32:51.418526+0000 mon.a (mon.0) 9196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: audit 2024-09-21T02:32:50.997868+0000 mgr.a (mgr.14388) 11181 : audit [DBG] from='client.245832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: audit 2024-09-21T02:32:51.256894+0000 mon.a (mon.0) 9191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: audit 2024-09-21T02:32:51.262345+0000 mon.a (mon.0) 9192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: audit 2024-09-21T02:32:51.268763+0000 mon.a (mon.0) 9193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: cluster 2024-09-21T02:32:51.330219+0000 mgr.a (mgr.14388) 11182 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: audit 2024-09-21T02:32:51.404018+0000 mon.a (mon.0) 9194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: audit 2024-09-21T02:32:51.411432+0000 mon.a (mon.0) 9195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:52 smithi044 bash[22676]: audit 2024-09-21T02:32:51.418526+0000 mon.a (mon.0) 9196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: audit 2024-09-21T02:32:50.997868+0000 mgr.a (mgr.14388) 11181 : audit [DBG] from='client.245832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: audit 2024-09-21T02:32:51.256894+0000 mon.a (mon.0) 9191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: audit 2024-09-21T02:32:51.262345+0000 mon.a (mon.0) 9192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: audit 2024-09-21T02:32:51.268763+0000 mon.a (mon.0) 9193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: cluster 2024-09-21T02:32:51.330219+0000 mgr.a (mgr.14388) 11182 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: audit 2024-09-21T02:32:51.404018+0000 mon.a (mon.0) 9194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: audit 2024-09-21T02:32:51.411432+0000 mon.a (mon.0) 9195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:52 smithi179 bash[23186]: audit 2024-09-21T02:32:51.418526+0000 mon.a (mon.0) 9196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:32:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:54 smithi044 bash[22676]: cluster 2024-09-21T02:32:53.331101+0000 mgr.a (mgr.14388) 11183 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:54 smithi179 bash[23186]: cluster 2024-09-21T02:32:53.331101+0000 mgr.a (mgr.14388) 11183 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:54 smithi049 bash[23528]: cluster 2024-09-21T02:32:53.331101+0000 mgr.a (mgr.14388) 11183 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:32:56.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:32:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:32:56.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:32:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:56 smithi044 bash[22676]: cluster 2024-09-21T02:32:55.333286+0000 mgr.a (mgr.14388) 11184 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:56 smithi179 bash[23186]: cluster 2024-09-21T02:32:55.333286+0000 mgr.a (mgr.14388) 11184 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:56 smithi049 bash[23528]: cluster 2024-09-21T02:32:55.333286+0000 mgr.a (mgr.14388) 11184 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:57.223 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:32:57.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:32:57.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:32:57.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:32:57.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:32:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:58 smithi044 bash[22676]: audit 2024-09-21T02:32:56.799404+0000 mgr.a (mgr.14388) 11185 : audit [DBG] from='client.245910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:58 smithi044 bash[22676]: cluster 2024-09-21T02:32:57.333868+0000 mgr.a (mgr.14388) 11186 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:58 smithi179 bash[23186]: audit 2024-09-21T02:32:56.799404+0000 mgr.a (mgr.14388) 11185 : audit [DBG] from='client.245910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:58 smithi179 bash[23186]: cluster 2024-09-21T02:32:57.333868+0000 mgr.a (mgr.14388) 11186 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:32:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:58 smithi049 bash[23528]: audit 2024-09-21T02:32:56.799404+0000 mgr.a (mgr.14388) 11185 : audit [DBG] from='client.245910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:58 smithi049 bash[23528]: cluster 2024-09-21T02:32:57.333868+0000 mgr.a (mgr.14388) 11186 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:59 smithi044 bash[22676]: audit 2024-09-21T02:32:58.886169+0000 mon.a (mon.0) 9197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:59 smithi044 bash[22676]: audit 2024-09-21T02:32:58.894743+0000 mon.a (mon.0) 9198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:59 smithi044 bash[22676]: audit 2024-09-21T02:32:58.904980+0000 mon.a (mon.0) 9199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:32:59 smithi044 bash[22676]: cluster 2024-09-21T02:32:59.334616+0000 mgr.a (mgr.14388) 11187 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:59 smithi179 bash[23186]: audit 2024-09-21T02:32:58.886169+0000 mon.a (mon.0) 9197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:59 smithi179 bash[23186]: audit 2024-09-21T02:32:58.894743+0000 mon.a (mon.0) 9198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:59 smithi179 bash[23186]: audit 2024-09-21T02:32:58.904980+0000 mon.a (mon.0) 9199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:32:59 smithi179 bash[23186]: cluster 2024-09-21T02:32:59.334616+0000 mgr.a (mgr.14388) 11187 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:59 smithi049 bash[23528]: audit 2024-09-21T02:32:58.886169+0000 mon.a (mon.0) 9197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:59 smithi049 bash[23528]: audit 2024-09-21T02:32:58.894743+0000 mon.a (mon.0) 9198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:59 smithi049 bash[23528]: audit 2024-09-21T02:32:58.904980+0000 mon.a (mon.0) 9199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:32:59 smithi049 bash[23528]: cluster 2024-09-21T02:32:59.334616+0000 mgr.a (mgr.14388) 11187 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:02.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:02.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:02.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:02 smithi044 bash[22676]: cluster 2024-09-21T02:33:01.336827+0000 mgr.a (mgr.14388) 11188 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:02 smithi044 bash[22676]: audit 2024-09-21T02:33:02.206760+0000 mon.a (mon.0) 9200 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:33:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:02 smithi044 bash[22676]: audit 2024-09-21T02:33:02.213485+0000 mon.a (mon.0) 9201 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:33:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:02 smithi044 bash[22676]: audit 2024-09-21T02:33:02.215432+0000 mon.a (mon.0) 9202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:33:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:02 smithi044 bash[22676]: audit 2024-09-21T02:33:02.226349+0000 mon.a (mon.0) 9203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:02 smithi044 bash[22676]: audit 2024-09-21T02:33:02.230778+0000 mon.a (mon.0) 9204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:33:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:02 smithi179 bash[23186]: cluster 2024-09-21T02:33:01.336827+0000 mgr.a (mgr.14388) 11188 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:02 smithi179 bash[23186]: audit 2024-09-21T02:33:02.206760+0000 mon.a (mon.0) 9200 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:33:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:02 smithi179 bash[23186]: audit 2024-09-21T02:33:02.213485+0000 mon.a (mon.0) 9201 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:33:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:02 smithi179 bash[23186]: audit 2024-09-21T02:33:02.215432+0000 mon.a (mon.0) 9202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:33:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:02 smithi179 bash[23186]: audit 2024-09-21T02:33:02.226349+0000 mon.a (mon.0) 9203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:02 smithi179 bash[23186]: audit 2024-09-21T02:33:02.230778+0000 mon.a (mon.0) 9204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:33:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:02 smithi049 bash[23528]: cluster 2024-09-21T02:33:01.336827+0000 mgr.a (mgr.14388) 11188 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:02 smithi049 bash[23528]: audit 2024-09-21T02:33:02.206760+0000 mon.a (mon.0) 9200 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:33:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:02 smithi049 bash[23528]: audit 2024-09-21T02:33:02.213485+0000 mon.a (mon.0) 9201 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:33:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:02 smithi049 bash[23528]: audit 2024-09-21T02:33:02.215432+0000 mon.a (mon.0) 9202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:33:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:02 smithi049 bash[23528]: audit 2024-09-21T02:33:02.226349+0000 mon.a (mon.0) 9203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:02 smithi049 bash[23528]: audit 2024-09-21T02:33:02.230778+0000 mon.a (mon.0) 9204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:33:03.399 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:33:03 smithi044 bash[22930]: debug 2024-09-21T02:33:03.007+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:33:03.399 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:33:03 smithi044 bash[22930]: debug 2024-09-21T02:33:03.019+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:33:03.421 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:03.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:03 smithi044 bash[22676]: audit 2024-09-21T02:33:02.232127+0000 mgr.a (mgr.14388) 11189 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:33:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:03 smithi179 bash[23186]: audit 2024-09-21T02:33:02.232127+0000 mgr.a (mgr.14388) 11189 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:33:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:03 smithi049 bash[23528]: audit 2024-09-21T02:33:02.232127+0000 mgr.a (mgr.14388) 11189 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:33:04.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:04 smithi044 bash[22676]: audit 2024-09-21T02:33:02.608914+0000 mgr.a (mgr.14388) 11190 : audit [DBG] from='client.246000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:04.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:04 smithi044 bash[22676]: audit 2024-09-21T02:33:03.012296+0000 mgr.a (mgr.14388) 11191 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:33:04.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:04 smithi044 bash[22676]: cephadm 2024-09-21T02:33:03.024683+0000 mgr.a (mgr.14388) 11192 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:33:04.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:04 smithi044 bash[22676]: cluster 2024-09-21T02:33:03.337377+0000 mgr.a (mgr.14388) 11193 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:04 smithi179 bash[23186]: audit 2024-09-21T02:33:02.608914+0000 mgr.a (mgr.14388) 11190 : audit [DBG] from='client.246000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:04 smithi179 bash[23186]: audit 2024-09-21T02:33:03.012296+0000 mgr.a (mgr.14388) 11191 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:33:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:04 smithi179 bash[23186]: cephadm 2024-09-21T02:33:03.024683+0000 mgr.a (mgr.14388) 11192 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:33:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:04 smithi179 bash[23186]: cluster 2024-09-21T02:33:03.337377+0000 mgr.a (mgr.14388) 11193 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:04 smithi049 bash[23528]: audit 2024-09-21T02:33:02.608914+0000 mgr.a (mgr.14388) 11190 : audit [DBG] from='client.246000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:04 smithi049 bash[23528]: audit 2024-09-21T02:33:03.012296+0000 mgr.a (mgr.14388) 11191 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:33:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:04 smithi049 bash[23528]: cephadm 2024-09-21T02:33:03.024683+0000 mgr.a (mgr.14388) 11192 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:33:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:04 smithi049 bash[23528]: cluster 2024-09-21T02:33:03.337377+0000 mgr.a (mgr.14388) 11193 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:06 smithi044 bash[22676]: cluster 2024-09-21T02:33:05.339636+0000 mgr.a (mgr.14388) 11194 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:06.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:06 smithi179 bash[23186]: cluster 2024-09-21T02:33:05.339636+0000 mgr.a (mgr.14388) 11194 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:06 smithi049 bash[23528]: cluster 2024-09-21T02:33:05.339636+0000 mgr.a (mgr.14388) 11194 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:08.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:08.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:08.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:08 smithi044 bash[22676]: cluster 2024-09-21T02:33:07.340431+0000 mgr.a (mgr.14388) 11195 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:08 smithi179 bash[23186]: cluster 2024-09-21T02:33:07.340431+0000 mgr.a (mgr.14388) 11195 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:08 smithi049 bash[23528]: cluster 2024-09-21T02:33:07.340431+0000 mgr.a (mgr.14388) 11195 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:09.217 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:09.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:09.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:09.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:09.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:10 smithi044 bash[22676]: audit 2024-09-21T02:33:08.763863+0000 mgr.a (mgr.14388) 11196 : audit [DBG] from='client.246171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:10 smithi044 bash[22676]: cluster 2024-09-21T02:33:09.341509+0000 mgr.a (mgr.14388) 11197 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:10 smithi179 bash[23186]: audit 2024-09-21T02:33:08.763863+0000 mgr.a (mgr.14388) 11196 : audit [DBG] from='client.246171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:10 smithi179 bash[23186]: cluster 2024-09-21T02:33:09.341509+0000 mgr.a (mgr.14388) 11197 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:10 smithi049 bash[23528]: audit 2024-09-21T02:33:08.763863+0000 mgr.a (mgr.14388) 11196 : audit [DBG] from='client.246171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:10 smithi049 bash[23528]: cluster 2024-09-21T02:33:09.341509+0000 mgr.a (mgr.14388) 11197 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:12 smithi044 bash[22676]: cluster 2024-09-21T02:33:11.343800+0000 mgr.a (mgr.14388) 11198 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:12 smithi044 bash[22676]: audit 2024-09-21T02:33:11.493372+0000 mon.a (mon.0) 9205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:12 smithi044 bash[22676]: audit 2024-09-21T02:33:11.503077+0000 mon.a (mon.0) 9206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:12 smithi044 bash[22676]: audit 2024-09-21T02:33:11.513744+0000 mon.a (mon.0) 9207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:12 smithi044 bash[22676]: audit 2024-09-21T02:33:11.630028+0000 mon.a (mon.0) 9208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:12 smithi044 bash[22676]: audit 2024-09-21T02:33:11.638685+0000 mon.a (mon.0) 9209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:12 smithi044 bash[22676]: audit 2024-09-21T02:33:11.650018+0000 mon.a (mon.0) 9210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:12 smithi179 bash[23186]: cluster 2024-09-21T02:33:11.343800+0000 mgr.a (mgr.14388) 11198 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:12 smithi179 bash[23186]: audit 2024-09-21T02:33:11.493372+0000 mon.a (mon.0) 9205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:12 smithi179 bash[23186]: audit 2024-09-21T02:33:11.503077+0000 mon.a (mon.0) 9206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:12 smithi179 bash[23186]: audit 2024-09-21T02:33:11.513744+0000 mon.a (mon.0) 9207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:12 smithi179 bash[23186]: audit 2024-09-21T02:33:11.630028+0000 mon.a (mon.0) 9208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:12 smithi179 bash[23186]: audit 2024-09-21T02:33:11.638685+0000 mon.a (mon.0) 9209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:12 smithi179 bash[23186]: audit 2024-09-21T02:33:11.650018+0000 mon.a (mon.0) 9210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:12 smithi049 bash[23528]: cluster 2024-09-21T02:33:11.343800+0000 mgr.a (mgr.14388) 11198 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:12 smithi049 bash[23528]: audit 2024-09-21T02:33:11.493372+0000 mon.a (mon.0) 9205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:12 smithi049 bash[23528]: audit 2024-09-21T02:33:11.503077+0000 mon.a (mon.0) 9206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:12 smithi049 bash[23528]: audit 2024-09-21T02:33:11.513744+0000 mon.a (mon.0) 9207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:12 smithi049 bash[23528]: audit 2024-09-21T02:33:11.630028+0000 mon.a (mon.0) 9208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:12 smithi049 bash[23528]: audit 2024-09-21T02:33:11.638685+0000 mon.a (mon.0) 9209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:12 smithi049 bash[23528]: audit 2024-09-21T02:33:11.650018+0000 mon.a (mon.0) 9210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:14.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:14.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:14.220 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:14 smithi044 bash[22676]: cluster 2024-09-21T02:33:13.344577+0000 mgr.a (mgr.14388) 11199 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:14 smithi179 bash[23186]: cluster 2024-09-21T02:33:13.344577+0000 mgr.a (mgr.14388) 11199 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:14.763 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:14 smithi049 bash[23528]: cluster 2024-09-21T02:33:13.344577+0000 mgr.a (mgr.14388) 11199 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:15.003 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:15.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:15.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:15.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:15.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:16 smithi044 bash[22676]: audit 2024-09-21T02:33:14.551667+0000 mgr.a (mgr.14388) 11200 : audit [DBG] from='client.246246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:16 smithi044 bash[22676]: cluster 2024-09-21T02:33:15.347073+0000 mgr.a (mgr.14388) 11201 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:16 smithi179 bash[23186]: audit 2024-09-21T02:33:14.551667+0000 mgr.a (mgr.14388) 11200 : audit [DBG] from='client.246246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:16 smithi179 bash[23186]: cluster 2024-09-21T02:33:15.347073+0000 mgr.a (mgr.14388) 11201 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:16 smithi049 bash[23528]: audit 2024-09-21T02:33:14.551667+0000 mgr.a (mgr.14388) 11200 : audit [DBG] from='client.246246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:16 smithi049 bash[23528]: cluster 2024-09-21T02:33:15.347073+0000 mgr.a (mgr.14388) 11201 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:33:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:18 smithi044 bash[22676]: cluster 2024-09-21T02:33:17.347847+0000 mgr.a (mgr.14388) 11202 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:18 smithi179 bash[23186]: cluster 2024-09-21T02:33:17.347847+0000 mgr.a (mgr.14388) 11202 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:18 smithi049 bash[23528]: cluster 2024-09-21T02:33:17.347847+0000 mgr.a (mgr.14388) 11202 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:20.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:20.005 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:20.006 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:20 smithi044 bash[22676]: audit 2024-09-21T02:33:19.085004+0000 mon.a (mon.0) 9211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:20 smithi044 bash[22676]: audit 2024-09-21T02:33:19.093556+0000 mon.a (mon.0) 9212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:20 smithi044 bash[22676]: audit 2024-09-21T02:33:19.103881+0000 mon.a (mon.0) 9213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:20 smithi044 bash[22676]: cluster 2024-09-21T02:33:19.348604+0000 mgr.a (mgr.14388) 11203 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:20.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:20 smithi179 bash[23186]: audit 2024-09-21T02:33:19.085004+0000 mon.a (mon.0) 9211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:20 smithi179 bash[23186]: audit 2024-09-21T02:33:19.093556+0000 mon.a (mon.0) 9212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:20 smithi179 bash[23186]: audit 2024-09-21T02:33:19.103881+0000 mon.a (mon.0) 9213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:20 smithi179 bash[23186]: cluster 2024-09-21T02:33:19.348604+0000 mgr.a (mgr.14388) 11203 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:20 smithi049 bash[23528]: audit 2024-09-21T02:33:19.085004+0000 mon.a (mon.0) 9211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:20 smithi049 bash[23528]: audit 2024-09-21T02:33:19.093556+0000 mon.a (mon.0) 9212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:20 smithi049 bash[23528]: audit 2024-09-21T02:33:19.103881+0000 mon.a (mon.0) 9213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:20 smithi049 bash[23528]: cluster 2024-09-21T02:33:19.348604+0000 mgr.a (mgr.14388) 11203 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:33:20.761 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:20.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:21.330 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:21 smithi179 bash[23186]: audit 2024-09-21T02:33:20.342656+0000 mgr.a (mgr.14388) 11204 : audit [DBG] from='client.246321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:21 smithi044 bash[22676]: audit 2024-09-21T02:33:20.342656+0000 mgr.a (mgr.14388) 11204 : audit [DBG] from='client.246321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:21 smithi049 bash[23528]: audit 2024-09-21T02:33:20.342656+0000 mgr.a (mgr.14388) 11204 : audit [DBG] from='client.246321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:22 smithi179 bash[23186]: cluster 2024-09-21T02:33:21.351406+0000 mgr.a (mgr.14388) 11205 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:22 smithi044 bash[22676]: cluster 2024-09-21T02:33:21.351406+0000 mgr.a (mgr.14388) 11205 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:22 smithi049 bash[23528]: cluster 2024-09-21T02:33:21.351406+0000 mgr.a (mgr.14388) 11205 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:24.684 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:24 smithi044 bash[22676]: cluster 2024-09-21T02:33:23.352208+0000 mgr.a (mgr.14388) 11206 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:33:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:24 smithi179 bash[23186]: cluster 2024-09-21T02:33:23.352208+0000 mgr.a (mgr.14388) 11206 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:33:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:24 smithi049 bash[23528]: cluster 2024-09-21T02:33:23.352208+0000 mgr.a (mgr.14388) 11206 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:33:25.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:25.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:25.763 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:26.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:26 smithi044 bash[22676]: cluster 2024-09-21T02:33:25.354239+0000 mgr.a (mgr.14388) 11207 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:26 smithi179 bash[23186]: cluster 2024-09-21T02:33:25.354239+0000 mgr.a (mgr.14388) 11207 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:26 smithi049 bash[23528]: cluster 2024-09-21T02:33:25.354239+0000 mgr.a (mgr.14388) 11207 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:27 smithi044 bash[22676]: audit 2024-09-21T02:33:26.101243+0000 mgr.a (mgr.14388) 11208 : audit [DBG] from='client.246393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:27.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:27 smithi179 bash[23186]: audit 2024-09-21T02:33:26.101243+0000 mgr.a (mgr.14388) 11208 : audit [DBG] from='client.246393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:27 smithi049 bash[23528]: audit 2024-09-21T02:33:26.101243+0000 mgr.a (mgr.14388) 11208 : audit [DBG] from='client.246393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:28 smithi044 bash[22676]: cluster 2024-09-21T02:33:27.355210+0000 mgr.a (mgr.14388) 11209 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:33:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:28 smithi179 bash[23186]: cluster 2024-09-21T02:33:27.355210+0000 mgr.a (mgr.14388) 11209 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:33:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:28 smithi049 bash[23528]: cluster 2024-09-21T02:33:27.355210+0000 mgr.a (mgr.14388) 11209 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:33:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:30 smithi044 bash[22676]: cluster 2024-09-21T02:33:29.356022+0000 mgr.a (mgr.14388) 11210 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:33:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:30 smithi179 bash[23186]: cluster 2024-09-21T02:33:29.356022+0000 mgr.a (mgr.14388) 11210 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:33:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:30 smithi049 bash[23528]: cluster 2024-09-21T02:33:29.356022+0000 mgr.a (mgr.14388) 11210 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:33:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:32.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:32.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:32.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:32.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:32 smithi044 bash[22676]: cluster 2024-09-21T02:33:31.358277+0000 mgr.a (mgr.14388) 11211 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:33:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:32 smithi044 bash[22676]: audit 2024-09-21T02:33:31.659061+0000 mon.a (mon.0) 9214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:32 smithi044 bash[22676]: audit 2024-09-21T02:33:31.666845+0000 mon.a (mon.0) 9215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:32 smithi044 bash[22676]: audit 2024-09-21T02:33:31.674180+0000 mon.a (mon.0) 9216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:32 smithi044 bash[22676]: audit 2024-09-21T02:33:31.860141+0000 mon.a (mon.0) 9217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:32 smithi044 bash[22676]: audit 2024-09-21T02:33:31.868326+0000 mon.a (mon.0) 9218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:32 smithi044 bash[22676]: audit 2024-09-21T02:33:31.877896+0000 mon.a (mon.0) 9219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:32 smithi179 bash[23186]: cluster 2024-09-21T02:33:31.358277+0000 mgr.a (mgr.14388) 11211 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:32 smithi179 bash[23186]: audit 2024-09-21T02:33:31.659061+0000 mon.a (mon.0) 9214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:32 smithi179 bash[23186]: audit 2024-09-21T02:33:31.666845+0000 mon.a (mon.0) 9215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:32 smithi179 bash[23186]: audit 2024-09-21T02:33:31.674180+0000 mon.a (mon.0) 9216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:32 smithi179 bash[23186]: audit 2024-09-21T02:33:31.860141+0000 mon.a (mon.0) 9217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:32 smithi179 bash[23186]: audit 2024-09-21T02:33:31.868326+0000 mon.a (mon.0) 9218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:32 smithi179 bash[23186]: audit 2024-09-21T02:33:31.877896+0000 mon.a (mon.0) 9219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:32 smithi049 bash[23528]: cluster 2024-09-21T02:33:31.358277+0000 mgr.a (mgr.14388) 11211 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:32 smithi049 bash[23528]: audit 2024-09-21T02:33:31.659061+0000 mon.a (mon.0) 9214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:32 smithi049 bash[23528]: audit 2024-09-21T02:33:31.666845+0000 mon.a (mon.0) 9215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:32 smithi049 bash[23528]: audit 2024-09-21T02:33:31.674180+0000 mon.a (mon.0) 9216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:32 smithi049 bash[23528]: audit 2024-09-21T02:33:31.860141+0000 mon.a (mon.0) 9217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:32 smithi049 bash[23528]: audit 2024-09-21T02:33:31.868326+0000 mon.a (mon.0) 9218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:32 smithi049 bash[23528]: audit 2024-09-21T02:33:31.877896+0000 mon.a (mon.0) 9219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:33 smithi044 bash[22676]: audit 2024-09-21T02:33:31.913650+0000 mgr.a (mgr.14388) 11212 : audit [DBG] from='client.246471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:33.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:33 smithi179 bash[23186]: audit 2024-09-21T02:33:31.913650+0000 mgr.a (mgr.14388) 11212 : audit [DBG] from='client.246471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:33 smithi049 bash[23528]: audit 2024-09-21T02:33:31.913650+0000 mgr.a (mgr.14388) 11212 : audit [DBG] from='client.246471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:34 smithi044 bash[22676]: cluster 2024-09-21T02:33:33.359153+0000 mgr.a (mgr.14388) 11213 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:34 smithi179 bash[23186]: cluster 2024-09-21T02:33:33.359153+0000 mgr.a (mgr.14388) 11213 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:34 smithi049 bash[23528]: cluster 2024-09-21T02:33:33.359153+0000 mgr.a (mgr.14388) 11213 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:36.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:36 smithi049 bash[23528]: cluster 2024-09-21T02:33:35.361303+0000 mgr.a (mgr.14388) 11214 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:36 smithi044 bash[22676]: cluster 2024-09-21T02:33:35.361303+0000 mgr.a (mgr.14388) 11214 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:36.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:36 smithi179 bash[23186]: cluster 2024-09-21T02:33:35.361303+0000 mgr.a (mgr.14388) 11214 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:37.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:37.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:37.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:38.082 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:38.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:38.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:38.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:38.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:38.706 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:38 smithi049 bash[23528]: cluster 2024-09-21T02:33:37.361914+0000 mgr.a (mgr.14388) 11215 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:38 smithi044 bash[22676]: cluster 2024-09-21T02:33:37.361914+0000 mgr.a (mgr.14388) 11215 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:38 smithi179 bash[23186]: cluster 2024-09-21T02:33:37.361914+0000 mgr.a (mgr.14388) 11215 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:39 smithi044 bash[22676]: audit 2024-09-21T02:33:37.663109+0000 mgr.a (mgr.14388) 11216 : audit [DBG] from='client.246546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:39 smithi044 bash[22676]: audit 2024-09-21T02:33:39.300521+0000 mon.a (mon.0) 9220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:39 smithi044 bash[22676]: audit 2024-09-21T02:33:39.309161+0000 mon.a (mon.0) 9221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:39 smithi044 bash[22676]: audit 2024-09-21T02:33:39.319687+0000 mon.a (mon.0) 9222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:39 smithi179 bash[23186]: audit 2024-09-21T02:33:37.663109+0000 mgr.a (mgr.14388) 11216 : audit [DBG] from='client.246546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:39 smithi179 bash[23186]: audit 2024-09-21T02:33:39.300521+0000 mon.a (mon.0) 9220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:39 smithi179 bash[23186]: audit 2024-09-21T02:33:39.309161+0000 mon.a (mon.0) 9221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:39 smithi179 bash[23186]: audit 2024-09-21T02:33:39.319687+0000 mon.a (mon.0) 9222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:39 smithi049 bash[23528]: audit 2024-09-21T02:33:37.663109+0000 mgr.a (mgr.14388) 11216 : audit [DBG] from='client.246546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:39 smithi049 bash[23528]: audit 2024-09-21T02:33:39.300521+0000 mon.a (mon.0) 9220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:39 smithi049 bash[23528]: audit 2024-09-21T02:33:39.309161+0000 mon.a (mon.0) 9221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:39 smithi049 bash[23528]: audit 2024-09-21T02:33:39.319687+0000 mon.a (mon.0) 9222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:40.710 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:40 smithi049 bash[23528]: cluster 2024-09-21T02:33:39.362823+0000 mgr.a (mgr.14388) 11217 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:40 smithi044 bash[22676]: cluster 2024-09-21T02:33:39.362823+0000 mgr.a (mgr.14388) 11217 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:40.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:40 smithi179 bash[23186]: cluster 2024-09-21T02:33:39.362823+0000 mgr.a (mgr.14388) 11217 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:41.602 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:41 smithi179 bash[23186]: cluster 2024-09-21T02:33:41.365039+0000 mgr.a (mgr.14388) 11218 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:41 smithi049 bash[23528]: cluster 2024-09-21T02:33:41.365039+0000 mgr.a (mgr.14388) 11218 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:41 smithi044 bash[22676]: cluster 2024-09-21T02:33:41.365039+0000 mgr.a (mgr.14388) 11218 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:43.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:43.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:43.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:43.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:43.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:43.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:43.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:43.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:44.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:44 smithi044 bash[22676]: cluster 2024-09-21T02:33:43.365789+0000 mgr.a (mgr.14388) 11219 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:44.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:44 smithi044 bash[22676]: audit 2024-09-21T02:33:43.420013+0000 mgr.a (mgr.14388) 11220 : audit [DBG] from='client.246618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:44 smithi179 bash[23186]: cluster 2024-09-21T02:33:43.365789+0000 mgr.a (mgr.14388) 11219 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:44 smithi179 bash[23186]: audit 2024-09-21T02:33:43.420013+0000 mgr.a (mgr.14388) 11220 : audit [DBG] from='client.246618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:44 smithi049 bash[23528]: cluster 2024-09-21T02:33:43.365789+0000 mgr.a (mgr.14388) 11219 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:44 smithi049 bash[23528]: audit 2024-09-21T02:33:43.420013+0000 mgr.a (mgr.14388) 11220 : audit [DBG] from='client.246618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:46 smithi044 bash[22676]: cluster 2024-09-21T02:33:45.368139+0000 mgr.a (mgr.14388) 11221 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:46 smithi179 bash[23186]: cluster 2024-09-21T02:33:45.368139+0000 mgr.a (mgr.14388) 11221 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:46 smithi049 bash[23528]: cluster 2024-09-21T02:33:45.368139+0000 mgr.a (mgr.14388) 11221 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:48 smithi044 bash[22676]: cluster 2024-09-21T02:33:47.368943+0000 mgr.a (mgr.14388) 11222 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:48 smithi179 bash[23186]: cluster 2024-09-21T02:33:47.368943+0000 mgr.a (mgr.14388) 11222 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:48 smithi049 bash[23528]: cluster 2024-09-21T02:33:47.368943+0000 mgr.a (mgr.14388) 11222 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:48.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:48.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:48.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:49.622 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:49.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:49.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:49.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:49.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:50 smithi044 bash[22676]: audit 2024-09-21T02:33:49.188064+0000 mgr.a (mgr.14388) 11223 : audit [DBG] from='client.246696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:50 smithi044 bash[22676]: cluster 2024-09-21T02:33:49.369569+0000 mgr.a (mgr.14388) 11224 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:50.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:50 smithi179 bash[23186]: audit 2024-09-21T02:33:49.188064+0000 mgr.a (mgr.14388) 11223 : audit [DBG] from='client.246696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:50 smithi179 bash[23186]: cluster 2024-09-21T02:33:49.369569+0000 mgr.a (mgr.14388) 11224 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:50 smithi049 bash[23528]: audit 2024-09-21T02:33:49.188064+0000 mgr.a (mgr.14388) 11223 : audit [DBG] from='client.246696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:50 smithi049 bash[23528]: cluster 2024-09-21T02:33:49.369569+0000 mgr.a (mgr.14388) 11224 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:52 smithi044 bash[22676]: cluster 2024-09-21T02:33:51.371894+0000 mgr.a (mgr.14388) 11225 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:52 smithi044 bash[22676]: audit 2024-09-21T02:33:51.876546+0000 mon.a (mon.0) 9223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:52 smithi044 bash[22676]: audit 2024-09-21T02:33:51.883758+0000 mon.a (mon.0) 9224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:52 smithi044 bash[22676]: audit 2024-09-21T02:33:51.893291+0000 mon.a (mon.0) 9225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:52 smithi044 bash[22676]: audit 2024-09-21T02:33:52.067230+0000 mon.a (mon.0) 9226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:52 smithi044 bash[22676]: audit 2024-09-21T02:33:52.072974+0000 mon.a (mon.0) 9227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:52 smithi044 bash[22676]: audit 2024-09-21T02:33:52.079794+0000 mon.a (mon.0) 9228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:52 smithi179 bash[23186]: cluster 2024-09-21T02:33:51.371894+0000 mgr.a (mgr.14388) 11225 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:52 smithi179 bash[23186]: audit 2024-09-21T02:33:51.876546+0000 mon.a (mon.0) 9223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:52 smithi179 bash[23186]: audit 2024-09-21T02:33:51.883758+0000 mon.a (mon.0) 9224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:52 smithi179 bash[23186]: audit 2024-09-21T02:33:51.893291+0000 mon.a (mon.0) 9225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:52 smithi179 bash[23186]: audit 2024-09-21T02:33:52.067230+0000 mon.a (mon.0) 9226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:52 smithi179 bash[23186]: audit 2024-09-21T02:33:52.072974+0000 mon.a (mon.0) 9227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:52 smithi179 bash[23186]: audit 2024-09-21T02:33:52.079794+0000 mon.a (mon.0) 9228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:52 smithi049 bash[23528]: cluster 2024-09-21T02:33:51.371894+0000 mgr.a (mgr.14388) 11225 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:52 smithi049 bash[23528]: audit 2024-09-21T02:33:51.876546+0000 mon.a (mon.0) 9223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:52 smithi049 bash[23528]: audit 2024-09-21T02:33:51.883758+0000 mon.a (mon.0) 9224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:52 smithi049 bash[23528]: audit 2024-09-21T02:33:51.893291+0000 mon.a (mon.0) 9225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:52 smithi049 bash[23528]: audit 2024-09-21T02:33:52.067230+0000 mon.a (mon.0) 9226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:52 smithi049 bash[23528]: audit 2024-09-21T02:33:52.072974+0000 mon.a (mon.0) 9227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:52 smithi049 bash[23528]: audit 2024-09-21T02:33:52.079794+0000 mon.a (mon.0) 9228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:33:54.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:33:54.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:33:54.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:33:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:54 smithi044 bash[22676]: cluster 2024-09-21T02:33:53.372677+0000 mgr.a (mgr.14388) 11226 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:54.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:54 smithi179 bash[23186]: cluster 2024-09-21T02:33:53.372677+0000 mgr.a (mgr.14388) 11226 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:54 smithi049 bash[23528]: cluster 2024-09-21T02:33:53.372677+0000 mgr.a (mgr.14388) 11226 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:55.403 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:33:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:33:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:33:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:33:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:33:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:56 smithi049 bash[23528]: audit 2024-09-21T02:33:54.961588+0000 mgr.a (mgr.14388) 11227 : audit [DBG] from='client.246774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:56 smithi049 bash[23528]: cluster 2024-09-21T02:33:55.374035+0000 mgr.a (mgr.14388) 11228 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:56 smithi044 bash[22676]: audit 2024-09-21T02:33:54.961588+0000 mgr.a (mgr.14388) 11227 : audit [DBG] from='client.246774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:56 smithi044 bash[22676]: cluster 2024-09-21T02:33:55.374035+0000 mgr.a (mgr.14388) 11228 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:56 smithi179 bash[23186]: audit 2024-09-21T02:33:54.961588+0000 mgr.a (mgr.14388) 11227 : audit [DBG] from='client.246774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:56 smithi179 bash[23186]: cluster 2024-09-21T02:33:55.374035+0000 mgr.a (mgr.14388) 11228 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:33:58.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:33:58 smithi044 bash[22676]: cluster 2024-09-21T02:33:57.374799+0000 mgr.a (mgr.14388) 11229 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:33:58.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:33:58 smithi179 bash[23186]: cluster 2024-09-21T02:33:57.374799+0000 mgr.a (mgr.14388) 11229 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:33:58.788 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:33:58 smithi049 bash[23528]: cluster 2024-09-21T02:33:57.374799+0000 mgr.a (mgr.14388) 11229 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:34:00.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:00.405 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:00.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:00 smithi044 bash[22676]: cluster 2024-09-21T02:33:59.375569+0000 mgr.a (mgr.14388) 11230 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:34:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:00 smithi044 bash[22676]: audit 2024-09-21T02:33:59.514748+0000 mon.a (mon.0) 9229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:00 smithi044 bash[22676]: audit 2024-09-21T02:33:59.523446+0000 mon.a (mon.0) 9230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:00 smithi044 bash[22676]: audit 2024-09-21T02:33:59.533727+0000 mon.a (mon.0) 9231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:00 smithi179 bash[23186]: cluster 2024-09-21T02:33:59.375569+0000 mgr.a (mgr.14388) 11230 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:34:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:00 smithi179 bash[23186]: audit 2024-09-21T02:33:59.514748+0000 mon.a (mon.0) 9229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:00 smithi179 bash[23186]: audit 2024-09-21T02:33:59.523446+0000 mon.a (mon.0) 9230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:00 smithi179 bash[23186]: audit 2024-09-21T02:33:59.533727+0000 mon.a (mon.0) 9231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:00 smithi049 bash[23528]: cluster 2024-09-21T02:33:59.375569+0000 mgr.a (mgr.14388) 11230 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:00 smithi049 bash[23528]: audit 2024-09-21T02:33:59.514748+0000 mon.a (mon.0) 9229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:00 smithi049 bash[23528]: audit 2024-09-21T02:33:59.523446+0000 mon.a (mon.0) 9230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:00 smithi049 bash[23528]: audit 2024-09-21T02:33:59.533727+0000 mon.a (mon.0) 9231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:01.182 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:01.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:01.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:01.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:02 smithi044 bash[22676]: audit 2024-09-21T02:34:00.738409+0000 mgr.a (mgr.14388) 11231 : audit [DBG] from='client.246849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:02 smithi044 bash[22676]: cluster 2024-09-21T02:34:01.378250+0000 mgr.a (mgr.14388) 11232 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:02.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:02 smithi179 bash[23186]: audit 2024-09-21T02:34:00.738409+0000 mgr.a (mgr.14388) 11231 : audit [DBG] from='client.246849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:02 smithi179 bash[23186]: cluster 2024-09-21T02:34:01.378250+0000 mgr.a (mgr.14388) 11232 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:02 smithi049 bash[23528]: audit 2024-09-21T02:34:00.738409+0000 mgr.a (mgr.14388) 11231 : audit [DBG] from='client.246849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:02 smithi049 bash[23528]: cluster 2024-09-21T02:34:01.378250+0000 mgr.a (mgr.14388) 11232 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:03 smithi044 bash[22676]: audit 2024-09-21T02:34:03.083944+0000 mon.a (mon.0) 9232 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:34:03.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:03 smithi179 bash[23186]: audit 2024-09-21T02:34:03.083944+0000 mon.a (mon.0) 9232 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:34:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:03 smithi049 bash[23528]: audit 2024-09-21T02:34:03.083944+0000 mon.a (mon.0) 9232 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:34:04.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22930]: debug 2024-09-21T02:34:04.454+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22930]: debug 2024-09-21T02:34:04.458+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: cluster 2024-09-21T02:34:03.379019+0000 mgr.a (mgr.14388) 11233 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.682943+0000 mon.a (mon.0) 9233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.688270+0000 mon.a (mon.0) 9234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.693540+0000 mon.a (mon.0) 9235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.706357+0000 mon.a (mon.0) 9236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.708104+0000 mon.a (mon.0) 9237 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.708989+0000 mon.a (mon.0) 9238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:34:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.720133+0000 mon.a (mon.0) 9239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.723078+0000 mon.a (mon.0) 9240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:34:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:03.724558+0000 mgr.a (mgr.14388) 11234 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:34:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:04 smithi044 bash[22676]: audit 2024-09-21T02:34:04.460385+0000 mgr.a (mgr.14388) 11235 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: cluster 2024-09-21T02:34:03.379019+0000 mgr.a (mgr.14388) 11233 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.682943+0000 mon.a (mon.0) 9233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.688270+0000 mon.a (mon.0) 9234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.693540+0000 mon.a (mon.0) 9235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.706357+0000 mon.a (mon.0) 9236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.708104+0000 mon.a (mon.0) 9237 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.708989+0000 mon.a (mon.0) 9238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.720133+0000 mon.a (mon.0) 9239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.723078+0000 mon.a (mon.0) 9240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:34:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:03.724558+0000 mgr.a (mgr.14388) 11234 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:34:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:04 smithi179 bash[23186]: audit 2024-09-21T02:34:04.460385+0000 mgr.a (mgr.14388) 11235 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: cluster 2024-09-21T02:34:03.379019+0000 mgr.a (mgr.14388) 11233 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:34:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.682943+0000 mon.a (mon.0) 9233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.688270+0000 mon.a (mon.0) 9234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.693540+0000 mon.a (mon.0) 9235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.706357+0000 mon.a (mon.0) 9236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.708104+0000 mon.a (mon.0) 9237 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.708989+0000 mon.a (mon.0) 9238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.720133+0000 mon.a (mon.0) 9239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.723078+0000 mon.a (mon.0) 9240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:03.724558+0000 mgr.a (mgr.14388) 11234 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:34:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:04 smithi049 bash[23528]: audit 2024-09-21T02:34:04.460385+0000 mgr.a (mgr.14388) 11235 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:34:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:05 smithi044 bash[22676]: cephadm 2024-09-21T02:34:04.461584+0000 mgr.a (mgr.14388) 11236 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:34:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:05 smithi044 bash[22676]: cluster 2024-09-21T02:34:05.381422+0000 mgr.a (mgr.14388) 11237 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:05 smithi179 bash[23186]: cephadm 2024-09-21T02:34:04.461584+0000 mgr.a (mgr.14388) 11236 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:34:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:05 smithi179 bash[23186]: cluster 2024-09-21T02:34:05.381422+0000 mgr.a (mgr.14388) 11237 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:05 smithi049 bash[23528]: cephadm 2024-09-21T02:34:04.461584+0000 mgr.a (mgr.14388) 11236 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:34:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:05 smithi049 bash[23528]: cluster 2024-09-21T02:34:05.381422+0000 mgr.a (mgr.14388) 11237 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:06.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:06.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:06.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:06.956 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:06.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:06.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:06.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:06.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:08 smithi044 bash[22676]: audit 2024-09-21T02:34:06.511951+0000 mgr.a (mgr.14388) 11238 : audit [DBG] from='client.247029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:08 smithi044 bash[22676]: cluster 2024-09-21T02:34:07.382453+0000 mgr.a (mgr.14388) 11239 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:08 smithi179 bash[23186]: audit 2024-09-21T02:34:06.511951+0000 mgr.a (mgr.14388) 11238 : audit [DBG] from='client.247029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:08 smithi179 bash[23186]: cluster 2024-09-21T02:34:07.382453+0000 mgr.a (mgr.14388) 11239 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:08 smithi049 bash[23528]: audit 2024-09-21T02:34:06.511951+0000 mgr.a (mgr.14388) 11238 : audit [DBG] from='client.247029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:08 smithi049 bash[23528]: cluster 2024-09-21T02:34:07.382453+0000 mgr.a (mgr.14388) 11239 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:10 smithi044 bash[22676]: cluster 2024-09-21T02:34:09.383435+0000 mgr.a (mgr.14388) 11240 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:10.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:10 smithi179 bash[23186]: cluster 2024-09-21T02:34:09.383435+0000 mgr.a (mgr.14388) 11240 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:10 smithi049 bash[23528]: cluster 2024-09-21T02:34:09.383435+0000 mgr.a (mgr.14388) 11240 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:11.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:11.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:11.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:12.731 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:12 smithi044 bash[22676]: cluster 2024-09-21T02:34:11.385756+0000 mgr.a (mgr.14388) 11241 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:12 smithi044 bash[22676]: audit 2024-09-21T02:34:12.084344+0000 mon.a (mon.0) 9241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:12 smithi044 bash[22676]: audit 2024-09-21T02:34:12.090450+0000 mon.a (mon.0) 9242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:12 smithi044 bash[22676]: audit 2024-09-21T02:34:12.096357+0000 mon.a (mon.0) 9243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:12 smithi044 bash[22676]: audit 2024-09-21T02:34:12.284452+0000 mon.a (mon.0) 9244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:12 smithi044 bash[22676]: audit 2024-09-21T02:34:12.292273+0000 mon.a (mon.0) 9245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:12 smithi044 bash[22676]: audit 2024-09-21T02:34:12.301872+0000 mon.a (mon.0) 9246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:12 smithi179 bash[23186]: cluster 2024-09-21T02:34:11.385756+0000 mgr.a (mgr.14388) 11241 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:12 smithi179 bash[23186]: audit 2024-09-21T02:34:12.084344+0000 mon.a (mon.0) 9241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:12 smithi179 bash[23186]: audit 2024-09-21T02:34:12.090450+0000 mon.a (mon.0) 9242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:12 smithi179 bash[23186]: audit 2024-09-21T02:34:12.096357+0000 mon.a (mon.0) 9243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:12 smithi179 bash[23186]: audit 2024-09-21T02:34:12.284452+0000 mon.a (mon.0) 9244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:12 smithi179 bash[23186]: audit 2024-09-21T02:34:12.292273+0000 mon.a (mon.0) 9245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:12 smithi179 bash[23186]: audit 2024-09-21T02:34:12.301872+0000 mon.a (mon.0) 9246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:12 smithi049 bash[23528]: cluster 2024-09-21T02:34:11.385756+0000 mgr.a (mgr.14388) 11241 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:12 smithi049 bash[23528]: audit 2024-09-21T02:34:12.084344+0000 mon.a (mon.0) 9241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:12 smithi049 bash[23528]: audit 2024-09-21T02:34:12.090450+0000 mon.a (mon.0) 9242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:12 smithi049 bash[23528]: audit 2024-09-21T02:34:12.096357+0000 mon.a (mon.0) 9243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:12 smithi049 bash[23528]: audit 2024-09-21T02:34:12.284452+0000 mon.a (mon.0) 9244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:12 smithi049 bash[23528]: audit 2024-09-21T02:34:12.292273+0000 mon.a (mon.0) 9245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:12 smithi049 bash[23528]: audit 2024-09-21T02:34:12.301872+0000 mon.a (mon.0) 9246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:13 smithi044 bash[22676]: audit 2024-09-21T02:34:12.299425+0000 mgr.a (mgr.14388) 11242 : audit [DBG] from='client.247107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:13 smithi179 bash[23186]: audit 2024-09-21T02:34:12.299425+0000 mgr.a (mgr.14388) 11242 : audit [DBG] from='client.247107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:13 smithi049 bash[23528]: audit 2024-09-21T02:34:12.299425+0000 mgr.a (mgr.14388) 11242 : audit [DBG] from='client.247107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:14 smithi044 bash[22676]: cluster 2024-09-21T02:34:13.386644+0000 mgr.a (mgr.14388) 11243 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:14 smithi179 bash[23186]: cluster 2024-09-21T02:34:13.386644+0000 mgr.a (mgr.14388) 11243 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:14 smithi049 bash[23528]: cluster 2024-09-21T02:34:13.386644+0000 mgr.a (mgr.14388) 11243 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:16 smithi044 bash[22676]: cluster 2024-09-21T02:34:15.388771+0000 mgr.a (mgr.14388) 11244 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:16.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:16 smithi179 bash[23186]: cluster 2024-09-21T02:34:15.388771+0000 mgr.a (mgr.14388) 11244 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:16 smithi049 bash[23528]: cluster 2024-09-21T02:34:15.388771+0000 mgr.a (mgr.14388) 11244 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:34:17.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:17.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:17.735 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:18.522 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:18.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:18.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:18.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:18.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:18 smithi044 bash[22676]: cluster 2024-09-21T02:34:17.389595+0000 mgr.a (mgr.14388) 11245 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:18.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:18 smithi179 bash[23186]: cluster 2024-09-21T02:34:17.389595+0000 mgr.a (mgr.14388) 11245 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:18 smithi049 bash[23528]: cluster 2024-09-21T02:34:17.389595+0000 mgr.a (mgr.14388) 11245 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:19 smithi044 bash[22676]: audit 2024-09-21T02:34:18.069283+0000 mgr.a (mgr.14388) 11246 : audit [DBG] from='client.247185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:19 smithi044 bash[22676]: cluster 2024-09-21T02:34:19.390492+0000 mgr.a (mgr.14388) 11247 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:19.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:19 smithi179 bash[23186]: audit 2024-09-21T02:34:18.069283+0000 mgr.a (mgr.14388) 11246 : audit [DBG] from='client.247185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:19 smithi179 bash[23186]: cluster 2024-09-21T02:34:19.390492+0000 mgr.a (mgr.14388) 11247 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:19.773 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:19 smithi049 bash[23528]: audit 2024-09-21T02:34:18.069283+0000 mgr.a (mgr.14388) 11246 : audit [DBG] from='client.247185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:19.773 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:19 smithi049 bash[23528]: cluster 2024-09-21T02:34:19.390492+0000 mgr.a (mgr.14388) 11247 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:20 smithi179 bash[23186]: audit 2024-09-21T02:34:19.750042+0000 mon.a (mon.0) 9247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:20 smithi179 bash[23186]: audit 2024-09-21T02:34:19.759987+0000 mon.a (mon.0) 9248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:20 smithi179 bash[23186]: audit 2024-09-21T02:34:19.771870+0000 mon.a (mon.0) 9249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:20 smithi049 bash[23528]: audit 2024-09-21T02:34:19.750042+0000 mon.a (mon.0) 9247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:20 smithi049 bash[23528]: audit 2024-09-21T02:34:19.759987+0000 mon.a (mon.0) 9248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:20 smithi049 bash[23528]: audit 2024-09-21T02:34:19.771870+0000 mon.a (mon.0) 9249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:20 smithi044 bash[22676]: audit 2024-09-21T02:34:19.750042+0000 mon.a (mon.0) 9247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:20 smithi044 bash[22676]: audit 2024-09-21T02:34:19.759987+0000 mon.a (mon.0) 9248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:20 smithi044 bash[22676]: audit 2024-09-21T02:34:19.771870+0000 mon.a (mon.0) 9249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:21 smithi049 bash[23528]: cluster 2024-09-21T02:34:21.392828+0000 mgr.a (mgr.14388) 11248 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:21 smithi044 bash[22676]: cluster 2024-09-21T02:34:21.392828+0000 mgr.a (mgr.14388) 11248 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:22.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:21 smithi179 bash[23186]: cluster 2024-09-21T02:34:21.392828+0000 mgr.a (mgr.14388) 11248 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:23.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:23.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:23.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:24.310 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:24.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:24.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:24.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:24.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:24 smithi044 bash[22676]: cluster 2024-09-21T02:34:23.393646+0000 mgr.a (mgr.14388) 11249 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:24 smithi179 bash[23186]: cluster 2024-09-21T02:34:23.393646+0000 mgr.a (mgr.14388) 11249 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:24 smithi049 bash[23528]: cluster 2024-09-21T02:34:23.393646+0000 mgr.a (mgr.14388) 11249 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:25.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:25 smithi044 bash[22676]: audit 2024-09-21T02:34:23.861879+0000 mgr.a (mgr.14388) 11250 : audit [DBG] from='client.247263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:25 smithi179 bash[23186]: audit 2024-09-21T02:34:23.861879+0000 mgr.a (mgr.14388) 11250 : audit [DBG] from='client.247263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:25 smithi049 bash[23528]: audit 2024-09-21T02:34:23.861879+0000 mgr.a (mgr.14388) 11250 : audit [DBG] from='client.247263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:26 smithi044 bash[22676]: cluster 2024-09-21T02:34:25.395580+0000 mgr.a (mgr.14388) 11251 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:26 smithi179 bash[23186]: cluster 2024-09-21T02:34:25.395580+0000 mgr.a (mgr.14388) 11251 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:26 smithi049 bash[23528]: cluster 2024-09-21T02:34:25.395580+0000 mgr.a (mgr.14388) 11251 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:28 smithi044 bash[22676]: cluster 2024-09-21T02:34:27.396217+0000 mgr.a (mgr.14388) 11252 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:28.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:28 smithi179 bash[23186]: cluster 2024-09-21T02:34:27.396217+0000 mgr.a (mgr.14388) 11252 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:28 smithi049 bash[23528]: cluster 2024-09-21T02:34:27.396217+0000 mgr.a (mgr.14388) 11252 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:29.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:29.312 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:29.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:30.097 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:30 smithi044 bash[22676]: cluster 2024-09-21T02:34:29.396625+0000 mgr.a (mgr.14388) 11253 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:30 smithi179 bash[23186]: cluster 2024-09-21T02:34:29.396625+0000 mgr.a (mgr.14388) 11253 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:30 smithi049 bash[23528]: cluster 2024-09-21T02:34:29.396625+0000 mgr.a (mgr.14388) 11253 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:31 smithi179 bash[23186]: audit 2024-09-21T02:34:29.653736+0000 mgr.a (mgr.14388) 11254 : audit [DBG] from='client.247338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:31 smithi179 bash[23186]: cluster 2024-09-21T02:34:31.399580+0000 mgr.a (mgr.14388) 11255 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:34:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:31 smithi044 bash[22676]: audit 2024-09-21T02:34:29.653736+0000 mgr.a (mgr.14388) 11254 : audit [DBG] from='client.247338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:31 smithi044 bash[22676]: cluster 2024-09-21T02:34:31.399580+0000 mgr.a (mgr.14388) 11255 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:34:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:31 smithi049 bash[23528]: audit 2024-09-21T02:34:29.653736+0000 mgr.a (mgr.14388) 11254 : audit [DBG] from='client.247338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:31 smithi049 bash[23528]: cluster 2024-09-21T02:34:31.399580+0000 mgr.a (mgr.14388) 11255 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:34:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:33 smithi044 bash[22676]: audit 2024-09-21T02:34:32.313038+0000 mon.a (mon.0) 9250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:33 smithi044 bash[22676]: audit 2024-09-21T02:34:32.321662+0000 mon.a (mon.0) 9251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:33 smithi044 bash[22676]: audit 2024-09-21T02:34:32.332409+0000 mon.a (mon.0) 9252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:33 smithi044 bash[22676]: audit 2024-09-21T02:34:32.518244+0000 mon.a (mon.0) 9253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:33 smithi044 bash[22676]: audit 2024-09-21T02:34:32.527643+0000 mon.a (mon.0) 9254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:33 smithi044 bash[22676]: audit 2024-09-21T02:34:32.537981+0000 mon.a (mon.0) 9255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:33 smithi179 bash[23186]: audit 2024-09-21T02:34:32.313038+0000 mon.a (mon.0) 9250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:33 smithi179 bash[23186]: audit 2024-09-21T02:34:32.321662+0000 mon.a (mon.0) 9251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:33 smithi179 bash[23186]: audit 2024-09-21T02:34:32.332409+0000 mon.a (mon.0) 9252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:33 smithi179 bash[23186]: audit 2024-09-21T02:34:32.518244+0000 mon.a (mon.0) 9253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:33 smithi179 bash[23186]: audit 2024-09-21T02:34:32.527643+0000 mon.a (mon.0) 9254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:33 smithi179 bash[23186]: audit 2024-09-21T02:34:32.537981+0000 mon.a (mon.0) 9255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:33 smithi049 bash[23528]: audit 2024-09-21T02:34:32.313038+0000 mon.a (mon.0) 9250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:33 smithi049 bash[23528]: audit 2024-09-21T02:34:32.321662+0000 mon.a (mon.0) 9251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:33 smithi049 bash[23528]: audit 2024-09-21T02:34:32.332409+0000 mon.a (mon.0) 9252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:33 smithi049 bash[23528]: audit 2024-09-21T02:34:32.518244+0000 mon.a (mon.0) 9253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:33 smithi049 bash[23528]: audit 2024-09-21T02:34:32.527643+0000 mon.a (mon.0) 9254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:33 smithi049 bash[23528]: audit 2024-09-21T02:34:32.537981+0000 mon.a (mon.0) 9255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:34 smithi044 bash[22676]: cluster 2024-09-21T02:34:33.400399+0000 mgr.a (mgr.14388) 11256 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:34:34.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:34 smithi179 bash[23186]: cluster 2024-09-21T02:34:33.400399+0000 mgr.a (mgr.14388) 11256 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:34:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:34 smithi049 bash[23528]: cluster 2024-09-21T02:34:33.400399+0000 mgr.a (mgr.14388) 11256 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:34:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:35.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:35.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:35.861 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:36 smithi044 bash[22676]: cluster 2024-09-21T02:34:35.402413+0000 mgr.a (mgr.14388) 11257 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:36 smithi044 bash[22676]: audit 2024-09-21T02:34:35.432331+0000 mgr.a (mgr.14388) 11258 : audit [DBG] from='client.247416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:36 smithi179 bash[23186]: cluster 2024-09-21T02:34:35.402413+0000 mgr.a (mgr.14388) 11257 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:36 smithi179 bash[23186]: audit 2024-09-21T02:34:35.432331+0000 mgr.a (mgr.14388) 11258 : audit [DBG] from='client.247416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:36 smithi049 bash[23528]: cluster 2024-09-21T02:34:35.402413+0000 mgr.a (mgr.14388) 11257 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:36 smithi049 bash[23528]: audit 2024-09-21T02:34:35.432331+0000 mgr.a (mgr.14388) 11258 : audit [DBG] from='client.247416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:38 smithi044 bash[22676]: cluster 2024-09-21T02:34:37.403439+0000 mgr.a (mgr.14388) 11259 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:34:38.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:38 smithi179 bash[23186]: cluster 2024-09-21T02:34:37.403439+0000 mgr.a (mgr.14388) 11259 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:34:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:38 smithi049 bash[23528]: cluster 2024-09-21T02:34:37.403439+0000 mgr.a (mgr.14388) 11259 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:34:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:40 smithi044 bash[22676]: cluster 2024-09-21T02:34:39.404263+0000 mgr.a (mgr.14388) 11260 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:34:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:40 smithi044 bash[22676]: audit 2024-09-21T02:34:39.968365+0000 mon.a (mon.0) 9256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:40 smithi044 bash[22676]: audit 2024-09-21T02:34:39.977121+0000 mon.a (mon.0) 9257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:40 smithi044 bash[22676]: audit 2024-09-21T02:34:39.987607+0000 mon.a (mon.0) 9258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:40 smithi179 bash[23186]: cluster 2024-09-21T02:34:39.404263+0000 mgr.a (mgr.14388) 11260 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:34:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:40 smithi179 bash[23186]: audit 2024-09-21T02:34:39.968365+0000 mon.a (mon.0) 9256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:40 smithi179 bash[23186]: audit 2024-09-21T02:34:39.977121+0000 mon.a (mon.0) 9257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:40 smithi179 bash[23186]: audit 2024-09-21T02:34:39.987607+0000 mon.a (mon.0) 9258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:40 smithi049 bash[23528]: cluster 2024-09-21T02:34:39.404263+0000 mgr.a (mgr.14388) 11260 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:34:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:40 smithi049 bash[23528]: audit 2024-09-21T02:34:39.968365+0000 mon.a (mon.0) 9256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:40 smithi049 bash[23528]: audit 2024-09-21T02:34:39.977121+0000 mon.a (mon.0) 9257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:40 smithi049 bash[23528]: audit 2024-09-21T02:34:39.987607+0000 mon.a (mon.0) 9258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:40.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:41.643 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:41.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:41.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:41 smithi049 bash[23528]: audit 2024-09-21T02:34:41.203406+0000 mgr.a (mgr.14388) 11261 : audit [DBG] from='client.247488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:41 smithi049 bash[23528]: cluster 2024-09-21T02:34:41.405889+0000 mgr.a (mgr.14388) 11262 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:41.877 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:41 smithi179 bash[23186]: audit 2024-09-21T02:34:41.203406+0000 mgr.a (mgr.14388) 11261 : audit [DBG] from='client.247488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:41.877 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:41 smithi179 bash[23186]: cluster 2024-09-21T02:34:41.405889+0000 mgr.a (mgr.14388) 11262 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:41 smithi044 bash[22676]: audit 2024-09-21T02:34:41.203406+0000 mgr.a (mgr.14388) 11261 : audit [DBG] from='client.247488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:41 smithi044 bash[22676]: cluster 2024-09-21T02:34:41.405889+0000 mgr.a (mgr.14388) 11262 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:44 smithi044 bash[22676]: cluster 2024-09-21T02:34:43.406781+0000 mgr.a (mgr.14388) 11263 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:34:44.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:44 smithi179 bash[23186]: cluster 2024-09-21T02:34:43.406781+0000 mgr.a (mgr.14388) 11263 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:34:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:44 smithi049 bash[23528]: cluster 2024-09-21T02:34:43.406781+0000 mgr.a (mgr.14388) 11263 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:34:46.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:46.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:46.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:46 smithi044 bash[22676]: cluster 2024-09-21T02:34:45.408409+0000 mgr.a (mgr.14388) 11264 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:34:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:46 smithi179 bash[23186]: cluster 2024-09-21T02:34:45.408409+0000 mgr.a (mgr.14388) 11264 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:34:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:46 smithi049 bash[23528]: cluster 2024-09-21T02:34:45.408409+0000 mgr.a (mgr.14388) 11264 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:34:47.444 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:47.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:47.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:47.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:47.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:48 smithi044 bash[22676]: audit 2024-09-21T02:34:46.984328+0000 mgr.a (mgr.14388) 11265 : audit [DBG] from='client.247563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:48 smithi044 bash[22676]: cluster 2024-09-21T02:34:47.409040+0000 mgr.a (mgr.14388) 11266 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:48.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:48 smithi179 bash[23186]: audit 2024-09-21T02:34:46.984328+0000 mgr.a (mgr.14388) 11265 : audit [DBG] from='client.247563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:48 smithi179 bash[23186]: cluster 2024-09-21T02:34:47.409040+0000 mgr.a (mgr.14388) 11266 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:48 smithi049 bash[23528]: audit 2024-09-21T02:34:46.984328+0000 mgr.a (mgr.14388) 11265 : audit [DBG] from='client.247563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:48 smithi049 bash[23528]: cluster 2024-09-21T02:34:47.409040+0000 mgr.a (mgr.14388) 11266 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:49 smithi044 bash[22676]: cluster 2024-09-21T02:34:49.409835+0000 mgr.a (mgr.14388) 11267 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:49 smithi179 bash[23186]: cluster 2024-09-21T02:34:49.409835+0000 mgr.a (mgr.14388) 11267 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:49 smithi049 bash[23528]: cluster 2024-09-21T02:34:49.409835+0000 mgr.a (mgr.14388) 11267 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:52.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:52.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:52.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:52 smithi044 bash[22676]: cluster 2024-09-21T02:34:51.412106+0000 mgr.a (mgr.14388) 11268 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:52.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:52 smithi179 bash[23186]: cluster 2024-09-21T02:34:51.412106+0000 mgr.a (mgr.14388) 11268 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:52 smithi049 bash[23528]: cluster 2024-09-21T02:34:51.412106+0000 mgr.a (mgr.14388) 11268 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:53.223 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:53.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:53.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:53.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:53.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:34:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: audit 2024-09-21T02:34:52.517928+0000 mon.a (mon.0) 9259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: audit 2024-09-21T02:34:52.523227+0000 mon.a (mon.0) 9260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: audit 2024-09-21T02:34:52.529176+0000 mon.a (mon.0) 9261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: audit 2024-09-21T02:34:52.748286+0000 mon.a (mon.0) 9262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: audit 2024-09-21T02:34:52.756574+0000 mon.a (mon.0) 9263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: audit 2024-09-21T02:34:52.766042+0000 mon.a (mon.0) 9264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: audit 2024-09-21T02:34:52.782165+0000 mgr.a (mgr.14388) 11269 : audit [DBG] from='client.247638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:53.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:53 smithi049 bash[23528]: cluster 2024-09-21T02:34:53.413108+0000 mgr.a (mgr.14388) 11270 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:53.858 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: audit 2024-09-21T02:34:52.517928+0000 mon.a (mon.0) 9259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: audit 2024-09-21T02:34:52.523227+0000 mon.a (mon.0) 9260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: audit 2024-09-21T02:34:52.529176+0000 mon.a (mon.0) 9261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: audit 2024-09-21T02:34:52.748286+0000 mon.a (mon.0) 9262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: audit 2024-09-21T02:34:52.756574+0000 mon.a (mon.0) 9263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: audit 2024-09-21T02:34:52.766042+0000 mon.a (mon.0) 9264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:53.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: audit 2024-09-21T02:34:52.782165+0000 mgr.a (mgr.14388) 11269 : audit [DBG] from='client.247638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:53.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:53 smithi044 bash[22676]: cluster 2024-09-21T02:34:53.413108+0000 mgr.a (mgr.14388) 11270 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: audit 2024-09-21T02:34:52.517928+0000 mon.a (mon.0) 9259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: audit 2024-09-21T02:34:52.523227+0000 mon.a (mon.0) 9260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: audit 2024-09-21T02:34:52.529176+0000 mon.a (mon.0) 9261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: audit 2024-09-21T02:34:52.748286+0000 mon.a (mon.0) 9262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: audit 2024-09-21T02:34:52.756574+0000 mon.a (mon.0) 9263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: audit 2024-09-21T02:34:52.766042+0000 mon.a (mon.0) 9264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: audit 2024-09-21T02:34:52.782165+0000 mgr.a (mgr.14388) 11269 : audit [DBG] from='client.247638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:53 smithi179 bash[23186]: cluster 2024-09-21T02:34:53.413108+0000 mgr.a (mgr.14388) 11270 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:56 smithi049 bash[23528]: cluster 2024-09-21T02:34:55.415306+0000 mgr.a (mgr.14388) 11271 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:56 smithi044 bash[22676]: cluster 2024-09-21T02:34:55.415306+0000 mgr.a (mgr.14388) 11271 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:56.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:56 smithi179 bash[23186]: cluster 2024-09-21T02:34:55.415306+0000 mgr.a (mgr.14388) 11271 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:34:57.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:34:57 smithi049 bash[23528]: cluster 2024-09-21T02:34:57.416077+0000 mgr.a (mgr.14388) 11272 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:34:57 smithi044 bash[22676]: cluster 2024-09-21T02:34:57.416077+0000 mgr.a (mgr.14388) 11272 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:57.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:34:57 smithi179 bash[23186]: cluster 2024-09-21T02:34:57.416077+0000 mgr.a (mgr.14388) 11272 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:34:58.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:34:58.226 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:34:58.226 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:34:58.985 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:34:58.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:34:58.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:34:58.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:34:58.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:00 smithi044 bash[22676]: audit 2024-09-21T02:34:58.556765+0000 mgr.a (mgr.14388) 11273 : audit [DBG] from='client.247713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:00 smithi044 bash[22676]: cluster 2024-09-21T02:34:59.417058+0000 mgr.a (mgr.14388) 11274 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:00 smithi044 bash[22676]: audit 2024-09-21T02:35:00.160605+0000 mon.a (mon.0) 9265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:00 smithi044 bash[22676]: audit 2024-09-21T02:35:00.169689+0000 mon.a (mon.0) 9266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:00 smithi044 bash[22676]: audit 2024-09-21T02:35:00.180783+0000 mon.a (mon.0) 9267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:00 smithi179 bash[23186]: audit 2024-09-21T02:34:58.556765+0000 mgr.a (mgr.14388) 11273 : audit [DBG] from='client.247713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:00 smithi179 bash[23186]: cluster 2024-09-21T02:34:59.417058+0000 mgr.a (mgr.14388) 11274 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:00 smithi179 bash[23186]: audit 2024-09-21T02:35:00.160605+0000 mon.a (mon.0) 9265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:00 smithi179 bash[23186]: audit 2024-09-21T02:35:00.169689+0000 mon.a (mon.0) 9266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:00 smithi179 bash[23186]: audit 2024-09-21T02:35:00.180783+0000 mon.a (mon.0) 9267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:00 smithi049 bash[23528]: audit 2024-09-21T02:34:58.556765+0000 mgr.a (mgr.14388) 11273 : audit [DBG] from='client.247713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:00 smithi049 bash[23528]: cluster 2024-09-21T02:34:59.417058+0000 mgr.a (mgr.14388) 11274 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:00 smithi049 bash[23528]: audit 2024-09-21T02:35:00.160605+0000 mon.a (mon.0) 9265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:00 smithi049 bash[23528]: audit 2024-09-21T02:35:00.169689+0000 mon.a (mon.0) 9266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:00 smithi049 bash[23528]: audit 2024-09-21T02:35:00.180783+0000 mon.a (mon.0) 9267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:01 smithi044 bash[22676]: cluster 2024-09-21T02:35:01.419309+0000 mgr.a (mgr.14388) 11275 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:01 smithi179 bash[23186]: cluster 2024-09-21T02:35:01.419309+0000 mgr.a (mgr.14388) 11275 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:01 smithi049 bash[23528]: cluster 2024-09-21T02:35:01.419309+0000 mgr.a (mgr.14388) 11275 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:03 smithi049 bash[23528]: cluster 2024-09-21T02:35:03.420093+0000 mgr.a (mgr.14388) 11276 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:03 smithi044 bash[22676]: cluster 2024-09-21T02:35:03.420093+0000 mgr.a (mgr.14388) 11276 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:03.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:03.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:03.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:03 smithi179 bash[23186]: cluster 2024-09-21T02:35:03.420093+0000 mgr.a (mgr.14388) 11276 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:04 smithi179 bash[23186]: audit 2024-09-21T02:35:04.326114+0000 mgr.a (mgr.14388) 11277 : audit [DBG] from='client.247788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:04 smithi179 bash[23186]: audit 2024-09-21T02:35:04.513793+0000 mon.a (mon.0) 9268 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:35:04.771 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:04 smithi049 bash[23528]: audit 2024-09-21T02:35:04.326114+0000 mgr.a (mgr.14388) 11277 : audit [DBG] from='client.247788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:04 smithi049 bash[23528]: audit 2024-09-21T02:35:04.513793+0000 mon.a (mon.0) 9268 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:35:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:04 smithi044 bash[22676]: audit 2024-09-21T02:35:04.326114+0000 mgr.a (mgr.14388) 11277 : audit [DBG] from='client.247788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:04 smithi044 bash[22676]: audit 2024-09-21T02:35:04.513793+0000 mon.a (mon.0) 9268 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:35:05.985 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:35:05 smithi044 bash[22930]: debug 2024-09-21T02:35:05.885+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:35:05.985 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:35:05 smithi044 bash[22930]: debug 2024-09-21T02:35:05.885+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:35:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: audit 2024-09-21T02:35:05.089102+0000 mon.a (mon.0) 9269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: audit 2024-09-21T02:35:05.097457+0000 mon.a (mon.0) 9270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: audit 2024-09-21T02:35:05.100368+0000 mon.a (mon.0) 9271 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:35:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: audit 2024-09-21T02:35:05.102154+0000 mon.a (mon.0) 9272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:35:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: audit 2024-09-21T02:35:05.112652+0000 mon.a (mon.0) 9273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: audit 2024-09-21T02:35:05.119036+0000 mon.a (mon.0) 9274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:35:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: audit 2024-09-21T02:35:05.121684+0000 mgr.a (mgr.14388) 11278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:35:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:06 smithi044 bash[22676]: cluster 2024-09-21T02:35:05.421402+0000 mgr.a (mgr.14388) 11279 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: audit 2024-09-21T02:35:05.089102+0000 mon.a (mon.0) 9269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: audit 2024-09-21T02:35:05.097457+0000 mon.a (mon.0) 9270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: audit 2024-09-21T02:35:05.100368+0000 mon.a (mon.0) 9271 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:35:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: audit 2024-09-21T02:35:05.102154+0000 mon.a (mon.0) 9272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:35:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: audit 2024-09-21T02:35:05.112652+0000 mon.a (mon.0) 9273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: audit 2024-09-21T02:35:05.119036+0000 mon.a (mon.0) 9274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:35:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: audit 2024-09-21T02:35:05.121684+0000 mgr.a (mgr.14388) 11278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:35:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:06 smithi179 bash[23186]: cluster 2024-09-21T02:35:05.421402+0000 mgr.a (mgr.14388) 11279 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: audit 2024-09-21T02:35:05.089102+0000 mon.a (mon.0) 9269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: audit 2024-09-21T02:35:05.097457+0000 mon.a (mon.0) 9270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: audit 2024-09-21T02:35:05.100368+0000 mon.a (mon.0) 9271 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:35:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: audit 2024-09-21T02:35:05.102154+0000 mon.a (mon.0) 9272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:35:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: audit 2024-09-21T02:35:05.112652+0000 mon.a (mon.0) 9273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: audit 2024-09-21T02:35:05.119036+0000 mon.a (mon.0) 9274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:35:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: audit 2024-09-21T02:35:05.121684+0000 mgr.a (mgr.14388) 11278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:35:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:06 smithi049 bash[23528]: cluster 2024-09-21T02:35:05.421402+0000 mgr.a (mgr.14388) 11279 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:07 smithi044 bash[22676]: audit 2024-09-21T02:35:05.887082+0000 mgr.a (mgr.14388) 11280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:35:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:07 smithi044 bash[22676]: cephadm 2024-09-21T02:35:05.888202+0000 mgr.a (mgr.14388) 11281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:35:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:07 smithi179 bash[23186]: audit 2024-09-21T02:35:05.887082+0000 mgr.a (mgr.14388) 11280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:35:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:07 smithi179 bash[23186]: cephadm 2024-09-21T02:35:05.888202+0000 mgr.a (mgr.14388) 11281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:35:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:07 smithi049 bash[23528]: audit 2024-09-21T02:35:05.887082+0000 mgr.a (mgr.14388) 11280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:35:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:07 smithi049 bash[23528]: cephadm 2024-09-21T02:35:05.888202+0000 mgr.a (mgr.14388) 11281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:35:08.442 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:08 smithi044 bash[22676]: cluster 2024-09-21T02:35:07.422301+0000 mgr.a (mgr.14388) 11282 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:08 smithi179 bash[23186]: cluster 2024-09-21T02:35:07.422301+0000 mgr.a (mgr.14388) 11282 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:08 smithi049 bash[23528]: cluster 2024-09-21T02:35:07.422301+0000 mgr.a (mgr.14388) 11282 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:09 smithi049 bash[23528]: cluster 2024-09-21T02:35:09.423112+0000 mgr.a (mgr.14388) 11283 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:09 smithi044 bash[22676]: cluster 2024-09-21T02:35:09.423112+0000 mgr.a (mgr.14388) 11283 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:09 smithi179 bash[23186]: cluster 2024-09-21T02:35:09.423112+0000 mgr.a (mgr.14388) 11283 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:10.559 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:10.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:10.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:10.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:10.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:10 smithi049 bash[23528]: audit 2024-09-21T02:35:10.110876+0000 mgr.a (mgr.14388) 11284 : audit [DBG] from='client.247968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:10 smithi044 bash[22676]: audit 2024-09-21T02:35:10.110876+0000 mgr.a (mgr.14388) 11284 : audit [DBG] from='client.247968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:11.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:10 smithi179 bash[23186]: audit 2024-09-21T02:35:10.110876+0000 mgr.a (mgr.14388) 11284 : audit [DBG] from='client.247968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:11 smithi049 bash[23528]: cluster 2024-09-21T02:35:11.425986+0000 mgr.a (mgr.14388) 11285 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:11 smithi044 bash[22676]: cluster 2024-09-21T02:35:11.425986+0000 mgr.a (mgr.14388) 11285 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:12.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:11 smithi179 bash[23186]: cluster 2024-09-21T02:35:11.425986+0000 mgr.a (mgr.14388) 11285 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:13 smithi049 bash[23528]: audit 2024-09-21T02:35:12.754753+0000 mon.a (mon.0) 9275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:13 smithi049 bash[23528]: audit 2024-09-21T02:35:12.762967+0000 mon.a (mon.0) 9276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:13 smithi049 bash[23528]: audit 2024-09-21T02:35:12.773631+0000 mon.a (mon.0) 9277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:13 smithi049 bash[23528]: audit 2024-09-21T02:35:12.973988+0000 mon.a (mon.0) 9278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:13 smithi049 bash[23528]: audit 2024-09-21T02:35:12.983820+0000 mon.a (mon.0) 9279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:13 smithi049 bash[23528]: audit 2024-09-21T02:35:12.994376+0000 mon.a (mon.0) 9280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:13 smithi049 bash[23528]: cluster 2024-09-21T02:35:13.426753+0000 mgr.a (mgr.14388) 11286 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:13 smithi044 bash[22676]: audit 2024-09-21T02:35:12.754753+0000 mon.a (mon.0) 9275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:13 smithi044 bash[22676]: audit 2024-09-21T02:35:12.762967+0000 mon.a (mon.0) 9276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:13 smithi044 bash[22676]: audit 2024-09-21T02:35:12.773631+0000 mon.a (mon.0) 9277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:13 smithi044 bash[22676]: audit 2024-09-21T02:35:12.973988+0000 mon.a (mon.0) 9278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:13 smithi044 bash[22676]: audit 2024-09-21T02:35:12.983820+0000 mon.a (mon.0) 9279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:13 smithi044 bash[22676]: audit 2024-09-21T02:35:12.994376+0000 mon.a (mon.0) 9280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:13 smithi044 bash[22676]: cluster 2024-09-21T02:35:13.426753+0000 mgr.a (mgr.14388) 11286 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:13 smithi179 bash[23186]: audit 2024-09-21T02:35:12.754753+0000 mon.a (mon.0) 9275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:13 smithi179 bash[23186]: audit 2024-09-21T02:35:12.762967+0000 mon.a (mon.0) 9276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:13 smithi179 bash[23186]: audit 2024-09-21T02:35:12.773631+0000 mon.a (mon.0) 9277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:13 smithi179 bash[23186]: audit 2024-09-21T02:35:12.973988+0000 mon.a (mon.0) 9278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:13 smithi179 bash[23186]: audit 2024-09-21T02:35:12.983820+0000 mon.a (mon.0) 9279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:13 smithi179 bash[23186]: audit 2024-09-21T02:35:12.994376+0000 mon.a (mon.0) 9280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:13 smithi179 bash[23186]: cluster 2024-09-21T02:35:13.426753+0000 mgr.a (mgr.14388) 11286 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:15.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:15.561 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:15.561 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:15 smithi049 bash[23528]: cluster 2024-09-21T02:35:15.428662+0000 mgr.a (mgr.14388) 11287 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:15 smithi044 bash[22676]: cluster 2024-09-21T02:35:15.428662+0000 mgr.a (mgr.14388) 11287 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:16.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:15 smithi179 bash[23186]: cluster 2024-09-21T02:35:15.428662+0000 mgr.a (mgr.14388) 11287 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:16.347 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:16.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:16 smithi049 bash[23528]: audit 2024-09-21T02:35:15.901821+0000 mgr.a (mgr.14388) 11288 : audit [DBG] from='client.248046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:16 smithi044 bash[22676]: audit 2024-09-21T02:35:15.901821+0000 mgr.a (mgr.14388) 11288 : audit [DBG] from='client.248046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:16 smithi179 bash[23186]: audit 2024-09-21T02:35:15.901821+0000 mgr.a (mgr.14388) 11288 : audit [DBG] from='client.248046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:17 smithi049 bash[23528]: cluster 2024-09-21T02:35:17.429704+0000 mgr.a (mgr.14388) 11289 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:17 smithi044 bash[22676]: cluster 2024-09-21T02:35:17.429704+0000 mgr.a (mgr.14388) 11289 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:17 smithi179 bash[23186]: cluster 2024-09-21T02:35:17.429704+0000 mgr.a (mgr.14388) 11289 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:19 smithi049 bash[23528]: cluster 2024-09-21T02:35:19.430535+0000 mgr.a (mgr.14388) 11290 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:19 smithi044 bash[22676]: cluster 2024-09-21T02:35:19.430535+0000 mgr.a (mgr.14388) 11290 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:19 smithi179 bash[23186]: cluster 2024-09-21T02:35:19.430535+0000 mgr.a (mgr.14388) 11290 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:35:21.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:21.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:21 smithi044 bash[22676]: audit 2024-09-21T02:35:20.372131+0000 mon.a (mon.0) 9281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:21 smithi044 bash[22676]: audit 2024-09-21T02:35:20.382008+0000 mon.a (mon.0) 9282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:21 smithi044 bash[22676]: audit 2024-09-21T02:35:20.393777+0000 mon.a (mon.0) 9283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:21 smithi179 bash[23186]: audit 2024-09-21T02:35:20.372131+0000 mon.a (mon.0) 9281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:21 smithi179 bash[23186]: audit 2024-09-21T02:35:20.382008+0000 mon.a (mon.0) 9282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:21 smithi179 bash[23186]: audit 2024-09-21T02:35:20.393777+0000 mon.a (mon.0) 9283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:21 smithi049 bash[23528]: audit 2024-09-21T02:35:20.372131+0000 mon.a (mon.0) 9281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:21 smithi049 bash[23528]: audit 2024-09-21T02:35:20.382008+0000 mon.a (mon.0) 9282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:21 smithi049 bash[23528]: audit 2024-09-21T02:35:20.393777+0000 mon.a (mon.0) 9283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:22.122 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:22.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:22.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:22 smithi179 bash[23186]: cluster 2024-09-21T02:35:21.432702+0000 mgr.a (mgr.14388) 11291 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:22 smithi044 bash[22676]: cluster 2024-09-21T02:35:21.432702+0000 mgr.a (mgr.14388) 11291 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:22 smithi049 bash[23528]: cluster 2024-09-21T02:35:21.432702+0000 mgr.a (mgr.14388) 11291 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:35:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:23 smithi044 bash[22676]: audit 2024-09-21T02:35:21.687102+0000 mgr.a (mgr.14388) 11292 : audit [DBG] from='client.248124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:23.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:23 smithi179 bash[23186]: audit 2024-09-21T02:35:21.687102+0000 mgr.a (mgr.14388) 11292 : audit [DBG] from='client.248124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:23 smithi049 bash[23528]: audit 2024-09-21T02:35:21.687102+0000 mgr.a (mgr.14388) 11292 : audit [DBG] from='client.248124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:24 smithi044 bash[22676]: cluster 2024-09-21T02:35:23.433848+0000 mgr.a (mgr.14388) 11293 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:24 smithi179 bash[23186]: cluster 2024-09-21T02:35:23.433848+0000 mgr.a (mgr.14388) 11293 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:24 smithi049 bash[23528]: cluster 2024-09-21T02:35:23.433848+0000 mgr.a (mgr.14388) 11293 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:25 smithi049 bash[23528]: cluster 2024-09-21T02:35:25.436214+0000 mgr.a (mgr.14388) 11294 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:25.862 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:25 smithi044 bash[22676]: cluster 2024-09-21T02:35:25.436214+0000 mgr.a (mgr.14388) 11294 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:25 smithi179 bash[23186]: cluster 2024-09-21T02:35:25.436214+0000 mgr.a (mgr.14388) 11294 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:27.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:27 smithi049 bash[23528]: cluster 2024-09-21T02:35:27.436754+0000 mgr.a (mgr.14388) 11295 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:27 smithi049 bash[23528]: audit 2024-09-21T02:35:27.465443+0000 mgr.a (mgr.14388) 11296 : audit [DBG] from='client.248202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:27.916 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:27.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:27.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:27.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:27.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:27 smithi044 bash[22676]: cluster 2024-09-21T02:35:27.436754+0000 mgr.a (mgr.14388) 11295 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:27 smithi044 bash[22676]: audit 2024-09-21T02:35:27.465443+0000 mgr.a (mgr.14388) 11296 : audit [DBG] from='client.248202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:27 smithi179 bash[23186]: cluster 2024-09-21T02:35:27.436754+0000 mgr.a (mgr.14388) 11295 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:27 smithi179 bash[23186]: audit 2024-09-21T02:35:27.465443+0000 mgr.a (mgr.14388) 11296 : audit [DBG] from='client.248202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:29 smithi049 bash[23528]: cluster 2024-09-21T02:35:29.437682+0000 mgr.a (mgr.14388) 11297 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:29 smithi044 bash[22676]: cluster 2024-09-21T02:35:29.437682+0000 mgr.a (mgr.14388) 11297 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:29 smithi179 bash[23186]: cluster 2024-09-21T02:35:29.437682+0000 mgr.a (mgr.14388) 11297 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:31 smithi049 bash[23528]: cluster 2024-09-21T02:35:31.439917+0000 mgr.a (mgr.14388) 11298 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:31 smithi044 bash[22676]: cluster 2024-09-21T02:35:31.439917+0000 mgr.a (mgr.14388) 11298 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:32.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:31 smithi179 bash[23186]: cluster 2024-09-21T02:35:31.439917+0000 mgr.a (mgr.14388) 11298 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:32.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:32.918 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:32.918 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:33.728 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:33.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:33.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:33.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:33.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: audit 2024-09-21T02:35:32.950913+0000 mon.a (mon.0) 9284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: audit 2024-09-21T02:35:32.957517+0000 mon.a (mon.0) 9285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: audit 2024-09-21T02:35:32.965420+0000 mon.a (mon.0) 9286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: audit 2024-09-21T02:35:33.136904+0000 mon.a (mon.0) 9287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: audit 2024-09-21T02:35:33.145088+0000 mon.a (mon.0) 9288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: audit 2024-09-21T02:35:33.154480+0000 mon.a (mon.0) 9289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: audit 2024-09-21T02:35:33.264407+0000 mgr.a (mgr.14388) 11299 : audit [DBG] from='client.248280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:33 smithi044 bash[22676]: cluster 2024-09-21T02:35:33.440628+0000 mgr.a (mgr.14388) 11300 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: audit 2024-09-21T02:35:32.950913+0000 mon.a (mon.0) 9284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: audit 2024-09-21T02:35:32.957517+0000 mon.a (mon.0) 9285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: audit 2024-09-21T02:35:32.965420+0000 mon.a (mon.0) 9286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: audit 2024-09-21T02:35:33.136904+0000 mon.a (mon.0) 9287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: audit 2024-09-21T02:35:33.145088+0000 mon.a (mon.0) 9288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: audit 2024-09-21T02:35:33.154480+0000 mon.a (mon.0) 9289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: audit 2024-09-21T02:35:33.264407+0000 mgr.a (mgr.14388) 11299 : audit [DBG] from='client.248280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:33 smithi179 bash[23186]: cluster 2024-09-21T02:35:33.440628+0000 mgr.a (mgr.14388) 11300 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: audit 2024-09-21T02:35:32.950913+0000 mon.a (mon.0) 9284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: audit 2024-09-21T02:35:32.957517+0000 mon.a (mon.0) 9285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: audit 2024-09-21T02:35:32.965420+0000 mon.a (mon.0) 9286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: audit 2024-09-21T02:35:33.136904+0000 mon.a (mon.0) 9287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: audit 2024-09-21T02:35:33.145088+0000 mon.a (mon.0) 9288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: audit 2024-09-21T02:35:33.154480+0000 mon.a (mon.0) 9289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: audit 2024-09-21T02:35:33.264407+0000 mgr.a (mgr.14388) 11299 : audit [DBG] from='client.248280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:33 smithi049 bash[23528]: cluster 2024-09-21T02:35:33.440628+0000 mgr.a (mgr.14388) 11300 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:35 smithi049 bash[23528]: cluster 2024-09-21T02:35:35.443004+0000 mgr.a (mgr.14388) 11301 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:35 smithi044 bash[22676]: cluster 2024-09-21T02:35:35.443004+0000 mgr.a (mgr.14388) 11301 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:35 smithi179 bash[23186]: cluster 2024-09-21T02:35:35.443004+0000 mgr.a (mgr.14388) 11301 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:37.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:37 smithi049 bash[23528]: cluster 2024-09-21T02:35:37.443797+0000 mgr.a (mgr.14388) 11302 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:37 smithi044 bash[22676]: cluster 2024-09-21T02:35:37.443797+0000 mgr.a (mgr.14388) 11302 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:37 smithi179 bash[23186]: cluster 2024-09-21T02:35:37.443797+0000 mgr.a (mgr.14388) 11302 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:39.484 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:39.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:39.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:39.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:39 smithi049 bash[23528]: audit 2024-09-21T02:35:39.061708+0000 mgr.a (mgr.14388) 11303 : audit [DBG] from='client.248352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:39 smithi049 bash[23528]: cluster 2024-09-21T02:35:39.444390+0000 mgr.a (mgr.14388) 11304 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:39 smithi044 bash[22676]: audit 2024-09-21T02:35:39.061708+0000 mgr.a (mgr.14388) 11303 : audit [DBG] from='client.248352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:39 smithi044 bash[22676]: cluster 2024-09-21T02:35:39.444390+0000 mgr.a (mgr.14388) 11304 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:39 smithi179 bash[23186]: audit 2024-09-21T02:35:39.061708+0000 mgr.a (mgr.14388) 11303 : audit [DBG] from='client.248352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:39 smithi179 bash[23186]: cluster 2024-09-21T02:35:39.444390+0000 mgr.a (mgr.14388) 11304 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:41 smithi044 bash[22676]: audit 2024-09-21T02:35:40.555597+0000 mon.a (mon.0) 9290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:41 smithi044 bash[22676]: audit 2024-09-21T02:35:40.564509+0000 mon.a (mon.0) 9291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:41 smithi044 bash[22676]: audit 2024-09-21T02:35:40.575728+0000 mon.a (mon.0) 9292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:41 smithi044 bash[22676]: cluster 2024-09-21T02:35:41.446540+0000 mgr.a (mgr.14388) 11305 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:41 smithi179 bash[23186]: audit 2024-09-21T02:35:40.555597+0000 mon.a (mon.0) 9290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:41 smithi179 bash[23186]: audit 2024-09-21T02:35:40.564509+0000 mon.a (mon.0) 9291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:41 smithi179 bash[23186]: audit 2024-09-21T02:35:40.575728+0000 mon.a (mon.0) 9292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:41 smithi179 bash[23186]: cluster 2024-09-21T02:35:41.446540+0000 mgr.a (mgr.14388) 11305 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:41 smithi049 bash[23528]: audit 2024-09-21T02:35:40.555597+0000 mon.a (mon.0) 9290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:41 smithi049 bash[23528]: audit 2024-09-21T02:35:40.564509+0000 mon.a (mon.0) 9291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:41 smithi049 bash[23528]: audit 2024-09-21T02:35:40.575728+0000 mon.a (mon.0) 9292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:41 smithi049 bash[23528]: cluster 2024-09-21T02:35:41.446540+0000 mgr.a (mgr.14388) 11305 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:35:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:43 smithi049 bash[23528]: cluster 2024-09-21T02:35:43.447324+0000 mgr.a (mgr.14388) 11306 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:43.916 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:43 smithi179 bash[23186]: cluster 2024-09-21T02:35:43.447324+0000 mgr.a (mgr.14388) 11306 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:43 smithi044 bash[22676]: cluster 2024-09-21T02:35:43.447324+0000 mgr.a (mgr.14388) 11306 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:44.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:44.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:44.487 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:45.285 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:45.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:45.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:45.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:45.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:45 smithi049 bash[23528]: audit 2024-09-21T02:35:44.822845+0000 mgr.a (mgr.14388) 11307 : audit [DBG] from='client.248430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:45 smithi049 bash[23528]: cluster 2024-09-21T02:35:45.450189+0000 mgr.a (mgr.14388) 11308 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:45 smithi044 bash[22676]: audit 2024-09-21T02:35:44.822845+0000 mgr.a (mgr.14388) 11307 : audit [DBG] from='client.248430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:45 smithi044 bash[22676]: cluster 2024-09-21T02:35:45.450189+0000 mgr.a (mgr.14388) 11308 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:45 smithi179 bash[23186]: audit 2024-09-21T02:35:44.822845+0000 mgr.a (mgr.14388) 11307 : audit [DBG] from='client.248430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:45 smithi179 bash[23186]: cluster 2024-09-21T02:35:45.450189+0000 mgr.a (mgr.14388) 11308 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:35:47.786 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:47 smithi044 bash[22676]: cluster 2024-09-21T02:35:47.451027+0000 mgr.a (mgr.14388) 11309 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:35:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:47 smithi049 bash[23528]: cluster 2024-09-21T02:35:47.451027+0000 mgr.a (mgr.14388) 11309 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:35:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:47 smithi179 bash[23186]: cluster 2024-09-21T02:35:47.451027+0000 mgr.a (mgr.14388) 11309 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:35:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:49 smithi049 bash[23528]: cluster 2024-09-21T02:35:49.451816+0000 mgr.a (mgr.14388) 11310 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:35:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:49 smithi044 bash[22676]: cluster 2024-09-21T02:35:49.451816+0000 mgr.a (mgr.14388) 11310 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:35:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:49 smithi179 bash[23186]: cluster 2024-09-21T02:35:49.451816+0000 mgr.a (mgr.14388) 11310 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:35:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:51.046 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:51.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:51 smithi049 bash[23528]: audit 2024-09-21T02:35:50.622907+0000 mgr.a (mgr.14388) 11311 : audit [DBG] from='client.248508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:51 smithi049 bash[23528]: cluster 2024-09-21T02:35:51.454690+0000 mgr.a (mgr.14388) 11312 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:51 smithi044 bash[22676]: audit 2024-09-21T02:35:50.622907+0000 mgr.a (mgr.14388) 11311 : audit [DBG] from='client.248508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:51 smithi044 bash[22676]: cluster 2024-09-21T02:35:51.454690+0000 mgr.a (mgr.14388) 11312 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:51 smithi179 bash[23186]: audit 2024-09-21T02:35:50.622907+0000 mgr.a (mgr.14388) 11311 : audit [DBG] from='client.248508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:51 smithi179 bash[23186]: cluster 2024-09-21T02:35:51.454690+0000 mgr.a (mgr.14388) 11312 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:54 smithi044 bash[22676]: audit 2024-09-21T02:35:53.125736+0000 mon.a (mon.0) 9293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:54 smithi044 bash[22676]: audit 2024-09-21T02:35:53.130869+0000 mon.a (mon.0) 9294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:54 smithi044 bash[22676]: audit 2024-09-21T02:35:53.136748+0000 mon.a (mon.0) 9295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:54 smithi044 bash[22676]: audit 2024-09-21T02:35:53.356468+0000 mon.a (mon.0) 9296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:54 smithi044 bash[22676]: audit 2024-09-21T02:35:53.364954+0000 mon.a (mon.0) 9297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:54 smithi044 bash[22676]: audit 2024-09-21T02:35:53.374881+0000 mon.a (mon.0) 9298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:54 smithi044 bash[22676]: cluster 2024-09-21T02:35:53.455489+0000 mgr.a (mgr.14388) 11313 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:35:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:54 smithi179 bash[23186]: audit 2024-09-21T02:35:53.125736+0000 mon.a (mon.0) 9293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:54 smithi179 bash[23186]: audit 2024-09-21T02:35:53.130869+0000 mon.a (mon.0) 9294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:54 smithi179 bash[23186]: audit 2024-09-21T02:35:53.136748+0000 mon.a (mon.0) 9295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:54 smithi179 bash[23186]: audit 2024-09-21T02:35:53.356468+0000 mon.a (mon.0) 9296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:54 smithi179 bash[23186]: audit 2024-09-21T02:35:53.364954+0000 mon.a (mon.0) 9297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:54 smithi179 bash[23186]: audit 2024-09-21T02:35:53.374881+0000 mon.a (mon.0) 9298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:54 smithi179 bash[23186]: cluster 2024-09-21T02:35:53.455489+0000 mgr.a (mgr.14388) 11313 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:35:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:54 smithi049 bash[23528]: audit 2024-09-21T02:35:53.125736+0000 mon.a (mon.0) 9293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:54 smithi049 bash[23528]: audit 2024-09-21T02:35:53.130869+0000 mon.a (mon.0) 9294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:54 smithi049 bash[23528]: audit 2024-09-21T02:35:53.136748+0000 mon.a (mon.0) 9295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:54 smithi049 bash[23528]: audit 2024-09-21T02:35:53.356468+0000 mon.a (mon.0) 9296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:54 smithi049 bash[23528]: audit 2024-09-21T02:35:53.364954+0000 mon.a (mon.0) 9297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:54 smithi049 bash[23528]: audit 2024-09-21T02:35:53.374881+0000 mon.a (mon.0) 9298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:35:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:54 smithi049 bash[23528]: cluster 2024-09-21T02:35:53.455489+0000 mgr.a (mgr.14388) 11313 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:35:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:55 smithi049 bash[23528]: cluster 2024-09-21T02:35:55.457529+0000 mgr.a (mgr.14388) 11314 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:55 smithi044 bash[22676]: cluster 2024-09-21T02:35:55.457529+0000 mgr.a (mgr.14388) 11314 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:55 smithi179 bash[23186]: cluster 2024-09-21T02:35:55.457529+0000 mgr.a (mgr.14388) 11314 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:56.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:35:56.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:35:56.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:35:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:56 smithi049 bash[23528]: audit 2024-09-21T02:35:56.384079+0000 mgr.a (mgr.14388) 11315 : audit [DBG] from='client.248586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:56.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:35:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:35:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:35:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:35:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:35:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:56 smithi044 bash[22676]: audit 2024-09-21T02:35:56.384079+0000 mgr.a (mgr.14388) 11315 : audit [DBG] from='client.248586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:57.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:56 smithi179 bash[23186]: audit 2024-09-21T02:35:56.384079+0000 mgr.a (mgr.14388) 11315 : audit [DBG] from='client.248586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:57 smithi049 bash[23528]: cluster 2024-09-21T02:35:57.458647+0000 mgr.a (mgr.14388) 11316 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:57 smithi044 bash[22676]: cluster 2024-09-21T02:35:57.458647+0000 mgr.a (mgr.14388) 11316 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:57 smithi179 bash[23186]: cluster 2024-09-21T02:35:57.458647+0000 mgr.a (mgr.14388) 11316 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:35:59 smithi049 bash[23528]: cluster 2024-09-21T02:35:59.459653+0000 mgr.a (mgr.14388) 11317 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:35:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:35:59 smithi044 bash[22676]: cluster 2024-09-21T02:35:59.459653+0000 mgr.a (mgr.14388) 11317 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:36:00.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:35:59 smithi179 bash[23186]: cluster 2024-09-21T02:35:59.459653+0000 mgr.a (mgr.14388) 11317 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:36:01.804 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:01.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:01.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:01 smithi044 bash[22676]: audit 2024-09-21T02:36:00.710299+0000 mon.a (mon.0) 9299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:01 smithi044 bash[22676]: audit 2024-09-21T02:36:00.719408+0000 mon.a (mon.0) 9300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:01 smithi044 bash[22676]: audit 2024-09-21T02:36:00.729929+0000 mon.a (mon.0) 9301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:01 smithi044 bash[22676]: cluster 2024-09-21T02:36:01.461916+0000 mgr.a (mgr.14388) 11318 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:36:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:01 smithi179 bash[23186]: audit 2024-09-21T02:36:00.710299+0000 mon.a (mon.0) 9299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:01 smithi179 bash[23186]: audit 2024-09-21T02:36:00.719408+0000 mon.a (mon.0) 9300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:01 smithi179 bash[23186]: audit 2024-09-21T02:36:00.729929+0000 mon.a (mon.0) 9301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:01 smithi179 bash[23186]: cluster 2024-09-21T02:36:01.461916+0000 mgr.a (mgr.14388) 11318 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:36:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:01 smithi049 bash[23528]: audit 2024-09-21T02:36:00.710299+0000 mon.a (mon.0) 9299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:01 smithi049 bash[23528]: audit 2024-09-21T02:36:00.719408+0000 mon.a (mon.0) 9300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:01 smithi049 bash[23528]: audit 2024-09-21T02:36:00.729929+0000 mon.a (mon.0) 9301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:01 smithi049 bash[23528]: cluster 2024-09-21T02:36:01.461916+0000 mgr.a (mgr.14388) 11318 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:02.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:02 smithi044 bash[22676]: audit 2024-09-21T02:36:02.141476+0000 mgr.a (mgr.14388) 11319 : audit [DBG] from='client.248658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:03.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:02 smithi179 bash[23186]: audit 2024-09-21T02:36:02.141476+0000 mgr.a (mgr.14388) 11319 : audit [DBG] from='client.248658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:02 smithi049 bash[23528]: audit 2024-09-21T02:36:02.141476+0000 mgr.a (mgr.14388) 11319 : audit [DBG] from='client.248658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:03 smithi179 bash[23186]: cluster 2024-09-21T02:36:03.462895+0000 mgr.a (mgr.14388) 11320 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:03 smithi049 bash[23528]: cluster 2024-09-21T02:36:03.462895+0000 mgr.a (mgr.14388) 11320 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:03 smithi044 bash[22676]: cluster 2024-09-21T02:36:03.462895+0000 mgr.a (mgr.14388) 11320 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:05 smithi049 bash[23528]: cluster 2024-09-21T02:36:05.465340+0000 mgr.a (mgr.14388) 11321 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:36:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:05 smithi044 bash[22676]: cluster 2024-09-21T02:36:05.465340+0000 mgr.a (mgr.14388) 11321 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:36:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:05 smithi179 bash[23186]: cluster 2024-09-21T02:36:05.465340+0000 mgr.a (mgr.14388) 11321 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T02:36:06.617 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22676]: audit 2024-09-21T02:36:05.937303+0000 mon.a (mon.0) 9302 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:36:06.617 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22676]: audit 2024-09-21T02:36:05.944563+0000 mon.a (mon.0) 9303 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:36:06.617 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22676]: audit 2024-09-21T02:36:05.946435+0000 mon.a (mon.0) 9304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:36:06.617 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22676]: audit 2024-09-21T02:36:05.958055+0000 mon.a (mon.0) 9305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:06.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22676]: audit 2024-09-21T02:36:05.964609+0000 mon.a (mon.0) 9306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:36:06.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22676]: audit 2024-09-21T02:36:05.967178+0000 mgr.a (mgr.14388) 11322 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:36:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:06 smithi049 bash[23528]: audit 2024-09-21T02:36:05.937303+0000 mon.a (mon.0) 9302 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:36:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:06 smithi049 bash[23528]: audit 2024-09-21T02:36:05.944563+0000 mon.a (mon.0) 9303 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:36:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:06 smithi049 bash[23528]: audit 2024-09-21T02:36:05.946435+0000 mon.a (mon.0) 9304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:36:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:06 smithi049 bash[23528]: audit 2024-09-21T02:36:05.958055+0000 mon.a (mon.0) 9305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:06 smithi049 bash[23528]: audit 2024-09-21T02:36:05.964609+0000 mon.a (mon.0) 9306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:36:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:06 smithi049 bash[23528]: audit 2024-09-21T02:36:05.967178+0000 mgr.a (mgr.14388) 11322 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:36:06.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22930]: debug 2024-09-21T02:36:06.792+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:36:06.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:36:06 smithi044 bash[22930]: debug 2024-09-21T02:36:06.792+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:36:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:06 smithi179 bash[23186]: audit 2024-09-21T02:36:05.937303+0000 mon.a (mon.0) 9302 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:36:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:06 smithi179 bash[23186]: audit 2024-09-21T02:36:05.944563+0000 mon.a (mon.0) 9303 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:36:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:06 smithi179 bash[23186]: audit 2024-09-21T02:36:05.946435+0000 mon.a (mon.0) 9304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:36:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:06 smithi179 bash[23186]: audit 2024-09-21T02:36:05.958055+0000 mon.a (mon.0) 9305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:06 smithi179 bash[23186]: audit 2024-09-21T02:36:05.964609+0000 mon.a (mon.0) 9306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:36:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:06 smithi179 bash[23186]: audit 2024-09-21T02:36:05.967178+0000 mgr.a (mgr.14388) 11322 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:36:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:07 smithi049 bash[23528]: audit 2024-09-21T02:36:06.794075+0000 mgr.a (mgr.14388) 11323 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:36:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:07 smithi049 bash[23528]: cephadm 2024-09-21T02:36:06.795759+0000 mgr.a (mgr.14388) 11324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:36:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:07 smithi049 bash[23528]: cluster 2024-09-21T02:36:07.466362+0000 mgr.a (mgr.14388) 11325 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:36:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:07 smithi044 bash[22676]: audit 2024-09-21T02:36:06.794075+0000 mgr.a (mgr.14388) 11323 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:36:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:07 smithi044 bash[22676]: cephadm 2024-09-21T02:36:06.795759+0000 mgr.a (mgr.14388) 11324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:36:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:07 smithi044 bash[22676]: cluster 2024-09-21T02:36:07.466362+0000 mgr.a (mgr.14388) 11325 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:36:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:07 smithi179 bash[23186]: audit 2024-09-21T02:36:06.794075+0000 mgr.a (mgr.14388) 11323 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:36:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:07 smithi179 bash[23186]: cephadm 2024-09-21T02:36:06.795759+0000 mgr.a (mgr.14388) 11324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:36:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:07 smithi179 bash[23186]: cluster 2024-09-21T02:36:07.466362+0000 mgr.a (mgr.14388) 11325 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:36:08.391 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:08.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:08.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:08.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:08.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:08 smithi044 bash[22676]: audit 2024-09-21T02:36:07.934435+0000 mgr.a (mgr.14388) 11326 : audit [DBG] from='client.248844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:08 smithi049 bash[23528]: audit 2024-09-21T02:36:07.934435+0000 mgr.a (mgr.14388) 11326 : audit [DBG] from='client.248844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:08 smithi179 bash[23186]: audit 2024-09-21T02:36:07.934435+0000 mgr.a (mgr.14388) 11326 : audit [DBG] from='client.248844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:09 smithi044 bash[22676]: cluster 2024-09-21T02:36:09.467338+0000 mgr.a (mgr.14388) 11327 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:36:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:09 smithi179 bash[23186]: cluster 2024-09-21T02:36:09.467338+0000 mgr.a (mgr.14388) 11327 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:36:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:09 smithi049 bash[23528]: cluster 2024-09-21T02:36:09.467338+0000 mgr.a (mgr.14388) 11327 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:36:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:11 smithi049 bash[23528]: cluster 2024-09-21T02:36:11.469580+0000 mgr.a (mgr.14388) 11328 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T02:36:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:11 smithi044 bash[22676]: cluster 2024-09-21T02:36:11.469580+0000 mgr.a (mgr.14388) 11328 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T02:36:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:11 smithi179 bash[23186]: cluster 2024-09-21T02:36:11.469580+0000 mgr.a (mgr.14388) 11328 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T02:36:13.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:13.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:13.394 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:14.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:14.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:14.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:14.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:14.152 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:14 smithi179 bash[23186]: audit 2024-09-21T02:36:13.357615+0000 mon.a (mon.0) 9307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:14 smithi179 bash[23186]: audit 2024-09-21T02:36:13.366928+0000 mon.a (mon.0) 9308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:14 smithi179 bash[23186]: audit 2024-09-21T02:36:13.378611+0000 mon.a (mon.0) 9309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:14 smithi179 bash[23186]: cluster 2024-09-21T02:36:13.470197+0000 mgr.a (mgr.14388) 11329 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T02:36:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:14 smithi179 bash[23186]: audit 2024-09-21T02:36:13.574587+0000 mon.a (mon.0) 9310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:14 smithi179 bash[23186]: audit 2024-09-21T02:36:13.584201+0000 mon.a (mon.0) 9311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:14 smithi179 bash[23186]: audit 2024-09-21T02:36:13.595681+0000 mon.a (mon.0) 9312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:14 smithi044 bash[22676]: audit 2024-09-21T02:36:13.357615+0000 mon.a (mon.0) 9307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:14 smithi044 bash[22676]: audit 2024-09-21T02:36:13.366928+0000 mon.a (mon.0) 9308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:14 smithi044 bash[22676]: audit 2024-09-21T02:36:13.378611+0000 mon.a (mon.0) 9309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:14 smithi044 bash[22676]: cluster 2024-09-21T02:36:13.470197+0000 mgr.a (mgr.14388) 11329 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T02:36:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:14 smithi044 bash[22676]: audit 2024-09-21T02:36:13.574587+0000 mon.a (mon.0) 9310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:14 smithi044 bash[22676]: audit 2024-09-21T02:36:13.584201+0000 mon.a (mon.0) 9311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:14 smithi044 bash[22676]: audit 2024-09-21T02:36:13.595681+0000 mon.a (mon.0) 9312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:14 smithi049 bash[23528]: audit 2024-09-21T02:36:13.357615+0000 mon.a (mon.0) 9307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:14 smithi049 bash[23528]: audit 2024-09-21T02:36:13.366928+0000 mon.a (mon.0) 9308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:14 smithi049 bash[23528]: audit 2024-09-21T02:36:13.378611+0000 mon.a (mon.0) 9309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:14 smithi049 bash[23528]: cluster 2024-09-21T02:36:13.470197+0000 mgr.a (mgr.14388) 11329 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T02:36:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:14 smithi049 bash[23528]: audit 2024-09-21T02:36:13.574587+0000 mon.a (mon.0) 9310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:14 smithi049 bash[23528]: audit 2024-09-21T02:36:13.584201+0000 mon.a (mon.0) 9311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:14 smithi049 bash[23528]: audit 2024-09-21T02:36:13.595681+0000 mon.a (mon.0) 9312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:15 smithi044 bash[22676]: audit 2024-09-21T02:36:13.733710+0000 mgr.a (mgr.14388) 11330 : audit [DBG] from='client.248919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:15 smithi179 bash[23186]: audit 2024-09-21T02:36:13.733710+0000 mgr.a (mgr.14388) 11330 : audit [DBG] from='client.248919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:15 smithi049 bash[23528]: audit 2024-09-21T02:36:13.733710+0000 mgr.a (mgr.14388) 11330 : audit [DBG] from='client.248919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:16 smithi044 bash[22676]: cluster 2024-09-21T02:36:15.472506+0000 mgr.a (mgr.14388) 11331 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T02:36:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:16 smithi179 bash[23186]: cluster 2024-09-21T02:36:15.472506+0000 mgr.a (mgr.14388) 11331 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T02:36:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:16 smithi049 bash[23528]: cluster 2024-09-21T02:36:15.472506+0000 mgr.a (mgr.14388) 11331 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T02:36:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:17 smithi049 bash[23528]: cluster 2024-09-21T02:36:17.473336+0000 mgr.a (mgr.14388) 11332 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:17 smithi044 bash[22676]: cluster 2024-09-21T02:36:17.473336+0000 mgr.a (mgr.14388) 11332 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:17 smithi179 bash[23186]: cluster 2024-09-21T02:36:17.473336+0000 mgr.a (mgr.14388) 11332 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:19.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:19.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:19.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:19 smithi049 bash[23528]: cluster 2024-09-21T02:36:19.474087+0000 mgr.a (mgr.14388) 11333 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:19 smithi044 bash[22676]: cluster 2024-09-21T02:36:19.474087+0000 mgr.a (mgr.14388) 11333 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:19 smithi179 bash[23186]: cluster 2024-09-21T02:36:19.474087+0000 mgr.a (mgr.14388) 11333 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:20 smithi049 bash[23528]: audit 2024-09-21T02:36:19.489111+0000 mgr.a (mgr.14388) 11334 : audit [DBG] from='client.248997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:20 smithi044 bash[22676]: audit 2024-09-21T02:36:19.489111+0000 mgr.a (mgr.14388) 11334 : audit [DBG] from='client.248997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:21.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:20 smithi179 bash[23186]: audit 2024-09-21T02:36:19.489111+0000 mgr.a (mgr.14388) 11334 : audit [DBG] from='client.248997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:21 smithi044 bash[22676]: audit 2024-09-21T02:36:20.890671+0000 mon.a (mon.0) 9313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:21 smithi044 bash[22676]: audit 2024-09-21T02:36:20.899457+0000 mon.a (mon.0) 9314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:21 smithi044 bash[22676]: audit 2024-09-21T02:36:20.910150+0000 mon.a (mon.0) 9315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:21 smithi044 bash[22676]: cluster 2024-09-21T02:36:21.476407+0000 mgr.a (mgr.14388) 11335 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:21 smithi179 bash[23186]: audit 2024-09-21T02:36:20.890671+0000 mon.a (mon.0) 9313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:21 smithi179 bash[23186]: audit 2024-09-21T02:36:20.899457+0000 mon.a (mon.0) 9314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:21 smithi179 bash[23186]: audit 2024-09-21T02:36:20.910150+0000 mon.a (mon.0) 9315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:21 smithi179 bash[23186]: cluster 2024-09-21T02:36:21.476407+0000 mgr.a (mgr.14388) 11335 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:21 smithi049 bash[23528]: audit 2024-09-21T02:36:20.890671+0000 mon.a (mon.0) 9313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:21 smithi049 bash[23528]: audit 2024-09-21T02:36:20.899457+0000 mon.a (mon.0) 9314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:21 smithi049 bash[23528]: audit 2024-09-21T02:36:20.910150+0000 mon.a (mon.0) 9315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:21 smithi049 bash[23528]: cluster 2024-09-21T02:36:21.476407+0000 mgr.a (mgr.14388) 11335 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 426 B/s wr, 55 op/s 2024-09-21T02:36:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:23 smithi049 bash[23528]: cluster 2024-09-21T02:36:23.477199+0000 mgr.a (mgr.14388) 11336 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:23 smithi044 bash[22676]: cluster 2024-09-21T02:36:23.477199+0000 mgr.a (mgr.14388) 11336 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:23 smithi179 bash[23186]: cluster 2024-09-21T02:36:23.477199+0000 mgr.a (mgr.14388) 11336 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:24.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:24.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:25.724 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:25.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:25 smithi049 bash[23528]: audit 2024-09-21T02:36:25.275633+0000 mgr.a (mgr.14388) 11337 : audit [DBG] from='client.249075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:25 smithi049 bash[23528]: cluster 2024-09-21T02:36:25.478624+0000 mgr.a (mgr.14388) 11338 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:25 smithi044 bash[22676]: audit 2024-09-21T02:36:25.275633+0000 mgr.a (mgr.14388) 11337 : audit [DBG] from='client.249075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:25 smithi044 bash[22676]: cluster 2024-09-21T02:36:25.478624+0000 mgr.a (mgr.14388) 11338 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:25 smithi179 bash[23186]: audit 2024-09-21T02:36:25.275633+0000 mgr.a (mgr.14388) 11337 : audit [DBG] from='client.249075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:25 smithi179 bash[23186]: cluster 2024-09-21T02:36:25.478624+0000 mgr.a (mgr.14388) 11338 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:27 smithi049 bash[23528]: cluster 2024-09-21T02:36:27.479239+0000 mgr.a (mgr.14388) 11339 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:27 smithi044 bash[22676]: cluster 2024-09-21T02:36:27.479239+0000 mgr.a (mgr.14388) 11339 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:27 smithi179 bash[23186]: cluster 2024-09-21T02:36:27.479239+0000 mgr.a (mgr.14388) 11339 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:29 smithi049 bash[23528]: cluster 2024-09-21T02:36:29.480031+0000 mgr.a (mgr.14388) 11340 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:29 smithi044 bash[22676]: cluster 2024-09-21T02:36:29.480031+0000 mgr.a (mgr.14388) 11340 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:29 smithi179 bash[23186]: cluster 2024-09-21T02:36:29.480031+0000 mgr.a (mgr.14388) 11340 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:31.485 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:31 smithi049 bash[23528]: audit 2024-09-21T02:36:31.067464+0000 mgr.a (mgr.14388) 11341 : audit [DBG] from='client.249150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:31 smithi049 bash[23528]: cluster 2024-09-21T02:36:31.481207+0000 mgr.a (mgr.14388) 11342 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:31 smithi044 bash[22676]: audit 2024-09-21T02:36:31.067464+0000 mgr.a (mgr.14388) 11341 : audit [DBG] from='client.249150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:31 smithi044 bash[22676]: cluster 2024-09-21T02:36:31.481207+0000 mgr.a (mgr.14388) 11342 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:31 smithi179 bash[23186]: audit 2024-09-21T02:36:31.067464+0000 mgr.a (mgr.14388) 11341 : audit [DBG] from='client.249150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:31 smithi179 bash[23186]: cluster 2024-09-21T02:36:31.481207+0000 mgr.a (mgr.14388) 11342 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:33 smithi049 bash[23528]: cluster 2024-09-21T02:36:33.481978+0000 mgr.a (mgr.14388) 11343 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:33.807 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:33 smithi179 bash[23186]: cluster 2024-09-21T02:36:33.481978+0000 mgr.a (mgr.14388) 11343 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:33 smithi044 bash[22676]: cluster 2024-09-21T02:36:33.481978+0000 mgr.a (mgr.14388) 11343 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:36:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:34 smithi044 bash[22676]: audit 2024-09-21T02:36:33.600345+0000 mon.a (mon.0) 9316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:34 smithi044 bash[22676]: audit 2024-09-21T02:36:33.607567+0000 mon.a (mon.0) 9317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:34 smithi044 bash[22676]: audit 2024-09-21T02:36:33.616707+0000 mon.a (mon.0) 9318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:34 smithi044 bash[22676]: audit 2024-09-21T02:36:33.787174+0000 mon.a (mon.0) 9319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:34 smithi044 bash[22676]: audit 2024-09-21T02:36:33.795800+0000 mon.a (mon.0) 9320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:34 smithi044 bash[22676]: audit 2024-09-21T02:36:33.806069+0000 mon.a (mon.0) 9321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:34 smithi179 bash[23186]: audit 2024-09-21T02:36:33.600345+0000 mon.a (mon.0) 9316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:34 smithi179 bash[23186]: audit 2024-09-21T02:36:33.607567+0000 mon.a (mon.0) 9317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:34 smithi179 bash[23186]: audit 2024-09-21T02:36:33.616707+0000 mon.a (mon.0) 9318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:34 smithi179 bash[23186]: audit 2024-09-21T02:36:33.787174+0000 mon.a (mon.0) 9319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:34 smithi179 bash[23186]: audit 2024-09-21T02:36:33.795800+0000 mon.a (mon.0) 9320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:34 smithi179 bash[23186]: audit 2024-09-21T02:36:33.806069+0000 mon.a (mon.0) 9321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:34 smithi049 bash[23528]: audit 2024-09-21T02:36:33.600345+0000 mon.a (mon.0) 9316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:34 smithi049 bash[23528]: audit 2024-09-21T02:36:33.607567+0000 mon.a (mon.0) 9317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:34 smithi049 bash[23528]: audit 2024-09-21T02:36:33.616707+0000 mon.a (mon.0) 9318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:34 smithi049 bash[23528]: audit 2024-09-21T02:36:33.787174+0000 mon.a (mon.0) 9319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:34 smithi049 bash[23528]: audit 2024-09-21T02:36:33.795800+0000 mon.a (mon.0) 9320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:34 smithi049 bash[23528]: audit 2024-09-21T02:36:33.806069+0000 mon.a (mon.0) 9321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:35 smithi044 bash[22676]: cluster 2024-09-21T02:36:35.484002+0000 mgr.a (mgr.14388) 11344 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:35 smithi179 bash[23186]: cluster 2024-09-21T02:36:35.484002+0000 mgr.a (mgr.14388) 11344 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:35 smithi049 bash[23528]: cluster 2024-09-21T02:36:35.484002+0000 mgr.a (mgr.14388) 11344 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:36.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:36.488 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:36.488 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:37.263 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:37.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:37 smithi049 bash[23528]: audit 2024-09-21T02:36:36.823299+0000 mgr.a (mgr.14388) 11345 : audit [DBG] from='client.249222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:37 smithi049 bash[23528]: cluster 2024-09-21T02:36:37.484970+0000 mgr.a (mgr.14388) 11346 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:37 smithi044 bash[22676]: audit 2024-09-21T02:36:36.823299+0000 mgr.a (mgr.14388) 11345 : audit [DBG] from='client.249222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:37 smithi044 bash[22676]: cluster 2024-09-21T02:36:37.484970+0000 mgr.a (mgr.14388) 11346 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:37 smithi179 bash[23186]: audit 2024-09-21T02:36:36.823299+0000 mgr.a (mgr.14388) 11345 : audit [DBG] from='client.249222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:37 smithi179 bash[23186]: cluster 2024-09-21T02:36:37.484970+0000 mgr.a (mgr.14388) 11346 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:39 smithi049 bash[23528]: cluster 2024-09-21T02:36:39.485803+0000 mgr.a (mgr.14388) 11347 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:39 smithi044 bash[22676]: cluster 2024-09-21T02:36:39.485803+0000 mgr.a (mgr.14388) 11347 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:40.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:39 smithi179 bash[23186]: cluster 2024-09-21T02:36:39.485803+0000 mgr.a (mgr.14388) 11347 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:42 smithi179 bash[23186]: audit 2024-09-21T02:36:41.077522+0000 mon.a (mon.0) 9322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:42 smithi179 bash[23186]: audit 2024-09-21T02:36:41.086466+0000 mon.a (mon.0) 9323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:42 smithi179 bash[23186]: audit 2024-09-21T02:36:41.097393+0000 mon.a (mon.0) 9324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:42 smithi179 bash[23186]: cluster 2024-09-21T02:36:41.488134+0000 mgr.a (mgr.14388) 11348 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:42.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:42.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:42.265 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:42 smithi044 bash[22676]: audit 2024-09-21T02:36:41.077522+0000 mon.a (mon.0) 9322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:42 smithi044 bash[22676]: audit 2024-09-21T02:36:41.086466+0000 mon.a (mon.0) 9323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:42 smithi044 bash[22676]: audit 2024-09-21T02:36:41.097393+0000 mon.a (mon.0) 9324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:42 smithi044 bash[22676]: cluster 2024-09-21T02:36:41.488134+0000 mgr.a (mgr.14388) 11348 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:42 smithi049 bash[23528]: audit 2024-09-21T02:36:41.077522+0000 mon.a (mon.0) 9322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:42 smithi049 bash[23528]: audit 2024-09-21T02:36:41.086466+0000 mon.a (mon.0) 9323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:42 smithi049 bash[23528]: audit 2024-09-21T02:36:41.097393+0000 mon.a (mon.0) 9324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:42 smithi049 bash[23528]: cluster 2024-09-21T02:36:41.488134+0000 mgr.a (mgr.14388) 11348 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:43.045 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:43.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:43 smithi049 bash[23528]: audit 2024-09-21T02:36:42.602000+0000 mgr.a (mgr.14388) 11349 : audit [DBG] from='client.249300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:43 smithi049 bash[23528]: cluster 2024-09-21T02:36:43.489147+0000 mgr.a (mgr.14388) 11350 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:43.886 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:43 smithi179 bash[23186]: audit 2024-09-21T02:36:42.602000+0000 mgr.a (mgr.14388) 11349 : audit [DBG] from='client.249300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:43.887 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:43 smithi179 bash[23186]: cluster 2024-09-21T02:36:43.489147+0000 mgr.a (mgr.14388) 11350 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:43 smithi044 bash[22676]: audit 2024-09-21T02:36:42.602000+0000 mgr.a (mgr.14388) 11349 : audit [DBG] from='client.249300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:43 smithi044 bash[22676]: cluster 2024-09-21T02:36:43.489147+0000 mgr.a (mgr.14388) 11350 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:45 smithi179 bash[23186]: cluster 2024-09-21T02:36:45.491299+0000 mgr.a (mgr.14388) 11351 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:45 smithi049 bash[23528]: cluster 2024-09-21T02:36:45.491299+0000 mgr.a (mgr.14388) 11351 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:45.892 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:45 smithi044 bash[22676]: cluster 2024-09-21T02:36:45.491299+0000 mgr.a (mgr.14388) 11351 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:47.812 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:47 smithi044 bash[22676]: cluster 2024-09-21T02:36:47.492104+0000 mgr.a (mgr.14388) 11352 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:47 smithi179 bash[23186]: cluster 2024-09-21T02:36:47.492104+0000 mgr.a (mgr.14388) 11352 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:48.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:48.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:48.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:47 smithi049 bash[23528]: cluster 2024-09-21T02:36:47.492104+0000 mgr.a (mgr.14388) 11352 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:48.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:48.835 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:48 smithi044 bash[22676]: audit 2024-09-21T02:36:48.383921+0000 mgr.a (mgr.14388) 11353 : audit [DBG] from='client.249378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:48 smithi179 bash[23186]: audit 2024-09-21T02:36:48.383921+0000 mgr.a (mgr.14388) 11353 : audit [DBG] from='client.249378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:48 smithi049 bash[23528]: audit 2024-09-21T02:36:48.383921+0000 mgr.a (mgr.14388) 11353 : audit [DBG] from='client.249378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:49 smithi044 bash[22676]: cluster 2024-09-21T02:36:49.492671+0000 mgr.a (mgr.14388) 11354 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:49 smithi179 bash[23186]: cluster 2024-09-21T02:36:49.492671+0000 mgr.a (mgr.14388) 11354 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:49 smithi049 bash[23528]: cluster 2024-09-21T02:36:49.492671+0000 mgr.a (mgr.14388) 11354 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:52 smithi049 bash[23528]: cluster 2024-09-21T02:36:51.494911+0000 mgr.a (mgr.14388) 11355 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:52 smithi044 bash[22676]: cluster 2024-09-21T02:36:51.494911+0000 mgr.a (mgr.14388) 11355 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:52 smithi179 bash[23186]: cluster 2024-09-21T02:36:51.494911+0000 mgr.a (mgr.14388) 11355 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:53.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:53.837 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:53.837 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:36:54.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:36:54.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:36:54.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:36:54.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:36:54.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:36:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: cluster 2024-09-21T02:36:53.495700+0000 mgr.a (mgr.14388) 11356 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: audit 2024-09-21T02:36:53.813851+0000 mon.a (mon.0) 9325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: audit 2024-09-21T02:36:53.822387+0000 mon.a (mon.0) 9326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: audit 2024-09-21T02:36:53.832784+0000 mon.a (mon.0) 9327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: audit 2024-09-21T02:36:53.993191+0000 mon.a (mon.0) 9328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: audit 2024-09-21T02:36:53.999078+0000 mon.a (mon.0) 9329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: audit 2024-09-21T02:36:54.005935+0000 mon.a (mon.0) 9330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:54 smithi044 bash[22676]: audit 2024-09-21T02:36:54.176508+0000 mgr.a (mgr.14388) 11357 : audit [DBG] from='client.249450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: cluster 2024-09-21T02:36:53.495700+0000 mgr.a (mgr.14388) 11356 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: audit 2024-09-21T02:36:53.813851+0000 mon.a (mon.0) 9325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: audit 2024-09-21T02:36:53.822387+0000 mon.a (mon.0) 9326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: audit 2024-09-21T02:36:53.832784+0000 mon.a (mon.0) 9327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: audit 2024-09-21T02:36:53.993191+0000 mon.a (mon.0) 9328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: audit 2024-09-21T02:36:53.999078+0000 mon.a (mon.0) 9329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: audit 2024-09-21T02:36:54.005935+0000 mon.a (mon.0) 9330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:54 smithi179 bash[23186]: audit 2024-09-21T02:36:54.176508+0000 mgr.a (mgr.14388) 11357 : audit [DBG] from='client.249450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: cluster 2024-09-21T02:36:53.495700+0000 mgr.a (mgr.14388) 11356 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: audit 2024-09-21T02:36:53.813851+0000 mon.a (mon.0) 9325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: audit 2024-09-21T02:36:53.822387+0000 mon.a (mon.0) 9326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: audit 2024-09-21T02:36:53.832784+0000 mon.a (mon.0) 9327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: audit 2024-09-21T02:36:53.993191+0000 mon.a (mon.0) 9328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: audit 2024-09-21T02:36:53.999078+0000 mon.a (mon.0) 9329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: audit 2024-09-21T02:36:54.005935+0000 mon.a (mon.0) 9330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:36:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:54 smithi049 bash[23528]: audit 2024-09-21T02:36:54.176508+0000 mgr.a (mgr.14388) 11357 : audit [DBG] from='client.249450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:56 smithi044 bash[22676]: cluster 2024-09-21T02:36:55.497974+0000 mgr.a (mgr.14388) 11358 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:56 smithi179 bash[23186]: cluster 2024-09-21T02:36:55.497974+0000 mgr.a (mgr.14388) 11358 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:56 smithi049 bash[23528]: cluster 2024-09-21T02:36:55.497974+0000 mgr.a (mgr.14388) 11358 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:36:59.132 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:36:58 smithi049 bash[23528]: cluster 2024-09-21T02:36:57.498514+0000 mgr.a (mgr.14388) 11359 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:36:58 smithi044 bash[22676]: cluster 2024-09-21T02:36:57.498514+0000 mgr.a (mgr.14388) 11359 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:36:58 smithi179 bash[23186]: cluster 2024-09-21T02:36:57.498514+0000 mgr.a (mgr.14388) 11359 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:36:59.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:36:59.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:36:59.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:00.381 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:00.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:00.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:00.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:00.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:00 smithi049 bash[23528]: cluster 2024-09-21T02:36:59.499249+0000 mgr.a (mgr.14388) 11360 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:00 smithi049 bash[23528]: audit 2024-09-21T02:36:59.963839+0000 mgr.a (mgr.14388) 11361 : audit [DBG] from='client.249525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:00 smithi044 bash[22676]: cluster 2024-09-21T02:36:59.499249+0000 mgr.a (mgr.14388) 11360 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:00 smithi044 bash[22676]: audit 2024-09-21T02:36:59.963839+0000 mgr.a (mgr.14388) 11361 : audit [DBG] from='client.249525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:01.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:00 smithi179 bash[23186]: cluster 2024-09-21T02:36:59.499249+0000 mgr.a (mgr.14388) 11360 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:00 smithi179 bash[23186]: audit 2024-09-21T02:36:59.963839+0000 mgr.a (mgr.14388) 11361 : audit [DBG] from='client.249525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:02 smithi179 bash[23186]: audit 2024-09-21T02:37:01.252899+0000 mon.a (mon.0) 9331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:02 smithi179 bash[23186]: audit 2024-09-21T02:37:01.261931+0000 mon.a (mon.0) 9332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:02 smithi179 bash[23186]: audit 2024-09-21T02:37:01.272337+0000 mon.a (mon.0) 9333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:02 smithi049 bash[23528]: audit 2024-09-21T02:37:01.252899+0000 mon.a (mon.0) 9331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:02 smithi049 bash[23528]: audit 2024-09-21T02:37:01.261931+0000 mon.a (mon.0) 9332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:02 smithi049 bash[23528]: audit 2024-09-21T02:37:01.272337+0000 mon.a (mon.0) 9333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:02 smithi044 bash[22676]: audit 2024-09-21T02:37:01.252899+0000 mon.a (mon.0) 9331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:02 smithi044 bash[22676]: audit 2024-09-21T02:37:01.261931+0000 mon.a (mon.0) 9332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:02 smithi044 bash[22676]: audit 2024-09-21T02:37:01.272337+0000 mon.a (mon.0) 9333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:03.482 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:03 smithi179 bash[23186]: cluster 2024-09-21T02:37:01.501963+0000 mgr.a (mgr.14388) 11362 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:03 smithi049 bash[23528]: cluster 2024-09-21T02:37:01.501963+0000 mgr.a (mgr.14388) 11362 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:03 smithi044 bash[22676]: cluster 2024-09-21T02:37:01.501963+0000 mgr.a (mgr.14388) 11362 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:05.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:05.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:05.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:05 smithi049 bash[23528]: cluster 2024-09-21T02:37:03.502747+0000 mgr.a (mgr.14388) 11363 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:05.620 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:05 smithi179 bash[23186]: cluster 2024-09-21T02:37:03.502747+0000 mgr.a (mgr.14388) 11363 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:05 smithi044 bash[22676]: cluster 2024-09-21T02:37:03.502747+0000 mgr.a (mgr.14388) 11363 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:06.154 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:06.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:06.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:06.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:06.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:07 smithi049 bash[23528]: cluster 2024-09-21T02:37:05.504574+0000 mgr.a (mgr.14388) 11364 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:07 smithi049 bash[23528]: audit 2024-09-21T02:37:05.719049+0000 mgr.a (mgr.14388) 11365 : audit [DBG] from='client.249600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:07 smithi049 bash[23528]: audit 2024-09-21T02:37:06.873044+0000 mon.a (mon.0) 9334 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:07 smithi049 bash[23528]: audit 2024-09-21T02:37:06.881162+0000 mon.a (mon.0) 9335 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:07 smithi049 bash[23528]: audit 2024-09-21T02:37:06.883176+0000 mon.a (mon.0) 9336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:07 smithi049 bash[23528]: audit 2024-09-21T02:37:06.894837+0000 mon.a (mon.0) 9337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:07.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:07 smithi049 bash[23528]: audit 2024-09-21T02:37:06.901521+0000 mon.a (mon.0) 9338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:37:07.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22676]: cluster 2024-09-21T02:37:05.504574+0000 mgr.a (mgr.14388) 11364 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:07.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22676]: audit 2024-09-21T02:37:05.719049+0000 mgr.a (mgr.14388) 11365 : audit [DBG] from='client.249600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:07.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22676]: audit 2024-09-21T02:37:06.873044+0000 mon.a (mon.0) 9334 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:37:07.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22676]: audit 2024-09-21T02:37:06.881162+0000 mon.a (mon.0) 9335 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:37:07.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22676]: audit 2024-09-21T02:37:06.883176+0000 mon.a (mon.0) 9336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:37:07.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22676]: audit 2024-09-21T02:37:06.894837+0000 mon.a (mon.0) 9337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:07.685 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22676]: audit 2024-09-21T02:37:06.901521+0000 mon.a (mon.0) 9338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:37:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:07 smithi179 bash[23186]: cluster 2024-09-21T02:37:05.504574+0000 mgr.a (mgr.14388) 11364 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:07 smithi179 bash[23186]: audit 2024-09-21T02:37:05.719049+0000 mgr.a (mgr.14388) 11365 : audit [DBG] from='client.249600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:07 smithi179 bash[23186]: audit 2024-09-21T02:37:06.873044+0000 mon.a (mon.0) 9334 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:37:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:07 smithi179 bash[23186]: audit 2024-09-21T02:37:06.881162+0000 mon.a (mon.0) 9335 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:37:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:07 smithi179 bash[23186]: audit 2024-09-21T02:37:06.883176+0000 mon.a (mon.0) 9336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:37:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:07 smithi179 bash[23186]: audit 2024-09-21T02:37:06.894837+0000 mon.a (mon.0) 9337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:07.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:07 smithi179 bash[23186]: audit 2024-09-21T02:37:06.901521+0000 mon.a (mon.0) 9338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:37:07.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22930]: debug 2024-09-21T02:37:07.683+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:37:07.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:37:07 smithi044 bash[22930]: debug 2024-09-21T02:37:07.683+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:37:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:08 smithi049 bash[23528]: audit 2024-09-21T02:37:06.904526+0000 mgr.a (mgr.14388) 11366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:37:08.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:08 smithi044 bash[22676]: audit 2024-09-21T02:37:06.904526+0000 mgr.a (mgr.14388) 11366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:37:08.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:08 smithi179 bash[23186]: audit 2024-09-21T02:37:06.904526+0000 mgr.a (mgr.14388) 11366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:37:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:09 smithi049 bash[23528]: cluster 2024-09-21T02:37:07.505114+0000 mgr.a (mgr.14388) 11367 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:09 smithi049 bash[23528]: audit 2024-09-21T02:37:07.685738+0000 mgr.a (mgr.14388) 11368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:37:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:09 smithi049 bash[23528]: cephadm 2024-09-21T02:37:07.687257+0000 mgr.a (mgr.14388) 11369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:37:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:09 smithi044 bash[22676]: cluster 2024-09-21T02:37:07.505114+0000 mgr.a (mgr.14388) 11367 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:09 smithi044 bash[22676]: audit 2024-09-21T02:37:07.685738+0000 mgr.a (mgr.14388) 11368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:37:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:09 smithi044 bash[22676]: cephadm 2024-09-21T02:37:07.687257+0000 mgr.a (mgr.14388) 11369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:37:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:09 smithi179 bash[23186]: cluster 2024-09-21T02:37:07.505114+0000 mgr.a (mgr.14388) 11367 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:09 smithi179 bash[23186]: audit 2024-09-21T02:37:07.685738+0000 mgr.a (mgr.14388) 11368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:37:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:09 smithi179 bash[23186]: cephadm 2024-09-21T02:37:07.687257+0000 mgr.a (mgr.14388) 11369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:37:11.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:11.157 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:11 smithi049 bash[23528]: cluster 2024-09-21T02:37:09.505899+0000 mgr.a (mgr.14388) 11370 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:37:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:11 smithi044 bash[22676]: cluster 2024-09-21T02:37:09.505899+0000 mgr.a (mgr.14388) 11370 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:37:11.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:11 smithi179 bash[23186]: cluster 2024-09-21T02:37:09.505899+0000 mgr.a (mgr.14388) 11370 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:37:11.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:11.944 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:12 smithi044 bash[22676]: audit 2024-09-21T02:37:11.493176+0000 mgr.a (mgr.14388) 11371 : audit [DBG] from='client.249783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:12.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:12 smithi179 bash[23186]: audit 2024-09-21T02:37:11.493176+0000 mgr.a (mgr.14388) 11371 : audit [DBG] from='client.249783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:12 smithi049 bash[23528]: audit 2024-09-21T02:37:11.493176+0000 mgr.a (mgr.14388) 11371 : audit [DBG] from='client.249783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:13 smithi044 bash[22676]: cluster 2024-09-21T02:37:11.511877+0000 mgr.a (mgr.14388) 11372 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:13 smithi179 bash[23186]: cluster 2024-09-21T02:37:11.511877+0000 mgr.a (mgr.14388) 11372 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:13 smithi049 bash[23528]: cluster 2024-09-21T02:37:11.511877+0000 mgr.a (mgr.14388) 11372 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:15 smithi049 bash[23528]: cluster 2024-09-21T02:37:13.512805+0000 mgr.a (mgr.14388) 11373 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:15 smithi049 bash[23528]: audit 2024-09-21T02:37:14.038614+0000 mon.a (mon.0) 9339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:15 smithi049 bash[23528]: audit 2024-09-21T02:37:14.045766+0000 mon.a (mon.0) 9340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:15 smithi049 bash[23528]: audit 2024-09-21T02:37:14.055508+0000 mon.a (mon.0) 9341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:15 smithi049 bash[23528]: audit 2024-09-21T02:37:14.179264+0000 mon.a (mon.0) 9342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:15 smithi049 bash[23528]: audit 2024-09-21T02:37:14.187648+0000 mon.a (mon.0) 9343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:15 smithi049 bash[23528]: audit 2024-09-21T02:37:14.197719+0000 mon.a (mon.0) 9344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:15 smithi044 bash[22676]: cluster 2024-09-21T02:37:13.512805+0000 mgr.a (mgr.14388) 11373 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:15 smithi044 bash[22676]: audit 2024-09-21T02:37:14.038614+0000 mon.a (mon.0) 9339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:15 smithi044 bash[22676]: audit 2024-09-21T02:37:14.045766+0000 mon.a (mon.0) 9340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:15 smithi044 bash[22676]: audit 2024-09-21T02:37:14.055508+0000 mon.a (mon.0) 9341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:15 smithi044 bash[22676]: audit 2024-09-21T02:37:14.179264+0000 mon.a (mon.0) 9342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:15 smithi044 bash[22676]: audit 2024-09-21T02:37:14.187648+0000 mon.a (mon.0) 9343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:15 smithi044 bash[22676]: audit 2024-09-21T02:37:14.197719+0000 mon.a (mon.0) 9344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:15 smithi179 bash[23186]: cluster 2024-09-21T02:37:13.512805+0000 mgr.a (mgr.14388) 11373 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:15 smithi179 bash[23186]: audit 2024-09-21T02:37:14.038614+0000 mon.a (mon.0) 9339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:15 smithi179 bash[23186]: audit 2024-09-21T02:37:14.045766+0000 mon.a (mon.0) 9340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:15 smithi179 bash[23186]: audit 2024-09-21T02:37:14.055508+0000 mon.a (mon.0) 9341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:15 smithi179 bash[23186]: audit 2024-09-21T02:37:14.179264+0000 mon.a (mon.0) 9342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:15 smithi179 bash[23186]: audit 2024-09-21T02:37:14.187648+0000 mon.a (mon.0) 9343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:15 smithi179 bash[23186]: audit 2024-09-21T02:37:14.197719+0000 mon.a (mon.0) 9344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:17 smithi049 bash[23528]: cluster 2024-09-21T02:37:15.514631+0000 mgr.a (mgr.14388) 11374 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:17 smithi044 bash[22676]: cluster 2024-09-21T02:37:15.514631+0000 mgr.a (mgr.14388) 11374 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:17 smithi179 bash[23186]: cluster 2024-09-21T02:37:15.514631+0000 mgr.a (mgr.14388) 11374 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:17.731 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:17.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:17.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:17.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:17.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:18 smithi049 bash[23528]: audit 2024-09-21T02:37:17.282324+0000 mgr.a (mgr.14388) 11375 : audit [DBG] from='client.249861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:18 smithi044 bash[22676]: audit 2024-09-21T02:37:17.282324+0000 mgr.a (mgr.14388) 11375 : audit [DBG] from='client.249861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:18 smithi179 bash[23186]: audit 2024-09-21T02:37:17.282324+0000 mgr.a (mgr.14388) 11375 : audit [DBG] from='client.249861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:19.362 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:19 smithi049 bash[23528]: cluster 2024-09-21T02:37:17.515163+0000 mgr.a (mgr.14388) 11376 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:19 smithi044 bash[22676]: cluster 2024-09-21T02:37:17.515163+0000 mgr.a (mgr.14388) 11376 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:19 smithi179 bash[23186]: cluster 2024-09-21T02:37:17.515163+0000 mgr.a (mgr.14388) 11376 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:21 smithi049 bash[23528]: cluster 2024-09-21T02:37:19.516060+0000 mgr.a (mgr.14388) 11377 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:21 smithi044 bash[22676]: cluster 2024-09-21T02:37:19.516060+0000 mgr.a (mgr.14388) 11377 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:21 smithi179 bash[23186]: cluster 2024-09-21T02:37:19.516060+0000 mgr.a (mgr.14388) 11377 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:22.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:22.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:22.735 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:22 smithi044 bash[22676]: audit 2024-09-21T02:37:21.448673+0000 mon.a (mon.0) 9345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:22 smithi044 bash[22676]: audit 2024-09-21T02:37:21.457517+0000 mon.a (mon.0) 9346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:22 smithi044 bash[22676]: audit 2024-09-21T02:37:21.467954+0000 mon.a (mon.0) 9347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:22 smithi179 bash[23186]: audit 2024-09-21T02:37:21.448673+0000 mon.a (mon.0) 9345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:22 smithi179 bash[23186]: audit 2024-09-21T02:37:21.457517+0000 mon.a (mon.0) 9346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:22 smithi179 bash[23186]: audit 2024-09-21T02:37:21.467954+0000 mon.a (mon.0) 9347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:22 smithi049 bash[23528]: audit 2024-09-21T02:37:21.448673+0000 mon.a (mon.0) 9345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:22 smithi049 bash[23528]: audit 2024-09-21T02:37:21.457517+0000 mon.a (mon.0) 9346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:22 smithi049 bash[23528]: audit 2024-09-21T02:37:21.467954+0000 mon.a (mon.0) 9347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:23.521 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:23.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:23.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:23.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:23.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:23.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:23 smithi179 bash[23186]: cluster 2024-09-21T02:37:21.518311+0000 mgr.a (mgr.14388) 11378 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:23 smithi044 bash[22676]: cluster 2024-09-21T02:37:21.518311+0000 mgr.a (mgr.14388) 11378 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:23 smithi049 bash[23528]: cluster 2024-09-21T02:37:21.518311+0000 mgr.a (mgr.14388) 11378 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:37:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:24 smithi044 bash[22676]: audit 2024-09-21T02:37:23.071832+0000 mgr.a (mgr.14388) 11379 : audit [DBG] from='client.249936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:24.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:24 smithi179 bash[23186]: audit 2024-09-21T02:37:23.071832+0000 mgr.a (mgr.14388) 11379 : audit [DBG] from='client.249936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:24 smithi049 bash[23528]: audit 2024-09-21T02:37:23.071832+0000 mgr.a (mgr.14388) 11379 : audit [DBG] from='client.249936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:25 smithi044 bash[22676]: cluster 2024-09-21T02:37:23.518932+0000 mgr.a (mgr.14388) 11380 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:25 smithi179 bash[23186]: cluster 2024-09-21T02:37:23.518932+0000 mgr.a (mgr.14388) 11380 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:25 smithi049 bash[23528]: cluster 2024-09-21T02:37:23.518932+0000 mgr.a (mgr.14388) 11380 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:27.716 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:27 smithi044 bash[22676]: cluster 2024-09-21T02:37:25.521137+0000 mgr.a (mgr.14388) 11381 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:27 smithi179 bash[23186]: cluster 2024-09-21T02:37:25.521137+0000 mgr.a (mgr.14388) 11381 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:27 smithi049 bash[23528]: cluster 2024-09-21T02:37:25.521137+0000 mgr.a (mgr.14388) 11381 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:28.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:28.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:28.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:29.282 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:29.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:29.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:29.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:29.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:29 smithi044 bash[22676]: cluster 2024-09-21T02:37:27.521677+0000 mgr.a (mgr.14388) 11382 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:29.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:29 smithi179 bash[23186]: cluster 2024-09-21T02:37:27.521677+0000 mgr.a (mgr.14388) 11382 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:29 smithi049 bash[23528]: cluster 2024-09-21T02:37:27.521677+0000 mgr.a (mgr.14388) 11382 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:30 smithi179 bash[23186]: audit 2024-09-21T02:37:28.859498+0000 mgr.a (mgr.14388) 11383 : audit [DBG] from='client.250011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:30 smithi049 bash[23528]: audit 2024-09-21T02:37:28.859498+0000 mgr.a (mgr.14388) 11383 : audit [DBG] from='client.250011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:30 smithi044 bash[22676]: audit 2024-09-21T02:37:28.859498+0000 mgr.a (mgr.14388) 11383 : audit [DBG] from='client.250011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:31 smithi179 bash[23186]: cluster 2024-09-21T02:37:29.522491+0000 mgr.a (mgr.14388) 11384 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:31 smithi049 bash[23528]: cluster 2024-09-21T02:37:29.522491+0000 mgr.a (mgr.14388) 11384 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:31 smithi044 bash[22676]: cluster 2024-09-21T02:37:29.522491+0000 mgr.a (mgr.14388) 11384 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:33 smithi049 bash[23528]: cluster 2024-09-21T02:37:31.524713+0000 mgr.a (mgr.14388) 11385 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:33 smithi044 bash[22676]: cluster 2024-09-21T02:37:31.524713+0000 mgr.a (mgr.14388) 11385 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:33 smithi179 bash[23186]: cluster 2024-09-21T02:37:31.524713+0000 mgr.a (mgr.14388) 11385 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:35.046 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:35.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:35.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:35 smithi049 bash[23528]: cluster 2024-09-21T02:37:33.525532+0000 mgr.a (mgr.14388) 11386 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:35 smithi049 bash[23528]: audit 2024-09-21T02:37:34.266000+0000 mon.a (mon.0) 9348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:35 smithi049 bash[23528]: audit 2024-09-21T02:37:34.274299+0000 mon.a (mon.0) 9349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:35 smithi049 bash[23528]: audit 2024-09-21T02:37:34.284325+0000 mon.a (mon.0) 9350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:35 smithi049 bash[23528]: audit 2024-09-21T02:37:34.396053+0000 mon.a (mon.0) 9351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:35 smithi049 bash[23528]: audit 2024-09-21T02:37:34.402381+0000 mon.a (mon.0) 9352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:35 smithi049 bash[23528]: audit 2024-09-21T02:37:34.408921+0000 mon.a (mon.0) 9353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:35 smithi044 bash[22676]: cluster 2024-09-21T02:37:33.525532+0000 mgr.a (mgr.14388) 11386 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:35 smithi044 bash[22676]: audit 2024-09-21T02:37:34.266000+0000 mon.a (mon.0) 9348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:35 smithi044 bash[22676]: audit 2024-09-21T02:37:34.274299+0000 mon.a (mon.0) 9349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:35 smithi044 bash[22676]: audit 2024-09-21T02:37:34.284325+0000 mon.a (mon.0) 9350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:35 smithi044 bash[22676]: audit 2024-09-21T02:37:34.396053+0000 mon.a (mon.0) 9351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:35 smithi044 bash[22676]: audit 2024-09-21T02:37:34.402381+0000 mon.a (mon.0) 9352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:35 smithi044 bash[22676]: audit 2024-09-21T02:37:34.408921+0000 mon.a (mon.0) 9353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:35 smithi179 bash[23186]: cluster 2024-09-21T02:37:33.525532+0000 mgr.a (mgr.14388) 11386 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:35 smithi179 bash[23186]: audit 2024-09-21T02:37:34.266000+0000 mon.a (mon.0) 9348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:35 smithi179 bash[23186]: audit 2024-09-21T02:37:34.274299+0000 mon.a (mon.0) 9349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:35 smithi179 bash[23186]: audit 2024-09-21T02:37:34.284325+0000 mon.a (mon.0) 9350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:35 smithi179 bash[23186]: audit 2024-09-21T02:37:34.396053+0000 mon.a (mon.0) 9351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:35 smithi179 bash[23186]: audit 2024-09-21T02:37:34.402381+0000 mon.a (mon.0) 9352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:35 smithi179 bash[23186]: audit 2024-09-21T02:37:34.408921+0000 mon.a (mon.0) 9353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:36 smithi049 bash[23528]: audit 2024-09-21T02:37:34.613219+0000 mgr.a (mgr.14388) 11387 : audit [DBG] from='client.250089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:36.581 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:36 smithi179 bash[23186]: audit 2024-09-21T02:37:34.613219+0000 mgr.a (mgr.14388) 11387 : audit [DBG] from='client.250089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:36 smithi044 bash[22676]: audit 2024-09-21T02:37:34.613219+0000 mgr.a (mgr.14388) 11387 : audit [DBG] from='client.250089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:37 smithi049 bash[23528]: cluster 2024-09-21T02:37:35.527984+0000 mgr.a (mgr.14388) 11388 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:37:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:37 smithi044 bash[22676]: cluster 2024-09-21T02:37:35.527984+0000 mgr.a (mgr.14388) 11388 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:37:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:37 smithi179 bash[23186]: cluster 2024-09-21T02:37:35.527984+0000 mgr.a (mgr.14388) 11388 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:37:39.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:39 smithi049 bash[23528]: cluster 2024-09-21T02:37:37.528811+0000 mgr.a (mgr.14388) 11389 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:37:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:39 smithi044 bash[22676]: cluster 2024-09-21T02:37:37.528811+0000 mgr.a (mgr.14388) 11389 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:37:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:39 smithi179 bash[23186]: cluster 2024-09-21T02:37:37.528811+0000 mgr.a (mgr.14388) 11389 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:37:40.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:40.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:40.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:40.834 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:40.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:40.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:40.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:40.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:41 smithi049 bash[23528]: cluster 2024-09-21T02:37:39.529618+0000 mgr.a (mgr.14388) 11390 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:37:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:41 smithi049 bash[23528]: audit 2024-09-21T02:37:40.387870+0000 mgr.a (mgr.14388) 11391 : audit [DBG] from='client.250164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:41 smithi044 bash[22676]: cluster 2024-09-21T02:37:39.529618+0000 mgr.a (mgr.14388) 11390 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:37:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:41 smithi044 bash[22676]: audit 2024-09-21T02:37:40.387870+0000 mgr.a (mgr.14388) 11391 : audit [DBG] from='client.250164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:41 smithi179 bash[23186]: cluster 2024-09-21T02:37:39.529618+0000 mgr.a (mgr.14388) 11390 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:37:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:41 smithi179 bash[23186]: audit 2024-09-21T02:37:40.387870+0000 mgr.a (mgr.14388) 11391 : audit [DBG] from='client.250164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:42 smithi044 bash[22676]: cluster 2024-09-21T02:37:41.532358+0000 mgr.a (mgr.14388) 11392 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:42 smithi044 bash[22676]: audit 2024-09-21T02:37:41.666971+0000 mon.a (mon.0) 9354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:42 smithi044 bash[22676]: audit 2024-09-21T02:37:41.675704+0000 mon.a (mon.0) 9355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:42 smithi044 bash[22676]: audit 2024-09-21T02:37:41.686705+0000 mon.a (mon.0) 9356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:42 smithi179 bash[23186]: cluster 2024-09-21T02:37:41.532358+0000 mgr.a (mgr.14388) 11392 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:42 smithi179 bash[23186]: audit 2024-09-21T02:37:41.666971+0000 mon.a (mon.0) 9354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:42 smithi179 bash[23186]: audit 2024-09-21T02:37:41.675704+0000 mon.a (mon.0) 9355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:42 smithi179 bash[23186]: audit 2024-09-21T02:37:41.686705+0000 mon.a (mon.0) 9356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:42 smithi049 bash[23528]: cluster 2024-09-21T02:37:41.532358+0000 mgr.a (mgr.14388) 11392 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:42 smithi049 bash[23528]: audit 2024-09-21T02:37:41.666971+0000 mon.a (mon.0) 9354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:42 smithi049 bash[23528]: audit 2024-09-21T02:37:41.675704+0000 mon.a (mon.0) 9355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:42 smithi049 bash[23528]: audit 2024-09-21T02:37:41.686705+0000 mon.a (mon.0) 9356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:44 smithi044 bash[22676]: cluster 2024-09-21T02:37:43.533117+0000 mgr.a (mgr.14388) 11393 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:44 smithi179 bash[23186]: cluster 2024-09-21T02:37:43.533117+0000 mgr.a (mgr.14388) 11393 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:44 smithi049 bash[23528]: cluster 2024-09-21T02:37:43.533117+0000 mgr.a (mgr.14388) 11393 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:37:45.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:45.836 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:45.836 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:46.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:46 smithi044 bash[22676]: cluster 2024-09-21T02:37:45.535037+0000 mgr.a (mgr.14388) 11394 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:46 smithi044 bash[22676]: audit 2024-09-21T02:37:46.176218+0000 mgr.a (mgr.14388) 11395 : audit [DBG] from='client.250242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:46 smithi179 bash[23186]: cluster 2024-09-21T02:37:45.535037+0000 mgr.a (mgr.14388) 11394 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:46 smithi179 bash[23186]: audit 2024-09-21T02:37:46.176218+0000 mgr.a (mgr.14388) 11395 : audit [DBG] from='client.250242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:46 smithi049 bash[23528]: cluster 2024-09-21T02:37:45.535037+0000 mgr.a (mgr.14388) 11394 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:46 smithi049 bash[23528]: audit 2024-09-21T02:37:46.176218+0000 mgr.a (mgr.14388) 11395 : audit [DBG] from='client.250242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:48.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:48 smithi044 bash[22676]: cluster 2024-09-21T02:37:47.535623+0000 mgr.a (mgr.14388) 11396 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:37:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:48 smithi179 bash[23186]: cluster 2024-09-21T02:37:47.535623+0000 mgr.a (mgr.14388) 11396 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:37:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:48 smithi049 bash[23528]: cluster 2024-09-21T02:37:47.535623+0000 mgr.a (mgr.14388) 11396 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:37:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:50 smithi044 bash[22676]: cluster 2024-09-21T02:37:49.536523+0000 mgr.a (mgr.14388) 11397 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:37:51.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:50 smithi179 bash[23186]: cluster 2024-09-21T02:37:49.536523+0000 mgr.a (mgr.14388) 11397 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:37:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:50 smithi049 bash[23528]: cluster 2024-09-21T02:37:49.536523+0000 mgr.a (mgr.14388) 11397 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:37:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:52.416 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:52 smithi044 bash[22676]: cluster 2024-09-21T02:37:51.538769+0000 mgr.a (mgr.14388) 11398 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:37:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:52 smithi044 bash[22676]: audit 2024-09-21T02:37:51.967323+0000 mgr.a (mgr.14388) 11399 : audit [DBG] from='client.250317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:53.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:52 smithi179 bash[23186]: cluster 2024-09-21T02:37:51.538769+0000 mgr.a (mgr.14388) 11398 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:37:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:52 smithi179 bash[23186]: audit 2024-09-21T02:37:51.967323+0000 mgr.a (mgr.14388) 11399 : audit [DBG] from='client.250317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:52 smithi049 bash[23528]: cluster 2024-09-21T02:37:51.538769+0000 mgr.a (mgr.14388) 11398 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:37:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:52 smithi049 bash[23528]: audit 2024-09-21T02:37:51.967323+0000 mgr.a (mgr.14388) 11399 : audit [DBG] from='client.250317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:55 smithi179 bash[23186]: cluster 2024-09-21T02:37:53.539681+0000 mgr.a (mgr.14388) 11400 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:55 smithi179 bash[23186]: audit 2024-09-21T02:37:54.503658+0000 mon.a (mon.0) 9357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:55 smithi179 bash[23186]: audit 2024-09-21T02:37:54.511644+0000 mon.a (mon.0) 9358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:55 smithi179 bash[23186]: audit 2024-09-21T02:37:54.522079+0000 mon.a (mon.0) 9359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:55 smithi179 bash[23186]: audit 2024-09-21T02:37:54.617443+0000 mon.a (mon.0) 9360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:55 smithi179 bash[23186]: audit 2024-09-21T02:37:54.625686+0000 mon.a (mon.0) 9361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:55 smithi179 bash[23186]: audit 2024-09-21T02:37:54.635683+0000 mon.a (mon.0) 9362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:55 smithi049 bash[23528]: cluster 2024-09-21T02:37:53.539681+0000 mgr.a (mgr.14388) 11400 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:55 smithi049 bash[23528]: audit 2024-09-21T02:37:54.503658+0000 mon.a (mon.0) 9357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:55 smithi049 bash[23528]: audit 2024-09-21T02:37:54.511644+0000 mon.a (mon.0) 9358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:55 smithi049 bash[23528]: audit 2024-09-21T02:37:54.522079+0000 mon.a (mon.0) 9359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:55 smithi049 bash[23528]: audit 2024-09-21T02:37:54.617443+0000 mon.a (mon.0) 9360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:55 smithi049 bash[23528]: audit 2024-09-21T02:37:54.625686+0000 mon.a (mon.0) 9361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:55 smithi049 bash[23528]: audit 2024-09-21T02:37:54.635683+0000 mon.a (mon.0) 9362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:55 smithi044 bash[22676]: cluster 2024-09-21T02:37:53.539681+0000 mgr.a (mgr.14388) 11400 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:55 smithi044 bash[22676]: audit 2024-09-21T02:37:54.503658+0000 mon.a (mon.0) 9357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:55 smithi044 bash[22676]: audit 2024-09-21T02:37:54.511644+0000 mon.a (mon.0) 9358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:55 smithi044 bash[22676]: audit 2024-09-21T02:37:54.522079+0000 mon.a (mon.0) 9359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:55 smithi044 bash[22676]: audit 2024-09-21T02:37:54.617443+0000 mon.a (mon.0) 9360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:55 smithi044 bash[22676]: audit 2024-09-21T02:37:54.625686+0000 mon.a (mon.0) 9361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:55 smithi044 bash[22676]: audit 2024-09-21T02:37:54.635683+0000 mon.a (mon.0) 9362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:37:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:37:57.419 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:37:57.419 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:37:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:57 smithi049 bash[23528]: cluster 2024-09-21T02:37:55.542029+0000 mgr.a (mgr.14388) 11401 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:57 smithi044 bash[22676]: cluster 2024-09-21T02:37:55.542029+0000 mgr.a (mgr.14388) 11401 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:58.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:57 smithi179 bash[23186]: cluster 2024-09-21T02:37:55.542029+0000 mgr.a (mgr.14388) 11401 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:37:58.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:37:58.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:37:58.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:37:58.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:37:58.200 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:37:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:59 smithi044 bash[22676]: cluster 2024-09-21T02:37:57.542513+0000 mgr.a (mgr.14388) 11402 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:37:59 smithi044 bash[22676]: audit 2024-09-21T02:37:57.757959+0000 mgr.a (mgr.14388) 11403 : audit [DBG] from='client.250392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:59 smithi049 bash[23528]: cluster 2024-09-21T02:37:57.542513+0000 mgr.a (mgr.14388) 11402 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:37:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:37:59 smithi049 bash[23528]: audit 2024-09-21T02:37:57.757959+0000 mgr.a (mgr.14388) 11403 : audit [DBG] from='client.250392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:59 smithi179 bash[23186]: cluster 2024-09-21T02:37:57.542513+0000 mgr.a (mgr.14388) 11402 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:37:59 smithi179 bash[23186]: audit 2024-09-21T02:37:57.757959+0000 mgr.a (mgr.14388) 11403 : audit [DBG] from='client.250392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:01 smithi049 bash[23528]: cluster 2024-09-21T02:37:59.543408+0000 mgr.a (mgr.14388) 11404 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:01 smithi044 bash[22676]: cluster 2024-09-21T02:37:59.543408+0000 mgr.a (mgr.14388) 11404 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:01 smithi179 bash[23186]: cluster 2024-09-21T02:37:59.543408+0000 mgr.a (mgr.14388) 11404 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:03.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:03.203 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:02 smithi044 bash[22676]: cluster 2024-09-21T02:38:01.545763+0000 mgr.a (mgr.14388) 11405 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:02 smithi044 bash[22676]: audit 2024-09-21T02:38:01.846305+0000 mon.a (mon.0) 9363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:02 smithi044 bash[22676]: audit 2024-09-21T02:38:01.855072+0000 mon.a (mon.0) 9364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:02 smithi044 bash[22676]: audit 2024-09-21T02:38:01.865433+0000 mon.a (mon.0) 9365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:02 smithi179 bash[23186]: cluster 2024-09-21T02:38:01.545763+0000 mgr.a (mgr.14388) 11405 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:02 smithi179 bash[23186]: audit 2024-09-21T02:38:01.846305+0000 mon.a (mon.0) 9363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:02 smithi179 bash[23186]: audit 2024-09-21T02:38:01.855072+0000 mon.a (mon.0) 9364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:02 smithi179 bash[23186]: audit 2024-09-21T02:38:01.865433+0000 mon.a (mon.0) 9365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:02 smithi049 bash[23528]: cluster 2024-09-21T02:38:01.545763+0000 mgr.a (mgr.14388) 11405 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:02 smithi049 bash[23528]: audit 2024-09-21T02:38:01.846305+0000 mon.a (mon.0) 9363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:02 smithi049 bash[23528]: audit 2024-09-21T02:38:01.855072+0000 mon.a (mon.0) 9364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:02 smithi049 bash[23528]: audit 2024-09-21T02:38:01.865433+0000 mon.a (mon.0) 9365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:03.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:03.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:03.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:03.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:03.972 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:04 smithi179 bash[23186]: audit 2024-09-21T02:38:03.533191+0000 mgr.a (mgr.14388) 11406 : audit [DBG] from='client.250470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:04 smithi179 bash[23186]: cluster 2024-09-21T02:38:03.547237+0000 mgr.a (mgr.14388) 11407 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:04 smithi044 bash[22676]: audit 2024-09-21T02:38:03.533191+0000 mgr.a (mgr.14388) 11406 : audit [DBG] from='client.250470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:04 smithi044 bash[22676]: cluster 2024-09-21T02:38:03.547237+0000 mgr.a (mgr.14388) 11407 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:04 smithi049 bash[23528]: audit 2024-09-21T02:38:03.533191+0000 mgr.a (mgr.14388) 11406 : audit [DBG] from='client.250470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:04 smithi049 bash[23528]: cluster 2024-09-21T02:38:03.547237+0000 mgr.a (mgr.14388) 11407 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:06 smithi044 bash[22676]: cluster 2024-09-21T02:38:05.549728+0000 mgr.a (mgr.14388) 11408 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:06 smithi179 bash[23186]: cluster 2024-09-21T02:38:05.549728+0000 mgr.a (mgr.14388) 11408 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:06 smithi049 bash[23528]: cluster 2024-09-21T02:38:05.549728+0000 mgr.a (mgr.14388) 11408 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:07.904 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:07 smithi044 bash[22676]: audit 2024-09-21T02:38:07.752261+0000 mon.a (mon.0) 9366 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:38:07.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:07 smithi044 bash[22676]: audit 2024-09-21T02:38:07.755813+0000 mon.a (mon.0) 9367 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:38:07.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:07 smithi044 bash[22676]: audit 2024-09-21T02:38:07.756859+0000 mon.a (mon.0) 9368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:38:07.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:07 smithi044 bash[22676]: audit 2024-09-21T02:38:07.763819+0000 mon.a (mon.0) 9369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:07.905 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:07 smithi044 bash[22676]: audit 2024-09-21T02:38:07.766909+0000 mon.a (mon.0) 9370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:38:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:07 smithi179 bash[23186]: audit 2024-09-21T02:38:07.752261+0000 mon.a (mon.0) 9366 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:38:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:07 smithi179 bash[23186]: audit 2024-09-21T02:38:07.755813+0000 mon.a (mon.0) 9367 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:38:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:07 smithi179 bash[23186]: audit 2024-09-21T02:38:07.756859+0000 mon.a (mon.0) 9368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:38:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:07 smithi179 bash[23186]: audit 2024-09-21T02:38:07.763819+0000 mon.a (mon.0) 9369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:07 smithi179 bash[23186]: audit 2024-09-21T02:38:07.766909+0000 mon.a (mon.0) 9370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:07 smithi049 bash[23528]: audit 2024-09-21T02:38:07.752261+0000 mon.a (mon.0) 9366 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:07 smithi049 bash[23528]: audit 2024-09-21T02:38:07.755813+0000 mon.a (mon.0) 9367 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:07 smithi049 bash[23528]: audit 2024-09-21T02:38:07.756859+0000 mon.a (mon.0) 9368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:07 smithi049 bash[23528]: audit 2024-09-21T02:38:07.763819+0000 mon.a (mon.0) 9369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:07 smithi049 bash[23528]: audit 2024-09-21T02:38:07.766909+0000 mon.a (mon.0) 9370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:38:08.861 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:38:08 smithi044 bash[22930]: debug 2024-09-21T02:38:08.518+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:38:08.861 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:38:08 smithi044 bash[22930]: debug 2024-09-21T02:38:08.518+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:38:08.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:08.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:08 smithi044 bash[22676]: cluster 2024-09-21T02:38:07.550552+0000 mgr.a (mgr.14388) 11409 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:08 smithi044 bash[22676]: audit 2024-09-21T02:38:07.767942+0000 mgr.a (mgr.14388) 11410 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:38:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:08 smithi044 bash[22676]: audit 2024-09-21T02:38:08.522568+0000 mgr.a (mgr.14388) 11411 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:38:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:08 smithi044 bash[22676]: cephadm 2024-09-21T02:38:08.523996+0000 mgr.a (mgr.14388) 11412 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:38:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:08 smithi179 bash[23186]: cluster 2024-09-21T02:38:07.550552+0000 mgr.a (mgr.14388) 11409 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:08 smithi179 bash[23186]: audit 2024-09-21T02:38:07.767942+0000 mgr.a (mgr.14388) 11410 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:38:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:08 smithi179 bash[23186]: audit 2024-09-21T02:38:08.522568+0000 mgr.a (mgr.14388) 11411 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:38:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:08 smithi179 bash[23186]: cephadm 2024-09-21T02:38:08.523996+0000 mgr.a (mgr.14388) 11412 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:38:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:08 smithi049 bash[23528]: cluster 2024-09-21T02:38:07.550552+0000 mgr.a (mgr.14388) 11409 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:08 smithi049 bash[23528]: audit 2024-09-21T02:38:07.767942+0000 mgr.a (mgr.14388) 11410 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:38:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:08 smithi049 bash[23528]: audit 2024-09-21T02:38:08.522568+0000 mgr.a (mgr.14388) 11411 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:38:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:08 smithi049 bash[23528]: cephadm 2024-09-21T02:38:08.523996+0000 mgr.a (mgr.14388) 11412 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:38:09.714 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:09.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:09.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:09.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:09.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:09 smithi044 bash[22676]: audit 2024-09-21T02:38:09.301451+0000 mgr.a (mgr.14388) 11413 : audit [DBG] from='client.250656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:09 smithi179 bash[23186]: audit 2024-09-21T02:38:09.301451+0000 mgr.a (mgr.14388) 11413 : audit [DBG] from='client.250656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:09 smithi049 bash[23528]: audit 2024-09-21T02:38:09.301451+0000 mgr.a (mgr.14388) 11413 : audit [DBG] from='client.250656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:10 smithi044 bash[22676]: cluster 2024-09-21T02:38:09.551122+0000 mgr.a (mgr.14388) 11414 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:11.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:10 smithi179 bash[23186]: cluster 2024-09-21T02:38:09.551122+0000 mgr.a (mgr.14388) 11414 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:10 smithi049 bash[23528]: cluster 2024-09-21T02:38:09.551122+0000 mgr.a (mgr.14388) 11414 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:12 smithi044 bash[22676]: cluster 2024-09-21T02:38:11.553475+0000 mgr.a (mgr.14388) 11415 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:12 smithi179 bash[23186]: cluster 2024-09-21T02:38:11.553475+0000 mgr.a (mgr.14388) 11415 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:12 smithi049 bash[23528]: cluster 2024-09-21T02:38:11.553475+0000 mgr.a (mgr.14388) 11415 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:14.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:14.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:14.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:14 smithi044 bash[22676]: cluster 2024-09-21T02:38:13.554276+0000 mgr.a (mgr.14388) 11416 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:14 smithi044 bash[22676]: audit 2024-09-21T02:38:14.706240+0000 mon.a (mon.0) 9371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:14 smithi044 bash[22676]: audit 2024-09-21T02:38:14.714922+0000 mon.a (mon.0) 9372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:14 smithi044 bash[22676]: audit 2024-09-21T02:38:14.725606+0000 mon.a (mon.0) 9373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:14 smithi044 bash[22676]: audit 2024-09-21T02:38:14.837428+0000 mon.a (mon.0) 9374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:14 smithi044 bash[22676]: audit 2024-09-21T02:38:14.844287+0000 mon.a (mon.0) 9375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:14 smithi044 bash[22676]: audit 2024-09-21T02:38:14.851594+0000 mon.a (mon.0) 9376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:14 smithi179 bash[23186]: cluster 2024-09-21T02:38:13.554276+0000 mgr.a (mgr.14388) 11416 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:14 smithi179 bash[23186]: audit 2024-09-21T02:38:14.706240+0000 mon.a (mon.0) 9371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:14 smithi179 bash[23186]: audit 2024-09-21T02:38:14.714922+0000 mon.a (mon.0) 9372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:14 smithi179 bash[23186]: audit 2024-09-21T02:38:14.725606+0000 mon.a (mon.0) 9373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:14 smithi179 bash[23186]: audit 2024-09-21T02:38:14.837428+0000 mon.a (mon.0) 9374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:14 smithi179 bash[23186]: audit 2024-09-21T02:38:14.844287+0000 mon.a (mon.0) 9375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:14 smithi179 bash[23186]: audit 2024-09-21T02:38:14.851594+0000 mon.a (mon.0) 9376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:14 smithi049 bash[23528]: cluster 2024-09-21T02:38:13.554276+0000 mgr.a (mgr.14388) 11416 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:14 smithi049 bash[23528]: audit 2024-09-21T02:38:14.706240+0000 mon.a (mon.0) 9371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:14 smithi049 bash[23528]: audit 2024-09-21T02:38:14.714922+0000 mon.a (mon.0) 9372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:14 smithi049 bash[23528]: audit 2024-09-21T02:38:14.725606+0000 mon.a (mon.0) 9373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:14 smithi049 bash[23528]: audit 2024-09-21T02:38:14.837428+0000 mon.a (mon.0) 9374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:14 smithi049 bash[23528]: audit 2024-09-21T02:38:14.844287+0000 mon.a (mon.0) 9375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:14 smithi049 bash[23528]: audit 2024-09-21T02:38:14.851594+0000 mon.a (mon.0) 9376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:15.517 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:15.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:15.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:15.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:15.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:15 smithi044 bash[22676]: audit 2024-09-21T02:38:15.070147+0000 mgr.a (mgr.14388) 11417 : audit [DBG] from='client.250731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:15 smithi179 bash[23186]: audit 2024-09-21T02:38:15.070147+0000 mgr.a (mgr.14388) 11417 : audit [DBG] from='client.250731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:15 smithi049 bash[23528]: audit 2024-09-21T02:38:15.070147+0000 mgr.a (mgr.14388) 11417 : audit [DBG] from='client.250731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:16 smithi044 bash[22676]: cluster 2024-09-21T02:38:15.555554+0000 mgr.a (mgr.14388) 11418 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:16 smithi179 bash[23186]: cluster 2024-09-21T02:38:15.555554+0000 mgr.a (mgr.14388) 11418 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:16 smithi049 bash[23528]: cluster 2024-09-21T02:38:15.555554+0000 mgr.a (mgr.14388) 11418 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:18 smithi044 bash[22676]: cluster 2024-09-21T02:38:17.556308+0000 mgr.a (mgr.14388) 11419 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:38:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:18 smithi179 bash[23186]: cluster 2024-09-21T02:38:17.556308+0000 mgr.a (mgr.14388) 11419 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:38:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:18 smithi049 bash[23528]: cluster 2024-09-21T02:38:17.556308+0000 mgr.a (mgr.14388) 11419 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:38:20.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:20.519 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:20.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:20 smithi044 bash[22676]: cluster 2024-09-21T02:38:19.557101+0000 mgr.a (mgr.14388) 11420 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:38:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:20 smithi179 bash[23186]: cluster 2024-09-21T02:38:19.557101+0000 mgr.a (mgr.14388) 11420 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:38:21.282 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:21.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:21.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:21.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:21.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:20 smithi049 bash[23528]: cluster 2024-09-21T02:38:19.557101+0000 mgr.a (mgr.14388) 11420 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:38:22.032 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:21 smithi049 bash[23528]: audit 2024-09-21T02:38:20.852302+0000 mgr.a (mgr.14388) 11421 : audit [DBG] from='client.250809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:21 smithi044 bash[22676]: audit 2024-09-21T02:38:20.852302+0000 mgr.a (mgr.14388) 11421 : audit [DBG] from='client.250809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:21 smithi179 bash[23186]: audit 2024-09-21T02:38:20.852302+0000 mgr.a (mgr.14388) 11421 : audit [DBG] from='client.250809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:23 smithi049 bash[23528]: cluster 2024-09-21T02:38:21.559919+0000 mgr.a (mgr.14388) 11422 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:23 smithi049 bash[23528]: audit 2024-09-21T02:38:22.011020+0000 mon.a (mon.0) 9377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:23 smithi049 bash[23528]: audit 2024-09-21T02:38:22.020207+0000 mon.a (mon.0) 9378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:23 smithi049 bash[23528]: audit 2024-09-21T02:38:22.031037+0000 mon.a (mon.0) 9379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:23 smithi044 bash[22676]: cluster 2024-09-21T02:38:21.559919+0000 mgr.a (mgr.14388) 11422 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:23 smithi044 bash[22676]: audit 2024-09-21T02:38:22.011020+0000 mon.a (mon.0) 9377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:23 smithi044 bash[22676]: audit 2024-09-21T02:38:22.020207+0000 mon.a (mon.0) 9378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:23 smithi044 bash[22676]: audit 2024-09-21T02:38:22.031037+0000 mon.a (mon.0) 9379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:23 smithi179 bash[23186]: cluster 2024-09-21T02:38:21.559919+0000 mgr.a (mgr.14388) 11422 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:38:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:23 smithi179 bash[23186]: audit 2024-09-21T02:38:22.011020+0000 mon.a (mon.0) 9377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:23 smithi179 bash[23186]: audit 2024-09-21T02:38:22.020207+0000 mon.a (mon.0) 9378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:23 smithi179 bash[23186]: audit 2024-09-21T02:38:22.031037+0000 mon.a (mon.0) 9379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:25 smithi179 bash[23186]: cluster 2024-09-21T02:38:23.560721+0000 mgr.a (mgr.14388) 11423 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:38:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:25 smithi049 bash[23528]: cluster 2024-09-21T02:38:23.560721+0000 mgr.a (mgr.14388) 11423 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:38:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:25 smithi044 bash[22676]: cluster 2024-09-21T02:38:23.560721+0000 mgr.a (mgr.14388) 11423 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:38:26.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:26.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:26.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:27.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:27.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:27.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:27.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:27.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:27 smithi049 bash[23528]: cluster 2024-09-21T02:38:25.562720+0000 mgr.a (mgr.14388) 11424 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:27 smithi044 bash[22676]: cluster 2024-09-21T02:38:25.562720+0000 mgr.a (mgr.14388) 11424 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:27 smithi179 bash[23186]: cluster 2024-09-21T02:38:25.562720+0000 mgr.a (mgr.14388) 11424 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:28.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:28 smithi044 bash[22676]: audit 2024-09-21T02:38:26.620330+0000 mgr.a (mgr.14388) 11425 : audit [DBG] from='client.250887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:28 smithi049 bash[23528]: audit 2024-09-21T02:38:26.620330+0000 mgr.a (mgr.14388) 11425 : audit [DBG] from='client.250887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:28 smithi179 bash[23186]: audit 2024-09-21T02:38:26.620330+0000 mgr.a (mgr.14388) 11425 : audit [DBG] from='client.250887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:29 smithi044 bash[22676]: cluster 2024-09-21T02:38:27.563721+0000 mgr.a (mgr.14388) 11426 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:29 smithi049 bash[23528]: cluster 2024-09-21T02:38:27.563721+0000 mgr.a (mgr.14388) 11426 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:29 smithi179 bash[23186]: cluster 2024-09-21T02:38:27.563721+0000 mgr.a (mgr.14388) 11426 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:31 smithi049 bash[23528]: cluster 2024-09-21T02:38:29.564529+0000 mgr.a (mgr.14388) 11427 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:31 smithi044 bash[22676]: cluster 2024-09-21T02:38:29.564529+0000 mgr.a (mgr.14388) 11427 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:31 smithi179 bash[23186]: cluster 2024-09-21T02:38:29.564529+0000 mgr.a (mgr.14388) 11427 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:32.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:32.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:32.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:32.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:32.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:32.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:32.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:32.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:33 smithi049 bash[23528]: cluster 2024-09-21T02:38:31.566792+0000 mgr.a (mgr.14388) 11428 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:33 smithi049 bash[23528]: audit 2024-09-21T02:38:32.420764+0000 mgr.a (mgr.14388) 11429 : audit [DBG] from='client.250965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:33 smithi044 bash[22676]: cluster 2024-09-21T02:38:31.566792+0000 mgr.a (mgr.14388) 11428 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:33 smithi044 bash[22676]: audit 2024-09-21T02:38:32.420764+0000 mgr.a (mgr.14388) 11429 : audit [DBG] from='client.250965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:33 smithi179 bash[23186]: cluster 2024-09-21T02:38:31.566792+0000 mgr.a (mgr.14388) 11428 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:33 smithi179 bash[23186]: audit 2024-09-21T02:38:32.420764+0000 mgr.a (mgr.14388) 11429 : audit [DBG] from='client.250965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:35 smithi044 bash[22676]: cluster 2024-09-21T02:38:33.567788+0000 mgr.a (mgr.14388) 11430 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:35 smithi044 bash[22676]: audit 2024-09-21T02:38:34.932972+0000 mon.a (mon.0) 9380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:35 smithi044 bash[22676]: audit 2024-09-21T02:38:34.940858+0000 mon.a (mon.0) 9381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:35 smithi044 bash[22676]: audit 2024-09-21T02:38:34.951514+0000 mon.a (mon.0) 9382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:35 smithi049 bash[23528]: cluster 2024-09-21T02:38:33.567788+0000 mgr.a (mgr.14388) 11430 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:35 smithi049 bash[23528]: audit 2024-09-21T02:38:34.932972+0000 mon.a (mon.0) 9380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:35 smithi049 bash[23528]: audit 2024-09-21T02:38:34.940858+0000 mon.a (mon.0) 9381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:35 smithi049 bash[23528]: audit 2024-09-21T02:38:34.951514+0000 mon.a (mon.0) 9382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:35 smithi179 bash[23186]: cluster 2024-09-21T02:38:33.567788+0000 mgr.a (mgr.14388) 11430 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:35 smithi179 bash[23186]: audit 2024-09-21T02:38:34.932972+0000 mon.a (mon.0) 9380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:35 smithi179 bash[23186]: audit 2024-09-21T02:38:34.940858+0000 mon.a (mon.0) 9381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:35 smithi179 bash[23186]: audit 2024-09-21T02:38:34.951514+0000 mon.a (mon.0) 9382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:36 smithi044 bash[22676]: audit 2024-09-21T02:38:35.062514+0000 mon.a (mon.0) 9383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:36 smithi044 bash[22676]: audit 2024-09-21T02:38:35.072152+0000 mon.a (mon.0) 9384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:36 smithi044 bash[22676]: audit 2024-09-21T02:38:35.083459+0000 mon.a (mon.0) 9385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:36 smithi179 bash[23186]: audit 2024-09-21T02:38:35.062514+0000 mon.a (mon.0) 9383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:36 smithi179 bash[23186]: audit 2024-09-21T02:38:35.072152+0000 mon.a (mon.0) 9384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:36 smithi179 bash[23186]: audit 2024-09-21T02:38:35.083459+0000 mon.a (mon.0) 9385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:36 smithi049 bash[23528]: audit 2024-09-21T02:38:35.062514+0000 mon.a (mon.0) 9383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:36 smithi049 bash[23528]: audit 2024-09-21T02:38:35.072152+0000 mon.a (mon.0) 9384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:36 smithi049 bash[23528]: audit 2024-09-21T02:38:35.083459+0000 mon.a (mon.0) 9385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:37 smithi044 bash[22676]: cluster 2024-09-21T02:38:35.570059+0000 mgr.a (mgr.14388) 11431 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:37 smithi179 bash[23186]: cluster 2024-09-21T02:38:35.570059+0000 mgr.a (mgr.14388) 11431 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:37 smithi049 bash[23528]: cluster 2024-09-21T02:38:35.570059+0000 mgr.a (mgr.14388) 11431 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:37.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:37.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:38.603 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:38.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:38.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:38.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:38.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:39 smithi044 bash[22676]: cluster 2024-09-21T02:38:37.570827+0000 mgr.a (mgr.14388) 11432 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:39 smithi044 bash[22676]: audit 2024-09-21T02:38:38.180607+0000 mgr.a (mgr.14388) 11433 : audit [DBG] from='client.251040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:39 smithi179 bash[23186]: cluster 2024-09-21T02:38:37.570827+0000 mgr.a (mgr.14388) 11432 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:39 smithi179 bash[23186]: audit 2024-09-21T02:38:38.180607+0000 mgr.a (mgr.14388) 11433 : audit [DBG] from='client.251040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:39 smithi049 bash[23528]: cluster 2024-09-21T02:38:37.570827+0000 mgr.a (mgr.14388) 11432 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:39 smithi049 bash[23528]: audit 2024-09-21T02:38:38.180607+0000 mgr.a (mgr.14388) 11433 : audit [DBG] from='client.251040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:41 smithi044 bash[22676]: cluster 2024-09-21T02:38:39.571837+0000 mgr.a (mgr.14388) 11434 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:41.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:41 smithi179 bash[23186]: cluster 2024-09-21T02:38:39.571837+0000 mgr.a (mgr.14388) 11434 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:41 smithi049 bash[23528]: cluster 2024-09-21T02:38:39.571837+0000 mgr.a (mgr.14388) 11434 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:43 smithi044 bash[22676]: cluster 2024-09-21T02:38:41.574131+0000 mgr.a (mgr.14388) 11435 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:43 smithi044 bash[22676]: audit 2024-09-21T02:38:42.232699+0000 mon.a (mon.0) 9386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:43 smithi044 bash[22676]: audit 2024-09-21T02:38:42.241562+0000 mon.a (mon.0) 9387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:43 smithi044 bash[22676]: audit 2024-09-21T02:38:42.251995+0000 mon.a (mon.0) 9388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:43 smithi179 bash[23186]: cluster 2024-09-21T02:38:41.574131+0000 mgr.a (mgr.14388) 11435 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:43 smithi179 bash[23186]: audit 2024-09-21T02:38:42.232699+0000 mon.a (mon.0) 9386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:43 smithi179 bash[23186]: audit 2024-09-21T02:38:42.241562+0000 mon.a (mon.0) 9387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:43 smithi179 bash[23186]: audit 2024-09-21T02:38:42.251995+0000 mon.a (mon.0) 9388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:43 smithi049 bash[23528]: cluster 2024-09-21T02:38:41.574131+0000 mgr.a (mgr.14388) 11435 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:43 smithi049 bash[23528]: audit 2024-09-21T02:38:42.232699+0000 mon.a (mon.0) 9386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:43 smithi049 bash[23528]: audit 2024-09-21T02:38:42.241562+0000 mon.a (mon.0) 9387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:43 smithi049 bash[23528]: audit 2024-09-21T02:38:42.251995+0000 mon.a (mon.0) 9388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:43.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:44.398 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:44.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:44.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:44.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:44.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:45 smithi044 bash[22676]: cluster 2024-09-21T02:38:43.575038+0000 mgr.a (mgr.14388) 11436 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:45 smithi044 bash[22676]: audit 2024-09-21T02:38:43.942546+0000 mgr.a (mgr.14388) 11437 : audit [DBG] from='client.251118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:45 smithi179 bash[23186]: cluster 2024-09-21T02:38:43.575038+0000 mgr.a (mgr.14388) 11436 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:45 smithi179 bash[23186]: audit 2024-09-21T02:38:43.942546+0000 mgr.a (mgr.14388) 11437 : audit [DBG] from='client.251118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:45 smithi049 bash[23528]: cluster 2024-09-21T02:38:43.575038+0000 mgr.a (mgr.14388) 11436 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:45 smithi049 bash[23528]: audit 2024-09-21T02:38:43.942546+0000 mgr.a (mgr.14388) 11437 : audit [DBG] from='client.251118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:47 smithi044 bash[22676]: cluster 2024-09-21T02:38:45.577538+0000 mgr.a (mgr.14388) 11438 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:47.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:47 smithi179 bash[23186]: cluster 2024-09-21T02:38:45.577538+0000 mgr.a (mgr.14388) 11438 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:47 smithi049 bash[23528]: cluster 2024-09-21T02:38:45.577538+0000 mgr.a (mgr.14388) 11438 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:38:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:49 smithi044 bash[22676]: cluster 2024-09-21T02:38:47.578331+0000 mgr.a (mgr.14388) 11439 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:49.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:49 smithi179 bash[23186]: cluster 2024-09-21T02:38:47.578331+0000 mgr.a (mgr.14388) 11439 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:49 smithi049 bash[23528]: cluster 2024-09-21T02:38:47.578331+0000 mgr.a (mgr.14388) 11439 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:50.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:50.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:50.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:50.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:50.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:51 smithi179 bash[23186]: cluster 2024-09-21T02:38:49.579083+0000 mgr.a (mgr.14388) 11440 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:51 smithi179 bash[23186]: audit 2024-09-21T02:38:49.731883+0000 mgr.a (mgr.14388) 11441 : audit [DBG] from='client.251193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:51 smithi049 bash[23528]: cluster 2024-09-21T02:38:49.579083+0000 mgr.a (mgr.14388) 11440 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:51 smithi049 bash[23528]: audit 2024-09-21T02:38:49.731883+0000 mgr.a (mgr.14388) 11441 : audit [DBG] from='client.251193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:51 smithi044 bash[22676]: cluster 2024-09-21T02:38:49.579083+0000 mgr.a (mgr.14388) 11440 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:51 smithi044 bash[22676]: audit 2024-09-21T02:38:49.731883+0000 mgr.a (mgr.14388) 11441 : audit [DBG] from='client.251193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:53 smithi179 bash[23186]: cluster 2024-09-21T02:38:51.581972+0000 mgr.a (mgr.14388) 11442 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:38:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:53 smithi049 bash[23528]: cluster 2024-09-21T02:38:51.581972+0000 mgr.a (mgr.14388) 11442 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:38:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:53 smithi044 bash[22676]: cluster 2024-09-21T02:38:51.581972+0000 mgr.a (mgr.14388) 11442 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T02:38:55.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:38:55.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:38:55.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:38:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:55 smithi044 bash[22676]: cluster 2024-09-21T02:38:53.582758+0000 mgr.a (mgr.14388) 11443 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:38:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:55 smithi044 bash[22676]: audit 2024-09-21T02:38:55.158840+0000 mon.a (mon.0) 9389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:55 smithi044 bash[22676]: audit 2024-09-21T02:38:55.167076+0000 mon.a (mon.0) 9390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:55 smithi044 bash[22676]: audit 2024-09-21T02:38:55.178101+0000 mon.a (mon.0) 9391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:55 smithi049 bash[23528]: cluster 2024-09-21T02:38:53.582758+0000 mgr.a (mgr.14388) 11443 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:38:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:55 smithi049 bash[23528]: audit 2024-09-21T02:38:55.158840+0000 mon.a (mon.0) 9389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:55 smithi049 bash[23528]: audit 2024-09-21T02:38:55.167076+0000 mon.a (mon.0) 9390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:55 smithi049 bash[23528]: audit 2024-09-21T02:38:55.178101+0000 mon.a (mon.0) 9391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:55 smithi179 bash[23186]: cluster 2024-09-21T02:38:53.582758+0000 mgr.a (mgr.14388) 11443 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:38:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:55 smithi179 bash[23186]: audit 2024-09-21T02:38:55.158840+0000 mon.a (mon.0) 9389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:55 smithi179 bash[23186]: audit 2024-09-21T02:38:55.167076+0000 mon.a (mon.0) 9390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:55 smithi179 bash[23186]: audit 2024-09-21T02:38:55.178101+0000 mon.a (mon.0) 9391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:55.967 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:38:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:38:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:38:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:38:55.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:38:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:56 smithi049 bash[23528]: audit 2024-09-21T02:38:55.290685+0000 mon.a (mon.0) 9392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:56 smithi049 bash[23528]: audit 2024-09-21T02:38:55.296732+0000 mon.a (mon.0) 9393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:56 smithi049 bash[23528]: audit 2024-09-21T02:38:55.303285+0000 mon.a (mon.0) 9394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:56 smithi049 bash[23528]: audit 2024-09-21T02:38:55.515717+0000 mgr.a (mgr.14388) 11444 : audit [DBG] from='client.251268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:56 smithi044 bash[22676]: audit 2024-09-21T02:38:55.290685+0000 mon.a (mon.0) 9392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:56 smithi044 bash[22676]: audit 2024-09-21T02:38:55.296732+0000 mon.a (mon.0) 9393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:56 smithi044 bash[22676]: audit 2024-09-21T02:38:55.303285+0000 mon.a (mon.0) 9394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:56 smithi044 bash[22676]: audit 2024-09-21T02:38:55.515717+0000 mgr.a (mgr.14388) 11444 : audit [DBG] from='client.251268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:56 smithi179 bash[23186]: audit 2024-09-21T02:38:55.290685+0000 mon.a (mon.0) 9392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:56 smithi179 bash[23186]: audit 2024-09-21T02:38:55.296732+0000 mon.a (mon.0) 9393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:56 smithi179 bash[23186]: audit 2024-09-21T02:38:55.303285+0000 mon.a (mon.0) 9394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:38:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:56 smithi179 bash[23186]: audit 2024-09-21T02:38:55.515717+0000 mgr.a (mgr.14388) 11444 : audit [DBG] from='client.251268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:57 smithi044 bash[22676]: cluster 2024-09-21T02:38:55.584597+0000 mgr.a (mgr.14388) 11445 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:57.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:57 smithi179 bash[23186]: cluster 2024-09-21T02:38:55.584597+0000 mgr.a (mgr.14388) 11445 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:57 smithi049 bash[23528]: cluster 2024-09-21T02:38:55.584597+0000 mgr.a (mgr.14388) 11445 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:38:59.609 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:38:59 smithi049 bash[23528]: cluster 2024-09-21T02:38:57.585541+0000 mgr.a (mgr.14388) 11446 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:38:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:38:59 smithi044 bash[22676]: cluster 2024-09-21T02:38:57.585541+0000 mgr.a (mgr.14388) 11446 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:38:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:38:59 smithi179 bash[23186]: cluster 2024-09-21T02:38:57.585541+0000 mgr.a (mgr.14388) 11446 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:39:00.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:00.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:01 smithi044 bash[22676]: cluster 2024-09-21T02:38:59.586330+0000 mgr.a (mgr.14388) 11447 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:39:01.718 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:01.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:01.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:01.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:01.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:01 smithi179 bash[23186]: cluster 2024-09-21T02:38:59.586330+0000 mgr.a (mgr.14388) 11447 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:39:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:01 smithi049 bash[23528]: cluster 2024-09-21T02:38:59.586330+0000 mgr.a (mgr.14388) 11447 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:39:02.607 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:02 smithi049 bash[23528]: audit 2024-09-21T02:39:01.299916+0000 mgr.a (mgr.14388) 11448 : audit [DBG] from='client.251343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:02 smithi044 bash[22676]: audit 2024-09-21T02:39:01.299916+0000 mgr.a (mgr.14388) 11448 : audit [DBG] from='client.251343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:02 smithi179 bash[23186]: audit 2024-09-21T02:39:01.299916+0000 mgr.a (mgr.14388) 11448 : audit [DBG] from='client.251343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:03 smithi044 bash[22676]: cluster 2024-09-21T02:39:01.587938+0000 mgr.a (mgr.14388) 11449 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:03 smithi044 bash[22676]: audit 2024-09-21T02:39:02.424833+0000 mon.a (mon.0) 9395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:03 smithi044 bash[22676]: audit 2024-09-21T02:39:02.433433+0000 mon.a (mon.0) 9396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:03 smithi044 bash[22676]: audit 2024-09-21T02:39:02.443922+0000 mon.a (mon.0) 9397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:03 smithi179 bash[23186]: cluster 2024-09-21T02:39:01.587938+0000 mgr.a (mgr.14388) 11449 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:03 smithi179 bash[23186]: audit 2024-09-21T02:39:02.424833+0000 mon.a (mon.0) 9395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:03 smithi179 bash[23186]: audit 2024-09-21T02:39:02.433433+0000 mon.a (mon.0) 9396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:03 smithi179 bash[23186]: audit 2024-09-21T02:39:02.443922+0000 mon.a (mon.0) 9397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:03 smithi049 bash[23528]: cluster 2024-09-21T02:39:01.587938+0000 mgr.a (mgr.14388) 11449 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:03 smithi049 bash[23528]: audit 2024-09-21T02:39:02.424833+0000 mon.a (mon.0) 9395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:03 smithi049 bash[23528]: audit 2024-09-21T02:39:02.433433+0000 mon.a (mon.0) 9396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:03.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:03 smithi049 bash[23528]: audit 2024-09-21T02:39:02.443922+0000 mon.a (mon.0) 9397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:05 smithi044 bash[22676]: cluster 2024-09-21T02:39:03.588824+0000 mgr.a (mgr.14388) 11450 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:39:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:05 smithi179 bash[23186]: cluster 2024-09-21T02:39:03.588824+0000 mgr.a (mgr.14388) 11450 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:39:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:05 smithi049 bash[23528]: cluster 2024-09-21T02:39:03.588824+0000 mgr.a (mgr.14388) 11450 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:39:06.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:06.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:06.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:07.514 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:07.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:07.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:07.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:07.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:07 smithi044 bash[22676]: cluster 2024-09-21T02:39:05.591057+0000 mgr.a (mgr.14388) 11451 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:39:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:07 smithi179 bash[23186]: cluster 2024-09-21T02:39:05.591057+0000 mgr.a (mgr.14388) 11451 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:39:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:07 smithi049 bash[23528]: cluster 2024-09-21T02:39:05.591057+0000 mgr.a (mgr.14388) 11451 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:39:08.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:08 smithi044 bash[22676]: audit 2024-09-21T02:39:07.057825+0000 mgr.a (mgr.14388) 11452 : audit [DBG] from='client.251418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:08 smithi179 bash[23186]: audit 2024-09-21T02:39:07.057825+0000 mgr.a (mgr.14388) 11452 : audit [DBG] from='client.251418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:08 smithi049 bash[23528]: audit 2024-09-21T02:39:07.057825+0000 mgr.a (mgr.14388) 11452 : audit [DBG] from='client.251418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22676]: cluster 2024-09-21T02:39:07.591769+0000 mgr.a (mgr.14388) 11453 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22676]: audit 2024-09-21T02:39:08.578729+0000 mon.a (mon.0) 9398 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:39:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22676]: audit 2024-09-21T02:39:08.582821+0000 mon.a (mon.0) 9399 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:39:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22676]: audit 2024-09-21T02:39:08.583882+0000 mon.a (mon.0) 9400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:39:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22676]: audit 2024-09-21T02:39:08.590352+0000 mon.a (mon.0) 9401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22676]: audit 2024-09-21T02:39:08.593584+0000 mon.a (mon.0) 9402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:39:09.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22930]: debug 2024-09-21T02:39:09.341+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:39:09.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:39:09 smithi044 bash[22930]: debug 2024-09-21T02:39:09.341+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:39:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:09 smithi179 bash[23186]: cluster 2024-09-21T02:39:07.591769+0000 mgr.a (mgr.14388) 11453 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:09 smithi179 bash[23186]: audit 2024-09-21T02:39:08.578729+0000 mon.a (mon.0) 9398 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:39:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:09 smithi179 bash[23186]: audit 2024-09-21T02:39:08.582821+0000 mon.a (mon.0) 9399 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:39:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:09 smithi179 bash[23186]: audit 2024-09-21T02:39:08.583882+0000 mon.a (mon.0) 9400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:39:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:09 smithi179 bash[23186]: audit 2024-09-21T02:39:08.590352+0000 mon.a (mon.0) 9401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:09 smithi179 bash[23186]: audit 2024-09-21T02:39:08.593584+0000 mon.a (mon.0) 9402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:39:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:09 smithi049 bash[23528]: cluster 2024-09-21T02:39:07.591769+0000 mgr.a (mgr.14388) 11453 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:09 smithi049 bash[23528]: audit 2024-09-21T02:39:08.578729+0000 mon.a (mon.0) 9398 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:39:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:09 smithi049 bash[23528]: audit 2024-09-21T02:39:08.582821+0000 mon.a (mon.0) 9399 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:39:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:09 smithi049 bash[23528]: audit 2024-09-21T02:39:08.583882+0000 mon.a (mon.0) 9400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:39:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:09 smithi049 bash[23528]: audit 2024-09-21T02:39:08.590352+0000 mon.a (mon.0) 9401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:09 smithi049 bash[23528]: audit 2024-09-21T02:39:08.593584+0000 mon.a (mon.0) 9402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:39:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:10 smithi044 bash[22676]: audit 2024-09-21T02:39:08.594869+0000 mgr.a (mgr.14388) 11454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:39:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:10 smithi044 bash[22676]: audit 2024-09-21T02:39:09.343060+0000 mgr.a (mgr.14388) 11455 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:39:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:10 smithi044 bash[22676]: cephadm 2024-09-21T02:39:09.344239+0000 mgr.a (mgr.14388) 11456 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:39:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:10 smithi179 bash[23186]: audit 2024-09-21T02:39:08.594869+0000 mgr.a (mgr.14388) 11454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:39:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:10 smithi179 bash[23186]: audit 2024-09-21T02:39:09.343060+0000 mgr.a (mgr.14388) 11455 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:39:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:10 smithi179 bash[23186]: cephadm 2024-09-21T02:39:09.344239+0000 mgr.a (mgr.14388) 11456 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:39:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:10 smithi049 bash[23528]: audit 2024-09-21T02:39:08.594869+0000 mgr.a (mgr.14388) 11454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:39:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:10 smithi049 bash[23528]: audit 2024-09-21T02:39:09.343060+0000 mgr.a (mgr.14388) 11455 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:39:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:10 smithi049 bash[23528]: cephadm 2024-09-21T02:39:09.344239+0000 mgr.a (mgr.14388) 11456 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:39:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:11 smithi044 bash[22676]: cluster 2024-09-21T02:39:09.592633+0000 mgr.a (mgr.14388) 11457 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:11 smithi179 bash[23186]: cluster 2024-09-21T02:39:09.592633+0000 mgr.a (mgr.14388) 11457 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:11 smithi049 bash[23528]: cluster 2024-09-21T02:39:09.592633+0000 mgr.a (mgr.14388) 11457 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:12.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:12.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:12.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:13.284 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:13 smithi044 bash[22676]: cluster 2024-09-21T02:39:11.594910+0000 mgr.a (mgr.14388) 11458 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:13 smithi179 bash[23186]: cluster 2024-09-21T02:39:11.594910+0000 mgr.a (mgr.14388) 11458 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:13 smithi049 bash[23528]: cluster 2024-09-21T02:39:11.594910+0000 mgr.a (mgr.14388) 11458 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:14 smithi044 bash[22676]: audit 2024-09-21T02:39:12.854426+0000 mgr.a (mgr.14388) 11459 : audit [DBG] from='client.251601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:14.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:14 smithi179 bash[23186]: audit 2024-09-21T02:39:12.854426+0000 mgr.a (mgr.14388) 11459 : audit [DBG] from='client.251601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:14 smithi049 bash[23528]: audit 2024-09-21T02:39:12.854426+0000 mgr.a (mgr.14388) 11459 : audit [DBG] from='client.251601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:15 smithi044 bash[22676]: cluster 2024-09-21T02:39:13.595869+0000 mgr.a (mgr.14388) 11460 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:15 smithi044 bash[22676]: audit 2024-09-21T02:39:15.385364+0000 mon.a (mon.0) 9403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:15 smithi044 bash[22676]: audit 2024-09-21T02:39:15.393672+0000 mon.a (mon.0) 9404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:15 smithi044 bash[22676]: audit 2024-09-21T02:39:15.404066+0000 mon.a (mon.0) 9405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:15 smithi179 bash[23186]: cluster 2024-09-21T02:39:13.595869+0000 mgr.a (mgr.14388) 11460 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:15 smithi179 bash[23186]: audit 2024-09-21T02:39:15.385364+0000 mon.a (mon.0) 9403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:15 smithi179 bash[23186]: audit 2024-09-21T02:39:15.393672+0000 mon.a (mon.0) 9404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:15 smithi179 bash[23186]: audit 2024-09-21T02:39:15.404066+0000 mon.a (mon.0) 9405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:15 smithi049 bash[23528]: cluster 2024-09-21T02:39:13.595869+0000 mgr.a (mgr.14388) 11460 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:15 smithi049 bash[23528]: audit 2024-09-21T02:39:15.385364+0000 mon.a (mon.0) 9403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:15 smithi049 bash[23528]: audit 2024-09-21T02:39:15.393672+0000 mon.a (mon.0) 9404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:15 smithi049 bash[23528]: audit 2024-09-21T02:39:15.404066+0000 mon.a (mon.0) 9405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:16 smithi049 bash[23528]: audit 2024-09-21T02:39:15.513164+0000 mon.a (mon.0) 9406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:16 smithi049 bash[23528]: audit 2024-09-21T02:39:15.522736+0000 mon.a (mon.0) 9407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:16 smithi049 bash[23528]: audit 2024-09-21T02:39:15.542056+0000 mon.a (mon.0) 9408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:16 smithi044 bash[22676]: audit 2024-09-21T02:39:15.513164+0000 mon.a (mon.0) 9406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:16 smithi044 bash[22676]: audit 2024-09-21T02:39:15.522736+0000 mon.a (mon.0) 9407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:16.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:16 smithi044 bash[22676]: audit 2024-09-21T02:39:15.542056+0000 mon.a (mon.0) 9408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:17.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:16 smithi179 bash[23186]: audit 2024-09-21T02:39:15.513164+0000 mon.a (mon.0) 9406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:16 smithi179 bash[23186]: audit 2024-09-21T02:39:15.522736+0000 mon.a (mon.0) 9407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:16 smithi179 bash[23186]: audit 2024-09-21T02:39:15.542056+0000 mon.a (mon.0) 9408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:17 smithi049 bash[23528]: cluster 2024-09-21T02:39:15.598177+0000 mgr.a (mgr.14388) 11461 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:17 smithi044 bash[22676]: cluster 2024-09-21T02:39:15.598177+0000 mgr.a (mgr.14388) 11461 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:17 smithi179 bash[23186]: cluster 2024-09-21T02:39:15.598177+0000 mgr.a (mgr.14388) 11461 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:18.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:18.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:18.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:19.084 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:19.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:19.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:19.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:19.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:19 smithi049 bash[23528]: cluster 2024-09-21T02:39:17.598961+0000 mgr.a (mgr.14388) 11462 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:19 smithi044 bash[22676]: cluster 2024-09-21T02:39:17.598961+0000 mgr.a (mgr.14388) 11462 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:19 smithi179 bash[23186]: cluster 2024-09-21T02:39:17.598961+0000 mgr.a (mgr.14388) 11462 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:20 smithi049 bash[23528]: audit 2024-09-21T02:39:18.622805+0000 mgr.a (mgr.14388) 11463 : audit [DBG] from='client.251676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:20 smithi049 bash[23528]: cluster 2024-09-21T02:39:19.599959+0000 mgr.a (mgr.14388) 11464 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:20 smithi044 bash[22676]: audit 2024-09-21T02:39:18.622805+0000 mgr.a (mgr.14388) 11463 : audit [DBG] from='client.251676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:20.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:20 smithi044 bash[22676]: cluster 2024-09-21T02:39:19.599959+0000 mgr.a (mgr.14388) 11464 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:20 smithi179 bash[23186]: audit 2024-09-21T02:39:18.622805+0000 mgr.a (mgr.14388) 11463 : audit [DBG] from='client.251676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:20 smithi179 bash[23186]: cluster 2024-09-21T02:39:19.599959+0000 mgr.a (mgr.14388) 11464 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:22.912 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:22 smithi049 bash[23528]: cluster 2024-09-21T02:39:21.602246+0000 mgr.a (mgr.14388) 11465 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:22.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:22 smithi044 bash[22676]: cluster 2024-09-21T02:39:21.602246+0000 mgr.a (mgr.14388) 11465 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:22 smithi179 bash[23186]: cluster 2024-09-21T02:39:21.602246+0000 mgr.a (mgr.14388) 11465 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:39:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:23 smithi044 bash[22676]: audit 2024-09-21T02:39:22.656307+0000 mon.a (mon.0) 9409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:23 smithi044 bash[22676]: audit 2024-09-21T02:39:22.669958+0000 mon.a (mon.0) 9410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:23 smithi044 bash[22676]: audit 2024-09-21T02:39:22.680676+0000 mon.a (mon.0) 9411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:23 smithi179 bash[23186]: audit 2024-09-21T02:39:22.656307+0000 mon.a (mon.0) 9409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:23 smithi179 bash[23186]: audit 2024-09-21T02:39:22.669958+0000 mon.a (mon.0) 9410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:23 smithi179 bash[23186]: audit 2024-09-21T02:39:22.680676+0000 mon.a (mon.0) 9411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:23 smithi049 bash[23528]: audit 2024-09-21T02:39:22.656307+0000 mon.a (mon.0) 9409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:23 smithi049 bash[23528]: audit 2024-09-21T02:39:22.669958+0000 mon.a (mon.0) 9410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:23 smithi049 bash[23528]: audit 2024-09-21T02:39:22.680676+0000 mon.a (mon.0) 9411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:24.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:24.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:24.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:24.852 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:24.950 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:24 smithi179 bash[23186]: cluster 2024-09-21T02:39:23.603030+0000 mgr.a (mgr.14388) 11466 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:24.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:24 smithi179 bash[23186]: audit 2024-09-21T02:39:24.421367+0000 mgr.a (mgr.14388) 11467 : audit [DBG] from='client.251754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:24 smithi044 bash[22676]: cluster 2024-09-21T02:39:23.603030+0000 mgr.a (mgr.14388) 11466 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:24 smithi044 bash[22676]: audit 2024-09-21T02:39:24.421367+0000 mgr.a (mgr.14388) 11467 : audit [DBG] from='client.251754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:24 smithi049 bash[23528]: cluster 2024-09-21T02:39:23.603030+0000 mgr.a (mgr.14388) 11466 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:24 smithi049 bash[23528]: audit 2024-09-21T02:39:24.421367+0000 mgr.a (mgr.14388) 11467 : audit [DBG] from='client.251754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:26 smithi044 bash[22676]: cluster 2024-09-21T02:39:25.605371+0000 mgr.a (mgr.14388) 11468 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:26 smithi179 bash[23186]: cluster 2024-09-21T02:39:25.605371+0000 mgr.a (mgr.14388) 11468 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:26 smithi049 bash[23528]: cluster 2024-09-21T02:39:25.605371+0000 mgr.a (mgr.14388) 11468 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:28.968 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:28 smithi044 bash[22676]: cluster 2024-09-21T02:39:27.606182+0000 mgr.a (mgr.14388) 11469 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:28 smithi179 bash[23186]: cluster 2024-09-21T02:39:27.606182+0000 mgr.a (mgr.14388) 11469 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:28 smithi049 bash[23528]: cluster 2024-09-21T02:39:27.606182+0000 mgr.a (mgr.14388) 11469 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:29.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:29.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:30.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:30 smithi044 bash[22676]: cluster 2024-09-21T02:39:29.606954+0000 mgr.a (mgr.14388) 11470 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:30.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:30 smithi044 bash[22676]: audit 2024-09-21T02:39:30.191763+0000 mgr.a (mgr.14388) 11471 : audit [DBG] from='client.251832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:30 smithi179 bash[23186]: cluster 2024-09-21T02:39:29.606954+0000 mgr.a (mgr.14388) 11470 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:30 smithi179 bash[23186]: audit 2024-09-21T02:39:30.191763+0000 mgr.a (mgr.14388) 11471 : audit [DBG] from='client.251832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:30 smithi049 bash[23528]: cluster 2024-09-21T02:39:29.606954+0000 mgr.a (mgr.14388) 11470 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:30 smithi049 bash[23528]: audit 2024-09-21T02:39:30.191763+0000 mgr.a (mgr.14388) 11471 : audit [DBG] from='client.251832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:32.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:32 smithi044 bash[22676]: cluster 2024-09-21T02:39:31.610607+0000 mgr.a (mgr.14388) 11472 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:32 smithi179 bash[23186]: cluster 2024-09-21T02:39:31.610607+0000 mgr.a (mgr.14388) 11472 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:32 smithi049 bash[23528]: cluster 2024-09-21T02:39:31.610607+0000 mgr.a (mgr.14388) 11472 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:34 smithi044 bash[22676]: cluster 2024-09-21T02:39:33.611450+0000 mgr.a (mgr.14388) 11473 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:39:35.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:34 smithi179 bash[23186]: cluster 2024-09-21T02:39:33.611450+0000 mgr.a (mgr.14388) 11473 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:39:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:34 smithi049 bash[23528]: cluster 2024-09-21T02:39:33.611450+0000 mgr.a (mgr.14388) 11473 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:39:35.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:35.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:35.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:36.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:36.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:36.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:36.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:36.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: audit 2024-09-21T02:39:35.611429+0000 mon.a (mon.0) 9412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: cluster 2024-09-21T02:39:35.612884+0000 mgr.a (mgr.14388) 11474 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: audit 2024-09-21T02:39:35.619607+0000 mon.a (mon.0) 9413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: audit 2024-09-21T02:39:35.628492+0000 mon.a (mon.0) 9414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: audit 2024-09-21T02:39:35.748562+0000 mon.a (mon.0) 9415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: audit 2024-09-21T02:39:35.754093+0000 mon.a (mon.0) 9416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: audit 2024-09-21T02:39:35.762136+0000 mon.a (mon.0) 9417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:36 smithi044 bash[22676]: audit 2024-09-21T02:39:35.976455+0000 mgr.a (mgr.14388) 11475 : audit [DBG] from='client.251907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: audit 2024-09-21T02:39:35.611429+0000 mon.a (mon.0) 9412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: cluster 2024-09-21T02:39:35.612884+0000 mgr.a (mgr.14388) 11474 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: audit 2024-09-21T02:39:35.619607+0000 mon.a (mon.0) 9413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: audit 2024-09-21T02:39:35.628492+0000 mon.a (mon.0) 9414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: audit 2024-09-21T02:39:35.748562+0000 mon.a (mon.0) 9415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: audit 2024-09-21T02:39:35.754093+0000 mon.a (mon.0) 9416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: audit 2024-09-21T02:39:35.762136+0000 mon.a (mon.0) 9417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:36 smithi179 bash[23186]: audit 2024-09-21T02:39:35.976455+0000 mgr.a (mgr.14388) 11475 : audit [DBG] from='client.251907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: audit 2024-09-21T02:39:35.611429+0000 mon.a (mon.0) 9412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: cluster 2024-09-21T02:39:35.612884+0000 mgr.a (mgr.14388) 11474 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: audit 2024-09-21T02:39:35.619607+0000 mon.a (mon.0) 9413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: audit 2024-09-21T02:39:35.628492+0000 mon.a (mon.0) 9414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: audit 2024-09-21T02:39:35.748562+0000 mon.a (mon.0) 9415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: audit 2024-09-21T02:39:35.754093+0000 mon.a (mon.0) 9416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: audit 2024-09-21T02:39:35.762136+0000 mon.a (mon.0) 9417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:36 smithi049 bash[23528]: audit 2024-09-21T02:39:35.976455+0000 mgr.a (mgr.14388) 11475 : audit [DBG] from='client.251907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:38 smithi044 bash[22676]: cluster 2024-09-21T02:39:37.613790+0000 mgr.a (mgr.14388) 11476 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:39:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:38 smithi179 bash[23186]: cluster 2024-09-21T02:39:37.613790+0000 mgr.a (mgr.14388) 11476 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:39:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:38 smithi049 bash[23528]: cluster 2024-09-21T02:39:37.613790+0000 mgr.a (mgr.14388) 11476 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:39:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:40 smithi049 bash[23528]: cluster 2024-09-21T02:39:39.614584+0000 mgr.a (mgr.14388) 11477 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:39:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:40 smithi044 bash[22676]: cluster 2024-09-21T02:39:39.614584+0000 mgr.a (mgr.14388) 11477 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:39:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:40 smithi179 bash[23186]: cluster 2024-09-21T02:39:39.614584+0000 mgr.a (mgr.14388) 11477 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:39:41.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:41.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:41.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:42.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:42.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:42.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:42.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:42.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:42 smithi049 bash[23528]: cluster 2024-09-21T02:39:41.616712+0000 mgr.a (mgr.14388) 11478 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:42 smithi049 bash[23528]: audit 2024-09-21T02:39:41.778669+0000 mgr.a (mgr.14388) 11479 : audit [DBG] from='client.251982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:42 smithi044 bash[22676]: cluster 2024-09-21T02:39:41.616712+0000 mgr.a (mgr.14388) 11478 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:42 smithi044 bash[22676]: audit 2024-09-21T02:39:41.778669+0000 mgr.a (mgr.14388) 11479 : audit [DBG] from='client.251982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:42 smithi179 bash[23186]: cluster 2024-09-21T02:39:41.616712+0000 mgr.a (mgr.14388) 11478 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:42 smithi179 bash[23186]: audit 2024-09-21T02:39:41.778669+0000 mgr.a (mgr.14388) 11479 : audit [DBG] from='client.251982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:44.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:43 smithi179 bash[23186]: audit 2024-09-21T02:39:42.869116+0000 mon.a (mon.0) 9418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:43 smithi179 bash[23186]: audit 2024-09-21T02:39:42.877815+0000 mon.a (mon.0) 9419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:43 smithi179 bash[23186]: audit 2024-09-21T02:39:42.888490+0000 mon.a (mon.0) 9420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.221 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:43 smithi049 bash[23528]: audit 2024-09-21T02:39:42.869116+0000 mon.a (mon.0) 9418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.221 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:43 smithi049 bash[23528]: audit 2024-09-21T02:39:42.877815+0000 mon.a (mon.0) 9419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.221 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:43 smithi049 bash[23528]: audit 2024-09-21T02:39:42.888490+0000 mon.a (mon.0) 9420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:43 smithi044 bash[22676]: audit 2024-09-21T02:39:42.869116+0000 mon.a (mon.0) 9418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:43 smithi044 bash[22676]: audit 2024-09-21T02:39:42.877815+0000 mon.a (mon.0) 9419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:43 smithi044 bash[22676]: audit 2024-09-21T02:39:42.888490+0000 mon.a (mon.0) 9420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:45.159 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:44 smithi179 bash[23186]: cluster 2024-09-21T02:39:43.617651+0000 mgr.a (mgr.14388) 11480 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:44 smithi044 bash[22676]: cluster 2024-09-21T02:39:43.617651+0000 mgr.a (mgr.14388) 11480 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:44 smithi049 bash[23528]: cluster 2024-09-21T02:39:43.617651+0000 mgr.a (mgr.14388) 11480 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:47.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:47.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:47.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:46 smithi044 bash[22676]: cluster 2024-09-21T02:39:45.619750+0000 mgr.a (mgr.14388) 11481 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:47.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:46 smithi179 bash[23186]: cluster 2024-09-21T02:39:45.619750+0000 mgr.a (mgr.14388) 11481 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:46 smithi049 bash[23528]: cluster 2024-09-21T02:39:45.619750+0000 mgr.a (mgr.14388) 11481 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:48.012 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:49.160 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:48 smithi044 bash[22676]: audit 2024-09-21T02:39:47.554613+0000 mgr.a (mgr.14388) 11482 : audit [DBG] from='client.252060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:49.161 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:48 smithi044 bash[22676]: cluster 2024-09-21T02:39:47.620399+0000 mgr.a (mgr.14388) 11483 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:48 smithi179 bash[23186]: audit 2024-09-21T02:39:47.554613+0000 mgr.a (mgr.14388) 11482 : audit [DBG] from='client.252060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:48 smithi179 bash[23186]: cluster 2024-09-21T02:39:47.620399+0000 mgr.a (mgr.14388) 11483 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:48 smithi049 bash[23528]: audit 2024-09-21T02:39:47.554613+0000 mgr.a (mgr.14388) 11482 : audit [DBG] from='client.252060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:48 smithi049 bash[23528]: cluster 2024-09-21T02:39:47.620399+0000 mgr.a (mgr.14388) 11483 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:50 smithi044 bash[22676]: cluster 2024-09-21T02:39:49.621485+0000 mgr.a (mgr.14388) 11484 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:51.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:50 smithi179 bash[23186]: cluster 2024-09-21T02:39:49.621485+0000 mgr.a (mgr.14388) 11484 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:50 smithi049 bash[23528]: cluster 2024-09-21T02:39:49.621485+0000 mgr.a (mgr.14388) 11484 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:53.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:53.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:53.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:52 smithi044 bash[22676]: cluster 2024-09-21T02:39:51.623089+0000 mgr.a (mgr.14388) 11485 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:52 smithi179 bash[23186]: cluster 2024-09-21T02:39:51.623089+0000 mgr.a (mgr.14388) 11485 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:52 smithi049 bash[23528]: cluster 2024-09-21T02:39:51.623089+0000 mgr.a (mgr.14388) 11485 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:53.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:39:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:53 smithi044 bash[22676]: audit 2024-09-21T02:39:53.349448+0000 mgr.a (mgr.14388) 11486 : audit [DBG] from='client.252135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:53 smithi179 bash[23186]: audit 2024-09-21T02:39:53.349448+0000 mgr.a (mgr.14388) 11486 : audit [DBG] from='client.252135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:53 smithi049 bash[23528]: audit 2024-09-21T02:39:53.349448+0000 mgr.a (mgr.14388) 11486 : audit [DBG] from='client.252135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:39:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:54 smithi044 bash[22676]: cluster 2024-09-21T02:39:53.623643+0000 mgr.a (mgr.14388) 11487 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:54 smithi179 bash[23186]: cluster 2024-09-21T02:39:53.623643+0000 mgr.a (mgr.14388) 11487 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:54 smithi049 bash[23528]: cluster 2024-09-21T02:39:53.623643+0000 mgr.a (mgr.14388) 11487 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:56 smithi044 bash[22676]: cluster 2024-09-21T02:39:55.625924+0000 mgr.a (mgr.14388) 11488 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:56 smithi044 bash[22676]: audit 2024-09-21T02:39:55.836975+0000 mon.a (mon.0) 9421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:56 smithi044 bash[22676]: audit 2024-09-21T02:39:55.845223+0000 mon.a (mon.0) 9422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:56 smithi044 bash[22676]: audit 2024-09-21T02:39:55.855449+0000 mon.a (mon.0) 9423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:56 smithi044 bash[22676]: audit 2024-09-21T02:39:55.948786+0000 mon.a (mon.0) 9424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:56 smithi044 bash[22676]: audit 2024-09-21T02:39:55.957724+0000 mon.a (mon.0) 9425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:56 smithi044 bash[22676]: audit 2024-09-21T02:39:55.968101+0000 mon.a (mon.0) 9426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:56 smithi179 bash[23186]: cluster 2024-09-21T02:39:55.625924+0000 mgr.a (mgr.14388) 11488 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:56 smithi179 bash[23186]: audit 2024-09-21T02:39:55.836975+0000 mon.a (mon.0) 9421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:56 smithi179 bash[23186]: audit 2024-09-21T02:39:55.845223+0000 mon.a (mon.0) 9422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:56 smithi179 bash[23186]: audit 2024-09-21T02:39:55.855449+0000 mon.a (mon.0) 9423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:56 smithi179 bash[23186]: audit 2024-09-21T02:39:55.948786+0000 mon.a (mon.0) 9424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:56 smithi179 bash[23186]: audit 2024-09-21T02:39:55.957724+0000 mon.a (mon.0) 9425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:56 smithi179 bash[23186]: audit 2024-09-21T02:39:55.968101+0000 mon.a (mon.0) 9426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:56 smithi049 bash[23528]: cluster 2024-09-21T02:39:55.625924+0000 mgr.a (mgr.14388) 11488 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:39:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:56 smithi049 bash[23528]: audit 2024-09-21T02:39:55.836975+0000 mon.a (mon.0) 9421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:56 smithi049 bash[23528]: audit 2024-09-21T02:39:55.845223+0000 mon.a (mon.0) 9422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:56 smithi049 bash[23528]: audit 2024-09-21T02:39:55.855449+0000 mon.a (mon.0) 9423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:56 smithi049 bash[23528]: audit 2024-09-21T02:39:55.948786+0000 mon.a (mon.0) 9424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:56 smithi049 bash[23528]: audit 2024-09-21T02:39:55.957724+0000 mon.a (mon.0) 9425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:56 smithi049 bash[23528]: audit 2024-09-21T02:39:55.968101+0000 mon.a (mon.0) 9426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:39:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:39:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:39:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:39:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:58 smithi044 bash[22676]: cluster 2024-09-21T02:39:57.626714+0000 mgr.a (mgr.14388) 11489 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:59.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:58 smithi179 bash[23186]: cluster 2024-09-21T02:39:57.626714+0000 mgr.a (mgr.14388) 11489 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:58 smithi049 bash[23528]: cluster 2024-09-21T02:39:57.626714+0000 mgr.a (mgr.14388) 11489 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:39:59.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:39:59.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:39:59.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:39:59.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:39:59.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:39:59 smithi044 bash[22676]: audit 2024-09-21T02:39:59.134313+0000 mgr.a (mgr.14388) 11490 : audit [DBG] from='client.252207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:39:59 smithi179 bash[23186]: audit 2024-09-21T02:39:59.134313+0000 mgr.a (mgr.14388) 11490 : audit [DBG] from='client.252207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:39:59 smithi049 bash[23528]: audit 2024-09-21T02:39:59.134313+0000 mgr.a (mgr.14388) 11490 : audit [DBG] from='client.252207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:00 smithi179 bash[23186]: cluster 2024-09-21T02:39:59.627774+0000 mgr.a (mgr.14388) 11491 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:00 smithi179 bash[23186]: cluster 2024-09-21T02:40:00.000148+0000 mon.a (mon.0) 9427 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:40:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:00 smithi044 bash[22676]: cluster 2024-09-21T02:39:59.627774+0000 mgr.a (mgr.14388) 11491 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:00 smithi044 bash[22676]: cluster 2024-09-21T02:40:00.000148+0000 mon.a (mon.0) 9427 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:40:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:00 smithi049 bash[23528]: cluster 2024-09-21T02:39:59.627774+0000 mgr.a (mgr.14388) 11491 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:00 smithi049 bash[23528]: cluster 2024-09-21T02:40:00.000148+0000 mon.a (mon.0) 9427 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:40:03.122 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:02 smithi049 bash[23528]: cluster 2024-09-21T02:40:01.630102+0000 mgr.a (mgr.14388) 11492 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:02 smithi044 bash[22676]: cluster 2024-09-21T02:40:01.630102+0000 mgr.a (mgr.14388) 11492 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:02 smithi179 bash[23186]: cluster 2024-09-21T02:40:01.630102+0000 mgr.a (mgr.14388) 11492 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:04 smithi049 bash[23528]: audit 2024-09-21T02:40:03.099764+0000 mon.a (mon.0) 9428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:04 smithi049 bash[23528]: audit 2024-09-21T02:40:03.108389+0000 mon.a (mon.0) 9429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:04 smithi049 bash[23528]: audit 2024-09-21T02:40:03.118797+0000 mon.a (mon.0) 9430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:04 smithi044 bash[22676]: audit 2024-09-21T02:40:03.099764+0000 mon.a (mon.0) 9428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:04 smithi044 bash[22676]: audit 2024-09-21T02:40:03.108389+0000 mon.a (mon.0) 9429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:04 smithi044 bash[22676]: audit 2024-09-21T02:40:03.118797+0000 mon.a (mon.0) 9430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:04 smithi179 bash[23186]: audit 2024-09-21T02:40:03.099764+0000 mon.a (mon.0) 9428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:04 smithi179 bash[23186]: audit 2024-09-21T02:40:03.108389+0000 mon.a (mon.0) 9429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:04 smithi179 bash[23186]: audit 2024-09-21T02:40:03.118797+0000 mon.a (mon.0) 9430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:04.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:04.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:04.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:05.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:05.463 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:05 smithi179 bash[23186]: cluster 2024-09-21T02:40:03.630880+0000 mgr.a (mgr.14388) 11493 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:05 smithi044 bash[22676]: cluster 2024-09-21T02:40:03.630880+0000 mgr.a (mgr.14388) 11493 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:05 smithi049 bash[23528]: cluster 2024-09-21T02:40:03.630880+0000 mgr.a (mgr.14388) 11493 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:06 smithi044 bash[22676]: audit 2024-09-21T02:40:04.904656+0000 mgr.a (mgr.14388) 11494 : audit [DBG] from='client.252285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:06 smithi179 bash[23186]: audit 2024-09-21T02:40:04.904656+0000 mgr.a (mgr.14388) 11494 : audit [DBG] from='client.252285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:06 smithi049 bash[23528]: audit 2024-09-21T02:40:04.904656+0000 mgr.a (mgr.14388) 11494 : audit [DBG] from='client.252285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:07 smithi179 bash[23186]: cluster 2024-09-21T02:40:05.633631+0000 mgr.a (mgr.14388) 11495 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:07 smithi044 bash[22676]: cluster 2024-09-21T02:40:05.633631+0000 mgr.a (mgr.14388) 11495 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:07 smithi049 bash[23528]: cluster 2024-09-21T02:40:05.633631+0000 mgr.a (mgr.14388) 11495 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:09.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:09 smithi044 bash[22676]: cluster 2024-09-21T02:40:07.634430+0000 mgr.a (mgr.14388) 11496 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:40:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:09 smithi179 bash[23186]: cluster 2024-09-21T02:40:07.634430+0000 mgr.a (mgr.14388) 11496 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:40:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:09 smithi049 bash[23528]: cluster 2024-09-21T02:40:07.634430+0000 mgr.a (mgr.14388) 11496 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:40:10.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:10.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:10.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:10.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22930]: debug 2024-09-21T02:40:10.152+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:40:10.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22930]: debug 2024-09-21T02:40:10.152+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:40:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22676]: audit 2024-09-21T02:40:09.392556+0000 mon.a (mon.0) 9431 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:40:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22676]: audit 2024-09-21T02:40:09.397714+0000 mon.a (mon.0) 9432 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:40:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22676]: audit 2024-09-21T02:40:09.398659+0000 mon.a (mon.0) 9433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:40:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22676]: audit 2024-09-21T02:40:09.406145+0000 mon.a (mon.0) 9434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22676]: audit 2024-09-21T02:40:09.408989+0000 mon.a (mon.0) 9435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:40:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:10 smithi044 bash[22676]: audit 2024-09-21T02:40:09.410052+0000 mgr.a (mgr.14388) 11497 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:40:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:10 smithi179 bash[23186]: audit 2024-09-21T02:40:09.392556+0000 mon.a (mon.0) 9431 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:40:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:10 smithi179 bash[23186]: audit 2024-09-21T02:40:09.397714+0000 mon.a (mon.0) 9432 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:40:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:10 smithi179 bash[23186]: audit 2024-09-21T02:40:09.398659+0000 mon.a (mon.0) 9433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:40:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:10 smithi179 bash[23186]: audit 2024-09-21T02:40:09.406145+0000 mon.a (mon.0) 9434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:10 smithi179 bash[23186]: audit 2024-09-21T02:40:09.408989+0000 mon.a (mon.0) 9435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:40:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:10 smithi179 bash[23186]: audit 2024-09-21T02:40:09.410052+0000 mgr.a (mgr.14388) 11497 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:40:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:10 smithi049 bash[23528]: audit 2024-09-21T02:40:09.392556+0000 mon.a (mon.0) 9431 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:40:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:10 smithi049 bash[23528]: audit 2024-09-21T02:40:09.397714+0000 mon.a (mon.0) 9432 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:40:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:10 smithi049 bash[23528]: audit 2024-09-21T02:40:09.398659+0000 mon.a (mon.0) 9433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:40:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:10 smithi049 bash[23528]: audit 2024-09-21T02:40:09.406145+0000 mon.a (mon.0) 9434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:10 smithi049 bash[23528]: audit 2024-09-21T02:40:09.408989+0000 mon.a (mon.0) 9435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:40:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:10 smithi049 bash[23528]: audit 2024-09-21T02:40:09.410052+0000 mgr.a (mgr.14388) 11497 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:40:11.057 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:11.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:11.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:11.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:11.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:11 smithi044 bash[22676]: cluster 2024-09-21T02:40:09.636453+0000 mgr.a (mgr.14388) 11498 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:40:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:11 smithi044 bash[22676]: audit 2024-09-21T02:40:10.154018+0000 mgr.a (mgr.14388) 11499 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:40:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:11 smithi044 bash[22676]: cephadm 2024-09-21T02:40:10.155073+0000 mgr.a (mgr.14388) 11500 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:11 smithi179 bash[23186]: cluster 2024-09-21T02:40:09.636453+0000 mgr.a (mgr.14388) 11498 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:11 smithi179 bash[23186]: audit 2024-09-21T02:40:10.154018+0000 mgr.a (mgr.14388) 11499 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:40:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:11 smithi179 bash[23186]: cephadm 2024-09-21T02:40:10.155073+0000 mgr.a (mgr.14388) 11500 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:11 smithi049 bash[23528]: cluster 2024-09-21T02:40:09.636453+0000 mgr.a (mgr.14388) 11498 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:11 smithi049 bash[23528]: audit 2024-09-21T02:40:10.154018+0000 mgr.a (mgr.14388) 11499 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:40:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:11 smithi049 bash[23528]: cephadm 2024-09-21T02:40:10.155073+0000 mgr.a (mgr.14388) 11500 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:40:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:12 smithi044 bash[22676]: audit 2024-09-21T02:40:10.635546+0000 mgr.a (mgr.14388) 11501 : audit [DBG] from='client.252468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:12 smithi179 bash[23186]: audit 2024-09-21T02:40:10.635546+0000 mgr.a (mgr.14388) 11501 : audit [DBG] from='client.252468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:12 smithi049 bash[23528]: audit 2024-09-21T02:40:10.635546+0000 mgr.a (mgr.14388) 11501 : audit [DBG] from='client.252468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:13 smithi044 bash[22676]: cluster 2024-09-21T02:40:11.639265+0000 mgr.a (mgr.14388) 11502 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:40:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:13 smithi179 bash[23186]: cluster 2024-09-21T02:40:11.639265+0000 mgr.a (mgr.14388) 11502 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:40:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:13 smithi049 bash[23528]: cluster 2024-09-21T02:40:11.639265+0000 mgr.a (mgr.14388) 11502 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:40:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:15 smithi044 bash[22676]: cluster 2024-09-21T02:40:13.640049+0000 mgr.a (mgr.14388) 11503 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:40:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:15 smithi179 bash[23186]: cluster 2024-09-21T02:40:13.640049+0000 mgr.a (mgr.14388) 11503 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:40:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:15 smithi049 bash[23528]: cluster 2024-09-21T02:40:13.640049+0000 mgr.a (mgr.14388) 11503 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:40:16.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:16.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:16.858 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: cluster 2024-09-21T02:40:15.642061+0000 mgr.a (mgr.14388) 11504 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: audit 2024-09-21T02:40:16.078249+0000 mon.a (mon.0) 9436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: audit 2024-09-21T02:40:16.086696+0000 mon.a (mon.0) 9437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: audit 2024-09-21T02:40:16.097019+0000 mon.a (mon.0) 9438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: audit 2024-09-21T02:40:16.185651+0000 mon.a (mon.0) 9439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: audit 2024-09-21T02:40:16.194728+0000 mon.a (mon.0) 9440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: audit 2024-09-21T02:40:16.205157+0000 mon.a (mon.0) 9441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:17 smithi044 bash[22676]: audit 2024-09-21T02:40:16.404515+0000 mgr.a (mgr.14388) 11505 : audit [DBG] from='client.252546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: cluster 2024-09-21T02:40:15.642061+0000 mgr.a (mgr.14388) 11504 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: audit 2024-09-21T02:40:16.078249+0000 mon.a (mon.0) 9436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: audit 2024-09-21T02:40:16.086696+0000 mon.a (mon.0) 9437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: audit 2024-09-21T02:40:16.097019+0000 mon.a (mon.0) 9438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: audit 2024-09-21T02:40:16.185651+0000 mon.a (mon.0) 9439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: audit 2024-09-21T02:40:16.194728+0000 mon.a (mon.0) 9440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: audit 2024-09-21T02:40:16.205157+0000 mon.a (mon.0) 9441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:17 smithi179 bash[23186]: audit 2024-09-21T02:40:16.404515+0000 mgr.a (mgr.14388) 11505 : audit [DBG] from='client.252546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: cluster 2024-09-21T02:40:15.642061+0000 mgr.a (mgr.14388) 11504 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: audit 2024-09-21T02:40:16.078249+0000 mon.a (mon.0) 9436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: audit 2024-09-21T02:40:16.086696+0000 mon.a (mon.0) 9437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: audit 2024-09-21T02:40:16.097019+0000 mon.a (mon.0) 9438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: audit 2024-09-21T02:40:16.185651+0000 mon.a (mon.0) 9439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: audit 2024-09-21T02:40:16.194728+0000 mon.a (mon.0) 9440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: audit 2024-09-21T02:40:16.205157+0000 mon.a (mon.0) 9441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:17 smithi049 bash[23528]: audit 2024-09-21T02:40:16.404515+0000 mgr.a (mgr.14388) 11505 : audit [DBG] from='client.252546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:19 smithi044 bash[22676]: cluster 2024-09-21T02:40:17.642981+0000 mgr.a (mgr.14388) 11506 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:19 smithi179 bash[23186]: cluster 2024-09-21T02:40:17.642981+0000 mgr.a (mgr.14388) 11506 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:19 smithi049 bash[23528]: cluster 2024-09-21T02:40:17.642981+0000 mgr.a (mgr.14388) 11506 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:21.451 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:21 smithi049 bash[23528]: cluster 2024-09-21T02:40:19.643771+0000 mgr.a (mgr.14388) 11507 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:21 smithi044 bash[22676]: cluster 2024-09-21T02:40:19.643771+0000 mgr.a (mgr.14388) 11507 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:21 smithi179 bash[23186]: cluster 2024-09-21T02:40:19.643771+0000 mgr.a (mgr.14388) 11507 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:22.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:22.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:22.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:22.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:22.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:23 smithi049 bash[23528]: cluster 2024-09-21T02:40:21.646003+0000 mgr.a (mgr.14388) 11508 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:23 smithi049 bash[23528]: audit 2024-09-21T02:40:22.192508+0000 mgr.a (mgr.14388) 11509 : audit [DBG] from='client.252618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:23.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:23 smithi044 bash[22676]: cluster 2024-09-21T02:40:21.646003+0000 mgr.a (mgr.14388) 11508 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:23.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:23 smithi044 bash[22676]: audit 2024-09-21T02:40:22.192508+0000 mgr.a (mgr.14388) 11509 : audit [DBG] from='client.252618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:23 smithi179 bash[23186]: cluster 2024-09-21T02:40:21.646003+0000 mgr.a (mgr.14388) 11508 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:40:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:23 smithi179 bash[23186]: audit 2024-09-21T02:40:22.192508+0000 mgr.a (mgr.14388) 11509 : audit [DBG] from='client.252618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:24.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:24 smithi049 bash[23528]: audit 2024-09-21T02:40:23.323064+0000 mon.a (mon.0) 9442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:24 smithi049 bash[23528]: audit 2024-09-21T02:40:23.332184+0000 mon.a (mon.0) 9443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.593 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:24 smithi049 bash[23528]: audit 2024-09-21T02:40:23.343092+0000 mon.a (mon.0) 9444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:24 smithi044 bash[22676]: audit 2024-09-21T02:40:23.323064+0000 mon.a (mon.0) 9442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:24 smithi044 bash[22676]: audit 2024-09-21T02:40:23.332184+0000 mon.a (mon.0) 9443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:24 smithi044 bash[22676]: audit 2024-09-21T02:40:23.343092+0000 mon.a (mon.0) 9444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:24 smithi179 bash[23186]: audit 2024-09-21T02:40:23.323064+0000 mon.a (mon.0) 9442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:24 smithi179 bash[23186]: audit 2024-09-21T02:40:23.332184+0000 mon.a (mon.0) 9443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:24 smithi179 bash[23186]: audit 2024-09-21T02:40:23.343092+0000 mon.a (mon.0) 9444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:25.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:25 smithi179 bash[23186]: cluster 2024-09-21T02:40:23.646964+0000 mgr.a (mgr.14388) 11510 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:40:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:25 smithi044 bash[22676]: cluster 2024-09-21T02:40:23.646964+0000 mgr.a (mgr.14388) 11510 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:40:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:25 smithi049 bash[23528]: cluster 2024-09-21T02:40:23.646964+0000 mgr.a (mgr.14388) 11510 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:40:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:27 smithi179 bash[23186]: cluster 2024-09-21T02:40:25.649179+0000 mgr.a (mgr.14388) 11511 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:40:27.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:27.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:27.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:27 smithi044 bash[22676]: cluster 2024-09-21T02:40:25.649179+0000 mgr.a (mgr.14388) 11511 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:40:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:27 smithi049 bash[23528]: cluster 2024-09-21T02:40:25.649179+0000 mgr.a (mgr.14388) 11511 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:40:28.377 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:28.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:28.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:28.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:28.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:29.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:29 smithi044 bash[22676]: cluster 2024-09-21T02:40:27.649772+0000 mgr.a (mgr.14388) 11512 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:29.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:29 smithi044 bash[22676]: audit 2024-09-21T02:40:27.955513+0000 mgr.a (mgr.14388) 11513 : audit [DBG] from='client.252693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:29 smithi179 bash[23186]: cluster 2024-09-21T02:40:27.649772+0000 mgr.a (mgr.14388) 11512 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:29 smithi179 bash[23186]: audit 2024-09-21T02:40:27.955513+0000 mgr.a (mgr.14388) 11513 : audit [DBG] from='client.252693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:29 smithi049 bash[23528]: cluster 2024-09-21T02:40:27.649772+0000 mgr.a (mgr.14388) 11512 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:29 smithi049 bash[23528]: audit 2024-09-21T02:40:27.955513+0000 mgr.a (mgr.14388) 11513 : audit [DBG] from='client.252693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:31 smithi044 bash[22676]: cluster 2024-09-21T02:40:29.650545+0000 mgr.a (mgr.14388) 11514 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:31 smithi179 bash[23186]: cluster 2024-09-21T02:40:29.650545+0000 mgr.a (mgr.14388) 11514 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:31 smithi049 bash[23528]: cluster 2024-09-21T02:40:29.650545+0000 mgr.a (mgr.14388) 11514 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:33.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:33.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:33 smithi044 bash[22676]: cluster 2024-09-21T02:40:31.652768+0000 mgr.a (mgr.14388) 11515 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:33 smithi179 bash[23186]: cluster 2024-09-21T02:40:31.652768+0000 mgr.a (mgr.14388) 11515 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:33 smithi049 bash[23528]: cluster 2024-09-21T02:40:31.652768+0000 mgr.a (mgr.14388) 11515 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:34.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:35 smithi044 bash[22676]: cluster 2024-09-21T02:40:33.653532+0000 mgr.a (mgr.14388) 11516 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:35 smithi044 bash[22676]: audit 2024-09-21T02:40:33.713888+0000 mgr.a (mgr.14388) 11517 : audit [DBG] from='client.252768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:35 smithi179 bash[23186]: cluster 2024-09-21T02:40:33.653532+0000 mgr.a (mgr.14388) 11516 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:35 smithi179 bash[23186]: audit 2024-09-21T02:40:33.713888+0000 mgr.a (mgr.14388) 11517 : audit [DBG] from='client.252768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:35 smithi049 bash[23528]: cluster 2024-09-21T02:40:33.653532+0000 mgr.a (mgr.14388) 11516 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:35 smithi049 bash[23528]: audit 2024-09-21T02:40:33.713888+0000 mgr.a (mgr.14388) 11517 : audit [DBG] from='client.252768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:37 smithi044 bash[22676]: cluster 2024-09-21T02:40:35.655798+0000 mgr.a (mgr.14388) 11518 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:37 smithi044 bash[22676]: audit 2024-09-21T02:40:36.317626+0000 mon.a (mon.0) 9445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:37 smithi044 bash[22676]: audit 2024-09-21T02:40:36.325021+0000 mon.a (mon.0) 9446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:37 smithi044 bash[22676]: audit 2024-09-21T02:40:36.335045+0000 mon.a (mon.0) 9447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:37 smithi044 bash[22676]: audit 2024-09-21T02:40:36.420737+0000 mon.a (mon.0) 9448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:37 smithi044 bash[22676]: audit 2024-09-21T02:40:36.430280+0000 mon.a (mon.0) 9449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:37 smithi044 bash[22676]: audit 2024-09-21T02:40:36.440015+0000 mon.a (mon.0) 9450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:37 smithi179 bash[23186]: cluster 2024-09-21T02:40:35.655798+0000 mgr.a (mgr.14388) 11518 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:37 smithi179 bash[23186]: audit 2024-09-21T02:40:36.317626+0000 mon.a (mon.0) 9445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:37 smithi179 bash[23186]: audit 2024-09-21T02:40:36.325021+0000 mon.a (mon.0) 9446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:37 smithi179 bash[23186]: audit 2024-09-21T02:40:36.335045+0000 mon.a (mon.0) 9447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:37 smithi179 bash[23186]: audit 2024-09-21T02:40:36.420737+0000 mon.a (mon.0) 9448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:37 smithi179 bash[23186]: audit 2024-09-21T02:40:36.430280+0000 mon.a (mon.0) 9449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:37 smithi179 bash[23186]: audit 2024-09-21T02:40:36.440015+0000 mon.a (mon.0) 9450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:37 smithi049 bash[23528]: cluster 2024-09-21T02:40:35.655798+0000 mgr.a (mgr.14388) 11518 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:37 smithi049 bash[23528]: audit 2024-09-21T02:40:36.317626+0000 mon.a (mon.0) 9445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:37 smithi049 bash[23528]: audit 2024-09-21T02:40:36.325021+0000 mon.a (mon.0) 9446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:37 smithi049 bash[23528]: audit 2024-09-21T02:40:36.335045+0000 mon.a (mon.0) 9447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:37 smithi049 bash[23528]: audit 2024-09-21T02:40:36.420737+0000 mon.a (mon.0) 9448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:37 smithi049 bash[23528]: audit 2024-09-21T02:40:36.430280+0000 mon.a (mon.0) 9449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:37.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:37 smithi049 bash[23528]: audit 2024-09-21T02:40:36.440015+0000 mon.a (mon.0) 9450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:39.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:39.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:39 smithi044 bash[22676]: cluster 2024-09-21T02:40:37.656594+0000 mgr.a (mgr.14388) 11519 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:39 smithi179 bash[23186]: cluster 2024-09-21T02:40:37.656594+0000 mgr.a (mgr.14388) 11519 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:39 smithi049 bash[23528]: cluster 2024-09-21T02:40:37.656594+0000 mgr.a (mgr.14388) 11519 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:39.935 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:39.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:39.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:39.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:39.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:40 smithi044 bash[22676]: audit 2024-09-21T02:40:39.476216+0000 mgr.a (mgr.14388) 11520 : audit [DBG] from='client.252837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:40 smithi179 bash[23186]: audit 2024-09-21T02:40:39.476216+0000 mgr.a (mgr.14388) 11520 : audit [DBG] from='client.252837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:40 smithi049 bash[23528]: audit 2024-09-21T02:40:39.476216+0000 mgr.a (mgr.14388) 11520 : audit [DBG] from='client.252837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:41 smithi044 bash[22676]: cluster 2024-09-21T02:40:39.657194+0000 mgr.a (mgr.14388) 11521 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:41 smithi179 bash[23186]: cluster 2024-09-21T02:40:39.657194+0000 mgr.a (mgr.14388) 11521 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:41 smithi049 bash[23528]: cluster 2024-09-21T02:40:39.657194+0000 mgr.a (mgr.14388) 11521 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:43 smithi049 bash[23528]: cluster 2024-09-21T02:40:41.659506+0000 mgr.a (mgr.14388) 11522 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:43 smithi044 bash[22676]: cluster 2024-09-21T02:40:41.659506+0000 mgr.a (mgr.14388) 11522 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:43 smithi179 bash[23186]: cluster 2024-09-21T02:40:41.659506+0000 mgr.a (mgr.14388) 11522 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:40:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:44 smithi049 bash[23528]: audit 2024-09-21T02:40:43.509239+0000 mon.a (mon.0) 9451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:44 smithi049 bash[23528]: audit 2024-09-21T02:40:43.518924+0000 mon.a (mon.0) 9452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:44 smithi049 bash[23528]: audit 2024-09-21T02:40:43.529969+0000 mon.a (mon.0) 9453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:44.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:44.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:44.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:44 smithi044 bash[22676]: audit 2024-09-21T02:40:43.509239+0000 mon.a (mon.0) 9451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:44 smithi044 bash[22676]: audit 2024-09-21T02:40:43.518924+0000 mon.a (mon.0) 9452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:44 smithi044 bash[22676]: audit 2024-09-21T02:40:43.529969+0000 mon.a (mon.0) 9453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:44 smithi179 bash[23186]: audit 2024-09-21T02:40:43.509239+0000 mon.a (mon.0) 9451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:44 smithi179 bash[23186]: audit 2024-09-21T02:40:43.518924+0000 mon.a (mon.0) 9452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:44 smithi179 bash[23186]: audit 2024-09-21T02:40:43.529969+0000 mon.a (mon.0) 9453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:45.716 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:45.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:45.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:45.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:45.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:45 smithi179 bash[23186]: cluster 2024-09-21T02:40:43.660313+0000 mgr.a (mgr.14388) 11523 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:45 smithi049 bash[23528]: cluster 2024-09-21T02:40:43.660313+0000 mgr.a (mgr.14388) 11523 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:45 smithi044 bash[22676]: cluster 2024-09-21T02:40:43.660313+0000 mgr.a (mgr.14388) 11523 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:46 smithi179 bash[23186]: audit 2024-09-21T02:40:45.273500+0000 mgr.a (mgr.14388) 11524 : audit [DBG] from='client.252915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:46 smithi049 bash[23528]: audit 2024-09-21T02:40:45.273500+0000 mgr.a (mgr.14388) 11524 : audit [DBG] from='client.252915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:46 smithi044 bash[22676]: audit 2024-09-21T02:40:45.273500+0000 mgr.a (mgr.14388) 11524 : audit [DBG] from='client.252915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:47 smithi049 bash[23528]: cluster 2024-09-21T02:40:45.661715+0000 mgr.a (mgr.14388) 11525 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:47.869 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:47 smithi179 bash[23186]: cluster 2024-09-21T02:40:45.661715+0000 mgr.a (mgr.14388) 11525 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:47 smithi044 bash[22676]: cluster 2024-09-21T02:40:45.661715+0000 mgr.a (mgr.14388) 11525 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:49 smithi049 bash[23528]: cluster 2024-09-21T02:40:47.662466+0000 mgr.a (mgr.14388) 11526 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:49.911 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:49 smithi044 bash[22676]: cluster 2024-09-21T02:40:47.662466+0000 mgr.a (mgr.14388) 11526 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:49 smithi179 bash[23186]: cluster 2024-09-21T02:40:47.662466+0000 mgr.a (mgr.14388) 11526 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:50.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:50.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:50.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:51.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:51.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:51.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:51.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:51.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:51 smithi049 bash[23528]: cluster 2024-09-21T02:40:49.663043+0000 mgr.a (mgr.14388) 11527 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:51 smithi044 bash[22676]: cluster 2024-09-21T02:40:49.663043+0000 mgr.a (mgr.14388) 11527 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:51 smithi179 bash[23186]: cluster 2024-09-21T02:40:49.663043+0000 mgr.a (mgr.14388) 11527 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:52.859 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:52 smithi049 bash[23528]: audit 2024-09-21T02:40:51.059632+0000 mgr.a (mgr.14388) 11528 : audit [DBG] from='client.252990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:52.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:52 smithi044 bash[22676]: audit 2024-09-21T02:40:51.059632+0000 mgr.a (mgr.14388) 11528 : audit [DBG] from='client.252990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:52 smithi179 bash[23186]: audit 2024-09-21T02:40:51.059632+0000 mgr.a (mgr.14388) 11528 : audit [DBG] from='client.252990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:53 smithi044 bash[22676]: cluster 2024-09-21T02:40:51.665354+0000 mgr.a (mgr.14388) 11529 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:53 smithi179 bash[23186]: cluster 2024-09-21T02:40:51.665354+0000 mgr.a (mgr.14388) 11529 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:53 smithi049 bash[23528]: cluster 2024-09-21T02:40:51.665354+0000 mgr.a (mgr.14388) 11529 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:54.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:54 smithi044 bash[22676]: cluster 2024-09-21T02:40:53.666098+0000 mgr.a (mgr.14388) 11530 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:54 smithi179 bash[23186]: cluster 2024-09-21T02:40:53.666098+0000 mgr.a (mgr.14388) 11530 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:54 smithi049 bash[23528]: cluster 2024-09-21T02:40:53.666098+0000 mgr.a (mgr.14388) 11530 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:40:56.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:40:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:40:56.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:40:57.303 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:40:57.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:40:57.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:40:57.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:40:57.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:40:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:57 smithi044 bash[22676]: cluster 2024-09-21T02:40:55.668033+0000 mgr.a (mgr.14388) 11531 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:57 smithi044 bash[22676]: audit 2024-09-21T02:40:56.555764+0000 mon.a (mon.0) 9454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:57 smithi044 bash[22676]: audit 2024-09-21T02:40:56.562836+0000 mon.a (mon.0) 9455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:57 smithi044 bash[22676]: audit 2024-09-21T02:40:56.570997+0000 mon.a (mon.0) 9456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:57 smithi044 bash[22676]: audit 2024-09-21T02:40:56.637360+0000 mon.a (mon.0) 9457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:57 smithi044 bash[22676]: audit 2024-09-21T02:40:56.642716+0000 mon.a (mon.0) 9458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:57 smithi044 bash[22676]: audit 2024-09-21T02:40:56.648068+0000 mon.a (mon.0) 9459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:57 smithi179 bash[23186]: cluster 2024-09-21T02:40:55.668033+0000 mgr.a (mgr.14388) 11531 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:57 smithi179 bash[23186]: audit 2024-09-21T02:40:56.555764+0000 mon.a (mon.0) 9454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:57 smithi179 bash[23186]: audit 2024-09-21T02:40:56.562836+0000 mon.a (mon.0) 9455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:57 smithi179 bash[23186]: audit 2024-09-21T02:40:56.570997+0000 mon.a (mon.0) 9456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:57 smithi179 bash[23186]: audit 2024-09-21T02:40:56.637360+0000 mon.a (mon.0) 9457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:57 smithi179 bash[23186]: audit 2024-09-21T02:40:56.642716+0000 mon.a (mon.0) 9458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:57 smithi179 bash[23186]: audit 2024-09-21T02:40:56.648068+0000 mon.a (mon.0) 9459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:57 smithi049 bash[23528]: cluster 2024-09-21T02:40:55.668033+0000 mgr.a (mgr.14388) 11531 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:40:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:57 smithi049 bash[23528]: audit 2024-09-21T02:40:56.555764+0000 mon.a (mon.0) 9454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:57 smithi049 bash[23528]: audit 2024-09-21T02:40:56.562836+0000 mon.a (mon.0) 9455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:57 smithi049 bash[23528]: audit 2024-09-21T02:40:56.570997+0000 mon.a (mon.0) 9456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:57 smithi049 bash[23528]: audit 2024-09-21T02:40:56.637360+0000 mon.a (mon.0) 9457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:57 smithi049 bash[23528]: audit 2024-09-21T02:40:56.642716+0000 mon.a (mon.0) 9458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:57 smithi049 bash[23528]: audit 2024-09-21T02:40:56.648068+0000 mon.a (mon.0) 9459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:40:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:58 smithi044 bash[22676]: audit 2024-09-21T02:40:56.862883+0000 mgr.a (mgr.14388) 11532 : audit [DBG] from='client.253065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:58 smithi179 bash[23186]: audit 2024-09-21T02:40:56.862883+0000 mgr.a (mgr.14388) 11532 : audit [DBG] from='client.253065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:58 smithi049 bash[23528]: audit 2024-09-21T02:40:56.862883+0000 mgr.a (mgr.14388) 11532 : audit [DBG] from='client.253065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:59.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:40:59 smithi044 bash[22676]: cluster 2024-09-21T02:40:57.668928+0000 mgr.a (mgr.14388) 11533 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:40:59 smithi179 bash[23186]: cluster 2024-09-21T02:40:57.668928+0000 mgr.a (mgr.14388) 11533 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:40:59 smithi049 bash[23528]: cluster 2024-09-21T02:40:57.668928+0000 mgr.a (mgr.14388) 11533 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:00 smithi044 bash[22676]: cluster 2024-09-21T02:40:59.669772+0000 mgr.a (mgr.14388) 11534 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:00 smithi179 bash[23186]: cluster 2024-09-21T02:40:59.669772+0000 mgr.a (mgr.14388) 11534 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:00 smithi049 bash[23528]: cluster 2024-09-21T02:40:59.669772+0000 mgr.a (mgr.14388) 11534 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:02.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:02.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:02.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:02 smithi044 bash[22676]: cluster 2024-09-21T02:41:01.671938+0000 mgr.a (mgr.14388) 11535 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:02 smithi179 bash[23186]: cluster 2024-09-21T02:41:01.671938+0000 mgr.a (mgr.14388) 11535 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:02 smithi049 bash[23528]: cluster 2024-09-21T02:41:01.671938+0000 mgr.a (mgr.14388) 11535 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:03.087 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:03.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:03.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:03.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:03.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:03 smithi049 bash[23528]: audit 2024-09-21T02:41:02.640992+0000 mgr.a (mgr.14388) 11536 : audit [DBG] from='client.253143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:03 smithi049 bash[23528]: audit 2024-09-21T02:41:03.692028+0000 mon.a (mon.0) 9460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:03 smithi049 bash[23528]: audit 2024-09-21T02:41:03.701454+0000 mon.a (mon.0) 9461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:03 smithi049 bash[23528]: audit 2024-09-21T02:41:03.713280+0000 mon.a (mon.0) 9462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:03 smithi179 bash[23186]: audit 2024-09-21T02:41:02.640992+0000 mgr.a (mgr.14388) 11536 : audit [DBG] from='client.253143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:03 smithi179 bash[23186]: audit 2024-09-21T02:41:03.692028+0000 mon.a (mon.0) 9460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:03 smithi179 bash[23186]: audit 2024-09-21T02:41:03.701454+0000 mon.a (mon.0) 9461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:03 smithi179 bash[23186]: audit 2024-09-21T02:41:03.713280+0000 mon.a (mon.0) 9462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:03 smithi044 bash[22676]: audit 2024-09-21T02:41:02.640992+0000 mgr.a (mgr.14388) 11536 : audit [DBG] from='client.253143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:03 smithi044 bash[22676]: audit 2024-09-21T02:41:03.692028+0000 mon.a (mon.0) 9460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:03 smithi044 bash[22676]: audit 2024-09-21T02:41:03.701454+0000 mon.a (mon.0) 9461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:03 smithi044 bash[22676]: audit 2024-09-21T02:41:03.713280+0000 mon.a (mon.0) 9462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:04 smithi044 bash[22676]: cluster 2024-09-21T02:41:03.672840+0000 mgr.a (mgr.14388) 11537 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:04 smithi179 bash[23186]: cluster 2024-09-21T02:41:03.672840+0000 mgr.a (mgr.14388) 11537 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:04 smithi049 bash[23528]: cluster 2024-09-21T02:41:03.672840+0000 mgr.a (mgr.14388) 11537 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:06 smithi179 bash[23186]: cluster 2024-09-21T02:41:05.675117+0000 mgr.a (mgr.14388) 11538 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:06 smithi049 bash[23528]: cluster 2024-09-21T02:41:05.675117+0000 mgr.a (mgr.14388) 11538 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:06 smithi044 bash[22676]: cluster 2024-09-21T02:41:05.675117+0000 mgr.a (mgr.14388) 11538 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:08.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:08.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:08.849 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:08.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:08.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:08.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:08.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:08 smithi179 bash[23186]: cluster 2024-09-21T02:41:07.676045+0000 mgr.a (mgr.14388) 11539 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:08 smithi179 bash[23186]: audit 2024-09-21T02:41:08.421512+0000 mgr.a (mgr.14388) 11540 : audit [DBG] from='client.253221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:08 smithi049 bash[23528]: cluster 2024-09-21T02:41:07.676045+0000 mgr.a (mgr.14388) 11539 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:08 smithi049 bash[23528]: audit 2024-09-21T02:41:08.421512+0000 mgr.a (mgr.14388) 11540 : audit [DBG] from='client.253221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:08 smithi044 bash[22676]: cluster 2024-09-21T02:41:07.676045+0000 mgr.a (mgr.14388) 11539 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:08 smithi044 bash[22676]: audit 2024-09-21T02:41:08.421512+0000 mgr.a (mgr.14388) 11540 : audit [DBG] from='client.253221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22676]: cluster 2024-09-21T02:41:09.676974+0000 mgr.a (mgr.14388) 11541 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22676]: audit 2024-09-21T02:41:10.205773+0000 mon.a (mon.0) 9463 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:41:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22676]: audit 2024-09-21T02:41:10.212758+0000 mon.a (mon.0) 9464 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:41:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22676]: audit 2024-09-21T02:41:10.214852+0000 mon.a (mon.0) 9465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:41:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22676]: audit 2024-09-21T02:41:10.224463+0000 mon.a (mon.0) 9466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22676]: audit 2024-09-21T02:41:10.227897+0000 mon.a (mon.0) 9467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:41:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22676]: audit 2024-09-21T02:41:10.230349+0000 mgr.a (mgr.14388) 11542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:41:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:10 smithi179 bash[23186]: cluster 2024-09-21T02:41:09.676974+0000 mgr.a (mgr.14388) 11541 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:10 smithi179 bash[23186]: audit 2024-09-21T02:41:10.205773+0000 mon.a (mon.0) 9463 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:41:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:10 smithi179 bash[23186]: audit 2024-09-21T02:41:10.212758+0000 mon.a (mon.0) 9464 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:41:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:10 smithi179 bash[23186]: audit 2024-09-21T02:41:10.214852+0000 mon.a (mon.0) 9465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:41:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:10 smithi179 bash[23186]: audit 2024-09-21T02:41:10.224463+0000 mon.a (mon.0) 9466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:10 smithi179 bash[23186]: audit 2024-09-21T02:41:10.227897+0000 mon.a (mon.0) 9467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:41:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:10 smithi179 bash[23186]: audit 2024-09-21T02:41:10.230349+0000 mgr.a (mgr.14388) 11542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:41:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:10 smithi049 bash[23528]: cluster 2024-09-21T02:41:09.676974+0000 mgr.a (mgr.14388) 11541 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:10 smithi049 bash[23528]: audit 2024-09-21T02:41:10.205773+0000 mon.a (mon.0) 9463 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:41:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:10 smithi049 bash[23528]: audit 2024-09-21T02:41:10.212758+0000 mon.a (mon.0) 9464 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:41:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:10 smithi049 bash[23528]: audit 2024-09-21T02:41:10.214852+0000 mon.a (mon.0) 9465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:41:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:10 smithi049 bash[23528]: audit 2024-09-21T02:41:10.224463+0000 mon.a (mon.0) 9466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:10 smithi049 bash[23528]: audit 2024-09-21T02:41:10.227897+0000 mon.a (mon.0) 9467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:41:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:10 smithi049 bash[23528]: audit 2024-09-21T02:41:10.230349+0000 mgr.a (mgr.14388) 11542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:41:11.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:41:10 smithi044 bash[22930]: debug 2024-09-21T02:41:10.995+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:41:11.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:41:11 smithi044 bash[22930]: debug 2024-09-21T02:41:10.995+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:41:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:11 smithi044 bash[22676]: audit 2024-09-21T02:41:10.998916+0000 mgr.a (mgr.14388) 11543 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:41:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:11 smithi044 bash[22676]: cephadm 2024-09-21T02:41:11.000649+0000 mgr.a (mgr.14388) 11544 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:41:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:11 smithi049 bash[23528]: audit 2024-09-21T02:41:10.998916+0000 mgr.a (mgr.14388) 11543 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:41:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:11 smithi049 bash[23528]: cephadm 2024-09-21T02:41:11.000649+0000 mgr.a (mgr.14388) 11544 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:41:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:11 smithi179 bash[23186]: audit 2024-09-21T02:41:10.998916+0000 mgr.a (mgr.14388) 11543 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:41:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:11 smithi179 bash[23186]: cephadm 2024-09-21T02:41:11.000649+0000 mgr.a (mgr.14388) 11544 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:41:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:12 smithi049 bash[23528]: cluster 2024-09-21T02:41:11.678264+0000 mgr.a (mgr.14388) 11545 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:12 smithi044 bash[22676]: cluster 2024-09-21T02:41:11.678264+0000 mgr.a (mgr.14388) 11545 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:12 smithi179 bash[23186]: cluster 2024-09-21T02:41:11.678264+0000 mgr.a (mgr.14388) 11545 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:13.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:13.852 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:13.852 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:14.607 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:14 smithi049 bash[23528]: cluster 2024-09-21T02:41:13.679023+0000 mgr.a (mgr.14388) 11546 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:14 smithi049 bash[23528]: audit 2024-09-21T02:41:14.186117+0000 mgr.a (mgr.14388) 11547 : audit [DBG] from='client.253404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:14 smithi044 bash[22676]: cluster 2024-09-21T02:41:13.679023+0000 mgr.a (mgr.14388) 11546 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:14 smithi044 bash[22676]: audit 2024-09-21T02:41:14.186117+0000 mgr.a (mgr.14388) 11547 : audit [DBG] from='client.253404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:14 smithi179 bash[23186]: cluster 2024-09-21T02:41:13.679023+0000 mgr.a (mgr.14388) 11546 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:14 smithi179 bash[23186]: audit 2024-09-21T02:41:14.186117+0000 mgr.a (mgr.14388) 11547 : audit [DBG] from='client.253404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:16 smithi049 bash[23528]: cluster 2024-09-21T02:41:15.681327+0000 mgr.a (mgr.14388) 11548 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:16 smithi044 bash[22676]: cluster 2024-09-21T02:41:15.681327+0000 mgr.a (mgr.14388) 11548 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:16 smithi179 bash[23186]: cluster 2024-09-21T02:41:15.681327+0000 mgr.a (mgr.14388) 11548 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:17 smithi049 bash[23528]: audit 2024-09-21T02:41:16.797078+0000 mon.a (mon.0) 9468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:17 smithi049 bash[23528]: audit 2024-09-21T02:41:16.805650+0000 mon.a (mon.0) 9469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:17 smithi049 bash[23528]: audit 2024-09-21T02:41:16.816939+0000 mon.a (mon.0) 9470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:17 smithi049 bash[23528]: audit 2024-09-21T02:41:16.855448+0000 mon.a (mon.0) 9471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:17 smithi049 bash[23528]: audit 2024-09-21T02:41:16.863644+0000 mon.a (mon.0) 9472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:17 smithi049 bash[23528]: audit 2024-09-21T02:41:16.873589+0000 mon.a (mon.0) 9473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:17 smithi044 bash[22676]: audit 2024-09-21T02:41:16.797078+0000 mon.a (mon.0) 9468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:17 smithi044 bash[22676]: audit 2024-09-21T02:41:16.805650+0000 mon.a (mon.0) 9469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:17 smithi044 bash[22676]: audit 2024-09-21T02:41:16.816939+0000 mon.a (mon.0) 9470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:17 smithi044 bash[22676]: audit 2024-09-21T02:41:16.855448+0000 mon.a (mon.0) 9471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:17 smithi044 bash[22676]: audit 2024-09-21T02:41:16.863644+0000 mon.a (mon.0) 9472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:17 smithi044 bash[22676]: audit 2024-09-21T02:41:16.873589+0000 mon.a (mon.0) 9473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:17 smithi179 bash[23186]: audit 2024-09-21T02:41:16.797078+0000 mon.a (mon.0) 9468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:17 smithi179 bash[23186]: audit 2024-09-21T02:41:16.805650+0000 mon.a (mon.0) 9469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:17 smithi179 bash[23186]: audit 2024-09-21T02:41:16.816939+0000 mon.a (mon.0) 9470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:17 smithi179 bash[23186]: audit 2024-09-21T02:41:16.855448+0000 mon.a (mon.0) 9471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:17 smithi179 bash[23186]: audit 2024-09-21T02:41:16.863644+0000 mon.a (mon.0) 9472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:17 smithi179 bash[23186]: audit 2024-09-21T02:41:16.873589+0000 mon.a (mon.0) 9473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:18 smithi044 bash[22676]: cluster 2024-09-21T02:41:17.682105+0000 mgr.a (mgr.14388) 11549 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:18 smithi179 bash[23186]: cluster 2024-09-21T02:41:17.682105+0000 mgr.a (mgr.14388) 11549 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:18 smithi049 bash[23528]: cluster 2024-09-21T02:41:17.682105+0000 mgr.a (mgr.14388) 11549 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:19.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:19.609 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:20.399 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:20.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:20.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:20.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:20.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:20 smithi044 bash[22676]: cluster 2024-09-21T02:41:19.682709+0000 mgr.a (mgr.14388) 11550 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:20 smithi044 bash[22676]: audit 2024-09-21T02:41:19.949962+0000 mgr.a (mgr.14388) 11551 : audit [DBG] from='client.253479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:20 smithi179 bash[23186]: cluster 2024-09-21T02:41:19.682709+0000 mgr.a (mgr.14388) 11550 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:20 smithi179 bash[23186]: audit 2024-09-21T02:41:19.949962+0000 mgr.a (mgr.14388) 11551 : audit [DBG] from='client.253479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:20 smithi049 bash[23528]: cluster 2024-09-21T02:41:19.682709+0000 mgr.a (mgr.14388) 11550 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:20 smithi049 bash[23528]: audit 2024-09-21T02:41:19.949962+0000 mgr.a (mgr.14388) 11551 : audit [DBG] from='client.253479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:22 smithi044 bash[22676]: cluster 2024-09-21T02:41:21.685436+0000 mgr.a (mgr.14388) 11552 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:23.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:22 smithi179 bash[23186]: cluster 2024-09-21T02:41:21.685436+0000 mgr.a (mgr.14388) 11552 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:22 smithi049 bash[23528]: cluster 2024-09-21T02:41:21.685436+0000 mgr.a (mgr.14388) 11552 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:24 smithi044 bash[22676]: cluster 2024-09-21T02:41:23.686219+0000 mgr.a (mgr.14388) 11553 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:41:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:24 smithi044 bash[22676]: audit 2024-09-21T02:41:23.927146+0000 mon.a (mon.0) 9474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:24 smithi044 bash[22676]: audit 2024-09-21T02:41:23.936172+0000 mon.a (mon.0) 9475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:24 smithi044 bash[22676]: audit 2024-09-21T02:41:23.947023+0000 mon.a (mon.0) 9476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:24 smithi179 bash[23186]: cluster 2024-09-21T02:41:23.686219+0000 mgr.a (mgr.14388) 11553 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:24 smithi179 bash[23186]: audit 2024-09-21T02:41:23.927146+0000 mon.a (mon.0) 9474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:24 smithi179 bash[23186]: audit 2024-09-21T02:41:23.936172+0000 mon.a (mon.0) 9475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:24 smithi179 bash[23186]: audit 2024-09-21T02:41:23.947023+0000 mon.a (mon.0) 9476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:24 smithi049 bash[23528]: cluster 2024-09-21T02:41:23.686219+0000 mgr.a (mgr.14388) 11553 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:41:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:24 smithi049 bash[23528]: audit 2024-09-21T02:41:23.927146+0000 mon.a (mon.0) 9474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:24 smithi049 bash[23528]: audit 2024-09-21T02:41:23.936172+0000 mon.a (mon.0) 9475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:24 smithi049 bash[23528]: audit 2024-09-21T02:41:23.947023+0000 mon.a (mon.0) 9476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:26.150 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:26.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:26.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:26.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:26.150 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:26 smithi044 bash[22676]: cluster 2024-09-21T02:41:25.688109+0000 mgr.a (mgr.14388) 11554 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:27.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:26 smithi044 bash[22676]: audit 2024-09-21T02:41:25.736064+0000 mgr.a (mgr.14388) 11555 : audit [DBG] from='client.253557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:26 smithi179 bash[23186]: cluster 2024-09-21T02:41:25.688109+0000 mgr.a (mgr.14388) 11554 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:26 smithi179 bash[23186]: audit 2024-09-21T02:41:25.736064+0000 mgr.a (mgr.14388) 11555 : audit [DBG] from='client.253557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:26 smithi049 bash[23528]: cluster 2024-09-21T02:41:25.688109+0000 mgr.a (mgr.14388) 11554 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:41:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:26 smithi049 bash[23528]: audit 2024-09-21T02:41:25.736064+0000 mgr.a (mgr.14388) 11555 : audit [DBG] from='client.253557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:28 smithi044 bash[22676]: cluster 2024-09-21T02:41:27.689012+0000 mgr.a (mgr.14388) 11556 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:41:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:28 smithi179 bash[23186]: cluster 2024-09-21T02:41:27.689012+0000 mgr.a (mgr.14388) 11556 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:41:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:28 smithi049 bash[23528]: cluster 2024-09-21T02:41:27.689012+0000 mgr.a (mgr.14388) 11556 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:41:31.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:31.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:31.152 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:31.249 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:30 smithi044 bash[22676]: cluster 2024-09-21T02:41:29.689824+0000 mgr.a (mgr.14388) 11557 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:41:31.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:30 smithi179 bash[23186]: cluster 2024-09-21T02:41:29.689824+0000 mgr.a (mgr.14388) 11557 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:41:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:30 smithi049 bash[23528]: cluster 2024-09-21T02:41:29.689824+0000 mgr.a (mgr.14388) 11557 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:41:31.960 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:31 smithi044 bash[22676]: audit 2024-09-21T02:41:31.489783+0000 mgr.a (mgr.14388) 11558 : audit [DBG] from='client.253635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:31 smithi179 bash[23186]: audit 2024-09-21T02:41:31.489783+0000 mgr.a (mgr.14388) 11558 : audit [DBG] from='client.253635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:31 smithi049 bash[23528]: audit 2024-09-21T02:41:31.489783+0000 mgr.a (mgr.14388) 11558 : audit [DBG] from='client.253635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:32 smithi044 bash[22676]: cluster 2024-09-21T02:41:31.691214+0000 mgr.a (mgr.14388) 11559 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:33.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:32 smithi179 bash[23186]: cluster 2024-09-21T02:41:31.691214+0000 mgr.a (mgr.14388) 11559 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:32 smithi049 bash[23528]: cluster 2024-09-21T02:41:31.691214+0000 mgr.a (mgr.14388) 11559 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:35.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:34 smithi044 bash[22676]: cluster 2024-09-21T02:41:33.692073+0000 mgr.a (mgr.14388) 11560 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:34 smithi179 bash[23186]: cluster 2024-09-21T02:41:33.692073+0000 mgr.a (mgr.14388) 11560 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:34 smithi049 bash[23528]: cluster 2024-09-21T02:41:33.692073+0000 mgr.a (mgr.14388) 11560 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:36 smithi044 bash[22676]: cluster 2024-09-21T02:41:35.694243+0000 mgr.a (mgr.14388) 11561 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:37.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:36 smithi179 bash[23186]: cluster 2024-09-21T02:41:35.694243+0000 mgr.a (mgr.14388) 11561 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:36 smithi049 bash[23528]: cluster 2024-09-21T02:41:35.694243+0000 mgr.a (mgr.14388) 11561 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:37.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:37.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:37.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:37.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:37.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:37 smithi179 bash[23186]: audit 2024-09-21T02:41:36.999054+0000 mon.a (mon.0) 9477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:37 smithi179 bash[23186]: audit 2024-09-21T02:41:37.006921+0000 mon.a (mon.0) 9478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:37 smithi179 bash[23186]: audit 2024-09-21T02:41:37.016000+0000 mon.a (mon.0) 9479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:37 smithi179 bash[23186]: audit 2024-09-21T02:41:37.074034+0000 mon.a (mon.0) 9480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:37 smithi179 bash[23186]: audit 2024-09-21T02:41:37.081815+0000 mon.a (mon.0) 9481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:37 smithi179 bash[23186]: audit 2024-09-21T02:41:37.087570+0000 mon.a (mon.0) 9482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:37 smithi179 bash[23186]: audit 2024-09-21T02:41:37.301541+0000 mgr.a (mgr.14388) 11562 : audit [DBG] from='client.253713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:37 smithi049 bash[23528]: audit 2024-09-21T02:41:36.999054+0000 mon.a (mon.0) 9477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:37 smithi049 bash[23528]: audit 2024-09-21T02:41:37.006921+0000 mon.a (mon.0) 9478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:37 smithi049 bash[23528]: audit 2024-09-21T02:41:37.016000+0000 mon.a (mon.0) 9479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:37 smithi049 bash[23528]: audit 2024-09-21T02:41:37.074034+0000 mon.a (mon.0) 9480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:37 smithi049 bash[23528]: audit 2024-09-21T02:41:37.081815+0000 mon.a (mon.0) 9481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:37 smithi049 bash[23528]: audit 2024-09-21T02:41:37.087570+0000 mon.a (mon.0) 9482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:37 smithi049 bash[23528]: audit 2024-09-21T02:41:37.301541+0000 mgr.a (mgr.14388) 11562 : audit [DBG] from='client.253713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:38.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:37 smithi044 bash[22676]: audit 2024-09-21T02:41:36.999054+0000 mon.a (mon.0) 9477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:37 smithi044 bash[22676]: audit 2024-09-21T02:41:37.006921+0000 mon.a (mon.0) 9478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:37 smithi044 bash[22676]: audit 2024-09-21T02:41:37.016000+0000 mon.a (mon.0) 9479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:37 smithi044 bash[22676]: audit 2024-09-21T02:41:37.074034+0000 mon.a (mon.0) 9480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:37 smithi044 bash[22676]: audit 2024-09-21T02:41:37.081815+0000 mon.a (mon.0) 9481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:37 smithi044 bash[22676]: audit 2024-09-21T02:41:37.087570+0000 mon.a (mon.0) 9482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:37 smithi044 bash[22676]: audit 2024-09-21T02:41:37.301541+0000 mgr.a (mgr.14388) 11562 : audit [DBG] from='client.253713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:39 smithi044 bash[22676]: cluster 2024-09-21T02:41:37.695110+0000 mgr.a (mgr.14388) 11563 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:39 smithi179 bash[23186]: cluster 2024-09-21T02:41:37.695110+0000 mgr.a (mgr.14388) 11563 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:39 smithi049 bash[23528]: cluster 2024-09-21T02:41:37.695110+0000 mgr.a (mgr.14388) 11563 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:41 smithi044 bash[22676]: cluster 2024-09-21T02:41:39.695880+0000 mgr.a (mgr.14388) 11564 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:41 smithi179 bash[23186]: cluster 2024-09-21T02:41:39.695880+0000 mgr.a (mgr.14388) 11564 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:41 smithi049 bash[23528]: cluster 2024-09-21T02:41:39.695880+0000 mgr.a (mgr.14388) 11564 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:42.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:42.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:43 smithi044 bash[22676]: cluster 2024-09-21T02:41:41.698125+0000 mgr.a (mgr.14388) 11565 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:43 smithi179 bash[23186]: cluster 2024-09-21T02:41:41.698125+0000 mgr.a (mgr.14388) 11565 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:43 smithi049 bash[23528]: cluster 2024-09-21T02:41:41.698125+0000 mgr.a (mgr.14388) 11565 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:43.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:44.350 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:44 smithi049 bash[23528]: audit 2024-09-21T02:41:43.106962+0000 mgr.a (mgr.14388) 11566 : audit [DBG] from='client.253791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:44 smithi044 bash[22676]: audit 2024-09-21T02:41:43.106962+0000 mgr.a (mgr.14388) 11566 : audit [DBG] from='client.253791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:44.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:44 smithi179 bash[23186]: audit 2024-09-21T02:41:43.106962+0000 mgr.a (mgr.14388) 11566 : audit [DBG] from='client.253791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:45 smithi179 bash[23186]: cluster 2024-09-21T02:41:43.698654+0000 mgr.a (mgr.14388) 11567 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:45 smithi179 bash[23186]: audit 2024-09-21T02:41:44.144069+0000 mon.a (mon.0) 9483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:45 smithi179 bash[23186]: audit 2024-09-21T02:41:44.153957+0000 mon.a (mon.0) 9484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:45 smithi179 bash[23186]: audit 2024-09-21T02:41:44.164498+0000 mon.a (mon.0) 9485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:45 smithi049 bash[23528]: cluster 2024-09-21T02:41:43.698654+0000 mgr.a (mgr.14388) 11567 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:45 smithi049 bash[23528]: audit 2024-09-21T02:41:44.144069+0000 mon.a (mon.0) 9483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:45 smithi049 bash[23528]: audit 2024-09-21T02:41:44.153957+0000 mon.a (mon.0) 9484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:45 smithi049 bash[23528]: audit 2024-09-21T02:41:44.164498+0000 mon.a (mon.0) 9485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:45 smithi044 bash[22676]: cluster 2024-09-21T02:41:43.698654+0000 mgr.a (mgr.14388) 11567 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:45 smithi044 bash[22676]: audit 2024-09-21T02:41:44.144069+0000 mon.a (mon.0) 9483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:45 smithi044 bash[22676]: audit 2024-09-21T02:41:44.153957+0000 mon.a (mon.0) 9484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:45 smithi044 bash[22676]: audit 2024-09-21T02:41:44.164498+0000 mon.a (mon.0) 9485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:47 smithi044 bash[22676]: cluster 2024-09-21T02:41:45.700912+0000 mgr.a (mgr.14388) 11568 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:47 smithi179 bash[23186]: cluster 2024-09-21T02:41:45.700912+0000 mgr.a (mgr.14388) 11568 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:47 smithi049 bash[23528]: cluster 2024-09-21T02:41:45.700912+0000 mgr.a (mgr.14388) 11568 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:48.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:49.350 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:49.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:49.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:49.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:49.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:49 smithi044 bash[22676]: cluster 2024-09-21T02:41:47.701759+0000 mgr.a (mgr.14388) 11569 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:49 smithi179 bash[23186]: cluster 2024-09-21T02:41:47.701759+0000 mgr.a (mgr.14388) 11569 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:49 smithi049 bash[23528]: cluster 2024-09-21T02:41:47.701759+0000 mgr.a (mgr.14388) 11569 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:50.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:50 smithi044 bash[22676]: audit 2024-09-21T02:41:48.905605+0000 mgr.a (mgr.14388) 11570 : audit [DBG] from='client.253869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:50 smithi179 bash[23186]: audit 2024-09-21T02:41:48.905605+0000 mgr.a (mgr.14388) 11570 : audit [DBG] from='client.253869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:50 smithi049 bash[23528]: audit 2024-09-21T02:41:48.905605+0000 mgr.a (mgr.14388) 11570 : audit [DBG] from='client.253869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:51 smithi044 bash[22676]: cluster 2024-09-21T02:41:49.702784+0000 mgr.a (mgr.14388) 11571 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:51 smithi179 bash[23186]: cluster 2024-09-21T02:41:49.702784+0000 mgr.a (mgr.14388) 11571 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:51 smithi049 bash[23528]: cluster 2024-09-21T02:41:49.702784+0000 mgr.a (mgr.14388) 11571 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:53 smithi044 bash[22676]: cluster 2024-09-21T02:41:51.705036+0000 mgr.a (mgr.14388) 11572 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:53 smithi179 bash[23186]: cluster 2024-09-21T02:41:51.705036+0000 mgr.a (mgr.14388) 11572 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:53 smithi049 bash[23528]: cluster 2024-09-21T02:41:51.705036+0000 mgr.a (mgr.14388) 11572 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:41:54.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:41:54.352 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:41:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:41:55.146 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:41:55.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:41:55.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:41:55.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:41:55.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:41:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:55 smithi044 bash[22676]: cluster 2024-09-21T02:41:53.705836+0000 mgr.a (mgr.14388) 11573 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:55 smithi179 bash[23186]: cluster 2024-09-21T02:41:53.705836+0000 mgr.a (mgr.14388) 11573 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:55 smithi049 bash[23528]: cluster 2024-09-21T02:41:53.705836+0000 mgr.a (mgr.14388) 11573 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:41:56.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:56 smithi044 bash[22676]: audit 2024-09-21T02:41:54.686725+0000 mgr.a (mgr.14388) 11574 : audit [DBG] from='client.253947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:56 smithi179 bash[23186]: audit 2024-09-21T02:41:54.686725+0000 mgr.a (mgr.14388) 11574 : audit [DBG] from='client.253947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:56 smithi049 bash[23528]: audit 2024-09-21T02:41:54.686725+0000 mgr.a (mgr.14388) 11574 : audit [DBG] from='client.253947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:41:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:57 smithi044 bash[22676]: cluster 2024-09-21T02:41:55.708288+0000 mgr.a (mgr.14388) 11575 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:41:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:57 smithi179 bash[23186]: cluster 2024-09-21T02:41:55.708288+0000 mgr.a (mgr.14388) 11575 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:41:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:57 smithi049 bash[23528]: cluster 2024-09-21T02:41:55.708288+0000 mgr.a (mgr.14388) 11575 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:41:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:58 smithi044 bash[22676]: audit 2024-09-21T02:41:57.237446+0000 mon.a (mon.0) 9486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:58 smithi044 bash[22676]: audit 2024-09-21T02:41:57.247044+0000 mon.a (mon.0) 9487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:58 smithi044 bash[22676]: audit 2024-09-21T02:41:57.259551+0000 mon.a (mon.0) 9488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:58 smithi044 bash[22676]: audit 2024-09-21T02:41:57.298429+0000 mon.a (mon.0) 9489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:58 smithi044 bash[22676]: audit 2024-09-21T02:41:57.307982+0000 mon.a (mon.0) 9490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:58 smithi044 bash[22676]: audit 2024-09-21T02:41:57.319181+0000 mon.a (mon.0) 9491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:58 smithi179 bash[23186]: audit 2024-09-21T02:41:57.237446+0000 mon.a (mon.0) 9486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:58 smithi179 bash[23186]: audit 2024-09-21T02:41:57.247044+0000 mon.a (mon.0) 9487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:58 smithi179 bash[23186]: audit 2024-09-21T02:41:57.259551+0000 mon.a (mon.0) 9488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:58 smithi179 bash[23186]: audit 2024-09-21T02:41:57.298429+0000 mon.a (mon.0) 9489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:58 smithi179 bash[23186]: audit 2024-09-21T02:41:57.307982+0000 mon.a (mon.0) 9490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:58 smithi179 bash[23186]: audit 2024-09-21T02:41:57.319181+0000 mon.a (mon.0) 9491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:58 smithi049 bash[23528]: audit 2024-09-21T02:41:57.237446+0000 mon.a (mon.0) 9486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:58 smithi049 bash[23528]: audit 2024-09-21T02:41:57.247044+0000 mon.a (mon.0) 9487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:58 smithi049 bash[23528]: audit 2024-09-21T02:41:57.259551+0000 mon.a (mon.0) 9488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:58 smithi049 bash[23528]: audit 2024-09-21T02:41:57.298429+0000 mon.a (mon.0) 9489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:58 smithi049 bash[23528]: audit 2024-09-21T02:41:57.307982+0000 mon.a (mon.0) 9490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:58 smithi049 bash[23528]: audit 2024-09-21T02:41:57.319181+0000 mon.a (mon.0) 9491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:41:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:41:59 smithi044 bash[22676]: cluster 2024-09-21T02:41:57.709103+0000 mgr.a (mgr.14388) 11576 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:41:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:41:59 smithi179 bash[23186]: cluster 2024-09-21T02:41:57.709103+0000 mgr.a (mgr.14388) 11576 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:41:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:41:59 smithi049 bash[23528]: cluster 2024-09-21T02:41:57.709103+0000 mgr.a (mgr.14388) 11576 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:42:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:00.148 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:00.149 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:00.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:00.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:00.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:00.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:00.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:01 smithi044 bash[22676]: cluster 2024-09-21T02:41:59.709865+0000 mgr.a (mgr.14388) 11577 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:42:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:01 smithi044 bash[22676]: audit 2024-09-21T02:42:00.482597+0000 mgr.a (mgr.14388) 11578 : audit [DBG] from='client.254022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:01 smithi179 bash[23186]: cluster 2024-09-21T02:41:59.709865+0000 mgr.a (mgr.14388) 11577 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:42:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:01 smithi179 bash[23186]: audit 2024-09-21T02:42:00.482597+0000 mgr.a (mgr.14388) 11578 : audit [DBG] from='client.254022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:01 smithi049 bash[23528]: cluster 2024-09-21T02:41:59.709865+0000 mgr.a (mgr.14388) 11577 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:42:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:01 smithi049 bash[23528]: audit 2024-09-21T02:42:00.482597+0000 mgr.a (mgr.14388) 11578 : audit [DBG] from='client.254022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:03 smithi044 bash[22676]: cluster 2024-09-21T02:42:01.712720+0000 mgr.a (mgr.14388) 11579 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:03 smithi179 bash[23186]: cluster 2024-09-21T02:42:01.712720+0000 mgr.a (mgr.14388) 11579 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:03 smithi049 bash[23528]: cluster 2024-09-21T02:42:01.712720+0000 mgr.a (mgr.14388) 11579 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:05 smithi179 bash[23186]: cluster 2024-09-21T02:42:03.713669+0000 mgr.a (mgr.14388) 11580 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:05 smithi179 bash[23186]: audit 2024-09-21T02:42:04.364072+0000 mon.a (mon.0) 9492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:05 smithi179 bash[23186]: audit 2024-09-21T02:42:04.372721+0000 mon.a (mon.0) 9493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:05 smithi179 bash[23186]: audit 2024-09-21T02:42:04.383058+0000 mon.a (mon.0) 9494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:05 smithi044 bash[22676]: cluster 2024-09-21T02:42:03.713669+0000 mgr.a (mgr.14388) 11580 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:05 smithi044 bash[22676]: audit 2024-09-21T02:42:04.364072+0000 mon.a (mon.0) 9492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:05 smithi044 bash[22676]: audit 2024-09-21T02:42:04.372721+0000 mon.a (mon.0) 9493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:05 smithi044 bash[22676]: audit 2024-09-21T02:42:04.383058+0000 mon.a (mon.0) 9494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:05 smithi049 bash[23528]: cluster 2024-09-21T02:42:03.713669+0000 mgr.a (mgr.14388) 11580 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:05 smithi049 bash[23528]: audit 2024-09-21T02:42:04.364072+0000 mon.a (mon.0) 9492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:05 smithi049 bash[23528]: audit 2024-09-21T02:42:04.372721+0000 mon.a (mon.0) 9493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:05 smithi049 bash[23528]: audit 2024-09-21T02:42:04.383058+0000 mon.a (mon.0) 9494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:05.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:05.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:06.693 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:06.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:06.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:06.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:06.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:07 smithi044 bash[22676]: cluster 2024-09-21T02:42:05.715690+0000 mgr.a (mgr.14388) 11581 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:07 smithi044 bash[22676]: audit 2024-09-21T02:42:06.250412+0000 mgr.a (mgr.14388) 11582 : audit [DBG] from='client.254097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:07 smithi179 bash[23186]: cluster 2024-09-21T02:42:05.715690+0000 mgr.a (mgr.14388) 11581 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:07 smithi179 bash[23186]: audit 2024-09-21T02:42:06.250412+0000 mgr.a (mgr.14388) 11582 : audit [DBG] from='client.254097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:07 smithi049 bash[23528]: cluster 2024-09-21T02:42:05.715690+0000 mgr.a (mgr.14388) 11581 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:07 smithi049 bash[23528]: audit 2024-09-21T02:42:06.250412+0000 mgr.a (mgr.14388) 11582 : audit [DBG] from='client.254097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:09 smithi044 bash[22676]: cluster 2024-09-21T02:42:07.716678+0000 mgr.a (mgr.14388) 11583 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:42:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:09 smithi179 bash[23186]: cluster 2024-09-21T02:42:07.716678+0000 mgr.a (mgr.14388) 11583 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:42:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:09 smithi049 bash[23528]: cluster 2024-09-21T02:42:07.716678+0000 mgr.a (mgr.14388) 11583 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:42:11.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:11.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:11.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22676]: cluster 2024-09-21T02:42:09.717535+0000 mgr.a (mgr.14388) 11584 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:42:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22676]: audit 2024-09-21T02:42:11.070555+0000 mon.a (mon.0) 9495 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:42:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22676]: audit 2024-09-21T02:42:11.077717+0000 mon.a (mon.0) 9496 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:42:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22676]: audit 2024-09-21T02:42:11.079853+0000 mon.a (mon.0) 9497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:42:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22676]: audit 2024-09-21T02:42:11.091704+0000 mon.a (mon.0) 9498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22676]: audit 2024-09-21T02:42:11.098364+0000 mon.a (mon.0) 9499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:42:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:11 smithi179 bash[23186]: cluster 2024-09-21T02:42:09.717535+0000 mgr.a (mgr.14388) 11584 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:42:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:11 smithi179 bash[23186]: audit 2024-09-21T02:42:11.070555+0000 mon.a (mon.0) 9495 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:42:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:11 smithi179 bash[23186]: audit 2024-09-21T02:42:11.077717+0000 mon.a (mon.0) 9496 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:42:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:11 smithi179 bash[23186]: audit 2024-09-21T02:42:11.079853+0000 mon.a (mon.0) 9497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:42:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:11 smithi179 bash[23186]: audit 2024-09-21T02:42:11.091704+0000 mon.a (mon.0) 9498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:11 smithi179 bash[23186]: audit 2024-09-21T02:42:11.098364+0000 mon.a (mon.0) 9499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:42:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:11 smithi049 bash[23528]: cluster 2024-09-21T02:42:09.717535+0000 mgr.a (mgr.14388) 11584 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:42:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:11 smithi049 bash[23528]: audit 2024-09-21T02:42:11.070555+0000 mon.a (mon.0) 9495 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:42:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:11 smithi049 bash[23528]: audit 2024-09-21T02:42:11.077717+0000 mon.a (mon.0) 9496 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:42:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:11 smithi049 bash[23528]: audit 2024-09-21T02:42:11.079853+0000 mon.a (mon.0) 9497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:42:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:11 smithi049 bash[23528]: audit 2024-09-21T02:42:11.091704+0000 mon.a (mon.0) 9498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:11 smithi049 bash[23528]: audit 2024-09-21T02:42:11.098364+0000 mon.a (mon.0) 9499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:42:12.224 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22930]: debug 2024-09-21T02:42:11.882+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:42:12.224 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:42:11 smithi044 bash[22930]: debug 2024-09-21T02:42:11.886+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:42:12.443 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:12.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:12 smithi044 bash[22676]: audit 2024-09-21T02:42:11.100860+0000 mgr.a (mgr.14388) 11585 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:42:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:12 smithi179 bash[23186]: audit 2024-09-21T02:42:11.100860+0000 mgr.a (mgr.14388) 11585 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:42:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:12 smithi049 bash[23528]: audit 2024-09-21T02:42:11.100860+0000 mgr.a (mgr.14388) 11585 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:42:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:13 smithi044 bash[22676]: cluster 2024-09-21T02:42:11.719021+0000 mgr.a (mgr.14388) 11586 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:42:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:13 smithi044 bash[22676]: audit 2024-09-21T02:42:11.888311+0000 mgr.a (mgr.14388) 11587 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:42:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:13 smithi044 bash[22676]: cephadm 2024-09-21T02:42:11.889793+0000 mgr.a (mgr.14388) 11588 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:42:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:13 smithi044 bash[22676]: audit 2024-09-21T02:42:12.017671+0000 mgr.a (mgr.14388) 11589 : audit [DBG] from='client.254280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:13 smithi179 bash[23186]: cluster 2024-09-21T02:42:11.719021+0000 mgr.a (mgr.14388) 11586 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:13 smithi179 bash[23186]: audit 2024-09-21T02:42:11.888311+0000 mgr.a (mgr.14388) 11587 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:13 smithi179 bash[23186]: cephadm 2024-09-21T02:42:11.889793+0000 mgr.a (mgr.14388) 11588 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:42:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:13 smithi179 bash[23186]: audit 2024-09-21T02:42:12.017671+0000 mgr.a (mgr.14388) 11589 : audit [DBG] from='client.254280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:13 smithi049 bash[23528]: cluster 2024-09-21T02:42:11.719021+0000 mgr.a (mgr.14388) 11586 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:42:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:13 smithi049 bash[23528]: audit 2024-09-21T02:42:11.888311+0000 mgr.a (mgr.14388) 11587 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:42:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:13 smithi049 bash[23528]: cephadm 2024-09-21T02:42:11.889793+0000 mgr.a (mgr.14388) 11588 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:42:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:13 smithi049 bash[23528]: audit 2024-09-21T02:42:12.017671+0000 mgr.a (mgr.14388) 11589 : audit [DBG] from='client.254280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:15 smithi049 bash[23528]: cluster 2024-09-21T02:42:13.720010+0000 mgr.a (mgr.14388) 11590 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:15 smithi044 bash[22676]: cluster 2024-09-21T02:42:13.720010+0000 mgr.a (mgr.14388) 11590 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:15 smithi179 bash[23186]: cluster 2024-09-21T02:42:13.720010+0000 mgr.a (mgr.14388) 11590 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:17.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:17.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:17.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:17 smithi044 bash[22676]: cluster 2024-09-21T02:42:15.722260+0000 mgr.a (mgr.14388) 11591 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:17.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:17 smithi179 bash[23186]: cluster 2024-09-21T02:42:15.722260+0000 mgr.a (mgr.14388) 11591 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:17 smithi049 bash[23528]: cluster 2024-09-21T02:42:15.722260+0000 mgr.a (mgr.14388) 11591 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:18.219 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:18.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:18.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:18.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:18.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:18 smithi044 bash[22676]: audit 2024-09-21T02:42:17.469348+0000 mon.a (mon.0) 9500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:18 smithi044 bash[22676]: audit 2024-09-21T02:42:17.475832+0000 mon.a (mon.0) 9501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:18 smithi044 bash[22676]: audit 2024-09-21T02:42:17.484912+0000 mon.a (mon.0) 9502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:18 smithi044 bash[22676]: audit 2024-09-21T02:42:17.489587+0000 mon.a (mon.0) 9503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:18 smithi044 bash[22676]: audit 2024-09-21T02:42:17.494898+0000 mon.a (mon.0) 9504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:18 smithi044 bash[22676]: audit 2024-09-21T02:42:17.503680+0000 mon.a (mon.0) 9505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:18 smithi179 bash[23186]: audit 2024-09-21T02:42:17.469348+0000 mon.a (mon.0) 9500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:18 smithi179 bash[23186]: audit 2024-09-21T02:42:17.475832+0000 mon.a (mon.0) 9501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:18 smithi179 bash[23186]: audit 2024-09-21T02:42:17.484912+0000 mon.a (mon.0) 9502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:18 smithi179 bash[23186]: audit 2024-09-21T02:42:17.489587+0000 mon.a (mon.0) 9503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:18 smithi179 bash[23186]: audit 2024-09-21T02:42:17.494898+0000 mon.a (mon.0) 9504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:18 smithi179 bash[23186]: audit 2024-09-21T02:42:17.503680+0000 mon.a (mon.0) 9505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:18 smithi049 bash[23528]: audit 2024-09-21T02:42:17.469348+0000 mon.a (mon.0) 9500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:18 smithi049 bash[23528]: audit 2024-09-21T02:42:17.475832+0000 mon.a (mon.0) 9501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:18 smithi049 bash[23528]: audit 2024-09-21T02:42:17.484912+0000 mon.a (mon.0) 9502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:18 smithi049 bash[23528]: audit 2024-09-21T02:42:17.489587+0000 mon.a (mon.0) 9503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:18 smithi049 bash[23528]: audit 2024-09-21T02:42:17.494898+0000 mon.a (mon.0) 9504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:18 smithi049 bash[23528]: audit 2024-09-21T02:42:17.503680+0000 mon.a (mon.0) 9505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:19 smithi049 bash[23528]: cluster 2024-09-21T02:42:17.723004+0000 mgr.a (mgr.14388) 11592 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:19 smithi049 bash[23528]: audit 2024-09-21T02:42:17.783851+0000 mgr.a (mgr.14388) 11593 : audit [DBG] from='client.254358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:19 smithi044 bash[22676]: cluster 2024-09-21T02:42:17.723004+0000 mgr.a (mgr.14388) 11592 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:19 smithi044 bash[22676]: audit 2024-09-21T02:42:17.783851+0000 mgr.a (mgr.14388) 11593 : audit [DBG] from='client.254358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:19 smithi179 bash[23186]: cluster 2024-09-21T02:42:17.723004+0000 mgr.a (mgr.14388) 11592 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:19 smithi179 bash[23186]: audit 2024-09-21T02:42:17.783851+0000 mgr.a (mgr.14388) 11593 : audit [DBG] from='client.254358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:21 smithi049 bash[23528]: cluster 2024-09-21T02:42:19.723978+0000 mgr.a (mgr.14388) 11594 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:21 smithi044 bash[22676]: cluster 2024-09-21T02:42:19.723978+0000 mgr.a (mgr.14388) 11594 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:21 smithi179 bash[23186]: cluster 2024-09-21T02:42:19.723978+0000 mgr.a (mgr.14388) 11594 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:23.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:23 smithi049 bash[23528]: cluster 2024-09-21T02:42:21.726222+0000 mgr.a (mgr.14388) 11595 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:23 smithi044 bash[22676]: cluster 2024-09-21T02:42:21.726222+0000 mgr.a (mgr.14388) 11595 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:23 smithi179 bash[23186]: cluster 2024-09-21T02:42:21.726222+0000 mgr.a (mgr.14388) 11595 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:24.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:24.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:24.781 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:24 smithi049 bash[23528]: audit 2024-09-21T02:42:23.557508+0000 mgr.a (mgr.14388) 11596 : audit [DBG] from='client.254433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:24.892 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:24 smithi179 bash[23186]: audit 2024-09-21T02:42:23.557508+0000 mgr.a (mgr.14388) 11596 : audit [DBG] from='client.254433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:24 smithi044 bash[22676]: audit 2024-09-21T02:42:23.557508+0000 mgr.a (mgr.14388) 11596 : audit [DBG] from='client.254433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:25 smithi044 bash[22676]: cluster 2024-09-21T02:42:23.726850+0000 mgr.a (mgr.14388) 11597 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:25 smithi044 bash[22676]: audit 2024-09-21T02:42:24.560757+0000 mon.a (mon.0) 9506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:25 smithi044 bash[22676]: audit 2024-09-21T02:42:24.566823+0000 mon.a (mon.0) 9507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:25 smithi044 bash[22676]: audit 2024-09-21T02:42:24.576379+0000 mon.a (mon.0) 9508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:25 smithi179 bash[23186]: cluster 2024-09-21T02:42:23.726850+0000 mgr.a (mgr.14388) 11597 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:25 smithi179 bash[23186]: audit 2024-09-21T02:42:24.560757+0000 mon.a (mon.0) 9506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:25 smithi179 bash[23186]: audit 2024-09-21T02:42:24.566823+0000 mon.a (mon.0) 9507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:25 smithi179 bash[23186]: audit 2024-09-21T02:42:24.576379+0000 mon.a (mon.0) 9508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:25 smithi049 bash[23528]: cluster 2024-09-21T02:42:23.726850+0000 mgr.a (mgr.14388) 11597 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:25 smithi049 bash[23528]: audit 2024-09-21T02:42:24.560757+0000 mon.a (mon.0) 9506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:25 smithi049 bash[23528]: audit 2024-09-21T02:42:24.566823+0000 mon.a (mon.0) 9507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:25 smithi049 bash[23528]: audit 2024-09-21T02:42:24.576379+0000 mon.a (mon.0) 9508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:27 smithi049 bash[23528]: cluster 2024-09-21T02:42:25.729146+0000 mgr.a (mgr.14388) 11598 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:27 smithi044 bash[22676]: cluster 2024-09-21T02:42:25.729146+0000 mgr.a (mgr.14388) 11598 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:28.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:27 smithi179 bash[23186]: cluster 2024-09-21T02:42:25.729146+0000 mgr.a (mgr.14388) 11598 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:42:29.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:29.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:29.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:29.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:29.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:29.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:29.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:29.808 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:29 smithi044 bash[22676]: cluster 2024-09-21T02:42:27.729979+0000 mgr.a (mgr.14388) 11599 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:29 smithi179 bash[23186]: cluster 2024-09-21T02:42:27.729979+0000 mgr.a (mgr.14388) 11599 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:29 smithi049 bash[23528]: cluster 2024-09-21T02:42:27.729979+0000 mgr.a (mgr.14388) 11599 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:30.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:30 smithi044 bash[22676]: audit 2024-09-21T02:42:29.361619+0000 mgr.a (mgr.14388) 11600 : audit [DBG] from='client.254508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:30 smithi179 bash[23186]: audit 2024-09-21T02:42:29.361619+0000 mgr.a (mgr.14388) 11600 : audit [DBG] from='client.254508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:30 smithi049 bash[23528]: audit 2024-09-21T02:42:29.361619+0000 mgr.a (mgr.14388) 11600 : audit [DBG] from='client.254508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:31 smithi044 bash[22676]: cluster 2024-09-21T02:42:29.730920+0000 mgr.a (mgr.14388) 11601 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:31 smithi179 bash[23186]: cluster 2024-09-21T02:42:29.730920+0000 mgr.a (mgr.14388) 11601 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:31 smithi049 bash[23528]: cluster 2024-09-21T02:42:29.730920+0000 mgr.a (mgr.14388) 11601 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:33 smithi044 bash[22676]: cluster 2024-09-21T02:42:31.733221+0000 mgr.a (mgr.14388) 11602 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:33 smithi179 bash[23186]: cluster 2024-09-21T02:42:31.733221+0000 mgr.a (mgr.14388) 11602 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:33 smithi049 bash[23528]: cluster 2024-09-21T02:42:31.733221+0000 mgr.a (mgr.14388) 11602 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:34.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:34.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:34.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:34 smithi044 bash[22676]: cluster 2024-09-21T02:42:33.734002+0000 mgr.a (mgr.14388) 11603 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:34 smithi179 bash[23186]: cluster 2024-09-21T02:42:33.734002+0000 mgr.a (mgr.14388) 11603 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:34 smithi049 bash[23528]: cluster 2024-09-21T02:42:33.734002+0000 mgr.a (mgr.14388) 11603 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:35.569 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:35.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:35.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:35.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:35.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:35.906 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:35 smithi049 bash[23528]: audit 2024-09-21T02:42:35.146244+0000 mgr.a (mgr.14388) 11604 : audit [DBG] from='client.254583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:35 smithi044 bash[22676]: audit 2024-09-21T02:42:35.146244+0000 mgr.a (mgr.14388) 11604 : audit [DBG] from='client.254583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:35 smithi179 bash[23186]: audit 2024-09-21T02:42:35.146244+0000 mgr.a (mgr.14388) 11604 : audit [DBG] from='client.254583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:36 smithi044 bash[22676]: cluster 2024-09-21T02:42:35.736739+0000 mgr.a (mgr.14388) 11605 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:36 smithi179 bash[23186]: cluster 2024-09-21T02:42:35.736739+0000 mgr.a (mgr.14388) 11605 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:36 smithi049 bash[23528]: cluster 2024-09-21T02:42:35.736739+0000 mgr.a (mgr.14388) 11605 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:38.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:38 smithi044 bash[22676]: audit 2024-09-21T02:42:37.702510+0000 mon.a (mon.0) 9509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:38 smithi044 bash[22676]: audit 2024-09-21T02:42:37.711519+0000 mon.a (mon.0) 9510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:38 smithi044 bash[22676]: audit 2024-09-21T02:42:37.723727+0000 mon.a (mon.0) 9511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:38 smithi044 bash[22676]: audit 2024-09-21T02:42:37.731363+0000 mon.a (mon.0) 9512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:38 smithi044 bash[22676]: cluster 2024-09-21T02:42:37.737519+0000 mgr.a (mgr.14388) 11606 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:38 smithi044 bash[22676]: audit 2024-09-21T02:42:37.741332+0000 mon.a (mon.0) 9513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:38 smithi044 bash[22676]: audit 2024-09-21T02:42:37.751660+0000 mon.a (mon.0) 9514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:38 smithi179 bash[23186]: audit 2024-09-21T02:42:37.702510+0000 mon.a (mon.0) 9509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:38 smithi179 bash[23186]: audit 2024-09-21T02:42:37.711519+0000 mon.a (mon.0) 9510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:38 smithi179 bash[23186]: audit 2024-09-21T02:42:37.723727+0000 mon.a (mon.0) 9511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:38 smithi179 bash[23186]: audit 2024-09-21T02:42:37.731363+0000 mon.a (mon.0) 9512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:38 smithi179 bash[23186]: cluster 2024-09-21T02:42:37.737519+0000 mgr.a (mgr.14388) 11606 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:38 smithi179 bash[23186]: audit 2024-09-21T02:42:37.741332+0000 mon.a (mon.0) 9513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:38 smithi179 bash[23186]: audit 2024-09-21T02:42:37.751660+0000 mon.a (mon.0) 9514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:38 smithi049 bash[23528]: audit 2024-09-21T02:42:37.702510+0000 mon.a (mon.0) 9509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:38 smithi049 bash[23528]: audit 2024-09-21T02:42:37.711519+0000 mon.a (mon.0) 9510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:38 smithi049 bash[23528]: audit 2024-09-21T02:42:37.723727+0000 mon.a (mon.0) 9511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:38 smithi049 bash[23528]: audit 2024-09-21T02:42:37.731363+0000 mon.a (mon.0) 9512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:38 smithi049 bash[23528]: cluster 2024-09-21T02:42:37.737519+0000 mgr.a (mgr.14388) 11606 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:38 smithi049 bash[23528]: audit 2024-09-21T02:42:37.741332+0000 mon.a (mon.0) 9513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:38 smithi049 bash[23528]: audit 2024-09-21T02:42:37.751660+0000 mon.a (mon.0) 9514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:40.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:40.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:40 smithi179 bash[23186]: cluster 2024-09-21T02:42:39.738314+0000 mgr.a (mgr.14388) 11607 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:42:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:40 smithi049 bash[23528]: cluster 2024-09-21T02:42:39.738314+0000 mgr.a (mgr.14388) 11607 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:42:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:40 smithi044 bash[22676]: cluster 2024-09-21T02:42:39.738314+0000 mgr.a (mgr.14388) 11607 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:42:41.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:41.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:41 smithi049 bash[23528]: audit 2024-09-21T02:42:40.906633+0000 mgr.a (mgr.14388) 11608 : audit [DBG] from='client.254661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:41 smithi044 bash[22676]: audit 2024-09-21T02:42:40.906633+0000 mgr.a (mgr.14388) 11608 : audit [DBG] from='client.254661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:41 smithi179 bash[23186]: audit 2024-09-21T02:42:40.906633+0000 mgr.a (mgr.14388) 11608 : audit [DBG] from='client.254661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:42 smithi049 bash[23528]: cluster 2024-09-21T02:42:41.741196+0000 mgr.a (mgr.14388) 11609 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:42 smithi044 bash[22676]: cluster 2024-09-21T02:42:41.741196+0000 mgr.a (mgr.14388) 11609 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:42 smithi179 bash[23186]: cluster 2024-09-21T02:42:41.741196+0000 mgr.a (mgr.14388) 11609 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:44 smithi049 bash[23528]: cluster 2024-09-21T02:42:43.742046+0000 mgr.a (mgr.14388) 11610 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:44 smithi044 bash[22676]: cluster 2024-09-21T02:42:43.742046+0000 mgr.a (mgr.14388) 11610 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:44 smithi179 bash[23186]: cluster 2024-09-21T02:42:43.742046+0000 mgr.a (mgr.14388) 11610 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:42:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:45 smithi049 bash[23528]: audit 2024-09-21T02:42:44.799732+0000 mon.a (mon.0) 9515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:45 smithi049 bash[23528]: audit 2024-09-21T02:42:44.808544+0000 mon.a (mon.0) 9516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:45 smithi049 bash[23528]: audit 2024-09-21T02:42:44.819108+0000 mon.a (mon.0) 9517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:45 smithi044 bash[22676]: audit 2024-09-21T02:42:44.799732+0000 mon.a (mon.0) 9515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:45 smithi044 bash[22676]: audit 2024-09-21T02:42:44.808544+0000 mon.a (mon.0) 9516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:45 smithi044 bash[22676]: audit 2024-09-21T02:42:44.819108+0000 mon.a (mon.0) 9517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:45 smithi179 bash[23186]: audit 2024-09-21T02:42:44.799732+0000 mon.a (mon.0) 9515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:45 smithi179 bash[23186]: audit 2024-09-21T02:42:44.808544+0000 mon.a (mon.0) 9516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:45 smithi179 bash[23186]: audit 2024-09-21T02:42:44.819108+0000 mon.a (mon.0) 9517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:46.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:46.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:46 smithi179 bash[23186]: cluster 2024-09-21T02:42:45.744101+0000 mgr.a (mgr.14388) 11611 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:47.093 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:47.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:47.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:47.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:47.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:47.185 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:46 smithi049 bash[23528]: cluster 2024-09-21T02:42:45.744101+0000 mgr.a (mgr.14388) 11611 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:46 smithi044 bash[22676]: cluster 2024-09-21T02:42:45.744101+0000 mgr.a (mgr.14388) 11611 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:47 smithi044 bash[22676]: audit 2024-09-21T02:42:46.667500+0000 mgr.a (mgr.14388) 11612 : audit [DBG] from='client.254736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:47 smithi179 bash[23186]: audit 2024-09-21T02:42:46.667500+0000 mgr.a (mgr.14388) 11612 : audit [DBG] from='client.254736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:47 smithi049 bash[23528]: audit 2024-09-21T02:42:46.667500+0000 mgr.a (mgr.14388) 11612 : audit [DBG] from='client.254736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:49.190 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:48 smithi179 bash[23186]: cluster 2024-09-21T02:42:47.745228+0000 mgr.a (mgr.14388) 11613 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:48 smithi044 bash[22676]: cluster 2024-09-21T02:42:47.745228+0000 mgr.a (mgr.14388) 11613 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:48 smithi049 bash[23528]: cluster 2024-09-21T02:42:47.745228+0000 mgr.a (mgr.14388) 11613 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:50 smithi044 bash[22676]: cluster 2024-09-21T02:42:49.746106+0000 mgr.a (mgr.14388) 11614 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:50 smithi179 bash[23186]: cluster 2024-09-21T02:42:49.746106+0000 mgr.a (mgr.14388) 11614 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:50 smithi049 bash[23528]: cluster 2024-09-21T02:42:49.746106+0000 mgr.a (mgr.14388) 11614 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:52.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:52.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:52.864 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:52.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:52.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:52.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:52.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:53.096 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:52 smithi044 bash[22676]: cluster 2024-09-21T02:42:51.748411+0000 mgr.a (mgr.14388) 11615 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:53.096 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:52 smithi044 bash[22676]: audit 2024-09-21T02:42:52.434790+0000 mgr.a (mgr.14388) 11616 : audit [DBG] from='client.254814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:52 smithi179 bash[23186]: cluster 2024-09-21T02:42:51.748411+0000 mgr.a (mgr.14388) 11615 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:52 smithi179 bash[23186]: audit 2024-09-21T02:42:52.434790+0000 mgr.a (mgr.14388) 11616 : audit [DBG] from='client.254814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:52 smithi049 bash[23528]: cluster 2024-09-21T02:42:51.748411+0000 mgr.a (mgr.14388) 11615 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:52 smithi049 bash[23528]: audit 2024-09-21T02:42:52.434790+0000 mgr.a (mgr.14388) 11616 : audit [DBG] from='client.254814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:54 smithi044 bash[22676]: cluster 2024-09-21T02:42:53.749432+0000 mgr.a (mgr.14388) 11617 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:54 smithi179 bash[23186]: cluster 2024-09-21T02:42:53.749432+0000 mgr.a (mgr.14388) 11617 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:54 smithi049 bash[23528]: cluster 2024-09-21T02:42:53.749432+0000 mgr.a (mgr.14388) 11617 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:56 smithi044 bash[22676]: cluster 2024-09-21T02:42:55.751669+0000 mgr.a (mgr.14388) 11618 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:56 smithi179 bash[23186]: cluster 2024-09-21T02:42:55.751669+0000 mgr.a (mgr.14388) 11618 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:56 smithi049 bash[23528]: cluster 2024-09-21T02:42:55.751669+0000 mgr.a (mgr.14388) 11618 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:42:57.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:42:57.866 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:42:57.866 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:42:58.652 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:42:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:42:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:42:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:42:58.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:42:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: cluster 2024-09-21T02:42:57.752304+0000 mgr.a (mgr.14388) 11619 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: audit 2024-09-21T02:42:57.907396+0000 mon.a (mon.0) 9518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: audit 2024-09-21T02:42:57.914864+0000 mon.a (mon.0) 9519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: audit 2024-09-21T02:42:57.921362+0000 mon.a (mon.0) 9520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: audit 2024-09-21T02:42:57.927715+0000 mon.a (mon.0) 9521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: audit 2024-09-21T02:42:57.936403+0000 mon.a (mon.0) 9522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: audit 2024-09-21T02:42:57.944892+0000 mon.a (mon.0) 9523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:42:58 smithi044 bash[22676]: audit 2024-09-21T02:42:58.205207+0000 mgr.a (mgr.14388) 11620 : audit [DBG] from='client.254892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: cluster 2024-09-21T02:42:57.752304+0000 mgr.a (mgr.14388) 11619 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: audit 2024-09-21T02:42:57.907396+0000 mon.a (mon.0) 9518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: audit 2024-09-21T02:42:57.914864+0000 mon.a (mon.0) 9519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: audit 2024-09-21T02:42:57.921362+0000 mon.a (mon.0) 9520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: audit 2024-09-21T02:42:57.927715+0000 mon.a (mon.0) 9521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: audit 2024-09-21T02:42:57.936403+0000 mon.a (mon.0) 9522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: audit 2024-09-21T02:42:57.944892+0000 mon.a (mon.0) 9523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:42:58 smithi179 bash[23186]: audit 2024-09-21T02:42:58.205207+0000 mgr.a (mgr.14388) 11620 : audit [DBG] from='client.254892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: cluster 2024-09-21T02:42:57.752304+0000 mgr.a (mgr.14388) 11619 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:42:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: audit 2024-09-21T02:42:57.907396+0000 mon.a (mon.0) 9518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: audit 2024-09-21T02:42:57.914864+0000 mon.a (mon.0) 9519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: audit 2024-09-21T02:42:57.921362+0000 mon.a (mon.0) 9520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: audit 2024-09-21T02:42:57.927715+0000 mon.a (mon.0) 9521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: audit 2024-09-21T02:42:57.936403+0000 mon.a (mon.0) 9522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: audit 2024-09-21T02:42:57.944892+0000 mon.a (mon.0) 9523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:42:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:42:58 smithi049 bash[23528]: audit 2024-09-21T02:42:58.205207+0000 mgr.a (mgr.14388) 11620 : audit [DBG] from='client.254892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:01.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:00 smithi044 bash[22676]: cluster 2024-09-21T02:42:59.753282+0000 mgr.a (mgr.14388) 11621 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:00 smithi179 bash[23186]: cluster 2024-09-21T02:42:59.753282+0000 mgr.a (mgr.14388) 11621 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:00 smithi049 bash[23528]: cluster 2024-09-21T02:42:59.753282+0000 mgr.a (mgr.14388) 11621 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:02 smithi044 bash[22676]: cluster 2024-09-21T02:43:01.755582+0000 mgr.a (mgr.14388) 11622 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:02 smithi179 bash[23186]: cluster 2024-09-21T02:43:01.755582+0000 mgr.a (mgr.14388) 11622 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:02 smithi049 bash[23528]: cluster 2024-09-21T02:43:01.755582+0000 mgr.a (mgr.14388) 11622 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:03.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:03.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:03.655 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:04.422 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:04.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:04.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:04.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:04.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:04 smithi044 bash[22676]: cluster 2024-09-21T02:43:03.756054+0000 mgr.a (mgr.14388) 11623 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:04 smithi044 bash[22676]: audit 2024-09-21T02:43:03.990161+0000 mgr.a (mgr.14388) 11624 : audit [DBG] from='client.254970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:04 smithi179 bash[23186]: cluster 2024-09-21T02:43:03.756054+0000 mgr.a (mgr.14388) 11623 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:04 smithi179 bash[23186]: audit 2024-09-21T02:43:03.990161+0000 mgr.a (mgr.14388) 11624 : audit [DBG] from='client.254970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:04 smithi049 bash[23528]: cluster 2024-09-21T02:43:03.756054+0000 mgr.a (mgr.14388) 11623 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:04 smithi049 bash[23528]: audit 2024-09-21T02:43:03.990161+0000 mgr.a (mgr.14388) 11624 : audit [DBG] from='client.254970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:06.148 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:05 smithi049 bash[23528]: audit 2024-09-21T02:43:05.000354+0000 mon.a (mon.0) 9524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.149 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:05 smithi049 bash[23528]: audit 2024-09-21T02:43:05.009170+0000 mon.a (mon.0) 9525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.149 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:05 smithi049 bash[23528]: audit 2024-09-21T02:43:05.019580+0000 mon.a (mon.0) 9526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:05 smithi179 bash[23186]: audit 2024-09-21T02:43:05.000354+0000 mon.a (mon.0) 9524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:05 smithi179 bash[23186]: audit 2024-09-21T02:43:05.009170+0000 mon.a (mon.0) 9525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:05 smithi179 bash[23186]: audit 2024-09-21T02:43:05.019580+0000 mon.a (mon.0) 9526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:05 smithi044 bash[22676]: audit 2024-09-21T02:43:05.000354+0000 mon.a (mon.0) 9524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:05 smithi044 bash[22676]: audit 2024-09-21T02:43:05.009170+0000 mon.a (mon.0) 9525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:05 smithi044 bash[22676]: audit 2024-09-21T02:43:05.019580+0000 mon.a (mon.0) 9526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:07 smithi049 bash[23528]: cluster 2024-09-21T02:43:05.757890+0000 mgr.a (mgr.14388) 11625 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:07.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:07 smithi179 bash[23186]: cluster 2024-09-21T02:43:05.757890+0000 mgr.a (mgr.14388) 11625 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:07 smithi044 bash[22676]: cluster 2024-09-21T02:43:05.757890+0000 mgr.a (mgr.14388) 11625 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:09.299 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:09 smithi179 bash[23186]: cluster 2024-09-21T02:43:07.758647+0000 mgr.a (mgr.14388) 11626 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:09 smithi049 bash[23528]: cluster 2024-09-21T02:43:07.758647+0000 mgr.a (mgr.14388) 11626 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:09.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:09.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:09.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:09 smithi044 bash[22676]: cluster 2024-09-21T02:43:07.758647+0000 mgr.a (mgr.14388) 11626 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:10.177 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:10.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:10.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:10.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:10.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:11.139 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:11 smithi044 bash[22676]: audit 2024-09-21T02:43:09.756417+0000 mgr.a (mgr.14388) 11627 : audit [DBG] from='client.255045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:11.139 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:11 smithi044 bash[22676]: cluster 2024-09-21T02:43:09.769476+0000 mgr.a (mgr.14388) 11628 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:11 smithi049 bash[23528]: audit 2024-09-21T02:43:09.756417+0000 mgr.a (mgr.14388) 11627 : audit [DBG] from='client.255045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:11 smithi049 bash[23528]: cluster 2024-09-21T02:43:09.769476+0000 mgr.a (mgr.14388) 11628 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:11 smithi179 bash[23186]: audit 2024-09-21T02:43:09.756417+0000 mgr.a (mgr.14388) 11627 : audit [DBG] from='client.255045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:11 smithi179 bash[23186]: cluster 2024-09-21T02:43:09.769476+0000 mgr.a (mgr.14388) 11628 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:12 smithi049 bash[23528]: audit 2024-09-21T02:43:11.940745+0000 mon.a (mon.0) 9527 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:43:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:12 smithi049 bash[23528]: audit 2024-09-21T02:43:11.948016+0000 mon.a (mon.0) 9528 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:43:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:12 smithi049 bash[23528]: audit 2024-09-21T02:43:11.950013+0000 mon.a (mon.0) 9529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:43:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:12 smithi049 bash[23528]: audit 2024-09-21T02:43:11.961672+0000 mon.a (mon.0) 9530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:12 smithi049 bash[23528]: audit 2024-09-21T02:43:11.968216+0000 mon.a (mon.0) 9531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:43:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:12 smithi044 bash[22676]: audit 2024-09-21T02:43:11.940745+0000 mon.a (mon.0) 9527 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:43:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:12 smithi044 bash[22676]: audit 2024-09-21T02:43:11.948016+0000 mon.a (mon.0) 9528 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:43:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:12 smithi044 bash[22676]: audit 2024-09-21T02:43:11.950013+0000 mon.a (mon.0) 9529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:43:12.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:12 smithi044 bash[22676]: audit 2024-09-21T02:43:11.961672+0000 mon.a (mon.0) 9530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:12 smithi044 bash[22676]: audit 2024-09-21T02:43:11.968216+0000 mon.a (mon.0) 9531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:43:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:12 smithi179 bash[23186]: audit 2024-09-21T02:43:11.940745+0000 mon.a (mon.0) 9527 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:43:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:12 smithi179 bash[23186]: audit 2024-09-21T02:43:11.948016+0000 mon.a (mon.0) 9528 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:43:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:12 smithi179 bash[23186]: audit 2024-09-21T02:43:11.950013+0000 mon.a (mon.0) 9529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:43:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:12 smithi179 bash[23186]: audit 2024-09-21T02:43:11.961672+0000 mon.a (mon.0) 9530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:12 smithi179 bash[23186]: audit 2024-09-21T02:43:11.968216+0000 mon.a (mon.0) 9531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:43:12.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:43:12 smithi044 bash[22930]: debug 2024-09-21T02:43:12.761+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:43:12.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:43:12 smithi044 bash[22930]: debug 2024-09-21T02:43:12.761+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:43:13.290 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:13 smithi044 bash[22676]: cluster 2024-09-21T02:43:11.772007+0000 mgr.a (mgr.14388) 11629 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:43:13.290 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:13 smithi044 bash[22676]: audit 2024-09-21T02:43:11.970674+0000 mgr.a (mgr.14388) 11630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:43:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:13 smithi049 bash[23528]: cluster 2024-09-21T02:43:11.772007+0000 mgr.a (mgr.14388) 11629 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:43:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:13 smithi049 bash[23528]: audit 2024-09-21T02:43:11.970674+0000 mgr.a (mgr.14388) 11630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:43:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:13 smithi179 bash[23186]: cluster 2024-09-21T02:43:11.772007+0000 mgr.a (mgr.14388) 11629 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:43:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:13 smithi179 bash[23186]: audit 2024-09-21T02:43:11.970674+0000 mgr.a (mgr.14388) 11630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:43:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:14 smithi049 bash[23528]: audit 2024-09-21T02:43:12.762859+0000 mgr.a (mgr.14388) 11631 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:43:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:14 smithi049 bash[23528]: cephadm 2024-09-21T02:43:12.763988+0000 mgr.a (mgr.14388) 11632 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:43:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:14 smithi044 bash[22676]: audit 2024-09-21T02:43:12.762859+0000 mgr.a (mgr.14388) 11631 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:43:14.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:14 smithi044 bash[22676]: cephadm 2024-09-21T02:43:12.763988+0000 mgr.a (mgr.14388) 11632 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:43:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:14 smithi179 bash[23186]: audit 2024-09-21T02:43:12.762859+0000 mgr.a (mgr.14388) 11631 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:43:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:14 smithi179 bash[23186]: cephadm 2024-09-21T02:43:12.763988+0000 mgr.a (mgr.14388) 11632 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:43:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:15 smithi049 bash[23528]: cluster 2024-09-21T02:43:13.772998+0000 mgr.a (mgr.14388) 11633 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:43:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:15 smithi044 bash[22676]: cluster 2024-09-21T02:43:13.772998+0000 mgr.a (mgr.14388) 11633 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:43:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:15 smithi179 bash[23186]: cluster 2024-09-21T02:43:13.772998+0000 mgr.a (mgr.14388) 11633 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:43:15.947 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:15.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:15.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:15.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:15.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:16 smithi044 bash[22676]: audit 2024-09-21T02:43:15.515202+0000 mgr.a (mgr.14388) 11634 : audit [DBG] from='client.255228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:16 smithi179 bash[23186]: audit 2024-09-21T02:43:15.515202+0000 mgr.a (mgr.14388) 11634 : audit [DBG] from='client.255228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:16 smithi049 bash[23528]: audit 2024-09-21T02:43:15.515202+0000 mgr.a (mgr.14388) 11634 : audit [DBG] from='client.255228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:17 smithi044 bash[22676]: cluster 2024-09-21T02:43:15.774318+0000 mgr.a (mgr.14388) 11635 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:17 smithi179 bash[23186]: cluster 2024-09-21T02:43:15.774318+0000 mgr.a (mgr.14388) 11635 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:17 smithi049 bash[23528]: cluster 2024-09-21T02:43:15.774318+0000 mgr.a (mgr.14388) 11635 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:19 smithi044 bash[22676]: cluster 2024-09-21T02:43:17.775225+0000 mgr.a (mgr.14388) 11636 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:19 smithi044 bash[22676]: audit 2024-09-21T02:43:18.122867+0000 mon.a (mon.0) 9532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:19 smithi044 bash[22676]: audit 2024-09-21T02:43:18.131561+0000 mon.a (mon.0) 9533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:19 smithi044 bash[22676]: audit 2024-09-21T02:43:18.140463+0000 mon.a (mon.0) 9534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:19 smithi044 bash[22676]: audit 2024-09-21T02:43:18.151033+0000 mon.a (mon.0) 9535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:19 smithi044 bash[22676]: audit 2024-09-21T02:43:18.158825+0000 mon.a (mon.0) 9536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:19 smithi044 bash[22676]: audit 2024-09-21T02:43:18.168713+0000 mon.a (mon.0) 9537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:19 smithi179 bash[23186]: cluster 2024-09-21T02:43:17.775225+0000 mgr.a (mgr.14388) 11636 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:19 smithi179 bash[23186]: audit 2024-09-21T02:43:18.122867+0000 mon.a (mon.0) 9532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:19 smithi179 bash[23186]: audit 2024-09-21T02:43:18.131561+0000 mon.a (mon.0) 9533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:19 smithi179 bash[23186]: audit 2024-09-21T02:43:18.140463+0000 mon.a (mon.0) 9534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:19 smithi179 bash[23186]: audit 2024-09-21T02:43:18.151033+0000 mon.a (mon.0) 9535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:19 smithi179 bash[23186]: audit 2024-09-21T02:43:18.158825+0000 mon.a (mon.0) 9536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:19 smithi179 bash[23186]: audit 2024-09-21T02:43:18.168713+0000 mon.a (mon.0) 9537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:19 smithi049 bash[23528]: cluster 2024-09-21T02:43:17.775225+0000 mgr.a (mgr.14388) 11636 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:19 smithi049 bash[23528]: audit 2024-09-21T02:43:18.122867+0000 mon.a (mon.0) 9532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:19 smithi049 bash[23528]: audit 2024-09-21T02:43:18.131561+0000 mon.a (mon.0) 9533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:19 smithi049 bash[23528]: audit 2024-09-21T02:43:18.140463+0000 mon.a (mon.0) 9534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:19 smithi049 bash[23528]: audit 2024-09-21T02:43:18.151033+0000 mon.a (mon.0) 9535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:19 smithi049 bash[23528]: audit 2024-09-21T02:43:18.158825+0000 mon.a (mon.0) 9536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:19.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:19 smithi049 bash[23528]: audit 2024-09-21T02:43:18.168713+0000 mon.a (mon.0) 9537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:20.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:20.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:20.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:21 smithi044 bash[22676]: cluster 2024-09-21T02:43:19.776200+0000 mgr.a (mgr.14388) 11637 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:21 smithi179 bash[23186]: cluster 2024-09-21T02:43:19.776200+0000 mgr.a (mgr.14388) 11637 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:21 smithi049 bash[23528]: cluster 2024-09-21T02:43:19.776200+0000 mgr.a (mgr.14388) 11637 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:21.743 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:21.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:21.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:21.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:21.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:22.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:22 smithi044 bash[22676]: audit 2024-09-21T02:43:21.290832+0000 mgr.a (mgr.14388) 11638 : audit [DBG] from='client.255303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:22 smithi179 bash[23186]: audit 2024-09-21T02:43:21.290832+0000 mgr.a (mgr.14388) 11638 : audit [DBG] from='client.255303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:22 smithi049 bash[23528]: audit 2024-09-21T02:43:21.290832+0000 mgr.a (mgr.14388) 11638 : audit [DBG] from='client.255303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:23 smithi044 bash[22676]: cluster 2024-09-21T02:43:21.777628+0000 mgr.a (mgr.14388) 11639 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:23 smithi179 bash[23186]: cluster 2024-09-21T02:43:21.777628+0000 mgr.a (mgr.14388) 11639 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:23 smithi049 bash[23528]: cluster 2024-09-21T02:43:21.777628+0000 mgr.a (mgr.14388) 11639 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:25 smithi044 bash[22676]: cluster 2024-09-21T02:43:23.778347+0000 mgr.a (mgr.14388) 11640 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:25 smithi179 bash[23186]: cluster 2024-09-21T02:43:23.778347+0000 mgr.a (mgr.14388) 11640 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:25 smithi049 bash[23528]: cluster 2024-09-21T02:43:23.778347+0000 mgr.a (mgr.14388) 11640 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:26 smithi044 bash[22676]: audit 2024-09-21T02:43:25.200858+0000 mon.a (mon.0) 9538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:26 smithi044 bash[22676]: audit 2024-09-21T02:43:25.209411+0000 mon.a (mon.0) 9539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:26 smithi044 bash[22676]: audit 2024-09-21T02:43:25.220241+0000 mon.a (mon.0) 9540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:26 smithi179 bash[23186]: audit 2024-09-21T02:43:25.200858+0000 mon.a (mon.0) 9538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:26 smithi179 bash[23186]: audit 2024-09-21T02:43:25.209411+0000 mon.a (mon.0) 9539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:26 smithi179 bash[23186]: audit 2024-09-21T02:43:25.220241+0000 mon.a (mon.0) 9540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.549 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:26 smithi049 bash[23528]: audit 2024-09-21T02:43:25.200858+0000 mon.a (mon.0) 9538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:26 smithi049 bash[23528]: audit 2024-09-21T02:43:25.209411+0000 mon.a (mon.0) 9539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:26 smithi049 bash[23528]: audit 2024-09-21T02:43:25.220241+0000 mon.a (mon.0) 9540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:26.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:26.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:26.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:27 smithi179 bash[23186]: cluster 2024-09-21T02:43:25.780349+0000 mgr.a (mgr.14388) 11641 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:27 smithi044 bash[22676]: cluster 2024-09-21T02:43:25.780349+0000 mgr.a (mgr.14388) 11641 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:27.529 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:27.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:27.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:27.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:27.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:27 smithi049 bash[23528]: cluster 2024-09-21T02:43:25.780349+0000 mgr.a (mgr.14388) 11641 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:43:28.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:28 smithi044 bash[22676]: audit 2024-09-21T02:43:27.082560+0000 mgr.a (mgr.14388) 11642 : audit [DBG] from='client.255378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:28 smithi179 bash[23186]: audit 2024-09-21T02:43:27.082560+0000 mgr.a (mgr.14388) 11642 : audit [DBG] from='client.255378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:28 smithi049 bash[23528]: audit 2024-09-21T02:43:27.082560+0000 mgr.a (mgr.14388) 11642 : audit [DBG] from='client.255378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:29 smithi044 bash[22676]: cluster 2024-09-21T02:43:27.781378+0000 mgr.a (mgr.14388) 11643 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:29 smithi179 bash[23186]: cluster 2024-09-21T02:43:27.781378+0000 mgr.a (mgr.14388) 11643 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:29 smithi049 bash[23528]: cluster 2024-09-21T02:43:27.781378+0000 mgr.a (mgr.14388) 11643 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:31 smithi179 bash[23186]: cluster 2024-09-21T02:43:29.782174+0000 mgr.a (mgr.14388) 11644 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:31 smithi049 bash[23528]: cluster 2024-09-21T02:43:29.782174+0000 mgr.a (mgr.14388) 11644 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:31 smithi044 bash[22676]: cluster 2024-09-21T02:43:29.782174+0000 mgr.a (mgr.14388) 11644 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:32.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:32.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:32.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:33.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:33.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:33.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:33.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:33.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:33 smithi179 bash[23186]: cluster 2024-09-21T02:43:31.784443+0000 mgr.a (mgr.14388) 11645 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:33 smithi049 bash[23528]: cluster 2024-09-21T02:43:31.784443+0000 mgr.a (mgr.14388) 11645 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:33.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:33 smithi044 bash[22676]: cluster 2024-09-21T02:43:31.784443+0000 mgr.a (mgr.14388) 11645 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:34 smithi049 bash[23528]: audit 2024-09-21T02:43:32.877028+0000 mgr.a (mgr.14388) 11646 : audit [DBG] from='client.255456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:34.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:34 smithi044 bash[22676]: audit 2024-09-21T02:43:32.877028+0000 mgr.a (mgr.14388) 11646 : audit [DBG] from='client.255456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:34 smithi179 bash[23186]: audit 2024-09-21T02:43:32.877028+0000 mgr.a (mgr.14388) 11646 : audit [DBG] from='client.255456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:35 smithi049 bash[23528]: cluster 2024-09-21T02:43:33.785455+0000 mgr.a (mgr.14388) 11647 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:35 smithi044 bash[22676]: cluster 2024-09-21T02:43:33.785455+0000 mgr.a (mgr.14388) 11647 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:35 smithi179 bash[23186]: cluster 2024-09-21T02:43:33.785455+0000 mgr.a (mgr.14388) 11647 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:37 smithi049 bash[23528]: cluster 2024-09-21T02:43:35.787703+0000 mgr.a (mgr.14388) 11648 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:37 smithi044 bash[22676]: cluster 2024-09-21T02:43:35.787703+0000 mgr.a (mgr.14388) 11648 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:37 smithi179 bash[23186]: cluster 2024-09-21T02:43:35.787703+0000 mgr.a (mgr.14388) 11648 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:38.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:38.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:38.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:39.108 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:39.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:39 smithi044 bash[22676]: cluster 2024-09-21T02:43:37.788477+0000 mgr.a (mgr.14388) 11649 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:39 smithi044 bash[22676]: audit 2024-09-21T02:43:38.346374+0000 mon.a (mon.0) 9541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:39 smithi044 bash[22676]: audit 2024-09-21T02:43:38.355283+0000 mon.a (mon.0) 9542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:39 smithi044 bash[22676]: audit 2024-09-21T02:43:38.365342+0000 mon.a (mon.0) 9543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:39 smithi044 bash[22676]: audit 2024-09-21T02:43:38.393411+0000 mon.a (mon.0) 9544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:39 smithi044 bash[22676]: audit 2024-09-21T02:43:38.399260+0000 mon.a (mon.0) 9545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:39 smithi044 bash[22676]: audit 2024-09-21T02:43:38.406993+0000 mon.a (mon.0) 9546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:39 smithi179 bash[23186]: cluster 2024-09-21T02:43:37.788477+0000 mgr.a (mgr.14388) 11649 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:39 smithi179 bash[23186]: audit 2024-09-21T02:43:38.346374+0000 mon.a (mon.0) 9541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:39 smithi179 bash[23186]: audit 2024-09-21T02:43:38.355283+0000 mon.a (mon.0) 9542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:39 smithi179 bash[23186]: audit 2024-09-21T02:43:38.365342+0000 mon.a (mon.0) 9543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:39 smithi179 bash[23186]: audit 2024-09-21T02:43:38.393411+0000 mon.a (mon.0) 9544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:39 smithi179 bash[23186]: audit 2024-09-21T02:43:38.399260+0000 mon.a (mon.0) 9545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:39 smithi179 bash[23186]: audit 2024-09-21T02:43:38.406993+0000 mon.a (mon.0) 9546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:39 smithi049 bash[23528]: cluster 2024-09-21T02:43:37.788477+0000 mgr.a (mgr.14388) 11649 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:39 smithi049 bash[23528]: audit 2024-09-21T02:43:38.346374+0000 mon.a (mon.0) 9541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:39 smithi049 bash[23528]: audit 2024-09-21T02:43:38.355283+0000 mon.a (mon.0) 9542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:39 smithi049 bash[23528]: audit 2024-09-21T02:43:38.365342+0000 mon.a (mon.0) 9543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:39 smithi049 bash[23528]: audit 2024-09-21T02:43:38.393411+0000 mon.a (mon.0) 9544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:39 smithi049 bash[23528]: audit 2024-09-21T02:43:38.399260+0000 mon.a (mon.0) 9545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:39 smithi049 bash[23528]: audit 2024-09-21T02:43:38.406993+0000 mon.a (mon.0) 9546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:40.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:40 smithi044 bash[22676]: audit 2024-09-21T02:43:38.652451+0000 mgr.a (mgr.14388) 11650 : audit [DBG] from='client.255534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:40.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:40 smithi179 bash[23186]: audit 2024-09-21T02:43:38.652451+0000 mgr.a (mgr.14388) 11650 : audit [DBG] from='client.255534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:40 smithi049 bash[23528]: audit 2024-09-21T02:43:38.652451+0000 mgr.a (mgr.14388) 11650 : audit [DBG] from='client.255534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:41 smithi044 bash[22676]: cluster 2024-09-21T02:43:39.789502+0000 mgr.a (mgr.14388) 11651 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:41 smithi179 bash[23186]: cluster 2024-09-21T02:43:39.789502+0000 mgr.a (mgr.14388) 11651 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:41 smithi049 bash[23528]: cluster 2024-09-21T02:43:39.789502+0000 mgr.a (mgr.14388) 11651 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:43 smithi044 bash[22676]: cluster 2024-09-21T02:43:41.791889+0000 mgr.a (mgr.14388) 11652 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:43 smithi179 bash[23186]: cluster 2024-09-21T02:43:41.791889+0000 mgr.a (mgr.14388) 11652 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:43 smithi049 bash[23528]: cluster 2024-09-21T02:43:41.791889+0000 mgr.a (mgr.14388) 11652 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:44.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:44.110 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:44.111 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:44.880 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:44.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:44.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:44.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:44.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:45.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:45 smithi049 bash[23528]: cluster 2024-09-21T02:43:43.792712+0000 mgr.a (mgr.14388) 11653 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:45.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:45 smithi049 bash[23528]: audit 2024-09-21T02:43:44.448463+0000 mgr.a (mgr.14388) 11654 : audit [DBG] from='client.255603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:45 smithi044 bash[22676]: cluster 2024-09-21T02:43:43.792712+0000 mgr.a (mgr.14388) 11653 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:45 smithi044 bash[22676]: audit 2024-09-21T02:43:44.448463+0000 mgr.a (mgr.14388) 11654 : audit [DBG] from='client.255603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:45 smithi179 bash[23186]: cluster 2024-09-21T02:43:43.792712+0000 mgr.a (mgr.14388) 11653 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:45 smithi179 bash[23186]: audit 2024-09-21T02:43:44.448463+0000 mgr.a (mgr.14388) 11654 : audit [DBG] from='client.255603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:46.724 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:46 smithi049 bash[23528]: audit 2024-09-21T02:43:45.438047+0000 mon.a (mon.0) 9547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.724 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:46 smithi049 bash[23528]: audit 2024-09-21T02:43:45.446774+0000 mon.a (mon.0) 9548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.724 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:46 smithi049 bash[23528]: audit 2024-09-21T02:43:45.457168+0000 mon.a (mon.0) 9549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:46 smithi044 bash[22676]: audit 2024-09-21T02:43:45.438047+0000 mon.a (mon.0) 9547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:46 smithi044 bash[22676]: audit 2024-09-21T02:43:45.446774+0000 mon.a (mon.0) 9548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:46 smithi044 bash[22676]: audit 2024-09-21T02:43:45.457168+0000 mon.a (mon.0) 9549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:46 smithi179 bash[23186]: audit 2024-09-21T02:43:45.438047+0000 mon.a (mon.0) 9547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:46 smithi179 bash[23186]: audit 2024-09-21T02:43:45.446774+0000 mon.a (mon.0) 9548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:46 smithi179 bash[23186]: audit 2024-09-21T02:43:45.457168+0000 mon.a (mon.0) 9549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:47 smithi044 bash[22676]: cluster 2024-09-21T02:43:45.795070+0000 mgr.a (mgr.14388) 11655 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:47 smithi179 bash[23186]: cluster 2024-09-21T02:43:45.795070+0000 mgr.a (mgr.14388) 11655 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:47 smithi049 bash[23528]: cluster 2024-09-21T02:43:45.795070+0000 mgr.a (mgr.14388) 11655 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:43:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:49 smithi049 bash[23528]: cluster 2024-09-21T02:43:47.795890+0000 mgr.a (mgr.14388) 11656 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:49.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:49 smithi044 bash[22676]: cluster 2024-09-21T02:43:47.795890+0000 mgr.a (mgr.14388) 11656 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:49 smithi179 bash[23186]: cluster 2024-09-21T02:43:47.795890+0000 mgr.a (mgr.14388) 11656 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:49.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:49.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:49.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:50.661 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:51 smithi044 bash[22676]: cluster 2024-09-21T02:43:49.796741+0000 mgr.a (mgr.14388) 11657 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:51 smithi044 bash[22676]: audit 2024-09-21T02:43:50.232877+0000 mgr.a (mgr.14388) 11658 : audit [DBG] from='client.255678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:51 smithi179 bash[23186]: cluster 2024-09-21T02:43:49.796741+0000 mgr.a (mgr.14388) 11657 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:51 smithi179 bash[23186]: audit 2024-09-21T02:43:50.232877+0000 mgr.a (mgr.14388) 11658 : audit [DBG] from='client.255678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:51 smithi049 bash[23528]: cluster 2024-09-21T02:43:49.796741+0000 mgr.a (mgr.14388) 11657 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:51 smithi049 bash[23528]: audit 2024-09-21T02:43:50.232877+0000 mgr.a (mgr.14388) 11658 : audit [DBG] from='client.255678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:53 smithi044 bash[22676]: cluster 2024-09-21T02:43:51.798674+0000 mgr.a (mgr.14388) 11659 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:53 smithi179 bash[23186]: cluster 2024-09-21T02:43:51.798674+0000 mgr.a (mgr.14388) 11659 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:53 smithi049 bash[23528]: cluster 2024-09-21T02:43:51.798674+0000 mgr.a (mgr.14388) 11659 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:55.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:43:55.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:43:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:43:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:55 smithi044 bash[22676]: cluster 2024-09-21T02:43:53.799480+0000 mgr.a (mgr.14388) 11660 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:43:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:55 smithi179 bash[23186]: cluster 2024-09-21T02:43:53.799480+0000 mgr.a (mgr.14388) 11660 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:43:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:55 smithi049 bash[23528]: cluster 2024-09-21T02:43:53.799480+0000 mgr.a (mgr.14388) 11660 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:43:56.440 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:43:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:43:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:43:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:43:56.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:43:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:57 smithi044 bash[22676]: cluster 2024-09-21T02:43:55.800772+0000 mgr.a (mgr.14388) 11661 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:57 smithi044 bash[22676]: audit 2024-09-21T02:43:55.999944+0000 mgr.a (mgr.14388) 11662 : audit [DBG] from='client.255753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:57 smithi179 bash[23186]: cluster 2024-09-21T02:43:55.800772+0000 mgr.a (mgr.14388) 11661 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:57 smithi179 bash[23186]: audit 2024-09-21T02:43:55.999944+0000 mgr.a (mgr.14388) 11662 : audit [DBG] from='client.255753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:57 smithi049 bash[23528]: cluster 2024-09-21T02:43:55.800772+0000 mgr.a (mgr.14388) 11661 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:43:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:57 smithi049 bash[23528]: audit 2024-09-21T02:43:55.999944+0000 mgr.a (mgr.14388) 11662 : audit [DBG] from='client.255753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:59 smithi044 bash[22676]: cluster 2024-09-21T02:43:57.801694+0000 mgr.a (mgr.14388) 11663 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:59 smithi044 bash[22676]: audit 2024-09-21T02:43:58.565822+0000 mon.a (mon.0) 9550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:59 smithi044 bash[22676]: audit 2024-09-21T02:43:58.573580+0000 mon.a (mon.0) 9551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:59 smithi044 bash[22676]: audit 2024-09-21T02:43:58.583826+0000 mon.a (mon.0) 9552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:59 smithi044 bash[22676]: audit 2024-09-21T02:43:58.615318+0000 mon.a (mon.0) 9553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:59 smithi044 bash[22676]: audit 2024-09-21T02:43:58.621428+0000 mon.a (mon.0) 9554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:43:59 smithi044 bash[22676]: audit 2024-09-21T02:43:58.628415+0000 mon.a (mon.0) 9555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:59 smithi179 bash[23186]: cluster 2024-09-21T02:43:57.801694+0000 mgr.a (mgr.14388) 11663 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:44:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:59 smithi179 bash[23186]: audit 2024-09-21T02:43:58.565822+0000 mon.a (mon.0) 9550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:59 smithi179 bash[23186]: audit 2024-09-21T02:43:58.573580+0000 mon.a (mon.0) 9551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:59 smithi179 bash[23186]: audit 2024-09-21T02:43:58.583826+0000 mon.a (mon.0) 9552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:59 smithi179 bash[23186]: audit 2024-09-21T02:43:58.615318+0000 mon.a (mon.0) 9553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:59 smithi179 bash[23186]: audit 2024-09-21T02:43:58.621428+0000 mon.a (mon.0) 9554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:43:59 smithi179 bash[23186]: audit 2024-09-21T02:43:58.628415+0000 mon.a (mon.0) 9555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:59 smithi049 bash[23528]: cluster 2024-09-21T02:43:57.801694+0000 mgr.a (mgr.14388) 11663 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:44:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:59 smithi049 bash[23528]: audit 2024-09-21T02:43:58.565822+0000 mon.a (mon.0) 9550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:59 smithi049 bash[23528]: audit 2024-09-21T02:43:58.573580+0000 mon.a (mon.0) 9551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:59 smithi049 bash[23528]: audit 2024-09-21T02:43:58.583826+0000 mon.a (mon.0) 9552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:59 smithi049 bash[23528]: audit 2024-09-21T02:43:58.615318+0000 mon.a (mon.0) 9553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:59 smithi049 bash[23528]: audit 2024-09-21T02:43:58.621428+0000 mon.a (mon.0) 9554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:43:59 smithi049 bash[23528]: audit 2024-09-21T02:43:58.628415+0000 mon.a (mon.0) 9555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:01.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:01.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:01.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:01 smithi044 bash[22676]: cluster 2024-09-21T02:43:59.802450+0000 mgr.a (mgr.14388) 11664 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:44:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:01 smithi179 bash[23186]: cluster 2024-09-21T02:43:59.802450+0000 mgr.a (mgr.14388) 11664 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:44:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:01 smithi049 bash[23528]: cluster 2024-09-21T02:43:59.802450+0000 mgr.a (mgr.14388) 11664 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:44:02.198 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:02.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:03 smithi044 bash[22676]: audit 2024-09-21T02:44:01.774489+0000 mgr.a (mgr.14388) 11665 : audit [DBG] from='client.255831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:03 smithi044 bash[22676]: cluster 2024-09-21T02:44:01.804181+0000 mgr.a (mgr.14388) 11666 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:03 smithi179 bash[23186]: audit 2024-09-21T02:44:01.774489+0000 mgr.a (mgr.14388) 11665 : audit [DBG] from='client.255831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:03 smithi179 bash[23186]: cluster 2024-09-21T02:44:01.804181+0000 mgr.a (mgr.14388) 11666 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:03 smithi049 bash[23528]: audit 2024-09-21T02:44:01.774489+0000 mgr.a (mgr.14388) 11665 : audit [DBG] from='client.255831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:03 smithi049 bash[23528]: cluster 2024-09-21T02:44:01.804181+0000 mgr.a (mgr.14388) 11666 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:05 smithi044 bash[22676]: cluster 2024-09-21T02:44:03.805064+0000 mgr.a (mgr.14388) 11667 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:05 smithi179 bash[23186]: cluster 2024-09-21T02:44:03.805064+0000 mgr.a (mgr.14388) 11667 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:05 smithi049 bash[23528]: cluster 2024-09-21T02:44:03.805064+0000 mgr.a (mgr.14388) 11667 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:06.948 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:06 smithi049 bash[23528]: audit 2024-09-21T02:44:05.675906+0000 mon.a (mon.0) 9556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:06.949 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:06 smithi049 bash[23528]: audit 2024-09-21T02:44:05.685238+0000 mon.a (mon.0) 9557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:06.949 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:06 smithi049 bash[23528]: audit 2024-09-21T02:44:05.697630+0000 mon.a (mon.0) 9558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:06.949 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:06 smithi049 bash[23528]: cluster 2024-09-21T02:44:05.807311+0000 mgr.a (mgr.14388) 11668 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:06 smithi044 bash[22676]: audit 2024-09-21T02:44:05.675906+0000 mon.a (mon.0) 9556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:06 smithi044 bash[22676]: audit 2024-09-21T02:44:05.685238+0000 mon.a (mon.0) 9557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:06 smithi044 bash[22676]: audit 2024-09-21T02:44:05.697630+0000 mon.a (mon.0) 9558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:06 smithi044 bash[22676]: cluster 2024-09-21T02:44:05.807311+0000 mgr.a (mgr.14388) 11668 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:06 smithi179 bash[23186]: audit 2024-09-21T02:44:05.675906+0000 mon.a (mon.0) 9556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:06 smithi179 bash[23186]: audit 2024-09-21T02:44:05.685238+0000 mon.a (mon.0) 9557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:06 smithi179 bash[23186]: audit 2024-09-21T02:44:05.697630+0000 mon.a (mon.0) 9558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:06 smithi179 bash[23186]: cluster 2024-09-21T02:44:05.807311+0000 mgr.a (mgr.14388) 11668 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:07.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:07.201 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:07.201 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:07.847 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:07 smithi179 bash[23186]: audit 2024-09-21T02:44:07.542635+0000 mgr.a (mgr.14388) 11669 : audit [DBG] from='client.255906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:07 smithi044 bash[22676]: audit 2024-09-21T02:44:07.542635+0000 mgr.a (mgr.14388) 11669 : audit [DBG] from='client.255906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:07.987 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:07.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:07.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:07.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:07.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:07 smithi049 bash[23528]: audit 2024-09-21T02:44:07.542635+0000 mgr.a (mgr.14388) 11669 : audit [DBG] from='client.255906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:08 smithi044 bash[22676]: cluster 2024-09-21T02:44:07.808078+0000 mgr.a (mgr.14388) 11670 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:08 smithi179 bash[23186]: cluster 2024-09-21T02:44:07.808078+0000 mgr.a (mgr.14388) 11670 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:08 smithi049 bash[23528]: cluster 2024-09-21T02:44:07.808078+0000 mgr.a (mgr.14388) 11670 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:11.144 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:10 smithi044 bash[22676]: cluster 2024-09-21T02:44:09.809112+0000 mgr.a (mgr.14388) 11671 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:10 smithi179 bash[23186]: cluster 2024-09-21T02:44:09.809112+0000 mgr.a (mgr.14388) 11671 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:10 smithi049 bash[23528]: cluster 2024-09-21T02:44:09.809112+0000 mgr.a (mgr.14388) 11671 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:12.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:12.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:12.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:12 smithi044 bash[22676]: cluster 2024-09-21T02:44:11.810635+0000 mgr.a (mgr.14388) 11672 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:12 smithi044 bash[22676]: audit 2024-09-21T02:44:12.814398+0000 mon.a (mon.0) 9559 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:44:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:12 smithi179 bash[23186]: cluster 2024-09-21T02:44:11.810635+0000 mgr.a (mgr.14388) 11672 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:12 smithi179 bash[23186]: audit 2024-09-21T02:44:12.814398+0000 mon.a (mon.0) 9559 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:44:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:12 smithi049 bash[23528]: cluster 2024-09-21T02:44:11.810635+0000 mgr.a (mgr.14388) 11672 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:12 smithi049 bash[23528]: audit 2024-09-21T02:44:12.814398+0000 mon.a (mon.0) 9559 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:44:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:14.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22930]: debug 2024-09-21T02:44:14.420+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22930]: debug 2024-09-21T02:44:14.424+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.320518+0000 mgr.a (mgr.14388) 11673 : audit [DBG] from='client.255978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.383489+0000 mon.a (mon.0) 9560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.389048+0000 mon.a (mon.0) 9561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.397625+0000 mon.a (mon.0) 9562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.403137+0000 mon.a (mon.0) 9563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.404837+0000 mon.a (mon.0) 9564 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.406488+0000 mon.a (mon.0) 9565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.414075+0000 mon.a (mon.0) 9566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.416811+0000 mon.a (mon.0) 9567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:44:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:14 smithi044 bash[22676]: audit 2024-09-21T02:44:13.417887+0000 mgr.a (mgr.14388) 11674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:44:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.320518+0000 mgr.a (mgr.14388) 11673 : audit [DBG] from='client.255978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.383489+0000 mon.a (mon.0) 9560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.389048+0000 mon.a (mon.0) 9561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.397625+0000 mon.a (mon.0) 9562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.403137+0000 mon.a (mon.0) 9563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.404837+0000 mon.a (mon.0) 9564 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:44:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.406488+0000 mon.a (mon.0) 9565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:44:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.414075+0000 mon.a (mon.0) 9566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.416811+0000 mon.a (mon.0) 9567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:44:14.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:14 smithi179 bash[23186]: audit 2024-09-21T02:44:13.417887+0000 mgr.a (mgr.14388) 11674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:44:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.320518+0000 mgr.a (mgr.14388) 11673 : audit [DBG] from='client.255978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.383489+0000 mon.a (mon.0) 9560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.389048+0000 mon.a (mon.0) 9561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.397625+0000 mon.a (mon.0) 9562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.403137+0000 mon.a (mon.0) 9563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.404837+0000 mon.a (mon.0) 9564 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.406488+0000 mon.a (mon.0) 9565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.414075+0000 mon.a (mon.0) 9566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.416811+0000 mon.a (mon.0) 9567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:14 smithi049 bash[23528]: audit 2024-09-21T02:44:13.417887+0000 mgr.a (mgr.14388) 11674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:44:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:15 smithi044 bash[22676]: cluster 2024-09-21T02:44:13.811113+0000 mgr.a (mgr.14388) 11675 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:15 smithi044 bash[22676]: audit 2024-09-21T02:44:14.424422+0000 mgr.a (mgr.14388) 11676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:44:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:15 smithi044 bash[22676]: cephadm 2024-09-21T02:44:14.425557+0000 mgr.a (mgr.14388) 11677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:44:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:15 smithi179 bash[23186]: cluster 2024-09-21T02:44:13.811113+0000 mgr.a (mgr.14388) 11675 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:15 smithi179 bash[23186]: audit 2024-09-21T02:44:14.424422+0000 mgr.a (mgr.14388) 11676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:44:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:15 smithi179 bash[23186]: cephadm 2024-09-21T02:44:14.425557+0000 mgr.a (mgr.14388) 11677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:44:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:15 smithi049 bash[23528]: cluster 2024-09-21T02:44:13.811113+0000 mgr.a (mgr.14388) 11675 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:15 smithi049 bash[23528]: audit 2024-09-21T02:44:14.424422+0000 mgr.a (mgr.14388) 11676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:44:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:15 smithi049 bash[23528]: cephadm 2024-09-21T02:44:14.425557+0000 mgr.a (mgr.14388) 11677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:44:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:17 smithi044 bash[22676]: cluster 2024-09-21T02:44:15.813448+0000 mgr.a (mgr.14388) 11678 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:17 smithi179 bash[23186]: cluster 2024-09-21T02:44:15.813448+0000 mgr.a (mgr.14388) 11678 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:17 smithi049 bash[23528]: cluster 2024-09-21T02:44:15.813448+0000 mgr.a (mgr.14388) 11678 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:18.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:18.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:18.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:19.501 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:19.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:19.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:19.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:19.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:19 smithi044 bash[22676]: cluster 2024-09-21T02:44:17.814249+0000 mgr.a (mgr.14388) 11679 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:19 smithi044 bash[22676]: audit 2024-09-21T02:44:18.779213+0000 mon.a (mon.0) 9568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:19 smithi044 bash[22676]: audit 2024-09-21T02:44:18.785671+0000 mon.a (mon.0) 9569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:19 smithi044 bash[22676]: audit 2024-09-21T02:44:18.792251+0000 mon.a (mon.0) 9570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:19 smithi044 bash[22676]: audit 2024-09-21T02:44:18.808236+0000 mon.a (mon.0) 9571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:19 smithi044 bash[22676]: audit 2024-09-21T02:44:18.813053+0000 mon.a (mon.0) 9572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:19 smithi044 bash[22676]: audit 2024-09-21T02:44:18.820880+0000 mon.a (mon.0) 9573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:19 smithi179 bash[23186]: cluster 2024-09-21T02:44:17.814249+0000 mgr.a (mgr.14388) 11679 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:19 smithi179 bash[23186]: audit 2024-09-21T02:44:18.779213+0000 mon.a (mon.0) 9568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:19 smithi179 bash[23186]: audit 2024-09-21T02:44:18.785671+0000 mon.a (mon.0) 9569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:19 smithi179 bash[23186]: audit 2024-09-21T02:44:18.792251+0000 mon.a (mon.0) 9570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:19 smithi179 bash[23186]: audit 2024-09-21T02:44:18.808236+0000 mon.a (mon.0) 9571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:19 smithi179 bash[23186]: audit 2024-09-21T02:44:18.813053+0000 mon.a (mon.0) 9572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:19 smithi179 bash[23186]: audit 2024-09-21T02:44:18.820880+0000 mon.a (mon.0) 9573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:19 smithi049 bash[23528]: cluster 2024-09-21T02:44:17.814249+0000 mgr.a (mgr.14388) 11679 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:19 smithi049 bash[23528]: audit 2024-09-21T02:44:18.779213+0000 mon.a (mon.0) 9568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:19 smithi049 bash[23528]: audit 2024-09-21T02:44:18.785671+0000 mon.a (mon.0) 9569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:19 smithi049 bash[23528]: audit 2024-09-21T02:44:18.792251+0000 mon.a (mon.0) 9570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:19 smithi049 bash[23528]: audit 2024-09-21T02:44:18.808236+0000 mon.a (mon.0) 9571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:19 smithi049 bash[23528]: audit 2024-09-21T02:44:18.813053+0000 mon.a (mon.0) 9572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:19 smithi049 bash[23528]: audit 2024-09-21T02:44:18.820880+0000 mon.a (mon.0) 9573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:20 smithi044 bash[22676]: audit 2024-09-21T02:44:19.072183+0000 mgr.a (mgr.14388) 11680 : audit [DBG] from='client.256155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:20 smithi179 bash[23186]: audit 2024-09-21T02:44:19.072183+0000 mgr.a (mgr.14388) 11680 : audit [DBG] from='client.256155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:20 smithi049 bash[23528]: audit 2024-09-21T02:44:19.072183+0000 mgr.a (mgr.14388) 11680 : audit [DBG] from='client.256155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:21 smithi044 bash[22676]: cluster 2024-09-21T02:44:19.815198+0000 mgr.a (mgr.14388) 11681 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:21 smithi179 bash[23186]: cluster 2024-09-21T02:44:19.815198+0000 mgr.a (mgr.14388) 11681 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:21 smithi049 bash[23528]: cluster 2024-09-21T02:44:19.815198+0000 mgr.a (mgr.14388) 11681 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:23 smithi044 bash[22676]: cluster 2024-09-21T02:44:21.817500+0000 mgr.a (mgr.14388) 11682 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:23 smithi179 bash[23186]: cluster 2024-09-21T02:44:21.817500+0000 mgr.a (mgr.14388) 11682 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:23 smithi049 bash[23528]: cluster 2024-09-21T02:44:21.817500+0000 mgr.a (mgr.14388) 11682 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:24.503 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:24.503 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:24.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:25.295 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:25.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:25 smithi044 bash[22676]: cluster 2024-09-21T02:44:23.818263+0000 mgr.a (mgr.14388) 11683 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:25 smithi179 bash[23186]: cluster 2024-09-21T02:44:23.818263+0000 mgr.a (mgr.14388) 11683 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:25 smithi049 bash[23528]: cluster 2024-09-21T02:44:23.818263+0000 mgr.a (mgr.14388) 11683 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:26 smithi044 bash[22676]: audit 2024-09-21T02:44:24.841047+0000 mgr.a (mgr.14388) 11684 : audit [DBG] from='client.256230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:26 smithi044 bash[22676]: audit 2024-09-21T02:44:25.910205+0000 mon.a (mon.0) 9574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:26 smithi044 bash[22676]: audit 2024-09-21T02:44:25.918866+0000 mon.a (mon.0) 9575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:26 smithi044 bash[22676]: audit 2024-09-21T02:44:25.929389+0000 mon.a (mon.0) 9576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:26 smithi179 bash[23186]: audit 2024-09-21T02:44:24.841047+0000 mgr.a (mgr.14388) 11684 : audit [DBG] from='client.256230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:26 smithi179 bash[23186]: audit 2024-09-21T02:44:25.910205+0000 mon.a (mon.0) 9574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:26 smithi179 bash[23186]: audit 2024-09-21T02:44:25.918866+0000 mon.a (mon.0) 9575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:26 smithi179 bash[23186]: audit 2024-09-21T02:44:25.929389+0000 mon.a (mon.0) 9576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:26 smithi049 bash[23528]: audit 2024-09-21T02:44:24.841047+0000 mgr.a (mgr.14388) 11684 : audit [DBG] from='client.256230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:26 smithi049 bash[23528]: audit 2024-09-21T02:44:25.910205+0000 mon.a (mon.0) 9574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:26 smithi049 bash[23528]: audit 2024-09-21T02:44:25.918866+0000 mon.a (mon.0) 9575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:26 smithi049 bash[23528]: audit 2024-09-21T02:44:25.929389+0000 mon.a (mon.0) 9576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:27.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:27 smithi179 bash[23186]: cluster 2024-09-21T02:44:25.821012+0000 mgr.a (mgr.14388) 11685 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:27 smithi044 bash[22676]: cluster 2024-09-21T02:44:25.821012+0000 mgr.a (mgr.14388) 11685 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:27.739 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:27 smithi049 bash[23528]: cluster 2024-09-21T02:44:25.821012+0000 mgr.a (mgr.14388) 11685 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:44:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:29 smithi049 bash[23528]: cluster 2024-09-21T02:44:27.821838+0000 mgr.a (mgr.14388) 11686 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:44:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:29 smithi044 bash[22676]: cluster 2024-09-21T02:44:27.821838+0000 mgr.a (mgr.14388) 11686 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:44:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:29 smithi179 bash[23186]: cluster 2024-09-21T02:44:27.821838+0000 mgr.a (mgr.14388) 11686 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:44:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:30.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:30.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:31.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:31.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:31.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:31.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:31.056 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:31 smithi044 bash[22676]: cluster 2024-09-21T02:44:29.822575+0000 mgr.a (mgr.14388) 11687 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:44:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:31 smithi179 bash[23186]: cluster 2024-09-21T02:44:29.822575+0000 mgr.a (mgr.14388) 11687 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:44:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:31 smithi049 bash[23528]: cluster 2024-09-21T02:44:29.822575+0000 mgr.a (mgr.14388) 11687 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T02:44:32.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:32 smithi044 bash[22676]: audit 2024-09-21T02:44:30.633347+0000 mgr.a (mgr.14388) 11688 : audit [DBG] from='client.256305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:32 smithi179 bash[23186]: audit 2024-09-21T02:44:30.633347+0000 mgr.a (mgr.14388) 11688 : audit [DBG] from='client.256305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:32 smithi049 bash[23528]: audit 2024-09-21T02:44:30.633347+0000 mgr.a (mgr.14388) 11688 : audit [DBG] from='client.256305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:33 smithi044 bash[22676]: cluster 2024-09-21T02:44:31.825384+0000 mgr.a (mgr.14388) 11689 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:33 smithi179 bash[23186]: cluster 2024-09-21T02:44:31.825384+0000 mgr.a (mgr.14388) 11689 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:33 smithi049 bash[23528]: cluster 2024-09-21T02:44:31.825384+0000 mgr.a (mgr.14388) 11689 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:35 smithi044 bash[22676]: cluster 2024-09-21T02:44:33.826788+0000 mgr.a (mgr.14388) 11690 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:44:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:35 smithi179 bash[23186]: cluster 2024-09-21T02:44:33.826788+0000 mgr.a (mgr.14388) 11690 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:44:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:35 smithi049 bash[23528]: cluster 2024-09-21T02:44:33.826788+0000 mgr.a (mgr.14388) 11690 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:44:36.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:36.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:36.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:36.845 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:36.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:36.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:36.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:36.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:37 smithi179 bash[23186]: cluster 2024-09-21T02:44:35.828822+0000 mgr.a (mgr.14388) 11691 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:37 smithi179 bash[23186]: audit 2024-09-21T02:44:36.398942+0000 mgr.a (mgr.14388) 11692 : audit [DBG] from='client.256383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:37 smithi049 bash[23528]: cluster 2024-09-21T02:44:35.828822+0000 mgr.a (mgr.14388) 11691 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:37 smithi049 bash[23528]: audit 2024-09-21T02:44:36.398942+0000 mgr.a (mgr.14388) 11692 : audit [DBG] from='client.256383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:37 smithi044 bash[22676]: cluster 2024-09-21T02:44:35.828822+0000 mgr.a (mgr.14388) 11691 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:37 smithi044 bash[22676]: audit 2024-09-21T02:44:36.398942+0000 mgr.a (mgr.14388) 11692 : audit [DBG] from='client.256383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:39 smithi179 bash[23186]: cluster 2024-09-21T02:44:37.829787+0000 mgr.a (mgr.14388) 11693 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:39 smithi179 bash[23186]: audit 2024-09-21T02:44:38.989233+0000 mon.a (mon.0) 9577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:39 smithi179 bash[23186]: audit 2024-09-21T02:44:39.002244+0000 mon.a (mon.0) 9578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:39 smithi179 bash[23186]: audit 2024-09-21T02:44:39.010391+0000 mon.a (mon.0) 9579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:39 smithi179 bash[23186]: audit 2024-09-21T02:44:39.018123+0000 mon.a (mon.0) 9580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:39 smithi179 bash[23186]: audit 2024-09-21T02:44:39.025987+0000 mon.a (mon.0) 9581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:39 smithi179 bash[23186]: audit 2024-09-21T02:44:39.037042+0000 mon.a (mon.0) 9582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:39 smithi049 bash[23528]: cluster 2024-09-21T02:44:37.829787+0000 mgr.a (mgr.14388) 11693 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:44:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:39 smithi049 bash[23528]: audit 2024-09-21T02:44:38.989233+0000 mon.a (mon.0) 9577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:39 smithi049 bash[23528]: audit 2024-09-21T02:44:39.002244+0000 mon.a (mon.0) 9578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:39 smithi049 bash[23528]: audit 2024-09-21T02:44:39.010391+0000 mon.a (mon.0) 9579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:39 smithi049 bash[23528]: audit 2024-09-21T02:44:39.018123+0000 mon.a (mon.0) 9580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:39 smithi049 bash[23528]: audit 2024-09-21T02:44:39.025987+0000 mon.a (mon.0) 9581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:39 smithi049 bash[23528]: audit 2024-09-21T02:44:39.037042+0000 mon.a (mon.0) 9582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:39 smithi044 bash[22676]: cluster 2024-09-21T02:44:37.829787+0000 mgr.a (mgr.14388) 11693 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:44:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:39 smithi044 bash[22676]: audit 2024-09-21T02:44:38.989233+0000 mon.a (mon.0) 9577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:39 smithi044 bash[22676]: audit 2024-09-21T02:44:39.002244+0000 mon.a (mon.0) 9578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:39 smithi044 bash[22676]: audit 2024-09-21T02:44:39.010391+0000 mon.a (mon.0) 9579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:39 smithi044 bash[22676]: audit 2024-09-21T02:44:39.018123+0000 mon.a (mon.0) 9580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:39 smithi044 bash[22676]: audit 2024-09-21T02:44:39.025987+0000 mon.a (mon.0) 9581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:39 smithi044 bash[22676]: audit 2024-09-21T02:44:39.037042+0000 mon.a (mon.0) 9582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:41 smithi179 bash[23186]: cluster 2024-09-21T02:44:39.830603+0000 mgr.a (mgr.14388) 11694 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:44:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:41 smithi049 bash[23528]: cluster 2024-09-21T02:44:39.830603+0000 mgr.a (mgr.14388) 11694 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:44:41.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:41.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:41.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:41 smithi044 bash[22676]: cluster 2024-09-21T02:44:39.830603+0000 mgr.a (mgr.14388) 11694 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:44:42.601 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:42.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:42.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:42.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:42.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:43 smithi049 bash[23528]: cluster 2024-09-21T02:44:41.832831+0000 mgr.a (mgr.14388) 11695 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:44:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:43 smithi049 bash[23528]: audit 2024-09-21T02:44:42.177811+0000 mgr.a (mgr.14388) 11696 : audit [DBG] from='client.256461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:43 smithi044 bash[22676]: cluster 2024-09-21T02:44:41.832831+0000 mgr.a (mgr.14388) 11695 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:44:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:43 smithi044 bash[22676]: audit 2024-09-21T02:44:42.177811+0000 mgr.a (mgr.14388) 11696 : audit [DBG] from='client.256461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:43 smithi179 bash[23186]: cluster 2024-09-21T02:44:41.832831+0000 mgr.a (mgr.14388) 11695 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:44:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:43 smithi179 bash[23186]: audit 2024-09-21T02:44:42.177811+0000 mgr.a (mgr.14388) 11696 : audit [DBG] from='client.256461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:45 smithi049 bash[23528]: cluster 2024-09-21T02:44:43.833741+0000 mgr.a (mgr.14388) 11697 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:45 smithi044 bash[22676]: cluster 2024-09-21T02:44:43.833741+0000 mgr.a (mgr.14388) 11697 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:45 smithi179 bash[23186]: cluster 2024-09-21T02:44:43.833741+0000 mgr.a (mgr.14388) 11697 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:47 smithi044 bash[22676]: cluster 2024-09-21T02:44:45.835982+0000 mgr.a (mgr.14388) 11698 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:47 smithi044 bash[22676]: audit 2024-09-21T02:44:46.142442+0000 mon.a (mon.0) 9583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:47 smithi044 bash[22676]: audit 2024-09-21T02:44:46.152613+0000 mon.a (mon.0) 9584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:47 smithi044 bash[22676]: audit 2024-09-21T02:44:46.164478+0000 mon.a (mon.0) 9585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:47 smithi179 bash[23186]: cluster 2024-09-21T02:44:45.835982+0000 mgr.a (mgr.14388) 11698 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:47 smithi179 bash[23186]: audit 2024-09-21T02:44:46.142442+0000 mon.a (mon.0) 9583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:47 smithi179 bash[23186]: audit 2024-09-21T02:44:46.152613+0000 mon.a (mon.0) 9584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:47 smithi179 bash[23186]: audit 2024-09-21T02:44:46.164478+0000 mon.a (mon.0) 9585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:47 smithi049 bash[23528]: cluster 2024-09-21T02:44:45.835982+0000 mgr.a (mgr.14388) 11698 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:47.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:47 smithi049 bash[23528]: audit 2024-09-21T02:44:46.142442+0000 mon.a (mon.0) 9583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:47 smithi049 bash[23528]: audit 2024-09-21T02:44:46.152613+0000 mon.a (mon.0) 9584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:47 smithi049 bash[23528]: audit 2024-09-21T02:44:46.164478+0000 mon.a (mon.0) 9585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:44:47.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:47.603 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:47.603 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:48.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:48.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:48.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:48.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:48.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:49 smithi044 bash[22676]: cluster 2024-09-21T02:44:47.836710+0000 mgr.a (mgr.14388) 11699 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:49 smithi044 bash[22676]: audit 2024-09-21T02:44:47.936026+0000 mgr.a (mgr.14388) 11700 : audit [DBG] from='client.256536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:49 smithi179 bash[23186]: cluster 2024-09-21T02:44:47.836710+0000 mgr.a (mgr.14388) 11699 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:49 smithi179 bash[23186]: audit 2024-09-21T02:44:47.936026+0000 mgr.a (mgr.14388) 11700 : audit [DBG] from='client.256536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:49 smithi049 bash[23528]: cluster 2024-09-21T02:44:47.836710+0000 mgr.a (mgr.14388) 11699 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:49 smithi049 bash[23528]: audit 2024-09-21T02:44:47.936026+0000 mgr.a (mgr.14388) 11700 : audit [DBG] from='client.256536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:51.437 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:51 smithi044 bash[22676]: cluster 2024-09-21T02:44:49.837640+0000 mgr.a (mgr.14388) 11701 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:51 smithi179 bash[23186]: cluster 2024-09-21T02:44:49.837640+0000 mgr.a (mgr.14388) 11701 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:51 smithi049 bash[23528]: cluster 2024-09-21T02:44:49.837640+0000 mgr.a (mgr.14388) 11701 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:53.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:53.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:53.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:53 smithi044 bash[22676]: cluster 2024-09-21T02:44:51.839872+0000 mgr.a (mgr.14388) 11702 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:53 smithi179 bash[23186]: cluster 2024-09-21T02:44:51.839872+0000 mgr.a (mgr.14388) 11702 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:53 smithi049 bash[23528]: cluster 2024-09-21T02:44:51.839872+0000 mgr.a (mgr.14388) 11702 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:54.101 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:54.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:54.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:54.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:54.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:44:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:55 smithi044 bash[22676]: audit 2024-09-21T02:44:53.696536+0000 mgr.a (mgr.14388) 11703 : audit [DBG] from='client.256614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:55 smithi044 bash[22676]: cluster 2024-09-21T02:44:53.840516+0000 mgr.a (mgr.14388) 11704 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:55 smithi179 bash[23186]: audit 2024-09-21T02:44:53.696536+0000 mgr.a (mgr.14388) 11703 : audit [DBG] from='client.256614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:55 smithi179 bash[23186]: cluster 2024-09-21T02:44:53.840516+0000 mgr.a (mgr.14388) 11704 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:55 smithi049 bash[23528]: audit 2024-09-21T02:44:53.696536+0000 mgr.a (mgr.14388) 11703 : audit [DBG] from='client.256614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:44:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:55 smithi049 bash[23528]: cluster 2024-09-21T02:44:53.840516+0000 mgr.a (mgr.14388) 11704 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:57 smithi044 bash[22676]: cluster 2024-09-21T02:44:55.842874+0000 mgr.a (mgr.14388) 11705 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:57 smithi179 bash[23186]: cluster 2024-09-21T02:44:55.842874+0000 mgr.a (mgr.14388) 11705 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:57 smithi049 bash[23528]: cluster 2024-09-21T02:44:55.842874+0000 mgr.a (mgr.14388) 11705 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:44:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:44:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:44:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:44:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:44:59 smithi044 bash[22676]: cluster 2024-09-21T02:44:57.843654+0000 mgr.a (mgr.14388) 11706 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:44:59 smithi179 bash[23186]: cluster 2024-09-21T02:44:57.843654+0000 mgr.a (mgr.14388) 11706 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:44:59 smithi049 bash[23528]: cluster 2024-09-21T02:44:57.843654+0000 mgr.a (mgr.14388) 11706 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:44:59.905 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:44:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:44:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:44:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:44:59.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:00.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:00 smithi044 bash[22676]: audit 2024-09-21T02:44:59.213375+0000 mon.a (mon.0) 9586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:00 smithi044 bash[22676]: audit 2024-09-21T02:44:59.220560+0000 mon.a (mon.0) 9587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:00 smithi044 bash[22676]: audit 2024-09-21T02:44:59.227848+0000 mon.a (mon.0) 9588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:00 smithi044 bash[22676]: audit 2024-09-21T02:44:59.232447+0000 mon.a (mon.0) 9589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:00 smithi044 bash[22676]: audit 2024-09-21T02:44:59.237324+0000 mon.a (mon.0) 9590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:00 smithi044 bash[22676]: audit 2024-09-21T02:44:59.242849+0000 mon.a (mon.0) 9591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:00 smithi044 bash[22676]: audit 2024-09-21T02:44:59.448712+0000 mgr.a (mgr.14388) 11707 : audit [DBG] from='client.256692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:00 smithi179 bash[23186]: audit 2024-09-21T02:44:59.213375+0000 mon.a (mon.0) 9586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:00 smithi179 bash[23186]: audit 2024-09-21T02:44:59.220560+0000 mon.a (mon.0) 9587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:00 smithi179 bash[23186]: audit 2024-09-21T02:44:59.227848+0000 mon.a (mon.0) 9588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:00 smithi179 bash[23186]: audit 2024-09-21T02:44:59.232447+0000 mon.a (mon.0) 9589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:00 smithi179 bash[23186]: audit 2024-09-21T02:44:59.237324+0000 mon.a (mon.0) 9590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:00 smithi179 bash[23186]: audit 2024-09-21T02:44:59.242849+0000 mon.a (mon.0) 9591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:00 smithi179 bash[23186]: audit 2024-09-21T02:44:59.448712+0000 mgr.a (mgr.14388) 11707 : audit [DBG] from='client.256692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:00 smithi049 bash[23528]: audit 2024-09-21T02:44:59.213375+0000 mon.a (mon.0) 9586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:00 smithi049 bash[23528]: audit 2024-09-21T02:44:59.220560+0000 mon.a (mon.0) 9587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:00 smithi049 bash[23528]: audit 2024-09-21T02:44:59.227848+0000 mon.a (mon.0) 9588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:00 smithi049 bash[23528]: audit 2024-09-21T02:44:59.232447+0000 mon.a (mon.0) 9589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:00 smithi049 bash[23528]: audit 2024-09-21T02:44:59.237324+0000 mon.a (mon.0) 9590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:00 smithi049 bash[23528]: audit 2024-09-21T02:44:59.242849+0000 mon.a (mon.0) 9591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:00 smithi049 bash[23528]: audit 2024-09-21T02:44:59.448712+0000 mgr.a (mgr.14388) 11707 : audit [DBG] from='client.256692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:01 smithi044 bash[22676]: cluster 2024-09-21T02:44:59.844251+0000 mgr.a (mgr.14388) 11708 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:01 smithi179 bash[23186]: cluster 2024-09-21T02:44:59.844251+0000 mgr.a (mgr.14388) 11708 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:01 smithi049 bash[23528]: cluster 2024-09-21T02:44:59.844251+0000 mgr.a (mgr.14388) 11708 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:03 smithi179 bash[23186]: cluster 2024-09-21T02:45:01.846499+0000 mgr.a (mgr.14388) 11709 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:45:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:03 smithi049 bash[23528]: cluster 2024-09-21T02:45:01.846499+0000 mgr.a (mgr.14388) 11709 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:45:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:03 smithi044 bash[22676]: cluster 2024-09-21T02:45:01.846499+0000 mgr.a (mgr.14388) 11709 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:45:04.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:05 smithi049 bash[23528]: cluster 2024-09-21T02:45:03.847267+0000 mgr.a (mgr.14388) 11710 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:05.664 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:05.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:05.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:05.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:05.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:05 smithi044 bash[22676]: cluster 2024-09-21T02:45:03.847267+0000 mgr.a (mgr.14388) 11710 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:05 smithi179 bash[23186]: cluster 2024-09-21T02:45:03.847267+0000 mgr.a (mgr.14388) 11710 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:06 smithi049 bash[23528]: audit 2024-09-21T02:45:05.242060+0000 mgr.a (mgr.14388) 11711 : audit [DBG] from='client.256770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:06 smithi044 bash[22676]: audit 2024-09-21T02:45:05.242060+0000 mgr.a (mgr.14388) 11711 : audit [DBG] from='client.256770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:06 smithi179 bash[23186]: audit 2024-09-21T02:45:05.242060+0000 mgr.a (mgr.14388) 11711 : audit [DBG] from='client.256770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:07 smithi044 bash[22676]: cluster 2024-09-21T02:45:05.850157+0000 mgr.a (mgr.14388) 11712 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:07 smithi044 bash[22676]: audit 2024-09-21T02:45:06.388586+0000 mon.a (mon.0) 9592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:07 smithi044 bash[22676]: audit 2024-09-21T02:45:06.398655+0000 mon.a (mon.0) 9593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:07 smithi044 bash[22676]: audit 2024-09-21T02:45:06.410406+0000 mon.a (mon.0) 9594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:07 smithi179 bash[23186]: cluster 2024-09-21T02:45:05.850157+0000 mgr.a (mgr.14388) 11712 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:07 smithi179 bash[23186]: audit 2024-09-21T02:45:06.388586+0000 mon.a (mon.0) 9592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:07 smithi179 bash[23186]: audit 2024-09-21T02:45:06.398655+0000 mon.a (mon.0) 9593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:07 smithi179 bash[23186]: audit 2024-09-21T02:45:06.410406+0000 mon.a (mon.0) 9594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.752 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:07 smithi049 bash[23528]: cluster 2024-09-21T02:45:05.850157+0000 mgr.a (mgr.14388) 11712 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:07.752 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:07 smithi049 bash[23528]: audit 2024-09-21T02:45:06.388586+0000 mon.a (mon.0) 9592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.752 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:07 smithi049 bash[23528]: audit 2024-09-21T02:45:06.398655+0000 mon.a (mon.0) 9593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:07.753 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:07 smithi049 bash[23528]: audit 2024-09-21T02:45:06.410406+0000 mon.a (mon.0) 9594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:09 smithi044 bash[22676]: cluster 2024-09-21T02:45:07.850993+0000 mgr.a (mgr.14388) 11713 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:09 smithi179 bash[23186]: cluster 2024-09-21T02:45:07.850993+0000 mgr.a (mgr.14388) 11713 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:09 smithi049 bash[23528]: cluster 2024-09-21T02:45:07.850993+0000 mgr.a (mgr.14388) 11713 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:10.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:10.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:10.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:11.432 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:11 smithi044 bash[22676]: cluster 2024-09-21T02:45:09.851762+0000 mgr.a (mgr.14388) 11714 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:45:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:11 smithi179 bash[23186]: cluster 2024-09-21T02:45:09.851762+0000 mgr.a (mgr.14388) 11714 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:45:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:11 smithi049 bash[23528]: cluster 2024-09-21T02:45:09.851762+0000 mgr.a (mgr.14388) 11714 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:45:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:12 smithi044 bash[22676]: audit 2024-09-21T02:45:11.003886+0000 mgr.a (mgr.14388) 11715 : audit [DBG] from='client.256839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:12 smithi179 bash[23186]: audit 2024-09-21T02:45:11.003886+0000 mgr.a (mgr.14388) 11715 : audit [DBG] from='client.256839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:12 smithi049 bash[23528]: audit 2024-09-21T02:45:11.003886+0000 mgr.a (mgr.14388) 11715 : audit [DBG] from='client.256839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:13 smithi044 bash[22676]: cluster 2024-09-21T02:45:11.853271+0000 mgr.a (mgr.14388) 11716 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:13 smithi179 bash[23186]: cluster 2024-09-21T02:45:11.853271+0000 mgr.a (mgr.14388) 11716 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:13 smithi049 bash[23528]: cluster 2024-09-21T02:45:11.853271+0000 mgr.a (mgr.14388) 11716 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: cluster 2024-09-21T02:45:13.853814+0000 mgr.a (mgr.14388) 11717 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: audit 2024-09-21T02:45:14.480549+0000 mon.a (mon.0) 9595 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:45:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: audit 2024-09-21T02:45:15.066288+0000 mon.a (mon.0) 9596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: audit 2024-09-21T02:45:15.074927+0000 mon.a (mon.0) 9597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: audit 2024-09-21T02:45:15.077112+0000 mon.a (mon.0) 9598 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:45:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: audit 2024-09-21T02:45:15.078960+0000 mon.a (mon.0) 9599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:45:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: audit 2024-09-21T02:45:15.090025+0000 mon.a (mon.0) 9600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22676]: audit 2024-09-21T02:45:15.097010+0000 mon.a (mon.0) 9601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: cluster 2024-09-21T02:45:13.853814+0000 mgr.a (mgr.14388) 11717 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: audit 2024-09-21T02:45:14.480549+0000 mon.a (mon.0) 9595 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: audit 2024-09-21T02:45:15.066288+0000 mon.a (mon.0) 9596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: audit 2024-09-21T02:45:15.074927+0000 mon.a (mon.0) 9597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: audit 2024-09-21T02:45:15.077112+0000 mon.a (mon.0) 9598 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: audit 2024-09-21T02:45:15.078960+0000 mon.a (mon.0) 9599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: audit 2024-09-21T02:45:15.090025+0000 mon.a (mon.0) 9600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:15 smithi179 bash[23186]: audit 2024-09-21T02:45:15.097010+0000 mon.a (mon.0) 9601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:45:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: cluster 2024-09-21T02:45:13.853814+0000 mgr.a (mgr.14388) 11717 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: audit 2024-09-21T02:45:14.480549+0000 mon.a (mon.0) 9595 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: audit 2024-09-21T02:45:15.066288+0000 mon.a (mon.0) 9596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: audit 2024-09-21T02:45:15.074927+0000 mon.a (mon.0) 9597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: audit 2024-09-21T02:45:15.077112+0000 mon.a (mon.0) 9598 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: audit 2024-09-21T02:45:15.078960+0000 mon.a (mon.0) 9599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: audit 2024-09-21T02:45:15.090025+0000 mon.a (mon.0) 9600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:15 smithi049 bash[23528]: audit 2024-09-21T02:45:15.097010+0000 mon.a (mon.0) 9601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:45:16.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22930]: debug 2024-09-21T02:45:15.907+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:45:16.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:45:15 smithi044 bash[22930]: debug 2024-09-21T02:45:15.911+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:45:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:16.434 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:16 smithi044 bash[22676]: audit 2024-09-21T02:45:15.099732+0000 mgr.a (mgr.14388) 11718 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:45:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:16 smithi179 bash[23186]: audit 2024-09-21T02:45:15.099732+0000 mgr.a (mgr.14388) 11718 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:45:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:16 smithi049 bash[23528]: audit 2024-09-21T02:45:15.099732+0000 mgr.a (mgr.14388) 11718 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:45:17.210 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:17.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:17.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:17.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:17.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:17 smithi044 bash[22676]: cluster 2024-09-21T02:45:15.855542+0000 mgr.a (mgr.14388) 11719 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:17.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:17 smithi044 bash[22676]: audit 2024-09-21T02:45:15.911603+0000 mgr.a (mgr.14388) 11720 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:45:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:17 smithi044 bash[22676]: cephadm 2024-09-21T02:45:15.913410+0000 mgr.a (mgr.14388) 11721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:45:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:17 smithi179 bash[23186]: cluster 2024-09-21T02:45:15.855542+0000 mgr.a (mgr.14388) 11719 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:17 smithi179 bash[23186]: audit 2024-09-21T02:45:15.911603+0000 mgr.a (mgr.14388) 11720 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:45:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:17 smithi179 bash[23186]: cephadm 2024-09-21T02:45:15.913410+0000 mgr.a (mgr.14388) 11721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:17 smithi049 bash[23528]: cluster 2024-09-21T02:45:15.855542+0000 mgr.a (mgr.14388) 11719 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:17 smithi049 bash[23528]: audit 2024-09-21T02:45:15.911603+0000 mgr.a (mgr.14388) 11720 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:17 smithi049 bash[23528]: cephadm 2024-09-21T02:45:15.913410+0000 mgr.a (mgr.14388) 11721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:45:18.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:18 smithi044 bash[22676]: audit 2024-09-21T02:45:16.769581+0000 mgr.a (mgr.14388) 11722 : audit [DBG] from='client.257025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:18 smithi179 bash[23186]: audit 2024-09-21T02:45:16.769581+0000 mgr.a (mgr.14388) 11722 : audit [DBG] from='client.257025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:18 smithi049 bash[23528]: audit 2024-09-21T02:45:16.769581+0000 mgr.a (mgr.14388) 11722 : audit [DBG] from='client.257025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:19 smithi044 bash[22676]: cluster 2024-09-21T02:45:17.856454+0000 mgr.a (mgr.14388) 11723 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:19 smithi044 bash[22676]: audit 2024-09-21T02:45:19.425222+0000 mon.a (mon.0) 9602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:19 smithi179 bash[23186]: cluster 2024-09-21T02:45:17.856454+0000 mgr.a (mgr.14388) 11723 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:19 smithi179 bash[23186]: audit 2024-09-21T02:45:19.425222+0000 mon.a (mon.0) 9602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:19 smithi049 bash[23528]: cluster 2024-09-21T02:45:17.856454+0000 mgr.a (mgr.14388) 11723 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:19 smithi049 bash[23528]: audit 2024-09-21T02:45:19.425222+0000 mon.a (mon.0) 9602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:20 smithi044 bash[22676]: audit 2024-09-21T02:45:19.433445+0000 mon.a (mon.0) 9603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:20 smithi044 bash[22676]: audit 2024-09-21T02:45:19.448289+0000 mon.a (mon.0) 9604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:20 smithi044 bash[22676]: audit 2024-09-21T02:45:19.455134+0000 mon.a (mon.0) 9605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:20 smithi044 bash[22676]: audit 2024-09-21T02:45:19.462133+0000 mon.a (mon.0) 9606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:20 smithi044 bash[22676]: audit 2024-09-21T02:45:19.470991+0000 mon.a (mon.0) 9607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:20 smithi179 bash[23186]: audit 2024-09-21T02:45:19.433445+0000 mon.a (mon.0) 9603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:20 smithi179 bash[23186]: audit 2024-09-21T02:45:19.448289+0000 mon.a (mon.0) 9604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:20 smithi179 bash[23186]: audit 2024-09-21T02:45:19.455134+0000 mon.a (mon.0) 9605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:20 smithi179 bash[23186]: audit 2024-09-21T02:45:19.462133+0000 mon.a (mon.0) 9606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:20 smithi179 bash[23186]: audit 2024-09-21T02:45:19.470991+0000 mon.a (mon.0) 9607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.789 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:20 smithi049 bash[23528]: audit 2024-09-21T02:45:19.433445+0000 mon.a (mon.0) 9603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.789 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:20 smithi049 bash[23528]: audit 2024-09-21T02:45:19.448289+0000 mon.a (mon.0) 9604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.789 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:20 smithi049 bash[23528]: audit 2024-09-21T02:45:19.455134+0000 mon.a (mon.0) 9605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.789 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:20 smithi049 bash[23528]: audit 2024-09-21T02:45:19.462133+0000 mon.a (mon.0) 9606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:20.790 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:20 smithi049 bash[23528]: audit 2024-09-21T02:45:19.470991+0000 mon.a (mon.0) 9607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:21 smithi044 bash[22676]: cluster 2024-09-21T02:45:19.857206+0000 mgr.a (mgr.14388) 11724 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:21 smithi179 bash[23186]: cluster 2024-09-21T02:45:19.857206+0000 mgr.a (mgr.14388) 11724 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:21 smithi049 bash[23528]: cluster 2024-09-21T02:45:19.857206+0000 mgr.a (mgr.14388) 11724 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:22.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:22.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:22.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:23 smithi044 bash[22676]: cluster 2024-09-21T02:45:21.859418+0000 mgr.a (mgr.14388) 11725 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:23 smithi044 bash[22676]: audit 2024-09-21T02:45:22.547864+0000 mgr.a (mgr.14388) 11726 : audit [DBG] from='client.257100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:23 smithi179 bash[23186]: cluster 2024-09-21T02:45:21.859418+0000 mgr.a (mgr.14388) 11725 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:23 smithi179 bash[23186]: audit 2024-09-21T02:45:22.547864+0000 mgr.a (mgr.14388) 11726 : audit [DBG] from='client.257100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:23 smithi049 bash[23528]: cluster 2024-09-21T02:45:21.859418+0000 mgr.a (mgr.14388) 11725 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:23 smithi049 bash[23528]: audit 2024-09-21T02:45:22.547864+0000 mgr.a (mgr.14388) 11726 : audit [DBG] from='client.257100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:25 smithi044 bash[22676]: cluster 2024-09-21T02:45:23.860332+0000 mgr.a (mgr.14388) 11727 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:25 smithi179 bash[23186]: cluster 2024-09-21T02:45:23.860332+0000 mgr.a (mgr.14388) 11727 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:25 smithi049 bash[23528]: cluster 2024-09-21T02:45:23.860332+0000 mgr.a (mgr.14388) 11727 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:27 smithi179 bash[23186]: cluster 2024-09-21T02:45:25.862633+0000 mgr.a (mgr.14388) 11728 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:27 smithi179 bash[23186]: audit 2024-09-21T02:45:26.627943+0000 mon.a (mon.0) 9608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:27 smithi179 bash[23186]: audit 2024-09-21T02:45:26.636522+0000 mon.a (mon.0) 9609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:27 smithi179 bash[23186]: audit 2024-09-21T02:45:26.646821+0000 mon.a (mon.0) 9610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:27 smithi049 bash[23528]: cluster 2024-09-21T02:45:25.862633+0000 mgr.a (mgr.14388) 11728 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:27 smithi049 bash[23528]: audit 2024-09-21T02:45:26.627943+0000 mon.a (mon.0) 9608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:27 smithi049 bash[23528]: audit 2024-09-21T02:45:26.636522+0000 mon.a (mon.0) 9609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:27 smithi049 bash[23528]: audit 2024-09-21T02:45:26.646821+0000 mon.a (mon.0) 9610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:27 smithi044 bash[22676]: cluster 2024-09-21T02:45:25.862633+0000 mgr.a (mgr.14388) 11728 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:27 smithi044 bash[22676]: audit 2024-09-21T02:45:26.627943+0000 mon.a (mon.0) 9608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:27 smithi044 bash[22676]: audit 2024-09-21T02:45:26.636522+0000 mon.a (mon.0) 9609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:27 smithi044 bash[22676]: audit 2024-09-21T02:45:26.646821+0000 mon.a (mon.0) 9610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:28.759 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:29.751 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:29 smithi049 bash[23528]: cluster 2024-09-21T02:45:27.863377+0000 mgr.a (mgr.14388) 11729 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:29.751 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:29 smithi049 bash[23528]: audit 2024-09-21T02:45:28.311865+0000 mgr.a (mgr.14388) 11730 : audit [DBG] from='client.257175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:29 smithi179 bash[23186]: cluster 2024-09-21T02:45:27.863377+0000 mgr.a (mgr.14388) 11729 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:29 smithi179 bash[23186]: audit 2024-09-21T02:45:28.311865+0000 mgr.a (mgr.14388) 11730 : audit [DBG] from='client.257175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:29 smithi044 bash[22676]: cluster 2024-09-21T02:45:27.863377+0000 mgr.a (mgr.14388) 11729 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:29 smithi044 bash[22676]: audit 2024-09-21T02:45:28.311865+0000 mgr.a (mgr.14388) 11730 : audit [DBG] from='client.257175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:31 smithi179 bash[23186]: cluster 2024-09-21T02:45:29.864284+0000 mgr.a (mgr.14388) 11731 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:31 smithi049 bash[23528]: cluster 2024-09-21T02:45:29.864284+0000 mgr.a (mgr.14388) 11731 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:31 smithi044 bash[22676]: cluster 2024-09-21T02:45:29.864284+0000 mgr.a (mgr.14388) 11731 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:33 smithi179 bash[23186]: cluster 2024-09-21T02:45:31.866506+0000 mgr.a (mgr.14388) 11732 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:33.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:33.761 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:33.762 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:33 smithi049 bash[23528]: cluster 2024-09-21T02:45:31.866506+0000 mgr.a (mgr.14388) 11732 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:33.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:33 smithi044 bash[22676]: cluster 2024-09-21T02:45:31.866506+0000 mgr.a (mgr.14388) 11732 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:45:34.532 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:34.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:35 smithi049 bash[23528]: cluster 2024-09-21T02:45:33.866980+0000 mgr.a (mgr.14388) 11733 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:35 smithi049 bash[23528]: audit 2024-09-21T02:45:34.104673+0000 mgr.a (mgr.14388) 11734 : audit [DBG] from='client.257253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:35 smithi044 bash[22676]: cluster 2024-09-21T02:45:33.866980+0000 mgr.a (mgr.14388) 11733 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:35 smithi044 bash[22676]: audit 2024-09-21T02:45:34.104673+0000 mgr.a (mgr.14388) 11734 : audit [DBG] from='client.257253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:35 smithi179 bash[23186]: cluster 2024-09-21T02:45:33.866980+0000 mgr.a (mgr.14388) 11733 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:35 smithi179 bash[23186]: audit 2024-09-21T02:45:34.104673+0000 mgr.a (mgr.14388) 11734 : audit [DBG] from='client.257253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:37 smithi049 bash[23528]: cluster 2024-09-21T02:45:35.869500+0000 mgr.a (mgr.14388) 11735 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:45:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:37 smithi044 bash[22676]: cluster 2024-09-21T02:45:35.869500+0000 mgr.a (mgr.14388) 11735 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:45:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:37 smithi179 bash[23186]: cluster 2024-09-21T02:45:35.869500+0000 mgr.a (mgr.14388) 11735 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:45:39.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:39.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:39.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:39 smithi049 bash[23528]: cluster 2024-09-21T02:45:37.870489+0000 mgr.a (mgr.14388) 11736 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:39 smithi044 bash[22676]: cluster 2024-09-21T02:45:37.870489+0000 mgr.a (mgr.14388) 11736 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:39 smithi179 bash[23186]: cluster 2024-09-21T02:45:37.870489+0000 mgr.a (mgr.14388) 11736 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:40.312 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: audit 2024-09-21T02:45:39.638342+0000 mon.a (mon.0) 9611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: audit 2024-09-21T02:45:39.647355+0000 mon.a (mon.0) 9612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: audit 2024-09-21T02:45:39.655287+0000 mon.a (mon.0) 9613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: audit 2024-09-21T02:45:39.660546+0000 mon.a (mon.0) 9614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: audit 2024-09-21T02:45:39.666134+0000 mon.a (mon.0) 9615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: audit 2024-09-21T02:45:39.672775+0000 mon.a (mon.0) 9616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: cluster 2024-09-21T02:45:39.871275+0000 mgr.a (mgr.14388) 11737 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:40 smithi044 bash[22676]: audit 2024-09-21T02:45:39.876081+0000 mgr.a (mgr.14388) 11738 : audit [DBG] from='client.257331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: audit 2024-09-21T02:45:39.638342+0000 mon.a (mon.0) 9611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: audit 2024-09-21T02:45:39.647355+0000 mon.a (mon.0) 9612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: audit 2024-09-21T02:45:39.655287+0000 mon.a (mon.0) 9613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: audit 2024-09-21T02:45:39.660546+0000 mon.a (mon.0) 9614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: audit 2024-09-21T02:45:39.666134+0000 mon.a (mon.0) 9615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: audit 2024-09-21T02:45:39.672775+0000 mon.a (mon.0) 9616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: cluster 2024-09-21T02:45:39.871275+0000 mgr.a (mgr.14388) 11737 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:40 smithi179 bash[23186]: audit 2024-09-21T02:45:39.876081+0000 mgr.a (mgr.14388) 11738 : audit [DBG] from='client.257331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: audit 2024-09-21T02:45:39.638342+0000 mon.a (mon.0) 9611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: audit 2024-09-21T02:45:39.647355+0000 mon.a (mon.0) 9612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: audit 2024-09-21T02:45:39.655287+0000 mon.a (mon.0) 9613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: audit 2024-09-21T02:45:39.660546+0000 mon.a (mon.0) 9614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: audit 2024-09-21T02:45:39.666134+0000 mon.a (mon.0) 9615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: audit 2024-09-21T02:45:39.672775+0000 mon.a (mon.0) 9616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: cluster 2024-09-21T02:45:39.871275+0000 mgr.a (mgr.14388) 11737 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:40 smithi049 bash[23528]: audit 2024-09-21T02:45:39.876081+0000 mgr.a (mgr.14388) 11738 : audit [DBG] from='client.257331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:42 smithi044 bash[22676]: cluster 2024-09-21T02:45:41.874062+0000 mgr.a (mgr.14388) 11739 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:42 smithi179 bash[23186]: cluster 2024-09-21T02:45:41.874062+0000 mgr.a (mgr.14388) 11739 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:42 smithi049 bash[23528]: cluster 2024-09-21T02:45:41.874062+0000 mgr.a (mgr.14388) 11739 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:44 smithi044 bash[22676]: cluster 2024-09-21T02:45:43.874847+0000 mgr.a (mgr.14388) 11740 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:44 smithi179 bash[23186]: cluster 2024-09-21T02:45:43.874847+0000 mgr.a (mgr.14388) 11740 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:44 smithi049 bash[23528]: cluster 2024-09-21T02:45:43.874847+0000 mgr.a (mgr.14388) 11740 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:46.099 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:46.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:46.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:46.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:46.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:46 smithi044 bash[22676]: audit 2024-09-21T02:45:45.648753+0000 mgr.a (mgr.14388) 11741 : audit [DBG] from='client.257406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:46 smithi044 bash[22676]: cluster 2024-09-21T02:45:45.876245+0000 mgr.a (mgr.14388) 11742 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:46 smithi044 bash[22676]: audit 2024-09-21T02:45:46.867121+0000 mon.a (mon.0) 9617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:46 smithi044 bash[22676]: audit 2024-09-21T02:45:46.878985+0000 mon.a (mon.0) 9618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:46 smithi044 bash[22676]: audit 2024-09-21T02:45:46.890108+0000 mon.a (mon.0) 9619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:46 smithi049 bash[23528]: audit 2024-09-21T02:45:45.648753+0000 mgr.a (mgr.14388) 11741 : audit [DBG] from='client.257406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:47.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:46 smithi049 bash[23528]: cluster 2024-09-21T02:45:45.876245+0000 mgr.a (mgr.14388) 11742 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:47.248 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:46 smithi049 bash[23528]: audit 2024-09-21T02:45:46.867121+0000 mon.a (mon.0) 9617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.248 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:46 smithi049 bash[23528]: audit 2024-09-21T02:45:46.878985+0000 mon.a (mon.0) 9618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.248 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:46 smithi049 bash[23528]: audit 2024-09-21T02:45:46.890108+0000 mon.a (mon.0) 9619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:46 smithi179 bash[23186]: audit 2024-09-21T02:45:45.648753+0000 mgr.a (mgr.14388) 11741 : audit [DBG] from='client.257406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:46 smithi179 bash[23186]: cluster 2024-09-21T02:45:45.876245+0000 mgr.a (mgr.14388) 11742 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:45:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:46 smithi179 bash[23186]: audit 2024-09-21T02:45:46.867121+0000 mon.a (mon.0) 9617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:46 smithi179 bash[23186]: audit 2024-09-21T02:45:46.878985+0000 mon.a (mon.0) 9618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:46 smithi179 bash[23186]: audit 2024-09-21T02:45:46.890108+0000 mon.a (mon.0) 9619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:45:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:48 smithi179 bash[23186]: cluster 2024-09-21T02:45:47.877115+0000 mgr.a (mgr.14388) 11743 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:48 smithi044 bash[22676]: cluster 2024-09-21T02:45:47.877115+0000 mgr.a (mgr.14388) 11743 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:48 smithi049 bash[23528]: cluster 2024-09-21T02:45:47.877115+0000 mgr.a (mgr.14388) 11743 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:45:51.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:51.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:50 smithi044 bash[22676]: cluster 2024-09-21T02:45:49.878517+0000 mgr.a (mgr.14388) 11744 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T02:45:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:50 smithi179 bash[23186]: cluster 2024-09-21T02:45:49.878517+0000 mgr.a (mgr.14388) 11744 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T02:45:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:50 smithi049 bash[23528]: cluster 2024-09-21T02:45:49.878517+0000 mgr.a (mgr.14388) 11744 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T02:45:51.891 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:51.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:51.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:51.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:51.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:52.209 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:51 smithi044 bash[22676]: audit 2024-09-21T02:45:51.442458+0000 mgr.a (mgr.14388) 11745 : audit [DBG] from='client.257484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:51 smithi179 bash[23186]: audit 2024-09-21T02:45:51.442458+0000 mgr.a (mgr.14388) 11745 : audit [DBG] from='client.257484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:51 smithi049 bash[23528]: audit 2024-09-21T02:45:51.442458+0000 mgr.a (mgr.14388) 11745 : audit [DBG] from='client.257484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:52 smithi044 bash[22676]: cluster 2024-09-21T02:45:51.879726+0000 mgr.a (mgr.14388) 11746 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:52 smithi179 bash[23186]: cluster 2024-09-21T02:45:51.879726+0000 mgr.a (mgr.14388) 11746 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:52 smithi049 bash[23528]: cluster 2024-09-21T02:45:51.879726+0000 mgr.a (mgr.14388) 11746 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:55.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:54 smithi044 bash[22676]: cluster 2024-09-21T02:45:53.880520+0000 mgr.a (mgr.14388) 11747 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:54 smithi179 bash[23186]: cluster 2024-09-21T02:45:53.880520+0000 mgr.a (mgr.14388) 11747 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:54 smithi049 bash[23528]: cluster 2024-09-21T02:45:53.880520+0000 mgr.a (mgr.14388) 11747 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:56.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:45:56.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:45:56.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:45:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:56 smithi044 bash[22676]: cluster 2024-09-21T02:45:55.882640+0000 mgr.a (mgr.14388) 11748 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:45:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:56 smithi179 bash[23186]: cluster 2024-09-21T02:45:55.882640+0000 mgr.a (mgr.14388) 11748 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:45:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:56 smithi049 bash[23528]: cluster 2024-09-21T02:45:55.882640+0000 mgr.a (mgr.14388) 11748 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:45:57.673 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:45:57.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:45:57.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:45:57.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:45:57.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:45:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:57 smithi044 bash[22676]: audit 2024-09-21T02:45:57.236274+0000 mgr.a (mgr.14388) 11749 : audit [DBG] from='client.257562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:57 smithi179 bash[23186]: audit 2024-09-21T02:45:57.236274+0000 mgr.a (mgr.14388) 11749 : audit [DBG] from='client.257562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:57 smithi049 bash[23528]: audit 2024-09-21T02:45:57.236274+0000 mgr.a (mgr.14388) 11749 : audit [DBG] from='client.257562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:45:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:45:58 smithi044 bash[22676]: cluster 2024-09-21T02:45:57.883564+0000 mgr.a (mgr.14388) 11750 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:45:58 smithi179 bash[23186]: cluster 2024-09-21T02:45:57.883564+0000 mgr.a (mgr.14388) 11750 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:45:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:45:58 smithi049 bash[23528]: cluster 2024-09-21T02:45:57.883564+0000 mgr.a (mgr.14388) 11750 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:46:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:00 smithi044 bash[22676]: audit 2024-09-21T02:45:59.841349+0000 mon.a (mon.0) 9620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:00 smithi044 bash[22676]: audit 2024-09-21T02:45:59.847147+0000 mon.a (mon.0) 9621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:00 smithi044 bash[22676]: audit 2024-09-21T02:45:59.856741+0000 mon.a (mon.0) 9622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:00 smithi044 bash[22676]: cluster 2024-09-21T02:45:59.884950+0000 mgr.a (mgr.14388) 11751 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:46:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:00 smithi044 bash[22676]: audit 2024-09-21T02:45:59.892608+0000 mon.a (mon.0) 9623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:00 smithi044 bash[22676]: audit 2024-09-21T02:45:59.901325+0000 mon.a (mon.0) 9624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:00 smithi044 bash[22676]: audit 2024-09-21T02:45:59.911513+0000 mon.a (mon.0) 9625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:00 smithi179 bash[23186]: audit 2024-09-21T02:45:59.841349+0000 mon.a (mon.0) 9620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:00 smithi179 bash[23186]: audit 2024-09-21T02:45:59.847147+0000 mon.a (mon.0) 9621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:00 smithi179 bash[23186]: audit 2024-09-21T02:45:59.856741+0000 mon.a (mon.0) 9622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:00 smithi179 bash[23186]: cluster 2024-09-21T02:45:59.884950+0000 mgr.a (mgr.14388) 11751 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:46:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:00 smithi179 bash[23186]: audit 2024-09-21T02:45:59.892608+0000 mon.a (mon.0) 9623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:00 smithi179 bash[23186]: audit 2024-09-21T02:45:59.901325+0000 mon.a (mon.0) 9624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:00 smithi179 bash[23186]: audit 2024-09-21T02:45:59.911513+0000 mon.a (mon.0) 9625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:00 smithi049 bash[23528]: audit 2024-09-21T02:45:59.841349+0000 mon.a (mon.0) 9620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:00 smithi049 bash[23528]: audit 2024-09-21T02:45:59.847147+0000 mon.a (mon.0) 9621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:00 smithi049 bash[23528]: audit 2024-09-21T02:45:59.856741+0000 mon.a (mon.0) 9622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:00 smithi049 bash[23528]: cluster 2024-09-21T02:45:59.884950+0000 mgr.a (mgr.14388) 11751 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:46:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:00 smithi049 bash[23528]: audit 2024-09-21T02:45:59.892608+0000 mon.a (mon.0) 9623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:00 smithi049 bash[23528]: audit 2024-09-21T02:45:59.901325+0000 mon.a (mon.0) 9624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:00 smithi049 bash[23528]: audit 2024-09-21T02:45:59.911513+0000 mon.a (mon.0) 9625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:02.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:02.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:02 smithi044 bash[22676]: cluster 2024-09-21T02:46:01.886892+0000 mgr.a (mgr.14388) 11752 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:46:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:02 smithi179 bash[23186]: cluster 2024-09-21T02:46:01.886892+0000 mgr.a (mgr.14388) 11752 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:46:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:02 smithi049 bash[23528]: cluster 2024-09-21T02:46:01.886892+0000 mgr.a (mgr.14388) 11752 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T02:46:03.443 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:03.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:03 smithi044 bash[22676]: audit 2024-09-21T02:46:03.009233+0000 mgr.a (mgr.14388) 11753 : audit [DBG] from='client.257640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:04.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:03 smithi179 bash[23186]: audit 2024-09-21T02:46:03.009233+0000 mgr.a (mgr.14388) 11753 : audit [DBG] from='client.257640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:03 smithi049 bash[23528]: audit 2024-09-21T02:46:03.009233+0000 mgr.a (mgr.14388) 11753 : audit [DBG] from='client.257640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:05.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:04 smithi044 bash[22676]: cluster 2024-09-21T02:46:03.888058+0000 mgr.a (mgr.14388) 11754 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:04 smithi179 bash[23186]: cluster 2024-09-21T02:46:03.888058+0000 mgr.a (mgr.14388) 11754 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:04 smithi049 bash[23528]: cluster 2024-09-21T02:46:03.888058+0000 mgr.a (mgr.14388) 11754 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:06 smithi044 bash[22676]: cluster 2024-09-21T02:46:05.890510+0000 mgr.a (mgr.14388) 11755 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:06 smithi179 bash[23186]: cluster 2024-09-21T02:46:05.890510+0000 mgr.a (mgr.14388) 11755 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:06 smithi049 bash[23528]: cluster 2024-09-21T02:46:05.890510+0000 mgr.a (mgr.14388) 11755 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:08 smithi179 bash[23186]: audit 2024-09-21T02:46:07.087425+0000 mon.a (mon.0) 9626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:08 smithi179 bash[23186]: audit 2024-09-21T02:46:07.096080+0000 mon.a (mon.0) 9627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:08 smithi179 bash[23186]: audit 2024-09-21T02:46:07.106772+0000 mon.a (mon.0) 9628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:08.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:08 smithi044 bash[22676]: audit 2024-09-21T02:46:07.087425+0000 mon.a (mon.0) 9626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:08 smithi044 bash[22676]: audit 2024-09-21T02:46:07.096080+0000 mon.a (mon.0) 9627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:08 smithi044 bash[22676]: audit 2024-09-21T02:46:07.106772+0000 mon.a (mon.0) 9628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:08 smithi049 bash[23528]: audit 2024-09-21T02:46:07.087425+0000 mon.a (mon.0) 9626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:08 smithi049 bash[23528]: audit 2024-09-21T02:46:07.096080+0000 mon.a (mon.0) 9627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:08 smithi049 bash[23528]: audit 2024-09-21T02:46:07.106772+0000 mon.a (mon.0) 9628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:09.234 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:09.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:09.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:09.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:09.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:09 smithi179 bash[23186]: cluster 2024-09-21T02:46:07.891359+0000 mgr.a (mgr.14388) 11756 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:09 smithi044 bash[22676]: cluster 2024-09-21T02:46:07.891359+0000 mgr.a (mgr.14388) 11756 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:09 smithi049 bash[23528]: cluster 2024-09-21T02:46:07.891359+0000 mgr.a (mgr.14388) 11756 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:10 smithi179 bash[23186]: audit 2024-09-21T02:46:08.780043+0000 mgr.a (mgr.14388) 11757 : audit [DBG] from='client.257718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:10 smithi044 bash[22676]: audit 2024-09-21T02:46:08.780043+0000 mgr.a (mgr.14388) 11757 : audit [DBG] from='client.257718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:10 smithi049 bash[23528]: audit 2024-09-21T02:46:08.780043+0000 mgr.a (mgr.14388) 11757 : audit [DBG] from='client.257718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:11.464 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:11 smithi049 bash[23528]: cluster 2024-09-21T02:46:09.893044+0000 mgr.a (mgr.14388) 11758 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-21T02:46:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:11 smithi044 bash[22676]: cluster 2024-09-21T02:46:09.893044+0000 mgr.a (mgr.14388) 11758 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-21T02:46:11.497 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:11 smithi179 bash[23186]: cluster 2024-09-21T02:46:09.893044+0000 mgr.a (mgr.14388) 11758 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-21T02:46:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:13 smithi044 bash[22676]: cluster 2024-09-21T02:46:11.894778+0000 mgr.a (mgr.14388) 11759 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:46:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:13 smithi179 bash[23186]: cluster 2024-09-21T02:46:11.894778+0000 mgr.a (mgr.14388) 11759 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:46:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:13 smithi049 bash[23528]: cluster 2024-09-21T02:46:11.894778+0000 mgr.a (mgr.14388) 11759 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T02:46:14.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:14.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:14.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:15.033 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:15.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:15.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:15.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:15.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:15.377 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:15 smithi044 bash[22676]: cluster 2024-09-21T02:46:13.895593+0000 mgr.a (mgr.14388) 11760 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:15.377 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:15 smithi044 bash[22676]: audit 2024-09-21T02:46:14.574126+0000 mgr.a (mgr.14388) 11761 : audit [DBG] from='client.257796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:15 smithi179 bash[23186]: cluster 2024-09-21T02:46:13.895593+0000 mgr.a (mgr.14388) 11760 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:15 smithi179 bash[23186]: audit 2024-09-21T02:46:14.574126+0000 mgr.a (mgr.14388) 11761 : audit [DBG] from='client.257796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:15 smithi049 bash[23528]: cluster 2024-09-21T02:46:13.895593+0000 mgr.a (mgr.14388) 11760 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:15 smithi049 bash[23528]: audit 2024-09-21T02:46:14.574126+0000 mgr.a (mgr.14388) 11761 : audit [DBG] from='client.257796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:16 smithi044 bash[22676]: audit 2024-09-21T02:46:15.973168+0000 mon.a (mon.0) 9629 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:46:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:16 smithi044 bash[22676]: audit 2024-09-21T02:46:15.980818+0000 mon.a (mon.0) 9630 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:46:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:16 smithi044 bash[22676]: audit 2024-09-21T02:46:15.982813+0000 mon.a (mon.0) 9631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:46:16.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:16 smithi044 bash[22676]: audit 2024-09-21T02:46:15.991264+0000 mon.a (mon.0) 9632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:16 smithi044 bash[22676]: audit 2024-09-21T02:46:15.995426+0000 mon.a (mon.0) 9633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:46:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:16 smithi179 bash[23186]: audit 2024-09-21T02:46:15.973168+0000 mon.a (mon.0) 9629 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:46:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:16 smithi179 bash[23186]: audit 2024-09-21T02:46:15.980818+0000 mon.a (mon.0) 9630 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:46:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:16 smithi179 bash[23186]: audit 2024-09-21T02:46:15.982813+0000 mon.a (mon.0) 9631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:46:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:16 smithi179 bash[23186]: audit 2024-09-21T02:46:15.991264+0000 mon.a (mon.0) 9632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:16 smithi179 bash[23186]: audit 2024-09-21T02:46:15.995426+0000 mon.a (mon.0) 9633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:46:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:16 smithi049 bash[23528]: audit 2024-09-21T02:46:15.973168+0000 mon.a (mon.0) 9629 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:46:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:16 smithi049 bash[23528]: audit 2024-09-21T02:46:15.980818+0000 mon.a (mon.0) 9630 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:46:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:16 smithi049 bash[23528]: audit 2024-09-21T02:46:15.982813+0000 mon.a (mon.0) 9631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:46:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:16 smithi049 bash[23528]: audit 2024-09-21T02:46:15.991264+0000 mon.a (mon.0) 9632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:16 smithi049 bash[23528]: audit 2024-09-21T02:46:15.995426+0000 mon.a (mon.0) 9633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:46:17.137 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:46:16 smithi044 bash[22930]: debug 2024-09-21T02:46:16.754+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:46:17.137 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:46:16 smithi044 bash[22930]: debug 2024-09-21T02:46:16.754+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:46:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:17 smithi044 bash[22676]: cluster 2024-09-21T02:46:15.898661+0000 mgr.a (mgr.14388) 11762 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:17 smithi044 bash[22676]: audit 2024-09-21T02:46:15.997029+0000 mgr.a (mgr.14388) 11763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:46:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:17 smithi179 bash[23186]: cluster 2024-09-21T02:46:15.898661+0000 mgr.a (mgr.14388) 11762 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:17 smithi179 bash[23186]: audit 2024-09-21T02:46:15.997029+0000 mgr.a (mgr.14388) 11763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:46:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:17 smithi049 bash[23528]: cluster 2024-09-21T02:46:15.898661+0000 mgr.a (mgr.14388) 11762 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:17 smithi049 bash[23528]: audit 2024-09-21T02:46:15.997029+0000 mgr.a (mgr.14388) 11763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:46:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:18 smithi044 bash[22676]: audit 2024-09-21T02:46:16.757667+0000 mgr.a (mgr.14388) 11764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:46:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:18 smithi044 bash[22676]: cephadm 2024-09-21T02:46:16.759005+0000 mgr.a (mgr.14388) 11765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:46:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:18 smithi179 bash[23186]: audit 2024-09-21T02:46:16.757667+0000 mgr.a (mgr.14388) 11764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:46:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:18 smithi179 bash[23186]: cephadm 2024-09-21T02:46:16.759005+0000 mgr.a (mgr.14388) 11765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:46:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:18 smithi049 bash[23528]: audit 2024-09-21T02:46:16.757667+0000 mgr.a (mgr.14388) 11764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:46:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:18 smithi049 bash[23528]: cephadm 2024-09-21T02:46:16.759005+0000 mgr.a (mgr.14388) 11765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:46:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:19 smithi044 bash[22676]: cluster 2024-09-21T02:46:17.899783+0000 mgr.a (mgr.14388) 11766 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:19 smithi179 bash[23186]: cluster 2024-09-21T02:46:17.899783+0000 mgr.a (mgr.14388) 11766 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:19 smithi049 bash[23528]: cluster 2024-09-21T02:46:17.899783+0000 mgr.a (mgr.14388) 11766 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:20.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:20.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:20.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:20.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:20.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: cluster 2024-09-21T02:46:19.901206+0000 mgr.a (mgr.14388) 11767 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: audit 2024-09-21T02:46:20.054166+0000 mon.a (mon.0) 9634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: audit 2024-09-21T02:46:20.060613+0000 mon.a (mon.0) 9635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: audit 2024-09-21T02:46:20.067199+0000 mon.a (mon.0) 9636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: audit 2024-09-21T02:46:20.100682+0000 mon.a (mon.0) 9637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: audit 2024-09-21T02:46:20.106668+0000 mon.a (mon.0) 9638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: audit 2024-09-21T02:46:20.114253+0000 mon.a (mon.0) 9639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:21 smithi044 bash[22676]: audit 2024-09-21T02:46:20.373712+0000 mgr.a (mgr.14388) 11768 : audit [DBG] from='client.257982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: cluster 2024-09-21T02:46:19.901206+0000 mgr.a (mgr.14388) 11767 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: audit 2024-09-21T02:46:20.054166+0000 mon.a (mon.0) 9634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: audit 2024-09-21T02:46:20.060613+0000 mon.a (mon.0) 9635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: audit 2024-09-21T02:46:20.067199+0000 mon.a (mon.0) 9636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: audit 2024-09-21T02:46:20.100682+0000 mon.a (mon.0) 9637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: audit 2024-09-21T02:46:20.106668+0000 mon.a (mon.0) 9638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: audit 2024-09-21T02:46:20.114253+0000 mon.a (mon.0) 9639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:21 smithi179 bash[23186]: audit 2024-09-21T02:46:20.373712+0000 mgr.a (mgr.14388) 11768 : audit [DBG] from='client.257982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: cluster 2024-09-21T02:46:19.901206+0000 mgr.a (mgr.14388) 11767 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:46:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: audit 2024-09-21T02:46:20.054166+0000 mon.a (mon.0) 9634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: audit 2024-09-21T02:46:20.060613+0000 mon.a (mon.0) 9635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: audit 2024-09-21T02:46:20.067199+0000 mon.a (mon.0) 9636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: audit 2024-09-21T02:46:20.100682+0000 mon.a (mon.0) 9637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: audit 2024-09-21T02:46:20.106668+0000 mon.a (mon.0) 9638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: audit 2024-09-21T02:46:20.114253+0000 mon.a (mon.0) 9639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:21 smithi049 bash[23528]: audit 2024-09-21T02:46:20.373712+0000 mgr.a (mgr.14388) 11768 : audit [DBG] from='client.257982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:23 smithi044 bash[22676]: cluster 2024-09-21T02:46:21.903553+0000 mgr.a (mgr.14388) 11769 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 36 op/s 2024-09-21T02:46:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:23 smithi179 bash[23186]: cluster 2024-09-21T02:46:21.903553+0000 mgr.a (mgr.14388) 11769 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 36 op/s 2024-09-21T02:46:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:23 smithi049 bash[23528]: cluster 2024-09-21T02:46:21.903553+0000 mgr.a (mgr.14388) 11769 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 36 op/s 2024-09-21T02:46:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:25 smithi044 bash[22676]: cluster 2024-09-21T02:46:23.904348+0000 mgr.a (mgr.14388) 11770 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:25 smithi179 bash[23186]: cluster 2024-09-21T02:46:23.904348+0000 mgr.a (mgr.14388) 11770 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:25 smithi049 bash[23528]: cluster 2024-09-21T02:46:23.904348+0000 mgr.a (mgr.14388) 11770 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:25.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:26.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:26.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:26.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:26.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:26.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:27.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:27 smithi049 bash[23528]: cluster 2024-09-21T02:46:25.906494+0000 mgr.a (mgr.14388) 11771 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:46:27.329 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:27 smithi049 bash[23528]: audit 2024-09-21T02:46:26.174925+0000 mgr.a (mgr.14388) 11772 : audit [DBG] from='client.258057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:27 smithi044 bash[22676]: cluster 2024-09-21T02:46:25.906494+0000 mgr.a (mgr.14388) 11771 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:46:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:27 smithi044 bash[22676]: audit 2024-09-21T02:46:26.174925+0000 mgr.a (mgr.14388) 11772 : audit [DBG] from='client.258057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:27 smithi179 bash[23186]: cluster 2024-09-21T02:46:25.906494+0000 mgr.a (mgr.14388) 11771 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:46:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:27 smithi179 bash[23186]: audit 2024-09-21T02:46:26.174925+0000 mgr.a (mgr.14388) 11772 : audit [DBG] from='client.258057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:28 smithi044 bash[22676]: audit 2024-09-21T02:46:27.307253+0000 mon.a (mon.0) 9640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:28 smithi044 bash[22676]: audit 2024-09-21T02:46:27.316426+0000 mon.a (mon.0) 9641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:28 smithi044 bash[22676]: audit 2024-09-21T02:46:27.326976+0000 mon.a (mon.0) 9642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:28 smithi179 bash[23186]: audit 2024-09-21T02:46:27.307253+0000 mon.a (mon.0) 9640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:28 smithi179 bash[23186]: audit 2024-09-21T02:46:27.316426+0000 mon.a (mon.0) 9641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:28 smithi179 bash[23186]: audit 2024-09-21T02:46:27.326976+0000 mon.a (mon.0) 9642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:28 smithi049 bash[23528]: audit 2024-09-21T02:46:27.307253+0000 mon.a (mon.0) 9640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:28 smithi049 bash[23528]: audit 2024-09-21T02:46:27.316426+0000 mon.a (mon.0) 9641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:28 smithi049 bash[23528]: audit 2024-09-21T02:46:27.326976+0000 mon.a (mon.0) 9642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:29.444 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:29 smithi049 bash[23528]: cluster 2024-09-21T02:46:27.907466+0000 mgr.a (mgr.14388) 11773 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:29.649 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:29 smithi179 bash[23186]: cluster 2024-09-21T02:46:27.907466+0000 mgr.a (mgr.14388) 11773 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:29 smithi044 bash[22676]: cluster 2024-09-21T02:46:27.907466+0000 mgr.a (mgr.14388) 11773 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:31 smithi179 bash[23186]: cluster 2024-09-21T02:46:29.908848+0000 mgr.a (mgr.14388) 11774 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:31.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:31.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:31.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:31.645 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:31 smithi049 bash[23528]: cluster 2024-09-21T02:46:29.908848+0000 mgr.a (mgr.14388) 11774 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:31 smithi044 bash[22676]: cluster 2024-09-21T02:46:29.908848+0000 mgr.a (mgr.14388) 11774 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:46:32.380 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:33 smithi179 bash[23186]: cluster 2024-09-21T02:46:31.910559+0000 mgr.a (mgr.14388) 11775 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:46:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:33 smithi179 bash[23186]: audit 2024-09-21T02:46:31.950409+0000 mgr.a (mgr.14388) 11776 : audit [DBG] from='client.258132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:33 smithi044 bash[22676]: cluster 2024-09-21T02:46:31.910559+0000 mgr.a (mgr.14388) 11775 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:46:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:33 smithi044 bash[22676]: audit 2024-09-21T02:46:31.950409+0000 mgr.a (mgr.14388) 11776 : audit [DBG] from='client.258132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:33 smithi049 bash[23528]: cluster 2024-09-21T02:46:31.910559+0000 mgr.a (mgr.14388) 11775 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:46:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:33 smithi049 bash[23528]: audit 2024-09-21T02:46:31.950409+0000 mgr.a (mgr.14388) 11776 : audit [DBG] from='client.258132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:35.601 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:35 smithi044 bash[22676]: cluster 2024-09-21T02:46:33.911586+0000 mgr.a (mgr.14388) 11777 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:35 smithi179 bash[23186]: cluster 2024-09-21T02:46:33.911586+0000 mgr.a (mgr.14388) 11777 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:35 smithi049 bash[23528]: cluster 2024-09-21T02:46:33.911586+0000 mgr.a (mgr.14388) 11777 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:37.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:37.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:37.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:37 smithi044 bash[22676]: cluster 2024-09-21T02:46:35.913928+0000 mgr.a (mgr.14388) 11778 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:37 smithi179 bash[23186]: cluster 2024-09-21T02:46:35.913928+0000 mgr.a (mgr.14388) 11778 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:37 smithi049 bash[23528]: cluster 2024-09-21T02:46:35.913928+0000 mgr.a (mgr.14388) 11778 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:38.145 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:38.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:38.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:38.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:38.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:39 smithi044 bash[22676]: audit 2024-09-21T02:46:37.714368+0000 mgr.a (mgr.14388) 11779 : audit [DBG] from='client.258207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:39 smithi044 bash[22676]: cluster 2024-09-21T02:46:37.914521+0000 mgr.a (mgr.14388) 11780 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:39 smithi179 bash[23186]: audit 2024-09-21T02:46:37.714368+0000 mgr.a (mgr.14388) 11779 : audit [DBG] from='client.258207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:39 smithi179 bash[23186]: cluster 2024-09-21T02:46:37.914521+0000 mgr.a (mgr.14388) 11780 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:39 smithi049 bash[23528]: audit 2024-09-21T02:46:37.714368+0000 mgr.a (mgr.14388) 11779 : audit [DBG] from='client.258207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:39 smithi049 bash[23528]: cluster 2024-09-21T02:46:37.914521+0000 mgr.a (mgr.14388) 11780 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:41 smithi049 bash[23528]: cluster 2024-09-21T02:46:39.916355+0000 mgr.a (mgr.14388) 11781 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:46:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:41 smithi049 bash[23528]: audit 2024-09-21T02:46:40.262947+0000 mon.a (mon.0) 9643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:41 smithi049 bash[23528]: audit 2024-09-21T02:46:40.269909+0000 mon.a (mon.0) 9644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:41 smithi049 bash[23528]: audit 2024-09-21T02:46:40.277489+0000 mon.a (mon.0) 9645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:41 smithi049 bash[23528]: audit 2024-09-21T02:46:40.315127+0000 mon.a (mon.0) 9646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:41 smithi049 bash[23528]: audit 2024-09-21T02:46:40.321822+0000 mon.a (mon.0) 9647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:41 smithi049 bash[23528]: audit 2024-09-21T02:46:40.330620+0000 mon.a (mon.0) 9648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:41 smithi044 bash[22676]: cluster 2024-09-21T02:46:39.916355+0000 mgr.a (mgr.14388) 11781 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:46:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:41 smithi044 bash[22676]: audit 2024-09-21T02:46:40.262947+0000 mon.a (mon.0) 9643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:41 smithi044 bash[22676]: audit 2024-09-21T02:46:40.269909+0000 mon.a (mon.0) 9644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:41 smithi044 bash[22676]: audit 2024-09-21T02:46:40.277489+0000 mon.a (mon.0) 9645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:41 smithi044 bash[22676]: audit 2024-09-21T02:46:40.315127+0000 mon.a (mon.0) 9646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:41 smithi044 bash[22676]: audit 2024-09-21T02:46:40.321822+0000 mon.a (mon.0) 9647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:41 smithi044 bash[22676]: audit 2024-09-21T02:46:40.330620+0000 mon.a (mon.0) 9648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:41 smithi179 bash[23186]: cluster 2024-09-21T02:46:39.916355+0000 mgr.a (mgr.14388) 11781 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:46:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:41 smithi179 bash[23186]: audit 2024-09-21T02:46:40.262947+0000 mon.a (mon.0) 9643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:41 smithi179 bash[23186]: audit 2024-09-21T02:46:40.269909+0000 mon.a (mon.0) 9644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:41 smithi179 bash[23186]: audit 2024-09-21T02:46:40.277489+0000 mon.a (mon.0) 9645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:41 smithi179 bash[23186]: audit 2024-09-21T02:46:40.315127+0000 mon.a (mon.0) 9646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:41 smithi179 bash[23186]: audit 2024-09-21T02:46:40.321822+0000 mon.a (mon.0) 9647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:41 smithi179 bash[23186]: audit 2024-09-21T02:46:40.330620+0000 mon.a (mon.0) 9648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:43.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:43.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:43.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:43 smithi049 bash[23528]: cluster 2024-09-21T02:46:41.917663+0000 mgr.a (mgr.14388) 11782 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:43 smithi044 bash[22676]: cluster 2024-09-21T02:46:41.917663+0000 mgr.a (mgr.14388) 11782 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:43 smithi179 bash[23186]: cluster 2024-09-21T02:46:41.917663+0000 mgr.a (mgr.14388) 11782 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:43.948 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:44 smithi049 bash[23528]: audit 2024-09-21T02:46:43.487756+0000 mgr.a (mgr.14388) 11783 : audit [DBG] from='client.258285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:44.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:44 smithi044 bash[22676]: audit 2024-09-21T02:46:43.487756+0000 mgr.a (mgr.14388) 11783 : audit [DBG] from='client.258285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:44 smithi179 bash[23186]: audit 2024-09-21T02:46:43.487756+0000 mgr.a (mgr.14388) 11783 : audit [DBG] from='client.258285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:45 smithi049 bash[23528]: cluster 2024-09-21T02:46:43.918162+0000 mgr.a (mgr.14388) 11784 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:45 smithi044 bash[22676]: cluster 2024-09-21T02:46:43.918162+0000 mgr.a (mgr.14388) 11784 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:45 smithi179 bash[23186]: cluster 2024-09-21T02:46:43.918162+0000 mgr.a (mgr.14388) 11784 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:47.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:47 smithi049 bash[23528]: cluster 2024-09-21T02:46:45.920378+0000 mgr.a (mgr.14388) 11785 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:47 smithi044 bash[22676]: cluster 2024-09-21T02:46:45.920378+0000 mgr.a (mgr.14388) 11785 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:47 smithi179 bash[23186]: cluster 2024-09-21T02:46:45.920378+0000 mgr.a (mgr.14388) 11785 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:46:48.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:48 smithi049 bash[23528]: audit 2024-09-21T02:46:47.515958+0000 mon.a (mon.0) 9649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:48.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:48 smithi049 bash[23528]: audit 2024-09-21T02:46:47.525979+0000 mon.a (mon.0) 9650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:48.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:48 smithi049 bash[23528]: audit 2024-09-21T02:46:47.536367+0000 mon.a (mon.0) 9651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:48.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:48.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:48.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:48 smithi044 bash[22676]: audit 2024-09-21T02:46:47.515958+0000 mon.a (mon.0) 9649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:48 smithi044 bash[22676]: audit 2024-09-21T02:46:47.525979+0000 mon.a (mon.0) 9650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:48 smithi044 bash[22676]: audit 2024-09-21T02:46:47.536367+0000 mon.a (mon.0) 9651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:48 smithi179 bash[23186]: audit 2024-09-21T02:46:47.515958+0000 mon.a (mon.0) 9649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:48 smithi179 bash[23186]: audit 2024-09-21T02:46:47.525979+0000 mon.a (mon.0) 9650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:48 smithi179 bash[23186]: audit 2024-09-21T02:46:47.536367+0000 mon.a (mon.0) 9651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:46:49.742 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:49.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:49.748 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:49 smithi049 bash[23528]: cluster 2024-09-21T02:46:47.921184+0000 mgr.a (mgr.14388) 11786 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:49.872 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:49 smithi179 bash[23186]: cluster 2024-09-21T02:46:47.921184+0000 mgr.a (mgr.14388) 11786 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:49 smithi044 bash[22676]: cluster 2024-09-21T02:46:47.921184+0000 mgr.a (mgr.14388) 11786 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:50 smithi179 bash[23186]: audit 2024-09-21T02:46:49.287655+0000 mgr.a (mgr.14388) 11787 : audit [DBG] from='client.258363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:50 smithi049 bash[23528]: audit 2024-09-21T02:46:49.287655+0000 mgr.a (mgr.14388) 11787 : audit [DBG] from='client.258363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:50 smithi044 bash[22676]: audit 2024-09-21T02:46:49.287655+0000 mgr.a (mgr.14388) 11787 : audit [DBG] from='client.258363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:51 smithi179 bash[23186]: cluster 2024-09-21T02:46:49.923206+0000 mgr.a (mgr.14388) 11788 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:46:51.881 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:51 smithi049 bash[23528]: cluster 2024-09-21T02:46:49.923206+0000 mgr.a (mgr.14388) 11788 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:46:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:51 smithi044 bash[22676]: cluster 2024-09-21T02:46:49.923206+0000 mgr.a (mgr.14388) 11788 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T02:46:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:53 smithi044 bash[22676]: cluster 2024-09-21T02:46:51.924415+0000 mgr.a (mgr.14388) 11789 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T02:46:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:53 smithi179 bash[23186]: cluster 2024-09-21T02:46:51.924415+0000 mgr.a (mgr.14388) 11789 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T02:46:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:53 smithi049 bash[23528]: cluster 2024-09-21T02:46:51.924415+0000 mgr.a (mgr.14388) 11789 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T02:46:54.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:46:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:46:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:46:55.515 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:46:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:46:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:46:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:46:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:46:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:55 smithi044 bash[22676]: cluster 2024-09-21T02:46:53.925184+0000 mgr.a (mgr.14388) 11790 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:55 smithi179 bash[23186]: cluster 2024-09-21T02:46:53.925184+0000 mgr.a (mgr.14388) 11790 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:55 smithi049 bash[23528]: cluster 2024-09-21T02:46:53.925184+0000 mgr.a (mgr.14388) 11790 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:56 smithi044 bash[22676]: audit 2024-09-21T02:46:55.081465+0000 mgr.a (mgr.14388) 11791 : audit [DBG] from='client.258438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:56 smithi179 bash[23186]: audit 2024-09-21T02:46:55.081465+0000 mgr.a (mgr.14388) 11791 : audit [DBG] from='client.258438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:56 smithi049 bash[23528]: audit 2024-09-21T02:46:55.081465+0000 mgr.a (mgr.14388) 11791 : audit [DBG] from='client.258438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:46:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:57 smithi044 bash[22676]: cluster 2024-09-21T02:46:55.928005+0000 mgr.a (mgr.14388) 11792 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:57 smithi179 bash[23186]: cluster 2024-09-21T02:46:55.928005+0000 mgr.a (mgr.14388) 11792 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:57 smithi049 bash[23528]: cluster 2024-09-21T02:46:55.928005+0000 mgr.a (mgr.14388) 11792 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:46:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:46:59 smithi044 bash[22676]: cluster 2024-09-21T02:46:57.928820+0000 mgr.a (mgr.14388) 11793 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:47:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:46:59 smithi179 bash[23186]: cluster 2024-09-21T02:46:57.928820+0000 mgr.a (mgr.14388) 11793 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:47:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:46:59 smithi049 bash[23528]: cluster 2024-09-21T02:46:57.928820+0000 mgr.a (mgr.14388) 11793 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:47:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:01.298 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:01 smithi044 bash[22676]: cluster 2024-09-21T02:46:59.930746+0000 mgr.a (mgr.14388) 11794 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:01 smithi044 bash[22676]: audit 2024-09-21T02:47:00.477856+0000 mon.a (mon.0) 9652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:01 smithi044 bash[22676]: audit 2024-09-21T02:47:00.487258+0000 mon.a (mon.0) 9653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:01 smithi044 bash[22676]: audit 2024-09-21T02:47:00.498683+0000 mon.a (mon.0) 9654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:01 smithi044 bash[22676]: audit 2024-09-21T02:47:00.547639+0000 mon.a (mon.0) 9655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:01 smithi044 bash[22676]: audit 2024-09-21T02:47:00.556158+0000 mon.a (mon.0) 9656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:01 smithi044 bash[22676]: audit 2024-09-21T02:47:00.567351+0000 mon.a (mon.0) 9657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:01 smithi179 bash[23186]: cluster 2024-09-21T02:46:59.930746+0000 mgr.a (mgr.14388) 11794 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:01 smithi179 bash[23186]: audit 2024-09-21T02:47:00.477856+0000 mon.a (mon.0) 9652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:01 smithi179 bash[23186]: audit 2024-09-21T02:47:00.487258+0000 mon.a (mon.0) 9653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:01 smithi179 bash[23186]: audit 2024-09-21T02:47:00.498683+0000 mon.a (mon.0) 9654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:01 smithi179 bash[23186]: audit 2024-09-21T02:47:00.547639+0000 mon.a (mon.0) 9655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:01 smithi179 bash[23186]: audit 2024-09-21T02:47:00.556158+0000 mon.a (mon.0) 9656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:01 smithi179 bash[23186]: audit 2024-09-21T02:47:00.567351+0000 mon.a (mon.0) 9657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:01 smithi049 bash[23528]: cluster 2024-09-21T02:46:59.930746+0000 mgr.a (mgr.14388) 11794 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:01 smithi049 bash[23528]: audit 2024-09-21T02:47:00.477856+0000 mon.a (mon.0) 9652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:01 smithi049 bash[23528]: audit 2024-09-21T02:47:00.487258+0000 mon.a (mon.0) 9653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:01 smithi049 bash[23528]: audit 2024-09-21T02:47:00.498683+0000 mon.a (mon.0) 9654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:01 smithi049 bash[23528]: audit 2024-09-21T02:47:00.547639+0000 mon.a (mon.0) 9655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:01 smithi049 bash[23528]: audit 2024-09-21T02:47:00.556158+0000 mon.a (mon.0) 9656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:01.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:01 smithi049 bash[23528]: audit 2024-09-21T02:47:00.567351+0000 mon.a (mon.0) 9657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:02.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:02 smithi044 bash[22676]: audit 2024-09-21T02:47:00.854093+0000 mgr.a (mgr.14388) 11795 : audit [DBG] from='client.258504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:02.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:02 smithi179 bash[23186]: audit 2024-09-21T02:47:00.854093+0000 mgr.a (mgr.14388) 11795 : audit [DBG] from='client.258504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:02 smithi049 bash[23528]: audit 2024-09-21T02:47:00.854093+0000 mgr.a (mgr.14388) 11795 : audit [DBG] from='client.258504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:03 smithi044 bash[22676]: cluster 2024-09-21T02:47:01.931736+0000 mgr.a (mgr.14388) 11796 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:47:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:03 smithi179 bash[23186]: cluster 2024-09-21T02:47:01.931736+0000 mgr.a (mgr.14388) 11796 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:47:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:03 smithi049 bash[23528]: cluster 2024-09-21T02:47:01.931736+0000 mgr.a (mgr.14388) 11796 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T02:47:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:05 smithi179 bash[23186]: cluster 2024-09-21T02:47:03.932525+0000 mgr.a (mgr.14388) 11797 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:47:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:05 smithi049 bash[23528]: cluster 2024-09-21T02:47:03.932525+0000 mgr.a (mgr.14388) 11797 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:47:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:05 smithi044 bash[22676]: cluster 2024-09-21T02:47:03.932525+0000 mgr.a (mgr.14388) 11797 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:07.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:07.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:07.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:07.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:07.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:07 smithi179 bash[23186]: cluster 2024-09-21T02:47:05.934768+0000 mgr.a (mgr.14388) 11798 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:07 smithi179 bash[23186]: audit 2024-09-21T02:47:06.632865+0000 mgr.a (mgr.14388) 11799 : audit [DBG] from='client.258579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:07 smithi049 bash[23528]: cluster 2024-09-21T02:47:05.934768+0000 mgr.a (mgr.14388) 11798 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:07 smithi049 bash[23528]: audit 2024-09-21T02:47:06.632865+0000 mgr.a (mgr.14388) 11799 : audit [DBG] from='client.258579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:07 smithi044 bash[22676]: cluster 2024-09-21T02:47:05.934768+0000 mgr.a (mgr.14388) 11798 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:07 smithi044 bash[22676]: audit 2024-09-21T02:47:06.632865+0000 mgr.a (mgr.14388) 11799 : audit [DBG] from='client.258579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:08 smithi044 bash[22676]: audit 2024-09-21T02:47:07.702783+0000 mon.a (mon.0) 9658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:08 smithi044 bash[22676]: audit 2024-09-21T02:47:07.711634+0000 mon.a (mon.0) 9659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:08 smithi044 bash[22676]: audit 2024-09-21T02:47:07.722153+0000 mon.a (mon.0) 9660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:08 smithi044 bash[22676]: cluster 2024-09-21T02:47:07.935697+0000 mgr.a (mgr.14388) 11800 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:08 smithi179 bash[23186]: audit 2024-09-21T02:47:07.702783+0000 mon.a (mon.0) 9658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:08 smithi179 bash[23186]: audit 2024-09-21T02:47:07.711634+0000 mon.a (mon.0) 9659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:08 smithi179 bash[23186]: audit 2024-09-21T02:47:07.722153+0000 mon.a (mon.0) 9660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:08 smithi179 bash[23186]: cluster 2024-09-21T02:47:07.935697+0000 mgr.a (mgr.14388) 11800 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:08 smithi049 bash[23528]: audit 2024-09-21T02:47:07.702783+0000 mon.a (mon.0) 9658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:08 smithi049 bash[23528]: audit 2024-09-21T02:47:07.711634+0000 mon.a (mon.0) 9659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:08 smithi049 bash[23528]: audit 2024-09-21T02:47:07.722153+0000 mon.a (mon.0) 9660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:08 smithi049 bash[23528]: cluster 2024-09-21T02:47:07.935697+0000 mgr.a (mgr.14388) 11800 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:10 smithi179 bash[23186]: cluster 2024-09-21T02:47:09.937959+0000 mgr.a (mgr.14388) 11801 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:10 smithi049 bash[23528]: cluster 2024-09-21T02:47:09.937959+0000 mgr.a (mgr.14388) 11801 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:10 smithi044 bash[22676]: cluster 2024-09-21T02:47:09.937959+0000 mgr.a (mgr.14388) 11801 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:12.857 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:12.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:12.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:13 smithi179 bash[23186]: cluster 2024-09-21T02:47:11.938716+0000 mgr.a (mgr.14388) 11802 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:13 smithi179 bash[23186]: audit 2024-09-21T02:47:12.401498+0000 mgr.a (mgr.14388) 11803 : audit [DBG] from='client.258654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:13.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:12 smithi044 bash[22676]: cluster 2024-09-21T02:47:11.938716+0000 mgr.a (mgr.14388) 11802 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:13.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:12 smithi044 bash[22676]: audit 2024-09-21T02:47:12.401498+0000 mgr.a (mgr.14388) 11803 : audit [DBG] from='client.258654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:12 smithi049 bash[23528]: cluster 2024-09-21T02:47:11.938716+0000 mgr.a (mgr.14388) 11802 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:12 smithi049 bash[23528]: audit 2024-09-21T02:47:12.401498+0000 mgr.a (mgr.14388) 11803 : audit [DBG] from='client.258654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:15 smithi044 bash[22676]: cluster 2024-09-21T02:47:13.939605+0000 mgr.a (mgr.14388) 11804 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:15 smithi049 bash[23528]: cluster 2024-09-21T02:47:13.939605+0000 mgr.a (mgr.14388) 11804 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:15 smithi179 bash[23186]: cluster 2024-09-21T02:47:13.939605+0000 mgr.a (mgr.14388) 11804 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22676]: cluster 2024-09-21T02:47:15.942080+0000 mgr.a (mgr.14388) 11805 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22676]: audit 2024-09-21T02:47:16.826982+0000 mon.a (mon.0) 9661 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:47:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22676]: audit 2024-09-21T02:47:16.830490+0000 mon.a (mon.0) 9662 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:47:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22676]: audit 2024-09-21T02:47:16.831430+0000 mon.a (mon.0) 9663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:47:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22676]: audit 2024-09-21T02:47:16.837896+0000 mon.a (mon.0) 9664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22676]: audit 2024-09-21T02:47:16.840999+0000 mon.a (mon.0) 9665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:47:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:17 smithi049 bash[23528]: cluster 2024-09-21T02:47:15.942080+0000 mgr.a (mgr.14388) 11805 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:17 smithi049 bash[23528]: audit 2024-09-21T02:47:16.826982+0000 mon.a (mon.0) 9661 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:47:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:17 smithi049 bash[23528]: audit 2024-09-21T02:47:16.830490+0000 mon.a (mon.0) 9662 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:47:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:17 smithi049 bash[23528]: audit 2024-09-21T02:47:16.831430+0000 mon.a (mon.0) 9663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:47:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:17 smithi049 bash[23528]: audit 2024-09-21T02:47:16.837896+0000 mon.a (mon.0) 9664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:17 smithi049 bash[23528]: audit 2024-09-21T02:47:16.840999+0000 mon.a (mon.0) 9665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:17 smithi179 bash[23186]: cluster 2024-09-21T02:47:15.942080+0000 mgr.a (mgr.14388) 11805 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:17 smithi179 bash[23186]: audit 2024-09-21T02:47:16.826982+0000 mon.a (mon.0) 9661 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:17 smithi179 bash[23186]: audit 2024-09-21T02:47:16.830490+0000 mon.a (mon.0) 9662 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:47:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:17 smithi179 bash[23186]: audit 2024-09-21T02:47:16.831430+0000 mon.a (mon.0) 9663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:47:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:17 smithi179 bash[23186]: audit 2024-09-21T02:47:16.837896+0000 mon.a (mon.0) 9664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:17 smithi179 bash[23186]: audit 2024-09-21T02:47:16.840999+0000 mon.a (mon.0) 9665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:47:17.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:17.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:17.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:17.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22930]: debug 2024-09-21T02:47:17.605+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:47:17.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:47:17 smithi044 bash[22930]: debug 2024-09-21T02:47:17.609+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:47:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:18 smithi049 bash[23528]: audit 2024-09-21T02:47:16.842020+0000 mgr.a (mgr.14388) 11806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:47:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:18 smithi049 bash[23528]: audit 2024-09-21T02:47:17.613146+0000 mgr.a (mgr.14388) 11807 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:47:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:18 smithi049 bash[23528]: cephadm 2024-09-21T02:47:17.614627+0000 mgr.a (mgr.14388) 11808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:47:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:18 smithi044 bash[22676]: audit 2024-09-21T02:47:16.842020+0000 mgr.a (mgr.14388) 11806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:47:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:18 smithi044 bash[22676]: audit 2024-09-21T02:47:17.613146+0000 mgr.a (mgr.14388) 11807 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:47:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:18 smithi044 bash[22676]: cephadm 2024-09-21T02:47:17.614627+0000 mgr.a (mgr.14388) 11808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:47:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:18 smithi179 bash[23186]: audit 2024-09-21T02:47:16.842020+0000 mgr.a (mgr.14388) 11806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:47:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:18 smithi179 bash[23186]: audit 2024-09-21T02:47:17.613146+0000 mgr.a (mgr.14388) 11807 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:47:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:18 smithi179 bash[23186]: cephadm 2024-09-21T02:47:17.614627+0000 mgr.a (mgr.14388) 11808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:47:18.627 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:18.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:18.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:18.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:18.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:19 smithi049 bash[23528]: cluster 2024-09-21T02:47:17.943040+0000 mgr.a (mgr.14388) 11809 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:19 smithi049 bash[23528]: audit 2024-09-21T02:47:18.194378+0000 mgr.a (mgr.14388) 11810 : audit [DBG] from='client.258834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:19 smithi044 bash[22676]: cluster 2024-09-21T02:47:17.943040+0000 mgr.a (mgr.14388) 11809 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:19.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:19 smithi044 bash[22676]: audit 2024-09-21T02:47:18.194378+0000 mgr.a (mgr.14388) 11810 : audit [DBG] from='client.258834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:19 smithi179 bash[23186]: cluster 2024-09-21T02:47:17.943040+0000 mgr.a (mgr.14388) 11809 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:19 smithi179 bash[23186]: audit 2024-09-21T02:47:18.194378+0000 mgr.a (mgr.14388) 11810 : audit [DBG] from='client.258834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:21 smithi044 bash[22676]: cluster 2024-09-21T02:47:19.945367+0000 mgr.a (mgr.14388) 11811 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:21 smithi044 bash[22676]: audit 2024-09-21T02:47:20.713221+0000 mon.a (mon.0) 9666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:21 smithi044 bash[22676]: audit 2024-09-21T02:47:20.718707+0000 mon.a (mon.0) 9667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:21 smithi044 bash[22676]: audit 2024-09-21T02:47:20.725335+0000 mon.a (mon.0) 9668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:21 smithi044 bash[22676]: audit 2024-09-21T02:47:20.786043+0000 mon.a (mon.0) 9669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:21 smithi044 bash[22676]: audit 2024-09-21T02:47:20.791349+0000 mon.a (mon.0) 9670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:21 smithi044 bash[22676]: audit 2024-09-21T02:47:20.797113+0000 mon.a (mon.0) 9671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:21 smithi049 bash[23528]: cluster 2024-09-21T02:47:19.945367+0000 mgr.a (mgr.14388) 11811 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:21 smithi049 bash[23528]: audit 2024-09-21T02:47:20.713221+0000 mon.a (mon.0) 9666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:21 smithi049 bash[23528]: audit 2024-09-21T02:47:20.718707+0000 mon.a (mon.0) 9667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:21 smithi049 bash[23528]: audit 2024-09-21T02:47:20.725335+0000 mon.a (mon.0) 9668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:21 smithi049 bash[23528]: audit 2024-09-21T02:47:20.786043+0000 mon.a (mon.0) 9669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:21 smithi049 bash[23528]: audit 2024-09-21T02:47:20.791349+0000 mon.a (mon.0) 9670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:21 smithi049 bash[23528]: audit 2024-09-21T02:47:20.797113+0000 mon.a (mon.0) 9671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:21 smithi179 bash[23186]: cluster 2024-09-21T02:47:19.945367+0000 mgr.a (mgr.14388) 11811 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:21 smithi179 bash[23186]: audit 2024-09-21T02:47:20.713221+0000 mon.a (mon.0) 9666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:21 smithi179 bash[23186]: audit 2024-09-21T02:47:20.718707+0000 mon.a (mon.0) 9667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:21 smithi179 bash[23186]: audit 2024-09-21T02:47:20.725335+0000 mon.a (mon.0) 9668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:21 smithi179 bash[23186]: audit 2024-09-21T02:47:20.786043+0000 mon.a (mon.0) 9669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:21 smithi179 bash[23186]: audit 2024-09-21T02:47:20.791349+0000 mon.a (mon.0) 9670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:21 smithi179 bash[23186]: audit 2024-09-21T02:47:20.797113+0000 mon.a (mon.0) 9671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:23 smithi049 bash[23528]: cluster 2024-09-21T02:47:21.946148+0000 mgr.a (mgr.14388) 11812 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:23.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:23 smithi044 bash[22676]: cluster 2024-09-21T02:47:21.946148+0000 mgr.a (mgr.14388) 11812 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:23 smithi179 bash[23186]: cluster 2024-09-21T02:47:21.946148+0000 mgr.a (mgr.14388) 11812 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:23.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:23.629 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:24.400 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:24.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:24.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:24.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:24.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:25 smithi049 bash[23528]: cluster 2024-09-21T02:47:23.946854+0000 mgr.a (mgr.14388) 11813 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:25 smithi049 bash[23528]: audit 2024-09-21T02:47:23.961684+0000 mgr.a (mgr.14388) 11814 : audit [DBG] from='client.258909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:25 smithi044 bash[22676]: cluster 2024-09-21T02:47:23.946854+0000 mgr.a (mgr.14388) 11813 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:25 smithi044 bash[22676]: audit 2024-09-21T02:47:23.961684+0000 mgr.a (mgr.14388) 11814 : audit [DBG] from='client.258909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:25 smithi179 bash[23186]: cluster 2024-09-21T02:47:23.946854+0000 mgr.a (mgr.14388) 11813 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:25 smithi179 bash[23186]: audit 2024-09-21T02:47:23.961684+0000 mgr.a (mgr.14388) 11814 : audit [DBG] from='client.258909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:27 smithi049 bash[23528]: cluster 2024-09-21T02:47:25.949206+0000 mgr.a (mgr.14388) 11815 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:27 smithi044 bash[22676]: cluster 2024-09-21T02:47:25.949206+0000 mgr.a (mgr.14388) 11815 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:27 smithi179 bash[23186]: cluster 2024-09-21T02:47:25.949206+0000 mgr.a (mgr.14388) 11815 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:28 smithi044 bash[22676]: audit 2024-09-21T02:47:27.919026+0000 mon.a (mon.0) 9672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:28 smithi044 bash[22676]: audit 2024-09-21T02:47:27.927614+0000 mon.a (mon.0) 9673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:28 smithi044 bash[22676]: audit 2024-09-21T02:47:27.938252+0000 mon.a (mon.0) 9674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:28 smithi044 bash[22676]: cluster 2024-09-21T02:47:27.949953+0000 mgr.a (mgr.14388) 11816 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:28 smithi179 bash[23186]: audit 2024-09-21T02:47:27.919026+0000 mon.a (mon.0) 9672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:28 smithi179 bash[23186]: audit 2024-09-21T02:47:27.927614+0000 mon.a (mon.0) 9673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:28 smithi179 bash[23186]: audit 2024-09-21T02:47:27.938252+0000 mon.a (mon.0) 9674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:28 smithi179 bash[23186]: cluster 2024-09-21T02:47:27.949953+0000 mgr.a (mgr.14388) 11816 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:28 smithi049 bash[23528]: audit 2024-09-21T02:47:27.919026+0000 mon.a (mon.0) 9672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:28 smithi049 bash[23528]: audit 2024-09-21T02:47:27.927614+0000 mon.a (mon.0) 9673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:28 smithi049 bash[23528]: audit 2024-09-21T02:47:27.938252+0000 mon.a (mon.0) 9674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:28 smithi049 bash[23528]: cluster 2024-09-21T02:47:27.949953+0000 mgr.a (mgr.14388) 11816 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:29.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:30.185 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:30.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:30.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:30.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:30.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:31 smithi179 bash[23186]: audit 2024-09-21T02:47:29.738962+0000 mgr.a (mgr.14388) 11817 : audit [DBG] from='client.258984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:31 smithi179 bash[23186]: cluster 2024-09-21T02:47:29.951321+0000 mgr.a (mgr.14388) 11818 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:31 smithi049 bash[23528]: audit 2024-09-21T02:47:29.738962+0000 mgr.a (mgr.14388) 11817 : audit [DBG] from='client.258984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:31 smithi049 bash[23528]: cluster 2024-09-21T02:47:29.951321+0000 mgr.a (mgr.14388) 11818 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:31 smithi044 bash[22676]: audit 2024-09-21T02:47:29.738962+0000 mgr.a (mgr.14388) 11817 : audit [DBG] from='client.258984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:31 smithi044 bash[22676]: cluster 2024-09-21T02:47:29.951321+0000 mgr.a (mgr.14388) 11818 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:47:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:33 smithi049 bash[23528]: cluster 2024-09-21T02:47:31.952169+0000 mgr.a (mgr.14388) 11819 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:33.401 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:33 smithi044 bash[22676]: cluster 2024-09-21T02:47:31.952169+0000 mgr.a (mgr.14388) 11819 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:33 smithi179 bash[23186]: cluster 2024-09-21T02:47:31.952169+0000 mgr.a (mgr.14388) 11819 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:35.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:35.187 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:35.187 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:35 smithi179 bash[23186]: cluster 2024-09-21T02:47:33.952952+0000 mgr.a (mgr.14388) 11820 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:35 smithi049 bash[23528]: cluster 2024-09-21T02:47:33.952952+0000 mgr.a (mgr.14388) 11820 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:35 smithi044 bash[22676]: cluster 2024-09-21T02:47:33.952952+0000 mgr.a (mgr.14388) 11820 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:35.920 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:35.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:35.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:35.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:35.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:36 smithi049 bash[23528]: audit 2024-09-21T02:47:35.508717+0000 mgr.a (mgr.14388) 11821 : audit [DBG] from='client.259059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:36 smithi044 bash[22676]: audit 2024-09-21T02:47:35.508717+0000 mgr.a (mgr.14388) 11821 : audit [DBG] from='client.259059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:36 smithi179 bash[23186]: audit 2024-09-21T02:47:35.508717+0000 mgr.a (mgr.14388) 11821 : audit [DBG] from='client.259059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:37 smithi049 bash[23528]: cluster 2024-09-21T02:47:35.954199+0000 mgr.a (mgr.14388) 11822 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:37 smithi044 bash[22676]: cluster 2024-09-21T02:47:35.954199+0000 mgr.a (mgr.14388) 11822 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:37 smithi179 bash[23186]: cluster 2024-09-21T02:47:35.954199+0000 mgr.a (mgr.14388) 11822 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:39 smithi049 bash[23528]: cluster 2024-09-21T02:47:37.954727+0000 mgr.a (mgr.14388) 11823 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:39 smithi044 bash[22676]: cluster 2024-09-21T02:47:37.954727+0000 mgr.a (mgr.14388) 11823 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:39 smithi179 bash[23186]: cluster 2024-09-21T02:47:37.954727+0000 mgr.a (mgr.14388) 11823 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:47:40.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:40.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:40.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:41 smithi179 bash[23186]: cluster 2024-09-21T02:47:39.956581+0000 mgr.a (mgr.14388) 11824 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:41 smithi179 bash[23186]: audit 2024-09-21T02:47:40.931340+0000 mon.a (mon.0) 9675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:41 smithi179 bash[23186]: audit 2024-09-21T02:47:40.938155+0000 mon.a (mon.0) 9676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:41 smithi179 bash[23186]: audit 2024-09-21T02:47:40.947655+0000 mon.a (mon.0) 9677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:41 smithi179 bash[23186]: audit 2024-09-21T02:47:40.984883+0000 mon.a (mon.0) 9678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:41 smithi179 bash[23186]: audit 2024-09-21T02:47:40.991221+0000 mon.a (mon.0) 9679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:41 smithi179 bash[23186]: audit 2024-09-21T02:47:40.998411+0000 mon.a (mon.0) 9680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:41 smithi049 bash[23528]: cluster 2024-09-21T02:47:39.956581+0000 mgr.a (mgr.14388) 11824 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:41 smithi049 bash[23528]: audit 2024-09-21T02:47:40.931340+0000 mon.a (mon.0) 9675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:41 smithi049 bash[23528]: audit 2024-09-21T02:47:40.938155+0000 mon.a (mon.0) 9676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:41 smithi049 bash[23528]: audit 2024-09-21T02:47:40.947655+0000 mon.a (mon.0) 9677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:41 smithi049 bash[23528]: audit 2024-09-21T02:47:40.984883+0000 mon.a (mon.0) 9678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:41 smithi049 bash[23528]: audit 2024-09-21T02:47:40.991221+0000 mon.a (mon.0) 9679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:41 smithi049 bash[23528]: audit 2024-09-21T02:47:40.998411+0000 mon.a (mon.0) 9680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:41 smithi044 bash[22676]: cluster 2024-09-21T02:47:39.956581+0000 mgr.a (mgr.14388) 11824 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:41 smithi044 bash[22676]: audit 2024-09-21T02:47:40.931340+0000 mon.a (mon.0) 9675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:41 smithi044 bash[22676]: audit 2024-09-21T02:47:40.938155+0000 mon.a (mon.0) 9676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:41 smithi044 bash[22676]: audit 2024-09-21T02:47:40.947655+0000 mon.a (mon.0) 9677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:41 smithi044 bash[22676]: audit 2024-09-21T02:47:40.984883+0000 mon.a (mon.0) 9678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:41 smithi044 bash[22676]: audit 2024-09-21T02:47:40.991221+0000 mon.a (mon.0) 9679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:41 smithi044 bash[22676]: audit 2024-09-21T02:47:40.998411+0000 mon.a (mon.0) 9680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:41.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:42 smithi049 bash[23528]: audit 2024-09-21T02:47:41.255725+0000 mgr.a (mgr.14388) 11825 : audit [DBG] from='client.259137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:42.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:42 smithi044 bash[22676]: audit 2024-09-21T02:47:41.255725+0000 mgr.a (mgr.14388) 11825 : audit [DBG] from='client.259137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:42 smithi179 bash[23186]: audit 2024-09-21T02:47:41.255725+0000 mgr.a (mgr.14388) 11825 : audit [DBG] from='client.259137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:43 smithi049 bash[23528]: cluster 2024-09-21T02:47:41.957612+0000 mgr.a (mgr.14388) 11826 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:43 smithi044 bash[22676]: cluster 2024-09-21T02:47:41.957612+0000 mgr.a (mgr.14388) 11826 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:43 smithi179 bash[23186]: cluster 2024-09-21T02:47:41.957612+0000 mgr.a (mgr.14388) 11826 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:45 smithi044 bash[22676]: cluster 2024-09-21T02:47:43.958399+0000 mgr.a (mgr.14388) 11827 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:45 smithi179 bash[23186]: cluster 2024-09-21T02:47:43.958399+0000 mgr.a (mgr.14388) 11827 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:45 smithi049 bash[23528]: cluster 2024-09-21T02:47:43.958399+0000 mgr.a (mgr.14388) 11827 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:46.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:46.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:46.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:47.461 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:47.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:47.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:47.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:47.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:47 smithi044 bash[22676]: cluster 2024-09-21T02:47:45.960602+0000 mgr.a (mgr.14388) 11828 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:47 smithi179 bash[23186]: cluster 2024-09-21T02:47:45.960602+0000 mgr.a (mgr.14388) 11828 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:47 smithi049 bash[23528]: cluster 2024-09-21T02:47:45.960602+0000 mgr.a (mgr.14388) 11828 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:48 smithi044 bash[22676]: audit 2024-09-21T02:47:47.030426+0000 mgr.a (mgr.14388) 11829 : audit [DBG] from='client.259215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:48 smithi179 bash[23186]: audit 2024-09-21T02:47:47.030426+0000 mgr.a (mgr.14388) 11829 : audit [DBG] from='client.259215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:48 smithi049 bash[23528]: audit 2024-09-21T02:47:47.030426+0000 mgr.a (mgr.14388) 11829 : audit [DBG] from='client.259215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:49 smithi044 bash[22676]: cluster 2024-09-21T02:47:47.961666+0000 mgr.a (mgr.14388) 11830 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:49 smithi044 bash[22676]: audit 2024-09-21T02:47:48.134673+0000 mon.a (mon.0) 9681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:49 smithi044 bash[22676]: audit 2024-09-21T02:47:48.143753+0000 mon.a (mon.0) 9682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:49 smithi044 bash[22676]: audit 2024-09-21T02:47:48.154307+0000 mon.a (mon.0) 9683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:49 smithi179 bash[23186]: cluster 2024-09-21T02:47:47.961666+0000 mgr.a (mgr.14388) 11830 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:49 smithi179 bash[23186]: audit 2024-09-21T02:47:48.134673+0000 mon.a (mon.0) 9681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:49 smithi179 bash[23186]: audit 2024-09-21T02:47:48.143753+0000 mon.a (mon.0) 9682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:49 smithi179 bash[23186]: audit 2024-09-21T02:47:48.154307+0000 mon.a (mon.0) 9683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:49 smithi049 bash[23528]: cluster 2024-09-21T02:47:47.961666+0000 mgr.a (mgr.14388) 11830 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:49 smithi049 bash[23528]: audit 2024-09-21T02:47:48.134673+0000 mon.a (mon.0) 9681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:49 smithi049 bash[23528]: audit 2024-09-21T02:47:48.143753+0000 mon.a (mon.0) 9682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:49 smithi049 bash[23528]: audit 2024-09-21T02:47:48.154307+0000 mon.a (mon.0) 9683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:47:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:51 smithi179 bash[23186]: cluster 2024-09-21T02:47:49.963783+0000 mgr.a (mgr.14388) 11831 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:51 smithi044 bash[22676]: cluster 2024-09-21T02:47:49.963783+0000 mgr.a (mgr.14388) 11831 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:51 smithi049 bash[23528]: cluster 2024-09-21T02:47:49.963783+0000 mgr.a (mgr.14388) 11831 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:52.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:52.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:52.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:53.260 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:53.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:53.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:53.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:53.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:53.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:53 smithi044 bash[22676]: cluster 2024-09-21T02:47:51.964557+0000 mgr.a (mgr.14388) 11832 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:53 smithi179 bash[23186]: cluster 2024-09-21T02:47:51.964557+0000 mgr.a (mgr.14388) 11832 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:53 smithi049 bash[23528]: cluster 2024-09-21T02:47:51.964557+0000 mgr.a (mgr.14388) 11832 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:54.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:54 smithi044 bash[22676]: audit 2024-09-21T02:47:52.798685+0000 mgr.a (mgr.14388) 11833 : audit [DBG] from='client.259293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:54 smithi179 bash[23186]: audit 2024-09-21T02:47:52.798685+0000 mgr.a (mgr.14388) 11833 : audit [DBG] from='client.259293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:54 smithi049 bash[23528]: audit 2024-09-21T02:47:52.798685+0000 mgr.a (mgr.14388) 11833 : audit [DBG] from='client.259293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:55 smithi044 bash[22676]: cluster 2024-09-21T02:47:53.965135+0000 mgr.a (mgr.14388) 11834 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:55 smithi179 bash[23186]: cluster 2024-09-21T02:47:53.965135+0000 mgr.a (mgr.14388) 11834 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:55 smithi049 bash[23528]: cluster 2024-09-21T02:47:53.965135+0000 mgr.a (mgr.14388) 11834 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:57 smithi044 bash[22676]: cluster 2024-09-21T02:47:55.966459+0000 mgr.a (mgr.14388) 11835 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:57 smithi179 bash[23186]: cluster 2024-09-21T02:47:55.966459+0000 mgr.a (mgr.14388) 11835 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:57 smithi049 bash[23528]: cluster 2024-09-21T02:47:55.966459+0000 mgr.a (mgr.14388) 11835 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:47:58.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:47:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:47:58.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:47:59.033 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:47:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:47:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:47:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:47:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:47:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:59 smithi044 bash[22676]: cluster 2024-09-21T02:47:57.967209+0000 mgr.a (mgr.14388) 11836 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:47:59 smithi044 bash[22676]: audit 2024-09-21T02:47:58.597178+0000 mgr.a (mgr.14388) 11837 : audit [DBG] from='client.259371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:59 smithi179 bash[23186]: cluster 2024-09-21T02:47:57.967209+0000 mgr.a (mgr.14388) 11836 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:47:59 smithi179 bash[23186]: audit 2024-09-21T02:47:58.597178+0000 mgr.a (mgr.14388) 11837 : audit [DBG] from='client.259371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:47:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:59 smithi049 bash[23528]: cluster 2024-09-21T02:47:57.967209+0000 mgr.a (mgr.14388) 11836 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:47:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:47:59 smithi049 bash[23528]: audit 2024-09-21T02:47:58.597178+0000 mgr.a (mgr.14388) 11837 : audit [DBG] from='client.259371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:01 smithi044 bash[22676]: cluster 2024-09-21T02:47:59.969485+0000 mgr.a (mgr.14388) 11838 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:01 smithi044 bash[22676]: audit 2024-09-21T02:48:01.144963+0000 mon.a (mon.0) 9684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:01 smithi044 bash[22676]: audit 2024-09-21T02:48:01.153046+0000 mon.a (mon.0) 9685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:01 smithi179 bash[23186]: cluster 2024-09-21T02:47:59.969485+0000 mgr.a (mgr.14388) 11838 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:01 smithi179 bash[23186]: audit 2024-09-21T02:48:01.144963+0000 mon.a (mon.0) 9684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:01 smithi179 bash[23186]: audit 2024-09-21T02:48:01.153046+0000 mon.a (mon.0) 9685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:01 smithi049 bash[23528]: cluster 2024-09-21T02:47:59.969485+0000 mgr.a (mgr.14388) 11838 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:01 smithi049 bash[23528]: audit 2024-09-21T02:48:01.144963+0000 mon.a (mon.0) 9684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:01 smithi049 bash[23528]: audit 2024-09-21T02:48:01.153046+0000 mon.a (mon.0) 9685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:02 smithi044 bash[22676]: audit 2024-09-21T02:48:01.162637+0000 mon.a (mon.0) 9686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:02 smithi044 bash[22676]: audit 2024-09-21T02:48:01.186194+0000 mon.a (mon.0) 9687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:02 smithi044 bash[22676]: audit 2024-09-21T02:48:01.194441+0000 mon.a (mon.0) 9688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:02 smithi044 bash[22676]: audit 2024-09-21T02:48:01.205102+0000 mon.a (mon.0) 9689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:02 smithi179 bash[23186]: audit 2024-09-21T02:48:01.162637+0000 mon.a (mon.0) 9686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:02 smithi179 bash[23186]: audit 2024-09-21T02:48:01.186194+0000 mon.a (mon.0) 9687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:02 smithi179 bash[23186]: audit 2024-09-21T02:48:01.194441+0000 mon.a (mon.0) 9688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:02 smithi179 bash[23186]: audit 2024-09-21T02:48:01.205102+0000 mon.a (mon.0) 9689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:02 smithi049 bash[23528]: audit 2024-09-21T02:48:01.162637+0000 mon.a (mon.0) 9686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:02 smithi049 bash[23528]: audit 2024-09-21T02:48:01.186194+0000 mon.a (mon.0) 9687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:02 smithi049 bash[23528]: audit 2024-09-21T02:48:01.194441+0000 mon.a (mon.0) 9688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:02 smithi049 bash[23528]: audit 2024-09-21T02:48:01.205102+0000 mon.a (mon.0) 9689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:03 smithi044 bash[22676]: cluster 2024-09-21T02:48:01.970238+0000 mgr.a (mgr.14388) 11839 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:03 smithi179 bash[23186]: cluster 2024-09-21T02:48:01.970238+0000 mgr.a (mgr.14388) 11839 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:03 smithi049 bash[23528]: cluster 2024-09-21T02:48:01.970238+0000 mgr.a (mgr.14388) 11839 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:04.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:04.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:04.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:04.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:04.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:05 smithi044 bash[22676]: cluster 2024-09-21T02:48:03.971007+0000 mgr.a (mgr.14388) 11840 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:05 smithi044 bash[22676]: audit 2024-09-21T02:48:04.371951+0000 mgr.a (mgr.14388) 11841 : audit [DBG] from='client.259446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:05 smithi179 bash[23186]: cluster 2024-09-21T02:48:03.971007+0000 mgr.a (mgr.14388) 11840 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:05 smithi179 bash[23186]: audit 2024-09-21T02:48:04.371951+0000 mgr.a (mgr.14388) 11841 : audit [DBG] from='client.259446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:05 smithi049 bash[23528]: cluster 2024-09-21T02:48:03.971007+0000 mgr.a (mgr.14388) 11840 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:05 smithi049 bash[23528]: audit 2024-09-21T02:48:04.371951+0000 mgr.a (mgr.14388) 11841 : audit [DBG] from='client.259446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:07 smithi044 bash[22676]: cluster 2024-09-21T02:48:05.973342+0000 mgr.a (mgr.14388) 11842 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:07 smithi179 bash[23186]: cluster 2024-09-21T02:48:05.973342+0000 mgr.a (mgr.14388) 11842 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:07 smithi049 bash[23528]: cluster 2024-09-21T02:48:05.973342+0000 mgr.a (mgr.14388) 11842 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:09 smithi044 bash[22676]: cluster 2024-09-21T02:48:07.974135+0000 mgr.a (mgr.14388) 11843 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:09 smithi044 bash[22676]: audit 2024-09-21T02:48:08.313772+0000 mon.a (mon.0) 9690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:09 smithi044 bash[22676]: audit 2024-09-21T02:48:08.322824+0000 mon.a (mon.0) 9691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:09 smithi044 bash[22676]: audit 2024-09-21T02:48:08.333746+0000 mon.a (mon.0) 9692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:09 smithi179 bash[23186]: cluster 2024-09-21T02:48:07.974135+0000 mgr.a (mgr.14388) 11843 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:09 smithi179 bash[23186]: audit 2024-09-21T02:48:08.313772+0000 mon.a (mon.0) 9690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:09 smithi179 bash[23186]: audit 2024-09-21T02:48:08.322824+0000 mon.a (mon.0) 9691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:09 smithi179 bash[23186]: audit 2024-09-21T02:48:08.333746+0000 mon.a (mon.0) 9692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:09 smithi049 bash[23528]: cluster 2024-09-21T02:48:07.974135+0000 mgr.a (mgr.14388) 11843 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:09 smithi049 bash[23528]: audit 2024-09-21T02:48:08.313772+0000 mon.a (mon.0) 9690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:09 smithi049 bash[23528]: audit 2024-09-21T02:48:08.322824+0000 mon.a (mon.0) 9691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:09 smithi049 bash[23528]: audit 2024-09-21T02:48:08.333746+0000 mon.a (mon.0) 9692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:09.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:09.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:09.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:10.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:10.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:10.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:10.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:10.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:11 smithi179 bash[23186]: cluster 2024-09-21T02:48:09.975750+0000 mgr.a (mgr.14388) 11844 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:11 smithi179 bash[23186]: audit 2024-09-21T02:48:10.151088+0000 mgr.a (mgr.14388) 11845 : audit [DBG] from='client.259524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:11 smithi044 bash[22676]: cluster 2024-09-21T02:48:09.975750+0000 mgr.a (mgr.14388) 11844 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:11 smithi044 bash[22676]: audit 2024-09-21T02:48:10.151088+0000 mgr.a (mgr.14388) 11845 : audit [DBG] from='client.259524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:11 smithi049 bash[23528]: cluster 2024-09-21T02:48:09.975750+0000 mgr.a (mgr.14388) 11844 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:11 smithi049 bash[23528]: audit 2024-09-21T02:48:10.151088+0000 mgr.a (mgr.14388) 11845 : audit [DBG] from='client.259524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:13.570 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:13 smithi044 bash[22676]: cluster 2024-09-21T02:48:11.976609+0000 mgr.a (mgr.14388) 11846 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:13 smithi179 bash[23186]: cluster 2024-09-21T02:48:11.976609+0000 mgr.a (mgr.14388) 11846 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:13 smithi049 bash[23528]: cluster 2024-09-21T02:48:11.976609+0000 mgr.a (mgr.14388) 11846 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:15.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:15.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:15.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:15 smithi044 bash[22676]: cluster 2024-09-21T02:48:13.977391+0000 mgr.a (mgr.14388) 11847 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:15 smithi179 bash[23186]: cluster 2024-09-21T02:48:13.977391+0000 mgr.a (mgr.14388) 11847 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:15 smithi049 bash[23528]: cluster 2024-09-21T02:48:13.977391+0000 mgr.a (mgr.14388) 11847 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:16.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:16.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:17 smithi044 bash[22676]: audit 2024-09-21T02:48:15.902443+0000 mgr.a (mgr.14388) 11848 : audit [DBG] from='client.259599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:17 smithi044 bash[22676]: cluster 2024-09-21T02:48:15.978845+0000 mgr.a (mgr.14388) 11849 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:17 smithi179 bash[23186]: audit 2024-09-21T02:48:15.902443+0000 mgr.a (mgr.14388) 11848 : audit [DBG] from='client.259599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:17 smithi179 bash[23186]: cluster 2024-09-21T02:48:15.978845+0000 mgr.a (mgr.14388) 11849 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:17 smithi049 bash[23528]: audit 2024-09-21T02:48:15.902443+0000 mgr.a (mgr.14388) 11848 : audit [DBG] from='client.259599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:17 smithi049 bash[23528]: cluster 2024-09-21T02:48:15.978845+0000 mgr.a (mgr.14388) 11849 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:18.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:48:18 smithi044 bash[22930]: debug 2024-09-21T02:48:18.488+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:48:18.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:48:18 smithi044 bash[22930]: debug 2024-09-21T02:48:18.488+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:48:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:18 smithi044 bash[22676]: audit 2024-09-21T02:48:17.684796+0000 mon.a (mon.0) 9693 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:48:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:18 smithi044 bash[22676]: audit 2024-09-21T02:48:17.692596+0000 mon.a (mon.0) 9694 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:48:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:18 smithi044 bash[22676]: audit 2024-09-21T02:48:17.694697+0000 mon.a (mon.0) 9695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:48:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:18 smithi044 bash[22676]: audit 2024-09-21T02:48:17.706583+0000 mon.a (mon.0) 9696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:18 smithi044 bash[22676]: audit 2024-09-21T02:48:17.712947+0000 mon.a (mon.0) 9697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:48:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:18 smithi179 bash[23186]: audit 2024-09-21T02:48:17.684796+0000 mon.a (mon.0) 9693 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:48:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:18 smithi179 bash[23186]: audit 2024-09-21T02:48:17.692596+0000 mon.a (mon.0) 9694 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:48:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:18 smithi179 bash[23186]: audit 2024-09-21T02:48:17.694697+0000 mon.a (mon.0) 9695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:48:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:18 smithi179 bash[23186]: audit 2024-09-21T02:48:17.706583+0000 mon.a (mon.0) 9696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:18 smithi179 bash[23186]: audit 2024-09-21T02:48:17.712947+0000 mon.a (mon.0) 9697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:48:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:18 smithi049 bash[23528]: audit 2024-09-21T02:48:17.684796+0000 mon.a (mon.0) 9693 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:48:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:18 smithi049 bash[23528]: audit 2024-09-21T02:48:17.692596+0000 mon.a (mon.0) 9694 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:48:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:18 smithi049 bash[23528]: audit 2024-09-21T02:48:17.694697+0000 mon.a (mon.0) 9695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:48:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:18 smithi049 bash[23528]: audit 2024-09-21T02:48:17.706583+0000 mon.a (mon.0) 9696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:18 smithi049 bash[23528]: audit 2024-09-21T02:48:17.712947+0000 mon.a (mon.0) 9697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:48:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:19 smithi044 bash[22676]: audit 2024-09-21T02:48:17.715587+0000 mgr.a (mgr.14388) 11850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:48:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:19 smithi044 bash[22676]: cluster 2024-09-21T02:48:17.979519+0000 mgr.a (mgr.14388) 11851 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:19 smithi044 bash[22676]: audit 2024-09-21T02:48:18.490082+0000 mgr.a (mgr.14388) 11852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:48:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:19 smithi044 bash[22676]: cephadm 2024-09-21T02:48:18.491363+0000 mgr.a (mgr.14388) 11853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:48:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:19 smithi179 bash[23186]: audit 2024-09-21T02:48:17.715587+0000 mgr.a (mgr.14388) 11850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:48:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:19 smithi179 bash[23186]: cluster 2024-09-21T02:48:17.979519+0000 mgr.a (mgr.14388) 11851 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:19 smithi179 bash[23186]: audit 2024-09-21T02:48:18.490082+0000 mgr.a (mgr.14388) 11852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:48:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:19 smithi179 bash[23186]: cephadm 2024-09-21T02:48:18.491363+0000 mgr.a (mgr.14388) 11853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:48:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:19 smithi049 bash[23528]: audit 2024-09-21T02:48:17.715587+0000 mgr.a (mgr.14388) 11850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:48:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:19 smithi049 bash[23528]: cluster 2024-09-21T02:48:17.979519+0000 mgr.a (mgr.14388) 11851 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:19 smithi049 bash[23528]: audit 2024-09-21T02:48:18.490082+0000 mgr.a (mgr.14388) 11852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:48:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:19 smithi049 bash[23528]: cephadm 2024-09-21T02:48:18.491363+0000 mgr.a (mgr.14388) 11853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:48:21.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:21.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:21.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:21 smithi044 bash[22676]: cluster 2024-09-21T02:48:19.981762+0000 mgr.a (mgr.14388) 11854 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:21 smithi179 bash[23186]: cluster 2024-09-21T02:48:19.981762+0000 mgr.a (mgr.14388) 11854 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:21 smithi049 bash[23528]: cluster 2024-09-21T02:48:19.981762+0000 mgr.a (mgr.14388) 11854 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:22.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:22.096 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:22 smithi044 bash[22676]: audit 2024-09-21T02:48:21.364091+0000 mon.a (mon.0) 9698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:22 smithi044 bash[22676]: audit 2024-09-21T02:48:21.370922+0000 mon.a (mon.0) 9699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:22 smithi044 bash[22676]: audit 2024-09-21T02:48:21.377841+0000 mon.a (mon.0) 9700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:22 smithi044 bash[22676]: audit 2024-09-21T02:48:21.397224+0000 mon.a (mon.0) 9701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:22 smithi044 bash[22676]: audit 2024-09-21T02:48:21.402532+0000 mon.a (mon.0) 9702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:22 smithi044 bash[22676]: audit 2024-09-21T02:48:21.407817+0000 mon.a (mon.0) 9703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:22 smithi179 bash[23186]: audit 2024-09-21T02:48:21.364091+0000 mon.a (mon.0) 9698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:22 smithi179 bash[23186]: audit 2024-09-21T02:48:21.370922+0000 mon.a (mon.0) 9699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:22 smithi179 bash[23186]: audit 2024-09-21T02:48:21.377841+0000 mon.a (mon.0) 9700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:22 smithi179 bash[23186]: audit 2024-09-21T02:48:21.397224+0000 mon.a (mon.0) 9701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:22 smithi179 bash[23186]: audit 2024-09-21T02:48:21.402532+0000 mon.a (mon.0) 9702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:22 smithi179 bash[23186]: audit 2024-09-21T02:48:21.407817+0000 mon.a (mon.0) 9703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:22 smithi049 bash[23528]: audit 2024-09-21T02:48:21.364091+0000 mon.a (mon.0) 9698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:22 smithi049 bash[23528]: audit 2024-09-21T02:48:21.370922+0000 mon.a (mon.0) 9699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:22 smithi049 bash[23528]: audit 2024-09-21T02:48:21.377841+0000 mon.a (mon.0) 9700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:22 smithi049 bash[23528]: audit 2024-09-21T02:48:21.397224+0000 mon.a (mon.0) 9701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:22 smithi049 bash[23528]: audit 2024-09-21T02:48:21.402532+0000 mon.a (mon.0) 9702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:22 smithi049 bash[23528]: audit 2024-09-21T02:48:21.407817+0000 mon.a (mon.0) 9703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:23 smithi044 bash[22676]: audit 2024-09-21T02:48:21.669497+0000 mgr.a (mgr.14388) 11855 : audit [DBG] from='client.259779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:23 smithi044 bash[22676]: cluster 2024-09-21T02:48:21.982260+0000 mgr.a (mgr.14388) 11856 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:23 smithi179 bash[23186]: audit 2024-09-21T02:48:21.669497+0000 mgr.a (mgr.14388) 11855 : audit [DBG] from='client.259779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:23 smithi179 bash[23186]: cluster 2024-09-21T02:48:21.982260+0000 mgr.a (mgr.14388) 11856 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:23 smithi049 bash[23528]: audit 2024-09-21T02:48:21.669497+0000 mgr.a (mgr.14388) 11855 : audit [DBG] from='client.259779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:23 smithi049 bash[23528]: cluster 2024-09-21T02:48:21.982260+0000 mgr.a (mgr.14388) 11856 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:25 smithi044 bash[22676]: cluster 2024-09-21T02:48:23.983137+0000 mgr.a (mgr.14388) 11857 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:25 smithi179 bash[23186]: cluster 2024-09-21T02:48:23.983137+0000 mgr.a (mgr.14388) 11857 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:25 smithi049 bash[23528]: cluster 2024-09-21T02:48:23.983137+0000 mgr.a (mgr.14388) 11857 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:27.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:27.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:27.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:27 smithi044 bash[22676]: cluster 2024-09-21T02:48:25.985385+0000 mgr.a (mgr.14388) 11858 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:27 smithi179 bash[23186]: cluster 2024-09-21T02:48:25.985385+0000 mgr.a (mgr.14388) 11858 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:27 smithi049 bash[23528]: cluster 2024-09-21T02:48:25.985385+0000 mgr.a (mgr.14388) 11858 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:27.869 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:27.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:27.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:27.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:27.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:28 smithi044 bash[22676]: audit 2024-09-21T02:48:27.431213+0000 mgr.a (mgr.14388) 11859 : audit [DBG] from='client.259854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:28 smithi179 bash[23186]: audit 2024-09-21T02:48:27.431213+0000 mgr.a (mgr.14388) 11859 : audit [DBG] from='client.259854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:28 smithi049 bash[23528]: audit 2024-09-21T02:48:27.431213+0000 mgr.a (mgr.14388) 11859 : audit [DBG] from='client.259854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:29 smithi049 bash[23528]: cluster 2024-09-21T02:48:27.986308+0000 mgr.a (mgr.14388) 11860 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:29 smithi049 bash[23528]: audit 2024-09-21T02:48:28.527661+0000 mon.a (mon.0) 9704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:29 smithi049 bash[23528]: audit 2024-09-21T02:48:28.537413+0000 mon.a (mon.0) 9705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:29 smithi049 bash[23528]: audit 2024-09-21T02:48:28.549072+0000 mon.a (mon.0) 9706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:29 smithi044 bash[22676]: cluster 2024-09-21T02:48:27.986308+0000 mgr.a (mgr.14388) 11860 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:29 smithi044 bash[22676]: audit 2024-09-21T02:48:28.527661+0000 mon.a (mon.0) 9704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:29 smithi044 bash[22676]: audit 2024-09-21T02:48:28.537413+0000 mon.a (mon.0) 9705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:29 smithi044 bash[22676]: audit 2024-09-21T02:48:28.549072+0000 mon.a (mon.0) 9706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:29 smithi179 bash[23186]: cluster 2024-09-21T02:48:27.986308+0000 mgr.a (mgr.14388) 11860 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:29 smithi179 bash[23186]: audit 2024-09-21T02:48:28.527661+0000 mon.a (mon.0) 9704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:29 smithi179 bash[23186]: audit 2024-09-21T02:48:28.537413+0000 mon.a (mon.0) 9705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:29 smithi179 bash[23186]: audit 2024-09-21T02:48:28.549072+0000 mon.a (mon.0) 9706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:31 smithi179 bash[23186]: cluster 2024-09-21T02:48:29.988590+0000 mgr.a (mgr.14388) 11861 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:31 smithi049 bash[23528]: cluster 2024-09-21T02:48:29.988590+0000 mgr.a (mgr.14388) 11861 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:31 smithi044 bash[22676]: cluster 2024-09-21T02:48:29.988590+0000 mgr.a (mgr.14388) 11861 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:48:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:33.663 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:33.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:33.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:33.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:33.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:33 smithi049 bash[23528]: cluster 2024-09-21T02:48:31.989405+0000 mgr.a (mgr.14388) 11862 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:33.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:33 smithi044 bash[22676]: cluster 2024-09-21T02:48:31.989405+0000 mgr.a (mgr.14388) 11862 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:33 smithi179 bash[23186]: cluster 2024-09-21T02:48:31.989405+0000 mgr.a (mgr.14388) 11862 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:34 smithi049 bash[23528]: audit 2024-09-21T02:48:33.203983+0000 mgr.a (mgr.14388) 11863 : audit [DBG] from='client.259932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:34.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:34 smithi044 bash[22676]: audit 2024-09-21T02:48:33.203983+0000 mgr.a (mgr.14388) 11863 : audit [DBG] from='client.259932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:34 smithi179 bash[23186]: audit 2024-09-21T02:48:33.203983+0000 mgr.a (mgr.14388) 11863 : audit [DBG] from='client.259932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:35 smithi044 bash[22676]: cluster 2024-09-21T02:48:33.990251+0000 mgr.a (mgr.14388) 11864 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:35 smithi049 bash[23528]: cluster 2024-09-21T02:48:33.990251+0000 mgr.a (mgr.14388) 11864 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:35 smithi179 bash[23186]: cluster 2024-09-21T02:48:33.990251+0000 mgr.a (mgr.14388) 11864 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:37 smithi049 bash[23528]: cluster 2024-09-21T02:48:35.992557+0000 mgr.a (mgr.14388) 11865 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:37 smithi044 bash[22676]: cluster 2024-09-21T02:48:35.992557+0000 mgr.a (mgr.14388) 11865 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:37 smithi179 bash[23186]: cluster 2024-09-21T02:48:35.992557+0000 mgr.a (mgr.14388) 11865 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:38.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:39.431 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:39.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:39.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:39.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:39.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:39 smithi044 bash[22676]: cluster 2024-09-21T02:48:37.993363+0000 mgr.a (mgr.14388) 11866 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:39 smithi179 bash[23186]: cluster 2024-09-21T02:48:37.993363+0000 mgr.a (mgr.14388) 11866 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:39 smithi049 bash[23528]: cluster 2024-09-21T02:48:37.993363+0000 mgr.a (mgr.14388) 11866 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:40 smithi044 bash[22676]: audit 2024-09-21T02:48:39.005594+0000 mgr.a (mgr.14388) 11867 : audit [DBG] from='client.260010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:40 smithi179 bash[23186]: audit 2024-09-21T02:48:39.005594+0000 mgr.a (mgr.14388) 11867 : audit [DBG] from='client.260010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:40 smithi049 bash[23528]: audit 2024-09-21T02:48:39.005594+0000 mgr.a (mgr.14388) 11867 : audit [DBG] from='client.260010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:41 smithi044 bash[22676]: cluster 2024-09-21T02:48:39.995540+0000 mgr.a (mgr.14388) 11868 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:41 smithi179 bash[23186]: cluster 2024-09-21T02:48:39.995540+0000 mgr.a (mgr.14388) 11868 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:41 smithi049 bash[23528]: cluster 2024-09-21T02:48:39.995540+0000 mgr.a (mgr.14388) 11868 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:48:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:42 smithi044 bash[22676]: audit 2024-09-21T02:48:41.567966+0000 mon.a (mon.0) 9707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:42 smithi044 bash[22676]: audit 2024-09-21T02:48:41.579783+0000 mon.a (mon.0) 9708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:42 smithi044 bash[22676]: audit 2024-09-21T02:48:41.586128+0000 mon.a (mon.0) 9709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:42 smithi044 bash[22676]: audit 2024-09-21T02:48:41.611625+0000 mon.a (mon.0) 9710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:42 smithi044 bash[22676]: audit 2024-09-21T02:48:41.618781+0000 mon.a (mon.0) 9711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:42 smithi044 bash[22676]: audit 2024-09-21T02:48:41.629136+0000 mon.a (mon.0) 9712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:42 smithi179 bash[23186]: audit 2024-09-21T02:48:41.567966+0000 mon.a (mon.0) 9707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:42 smithi179 bash[23186]: audit 2024-09-21T02:48:41.579783+0000 mon.a (mon.0) 9708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:42 smithi179 bash[23186]: audit 2024-09-21T02:48:41.586128+0000 mon.a (mon.0) 9709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:42 smithi179 bash[23186]: audit 2024-09-21T02:48:41.611625+0000 mon.a (mon.0) 9710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:42 smithi179 bash[23186]: audit 2024-09-21T02:48:41.618781+0000 mon.a (mon.0) 9711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:42 smithi179 bash[23186]: audit 2024-09-21T02:48:41.629136+0000 mon.a (mon.0) 9712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:42 smithi049 bash[23528]: audit 2024-09-21T02:48:41.567966+0000 mon.a (mon.0) 9707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:42 smithi049 bash[23528]: audit 2024-09-21T02:48:41.579783+0000 mon.a (mon.0) 9708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:42 smithi049 bash[23528]: audit 2024-09-21T02:48:41.586128+0000 mon.a (mon.0) 9709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:42 smithi049 bash[23528]: audit 2024-09-21T02:48:41.611625+0000 mon.a (mon.0) 9710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:42 smithi049 bash[23528]: audit 2024-09-21T02:48:41.618781+0000 mon.a (mon.0) 9711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:42 smithi049 bash[23528]: audit 2024-09-21T02:48:41.629136+0000 mon.a (mon.0) 9712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:43 smithi044 bash[22676]: cluster 2024-09-21T02:48:41.996310+0000 mgr.a (mgr.14388) 11869 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:43 smithi179 bash[23186]: cluster 2024-09-21T02:48:41.996310+0000 mgr.a (mgr.14388) 11869 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:43 smithi049 bash[23528]: cluster 2024-09-21T02:48:41.996310+0000 mgr.a (mgr.14388) 11869 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:44.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:44.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:44.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:45.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:45.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:45.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:45.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:45.195 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:45 smithi044 bash[22676]: cluster 2024-09-21T02:48:43.997205+0000 mgr.a (mgr.14388) 11870 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:45 smithi179 bash[23186]: cluster 2024-09-21T02:48:43.997205+0000 mgr.a (mgr.14388) 11870 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:45 smithi049 bash[23528]: cluster 2024-09-21T02:48:43.997205+0000 mgr.a (mgr.14388) 11870 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:46.908 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:46 smithi049 bash[23528]: audit 2024-09-21T02:48:44.768104+0000 mgr.a (mgr.14388) 11871 : audit [DBG] from='client.260085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:46 smithi044 bash[22676]: audit 2024-09-21T02:48:44.768104+0000 mgr.a (mgr.14388) 11871 : audit [DBG] from='client.260085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:46 smithi179 bash[23186]: audit 2024-09-21T02:48:44.768104+0000 mgr.a (mgr.14388) 11871 : audit [DBG] from='client.260085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:47 smithi044 bash[22676]: cluster 2024-09-21T02:48:45.999918+0000 mgr.a (mgr.14388) 11872 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:47 smithi179 bash[23186]: cluster 2024-09-21T02:48:45.999918+0000 mgr.a (mgr.14388) 11872 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:47 smithi049 bash[23528]: cluster 2024-09-21T02:48:45.999918+0000 mgr.a (mgr.14388) 11872 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:49 smithi044 bash[22676]: cluster 2024-09-21T02:48:48.000689+0000 mgr.a (mgr.14388) 11873 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:48:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:49 smithi044 bash[22676]: audit 2024-09-21T02:48:48.741473+0000 mon.a (mon.0) 9713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:49 smithi044 bash[22676]: audit 2024-09-21T02:48:48.750145+0000 mon.a (mon.0) 9714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:49 smithi044 bash[22676]: audit 2024-09-21T02:48:48.760526+0000 mon.a (mon.0) 9715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:49 smithi179 bash[23186]: cluster 2024-09-21T02:48:48.000689+0000 mgr.a (mgr.14388) 11873 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:48:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:49 smithi179 bash[23186]: audit 2024-09-21T02:48:48.741473+0000 mon.a (mon.0) 9713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:49 smithi179 bash[23186]: audit 2024-09-21T02:48:48.750145+0000 mon.a (mon.0) 9714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:49 smithi179 bash[23186]: audit 2024-09-21T02:48:48.760526+0000 mon.a (mon.0) 9715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:49 smithi049 bash[23528]: cluster 2024-09-21T02:48:48.000689+0000 mgr.a (mgr.14388) 11873 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:48:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:49 smithi049 bash[23528]: audit 2024-09-21T02:48:48.741473+0000 mon.a (mon.0) 9713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:49 smithi049 bash[23528]: audit 2024-09-21T02:48:48.750145+0000 mon.a (mon.0) 9714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:49 smithi049 bash[23528]: audit 2024-09-21T02:48:48.760526+0000 mon.a (mon.0) 9715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:48:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:50.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:50.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:50.986 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:50.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:51 smithi049 bash[23528]: cluster 2024-09-21T02:48:50.002739+0000 mgr.a (mgr.14388) 11874 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:51 smithi049 bash[23528]: audit 2024-09-21T02:48:50.533542+0000 mgr.a (mgr.14388) 11875 : audit [DBG] from='client.260160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:51 smithi044 bash[22676]: cluster 2024-09-21T02:48:50.002739+0000 mgr.a (mgr.14388) 11874 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:51 smithi044 bash[22676]: audit 2024-09-21T02:48:50.533542+0000 mgr.a (mgr.14388) 11875 : audit [DBG] from='client.260160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:51 smithi179 bash[23186]: cluster 2024-09-21T02:48:50.002739+0000 mgr.a (mgr.14388) 11874 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:51 smithi179 bash[23186]: audit 2024-09-21T02:48:50.533542+0000 mgr.a (mgr.14388) 11875 : audit [DBG] from='client.260160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:53.920 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:53 smithi049 bash[23528]: cluster 2024-09-21T02:48:52.003642+0000 mgr.a (mgr.14388) 11876 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:48:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:53 smithi044 bash[22676]: cluster 2024-09-21T02:48:52.003642+0000 mgr.a (mgr.14388) 11876 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:48:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:53 smithi179 bash[23186]: cluster 2024-09-21T02:48:52.003642+0000 mgr.a (mgr.14388) 11876 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:48:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:55 smithi044 bash[22676]: cluster 2024-09-21T02:48:54.004204+0000 mgr.a (mgr.14388) 11877 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:55.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:48:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:48:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:48:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:55 smithi179 bash[23186]: cluster 2024-09-21T02:48:54.004204+0000 mgr.a (mgr.14388) 11877 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:55 smithi049 bash[23528]: cluster 2024-09-21T02:48:54.004204+0000 mgr.a (mgr.14388) 11877 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:48:56.745 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:48:56.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:48:56.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:48:56.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:48:56.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:48:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:57 smithi044 bash[22676]: cluster 2024-09-21T02:48:56.005701+0000 mgr.a (mgr.14388) 11878 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:57 smithi044 bash[22676]: audit 2024-09-21T02:48:56.307103+0000 mgr.a (mgr.14388) 11879 : audit [DBG] from='client.260235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:57 smithi179 bash[23186]: cluster 2024-09-21T02:48:56.005701+0000 mgr.a (mgr.14388) 11878 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:57 smithi179 bash[23186]: audit 2024-09-21T02:48:56.307103+0000 mgr.a (mgr.14388) 11879 : audit [DBG] from='client.260235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:57 smithi049 bash[23528]: cluster 2024-09-21T02:48:56.005701+0000 mgr.a (mgr.14388) 11878 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:48:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:57 smithi049 bash[23528]: audit 2024-09-21T02:48:56.307103+0000 mgr.a (mgr.14388) 11879 : audit [DBG] from='client.260235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:48:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:48:59 smithi044 bash[22676]: cluster 2024-09-21T02:48:58.006577+0000 mgr.a (mgr.14388) 11880 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:48:59 smithi179 bash[23186]: cluster 2024-09-21T02:48:58.006577+0000 mgr.a (mgr.14388) 11880 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:48:59 smithi049 bash[23528]: cluster 2024-09-21T02:48:58.006577+0000 mgr.a (mgr.14388) 11880 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:01 smithi044 bash[22676]: cluster 2024-09-21T02:49:00.008709+0000 mgr.a (mgr.14388) 11881 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:01 smithi179 bash[23186]: cluster 2024-09-21T02:49:00.008709+0000 mgr.a (mgr.14388) 11881 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:01 smithi049 bash[23528]: cluster 2024-09-21T02:49:00.008709+0000 mgr.a (mgr.14388) 11881 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:02.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:02.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:02.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:02.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:02.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: audit 2024-09-21T02:49:01.774332+0000 mon.a (mon.0) 9716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: audit 2024-09-21T02:49:01.781816+0000 mon.a (mon.0) 9717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: audit 2024-09-21T02:49:01.790583+0000 mon.a (mon.0) 9718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: audit 2024-09-21T02:49:01.808957+0000 mon.a (mon.0) 9719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: audit 2024-09-21T02:49:01.816765+0000 mon.a (mon.0) 9720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: audit 2024-09-21T02:49:01.827188+0000 mon.a (mon.0) 9721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: cluster 2024-09-21T02:49:02.009444+0000 mgr.a (mgr.14388) 11882 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:02 smithi049 bash[23528]: audit 2024-09-21T02:49:02.090171+0000 mgr.a (mgr.14388) 11883 : audit [DBG] from='client.260313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: audit 2024-09-21T02:49:01.774332+0000 mon.a (mon.0) 9716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: audit 2024-09-21T02:49:01.781816+0000 mon.a (mon.0) 9717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: audit 2024-09-21T02:49:01.790583+0000 mon.a (mon.0) 9718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: audit 2024-09-21T02:49:01.808957+0000 mon.a (mon.0) 9719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: audit 2024-09-21T02:49:01.816765+0000 mon.a (mon.0) 9720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: audit 2024-09-21T02:49:01.827188+0000 mon.a (mon.0) 9721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: cluster 2024-09-21T02:49:02.009444+0000 mgr.a (mgr.14388) 11882 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:02 smithi044 bash[22676]: audit 2024-09-21T02:49:02.090171+0000 mgr.a (mgr.14388) 11883 : audit [DBG] from='client.260313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: audit 2024-09-21T02:49:01.774332+0000 mon.a (mon.0) 9716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: audit 2024-09-21T02:49:01.781816+0000 mon.a (mon.0) 9717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: audit 2024-09-21T02:49:01.790583+0000 mon.a (mon.0) 9718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: audit 2024-09-21T02:49:01.808957+0000 mon.a (mon.0) 9719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: audit 2024-09-21T02:49:01.816765+0000 mon.a (mon.0) 9720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: audit 2024-09-21T02:49:01.827188+0000 mon.a (mon.0) 9721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: cluster 2024-09-21T02:49:02.009444+0000 mgr.a (mgr.14388) 11882 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:02 smithi179 bash[23186]: audit 2024-09-21T02:49:02.090171+0000 mgr.a (mgr.14388) 11883 : audit [DBG] from='client.260313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:05 smithi044 bash[22676]: cluster 2024-09-21T02:49:04.010475+0000 mgr.a (mgr.14388) 11884 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:05 smithi179 bash[23186]: cluster 2024-09-21T02:49:04.010475+0000 mgr.a (mgr.14388) 11884 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:05 smithi049 bash[23528]: cluster 2024-09-21T02:49:04.010475+0000 mgr.a (mgr.14388) 11884 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:07 smithi044 bash[22676]: cluster 2024-09-21T02:49:06.012759+0000 mgr.a (mgr.14388) 11885 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:07 smithi179 bash[23186]: cluster 2024-09-21T02:49:06.012759+0000 mgr.a (mgr.14388) 11885 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:07.518 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:07 smithi049 bash[23528]: cluster 2024-09-21T02:49:06.012759+0000 mgr.a (mgr.14388) 11885 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:07.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:07.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:07.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:08.320 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:08.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:08.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:08.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:08.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:09 smithi049 bash[23528]: audit 2024-09-21T02:49:07.884201+0000 mgr.a (mgr.14388) 11886 : audit [DBG] from='client.260388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:09 smithi049 bash[23528]: cluster 2024-09-21T02:49:08.013267+0000 mgr.a (mgr.14388) 11887 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:09 smithi049 bash[23528]: audit 2024-09-21T02:49:08.944296+0000 mon.a (mon.0) 9722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:09 smithi049 bash[23528]: audit 2024-09-21T02:49:08.953496+0000 mon.a (mon.0) 9723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:09 smithi049 bash[23528]: audit 2024-09-21T02:49:08.964173+0000 mon.a (mon.0) 9724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:09 smithi044 bash[22676]: audit 2024-09-21T02:49:07.884201+0000 mgr.a (mgr.14388) 11886 : audit [DBG] from='client.260388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:09 smithi044 bash[22676]: cluster 2024-09-21T02:49:08.013267+0000 mgr.a (mgr.14388) 11887 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:09 smithi044 bash[22676]: audit 2024-09-21T02:49:08.944296+0000 mon.a (mon.0) 9722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:09 smithi044 bash[22676]: audit 2024-09-21T02:49:08.953496+0000 mon.a (mon.0) 9723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:09 smithi044 bash[22676]: audit 2024-09-21T02:49:08.964173+0000 mon.a (mon.0) 9724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:09 smithi179 bash[23186]: audit 2024-09-21T02:49:07.884201+0000 mgr.a (mgr.14388) 11886 : audit [DBG] from='client.260388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:09 smithi179 bash[23186]: cluster 2024-09-21T02:49:08.013267+0000 mgr.a (mgr.14388) 11887 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:09 smithi179 bash[23186]: audit 2024-09-21T02:49:08.944296+0000 mon.a (mon.0) 9722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:09 smithi179 bash[23186]: audit 2024-09-21T02:49:08.953496+0000 mon.a (mon.0) 9723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:09 smithi179 bash[23186]: audit 2024-09-21T02:49:08.964173+0000 mon.a (mon.0) 9724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:11.234 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:11 smithi179 bash[23186]: cluster 2024-09-21T02:49:10.015474+0000 mgr.a (mgr.14388) 11888 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:11 smithi044 bash[22676]: cluster 2024-09-21T02:49:10.015474+0000 mgr.a (mgr.14388) 11888 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:11 smithi049 bash[23528]: cluster 2024-09-21T02:49:10.015474+0000 mgr.a (mgr.14388) 11888 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:13 smithi044 bash[22676]: cluster 2024-09-21T02:49:12.016276+0000 mgr.a (mgr.14388) 11889 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:13.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:13.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:13.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:13.340 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:13 smithi179 bash[23186]: cluster 2024-09-21T02:49:12.016276+0000 mgr.a (mgr.14388) 11889 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:13.413 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:13 smithi049 bash[23528]: cluster 2024-09-21T02:49:12.016276+0000 mgr.a (mgr.14388) 11889 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:14.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:14.121 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:14 smithi044 bash[22676]: audit 2024-09-21T02:49:13.655152+0000 mgr.a (mgr.14388) 11890 : audit [DBG] from='client.260463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:14 smithi179 bash[23186]: audit 2024-09-21T02:49:13.655152+0000 mgr.a (mgr.14388) 11890 : audit [DBG] from='client.260463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:14 smithi049 bash[23528]: audit 2024-09-21T02:49:13.655152+0000 mgr.a (mgr.14388) 11890 : audit [DBG] from='client.260463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:15 smithi044 bash[22676]: cluster 2024-09-21T02:49:14.016873+0000 mgr.a (mgr.14388) 11891 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:15 smithi179 bash[23186]: cluster 2024-09-21T02:49:14.016873+0000 mgr.a (mgr.14388) 11891 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:15 smithi049 bash[23528]: cluster 2024-09-21T02:49:14.016873+0000 mgr.a (mgr.14388) 11891 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:17 smithi044 bash[22676]: cluster 2024-09-21T02:49:16.019119+0000 mgr.a (mgr.14388) 11892 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:17 smithi179 bash[23186]: cluster 2024-09-21T02:49:16.019119+0000 mgr.a (mgr.14388) 11892 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:17 smithi049 bash[23528]: cluster 2024-09-21T02:49:16.019119+0000 mgr.a (mgr.14388) 11892 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:19.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:19.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22676]: cluster 2024-09-21T02:49:18.020099+0000 mgr.a (mgr.14388) 11893 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22676]: audit 2024-09-21T02:49:18.551871+0000 mon.a (mon.0) 9725 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:49:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22676]: audit 2024-09-21T02:49:18.559327+0000 mon.a (mon.0) 9726 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:49:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22676]: audit 2024-09-21T02:49:18.561373+0000 mon.a (mon.0) 9727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:49:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22676]: audit 2024-09-21T02:49:18.572918+0000 mon.a (mon.0) 9728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22676]: audit 2024-09-21T02:49:18.579295+0000 mon.a (mon.0) 9729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:49:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22676]: audit 2024-09-21T02:49:18.581753+0000 mgr.a (mgr.14388) 11894 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:49:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:19 smithi179 bash[23186]: cluster 2024-09-21T02:49:18.020099+0000 mgr.a (mgr.14388) 11893 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:19 smithi179 bash[23186]: audit 2024-09-21T02:49:18.551871+0000 mon.a (mon.0) 9725 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:49:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:19 smithi179 bash[23186]: audit 2024-09-21T02:49:18.559327+0000 mon.a (mon.0) 9726 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:49:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:19 smithi179 bash[23186]: audit 2024-09-21T02:49:18.561373+0000 mon.a (mon.0) 9727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:49:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:19 smithi179 bash[23186]: audit 2024-09-21T02:49:18.572918+0000 mon.a (mon.0) 9728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:19 smithi179 bash[23186]: audit 2024-09-21T02:49:18.579295+0000 mon.a (mon.0) 9729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:49:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:19 smithi179 bash[23186]: audit 2024-09-21T02:49:18.581753+0000 mgr.a (mgr.14388) 11894 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:49:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:19 smithi049 bash[23528]: cluster 2024-09-21T02:49:18.020099+0000 mgr.a (mgr.14388) 11893 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:19 smithi049 bash[23528]: audit 2024-09-21T02:49:18.551871+0000 mon.a (mon.0) 9725 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:49:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:19 smithi049 bash[23528]: audit 2024-09-21T02:49:18.559327+0000 mon.a (mon.0) 9726 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:49:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:19 smithi049 bash[23528]: audit 2024-09-21T02:49:18.561373+0000 mon.a (mon.0) 9727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:49:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:19 smithi049 bash[23528]: audit 2024-09-21T02:49:18.572918+0000 mon.a (mon.0) 9728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:19.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:19 smithi049 bash[23528]: audit 2024-09-21T02:49:18.579295+0000 mon.a (mon.0) 9729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:49:19.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:19 smithi049 bash[23528]: audit 2024-09-21T02:49:18.581753+0000 mgr.a (mgr.14388) 11894 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:49:19.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22930]: debug 2024-09-21T02:49:19.371+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:49:19.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:49:19 smithi044 bash[22930]: debug 2024-09-21T02:49:19.371+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:49:19.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:19.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:19.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:19.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:19.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:20.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:20 smithi044 bash[22676]: audit 2024-09-21T02:49:19.374681+0000 mgr.a (mgr.14388) 11895 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:49:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:20 smithi044 bash[22676]: cephadm 2024-09-21T02:49:19.375896+0000 mgr.a (mgr.14388) 11896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:49:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:20 smithi044 bash[22676]: audit 2024-09-21T02:49:19.449739+0000 mgr.a (mgr.14388) 11897 : audit [DBG] from='client.260631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:20 smithi179 bash[23186]: audit 2024-09-21T02:49:19.374681+0000 mgr.a (mgr.14388) 11895 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:49:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:20 smithi179 bash[23186]: cephadm 2024-09-21T02:49:19.375896+0000 mgr.a (mgr.14388) 11896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:49:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:20 smithi179 bash[23186]: audit 2024-09-21T02:49:19.449739+0000 mgr.a (mgr.14388) 11897 : audit [DBG] from='client.260631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:20 smithi049 bash[23528]: audit 2024-09-21T02:49:19.374681+0000 mgr.a (mgr.14388) 11895 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:49:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:20 smithi049 bash[23528]: cephadm 2024-09-21T02:49:19.375896+0000 mgr.a (mgr.14388) 11896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:49:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:20 smithi049 bash[23528]: audit 2024-09-21T02:49:19.449739+0000 mgr.a (mgr.14388) 11897 : audit [DBG] from='client.260631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:21.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:21 smithi044 bash[22676]: cluster 2024-09-21T02:49:20.022425+0000 mgr.a (mgr.14388) 11898 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:21 smithi179 bash[23186]: cluster 2024-09-21T02:49:20.022425+0000 mgr.a (mgr.14388) 11898 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:21 smithi049 bash[23528]: cluster 2024-09-21T02:49:20.022425+0000 mgr.a (mgr.14388) 11898 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:22 smithi179 bash[23186]: audit 2024-09-21T02:49:21.989841+0000 mon.a (mon.0) 9730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:22 smithi179 bash[23186]: audit 2024-09-21T02:49:21.997655+0000 mon.a (mon.0) 9731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:22 smithi179 bash[23186]: audit 2024-09-21T02:49:22.009578+0000 mon.a (mon.0) 9732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:22 smithi179 bash[23186]: cluster 2024-09-21T02:49:22.023016+0000 mgr.a (mgr.14388) 11899 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:22 smithi179 bash[23186]: audit 2024-09-21T02:49:22.036499+0000 mon.a (mon.0) 9733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:22 smithi179 bash[23186]: audit 2024-09-21T02:49:22.045947+0000 mon.a (mon.0) 9734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:22 smithi179 bash[23186]: audit 2024-09-21T02:49:22.055483+0000 mon.a (mon.0) 9735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:22 smithi049 bash[23528]: audit 2024-09-21T02:49:21.989841+0000 mon.a (mon.0) 9730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:22 smithi049 bash[23528]: audit 2024-09-21T02:49:21.997655+0000 mon.a (mon.0) 9731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:22 smithi049 bash[23528]: audit 2024-09-21T02:49:22.009578+0000 mon.a (mon.0) 9732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:22 smithi049 bash[23528]: cluster 2024-09-21T02:49:22.023016+0000 mgr.a (mgr.14388) 11899 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:22 smithi049 bash[23528]: audit 2024-09-21T02:49:22.036499+0000 mon.a (mon.0) 9733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:22 smithi049 bash[23528]: audit 2024-09-21T02:49:22.045947+0000 mon.a (mon.0) 9734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:22 smithi049 bash[23528]: audit 2024-09-21T02:49:22.055483+0000 mon.a (mon.0) 9735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:22 smithi044 bash[22676]: audit 2024-09-21T02:49:21.989841+0000 mon.a (mon.0) 9730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:22 smithi044 bash[22676]: audit 2024-09-21T02:49:21.997655+0000 mon.a (mon.0) 9731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:22 smithi044 bash[22676]: audit 2024-09-21T02:49:22.009578+0000 mon.a (mon.0) 9732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:22 smithi044 bash[22676]: cluster 2024-09-21T02:49:22.023016+0000 mgr.a (mgr.14388) 11899 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:22 smithi044 bash[22676]: audit 2024-09-21T02:49:22.036499+0000 mon.a (mon.0) 9733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:22 smithi044 bash[22676]: audit 2024-09-21T02:49:22.045947+0000 mon.a (mon.0) 9734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:22 smithi044 bash[22676]: audit 2024-09-21T02:49:22.055483+0000 mon.a (mon.0) 9735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:24.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:25.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:25 smithi044 bash[22676]: cluster 2024-09-21T02:49:24.023934+0000 mgr.a (mgr.14388) 11900 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:25 smithi179 bash[23186]: cluster 2024-09-21T02:49:24.023934+0000 mgr.a (mgr.14388) 11900 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:25 smithi049 bash[23528]: cluster 2024-09-21T02:49:24.023934+0000 mgr.a (mgr.14388) 11900 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:25.650 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:26.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:26 smithi044 bash[22676]: audit 2024-09-21T02:49:25.195558+0000 mgr.a (mgr.14388) 11901 : audit [DBG] from='client.260721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:26.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:26 smithi179 bash[23186]: audit 2024-09-21T02:49:25.195558+0000 mgr.a (mgr.14388) 11901 : audit [DBG] from='client.260721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:26 smithi049 bash[23528]: audit 2024-09-21T02:49:25.195558+0000 mgr.a (mgr.14388) 11901 : audit [DBG] from='client.260721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:27 smithi044 bash[22676]: cluster 2024-09-21T02:49:26.026924+0000 mgr.a (mgr.14388) 11902 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:27 smithi179 bash[23186]: cluster 2024-09-21T02:49:26.026924+0000 mgr.a (mgr.14388) 11902 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:27 smithi049 bash[23528]: cluster 2024-09-21T02:49:26.026924+0000 mgr.a (mgr.14388) 11902 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:29 smithi044 bash[22676]: cluster 2024-09-21T02:49:28.027771+0000 mgr.a (mgr.14388) 11903 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:49:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:29 smithi179 bash[23186]: cluster 2024-09-21T02:49:28.027771+0000 mgr.a (mgr.14388) 11903 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:49:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:29 smithi049 bash[23528]: cluster 2024-09-21T02:49:28.027771+0000 mgr.a (mgr.14388) 11903 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:49:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:30 smithi044 bash[22676]: audit 2024-09-21T02:49:29.181168+0000 mon.a (mon.0) 9736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:30 smithi044 bash[22676]: audit 2024-09-21T02:49:29.191145+0000 mon.a (mon.0) 9737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:30 smithi044 bash[22676]: audit 2024-09-21T02:49:29.203242+0000 mon.a (mon.0) 9738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:30 smithi179 bash[23186]: audit 2024-09-21T02:49:29.181168+0000 mon.a (mon.0) 9736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:30 smithi179 bash[23186]: audit 2024-09-21T02:49:29.191145+0000 mon.a (mon.0) 9737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:30 smithi179 bash[23186]: audit 2024-09-21T02:49:29.203242+0000 mon.a (mon.0) 9738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:30 smithi049 bash[23528]: audit 2024-09-21T02:49:29.181168+0000 mon.a (mon.0) 9736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:30 smithi049 bash[23528]: audit 2024-09-21T02:49:29.191145+0000 mon.a (mon.0) 9737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:30 smithi049 bash[23528]: audit 2024-09-21T02:49:29.203242+0000 mon.a (mon.0) 9738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:30.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:31.427 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:31.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:31 smithi044 bash[22676]: cluster 2024-09-21T02:49:30.029712+0000 mgr.a (mgr.14388) 11904 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:31.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:31 smithi179 bash[23186]: cluster 2024-09-21T02:49:30.029712+0000 mgr.a (mgr.14388) 11904 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:31 smithi049 bash[23528]: cluster 2024-09-21T02:49:30.029712+0000 mgr.a (mgr.14388) 11904 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:49:32.288 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:32 smithi049 bash[23528]: audit 2024-09-21T02:49:30.988377+0000 mgr.a (mgr.14388) 11905 : audit [DBG] from='client.260799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:32 smithi044 bash[22676]: audit 2024-09-21T02:49:30.988377+0000 mgr.a (mgr.14388) 11905 : audit [DBG] from='client.260799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:32 smithi179 bash[23186]: audit 2024-09-21T02:49:30.988377+0000 mgr.a (mgr.14388) 11905 : audit [DBG] from='client.260799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:33 smithi044 bash[22676]: cluster 2024-09-21T02:49:32.030745+0000 mgr.a (mgr.14388) 11906 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:49:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:33 smithi179 bash[23186]: cluster 2024-09-21T02:49:32.030745+0000 mgr.a (mgr.14388) 11906 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:49:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:33 smithi049 bash[23528]: cluster 2024-09-21T02:49:32.030745+0000 mgr.a (mgr.14388) 11906 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:49:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:35 smithi044 bash[22676]: cluster 2024-09-21T02:49:34.031551+0000 mgr.a (mgr.14388) 11907 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:49:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:35 smithi179 bash[23186]: cluster 2024-09-21T02:49:34.031551+0000 mgr.a (mgr.14388) 11907 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:49:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:35 smithi049 bash[23528]: cluster 2024-09-21T02:49:34.031551+0000 mgr.a (mgr.14388) 11907 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:49:36.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:36.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:36.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:37.213 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:37 smithi044 bash[22676]: cluster 2024-09-21T02:49:36.032776+0000 mgr.a (mgr.14388) 11908 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:37 smithi179 bash[23186]: cluster 2024-09-21T02:49:36.032776+0000 mgr.a (mgr.14388) 11908 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:37 smithi049 bash[23528]: cluster 2024-09-21T02:49:36.032776+0000 mgr.a (mgr.14388) 11908 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:38 smithi179 bash[23186]: audit 2024-09-21T02:49:36.763424+0000 mgr.a (mgr.14388) 11909 : audit [DBG] from='client.260877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:38 smithi049 bash[23528]: audit 2024-09-21T02:49:36.763424+0000 mgr.a (mgr.14388) 11909 : audit [DBG] from='client.260877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:38 smithi044 bash[22676]: audit 2024-09-21T02:49:36.763424+0000 mgr.a (mgr.14388) 11909 : audit [DBG] from='client.260877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:39 smithi179 bash[23186]: cluster 2024-09-21T02:49:38.033930+0000 mgr.a (mgr.14388) 11910 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:39.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:39 smithi044 bash[22676]: cluster 2024-09-21T02:49:38.033930+0000 mgr.a (mgr.14388) 11910 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:39 smithi049 bash[23528]: cluster 2024-09-21T02:49:38.033930+0000 mgr.a (mgr.14388) 11910 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:41 smithi179 bash[23186]: cluster 2024-09-21T02:49:40.036133+0000 mgr.a (mgr.14388) 11911 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:41 smithi049 bash[23528]: cluster 2024-09-21T02:49:40.036133+0000 mgr.a (mgr.14388) 11911 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:41 smithi044 bash[22676]: cluster 2024-09-21T02:49:40.036133+0000 mgr.a (mgr.14388) 11911 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:42.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:42.994 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:42.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:42.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:42.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:42.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: cluster 2024-09-21T02:49:42.036894+0000 mgr.a (mgr.14388) 11912 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: audit 2024-09-21T02:49:42.214025+0000 mon.a (mon.0) 9739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: audit 2024-09-21T02:49:42.222270+0000 mon.a (mon.0) 9740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: audit 2024-09-21T02:49:42.229766+0000 mon.a (mon.0) 9741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: audit 2024-09-21T02:49:42.253026+0000 mon.a (mon.0) 9742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: audit 2024-09-21T02:49:42.262467+0000 mon.a (mon.0) 9743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: audit 2024-09-21T02:49:42.270243+0000 mon.a (mon.0) 9744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:43 smithi044 bash[22676]: audit 2024-09-21T02:49:42.545415+0000 mgr.a (mgr.14388) 11913 : audit [DBG] from='client.260952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: cluster 2024-09-21T02:49:42.036894+0000 mgr.a (mgr.14388) 11912 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: audit 2024-09-21T02:49:42.214025+0000 mon.a (mon.0) 9739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: audit 2024-09-21T02:49:42.222270+0000 mon.a (mon.0) 9740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: audit 2024-09-21T02:49:42.229766+0000 mon.a (mon.0) 9741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: audit 2024-09-21T02:49:42.253026+0000 mon.a (mon.0) 9742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: audit 2024-09-21T02:49:42.262467+0000 mon.a (mon.0) 9743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: audit 2024-09-21T02:49:42.270243+0000 mon.a (mon.0) 9744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:43 smithi179 bash[23186]: audit 2024-09-21T02:49:42.545415+0000 mgr.a (mgr.14388) 11913 : audit [DBG] from='client.260952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: cluster 2024-09-21T02:49:42.036894+0000 mgr.a (mgr.14388) 11912 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: audit 2024-09-21T02:49:42.214025+0000 mon.a (mon.0) 9739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: audit 2024-09-21T02:49:42.222270+0000 mon.a (mon.0) 9740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: audit 2024-09-21T02:49:42.229766+0000 mon.a (mon.0) 9741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: audit 2024-09-21T02:49:42.253026+0000 mon.a (mon.0) 9742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: audit 2024-09-21T02:49:42.262467+0000 mon.a (mon.0) 9743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: audit 2024-09-21T02:49:42.270243+0000 mon.a (mon.0) 9744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:43 smithi049 bash[23528]: audit 2024-09-21T02:49:42.545415+0000 mgr.a (mgr.14388) 11913 : audit [DBG] from='client.260952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:45 smithi044 bash[22676]: cluster 2024-09-21T02:49:44.037876+0000 mgr.a (mgr.14388) 11914 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:45 smithi179 bash[23186]: cluster 2024-09-21T02:49:44.037876+0000 mgr.a (mgr.14388) 11914 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:45 smithi049 bash[23528]: cluster 2024-09-21T02:49:44.037876+0000 mgr.a (mgr.14388) 11914 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:47 smithi044 bash[22676]: cluster 2024-09-21T02:49:46.040112+0000 mgr.a (mgr.14388) 11915 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:47 smithi179 bash[23186]: cluster 2024-09-21T02:49:46.040112+0000 mgr.a (mgr.14388) 11915 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:47 smithi049 bash[23528]: cluster 2024-09-21T02:49:46.040112+0000 mgr.a (mgr.14388) 11915 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:47.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:47.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:47.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:48.776 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:49 smithi044 bash[22676]: cluster 2024-09-21T02:49:48.041045+0000 mgr.a (mgr.14388) 11916 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:49 smithi044 bash[22676]: audit 2024-09-21T02:49:48.330416+0000 mgr.a (mgr.14388) 11917 : audit [DBG] from='client.261024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:49 smithi179 bash[23186]: cluster 2024-09-21T02:49:48.041045+0000 mgr.a (mgr.14388) 11916 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:49 smithi179 bash[23186]: audit 2024-09-21T02:49:48.330416+0000 mgr.a (mgr.14388) 11917 : audit [DBG] from='client.261024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:49 smithi049 bash[23528]: cluster 2024-09-21T02:49:48.041045+0000 mgr.a (mgr.14388) 11916 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:49 smithi049 bash[23528]: audit 2024-09-21T02:49:48.330416+0000 mgr.a (mgr.14388) 11917 : audit [DBG] from='client.261024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:50.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:50 smithi044 bash[22676]: audit 2024-09-21T02:49:49.419699+0000 mon.a (mon.0) 9745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:50 smithi044 bash[22676]: audit 2024-09-21T02:49:49.428410+0000 mon.a (mon.0) 9746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:50 smithi044 bash[22676]: audit 2024-09-21T02:49:49.438899+0000 mon.a (mon.0) 9747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:50 smithi179 bash[23186]: audit 2024-09-21T02:49:49.419699+0000 mon.a (mon.0) 9745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:50 smithi179 bash[23186]: audit 2024-09-21T02:49:49.428410+0000 mon.a (mon.0) 9746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:50 smithi179 bash[23186]: audit 2024-09-21T02:49:49.438899+0000 mon.a (mon.0) 9747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:50 smithi049 bash[23528]: audit 2024-09-21T02:49:49.419699+0000 mon.a (mon.0) 9745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:50 smithi049 bash[23528]: audit 2024-09-21T02:49:49.428410+0000 mon.a (mon.0) 9746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:50 smithi049 bash[23528]: audit 2024-09-21T02:49:49.438899+0000 mon.a (mon.0) 9747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:49:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:51 smithi049 bash[23528]: cluster 2024-09-21T02:49:50.043395+0000 mgr.a (mgr.14388) 11918 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:51 smithi044 bash[22676]: cluster 2024-09-21T02:49:50.043395+0000 mgr.a (mgr.14388) 11918 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:51 smithi179 bash[23186]: cluster 2024-09-21T02:49:50.043395+0000 mgr.a (mgr.14388) 11918 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:53 smithi044 bash[22676]: cluster 2024-09-21T02:49:52.044164+0000 mgr.a (mgr.14388) 11919 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:53 smithi179 bash[23186]: cluster 2024-09-21T02:49:52.044164+0000 mgr.a (mgr.14388) 11919 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:53.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:53.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:53.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:53 smithi049 bash[23528]: cluster 2024-09-21T02:49:52.044164+0000 mgr.a (mgr.14388) 11919 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:54.549 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:49:54.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:49:54.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:49:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:55 smithi044 bash[22676]: cluster 2024-09-21T02:49:54.044889+0000 mgr.a (mgr.14388) 11920 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:55 smithi044 bash[22676]: audit 2024-09-21T02:49:54.110921+0000 mgr.a (mgr.14388) 11921 : audit [DBG] from='client.261099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:55 smithi179 bash[23186]: cluster 2024-09-21T02:49:54.044889+0000 mgr.a (mgr.14388) 11920 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:55 smithi179 bash[23186]: audit 2024-09-21T02:49:54.110921+0000 mgr.a (mgr.14388) 11921 : audit [DBG] from='client.261099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:55 smithi049 bash[23528]: cluster 2024-09-21T02:49:54.044889+0000 mgr.a (mgr.14388) 11920 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:55 smithi049 bash[23528]: audit 2024-09-21T02:49:54.110921+0000 mgr.a (mgr.14388) 11921 : audit [DBG] from='client.261099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:49:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:57 smithi044 bash[22676]: cluster 2024-09-21T02:49:56.047438+0000 mgr.a (mgr.14388) 11922 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:57 smithi179 bash[23186]: cluster 2024-09-21T02:49:56.047438+0000 mgr.a (mgr.14388) 11922 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:57 smithi049 bash[23528]: cluster 2024-09-21T02:49:56.047438+0000 mgr.a (mgr.14388) 11922 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:49:59.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:49:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:49:59.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:49:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:49:59 smithi044 bash[22676]: cluster 2024-09-21T02:49:58.048395+0000 mgr.a (mgr.14388) 11923 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:49:59 smithi179 bash[23186]: cluster 2024-09-21T02:49:58.048395+0000 mgr.a (mgr.14388) 11923 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:49:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:49:59 smithi049 bash[23528]: cluster 2024-09-21T02:49:58.048395+0000 mgr.a (mgr.14388) 11923 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:00.343 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:00.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:00.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:00.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:00 smithi044 bash[22676]: cluster 2024-09-21T02:50:00.000035+0000 mon.a (mon.0) 9748 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:50:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:00 smithi179 bash[23186]: cluster 2024-09-21T02:50:00.000035+0000 mon.a (mon.0) 9748 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:50:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:00 smithi049 bash[23528]: cluster 2024-09-21T02:50:00.000035+0000 mon.a (mon.0) 9748 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T02:50:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:01 smithi044 bash[22676]: audit 2024-09-21T02:49:59.891555+0000 mgr.a (mgr.14388) 11924 : audit [DBG] from='client.261177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:01 smithi044 bash[22676]: cluster 2024-09-21T02:50:00.049837+0000 mgr.a (mgr.14388) 11925 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:01 smithi179 bash[23186]: audit 2024-09-21T02:49:59.891555+0000 mgr.a (mgr.14388) 11924 : audit [DBG] from='client.261177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:01 smithi179 bash[23186]: cluster 2024-09-21T02:50:00.049837+0000 mgr.a (mgr.14388) 11925 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:01 smithi049 bash[23528]: audit 2024-09-21T02:49:59.891555+0000 mgr.a (mgr.14388) 11924 : audit [DBG] from='client.261177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:01 smithi049 bash[23528]: cluster 2024-09-21T02:50:00.049837+0000 mgr.a (mgr.14388) 11925 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:03 smithi044 bash[22676]: cluster 2024-09-21T02:50:02.050722+0000 mgr.a (mgr.14388) 11926 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:03 smithi044 bash[22676]: audit 2024-09-21T02:50:02.424973+0000 mon.a (mon.0) 9749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:03 smithi044 bash[22676]: audit 2024-09-21T02:50:02.431031+0000 mon.a (mon.0) 9750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:03 smithi044 bash[22676]: audit 2024-09-21T02:50:02.440120+0000 mon.a (mon.0) 9751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:03 smithi044 bash[22676]: audit 2024-09-21T02:50:02.491698+0000 mon.a (mon.0) 9752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:03 smithi044 bash[22676]: audit 2024-09-21T02:50:02.497887+0000 mon.a (mon.0) 9753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:03 smithi044 bash[22676]: audit 2024-09-21T02:50:02.506080+0000 mon.a (mon.0) 9754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:03 smithi179 bash[23186]: cluster 2024-09-21T02:50:02.050722+0000 mgr.a (mgr.14388) 11926 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:50:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:03 smithi179 bash[23186]: audit 2024-09-21T02:50:02.424973+0000 mon.a (mon.0) 9749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:03 smithi179 bash[23186]: audit 2024-09-21T02:50:02.431031+0000 mon.a (mon.0) 9750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:03 smithi179 bash[23186]: audit 2024-09-21T02:50:02.440120+0000 mon.a (mon.0) 9751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:03 smithi179 bash[23186]: audit 2024-09-21T02:50:02.491698+0000 mon.a (mon.0) 9752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:03 smithi179 bash[23186]: audit 2024-09-21T02:50:02.497887+0000 mon.a (mon.0) 9753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:03 smithi179 bash[23186]: audit 2024-09-21T02:50:02.506080+0000 mon.a (mon.0) 9754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:03 smithi049 bash[23528]: cluster 2024-09-21T02:50:02.050722+0000 mgr.a (mgr.14388) 11926 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:50:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:03 smithi049 bash[23528]: audit 2024-09-21T02:50:02.424973+0000 mon.a (mon.0) 9749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:03 smithi049 bash[23528]: audit 2024-09-21T02:50:02.431031+0000 mon.a (mon.0) 9750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:03 smithi049 bash[23528]: audit 2024-09-21T02:50:02.440120+0000 mon.a (mon.0) 9751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:03 smithi049 bash[23528]: audit 2024-09-21T02:50:02.491698+0000 mon.a (mon.0) 9752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:03 smithi049 bash[23528]: audit 2024-09-21T02:50:02.497887+0000 mon.a (mon.0) 9753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:03.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:03 smithi049 bash[23528]: audit 2024-09-21T02:50:02.506080+0000 mon.a (mon.0) 9754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:05.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:05.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:05.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:05 smithi044 bash[22676]: cluster 2024-09-21T02:50:04.051692+0000 mgr.a (mgr.14388) 11927 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:05 smithi179 bash[23186]: cluster 2024-09-21T02:50:04.051692+0000 mgr.a (mgr.14388) 11927 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:05 smithi049 bash[23528]: cluster 2024-09-21T02:50:04.051692+0000 mgr.a (mgr.14388) 11927 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:06.099 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:06.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:06 smithi044 bash[22676]: audit 2024-09-21T02:50:05.677854+0000 mgr.a (mgr.14388) 11928 : audit [DBG] from='client.261249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:06 smithi179 bash[23186]: audit 2024-09-21T02:50:05.677854+0000 mgr.a (mgr.14388) 11928 : audit [DBG] from='client.261249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:06 smithi049 bash[23528]: audit 2024-09-21T02:50:05.677854+0000 mgr.a (mgr.14388) 11928 : audit [DBG] from='client.261249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:07 smithi044 bash[22676]: cluster 2024-09-21T02:50:06.053067+0000 mgr.a (mgr.14388) 11929 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:07 smithi179 bash[23186]: cluster 2024-09-21T02:50:06.053067+0000 mgr.a (mgr.14388) 11929 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:07 smithi049 bash[23528]: cluster 2024-09-21T02:50:06.053067+0000 mgr.a (mgr.14388) 11929 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:09.623 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:09 smithi049 bash[23528]: cluster 2024-09-21T02:50:08.053854+0000 mgr.a (mgr.14388) 11930 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:09 smithi044 bash[22676]: cluster 2024-09-21T02:50:08.053854+0000 mgr.a (mgr.14388) 11930 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:09 smithi179 bash[23186]: cluster 2024-09-21T02:50:08.053854+0000 mgr.a (mgr.14388) 11930 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:10.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:10 smithi044 bash[22676]: audit 2024-09-21T02:50:09.599930+0000 mon.a (mon.0) 9755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:10 smithi044 bash[22676]: audit 2024-09-21T02:50:09.609474+0000 mon.a (mon.0) 9756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:10 smithi044 bash[22676]: audit 2024-09-21T02:50:09.620362+0000 mon.a (mon.0) 9757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:10 smithi179 bash[23186]: audit 2024-09-21T02:50:09.599930+0000 mon.a (mon.0) 9755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:10 smithi179 bash[23186]: audit 2024-09-21T02:50:09.609474+0000 mon.a (mon.0) 9756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:10 smithi179 bash[23186]: audit 2024-09-21T02:50:09.620362+0000 mon.a (mon.0) 9757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:10 smithi049 bash[23528]: audit 2024-09-21T02:50:09.599930+0000 mon.a (mon.0) 9755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:10 smithi049 bash[23528]: audit 2024-09-21T02:50:09.609474+0000 mon.a (mon.0) 9756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:10 smithi049 bash[23528]: audit 2024-09-21T02:50:09.620362+0000 mon.a (mon.0) 9757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:11.882 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:11 smithi044 bash[22676]: cluster 2024-09-21T02:50:10.055788+0000 mgr.a (mgr.14388) 11931 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:11 smithi179 bash[23186]: cluster 2024-09-21T02:50:10.055788+0000 mgr.a (mgr.14388) 11931 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:11 smithi049 bash[23528]: cluster 2024-09-21T02:50:10.055788+0000 mgr.a (mgr.14388) 11931 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:12.915 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:12 smithi049 bash[23528]: audit 2024-09-21T02:50:11.437779+0000 mgr.a (mgr.14388) 11932 : audit [DBG] from='client.261327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:12 smithi044 bash[22676]: audit 2024-09-21T02:50:11.437779+0000 mgr.a (mgr.14388) 11932 : audit [DBG] from='client.261327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:12 smithi179 bash[23186]: audit 2024-09-21T02:50:11.437779+0000 mgr.a (mgr.14388) 11932 : audit [DBG] from='client.261327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:13 smithi179 bash[23186]: cluster 2024-09-21T02:50:12.056774+0000 mgr.a (mgr.14388) 11933 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:13 smithi044 bash[22676]: cluster 2024-09-21T02:50:12.056774+0000 mgr.a (mgr.14388) 11933 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:13 smithi049 bash[23528]: cluster 2024-09-21T02:50:12.056774+0000 mgr.a (mgr.14388) 11933 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:14 smithi044 bash[22676]: cluster 2024-09-21T02:50:14.057695+0000 mgr.a (mgr.14388) 11934 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:15.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:14 smithi049 bash[23528]: cluster 2024-09-21T02:50:14.057695+0000 mgr.a (mgr.14388) 11934 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:14 smithi179 bash[23186]: cluster 2024-09-21T02:50:14.057695+0000 mgr.a (mgr.14388) 11934 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:16.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:16.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:17.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:17 smithi044 bash[22676]: cluster 2024-09-21T02:50:16.060217+0000 mgr.a (mgr.14388) 11935 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:50:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:17 smithi179 bash[23186]: cluster 2024-09-21T02:50:16.060217+0000 mgr.a (mgr.14388) 11935 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:50:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:17 smithi049 bash[23528]: cluster 2024-09-21T02:50:16.060217+0000 mgr.a (mgr.14388) 11935 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:50:17.670 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:18 smithi044 bash[22676]: audit 2024-09-21T02:50:17.224660+0000 mgr.a (mgr.14388) 11936 : audit [DBG] from='client.261402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:18 smithi179 bash[23186]: audit 2024-09-21T02:50:17.224660+0000 mgr.a (mgr.14388) 11936 : audit [DBG] from='client.261402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:18 smithi049 bash[23528]: audit 2024-09-21T02:50:17.224660+0000 mgr.a (mgr.14388) 11936 : audit [DBG] from='client.261402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:19 smithi044 bash[22676]: cluster 2024-09-21T02:50:18.061214+0000 mgr.a (mgr.14388) 11937 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:19 smithi179 bash[23186]: cluster 2024-09-21T02:50:18.061214+0000 mgr.a (mgr.14388) 11937 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:19 smithi049 bash[23528]: cluster 2024-09-21T02:50:18.061214+0000 mgr.a (mgr.14388) 11937 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22930]: debug 2024-09-21T02:50:20.238+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22930]: debug 2024-09-21T02:50:20.238+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22676]: audit 2024-09-21T02:50:19.440033+0000 mon.a (mon.0) 9758 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22676]: audit 2024-09-21T02:50:19.452018+0000 mon.a (mon.0) 9759 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22676]: audit 2024-09-21T02:50:19.454061+0000 mon.a (mon.0) 9760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22676]: audit 2024-09-21T02:50:19.466849+0000 mon.a (mon.0) 9761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22676]: audit 2024-09-21T02:50:19.473326+0000 mon.a (mon.0) 9762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:50:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:20 smithi044 bash[22676]: audit 2024-09-21T02:50:19.475936+0000 mgr.a (mgr.14388) 11938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:50:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:20 smithi179 bash[23186]: audit 2024-09-21T02:50:19.440033+0000 mon.a (mon.0) 9758 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:50:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:20 smithi179 bash[23186]: audit 2024-09-21T02:50:19.452018+0000 mon.a (mon.0) 9759 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:50:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:20 smithi179 bash[23186]: audit 2024-09-21T02:50:19.454061+0000 mon.a (mon.0) 9760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:50:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:20 smithi179 bash[23186]: audit 2024-09-21T02:50:19.466849+0000 mon.a (mon.0) 9761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:20 smithi179 bash[23186]: audit 2024-09-21T02:50:19.473326+0000 mon.a (mon.0) 9762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:50:20.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:20 smithi179 bash[23186]: audit 2024-09-21T02:50:19.475936+0000 mgr.a (mgr.14388) 11938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:50:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:20 smithi049 bash[23528]: audit 2024-09-21T02:50:19.440033+0000 mon.a (mon.0) 9758 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:50:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:20 smithi049 bash[23528]: audit 2024-09-21T02:50:19.452018+0000 mon.a (mon.0) 9759 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:50:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:20 smithi049 bash[23528]: audit 2024-09-21T02:50:19.454061+0000 mon.a (mon.0) 9760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:50:20.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:20 smithi049 bash[23528]: audit 2024-09-21T02:50:19.466849+0000 mon.a (mon.0) 9761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:20.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:20 smithi049 bash[23528]: audit 2024-09-21T02:50:19.473326+0000 mon.a (mon.0) 9762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:50:20.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:20 smithi049 bash[23528]: audit 2024-09-21T02:50:19.475936+0000 mgr.a (mgr.14388) 11938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:50:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:21 smithi044 bash[22676]: cluster 2024-09-21T02:50:20.063032+0000 mgr.a (mgr.14388) 11939 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:50:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:21 smithi044 bash[22676]: audit 2024-09-21T02:50:20.241686+0000 mgr.a (mgr.14388) 11940 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:50:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:21 smithi044 bash[22676]: cephadm 2024-09-21T02:50:20.242867+0000 mgr.a (mgr.14388) 11941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:50:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:21 smithi179 bash[23186]: cluster 2024-09-21T02:50:20.063032+0000 mgr.a (mgr.14388) 11939 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:50:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:21 smithi179 bash[23186]: audit 2024-09-21T02:50:20.241686+0000 mgr.a (mgr.14388) 11940 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:50:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:21 smithi179 bash[23186]: cephadm 2024-09-21T02:50:20.242867+0000 mgr.a (mgr.14388) 11941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:50:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:21 smithi049 bash[23528]: cluster 2024-09-21T02:50:20.063032+0000 mgr.a (mgr.14388) 11939 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T02:50:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:21 smithi049 bash[23528]: audit 2024-09-21T02:50:20.241686+0000 mgr.a (mgr.14388) 11940 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:50:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:21 smithi049 bash[23528]: cephadm 2024-09-21T02:50:20.242867+0000 mgr.a (mgr.14388) 11941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:50:22.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:22.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:22.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:23.460 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:23 smithi044 bash[22676]: cluster 2024-09-21T02:50:22.063795+0000 mgr.a (mgr.14388) 11942 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:50:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:23 smithi044 bash[22676]: audit 2024-09-21T02:50:22.650306+0000 mon.a (mon.0) 9763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:23 smithi044 bash[22676]: audit 2024-09-21T02:50:22.658231+0000 mon.a (mon.0) 9764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:23 smithi044 bash[22676]: audit 2024-09-21T02:50:22.668728+0000 mon.a (mon.0) 9765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:23 smithi044 bash[22676]: audit 2024-09-21T02:50:22.728163+0000 mon.a (mon.0) 9766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:23 smithi044 bash[22676]: audit 2024-09-21T02:50:22.736394+0000 mon.a (mon.0) 9767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:23 smithi044 bash[22676]: audit 2024-09-21T02:50:22.746767+0000 mon.a (mon.0) 9768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:23 smithi179 bash[23186]: cluster 2024-09-21T02:50:22.063795+0000 mgr.a (mgr.14388) 11942 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:50:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:23 smithi179 bash[23186]: audit 2024-09-21T02:50:22.650306+0000 mon.a (mon.0) 9763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:23 smithi179 bash[23186]: audit 2024-09-21T02:50:22.658231+0000 mon.a (mon.0) 9764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:23 smithi179 bash[23186]: audit 2024-09-21T02:50:22.668728+0000 mon.a (mon.0) 9765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:23 smithi179 bash[23186]: audit 2024-09-21T02:50:22.728163+0000 mon.a (mon.0) 9766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:23 smithi179 bash[23186]: audit 2024-09-21T02:50:22.736394+0000 mon.a (mon.0) 9767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:23 smithi179 bash[23186]: audit 2024-09-21T02:50:22.746767+0000 mon.a (mon.0) 9768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:23 smithi049 bash[23528]: cluster 2024-09-21T02:50:22.063795+0000 mgr.a (mgr.14388) 11942 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:50:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:23 smithi049 bash[23528]: audit 2024-09-21T02:50:22.650306+0000 mon.a (mon.0) 9763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:23 smithi049 bash[23528]: audit 2024-09-21T02:50:22.658231+0000 mon.a (mon.0) 9764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:23 smithi049 bash[23528]: audit 2024-09-21T02:50:22.668728+0000 mon.a (mon.0) 9765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:23 smithi049 bash[23528]: audit 2024-09-21T02:50:22.728163+0000 mon.a (mon.0) 9766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:23 smithi049 bash[23528]: audit 2024-09-21T02:50:22.736394+0000 mon.a (mon.0) 9767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:23 smithi049 bash[23528]: audit 2024-09-21T02:50:22.746767+0000 mon.a (mon.0) 9768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:24 smithi044 bash[22676]: audit 2024-09-21T02:50:23.002935+0000 mgr.a (mgr.14388) 11943 : audit [DBG] from='client.261582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:24 smithi179 bash[23186]: audit 2024-09-21T02:50:23.002935+0000 mgr.a (mgr.14388) 11943 : audit [DBG] from='client.261582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:24 smithi049 bash[23528]: audit 2024-09-21T02:50:23.002935+0000 mgr.a (mgr.14388) 11943 : audit [DBG] from='client.261582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:25 smithi044 bash[22676]: cluster 2024-09-21T02:50:24.064769+0000 mgr.a (mgr.14388) 11944 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:50:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:25 smithi179 bash[23186]: cluster 2024-09-21T02:50:24.064769+0000 mgr.a (mgr.14388) 11944 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:50:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:25 smithi049 bash[23528]: cluster 2024-09-21T02:50:24.064769+0000 mgr.a (mgr.14388) 11944 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T02:50:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:27 smithi044 bash[22676]: cluster 2024-09-21T02:50:26.067038+0000 mgr.a (mgr.14388) 11945 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:27 smithi179 bash[23186]: cluster 2024-09-21T02:50:26.067038+0000 mgr.a (mgr.14388) 11945 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:27 smithi049 bash[23528]: cluster 2024-09-21T02:50:26.067038+0000 mgr.a (mgr.14388) 11945 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:28.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:29.207 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:29.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:29.956 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:29 smithi049 bash[23528]: cluster 2024-09-21T02:50:28.067821+0000 mgr.a (mgr.14388) 11946 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:29 smithi044 bash[22676]: cluster 2024-09-21T02:50:28.067821+0000 mgr.a (mgr.14388) 11946 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:29 smithi179 bash[23186]: cluster 2024-09-21T02:50:28.067821+0000 mgr.a (mgr.14388) 11946 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:30 smithi044 bash[22676]: audit 2024-09-21T02:50:28.792329+0000 mgr.a (mgr.14388) 11947 : audit [DBG] from='client.261654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:30 smithi044 bash[22676]: audit 2024-09-21T02:50:29.833471+0000 mon.a (mon.0) 9769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:30 smithi044 bash[22676]: audit 2024-09-21T02:50:29.842466+0000 mon.a (mon.0) 9770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:30 smithi044 bash[22676]: audit 2024-09-21T02:50:29.853134+0000 mon.a (mon.0) 9771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:30 smithi179 bash[23186]: audit 2024-09-21T02:50:28.792329+0000 mgr.a (mgr.14388) 11947 : audit [DBG] from='client.261654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:30 smithi179 bash[23186]: audit 2024-09-21T02:50:29.833471+0000 mon.a (mon.0) 9769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:30 smithi179 bash[23186]: audit 2024-09-21T02:50:29.842466+0000 mon.a (mon.0) 9770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:30 smithi179 bash[23186]: audit 2024-09-21T02:50:29.853134+0000 mon.a (mon.0) 9771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:30 smithi049 bash[23528]: audit 2024-09-21T02:50:28.792329+0000 mgr.a (mgr.14388) 11947 : audit [DBG] from='client.261654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:30 smithi049 bash[23528]: audit 2024-09-21T02:50:29.833471+0000 mon.a (mon.0) 9769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:30 smithi049 bash[23528]: audit 2024-09-21T02:50:29.842466+0000 mon.a (mon.0) 9770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:30 smithi049 bash[23528]: audit 2024-09-21T02:50:29.853134+0000 mon.a (mon.0) 9771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:31.942 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:31 smithi179 bash[23186]: cluster 2024-09-21T02:50:30.070097+0000 mgr.a (mgr.14388) 11948 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:31 smithi044 bash[22676]: cluster 2024-09-21T02:50:30.070097+0000 mgr.a (mgr.14388) 11948 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:32.010 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:31 smithi049 bash[23528]: cluster 2024-09-21T02:50:30.070097+0000 mgr.a (mgr.14388) 11948 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:50:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:33 smithi179 bash[23186]: cluster 2024-09-21T02:50:32.070898+0000 mgr.a (mgr.14388) 11949 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:50:33.976 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:33 smithi049 bash[23528]: cluster 2024-09-21T02:50:32.070898+0000 mgr.a (mgr.14388) 11949 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:50:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:33 smithi044 bash[22676]: cluster 2024-09-21T02:50:32.070898+0000 mgr.a (mgr.14388) 11949 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:50:34.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:34.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:35.000 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:35.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:35.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:35.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:35.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:35 smithi044 bash[22676]: cluster 2024-09-21T02:50:34.071682+0000 mgr.a (mgr.14388) 11950 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:50:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:35 smithi044 bash[22676]: audit 2024-09-21T02:50:34.557006+0000 mgr.a (mgr.14388) 11951 : audit [DBG] from='client.261726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:35 smithi179 bash[23186]: cluster 2024-09-21T02:50:34.071682+0000 mgr.a (mgr.14388) 11950 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:50:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:35 smithi179 bash[23186]: audit 2024-09-21T02:50:34.557006+0000 mgr.a (mgr.14388) 11951 : audit [DBG] from='client.261726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:35 smithi049 bash[23528]: cluster 2024-09-21T02:50:34.071682+0000 mgr.a (mgr.14388) 11950 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T02:50:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:35 smithi049 bash[23528]: audit 2024-09-21T02:50:34.557006+0000 mgr.a (mgr.14388) 11951 : audit [DBG] from='client.261726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:37 smithi044 bash[22676]: cluster 2024-09-21T02:50:36.074137+0000 mgr.a (mgr.14388) 11952 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:50:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:37 smithi179 bash[23186]: cluster 2024-09-21T02:50:36.074137+0000 mgr.a (mgr.14388) 11952 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:50:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:37 smithi049 bash[23528]: cluster 2024-09-21T02:50:36.074137+0000 mgr.a (mgr.14388) 11952 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:50:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:39 smithi044 bash[22676]: cluster 2024-09-21T02:50:38.074953+0000 mgr.a (mgr.14388) 11953 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:50:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:39 smithi179 bash[23186]: cluster 2024-09-21T02:50:38.074953+0000 mgr.a (mgr.14388) 11953 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:50:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:39 smithi049 bash[23528]: cluster 2024-09-21T02:50:38.074953+0000 mgr.a (mgr.14388) 11953 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:50:40.763 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:41 smithi044 bash[22676]: cluster 2024-09-21T02:50:40.076276+0000 mgr.a (mgr.14388) 11954 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:41 smithi044 bash[22676]: audit 2024-09-21T02:50:40.329434+0000 mgr.a (mgr.14388) 11955 : audit [DBG] from='client.261804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:41 smithi179 bash[23186]: cluster 2024-09-21T02:50:40.076276+0000 mgr.a (mgr.14388) 11954 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:41 smithi179 bash[23186]: audit 2024-09-21T02:50:40.329434+0000 mgr.a (mgr.14388) 11955 : audit [DBG] from='client.261804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:41 smithi049 bash[23528]: cluster 2024-09-21T02:50:40.076276+0000 mgr.a (mgr.14388) 11954 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:41 smithi049 bash[23528]: audit 2024-09-21T02:50:40.329434+0000 mgr.a (mgr.14388) 11955 : audit [DBG] from='client.261804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:43 smithi044 bash[22676]: cluster 2024-09-21T02:50:42.077145+0000 mgr.a (mgr.14388) 11956 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:43 smithi044 bash[22676]: audit 2024-09-21T02:50:42.867370+0000 mon.a (mon.0) 9772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:43 smithi044 bash[22676]: audit 2024-09-21T02:50:42.875406+0000 mon.a (mon.0) 9773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:43 smithi044 bash[22676]: audit 2024-09-21T02:50:42.885952+0000 mon.a (mon.0) 9774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:43 smithi044 bash[22676]: audit 2024-09-21T02:50:42.951502+0000 mon.a (mon.0) 9775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:43 smithi044 bash[22676]: audit 2024-09-21T02:50:42.960417+0000 mon.a (mon.0) 9776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:43 smithi044 bash[22676]: audit 2024-09-21T02:50:42.970497+0000 mon.a (mon.0) 9777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:43 smithi179 bash[23186]: cluster 2024-09-21T02:50:42.077145+0000 mgr.a (mgr.14388) 11956 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:43 smithi179 bash[23186]: audit 2024-09-21T02:50:42.867370+0000 mon.a (mon.0) 9772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:43 smithi179 bash[23186]: audit 2024-09-21T02:50:42.875406+0000 mon.a (mon.0) 9773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:43 smithi179 bash[23186]: audit 2024-09-21T02:50:42.885952+0000 mon.a (mon.0) 9774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:43 smithi179 bash[23186]: audit 2024-09-21T02:50:42.951502+0000 mon.a (mon.0) 9775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:43 smithi179 bash[23186]: audit 2024-09-21T02:50:42.960417+0000 mon.a (mon.0) 9776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:43 smithi179 bash[23186]: audit 2024-09-21T02:50:42.970497+0000 mon.a (mon.0) 9777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:43 smithi049 bash[23528]: cluster 2024-09-21T02:50:42.077145+0000 mgr.a (mgr.14388) 11956 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:43 smithi049 bash[23528]: audit 2024-09-21T02:50:42.867370+0000 mon.a (mon.0) 9772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:43 smithi049 bash[23528]: audit 2024-09-21T02:50:42.875406+0000 mon.a (mon.0) 9773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:43 smithi049 bash[23528]: audit 2024-09-21T02:50:42.885952+0000 mon.a (mon.0) 9774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:43 smithi049 bash[23528]: audit 2024-09-21T02:50:42.951502+0000 mon.a (mon.0) 9775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:43 smithi049 bash[23528]: audit 2024-09-21T02:50:42.960417+0000 mon.a (mon.0) 9776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:44.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:43 smithi049 bash[23528]: audit 2024-09-21T02:50:42.970497+0000 mon.a (mon.0) 9777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:45.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:45.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:45.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:45 smithi044 bash[22676]: cluster 2024-09-21T02:50:44.077939+0000 mgr.a (mgr.14388) 11957 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:45 smithi179 bash[23186]: cluster 2024-09-21T02:50:44.077939+0000 mgr.a (mgr.14388) 11957 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:45 smithi049 bash[23528]: cluster 2024-09-21T02:50:44.077939+0000 mgr.a (mgr.14388) 11957 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:50:46.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:46.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:46.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:46.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:46.525 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:47 smithi044 bash[22676]: cluster 2024-09-21T02:50:46.080015+0000 mgr.a (mgr.14388) 11958 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:47 smithi044 bash[22676]: audit 2024-09-21T02:50:46.098315+0000 mgr.a (mgr.14388) 11959 : audit [DBG] from='client.261882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:47 smithi179 bash[23186]: cluster 2024-09-21T02:50:46.080015+0000 mgr.a (mgr.14388) 11958 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:47 smithi179 bash[23186]: audit 2024-09-21T02:50:46.098315+0000 mgr.a (mgr.14388) 11959 : audit [DBG] from='client.261882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:47 smithi049 bash[23528]: cluster 2024-09-21T02:50:46.080015+0000 mgr.a (mgr.14388) 11958 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:47 smithi049 bash[23528]: audit 2024-09-21T02:50:46.098315+0000 mgr.a (mgr.14388) 11959 : audit [DBG] from='client.261882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:48 smithi044 bash[22676]: cluster 2024-09-21T02:50:48.081120+0000 mgr.a (mgr.14388) 11960 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:50:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:48 smithi179 bash[23186]: cluster 2024-09-21T02:50:48.081120+0000 mgr.a (mgr.14388) 11960 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:50:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:48 smithi049 bash[23528]: cluster 2024-09-21T02:50:48.081120+0000 mgr.a (mgr.14388) 11960 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:50:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:51 smithi179 bash[23186]: audit 2024-09-21T02:50:50.058914+0000 mon.a (mon.0) 9778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:51 smithi179 bash[23186]: audit 2024-09-21T02:50:50.069519+0000 mon.a (mon.0) 9779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:51 smithi179 bash[23186]: audit 2024-09-21T02:50:50.081853+0000 mon.a (mon.0) 9780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:51 smithi179 bash[23186]: cluster 2024-09-21T02:50:50.084082+0000 mgr.a (mgr.14388) 11961 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:50:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:51 smithi044 bash[22676]: audit 2024-09-21T02:50:50.058914+0000 mon.a (mon.0) 9778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:51 smithi044 bash[22676]: audit 2024-09-21T02:50:50.069519+0000 mon.a (mon.0) 9779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:51 smithi044 bash[22676]: audit 2024-09-21T02:50:50.081853+0000 mon.a (mon.0) 9780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:51 smithi044 bash[22676]: cluster 2024-09-21T02:50:50.084082+0000 mgr.a (mgr.14388) 11961 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:50:51.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:51 smithi049 bash[23528]: audit 2024-09-21T02:50:50.058914+0000 mon.a (mon.0) 9778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:51 smithi049 bash[23528]: audit 2024-09-21T02:50:50.069519+0000 mon.a (mon.0) 9779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:51 smithi049 bash[23528]: audit 2024-09-21T02:50:50.081853+0000 mon.a (mon.0) 9780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:50:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:51 smithi049 bash[23528]: cluster 2024-09-21T02:50:50.084082+0000 mgr.a (mgr.14388) 11961 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:50:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:52.283 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:53.478 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:53 smithi049 bash[23528]: audit 2024-09-21T02:50:51.856540+0000 mgr.a (mgr.14388) 11962 : audit [DBG] from='client.261960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:53.478 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:53 smithi049 bash[23528]: cluster 2024-09-21T02:50:52.090339+0000 mgr.a (mgr.14388) 11963 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:53 smithi044 bash[22676]: audit 2024-09-21T02:50:51.856540+0000 mgr.a (mgr.14388) 11962 : audit [DBG] from='client.261960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:53 smithi044 bash[22676]: cluster 2024-09-21T02:50:52.090339+0000 mgr.a (mgr.14388) 11963 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:53 smithi179 bash[23186]: audit 2024-09-21T02:50:51.856540+0000 mgr.a (mgr.14388) 11962 : audit [DBG] from='client.261960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:53 smithi179 bash[23186]: cluster 2024-09-21T02:50:52.090339+0000 mgr.a (mgr.14388) 11963 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:55 smithi044 bash[22676]: cluster 2024-09-21T02:50:54.091272+0000 mgr.a (mgr.14388) 11964 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:55 smithi179 bash[23186]: cluster 2024-09-21T02:50:54.091272+0000 mgr.a (mgr.14388) 11964 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:55 smithi049 bash[23528]: cluster 2024-09-21T02:50:54.091272+0000 mgr.a (mgr.14388) 11964 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:57.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:50:57.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:50:57.285 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:50:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:57 smithi044 bash[22676]: cluster 2024-09-21T02:50:56.093539+0000 mgr.a (mgr.14388) 11965 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:50:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:57 smithi179 bash[23186]: cluster 2024-09-21T02:50:56.093539+0000 mgr.a (mgr.14388) 11965 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:50:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:57 smithi049 bash[23528]: cluster 2024-09-21T02:50:56.093539+0000 mgr.a (mgr.14388) 11965 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:50:58.064 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:50:58.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:50:58.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:50:58.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:50:58.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:50:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:58 smithi044 bash[22676]: audit 2024-09-21T02:50:57.613750+0000 mgr.a (mgr.14388) 11966 : audit [DBG] from='client.262038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:58 smithi179 bash[23186]: audit 2024-09-21T02:50:57.613750+0000 mgr.a (mgr.14388) 11966 : audit [DBG] from='client.262038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:58 smithi049 bash[23528]: audit 2024-09-21T02:50:57.613750+0000 mgr.a (mgr.14388) 11966 : audit [DBG] from='client.262038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:50:59 smithi044 bash[22676]: cluster 2024-09-21T02:50:58.094044+0000 mgr.a (mgr.14388) 11967 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:50:59 smithi179 bash[23186]: cluster 2024-09-21T02:50:58.094044+0000 mgr.a (mgr.14388) 11967 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:50:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:50:59 smithi049 bash[23528]: cluster 2024-09-21T02:50:58.094044+0000 mgr.a (mgr.14388) 11967 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:01 smithi179 bash[23186]: cluster 2024-09-21T02:51:00.096151+0000 mgr.a (mgr.14388) 11968 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:01 smithi044 bash[22676]: cluster 2024-09-21T02:51:00.096151+0000 mgr.a (mgr.14388) 11968 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:01 smithi049 bash[23528]: cluster 2024-09-21T02:51:00.096151+0000 mgr.a (mgr.14388) 11968 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:03.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:03.066 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:03.066 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:03 smithi044 bash[22676]: cluster 2024-09-21T02:51:02.096968+0000 mgr.a (mgr.14388) 11969 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:03 smithi044 bash[22676]: audit 2024-09-21T02:51:03.068842+0000 mon.a (mon.0) 9781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:03 smithi044 bash[22676]: audit 2024-09-21T02:51:03.074841+0000 mon.a (mon.0) 9782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:03 smithi044 bash[22676]: audit 2024-09-21T02:51:03.081793+0000 mon.a (mon.0) 9783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:03 smithi044 bash[22676]: audit 2024-09-21T02:51:03.156394+0000 mon.a (mon.0) 9784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:03 smithi044 bash[22676]: audit 2024-09-21T02:51:03.161234+0000 mon.a (mon.0) 9785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:03 smithi044 bash[22676]: audit 2024-09-21T02:51:03.166798+0000 mon.a (mon.0) 9786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:03 smithi179 bash[23186]: cluster 2024-09-21T02:51:02.096968+0000 mgr.a (mgr.14388) 11969 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:03 smithi179 bash[23186]: audit 2024-09-21T02:51:03.068842+0000 mon.a (mon.0) 9781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:03 smithi179 bash[23186]: audit 2024-09-21T02:51:03.074841+0000 mon.a (mon.0) 9782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:03 smithi179 bash[23186]: audit 2024-09-21T02:51:03.081793+0000 mon.a (mon.0) 9783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:03 smithi179 bash[23186]: audit 2024-09-21T02:51:03.156394+0000 mon.a (mon.0) 9784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:03 smithi179 bash[23186]: audit 2024-09-21T02:51:03.161234+0000 mon.a (mon.0) 9785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:03 smithi179 bash[23186]: audit 2024-09-21T02:51:03.166798+0000 mon.a (mon.0) 9786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:03 smithi049 bash[23528]: cluster 2024-09-21T02:51:02.096968+0000 mgr.a (mgr.14388) 11969 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:03 smithi049 bash[23528]: audit 2024-09-21T02:51:03.068842+0000 mon.a (mon.0) 9781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:03 smithi049 bash[23528]: audit 2024-09-21T02:51:03.074841+0000 mon.a (mon.0) 9782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:03 smithi049 bash[23528]: audit 2024-09-21T02:51:03.081793+0000 mon.a (mon.0) 9783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:03 smithi049 bash[23528]: audit 2024-09-21T02:51:03.156394+0000 mon.a (mon.0) 9784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:03 smithi049 bash[23528]: audit 2024-09-21T02:51:03.161234+0000 mon.a (mon.0) 9785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:03 smithi049 bash[23528]: audit 2024-09-21T02:51:03.166798+0000 mon.a (mon.0) 9786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:03.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:03.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:03.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:03.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:04.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:04 smithi044 bash[22676]: audit 2024-09-21T02:51:03.399710+0000 mgr.a (mgr.14388) 11970 : audit [DBG] from='client.262116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:04 smithi179 bash[23186]: audit 2024-09-21T02:51:03.399710+0000 mgr.a (mgr.14388) 11970 : audit [DBG] from='client.262116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:04 smithi049 bash[23528]: audit 2024-09-21T02:51:03.399710+0000 mgr.a (mgr.14388) 11970 : audit [DBG] from='client.262116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:05.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:05 smithi044 bash[22676]: cluster 2024-09-21T02:51:04.097965+0000 mgr.a (mgr.14388) 11971 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:05 smithi179 bash[23186]: cluster 2024-09-21T02:51:04.097965+0000 mgr.a (mgr.14388) 11971 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:05 smithi049 bash[23528]: cluster 2024-09-21T02:51:04.097965+0000 mgr.a (mgr.14388) 11971 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:07.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:07 smithi044 bash[22676]: cluster 2024-09-21T02:51:06.100238+0000 mgr.a (mgr.14388) 11972 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:07 smithi179 bash[23186]: cluster 2024-09-21T02:51:06.100238+0000 mgr.a (mgr.14388) 11972 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:07 smithi049 bash[23528]: cluster 2024-09-21T02:51:06.100238+0000 mgr.a (mgr.14388) 11972 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:09.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:09 smithi044 bash[22676]: cluster 2024-09-21T02:51:08.101108+0000 mgr.a (mgr.14388) 11973 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:09 smithi179 bash[23186]: cluster 2024-09-21T02:51:08.101108+0000 mgr.a (mgr.14388) 11973 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:09 smithi049 bash[23528]: cluster 2024-09-21T02:51:08.101108+0000 mgr.a (mgr.14388) 11973 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:09.595 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:09.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:09.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:09.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:09.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:10 smithi044 bash[22676]: audit 2024-09-21T02:51:09.184931+0000 mgr.a (mgr.14388) 11974 : audit [DBG] from='client.262194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:10 smithi179 bash[23186]: audit 2024-09-21T02:51:09.184931+0000 mgr.a (mgr.14388) 11974 : audit [DBG] from='client.262194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:10 smithi049 bash[23528]: audit 2024-09-21T02:51:09.184931+0000 mgr.a (mgr.14388) 11974 : audit [DBG] from='client.262194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:11 smithi049 bash[23528]: cluster 2024-09-21T02:51:10.103590+0000 mgr.a (mgr.14388) 11975 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:11 smithi049 bash[23528]: audit 2024-09-21T02:51:10.307442+0000 mon.a (mon.0) 9787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:11 smithi049 bash[23528]: audit 2024-09-21T02:51:10.316154+0000 mon.a (mon.0) 9788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:11 smithi049 bash[23528]: audit 2024-09-21T02:51:10.326831+0000 mon.a (mon.0) 9789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:11 smithi044 bash[22676]: cluster 2024-09-21T02:51:10.103590+0000 mgr.a (mgr.14388) 11975 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:11 smithi044 bash[22676]: audit 2024-09-21T02:51:10.307442+0000 mon.a (mon.0) 9787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:11 smithi044 bash[22676]: audit 2024-09-21T02:51:10.316154+0000 mon.a (mon.0) 9788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:11 smithi044 bash[22676]: audit 2024-09-21T02:51:10.326831+0000 mon.a (mon.0) 9789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:11 smithi179 bash[23186]: cluster 2024-09-21T02:51:10.103590+0000 mgr.a (mgr.14388) 11975 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:11 smithi179 bash[23186]: audit 2024-09-21T02:51:10.307442+0000 mon.a (mon.0) 9787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:11 smithi179 bash[23186]: audit 2024-09-21T02:51:10.316154+0000 mon.a (mon.0) 9788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:11 smithi179 bash[23186]: audit 2024-09-21T02:51:10.326831+0000 mon.a (mon.0) 9789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:13.657 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:13 smithi179 bash[23186]: cluster 2024-09-21T02:51:12.104447+0000 mgr.a (mgr.14388) 11976 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:13 smithi044 bash[22676]: cluster 2024-09-21T02:51:12.104447+0000 mgr.a (mgr.14388) 11976 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:13 smithi049 bash[23528]: cluster 2024-09-21T02:51:12.104447+0000 mgr.a (mgr.14388) 11976 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:14.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:14.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:14.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:15.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:15.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:15.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:15 smithi049 bash[23528]: cluster 2024-09-21T02:51:14.105038+0000 mgr.a (mgr.14388) 11977 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:15 smithi044 bash[22676]: cluster 2024-09-21T02:51:14.105038+0000 mgr.a (mgr.14388) 11977 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:15 smithi179 bash[23186]: cluster 2024-09-21T02:51:14.105038+0000 mgr.a (mgr.14388) 11977 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:16.604 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:16 smithi049 bash[23528]: audit 2024-09-21T02:51:14.937277+0000 mgr.a (mgr.14388) 11978 : audit [DBG] from='client.262272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:16 smithi044 bash[22676]: audit 2024-09-21T02:51:14.937277+0000 mgr.a (mgr.14388) 11978 : audit [DBG] from='client.262272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:16 smithi179 bash[23186]: audit 2024-09-21T02:51:14.937277+0000 mgr.a (mgr.14388) 11978 : audit [DBG] from='client.262272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:17.709 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:17 smithi044 bash[22676]: cluster 2024-09-21T02:51:16.107889+0000 mgr.a (mgr.14388) 11979 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:17 smithi179 bash[23186]: cluster 2024-09-21T02:51:16.107889+0000 mgr.a (mgr.14388) 11979 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:17 smithi049 bash[23528]: cluster 2024-09-21T02:51:16.107889+0000 mgr.a (mgr.14388) 11979 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:19 smithi044 bash[22676]: cluster 2024-09-21T02:51:18.108692+0000 mgr.a (mgr.14388) 11980 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:51:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:19 smithi179 bash[23186]: cluster 2024-09-21T02:51:18.108692+0000 mgr.a (mgr.14388) 11980 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:51:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:19 smithi049 bash[23528]: cluster 2024-09-21T02:51:18.108692+0000 mgr.a (mgr.14388) 11980 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:51:20.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:20.389 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:20.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:20 smithi044 bash[22676]: audit 2024-09-21T02:51:20.293041+0000 mon.a (mon.0) 9790 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:51:20.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:20 smithi044 bash[22676]: audit 2024-09-21T02:51:20.300035+0000 mon.a (mon.0) 9791 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:51:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:20 smithi044 bash[22676]: audit 2024-09-21T02:51:20.301955+0000 mon.a (mon.0) 9792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:51:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:20 smithi044 bash[22676]: audit 2024-09-21T02:51:20.313649+0000 mon.a (mon.0) 9793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:20 smithi044 bash[22676]: audit 2024-09-21T02:51:20.319972+0000 mon.a (mon.0) 9794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:51:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:20 smithi179 bash[23186]: audit 2024-09-21T02:51:20.293041+0000 mon.a (mon.0) 9790 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:51:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:20 smithi179 bash[23186]: audit 2024-09-21T02:51:20.300035+0000 mon.a (mon.0) 9791 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:51:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:20 smithi179 bash[23186]: audit 2024-09-21T02:51:20.301955+0000 mon.a (mon.0) 9792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:51:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:20 smithi179 bash[23186]: audit 2024-09-21T02:51:20.313649+0000 mon.a (mon.0) 9793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:20 smithi179 bash[23186]: audit 2024-09-21T02:51:20.319972+0000 mon.a (mon.0) 9794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:51:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:20 smithi049 bash[23528]: audit 2024-09-21T02:51:20.293041+0000 mon.a (mon.0) 9790 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:51:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:20 smithi049 bash[23528]: audit 2024-09-21T02:51:20.300035+0000 mon.a (mon.0) 9791 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:51:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:20 smithi049 bash[23528]: audit 2024-09-21T02:51:20.301955+0000 mon.a (mon.0) 9792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:51:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:20 smithi049 bash[23528]: audit 2024-09-21T02:51:20.313649+0000 mon.a (mon.0) 9793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:20 smithi049 bash[23528]: audit 2024-09-21T02:51:20.319972+0000 mon.a (mon.0) 9794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:51:21.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:51:21 smithi044 bash[22930]: debug 2024-09-21T02:51:21.097+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:51:21.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:51:21 smithi044 bash[22930]: debug 2024-09-21T02:51:21.113+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:51:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:21 smithi044 bash[22676]: cluster 2024-09-21T02:51:20.110650+0000 mgr.a (mgr.14388) 11981 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:21 smithi044 bash[22676]: audit 2024-09-21T02:51:20.322427+0000 mgr.a (mgr.14388) 11982 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:51:21.506 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:21.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:21.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:21.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:21.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:21 smithi179 bash[23186]: cluster 2024-09-21T02:51:20.110650+0000 mgr.a (mgr.14388) 11981 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:21 smithi179 bash[23186]: audit 2024-09-21T02:51:20.322427+0000 mgr.a (mgr.14388) 11982 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:51:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:21 smithi049 bash[23528]: cluster 2024-09-21T02:51:20.110650+0000 mgr.a (mgr.14388) 11981 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:21 smithi049 bash[23528]: audit 2024-09-21T02:51:20.322427+0000 mgr.a (mgr.14388) 11982 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:51:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:22 smithi044 bash[22676]: audit 2024-09-21T02:51:20.734895+0000 mgr.a (mgr.14388) 11983 : audit [DBG] from='client.262365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:22 smithi044 bash[22676]: audit 2024-09-21T02:51:21.104142+0000 mgr.a (mgr.14388) 11984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:51:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:22 smithi044 bash[22676]: cephadm 2024-09-21T02:51:21.117360+0000 mgr.a (mgr.14388) 11985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:51:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:22 smithi179 bash[23186]: audit 2024-09-21T02:51:20.734895+0000 mgr.a (mgr.14388) 11983 : audit [DBG] from='client.262365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:22 smithi179 bash[23186]: audit 2024-09-21T02:51:21.104142+0000 mgr.a (mgr.14388) 11984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:51:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:22 smithi179 bash[23186]: cephadm 2024-09-21T02:51:21.117360+0000 mgr.a (mgr.14388) 11985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:51:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:22 smithi049 bash[23528]: audit 2024-09-21T02:51:20.734895+0000 mgr.a (mgr.14388) 11983 : audit [DBG] from='client.262365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:22 smithi049 bash[23528]: audit 2024-09-21T02:51:21.104142+0000 mgr.a (mgr.14388) 11984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:51:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:22 smithi049 bash[23528]: cephadm 2024-09-21T02:51:21.117360+0000 mgr.a (mgr.14388) 11985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:51:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:23 smithi044 bash[22676]: cluster 2024-09-21T02:51:22.111635+0000 mgr.a (mgr.14388) 11986 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:51:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:23 smithi044 bash[22676]: audit 2024-09-21T02:51:23.245411+0000 mon.a (mon.0) 9795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:23 smithi044 bash[22676]: audit 2024-09-21T02:51:23.250768+0000 mon.a (mon.0) 9796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:23 smithi044 bash[22676]: audit 2024-09-21T02:51:23.257119+0000 mon.a (mon.0) 9797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:23 smithi044 bash[22676]: audit 2024-09-21T02:51:23.320494+0000 mon.a (mon.0) 9798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:23 smithi044 bash[22676]: audit 2024-09-21T02:51:23.326505+0000 mon.a (mon.0) 9799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:23 smithi044 bash[22676]: audit 2024-09-21T02:51:23.333354+0000 mon.a (mon.0) 9800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:23 smithi179 bash[23186]: cluster 2024-09-21T02:51:22.111635+0000 mgr.a (mgr.14388) 11986 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:51:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:23 smithi179 bash[23186]: audit 2024-09-21T02:51:23.245411+0000 mon.a (mon.0) 9795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:23 smithi179 bash[23186]: audit 2024-09-21T02:51:23.250768+0000 mon.a (mon.0) 9796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:23 smithi179 bash[23186]: audit 2024-09-21T02:51:23.257119+0000 mon.a (mon.0) 9797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:23 smithi179 bash[23186]: audit 2024-09-21T02:51:23.320494+0000 mon.a (mon.0) 9798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:23 smithi179 bash[23186]: audit 2024-09-21T02:51:23.326505+0000 mon.a (mon.0) 9799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:23 smithi179 bash[23186]: audit 2024-09-21T02:51:23.333354+0000 mon.a (mon.0) 9800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:23 smithi049 bash[23528]: cluster 2024-09-21T02:51:22.111635+0000 mgr.a (mgr.14388) 11986 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:51:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:23 smithi049 bash[23528]: audit 2024-09-21T02:51:23.245411+0000 mon.a (mon.0) 9795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:23 smithi049 bash[23528]: audit 2024-09-21T02:51:23.250768+0000 mon.a (mon.0) 9796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:23 smithi049 bash[23528]: audit 2024-09-21T02:51:23.257119+0000 mon.a (mon.0) 9797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:23 smithi049 bash[23528]: audit 2024-09-21T02:51:23.320494+0000 mon.a (mon.0) 9798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:23 smithi049 bash[23528]: audit 2024-09-21T02:51:23.326505+0000 mon.a (mon.0) 9799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:23 smithi049 bash[23528]: audit 2024-09-21T02:51:23.333354+0000 mon.a (mon.0) 9800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:25 smithi044 bash[22676]: cluster 2024-09-21T02:51:24.112474+0000 mgr.a (mgr.14388) 11987 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:25 smithi179 bash[23186]: cluster 2024-09-21T02:51:24.112474+0000 mgr.a (mgr.14388) 11987 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:25 smithi049 bash[23528]: cluster 2024-09-21T02:51:24.112474+0000 mgr.a (mgr.14388) 11987 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:26.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:27.278 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:27.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:27 smithi044 bash[22676]: cluster 2024-09-21T02:51:26.114716+0000 mgr.a (mgr.14388) 11988 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:27 smithi179 bash[23186]: cluster 2024-09-21T02:51:26.114716+0000 mgr.a (mgr.14388) 11988 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:27 smithi049 bash[23528]: cluster 2024-09-21T02:51:26.114716+0000 mgr.a (mgr.14388) 11988 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:28 smithi044 bash[22676]: audit 2024-09-21T02:51:26.842788+0000 mgr.a (mgr.14388) 11989 : audit [DBG] from='client.262533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:28 smithi179 bash[23186]: audit 2024-09-21T02:51:26.842788+0000 mgr.a (mgr.14388) 11989 : audit [DBG] from='client.262533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:28 smithi049 bash[23528]: audit 2024-09-21T02:51:26.842788+0000 mgr.a (mgr.14388) 11989 : audit [DBG] from='client.262533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:29 smithi044 bash[22676]: cluster 2024-09-21T02:51:28.115621+0000 mgr.a (mgr.14388) 11990 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:29 smithi179 bash[23186]: cluster 2024-09-21T02:51:28.115621+0000 mgr.a (mgr.14388) 11990 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:29 smithi049 bash[23528]: cluster 2024-09-21T02:51:28.115621+0000 mgr.a (mgr.14388) 11990 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:31.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:31 smithi049 bash[23528]: cluster 2024-09-21T02:51:30.117789+0000 mgr.a (mgr.14388) 11991 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:31.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:31 smithi049 bash[23528]: audit 2024-09-21T02:51:30.504455+0000 mon.a (mon.0) 9801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:31.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:31 smithi049 bash[23528]: audit 2024-09-21T02:51:30.514476+0000 mon.a (mon.0) 9802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:31.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:31 smithi049 bash[23528]: audit 2024-09-21T02:51:30.524842+0000 mon.a (mon.0) 9803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:31 smithi044 bash[22676]: cluster 2024-09-21T02:51:30.117789+0000 mgr.a (mgr.14388) 11991 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:31 smithi044 bash[22676]: audit 2024-09-21T02:51:30.504455+0000 mon.a (mon.0) 9801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:31 smithi044 bash[22676]: audit 2024-09-21T02:51:30.514476+0000 mon.a (mon.0) 9802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:31 smithi044 bash[22676]: audit 2024-09-21T02:51:30.524842+0000 mon.a (mon.0) 9803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:31 smithi179 bash[23186]: cluster 2024-09-21T02:51:30.117789+0000 mgr.a (mgr.14388) 11991 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:31 smithi179 bash[23186]: audit 2024-09-21T02:51:30.504455+0000 mon.a (mon.0) 9801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:31 smithi179 bash[23186]: audit 2024-09-21T02:51:30.514476+0000 mon.a (mon.0) 9802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:31 smithi179 bash[23186]: audit 2024-09-21T02:51:30.524842+0000 mon.a (mon.0) 9803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:32.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:32.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:32.281 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:33.061 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:33.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:33.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:33.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:33.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:33 smithi049 bash[23528]: cluster 2024-09-21T02:51:32.118572+0000 mgr.a (mgr.14388) 11992 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:33 smithi049 bash[23528]: audit 2024-09-21T02:51:32.618858+0000 mgr.a (mgr.14388) 11993 : audit [DBG] from='client.262611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:33.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:33 smithi179 bash[23186]: cluster 2024-09-21T02:51:32.118572+0000 mgr.a (mgr.14388) 11992 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:33.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:33 smithi179 bash[23186]: audit 2024-09-21T02:51:32.618858+0000 mgr.a (mgr.14388) 11993 : audit [DBG] from='client.262611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:33 smithi044 bash[22676]: cluster 2024-09-21T02:51:32.118572+0000 mgr.a (mgr.14388) 11992 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:33 smithi044 bash[22676]: audit 2024-09-21T02:51:32.618858+0000 mgr.a (mgr.14388) 11993 : audit [DBG] from='client.262611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:35 smithi044 bash[22676]: cluster 2024-09-21T02:51:34.119635+0000 mgr.a (mgr.14388) 11994 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:35 smithi049 bash[23528]: cluster 2024-09-21T02:51:34.119635+0000 mgr.a (mgr.14388) 11994 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:35 smithi179 bash[23186]: cluster 2024-09-21T02:51:34.119635+0000 mgr.a (mgr.14388) 11994 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:37.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:37 smithi044 bash[22676]: cluster 2024-09-21T02:51:36.122039+0000 mgr.a (mgr.14388) 11995 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:37 smithi049 bash[23528]: cluster 2024-09-21T02:51:36.122039+0000 mgr.a (mgr.14388) 11995 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:37 smithi179 bash[23186]: cluster 2024-09-21T02:51:36.122039+0000 mgr.a (mgr.14388) 11995 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:51:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:38.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:38.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:38.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:38.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:38.853 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:39 smithi049 bash[23528]: cluster 2024-09-21T02:51:38.122809+0000 mgr.a (mgr.14388) 11996 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:39 smithi049 bash[23528]: audit 2024-09-21T02:51:38.407062+0000 mgr.a (mgr.14388) 11997 : audit [DBG] from='client.262689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:39 smithi044 bash[22676]: cluster 2024-09-21T02:51:38.122809+0000 mgr.a (mgr.14388) 11996 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:39 smithi044 bash[22676]: audit 2024-09-21T02:51:38.407062+0000 mgr.a (mgr.14388) 11997 : audit [DBG] from='client.262689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:39 smithi179 bash[23186]: cluster 2024-09-21T02:51:38.122809+0000 mgr.a (mgr.14388) 11996 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:39 smithi179 bash[23186]: audit 2024-09-21T02:51:38.407062+0000 mgr.a (mgr.14388) 11997 : audit [DBG] from='client.262689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:41 smithi049 bash[23528]: cluster 2024-09-21T02:51:40.125056+0000 mgr.a (mgr.14388) 11998 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:41 smithi044 bash[22676]: cluster 2024-09-21T02:51:40.125056+0000 mgr.a (mgr.14388) 11998 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:41 smithi179 bash[23186]: cluster 2024-09-21T02:51:40.125056+0000 mgr.a (mgr.14388) 11998 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:43 smithi179 bash[23186]: cluster 2024-09-21T02:51:42.125851+0000 mgr.a (mgr.14388) 11999 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:43 smithi179 bash[23186]: audit 2024-09-21T02:51:43.453978+0000 mon.a (mon.0) 9804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:43 smithi179 bash[23186]: audit 2024-09-21T02:51:43.462493+0000 mon.a (mon.0) 9805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:43 smithi179 bash[23186]: audit 2024-09-21T02:51:43.471188+0000 mon.a (mon.0) 9806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:43 smithi049 bash[23528]: cluster 2024-09-21T02:51:42.125851+0000 mgr.a (mgr.14388) 11999 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:43 smithi049 bash[23528]: audit 2024-09-21T02:51:43.453978+0000 mon.a (mon.0) 9804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:43 smithi049 bash[23528]: audit 2024-09-21T02:51:43.462493+0000 mon.a (mon.0) 9805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:43 smithi049 bash[23528]: audit 2024-09-21T02:51:43.471188+0000 mon.a (mon.0) 9806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.854 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:43.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:43.855 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:43 smithi044 bash[22676]: cluster 2024-09-21T02:51:42.125851+0000 mgr.a (mgr.14388) 11999 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:43 smithi044 bash[22676]: audit 2024-09-21T02:51:43.453978+0000 mon.a (mon.0) 9804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:43 smithi044 bash[22676]: audit 2024-09-21T02:51:43.462493+0000 mon.a (mon.0) 9805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:43 smithi044 bash[22676]: audit 2024-09-21T02:51:43.471188+0000 mon.a (mon.0) 9806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:44.631 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:44.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:44 smithi044 bash[22676]: audit 2024-09-21T02:51:43.559096+0000 mon.a (mon.0) 9807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:44 smithi044 bash[22676]: audit 2024-09-21T02:51:43.567393+0000 mon.a (mon.0) 9808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:44 smithi044 bash[22676]: audit 2024-09-21T02:51:43.577579+0000 mon.a (mon.0) 9809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:44 smithi179 bash[23186]: audit 2024-09-21T02:51:43.559096+0000 mon.a (mon.0) 9807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:44 smithi179 bash[23186]: audit 2024-09-21T02:51:43.567393+0000 mon.a (mon.0) 9808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:44 smithi179 bash[23186]: audit 2024-09-21T02:51:43.577579+0000 mon.a (mon.0) 9809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:44 smithi049 bash[23528]: audit 2024-09-21T02:51:43.559096+0000 mon.a (mon.0) 9807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:44 smithi049 bash[23528]: audit 2024-09-21T02:51:43.567393+0000 mon.a (mon.0) 9808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:44 smithi049 bash[23528]: audit 2024-09-21T02:51:43.577579+0000 mon.a (mon.0) 9809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:45 smithi044 bash[22676]: cluster 2024-09-21T02:51:44.126595+0000 mgr.a (mgr.14388) 12000 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:45 smithi044 bash[22676]: audit 2024-09-21T02:51:44.193187+0000 mgr.a (mgr.14388) 12001 : audit [DBG] from='client.262767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:45 smithi179 bash[23186]: cluster 2024-09-21T02:51:44.126595+0000 mgr.a (mgr.14388) 12000 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:45 smithi179 bash[23186]: audit 2024-09-21T02:51:44.193187+0000 mgr.a (mgr.14388) 12001 : audit [DBG] from='client.262767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:45 smithi049 bash[23528]: cluster 2024-09-21T02:51:44.126595+0000 mgr.a (mgr.14388) 12000 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:45 smithi049 bash[23528]: audit 2024-09-21T02:51:44.193187+0000 mgr.a (mgr.14388) 12001 : audit [DBG] from='client.262767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:47 smithi044 bash[22676]: cluster 2024-09-21T02:51:46.128964+0000 mgr.a (mgr.14388) 12002 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:47 smithi179 bash[23186]: cluster 2024-09-21T02:51:46.128964+0000 mgr.a (mgr.14388) 12002 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:47 smithi049 bash[23528]: cluster 2024-09-21T02:51:46.128964+0000 mgr.a (mgr.14388) 12002 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:51:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:49.634 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:49 smithi044 bash[22676]: cluster 2024-09-21T02:51:48.129820+0000 mgr.a (mgr.14388) 12003 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:49 smithi179 bash[23186]: cluster 2024-09-21T02:51:48.129820+0000 mgr.a (mgr.14388) 12003 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:49 smithi049 bash[23528]: cluster 2024-09-21T02:51:48.129820+0000 mgr.a (mgr.14388) 12003 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:50.402 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:50.402 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:51 smithi044 bash[22676]: audit 2024-09-21T02:51:49.969370+0000 mgr.a (mgr.14388) 12004 : audit [DBG] from='client.262845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:51 smithi044 bash[22676]: cluster 2024-09-21T02:51:50.131173+0000 mgr.a (mgr.14388) 12005 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:51 smithi044 bash[22676]: audit 2024-09-21T02:51:50.738586+0000 mon.a (mon.0) 9810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:51 smithi044 bash[22676]: audit 2024-09-21T02:51:50.746975+0000 mon.a (mon.0) 9811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:51 smithi044 bash[22676]: audit 2024-09-21T02:51:50.757389+0000 mon.a (mon.0) 9812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:51 smithi179 bash[23186]: audit 2024-09-21T02:51:49.969370+0000 mgr.a (mgr.14388) 12004 : audit [DBG] from='client.262845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:51 smithi179 bash[23186]: cluster 2024-09-21T02:51:50.131173+0000 mgr.a (mgr.14388) 12005 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:51 smithi179 bash[23186]: audit 2024-09-21T02:51:50.738586+0000 mon.a (mon.0) 9810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:51 smithi179 bash[23186]: audit 2024-09-21T02:51:50.746975+0000 mon.a (mon.0) 9811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:51 smithi179 bash[23186]: audit 2024-09-21T02:51:50.757389+0000 mon.a (mon.0) 9812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:51 smithi049 bash[23528]: audit 2024-09-21T02:51:49.969370+0000 mgr.a (mgr.14388) 12004 : audit [DBG] from='client.262845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:51 smithi049 bash[23528]: cluster 2024-09-21T02:51:50.131173+0000 mgr.a (mgr.14388) 12005 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:51 smithi049 bash[23528]: audit 2024-09-21T02:51:50.738586+0000 mon.a (mon.0) 9810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:51 smithi049 bash[23528]: audit 2024-09-21T02:51:50.746975+0000 mon.a (mon.0) 9811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:51 smithi049 bash[23528]: audit 2024-09-21T02:51:50.757389+0000 mon.a (mon.0) 9812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:51:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:53 smithi044 bash[22676]: cluster 2024-09-21T02:51:52.132046+0000 mgr.a (mgr.14388) 12006 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:53 smithi179 bash[23186]: cluster 2024-09-21T02:51:52.132046+0000 mgr.a (mgr.14388) 12006 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:53 smithi049 bash[23528]: cluster 2024-09-21T02:51:52.132046+0000 mgr.a (mgr.14388) 12006 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:55.275 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:55 smithi044 bash[22676]: cluster 2024-09-21T02:51:54.133032+0000 mgr.a (mgr.14388) 12007 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:55 smithi049 bash[23528]: cluster 2024-09-21T02:51:54.133032+0000 mgr.a (mgr.14388) 12007 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:55.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:51:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:51:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:51:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:55 smithi179 bash[23186]: cluster 2024-09-21T02:51:54.133032+0000 mgr.a (mgr.14388) 12007 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:56.181 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:51:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:51:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:51:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:51:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:51:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:57 smithi044 bash[22676]: audit 2024-09-21T02:51:55.734189+0000 mgr.a (mgr.14388) 12008 : audit [DBG] from='client.262923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:57 smithi044 bash[22676]: cluster 2024-09-21T02:51:56.134400+0000 mgr.a (mgr.14388) 12009 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:57 smithi179 bash[23186]: audit 2024-09-21T02:51:55.734189+0000 mgr.a (mgr.14388) 12008 : audit [DBG] from='client.262923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:57 smithi179 bash[23186]: cluster 2024-09-21T02:51:56.134400+0000 mgr.a (mgr.14388) 12009 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:57 smithi049 bash[23528]: audit 2024-09-21T02:51:55.734189+0000 mgr.a (mgr.14388) 12008 : audit [DBG] from='client.262923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:57 smithi049 bash[23528]: cluster 2024-09-21T02:51:56.134400+0000 mgr.a (mgr.14388) 12009 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:51:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:51:59 smithi044 bash[22676]: cluster 2024-09-21T02:51:58.135176+0000 mgr.a (mgr.14388) 12010 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:51:59 smithi179 bash[23186]: cluster 2024-09-21T02:51:58.135176+0000 mgr.a (mgr.14388) 12010 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:51:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:51:59 smithi049 bash[23528]: cluster 2024-09-21T02:51:58.135176+0000 mgr.a (mgr.14388) 12010 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:52:01.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:01 smithi044 bash[22676]: cluster 2024-09-21T02:52:00.137085+0000 mgr.a (mgr.14388) 12011 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:01 smithi179 bash[23186]: cluster 2024-09-21T02:52:00.137085+0000 mgr.a (mgr.14388) 12011 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:01 smithi049 bash[23528]: cluster 2024-09-21T02:52:00.137085+0000 mgr.a (mgr.14388) 12011 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:01.940 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:01.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:01.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:01.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:01.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:02.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:02 smithi044 bash[22676]: audit 2024-09-21T02:52:01.506495+0000 mgr.a (mgr.14388) 12012 : audit [DBG] from='client.263001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:02 smithi179 bash[23186]: audit 2024-09-21T02:52:01.506495+0000 mgr.a (mgr.14388) 12012 : audit [DBG] from='client.263001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:02 smithi049 bash[23528]: audit 2024-09-21T02:52:01.506495+0000 mgr.a (mgr.14388) 12012 : audit [DBG] from='client.263001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:03 smithi044 bash[22676]: cluster 2024-09-21T02:52:02.138072+0000 mgr.a (mgr.14388) 12013 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:03 smithi179 bash[23186]: cluster 2024-09-21T02:52:02.138072+0000 mgr.a (mgr.14388) 12013 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:03 smithi049 bash[23528]: cluster 2024-09-21T02:52:02.138072+0000 mgr.a (mgr.14388) 12013 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:04 smithi044 bash[22676]: audit 2024-09-21T02:52:03.670851+0000 mon.a (mon.0) 9813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:04 smithi044 bash[22676]: audit 2024-09-21T02:52:03.676343+0000 mon.a (mon.0) 9814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:04 smithi044 bash[22676]: audit 2024-09-21T02:52:03.682984+0000 mon.a (mon.0) 9815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:04 smithi044 bash[22676]: audit 2024-09-21T02:52:03.745750+0000 mon.a (mon.0) 9816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:04 smithi044 bash[22676]: audit 2024-09-21T02:52:03.750459+0000 mon.a (mon.0) 9817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:04 smithi044 bash[22676]: audit 2024-09-21T02:52:03.755256+0000 mon.a (mon.0) 9818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:04 smithi179 bash[23186]: audit 2024-09-21T02:52:03.670851+0000 mon.a (mon.0) 9813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:04 smithi179 bash[23186]: audit 2024-09-21T02:52:03.676343+0000 mon.a (mon.0) 9814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:04 smithi179 bash[23186]: audit 2024-09-21T02:52:03.682984+0000 mon.a (mon.0) 9815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:04 smithi179 bash[23186]: audit 2024-09-21T02:52:03.745750+0000 mon.a (mon.0) 9816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:04 smithi179 bash[23186]: audit 2024-09-21T02:52:03.750459+0000 mon.a (mon.0) 9817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:04 smithi179 bash[23186]: audit 2024-09-21T02:52:03.755256+0000 mon.a (mon.0) 9818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:04 smithi049 bash[23528]: audit 2024-09-21T02:52:03.670851+0000 mon.a (mon.0) 9813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:04 smithi049 bash[23528]: audit 2024-09-21T02:52:03.676343+0000 mon.a (mon.0) 9814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:04 smithi049 bash[23528]: audit 2024-09-21T02:52:03.682984+0000 mon.a (mon.0) 9815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:04 smithi049 bash[23528]: audit 2024-09-21T02:52:03.745750+0000 mon.a (mon.0) 9816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:04 smithi049 bash[23528]: audit 2024-09-21T02:52:03.750459+0000 mon.a (mon.0) 9817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:04 smithi049 bash[23528]: audit 2024-09-21T02:52:03.755256+0000 mon.a (mon.0) 9818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:05 smithi044 bash[22676]: cluster 2024-09-21T02:52:04.138871+0000 mgr.a (mgr.14388) 12014 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:05 smithi179 bash[23186]: cluster 2024-09-21T02:52:04.138871+0000 mgr.a (mgr.14388) 12014 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:05 smithi049 bash[23528]: cluster 2024-09-21T02:52:04.138871+0000 mgr.a (mgr.14388) 12014 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:06.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:06.942 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:07.727 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:07.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:07.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:07.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:07.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:07 smithi044 bash[22676]: cluster 2024-09-21T02:52:06.141056+0000 mgr.a (mgr.14388) 12015 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:07 smithi179 bash[23186]: cluster 2024-09-21T02:52:06.141056+0000 mgr.a (mgr.14388) 12015 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:07 smithi049 bash[23528]: cluster 2024-09-21T02:52:06.141056+0000 mgr.a (mgr.14388) 12015 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:08 smithi044 bash[22676]: audit 2024-09-21T02:52:07.277988+0000 mgr.a (mgr.14388) 12016 : audit [DBG] from='client.263079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:08 smithi179 bash[23186]: audit 2024-09-21T02:52:07.277988+0000 mgr.a (mgr.14388) 12016 : audit [DBG] from='client.263079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:08 smithi049 bash[23528]: audit 2024-09-21T02:52:07.277988+0000 mgr.a (mgr.14388) 12016 : audit [DBG] from='client.263079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:09 smithi044 bash[22676]: cluster 2024-09-21T02:52:08.141958+0000 mgr.a (mgr.14388) 12017 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:09 smithi179 bash[23186]: cluster 2024-09-21T02:52:08.141958+0000 mgr.a (mgr.14388) 12017 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:09 smithi049 bash[23528]: cluster 2024-09-21T02:52:08.141958+0000 mgr.a (mgr.14388) 12017 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:11 smithi179 bash[23186]: cluster 2024-09-21T02:52:10.144106+0000 mgr.a (mgr.14388) 12018 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:11 smithi179 bash[23186]: audit 2024-09-21T02:52:10.958172+0000 mon.a (mon.0) 9819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:11 smithi179 bash[23186]: audit 2024-09-21T02:52:10.967216+0000 mon.a (mon.0) 9820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:11 smithi179 bash[23186]: audit 2024-09-21T02:52:10.978067+0000 mon.a (mon.0) 9821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:11 smithi044 bash[22676]: cluster 2024-09-21T02:52:10.144106+0000 mgr.a (mgr.14388) 12018 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:11 smithi044 bash[22676]: audit 2024-09-21T02:52:10.958172+0000 mon.a (mon.0) 9819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:11 smithi044 bash[22676]: audit 2024-09-21T02:52:10.967216+0000 mon.a (mon.0) 9820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:11 smithi044 bash[22676]: audit 2024-09-21T02:52:10.978067+0000 mon.a (mon.0) 9821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:11 smithi049 bash[23528]: cluster 2024-09-21T02:52:10.144106+0000 mgr.a (mgr.14388) 12018 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:11 smithi049 bash[23528]: audit 2024-09-21T02:52:10.958172+0000 mon.a (mon.0) 9819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:11 smithi049 bash[23528]: audit 2024-09-21T02:52:10.967216+0000 mon.a (mon.0) 9820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:11 smithi049 bash[23528]: audit 2024-09-21T02:52:10.978067+0000 mon.a (mon.0) 9821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:13.511 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:13 smithi044 bash[22676]: cluster 2024-09-21T02:52:12.144883+0000 mgr.a (mgr.14388) 12019 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:13 smithi179 bash[23186]: cluster 2024-09-21T02:52:12.144883+0000 mgr.a (mgr.14388) 12019 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:13 smithi049 bash[23528]: cluster 2024-09-21T02:52:12.144883+0000 mgr.a (mgr.14388) 12019 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:14.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:14 smithi044 bash[22676]: audit 2024-09-21T02:52:13.066272+0000 mgr.a (mgr.14388) 12020 : audit [DBG] from='client.263154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:14 smithi179 bash[23186]: audit 2024-09-21T02:52:13.066272+0000 mgr.a (mgr.14388) 12020 : audit [DBG] from='client.263154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:14 smithi049 bash[23528]: audit 2024-09-21T02:52:13.066272+0000 mgr.a (mgr.14388) 12020 : audit [DBG] from='client.263154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:15 smithi044 bash[22676]: cluster 2024-09-21T02:52:14.145817+0000 mgr.a (mgr.14388) 12021 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:15 smithi179 bash[23186]: cluster 2024-09-21T02:52:14.145817+0000 mgr.a (mgr.14388) 12021 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:16.020 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:15 smithi049 bash[23528]: cluster 2024-09-21T02:52:14.145817+0000 mgr.a (mgr.14388) 12021 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:17 smithi044 bash[22676]: cluster 2024-09-21T02:52:16.147992+0000 mgr.a (mgr.14388) 12022 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T02:52:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:17 smithi179 bash[23186]: cluster 2024-09-21T02:52:16.147992+0000 mgr.a (mgr.14388) 12022 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T02:52:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:17 smithi049 bash[23528]: cluster 2024-09-21T02:52:16.147992+0000 mgr.a (mgr.14388) 12022 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T02:52:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:19.303 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:19.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:19 smithi044 bash[22676]: cluster 2024-09-21T02:52:18.148820+0000 mgr.a (mgr.14388) 12023 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:19 smithi179 bash[23186]: cluster 2024-09-21T02:52:18.148820+0000 mgr.a (mgr.14388) 12023 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:19 smithi049 bash[23528]: cluster 2024-09-21T02:52:18.148820+0000 mgr.a (mgr.14388) 12023 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:20 smithi044 bash[22676]: audit 2024-09-21T02:52:18.848053+0000 mgr.a (mgr.14388) 12024 : audit [DBG] from='client.263226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:20 smithi044 bash[22676]: cluster 2024-09-21T02:52:20.151144+0000 mgr.a (mgr.14388) 12025 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T02:52:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:20 smithi179 bash[23186]: audit 2024-09-21T02:52:18.848053+0000 mgr.a (mgr.14388) 12024 : audit [DBG] from='client.263226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:20 smithi179 bash[23186]: cluster 2024-09-21T02:52:20.151144+0000 mgr.a (mgr.14388) 12025 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T02:52:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:20 smithi049 bash[23528]: audit 2024-09-21T02:52:18.848053+0000 mgr.a (mgr.14388) 12024 : audit [DBG] from='client.263226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:20 smithi049 bash[23528]: cluster 2024-09-21T02:52:20.151144+0000 mgr.a (mgr.14388) 12025 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T02:52:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22676]: audit 2024-09-21T02:52:21.179350+0000 mon.a (mon.0) 9822 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:52:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22676]: audit 2024-09-21T02:52:21.186570+0000 mon.a (mon.0) 9823 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:52:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22676]: audit 2024-09-21T02:52:21.188446+0000 mon.a (mon.0) 9824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:52:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22676]: audit 2024-09-21T02:52:21.199817+0000 mon.a (mon.0) 9825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22676]: audit 2024-09-21T02:52:21.206236+0000 mon.a (mon.0) 9826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:52:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22676]: audit 2024-09-21T02:52:21.208665+0000 mgr.a (mgr.14388) 12026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:52:22.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:21 smithi179 bash[23186]: audit 2024-09-21T02:52:21.179350+0000 mon.a (mon.0) 9822 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:52:22.817 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:21 smithi179 bash[23186]: audit 2024-09-21T02:52:21.186570+0000 mon.a (mon.0) 9823 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:52:22.817 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:21 smithi179 bash[23186]: audit 2024-09-21T02:52:21.188446+0000 mon.a (mon.0) 9824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:52:22.817 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:21 smithi179 bash[23186]: audit 2024-09-21T02:52:21.199817+0000 mon.a (mon.0) 9825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:22.817 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:21 smithi179 bash[23186]: audit 2024-09-21T02:52:21.206236+0000 mon.a (mon.0) 9826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:52:22.817 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:21 smithi179 bash[23186]: audit 2024-09-21T02:52:21.208665+0000 mgr.a (mgr.14388) 12026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:52:22.818 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22930]: debug 2024-09-21T02:52:21.984+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:52:22.818 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:52:21 smithi044 bash[22930]: debug 2024-09-21T02:52:21.988+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:52:22.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:21 smithi049 bash[23528]: audit 2024-09-21T02:52:21.179350+0000 mon.a (mon.0) 9822 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:52:22.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:21 smithi049 bash[23528]: audit 2024-09-21T02:52:21.186570+0000 mon.a (mon.0) 9823 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:52:22.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:21 smithi049 bash[23528]: audit 2024-09-21T02:52:21.188446+0000 mon.a (mon.0) 9824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:52:22.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:21 smithi049 bash[23528]: audit 2024-09-21T02:52:21.199817+0000 mon.a (mon.0) 9825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:22.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:21 smithi049 bash[23528]: audit 2024-09-21T02:52:21.206236+0000 mon.a (mon.0) 9826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:52:22.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:21 smithi049 bash[23528]: audit 2024-09-21T02:52:21.208665+0000 mgr.a (mgr.14388) 12026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:52:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:22 smithi179 bash[23186]: audit 2024-09-21T02:52:21.988178+0000 mgr.a (mgr.14388) 12027 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:52:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:22 smithi179 bash[23186]: cephadm 2024-09-21T02:52:21.989389+0000 mgr.a (mgr.14388) 12028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:52:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:22 smithi179 bash[23186]: cluster 2024-09-21T02:52:22.152025+0000 mgr.a (mgr.14388) 12029 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:22 smithi049 bash[23528]: audit 2024-09-21T02:52:21.988178+0000 mgr.a (mgr.14388) 12027 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:52:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:22 smithi049 bash[23528]: cephadm 2024-09-21T02:52:21.989389+0000 mgr.a (mgr.14388) 12028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:52:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:22 smithi049 bash[23528]: cluster 2024-09-21T02:52:22.152025+0000 mgr.a (mgr.14388) 12029 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:23.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:22 smithi044 bash[22676]: audit 2024-09-21T02:52:21.988178+0000 mgr.a (mgr.14388) 12027 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:52:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:22 smithi044 bash[22676]: cephadm 2024-09-21T02:52:21.989389+0000 mgr.a (mgr.14388) 12028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:52:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:22 smithi044 bash[22676]: cluster 2024-09-21T02:52:22.152025+0000 mgr.a (mgr.14388) 12029 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:24.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:24.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:24.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:25.086 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:25.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: audit 2024-09-21T02:52:23.884253+0000 mon.a (mon.0) 9827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: audit 2024-09-21T02:52:23.890413+0000 mon.a (mon.0) 9828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: audit 2024-09-21T02:52:23.897955+0000 mon.a (mon.0) 9829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: audit 2024-09-21T02:52:23.944072+0000 mon.a (mon.0) 9830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: audit 2024-09-21T02:52:23.951755+0000 mon.a (mon.0) 9831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: audit 2024-09-21T02:52:23.959929+0000 mon.a (mon.0) 9832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: cluster 2024-09-21T02:52:24.152846+0000 mgr.a (mgr.14388) 12030 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:24 smithi044 bash[22676]: audit 2024-09-21T02:52:24.626041+0000 mgr.a (mgr.14388) 12031 : audit [DBG] from='client.263409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: audit 2024-09-21T02:52:23.884253+0000 mon.a (mon.0) 9827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: audit 2024-09-21T02:52:23.890413+0000 mon.a (mon.0) 9828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: audit 2024-09-21T02:52:23.897955+0000 mon.a (mon.0) 9829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: audit 2024-09-21T02:52:23.944072+0000 mon.a (mon.0) 9830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: audit 2024-09-21T02:52:23.951755+0000 mon.a (mon.0) 9831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: audit 2024-09-21T02:52:23.959929+0000 mon.a (mon.0) 9832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: cluster 2024-09-21T02:52:24.152846+0000 mgr.a (mgr.14388) 12030 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:24 smithi179 bash[23186]: audit 2024-09-21T02:52:24.626041+0000 mgr.a (mgr.14388) 12031 : audit [DBG] from='client.263409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: audit 2024-09-21T02:52:23.884253+0000 mon.a (mon.0) 9827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: audit 2024-09-21T02:52:23.890413+0000 mon.a (mon.0) 9828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: audit 2024-09-21T02:52:23.897955+0000 mon.a (mon.0) 9829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: audit 2024-09-21T02:52:23.944072+0000 mon.a (mon.0) 9830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: audit 2024-09-21T02:52:23.951755+0000 mon.a (mon.0) 9831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: audit 2024-09-21T02:52:23.959929+0000 mon.a (mon.0) 9832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: cluster 2024-09-21T02:52:24.152846+0000 mgr.a (mgr.14388) 12030 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:52:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:24 smithi049 bash[23528]: audit 2024-09-21T02:52:24.626041+0000 mgr.a (mgr.14388) 12031 : audit [DBG] from='client.263409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:27.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:27 smithi044 bash[22676]: cluster 2024-09-21T02:52:26.155161+0000 mgr.a (mgr.14388) 12032 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 8.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T02:52:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:27 smithi179 bash[23186]: cluster 2024-09-21T02:52:26.155161+0000 mgr.a (mgr.14388) 12032 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 8.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T02:52:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:27 smithi049 bash[23528]: cluster 2024-09-21T02:52:26.155161+0000 mgr.a (mgr.14388) 12032 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 8.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T02:52:29.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:29 smithi044 bash[22676]: cluster 2024-09-21T02:52:28.155926+0000 mgr.a (mgr.14388) 12033 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:29 smithi179 bash[23186]: cluster 2024-09-21T02:52:28.155926+0000 mgr.a (mgr.14388) 12033 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:29 smithi049 bash[23528]: cluster 2024-09-21T02:52:28.155926+0000 mgr.a (mgr.14388) 12033 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:30.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:30.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:30.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:30.846 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:31 smithi044 bash[22676]: cluster 2024-09-21T02:52:30.157334+0000 mgr.a (mgr.14388) 12034 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:52:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:31 smithi044 bash[22676]: audit 2024-09-21T02:52:30.417442+0000 mgr.a (mgr.14388) 12035 : audit [DBG] from='client.263487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:31 smithi044 bash[22676]: audit 2024-09-21T02:52:31.155395+0000 mon.a (mon.0) 9833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:31 smithi044 bash[22676]: audit 2024-09-21T02:52:31.165358+0000 mon.a (mon.0) 9834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:31 smithi044 bash[22676]: audit 2024-09-21T02:52:31.177218+0000 mon.a (mon.0) 9835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:31 smithi179 bash[23186]: cluster 2024-09-21T02:52:30.157334+0000 mgr.a (mgr.14388) 12034 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:52:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:31 smithi179 bash[23186]: audit 2024-09-21T02:52:30.417442+0000 mgr.a (mgr.14388) 12035 : audit [DBG] from='client.263487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:31 smithi179 bash[23186]: audit 2024-09-21T02:52:31.155395+0000 mon.a (mon.0) 9833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:31 smithi179 bash[23186]: audit 2024-09-21T02:52:31.165358+0000 mon.a (mon.0) 9834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:31 smithi179 bash[23186]: audit 2024-09-21T02:52:31.177218+0000 mon.a (mon.0) 9835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:31 smithi049 bash[23528]: cluster 2024-09-21T02:52:30.157334+0000 mgr.a (mgr.14388) 12034 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:52:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:31 smithi049 bash[23528]: audit 2024-09-21T02:52:30.417442+0000 mgr.a (mgr.14388) 12035 : audit [DBG] from='client.263487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:31 smithi049 bash[23528]: audit 2024-09-21T02:52:31.155395+0000 mon.a (mon.0) 9833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:31 smithi049 bash[23528]: audit 2024-09-21T02:52:31.165358+0000 mon.a (mon.0) 9834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:31 smithi049 bash[23528]: audit 2024-09-21T02:52:31.177218+0000 mon.a (mon.0) 9835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:33 smithi044 bash[22676]: cluster 2024-09-21T02:52:32.158213+0000 mgr.a (mgr.14388) 12036 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:33 smithi179 bash[23186]: cluster 2024-09-21T02:52:32.158213+0000 mgr.a (mgr.14388) 12036 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:33 smithi049 bash[23528]: cluster 2024-09-21T02:52:32.158213+0000 mgr.a (mgr.14388) 12036 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:35 smithi044 bash[22676]: cluster 2024-09-21T02:52:34.158994+0000 mgr.a (mgr.14388) 12037 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:35.500 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:35 smithi049 bash[23528]: cluster 2024-09-21T02:52:34.158994+0000 mgr.a (mgr.14388) 12037 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:35 smithi179 bash[23186]: cluster 2024-09-21T02:52:34.158994+0000 mgr.a (mgr.14388) 12037 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:52:35.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:35.848 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:35.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:36.637 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:36.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:36.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:36.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:36.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:37 smithi044 bash[22676]: cluster 2024-09-21T02:52:36.161156+0000 mgr.a (mgr.14388) 12038 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:52:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:37 smithi044 bash[22676]: audit 2024-09-21T02:52:36.190126+0000 mgr.a (mgr.14388) 12039 : audit [DBG] from='client.263565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:37 smithi179 bash[23186]: cluster 2024-09-21T02:52:36.161156+0000 mgr.a (mgr.14388) 12038 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:52:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:37 smithi179 bash[23186]: audit 2024-09-21T02:52:36.190126+0000 mgr.a (mgr.14388) 12039 : audit [DBG] from='client.263565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:37 smithi049 bash[23528]: cluster 2024-09-21T02:52:36.161156+0000 mgr.a (mgr.14388) 12038 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:52:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:37 smithi049 bash[23528]: audit 2024-09-21T02:52:36.190126+0000 mgr.a (mgr.14388) 12039 : audit [DBG] from='client.263565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:39 smithi179 bash[23186]: cluster 2024-09-21T02:52:38.161860+0000 mgr.a (mgr.14388) 12040 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:52:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:39 smithi049 bash[23528]: cluster 2024-09-21T02:52:38.161860+0000 mgr.a (mgr.14388) 12040 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:52:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:39 smithi044 bash[22676]: cluster 2024-09-21T02:52:38.161860+0000 mgr.a (mgr.14388) 12040 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T02:52:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:41 smithi179 bash[23186]: cluster 2024-09-21T02:52:40.163975+0000 mgr.a (mgr.14388) 12041 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:52:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:41 smithi049 bash[23528]: cluster 2024-09-21T02:52:40.163975+0000 mgr.a (mgr.14388) 12041 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:52:41.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:41.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:41.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:41 smithi044 bash[22676]: cluster 2024-09-21T02:52:40.163975+0000 mgr.a (mgr.14388) 12041 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T02:52:42.438 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:43 smithi179 bash[23186]: audit 2024-09-21T02:52:41.977709+0000 mgr.a (mgr.14388) 12042 : audit [DBG] from='client.263643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:43 smithi179 bash[23186]: cluster 2024-09-21T02:52:42.164538+0000 mgr.a (mgr.14388) 12043 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:43 smithi049 bash[23528]: audit 2024-09-21T02:52:41.977709+0000 mgr.a (mgr.14388) 12042 : audit [DBG] from='client.263643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:43 smithi049 bash[23528]: cluster 2024-09-21T02:52:42.164538+0000 mgr.a (mgr.14388) 12043 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:43 smithi044 bash[22676]: audit 2024-09-21T02:52:41.977709+0000 mgr.a (mgr.14388) 12042 : audit [DBG] from='client.263643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:43 smithi044 bash[22676]: cluster 2024-09-21T02:52:42.164538+0000 mgr.a (mgr.14388) 12043 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:45 smithi044 bash[22676]: audit 2024-09-21T02:52:44.052819+0000 mon.a (mon.0) 9836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:45 smithi044 bash[22676]: audit 2024-09-21T02:52:44.065054+0000 mon.a (mon.0) 9837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:45 smithi044 bash[22676]: audit 2024-09-21T02:52:44.074807+0000 mon.a (mon.0) 9838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:45 smithi044 bash[22676]: cluster 2024-09-21T02:52:44.165392+0000 mgr.a (mgr.14388) 12044 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:45 smithi044 bash[22676]: audit 2024-09-21T02:52:44.171356+0000 mon.a (mon.0) 9839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:45 smithi044 bash[22676]: audit 2024-09-21T02:52:44.179255+0000 mon.a (mon.0) 9840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:45 smithi044 bash[22676]: audit 2024-09-21T02:52:44.189403+0000 mon.a (mon.0) 9841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:45 smithi049 bash[23528]: audit 2024-09-21T02:52:44.052819+0000 mon.a (mon.0) 9836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:45 smithi049 bash[23528]: audit 2024-09-21T02:52:44.065054+0000 mon.a (mon.0) 9837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:45 smithi049 bash[23528]: audit 2024-09-21T02:52:44.074807+0000 mon.a (mon.0) 9838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:45 smithi049 bash[23528]: cluster 2024-09-21T02:52:44.165392+0000 mgr.a (mgr.14388) 12044 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:45 smithi049 bash[23528]: audit 2024-09-21T02:52:44.171356+0000 mon.a (mon.0) 9839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:45 smithi049 bash[23528]: audit 2024-09-21T02:52:44.179255+0000 mon.a (mon.0) 9840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:45 smithi049 bash[23528]: audit 2024-09-21T02:52:44.189403+0000 mon.a (mon.0) 9841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:45 smithi179 bash[23186]: audit 2024-09-21T02:52:44.052819+0000 mon.a (mon.0) 9836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:45 smithi179 bash[23186]: audit 2024-09-21T02:52:44.065054+0000 mon.a (mon.0) 9837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:45 smithi179 bash[23186]: audit 2024-09-21T02:52:44.074807+0000 mon.a (mon.0) 9838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:45 smithi179 bash[23186]: cluster 2024-09-21T02:52:44.165392+0000 mgr.a (mgr.14388) 12044 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:45 smithi179 bash[23186]: audit 2024-09-21T02:52:44.171356+0000 mon.a (mon.0) 9839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:45 smithi179 bash[23186]: audit 2024-09-21T02:52:44.179255+0000 mon.a (mon.0) 9840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:45 smithi179 bash[23186]: audit 2024-09-21T02:52:44.189403+0000 mon.a (mon.0) 9841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:47.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:47.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:47.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:47 smithi044 bash[22676]: cluster 2024-09-21T02:52:46.167665+0000 mgr.a (mgr.14388) 12045 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:47 smithi179 bash[23186]: cluster 2024-09-21T02:52:46.167665+0000 mgr.a (mgr.14388) 12045 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:47 smithi049 bash[23528]: cluster 2024-09-21T02:52:46.167665+0000 mgr.a (mgr.14388) 12045 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:48.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:48.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:48.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:48.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:48.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:49 smithi044 bash[22676]: audit 2024-09-21T02:52:47.780919+0000 mgr.a (mgr.14388) 12046 : audit [DBG] from='client.263718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:49 smithi044 bash[22676]: cluster 2024-09-21T02:52:48.168323+0000 mgr.a (mgr.14388) 12047 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:49 smithi179 bash[23186]: audit 2024-09-21T02:52:47.780919+0000 mgr.a (mgr.14388) 12046 : audit [DBG] from='client.263718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:49 smithi179 bash[23186]: cluster 2024-09-21T02:52:48.168323+0000 mgr.a (mgr.14388) 12047 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:49 smithi049 bash[23528]: audit 2024-09-21T02:52:47.780919+0000 mgr.a (mgr.14388) 12046 : audit [DBG] from='client.263718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:49 smithi049 bash[23528]: cluster 2024-09-21T02:52:48.168323+0000 mgr.a (mgr.14388) 12047 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:51 smithi044 bash[22676]: cluster 2024-09-21T02:52:50.170521+0000 mgr.a (mgr.14388) 12048 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:51 smithi179 bash[23186]: cluster 2024-09-21T02:52:50.170521+0000 mgr.a (mgr.14388) 12048 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:51 smithi049 bash[23528]: cluster 2024-09-21T02:52:50.170521+0000 mgr.a (mgr.14388) 12048 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:52.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:52 smithi044 bash[22676]: audit 2024-09-21T02:52:51.392938+0000 mon.a (mon.0) 9842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:52 smithi044 bash[22676]: audit 2024-09-21T02:52:51.401788+0000 mon.a (mon.0) 9843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:52 smithi044 bash[22676]: audit 2024-09-21T02:52:51.413805+0000 mon.a (mon.0) 9844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:52 smithi179 bash[23186]: audit 2024-09-21T02:52:51.392938+0000 mon.a (mon.0) 9842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:52 smithi179 bash[23186]: audit 2024-09-21T02:52:51.401788+0000 mon.a (mon.0) 9843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:52 smithi179 bash[23186]: audit 2024-09-21T02:52:51.413805+0000 mon.a (mon.0) 9844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:52 smithi049 bash[23528]: audit 2024-09-21T02:52:51.392938+0000 mon.a (mon.0) 9842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:52 smithi049 bash[23528]: audit 2024-09-21T02:52:51.401788+0000 mon.a (mon.0) 9843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:52 smithi049 bash[23528]: audit 2024-09-21T02:52:51.413805+0000 mon.a (mon.0) 9844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:52:53.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:53.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:53.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:53 smithi044 bash[22676]: cluster 2024-09-21T02:52:52.171277+0000 mgr.a (mgr.14388) 12049 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:53 smithi179 bash[23186]: cluster 2024-09-21T02:52:52.171277+0000 mgr.a (mgr.14388) 12049 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:53 smithi049 bash[23528]: cluster 2024-09-21T02:52:52.171277+0000 mgr.a (mgr.14388) 12049 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:54.020 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:54.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:54.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:54.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:54 smithi049 bash[23528]: audit 2024-09-21T02:52:53.573286+0000 mgr.a (mgr.14388) 12050 : audit [DBG] from='client.263793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:54.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:54 smithi044 bash[22676]: audit 2024-09-21T02:52:53.573286+0000 mgr.a (mgr.14388) 12050 : audit [DBG] from='client.263793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:54.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:54 smithi179 bash[23186]: audit 2024-09-21T02:52:53.573286+0000 mgr.a (mgr.14388) 12050 : audit [DBG] from='client.263793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:55.690 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:55 smithi049 bash[23528]: cluster 2024-09-21T02:52:54.172186+0000 mgr.a (mgr.14388) 12051 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:55.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:55 smithi044 bash[22676]: cluster 2024-09-21T02:52:54.172186+0000 mgr.a (mgr.14388) 12051 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:55 smithi179 bash[23186]: cluster 2024-09-21T02:52:54.172186+0000 mgr.a (mgr.14388) 12051 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:57 smithi044 bash[22676]: cluster 2024-09-21T02:52:56.174572+0000 mgr.a (mgr.14388) 12052 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:57 smithi179 bash[23186]: cluster 2024-09-21T02:52:56.174572+0000 mgr.a (mgr.14388) 12052 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:57 smithi049 bash[23528]: cluster 2024-09-21T02:52:56.174572+0000 mgr.a (mgr.14388) 12052 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:52:59.022 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:52:59.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:52:59.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:52:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:52:59 smithi044 bash[22676]: cluster 2024-09-21T02:52:58.175164+0000 mgr.a (mgr.14388) 12053 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:52:59 smithi179 bash[23186]: cluster 2024-09-21T02:52:58.175164+0000 mgr.a (mgr.14388) 12053 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:52:59.789 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:52:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:52:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:52:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:52:59.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:52:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:52:59 smithi049 bash[23528]: cluster 2024-09-21T02:52:58.175164+0000 mgr.a (mgr.14388) 12053 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:00 smithi044 bash[22676]: audit 2024-09-21T02:52:59.356431+0000 mgr.a (mgr.14388) 12054 : audit [DBG] from='client.263865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:00 smithi179 bash[23186]: audit 2024-09-21T02:52:59.356431+0000 mgr.a (mgr.14388) 12054 : audit [DBG] from='client.263865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:00 smithi049 bash[23528]: audit 2024-09-21T02:52:59.356431+0000 mgr.a (mgr.14388) 12054 : audit [DBG] from='client.263865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:01 smithi044 bash[22676]: cluster 2024-09-21T02:53:00.177644+0000 mgr.a (mgr.14388) 12055 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:01 smithi179 bash[23186]: cluster 2024-09-21T02:53:00.177644+0000 mgr.a (mgr.14388) 12055 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:01 smithi049 bash[23528]: cluster 2024-09-21T02:53:00.177644+0000 mgr.a (mgr.14388) 12055 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:03 smithi044 bash[22676]: cluster 2024-09-21T02:53:02.178610+0000 mgr.a (mgr.14388) 12056 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:03 smithi179 bash[23186]: cluster 2024-09-21T02:53:02.178610+0000 mgr.a (mgr.14388) 12056 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:03 smithi049 bash[23528]: cluster 2024-09-21T02:53:02.178610+0000 mgr.a (mgr.14388) 12056 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:04.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:04.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:04.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:05 smithi049 bash[23528]: cluster 2024-09-21T02:53:04.179549+0000 mgr.a (mgr.14388) 12057 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:05 smithi049 bash[23528]: audit 2024-09-21T02:53:04.271562+0000 mon.a (mon.0) 9845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:05 smithi049 bash[23528]: audit 2024-09-21T02:53:04.279785+0000 mon.a (mon.0) 9846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:05 smithi049 bash[23528]: audit 2024-09-21T02:53:04.292064+0000 mon.a (mon.0) 9847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:05 smithi049 bash[23528]: audit 2024-09-21T02:53:04.410255+0000 mon.a (mon.0) 9848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:05 smithi049 bash[23528]: audit 2024-09-21T02:53:04.418893+0000 mon.a (mon.0) 9849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:05 smithi049 bash[23528]: audit 2024-09-21T02:53:04.429029+0000 mon.a (mon.0) 9850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.573 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:05 smithi044 bash[22676]: cluster 2024-09-21T02:53:04.179549+0000 mgr.a (mgr.14388) 12057 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:05 smithi044 bash[22676]: audit 2024-09-21T02:53:04.271562+0000 mon.a (mon.0) 9845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:05 smithi044 bash[22676]: audit 2024-09-21T02:53:04.279785+0000 mon.a (mon.0) 9846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:05 smithi044 bash[22676]: audit 2024-09-21T02:53:04.292064+0000 mon.a (mon.0) 9847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:05 smithi044 bash[22676]: audit 2024-09-21T02:53:04.410255+0000 mon.a (mon.0) 9848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:05 smithi044 bash[22676]: audit 2024-09-21T02:53:04.418893+0000 mon.a (mon.0) 9849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:05 smithi044 bash[22676]: audit 2024-09-21T02:53:04.429029+0000 mon.a (mon.0) 9850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:05 smithi179 bash[23186]: cluster 2024-09-21T02:53:04.179549+0000 mgr.a (mgr.14388) 12057 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:05 smithi179 bash[23186]: audit 2024-09-21T02:53:04.271562+0000 mon.a (mon.0) 9845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:05 smithi179 bash[23186]: audit 2024-09-21T02:53:04.279785+0000 mon.a (mon.0) 9846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:05 smithi179 bash[23186]: audit 2024-09-21T02:53:04.292064+0000 mon.a (mon.0) 9847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:05 smithi179 bash[23186]: audit 2024-09-21T02:53:04.410255+0000 mon.a (mon.0) 9848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:05 smithi179 bash[23186]: audit 2024-09-21T02:53:04.418893+0000 mon.a (mon.0) 9849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:05 smithi179 bash[23186]: audit 2024-09-21T02:53:04.429029+0000 mon.a (mon.0) 9850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:06 smithi049 bash[23528]: audit 2024-09-21T02:53:05.132835+0000 mgr.a (mgr.14388) 12058 : audit [DBG] from='client.263943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:06.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:06 smithi044 bash[22676]: audit 2024-09-21T02:53:05.132835+0000 mgr.a (mgr.14388) 12058 : audit [DBG] from='client.263943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:06 smithi179 bash[23186]: audit 2024-09-21T02:53:05.132835+0000 mgr.a (mgr.14388) 12058 : audit [DBG] from='client.263943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:07 smithi049 bash[23528]: cluster 2024-09-21T02:53:06.182517+0000 mgr.a (mgr.14388) 12059 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:07 smithi044 bash[22676]: cluster 2024-09-21T02:53:06.182517+0000 mgr.a (mgr.14388) 12059 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:07 smithi179 bash[23186]: cluster 2024-09-21T02:53:06.182517+0000 mgr.a (mgr.14388) 12059 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:09 smithi049 bash[23528]: cluster 2024-09-21T02:53:08.183458+0000 mgr.a (mgr.14388) 12060 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:09 smithi044 bash[22676]: cluster 2024-09-21T02:53:08.183458+0000 mgr.a (mgr.14388) 12060 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:09 smithi179 bash[23186]: cluster 2024-09-21T02:53:08.183458+0000 mgr.a (mgr.14388) 12060 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:10.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:10.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:10.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:11 smithi049 bash[23528]: cluster 2024-09-21T02:53:10.185426+0000 mgr.a (mgr.14388) 12061 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:11 smithi044 bash[22676]: cluster 2024-09-21T02:53:10.185426+0000 mgr.a (mgr.14388) 12061 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:11 smithi179 bash[23186]: cluster 2024-09-21T02:53:10.185426+0000 mgr.a (mgr.14388) 12061 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:12 smithi044 bash[22676]: audit 2024-09-21T02:53:10.906283+0000 mgr.a (mgr.14388) 12062 : audit [DBG] from='client.264021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:12 smithi044 bash[22676]: audit 2024-09-21T02:53:11.635143+0000 mon.a (mon.0) 9851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:12 smithi044 bash[22676]: audit 2024-09-21T02:53:11.644607+0000 mon.a (mon.0) 9852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:12 smithi044 bash[22676]: audit 2024-09-21T02:53:11.655054+0000 mon.a (mon.0) 9853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:12 smithi179 bash[23186]: audit 2024-09-21T02:53:10.906283+0000 mgr.a (mgr.14388) 12062 : audit [DBG] from='client.264021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:12 smithi179 bash[23186]: audit 2024-09-21T02:53:11.635143+0000 mon.a (mon.0) 9851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:12 smithi179 bash[23186]: audit 2024-09-21T02:53:11.644607+0000 mon.a (mon.0) 9852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:12 smithi179 bash[23186]: audit 2024-09-21T02:53:11.655054+0000 mon.a (mon.0) 9853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:12 smithi049 bash[23528]: audit 2024-09-21T02:53:10.906283+0000 mgr.a (mgr.14388) 12062 : audit [DBG] from='client.264021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:12 smithi049 bash[23528]: audit 2024-09-21T02:53:11.635143+0000 mon.a (mon.0) 9851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:12 smithi049 bash[23528]: audit 2024-09-21T02:53:11.644607+0000 mon.a (mon.0) 9852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:12 smithi049 bash[23528]: audit 2024-09-21T02:53:11.655054+0000 mon.a (mon.0) 9853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:13 smithi044 bash[22676]: cluster 2024-09-21T02:53:12.186361+0000 mgr.a (mgr.14388) 12063 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:13 smithi179 bash[23186]: cluster 2024-09-21T02:53:12.186361+0000 mgr.a (mgr.14388) 12063 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:13 smithi049 bash[23528]: cluster 2024-09-21T02:53:12.186361+0000 mgr.a (mgr.14388) 12063 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:15.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:15 smithi044 bash[22676]: cluster 2024-09-21T02:53:14.187156+0000 mgr.a (mgr.14388) 12064 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:15 smithi179 bash[23186]: cluster 2024-09-21T02:53:14.187156+0000 mgr.a (mgr.14388) 12064 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:15 smithi049 bash[23528]: cluster 2024-09-21T02:53:14.187156+0000 mgr.a (mgr.14388) 12064 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:53:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:17.098 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:17.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:17.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:17.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:17.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:17.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:17 smithi049 bash[23528]: cluster 2024-09-21T02:53:16.189490+0000 mgr.a (mgr.14388) 12065 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:17.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:17 smithi049 bash[23528]: audit 2024-09-21T02:53:16.676635+0000 mgr.a (mgr.14388) 12066 : audit [DBG] from='client.264099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:17 smithi044 bash[22676]: cluster 2024-09-21T02:53:16.189490+0000 mgr.a (mgr.14388) 12065 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:17 smithi044 bash[22676]: audit 2024-09-21T02:53:16.676635+0000 mgr.a (mgr.14388) 12066 : audit [DBG] from='client.264099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:17 smithi179 bash[23186]: cluster 2024-09-21T02:53:16.189490+0000 mgr.a (mgr.14388) 12065 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:17 smithi179 bash[23186]: audit 2024-09-21T02:53:16.676635+0000 mgr.a (mgr.14388) 12066 : audit [DBG] from='client.264099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:19 smithi044 bash[22676]: cluster 2024-09-21T02:53:18.190106+0000 mgr.a (mgr.14388) 12067 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:20.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:19 smithi179 bash[23186]: cluster 2024-09-21T02:53:18.190106+0000 mgr.a (mgr.14388) 12067 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:19 smithi049 bash[23528]: cluster 2024-09-21T02:53:18.190106+0000 mgr.a (mgr.14388) 12067 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:21 smithi044 bash[22676]: cluster 2024-09-21T02:53:20.192237+0000 mgr.a (mgr.14388) 12068 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:21 smithi179 bash[23186]: cluster 2024-09-21T02:53:20.192237+0000 mgr.a (mgr.14388) 12068 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:21 smithi049 bash[23528]: cluster 2024-09-21T02:53:20.192237+0000 mgr.a (mgr.14388) 12068 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:22.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:22.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:22.986 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:53:22 smithi044 bash[22930]: debug 2024-09-21T02:53:22.839+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:53:22.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:53:22 smithi044 bash[22930]: debug 2024-09-21T02:53:22.855+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:53:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:22 smithi044 bash[22676]: audit 2024-09-21T02:53:22.047862+0000 mon.a (mon.0) 9854 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:53:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:22 smithi044 bash[22676]: audit 2024-09-21T02:53:22.054315+0000 mon.a (mon.0) 9855 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:53:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:22 smithi044 bash[22676]: audit 2024-09-21T02:53:22.056256+0000 mon.a (mon.0) 9856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:53:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:22 smithi044 bash[22676]: audit 2024-09-21T02:53:22.067997+0000 mon.a (mon.0) 9857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:22 smithi044 bash[22676]: audit 2024-09-21T02:53:22.074377+0000 mon.a (mon.0) 9858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:53:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:22 smithi179 bash[23186]: audit 2024-09-21T02:53:22.047862+0000 mon.a (mon.0) 9854 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:53:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:22 smithi179 bash[23186]: audit 2024-09-21T02:53:22.054315+0000 mon.a (mon.0) 9855 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:53:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:22 smithi179 bash[23186]: audit 2024-09-21T02:53:22.056256+0000 mon.a (mon.0) 9856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:53:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:22 smithi179 bash[23186]: audit 2024-09-21T02:53:22.067997+0000 mon.a (mon.0) 9857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:22 smithi179 bash[23186]: audit 2024-09-21T02:53:22.074377+0000 mon.a (mon.0) 9858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:53:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:22 smithi049 bash[23528]: audit 2024-09-21T02:53:22.047862+0000 mon.a (mon.0) 9854 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:53:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:22 smithi049 bash[23528]: audit 2024-09-21T02:53:22.054315+0000 mon.a (mon.0) 9855 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:53:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:22 smithi049 bash[23528]: audit 2024-09-21T02:53:22.056256+0000 mon.a (mon.0) 9856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:53:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:22 smithi049 bash[23528]: audit 2024-09-21T02:53:22.067997+0000 mon.a (mon.0) 9857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:22 smithi049 bash[23528]: audit 2024-09-21T02:53:22.074377+0000 mon.a (mon.0) 9858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:53:23.251 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:23.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:23.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:23.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:23.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:23 smithi044 bash[22676]: audit 2024-09-21T02:53:22.076789+0000 mgr.a (mgr.14388) 12069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:53:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:23 smithi044 bash[22676]: cluster 2024-09-21T02:53:22.192866+0000 mgr.a (mgr.14388) 12070 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:23 smithi044 bash[22676]: audit 2024-09-21T02:53:22.455553+0000 mgr.a (mgr.14388) 12071 : audit [DBG] from='client.264195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:23 smithi179 bash[23186]: audit 2024-09-21T02:53:22.076789+0000 mgr.a (mgr.14388) 12069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:53:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:23 smithi179 bash[23186]: cluster 2024-09-21T02:53:22.192866+0000 mgr.a (mgr.14388) 12070 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:23 smithi179 bash[23186]: audit 2024-09-21T02:53:22.455553+0000 mgr.a (mgr.14388) 12071 : audit [DBG] from='client.264195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:23 smithi049 bash[23528]: audit 2024-09-21T02:53:22.076789+0000 mgr.a (mgr.14388) 12069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:53:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:23 smithi049 bash[23528]: cluster 2024-09-21T02:53:22.192866+0000 mgr.a (mgr.14388) 12070 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:23 smithi049 bash[23528]: audit 2024-09-21T02:53:22.455553+0000 mgr.a (mgr.14388) 12071 : audit [DBG] from='client.264195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: audit 2024-09-21T02:53:22.844583+0000 mgr.a (mgr.14388) 12072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: cephadm 2024-09-21T02:53:22.860925+0000 mgr.a (mgr.14388) 12073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: audit 2024-09-21T02:53:24.491573+0000 mon.a (mon.0) 9859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: audit 2024-09-21T02:53:24.501420+0000 mon.a (mon.0) 9860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: audit 2024-09-21T02:53:24.511306+0000 mon.a (mon.0) 9861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: audit 2024-09-21T02:53:24.641965+0000 mon.a (mon.0) 9862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: audit 2024-09-21T02:53:24.649826+0000 mon.a (mon.0) 9863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:24 smithi044 bash[22676]: audit 2024-09-21T02:53:24.657208+0000 mon.a (mon.0) 9864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: audit 2024-09-21T02:53:22.844583+0000 mgr.a (mgr.14388) 12072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:53:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: cephadm 2024-09-21T02:53:22.860925+0000 mgr.a (mgr.14388) 12073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:53:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: audit 2024-09-21T02:53:24.491573+0000 mon.a (mon.0) 9859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: audit 2024-09-21T02:53:24.501420+0000 mon.a (mon.0) 9860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: audit 2024-09-21T02:53:24.511306+0000 mon.a (mon.0) 9861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: audit 2024-09-21T02:53:24.641965+0000 mon.a (mon.0) 9862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: audit 2024-09-21T02:53:24.649826+0000 mon.a (mon.0) 9863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:24 smithi179 bash[23186]: audit 2024-09-21T02:53:24.657208+0000 mon.a (mon.0) 9864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: audit 2024-09-21T02:53:22.844583+0000 mgr.a (mgr.14388) 12072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: cephadm 2024-09-21T02:53:22.860925+0000 mgr.a (mgr.14388) 12073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: audit 2024-09-21T02:53:24.491573+0000 mon.a (mon.0) 9859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: audit 2024-09-21T02:53:24.501420+0000 mon.a (mon.0) 9860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: audit 2024-09-21T02:53:24.511306+0000 mon.a (mon.0) 9861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: audit 2024-09-21T02:53:24.641965+0000 mon.a (mon.0) 9862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: audit 2024-09-21T02:53:24.649826+0000 mon.a (mon.0) 9863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:24 smithi049 bash[23528]: audit 2024-09-21T02:53:24.657208+0000 mon.a (mon.0) 9864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:25 smithi044 bash[22676]: cluster 2024-09-21T02:53:24.193863+0000 mgr.a (mgr.14388) 12074 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:25 smithi179 bash[23186]: cluster 2024-09-21T02:53:24.193863+0000 mgr.a (mgr.14388) 12074 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:25 smithi049 bash[23528]: cluster 2024-09-21T02:53:24.193863+0000 mgr.a (mgr.14388) 12074 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:27 smithi044 bash[22676]: cluster 2024-09-21T02:53:26.195536+0000 mgr.a (mgr.14388) 12075 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:27 smithi179 bash[23186]: cluster 2024-09-21T02:53:26.195536+0000 mgr.a (mgr.14388) 12075 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:27 smithi049 bash[23528]: cluster 2024-09-21T02:53:26.195536+0000 mgr.a (mgr.14388) 12075 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:29.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:29.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:29.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:29.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:29 smithi044 bash[22676]: cluster 2024-09-21T02:53:28.196325+0000 mgr.a (mgr.14388) 12076 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:29 smithi044 bash[22676]: audit 2024-09-21T02:53:28.595035+0000 mgr.a (mgr.14388) 12077 : audit [DBG] from='client.264360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:29 smithi179 bash[23186]: cluster 2024-09-21T02:53:28.196325+0000 mgr.a (mgr.14388) 12076 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:29 smithi179 bash[23186]: audit 2024-09-21T02:53:28.595035+0000 mgr.a (mgr.14388) 12077 : audit [DBG] from='client.264360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:29 smithi049 bash[23528]: cluster 2024-09-21T02:53:28.196325+0000 mgr.a (mgr.14388) 12076 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:29 smithi049 bash[23528]: audit 2024-09-21T02:53:28.595035+0000 mgr.a (mgr.14388) 12077 : audit [DBG] from='client.264360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:31 smithi044 bash[22676]: cluster 2024-09-21T02:53:30.198708+0000 mgr.a (mgr.14388) 12078 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:31 smithi179 bash[23186]: cluster 2024-09-21T02:53:30.198708+0000 mgr.a (mgr.14388) 12078 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:31 smithi049 bash[23528]: cluster 2024-09-21T02:53:30.198708+0000 mgr.a (mgr.14388) 12078 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:32 smithi044 bash[22676]: audit 2024-09-21T02:53:31.871566+0000 mon.a (mon.0) 9865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:32 smithi044 bash[22676]: audit 2024-09-21T02:53:31.880715+0000 mon.a (mon.0) 9866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:32 smithi044 bash[22676]: audit 2024-09-21T02:53:31.891464+0000 mon.a (mon.0) 9867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:32 smithi044 bash[22676]: cluster 2024-09-21T02:53:32.199499+0000 mgr.a (mgr.14388) 12079 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:32 smithi179 bash[23186]: audit 2024-09-21T02:53:31.871566+0000 mon.a (mon.0) 9865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:32 smithi179 bash[23186]: audit 2024-09-21T02:53:31.880715+0000 mon.a (mon.0) 9866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:32 smithi179 bash[23186]: audit 2024-09-21T02:53:31.891464+0000 mon.a (mon.0) 9867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:32 smithi179 bash[23186]: cluster 2024-09-21T02:53:32.199499+0000 mgr.a (mgr.14388) 12079 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:32 smithi049 bash[23528]: audit 2024-09-21T02:53:31.871566+0000 mon.a (mon.0) 9865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:32 smithi049 bash[23528]: audit 2024-09-21T02:53:31.880715+0000 mon.a (mon.0) 9866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:32 smithi049 bash[23528]: audit 2024-09-21T02:53:31.891464+0000 mon.a (mon.0) 9867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:32 smithi049 bash[23528]: cluster 2024-09-21T02:53:32.199499+0000 mgr.a (mgr.14388) 12079 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:34.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:34.787 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:34.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:34.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:34.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:34.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:35 smithi044 bash[22676]: cluster 2024-09-21T02:53:34.200029+0000 mgr.a (mgr.14388) 12080 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:35 smithi044 bash[22676]: audit 2024-09-21T02:53:34.377221+0000 mgr.a (mgr.14388) 12081 : audit [DBG] from='client.264435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:35 smithi179 bash[23186]: cluster 2024-09-21T02:53:34.200029+0000 mgr.a (mgr.14388) 12080 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:35 smithi179 bash[23186]: audit 2024-09-21T02:53:34.377221+0000 mgr.a (mgr.14388) 12081 : audit [DBG] from='client.264435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:35 smithi049 bash[23528]: cluster 2024-09-21T02:53:34.200029+0000 mgr.a (mgr.14388) 12080 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:35 smithi049 bash[23528]: audit 2024-09-21T02:53:34.377221+0000 mgr.a (mgr.14388) 12081 : audit [DBG] from='client.264435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:37 smithi044 bash[22676]: cluster 2024-09-21T02:53:36.202556+0000 mgr.a (mgr.14388) 12082 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:37 smithi049 bash[23528]: cluster 2024-09-21T02:53:36.202556+0000 mgr.a (mgr.14388) 12082 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:37 smithi179 bash[23186]: cluster 2024-09-21T02:53:36.202556+0000 mgr.a (mgr.14388) 12082 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:53:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:39 smithi049 bash[23528]: cluster 2024-09-21T02:53:38.203338+0000 mgr.a (mgr.14388) 12083 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:39 smithi044 bash[22676]: cluster 2024-09-21T02:53:38.203338+0000 mgr.a (mgr.14388) 12083 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:39 smithi179 bash[23186]: cluster 2024-09-21T02:53:38.203338+0000 mgr.a (mgr.14388) 12083 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:39.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:39.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:40.589 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:40.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:40.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:40.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:40.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:41 smithi049 bash[23528]: audit 2024-09-21T02:53:40.132582+0000 mgr.a (mgr.14388) 12084 : audit [DBG] from='client.264513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:41 smithi049 bash[23528]: cluster 2024-09-21T02:53:40.204780+0000 mgr.a (mgr.14388) 12085 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:41 smithi044 bash[22676]: audit 2024-09-21T02:53:40.132582+0000 mgr.a (mgr.14388) 12084 : audit [DBG] from='client.264513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:41 smithi044 bash[22676]: cluster 2024-09-21T02:53:40.204780+0000 mgr.a (mgr.14388) 12085 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:41 smithi179 bash[23186]: audit 2024-09-21T02:53:40.132582+0000 mgr.a (mgr.14388) 12084 : audit [DBG] from='client.264513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:41 smithi179 bash[23186]: cluster 2024-09-21T02:53:40.204780+0000 mgr.a (mgr.14388) 12085 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:43 smithi049 bash[23528]: cluster 2024-09-21T02:53:42.205703+0000 mgr.a (mgr.14388) 12086 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:43 smithi044 bash[22676]: cluster 2024-09-21T02:53:42.205703+0000 mgr.a (mgr.14388) 12086 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:43 smithi179 bash[23186]: cluster 2024-09-21T02:53:42.205703+0000 mgr.a (mgr.14388) 12086 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:45.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:45.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:45.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:45 smithi044 bash[22676]: cluster 2024-09-21T02:53:44.206471+0000 mgr.a (mgr.14388) 12087 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:45 smithi044 bash[22676]: audit 2024-09-21T02:53:44.735838+0000 mon.a (mon.0) 9868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:45 smithi044 bash[22676]: audit 2024-09-21T02:53:44.743991+0000 mon.a (mon.0) 9869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:45 smithi044 bash[22676]: audit 2024-09-21T02:53:44.755534+0000 mon.a (mon.0) 9870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:45 smithi044 bash[22676]: audit 2024-09-21T02:53:44.881570+0000 mon.a (mon.0) 9871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:45 smithi044 bash[22676]: audit 2024-09-21T02:53:44.891873+0000 mon.a (mon.0) 9872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:45 smithi044 bash[22676]: audit 2024-09-21T02:53:44.902327+0000 mon.a (mon.0) 9873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:45 smithi179 bash[23186]: cluster 2024-09-21T02:53:44.206471+0000 mgr.a (mgr.14388) 12087 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:45 smithi179 bash[23186]: audit 2024-09-21T02:53:44.735838+0000 mon.a (mon.0) 9868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:45 smithi179 bash[23186]: audit 2024-09-21T02:53:44.743991+0000 mon.a (mon.0) 9869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:45 smithi179 bash[23186]: audit 2024-09-21T02:53:44.755534+0000 mon.a (mon.0) 9870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:45 smithi179 bash[23186]: audit 2024-09-21T02:53:44.881570+0000 mon.a (mon.0) 9871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:45 smithi179 bash[23186]: audit 2024-09-21T02:53:44.891873+0000 mon.a (mon.0) 9872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:45 smithi179 bash[23186]: audit 2024-09-21T02:53:44.902327+0000 mon.a (mon.0) 9873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:45 smithi049 bash[23528]: cluster 2024-09-21T02:53:44.206471+0000 mgr.a (mgr.14388) 12087 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:45 smithi049 bash[23528]: audit 2024-09-21T02:53:44.735838+0000 mon.a (mon.0) 9868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:45 smithi049 bash[23528]: audit 2024-09-21T02:53:44.743991+0000 mon.a (mon.0) 9869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:45 smithi049 bash[23528]: audit 2024-09-21T02:53:44.755534+0000 mon.a (mon.0) 9870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:45 smithi049 bash[23528]: audit 2024-09-21T02:53:44.881570+0000 mon.a (mon.0) 9871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:45 smithi049 bash[23528]: audit 2024-09-21T02:53:44.891873+0000 mon.a (mon.0) 9872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:45 smithi049 bash[23528]: audit 2024-09-21T02:53:44.902327+0000 mon.a (mon.0) 9873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:46.381 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:46.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:46.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:46.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:46.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:47 smithi179 bash[23186]: audit 2024-09-21T02:53:45.931434+0000 mgr.a (mgr.14388) 12088 : audit [DBG] from='client.264591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:47 smithi179 bash[23186]: cluster 2024-09-21T02:53:46.208149+0000 mgr.a (mgr.14388) 12089 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:47 smithi049 bash[23528]: audit 2024-09-21T02:53:45.931434+0000 mgr.a (mgr.14388) 12088 : audit [DBG] from='client.264591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:47 smithi049 bash[23528]: cluster 2024-09-21T02:53:46.208149+0000 mgr.a (mgr.14388) 12089 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:47 smithi044 bash[22676]: audit 2024-09-21T02:53:45.931434+0000 mgr.a (mgr.14388) 12088 : audit [DBG] from='client.264591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:47 smithi044 bash[22676]: cluster 2024-09-21T02:53:46.208149+0000 mgr.a (mgr.14388) 12089 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:49 smithi179 bash[23186]: cluster 2024-09-21T02:53:48.209064+0000 mgr.a (mgr.14388) 12090 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:49 smithi049 bash[23528]: cluster 2024-09-21T02:53:48.209064+0000 mgr.a (mgr.14388) 12090 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:49 smithi044 bash[22676]: cluster 2024-09-21T02:53:48.209064+0000 mgr.a (mgr.14388) 12090 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:53:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:50 smithi049 bash[23528]: cluster 2024-09-21T02:53:50.211235+0000 mgr.a (mgr.14388) 12091 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:50 smithi044 bash[22676]: cluster 2024-09-21T02:53:50.211235+0000 mgr.a (mgr.14388) 12091 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:50 smithi179 bash[23186]: cluster 2024-09-21T02:53:50.211235+0000 mgr.a (mgr.14388) 12091 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:51.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:51 smithi049 bash[23528]: audit 2024-09-21T02:53:51.721712+0000 mgr.a (mgr.14388) 12092 : audit [DBG] from='client.264666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:52.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:52.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:52.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:52.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:52.166 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:51 smithi044 bash[22676]: audit 2024-09-21T02:53:51.721712+0000 mgr.a (mgr.14388) 12092 : audit [DBG] from='client.264666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:51 smithi179 bash[23186]: audit 2024-09-21T02:53:51.721712+0000 mgr.a (mgr.14388) 12092 : audit [DBG] from='client.264666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:53 smithi049 bash[23528]: audit 2024-09-21T02:53:52.043671+0000 mon.a (mon.0) 9874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:53 smithi049 bash[23528]: audit 2024-09-21T02:53:52.050352+0000 mon.a (mon.0) 9875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:53 smithi049 bash[23528]: audit 2024-09-21T02:53:52.057904+0000 mon.a (mon.0) 9876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:53 smithi049 bash[23528]: cluster 2024-09-21T02:53:52.211985+0000 mgr.a (mgr.14388) 12093 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:53 smithi044 bash[22676]: audit 2024-09-21T02:53:52.043671+0000 mon.a (mon.0) 9874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:53 smithi044 bash[22676]: audit 2024-09-21T02:53:52.050352+0000 mon.a (mon.0) 9875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:53 smithi044 bash[22676]: audit 2024-09-21T02:53:52.057904+0000 mon.a (mon.0) 9876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:53 smithi044 bash[22676]: cluster 2024-09-21T02:53:52.211985+0000 mgr.a (mgr.14388) 12093 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:53 smithi179 bash[23186]: audit 2024-09-21T02:53:52.043671+0000 mon.a (mon.0) 9874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:53 smithi179 bash[23186]: audit 2024-09-21T02:53:52.050352+0000 mon.a (mon.0) 9875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:53 smithi179 bash[23186]: audit 2024-09-21T02:53:52.057904+0000 mon.a (mon.0) 9876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:53:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:53 smithi179 bash[23186]: cluster 2024-09-21T02:53:52.211985+0000 mgr.a (mgr.14388) 12093 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:55 smithi049 bash[23528]: cluster 2024-09-21T02:53:54.212721+0000 mgr.a (mgr.14388) 12094 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:55 smithi044 bash[22676]: cluster 2024-09-21T02:53:54.212721+0000 mgr.a (mgr.14388) 12094 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:55 smithi179 bash[23186]: cluster 2024-09-21T02:53:54.212721+0000 mgr.a (mgr.14388) 12094 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:53:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:53:57.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:53:57.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:57 smithi044 bash[22676]: cluster 2024-09-21T02:53:56.214143+0000 mgr.a (mgr.14388) 12095 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:57 smithi049 bash[23528]: cluster 2024-09-21T02:53:56.214143+0000 mgr.a (mgr.14388) 12095 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:57 smithi179 bash[23186]: cluster 2024-09-21T02:53:56.214143+0000 mgr.a (mgr.14388) 12095 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:53:57.962 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:53:57.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:53:57.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:53:57.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:53:57.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:53:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:58 smithi049 bash[23528]: audit 2024-09-21T02:53:57.502344+0000 mgr.a (mgr.14388) 12096 : audit [DBG] from='client.264741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:58.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:58 smithi044 bash[22676]: audit 2024-09-21T02:53:57.502344+0000 mgr.a (mgr.14388) 12096 : audit [DBG] from='client.264741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:58 smithi179 bash[23186]: audit 2024-09-21T02:53:57.502344+0000 mgr.a (mgr.14388) 12096 : audit [DBG] from='client.264741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:53:59 smithi049 bash[23528]: cluster 2024-09-21T02:53:58.214820+0000 mgr.a (mgr.14388) 12097 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:53:59 smithi044 bash[22676]: cluster 2024-09-21T02:53:58.214820+0000 mgr.a (mgr.14388) 12097 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:53:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:53:59 smithi179 bash[23186]: cluster 2024-09-21T02:53:58.214820+0000 mgr.a (mgr.14388) 12097 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:01 smithi049 bash[23528]: cluster 2024-09-21T02:54:00.216946+0000 mgr.a (mgr.14388) 12098 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:01 smithi044 bash[22676]: cluster 2024-09-21T02:54:00.216946+0000 mgr.a (mgr.14388) 12098 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:01 smithi179 bash[23186]: cluster 2024-09-21T02:54:00.216946+0000 mgr.a (mgr.14388) 12098 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:03 smithi049 bash[23528]: cluster 2024-09-21T02:54:02.217758+0000 mgr.a (mgr.14388) 12099 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:03 smithi044 bash[22676]: cluster 2024-09-21T02:54:02.217758+0000 mgr.a (mgr.14388) 12099 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:03 smithi179 bash[23186]: cluster 2024-09-21T02:54:02.217758+0000 mgr.a (mgr.14388) 12099 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:03.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:04 smithi049 bash[23528]: audit 2024-09-21T02:54:03.301012+0000 mgr.a (mgr.14388) 12100 : audit [DBG] from='client.264813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:04 smithi044 bash[22676]: audit 2024-09-21T02:54:03.301012+0000 mgr.a (mgr.14388) 12100 : audit [DBG] from='client.264813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:04 smithi179 bash[23186]: audit 2024-09-21T02:54:03.301012+0000 mgr.a (mgr.14388) 12100 : audit [DBG] from='client.264813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:05 smithi044 bash[22676]: cluster 2024-09-21T02:54:04.218757+0000 mgr.a (mgr.14388) 12101 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:05 smithi044 bash[22676]: audit 2024-09-21T02:54:04.970004+0000 mon.a (mon.0) 9877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:05 smithi044 bash[22676]: audit 2024-09-21T02:54:04.976143+0000 mon.a (mon.0) 9878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:05 smithi044 bash[22676]: audit 2024-09-21T02:54:04.985497+0000 mon.a (mon.0) 9879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:05 smithi044 bash[22676]: audit 2024-09-21T02:54:05.115313+0000 mon.a (mon.0) 9880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:05 smithi044 bash[22676]: audit 2024-09-21T02:54:05.123656+0000 mon.a (mon.0) 9881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:05 smithi044 bash[22676]: audit 2024-09-21T02:54:05.134967+0000 mon.a (mon.0) 9882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:05 smithi179 bash[23186]: cluster 2024-09-21T02:54:04.218757+0000 mgr.a (mgr.14388) 12101 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:05 smithi179 bash[23186]: audit 2024-09-21T02:54:04.970004+0000 mon.a (mon.0) 9877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:05 smithi179 bash[23186]: audit 2024-09-21T02:54:04.976143+0000 mon.a (mon.0) 9878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:05 smithi179 bash[23186]: audit 2024-09-21T02:54:04.985497+0000 mon.a (mon.0) 9879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:05 smithi179 bash[23186]: audit 2024-09-21T02:54:05.115313+0000 mon.a (mon.0) 9880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:05 smithi179 bash[23186]: audit 2024-09-21T02:54:05.123656+0000 mon.a (mon.0) 9881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:05 smithi179 bash[23186]: audit 2024-09-21T02:54:05.134967+0000 mon.a (mon.0) 9882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:05 smithi049 bash[23528]: cluster 2024-09-21T02:54:04.218757+0000 mgr.a (mgr.14388) 12101 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:05 smithi049 bash[23528]: audit 2024-09-21T02:54:04.970004+0000 mon.a (mon.0) 9877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:05 smithi049 bash[23528]: audit 2024-09-21T02:54:04.976143+0000 mon.a (mon.0) 9878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:05 smithi049 bash[23528]: audit 2024-09-21T02:54:04.985497+0000 mon.a (mon.0) 9879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:05 smithi049 bash[23528]: audit 2024-09-21T02:54:05.115313+0000 mon.a (mon.0) 9880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:05 smithi049 bash[23528]: audit 2024-09-21T02:54:05.123656+0000 mon.a (mon.0) 9881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:05 smithi049 bash[23528]: audit 2024-09-21T02:54:05.134967+0000 mon.a (mon.0) 9882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:07.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:07 smithi044 bash[22676]: cluster 2024-09-21T02:54:06.220990+0000 mgr.a (mgr.14388) 12102 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:07 smithi179 bash[23186]: cluster 2024-09-21T02:54:06.220990+0000 mgr.a (mgr.14388) 12102 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:07 smithi049 bash[23528]: cluster 2024-09-21T02:54:06.220990+0000 mgr.a (mgr.14388) 12102 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:08.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:09.517 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:09.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:09.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:09.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:09.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:09 smithi044 bash[22676]: cluster 2024-09-21T02:54:08.221805+0000 mgr.a (mgr.14388) 12103 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:09 smithi179 bash[23186]: cluster 2024-09-21T02:54:08.221805+0000 mgr.a (mgr.14388) 12103 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:09 smithi049 bash[23528]: cluster 2024-09-21T02:54:08.221805+0000 mgr.a (mgr.14388) 12103 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:10.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:10 smithi044 bash[22676]: audit 2024-09-21T02:54:09.093811+0000 mgr.a (mgr.14388) 12104 : audit [DBG] from='client.264891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:10 smithi179 bash[23186]: audit 2024-09-21T02:54:09.093811+0000 mgr.a (mgr.14388) 12104 : audit [DBG] from='client.264891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:10 smithi049 bash[23528]: audit 2024-09-21T02:54:09.093811+0000 mgr.a (mgr.14388) 12104 : audit [DBG] from='client.264891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:11 smithi044 bash[22676]: cluster 2024-09-21T02:54:10.224160+0000 mgr.a (mgr.14388) 12105 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:11 smithi179 bash[23186]: cluster 2024-09-21T02:54:10.224160+0000 mgr.a (mgr.14388) 12105 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:11 smithi049 bash[23528]: cluster 2024-09-21T02:54:10.224160+0000 mgr.a (mgr.14388) 12105 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:13 smithi049 bash[23528]: cluster 2024-09-21T02:54:12.224937+0000 mgr.a (mgr.14388) 12106 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:13 smithi049 bash[23528]: audit 2024-09-21T02:54:12.263317+0000 mon.a (mon.0) 9883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:13 smithi049 bash[23528]: audit 2024-09-21T02:54:12.272138+0000 mon.a (mon.0) 9884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:13 smithi049 bash[23528]: audit 2024-09-21T02:54:12.282405+0000 mon.a (mon.0) 9885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:13 smithi044 bash[22676]: cluster 2024-09-21T02:54:12.224937+0000 mgr.a (mgr.14388) 12106 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:13 smithi044 bash[22676]: audit 2024-09-21T02:54:12.263317+0000 mon.a (mon.0) 9883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:13 smithi044 bash[22676]: audit 2024-09-21T02:54:12.272138+0000 mon.a (mon.0) 9884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:13 smithi044 bash[22676]: audit 2024-09-21T02:54:12.282405+0000 mon.a (mon.0) 9885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:13 smithi179 bash[23186]: cluster 2024-09-21T02:54:12.224937+0000 mgr.a (mgr.14388) 12106 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:13 smithi179 bash[23186]: audit 2024-09-21T02:54:12.263317+0000 mon.a (mon.0) 9883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:13 smithi179 bash[23186]: audit 2024-09-21T02:54:12.272138+0000 mon.a (mon.0) 9884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:13 smithi179 bash[23186]: audit 2024-09-21T02:54:12.282405+0000 mon.a (mon.0) 9885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:15.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:15 smithi049 bash[23528]: cluster 2024-09-21T02:54:14.225771+0000 mgr.a (mgr.14388) 12107 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:15.689 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:15 smithi179 bash[23186]: cluster 2024-09-21T02:54:14.225771+0000 mgr.a (mgr.14388) 12107 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:15 smithi044 bash[22676]: cluster 2024-09-21T02:54:14.225771+0000 mgr.a (mgr.14388) 12107 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:16 smithi049 bash[23528]: audit 2024-09-21T02:54:14.850659+0000 mgr.a (mgr.14388) 12108 : audit [DBG] from='client.264963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:16.591 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:16 smithi179 bash[23186]: audit 2024-09-21T02:54:14.850659+0000 mgr.a (mgr.14388) 12108 : audit [DBG] from='client.264963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:16.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:16 smithi044 bash[22676]: audit 2024-09-21T02:54:14.850659+0000 mgr.a (mgr.14388) 12108 : audit [DBG] from='client.264963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:17 smithi044 bash[22676]: cluster 2024-09-21T02:54:16.228671+0000 mgr.a (mgr.14388) 12109 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:17.527 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:17 smithi049 bash[23528]: cluster 2024-09-21T02:54:16.228671+0000 mgr.a (mgr.14388) 12109 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:17 smithi179 bash[23186]: cluster 2024-09-21T02:54:16.228671+0000 mgr.a (mgr.14388) 12109 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:19 smithi049 bash[23528]: cluster 2024-09-21T02:54:18.229448+0000 mgr.a (mgr.14388) 12110 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:54:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:19 smithi044 bash[22676]: cluster 2024-09-21T02:54:18.229448+0000 mgr.a (mgr.14388) 12110 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:54:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:19 smithi179 bash[23186]: cluster 2024-09-21T02:54:18.229448+0000 mgr.a (mgr.14388) 12110 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:54:20.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:21.030 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:21.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:21 smithi049 bash[23528]: cluster 2024-09-21T02:54:20.231347+0000 mgr.a (mgr.14388) 12111 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:21 smithi049 bash[23528]: audit 2024-09-21T02:54:20.608033+0000 mgr.a (mgr.14388) 12112 : audit [DBG] from='client.265035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:21 smithi044 bash[22676]: cluster 2024-09-21T02:54:20.231347+0000 mgr.a (mgr.14388) 12111 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:21 smithi044 bash[22676]: audit 2024-09-21T02:54:20.608033+0000 mgr.a (mgr.14388) 12112 : audit [DBG] from='client.265035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:21 smithi179 bash[23186]: cluster 2024-09-21T02:54:20.231347+0000 mgr.a (mgr.14388) 12111 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:21 smithi179 bash[23186]: audit 2024-09-21T02:54:20.608033+0000 mgr.a (mgr.14388) 12112 : audit [DBG] from='client.265035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:23 smithi049 bash[23528]: cluster 2024-09-21T02:54:22.232256+0000 mgr.a (mgr.14388) 12113 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:54:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:23 smithi049 bash[23528]: audit 2024-09-21T02:54:22.925650+0000 mon.a (mon.0) 9886 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:54:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:23 smithi044 bash[22676]: cluster 2024-09-21T02:54:22.232256+0000 mgr.a (mgr.14388) 12113 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:54:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:23 smithi044 bash[22676]: audit 2024-09-21T02:54:22.925650+0000 mon.a (mon.0) 9886 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:54:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:23 smithi179 bash[23186]: cluster 2024-09-21T02:54:22.232256+0000 mgr.a (mgr.14388) 12113 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:54:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:23 smithi179 bash[23186]: audit 2024-09-21T02:54:22.925650+0000 mon.a (mon.0) 9886 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22930]: debug 2024-09-21T02:54:24.326+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22930]: debug 2024-09-21T02:54:24.326+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.527474+0000 mon.a (mon.0) 9887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.533794+0000 mon.a (mon.0) 9888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.540364+0000 mon.a (mon.0) 9889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.547151+0000 mon.a (mon.0) 9890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.548736+0000 mon.a (mon.0) 9891 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.550007+0000 mon.a (mon.0) 9892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:54:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.559041+0000 mon.a (mon.0) 9893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.564795+0000 mon.a (mon.0) 9894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:54:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:24 smithi044 bash[22676]: audit 2024-09-21T02:54:23.567274+0000 mgr.a (mgr.14388) 12114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:54:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.527474+0000 mon.a (mon.0) 9887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.533794+0000 mon.a (mon.0) 9888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.540364+0000 mon.a (mon.0) 9889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.547151+0000 mon.a (mon.0) 9890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.548736+0000 mon.a (mon.0) 9891 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.550007+0000 mon.a (mon.0) 9892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.559041+0000 mon.a (mon.0) 9893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.564795+0000 mon.a (mon.0) 9894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:24 smithi049 bash[23528]: audit 2024-09-21T02:54:23.567274+0000 mgr.a (mgr.14388) 12114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:54:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.527474+0000 mon.a (mon.0) 9887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.533794+0000 mon.a (mon.0) 9888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.540364+0000 mon.a (mon.0) 9889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.547151+0000 mon.a (mon.0) 9890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.548736+0000 mon.a (mon.0) 9891 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:54:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.550007+0000 mon.a (mon.0) 9892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:54:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.559041+0000 mon.a (mon.0) 9893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.564795+0000 mon.a (mon.0) 9894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:54:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:24 smithi179 bash[23186]: audit 2024-09-21T02:54:23.567274+0000 mgr.a (mgr.14388) 12114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: cluster 2024-09-21T02:54:24.232773+0000 mgr.a (mgr.14388) 12115 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: audit 2024-09-21T02:54:24.331455+0000 mgr.a (mgr.14388) 12116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: cephadm 2024-09-21T02:54:24.332750+0000 mgr.a (mgr.14388) 12117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: audit 2024-09-21T02:54:25.200300+0000 mon.a (mon.0) 9895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: audit 2024-09-21T02:54:25.211091+0000 mon.a (mon.0) 9896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: audit 2024-09-21T02:54:25.221959+0000 mon.a (mon.0) 9897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: audit 2024-09-21T02:54:25.353717+0000 mon.a (mon.0) 9898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: audit 2024-09-21T02:54:25.359894+0000 mon.a (mon.0) 9899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:25 smithi044 bash[22676]: audit 2024-09-21T02:54:25.367667+0000 mon.a (mon.0) 9900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: cluster 2024-09-21T02:54:24.232773+0000 mgr.a (mgr.14388) 12115 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:54:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: audit 2024-09-21T02:54:24.331455+0000 mgr.a (mgr.14388) 12116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:54:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: cephadm 2024-09-21T02:54:24.332750+0000 mgr.a (mgr.14388) 12117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:54:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: audit 2024-09-21T02:54:25.200300+0000 mon.a (mon.0) 9895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: audit 2024-09-21T02:54:25.211091+0000 mon.a (mon.0) 9896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: audit 2024-09-21T02:54:25.221959+0000 mon.a (mon.0) 9897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: audit 2024-09-21T02:54:25.353717+0000 mon.a (mon.0) 9898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: audit 2024-09-21T02:54:25.359894+0000 mon.a (mon.0) 9899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:25 smithi179 bash[23186]: audit 2024-09-21T02:54:25.367667+0000 mon.a (mon.0) 9900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:26.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:26.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: cluster 2024-09-21T02:54:24.232773+0000 mgr.a (mgr.14388) 12115 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: audit 2024-09-21T02:54:24.331455+0000 mgr.a (mgr.14388) 12116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: cephadm 2024-09-21T02:54:24.332750+0000 mgr.a (mgr.14388) 12117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: audit 2024-09-21T02:54:25.200300+0000 mon.a (mon.0) 9895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: audit 2024-09-21T02:54:25.211091+0000 mon.a (mon.0) 9896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: audit 2024-09-21T02:54:25.221959+0000 mon.a (mon.0) 9897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: audit 2024-09-21T02:54:25.353717+0000 mon.a (mon.0) 9898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: audit 2024-09-21T02:54:25.359894+0000 mon.a (mon.0) 9899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:25 smithi049 bash[23528]: audit 2024-09-21T02:54:25.367667+0000 mon.a (mon.0) 9900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:26.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:26.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:26.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:27.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:27 smithi044 bash[22676]: cluster 2024-09-21T02:54:26.234141+0000 mgr.a (mgr.14388) 12118 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:27.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:27 smithi044 bash[22676]: audit 2024-09-21T02:54:26.372879+0000 mgr.a (mgr.14388) 12119 : audit [DBG] from='client.265221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:27 smithi179 bash[23186]: cluster 2024-09-21T02:54:26.234141+0000 mgr.a (mgr.14388) 12118 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:27 smithi179 bash[23186]: audit 2024-09-21T02:54:26.372879+0000 mgr.a (mgr.14388) 12119 : audit [DBG] from='client.265221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:27 smithi049 bash[23528]: cluster 2024-09-21T02:54:26.234141+0000 mgr.a (mgr.14388) 12118 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:27 smithi049 bash[23528]: audit 2024-09-21T02:54:26.372879+0000 mgr.a (mgr.14388) 12119 : audit [DBG] from='client.265221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:29 smithi044 bash[22676]: cluster 2024-09-21T02:54:28.235188+0000 mgr.a (mgr.14388) 12120 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:29 smithi179 bash[23186]: cluster 2024-09-21T02:54:28.235188+0000 mgr.a (mgr.14388) 12120 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:29 smithi049 bash[23528]: cluster 2024-09-21T02:54:28.235188+0000 mgr.a (mgr.14388) 12120 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:31.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:31.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:31.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:31 smithi044 bash[22676]: cluster 2024-09-21T02:54:30.237478+0000 mgr.a (mgr.14388) 12121 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:31 smithi179 bash[23186]: cluster 2024-09-21T02:54:30.237478+0000 mgr.a (mgr.14388) 12121 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:31 smithi049 bash[23528]: cluster 2024-09-21T02:54:30.237478+0000 mgr.a (mgr.14388) 12121 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:32.564 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:32.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:32.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:32.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:32.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:33 smithi044 bash[22676]: audit 2024-09-21T02:54:32.133103+0000 mgr.a (mgr.14388) 12122 : audit [DBG] from='client.265296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:33 smithi044 bash[22676]: cluster 2024-09-21T02:54:32.237963+0000 mgr.a (mgr.14388) 12123 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:33 smithi044 bash[22676]: audit 2024-09-21T02:54:32.482899+0000 mon.a (mon.0) 9901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:33 smithi044 bash[22676]: audit 2024-09-21T02:54:32.490219+0000 mon.a (mon.0) 9902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:33 smithi044 bash[22676]: audit 2024-09-21T02:54:32.495488+0000 mon.a (mon.0) 9903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:33 smithi179 bash[23186]: audit 2024-09-21T02:54:32.133103+0000 mgr.a (mgr.14388) 12122 : audit [DBG] from='client.265296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:33 smithi179 bash[23186]: cluster 2024-09-21T02:54:32.237963+0000 mgr.a (mgr.14388) 12123 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:33 smithi179 bash[23186]: audit 2024-09-21T02:54:32.482899+0000 mon.a (mon.0) 9901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:33 smithi179 bash[23186]: audit 2024-09-21T02:54:32.490219+0000 mon.a (mon.0) 9902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:33 smithi179 bash[23186]: audit 2024-09-21T02:54:32.495488+0000 mon.a (mon.0) 9903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:33 smithi049 bash[23528]: audit 2024-09-21T02:54:32.133103+0000 mgr.a (mgr.14388) 12122 : audit [DBG] from='client.265296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:33 smithi049 bash[23528]: cluster 2024-09-21T02:54:32.237963+0000 mgr.a (mgr.14388) 12123 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:33 smithi049 bash[23528]: audit 2024-09-21T02:54:32.482899+0000 mon.a (mon.0) 9901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:33 smithi049 bash[23528]: audit 2024-09-21T02:54:32.490219+0000 mon.a (mon.0) 9902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:33 smithi049 bash[23528]: audit 2024-09-21T02:54:32.495488+0000 mon.a (mon.0) 9903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:35 smithi179 bash[23186]: cluster 2024-09-21T02:54:34.238799+0000 mgr.a (mgr.14388) 12124 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:35 smithi049 bash[23528]: cluster 2024-09-21T02:54:34.238799+0000 mgr.a (mgr.14388) 12124 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:35 smithi044 bash[22676]: cluster 2024-09-21T02:54:34.238799+0000 mgr.a (mgr.14388) 12124 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:37 smithi049 bash[23528]: cluster 2024-09-21T02:54:36.241050+0000 mgr.a (mgr.14388) 12125 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:37.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:37 smithi044 bash[22676]: cluster 2024-09-21T02:54:36.241050+0000 mgr.a (mgr.14388) 12125 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:37 smithi179 bash[23186]: cluster 2024-09-21T02:54:36.241050+0000 mgr.a (mgr.14388) 12125 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:54:38.347 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:38.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:38.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:38.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:38.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:39 smithi179 bash[23186]: audit 2024-09-21T02:54:37.904006+0000 mgr.a (mgr.14388) 12126 : audit [DBG] from='client.265374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:39 smithi179 bash[23186]: cluster 2024-09-21T02:54:38.245107+0000 mgr.a (mgr.14388) 12127 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:39 smithi049 bash[23528]: audit 2024-09-21T02:54:37.904006+0000 mgr.a (mgr.14388) 12126 : audit [DBG] from='client.265374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:39 smithi049 bash[23528]: cluster 2024-09-21T02:54:38.245107+0000 mgr.a (mgr.14388) 12127 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:39 smithi044 bash[22676]: audit 2024-09-21T02:54:37.904006+0000 mgr.a (mgr.14388) 12126 : audit [DBG] from='client.265374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:39 smithi044 bash[22676]: cluster 2024-09-21T02:54:38.245107+0000 mgr.a (mgr.14388) 12127 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:41 smithi179 bash[23186]: cluster 2024-09-21T02:54:40.247256+0000 mgr.a (mgr.14388) 12128 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:41 smithi049 bash[23528]: cluster 2024-09-21T02:54:40.247256+0000 mgr.a (mgr.14388) 12128 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:41 smithi044 bash[22676]: cluster 2024-09-21T02:54:40.247256+0000 mgr.a (mgr.14388) 12128 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:43.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:43 smithi049 bash[23528]: cluster 2024-09-21T02:54:42.248059+0000 mgr.a (mgr.14388) 12129 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:43 smithi044 bash[22676]: cluster 2024-09-21T02:54:42.248059+0000 mgr.a (mgr.14388) 12129 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:43 smithi179 bash[23186]: cluster 2024-09-21T02:54:42.248059+0000 mgr.a (mgr.14388) 12129 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:44.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:44.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:44.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:44.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:44.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:44 smithi049 bash[23528]: audit 2024-09-21T02:54:43.681319+0000 mgr.a (mgr.14388) 12130 : audit [DBG] from='client.265449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:44 smithi044 bash[22676]: audit 2024-09-21T02:54:43.681319+0000 mgr.a (mgr.14388) 12130 : audit [DBG] from='client.265449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:44 smithi179 bash[23186]: audit 2024-09-21T02:54:43.681319+0000 mgr.a (mgr.14388) 12130 : audit [DBG] from='client.265449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:45 smithi179 bash[23186]: cluster 2024-09-21T02:54:44.249021+0000 mgr.a (mgr.14388) 12131 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:45 smithi179 bash[23186]: audit 2024-09-21T02:54:45.442019+0000 mon.a (mon.0) 9904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:45 smithi179 bash[23186]: audit 2024-09-21T02:54:45.450061+0000 mon.a (mon.0) 9905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:45 smithi179 bash[23186]: audit 2024-09-21T02:54:45.460575+0000 mon.a (mon.0) 9906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:45 smithi049 bash[23528]: cluster 2024-09-21T02:54:44.249021+0000 mgr.a (mgr.14388) 12131 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:45 smithi049 bash[23528]: audit 2024-09-21T02:54:45.442019+0000 mon.a (mon.0) 9904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:45 smithi049 bash[23528]: audit 2024-09-21T02:54:45.450061+0000 mon.a (mon.0) 9905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:45 smithi049 bash[23528]: audit 2024-09-21T02:54:45.460575+0000 mon.a (mon.0) 9906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:45 smithi044 bash[22676]: cluster 2024-09-21T02:54:44.249021+0000 mgr.a (mgr.14388) 12131 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:45 smithi044 bash[22676]: audit 2024-09-21T02:54:45.442019+0000 mon.a (mon.0) 9904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:45 smithi044 bash[22676]: audit 2024-09-21T02:54:45.450061+0000 mon.a (mon.0) 9905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:45 smithi044 bash[22676]: audit 2024-09-21T02:54:45.460575+0000 mon.a (mon.0) 9906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:46 smithi044 bash[22676]: audit 2024-09-21T02:54:45.562780+0000 mon.a (mon.0) 9907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:46 smithi044 bash[22676]: audit 2024-09-21T02:54:45.567950+0000 mon.a (mon.0) 9908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:46 smithi044 bash[22676]: audit 2024-09-21T02:54:45.574818+0000 mon.a (mon.0) 9909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:46 smithi179 bash[23186]: audit 2024-09-21T02:54:45.562780+0000 mon.a (mon.0) 9907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:46 smithi179 bash[23186]: audit 2024-09-21T02:54:45.567950+0000 mon.a (mon.0) 9908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:46 smithi179 bash[23186]: audit 2024-09-21T02:54:45.574818+0000 mon.a (mon.0) 9909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:46 smithi049 bash[23528]: audit 2024-09-21T02:54:45.562780+0000 mon.a (mon.0) 9907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:46 smithi049 bash[23528]: audit 2024-09-21T02:54:45.567950+0000 mon.a (mon.0) 9908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:46 smithi049 bash[23528]: audit 2024-09-21T02:54:45.574818+0000 mon.a (mon.0) 9909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:47 smithi179 bash[23186]: cluster 2024-09-21T02:54:46.251408+0000 mgr.a (mgr.14388) 12132 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:47 smithi044 bash[22676]: cluster 2024-09-21T02:54:46.251408+0000 mgr.a (mgr.14388) 12132 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:47 smithi049 bash[23528]: cluster 2024-09-21T02:54:46.251408+0000 mgr.a (mgr.14388) 12132 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:49.879 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:49.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:49.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:49 smithi044 bash[22676]: cluster 2024-09-21T02:54:48.252364+0000 mgr.a (mgr.14388) 12133 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:49 smithi179 bash[23186]: cluster 2024-09-21T02:54:48.252364+0000 mgr.a (mgr.14388) 12133 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:49 smithi049 bash[23528]: cluster 2024-09-21T02:54:48.252364+0000 mgr.a (mgr.14388) 12133 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:50 smithi044 bash[22676]: audit 2024-09-21T02:54:49.450216+0000 mgr.a (mgr.14388) 12134 : audit [DBG] from='client.265527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:50 smithi179 bash[23186]: audit 2024-09-21T02:54:49.450216+0000 mgr.a (mgr.14388) 12134 : audit [DBG] from='client.265527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:50 smithi049 bash[23528]: audit 2024-09-21T02:54:49.450216+0000 mgr.a (mgr.14388) 12134 : audit [DBG] from='client.265527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:51 smithi044 bash[22676]: cluster 2024-09-21T02:54:50.254801+0000 mgr.a (mgr.14388) 12135 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:51 smithi179 bash[23186]: cluster 2024-09-21T02:54:50.254801+0000 mgr.a (mgr.14388) 12135 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:51 smithi049 bash[23528]: cluster 2024-09-21T02:54:50.254801+0000 mgr.a (mgr.14388) 12135 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:54:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:53 smithi044 bash[22676]: cluster 2024-09-21T02:54:52.255769+0000 mgr.a (mgr.14388) 12136 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:53 smithi044 bash[22676]: audit 2024-09-21T02:54:52.707936+0000 mon.a (mon.0) 9910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:53 smithi044 bash[22676]: audit 2024-09-21T02:54:52.716717+0000 mon.a (mon.0) 9911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:53 smithi044 bash[22676]: audit 2024-09-21T02:54:52.727218+0000 mon.a (mon.0) 9912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:53 smithi179 bash[23186]: cluster 2024-09-21T02:54:52.255769+0000 mgr.a (mgr.14388) 12136 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:53 smithi179 bash[23186]: audit 2024-09-21T02:54:52.707936+0000 mon.a (mon.0) 9910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:53 smithi179 bash[23186]: audit 2024-09-21T02:54:52.716717+0000 mon.a (mon.0) 9911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:53 smithi179 bash[23186]: audit 2024-09-21T02:54:52.727218+0000 mon.a (mon.0) 9912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:53 smithi049 bash[23528]: cluster 2024-09-21T02:54:52.255769+0000 mgr.a (mgr.14388) 12136 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:53 smithi049 bash[23528]: audit 2024-09-21T02:54:52.707936+0000 mon.a (mon.0) 9910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:53 smithi049 bash[23528]: audit 2024-09-21T02:54:52.716717+0000 mon.a (mon.0) 9911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:53 smithi049 bash[23528]: audit 2024-09-21T02:54:52.727218+0000 mon.a (mon.0) 9912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:54:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:54:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:54:54.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:54:55.655 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:54:55.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:54:55.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:54:55.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:54:55.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:54:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:55 smithi179 bash[23186]: cluster 2024-09-21T02:54:54.256570+0000 mgr.a (mgr.14388) 12137 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:55 smithi044 bash[22676]: cluster 2024-09-21T02:54:54.256570+0000 mgr.a (mgr.14388) 12137 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:55 smithi049 bash[23528]: cluster 2024-09-21T02:54:54.256570+0000 mgr.a (mgr.14388) 12137 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:56.906 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:56 smithi044 bash[22676]: audit 2024-09-21T02:54:55.216910+0000 mgr.a (mgr.14388) 12138 : audit [DBG] from='client.265602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:56 smithi179 bash[23186]: audit 2024-09-21T02:54:55.216910+0000 mgr.a (mgr.14388) 12138 : audit [DBG] from='client.265602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:56 smithi049 bash[23528]: audit 2024-09-21T02:54:55.216910+0000 mgr.a (mgr.14388) 12138 : audit [DBG] from='client.265602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:57.983 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:57 smithi049 bash[23528]: cluster 2024-09-21T02:54:56.259522+0000 mgr.a (mgr.14388) 12139 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:57 smithi044 bash[22676]: cluster 2024-09-21T02:54:56.259522+0000 mgr.a (mgr.14388) 12139 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:57 smithi179 bash[23186]: cluster 2024-09-21T02:54:56.259522+0000 mgr.a (mgr.14388) 12139 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:54:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:54:59 smithi044 bash[22676]: cluster 2024-09-21T02:54:58.260312+0000 mgr.a (mgr.14388) 12140 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:55:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:54:59 smithi179 bash[23186]: cluster 2024-09-21T02:54:58.260312+0000 mgr.a (mgr.14388) 12140 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:55:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:54:59 smithi049 bash[23528]: cluster 2024-09-21T02:54:58.260312+0000 mgr.a (mgr.14388) 12140 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:55:00.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:00.658 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:00.658 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:01.416 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:01.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:01.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:01.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:01.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:01 smithi044 bash[22676]: cluster 2024-09-21T02:55:00.262302+0000 mgr.a (mgr.14388) 12141 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:01 smithi179 bash[23186]: cluster 2024-09-21T02:55:00.262302+0000 mgr.a (mgr.14388) 12141 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:01 smithi049 bash[23528]: cluster 2024-09-21T02:55:00.262302+0000 mgr.a (mgr.14388) 12141 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:02 smithi179 bash[23186]: audit 2024-09-21T02:55:00.986027+0000 mgr.a (mgr.14388) 12142 : audit [DBG] from='client.265680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:02 smithi049 bash[23528]: audit 2024-09-21T02:55:00.986027+0000 mgr.a (mgr.14388) 12142 : audit [DBG] from='client.265680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:02 smithi044 bash[22676]: audit 2024-09-21T02:55:00.986027+0000 mgr.a (mgr.14388) 12142 : audit [DBG] from='client.265680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:03 smithi179 bash[23186]: cluster 2024-09-21T02:55:02.263226+0000 mgr.a (mgr.14388) 12143 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:55:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:03 smithi049 bash[23528]: cluster 2024-09-21T02:55:02.263226+0000 mgr.a (mgr.14388) 12143 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:55:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:03 smithi044 bash[22676]: cluster 2024-09-21T02:55:02.263226+0000 mgr.a (mgr.14388) 12143 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:55:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:05 smithi179 bash[23186]: cluster 2024-09-21T02:55:04.264035+0000 mgr.a (mgr.14388) 12144 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:55:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:05 smithi179 bash[23186]: audit 2024-09-21T02:55:05.606379+0000 mon.a (mon.0) 9913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:05 smithi179 bash[23186]: audit 2024-09-21T02:55:05.611539+0000 mon.a (mon.0) 9914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:05 smithi179 bash[23186]: audit 2024-09-21T02:55:05.618327+0000 mon.a (mon.0) 9915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:05 smithi049 bash[23528]: cluster 2024-09-21T02:55:04.264035+0000 mgr.a (mgr.14388) 12144 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:55:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:05 smithi049 bash[23528]: audit 2024-09-21T02:55:05.606379+0000 mon.a (mon.0) 9913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:05 smithi049 bash[23528]: audit 2024-09-21T02:55:05.611539+0000 mon.a (mon.0) 9914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:05 smithi049 bash[23528]: audit 2024-09-21T02:55:05.618327+0000 mon.a (mon.0) 9915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:05 smithi044 bash[22676]: cluster 2024-09-21T02:55:04.264035+0000 mgr.a (mgr.14388) 12144 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:55:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:05 smithi044 bash[22676]: audit 2024-09-21T02:55:05.606379+0000 mon.a (mon.0) 9913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:05 smithi044 bash[22676]: audit 2024-09-21T02:55:05.611539+0000 mon.a (mon.0) 9914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:05 smithi044 bash[22676]: audit 2024-09-21T02:55:05.618327+0000 mon.a (mon.0) 9915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:06.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:06 smithi049 bash[23528]: audit 2024-09-21T02:55:05.763457+0000 mon.a (mon.0) 9916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:06 smithi049 bash[23528]: audit 2024-09-21T02:55:05.769818+0000 mon.a (mon.0) 9917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:06 smithi049 bash[23528]: audit 2024-09-21T02:55:05.779022+0000 mon.a (mon.0) 9918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.207 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:07.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:07.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:07.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:07.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:06 smithi044 bash[22676]: audit 2024-09-21T02:55:05.763457+0000 mon.a (mon.0) 9916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:06 smithi044 bash[22676]: audit 2024-09-21T02:55:05.769818+0000 mon.a (mon.0) 9917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:06 smithi044 bash[22676]: audit 2024-09-21T02:55:05.779022+0000 mon.a (mon.0) 9918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:06 smithi179 bash[23186]: audit 2024-09-21T02:55:05.763457+0000 mon.a (mon.0) 9916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:06 smithi179 bash[23186]: audit 2024-09-21T02:55:05.769818+0000 mon.a (mon.0) 9917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:06 smithi179 bash[23186]: audit 2024-09-21T02:55:05.779022+0000 mon.a (mon.0) 9918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:08.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:07 smithi179 bash[23186]: cluster 2024-09-21T02:55:06.266322+0000 mgr.a (mgr.14388) 12145 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:08.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:07 smithi179 bash[23186]: audit 2024-09-21T02:55:06.758114+0000 mgr.a (mgr.14388) 12146 : audit [DBG] from='client.265758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:07 smithi049 bash[23528]: cluster 2024-09-21T02:55:06.266322+0000 mgr.a (mgr.14388) 12145 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:07 smithi049 bash[23528]: audit 2024-09-21T02:55:06.758114+0000 mgr.a (mgr.14388) 12146 : audit [DBG] from='client.265758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:08.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:07 smithi044 bash[22676]: cluster 2024-09-21T02:55:06.266322+0000 mgr.a (mgr.14388) 12145 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:08.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:07 smithi044 bash[22676]: audit 2024-09-21T02:55:06.758114+0000 mgr.a (mgr.14388) 12146 : audit [DBG] from='client.265758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:09 smithi049 bash[23528]: cluster 2024-09-21T02:55:08.267228+0000 mgr.a (mgr.14388) 12147 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:09 smithi044 bash[22676]: cluster 2024-09-21T02:55:08.267228+0000 mgr.a (mgr.14388) 12147 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:09 smithi179 bash[23186]: cluster 2024-09-21T02:55:08.267228+0000 mgr.a (mgr.14388) 12147 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:11 smithi049 bash[23528]: cluster 2024-09-21T02:55:10.269487+0000 mgr.a (mgr.14388) 12148 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:11 smithi044 bash[22676]: cluster 2024-09-21T02:55:10.269487+0000 mgr.a (mgr.14388) 12148 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:11 smithi179 bash[23186]: cluster 2024-09-21T02:55:10.269487+0000 mgr.a (mgr.14388) 12148 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:12.985 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:12.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:12.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:12.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:12.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:13 smithi049 bash[23528]: cluster 2024-09-21T02:55:12.270031+0000 mgr.a (mgr.14388) 12149 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:13 smithi049 bash[23528]: audit 2024-09-21T02:55:12.540851+0000 mgr.a (mgr.14388) 12150 : audit [DBG] from='client.265836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:13 smithi049 bash[23528]: audit 2024-09-21T02:55:12.932202+0000 mon.a (mon.0) 9919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:13 smithi049 bash[23528]: audit 2024-09-21T02:55:12.938197+0000 mon.a (mon.0) 9920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:13 smithi049 bash[23528]: audit 2024-09-21T02:55:12.943382+0000 mon.a (mon.0) 9921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:13 smithi044 bash[22676]: cluster 2024-09-21T02:55:12.270031+0000 mgr.a (mgr.14388) 12149 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:13 smithi044 bash[22676]: audit 2024-09-21T02:55:12.540851+0000 mgr.a (mgr.14388) 12150 : audit [DBG] from='client.265836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:13 smithi044 bash[22676]: audit 2024-09-21T02:55:12.932202+0000 mon.a (mon.0) 9919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:13 smithi044 bash[22676]: audit 2024-09-21T02:55:12.938197+0000 mon.a (mon.0) 9920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:13 smithi044 bash[22676]: audit 2024-09-21T02:55:12.943382+0000 mon.a (mon.0) 9921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:13 smithi179 bash[23186]: cluster 2024-09-21T02:55:12.270031+0000 mgr.a (mgr.14388) 12149 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:13 smithi179 bash[23186]: audit 2024-09-21T02:55:12.540851+0000 mgr.a (mgr.14388) 12150 : audit [DBG] from='client.265836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:13 smithi179 bash[23186]: audit 2024-09-21T02:55:12.932202+0000 mon.a (mon.0) 9919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:13 smithi179 bash[23186]: audit 2024-09-21T02:55:12.938197+0000 mon.a (mon.0) 9920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:13 smithi179 bash[23186]: audit 2024-09-21T02:55:12.943382+0000 mon.a (mon.0) 9921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:15.207 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:14 smithi179 bash[23186]: cluster 2024-09-21T02:55:14.270874+0000 mgr.a (mgr.14388) 12151 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:14 smithi044 bash[22676]: cluster 2024-09-21T02:55:14.270874+0000 mgr.a (mgr.14388) 12151 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:14 smithi049 bash[23528]: cluster 2024-09-21T02:55:14.270874+0000 mgr.a (mgr.14388) 12151 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:17 smithi049 bash[23528]: cluster 2024-09-21T02:55:16.273137+0000 mgr.a (mgr.14388) 12152 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:17.608 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:17 smithi044 bash[22676]: cluster 2024-09-21T02:55:16.273137+0000 mgr.a (mgr.14388) 12152 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:17 smithi179 bash[23186]: cluster 2024-09-21T02:55:16.273137+0000 mgr.a (mgr.14388) 12152 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:17.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:17.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:18.782 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:19 smithi049 bash[23528]: cluster 2024-09-21T02:55:18.273875+0000 mgr.a (mgr.14388) 12153 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:19 smithi049 bash[23528]: audit 2024-09-21T02:55:18.327344+0000 mgr.a (mgr.14388) 12154 : audit [DBG] from='client.265914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:19 smithi044 bash[22676]: cluster 2024-09-21T02:55:18.273875+0000 mgr.a (mgr.14388) 12153 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:19 smithi044 bash[22676]: audit 2024-09-21T02:55:18.327344+0000 mgr.a (mgr.14388) 12154 : audit [DBG] from='client.265914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:19 smithi179 bash[23186]: cluster 2024-09-21T02:55:18.273875+0000 mgr.a (mgr.14388) 12153 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:19 smithi179 bash[23186]: audit 2024-09-21T02:55:18.327344+0000 mgr.a (mgr.14388) 12154 : audit [DBG] from='client.265914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:21 smithi044 bash[22676]: cluster 2024-09-21T02:55:20.276147+0000 mgr.a (mgr.14388) 12155 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:21 smithi179 bash[23186]: cluster 2024-09-21T02:55:20.276147+0000 mgr.a (mgr.14388) 12155 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:21 smithi049 bash[23528]: cluster 2024-09-21T02:55:20.276147+0000 mgr.a (mgr.14388) 12155 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:23 smithi044 bash[22676]: cluster 2024-09-21T02:55:22.276939+0000 mgr.a (mgr.14388) 12156 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:23 smithi179 bash[23186]: cluster 2024-09-21T02:55:22.276939+0000 mgr.a (mgr.14388) 12156 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:23.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:23 smithi049 bash[23528]: cluster 2024-09-21T02:55:22.276939+0000 mgr.a (mgr.14388) 12156 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:24.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:24.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:24.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:24.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:24.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:25.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.112992+0000 mgr.a (mgr.14388) 12157 : audit [DBG] from='client.265983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:25.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: cluster 2024-09-21T02:55:24.277915+0000 mgr.a (mgr.14388) 12158 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:25.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.386067+0000 mon.a (mon.0) 9922 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:55:25.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.936002+0000 mon.a (mon.0) 9923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.729 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.945426+0000 mon.a (mon.0) 9924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.729 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.948907+0000 mon.a (mon.0) 9925 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:55:25.729 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.951035+0000 mon.a (mon.0) 9926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:55:25.729 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.961729+0000 mon.a (mon.0) 9927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.729 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22676]: audit 2024-09-21T02:55:24.968658+0000 mon.a (mon.0) 9928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:55:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.112992+0000 mgr.a (mgr.14388) 12157 : audit [DBG] from='client.265983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: cluster 2024-09-21T02:55:24.277915+0000 mgr.a (mgr.14388) 12158 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.386067+0000 mon.a (mon.0) 9922 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:55:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.936002+0000 mon.a (mon.0) 9923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.945426+0000 mon.a (mon.0) 9924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.948907+0000 mon.a (mon.0) 9925 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:55:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.951035+0000 mon.a (mon.0) 9926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:55:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.961729+0000 mon.a (mon.0) 9927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:25 smithi179 bash[23186]: audit 2024-09-21T02:55:24.968658+0000 mon.a (mon.0) 9928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:55:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.112992+0000 mgr.a (mgr.14388) 12157 : audit [DBG] from='client.265983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: cluster 2024-09-21T02:55:24.277915+0000 mgr.a (mgr.14388) 12158 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.386067+0000 mon.a (mon.0) 9922 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:55:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.936002+0000 mon.a (mon.0) 9923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.945426+0000 mon.a (mon.0) 9924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.948907+0000 mon.a (mon.0) 9925 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.951035+0000 mon.a (mon.0) 9926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.961729+0000 mon.a (mon.0) 9927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:25 smithi049 bash[23528]: audit 2024-09-21T02:55:24.968658+0000 mon.a (mon.0) 9928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:55:25.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22930]: debug 2024-09-21T02:55:25.721+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:55:25.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:55:25 smithi044 bash[22930]: debug 2024-09-21T02:55:25.725+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:55:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:24.971564+0000 mgr.a (mgr.14388) 12159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:55:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:25.728703+0000 mgr.a (mgr.14388) 12160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:55:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: cephadm 2024-09-21T02:55:25.730239+0000 mgr.a (mgr.14388) 12161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:55:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:25.803749+0000 mon.a (mon.0) 9929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:25.811383+0000 mon.a (mon.0) 9930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:25.819010+0000 mon.a (mon.0) 9931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:25.948014+0000 mon.a (mon.0) 9932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:25.956087+0000 mon.a (mon.0) 9933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:26 smithi044 bash[22676]: audit 2024-09-21T02:55:25.965623+0000 mon.a (mon.0) 9934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:24.971564+0000 mgr.a (mgr.14388) 12159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:25.728703+0000 mgr.a (mgr.14388) 12160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: cephadm 2024-09-21T02:55:25.730239+0000 mgr.a (mgr.14388) 12161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:25.803749+0000 mon.a (mon.0) 9929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:25.811383+0000 mon.a (mon.0) 9930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:25.819010+0000 mon.a (mon.0) 9931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:25.948014+0000 mon.a (mon.0) 9932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:25.956087+0000 mon.a (mon.0) 9933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:26 smithi179 bash[23186]: audit 2024-09-21T02:55:25.965623+0000 mon.a (mon.0) 9934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:24.971564+0000 mgr.a (mgr.14388) 12159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:55:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:25.728703+0000 mgr.a (mgr.14388) 12160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:55:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: cephadm 2024-09-21T02:55:25.730239+0000 mgr.a (mgr.14388) 12161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:55:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:25.803749+0000 mon.a (mon.0) 9929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:25.811383+0000 mon.a (mon.0) 9930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:25.819010+0000 mon.a (mon.0) 9931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:25.948014+0000 mon.a (mon.0) 9932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:25.956087+0000 mon.a (mon.0) 9933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:26 smithi049 bash[23528]: audit 2024-09-21T02:55:25.965623+0000 mon.a (mon.0) 9934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:27.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:27 smithi044 bash[22676]: cluster 2024-09-21T02:55:26.280733+0000 mgr.a (mgr.14388) 12162 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:27 smithi179 bash[23186]: cluster 2024-09-21T02:55:26.280733+0000 mgr.a (mgr.14388) 12162 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:27 smithi049 bash[23528]: cluster 2024-09-21T02:55:26.280733+0000 mgr.a (mgr.14388) 12162 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:29.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:29.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:29.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:29.723 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:29 smithi044 bash[22676]: cluster 2024-09-21T02:55:28.281737+0000 mgr.a (mgr.14388) 12163 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:29 smithi179 bash[23186]: cluster 2024-09-21T02:55:28.281737+0000 mgr.a (mgr.14388) 12163 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:29 smithi049 bash[23528]: cluster 2024-09-21T02:55:28.281737+0000 mgr.a (mgr.14388) 12163 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:30.345 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:30.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:30.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:30.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:30.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:31 smithi044 bash[22676]: audit 2024-09-21T02:55:29.893774+0000 mgr.a (mgr.14388) 12164 : audit [DBG] from='client.266166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:31 smithi044 bash[22676]: cluster 2024-09-21T02:55:30.283395+0000 mgr.a (mgr.14388) 12165 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:31 smithi179 bash[23186]: audit 2024-09-21T02:55:29.893774+0000 mgr.a (mgr.14388) 12164 : audit [DBG] from='client.266166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:31 smithi179 bash[23186]: cluster 2024-09-21T02:55:30.283395+0000 mgr.a (mgr.14388) 12165 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:31 smithi049 bash[23528]: audit 2024-09-21T02:55:29.893774+0000 mgr.a (mgr.14388) 12164 : audit [DBG] from='client.266166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:31 smithi049 bash[23528]: cluster 2024-09-21T02:55:30.283395+0000 mgr.a (mgr.14388) 12165 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:33 smithi049 bash[23528]: cluster 2024-09-21T02:55:32.284150+0000 mgr.a (mgr.14388) 12166 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:33 smithi049 bash[23528]: audit 2024-09-21T02:55:33.159262+0000 mon.a (mon.0) 9935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:33 smithi049 bash[23528]: audit 2024-09-21T02:55:33.167887+0000 mon.a (mon.0) 9936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:33 smithi049 bash[23528]: audit 2024-09-21T02:55:33.178175+0000 mon.a (mon.0) 9937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:33 smithi044 bash[22676]: cluster 2024-09-21T02:55:32.284150+0000 mgr.a (mgr.14388) 12166 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:33 smithi044 bash[22676]: audit 2024-09-21T02:55:33.159262+0000 mon.a (mon.0) 9935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:33 smithi044 bash[22676]: audit 2024-09-21T02:55:33.167887+0000 mon.a (mon.0) 9936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:33 smithi044 bash[22676]: audit 2024-09-21T02:55:33.178175+0000 mon.a (mon.0) 9937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:33 smithi179 bash[23186]: cluster 2024-09-21T02:55:32.284150+0000 mgr.a (mgr.14388) 12166 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:33 smithi179 bash[23186]: audit 2024-09-21T02:55:33.159262+0000 mon.a (mon.0) 9935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:33 smithi179 bash[23186]: audit 2024-09-21T02:55:33.167887+0000 mon.a (mon.0) 9936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:33 smithi179 bash[23186]: audit 2024-09-21T02:55:33.178175+0000 mon.a (mon.0) 9937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:35.347 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:35.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:35.348 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:35.462 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:35 smithi179 bash[23186]: cluster 2024-09-21T02:55:34.285048+0000 mgr.a (mgr.14388) 12167 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:35 smithi044 bash[22676]: cluster 2024-09-21T02:55:34.285048+0000 mgr.a (mgr.14388) 12167 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:35 smithi049 bash[23528]: cluster 2024-09-21T02:55:34.285048+0000 mgr.a (mgr.14388) 12167 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:36.144 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:36.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:36.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:36.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:36.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:36.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:36 smithi044 bash[22676]: audit 2024-09-21T02:55:35.680841+0000 mgr.a (mgr.14388) 12168 : audit [DBG] from='client.266238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:36 smithi179 bash[23186]: audit 2024-09-21T02:55:35.680841+0000 mgr.a (mgr.14388) 12168 : audit [DBG] from='client.266238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:36 smithi049 bash[23528]: audit 2024-09-21T02:55:35.680841+0000 mgr.a (mgr.14388) 12168 : audit [DBG] from='client.266238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:37.632 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:37 smithi179 bash[23186]: cluster 2024-09-21T02:55:36.287980+0000 mgr.a (mgr.14388) 12169 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:37.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:37 smithi044 bash[22676]: cluster 2024-09-21T02:55:36.287980+0000 mgr.a (mgr.14388) 12169 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:37 smithi049 bash[23528]: cluster 2024-09-21T02:55:36.287980+0000 mgr.a (mgr.14388) 12169 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:39.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:39 smithi044 bash[22676]: cluster 2024-09-21T02:55:38.288774+0000 mgr.a (mgr.14388) 12170 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:39 smithi179 bash[23186]: cluster 2024-09-21T02:55:38.288774+0000 mgr.a (mgr.14388) 12170 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:39 smithi049 bash[23528]: cluster 2024-09-21T02:55:38.288774+0000 mgr.a (mgr.14388) 12170 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:55:41.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:41.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:41.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:41 smithi049 bash[23528]: cluster 2024-09-21T02:55:40.290713+0000 mgr.a (mgr.14388) 12171 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:41 smithi044 bash[22676]: cluster 2024-09-21T02:55:40.290713+0000 mgr.a (mgr.14388) 12171 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:41 smithi179 bash[23186]: cluster 2024-09-21T02:55:40.290713+0000 mgr.a (mgr.14388) 12171 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:55:41.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:41.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:41.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:41.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:41.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:42.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:42 smithi044 bash[22676]: audit 2024-09-21T02:55:41.488051+0000 mgr.a (mgr.14388) 12172 : audit [DBG] from='client.266316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:42 smithi179 bash[23186]: audit 2024-09-21T02:55:41.488051+0000 mgr.a (mgr.14388) 12172 : audit [DBG] from='client.266316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:42 smithi049 bash[23528]: audit 2024-09-21T02:55:41.488051+0000 mgr.a (mgr.14388) 12172 : audit [DBG] from='client.266316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:43 smithi044 bash[22676]: cluster 2024-09-21T02:55:42.291706+0000 mgr.a (mgr.14388) 12173 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:43 smithi179 bash[23186]: cluster 2024-09-21T02:55:42.291706+0000 mgr.a (mgr.14388) 12173 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:43 smithi049 bash[23528]: cluster 2024-09-21T02:55:42.291706+0000 mgr.a (mgr.14388) 12173 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:45 smithi044 bash[22676]: cluster 2024-09-21T02:55:44.292528+0000 mgr.a (mgr.14388) 12174 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:45 smithi179 bash[23186]: cluster 2024-09-21T02:55:44.292528+0000 mgr.a (mgr.14388) 12174 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:45 smithi049 bash[23528]: cluster 2024-09-21T02:55:44.292528+0000 mgr.a (mgr.14388) 12174 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:46.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:46.933 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:46.933 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:47 smithi049 bash[23528]: audit 2024-09-21T02:55:46.011479+0000 mon.a (mon.0) 9938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:47 smithi049 bash[23528]: audit 2024-09-21T02:55:46.019606+0000 mon.a (mon.0) 9939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:47 smithi049 bash[23528]: audit 2024-09-21T02:55:46.029721+0000 mon.a (mon.0) 9940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:47 smithi049 bash[23528]: audit 2024-09-21T02:55:46.190449+0000 mon.a (mon.0) 9941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:47 smithi049 bash[23528]: audit 2024-09-21T02:55:46.198719+0000 mon.a (mon.0) 9942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:47 smithi049 bash[23528]: audit 2024-09-21T02:55:46.209942+0000 mon.a (mon.0) 9943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:47 smithi049 bash[23528]: cluster 2024-09-21T02:55:46.294785+0000 mgr.a (mgr.14388) 12175 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:47 smithi044 bash[22676]: audit 2024-09-21T02:55:46.011479+0000 mon.a (mon.0) 9938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:47 smithi044 bash[22676]: audit 2024-09-21T02:55:46.019606+0000 mon.a (mon.0) 9939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:47 smithi044 bash[22676]: audit 2024-09-21T02:55:46.029721+0000 mon.a (mon.0) 9940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:47 smithi044 bash[22676]: audit 2024-09-21T02:55:46.190449+0000 mon.a (mon.0) 9941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:47 smithi044 bash[22676]: audit 2024-09-21T02:55:46.198719+0000 mon.a (mon.0) 9942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:47 smithi044 bash[22676]: audit 2024-09-21T02:55:46.209942+0000 mon.a (mon.0) 9943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:47 smithi044 bash[22676]: cluster 2024-09-21T02:55:46.294785+0000 mgr.a (mgr.14388) 12175 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:47 smithi179 bash[23186]: audit 2024-09-21T02:55:46.011479+0000 mon.a (mon.0) 9938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:47 smithi179 bash[23186]: audit 2024-09-21T02:55:46.019606+0000 mon.a (mon.0) 9939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:47 smithi179 bash[23186]: audit 2024-09-21T02:55:46.029721+0000 mon.a (mon.0) 9940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:47 smithi179 bash[23186]: audit 2024-09-21T02:55:46.190449+0000 mon.a (mon.0) 9941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:47 smithi179 bash[23186]: audit 2024-09-21T02:55:46.198719+0000 mon.a (mon.0) 9942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:47 smithi179 bash[23186]: audit 2024-09-21T02:55:46.209942+0000 mon.a (mon.0) 9943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:47 smithi179 bash[23186]: cluster 2024-09-21T02:55:46.294785+0000 mgr.a (mgr.14388) 12175 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:55:47.692 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:47.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:47.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:47.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:47.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:48.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:48 smithi044 bash[22676]: audit 2024-09-21T02:55:47.268270+0000 mgr.a (mgr.14388) 12176 : audit [DBG] from='client.266394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:48 smithi179 bash[23186]: audit 2024-09-21T02:55:47.268270+0000 mgr.a (mgr.14388) 12176 : audit [DBG] from='client.266394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:48 smithi049 bash[23528]: audit 2024-09-21T02:55:47.268270+0000 mgr.a (mgr.14388) 12176 : audit [DBG] from='client.266394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:49.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:49 smithi044 bash[22676]: cluster 2024-09-21T02:55:48.295693+0000 mgr.a (mgr.14388) 12177 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:49 smithi179 bash[23186]: cluster 2024-09-21T02:55:48.295693+0000 mgr.a (mgr.14388) 12177 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:49 smithi049 bash[23528]: cluster 2024-09-21T02:55:48.295693+0000 mgr.a (mgr.14388) 12177 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:55:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:51 smithi044 bash[22676]: cluster 2024-09-21T02:55:50.296934+0000 mgr.a (mgr.14388) 12178 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:55:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:51 smithi179 bash[23186]: cluster 2024-09-21T02:55:50.296934+0000 mgr.a (mgr.14388) 12178 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:55:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:51 smithi049 bash[23528]: cluster 2024-09-21T02:55:50.296934+0000 mgr.a (mgr.14388) 12178 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:55:52.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:53.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:53.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:53 smithi044 bash[22676]: cluster 2024-09-21T02:55:52.297692+0000 mgr.a (mgr.14388) 12179 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:53 smithi179 bash[23186]: cluster 2024-09-21T02:55:52.297692+0000 mgr.a (mgr.14388) 12179 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:53 smithi049 bash[23528]: cluster 2024-09-21T02:55:52.297692+0000 mgr.a (mgr.14388) 12179 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:54 smithi044 bash[22676]: audit 2024-09-21T02:55:53.032439+0000 mgr.a (mgr.14388) 12180 : audit [DBG] from='client.266472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:54 smithi044 bash[22676]: audit 2024-09-21T02:55:53.379658+0000 mon.a (mon.0) 9944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:54 smithi044 bash[22676]: audit 2024-09-21T02:55:53.384842+0000 mon.a (mon.0) 9945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:54 smithi044 bash[22676]: audit 2024-09-21T02:55:53.401307+0000 mon.a (mon.0) 9946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:54 smithi179 bash[23186]: audit 2024-09-21T02:55:53.032439+0000 mgr.a (mgr.14388) 12180 : audit [DBG] from='client.266472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:54 smithi179 bash[23186]: audit 2024-09-21T02:55:53.379658+0000 mon.a (mon.0) 9944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:54 smithi179 bash[23186]: audit 2024-09-21T02:55:53.384842+0000 mon.a (mon.0) 9945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:54 smithi179 bash[23186]: audit 2024-09-21T02:55:53.401307+0000 mon.a (mon.0) 9946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:54 smithi049 bash[23528]: audit 2024-09-21T02:55:53.032439+0000 mgr.a (mgr.14388) 12180 : audit [DBG] from='client.266472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:54 smithi049 bash[23528]: audit 2024-09-21T02:55:53.379658+0000 mon.a (mon.0) 9944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:54 smithi049 bash[23528]: audit 2024-09-21T02:55:53.384842+0000 mon.a (mon.0) 9945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:54 smithi049 bash[23528]: audit 2024-09-21T02:55:53.401307+0000 mon.a (mon.0) 9946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:55:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:55 smithi044 bash[22676]: cluster 2024-09-21T02:55:54.298571+0000 mgr.a (mgr.14388) 12181 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:55.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:55 smithi179 bash[23186]: cluster 2024-09-21T02:55:54.298571+0000 mgr.a (mgr.14388) 12181 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:55 smithi049 bash[23528]: cluster 2024-09-21T02:55:54.298571+0000 mgr.a (mgr.14388) 12181 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:57 smithi179 bash[23186]: cluster 2024-09-21T02:55:56.299911+0000 mgr.a (mgr.14388) 12182 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:55:57.639 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:57 smithi044 bash[22676]: cluster 2024-09-21T02:55:56.299911+0000 mgr.a (mgr.14388) 12182 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:55:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:57 smithi049 bash[23528]: cluster 2024-09-21T02:55:56.299911+0000 mgr.a (mgr.14388) 12182 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:55:58.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:55:58.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:55:58.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:55:59.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:55:59.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:55:59.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:55:59.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:55:59.308 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:55:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:55:59 smithi049 bash[23528]: cluster 2024-09-21T02:55:58.300660+0000 mgr.a (mgr.14388) 12183 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:59.701 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:55:59 smithi044 bash[22676]: cluster 2024-09-21T02:55:58.300660+0000 mgr.a (mgr.14388) 12183 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:55:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:55:59 smithi179 bash[23186]: cluster 2024-09-21T02:55:58.300660+0000 mgr.a (mgr.14388) 12183 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T02:56:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:00 smithi049 bash[23528]: audit 2024-09-21T02:55:58.840160+0000 mgr.a (mgr.14388) 12184 : audit [DBG] from='client.266544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:00 smithi044 bash[22676]: audit 2024-09-21T02:55:58.840160+0000 mgr.a (mgr.14388) 12184 : audit [DBG] from='client.266544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:00 smithi179 bash[23186]: audit 2024-09-21T02:55:58.840160+0000 mgr.a (mgr.14388) 12184 : audit [DBG] from='client.266544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:01 smithi044 bash[22676]: cluster 2024-09-21T02:56:00.303036+0000 mgr.a (mgr.14388) 12185 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:56:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:01 smithi179 bash[23186]: cluster 2024-09-21T02:56:00.303036+0000 mgr.a (mgr.14388) 12185 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:56:01.752 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:01 smithi049 bash[23528]: cluster 2024-09-21T02:56:00.303036+0000 mgr.a (mgr.14388) 12185 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T02:56:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:03 smithi044 bash[22676]: cluster 2024-09-21T02:56:02.303821+0000 mgr.a (mgr.14388) 12186 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:03 smithi179 bash[23186]: cluster 2024-09-21T02:56:02.303821+0000 mgr.a (mgr.14388) 12186 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:03.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:03 smithi049 bash[23528]: cluster 2024-09-21T02:56:02.303821+0000 mgr.a (mgr.14388) 12186 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:04.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:04.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:04.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:05.098 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:05 smithi044 bash[22676]: cluster 2024-09-21T02:56:04.304579+0000 mgr.a (mgr.14388) 12187 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:05 smithi044 bash[22676]: audit 2024-09-21T02:56:04.644015+0000 mgr.a (mgr.14388) 12188 : audit [DBG] from='client.266619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:05 smithi179 bash[23186]: cluster 2024-09-21T02:56:04.304579+0000 mgr.a (mgr.14388) 12187 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:05 smithi179 bash[23186]: audit 2024-09-21T02:56:04.644015+0000 mgr.a (mgr.14388) 12188 : audit [DBG] from='client.266619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:05 smithi049 bash[23528]: cluster 2024-09-21T02:56:04.304579+0000 mgr.a (mgr.14388) 12187 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:05 smithi049 bash[23528]: audit 2024-09-21T02:56:04.644015+0000 mgr.a (mgr.14388) 12188 : audit [DBG] from='client.266619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:07 smithi179 bash[23186]: audit 2024-09-21T02:56:06.240342+0000 mon.a (mon.0) 9947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:07 smithi179 bash[23186]: audit 2024-09-21T02:56:06.246550+0000 mon.a (mon.0) 9948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:07 smithi179 bash[23186]: audit 2024-09-21T02:56:06.257177+0000 mon.a (mon.0) 9949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:07 smithi179 bash[23186]: cluster 2024-09-21T02:56:06.306540+0000 mgr.a (mgr.14388) 12189 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:56:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:07 smithi179 bash[23186]: audit 2024-09-21T02:56:06.382431+0000 mon.a (mon.0) 9950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:07 smithi179 bash[23186]: audit 2024-09-21T02:56:06.389121+0000 mon.a (mon.0) 9951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:07 smithi179 bash[23186]: audit 2024-09-21T02:56:06.395831+0000 mon.a (mon.0) 9952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:07 smithi049 bash[23528]: audit 2024-09-21T02:56:06.240342+0000 mon.a (mon.0) 9947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:07 smithi049 bash[23528]: audit 2024-09-21T02:56:06.246550+0000 mon.a (mon.0) 9948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:07 smithi049 bash[23528]: audit 2024-09-21T02:56:06.257177+0000 mon.a (mon.0) 9949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:07 smithi049 bash[23528]: cluster 2024-09-21T02:56:06.306540+0000 mgr.a (mgr.14388) 12189 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:56:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:07 smithi049 bash[23528]: audit 2024-09-21T02:56:06.382431+0000 mon.a (mon.0) 9950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:07 smithi049 bash[23528]: audit 2024-09-21T02:56:06.389121+0000 mon.a (mon.0) 9951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:07 smithi049 bash[23528]: audit 2024-09-21T02:56:06.395831+0000 mon.a (mon.0) 9952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:07 smithi044 bash[22676]: audit 2024-09-21T02:56:06.240342+0000 mon.a (mon.0) 9947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:07 smithi044 bash[22676]: audit 2024-09-21T02:56:06.246550+0000 mon.a (mon.0) 9948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:07 smithi044 bash[22676]: audit 2024-09-21T02:56:06.257177+0000 mon.a (mon.0) 9949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:07 smithi044 bash[22676]: cluster 2024-09-21T02:56:06.306540+0000 mgr.a (mgr.14388) 12189 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:56:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:07 smithi044 bash[22676]: audit 2024-09-21T02:56:06.382431+0000 mon.a (mon.0) 9950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:07 smithi044 bash[22676]: audit 2024-09-21T02:56:06.389121+0000 mon.a (mon.0) 9951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:07 smithi044 bash[22676]: audit 2024-09-21T02:56:06.395831+0000 mon.a (mon.0) 9952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:09.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:09 smithi044 bash[22676]: cluster 2024-09-21T02:56:08.307451+0000 mgr.a (mgr.14388) 12190 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:56:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:09 smithi179 bash[23186]: cluster 2024-09-21T02:56:08.307451+0000 mgr.a (mgr.14388) 12190 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:56:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:09 smithi049 bash[23528]: cluster 2024-09-21T02:56:08.307451+0000 mgr.a (mgr.14388) 12190 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:56:10.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:10.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:10.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:10.864 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:10.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:11 smithi044 bash[22676]: cluster 2024-09-21T02:56:10.309638+0000 mgr.a (mgr.14388) 12191 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:11 smithi044 bash[22676]: audit 2024-09-21T02:56:10.436142+0000 mgr.a (mgr.14388) 12192 : audit [DBG] from='client.266697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:11 smithi179 bash[23186]: cluster 2024-09-21T02:56:10.309638+0000 mgr.a (mgr.14388) 12191 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:11 smithi179 bash[23186]: audit 2024-09-21T02:56:10.436142+0000 mgr.a (mgr.14388) 12192 : audit [DBG] from='client.266697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:11 smithi049 bash[23528]: cluster 2024-09-21T02:56:10.309638+0000 mgr.a (mgr.14388) 12191 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:11 smithi049 bash[23528]: audit 2024-09-21T02:56:10.436142+0000 mgr.a (mgr.14388) 12192 : audit [DBG] from='client.266697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:13.641 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:13 smithi049 bash[23528]: cluster 2024-09-21T02:56:12.310731+0000 mgr.a (mgr.14388) 12193 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:56:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:13 smithi044 bash[22676]: cluster 2024-09-21T02:56:12.310731+0000 mgr.a (mgr.14388) 12193 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:56:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:13 smithi179 bash[23186]: cluster 2024-09-21T02:56:12.310731+0000 mgr.a (mgr.14388) 12193 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:56:14.912 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:14 smithi179 bash[23186]: audit 2024-09-21T02:56:13.619787+0000 mon.a (mon.0) 9953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:14.912 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:14 smithi179 bash[23186]: audit 2024-09-21T02:56:13.628681+0000 mon.a (mon.0) 9954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:14.912 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:14 smithi179 bash[23186]: audit 2024-09-21T02:56:13.639349+0000 mon.a (mon.0) 9955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:14 smithi044 bash[22676]: audit 2024-09-21T02:56:13.619787+0000 mon.a (mon.0) 9953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:14 smithi044 bash[22676]: audit 2024-09-21T02:56:13.628681+0000 mon.a (mon.0) 9954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:14 smithi044 bash[22676]: audit 2024-09-21T02:56:13.639349+0000 mon.a (mon.0) 9955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:14 smithi049 bash[23528]: audit 2024-09-21T02:56:13.619787+0000 mon.a (mon.0) 9953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:14 smithi049 bash[23528]: audit 2024-09-21T02:56:13.628681+0000 mon.a (mon.0) 9954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:14 smithi049 bash[23528]: audit 2024-09-21T02:56:13.639349+0000 mon.a (mon.0) 9955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:15.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:15.867 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:15.867 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:15.896 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:15 smithi179 bash[23186]: cluster 2024-09-21T02:56:14.311540+0000 mgr.a (mgr.14388) 12194 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:56:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:15 smithi044 bash[22676]: cluster 2024-09-21T02:56:14.311540+0000 mgr.a (mgr.14388) 12194 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:56:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:15 smithi049 bash[23528]: cluster 2024-09-21T02:56:14.311540+0000 mgr.a (mgr.14388) 12194 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T02:56:16.632 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:17.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:17 smithi044 bash[22676]: audit 2024-09-21T02:56:16.204295+0000 mgr.a (mgr.14388) 12195 : audit [DBG] from='client.266772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:17.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:17 smithi044 bash[22676]: cluster 2024-09-21T02:56:16.312968+0000 mgr.a (mgr.14388) 12196 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:17 smithi179 bash[23186]: audit 2024-09-21T02:56:16.204295+0000 mgr.a (mgr.14388) 12195 : audit [DBG] from='client.266772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:17 smithi179 bash[23186]: cluster 2024-09-21T02:56:16.312968+0000 mgr.a (mgr.14388) 12196 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:17 smithi049 bash[23528]: audit 2024-09-21T02:56:16.204295+0000 mgr.a (mgr.14388) 12195 : audit [DBG] from='client.266772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:17 smithi049 bash[23528]: cluster 2024-09-21T02:56:16.312968+0000 mgr.a (mgr.14388) 12196 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:19 smithi049 bash[23528]: cluster 2024-09-21T02:56:18.313912+0000 mgr.a (mgr.14388) 12197 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:19.969 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:19 smithi044 bash[22676]: cluster 2024-09-21T02:56:18.313912+0000 mgr.a (mgr.14388) 12197 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:20.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:19 smithi179 bash[23186]: cluster 2024-09-21T02:56:18.313912+0000 mgr.a (mgr.14388) 12197 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:21.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:21.634 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:21.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:21.924 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:21 smithi049 bash[23528]: cluster 2024-09-21T02:56:20.316114+0000 mgr.a (mgr.14388) 12198 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:21 smithi044 bash[22676]: cluster 2024-09-21T02:56:20.316114+0000 mgr.a (mgr.14388) 12198 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:21 smithi179 bash[23186]: cluster 2024-09-21T02:56:20.316114+0000 mgr.a (mgr.14388) 12198 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T02:56:22.426 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:22.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:22.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:22.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:22.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:23 smithi044 bash[22676]: audit 2024-09-21T02:56:21.975452+0000 mgr.a (mgr.14388) 12199 : audit [DBG] from='client.266850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:23 smithi044 bash[22676]: cluster 2024-09-21T02:56:22.323837+0000 mgr.a (mgr.14388) 12200 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:23 smithi179 bash[23186]: audit 2024-09-21T02:56:21.975452+0000 mgr.a (mgr.14388) 12199 : audit [DBG] from='client.266850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:23 smithi179 bash[23186]: cluster 2024-09-21T02:56:22.323837+0000 mgr.a (mgr.14388) 12200 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:23 smithi049 bash[23528]: audit 2024-09-21T02:56:21.975452+0000 mgr.a (mgr.14388) 12199 : audit [DBG] from='client.266850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:23 smithi049 bash[23528]: cluster 2024-09-21T02:56:22.323837+0000 mgr.a (mgr.14388) 12200 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:25 smithi044 bash[22676]: cluster 2024-09-21T02:56:24.324598+0000 mgr.a (mgr.14388) 12201 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:25 smithi179 bash[23186]: cluster 2024-09-21T02:56:24.324598+0000 mgr.a (mgr.14388) 12201 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:25 smithi049 bash[23528]: cluster 2024-09-21T02:56:24.324598+0000 mgr.a (mgr.14388) 12201 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:25.786502+0000 mon.a (mon.0) 9956 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:56:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:25.793572+0000 mon.a (mon.0) 9957 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:25.795410+0000 mon.a (mon.0) 9958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:25.806437+0000 mon.a (mon.0) 9959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:25.812869+0000 mon.a (mon.0) 9960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:26.441204+0000 mon.a (mon.0) 9961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:26.446790+0000 mon.a (mon.0) 9962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:26.453550+0000 mon.a (mon.0) 9963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:26.533361+0000 mon.a (mon.0) 9964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:26.538932+0000 mon.a (mon.0) 9965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:26 smithi179 bash[23186]: audit 2024-09-21T02:56:26.544842+0000 mon.a (mon.0) 9966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22930]: debug 2024-09-21T02:56:26.600+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:56:26.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22930]: debug 2024-09-21T02:56:26.600+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:56:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:25.786502+0000 mon.a (mon.0) 9956 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:56:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:25.793572+0000 mon.a (mon.0) 9957 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:56:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:25.795410+0000 mon.a (mon.0) 9958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:56:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:25.806437+0000 mon.a (mon.0) 9959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:25.812869+0000 mon.a (mon.0) 9960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:56:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:26.441204+0000 mon.a (mon.0) 9961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:26.446790+0000 mon.a (mon.0) 9962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:26.453550+0000 mon.a (mon.0) 9963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:26.533361+0000 mon.a (mon.0) 9964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:26.538932+0000 mon.a (mon.0) 9965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:26 smithi044 bash[22676]: audit 2024-09-21T02:56:26.544842+0000 mon.a (mon.0) 9966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:25.786502+0000 mon.a (mon.0) 9956 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:56:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:25.793572+0000 mon.a (mon.0) 9957 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:25.795410+0000 mon.a (mon.0) 9958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:25.806437+0000 mon.a (mon.0) 9959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:25.812869+0000 mon.a (mon.0) 9960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:26.441204+0000 mon.a (mon.0) 9961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:26.446790+0000 mon.a (mon.0) 9962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:26.453550+0000 mon.a (mon.0) 9963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:26.533361+0000 mon.a (mon.0) 9964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:26.538932+0000 mon.a (mon.0) 9965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:26 smithi049 bash[23528]: audit 2024-09-21T02:56:26.544842+0000 mon.a (mon.0) 9966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:27.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:27.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:27.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:27 smithi044 bash[22676]: audit 2024-09-21T02:56:25.815379+0000 mgr.a (mgr.14388) 12202 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:56:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:27 smithi044 bash[22676]: cluster 2024-09-21T02:56:26.326456+0000 mgr.a (mgr.14388) 12203 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:56:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:27 smithi044 bash[22676]: audit 2024-09-21T02:56:26.603591+0000 mgr.a (mgr.14388) 12204 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:56:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:27 smithi044 bash[22676]: cephadm 2024-09-21T02:56:26.604527+0000 mgr.a (mgr.14388) 12205 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:56:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:27 smithi179 bash[23186]: audit 2024-09-21T02:56:25.815379+0000 mgr.a (mgr.14388) 12202 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:56:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:27 smithi179 bash[23186]: cluster 2024-09-21T02:56:26.326456+0000 mgr.a (mgr.14388) 12203 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:56:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:27 smithi179 bash[23186]: audit 2024-09-21T02:56:26.603591+0000 mgr.a (mgr.14388) 12204 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:56:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:27 smithi179 bash[23186]: cephadm 2024-09-21T02:56:26.604527+0000 mgr.a (mgr.14388) 12205 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:56:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:27 smithi049 bash[23528]: audit 2024-09-21T02:56:25.815379+0000 mgr.a (mgr.14388) 12202 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:56:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:27 smithi049 bash[23528]: cluster 2024-09-21T02:56:26.326456+0000 mgr.a (mgr.14388) 12203 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:56:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:27 smithi049 bash[23528]: audit 2024-09-21T02:56:26.603591+0000 mgr.a (mgr.14388) 12204 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:56:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:27 smithi049 bash[23528]: cephadm 2024-09-21T02:56:26.604527+0000 mgr.a (mgr.14388) 12205 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:56:28.196 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:28.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:28.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:28.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:28.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:28.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:28 smithi044 bash[22676]: audit 2024-09-21T02:56:27.762075+0000 mgr.a (mgr.14388) 12206 : audit [DBG] from='client.267033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:28 smithi179 bash[23186]: audit 2024-09-21T02:56:27.762075+0000 mgr.a (mgr.14388) 12206 : audit [DBG] from='client.267033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:28 smithi049 bash[23528]: audit 2024-09-21T02:56:27.762075+0000 mgr.a (mgr.14388) 12206 : audit [DBG] from='client.267033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:29 smithi044 bash[22676]: cluster 2024-09-21T02:56:28.327306+0000 mgr.a (mgr.14388) 12207 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:29 smithi179 bash[23186]: cluster 2024-09-21T02:56:28.327306+0000 mgr.a (mgr.14388) 12207 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:29 smithi049 bash[23528]: cluster 2024-09-21T02:56:28.327306+0000 mgr.a (mgr.14388) 12207 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:31.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:31 smithi044 bash[22676]: cluster 2024-09-21T02:56:30.329477+0000 mgr.a (mgr.14388) 12208 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:31 smithi179 bash[23186]: cluster 2024-09-21T02:56:30.329477+0000 mgr.a (mgr.14388) 12208 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:31 smithi049 bash[23528]: cluster 2024-09-21T02:56:30.329477+0000 mgr.a (mgr.14388) 12208 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:33.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:33.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:33.973 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:33.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:33.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:33.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:33.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:33 smithi044 bash[22676]: cluster 2024-09-21T02:56:32.330249+0000 mgr.a (mgr.14388) 12209 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:33 smithi179 bash[23186]: cluster 2024-09-21T02:56:32.330249+0000 mgr.a (mgr.14388) 12209 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:33 smithi049 bash[23528]: cluster 2024-09-21T02:56:32.330249+0000 mgr.a (mgr.14388) 12209 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:34 smithi044 bash[22676]: audit 2024-09-21T02:56:33.533809+0000 mgr.a (mgr.14388) 12210 : audit [DBG] from='client.267111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:34 smithi044 bash[22676]: audit 2024-09-21T02:56:33.812876+0000 mon.a (mon.0) 9967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:34 smithi044 bash[22676]: audit 2024-09-21T02:56:33.816850+0000 mon.a (mon.0) 9968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:34 smithi044 bash[22676]: audit 2024-09-21T02:56:33.822055+0000 mon.a (mon.0) 9969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:34.996 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:34 smithi179 bash[23186]: audit 2024-09-21T02:56:33.533809+0000 mgr.a (mgr.14388) 12210 : audit [DBG] from='client.267111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:34.996 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:34 smithi179 bash[23186]: audit 2024-09-21T02:56:33.812876+0000 mon.a (mon.0) 9967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:34.996 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:34 smithi179 bash[23186]: audit 2024-09-21T02:56:33.816850+0000 mon.a (mon.0) 9968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:34.996 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:34 smithi179 bash[23186]: audit 2024-09-21T02:56:33.822055+0000 mon.a (mon.0) 9969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:34 smithi049 bash[23528]: audit 2024-09-21T02:56:33.533809+0000 mgr.a (mgr.14388) 12210 : audit [DBG] from='client.267111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:34 smithi049 bash[23528]: audit 2024-09-21T02:56:33.812876+0000 mon.a (mon.0) 9967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:34 smithi049 bash[23528]: audit 2024-09-21T02:56:33.816850+0000 mon.a (mon.0) 9968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:34 smithi049 bash[23528]: audit 2024-09-21T02:56:33.822055+0000 mon.a (mon.0) 9969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:35.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:35 smithi179 bash[23186]: cluster 2024-09-21T02:56:34.331098+0000 mgr.a (mgr.14388) 12211 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:35 smithi044 bash[22676]: cluster 2024-09-21T02:56:34.331098+0000 mgr.a (mgr.14388) 12211 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:35 smithi049 bash[23528]: cluster 2024-09-21T02:56:34.331098+0000 mgr.a (mgr.14388) 12211 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:37.851 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:37 smithi044 bash[22676]: cluster 2024-09-21T02:56:36.333329+0000 mgr.a (mgr.14388) 12212 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:37 smithi179 bash[23186]: cluster 2024-09-21T02:56:36.333329+0000 mgr.a (mgr.14388) 12212 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:37 smithi049 bash[23528]: cluster 2024-09-21T02:56:36.333329+0000 mgr.a (mgr.14388) 12212 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:38.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:38.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:38.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:39.732 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:39.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:39.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:39.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:39.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:39 smithi044 bash[22676]: cluster 2024-09-21T02:56:38.334035+0000 mgr.a (mgr.14388) 12213 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:40.001 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:39 smithi049 bash[23528]: cluster 2024-09-21T02:56:38.334035+0000 mgr.a (mgr.14388) 12213 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:39 smithi179 bash[23186]: cluster 2024-09-21T02:56:38.334035+0000 mgr.a (mgr.14388) 12213 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:40 smithi044 bash[22676]: audit 2024-09-21T02:56:39.315488+0000 mgr.a (mgr.14388) 12214 : audit [DBG] from='client.267183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:40 smithi179 bash[23186]: audit 2024-09-21T02:56:39.315488+0000 mgr.a (mgr.14388) 12214 : audit [DBG] from='client.267183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:40 smithi049 bash[23528]: audit 2024-09-21T02:56:39.315488+0000 mgr.a (mgr.14388) 12214 : audit [DBG] from='client.267183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:41 smithi049 bash[23528]: cluster 2024-09-21T02:56:40.336281+0000 mgr.a (mgr.14388) 12215 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:41 smithi044 bash[22676]: cluster 2024-09-21T02:56:40.336281+0000 mgr.a (mgr.14388) 12215 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:41 smithi179 bash[23186]: cluster 2024-09-21T02:56:40.336281+0000 mgr.a (mgr.14388) 12215 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:56:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:43 smithi044 bash[22676]: cluster 2024-09-21T02:56:42.337052+0000 mgr.a (mgr.14388) 12216 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:43 smithi179 bash[23186]: cluster 2024-09-21T02:56:42.337052+0000 mgr.a (mgr.14388) 12216 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:43 smithi049 bash[23528]: cluster 2024-09-21T02:56:42.337052+0000 mgr.a (mgr.14388) 12216 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:44.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:45.520 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:45.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:45.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:45.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:45.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:45 smithi044 bash[22676]: cluster 2024-09-21T02:56:44.337818+0000 mgr.a (mgr.14388) 12217 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:45 smithi179 bash[23186]: cluster 2024-09-21T02:56:44.337818+0000 mgr.a (mgr.14388) 12217 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:45 smithi049 bash[23528]: cluster 2024-09-21T02:56:44.337818+0000 mgr.a (mgr.14388) 12217 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:46 smithi044 bash[22676]: audit 2024-09-21T02:56:45.075097+0000 mgr.a (mgr.14388) 12218 : audit [DBG] from='client.267255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:46 smithi044 bash[22676]: audit 2024-09-21T02:56:46.651401+0000 mon.a (mon.0) 9970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:46 smithi044 bash[22676]: audit 2024-09-21T02:56:46.659530+0000 mon.a (mon.0) 9971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:46 smithi044 bash[22676]: audit 2024-09-21T02:56:46.672669+0000 mon.a (mon.0) 9972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:46 smithi179 bash[23186]: audit 2024-09-21T02:56:45.075097+0000 mgr.a (mgr.14388) 12218 : audit [DBG] from='client.267255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:46 smithi179 bash[23186]: audit 2024-09-21T02:56:46.651401+0000 mon.a (mon.0) 9970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:46 smithi179 bash[23186]: audit 2024-09-21T02:56:46.659530+0000 mon.a (mon.0) 9971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:46 smithi179 bash[23186]: audit 2024-09-21T02:56:46.672669+0000 mon.a (mon.0) 9972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:46 smithi049 bash[23528]: audit 2024-09-21T02:56:45.075097+0000 mgr.a (mgr.14388) 12218 : audit [DBG] from='client.267255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:46 smithi049 bash[23528]: audit 2024-09-21T02:56:46.651401+0000 mon.a (mon.0) 9970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:46 smithi049 bash[23528]: audit 2024-09-21T02:56:46.659530+0000 mon.a (mon.0) 9971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:46 smithi049 bash[23528]: audit 2024-09-21T02:56:46.672669+0000 mon.a (mon.0) 9972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:47 smithi179 bash[23186]: cluster 2024-09-21T02:56:46.340470+0000 mgr.a (mgr.14388) 12219 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:47 smithi179 bash[23186]: audit 2024-09-21T02:56:46.750613+0000 mon.a (mon.0) 9973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:47 smithi179 bash[23186]: audit 2024-09-21T02:56:46.759617+0000 mon.a (mon.0) 9974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:47 smithi179 bash[23186]: audit 2024-09-21T02:56:46.769425+0000 mon.a (mon.0) 9975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:47 smithi049 bash[23528]: cluster 2024-09-21T02:56:46.340470+0000 mgr.a (mgr.14388) 12219 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:47 smithi049 bash[23528]: audit 2024-09-21T02:56:46.750613+0000 mon.a (mon.0) 9973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:47 smithi049 bash[23528]: audit 2024-09-21T02:56:46.759617+0000 mon.a (mon.0) 9974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:47 smithi049 bash[23528]: audit 2024-09-21T02:56:46.769425+0000 mon.a (mon.0) 9975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:47 smithi044 bash[22676]: cluster 2024-09-21T02:56:46.340470+0000 mgr.a (mgr.14388) 12219 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:47 smithi044 bash[22676]: audit 2024-09-21T02:56:46.750613+0000 mon.a (mon.0) 9973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:47 smithi044 bash[22676]: audit 2024-09-21T02:56:46.759617+0000 mon.a (mon.0) 9974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:47 smithi044 bash[22676]: audit 2024-09-21T02:56:46.769425+0000 mon.a (mon.0) 9975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:49 smithi049 bash[23528]: cluster 2024-09-21T02:56:48.341287+0000 mgr.a (mgr.14388) 12220 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:56:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:49 smithi044 bash[22676]: cluster 2024-09-21T02:56:48.341287+0000 mgr.a (mgr.14388) 12220 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:56:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:49 smithi179 bash[23186]: cluster 2024-09-21T02:56:48.341287+0000 mgr.a (mgr.14388) 12220 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:56:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:51.284 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:51.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:51 smithi049 bash[23528]: cluster 2024-09-21T02:56:50.343264+0000 mgr.a (mgr.14388) 12221 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:52.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:51 smithi044 bash[22676]: cluster 2024-09-21T02:56:50.343264+0000 mgr.a (mgr.14388) 12221 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:51 smithi179 bash[23186]: cluster 2024-09-21T02:56:50.343264+0000 mgr.a (mgr.14388) 12221 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:52 smithi049 bash[23528]: audit 2024-09-21T02:56:50.855989+0000 mgr.a (mgr.14388) 12222 : audit [DBG] from='client.267330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:52 smithi044 bash[22676]: audit 2024-09-21T02:56:50.855989+0000 mgr.a (mgr.14388) 12222 : audit [DBG] from='client.267330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:52 smithi179 bash[23186]: audit 2024-09-21T02:56:50.855989+0000 mgr.a (mgr.14388) 12222 : audit [DBG] from='client.267330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:53 smithi049 bash[23528]: cluster 2024-09-21T02:56:52.344302+0000 mgr.a (mgr.14388) 12223 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:56:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:53 smithi044 bash[22676]: cluster 2024-09-21T02:56:52.344302+0000 mgr.a (mgr.14388) 12223 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:56:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:53 smithi179 bash[23186]: cluster 2024-09-21T02:56:52.344302+0000 mgr.a (mgr.14388) 12223 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:56:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:55 smithi049 bash[23528]: audit 2024-09-21T02:56:54.034949+0000 mon.a (mon.0) 9976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:55 smithi049 bash[23528]: audit 2024-09-21T02:56:54.044595+0000 mon.a (mon.0) 9977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:55 smithi049 bash[23528]: audit 2024-09-21T02:56:54.055180+0000 mon.a (mon.0) 9978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:55 smithi049 bash[23528]: cluster 2024-09-21T02:56:54.345094+0000 mgr.a (mgr.14388) 12224 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:56:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:55 smithi044 bash[22676]: audit 2024-09-21T02:56:54.034949+0000 mon.a (mon.0) 9976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:55 smithi044 bash[22676]: audit 2024-09-21T02:56:54.044595+0000 mon.a (mon.0) 9977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:55 smithi044 bash[22676]: audit 2024-09-21T02:56:54.055180+0000 mon.a (mon.0) 9978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:55 smithi044 bash[22676]: cluster 2024-09-21T02:56:54.345094+0000 mgr.a (mgr.14388) 12224 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:56:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:55 smithi179 bash[23186]: audit 2024-09-21T02:56:54.034949+0000 mon.a (mon.0) 9976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:55 smithi179 bash[23186]: audit 2024-09-21T02:56:54.044595+0000 mon.a (mon.0) 9977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:55 smithi179 bash[23186]: audit 2024-09-21T02:56:54.055180+0000 mon.a (mon.0) 9978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:56:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:55 smithi179 bash[23186]: cluster 2024-09-21T02:56:54.345094+0000 mgr.a (mgr.14388) 12224 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:56:56.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:56:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:56:56.287 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:56:57.026 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:56:57.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:56:57.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:56:57.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:56:57.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:56:57.697 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:57 smithi044 bash[22676]: cluster 2024-09-21T02:56:56.347325+0000 mgr.a (mgr.14388) 12225 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:57.697 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:57 smithi044 bash[22676]: audit 2024-09-21T02:56:56.623738+0000 mgr.a (mgr.14388) 12226 : audit [DBG] from='client.267408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:57 smithi179 bash[23186]: cluster 2024-09-21T02:56:56.347325+0000 mgr.a (mgr.14388) 12225 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:57 smithi179 bash[23186]: audit 2024-09-21T02:56:56.623738+0000 mgr.a (mgr.14388) 12226 : audit [DBG] from='client.267408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:57 smithi049 bash[23528]: cluster 2024-09-21T02:56:56.347325+0000 mgr.a (mgr.14388) 12225 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:57 smithi049 bash[23528]: audit 2024-09-21T02:56:56.623738+0000 mgr.a (mgr.14388) 12226 : audit [DBG] from='client.267408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:56:59 smithi044 bash[22676]: cluster 2024-09-21T02:56:58.348349+0000 mgr.a (mgr.14388) 12227 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:56:59 smithi179 bash[23186]: cluster 2024-09-21T02:56:58.348349+0000 mgr.a (mgr.14388) 12227 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:56:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:56:59 smithi049 bash[23528]: cluster 2024-09-21T02:56:58.348349+0000 mgr.a (mgr.14388) 12227 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:01 smithi049 bash[23528]: cluster 2024-09-21T02:57:00.350649+0000 mgr.a (mgr.14388) 12228 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:01.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:01 smithi044 bash[22676]: cluster 2024-09-21T02:57:00.350649+0000 mgr.a (mgr.14388) 12228 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:01.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:01 smithi179 bash[23186]: cluster 2024-09-21T02:57:00.350649+0000 mgr.a (mgr.14388) 12228 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:02.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:02.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:02.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:03.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:03 smithi044 bash[22676]: cluster 2024-09-21T02:57:02.351399+0000 mgr.a (mgr.14388) 12229 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:03 smithi044 bash[22676]: audit 2024-09-21T02:57:02.370030+0000 mgr.a (mgr.14388) 12230 : audit [DBG] from='client.267483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:03 smithi179 bash[23186]: cluster 2024-09-21T02:57:02.351399+0000 mgr.a (mgr.14388) 12229 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:03.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:03 smithi179 bash[23186]: audit 2024-09-21T02:57:02.370030+0000 mgr.a (mgr.14388) 12230 : audit [DBG] from='client.267483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:03 smithi049 bash[23528]: cluster 2024-09-21T02:57:02.351399+0000 mgr.a (mgr.14388) 12229 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:03 smithi049 bash[23528]: audit 2024-09-21T02:57:02.370030+0000 mgr.a (mgr.14388) 12230 : audit [DBG] from='client.267483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:05 smithi044 bash[22676]: cluster 2024-09-21T02:57:04.352417+0000 mgr.a (mgr.14388) 12231 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:05.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:05 smithi179 bash[23186]: cluster 2024-09-21T02:57:04.352417+0000 mgr.a (mgr.14388) 12231 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:05 smithi049 bash[23528]: cluster 2024-09-21T02:57:04.352417+0000 mgr.a (mgr.14388) 12231 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:07 smithi044 bash[22676]: cluster 2024-09-21T02:57:06.354675+0000 mgr.a (mgr.14388) 12232 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:07 smithi044 bash[22676]: audit 2024-09-21T02:57:06.870451+0000 mon.a (mon.0) 9979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:07 smithi044 bash[22676]: audit 2024-09-21T02:57:06.876246+0000 mon.a (mon.0) 9980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:07 smithi044 bash[22676]: audit 2024-09-21T02:57:06.883902+0000 mon.a (mon.0) 9981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:07 smithi044 bash[22676]: audit 2024-09-21T02:57:06.975872+0000 mon.a (mon.0) 9982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:07 smithi044 bash[22676]: audit 2024-09-21T02:57:06.983013+0000 mon.a (mon.0) 9983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:07 smithi044 bash[22676]: audit 2024-09-21T02:57:06.990984+0000 mon.a (mon.0) 9984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:07 smithi179 bash[23186]: cluster 2024-09-21T02:57:06.354675+0000 mgr.a (mgr.14388) 12232 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:07 smithi179 bash[23186]: audit 2024-09-21T02:57:06.870451+0000 mon.a (mon.0) 9979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:07 smithi179 bash[23186]: audit 2024-09-21T02:57:06.876246+0000 mon.a (mon.0) 9980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:07 smithi179 bash[23186]: audit 2024-09-21T02:57:06.883902+0000 mon.a (mon.0) 9981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:07 smithi179 bash[23186]: audit 2024-09-21T02:57:06.975872+0000 mon.a (mon.0) 9982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:07 smithi179 bash[23186]: audit 2024-09-21T02:57:06.983013+0000 mon.a (mon.0) 9983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:07 smithi179 bash[23186]: audit 2024-09-21T02:57:06.990984+0000 mon.a (mon.0) 9984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:07 smithi049 bash[23528]: cluster 2024-09-21T02:57:06.354675+0000 mgr.a (mgr.14388) 12232 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:07 smithi049 bash[23528]: audit 2024-09-21T02:57:06.870451+0000 mon.a (mon.0) 9979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:07 smithi049 bash[23528]: audit 2024-09-21T02:57:06.876246+0000 mon.a (mon.0) 9980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:07 smithi049 bash[23528]: audit 2024-09-21T02:57:06.883902+0000 mon.a (mon.0) 9981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:07 smithi049 bash[23528]: audit 2024-09-21T02:57:06.975872+0000 mon.a (mon.0) 9982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:07 smithi049 bash[23528]: audit 2024-09-21T02:57:06.983013+0000 mon.a (mon.0) 9983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:07 smithi049 bash[23528]: audit 2024-09-21T02:57:06.990984+0000 mon.a (mon.0) 9984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:07.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:08.617 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:08.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:08.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:08.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:08.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:09 smithi044 bash[22676]: audit 2024-09-21T02:57:08.161033+0000 mgr.a (mgr.14388) 12233 : audit [DBG] from='client.267558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:09 smithi044 bash[22676]: cluster 2024-09-21T02:57:08.355214+0000 mgr.a (mgr.14388) 12234 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:09 smithi179 bash[23186]: audit 2024-09-21T02:57:08.161033+0000 mgr.a (mgr.14388) 12233 : audit [DBG] from='client.267558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:09.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:09 smithi179 bash[23186]: cluster 2024-09-21T02:57:08.355214+0000 mgr.a (mgr.14388) 12234 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:09 smithi049 bash[23528]: audit 2024-09-21T02:57:08.161033+0000 mgr.a (mgr.14388) 12233 : audit [DBG] from='client.267558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:09 smithi049 bash[23528]: cluster 2024-09-21T02:57:08.355214+0000 mgr.a (mgr.14388) 12234 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:11.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:11 smithi044 bash[22676]: cluster 2024-09-21T02:57:10.357640+0000 mgr.a (mgr.14388) 12235 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:11 smithi179 bash[23186]: cluster 2024-09-21T02:57:10.357640+0000 mgr.a (mgr.14388) 12235 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:11 smithi049 bash[23528]: cluster 2024-09-21T02:57:10.357640+0000 mgr.a (mgr.14388) 12235 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:13.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:13.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:13 smithi044 bash[22676]: cluster 2024-09-21T02:57:12.358433+0000 mgr.a (mgr.14388) 12236 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:13.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:13 smithi179 bash[23186]: cluster 2024-09-21T02:57:12.358433+0000 mgr.a (mgr.14388) 12236 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:13 smithi049 bash[23528]: cluster 2024-09-21T02:57:12.358433+0000 mgr.a (mgr.14388) 12236 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:14.408 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:15 smithi179 bash[23186]: audit 2024-09-21T02:57:13.951245+0000 mgr.a (mgr.14388) 12237 : audit [DBG] from='client.267636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:15 smithi179 bash[23186]: audit 2024-09-21T02:57:14.256550+0000 mon.a (mon.0) 9985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:15 smithi179 bash[23186]: audit 2024-09-21T02:57:14.263200+0000 mon.a (mon.0) 9986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:15 smithi179 bash[23186]: audit 2024-09-21T02:57:14.269019+0000 mon.a (mon.0) 9987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:15 smithi179 bash[23186]: cluster 2024-09-21T02:57:14.358989+0000 mgr.a (mgr.14388) 12238 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:15 smithi049 bash[23528]: audit 2024-09-21T02:57:13.951245+0000 mgr.a (mgr.14388) 12237 : audit [DBG] from='client.267636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:15 smithi049 bash[23528]: audit 2024-09-21T02:57:14.256550+0000 mon.a (mon.0) 9985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:15 smithi049 bash[23528]: audit 2024-09-21T02:57:14.263200+0000 mon.a (mon.0) 9986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:15 smithi049 bash[23528]: audit 2024-09-21T02:57:14.269019+0000 mon.a (mon.0) 9987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:15 smithi049 bash[23528]: cluster 2024-09-21T02:57:14.358989+0000 mgr.a (mgr.14388) 12238 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:15 smithi044 bash[22676]: audit 2024-09-21T02:57:13.951245+0000 mgr.a (mgr.14388) 12237 : audit [DBG] from='client.267636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:15 smithi044 bash[22676]: audit 2024-09-21T02:57:14.256550+0000 mon.a (mon.0) 9985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:15 smithi044 bash[22676]: audit 2024-09-21T02:57:14.263200+0000 mon.a (mon.0) 9986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:15 smithi044 bash[22676]: audit 2024-09-21T02:57:14.269019+0000 mon.a (mon.0) 9987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:15 smithi044 bash[22676]: cluster 2024-09-21T02:57:14.358989+0000 mgr.a (mgr.14388) 12238 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:17.730 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:17 smithi044 bash[22676]: cluster 2024-09-21T02:57:16.361236+0000 mgr.a (mgr.14388) 12239 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:17 smithi179 bash[23186]: cluster 2024-09-21T02:57:16.361236+0000 mgr.a (mgr.14388) 12239 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:17 smithi049 bash[23528]: cluster 2024-09-21T02:57:16.361236+0000 mgr.a (mgr.14388) 12239 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:19.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:19.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:19.410 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:19 smithi044 bash[22676]: cluster 2024-09-21T02:57:18.362228+0000 mgr.a (mgr.14388) 12240 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:19 smithi179 bash[23186]: cluster 2024-09-21T02:57:18.362228+0000 mgr.a (mgr.14388) 12240 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:19 smithi049 bash[23528]: cluster 2024-09-21T02:57:18.362228+0000 mgr.a (mgr.14388) 12240 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:20.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:20.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:20.681 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:20 smithi049 bash[23528]: audit 2024-09-21T02:57:19.741818+0000 mgr.a (mgr.14388) 12241 : audit [DBG] from='client.267714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:20 smithi044 bash[22676]: audit 2024-09-21T02:57:19.741818+0000 mgr.a (mgr.14388) 12241 : audit [DBG] from='client.267714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:20.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:20 smithi179 bash[23186]: audit 2024-09-21T02:57:19.741818+0000 mgr.a (mgr.14388) 12241 : audit [DBG] from='client.267714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:21 smithi044 bash[22676]: cluster 2024-09-21T02:57:20.364725+0000 mgr.a (mgr.14388) 12242 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:57:21.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:21 smithi179 bash[23186]: cluster 2024-09-21T02:57:20.364725+0000 mgr.a (mgr.14388) 12242 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:57:21.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:21 smithi049 bash[23528]: cluster 2024-09-21T02:57:20.364725+0000 mgr.a (mgr.14388) 12242 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T02:57:23.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:23 smithi044 bash[22676]: cluster 2024-09-21T02:57:22.365581+0000 mgr.a (mgr.14388) 12243 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:57:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:23 smithi179 bash[23186]: cluster 2024-09-21T02:57:22.365581+0000 mgr.a (mgr.14388) 12243 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:57:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:23 smithi049 bash[23528]: cluster 2024-09-21T02:57:22.365581+0000 mgr.a (mgr.14388) 12243 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:57:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:25.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:25.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:25 smithi044 bash[22676]: cluster 2024-09-21T02:57:24.366345+0000 mgr.a (mgr.14388) 12244 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:57:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:25 smithi179 bash[23186]: cluster 2024-09-21T02:57:24.366345+0000 mgr.a (mgr.14388) 12244 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:57:25.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:25 smithi049 bash[23528]: cluster 2024-09-21T02:57:24.366345+0000 mgr.a (mgr.14388) 12244 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T02:57:25.988 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:25.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:25.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:25.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:25.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:26.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:26 smithi044 bash[22676]: audit 2024-09-21T02:57:25.526892+0000 mgr.a (mgr.14388) 12245 : audit [DBG] from='client.267786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:26.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:26 smithi179 bash[23186]: audit 2024-09-21T02:57:25.526892+0000 mgr.a (mgr.14388) 12245 : audit [DBG] from='client.267786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:26.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:26 smithi049 bash[23528]: audit 2024-09-21T02:57:25.526892+0000 mgr.a (mgr.14388) 12245 : audit [DBG] from='client.267786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:27.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22930]: debug 2024-09-21T02:57:27.467+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22930]: debug 2024-09-21T02:57:27.467+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: cluster 2024-09-21T02:57:26.369266+0000 mgr.a (mgr.14388) 12246 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:26.654560+0000 mon.a (mon.0) 9988 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:26.662051+0000 mon.a (mon.0) 9989 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:26.664268+0000 mon.a (mon.0) 9990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:26.675569+0000 mon.a (mon.0) 9991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:26.682010+0000 mon.a (mon.0) 9992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:26.684628+0000 mgr.a (mgr.14388) 12247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:27.075783+0000 mon.a (mon.0) 9993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:27.082344+0000 mon.a (mon.0) 9994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:27.089168+0000 mon.a (mon.0) 9995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:27.136873+0000 mon.a (mon.0) 9996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:27.143281+0000 mon.a (mon.0) 9997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:27 smithi044 bash[22676]: audit 2024-09-21T02:57:27.150213+0000 mon.a (mon.0) 9998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: cluster 2024-09-21T02:57:26.369266+0000 mgr.a (mgr.14388) 12246 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:26.654560+0000 mon.a (mon.0) 9988 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:26.662051+0000 mon.a (mon.0) 9989 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:26.664268+0000 mon.a (mon.0) 9990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:26.675569+0000 mon.a (mon.0) 9991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:26.682010+0000 mon.a (mon.0) 9992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:26.684628+0000 mgr.a (mgr.14388) 12247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:57:27.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:27.075783+0000 mon.a (mon.0) 9993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:27.082344+0000 mon.a (mon.0) 9994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:27.089168+0000 mon.a (mon.0) 9995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:27.136873+0000 mon.a (mon.0) 9996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:27.143281+0000 mon.a (mon.0) 9997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:27 smithi179 bash[23186]: audit 2024-09-21T02:57:27.150213+0000 mon.a (mon.0) 9998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: cluster 2024-09-21T02:57:26.369266+0000 mgr.a (mgr.14388) 12246 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:26.654560+0000 mon.a (mon.0) 9988 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:57:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:26.662051+0000 mon.a (mon.0) 9989 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:57:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:26.664268+0000 mon.a (mon.0) 9990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:57:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:26.675569+0000 mon.a (mon.0) 9991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:26.682010+0000 mon.a (mon.0) 9992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:57:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:26.684628+0000 mgr.a (mgr.14388) 12247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:27.075783+0000 mon.a (mon.0) 9993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:27.082344+0000 mon.a (mon.0) 9994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:27.089168+0000 mon.a (mon.0) 9995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:27.136873+0000 mon.a (mon.0) 9996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:27.143281+0000 mon.a (mon.0) 9997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:27 smithi049 bash[23528]: audit 2024-09-21T02:57:27.150213+0000 mon.a (mon.0) 9998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:28.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:28 smithi044 bash[22676]: audit 2024-09-21T02:57:27.470196+0000 mgr.a (mgr.14388) 12248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:57:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:28 smithi044 bash[22676]: cephadm 2024-09-21T02:57:27.471325+0000 mgr.a (mgr.14388) 12249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:57:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:28 smithi179 bash[23186]: audit 2024-09-21T02:57:27.470196+0000 mgr.a (mgr.14388) 12248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:57:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:28 smithi179 bash[23186]: cephadm 2024-09-21T02:57:27.471325+0000 mgr.a (mgr.14388) 12249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:57:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:28 smithi049 bash[23528]: audit 2024-09-21T02:57:27.470196+0000 mgr.a (mgr.14388) 12248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:57:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:28 smithi049 bash[23528]: cephadm 2024-09-21T02:57:27.471325+0000 mgr.a (mgr.14388) 12249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:57:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:29 smithi044 bash[22676]: cluster 2024-09-21T02:57:28.370253+0000 mgr.a (mgr.14388) 12250 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:57:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:29 smithi179 bash[23186]: cluster 2024-09-21T02:57:28.370253+0000 mgr.a (mgr.14388) 12250 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:57:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:29 smithi049 bash[23528]: cluster 2024-09-21T02:57:28.370253+0000 mgr.a (mgr.14388) 12250 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:57:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:30.990 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:30.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:31 smithi044 bash[22676]: cluster 2024-09-21T02:57:30.372400+0000 mgr.a (mgr.14388) 12251 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:31 smithi179 bash[23186]: cluster 2024-09-21T02:57:30.372400+0000 mgr.a (mgr.14388) 12251 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:31.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:31.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:31.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:31.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:31 smithi049 bash[23528]: cluster 2024-09-21T02:57:30.372400+0000 mgr.a (mgr.14388) 12251 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:32 smithi179 bash[23186]: audit 2024-09-21T02:57:31.332218+0000 mgr.a (mgr.14388) 12252 : audit [DBG] from='client.267972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:32.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:32 smithi049 bash[23528]: audit 2024-09-21T02:57:31.332218+0000 mgr.a (mgr.14388) 12252 : audit [DBG] from='client.267972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:32 smithi044 bash[22676]: audit 2024-09-21T02:57:31.332218+0000 mgr.a (mgr.14388) 12252 : audit [DBG] from='client.267972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:33.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:33 smithi044 bash[22676]: cluster 2024-09-21T02:57:32.373406+0000 mgr.a (mgr.14388) 12253 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:57:33.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:33 smithi179 bash[23186]: cluster 2024-09-21T02:57:32.373406+0000 mgr.a (mgr.14388) 12253 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:57:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:33 smithi049 bash[23528]: cluster 2024-09-21T02:57:32.373406+0000 mgr.a (mgr.14388) 12253 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:57:35.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:35 smithi044 bash[22676]: cluster 2024-09-21T02:57:34.374185+0000 mgr.a (mgr.14388) 12254 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:57:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:35 smithi044 bash[22676]: audit 2024-09-21T02:57:34.462488+0000 mon.a (mon.0) 9999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:35 smithi044 bash[22676]: audit 2024-09-21T02:57:34.472461+0000 mon.a (mon.0) 10000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:35 smithi044 bash[22676]: audit 2024-09-21T02:57:34.484094+0000 mon.a (mon.0) 10001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:35 smithi179 bash[23186]: cluster 2024-09-21T02:57:34.374185+0000 mgr.a (mgr.14388) 12254 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:57:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:35 smithi179 bash[23186]: audit 2024-09-21T02:57:34.462488+0000 mon.a (mon.0) 9999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:35 smithi179 bash[23186]: audit 2024-09-21T02:57:34.472461+0000 mon.a (mon.0) 10000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:35 smithi179 bash[23186]: audit 2024-09-21T02:57:34.484094+0000 mon.a (mon.0) 10001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:35 smithi049 bash[23528]: cluster 2024-09-21T02:57:34.374185+0000 mgr.a (mgr.14388) 12254 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:57:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:35 smithi049 bash[23528]: audit 2024-09-21T02:57:34.462488+0000 mon.a (mon.0) 9999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:35 smithi049 bash[23528]: audit 2024-09-21T02:57:34.472461+0000 mon.a (mon.0) 10000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:35 smithi049 bash[23528]: audit 2024-09-21T02:57:34.484094+0000 mon.a (mon.0) 10001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:36.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:36.793 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:36.793 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:37.553 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:37.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:37.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:37.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:37.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:37.718 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:37 smithi044 bash[22676]: cluster 2024-09-21T02:57:36.376393+0000 mgr.a (mgr.14388) 12255 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:37.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:37 smithi179 bash[23186]: cluster 2024-09-21T02:57:36.376393+0000 mgr.a (mgr.14388) 12255 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:37 smithi049 bash[23528]: cluster 2024-09-21T02:57:36.376393+0000 mgr.a (mgr.14388) 12255 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:38 smithi179 bash[23186]: audit 2024-09-21T02:57:37.127486+0000 mgr.a (mgr.14388) 12256 : audit [DBG] from='client.268044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:38.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:38 smithi044 bash[22676]: audit 2024-09-21T02:57:37.127486+0000 mgr.a (mgr.14388) 12256 : audit [DBG] from='client.268044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:38 smithi049 bash[23528]: audit 2024-09-21T02:57:37.127486+0000 mgr.a (mgr.14388) 12256 : audit [DBG] from='client.268044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:39 smithi044 bash[22676]: cluster 2024-09-21T02:57:38.377128+0000 mgr.a (mgr.14388) 12257 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:39 smithi179 bash[23186]: cluster 2024-09-21T02:57:38.377128+0000 mgr.a (mgr.14388) 12257 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:39 smithi049 bash[23528]: cluster 2024-09-21T02:57:38.377128+0000 mgr.a (mgr.14388) 12257 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:41 smithi044 bash[22676]: cluster 2024-09-21T02:57:40.378581+0000 mgr.a (mgr.14388) 12258 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:41 smithi179 bash[23186]: cluster 2024-09-21T02:57:40.378581+0000 mgr.a (mgr.14388) 12258 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:41.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:41 smithi049 bash[23528]: cluster 2024-09-21T02:57:40.378581+0000 mgr.a (mgr.14388) 12258 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:57:42.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:42.555 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:42.555 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:43.306 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:43.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:43.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:43.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:43.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:43.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:43 smithi044 bash[22676]: cluster 2024-09-21T02:57:42.379351+0000 mgr.a (mgr.14388) 12259 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:43 smithi179 bash[23186]: cluster 2024-09-21T02:57:42.379351+0000 mgr.a (mgr.14388) 12259 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:43 smithi049 bash[23528]: cluster 2024-09-21T02:57:42.379351+0000 mgr.a (mgr.14388) 12259 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:44 smithi179 bash[23186]: audit 2024-09-21T02:57:42.889909+0000 mgr.a (mgr.14388) 12260 : audit [DBG] from='client.268122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:44 smithi049 bash[23528]: audit 2024-09-21T02:57:42.889909+0000 mgr.a (mgr.14388) 12260 : audit [DBG] from='client.268122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:44 smithi044 bash[22676]: audit 2024-09-21T02:57:42.889909+0000 mgr.a (mgr.14388) 12260 : audit [DBG] from='client.268122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:45 smithi179 bash[23186]: cluster 2024-09-21T02:57:44.380350+0000 mgr.a (mgr.14388) 12261 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:45 smithi049 bash[23528]: cluster 2024-09-21T02:57:44.380350+0000 mgr.a (mgr.14388) 12261 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:45 smithi044 bash[22676]: cluster 2024-09-21T02:57:44.380350+0000 mgr.a (mgr.14388) 12261 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:47 smithi044 bash[22676]: cluster 2024-09-21T02:57:46.382620+0000 mgr.a (mgr.14388) 12262 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:47 smithi044 bash[22676]: audit 2024-09-21T02:57:47.286626+0000 mon.a (mon.0) 10002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:47 smithi044 bash[22676]: audit 2024-09-21T02:57:47.293735+0000 mon.a (mon.0) 10003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:47 smithi044 bash[22676]: audit 2024-09-21T02:57:47.301590+0000 mon.a (mon.0) 10004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:47 smithi044 bash[22676]: audit 2024-09-21T02:57:47.334912+0000 mon.a (mon.0) 10005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:47 smithi044 bash[22676]: audit 2024-09-21T02:57:47.340553+0000 mon.a (mon.0) 10006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:47 smithi044 bash[22676]: audit 2024-09-21T02:57:47.346645+0000 mon.a (mon.0) 10007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:47 smithi179 bash[23186]: cluster 2024-09-21T02:57:46.382620+0000 mgr.a (mgr.14388) 12262 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:47 smithi179 bash[23186]: audit 2024-09-21T02:57:47.286626+0000 mon.a (mon.0) 10002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:47 smithi179 bash[23186]: audit 2024-09-21T02:57:47.293735+0000 mon.a (mon.0) 10003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:47 smithi179 bash[23186]: audit 2024-09-21T02:57:47.301590+0000 mon.a (mon.0) 10004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:47 smithi179 bash[23186]: audit 2024-09-21T02:57:47.334912+0000 mon.a (mon.0) 10005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:47 smithi179 bash[23186]: audit 2024-09-21T02:57:47.340553+0000 mon.a (mon.0) 10006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:47 smithi179 bash[23186]: audit 2024-09-21T02:57:47.346645+0000 mon.a (mon.0) 10007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:47 smithi049 bash[23528]: cluster 2024-09-21T02:57:46.382620+0000 mgr.a (mgr.14388) 12262 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:47 smithi049 bash[23528]: audit 2024-09-21T02:57:47.286626+0000 mon.a (mon.0) 10002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:47 smithi049 bash[23528]: audit 2024-09-21T02:57:47.293735+0000 mon.a (mon.0) 10003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:47 smithi049 bash[23528]: audit 2024-09-21T02:57:47.301590+0000 mon.a (mon.0) 10004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:47 smithi049 bash[23528]: audit 2024-09-21T02:57:47.334912+0000 mon.a (mon.0) 10005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:47 smithi049 bash[23528]: audit 2024-09-21T02:57:47.340553+0000 mon.a (mon.0) 10006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:47 smithi049 bash[23528]: audit 2024-09-21T02:57:47.346645+0000 mon.a (mon.0) 10007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:49.066 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:49 smithi049 bash[23528]: cluster 2024-09-21T02:57:48.383160+0000 mgr.a (mgr.14388) 12263 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:49 smithi049 bash[23528]: audit 2024-09-21T02:57:48.642348+0000 mgr.a (mgr.14388) 12264 : audit [DBG] from='client.268194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:49 smithi044 bash[22676]: cluster 2024-09-21T02:57:48.383160+0000 mgr.a (mgr.14388) 12263 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:49 smithi044 bash[22676]: audit 2024-09-21T02:57:48.642348+0000 mgr.a (mgr.14388) 12264 : audit [DBG] from='client.268194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:49 smithi179 bash[23186]: cluster 2024-09-21T02:57:48.383160+0000 mgr.a (mgr.14388) 12263 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:49 smithi179 bash[23186]: audit 2024-09-21T02:57:48.642348+0000 mgr.a (mgr.14388) 12264 : audit [DBG] from='client.268194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:51 smithi049 bash[23528]: cluster 2024-09-21T02:57:50.385529+0000 mgr.a (mgr.14388) 12265 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:51 smithi044 bash[22676]: cluster 2024-09-21T02:57:50.385529+0000 mgr.a (mgr.14388) 12265 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:51 smithi179 bash[23186]: cluster 2024-09-21T02:57:50.385529+0000 mgr.a (mgr.14388) 12265 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:53 smithi049 bash[23528]: cluster 2024-09-21T02:57:52.386313+0000 mgr.a (mgr.14388) 12266 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:53.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:53 smithi044 bash[22676]: cluster 2024-09-21T02:57:52.386313+0000 mgr.a (mgr.14388) 12266 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:53 smithi179 bash[23186]: cluster 2024-09-21T02:57:52.386313+0000 mgr.a (mgr.14388) 12266 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:54.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:54.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:54.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:54.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:57:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:57:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:57:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:57:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:57:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:55 smithi044 bash[22676]: cluster 2024-09-21T02:57:54.386824+0000 mgr.a (mgr.14388) 12267 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:55 smithi044 bash[22676]: audit 2024-09-21T02:57:54.395853+0000 mgr.a (mgr.14388) 12268 : audit [DBG] from='client.268269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:55 smithi044 bash[22676]: audit 2024-09-21T02:57:54.687765+0000 mon.a (mon.0) 10008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:55 smithi044 bash[22676]: audit 2024-09-21T02:57:54.694157+0000 mon.a (mon.0) 10009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:55 smithi044 bash[22676]: audit 2024-09-21T02:57:54.699490+0000 mon.a (mon.0) 10010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:55 smithi179 bash[23186]: cluster 2024-09-21T02:57:54.386824+0000 mgr.a (mgr.14388) 12267 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:55 smithi179 bash[23186]: audit 2024-09-21T02:57:54.395853+0000 mgr.a (mgr.14388) 12268 : audit [DBG] from='client.268269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:55 smithi179 bash[23186]: audit 2024-09-21T02:57:54.687765+0000 mon.a (mon.0) 10008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:55 smithi179 bash[23186]: audit 2024-09-21T02:57:54.694157+0000 mon.a (mon.0) 10009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:55 smithi179 bash[23186]: audit 2024-09-21T02:57:54.699490+0000 mon.a (mon.0) 10010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:55 smithi049 bash[23528]: cluster 2024-09-21T02:57:54.386824+0000 mgr.a (mgr.14388) 12267 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:57:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:55 smithi049 bash[23528]: audit 2024-09-21T02:57:54.395853+0000 mgr.a (mgr.14388) 12268 : audit [DBG] from='client.268269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:55 smithi049 bash[23528]: audit 2024-09-21T02:57:54.687765+0000 mon.a (mon.0) 10008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:55 smithi049 bash[23528]: audit 2024-09-21T02:57:54.694157+0000 mon.a (mon.0) 10009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:55 smithi049 bash[23528]: audit 2024-09-21T02:57:54.699490+0000 mon.a (mon.0) 10010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:57:57.954 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:57 smithi044 bash[22676]: cluster 2024-09-21T02:57:56.389130+0000 mgr.a (mgr.14388) 12269 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:57 smithi179 bash[23186]: cluster 2024-09-21T02:57:56.389130+0000 mgr.a (mgr.14388) 12269 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:57 smithi049 bash[23528]: cluster 2024-09-21T02:57:56.389130+0000 mgr.a (mgr.14388) 12269 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:57:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:57:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:57:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:57:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:57:59 smithi044 bash[22676]: cluster 2024-09-21T02:57:58.390044+0000 mgr.a (mgr.14388) 12270 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:57:59 smithi179 bash[23186]: cluster 2024-09-21T02:57:58.390044+0000 mgr.a (mgr.14388) 12270 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:57:59 smithi049 bash[23528]: cluster 2024-09-21T02:57:58.390044+0000 mgr.a (mgr.14388) 12270 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:00.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:00.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:00.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:00.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:00.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:01.927 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:01 smithi049 bash[23528]: audit 2024-09-21T02:58:00.176598+0000 mgr.a (mgr.14388) 12271 : audit [DBG] from='client.268344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:01.928 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:01 smithi049 bash[23528]: cluster 2024-09-21T02:58:00.391429+0000 mgr.a (mgr.14388) 12272 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:01 smithi044 bash[22676]: audit 2024-09-21T02:58:00.176598+0000 mgr.a (mgr.14388) 12271 : audit [DBG] from='client.268344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:01 smithi044 bash[22676]: cluster 2024-09-21T02:58:00.391429+0000 mgr.a (mgr.14388) 12272 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:01 smithi179 bash[23186]: audit 2024-09-21T02:58:00.176598+0000 mgr.a (mgr.14388) 12271 : audit [DBG] from='client.268344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:01 smithi179 bash[23186]: cluster 2024-09-21T02:58:00.391429+0000 mgr.a (mgr.14388) 12272 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:03 smithi044 bash[22676]: cluster 2024-09-21T02:58:02.392344+0000 mgr.a (mgr.14388) 12273 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:03 smithi179 bash[23186]: cluster 2024-09-21T02:58:02.392344+0000 mgr.a (mgr.14388) 12273 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:04.020 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:03 smithi049 bash[23528]: cluster 2024-09-21T02:58:02.392344+0000 mgr.a (mgr.14388) 12273 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:05.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:05.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:05.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:05 smithi044 bash[22676]: cluster 2024-09-21T02:58:04.393137+0000 mgr.a (mgr.14388) 12274 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:05 smithi179 bash[23186]: cluster 2024-09-21T02:58:04.393137+0000 mgr.a (mgr.14388) 12274 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:05 smithi049 bash[23528]: cluster 2024-09-21T02:58:04.393137+0000 mgr.a (mgr.14388) 12274 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:06.417 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: audit 2024-09-21T02:58:05.969211+0000 mgr.a (mgr.14388) 12275 : audit [DBG] from='client.268422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: cluster 2024-09-21T02:58:06.394469+0000 mgr.a (mgr.14388) 12276 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: audit 2024-09-21T02:58:07.494782+0000 mon.a (mon.0) 10011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: audit 2024-09-21T02:58:07.503012+0000 mon.a (mon.0) 10012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: audit 2024-09-21T02:58:07.513784+0000 mon.a (mon.0) 10013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: audit 2024-09-21T02:58:07.535511+0000 mon.a (mon.0) 10014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: audit 2024-09-21T02:58:07.549016+0000 mon.a (mon.0) 10015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:07 smithi044 bash[22676]: audit 2024-09-21T02:58:07.557075+0000 mon.a (mon.0) 10016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: audit 2024-09-21T02:58:05.969211+0000 mgr.a (mgr.14388) 12275 : audit [DBG] from='client.268422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: cluster 2024-09-21T02:58:06.394469+0000 mgr.a (mgr.14388) 12276 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: audit 2024-09-21T02:58:07.494782+0000 mon.a (mon.0) 10011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: audit 2024-09-21T02:58:07.503012+0000 mon.a (mon.0) 10012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: audit 2024-09-21T02:58:07.513784+0000 mon.a (mon.0) 10013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: audit 2024-09-21T02:58:07.535511+0000 mon.a (mon.0) 10014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: audit 2024-09-21T02:58:07.549016+0000 mon.a (mon.0) 10015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:07 smithi179 bash[23186]: audit 2024-09-21T02:58:07.557075+0000 mon.a (mon.0) 10016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: audit 2024-09-21T02:58:05.969211+0000 mgr.a (mgr.14388) 12275 : audit [DBG] from='client.268422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: cluster 2024-09-21T02:58:06.394469+0000 mgr.a (mgr.14388) 12276 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: audit 2024-09-21T02:58:07.494782+0000 mon.a (mon.0) 10011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: audit 2024-09-21T02:58:07.503012+0000 mon.a (mon.0) 10012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: audit 2024-09-21T02:58:07.513784+0000 mon.a (mon.0) 10013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: audit 2024-09-21T02:58:07.535511+0000 mon.a (mon.0) 10014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: audit 2024-09-21T02:58:07.549016+0000 mon.a (mon.0) 10015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:07 smithi049 bash[23528]: audit 2024-09-21T02:58:07.557075+0000 mon.a (mon.0) 10016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:09 smithi044 bash[22676]: cluster 2024-09-21T02:58:08.395232+0000 mgr.a (mgr.14388) 12277 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:09 smithi179 bash[23186]: cluster 2024-09-21T02:58:08.395232+0000 mgr.a (mgr.14388) 12277 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:09 smithi049 bash[23528]: cluster 2024-09-21T02:58:08.395232+0000 mgr.a (mgr.14388) 12277 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:11.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:11.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:11.420 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:11 smithi044 bash[22676]: cluster 2024-09-21T02:58:10.397179+0000 mgr.a (mgr.14388) 12278 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:11 smithi179 bash[23186]: cluster 2024-09-21T02:58:10.397179+0000 mgr.a (mgr.14388) 12278 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:11 smithi049 bash[23528]: cluster 2024-09-21T02:58:10.397179+0000 mgr.a (mgr.14388) 12278 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:12.185 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:12.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:12 smithi044 bash[22676]: audit 2024-09-21T02:58:11.752210+0000 mgr.a (mgr.14388) 12279 : audit [DBG] from='client.268500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:12 smithi179 bash[23186]: audit 2024-09-21T02:58:11.752210+0000 mgr.a (mgr.14388) 12279 : audit [DBG] from='client.268500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:12 smithi049 bash[23528]: audit 2024-09-21T02:58:11.752210+0000 mgr.a (mgr.14388) 12279 : audit [DBG] from='client.268500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:13 smithi044 bash[22676]: cluster 2024-09-21T02:58:12.398113+0000 mgr.a (mgr.14388) 12280 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:13 smithi179 bash[23186]: cluster 2024-09-21T02:58:12.398113+0000 mgr.a (mgr.14388) 12280 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:13 smithi049 bash[23528]: cluster 2024-09-21T02:58:12.398113+0000 mgr.a (mgr.14388) 12280 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:15 smithi179 bash[23186]: cluster 2024-09-21T02:58:14.398974+0000 mgr.a (mgr.14388) 12281 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:15 smithi179 bash[23186]: audit 2024-09-21T02:58:14.873221+0000 mon.a (mon.0) 10017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:15 smithi179 bash[23186]: audit 2024-09-21T02:58:14.882042+0000 mon.a (mon.0) 10018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:15 smithi179 bash[23186]: audit 2024-09-21T02:58:14.895893+0000 mon.a (mon.0) 10019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:15 smithi049 bash[23528]: cluster 2024-09-21T02:58:14.398974+0000 mgr.a (mgr.14388) 12281 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:15 smithi049 bash[23528]: audit 2024-09-21T02:58:14.873221+0000 mon.a (mon.0) 10017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:15 smithi049 bash[23528]: audit 2024-09-21T02:58:14.882042+0000 mon.a (mon.0) 10018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:15 smithi049 bash[23528]: audit 2024-09-21T02:58:14.895893+0000 mon.a (mon.0) 10019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:15 smithi044 bash[22676]: cluster 2024-09-21T02:58:14.398974+0000 mgr.a (mgr.14388) 12281 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:15 smithi044 bash[22676]: audit 2024-09-21T02:58:14.873221+0000 mon.a (mon.0) 10017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:15 smithi044 bash[22676]: audit 2024-09-21T02:58:14.882042+0000 mon.a (mon.0) 10018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:15 smithi044 bash[22676]: audit 2024-09-21T02:58:14.895893+0000 mon.a (mon.0) 10019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:17.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:17.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:17.188 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:17.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:17.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:17.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:17.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:17.938 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:17.996 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:17 smithi044 bash[22676]: cluster 2024-09-21T02:58:16.401184+0000 mgr.a (mgr.14388) 12282 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:17 smithi179 bash[23186]: cluster 2024-09-21T02:58:16.401184+0000 mgr.a (mgr.14388) 12282 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:17 smithi049 bash[23528]: cluster 2024-09-21T02:58:16.401184+0000 mgr.a (mgr.14388) 12282 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:18 smithi179 bash[23186]: audit 2024-09-21T02:58:17.518528+0000 mgr.a (mgr.14388) 12283 : audit [DBG] from='client.268578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:18 smithi049 bash[23528]: audit 2024-09-21T02:58:17.518528+0000 mgr.a (mgr.14388) 12283 : audit [DBG] from='client.268578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:19.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:18 smithi044 bash[22676]: audit 2024-09-21T02:58:17.518528+0000 mgr.a (mgr.14388) 12283 : audit [DBG] from='client.268578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:19 smithi049 bash[23528]: cluster 2024-09-21T02:58:18.402156+0000 mgr.a (mgr.14388) 12284 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:19 smithi044 bash[22676]: cluster 2024-09-21T02:58:18.402156+0000 mgr.a (mgr.14388) 12284 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:19 smithi179 bash[23186]: cluster 2024-09-21T02:58:18.402156+0000 mgr.a (mgr.14388) 12284 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:22.008 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:21 smithi049 bash[23528]: cluster 2024-09-21T02:58:20.403433+0000 mgr.a (mgr.14388) 12285 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:22.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:21 smithi044 bash[22676]: cluster 2024-09-21T02:58:20.403433+0000 mgr.a (mgr.14388) 12285 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:21 smithi179 bash[23186]: cluster 2024-09-21T02:58:20.403433+0000 mgr.a (mgr.14388) 12285 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:22.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:23.689 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:23.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:23.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:23.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:23.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:23 smithi049 bash[23528]: cluster 2024-09-21T02:58:22.404177+0000 mgr.a (mgr.14388) 12286 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:23 smithi044 bash[22676]: cluster 2024-09-21T02:58:22.404177+0000 mgr.a (mgr.14388) 12286 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:23 smithi179 bash[23186]: cluster 2024-09-21T02:58:22.404177+0000 mgr.a (mgr.14388) 12286 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:24 smithi049 bash[23528]: audit 2024-09-21T02:58:23.267282+0000 mgr.a (mgr.14388) 12287 : audit [DBG] from='client.268653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:24 smithi044 bash[22676]: audit 2024-09-21T02:58:23.267282+0000 mgr.a (mgr.14388) 12287 : audit [DBG] from='client.268653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:24 smithi179 bash[23186]: audit 2024-09-21T02:58:23.267282+0000 mgr.a (mgr.14388) 12287 : audit [DBG] from='client.268653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:25 smithi049 bash[23528]: cluster 2024-09-21T02:58:24.405165+0000 mgr.a (mgr.14388) 12288 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:25 smithi044 bash[22676]: cluster 2024-09-21T02:58:24.405165+0000 mgr.a (mgr.14388) 12288 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:25 smithi179 bash[23186]: cluster 2024-09-21T02:58:24.405165+0000 mgr.a (mgr.14388) 12288 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: cluster 2024-09-21T02:58:26.407456+0000 mgr.a (mgr.14388) 12289 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.529536+0000 mon.a (mon.0) 10020 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:58:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.536568+0000 mon.a (mon.0) 10021 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:58:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.538404+0000 mon.a (mon.0) 10022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:58:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.549721+0000 mon.a (mon.0) 10023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.556051+0000 mon.a (mon.0) 10024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:58:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.719753+0000 mon.a (mon.0) 10025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.726200+0000 mon.a (mon.0) 10026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.731221+0000 mon.a (mon.0) 10027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.736060+0000 mon.a (mon.0) 10028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.742846+0000 mon.a (mon.0) 10029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:27 smithi179 bash[23186]: audit 2024-09-21T02:58:27.748874+0000 mon.a (mon.0) 10030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: cluster 2024-09-21T02:58:26.407456+0000 mgr.a (mgr.14388) 12289 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.529536+0000 mon.a (mon.0) 10020 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:58:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.536568+0000 mon.a (mon.0) 10021 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:58:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.538404+0000 mon.a (mon.0) 10022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:58:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.549721+0000 mon.a (mon.0) 10023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.556051+0000 mon.a (mon.0) 10024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:58:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.719753+0000 mon.a (mon.0) 10025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.726200+0000 mon.a (mon.0) 10026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.731221+0000 mon.a (mon.0) 10027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.736060+0000 mon.a (mon.0) 10028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.742846+0000 mon.a (mon.0) 10029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:27 smithi049 bash[23528]: audit 2024-09-21T02:58:27.748874+0000 mon.a (mon.0) 10030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: cluster 2024-09-21T02:58:26.407456+0000 mgr.a (mgr.14388) 12289 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.529536+0000 mon.a (mon.0) 10020 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:58:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.536568+0000 mon.a (mon.0) 10021 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.538404+0000 mon.a (mon.0) 10022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.549721+0000 mon.a (mon.0) 10023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.556051+0000 mon.a (mon.0) 10024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.719753+0000 mon.a (mon.0) 10025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.726200+0000 mon.a (mon.0) 10026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.731221+0000 mon.a (mon.0) 10027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.736060+0000 mon.a (mon.0) 10028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.742846+0000 mon.a (mon.0) 10029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:27 smithi044 bash[22676]: audit 2024-09-21T02:58:27.748874+0000 mon.a (mon.0) 10030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:28.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:28.691 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:28.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:58:28 smithi044 bash[22930]: debug 2024-09-21T02:58:28.358+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:58:28.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:58:28 smithi044 bash[22930]: debug 2024-09-21T02:58:28.362+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:58:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:28 smithi049 bash[23528]: audit 2024-09-21T02:58:27.558431+0000 mgr.a (mgr.14388) 12290 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:58:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:28 smithi044 bash[22676]: audit 2024-09-21T02:58:27.558431+0000 mgr.a (mgr.14388) 12290 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:58:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:28 smithi179 bash[23186]: audit 2024-09-21T02:58:27.558431+0000 mgr.a (mgr.14388) 12290 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:58:29.452 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:29 smithi049 bash[23528]: audit 2024-09-21T02:58:28.365215+0000 mgr.a (mgr.14388) 12291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:58:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:29 smithi049 bash[23528]: cephadm 2024-09-21T02:58:28.366715+0000 mgr.a (mgr.14388) 12292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:58:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:29 smithi049 bash[23528]: cluster 2024-09-21T02:58:28.408402+0000 mgr.a (mgr.14388) 12293 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:29 smithi044 bash[22676]: audit 2024-09-21T02:58:28.365215+0000 mgr.a (mgr.14388) 12291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:29 smithi044 bash[22676]: cephadm 2024-09-21T02:58:28.366715+0000 mgr.a (mgr.14388) 12292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:58:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:29 smithi044 bash[22676]: cluster 2024-09-21T02:58:28.408402+0000 mgr.a (mgr.14388) 12293 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:29 smithi179 bash[23186]: audit 2024-09-21T02:58:28.365215+0000 mgr.a (mgr.14388) 12291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:29 smithi179 bash[23186]: cephadm 2024-09-21T02:58:28.366715+0000 mgr.a (mgr.14388) 12292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:58:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:29 smithi179 bash[23186]: cluster 2024-09-21T02:58:28.408402+0000 mgr.a (mgr.14388) 12293 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:30 smithi049 bash[23528]: audit 2024-09-21T02:58:29.028302+0000 mgr.a (mgr.14388) 12294 : audit [DBG] from='client.268836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:30 smithi044 bash[22676]: audit 2024-09-21T02:58:29.028302+0000 mgr.a (mgr.14388) 12294 : audit [DBG] from='client.268836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:30 smithi179 bash[23186]: audit 2024-09-21T02:58:29.028302+0000 mgr.a (mgr.14388) 12294 : audit [DBG] from='client.268836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:31 smithi049 bash[23528]: cluster 2024-09-21T02:58:30.410744+0000 mgr.a (mgr.14388) 12295 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:31 smithi044 bash[22676]: cluster 2024-09-21T02:58:30.410744+0000 mgr.a (mgr.14388) 12295 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:31 smithi179 bash[23186]: cluster 2024-09-21T02:58:30.410744+0000 mgr.a (mgr.14388) 12295 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:33 smithi044 bash[22676]: cluster 2024-09-21T02:58:32.411736+0000 mgr.a (mgr.14388) 12296 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:33 smithi179 bash[23186]: cluster 2024-09-21T02:58:32.411736+0000 mgr.a (mgr.14388) 12296 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:33 smithi049 bash[23528]: cluster 2024-09-21T02:58:32.411736+0000 mgr.a (mgr.14388) 12296 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:34.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:35.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:35.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:35.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:35.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:35.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:35 smithi044 bash[22676]: cluster 2024-09-21T02:58:34.412574+0000 mgr.a (mgr.14388) 12297 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:35 smithi044 bash[22676]: audit 2024-09-21T02:58:34.792253+0000 mgr.a (mgr.14388) 12298 : audit [DBG] from='client.268914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:35 smithi044 bash[22676]: audit 2024-09-21T02:58:35.044424+0000 mon.a (mon.0) 10031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:35 smithi044 bash[22676]: audit 2024-09-21T02:58:35.050842+0000 mon.a (mon.0) 10032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:35 smithi044 bash[22676]: audit 2024-09-21T02:58:35.057939+0000 mon.a (mon.0) 10033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:35 smithi179 bash[23186]: cluster 2024-09-21T02:58:34.412574+0000 mgr.a (mgr.14388) 12297 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:35 smithi179 bash[23186]: audit 2024-09-21T02:58:34.792253+0000 mgr.a (mgr.14388) 12298 : audit [DBG] from='client.268914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:35 smithi179 bash[23186]: audit 2024-09-21T02:58:35.044424+0000 mon.a (mon.0) 10031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:35 smithi179 bash[23186]: audit 2024-09-21T02:58:35.050842+0000 mon.a (mon.0) 10032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:35 smithi179 bash[23186]: audit 2024-09-21T02:58:35.057939+0000 mon.a (mon.0) 10033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:35 smithi049 bash[23528]: cluster 2024-09-21T02:58:34.412574+0000 mgr.a (mgr.14388) 12297 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:35 smithi049 bash[23528]: audit 2024-09-21T02:58:34.792253+0000 mgr.a (mgr.14388) 12298 : audit [DBG] from='client.268914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:35 smithi049 bash[23528]: audit 2024-09-21T02:58:35.044424+0000 mon.a (mon.0) 10031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:35 smithi049 bash[23528]: audit 2024-09-21T02:58:35.050842+0000 mon.a (mon.0) 10032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:35 smithi049 bash[23528]: audit 2024-09-21T02:58:35.057939+0000 mon.a (mon.0) 10033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:37 smithi179 bash[23186]: cluster 2024-09-21T02:58:36.415359+0000 mgr.a (mgr.14388) 12299 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:37 smithi044 bash[22676]: cluster 2024-09-21T02:58:36.415359+0000 mgr.a (mgr.14388) 12299 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:38.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:37 smithi049 bash[23528]: cluster 2024-09-21T02:58:36.415359+0000 mgr.a (mgr.14388) 12299 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:39 smithi044 bash[22676]: cluster 2024-09-21T02:58:38.415953+0000 mgr.a (mgr.14388) 12300 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:58:40.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:40.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:40.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:39 smithi179 bash[23186]: cluster 2024-09-21T02:58:38.415953+0000 mgr.a (mgr.14388) 12300 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:58:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:39 smithi049 bash[23528]: cluster 2024-09-21T02:58:38.415953+0000 mgr.a (mgr.14388) 12300 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:58:41.007 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:42.132 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:41 smithi049 bash[23528]: cluster 2024-09-21T02:58:40.416917+0000 mgr.a (mgr.14388) 12301 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:42.132 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:41 smithi049 bash[23528]: audit 2024-09-21T02:58:40.575280+0000 mgr.a (mgr.14388) 12302 : audit [DBG] from='client.268989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:41 smithi044 bash[22676]: cluster 2024-09-21T02:58:40.416917+0000 mgr.a (mgr.14388) 12301 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:41 smithi044 bash[22676]: audit 2024-09-21T02:58:40.575280+0000 mgr.a (mgr.14388) 12302 : audit [DBG] from='client.268989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:41 smithi179 bash[23186]: cluster 2024-09-21T02:58:40.416917+0000 mgr.a (mgr.14388) 12301 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:58:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:41 smithi179 bash[23186]: audit 2024-09-21T02:58:40.575280+0000 mgr.a (mgr.14388) 12302 : audit [DBG] from='client.268989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:43 smithi044 bash[22676]: cluster 2024-09-21T02:58:42.417825+0000 mgr.a (mgr.14388) 12303 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:44.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:43 smithi179 bash[23186]: cluster 2024-09-21T02:58:42.417825+0000 mgr.a (mgr.14388) 12303 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:44.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:43 smithi049 bash[23528]: cluster 2024-09-21T02:58:42.417825+0000 mgr.a (mgr.14388) 12303 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:44 smithi049 bash[23528]: cluster 2024-09-21T02:58:44.418626+0000 mgr.a (mgr.14388) 12304 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:45.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:44 smithi044 bash[22676]: cluster 2024-09-21T02:58:44.418626+0000 mgr.a (mgr.14388) 12304 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:44 smithi179 bash[23186]: cluster 2024-09-21T02:58:44.418626+0000 mgr.a (mgr.14388) 12304 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:58:46.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:46.010 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:46.010 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:46.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:46.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:46.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:46.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:46.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:47.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:47 smithi044 bash[22676]: audit 2024-09-21T02:58:46.342254+0000 mgr.a (mgr.14388) 12305 : audit [DBG] from='client.269067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:47 smithi044 bash[22676]: cluster 2024-09-21T02:58:46.420050+0000 mgr.a (mgr.14388) 12306 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:47 smithi179 bash[23186]: audit 2024-09-21T02:58:46.342254+0000 mgr.a (mgr.14388) 12305 : audit [DBG] from='client.269067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:47.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:47 smithi179 bash[23186]: cluster 2024-09-21T02:58:46.420050+0000 mgr.a (mgr.14388) 12306 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:47.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:47 smithi049 bash[23528]: audit 2024-09-21T02:58:46.342254+0000 mgr.a (mgr.14388) 12305 : audit [DBG] from='client.269067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:47 smithi049 bash[23528]: cluster 2024-09-21T02:58:46.420050+0000 mgr.a (mgr.14388) 12306 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:48 smithi044 bash[22676]: audit 2024-09-21T02:58:47.949696+0000 mon.a (mon.0) 10034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:48 smithi044 bash[22676]: audit 2024-09-21T02:58:47.958245+0000 mon.a (mon.0) 10035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:48 smithi044 bash[22676]: audit 2024-09-21T02:58:47.970322+0000 mon.a (mon.0) 10036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:48 smithi044 bash[22676]: audit 2024-09-21T02:58:47.977890+0000 mon.a (mon.0) 10037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:48 smithi044 bash[22676]: audit 2024-09-21T02:58:47.985334+0000 mon.a (mon.0) 10038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:48 smithi044 bash[22676]: audit 2024-09-21T02:58:47.995044+0000 mon.a (mon.0) 10039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:48 smithi044 bash[22676]: cluster 2024-09-21T02:58:48.421079+0000 mgr.a (mgr.14388) 12307 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:48 smithi179 bash[23186]: audit 2024-09-21T02:58:47.949696+0000 mon.a (mon.0) 10034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:48 smithi179 bash[23186]: audit 2024-09-21T02:58:47.958245+0000 mon.a (mon.0) 10035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:48 smithi179 bash[23186]: audit 2024-09-21T02:58:47.970322+0000 mon.a (mon.0) 10036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:48 smithi179 bash[23186]: audit 2024-09-21T02:58:47.977890+0000 mon.a (mon.0) 10037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:48 smithi179 bash[23186]: audit 2024-09-21T02:58:47.985334+0000 mon.a (mon.0) 10038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:48 smithi179 bash[23186]: audit 2024-09-21T02:58:47.995044+0000 mon.a (mon.0) 10039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:48 smithi179 bash[23186]: cluster 2024-09-21T02:58:48.421079+0000 mgr.a (mgr.14388) 12307 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:58:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:48 smithi049 bash[23528]: audit 2024-09-21T02:58:47.949696+0000 mon.a (mon.0) 10034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:48 smithi049 bash[23528]: audit 2024-09-21T02:58:47.958245+0000 mon.a (mon.0) 10035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:48 smithi049 bash[23528]: audit 2024-09-21T02:58:47.970322+0000 mon.a (mon.0) 10036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:48 smithi049 bash[23528]: audit 2024-09-21T02:58:47.977890+0000 mon.a (mon.0) 10037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:48 smithi049 bash[23528]: audit 2024-09-21T02:58:47.985334+0000 mon.a (mon.0) 10038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:48 smithi049 bash[23528]: audit 2024-09-21T02:58:47.995044+0000 mon.a (mon.0) 10039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:48 smithi049 bash[23528]: cluster 2024-09-21T02:58:48.421079+0000 mgr.a (mgr.14388) 12307 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T02:58:51.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:51 smithi044 bash[22676]: cluster 2024-09-21T02:58:50.423307+0000 mgr.a (mgr.14388) 12308 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:58:51.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:51 smithi179 bash[23186]: cluster 2024-09-21T02:58:50.423307+0000 mgr.a (mgr.14388) 12308 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:58:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:51.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:51.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:51 smithi049 bash[23528]: cluster 2024-09-21T02:58:50.423307+0000 mgr.a (mgr.14388) 12308 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T02:58:52.535 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:52.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:52.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:52.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:52.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:53.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:53 smithi044 bash[22676]: audit 2024-09-21T02:58:52.101014+0000 mgr.a (mgr.14388) 12309 : audit [DBG] from='client.269145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:53 smithi044 bash[22676]: cluster 2024-09-21T02:58:52.423844+0000 mgr.a (mgr.14388) 12310 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:53.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:53 smithi179 bash[23186]: audit 2024-09-21T02:58:52.101014+0000 mgr.a (mgr.14388) 12309 : audit [DBG] from='client.269145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:53 smithi179 bash[23186]: cluster 2024-09-21T02:58:52.423844+0000 mgr.a (mgr.14388) 12310 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:53.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:53 smithi049 bash[23528]: audit 2024-09-21T02:58:52.101014+0000 mgr.a (mgr.14388) 12309 : audit [DBG] from='client.269145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:53 smithi049 bash[23528]: cluster 2024-09-21T02:58:52.423844+0000 mgr.a (mgr.14388) 12310 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:55 smithi049 bash[23528]: cluster 2024-09-21T02:58:54.424685+0000 mgr.a (mgr.14388) 12311 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:55 smithi049 bash[23528]: audit 2024-09-21T02:58:55.251125+0000 mon.a (mon.0) 10040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:55 smithi049 bash[23528]: audit 2024-09-21T02:58:55.259963+0000 mon.a (mon.0) 10041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:55 smithi049 bash[23528]: audit 2024-09-21T02:58:55.270486+0000 mon.a (mon.0) 10042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:55 smithi179 bash[23186]: cluster 2024-09-21T02:58:54.424685+0000 mgr.a (mgr.14388) 12311 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:55 smithi179 bash[23186]: audit 2024-09-21T02:58:55.251125+0000 mon.a (mon.0) 10040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:55 smithi179 bash[23186]: audit 2024-09-21T02:58:55.259963+0000 mon.a (mon.0) 10041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:55 smithi179 bash[23186]: audit 2024-09-21T02:58:55.270486+0000 mon.a (mon.0) 10042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:55 smithi044 bash[22676]: cluster 2024-09-21T02:58:54.424685+0000 mgr.a (mgr.14388) 12311 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:55 smithi044 bash[22676]: audit 2024-09-21T02:58:55.251125+0000 mon.a (mon.0) 10040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:55 smithi044 bash[22676]: audit 2024-09-21T02:58:55.259963+0000 mon.a (mon.0) 10041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:55 smithi044 bash[22676]: audit 2024-09-21T02:58:55.270486+0000 mon.a (mon.0) 10042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:58:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:58:57.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:58:57.537 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:58:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:57 smithi044 bash[22676]: cluster 2024-09-21T02:58:56.426952+0000 mgr.a (mgr.14388) 12312 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:57 smithi179 bash[23186]: cluster 2024-09-21T02:58:56.426952+0000 mgr.a (mgr.14388) 12312 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:57.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:57 smithi049 bash[23528]: cluster 2024-09-21T02:58:56.426952+0000 mgr.a (mgr.14388) 12312 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:58:58.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:58:58.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:58:58.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:58:58.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:58:58.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:58:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:59 smithi179 bash[23186]: audit 2024-09-21T02:58:57.867613+0000 mgr.a (mgr.14388) 12313 : audit [DBG] from='client.269223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:58:59 smithi179 bash[23186]: cluster 2024-09-21T02:58:58.427518+0000 mgr.a (mgr.14388) 12314 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:59 smithi049 bash[23528]: audit 2024-09-21T02:58:57.867613+0000 mgr.a (mgr.14388) 12313 : audit [DBG] from='client.269223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:58:59 smithi049 bash[23528]: cluster 2024-09-21T02:58:58.427518+0000 mgr.a (mgr.14388) 12314 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:58:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:59 smithi044 bash[22676]: audit 2024-09-21T02:58:57.867613+0000 mgr.a (mgr.14388) 12313 : audit [DBG] from='client.269223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:58:59 smithi044 bash[22676]: cluster 2024-09-21T02:58:58.427518+0000 mgr.a (mgr.14388) 12314 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:01.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:01 smithi179 bash[23186]: cluster 2024-09-21T02:59:00.428965+0000 mgr.a (mgr.14388) 12315 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:01 smithi049 bash[23528]: cluster 2024-09-21T02:59:00.428965+0000 mgr.a (mgr.14388) 12315 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:01 smithi044 bash[22676]: cluster 2024-09-21T02:59:00.428965+0000 mgr.a (mgr.14388) 12315 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:03.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:03 smithi049 bash[23528]: cluster 2024-09-21T02:59:02.429721+0000 mgr.a (mgr.14388) 12316 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:03 smithi044 bash[22676]: cluster 2024-09-21T02:59:02.429721+0000 mgr.a (mgr.14388) 12316 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:03 smithi179 bash[23186]: cluster 2024-09-21T02:59:02.429721+0000 mgr.a (mgr.14388) 12316 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:04.119 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:04.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:04.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:04.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:04.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:04 smithi049 bash[23528]: audit 2024-09-21T02:59:03.659111+0000 mgr.a (mgr.14388) 12317 : audit [DBG] from='client.269301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:04 smithi044 bash[22676]: audit 2024-09-21T02:59:03.659111+0000 mgr.a (mgr.14388) 12317 : audit [DBG] from='client.269301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:05.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:04 smithi179 bash[23186]: audit 2024-09-21T02:59:03.659111+0000 mgr.a (mgr.14388) 12317 : audit [DBG] from='client.269301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:05 smithi049 bash[23528]: cluster 2024-09-21T02:59:04.430754+0000 mgr.a (mgr.14388) 12318 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:05 smithi044 bash[22676]: cluster 2024-09-21T02:59:04.430754+0000 mgr.a (mgr.14388) 12318 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:05 smithi179 bash[23186]: cluster 2024-09-21T02:59:04.430754+0000 mgr.a (mgr.14388) 12318 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:07 smithi049 bash[23528]: cluster 2024-09-21T02:59:06.432984+0000 mgr.a (mgr.14388) 12319 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:07 smithi044 bash[22676]: cluster 2024-09-21T02:59:06.432984+0000 mgr.a (mgr.14388) 12319 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:07 smithi179 bash[23186]: cluster 2024-09-21T02:59:06.432984+0000 mgr.a (mgr.14388) 12319 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:09.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:09.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:09.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:09 smithi044 bash[22676]: audit 2024-09-21T02:59:08.171342+0000 mon.a (mon.0) 10043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:09 smithi044 bash[22676]: audit 2024-09-21T02:59:08.183476+0000 mon.a (mon.0) 10044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:09 smithi044 bash[22676]: audit 2024-09-21T02:59:08.191589+0000 mon.a (mon.0) 10045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:09 smithi044 bash[22676]: audit 2024-09-21T02:59:08.198267+0000 mon.a (mon.0) 10046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:09 smithi044 bash[22676]: audit 2024-09-21T02:59:08.204889+0000 mon.a (mon.0) 10047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:09 smithi044 bash[22676]: audit 2024-09-21T02:59:08.214681+0000 mon.a (mon.0) 10048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:09 smithi044 bash[22676]: cluster 2024-09-21T02:59:08.433806+0000 mgr.a (mgr.14388) 12320 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:09 smithi179 bash[23186]: audit 2024-09-21T02:59:08.171342+0000 mon.a (mon.0) 10043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:09 smithi179 bash[23186]: audit 2024-09-21T02:59:08.183476+0000 mon.a (mon.0) 10044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:09 smithi179 bash[23186]: audit 2024-09-21T02:59:08.191589+0000 mon.a (mon.0) 10045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:09 smithi179 bash[23186]: audit 2024-09-21T02:59:08.198267+0000 mon.a (mon.0) 10046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:09 smithi179 bash[23186]: audit 2024-09-21T02:59:08.204889+0000 mon.a (mon.0) 10047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:09 smithi179 bash[23186]: audit 2024-09-21T02:59:08.214681+0000 mon.a (mon.0) 10048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:09 smithi179 bash[23186]: cluster 2024-09-21T02:59:08.433806+0000 mgr.a (mgr.14388) 12320 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:09 smithi049 bash[23528]: audit 2024-09-21T02:59:08.171342+0000 mon.a (mon.0) 10043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:09 smithi049 bash[23528]: audit 2024-09-21T02:59:08.183476+0000 mon.a (mon.0) 10044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:09 smithi049 bash[23528]: audit 2024-09-21T02:59:08.191589+0000 mon.a (mon.0) 10045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:09 smithi049 bash[23528]: audit 2024-09-21T02:59:08.198267+0000 mon.a (mon.0) 10046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:09 smithi049 bash[23528]: audit 2024-09-21T02:59:08.204889+0000 mon.a (mon.0) 10047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:09 smithi049 bash[23528]: audit 2024-09-21T02:59:08.214681+0000 mon.a (mon.0) 10048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:09 smithi049 bash[23528]: cluster 2024-09-21T02:59:08.433806+0000 mgr.a (mgr.14388) 12320 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:09.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:09.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:09.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:09.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:09.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:10 smithi044 bash[22676]: audit 2024-09-21T02:59:09.455728+0000 mgr.a (mgr.14388) 12321 : audit [DBG] from='client.269379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:10 smithi179 bash[23186]: audit 2024-09-21T02:59:09.455728+0000 mgr.a (mgr.14388) 12321 : audit [DBG] from='client.269379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:10 smithi049 bash[23528]: audit 2024-09-21T02:59:09.455728+0000 mgr.a (mgr.14388) 12321 : audit [DBG] from='client.269379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:11 smithi044 bash[22676]: cluster 2024-09-21T02:59:10.436234+0000 mgr.a (mgr.14388) 12322 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:11 smithi179 bash[23186]: cluster 2024-09-21T02:59:10.436234+0000 mgr.a (mgr.14388) 12322 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:11.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:11 smithi049 bash[23528]: cluster 2024-09-21T02:59:10.436234+0000 mgr.a (mgr.14388) 12322 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:13 smithi179 bash[23186]: cluster 2024-09-21T02:59:12.437009+0000 mgr.a (mgr.14388) 12323 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:13 smithi049 bash[23528]: cluster 2024-09-21T02:59:12.437009+0000 mgr.a (mgr.14388) 12323 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:13 smithi044 bash[22676]: cluster 2024-09-21T02:59:12.437009+0000 mgr.a (mgr.14388) 12323 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:14.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:14.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:14.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:15.668 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:15.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:15.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:15.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:15.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:15 smithi179 bash[23186]: cluster 2024-09-21T02:59:14.437827+0000 mgr.a (mgr.14388) 12324 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:15 smithi179 bash[23186]: audit 2024-09-21T02:59:15.469572+0000 mon.a (mon.0) 10049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:15 smithi179 bash[23186]: audit 2024-09-21T02:59:15.481035+0000 mon.a (mon.0) 10050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:15 smithi179 bash[23186]: audit 2024-09-21T02:59:15.488967+0000 mon.a (mon.0) 10051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:15 smithi049 bash[23528]: cluster 2024-09-21T02:59:14.437827+0000 mgr.a (mgr.14388) 12324 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:15 smithi049 bash[23528]: audit 2024-09-21T02:59:15.469572+0000 mon.a (mon.0) 10049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:15 smithi049 bash[23528]: audit 2024-09-21T02:59:15.481035+0000 mon.a (mon.0) 10050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:15 smithi049 bash[23528]: audit 2024-09-21T02:59:15.488967+0000 mon.a (mon.0) 10051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:15 smithi044 bash[22676]: cluster 2024-09-21T02:59:14.437827+0000 mgr.a (mgr.14388) 12324 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:15 smithi044 bash[22676]: audit 2024-09-21T02:59:15.469572+0000 mon.a (mon.0) 10049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:15 smithi044 bash[22676]: audit 2024-09-21T02:59:15.481035+0000 mon.a (mon.0) 10050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:15 smithi044 bash[22676]: audit 2024-09-21T02:59:15.488967+0000 mon.a (mon.0) 10051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:16.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:16 smithi044 bash[22676]: audit 2024-09-21T02:59:15.244650+0000 mgr.a (mgr.14388) 12325 : audit [DBG] from='client.269457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:16 smithi049 bash[23528]: audit 2024-09-21T02:59:15.244650+0000 mgr.a (mgr.14388) 12325 : audit [DBG] from='client.269457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:16 smithi179 bash[23186]: audit 2024-09-21T02:59:15.244650+0000 mgr.a (mgr.14388) 12325 : audit [DBG] from='client.269457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:17 smithi049 bash[23528]: cluster 2024-09-21T02:59:16.440277+0000 mgr.a (mgr.14388) 12326 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:17 smithi044 bash[22676]: cluster 2024-09-21T02:59:16.440277+0000 mgr.a (mgr.14388) 12326 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:18.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:17 smithi179 bash[23186]: cluster 2024-09-21T02:59:16.440277+0000 mgr.a (mgr.14388) 12326 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:19.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:19 smithi044 bash[22676]: cluster 2024-09-21T02:59:18.441119+0000 mgr.a (mgr.14388) 12327 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:19 smithi049 bash[23528]: cluster 2024-09-21T02:59:18.441119+0000 mgr.a (mgr.14388) 12327 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:19.838 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:19 smithi179 bash[23186]: cluster 2024-09-21T02:59:18.441119+0000 mgr.a (mgr.14388) 12327 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:20.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:20.671 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:20.671 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:21.440 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:21.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:21.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:21.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:21.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:21 smithi049 bash[23528]: cluster 2024-09-21T02:59:20.442096+0000 mgr.a (mgr.14388) 12328 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:21 smithi044 bash[22676]: cluster 2024-09-21T02:59:20.442096+0000 mgr.a (mgr.14388) 12328 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:21 smithi179 bash[23186]: cluster 2024-09-21T02:59:20.442096+0000 mgr.a (mgr.14388) 12328 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:22 smithi049 bash[23528]: audit 2024-09-21T02:59:21.003248+0000 mgr.a (mgr.14388) 12329 : audit [DBG] from='client.269532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:22 smithi044 bash[22676]: audit 2024-09-21T02:59:21.003248+0000 mgr.a (mgr.14388) 12329 : audit [DBG] from='client.269532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:22 smithi179 bash[23186]: audit 2024-09-21T02:59:21.003248+0000 mgr.a (mgr.14388) 12329 : audit [DBG] from='client.269532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:23 smithi049 bash[23528]: cluster 2024-09-21T02:59:22.442960+0000 mgr.a (mgr.14388) 12330 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:59:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:23 smithi044 bash[22676]: cluster 2024-09-21T02:59:22.442960+0000 mgr.a (mgr.14388) 12330 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:59:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:23 smithi179 bash[23186]: cluster 2024-09-21T02:59:22.442960+0000 mgr.a (mgr.14388) 12330 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:59:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:25 smithi049 bash[23528]: cluster 2024-09-21T02:59:24.443750+0000 mgr.a (mgr.14388) 12331 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:59:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:25 smithi044 bash[22676]: cluster 2024-09-21T02:59:24.443750+0000 mgr.a (mgr.14388) 12331 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:59:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:25 smithi179 bash[23186]: cluster 2024-09-21T02:59:24.443750+0000 mgr.a (mgr.14388) 12331 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T02:59:26.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:26.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:26.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:27.223 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:27 smithi049 bash[23528]: cluster 2024-09-21T02:59:26.445697+0000 mgr.a (mgr.14388) 12332 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:27 smithi049 bash[23528]: audit 2024-09-21T02:59:26.783128+0000 mgr.a (mgr.14388) 12333 : audit [DBG] from='client.269610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:27 smithi044 bash[22676]: cluster 2024-09-21T02:59:26.445697+0000 mgr.a (mgr.14388) 12332 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:27.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:27 smithi044 bash[22676]: audit 2024-09-21T02:59:26.783128+0000 mgr.a (mgr.14388) 12333 : audit [DBG] from='client.269610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:27 smithi179 bash[23186]: cluster 2024-09-21T02:59:26.445697+0000 mgr.a (mgr.14388) 12332 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:27 smithi179 bash[23186]: audit 2024-09-21T02:59:26.783128+0000 mgr.a (mgr.14388) 12333 : audit [DBG] from='client.269610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22930]: debug 2024-09-21T02:59:29.249+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22930]: debug 2024-09-21T02:59:29.253+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.389778+0000 mon.a (mon.0) 10052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.399080+0000 mon.a (mon.0) 10053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.409870+0000 mon.a (mon.0) 10054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.420416+0000 mon.a (mon.0) 10055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.425025+0000 mon.a (mon.0) 10056 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.429722+0000 mon.a (mon.0) 10057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.441301+0000 mon.a (mon.0) 10058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.442038+0000 mon.a (mon.0) 10059 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:59:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.444332+0000 mon.a (mon.0) 10060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:59:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: cluster 2024-09-21T02:59:28.446555+0000 mgr.a (mgr.14388) 12334 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.456880+0000 mon.a (mon.0) 10061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.463141+0000 mon.a (mon.0) 10062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:59:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:29 smithi044 bash[22676]: audit 2024-09-21T02:59:28.465844+0000 mgr.a (mgr.14388) 12335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.389778+0000 mon.a (mon.0) 10052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.399080+0000 mon.a (mon.0) 10053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.409870+0000 mon.a (mon.0) 10054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.420416+0000 mon.a (mon.0) 10055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.425025+0000 mon.a (mon.0) 10056 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.429722+0000 mon.a (mon.0) 10057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.441301+0000 mon.a (mon.0) 10058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.442038+0000 mon.a (mon.0) 10059 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:59:29.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.444332+0000 mon.a (mon.0) 10060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:59:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: cluster 2024-09-21T02:59:28.446555+0000 mgr.a (mgr.14388) 12334 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.456880+0000 mon.a (mon.0) 10061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.463141+0000 mon.a (mon.0) 10062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:59:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:29 smithi179 bash[23186]: audit 2024-09-21T02:59:28.465844+0000 mgr.a (mgr.14388) 12335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:59:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.389778+0000 mon.a (mon.0) 10052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.399080+0000 mon.a (mon.0) 10053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.409870+0000 mon.a (mon.0) 10054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.420416+0000 mon.a (mon.0) 10055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.425025+0000 mon.a (mon.0) 10056 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.429722+0000 mon.a (mon.0) 10057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.441301+0000 mon.a (mon.0) 10058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.442038+0000 mon.a (mon.0) 10059 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.444332+0000 mon.a (mon.0) 10060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: cluster 2024-09-21T02:59:28.446555+0000 mgr.a (mgr.14388) 12334 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.456880+0000 mon.a (mon.0) 10061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.463141+0000 mon.a (mon.0) 10062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:59:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:29 smithi049 bash[23528]: audit 2024-09-21T02:59:28.465844+0000 mgr.a (mgr.14388) 12335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T02:59:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:30 smithi044 bash[22676]: audit 2024-09-21T02:59:29.256053+0000 mgr.a (mgr.14388) 12336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:59:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:30 smithi044 bash[22676]: cephadm 2024-09-21T02:59:29.257304+0000 mgr.a (mgr.14388) 12337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:59:30.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:30 smithi179 bash[23186]: audit 2024-09-21T02:59:29.256053+0000 mgr.a (mgr.14388) 12336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:59:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:30 smithi179 bash[23186]: cephadm 2024-09-21T02:59:29.257304+0000 mgr.a (mgr.14388) 12337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:59:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:30 smithi049 bash[23528]: audit 2024-09-21T02:59:29.256053+0000 mgr.a (mgr.14388) 12336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T02:59:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:30 smithi049 bash[23528]: cephadm 2024-09-21T02:59:29.257304+0000 mgr.a (mgr.14388) 12337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T02:59:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:31 smithi044 bash[22676]: cluster 2024-09-21T02:59:30.449239+0000 mgr.a (mgr.14388) 12338 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:31.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:31 smithi179 bash[23186]: cluster 2024-09-21T02:59:30.449239+0000 mgr.a (mgr.14388) 12338 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:31 smithi049 bash[23528]: cluster 2024-09-21T02:59:30.449239+0000 mgr.a (mgr.14388) 12338 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:32.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:32.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:32.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:33 smithi049 bash[23528]: cluster 2024-09-21T02:59:32.450065+0000 mgr.a (mgr.14388) 12339 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:33 smithi049 bash[23528]: audit 2024-09-21T02:59:32.556225+0000 mgr.a (mgr.14388) 12340 : audit [DBG] from='client.269793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:33 smithi044 bash[22676]: cluster 2024-09-21T02:59:32.450065+0000 mgr.a (mgr.14388) 12339 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:33 smithi044 bash[22676]: audit 2024-09-21T02:59:32.556225+0000 mgr.a (mgr.14388) 12340 : audit [DBG] from='client.269793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:33 smithi179 bash[23186]: cluster 2024-09-21T02:59:32.450065+0000 mgr.a (mgr.14388) 12339 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:33 smithi179 bash[23186]: audit 2024-09-21T02:59:32.556225+0000 mgr.a (mgr.14388) 12340 : audit [DBG] from='client.269793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:35.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:35 smithi179 bash[23186]: cluster 2024-09-21T02:59:34.451003+0000 mgr.a (mgr.14388) 12341 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:35 smithi049 bash[23528]: cluster 2024-09-21T02:59:34.451003+0000 mgr.a (mgr.14388) 12341 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:35 smithi044 bash[22676]: cluster 2024-09-21T02:59:34.451003+0000 mgr.a (mgr.14388) 12341 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:36 smithi044 bash[22676]: audit 2024-09-21T02:59:35.703968+0000 mon.a (mon.0) 10063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:36 smithi044 bash[22676]: audit 2024-09-21T02:59:35.714016+0000 mon.a (mon.0) 10064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:36 smithi044 bash[22676]: audit 2024-09-21T02:59:35.724786+0000 mon.a (mon.0) 10065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:36 smithi179 bash[23186]: audit 2024-09-21T02:59:35.703968+0000 mon.a (mon.0) 10063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:36 smithi179 bash[23186]: audit 2024-09-21T02:59:35.714016+0000 mon.a (mon.0) 10064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:36 smithi179 bash[23186]: audit 2024-09-21T02:59:35.724786+0000 mon.a (mon.0) 10065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:36 smithi049 bash[23528]: audit 2024-09-21T02:59:35.703968+0000 mon.a (mon.0) 10063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:36 smithi049 bash[23528]: audit 2024-09-21T02:59:35.714016+0000 mon.a (mon.0) 10064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:36 smithi049 bash[23528]: audit 2024-09-21T02:59:35.724786+0000 mon.a (mon.0) 10065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:37 smithi044 bash[22676]: cluster 2024-09-21T02:59:36.453312+0000 mgr.a (mgr.14388) 12342 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:37.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:37.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:37.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:37 smithi179 bash[23186]: cluster 2024-09-21T02:59:36.453312+0000 mgr.a (mgr.14388) 12342 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:38.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:37 smithi049 bash[23528]: cluster 2024-09-21T02:59:36.453312+0000 mgr.a (mgr.14388) 12342 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:38.784 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:38.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:39.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:39 smithi044 bash[22676]: audit 2024-09-21T02:59:38.328521+0000 mgr.a (mgr.14388) 12343 : audit [DBG] from='client.269868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:39 smithi044 bash[22676]: cluster 2024-09-21T02:59:38.453890+0000 mgr.a (mgr.14388) 12344 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:39 smithi179 bash[23186]: audit 2024-09-21T02:59:38.328521+0000 mgr.a (mgr.14388) 12343 : audit [DBG] from='client.269868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:39 smithi179 bash[23186]: cluster 2024-09-21T02:59:38.453890+0000 mgr.a (mgr.14388) 12344 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:39 smithi049 bash[23528]: audit 2024-09-21T02:59:38.328521+0000 mgr.a (mgr.14388) 12343 : audit [DBG] from='client.269868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:39 smithi049 bash[23528]: cluster 2024-09-21T02:59:38.453890+0000 mgr.a (mgr.14388) 12344 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:41 smithi044 bash[22676]: cluster 2024-09-21T02:59:40.456475+0000 mgr.a (mgr.14388) 12345 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:41 smithi179 bash[23186]: cluster 2024-09-21T02:59:40.456475+0000 mgr.a (mgr.14388) 12345 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:42.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:41 smithi049 bash[23528]: cluster 2024-09-21T02:59:40.456475+0000 mgr.a (mgr.14388) 12345 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T02:59:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:43 smithi049 bash[23528]: cluster 2024-09-21T02:59:42.457450+0000 mgr.a (mgr.14388) 12346 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:43 smithi179 bash[23186]: cluster 2024-09-21T02:59:42.457450+0000 mgr.a (mgr.14388) 12346 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:43 smithi044 bash[22676]: cluster 2024-09-21T02:59:42.457450+0000 mgr.a (mgr.14388) 12346 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:44.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:44.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:44.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:44.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:44.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:45 smithi179 bash[23186]: audit 2024-09-21T02:59:44.120660+0000 mgr.a (mgr.14388) 12347 : audit [DBG] from='client.269943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:45 smithi179 bash[23186]: cluster 2024-09-21T02:59:44.464219+0000 mgr.a (mgr.14388) 12348 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:46.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:45 smithi049 bash[23528]: audit 2024-09-21T02:59:44.120660+0000 mgr.a (mgr.14388) 12347 : audit [DBG] from='client.269943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:45 smithi049 bash[23528]: cluster 2024-09-21T02:59:44.464219+0000 mgr.a (mgr.14388) 12348 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:45 smithi044 bash[22676]: audit 2024-09-21T02:59:44.120660+0000 mgr.a (mgr.14388) 12347 : audit [DBG] from='client.269943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:45 smithi044 bash[22676]: cluster 2024-09-21T02:59:44.464219+0000 mgr.a (mgr.14388) 12348 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:47 smithi179 bash[23186]: cluster 2024-09-21T02:59:46.466393+0000 mgr.a (mgr.14388) 12349 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:47 smithi049 bash[23528]: cluster 2024-09-21T02:59:46.466393+0000 mgr.a (mgr.14388) 12349 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:47 smithi044 bash[22676]: cluster 2024-09-21T02:59:46.466393+0000 mgr.a (mgr.14388) 12349 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T02:59:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:49.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:49.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:49 smithi044 bash[22676]: cluster 2024-09-21T02:59:48.467175+0000 mgr.a (mgr.14388) 12350 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:49 smithi044 bash[22676]: audit 2024-09-21T02:59:48.601062+0000 mon.a (mon.0) 10066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:49 smithi044 bash[22676]: audit 2024-09-21T02:59:48.610566+0000 mon.a (mon.0) 10067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:49 smithi044 bash[22676]: audit 2024-09-21T02:59:48.617750+0000 mon.a (mon.0) 10068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:49 smithi044 bash[22676]: audit 2024-09-21T02:59:48.624983+0000 mon.a (mon.0) 10069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:49 smithi044 bash[22676]: audit 2024-09-21T02:59:48.633018+0000 mon.a (mon.0) 10070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:49 smithi044 bash[22676]: audit 2024-09-21T02:59:48.644143+0000 mon.a (mon.0) 10071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:49 smithi179 bash[23186]: cluster 2024-09-21T02:59:48.467175+0000 mgr.a (mgr.14388) 12350 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:49 smithi179 bash[23186]: audit 2024-09-21T02:59:48.601062+0000 mon.a (mon.0) 10066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:49 smithi179 bash[23186]: audit 2024-09-21T02:59:48.610566+0000 mon.a (mon.0) 10067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:49 smithi179 bash[23186]: audit 2024-09-21T02:59:48.617750+0000 mon.a (mon.0) 10068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:49 smithi179 bash[23186]: audit 2024-09-21T02:59:48.624983+0000 mon.a (mon.0) 10069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:49 smithi179 bash[23186]: audit 2024-09-21T02:59:48.633018+0000 mon.a (mon.0) 10070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:49 smithi179 bash[23186]: audit 2024-09-21T02:59:48.644143+0000 mon.a (mon.0) 10071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:49 smithi049 bash[23528]: cluster 2024-09-21T02:59:48.467175+0000 mgr.a (mgr.14388) 12350 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:49 smithi049 bash[23528]: audit 2024-09-21T02:59:48.601062+0000 mon.a (mon.0) 10066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:49 smithi049 bash[23528]: audit 2024-09-21T02:59:48.610566+0000 mon.a (mon.0) 10067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:49 smithi049 bash[23528]: audit 2024-09-21T02:59:48.617750+0000 mon.a (mon.0) 10068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:49 smithi049 bash[23528]: audit 2024-09-21T02:59:48.624983+0000 mon.a (mon.0) 10069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:49 smithi049 bash[23528]: audit 2024-09-21T02:59:48.633018+0000 mon.a (mon.0) 10070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:49 smithi049 bash[23528]: audit 2024-09-21T02:59:48.644143+0000 mon.a (mon.0) 10071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:50.352 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:50.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:50.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:51 smithi044 bash[22676]: audit 2024-09-21T02:59:49.910526+0000 mgr.a (mgr.14388) 12351 : audit [DBG] from='client.270018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:51 smithi044 bash[22676]: cluster 2024-09-21T02:59:50.469976+0000 mgr.a (mgr.14388) 12352 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:52.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:51 smithi179 bash[23186]: audit 2024-09-21T02:59:49.910526+0000 mgr.a (mgr.14388) 12351 : audit [DBG] from='client.270018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:51 smithi179 bash[23186]: cluster 2024-09-21T02:59:50.469976+0000 mgr.a (mgr.14388) 12352 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:51 smithi049 bash[23528]: audit 2024-09-21T02:59:49.910526+0000 mgr.a (mgr.14388) 12351 : audit [DBG] from='client.270018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:51 smithi049 bash[23528]: cluster 2024-09-21T02:59:50.469976+0000 mgr.a (mgr.14388) 12352 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:53 smithi044 bash[22676]: cluster 2024-09-21T02:59:52.470787+0000 mgr.a (mgr.14388) 12353 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:53 smithi179 bash[23186]: cluster 2024-09-21T02:59:52.470787+0000 mgr.a (mgr.14388) 12353 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:53 smithi049 bash[23528]: cluster 2024-09-21T02:59:52.470787+0000 mgr.a (mgr.14388) 12353 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:55.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T02:59:55.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T02:59:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T02:59:55.940 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:55 smithi049 bash[23528]: cluster 2024-09-21T02:59:54.471571+0000 mgr.a (mgr.14388) 12354 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:55 smithi044 bash[22676]: cluster 2024-09-21T02:59:54.471571+0000 mgr.a (mgr.14388) 12354 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:55 smithi179 bash[23186]: cluster 2024-09-21T02:59:54.471571+0000 mgr.a (mgr.14388) 12354 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:56.125 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T02:59:56.125 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T02:59:56.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T02:59:56.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T02:59:56.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T02:59:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:56 smithi179 bash[23186]: audit 2024-09-21T02:59:55.689847+0000 mgr.a (mgr.14388) 12355 : audit [DBG] from='client.270096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:56 smithi179 bash[23186]: audit 2024-09-21T02:59:55.919796+0000 mon.a (mon.0) 10072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:56 smithi179 bash[23186]: audit 2024-09-21T02:59:55.933089+0000 mon.a (mon.0) 10073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:56 smithi179 bash[23186]: audit 2024-09-21T02:59:55.938965+0000 mon.a (mon.0) 10074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:56 smithi044 bash[22676]: audit 2024-09-21T02:59:55.689847+0000 mgr.a (mgr.14388) 12355 : audit [DBG] from='client.270096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:56 smithi044 bash[22676]: audit 2024-09-21T02:59:55.919796+0000 mon.a (mon.0) 10072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:56 smithi044 bash[22676]: audit 2024-09-21T02:59:55.933089+0000 mon.a (mon.0) 10073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:56 smithi044 bash[22676]: audit 2024-09-21T02:59:55.938965+0000 mon.a (mon.0) 10074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:56 smithi049 bash[23528]: audit 2024-09-21T02:59:55.689847+0000 mgr.a (mgr.14388) 12355 : audit [DBG] from='client.270096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:56 smithi049 bash[23528]: audit 2024-09-21T02:59:55.919796+0000 mon.a (mon.0) 10072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:56 smithi049 bash[23528]: audit 2024-09-21T02:59:55.933089+0000 mon.a (mon.0) 10073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:56 smithi049 bash[23528]: audit 2024-09-21T02:59:55.938965+0000 mon.a (mon.0) 10074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T02:59:57.884 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:57 smithi044 bash[22676]: cluster 2024-09-21T02:59:56.474412+0000 mgr.a (mgr.14388) 12356 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:57.944 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:57 smithi179 bash[23186]: cluster 2024-09-21T02:59:56.474412+0000 mgr.a (mgr.14388) 12356 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:57 smithi049 bash[23528]: cluster 2024-09-21T02:59:56.474412+0000 mgr.a (mgr.14388) 12356 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T02:59:59.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 02:59:59 smithi179 bash[23186]: cluster 2024-09-21T02:59:58.475257+0000 mgr.a (mgr.14388) 12357 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T02:59:59.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 02:59:59 smithi044 bash[22676]: cluster 2024-09-21T02:59:58.475257+0000 mgr.a (mgr.14388) 12357 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:00:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 02:59:59 smithi049 bash[23528]: cluster 2024-09-21T02:59:58.475257+0000 mgr.a (mgr.14388) 12357 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:00:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:00 smithi044 bash[22676]: cluster 2024-09-21T03:00:00.000152+0000 mon.a (mon.0) 10075 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:00:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:00 smithi179 bash[23186]: cluster 2024-09-21T03:00:00.000152+0000 mon.a (mon.0) 10075 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:00:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:00 smithi049 bash[23528]: cluster 2024-09-21T03:00:00.000152+0000 mon.a (mon.0) 10075 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:00:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:01.127 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:01.127 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:01.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:01.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:01.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:01.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:01.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:01 smithi044 bash[22676]: cluster 2024-09-21T03:00:00.477220+0000 mgr.a (mgr.14388) 12358 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:01 smithi179 bash[23186]: cluster 2024-09-21T03:00:00.477220+0000 mgr.a (mgr.14388) 12358 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:02.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:01 smithi049 bash[23528]: cluster 2024-09-21T03:00:00.477220+0000 mgr.a (mgr.14388) 12358 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:02.915 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:02 smithi049 bash[23528]: audit 2024-09-21T03:00:01.463959+0000 mgr.a (mgr.14388) 12359 : audit [DBG] from='client.270171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:02 smithi044 bash[22676]: audit 2024-09-21T03:00:01.463959+0000 mgr.a (mgr.14388) 12359 : audit [DBG] from='client.270171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:02 smithi179 bash[23186]: audit 2024-09-21T03:00:01.463959+0000 mgr.a (mgr.14388) 12359 : audit [DBG] from='client.270171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:03.919 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:03 smithi049 bash[23528]: cluster 2024-09-21T03:00:02.478137+0000 mgr.a (mgr.14388) 12360 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:03 smithi044 bash[22676]: cluster 2024-09-21T03:00:02.478137+0000 mgr.a (mgr.14388) 12360 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:03 smithi179 bash[23186]: cluster 2024-09-21T03:00:02.478137+0000 mgr.a (mgr.14388) 12360 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:05 smithi044 bash[22676]: cluster 2024-09-21T03:00:04.478891+0000 mgr.a (mgr.14388) 12361 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:05 smithi179 bash[23186]: cluster 2024-09-21T03:00:04.478891+0000 mgr.a (mgr.14388) 12361 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:05 smithi049 bash[23528]: cluster 2024-09-21T03:00:04.478891+0000 mgr.a (mgr.14388) 12361 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:06.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:06.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:06.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:07.701 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:07.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:07.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:07.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:07.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:07.961 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:07 smithi049 bash[23528]: cluster 2024-09-21T03:00:06.481094+0000 mgr.a (mgr.14388) 12362 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:07 smithi044 bash[22676]: cluster 2024-09-21T03:00:06.481094+0000 mgr.a (mgr.14388) 12362 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:07 smithi179 bash[23186]: cluster 2024-09-21T03:00:06.481094+0000 mgr.a (mgr.14388) 12362 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:08.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:08 smithi044 bash[22676]: audit 2024-09-21T03:00:07.252289+0000 mgr.a (mgr.14388) 12363 : audit [DBG] from='client.270246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:08 smithi179 bash[23186]: audit 2024-09-21T03:00:07.252289+0000 mgr.a (mgr.14388) 12363 : audit [DBG] from='client.270246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:09.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:08 smithi049 bash[23528]: audit 2024-09-21T03:00:07.252289+0000 mgr.a (mgr.14388) 12363 : audit [DBG] from='client.270246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:09 smithi044 bash[22676]: cluster 2024-09-21T03:00:08.481983+0000 mgr.a (mgr.14388) 12364 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:09 smithi044 bash[22676]: audit 2024-09-21T03:00:08.811276+0000 mon.a (mon.0) 10076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:09 smithi044 bash[22676]: audit 2024-09-21T03:00:08.820663+0000 mon.a (mon.0) 10077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:09 smithi044 bash[22676]: audit 2024-09-21T03:00:08.832101+0000 mon.a (mon.0) 10078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:09 smithi044 bash[22676]: audit 2024-09-21T03:00:08.854741+0000 mon.a (mon.0) 10079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:09 smithi044 bash[22676]: audit 2024-09-21T03:00:08.864243+0000 mon.a (mon.0) 10080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:09 smithi044 bash[22676]: audit 2024-09-21T03:00:08.875761+0000 mon.a (mon.0) 10081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:09 smithi179 bash[23186]: cluster 2024-09-21T03:00:08.481983+0000 mgr.a (mgr.14388) 12364 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:09 smithi179 bash[23186]: audit 2024-09-21T03:00:08.811276+0000 mon.a (mon.0) 10076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:09 smithi179 bash[23186]: audit 2024-09-21T03:00:08.820663+0000 mon.a (mon.0) 10077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:09 smithi179 bash[23186]: audit 2024-09-21T03:00:08.832101+0000 mon.a (mon.0) 10078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:09 smithi179 bash[23186]: audit 2024-09-21T03:00:08.854741+0000 mon.a (mon.0) 10079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:09 smithi179 bash[23186]: audit 2024-09-21T03:00:08.864243+0000 mon.a (mon.0) 10080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:09 smithi179 bash[23186]: audit 2024-09-21T03:00:08.875761+0000 mon.a (mon.0) 10081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:09 smithi049 bash[23528]: cluster 2024-09-21T03:00:08.481983+0000 mgr.a (mgr.14388) 12364 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:09 smithi049 bash[23528]: audit 2024-09-21T03:00:08.811276+0000 mon.a (mon.0) 10076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:09 smithi049 bash[23528]: audit 2024-09-21T03:00:08.820663+0000 mon.a (mon.0) 10077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:09 smithi049 bash[23528]: audit 2024-09-21T03:00:08.832101+0000 mon.a (mon.0) 10078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:09 smithi049 bash[23528]: audit 2024-09-21T03:00:08.854741+0000 mon.a (mon.0) 10079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:09 smithi049 bash[23528]: audit 2024-09-21T03:00:08.864243+0000 mon.a (mon.0) 10080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:09 smithi049 bash[23528]: audit 2024-09-21T03:00:08.875761+0000 mon.a (mon.0) 10081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:11 smithi044 bash[22676]: cluster 2024-09-21T03:00:10.484238+0000 mgr.a (mgr.14388) 12365 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:11 smithi179 bash[23186]: cluster 2024-09-21T03:00:10.484238+0000 mgr.a (mgr.14388) 12365 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:12.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:11 smithi049 bash[23528]: cluster 2024-09-21T03:00:10.484238+0000 mgr.a (mgr.14388) 12365 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:13.489 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:13.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:13.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:13.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:13.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:13 smithi044 bash[22676]: cluster 2024-09-21T03:00:12.485054+0000 mgr.a (mgr.14388) 12366 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:14.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:13 smithi179 bash[23186]: cluster 2024-09-21T03:00:12.485054+0000 mgr.a (mgr.14388) 12366 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:13 smithi049 bash[23528]: cluster 2024-09-21T03:00:12.485054+0000 mgr.a (mgr.14388) 12366 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:15.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:14 smithi044 bash[22676]: audit 2024-09-21T03:00:13.040965+0000 mgr.a (mgr.14388) 12367 : audit [DBG] from='client.270321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:15.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:14 smithi179 bash[23186]: audit 2024-09-21T03:00:13.040965+0000 mgr.a (mgr.14388) 12367 : audit [DBG] from='client.270321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:14 smithi049 bash[23528]: audit 2024-09-21T03:00:13.040965+0000 mgr.a (mgr.14388) 12367 : audit [DBG] from='client.270321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:15 smithi044 bash[22676]: cluster 2024-09-21T03:00:14.485928+0000 mgr.a (mgr.14388) 12368 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:16.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:15 smithi049 bash[23528]: cluster 2024-09-21T03:00:14.485928+0000 mgr.a (mgr.14388) 12368 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:15 smithi179 bash[23186]: cluster 2024-09-21T03:00:14.485928+0000 mgr.a (mgr.14388) 12368 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:17 smithi179 bash[23186]: audit 2024-09-21T03:00:16.152114+0000 mon.a (mon.0) 10082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:17 smithi179 bash[23186]: audit 2024-09-21T03:00:16.160822+0000 mon.a (mon.0) 10083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:17 smithi179 bash[23186]: audit 2024-09-21T03:00:16.171609+0000 mon.a (mon.0) 10084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:17 smithi179 bash[23186]: cluster 2024-09-21T03:00:16.488141+0000 mgr.a (mgr.14388) 12369 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:17 smithi044 bash[22676]: audit 2024-09-21T03:00:16.152114+0000 mon.a (mon.0) 10082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:17 smithi044 bash[22676]: audit 2024-09-21T03:00:16.160822+0000 mon.a (mon.0) 10083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:17 smithi044 bash[22676]: audit 2024-09-21T03:00:16.171609+0000 mon.a (mon.0) 10084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:17 smithi044 bash[22676]: cluster 2024-09-21T03:00:16.488141+0000 mgr.a (mgr.14388) 12369 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:17 smithi049 bash[23528]: audit 2024-09-21T03:00:16.152114+0000 mon.a (mon.0) 10082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:17 smithi049 bash[23528]: audit 2024-09-21T03:00:16.160822+0000 mon.a (mon.0) 10083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:17 smithi049 bash[23528]: audit 2024-09-21T03:00:16.171609+0000 mon.a (mon.0) 10084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:17 smithi049 bash[23528]: cluster 2024-09-21T03:00:16.488141+0000 mgr.a (mgr.14388) 12369 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:18.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:19.249 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:19.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:19 smithi049 bash[23528]: cluster 2024-09-21T03:00:18.488898+0000 mgr.a (mgr.14388) 12370 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:19 smithi049 bash[23528]: audit 2024-09-21T03:00:18.829009+0000 mgr.a (mgr.14388) 12371 : audit [DBG] from='client.270399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:19.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:19 smithi179 bash[23186]: cluster 2024-09-21T03:00:18.488898+0000 mgr.a (mgr.14388) 12370 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:19.804 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:19 smithi179 bash[23186]: audit 2024-09-21T03:00:18.829009+0000 mgr.a (mgr.14388) 12371 : audit [DBG] from='client.270399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:19.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:19 smithi044 bash[22676]: cluster 2024-09-21T03:00:18.488898+0000 mgr.a (mgr.14388) 12370 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:19 smithi044 bash[22676]: audit 2024-09-21T03:00:18.829009+0000 mgr.a (mgr.14388) 12371 : audit [DBG] from='client.270399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:21.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:21 smithi044 bash[22676]: cluster 2024-09-21T03:00:20.491255+0000 mgr.a (mgr.14388) 12372 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:21 smithi049 bash[23528]: cluster 2024-09-21T03:00:20.491255+0000 mgr.a (mgr.14388) 12372 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:21 smithi179 bash[23186]: cluster 2024-09-21T03:00:20.491255+0000 mgr.a (mgr.14388) 12372 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:23 smithi049 bash[23528]: cluster 2024-09-21T03:00:22.492037+0000 mgr.a (mgr.14388) 12373 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:23 smithi044 bash[22676]: cluster 2024-09-21T03:00:22.492037+0000 mgr.a (mgr.14388) 12373 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:23 smithi179 bash[23186]: cluster 2024-09-21T03:00:22.492037+0000 mgr.a (mgr.14388) 12373 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:24.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:24.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:24.252 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:25.049 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:25 smithi044 bash[22676]: cluster 2024-09-21T03:00:24.492788+0000 mgr.a (mgr.14388) 12374 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:25 smithi044 bash[22676]: audit 2024-09-21T03:00:24.591330+0000 mgr.a (mgr.14388) 12375 : audit [DBG] from='client.270477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:25 smithi179 bash[23186]: cluster 2024-09-21T03:00:24.492788+0000 mgr.a (mgr.14388) 12374 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:25 smithi179 bash[23186]: audit 2024-09-21T03:00:24.591330+0000 mgr.a (mgr.14388) 12375 : audit [DBG] from='client.270477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:26.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:25 smithi049 bash[23528]: cluster 2024-09-21T03:00:24.492788+0000 mgr.a (mgr.14388) 12374 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:25 smithi049 bash[23528]: audit 2024-09-21T03:00:24.591330+0000 mgr.a (mgr.14388) 12375 : audit [DBG] from='client.270477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:27 smithi044 bash[22676]: cluster 2024-09-21T03:00:26.495499+0000 mgr.a (mgr.14388) 12376 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:00:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:27 smithi179 bash[23186]: cluster 2024-09-21T03:00:26.495499+0000 mgr.a (mgr.14388) 12376 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:00:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:27 smithi049 bash[23528]: cluster 2024-09-21T03:00:26.495499+0000 mgr.a (mgr.14388) 12376 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:00:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: cluster 2024-09-21T03:00:28.496279+0000 mgr.a (mgr.14388) 12377 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.042608+0000 mon.a (mon.0) 10085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.053087+0000 mon.a (mon.0) 10086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.067761+0000 mon.a (mon.0) 10087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.093402+0000 mon.a (mon.0) 10088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.103463+0000 mon.a (mon.0) 10089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.115176+0000 mon.a (mon.0) 10090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.340474+0000 mon.a (mon.0) 10091 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.351015+0000 mon.a (mon.0) 10092 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.352895+0000 mon.a (mon.0) 10093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.365551+0000 mon.a (mon.0) 10094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:29 smithi044 bash[22676]: audit 2024-09-21T03:00:29.372403+0000 mon.a (mon.0) 10095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:00:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: cluster 2024-09-21T03:00:28.496279+0000 mgr.a (mgr.14388) 12377 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:00:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.042608+0000 mon.a (mon.0) 10085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.053087+0000 mon.a (mon.0) 10086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.067761+0000 mon.a (mon.0) 10087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.093402+0000 mon.a (mon.0) 10088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.103463+0000 mon.a (mon.0) 10089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.115176+0000 mon.a (mon.0) 10090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.340474+0000 mon.a (mon.0) 10091 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:00:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.351015+0000 mon.a (mon.0) 10092 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:00:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.352895+0000 mon.a (mon.0) 10093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:00:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.365551+0000 mon.a (mon.0) 10094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:29 smithi179 bash[23186]: audit 2024-09-21T03:00:29.372403+0000 mon.a (mon.0) 10095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:00:30.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:30.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:30.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: cluster 2024-09-21T03:00:28.496279+0000 mgr.a (mgr.14388) 12377 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.042608+0000 mon.a (mon.0) 10085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.053087+0000 mon.a (mon.0) 10086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.067761+0000 mon.a (mon.0) 10087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.093402+0000 mon.a (mon.0) 10088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.103463+0000 mon.a (mon.0) 10089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.115176+0000 mon.a (mon.0) 10090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.340474+0000 mon.a (mon.0) 10091 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:00:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.351015+0000 mon.a (mon.0) 10092 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:00:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.352895+0000 mon.a (mon.0) 10093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:00:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.365551+0000 mon.a (mon.0) 10094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:29 smithi049 bash[23528]: audit 2024-09-21T03:00:29.372403+0000 mon.a (mon.0) 10095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:00:30.486 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:00:30 smithi044 bash[22930]: debug 2024-09-21T03:00:30.148+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:00:30.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:00:30 smithi044 bash[22930]: debug 2024-09-21T03:00:30.148+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:00:30.772 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:30.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:30.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:30.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:30.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:30 smithi044 bash[22676]: audit 2024-09-21T03:00:29.374857+0000 mgr.a (mgr.14388) 12378 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:00:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:30 smithi179 bash[23186]: audit 2024-09-21T03:00:29.374857+0000 mgr.a (mgr.14388) 12378 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:00:31.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:30 smithi049 bash[23528]: audit 2024-09-21T03:00:29.374857+0000 mgr.a (mgr.14388) 12378 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:31 smithi044 bash[22676]: audit 2024-09-21T03:00:30.151667+0000 mgr.a (mgr.14388) 12379 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:31 smithi044 bash[22676]: cephadm 2024-09-21T03:00:30.152876+0000 mgr.a (mgr.14388) 12380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:31 smithi044 bash[22676]: audit 2024-09-21T03:00:30.360425+0000 mgr.a (mgr.14388) 12381 : audit [DBG] from='client.270663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:31 smithi044 bash[22676]: cluster 2024-09-21T03:00:30.497990+0000 mgr.a (mgr.14388) 12382 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:31 smithi179 bash[23186]: audit 2024-09-21T03:00:30.151667+0000 mgr.a (mgr.14388) 12379 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:31 smithi179 bash[23186]: cephadm 2024-09-21T03:00:30.152876+0000 mgr.a (mgr.14388) 12380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:31 smithi179 bash[23186]: audit 2024-09-21T03:00:30.360425+0000 mgr.a (mgr.14388) 12381 : audit [DBG] from='client.270663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:31 smithi179 bash[23186]: cluster 2024-09-21T03:00:30.497990+0000 mgr.a (mgr.14388) 12382 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:00:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:31 smithi049 bash[23528]: audit 2024-09-21T03:00:30.151667+0000 mgr.a (mgr.14388) 12379 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:00:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:31 smithi049 bash[23528]: cephadm 2024-09-21T03:00:30.152876+0000 mgr.a (mgr.14388) 12380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:00:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:31 smithi049 bash[23528]: audit 2024-09-21T03:00:30.360425+0000 mgr.a (mgr.14388) 12381 : audit [DBG] from='client.270663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:31 smithi049 bash[23528]: cluster 2024-09-21T03:00:30.497990+0000 mgr.a (mgr.14388) 12382 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:00:33.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:33 smithi044 bash[22676]: cluster 2024-09-21T03:00:32.498831+0000 mgr.a (mgr.14388) 12383 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:00:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:33 smithi179 bash[23186]: cluster 2024-09-21T03:00:32.498831+0000 mgr.a (mgr.14388) 12383 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:00:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:33 smithi049 bash[23528]: cluster 2024-09-21T03:00:32.498831+0000 mgr.a (mgr.14388) 12383 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:00:35.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:35.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:35 smithi044 bash[22676]: cluster 2024-09-21T03:00:34.499596+0000 mgr.a (mgr.14388) 12384 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:00:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:35 smithi179 bash[23186]: cluster 2024-09-21T03:00:34.499596+0000 mgr.a (mgr.14388) 12384 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:00:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:35 smithi049 bash[23528]: cluster 2024-09-21T03:00:34.499596+0000 mgr.a (mgr.14388) 12384 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:00:36.561 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:36.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:36.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:36.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:36.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:37.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:37 smithi179 bash[23186]: audit 2024-09-21T03:00:36.111353+0000 mgr.a (mgr.14388) 12385 : audit [DBG] from='client.270741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:37.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:37 smithi179 bash[23186]: audit 2024-09-21T03:00:36.372685+0000 mon.a (mon.0) 10096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:37 smithi179 bash[23186]: audit 2024-09-21T03:00:36.379995+0000 mon.a (mon.0) 10097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:37 smithi179 bash[23186]: audit 2024-09-21T03:00:36.387863+0000 mon.a (mon.0) 10098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:37 smithi179 bash[23186]: cluster 2024-09-21T03:00:36.500934+0000 mgr.a (mgr.14388) 12386 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:37 smithi044 bash[22676]: audit 2024-09-21T03:00:36.111353+0000 mgr.a (mgr.14388) 12385 : audit [DBG] from='client.270741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:37 smithi044 bash[22676]: audit 2024-09-21T03:00:36.372685+0000 mon.a (mon.0) 10096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:37 smithi044 bash[22676]: audit 2024-09-21T03:00:36.379995+0000 mon.a (mon.0) 10097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:37 smithi044 bash[22676]: audit 2024-09-21T03:00:36.387863+0000 mon.a (mon.0) 10098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:37 smithi044 bash[22676]: cluster 2024-09-21T03:00:36.500934+0000 mgr.a (mgr.14388) 12386 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:37 smithi049 bash[23528]: audit 2024-09-21T03:00:36.111353+0000 mgr.a (mgr.14388) 12385 : audit [DBG] from='client.270741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:37 smithi049 bash[23528]: audit 2024-09-21T03:00:36.372685+0000 mon.a (mon.0) 10096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:37 smithi049 bash[23528]: audit 2024-09-21T03:00:36.379995+0000 mon.a (mon.0) 10097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:37 smithi049 bash[23528]: audit 2024-09-21T03:00:36.387863+0000 mon.a (mon.0) 10098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:37 smithi049 bash[23528]: cluster 2024-09-21T03:00:36.500934+0000 mgr.a (mgr.14388) 12386 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:39 smithi044 bash[22676]: cluster 2024-09-21T03:00:38.501708+0000 mgr.a (mgr.14388) 12387 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:40.000 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:39 smithi179 bash[23186]: cluster 2024-09-21T03:00:38.501708+0000 mgr.a (mgr.14388) 12387 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:39 smithi049 bash[23528]: cluster 2024-09-21T03:00:38.501708+0000 mgr.a (mgr.14388) 12387 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:41.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:41 smithi044 bash[22676]: cluster 2024-09-21T03:00:40.503665+0000 mgr.a (mgr.14388) 12388 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:41 smithi179 bash[23186]: cluster 2024-09-21T03:00:40.503665+0000 mgr.a (mgr.14388) 12388 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:41 smithi049 bash[23528]: cluster 2024-09-21T03:00:40.503665+0000 mgr.a (mgr.14388) 12388 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:42.327 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:42.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:42.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:42.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:42.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:43 smithi044 bash[22676]: audit 2024-09-21T03:00:41.889382+0000 mgr.a (mgr.14388) 12389 : audit [DBG] from='client.270819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:43 smithi044 bash[22676]: cluster 2024-09-21T03:00:42.504583+0000 mgr.a (mgr.14388) 12390 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:00:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:43 smithi179 bash[23186]: audit 2024-09-21T03:00:41.889382+0000 mgr.a (mgr.14388) 12389 : audit [DBG] from='client.270819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:43 smithi179 bash[23186]: cluster 2024-09-21T03:00:42.504583+0000 mgr.a (mgr.14388) 12390 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:00:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:43 smithi049 bash[23528]: audit 2024-09-21T03:00:41.889382+0000 mgr.a (mgr.14388) 12389 : audit [DBG] from='client.270819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:43 smithi049 bash[23528]: cluster 2024-09-21T03:00:42.504583+0000 mgr.a (mgr.14388) 12390 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:00:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:45 smithi049 bash[23528]: cluster 2024-09-21T03:00:44.505381+0000 mgr.a (mgr.14388) 12391 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:00:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:45 smithi044 bash[22676]: cluster 2024-09-21T03:00:44.505381+0000 mgr.a (mgr.14388) 12391 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:00:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:45 smithi179 bash[23186]: cluster 2024-09-21T03:00:44.505381+0000 mgr.a (mgr.14388) 12391 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:00:47.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:47.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:47.329 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:47 smithi044 bash[22676]: cluster 2024-09-21T03:00:46.507566+0000 mgr.a (mgr.14388) 12392 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:00:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:47 smithi179 bash[23186]: cluster 2024-09-21T03:00:46.507566+0000 mgr.a (mgr.14388) 12392 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:00:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:47 smithi049 bash[23528]: cluster 2024-09-21T03:00:46.507566+0000 mgr.a (mgr.14388) 12392 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:00:48.121 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:48.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:48.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:48.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:48.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:48 smithi044 bash[22676]: audit 2024-09-21T03:00:47.667897+0000 mgr.a (mgr.14388) 12393 : audit [DBG] from='client.270897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:48 smithi179 bash[23186]: audit 2024-09-21T03:00:47.667897+0000 mgr.a (mgr.14388) 12393 : audit [DBG] from='client.270897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:49.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:48 smithi049 bash[23528]: audit 2024-09-21T03:00:47.667897+0000 mgr.a (mgr.14388) 12393 : audit [DBG] from='client.270897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:49 smithi179 bash[23186]: cluster 2024-09-21T03:00:48.508586+0000 mgr.a (mgr.14388) 12394 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:49 smithi179 bash[23186]: audit 2024-09-21T03:00:49.284546+0000 mon.a (mon.0) 10099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:49 smithi179 bash[23186]: audit 2024-09-21T03:00:49.292291+0000 mon.a (mon.0) 10100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:49 smithi179 bash[23186]: audit 2024-09-21T03:00:49.304143+0000 mon.a (mon.0) 10101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:49 smithi179 bash[23186]: audit 2024-09-21T03:00:49.329670+0000 mon.a (mon.0) 10102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:49 smithi179 bash[23186]: audit 2024-09-21T03:00:49.338243+0000 mon.a (mon.0) 10103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:49 smithi179 bash[23186]: audit 2024-09-21T03:00:49.348669+0000 mon.a (mon.0) 10104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:49 smithi044 bash[22676]: cluster 2024-09-21T03:00:48.508586+0000 mgr.a (mgr.14388) 12394 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:49 smithi044 bash[22676]: audit 2024-09-21T03:00:49.284546+0000 mon.a (mon.0) 10099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:49 smithi044 bash[22676]: audit 2024-09-21T03:00:49.292291+0000 mon.a (mon.0) 10100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:49 smithi044 bash[22676]: audit 2024-09-21T03:00:49.304143+0000 mon.a (mon.0) 10101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:49 smithi044 bash[22676]: audit 2024-09-21T03:00:49.329670+0000 mon.a (mon.0) 10102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:49 smithi044 bash[22676]: audit 2024-09-21T03:00:49.338243+0000 mon.a (mon.0) 10103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:49.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:49 smithi044 bash[22676]: audit 2024-09-21T03:00:49.348669+0000 mon.a (mon.0) 10104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:49 smithi049 bash[23528]: cluster 2024-09-21T03:00:48.508586+0000 mgr.a (mgr.14388) 12394 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:49 smithi049 bash[23528]: audit 2024-09-21T03:00:49.284546+0000 mon.a (mon.0) 10099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:49 smithi049 bash[23528]: audit 2024-09-21T03:00:49.292291+0000 mon.a (mon.0) 10100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:49 smithi049 bash[23528]: audit 2024-09-21T03:00:49.304143+0000 mon.a (mon.0) 10101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:49 smithi049 bash[23528]: audit 2024-09-21T03:00:49.329670+0000 mon.a (mon.0) 10102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:49 smithi049 bash[23528]: audit 2024-09-21T03:00:49.338243+0000 mon.a (mon.0) 10103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:49 smithi049 bash[23528]: audit 2024-09-21T03:00:49.348669+0000 mon.a (mon.0) 10104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:51.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:51 smithi044 bash[22676]: cluster 2024-09-21T03:00:50.510800+0000 mgr.a (mgr.14388) 12395 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:51 smithi179 bash[23186]: cluster 2024-09-21T03:00:50.510800+0000 mgr.a (mgr.14388) 12395 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:52.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:51 smithi049 bash[23528]: cluster 2024-09-21T03:00:50.510800+0000 mgr.a (mgr.14388) 12395 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:53.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:53.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:53.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:53.905 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:53.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:53.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:53.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:53.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:53 smithi044 bash[22676]: cluster 2024-09-21T03:00:52.511584+0000 mgr.a (mgr.14388) 12396 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:53 smithi179 bash[23186]: cluster 2024-09-21T03:00:52.511584+0000 mgr.a (mgr.14388) 12396 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:53 smithi049 bash[23528]: cluster 2024-09-21T03:00:52.511584+0000 mgr.a (mgr.14388) 12396 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:54 smithi044 bash[22676]: audit 2024-09-21T03:00:53.461381+0000 mgr.a (mgr.14388) 12397 : audit [DBG] from='client.270975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:54 smithi179 bash[23186]: audit 2024-09-21T03:00:53.461381+0000 mgr.a (mgr.14388) 12397 : audit [DBG] from='client.270975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:55.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:54 smithi049 bash[23528]: audit 2024-09-21T03:00:53.461381+0000 mgr.a (mgr.14388) 12397 : audit [DBG] from='client.270975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:55 smithi044 bash[22676]: cluster 2024-09-21T03:00:54.512533+0000 mgr.a (mgr.14388) 12398 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:55 smithi179 bash[23186]: cluster 2024-09-21T03:00:54.512533+0000 mgr.a (mgr.14388) 12398 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:55 smithi049 bash[23528]: cluster 2024-09-21T03:00:54.512533+0000 mgr.a (mgr.14388) 12398 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:57.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:57 smithi179 bash[23186]: cluster 2024-09-21T03:00:56.514780+0000 mgr.a (mgr.14388) 12399 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:57.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:57 smithi179 bash[23186]: audit 2024-09-21T03:00:56.586062+0000 mon.a (mon.0) 10105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:57.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:57 smithi179 bash[23186]: audit 2024-09-21T03:00:56.594993+0000 mon.a (mon.0) 10106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:57.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:57 smithi179 bash[23186]: audit 2024-09-21T03:00:56.605652+0000 mon.a (mon.0) 10107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:57.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:57 smithi044 bash[22676]: cluster 2024-09-21T03:00:56.514780+0000 mgr.a (mgr.14388) 12399 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:57 smithi044 bash[22676]: audit 2024-09-21T03:00:56.586062+0000 mon.a (mon.0) 10105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:57 smithi044 bash[22676]: audit 2024-09-21T03:00:56.594993+0000 mon.a (mon.0) 10106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:57 smithi044 bash[22676]: audit 2024-09-21T03:00:56.605652+0000 mon.a (mon.0) 10107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:57 smithi049 bash[23528]: cluster 2024-09-21T03:00:56.514780+0000 mgr.a (mgr.14388) 12399 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:00:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:57 smithi049 bash[23528]: audit 2024-09-21T03:00:56.586062+0000 mon.a (mon.0) 10105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:57 smithi049 bash[23528]: audit 2024-09-21T03:00:56.594993+0000 mon.a (mon.0) 10106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:57 smithi049 bash[23528]: audit 2024-09-21T03:00:56.605652+0000 mon.a (mon.0) 10107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:00:58.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:00:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:00:58.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:00:59.660 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:00:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:00:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:00:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:00:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:00:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:00:59 smithi179 bash[23186]: cluster 2024-09-21T03:00:58.515577+0000 mgr.a (mgr.14388) 12400 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:00:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:00:59 smithi044 bash[22676]: cluster 2024-09-21T03:00:58.515577+0000 mgr.a (mgr.14388) 12400 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:00:59 smithi049 bash[23528]: cluster 2024-09-21T03:00:58.515577+0000 mgr.a (mgr.14388) 12400 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:00.925 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:00 smithi179 bash[23186]: audit 2024-09-21T03:00:59.245674+0000 mgr.a (mgr.14388) 12401 : audit [DBG] from='client.271053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:00.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:00 smithi044 bash[22676]: audit 2024-09-21T03:00:59.245674+0000 mgr.a (mgr.14388) 12401 : audit [DBG] from='client.271053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:01.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:00 smithi049 bash[23528]: audit 2024-09-21T03:00:59.245674+0000 mgr.a (mgr.14388) 12401 : audit [DBG] from='client.271053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:01.929 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:01 smithi044 bash[22676]: cluster 2024-09-21T03:01:00.517931+0000 mgr.a (mgr.14388) 12402 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:01 smithi179 bash[23186]: cluster 2024-09-21T03:01:00.517931+0000 mgr.a (mgr.14388) 12402 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:01 smithi049 bash[23528]: cluster 2024-09-21T03:01:00.517931+0000 mgr.a (mgr.14388) 12402 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:03 smithi044 bash[22676]: cluster 2024-09-21T03:01:02.518712+0000 mgr.a (mgr.14388) 12403 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:03 smithi179 bash[23186]: cluster 2024-09-21T03:01:02.518712+0000 mgr.a (mgr.14388) 12403 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:03 smithi049 bash[23528]: cluster 2024-09-21T03:01:02.518712+0000 mgr.a (mgr.14388) 12403 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:04.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:04.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:04.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:05.439 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:05.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:05.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:05.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:05.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:05 smithi044 bash[22676]: cluster 2024-09-21T03:01:04.519490+0000 mgr.a (mgr.14388) 12404 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:05 smithi179 bash[23186]: cluster 2024-09-21T03:01:04.519490+0000 mgr.a (mgr.14388) 12404 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:05 smithi049 bash[23528]: cluster 2024-09-21T03:01:04.519490+0000 mgr.a (mgr.14388) 12404 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:06.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:06 smithi044 bash[22676]: audit 2024-09-21T03:01:04.997359+0000 mgr.a (mgr.14388) 12405 : audit [DBG] from='client.271131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:06 smithi179 bash[23186]: audit 2024-09-21T03:01:04.997359+0000 mgr.a (mgr.14388) 12405 : audit [DBG] from='client.271131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:06 smithi049 bash[23528]: audit 2024-09-21T03:01:04.997359+0000 mgr.a (mgr.14388) 12405 : audit [DBG] from='client.271131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:07 smithi049 bash[23528]: cluster 2024-09-21T03:01:06.522526+0000 mgr.a (mgr.14388) 12406 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:07 smithi044 bash[22676]: cluster 2024-09-21T03:01:06.522526+0000 mgr.a (mgr.14388) 12406 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:07 smithi179 bash[23186]: cluster 2024-09-21T03:01:06.522526+0000 mgr.a (mgr.14388) 12406 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:09 smithi044 bash[22676]: cluster 2024-09-21T03:01:08.523359+0000 mgr.a (mgr.14388) 12407 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:09 smithi044 bash[22676]: audit 2024-09-21T03:01:09.518925+0000 mon.a (mon.0) 10108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:09 smithi044 bash[22676]: audit 2024-09-21T03:01:09.527331+0000 mon.a (mon.0) 10109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:09 smithi044 bash[22676]: audit 2024-09-21T03:01:09.537810+0000 mon.a (mon.0) 10110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:09 smithi044 bash[22676]: audit 2024-09-21T03:01:09.554505+0000 mon.a (mon.0) 10111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:09 smithi044 bash[22676]: audit 2024-09-21T03:01:09.562981+0000 mon.a (mon.0) 10112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:09 smithi044 bash[22676]: audit 2024-09-21T03:01:09.573063+0000 mon.a (mon.0) 10113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:09 smithi179 bash[23186]: cluster 2024-09-21T03:01:08.523359+0000 mgr.a (mgr.14388) 12407 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:09 smithi179 bash[23186]: audit 2024-09-21T03:01:09.518925+0000 mon.a (mon.0) 10108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:09 smithi179 bash[23186]: audit 2024-09-21T03:01:09.527331+0000 mon.a (mon.0) 10109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:09 smithi179 bash[23186]: audit 2024-09-21T03:01:09.537810+0000 mon.a (mon.0) 10110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:09 smithi179 bash[23186]: audit 2024-09-21T03:01:09.554505+0000 mon.a (mon.0) 10111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:09 smithi179 bash[23186]: audit 2024-09-21T03:01:09.562981+0000 mon.a (mon.0) 10112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:09 smithi179 bash[23186]: audit 2024-09-21T03:01:09.573063+0000 mon.a (mon.0) 10113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:09 smithi049 bash[23528]: cluster 2024-09-21T03:01:08.523359+0000 mgr.a (mgr.14388) 12407 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:09 smithi049 bash[23528]: audit 2024-09-21T03:01:09.518925+0000 mon.a (mon.0) 10108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:09 smithi049 bash[23528]: audit 2024-09-21T03:01:09.527331+0000 mon.a (mon.0) 10109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:09 smithi049 bash[23528]: audit 2024-09-21T03:01:09.537810+0000 mon.a (mon.0) 10110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:09 smithi049 bash[23528]: audit 2024-09-21T03:01:09.554505+0000 mon.a (mon.0) 10111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:09 smithi049 bash[23528]: audit 2024-09-21T03:01:09.562981+0000 mon.a (mon.0) 10112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:09 smithi049 bash[23528]: audit 2024-09-21T03:01:09.573063+0000 mon.a (mon.0) 10113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:11.206 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:11.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:11 smithi044 bash[22676]: cluster 2024-09-21T03:01:10.525433+0000 mgr.a (mgr.14388) 12408 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:11 smithi044 bash[22676]: audit 2024-09-21T03:01:10.778596+0000 mgr.a (mgr.14388) 12409 : audit [DBG] from='client.271209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:11 smithi179 bash[23186]: cluster 2024-09-21T03:01:10.525433+0000 mgr.a (mgr.14388) 12408 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:11 smithi179 bash[23186]: audit 2024-09-21T03:01:10.778596+0000 mgr.a (mgr.14388) 12409 : audit [DBG] from='client.271209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:11 smithi049 bash[23528]: cluster 2024-09-21T03:01:10.525433+0000 mgr.a (mgr.14388) 12408 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:11 smithi049 bash[23528]: audit 2024-09-21T03:01:10.778596+0000 mgr.a (mgr.14388) 12409 : audit [DBG] from='client.271209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:13 smithi044 bash[22676]: cluster 2024-09-21T03:01:12.526440+0000 mgr.a (mgr.14388) 12410 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:13 smithi179 bash[23186]: cluster 2024-09-21T03:01:12.526440+0000 mgr.a (mgr.14388) 12410 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:13 smithi049 bash[23528]: cluster 2024-09-21T03:01:12.526440+0000 mgr.a (mgr.14388) 12410 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:15 smithi044 bash[22676]: cluster 2024-09-21T03:01:14.527232+0000 mgr.a (mgr.14388) 12411 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:01:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:15 smithi179 bash[23186]: cluster 2024-09-21T03:01:14.527232+0000 mgr.a (mgr.14388) 12411 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:01:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:15 smithi049 bash[23528]: cluster 2024-09-21T03:01:14.527232+0000 mgr.a (mgr.14388) 12411 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:01:16.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:16.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:16.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:16.982 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:17 smithi179 bash[23186]: cluster 2024-09-21T03:01:16.528576+0000 mgr.a (mgr.14388) 12412 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:17 smithi179 bash[23186]: audit 2024-09-21T03:01:16.541892+0000 mgr.a (mgr.14388) 12413 : audit [DBG] from='client.271287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:17 smithi179 bash[23186]: audit 2024-09-21T03:01:16.801433+0000 mon.a (mon.0) 10114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:17 smithi179 bash[23186]: audit 2024-09-21T03:01:16.808347+0000 mon.a (mon.0) 10115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:17 smithi179 bash[23186]: audit 2024-09-21T03:01:16.827762+0000 mon.a (mon.0) 10116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:17 smithi044 bash[22676]: cluster 2024-09-21T03:01:16.528576+0000 mgr.a (mgr.14388) 12412 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:17 smithi044 bash[22676]: audit 2024-09-21T03:01:16.541892+0000 mgr.a (mgr.14388) 12413 : audit [DBG] from='client.271287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:17 smithi044 bash[22676]: audit 2024-09-21T03:01:16.801433+0000 mon.a (mon.0) 10114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:17 smithi044 bash[22676]: audit 2024-09-21T03:01:16.808347+0000 mon.a (mon.0) 10115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:17 smithi044 bash[22676]: audit 2024-09-21T03:01:16.827762+0000 mon.a (mon.0) 10116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:17 smithi049 bash[23528]: cluster 2024-09-21T03:01:16.528576+0000 mgr.a (mgr.14388) 12412 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:17 smithi049 bash[23528]: audit 2024-09-21T03:01:16.541892+0000 mgr.a (mgr.14388) 12413 : audit [DBG] from='client.271287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:17 smithi049 bash[23528]: audit 2024-09-21T03:01:16.801433+0000 mon.a (mon.0) 10114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:17 smithi049 bash[23528]: audit 2024-09-21T03:01:16.808347+0000 mon.a (mon.0) 10115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:17 smithi049 bash[23528]: audit 2024-09-21T03:01:16.827762+0000 mon.a (mon.0) 10116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:19.864 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:19 smithi044 bash[22676]: cluster 2024-09-21T03:01:18.529561+0000 mgr.a (mgr.14388) 12414 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:19 smithi179 bash[23186]: cluster 2024-09-21T03:01:18.529561+0000 mgr.a (mgr.14388) 12414 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:20.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:19 smithi049 bash[23528]: cluster 2024-09-21T03:01:18.529561+0000 mgr.a (mgr.14388) 12414 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:21.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:21.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:21.985 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:22.093 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:21 smithi044 bash[22676]: cluster 2024-09-21T03:01:20.531826+0000 mgr.a (mgr.14388) 12415 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:21 smithi179 bash[23186]: cluster 2024-09-21T03:01:20.531826+0000 mgr.a (mgr.14388) 12415 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:22.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:21 smithi049 bash[23528]: cluster 2024-09-21T03:01:20.531826+0000 mgr.a (mgr.14388) 12415 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:22.768 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:24.217 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:23 smithi049 bash[23528]: audit 2024-09-21T03:01:22.310827+0000 mgr.a (mgr.14388) 12416 : audit [DBG] from='client.271362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:24.217 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:23 smithi049 bash[23528]: cluster 2024-09-21T03:01:22.532328+0000 mgr.a (mgr.14388) 12417 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:23 smithi044 bash[22676]: audit 2024-09-21T03:01:22.310827+0000 mgr.a (mgr.14388) 12416 : audit [DBG] from='client.271362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:23 smithi044 bash[22676]: cluster 2024-09-21T03:01:22.532328+0000 mgr.a (mgr.14388) 12417 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:23 smithi179 bash[23186]: audit 2024-09-21T03:01:22.310827+0000 mgr.a (mgr.14388) 12416 : audit [DBG] from='client.271362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:23 smithi179 bash[23186]: cluster 2024-09-21T03:01:22.532328+0000 mgr.a (mgr.14388) 12417 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:26.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:25 smithi049 bash[23528]: cluster 2024-09-21T03:01:24.533213+0000 mgr.a (mgr.14388) 12418 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:25 smithi044 bash[22676]: cluster 2024-09-21T03:01:24.533213+0000 mgr.a (mgr.14388) 12418 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:25 smithi179 bash[23186]: cluster 2024-09-21T03:01:24.533213+0000 mgr.a (mgr.14388) 12418 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:27.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:27.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:27.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:27 smithi049 bash[23528]: cluster 2024-09-21T03:01:26.535558+0000 mgr.a (mgr.14388) 12419 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:27 smithi044 bash[22676]: cluster 2024-09-21T03:01:26.535558+0000 mgr.a (mgr.14388) 12419 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:27 smithi179 bash[23186]: cluster 2024-09-21T03:01:26.535558+0000 mgr.a (mgr.14388) 12419 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:28.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:28.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:28.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:28.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: audit 2024-09-21T03:01:28.105366+0000 mgr.a (mgr.14388) 12420 : audit [DBG] from='client.271440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: cluster 2024-09-21T03:01:28.536052+0000 mgr.a (mgr.14388) 12421 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: audit 2024-09-21T03:01:29.756703+0000 mon.a (mon.0) 10117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: audit 2024-09-21T03:01:29.767337+0000 mon.a (mon.0) 10118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: audit 2024-09-21T03:01:29.780102+0000 mon.a (mon.0) 10119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: audit 2024-09-21T03:01:29.796937+0000 mon.a (mon.0) 10120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: audit 2024-09-21T03:01:29.805197+0000 mon.a (mon.0) 10121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:29 smithi044 bash[22676]: audit 2024-09-21T03:01:29.815093+0000 mon.a (mon.0) 10122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: audit 2024-09-21T03:01:28.105366+0000 mgr.a (mgr.14388) 12420 : audit [DBG] from='client.271440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: cluster 2024-09-21T03:01:28.536052+0000 mgr.a (mgr.14388) 12421 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: audit 2024-09-21T03:01:29.756703+0000 mon.a (mon.0) 10117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: audit 2024-09-21T03:01:29.767337+0000 mon.a (mon.0) 10118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: audit 2024-09-21T03:01:29.780102+0000 mon.a (mon.0) 10119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: audit 2024-09-21T03:01:29.796937+0000 mon.a (mon.0) 10120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: audit 2024-09-21T03:01:29.805197+0000 mon.a (mon.0) 10121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:29 smithi179 bash[23186]: audit 2024-09-21T03:01:29.815093+0000 mon.a (mon.0) 10122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: audit 2024-09-21T03:01:28.105366+0000 mgr.a (mgr.14388) 12420 : audit [DBG] from='client.271440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: cluster 2024-09-21T03:01:28.536052+0000 mgr.a (mgr.14388) 12421 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: audit 2024-09-21T03:01:29.756703+0000 mon.a (mon.0) 10117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: audit 2024-09-21T03:01:29.767337+0000 mon.a (mon.0) 10118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: audit 2024-09-21T03:01:29.780102+0000 mon.a (mon.0) 10119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: audit 2024-09-21T03:01:29.796937+0000 mon.a (mon.0) 10120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: audit 2024-09-21T03:01:29.805197+0000 mon.a (mon.0) 10121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:29 smithi049 bash[23528]: audit 2024-09-21T03:01:29.815093+0000 mon.a (mon.0) 10122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:31.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:01:31 smithi044 bash[22930]: debug 2024-09-21T03:01:31.023+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:01:31.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:01:31 smithi044 bash[22930]: debug 2024-09-21T03:01:31.023+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:01:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:30 smithi044 bash[22676]: audit 2024-09-21T03:01:30.202142+0000 mon.a (mon.0) 10123 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:01:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:30 smithi044 bash[22676]: audit 2024-09-21T03:01:30.208514+0000 mon.a (mon.0) 10124 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:01:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:30 smithi044 bash[22676]: audit 2024-09-21T03:01:30.210437+0000 mon.a (mon.0) 10125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:01:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:30 smithi044 bash[22676]: audit 2024-09-21T03:01:30.221685+0000 mon.a (mon.0) 10126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:30 smithi044 bash[22676]: audit 2024-09-21T03:01:30.227976+0000 mon.a (mon.0) 10127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:01:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:30 smithi179 bash[23186]: audit 2024-09-21T03:01:30.202142+0000 mon.a (mon.0) 10123 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:01:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:30 smithi179 bash[23186]: audit 2024-09-21T03:01:30.208514+0000 mon.a (mon.0) 10124 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:01:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:30 smithi179 bash[23186]: audit 2024-09-21T03:01:30.210437+0000 mon.a (mon.0) 10125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:01:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:30 smithi179 bash[23186]: audit 2024-09-21T03:01:30.221685+0000 mon.a (mon.0) 10126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:30 smithi179 bash[23186]: audit 2024-09-21T03:01:30.227976+0000 mon.a (mon.0) 10127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:01:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:30 smithi049 bash[23528]: audit 2024-09-21T03:01:30.202142+0000 mon.a (mon.0) 10123 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:01:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:30 smithi049 bash[23528]: audit 2024-09-21T03:01:30.208514+0000 mon.a (mon.0) 10124 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:01:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:30 smithi049 bash[23528]: audit 2024-09-21T03:01:30.210437+0000 mon.a (mon.0) 10125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:01:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:30 smithi049 bash[23528]: audit 2024-09-21T03:01:30.221685+0000 mon.a (mon.0) 10126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:30 smithi049 bash[23528]: audit 2024-09-21T03:01:30.227976+0000 mon.a (mon.0) 10127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:01:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:31 smithi044 bash[22676]: audit 2024-09-21T03:01:30.230413+0000 mgr.a (mgr.14388) 12422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:01:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:31 smithi044 bash[22676]: cluster 2024-09-21T03:01:30.537786+0000 mgr.a (mgr.14388) 12423 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:31 smithi179 bash[23186]: audit 2024-09-21T03:01:30.230413+0000 mgr.a (mgr.14388) 12422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:01:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:31 smithi179 bash[23186]: cluster 2024-09-21T03:01:30.537786+0000 mgr.a (mgr.14388) 12423 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:31 smithi049 bash[23528]: audit 2024-09-21T03:01:30.230413+0000 mgr.a (mgr.14388) 12422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:01:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:31 smithi049 bash[23528]: cluster 2024-09-21T03:01:30.537786+0000 mgr.a (mgr.14388) 12423 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:01:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:32 smithi044 bash[22676]: audit 2024-09-21T03:01:31.026957+0000 mgr.a (mgr.14388) 12424 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:01:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:32 smithi044 bash[22676]: cephadm 2024-09-21T03:01:31.028662+0000 mgr.a (mgr.14388) 12425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:01:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:32 smithi179 bash[23186]: audit 2024-09-21T03:01:31.026957+0000 mgr.a (mgr.14388) 12424 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:01:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:32 smithi179 bash[23186]: cephadm 2024-09-21T03:01:31.028662+0000 mgr.a (mgr.14388) 12425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:01:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:32 smithi049 bash[23528]: audit 2024-09-21T03:01:31.026957+0000 mgr.a (mgr.14388) 12424 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:01:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:32 smithi049 bash[23528]: cephadm 2024-09-21T03:01:31.028662+0000 mgr.a (mgr.14388) 12425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:01:33.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:33.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:33 smithi044 bash[22676]: cluster 2024-09-21T03:01:32.538653+0000 mgr.a (mgr.14388) 12426 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:33 smithi179 bash[23186]: cluster 2024-09-21T03:01:32.538653+0000 mgr.a (mgr.14388) 12426 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:33 smithi049 bash[23528]: cluster 2024-09-21T03:01:32.538653+0000 mgr.a (mgr.14388) 12426 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:34.314 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:34.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:34.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:34.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:34.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:35 smithi044 bash[22676]: audit 2024-09-21T03:01:33.892949+0000 mgr.a (mgr.14388) 12427 : audit [DBG] from='client.271620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:35 smithi044 bash[22676]: cluster 2024-09-21T03:01:34.539760+0000 mgr.a (mgr.14388) 12428 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:35 smithi179 bash[23186]: audit 2024-09-21T03:01:33.892949+0000 mgr.a (mgr.14388) 12427 : audit [DBG] from='client.271620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:35 smithi179 bash[23186]: cluster 2024-09-21T03:01:34.539760+0000 mgr.a (mgr.14388) 12428 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:35 smithi049 bash[23528]: audit 2024-09-21T03:01:33.892949+0000 mgr.a (mgr.14388) 12427 : audit [DBG] from='client.271620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:35 smithi049 bash[23528]: cluster 2024-09-21T03:01:34.539760+0000 mgr.a (mgr.14388) 12428 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:37 smithi179 bash[23186]: cluster 2024-09-21T03:01:36.542094+0000 mgr.a (mgr.14388) 12429 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:37 smithi179 bash[23186]: audit 2024-09-21T03:01:37.026999+0000 mon.a (mon.0) 10128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:37 smithi179 bash[23186]: audit 2024-09-21T03:01:37.035871+0000 mon.a (mon.0) 10129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:37 smithi179 bash[23186]: audit 2024-09-21T03:01:37.046627+0000 mon.a (mon.0) 10130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:37 smithi044 bash[22676]: cluster 2024-09-21T03:01:36.542094+0000 mgr.a (mgr.14388) 12429 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:37 smithi044 bash[22676]: audit 2024-09-21T03:01:37.026999+0000 mon.a (mon.0) 10128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:37 smithi044 bash[22676]: audit 2024-09-21T03:01:37.035871+0000 mon.a (mon.0) 10129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:37 smithi044 bash[22676]: audit 2024-09-21T03:01:37.046627+0000 mon.a (mon.0) 10130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:37 smithi049 bash[23528]: cluster 2024-09-21T03:01:36.542094+0000 mgr.a (mgr.14388) 12429 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:37 smithi049 bash[23528]: audit 2024-09-21T03:01:37.026999+0000 mon.a (mon.0) 10128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:37 smithi049 bash[23528]: audit 2024-09-21T03:01:37.035871+0000 mon.a (mon.0) 10129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:37 smithi049 bash[23528]: audit 2024-09-21T03:01:37.046627+0000 mon.a (mon.0) 10130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:39.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:39.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:39.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:39 smithi179 bash[23186]: cluster 2024-09-21T03:01:38.542863+0000 mgr.a (mgr.14388) 12430 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:40.108 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:40.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:40.132 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:39 smithi044 bash[22676]: cluster 2024-09-21T03:01:38.542863+0000 mgr.a (mgr.14388) 12430 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:39 smithi049 bash[23528]: cluster 2024-09-21T03:01:38.542863+0000 mgr.a (mgr.14388) 12430 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:40 smithi179 bash[23186]: audit 2024-09-21T03:01:39.652705+0000 mgr.a (mgr.14388) 12431 : audit [DBG] from='client.271698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:40 smithi044 bash[22676]: audit 2024-09-21T03:01:39.652705+0000 mgr.a (mgr.14388) 12431 : audit [DBG] from='client.271698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:40 smithi049 bash[23528]: audit 2024-09-21T03:01:39.652705+0000 mgr.a (mgr.14388) 12431 : audit [DBG] from='client.271698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:41 smithi044 bash[22676]: cluster 2024-09-21T03:01:40.544256+0000 mgr.a (mgr.14388) 12432 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:41 smithi179 bash[23186]: cluster 2024-09-21T03:01:40.544256+0000 mgr.a (mgr.14388) 12432 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:41 smithi049 bash[23528]: cluster 2024-09-21T03:01:40.544256+0000 mgr.a (mgr.14388) 12432 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:42 smithi044 bash[22676]: cluster 2024-09-21T03:01:42.544791+0000 mgr.a (mgr.14388) 12433 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:01:43.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:42 smithi179 bash[23186]: cluster 2024-09-21T03:01:42.544791+0000 mgr.a (mgr.14388) 12433 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:01:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:42 smithi049 bash[23528]: cluster 2024-09-21T03:01:42.544791+0000 mgr.a (mgr.14388) 12433 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:01:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:45.860 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:45 smithi049 bash[23528]: cluster 2024-09-21T03:01:44.545566+0000 mgr.a (mgr.14388) 12434 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:01:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:45.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:45.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:45.876 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:45 smithi044 bash[22676]: cluster 2024-09-21T03:01:44.545566+0000 mgr.a (mgr.14388) 12434 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:01:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:45 smithi179 bash[23186]: cluster 2024-09-21T03:01:44.545566+0000 mgr.a (mgr.14388) 12434 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:01:46.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:46 smithi044 bash[22676]: audit 2024-09-21T03:01:45.446666+0000 mgr.a (mgr.14388) 12435 : audit [DBG] from='client.271776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:47.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:46 smithi179 bash[23186]: audit 2024-09-21T03:01:45.446666+0000 mgr.a (mgr.14388) 12435 : audit [DBG] from='client.271776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:47.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:46 smithi049 bash[23528]: audit 2024-09-21T03:01:45.446666+0000 mgr.a (mgr.14388) 12435 : audit [DBG] from='client.271776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:47 smithi044 bash[22676]: cluster 2024-09-21T03:01:46.548439+0000 mgr.a (mgr.14388) 12436 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:47 smithi179 bash[23186]: cluster 2024-09-21T03:01:46.548439+0000 mgr.a (mgr.14388) 12436 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:48.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:47 smithi049 bash[23528]: cluster 2024-09-21T03:01:46.548439+0000 mgr.a (mgr.14388) 12436 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:01:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:49 smithi044 bash[22676]: cluster 2024-09-21T03:01:48.549289+0000 mgr.a (mgr.14388) 12437 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:49 smithi179 bash[23186]: cluster 2024-09-21T03:01:48.549289+0000 mgr.a (mgr.14388) 12437 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:49 smithi049 bash[23528]: cluster 2024-09-21T03:01:48.549289+0000 mgr.a (mgr.14388) 12437 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:01:50.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:50.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:50.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:50 smithi179 bash[23186]: audit 2024-09-21T03:01:49.991806+0000 mon.a (mon.0) 10131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:50 smithi179 bash[23186]: audit 2024-09-21T03:01:50.003112+0000 mon.a (mon.0) 10132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:50 smithi179 bash[23186]: audit 2024-09-21T03:01:50.016307+0000 mon.a (mon.0) 10133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:50 smithi179 bash[23186]: audit 2024-09-21T03:01:50.035942+0000 mon.a (mon.0) 10134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:50 smithi179 bash[23186]: audit 2024-09-21T03:01:50.044927+0000 mon.a (mon.0) 10135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:50 smithi179 bash[23186]: audit 2024-09-21T03:01:50.056217+0000 mon.a (mon.0) 10136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:50 smithi179 bash[23186]: cluster 2024-09-21T03:01:50.551474+0000 mgr.a (mgr.14388) 12438 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:50 smithi049 bash[23528]: audit 2024-09-21T03:01:49.991806+0000 mon.a (mon.0) 10131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:50 smithi049 bash[23528]: audit 2024-09-21T03:01:50.003112+0000 mon.a (mon.0) 10132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:50 smithi049 bash[23528]: audit 2024-09-21T03:01:50.016307+0000 mon.a (mon.0) 10133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:50 smithi049 bash[23528]: audit 2024-09-21T03:01:50.035942+0000 mon.a (mon.0) 10134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:50 smithi049 bash[23528]: audit 2024-09-21T03:01:50.044927+0000 mon.a (mon.0) 10135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:50 smithi049 bash[23528]: audit 2024-09-21T03:01:50.056217+0000 mon.a (mon.0) 10136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:50 smithi049 bash[23528]: cluster 2024-09-21T03:01:50.551474+0000 mgr.a (mgr.14388) 12438 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:51.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:50 smithi044 bash[22676]: audit 2024-09-21T03:01:49.991806+0000 mon.a (mon.0) 10131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:50 smithi044 bash[22676]: audit 2024-09-21T03:01:50.003112+0000 mon.a (mon.0) 10132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:50 smithi044 bash[22676]: audit 2024-09-21T03:01:50.016307+0000 mon.a (mon.0) 10133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:50 smithi044 bash[22676]: audit 2024-09-21T03:01:50.035942+0000 mon.a (mon.0) 10134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:50 smithi044 bash[22676]: audit 2024-09-21T03:01:50.044927+0000 mon.a (mon.0) 10135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:50 smithi044 bash[22676]: audit 2024-09-21T03:01:50.056217+0000 mon.a (mon.0) 10136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:50 smithi044 bash[22676]: cluster 2024-09-21T03:01:50.551474+0000 mgr.a (mgr.14388) 12438 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:01:51.651 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:51.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:51.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:51.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:51.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:52.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:52 smithi044 bash[22676]: audit 2024-09-21T03:01:51.215886+0000 mgr.a (mgr.14388) 12439 : audit [DBG] from='client.271854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:52.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:52 smithi179 bash[23186]: audit 2024-09-21T03:01:51.215886+0000 mgr.a (mgr.14388) 12439 : audit [DBG] from='client.271854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:52 smithi049 bash[23528]: audit 2024-09-21T03:01:51.215886+0000 mgr.a (mgr.14388) 12439 : audit [DBG] from='client.271854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:53.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:53 smithi044 bash[22676]: cluster 2024-09-21T03:01:52.552498+0000 mgr.a (mgr.14388) 12440 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:01:53.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:53 smithi179 bash[23186]: cluster 2024-09-21T03:01:52.552498+0000 mgr.a (mgr.14388) 12440 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:01:53.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:53 smithi049 bash[23528]: cluster 2024-09-21T03:01:52.552498+0000 mgr.a (mgr.14388) 12440 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:01:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:55 smithi044 bash[22676]: cluster 2024-09-21T03:01:54.553359+0000 mgr.a (mgr.14388) 12441 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:01:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:55 smithi179 bash[23186]: cluster 2024-09-21T03:01:54.553359+0000 mgr.a (mgr.14388) 12441 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:01:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:55 smithi049 bash[23528]: cluster 2024-09-21T03:01:54.553359+0000 mgr.a (mgr.14388) 12441 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:01:56.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:01:56.654 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:01:56.654 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:01:57.428 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:01:57.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:01:57.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:01:57.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:01:57.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:01:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:57 smithi044 bash[22676]: cluster 2024-09-21T03:01:56.555722+0000 mgr.a (mgr.14388) 12442 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:01:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:57 smithi044 bash[22676]: audit 2024-09-21T03:01:57.246396+0000 mon.a (mon.0) 10137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:57 smithi044 bash[22676]: audit 2024-09-21T03:01:57.252507+0000 mon.a (mon.0) 10138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:57 smithi044 bash[22676]: audit 2024-09-21T03:01:57.258351+0000 mon.a (mon.0) 10139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:57 smithi179 bash[23186]: cluster 2024-09-21T03:01:56.555722+0000 mgr.a (mgr.14388) 12442 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:01:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:57 smithi179 bash[23186]: audit 2024-09-21T03:01:57.246396+0000 mon.a (mon.0) 10137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:57 smithi179 bash[23186]: audit 2024-09-21T03:01:57.252507+0000 mon.a (mon.0) 10138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:57 smithi179 bash[23186]: audit 2024-09-21T03:01:57.258351+0000 mon.a (mon.0) 10139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:57 smithi049 bash[23528]: cluster 2024-09-21T03:01:56.555722+0000 mgr.a (mgr.14388) 12442 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:01:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:57 smithi049 bash[23528]: audit 2024-09-21T03:01:57.246396+0000 mon.a (mon.0) 10137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:57 smithi049 bash[23528]: audit 2024-09-21T03:01:57.252507+0000 mon.a (mon.0) 10138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:57 smithi049 bash[23528]: audit 2024-09-21T03:01:57.258351+0000 mon.a (mon.0) 10139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:01:58.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:58 smithi044 bash[22676]: audit 2024-09-21T03:01:56.990509+0000 mgr.a (mgr.14388) 12443 : audit [DBG] from='client.271923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:59.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:58 smithi179 bash[23186]: audit 2024-09-21T03:01:56.990509+0000 mgr.a (mgr.14388) 12443 : audit [DBG] from='client.271923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:59.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:58 smithi049 bash[23528]: audit 2024-09-21T03:01:56.990509+0000 mgr.a (mgr.14388) 12443 : audit [DBG] from='client.271923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:01:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:01:59 smithi044 bash[22676]: cluster 2024-09-21T03:01:58.556527+0000 mgr.a (mgr.14388) 12444 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:01:59 smithi179 bash[23186]: cluster 2024-09-21T03:01:58.556527+0000 mgr.a (mgr.14388) 12444 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:01:59 smithi049 bash[23528]: cluster 2024-09-21T03:01:58.556527+0000 mgr.a (mgr.14388) 12444 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:01.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:01 smithi179 bash[23186]: cluster 2024-09-21T03:02:00.557779+0000 mgr.a (mgr.14388) 12445 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:01 smithi044 bash[22676]: cluster 2024-09-21T03:02:00.557779+0000 mgr.a (mgr.14388) 12445 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:01 smithi049 bash[23528]: cluster 2024-09-21T03:02:00.557779+0000 mgr.a (mgr.14388) 12445 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:02.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:03.181 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:03 smithi044 bash[22676]: cluster 2024-09-21T03:02:02.558317+0000 mgr.a (mgr.14388) 12446 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:03 smithi044 bash[22676]: audit 2024-09-21T03:02:02.753145+0000 mgr.a (mgr.14388) 12447 : audit [DBG] from='client.272001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:03 smithi179 bash[23186]: cluster 2024-09-21T03:02:02.558317+0000 mgr.a (mgr.14388) 12446 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:03 smithi179 bash[23186]: audit 2024-09-21T03:02:02.753145+0000 mgr.a (mgr.14388) 12447 : audit [DBG] from='client.272001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:03 smithi049 bash[23528]: cluster 2024-09-21T03:02:02.558317+0000 mgr.a (mgr.14388) 12446 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:03 smithi049 bash[23528]: audit 2024-09-21T03:02:02.753145+0000 mgr.a (mgr.14388) 12447 : audit [DBG] from='client.272001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:05 smithi044 bash[22676]: cluster 2024-09-21T03:02:04.559160+0000 mgr.a (mgr.14388) 12448 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:05 smithi179 bash[23186]: cluster 2024-09-21T03:02:04.559160+0000 mgr.a (mgr.14388) 12448 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:05 smithi049 bash[23528]: cluster 2024-09-21T03:02:04.559160+0000 mgr.a (mgr.14388) 12448 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:07 smithi044 bash[22676]: cluster 2024-09-21T03:02:06.561413+0000 mgr.a (mgr.14388) 12449 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:07 smithi179 bash[23186]: cluster 2024-09-21T03:02:06.561413+0000 mgr.a (mgr.14388) 12449 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:07 smithi049 bash[23528]: cluster 2024-09-21T03:02:06.561413+0000 mgr.a (mgr.14388) 12449 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:08.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:08.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:08.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:08.936 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:09 smithi044 bash[22676]: audit 2024-09-21T03:02:08.514725+0000 mgr.a (mgr.14388) 12450 : audit [DBG] from='client.272079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:09 smithi044 bash[22676]: cluster 2024-09-21T03:02:08.562198+0000 mgr.a (mgr.14388) 12451 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:09 smithi179 bash[23186]: audit 2024-09-21T03:02:08.514725+0000 mgr.a (mgr.14388) 12450 : audit [DBG] from='client.272079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:09 smithi179 bash[23186]: cluster 2024-09-21T03:02:08.562198+0000 mgr.a (mgr.14388) 12451 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:09 smithi049 bash[23528]: audit 2024-09-21T03:02:08.514725+0000 mgr.a (mgr.14388) 12450 : audit [DBG] from='client.272079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:09 smithi049 bash[23528]: cluster 2024-09-21T03:02:08.562198+0000 mgr.a (mgr.14388) 12451 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:11 smithi044 bash[22676]: audit 2024-09-21T03:02:10.221271+0000 mon.a (mon.0) 10140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:11 smithi044 bash[22676]: audit 2024-09-21T03:02:10.228729+0000 mon.a (mon.0) 10141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:11 smithi044 bash[22676]: audit 2024-09-21T03:02:10.238241+0000 mon.a (mon.0) 10142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:11 smithi044 bash[22676]: audit 2024-09-21T03:02:10.252247+0000 mon.a (mon.0) 10143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:11 smithi044 bash[22676]: audit 2024-09-21T03:02:10.259184+0000 mon.a (mon.0) 10144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:11 smithi044 bash[22676]: audit 2024-09-21T03:02:10.268715+0000 mon.a (mon.0) 10145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:11 smithi044 bash[22676]: cluster 2024-09-21T03:02:10.564517+0000 mgr.a (mgr.14388) 12452 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:11 smithi179 bash[23186]: audit 2024-09-21T03:02:10.221271+0000 mon.a (mon.0) 10140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:11 smithi179 bash[23186]: audit 2024-09-21T03:02:10.228729+0000 mon.a (mon.0) 10141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:11 smithi179 bash[23186]: audit 2024-09-21T03:02:10.238241+0000 mon.a (mon.0) 10142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:11 smithi179 bash[23186]: audit 2024-09-21T03:02:10.252247+0000 mon.a (mon.0) 10143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:11 smithi179 bash[23186]: audit 2024-09-21T03:02:10.259184+0000 mon.a (mon.0) 10144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:11 smithi179 bash[23186]: audit 2024-09-21T03:02:10.268715+0000 mon.a (mon.0) 10145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:11 smithi179 bash[23186]: cluster 2024-09-21T03:02:10.564517+0000 mgr.a (mgr.14388) 12452 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:11 smithi049 bash[23528]: audit 2024-09-21T03:02:10.221271+0000 mon.a (mon.0) 10140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:11 smithi049 bash[23528]: audit 2024-09-21T03:02:10.228729+0000 mon.a (mon.0) 10141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:11 smithi049 bash[23528]: audit 2024-09-21T03:02:10.238241+0000 mon.a (mon.0) 10142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:11 smithi049 bash[23528]: audit 2024-09-21T03:02:10.252247+0000 mon.a (mon.0) 10143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:11 smithi049 bash[23528]: audit 2024-09-21T03:02:10.259184+0000 mon.a (mon.0) 10144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:11 smithi049 bash[23528]: audit 2024-09-21T03:02:10.268715+0000 mon.a (mon.0) 10145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:11 smithi049 bash[23528]: cluster 2024-09-21T03:02:10.564517+0000 mgr.a (mgr.14388) 12452 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:13.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:13.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:13.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:13 smithi044 bash[22676]: cluster 2024-09-21T03:02:12.565290+0000 mgr.a (mgr.14388) 12453 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:13 smithi179 bash[23186]: cluster 2024-09-21T03:02:12.565290+0000 mgr.a (mgr.14388) 12453 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:13 smithi049 bash[23528]: cluster 2024-09-21T03:02:12.565290+0000 mgr.a (mgr.14388) 12453 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:14.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:14.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:14.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:14.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:14.712 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:15 smithi044 bash[22676]: audit 2024-09-21T03:02:14.271038+0000 mgr.a (mgr.14388) 12454 : audit [DBG] from='client.272157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:15 smithi044 bash[22676]: cluster 2024-09-21T03:02:14.565814+0000 mgr.a (mgr.14388) 12455 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:15 smithi179 bash[23186]: audit 2024-09-21T03:02:14.271038+0000 mgr.a (mgr.14388) 12454 : audit [DBG] from='client.272157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:15 smithi179 bash[23186]: cluster 2024-09-21T03:02:14.565814+0000 mgr.a (mgr.14388) 12455 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:15 smithi049 bash[23528]: audit 2024-09-21T03:02:14.271038+0000 mgr.a (mgr.14388) 12454 : audit [DBG] from='client.272157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:15 smithi049 bash[23528]: cluster 2024-09-21T03:02:14.565814+0000 mgr.a (mgr.14388) 12455 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:17 smithi049 bash[23528]: cluster 2024-09-21T03:02:16.568174+0000 mgr.a (mgr.14388) 12456 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:17 smithi049 bash[23528]: audit 2024-09-21T03:02:17.435466+0000 mon.a (mon.0) 10146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:17 smithi049 bash[23528]: audit 2024-09-21T03:02:17.444225+0000 mon.a (mon.0) 10147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:17 smithi049 bash[23528]: audit 2024-09-21T03:02:17.456229+0000 mon.a (mon.0) 10148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:17 smithi044 bash[22676]: cluster 2024-09-21T03:02:16.568174+0000 mgr.a (mgr.14388) 12456 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:17 smithi044 bash[22676]: audit 2024-09-21T03:02:17.435466+0000 mon.a (mon.0) 10146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:17 smithi044 bash[22676]: audit 2024-09-21T03:02:17.444225+0000 mon.a (mon.0) 10147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:17 smithi044 bash[22676]: audit 2024-09-21T03:02:17.456229+0000 mon.a (mon.0) 10148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:17 smithi179 bash[23186]: cluster 2024-09-21T03:02:16.568174+0000 mgr.a (mgr.14388) 12456 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:17 smithi179 bash[23186]: audit 2024-09-21T03:02:17.435466+0000 mon.a (mon.0) 10146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:17 smithi179 bash[23186]: audit 2024-09-21T03:02:17.444225+0000 mon.a (mon.0) 10147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:18.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:17 smithi179 bash[23186]: audit 2024-09-21T03:02:17.456229+0000 mon.a (mon.0) 10148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:19.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:19 smithi179 bash[23186]: cluster 2024-09-21T03:02:18.568959+0000 mgr.a (mgr.14388) 12457 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:19.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:19 smithi044 bash[22676]: cluster 2024-09-21T03:02:18.568959+0000 mgr.a (mgr.14388) 12457 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:19 smithi049 bash[23528]: cluster 2024-09-21T03:02:18.568959+0000 mgr.a (mgr.14388) 12457 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:20.484 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:20.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:20.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:20.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:20.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:21.906 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:21 smithi179 bash[23186]: audit 2024-09-21T03:02:20.044910+0000 mgr.a (mgr.14388) 12458 : audit [DBG] from='client.272232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:21.906 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:21 smithi179 bash[23186]: cluster 2024-09-21T03:02:20.571739+0000 mgr.a (mgr.14388) 12459 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:21 smithi044 bash[22676]: audit 2024-09-21T03:02:20.044910+0000 mgr.a (mgr.14388) 12458 : audit [DBG] from='client.272232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:21 smithi044 bash[22676]: cluster 2024-09-21T03:02:20.571739+0000 mgr.a (mgr.14388) 12459 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:21 smithi049 bash[23528]: audit 2024-09-21T03:02:20.044910+0000 mgr.a (mgr.14388) 12458 : audit [DBG] from='client.272232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:21 smithi049 bash[23528]: cluster 2024-09-21T03:02:20.571739+0000 mgr.a (mgr.14388) 12459 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:23.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:23 smithi044 bash[22676]: cluster 2024-09-21T03:02:22.572239+0000 mgr.a (mgr.14388) 12460 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:24.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:23 smithi179 bash[23186]: cluster 2024-09-21T03:02:22.572239+0000 mgr.a (mgr.14388) 12460 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:23 smithi049 bash[23528]: cluster 2024-09-21T03:02:22.572239+0000 mgr.a (mgr.14388) 12460 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:25.485 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:25 smithi044 bash[22676]: cluster 2024-09-21T03:02:24.572961+0000 mgr.a (mgr.14388) 12461 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:02:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:25 smithi179 bash[23186]: cluster 2024-09-21T03:02:24.572961+0000 mgr.a (mgr.14388) 12461 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:02:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:25 smithi049 bash[23528]: cluster 2024-09-21T03:02:24.572961+0000 mgr.a (mgr.14388) 12461 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:02:26.279 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:26.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:26.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:26.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:26.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:26.874 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:26 smithi049 bash[23528]: audit 2024-09-21T03:02:25.827826+0000 mgr.a (mgr.14388) 12462 : audit [DBG] from='client.272307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:26.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:26 smithi044 bash[22676]: audit 2024-09-21T03:02:25.827826+0000 mgr.a (mgr.14388) 12462 : audit [DBG] from='client.272307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:26 smithi179 bash[23186]: audit 2024-09-21T03:02:25.827826+0000 mgr.a (mgr.14388) 12462 : audit [DBG] from='client.272307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:27 smithi049 bash[23528]: cluster 2024-09-21T03:02:26.575903+0000 mgr.a (mgr.14388) 12463 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:27 smithi044 bash[22676]: cluster 2024-09-21T03:02:26.575903+0000 mgr.a (mgr.14388) 12463 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:28.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:27 smithi179 bash[23186]: cluster 2024-09-21T03:02:26.575903+0000 mgr.a (mgr.14388) 12463 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:29 smithi044 bash[22676]: cluster 2024-09-21T03:02:28.576701+0000 mgr.a (mgr.14388) 12464 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:29 smithi179 bash[23186]: cluster 2024-09-21T03:02:28.576701+0000 mgr.a (mgr.14388) 12464 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:29 smithi049 bash[23528]: cluster 2024-09-21T03:02:28.576701+0000 mgr.a (mgr.14388) 12464 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:31.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:31.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:31.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:30.430703+0000 mon.a (mon.0) 10149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:30.438816+0000 mon.a (mon.0) 10150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:30.450034+0000 mon.a (mon.0) 10151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:30.481211+0000 mon.a (mon.0) 10152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:30.489906+0000 mon.a (mon.0) 10153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:30.499745+0000 mon.a (mon.0) 10154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: cluster 2024-09-21T03:02:30.578746+0000 mgr.a (mgr.14388) 12465 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:31.099399+0000 mon.a (mon.0) 10155 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:31.105774+0000 mon.a (mon.0) 10156 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:31.107634+0000 mon.a (mon.0) 10157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:31.118791+0000 mon.a (mon.0) 10158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22676]: audit 2024-09-21T03:02:31.125594+0000 mon.a (mon.0) 10159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:30.430703+0000 mon.a (mon.0) 10149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:30.438816+0000 mon.a (mon.0) 10150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:30.450034+0000 mon.a (mon.0) 10151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:30.481211+0000 mon.a (mon.0) 10152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:30.489906+0000 mon.a (mon.0) 10153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:30.499745+0000 mon.a (mon.0) 10154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: cluster 2024-09-21T03:02:30.578746+0000 mgr.a (mgr.14388) 12465 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:31.099399+0000 mon.a (mon.0) 10155 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:02:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:31.105774+0000 mon.a (mon.0) 10156 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:02:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:31.107634+0000 mon.a (mon.0) 10157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:02:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:31.118791+0000 mon.a (mon.0) 10158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:31 smithi179 bash[23186]: audit 2024-09-21T03:02:31.125594+0000 mon.a (mon.0) 10159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:02:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:30.430703+0000 mon.a (mon.0) 10149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:30.438816+0000 mon.a (mon.0) 10150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:30.450034+0000 mon.a (mon.0) 10151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:30.481211+0000 mon.a (mon.0) 10152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:30.489906+0000 mon.a (mon.0) 10153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:30.499745+0000 mon.a (mon.0) 10154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: cluster 2024-09-21T03:02:30.578746+0000 mgr.a (mgr.14388) 12465 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:31.099399+0000 mon.a (mon.0) 10155 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:31.105774+0000 mon.a (mon.0) 10156 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:31.107634+0000 mon.a (mon.0) 10157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:31.118791+0000 mon.a (mon.0) 10158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:31 smithi049 bash[23528]: audit 2024-09-21T03:02:31.125594+0000 mon.a (mon.0) 10159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:02:32.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22930]: debug 2024-09-21T03:02:31.930+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:02:32.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:02:31 smithi044 bash[22930]: debug 2024-09-21T03:02:31.942+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:02:32.354 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:32 smithi049 bash[23528]: audit 2024-09-21T03:02:31.127935+0000 mgr.a (mgr.14388) 12466 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:02:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:32 smithi049 bash[23528]: audit 2024-09-21T03:02:31.631889+0000 mgr.a (mgr.14388) 12467 : audit [DBG] from='client.272421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:32 smithi044 bash[22676]: audit 2024-09-21T03:02:31.127935+0000 mgr.a (mgr.14388) 12466 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:02:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:32 smithi044 bash[22676]: audit 2024-09-21T03:02:31.631889+0000 mgr.a (mgr.14388) 12467 : audit [DBG] from='client.272421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:32 smithi179 bash[23186]: audit 2024-09-21T03:02:31.127935+0000 mgr.a (mgr.14388) 12466 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:02:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:32 smithi179 bash[23186]: audit 2024-09-21T03:02:31.631889+0000 mgr.a (mgr.14388) 12467 : audit [DBG] from='client.272421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:33 smithi049 bash[23528]: audit 2024-09-21T03:02:31.936600+0000 mgr.a (mgr.14388) 12468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:02:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:33 smithi049 bash[23528]: cephadm 2024-09-21T03:02:31.949243+0000 mgr.a (mgr.14388) 12469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:02:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:33 smithi049 bash[23528]: cluster 2024-09-21T03:02:32.579738+0000 mgr.a (mgr.14388) 12470 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:33 smithi044 bash[22676]: audit 2024-09-21T03:02:31.936600+0000 mgr.a (mgr.14388) 12468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:02:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:33 smithi044 bash[22676]: cephadm 2024-09-21T03:02:31.949243+0000 mgr.a (mgr.14388) 12469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:02:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:33 smithi044 bash[22676]: cluster 2024-09-21T03:02:32.579738+0000 mgr.a (mgr.14388) 12470 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:33 smithi179 bash[23186]: audit 2024-09-21T03:02:31.936600+0000 mgr.a (mgr.14388) 12468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:02:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:33 smithi179 bash[23186]: cephadm 2024-09-21T03:02:31.949243+0000 mgr.a (mgr.14388) 12469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:02:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:33 smithi179 bash[23186]: cluster 2024-09-21T03:02:32.579738+0000 mgr.a (mgr.14388) 12470 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:35 smithi044 bash[22676]: cluster 2024-09-21T03:02:34.580542+0000 mgr.a (mgr.14388) 12471 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:35 smithi179 bash[23186]: cluster 2024-09-21T03:02:34.580542+0000 mgr.a (mgr.14388) 12471 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:35 smithi049 bash[23528]: cluster 2024-09-21T03:02:34.580542+0000 mgr.a (mgr.14388) 12471 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:37.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:37.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:37.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:37 smithi044 bash[22676]: cluster 2024-09-21T03:02:36.582808+0000 mgr.a (mgr.14388) 12472 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:37 smithi179 bash[23186]: cluster 2024-09-21T03:02:36.582808+0000 mgr.a (mgr.14388) 12472 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:37 smithi049 bash[23528]: cluster 2024-09-21T03:02:36.582808+0000 mgr.a (mgr.14388) 12472 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:38.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:38.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:38.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:38.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:38.151 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:38 smithi044 bash[22676]: audit 2024-09-21T03:02:37.670753+0000 mon.a (mon.0) 10160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:38 smithi044 bash[22676]: audit 2024-09-21T03:02:37.678745+0000 mon.a (mon.0) 10161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:38 smithi044 bash[22676]: audit 2024-09-21T03:02:37.688962+0000 mon.a (mon.0) 10162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:38 smithi044 bash[22676]: audit 2024-09-21T03:02:37.693638+0000 mgr.a (mgr.14388) 12473 : audit [DBG] from='client.272571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:38 smithi179 bash[23186]: audit 2024-09-21T03:02:37.670753+0000 mon.a (mon.0) 10160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:38 smithi179 bash[23186]: audit 2024-09-21T03:02:37.678745+0000 mon.a (mon.0) 10161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:38 smithi179 bash[23186]: audit 2024-09-21T03:02:37.688962+0000 mon.a (mon.0) 10162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:38 smithi179 bash[23186]: audit 2024-09-21T03:02:37.693638+0000 mgr.a (mgr.14388) 12473 : audit [DBG] from='client.272571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:38 smithi049 bash[23528]: audit 2024-09-21T03:02:37.670753+0000 mon.a (mon.0) 10160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:38 smithi049 bash[23528]: audit 2024-09-21T03:02:37.678745+0000 mon.a (mon.0) 10161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:38 smithi049 bash[23528]: audit 2024-09-21T03:02:37.688962+0000 mon.a (mon.0) 10162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:38 smithi049 bash[23528]: audit 2024-09-21T03:02:37.693638+0000 mgr.a (mgr.14388) 12473 : audit [DBG] from='client.272571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:39.959 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:39 smithi179 bash[23186]: cluster 2024-09-21T03:02:38.583782+0000 mgr.a (mgr.14388) 12474 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:39 smithi044 bash[22676]: cluster 2024-09-21T03:02:38.583782+0000 mgr.a (mgr.14388) 12474 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:39 smithi049 bash[23528]: cluster 2024-09-21T03:02:38.583782+0000 mgr.a (mgr.14388) 12474 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:41 smithi044 bash[22676]: cluster 2024-09-21T03:02:40.585543+0000 mgr.a (mgr.14388) 12475 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:42.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:41 smithi179 bash[23186]: cluster 2024-09-21T03:02:40.585543+0000 mgr.a (mgr.14388) 12475 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:41 smithi049 bash[23528]: cluster 2024-09-21T03:02:40.585543+0000 mgr.a (mgr.14388) 12475 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:43.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:43.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:43.153 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:43.910 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:43 smithi044 bash[22676]: cluster 2024-09-21T03:02:42.586291+0000 mgr.a (mgr.14388) 12476 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:43 smithi179 bash[23186]: cluster 2024-09-21T03:02:42.586291+0000 mgr.a (mgr.14388) 12476 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:43 smithi049 bash[23528]: cluster 2024-09-21T03:02:42.586291+0000 mgr.a (mgr.14388) 12476 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:44.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:44 smithi044 bash[22676]: audit 2024-09-21T03:02:43.475240+0000 mgr.a (mgr.14388) 12477 : audit [DBG] from='client.272646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:45.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:44 smithi179 bash[23186]: audit 2024-09-21T03:02:43.475240+0000 mgr.a (mgr.14388) 12477 : audit [DBG] from='client.272646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:44 smithi049 bash[23528]: audit 2024-09-21T03:02:43.475240+0000 mgr.a (mgr.14388) 12477 : audit [DBG] from='client.272646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:45.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:45 smithi044 bash[22676]: cluster 2024-09-21T03:02:44.587250+0000 mgr.a (mgr.14388) 12478 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:46.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:45 smithi179 bash[23186]: cluster 2024-09-21T03:02:44.587250+0000 mgr.a (mgr.14388) 12478 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:45 smithi049 bash[23528]: cluster 2024-09-21T03:02:44.587250+0000 mgr.a (mgr.14388) 12478 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:47 smithi044 bash[22676]: cluster 2024-09-21T03:02:46.589520+0000 mgr.a (mgr.14388) 12479 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:47 smithi179 bash[23186]: cluster 2024-09-21T03:02:46.589520+0000 mgr.a (mgr.14388) 12479 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:47 smithi049 bash[23528]: cluster 2024-09-21T03:02:46.589520+0000 mgr.a (mgr.14388) 12479 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:02:48.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:49.701 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:49.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:49.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:49.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:49.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:49 smithi044 bash[22676]: cluster 2024-09-21T03:02:48.590296+0000 mgr.a (mgr.14388) 12480 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:50.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:49 smithi179 bash[23186]: cluster 2024-09-21T03:02:48.590296+0000 mgr.a (mgr.14388) 12480 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:49 smithi049 bash[23528]: cluster 2024-09-21T03:02:48.590296+0000 mgr.a (mgr.14388) 12480 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:50 smithi044 bash[22676]: audit 2024-09-21T03:02:49.249796+0000 mgr.a (mgr.14388) 12481 : audit [DBG] from='client.272724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:50 smithi044 bash[22676]: audit 2024-09-21T03:02:50.674987+0000 mon.a (mon.0) 10163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:50 smithi044 bash[22676]: audit 2024-09-21T03:02:50.686194+0000 mon.a (mon.0) 10164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:50 smithi044 bash[22676]: audit 2024-09-21T03:02:50.701194+0000 mon.a (mon.0) 10165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:50 smithi179 bash[23186]: audit 2024-09-21T03:02:49.249796+0000 mgr.a (mgr.14388) 12481 : audit [DBG] from='client.272724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:50 smithi179 bash[23186]: audit 2024-09-21T03:02:50.674987+0000 mon.a (mon.0) 10163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:50 smithi179 bash[23186]: audit 2024-09-21T03:02:50.686194+0000 mon.a (mon.0) 10164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:50 smithi179 bash[23186]: audit 2024-09-21T03:02:50.701194+0000 mon.a (mon.0) 10165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:50 smithi049 bash[23528]: audit 2024-09-21T03:02:49.249796+0000 mgr.a (mgr.14388) 12481 : audit [DBG] from='client.272724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:50 smithi049 bash[23528]: audit 2024-09-21T03:02:50.674987+0000 mon.a (mon.0) 10163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:50 smithi049 bash[23528]: audit 2024-09-21T03:02:50.686194+0000 mon.a (mon.0) 10164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:50 smithi049 bash[23528]: audit 2024-09-21T03:02:50.701194+0000 mon.a (mon.0) 10165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:51 smithi179 bash[23186]: cluster 2024-09-21T03:02:50.591930+0000 mgr.a (mgr.14388) 12482 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:51 smithi179 bash[23186]: audit 2024-09-21T03:02:50.724108+0000 mon.a (mon.0) 10166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:51 smithi179 bash[23186]: audit 2024-09-21T03:02:50.741326+0000 mon.a (mon.0) 10167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:51 smithi179 bash[23186]: audit 2024-09-21T03:02:50.752849+0000 mon.a (mon.0) 10168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:51 smithi049 bash[23528]: cluster 2024-09-21T03:02:50.591930+0000 mgr.a (mgr.14388) 12482 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:51 smithi049 bash[23528]: audit 2024-09-21T03:02:50.724108+0000 mon.a (mon.0) 10166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:51 smithi049 bash[23528]: audit 2024-09-21T03:02:50.741326+0000 mon.a (mon.0) 10167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:51 smithi049 bash[23528]: audit 2024-09-21T03:02:50.752849+0000 mon.a (mon.0) 10168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:51 smithi044 bash[22676]: cluster 2024-09-21T03:02:50.591930+0000 mgr.a (mgr.14388) 12482 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:02:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:51 smithi044 bash[22676]: audit 2024-09-21T03:02:50.724108+0000 mon.a (mon.0) 10166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:51 smithi044 bash[22676]: audit 2024-09-21T03:02:50.741326+0000 mon.a (mon.0) 10167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:51 smithi044 bash[22676]: audit 2024-09-21T03:02:50.752849+0000 mon.a (mon.0) 10168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:53 smithi179 bash[23186]: cluster 2024-09-21T03:02:52.592706+0000 mgr.a (mgr.14388) 12483 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:54.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:53 smithi049 bash[23528]: cluster 2024-09-21T03:02:52.592706+0000 mgr.a (mgr.14388) 12483 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:53 smithi044 bash[22676]: cluster 2024-09-21T03:02:52.592706+0000 mgr.a (mgr.14388) 12483 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:54.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:02:54.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:02:54.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:02:55.502 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:02:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:02:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:55 smithi179 bash[23186]: cluster 2024-09-21T03:02:54.593487+0000 mgr.a (mgr.14388) 12484 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:55 smithi049 bash[23528]: cluster 2024-09-21T03:02:54.593487+0000 mgr.a (mgr.14388) 12484 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:55 smithi044 bash[22676]: cluster 2024-09-21T03:02:54.593487+0000 mgr.a (mgr.14388) 12484 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:56 smithi049 bash[23528]: audit 2024-09-21T03:02:55.045680+0000 mgr.a (mgr.14388) 12485 : audit [DBG] from='client.272802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:57.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:56 smithi044 bash[22676]: audit 2024-09-21T03:02:55.045680+0000 mgr.a (mgr.14388) 12485 : audit [DBG] from='client.272802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:56 smithi179 bash[23186]: audit 2024-09-21T03:02:55.045680+0000 mgr.a (mgr.14388) 12485 : audit [DBG] from='client.272802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:02:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:57 smithi049 bash[23528]: cluster 2024-09-21T03:02:56.596175+0000 mgr.a (mgr.14388) 12486 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:57 smithi044 bash[22676]: cluster 2024-09-21T03:02:56.596175+0000 mgr.a (mgr.14388) 12486 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:57 smithi179 bash[23186]: cluster 2024-09-21T03:02:56.596175+0000 mgr.a (mgr.14388) 12486 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:02:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:58 smithi044 bash[22676]: audit 2024-09-21T03:02:57.904373+0000 mon.a (mon.0) 10169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:58 smithi044 bash[22676]: audit 2024-09-21T03:02:57.913069+0000 mon.a (mon.0) 10170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:58 smithi044 bash[22676]: audit 2024-09-21T03:02:57.923438+0000 mon.a (mon.0) 10171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:02:58 smithi044 bash[22676]: cluster 2024-09-21T03:02:58.596975+0000 mgr.a (mgr.14388) 12487 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:58 smithi179 bash[23186]: audit 2024-09-21T03:02:57.904373+0000 mon.a (mon.0) 10169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:58 smithi179 bash[23186]: audit 2024-09-21T03:02:57.913069+0000 mon.a (mon.0) 10170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:58 smithi179 bash[23186]: audit 2024-09-21T03:02:57.923438+0000 mon.a (mon.0) 10171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:02:58 smithi179 bash[23186]: cluster 2024-09-21T03:02:58.596975+0000 mgr.a (mgr.14388) 12487 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:02:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:58 smithi049 bash[23528]: audit 2024-09-21T03:02:57.904373+0000 mon.a (mon.0) 10169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:58 smithi049 bash[23528]: audit 2024-09-21T03:02:57.913069+0000 mon.a (mon.0) 10170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:58 smithi049 bash[23528]: audit 2024-09-21T03:02:57.923438+0000 mon.a (mon.0) 10171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:02:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:02:58 smithi049 bash[23528]: cluster 2024-09-21T03:02:58.596975+0000 mgr.a (mgr.14388) 12487 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:03:00.504 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:00.504 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:00.505 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:01.300 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:01.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:01 smithi044 bash[22676]: cluster 2024-09-21T03:03:00.598248+0000 mgr.a (mgr.14388) 12488 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:01 smithi044 bash[22676]: audit 2024-09-21T03:03:00.843747+0000 mgr.a (mgr.14388) 12489 : audit [DBG] from='client.272880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:01 smithi179 bash[23186]: cluster 2024-09-21T03:03:00.598248+0000 mgr.a (mgr.14388) 12488 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:01 smithi179 bash[23186]: audit 2024-09-21T03:03:00.843747+0000 mgr.a (mgr.14388) 12489 : audit [DBG] from='client.272880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:01 smithi049 bash[23528]: cluster 2024-09-21T03:03:00.598248+0000 mgr.a (mgr.14388) 12488 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:01 smithi049 bash[23528]: audit 2024-09-21T03:03:00.843747+0000 mgr.a (mgr.14388) 12489 : audit [DBG] from='client.272880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:03 smithi044 bash[22676]: cluster 2024-09-21T03:03:02.599055+0000 mgr.a (mgr.14388) 12490 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:03:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:03 smithi179 bash[23186]: cluster 2024-09-21T03:03:02.599055+0000 mgr.a (mgr.14388) 12490 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:03:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:03 smithi049 bash[23528]: cluster 2024-09-21T03:03:02.599055+0000 mgr.a (mgr.14388) 12490 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:03:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:05 smithi044 bash[22676]: cluster 2024-09-21T03:03:04.599823+0000 mgr.a (mgr.14388) 12491 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:03:06.001 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:05 smithi049 bash[23528]: cluster 2024-09-21T03:03:04.599823+0000 mgr.a (mgr.14388) 12491 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:03:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:05 smithi179 bash[23186]: cluster 2024-09-21T03:03:04.599823+0000 mgr.a (mgr.14388) 12491 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:03:06.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:06.303 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:07.058 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:07.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:07.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:07.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:07.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:07 smithi044 bash[22676]: cluster 2024-09-21T03:03:06.601950+0000 mgr.a (mgr.14388) 12492 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:07 smithi044 bash[22676]: audit 2024-09-21T03:03:06.629093+0000 mgr.a (mgr.14388) 12493 : audit [DBG] from='client.272958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:07 smithi179 bash[23186]: cluster 2024-09-21T03:03:06.601950+0000 mgr.a (mgr.14388) 12492 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:07 smithi179 bash[23186]: audit 2024-09-21T03:03:06.629093+0000 mgr.a (mgr.14388) 12493 : audit [DBG] from='client.272958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:07 smithi049 bash[23528]: cluster 2024-09-21T03:03:06.601950+0000 mgr.a (mgr.14388) 12492 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:07 smithi049 bash[23528]: audit 2024-09-21T03:03:06.629093+0000 mgr.a (mgr.14388) 12493 : audit [DBG] from='client.272958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:09 smithi044 bash[22676]: cluster 2024-09-21T03:03:08.602842+0000 mgr.a (mgr.14388) 12494 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:09 smithi179 bash[23186]: cluster 2024-09-21T03:03:08.602842+0000 mgr.a (mgr.14388) 12494 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:09 smithi049 bash[23528]: cluster 2024-09-21T03:03:08.602842+0000 mgr.a (mgr.14388) 12494 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:11 smithi044 bash[22676]: cluster 2024-09-21T03:03:10.605006+0000 mgr.a (mgr.14388) 12495 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:11 smithi044 bash[22676]: audit 2024-09-21T03:03:10.926791+0000 mon.a (mon.0) 10172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:11 smithi044 bash[22676]: audit 2024-09-21T03:03:10.935286+0000 mon.a (mon.0) 10173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:11 smithi044 bash[22676]: audit 2024-09-21T03:03:10.947288+0000 mon.a (mon.0) 10174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:11 smithi044 bash[22676]: audit 2024-09-21T03:03:10.970078+0000 mon.a (mon.0) 10175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:11 smithi044 bash[22676]: audit 2024-09-21T03:03:10.979737+0000 mon.a (mon.0) 10176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:11 smithi044 bash[22676]: audit 2024-09-21T03:03:10.991153+0000 mon.a (mon.0) 10177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:11 smithi179 bash[23186]: cluster 2024-09-21T03:03:10.605006+0000 mgr.a (mgr.14388) 12495 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:11 smithi179 bash[23186]: audit 2024-09-21T03:03:10.926791+0000 mon.a (mon.0) 10172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:11 smithi179 bash[23186]: audit 2024-09-21T03:03:10.935286+0000 mon.a (mon.0) 10173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:11 smithi179 bash[23186]: audit 2024-09-21T03:03:10.947288+0000 mon.a (mon.0) 10174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:11 smithi179 bash[23186]: audit 2024-09-21T03:03:10.970078+0000 mon.a (mon.0) 10175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:11 smithi179 bash[23186]: audit 2024-09-21T03:03:10.979737+0000 mon.a (mon.0) 10176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:11 smithi179 bash[23186]: audit 2024-09-21T03:03:10.991153+0000 mon.a (mon.0) 10177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:11 smithi049 bash[23528]: cluster 2024-09-21T03:03:10.605006+0000 mgr.a (mgr.14388) 12495 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:11 smithi049 bash[23528]: audit 2024-09-21T03:03:10.926791+0000 mon.a (mon.0) 10172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:11 smithi049 bash[23528]: audit 2024-09-21T03:03:10.935286+0000 mon.a (mon.0) 10173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:11 smithi049 bash[23528]: audit 2024-09-21T03:03:10.947288+0000 mon.a (mon.0) 10174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:11 smithi049 bash[23528]: audit 2024-09-21T03:03:10.970078+0000 mon.a (mon.0) 10175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:11 smithi049 bash[23528]: audit 2024-09-21T03:03:10.979737+0000 mon.a (mon.0) 10176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:11 smithi049 bash[23528]: audit 2024-09-21T03:03:10.991153+0000 mon.a (mon.0) 10177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:12.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:12.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:12.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:12.813 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:13 smithi044 bash[22676]: audit 2024-09-21T03:03:12.391817+0000 mgr.a (mgr.14388) 12496 : audit [DBG] from='client.273033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:13 smithi044 bash[22676]: cluster 2024-09-21T03:03:12.614366+0000 mgr.a (mgr.14388) 12497 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:13 smithi179 bash[23186]: audit 2024-09-21T03:03:12.391817+0000 mgr.a (mgr.14388) 12496 : audit [DBG] from='client.273033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:13 smithi179 bash[23186]: cluster 2024-09-21T03:03:12.614366+0000 mgr.a (mgr.14388) 12497 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:13 smithi049 bash[23528]: audit 2024-09-21T03:03:12.391817+0000 mgr.a (mgr.14388) 12496 : audit [DBG] from='client.273033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:13 smithi049 bash[23528]: cluster 2024-09-21T03:03:12.614366+0000 mgr.a (mgr.14388) 12497 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:15 smithi044 bash[22676]: cluster 2024-09-21T03:03:14.615277+0000 mgr.a (mgr.14388) 12498 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:16.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:15 smithi179 bash[23186]: cluster 2024-09-21T03:03:14.615277+0000 mgr.a (mgr.14388) 12498 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:15 smithi049 bash[23528]: cluster 2024-09-21T03:03:14.615277+0000 mgr.a (mgr.14388) 12498 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:17.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:17.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:17.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:17 smithi044 bash[22676]: cluster 2024-09-21T03:03:16.617539+0000 mgr.a (mgr.14388) 12499 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:17 smithi179 bash[23186]: cluster 2024-09-21T03:03:16.617539+0000 mgr.a (mgr.14388) 12499 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:17 smithi049 bash[23528]: cluster 2024-09-21T03:03:16.617539+0000 mgr.a (mgr.14388) 12499 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:18.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:18.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:18.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:18.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:18.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:19 smithi044 bash[22676]: audit 2024-09-21T03:03:18.128464+0000 mon.a (mon.0) 10178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:19 smithi044 bash[22676]: audit 2024-09-21T03:03:18.135465+0000 mon.a (mon.0) 10179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:19 smithi044 bash[22676]: audit 2024-09-21T03:03:18.144436+0000 mon.a (mon.0) 10180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:19 smithi044 bash[22676]: audit 2024-09-21T03:03:18.157491+0000 mgr.a (mgr.14388) 12500 : audit [DBG] from='client.273111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:19 smithi044 bash[22676]: cluster 2024-09-21T03:03:18.618277+0000 mgr.a (mgr.14388) 12501 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:19 smithi179 bash[23186]: audit 2024-09-21T03:03:18.128464+0000 mon.a (mon.0) 10178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:19 smithi179 bash[23186]: audit 2024-09-21T03:03:18.135465+0000 mon.a (mon.0) 10179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:19 smithi179 bash[23186]: audit 2024-09-21T03:03:18.144436+0000 mon.a (mon.0) 10180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:19 smithi179 bash[23186]: audit 2024-09-21T03:03:18.157491+0000 mgr.a (mgr.14388) 12500 : audit [DBG] from='client.273111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:19 smithi179 bash[23186]: cluster 2024-09-21T03:03:18.618277+0000 mgr.a (mgr.14388) 12501 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:19 smithi049 bash[23528]: audit 2024-09-21T03:03:18.128464+0000 mon.a (mon.0) 10178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:19 smithi049 bash[23528]: audit 2024-09-21T03:03:18.135465+0000 mon.a (mon.0) 10179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:19 smithi049 bash[23528]: audit 2024-09-21T03:03:18.144436+0000 mon.a (mon.0) 10180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:19 smithi049 bash[23528]: audit 2024-09-21T03:03:18.157491+0000 mgr.a (mgr.14388) 12500 : audit [DBG] from='client.273111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:19 smithi049 bash[23528]: cluster 2024-09-21T03:03:18.618277+0000 mgr.a (mgr.14388) 12501 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:21 smithi044 bash[22676]: cluster 2024-09-21T03:03:20.620459+0000 mgr.a (mgr.14388) 12502 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:21 smithi179 bash[23186]: cluster 2024-09-21T03:03:20.620459+0000 mgr.a (mgr.14388) 12502 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:21 smithi049 bash[23528]: cluster 2024-09-21T03:03:20.620459+0000 mgr.a (mgr.14388) 12502 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:23 smithi044 bash[22676]: cluster 2024-09-21T03:03:22.621287+0000 mgr.a (mgr.14388) 12503 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:24.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:23 smithi179 bash[23186]: cluster 2024-09-21T03:03:22.621287+0000 mgr.a (mgr.14388) 12503 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:23 smithi049 bash[23528]: cluster 2024-09-21T03:03:22.621287+0000 mgr.a (mgr.14388) 12503 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:24.336 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:24.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:25 smithi044 bash[22676]: audit 2024-09-21T03:03:23.911086+0000 mgr.a (mgr.14388) 12504 : audit [DBG] from='client.273189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:25 smithi044 bash[22676]: cluster 2024-09-21T03:03:24.622169+0000 mgr.a (mgr.14388) 12505 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:26.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:25 smithi179 bash[23186]: audit 2024-09-21T03:03:23.911086+0000 mgr.a (mgr.14388) 12504 : audit [DBG] from='client.273189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:25 smithi179 bash[23186]: cluster 2024-09-21T03:03:24.622169+0000 mgr.a (mgr.14388) 12505 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:25 smithi049 bash[23528]: audit 2024-09-21T03:03:23.911086+0000 mgr.a (mgr.14388) 12504 : audit [DBG] from='client.273189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:25 smithi049 bash[23528]: cluster 2024-09-21T03:03:24.622169+0000 mgr.a (mgr.14388) 12505 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:27.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:27 smithi044 bash[22676]: cluster 2024-09-21T03:03:26.624424+0000 mgr.a (mgr.14388) 12506 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:28.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:27 smithi179 bash[23186]: cluster 2024-09-21T03:03:26.624424+0000 mgr.a (mgr.14388) 12506 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:27 smithi049 bash[23528]: cluster 2024-09-21T03:03:26.624424+0000 mgr.a (mgr.14388) 12506 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:29.337 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:29.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:29.338 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:29.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:29 smithi044 bash[22676]: cluster 2024-09-21T03:03:28.625182+0000 mgr.a (mgr.14388) 12507 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:30.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:29 smithi179 bash[23186]: cluster 2024-09-21T03:03:28.625182+0000 mgr.a (mgr.14388) 12507 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:30.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:29 smithi049 bash[23528]: cluster 2024-09-21T03:03:28.625182+0000 mgr.a (mgr.14388) 12507 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:30.124 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:30.125 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:30 smithi044 bash[22676]: audit 2024-09-21T03:03:29.671986+0000 mgr.a (mgr.14388) 12508 : audit [DBG] from='client.273264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:30 smithi179 bash[23186]: audit 2024-09-21T03:03:29.671986+0000 mgr.a (mgr.14388) 12508 : audit [DBG] from='client.273264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:30 smithi049 bash[23528]: audit 2024-09-21T03:03:29.671986+0000 mgr.a (mgr.14388) 12508 : audit [DBG] from='client.273264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:31 smithi044 bash[22676]: cluster 2024-09-21T03:03:30.628051+0000 mgr.a (mgr.14388) 12509 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:03:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:31 smithi044 bash[22676]: audit 2024-09-21T03:03:31.165483+0000 mon.a (mon.0) 10181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:31 smithi044 bash[22676]: audit 2024-09-21T03:03:31.175032+0000 mon.a (mon.0) 10182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:31 smithi044 bash[22676]: audit 2024-09-21T03:03:31.187823+0000 mon.a (mon.0) 10183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:31 smithi044 bash[22676]: audit 2024-09-21T03:03:31.204508+0000 mon.a (mon.0) 10184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:31 smithi044 bash[22676]: audit 2024-09-21T03:03:31.214340+0000 mon.a (mon.0) 10185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:31 smithi044 bash[22676]: audit 2024-09-21T03:03:31.225635+0000 mon.a (mon.0) 10186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:31 smithi179 bash[23186]: cluster 2024-09-21T03:03:30.628051+0000 mgr.a (mgr.14388) 12509 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:03:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:31 smithi179 bash[23186]: audit 2024-09-21T03:03:31.165483+0000 mon.a (mon.0) 10181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:31 smithi179 bash[23186]: audit 2024-09-21T03:03:31.175032+0000 mon.a (mon.0) 10182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:31 smithi179 bash[23186]: audit 2024-09-21T03:03:31.187823+0000 mon.a (mon.0) 10183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:31 smithi179 bash[23186]: audit 2024-09-21T03:03:31.204508+0000 mon.a (mon.0) 10184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:31 smithi179 bash[23186]: audit 2024-09-21T03:03:31.214340+0000 mon.a (mon.0) 10185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:31 smithi179 bash[23186]: audit 2024-09-21T03:03:31.225635+0000 mon.a (mon.0) 10186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:31 smithi049 bash[23528]: cluster 2024-09-21T03:03:30.628051+0000 mgr.a (mgr.14388) 12509 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:03:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:31 smithi049 bash[23528]: audit 2024-09-21T03:03:31.165483+0000 mon.a (mon.0) 10181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:31 smithi049 bash[23528]: audit 2024-09-21T03:03:31.175032+0000 mon.a (mon.0) 10182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:31 smithi049 bash[23528]: audit 2024-09-21T03:03:31.187823+0000 mon.a (mon.0) 10183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:31 smithi049 bash[23528]: audit 2024-09-21T03:03:31.204508+0000 mon.a (mon.0) 10184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:31 smithi049 bash[23528]: audit 2024-09-21T03:03:31.214340+0000 mon.a (mon.0) 10185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:31 smithi049 bash[23528]: audit 2024-09-21T03:03:31.225635+0000 mon.a (mon.0) 10186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:03:32 smithi044 bash[22930]: debug 2024-09-21T03:03:32.841+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:03:32.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:03:32 smithi044 bash[22930]: debug 2024-09-21T03:03:32.841+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:03:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:32 smithi044 bash[22676]: audit 2024-09-21T03:03:32.014380+0000 mon.a (mon.0) 10187 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:03:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:32 smithi044 bash[22676]: audit 2024-09-21T03:03:32.020736+0000 mon.a (mon.0) 10188 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:03:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:32 smithi044 bash[22676]: audit 2024-09-21T03:03:32.022638+0000 mon.a (mon.0) 10189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:03:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:32 smithi044 bash[22676]: audit 2024-09-21T03:03:32.034628+0000 mon.a (mon.0) 10190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:32 smithi044 bash[22676]: audit 2024-09-21T03:03:32.040831+0000 mon.a (mon.0) 10191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:03:33.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:32 smithi179 bash[23186]: audit 2024-09-21T03:03:32.014380+0000 mon.a (mon.0) 10187 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:03:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:32 smithi179 bash[23186]: audit 2024-09-21T03:03:32.020736+0000 mon.a (mon.0) 10188 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:03:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:32 smithi179 bash[23186]: audit 2024-09-21T03:03:32.022638+0000 mon.a (mon.0) 10189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:03:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:32 smithi179 bash[23186]: audit 2024-09-21T03:03:32.034628+0000 mon.a (mon.0) 10190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:32 smithi179 bash[23186]: audit 2024-09-21T03:03:32.040831+0000 mon.a (mon.0) 10191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:03:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:32 smithi049 bash[23528]: audit 2024-09-21T03:03:32.014380+0000 mon.a (mon.0) 10187 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:03:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:32 smithi049 bash[23528]: audit 2024-09-21T03:03:32.020736+0000 mon.a (mon.0) 10188 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:03:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:32 smithi049 bash[23528]: audit 2024-09-21T03:03:32.022638+0000 mon.a (mon.0) 10189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:03:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:32 smithi049 bash[23528]: audit 2024-09-21T03:03:32.034628+0000 mon.a (mon.0) 10190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:32 smithi049 bash[23528]: audit 2024-09-21T03:03:32.040831+0000 mon.a (mon.0) 10191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:03:33.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:33 smithi179 bash[23186]: audit 2024-09-21T03:03:32.043272+0000 mgr.a (mgr.14388) 12510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:03:33.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:33 smithi179 bash[23186]: cluster 2024-09-21T03:03:32.628691+0000 mgr.a (mgr.14388) 12511 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:03:33.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:33 smithi179 bash[23186]: audit 2024-09-21T03:03:32.846122+0000 mgr.a (mgr.14388) 12512 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:03:33.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:33 smithi179 bash[23186]: cephadm 2024-09-21T03:03:32.847798+0000 mgr.a (mgr.14388) 12513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:03:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:33 smithi049 bash[23528]: audit 2024-09-21T03:03:32.043272+0000 mgr.a (mgr.14388) 12510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:03:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:33 smithi049 bash[23528]: cluster 2024-09-21T03:03:32.628691+0000 mgr.a (mgr.14388) 12511 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:03:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:33 smithi049 bash[23528]: audit 2024-09-21T03:03:32.846122+0000 mgr.a (mgr.14388) 12512 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:03:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:33 smithi049 bash[23528]: cephadm 2024-09-21T03:03:32.847798+0000 mgr.a (mgr.14388) 12513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:03:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:33 smithi044 bash[22676]: audit 2024-09-21T03:03:32.043272+0000 mgr.a (mgr.14388) 12510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:03:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:33 smithi044 bash[22676]: cluster 2024-09-21T03:03:32.628691+0000 mgr.a (mgr.14388) 12511 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:03:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:33 smithi044 bash[22676]: audit 2024-09-21T03:03:32.846122+0000 mgr.a (mgr.14388) 12512 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:03:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:33 smithi044 bash[22676]: cephadm 2024-09-21T03:03:32.847798+0000 mgr.a (mgr.14388) 12513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:03:35.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:35.127 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:35.127 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:35.913 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:35.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:35.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:35.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:35.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:35.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:35 smithi044 bash[22676]: cluster 2024-09-21T03:03:34.629479+0000 mgr.a (mgr.14388) 12514 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:03:36.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:35 smithi179 bash[23186]: cluster 2024-09-21T03:03:34.629479+0000 mgr.a (mgr.14388) 12514 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:03:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:35 smithi049 bash[23528]: cluster 2024-09-21T03:03:34.629479+0000 mgr.a (mgr.14388) 12514 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:03:36.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:36 smithi044 bash[22676]: audit 2024-09-21T03:03:35.461027+0000 mgr.a (mgr.14388) 12515 : audit [DBG] from='client.273441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:37.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:36 smithi179 bash[23186]: audit 2024-09-21T03:03:35.461027+0000 mgr.a (mgr.14388) 12515 : audit [DBG] from='client.273441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:37.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:36 smithi049 bash[23528]: audit 2024-09-21T03:03:35.461027+0000 mgr.a (mgr.14388) 12515 : audit [DBG] from='client.273441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:37 smithi044 bash[22676]: cluster 2024-09-21T03:03:36.632148+0000 mgr.a (mgr.14388) 12516 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:38.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:37 smithi179 bash[23186]: cluster 2024-09-21T03:03:36.632148+0000 mgr.a (mgr.14388) 12516 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:37 smithi049 bash[23528]: cluster 2024-09-21T03:03:36.632148+0000 mgr.a (mgr.14388) 12516 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:39.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:39 smithi044 bash[22676]: audit 2024-09-21T03:03:38.356462+0000 mon.a (mon.0) 10192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:39 smithi044 bash[22676]: audit 2024-09-21T03:03:38.365210+0000 mon.a (mon.0) 10193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:39 smithi044 bash[22676]: audit 2024-09-21T03:03:38.375896+0000 mon.a (mon.0) 10194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:39 smithi044 bash[22676]: cluster 2024-09-21T03:03:38.632922+0000 mgr.a (mgr.14388) 12517 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:39.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:39 smithi179 bash[23186]: audit 2024-09-21T03:03:38.356462+0000 mon.a (mon.0) 10192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:39 smithi179 bash[23186]: audit 2024-09-21T03:03:38.365210+0000 mon.a (mon.0) 10193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:39 smithi179 bash[23186]: audit 2024-09-21T03:03:38.375896+0000 mon.a (mon.0) 10194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:39 smithi179 bash[23186]: cluster 2024-09-21T03:03:38.632922+0000 mgr.a (mgr.14388) 12517 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:39 smithi049 bash[23528]: audit 2024-09-21T03:03:38.356462+0000 mon.a (mon.0) 10192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:39 smithi049 bash[23528]: audit 2024-09-21T03:03:38.365210+0000 mon.a (mon.0) 10193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:39 smithi049 bash[23528]: audit 2024-09-21T03:03:38.375896+0000 mon.a (mon.0) 10194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:39 smithi049 bash[23528]: cluster 2024-09-21T03:03:38.632922+0000 mgr.a (mgr.14388) 12517 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:40.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:40.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:40.916 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:41.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:41.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:41.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:41.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:41.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:41.803 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:41 smithi044 bash[22676]: cluster 2024-09-21T03:03:40.634975+0000 mgr.a (mgr.14388) 12518 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:41 smithi179 bash[23186]: cluster 2024-09-21T03:03:40.634975+0000 mgr.a (mgr.14388) 12518 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:41 smithi049 bash[23528]: cluster 2024-09-21T03:03:40.634975+0000 mgr.a (mgr.14388) 12518 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:42.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:42 smithi044 bash[22676]: audit 2024-09-21T03:03:41.248628+0000 mgr.a (mgr.14388) 12519 : audit [DBG] from='client.273519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:43.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:42 smithi179 bash[23186]: audit 2024-09-21T03:03:41.248628+0000 mgr.a (mgr.14388) 12519 : audit [DBG] from='client.273519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:43.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:42 smithi049 bash[23528]: audit 2024-09-21T03:03:41.248628+0000 mgr.a (mgr.14388) 12519 : audit [DBG] from='client.273519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:43 smithi044 bash[22676]: cluster 2024-09-21T03:03:42.635908+0000 mgr.a (mgr.14388) 12520 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:44.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:43 smithi179 bash[23186]: cluster 2024-09-21T03:03:42.635908+0000 mgr.a (mgr.14388) 12520 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:44.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:43 smithi049 bash[23528]: cluster 2024-09-21T03:03:42.635908+0000 mgr.a (mgr.14388) 12520 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:45 smithi044 bash[22676]: cluster 2024-09-21T03:03:44.636708+0000 mgr.a (mgr.14388) 12521 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:45 smithi179 bash[23186]: cluster 2024-09-21T03:03:44.636708+0000 mgr.a (mgr.14388) 12521 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:45 smithi049 bash[23528]: cluster 2024-09-21T03:03:44.636708+0000 mgr.a (mgr.14388) 12521 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:03:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:46.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:46.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:47.471 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:47.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:47.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:47.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:47.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:47.903 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:47 smithi049 bash[23528]: cluster 2024-09-21T03:03:46.638940+0000 mgr.a (mgr.14388) 12522 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:47.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:47 smithi044 bash[22676]: cluster 2024-09-21T03:03:46.638940+0000 mgr.a (mgr.14388) 12522 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:48.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:47 smithi179 bash[23186]: cluster 2024-09-21T03:03:46.638940+0000 mgr.a (mgr.14388) 12522 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:03:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:48 smithi049 bash[23528]: audit 2024-09-21T03:03:47.024151+0000 mgr.a (mgr.14388) 12523 : audit [DBG] from='client.273591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:48.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:48 smithi044 bash[22676]: audit 2024-09-21T03:03:47.024151+0000 mgr.a (mgr.14388) 12523 : audit [DBG] from='client.273591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:49.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:48 smithi179 bash[23186]: audit 2024-09-21T03:03:47.024151+0000 mgr.a (mgr.14388) 12523 : audit [DBG] from='client.273591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:49 smithi044 bash[22676]: cluster 2024-09-21T03:03:48.639839+0000 mgr.a (mgr.14388) 12524 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:50.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:49 smithi179 bash[23186]: cluster 2024-09-21T03:03:48.639839+0000 mgr.a (mgr.14388) 12524 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:50.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:49 smithi049 bash[23528]: cluster 2024-09-21T03:03:48.639839+0000 mgr.a (mgr.14388) 12524 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:51 smithi044 bash[22676]: cluster 2024-09-21T03:03:50.642090+0000 mgr.a (mgr.14388) 12525 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:51 smithi044 bash[22676]: audit 2024-09-21T03:03:51.395537+0000 mon.a (mon.0) 10195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:51 smithi044 bash[22676]: audit 2024-09-21T03:03:51.401825+0000 mon.a (mon.0) 10196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:51 smithi044 bash[22676]: audit 2024-09-21T03:03:51.410581+0000 mon.a (mon.0) 10197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:51 smithi044 bash[22676]: audit 2024-09-21T03:03:51.423586+0000 mon.a (mon.0) 10198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:51 smithi044 bash[22676]: audit 2024-09-21T03:03:51.431889+0000 mon.a (mon.0) 10199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:51 smithi044 bash[22676]: audit 2024-09-21T03:03:51.442013+0000 mon.a (mon.0) 10200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:51 smithi179 bash[23186]: cluster 2024-09-21T03:03:50.642090+0000 mgr.a (mgr.14388) 12525 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:51 smithi179 bash[23186]: audit 2024-09-21T03:03:51.395537+0000 mon.a (mon.0) 10195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:51 smithi179 bash[23186]: audit 2024-09-21T03:03:51.401825+0000 mon.a (mon.0) 10196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:51 smithi179 bash[23186]: audit 2024-09-21T03:03:51.410581+0000 mon.a (mon.0) 10197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:51 smithi179 bash[23186]: audit 2024-09-21T03:03:51.423586+0000 mon.a (mon.0) 10198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:51 smithi179 bash[23186]: audit 2024-09-21T03:03:51.431889+0000 mon.a (mon.0) 10199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:51 smithi179 bash[23186]: audit 2024-09-21T03:03:51.442013+0000 mon.a (mon.0) 10200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:51 smithi049 bash[23528]: cluster 2024-09-21T03:03:50.642090+0000 mgr.a (mgr.14388) 12525 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:51 smithi049 bash[23528]: audit 2024-09-21T03:03:51.395537+0000 mon.a (mon.0) 10195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:51 smithi049 bash[23528]: audit 2024-09-21T03:03:51.401825+0000 mon.a (mon.0) 10196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:51 smithi049 bash[23528]: audit 2024-09-21T03:03:51.410581+0000 mon.a (mon.0) 10197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:51 smithi049 bash[23528]: audit 2024-09-21T03:03:51.423586+0000 mon.a (mon.0) 10198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:51 smithi049 bash[23528]: audit 2024-09-21T03:03:51.431889+0000 mon.a (mon.0) 10199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:51 smithi049 bash[23528]: audit 2024-09-21T03:03:51.442013+0000 mon.a (mon.0) 10200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:52.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:52.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:52.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:53.265 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:53.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:53 smithi044 bash[22676]: cluster 2024-09-21T03:03:52.642837+0000 mgr.a (mgr.14388) 12526 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:53 smithi044 bash[22676]: audit 2024-09-21T03:03:52.811455+0000 mgr.a (mgr.14388) 12527 : audit [DBG] from='client.273666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:54.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:53 smithi179 bash[23186]: cluster 2024-09-21T03:03:52.642837+0000 mgr.a (mgr.14388) 12526 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:54.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:53 smithi179 bash[23186]: audit 2024-09-21T03:03:52.811455+0000 mgr.a (mgr.14388) 12527 : audit [DBG] from='client.273666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:53 smithi049 bash[23528]: cluster 2024-09-21T03:03:52.642837+0000 mgr.a (mgr.14388) 12526 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:53 smithi049 bash[23528]: audit 2024-09-21T03:03:52.811455+0000 mgr.a (mgr.14388) 12527 : audit [DBG] from='client.273666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:55.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:55 smithi044 bash[22676]: cluster 2024-09-21T03:03:54.643754+0000 mgr.a (mgr.14388) 12528 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:56.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:55 smithi179 bash[23186]: cluster 2024-09-21T03:03:54.643754+0000 mgr.a (mgr.14388) 12528 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:55 smithi049 bash[23528]: cluster 2024-09-21T03:03:54.643754+0000 mgr.a (mgr.14388) 12528 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:03:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:57 smithi179 bash[23186]: cluster 2024-09-21T03:03:56.646044+0000 mgr.a (mgr.14388) 12529 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:57 smithi049 bash[23528]: cluster 2024-09-21T03:03:56.646044+0000 mgr.a (mgr.14388) 12529 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:57 smithi044 bash[22676]: cluster 2024-09-21T03:03:56.646044+0000 mgr.a (mgr.14388) 12529 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:03:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:03:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:03:58.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:03:59.014 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:03:59.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:03:59.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:03:59.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:03:59.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:59 smithi044 bash[22676]: audit 2024-09-21T03:03:58.595063+0000 mon.a (mon.0) 10201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:59 smithi044 bash[22676]: audit 2024-09-21T03:03:58.598631+0000 mgr.a (mgr.14388) 12530 : audit [DBG] from='client.273744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:59 smithi044 bash[22676]: audit 2024-09-21T03:03:58.601406+0000 mon.a (mon.0) 10202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:59 smithi044 bash[22676]: audit 2024-09-21T03:03:58.622312+0000 mon.a (mon.0) 10203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:03:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:03:59 smithi044 bash[22676]: cluster 2024-09-21T03:03:58.647035+0000 mgr.a (mgr.14388) 12531 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:59 smithi179 bash[23186]: audit 2024-09-21T03:03:58.595063+0000 mon.a (mon.0) 10201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:59 smithi179 bash[23186]: audit 2024-09-21T03:03:58.598631+0000 mgr.a (mgr.14388) 12530 : audit [DBG] from='client.273744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:59 smithi179 bash[23186]: audit 2024-09-21T03:03:58.601406+0000 mon.a (mon.0) 10202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:59 smithi179 bash[23186]: audit 2024-09-21T03:03:58.622312+0000 mon.a (mon.0) 10203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:03:59 smithi179 bash[23186]: cluster 2024-09-21T03:03:58.647035+0000 mgr.a (mgr.14388) 12531 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:59 smithi049 bash[23528]: audit 2024-09-21T03:03:58.595063+0000 mon.a (mon.0) 10201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:59 smithi049 bash[23528]: audit 2024-09-21T03:03:58.598631+0000 mgr.a (mgr.14388) 12530 : audit [DBG] from='client.273744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:59 smithi049 bash[23528]: audit 2024-09-21T03:03:58.601406+0000 mon.a (mon.0) 10202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:59 smithi049 bash[23528]: audit 2024-09-21T03:03:58.622312+0000 mon.a (mon.0) 10203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:03:59 smithi049 bash[23528]: cluster 2024-09-21T03:03:58.647035+0000 mgr.a (mgr.14388) 12531 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:01.959 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:01 smithi044 bash[22676]: cluster 2024-09-21T03:04:00.649535+0000 mgr.a (mgr.14388) 12532 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:01 smithi179 bash[23186]: cluster 2024-09-21T03:04:00.649535+0000 mgr.a (mgr.14388) 12532 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:01 smithi049 bash[23528]: cluster 2024-09-21T03:04:00.649535+0000 mgr.a (mgr.14388) 12532 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:03.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:03 smithi044 bash[22676]: cluster 2024-09-21T03:04:02.650490+0000 mgr.a (mgr.14388) 12533 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:04.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:03 smithi179 bash[23186]: cluster 2024-09-21T03:04:02.650490+0000 mgr.a (mgr.14388) 12533 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:04.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:03 smithi049 bash[23528]: cluster 2024-09-21T03:04:02.650490+0000 mgr.a (mgr.14388) 12533 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:04.809 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:04.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:04.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:04.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:04.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:05 smithi044 bash[22676]: audit 2024-09-21T03:04:04.353423+0000 mgr.a (mgr.14388) 12534 : audit [DBG] from='client.273822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:05 smithi044 bash[22676]: cluster 2024-09-21T03:04:04.651109+0000 mgr.a (mgr.14388) 12535 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:06.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:05 smithi179 bash[23186]: audit 2024-09-21T03:04:04.353423+0000 mgr.a (mgr.14388) 12534 : audit [DBG] from='client.273822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:05 smithi179 bash[23186]: cluster 2024-09-21T03:04:04.651109+0000 mgr.a (mgr.14388) 12535 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:05 smithi049 bash[23528]: audit 2024-09-21T03:04:04.353423+0000 mgr.a (mgr.14388) 12534 : audit [DBG] from='client.273822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:05 smithi049 bash[23528]: cluster 2024-09-21T03:04:04.651109+0000 mgr.a (mgr.14388) 12535 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:07.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:07 smithi044 bash[22676]: cluster 2024-09-21T03:04:06.653491+0000 mgr.a (mgr.14388) 12536 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:07.991 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:07 smithi049 bash[23528]: cluster 2024-09-21T03:04:06.653491+0000 mgr.a (mgr.14388) 12536 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:08.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:07 smithi179 bash[23186]: cluster 2024-09-21T03:04:06.653491+0000 mgr.a (mgr.14388) 12536 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:09.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:09.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:09.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:09.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:09 smithi044 bash[22676]: cluster 2024-09-21T03:04:08.654266+0000 mgr.a (mgr.14388) 12537 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:10.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:09 smithi179 bash[23186]: cluster 2024-09-21T03:04:08.654266+0000 mgr.a (mgr.14388) 12537 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:09 smithi049 bash[23528]: cluster 2024-09-21T03:04:08.654266+0000 mgr.a (mgr.14388) 12537 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:10.601 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: audit 2024-09-21T03:04:10.153215+0000 mgr.a (mgr.14388) 12538 : audit [DBG] from='client.273894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: cluster 2024-09-21T03:04:10.655614+0000 mgr.a (mgr.14388) 12539 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: audit 2024-09-21T03:04:11.636072+0000 mon.a (mon.0) 10204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: audit 2024-09-21T03:04:11.642597+0000 mon.a (mon.0) 10205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: audit 2024-09-21T03:04:11.653940+0000 mon.a (mon.0) 10206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: audit 2024-09-21T03:04:11.671066+0000 mon.a (mon.0) 10207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: audit 2024-09-21T03:04:11.679680+0000 mon.a (mon.0) 10208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:11 smithi044 bash[22676]: audit 2024-09-21T03:04:11.689745+0000 mon.a (mon.0) 10209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: audit 2024-09-21T03:04:10.153215+0000 mgr.a (mgr.14388) 12538 : audit [DBG] from='client.273894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: cluster 2024-09-21T03:04:10.655614+0000 mgr.a (mgr.14388) 12539 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: audit 2024-09-21T03:04:11.636072+0000 mon.a (mon.0) 10204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: audit 2024-09-21T03:04:11.642597+0000 mon.a (mon.0) 10205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: audit 2024-09-21T03:04:11.653940+0000 mon.a (mon.0) 10206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: audit 2024-09-21T03:04:11.671066+0000 mon.a (mon.0) 10207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: audit 2024-09-21T03:04:11.679680+0000 mon.a (mon.0) 10208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:11 smithi179 bash[23186]: audit 2024-09-21T03:04:11.689745+0000 mon.a (mon.0) 10209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: audit 2024-09-21T03:04:10.153215+0000 mgr.a (mgr.14388) 12538 : audit [DBG] from='client.273894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:12.067 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: cluster 2024-09-21T03:04:10.655614+0000 mgr.a (mgr.14388) 12539 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:12.068 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: audit 2024-09-21T03:04:11.636072+0000 mon.a (mon.0) 10204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.068 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: audit 2024-09-21T03:04:11.642597+0000 mon.a (mon.0) 10205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.068 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: audit 2024-09-21T03:04:11.653940+0000 mon.a (mon.0) 10206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.068 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: audit 2024-09-21T03:04:11.671066+0000 mon.a (mon.0) 10207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.068 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: audit 2024-09-21T03:04:11.679680+0000 mon.a (mon.0) 10208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:12.068 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:11 smithi049 bash[23528]: audit 2024-09-21T03:04:11.689745+0000 mon.a (mon.0) 10209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:13.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:13 smithi044 bash[22676]: cluster 2024-09-21T03:04:12.656321+0000 mgr.a (mgr.14388) 12540 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:04:14.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:13 smithi179 bash[23186]: cluster 2024-09-21T03:04:12.656321+0000 mgr.a (mgr.14388) 12540 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:04:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:13 smithi049 bash[23528]: cluster 2024-09-21T03:04:12.656321+0000 mgr.a (mgr.14388) 12540 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:04:15.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:15.604 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:15.604 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:15.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:15 smithi044 bash[22676]: cluster 2024-09-21T03:04:14.657067+0000 mgr.a (mgr.14388) 12541 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:04:16.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:15 smithi179 bash[23186]: cluster 2024-09-21T03:04:14.657067+0000 mgr.a (mgr.14388) 12541 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:04:16.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:15 smithi049 bash[23528]: cluster 2024-09-21T03:04:14.657067+0000 mgr.a (mgr.14388) 12541 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:04:16.397 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:16.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:16.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:16.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:16.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:17 smithi179 bash[23186]: audit 2024-09-21T03:04:15.939348+0000 mgr.a (mgr.14388) 12542 : audit [DBG] from='client.273969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:17 smithi179 bash[23186]: cluster 2024-09-21T03:04:16.659861+0000 mgr.a (mgr.14388) 12543 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:17 smithi049 bash[23528]: audit 2024-09-21T03:04:15.939348+0000 mgr.a (mgr.14388) 12542 : audit [DBG] from='client.273969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:17 smithi049 bash[23528]: cluster 2024-09-21T03:04:16.659861+0000 mgr.a (mgr.14388) 12543 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:17 smithi044 bash[22676]: audit 2024-09-21T03:04:15.939348+0000 mgr.a (mgr.14388) 12542 : audit [DBG] from='client.273969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:17 smithi044 bash[22676]: cluster 2024-09-21T03:04:16.659861+0000 mgr.a (mgr.14388) 12543 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:19 smithi044 bash[22676]: cluster 2024-09-21T03:04:18.660684+0000 mgr.a (mgr.14388) 12544 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:19 smithi044 bash[22676]: audit 2024-09-21T03:04:18.840466+0000 mon.a (mon.0) 10210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:19 smithi044 bash[22676]: audit 2024-09-21T03:04:18.849113+0000 mon.a (mon.0) 10211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:19 smithi044 bash[22676]: audit 2024-09-21T03:04:18.859589+0000 mon.a (mon.0) 10212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:19 smithi179 bash[23186]: cluster 2024-09-21T03:04:18.660684+0000 mgr.a (mgr.14388) 12544 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:19 smithi179 bash[23186]: audit 2024-09-21T03:04:18.840466+0000 mon.a (mon.0) 10210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:19 smithi179 bash[23186]: audit 2024-09-21T03:04:18.849113+0000 mon.a (mon.0) 10211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:19 smithi179 bash[23186]: audit 2024-09-21T03:04:18.859589+0000 mon.a (mon.0) 10212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:19 smithi049 bash[23528]: cluster 2024-09-21T03:04:18.660684+0000 mgr.a (mgr.14388) 12544 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:19 smithi049 bash[23528]: audit 2024-09-21T03:04:18.840466+0000 mon.a (mon.0) 10210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:19 smithi049 bash[23528]: audit 2024-09-21T03:04:18.849113+0000 mon.a (mon.0) 10211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:19 smithi049 bash[23528]: audit 2024-09-21T03:04:18.859589+0000 mon.a (mon.0) 10212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:21.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:22.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:21 smithi044 bash[22676]: cluster 2024-09-21T03:04:20.662660+0000 mgr.a (mgr.14388) 12545 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:22.182 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:21 smithi179 bash[23186]: cluster 2024-09-21T03:04:20.662660+0000 mgr.a (mgr.14388) 12545 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:21 smithi049 bash[23528]: cluster 2024-09-21T03:04:20.662660+0000 mgr.a (mgr.14388) 12545 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:22 smithi044 bash[22676]: audit 2024-09-21T03:04:21.733946+0000 mgr.a (mgr.14388) 12546 : audit [DBG] from='client.274047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:23.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:22 smithi179 bash[23186]: audit 2024-09-21T03:04:21.733946+0000 mgr.a (mgr.14388) 12546 : audit [DBG] from='client.274047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:22 smithi049 bash[23528]: audit 2024-09-21T03:04:21.733946+0000 mgr.a (mgr.14388) 12546 : audit [DBG] from='client.274047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:23 smithi044 bash[22676]: cluster 2024-09-21T03:04:22.663257+0000 mgr.a (mgr.14388) 12547 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:23 smithi179 bash[23186]: cluster 2024-09-21T03:04:22.663257+0000 mgr.a (mgr.14388) 12547 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:23 smithi049 bash[23528]: cluster 2024-09-21T03:04:22.663257+0000 mgr.a (mgr.14388) 12547 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:25 smithi179 bash[23186]: cluster 2024-09-21T03:04:24.664013+0000 mgr.a (mgr.14388) 12548 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:25 smithi044 bash[22676]: cluster 2024-09-21T03:04:24.664013+0000 mgr.a (mgr.14388) 12548 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:25 smithi049 bash[23528]: cluster 2024-09-21T03:04:24.664013+0000 mgr.a (mgr.14388) 12548 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:27.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:27.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:27.942 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:27.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:27.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:27.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:27.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:27 smithi044 bash[22676]: cluster 2024-09-21T03:04:26.666254+0000 mgr.a (mgr.14388) 12549 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:28.249 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:27 smithi049 bash[23528]: cluster 2024-09-21T03:04:26.666254+0000 mgr.a (mgr.14388) 12549 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:27 smithi179 bash[23186]: cluster 2024-09-21T03:04:26.666254+0000 mgr.a (mgr.14388) 12549 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:29.190 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:28 smithi049 bash[23528]: audit 2024-09-21T03:04:27.520007+0000 mgr.a (mgr.14388) 12550 : audit [DBG] from='client.274122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:28 smithi044 bash[22676]: audit 2024-09-21T03:04:27.520007+0000 mgr.a (mgr.14388) 12550 : audit [DBG] from='client.274122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:29.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:28 smithi179 bash[23186]: audit 2024-09-21T03:04:27.520007+0000 mgr.a (mgr.14388) 12550 : audit [DBG] from='client.274122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:30.134 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:29 smithi049 bash[23528]: cluster 2024-09-21T03:04:28.667175+0000 mgr.a (mgr.14388) 12551 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:29 smithi044 bash[22676]: cluster 2024-09-21T03:04:28.667175+0000 mgr.a (mgr.14388) 12551 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:30.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:29 smithi179 bash[23186]: cluster 2024-09-21T03:04:28.667175+0000 mgr.a (mgr.14388) 12551 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:31 smithi044 bash[22676]: cluster 2024-09-21T03:04:30.669405+0000 mgr.a (mgr.14388) 12552 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:31 smithi179 bash[23186]: cluster 2024-09-21T03:04:30.669405+0000 mgr.a (mgr.14388) 12552 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:31 smithi049 bash[23528]: cluster 2024-09-21T03:04:30.669405+0000 mgr.a (mgr.14388) 12552 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:04:32.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:32.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:32 smithi044 bash[22676]: audit 2024-09-21T03:04:31.878806+0000 mon.a (mon.0) 10213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:32 smithi044 bash[22676]: audit 2024-09-21T03:04:31.893856+0000 mon.a (mon.0) 10214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:32 smithi044 bash[22676]: audit 2024-09-21T03:04:31.901970+0000 mon.a (mon.0) 10215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:32 smithi044 bash[22676]: audit 2024-09-21T03:04:31.908913+0000 mon.a (mon.0) 10216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:32 smithi044 bash[22676]: audit 2024-09-21T03:04:31.915690+0000 mon.a (mon.0) 10217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:32 smithi044 bash[22676]: audit 2024-09-21T03:04:31.927245+0000 mon.a (mon.0) 10218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:32 smithi179 bash[23186]: audit 2024-09-21T03:04:31.878806+0000 mon.a (mon.0) 10213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:32 smithi179 bash[23186]: audit 2024-09-21T03:04:31.893856+0000 mon.a (mon.0) 10214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:32 smithi179 bash[23186]: audit 2024-09-21T03:04:31.901970+0000 mon.a (mon.0) 10215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:32 smithi179 bash[23186]: audit 2024-09-21T03:04:31.908913+0000 mon.a (mon.0) 10216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:32 smithi179 bash[23186]: audit 2024-09-21T03:04:31.915690+0000 mon.a (mon.0) 10217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:32 smithi179 bash[23186]: audit 2024-09-21T03:04:31.927245+0000 mon.a (mon.0) 10218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:32 smithi049 bash[23528]: audit 2024-09-21T03:04:31.878806+0000 mon.a (mon.0) 10213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:32 smithi049 bash[23528]: audit 2024-09-21T03:04:31.893856+0000 mon.a (mon.0) 10214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:32 smithi049 bash[23528]: audit 2024-09-21T03:04:31.901970+0000 mon.a (mon.0) 10215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:32 smithi049 bash[23528]: audit 2024-09-21T03:04:31.908913+0000 mon.a (mon.0) 10216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:32 smithi049 bash[23528]: audit 2024-09-21T03:04:31.915690+0000 mon.a (mon.0) 10217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:32 smithi049 bash[23528]: audit 2024-09-21T03:04:31.927245+0000 mon.a (mon.0) 10218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:33.726 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: cluster 2024-09-21T03:04:32.670188+0000 mgr.a (mgr.14388) 12553 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:32.910375+0000 mon.a (mon.0) 10219 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.500627+0000 mon.a (mon.0) 10220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.507602+0000 mon.a (mon.0) 10221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.535991+0000 mon.a (mon.0) 10222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.542000+0000 mon.a (mon.0) 10223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.543423+0000 mon.a (mon.0) 10224 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.544210+0000 mon.a (mon.0) 10225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.549215+0000 mon.a (mon.0) 10226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:33 smithi044 bash[22676]: audit 2024-09-21T03:04:33.551896+0000 mon.a (mon.0) 10227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: cluster 2024-09-21T03:04:32.670188+0000 mgr.a (mgr.14388) 12553 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:32.910375+0000 mon.a (mon.0) 10219 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.500627+0000 mon.a (mon.0) 10220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.507602+0000 mon.a (mon.0) 10221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.535991+0000 mon.a (mon.0) 10222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.542000+0000 mon.a (mon.0) 10223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.543423+0000 mon.a (mon.0) 10224 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:04:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.544210+0000 mon.a (mon.0) 10225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:04:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.549215+0000 mon.a (mon.0) 10226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:33 smithi179 bash[23186]: audit 2024-09-21T03:04:33.551896+0000 mon.a (mon.0) 10227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: cluster 2024-09-21T03:04:32.670188+0000 mgr.a (mgr.14388) 12553 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:32.910375+0000 mon.a (mon.0) 10219 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.500627+0000 mon.a (mon.0) 10220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.507602+0000 mon.a (mon.0) 10221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.535991+0000 mon.a (mon.0) 10222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.542000+0000 mon.a (mon.0) 10223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.543423+0000 mon.a (mon.0) 10224 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:04:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.544210+0000 mon.a (mon.0) 10225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:04:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.549215+0000 mon.a (mon.0) 10226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:33 smithi049 bash[23528]: audit 2024-09-21T03:04:33.551896+0000 mon.a (mon.0) 10227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:04:34.736 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:04:34 smithi044 bash[22930]: debug 2024-09-21T03:04:34.416+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:04:34.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:04:34 smithi044 bash[22930]: debug 2024-09-21T03:04:34.420+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:04:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:34 smithi044 bash[22676]: audit 2024-09-21T03:04:33.277804+0000 mgr.a (mgr.14388) 12554 : audit [DBG] from='client.274197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:34 smithi044 bash[22676]: audit 2024-09-21T03:04:33.553627+0000 mgr.a (mgr.14388) 12555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:04:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:34 smithi179 bash[23186]: audit 2024-09-21T03:04:33.277804+0000 mgr.a (mgr.14388) 12554 : audit [DBG] from='client.274197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:34 smithi179 bash[23186]: audit 2024-09-21T03:04:33.553627+0000 mgr.a (mgr.14388) 12555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:04:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:34 smithi049 bash[23528]: audit 2024-09-21T03:04:33.277804+0000 mgr.a (mgr.14388) 12554 : audit [DBG] from='client.274197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:34 smithi049 bash[23528]: audit 2024-09-21T03:04:33.553627+0000 mgr.a (mgr.14388) 12555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:04:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:35 smithi044 bash[22676]: audit 2024-09-21T03:04:34.421142+0000 mgr.a (mgr.14388) 12556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:04:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:35 smithi044 bash[22676]: cephadm 2024-09-21T03:04:34.422183+0000 mgr.a (mgr.14388) 12557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:04:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:35 smithi044 bash[22676]: cluster 2024-09-21T03:04:34.670997+0000 mgr.a (mgr.14388) 12558 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:35 smithi179 bash[23186]: audit 2024-09-21T03:04:34.421142+0000 mgr.a (mgr.14388) 12556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:35 smithi179 bash[23186]: cephadm 2024-09-21T03:04:34.422183+0000 mgr.a (mgr.14388) 12557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:04:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:35 smithi179 bash[23186]: cluster 2024-09-21T03:04:34.670997+0000 mgr.a (mgr.14388) 12558 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:35 smithi049 bash[23528]: audit 2024-09-21T03:04:34.421142+0000 mgr.a (mgr.14388) 12556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:35 smithi049 bash[23528]: cephadm 2024-09-21T03:04:34.422183+0000 mgr.a (mgr.14388) 12557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:04:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:35 smithi049 bash[23528]: cluster 2024-09-21T03:04:34.670997+0000 mgr.a (mgr.14388) 12558 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:36 smithi044 bash[22676]: cluster 2024-09-21T03:04:36.673168+0000 mgr.a (mgr.14388) 12559 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:36 smithi179 bash[23186]: cluster 2024-09-21T03:04:36.673168+0000 mgr.a (mgr.14388) 12559 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:36 smithi049 bash[23528]: cluster 2024-09-21T03:04:36.673168+0000 mgr.a (mgr.14388) 12559 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:39.526 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:39.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:39.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:39.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:39.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:39 smithi044 bash[22676]: cluster 2024-09-21T03:04:38.673897+0000 mgr.a (mgr.14388) 12560 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:39 smithi044 bash[22676]: audit 2024-09-21T03:04:39.074515+0000 mon.a (mon.0) 10228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:39 smithi044 bash[22676]: audit 2024-09-21T03:04:39.093725+0000 mon.a (mon.0) 10229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:39 smithi044 bash[22676]: audit 2024-09-21T03:04:39.103816+0000 mon.a (mon.0) 10230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:39 smithi179 bash[23186]: cluster 2024-09-21T03:04:38.673897+0000 mgr.a (mgr.14388) 12560 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:39 smithi179 bash[23186]: audit 2024-09-21T03:04:39.074515+0000 mon.a (mon.0) 10228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:39 smithi179 bash[23186]: audit 2024-09-21T03:04:39.093725+0000 mon.a (mon.0) 10229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:39 smithi179 bash[23186]: audit 2024-09-21T03:04:39.103816+0000 mon.a (mon.0) 10230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:39 smithi049 bash[23528]: cluster 2024-09-21T03:04:38.673897+0000 mgr.a (mgr.14388) 12560 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:39 smithi049 bash[23528]: audit 2024-09-21T03:04:39.074515+0000 mon.a (mon.0) 10228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:39 smithi049 bash[23528]: audit 2024-09-21T03:04:39.093725+0000 mon.a (mon.0) 10229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:39 smithi049 bash[23528]: audit 2024-09-21T03:04:39.103816+0000 mon.a (mon.0) 10230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:40 smithi179 bash[23186]: audit 2024-09-21T03:04:39.064123+0000 mgr.a (mgr.14388) 12561 : audit [DBG] from='client.274380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:41.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:40 smithi049 bash[23528]: audit 2024-09-21T03:04:39.064123+0000 mgr.a (mgr.14388) 12561 : audit [DBG] from='client.274380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:41.075 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:40 smithi044 bash[22676]: audit 2024-09-21T03:04:39.064123+0000 mgr.a (mgr.14388) 12561 : audit [DBG] from='client.274380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:41 smithi179 bash[23186]: cluster 2024-09-21T03:04:40.676276+0000 mgr.a (mgr.14388) 12562 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:41 smithi049 bash[23528]: cluster 2024-09-21T03:04:40.676276+0000 mgr.a (mgr.14388) 12562 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:42.093 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:41 smithi044 bash[22676]: cluster 2024-09-21T03:04:40.676276+0000 mgr.a (mgr.14388) 12562 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:43 smithi179 bash[23186]: cluster 2024-09-21T03:04:42.677067+0000 mgr.a (mgr.14388) 12563 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:43 smithi049 bash[23528]: cluster 2024-09-21T03:04:42.677067+0000 mgr.a (mgr.14388) 12563 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:43 smithi044 bash[22676]: cluster 2024-09-21T03:04:42.677067+0000 mgr.a (mgr.14388) 12563 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:44.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:45.321 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:45.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:45.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:45.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:45.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:45 smithi179 bash[23186]: cluster 2024-09-21T03:04:44.678777+0000 mgr.a (mgr.14388) 12564 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:45 smithi179 bash[23186]: audit 2024-09-21T03:04:44.864001+0000 mgr.a (mgr.14388) 12565 : audit [DBG] from='client.274458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:45 smithi049 bash[23528]: cluster 2024-09-21T03:04:44.678777+0000 mgr.a (mgr.14388) 12564 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:45 smithi049 bash[23528]: audit 2024-09-21T03:04:44.864001+0000 mgr.a (mgr.14388) 12565 : audit [DBG] from='client.274458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:45 smithi044 bash[22676]: cluster 2024-09-21T03:04:44.678777+0000 mgr.a (mgr.14388) 12564 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:45 smithi044 bash[22676]: audit 2024-09-21T03:04:44.864001+0000 mgr.a (mgr.14388) 12565 : audit [DBG] from='client.274458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:47 smithi049 bash[23528]: cluster 2024-09-21T03:04:46.681553+0000 mgr.a (mgr.14388) 12566 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:47 smithi044 bash[22676]: cluster 2024-09-21T03:04:46.681553+0000 mgr.a (mgr.14388) 12566 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:47 smithi179 bash[23186]: cluster 2024-09-21T03:04:46.681553+0000 mgr.a (mgr.14388) 12566 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:04:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:49 smithi049 bash[23528]: cluster 2024-09-21T03:04:48.682340+0000 mgr.a (mgr.14388) 12567 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:49 smithi044 bash[22676]: cluster 2024-09-21T03:04:48.682340+0000 mgr.a (mgr.14388) 12567 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:49 smithi179 bash[23186]: cluster 2024-09-21T03:04:48.682340+0000 mgr.a (mgr.14388) 12567 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:51 smithi049 bash[23528]: audit 2024-09-21T03:04:50.662947+0000 mgr.a (mgr.14388) 12568 : audit [DBG] from='client.274536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:51 smithi049 bash[23528]: cluster 2024-09-21T03:04:50.684559+0000 mgr.a (mgr.14388) 12569 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:52.131 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:51 smithi179 bash[23186]: audit 2024-09-21T03:04:50.662947+0000 mgr.a (mgr.14388) 12568 : audit [DBG] from='client.274536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:52.131 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:51 smithi179 bash[23186]: cluster 2024-09-21T03:04:50.684559+0000 mgr.a (mgr.14388) 12569 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:52.150 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:51 smithi044 bash[22676]: audit 2024-09-21T03:04:50.662947+0000 mgr.a (mgr.14388) 12568 : audit [DBG] from='client.274536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:52.150 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:51 smithi044 bash[22676]: cluster 2024-09-21T03:04:50.684559+0000 mgr.a (mgr.14388) 12569 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:53 smithi044 bash[22676]: audit 2024-09-21T03:04:52.107889+0000 mon.a (mon.0) 10231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:53 smithi044 bash[22676]: audit 2024-09-21T03:04:52.115678+0000 mon.a (mon.0) 10232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:53 smithi044 bash[22676]: audit 2024-09-21T03:04:52.122187+0000 mon.a (mon.0) 10233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:53 smithi044 bash[22676]: audit 2024-09-21T03:04:52.129581+0000 mon.a (mon.0) 10234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:53 smithi044 bash[22676]: audit 2024-09-21T03:04:52.137298+0000 mon.a (mon.0) 10235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:53 smithi044 bash[22676]: audit 2024-09-21T03:04:52.148265+0000 mon.a (mon.0) 10236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:53 smithi044 bash[22676]: cluster 2024-09-21T03:04:52.685529+0000 mgr.a (mgr.14388) 12570 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:53 smithi179 bash[23186]: audit 2024-09-21T03:04:52.107889+0000 mon.a (mon.0) 10231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:53 smithi179 bash[23186]: audit 2024-09-21T03:04:52.115678+0000 mon.a (mon.0) 10232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:53 smithi179 bash[23186]: audit 2024-09-21T03:04:52.122187+0000 mon.a (mon.0) 10233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:53 smithi179 bash[23186]: audit 2024-09-21T03:04:52.129581+0000 mon.a (mon.0) 10234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:53 smithi179 bash[23186]: audit 2024-09-21T03:04:52.137298+0000 mon.a (mon.0) 10235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:53 smithi179 bash[23186]: audit 2024-09-21T03:04:52.148265+0000 mon.a (mon.0) 10236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:53 smithi179 bash[23186]: cluster 2024-09-21T03:04:52.685529+0000 mgr.a (mgr.14388) 12570 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:53 smithi049 bash[23528]: audit 2024-09-21T03:04:52.107889+0000 mon.a (mon.0) 10231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:53 smithi049 bash[23528]: audit 2024-09-21T03:04:52.115678+0000 mon.a (mon.0) 10232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:53 smithi049 bash[23528]: audit 2024-09-21T03:04:52.122187+0000 mon.a (mon.0) 10233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:53 smithi049 bash[23528]: audit 2024-09-21T03:04:52.129581+0000 mon.a (mon.0) 10234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:53 smithi049 bash[23528]: audit 2024-09-21T03:04:52.137298+0000 mon.a (mon.0) 10235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:53 smithi049 bash[23528]: audit 2024-09-21T03:04:52.148265+0000 mon.a (mon.0) 10236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:04:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:53 smithi049 bash[23528]: cluster 2024-09-21T03:04:52.685529+0000 mgr.a (mgr.14388) 12570 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:55 smithi179 bash[23186]: cluster 2024-09-21T03:04:54.686320+0000 mgr.a (mgr.14388) 12571 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:56.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:55 smithi049 bash[23528]: cluster 2024-09-21T03:04:54.686320+0000 mgr.a (mgr.14388) 12571 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:04:56.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:04:56.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:04:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:55 smithi044 bash[22676]: cluster 2024-09-21T03:04:54.686320+0000 mgr.a (mgr.14388) 12571 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:04:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:04:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:04:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:04:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:04:56.856 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:04:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:57 smithi179 bash[23186]: audit 2024-09-21T03:04:56.432102+0000 mgr.a (mgr.14388) 12572 : audit [DBG] from='client.274614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:57 smithi179 bash[23186]: cluster 2024-09-21T03:04:56.688028+0000 mgr.a (mgr.14388) 12573 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:57 smithi049 bash[23528]: audit 2024-09-21T03:04:56.432102+0000 mgr.a (mgr.14388) 12572 : audit [DBG] from='client.274614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:57 smithi049 bash[23528]: cluster 2024-09-21T03:04:56.688028+0000 mgr.a (mgr.14388) 12573 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:04:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:57 smithi044 bash[22676]: audit 2024-09-21T03:04:56.432102+0000 mgr.a (mgr.14388) 12572 : audit [DBG] from='client.274614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:04:58.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:57 smithi044 bash[22676]: cluster 2024-09-21T03:04:56.688028+0000 mgr.a (mgr.14388) 12573 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:59 smithi179 bash[23186]: cluster 2024-09-21T03:04:58.688950+0000 mgr.a (mgr.14388) 12574 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:59 smithi179 bash[23186]: audit 2024-09-21T03:04:59.321334+0000 mon.a (mon.0) 10237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:59 smithi179 bash[23186]: audit 2024-09-21T03:04:59.329745+0000 mon.a (mon.0) 10238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:04:59 smithi179 bash[23186]: audit 2024-09-21T03:04:59.340052+0000 mon.a (mon.0) 10239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:59 smithi049 bash[23528]: cluster 2024-09-21T03:04:58.688950+0000 mgr.a (mgr.14388) 12574 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:59 smithi049 bash[23528]: audit 2024-09-21T03:04:59.321334+0000 mon.a (mon.0) 10237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:59 smithi049 bash[23528]: audit 2024-09-21T03:04:59.329745+0000 mon.a (mon.0) 10238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:04:59 smithi049 bash[23528]: audit 2024-09-21T03:04:59.340052+0000 mon.a (mon.0) 10239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:59 smithi044 bash[22676]: cluster 2024-09-21T03:04:58.688950+0000 mgr.a (mgr.14388) 12574 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:59 smithi044 bash[22676]: audit 2024-09-21T03:04:59.321334+0000 mon.a (mon.0) 10237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:59 smithi044 bash[22676]: audit 2024-09-21T03:04:59.329745+0000 mon.a (mon.0) 10238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:04:59 smithi044 bash[22676]: audit 2024-09-21T03:04:59.340052+0000 mon.a (mon.0) 10239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:01.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:01 smithi179 bash[23186]: cluster 2024-09-21T03:05:00.691139+0000 mgr.a (mgr.14388) 12575 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:01 smithi049 bash[23528]: cluster 2024-09-21T03:05:00.691139+0000 mgr.a (mgr.14388) 12575 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:01 smithi044 bash[22676]: cluster 2024-09-21T03:05:00.691139+0000 mgr.a (mgr.14388) 12575 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:02.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:02.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:02.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:02.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:02.643 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:04.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:03 smithi179 bash[23186]: audit 2024-09-21T03:05:02.194180+0000 mgr.a (mgr.14388) 12576 : audit [DBG] from='client.274686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:04.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:03 smithi179 bash[23186]: cluster 2024-09-21T03:05:02.691670+0000 mgr.a (mgr.14388) 12577 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:03 smithi049 bash[23528]: audit 2024-09-21T03:05:02.194180+0000 mgr.a (mgr.14388) 12576 : audit [DBG] from='client.274686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:03 smithi049 bash[23528]: cluster 2024-09-21T03:05:02.691670+0000 mgr.a (mgr.14388) 12577 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:04.191 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:03 smithi044 bash[22676]: audit 2024-09-21T03:05:02.194180+0000 mgr.a (mgr.14388) 12576 : audit [DBG] from='client.274686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:04.191 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:03 smithi044 bash[22676]: cluster 2024-09-21T03:05:02.691670+0000 mgr.a (mgr.14388) 12577 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:05 smithi049 bash[23528]: cluster 2024-09-21T03:05:04.692391+0000 mgr.a (mgr.14388) 12578 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:05 smithi044 bash[22676]: cluster 2024-09-21T03:05:04.692391+0000 mgr.a (mgr.14388) 12578 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:06.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:05 smithi179 bash[23186]: cluster 2024-09-21T03:05:04.692391+0000 mgr.a (mgr.14388) 12578 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:07.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:07.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:07 smithi049 bash[23528]: cluster 2024-09-21T03:05:06.694649+0000 mgr.a (mgr.14388) 12579 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:07 smithi044 bash[22676]: cluster 2024-09-21T03:05:06.694649+0000 mgr.a (mgr.14388) 12579 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:07 smithi179 bash[23186]: cluster 2024-09-21T03:05:06.694649+0000 mgr.a (mgr.14388) 12579 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:08.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:08.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:08.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:08.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:08.441 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:09 smithi049 bash[23528]: audit 2024-09-21T03:05:07.989500+0000 mgr.a (mgr.14388) 12580 : audit [DBG] from='client.274761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:09 smithi049 bash[23528]: cluster 2024-09-21T03:05:08.695639+0000 mgr.a (mgr.14388) 12581 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:09 smithi044 bash[22676]: audit 2024-09-21T03:05:07.989500+0000 mgr.a (mgr.14388) 12580 : audit [DBG] from='client.274761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:09 smithi044 bash[22676]: cluster 2024-09-21T03:05:08.695639+0000 mgr.a (mgr.14388) 12581 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:09 smithi179 bash[23186]: audit 2024-09-21T03:05:07.989500+0000 mgr.a (mgr.14388) 12580 : audit [DBG] from='client.274761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:09 smithi179 bash[23186]: cluster 2024-09-21T03:05:08.695639+0000 mgr.a (mgr.14388) 12581 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:11 smithi049 bash[23528]: cluster 2024-09-21T03:05:10.697886+0000 mgr.a (mgr.14388) 12582 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:11 smithi044 bash[22676]: cluster 2024-09-21T03:05:10.697886+0000 mgr.a (mgr.14388) 12582 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:11 smithi179 bash[23186]: cluster 2024-09-21T03:05:10.697886+0000 mgr.a (mgr.14388) 12582 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:13.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:13.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:13 smithi044 bash[22676]: audit 2024-09-21T03:05:12.325590+0000 mon.a (mon.0) 10240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:13 smithi044 bash[22676]: audit 2024-09-21T03:05:12.334660+0000 mon.a (mon.0) 10241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:13 smithi044 bash[22676]: audit 2024-09-21T03:05:12.343992+0000 mon.a (mon.0) 10242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:13 smithi044 bash[22676]: audit 2024-09-21T03:05:12.356550+0000 mon.a (mon.0) 10243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:13 smithi044 bash[22676]: audit 2024-09-21T03:05:12.365105+0000 mon.a (mon.0) 10244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:13 smithi044 bash[22676]: audit 2024-09-21T03:05:12.376129+0000 mon.a (mon.0) 10245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:13 smithi044 bash[22676]: cluster 2024-09-21T03:05:12.698678+0000 mgr.a (mgr.14388) 12583 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:13 smithi179 bash[23186]: audit 2024-09-21T03:05:12.325590+0000 mon.a (mon.0) 10240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:13 smithi179 bash[23186]: audit 2024-09-21T03:05:12.334660+0000 mon.a (mon.0) 10241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:13 smithi179 bash[23186]: audit 2024-09-21T03:05:12.343992+0000 mon.a (mon.0) 10242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:13 smithi179 bash[23186]: audit 2024-09-21T03:05:12.356550+0000 mon.a (mon.0) 10243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:13 smithi179 bash[23186]: audit 2024-09-21T03:05:12.365105+0000 mon.a (mon.0) 10244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:13 smithi179 bash[23186]: audit 2024-09-21T03:05:12.376129+0000 mon.a (mon.0) 10245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:13 smithi179 bash[23186]: cluster 2024-09-21T03:05:12.698678+0000 mgr.a (mgr.14388) 12583 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:13 smithi049 bash[23528]: audit 2024-09-21T03:05:12.325590+0000 mon.a (mon.0) 10240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:13 smithi049 bash[23528]: audit 2024-09-21T03:05:12.334660+0000 mon.a (mon.0) 10241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:13 smithi049 bash[23528]: audit 2024-09-21T03:05:12.343992+0000 mon.a (mon.0) 10242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:13 smithi049 bash[23528]: audit 2024-09-21T03:05:12.356550+0000 mon.a (mon.0) 10243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:13 smithi049 bash[23528]: audit 2024-09-21T03:05:12.365105+0000 mon.a (mon.0) 10244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:13 smithi049 bash[23528]: audit 2024-09-21T03:05:12.376129+0000 mon.a (mon.0) 10245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:13 smithi049 bash[23528]: cluster 2024-09-21T03:05:12.698678+0000 mgr.a (mgr.14388) 12583 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:14.229 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:14.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:14.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:14.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:14.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:14.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:14 smithi044 bash[22676]: audit 2024-09-21T03:05:13.776577+0000 mgr.a (mgr.14388) 12584 : audit [DBG] from='client.274839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:14 smithi179 bash[23186]: audit 2024-09-21T03:05:13.776577+0000 mgr.a (mgr.14388) 12584 : audit [DBG] from='client.274839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:14 smithi049 bash[23528]: audit 2024-09-21T03:05:13.776577+0000 mgr.a (mgr.14388) 12584 : audit [DBG] from='client.274839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:15.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:15 smithi044 bash[22676]: cluster 2024-09-21T03:05:14.699867+0000 mgr.a (mgr.14388) 12585 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:15.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:15 smithi179 bash[23186]: cluster 2024-09-21T03:05:14.699867+0000 mgr.a (mgr.14388) 12585 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:15.801 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:15 smithi049 bash[23528]: cluster 2024-09-21T03:05:14.699867+0000 mgr.a (mgr.14388) 12585 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:17 smithi049 bash[23528]: cluster 2024-09-21T03:05:16.702199+0000 mgr.a (mgr.14388) 12586 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:17 smithi044 bash[22676]: cluster 2024-09-21T03:05:16.702199+0000 mgr.a (mgr.14388) 12586 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:17 smithi179 bash[23186]: cluster 2024-09-21T03:05:16.702199+0000 mgr.a (mgr.14388) 12586 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:19.231 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:19.231 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:19.989 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:19.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:19.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:19.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:19.989 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:19 smithi049 bash[23528]: cluster 2024-09-21T03:05:18.702961+0000 mgr.a (mgr.14388) 12587 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:19 smithi049 bash[23528]: audit 2024-09-21T03:05:19.548002+0000 mon.a (mon.0) 10246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:19 smithi049 bash[23528]: audit 2024-09-21T03:05:19.553894+0000 mon.a (mon.0) 10247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:19 smithi049 bash[23528]: audit 2024-09-21T03:05:19.567622+0000 mon.a (mon.0) 10248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:19 smithi044 bash[22676]: cluster 2024-09-21T03:05:18.702961+0000 mgr.a (mgr.14388) 12587 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:19 smithi044 bash[22676]: audit 2024-09-21T03:05:19.548002+0000 mon.a (mon.0) 10246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:19 smithi044 bash[22676]: audit 2024-09-21T03:05:19.553894+0000 mon.a (mon.0) 10247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:19 smithi044 bash[22676]: audit 2024-09-21T03:05:19.567622+0000 mon.a (mon.0) 10248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:19 smithi179 bash[23186]: cluster 2024-09-21T03:05:18.702961+0000 mgr.a (mgr.14388) 12587 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:19 smithi179 bash[23186]: audit 2024-09-21T03:05:19.548002+0000 mon.a (mon.0) 10246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:19 smithi179 bash[23186]: audit 2024-09-21T03:05:19.553894+0000 mon.a (mon.0) 10247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:19 smithi179 bash[23186]: audit 2024-09-21T03:05:19.567622+0000 mon.a (mon.0) 10248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:20 smithi049 bash[23528]: audit 2024-09-21T03:05:19.569549+0000 mgr.a (mgr.14388) 12588 : audit [DBG] from='client.274914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:20 smithi044 bash[22676]: audit 2024-09-21T03:05:19.569549+0000 mgr.a (mgr.14388) 12588 : audit [DBG] from='client.274914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:20 smithi179 bash[23186]: audit 2024-09-21T03:05:19.569549+0000 mgr.a (mgr.14388) 12588 : audit [DBG] from='client.274914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:21.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:21 smithi044 bash[22676]: cluster 2024-09-21T03:05:20.705427+0000 mgr.a (mgr.14388) 12589 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:22.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:21 smithi179 bash[23186]: cluster 2024-09-21T03:05:20.705427+0000 mgr.a (mgr.14388) 12589 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:21 smithi049 bash[23528]: cluster 2024-09-21T03:05:20.705427+0000 mgr.a (mgr.14388) 12589 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:05:23.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:23 smithi044 bash[22676]: cluster 2024-09-21T03:05:22.706231+0000 mgr.a (mgr.14388) 12590 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:24.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:23 smithi049 bash[23528]: cluster 2024-09-21T03:05:22.706231+0000 mgr.a (mgr.14388) 12590 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:24.153 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:23 smithi179 bash[23186]: cluster 2024-09-21T03:05:22.706231+0000 mgr.a (mgr.14388) 12590 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:24.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:24.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:24.991 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:25.768 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:25.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:25.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:25 smithi049 bash[23528]: cluster 2024-09-21T03:05:24.706964+0000 mgr.a (mgr.14388) 12591 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:25 smithi044 bash[22676]: cluster 2024-09-21T03:05:24.706964+0000 mgr.a (mgr.14388) 12591 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:25 smithi179 bash[23186]: cluster 2024-09-21T03:05:24.706964+0000 mgr.a (mgr.14388) 12591 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:26 smithi049 bash[23528]: audit 2024-09-21T03:05:25.323301+0000 mgr.a (mgr.14388) 12592 : audit [DBG] from='client.274989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:26 smithi044 bash[22676]: audit 2024-09-21T03:05:25.323301+0000 mgr.a (mgr.14388) 12592 : audit [DBG] from='client.274989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:26 smithi179 bash[23186]: audit 2024-09-21T03:05:25.323301+0000 mgr.a (mgr.14388) 12592 : audit [DBG] from='client.274989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:28.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:27 smithi049 bash[23528]: cluster 2024-09-21T03:05:26.709800+0000 mgr.a (mgr.14388) 12593 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:27 smithi044 bash[22676]: cluster 2024-09-21T03:05:26.709800+0000 mgr.a (mgr.14388) 12593 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:27 smithi179 bash[23186]: cluster 2024-09-21T03:05:26.709800+0000 mgr.a (mgr.14388) 12593 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:29 smithi049 bash[23528]: cluster 2024-09-21T03:05:28.710580+0000 mgr.a (mgr.14388) 12594 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:05:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:29 smithi044 bash[22676]: cluster 2024-09-21T03:05:28.710580+0000 mgr.a (mgr.14388) 12594 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:05:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:29 smithi179 bash[23186]: cluster 2024-09-21T03:05:28.710580+0000 mgr.a (mgr.14388) 12594 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:05:30.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:31.541 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:31 smithi049 bash[23528]: cluster 2024-09-21T03:05:30.712560+0000 mgr.a (mgr.14388) 12595 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:31 smithi044 bash[22676]: cluster 2024-09-21T03:05:30.712560+0000 mgr.a (mgr.14388) 12595 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:32.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:31 smithi179 bash[23186]: cluster 2024-09-21T03:05:30.712560+0000 mgr.a (mgr.14388) 12595 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:32 smithi044 bash[22676]: audit 2024-09-21T03:05:31.106434+0000 mgr.a (mgr.14388) 12596 : audit [DBG] from='client.275064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:32 smithi044 bash[22676]: audit 2024-09-21T03:05:32.558172+0000 mon.a (mon.0) 10249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:32 smithi044 bash[22676]: audit 2024-09-21T03:05:32.565459+0000 mon.a (mon.0) 10250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:32 smithi044 bash[22676]: audit 2024-09-21T03:05:32.572389+0000 mon.a (mon.0) 10251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:32 smithi044 bash[22676]: audit 2024-09-21T03:05:32.602051+0000 mon.a (mon.0) 10252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:32 smithi044 bash[22676]: audit 2024-09-21T03:05:32.610433+0000 mon.a (mon.0) 10253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:32 smithi044 bash[22676]: audit 2024-09-21T03:05:32.620288+0000 mon.a (mon.0) 10254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:32 smithi179 bash[23186]: audit 2024-09-21T03:05:31.106434+0000 mgr.a (mgr.14388) 12596 : audit [DBG] from='client.275064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:32 smithi179 bash[23186]: audit 2024-09-21T03:05:32.558172+0000 mon.a (mon.0) 10249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:32 smithi179 bash[23186]: audit 2024-09-21T03:05:32.565459+0000 mon.a (mon.0) 10250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:32 smithi179 bash[23186]: audit 2024-09-21T03:05:32.572389+0000 mon.a (mon.0) 10251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:32 smithi179 bash[23186]: audit 2024-09-21T03:05:32.602051+0000 mon.a (mon.0) 10252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:32 smithi179 bash[23186]: audit 2024-09-21T03:05:32.610433+0000 mon.a (mon.0) 10253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:32 smithi179 bash[23186]: audit 2024-09-21T03:05:32.620288+0000 mon.a (mon.0) 10254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:32 smithi049 bash[23528]: audit 2024-09-21T03:05:31.106434+0000 mgr.a (mgr.14388) 12596 : audit [DBG] from='client.275064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:32 smithi049 bash[23528]: audit 2024-09-21T03:05:32.558172+0000 mon.a (mon.0) 10249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:32 smithi049 bash[23528]: audit 2024-09-21T03:05:32.565459+0000 mon.a (mon.0) 10250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:32 smithi049 bash[23528]: audit 2024-09-21T03:05:32.572389+0000 mon.a (mon.0) 10251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:32 smithi049 bash[23528]: audit 2024-09-21T03:05:32.602051+0000 mon.a (mon.0) 10252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:32 smithi049 bash[23528]: audit 2024-09-21T03:05:32.610433+0000 mon.a (mon.0) 10253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:32 smithi049 bash[23528]: audit 2024-09-21T03:05:32.620288+0000 mon.a (mon.0) 10254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:33 smithi044 bash[22676]: cluster 2024-09-21T03:05:32.713489+0000 mgr.a (mgr.14388) 12597 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:05:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:33 smithi179 bash[23186]: cluster 2024-09-21T03:05:32.713489+0000 mgr.a (mgr.14388) 12597 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:05:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:33 smithi049 bash[23528]: cluster 2024-09-21T03:05:32.713489+0000 mgr.a (mgr.14388) 12597 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: audit 2024-09-21T03:05:34.488047+0000 mon.a (mon.0) 10255 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: cluster 2024-09-21T03:05:34.714280+0000 mgr.a (mgr.14388) 12598 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: audit 2024-09-21T03:05:35.074208+0000 mon.a (mon.0) 10256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: audit 2024-09-21T03:05:35.082438+0000 mon.a (mon.0) 10257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: audit 2024-09-21T03:05:35.085079+0000 mon.a (mon.0) 10258 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: audit 2024-09-21T03:05:35.086979+0000 mon.a (mon.0) 10259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: audit 2024-09-21T03:05:35.097279+0000 mon.a (mon.0) 10260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22676]: audit 2024-09-21T03:05:35.103422+0000 mon.a (mon.0) 10261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: audit 2024-09-21T03:05:34.488047+0000 mon.a (mon.0) 10255 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: cluster 2024-09-21T03:05:34.714280+0000 mgr.a (mgr.14388) 12598 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: audit 2024-09-21T03:05:35.074208+0000 mon.a (mon.0) 10256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: audit 2024-09-21T03:05:35.082438+0000 mon.a (mon.0) 10257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: audit 2024-09-21T03:05:35.085079+0000 mon.a (mon.0) 10258 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: audit 2024-09-21T03:05:35.086979+0000 mon.a (mon.0) 10259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: audit 2024-09-21T03:05:35.097279+0000 mon.a (mon.0) 10260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:35 smithi179 bash[23186]: audit 2024-09-21T03:05:35.103422+0000 mon.a (mon.0) 10261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:05:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: audit 2024-09-21T03:05:34.488047+0000 mon.a (mon.0) 10255 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:05:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: cluster 2024-09-21T03:05:34.714280+0000 mgr.a (mgr.14388) 12598 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:05:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: audit 2024-09-21T03:05:35.074208+0000 mon.a (mon.0) 10256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: audit 2024-09-21T03:05:35.082438+0000 mon.a (mon.0) 10257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: audit 2024-09-21T03:05:35.085079+0000 mon.a (mon.0) 10258 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:05:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: audit 2024-09-21T03:05:35.086979+0000 mon.a (mon.0) 10259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:05:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: audit 2024-09-21T03:05:35.097279+0000 mon.a (mon.0) 10260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:35 smithi049 bash[23528]: audit 2024-09-21T03:05:35.103422+0000 mon.a (mon.0) 10261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:05:36.203 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22930]: debug 2024-09-21T03:05:35.915+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:05:36.203 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:05:35 smithi044 bash[22930]: debug 2024-09-21T03:05:35.915+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:05:36.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:36 smithi044 bash[22676]: audit 2024-09-21T03:05:35.105790+0000 mgr.a (mgr.14388) 12599 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:05:36.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:36 smithi179 bash[23186]: audit 2024-09-21T03:05:35.105790+0000 mgr.a (mgr.14388) 12599 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:05:36.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:36.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:36.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:36 smithi049 bash[23528]: audit 2024-09-21T03:05:35.105790+0000 mgr.a (mgr.14388) 12599 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:05:37.339 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:37.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:37.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:37.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:37.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:37.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:37 smithi044 bash[22676]: audit 2024-09-21T03:05:35.918542+0000 mgr.a (mgr.14388) 12600 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:05:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:37 smithi044 bash[22676]: cephadm 2024-09-21T03:05:35.920425+0000 mgr.a (mgr.14388) 12601 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:05:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:37 smithi044 bash[22676]: cluster 2024-09-21T03:05:36.715935+0000 mgr.a (mgr.14388) 12602 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:37 smithi044 bash[22676]: audit 2024-09-21T03:05:36.876650+0000 mgr.a (mgr.14388) 12603 : audit [DBG] from='client.275244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:37 smithi179 bash[23186]: audit 2024-09-21T03:05:35.918542+0000 mgr.a (mgr.14388) 12600 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:05:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:37 smithi179 bash[23186]: cephadm 2024-09-21T03:05:35.920425+0000 mgr.a (mgr.14388) 12601 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:05:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:37 smithi179 bash[23186]: cluster 2024-09-21T03:05:36.715935+0000 mgr.a (mgr.14388) 12602 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:37 smithi179 bash[23186]: audit 2024-09-21T03:05:36.876650+0000 mgr.a (mgr.14388) 12603 : audit [DBG] from='client.275244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:37 smithi049 bash[23528]: audit 2024-09-21T03:05:35.918542+0000 mgr.a (mgr.14388) 12600 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:05:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:37 smithi049 bash[23528]: cephadm 2024-09-21T03:05:35.920425+0000 mgr.a (mgr.14388) 12601 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:05:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:37 smithi049 bash[23528]: cluster 2024-09-21T03:05:36.715935+0000 mgr.a (mgr.14388) 12602 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:37 smithi049 bash[23528]: audit 2024-09-21T03:05:36.876650+0000 mgr.a (mgr.14388) 12603 : audit [DBG] from='client.275244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:39 smithi049 bash[23528]: cluster 2024-09-21T03:05:38.716829+0000 mgr.a (mgr.14388) 12604 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:39 smithi044 bash[22676]: cluster 2024-09-21T03:05:38.716829+0000 mgr.a (mgr.14388) 12604 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:39 smithi179 bash[23186]: cluster 2024-09-21T03:05:38.716829+0000 mgr.a (mgr.14388) 12604 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:05:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:40 smithi049 bash[23528]: audit 2024-09-21T03:05:39.793288+0000 mon.a (mon.0) 10262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:40 smithi049 bash[23528]: audit 2024-09-21T03:05:39.802896+0000 mon.a (mon.0) 10263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:40 smithi049 bash[23528]: audit 2024-09-21T03:05:39.814727+0000 mon.a (mon.0) 10264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:40 smithi044 bash[22676]: audit 2024-09-21T03:05:39.793288+0000 mon.a (mon.0) 10262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:40 smithi044 bash[22676]: audit 2024-09-21T03:05:39.802896+0000 mon.a (mon.0) 10263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:40 smithi044 bash[22676]: audit 2024-09-21T03:05:39.814727+0000 mon.a (mon.0) 10264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:40 smithi179 bash[23186]: audit 2024-09-21T03:05:39.793288+0000 mon.a (mon.0) 10262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:40 smithi179 bash[23186]: audit 2024-09-21T03:05:39.802896+0000 mon.a (mon.0) 10263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:40 smithi179 bash[23186]: audit 2024-09-21T03:05:39.814727+0000 mon.a (mon.0) 10264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:42.116 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:41 smithi179 bash[23186]: cluster 2024-09-21T03:05:40.719013+0000 mgr.a (mgr.14388) 12605 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:41 smithi044 bash[22676]: cluster 2024-09-21T03:05:40.719013+0000 mgr.a (mgr.14388) 12605 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:41 smithi049 bash[23528]: cluster 2024-09-21T03:05:40.719013+0000 mgr.a (mgr.14388) 12605 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:42.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:42.341 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:42.341 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:43.158 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:43.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:43.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:43.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:43.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:44.148 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:43 smithi179 bash[23186]: audit 2024-09-21T03:05:42.682987+0000 mgr.a (mgr.14388) 12606 : audit [DBG] from='client.275322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:44.149 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:43 smithi179 bash[23186]: cluster 2024-09-21T03:05:42.720173+0000 mgr.a (mgr.14388) 12607 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:43 smithi044 bash[22676]: audit 2024-09-21T03:05:42.682987+0000 mgr.a (mgr.14388) 12606 : audit [DBG] from='client.275322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:43 smithi044 bash[22676]: cluster 2024-09-21T03:05:42.720173+0000 mgr.a (mgr.14388) 12607 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:43 smithi049 bash[23528]: audit 2024-09-21T03:05:42.682987+0000 mgr.a (mgr.14388) 12606 : audit [DBG] from='client.275322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:43 smithi049 bash[23528]: cluster 2024-09-21T03:05:42.720173+0000 mgr.a (mgr.14388) 12607 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:45 smithi044 bash[22676]: cluster 2024-09-21T03:05:44.720937+0000 mgr.a (mgr.14388) 12608 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:45 smithi179 bash[23186]: cluster 2024-09-21T03:05:44.720937+0000 mgr.a (mgr.14388) 12608 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:45 smithi049 bash[23528]: cluster 2024-09-21T03:05:44.720937+0000 mgr.a (mgr.14388) 12608 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:48.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:48.161 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:48.161 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:47 smithi044 bash[22676]: cluster 2024-09-21T03:05:46.723201+0000 mgr.a (mgr.14388) 12609 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:47 smithi179 bash[23186]: cluster 2024-09-21T03:05:46.723201+0000 mgr.a (mgr.14388) 12609 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:47 smithi049 bash[23528]: cluster 2024-09-21T03:05:46.723201+0000 mgr.a (mgr.14388) 12609 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:48.917 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:48.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:48.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:48.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:48.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:50.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:49 smithi049 bash[23528]: audit 2024-09-21T03:05:48.493849+0000 mgr.a (mgr.14388) 12610 : audit [DBG] from='client.275397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:50.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:49 smithi049 bash[23528]: cluster 2024-09-21T03:05:48.724104+0000 mgr.a (mgr.14388) 12611 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:49 smithi044 bash[22676]: audit 2024-09-21T03:05:48.493849+0000 mgr.a (mgr.14388) 12610 : audit [DBG] from='client.275397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:49 smithi044 bash[22676]: cluster 2024-09-21T03:05:48.724104+0000 mgr.a (mgr.14388) 12611 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:50.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:49 smithi179 bash[23186]: audit 2024-09-21T03:05:48.493849+0000 mgr.a (mgr.14388) 12610 : audit [DBG] from='client.275397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:49 smithi179 bash[23186]: cluster 2024-09-21T03:05:48.724104+0000 mgr.a (mgr.14388) 12611 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:05:52.088 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:51 smithi049 bash[23528]: cluster 2024-09-21T03:05:50.726497+0000 mgr.a (mgr.14388) 12612 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 15 op/s 2024-09-21T03:05:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:51 smithi044 bash[22676]: cluster 2024-09-21T03:05:50.726497+0000 mgr.a (mgr.14388) 12612 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 15 op/s 2024-09-21T03:05:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:51 smithi179 bash[23186]: cluster 2024-09-21T03:05:50.726497+0000 mgr.a (mgr.14388) 12612 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 15 op/s 2024-09-21T03:05:53.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:53.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:53.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:53 smithi049 bash[23528]: cluster 2024-09-21T03:05:52.727197+0000 mgr.a (mgr.14388) 12613 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:53 smithi049 bash[23528]: audit 2024-09-21T03:05:52.779891+0000 mon.a (mon.0) 10265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:53 smithi049 bash[23528]: audit 2024-09-21T03:05:52.785299+0000 mon.a (mon.0) 10266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:53 smithi049 bash[23528]: audit 2024-09-21T03:05:52.792247+0000 mon.a (mon.0) 10267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:53 smithi049 bash[23528]: audit 2024-09-21T03:05:52.830319+0000 mon.a (mon.0) 10268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:53 smithi049 bash[23528]: audit 2024-09-21T03:05:52.836319+0000 mon.a (mon.0) 10269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:53 smithi049 bash[23528]: audit 2024-09-21T03:05:52.850989+0000 mon.a (mon.0) 10270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:53 smithi044 bash[22676]: cluster 2024-09-21T03:05:52.727197+0000 mgr.a (mgr.14388) 12613 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:05:54.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:53 smithi044 bash[22676]: audit 2024-09-21T03:05:52.779891+0000 mon.a (mon.0) 10265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:53 smithi044 bash[22676]: audit 2024-09-21T03:05:52.785299+0000 mon.a (mon.0) 10266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:53 smithi044 bash[22676]: audit 2024-09-21T03:05:52.792247+0000 mon.a (mon.0) 10267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:53 smithi044 bash[22676]: audit 2024-09-21T03:05:52.830319+0000 mon.a (mon.0) 10268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:53 smithi044 bash[22676]: audit 2024-09-21T03:05:52.836319+0000 mon.a (mon.0) 10269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:53 smithi044 bash[22676]: audit 2024-09-21T03:05:52.850989+0000 mon.a (mon.0) 10270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:53 smithi179 bash[23186]: cluster 2024-09-21T03:05:52.727197+0000 mgr.a (mgr.14388) 12613 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:05:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:53 smithi179 bash[23186]: audit 2024-09-21T03:05:52.779891+0000 mon.a (mon.0) 10265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:53 smithi179 bash[23186]: audit 2024-09-21T03:05:52.785299+0000 mon.a (mon.0) 10266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:53 smithi179 bash[23186]: audit 2024-09-21T03:05:52.792247+0000 mon.a (mon.0) 10267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:53 smithi179 bash[23186]: audit 2024-09-21T03:05:52.830319+0000 mon.a (mon.0) 10268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:53 smithi179 bash[23186]: audit 2024-09-21T03:05:52.836319+0000 mon.a (mon.0) 10269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:53 smithi179 bash[23186]: audit 2024-09-21T03:05:52.850989+0000 mon.a (mon.0) 10270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:05:54.675 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:05:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:05:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:05:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:05:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:05:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:55 smithi049 bash[23528]: audit 2024-09-21T03:05:54.248965+0000 mgr.a (mgr.14388) 12614 : audit [DBG] from='client.275475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:55 smithi049 bash[23528]: cluster 2024-09-21T03:05:54.728162+0000 mgr.a (mgr.14388) 12615 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:05:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:55 smithi044 bash[22676]: audit 2024-09-21T03:05:54.248965+0000 mgr.a (mgr.14388) 12614 : audit [DBG] from='client.275475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:55 smithi044 bash[22676]: cluster 2024-09-21T03:05:54.728162+0000 mgr.a (mgr.14388) 12615 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:05:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:55 smithi179 bash[23186]: audit 2024-09-21T03:05:54.248965+0000 mgr.a (mgr.14388) 12614 : audit [DBG] from='client.275475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:05:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:55 smithi179 bash[23186]: cluster 2024-09-21T03:05:54.728162+0000 mgr.a (mgr.14388) 12615 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:05:58.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:57 smithi049 bash[23528]: cluster 2024-09-21T03:05:56.730486+0000 mgr.a (mgr.14388) 12616 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T03:05:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:57 smithi044 bash[22676]: cluster 2024-09-21T03:05:56.730486+0000 mgr.a (mgr.14388) 12616 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T03:05:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:57 smithi179 bash[23186]: cluster 2024-09-21T03:05:56.730486+0000 mgr.a (mgr.14388) 12616 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T03:05:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:05:59.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:05:59.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:05:59 smithi049 bash[23528]: cluster 2024-09-21T03:05:58.731303+0000 mgr.a (mgr.14388) 12617 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:06:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:05:59 smithi044 bash[22676]: cluster 2024-09-21T03:05:58.731303+0000 mgr.a (mgr.14388) 12617 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:06:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:05:59 smithi179 bash[23186]: cluster 2024-09-21T03:05:58.731303+0000 mgr.a (mgr.14388) 12617 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:06:00.464 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:00.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:00.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:00.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:00.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:01 smithi049 bash[23528]: audit 2024-09-21T03:06:00.014922+0000 mon.a (mon.0) 10271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:01 smithi049 bash[23528]: audit 2024-09-21T03:06:00.015433+0000 mgr.a (mgr.14388) 12618 : audit [DBG] from='client.275553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:01 smithi049 bash[23528]: audit 2024-09-21T03:06:00.022660+0000 mon.a (mon.0) 10272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:01 smithi049 bash[23528]: audit 2024-09-21T03:06:00.038733+0000 mon.a (mon.0) 10273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:01 smithi049 bash[23528]: cluster 2024-09-21T03:06:00.734175+0000 mgr.a (mgr.14388) 12619 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:06:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:01 smithi044 bash[22676]: audit 2024-09-21T03:06:00.014922+0000 mon.a (mon.0) 10271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:01 smithi044 bash[22676]: audit 2024-09-21T03:06:00.015433+0000 mgr.a (mgr.14388) 12618 : audit [DBG] from='client.275553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:01 smithi044 bash[22676]: audit 2024-09-21T03:06:00.022660+0000 mon.a (mon.0) 10272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:01 smithi044 bash[22676]: audit 2024-09-21T03:06:00.038733+0000 mon.a (mon.0) 10273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:01 smithi044 bash[22676]: cluster 2024-09-21T03:06:00.734175+0000 mgr.a (mgr.14388) 12619 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:06:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:01 smithi179 bash[23186]: audit 2024-09-21T03:06:00.014922+0000 mon.a (mon.0) 10271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:01 smithi179 bash[23186]: audit 2024-09-21T03:06:00.015433+0000 mgr.a (mgr.14388) 12618 : audit [DBG] from='client.275553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:01 smithi179 bash[23186]: audit 2024-09-21T03:06:00.022660+0000 mon.a (mon.0) 10272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:01 smithi179 bash[23186]: audit 2024-09-21T03:06:00.038733+0000 mon.a (mon.0) 10273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:01 smithi179 bash[23186]: cluster 2024-09-21T03:06:00.734175+0000 mgr.a (mgr.14388) 12619 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:06:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:03 smithi179 bash[23186]: cluster 2024-09-21T03:06:02.734979+0000 mgr.a (mgr.14388) 12620 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:06:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:03 smithi049 bash[23528]: cluster 2024-09-21T03:06:02.734979+0000 mgr.a (mgr.14388) 12620 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:06:04.129 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:03 smithi044 bash[22676]: cluster 2024-09-21T03:06:02.734979+0000 mgr.a (mgr.14388) 12620 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:06:05.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:05.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:05.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:05 smithi049 bash[23528]: cluster 2024-09-21T03:06:04.735756+0000 mgr.a (mgr.14388) 12621 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:06:06.207 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:05 smithi044 bash[22676]: cluster 2024-09-21T03:06:04.735756+0000 mgr.a (mgr.14388) 12621 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:06:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:05 smithi179 bash[23186]: cluster 2024-09-21T03:06:04.735756+0000 mgr.a (mgr.14388) 12621 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:06:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:06 smithi049 bash[23528]: audit 2024-09-21T03:06:05.798000+0000 mgr.a (mgr.14388) 12622 : audit [DBG] from='client.275625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:06 smithi044 bash[22676]: audit 2024-09-21T03:06:05.798000+0000 mgr.a (mgr.14388) 12622 : audit [DBG] from='client.275625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:07.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:06 smithi179 bash[23186]: audit 2024-09-21T03:06:05.798000+0000 mgr.a (mgr.14388) 12622 : audit [DBG] from='client.275625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:07 smithi044 bash[22676]: cluster 2024-09-21T03:06:06.738666+0000 mgr.a (mgr.14388) 12623 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:08.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:07 smithi179 bash[23186]: cluster 2024-09-21T03:06:06.738666+0000 mgr.a (mgr.14388) 12623 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:07 smithi049 bash[23528]: cluster 2024-09-21T03:06:06.738666+0000 mgr.a (mgr.14388) 12623 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:10.105 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:09 smithi049 bash[23528]: cluster 2024-09-21T03:06:08.739514+0000 mgr.a (mgr.14388) 12624 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:06:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:09 smithi044 bash[22676]: cluster 2024-09-21T03:06:08.739514+0000 mgr.a (mgr.14388) 12624 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:06:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:09 smithi179 bash[23186]: cluster 2024-09-21T03:06:08.739514+0000 mgr.a (mgr.14388) 12624 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:06:11.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:11.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:11.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:11.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:12.051 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:11 smithi049 bash[23528]: cluster 2024-09-21T03:06:10.741497+0000 mgr.a (mgr.14388) 12625 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:11 smithi044 bash[22676]: cluster 2024-09-21T03:06:10.741497+0000 mgr.a (mgr.14388) 12625 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:11 smithi179 bash[23186]: cluster 2024-09-21T03:06:10.741497+0000 mgr.a (mgr.14388) 12625 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:13.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:12 smithi044 bash[22676]: audit 2024-09-21T03:06:11.543559+0000 mgr.a (mgr.14388) 12626 : audit [DBG] from='client.275703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:13.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:12 smithi179 bash[23186]: audit 2024-09-21T03:06:11.543559+0000 mgr.a (mgr.14388) 12626 : audit [DBG] from='client.275703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:12 smithi049 bash[23528]: audit 2024-09-21T03:06:11.543559+0000 mgr.a (mgr.14388) 12626 : audit [DBG] from='client.275703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:13 smithi044 bash[22676]: cluster 2024-09-21T03:06:12.742678+0000 mgr.a (mgr.14388) 12627 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:13 smithi044 bash[22676]: audit 2024-09-21T03:06:12.994882+0000 mon.a (mon.0) 10274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:13 smithi044 bash[22676]: audit 2024-09-21T03:06:13.004714+0000 mon.a (mon.0) 10275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:13 smithi044 bash[22676]: audit 2024-09-21T03:06:13.015616+0000 mon.a (mon.0) 10276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:13 smithi044 bash[22676]: audit 2024-09-21T03:06:13.052752+0000 mon.a (mon.0) 10277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:13 smithi044 bash[22676]: audit 2024-09-21T03:06:13.060887+0000 mon.a (mon.0) 10278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:13 smithi044 bash[22676]: audit 2024-09-21T03:06:13.070169+0000 mon.a (mon.0) 10279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:13 smithi179 bash[23186]: cluster 2024-09-21T03:06:12.742678+0000 mgr.a (mgr.14388) 12627 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:13 smithi179 bash[23186]: audit 2024-09-21T03:06:12.994882+0000 mon.a (mon.0) 10274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:13 smithi179 bash[23186]: audit 2024-09-21T03:06:13.004714+0000 mon.a (mon.0) 10275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:13 smithi179 bash[23186]: audit 2024-09-21T03:06:13.015616+0000 mon.a (mon.0) 10276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:13 smithi179 bash[23186]: audit 2024-09-21T03:06:13.052752+0000 mon.a (mon.0) 10277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:13 smithi179 bash[23186]: audit 2024-09-21T03:06:13.060887+0000 mon.a (mon.0) 10278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:13 smithi179 bash[23186]: audit 2024-09-21T03:06:13.070169+0000 mon.a (mon.0) 10279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:13 smithi049 bash[23528]: cluster 2024-09-21T03:06:12.742678+0000 mgr.a (mgr.14388) 12627 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:13 smithi049 bash[23528]: audit 2024-09-21T03:06:12.994882+0000 mon.a (mon.0) 10274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:13 smithi049 bash[23528]: audit 2024-09-21T03:06:13.004714+0000 mon.a (mon.0) 10275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:13 smithi049 bash[23528]: audit 2024-09-21T03:06:13.015616+0000 mon.a (mon.0) 10276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:13 smithi049 bash[23528]: audit 2024-09-21T03:06:13.052752+0000 mon.a (mon.0) 10277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:13 smithi049 bash[23528]: audit 2024-09-21T03:06:13.060887+0000 mon.a (mon.0) 10278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:13 smithi049 bash[23528]: audit 2024-09-21T03:06:13.070169+0000 mon.a (mon.0) 10279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:15 smithi044 bash[22676]: cluster 2024-09-21T03:06:14.743664+0000 mgr.a (mgr.14388) 12628 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:15 smithi179 bash[23186]: cluster 2024-09-21T03:06:14.743664+0000 mgr.a (mgr.14388) 12628 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:15 smithi049 bash[23528]: cluster 2024-09-21T03:06:14.743664+0000 mgr.a (mgr.14388) 12628 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:17.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:17 smithi044 bash[22676]: cluster 2024-09-21T03:06:16.746065+0000 mgr.a (mgr.14388) 12629 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:06:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:17 smithi179 bash[23186]: cluster 2024-09-21T03:06:16.746065+0000 mgr.a (mgr.14388) 12629 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:06:18.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:17 smithi049 bash[23528]: cluster 2024-09-21T03:06:16.746065+0000 mgr.a (mgr.14388) 12629 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:06:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:18 smithi044 bash[22676]: audit 2024-09-21T03:06:17.327415+0000 mgr.a (mgr.14388) 12630 : audit [DBG] from='client.275781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:19.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:18 smithi179 bash[23186]: audit 2024-09-21T03:06:17.327415+0000 mgr.a (mgr.14388) 12630 : audit [DBG] from='client.275781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:19.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:18 smithi049 bash[23528]: audit 2024-09-21T03:06:17.327415+0000 mgr.a (mgr.14388) 12630 : audit [DBG] from='client.275781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:19 smithi044 bash[22676]: cluster 2024-09-21T03:06:18.747191+0000 mgr.a (mgr.14388) 12631 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:20.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:19 smithi179 bash[23186]: cluster 2024-09-21T03:06:18.747191+0000 mgr.a (mgr.14388) 12631 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:20.271 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:19 smithi049 bash[23528]: cluster 2024-09-21T03:06:18.747191+0000 mgr.a (mgr.14388) 12631 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:06:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:21 smithi179 bash[23186]: audit 2024-09-21T03:06:20.249890+0000 mon.a (mon.0) 10280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:21 smithi179 bash[23186]: audit 2024-09-21T03:06:20.258545+0000 mon.a (mon.0) 10281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:21 smithi179 bash[23186]: audit 2024-09-21T03:06:20.269040+0000 mon.a (mon.0) 10282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:21 smithi179 bash[23186]: cluster 2024-09-21T03:06:20.749572+0000 mgr.a (mgr.14388) 12632 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:21 smithi049 bash[23528]: audit 2024-09-21T03:06:20.249890+0000 mon.a (mon.0) 10280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:21 smithi049 bash[23528]: audit 2024-09-21T03:06:20.258545+0000 mon.a (mon.0) 10281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:21 smithi049 bash[23528]: audit 2024-09-21T03:06:20.269040+0000 mon.a (mon.0) 10282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:21 smithi049 bash[23528]: cluster 2024-09-21T03:06:20.749572+0000 mgr.a (mgr.14388) 12632 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:06:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:21 smithi044 bash[22676]: audit 2024-09-21T03:06:20.249890+0000 mon.a (mon.0) 10280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:21 smithi044 bash[22676]: audit 2024-09-21T03:06:20.258545+0000 mon.a (mon.0) 10281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:21 smithi044 bash[22676]: audit 2024-09-21T03:06:20.269040+0000 mon.a (mon.0) 10282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:21 smithi044 bash[22676]: cluster 2024-09-21T03:06:20.749572+0000 mgr.a (mgr.14388) 12632 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:06:22.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:22.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:22.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:23.548 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:23.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:23.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:23.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:23.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:23 smithi044 bash[22676]: cluster 2024-09-21T03:06:22.750518+0000 mgr.a (mgr.14388) 12633 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:24.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:23 smithi179 bash[23186]: cluster 2024-09-21T03:06:22.750518+0000 mgr.a (mgr.14388) 12633 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:23 smithi049 bash[23528]: cluster 2024-09-21T03:06:22.750518+0000 mgr.a (mgr.14388) 12633 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:24 smithi179 bash[23186]: audit 2024-09-21T03:06:23.120919+0000 mgr.a (mgr.14388) 12634 : audit [DBG] from='client.275856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:24 smithi044 bash[22676]: audit 2024-09-21T03:06:23.120919+0000 mgr.a (mgr.14388) 12634 : audit [DBG] from='client.275856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:24 smithi049 bash[23528]: audit 2024-09-21T03:06:23.120919+0000 mgr.a (mgr.14388) 12634 : audit [DBG] from='client.275856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:26.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:25 smithi044 bash[22676]: cluster 2024-09-21T03:06:24.751628+0000 mgr.a (mgr.14388) 12635 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:25 smithi179 bash[23186]: cluster 2024-09-21T03:06:24.751628+0000 mgr.a (mgr.14388) 12635 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:25 smithi049 bash[23528]: cluster 2024-09-21T03:06:24.751628+0000 mgr.a (mgr.14388) 12635 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:27 smithi044 bash[22676]: cluster 2024-09-21T03:06:26.754086+0000 mgr.a (mgr.14388) 12636 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:27 smithi179 bash[23186]: cluster 2024-09-21T03:06:26.754086+0000 mgr.a (mgr.14388) 12636 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:27 smithi049 bash[23528]: cluster 2024-09-21T03:06:26.754086+0000 mgr.a (mgr.14388) 12636 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:28.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:28.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:29.321 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:29 smithi044 bash[22676]: cluster 2024-09-21T03:06:28.754877+0000 mgr.a (mgr.14388) 12637 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:29 smithi044 bash[22676]: audit 2024-09-21T03:06:28.884380+0000 mgr.a (mgr.14388) 12638 : audit [DBG] from='client.275934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:29 smithi179 bash[23186]: cluster 2024-09-21T03:06:28.754877+0000 mgr.a (mgr.14388) 12637 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:29 smithi179 bash[23186]: audit 2024-09-21T03:06:28.884380+0000 mgr.a (mgr.14388) 12638 : audit [DBG] from='client.275934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:30.252 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:29 smithi049 bash[23528]: cluster 2024-09-21T03:06:28.754877+0000 mgr.a (mgr.14388) 12637 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:30.252 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:29 smithi049 bash[23528]: audit 2024-09-21T03:06:28.884380+0000 mgr.a (mgr.14388) 12638 : audit [DBG] from='client.275934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:31 smithi044 bash[22676]: cluster 2024-09-21T03:06:30.757143+0000 mgr.a (mgr.14388) 12639 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:31 smithi179 bash[23186]: cluster 2024-09-21T03:06:30.757143+0000 mgr.a (mgr.14388) 12639 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:32.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:31 smithi049 bash[23528]: cluster 2024-09-21T03:06:30.757143+0000 mgr.a (mgr.14388) 12639 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:33 smithi044 bash[22676]: cluster 2024-09-21T03:06:32.757940+0000 mgr.a (mgr.14388) 12640 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:33 smithi044 bash[22676]: audit 2024-09-21T03:06:33.224115+0000 mon.a (mon.0) 10283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:33 smithi044 bash[22676]: audit 2024-09-21T03:06:33.230119+0000 mon.a (mon.0) 10284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:33 smithi044 bash[22676]: audit 2024-09-21T03:06:33.238564+0000 mon.a (mon.0) 10285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:33 smithi044 bash[22676]: audit 2024-09-21T03:06:33.290547+0000 mon.a (mon.0) 10286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:33 smithi044 bash[22676]: audit 2024-09-21T03:06:33.299079+0000 mon.a (mon.0) 10287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:33 smithi044 bash[22676]: audit 2024-09-21T03:06:33.309386+0000 mon.a (mon.0) 10288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:33 smithi179 bash[23186]: cluster 2024-09-21T03:06:32.757940+0000 mgr.a (mgr.14388) 12640 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:33 smithi179 bash[23186]: audit 2024-09-21T03:06:33.224115+0000 mon.a (mon.0) 10283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:33 smithi179 bash[23186]: audit 2024-09-21T03:06:33.230119+0000 mon.a (mon.0) 10284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:33 smithi179 bash[23186]: audit 2024-09-21T03:06:33.238564+0000 mon.a (mon.0) 10285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:33 smithi179 bash[23186]: audit 2024-09-21T03:06:33.290547+0000 mon.a (mon.0) 10286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:33 smithi179 bash[23186]: audit 2024-09-21T03:06:33.299079+0000 mon.a (mon.0) 10287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:33 smithi179 bash[23186]: audit 2024-09-21T03:06:33.309386+0000 mon.a (mon.0) 10288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:33 smithi049 bash[23528]: cluster 2024-09-21T03:06:32.757940+0000 mgr.a (mgr.14388) 12640 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:33 smithi049 bash[23528]: audit 2024-09-21T03:06:33.224115+0000 mon.a (mon.0) 10283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:33 smithi049 bash[23528]: audit 2024-09-21T03:06:33.230119+0000 mon.a (mon.0) 10284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:33 smithi049 bash[23528]: audit 2024-09-21T03:06:33.238564+0000 mon.a (mon.0) 10285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:33 smithi049 bash[23528]: audit 2024-09-21T03:06:33.290547+0000 mon.a (mon.0) 10286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:33 smithi049 bash[23528]: audit 2024-09-21T03:06:33.299079+0000 mon.a (mon.0) 10287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:33 smithi049 bash[23528]: audit 2024-09-21T03:06:33.309386+0000 mon.a (mon.0) 10288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:34.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:34.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:34.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:35.119 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:35.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:35.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:35.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:35.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:35 smithi044 bash[22676]: audit 2024-09-21T03:06:34.658155+0000 mgr.a (mgr.14388) 12641 : audit [DBG] from='client.276012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:35 smithi044 bash[22676]: cluster 2024-09-21T03:06:34.758478+0000 mgr.a (mgr.14388) 12642 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:35 smithi179 bash[23186]: audit 2024-09-21T03:06:34.658155+0000 mgr.a (mgr.14388) 12641 : audit [DBG] from='client.276012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:35 smithi179 bash[23186]: cluster 2024-09-21T03:06:34.758478+0000 mgr.a (mgr.14388) 12642 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:35 smithi049 bash[23528]: audit 2024-09-21T03:06:34.658155+0000 mgr.a (mgr.14388) 12641 : audit [DBG] from='client.276012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:35 smithi049 bash[23528]: cluster 2024-09-21T03:06:34.758478+0000 mgr.a (mgr.14388) 12642 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:37.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:06:36 smithi044 bash[22930]: debug 2024-09-21T03:06:36.794+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:06:37.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:06:36 smithi044 bash[22930]: debug 2024-09-21T03:06:36.794+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:06:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:36 smithi044 bash[22676]: audit 2024-09-21T03:06:35.986799+0000 mon.a (mon.0) 10289 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:06:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:36 smithi044 bash[22676]: audit 2024-09-21T03:06:35.993752+0000 mon.a (mon.0) 10290 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:06:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:36 smithi044 bash[22676]: audit 2024-09-21T03:06:35.995687+0000 mon.a (mon.0) 10291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:06:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:36 smithi044 bash[22676]: audit 2024-09-21T03:06:36.007387+0000 mon.a (mon.0) 10292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:36 smithi044 bash[22676]: audit 2024-09-21T03:06:36.014541+0000 mon.a (mon.0) 10293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:06:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:36 smithi179 bash[23186]: audit 2024-09-21T03:06:35.986799+0000 mon.a (mon.0) 10289 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:06:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:36 smithi179 bash[23186]: audit 2024-09-21T03:06:35.993752+0000 mon.a (mon.0) 10290 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:06:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:36 smithi179 bash[23186]: audit 2024-09-21T03:06:35.995687+0000 mon.a (mon.0) 10291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:06:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:36 smithi179 bash[23186]: audit 2024-09-21T03:06:36.007387+0000 mon.a (mon.0) 10292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:36 smithi179 bash[23186]: audit 2024-09-21T03:06:36.014541+0000 mon.a (mon.0) 10293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:06:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:36 smithi049 bash[23528]: audit 2024-09-21T03:06:35.986799+0000 mon.a (mon.0) 10289 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:06:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:36 smithi049 bash[23528]: audit 2024-09-21T03:06:35.993752+0000 mon.a (mon.0) 10290 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:06:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:36 smithi049 bash[23528]: audit 2024-09-21T03:06:35.995687+0000 mon.a (mon.0) 10291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:06:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:36 smithi049 bash[23528]: audit 2024-09-21T03:06:36.007387+0000 mon.a (mon.0) 10292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:36 smithi049 bash[23528]: audit 2024-09-21T03:06:36.014541+0000 mon.a (mon.0) 10293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:06:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:37 smithi044 bash[22676]: audit 2024-09-21T03:06:36.017238+0000 mgr.a (mgr.14388) 12643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:06:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:37 smithi044 bash[22676]: cluster 2024-09-21T03:06:36.761221+0000 mgr.a (mgr.14388) 12644 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:06:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:37 smithi044 bash[22676]: audit 2024-09-21T03:06:36.798715+0000 mgr.a (mgr.14388) 12645 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:06:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:37 smithi044 bash[22676]: cephadm 2024-09-21T03:06:36.800593+0000 mgr.a (mgr.14388) 12646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:06:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:37 smithi179 bash[23186]: audit 2024-09-21T03:06:36.017238+0000 mgr.a (mgr.14388) 12643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:06:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:37 smithi179 bash[23186]: cluster 2024-09-21T03:06:36.761221+0000 mgr.a (mgr.14388) 12644 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:06:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:37 smithi179 bash[23186]: audit 2024-09-21T03:06:36.798715+0000 mgr.a (mgr.14388) 12645 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:06:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:37 smithi179 bash[23186]: cephadm 2024-09-21T03:06:36.800593+0000 mgr.a (mgr.14388) 12646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:06:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:37 smithi049 bash[23528]: audit 2024-09-21T03:06:36.017238+0000 mgr.a (mgr.14388) 12643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:06:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:37 smithi049 bash[23528]: cluster 2024-09-21T03:06:36.761221+0000 mgr.a (mgr.14388) 12644 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:06:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:37 smithi049 bash[23528]: audit 2024-09-21T03:06:36.798715+0000 mgr.a (mgr.14388) 12645 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:06:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:37 smithi049 bash[23528]: cephadm 2024-09-21T03:06:36.800593+0000 mgr.a (mgr.14388) 12646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:06:40.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:40.121 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:40.121 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:39 smithi044 bash[22676]: cluster 2024-09-21T03:06:38.762055+0000 mgr.a (mgr.14388) 12647 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:06:40.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:39 smithi179 bash[23186]: cluster 2024-09-21T03:06:38.762055+0000 mgr.a (mgr.14388) 12647 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:06:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:39 smithi049 bash[23528]: cluster 2024-09-21T03:06:38.762055+0000 mgr.a (mgr.14388) 12647 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:06:40.878 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:41 smithi179 bash[23186]: audit 2024-09-21T03:06:40.459516+0000 mgr.a (mgr.14388) 12648 : audit [DBG] from='client.276198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:41 smithi179 bash[23186]: audit 2024-09-21T03:06:40.494541+0000 mon.a (mon.0) 10294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:41 smithi179 bash[23186]: audit 2024-09-21T03:06:40.502304+0000 mon.a (mon.0) 10295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:41 smithi179 bash[23186]: audit 2024-09-21T03:06:40.511042+0000 mon.a (mon.0) 10296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:41 smithi179 bash[23186]: cluster 2024-09-21T03:06:40.763566+0000 mgr.a (mgr.14388) 12649 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:41 smithi049 bash[23528]: audit 2024-09-21T03:06:40.459516+0000 mgr.a (mgr.14388) 12648 : audit [DBG] from='client.276198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:41 smithi049 bash[23528]: audit 2024-09-21T03:06:40.494541+0000 mon.a (mon.0) 10294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:41 smithi049 bash[23528]: audit 2024-09-21T03:06:40.502304+0000 mon.a (mon.0) 10295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:41 smithi049 bash[23528]: audit 2024-09-21T03:06:40.511042+0000 mon.a (mon.0) 10296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:41 smithi049 bash[23528]: cluster 2024-09-21T03:06:40.763566+0000 mgr.a (mgr.14388) 12649 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:41 smithi044 bash[22676]: audit 2024-09-21T03:06:40.459516+0000 mgr.a (mgr.14388) 12648 : audit [DBG] from='client.276198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:41 smithi044 bash[22676]: audit 2024-09-21T03:06:40.494541+0000 mon.a (mon.0) 10294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:41 smithi044 bash[22676]: audit 2024-09-21T03:06:40.502304+0000 mon.a (mon.0) 10295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:41 smithi044 bash[22676]: audit 2024-09-21T03:06:40.511042+0000 mon.a (mon.0) 10296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:41 smithi044 bash[22676]: cluster 2024-09-21T03:06:40.763566+0000 mgr.a (mgr.14388) 12649 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:43 smithi044 bash[22676]: cluster 2024-09-21T03:06:42.764463+0000 mgr.a (mgr.14388) 12650 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:44.214 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:43 smithi179 bash[23186]: cluster 2024-09-21T03:06:42.764463+0000 mgr.a (mgr.14388) 12650 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:43 smithi049 bash[23528]: cluster 2024-09-21T03:06:42.764463+0000 mgr.a (mgr.14388) 12650 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:45.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:45.880 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:45.880 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:46.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:45 smithi044 bash[22676]: cluster 2024-09-21T03:06:44.765325+0000 mgr.a (mgr.14388) 12651 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:45 smithi179 bash[23186]: cluster 2024-09-21T03:06:44.765325+0000 mgr.a (mgr.14388) 12651 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:46.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:45 smithi049 bash[23528]: cluster 2024-09-21T03:06:44.765325+0000 mgr.a (mgr.14388) 12651 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:46.631 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:47 smithi044 bash[22676]: audit 2024-09-21T03:06:46.217034+0000 mgr.a (mgr.14388) 12652 : audit [DBG] from='client.276276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:47 smithi044 bash[22676]: cluster 2024-09-21T03:06:46.768256+0000 mgr.a (mgr.14388) 12653 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:47 smithi179 bash[23186]: audit 2024-09-21T03:06:46.217034+0000 mgr.a (mgr.14388) 12652 : audit [DBG] from='client.276276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:47 smithi179 bash[23186]: cluster 2024-09-21T03:06:46.768256+0000 mgr.a (mgr.14388) 12653 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:47 smithi049 bash[23528]: audit 2024-09-21T03:06:46.217034+0000 mgr.a (mgr.14388) 12652 : audit [DBG] from='client.276276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:47 smithi049 bash[23528]: cluster 2024-09-21T03:06:46.768256+0000 mgr.a (mgr.14388) 12653 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:49 smithi044 bash[22676]: cluster 2024-09-21T03:06:48.769235+0000 mgr.a (mgr.14388) 12654 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:49 smithi179 bash[23186]: cluster 2024-09-21T03:06:48.769235+0000 mgr.a (mgr.14388) 12654 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:49 smithi049 bash[23528]: cluster 2024-09-21T03:06:48.769235+0000 mgr.a (mgr.14388) 12654 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:06:51.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:51.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:51.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:51 smithi049 bash[23528]: cluster 2024-09-21T03:06:50.771439+0000 mgr.a (mgr.14388) 12655 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:51 smithi044 bash[22676]: cluster 2024-09-21T03:06:50.771439+0000 mgr.a (mgr.14388) 12655 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:51 smithi179 bash[23186]: cluster 2024-09-21T03:06:50.771439+0000 mgr.a (mgr.14388) 12655 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:06:52.389 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:52.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:52.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:52.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:52.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: audit 2024-09-21T03:06:51.969363+0000 mgr.a (mgr.14388) 12656 : audit [DBG] from='client.276348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: cluster 2024-09-21T03:06:52.772448+0000 mgr.a (mgr.14388) 12657 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: audit 2024-09-21T03:06:53.453465+0000 mon.a (mon.0) 10297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: audit 2024-09-21T03:06:53.459229+0000 mon.a (mon.0) 10298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: audit 2024-09-21T03:06:53.468079+0000 mon.a (mon.0) 10299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: audit 2024-09-21T03:06:53.513430+0000 mon.a (mon.0) 10300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: audit 2024-09-21T03:06:53.520895+0000 mon.a (mon.0) 10301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:53 smithi044 bash[22676]: audit 2024-09-21T03:06:53.527813+0000 mon.a (mon.0) 10302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: audit 2024-09-21T03:06:51.969363+0000 mgr.a (mgr.14388) 12656 : audit [DBG] from='client.276348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: cluster 2024-09-21T03:06:52.772448+0000 mgr.a (mgr.14388) 12657 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: audit 2024-09-21T03:06:53.453465+0000 mon.a (mon.0) 10297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: audit 2024-09-21T03:06:53.459229+0000 mon.a (mon.0) 10298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: audit 2024-09-21T03:06:53.468079+0000 mon.a (mon.0) 10299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: audit 2024-09-21T03:06:53.513430+0000 mon.a (mon.0) 10300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: audit 2024-09-21T03:06:53.520895+0000 mon.a (mon.0) 10301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:53 smithi179 bash[23186]: audit 2024-09-21T03:06:53.527813+0000 mon.a (mon.0) 10302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: audit 2024-09-21T03:06:51.969363+0000 mgr.a (mgr.14388) 12656 : audit [DBG] from='client.276348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: cluster 2024-09-21T03:06:52.772448+0000 mgr.a (mgr.14388) 12657 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: audit 2024-09-21T03:06:53.453465+0000 mon.a (mon.0) 10297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: audit 2024-09-21T03:06:53.459229+0000 mon.a (mon.0) 10298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: audit 2024-09-21T03:06:53.468079+0000 mon.a (mon.0) 10299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: audit 2024-09-21T03:06:53.513430+0000 mon.a (mon.0) 10300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: audit 2024-09-21T03:06:53.520895+0000 mon.a (mon.0) 10301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:53 smithi049 bash[23528]: audit 2024-09-21T03:06:53.527813+0000 mon.a (mon.0) 10302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:06:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:55 smithi044 bash[22676]: cluster 2024-09-21T03:06:54.773231+0000 mgr.a (mgr.14388) 12658 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:55 smithi179 bash[23186]: cluster 2024-09-21T03:06:54.773231+0000 mgr.a (mgr.14388) 12658 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:55 smithi049 bash[23528]: cluster 2024-09-21T03:06:54.773231+0000 mgr.a (mgr.14388) 12658 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:06:57.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:06:57.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:06:57.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:06:58.166 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:06:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:06:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:06:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:06:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:06:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:57 smithi044 bash[22676]: cluster 2024-09-21T03:06:56.775566+0000 mgr.a (mgr.14388) 12659 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:57 smithi179 bash[23186]: cluster 2024-09-21T03:06:56.775566+0000 mgr.a (mgr.14388) 12659 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:57 smithi049 bash[23528]: cluster 2024-09-21T03:06:56.775566+0000 mgr.a (mgr.14388) 12659 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:06:59.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:58 smithi044 bash[22676]: audit 2024-09-21T03:06:57.726216+0000 mgr.a (mgr.14388) 12660 : audit [DBG] from='client.276420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:58 smithi179 bash[23186]: audit 2024-09-21T03:06:57.726216+0000 mgr.a (mgr.14388) 12660 : audit [DBG] from='client.276420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:06:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:58 smithi049 bash[23528]: audit 2024-09-21T03:06:57.726216+0000 mgr.a (mgr.14388) 12660 : audit [DBG] from='client.276420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:06:59 smithi049 bash[23528]: cluster 2024-09-21T03:06:58.776712+0000 mgr.a (mgr.14388) 12661 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:06:59 smithi044 bash[22676]: cluster 2024-09-21T03:06:58.776712+0000 mgr.a (mgr.14388) 12661 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:06:59 smithi179 bash[23186]: cluster 2024-09-21T03:06:58.776712+0000 mgr.a (mgr.14388) 12661 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:01 smithi044 bash[22676]: audit 2024-09-21T03:07:00.726795+0000 mon.a (mon.0) 10303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:01 smithi044 bash[22676]: audit 2024-09-21T03:07:00.735507+0000 mon.a (mon.0) 10304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:01 smithi044 bash[22676]: audit 2024-09-21T03:07:00.746107+0000 mon.a (mon.0) 10305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:01 smithi044 bash[22676]: cluster 2024-09-21T03:07:00.779055+0000 mgr.a (mgr.14388) 12662 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:02.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:01 smithi179 bash[23186]: audit 2024-09-21T03:07:00.726795+0000 mon.a (mon.0) 10303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:01 smithi179 bash[23186]: audit 2024-09-21T03:07:00.735507+0000 mon.a (mon.0) 10304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:01 smithi179 bash[23186]: audit 2024-09-21T03:07:00.746107+0000 mon.a (mon.0) 10305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:02.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:01 smithi179 bash[23186]: cluster 2024-09-21T03:07:00.779055+0000 mgr.a (mgr.14388) 12662 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:01 smithi049 bash[23528]: audit 2024-09-21T03:07:00.726795+0000 mon.a (mon.0) 10303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:01 smithi049 bash[23528]: audit 2024-09-21T03:07:00.735507+0000 mon.a (mon.0) 10304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:01 smithi049 bash[23528]: audit 2024-09-21T03:07:00.746107+0000 mon.a (mon.0) 10305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:01 smithi049 bash[23528]: cluster 2024-09-21T03:07:00.779055+0000 mgr.a (mgr.14388) 12662 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:03.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:03.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:03.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:03.953 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:03.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:03 smithi179 bash[23186]: cluster 2024-09-21T03:07:02.779815+0000 mgr.a (mgr.14388) 12663 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:04.102 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:03 smithi044 bash[22676]: cluster 2024-09-21T03:07:02.779815+0000 mgr.a (mgr.14388) 12663 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:03 smithi049 bash[23528]: cluster 2024-09-21T03:07:02.779815+0000 mgr.a (mgr.14388) 12663 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:04.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:04 smithi044 bash[22676]: audit 2024-09-21T03:07:03.507452+0000 mgr.a (mgr.14388) 12664 : audit [DBG] from='client.276495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:04 smithi179 bash[23186]: audit 2024-09-21T03:07:03.507452+0000 mgr.a (mgr.14388) 12664 : audit [DBG] from='client.276495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:04 smithi049 bash[23528]: audit 2024-09-21T03:07:03.507452+0000 mgr.a (mgr.14388) 12664 : audit [DBG] from='client.276495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:05.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:05 smithi044 bash[22676]: cluster 2024-09-21T03:07:04.780754+0000 mgr.a (mgr.14388) 12665 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:05 smithi179 bash[23186]: cluster 2024-09-21T03:07:04.780754+0000 mgr.a (mgr.14388) 12665 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:05 smithi049 bash[23528]: cluster 2024-09-21T03:07:04.780754+0000 mgr.a (mgr.14388) 12665 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:07 smithi044 bash[22676]: cluster 2024-09-21T03:07:06.782398+0000 mgr.a (mgr.14388) 12666 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:07 smithi179 bash[23186]: cluster 2024-09-21T03:07:06.782398+0000 mgr.a (mgr.14388) 12666 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:07 smithi049 bash[23528]: cluster 2024-09-21T03:07:06.782398+0000 mgr.a (mgr.14388) 12666 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:08.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:08.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:08.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:09.734 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:09.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:09.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:09.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:09.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:09 smithi044 bash[22676]: cluster 2024-09-21T03:07:08.783290+0000 mgr.a (mgr.14388) 12667 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:09 smithi179 bash[23186]: cluster 2024-09-21T03:07:08.783290+0000 mgr.a (mgr.14388) 12667 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:09 smithi049 bash[23528]: cluster 2024-09-21T03:07:08.783290+0000 mgr.a (mgr.14388) 12667 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:11.136 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:10 smithi049 bash[23528]: audit 2024-09-21T03:07:09.289766+0000 mgr.a (mgr.14388) 12668 : audit [DBG] from='client.276570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:10 smithi044 bash[22676]: audit 2024-09-21T03:07:09.289766+0000 mgr.a (mgr.14388) 12668 : audit [DBG] from='client.276570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:10 smithi179 bash[23186]: audit 2024-09-21T03:07:09.289766+0000 mgr.a (mgr.14388) 12668 : audit [DBG] from='client.276570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:12.128 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:11 smithi049 bash[23528]: cluster 2024-09-21T03:07:10.785873+0000 mgr.a (mgr.14388) 12669 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:11 smithi044 bash[22676]: cluster 2024-09-21T03:07:10.785873+0000 mgr.a (mgr.14388) 12669 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:12.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:11 smithi179 bash[23186]: cluster 2024-09-21T03:07:10.785873+0000 mgr.a (mgr.14388) 12669 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:13 smithi179 bash[23186]: cluster 2024-09-21T03:07:12.786824+0000 mgr.a (mgr.14388) 12670 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:13 smithi179 bash[23186]: audit 2024-09-21T03:07:13.678441+0000 mon.a (mon.0) 10306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:13 smithi179 bash[23186]: audit 2024-09-21T03:07:13.685752+0000 mon.a (mon.0) 10307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:13 smithi179 bash[23186]: audit 2024-09-21T03:07:13.695570+0000 mon.a (mon.0) 10308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:13 smithi179 bash[23186]: audit 2024-09-21T03:07:13.736499+0000 mon.a (mon.0) 10309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:13 smithi179 bash[23186]: audit 2024-09-21T03:07:13.744647+0000 mon.a (mon.0) 10310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:13 smithi179 bash[23186]: audit 2024-09-21T03:07:13.753113+0000 mon.a (mon.0) 10311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:13 smithi049 bash[23528]: cluster 2024-09-21T03:07:12.786824+0000 mgr.a (mgr.14388) 12670 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:13 smithi049 bash[23528]: audit 2024-09-21T03:07:13.678441+0000 mon.a (mon.0) 10306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:13 smithi049 bash[23528]: audit 2024-09-21T03:07:13.685752+0000 mon.a (mon.0) 10307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:13 smithi049 bash[23528]: audit 2024-09-21T03:07:13.695570+0000 mon.a (mon.0) 10308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:13 smithi049 bash[23528]: audit 2024-09-21T03:07:13.736499+0000 mon.a (mon.0) 10309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:13 smithi049 bash[23528]: audit 2024-09-21T03:07:13.744647+0000 mon.a (mon.0) 10310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:13 smithi049 bash[23528]: audit 2024-09-21T03:07:13.753113+0000 mon.a (mon.0) 10311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:13 smithi044 bash[22676]: cluster 2024-09-21T03:07:12.786824+0000 mgr.a (mgr.14388) 12670 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:13 smithi044 bash[22676]: audit 2024-09-21T03:07:13.678441+0000 mon.a (mon.0) 10306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:13 smithi044 bash[22676]: audit 2024-09-21T03:07:13.685752+0000 mon.a (mon.0) 10307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:13 smithi044 bash[22676]: audit 2024-09-21T03:07:13.695570+0000 mon.a (mon.0) 10308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:13 smithi044 bash[22676]: audit 2024-09-21T03:07:13.736499+0000 mon.a (mon.0) 10309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:13 smithi044 bash[22676]: audit 2024-09-21T03:07:13.744647+0000 mon.a (mon.0) 10310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:13 smithi044 bash[22676]: audit 2024-09-21T03:07:13.753113+0000 mon.a (mon.0) 10311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:14.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:14.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:14.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:15.532 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:15.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:15.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:15.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:15.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:16.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:15 smithi044 bash[22676]: cluster 2024-09-21T03:07:14.787779+0000 mgr.a (mgr.14388) 12671 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:15 smithi179 bash[23186]: cluster 2024-09-21T03:07:14.787779+0000 mgr.a (mgr.14388) 12671 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:15 smithi049 bash[23528]: cluster 2024-09-21T03:07:14.787779+0000 mgr.a (mgr.14388) 12671 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:17.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:16 smithi044 bash[22676]: audit 2024-09-21T03:07:15.074216+0000 mgr.a (mgr.14388) 12672 : audit [DBG] from='client.276648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:16 smithi179 bash[23186]: audit 2024-09-21T03:07:15.074216+0000 mgr.a (mgr.14388) 12672 : audit [DBG] from='client.276648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:16 smithi049 bash[23528]: audit 2024-09-21T03:07:15.074216+0000 mgr.a (mgr.14388) 12672 : audit [DBG] from='client.276648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:17 smithi044 bash[22676]: cluster 2024-09-21T03:07:16.790717+0000 mgr.a (mgr.14388) 12673 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:18.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:17 smithi179 bash[23186]: cluster 2024-09-21T03:07:16.790717+0000 mgr.a (mgr.14388) 12673 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:17 smithi049 bash[23528]: cluster 2024-09-21T03:07:16.790717+0000 mgr.a (mgr.14388) 12673 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:20.228 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:19 smithi049 bash[23528]: cluster 2024-09-21T03:07:18.791666+0000 mgr.a (mgr.14388) 12674 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:19 smithi044 bash[22676]: cluster 2024-09-21T03:07:18.791666+0000 mgr.a (mgr.14388) 12674 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:19 smithi179 bash[23186]: cluster 2024-09-21T03:07:18.791666+0000 mgr.a (mgr.14388) 12674 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:20.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:21.321 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:21.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:21.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:21.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:21.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:21 smithi044 bash[22676]: cluster 2024-09-21T03:07:20.793675+0000 mgr.a (mgr.14388) 12675 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:21 smithi044 bash[22676]: audit 2024-09-21T03:07:20.867133+0000 mgr.a (mgr.14388) 12676 : audit [DBG] from='client.276723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:21 smithi044 bash[22676]: audit 2024-09-21T03:07:20.951399+0000 mon.a (mon.0) 10312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:21 smithi044 bash[22676]: audit 2024-09-21T03:07:20.957216+0000 mon.a (mon.0) 10313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:21 smithi044 bash[22676]: audit 2024-09-21T03:07:20.963166+0000 mon.a (mon.0) 10314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:21 smithi179 bash[23186]: cluster 2024-09-21T03:07:20.793675+0000 mgr.a (mgr.14388) 12675 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:21 smithi179 bash[23186]: audit 2024-09-21T03:07:20.867133+0000 mgr.a (mgr.14388) 12676 : audit [DBG] from='client.276723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:21 smithi179 bash[23186]: audit 2024-09-21T03:07:20.951399+0000 mon.a (mon.0) 10312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:21 smithi179 bash[23186]: audit 2024-09-21T03:07:20.957216+0000 mon.a (mon.0) 10313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:21 smithi179 bash[23186]: audit 2024-09-21T03:07:20.963166+0000 mon.a (mon.0) 10314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:21 smithi049 bash[23528]: cluster 2024-09-21T03:07:20.793675+0000 mgr.a (mgr.14388) 12675 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:21 smithi049 bash[23528]: audit 2024-09-21T03:07:20.867133+0000 mgr.a (mgr.14388) 12676 : audit [DBG] from='client.276723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:21 smithi049 bash[23528]: audit 2024-09-21T03:07:20.951399+0000 mon.a (mon.0) 10312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:21 smithi049 bash[23528]: audit 2024-09-21T03:07:20.957216+0000 mon.a (mon.0) 10313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:21 smithi049 bash[23528]: audit 2024-09-21T03:07:20.963166+0000 mon.a (mon.0) 10314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:24.194 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:23 smithi044 bash[22676]: cluster 2024-09-21T03:07:22.794570+0000 mgr.a (mgr.14388) 12677 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:23 smithi179 bash[23186]: cluster 2024-09-21T03:07:22.794570+0000 mgr.a (mgr.14388) 12677 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:24.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:23 smithi049 bash[23528]: cluster 2024-09-21T03:07:22.794570+0000 mgr.a (mgr.14388) 12677 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:25 smithi044 bash[22676]: cluster 2024-09-21T03:07:24.795139+0000 mgr.a (mgr.14388) 12678 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:26.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:25 smithi179 bash[23186]: cluster 2024-09-21T03:07:24.795139+0000 mgr.a (mgr.14388) 12678 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:25 smithi049 bash[23528]: cluster 2024-09-21T03:07:24.795139+0000 mgr.a (mgr.14388) 12678 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:26.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:26.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:26.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:27.097 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:27.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:27.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:27.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:27.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:27 smithi044 bash[22676]: audit 2024-09-21T03:07:26.658471+0000 mgr.a (mgr.14388) 12679 : audit [DBG] from='client.276801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:27 smithi044 bash[22676]: cluster 2024-09-21T03:07:26.802300+0000 mgr.a (mgr.14388) 12680 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:27 smithi179 bash[23186]: audit 2024-09-21T03:07:26.658471+0000 mgr.a (mgr.14388) 12679 : audit [DBG] from='client.276801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:27 smithi179 bash[23186]: cluster 2024-09-21T03:07:26.802300+0000 mgr.a (mgr.14388) 12680 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:27 smithi049 bash[23528]: audit 2024-09-21T03:07:26.658471+0000 mgr.a (mgr.14388) 12679 : audit [DBG] from='client.276801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:27 smithi049 bash[23528]: cluster 2024-09-21T03:07:26.802300+0000 mgr.a (mgr.14388) 12680 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:29 smithi044 bash[22676]: cluster 2024-09-21T03:07:28.803281+0000 mgr.a (mgr.14388) 12681 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:29 smithi179 bash[23186]: cluster 2024-09-21T03:07:28.803281+0000 mgr.a (mgr.14388) 12681 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:29 smithi049 bash[23528]: cluster 2024-09-21T03:07:28.803281+0000 mgr.a (mgr.14388) 12681 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:31 smithi044 bash[22676]: cluster 2024-09-21T03:07:30.805488+0000 mgr.a (mgr.14388) 12682 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:31 smithi179 bash[23186]: cluster 2024-09-21T03:07:30.805488+0000 mgr.a (mgr.14388) 12682 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:31 smithi049 bash[23528]: cluster 2024-09-21T03:07:30.805488+0000 mgr.a (mgr.14388) 12682 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:32.888 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:32.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:32.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:32.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:32.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:33 smithi044 bash[22676]: audit 2024-09-21T03:07:32.438158+0000 mgr.a (mgr.14388) 12683 : audit [DBG] from='client.276879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:33 smithi044 bash[22676]: cluster 2024-09-21T03:07:32.806055+0000 mgr.a (mgr.14388) 12684 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:33 smithi044 bash[22676]: audit 2024-09-21T03:07:33.908391+0000 mon.a (mon.0) 10315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:33 smithi044 bash[22676]: audit 2024-09-21T03:07:33.915649+0000 mon.a (mon.0) 10316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:33 smithi179 bash[23186]: audit 2024-09-21T03:07:32.438158+0000 mgr.a (mgr.14388) 12683 : audit [DBG] from='client.276879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:33 smithi179 bash[23186]: cluster 2024-09-21T03:07:32.806055+0000 mgr.a (mgr.14388) 12684 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:33 smithi179 bash[23186]: audit 2024-09-21T03:07:33.908391+0000 mon.a (mon.0) 10315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:33 smithi179 bash[23186]: audit 2024-09-21T03:07:33.915649+0000 mon.a (mon.0) 10316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:34.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:33 smithi049 bash[23528]: audit 2024-09-21T03:07:32.438158+0000 mgr.a (mgr.14388) 12683 : audit [DBG] from='client.276879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:34.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:33 smithi049 bash[23528]: cluster 2024-09-21T03:07:32.806055+0000 mgr.a (mgr.14388) 12684 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:34.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:33 smithi049 bash[23528]: audit 2024-09-21T03:07:33.908391+0000 mon.a (mon.0) 10315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:34.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:33 smithi049 bash[23528]: audit 2024-09-21T03:07:33.915649+0000 mon.a (mon.0) 10316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:34 smithi044 bash[22676]: audit 2024-09-21T03:07:33.929934+0000 mon.a (mon.0) 10317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:34 smithi044 bash[22676]: audit 2024-09-21T03:07:33.973423+0000 mon.a (mon.0) 10318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:34 smithi044 bash[22676]: audit 2024-09-21T03:07:33.981022+0000 mon.a (mon.0) 10319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:34 smithi044 bash[22676]: audit 2024-09-21T03:07:33.990592+0000 mon.a (mon.0) 10320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:34 smithi179 bash[23186]: audit 2024-09-21T03:07:33.929934+0000 mon.a (mon.0) 10317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:34 smithi179 bash[23186]: audit 2024-09-21T03:07:33.973423+0000 mon.a (mon.0) 10318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:34 smithi179 bash[23186]: audit 2024-09-21T03:07:33.981022+0000 mon.a (mon.0) 10319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:34 smithi179 bash[23186]: audit 2024-09-21T03:07:33.990592+0000 mon.a (mon.0) 10320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:34 smithi049 bash[23528]: audit 2024-09-21T03:07:33.929934+0000 mon.a (mon.0) 10317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:34 smithi049 bash[23528]: audit 2024-09-21T03:07:33.973423+0000 mon.a (mon.0) 10318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:34 smithi049 bash[23528]: audit 2024-09-21T03:07:33.981022+0000 mon.a (mon.0) 10319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:34 smithi049 bash[23528]: audit 2024-09-21T03:07:33.990592+0000 mon.a (mon.0) 10320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:36.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:35 smithi044 bash[22676]: cluster 2024-09-21T03:07:34.806809+0000 mgr.a (mgr.14388) 12685 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:36.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:35 smithi179 bash[23186]: cluster 2024-09-21T03:07:34.806809+0000 mgr.a (mgr.14388) 12685 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:35 smithi049 bash[23528]: cluster 2024-09-21T03:07:34.806809+0000 mgr.a (mgr.14388) 12685 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:36 smithi044 bash[22676]: audit 2024-09-21T03:07:36.883841+0000 mon.a (mon.0) 10321 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:07:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:36 smithi044 bash[22676]: audit 2024-09-21T03:07:36.890356+0000 mon.a (mon.0) 10322 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:07:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:36 smithi044 bash[22676]: audit 2024-09-21T03:07:36.892546+0000 mon.a (mon.0) 10323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:07:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:36 smithi044 bash[22676]: audit 2024-09-21T03:07:36.903830+0000 mon.a (mon.0) 10324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:36 smithi044 bash[22676]: audit 2024-09-21T03:07:36.910117+0000 mon.a (mon.0) 10325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:07:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:36 smithi179 bash[23186]: audit 2024-09-21T03:07:36.883841+0000 mon.a (mon.0) 10321 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:07:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:36 smithi179 bash[23186]: audit 2024-09-21T03:07:36.890356+0000 mon.a (mon.0) 10322 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:07:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:36 smithi179 bash[23186]: audit 2024-09-21T03:07:36.892546+0000 mon.a (mon.0) 10323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:07:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:36 smithi179 bash[23186]: audit 2024-09-21T03:07:36.903830+0000 mon.a (mon.0) 10324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:36 smithi179 bash[23186]: audit 2024-09-21T03:07:36.910117+0000 mon.a (mon.0) 10325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:07:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:36 smithi049 bash[23528]: audit 2024-09-21T03:07:36.883841+0000 mon.a (mon.0) 10321 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:07:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:36 smithi049 bash[23528]: audit 2024-09-21T03:07:36.890356+0000 mon.a (mon.0) 10322 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:07:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:36 smithi049 bash[23528]: audit 2024-09-21T03:07:36.892546+0000 mon.a (mon.0) 10323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:07:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:36 smithi049 bash[23528]: audit 2024-09-21T03:07:36.903830+0000 mon.a (mon.0) 10324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:36 smithi049 bash[23528]: audit 2024-09-21T03:07:36.910117+0000 mon.a (mon.0) 10325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:07:37.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:37.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:37.890 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:37 smithi044 bash[22676]: cluster 2024-09-21T03:07:36.809013+0000 mgr.a (mgr.14388) 12686 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:37 smithi044 bash[22676]: audit 2024-09-21T03:07:36.912546+0000 mgr.a (mgr.14388) 12687 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:07:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:37 smithi044 bash[22676]: audit 2024-09-21T03:07:37.728705+0000 mgr.a (mgr.14388) 12688 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:07:37.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:37 smithi044 bash[22676]: cephadm 2024-09-21T03:07:37.730672+0000 mgr.a (mgr.14388) 12689 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:07:37.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:07:37 smithi044 bash[22930]: debug 2024-09-21T03:07:37.721+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:07:37.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:07:37 smithi044 bash[22930]: debug 2024-09-21T03:07:37.725+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:07:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:37 smithi179 bash[23186]: cluster 2024-09-21T03:07:36.809013+0000 mgr.a (mgr.14388) 12686 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:37 smithi179 bash[23186]: audit 2024-09-21T03:07:36.912546+0000 mgr.a (mgr.14388) 12687 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:07:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:37 smithi179 bash[23186]: audit 2024-09-21T03:07:37.728705+0000 mgr.a (mgr.14388) 12688 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:07:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:37 smithi179 bash[23186]: cephadm 2024-09-21T03:07:37.730672+0000 mgr.a (mgr.14388) 12689 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:07:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:37 smithi049 bash[23528]: cluster 2024-09-21T03:07:36.809013+0000 mgr.a (mgr.14388) 12686 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:07:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:37 smithi049 bash[23528]: audit 2024-09-21T03:07:36.912546+0000 mgr.a (mgr.14388) 12687 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:07:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:37 smithi049 bash[23528]: audit 2024-09-21T03:07:37.728705+0000 mgr.a (mgr.14388) 12688 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:07:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:37 smithi049 bash[23528]: cephadm 2024-09-21T03:07:37.730672+0000 mgr.a (mgr.14388) 12689 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:07:38.676 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:38.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:38.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:38.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:38.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:38 smithi044 bash[22676]: audit 2024-09-21T03:07:38.225766+0000 mgr.a (mgr.14388) 12690 : audit [DBG] from='client.277062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:38 smithi044 bash[22676]: cluster 2024-09-21T03:07:38.810067+0000 mgr.a (mgr.14388) 12691 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:38 smithi179 bash[23186]: audit 2024-09-21T03:07:38.225766+0000 mgr.a (mgr.14388) 12690 : audit [DBG] from='client.277062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:38 smithi179 bash[23186]: cluster 2024-09-21T03:07:38.810067+0000 mgr.a (mgr.14388) 12691 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:38 smithi049 bash[23528]: audit 2024-09-21T03:07:38.225766+0000 mgr.a (mgr.14388) 12690 : audit [DBG] from='client.277062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:38 smithi049 bash[23528]: cluster 2024-09-21T03:07:38.810067+0000 mgr.a (mgr.14388) 12691 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:41 smithi044 bash[22676]: cluster 2024-09-21T03:07:40.812225+0000 mgr.a (mgr.14388) 12692 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:41 smithi044 bash[22676]: audit 2024-09-21T03:07:41.174097+0000 mon.a (mon.0) 10326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:41 smithi044 bash[22676]: audit 2024-09-21T03:07:41.182963+0000 mon.a (mon.0) 10327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:41 smithi044 bash[22676]: audit 2024-09-21T03:07:41.193653+0000 mon.a (mon.0) 10328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:41 smithi179 bash[23186]: cluster 2024-09-21T03:07:40.812225+0000 mgr.a (mgr.14388) 12692 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:41 smithi179 bash[23186]: audit 2024-09-21T03:07:41.174097+0000 mon.a (mon.0) 10326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:41 smithi179 bash[23186]: audit 2024-09-21T03:07:41.182963+0000 mon.a (mon.0) 10327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:41 smithi179 bash[23186]: audit 2024-09-21T03:07:41.193653+0000 mon.a (mon.0) 10328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:41 smithi049 bash[23528]: cluster 2024-09-21T03:07:40.812225+0000 mgr.a (mgr.14388) 12692 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:41 smithi049 bash[23528]: audit 2024-09-21T03:07:41.174097+0000 mon.a (mon.0) 10326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:41 smithi049 bash[23528]: audit 2024-09-21T03:07:41.182963+0000 mon.a (mon.0) 10327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:41 smithi049 bash[23528]: audit 2024-09-21T03:07:41.193653+0000 mon.a (mon.0) 10328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:43 smithi179 bash[23186]: cluster 2024-09-21T03:07:42.812979+0000 mgr.a (mgr.14388) 12693 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:44.145 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:43 smithi044 bash[22676]: cluster 2024-09-21T03:07:42.812979+0000 mgr.a (mgr.14388) 12693 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:43 smithi049 bash[23528]: cluster 2024-09-21T03:07:42.812979+0000 mgr.a (mgr.14388) 12693 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:44.480 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:44.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:45 smithi044 bash[22676]: audit 2024-09-21T03:07:44.018725+0000 mgr.a (mgr.14388) 12694 : audit [DBG] from='client.277140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:45 smithi044 bash[22676]: cluster 2024-09-21T03:07:44.813923+0000 mgr.a (mgr.14388) 12695 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:45 smithi179 bash[23186]: audit 2024-09-21T03:07:44.018725+0000 mgr.a (mgr.14388) 12694 : audit [DBG] from='client.277140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:45 smithi179 bash[23186]: cluster 2024-09-21T03:07:44.813923+0000 mgr.a (mgr.14388) 12695 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:45 smithi049 bash[23528]: audit 2024-09-21T03:07:44.018725+0000 mgr.a (mgr.14388) 12694 : audit [DBG] from='client.277140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:45 smithi049 bash[23528]: cluster 2024-09-21T03:07:44.813923+0000 mgr.a (mgr.14388) 12695 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:47 smithi044 bash[22676]: cluster 2024-09-21T03:07:46.816166+0000 mgr.a (mgr.14388) 12696 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:47 smithi179 bash[23186]: cluster 2024-09-21T03:07:46.816166+0000 mgr.a (mgr.14388) 12696 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:47 smithi049 bash[23528]: cluster 2024-09-21T03:07:46.816166+0000 mgr.a (mgr.14388) 12696 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:49 smithi044 bash[22676]: cluster 2024-09-21T03:07:48.816941+0000 mgr.a (mgr.14388) 12697 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:49 smithi179 bash[23186]: cluster 2024-09-21T03:07:48.816941+0000 mgr.a (mgr.14388) 12697 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:50.273 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:49 smithi049 bash[23528]: cluster 2024-09-21T03:07:48.816941+0000 mgr.a (mgr.14388) 12697 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:50 smithi044 bash[22676]: audit 2024-09-21T03:07:49.822540+0000 mgr.a (mgr.14388) 12698 : audit [DBG] from='client.277218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:50 smithi179 bash[23186]: audit 2024-09-21T03:07:49.822540+0000 mgr.a (mgr.14388) 12698 : audit [DBG] from='client.277218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:50 smithi049 bash[23528]: audit 2024-09-21T03:07:49.822540+0000 mgr.a (mgr.14388) 12698 : audit [DBG] from='client.277218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:52.195 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:51 smithi049 bash[23528]: cluster 2024-09-21T03:07:50.819719+0000 mgr.a (mgr.14388) 12699 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:52.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:51 smithi044 bash[22676]: cluster 2024-09-21T03:07:50.819719+0000 mgr.a (mgr.14388) 12699 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:51 smithi179 bash[23186]: cluster 2024-09-21T03:07:50.819719+0000 mgr.a (mgr.14388) 12699 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:07:54.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:53 smithi044 bash[22676]: cluster 2024-09-21T03:07:52.820513+0000 mgr.a (mgr.14388) 12700 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:53 smithi179 bash[23186]: cluster 2024-09-21T03:07:52.820513+0000 mgr.a (mgr.14388) 12700 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:54.301 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:53 smithi049 bash[23528]: cluster 2024-09-21T03:07:52.820513+0000 mgr.a (mgr.14388) 12700 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:07:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:07:55.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:07:55.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:07:55.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:55 smithi044 bash[22676]: audit 2024-09-21T03:07:54.140807+0000 mon.a (mon.0) 10329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:55 smithi044 bash[22676]: audit 2024-09-21T03:07:54.146630+0000 mon.a (mon.0) 10330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:55 smithi044 bash[22676]: audit 2024-09-21T03:07:54.153799+0000 mon.a (mon.0) 10331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:55 smithi044 bash[22676]: audit 2024-09-21T03:07:54.207683+0000 mon.a (mon.0) 10332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:55 smithi044 bash[22676]: audit 2024-09-21T03:07:54.215879+0000 mon.a (mon.0) 10333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:55 smithi044 bash[22676]: audit 2024-09-21T03:07:54.227219+0000 mon.a (mon.0) 10334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:55 smithi044 bash[22676]: cluster 2024-09-21T03:07:54.821307+0000 mgr.a (mgr.14388) 12701 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:07:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:55 smithi179 bash[23186]: audit 2024-09-21T03:07:54.140807+0000 mon.a (mon.0) 10329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:55 smithi179 bash[23186]: audit 2024-09-21T03:07:54.146630+0000 mon.a (mon.0) 10330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:55 smithi179 bash[23186]: audit 2024-09-21T03:07:54.153799+0000 mon.a (mon.0) 10331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:55 smithi179 bash[23186]: audit 2024-09-21T03:07:54.207683+0000 mon.a (mon.0) 10332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:55 smithi179 bash[23186]: audit 2024-09-21T03:07:54.215879+0000 mon.a (mon.0) 10333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:55 smithi179 bash[23186]: audit 2024-09-21T03:07:54.227219+0000 mon.a (mon.0) 10334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:55 smithi179 bash[23186]: cluster 2024-09-21T03:07:54.821307+0000 mgr.a (mgr.14388) 12701 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:07:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:55 smithi049 bash[23528]: audit 2024-09-21T03:07:54.140807+0000 mon.a (mon.0) 10329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:55 smithi049 bash[23528]: audit 2024-09-21T03:07:54.146630+0000 mon.a (mon.0) 10330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:55 smithi049 bash[23528]: audit 2024-09-21T03:07:54.153799+0000 mon.a (mon.0) 10331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:55 smithi049 bash[23528]: audit 2024-09-21T03:07:54.207683+0000 mon.a (mon.0) 10332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:55 smithi049 bash[23528]: audit 2024-09-21T03:07:54.215879+0000 mon.a (mon.0) 10333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:55 smithi049 bash[23528]: audit 2024-09-21T03:07:54.227219+0000 mon.a (mon.0) 10334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:07:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:55 smithi049 bash[23528]: cluster 2024-09-21T03:07:54.821307+0000 mgr.a (mgr.14388) 12701 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:07:56.069 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:07:56.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:07:56.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:07:56.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:07:56.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:07:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:56 smithi044 bash[22676]: audit 2024-09-21T03:07:55.610780+0000 mgr.a (mgr.14388) 12702 : audit [DBG] from='client.277296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:56 smithi179 bash[23186]: audit 2024-09-21T03:07:55.610780+0000 mgr.a (mgr.14388) 12702 : audit [DBG] from='client.277296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:56 smithi049 bash[23528]: audit 2024-09-21T03:07:55.610780+0000 mgr.a (mgr.14388) 12702 : audit [DBG] from='client.277296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:07:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:57 smithi179 bash[23186]: cluster 2024-09-21T03:07:56.824018+0000 mgr.a (mgr.14388) 12703 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:57 smithi049 bash[23528]: cluster 2024-09-21T03:07:56.824018+0000 mgr.a (mgr.14388) 12703 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:07:57.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:57 smithi044 bash[22676]: cluster 2024-09-21T03:07:56.824018+0000 mgr.a (mgr.14388) 12703 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:07:59 smithi044 bash[22676]: cluster 2024-09-21T03:07:58.824798+0000 mgr.a (mgr.14388) 12704 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:08:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:07:59 smithi179 bash[23186]: cluster 2024-09-21T03:07:58.824798+0000 mgr.a (mgr.14388) 12704 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:08:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:07:59 smithi049 bash[23528]: cluster 2024-09-21T03:07:58.824798+0000 mgr.a (mgr.14388) 12704 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:08:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:01.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:01.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:01.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:01.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:01.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:02.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:01 smithi044 bash[22676]: cluster 2024-09-21T03:08:00.826744+0000 mgr.a (mgr.14388) 12705 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:01 smithi044 bash[22676]: audit 2024-09-21T03:08:01.412206+0000 mon.a (mon.0) 10335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:01 smithi044 bash[22676]: audit 2024-09-21T03:08:01.437380+0000 mon.a (mon.0) 10336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:01 smithi044 bash[22676]: audit 2024-09-21T03:08:01.447942+0000 mon.a (mon.0) 10337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:01 smithi179 bash[23186]: cluster 2024-09-21T03:08:00.826744+0000 mgr.a (mgr.14388) 12705 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:01 smithi179 bash[23186]: audit 2024-09-21T03:08:01.412206+0000 mon.a (mon.0) 10335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:01 smithi179 bash[23186]: audit 2024-09-21T03:08:01.437380+0000 mon.a (mon.0) 10336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:01 smithi179 bash[23186]: audit 2024-09-21T03:08:01.447942+0000 mon.a (mon.0) 10337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:01 smithi049 bash[23528]: cluster 2024-09-21T03:08:00.826744+0000 mgr.a (mgr.14388) 12705 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:01 smithi049 bash[23528]: audit 2024-09-21T03:08:01.412206+0000 mon.a (mon.0) 10335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:01 smithi049 bash[23528]: audit 2024-09-21T03:08:01.437380+0000 mon.a (mon.0) 10336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:01 smithi049 bash[23528]: audit 2024-09-21T03:08:01.447942+0000 mon.a (mon.0) 10337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:03.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:02 smithi044 bash[22676]: audit 2024-09-21T03:08:01.410614+0000 mgr.a (mgr.14388) 12706 : audit [DBG] from='client.277368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:03.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:02 smithi179 bash[23186]: audit 2024-09-21T03:08:01.410614+0000 mgr.a (mgr.14388) 12706 : audit [DBG] from='client.277368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:02 smithi049 bash[23528]: audit 2024-09-21T03:08:01.410614+0000 mgr.a (mgr.14388) 12706 : audit [DBG] from='client.277368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:03 smithi179 bash[23186]: cluster 2024-09-21T03:08:02.827661+0000 mgr.a (mgr.14388) 12707 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:04.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:03 smithi044 bash[22676]: cluster 2024-09-21T03:08:02.827661+0000 mgr.a (mgr.14388) 12707 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:03 smithi049 bash[23528]: cluster 2024-09-21T03:08:02.827661+0000 mgr.a (mgr.14388) 12707 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:05 smithi179 bash[23186]: cluster 2024-09-21T03:08:04.828474+0000 mgr.a (mgr.14388) 12708 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:05 smithi049 bash[23528]: cluster 2024-09-21T03:08:04.828474+0000 mgr.a (mgr.14388) 12708 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:05.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:05 smithi044 bash[22676]: cluster 2024-09-21T03:08:04.828474+0000 mgr.a (mgr.14388) 12708 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:06.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:06.848 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:06.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:07.647 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:07.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:07.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:07.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:07.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:07 smithi044 bash[22676]: cluster 2024-09-21T03:08:06.830013+0000 mgr.a (mgr.14388) 12709 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:07 smithi179 bash[23186]: cluster 2024-09-21T03:08:06.830013+0000 mgr.a (mgr.14388) 12709 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:07 smithi049 bash[23528]: cluster 2024-09-21T03:08:06.830013+0000 mgr.a (mgr.14388) 12709 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:08 smithi044 bash[22676]: audit 2024-09-21T03:08:07.190949+0000 mgr.a (mgr.14388) 12710 : audit [DBG] from='client.277446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:09.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:08 smithi179 bash[23186]: audit 2024-09-21T03:08:07.190949+0000 mgr.a (mgr.14388) 12710 : audit [DBG] from='client.277446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:08 smithi049 bash[23528]: audit 2024-09-21T03:08:07.190949+0000 mgr.a (mgr.14388) 12710 : audit [DBG] from='client.277446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:09 smithi044 bash[22676]: cluster 2024-09-21T03:08:08.830860+0000 mgr.a (mgr.14388) 12711 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:10.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:09 smithi179 bash[23186]: cluster 2024-09-21T03:08:08.830860+0000 mgr.a (mgr.14388) 12711 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:09 smithi049 bash[23528]: cluster 2024-09-21T03:08:08.830860+0000 mgr.a (mgr.14388) 12711 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:12.165 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:11 smithi179 bash[23186]: cluster 2024-09-21T03:08:10.833088+0000 mgr.a (mgr.14388) 12712 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:11 smithi044 bash[22676]: cluster 2024-09-21T03:08:10.833088+0000 mgr.a (mgr.14388) 12712 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:11 smithi049 bash[23528]: cluster 2024-09-21T03:08:10.833088+0000 mgr.a (mgr.14388) 12712 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:12.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:13.413 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:13.413 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:14.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:13 smithi044 bash[22676]: cluster 2024-09-21T03:08:12.833546+0000 mgr.a (mgr.14388) 12713 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:13 smithi179 bash[23186]: cluster 2024-09-21T03:08:12.833546+0000 mgr.a (mgr.14388) 12713 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:13 smithi049 bash[23528]: cluster 2024-09-21T03:08:12.833546+0000 mgr.a (mgr.14388) 12713 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:14 smithi044 bash[22676]: audit 2024-09-21T03:08:12.986678+0000 mgr.a (mgr.14388) 12714 : audit [DBG] from='client.277521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:14 smithi044 bash[22676]: audit 2024-09-21T03:08:14.356737+0000 mon.a (mon.0) 10338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:14 smithi044 bash[22676]: audit 2024-09-21T03:08:14.363896+0000 mon.a (mon.0) 10339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:14 smithi044 bash[22676]: audit 2024-09-21T03:08:14.374745+0000 mon.a (mon.0) 10340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:14 smithi044 bash[22676]: audit 2024-09-21T03:08:14.406448+0000 mon.a (mon.0) 10341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:14 smithi044 bash[22676]: audit 2024-09-21T03:08:14.414356+0000 mon.a (mon.0) 10342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:14 smithi044 bash[22676]: audit 2024-09-21T03:08:14.423914+0000 mon.a (mon.0) 10343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:14 smithi049 bash[23528]: audit 2024-09-21T03:08:12.986678+0000 mgr.a (mgr.14388) 12714 : audit [DBG] from='client.277521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:15.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:14 smithi049 bash[23528]: audit 2024-09-21T03:08:14.356737+0000 mon.a (mon.0) 10338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:14 smithi049 bash[23528]: audit 2024-09-21T03:08:14.363896+0000 mon.a (mon.0) 10339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:14 smithi049 bash[23528]: audit 2024-09-21T03:08:14.374745+0000 mon.a (mon.0) 10340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:14 smithi049 bash[23528]: audit 2024-09-21T03:08:14.406448+0000 mon.a (mon.0) 10341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:14 smithi049 bash[23528]: audit 2024-09-21T03:08:14.414356+0000 mon.a (mon.0) 10342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.250 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:14 smithi049 bash[23528]: audit 2024-09-21T03:08:14.423914+0000 mon.a (mon.0) 10343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:14 smithi179 bash[23186]: audit 2024-09-21T03:08:12.986678+0000 mgr.a (mgr.14388) 12714 : audit [DBG] from='client.277521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:14 smithi179 bash[23186]: audit 2024-09-21T03:08:14.356737+0000 mon.a (mon.0) 10338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:14 smithi179 bash[23186]: audit 2024-09-21T03:08:14.363896+0000 mon.a (mon.0) 10339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:14 smithi179 bash[23186]: audit 2024-09-21T03:08:14.374745+0000 mon.a (mon.0) 10340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:14 smithi179 bash[23186]: audit 2024-09-21T03:08:14.406448+0000 mon.a (mon.0) 10341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:14 smithi179 bash[23186]: audit 2024-09-21T03:08:14.414356+0000 mon.a (mon.0) 10342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:14 smithi179 bash[23186]: audit 2024-09-21T03:08:14.423914+0000 mon.a (mon.0) 10343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:15 smithi044 bash[22676]: cluster 2024-09-21T03:08:14.834396+0000 mgr.a (mgr.14388) 12715 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:15 smithi179 bash[23186]: cluster 2024-09-21T03:08:14.834396+0000 mgr.a (mgr.14388) 12715 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:15 smithi049 bash[23528]: cluster 2024-09-21T03:08:14.834396+0000 mgr.a (mgr.14388) 12715 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:18.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:17 smithi044 bash[22676]: cluster 2024-09-21T03:08:16.836592+0000 mgr.a (mgr.14388) 12716 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:17 smithi179 bash[23186]: cluster 2024-09-21T03:08:16.836592+0000 mgr.a (mgr.14388) 12716 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:17 smithi049 bash[23528]: cluster 2024-09-21T03:08:16.836592+0000 mgr.a (mgr.14388) 12716 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:18.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:18.415 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:18.415 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:19 smithi044 bash[22676]: audit 2024-09-21T03:08:18.746177+0000 mgr.a (mgr.14388) 12717 : audit [DBG] from='client.277596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:20.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:19 smithi044 bash[22676]: cluster 2024-09-21T03:08:18.837079+0000 mgr.a (mgr.14388) 12718 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:19 smithi179 bash[23186]: audit 2024-09-21T03:08:18.746177+0000 mgr.a (mgr.14388) 12717 : audit [DBG] from='client.277596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:19 smithi179 bash[23186]: cluster 2024-09-21T03:08:18.837079+0000 mgr.a (mgr.14388) 12718 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:19 smithi049 bash[23528]: audit 2024-09-21T03:08:18.746177+0000 mgr.a (mgr.14388) 12717 : audit [DBG] from='client.277596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:19 smithi049 bash[23528]: cluster 2024-09-21T03:08:18.837079+0000 mgr.a (mgr.14388) 12718 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:21 smithi044 bash[22676]: cluster 2024-09-21T03:08:20.839317+0000 mgr.a (mgr.14388) 12719 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:21 smithi044 bash[22676]: audit 2024-09-21T03:08:21.632023+0000 mon.a (mon.0) 10344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:21 smithi044 bash[22676]: audit 2024-09-21T03:08:21.641914+0000 mon.a (mon.0) 10345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:21 smithi044 bash[22676]: audit 2024-09-21T03:08:21.653579+0000 mon.a (mon.0) 10346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:21 smithi179 bash[23186]: cluster 2024-09-21T03:08:20.839317+0000 mgr.a (mgr.14388) 12719 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:21 smithi179 bash[23186]: audit 2024-09-21T03:08:21.632023+0000 mon.a (mon.0) 10344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:21 smithi179 bash[23186]: audit 2024-09-21T03:08:21.641914+0000 mon.a (mon.0) 10345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:21 smithi179 bash[23186]: audit 2024-09-21T03:08:21.653579+0000 mon.a (mon.0) 10346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:21 smithi049 bash[23528]: cluster 2024-09-21T03:08:20.839317+0000 mgr.a (mgr.14388) 12719 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:21 smithi049 bash[23528]: audit 2024-09-21T03:08:21.632023+0000 mon.a (mon.0) 10344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:21 smithi049 bash[23528]: audit 2024-09-21T03:08:21.641914+0000 mon.a (mon.0) 10345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:21 smithi049 bash[23528]: audit 2024-09-21T03:08:21.653579+0000 mon.a (mon.0) 10346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:24.127 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:23 smithi179 bash[23186]: cluster 2024-09-21T03:08:22.840089+0000 mgr.a (mgr.14388) 12720 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:24.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:24.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:24.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:24.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:23 smithi044 bash[22676]: cluster 2024-09-21T03:08:22.840089+0000 mgr.a (mgr.14388) 12720 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:23 smithi049 bash[23528]: cluster 2024-09-21T03:08:22.840089+0000 mgr.a (mgr.14388) 12720 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:24.982 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:24.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:25 smithi044 bash[22676]: audit 2024-09-21T03:08:24.519199+0000 mgr.a (mgr.14388) 12721 : audit [DBG] from='client.277668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:25 smithi044 bash[22676]: cluster 2024-09-21T03:08:24.840552+0000 mgr.a (mgr.14388) 12722 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:26.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:25 smithi179 bash[23186]: audit 2024-09-21T03:08:24.519199+0000 mgr.a (mgr.14388) 12721 : audit [DBG] from='client.277668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:26.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:25 smithi179 bash[23186]: cluster 2024-09-21T03:08:24.840552+0000 mgr.a (mgr.14388) 12722 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:25 smithi049 bash[23528]: audit 2024-09-21T03:08:24.519199+0000 mgr.a (mgr.14388) 12721 : audit [DBG] from='client.277668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:25 smithi049 bash[23528]: cluster 2024-09-21T03:08:24.840552+0000 mgr.a (mgr.14388) 12722 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:27 smithi044 bash[22676]: cluster 2024-09-21T03:08:26.842920+0000 mgr.a (mgr.14388) 12723 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:28.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:27 smithi179 bash[23186]: cluster 2024-09-21T03:08:26.842920+0000 mgr.a (mgr.14388) 12723 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:27 smithi049 bash[23528]: cluster 2024-09-21T03:08:26.842920+0000 mgr.a (mgr.14388) 12723 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:29.985 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:29 smithi044 bash[22676]: cluster 2024-09-21T03:08:28.843706+0000 mgr.a (mgr.14388) 12724 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:29 smithi179 bash[23186]: cluster 2024-09-21T03:08:28.843706+0000 mgr.a (mgr.14388) 12724 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:29 smithi049 bash[23528]: cluster 2024-09-21T03:08:28.843706+0000 mgr.a (mgr.14388) 12724 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:31 smithi049 bash[23528]: audit 2024-09-21T03:08:30.318445+0000 mgr.a (mgr.14388) 12725 : audit [DBG] from='client.277740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:31 smithi049 bash[23528]: cluster 2024-09-21T03:08:30.844999+0000 mgr.a (mgr.14388) 12726 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:32.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:31 smithi044 bash[22676]: audit 2024-09-21T03:08:30.318445+0000 mgr.a (mgr.14388) 12725 : audit [DBG] from='client.277740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:32.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:31 smithi044 bash[22676]: cluster 2024-09-21T03:08:30.844999+0000 mgr.a (mgr.14388) 12726 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:31 smithi179 bash[23186]: audit 2024-09-21T03:08:30.318445+0000 mgr.a (mgr.14388) 12725 : audit [DBG] from='client.277740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:31 smithi179 bash[23186]: cluster 2024-09-21T03:08:30.844999+0000 mgr.a (mgr.14388) 12726 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:33 smithi044 bash[22676]: cluster 2024-09-21T03:08:32.845754+0000 mgr.a (mgr.14388) 12727 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:08:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:33 smithi179 bash[23186]: cluster 2024-09-21T03:08:32.845754+0000 mgr.a (mgr.14388) 12727 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:08:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:33 smithi049 bash[23528]: cluster 2024-09-21T03:08:32.845754+0000 mgr.a (mgr.14388) 12727 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:08:35.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:35.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:35.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:35 smithi044 bash[22676]: audit 2024-09-21T03:08:34.587048+0000 mon.a (mon.0) 10347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:35 smithi044 bash[22676]: audit 2024-09-21T03:08:34.596584+0000 mon.a (mon.0) 10348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:35 smithi044 bash[22676]: audit 2024-09-21T03:08:34.608463+0000 mon.a (mon.0) 10349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:35 smithi044 bash[22676]: audit 2024-09-21T03:08:34.640357+0000 mon.a (mon.0) 10350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:35 smithi044 bash[22676]: audit 2024-09-21T03:08:34.648247+0000 mon.a (mon.0) 10351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:35 smithi044 bash[22676]: audit 2024-09-21T03:08:34.657284+0000 mon.a (mon.0) 10352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:35 smithi044 bash[22676]: cluster 2024-09-21T03:08:34.846484+0000 mgr.a (mgr.14388) 12728 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:08:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:35 smithi179 bash[23186]: audit 2024-09-21T03:08:34.587048+0000 mon.a (mon.0) 10347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:35 smithi179 bash[23186]: audit 2024-09-21T03:08:34.596584+0000 mon.a (mon.0) 10348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:35 smithi179 bash[23186]: audit 2024-09-21T03:08:34.608463+0000 mon.a (mon.0) 10349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:35 smithi179 bash[23186]: audit 2024-09-21T03:08:34.640357+0000 mon.a (mon.0) 10350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:35 smithi179 bash[23186]: audit 2024-09-21T03:08:34.648247+0000 mon.a (mon.0) 10351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:35 smithi179 bash[23186]: audit 2024-09-21T03:08:34.657284+0000 mon.a (mon.0) 10352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:35 smithi179 bash[23186]: cluster 2024-09-21T03:08:34.846484+0000 mgr.a (mgr.14388) 12728 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:08:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:35 smithi049 bash[23528]: audit 2024-09-21T03:08:34.587048+0000 mon.a (mon.0) 10347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:35 smithi049 bash[23528]: audit 2024-09-21T03:08:34.596584+0000 mon.a (mon.0) 10348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:35 smithi049 bash[23528]: audit 2024-09-21T03:08:34.608463+0000 mon.a (mon.0) 10349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:35 smithi049 bash[23528]: audit 2024-09-21T03:08:34.640357+0000 mon.a (mon.0) 10350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:35 smithi049 bash[23528]: audit 2024-09-21T03:08:34.648247+0000 mon.a (mon.0) 10351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:35 smithi049 bash[23528]: audit 2024-09-21T03:08:34.657284+0000 mon.a (mon.0) 10352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:35 smithi049 bash[23528]: cluster 2024-09-21T03:08:34.846484+0000 mgr.a (mgr.14388) 12728 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:08:36.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:36.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:36.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:36.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:36.516 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:38.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:37 smithi044 bash[22676]: audit 2024-09-21T03:08:36.082301+0000 mgr.a (mgr.14388) 12729 : audit [DBG] from='client.277818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:37 smithi044 bash[22676]: cluster 2024-09-21T03:08:36.849177+0000 mgr.a (mgr.14388) 12730 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:37 smithi044 bash[22676]: audit 2024-09-21T03:08:37.812251+0000 mon.a (mon.0) 10353 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:08:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:37 smithi044 bash[22676]: audit 2024-09-21T03:08:37.819822+0000 mon.a (mon.0) 10354 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:08:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:37 smithi044 bash[22676]: audit 2024-09-21T03:08:37.822034+0000 mon.a (mon.0) 10355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:08:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:37 smithi044 bash[22676]: audit 2024-09-21T03:08:37.833624+0000 mon.a (mon.0) 10356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:37 smithi044 bash[22676]: audit 2024-09-21T03:08:37.840730+0000 mon.a (mon.0) 10357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:08:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:37 smithi179 bash[23186]: audit 2024-09-21T03:08:36.082301+0000 mgr.a (mgr.14388) 12729 : audit [DBG] from='client.277818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:37 smithi179 bash[23186]: cluster 2024-09-21T03:08:36.849177+0000 mgr.a (mgr.14388) 12730 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:37 smithi179 bash[23186]: audit 2024-09-21T03:08:37.812251+0000 mon.a (mon.0) 10353 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:08:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:37 smithi179 bash[23186]: audit 2024-09-21T03:08:37.819822+0000 mon.a (mon.0) 10354 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:08:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:37 smithi179 bash[23186]: audit 2024-09-21T03:08:37.822034+0000 mon.a (mon.0) 10355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:08:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:37 smithi179 bash[23186]: audit 2024-09-21T03:08:37.833624+0000 mon.a (mon.0) 10356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:37 smithi179 bash[23186]: audit 2024-09-21T03:08:37.840730+0000 mon.a (mon.0) 10357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:08:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:37 smithi049 bash[23528]: audit 2024-09-21T03:08:36.082301+0000 mgr.a (mgr.14388) 12729 : audit [DBG] from='client.277818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:38.378 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:37 smithi049 bash[23528]: cluster 2024-09-21T03:08:36.849177+0000 mgr.a (mgr.14388) 12730 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:38.378 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:37 smithi049 bash[23528]: audit 2024-09-21T03:08:37.812251+0000 mon.a (mon.0) 10353 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:08:38.378 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:37 smithi049 bash[23528]: audit 2024-09-21T03:08:37.819822+0000 mon.a (mon.0) 10354 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:08:38.378 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:37 smithi049 bash[23528]: audit 2024-09-21T03:08:37.822034+0000 mon.a (mon.0) 10355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:08:38.378 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:37 smithi049 bash[23528]: audit 2024-09-21T03:08:37.833624+0000 mon.a (mon.0) 10356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:38.378 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:37 smithi049 bash[23528]: audit 2024-09-21T03:08:37.840730+0000 mon.a (mon.0) 10357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:08:38.908 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:08:38 smithi044 bash[22930]: debug 2024-09-21T03:08:38.628+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:08:38.908 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:08:38 smithi044 bash[22930]: debug 2024-09-21T03:08:38.628+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:08:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:38 smithi044 bash[22676]: audit 2024-09-21T03:08:37.843392+0000 mgr.a (mgr.14388) 12731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:08:39.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:38 smithi179 bash[23186]: audit 2024-09-21T03:08:37.843392+0000 mgr.a (mgr.14388) 12731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:08:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:38 smithi049 bash[23528]: audit 2024-09-21T03:08:37.843392+0000 mgr.a (mgr.14388) 12731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:08:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:39 smithi044 bash[22676]: audit 2024-09-21T03:08:38.631653+0000 mgr.a (mgr.14388) 12732 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:08:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:39 smithi044 bash[22676]: cephadm 2024-09-21T03:08:38.632998+0000 mgr.a (mgr.14388) 12733 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:08:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:39 smithi044 bash[22676]: cluster 2024-09-21T03:08:38.850162+0000 mgr.a (mgr.14388) 12734 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:08:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:39 smithi179 bash[23186]: audit 2024-09-21T03:08:38.631653+0000 mgr.a (mgr.14388) 12732 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:08:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:39 smithi179 bash[23186]: cephadm 2024-09-21T03:08:38.632998+0000 mgr.a (mgr.14388) 12733 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:08:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:39 smithi179 bash[23186]: cluster 2024-09-21T03:08:38.850162+0000 mgr.a (mgr.14388) 12734 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:39 smithi049 bash[23528]: audit 2024-09-21T03:08:38.631653+0000 mgr.a (mgr.14388) 12732 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:39 smithi049 bash[23528]: cephadm 2024-09-21T03:08:38.632998+0000 mgr.a (mgr.14388) 12733 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:08:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:39 smithi049 bash[23528]: cluster 2024-09-21T03:08:38.850162+0000 mgr.a (mgr.14388) 12734 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:08:41.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:41.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:41.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:41 smithi044 bash[22676]: cluster 2024-09-21T03:08:40.852340+0000 mgr.a (mgr.14388) 12735 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:41 smithi044 bash[22676]: audit 2024-09-21T03:08:41.851030+0000 mon.a (mon.0) 10358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:41 smithi044 bash[22676]: audit 2024-09-21T03:08:41.858521+0000 mon.a (mon.0) 10359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:41 smithi044 bash[22676]: audit 2024-09-21T03:08:41.878419+0000 mon.a (mon.0) 10360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:41 smithi179 bash[23186]: cluster 2024-09-21T03:08:40.852340+0000 mgr.a (mgr.14388) 12735 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:41 smithi179 bash[23186]: audit 2024-09-21T03:08:41.851030+0000 mon.a (mon.0) 10358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:41 smithi179 bash[23186]: audit 2024-09-21T03:08:41.858521+0000 mon.a (mon.0) 10359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:41 smithi179 bash[23186]: audit 2024-09-21T03:08:41.878419+0000 mon.a (mon.0) 10360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.275 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:42.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:42.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:42.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:42.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:41 smithi049 bash[23528]: cluster 2024-09-21T03:08:40.852340+0000 mgr.a (mgr.14388) 12735 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:41 smithi049 bash[23528]: audit 2024-09-21T03:08:41.851030+0000 mon.a (mon.0) 10358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:41 smithi049 bash[23528]: audit 2024-09-21T03:08:41.858521+0000 mon.a (mon.0) 10359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:41 smithi049 bash[23528]: audit 2024-09-21T03:08:41.878419+0000 mon.a (mon.0) 10360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:42 smithi049 bash[23528]: audit 2024-09-21T03:08:41.858468+0000 mgr.a (mgr.14388) 12736 : audit [DBG] from='client.278001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:43.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:42 smithi044 bash[22676]: audit 2024-09-21T03:08:41.858468+0000 mgr.a (mgr.14388) 12736 : audit [DBG] from='client.278001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:42 smithi179 bash[23186]: audit 2024-09-21T03:08:41.858468+0000 mgr.a (mgr.14388) 12736 : audit [DBG] from='client.278001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:44.181 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:43 smithi179 bash[23186]: cluster 2024-09-21T03:08:42.853359+0000 mgr.a (mgr.14388) 12737 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:43 smithi044 bash[22676]: cluster 2024-09-21T03:08:42.853359+0000 mgr.a (mgr.14388) 12737 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:43 smithi049 bash[23528]: cluster 2024-09-21T03:08:42.853359+0000 mgr.a (mgr.14388) 12737 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:45 smithi044 bash[22676]: cluster 2024-09-21T03:08:44.854171+0000 mgr.a (mgr.14388) 12738 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:45 smithi179 bash[23186]: cluster 2024-09-21T03:08:44.854171+0000 mgr.a (mgr.14388) 12738 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:45 smithi049 bash[23528]: cluster 2024-09-21T03:08:44.854171+0000 mgr.a (mgr.14388) 12738 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:47.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:47.277 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:47.277 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:48.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:48.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:48.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:48.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:48.081 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:48.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:47 smithi044 bash[22676]: cluster 2024-09-21T03:08:46.856486+0000 mgr.a (mgr.14388) 12739 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:48.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:47 smithi179 bash[23186]: cluster 2024-09-21T03:08:46.856486+0000 mgr.a (mgr.14388) 12739 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:47 smithi049 bash[23528]: cluster 2024-09-21T03:08:46.856486+0000 mgr.a (mgr.14388) 12739 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:48 smithi044 bash[22676]: audit 2024-09-21T03:08:47.626136+0000 mgr.a (mgr.14388) 12740 : audit [DBG] from='client.278073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:49.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:48 smithi179 bash[23186]: audit 2024-09-21T03:08:47.626136+0000 mgr.a (mgr.14388) 12740 : audit [DBG] from='client.278073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:48 smithi049 bash[23528]: audit 2024-09-21T03:08:47.626136+0000 mgr.a (mgr.14388) 12740 : audit [DBG] from='client.278073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:50.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:49 smithi044 bash[22676]: cluster 2024-09-21T03:08:48.857683+0000 mgr.a (mgr.14388) 12741 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:49 smithi179 bash[23186]: cluster 2024-09-21T03:08:48.857683+0000 mgr.a (mgr.14388) 12741 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:49 smithi049 bash[23528]: cluster 2024-09-21T03:08:48.857683+0000 mgr.a (mgr.14388) 12741 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:51.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:50 smithi044 bash[22676]: cluster 2024-09-21T03:08:50.859945+0000 mgr.a (mgr.14388) 12742 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:50 smithi179 bash[23186]: cluster 2024-09-21T03:08:50.859945+0000 mgr.a (mgr.14388) 12742 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:50 smithi049 bash[23528]: cluster 2024-09-21T03:08:50.859945+0000 mgr.a (mgr.14388) 12742 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:08:53.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:53.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:53.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:53.849 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:53.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:53.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:53.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:53.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:08:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:53 smithi044 bash[22676]: cluster 2024-09-21T03:08:52.860695+0000 mgr.a (mgr.14388) 12743 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:54.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:53 smithi179 bash[23186]: cluster 2024-09-21T03:08:52.860695+0000 mgr.a (mgr.14388) 12743 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:53 smithi049 bash[23528]: cluster 2024-09-21T03:08:52.860695+0000 mgr.a (mgr.14388) 12743 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:54 smithi049 bash[23528]: audit 2024-09-21T03:08:53.415763+0000 mgr.a (mgr.14388) 12744 : audit [DBG] from='client.278148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:54 smithi049 bash[23528]: audit 2024-09-21T03:08:54.818638+0000 mon.a (mon.0) 10361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:54 smithi049 bash[23528]: audit 2024-09-21T03:08:54.825444+0000 mon.a (mon.0) 10362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:54 smithi049 bash[23528]: audit 2024-09-21T03:08:54.834430+0000 mon.a (mon.0) 10363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:54 smithi049 bash[23528]: audit 2024-09-21T03:08:54.882228+0000 mon.a (mon.0) 10364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:54 smithi049 bash[23528]: audit 2024-09-21T03:08:54.890668+0000 mon.a (mon.0) 10365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:54 smithi049 bash[23528]: audit 2024-09-21T03:08:54.900963+0000 mon.a (mon.0) 10366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:54 smithi044 bash[22676]: audit 2024-09-21T03:08:53.415763+0000 mgr.a (mgr.14388) 12744 : audit [DBG] from='client.278148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:54 smithi044 bash[22676]: audit 2024-09-21T03:08:54.818638+0000 mon.a (mon.0) 10361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:54 smithi044 bash[22676]: audit 2024-09-21T03:08:54.825444+0000 mon.a (mon.0) 10362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:54 smithi044 bash[22676]: audit 2024-09-21T03:08:54.834430+0000 mon.a (mon.0) 10363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:54 smithi044 bash[22676]: audit 2024-09-21T03:08:54.882228+0000 mon.a (mon.0) 10364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:54 smithi044 bash[22676]: audit 2024-09-21T03:08:54.890668+0000 mon.a (mon.0) 10365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:54 smithi044 bash[22676]: audit 2024-09-21T03:08:54.900963+0000 mon.a (mon.0) 10366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:54 smithi179 bash[23186]: audit 2024-09-21T03:08:53.415763+0000 mgr.a (mgr.14388) 12744 : audit [DBG] from='client.278148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:08:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:54 smithi179 bash[23186]: audit 2024-09-21T03:08:54.818638+0000 mon.a (mon.0) 10361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:54 smithi179 bash[23186]: audit 2024-09-21T03:08:54.825444+0000 mon.a (mon.0) 10362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:54 smithi179 bash[23186]: audit 2024-09-21T03:08:54.834430+0000 mon.a (mon.0) 10363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:54 smithi179 bash[23186]: audit 2024-09-21T03:08:54.882228+0000 mon.a (mon.0) 10364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:54 smithi179 bash[23186]: audit 2024-09-21T03:08:54.890668+0000 mon.a (mon.0) 10365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:54 smithi179 bash[23186]: audit 2024-09-21T03:08:54.900963+0000 mon.a (mon.0) 10366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:08:56.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:55 smithi044 bash[22676]: cluster 2024-09-21T03:08:54.861619+0000 mgr.a (mgr.14388) 12745 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:55 smithi179 bash[23186]: cluster 2024-09-21T03:08:54.861619+0000 mgr.a (mgr.14388) 12745 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:55 smithi049 bash[23528]: cluster 2024-09-21T03:08:54.861619+0000 mgr.a (mgr.14388) 12745 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:08:58.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:57 smithi044 bash[22676]: cluster 2024-09-21T03:08:56.863789+0000 mgr.a (mgr.14388) 12746 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:57 smithi179 bash[23186]: cluster 2024-09-21T03:08:56.863789+0000 mgr.a (mgr.14388) 12746 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:57 smithi049 bash[23528]: cluster 2024-09-21T03:08:56.863789+0000 mgr.a (mgr.14388) 12746 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:08:58.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:08:58.852 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:08:58.852 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:08:59.635 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:08:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:08:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:08:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:08:59.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:00.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:08:59 smithi044 bash[22676]: cluster 2024-09-21T03:08:58.864576+0000 mgr.a (mgr.14388) 12747 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:00.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:08:59 smithi179 bash[23186]: cluster 2024-09-21T03:08:58.864576+0000 mgr.a (mgr.14388) 12747 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:08:59 smithi049 bash[23528]: cluster 2024-09-21T03:08:58.864576+0000 mgr.a (mgr.14388) 12747 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:00 smithi044 bash[22676]: audit 2024-09-21T03:08:59.190866+0000 mgr.a (mgr.14388) 12748 : audit [DBG] from='client.278223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:00 smithi179 bash[23186]: audit 2024-09-21T03:08:59.190866+0000 mgr.a (mgr.14388) 12748 : audit [DBG] from='client.278223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:00 smithi049 bash[23528]: audit 2024-09-21T03:08:59.190866+0000 mgr.a (mgr.14388) 12748 : audit [DBG] from='client.278223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:01 smithi044 bash[22676]: cluster 2024-09-21T03:09:00.866944+0000 mgr.a (mgr.14388) 12749 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:01 smithi179 bash[23186]: cluster 2024-09-21T03:09:00.866944+0000 mgr.a (mgr.14388) 12749 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:01 smithi049 bash[23528]: cluster 2024-09-21T03:09:00.866944+0000 mgr.a (mgr.14388) 12749 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:03 smithi044 bash[22676]: audit 2024-09-21T03:09:02.077241+0000 mon.a (mon.0) 10367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:03 smithi044 bash[22676]: audit 2024-09-21T03:09:02.085750+0000 mon.a (mon.0) 10368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:03 smithi044 bash[22676]: audit 2024-09-21T03:09:02.096012+0000 mon.a (mon.0) 10369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:03 smithi044 bash[22676]: cluster 2024-09-21T03:09:02.867782+0000 mgr.a (mgr.14388) 12750 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:03 smithi179 bash[23186]: audit 2024-09-21T03:09:02.077241+0000 mon.a (mon.0) 10367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:03 smithi179 bash[23186]: audit 2024-09-21T03:09:02.085750+0000 mon.a (mon.0) 10368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:03 smithi179 bash[23186]: audit 2024-09-21T03:09:02.096012+0000 mon.a (mon.0) 10369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:03 smithi179 bash[23186]: cluster 2024-09-21T03:09:02.867782+0000 mgr.a (mgr.14388) 12750 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:03 smithi049 bash[23528]: audit 2024-09-21T03:09:02.077241+0000 mon.a (mon.0) 10367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:03 smithi049 bash[23528]: audit 2024-09-21T03:09:02.085750+0000 mon.a (mon.0) 10368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:03 smithi049 bash[23528]: audit 2024-09-21T03:09:02.096012+0000 mon.a (mon.0) 10369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:03 smithi049 bash[23528]: cluster 2024-09-21T03:09:02.867782+0000 mgr.a (mgr.14388) 12750 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:04.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:04.637 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:05.439 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:05.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:05.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:05.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:05.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:06.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:05 smithi044 bash[22676]: cluster 2024-09-21T03:09:04.868520+0000 mgr.a (mgr.14388) 12751 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:05 smithi179 bash[23186]: cluster 2024-09-21T03:09:04.868520+0000 mgr.a (mgr.14388) 12751 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:05 smithi049 bash[23528]: cluster 2024-09-21T03:09:04.868520+0000 mgr.a (mgr.14388) 12751 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:07.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:06 smithi044 bash[22676]: audit 2024-09-21T03:09:04.980239+0000 mgr.a (mgr.14388) 12752 : audit [DBG] from='client.278301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:06 smithi179 bash[23186]: audit 2024-09-21T03:09:04.980239+0000 mgr.a (mgr.14388) 12752 : audit [DBG] from='client.278301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:06 smithi049 bash[23528]: audit 2024-09-21T03:09:04.980239+0000 mgr.a (mgr.14388) 12752 : audit [DBG] from='client.278301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:07 smithi044 bash[22676]: cluster 2024-09-21T03:09:06.871521+0000 mgr.a (mgr.14388) 12753 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:07 smithi179 bash[23186]: cluster 2024-09-21T03:09:06.871521+0000 mgr.a (mgr.14388) 12753 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:07 smithi049 bash[23528]: cluster 2024-09-21T03:09:06.871521+0000 mgr.a (mgr.14388) 12753 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:09 smithi044 bash[22676]: cluster 2024-09-21T03:09:08.872523+0000 mgr.a (mgr.14388) 12754 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:09:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:09 smithi179 bash[23186]: cluster 2024-09-21T03:09:08.872523+0000 mgr.a (mgr.14388) 12754 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:09:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:09 smithi049 bash[23528]: cluster 2024-09-21T03:09:08.872523+0000 mgr.a (mgr.14388) 12754 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:09:10.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:10.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:11.188 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:11.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:11.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:11.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:11.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:12.214 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:11 smithi049 bash[23528]: audit 2024-09-21T03:09:10.764222+0000 mgr.a (mgr.14388) 12755 : audit [DBG] from='client.278379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:12.214 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:11 smithi049 bash[23528]: cluster 2024-09-21T03:09:10.873850+0000 mgr.a (mgr.14388) 12756 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:12.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:11 smithi044 bash[22676]: audit 2024-09-21T03:09:10.764222+0000 mgr.a (mgr.14388) 12755 : audit [DBG] from='client.278379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:11 smithi044 bash[22676]: cluster 2024-09-21T03:09:10.873850+0000 mgr.a (mgr.14388) 12756 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:11 smithi179 bash[23186]: audit 2024-09-21T03:09:10.764222+0000 mgr.a (mgr.14388) 12755 : audit [DBG] from='client.278379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:11 smithi179 bash[23186]: cluster 2024-09-21T03:09:10.873850+0000 mgr.a (mgr.14388) 12756 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:13 smithi044 bash[22676]: cluster 2024-09-21T03:09:12.874916+0000 mgr.a (mgr.14388) 12757 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:09:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:13 smithi179 bash[23186]: cluster 2024-09-21T03:09:12.874916+0000 mgr.a (mgr.14388) 12757 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:09:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:13 smithi049 bash[23528]: cluster 2024-09-21T03:09:12.874916+0000 mgr.a (mgr.14388) 12757 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:09:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:16.190 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:16.191 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:15 smithi044 bash[22676]: cluster 2024-09-21T03:09:14.875758+0000 mgr.a (mgr.14388) 12758 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:09:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:15 smithi044 bash[22676]: audit 2024-09-21T03:09:15.026599+0000 mon.a (mon.0) 10370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:15 smithi044 bash[22676]: audit 2024-09-21T03:09:15.035364+0000 mon.a (mon.0) 10371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:15 smithi044 bash[22676]: audit 2024-09-21T03:09:15.044559+0000 mon.a (mon.0) 10372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:15 smithi044 bash[22676]: audit 2024-09-21T03:09:15.112115+0000 mon.a (mon.0) 10373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:15 smithi044 bash[22676]: audit 2024-09-21T03:09:15.119826+0000 mon.a (mon.0) 10374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:15 smithi044 bash[22676]: audit 2024-09-21T03:09:15.129737+0000 mon.a (mon.0) 10375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:15 smithi179 bash[23186]: cluster 2024-09-21T03:09:14.875758+0000 mgr.a (mgr.14388) 12758 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:09:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:15 smithi179 bash[23186]: audit 2024-09-21T03:09:15.026599+0000 mon.a (mon.0) 10370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:15 smithi179 bash[23186]: audit 2024-09-21T03:09:15.035364+0000 mon.a (mon.0) 10371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:15 smithi179 bash[23186]: audit 2024-09-21T03:09:15.044559+0000 mon.a (mon.0) 10372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:15 smithi179 bash[23186]: audit 2024-09-21T03:09:15.112115+0000 mon.a (mon.0) 10373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:15 smithi179 bash[23186]: audit 2024-09-21T03:09:15.119826+0000 mon.a (mon.0) 10374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:15 smithi179 bash[23186]: audit 2024-09-21T03:09:15.129737+0000 mon.a (mon.0) 10375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:15 smithi049 bash[23528]: cluster 2024-09-21T03:09:14.875758+0000 mgr.a (mgr.14388) 12758 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:09:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:15 smithi049 bash[23528]: audit 2024-09-21T03:09:15.026599+0000 mon.a (mon.0) 10370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:15 smithi049 bash[23528]: audit 2024-09-21T03:09:15.035364+0000 mon.a (mon.0) 10371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:15 smithi049 bash[23528]: audit 2024-09-21T03:09:15.044559+0000 mon.a (mon.0) 10372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:15 smithi049 bash[23528]: audit 2024-09-21T03:09:15.112115+0000 mon.a (mon.0) 10373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:15 smithi049 bash[23528]: audit 2024-09-21T03:09:15.119826+0000 mon.a (mon.0) 10374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:15 smithi049 bash[23528]: audit 2024-09-21T03:09:15.129737+0000 mon.a (mon.0) 10375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:16.981 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:16.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:16.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:16.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:16.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:17 smithi044 bash[22676]: audit 2024-09-21T03:09:16.525514+0000 mgr.a (mgr.14388) 12759 : audit [DBG] from='client.278457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:17 smithi044 bash[22676]: cluster 2024-09-21T03:09:16.877761+0000 mgr.a (mgr.14388) 12760 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:17 smithi179 bash[23186]: audit 2024-09-21T03:09:16.525514+0000 mgr.a (mgr.14388) 12759 : audit [DBG] from='client.278457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:17 smithi179 bash[23186]: cluster 2024-09-21T03:09:16.877761+0000 mgr.a (mgr.14388) 12760 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:17 smithi049 bash[23528]: audit 2024-09-21T03:09:16.525514+0000 mgr.a (mgr.14388) 12759 : audit [DBG] from='client.278457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:17 smithi049 bash[23528]: cluster 2024-09-21T03:09:16.877761+0000 mgr.a (mgr.14388) 12760 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:19 smithi044 bash[22676]: cluster 2024-09-21T03:09:18.878528+0000 mgr.a (mgr.14388) 12761 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:19 smithi179 bash[23186]: cluster 2024-09-21T03:09:18.878528+0000 mgr.a (mgr.14388) 12761 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:19 smithi049 bash[23528]: cluster 2024-09-21T03:09:18.878528+0000 mgr.a (mgr.14388) 12761 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:21.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:20 smithi044 bash[22676]: cluster 2024-09-21T03:09:20.880486+0000 mgr.a (mgr.14388) 12762 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:21.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:20 smithi179 bash[23186]: cluster 2024-09-21T03:09:20.880486+0000 mgr.a (mgr.14388) 12762 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:20 smithi049 bash[23528]: cluster 2024-09-21T03:09:20.880486+0000 mgr.a (mgr.14388) 12762 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:21.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:21.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:21.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:22.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:22.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:22.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:22.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:22.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:23 smithi179 bash[23186]: audit 2024-09-21T03:09:22.304042+0000 mon.a (mon.0) 10376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:23 smithi179 bash[23186]: audit 2024-09-21T03:09:22.312474+0000 mon.a (mon.0) 10377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:23 smithi179 bash[23186]: audit 2024-09-21T03:09:22.322649+0000 mon.a (mon.0) 10378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:23 smithi179 bash[23186]: audit 2024-09-21T03:09:22.334560+0000 mgr.a (mgr.14388) 12763 : audit [DBG] from='client.278532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:23 smithi179 bash[23186]: cluster 2024-09-21T03:09:22.881432+0000 mgr.a (mgr.14388) 12764 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:23 smithi044 bash[22676]: audit 2024-09-21T03:09:22.304042+0000 mon.a (mon.0) 10376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:23 smithi044 bash[22676]: audit 2024-09-21T03:09:22.312474+0000 mon.a (mon.0) 10377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:23 smithi044 bash[22676]: audit 2024-09-21T03:09:22.322649+0000 mon.a (mon.0) 10378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:23 smithi044 bash[22676]: audit 2024-09-21T03:09:22.334560+0000 mgr.a (mgr.14388) 12763 : audit [DBG] from='client.278532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:23 smithi044 bash[22676]: cluster 2024-09-21T03:09:22.881432+0000 mgr.a (mgr.14388) 12764 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:23 smithi049 bash[23528]: audit 2024-09-21T03:09:22.304042+0000 mon.a (mon.0) 10376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:23 smithi049 bash[23528]: audit 2024-09-21T03:09:22.312474+0000 mon.a (mon.0) 10377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:23 smithi049 bash[23528]: audit 2024-09-21T03:09:22.322649+0000 mon.a (mon.0) 10378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:23 smithi049 bash[23528]: audit 2024-09-21T03:09:22.334560+0000 mgr.a (mgr.14388) 12763 : audit [DBG] from='client.278532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:23 smithi049 bash[23528]: cluster 2024-09-21T03:09:22.881432+0000 mgr.a (mgr.14388) 12764 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:25 smithi044 bash[22676]: cluster 2024-09-21T03:09:24.882203+0000 mgr.a (mgr.14388) 12765 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:25 smithi179 bash[23186]: cluster 2024-09-21T03:09:24.882203+0000 mgr.a (mgr.14388) 12765 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:25 smithi049 bash[23528]: cluster 2024-09-21T03:09:24.882203+0000 mgr.a (mgr.14388) 12765 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:27.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:27.782 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:27 smithi044 bash[22676]: cluster 2024-09-21T03:09:26.884453+0000 mgr.a (mgr.14388) 12766 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:27 smithi179 bash[23186]: cluster 2024-09-21T03:09:26.884453+0000 mgr.a (mgr.14388) 12766 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:27 smithi049 bash[23528]: cluster 2024-09-21T03:09:26.884453+0000 mgr.a (mgr.14388) 12766 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:28.560 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:28.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:30.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:29 smithi044 bash[22676]: audit 2024-09-21T03:09:28.121700+0000 mgr.a (mgr.14388) 12767 : audit [DBG] from='client.278607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:30.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:29 smithi044 bash[22676]: cluster 2024-09-21T03:09:28.885638+0000 mgr.a (mgr.14388) 12768 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:29 smithi179 bash[23186]: audit 2024-09-21T03:09:28.121700+0000 mgr.a (mgr.14388) 12767 : audit [DBG] from='client.278607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:30.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:29 smithi179 bash[23186]: cluster 2024-09-21T03:09:28.885638+0000 mgr.a (mgr.14388) 12768 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:29 smithi049 bash[23528]: audit 2024-09-21T03:09:28.121700+0000 mgr.a (mgr.14388) 12767 : audit [DBG] from='client.278607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:29 smithi049 bash[23528]: cluster 2024-09-21T03:09:28.885638+0000 mgr.a (mgr.14388) 12768 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:31 smithi044 bash[22676]: cluster 2024-09-21T03:09:30.887879+0000 mgr.a (mgr.14388) 12769 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:31 smithi179 bash[23186]: cluster 2024-09-21T03:09:30.887879+0000 mgr.a (mgr.14388) 12769 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:31 smithi049 bash[23528]: cluster 2024-09-21T03:09:30.887879+0000 mgr.a (mgr.14388) 12769 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:33.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:33.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:33 smithi049 bash[23528]: cluster 2024-09-21T03:09:32.888674+0000 mgr.a (mgr.14388) 12770 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:34.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:33 smithi044 bash[22676]: cluster 2024-09-21T03:09:32.888674+0000 mgr.a (mgr.14388) 12770 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:33 smithi179 bash[23186]: cluster 2024-09-21T03:09:32.888674+0000 mgr.a (mgr.14388) 12770 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:34.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:34.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:34.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:34.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:34.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:35.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:34 smithi044 bash[22676]: audit 2024-09-21T03:09:33.902127+0000 mgr.a (mgr.14388) 12771 : audit [DBG] from='client.278685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:35.250 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:34 smithi179 bash[23186]: audit 2024-09-21T03:09:33.902127+0000 mgr.a (mgr.14388) 12771 : audit [DBG] from='client.278685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:35.266 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:34 smithi049 bash[23528]: audit 2024-09-21T03:09:33.902127+0000 mgr.a (mgr.14388) 12771 : audit [DBG] from='client.278685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:35 smithi044 bash[22676]: cluster 2024-09-21T03:09:34.889729+0000 mgr.a (mgr.14388) 12772 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:35 smithi044 bash[22676]: audit 2024-09-21T03:09:35.236523+0000 mon.a (mon.0) 10379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:35 smithi044 bash[22676]: audit 2024-09-21T03:09:35.242120+0000 mon.a (mon.0) 10380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:35 smithi044 bash[22676]: audit 2024-09-21T03:09:35.249609+0000 mon.a (mon.0) 10381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:35 smithi044 bash[22676]: audit 2024-09-21T03:09:35.285898+0000 mon.a (mon.0) 10382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:35 smithi044 bash[22676]: audit 2024-09-21T03:09:35.291682+0000 mon.a (mon.0) 10383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:35 smithi044 bash[22676]: audit 2024-09-21T03:09:35.296418+0000 mon.a (mon.0) 10384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:35 smithi179 bash[23186]: cluster 2024-09-21T03:09:34.889729+0000 mgr.a (mgr.14388) 12772 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:35 smithi179 bash[23186]: audit 2024-09-21T03:09:35.236523+0000 mon.a (mon.0) 10379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:35 smithi179 bash[23186]: audit 2024-09-21T03:09:35.242120+0000 mon.a (mon.0) 10380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:35 smithi179 bash[23186]: audit 2024-09-21T03:09:35.249609+0000 mon.a (mon.0) 10381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:35 smithi179 bash[23186]: audit 2024-09-21T03:09:35.285898+0000 mon.a (mon.0) 10382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:35 smithi179 bash[23186]: audit 2024-09-21T03:09:35.291682+0000 mon.a (mon.0) 10383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:35 smithi179 bash[23186]: audit 2024-09-21T03:09:35.296418+0000 mon.a (mon.0) 10384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:35 smithi049 bash[23528]: cluster 2024-09-21T03:09:34.889729+0000 mgr.a (mgr.14388) 12772 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:35 smithi049 bash[23528]: audit 2024-09-21T03:09:35.236523+0000 mon.a (mon.0) 10379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:35 smithi049 bash[23528]: audit 2024-09-21T03:09:35.242120+0000 mon.a (mon.0) 10380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:35 smithi049 bash[23528]: audit 2024-09-21T03:09:35.249609+0000 mon.a (mon.0) 10381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:35 smithi049 bash[23528]: audit 2024-09-21T03:09:35.285898+0000 mon.a (mon.0) 10382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:35 smithi049 bash[23528]: audit 2024-09-21T03:09:35.291682+0000 mon.a (mon.0) 10383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:35 smithi049 bash[23528]: audit 2024-09-21T03:09:35.296418+0000 mon.a (mon.0) 10384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:36 smithi044 bash[22676]: cluster 2024-09-21T03:09:36.892078+0000 mgr.a (mgr.14388) 12773 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:36 smithi179 bash[23186]: cluster 2024-09-21T03:09:36.892078+0000 mgr.a (mgr.14388) 12773 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:36 smithi049 bash[23528]: cluster 2024-09-21T03:09:36.892078+0000 mgr.a (mgr.14388) 12773 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:09:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:38 smithi049 bash[23528]: audit 2024-09-21T03:09:38.716907+0000 mon.a (mon.0) 10385 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:09:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:38 smithi049 bash[23528]: audit 2024-09-21T03:09:38.723235+0000 mon.a (mon.0) 10386 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:09:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:38 smithi049 bash[23528]: audit 2024-09-21T03:09:38.725233+0000 mon.a (mon.0) 10387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:09:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:38 smithi049 bash[23528]: audit 2024-09-21T03:09:38.736349+0000 mon.a (mon.0) 10388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:38 smithi049 bash[23528]: audit 2024-09-21T03:09:38.742628+0000 mon.a (mon.0) 10389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:09:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:38 smithi044 bash[22676]: audit 2024-09-21T03:09:38.716907+0000 mon.a (mon.0) 10385 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:09:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:38 smithi044 bash[22676]: audit 2024-09-21T03:09:38.723235+0000 mon.a (mon.0) 10386 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:09:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:38 smithi044 bash[22676]: audit 2024-09-21T03:09:38.725233+0000 mon.a (mon.0) 10387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:09:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:38 smithi044 bash[22676]: audit 2024-09-21T03:09:38.736349+0000 mon.a (mon.0) 10388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:38 smithi044 bash[22676]: audit 2024-09-21T03:09:38.742628+0000 mon.a (mon.0) 10389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:09:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:38 smithi179 bash[23186]: audit 2024-09-21T03:09:38.716907+0000 mon.a (mon.0) 10385 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:09:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:38 smithi179 bash[23186]: audit 2024-09-21T03:09:38.723235+0000 mon.a (mon.0) 10386 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:09:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:38 smithi179 bash[23186]: audit 2024-09-21T03:09:38.725233+0000 mon.a (mon.0) 10387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:09:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:38 smithi179 bash[23186]: audit 2024-09-21T03:09:38.736349+0000 mon.a (mon.0) 10388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:38 smithi179 bash[23186]: audit 2024-09-21T03:09:38.742628+0000 mon.a (mon.0) 10389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:09:39.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:39.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:39.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:39.778 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:09:39 smithi044 bash[22930]: debug 2024-09-21T03:09:39.511+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:09:39.778 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:09:39 smithi044 bash[22930]: debug 2024-09-21T03:09:39.511+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:09:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:39 smithi049 bash[23528]: audit 2024-09-21T03:09:38.745089+0000 mgr.a (mgr.14388) 12774 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:09:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:39 smithi049 bash[23528]: cluster 2024-09-21T03:09:38.892705+0000 mgr.a (mgr.14388) 12775 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:40.089 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:40.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:40.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:40.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:40.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:39 smithi044 bash[22676]: audit 2024-09-21T03:09:38.745089+0000 mgr.a (mgr.14388) 12774 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:09:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:39 smithi044 bash[22676]: cluster 2024-09-21T03:09:38.892705+0000 mgr.a (mgr.14388) 12775 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:39 smithi179 bash[23186]: audit 2024-09-21T03:09:38.745089+0000 mgr.a (mgr.14388) 12774 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:09:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:39 smithi179 bash[23186]: cluster 2024-09-21T03:09:38.892705+0000 mgr.a (mgr.14388) 12775 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:40 smithi049 bash[23528]: audit 2024-09-21T03:09:39.515379+0000 mgr.a (mgr.14388) 12776 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:40 smithi049 bash[23528]: cephadm 2024-09-21T03:09:39.516536+0000 mgr.a (mgr.14388) 12777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:09:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:40 smithi049 bash[23528]: audit 2024-09-21T03:09:39.670257+0000 mgr.a (mgr.14388) 12778 : audit [DBG] from='client.278868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:41.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:40 smithi044 bash[22676]: audit 2024-09-21T03:09:39.515379+0000 mgr.a (mgr.14388) 12776 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:09:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:40 smithi044 bash[22676]: cephadm 2024-09-21T03:09:39.516536+0000 mgr.a (mgr.14388) 12777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:09:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:40 smithi044 bash[22676]: audit 2024-09-21T03:09:39.670257+0000 mgr.a (mgr.14388) 12778 : audit [DBG] from='client.278868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:40 smithi179 bash[23186]: audit 2024-09-21T03:09:39.515379+0000 mgr.a (mgr.14388) 12776 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:09:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:40 smithi179 bash[23186]: cephadm 2024-09-21T03:09:39.516536+0000 mgr.a (mgr.14388) 12777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:09:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:40 smithi179 bash[23186]: audit 2024-09-21T03:09:39.670257+0000 mgr.a (mgr.14388) 12778 : audit [DBG] from='client.278868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:41 smithi049 bash[23528]: cluster 2024-09-21T03:09:40.895128+0000 mgr.a (mgr.14388) 12779 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:42.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:41 smithi044 bash[22676]: cluster 2024-09-21T03:09:40.895128+0000 mgr.a (mgr.14388) 12779 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:42.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:41 smithi179 bash[23186]: cluster 2024-09-21T03:09:40.895128+0000 mgr.a (mgr.14388) 12779 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:43 smithi179 bash[23186]: audit 2024-09-21T03:09:42.545451+0000 mon.a (mon.0) 10390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:43 smithi179 bash[23186]: audit 2024-09-21T03:09:42.554122+0000 mon.a (mon.0) 10391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:43 smithi179 bash[23186]: audit 2024-09-21T03:09:42.564576+0000 mon.a (mon.0) 10392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:43 smithi179 bash[23186]: cluster 2024-09-21T03:09:42.896055+0000 mgr.a (mgr.14388) 12780 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:43 smithi049 bash[23528]: audit 2024-09-21T03:09:42.545451+0000 mon.a (mon.0) 10390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:43 smithi049 bash[23528]: audit 2024-09-21T03:09:42.554122+0000 mon.a (mon.0) 10391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:43 smithi049 bash[23528]: audit 2024-09-21T03:09:42.564576+0000 mon.a (mon.0) 10392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:43 smithi049 bash[23528]: cluster 2024-09-21T03:09:42.896055+0000 mgr.a (mgr.14388) 12780 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:43 smithi044 bash[22676]: audit 2024-09-21T03:09:42.545451+0000 mon.a (mon.0) 10390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:43 smithi044 bash[22676]: audit 2024-09-21T03:09:42.554122+0000 mon.a (mon.0) 10391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:43 smithi044 bash[22676]: audit 2024-09-21T03:09:42.564576+0000 mon.a (mon.0) 10392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:43 smithi044 bash[22676]: cluster 2024-09-21T03:09:42.896055+0000 mgr.a (mgr.14388) 12780 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:45.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:45.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:45.845 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:46.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:45 smithi044 bash[22676]: cluster 2024-09-21T03:09:44.896906+0000 mgr.a (mgr.14388) 12781 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:46.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:45 smithi179 bash[23186]: cluster 2024-09-21T03:09:44.896906+0000 mgr.a (mgr.14388) 12781 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:45 smithi049 bash[23528]: cluster 2024-09-21T03:09:44.896906+0000 mgr.a (mgr.14388) 12781 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:47.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:46 smithi044 bash[22676]: audit 2024-09-21T03:09:45.422904+0000 mgr.a (mgr.14388) 12782 : audit [DBG] from='client.278943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:46 smithi179 bash[23186]: audit 2024-09-21T03:09:45.422904+0000 mgr.a (mgr.14388) 12782 : audit [DBG] from='client.278943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:46 smithi049 bash[23528]: audit 2024-09-21T03:09:45.422904+0000 mgr.a (mgr.14388) 12782 : audit [DBG] from='client.278943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:47 smithi044 bash[22676]: cluster 2024-09-21T03:09:46.899781+0000 mgr.a (mgr.14388) 12783 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:48.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:47 smithi179 bash[23186]: cluster 2024-09-21T03:09:46.899781+0000 mgr.a (mgr.14388) 12783 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:47 smithi049 bash[23528]: cluster 2024-09-21T03:09:46.899781+0000 mgr.a (mgr.14388) 12783 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:49 smithi044 bash[22676]: cluster 2024-09-21T03:09:48.900574+0000 mgr.a (mgr.14388) 12784 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:49 smithi179 bash[23186]: cluster 2024-09-21T03:09:48.900574+0000 mgr.a (mgr.14388) 12784 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:49 smithi049 bash[23528]: cluster 2024-09-21T03:09:48.900574+0000 mgr.a (mgr.14388) 12784 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:09:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:50.846 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:50.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:51.608 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:51.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:51.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:51.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:51.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:52.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:51 smithi044 bash[22676]: cluster 2024-09-21T03:09:50.902557+0000 mgr.a (mgr.14388) 12785 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:51 smithi179 bash[23186]: cluster 2024-09-21T03:09:50.902557+0000 mgr.a (mgr.14388) 12785 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:51 smithi049 bash[23528]: cluster 2024-09-21T03:09:50.902557+0000 mgr.a (mgr.14388) 12785 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:09:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:52 smithi049 bash[23528]: audit 2024-09-21T03:09:51.189656+0000 mgr.a (mgr.14388) 12786 : audit [DBG] from='client.279018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:52 smithi049 bash[23528]: cluster 2024-09-21T03:09:52.903505+0000 mgr.a (mgr.14388) 12787 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:09:53.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:52 smithi044 bash[22676]: audit 2024-09-21T03:09:51.189656+0000 mgr.a (mgr.14388) 12786 : audit [DBG] from='client.279018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:52 smithi044 bash[22676]: cluster 2024-09-21T03:09:52.903505+0000 mgr.a (mgr.14388) 12787 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:09:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:52 smithi179 bash[23186]: audit 2024-09-21T03:09:51.189656+0000 mgr.a (mgr.14388) 12786 : audit [DBG] from='client.279018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:52 smithi179 bash[23186]: cluster 2024-09-21T03:09:52.903505+0000 mgr.a (mgr.14388) 12787 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:09:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:55 smithi049 bash[23528]: cluster 2024-09-21T03:09:54.904303+0000 mgr.a (mgr.14388) 12788 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:09:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:55 smithi049 bash[23528]: audit 2024-09-21T03:09:55.446104+0000 mon.a (mon.0) 10393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:55 smithi049 bash[23528]: audit 2024-09-21T03:09:55.453398+0000 mon.a (mon.0) 10394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:55 smithi049 bash[23528]: audit 2024-09-21T03:09:55.464546+0000 mon.a (mon.0) 10395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:55 smithi049 bash[23528]: audit 2024-09-21T03:09:55.470950+0000 mon.a (mon.0) 10396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:55 smithi049 bash[23528]: audit 2024-09-21T03:09:55.482063+0000 mon.a (mon.0) 10397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:55 smithi049 bash[23528]: audit 2024-09-21T03:09:55.490353+0000 mon.a (mon.0) 10398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:55 smithi044 bash[22676]: cluster 2024-09-21T03:09:54.904303+0000 mgr.a (mgr.14388) 12788 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:09:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:55 smithi044 bash[22676]: audit 2024-09-21T03:09:55.446104+0000 mon.a (mon.0) 10393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:55 smithi044 bash[22676]: audit 2024-09-21T03:09:55.453398+0000 mon.a (mon.0) 10394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:55 smithi044 bash[22676]: audit 2024-09-21T03:09:55.464546+0000 mon.a (mon.0) 10395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:55 smithi044 bash[22676]: audit 2024-09-21T03:09:55.470950+0000 mon.a (mon.0) 10396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:55 smithi044 bash[22676]: audit 2024-09-21T03:09:55.482063+0000 mon.a (mon.0) 10397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:55 smithi044 bash[22676]: audit 2024-09-21T03:09:55.490353+0000 mon.a (mon.0) 10398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:55 smithi179 bash[23186]: cluster 2024-09-21T03:09:54.904303+0000 mgr.a (mgr.14388) 12788 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:09:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:55 smithi179 bash[23186]: audit 2024-09-21T03:09:55.446104+0000 mon.a (mon.0) 10393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:55 smithi179 bash[23186]: audit 2024-09-21T03:09:55.453398+0000 mon.a (mon.0) 10394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:55 smithi179 bash[23186]: audit 2024-09-21T03:09:55.464546+0000 mon.a (mon.0) 10395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:55 smithi179 bash[23186]: audit 2024-09-21T03:09:55.470950+0000 mon.a (mon.0) 10396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:55 smithi179 bash[23186]: audit 2024-09-21T03:09:55.482063+0000 mon.a (mon.0) 10397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:55 smithi179 bash[23186]: audit 2024-09-21T03:09:55.490353+0000 mon.a (mon.0) 10398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:09:56.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:09:56.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:09:56.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:09:57.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:09:57.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:09:57.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:09:57.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:09:57.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:09:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:57 smithi044 bash[22676]: cluster 2024-09-21T03:09:56.906460+0000 mgr.a (mgr.14388) 12789 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:09:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:57 smithi044 bash[22676]: audit 2024-09-21T03:09:56.945907+0000 mgr.a (mgr.14388) 12790 : audit [DBG] from='client.279096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:57 smithi179 bash[23186]: cluster 2024-09-21T03:09:56.906460+0000 mgr.a (mgr.14388) 12789 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:09:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:57 smithi179 bash[23186]: audit 2024-09-21T03:09:56.945907+0000 mgr.a (mgr.14388) 12790 : audit [DBG] from='client.279096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:57 smithi049 bash[23528]: cluster 2024-09-21T03:09:56.906460+0000 mgr.a (mgr.14388) 12789 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:09:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:57 smithi049 bash[23528]: audit 2024-09-21T03:09:56.945907+0000 mgr.a (mgr.14388) 12790 : audit [DBG] from='client.279096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:09:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:09:59 smithi049 bash[23528]: cluster 2024-09-21T03:09:58.907358+0000 mgr.a (mgr.14388) 12791 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:59.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:09:59 smithi044 bash[22676]: cluster 2024-09-21T03:09:58.907358+0000 mgr.a (mgr.14388) 12791 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:09:59.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:09:59 smithi179 bash[23186]: cluster 2024-09-21T03:09:58.907358+0000 mgr.a (mgr.14388) 12791 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:00 smithi049 bash[23528]: cluster 2024-09-21T03:10:00.000155+0000 mon.a (mon.0) 10399 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:10:00.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:00 smithi044 bash[22676]: cluster 2024-09-21T03:10:00.000155+0000 mon.a (mon.0) 10399 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:10:00.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:00 smithi179 bash[23186]: cluster 2024-09-21T03:10:00.000155+0000 mon.a (mon.0) 10399 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:10:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:01 smithi044 bash[22676]: cluster 2024-09-21T03:10:00.909610+0000 mgr.a (mgr.14388) 12792 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:01 smithi179 bash[23186]: cluster 2024-09-21T03:10:00.909610+0000 mgr.a (mgr.14388) 12792 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:01 smithi049 bash[23528]: cluster 2024-09-21T03:10:00.909610+0000 mgr.a (mgr.14388) 12792 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:02.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:02.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:03.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:03.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:03.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:03.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:03.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:03 smithi044 bash[22676]: audit 2024-09-21T03:10:02.720104+0000 mon.a (mon.0) 10400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:03 smithi044 bash[22676]: audit 2024-09-21T03:10:02.725317+0000 mgr.a (mgr.14388) 12793 : audit [DBG] from='client.279174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:03 smithi044 bash[22676]: audit 2024-09-21T03:10:02.727833+0000 mon.a (mon.0) 10401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:03 smithi044 bash[22676]: audit 2024-09-21T03:10:02.754892+0000 mon.a (mon.0) 10402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:03 smithi044 bash[22676]: cluster 2024-09-21T03:10:02.910142+0000 mgr.a (mgr.14388) 12794 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:03 smithi179 bash[23186]: audit 2024-09-21T03:10:02.720104+0000 mon.a (mon.0) 10400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:03 smithi179 bash[23186]: audit 2024-09-21T03:10:02.725317+0000 mgr.a (mgr.14388) 12793 : audit [DBG] from='client.279174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:03 smithi179 bash[23186]: audit 2024-09-21T03:10:02.727833+0000 mon.a (mon.0) 10401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:03 smithi179 bash[23186]: audit 2024-09-21T03:10:02.754892+0000 mon.a (mon.0) 10402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:03 smithi179 bash[23186]: cluster 2024-09-21T03:10:02.910142+0000 mgr.a (mgr.14388) 12794 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:03 smithi049 bash[23528]: audit 2024-09-21T03:10:02.720104+0000 mon.a (mon.0) 10400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:03 smithi049 bash[23528]: audit 2024-09-21T03:10:02.725317+0000 mgr.a (mgr.14388) 12793 : audit [DBG] from='client.279174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:03 smithi049 bash[23528]: audit 2024-09-21T03:10:02.727833+0000 mon.a (mon.0) 10401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:03 smithi049 bash[23528]: audit 2024-09-21T03:10:02.754892+0000 mon.a (mon.0) 10402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:03 smithi049 bash[23528]: cluster 2024-09-21T03:10:02.910142+0000 mgr.a (mgr.14388) 12794 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:06.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:05 smithi044 bash[22676]: cluster 2024-09-21T03:10:04.911042+0000 mgr.a (mgr.14388) 12795 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:06.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:05 smithi179 bash[23186]: cluster 2024-09-21T03:10:04.911042+0000 mgr.a (mgr.14388) 12795 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:05 smithi049 bash[23528]: cluster 2024-09-21T03:10:04.911042+0000 mgr.a (mgr.14388) 12795 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:08.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:08.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:07 smithi044 bash[22676]: cluster 2024-09-21T03:10:06.912526+0000 mgr.a (mgr.14388) 12796 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:08.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:07 smithi179 bash[23186]: cluster 2024-09-21T03:10:06.912526+0000 mgr.a (mgr.14388) 12796 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:07 smithi049 bash[23528]: cluster 2024-09-21T03:10:06.912526+0000 mgr.a (mgr.14388) 12796 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:08.943 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:08.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:10.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:09 smithi044 bash[22676]: audit 2024-09-21T03:10:08.519277+0000 mgr.a (mgr.14388) 12797 : audit [DBG] from='client.279252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:10.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:09 smithi044 bash[22676]: cluster 2024-09-21T03:10:08.913008+0000 mgr.a (mgr.14388) 12798 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:09 smithi179 bash[23186]: audit 2024-09-21T03:10:08.519277+0000 mgr.a (mgr.14388) 12797 : audit [DBG] from='client.279252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:10.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:09 smithi179 bash[23186]: cluster 2024-09-21T03:10:08.913008+0000 mgr.a (mgr.14388) 12798 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:09 smithi049 bash[23528]: audit 2024-09-21T03:10:08.519277+0000 mgr.a (mgr.14388) 12797 : audit [DBG] from='client.279252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:09 smithi049 bash[23528]: cluster 2024-09-21T03:10:08.913008+0000 mgr.a (mgr.14388) 12798 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:11.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:10 smithi044 bash[22676]: cluster 2024-09-21T03:10:10.915166+0000 mgr.a (mgr.14388) 12799 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:10 smithi179 bash[23186]: cluster 2024-09-21T03:10:10.915166+0000 mgr.a (mgr.14388) 12799 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:10 smithi049 bash[23528]: cluster 2024-09-21T03:10:10.915166+0000 mgr.a (mgr.14388) 12799 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:13.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:13 smithi044 bash[22676]: cluster 2024-09-21T03:10:12.915943+0000 mgr.a (mgr.14388) 12800 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:13 smithi179 bash[23186]: cluster 2024-09-21T03:10:12.915943+0000 mgr.a (mgr.14388) 12800 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:14.274 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:13 smithi049 bash[23528]: cluster 2024-09-21T03:10:12.915943+0000 mgr.a (mgr.14388) 12800 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:14.706 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:14.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:15 smithi049 bash[23528]: audit 2024-09-21T03:10:14.278279+0000 mgr.a (mgr.14388) 12801 : audit [DBG] from='client.279324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:15 smithi049 bash[23528]: cluster 2024-09-21T03:10:14.916910+0000 mgr.a (mgr.14388) 12802 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:15.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:15 smithi044 bash[22676]: audit 2024-09-21T03:10:14.278279+0000 mgr.a (mgr.14388) 12801 : audit [DBG] from='client.279324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:15 smithi044 bash[22676]: cluster 2024-09-21T03:10:14.916910+0000 mgr.a (mgr.14388) 12802 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:15 smithi179 bash[23186]: audit 2024-09-21T03:10:14.278279+0000 mgr.a (mgr.14388) 12801 : audit [DBG] from='client.279324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:15.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:15 smithi179 bash[23186]: cluster 2024-09-21T03:10:14.916910+0000 mgr.a (mgr.14388) 12802 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:16 smithi044 bash[22676]: audit 2024-09-21T03:10:15.633475+0000 mon.a (mon.0) 10403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:16 smithi044 bash[22676]: audit 2024-09-21T03:10:15.641033+0000 mon.a (mon.0) 10404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:16 smithi044 bash[22676]: audit 2024-09-21T03:10:15.651007+0000 mon.a (mon.0) 10405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:16 smithi044 bash[22676]: audit 2024-09-21T03:10:15.683083+0000 mon.a (mon.0) 10406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:16 smithi044 bash[22676]: audit 2024-09-21T03:10:15.690746+0000 mon.a (mon.0) 10407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:16 smithi044 bash[22676]: audit 2024-09-21T03:10:15.700534+0000 mon.a (mon.0) 10408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:16 smithi049 bash[23528]: audit 2024-09-21T03:10:15.633475+0000 mon.a (mon.0) 10403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:16 smithi049 bash[23528]: audit 2024-09-21T03:10:15.641033+0000 mon.a (mon.0) 10404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:16 smithi049 bash[23528]: audit 2024-09-21T03:10:15.651007+0000 mon.a (mon.0) 10405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:16 smithi049 bash[23528]: audit 2024-09-21T03:10:15.683083+0000 mon.a (mon.0) 10406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:16 smithi049 bash[23528]: audit 2024-09-21T03:10:15.690746+0000 mon.a (mon.0) 10407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:16.921 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:16 smithi049 bash[23528]: audit 2024-09-21T03:10:15.700534+0000 mon.a (mon.0) 10408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:16 smithi179 bash[23186]: audit 2024-09-21T03:10:15.633475+0000 mon.a (mon.0) 10403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:16 smithi179 bash[23186]: audit 2024-09-21T03:10:15.641033+0000 mon.a (mon.0) 10404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:16 smithi179 bash[23186]: audit 2024-09-21T03:10:15.651007+0000 mon.a (mon.0) 10405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:16 smithi179 bash[23186]: audit 2024-09-21T03:10:15.683083+0000 mon.a (mon.0) 10406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:16 smithi179 bash[23186]: audit 2024-09-21T03:10:15.690746+0000 mon.a (mon.0) 10407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:16 smithi179 bash[23186]: audit 2024-09-21T03:10:15.700534+0000 mon.a (mon.0) 10408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:17.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:17 smithi044 bash[22676]: cluster 2024-09-21T03:10:16.919214+0000 mgr.a (mgr.14388) 12803 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:18.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:17 smithi179 bash[23186]: cluster 2024-09-21T03:10:16.919214+0000 mgr.a (mgr.14388) 12803 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:17 smithi049 bash[23528]: cluster 2024-09-21T03:10:16.919214+0000 mgr.a (mgr.14388) 12803 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:20.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:19 smithi044 bash[22676]: cluster 2024-09-21T03:10:18.919985+0000 mgr.a (mgr.14388) 12804 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:20.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:19 smithi179 bash[23186]: cluster 2024-09-21T03:10:18.919985+0000 mgr.a (mgr.14388) 12804 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:19 smithi049 bash[23528]: cluster 2024-09-21T03:10:18.919985+0000 mgr.a (mgr.14388) 12804 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:20.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:20 smithi044 bash[22676]: audit 2024-09-21T03:10:20.040855+0000 mgr.a (mgr.14388) 12805 : audit [DBG] from='client.279402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:20 smithi044 bash[22676]: cluster 2024-09-21T03:10:20.922767+0000 mgr.a (mgr.14388) 12806 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:20 smithi179 bash[23186]: audit 2024-09-21T03:10:20.040855+0000 mgr.a (mgr.14388) 12805 : audit [DBG] from='client.279402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:20 smithi179 bash[23186]: cluster 2024-09-21T03:10:20.922767+0000 mgr.a (mgr.14388) 12806 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:20 smithi049 bash[23528]: audit 2024-09-21T03:10:20.040855+0000 mgr.a (mgr.14388) 12805 : audit [DBG] from='client.279402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:20 smithi049 bash[23528]: cluster 2024-09-21T03:10:20.922767+0000 mgr.a (mgr.14388) 12806 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:23 smithi044 bash[22676]: cluster 2024-09-21T03:10:22.923537+0000 mgr.a (mgr.14388) 12807 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:10:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:23 smithi044 bash[22676]: audit 2024-09-21T03:10:22.973674+0000 mon.a (mon.0) 10409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:23 smithi044 bash[22676]: audit 2024-09-21T03:10:22.988465+0000 mon.a (mon.0) 10410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:23 smithi044 bash[22676]: audit 2024-09-21T03:10:22.998995+0000 mon.a (mon.0) 10411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:23 smithi179 bash[23186]: cluster 2024-09-21T03:10:22.923537+0000 mgr.a (mgr.14388) 12807 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:10:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:23 smithi179 bash[23186]: audit 2024-09-21T03:10:22.973674+0000 mon.a (mon.0) 10409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:23 smithi179 bash[23186]: audit 2024-09-21T03:10:22.988465+0000 mon.a (mon.0) 10410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:23 smithi179 bash[23186]: audit 2024-09-21T03:10:22.998995+0000 mon.a (mon.0) 10411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:23 smithi049 bash[23528]: cluster 2024-09-21T03:10:22.923537+0000 mgr.a (mgr.14388) 12807 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:23 smithi049 bash[23528]: audit 2024-09-21T03:10:22.973674+0000 mon.a (mon.0) 10409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:23 smithi049 bash[23528]: audit 2024-09-21T03:10:22.988465+0000 mon.a (mon.0) 10410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:23 smithi049 bash[23528]: audit 2024-09-21T03:10:22.998995+0000 mon.a (mon.0) 10411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:25.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:25.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:25 smithi049 bash[23528]: cluster 2024-09-21T03:10:24.924304+0000 mgr.a (mgr.14388) 12808 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:10:26.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:26.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:26.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:26.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:26.223 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:26.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:25 smithi044 bash[22676]: cluster 2024-09-21T03:10:24.924304+0000 mgr.a (mgr.14388) 12808 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:10:26.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:25 smithi179 bash[23186]: cluster 2024-09-21T03:10:24.924304+0000 mgr.a (mgr.14388) 12808 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:10:27.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:26 smithi044 bash[22676]: audit 2024-09-21T03:10:25.805238+0000 mgr.a (mgr.14388) 12809 : audit [DBG] from='client.279480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:27.251 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:26 smithi179 bash[23186]: audit 2024-09-21T03:10:25.805238+0000 mgr.a (mgr.14388) 12809 : audit [DBG] from='client.279480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:26 smithi049 bash[23528]: audit 2024-09-21T03:10:25.805238+0000 mgr.a (mgr.14388) 12809 : audit [DBG] from='client.279480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:28.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:27 smithi044 bash[22676]: cluster 2024-09-21T03:10:26.927197+0000 mgr.a (mgr.14388) 12810 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:27 smithi179 bash[23186]: cluster 2024-09-21T03:10:26.927197+0000 mgr.a (mgr.14388) 12810 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:27 smithi049 bash[23528]: cluster 2024-09-21T03:10:26.927197+0000 mgr.a (mgr.14388) 12810 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:28 smithi044 bash[22676]: cluster 2024-09-21T03:10:28.927877+0000 mgr.a (mgr.14388) 12811 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:10:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:28 smithi179 bash[23186]: cluster 2024-09-21T03:10:28.927877+0000 mgr.a (mgr.14388) 12811 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:10:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:28 smithi049 bash[23528]: cluster 2024-09-21T03:10:28.927877+0000 mgr.a (mgr.14388) 12811 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:10:31.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:31.226 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:31 smithi049 bash[23528]: cluster 2024-09-21T03:10:30.930540+0000 mgr.a (mgr.14388) 12812 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:31 smithi044 bash[22676]: cluster 2024-09-21T03:10:30.930540+0000 mgr.a (mgr.14388) 12812 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:31 smithi179 bash[23186]: cluster 2024-09-21T03:10:30.930540+0000 mgr.a (mgr.14388) 12812 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:31.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:32 smithi049 bash[23528]: audit 2024-09-21T03:10:31.563099+0000 mgr.a (mgr.14388) 12813 : audit [DBG] from='client.279558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:32.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:32 smithi044 bash[22676]: audit 2024-09-21T03:10:31.563099+0000 mgr.a (mgr.14388) 12813 : audit [DBG] from='client.279558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:32 smithi179 bash[23186]: audit 2024-09-21T03:10:31.563099+0000 mgr.a (mgr.14388) 12813 : audit [DBG] from='client.279558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:33 smithi049 bash[23528]: cluster 2024-09-21T03:10:32.931495+0000 mgr.a (mgr.14388) 12814 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:33.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:33 smithi044 bash[22676]: cluster 2024-09-21T03:10:32.931495+0000 mgr.a (mgr.14388) 12814 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:33 smithi179 bash[23186]: cluster 2024-09-21T03:10:32.931495+0000 mgr.a (mgr.14388) 12814 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:35 smithi049 bash[23528]: cluster 2024-09-21T03:10:34.932284+0000 mgr.a (mgr.14388) 12815 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:35 smithi044 bash[22676]: cluster 2024-09-21T03:10:34.932284+0000 mgr.a (mgr.14388) 12815 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:35 smithi179 bash[23186]: cluster 2024-09-21T03:10:34.932284+0000 mgr.a (mgr.14388) 12815 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:36.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:36.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:36.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:37.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:36 smithi049 bash[23528]: audit 2024-09-21T03:10:35.848284+0000 mon.a (mon.0) 10412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:36 smithi049 bash[23528]: audit 2024-09-21T03:10:35.856807+0000 mon.a (mon.0) 10413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:36 smithi049 bash[23528]: audit 2024-09-21T03:10:35.868416+0000 mon.a (mon.0) 10414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:36 smithi049 bash[23528]: audit 2024-09-21T03:10:35.914591+0000 mon.a (mon.0) 10415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:36 smithi049 bash[23528]: audit 2024-09-21T03:10:35.923973+0000 mon.a (mon.0) 10416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.129 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:36 smithi049 bash[23528]: audit 2024-09-21T03:10:35.935163+0000 mon.a (mon.0) 10417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:36 smithi044 bash[22676]: audit 2024-09-21T03:10:35.848284+0000 mon.a (mon.0) 10412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:36 smithi044 bash[22676]: audit 2024-09-21T03:10:35.856807+0000 mon.a (mon.0) 10413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:36 smithi044 bash[22676]: audit 2024-09-21T03:10:35.868416+0000 mon.a (mon.0) 10414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:36 smithi044 bash[22676]: audit 2024-09-21T03:10:35.914591+0000 mon.a (mon.0) 10415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:36 smithi044 bash[22676]: audit 2024-09-21T03:10:35.923973+0000 mon.a (mon.0) 10416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:36 smithi044 bash[22676]: audit 2024-09-21T03:10:35.935163+0000 mon.a (mon.0) 10417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:36 smithi179 bash[23186]: audit 2024-09-21T03:10:35.848284+0000 mon.a (mon.0) 10412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:36 smithi179 bash[23186]: audit 2024-09-21T03:10:35.856807+0000 mon.a (mon.0) 10413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:36 smithi179 bash[23186]: audit 2024-09-21T03:10:35.868416+0000 mon.a (mon.0) 10414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:36 smithi179 bash[23186]: audit 2024-09-21T03:10:35.914591+0000 mon.a (mon.0) 10415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:36 smithi179 bash[23186]: audit 2024-09-21T03:10:35.923973+0000 mon.a (mon.0) 10416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:36 smithi179 bash[23186]: audit 2024-09-21T03:10:35.935163+0000 mon.a (mon.0) 10417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:37.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:37.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:37.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:37.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:37.765 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:37 smithi044 bash[22676]: cluster 2024-09-21T03:10:36.934532+0000 mgr.a (mgr.14388) 12816 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:37 smithi179 bash[23186]: cluster 2024-09-21T03:10:36.934532+0000 mgr.a (mgr.14388) 12816 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:37 smithi049 bash[23528]: cluster 2024-09-21T03:10:36.934532+0000 mgr.a (mgr.14388) 12816 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:10:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:38 smithi044 bash[22676]: audit 2024-09-21T03:10:37.331719+0000 mgr.a (mgr.14388) 12817 : audit [DBG] from='client.279636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:38 smithi179 bash[23186]: audit 2024-09-21T03:10:37.331719+0000 mgr.a (mgr.14388) 12817 : audit [DBG] from='client.279636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:38 smithi049 bash[23528]: audit 2024-09-21T03:10:37.331719+0000 mgr.a (mgr.14388) 12817 : audit [DBG] from='client.279636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:40.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:39 smithi044 bash[22676]: cluster 2024-09-21T03:10:38.935441+0000 mgr.a (mgr.14388) 12818 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:39 smithi044 bash[22676]: audit 2024-09-21T03:10:39.565128+0000 mon.a (mon.0) 10418 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:10:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:39 smithi044 bash[22676]: audit 2024-09-21T03:10:39.576257+0000 mon.a (mon.0) 10419 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:10:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:39 smithi044 bash[22676]: audit 2024-09-21T03:10:39.578162+0000 mon.a (mon.0) 10420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:10:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:39 smithi044 bash[22676]: audit 2024-09-21T03:10:39.589160+0000 mon.a (mon.0) 10421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:39 smithi044 bash[22676]: audit 2024-09-21T03:10:39.595519+0000 mon.a (mon.0) 10422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:10:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:39 smithi179 bash[23186]: cluster 2024-09-21T03:10:38.935441+0000 mgr.a (mgr.14388) 12818 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:39 smithi179 bash[23186]: audit 2024-09-21T03:10:39.565128+0000 mon.a (mon.0) 10418 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:10:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:39 smithi179 bash[23186]: audit 2024-09-21T03:10:39.576257+0000 mon.a (mon.0) 10419 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:10:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:39 smithi179 bash[23186]: audit 2024-09-21T03:10:39.578162+0000 mon.a (mon.0) 10420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:10:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:39 smithi179 bash[23186]: audit 2024-09-21T03:10:39.589160+0000 mon.a (mon.0) 10421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:39 smithi179 bash[23186]: audit 2024-09-21T03:10:39.595519+0000 mon.a (mon.0) 10422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:10:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:39 smithi049 bash[23528]: cluster 2024-09-21T03:10:38.935441+0000 mgr.a (mgr.14388) 12818 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:39 smithi049 bash[23528]: audit 2024-09-21T03:10:39.565128+0000 mon.a (mon.0) 10418 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:10:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:39 smithi049 bash[23528]: audit 2024-09-21T03:10:39.576257+0000 mon.a (mon.0) 10419 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:10:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:39 smithi049 bash[23528]: audit 2024-09-21T03:10:39.578162+0000 mon.a (mon.0) 10420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:10:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:39 smithi049 bash[23528]: audit 2024-09-21T03:10:39.589160+0000 mon.a (mon.0) 10421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:39 smithi049 bash[23528]: audit 2024-09-21T03:10:39.595519+0000 mon.a (mon.0) 10422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:10:40.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:10:40 smithi044 bash[22930]: debug 2024-09-21T03:10:40.386+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:10:40.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:10:40 smithi044 bash[22930]: debug 2024-09-21T03:10:40.390+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:10:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:40 smithi044 bash[22676]: audit 2024-09-21T03:10:39.598168+0000 mgr.a (mgr.14388) 12819 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:10:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:40 smithi179 bash[23186]: audit 2024-09-21T03:10:39.598168+0000 mgr.a (mgr.14388) 12819 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:10:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:40 smithi049 bash[23528]: audit 2024-09-21T03:10:39.598168+0000 mgr.a (mgr.14388) 12819 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:41 smithi044 bash[22676]: audit 2024-09-21T03:10:40.392197+0000 mgr.a (mgr.14388) 12820 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:41 smithi044 bash[22676]: cephadm 2024-09-21T03:10:40.393998+0000 mgr.a (mgr.14388) 12821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:10:42.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:41 smithi044 bash[22676]: cluster 2024-09-21T03:10:40.938338+0000 mgr.a (mgr.14388) 12822 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T03:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:41 smithi179 bash[23186]: audit 2024-09-21T03:10:40.392197+0000 mgr.a (mgr.14388) 12820 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:41 smithi179 bash[23186]: cephadm 2024-09-21T03:10:40.393998+0000 mgr.a (mgr.14388) 12821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:10:42.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:41 smithi179 bash[23186]: cluster 2024-09-21T03:10:40.938338+0000 mgr.a (mgr.14388) 12822 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T03:10:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:41 smithi049 bash[23528]: audit 2024-09-21T03:10:40.392197+0000 mgr.a (mgr.14388) 12820 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:10:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:41 smithi049 bash[23528]: cephadm 2024-09-21T03:10:40.393998+0000 mgr.a (mgr.14388) 12821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:10:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:41 smithi049 bash[23528]: cluster 2024-09-21T03:10:40.938338+0000 mgr.a (mgr.14388) 12822 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T03:10:42.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:43 smithi049 bash[23528]: cluster 2024-09-21T03:10:42.938808+0000 mgr.a (mgr.14388) 12823 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:10:43.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:43 smithi044 bash[22676]: cluster 2024-09-21T03:10:42.938808+0000 mgr.a (mgr.14388) 12823 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:10:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:43 smithi179 bash[23186]: cluster 2024-09-21T03:10:42.938808+0000 mgr.a (mgr.14388) 12823 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:10:43.537 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:44 smithi044 bash[22676]: audit 2024-09-21T03:10:43.097380+0000 mgr.a (mgr.14388) 12824 : audit [DBG] from='client.279822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:44 smithi044 bash[22676]: audit 2024-09-21T03:10:43.175388+0000 mon.a (mon.0) 10423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:44 smithi044 bash[22676]: audit 2024-09-21T03:10:43.181965+0000 mon.a (mon.0) 10424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:44 smithi044 bash[22676]: audit 2024-09-21T03:10:43.188997+0000 mon.a (mon.0) 10425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:44 smithi179 bash[23186]: audit 2024-09-21T03:10:43.097380+0000 mgr.a (mgr.14388) 12824 : audit [DBG] from='client.279822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:44 smithi179 bash[23186]: audit 2024-09-21T03:10:43.175388+0000 mon.a (mon.0) 10423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:44 smithi179 bash[23186]: audit 2024-09-21T03:10:43.181965+0000 mon.a (mon.0) 10424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:44 smithi179 bash[23186]: audit 2024-09-21T03:10:43.188997+0000 mon.a (mon.0) 10425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:44 smithi049 bash[23528]: audit 2024-09-21T03:10:43.097380+0000 mgr.a (mgr.14388) 12824 : audit [DBG] from='client.279822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:44 smithi049 bash[23528]: audit 2024-09-21T03:10:43.175388+0000 mon.a (mon.0) 10423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:44 smithi049 bash[23528]: audit 2024-09-21T03:10:43.181965+0000 mon.a (mon.0) 10424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:44 smithi049 bash[23528]: audit 2024-09-21T03:10:43.188997+0000 mon.a (mon.0) 10425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:45 smithi049 bash[23528]: cluster 2024-09-21T03:10:44.939694+0000 mgr.a (mgr.14388) 12825 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:10:45.598 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:45 smithi179 bash[23186]: cluster 2024-09-21T03:10:44.939694+0000 mgr.a (mgr.14388) 12825 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:10:45.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:45 smithi044 bash[22676]: cluster 2024-09-21T03:10:44.939694+0000 mgr.a (mgr.14388) 12825 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:10:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:47 smithi049 bash[23528]: cluster 2024-09-21T03:10:46.941926+0000 mgr.a (mgr.14388) 12826 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:47.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:47 smithi044 bash[22676]: cluster 2024-09-21T03:10:46.941926+0000 mgr.a (mgr.14388) 12826 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:47 smithi179 bash[23186]: cluster 2024-09-21T03:10:46.941926+0000 mgr.a (mgr.14388) 12826 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:48.538 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:48.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:48.539 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:49 smithi044 bash[22676]: audit 2024-09-21T03:10:48.890322+0000 mgr.a (mgr.14388) 12827 : audit [DBG] from='client.279900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:49 smithi044 bash[22676]: cluster 2024-09-21T03:10:48.942693+0000 mgr.a (mgr.14388) 12828 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:49 smithi049 bash[23528]: audit 2024-09-21T03:10:48.890322+0000 mgr.a (mgr.14388) 12827 : audit [DBG] from='client.279900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:49 smithi049 bash[23528]: cluster 2024-09-21T03:10:48.942693+0000 mgr.a (mgr.14388) 12828 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:49.314 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:49.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:49.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:49.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:49.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:49 smithi179 bash[23186]: audit 2024-09-21T03:10:48.890322+0000 mgr.a (mgr.14388) 12827 : audit [DBG] from='client.279900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:49 smithi179 bash[23186]: cluster 2024-09-21T03:10:48.942693+0000 mgr.a (mgr.14388) 12828 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:51 smithi049 bash[23528]: cluster 2024-09-21T03:10:50.945072+0000 mgr.a (mgr.14388) 12829 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:51 smithi044 bash[22676]: cluster 2024-09-21T03:10:50.945072+0000 mgr.a (mgr.14388) 12829 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:51 smithi179 bash[23186]: cluster 2024-09-21T03:10:50.945072+0000 mgr.a (mgr.14388) 12829 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:10:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:53 smithi049 bash[23528]: cluster 2024-09-21T03:10:52.945963+0000 mgr.a (mgr.14388) 12830 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:10:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:53 smithi044 bash[22676]: cluster 2024-09-21T03:10:52.945963+0000 mgr.a (mgr.14388) 12830 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:10:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:53 smithi179 bash[23186]: cluster 2024-09-21T03:10:52.945963+0000 mgr.a (mgr.14388) 12830 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:10:54.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:10:54.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:10:54.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:10:55.071 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:10:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:10:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:10:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:10:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:10:55.223 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:55 smithi049 bash[23528]: audit 2024-09-21T03:10:54.648495+0000 mgr.a (mgr.14388) 12831 : audit [DBG] from='client.279978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:55.223 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:55 smithi049 bash[23528]: cluster 2024-09-21T03:10:54.946509+0000 mgr.a (mgr.14388) 12832 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:10:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:55 smithi044 bash[22676]: audit 2024-09-21T03:10:54.648495+0000 mgr.a (mgr.14388) 12831 : audit [DBG] from='client.279978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:55 smithi044 bash[22676]: cluster 2024-09-21T03:10:54.946509+0000 mgr.a (mgr.14388) 12832 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:10:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:55 smithi179 bash[23186]: audit 2024-09-21T03:10:54.648495+0000 mgr.a (mgr.14388) 12831 : audit [DBG] from='client.279978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:10:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:55 smithi179 bash[23186]: cluster 2024-09-21T03:10:54.946509+0000 mgr.a (mgr.14388) 12832 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:10:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:57 smithi179 bash[23186]: audit 2024-09-21T03:10:56.069397+0000 mon.a (mon.0) 10426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:57 smithi179 bash[23186]: audit 2024-09-21T03:10:56.078520+0000 mon.a (mon.0) 10427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:57 smithi179 bash[23186]: audit 2024-09-21T03:10:56.088483+0000 mon.a (mon.0) 10428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:57 smithi179 bash[23186]: audit 2024-09-21T03:10:56.119163+0000 mon.a (mon.0) 10429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:57 smithi179 bash[23186]: audit 2024-09-21T03:10:56.127442+0000 mon.a (mon.0) 10430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:57 smithi179 bash[23186]: audit 2024-09-21T03:10:56.138827+0000 mon.a (mon.0) 10431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:57 smithi179 bash[23186]: cluster 2024-09-21T03:10:56.948947+0000 mgr.a (mgr.14388) 12833 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:10:57.369 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:57 smithi049 bash[23528]: audit 2024-09-21T03:10:56.069397+0000 mon.a (mon.0) 10426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.370 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:57 smithi049 bash[23528]: audit 2024-09-21T03:10:56.078520+0000 mon.a (mon.0) 10427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.370 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:57 smithi049 bash[23528]: audit 2024-09-21T03:10:56.088483+0000 mon.a (mon.0) 10428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.370 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:57 smithi049 bash[23528]: audit 2024-09-21T03:10:56.119163+0000 mon.a (mon.0) 10429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.370 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:57 smithi049 bash[23528]: audit 2024-09-21T03:10:56.127442+0000 mon.a (mon.0) 10430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.370 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:57 smithi049 bash[23528]: audit 2024-09-21T03:10:56.138827+0000 mon.a (mon.0) 10431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.370 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:57 smithi049 bash[23528]: cluster 2024-09-21T03:10:56.948947+0000 mgr.a (mgr.14388) 12833 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:10:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:57 smithi044 bash[22676]: audit 2024-09-21T03:10:56.069397+0000 mon.a (mon.0) 10426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:57 smithi044 bash[22676]: audit 2024-09-21T03:10:56.078520+0000 mon.a (mon.0) 10427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:57 smithi044 bash[22676]: audit 2024-09-21T03:10:56.088483+0000 mon.a (mon.0) 10428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:57 smithi044 bash[22676]: audit 2024-09-21T03:10:56.119163+0000 mon.a (mon.0) 10429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:57 smithi044 bash[22676]: audit 2024-09-21T03:10:56.127442+0000 mon.a (mon.0) 10430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:57 smithi044 bash[22676]: audit 2024-09-21T03:10:56.138827+0000 mon.a (mon.0) 10431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:10:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:57 smithi044 bash[22676]: cluster 2024-09-21T03:10:56.948947+0000 mgr.a (mgr.14388) 12833 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:10:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:10:59 smithi049 bash[23528]: cluster 2024-09-21T03:10:58.949762+0000 mgr.a (mgr.14388) 12834 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:10:59 smithi044 bash[22676]: cluster 2024-09-21T03:10:58.949762+0000 mgr.a (mgr.14388) 12834 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:10:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:10:59 smithi179 bash[23186]: cluster 2024-09-21T03:10:58.949762+0000 mgr.a (mgr.14388) 12834 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:00.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:00.848 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:00.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:00.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:00.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:01 smithi049 bash[23528]: audit 2024-09-21T03:11:00.407373+0000 mgr.a (mgr.14388) 12835 : audit [DBG] from='client.280047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:01 smithi049 bash[23528]: cluster 2024-09-21T03:11:00.952706+0000 mgr.a (mgr.14388) 12836 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:01.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:01 smithi044 bash[22676]: audit 2024-09-21T03:11:00.407373+0000 mgr.a (mgr.14388) 12835 : audit [DBG] from='client.280047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:01 smithi044 bash[22676]: cluster 2024-09-21T03:11:00.952706+0000 mgr.a (mgr.14388) 12836 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:01 smithi179 bash[23186]: audit 2024-09-21T03:11:00.407373+0000 mgr.a (mgr.14388) 12835 : audit [DBG] from='client.280047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:01 smithi179 bash[23186]: cluster 2024-09-21T03:11:00.952706+0000 mgr.a (mgr.14388) 12836 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:03 smithi049 bash[23528]: cluster 2024-09-21T03:11:02.953539+0000 mgr.a (mgr.14388) 12837 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:03.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:03 smithi044 bash[22676]: cluster 2024-09-21T03:11:02.953539+0000 mgr.a (mgr.14388) 12837 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:03 smithi179 bash[23186]: cluster 2024-09-21T03:11:02.953539+0000 mgr.a (mgr.14388) 12837 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:04 smithi044 bash[22676]: audit 2024-09-21T03:11:03.407468+0000 mon.a (mon.0) 10432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:04 smithi044 bash[22676]: audit 2024-09-21T03:11:03.416622+0000 mon.a (mon.0) 10433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:04 smithi044 bash[22676]: audit 2024-09-21T03:11:03.427681+0000 mon.a (mon.0) 10434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:04 smithi179 bash[23186]: audit 2024-09-21T03:11:03.407468+0000 mon.a (mon.0) 10432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:04 smithi179 bash[23186]: audit 2024-09-21T03:11:03.416622+0000 mon.a (mon.0) 10433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:04 smithi179 bash[23186]: audit 2024-09-21T03:11:03.427681+0000 mon.a (mon.0) 10434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:04 smithi049 bash[23528]: audit 2024-09-21T03:11:03.407468+0000 mon.a (mon.0) 10432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:04 smithi049 bash[23528]: audit 2024-09-21T03:11:03.416622+0000 mon.a (mon.0) 10433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:04 smithi049 bash[23528]: audit 2024-09-21T03:11:03.427681+0000 mon.a (mon.0) 10434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:05.669 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:05 smithi179 bash[23186]: cluster 2024-09-21T03:11:04.954480+0000 mgr.a (mgr.14388) 12838 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:05.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:05 smithi044 bash[22676]: cluster 2024-09-21T03:11:04.954480+0000 mgr.a (mgr.14388) 12838 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:05 smithi049 bash[23528]: cluster 2024-09-21T03:11:04.954480+0000 mgr.a (mgr.14388) 12838 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:06.648 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:07 smithi044 bash[22676]: audit 2024-09-21T03:11:06.189432+0000 mgr.a (mgr.14388) 12839 : audit [DBG] from='client.280125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:07 smithi044 bash[22676]: cluster 2024-09-21T03:11:06.957473+0000 mgr.a (mgr.14388) 12840 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:07 smithi049 bash[23528]: audit 2024-09-21T03:11:06.189432+0000 mgr.a (mgr.14388) 12839 : audit [DBG] from='client.280125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:07 smithi049 bash[23528]: cluster 2024-09-21T03:11:06.957473+0000 mgr.a (mgr.14388) 12840 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:07 smithi179 bash[23186]: audit 2024-09-21T03:11:06.189432+0000 mgr.a (mgr.14388) 12839 : audit [DBG] from='client.280125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:07 smithi179 bash[23186]: cluster 2024-09-21T03:11:06.957473+0000 mgr.a (mgr.14388) 12840 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:09.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:09 smithi044 bash[22676]: cluster 2024-09-21T03:11:08.958037+0000 mgr.a (mgr.14388) 12841 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:09 smithi049 bash[23528]: cluster 2024-09-21T03:11:08.958037+0000 mgr.a (mgr.14388) 12841 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:09 smithi179 bash[23186]: cluster 2024-09-21T03:11:08.958037+0000 mgr.a (mgr.14388) 12841 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:11 smithi049 bash[23528]: cluster 2024-09-21T03:11:10.960059+0000 mgr.a (mgr.14388) 12842 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:11 smithi044 bash[22676]: cluster 2024-09-21T03:11:10.960059+0000 mgr.a (mgr.14388) 12842 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:11 smithi179 bash[23186]: cluster 2024-09-21T03:11:10.960059+0000 mgr.a (mgr.14388) 12842 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:11.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:12.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:13 smithi049 bash[23528]: audit 2024-09-21T03:11:11.989930+0000 mgr.a (mgr.14388) 12843 : audit [DBG] from='client.280203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:13 smithi049 bash[23528]: cluster 2024-09-21T03:11:12.960966+0000 mgr.a (mgr.14388) 12844 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:13.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:13 smithi044 bash[22676]: audit 2024-09-21T03:11:11.989930+0000 mgr.a (mgr.14388) 12843 : audit [DBG] from='client.280203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:13 smithi044 bash[22676]: cluster 2024-09-21T03:11:12.960966+0000 mgr.a (mgr.14388) 12844 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:13 smithi179 bash[23186]: audit 2024-09-21T03:11:11.989930+0000 mgr.a (mgr.14388) 12843 : audit [DBG] from='client.280203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:13 smithi179 bash[23186]: cluster 2024-09-21T03:11:12.960966+0000 mgr.a (mgr.14388) 12844 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:15 smithi049 bash[23528]: cluster 2024-09-21T03:11:14.961726+0000 mgr.a (mgr.14388) 12845 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:15 smithi044 bash[22676]: cluster 2024-09-21T03:11:14.961726+0000 mgr.a (mgr.14388) 12845 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:15 smithi179 bash[23186]: cluster 2024-09-21T03:11:14.961726+0000 mgr.a (mgr.14388) 12845 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:17.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:17.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:17.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:17 smithi049 bash[23528]: audit 2024-09-21T03:11:16.283986+0000 mon.a (mon.0) 10435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:17 smithi049 bash[23528]: audit 2024-09-21T03:11:16.291353+0000 mon.a (mon.0) 10436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:17 smithi049 bash[23528]: audit 2024-09-21T03:11:16.302128+0000 mon.a (mon.0) 10437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:17 smithi049 bash[23528]: audit 2024-09-21T03:11:16.349567+0000 mon.a (mon.0) 10438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:17 smithi049 bash[23528]: audit 2024-09-21T03:11:16.357756+0000 mon.a (mon.0) 10439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:17 smithi049 bash[23528]: audit 2024-09-21T03:11:16.366298+0000 mon.a (mon.0) 10440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:17 smithi049 bash[23528]: cluster 2024-09-21T03:11:16.963929+0000 mgr.a (mgr.14388) 12846 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:17 smithi044 bash[22676]: audit 2024-09-21T03:11:16.283986+0000 mon.a (mon.0) 10435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:17 smithi044 bash[22676]: audit 2024-09-21T03:11:16.291353+0000 mon.a (mon.0) 10436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:17 smithi044 bash[22676]: audit 2024-09-21T03:11:16.302128+0000 mon.a (mon.0) 10437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:17 smithi044 bash[22676]: audit 2024-09-21T03:11:16.349567+0000 mon.a (mon.0) 10438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:17 smithi044 bash[22676]: audit 2024-09-21T03:11:16.357756+0000 mon.a (mon.0) 10439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:17 smithi044 bash[22676]: audit 2024-09-21T03:11:16.366298+0000 mon.a (mon.0) 10440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:17 smithi044 bash[22676]: cluster 2024-09-21T03:11:16.963929+0000 mgr.a (mgr.14388) 12846 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:17 smithi179 bash[23186]: audit 2024-09-21T03:11:16.283986+0000 mon.a (mon.0) 10435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:17 smithi179 bash[23186]: audit 2024-09-21T03:11:16.291353+0000 mon.a (mon.0) 10436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:17 smithi179 bash[23186]: audit 2024-09-21T03:11:16.302128+0000 mon.a (mon.0) 10437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:17 smithi179 bash[23186]: audit 2024-09-21T03:11:16.349567+0000 mon.a (mon.0) 10438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:17 smithi179 bash[23186]: audit 2024-09-21T03:11:16.357756+0000 mon.a (mon.0) 10439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:17 smithi179 bash[23186]: audit 2024-09-21T03:11:16.366298+0000 mon.a (mon.0) 10440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:17 smithi179 bash[23186]: cluster 2024-09-21T03:11:16.963929+0000 mgr.a (mgr.14388) 12846 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:18.205 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:18.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:18.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:18.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:18.206 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:18.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:18 smithi044 bash[22676]: audit 2024-09-21T03:11:17.776295+0000 mgr.a (mgr.14388) 12847 : audit [DBG] from='client.280281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:18 smithi179 bash[23186]: audit 2024-09-21T03:11:17.776295+0000 mgr.a (mgr.14388) 12847 : audit [DBG] from='client.280281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:18 smithi049 bash[23528]: audit 2024-09-21T03:11:17.776295+0000 mgr.a (mgr.14388) 12847 : audit [DBG] from='client.280281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:19 smithi044 bash[22676]: cluster 2024-09-21T03:11:18.964856+0000 mgr.a (mgr.14388) 12848 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:19.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:19 smithi179 bash[23186]: cluster 2024-09-21T03:11:18.964856+0000 mgr.a (mgr.14388) 12848 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:19 smithi049 bash[23528]: cluster 2024-09-21T03:11:18.964856+0000 mgr.a (mgr.14388) 12848 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:21 smithi049 bash[23528]: cluster 2024-09-21T03:11:20.967077+0000 mgr.a (mgr.14388) 12849 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:21 smithi044 bash[22676]: cluster 2024-09-21T03:11:20.967077+0000 mgr.a (mgr.14388) 12849 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:21 smithi179 bash[23186]: cluster 2024-09-21T03:11:20.967077+0000 mgr.a (mgr.14388) 12849 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:23.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:23 smithi049 bash[23528]: cluster 2024-09-21T03:11:22.967823+0000 mgr.a (mgr.14388) 12850 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:23 smithi044 bash[22676]: cluster 2024-09-21T03:11:22.967823+0000 mgr.a (mgr.14388) 12850 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:23 smithi179 bash[23186]: cluster 2024-09-21T03:11:22.967823+0000 mgr.a (mgr.14388) 12850 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:23.971 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:23.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:24 smithi044 bash[22676]: audit 2024-09-21T03:11:23.539528+0000 mgr.a (mgr.14388) 12851 : audit [DBG] from='client.280356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:24 smithi044 bash[22676]: audit 2024-09-21T03:11:23.611269+0000 mon.a (mon.0) 10441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:24 smithi044 bash[22676]: audit 2024-09-21T03:11:23.617783+0000 mon.a (mon.0) 10442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:24 smithi044 bash[22676]: audit 2024-09-21T03:11:23.623217+0000 mon.a (mon.0) 10443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:25.001 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:24 smithi179 bash[23186]: audit 2024-09-21T03:11:23.539528+0000 mgr.a (mgr.14388) 12851 : audit [DBG] from='client.280356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:24 smithi179 bash[23186]: audit 2024-09-21T03:11:23.611269+0000 mon.a (mon.0) 10441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:24 smithi179 bash[23186]: audit 2024-09-21T03:11:23.617783+0000 mon.a (mon.0) 10442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:24 smithi179 bash[23186]: audit 2024-09-21T03:11:23.623217+0000 mon.a (mon.0) 10443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:24 smithi049 bash[23528]: audit 2024-09-21T03:11:23.539528+0000 mgr.a (mgr.14388) 12851 : audit [DBG] from='client.280356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:24 smithi049 bash[23528]: audit 2024-09-21T03:11:23.611269+0000 mon.a (mon.0) 10441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:24 smithi049 bash[23528]: audit 2024-09-21T03:11:23.617783+0000 mon.a (mon.0) 10442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:24 smithi049 bash[23528]: audit 2024-09-21T03:11:23.623217+0000 mon.a (mon.0) 10443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:25.959 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:25 smithi179 bash[23186]: cluster 2024-09-21T03:11:24.968717+0000 mgr.a (mgr.14388) 12852 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:25.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:25 smithi044 bash[22676]: cluster 2024-09-21T03:11:24.968717+0000 mgr.a (mgr.14388) 12852 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:25 smithi049 bash[23528]: cluster 2024-09-21T03:11:24.968717+0000 mgr.a (mgr.14388) 12852 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:27 smithi049 bash[23528]: cluster 2024-09-21T03:11:26.970119+0000 mgr.a (mgr.14388) 12853 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:27.415 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:27 smithi179 bash[23186]: cluster 2024-09-21T03:11:26.970119+0000 mgr.a (mgr.14388) 12853 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:27 smithi044 bash[22676]: cluster 2024-09-21T03:11:26.970119+0000 mgr.a (mgr.14388) 12853 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:28.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:28.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:28.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:29.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:29 smithi044 bash[22676]: cluster 2024-09-21T03:11:28.970670+0000 mgr.a (mgr.14388) 12854 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:29 smithi049 bash[23528]: cluster 2024-09-21T03:11:28.970670+0000 mgr.a (mgr.14388) 12854 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:29 smithi179 bash[23186]: cluster 2024-09-21T03:11:28.970670+0000 mgr.a (mgr.14388) 12854 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:29.729 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:30 smithi049 bash[23528]: audit 2024-09-21T03:11:29.298047+0000 mgr.a (mgr.14388) 12855 : audit [DBG] from='client.280434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:30 smithi044 bash[22676]: audit 2024-09-21T03:11:29.298047+0000 mgr.a (mgr.14388) 12855 : audit [DBG] from='client.280434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:30 smithi179 bash[23186]: audit 2024-09-21T03:11:29.298047+0000 mgr.a (mgr.14388) 12855 : audit [DBG] from='client.280434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:31.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:31 smithi044 bash[22676]: cluster 2024-09-21T03:11:30.972895+0000 mgr.a (mgr.14388) 12856 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:31.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:31 smithi179 bash[23186]: cluster 2024-09-21T03:11:30.972895+0000 mgr.a (mgr.14388) 12856 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:31 smithi049 bash[23528]: cluster 2024-09-21T03:11:30.972895+0000 mgr.a (mgr.14388) 12856 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:11:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:33 smithi049 bash[23528]: cluster 2024-09-21T03:11:32.973733+0000 mgr.a (mgr.14388) 12857 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:33 smithi044 bash[22676]: cluster 2024-09-21T03:11:32.973733+0000 mgr.a (mgr.14388) 12857 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:33 smithi179 bash[23186]: cluster 2024-09-21T03:11:32.973733+0000 mgr.a (mgr.14388) 12857 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:34.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:35 smithi049 bash[23528]: cluster 2024-09-21T03:11:34.974421+0000 mgr.a (mgr.14388) 12858 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:35.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:35.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:35.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:35.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:35.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:35.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:35 smithi044 bash[22676]: cluster 2024-09-21T03:11:34.974421+0000 mgr.a (mgr.14388) 12858 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:35 smithi179 bash[23186]: cluster 2024-09-21T03:11:34.974421+0000 mgr.a (mgr.14388) 12858 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:36 smithi049 bash[23528]: audit 2024-09-21T03:11:35.057758+0000 mgr.a (mgr.14388) 12859 : audit [DBG] from='client.280512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:36 smithi044 bash[22676]: audit 2024-09-21T03:11:35.057758+0000 mgr.a (mgr.14388) 12859 : audit [DBG] from='client.280512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:36.501 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:36 smithi179 bash[23186]: audit 2024-09-21T03:11:35.057758+0000 mgr.a (mgr.14388) 12859 : audit [DBG] from='client.280512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:37 smithi049 bash[23528]: audit 2024-09-21T03:11:36.516751+0000 mon.a (mon.0) 10444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:37 smithi049 bash[23528]: audit 2024-09-21T03:11:36.525133+0000 mon.a (mon.0) 10445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:37 smithi049 bash[23528]: audit 2024-09-21T03:11:36.534480+0000 mon.a (mon.0) 10446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:37 smithi049 bash[23528]: audit 2024-09-21T03:11:36.603368+0000 mon.a (mon.0) 10447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:37 smithi049 bash[23528]: audit 2024-09-21T03:11:36.611522+0000 mon.a (mon.0) 10448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:37 smithi049 bash[23528]: audit 2024-09-21T03:11:36.621538+0000 mon.a (mon.0) 10449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:37 smithi049 bash[23528]: cluster 2024-09-21T03:11:36.977106+0000 mgr.a (mgr.14388) 12860 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:37 smithi044 bash[22676]: audit 2024-09-21T03:11:36.516751+0000 mon.a (mon.0) 10444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:37 smithi044 bash[22676]: audit 2024-09-21T03:11:36.525133+0000 mon.a (mon.0) 10445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:37 smithi044 bash[22676]: audit 2024-09-21T03:11:36.534480+0000 mon.a (mon.0) 10446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:37 smithi044 bash[22676]: audit 2024-09-21T03:11:36.603368+0000 mon.a (mon.0) 10447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:37 smithi044 bash[22676]: audit 2024-09-21T03:11:36.611522+0000 mon.a (mon.0) 10448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:37 smithi044 bash[22676]: audit 2024-09-21T03:11:36.621538+0000 mon.a (mon.0) 10449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:37 smithi044 bash[22676]: cluster 2024-09-21T03:11:36.977106+0000 mgr.a (mgr.14388) 12860 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:37 smithi179 bash[23186]: audit 2024-09-21T03:11:36.516751+0000 mon.a (mon.0) 10444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:37 smithi179 bash[23186]: audit 2024-09-21T03:11:36.525133+0000 mon.a (mon.0) 10445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:37 smithi179 bash[23186]: audit 2024-09-21T03:11:36.534480+0000 mon.a (mon.0) 10446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:37 smithi179 bash[23186]: audit 2024-09-21T03:11:36.603368+0000 mon.a (mon.0) 10447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:37 smithi179 bash[23186]: audit 2024-09-21T03:11:36.611522+0000 mon.a (mon.0) 10448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:37 smithi179 bash[23186]: audit 2024-09-21T03:11:36.621538+0000 mon.a (mon.0) 10449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:38.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:37 smithi179 bash[23186]: cluster 2024-09-21T03:11:36.977106+0000 mgr.a (mgr.14388) 12860 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:39 smithi044 bash[22676]: cluster 2024-09-21T03:11:38.977912+0000 mgr.a (mgr.14388) 12861 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:39 smithi049 bash[23528]: cluster 2024-09-21T03:11:38.977912+0000 mgr.a (mgr.14388) 12861 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:39 smithi179 bash[23186]: cluster 2024-09-21T03:11:38.977912+0000 mgr.a (mgr.14388) 12861 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:40.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:40.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:40.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:40 smithi049 bash[23528]: audit 2024-09-21T03:11:40.486033+0000 mon.a (mon.0) 10450 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:40 smithi049 bash[23528]: audit 2024-09-21T03:11:40.491525+0000 mon.a (mon.0) 10451 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:40 smithi049 bash[23528]: audit 2024-09-21T03:11:40.493098+0000 mon.a (mon.0) 10452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:40 smithi049 bash[23528]: audit 2024-09-21T03:11:40.502815+0000 mon.a (mon.0) 10453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:40 smithi049 bash[23528]: audit 2024-09-21T03:11:40.508222+0000 mon.a (mon.0) 10454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:11:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:40 smithi044 bash[22676]: audit 2024-09-21T03:11:40.486033+0000 mon.a (mon.0) 10450 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:11:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:40 smithi044 bash[22676]: audit 2024-09-21T03:11:40.491525+0000 mon.a (mon.0) 10451 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:11:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:40 smithi044 bash[22676]: audit 2024-09-21T03:11:40.493098+0000 mon.a (mon.0) 10452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:11:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:40 smithi044 bash[22676]: audit 2024-09-21T03:11:40.502815+0000 mon.a (mon.0) 10453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:40 smithi044 bash[22676]: audit 2024-09-21T03:11:40.508222+0000 mon.a (mon.0) 10454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:11:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:40 smithi179 bash[23186]: audit 2024-09-21T03:11:40.486033+0000 mon.a (mon.0) 10450 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:11:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:40 smithi179 bash[23186]: audit 2024-09-21T03:11:40.491525+0000 mon.a (mon.0) 10451 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:11:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:40 smithi179 bash[23186]: audit 2024-09-21T03:11:40.493098+0000 mon.a (mon.0) 10452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:11:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:40 smithi179 bash[23186]: audit 2024-09-21T03:11:40.502815+0000 mon.a (mon.0) 10453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:40 smithi179 bash[23186]: audit 2024-09-21T03:11:40.508222+0000 mon.a (mon.0) 10454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:11:41.547 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:11:41 smithi044 bash[22930]: debug 2024-09-21T03:11:41.281+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:11:41.547 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:11:41 smithi044 bash[22930]: debug 2024-09-21T03:11:41.293+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:11:41.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:41.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:41 smithi049 bash[23528]: audit 2024-09-21T03:11:40.509913+0000 mgr.a (mgr.14388) 12862 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:11:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:41 smithi049 bash[23528]: audit 2024-09-21T03:11:40.836206+0000 mgr.a (mgr.14388) 12863 : audit [DBG] from='client.280590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:41 smithi049 bash[23528]: cluster 2024-09-21T03:11:40.979321+0000 mgr.a (mgr.14388) 12864 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:41 smithi044 bash[22676]: audit 2024-09-21T03:11:40.509913+0000 mgr.a (mgr.14388) 12862 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:11:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:41 smithi044 bash[22676]: audit 2024-09-21T03:11:40.836206+0000 mgr.a (mgr.14388) 12863 : audit [DBG] from='client.280590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:41 smithi044 bash[22676]: cluster 2024-09-21T03:11:40.979321+0000 mgr.a (mgr.14388) 12864 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:41 smithi179 bash[23186]: audit 2024-09-21T03:11:40.509913+0000 mgr.a (mgr.14388) 12862 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:11:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:41 smithi179 bash[23186]: audit 2024-09-21T03:11:40.836206+0000 mgr.a (mgr.14388) 12863 : audit [DBG] from='client.280590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:41 smithi179 bash[23186]: cluster 2024-09-21T03:11:40.979321+0000 mgr.a (mgr.14388) 12864 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:42 smithi049 bash[23528]: audit 2024-09-21T03:11:41.285965+0000 mgr.a (mgr.14388) 12865 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:11:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:42 smithi049 bash[23528]: cephadm 2024-09-21T03:11:41.300197+0000 mgr.a (mgr.14388) 12866 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:11:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:42 smithi044 bash[22676]: audit 2024-09-21T03:11:41.285965+0000 mgr.a (mgr.14388) 12865 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:11:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:42 smithi044 bash[22676]: cephadm 2024-09-21T03:11:41.300197+0000 mgr.a (mgr.14388) 12866 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:11:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:42 smithi179 bash[23186]: audit 2024-09-21T03:11:41.285965+0000 mgr.a (mgr.14388) 12865 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:11:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:42 smithi179 bash[23186]: cephadm 2024-09-21T03:11:41.300197+0000 mgr.a (mgr.14388) 12866 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:11:43.837 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:43 smithi049 bash[23528]: cluster 2024-09-21T03:11:42.980223+0000 mgr.a (mgr.14388) 12867 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:43 smithi044 bash[22676]: cluster 2024-09-21T03:11:42.980223+0000 mgr.a (mgr.14388) 12867 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:43 smithi179 bash[23186]: cluster 2024-09-21T03:11:42.980223+0000 mgr.a (mgr.14388) 12867 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:11:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:44 smithi044 bash[22676]: audit 2024-09-21T03:11:43.815329+0000 mon.a (mon.0) 10455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:44 smithi044 bash[22676]: audit 2024-09-21T03:11:43.823967+0000 mon.a (mon.0) 10456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:44 smithi044 bash[22676]: audit 2024-09-21T03:11:43.834979+0000 mon.a (mon.0) 10457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:44 smithi179 bash[23186]: audit 2024-09-21T03:11:43.815329+0000 mon.a (mon.0) 10455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:44 smithi179 bash[23186]: audit 2024-09-21T03:11:43.823967+0000 mon.a (mon.0) 10456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:44 smithi179 bash[23186]: audit 2024-09-21T03:11:43.834979+0000 mon.a (mon.0) 10457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:44 smithi049 bash[23528]: audit 2024-09-21T03:11:43.815329+0000 mon.a (mon.0) 10455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:44 smithi049 bash[23528]: audit 2024-09-21T03:11:43.823967+0000 mon.a (mon.0) 10456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:44 smithi049 bash[23528]: audit 2024-09-21T03:11:43.834979+0000 mon.a (mon.0) 10457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:46.105 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:45 smithi179 bash[23186]: cluster 2024-09-21T03:11:44.981009+0000 mgr.a (mgr.14388) 12868 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:45 smithi044 bash[22676]: cluster 2024-09-21T03:11:44.981009+0000 mgr.a (mgr.14388) 12868 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:45 smithi049 bash[23528]: cluster 2024-09-21T03:11:44.981009+0000 mgr.a (mgr.14388) 12868 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:11:46.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:46.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:46.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:47 smithi049 bash[23528]: cluster 2024-09-21T03:11:46.982354+0000 mgr.a (mgr.14388) 12869 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:47.459 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:47.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:47.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:47.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:47.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:47.470 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:47 smithi179 bash[23186]: cluster 2024-09-21T03:11:46.982354+0000 mgr.a (mgr.14388) 12869 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:47.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:47 smithi044 bash[22676]: cluster 2024-09-21T03:11:46.982354+0000 mgr.a (mgr.14388) 12869 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:48 smithi049 bash[23528]: audit 2024-09-21T03:11:47.038598+0000 mgr.a (mgr.14388) 12870 : audit [DBG] from='client.280770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:48.305 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:48 smithi179 bash[23186]: audit 2024-09-21T03:11:47.038598+0000 mgr.a (mgr.14388) 12870 : audit [DBG] from='client.280770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:48 smithi044 bash[22676]: audit 2024-09-21T03:11:47.038598+0000 mgr.a (mgr.14388) 12870 : audit [DBG] from='client.280770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:49.389 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:49 smithi044 bash[22676]: cluster 2024-09-21T03:11:48.983207+0000 mgr.a (mgr.14388) 12871 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:49 smithi179 bash[23186]: cluster 2024-09-21T03:11:48.983207+0000 mgr.a (mgr.14388) 12871 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:49 smithi049 bash[23528]: cluster 2024-09-21T03:11:48.983207+0000 mgr.a (mgr.14388) 12871 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:51 smithi049 bash[23528]: cluster 2024-09-21T03:11:50.985490+0000 mgr.a (mgr.14388) 12872 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:51 smithi044 bash[22676]: cluster 2024-09-21T03:11:50.985490+0000 mgr.a (mgr.14388) 12872 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:51 smithi179 bash[23186]: cluster 2024-09-21T03:11:50.985490+0000 mgr.a (mgr.14388) 12872 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:52.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:52.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:52.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:53.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:53.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:53.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:53.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:53.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:53 smithi049 bash[23528]: audit 2024-09-21T03:11:52.797227+0000 mgr.a (mgr.14388) 12873 : audit [DBG] from='client.280848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:53 smithi049 bash[23528]: cluster 2024-09-21T03:11:52.986121+0000 mgr.a (mgr.14388) 12874 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:53 smithi044 bash[22676]: audit 2024-09-21T03:11:52.797227+0000 mgr.a (mgr.14388) 12873 : audit [DBG] from='client.280848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:53 smithi044 bash[22676]: cluster 2024-09-21T03:11:52.986121+0000 mgr.a (mgr.14388) 12874 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:53 smithi179 bash[23186]: audit 2024-09-21T03:11:52.797227+0000 mgr.a (mgr.14388) 12873 : audit [DBG] from='client.280848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:53 smithi179 bash[23186]: cluster 2024-09-21T03:11:52.986121+0000 mgr.a (mgr.14388) 12874 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:55 smithi049 bash[23528]: cluster 2024-09-21T03:11:54.987024+0000 mgr.a (mgr.14388) 12875 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:55 smithi044 bash[22676]: cluster 2024-09-21T03:11:54.987024+0000 mgr.a (mgr.14388) 12875 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:55 smithi179 bash[23186]: cluster 2024-09-21T03:11:54.987024+0000 mgr.a (mgr.14388) 12875 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:57 smithi044 bash[22676]: audit 2024-09-21T03:11:56.729659+0000 mon.a (mon.0) 10458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:57 smithi044 bash[22676]: audit 2024-09-21T03:11:56.738433+0000 mon.a (mon.0) 10459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:57 smithi044 bash[22676]: audit 2024-09-21T03:11:56.747132+0000 mon.a (mon.0) 10460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:57 smithi044 bash[22676]: audit 2024-09-21T03:11:56.822135+0000 mon.a (mon.0) 10461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:57 smithi044 bash[22676]: audit 2024-09-21T03:11:56.829463+0000 mon.a (mon.0) 10462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:57 smithi044 bash[22676]: audit 2024-09-21T03:11:56.839222+0000 mon.a (mon.0) 10463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:57 smithi044 bash[22676]: cluster 2024-09-21T03:11:56.989297+0000 mgr.a (mgr.14388) 12876 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:57 smithi179 bash[23186]: audit 2024-09-21T03:11:56.729659+0000 mon.a (mon.0) 10458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:57 smithi179 bash[23186]: audit 2024-09-21T03:11:56.738433+0000 mon.a (mon.0) 10459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:57 smithi179 bash[23186]: audit 2024-09-21T03:11:56.747132+0000 mon.a (mon.0) 10460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:57 smithi179 bash[23186]: audit 2024-09-21T03:11:56.822135+0000 mon.a (mon.0) 10461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:57 smithi179 bash[23186]: audit 2024-09-21T03:11:56.829463+0000 mon.a (mon.0) 10462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:57 smithi179 bash[23186]: audit 2024-09-21T03:11:56.839222+0000 mon.a (mon.0) 10463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:57 smithi179 bash[23186]: cluster 2024-09-21T03:11:56.989297+0000 mgr.a (mgr.14388) 12876 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:57 smithi049 bash[23528]: audit 2024-09-21T03:11:56.729659+0000 mon.a (mon.0) 10458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:57 smithi049 bash[23528]: audit 2024-09-21T03:11:56.738433+0000 mon.a (mon.0) 10459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:57 smithi049 bash[23528]: audit 2024-09-21T03:11:56.747132+0000 mon.a (mon.0) 10460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:57 smithi049 bash[23528]: audit 2024-09-21T03:11:56.822135+0000 mon.a (mon.0) 10461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:57 smithi049 bash[23528]: audit 2024-09-21T03:11:56.829463+0000 mon.a (mon.0) 10462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:57 smithi049 bash[23528]: audit 2024-09-21T03:11:56.839222+0000 mon.a (mon.0) 10463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:11:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:57 smithi049 bash[23528]: cluster 2024-09-21T03:11:56.989297+0000 mgr.a (mgr.14388) 12876 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:11:58.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:11:58.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:11:58.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:11:59.016 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:11:59.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:11:59.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:11:59.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:11:59.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:11:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:59 smithi049 bash[23528]: audit 2024-09-21T03:11:58.576490+0000 mgr.a (mgr.14388) 12877 : audit [DBG] from='client.280926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:11:59 smithi049 bash[23528]: cluster 2024-09-21T03:11:58.989795+0000 mgr.a (mgr.14388) 12878 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:59.428 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:59 smithi044 bash[22676]: audit 2024-09-21T03:11:58.576490+0000 mgr.a (mgr.14388) 12877 : audit [DBG] from='client.280926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:59.428 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:11:59 smithi044 bash[22676]: cluster 2024-09-21T03:11:58.989795+0000 mgr.a (mgr.14388) 12878 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:11:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:59 smithi179 bash[23186]: audit 2024-09-21T03:11:58.576490+0000 mgr.a (mgr.14388) 12877 : audit [DBG] from='client.280926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:11:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:11:59 smithi179 bash[23186]: cluster 2024-09-21T03:11:58.989795+0000 mgr.a (mgr.14388) 12878 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:01 smithi044 bash[22676]: cluster 2024-09-21T03:12:00.991961+0000 mgr.a (mgr.14388) 12879 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:01 smithi179 bash[23186]: cluster 2024-09-21T03:12:00.991961+0000 mgr.a (mgr.14388) 12879 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:01 smithi049 bash[23528]: cluster 2024-09-21T03:12:00.991961+0000 mgr.a (mgr.14388) 12879 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:03 smithi044 bash[22676]: cluster 2024-09-21T03:12:02.992716+0000 mgr.a (mgr.14388) 12880 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:03 smithi179 bash[23186]: cluster 2024-09-21T03:12:02.992716+0000 mgr.a (mgr.14388) 12880 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:03 smithi049 bash[23528]: cluster 2024-09-21T03:12:02.992716+0000 mgr.a (mgr.14388) 12880 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:04.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:04.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:04.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:04.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:04.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:04.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:04.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:04.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:05 smithi179 bash[23186]: audit 2024-09-21T03:12:04.025184+0000 mon.a (mon.0) 10464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:05 smithi179 bash[23186]: audit 2024-09-21T03:12:04.032317+0000 mon.a (mon.0) 10465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:05 smithi179 bash[23186]: audit 2024-09-21T03:12:04.041685+0000 mon.a (mon.0) 10466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:05 smithi179 bash[23186]: audit 2024-09-21T03:12:04.353022+0000 mgr.a (mgr.14388) 12881 : audit [DBG] from='client.281004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:05 smithi179 bash[23186]: cluster 2024-09-21T03:12:04.993618+0000 mgr.a (mgr.14388) 12882 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:05 smithi049 bash[23528]: audit 2024-09-21T03:12:04.025184+0000 mon.a (mon.0) 10464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:05 smithi049 bash[23528]: audit 2024-09-21T03:12:04.032317+0000 mon.a (mon.0) 10465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:05 smithi049 bash[23528]: audit 2024-09-21T03:12:04.041685+0000 mon.a (mon.0) 10466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:05 smithi049 bash[23528]: audit 2024-09-21T03:12:04.353022+0000 mgr.a (mgr.14388) 12881 : audit [DBG] from='client.281004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:05 smithi049 bash[23528]: cluster 2024-09-21T03:12:04.993618+0000 mgr.a (mgr.14388) 12882 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:05 smithi044 bash[22676]: audit 2024-09-21T03:12:04.025184+0000 mon.a (mon.0) 10464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:05 smithi044 bash[22676]: audit 2024-09-21T03:12:04.032317+0000 mon.a (mon.0) 10465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:05 smithi044 bash[22676]: audit 2024-09-21T03:12:04.041685+0000 mon.a (mon.0) 10466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:05 smithi044 bash[22676]: audit 2024-09-21T03:12:04.353022+0000 mgr.a (mgr.14388) 12881 : audit [DBG] from='client.281004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:05 smithi044 bash[22676]: cluster 2024-09-21T03:12:04.993618+0000 mgr.a (mgr.14388) 12882 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:07.138 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:07 smithi044 bash[22676]: cluster 2024-09-21T03:12:06.995026+0000 mgr.a (mgr.14388) 12883 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:07 smithi179 bash[23186]: cluster 2024-09-21T03:12:06.995026+0000 mgr.a (mgr.14388) 12883 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:07 smithi049 bash[23528]: cluster 2024-09-21T03:12:06.995026+0000 mgr.a (mgr.14388) 12883 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:09.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:09.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:09.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:10 smithi049 bash[23528]: cluster 2024-09-21T03:12:08.995533+0000 mgr.a (mgr.14388) 12884 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:10.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:10 smithi044 bash[22676]: cluster 2024-09-21T03:12:08.995533+0000 mgr.a (mgr.14388) 12884 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:10.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:10 smithi179 bash[23186]: cluster 2024-09-21T03:12:08.995533+0000 mgr.a (mgr.14388) 12884 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:10.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:11.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:11 smithi044 bash[22676]: audit 2024-09-21T03:12:10.136729+0000 mgr.a (mgr.14388) 12885 : audit [DBG] from='client.281082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:11 smithi179 bash[23186]: audit 2024-09-21T03:12:10.136729+0000 mgr.a (mgr.14388) 12885 : audit [DBG] from='client.281082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:11 smithi049 bash[23528]: audit 2024-09-21T03:12:10.136729+0000 mgr.a (mgr.14388) 12885 : audit [DBG] from='client.281082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:12 smithi044 bash[22676]: cluster 2024-09-21T03:12:10.998352+0000 mgr.a (mgr.14388) 12886 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:12 smithi179 bash[23186]: cluster 2024-09-21T03:12:10.998352+0000 mgr.a (mgr.14388) 12886 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:12 smithi049 bash[23528]: cluster 2024-09-21T03:12:10.998352+0000 mgr.a (mgr.14388) 12886 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:14 smithi044 bash[22676]: cluster 2024-09-21T03:12:12.999071+0000 mgr.a (mgr.14388) 12887 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:12:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:14 smithi179 bash[23186]: cluster 2024-09-21T03:12:12.999071+0000 mgr.a (mgr.14388) 12887 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:12:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:14 smithi049 bash[23528]: cluster 2024-09-21T03:12:12.999071+0000 mgr.a (mgr.14388) 12887 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:12:15.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:15.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:15.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:16.359 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:16.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:16.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:16.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:16.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:16.386 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:16 smithi049 bash[23528]: cluster 2024-09-21T03:12:14.999847+0000 mgr.a (mgr.14388) 12888 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:12:16.386 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:16 smithi049 bash[23528]: audit 2024-09-21T03:12:15.911491+0000 mgr.a (mgr.14388) 12889 : audit [DBG] from='client.281154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:16 smithi044 bash[22676]: cluster 2024-09-21T03:12:14.999847+0000 mgr.a (mgr.14388) 12888 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:12:16.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:16 smithi044 bash[22676]: audit 2024-09-21T03:12:15.911491+0000 mgr.a (mgr.14388) 12889 : audit [DBG] from='client.281154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:16 smithi179 bash[23186]: cluster 2024-09-21T03:12:14.999847+0000 mgr.a (mgr.14388) 12888 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:12:16.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:16 smithi179 bash[23186]: audit 2024-09-21T03:12:15.911491+0000 mgr.a (mgr.14388) 12889 : audit [DBG] from='client.281154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:17 smithi044 bash[22676]: audit 2024-09-21T03:12:16.888381+0000 mon.a (mon.0) 10467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:17 smithi044 bash[22676]: audit 2024-09-21T03:12:16.898040+0000 mon.a (mon.0) 10468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:17 smithi044 bash[22676]: audit 2024-09-21T03:12:16.911185+0000 mon.a (mon.0) 10469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:17 smithi044 bash[22676]: audit 2024-09-21T03:12:17.064131+0000 mon.a (mon.0) 10470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:17 smithi044 bash[22676]: audit 2024-09-21T03:12:17.071601+0000 mon.a (mon.0) 10471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:17 smithi044 bash[22676]: audit 2024-09-21T03:12:17.081482+0000 mon.a (mon.0) 10472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:17 smithi179 bash[23186]: audit 2024-09-21T03:12:16.888381+0000 mon.a (mon.0) 10467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:17 smithi179 bash[23186]: audit 2024-09-21T03:12:16.898040+0000 mon.a (mon.0) 10468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:17 smithi179 bash[23186]: audit 2024-09-21T03:12:16.911185+0000 mon.a (mon.0) 10469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:17 smithi179 bash[23186]: audit 2024-09-21T03:12:17.064131+0000 mon.a (mon.0) 10470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:17 smithi179 bash[23186]: audit 2024-09-21T03:12:17.071601+0000 mon.a (mon.0) 10471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:17 smithi179 bash[23186]: audit 2024-09-21T03:12:17.081482+0000 mon.a (mon.0) 10472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:17 smithi049 bash[23528]: audit 2024-09-21T03:12:16.888381+0000 mon.a (mon.0) 10467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:17 smithi049 bash[23528]: audit 2024-09-21T03:12:16.898040+0000 mon.a (mon.0) 10468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:17 smithi049 bash[23528]: audit 2024-09-21T03:12:16.911185+0000 mon.a (mon.0) 10469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:17 smithi049 bash[23528]: audit 2024-09-21T03:12:17.064131+0000 mon.a (mon.0) 10470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:17 smithi049 bash[23528]: audit 2024-09-21T03:12:17.071601+0000 mon.a (mon.0) 10471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:17 smithi049 bash[23528]: audit 2024-09-21T03:12:17.081482+0000 mon.a (mon.0) 10472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:18 smithi049 bash[23528]: cluster 2024-09-21T03:12:17.002047+0000 mgr.a (mgr.14388) 12890 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:18 smithi044 bash[22676]: cluster 2024-09-21T03:12:17.002047+0000 mgr.a (mgr.14388) 12890 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:18 smithi179 bash[23186]: cluster 2024-09-21T03:12:17.002047+0000 mgr.a (mgr.14388) 12890 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:20 smithi044 bash[22676]: cluster 2024-09-21T03:12:19.002835+0000 mgr.a (mgr.14388) 12891 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:12:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:20 smithi179 bash[23186]: cluster 2024-09-21T03:12:19.002835+0000 mgr.a (mgr.14388) 12891 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:12:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:20 smithi049 bash[23528]: cluster 2024-09-21T03:12:19.002835+0000 mgr.a (mgr.14388) 12891 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:12:21.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:21.361 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:21.361 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:22.131 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:22.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:22.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:22.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:22.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:22 smithi044 bash[22676]: cluster 2024-09-21T03:12:21.004837+0000 mgr.a (mgr.14388) 12892 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:22 smithi044 bash[22676]: audit 2024-09-21T03:12:21.691687+0000 mgr.a (mgr.14388) 12893 : audit [DBG] from='client.281226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:22 smithi179 bash[23186]: cluster 2024-09-21T03:12:21.004837+0000 mgr.a (mgr.14388) 12892 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:22 smithi179 bash[23186]: audit 2024-09-21T03:12:21.691687+0000 mgr.a (mgr.14388) 12893 : audit [DBG] from='client.281226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:22 smithi049 bash[23528]: cluster 2024-09-21T03:12:21.004837+0000 mgr.a (mgr.14388) 12892 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:22 smithi049 bash[23528]: audit 2024-09-21T03:12:21.691687+0000 mgr.a (mgr.14388) 12893 : audit [DBG] from='client.281226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:25.195 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:24 smithi179 bash[23186]: cluster 2024-09-21T03:12:23.005823+0000 mgr.a (mgr.14388) 12894 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:25.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:24 smithi179 bash[23186]: audit 2024-09-21T03:12:24.255696+0000 mon.a (mon.0) 10473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:24 smithi179 bash[23186]: audit 2024-09-21T03:12:24.264887+0000 mon.a (mon.0) 10474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:24 smithi179 bash[23186]: audit 2024-09-21T03:12:24.275663+0000 mon.a (mon.0) 10475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:24 smithi044 bash[22676]: cluster 2024-09-21T03:12:23.005823+0000 mgr.a (mgr.14388) 12894 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:24 smithi044 bash[22676]: audit 2024-09-21T03:12:24.255696+0000 mon.a (mon.0) 10473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:24 smithi044 bash[22676]: audit 2024-09-21T03:12:24.264887+0000 mon.a (mon.0) 10474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:24 smithi044 bash[22676]: audit 2024-09-21T03:12:24.275663+0000 mon.a (mon.0) 10475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:24 smithi049 bash[23528]: cluster 2024-09-21T03:12:23.005823+0000 mgr.a (mgr.14388) 12894 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:24 smithi049 bash[23528]: audit 2024-09-21T03:12:24.255696+0000 mon.a (mon.0) 10473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:24 smithi049 bash[23528]: audit 2024-09-21T03:12:24.264887+0000 mon.a (mon.0) 10474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:24 smithi049 bash[23528]: audit 2024-09-21T03:12:24.275663+0000 mon.a (mon.0) 10475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:27.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:27.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:27.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:27.185 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:26 smithi044 bash[22676]: cluster 2024-09-21T03:12:25.006587+0000 mgr.a (mgr.14388) 12895 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:26 smithi179 bash[23186]: cluster 2024-09-21T03:12:25.006587+0000 mgr.a (mgr.14388) 12895 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:26 smithi049 bash[23528]: cluster 2024-09-21T03:12:25.006587+0000 mgr.a (mgr.14388) 12895 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:27.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:27.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:28 smithi179 bash[23186]: cluster 2024-09-21T03:12:27.008118+0000 mgr.a (mgr.14388) 12896 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:28 smithi179 bash[23186]: audit 2024-09-21T03:12:27.462193+0000 mgr.a (mgr.14388) 12897 : audit [DBG] from='client.281304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:29.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:28 smithi044 bash[22676]: cluster 2024-09-21T03:12:27.008118+0000 mgr.a (mgr.14388) 12896 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:28 smithi044 bash[22676]: audit 2024-09-21T03:12:27.462193+0000 mgr.a (mgr.14388) 12897 : audit [DBG] from='client.281304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:28 smithi049 bash[23528]: cluster 2024-09-21T03:12:27.008118+0000 mgr.a (mgr.14388) 12896 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:28 smithi049 bash[23528]: audit 2024-09-21T03:12:27.462193+0000 mgr.a (mgr.14388) 12897 : audit [DBG] from='client.281304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:30 smithi044 bash[22676]: cluster 2024-09-21T03:12:29.008684+0000 mgr.a (mgr.14388) 12898 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:30 smithi179 bash[23186]: cluster 2024-09-21T03:12:29.008684+0000 mgr.a (mgr.14388) 12898 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:30 smithi049 bash[23528]: cluster 2024-09-21T03:12:29.008684+0000 mgr.a (mgr.14388) 12898 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:32.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:33.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:32 smithi044 bash[22676]: cluster 2024-09-21T03:12:31.010899+0000 mgr.a (mgr.14388) 12899 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:32 smithi179 bash[23186]: cluster 2024-09-21T03:12:31.010899+0000 mgr.a (mgr.14388) 12899 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:32 smithi049 bash[23528]: cluster 2024-09-21T03:12:31.010899+0000 mgr.a (mgr.14388) 12899 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:33.658 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:33.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:34 smithi044 bash[22676]: cluster 2024-09-21T03:12:33.011371+0000 mgr.a (mgr.14388) 12900 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:34 smithi044 bash[22676]: audit 2024-09-21T03:12:33.236619+0000 mgr.a (mgr.14388) 12901 : audit [DBG] from='client.281382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:34 smithi179 bash[23186]: cluster 2024-09-21T03:12:33.011371+0000 mgr.a (mgr.14388) 12900 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:34 smithi179 bash[23186]: audit 2024-09-21T03:12:33.236619+0000 mgr.a (mgr.14388) 12901 : audit [DBG] from='client.281382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:34 smithi049 bash[23528]: cluster 2024-09-21T03:12:33.011371+0000 mgr.a (mgr.14388) 12900 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:34 smithi049 bash[23528]: audit 2024-09-21T03:12:33.236619+0000 mgr.a (mgr.14388) 12901 : audit [DBG] from='client.281382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:36 smithi044 bash[22676]: cluster 2024-09-21T03:12:35.012309+0000 mgr.a (mgr.14388) 12902 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:36 smithi179 bash[23186]: cluster 2024-09-21T03:12:35.012309+0000 mgr.a (mgr.14388) 12902 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:36 smithi049 bash[23528]: cluster 2024-09-21T03:12:35.012309+0000 mgr.a (mgr.14388) 12902 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:38.418 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:38 smithi049 bash[23528]: cluster 2024-09-21T03:12:37.014614+0000 mgr.a (mgr.14388) 12903 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:38.419 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:38 smithi049 bash[23528]: audit 2024-09-21T03:12:37.129673+0000 mon.a (mon.0) 10476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.419 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:38 smithi049 bash[23528]: audit 2024-09-21T03:12:37.134882+0000 mon.a (mon.0) 10477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.419 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:38 smithi049 bash[23528]: audit 2024-09-21T03:12:37.142447+0000 mon.a (mon.0) 10478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.419 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:38 smithi049 bash[23528]: audit 2024-09-21T03:12:37.301289+0000 mon.a (mon.0) 10479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.419 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:38 smithi049 bash[23528]: audit 2024-09-21T03:12:37.310998+0000 mon.a (mon.0) 10480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.419 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:38 smithi049 bash[23528]: audit 2024-09-21T03:12:37.322699+0000 mon.a (mon.0) 10481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:38 smithi044 bash[22676]: cluster 2024-09-21T03:12:37.014614+0000 mgr.a (mgr.14388) 12903 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:38 smithi044 bash[22676]: audit 2024-09-21T03:12:37.129673+0000 mon.a (mon.0) 10476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:38 smithi044 bash[22676]: audit 2024-09-21T03:12:37.134882+0000 mon.a (mon.0) 10477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:38 smithi044 bash[22676]: audit 2024-09-21T03:12:37.142447+0000 mon.a (mon.0) 10478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:38 smithi044 bash[22676]: audit 2024-09-21T03:12:37.301289+0000 mon.a (mon.0) 10479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:38 smithi044 bash[22676]: audit 2024-09-21T03:12:37.310998+0000 mon.a (mon.0) 10480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:38 smithi044 bash[22676]: audit 2024-09-21T03:12:37.322699+0000 mon.a (mon.0) 10481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:38 smithi179 bash[23186]: cluster 2024-09-21T03:12:37.014614+0000 mgr.a (mgr.14388) 12903 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:38 smithi179 bash[23186]: audit 2024-09-21T03:12:37.129673+0000 mon.a (mon.0) 10476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:38 smithi179 bash[23186]: audit 2024-09-21T03:12:37.134882+0000 mon.a (mon.0) 10477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:38 smithi179 bash[23186]: audit 2024-09-21T03:12:37.142447+0000 mon.a (mon.0) 10478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:38 smithi179 bash[23186]: audit 2024-09-21T03:12:37.301289+0000 mon.a (mon.0) 10479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:38 smithi179 bash[23186]: audit 2024-09-21T03:12:37.310998+0000 mon.a (mon.0) 10480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:38 smithi179 bash[23186]: audit 2024-09-21T03:12:37.322699+0000 mon.a (mon.0) 10481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:38.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:38.661 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:39 smithi179 bash[23186]: audit 2024-09-21T03:12:39.001285+0000 mgr.a (mgr.14388) 12904 : audit [DBG] from='client.281454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:39.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:39.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:39.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:39.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:39.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:39.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:39 smithi044 bash[22676]: audit 2024-09-21T03:12:39.001285+0000 mgr.a (mgr.14388) 12904 : audit [DBG] from='client.281454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:39 smithi049 bash[23528]: audit 2024-09-21T03:12:39.001285+0000 mgr.a (mgr.14388) 12904 : audit [DBG] from='client.281454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:40 smithi044 bash[22676]: cluster 2024-09-21T03:12:39.018719+0000 mgr.a (mgr.14388) 12905 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:40.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:40 smithi179 bash[23186]: cluster 2024-09-21T03:12:39.018719+0000 mgr.a (mgr.14388) 12905 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:40 smithi049 bash[23528]: cluster 2024-09-21T03:12:39.018719+0000 mgr.a (mgr.14388) 12905 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22930]: debug 2024-09-21T03:12:42.188+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22930]: debug 2024-09-21T03:12:42.188+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22676]: cluster 2024-09-21T03:12:41.021421+0000 mgr.a (mgr.14388) 12906 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22676]: audit 2024-09-21T03:12:41.371493+0000 mon.a (mon.0) 10482 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22676]: audit 2024-09-21T03:12:41.378800+0000 mon.a (mon.0) 10483 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22676]: audit 2024-09-21T03:12:41.380708+0000 mon.a (mon.0) 10484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22676]: audit 2024-09-21T03:12:41.393230+0000 mon.a (mon.0) 10485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22676]: audit 2024-09-21T03:12:41.399690+0000 mon.a (mon.0) 10486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:12:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:42 smithi044 bash[22676]: audit 2024-09-21T03:12:41.402183+0000 mgr.a (mgr.14388) 12907 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:12:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:42 smithi179 bash[23186]: cluster 2024-09-21T03:12:41.021421+0000 mgr.a (mgr.14388) 12906 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:42 smithi179 bash[23186]: audit 2024-09-21T03:12:41.371493+0000 mon.a (mon.0) 10482 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:12:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:42 smithi179 bash[23186]: audit 2024-09-21T03:12:41.378800+0000 mon.a (mon.0) 10483 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:12:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:42 smithi179 bash[23186]: audit 2024-09-21T03:12:41.380708+0000 mon.a (mon.0) 10484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:12:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:42 smithi179 bash[23186]: audit 2024-09-21T03:12:41.393230+0000 mon.a (mon.0) 10485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:42 smithi179 bash[23186]: audit 2024-09-21T03:12:41.399690+0000 mon.a (mon.0) 10486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:12:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:42 smithi179 bash[23186]: audit 2024-09-21T03:12:41.402183+0000 mgr.a (mgr.14388) 12907 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:12:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:42 smithi049 bash[23528]: cluster 2024-09-21T03:12:41.021421+0000 mgr.a (mgr.14388) 12906 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:12:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:42 smithi049 bash[23528]: audit 2024-09-21T03:12:41.371493+0000 mon.a (mon.0) 10482 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:12:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:42 smithi049 bash[23528]: audit 2024-09-21T03:12:41.378800+0000 mon.a (mon.0) 10483 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:12:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:42 smithi049 bash[23528]: audit 2024-09-21T03:12:41.380708+0000 mon.a (mon.0) 10484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:12:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:42 smithi049 bash[23528]: audit 2024-09-21T03:12:41.393230+0000 mon.a (mon.0) 10485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:42 smithi049 bash[23528]: audit 2024-09-21T03:12:41.399690+0000 mon.a (mon.0) 10486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:12:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:42 smithi049 bash[23528]: audit 2024-09-21T03:12:41.402183+0000 mgr.a (mgr.14388) 12907 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:12:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:43 smithi044 bash[22676]: audit 2024-09-21T03:12:42.191452+0000 mgr.a (mgr.14388) 12908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:12:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:43 smithi044 bash[22676]: cephadm 2024-09-21T03:12:42.192913+0000 mgr.a (mgr.14388) 12909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:12:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:43 smithi179 bash[23186]: audit 2024-09-21T03:12:42.191452+0000 mgr.a (mgr.14388) 12908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:12:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:43 smithi179 bash[23186]: cephadm 2024-09-21T03:12:42.192913+0000 mgr.a (mgr.14388) 12909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:43 smithi049 bash[23528]: audit 2024-09-21T03:12:42.191452+0000 mgr.a (mgr.14388) 12908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:12:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:43 smithi049 bash[23528]: cephadm 2024-09-21T03:12:42.192913+0000 mgr.a (mgr.14388) 12909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:12:44.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:44.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:44.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:44.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:44 smithi044 bash[22676]: cluster 2024-09-21T03:12:43.022454+0000 mgr.a (mgr.14388) 12910 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:44.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:44 smithi179 bash[23186]: cluster 2024-09-21T03:12:43.022454+0000 mgr.a (mgr.14388) 12910 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:44.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:44 smithi049 bash[23528]: cluster 2024-09-21T03:12:43.022454+0000 mgr.a (mgr.14388) 12910 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:45.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:45 smithi044 bash[22676]: audit 2024-09-21T03:12:44.486395+0000 mon.a (mon.0) 10487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:45 smithi044 bash[22676]: audit 2024-09-21T03:12:44.495607+0000 mon.a (mon.0) 10488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:45 smithi044 bash[22676]: audit 2024-09-21T03:12:44.506552+0000 mon.a (mon.0) 10489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:45 smithi044 bash[22676]: audit 2024-09-21T03:12:44.779822+0000 mgr.a (mgr.14388) 12911 : audit [DBG] from='client.281637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:45 smithi179 bash[23186]: audit 2024-09-21T03:12:44.486395+0000 mon.a (mon.0) 10487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:45 smithi179 bash[23186]: audit 2024-09-21T03:12:44.495607+0000 mon.a (mon.0) 10488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:45 smithi179 bash[23186]: audit 2024-09-21T03:12:44.506552+0000 mon.a (mon.0) 10489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:45 smithi179 bash[23186]: audit 2024-09-21T03:12:44.779822+0000 mgr.a (mgr.14388) 12911 : audit [DBG] from='client.281637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:45 smithi049 bash[23528]: audit 2024-09-21T03:12:44.486395+0000 mon.a (mon.0) 10487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:45 smithi049 bash[23528]: audit 2024-09-21T03:12:44.495607+0000 mon.a (mon.0) 10488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:45 smithi049 bash[23528]: audit 2024-09-21T03:12:44.506552+0000 mon.a (mon.0) 10489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:45 smithi049 bash[23528]: audit 2024-09-21T03:12:44.779822+0000 mgr.a (mgr.14388) 12911 : audit [DBG] from='client.281637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:46 smithi179 bash[23186]: cluster 2024-09-21T03:12:45.022993+0000 mgr.a (mgr.14388) 12912 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:46 smithi049 bash[23528]: cluster 2024-09-21T03:12:45.022993+0000 mgr.a (mgr.14388) 12912 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:46 smithi044 bash[22676]: cluster 2024-09-21T03:12:45.022993+0000 mgr.a (mgr.14388) 12912 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:12:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:48 smithi049 bash[23528]: cluster 2024-09-21T03:12:47.025753+0000 mgr.a (mgr.14388) 12913 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:48.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:48 smithi044 bash[22676]: cluster 2024-09-21T03:12:47.025753+0000 mgr.a (mgr.14388) 12913 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:48.966 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:48 smithi179 bash[23186]: cluster 2024-09-21T03:12:47.025753+0000 mgr.a (mgr.14388) 12913 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:50.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:50.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:50 smithi049 bash[23528]: cluster 2024-09-21T03:12:49.026232+0000 mgr.a (mgr.14388) 12914 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:50.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:50 smithi044 bash[22676]: cluster 2024-09-21T03:12:49.026232+0000 mgr.a (mgr.14388) 12914 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:50 smithi179 bash[23186]: cluster 2024-09-21T03:12:49.026232+0000 mgr.a (mgr.14388) 12914 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:51.030 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:51.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:51 smithi049 bash[23528]: audit 2024-09-21T03:12:50.580064+0000 mgr.a (mgr.14388) 12915 : audit [DBG] from='client.281715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:51.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:51 smithi044 bash[22676]: audit 2024-09-21T03:12:50.580064+0000 mgr.a (mgr.14388) 12915 : audit [DBG] from='client.281715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:52.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:51 smithi179 bash[23186]: audit 2024-09-21T03:12:50.580064+0000 mgr.a (mgr.14388) 12915 : audit [DBG] from='client.281715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:52 smithi049 bash[23528]: cluster 2024-09-21T03:12:51.027438+0000 mgr.a (mgr.14388) 12916 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:52 smithi044 bash[22676]: cluster 2024-09-21T03:12:51.027438+0000 mgr.a (mgr.14388) 12916 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:52 smithi179 bash[23186]: cluster 2024-09-21T03:12:51.027438+0000 mgr.a (mgr.14388) 12916 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:54 smithi049 bash[23528]: cluster 2024-09-21T03:12:53.028195+0000 mgr.a (mgr.14388) 12917 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:54 smithi044 bash[22676]: cluster 2024-09-21T03:12:53.028195+0000 mgr.a (mgr.14388) 12917 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:54 smithi179 bash[23186]: cluster 2024-09-21T03:12:53.028195+0000 mgr.a (mgr.14388) 12917 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:56.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:12:56.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:12:56.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:12:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:56 smithi049 bash[23528]: cluster 2024-09-21T03:12:55.028982+0000 mgr.a (mgr.14388) 12918 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:56.813 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:12:56.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:12:56.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:12:56.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:12:56.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:12:56.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:56 smithi044 bash[22676]: cluster 2024-09-21T03:12:55.028982+0000 mgr.a (mgr.14388) 12918 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:56 smithi179 bash[23186]: cluster 2024-09-21T03:12:55.028982+0000 mgr.a (mgr.14388) 12918 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:12:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:57 smithi179 bash[23186]: audit 2024-09-21T03:12:56.370297+0000 mgr.a (mgr.14388) 12919 : audit [DBG] from='client.281793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:57 smithi179 bash[23186]: audit 2024-09-21T03:12:57.349862+0000 mon.a (mon.0) 10490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:57 smithi179 bash[23186]: audit 2024-09-21T03:12:57.356264+0000 mon.a (mon.0) 10491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:57 smithi179 bash[23186]: audit 2024-09-21T03:12:57.363954+0000 mon.a (mon.0) 10492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:57 smithi179 bash[23186]: audit 2024-09-21T03:12:57.487717+0000 mon.a (mon.0) 10493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:57 smithi179 bash[23186]: audit 2024-09-21T03:12:57.494594+0000 mon.a (mon.0) 10494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:57 smithi179 bash[23186]: audit 2024-09-21T03:12:57.502690+0000 mon.a (mon.0) 10495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:57 smithi049 bash[23528]: audit 2024-09-21T03:12:56.370297+0000 mgr.a (mgr.14388) 12919 : audit [DBG] from='client.281793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:57 smithi049 bash[23528]: audit 2024-09-21T03:12:57.349862+0000 mon.a (mon.0) 10490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:57 smithi049 bash[23528]: audit 2024-09-21T03:12:57.356264+0000 mon.a (mon.0) 10491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:57 smithi049 bash[23528]: audit 2024-09-21T03:12:57.363954+0000 mon.a (mon.0) 10492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:57 smithi049 bash[23528]: audit 2024-09-21T03:12:57.487717+0000 mon.a (mon.0) 10493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:57 smithi049 bash[23528]: audit 2024-09-21T03:12:57.494594+0000 mon.a (mon.0) 10494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:57 smithi049 bash[23528]: audit 2024-09-21T03:12:57.502690+0000 mon.a (mon.0) 10495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:57 smithi044 bash[22676]: audit 2024-09-21T03:12:56.370297+0000 mgr.a (mgr.14388) 12919 : audit [DBG] from='client.281793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:12:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:57 smithi044 bash[22676]: audit 2024-09-21T03:12:57.349862+0000 mon.a (mon.0) 10490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:57 smithi044 bash[22676]: audit 2024-09-21T03:12:57.356264+0000 mon.a (mon.0) 10491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:57 smithi044 bash[22676]: audit 2024-09-21T03:12:57.363954+0000 mon.a (mon.0) 10492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:57 smithi044 bash[22676]: audit 2024-09-21T03:12:57.487717+0000 mon.a (mon.0) 10493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:57 smithi044 bash[22676]: audit 2024-09-21T03:12:57.494594+0000 mon.a (mon.0) 10494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:57 smithi044 bash[22676]: audit 2024-09-21T03:12:57.502690+0000 mon.a (mon.0) 10495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:12:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:12:58 smithi049 bash[23528]: cluster 2024-09-21T03:12:57.031823+0000 mgr.a (mgr.14388) 12920 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:12:58 smithi044 bash[22676]: cluster 2024-09-21T03:12:57.031823+0000 mgr.a (mgr.14388) 12920 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:12:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:12:58 smithi179 bash[23186]: cluster 2024-09-21T03:12:57.031823+0000 mgr.a (mgr.14388) 12920 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:00 smithi049 bash[23528]: cluster 2024-09-21T03:12:59.032619+0000 mgr.a (mgr.14388) 12921 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:13:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:00 smithi044 bash[22676]: cluster 2024-09-21T03:12:59.032619+0000 mgr.a (mgr.14388) 12921 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:13:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:00 smithi179 bash[23186]: cluster 2024-09-21T03:12:59.032619+0000 mgr.a (mgr.14388) 12921 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:13:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:02.579 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:02.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:02.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:02.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:02.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:02 smithi044 bash[22676]: cluster 2024-09-21T03:13:01.034651+0000 mgr.a (mgr.14388) 12922 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:13:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:02 smithi179 bash[23186]: cluster 2024-09-21T03:13:01.034651+0000 mgr.a (mgr.14388) 12922 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:13:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:02 smithi049 bash[23528]: cluster 2024-09-21T03:13:01.034651+0000 mgr.a (mgr.14388) 12922 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:13:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:03 smithi044 bash[22676]: audit 2024-09-21T03:13:02.143965+0000 mgr.a (mgr.14388) 12923 : audit [DBG] from='client.281871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:04.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:03 smithi179 bash[23186]: audit 2024-09-21T03:13:02.143965+0000 mgr.a (mgr.14388) 12923 : audit [DBG] from='client.281871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:03 smithi049 bash[23528]: audit 2024-09-21T03:13:02.143965+0000 mgr.a (mgr.14388) 12923 : audit [DBG] from='client.281871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:04 smithi044 bash[22676]: cluster 2024-09-21T03:13:03.035654+0000 mgr.a (mgr.14388) 12924 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:04 smithi179 bash[23186]: cluster 2024-09-21T03:13:03.035654+0000 mgr.a (mgr.14388) 12924 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:04 smithi049 bash[23528]: cluster 2024-09-21T03:13:03.035654+0000 mgr.a (mgr.14388) 12924 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:05 smithi044 bash[22676]: audit 2024-09-21T03:13:04.664386+0000 mon.a (mon.0) 10496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:05 smithi044 bash[22676]: audit 2024-09-21T03:13:04.674300+0000 mon.a (mon.0) 10497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:05 smithi044 bash[22676]: audit 2024-09-21T03:13:04.684853+0000 mon.a (mon.0) 10498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:05 smithi179 bash[23186]: audit 2024-09-21T03:13:04.664386+0000 mon.a (mon.0) 10496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:05 smithi179 bash[23186]: audit 2024-09-21T03:13:04.674300+0000 mon.a (mon.0) 10497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:05 smithi179 bash[23186]: audit 2024-09-21T03:13:04.684853+0000 mon.a (mon.0) 10498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:05 smithi049 bash[23528]: audit 2024-09-21T03:13:04.664386+0000 mon.a (mon.0) 10496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:05 smithi049 bash[23528]: audit 2024-09-21T03:13:04.674300+0000 mon.a (mon.0) 10497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:05 smithi049 bash[23528]: audit 2024-09-21T03:13:04.684853+0000 mon.a (mon.0) 10498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:06 smithi044 bash[22676]: cluster 2024-09-21T03:13:05.036476+0000 mgr.a (mgr.14388) 12925 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:06 smithi179 bash[23186]: cluster 2024-09-21T03:13:05.036476+0000 mgr.a (mgr.14388) 12925 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:06 smithi049 bash[23528]: cluster 2024-09-21T03:13:05.036476+0000 mgr.a (mgr.14388) 12925 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:07.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:07.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:08.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:08.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:08.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:08.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:08.318 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:08 smithi179 bash[23186]: cluster 2024-09-21T03:13:07.038713+0000 mgr.a (mgr.14388) 12926 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:08 smithi179 bash[23186]: audit 2024-09-21T03:13:07.904593+0000 mgr.a (mgr.14388) 12927 : audit [DBG] from='client.281946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:08 smithi044 bash[22676]: cluster 2024-09-21T03:13:07.038713+0000 mgr.a (mgr.14388) 12926 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:08 smithi044 bash[22676]: audit 2024-09-21T03:13:07.904593+0000 mgr.a (mgr.14388) 12927 : audit [DBG] from='client.281946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:08 smithi049 bash[23528]: cluster 2024-09-21T03:13:07.038713+0000 mgr.a (mgr.14388) 12926 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:08 smithi049 bash[23528]: audit 2024-09-21T03:13:07.904593+0000 mgr.a (mgr.14388) 12927 : audit [DBG] from='client.281946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:10 smithi044 bash[22676]: cluster 2024-09-21T03:13:09.039445+0000 mgr.a (mgr.14388) 12928 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:10 smithi179 bash[23186]: cluster 2024-09-21T03:13:09.039445+0000 mgr.a (mgr.14388) 12928 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:10 smithi049 bash[23528]: cluster 2024-09-21T03:13:09.039445+0000 mgr.a (mgr.14388) 12928 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:12 smithi044 bash[22676]: cluster 2024-09-21T03:13:11.041686+0000 mgr.a (mgr.14388) 12929 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:12 smithi179 bash[23186]: cluster 2024-09-21T03:13:11.041686+0000 mgr.a (mgr.14388) 12929 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:12 smithi049 bash[23528]: cluster 2024-09-21T03:13:11.041686+0000 mgr.a (mgr.14388) 12929 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:13.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:13.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:13.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:14.067 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:14.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:14.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:14.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:14 smithi044 bash[22676]: cluster 2024-09-21T03:13:13.042443+0000 mgr.a (mgr.14388) 12930 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:14 smithi044 bash[22676]: audit 2024-09-21T03:13:13.650000+0000 mgr.a (mgr.14388) 12931 : audit [DBG] from='client.282024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:14 smithi179 bash[23186]: cluster 2024-09-21T03:13:13.042443+0000 mgr.a (mgr.14388) 12930 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:15.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:14 smithi179 bash[23186]: audit 2024-09-21T03:13:13.650000+0000 mgr.a (mgr.14388) 12931 : audit [DBG] from='client.282024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:14 smithi049 bash[23528]: cluster 2024-09-21T03:13:13.042443+0000 mgr.a (mgr.14388) 12930 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:14 smithi049 bash[23528]: audit 2024-09-21T03:13:13.650000+0000 mgr.a (mgr.14388) 12931 : audit [DBG] from='client.282024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:16 smithi044 bash[22676]: cluster 2024-09-21T03:13:15.043424+0000 mgr.a (mgr.14388) 12932 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:16 smithi179 bash[23186]: cluster 2024-09-21T03:13:15.043424+0000 mgr.a (mgr.14388) 12932 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:16 smithi049 bash[23528]: cluster 2024-09-21T03:13:15.043424+0000 mgr.a (mgr.14388) 12932 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:18 smithi044 bash[22676]: cluster 2024-09-21T03:13:17.045715+0000 mgr.a (mgr.14388) 12933 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:18 smithi044 bash[22676]: audit 2024-09-21T03:13:17.558969+0000 mon.a (mon.0) 10499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:18 smithi044 bash[22676]: audit 2024-09-21T03:13:17.568225+0000 mon.a (mon.0) 10500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:18 smithi044 bash[22676]: audit 2024-09-21T03:13:17.579480+0000 mon.a (mon.0) 10501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:18 smithi044 bash[22676]: audit 2024-09-21T03:13:17.669682+0000 mon.a (mon.0) 10502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:18 smithi044 bash[22676]: audit 2024-09-21T03:13:17.678197+0000 mon.a (mon.0) 10503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:18 smithi044 bash[22676]: audit 2024-09-21T03:13:17.687954+0000 mon.a (mon.0) 10504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:18 smithi179 bash[23186]: cluster 2024-09-21T03:13:17.045715+0000 mgr.a (mgr.14388) 12933 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:18 smithi179 bash[23186]: audit 2024-09-21T03:13:17.558969+0000 mon.a (mon.0) 10499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:18 smithi179 bash[23186]: audit 2024-09-21T03:13:17.568225+0000 mon.a (mon.0) 10500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:18 smithi179 bash[23186]: audit 2024-09-21T03:13:17.579480+0000 mon.a (mon.0) 10501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:18 smithi179 bash[23186]: audit 2024-09-21T03:13:17.669682+0000 mon.a (mon.0) 10502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:18 smithi179 bash[23186]: audit 2024-09-21T03:13:17.678197+0000 mon.a (mon.0) 10503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:18 smithi179 bash[23186]: audit 2024-09-21T03:13:17.687954+0000 mon.a (mon.0) 10504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:18 smithi049 bash[23528]: cluster 2024-09-21T03:13:17.045715+0000 mgr.a (mgr.14388) 12933 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:18 smithi049 bash[23528]: audit 2024-09-21T03:13:17.558969+0000 mon.a (mon.0) 10499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:18 smithi049 bash[23528]: audit 2024-09-21T03:13:17.568225+0000 mon.a (mon.0) 10500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:18 smithi049 bash[23528]: audit 2024-09-21T03:13:17.579480+0000 mon.a (mon.0) 10501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:18 smithi049 bash[23528]: audit 2024-09-21T03:13:17.669682+0000 mon.a (mon.0) 10502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:18 smithi049 bash[23528]: audit 2024-09-21T03:13:17.678197+0000 mon.a (mon.0) 10503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:18 smithi049 bash[23528]: audit 2024-09-21T03:13:17.687954+0000 mon.a (mon.0) 10504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:19.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:19.860 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:19.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:19.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:19.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:19.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:20 smithi044 bash[22676]: cluster 2024-09-21T03:13:19.046514+0000 mgr.a (mgr.14388) 12934 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:21.047 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:20 smithi044 bash[22676]: audit 2024-09-21T03:13:19.406752+0000 mgr.a (mgr.14388) 12935 : audit [DBG] from='client.282102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:21.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:20 smithi179 bash[23186]: cluster 2024-09-21T03:13:19.046514+0000 mgr.a (mgr.14388) 12934 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:21.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:20 smithi179 bash[23186]: audit 2024-09-21T03:13:19.406752+0000 mgr.a (mgr.14388) 12935 : audit [DBG] from='client.282102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:20 smithi049 bash[23528]: cluster 2024-09-21T03:13:19.046514+0000 mgr.a (mgr.14388) 12934 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:20 smithi049 bash[23528]: audit 2024-09-21T03:13:19.406752+0000 mgr.a (mgr.14388) 12935 : audit [DBG] from='client.282102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:22 smithi044 bash[22676]: cluster 2024-09-21T03:13:21.048970+0000 mgr.a (mgr.14388) 12936 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:22 smithi179 bash[23186]: cluster 2024-09-21T03:13:21.048970+0000 mgr.a (mgr.14388) 12936 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:22 smithi049 bash[23528]: cluster 2024-09-21T03:13:21.048970+0000 mgr.a (mgr.14388) 12936 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:24.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:24.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:24.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:24.916 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:24 smithi049 bash[23528]: cluster 2024-09-21T03:13:23.049825+0000 mgr.a (mgr.14388) 12937 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:24.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:24 smithi044 bash[22676]: cluster 2024-09-21T03:13:23.049825+0000 mgr.a (mgr.14388) 12937 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:24 smithi179 bash[23186]: cluster 2024-09-21T03:13:23.049825+0000 mgr.a (mgr.14388) 12937 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:25.636 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:25 smithi044 bash[22676]: audit 2024-09-21T03:13:24.897317+0000 mon.a (mon.0) 10505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:25 smithi044 bash[22676]: audit 2024-09-21T03:13:24.904105+0000 mon.a (mon.0) 10506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:25 smithi044 bash[22676]: audit 2024-09-21T03:13:24.913859+0000 mon.a (mon.0) 10507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:25 smithi179 bash[23186]: audit 2024-09-21T03:13:24.897317+0000 mon.a (mon.0) 10505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:25 smithi179 bash[23186]: audit 2024-09-21T03:13:24.904105+0000 mon.a (mon.0) 10506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:25 smithi179 bash[23186]: audit 2024-09-21T03:13:24.913859+0000 mon.a (mon.0) 10507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:25 smithi049 bash[23528]: audit 2024-09-21T03:13:24.897317+0000 mon.a (mon.0) 10505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:25 smithi049 bash[23528]: audit 2024-09-21T03:13:24.904105+0000 mon.a (mon.0) 10506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:25 smithi049 bash[23528]: audit 2024-09-21T03:13:24.913859+0000 mon.a (mon.0) 10507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:26 smithi044 bash[22676]: cluster 2024-09-21T03:13:25.050564+0000 mgr.a (mgr.14388) 12938 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:26 smithi044 bash[22676]: audit 2024-09-21T03:13:25.201683+0000 mgr.a (mgr.14388) 12939 : audit [DBG] from='client.282180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:27.216 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:26 smithi179 bash[23186]: cluster 2024-09-21T03:13:25.050564+0000 mgr.a (mgr.14388) 12938 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:27.216 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:26 smithi179 bash[23186]: audit 2024-09-21T03:13:25.201683+0000 mgr.a (mgr.14388) 12939 : audit [DBG] from='client.282180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:26 smithi049 bash[23528]: cluster 2024-09-21T03:13:25.050564+0000 mgr.a (mgr.14388) 12938 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:26 smithi049 bash[23528]: audit 2024-09-21T03:13:25.201683+0000 mgr.a (mgr.14388) 12939 : audit [DBG] from='client.282180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:28 smithi044 bash[22676]: cluster 2024-09-21T03:13:27.053227+0000 mgr.a (mgr.14388) 12940 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:28 smithi179 bash[23186]: cluster 2024-09-21T03:13:27.053227+0000 mgr.a (mgr.14388) 12940 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:28 smithi049 bash[23528]: cluster 2024-09-21T03:13:27.053227+0000 mgr.a (mgr.14388) 12940 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:31.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:30 smithi044 bash[22676]: cluster 2024-09-21T03:13:29.054010+0000 mgr.a (mgr.14388) 12941 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:13:31.244 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:30 smithi049 bash[23528]: cluster 2024-09-21T03:13:29.054010+0000 mgr.a (mgr.14388) 12941 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:13:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:30 smithi179 bash[23186]: cluster 2024-09-21T03:13:29.054010+0000 mgr.a (mgr.14388) 12941 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:13:31.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:31.422 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:31 smithi044 bash[22676]: audit 2024-09-21T03:13:30.972442+0000 mgr.a (mgr.14388) 12942 : audit [DBG] from='client.282255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:31 smithi179 bash[23186]: audit 2024-09-21T03:13:30.972442+0000 mgr.a (mgr.14388) 12942 : audit [DBG] from='client.282255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:31 smithi049 bash[23528]: audit 2024-09-21T03:13:30.972442+0000 mgr.a (mgr.14388) 12942 : audit [DBG] from='client.282255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:32 smithi044 bash[22676]: cluster 2024-09-21T03:13:31.055388+0000 mgr.a (mgr.14388) 12943 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:32 smithi179 bash[23186]: cluster 2024-09-21T03:13:31.055388+0000 mgr.a (mgr.14388) 12943 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:32 smithi049 bash[23528]: cluster 2024-09-21T03:13:31.055388+0000 mgr.a (mgr.14388) 12943 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:34 smithi044 bash[22676]: cluster 2024-09-21T03:13:33.056257+0000 mgr.a (mgr.14388) 12944 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:13:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:34 smithi179 bash[23186]: cluster 2024-09-21T03:13:33.056257+0000 mgr.a (mgr.14388) 12944 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:13:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:34 smithi049 bash[23528]: cluster 2024-09-21T03:13:33.056257+0000 mgr.a (mgr.14388) 12944 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:13:36.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:36.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:36.424 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:37.212 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:37.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:37.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:37.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:36 smithi044 bash[22676]: cluster 2024-09-21T03:13:35.057052+0000 mgr.a (mgr.14388) 12945 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:13:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:36 smithi179 bash[23186]: cluster 2024-09-21T03:13:35.057052+0000 mgr.a (mgr.14388) 12945 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:13:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:36 smithi049 bash[23528]: cluster 2024-09-21T03:13:35.057052+0000 mgr.a (mgr.14388) 12945 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:13:38.162 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:37 smithi049 bash[23528]: audit 2024-09-21T03:13:36.759068+0000 mgr.a (mgr.14388) 12946 : audit [DBG] from='client.282330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:38.162 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:37 smithi049 bash[23528]: audit 2024-09-21T03:13:37.795842+0000 mon.a (mon.0) 10508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.162 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:37 smithi049 bash[23528]: audit 2024-09-21T03:13:37.804575+0000 mon.a (mon.0) 10509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.162 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:37 smithi049 bash[23528]: audit 2024-09-21T03:13:37.815016+0000 mon.a (mon.0) 10510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.163 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:37 smithi049 bash[23528]: audit 2024-09-21T03:13:37.900232+0000 mon.a (mon.0) 10511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.163 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:37 smithi049 bash[23528]: audit 2024-09-21T03:13:37.908593+0000 mon.a (mon.0) 10512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.163 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:37 smithi049 bash[23528]: audit 2024-09-21T03:13:37.917413+0000 mon.a (mon.0) 10513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:37 smithi044 bash[22676]: audit 2024-09-21T03:13:36.759068+0000 mgr.a (mgr.14388) 12946 : audit [DBG] from='client.282330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:37 smithi044 bash[22676]: audit 2024-09-21T03:13:37.795842+0000 mon.a (mon.0) 10508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:37 smithi044 bash[22676]: audit 2024-09-21T03:13:37.804575+0000 mon.a (mon.0) 10509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:37 smithi044 bash[22676]: audit 2024-09-21T03:13:37.815016+0000 mon.a (mon.0) 10510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:37 smithi044 bash[22676]: audit 2024-09-21T03:13:37.900232+0000 mon.a (mon.0) 10511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:37 smithi044 bash[22676]: audit 2024-09-21T03:13:37.908593+0000 mon.a (mon.0) 10512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:37 smithi044 bash[22676]: audit 2024-09-21T03:13:37.917413+0000 mon.a (mon.0) 10513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:37 smithi179 bash[23186]: audit 2024-09-21T03:13:36.759068+0000 mgr.a (mgr.14388) 12946 : audit [DBG] from='client.282330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:37 smithi179 bash[23186]: audit 2024-09-21T03:13:37.795842+0000 mon.a (mon.0) 10508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:37 smithi179 bash[23186]: audit 2024-09-21T03:13:37.804575+0000 mon.a (mon.0) 10509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:37 smithi179 bash[23186]: audit 2024-09-21T03:13:37.815016+0000 mon.a (mon.0) 10510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:37 smithi179 bash[23186]: audit 2024-09-21T03:13:37.900232+0000 mon.a (mon.0) 10511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:37 smithi179 bash[23186]: audit 2024-09-21T03:13:37.908593+0000 mon.a (mon.0) 10512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:37 smithi179 bash[23186]: audit 2024-09-21T03:13:37.917413+0000 mon.a (mon.0) 10513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:38 smithi044 bash[22676]: cluster 2024-09-21T03:13:37.058375+0000 mgr.a (mgr.14388) 12947 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:38 smithi179 bash[23186]: cluster 2024-09-21T03:13:37.058375+0000 mgr.a (mgr.14388) 12947 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:38 smithi049 bash[23528]: cluster 2024-09-21T03:13:37.058375+0000 mgr.a (mgr.14388) 12947 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:40 smithi044 bash[22676]: cluster 2024-09-21T03:13:39.059218+0000 mgr.a (mgr.14388) 12948 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:40 smithi179 bash[23186]: cluster 2024-09-21T03:13:39.059218+0000 mgr.a (mgr.14388) 12948 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:40 smithi049 bash[23528]: cluster 2024-09-21T03:13:39.059218+0000 mgr.a (mgr.14388) 12948 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:42.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:43.236 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:13:43 smithi044 bash[22930]: debug 2024-09-21T03:13:43.039+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:13:43.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:13:43 smithi044 bash[22930]: debug 2024-09-21T03:13:43.055+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:13:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:42 smithi044 bash[22676]: cluster 2024-09-21T03:13:41.061515+0000 mgr.a (mgr.14388) 12949 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:42 smithi044 bash[22676]: audit 2024-09-21T03:13:42.258197+0000 mon.a (mon.0) 10514 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:13:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:42 smithi044 bash[22676]: audit 2024-09-21T03:13:42.263697+0000 mon.a (mon.0) 10515 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:13:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:42 smithi044 bash[22676]: audit 2024-09-21T03:13:42.265416+0000 mon.a (mon.0) 10516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:13:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:42 smithi044 bash[22676]: audit 2024-09-21T03:13:42.276187+0000 mon.a (mon.0) 10517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:42 smithi044 bash[22676]: audit 2024-09-21T03:13:42.282406+0000 mon.a (mon.0) 10518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:13:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:42 smithi179 bash[23186]: cluster 2024-09-21T03:13:41.061515+0000 mgr.a (mgr.14388) 12949 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:42 smithi179 bash[23186]: audit 2024-09-21T03:13:42.258197+0000 mon.a (mon.0) 10514 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:13:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:42 smithi179 bash[23186]: audit 2024-09-21T03:13:42.263697+0000 mon.a (mon.0) 10515 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:13:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:42 smithi179 bash[23186]: audit 2024-09-21T03:13:42.265416+0000 mon.a (mon.0) 10516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:13:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:42 smithi179 bash[23186]: audit 2024-09-21T03:13:42.276187+0000 mon.a (mon.0) 10517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:42 smithi179 bash[23186]: audit 2024-09-21T03:13:42.282406+0000 mon.a (mon.0) 10518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:13:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:42 smithi049 bash[23528]: cluster 2024-09-21T03:13:41.061515+0000 mgr.a (mgr.14388) 12949 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:13:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:42 smithi049 bash[23528]: audit 2024-09-21T03:13:42.258197+0000 mon.a (mon.0) 10514 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:13:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:42 smithi049 bash[23528]: audit 2024-09-21T03:13:42.263697+0000 mon.a (mon.0) 10515 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:13:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:42 smithi049 bash[23528]: audit 2024-09-21T03:13:42.265416+0000 mon.a (mon.0) 10516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:13:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:42 smithi049 bash[23528]: audit 2024-09-21T03:13:42.276187+0000 mon.a (mon.0) 10517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:42 smithi049 bash[23528]: audit 2024-09-21T03:13:42.282406+0000 mon.a (mon.0) 10518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:13:43.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:43.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:43.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:43.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:43.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:43 smithi044 bash[22676]: audit 2024-09-21T03:13:42.283972+0000 mgr.a (mgr.14388) 12950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:13:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:43 smithi044 bash[22676]: audit 2024-09-21T03:13:42.582669+0000 mgr.a (mgr.14388) 12951 : audit [DBG] from='client.282405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:43 smithi179 bash[23186]: audit 2024-09-21T03:13:42.283972+0000 mgr.a (mgr.14388) 12950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:13:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:43 smithi179 bash[23186]: audit 2024-09-21T03:13:42.582669+0000 mgr.a (mgr.14388) 12951 : audit [DBG] from='client.282405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:43 smithi049 bash[23528]: audit 2024-09-21T03:13:42.283972+0000 mgr.a (mgr.14388) 12950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:13:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:43 smithi049 bash[23528]: audit 2024-09-21T03:13:42.582669+0000 mgr.a (mgr.14388) 12951 : audit [DBG] from='client.282405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:44 smithi044 bash[22676]: audit 2024-09-21T03:13:43.045153+0000 mgr.a (mgr.14388) 12952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:13:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:44 smithi044 bash[22676]: cephadm 2024-09-21T03:13:43.060889+0000 mgr.a (mgr.14388) 12953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:13:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:44 smithi044 bash[22676]: cluster 2024-09-21T03:13:43.062616+0000 mgr.a (mgr.14388) 12954 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:44 smithi179 bash[23186]: audit 2024-09-21T03:13:43.045153+0000 mgr.a (mgr.14388) 12952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:13:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:44 smithi179 bash[23186]: cephadm 2024-09-21T03:13:43.060889+0000 mgr.a (mgr.14388) 12953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:13:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:44 smithi179 bash[23186]: cluster 2024-09-21T03:13:43.062616+0000 mgr.a (mgr.14388) 12954 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:44 smithi049 bash[23528]: audit 2024-09-21T03:13:43.045153+0000 mgr.a (mgr.14388) 12952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:44 smithi049 bash[23528]: cephadm 2024-09-21T03:13:43.060889+0000 mgr.a (mgr.14388) 12953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:13:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:44 smithi049 bash[23528]: cluster 2024-09-21T03:13:43.062616+0000 mgr.a (mgr.14388) 12954 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:46 smithi044 bash[22676]: cluster 2024-09-21T03:13:45.063585+0000 mgr.a (mgr.14388) 12955 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:46 smithi044 bash[22676]: audit 2024-09-21T03:13:45.133211+0000 mon.a (mon.0) 10519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:46 smithi044 bash[22676]: audit 2024-09-21T03:13:45.143059+0000 mon.a (mon.0) 10520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:46 smithi044 bash[22676]: audit 2024-09-21T03:13:45.153425+0000 mon.a (mon.0) 10521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:46 smithi179 bash[23186]: cluster 2024-09-21T03:13:45.063585+0000 mgr.a (mgr.14388) 12955 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:46 smithi179 bash[23186]: audit 2024-09-21T03:13:45.133211+0000 mon.a (mon.0) 10519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:46 smithi179 bash[23186]: audit 2024-09-21T03:13:45.143059+0000 mon.a (mon.0) 10520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:46 smithi179 bash[23186]: audit 2024-09-21T03:13:45.153425+0000 mon.a (mon.0) 10521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:46 smithi049 bash[23528]: cluster 2024-09-21T03:13:45.063585+0000 mgr.a (mgr.14388) 12955 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:13:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:46 smithi049 bash[23528]: audit 2024-09-21T03:13:45.133211+0000 mon.a (mon.0) 10519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:46 smithi049 bash[23528]: audit 2024-09-21T03:13:45.143059+0000 mon.a (mon.0) 10520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:46 smithi049 bash[23528]: audit 2024-09-21T03:13:45.153425+0000 mon.a (mon.0) 10521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:48.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:48 smithi044 bash[22676]: cluster 2024-09-21T03:13:47.065885+0000 mgr.a (mgr.14388) 12956 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:48 smithi179 bash[23186]: cluster 2024-09-21T03:13:47.065885+0000 mgr.a (mgr.14388) 12956 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:48 smithi049 bash[23528]: cluster 2024-09-21T03:13:47.065885+0000 mgr.a (mgr.14388) 12956 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:49.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:49 smithi044 bash[22676]: audit 2024-09-21T03:13:48.799875+0000 mgr.a (mgr.14388) 12957 : audit [DBG] from='client.282585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:49.251 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:49 smithi179 bash[23186]: audit 2024-09-21T03:13:48.799875+0000 mgr.a (mgr.14388) 12957 : audit [DBG] from='client.282585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:49 smithi049 bash[23528]: audit 2024-09-21T03:13:48.799875+0000 mgr.a (mgr.14388) 12957 : audit [DBG] from='client.282585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:50 smithi044 bash[22676]: cluster 2024-09-21T03:13:49.066457+0000 mgr.a (mgr.14388) 12958 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:50 smithi179 bash[23186]: cluster 2024-09-21T03:13:49.066457+0000 mgr.a (mgr.14388) 12958 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:50 smithi049 bash[23528]: cluster 2024-09-21T03:13:49.066457+0000 mgr.a (mgr.14388) 12958 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:52 smithi044 bash[22676]: cluster 2024-09-21T03:13:51.068954+0000 mgr.a (mgr.14388) 12959 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:52 smithi179 bash[23186]: cluster 2024-09-21T03:13:51.068954+0000 mgr.a (mgr.14388) 12959 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:52 smithi049 bash[23528]: cluster 2024-09-21T03:13:51.068954+0000 mgr.a (mgr.14388) 12959 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:13:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:13:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:13:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:54 smithi044 bash[22676]: cluster 2024-09-21T03:13:53.069839+0000 mgr.a (mgr.14388) 12960 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:54.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:54 smithi179 bash[23186]: cluster 2024-09-21T03:13:53.069839+0000 mgr.a (mgr.14388) 12960 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:54 smithi049 bash[23528]: cluster 2024-09-21T03:13:53.069839+0000 mgr.a (mgr.14388) 12960 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:55.035 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:13:55.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:13:55.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:13:55.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:13:55.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:13:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:55 smithi044 bash[22676]: audit 2024-09-21T03:13:54.588646+0000 mgr.a (mgr.14388) 12961 : audit [DBG] from='client.282663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:55 smithi179 bash[23186]: audit 2024-09-21T03:13:54.588646+0000 mgr.a (mgr.14388) 12961 : audit [DBG] from='client.282663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:55 smithi049 bash[23528]: audit 2024-09-21T03:13:54.588646+0000 mgr.a (mgr.14388) 12961 : audit [DBG] from='client.282663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:13:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:56 smithi044 bash[22676]: cluster 2024-09-21T03:13:55.071368+0000 mgr.a (mgr.14388) 12962 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:56 smithi179 bash[23186]: cluster 2024-09-21T03:13:55.071368+0000 mgr.a (mgr.14388) 12962 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:56 smithi049 bash[23528]: cluster 2024-09-21T03:13:55.071368+0000 mgr.a (mgr.14388) 12962 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:59 smithi049 bash[23528]: cluster 2024-09-21T03:13:57.073028+0000 mgr.a (mgr.14388) 12963 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:59 smithi049 bash[23528]: audit 2024-09-21T03:13:58.015605+0000 mon.a (mon.0) 10522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:59 smithi049 bash[23528]: audit 2024-09-21T03:13:58.024959+0000 mon.a (mon.0) 10523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:59 smithi049 bash[23528]: audit 2024-09-21T03:13:58.036516+0000 mon.a (mon.0) 10524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:59 smithi049 bash[23528]: audit 2024-09-21T03:13:58.117880+0000 mon.a (mon.0) 10525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:59 smithi049 bash[23528]: audit 2024-09-21T03:13:58.124145+0000 mon.a (mon.0) 10526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:13:59 smithi049 bash[23528]: audit 2024-09-21T03:13:58.132344+0000 mon.a (mon.0) 10527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:59 smithi044 bash[22676]: cluster 2024-09-21T03:13:57.073028+0000 mgr.a (mgr.14388) 12963 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:59 smithi044 bash[22676]: audit 2024-09-21T03:13:58.015605+0000 mon.a (mon.0) 10522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:59 smithi044 bash[22676]: audit 2024-09-21T03:13:58.024959+0000 mon.a (mon.0) 10523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:59 smithi044 bash[22676]: audit 2024-09-21T03:13:58.036516+0000 mon.a (mon.0) 10524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:59 smithi044 bash[22676]: audit 2024-09-21T03:13:58.117880+0000 mon.a (mon.0) 10525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:59 smithi044 bash[22676]: audit 2024-09-21T03:13:58.124145+0000 mon.a (mon.0) 10526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:13:59 smithi044 bash[22676]: audit 2024-09-21T03:13:58.132344+0000 mon.a (mon.0) 10527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:59 smithi179 bash[23186]: cluster 2024-09-21T03:13:57.073028+0000 mgr.a (mgr.14388) 12963 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:13:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:59 smithi179 bash[23186]: audit 2024-09-21T03:13:58.015605+0000 mon.a (mon.0) 10522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:59 smithi179 bash[23186]: audit 2024-09-21T03:13:58.024959+0000 mon.a (mon.0) 10523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:59 smithi179 bash[23186]: audit 2024-09-21T03:13:58.036516+0000 mon.a (mon.0) 10524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:59 smithi179 bash[23186]: audit 2024-09-21T03:13:58.117880+0000 mon.a (mon.0) 10525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:59 smithi179 bash[23186]: audit 2024-09-21T03:13:58.124145+0000 mon.a (mon.0) 10526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:13:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:13:59 smithi179 bash[23186]: audit 2024-09-21T03:13:58.132344+0000 mon.a (mon.0) 10527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:00.819 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:00.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:00.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:00.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:00.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:01.282 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:01 smithi179 bash[23186]: cluster 2024-09-21T03:13:59.073960+0000 mgr.a (mgr.14388) 12964 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:01 smithi049 bash[23528]: cluster 2024-09-21T03:13:59.073960+0000 mgr.a (mgr.14388) 12964 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:01 smithi044 bash[22676]: cluster 2024-09-21T03:13:59.073960+0000 mgr.a (mgr.14388) 12964 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:02 smithi049 bash[23528]: audit 2024-09-21T03:14:00.373218+0000 mgr.a (mgr.14388) 12965 : audit [DBG] from='client.282741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:02 smithi049 bash[23528]: cluster 2024-09-21T03:14:01.076874+0000 mgr.a (mgr.14388) 12966 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:02 smithi044 bash[22676]: audit 2024-09-21T03:14:00.373218+0000 mgr.a (mgr.14388) 12965 : audit [DBG] from='client.282741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:02 smithi044 bash[22676]: cluster 2024-09-21T03:14:01.076874+0000 mgr.a (mgr.14388) 12966 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:02 smithi179 bash[23186]: audit 2024-09-21T03:14:00.373218+0000 mgr.a (mgr.14388) 12965 : audit [DBG] from='client.282741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:02 smithi179 bash[23186]: cluster 2024-09-21T03:14:01.076874+0000 mgr.a (mgr.14388) 12966 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:04 smithi044 bash[22676]: cluster 2024-09-21T03:14:03.077559+0000 mgr.a (mgr.14388) 12967 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:04 smithi179 bash[23186]: cluster 2024-09-21T03:14:03.077559+0000 mgr.a (mgr.14388) 12967 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:04 smithi049 bash[23528]: cluster 2024-09-21T03:14:03.077559+0000 mgr.a (mgr.14388) 12967 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:05.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:05.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:05.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:06.591 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:06.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:06 smithi044 bash[22676]: cluster 2024-09-21T03:14:05.078727+0000 mgr.a (mgr.14388) 12968 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:14:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:06 smithi044 bash[22676]: audit 2024-09-21T03:14:05.365776+0000 mon.a (mon.0) 10528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:06 smithi044 bash[22676]: audit 2024-09-21T03:14:05.374921+0000 mon.a (mon.0) 10529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:06 smithi044 bash[22676]: audit 2024-09-21T03:14:05.385325+0000 mon.a (mon.0) 10530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:06 smithi179 bash[23186]: cluster 2024-09-21T03:14:05.078727+0000 mgr.a (mgr.14388) 12968 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:14:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:06 smithi179 bash[23186]: audit 2024-09-21T03:14:05.365776+0000 mon.a (mon.0) 10528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:06 smithi179 bash[23186]: audit 2024-09-21T03:14:05.374921+0000 mon.a (mon.0) 10529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:06 smithi179 bash[23186]: audit 2024-09-21T03:14:05.385325+0000 mon.a (mon.0) 10530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:06 smithi049 bash[23528]: cluster 2024-09-21T03:14:05.078727+0000 mgr.a (mgr.14388) 12968 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:14:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:06 smithi049 bash[23528]: audit 2024-09-21T03:14:05.365776+0000 mon.a (mon.0) 10528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:06 smithi049 bash[23528]: audit 2024-09-21T03:14:05.374921+0000 mon.a (mon.0) 10529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:06 smithi049 bash[23528]: audit 2024-09-21T03:14:05.385325+0000 mon.a (mon.0) 10530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:07.685 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:07 smithi179 bash[23186]: audit 2024-09-21T03:14:06.153524+0000 mgr.a (mgr.14388) 12969 : audit [DBG] from='client.282816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:07 smithi044 bash[22676]: audit 2024-09-21T03:14:06.153524+0000 mgr.a (mgr.14388) 12969 : audit [DBG] from='client.282816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:07 smithi049 bash[23528]: audit 2024-09-21T03:14:06.153524+0000 mgr.a (mgr.14388) 12969 : audit [DBG] from='client.282816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:08.630 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:08 smithi044 bash[22676]: cluster 2024-09-21T03:14:07.081220+0000 mgr.a (mgr.14388) 12970 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:14:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:08 smithi179 bash[23186]: cluster 2024-09-21T03:14:07.081220+0000 mgr.a (mgr.14388) 12970 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:14:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:08 smithi049 bash[23528]: cluster 2024-09-21T03:14:07.081220+0000 mgr.a (mgr.14388) 12970 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:14:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:10 smithi044 bash[22676]: cluster 2024-09-21T03:14:09.082261+0000 mgr.a (mgr.14388) 12971 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:10 smithi179 bash[23186]: cluster 2024-09-21T03:14:09.082261+0000 mgr.a (mgr.14388) 12971 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:10 smithi049 bash[23528]: cluster 2024-09-21T03:14:09.082261+0000 mgr.a (mgr.14388) 12971 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:11.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:11.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:12.379 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:12.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:12.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:12.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:12.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:12 smithi044 bash[22676]: cluster 2024-09-21T03:14:11.083424+0000 mgr.a (mgr.14388) 12972 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:12 smithi044 bash[22676]: audit 2024-09-21T03:14:11.928730+0000 mgr.a (mgr.14388) 12973 : audit [DBG] from='client.282891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:12 smithi179 bash[23186]: cluster 2024-09-21T03:14:11.083424+0000 mgr.a (mgr.14388) 12972 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:12 smithi179 bash[23186]: audit 2024-09-21T03:14:11.928730+0000 mgr.a (mgr.14388) 12973 : audit [DBG] from='client.282891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:12 smithi049 bash[23528]: cluster 2024-09-21T03:14:11.083424+0000 mgr.a (mgr.14388) 12972 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:12 smithi049 bash[23528]: audit 2024-09-21T03:14:11.928730+0000 mgr.a (mgr.14388) 12973 : audit [DBG] from='client.282891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:14 smithi044 bash[22676]: cluster 2024-09-21T03:14:13.084376+0000 mgr.a (mgr.14388) 12974 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:14 smithi179 bash[23186]: cluster 2024-09-21T03:14:13.084376+0000 mgr.a (mgr.14388) 12974 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:14 smithi049 bash[23528]: cluster 2024-09-21T03:14:13.084376+0000 mgr.a (mgr.14388) 12974 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:16 smithi044 bash[22676]: cluster 2024-09-21T03:14:15.085825+0000 mgr.a (mgr.14388) 12975 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:14:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:16 smithi179 bash[23186]: cluster 2024-09-21T03:14:15.085825+0000 mgr.a (mgr.14388) 12975 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:14:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:16 smithi049 bash[23528]: cluster 2024-09-21T03:14:15.085825+0000 mgr.a (mgr.14388) 12975 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:14:17.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:17.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:17.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:18.158 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:18.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:18.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:18.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:18.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: cluster 2024-09-21T03:14:17.087506+0000 mgr.a (mgr.14388) 12976 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: audit 2024-09-21T03:14:17.717110+0000 mgr.a (mgr.14388) 12977 : audit [DBG] from='client.282966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: audit 2024-09-21T03:14:18.225186+0000 mon.a (mon.0) 10531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: audit 2024-09-21T03:14:18.231289+0000 mon.a (mon.0) 10532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: audit 2024-09-21T03:14:18.246818+0000 mon.a (mon.0) 10533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: audit 2024-09-21T03:14:18.257844+0000 mon.a (mon.0) 10534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: audit 2024-09-21T03:14:18.266000+0000 mon.a (mon.0) 10535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:18 smithi179 bash[23186]: audit 2024-09-21T03:14:18.274840+0000 mon.a (mon.0) 10536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: cluster 2024-09-21T03:14:17.087506+0000 mgr.a (mgr.14388) 12976 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:18.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: audit 2024-09-21T03:14:17.717110+0000 mgr.a (mgr.14388) 12977 : audit [DBG] from='client.282966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:18.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: audit 2024-09-21T03:14:18.225186+0000 mon.a (mon.0) 10531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: audit 2024-09-21T03:14:18.231289+0000 mon.a (mon.0) 10532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: audit 2024-09-21T03:14:18.246818+0000 mon.a (mon.0) 10533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: audit 2024-09-21T03:14:18.257844+0000 mon.a (mon.0) 10534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: audit 2024-09-21T03:14:18.266000+0000 mon.a (mon.0) 10535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:18 smithi049 bash[23528]: audit 2024-09-21T03:14:18.274840+0000 mon.a (mon.0) 10536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: cluster 2024-09-21T03:14:17.087506+0000 mgr.a (mgr.14388) 12976 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: audit 2024-09-21T03:14:17.717110+0000 mgr.a (mgr.14388) 12977 : audit [DBG] from='client.282966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: audit 2024-09-21T03:14:18.225186+0000 mon.a (mon.0) 10531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: audit 2024-09-21T03:14:18.231289+0000 mon.a (mon.0) 10532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: audit 2024-09-21T03:14:18.246818+0000 mon.a (mon.0) 10533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: audit 2024-09-21T03:14:18.257844+0000 mon.a (mon.0) 10534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: audit 2024-09-21T03:14:18.266000+0000 mon.a (mon.0) 10535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:18 smithi044 bash[22676]: audit 2024-09-21T03:14:18.274840+0000 mon.a (mon.0) 10536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:20 smithi044 bash[22676]: cluster 2024-09-21T03:14:19.088591+0000 mgr.a (mgr.14388) 12978 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:20 smithi179 bash[23186]: cluster 2024-09-21T03:14:19.088591+0000 mgr.a (mgr.14388) 12978 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:20 smithi049 bash[23528]: cluster 2024-09-21T03:14:19.088591+0000 mgr.a (mgr.14388) 12978 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:22 smithi044 bash[22676]: cluster 2024-09-21T03:14:21.090017+0000 mgr.a (mgr.14388) 12979 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:22 smithi179 bash[23186]: cluster 2024-09-21T03:14:21.090017+0000 mgr.a (mgr.14388) 12979 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:22 smithi049 bash[23528]: cluster 2024-09-21T03:14:21.090017+0000 mgr.a (mgr.14388) 12979 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:23.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:23.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:23.161 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:23.926 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:23.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:23.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:23.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:23.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:24 smithi044 bash[22676]: cluster 2024-09-21T03:14:23.090866+0000 mgr.a (mgr.14388) 12980 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:24 smithi044 bash[22676]: audit 2024-09-21T03:14:23.491374+0000 mgr.a (mgr.14388) 12981 : audit [DBG] from='client.283041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:24 smithi179 bash[23186]: cluster 2024-09-21T03:14:23.090866+0000 mgr.a (mgr.14388) 12980 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:24 smithi179 bash[23186]: audit 2024-09-21T03:14:23.491374+0000 mgr.a (mgr.14388) 12981 : audit [DBG] from='client.283041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:24 smithi049 bash[23528]: cluster 2024-09-21T03:14:23.090866+0000 mgr.a (mgr.14388) 12980 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:24 smithi049 bash[23528]: audit 2024-09-21T03:14:23.491374+0000 mgr.a (mgr.14388) 12981 : audit [DBG] from='client.283041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:26 smithi044 bash[22676]: cluster 2024-09-21T03:14:25.092378+0000 mgr.a (mgr.14388) 12982 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:14:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:26 smithi044 bash[22676]: audit 2024-09-21T03:14:25.603880+0000 mon.a (mon.0) 10537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:26 smithi044 bash[22676]: audit 2024-09-21T03:14:25.613946+0000 mon.a (mon.0) 10538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:26 smithi044 bash[22676]: audit 2024-09-21T03:14:25.624352+0000 mon.a (mon.0) 10539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:26 smithi179 bash[23186]: cluster 2024-09-21T03:14:25.092378+0000 mgr.a (mgr.14388) 12982 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:14:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:26 smithi179 bash[23186]: audit 2024-09-21T03:14:25.603880+0000 mon.a (mon.0) 10537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:26 smithi179 bash[23186]: audit 2024-09-21T03:14:25.613946+0000 mon.a (mon.0) 10538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:26 smithi179 bash[23186]: audit 2024-09-21T03:14:25.624352+0000 mon.a (mon.0) 10539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:26 smithi049 bash[23528]: cluster 2024-09-21T03:14:25.092378+0000 mgr.a (mgr.14388) 12982 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:14:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:26 smithi049 bash[23528]: audit 2024-09-21T03:14:25.603880+0000 mon.a (mon.0) 10537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:26 smithi049 bash[23528]: audit 2024-09-21T03:14:25.613946+0000 mon.a (mon.0) 10538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:26 smithi049 bash[23528]: audit 2024-09-21T03:14:25.624352+0000 mon.a (mon.0) 10539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:28.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:28 smithi044 bash[22676]: cluster 2024-09-21T03:14:27.094041+0000 mgr.a (mgr.14388) 12983 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:28.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:28.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:28.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:28 smithi179 bash[23186]: cluster 2024-09-21T03:14:27.094041+0000 mgr.a (mgr.14388) 12983 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:28 smithi049 bash[23528]: cluster 2024-09-21T03:14:27.094041+0000 mgr.a (mgr.14388) 12983 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:29.690 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:30 smithi044 bash[22676]: cluster 2024-09-21T03:14:29.094833+0000 mgr.a (mgr.14388) 12984 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:30 smithi044 bash[22676]: audit 2024-09-21T03:14:29.261953+0000 mgr.a (mgr.14388) 12985 : audit [DBG] from='client.283116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:30 smithi179 bash[23186]: cluster 2024-09-21T03:14:29.094833+0000 mgr.a (mgr.14388) 12984 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:30 smithi179 bash[23186]: audit 2024-09-21T03:14:29.261953+0000 mgr.a (mgr.14388) 12985 : audit [DBG] from='client.283116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:30 smithi049 bash[23528]: cluster 2024-09-21T03:14:29.094833+0000 mgr.a (mgr.14388) 12984 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:30 smithi049 bash[23528]: audit 2024-09-21T03:14:29.261953+0000 mgr.a (mgr.14388) 12985 : audit [DBG] from='client.283116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:32 smithi044 bash[22676]: cluster 2024-09-21T03:14:31.097037+0000 mgr.a (mgr.14388) 12986 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:32 smithi179 bash[23186]: cluster 2024-09-21T03:14:31.097037+0000 mgr.a (mgr.14388) 12986 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:32 smithi049 bash[23528]: cluster 2024-09-21T03:14:31.097037+0000 mgr.a (mgr.14388) 12986 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:14:34.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:34.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:34.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:34 smithi044 bash[22676]: cluster 2024-09-21T03:14:33.097831+0000 mgr.a (mgr.14388) 12987 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:34 smithi179 bash[23186]: cluster 2024-09-21T03:14:33.097831+0000 mgr.a (mgr.14388) 12987 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:34 smithi049 bash[23528]: cluster 2024-09-21T03:14:33.097831+0000 mgr.a (mgr.14388) 12987 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:35.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:35.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:35.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:35.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:35.447 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:35 smithi044 bash[22676]: audit 2024-09-21T03:14:35.022403+0000 mgr.a (mgr.14388) 12988 : audit [DBG] from='client.283194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:35 smithi179 bash[23186]: audit 2024-09-21T03:14:35.022403+0000 mgr.a (mgr.14388) 12988 : audit [DBG] from='client.283194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:35 smithi049 bash[23528]: audit 2024-09-21T03:14:35.022403+0000 mgr.a (mgr.14388) 12988 : audit [DBG] from='client.283194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:36 smithi044 bash[22676]: cluster 2024-09-21T03:14:35.098711+0000 mgr.a (mgr.14388) 12989 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:36 smithi179 bash[23186]: cluster 2024-09-21T03:14:35.098711+0000 mgr.a (mgr.14388) 12989 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:36 smithi049 bash[23528]: cluster 2024-09-21T03:14:35.098711+0000 mgr.a (mgr.14388) 12989 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:38 smithi179 bash[23186]: cluster 2024-09-21T03:14:37.100910+0000 mgr.a (mgr.14388) 12990 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:14:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:38 smithi179 bash[23186]: audit 2024-09-21T03:14:38.447805+0000 mon.a (mon.0) 10540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:38 smithi179 bash[23186]: audit 2024-09-21T03:14:38.455001+0000 mon.a (mon.0) 10541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:38 smithi179 bash[23186]: audit 2024-09-21T03:14:38.461634+0000 mon.a (mon.0) 10542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:38 smithi179 bash[23186]: audit 2024-09-21T03:14:38.489846+0000 mon.a (mon.0) 10543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:38 smithi179 bash[23186]: audit 2024-09-21T03:14:38.495709+0000 mon.a (mon.0) 10544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:38 smithi179 bash[23186]: audit 2024-09-21T03:14:38.502274+0000 mon.a (mon.0) 10545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:38 smithi049 bash[23528]: cluster 2024-09-21T03:14:37.100910+0000 mgr.a (mgr.14388) 12990 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:14:38.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:38 smithi049 bash[23528]: audit 2024-09-21T03:14:38.447805+0000 mon.a (mon.0) 10540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:38 smithi049 bash[23528]: audit 2024-09-21T03:14:38.455001+0000 mon.a (mon.0) 10541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:38 smithi049 bash[23528]: audit 2024-09-21T03:14:38.461634+0000 mon.a (mon.0) 10542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:38 smithi049 bash[23528]: audit 2024-09-21T03:14:38.489846+0000 mon.a (mon.0) 10543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:38 smithi049 bash[23528]: audit 2024-09-21T03:14:38.495709+0000 mon.a (mon.0) 10544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.930 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:38 smithi049 bash[23528]: audit 2024-09-21T03:14:38.502274+0000 mon.a (mon.0) 10545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:38 smithi044 bash[22676]: cluster 2024-09-21T03:14:37.100910+0000 mgr.a (mgr.14388) 12990 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:14:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:38 smithi044 bash[22676]: audit 2024-09-21T03:14:38.447805+0000 mon.a (mon.0) 10540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:38 smithi044 bash[22676]: audit 2024-09-21T03:14:38.455001+0000 mon.a (mon.0) 10541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:38 smithi044 bash[22676]: audit 2024-09-21T03:14:38.461634+0000 mon.a (mon.0) 10542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:38 smithi044 bash[22676]: audit 2024-09-21T03:14:38.489846+0000 mon.a (mon.0) 10543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:38 smithi044 bash[22676]: audit 2024-09-21T03:14:38.495709+0000 mon.a (mon.0) 10544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:38 smithi044 bash[22676]: audit 2024-09-21T03:14:38.502274+0000 mon.a (mon.0) 10545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:40.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:40 smithi044 bash[22676]: cluster 2024-09-21T03:14:39.101759+0000 mgr.a (mgr.14388) 12991 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:40 smithi179 bash[23186]: cluster 2024-09-21T03:14:39.101759+0000 mgr.a (mgr.14388) 12991 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:40 smithi049 bash[23528]: cluster 2024-09-21T03:14:39.101759+0000 mgr.a (mgr.14388) 12991 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:14:41.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:41.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:41.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:41.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:41.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:41 smithi049 bash[23528]: audit 2024-09-21T03:14:40.794579+0000 mgr.a (mgr.14388) 12992 : audit [DBG] from='client.283272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:41 smithi044 bash[22676]: audit 2024-09-21T03:14:40.794579+0000 mgr.a (mgr.14388) 12992 : audit [DBG] from='client.283272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:41 smithi179 bash[23186]: audit 2024-09-21T03:14:40.794579+0000 mgr.a (mgr.14388) 12992 : audit [DBG] from='client.283272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:42 smithi179 bash[23186]: cluster 2024-09-21T03:14:41.103325+0000 mgr.a (mgr.14388) 12993 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:42 smithi044 bash[22676]: cluster 2024-09-21T03:14:41.103325+0000 mgr.a (mgr.14388) 12993 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:42 smithi049 bash[23528]: cluster 2024-09-21T03:14:41.103325+0000 mgr.a (mgr.14388) 12993 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:14:43.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:43 smithi044 bash[22676]: audit 2024-09-21T03:14:43.121444+0000 mon.a (mon.0) 10546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:14:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:43 smithi179 bash[23186]: audit 2024-09-21T03:14:43.121444+0000 mon.a (mon.0) 10546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:14:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:43 smithi049 bash[23528]: audit 2024-09-21T03:14:43.121444+0000 mon.a (mon.0) 10546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:14:44.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22930]: debug 2024-09-21T03:14:44.478+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:14:44.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22930]: debug 2024-09-21T03:14:44.478+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:14:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: cluster 2024-09-21T03:14:43.104195+0000 mgr.a (mgr.14388) 12994 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:14:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.722153+0000 mon.a (mon.0) 10547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.726432+0000 mon.a (mon.0) 10548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.731641+0000 mon.a (mon.0) 10549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.737917+0000 mon.a (mon.0) 10550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.739127+0000 mon.a (mon.0) 10551 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:14:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.740135+0000 mon.a (mon.0) 10552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:14:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.746731+0000 mon.a (mon.0) 10553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.749578+0000 mon.a (mon.0) 10554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:14:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:44 smithi044 bash[22676]: audit 2024-09-21T03:14:43.750616+0000 mgr.a (mgr.14388) 12995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:14:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: cluster 2024-09-21T03:14:43.104195+0000 mgr.a (mgr.14388) 12994 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:14:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.722153+0000 mon.a (mon.0) 10547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.726432+0000 mon.a (mon.0) 10548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.731641+0000 mon.a (mon.0) 10549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.737917+0000 mon.a (mon.0) 10550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.739127+0000 mon.a (mon.0) 10551 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.740135+0000 mon.a (mon.0) 10552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.746731+0000 mon.a (mon.0) 10553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.749578+0000 mon.a (mon.0) 10554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:14:45.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:44 smithi179 bash[23186]: audit 2024-09-21T03:14:43.750616+0000 mgr.a (mgr.14388) 12995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:14:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: cluster 2024-09-21T03:14:43.104195+0000 mgr.a (mgr.14388) 12994 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:14:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.722153+0000 mon.a (mon.0) 10547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.726432+0000 mon.a (mon.0) 10548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.731641+0000 mon.a (mon.0) 10549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.737917+0000 mon.a (mon.0) 10550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.739127+0000 mon.a (mon.0) 10551 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:14:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.740135+0000 mon.a (mon.0) 10552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:14:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.746731+0000 mon.a (mon.0) 10553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.749578+0000 mon.a (mon.0) 10554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:14:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:44 smithi049 bash[23528]: audit 2024-09-21T03:14:43.750616+0000 mgr.a (mgr.14388) 12995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:14:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:45 smithi044 bash[22676]: audit 2024-09-21T03:14:44.483636+0000 mgr.a (mgr.14388) 12996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:14:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:45 smithi044 bash[22676]: cephadm 2024-09-21T03:14:44.484981+0000 mgr.a (mgr.14388) 12997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:14:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:45 smithi179 bash[23186]: audit 2024-09-21T03:14:44.483636+0000 mgr.a (mgr.14388) 12996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:14:46.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:45 smithi179 bash[23186]: cephadm 2024-09-21T03:14:44.484981+0000 mgr.a (mgr.14388) 12997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:14:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:45 smithi049 bash[23528]: audit 2024-09-21T03:14:44.483636+0000 mgr.a (mgr.14388) 12996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:14:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:45 smithi049 bash[23528]: cephadm 2024-09-21T03:14:44.484981+0000 mgr.a (mgr.14388) 12997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:14:46.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:47.027 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:47.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:47.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:47.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:47.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:46 smithi044 bash[22676]: cluster 2024-09-21T03:14:45.106102+0000 mgr.a (mgr.14388) 12998 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-21T03:14:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:46 smithi044 bash[22676]: audit 2024-09-21T03:14:45.828759+0000 mon.a (mon.0) 10555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:46 smithi044 bash[22676]: audit 2024-09-21T03:14:45.837439+0000 mon.a (mon.0) 10556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:46 smithi044 bash[22676]: audit 2024-09-21T03:14:45.847856+0000 mon.a (mon.0) 10557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:46 smithi179 bash[23186]: cluster 2024-09-21T03:14:45.106102+0000 mgr.a (mgr.14388) 12998 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-21T03:14:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:46 smithi179 bash[23186]: audit 2024-09-21T03:14:45.828759+0000 mon.a (mon.0) 10555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:46 smithi179 bash[23186]: audit 2024-09-21T03:14:45.837439+0000 mon.a (mon.0) 10556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:46 smithi179 bash[23186]: audit 2024-09-21T03:14:45.847856+0000 mon.a (mon.0) 10557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:46 smithi049 bash[23528]: cluster 2024-09-21T03:14:45.106102+0000 mgr.a (mgr.14388) 12998 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-21T03:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:46 smithi049 bash[23528]: audit 2024-09-21T03:14:45.828759+0000 mon.a (mon.0) 10555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:46 smithi049 bash[23528]: audit 2024-09-21T03:14:45.837439+0000 mon.a (mon.0) 10556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:46 smithi049 bash[23528]: audit 2024-09-21T03:14:45.847856+0000 mon.a (mon.0) 10557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:48.127 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:47 smithi179 bash[23186]: audit 2024-09-21T03:14:46.582289+0000 mgr.a (mgr.14388) 12999 : audit [DBG] from='client.283449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:47 smithi044 bash[22676]: audit 2024-09-21T03:14:46.582289+0000 mgr.a (mgr.14388) 12999 : audit [DBG] from='client.283449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:47 smithi049 bash[23528]: audit 2024-09-21T03:14:46.582289+0000 mgr.a (mgr.14388) 12999 : audit [DBG] from='client.283449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:49.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:48 smithi044 bash[22676]: cluster 2024-09-21T03:14:47.107904+0000 mgr.a (mgr.14388) 13000 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:48 smithi179 bash[23186]: cluster 2024-09-21T03:14:47.107904+0000 mgr.a (mgr.14388) 13000 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:48 smithi049 bash[23528]: cluster 2024-09-21T03:14:47.107904+0000 mgr.a (mgr.14388) 13000 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:50 smithi179 bash[23186]: cluster 2024-09-21T03:14:49.108733+0000 mgr.a (mgr.14388) 13001 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:50 smithi044 bash[22676]: cluster 2024-09-21T03:14:49.108733+0000 mgr.a (mgr.14388) 13001 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:50 smithi049 bash[23528]: cluster 2024-09-21T03:14:49.108733+0000 mgr.a (mgr.14388) 13001 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 176 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:52.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:52.793 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:52.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:52.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:52.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:52.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:52 smithi044 bash[22676]: cluster 2024-09-21T03:14:51.110987+0000 mgr.a (mgr.14388) 13002 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:52 smithi179 bash[23186]: cluster 2024-09-21T03:14:51.110987+0000 mgr.a (mgr.14388) 13002 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:52 smithi049 bash[23528]: cluster 2024-09-21T03:14:51.110987+0000 mgr.a (mgr.14388) 13002 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:53 smithi049 bash[23528]: audit 2024-09-21T03:14:52.366879+0000 mgr.a (mgr.14388) 13003 : audit [DBG] from='client.283527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:53 smithi044 bash[22676]: audit 2024-09-21T03:14:52.366879+0000 mgr.a (mgr.14388) 13003 : audit [DBG] from='client.283527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:53 smithi179 bash[23186]: audit 2024-09-21T03:14:52.366879+0000 mgr.a (mgr.14388) 13003 : audit [DBG] from='client.283527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:14:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:54 smithi044 bash[22676]: cluster 2024-09-21T03:14:53.111999+0000 mgr.a (mgr.14388) 13004 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:54 smithi179 bash[23186]: cluster 2024-09-21T03:14:53.111999+0000 mgr.a (mgr.14388) 13004 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:54 smithi049 bash[23528]: cluster 2024-09-21T03:14:53.111999+0000 mgr.a (mgr.14388) 13004 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:56 smithi044 bash[22676]: cluster 2024-09-21T03:14:55.114117+0000 mgr.a (mgr.14388) 13005 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:56 smithi179 bash[23186]: cluster 2024-09-21T03:14:55.114117+0000 mgr.a (mgr.14388) 13005 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:56 smithi049 bash[23528]: cluster 2024-09-21T03:14:55.114117+0000 mgr.a (mgr.14388) 13005 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:14:57.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:14:57.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:14:57.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:14:58.576 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:14:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:14:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:14:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:14:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:14:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:58 smithi044 bash[22676]: cluster 2024-09-21T03:14:57.115560+0000 mgr.a (mgr.14388) 13006 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:14:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:58 smithi044 bash[22676]: audit 2024-09-21T03:14:58.624808+0000 mon.a (mon.0) 10558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:58 smithi044 bash[22676]: audit 2024-09-21T03:14:58.630321+0000 mon.a (mon.0) 10559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:58 smithi044 bash[22676]: audit 2024-09-21T03:14:58.635425+0000 mon.a (mon.0) 10560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:58 smithi044 bash[22676]: audit 2024-09-21T03:14:58.650266+0000 mon.a (mon.0) 10561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:58 smithi044 bash[22676]: audit 2024-09-21T03:14:58.654707+0000 mon.a (mon.0) 10562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:58 smithi044 bash[22676]: audit 2024-09-21T03:14:58.663175+0000 mon.a (mon.0) 10563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:58 smithi179 bash[23186]: cluster 2024-09-21T03:14:57.115560+0000 mgr.a (mgr.14388) 13006 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:14:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:58 smithi179 bash[23186]: audit 2024-09-21T03:14:58.624808+0000 mon.a (mon.0) 10558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:58 smithi179 bash[23186]: audit 2024-09-21T03:14:58.630321+0000 mon.a (mon.0) 10559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:58 smithi179 bash[23186]: audit 2024-09-21T03:14:58.635425+0000 mon.a (mon.0) 10560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:58 smithi179 bash[23186]: audit 2024-09-21T03:14:58.650266+0000 mon.a (mon.0) 10561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:58 smithi179 bash[23186]: audit 2024-09-21T03:14:58.654707+0000 mon.a (mon.0) 10562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:58 smithi179 bash[23186]: audit 2024-09-21T03:14:58.663175+0000 mon.a (mon.0) 10563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:58 smithi049 bash[23528]: cluster 2024-09-21T03:14:57.115560+0000 mgr.a (mgr.14388) 13006 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:14:59.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:58 smithi049 bash[23528]: audit 2024-09-21T03:14:58.624808+0000 mon.a (mon.0) 10558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:58 smithi049 bash[23528]: audit 2024-09-21T03:14:58.630321+0000 mon.a (mon.0) 10559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:58 smithi049 bash[23528]: audit 2024-09-21T03:14:58.635425+0000 mon.a (mon.0) 10560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:58 smithi049 bash[23528]: audit 2024-09-21T03:14:58.650266+0000 mon.a (mon.0) 10561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:58 smithi049 bash[23528]: audit 2024-09-21T03:14:58.654707+0000 mon.a (mon.0) 10562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:14:59.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:58 smithi049 bash[23528]: audit 2024-09-21T03:14:58.663175+0000 mon.a (mon.0) 10563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:14:59 smithi044 bash[22676]: audit 2024-09-21T03:14:58.130764+0000 mgr.a (mgr.14388) 13007 : audit [DBG] from='client.283599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:14:59 smithi179 bash[23186]: audit 2024-09-21T03:14:58.130764+0000 mgr.a (mgr.14388) 13007 : audit [DBG] from='client.283599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:00.252 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:14:59 smithi049 bash[23528]: audit 2024-09-21T03:14:58.130764+0000 mgr.a (mgr.14388) 13007 : audit [DBG] from='client.283599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:00 smithi044 bash[22676]: cluster 2024-09-21T03:14:59.116600+0000 mgr.a (mgr.14388) 13008 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:00 smithi179 bash[23186]: cluster 2024-09-21T03:14:59.116600+0000 mgr.a (mgr.14388) 13008 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:00 smithi049 bash[23528]: cluster 2024-09-21T03:14:59.116600+0000 mgr.a (mgr.14388) 13008 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:02 smithi044 bash[22676]: cluster 2024-09-21T03:15:01.118224+0000 mgr.a (mgr.14388) 13009 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:02 smithi179 bash[23186]: cluster 2024-09-21T03:15:01.118224+0000 mgr.a (mgr.14388) 13009 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:02 smithi049 bash[23528]: cluster 2024-09-21T03:15:01.118224+0000 mgr.a (mgr.14388) 13009 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:03.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:04.360 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:04 smithi044 bash[22676]: cluster 2024-09-21T03:15:03.118998+0000 mgr.a (mgr.14388) 13010 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:04 smithi044 bash[22676]: audit 2024-09-21T03:15:03.913472+0000 mgr.a (mgr.14388) 13011 : audit [DBG] from='client.283677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:04 smithi179 bash[23186]: cluster 2024-09-21T03:15:03.118998+0000 mgr.a (mgr.14388) 13010 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:04 smithi179 bash[23186]: audit 2024-09-21T03:15:03.913472+0000 mgr.a (mgr.14388) 13011 : audit [DBG] from='client.283677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:04 smithi049 bash[23528]: cluster 2024-09-21T03:15:03.118998+0000 mgr.a (mgr.14388) 13010 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:04 smithi049 bash[23528]: audit 2024-09-21T03:15:03.913472+0000 mgr.a (mgr.14388) 13011 : audit [DBG] from='client.283677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:06 smithi044 bash[22676]: cluster 2024-09-21T03:15:05.121274+0000 mgr.a (mgr.14388) 13012 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:06 smithi044 bash[22676]: audit 2024-09-21T03:15:06.065655+0000 mon.a (mon.0) 10564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:06 smithi044 bash[22676]: audit 2024-09-21T03:15:06.074070+0000 mon.a (mon.0) 10565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:06 smithi044 bash[22676]: audit 2024-09-21T03:15:06.084890+0000 mon.a (mon.0) 10566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:06 smithi179 bash[23186]: cluster 2024-09-21T03:15:05.121274+0000 mgr.a (mgr.14388) 13012 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:06 smithi179 bash[23186]: audit 2024-09-21T03:15:06.065655+0000 mon.a (mon.0) 10564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:06 smithi179 bash[23186]: audit 2024-09-21T03:15:06.074070+0000 mon.a (mon.0) 10565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:06 smithi179 bash[23186]: audit 2024-09-21T03:15:06.084890+0000 mon.a (mon.0) 10566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:06 smithi049 bash[23528]: cluster 2024-09-21T03:15:05.121274+0000 mgr.a (mgr.14388) 13012 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:06 smithi049 bash[23528]: audit 2024-09-21T03:15:06.065655+0000 mon.a (mon.0) 10564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:06 smithi049 bash[23528]: audit 2024-09-21T03:15:06.074070+0000 mon.a (mon.0) 10565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:06 smithi049 bash[23528]: audit 2024-09-21T03:15:06.084890+0000 mon.a (mon.0) 10566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:09.154 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:08 smithi044 bash[22676]: cluster 2024-09-21T03:15:07.122163+0000 mgr.a (mgr.14388) 13013 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:15:09.214 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:08 smithi179 bash[23186]: cluster 2024-09-21T03:15:07.122163+0000 mgr.a (mgr.14388) 13013 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:15:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:08 smithi049 bash[23528]: cluster 2024-09-21T03:15:07.122163+0000 mgr.a (mgr.14388) 13013 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:15:09.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:09.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:09.363 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:10.159 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:10.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:10.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:10.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:10.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:10 smithi044 bash[22676]: cluster 2024-09-21T03:15:09.122691+0000 mgr.a (mgr.14388) 13014 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:10 smithi044 bash[22676]: audit 2024-09-21T03:15:09.700253+0000 mgr.a (mgr.14388) 13015 : audit [DBG] from='client.283752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:10 smithi179 bash[23186]: cluster 2024-09-21T03:15:09.122691+0000 mgr.a (mgr.14388) 13014 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:10 smithi179 bash[23186]: audit 2024-09-21T03:15:09.700253+0000 mgr.a (mgr.14388) 13015 : audit [DBG] from='client.283752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:10 smithi049 bash[23528]: cluster 2024-09-21T03:15:09.122691+0000 mgr.a (mgr.14388) 13014 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:10 smithi049 bash[23528]: audit 2024-09-21T03:15:09.700253+0000 mgr.a (mgr.14388) 13015 : audit [DBG] from='client.283752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:12 smithi044 bash[22676]: cluster 2024-09-21T03:15:11.125030+0000 mgr.a (mgr.14388) 13016 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:15:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:12 smithi179 bash[23186]: cluster 2024-09-21T03:15:11.125030+0000 mgr.a (mgr.14388) 13016 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:15:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:12 smithi049 bash[23528]: cluster 2024-09-21T03:15:11.125030+0000 mgr.a (mgr.14388) 13016 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:15:15.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:14 smithi044 bash[22676]: cluster 2024-09-21T03:15:13.125877+0000 mgr.a (mgr.14388) 13017 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:15:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:14 smithi179 bash[23186]: cluster 2024-09-21T03:15:13.125877+0000 mgr.a (mgr.14388) 13017 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:15:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:14 smithi049 bash[23528]: cluster 2024-09-21T03:15:13.125877+0000 mgr.a (mgr.14388) 13017 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:15:15.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:15.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:15.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:15.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:15.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:16 smithi044 bash[22676]: cluster 2024-09-21T03:15:15.127793+0000 mgr.a (mgr.14388) 13018 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:16 smithi044 bash[22676]: audit 2024-09-21T03:15:15.500915+0000 mgr.a (mgr.14388) 13019 : audit [DBG] from='client.283827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:16 smithi179 bash[23186]: cluster 2024-09-21T03:15:15.127793+0000 mgr.a (mgr.14388) 13018 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:16 smithi179 bash[23186]: audit 2024-09-21T03:15:15.500915+0000 mgr.a (mgr.14388) 13019 : audit [DBG] from='client.283827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:16 smithi049 bash[23528]: cluster 2024-09-21T03:15:15.127793+0000 mgr.a (mgr.14388) 13018 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:16 smithi049 bash[23528]: audit 2024-09-21T03:15:15.500915+0000 mgr.a (mgr.14388) 13019 : audit [DBG] from='client.283827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:18 smithi044 bash[22676]: cluster 2024-09-21T03:15:17.128705+0000 mgr.a (mgr.14388) 13020 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:15:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:18 smithi044 bash[22676]: audit 2024-09-21T03:15:18.844274+0000 mon.a (mon.0) 10567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:18 smithi044 bash[22676]: audit 2024-09-21T03:15:18.852508+0000 mon.a (mon.0) 10568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:18 smithi044 bash[22676]: audit 2024-09-21T03:15:18.863518+0000 mon.a (mon.0) 10569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:18 smithi044 bash[22676]: audit 2024-09-21T03:15:18.870713+0000 mon.a (mon.0) 10570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:18 smithi044 bash[22676]: audit 2024-09-21T03:15:18.879114+0000 mon.a (mon.0) 10571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:18 smithi044 bash[22676]: audit 2024-09-21T03:15:18.889185+0000 mon.a (mon.0) 10572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:18 smithi179 bash[23186]: cluster 2024-09-21T03:15:17.128705+0000 mgr.a (mgr.14388) 13020 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:15:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:18 smithi179 bash[23186]: audit 2024-09-21T03:15:18.844274+0000 mon.a (mon.0) 10567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:18 smithi179 bash[23186]: audit 2024-09-21T03:15:18.852508+0000 mon.a (mon.0) 10568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:18 smithi179 bash[23186]: audit 2024-09-21T03:15:18.863518+0000 mon.a (mon.0) 10569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:18 smithi179 bash[23186]: audit 2024-09-21T03:15:18.870713+0000 mon.a (mon.0) 10570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:18 smithi179 bash[23186]: audit 2024-09-21T03:15:18.879114+0000 mon.a (mon.0) 10571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:18 smithi179 bash[23186]: audit 2024-09-21T03:15:18.889185+0000 mon.a (mon.0) 10572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:18 smithi049 bash[23528]: cluster 2024-09-21T03:15:17.128705+0000 mgr.a (mgr.14388) 13020 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:18 smithi049 bash[23528]: audit 2024-09-21T03:15:18.844274+0000 mon.a (mon.0) 10567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:18 smithi049 bash[23528]: audit 2024-09-21T03:15:18.852508+0000 mon.a (mon.0) 10568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:18 smithi049 bash[23528]: audit 2024-09-21T03:15:18.863518+0000 mon.a (mon.0) 10569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:18 smithi049 bash[23528]: audit 2024-09-21T03:15:18.870713+0000 mon.a (mon.0) 10570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:18 smithi049 bash[23528]: audit 2024-09-21T03:15:18.879114+0000 mon.a (mon.0) 10571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:18 smithi049 bash[23528]: audit 2024-09-21T03:15:18.889185+0000 mon.a (mon.0) 10572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:20.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:20.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:20 smithi044 bash[22676]: cluster 2024-09-21T03:15:19.129538+0000 mgr.a (mgr.14388) 13021 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:15:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:20 smithi179 bash[23186]: cluster 2024-09-21T03:15:19.129538+0000 mgr.a (mgr.14388) 13021 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:15:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:20 smithi049 bash[23528]: cluster 2024-09-21T03:15:19.129538+0000 mgr.a (mgr.14388) 13021 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:15:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:21.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:21.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:21.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:21.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:22 smithi044 bash[22676]: cluster 2024-09-21T03:15:21.131148+0000 mgr.a (mgr.14388) 13022 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:22 smithi044 bash[22676]: audit 2024-09-21T03:15:21.293206+0000 mgr.a (mgr.14388) 13023 : audit [DBG] from='client.283902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:22 smithi179 bash[23186]: cluster 2024-09-21T03:15:21.131148+0000 mgr.a (mgr.14388) 13022 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:22 smithi179 bash[23186]: audit 2024-09-21T03:15:21.293206+0000 mgr.a (mgr.14388) 13023 : audit [DBG] from='client.283902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:22 smithi049 bash[23528]: cluster 2024-09-21T03:15:21.131148+0000 mgr.a (mgr.14388) 13022 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:22 smithi049 bash[23528]: audit 2024-09-21T03:15:21.293206+0000 mgr.a (mgr.14388) 13023 : audit [DBG] from='client.283902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:24 smithi044 bash[22676]: cluster 2024-09-21T03:15:23.132078+0000 mgr.a (mgr.14388) 13024 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:15:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:24 smithi179 bash[23186]: cluster 2024-09-21T03:15:23.132078+0000 mgr.a (mgr.14388) 13024 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:15:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:24 smithi049 bash[23528]: cluster 2024-09-21T03:15:23.132078+0000 mgr.a (mgr.14388) 13024 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:15:26.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:26.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:26.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:26 smithi044 bash[22676]: cluster 2024-09-21T03:15:25.134309+0000 mgr.a (mgr.14388) 13025 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:15:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:26 smithi044 bash[22676]: audit 2024-09-21T03:15:26.300371+0000 mon.a (mon.0) 10573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:26 smithi044 bash[22676]: audit 2024-09-21T03:15:26.309698+0000 mon.a (mon.0) 10574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:26 smithi044 bash[22676]: audit 2024-09-21T03:15:26.320143+0000 mon.a (mon.0) 10575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:26 smithi179 bash[23186]: cluster 2024-09-21T03:15:25.134309+0000 mgr.a (mgr.14388) 13025 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:15:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:26 smithi179 bash[23186]: audit 2024-09-21T03:15:26.300371+0000 mon.a (mon.0) 10573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:26 smithi179 bash[23186]: audit 2024-09-21T03:15:26.309698+0000 mon.a (mon.0) 10574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:26 smithi179 bash[23186]: audit 2024-09-21T03:15:26.320143+0000 mon.a (mon.0) 10575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:26 smithi049 bash[23528]: cluster 2024-09-21T03:15:25.134309+0000 mgr.a (mgr.14388) 13025 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:15:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:26 smithi049 bash[23528]: audit 2024-09-21T03:15:26.300371+0000 mon.a (mon.0) 10573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:26 smithi049 bash[23528]: audit 2024-09-21T03:15:26.309698+0000 mon.a (mon.0) 10574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:26 smithi049 bash[23528]: audit 2024-09-21T03:15:26.320143+0000 mon.a (mon.0) 10575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:27.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:27.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:27.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:27.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:29.210 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:28 smithi044 bash[22676]: audit 2024-09-21T03:15:27.096028+0000 mgr.a (mgr.14388) 13026 : audit [DBG] from='client.283977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:29.211 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:28 smithi044 bash[22676]: cluster 2024-09-21T03:15:27.135375+0000 mgr.a (mgr.14388) 13027 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:28 smithi179 bash[23186]: audit 2024-09-21T03:15:27.096028+0000 mgr.a (mgr.14388) 13026 : audit [DBG] from='client.283977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:28 smithi179 bash[23186]: cluster 2024-09-21T03:15:27.135375+0000 mgr.a (mgr.14388) 13027 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:28 smithi049 bash[23528]: audit 2024-09-21T03:15:27.096028+0000 mgr.a (mgr.14388) 13026 : audit [DBG] from='client.283977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:28 smithi049 bash[23528]: cluster 2024-09-21T03:15:27.135375+0000 mgr.a (mgr.14388) 13027 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:30 smithi044 bash[22676]: cluster 2024-09-21T03:15:29.136341+0000 mgr.a (mgr.14388) 13028 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:30 smithi179 bash[23186]: cluster 2024-09-21T03:15:29.136341+0000 mgr.a (mgr.14388) 13028 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:30 smithi049 bash[23528]: cluster 2024-09-21T03:15:29.136341+0000 mgr.a (mgr.14388) 13028 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:32.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:32.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:32.553 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:32 smithi044 bash[22676]: cluster 2024-09-21T03:15:31.137782+0000 mgr.a (mgr.14388) 13029 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:32 smithi179 bash[23186]: cluster 2024-09-21T03:15:31.137782+0000 mgr.a (mgr.14388) 13029 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:32 smithi049 bash[23528]: cluster 2024-09-21T03:15:31.137782+0000 mgr.a (mgr.14388) 13029 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:33.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:33 smithi044 bash[22676]: audit 2024-09-21T03:15:32.891826+0000 mgr.a (mgr.14388) 13030 : audit [DBG] from='client.284055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:33 smithi179 bash[23186]: audit 2024-09-21T03:15:32.891826+0000 mgr.a (mgr.14388) 13030 : audit [DBG] from='client.284055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:33 smithi049 bash[23528]: audit 2024-09-21T03:15:32.891826+0000 mgr.a (mgr.14388) 13030 : audit [DBG] from='client.284055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:34 smithi044 bash[22676]: cluster 2024-09-21T03:15:33.140183+0000 mgr.a (mgr.14388) 13031 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:34 smithi179 bash[23186]: cluster 2024-09-21T03:15:33.140183+0000 mgr.a (mgr.14388) 13031 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:34 smithi049 bash[23528]: cluster 2024-09-21T03:15:33.140183+0000 mgr.a (mgr.14388) 13031 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:36 smithi044 bash[22676]: cluster 2024-09-21T03:15:35.142553+0000 mgr.a (mgr.14388) 13032 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:36 smithi179 bash[23186]: cluster 2024-09-21T03:15:35.142553+0000 mgr.a (mgr.14388) 13032 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:36 smithi049 bash[23528]: cluster 2024-09-21T03:15:35.142553+0000 mgr.a (mgr.14388) 13032 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:38.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:38.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:38.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:39.151 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:39.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:39.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:39.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:39.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:39.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:38 smithi044 bash[22676]: cluster 2024-09-21T03:15:37.143354+0000 mgr.a (mgr.14388) 13033 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:38 smithi179 bash[23186]: cluster 2024-09-21T03:15:37.143354+0000 mgr.a (mgr.14388) 13033 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:38 smithi049 bash[23528]: cluster 2024-09-21T03:15:37.143354+0000 mgr.a (mgr.14388) 13033 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:39 smithi179 bash[23186]: audit 2024-09-21T03:15:38.694662+0000 mgr.a (mgr.14388) 13034 : audit [DBG] from='client.284130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:39 smithi179 bash[23186]: audit 2024-09-21T03:15:38.992986+0000 mon.a (mon.0) 10576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:39 smithi179 bash[23186]: audit 2024-09-21T03:15:38.998188+0000 mon.a (mon.0) 10577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:39 smithi179 bash[23186]: audit 2024-09-21T03:15:39.003838+0000 mon.a (mon.0) 10578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:39 smithi179 bash[23186]: audit 2024-09-21T03:15:39.066991+0000 mon.a (mon.0) 10579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:39 smithi179 bash[23186]: audit 2024-09-21T03:15:39.072283+0000 mon.a (mon.0) 10580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:39 smithi179 bash[23186]: audit 2024-09-21T03:15:39.079646+0000 mon.a (mon.0) 10581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:39 smithi049 bash[23528]: audit 2024-09-21T03:15:38.694662+0000 mgr.a (mgr.14388) 13034 : audit [DBG] from='client.284130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:39 smithi049 bash[23528]: audit 2024-09-21T03:15:38.992986+0000 mon.a (mon.0) 10576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:39 smithi049 bash[23528]: audit 2024-09-21T03:15:38.998188+0000 mon.a (mon.0) 10577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:39 smithi049 bash[23528]: audit 2024-09-21T03:15:39.003838+0000 mon.a (mon.0) 10578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:39 smithi049 bash[23528]: audit 2024-09-21T03:15:39.066991+0000 mon.a (mon.0) 10579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:39 smithi049 bash[23528]: audit 2024-09-21T03:15:39.072283+0000 mon.a (mon.0) 10580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:39 smithi049 bash[23528]: audit 2024-09-21T03:15:39.079646+0000 mon.a (mon.0) 10581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:39 smithi044 bash[22676]: audit 2024-09-21T03:15:38.694662+0000 mgr.a (mgr.14388) 13034 : audit [DBG] from='client.284130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:39 smithi044 bash[22676]: audit 2024-09-21T03:15:38.992986+0000 mon.a (mon.0) 10576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:39 smithi044 bash[22676]: audit 2024-09-21T03:15:38.998188+0000 mon.a (mon.0) 10577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:39 smithi044 bash[22676]: audit 2024-09-21T03:15:39.003838+0000 mon.a (mon.0) 10578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:39 smithi044 bash[22676]: audit 2024-09-21T03:15:39.066991+0000 mon.a (mon.0) 10579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:39 smithi044 bash[22676]: audit 2024-09-21T03:15:39.072283+0000 mon.a (mon.0) 10580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:39 smithi044 bash[22676]: audit 2024-09-21T03:15:39.079646+0000 mon.a (mon.0) 10581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:41 smithi049 bash[23528]: cluster 2024-09-21T03:15:39.143918+0000 mgr.a (mgr.14388) 13035 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:41 smithi044 bash[22676]: cluster 2024-09-21T03:15:39.143918+0000 mgr.a (mgr.14388) 13035 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:41 smithi179 bash[23186]: cluster 2024-09-21T03:15:39.143918+0000 mgr.a (mgr.14388) 13035 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:43 smithi049 bash[23528]: cluster 2024-09-21T03:15:41.146151+0000 mgr.a (mgr.14388) 13036 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:43 smithi044 bash[22676]: cluster 2024-09-21T03:15:41.146151+0000 mgr.a (mgr.14388) 13036 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:43 smithi179 bash[23186]: cluster 2024-09-21T03:15:41.146151+0000 mgr.a (mgr.14388) 13036 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:44.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:44.154 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:44.154 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:44.907 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:44.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:44.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:44.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:44.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:45 smithi049 bash[23528]: cluster 2024-09-21T03:15:43.147071+0000 mgr.a (mgr.14388) 13037 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:45 smithi049 bash[23528]: audit 2024-09-21T03:15:44.543378+0000 mon.a (mon.0) 10582 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:15:45.486 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:45 smithi044 bash[22676]: cluster 2024-09-21T03:15:43.147071+0000 mgr.a (mgr.14388) 13037 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:45 smithi044 bash[22676]: audit 2024-09-21T03:15:44.543378+0000 mon.a (mon.0) 10582 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:15:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:45 smithi179 bash[23186]: cluster 2024-09-21T03:15:43.147071+0000 mgr.a (mgr.14388) 13037 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:45 smithi179 bash[23186]: audit 2024-09-21T03:15:44.543378+0000 mon.a (mon.0) 10582 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:15:46.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:15:45 smithi044 bash[22930]: debug 2024-09-21T03:15:45.905+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:15:46.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:15:45 smithi044 bash[22930]: debug 2024-09-21T03:15:45.905+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:15:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:46 smithi044 bash[22676]: audit 2024-09-21T03:15:44.486173+0000 mgr.a (mgr.14388) 13038 : audit [DBG] from='client.284208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:46 smithi044 bash[22676]: audit 2024-09-21T03:15:45.125856+0000 mon.a (mon.0) 10583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:46 smithi044 bash[22676]: audit 2024-09-21T03:15:45.134031+0000 mon.a (mon.0) 10584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:46 smithi044 bash[22676]: audit 2024-09-21T03:15:45.136933+0000 mon.a (mon.0) 10585 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:15:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:46 smithi044 bash[22676]: audit 2024-09-21T03:15:45.138966+0000 mon.a (mon.0) 10586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:15:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:46 smithi044 bash[22676]: audit 2024-09-21T03:15:45.149123+0000 mon.a (mon.0) 10587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:46 smithi044 bash[22676]: audit 2024-09-21T03:15:45.155152+0000 mon.a (mon.0) 10588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:15:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:46 smithi049 bash[23528]: audit 2024-09-21T03:15:44.486173+0000 mgr.a (mgr.14388) 13038 : audit [DBG] from='client.284208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:46 smithi049 bash[23528]: audit 2024-09-21T03:15:45.125856+0000 mon.a (mon.0) 10583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:46 smithi049 bash[23528]: audit 2024-09-21T03:15:45.134031+0000 mon.a (mon.0) 10584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:46 smithi049 bash[23528]: audit 2024-09-21T03:15:45.136933+0000 mon.a (mon.0) 10585 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:15:46.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:46 smithi049 bash[23528]: audit 2024-09-21T03:15:45.138966+0000 mon.a (mon.0) 10586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:15:46.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:46 smithi049 bash[23528]: audit 2024-09-21T03:15:45.149123+0000 mon.a (mon.0) 10587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:46 smithi049 bash[23528]: audit 2024-09-21T03:15:45.155152+0000 mon.a (mon.0) 10588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:15:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:46 smithi179 bash[23186]: audit 2024-09-21T03:15:44.486173+0000 mgr.a (mgr.14388) 13038 : audit [DBG] from='client.284208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:46 smithi179 bash[23186]: audit 2024-09-21T03:15:45.125856+0000 mon.a (mon.0) 10583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:46 smithi179 bash[23186]: audit 2024-09-21T03:15:45.134031+0000 mon.a (mon.0) 10584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:46 smithi179 bash[23186]: audit 2024-09-21T03:15:45.136933+0000 mon.a (mon.0) 10585 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:15:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:46 smithi179 bash[23186]: audit 2024-09-21T03:15:45.138966+0000 mon.a (mon.0) 10586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:15:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:46 smithi179 bash[23186]: audit 2024-09-21T03:15:45.149123+0000 mon.a (mon.0) 10587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:46 smithi179 bash[23186]: audit 2024-09-21T03:15:45.155152+0000 mon.a (mon.0) 10588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:15:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:47 smithi049 bash[23528]: cluster 2024-09-21T03:15:45.149506+0000 mgr.a (mgr.14388) 13039 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:47 smithi049 bash[23528]: audit 2024-09-21T03:15:45.157571+0000 mgr.a (mgr.14388) 13040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:15:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:47 smithi049 bash[23528]: audit 2024-09-21T03:15:45.911010+0000 mgr.a (mgr.14388) 13041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:15:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:47 smithi049 bash[23528]: cephadm 2024-09-21T03:15:45.912230+0000 mgr.a (mgr.14388) 13042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:15:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:47 smithi049 bash[23528]: audit 2024-09-21T03:15:46.534233+0000 mon.a (mon.0) 10589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:47 smithi049 bash[23528]: audit 2024-09-21T03:15:46.542903+0000 mon.a (mon.0) 10590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:47 smithi049 bash[23528]: audit 2024-09-21T03:15:46.553673+0000 mon.a (mon.0) 10591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:47 smithi044 bash[22676]: cluster 2024-09-21T03:15:45.149506+0000 mgr.a (mgr.14388) 13039 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:47 smithi044 bash[22676]: audit 2024-09-21T03:15:45.157571+0000 mgr.a (mgr.14388) 13040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:15:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:47 smithi044 bash[22676]: audit 2024-09-21T03:15:45.911010+0000 mgr.a (mgr.14388) 13041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:15:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:47 smithi044 bash[22676]: cephadm 2024-09-21T03:15:45.912230+0000 mgr.a (mgr.14388) 13042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:15:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:47 smithi044 bash[22676]: audit 2024-09-21T03:15:46.534233+0000 mon.a (mon.0) 10589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:47 smithi044 bash[22676]: audit 2024-09-21T03:15:46.542903+0000 mon.a (mon.0) 10590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:47 smithi044 bash[22676]: audit 2024-09-21T03:15:46.553673+0000 mon.a (mon.0) 10591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:47 smithi179 bash[23186]: cluster 2024-09-21T03:15:45.149506+0000 mgr.a (mgr.14388) 13039 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:15:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:47 smithi179 bash[23186]: audit 2024-09-21T03:15:45.157571+0000 mgr.a (mgr.14388) 13040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:15:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:47 smithi179 bash[23186]: audit 2024-09-21T03:15:45.911010+0000 mgr.a (mgr.14388) 13041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:15:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:47 smithi179 bash[23186]: cephadm 2024-09-21T03:15:45.912230+0000 mgr.a (mgr.14388) 13042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:15:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:47 smithi179 bash[23186]: audit 2024-09-21T03:15:46.534233+0000 mon.a (mon.0) 10589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:47 smithi179 bash[23186]: audit 2024-09-21T03:15:46.542903+0000 mon.a (mon.0) 10590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:47 smithi179 bash[23186]: audit 2024-09-21T03:15:46.553673+0000 mon.a (mon.0) 10591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:15:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:49 smithi049 bash[23528]: cluster 2024-09-21T03:15:47.150459+0000 mgr.a (mgr.14388) 13043 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:49.422 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:49 smithi044 bash[22676]: cluster 2024-09-21T03:15:47.150459+0000 mgr.a (mgr.14388) 13043 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:49 smithi179 bash[23186]: cluster 2024-09-21T03:15:47.150459+0000 mgr.a (mgr.14388) 13043 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:49.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:49.909 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:49.909 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:50.662 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:51.299 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:51 smithi044 bash[22676]: cluster 2024-09-21T03:15:49.151069+0000 mgr.a (mgr.14388) 13044 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:51 smithi049 bash[23528]: cluster 2024-09-21T03:15:49.151069+0000 mgr.a (mgr.14388) 13044 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:51.373 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:51 smithi179 bash[23186]: cluster 2024-09-21T03:15:49.151069+0000 mgr.a (mgr.14388) 13044 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 180 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:15:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:52 smithi044 bash[22676]: audit 2024-09-21T03:15:50.244158+0000 mgr.a (mgr.14388) 13045 : audit [DBG] from='client.284388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:52 smithi049 bash[23528]: audit 2024-09-21T03:15:50.244158+0000 mgr.a (mgr.14388) 13045 : audit [DBG] from='client.284388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:52 smithi179 bash[23186]: audit 2024-09-21T03:15:50.244158+0000 mgr.a (mgr.14388) 13045 : audit [DBG] from='client.284388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:53 smithi049 bash[23528]: cluster 2024-09-21T03:15:51.153910+0000 mgr.a (mgr.14388) 13046 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:15:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:53 smithi044 bash[22676]: cluster 2024-09-21T03:15:51.153910+0000 mgr.a (mgr.14388) 13046 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:15:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:53 smithi179 bash[23186]: cluster 2024-09-21T03:15:51.153910+0000 mgr.a (mgr.14388) 13046 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:15:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:55 smithi049 bash[23528]: cluster 2024-09-21T03:15:53.154718+0000 mgr.a (mgr.14388) 13047 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:15:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:55 smithi044 bash[22676]: cluster 2024-09-21T03:15:53.154718+0000 mgr.a (mgr.14388) 13047 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:15:55.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:55 smithi179 bash[23186]: cluster 2024-09-21T03:15:53.154718+0000 mgr.a (mgr.14388) 13047 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:15:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:15:55.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:15:55.665 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:15:56.430 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:15:56.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:15:56.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:15:56.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:15:56.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:15:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:57 smithi049 bash[23528]: cluster 2024-09-21T03:15:55.156712+0000 mgr.a (mgr.14388) 13048 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:15:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:57 smithi049 bash[23528]: audit 2024-09-21T03:15:55.996904+0000 mgr.a (mgr.14388) 13049 : audit [DBG] from='client.284466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:57 smithi044 bash[22676]: cluster 2024-09-21T03:15:55.156712+0000 mgr.a (mgr.14388) 13048 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:15:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:57 smithi044 bash[22676]: audit 2024-09-21T03:15:55.996904+0000 mgr.a (mgr.14388) 13049 : audit [DBG] from='client.284466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:57 smithi179 bash[23186]: cluster 2024-09-21T03:15:55.156712+0000 mgr.a (mgr.14388) 13048 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:15:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:57 smithi179 bash[23186]: audit 2024-09-21T03:15:55.996904+0000 mgr.a (mgr.14388) 13049 : audit [DBG] from='client.284466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:15:59.313 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:15:59 smithi179 bash[23186]: cluster 2024-09-21T03:15:57.157761+0000 mgr.a (mgr.14388) 13050 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:15:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:15:59 smithi044 bash[22676]: cluster 2024-09-21T03:15:57.157761+0000 mgr.a (mgr.14388) 13050 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:15:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:15:59 smithi049 bash[23528]: cluster 2024-09-21T03:15:57.157761+0000 mgr.a (mgr.14388) 13050 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:16:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:00 smithi044 bash[22676]: cluster 2024-09-21T03:15:59.158622+0000 mgr.a (mgr.14388) 13051 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:16:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:00 smithi044 bash[22676]: audit 2024-09-21T03:15:59.197492+0000 mon.a (mon.0) 10592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:00 smithi044 bash[22676]: audit 2024-09-21T03:15:59.205574+0000 mon.a (mon.0) 10593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:00 smithi044 bash[22676]: audit 2024-09-21T03:15:59.215761+0000 mon.a (mon.0) 10594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:00 smithi044 bash[22676]: audit 2024-09-21T03:15:59.291783+0000 mon.a (mon.0) 10595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:00 smithi044 bash[22676]: audit 2024-09-21T03:15:59.300433+0000 mon.a (mon.0) 10596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:00 smithi044 bash[22676]: audit 2024-09-21T03:15:59.310653+0000 mon.a (mon.0) 10597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:00 smithi179 bash[23186]: cluster 2024-09-21T03:15:59.158622+0000 mgr.a (mgr.14388) 13051 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:16:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:00 smithi179 bash[23186]: audit 2024-09-21T03:15:59.197492+0000 mon.a (mon.0) 10592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:00 smithi179 bash[23186]: audit 2024-09-21T03:15:59.205574+0000 mon.a (mon.0) 10593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:00 smithi179 bash[23186]: audit 2024-09-21T03:15:59.215761+0000 mon.a (mon.0) 10594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:00 smithi179 bash[23186]: audit 2024-09-21T03:15:59.291783+0000 mon.a (mon.0) 10595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:00 smithi179 bash[23186]: audit 2024-09-21T03:15:59.300433+0000 mon.a (mon.0) 10596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:00 smithi179 bash[23186]: audit 2024-09-21T03:15:59.310653+0000 mon.a (mon.0) 10597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:00 smithi049 bash[23528]: cluster 2024-09-21T03:15:59.158622+0000 mgr.a (mgr.14388) 13051 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-21T03:16:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:00 smithi049 bash[23528]: audit 2024-09-21T03:15:59.197492+0000 mon.a (mon.0) 10592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:00 smithi049 bash[23528]: audit 2024-09-21T03:15:59.205574+0000 mon.a (mon.0) 10593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:00 smithi049 bash[23528]: audit 2024-09-21T03:15:59.215761+0000 mon.a (mon.0) 10594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:00 smithi049 bash[23528]: audit 2024-09-21T03:15:59.291783+0000 mon.a (mon.0) 10595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:00 smithi049 bash[23528]: audit 2024-09-21T03:15:59.300433+0000 mon.a (mon.0) 10596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:00 smithi049 bash[23528]: audit 2024-09-21T03:15:59.310653+0000 mon.a (mon.0) 10597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:01.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:01.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:01.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:02.226 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:02 smithi044 bash[22676]: cluster 2024-09-21T03:16:01.160865+0000 mgr.a (mgr.14388) 13052 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:16:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:02 smithi044 bash[22676]: audit 2024-09-21T03:16:01.764440+0000 mgr.a (mgr.14388) 13053 : audit [DBG] from='client.284544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:02 smithi179 bash[23186]: cluster 2024-09-21T03:16:01.160865+0000 mgr.a (mgr.14388) 13052 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:16:02.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:02 smithi179 bash[23186]: audit 2024-09-21T03:16:01.764440+0000 mgr.a (mgr.14388) 13053 : audit [DBG] from='client.284544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:02 smithi049 bash[23528]: cluster 2024-09-21T03:16:01.160865+0000 mgr.a (mgr.14388) 13052 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T03:16:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:02 smithi049 bash[23528]: audit 2024-09-21T03:16:01.764440+0000 mgr.a (mgr.14388) 13053 : audit [DBG] from='client.284544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:04 smithi044 bash[22676]: cluster 2024-09-21T03:16:03.161891+0000 mgr.a (mgr.14388) 13054 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:04 smithi179 bash[23186]: cluster 2024-09-21T03:16:03.161891+0000 mgr.a (mgr.14388) 13054 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:04 smithi049 bash[23528]: cluster 2024-09-21T03:16:03.161891+0000 mgr.a (mgr.14388) 13054 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:06 smithi044 bash[22676]: cluster 2024-09-21T03:16:05.164161+0000 mgr.a (mgr.14388) 13055 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:06 smithi179 bash[23186]: cluster 2024-09-21T03:16:05.164161+0000 mgr.a (mgr.14388) 13055 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:06 smithi049 bash[23528]: cluster 2024-09-21T03:16:05.164161+0000 mgr.a (mgr.14388) 13055 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:07 smithi044 bash[22676]: audit 2024-09-21T03:16:06.737093+0000 mon.a (mon.0) 10598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:07 smithi044 bash[22676]: audit 2024-09-21T03:16:06.746062+0000 mon.a (mon.0) 10599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:07 smithi044 bash[22676]: audit 2024-09-21T03:16:06.757045+0000 mon.a (mon.0) 10600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:07 smithi179 bash[23186]: audit 2024-09-21T03:16:06.737093+0000 mon.a (mon.0) 10598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:07 smithi179 bash[23186]: audit 2024-09-21T03:16:06.746062+0000 mon.a (mon.0) 10599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:08.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:07 smithi179 bash[23186]: audit 2024-09-21T03:16:06.757045+0000 mon.a (mon.0) 10600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:07 smithi049 bash[23528]: audit 2024-09-21T03:16:06.737093+0000 mon.a (mon.0) 10598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:07 smithi049 bash[23528]: audit 2024-09-21T03:16:06.746062+0000 mon.a (mon.0) 10599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:07 smithi049 bash[23528]: audit 2024-09-21T03:16:06.757045+0000 mon.a (mon.0) 10600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:08.060 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:08.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:08.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:08.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:08.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:08 smithi044 bash[22676]: cluster 2024-09-21T03:16:07.164963+0000 mgr.a (mgr.14388) 13056 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:08 smithi044 bash[22676]: audit 2024-09-21T03:16:07.562706+0000 mgr.a (mgr.14388) 13057 : audit [DBG] from='client.284622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:09.046 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:08 smithi179 bash[23186]: cluster 2024-09-21T03:16:07.164963+0000 mgr.a (mgr.14388) 13056 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:09.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:08 smithi179 bash[23186]: audit 2024-09-21T03:16:07.562706+0000 mgr.a (mgr.14388) 13057 : audit [DBG] from='client.284622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:08 smithi049 bash[23528]: cluster 2024-09-21T03:16:07.164963+0000 mgr.a (mgr.14388) 13056 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:08 smithi049 bash[23528]: audit 2024-09-21T03:16:07.562706+0000 mgr.a (mgr.14388) 13057 : audit [DBG] from='client.284622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:10 smithi044 bash[22676]: cluster 2024-09-21T03:16:09.165962+0000 mgr.a (mgr.14388) 13058 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:10 smithi179 bash[23186]: cluster 2024-09-21T03:16:09.165962+0000 mgr.a (mgr.14388) 13058 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:10 smithi049 bash[23528]: cluster 2024-09-21T03:16:09.165962+0000 mgr.a (mgr.14388) 13058 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:12 smithi049 bash[23528]: cluster 2024-09-21T03:16:11.168312+0000 mgr.a (mgr.14388) 13059 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:13.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:12 smithi044 bash[22676]: cluster 2024-09-21T03:16:11.168312+0000 mgr.a (mgr.14388) 13059 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:12 smithi179 bash[23186]: cluster 2024-09-21T03:16:11.168312+0000 mgr.a (mgr.14388) 13059 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:13.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:13.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:13.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:13.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:13.846 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:14 smithi049 bash[23528]: cluster 2024-09-21T03:16:13.168972+0000 mgr.a (mgr.14388) 13060 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:14 smithi049 bash[23528]: audit 2024-09-21T03:16:13.399813+0000 mgr.a (mgr.14388) 13061 : audit [DBG] from='client.284697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:14 smithi044 bash[22676]: cluster 2024-09-21T03:16:13.168972+0000 mgr.a (mgr.14388) 13060 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:14 smithi044 bash[22676]: audit 2024-09-21T03:16:13.399813+0000 mgr.a (mgr.14388) 13061 : audit [DBG] from='client.284697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:14 smithi179 bash[23186]: cluster 2024-09-21T03:16:13.168972+0000 mgr.a (mgr.14388) 13060 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:14 smithi179 bash[23186]: audit 2024-09-21T03:16:13.399813+0000 mgr.a (mgr.14388) 13061 : audit [DBG] from='client.284697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:16 smithi049 bash[23528]: cluster 2024-09-21T03:16:15.171317+0000 mgr.a (mgr.14388) 13062 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:16 smithi044 bash[22676]: cluster 2024-09-21T03:16:15.171317+0000 mgr.a (mgr.14388) 13062 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:16 smithi179 bash[23186]: cluster 2024-09-21T03:16:15.171317+0000 mgr.a (mgr.14388) 13062 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:18 smithi049 bash[23528]: cluster 2024-09-21T03:16:17.172115+0000 mgr.a (mgr.14388) 13063 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:18 smithi044 bash[22676]: cluster 2024-09-21T03:16:17.172115+0000 mgr.a (mgr.14388) 13063 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:18 smithi179 bash[23186]: cluster 2024-09-21T03:16:17.172115+0000 mgr.a (mgr.14388) 13063 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:19.640 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:19.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: cluster 2024-09-21T03:16:19.172873+0000 mgr.a (mgr.14388) 13064 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: audit 2024-09-21T03:16:19.188104+0000 mgr.a (mgr.14388) 13065 : audit [DBG] from='client.284775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: audit 2024-09-21T03:16:19.361379+0000 mon.a (mon.0) 10601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: audit 2024-09-21T03:16:19.367651+0000 mon.a (mon.0) 10602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: audit 2024-09-21T03:16:19.373042+0000 mon.a (mon.0) 10603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: audit 2024-09-21T03:16:19.508256+0000 mon.a (mon.0) 10604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: audit 2024-09-21T03:16:19.514725+0000 mon.a (mon.0) 10605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:20 smithi044 bash[22676]: audit 2024-09-21T03:16:19.520471+0000 mon.a (mon.0) 10606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: cluster 2024-09-21T03:16:19.172873+0000 mgr.a (mgr.14388) 13064 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: audit 2024-09-21T03:16:19.188104+0000 mgr.a (mgr.14388) 13065 : audit [DBG] from='client.284775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: audit 2024-09-21T03:16:19.361379+0000 mon.a (mon.0) 10601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: audit 2024-09-21T03:16:19.367651+0000 mon.a (mon.0) 10602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: audit 2024-09-21T03:16:19.373042+0000 mon.a (mon.0) 10603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: audit 2024-09-21T03:16:19.508256+0000 mon.a (mon.0) 10604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: audit 2024-09-21T03:16:19.514725+0000 mon.a (mon.0) 10605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:20 smithi179 bash[23186]: audit 2024-09-21T03:16:19.520471+0000 mon.a (mon.0) 10606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: cluster 2024-09-21T03:16:19.172873+0000 mgr.a (mgr.14388) 13064 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T03:16:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: audit 2024-09-21T03:16:19.188104+0000 mgr.a (mgr.14388) 13065 : audit [DBG] from='client.284775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: audit 2024-09-21T03:16:19.361379+0000 mon.a (mon.0) 10601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: audit 2024-09-21T03:16:19.367651+0000 mon.a (mon.0) 10602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: audit 2024-09-21T03:16:19.373042+0000 mon.a (mon.0) 10603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: audit 2024-09-21T03:16:19.508256+0000 mon.a (mon.0) 10604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: audit 2024-09-21T03:16:19.514725+0000 mon.a (mon.0) 10605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:20 smithi049 bash[23528]: audit 2024-09-21T03:16:19.520471+0000 mon.a (mon.0) 10606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:22 smithi044 bash[22676]: cluster 2024-09-21T03:16:21.175327+0000 mgr.a (mgr.14388) 13066 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:22 smithi179 bash[23186]: cluster 2024-09-21T03:16:21.175327+0000 mgr.a (mgr.14388) 13066 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:22 smithi049 bash[23528]: cluster 2024-09-21T03:16:21.175327+0000 mgr.a (mgr.14388) 13066 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T03:16:24.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:24.642 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:24.642 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:24.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:24 smithi044 bash[22676]: cluster 2024-09-21T03:16:23.176125+0000 mgr.a (mgr.14388) 13067 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:24 smithi179 bash[23186]: cluster 2024-09-21T03:16:23.176125+0000 mgr.a (mgr.14388) 13067 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:24 smithi049 bash[23528]: cluster 2024-09-21T03:16:23.176125+0000 mgr.a (mgr.14388) 13067 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:25.373 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:25 smithi044 bash[22676]: audit 2024-09-21T03:16:24.954024+0000 mgr.a (mgr.14388) 13068 : audit [DBG] from='client.284853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:25 smithi179 bash[23186]: audit 2024-09-21T03:16:24.954024+0000 mgr.a (mgr.14388) 13068 : audit [DBG] from='client.284853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:25 smithi049 bash[23528]: audit 2024-09-21T03:16:24.954024+0000 mgr.a (mgr.14388) 13068 : audit [DBG] from='client.284853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:26 smithi044 bash[22676]: cluster 2024-09-21T03:16:25.179868+0000 mgr.a (mgr.14388) 13069 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:26 smithi179 bash[23186]: cluster 2024-09-21T03:16:25.179868+0000 mgr.a (mgr.14388) 13069 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:26 smithi049 bash[23528]: cluster 2024-09-21T03:16:25.179868+0000 mgr.a (mgr.14388) 13069 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:27 smithi044 bash[22676]: audit 2024-09-21T03:16:26.970995+0000 mon.a (mon.0) 10607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:27 smithi044 bash[22676]: audit 2024-09-21T03:16:26.980673+0000 mon.a (mon.0) 10608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:27 smithi044 bash[22676]: audit 2024-09-21T03:16:26.993110+0000 mon.a (mon.0) 10609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:27 smithi179 bash[23186]: audit 2024-09-21T03:16:26.970995+0000 mon.a (mon.0) 10607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:27 smithi179 bash[23186]: audit 2024-09-21T03:16:26.980673+0000 mon.a (mon.0) 10608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:27 smithi179 bash[23186]: audit 2024-09-21T03:16:26.993110+0000 mon.a (mon.0) 10609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:27 smithi049 bash[23528]: audit 2024-09-21T03:16:26.970995+0000 mon.a (mon.0) 10607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:27 smithi049 bash[23528]: audit 2024-09-21T03:16:26.980673+0000 mon.a (mon.0) 10608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:27 smithi049 bash[23528]: audit 2024-09-21T03:16:26.993110+0000 mon.a (mon.0) 10609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:28 smithi179 bash[23186]: cluster 2024-09-21T03:16:27.180505+0000 mgr.a (mgr.14388) 13070 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:28 smithi049 bash[23528]: cluster 2024-09-21T03:16:27.180505+0000 mgr.a (mgr.14388) 13070 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:28 smithi044 bash[22676]: cluster 2024-09-21T03:16:27.180505+0000 mgr.a (mgr.14388) 13070 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:30.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:30.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:30.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:31.131 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:31.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:30 smithi044 bash[22676]: cluster 2024-09-21T03:16:29.181317+0000 mgr.a (mgr.14388) 13071 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:31 smithi179 bash[23186]: cluster 2024-09-21T03:16:29.181317+0000 mgr.a (mgr.14388) 13071 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:31 smithi049 bash[23528]: cluster 2024-09-21T03:16:29.181317+0000 mgr.a (mgr.14388) 13071 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:32 smithi044 bash[22676]: audit 2024-09-21T03:16:30.712237+0000 mgr.a (mgr.14388) 13072 : audit [DBG] from='client.284928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:32 smithi049 bash[23528]: audit 2024-09-21T03:16:30.712237+0000 mgr.a (mgr.14388) 13072 : audit [DBG] from='client.284928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:32.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:32 smithi179 bash[23186]: audit 2024-09-21T03:16:30.712237+0000 mgr.a (mgr.14388) 13072 : audit [DBG] from='client.284928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:33 smithi049 bash[23528]: cluster 2024-09-21T03:16:31.183425+0000 mgr.a (mgr.14388) 13073 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:33 smithi044 bash[22676]: cluster 2024-09-21T03:16:31.183425+0000 mgr.a (mgr.14388) 13073 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:33 smithi179 bash[23186]: cluster 2024-09-21T03:16:31.183425+0000 mgr.a (mgr.14388) 13073 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:35 smithi049 bash[23528]: cluster 2024-09-21T03:16:33.184233+0000 mgr.a (mgr.14388) 13074 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:35 smithi044 bash[22676]: cluster 2024-09-21T03:16:33.184233+0000 mgr.a (mgr.14388) 13074 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:35 smithi179 bash[23186]: cluster 2024-09-21T03:16:33.184233+0000 mgr.a (mgr.14388) 13074 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:16:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:36.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:36.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:36.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:36.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:36.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:37 smithi049 bash[23528]: cluster 2024-09-21T03:16:35.186255+0000 mgr.a (mgr.14388) 13075 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:37 smithi044 bash[22676]: cluster 2024-09-21T03:16:35.186255+0000 mgr.a (mgr.14388) 13075 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:37 smithi179 bash[23186]: cluster 2024-09-21T03:16:35.186255+0000 mgr.a (mgr.14388) 13075 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:38 smithi049 bash[23528]: audit 2024-09-21T03:16:36.463836+0000 mgr.a (mgr.14388) 13076 : audit [DBG] from='client.285003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:38 smithi044 bash[22676]: audit 2024-09-21T03:16:36.463836+0000 mgr.a (mgr.14388) 13076 : audit [DBG] from='client.285003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:38 smithi179 bash[23186]: audit 2024-09-21T03:16:36.463836+0000 mgr.a (mgr.14388) 13076 : audit [DBG] from='client.285003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:39 smithi049 bash[23528]: cluster 2024-09-21T03:16:37.187264+0000 mgr.a (mgr.14388) 13077 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:39 smithi044 bash[22676]: cluster 2024-09-21T03:16:37.187264+0000 mgr.a (mgr.14388) 13077 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:39 smithi179 bash[23186]: cluster 2024-09-21T03:16:37.187264+0000 mgr.a (mgr.14388) 13077 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:40 smithi049 bash[23528]: cluster 2024-09-21T03:16:39.188208+0000 mgr.a (mgr.14388) 13078 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:40 smithi049 bash[23528]: audit 2024-09-21T03:16:39.581163+0000 mon.a (mon.0) 10610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:40 smithi049 bash[23528]: audit 2024-09-21T03:16:39.588924+0000 mon.a (mon.0) 10611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:40 smithi049 bash[23528]: audit 2024-09-21T03:16:39.605679+0000 mon.a (mon.0) 10612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:40 smithi049 bash[23528]: audit 2024-09-21T03:16:39.725520+0000 mon.a (mon.0) 10613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:40 smithi049 bash[23528]: audit 2024-09-21T03:16:39.734259+0000 mon.a (mon.0) 10614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:40 smithi049 bash[23528]: audit 2024-09-21T03:16:39.744804+0000 mon.a (mon.0) 10615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:40 smithi044 bash[22676]: cluster 2024-09-21T03:16:39.188208+0000 mgr.a (mgr.14388) 13078 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:40 smithi044 bash[22676]: audit 2024-09-21T03:16:39.581163+0000 mon.a (mon.0) 10610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:40 smithi044 bash[22676]: audit 2024-09-21T03:16:39.588924+0000 mon.a (mon.0) 10611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:40 smithi044 bash[22676]: audit 2024-09-21T03:16:39.605679+0000 mon.a (mon.0) 10612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:40 smithi044 bash[22676]: audit 2024-09-21T03:16:39.725520+0000 mon.a (mon.0) 10613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:40 smithi044 bash[22676]: audit 2024-09-21T03:16:39.734259+0000 mon.a (mon.0) 10614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:40 smithi044 bash[22676]: audit 2024-09-21T03:16:39.744804+0000 mon.a (mon.0) 10615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:40 smithi179 bash[23186]: cluster 2024-09-21T03:16:39.188208+0000 mgr.a (mgr.14388) 13078 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:40 smithi179 bash[23186]: audit 2024-09-21T03:16:39.581163+0000 mon.a (mon.0) 10610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:40 smithi179 bash[23186]: audit 2024-09-21T03:16:39.588924+0000 mon.a (mon.0) 10611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:40 smithi179 bash[23186]: audit 2024-09-21T03:16:39.605679+0000 mon.a (mon.0) 10612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:40 smithi179 bash[23186]: audit 2024-09-21T03:16:39.725520+0000 mon.a (mon.0) 10613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:40 smithi179 bash[23186]: audit 2024-09-21T03:16:39.734259+0000 mon.a (mon.0) 10614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:40 smithi179 bash[23186]: audit 2024-09-21T03:16:39.744804+0000 mon.a (mon.0) 10615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:41.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:41.918 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:41.918 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:42.704 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:42.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:42.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:42.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:42.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:42 smithi049 bash[23528]: cluster 2024-09-21T03:16:41.190456+0000 mgr.a (mgr.14388) 13079 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:42 smithi044 bash[22676]: cluster 2024-09-21T03:16:41.190456+0000 mgr.a (mgr.14388) 13079 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:42 smithi179 bash[23186]: cluster 2024-09-21T03:16:41.190456+0000 mgr.a (mgr.14388) 13079 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:43 smithi049 bash[23528]: audit 2024-09-21T03:16:42.259243+0000 mgr.a (mgr.14388) 13080 : audit [DBG] from='client.285078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:43 smithi044 bash[22676]: audit 2024-09-21T03:16:42.259243+0000 mgr.a (mgr.14388) 13080 : audit [DBG] from='client.285078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:43 smithi179 bash[23186]: audit 2024-09-21T03:16:42.259243+0000 mgr.a (mgr.14388) 13080 : audit [DBG] from='client.285078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:44 smithi044 bash[22676]: cluster 2024-09-21T03:16:43.191432+0000 mgr.a (mgr.14388) 13081 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:44 smithi179 bash[23186]: cluster 2024-09-21T03:16:43.191432+0000 mgr.a (mgr.14388) 13081 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:44 smithi049 bash[23528]: cluster 2024-09-21T03:16:43.191432+0000 mgr.a (mgr.14388) 13081 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:46.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22930]: debug 2024-09-21T03:16:46.808+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:16:46.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22930]: debug 2024-09-21T03:16:46.808+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:16:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22676]: cluster 2024-09-21T03:16:45.193624+0000 mgr.a (mgr.14388) 13082 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22676]: audit 2024-09-21T03:16:45.999349+0000 mon.a (mon.0) 10616 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:16:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22676]: audit 2024-09-21T03:16:46.007434+0000 mon.a (mon.0) 10617 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:16:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22676]: audit 2024-09-21T03:16:46.009576+0000 mon.a (mon.0) 10618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:16:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22676]: audit 2024-09-21T03:16:46.021357+0000 mon.a (mon.0) 10619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22676]: audit 2024-09-21T03:16:46.027628+0000 mon.a (mon.0) 10620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:16:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:46 smithi044 bash[22676]: audit 2024-09-21T03:16:46.030095+0000 mgr.a (mgr.14388) 13083 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:16:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:46 smithi179 bash[23186]: cluster 2024-09-21T03:16:45.193624+0000 mgr.a (mgr.14388) 13082 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:46 smithi179 bash[23186]: audit 2024-09-21T03:16:45.999349+0000 mon.a (mon.0) 10616 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:16:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:46 smithi179 bash[23186]: audit 2024-09-21T03:16:46.007434+0000 mon.a (mon.0) 10617 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:16:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:46 smithi179 bash[23186]: audit 2024-09-21T03:16:46.009576+0000 mon.a (mon.0) 10618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:16:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:46 smithi179 bash[23186]: audit 2024-09-21T03:16:46.021357+0000 mon.a (mon.0) 10619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:46 smithi179 bash[23186]: audit 2024-09-21T03:16:46.027628+0000 mon.a (mon.0) 10620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:16:47.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:46 smithi179 bash[23186]: audit 2024-09-21T03:16:46.030095+0000 mgr.a (mgr.14388) 13083 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:16:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:46 smithi049 bash[23528]: cluster 2024-09-21T03:16:45.193624+0000 mgr.a (mgr.14388) 13082 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:16:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:46 smithi049 bash[23528]: audit 2024-09-21T03:16:45.999349+0000 mon.a (mon.0) 10616 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:16:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:46 smithi049 bash[23528]: audit 2024-09-21T03:16:46.007434+0000 mon.a (mon.0) 10617 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:16:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:46 smithi049 bash[23528]: audit 2024-09-21T03:16:46.009576+0000 mon.a (mon.0) 10618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:16:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:46 smithi049 bash[23528]: audit 2024-09-21T03:16:46.021357+0000 mon.a (mon.0) 10619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:46 smithi049 bash[23528]: audit 2024-09-21T03:16:46.027628+0000 mon.a (mon.0) 10620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:16:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:46 smithi049 bash[23528]: audit 2024-09-21T03:16:46.030095+0000 mgr.a (mgr.14388) 13083 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:16:47.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:47.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:47.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:47 smithi044 bash[22676]: audit 2024-09-21T03:16:46.809702+0000 mgr.a (mgr.14388) 13084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:16:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:47 smithi044 bash[22676]: cephadm 2024-09-21T03:16:46.811084+0000 mgr.a (mgr.14388) 13085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:16:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:47 smithi044 bash[22676]: audit 2024-09-21T03:16:47.207878+0000 mon.a (mon.0) 10621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:47 smithi044 bash[22676]: audit 2024-09-21T03:16:47.216821+0000 mon.a (mon.0) 10622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:47 smithi044 bash[22676]: audit 2024-09-21T03:16:47.227467+0000 mon.a (mon.0) 10623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:47 smithi179 bash[23186]: audit 2024-09-21T03:16:46.809702+0000 mgr.a (mgr.14388) 13084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:16:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:47 smithi179 bash[23186]: cephadm 2024-09-21T03:16:46.811084+0000 mgr.a (mgr.14388) 13085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:16:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:47 smithi179 bash[23186]: audit 2024-09-21T03:16:47.207878+0000 mon.a (mon.0) 10621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:47 smithi179 bash[23186]: audit 2024-09-21T03:16:47.216821+0000 mon.a (mon.0) 10622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:47 smithi179 bash[23186]: audit 2024-09-21T03:16:47.227467+0000 mon.a (mon.0) 10623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:47 smithi049 bash[23528]: audit 2024-09-21T03:16:46.809702+0000 mgr.a (mgr.14388) 13084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:16:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:47 smithi049 bash[23528]: cephadm 2024-09-21T03:16:46.811084+0000 mgr.a (mgr.14388) 13085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:16:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:47 smithi049 bash[23528]: audit 2024-09-21T03:16:47.207878+0000 mon.a (mon.0) 10621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:47 smithi049 bash[23528]: audit 2024-09-21T03:16:47.216821+0000 mon.a (mon.0) 10622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:47 smithi049 bash[23528]: audit 2024-09-21T03:16:47.227467+0000 mon.a (mon.0) 10623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:16:48.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:48 smithi044 bash[22676]: cluster 2024-09-21T03:16:47.194859+0000 mgr.a (mgr.14388) 13086 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:48 smithi044 bash[22676]: audit 2024-09-21T03:16:48.040170+0000 mgr.a (mgr.14388) 13087 : audit [DBG] from='client.285261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:48 smithi179 bash[23186]: cluster 2024-09-21T03:16:47.194859+0000 mgr.a (mgr.14388) 13086 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:48 smithi179 bash[23186]: audit 2024-09-21T03:16:48.040170+0000 mgr.a (mgr.14388) 13087 : audit [DBG] from='client.285261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:48 smithi049 bash[23528]: cluster 2024-09-21T03:16:47.194859+0000 mgr.a (mgr.14388) 13086 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:48 smithi049 bash[23528]: audit 2024-09-21T03:16:48.040170+0000 mgr.a (mgr.14388) 13087 : audit [DBG] from='client.285261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:50 smithi044 bash[22676]: cluster 2024-09-21T03:16:49.195931+0000 mgr.a (mgr.14388) 13088 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:50 smithi179 bash[23186]: cluster 2024-09-21T03:16:49.195931+0000 mgr.a (mgr.14388) 13088 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:50 smithi049 bash[23528]: cluster 2024-09-21T03:16:49.195931+0000 mgr.a (mgr.14388) 13088 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:16:52.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:52 smithi044 bash[22676]: cluster 2024-09-21T03:16:51.198256+0000 mgr.a (mgr.14388) 13089 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:53.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:52 smithi179 bash[23186]: cluster 2024-09-21T03:16:51.198256+0000 mgr.a (mgr.14388) 13089 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:52 smithi049 bash[23528]: cluster 2024-09-21T03:16:51.198256+0000 mgr.a (mgr.14388) 13089 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:53.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:53.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:53.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:16:54.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:16:54.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:16:54.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:16:54.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:16:54.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:16:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:54 smithi044 bash[22676]: cluster 2024-09-21T03:16:53.199051+0000 mgr.a (mgr.14388) 13090 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:54 smithi044 bash[22676]: audit 2024-09-21T03:16:53.796753+0000 mgr.a (mgr.14388) 13091 : audit [DBG] from='client.285336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:54 smithi179 bash[23186]: cluster 2024-09-21T03:16:53.199051+0000 mgr.a (mgr.14388) 13090 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:55.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:54 smithi179 bash[23186]: audit 2024-09-21T03:16:53.796753+0000 mgr.a (mgr.14388) 13091 : audit [DBG] from='client.285336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:54 smithi049 bash[23528]: cluster 2024-09-21T03:16:53.199051+0000 mgr.a (mgr.14388) 13090 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:54 smithi049 bash[23528]: audit 2024-09-21T03:16:53.796753+0000 mgr.a (mgr.14388) 13091 : audit [DBG] from='client.285336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:16:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:56 smithi044 bash[22676]: cluster 2024-09-21T03:16:55.201465+0000 mgr.a (mgr.14388) 13092 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:56 smithi179 bash[23186]: cluster 2024-09-21T03:16:55.201465+0000 mgr.a (mgr.14388) 13092 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:56 smithi049 bash[23528]: cluster 2024-09-21T03:16:55.201465+0000 mgr.a (mgr.14388) 13092 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:16:58 smithi044 bash[22676]: cluster 2024-09-21T03:16:57.202270+0000 mgr.a (mgr.14388) 13093 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:16:58 smithi179 bash[23186]: cluster 2024-09-21T03:16:57.202270+0000 mgr.a (mgr.14388) 13093 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:16:58 smithi049 bash[23528]: cluster 2024-09-21T03:16:57.202270+0000 mgr.a (mgr.14388) 13093 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:16:59.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:16:59.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:16:59.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:00.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:01.049 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: cluster 2024-09-21T03:16:59.203068+0000 mgr.a (mgr.14388) 13094 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:01.049 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: audit 2024-09-21T03:16:59.587807+0000 mgr.a (mgr.14388) 13095 : audit [DBG] from='client.285414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:01.049 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: audit 2024-09-21T03:16:59.752059+0000 mon.a (mon.0) 10624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.049 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: audit 2024-09-21T03:16:59.758246+0000 mon.a (mon.0) 10625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.049 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: audit 2024-09-21T03:16:59.766122+0000 mon.a (mon.0) 10626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.049 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: audit 2024-09-21T03:16:59.940407+0000 mon.a (mon.0) 10627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: audit 2024-09-21T03:16:59.946787+0000 mon.a (mon.0) 10628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:00 smithi179 bash[23186]: audit 2024-09-21T03:16:59.953643+0000 mon.a (mon.0) 10629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: cluster 2024-09-21T03:16:59.203068+0000 mgr.a (mgr.14388) 13094 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: audit 2024-09-21T03:16:59.587807+0000 mgr.a (mgr.14388) 13095 : audit [DBG] from='client.285414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: audit 2024-09-21T03:16:59.752059+0000 mon.a (mon.0) 10624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: audit 2024-09-21T03:16:59.758246+0000 mon.a (mon.0) 10625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: audit 2024-09-21T03:16:59.766122+0000 mon.a (mon.0) 10626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: audit 2024-09-21T03:16:59.940407+0000 mon.a (mon.0) 10627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: audit 2024-09-21T03:16:59.946787+0000 mon.a (mon.0) 10628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:00 smithi049 bash[23528]: audit 2024-09-21T03:16:59.953643+0000 mon.a (mon.0) 10629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: cluster 2024-09-21T03:16:59.203068+0000 mgr.a (mgr.14388) 13094 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: audit 2024-09-21T03:16:59.587807+0000 mgr.a (mgr.14388) 13095 : audit [DBG] from='client.285414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: audit 2024-09-21T03:16:59.752059+0000 mon.a (mon.0) 10624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: audit 2024-09-21T03:16:59.758246+0000 mon.a (mon.0) 10625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: audit 2024-09-21T03:16:59.766122+0000 mon.a (mon.0) 10626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: audit 2024-09-21T03:16:59.940407+0000 mon.a (mon.0) 10627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: audit 2024-09-21T03:16:59.946787+0000 mon.a (mon.0) 10628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:01.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:00 smithi044 bash[22676]: audit 2024-09-21T03:16:59.953643+0000 mon.a (mon.0) 10629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:02 smithi049 bash[23528]: cluster 2024-09-21T03:17:01.205490+0000 mgr.a (mgr.14388) 13096 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:02 smithi044 bash[22676]: cluster 2024-09-21T03:17:01.205490+0000 mgr.a (mgr.14388) 13096 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:02 smithi179 bash[23186]: cluster 2024-09-21T03:17:01.205490+0000 mgr.a (mgr.14388) 13096 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:05.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:04 smithi049 bash[23528]: cluster 2024-09-21T03:17:03.206298+0000 mgr.a (mgr.14388) 13097 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:17:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:04 smithi044 bash[22676]: cluster 2024-09-21T03:17:03.206298+0000 mgr.a (mgr.14388) 13097 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:17:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:04 smithi179 bash[23186]: cluster 2024-09-21T03:17:03.206298+0000 mgr.a (mgr.14388) 13097 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:17:05.806 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:05.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:05.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:05.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:05.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:06 smithi179 bash[23186]: cluster 2024-09-21T03:17:05.208253+0000 mgr.a (mgr.14388) 13098 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:06 smithi179 bash[23186]: audit 2024-09-21T03:17:05.351718+0000 mgr.a (mgr.14388) 13099 : audit [DBG] from='client.285492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:06 smithi049 bash[23528]: cluster 2024-09-21T03:17:05.208253+0000 mgr.a (mgr.14388) 13098 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:06 smithi049 bash[23528]: audit 2024-09-21T03:17:05.351718+0000 mgr.a (mgr.14388) 13099 : audit [DBG] from='client.285492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:06 smithi044 bash[22676]: cluster 2024-09-21T03:17:05.208253+0000 mgr.a (mgr.14388) 13098 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:06 smithi044 bash[22676]: audit 2024-09-21T03:17:05.351718+0000 mgr.a (mgr.14388) 13099 : audit [DBG] from='client.285492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:08 smithi044 bash[22676]: cluster 2024-09-21T03:17:07.209223+0000 mgr.a (mgr.14388) 13100 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:08 smithi044 bash[22676]: audit 2024-09-21T03:17:07.442381+0000 mon.a (mon.0) 10630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:08 smithi044 bash[22676]: audit 2024-09-21T03:17:07.451060+0000 mon.a (mon.0) 10631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:08 smithi044 bash[22676]: audit 2024-09-21T03:17:07.461774+0000 mon.a (mon.0) 10632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:08 smithi179 bash[23186]: cluster 2024-09-21T03:17:07.209223+0000 mgr.a (mgr.14388) 13100 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:08 smithi179 bash[23186]: audit 2024-09-21T03:17:07.442381+0000 mon.a (mon.0) 10630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:08 smithi179 bash[23186]: audit 2024-09-21T03:17:07.451060+0000 mon.a (mon.0) 10631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:08 smithi179 bash[23186]: audit 2024-09-21T03:17:07.461774+0000 mon.a (mon.0) 10632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:08 smithi049 bash[23528]: cluster 2024-09-21T03:17:07.209223+0000 mgr.a (mgr.14388) 13100 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:08 smithi049 bash[23528]: audit 2024-09-21T03:17:07.442381+0000 mon.a (mon.0) 10630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:08 smithi049 bash[23528]: audit 2024-09-21T03:17:07.451060+0000 mon.a (mon.0) 10631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:08 smithi049 bash[23528]: audit 2024-09-21T03:17:07.461774+0000 mon.a (mon.0) 10632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:10.657 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:10 smithi044 bash[22676]: cluster 2024-09-21T03:17:09.210035+0000 mgr.a (mgr.14388) 13101 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:17:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:10 smithi179 bash[23186]: cluster 2024-09-21T03:17:09.210035+0000 mgr.a (mgr.14388) 13101 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:17:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:10 smithi049 bash[23528]: cluster 2024-09-21T03:17:09.210035+0000 mgr.a (mgr.14388) 13101 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:17:10.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:10.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:10.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:11.591 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:12 smithi044 bash[22676]: audit 2024-09-21T03:17:11.146415+0000 mgr.a (mgr.14388) 13102 : audit [DBG] from='client.285567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:12 smithi044 bash[22676]: cluster 2024-09-21T03:17:11.211945+0000 mgr.a (mgr.14388) 13103 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:12 smithi179 bash[23186]: audit 2024-09-21T03:17:11.146415+0000 mgr.a (mgr.14388) 13102 : audit [DBG] from='client.285567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:12 smithi179 bash[23186]: cluster 2024-09-21T03:17:11.211945+0000 mgr.a (mgr.14388) 13103 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:12 smithi049 bash[23528]: audit 2024-09-21T03:17:11.146415+0000 mgr.a (mgr.14388) 13102 : audit [DBG] from='client.285567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:12 smithi049 bash[23528]: cluster 2024-09-21T03:17:11.211945+0000 mgr.a (mgr.14388) 13103 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:14 smithi044 bash[22676]: cluster 2024-09-21T03:17:13.212965+0000 mgr.a (mgr.14388) 13104 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:17:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:14 smithi179 bash[23186]: cluster 2024-09-21T03:17:13.212965+0000 mgr.a (mgr.14388) 13104 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:17:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:14 smithi049 bash[23528]: cluster 2024-09-21T03:17:13.212965+0000 mgr.a (mgr.14388) 13104 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:17:16.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:16.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:16.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:16 smithi044 bash[22676]: cluster 2024-09-21T03:17:15.215200+0000 mgr.a (mgr.14388) 13105 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:17:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:16 smithi179 bash[23186]: cluster 2024-09-21T03:17:15.215200+0000 mgr.a (mgr.14388) 13105 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:17:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:16 smithi049 bash[23528]: cluster 2024-09-21T03:17:15.215200+0000 mgr.a (mgr.14388) 13105 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:17:17.379 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:17.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:17.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:17.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:17.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:17 smithi044 bash[22676]: audit 2024-09-21T03:17:16.928046+0000 mgr.a (mgr.14388) 13106 : audit [DBG] from='client.285645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:17.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:17 smithi179 bash[23186]: audit 2024-09-21T03:17:16.928046+0000 mgr.a (mgr.14388) 13106 : audit [DBG] from='client.285645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:17 smithi049 bash[23528]: audit 2024-09-21T03:17:16.928046+0000 mgr.a (mgr.14388) 13106 : audit [DBG] from='client.285645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:18 smithi044 bash[22676]: cluster 2024-09-21T03:17:17.215785+0000 mgr.a (mgr.14388) 13107 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:18 smithi179 bash[23186]: cluster 2024-09-21T03:17:17.215785+0000 mgr.a (mgr.14388) 13107 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:18 smithi049 bash[23528]: cluster 2024-09-21T03:17:17.215785+0000 mgr.a (mgr.14388) 13107 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:20 smithi044 bash[22676]: cluster 2024-09-21T03:17:19.216679+0000 mgr.a (mgr.14388) 13108 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:20 smithi044 bash[22676]: audit 2024-09-21T03:17:19.983343+0000 mon.a (mon.0) 10633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:20 smithi044 bash[22676]: audit 2024-09-21T03:17:19.990887+0000 mon.a (mon.0) 10634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:20 smithi044 bash[22676]: audit 2024-09-21T03:17:20.001220+0000 mon.a (mon.0) 10635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:20 smithi044 bash[22676]: audit 2024-09-21T03:17:20.165915+0000 mon.a (mon.0) 10636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:20 smithi044 bash[22676]: audit 2024-09-21T03:17:20.175507+0000 mon.a (mon.0) 10637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:20 smithi044 bash[22676]: audit 2024-09-21T03:17:20.187060+0000 mon.a (mon.0) 10638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:20 smithi179 bash[23186]: cluster 2024-09-21T03:17:19.216679+0000 mgr.a (mgr.14388) 13108 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:20 smithi179 bash[23186]: audit 2024-09-21T03:17:19.983343+0000 mon.a (mon.0) 10633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:20 smithi179 bash[23186]: audit 2024-09-21T03:17:19.990887+0000 mon.a (mon.0) 10634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:20 smithi179 bash[23186]: audit 2024-09-21T03:17:20.001220+0000 mon.a (mon.0) 10635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:20 smithi179 bash[23186]: audit 2024-09-21T03:17:20.165915+0000 mon.a (mon.0) 10636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:20 smithi179 bash[23186]: audit 2024-09-21T03:17:20.175507+0000 mon.a (mon.0) 10637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:20 smithi179 bash[23186]: audit 2024-09-21T03:17:20.187060+0000 mon.a (mon.0) 10638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:20 smithi049 bash[23528]: cluster 2024-09-21T03:17:19.216679+0000 mgr.a (mgr.14388) 13108 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:20 smithi049 bash[23528]: audit 2024-09-21T03:17:19.983343+0000 mon.a (mon.0) 10633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:20 smithi049 bash[23528]: audit 2024-09-21T03:17:19.990887+0000 mon.a (mon.0) 10634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:20 smithi049 bash[23528]: audit 2024-09-21T03:17:20.001220+0000 mon.a (mon.0) 10635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:20 smithi049 bash[23528]: audit 2024-09-21T03:17:20.165915+0000 mon.a (mon.0) 10636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:20 smithi049 bash[23528]: audit 2024-09-21T03:17:20.175507+0000 mon.a (mon.0) 10637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:20 smithi049 bash[23528]: audit 2024-09-21T03:17:20.187060+0000 mon.a (mon.0) 10638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:22.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:23.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:23.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:23.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:23.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:23.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:22 smithi179 bash[23186]: cluster 2024-09-21T03:17:21.218952+0000 mgr.a (mgr.14388) 13109 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:22 smithi049 bash[23528]: cluster 2024-09-21T03:17:21.218952+0000 mgr.a (mgr.14388) 13109 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:22 smithi044 bash[22676]: cluster 2024-09-21T03:17:21.218952+0000 mgr.a (mgr.14388) 13109 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:24.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:23 smithi179 bash[23186]: audit 2024-09-21T03:17:22.712763+0000 mgr.a (mgr.14388) 13110 : audit [DBG] from='client.285723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:23 smithi049 bash[23528]: audit 2024-09-21T03:17:22.712763+0000 mgr.a (mgr.14388) 13110 : audit [DBG] from='client.285723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:23 smithi044 bash[22676]: audit 2024-09-21T03:17:22.712763+0000 mgr.a (mgr.14388) 13110 : audit [DBG] from='client.285723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:25 smithi179 bash[23186]: cluster 2024-09-21T03:17:23.219905+0000 mgr.a (mgr.14388) 13111 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:25 smithi049 bash[23528]: cluster 2024-09-21T03:17:23.219905+0000 mgr.a (mgr.14388) 13111 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:24 smithi044 bash[22676]: cluster 2024-09-21T03:17:23.219905+0000 mgr.a (mgr.14388) 13111 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:27 smithi049 bash[23528]: cluster 2024-09-21T03:17:25.222198+0000 mgr.a (mgr.14388) 13112 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:27 smithi044 bash[22676]: cluster 2024-09-21T03:17:25.222198+0000 mgr.a (mgr.14388) 13112 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:27 smithi179 bash[23186]: cluster 2024-09-21T03:17:25.222198+0000 mgr.a (mgr.14388) 13112 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:28.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:28.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:28.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:28.873 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:28.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:28.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:28.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:28 smithi044 bash[22676]: cluster 2024-09-21T03:17:27.222987+0000 mgr.a (mgr.14388) 13113 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:28 smithi044 bash[22676]: audit 2024-09-21T03:17:27.679748+0000 mon.a (mon.0) 10639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:28 smithi044 bash[22676]: audit 2024-09-21T03:17:27.688705+0000 mon.a (mon.0) 10640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:28 smithi044 bash[22676]: audit 2024-09-21T03:17:27.699504+0000 mon.a (mon.0) 10641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:28 smithi179 bash[23186]: cluster 2024-09-21T03:17:27.222987+0000 mgr.a (mgr.14388) 13113 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:28 smithi179 bash[23186]: audit 2024-09-21T03:17:27.679748+0000 mon.a (mon.0) 10639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:28 smithi179 bash[23186]: audit 2024-09-21T03:17:27.688705+0000 mon.a (mon.0) 10640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:28 smithi179 bash[23186]: audit 2024-09-21T03:17:27.699504+0000 mon.a (mon.0) 10641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:28 smithi049 bash[23528]: cluster 2024-09-21T03:17:27.222987+0000 mgr.a (mgr.14388) 13113 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:28 smithi049 bash[23528]: audit 2024-09-21T03:17:27.679748+0000 mon.a (mon.0) 10639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:28 smithi049 bash[23528]: audit 2024-09-21T03:17:27.688705+0000 mon.a (mon.0) 10640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:28 smithi049 bash[23528]: audit 2024-09-21T03:17:27.699504+0000 mon.a (mon.0) 10641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:29.963 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:29 smithi179 bash[23186]: audit 2024-09-21T03:17:28.460327+0000 mgr.a (mgr.14388) 13114 : audit [DBG] from='client.285795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:29.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:29 smithi044 bash[22676]: audit 2024-09-21T03:17:28.460327+0000 mgr.a (mgr.14388) 13114 : audit [DBG] from='client.285795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:30.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:29 smithi049 bash[23528]: audit 2024-09-21T03:17:28.460327+0000 mgr.a (mgr.14388) 13114 : audit [DBG] from='client.285795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:30.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:30 smithi044 bash[22676]: cluster 2024-09-21T03:17:29.223966+0000 mgr.a (mgr.14388) 13115 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:30 smithi179 bash[23186]: cluster 2024-09-21T03:17:29.223966+0000 mgr.a (mgr.14388) 13115 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:30 smithi049 bash[23528]: cluster 2024-09-21T03:17:29.223966+0000 mgr.a (mgr.14388) 13115 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:32 smithi044 bash[22676]: cluster 2024-09-21T03:17:31.226271+0000 mgr.a (mgr.14388) 13116 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:32 smithi179 bash[23186]: cluster 2024-09-21T03:17:31.226271+0000 mgr.a (mgr.14388) 13116 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:32 smithi049 bash[23528]: cluster 2024-09-21T03:17:31.226271+0000 mgr.a (mgr.14388) 13116 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:33.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:34.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:34.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:34.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:34.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:34.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:34 smithi044 bash[22676]: cluster 2024-09-21T03:17:33.226748+0000 mgr.a (mgr.14388) 13117 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:34 smithi179 bash[23186]: cluster 2024-09-21T03:17:33.226748+0000 mgr.a (mgr.14388) 13117 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:34 smithi049 bash[23528]: cluster 2024-09-21T03:17:33.226748+0000 mgr.a (mgr.14388) 13117 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:35 smithi044 bash[22676]: audit 2024-09-21T03:17:34.209376+0000 mgr.a (mgr.14388) 13118 : audit [DBG] from='client.285870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:36.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:35 smithi179 bash[23186]: audit 2024-09-21T03:17:34.209376+0000 mgr.a (mgr.14388) 13118 : audit [DBG] from='client.285870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:35 smithi049 bash[23528]: audit 2024-09-21T03:17:34.209376+0000 mgr.a (mgr.14388) 13118 : audit [DBG] from='client.285870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:36 smithi044 bash[22676]: cluster 2024-09-21T03:17:35.229234+0000 mgr.a (mgr.14388) 13119 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:36 smithi179 bash[23186]: cluster 2024-09-21T03:17:35.229234+0000 mgr.a (mgr.14388) 13119 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:36 smithi049 bash[23528]: cluster 2024-09-21T03:17:35.229234+0000 mgr.a (mgr.14388) 13119 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:17:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:38 smithi044 bash[22676]: cluster 2024-09-21T03:17:37.230062+0000 mgr.a (mgr.14388) 13120 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:38 smithi179 bash[23186]: cluster 2024-09-21T03:17:37.230062+0000 mgr.a (mgr.14388) 13120 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:38 smithi049 bash[23528]: cluster 2024-09-21T03:17:37.230062+0000 mgr.a (mgr.14388) 13120 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:39.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:39.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:39.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:40.442 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:40.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:40.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:40.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:40.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: cluster 2024-09-21T03:17:39.230831+0000 mgr.a (mgr.14388) 13121 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: audit 2024-09-21T03:17:40.004072+0000 mgr.a (mgr.14388) 13122 : audit [DBG] from='client.285948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: audit 2024-09-21T03:17:40.153126+0000 mon.a (mon.0) 10642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: audit 2024-09-21T03:17:40.158771+0000 mon.a (mon.0) 10643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: audit 2024-09-21T03:17:40.171219+0000 mon.a (mon.0) 10644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: audit 2024-09-21T03:17:40.376370+0000 mon.a (mon.0) 10645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: audit 2024-09-21T03:17:40.380907+0000 mon.a (mon.0) 10646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:40 smithi044 bash[22676]: audit 2024-09-21T03:17:40.390277+0000 mon.a (mon.0) 10647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: cluster 2024-09-21T03:17:39.230831+0000 mgr.a (mgr.14388) 13121 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: audit 2024-09-21T03:17:40.004072+0000 mgr.a (mgr.14388) 13122 : audit [DBG] from='client.285948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: audit 2024-09-21T03:17:40.153126+0000 mon.a (mon.0) 10642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: audit 2024-09-21T03:17:40.158771+0000 mon.a (mon.0) 10643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: audit 2024-09-21T03:17:40.171219+0000 mon.a (mon.0) 10644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: audit 2024-09-21T03:17:40.376370+0000 mon.a (mon.0) 10645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: audit 2024-09-21T03:17:40.380907+0000 mon.a (mon.0) 10646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:40 smithi179 bash[23186]: audit 2024-09-21T03:17:40.390277+0000 mon.a (mon.0) 10647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: cluster 2024-09-21T03:17:39.230831+0000 mgr.a (mgr.14388) 13121 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: audit 2024-09-21T03:17:40.004072+0000 mgr.a (mgr.14388) 13122 : audit [DBG] from='client.285948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: audit 2024-09-21T03:17:40.153126+0000 mon.a (mon.0) 10642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: audit 2024-09-21T03:17:40.158771+0000 mon.a (mon.0) 10643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: audit 2024-09-21T03:17:40.171219+0000 mon.a (mon.0) 10644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: audit 2024-09-21T03:17:40.376370+0000 mon.a (mon.0) 10645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: audit 2024-09-21T03:17:40.380907+0000 mon.a (mon.0) 10646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:40 smithi049 bash[23528]: audit 2024-09-21T03:17:40.390277+0000 mon.a (mon.0) 10647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:42 smithi049 bash[23528]: cluster 2024-09-21T03:17:41.233599+0000 mgr.a (mgr.14388) 13123 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:42 smithi044 bash[22676]: cluster 2024-09-21T03:17:41.233599+0000 mgr.a (mgr.14388) 13123 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:42 smithi179 bash[23186]: cluster 2024-09-21T03:17:41.233599+0000 mgr.a (mgr.14388) 13123 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:44.985 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:44 smithi049 bash[23528]: cluster 2024-09-21T03:17:43.234376+0000 mgr.a (mgr.14388) 13124 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:44 smithi044 bash[22676]: cluster 2024-09-21T03:17:43.234376+0000 mgr.a (mgr.14388) 13124 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:44 smithi179 bash[23186]: cluster 2024-09-21T03:17:43.234376+0000 mgr.a (mgr.14388) 13124 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:45.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:45.444 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:45.444 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:46.196 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:46.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:46.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:46.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:46.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:46 smithi044 bash[22676]: cluster 2024-09-21T03:17:45.236306+0000 mgr.a (mgr.14388) 13125 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:46 smithi044 bash[22676]: audit 2024-09-21T03:17:45.778462+0000 mgr.a (mgr.14388) 13126 : audit [DBG] from='client.286023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:46 smithi179 bash[23186]: cluster 2024-09-21T03:17:45.236306+0000 mgr.a (mgr.14388) 13125 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:46 smithi179 bash[23186]: audit 2024-09-21T03:17:45.778462+0000 mgr.a (mgr.14388) 13126 : audit [DBG] from='client.286023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:46 smithi049 bash[23528]: cluster 2024-09-21T03:17:45.236306+0000 mgr.a (mgr.14388) 13125 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:17:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:46 smithi049 bash[23528]: audit 2024-09-21T03:17:45.778462+0000 mgr.a (mgr.14388) 13126 : audit [DBG] from='client.286023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:47.732 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22930]: debug 2024-09-21T03:17:47.651+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:17:47.732 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22930]: debug 2024-09-21T03:17:47.655+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:17:47.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22676]: audit 2024-09-21T03:17:46.871623+0000 mon.a (mon.0) 10648 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:17:47.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22676]: audit 2024-09-21T03:17:46.879540+0000 mon.a (mon.0) 10649 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:17:47.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22676]: audit 2024-09-21T03:17:46.881783+0000 mon.a (mon.0) 10650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:17:47.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22676]: audit 2024-09-21T03:17:46.894481+0000 mon.a (mon.0) 10651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:47.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22676]: audit 2024-09-21T03:17:46.901557+0000 mon.a (mon.0) 10652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:17:47.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:47 smithi044 bash[22676]: audit 2024-09-21T03:17:46.904152+0000 mgr.a (mgr.14388) 13127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:17:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:47 smithi179 bash[23186]: audit 2024-09-21T03:17:46.871623+0000 mon.a (mon.0) 10648 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:17:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:47 smithi179 bash[23186]: audit 2024-09-21T03:17:46.879540+0000 mon.a (mon.0) 10649 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:17:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:47 smithi179 bash[23186]: audit 2024-09-21T03:17:46.881783+0000 mon.a (mon.0) 10650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:17:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:47 smithi179 bash[23186]: audit 2024-09-21T03:17:46.894481+0000 mon.a (mon.0) 10651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:47 smithi179 bash[23186]: audit 2024-09-21T03:17:46.901557+0000 mon.a (mon.0) 10652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:17:48.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:47 smithi179 bash[23186]: audit 2024-09-21T03:17:46.904152+0000 mgr.a (mgr.14388) 13127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:17:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:47 smithi049 bash[23528]: audit 2024-09-21T03:17:46.871623+0000 mon.a (mon.0) 10648 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:17:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:47 smithi049 bash[23528]: audit 2024-09-21T03:17:46.879540+0000 mon.a (mon.0) 10649 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:17:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:47 smithi049 bash[23528]: audit 2024-09-21T03:17:46.881783+0000 mon.a (mon.0) 10650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:17:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:47 smithi049 bash[23528]: audit 2024-09-21T03:17:46.894481+0000 mon.a (mon.0) 10651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:47 smithi049 bash[23528]: audit 2024-09-21T03:17:46.901557+0000 mon.a (mon.0) 10652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:17:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:47 smithi049 bash[23528]: audit 2024-09-21T03:17:46.904152+0000 mgr.a (mgr.14388) 13127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:17:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:48 smithi044 bash[22676]: cluster 2024-09-21T03:17:47.236871+0000 mgr.a (mgr.14388) 13128 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:48 smithi044 bash[22676]: audit 2024-09-21T03:17:47.656270+0000 mgr.a (mgr.14388) 13129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:17:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:48 smithi044 bash[22676]: cephadm 2024-09-21T03:17:47.657403+0000 mgr.a (mgr.14388) 13130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:17:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:48 smithi044 bash[22676]: audit 2024-09-21T03:17:47.887691+0000 mon.a (mon.0) 10653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:48 smithi044 bash[22676]: audit 2024-09-21T03:17:47.897057+0000 mon.a (mon.0) 10654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:48 smithi044 bash[22676]: audit 2024-09-21T03:17:47.910479+0000 mon.a (mon.0) 10655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:48 smithi179 bash[23186]: cluster 2024-09-21T03:17:47.236871+0000 mgr.a (mgr.14388) 13128 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:48 smithi179 bash[23186]: audit 2024-09-21T03:17:47.656270+0000 mgr.a (mgr.14388) 13129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:48 smithi179 bash[23186]: cephadm 2024-09-21T03:17:47.657403+0000 mgr.a (mgr.14388) 13130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:48 smithi179 bash[23186]: audit 2024-09-21T03:17:47.887691+0000 mon.a (mon.0) 10653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:48 smithi179 bash[23186]: audit 2024-09-21T03:17:47.897057+0000 mon.a (mon.0) 10654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:48 smithi179 bash[23186]: audit 2024-09-21T03:17:47.910479+0000 mon.a (mon.0) 10655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:48 smithi049 bash[23528]: cluster 2024-09-21T03:17:47.236871+0000 mgr.a (mgr.14388) 13128 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:17:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:48 smithi049 bash[23528]: audit 2024-09-21T03:17:47.656270+0000 mgr.a (mgr.14388) 13129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:17:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:48 smithi049 bash[23528]: cephadm 2024-09-21T03:17:47.657403+0000 mgr.a (mgr.14388) 13130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:17:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:48 smithi049 bash[23528]: audit 2024-09-21T03:17:47.887691+0000 mon.a (mon.0) 10653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:48 smithi049 bash[23528]: audit 2024-09-21T03:17:47.897057+0000 mon.a (mon.0) 10654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:48 smithi049 bash[23528]: audit 2024-09-21T03:17:47.910479+0000 mon.a (mon.0) 10655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:17:51.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:51.198 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:51.198 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:51.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:50 smithi044 bash[22676]: cluster 2024-09-21T03:17:49.237801+0000 mgr.a (mgr.14388) 13131 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:17:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:50 smithi179 bash[23186]: cluster 2024-09-21T03:17:49.237801+0000 mgr.a (mgr.14388) 13131 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:17:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:50 smithi049 bash[23528]: cluster 2024-09-21T03:17:49.237801+0000 mgr.a (mgr.14388) 13131 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:17:51.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:51.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:51.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:51.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:51.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:52 smithi044 bash[22676]: cluster 2024-09-21T03:17:51.239934+0000 mgr.a (mgr.14388) 13132 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:52 smithi044 bash[22676]: audit 2024-09-21T03:17:51.536958+0000 mgr.a (mgr.14388) 13133 : audit [DBG] from='client.286206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:52 smithi179 bash[23186]: cluster 2024-09-21T03:17:51.239934+0000 mgr.a (mgr.14388) 13132 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:52 smithi179 bash[23186]: audit 2024-09-21T03:17:51.536958+0000 mgr.a (mgr.14388) 13133 : audit [DBG] from='client.286206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:52 smithi049 bash[23528]: cluster 2024-09-21T03:17:51.239934+0000 mgr.a (mgr.14388) 13132 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:52 smithi049 bash[23528]: audit 2024-09-21T03:17:51.536958+0000 mgr.a (mgr.14388) 13133 : audit [DBG] from='client.286206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:54 smithi044 bash[22676]: cluster 2024-09-21T03:17:53.240886+0000 mgr.a (mgr.14388) 13134 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:54 smithi179 bash[23186]: cluster 2024-09-21T03:17:53.240886+0000 mgr.a (mgr.14388) 13134 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:54 smithi049 bash[23528]: cluster 2024-09-21T03:17:53.240886+0000 mgr.a (mgr.14388) 13134 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:56.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:17:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:17:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:17:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:56 smithi044 bash[22676]: cluster 2024-09-21T03:17:55.243140+0000 mgr.a (mgr.14388) 13135 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:56 smithi179 bash[23186]: cluster 2024-09-21T03:17:55.243140+0000 mgr.a (mgr.14388) 13135 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:56 smithi049 bash[23528]: cluster 2024-09-21T03:17:55.243140+0000 mgr.a (mgr.14388) 13135 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:57.770 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:17:57.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:17:57.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:17:57.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:17:57.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:17:59.196 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:58 smithi049 bash[23528]: cluster 2024-09-21T03:17:57.243886+0000 mgr.a (mgr.14388) 13136 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:59.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:17:58 smithi049 bash[23528]: audit 2024-09-21T03:17:57.330665+0000 mgr.a (mgr.14388) 13137 : audit [DBG] from='client.286281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:58 smithi044 bash[22676]: cluster 2024-09-21T03:17:57.243886+0000 mgr.a (mgr.14388) 13136 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:17:58 smithi044 bash[22676]: audit 2024-09-21T03:17:57.330665+0000 mgr.a (mgr.14388) 13137 : audit [DBG] from='client.286281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:17:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:58 smithi179 bash[23186]: cluster 2024-09-21T03:17:57.243886+0000 mgr.a (mgr.14388) 13136 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:17:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:17:58 smithi179 bash[23186]: audit 2024-09-21T03:17:57.330665+0000 mgr.a (mgr.14388) 13137 : audit [DBG] from='client.286281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:00 smithi044 bash[22676]: cluster 2024-09-21T03:17:59.244800+0000 mgr.a (mgr.14388) 13138 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:00 smithi044 bash[22676]: audit 2024-09-21T03:18:00.375555+0000 mon.a (mon.0) 10656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:00 smithi044 bash[22676]: audit 2024-09-21T03:18:00.381709+0000 mon.a (mon.0) 10657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:00 smithi044 bash[22676]: audit 2024-09-21T03:18:00.391642+0000 mon.a (mon.0) 10658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:00 smithi044 bash[22676]: audit 2024-09-21T03:18:00.600413+0000 mon.a (mon.0) 10659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:00 smithi044 bash[22676]: audit 2024-09-21T03:18:00.608965+0000 mon.a (mon.0) 10660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:00 smithi044 bash[22676]: audit 2024-09-21T03:18:00.620467+0000 mon.a (mon.0) 10661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:00 smithi179 bash[23186]: cluster 2024-09-21T03:17:59.244800+0000 mgr.a (mgr.14388) 13138 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:00 smithi179 bash[23186]: audit 2024-09-21T03:18:00.375555+0000 mon.a (mon.0) 10656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:00 smithi179 bash[23186]: audit 2024-09-21T03:18:00.381709+0000 mon.a (mon.0) 10657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:00 smithi179 bash[23186]: audit 2024-09-21T03:18:00.391642+0000 mon.a (mon.0) 10658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:00 smithi179 bash[23186]: audit 2024-09-21T03:18:00.600413+0000 mon.a (mon.0) 10659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:00 smithi179 bash[23186]: audit 2024-09-21T03:18:00.608965+0000 mon.a (mon.0) 10660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:00 smithi179 bash[23186]: audit 2024-09-21T03:18:00.620467+0000 mon.a (mon.0) 10661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:00 smithi049 bash[23528]: cluster 2024-09-21T03:17:59.244800+0000 mgr.a (mgr.14388) 13138 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:00 smithi049 bash[23528]: audit 2024-09-21T03:18:00.375555+0000 mon.a (mon.0) 10656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:00 smithi049 bash[23528]: audit 2024-09-21T03:18:00.381709+0000 mon.a (mon.0) 10657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:00 smithi049 bash[23528]: audit 2024-09-21T03:18:00.391642+0000 mon.a (mon.0) 10658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:00 smithi049 bash[23528]: audit 2024-09-21T03:18:00.600413+0000 mon.a (mon.0) 10659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:00 smithi049 bash[23528]: audit 2024-09-21T03:18:00.608965+0000 mon.a (mon.0) 10660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:00 smithi049 bash[23528]: audit 2024-09-21T03:18:00.620467+0000 mon.a (mon.0) 10661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:02.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:02.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:02.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:03.092 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:02 smithi049 bash[23528]: cluster 2024-09-21T03:18:01.247072+0000 mgr.a (mgr.14388) 13139 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:02 smithi044 bash[22676]: cluster 2024-09-21T03:18:01.247072+0000 mgr.a (mgr.14388) 13139 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:02 smithi179 bash[23186]: cluster 2024-09-21T03:18:01.247072+0000 mgr.a (mgr.14388) 13139 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:03.568 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:03.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:03.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:03.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:03.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:04 smithi049 bash[23528]: audit 2024-09-21T03:18:03.114715+0000 mgr.a (mgr.14388) 13140 : audit [DBG] from='client.286359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:04 smithi049 bash[23528]: cluster 2024-09-21T03:18:03.247605+0000 mgr.a (mgr.14388) 13141 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:04 smithi044 bash[22676]: audit 2024-09-21T03:18:03.114715+0000 mgr.a (mgr.14388) 13140 : audit [DBG] from='client.286359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:05.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:04 smithi044 bash[22676]: cluster 2024-09-21T03:18:03.247605+0000 mgr.a (mgr.14388) 13141 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:05.282 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:04 smithi179 bash[23186]: audit 2024-09-21T03:18:03.114715+0000 mgr.a (mgr.14388) 13140 : audit [DBG] from='client.286359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:05.282 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:04 smithi179 bash[23186]: cluster 2024-09-21T03:18:03.247605+0000 mgr.a (mgr.14388) 13141 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:06 smithi044 bash[22676]: cluster 2024-09-21T03:18:05.249905+0000 mgr.a (mgr.14388) 13142 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:07.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:06 smithi179 bash[23186]: cluster 2024-09-21T03:18:05.249905+0000 mgr.a (mgr.14388) 13142 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:06 smithi049 bash[23528]: cluster 2024-09-21T03:18:05.249905+0000 mgr.a (mgr.14388) 13142 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:08.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:08.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:08.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:08 smithi044 bash[22676]: cluster 2024-09-21T03:18:07.250691+0000 mgr.a (mgr.14388) 13143 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:08 smithi044 bash[22676]: audit 2024-09-21T03:18:08.127493+0000 mon.a (mon.0) 10662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:08 smithi044 bash[22676]: audit 2024-09-21T03:18:08.136207+0000 mon.a (mon.0) 10663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:08 smithi044 bash[22676]: audit 2024-09-21T03:18:08.146797+0000 mon.a (mon.0) 10664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:08 smithi179 bash[23186]: cluster 2024-09-21T03:18:07.250691+0000 mgr.a (mgr.14388) 13143 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:08 smithi179 bash[23186]: audit 2024-09-21T03:18:08.127493+0000 mon.a (mon.0) 10662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:08 smithi179 bash[23186]: audit 2024-09-21T03:18:08.136207+0000 mon.a (mon.0) 10663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:08 smithi179 bash[23186]: audit 2024-09-21T03:18:08.146797+0000 mon.a (mon.0) 10664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:08 smithi049 bash[23528]: cluster 2024-09-21T03:18:07.250691+0000 mgr.a (mgr.14388) 13143 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:08 smithi049 bash[23528]: audit 2024-09-21T03:18:08.127493+0000 mon.a (mon.0) 10662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:08 smithi049 bash[23528]: audit 2024-09-21T03:18:08.136207+0000 mon.a (mon.0) 10663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:08 smithi049 bash[23528]: audit 2024-09-21T03:18:08.146797+0000 mon.a (mon.0) 10664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:09.347 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:09.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:09.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:09.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:09.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:10.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:09 smithi044 bash[22676]: audit 2024-09-21T03:18:08.903105+0000 mgr.a (mgr.14388) 13144 : audit [DBG] from='client.286431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:10.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:09 smithi179 bash[23186]: audit 2024-09-21T03:18:08.903105+0000 mgr.a (mgr.14388) 13144 : audit [DBG] from='client.286431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:09 smithi049 bash[23528]: audit 2024-09-21T03:18:08.903105+0000 mgr.a (mgr.14388) 13144 : audit [DBG] from='client.286431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:11.197 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:10 smithi044 bash[22676]: cluster 2024-09-21T03:18:09.251333+0000 mgr.a (mgr.14388) 13145 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:10 smithi179 bash[23186]: cluster 2024-09-21T03:18:09.251333+0000 mgr.a (mgr.14388) 13145 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:10 smithi049 bash[23528]: cluster 2024-09-21T03:18:09.251333+0000 mgr.a (mgr.14388) 13145 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:12 smithi044 bash[22676]: cluster 2024-09-21T03:18:11.252471+0000 mgr.a (mgr.14388) 13146 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:12 smithi179 bash[23186]: cluster 2024-09-21T03:18:11.252471+0000 mgr.a (mgr.14388) 13146 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:12 smithi049 bash[23528]: cluster 2024-09-21T03:18:11.252471+0000 mgr.a (mgr.14388) 13146 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:14.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:14.349 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:14.349 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:15.114 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:14 smithi044 bash[22676]: cluster 2024-09-21T03:18:13.253106+0000 mgr.a (mgr.14388) 13147 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:14 smithi179 bash[23186]: cluster 2024-09-21T03:18:13.253106+0000 mgr.a (mgr.14388) 13147 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:14 smithi049 bash[23528]: cluster 2024-09-21T03:18:13.253106+0000 mgr.a (mgr.14388) 13147 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:15 smithi044 bash[22676]: audit 2024-09-21T03:18:14.684453+0000 mgr.a (mgr.14388) 13148 : audit [DBG] from='client.286509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:16.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:15 smithi179 bash[23186]: audit 2024-09-21T03:18:14.684453+0000 mgr.a (mgr.14388) 13148 : audit [DBG] from='client.286509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:15 smithi049 bash[23528]: audit 2024-09-21T03:18:14.684453+0000 mgr.a (mgr.14388) 13148 : audit [DBG] from='client.286509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:16 smithi044 bash[22676]: cluster 2024-09-21T03:18:15.255858+0000 mgr.a (mgr.14388) 13149 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:18:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:16 smithi179 bash[23186]: cluster 2024-09-21T03:18:15.255858+0000 mgr.a (mgr.14388) 13149 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:18:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:16 smithi049 bash[23528]: cluster 2024-09-21T03:18:15.255858+0000 mgr.a (mgr.14388) 13149 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:18:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:18 smithi044 bash[22676]: cluster 2024-09-21T03:18:17.256650+0000 mgr.a (mgr.14388) 13150 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:18:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:18 smithi179 bash[23186]: cluster 2024-09-21T03:18:17.256650+0000 mgr.a (mgr.14388) 13150 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:18:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:18 smithi049 bash[23528]: cluster 2024-09-21T03:18:17.256650+0000 mgr.a (mgr.14388) 13150 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:18:20.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:20.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:20.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:20.881 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:20.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:20 smithi044 bash[22676]: cluster 2024-09-21T03:18:19.257448+0000 mgr.a (mgr.14388) 13151 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:18:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:20 smithi044 bash[22676]: audit 2024-09-21T03:18:20.565005+0000 mon.a (mon.0) 10665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:20 smithi044 bash[22676]: audit 2024-09-21T03:18:20.571974+0000 mon.a (mon.0) 10666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:20 smithi044 bash[22676]: audit 2024-09-21T03:18:20.579846+0000 mon.a (mon.0) 10667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:20 smithi044 bash[22676]: audit 2024-09-21T03:18:20.814785+0000 mon.a (mon.0) 10668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:20 smithi044 bash[22676]: audit 2024-09-21T03:18:20.821279+0000 mon.a (mon.0) 10669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:20 smithi044 bash[22676]: audit 2024-09-21T03:18:20.828249+0000 mon.a (mon.0) 10670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:20 smithi179 bash[23186]: cluster 2024-09-21T03:18:19.257448+0000 mgr.a (mgr.14388) 13151 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:18:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:20 smithi179 bash[23186]: audit 2024-09-21T03:18:20.565005+0000 mon.a (mon.0) 10665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:20 smithi179 bash[23186]: audit 2024-09-21T03:18:20.571974+0000 mon.a (mon.0) 10666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:20 smithi179 bash[23186]: audit 2024-09-21T03:18:20.579846+0000 mon.a (mon.0) 10667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:20 smithi179 bash[23186]: audit 2024-09-21T03:18:20.814785+0000 mon.a (mon.0) 10668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:20 smithi179 bash[23186]: audit 2024-09-21T03:18:20.821279+0000 mon.a (mon.0) 10669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:20 smithi179 bash[23186]: audit 2024-09-21T03:18:20.828249+0000 mon.a (mon.0) 10670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:20 smithi049 bash[23528]: cluster 2024-09-21T03:18:19.257448+0000 mgr.a (mgr.14388) 13151 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:18:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:20 smithi049 bash[23528]: audit 2024-09-21T03:18:20.565005+0000 mon.a (mon.0) 10665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:20 smithi049 bash[23528]: audit 2024-09-21T03:18:20.571974+0000 mon.a (mon.0) 10666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:20 smithi049 bash[23528]: audit 2024-09-21T03:18:20.579846+0000 mon.a (mon.0) 10667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:20 smithi049 bash[23528]: audit 2024-09-21T03:18:20.814785+0000 mon.a (mon.0) 10668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:20 smithi049 bash[23528]: audit 2024-09-21T03:18:20.821279+0000 mon.a (mon.0) 10669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:20 smithi049 bash[23528]: audit 2024-09-21T03:18:20.828249+0000 mon.a (mon.0) 10670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:22.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:21 smithi179 bash[23186]: audit 2024-09-21T03:18:20.445978+0000 mgr.a (mgr.14388) 13152 : audit [DBG] from='client.286587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:22.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:21 smithi049 bash[23528]: audit 2024-09-21T03:18:20.445978+0000 mgr.a (mgr.14388) 13152 : audit [DBG] from='client.286587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:21 smithi044 bash[22676]: audit 2024-09-21T03:18:20.445978+0000 mgr.a (mgr.14388) 13152 : audit [DBG] from='client.286587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:22 smithi179 bash[23186]: cluster 2024-09-21T03:18:21.260116+0000 mgr.a (mgr.14388) 13153 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:22 smithi049 bash[23528]: cluster 2024-09-21T03:18:21.260116+0000 mgr.a (mgr.14388) 13153 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:22 smithi044 bash[22676]: cluster 2024-09-21T03:18:21.260116+0000 mgr.a (mgr.14388) 13153 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:24 smithi179 bash[23186]: cluster 2024-09-21T03:18:23.260924+0000 mgr.a (mgr.14388) 13154 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:18:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:24 smithi049 bash[23528]: cluster 2024-09-21T03:18:23.260924+0000 mgr.a (mgr.14388) 13154 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:18:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:24 smithi044 bash[22676]: cluster 2024-09-21T03:18:23.260924+0000 mgr.a (mgr.14388) 13154 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:18:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:26.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:26.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:26.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:26.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:26.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:27 smithi179 bash[23186]: cluster 2024-09-21T03:18:25.262990+0000 mgr.a (mgr.14388) 13155 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:27 smithi049 bash[23528]: cluster 2024-09-21T03:18:25.262990+0000 mgr.a (mgr.14388) 13155 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:27 smithi044 bash[22676]: cluster 2024-09-21T03:18:25.262990+0000 mgr.a (mgr.14388) 13155 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:28 smithi049 bash[23528]: audit 2024-09-21T03:18:26.219938+0000 mgr.a (mgr.14388) 13156 : audit [DBG] from='client.286665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:28 smithi044 bash[22676]: audit 2024-09-21T03:18:26.219938+0000 mgr.a (mgr.14388) 13156 : audit [DBG] from='client.286665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:28.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:28 smithi179 bash[23186]: audit 2024-09-21T03:18:26.219938+0000 mgr.a (mgr.14388) 13156 : audit [DBG] from='client.286665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:29 smithi049 bash[23528]: cluster 2024-09-21T03:18:27.263900+0000 mgr.a (mgr.14388) 13157 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:18:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:29 smithi049 bash[23528]: audit 2024-09-21T03:18:28.362701+0000 mon.a (mon.0) 10671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:29 smithi049 bash[23528]: audit 2024-09-21T03:18:28.372473+0000 mon.a (mon.0) 10672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:29 smithi049 bash[23528]: audit 2024-09-21T03:18:28.384363+0000 mon.a (mon.0) 10673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:29 smithi044 bash[22676]: cluster 2024-09-21T03:18:27.263900+0000 mgr.a (mgr.14388) 13157 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:18:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:29 smithi044 bash[22676]: audit 2024-09-21T03:18:28.362701+0000 mon.a (mon.0) 10671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:29 smithi044 bash[22676]: audit 2024-09-21T03:18:28.372473+0000 mon.a (mon.0) 10672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:29 smithi044 bash[22676]: audit 2024-09-21T03:18:28.384363+0000 mon.a (mon.0) 10673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:29 smithi179 bash[23186]: cluster 2024-09-21T03:18:27.263900+0000 mgr.a (mgr.14388) 13157 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:18:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:29 smithi179 bash[23186]: audit 2024-09-21T03:18:28.362701+0000 mon.a (mon.0) 10671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:29 smithi179 bash[23186]: audit 2024-09-21T03:18:28.372473+0000 mon.a (mon.0) 10672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:29 smithi179 bash[23186]: audit 2024-09-21T03:18:28.384363+0000 mon.a (mon.0) 10673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:31 smithi044 bash[22676]: cluster 2024-09-21T03:18:29.264701+0000 mgr.a (mgr.14388) 13158 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:18:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:31 smithi179 bash[23186]: cluster 2024-09-21T03:18:29.264701+0000 mgr.a (mgr.14388) 13158 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:18:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:31 smithi049 bash[23528]: cluster 2024-09-21T03:18:29.264701+0000 mgr.a (mgr.14388) 13158 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:18:31.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:31.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:31.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:32.437 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:32.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:32.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:32.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:32.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:33.289 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:33 smithi179 bash[23186]: cluster 2024-09-21T03:18:31.266940+0000 mgr.a (mgr.14388) 13159 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:18:33.289 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:33 smithi179 bash[23186]: audit 2024-09-21T03:18:32.004219+0000 mgr.a (mgr.14388) 13160 : audit [DBG] from='client.286740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:33 smithi049 bash[23528]: cluster 2024-09-21T03:18:31.266940+0000 mgr.a (mgr.14388) 13159 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:18:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:33 smithi049 bash[23528]: audit 2024-09-21T03:18:32.004219+0000 mgr.a (mgr.14388) 13160 : audit [DBG] from='client.286740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:33 smithi044 bash[22676]: cluster 2024-09-21T03:18:31.266940+0000 mgr.a (mgr.14388) 13159 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:18:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:33 smithi044 bash[22676]: audit 2024-09-21T03:18:32.004219+0000 mgr.a (mgr.14388) 13160 : audit [DBG] from='client.286740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:35 smithi049 bash[23528]: cluster 2024-09-21T03:18:33.267460+0000 mgr.a (mgr.14388) 13161 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:35 smithi044 bash[22676]: cluster 2024-09-21T03:18:33.267460+0000 mgr.a (mgr.14388) 13161 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:35 smithi179 bash[23186]: cluster 2024-09-21T03:18:33.267460+0000 mgr.a (mgr.14388) 13161 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:37 smithi049 bash[23528]: cluster 2024-09-21T03:18:35.269721+0000 mgr.a (mgr.14388) 13162 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:37.440 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:37.440 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:37 smithi044 bash[22676]: cluster 2024-09-21T03:18:35.269721+0000 mgr.a (mgr.14388) 13162 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:37 smithi179 bash[23186]: cluster 2024-09-21T03:18:35.269721+0000 mgr.a (mgr.14388) 13162 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:38.186 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:38.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:38.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:38.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:38.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:39 smithi049 bash[23528]: cluster 2024-09-21T03:18:37.270484+0000 mgr.a (mgr.14388) 13163 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:39 smithi049 bash[23528]: audit 2024-09-21T03:18:37.771248+0000 mgr.a (mgr.14388) 13164 : audit [DBG] from='client.286815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:39 smithi044 bash[22676]: cluster 2024-09-21T03:18:37.270484+0000 mgr.a (mgr.14388) 13163 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:39 smithi044 bash[22676]: audit 2024-09-21T03:18:37.771248+0000 mgr.a (mgr.14388) 13164 : audit [DBG] from='client.286815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:39 smithi179 bash[23186]: cluster 2024-09-21T03:18:37.270484+0000 mgr.a (mgr.14388) 13163 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:39 smithi179 bash[23186]: audit 2024-09-21T03:18:37.771248+0000 mgr.a (mgr.14388) 13164 : audit [DBG] from='client.286815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:41 smithi044 bash[22676]: cluster 2024-09-21T03:18:39.271560+0000 mgr.a (mgr.14388) 13165 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:41 smithi044 bash[22676]: audit 2024-09-21T03:18:40.813503+0000 mon.a (mon.0) 10674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:41 smithi044 bash[22676]: audit 2024-09-21T03:18:40.821064+0000 mon.a (mon.0) 10675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:41 smithi044 bash[22676]: audit 2024-09-21T03:18:40.830891+0000 mon.a (mon.0) 10676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:41 smithi049 bash[23528]: cluster 2024-09-21T03:18:39.271560+0000 mgr.a (mgr.14388) 13165 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:41 smithi049 bash[23528]: audit 2024-09-21T03:18:40.813503+0000 mon.a (mon.0) 10674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:41 smithi049 bash[23528]: audit 2024-09-21T03:18:40.821064+0000 mon.a (mon.0) 10675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:41 smithi049 bash[23528]: audit 2024-09-21T03:18:40.830891+0000 mon.a (mon.0) 10676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:41 smithi179 bash[23186]: cluster 2024-09-21T03:18:39.271560+0000 mgr.a (mgr.14388) 13165 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:41 smithi179 bash[23186]: audit 2024-09-21T03:18:40.813503+0000 mon.a (mon.0) 10674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:41 smithi179 bash[23186]: audit 2024-09-21T03:18:40.821064+0000 mon.a (mon.0) 10675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:41 smithi179 bash[23186]: audit 2024-09-21T03:18:40.830891+0000 mon.a (mon.0) 10676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:42 smithi049 bash[23528]: audit 2024-09-21T03:18:41.041162+0000 mon.a (mon.0) 10677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:42 smithi049 bash[23528]: audit 2024-09-21T03:18:41.055099+0000 mon.a (mon.0) 10678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:42 smithi049 bash[23528]: audit 2024-09-21T03:18:41.065225+0000 mon.a (mon.0) 10679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:42 smithi044 bash[22676]: audit 2024-09-21T03:18:41.041162+0000 mon.a (mon.0) 10677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:42 smithi044 bash[22676]: audit 2024-09-21T03:18:41.055099+0000 mon.a (mon.0) 10678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:42 smithi044 bash[22676]: audit 2024-09-21T03:18:41.065225+0000 mon.a (mon.0) 10679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:42 smithi179 bash[23186]: audit 2024-09-21T03:18:41.041162+0000 mon.a (mon.0) 10677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:42 smithi179 bash[23186]: audit 2024-09-21T03:18:41.055099+0000 mon.a (mon.0) 10678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:42 smithi179 bash[23186]: audit 2024-09-21T03:18:41.065225+0000 mon.a (mon.0) 10679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:43.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:43.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:43.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:43.389 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:43 smithi049 bash[23528]: cluster 2024-09-21T03:18:41.273864+0000 mgr.a (mgr.14388) 13166 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:43 smithi044 bash[22676]: cluster 2024-09-21T03:18:41.273864+0000 mgr.a (mgr.14388) 13166 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:43 smithi179 bash[23186]: cluster 2024-09-21T03:18:41.273864+0000 mgr.a (mgr.14388) 13166 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:43.972 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:43.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:45.344 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:45 smithi049 bash[23528]: cluster 2024-09-21T03:18:43.274409+0000 mgr.a (mgr.14388) 13167 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:45.344 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:45 smithi049 bash[23528]: audit 2024-09-21T03:18:43.519650+0000 mgr.a (mgr.14388) 13168 : audit [DBG] from='client.286893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:45 smithi044 bash[22676]: cluster 2024-09-21T03:18:43.274409+0000 mgr.a (mgr.14388) 13167 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:45 smithi044 bash[22676]: audit 2024-09-21T03:18:43.519650+0000 mgr.a (mgr.14388) 13168 : audit [DBG] from='client.286893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:45 smithi179 bash[23186]: cluster 2024-09-21T03:18:43.274409+0000 mgr.a (mgr.14388) 13167 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:45 smithi179 bash[23186]: audit 2024-09-21T03:18:43.519650+0000 mgr.a (mgr.14388) 13168 : audit [DBG] from='client.286893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:47 smithi044 bash[22676]: cluster 2024-09-21T03:18:45.276733+0000 mgr.a (mgr.14388) 13169 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:47 smithi179 bash[23186]: cluster 2024-09-21T03:18:45.276733+0000 mgr.a (mgr.14388) 13169 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:47 smithi049 bash[23528]: cluster 2024-09-21T03:18:45.276733+0000 mgr.a (mgr.14388) 13169 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:18:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:48 smithi044 bash[22676]: audit 2024-09-21T03:18:47.706219+0000 mon.a (mon.0) 10680 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:18:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:48 smithi044 bash[22676]: audit 2024-09-21T03:18:47.713447+0000 mon.a (mon.0) 10681 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:18:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:48 smithi044 bash[22676]: audit 2024-09-21T03:18:47.715365+0000 mon.a (mon.0) 10682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:18:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:48 smithi044 bash[22676]: audit 2024-09-21T03:18:47.727227+0000 mon.a (mon.0) 10683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:48 smithi044 bash[22676]: audit 2024-09-21T03:18:47.733576+0000 mon.a (mon.0) 10684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:18:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:48 smithi179 bash[23186]: audit 2024-09-21T03:18:47.706219+0000 mon.a (mon.0) 10680 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:18:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:48 smithi179 bash[23186]: audit 2024-09-21T03:18:47.713447+0000 mon.a (mon.0) 10681 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:18:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:48 smithi179 bash[23186]: audit 2024-09-21T03:18:47.715365+0000 mon.a (mon.0) 10682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:18:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:48 smithi179 bash[23186]: audit 2024-09-21T03:18:47.727227+0000 mon.a (mon.0) 10683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:48 smithi179 bash[23186]: audit 2024-09-21T03:18:47.733576+0000 mon.a (mon.0) 10684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:18:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:48 smithi049 bash[23528]: audit 2024-09-21T03:18:47.706219+0000 mon.a (mon.0) 10680 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:18:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:48 smithi049 bash[23528]: audit 2024-09-21T03:18:47.713447+0000 mon.a (mon.0) 10681 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:18:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:48 smithi049 bash[23528]: audit 2024-09-21T03:18:47.715365+0000 mon.a (mon.0) 10682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:18:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:48 smithi049 bash[23528]: audit 2024-09-21T03:18:47.727227+0000 mon.a (mon.0) 10683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:48 smithi049 bash[23528]: audit 2024-09-21T03:18:47.733576+0000 mon.a (mon.0) 10684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:18:48.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:48.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:48.974 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:48.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:18:48 smithi044 bash[22930]: debug 2024-09-21T03:18:48.530+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:18:48.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:18:48 smithi044 bash[22930]: debug 2024-09-21T03:18:48.534+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:18:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:49 smithi044 bash[22676]: cluster 2024-09-21T03:18:47.277529+0000 mgr.a (mgr.14388) 13170 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:49 smithi044 bash[22676]: audit 2024-09-21T03:18:47.736019+0000 mgr.a (mgr.14388) 13171 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:18:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:49 smithi044 bash[22676]: audit 2024-09-21T03:18:48.594048+0000 mon.a (mon.0) 10685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:49 smithi044 bash[22676]: audit 2024-09-21T03:18:48.600941+0000 mon.a (mon.0) 10686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:49 smithi044 bash[22676]: audit 2024-09-21T03:18:48.608968+0000 mon.a (mon.0) 10687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:49 smithi179 bash[23186]: cluster 2024-09-21T03:18:47.277529+0000 mgr.a (mgr.14388) 13170 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:49 smithi179 bash[23186]: audit 2024-09-21T03:18:47.736019+0000 mgr.a (mgr.14388) 13171 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:49 smithi179 bash[23186]: audit 2024-09-21T03:18:48.594048+0000 mon.a (mon.0) 10685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:49 smithi179 bash[23186]: audit 2024-09-21T03:18:48.600941+0000 mon.a (mon.0) 10686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:49 smithi179 bash[23186]: audit 2024-09-21T03:18:48.608968+0000 mon.a (mon.0) 10687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:49 smithi049 bash[23528]: cluster 2024-09-21T03:18:47.277529+0000 mgr.a (mgr.14388) 13170 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:49 smithi049 bash[23528]: audit 2024-09-21T03:18:47.736019+0000 mgr.a (mgr.14388) 13171 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:49 smithi049 bash[23528]: audit 2024-09-21T03:18:48.594048+0000 mon.a (mon.0) 10685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:49 smithi049 bash[23528]: audit 2024-09-21T03:18:48.600941+0000 mon.a (mon.0) 10686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:49 smithi049 bash[23528]: audit 2024-09-21T03:18:48.608968+0000 mon.a (mon.0) 10687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:18:49.734 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:49.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:49.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:49.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:50 smithi179 bash[23186]: audit 2024-09-21T03:18:48.535382+0000 mgr.a (mgr.14388) 13172 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:18:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:50 smithi179 bash[23186]: cephadm 2024-09-21T03:18:48.537421+0000 mgr.a (mgr.14388) 13173 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:18:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:50 smithi044 bash[22676]: audit 2024-09-21T03:18:48.535382+0000 mgr.a (mgr.14388) 13172 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:18:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:50 smithi044 bash[22676]: cephadm 2024-09-21T03:18:48.537421+0000 mgr.a (mgr.14388) 13173 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:18:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:50 smithi049 bash[23528]: audit 2024-09-21T03:18:48.535382+0000 mgr.a (mgr.14388) 13172 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:18:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:50 smithi049 bash[23528]: cephadm 2024-09-21T03:18:48.537421+0000 mgr.a (mgr.14388) 13173 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:18:51.344 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:51 smithi179 bash[23186]: cluster 2024-09-21T03:18:49.278082+0000 mgr.a (mgr.14388) 13174 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:51.344 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:51 smithi179 bash[23186]: audit 2024-09-21T03:18:49.305168+0000 mgr.a (mgr.14388) 13175 : audit [DBG] from='client.287073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:51.393 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:51 smithi044 bash[22676]: cluster 2024-09-21T03:18:49.278082+0000 mgr.a (mgr.14388) 13174 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:51.393 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:51 smithi044 bash[22676]: audit 2024-09-21T03:18:49.305168+0000 mgr.a (mgr.14388) 13175 : audit [DBG] from='client.287073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:51 smithi049 bash[23528]: cluster 2024-09-21T03:18:49.278082+0000 mgr.a (mgr.14388) 13174 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:18:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:51 smithi049 bash[23528]: audit 2024-09-21T03:18:49.305168+0000 mgr.a (mgr.14388) 13175 : audit [DBG] from='client.287073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:52 smithi044 bash[22676]: cluster 2024-09-21T03:18:51.280420+0000 mgr.a (mgr.14388) 13176 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:52 smithi179 bash[23186]: cluster 2024-09-21T03:18:51.280420+0000 mgr.a (mgr.14388) 13176 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:52 smithi049 bash[23528]: cluster 2024-09-21T03:18:51.280420+0000 mgr.a (mgr.14388) 13176 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:18:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:18:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:54 smithi044 bash[22676]: cluster 2024-09-21T03:18:53.281176+0000 mgr.a (mgr.14388) 13177 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:18:54.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:54 smithi179 bash[23186]: cluster 2024-09-21T03:18:53.281176+0000 mgr.a (mgr.14388) 13177 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:54 smithi049 bash[23528]: cluster 2024-09-21T03:18:53.281176+0000 mgr.a (mgr.14388) 13177 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:55.496 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:18:55.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:18:55.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:18:55.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:18:55.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:18:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:55 smithi044 bash[22676]: audit 2024-09-21T03:18:55.067874+0000 mgr.a (mgr.14388) 13178 : audit [DBG] from='client.287142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:55.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:55 smithi179 bash[23186]: audit 2024-09-21T03:18:55.067874+0000 mgr.a (mgr.14388) 13178 : audit [DBG] from='client.287142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:55 smithi049 bash[23528]: audit 2024-09-21T03:18:55.067874+0000 mgr.a (mgr.14388) 13178 : audit [DBG] from='client.287142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:18:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:56 smithi044 bash[22676]: cluster 2024-09-21T03:18:55.282707+0000 mgr.a (mgr.14388) 13179 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:56 smithi179 bash[23186]: cluster 2024-09-21T03:18:55.282707+0000 mgr.a (mgr.14388) 13179 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:56 smithi049 bash[23528]: cluster 2024-09-21T03:18:55.282707+0000 mgr.a (mgr.14388) 13179 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:18:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:18:58 smithi044 bash[22676]: cluster 2024-09-21T03:18:57.283579+0000 mgr.a (mgr.14388) 13180 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:18:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:18:58 smithi179 bash[23186]: cluster 2024-09-21T03:18:57.283579+0000 mgr.a (mgr.14388) 13180 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:18:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:18:58 smithi049 bash[23528]: cluster 2024-09-21T03:18:57.283579+0000 mgr.a (mgr.14388) 13180 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:19:00.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:00.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:00.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:00 smithi044 bash[22676]: cluster 2024-09-21T03:18:59.284373+0000 mgr.a (mgr.14388) 13181 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:19:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:00 smithi179 bash[23186]: cluster 2024-09-21T03:18:59.284373+0000 mgr.a (mgr.14388) 13181 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:19:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:00 smithi049 bash[23528]: cluster 2024-09-21T03:18:59.284373+0000 mgr.a (mgr.14388) 13181 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:19:01.274 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:01.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:01.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:01.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:01.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:01 smithi179 bash[23186]: audit 2024-09-21T03:19:00.833501+0000 mgr.a (mgr.14388) 13182 : audit [DBG] from='client.287217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:01 smithi179 bash[23186]: audit 2024-09-21T03:19:00.993697+0000 mon.a (mon.0) 10688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:01 smithi179 bash[23186]: audit 2024-09-21T03:19:00.999607+0000 mon.a (mon.0) 10689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:01 smithi179 bash[23186]: audit 2024-09-21T03:19:01.008185+0000 mon.a (mon.0) 10690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:01 smithi179 bash[23186]: audit 2024-09-21T03:19:01.233961+0000 mon.a (mon.0) 10691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:01 smithi179 bash[23186]: audit 2024-09-21T03:19:01.241183+0000 mon.a (mon.0) 10692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:01 smithi179 bash[23186]: audit 2024-09-21T03:19:01.247715+0000 mon.a (mon.0) 10693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:01 smithi049 bash[23528]: audit 2024-09-21T03:19:00.833501+0000 mgr.a (mgr.14388) 13182 : audit [DBG] from='client.287217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:01 smithi049 bash[23528]: audit 2024-09-21T03:19:00.993697+0000 mon.a (mon.0) 10688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:01 smithi049 bash[23528]: audit 2024-09-21T03:19:00.999607+0000 mon.a (mon.0) 10689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:01 smithi049 bash[23528]: audit 2024-09-21T03:19:01.008185+0000 mon.a (mon.0) 10690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:01 smithi049 bash[23528]: audit 2024-09-21T03:19:01.233961+0000 mon.a (mon.0) 10691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:01 smithi049 bash[23528]: audit 2024-09-21T03:19:01.241183+0000 mon.a (mon.0) 10692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:01 smithi049 bash[23528]: audit 2024-09-21T03:19:01.247715+0000 mon.a (mon.0) 10693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:01 smithi044 bash[22676]: audit 2024-09-21T03:19:00.833501+0000 mgr.a (mgr.14388) 13182 : audit [DBG] from='client.287217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:01 smithi044 bash[22676]: audit 2024-09-21T03:19:00.993697+0000 mon.a (mon.0) 10688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:01 smithi044 bash[22676]: audit 2024-09-21T03:19:00.999607+0000 mon.a (mon.0) 10689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:01 smithi044 bash[22676]: audit 2024-09-21T03:19:01.008185+0000 mon.a (mon.0) 10690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:01 smithi044 bash[22676]: audit 2024-09-21T03:19:01.233961+0000 mon.a (mon.0) 10691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:01 smithi044 bash[22676]: audit 2024-09-21T03:19:01.241183+0000 mon.a (mon.0) 10692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:01 smithi044 bash[22676]: audit 2024-09-21T03:19:01.247715+0000 mon.a (mon.0) 10693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:02 smithi179 bash[23186]: cluster 2024-09-21T03:19:01.285828+0000 mgr.a (mgr.14388) 13183 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:02 smithi049 bash[23528]: cluster 2024-09-21T03:19:01.285828+0000 mgr.a (mgr.14388) 13183 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:02 smithi044 bash[22676]: cluster 2024-09-21T03:19:01.285828+0000 mgr.a (mgr.14388) 13183 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:05 smithi179 bash[23186]: cluster 2024-09-21T03:19:03.286559+0000 mgr.a (mgr.14388) 13184 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:19:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:05 smithi049 bash[23528]: cluster 2024-09-21T03:19:03.286559+0000 mgr.a (mgr.14388) 13184 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:19:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:04 smithi044 bash[22676]: cluster 2024-09-21T03:19:03.286559+0000 mgr.a (mgr.14388) 13184 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:19:06.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:06.278 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:06.278 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:07.050 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:07.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:07.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:07.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:07.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:07 smithi049 bash[23528]: cluster 2024-09-21T03:19:05.288571+0000 mgr.a (mgr.14388) 13185 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:07 smithi044 bash[22676]: cluster 2024-09-21T03:19:05.288571+0000 mgr.a (mgr.14388) 13185 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:07 smithi179 bash[23186]: cluster 2024-09-21T03:19:05.288571+0000 mgr.a (mgr.14388) 13185 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:08 smithi049 bash[23528]: audit 2024-09-21T03:19:06.607516+0000 mgr.a (mgr.14388) 13186 : audit [DBG] from='client.287295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:08 smithi044 bash[22676]: audit 2024-09-21T03:19:06.607516+0000 mgr.a (mgr.14388) 13186 : audit [DBG] from='client.287295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:08 smithi179 bash[23186]: audit 2024-09-21T03:19:06.607516+0000 mgr.a (mgr.14388) 13186 : audit [DBG] from='client.287295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:09 smithi049 bash[23528]: cluster 2024-09-21T03:19:07.289470+0000 mgr.a (mgr.14388) 13187 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:09 smithi049 bash[23528]: audit 2024-09-21T03:19:08.821524+0000 mon.a (mon.0) 10694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:09 smithi049 bash[23528]: audit 2024-09-21T03:19:08.831319+0000 mon.a (mon.0) 10695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:09 smithi049 bash[23528]: audit 2024-09-21T03:19:08.842818+0000 mon.a (mon.0) 10696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:09 smithi044 bash[22676]: cluster 2024-09-21T03:19:07.289470+0000 mgr.a (mgr.14388) 13187 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:09 smithi044 bash[22676]: audit 2024-09-21T03:19:08.821524+0000 mon.a (mon.0) 10694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:09 smithi044 bash[22676]: audit 2024-09-21T03:19:08.831319+0000 mon.a (mon.0) 10695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:09 smithi044 bash[22676]: audit 2024-09-21T03:19:08.842818+0000 mon.a (mon.0) 10696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:09 smithi179 bash[23186]: cluster 2024-09-21T03:19:07.289470+0000 mgr.a (mgr.14388) 13187 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:09 smithi179 bash[23186]: audit 2024-09-21T03:19:08.821524+0000 mon.a (mon.0) 10694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:09 smithi179 bash[23186]: audit 2024-09-21T03:19:08.831319+0000 mon.a (mon.0) 10695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:09 smithi179 bash[23186]: audit 2024-09-21T03:19:08.842818+0000 mon.a (mon.0) 10696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:11 smithi049 bash[23528]: cluster 2024-09-21T03:19:09.290235+0000 mgr.a (mgr.14388) 13188 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:11.404 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:11 smithi179 bash[23186]: cluster 2024-09-21T03:19:09.290235+0000 mgr.a (mgr.14388) 13188 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:11 smithi044 bash[22676]: cluster 2024-09-21T03:19:09.290235+0000 mgr.a (mgr.14388) 13188 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:12.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:12.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:13 smithi044 bash[22676]: cluster 2024-09-21T03:19:11.292420+0000 mgr.a (mgr.14388) 13189 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:13 smithi049 bash[23528]: cluster 2024-09-21T03:19:11.292420+0000 mgr.a (mgr.14388) 13189 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:13 smithi179 bash[23186]: cluster 2024-09-21T03:19:11.292420+0000 mgr.a (mgr.14388) 13189 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:14.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:14 smithi044 bash[22676]: audit 2024-09-21T03:19:12.369696+0000 mgr.a (mgr.14388) 13190 : audit [DBG] from='client.287370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:14.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:14 smithi179 bash[23186]: audit 2024-09-21T03:19:12.369696+0000 mgr.a (mgr.14388) 13190 : audit [DBG] from='client.287370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:14 smithi049 bash[23528]: audit 2024-09-21T03:19:12.369696+0000 mgr.a (mgr.14388) 13190 : audit [DBG] from='client.287370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:15 smithi049 bash[23528]: cluster 2024-09-21T03:19:13.293380+0000 mgr.a (mgr.14388) 13191 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:15 smithi044 bash[22676]: cluster 2024-09-21T03:19:13.293380+0000 mgr.a (mgr.14388) 13191 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:15 smithi179 bash[23186]: cluster 2024-09-21T03:19:13.293380+0000 mgr.a (mgr.14388) 13191 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:17 smithi049 bash[23528]: cluster 2024-09-21T03:19:15.295655+0000 mgr.a (mgr.14388) 13192 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:17 smithi044 bash[22676]: cluster 2024-09-21T03:19:15.295655+0000 mgr.a (mgr.14388) 13192 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:17 smithi179 bash[23186]: cluster 2024-09-21T03:19:15.295655+0000 mgr.a (mgr.14388) 13192 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:17.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:18.569 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:18.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:18.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:18.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:18.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:19 smithi049 bash[23528]: cluster 2024-09-21T03:19:17.296434+0000 mgr.a (mgr.14388) 13193 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:19 smithi044 bash[22676]: cluster 2024-09-21T03:19:17.296434+0000 mgr.a (mgr.14388) 13193 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:19 smithi179 bash[23186]: cluster 2024-09-21T03:19:17.296434+0000 mgr.a (mgr.14388) 13193 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:20 smithi044 bash[22676]: audit 2024-09-21T03:19:18.133403+0000 mgr.a (mgr.14388) 13194 : audit [DBG] from='client.287448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:20 smithi179 bash[23186]: audit 2024-09-21T03:19:18.133403+0000 mgr.a (mgr.14388) 13194 : audit [DBG] from='client.287448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:20 smithi049 bash[23528]: audit 2024-09-21T03:19:18.133403+0000 mgr.a (mgr.14388) 13194 : audit [DBG] from='client.287448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:21.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:21 smithi179 bash[23186]: cluster 2024-09-21T03:19:19.297374+0000 mgr.a (mgr.14388) 13195 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:21 smithi044 bash[22676]: cluster 2024-09-21T03:19:19.297374+0000 mgr.a (mgr.14388) 13195 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:21 smithi049 bash[23528]: cluster 2024-09-21T03:19:19.297374+0000 mgr.a (mgr.14388) 13195 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:22 smithi044 bash[22676]: audit 2024-09-21T03:19:21.228648+0000 mon.a (mon.0) 10697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:22 smithi044 bash[22676]: audit 2024-09-21T03:19:21.236732+0000 mon.a (mon.0) 10698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:22 smithi044 bash[22676]: audit 2024-09-21T03:19:21.247161+0000 mon.a (mon.0) 10699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:22 smithi044 bash[22676]: cluster 2024-09-21T03:19:21.299533+0000 mgr.a (mgr.14388) 13196 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:22 smithi044 bash[22676]: audit 2024-09-21T03:19:21.456738+0000 mon.a (mon.0) 10700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:22 smithi044 bash[22676]: audit 2024-09-21T03:19:21.465237+0000 mon.a (mon.0) 10701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:22 smithi044 bash[22676]: audit 2024-09-21T03:19:21.475411+0000 mon.a (mon.0) 10702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:22 smithi179 bash[23186]: audit 2024-09-21T03:19:21.228648+0000 mon.a (mon.0) 10697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:22 smithi179 bash[23186]: audit 2024-09-21T03:19:21.236732+0000 mon.a (mon.0) 10698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:22 smithi179 bash[23186]: audit 2024-09-21T03:19:21.247161+0000 mon.a (mon.0) 10699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:22 smithi179 bash[23186]: cluster 2024-09-21T03:19:21.299533+0000 mgr.a (mgr.14388) 13196 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:22 smithi179 bash[23186]: audit 2024-09-21T03:19:21.456738+0000 mon.a (mon.0) 10700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:22 smithi179 bash[23186]: audit 2024-09-21T03:19:21.465237+0000 mon.a (mon.0) 10701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:22 smithi179 bash[23186]: audit 2024-09-21T03:19:21.475411+0000 mon.a (mon.0) 10702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:22 smithi049 bash[23528]: audit 2024-09-21T03:19:21.228648+0000 mon.a (mon.0) 10697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:22 smithi049 bash[23528]: audit 2024-09-21T03:19:21.236732+0000 mon.a (mon.0) 10698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:22 smithi049 bash[23528]: audit 2024-09-21T03:19:21.247161+0000 mon.a (mon.0) 10699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:22 smithi049 bash[23528]: cluster 2024-09-21T03:19:21.299533+0000 mgr.a (mgr.14388) 13196 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:22.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:22 smithi049 bash[23528]: audit 2024-09-21T03:19:21.456738+0000 mon.a (mon.0) 10700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:22 smithi049 bash[23528]: audit 2024-09-21T03:19:21.465237+0000 mon.a (mon.0) 10701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:22.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:22 smithi049 bash[23528]: audit 2024-09-21T03:19:21.475411+0000 mon.a (mon.0) 10702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:23.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:24.357 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:24.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:24.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:24.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:24.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:24 smithi049 bash[23528]: cluster 2024-09-21T03:19:23.300274+0000 mgr.a (mgr.14388) 13197 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:24 smithi049 bash[23528]: audit 2024-09-21T03:19:23.904379+0000 mgr.a (mgr.14388) 13198 : audit [DBG] from='client.287526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:24 smithi044 bash[22676]: cluster 2024-09-21T03:19:23.300274+0000 mgr.a (mgr.14388) 13197 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:24 smithi044 bash[22676]: audit 2024-09-21T03:19:23.904379+0000 mgr.a (mgr.14388) 13198 : audit [DBG] from='client.287526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:24 smithi179 bash[23186]: cluster 2024-09-21T03:19:23.300274+0000 mgr.a (mgr.14388) 13197 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:24.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:24 smithi179 bash[23186]: audit 2024-09-21T03:19:23.904379+0000 mgr.a (mgr.14388) 13198 : audit [DBG] from='client.287526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:26.617 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:26 smithi049 bash[23528]: cluster 2024-09-21T03:19:25.302558+0000 mgr.a (mgr.14388) 13199 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:26 smithi044 bash[22676]: cluster 2024-09-21T03:19:25.302558+0000 mgr.a (mgr.14388) 13199 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:26.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:26 smithi179 bash[23186]: cluster 2024-09-21T03:19:25.302558+0000 mgr.a (mgr.14388) 13199 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:19:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:28 smithi044 bash[22676]: cluster 2024-09-21T03:19:27.303324+0000 mgr.a (mgr.14388) 13200 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:28.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:28 smithi179 bash[23186]: cluster 2024-09-21T03:19:27.303324+0000 mgr.a (mgr.14388) 13200 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:28 smithi049 bash[23528]: cluster 2024-09-21T03:19:27.303324+0000 mgr.a (mgr.14388) 13200 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:29.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:30.164 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:30.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:30.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:30.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:30.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:30 smithi044 bash[22676]: audit 2024-09-21T03:19:29.055510+0000 mon.a (mon.0) 10703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:30 smithi044 bash[22676]: audit 2024-09-21T03:19:29.065349+0000 mon.a (mon.0) 10704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:30 smithi044 bash[22676]: audit 2024-09-21T03:19:29.077053+0000 mon.a (mon.0) 10705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:30 smithi179 bash[23186]: audit 2024-09-21T03:19:29.055510+0000 mon.a (mon.0) 10703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:30 smithi179 bash[23186]: audit 2024-09-21T03:19:29.065349+0000 mon.a (mon.0) 10704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:30 smithi179 bash[23186]: audit 2024-09-21T03:19:29.077053+0000 mon.a (mon.0) 10705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:30 smithi049 bash[23528]: audit 2024-09-21T03:19:29.055510+0000 mon.a (mon.0) 10703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:30 smithi049 bash[23528]: audit 2024-09-21T03:19:29.065349+0000 mon.a (mon.0) 10704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:30 smithi049 bash[23528]: audit 2024-09-21T03:19:29.077053+0000 mon.a (mon.0) 10705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:31 smithi044 bash[22676]: cluster 2024-09-21T03:19:29.304067+0000 mgr.a (mgr.14388) 13201 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:31 smithi044 bash[22676]: audit 2024-09-21T03:19:29.699434+0000 mgr.a (mgr.14388) 13202 : audit [DBG] from='client.287604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:31 smithi179 bash[23186]: cluster 2024-09-21T03:19:29.304067+0000 mgr.a (mgr.14388) 13201 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:31 smithi179 bash[23186]: audit 2024-09-21T03:19:29.699434+0000 mgr.a (mgr.14388) 13202 : audit [DBG] from='client.287604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:31 smithi049 bash[23528]: cluster 2024-09-21T03:19:29.304067+0000 mgr.a (mgr.14388) 13201 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:31 smithi049 bash[23528]: audit 2024-09-21T03:19:29.699434+0000 mgr.a (mgr.14388) 13202 : audit [DBG] from='client.287604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:33.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:33 smithi179 bash[23186]: cluster 2024-09-21T03:19:31.306796+0000 mgr.a (mgr.14388) 13203 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:19:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:33 smithi044 bash[22676]: cluster 2024-09-21T03:19:31.306796+0000 mgr.a (mgr.14388) 13203 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:19:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:33 smithi049 bash[23528]: cluster 2024-09-21T03:19:31.306796+0000 mgr.a (mgr.14388) 13203 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:19:35.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:35.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:35.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:35 smithi044 bash[22676]: cluster 2024-09-21T03:19:33.307596+0000 mgr.a (mgr.14388) 13204 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:19:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:35 smithi179 bash[23186]: cluster 2024-09-21T03:19:33.307596+0000 mgr.a (mgr.14388) 13204 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:19:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:35 smithi049 bash[23528]: cluster 2024-09-21T03:19:33.307596+0000 mgr.a (mgr.14388) 13204 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:19:35.953 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:35.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:35.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:35.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:35.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:37 smithi044 bash[22676]: cluster 2024-09-21T03:19:35.309533+0000 mgr.a (mgr.14388) 13205 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:37 smithi044 bash[22676]: audit 2024-09-21T03:19:35.501941+0000 mgr.a (mgr.14388) 13206 : audit [DBG] from='client.287679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:37 smithi179 bash[23186]: cluster 2024-09-21T03:19:35.309533+0000 mgr.a (mgr.14388) 13205 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:37.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:37 smithi179 bash[23186]: audit 2024-09-21T03:19:35.501941+0000 mgr.a (mgr.14388) 13206 : audit [DBG] from='client.287679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:37 smithi049 bash[23528]: cluster 2024-09-21T03:19:35.309533+0000 mgr.a (mgr.14388) 13205 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:37 smithi049 bash[23528]: audit 2024-09-21T03:19:35.501941+0000 mgr.a (mgr.14388) 13206 : audit [DBG] from='client.287679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:39 smithi044 bash[22676]: cluster 2024-09-21T03:19:37.310524+0000 mgr.a (mgr.14388) 13207 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:19:39.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:39 smithi179 bash[23186]: cluster 2024-09-21T03:19:37.310524+0000 mgr.a (mgr.14388) 13207 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:19:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:39 smithi049 bash[23528]: cluster 2024-09-21T03:19:37.310524+0000 mgr.a (mgr.14388) 13207 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:19:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:40.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:40.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:41.428 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:41 smithi044 bash[22676]: cluster 2024-09-21T03:19:39.311484+0000 mgr.a (mgr.14388) 13208 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:19:41.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:41 smithi179 bash[23186]: cluster 2024-09-21T03:19:39.311484+0000 mgr.a (mgr.14388) 13208 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:19:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:41 smithi049 bash[23528]: cluster 2024-09-21T03:19:39.311484+0000 mgr.a (mgr.14388) 13208 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:19:41.741 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: audit 2024-09-21T03:19:41.291150+0000 mgr.a (mgr.14388) 13209 : audit [DBG] from='client.287757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: cluster 2024-09-21T03:19:41.317228+0000 mgr.a (mgr.14388) 13210 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: audit 2024-09-21T03:19:41.414210+0000 mon.a (mon.0) 10706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: audit 2024-09-21T03:19:41.419836+0000 mon.a (mon.0) 10707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: audit 2024-09-21T03:19:41.427699+0000 mon.a (mon.0) 10708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: audit 2024-09-21T03:19:41.659285+0000 mon.a (mon.0) 10709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: audit 2024-09-21T03:19:41.666321+0000 mon.a (mon.0) 10710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:42 smithi049 bash[23528]: audit 2024-09-21T03:19:41.671484+0000 mon.a (mon.0) 10711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: audit 2024-09-21T03:19:41.291150+0000 mgr.a (mgr.14388) 13209 : audit [DBG] from='client.287757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: cluster 2024-09-21T03:19:41.317228+0000 mgr.a (mgr.14388) 13210 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: audit 2024-09-21T03:19:41.414210+0000 mon.a (mon.0) 10706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: audit 2024-09-21T03:19:41.419836+0000 mon.a (mon.0) 10707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: audit 2024-09-21T03:19:41.427699+0000 mon.a (mon.0) 10708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: audit 2024-09-21T03:19:41.659285+0000 mon.a (mon.0) 10709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: audit 2024-09-21T03:19:41.666321+0000 mon.a (mon.0) 10710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:42 smithi044 bash[22676]: audit 2024-09-21T03:19:41.671484+0000 mon.a (mon.0) 10711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: audit 2024-09-21T03:19:41.291150+0000 mgr.a (mgr.14388) 13209 : audit [DBG] from='client.287757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: cluster 2024-09-21T03:19:41.317228+0000 mgr.a (mgr.14388) 13210 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: audit 2024-09-21T03:19:41.414210+0000 mon.a (mon.0) 10706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: audit 2024-09-21T03:19:41.419836+0000 mon.a (mon.0) 10707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: audit 2024-09-21T03:19:41.427699+0000 mon.a (mon.0) 10708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: audit 2024-09-21T03:19:41.659285+0000 mon.a (mon.0) 10709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: audit 2024-09-21T03:19:41.666321+0000 mon.a (mon.0) 10710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:42.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:42 smithi179 bash[23186]: audit 2024-09-21T03:19:41.671484+0000 mon.a (mon.0) 10711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:44.667 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:44 smithi049 bash[23528]: cluster 2024-09-21T03:19:43.318157+0000 mgr.a (mgr.14388) 13211 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:19:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:44 smithi044 bash[22676]: cluster 2024-09-21T03:19:43.318157+0000 mgr.a (mgr.14388) 13211 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:19:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:44 smithi179 bash[23186]: cluster 2024-09-21T03:19:43.318157+0000 mgr.a (mgr.14388) 13211 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:19:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:46 smithi044 bash[22676]: cluster 2024-09-21T03:19:45.320290+0000 mgr.a (mgr.14388) 13212 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:19:46.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:46.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:46.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:46 smithi179 bash[23186]: cluster 2024-09-21T03:19:45.320290+0000 mgr.a (mgr.14388) 13212 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:19:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:46 smithi049 bash[23528]: cluster 2024-09-21T03:19:45.320290+0000 mgr.a (mgr.14388) 13212 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:19:47.528 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:47.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:47 smithi044 bash[22676]: audit 2024-09-21T03:19:47.082482+0000 mgr.a (mgr.14388) 13213 : audit [DBG] from='client.287832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:47.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:47 smithi179 bash[23186]: audit 2024-09-21T03:19:47.082482+0000 mgr.a (mgr.14388) 13213 : audit [DBG] from='client.287832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:47 smithi049 bash[23528]: audit 2024-09-21T03:19:47.082482+0000 mgr.a (mgr.14388) 13213 : audit [DBG] from='client.287832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:48 smithi044 bash[22676]: cluster 2024-09-21T03:19:47.329846+0000 mgr.a (mgr.14388) 13214 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:48.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:48 smithi179 bash[23186]: cluster 2024-09-21T03:19:47.329846+0000 mgr.a (mgr.14388) 13214 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:48 smithi049 bash[23528]: cluster 2024-09-21T03:19:47.329846+0000 mgr.a (mgr.14388) 13214 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:48.613838+0000 mon.a (mon.0) 10712 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:19:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:48.621126+0000 mon.a (mon.0) 10713 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:19:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:48.623258+0000 mon.a (mon.0) 10714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:19:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:48.634739+0000 mon.a (mon.0) 10715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:48.641265+0000 mon.a (mon.0) 10716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:19:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:48.644215+0000 mgr.a (mgr.14388) 13215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:19:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:49.268266+0000 mon.a (mon.0) 10717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:49.274710+0000 mon.a (mon.0) 10718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:49 smithi049 bash[23528]: audit 2024-09-21T03:19:49.279819+0000 mon.a (mon.0) 10719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22930]: debug 2024-09-21T03:19:49.409+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:19:49.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22930]: debug 2024-09-21T03:19:49.421+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:19:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:48.613838+0000 mon.a (mon.0) 10712 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:19:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:48.621126+0000 mon.a (mon.0) 10713 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:19:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:48.623258+0000 mon.a (mon.0) 10714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:19:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:48.634739+0000 mon.a (mon.0) 10715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:48.641265+0000 mon.a (mon.0) 10716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:19:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:48.644215+0000 mgr.a (mgr.14388) 13215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:19:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:49.268266+0000 mon.a (mon.0) 10717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:49.274710+0000 mon.a (mon.0) 10718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:49 smithi044 bash[22676]: audit 2024-09-21T03:19:49.279819+0000 mon.a (mon.0) 10719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:48.613838+0000 mon.a (mon.0) 10712 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:19:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:48.621126+0000 mon.a (mon.0) 10713 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:19:49.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:48.623258+0000 mon.a (mon.0) 10714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:19:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:48.634739+0000 mon.a (mon.0) 10715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:48.641265+0000 mon.a (mon.0) 10716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:19:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:48.644215+0000 mgr.a (mgr.14388) 13215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:19:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:49.268266+0000 mon.a (mon.0) 10717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:49.274710+0000 mon.a (mon.0) 10718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:49 smithi179 bash[23186]: audit 2024-09-21T03:19:49.279819+0000 mon.a (mon.0) 10719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:19:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:50 smithi044 bash[22676]: cluster 2024-09-21T03:19:49.330377+0000 mgr.a (mgr.14388) 13216 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:50 smithi044 bash[22676]: audit 2024-09-21T03:19:49.416197+0000 mgr.a (mgr.14388) 13217 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:19:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:50 smithi044 bash[22676]: cephadm 2024-09-21T03:19:49.427052+0000 mgr.a (mgr.14388) 13218 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:19:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:50 smithi179 bash[23186]: cluster 2024-09-21T03:19:49.330377+0000 mgr.a (mgr.14388) 13216 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:50 smithi179 bash[23186]: audit 2024-09-21T03:19:49.416197+0000 mgr.a (mgr.14388) 13217 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:19:50.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:50 smithi179 bash[23186]: cephadm 2024-09-21T03:19:49.427052+0000 mgr.a (mgr.14388) 13218 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:19:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:50 smithi049 bash[23528]: cluster 2024-09-21T03:19:49.330377+0000 mgr.a (mgr.14388) 13216 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:19:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:50 smithi049 bash[23528]: audit 2024-09-21T03:19:49.416197+0000 mgr.a (mgr.14388) 13217 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:19:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:50 smithi049 bash[23528]: cephadm 2024-09-21T03:19:49.427052+0000 mgr.a (mgr.14388) 13218 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:19:52.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:52.530 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:52.530 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:52.693 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:52 smithi044 bash[22676]: cluster 2024-09-21T03:19:51.332677+0000 mgr.a (mgr.14388) 13219 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T03:19:52.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:52 smithi179 bash[23186]: cluster 2024-09-21T03:19:51.332677+0000 mgr.a (mgr.14388) 13219 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T03:19:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:52 smithi049 bash[23528]: cluster 2024-09-21T03:19:51.332677+0000 mgr.a (mgr.14388) 13219 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T03:19:53.308 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:53.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:53.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:53.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:53.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:53.698 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:53 smithi044 bash[22676]: audit 2024-09-21T03:19:52.863693+0000 mgr.a (mgr.14388) 13220 : audit [DBG] from='client.288012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:53.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:53 smithi179 bash[23186]: audit 2024-09-21T03:19:52.863693+0000 mgr.a (mgr.14388) 13220 : audit [DBG] from='client.288012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:53 smithi049 bash[23528]: audit 2024-09-21T03:19:52.863693+0000 mgr.a (mgr.14388) 13220 : audit [DBG] from='client.288012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:54 smithi044 bash[22676]: cluster 2024-09-21T03:19:53.333368+0000 mgr.a (mgr.14388) 13221 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T03:19:54.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:54 smithi179 bash[23186]: cluster 2024-09-21T03:19:53.333368+0000 mgr.a (mgr.14388) 13221 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T03:19:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:54 smithi049 bash[23528]: cluster 2024-09-21T03:19:53.333368+0000 mgr.a (mgr.14388) 13221 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T03:19:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:56 smithi044 bash[22676]: cluster 2024-09-21T03:19:55.335725+0000 mgr.a (mgr.14388) 13222 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:56.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:56 smithi179 bash[23186]: cluster 2024-09-21T03:19:55.335725+0000 mgr.a (mgr.14388) 13222 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:56 smithi049 bash[23528]: cluster 2024-09-21T03:19:55.335725+0000 mgr.a (mgr.14388) 13222 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:58.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:19:58.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:19:58.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:19:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:58 smithi044 bash[22676]: cluster 2024-09-21T03:19:57.336693+0000 mgr.a (mgr.14388) 13223 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:58.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:58 smithi179 bash[23186]: cluster 2024-09-21T03:19:57.336693+0000 mgr.a (mgr.14388) 13223 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:58 smithi049 bash[23528]: cluster 2024-09-21T03:19:57.336693+0000 mgr.a (mgr.14388) 13223 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:19:59.080 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:19:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:19:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:19:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:19:59.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:19:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:19:59 smithi044 bash[22676]: audit 2024-09-21T03:19:58.642508+0000 mgr.a (mgr.14388) 13224 : audit [DBG] from='client.288087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:59.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:19:59 smithi179 bash[23186]: audit 2024-09-21T03:19:58.642508+0000 mgr.a (mgr.14388) 13224 : audit [DBG] from='client.288087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:19:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:19:59 smithi049 bash[23528]: audit 2024-09-21T03:19:58.642508+0000 mgr.a (mgr.14388) 13224 : audit [DBG] from='client.288087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:00 smithi044 bash[22676]: cluster 2024-09-21T03:19:59.337764+0000 mgr.a (mgr.14388) 13225 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:00 smithi044 bash[22676]: cluster 2024-09-21T03:20:00.000155+0000 mon.a (mon.0) 10720 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:20:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:00 smithi179 bash[23186]: cluster 2024-09-21T03:19:59.337764+0000 mgr.a (mgr.14388) 13225 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:00.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:00 smithi179 bash[23186]: cluster 2024-09-21T03:20:00.000155+0000 mon.a (mon.0) 10720 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:20:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:00 smithi049 bash[23528]: cluster 2024-09-21T03:19:59.337764+0000 mgr.a (mgr.14388) 13225 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:00 smithi049 bash[23528]: cluster 2024-09-21T03:20:00.000155+0000 mon.a (mon.0) 10720 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:20:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:02 smithi044 bash[22676]: cluster 2024-09-21T03:20:01.339979+0000 mgr.a (mgr.14388) 13226 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:02 smithi044 bash[22676]: audit 2024-09-21T03:20:01.620989+0000 mon.a (mon.0) 10721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:02 smithi044 bash[22676]: audit 2024-09-21T03:20:01.627801+0000 mon.a (mon.0) 10722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:02 smithi044 bash[22676]: audit 2024-09-21T03:20:01.636502+0000 mon.a (mon.0) 10723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:02 smithi044 bash[22676]: audit 2024-09-21T03:20:01.887914+0000 mon.a (mon.0) 10724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:02 smithi044 bash[22676]: audit 2024-09-21T03:20:01.896987+0000 mon.a (mon.0) 10725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:02 smithi044 bash[22676]: audit 2024-09-21T03:20:01.907234+0000 mon.a (mon.0) 10726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:02 smithi179 bash[23186]: cluster 2024-09-21T03:20:01.339979+0000 mgr.a (mgr.14388) 13226 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:02 smithi179 bash[23186]: audit 2024-09-21T03:20:01.620989+0000 mon.a (mon.0) 10721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:02 smithi179 bash[23186]: audit 2024-09-21T03:20:01.627801+0000 mon.a (mon.0) 10722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:02 smithi179 bash[23186]: audit 2024-09-21T03:20:01.636502+0000 mon.a (mon.0) 10723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:02 smithi179 bash[23186]: audit 2024-09-21T03:20:01.887914+0000 mon.a (mon.0) 10724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:02 smithi179 bash[23186]: audit 2024-09-21T03:20:01.896987+0000 mon.a (mon.0) 10725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:02 smithi179 bash[23186]: audit 2024-09-21T03:20:01.907234+0000 mon.a (mon.0) 10726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:02 smithi049 bash[23528]: cluster 2024-09-21T03:20:01.339979+0000 mgr.a (mgr.14388) 13226 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:02 smithi049 bash[23528]: audit 2024-09-21T03:20:01.620989+0000 mon.a (mon.0) 10721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:02 smithi049 bash[23528]: audit 2024-09-21T03:20:01.627801+0000 mon.a (mon.0) 10722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:02 smithi049 bash[23528]: audit 2024-09-21T03:20:01.636502+0000 mon.a (mon.0) 10723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:02 smithi049 bash[23528]: audit 2024-09-21T03:20:01.887914+0000 mon.a (mon.0) 10724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:02 smithi049 bash[23528]: audit 2024-09-21T03:20:01.896987+0000 mon.a (mon.0) 10725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:02 smithi049 bash[23528]: audit 2024-09-21T03:20:01.907234+0000 mon.a (mon.0) 10726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:04.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:04.082 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:04.082 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:04.878 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:04.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:04.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:04.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:04.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:04 smithi044 bash[22676]: cluster 2024-09-21T03:20:03.340895+0000 mgr.a (mgr.14388) 13227 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:04 smithi179 bash[23186]: cluster 2024-09-21T03:20:03.340895+0000 mgr.a (mgr.14388) 13227 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:05.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:04 smithi049 bash[23528]: cluster 2024-09-21T03:20:03.340895+0000 mgr.a (mgr.14388) 13227 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:05.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:05 smithi044 bash[22676]: audit 2024-09-21T03:20:04.418334+0000 mgr.a (mgr.14388) 13228 : audit [DBG] from='client.288165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:06.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:05 smithi179 bash[23186]: audit 2024-09-21T03:20:04.418334+0000 mgr.a (mgr.14388) 13228 : audit [DBG] from='client.288165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:05 smithi049 bash[23528]: audit 2024-09-21T03:20:04.418334+0000 mgr.a (mgr.14388) 13228 : audit [DBG] from='client.288165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:06 smithi044 bash[22676]: cluster 2024-09-21T03:20:05.343325+0000 mgr.a (mgr.14388) 13229 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:06 smithi179 bash[23186]: cluster 2024-09-21T03:20:05.343325+0000 mgr.a (mgr.14388) 13229 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:06 smithi049 bash[23528]: cluster 2024-09-21T03:20:05.343325+0000 mgr.a (mgr.14388) 13229 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:08 smithi044 bash[22676]: cluster 2024-09-21T03:20:07.344109+0000 mgr.a (mgr.14388) 13230 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:08 smithi179 bash[23186]: cluster 2024-09-21T03:20:07.344109+0000 mgr.a (mgr.14388) 13230 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:08 smithi049 bash[23528]: cluster 2024-09-21T03:20:07.344109+0000 mgr.a (mgr.14388) 13230 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:09.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:09.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:09.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:10.668 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:10.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:10.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:10.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:10.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:10 smithi179 bash[23186]: cluster 2024-09-21T03:20:09.345043+0000 mgr.a (mgr.14388) 13231 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:10 smithi179 bash[23186]: audit 2024-09-21T03:20:09.494330+0000 mon.a (mon.0) 10727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:10 smithi179 bash[23186]: audit 2024-09-21T03:20:09.503092+0000 mon.a (mon.0) 10728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:10 smithi179 bash[23186]: audit 2024-09-21T03:20:09.513454+0000 mon.a (mon.0) 10729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:10 smithi049 bash[23528]: cluster 2024-09-21T03:20:09.345043+0000 mgr.a (mgr.14388) 13231 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:10 smithi049 bash[23528]: audit 2024-09-21T03:20:09.494330+0000 mon.a (mon.0) 10727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:10 smithi049 bash[23528]: audit 2024-09-21T03:20:09.503092+0000 mon.a (mon.0) 10728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:10 smithi049 bash[23528]: audit 2024-09-21T03:20:09.513454+0000 mon.a (mon.0) 10729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:10 smithi044 bash[22676]: cluster 2024-09-21T03:20:09.345043+0000 mgr.a (mgr.14388) 13231 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:10 smithi044 bash[22676]: audit 2024-09-21T03:20:09.494330+0000 mon.a (mon.0) 10727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:10 smithi044 bash[22676]: audit 2024-09-21T03:20:09.503092+0000 mon.a (mon.0) 10728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:10 smithi044 bash[22676]: audit 2024-09-21T03:20:09.513454+0000 mon.a (mon.0) 10729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:11.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:11 smithi179 bash[23186]: audit 2024-09-21T03:20:10.215966+0000 mgr.a (mgr.14388) 13232 : audit [DBG] from='client.288243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:11 smithi049 bash[23528]: audit 2024-09-21T03:20:10.215966+0000 mgr.a (mgr.14388) 13232 : audit [DBG] from='client.288243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:11.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:11 smithi044 bash[22676]: audit 2024-09-21T03:20:10.215966+0000 mgr.a (mgr.14388) 13232 : audit [DBG] from='client.288243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:12.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:12 smithi179 bash[23186]: cluster 2024-09-21T03:20:11.347914+0000 mgr.a (mgr.14388) 13233 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:12 smithi049 bash[23528]: cluster 2024-09-21T03:20:11.347914+0000 mgr.a (mgr.14388) 13233 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:12.833 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:12 smithi044 bash[22676]: cluster 2024-09-21T03:20:11.347914+0000 mgr.a (mgr.14388) 13233 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:14 smithi049 bash[23528]: cluster 2024-09-21T03:20:13.348680+0000 mgr.a (mgr.14388) 13234 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:20:15.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:14 smithi044 bash[22676]: cluster 2024-09-21T03:20:13.348680+0000 mgr.a (mgr.14388) 13234 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:20:15.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:14 smithi179 bash[23186]: cluster 2024-09-21T03:20:13.348680+0000 mgr.a (mgr.14388) 13234 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:20:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:16.430 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:16.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:16.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:16.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:16.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:16 smithi049 bash[23528]: cluster 2024-09-21T03:20:15.350719+0000 mgr.a (mgr.14388) 13235 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:16 smithi049 bash[23528]: audit 2024-09-21T03:20:15.996503+0000 mgr.a (mgr.14388) 13236 : audit [DBG] from='client.288321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:16 smithi044 bash[22676]: cluster 2024-09-21T03:20:15.350719+0000 mgr.a (mgr.14388) 13235 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:16 smithi044 bash[22676]: audit 2024-09-21T03:20:15.996503+0000 mgr.a (mgr.14388) 13236 : audit [DBG] from='client.288321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:16 smithi179 bash[23186]: cluster 2024-09-21T03:20:15.350719+0000 mgr.a (mgr.14388) 13235 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:16 smithi179 bash[23186]: audit 2024-09-21T03:20:15.996503+0000 mgr.a (mgr.14388) 13236 : audit [DBG] from='client.288321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:18 smithi049 bash[23528]: cluster 2024-09-21T03:20:17.351721+0000 mgr.a (mgr.14388) 13237 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:20:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:18 smithi044 bash[22676]: cluster 2024-09-21T03:20:17.351721+0000 mgr.a (mgr.14388) 13237 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:20:19.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:18 smithi179 bash[23186]: cluster 2024-09-21T03:20:17.351721+0000 mgr.a (mgr.14388) 13237 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:20:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:20 smithi049 bash[23528]: cluster 2024-09-21T03:20:19.352531+0000 mgr.a (mgr.14388) 13238 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:20 smithi044 bash[22676]: cluster 2024-09-21T03:20:19.352531+0000 mgr.a (mgr.14388) 13238 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:20 smithi179 bash[23186]: cluster 2024-09-21T03:20:19.352531+0000 mgr.a (mgr.14388) 13238 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:21.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:21.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:21.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:22.212 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:22.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:22.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: cluster 2024-09-21T03:20:21.354746+0000 mgr.a (mgr.14388) 13239 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: audit 2024-09-21T03:20:21.768132+0000 mgr.a (mgr.14388) 13240 : audit [DBG] from='client.288396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: audit 2024-09-21T03:20:21.823165+0000 mon.a (mon.0) 10730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: audit 2024-09-21T03:20:21.827744+0000 mon.a (mon.0) 10731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: audit 2024-09-21T03:20:21.833294+0000 mon.a (mon.0) 10732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: audit 2024-09-21T03:20:22.097961+0000 mon.a (mon.0) 10733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: audit 2024-09-21T03:20:22.104842+0000 mon.a (mon.0) 10734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:22 smithi044 bash[22676]: audit 2024-09-21T03:20:22.118499+0000 mon.a (mon.0) 10735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: cluster 2024-09-21T03:20:21.354746+0000 mgr.a (mgr.14388) 13239 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: audit 2024-09-21T03:20:21.768132+0000 mgr.a (mgr.14388) 13240 : audit [DBG] from='client.288396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: audit 2024-09-21T03:20:21.823165+0000 mon.a (mon.0) 10730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: audit 2024-09-21T03:20:21.827744+0000 mon.a (mon.0) 10731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: audit 2024-09-21T03:20:21.833294+0000 mon.a (mon.0) 10732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: audit 2024-09-21T03:20:22.097961+0000 mon.a (mon.0) 10733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: audit 2024-09-21T03:20:22.104842+0000 mon.a (mon.0) 10734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:22 smithi179 bash[23186]: audit 2024-09-21T03:20:22.118499+0000 mon.a (mon.0) 10735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: cluster 2024-09-21T03:20:21.354746+0000 mgr.a (mgr.14388) 13239 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: audit 2024-09-21T03:20:21.768132+0000 mgr.a (mgr.14388) 13240 : audit [DBG] from='client.288396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: audit 2024-09-21T03:20:21.823165+0000 mon.a (mon.0) 10730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: audit 2024-09-21T03:20:21.827744+0000 mon.a (mon.0) 10731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: audit 2024-09-21T03:20:21.833294+0000 mon.a (mon.0) 10732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: audit 2024-09-21T03:20:22.097961+0000 mon.a (mon.0) 10733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: audit 2024-09-21T03:20:22.104842+0000 mon.a (mon.0) 10734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:22 smithi049 bash[23528]: audit 2024-09-21T03:20:22.118499+0000 mon.a (mon.0) 10735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:25.107 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:24 smithi049 bash[23528]: cluster 2024-09-21T03:20:23.355694+0000 mgr.a (mgr.14388) 13241 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:24 smithi044 bash[22676]: cluster 2024-09-21T03:20:23.355694+0000 mgr.a (mgr.14388) 13241 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:24 smithi179 bash[23186]: cluster 2024-09-21T03:20:23.355694+0000 mgr.a (mgr.14388) 13241 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:26 smithi049 bash[23528]: cluster 2024-09-21T03:20:25.357885+0000 mgr.a (mgr.14388) 13242 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:27.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:27.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:27.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:26 smithi044 bash[22676]: cluster 2024-09-21T03:20:25.357885+0000 mgr.a (mgr.14388) 13242 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:26 smithi179 bash[23186]: cluster 2024-09-21T03:20:25.357885+0000 mgr.a (mgr.14388) 13242 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:27.975 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:28 smithi044 bash[22676]: cluster 2024-09-21T03:20:27.358421+0000 mgr.a (mgr.14388) 13243 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:28 smithi044 bash[22676]: audit 2024-09-21T03:20:27.544745+0000 mgr.a (mgr.14388) 13244 : audit [DBG] from='client.288474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:28 smithi179 bash[23186]: cluster 2024-09-21T03:20:27.358421+0000 mgr.a (mgr.14388) 13243 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:28 smithi179 bash[23186]: audit 2024-09-21T03:20:27.544745+0000 mgr.a (mgr.14388) 13244 : audit [DBG] from='client.288474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:28 smithi049 bash[23528]: cluster 2024-09-21T03:20:27.358421+0000 mgr.a (mgr.14388) 13243 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:28 smithi049 bash[23528]: audit 2024-09-21T03:20:27.544745+0000 mgr.a (mgr.14388) 13244 : audit [DBG] from='client.288474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:30 smithi044 bash[22676]: cluster 2024-09-21T03:20:29.359475+0000 mgr.a (mgr.14388) 13245 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:30 smithi044 bash[22676]: audit 2024-09-21T03:20:29.727040+0000 mon.a (mon.0) 10736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:30 smithi044 bash[22676]: audit 2024-09-21T03:20:29.736122+0000 mon.a (mon.0) 10737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:30 smithi044 bash[22676]: audit 2024-09-21T03:20:29.746690+0000 mon.a (mon.0) 10738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:30 smithi179 bash[23186]: cluster 2024-09-21T03:20:29.359475+0000 mgr.a (mgr.14388) 13245 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:30 smithi179 bash[23186]: audit 2024-09-21T03:20:29.727040+0000 mon.a (mon.0) 10736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:30 smithi179 bash[23186]: audit 2024-09-21T03:20:29.736122+0000 mon.a (mon.0) 10737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:30 smithi179 bash[23186]: audit 2024-09-21T03:20:29.746690+0000 mon.a (mon.0) 10738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:30 smithi049 bash[23528]: cluster 2024-09-21T03:20:29.359475+0000 mgr.a (mgr.14388) 13245 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:30 smithi049 bash[23528]: audit 2024-09-21T03:20:29.727040+0000 mon.a (mon.0) 10736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:30 smithi049 bash[23528]: audit 2024-09-21T03:20:29.736122+0000 mon.a (mon.0) 10737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:30 smithi049 bash[23528]: audit 2024-09-21T03:20:29.746690+0000 mon.a (mon.0) 10738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:32.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:32 smithi179 bash[23186]: cluster 2024-09-21T03:20:31.361775+0000 mgr.a (mgr.14388) 13246 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:32.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:32.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:32.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:32 smithi044 bash[22676]: cluster 2024-09-21T03:20:31.361775+0000 mgr.a (mgr.14388) 13246 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:32 smithi049 bash[23528]: cluster 2024-09-21T03:20:31.361775+0000 mgr.a (mgr.14388) 13246 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:33.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:33.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:33.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:33.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:33.731 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:34.895 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:34 smithi044 bash[22676]: audit 2024-09-21T03:20:33.310292+0000 mgr.a (mgr.14388) 13247 : audit [DBG] from='client.288552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:34.895 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:34 smithi044 bash[22676]: cluster 2024-09-21T03:20:33.362773+0000 mgr.a (mgr.14388) 13248 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:34 smithi179 bash[23186]: audit 2024-09-21T03:20:33.310292+0000 mgr.a (mgr.14388) 13247 : audit [DBG] from='client.288552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:34 smithi179 bash[23186]: cluster 2024-09-21T03:20:33.362773+0000 mgr.a (mgr.14388) 13248 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:34 smithi049 bash[23528]: audit 2024-09-21T03:20:33.310292+0000 mgr.a (mgr.14388) 13247 : audit [DBG] from='client.288552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:34 smithi049 bash[23528]: cluster 2024-09-21T03:20:33.362773+0000 mgr.a (mgr.14388) 13248 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:36 smithi179 bash[23186]: cluster 2024-09-21T03:20:35.364144+0000 mgr.a (mgr.14388) 13249 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:36 smithi049 bash[23528]: cluster 2024-09-21T03:20:35.364144+0000 mgr.a (mgr.14388) 13249 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:36 smithi044 bash[22676]: cluster 2024-09-21T03:20:35.364144+0000 mgr.a (mgr.14388) 13249 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:38.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:38.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:38.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:38 smithi179 bash[23186]: cluster 2024-09-21T03:20:37.365067+0000 mgr.a (mgr.14388) 13250 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:38 smithi049 bash[23528]: cluster 2024-09-21T03:20:37.365067+0000 mgr.a (mgr.14388) 13250 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:38 smithi044 bash[22676]: cluster 2024-09-21T03:20:37.365067+0000 mgr.a (mgr.14388) 13250 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:39.495 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:39.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:39.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:39.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:39.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:39 smithi049 bash[23528]: audit 2024-09-21T03:20:39.065289+0000 mgr.a (mgr.14388) 13251 : audit [DBG] from='client.288630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:39 smithi044 bash[22676]: audit 2024-09-21T03:20:39.065289+0000 mgr.a (mgr.14388) 13251 : audit [DBG] from='client.288630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:40.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:39 smithi179 bash[23186]: audit 2024-09-21T03:20:39.065289+0000 mgr.a (mgr.14388) 13251 : audit [DBG] from='client.288630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:40 smithi049 bash[23528]: cluster 2024-09-21T03:20:39.365714+0000 mgr.a (mgr.14388) 13252 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:40 smithi044 bash[22676]: cluster 2024-09-21T03:20:39.365714+0000 mgr.a (mgr.14388) 13252 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:40 smithi179 bash[23186]: cluster 2024-09-21T03:20:39.365714+0000 mgr.a (mgr.14388) 13252 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:43 smithi049 bash[23528]: cluster 2024-09-21T03:20:41.368028+0000 mgr.a (mgr.14388) 13253 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:43 smithi049 bash[23528]: audit 2024-09-21T03:20:42.024146+0000 mon.a (mon.0) 10739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:43 smithi049 bash[23528]: audit 2024-09-21T03:20:42.030940+0000 mon.a (mon.0) 10740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:43 smithi049 bash[23528]: audit 2024-09-21T03:20:42.040338+0000 mon.a (mon.0) 10741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:43 smithi049 bash[23528]: audit 2024-09-21T03:20:42.324852+0000 mon.a (mon.0) 10742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:43 smithi049 bash[23528]: audit 2024-09-21T03:20:42.333712+0000 mon.a (mon.0) 10743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:43 smithi049 bash[23528]: audit 2024-09-21T03:20:42.344394+0000 mon.a (mon.0) 10744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:43 smithi044 bash[22676]: cluster 2024-09-21T03:20:41.368028+0000 mgr.a (mgr.14388) 13253 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:43 smithi044 bash[22676]: audit 2024-09-21T03:20:42.024146+0000 mon.a (mon.0) 10739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:43 smithi044 bash[22676]: audit 2024-09-21T03:20:42.030940+0000 mon.a (mon.0) 10740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:43 smithi044 bash[22676]: audit 2024-09-21T03:20:42.040338+0000 mon.a (mon.0) 10741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:43 smithi044 bash[22676]: audit 2024-09-21T03:20:42.324852+0000 mon.a (mon.0) 10742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:43 smithi044 bash[22676]: audit 2024-09-21T03:20:42.333712+0000 mon.a (mon.0) 10743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:43 smithi044 bash[22676]: audit 2024-09-21T03:20:42.344394+0000 mon.a (mon.0) 10744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:43 smithi179 bash[23186]: cluster 2024-09-21T03:20:41.368028+0000 mgr.a (mgr.14388) 13253 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:20:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:43 smithi179 bash[23186]: audit 2024-09-21T03:20:42.024146+0000 mon.a (mon.0) 10739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:43 smithi179 bash[23186]: audit 2024-09-21T03:20:42.030940+0000 mon.a (mon.0) 10740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:43 smithi179 bash[23186]: audit 2024-09-21T03:20:42.040338+0000 mon.a (mon.0) 10741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:43 smithi179 bash[23186]: audit 2024-09-21T03:20:42.324852+0000 mon.a (mon.0) 10742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:43 smithi179 bash[23186]: audit 2024-09-21T03:20:42.333712+0000 mon.a (mon.0) 10743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:43 smithi179 bash[23186]: audit 2024-09-21T03:20:42.344394+0000 mon.a (mon.0) 10744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:44.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:44.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:44.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:45.288 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:45.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:45.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:45.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:45.289 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:45.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:45 smithi049 bash[23528]: cluster 2024-09-21T03:20:43.368786+0000 mgr.a (mgr.14388) 13254 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:45 smithi044 bash[22676]: cluster 2024-09-21T03:20:43.368786+0000 mgr.a (mgr.14388) 13254 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:45 smithi179 bash[23186]: cluster 2024-09-21T03:20:43.368786+0000 mgr.a (mgr.14388) 13254 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:46.289 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:46 smithi049 bash[23528]: audit 2024-09-21T03:20:44.832150+0000 mgr.a (mgr.14388) 13255 : audit [DBG] from='client.288705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:46 smithi044 bash[22676]: audit 2024-09-21T03:20:44.832150+0000 mgr.a (mgr.14388) 13255 : audit [DBG] from='client.288705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:46.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:46 smithi179 bash[23186]: audit 2024-09-21T03:20:44.832150+0000 mgr.a (mgr.14388) 13255 : audit [DBG] from='client.288705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:47.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:47 smithi049 bash[23528]: cluster 2024-09-21T03:20:45.370415+0000 mgr.a (mgr.14388) 13256 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:47 smithi044 bash[22676]: cluster 2024-09-21T03:20:45.370415+0000 mgr.a (mgr.14388) 13256 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:47 smithi179 bash[23186]: cluster 2024-09-21T03:20:45.370415+0000 mgr.a (mgr.14388) 13256 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:20:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:49 smithi049 bash[23528]: cluster 2024-09-21T03:20:47.371165+0000 mgr.a (mgr.14388) 13257 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:49 smithi044 bash[22676]: cluster 2024-09-21T03:20:47.371165+0000 mgr.a (mgr.14388) 13257 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:49 smithi179 bash[23186]: cluster 2024-09-21T03:20:47.371165+0000 mgr.a (mgr.14388) 13257 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.482822+0000 mon.a (mon.0) 10745 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:20:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.494373+0000 mon.a (mon.0) 10746 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:20:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.496334+0000 mon.a (mon.0) 10747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:20:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.507710+0000 mon.a (mon.0) 10748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.514251+0000 mon.a (mon.0) 10749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:20:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.935523+0000 mon.a (mon.0) 10750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.941420+0000 mon.a (mon.0) 10751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:50 smithi049 bash[23528]: audit 2024-09-21T03:20:49.947227+0000 mon.a (mon.0) 10752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.482822+0000 mon.a (mon.0) 10745 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:20:50.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.494373+0000 mon.a (mon.0) 10746 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:20:50.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.496334+0000 mon.a (mon.0) 10747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:20:50.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.507710+0000 mon.a (mon.0) 10748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.514251+0000 mon.a (mon.0) 10749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:20:50.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.935523+0000 mon.a (mon.0) 10750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.941420+0000 mon.a (mon.0) 10751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22676]: audit 2024-09-21T03:20:49.947227+0000 mon.a (mon.0) 10752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.482822+0000 mon.a (mon.0) 10745 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:20:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.494373+0000 mon.a (mon.0) 10746 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:20:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.496334+0000 mon.a (mon.0) 10747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:20:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.507710+0000 mon.a (mon.0) 10748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.514251+0000 mon.a (mon.0) 10749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:20:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.935523+0000 mon.a (mon.0) 10750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.941420+0000 mon.a (mon.0) 10751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:50 smithi179 bash[23186]: audit 2024-09-21T03:20:49.947227+0000 mon.a (mon.0) 10752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:20:50.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22930]: debug 2024-09-21T03:20:50.320+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:20:50.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:20:50 smithi044 bash[22930]: debug 2024-09-21T03:20:50.320+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:20:51.050 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:51.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:51 smithi044 bash[22676]: cluster 2024-09-21T03:20:49.371967+0000 mgr.a (mgr.14388) 13258 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:51 smithi044 bash[22676]: audit 2024-09-21T03:20:49.516739+0000 mgr.a (mgr.14388) 13259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:20:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:51 smithi179 bash[23186]: cluster 2024-09-21T03:20:49.371967+0000 mgr.a (mgr.14388) 13258 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:51 smithi179 bash[23186]: audit 2024-09-21T03:20:49.516739+0000 mgr.a (mgr.14388) 13259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:20:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:51 smithi049 bash[23528]: cluster 2024-09-21T03:20:49.371967+0000 mgr.a (mgr.14388) 13258 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:20:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:51 smithi049 bash[23528]: audit 2024-09-21T03:20:49.516739+0000 mgr.a (mgr.14388) 13259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:20:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:52 smithi044 bash[22676]: audit 2024-09-21T03:20:50.322582+0000 mgr.a (mgr.14388) 13260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:20:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:52 smithi044 bash[22676]: cephadm 2024-09-21T03:20:50.324082+0000 mgr.a (mgr.14388) 13261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:20:52.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:52 smithi044 bash[22676]: audit 2024-09-21T03:20:50.619532+0000 mgr.a (mgr.14388) 13262 : audit [DBG] from='client.288891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:52 smithi179 bash[23186]: audit 2024-09-21T03:20:50.322582+0000 mgr.a (mgr.14388) 13260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:20:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:52 smithi179 bash[23186]: cephadm 2024-09-21T03:20:50.324082+0000 mgr.a (mgr.14388) 13261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:20:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:52 smithi179 bash[23186]: audit 2024-09-21T03:20:50.619532+0000 mgr.a (mgr.14388) 13262 : audit [DBG] from='client.288891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:52 smithi049 bash[23528]: audit 2024-09-21T03:20:50.322582+0000 mgr.a (mgr.14388) 13260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:20:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:52 smithi049 bash[23528]: cephadm 2024-09-21T03:20:50.324082+0000 mgr.a (mgr.14388) 13261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:20:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:52 smithi049 bash[23528]: audit 2024-09-21T03:20:50.619532+0000 mgr.a (mgr.14388) 13262 : audit [DBG] from='client.288891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:53 smithi044 bash[22676]: cluster 2024-09-21T03:20:51.374802+0000 mgr.a (mgr.14388) 13263 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:20:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:53 smithi179 bash[23186]: cluster 2024-09-21T03:20:51.374802+0000 mgr.a (mgr.14388) 13263 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:20:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:53 smithi049 bash[23528]: cluster 2024-09-21T03:20:51.374802+0000 mgr.a (mgr.14388) 13263 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:20:55.426 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:55 smithi179 bash[23186]: cluster 2024-09-21T03:20:53.375612+0000 mgr.a (mgr.14388) 13264 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:20:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:55 smithi044 bash[22676]: cluster 2024-09-21T03:20:53.375612+0000 mgr.a (mgr.14388) 13264 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:20:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:55 smithi049 bash[23528]: cluster 2024-09-21T03:20:53.375612+0000 mgr.a (mgr.14388) 13264 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:20:56.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:20:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:20:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:57 smithi044 bash[22676]: cluster 2024-09-21T03:20:55.377737+0000 mgr.a (mgr.14388) 13265 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:57 smithi179 bash[23186]: cluster 2024-09-21T03:20:55.377737+0000 mgr.a (mgr.14388) 13265 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:57 smithi049 bash[23528]: cluster 2024-09-21T03:20:55.377737+0000 mgr.a (mgr.14388) 13265 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:58 smithi044 bash[22676]: audit 2024-09-21T03:20:56.387881+0000 mgr.a (mgr.14388) 13266 : audit [DBG] from='client.288969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:58.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:58 smithi179 bash[23186]: audit 2024-09-21T03:20:56.387881+0000 mgr.a (mgr.14388) 13266 : audit [DBG] from='client.288969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:58 smithi049 bash[23528]: audit 2024-09-21T03:20:56.387881+0000 mgr.a (mgr.14388) 13266 : audit [DBG] from='client.288969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:20:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:20:59 smithi044 bash[22676]: cluster 2024-09-21T03:20:57.378731+0000 mgr.a (mgr.14388) 13267 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:20:59 smithi179 bash[23186]: cluster 2024-09-21T03:20:57.378731+0000 mgr.a (mgr.14388) 13267 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:20:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:20:59 smithi049 bash[23528]: cluster 2024-09-21T03:20:57.378731+0000 mgr.a (mgr.14388) 13267 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:01 smithi044 bash[22676]: cluster 2024-09-21T03:20:59.379581+0000 mgr.a (mgr.14388) 13268 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:01 smithi179 bash[23186]: cluster 2024-09-21T03:20:59.379581+0000 mgr.a (mgr.14388) 13268 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:01 smithi049 bash[23528]: cluster 2024-09-21T03:20:59.379581+0000 mgr.a (mgr.14388) 13268 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:02.650 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:03 smithi044 bash[22676]: cluster 2024-09-21T03:21:01.381846+0000 mgr.a (mgr.14388) 13269 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:03 smithi044 bash[22676]: audit 2024-09-21T03:21:02.254967+0000 mon.a (mon.0) 10753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:03 smithi044 bash[22676]: audit 2024-09-21T03:21:02.263376+0000 mon.a (mon.0) 10754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:03 smithi044 bash[22676]: audit 2024-09-21T03:21:02.273385+0000 mon.a (mon.0) 10755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:03 smithi044 bash[22676]: audit 2024-09-21T03:21:02.535518+0000 mon.a (mon.0) 10756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:03 smithi044 bash[22676]: audit 2024-09-21T03:21:02.548147+0000 mon.a (mon.0) 10757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:03 smithi044 bash[22676]: audit 2024-09-21T03:21:02.554757+0000 mon.a (mon.0) 10758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:03 smithi179 bash[23186]: cluster 2024-09-21T03:21:01.381846+0000 mgr.a (mgr.14388) 13269 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:03 smithi179 bash[23186]: audit 2024-09-21T03:21:02.254967+0000 mon.a (mon.0) 10753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:03 smithi179 bash[23186]: audit 2024-09-21T03:21:02.263376+0000 mon.a (mon.0) 10754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:03 smithi179 bash[23186]: audit 2024-09-21T03:21:02.273385+0000 mon.a (mon.0) 10755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:03 smithi179 bash[23186]: audit 2024-09-21T03:21:02.535518+0000 mon.a (mon.0) 10756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:03 smithi179 bash[23186]: audit 2024-09-21T03:21:02.548147+0000 mon.a (mon.0) 10757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:03 smithi179 bash[23186]: audit 2024-09-21T03:21:02.554757+0000 mon.a (mon.0) 10758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:03 smithi049 bash[23528]: cluster 2024-09-21T03:21:01.381846+0000 mgr.a (mgr.14388) 13269 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:03 smithi049 bash[23528]: audit 2024-09-21T03:21:02.254967+0000 mon.a (mon.0) 10753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:03 smithi049 bash[23528]: audit 2024-09-21T03:21:02.263376+0000 mon.a (mon.0) 10754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:03 smithi049 bash[23528]: audit 2024-09-21T03:21:02.273385+0000 mon.a (mon.0) 10755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:03 smithi049 bash[23528]: audit 2024-09-21T03:21:02.535518+0000 mon.a (mon.0) 10756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:03 smithi049 bash[23528]: audit 2024-09-21T03:21:02.548147+0000 mon.a (mon.0) 10757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:03 smithi049 bash[23528]: audit 2024-09-21T03:21:02.554757+0000 mon.a (mon.0) 10758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:04 smithi044 bash[22676]: audit 2024-09-21T03:21:02.191307+0000 mgr.a (mgr.14388) 13270 : audit [DBG] from='client.289044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:04 smithi179 bash[23186]: audit 2024-09-21T03:21:02.191307+0000 mgr.a (mgr.14388) 13270 : audit [DBG] from='client.289044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:04 smithi049 bash[23528]: audit 2024-09-21T03:21:02.191307+0000 mgr.a (mgr.14388) 13270 : audit [DBG] from='client.289044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:05 smithi044 bash[22676]: cluster 2024-09-21T03:21:03.382766+0000 mgr.a (mgr.14388) 13271 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:21:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:05 smithi179 bash[23186]: cluster 2024-09-21T03:21:03.382766+0000 mgr.a (mgr.14388) 13271 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:21:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:05 smithi049 bash[23528]: cluster 2024-09-21T03:21:03.382766+0000 mgr.a (mgr.14388) 13271 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:21:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:07 smithi044 bash[22676]: cluster 2024-09-21T03:21:05.384969+0000 mgr.a (mgr.14388) 13272 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:21:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:07 smithi179 bash[23186]: cluster 2024-09-21T03:21:05.384969+0000 mgr.a (mgr.14388) 13272 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:21:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:07 smithi049 bash[23528]: cluster 2024-09-21T03:21:05.384969+0000 mgr.a (mgr.14388) 13272 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:21:07.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:07.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:07.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:08.422 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:08.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:08.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:08.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:08.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:09 smithi044 bash[22676]: cluster 2024-09-21T03:21:07.385789+0000 mgr.a (mgr.14388) 13273 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:09 smithi044 bash[22676]: audit 2024-09-21T03:21:07.986550+0000 mgr.a (mgr.14388) 13274 : audit [DBG] from='client.289122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:09 smithi179 bash[23186]: cluster 2024-09-21T03:21:07.385789+0000 mgr.a (mgr.14388) 13273 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:09 smithi179 bash[23186]: audit 2024-09-21T03:21:07.986550+0000 mgr.a (mgr.14388) 13274 : audit [DBG] from='client.289122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:09 smithi049 bash[23528]: cluster 2024-09-21T03:21:07.385789+0000 mgr.a (mgr.14388) 13273 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:09 smithi049 bash[23528]: audit 2024-09-21T03:21:07.986550+0000 mgr.a (mgr.14388) 13274 : audit [DBG] from='client.289122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:11 smithi044 bash[22676]: cluster 2024-09-21T03:21:09.386799+0000 mgr.a (mgr.14388) 13275 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:11 smithi044 bash[22676]: audit 2024-09-21T03:21:10.148000+0000 mon.a (mon.0) 10759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:11 smithi044 bash[22676]: audit 2024-09-21T03:21:10.158589+0000 mon.a (mon.0) 10760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:11 smithi044 bash[22676]: audit 2024-09-21T03:21:10.170533+0000 mon.a (mon.0) 10761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:11 smithi179 bash[23186]: cluster 2024-09-21T03:21:09.386799+0000 mgr.a (mgr.14388) 13275 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:11 smithi179 bash[23186]: audit 2024-09-21T03:21:10.148000+0000 mon.a (mon.0) 10759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:11 smithi179 bash[23186]: audit 2024-09-21T03:21:10.158589+0000 mon.a (mon.0) 10760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:11 smithi179 bash[23186]: audit 2024-09-21T03:21:10.170533+0000 mon.a (mon.0) 10761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:11 smithi049 bash[23528]: cluster 2024-09-21T03:21:09.386799+0000 mgr.a (mgr.14388) 13275 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:11 smithi049 bash[23528]: audit 2024-09-21T03:21:10.148000+0000 mon.a (mon.0) 10759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:11 smithi049 bash[23528]: audit 2024-09-21T03:21:10.158589+0000 mon.a (mon.0) 10760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:11 smithi049 bash[23528]: audit 2024-09-21T03:21:10.170533+0000 mon.a (mon.0) 10761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:13.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:13 smithi044 bash[22676]: cluster 2024-09-21T03:21:11.389151+0000 mgr.a (mgr.14388) 13276 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:13.419 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:13 smithi179 bash[23186]: cluster 2024-09-21T03:21:11.389151+0000 mgr.a (mgr.14388) 13276 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:13.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:13.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:13.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:13 smithi049 bash[23528]: cluster 2024-09-21T03:21:11.389151+0000 mgr.a (mgr.14388) 13276 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:14.175 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:15 smithi044 bash[22676]: cluster 2024-09-21T03:21:13.389956+0000 mgr.a (mgr.14388) 13277 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:15 smithi044 bash[22676]: audit 2024-09-21T03:21:13.756051+0000 mgr.a (mgr.14388) 13278 : audit [DBG] from='client.289197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:15 smithi179 bash[23186]: cluster 2024-09-21T03:21:13.389956+0000 mgr.a (mgr.14388) 13277 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:15 smithi179 bash[23186]: audit 2024-09-21T03:21:13.756051+0000 mgr.a (mgr.14388) 13278 : audit [DBG] from='client.289197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:15 smithi049 bash[23528]: cluster 2024-09-21T03:21:13.389956+0000 mgr.a (mgr.14388) 13277 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:15 smithi049 bash[23528]: audit 2024-09-21T03:21:13.756051+0000 mgr.a (mgr.14388) 13278 : audit [DBG] from='client.289197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:17 smithi044 bash[22676]: cluster 2024-09-21T03:21:15.391369+0000 mgr.a (mgr.14388) 13279 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:17 smithi179 bash[23186]: cluster 2024-09-21T03:21:15.391369+0000 mgr.a (mgr.14388) 13279 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:17 smithi049 bash[23528]: cluster 2024-09-21T03:21:15.391369+0000 mgr.a (mgr.14388) 13279 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:19 smithi044 bash[22676]: cluster 2024-09-21T03:21:17.392123+0000 mgr.a (mgr.14388) 13280 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:19 smithi179 bash[23186]: cluster 2024-09-21T03:21:17.392123+0000 mgr.a (mgr.14388) 13280 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:19 smithi049 bash[23528]: cluster 2024-09-21T03:21:17.392123+0000 mgr.a (mgr.14388) 13280 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:19.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:19.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:20 smithi044 bash[22676]: cluster 2024-09-21T03:21:19.392876+0000 mgr.a (mgr.14388) 13281 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:20 smithi044 bash[22676]: audit 2024-09-21T03:21:19.508726+0000 mgr.a (mgr.14388) 13282 : audit [DBG] from='client.289275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:20 smithi179 bash[23186]: cluster 2024-09-21T03:21:19.392876+0000 mgr.a (mgr.14388) 13281 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:20 smithi179 bash[23186]: audit 2024-09-21T03:21:19.508726+0000 mgr.a (mgr.14388) 13282 : audit [DBG] from='client.289275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:20 smithi049 bash[23528]: cluster 2024-09-21T03:21:19.392876+0000 mgr.a (mgr.14388) 13281 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:20 smithi049 bash[23528]: audit 2024-09-21T03:21:19.508726+0000 mgr.a (mgr.14388) 13282 : audit [DBG] from='client.289275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:22 smithi044 bash[22676]: cluster 2024-09-21T03:21:21.395222+0000 mgr.a (mgr.14388) 13283 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:22.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:22 smithi179 bash[23186]: cluster 2024-09-21T03:21:21.395222+0000 mgr.a (mgr.14388) 13283 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:22 smithi049 bash[23528]: cluster 2024-09-21T03:21:21.395222+0000 mgr.a (mgr.14388) 13283 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:23 smithi044 bash[22676]: audit 2024-09-21T03:21:22.475553+0000 mon.a (mon.0) 10762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:23 smithi044 bash[22676]: audit 2024-09-21T03:21:22.484114+0000 mon.a (mon.0) 10763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:23 smithi044 bash[22676]: audit 2024-09-21T03:21:22.496059+0000 mon.a (mon.0) 10764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:23 smithi044 bash[22676]: audit 2024-09-21T03:21:22.760477+0000 mon.a (mon.0) 10765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:23 smithi044 bash[22676]: audit 2024-09-21T03:21:22.768743+0000 mon.a (mon.0) 10766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:23 smithi044 bash[22676]: audit 2024-09-21T03:21:22.778723+0000 mon.a (mon.0) 10767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:23 smithi179 bash[23186]: audit 2024-09-21T03:21:22.475553+0000 mon.a (mon.0) 10762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:23 smithi179 bash[23186]: audit 2024-09-21T03:21:22.484114+0000 mon.a (mon.0) 10763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:23 smithi179 bash[23186]: audit 2024-09-21T03:21:22.496059+0000 mon.a (mon.0) 10764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:23 smithi179 bash[23186]: audit 2024-09-21T03:21:22.760477+0000 mon.a (mon.0) 10765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:23 smithi179 bash[23186]: audit 2024-09-21T03:21:22.768743+0000 mon.a (mon.0) 10766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:23 smithi179 bash[23186]: audit 2024-09-21T03:21:22.778723+0000 mon.a (mon.0) 10767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:23 smithi049 bash[23528]: audit 2024-09-21T03:21:22.475553+0000 mon.a (mon.0) 10762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:23 smithi049 bash[23528]: audit 2024-09-21T03:21:22.484114+0000 mon.a (mon.0) 10763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:23 smithi049 bash[23528]: audit 2024-09-21T03:21:22.496059+0000 mon.a (mon.0) 10764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:23 smithi049 bash[23528]: audit 2024-09-21T03:21:22.760477+0000 mon.a (mon.0) 10765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:23 smithi049 bash[23528]: audit 2024-09-21T03:21:22.768743+0000 mon.a (mon.0) 10766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:23 smithi049 bash[23528]: audit 2024-09-21T03:21:22.778723+0000 mon.a (mon.0) 10767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:24.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:24 smithi049 bash[23528]: cluster 2024-09-21T03:21:23.396114+0000 mgr.a (mgr.14388) 13284 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:24 smithi044 bash[22676]: cluster 2024-09-21T03:21:23.396114+0000 mgr.a (mgr.14388) 13284 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:24 smithi179 bash[23186]: cluster 2024-09-21T03:21:23.396114+0000 mgr.a (mgr.14388) 13284 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:25.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:25.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:25.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:25.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:25.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:26 smithi049 bash[23528]: audit 2024-09-21T03:21:25.288195+0000 mgr.a (mgr.14388) 13285 : audit [DBG] from='client.289353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:26 smithi049 bash[23528]: cluster 2024-09-21T03:21:25.397481+0000 mgr.a (mgr.14388) 13286 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:26 smithi044 bash[22676]: audit 2024-09-21T03:21:25.288195+0000 mgr.a (mgr.14388) 13285 : audit [DBG] from='client.289353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:26 smithi044 bash[22676]: cluster 2024-09-21T03:21:25.397481+0000 mgr.a (mgr.14388) 13286 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:26 smithi179 bash[23186]: audit 2024-09-21T03:21:25.288195+0000 mgr.a (mgr.14388) 13285 : audit [DBG] from='client.289353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:27.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:26 smithi179 bash[23186]: cluster 2024-09-21T03:21:25.397481+0000 mgr.a (mgr.14388) 13286 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:28 smithi049 bash[23528]: cluster 2024-09-21T03:21:27.398397+0000 mgr.a (mgr.14388) 13287 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:28 smithi044 bash[22676]: cluster 2024-09-21T03:21:27.398397+0000 mgr.a (mgr.14388) 13287 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:28 smithi179 bash[23186]: cluster 2024-09-21T03:21:27.398397+0000 mgr.a (mgr.14388) 13287 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:30.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:30 smithi049 bash[23528]: cluster 2024-09-21T03:21:29.399201+0000 mgr.a (mgr.14388) 13288 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:30 smithi049 bash[23528]: audit 2024-09-21T03:21:30.384500+0000 mon.a (mon.0) 10768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:30 smithi049 bash[23528]: audit 2024-09-21T03:21:30.394098+0000 mon.a (mon.0) 10769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:30 smithi049 bash[23528]: audit 2024-09-21T03:21:30.405952+0000 mon.a (mon.0) 10770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:30 smithi044 bash[22676]: cluster 2024-09-21T03:21:29.399201+0000 mgr.a (mgr.14388) 13288 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:30 smithi044 bash[22676]: audit 2024-09-21T03:21:30.384500+0000 mon.a (mon.0) 10768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:30 smithi044 bash[22676]: audit 2024-09-21T03:21:30.394098+0000 mon.a (mon.0) 10769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:30 smithi044 bash[22676]: audit 2024-09-21T03:21:30.405952+0000 mon.a (mon.0) 10770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:30 smithi179 bash[23186]: cluster 2024-09-21T03:21:29.399201+0000 mgr.a (mgr.14388) 13288 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:30 smithi179 bash[23186]: audit 2024-09-21T03:21:30.384500+0000 mon.a (mon.0) 10768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:30 smithi179 bash[23186]: audit 2024-09-21T03:21:30.394098+0000 mon.a (mon.0) 10769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:30 smithi179 bash[23186]: audit 2024-09-21T03:21:30.405952+0000 mon.a (mon.0) 10770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:31.545 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:32.093 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:31 smithi044 bash[22676]: audit 2024-09-21T03:21:31.088711+0000 mgr.a (mgr.14388) 13289 : audit [DBG] from='client.289431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:32.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:31 smithi179 bash[23186]: audit 2024-09-21T03:21:31.088711+0000 mgr.a (mgr.14388) 13289 : audit [DBG] from='client.289431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:31 smithi049 bash[23528]: audit 2024-09-21T03:21:31.088711+0000 mgr.a (mgr.14388) 13289 : audit [DBG] from='client.289431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:33.057 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:32 smithi044 bash[22676]: cluster 2024-09-21T03:21:31.400621+0000 mgr.a (mgr.14388) 13290 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:33.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:32 smithi179 bash[23186]: cluster 2024-09-21T03:21:31.400621+0000 mgr.a (mgr.14388) 13290 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:32 smithi049 bash[23528]: cluster 2024-09-21T03:21:31.400621+0000 mgr.a (mgr.14388) 13290 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:34.906 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:34 smithi179 bash[23186]: cluster 2024-09-21T03:21:33.401558+0000 mgr.a (mgr.14388) 13291 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:34 smithi044 bash[22676]: cluster 2024-09-21T03:21:33.401558+0000 mgr.a (mgr.14388) 13291 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:34 smithi049 bash[23528]: cluster 2024-09-21T03:21:33.401558+0000 mgr.a (mgr.14388) 13291 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:21:36.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:36.547 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:36.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:36 smithi044 bash[22676]: cluster 2024-09-21T03:21:35.403816+0000 mgr.a (mgr.14388) 13292 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:36 smithi179 bash[23186]: cluster 2024-09-21T03:21:35.403816+0000 mgr.a (mgr.14388) 13292 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:36 smithi049 bash[23528]: cluster 2024-09-21T03:21:35.403816+0000 mgr.a (mgr.14388) 13292 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:37.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:37.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:37.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:37.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:37.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:37 smithi044 bash[22676]: audit 2024-09-21T03:21:36.878184+0000 mgr.a (mgr.14388) 13293 : audit [DBG] from='client.289506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:38.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:37 smithi179 bash[23186]: audit 2024-09-21T03:21:36.878184+0000 mgr.a (mgr.14388) 13293 : audit [DBG] from='client.289506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:37 smithi049 bash[23528]: audit 2024-09-21T03:21:36.878184+0000 mgr.a (mgr.14388) 13293 : audit [DBG] from='client.289506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:38 smithi044 bash[22676]: cluster 2024-09-21T03:21:37.404360+0000 mgr.a (mgr.14388) 13294 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:38 smithi179 bash[23186]: cluster 2024-09-21T03:21:37.404360+0000 mgr.a (mgr.14388) 13294 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:38 smithi049 bash[23528]: cluster 2024-09-21T03:21:37.404360+0000 mgr.a (mgr.14388) 13294 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:40 smithi044 bash[22676]: cluster 2024-09-21T03:21:39.405093+0000 mgr.a (mgr.14388) 13295 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:40 smithi179 bash[23186]: cluster 2024-09-21T03:21:39.405093+0000 mgr.a (mgr.14388) 13295 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:40 smithi049 bash[23528]: cluster 2024-09-21T03:21:39.405093+0000 mgr.a (mgr.14388) 13295 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:42.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:42.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:42.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:42 smithi044 bash[22676]: cluster 2024-09-21T03:21:41.407359+0000 mgr.a (mgr.14388) 13296 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:42 smithi044 bash[22676]: audit 2024-09-21T03:21:42.694546+0000 mon.a (mon.0) 10771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:42 smithi044 bash[22676]: audit 2024-09-21T03:21:42.704610+0000 mon.a (mon.0) 10772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:42 smithi044 bash[22676]: audit 2024-09-21T03:21:42.716464+0000 mon.a (mon.0) 10773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:43.102 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:43.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:43.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:43.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:43.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:42 smithi179 bash[23186]: cluster 2024-09-21T03:21:41.407359+0000 mgr.a (mgr.14388) 13296 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:42 smithi179 bash[23186]: audit 2024-09-21T03:21:42.694546+0000 mon.a (mon.0) 10771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:42 smithi179 bash[23186]: audit 2024-09-21T03:21:42.704610+0000 mon.a (mon.0) 10772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:42 smithi179 bash[23186]: audit 2024-09-21T03:21:42.716464+0000 mon.a (mon.0) 10773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:42 smithi049 bash[23528]: cluster 2024-09-21T03:21:41.407359+0000 mgr.a (mgr.14388) 13296 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:42 smithi049 bash[23528]: audit 2024-09-21T03:21:42.694546+0000 mon.a (mon.0) 10771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:42 smithi049 bash[23528]: audit 2024-09-21T03:21:42.704610+0000 mon.a (mon.0) 10772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:42 smithi049 bash[23528]: audit 2024-09-21T03:21:42.716464+0000 mon.a (mon.0) 10773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:43 smithi044 bash[22676]: audit 2024-09-21T03:21:42.658679+0000 mgr.a (mgr.14388) 13297 : audit [DBG] from='client.289584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:43 smithi044 bash[22676]: audit 2024-09-21T03:21:42.944230+0000 mon.a (mon.0) 10774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:43 smithi044 bash[22676]: audit 2024-09-21T03:21:42.950211+0000 mon.a (mon.0) 10775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:43 smithi044 bash[22676]: audit 2024-09-21T03:21:42.955796+0000 mon.a (mon.0) 10776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:43 smithi179 bash[23186]: audit 2024-09-21T03:21:42.658679+0000 mgr.a (mgr.14388) 13297 : audit [DBG] from='client.289584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:43 smithi179 bash[23186]: audit 2024-09-21T03:21:42.944230+0000 mon.a (mon.0) 10774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:43 smithi179 bash[23186]: audit 2024-09-21T03:21:42.950211+0000 mon.a (mon.0) 10775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:43 smithi179 bash[23186]: audit 2024-09-21T03:21:42.955796+0000 mon.a (mon.0) 10776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:43 smithi049 bash[23528]: audit 2024-09-21T03:21:42.658679+0000 mgr.a (mgr.14388) 13297 : audit [DBG] from='client.289584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:43 smithi049 bash[23528]: audit 2024-09-21T03:21:42.944230+0000 mon.a (mon.0) 10774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:43 smithi049 bash[23528]: audit 2024-09-21T03:21:42.950211+0000 mon.a (mon.0) 10775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:43 smithi049 bash[23528]: audit 2024-09-21T03:21:42.955796+0000 mon.a (mon.0) 10776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:44 smithi044 bash[22676]: cluster 2024-09-21T03:21:43.408329+0000 mgr.a (mgr.14388) 13298 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:44 smithi179 bash[23186]: cluster 2024-09-21T03:21:43.408329+0000 mgr.a (mgr.14388) 13298 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:44 smithi049 bash[23528]: cluster 2024-09-21T03:21:43.408329+0000 mgr.a (mgr.14388) 13298 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:47.155 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:46 smithi049 bash[23528]: cluster 2024-09-21T03:21:45.410524+0000 mgr.a (mgr.14388) 13299 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:46 smithi044 bash[22676]: cluster 2024-09-21T03:21:45.410524+0000 mgr.a (mgr.14388) 13299 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:46 smithi179 bash[23186]: cluster 2024-09-21T03:21:45.410524+0000 mgr.a (mgr.14388) 13299 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:48.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:48.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:48.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:48.881 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:48 smithi044 bash[22676]: cluster 2024-09-21T03:21:47.411315+0000 mgr.a (mgr.14388) 13300 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:48 smithi179 bash[23186]: cluster 2024-09-21T03:21:47.411315+0000 mgr.a (mgr.14388) 13300 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:48 smithi049 bash[23528]: cluster 2024-09-21T03:21:47.411315+0000 mgr.a (mgr.14388) 13300 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:49 smithi044 bash[22676]: audit 2024-09-21T03:21:48.439251+0000 mgr.a (mgr.14388) 13301 : audit [DBG] from='client.289659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:50.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:49 smithi179 bash[23186]: audit 2024-09-21T03:21:48.439251+0000 mgr.a (mgr.14388) 13301 : audit [DBG] from='client.289659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:49 smithi049 bash[23528]: audit 2024-09-21T03:21:48.439251+0000 mgr.a (mgr.14388) 13301 : audit [DBG] from='client.289659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:51.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:21:51 smithi044 bash[22930]: debug 2024-09-21T03:21:51.199+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:21:51.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:21:51 smithi044 bash[22930]: debug 2024-09-21T03:21:51.199+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:21:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: cluster 2024-09-21T03:21:49.412475+0000 mgr.a (mgr.14388) 13302 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.383249+0000 mon.a (mon.0) 10777 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:21:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.390725+0000 mon.a (mon.0) 10778 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:21:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.392501+0000 mon.a (mon.0) 10779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:21:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.404014+0000 mon.a (mon.0) 10780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.410491+0000 mon.a (mon.0) 10781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:21:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.605051+0000 mon.a (mon.0) 10782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.611005+0000 mon.a (mon.0) 10783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:50 smithi044 bash[22676]: audit 2024-09-21T03:21:50.616762+0000 mon.a (mon.0) 10784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: cluster 2024-09-21T03:21:49.412475+0000 mgr.a (mgr.14388) 13302 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.383249+0000 mon.a (mon.0) 10777 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:21:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.390725+0000 mon.a (mon.0) 10778 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:21:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.392501+0000 mon.a (mon.0) 10779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:21:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.404014+0000 mon.a (mon.0) 10780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.410491+0000 mon.a (mon.0) 10781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:21:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.605051+0000 mon.a (mon.0) 10782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.611005+0000 mon.a (mon.0) 10783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:50 smithi179 bash[23186]: audit 2024-09-21T03:21:50.616762+0000 mon.a (mon.0) 10784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: cluster 2024-09-21T03:21:49.412475+0000 mgr.a (mgr.14388) 13302 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.383249+0000 mon.a (mon.0) 10777 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.390725+0000 mon.a (mon.0) 10778 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.392501+0000 mon.a (mon.0) 10779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.404014+0000 mon.a (mon.0) 10780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.410491+0000 mon.a (mon.0) 10781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.605051+0000 mon.a (mon.0) 10782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.611005+0000 mon.a (mon.0) 10783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:50 smithi049 bash[23528]: audit 2024-09-21T03:21:50.616762+0000 mon.a (mon.0) 10784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:21:52.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:51 smithi179 bash[23186]: audit 2024-09-21T03:21:50.413163+0000 mgr.a (mgr.14388) 13303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:21:52.282 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:51 smithi044 bash[22676]: audit 2024-09-21T03:21:50.413163+0000 mgr.a (mgr.14388) 13303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:21:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:51 smithi049 bash[23528]: audit 2024-09-21T03:21:50.413163+0000 mgr.a (mgr.14388) 13303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:21:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:52 smithi179 bash[23186]: audit 2024-09-21T03:21:51.203555+0000 mgr.a (mgr.14388) 13304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:21:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:52 smithi179 bash[23186]: cephadm 2024-09-21T03:21:51.205034+0000 mgr.a (mgr.14388) 13305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:21:53.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:52 smithi179 bash[23186]: cluster 2024-09-21T03:21:51.415402+0000 mgr.a (mgr.14388) 13306 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:53.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:52 smithi049 bash[23528]: audit 2024-09-21T03:21:51.203555+0000 mgr.a (mgr.14388) 13304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:21:53.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:52 smithi049 bash[23528]: cephadm 2024-09-21T03:21:51.205034+0000 mgr.a (mgr.14388) 13305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:21:53.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:52 smithi049 bash[23528]: cluster 2024-09-21T03:21:51.415402+0000 mgr.a (mgr.14388) 13306 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:53.384 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:52 smithi044 bash[22676]: audit 2024-09-21T03:21:51.203555+0000 mgr.a (mgr.14388) 13304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:21:53.385 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:52 smithi044 bash[22676]: cephadm 2024-09-21T03:21:51.205034+0000 mgr.a (mgr.14388) 13305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:21:53.385 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:52 smithi044 bash[22676]: cluster 2024-09-21T03:21:51.415402+0000 mgr.a (mgr.14388) 13306 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:21:53.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:53.882 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:53.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:21:54.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:21:54.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:21:54.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:21:54.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:21:54.675 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:21:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:54 smithi044 bash[22676]: cluster 2024-09-21T03:21:53.416087+0000 mgr.a (mgr.14388) 13307 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:54 smithi179 bash[23186]: cluster 2024-09-21T03:21:53.416087+0000 mgr.a (mgr.14388) 13307 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:54 smithi049 bash[23528]: cluster 2024-09-21T03:21:53.416087+0000 mgr.a (mgr.14388) 13307 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:21:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:56 smithi179 bash[23186]: audit 2024-09-21T03:21:54.222525+0000 mgr.a (mgr.14388) 13308 : audit [DBG] from='client.289842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:56 smithi049 bash[23528]: audit 2024-09-21T03:21:54.222525+0000 mgr.a (mgr.14388) 13308 : audit [DBG] from='client.289842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:56 smithi044 bash[22676]: audit 2024-09-21T03:21:54.222525+0000 mgr.a (mgr.14388) 13308 : audit [DBG] from='client.289842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:21:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:57 smithi049 bash[23528]: cluster 2024-09-21T03:21:55.418475+0000 mgr.a (mgr.14388) 13309 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:57 smithi044 bash[22676]: cluster 2024-09-21T03:21:55.418475+0000 mgr.a (mgr.14388) 13309 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:57 smithi179 bash[23186]: cluster 2024-09-21T03:21:55.418475+0000 mgr.a (mgr.14388) 13309 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:21:59 smithi049 bash[23528]: cluster 2024-09-21T03:21:57.419305+0000 mgr.a (mgr.14388) 13310 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:21:59 smithi044 bash[22676]: cluster 2024-09-21T03:21:57.419305+0000 mgr.a (mgr.14388) 13310 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:21:59 smithi179 bash[23186]: cluster 2024-09-21T03:21:57.419305+0000 mgr.a (mgr.14388) 13310 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:21:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:21:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:21:59.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:00.439 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:01 smithi049 bash[23528]: cluster 2024-09-21T03:21:59.420099+0000 mgr.a (mgr.14388) 13311 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:01 smithi049 bash[23528]: audit 2024-09-21T03:22:00.011473+0000 mgr.a (mgr.14388) 13312 : audit [DBG] from='client.289920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:01 smithi044 bash[22676]: cluster 2024-09-21T03:21:59.420099+0000 mgr.a (mgr.14388) 13311 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:01 smithi044 bash[22676]: audit 2024-09-21T03:22:00.011473+0000 mgr.a (mgr.14388) 13312 : audit [DBG] from='client.289920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:01 smithi179 bash[23186]: cluster 2024-09-21T03:21:59.420099+0000 mgr.a (mgr.14388) 13311 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:01 smithi179 bash[23186]: audit 2024-09-21T03:22:00.011473+0000 mgr.a (mgr.14388) 13312 : audit [DBG] from='client.289920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:03 smithi044 bash[22676]: cluster 2024-09-21T03:22:01.422867+0000 mgr.a (mgr.14388) 13313 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:03 smithi044 bash[22676]: audit 2024-09-21T03:22:02.917428+0000 mon.a (mon.0) 10785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:03 smithi044 bash[22676]: audit 2024-09-21T03:22:02.926632+0000 mon.a (mon.0) 10786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:03 smithi044 bash[22676]: audit 2024-09-21T03:22:02.938391+0000 mon.a (mon.0) 10787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:03 smithi049 bash[23528]: cluster 2024-09-21T03:22:01.422867+0000 mgr.a (mgr.14388) 13313 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:03 smithi049 bash[23528]: audit 2024-09-21T03:22:02.917428+0000 mon.a (mon.0) 10785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:03 smithi049 bash[23528]: audit 2024-09-21T03:22:02.926632+0000 mon.a (mon.0) 10786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:03 smithi049 bash[23528]: audit 2024-09-21T03:22:02.938391+0000 mon.a (mon.0) 10787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:03 smithi179 bash[23186]: cluster 2024-09-21T03:22:01.422867+0000 mgr.a (mgr.14388) 13313 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:03.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:03 smithi179 bash[23186]: audit 2024-09-21T03:22:02.917428+0000 mon.a (mon.0) 10785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:03 smithi179 bash[23186]: audit 2024-09-21T03:22:02.926632+0000 mon.a (mon.0) 10786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:03 smithi179 bash[23186]: audit 2024-09-21T03:22:02.938391+0000 mon.a (mon.0) 10787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:04 smithi044 bash[22676]: audit 2024-09-21T03:22:03.166968+0000 mon.a (mon.0) 10788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:04 smithi044 bash[22676]: audit 2024-09-21T03:22:03.176836+0000 mon.a (mon.0) 10789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:04 smithi044 bash[22676]: audit 2024-09-21T03:22:03.186789+0000 mon.a (mon.0) 10790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:04 smithi044 bash[22676]: cluster 2024-09-21T03:22:03.423656+0000 mgr.a (mgr.14388) 13314 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:22:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:04 smithi179 bash[23186]: audit 2024-09-21T03:22:03.166968+0000 mon.a (mon.0) 10788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:04 smithi179 bash[23186]: audit 2024-09-21T03:22:03.176836+0000 mon.a (mon.0) 10789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:04 smithi179 bash[23186]: audit 2024-09-21T03:22:03.186789+0000 mon.a (mon.0) 10790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:04 smithi179 bash[23186]: cluster 2024-09-21T03:22:03.423656+0000 mgr.a (mgr.14388) 13314 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:22:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:04 smithi049 bash[23528]: audit 2024-09-21T03:22:03.166968+0000 mon.a (mon.0) 10788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:04 smithi049 bash[23528]: audit 2024-09-21T03:22:03.176836+0000 mon.a (mon.0) 10789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:04 smithi049 bash[23528]: audit 2024-09-21T03:22:03.186789+0000 mon.a (mon.0) 10790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:04 smithi049 bash[23528]: cluster 2024-09-21T03:22:03.423656+0000 mgr.a (mgr.14388) 13314 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:22:05.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:05.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:05.441 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:06.227 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:06.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:06.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:06.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:06.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:06 smithi044 bash[22676]: cluster 2024-09-21T03:22:05.425614+0000 mgr.a (mgr.14388) 13315 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:06 smithi044 bash[22676]: audit 2024-09-21T03:22:05.773528+0000 mgr.a (mgr.14388) 13316 : audit [DBG] from='client.289995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:06 smithi179 bash[23186]: cluster 2024-09-21T03:22:05.425614+0000 mgr.a (mgr.14388) 13315 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:06.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:06 smithi179 bash[23186]: audit 2024-09-21T03:22:05.773528+0000 mgr.a (mgr.14388) 13316 : audit [DBG] from='client.289995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:06 smithi049 bash[23528]: cluster 2024-09-21T03:22:05.425614+0000 mgr.a (mgr.14388) 13315 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:06 smithi049 bash[23528]: audit 2024-09-21T03:22:05.773528+0000 mgr.a (mgr.14388) 13316 : audit [DBG] from='client.289995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:08 smithi044 bash[22676]: cluster 2024-09-21T03:22:07.426525+0000 mgr.a (mgr.14388) 13317 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:22:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:08 smithi179 bash[23186]: cluster 2024-09-21T03:22:07.426525+0000 mgr.a (mgr.14388) 13317 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:22:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:08 smithi049 bash[23528]: cluster 2024-09-21T03:22:07.426525+0000 mgr.a (mgr.14388) 13317 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:22:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:10 smithi179 bash[23186]: cluster 2024-09-21T03:22:09.427292+0000 mgr.a (mgr.14388) 13318 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:22:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:10 smithi049 bash[23528]: cluster 2024-09-21T03:22:09.427292+0000 mgr.a (mgr.14388) 13318 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:22:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:10 smithi044 bash[22676]: cluster 2024-09-21T03:22:09.427292+0000 mgr.a (mgr.14388) 13318 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:22:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:11.229 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:11.229 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:12.029 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:11 smithi044 bash[22676]: audit 2024-09-21T03:22:10.831112+0000 mon.a (mon.0) 10791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:11 smithi044 bash[22676]: audit 2024-09-21T03:22:10.840004+0000 mon.a (mon.0) 10792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:11 smithi044 bash[22676]: audit 2024-09-21T03:22:10.850659+0000 mon.a (mon.0) 10793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:11 smithi179 bash[23186]: audit 2024-09-21T03:22:10.831112+0000 mon.a (mon.0) 10791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:11 smithi179 bash[23186]: audit 2024-09-21T03:22:10.840004+0000 mon.a (mon.0) 10792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:11 smithi179 bash[23186]: audit 2024-09-21T03:22:10.850659+0000 mon.a (mon.0) 10793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:11 smithi049 bash[23528]: audit 2024-09-21T03:22:10.831112+0000 mon.a (mon.0) 10791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:11 smithi049 bash[23528]: audit 2024-09-21T03:22:10.840004+0000 mon.a (mon.0) 10792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:11 smithi049 bash[23528]: audit 2024-09-21T03:22:10.850659+0000 mon.a (mon.0) 10793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:12 smithi044 bash[22676]: cluster 2024-09-21T03:22:11.429395+0000 mgr.a (mgr.14388) 13319 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:12 smithi044 bash[22676]: audit 2024-09-21T03:22:11.570263+0000 mgr.a (mgr.14388) 13320 : audit [DBG] from='client.290073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:13.246 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:12 smithi179 bash[23186]: cluster 2024-09-21T03:22:11.429395+0000 mgr.a (mgr.14388) 13319 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:13.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:12 smithi179 bash[23186]: audit 2024-09-21T03:22:11.570263+0000 mgr.a (mgr.14388) 13320 : audit [DBG] from='client.290073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:12 smithi049 bash[23528]: cluster 2024-09-21T03:22:11.429395+0000 mgr.a (mgr.14388) 13319 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:12 smithi049 bash[23528]: audit 2024-09-21T03:22:11.570263+0000 mgr.a (mgr.14388) 13320 : audit [DBG] from='client.290073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:15.122 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:14 smithi044 bash[22676]: cluster 2024-09-21T03:22:13.429956+0000 mgr.a (mgr.14388) 13321 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:15.137 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:14 smithi179 bash[23186]: cluster 2024-09-21T03:22:13.429956+0000 mgr.a (mgr.14388) 13321 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:14 smithi049 bash[23528]: cluster 2024-09-21T03:22:13.429956+0000 mgr.a (mgr.14388) 13321 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:17.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:17.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:17.032 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:16 smithi044 bash[22676]: cluster 2024-09-21T03:22:15.431321+0000 mgr.a (mgr.14388) 13322 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:16 smithi179 bash[23186]: cluster 2024-09-21T03:22:15.431321+0000 mgr.a (mgr.14388) 13322 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:16 smithi049 bash[23528]: cluster 2024-09-21T03:22:15.431321+0000 mgr.a (mgr.14388) 13322 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:17.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:17.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:17.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:18 smithi044 bash[22676]: audit 2024-09-21T03:22:17.367803+0000 mgr.a (mgr.14388) 13323 : audit [DBG] from='client.290145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:18 smithi044 bash[22676]: cluster 2024-09-21T03:22:17.431877+0000 mgr.a (mgr.14388) 13324 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:18 smithi179 bash[23186]: audit 2024-09-21T03:22:17.367803+0000 mgr.a (mgr.14388) 13323 : audit [DBG] from='client.290145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:18 smithi179 bash[23186]: cluster 2024-09-21T03:22:17.431877+0000 mgr.a (mgr.14388) 13324 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:18 smithi049 bash[23528]: audit 2024-09-21T03:22:17.367803+0000 mgr.a (mgr.14388) 13323 : audit [DBG] from='client.290145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:18 smithi049 bash[23528]: cluster 2024-09-21T03:22:17.431877+0000 mgr.a (mgr.14388) 13324 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:20 smithi044 bash[22676]: cluster 2024-09-21T03:22:19.432759+0000 mgr.a (mgr.14388) 13325 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:20 smithi179 bash[23186]: cluster 2024-09-21T03:22:19.432759+0000 mgr.a (mgr.14388) 13325 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:20 smithi049 bash[23528]: cluster 2024-09-21T03:22:19.432759+0000 mgr.a (mgr.14388) 13325 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:22.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:22.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:22.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:23.146 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:22 smithi044 bash[22676]: cluster 2024-09-21T03:22:21.435171+0000 mgr.a (mgr.14388) 13326 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:22 smithi179 bash[23186]: cluster 2024-09-21T03:22:21.435171+0000 mgr.a (mgr.14388) 13326 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:22 smithi049 bash[23528]: cluster 2024-09-21T03:22:21.435171+0000 mgr.a (mgr.14388) 13326 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:23.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:23.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:24 smithi044 bash[22676]: audit 2024-09-21T03:22:23.122783+0000 mon.a (mon.0) 10794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:24 smithi044 bash[22676]: audit 2024-09-21T03:22:23.132306+0000 mon.a (mon.0) 10795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:24 smithi044 bash[22676]: audit 2024-09-21T03:22:23.143944+0000 mon.a (mon.0) 10796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:24 smithi044 bash[22676]: audit 2024-09-21T03:22:23.378720+0000 mon.a (mon.0) 10797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:24 smithi044 bash[22676]: audit 2024-09-21T03:22:23.384818+0000 mon.a (mon.0) 10798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:24 smithi044 bash[22676]: audit 2024-09-21T03:22:23.403754+0000 mon.a (mon.0) 10799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:24 smithi179 bash[23186]: audit 2024-09-21T03:22:23.122783+0000 mon.a (mon.0) 10794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:24 smithi179 bash[23186]: audit 2024-09-21T03:22:23.132306+0000 mon.a (mon.0) 10795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:24 smithi179 bash[23186]: audit 2024-09-21T03:22:23.143944+0000 mon.a (mon.0) 10796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:24 smithi179 bash[23186]: audit 2024-09-21T03:22:23.378720+0000 mon.a (mon.0) 10797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:24 smithi179 bash[23186]: audit 2024-09-21T03:22:23.384818+0000 mon.a (mon.0) 10798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:24 smithi179 bash[23186]: audit 2024-09-21T03:22:23.403754+0000 mon.a (mon.0) 10799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:24 smithi049 bash[23528]: audit 2024-09-21T03:22:23.122783+0000 mon.a (mon.0) 10794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:24 smithi049 bash[23528]: audit 2024-09-21T03:22:23.132306+0000 mon.a (mon.0) 10795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:24 smithi049 bash[23528]: audit 2024-09-21T03:22:23.143944+0000 mon.a (mon.0) 10796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:24 smithi049 bash[23528]: audit 2024-09-21T03:22:23.378720+0000 mon.a (mon.0) 10797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:24 smithi049 bash[23528]: audit 2024-09-21T03:22:23.384818+0000 mon.a (mon.0) 10798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:24.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:24 smithi049 bash[23528]: audit 2024-09-21T03:22:23.403754+0000 mon.a (mon.0) 10799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:25 smithi044 bash[22676]: audit 2024-09-21T03:22:23.158100+0000 mgr.a (mgr.14388) 13327 : audit [DBG] from='client.290223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:25 smithi044 bash[22676]: cluster 2024-09-21T03:22:23.435735+0000 mgr.a (mgr.14388) 13328 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:25 smithi179 bash[23186]: audit 2024-09-21T03:22:23.158100+0000 mgr.a (mgr.14388) 13327 : audit [DBG] from='client.290223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:25 smithi179 bash[23186]: cluster 2024-09-21T03:22:23.435735+0000 mgr.a (mgr.14388) 13328 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:25 smithi049 bash[23528]: audit 2024-09-21T03:22:23.158100+0000 mgr.a (mgr.14388) 13327 : audit [DBG] from='client.290223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:25 smithi049 bash[23528]: cluster 2024-09-21T03:22:23.435735+0000 mgr.a (mgr.14388) 13328 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:27.445 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:27 smithi049 bash[23528]: cluster 2024-09-21T03:22:25.438113+0000 mgr.a (mgr.14388) 13329 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:27 smithi044 bash[22676]: cluster 2024-09-21T03:22:25.438113+0000 mgr.a (mgr.14388) 13329 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:27.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:27 smithi179 bash[23186]: cluster 2024-09-21T03:22:25.438113+0000 mgr.a (mgr.14388) 13329 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:28.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:28.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:28.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:29.354 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:29.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:29.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:29.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:29.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:29 smithi044 bash[22676]: cluster 2024-09-21T03:22:27.438906+0000 mgr.a (mgr.14388) 13330 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:29 smithi179 bash[23186]: cluster 2024-09-21T03:22:27.438906+0000 mgr.a (mgr.14388) 13330 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:29 smithi049 bash[23528]: cluster 2024-09-21T03:22:27.438906+0000 mgr.a (mgr.14388) 13330 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:30 smithi044 bash[22676]: audit 2024-09-21T03:22:28.936003+0000 mgr.a (mgr.14388) 13331 : audit [DBG] from='client.290301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:30.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:30 smithi179 bash[23186]: audit 2024-09-21T03:22:28.936003+0000 mgr.a (mgr.14388) 13331 : audit [DBG] from='client.290301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:30.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:30 smithi049 bash[23528]: audit 2024-09-21T03:22:28.936003+0000 mgr.a (mgr.14388) 13331 : audit [DBG] from='client.290301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:31 smithi044 bash[22676]: cluster 2024-09-21T03:22:29.439634+0000 mgr.a (mgr.14388) 13332 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:31 smithi044 bash[22676]: audit 2024-09-21T03:22:31.029194+0000 mon.a (mon.0) 10800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:31 smithi044 bash[22676]: audit 2024-09-21T03:22:31.039310+0000 mon.a (mon.0) 10801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:31 smithi044 bash[22676]: audit 2024-09-21T03:22:31.049740+0000 mon.a (mon.0) 10802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:31 smithi179 bash[23186]: cluster 2024-09-21T03:22:29.439634+0000 mgr.a (mgr.14388) 13332 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:31 smithi179 bash[23186]: audit 2024-09-21T03:22:31.029194+0000 mon.a (mon.0) 10800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:31 smithi179 bash[23186]: audit 2024-09-21T03:22:31.039310+0000 mon.a (mon.0) 10801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:31 smithi179 bash[23186]: audit 2024-09-21T03:22:31.049740+0000 mon.a (mon.0) 10802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:31 smithi049 bash[23528]: cluster 2024-09-21T03:22:29.439634+0000 mgr.a (mgr.14388) 13332 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:31 smithi049 bash[23528]: audit 2024-09-21T03:22:31.029194+0000 mon.a (mon.0) 10800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:31 smithi049 bash[23528]: audit 2024-09-21T03:22:31.039310+0000 mon.a (mon.0) 10801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:31.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:31 smithi049 bash[23528]: audit 2024-09-21T03:22:31.049740+0000 mon.a (mon.0) 10802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:33 smithi044 bash[22676]: cluster 2024-09-21T03:22:31.441897+0000 mgr.a (mgr.14388) 13333 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:33.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:33 smithi179 bash[23186]: cluster 2024-09-21T03:22:31.441897+0000 mgr.a (mgr.14388) 13333 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:33 smithi049 bash[23528]: cluster 2024-09-21T03:22:31.441897+0000 mgr.a (mgr.14388) 13333 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:22:34.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:34.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:34.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:35.115 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:35.426 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:35 smithi044 bash[22676]: cluster 2024-09-21T03:22:33.442666+0000 mgr.a (mgr.14388) 13334 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:35.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:35 smithi179 bash[23186]: cluster 2024-09-21T03:22:33.442666+0000 mgr.a (mgr.14388) 13334 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:35 smithi049 bash[23528]: cluster 2024-09-21T03:22:33.442666+0000 mgr.a (mgr.14388) 13334 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:36.416 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:36 smithi179 bash[23186]: audit 2024-09-21T03:22:34.688065+0000 mgr.a (mgr.14388) 13335 : audit [DBG] from='client.290376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:36.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:36 smithi044 bash[22676]: audit 2024-09-21T03:22:34.688065+0000 mgr.a (mgr.14388) 13335 : audit [DBG] from='client.290376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:36 smithi049 bash[23528]: audit 2024-09-21T03:22:34.688065+0000 mgr.a (mgr.14388) 13335 : audit [DBG] from='client.290376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:37 smithi179 bash[23186]: cluster 2024-09-21T03:22:35.443955+0000 mgr.a (mgr.14388) 13336 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:22:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:37 smithi044 bash[22676]: cluster 2024-09-21T03:22:35.443955+0000 mgr.a (mgr.14388) 13336 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:22:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:37 smithi049 bash[23528]: cluster 2024-09-21T03:22:35.443955+0000 mgr.a (mgr.14388) 13336 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:22:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:38 smithi044 bash[22676]: cluster 2024-09-21T03:22:37.444716+0000 mgr.a (mgr.14388) 13337 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:22:38.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:38 smithi179 bash[23186]: cluster 2024-09-21T03:22:37.444716+0000 mgr.a (mgr.14388) 13337 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:22:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:38 smithi049 bash[23528]: cluster 2024-09-21T03:22:37.444716+0000 mgr.a (mgr.14388) 13337 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:22:40.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:40.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:40.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:40 smithi049 bash[23528]: cluster 2024-09-21T03:22:39.445560+0000 mgr.a (mgr.14388) 13338 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:22:40.890 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:40.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:40.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:40.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:40.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:40 smithi044 bash[22676]: cluster 2024-09-21T03:22:39.445560+0000 mgr.a (mgr.14388) 13338 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:22:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:40 smithi179 bash[23186]: cluster 2024-09-21T03:22:39.445560+0000 mgr.a (mgr.14388) 13338 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:22:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:41 smithi049 bash[23528]: audit 2024-09-21T03:22:40.451015+0000 mgr.a (mgr.14388) 13339 : audit [DBG] from='client.290454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:41 smithi044 bash[22676]: audit 2024-09-21T03:22:40.451015+0000 mgr.a (mgr.14388) 13339 : audit [DBG] from='client.290454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:42.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:41 smithi179 bash[23186]: audit 2024-09-21T03:22:40.451015+0000 mgr.a (mgr.14388) 13339 : audit [DBG] from='client.290454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:42 smithi049 bash[23528]: cluster 2024-09-21T03:22:41.448363+0000 mgr.a (mgr.14388) 13340 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:42 smithi044 bash[22676]: cluster 2024-09-21T03:22:41.448363+0000 mgr.a (mgr.14388) 13340 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:42 smithi179 bash[23186]: cluster 2024-09-21T03:22:41.448363+0000 mgr.a (mgr.14388) 13340 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:44 smithi044 bash[22676]: audit 2024-09-21T03:22:43.349834+0000 mon.a (mon.0) 10803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:44 smithi044 bash[22676]: audit 2024-09-21T03:22:43.358004+0000 mon.a (mon.0) 10804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:44 smithi044 bash[22676]: audit 2024-09-21T03:22:43.368650+0000 mon.a (mon.0) 10805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:44 smithi044 bash[22676]: cluster 2024-09-21T03:22:43.449151+0000 mgr.a (mgr.14388) 13341 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:22:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:44 smithi044 bash[22676]: audit 2024-09-21T03:22:43.612714+0000 mon.a (mon.0) 10806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:44 smithi044 bash[22676]: audit 2024-09-21T03:22:43.621114+0000 mon.a (mon.0) 10807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:44 smithi044 bash[22676]: audit 2024-09-21T03:22:43.631386+0000 mon.a (mon.0) 10808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:44 smithi179 bash[23186]: audit 2024-09-21T03:22:43.349834+0000 mon.a (mon.0) 10803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:44 smithi179 bash[23186]: audit 2024-09-21T03:22:43.358004+0000 mon.a (mon.0) 10804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:44 smithi179 bash[23186]: audit 2024-09-21T03:22:43.368650+0000 mon.a (mon.0) 10805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:44 smithi179 bash[23186]: cluster 2024-09-21T03:22:43.449151+0000 mgr.a (mgr.14388) 13341 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:22:44.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:44 smithi179 bash[23186]: audit 2024-09-21T03:22:43.612714+0000 mon.a (mon.0) 10806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:44 smithi179 bash[23186]: audit 2024-09-21T03:22:43.621114+0000 mon.a (mon.0) 10807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:44 smithi179 bash[23186]: audit 2024-09-21T03:22:43.631386+0000 mon.a (mon.0) 10808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:44 smithi049 bash[23528]: audit 2024-09-21T03:22:43.349834+0000 mon.a (mon.0) 10803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:44 smithi049 bash[23528]: audit 2024-09-21T03:22:43.358004+0000 mon.a (mon.0) 10804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:44 smithi049 bash[23528]: audit 2024-09-21T03:22:43.368650+0000 mon.a (mon.0) 10805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:44 smithi049 bash[23528]: cluster 2024-09-21T03:22:43.449151+0000 mgr.a (mgr.14388) 13341 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:22:44.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:44 smithi049 bash[23528]: audit 2024-09-21T03:22:43.612714+0000 mon.a (mon.0) 10806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:44 smithi049 bash[23528]: audit 2024-09-21T03:22:43.621114+0000 mon.a (mon.0) 10807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:44.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:44 smithi049 bash[23528]: audit 2024-09-21T03:22:43.631386+0000 mon.a (mon.0) 10808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:45.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:45.893 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:45.893 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:46.658 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:46.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:46 smithi049 bash[23528]: cluster 2024-09-21T03:22:45.451064+0000 mgr.a (mgr.14388) 13342 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:46 smithi044 bash[22676]: cluster 2024-09-21T03:22:45.451064+0000 mgr.a (mgr.14388) 13342 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:47.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:46 smithi179 bash[23186]: cluster 2024-09-21T03:22:45.451064+0000 mgr.a (mgr.14388) 13342 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:47 smithi049 bash[23528]: audit 2024-09-21T03:22:46.223501+0000 mgr.a (mgr.14388) 13343 : audit [DBG] from='client.290529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:47 smithi044 bash[22676]: audit 2024-09-21T03:22:46.223501+0000 mgr.a (mgr.14388) 13343 : audit [DBG] from='client.290529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:48.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:47 smithi179 bash[23186]: audit 2024-09-21T03:22:46.223501+0000 mgr.a (mgr.14388) 13343 : audit [DBG] from='client.290529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:48 smithi049 bash[23528]: cluster 2024-09-21T03:22:47.451988+0000 mgr.a (mgr.14388) 13344 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:22:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:48 smithi044 bash[22676]: cluster 2024-09-21T03:22:47.451988+0000 mgr.a (mgr.14388) 13344 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:22:49.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:48 smithi179 bash[23186]: cluster 2024-09-21T03:22:47.451988+0000 mgr.a (mgr.14388) 13344 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:22:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:50 smithi049 bash[23528]: cluster 2024-09-21T03:22:49.452772+0000 mgr.a (mgr.14388) 13345 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:22:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:50 smithi044 bash[22676]: cluster 2024-09-21T03:22:49.452772+0000 mgr.a (mgr.14388) 13345 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:22:51.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:50 smithi179 bash[23186]: cluster 2024-09-21T03:22:49.452772+0000 mgr.a (mgr.14388) 13345 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:22:51.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:51.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:51.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:52.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22930]: debug 2024-09-21T03:22:52.106+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:22:52.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22930]: debug 2024-09-21T03:22:52.122+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:22:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.265360+0000 mon.a (mon.0) 10809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.275653+0000 mon.a (mon.0) 10810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.276392+0000 mon.a (mon.0) 10811 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.288281+0000 mon.a (mon.0) 10812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.288935+0000 mon.a (mon.0) 10813 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.291080+0000 mon.a (mon.0) 10814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.302773+0000 mon.a (mon.0) 10815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.308834+0000 mon.a (mon.0) 10816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:51.311283+0000 mgr.a (mgr.14388) 13346 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: cluster 2024-09-21T03:22:51.454323+0000 mgr.a (mgr.14388) 13347 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:52.008441+0000 mgr.a (mgr.14388) 13348 : audit [DBG] from='client.290676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: audit 2024-09-21T03:22:52.112362+0000 mgr.a (mgr.14388) 13349 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:22:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:52 smithi044 bash[22676]: cephadm 2024-09-21T03:22:52.125678+0000 mgr.a (mgr.14388) 13350 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:22:52.531 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:52.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:52.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:52.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:52.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.265360+0000 mon.a (mon.0) 10809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.275653+0000 mon.a (mon.0) 10810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.276392+0000 mon.a (mon.0) 10811 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.288281+0000 mon.a (mon.0) 10812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.288935+0000 mon.a (mon.0) 10813 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.291080+0000 mon.a (mon.0) 10814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.302773+0000 mon.a (mon.0) 10815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.308834+0000 mon.a (mon.0) 10816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:51.311283+0000 mgr.a (mgr.14388) 13346 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: cluster 2024-09-21T03:22:51.454323+0000 mgr.a (mgr.14388) 13347 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:52.008441+0000 mgr.a (mgr.14388) 13348 : audit [DBG] from='client.290676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: audit 2024-09-21T03:22:52.112362+0000 mgr.a (mgr.14388) 13349 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:22:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:52 smithi049 bash[23528]: cephadm 2024-09-21T03:22:52.125678+0000 mgr.a (mgr.14388) 13350 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.265360+0000 mon.a (mon.0) 10809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.275653+0000 mon.a (mon.0) 10810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.276392+0000 mon.a (mon.0) 10811 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.288281+0000 mon.a (mon.0) 10812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.288935+0000 mon.a (mon.0) 10813 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.291080+0000 mon.a (mon.0) 10814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.302773+0000 mon.a (mon.0) 10815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.308834+0000 mon.a (mon.0) 10816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:51.311283+0000 mgr.a (mgr.14388) 13346 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: cluster 2024-09-21T03:22:51.454323+0000 mgr.a (mgr.14388) 13347 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:22:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:52.008441+0000 mgr.a (mgr.14388) 13348 : audit [DBG] from='client.290676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: audit 2024-09-21T03:22:52.112362+0000 mgr.a (mgr.14388) 13349 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:22:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:52 smithi179 bash[23186]: cephadm 2024-09-21T03:22:52.125678+0000 mgr.a (mgr.14388) 13350 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:22:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:54 smithi049 bash[23528]: cluster 2024-09-21T03:22:53.455367+0000 mgr.a (mgr.14388) 13351 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:54.889 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:54 smithi179 bash[23186]: cluster 2024-09-21T03:22:53.455367+0000 mgr.a (mgr.14388) 13351 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:54 smithi044 bash[22676]: cluster 2024-09-21T03:22:53.455367+0000 mgr.a (mgr.14388) 13351 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:22:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:56 smithi044 bash[22676]: cluster 2024-09-21T03:22:55.457809+0000 mgr.a (mgr.14388) 13352 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:56 smithi049 bash[23528]: cluster 2024-09-21T03:22:55.457809+0000 mgr.a (mgr.14388) 13352 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:57.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:56 smithi179 bash[23186]: cluster 2024-09-21T03:22:55.457809+0000 mgr.a (mgr.14388) 13352 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:57.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:22:57.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:22:57.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:22:58.305 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:22:58.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:22:58.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:22:58.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:22:58.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:22:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:58 smithi049 bash[23528]: cluster 2024-09-21T03:22:57.458766+0000 mgr.a (mgr.14388) 13353 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:58.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:22:58 smithi049 bash[23528]: audit 2024-09-21T03:22:57.866667+0000 mgr.a (mgr.14388) 13354 : audit [DBG] from='client.290790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:58 smithi044 bash[22676]: cluster 2024-09-21T03:22:57.458766+0000 mgr.a (mgr.14388) 13353 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:22:58 smithi044 bash[22676]: audit 2024-09-21T03:22:57.866667+0000 mgr.a (mgr.14388) 13354 : audit [DBG] from='client.290790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:22:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:58 smithi179 bash[23186]: cluster 2024-09-21T03:22:57.458766+0000 mgr.a (mgr.14388) 13353 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:22:59.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:22:58 smithi179 bash[23186]: audit 2024-09-21T03:22:57.866667+0000 mgr.a (mgr.14388) 13354 : audit [DBG] from='client.290790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:00 smithi049 bash[23528]: cluster 2024-09-21T03:22:59.459696+0000 mgr.a (mgr.14388) 13355 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:00 smithi044 bash[22676]: cluster 2024-09-21T03:22:59.459696+0000 mgr.a (mgr.14388) 13355 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:00 smithi179 bash[23186]: cluster 2024-09-21T03:22:59.459696+0000 mgr.a (mgr.14388) 13355 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:02 smithi049 bash[23528]: cluster 2024-09-21T03:23:01.461966+0000 mgr.a (mgr.14388) 13356 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:02 smithi044 bash[22676]: cluster 2024-09-21T03:23:01.461966+0000 mgr.a (mgr.14388) 13356 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:02 smithi179 bash[23186]: cluster 2024-09-21T03:23:01.461966+0000 mgr.a (mgr.14388) 13356 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:03.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:03.307 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:03.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:04.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:04.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:04.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:04.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: cluster 2024-09-21T03:23:03.462414+0000 mgr.a (mgr.14388) 13357 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: audit 2024-09-21T03:23:03.519182+0000 mon.a (mon.0) 10817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: audit 2024-09-21T03:23:03.525366+0000 mon.a (mon.0) 10818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: audit 2024-09-21T03:23:03.532064+0000 mon.a (mon.0) 10819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: audit 2024-09-21T03:23:03.643689+0000 mgr.a (mgr.14388) 13358 : audit [DBG] from='client.290868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: audit 2024-09-21T03:23:03.830577+0000 mon.a (mon.0) 10820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: audit 2024-09-21T03:23:03.836413+0000 mon.a (mon.0) 10821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:04 smithi049 bash[23528]: audit 2024-09-21T03:23:03.843661+0000 mon.a (mon.0) 10822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: cluster 2024-09-21T03:23:03.462414+0000 mgr.a (mgr.14388) 13357 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: audit 2024-09-21T03:23:03.519182+0000 mon.a (mon.0) 10817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: audit 2024-09-21T03:23:03.525366+0000 mon.a (mon.0) 10818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: audit 2024-09-21T03:23:03.532064+0000 mon.a (mon.0) 10819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: audit 2024-09-21T03:23:03.643689+0000 mgr.a (mgr.14388) 13358 : audit [DBG] from='client.290868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: audit 2024-09-21T03:23:03.830577+0000 mon.a (mon.0) 10820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: audit 2024-09-21T03:23:03.836413+0000 mon.a (mon.0) 10821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:04 smithi044 bash[22676]: audit 2024-09-21T03:23:03.843661+0000 mon.a (mon.0) 10822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: cluster 2024-09-21T03:23:03.462414+0000 mgr.a (mgr.14388) 13357 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: audit 2024-09-21T03:23:03.519182+0000 mon.a (mon.0) 10817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: audit 2024-09-21T03:23:03.525366+0000 mon.a (mon.0) 10818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: audit 2024-09-21T03:23:03.532064+0000 mon.a (mon.0) 10819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: audit 2024-09-21T03:23:03.643689+0000 mgr.a (mgr.14388) 13358 : audit [DBG] from='client.290868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: audit 2024-09-21T03:23:03.830577+0000 mon.a (mon.0) 10820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: audit 2024-09-21T03:23:03.836413+0000 mon.a (mon.0) 10821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:05.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:04 smithi179 bash[23186]: audit 2024-09-21T03:23:03.843661+0000 mon.a (mon.0) 10822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:06 smithi049 bash[23528]: cluster 2024-09-21T03:23:05.464605+0000 mgr.a (mgr.14388) 13359 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:06.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:06 smithi044 bash[22676]: cluster 2024-09-21T03:23:05.464605+0000 mgr.a (mgr.14388) 13359 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:07.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:06 smithi179 bash[23186]: cluster 2024-09-21T03:23:05.464605+0000 mgr.a (mgr.14388) 13359 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:08 smithi049 bash[23528]: cluster 2024-09-21T03:23:07.465417+0000 mgr.a (mgr.14388) 13360 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:08 smithi044 bash[22676]: cluster 2024-09-21T03:23:07.465417+0000 mgr.a (mgr.14388) 13360 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:08 smithi179 bash[23186]: cluster 2024-09-21T03:23:07.465417+0000 mgr.a (mgr.14388) 13360 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:09.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:09.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:09.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:09.822 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:09.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:09.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:09.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:09.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:10 smithi049 bash[23528]: audit 2024-09-21T03:23:09.397667+0000 mgr.a (mgr.14388) 13361 : audit [DBG] from='client.290943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:10 smithi049 bash[23528]: cluster 2024-09-21T03:23:09.465979+0000 mgr.a (mgr.14388) 13362 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:10 smithi044 bash[22676]: audit 2024-09-21T03:23:09.397667+0000 mgr.a (mgr.14388) 13361 : audit [DBG] from='client.290943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:10 smithi044 bash[22676]: cluster 2024-09-21T03:23:09.465979+0000 mgr.a (mgr.14388) 13362 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:10 smithi179 bash[23186]: audit 2024-09-21T03:23:09.397667+0000 mgr.a (mgr.14388) 13361 : audit [DBG] from='client.290943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:10 smithi179 bash[23186]: cluster 2024-09-21T03:23:09.465979+0000 mgr.a (mgr.14388) 13362 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:12 smithi044 bash[22676]: cluster 2024-09-21T03:23:11.468396+0000 mgr.a (mgr.14388) 13363 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:12 smithi044 bash[22676]: audit 2024-09-21T03:23:11.468594+0000 mon.a (mon.0) 10823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:12 smithi044 bash[22676]: audit 2024-09-21T03:23:11.477314+0000 mon.a (mon.0) 10824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:12 smithi044 bash[22676]: audit 2024-09-21T03:23:11.487690+0000 mon.a (mon.0) 10825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:12 smithi179 bash[23186]: cluster 2024-09-21T03:23:11.468396+0000 mgr.a (mgr.14388) 13363 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:12 smithi179 bash[23186]: audit 2024-09-21T03:23:11.468594+0000 mon.a (mon.0) 10823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:12 smithi179 bash[23186]: audit 2024-09-21T03:23:11.477314+0000 mon.a (mon.0) 10824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:12 smithi179 bash[23186]: audit 2024-09-21T03:23:11.487690+0000 mon.a (mon.0) 10825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:12 smithi049 bash[23528]: cluster 2024-09-21T03:23:11.468396+0000 mgr.a (mgr.14388) 13363 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:12 smithi049 bash[23528]: audit 2024-09-21T03:23:11.468594+0000 mon.a (mon.0) 10823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:12 smithi049 bash[23528]: audit 2024-09-21T03:23:11.477314+0000 mon.a (mon.0) 10824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:12 smithi049 bash[23528]: audit 2024-09-21T03:23:11.487690+0000 mon.a (mon.0) 10825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:14 smithi044 bash[22676]: cluster 2024-09-21T03:23:13.469390+0000 mgr.a (mgr.14388) 13364 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:14.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:14 smithi179 bash[23186]: cluster 2024-09-21T03:23:13.469390+0000 mgr.a (mgr.14388) 13364 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:14 smithi049 bash[23528]: cluster 2024-09-21T03:23:13.469390+0000 mgr.a (mgr.14388) 13364 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:14.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:14.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:15.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:15 smithi179 bash[23186]: audit 2024-09-21T03:23:15.165570+0000 mgr.a (mgr.14388) 13365 : audit [DBG] from='client.291018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:15.577 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:15.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:15.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:15.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:15.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:15 smithi044 bash[22676]: audit 2024-09-21T03:23:15.165570+0000 mgr.a (mgr.14388) 13365 : audit [DBG] from='client.291018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:15 smithi049 bash[23528]: audit 2024-09-21T03:23:15.165570+0000 mgr.a (mgr.14388) 13365 : audit [DBG] from='client.291018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:16.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:16 smithi179 bash[23186]: cluster 2024-09-21T03:23:15.478761+0000 mgr.a (mgr.14388) 13366 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:16 smithi049 bash[23528]: cluster 2024-09-21T03:23:15.478761+0000 mgr.a (mgr.14388) 13366 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:16 smithi044 bash[22676]: cluster 2024-09-21T03:23:15.478761+0000 mgr.a (mgr.14388) 13366 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:18.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:18 smithi179 bash[23186]: cluster 2024-09-21T03:23:17.479534+0000 mgr.a (mgr.14388) 13367 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:18 smithi049 bash[23528]: cluster 2024-09-21T03:23:17.479534+0000 mgr.a (mgr.14388) 13367 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:18 smithi044 bash[22676]: cluster 2024-09-21T03:23:17.479534+0000 mgr.a (mgr.14388) 13367 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:20.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:20.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:20.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:20 smithi179 bash[23186]: cluster 2024-09-21T03:23:19.480238+0000 mgr.a (mgr.14388) 13368 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:20 smithi049 bash[23528]: cluster 2024-09-21T03:23:19.480238+0000 mgr.a (mgr.14388) 13368 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:20 smithi044 bash[22676]: cluster 2024-09-21T03:23:19.480238+0000 mgr.a (mgr.14388) 13368 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:21.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:21.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:21.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:21.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:21 smithi049 bash[23528]: audit 2024-09-21T03:23:20.914263+0000 mgr.a (mgr.14388) 13369 : audit [DBG] from='client.291096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:21 smithi044 bash[22676]: audit 2024-09-21T03:23:20.914263+0000 mgr.a (mgr.14388) 13369 : audit [DBG] from='client.291096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:22.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:21 smithi179 bash[23186]: audit 2024-09-21T03:23:20.914263+0000 mgr.a (mgr.14388) 13369 : audit [DBG] from='client.291096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:22 smithi049 bash[23528]: cluster 2024-09-21T03:23:21.482888+0000 mgr.a (mgr.14388) 13370 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:22 smithi044 bash[22676]: cluster 2024-09-21T03:23:21.482888+0000 mgr.a (mgr.14388) 13370 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:22 smithi179 bash[23186]: cluster 2024-09-21T03:23:21.482888+0000 mgr.a (mgr.14388) 13370 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:24 smithi179 bash[23186]: cluster 2024-09-21T03:23:23.483650+0000 mgr.a (mgr.14388) 13371 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:24 smithi179 bash[23186]: audit 2024-09-21T03:23:23.747926+0000 mon.a (mon.0) 10826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:24 smithi179 bash[23186]: audit 2024-09-21T03:23:23.757392+0000 mon.a (mon.0) 10827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:24 smithi179 bash[23186]: audit 2024-09-21T03:23:23.769137+0000 mon.a (mon.0) 10828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:24 smithi179 bash[23186]: audit 2024-09-21T03:23:24.015726+0000 mon.a (mon.0) 10829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:24 smithi179 bash[23186]: audit 2024-09-21T03:23:24.025460+0000 mon.a (mon.0) 10830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:24 smithi179 bash[23186]: audit 2024-09-21T03:23:24.036789+0000 mon.a (mon.0) 10831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:24 smithi049 bash[23528]: cluster 2024-09-21T03:23:23.483650+0000 mgr.a (mgr.14388) 13371 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:24 smithi049 bash[23528]: audit 2024-09-21T03:23:23.747926+0000 mon.a (mon.0) 10826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:24 smithi049 bash[23528]: audit 2024-09-21T03:23:23.757392+0000 mon.a (mon.0) 10827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:24 smithi049 bash[23528]: audit 2024-09-21T03:23:23.769137+0000 mon.a (mon.0) 10828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:24 smithi049 bash[23528]: audit 2024-09-21T03:23:24.015726+0000 mon.a (mon.0) 10829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:24 smithi049 bash[23528]: audit 2024-09-21T03:23:24.025460+0000 mon.a (mon.0) 10830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:24 smithi049 bash[23528]: audit 2024-09-21T03:23:24.036789+0000 mon.a (mon.0) 10831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:24 smithi044 bash[22676]: cluster 2024-09-21T03:23:23.483650+0000 mgr.a (mgr.14388) 13371 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:23:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:24 smithi044 bash[22676]: audit 2024-09-21T03:23:23.747926+0000 mon.a (mon.0) 10826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:24 smithi044 bash[22676]: audit 2024-09-21T03:23:23.757392+0000 mon.a (mon.0) 10827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:24 smithi044 bash[22676]: audit 2024-09-21T03:23:23.769137+0000 mon.a (mon.0) 10828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:24 smithi044 bash[22676]: audit 2024-09-21T03:23:24.015726+0000 mon.a (mon.0) 10829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:24 smithi044 bash[22676]: audit 2024-09-21T03:23:24.025460+0000 mon.a (mon.0) 10830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:24 smithi044 bash[22676]: audit 2024-09-21T03:23:24.036789+0000 mon.a (mon.0) 10831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:26.353 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:26 smithi179 bash[23186]: cluster 2024-09-21T03:23:25.485601+0000 mgr.a (mgr.14388) 13372 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:26 smithi049 bash[23528]: cluster 2024-09-21T03:23:25.485601+0000 mgr.a (mgr.14388) 13372 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:27.154 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:27.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:26 smithi044 bash[22676]: cluster 2024-09-21T03:23:25.485601+0000 mgr.a (mgr.14388) 13372 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:27 smithi049 bash[23528]: audit 2024-09-21T03:23:26.691712+0000 mgr.a (mgr.14388) 13373 : audit [DBG] from='client.291174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:28.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:27 smithi044 bash[22676]: audit 2024-09-21T03:23:26.691712+0000 mgr.a (mgr.14388) 13373 : audit [DBG] from='client.291174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:28.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:27 smithi179 bash[23186]: audit 2024-09-21T03:23:26.691712+0000 mgr.a (mgr.14388) 13373 : audit [DBG] from='client.291174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:28.863 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:28 smithi049 bash[23528]: cluster 2024-09-21T03:23:27.486502+0000 mgr.a (mgr.14388) 13374 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:28 smithi044 bash[22676]: cluster 2024-09-21T03:23:27.486502+0000 mgr.a (mgr.14388) 13374 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:29.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:28 smithi179 bash[23186]: cluster 2024-09-21T03:23:27.486502+0000 mgr.a (mgr.14388) 13374 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:31.027 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:30 smithi049 bash[23528]: cluster 2024-09-21T03:23:29.487308+0000 mgr.a (mgr.14388) 13375 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:30 smithi044 bash[22676]: cluster 2024-09-21T03:23:29.487308+0000 mgr.a (mgr.14388) 13375 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:31.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:30 smithi179 bash[23186]: cluster 2024-09-21T03:23:29.487308+0000 mgr.a (mgr.14388) 13375 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:32 smithi044 bash[22676]: cluster 2024-09-21T03:23:31.489569+0000 mgr.a (mgr.14388) 13376 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:32 smithi044 bash[22676]: audit 2024-09-21T03:23:31.705069+0000 mon.a (mon.0) 10832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:32 smithi044 bash[22676]: audit 2024-09-21T03:23:31.727193+0000 mon.a (mon.0) 10833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:32 smithi044 bash[22676]: audit 2024-09-21T03:23:31.739129+0000 mon.a (mon.0) 10834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:32 smithi179 bash[23186]: cluster 2024-09-21T03:23:31.489569+0000 mgr.a (mgr.14388) 13376 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:32 smithi179 bash[23186]: audit 2024-09-21T03:23:31.705069+0000 mon.a (mon.0) 10832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:32 smithi179 bash[23186]: audit 2024-09-21T03:23:31.727193+0000 mon.a (mon.0) 10833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:32 smithi179 bash[23186]: audit 2024-09-21T03:23:31.739129+0000 mon.a (mon.0) 10834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:32 smithi049 bash[23528]: cluster 2024-09-21T03:23:31.489569+0000 mgr.a (mgr.14388) 13376 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:32 smithi049 bash[23528]: audit 2024-09-21T03:23:31.705069+0000 mon.a (mon.0) 10832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:32 smithi049 bash[23528]: audit 2024-09-21T03:23:31.727193+0000 mon.a (mon.0) 10833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:32 smithi049 bash[23528]: audit 2024-09-21T03:23:31.739129+0000 mon.a (mon.0) 10834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:33.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:33 smithi044 bash[22676]: audit 2024-09-21T03:23:32.488776+0000 mgr.a (mgr.14388) 13377 : audit [DBG] from='client.291249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:34.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:33 smithi179 bash[23186]: audit 2024-09-21T03:23:32.488776+0000 mgr.a (mgr.14388) 13377 : audit [DBG] from='client.291249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:33 smithi049 bash[23528]: audit 2024-09-21T03:23:32.488776+0000 mgr.a (mgr.14388) 13377 : audit [DBG] from='client.291249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:34.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:34 smithi179 bash[23186]: cluster 2024-09-21T03:23:33.490680+0000 mgr.a (mgr.14388) 13378 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:34 smithi044 bash[22676]: cluster 2024-09-21T03:23:33.490680+0000 mgr.a (mgr.14388) 13378 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:34 smithi049 bash[23528]: cluster 2024-09-21T03:23:33.490680+0000 mgr.a (mgr.14388) 13378 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:36 smithi179 bash[23186]: cluster 2024-09-21T03:23:35.492951+0000 mgr.a (mgr.14388) 13379 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:36.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:36 smithi044 bash[22676]: cluster 2024-09-21T03:23:35.492951+0000 mgr.a (mgr.14388) 13379 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:36 smithi049 bash[23528]: cluster 2024-09-21T03:23:35.492951+0000 mgr.a (mgr.14388) 13379 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:37.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:37.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:37.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:38.695 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:38 smithi044 bash[22676]: cluster 2024-09-21T03:23:37.493934+0000 mgr.a (mgr.14388) 13380 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:39.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:38 smithi179 bash[23186]: cluster 2024-09-21T03:23:37.493934+0000 mgr.a (mgr.14388) 13380 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:38 smithi049 bash[23528]: cluster 2024-09-21T03:23:37.493934+0000 mgr.a (mgr.14388) 13380 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:39 smithi044 bash[22676]: audit 2024-09-21T03:23:38.254250+0000 mgr.a (mgr.14388) 13381 : audit [DBG] from='client.291327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:40.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:39 smithi179 bash[23186]: audit 2024-09-21T03:23:38.254250+0000 mgr.a (mgr.14388) 13381 : audit [DBG] from='client.291327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:39 smithi049 bash[23528]: audit 2024-09-21T03:23:38.254250+0000 mgr.a (mgr.14388) 13381 : audit [DBG] from='client.291327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:40 smithi044 bash[22676]: cluster 2024-09-21T03:23:39.494906+0000 mgr.a (mgr.14388) 13382 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:40 smithi179 bash[23186]: cluster 2024-09-21T03:23:39.494906+0000 mgr.a (mgr.14388) 13382 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:40 smithi049 bash[23528]: cluster 2024-09-21T03:23:39.494906+0000 mgr.a (mgr.14388) 13382 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:42 smithi179 bash[23186]: cluster 2024-09-21T03:23:41.497164+0000 mgr.a (mgr.14388) 13383 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:42 smithi049 bash[23528]: cluster 2024-09-21T03:23:41.497164+0000 mgr.a (mgr.14388) 13383 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:42 smithi044 bash[22676]: cluster 2024-09-21T03:23:41.497164+0000 mgr.a (mgr.14388) 13383 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:43.697 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:43.698 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:44.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:44.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:44.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: cluster 2024-09-21T03:23:43.498033+0000 mgr.a (mgr.14388) 13384 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: audit 2024-09-21T03:23:43.916640+0000 mon.a (mon.0) 10835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: audit 2024-09-21T03:23:43.921925+0000 mon.a (mon.0) 10836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: audit 2024-09-21T03:23:43.931424+0000 mon.a (mon.0) 10837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: audit 2024-09-21T03:23:44.030083+0000 mgr.a (mgr.14388) 13385 : audit [DBG] from='client.291405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: audit 2024-09-21T03:23:44.194931+0000 mon.a (mon.0) 10838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: audit 2024-09-21T03:23:44.201658+0000 mon.a (mon.0) 10839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:44 smithi044 bash[22676]: audit 2024-09-21T03:23:44.208530+0000 mon.a (mon.0) 10840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: cluster 2024-09-21T03:23:43.498033+0000 mgr.a (mgr.14388) 13384 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: audit 2024-09-21T03:23:43.916640+0000 mon.a (mon.0) 10835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: audit 2024-09-21T03:23:43.921925+0000 mon.a (mon.0) 10836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: audit 2024-09-21T03:23:43.931424+0000 mon.a (mon.0) 10837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: audit 2024-09-21T03:23:44.030083+0000 mgr.a (mgr.14388) 13385 : audit [DBG] from='client.291405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: audit 2024-09-21T03:23:44.194931+0000 mon.a (mon.0) 10838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: audit 2024-09-21T03:23:44.201658+0000 mon.a (mon.0) 10839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:44 smithi179 bash[23186]: audit 2024-09-21T03:23:44.208530+0000 mon.a (mon.0) 10840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: cluster 2024-09-21T03:23:43.498033+0000 mgr.a (mgr.14388) 13384 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: audit 2024-09-21T03:23:43.916640+0000 mon.a (mon.0) 10835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: audit 2024-09-21T03:23:43.921925+0000 mon.a (mon.0) 10836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: audit 2024-09-21T03:23:43.931424+0000 mon.a (mon.0) 10837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: audit 2024-09-21T03:23:44.030083+0000 mgr.a (mgr.14388) 13385 : audit [DBG] from='client.291405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: audit 2024-09-21T03:23:44.194931+0000 mon.a (mon.0) 10838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: audit 2024-09-21T03:23:44.201658+0000 mon.a (mon.0) 10839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:44 smithi049 bash[23528]: audit 2024-09-21T03:23:44.208530+0000 mon.a (mon.0) 10840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:46 smithi044 bash[22676]: cluster 2024-09-21T03:23:45.500392+0000 mgr.a (mgr.14388) 13386 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:46 smithi179 bash[23186]: cluster 2024-09-21T03:23:45.500392+0000 mgr.a (mgr.14388) 13386 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:46 smithi049 bash[23528]: cluster 2024-09-21T03:23:45.500392+0000 mgr.a (mgr.14388) 13386 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:23:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:48 smithi049 bash[23528]: cluster 2024-09-21T03:23:47.501197+0000 mgr.a (mgr.14388) 13387 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:48 smithi044 bash[22676]: cluster 2024-09-21T03:23:47.501197+0000 mgr.a (mgr.14388) 13387 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:48 smithi179 bash[23186]: cluster 2024-09-21T03:23:47.501197+0000 mgr.a (mgr.14388) 13387 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:50.222 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:50 smithi044 bash[22676]: cluster 2024-09-21T03:23:49.501813+0000 mgr.a (mgr.14388) 13388 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:50 smithi044 bash[22676]: audit 2024-09-21T03:23:49.796124+0000 mgr.a (mgr.14388) 13389 : audit [DBG] from='client.291483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:50 smithi179 bash[23186]: cluster 2024-09-21T03:23:49.501813+0000 mgr.a (mgr.14388) 13388 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:50 smithi179 bash[23186]: audit 2024-09-21T03:23:49.796124+0000 mgr.a (mgr.14388) 13389 : audit [DBG] from='client.291483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:50 smithi049 bash[23528]: cluster 2024-09-21T03:23:49.501813+0000 mgr.a (mgr.14388) 13388 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:23:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:50 smithi049 bash[23528]: audit 2024-09-21T03:23:49.796124+0000 mgr.a (mgr.14388) 13389 : audit [DBG] from='client.291483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:53.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:23:53 smithi044 bash[22930]: debug 2024-09-21T03:23:53.005+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:23:53.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:23:53 smithi044 bash[22930]: debug 2024-09-21T03:23:53.009+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: cluster 2024-09-21T03:23:51.504744+0000 mgr.a (mgr.14388) 13390 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:51.932448+0000 mon.a (mon.0) 10841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:51.945798+0000 mon.a (mon.0) 10842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:51.956359+0000 mon.a (mon.0) 10843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:52.191213+0000 mon.a (mon.0) 10844 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:52.197372+0000 mon.a (mon.0) 10845 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:52.199091+0000 mon.a (mon.0) 10846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:52.209974+0000 mon.a (mon.0) 10847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:52 smithi044 bash[22676]: audit 2024-09-21T03:23:52.216197+0000 mon.a (mon.0) 10848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:23:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: cluster 2024-09-21T03:23:51.504744+0000 mgr.a (mgr.14388) 13390 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:51.932448+0000 mon.a (mon.0) 10841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:51.945798+0000 mon.a (mon.0) 10842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:51.956359+0000 mon.a (mon.0) 10843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:52.191213+0000 mon.a (mon.0) 10844 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:52.197372+0000 mon.a (mon.0) 10845 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:52.199091+0000 mon.a (mon.0) 10846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:52.209974+0000 mon.a (mon.0) 10847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:52 smithi179 bash[23186]: audit 2024-09-21T03:23:52.216197+0000 mon.a (mon.0) 10848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:23:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: cluster 2024-09-21T03:23:51.504744+0000 mgr.a (mgr.14388) 13390 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:51.932448+0000 mon.a (mon.0) 10841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:51.945798+0000 mon.a (mon.0) 10842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:51.956359+0000 mon.a (mon.0) 10843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:52.191213+0000 mon.a (mon.0) 10844 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:52.197372+0000 mon.a (mon.0) 10845 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:52.199091+0000 mon.a (mon.0) 10846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:52.209974+0000 mon.a (mon.0) 10847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:23:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:52 smithi049 bash[23528]: audit 2024-09-21T03:23:52.216197+0000 mon.a (mon.0) 10848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:23:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:53 smithi044 bash[22676]: audit 2024-09-21T03:23:52.218794+0000 mgr.a (mgr.14388) 13391 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:23:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:53 smithi044 bash[22676]: audit 2024-09-21T03:23:53.013072+0000 mgr.a (mgr.14388) 13392 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:23:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:53 smithi044 bash[22676]: cephadm 2024-09-21T03:23:53.014348+0000 mgr.a (mgr.14388) 13393 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:23:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:53 smithi179 bash[23186]: audit 2024-09-21T03:23:52.218794+0000 mgr.a (mgr.14388) 13391 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:23:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:53 smithi179 bash[23186]: audit 2024-09-21T03:23:53.013072+0000 mgr.a (mgr.14388) 13392 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:23:54.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:53 smithi179 bash[23186]: cephadm 2024-09-21T03:23:53.014348+0000 mgr.a (mgr.14388) 13393 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:23:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:53 smithi049 bash[23528]: audit 2024-09-21T03:23:52.218794+0000 mgr.a (mgr.14388) 13391 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:23:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:53 smithi049 bash[23528]: audit 2024-09-21T03:23:53.013072+0000 mgr.a (mgr.14388) 13392 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:23:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:53 smithi049 bash[23528]: cephadm 2024-09-21T03:23:53.014348+0000 mgr.a (mgr.14388) 13393 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:23:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:54 smithi044 bash[22676]: cluster 2024-09-21T03:23:53.505803+0000 mgr.a (mgr.14388) 13394 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:23:55.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:23:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:23:55.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:23:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:54 smithi179 bash[23186]: cluster 2024-09-21T03:23:53.505803+0000 mgr.a (mgr.14388) 13394 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:23:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:54 smithi049 bash[23528]: cluster 2024-09-21T03:23:53.505803+0000 mgr.a (mgr.14388) 13394 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:23:56.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:23:56.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:23:56.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:23:56.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:23:56.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:23:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:56 smithi044 bash[22676]: cluster 2024-09-21T03:23:55.507935+0000 mgr.a (mgr.14388) 13395 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:56 smithi044 bash[22676]: audit 2024-09-21T03:23:55.563650+0000 mgr.a (mgr.14388) 13396 : audit [DBG] from='client.291669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:56 smithi179 bash[23186]: cluster 2024-09-21T03:23:55.507935+0000 mgr.a (mgr.14388) 13395 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:56 smithi179 bash[23186]: audit 2024-09-21T03:23:55.563650+0000 mgr.a (mgr.14388) 13396 : audit [DBG] from='client.291669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:56 smithi049 bash[23528]: cluster 2024-09-21T03:23:55.507935+0000 mgr.a (mgr.14388) 13395 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:23:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:56 smithi049 bash[23528]: audit 2024-09-21T03:23:55.563650+0000 mgr.a (mgr.14388) 13396 : audit [DBG] from='client.291669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:23:58 smithi044 bash[22676]: cluster 2024-09-21T03:23:57.508957+0000 mgr.a (mgr.14388) 13397 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:23:59.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:23:58 smithi179 bash[23186]: cluster 2024-09-21T03:23:57.508957+0000 mgr.a (mgr.14388) 13397 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:23:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:23:58 smithi049 bash[23528]: cluster 2024-09-21T03:23:57.508957+0000 mgr.a (mgr.14388) 13397 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:24:01.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:01.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:01.014 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:00 smithi044 bash[22676]: cluster 2024-09-21T03:23:59.509804+0000 mgr.a (mgr.14388) 13398 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:24:01.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:00 smithi179 bash[23186]: cluster 2024-09-21T03:23:59.509804+0000 mgr.a (mgr.14388) 13398 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:24:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:00 smithi049 bash[23528]: cluster 2024-09-21T03:23:59.509804+0000 mgr.a (mgr.14388) 13398 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:24:01.776 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:02 smithi044 bash[22676]: audit 2024-09-21T03:24:01.343168+0000 mgr.a (mgr.14388) 13399 : audit [DBG] from='client.291747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:02 smithi044 bash[22676]: cluster 2024-09-21T03:24:01.511177+0000 mgr.a (mgr.14388) 13400 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:02 smithi179 bash[23186]: audit 2024-09-21T03:24:01.343168+0000 mgr.a (mgr.14388) 13399 : audit [DBG] from='client.291747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:02 smithi179 bash[23186]: cluster 2024-09-21T03:24:01.511177+0000 mgr.a (mgr.14388) 13400 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:02 smithi049 bash[23528]: audit 2024-09-21T03:24:01.343168+0000 mgr.a (mgr.14388) 13399 : audit [DBG] from='client.291747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:02 smithi049 bash[23528]: cluster 2024-09-21T03:24:01.511177+0000 mgr.a (mgr.14388) 13400 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:05 smithi044 bash[22676]: cluster 2024-09-21T03:24:03.512208+0000 mgr.a (mgr.14388) 13401 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:24:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:05 smithi044 bash[22676]: audit 2024-09-21T03:24:04.152952+0000 mon.a (mon.0) 10849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:05 smithi044 bash[22676]: audit 2024-09-21T03:24:04.160752+0000 mon.a (mon.0) 10850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:05 smithi044 bash[22676]: audit 2024-09-21T03:24:04.171136+0000 mon.a (mon.0) 10851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:05 smithi044 bash[22676]: audit 2024-09-21T03:24:04.417729+0000 mon.a (mon.0) 10852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:05 smithi044 bash[22676]: audit 2024-09-21T03:24:04.427612+0000 mon.a (mon.0) 10853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:05 smithi044 bash[22676]: audit 2024-09-21T03:24:04.439231+0000 mon.a (mon.0) 10854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:05 smithi179 bash[23186]: cluster 2024-09-21T03:24:03.512208+0000 mgr.a (mgr.14388) 13401 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:24:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:05 smithi179 bash[23186]: audit 2024-09-21T03:24:04.152952+0000 mon.a (mon.0) 10849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:05 smithi179 bash[23186]: audit 2024-09-21T03:24:04.160752+0000 mon.a (mon.0) 10850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:05 smithi179 bash[23186]: audit 2024-09-21T03:24:04.171136+0000 mon.a (mon.0) 10851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:05 smithi179 bash[23186]: audit 2024-09-21T03:24:04.417729+0000 mon.a (mon.0) 10852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:05 smithi179 bash[23186]: audit 2024-09-21T03:24:04.427612+0000 mon.a (mon.0) 10853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:05 smithi179 bash[23186]: audit 2024-09-21T03:24:04.439231+0000 mon.a (mon.0) 10854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:05 smithi049 bash[23528]: cluster 2024-09-21T03:24:03.512208+0000 mgr.a (mgr.14388) 13401 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:24:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:05 smithi049 bash[23528]: audit 2024-09-21T03:24:04.152952+0000 mon.a (mon.0) 10849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:05 smithi049 bash[23528]: audit 2024-09-21T03:24:04.160752+0000 mon.a (mon.0) 10850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:05 smithi049 bash[23528]: audit 2024-09-21T03:24:04.171136+0000 mon.a (mon.0) 10851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:05 smithi049 bash[23528]: audit 2024-09-21T03:24:04.417729+0000 mon.a (mon.0) 10852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:05 smithi049 bash[23528]: audit 2024-09-21T03:24:04.427612+0000 mon.a (mon.0) 10853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:05 smithi049 bash[23528]: audit 2024-09-21T03:24:04.439231+0000 mon.a (mon.0) 10854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:07 smithi044 bash[22676]: cluster 2024-09-21T03:24:05.514490+0000 mgr.a (mgr.14388) 13402 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:07 smithi179 bash[23186]: cluster 2024-09-21T03:24:05.514490+0000 mgr.a (mgr.14388) 13402 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:07 smithi049 bash[23528]: cluster 2024-09-21T03:24:05.514490+0000 mgr.a (mgr.14388) 13402 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:07.566 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:08 smithi044 bash[22676]: audit 2024-09-21T03:24:07.121213+0000 mgr.a (mgr.14388) 13403 : audit [DBG] from='client.291825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:08.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:08 smithi179 bash[23186]: audit 2024-09-21T03:24:07.121213+0000 mgr.a (mgr.14388) 13403 : audit [DBG] from='client.291825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:08 smithi049 bash[23528]: audit 2024-09-21T03:24:07.121213+0000 mgr.a (mgr.14388) 13403 : audit [DBG] from='client.291825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:09 smithi044 bash[22676]: cluster 2024-09-21T03:24:07.515059+0000 mgr.a (mgr.14388) 13404 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:09.497 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:09 smithi049 bash[23528]: cluster 2024-09-21T03:24:07.515059+0000 mgr.a (mgr.14388) 13404 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:09 smithi179 bash[23186]: cluster 2024-09-21T03:24:07.515059+0000 mgr.a (mgr.14388) 13404 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:11 smithi044 bash[22676]: cluster 2024-09-21T03:24:09.515827+0000 mgr.a (mgr.14388) 13405 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:11 smithi179 bash[23186]: cluster 2024-09-21T03:24:09.515827+0000 mgr.a (mgr.14388) 13405 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:11 smithi049 bash[23528]: cluster 2024-09-21T03:24:09.515827+0000 mgr.a (mgr.14388) 13405 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:12.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:12.569 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:12.569 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:13.341 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:13.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:13 smithi044 bash[22676]: cluster 2024-09-21T03:24:11.518110+0000 mgr.a (mgr.14388) 13406 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:13 smithi044 bash[22676]: audit 2024-09-21T03:24:12.172194+0000 mon.a (mon.0) 10855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:13 smithi044 bash[22676]: audit 2024-09-21T03:24:12.184859+0000 mon.a (mon.0) 10856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:13 smithi044 bash[22676]: audit 2024-09-21T03:24:12.195643+0000 mon.a (mon.0) 10857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:13 smithi179 bash[23186]: cluster 2024-09-21T03:24:11.518110+0000 mgr.a (mgr.14388) 13406 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:13 smithi179 bash[23186]: audit 2024-09-21T03:24:12.172194+0000 mon.a (mon.0) 10855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:13 smithi179 bash[23186]: audit 2024-09-21T03:24:12.184859+0000 mon.a (mon.0) 10856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:13 smithi179 bash[23186]: audit 2024-09-21T03:24:12.195643+0000 mon.a (mon.0) 10857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:13 smithi049 bash[23528]: cluster 2024-09-21T03:24:11.518110+0000 mgr.a (mgr.14388) 13406 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:13 smithi049 bash[23528]: audit 2024-09-21T03:24:12.172194+0000 mon.a (mon.0) 10855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:13 smithi049 bash[23528]: audit 2024-09-21T03:24:12.184859+0000 mon.a (mon.0) 10856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:13 smithi049 bash[23528]: audit 2024-09-21T03:24:12.195643+0000 mon.a (mon.0) 10857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:14 smithi044 bash[22676]: audit 2024-09-21T03:24:12.905296+0000 mgr.a (mgr.14388) 13407 : audit [DBG] from='client.291900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:14.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:14 smithi179 bash[23186]: audit 2024-09-21T03:24:12.905296+0000 mgr.a (mgr.14388) 13407 : audit [DBG] from='client.291900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:14 smithi049 bash[23528]: audit 2024-09-21T03:24:12.905296+0000 mgr.a (mgr.14388) 13407 : audit [DBG] from='client.291900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:15 smithi179 bash[23186]: cluster 2024-09-21T03:24:13.519043+0000 mgr.a (mgr.14388) 13408 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:15.318 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:15 smithi044 bash[22676]: cluster 2024-09-21T03:24:13.519043+0000 mgr.a (mgr.14388) 13408 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:15 smithi049 bash[23528]: cluster 2024-09-21T03:24:13.519043+0000 mgr.a (mgr.14388) 13408 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:17.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:17 smithi044 bash[22676]: cluster 2024-09-21T03:24:15.521374+0000 mgr.a (mgr.14388) 13409 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:17.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:17 smithi179 bash[23186]: cluster 2024-09-21T03:24:15.521374+0000 mgr.a (mgr.14388) 13409 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:17 smithi049 bash[23528]: cluster 2024-09-21T03:24:15.521374+0000 mgr.a (mgr.14388) 13409 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:18.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:18.343 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:18.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:19.113 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:19.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:19.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:19.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:19.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:19 smithi044 bash[22676]: cluster 2024-09-21T03:24:17.522121+0000 mgr.a (mgr.14388) 13410 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:19.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:19 smithi179 bash[23186]: cluster 2024-09-21T03:24:17.522121+0000 mgr.a (mgr.14388) 13410 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:19 smithi049 bash[23528]: cluster 2024-09-21T03:24:17.522121+0000 mgr.a (mgr.14388) 13410 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:20 smithi044 bash[22676]: audit 2024-09-21T03:24:18.674356+0000 mgr.a (mgr.14388) 13411 : audit [DBG] from='client.291978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:20 smithi044 bash[22676]: cluster 2024-09-21T03:24:19.523262+0000 mgr.a (mgr.14388) 13412 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:20 smithi179 bash[23186]: audit 2024-09-21T03:24:18.674356+0000 mgr.a (mgr.14388) 13411 : audit [DBG] from='client.291978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:20.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:20 smithi179 bash[23186]: cluster 2024-09-21T03:24:19.523262+0000 mgr.a (mgr.14388) 13412 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:20 smithi049 bash[23528]: audit 2024-09-21T03:24:18.674356+0000 mgr.a (mgr.14388) 13411 : audit [DBG] from='client.291978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:20 smithi049 bash[23528]: cluster 2024-09-21T03:24:19.523262+0000 mgr.a (mgr.14388) 13412 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:22 smithi044 bash[22676]: cluster 2024-09-21T03:24:21.525580+0000 mgr.a (mgr.14388) 13413 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:22 smithi179 bash[23186]: cluster 2024-09-21T03:24:21.525580+0000 mgr.a (mgr.14388) 13413 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:22 smithi049 bash[23528]: cluster 2024-09-21T03:24:21.525580+0000 mgr.a (mgr.14388) 13413 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:24.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:24 smithi044 bash[22676]: cluster 2024-09-21T03:24:23.526345+0000 mgr.a (mgr.14388) 13414 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:24 smithi044 bash[22676]: audit 2024-09-21T03:24:24.346874+0000 mon.a (mon.0) 10858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:24 smithi044 bash[22676]: audit 2024-09-21T03:24:24.352247+0000 mon.a (mon.0) 10859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:24 smithi044 bash[22676]: audit 2024-09-21T03:24:24.358514+0000 mon.a (mon.0) 10860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:24.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:24.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:24.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:24.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:24.928 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:24 smithi179 bash[23186]: cluster 2024-09-21T03:24:23.526345+0000 mgr.a (mgr.14388) 13414 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:24 smithi179 bash[23186]: audit 2024-09-21T03:24:24.346874+0000 mon.a (mon.0) 10858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:24 smithi179 bash[23186]: audit 2024-09-21T03:24:24.352247+0000 mon.a (mon.0) 10859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:24 smithi179 bash[23186]: audit 2024-09-21T03:24:24.358514+0000 mon.a (mon.0) 10860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:24 smithi049 bash[23528]: cluster 2024-09-21T03:24:23.526345+0000 mgr.a (mgr.14388) 13414 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:24 smithi049 bash[23528]: audit 2024-09-21T03:24:24.346874+0000 mon.a (mon.0) 10858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:24 smithi049 bash[23528]: audit 2024-09-21T03:24:24.352247+0000 mon.a (mon.0) 10859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:24 smithi049 bash[23528]: audit 2024-09-21T03:24:24.358514+0000 mon.a (mon.0) 10860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:25 smithi044 bash[22676]: audit 2024-09-21T03:24:24.480282+0000 mgr.a (mgr.14388) 13415 : audit [DBG] from='client.292053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:25 smithi044 bash[22676]: audit 2024-09-21T03:24:24.632849+0000 mon.a (mon.0) 10861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:25 smithi044 bash[22676]: audit 2024-09-21T03:24:24.638193+0000 mon.a (mon.0) 10862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:25 smithi044 bash[22676]: audit 2024-09-21T03:24:24.643698+0000 mon.a (mon.0) 10863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:25 smithi179 bash[23186]: audit 2024-09-21T03:24:24.480282+0000 mgr.a (mgr.14388) 13415 : audit [DBG] from='client.292053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:25 smithi179 bash[23186]: audit 2024-09-21T03:24:24.632849+0000 mon.a (mon.0) 10861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:25 smithi179 bash[23186]: audit 2024-09-21T03:24:24.638193+0000 mon.a (mon.0) 10862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:26.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:25 smithi179 bash[23186]: audit 2024-09-21T03:24:24.643698+0000 mon.a (mon.0) 10863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:25 smithi049 bash[23528]: audit 2024-09-21T03:24:24.480282+0000 mgr.a (mgr.14388) 13415 : audit [DBG] from='client.292053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:25 smithi049 bash[23528]: audit 2024-09-21T03:24:24.632849+0000 mon.a (mon.0) 10861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:25 smithi049 bash[23528]: audit 2024-09-21T03:24:24.638193+0000 mon.a (mon.0) 10862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:25 smithi049 bash[23528]: audit 2024-09-21T03:24:24.643698+0000 mon.a (mon.0) 10863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:26 smithi044 bash[22676]: cluster 2024-09-21T03:24:25.528862+0000 mgr.a (mgr.14388) 13416 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:27.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:26 smithi179 bash[23186]: cluster 2024-09-21T03:24:25.528862+0000 mgr.a (mgr.14388) 13416 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:26 smithi049 bash[23528]: cluster 2024-09-21T03:24:25.528862+0000 mgr.a (mgr.14388) 13416 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:28 smithi049 bash[23528]: cluster 2024-09-21T03:24:27.529714+0000 mgr.a (mgr.14388) 13417 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:28 smithi044 bash[22676]: cluster 2024-09-21T03:24:27.529714+0000 mgr.a (mgr.14388) 13417 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:28 smithi179 bash[23186]: cluster 2024-09-21T03:24:27.529714+0000 mgr.a (mgr.14388) 13417 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:30.705 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:30 smithi044 bash[22676]: cluster 2024-09-21T03:24:29.530498+0000 mgr.a (mgr.14388) 13418 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:30.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:30 smithi179 bash[23186]: cluster 2024-09-21T03:24:29.530498+0000 mgr.a (mgr.14388) 13418 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:30 smithi049 bash[23528]: cluster 2024-09-21T03:24:29.530498+0000 mgr.a (mgr.14388) 13418 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:31.600 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:31 smithi049 bash[23528]: audit 2024-09-21T03:24:30.265624+0000 mgr.a (mgr.14388) 13419 : audit [DBG] from='client.292128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:31 smithi044 bash[22676]: audit 2024-09-21T03:24:30.265624+0000 mgr.a (mgr.14388) 13419 : audit [DBG] from='client.292128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:31.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:31 smithi179 bash[23186]: audit 2024-09-21T03:24:30.265624+0000 mgr.a (mgr.14388) 13419 : audit [DBG] from='client.292128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:32.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:32 smithi179 bash[23186]: cluster 2024-09-21T03:24:31.533436+0000 mgr.a (mgr.14388) 13420 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:32 smithi179 bash[23186]: audit 2024-09-21T03:24:32.330613+0000 mon.a (mon.0) 10864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:32 smithi179 bash[23186]: audit 2024-09-21T03:24:32.340612+0000 mon.a (mon.0) 10865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:32 smithi179 bash[23186]: audit 2024-09-21T03:24:32.351146+0000 mon.a (mon.0) 10866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:32 smithi049 bash[23528]: cluster 2024-09-21T03:24:31.533436+0000 mgr.a (mgr.14388) 13420 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:32 smithi049 bash[23528]: audit 2024-09-21T03:24:32.330613+0000 mon.a (mon.0) 10864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:32 smithi049 bash[23528]: audit 2024-09-21T03:24:32.340612+0000 mon.a (mon.0) 10865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:32 smithi049 bash[23528]: audit 2024-09-21T03:24:32.351146+0000 mon.a (mon.0) 10866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:32 smithi044 bash[22676]: cluster 2024-09-21T03:24:31.533436+0000 mgr.a (mgr.14388) 13420 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:32 smithi044 bash[22676]: audit 2024-09-21T03:24:32.330613+0000 mon.a (mon.0) 10864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:32 smithi044 bash[22676]: audit 2024-09-21T03:24:32.340612+0000 mon.a (mon.0) 10865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:32 smithi044 bash[22676]: audit 2024-09-21T03:24:32.351146+0000 mon.a (mon.0) 10866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:34 smithi044 bash[22676]: cluster 2024-09-21T03:24:33.534206+0000 mgr.a (mgr.14388) 13421 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:24:35.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:34 smithi179 bash[23186]: cluster 2024-09-21T03:24:33.534206+0000 mgr.a (mgr.14388) 13421 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:24:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:34 smithi049 bash[23528]: cluster 2024-09-21T03:24:33.534206+0000 mgr.a (mgr.14388) 13421 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:24:35.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:35.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:35.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:36.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:36 smithi179 bash[23186]: cluster 2024-09-21T03:24:35.535378+0000 mgr.a (mgr.14388) 13422 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:36.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:36 smithi179 bash[23186]: audit 2024-09-21T03:24:36.047570+0000 mgr.a (mgr.14388) 13423 : audit [DBG] from='client.292206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:36.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:36 smithi044 bash[22676]: cluster 2024-09-21T03:24:35.535378+0000 mgr.a (mgr.14388) 13422 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:36.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:36 smithi044 bash[22676]: audit 2024-09-21T03:24:36.047570+0000 mgr.a (mgr.14388) 13423 : audit [DBG] from='client.292206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:36 smithi049 bash[23528]: cluster 2024-09-21T03:24:35.535378+0000 mgr.a (mgr.14388) 13422 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:36 smithi049 bash[23528]: audit 2024-09-21T03:24:36.047570+0000 mgr.a (mgr.14388) 13423 : audit [DBG] from='client.292206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:38.861 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:38 smithi179 bash[23186]: cluster 2024-09-21T03:24:37.536368+0000 mgr.a (mgr.14388) 13424 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:24:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:38 smithi044 bash[22676]: cluster 2024-09-21T03:24:37.536368+0000 mgr.a (mgr.14388) 13424 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:24:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:38 smithi049 bash[23528]: cluster 2024-09-21T03:24:37.536368+0000 mgr.a (mgr.14388) 13424 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:24:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:40 smithi044 bash[22676]: cluster 2024-09-21T03:24:39.537165+0000 mgr.a (mgr.14388) 13425 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:24:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:40 smithi179 bash[23186]: cluster 2024-09-21T03:24:39.537165+0000 mgr.a (mgr.14388) 13425 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:24:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:40 smithi049 bash[23528]: cluster 2024-09-21T03:24:39.537165+0000 mgr.a (mgr.14388) 13425 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:24:41.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:41.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:41.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:42.231 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:42.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:42.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:42 smithi044 bash[22676]: cluster 2024-09-21T03:24:41.538549+0000 mgr.a (mgr.14388) 13426 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:42 smithi044 bash[22676]: audit 2024-09-21T03:24:41.809726+0000 mgr.a (mgr.14388) 13427 : audit [DBG] from='client.292284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:42 smithi179 bash[23186]: cluster 2024-09-21T03:24:41.538549+0000 mgr.a (mgr.14388) 13426 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:42 smithi179 bash[23186]: audit 2024-09-21T03:24:41.809726+0000 mgr.a (mgr.14388) 13427 : audit [DBG] from='client.292284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:42 smithi049 bash[23528]: cluster 2024-09-21T03:24:41.538549+0000 mgr.a (mgr.14388) 13426 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:42 smithi049 bash[23528]: audit 2024-09-21T03:24:41.809726+0000 mgr.a (mgr.14388) 13427 : audit [DBG] from='client.292284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:44.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:44 smithi179 bash[23186]: cluster 2024-09-21T03:24:43.539450+0000 mgr.a (mgr.14388) 13428 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:44.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:44 smithi179 bash[23186]: audit 2024-09-21T03:24:44.580339+0000 mon.a (mon.0) 10867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:44.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:44 smithi179 bash[23186]: audit 2024-09-21T03:24:44.588820+0000 mon.a (mon.0) 10868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:44.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:44 smithi179 bash[23186]: audit 2024-09-21T03:24:44.599223+0000 mon.a (mon.0) 10869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:44 smithi044 bash[22676]: cluster 2024-09-21T03:24:43.539450+0000 mgr.a (mgr.14388) 13428 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:44 smithi044 bash[22676]: audit 2024-09-21T03:24:44.580339+0000 mon.a (mon.0) 10867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:44 smithi044 bash[22676]: audit 2024-09-21T03:24:44.588820+0000 mon.a (mon.0) 10868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:44 smithi044 bash[22676]: audit 2024-09-21T03:24:44.599223+0000 mon.a (mon.0) 10869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:44 smithi049 bash[23528]: cluster 2024-09-21T03:24:43.539450+0000 mgr.a (mgr.14388) 13428 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:44 smithi049 bash[23528]: audit 2024-09-21T03:24:44.580339+0000 mon.a (mon.0) 10867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:44 smithi049 bash[23528]: audit 2024-09-21T03:24:44.588820+0000 mon.a (mon.0) 10868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:44 smithi049 bash[23528]: audit 2024-09-21T03:24:44.599223+0000 mon.a (mon.0) 10869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:45 smithi044 bash[22676]: audit 2024-09-21T03:24:44.851783+0000 mon.a (mon.0) 10870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:45 smithi044 bash[22676]: audit 2024-09-21T03:24:44.860289+0000 mon.a (mon.0) 10871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:45 smithi044 bash[22676]: audit 2024-09-21T03:24:44.871815+0000 mon.a (mon.0) 10872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:45 smithi179 bash[23186]: audit 2024-09-21T03:24:44.851783+0000 mon.a (mon.0) 10870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:45 smithi179 bash[23186]: audit 2024-09-21T03:24:44.860289+0000 mon.a (mon.0) 10871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:45 smithi179 bash[23186]: audit 2024-09-21T03:24:44.871815+0000 mon.a (mon.0) 10872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:45 smithi049 bash[23528]: audit 2024-09-21T03:24:44.851783+0000 mon.a (mon.0) 10870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:45 smithi049 bash[23528]: audit 2024-09-21T03:24:44.860289+0000 mon.a (mon.0) 10871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:46.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:45 smithi049 bash[23528]: audit 2024-09-21T03:24:44.871815+0000 mon.a (mon.0) 10872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:47.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:47.233 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:47.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:46 smithi044 bash[22676]: cluster 2024-09-21T03:24:45.541638+0000 mgr.a (mgr.14388) 13429 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:47.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:46 smithi179 bash[23186]: cluster 2024-09-21T03:24:45.541638+0000 mgr.a (mgr.14388) 13429 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:46 smithi049 bash[23528]: cluster 2024-09-21T03:24:45.541638+0000 mgr.a (mgr.14388) 13429 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:48.039 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:48.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:48.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:48.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:48.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:48 smithi044 bash[22676]: cluster 2024-09-21T03:24:47.542380+0000 mgr.a (mgr.14388) 13430 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:48 smithi044 bash[22676]: audit 2024-09-21T03:24:47.571713+0000 mgr.a (mgr.14388) 13431 : audit [DBG] from='client.292362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:48 smithi179 bash[23186]: cluster 2024-09-21T03:24:47.542380+0000 mgr.a (mgr.14388) 13430 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:48 smithi179 bash[23186]: audit 2024-09-21T03:24:47.571713+0000 mgr.a (mgr.14388) 13431 : audit [DBG] from='client.292362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:48 smithi049 bash[23528]: cluster 2024-09-21T03:24:47.542380+0000 mgr.a (mgr.14388) 13430 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:48 smithi049 bash[23528]: audit 2024-09-21T03:24:47.571713+0000 mgr.a (mgr.14388) 13431 : audit [DBG] from='client.292362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:50 smithi044 bash[22676]: cluster 2024-09-21T03:24:49.543263+0000 mgr.a (mgr.14388) 13432 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:50 smithi179 bash[23186]: cluster 2024-09-21T03:24:49.543263+0000 mgr.a (mgr.14388) 13432 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:50 smithi049 bash[23528]: cluster 2024-09-21T03:24:49.543263+0000 mgr.a (mgr.14388) 13432 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:52 smithi044 bash[22676]: cluster 2024-09-21T03:24:51.545542+0000 mgr.a (mgr.14388) 13433 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:52 smithi044 bash[22676]: audit 2024-09-21T03:24:52.503360+0000 mon.a (mon.0) 10873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:52 smithi044 bash[22676]: audit 2024-09-21T03:24:52.512472+0000 mon.a (mon.0) 10874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:52 smithi044 bash[22676]: audit 2024-09-21T03:24:52.523396+0000 mon.a (mon.0) 10875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:52 smithi179 bash[23186]: cluster 2024-09-21T03:24:51.545542+0000 mgr.a (mgr.14388) 13433 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:52 smithi179 bash[23186]: audit 2024-09-21T03:24:52.503360+0000 mon.a (mon.0) 10873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:52 smithi179 bash[23186]: audit 2024-09-21T03:24:52.512472+0000 mon.a (mon.0) 10874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:52 smithi179 bash[23186]: audit 2024-09-21T03:24:52.523396+0000 mon.a (mon.0) 10875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:52 smithi049 bash[23528]: cluster 2024-09-21T03:24:51.545542+0000 mgr.a (mgr.14388) 13433 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:24:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:52 smithi049 bash[23528]: audit 2024-09-21T03:24:52.503360+0000 mon.a (mon.0) 10873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:52 smithi049 bash[23528]: audit 2024-09-21T03:24:52.512472+0000 mon.a (mon.0) 10874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:52 smithi049 bash[23528]: audit 2024-09-21T03:24:52.523396+0000 mon.a (mon.0) 10875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:53.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:53.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:24:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.073186+0000 mon.a (mon.0) 10876 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:24:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.657913+0000 mon.a (mon.0) 10877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.663550+0000 mon.a (mon.0) 10878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.668736+0000 mon.a (mon.0) 10879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.674022+0000 mon.a (mon.0) 10880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.675203+0000 mon.a (mon.0) 10881 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:24:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.675979+0000 mon.a (mon.0) 10882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:24:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.682998+0000 mon.a (mon.0) 10883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:53 smithi044 bash[22676]: audit 2024-09-21T03:24:53.685955+0000 mon.a (mon.0) 10884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.073186+0000 mon.a (mon.0) 10876 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.657913+0000 mon.a (mon.0) 10877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.663550+0000 mon.a (mon.0) 10878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.668736+0000 mon.a (mon.0) 10879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.674022+0000 mon.a (mon.0) 10880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.675203+0000 mon.a (mon.0) 10881 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.675979+0000 mon.a (mon.0) 10882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.682998+0000 mon.a (mon.0) 10883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:53 smithi179 bash[23186]: audit 2024-09-21T03:24:53.685955+0000 mon.a (mon.0) 10884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:24:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.073186+0000 mon.a (mon.0) 10876 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.657913+0000 mon.a (mon.0) 10877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.663550+0000 mon.a (mon.0) 10878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.668736+0000 mon.a (mon.0) 10879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.674022+0000 mon.a (mon.0) 10880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.675203+0000 mon.a (mon.0) 10881 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.675979+0000 mon.a (mon.0) 10882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.682998+0000 mon.a (mon.0) 10883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:24:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:53 smithi049 bash[23528]: audit 2024-09-21T03:24:53.685955+0000 mon.a (mon.0) 10884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:24:54.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:24:54 smithi044 bash[22930]: debug 2024-09-21T03:24:54.528+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:24:54.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:24:54 smithi044 bash[22930]: debug 2024-09-21T03:24:54.532+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:24:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:54 smithi044 bash[22676]: audit 2024-09-21T03:24:53.402295+0000 mgr.a (mgr.14388) 13434 : audit [DBG] from='client.292437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:54 smithi044 bash[22676]: cluster 2024-09-21T03:24:53.546077+0000 mgr.a (mgr.14388) 13435 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:54 smithi044 bash[22676]: audit 2024-09-21T03:24:53.687191+0000 mgr.a (mgr.14388) 13436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:24:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:54 smithi179 bash[23186]: audit 2024-09-21T03:24:53.402295+0000 mgr.a (mgr.14388) 13434 : audit [DBG] from='client.292437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:54 smithi179 bash[23186]: cluster 2024-09-21T03:24:53.546077+0000 mgr.a (mgr.14388) 13435 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:55.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:54 smithi179 bash[23186]: audit 2024-09-21T03:24:53.687191+0000 mgr.a (mgr.14388) 13436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:24:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:54 smithi049 bash[23528]: audit 2024-09-21T03:24:53.402295+0000 mgr.a (mgr.14388) 13434 : audit [DBG] from='client.292437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:54 smithi049 bash[23528]: cluster 2024-09-21T03:24:53.546077+0000 mgr.a (mgr.14388) 13435 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:24:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:54 smithi049 bash[23528]: audit 2024-09-21T03:24:53.687191+0000 mgr.a (mgr.14388) 13436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:24:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:55 smithi044 bash[22676]: audit 2024-09-21T03:24:54.532923+0000 mgr.a (mgr.14388) 13437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:24:56.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:55 smithi044 bash[22676]: cephadm 2024-09-21T03:24:54.534081+0000 mgr.a (mgr.14388) 13438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:24:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:55 smithi179 bash[23186]: audit 2024-09-21T03:24:54.532923+0000 mgr.a (mgr.14388) 13437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:24:56.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:55 smithi179 bash[23186]: cephadm 2024-09-21T03:24:54.534081+0000 mgr.a (mgr.14388) 13438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:24:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:55 smithi049 bash[23528]: audit 2024-09-21T03:24:54.532923+0000 mgr.a (mgr.14388) 13437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:24:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:55 smithi049 bash[23528]: cephadm 2024-09-21T03:24:54.534081+0000 mgr.a (mgr.14388) 13438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:24:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:56 smithi044 bash[22676]: cluster 2024-09-21T03:24:55.547250+0000 mgr.a (mgr.14388) 13439 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:57.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:56 smithi179 bash[23186]: cluster 2024-09-21T03:24:55.547250+0000 mgr.a (mgr.14388) 13439 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:56 smithi049 bash[23528]: cluster 2024-09-21T03:24:55.547250+0000 mgr.a (mgr.14388) 13439 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:58.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:24:58.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:24:58.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:24:59.232 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:58 smithi179 bash[23186]: cluster 2024-09-21T03:24:57.547996+0000 mgr.a (mgr.14388) 13440 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:58 smithi044 bash[22676]: cluster 2024-09-21T03:24:57.547996+0000 mgr.a (mgr.14388) 13440 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:58 smithi049 bash[23528]: cluster 2024-09-21T03:24:57.547996+0000 mgr.a (mgr.14388) 13440 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:24:59.580 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:24:59.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:24:59.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:24:59.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:24:59.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:24:59 smithi044 bash[22676]: audit 2024-09-21T03:24:59.165727+0000 mgr.a (mgr.14388) 13441 : audit [DBG] from='client.292617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:00.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:24:59 smithi179 bash[23186]: audit 2024-09-21T03:24:59.165727+0000 mgr.a (mgr.14388) 13441 : audit [DBG] from='client.292617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:24:59 smithi049 bash[23528]: audit 2024-09-21T03:24:59.165727+0000 mgr.a (mgr.14388) 13441 : audit [DBG] from='client.292617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:00 smithi044 bash[22676]: cluster 2024-09-21T03:24:59.548600+0000 mgr.a (mgr.14388) 13442 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:00 smithi179 bash[23186]: cluster 2024-09-21T03:24:59.548600+0000 mgr.a (mgr.14388) 13442 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:00 smithi049 bash[23528]: cluster 2024-09-21T03:24:59.548600+0000 mgr.a (mgr.14388) 13442 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:02 smithi044 bash[22676]: cluster 2024-09-21T03:25:01.550856+0000 mgr.a (mgr.14388) 13443 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:03.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:02 smithi179 bash[23186]: cluster 2024-09-21T03:25:01.550856+0000 mgr.a (mgr.14388) 13443 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:02 smithi049 bash[23528]: cluster 2024-09-21T03:25:01.550856+0000 mgr.a (mgr.14388) 13443 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:04.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:04.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:04.583 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:04 smithi044 bash[22676]: cluster 2024-09-21T03:25:03.551615+0000 mgr.a (mgr.14388) 13444 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:04 smithi044 bash[22676]: audit 2024-09-21T03:25:04.758785+0000 mon.a (mon.0) 10885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:04 smithi044 bash[22676]: audit 2024-09-21T03:25:04.765399+0000 mon.a (mon.0) 10886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:04 smithi044 bash[22676]: audit 2024-09-21T03:25:04.770927+0000 mon.a (mon.0) 10887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:04 smithi179 bash[23186]: cluster 2024-09-21T03:25:03.551615+0000 mgr.a (mgr.14388) 13444 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:04 smithi179 bash[23186]: audit 2024-09-21T03:25:04.758785+0000 mon.a (mon.0) 10885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:04 smithi179 bash[23186]: audit 2024-09-21T03:25:04.765399+0000 mon.a (mon.0) 10886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:04 smithi179 bash[23186]: audit 2024-09-21T03:25:04.770927+0000 mon.a (mon.0) 10887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:04 smithi049 bash[23528]: cluster 2024-09-21T03:25:03.551615+0000 mgr.a (mgr.14388) 13444 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:04 smithi049 bash[23528]: audit 2024-09-21T03:25:04.758785+0000 mon.a (mon.0) 10885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:04 smithi049 bash[23528]: audit 2024-09-21T03:25:04.765399+0000 mon.a (mon.0) 10886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:04 smithi049 bash[23528]: audit 2024-09-21T03:25:04.770927+0000 mon.a (mon.0) 10887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:05.343 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:05.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:05.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:05.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:05.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:06 smithi044 bash[22676]: audit 2024-09-21T03:25:04.921833+0000 mgr.a (mgr.14388) 13445 : audit [DBG] from='client.292692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:06 smithi044 bash[22676]: audit 2024-09-21T03:25:05.072707+0000 mon.a (mon.0) 10888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:06 smithi044 bash[22676]: audit 2024-09-21T03:25:05.078587+0000 mon.a (mon.0) 10889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:06 smithi044 bash[22676]: audit 2024-09-21T03:25:05.084774+0000 mon.a (mon.0) 10890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:06 smithi179 bash[23186]: audit 2024-09-21T03:25:04.921833+0000 mgr.a (mgr.14388) 13445 : audit [DBG] from='client.292692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:06.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:06 smithi179 bash[23186]: audit 2024-09-21T03:25:05.072707+0000 mon.a (mon.0) 10888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:06 smithi179 bash[23186]: audit 2024-09-21T03:25:05.078587+0000 mon.a (mon.0) 10889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:06 smithi179 bash[23186]: audit 2024-09-21T03:25:05.084774+0000 mon.a (mon.0) 10890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:06 smithi049 bash[23528]: audit 2024-09-21T03:25:04.921833+0000 mgr.a (mgr.14388) 13445 : audit [DBG] from='client.292692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:06 smithi049 bash[23528]: audit 2024-09-21T03:25:05.072707+0000 mon.a (mon.0) 10888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:06 smithi049 bash[23528]: audit 2024-09-21T03:25:05.078587+0000 mon.a (mon.0) 10889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:06 smithi049 bash[23528]: audit 2024-09-21T03:25:05.084774+0000 mon.a (mon.0) 10890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:07 smithi044 bash[22676]: cluster 2024-09-21T03:25:05.554511+0000 mgr.a (mgr.14388) 13446 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:07.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:07 smithi179 bash[23186]: cluster 2024-09-21T03:25:05.554511+0000 mgr.a (mgr.14388) 13446 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:07 smithi049 bash[23528]: cluster 2024-09-21T03:25:05.554511+0000 mgr.a (mgr.14388) 13446 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:25:09.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:09 smithi049 bash[23528]: cluster 2024-09-21T03:25:07.555303+0000 mgr.a (mgr.14388) 13447 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:09 smithi044 bash[22676]: cluster 2024-09-21T03:25:07.555303+0000 mgr.a (mgr.14388) 13447 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:09.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:09 smithi179 bash[23186]: cluster 2024-09-21T03:25:07.555303+0000 mgr.a (mgr.14388) 13447 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:10.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:10.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:11.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:11.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:11 smithi049 bash[23528]: cluster 2024-09-21T03:25:09.556216+0000 mgr.a (mgr.14388) 13448 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:25:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:11 smithi044 bash[22676]: cluster 2024-09-21T03:25:09.556216+0000 mgr.a (mgr.14388) 13448 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:25:11.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:11 smithi179 bash[23186]: cluster 2024-09-21T03:25:09.556216+0000 mgr.a (mgr.14388) 13448 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:25:12.417 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:12 smithi049 bash[23528]: audit 2024-09-21T03:25:10.682222+0000 mgr.a (mgr.14388) 13449 : audit [DBG] from='client.292770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:12 smithi044 bash[22676]: audit 2024-09-21T03:25:10.682222+0000 mgr.a (mgr.14388) 13449 : audit [DBG] from='client.292770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:12.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:12 smithi179 bash[23186]: audit 2024-09-21T03:25:10.682222+0000 mgr.a (mgr.14388) 13449 : audit [DBG] from='client.292770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:13 smithi049 bash[23528]: cluster 2024-09-21T03:25:11.559186+0000 mgr.a (mgr.14388) 13450 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:13 smithi049 bash[23528]: audit 2024-09-21T03:25:12.673604+0000 mon.a (mon.0) 10891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:13 smithi049 bash[23528]: audit 2024-09-21T03:25:12.683680+0000 mon.a (mon.0) 10892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:13 smithi049 bash[23528]: audit 2024-09-21T03:25:12.695470+0000 mon.a (mon.0) 10893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:13 smithi044 bash[22676]: cluster 2024-09-21T03:25:11.559186+0000 mgr.a (mgr.14388) 13450 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:13 smithi044 bash[22676]: audit 2024-09-21T03:25:12.673604+0000 mon.a (mon.0) 10891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:13 smithi044 bash[22676]: audit 2024-09-21T03:25:12.683680+0000 mon.a (mon.0) 10892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:13 smithi044 bash[22676]: audit 2024-09-21T03:25:12.695470+0000 mon.a (mon.0) 10893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:13 smithi179 bash[23186]: cluster 2024-09-21T03:25:11.559186+0000 mgr.a (mgr.14388) 13450 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:13 smithi179 bash[23186]: audit 2024-09-21T03:25:12.673604+0000 mon.a (mon.0) 10891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:13 smithi179 bash[23186]: audit 2024-09-21T03:25:12.683680+0000 mon.a (mon.0) 10892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:13.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:13 smithi179 bash[23186]: audit 2024-09-21T03:25:12.695470+0000 mon.a (mon.0) 10893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:15 smithi044 bash[22676]: cluster 2024-09-21T03:25:13.559972+0000 mgr.a (mgr.14388) 13451 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:15.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:15 smithi179 bash[23186]: cluster 2024-09-21T03:25:13.559972+0000 mgr.a (mgr.14388) 13451 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:15 smithi049 bash[23528]: cluster 2024-09-21T03:25:13.559972+0000 mgr.a (mgr.14388) 13451 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:16.903 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:17 smithi179 bash[23186]: cluster 2024-09-21T03:25:15.562019+0000 mgr.a (mgr.14388) 13452 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:17 smithi044 bash[22676]: cluster 2024-09-21T03:25:15.562019+0000 mgr.a (mgr.14388) 13452 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:17 smithi049 bash[23528]: cluster 2024-09-21T03:25:15.562019+0000 mgr.a (mgr.14388) 13452 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:18.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:18 smithi179 bash[23186]: audit 2024-09-21T03:25:16.469406+0000 mgr.a (mgr.14388) 13453 : audit [DBG] from='client.292848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:18.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:18 smithi044 bash[22676]: audit 2024-09-21T03:25:16.469406+0000 mgr.a (mgr.14388) 13453 : audit [DBG] from='client.292848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:18 smithi049 bash[23528]: audit 2024-09-21T03:25:16.469406+0000 mgr.a (mgr.14388) 13453 : audit [DBG] from='client.292848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:19.474 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:19 smithi179 bash[23186]: cluster 2024-09-21T03:25:17.563037+0000 mgr.a (mgr.14388) 13454 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:19 smithi044 bash[22676]: cluster 2024-09-21T03:25:17.563037+0000 mgr.a (mgr.14388) 13454 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:19 smithi049 bash[23528]: cluster 2024-09-21T03:25:17.563037+0000 mgr.a (mgr.14388) 13454 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:21 smithi044 bash[22676]: cluster 2024-09-21T03:25:19.563830+0000 mgr.a (mgr.14388) 13455 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:21.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:21 smithi179 bash[23186]: cluster 2024-09-21T03:25:19.563830+0000 mgr.a (mgr.14388) 13455 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:21 smithi049 bash[23528]: cluster 2024-09-21T03:25:19.563830+0000 mgr.a (mgr.14388) 13455 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:21.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:21.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:21.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:22.656 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:22.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:22.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:22.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:22.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:23 smithi044 bash[22676]: cluster 2024-09-21T03:25:21.566124+0000 mgr.a (mgr.14388) 13456 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:23.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:23 smithi179 bash[23186]: cluster 2024-09-21T03:25:21.566124+0000 mgr.a (mgr.14388) 13456 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:23 smithi049 bash[23528]: cluster 2024-09-21T03:25:21.566124+0000 mgr.a (mgr.14388) 13456 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:24 smithi044 bash[22676]: audit 2024-09-21T03:25:22.239151+0000 mgr.a (mgr.14388) 13457 : audit [DBG] from='client.292926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:24.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:24 smithi179 bash[23186]: audit 2024-09-21T03:25:22.239151+0000 mgr.a (mgr.14388) 13457 : audit [DBG] from='client.292926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:24.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:24 smithi049 bash[23528]: audit 2024-09-21T03:25:22.239151+0000 mgr.a (mgr.14388) 13457 : audit [DBG] from='client.292926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:25 smithi044 bash[22676]: cluster 2024-09-21T03:25:23.567111+0000 mgr.a (mgr.14388) 13458 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:25 smithi044 bash[22676]: audit 2024-09-21T03:25:24.989789+0000 mon.a (mon.0) 10894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:25 smithi044 bash[22676]: audit 2024-09-21T03:25:24.998385+0000 mon.a (mon.0) 10895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:25 smithi044 bash[22676]: audit 2024-09-21T03:25:25.010168+0000 mon.a (mon.0) 10896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:25 smithi179 bash[23186]: cluster 2024-09-21T03:25:23.567111+0000 mgr.a (mgr.14388) 13458 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:25 smithi179 bash[23186]: audit 2024-09-21T03:25:24.989789+0000 mon.a (mon.0) 10894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:25 smithi179 bash[23186]: audit 2024-09-21T03:25:24.998385+0000 mon.a (mon.0) 10895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:25 smithi179 bash[23186]: audit 2024-09-21T03:25:25.010168+0000 mon.a (mon.0) 10896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:25 smithi049 bash[23528]: cluster 2024-09-21T03:25:23.567111+0000 mgr.a (mgr.14388) 13458 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:25 smithi049 bash[23528]: audit 2024-09-21T03:25:24.989789+0000 mon.a (mon.0) 10894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:25 smithi049 bash[23528]: audit 2024-09-21T03:25:24.998385+0000 mon.a (mon.0) 10895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:25 smithi049 bash[23528]: audit 2024-09-21T03:25:25.010168+0000 mon.a (mon.0) 10896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:26 smithi049 bash[23528]: audit 2024-09-21T03:25:25.292254+0000 mon.a (mon.0) 10897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:26 smithi049 bash[23528]: audit 2024-09-21T03:25:25.301028+0000 mon.a (mon.0) 10898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:26 smithi049 bash[23528]: audit 2024-09-21T03:25:25.310947+0000 mon.a (mon.0) 10899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:26 smithi049 bash[23528]: cluster 2024-09-21T03:25:25.569388+0000 mgr.a (mgr.14388) 13459 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:26 smithi044 bash[22676]: audit 2024-09-21T03:25:25.292254+0000 mon.a (mon.0) 10897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:26 smithi044 bash[22676]: audit 2024-09-21T03:25:25.301028+0000 mon.a (mon.0) 10898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:26 smithi044 bash[22676]: audit 2024-09-21T03:25:25.310947+0000 mon.a (mon.0) 10899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:26 smithi044 bash[22676]: cluster 2024-09-21T03:25:25.569388+0000 mgr.a (mgr.14388) 13459 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:26 smithi179 bash[23186]: audit 2024-09-21T03:25:25.292254+0000 mon.a (mon.0) 10897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:26 smithi179 bash[23186]: audit 2024-09-21T03:25:25.301028+0000 mon.a (mon.0) 10898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:26 smithi179 bash[23186]: audit 2024-09-21T03:25:25.310947+0000 mon.a (mon.0) 10899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:26.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:26 smithi179 bash[23186]: cluster 2024-09-21T03:25:25.569388+0000 mgr.a (mgr.14388) 13459 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:27.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:27.658 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:27.658 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:28.444 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:28.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:28.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:28.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:28.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:28 smithi044 bash[22676]: cluster 2024-09-21T03:25:27.570104+0000 mgr.a (mgr.14388) 13460 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:28 smithi044 bash[22676]: audit 2024-09-21T03:25:27.995434+0000 mgr.a (mgr.14388) 13461 : audit [DBG] from='client.293004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:28 smithi179 bash[23186]: cluster 2024-09-21T03:25:27.570104+0000 mgr.a (mgr.14388) 13460 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:28 smithi179 bash[23186]: audit 2024-09-21T03:25:27.995434+0000 mgr.a (mgr.14388) 13461 : audit [DBG] from='client.293004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:28 smithi049 bash[23528]: cluster 2024-09-21T03:25:27.570104+0000 mgr.a (mgr.14388) 13460 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:28 smithi049 bash[23528]: audit 2024-09-21T03:25:27.995434+0000 mgr.a (mgr.14388) 13461 : audit [DBG] from='client.293004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:30 smithi044 bash[22676]: cluster 2024-09-21T03:25:29.571036+0000 mgr.a (mgr.14388) 13462 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:30 smithi179 bash[23186]: cluster 2024-09-21T03:25:29.571036+0000 mgr.a (mgr.14388) 13462 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:31.009 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:30 smithi049 bash[23528]: cluster 2024-09-21T03:25:29.571036+0000 mgr.a (mgr.14388) 13462 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:32 smithi049 bash[23528]: cluster 2024-09-21T03:25:31.573309+0000 mgr.a (mgr.14388) 13463 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:32 smithi044 bash[22676]: cluster 2024-09-21T03:25:31.573309+0000 mgr.a (mgr.14388) 13463 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:32 smithi179 bash[23186]: cluster 2024-09-21T03:25:31.573309+0000 mgr.a (mgr.14388) 13463 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:33.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:33.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:33.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:33 smithi044 bash[22676]: audit 2024-09-21T03:25:32.863821+0000 mon.a (mon.0) 10900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:33 smithi044 bash[22676]: audit 2024-09-21T03:25:32.873678+0000 mon.a (mon.0) 10901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:33 smithi044 bash[22676]: audit 2024-09-21T03:25:32.884045+0000 mon.a (mon.0) 10902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.248 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:34.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:34.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:34.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:34.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:33 smithi179 bash[23186]: audit 2024-09-21T03:25:32.863821+0000 mon.a (mon.0) 10900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:33 smithi179 bash[23186]: audit 2024-09-21T03:25:32.873678+0000 mon.a (mon.0) 10901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:33 smithi179 bash[23186]: audit 2024-09-21T03:25:32.884045+0000 mon.a (mon.0) 10902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:33 smithi049 bash[23528]: audit 2024-09-21T03:25:32.863821+0000 mon.a (mon.0) 10900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:33 smithi049 bash[23528]: audit 2024-09-21T03:25:32.873678+0000 mon.a (mon.0) 10901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:33 smithi049 bash[23528]: audit 2024-09-21T03:25:32.884045+0000 mon.a (mon.0) 10902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:34 smithi044 bash[22676]: cluster 2024-09-21T03:25:33.573865+0000 mgr.a (mgr.14388) 13464 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:34 smithi044 bash[22676]: audit 2024-09-21T03:25:33.788835+0000 mgr.a (mgr.14388) 13465 : audit [DBG] from='client.293079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:34 smithi179 bash[23186]: cluster 2024-09-21T03:25:33.573865+0000 mgr.a (mgr.14388) 13464 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:35.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:34 smithi179 bash[23186]: audit 2024-09-21T03:25:33.788835+0000 mgr.a (mgr.14388) 13465 : audit [DBG] from='client.293079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:34 smithi049 bash[23528]: cluster 2024-09-21T03:25:33.573865+0000 mgr.a (mgr.14388) 13464 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:34 smithi049 bash[23528]: audit 2024-09-21T03:25:33.788835+0000 mgr.a (mgr.14388) 13465 : audit [DBG] from='client.293079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:36 smithi044 bash[22676]: cluster 2024-09-21T03:25:35.576121+0000 mgr.a (mgr.14388) 13466 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:37.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:36 smithi179 bash[23186]: cluster 2024-09-21T03:25:35.576121+0000 mgr.a (mgr.14388) 13466 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:36 smithi049 bash[23528]: cluster 2024-09-21T03:25:35.576121+0000 mgr.a (mgr.14388) 13466 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:38 smithi044 bash[22676]: cluster 2024-09-21T03:25:37.576874+0000 mgr.a (mgr.14388) 13467 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:39.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:39.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:38 smithi179 bash[23186]: cluster 2024-09-21T03:25:37.576874+0000 mgr.a (mgr.14388) 13467 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:38 smithi049 bash[23528]: cluster 2024-09-21T03:25:37.576874+0000 mgr.a (mgr.14388) 13467 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:40.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:40.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:40 smithi044 bash[22676]: cluster 2024-09-21T03:25:39.577608+0000 mgr.a (mgr.14388) 13468 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:40 smithi044 bash[22676]: audit 2024-09-21T03:25:39.583014+0000 mgr.a (mgr.14388) 13469 : audit [DBG] from='client.293157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:41.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:40 smithi179 bash[23186]: cluster 2024-09-21T03:25:39.577608+0000 mgr.a (mgr.14388) 13468 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:40 smithi179 bash[23186]: audit 2024-09-21T03:25:39.583014+0000 mgr.a (mgr.14388) 13469 : audit [DBG] from='client.293157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:40 smithi049 bash[23528]: cluster 2024-09-21T03:25:39.577608+0000 mgr.a (mgr.14388) 13468 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:40 smithi049 bash[23528]: audit 2024-09-21T03:25:39.583014+0000 mgr.a (mgr.14388) 13469 : audit [DBG] from='client.293157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:42 smithi044 bash[22676]: cluster 2024-09-21T03:25:41.579966+0000 mgr.a (mgr.14388) 13470 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:43.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:42 smithi179 bash[23186]: cluster 2024-09-21T03:25:41.579966+0000 mgr.a (mgr.14388) 13470 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:42 smithi049 bash[23528]: cluster 2024-09-21T03:25:41.579966+0000 mgr.a (mgr.14388) 13470 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:25:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:45.172 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:44 smithi044 bash[22676]: cluster 2024-09-21T03:25:43.580790+0000 mgr.a (mgr.14388) 13471 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:45.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:44 smithi179 bash[23186]: cluster 2024-09-21T03:25:43.580790+0000 mgr.a (mgr.14388) 13471 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:44 smithi049 bash[23528]: cluster 2024-09-21T03:25:43.580790+0000 mgr.a (mgr.14388) 13471 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:45.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:45.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:45.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:45.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:45.778 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:46 smithi044 bash[22676]: audit 2024-09-21T03:25:45.160508+0000 mon.a (mon.0) 10903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:46 smithi044 bash[22676]: audit 2024-09-21T03:25:45.166128+0000 mon.a (mon.0) 10904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:46 smithi044 bash[22676]: audit 2024-09-21T03:25:45.171199+0000 mon.a (mon.0) 10905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:46 smithi044 bash[22676]: audit 2024-09-21T03:25:45.499051+0000 mon.a (mon.0) 10906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:46 smithi044 bash[22676]: audit 2024-09-21T03:25:45.504512+0000 mon.a (mon.0) 10907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:46 smithi044 bash[22676]: audit 2024-09-21T03:25:45.511536+0000 mon.a (mon.0) 10908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:46 smithi179 bash[23186]: audit 2024-09-21T03:25:45.160508+0000 mon.a (mon.0) 10903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:46 smithi179 bash[23186]: audit 2024-09-21T03:25:45.166128+0000 mon.a (mon.0) 10904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:46 smithi179 bash[23186]: audit 2024-09-21T03:25:45.171199+0000 mon.a (mon.0) 10905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:46 smithi179 bash[23186]: audit 2024-09-21T03:25:45.499051+0000 mon.a (mon.0) 10906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:46 smithi179 bash[23186]: audit 2024-09-21T03:25:45.504512+0000 mon.a (mon.0) 10907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:46 smithi179 bash[23186]: audit 2024-09-21T03:25:45.511536+0000 mon.a (mon.0) 10908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:46 smithi049 bash[23528]: audit 2024-09-21T03:25:45.160508+0000 mon.a (mon.0) 10903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:46 smithi049 bash[23528]: audit 2024-09-21T03:25:45.166128+0000 mon.a (mon.0) 10904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:46 smithi049 bash[23528]: audit 2024-09-21T03:25:45.171199+0000 mon.a (mon.0) 10905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:46 smithi049 bash[23528]: audit 2024-09-21T03:25:45.499051+0000 mon.a (mon.0) 10906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:46 smithi049 bash[23528]: audit 2024-09-21T03:25:45.504512+0000 mon.a (mon.0) 10907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:46 smithi049 bash[23528]: audit 2024-09-21T03:25:45.511536+0000 mon.a (mon.0) 10908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:47 smithi044 bash[22676]: audit 2024-09-21T03:25:45.355345+0000 mgr.a (mgr.14388) 13472 : audit [DBG] from='client.293232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:47 smithi044 bash[22676]: cluster 2024-09-21T03:25:45.583578+0000 mgr.a (mgr.14388) 13473 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:47 smithi179 bash[23186]: audit 2024-09-21T03:25:45.355345+0000 mgr.a (mgr.14388) 13472 : audit [DBG] from='client.293232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:47.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:47 smithi179 bash[23186]: cluster 2024-09-21T03:25:45.583578+0000 mgr.a (mgr.14388) 13473 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:47 smithi049 bash[23528]: audit 2024-09-21T03:25:45.355345+0000 mgr.a (mgr.14388) 13472 : audit [DBG] from='client.293232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:47 smithi049 bash[23528]: cluster 2024-09-21T03:25:45.583578+0000 mgr.a (mgr.14388) 13473 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:25:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:49 smithi044 bash[22676]: cluster 2024-09-21T03:25:47.584650+0000 mgr.a (mgr.14388) 13474 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:49.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:49 smithi179 bash[23186]: cluster 2024-09-21T03:25:47.584650+0000 mgr.a (mgr.14388) 13474 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:49 smithi049 bash[23528]: cluster 2024-09-21T03:25:47.584650+0000 mgr.a (mgr.14388) 13474 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:51 smithi049 bash[23528]: cluster 2024-09-21T03:25:49.585456+0000 mgr.a (mgr.14388) 13475 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:51 smithi044 bash[22676]: cluster 2024-09-21T03:25:49.585456+0000 mgr.a (mgr.14388) 13475 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:51.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:51 smithi179 bash[23186]: cluster 2024-09-21T03:25:49.585456+0000 mgr.a (mgr.14388) 13475 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:25:51.527 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:51.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:52.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:52 smithi049 bash[23528]: audit 2024-09-21T03:25:51.111692+0000 mgr.a (mgr.14388) 13476 : audit [DBG] from='client.293310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:52 smithi044 bash[22676]: audit 2024-09-21T03:25:51.111692+0000 mgr.a (mgr.14388) 13476 : audit [DBG] from='client.293310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:52.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:52 smithi179 bash[23186]: audit 2024-09-21T03:25:51.111692+0000 mgr.a (mgr.14388) 13476 : audit [DBG] from='client.293310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:53 smithi044 bash[22676]: cluster 2024-09-21T03:25:51.588327+0000 mgr.a (mgr.14388) 13477 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:53 smithi044 bash[22676]: audit 2024-09-21T03:25:53.046019+0000 mon.a (mon.0) 10909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:53 smithi044 bash[22676]: audit 2024-09-21T03:25:53.055142+0000 mon.a (mon.0) 10910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:53 smithi044 bash[22676]: audit 2024-09-21T03:25:53.067455+0000 mon.a (mon.0) 10911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:53 smithi179 bash[23186]: cluster 2024-09-21T03:25:51.588327+0000 mgr.a (mgr.14388) 13477 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:53.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:53 smithi179 bash[23186]: audit 2024-09-21T03:25:53.046019+0000 mon.a (mon.0) 10909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:53 smithi179 bash[23186]: audit 2024-09-21T03:25:53.055142+0000 mon.a (mon.0) 10910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:53 smithi179 bash[23186]: audit 2024-09-21T03:25:53.067455+0000 mon.a (mon.0) 10911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:53 smithi049 bash[23528]: cluster 2024-09-21T03:25:51.588327+0000 mgr.a (mgr.14388) 13477 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:53 smithi049 bash[23528]: audit 2024-09-21T03:25:53.046019+0000 mon.a (mon.0) 10909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:53 smithi049 bash[23528]: audit 2024-09-21T03:25:53.055142+0000 mon.a (mon.0) 10910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:53 smithi049 bash[23528]: audit 2024-09-21T03:25:53.067455+0000 mon.a (mon.0) 10911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: cluster 2024-09-21T03:25:53.589158+0000 mgr.a (mgr.14388) 13478 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: audit 2024-09-21T03:25:54.584233+0000 mon.a (mon.0) 10912 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: audit 2024-09-21T03:25:55.157234+0000 mon.a (mon.0) 10913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: audit 2024-09-21T03:25:55.165133+0000 mon.a (mon.0) 10914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: audit 2024-09-21T03:25:55.167605+0000 mon.a (mon.0) 10915 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: audit 2024-09-21T03:25:55.169243+0000 mon.a (mon.0) 10916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: audit 2024-09-21T03:25:55.177909+0000 mon.a (mon.0) 10917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22676]: audit 2024-09-21T03:25:55.183161+0000 mon.a (mon.0) 10918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: cluster 2024-09-21T03:25:53.589158+0000 mgr.a (mgr.14388) 13478 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: audit 2024-09-21T03:25:54.584233+0000 mon.a (mon.0) 10912 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: audit 2024-09-21T03:25:55.157234+0000 mon.a (mon.0) 10913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: audit 2024-09-21T03:25:55.165133+0000 mon.a (mon.0) 10914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: audit 2024-09-21T03:25:55.167605+0000 mon.a (mon.0) 10915 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: audit 2024-09-21T03:25:55.169243+0000 mon.a (mon.0) 10916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: audit 2024-09-21T03:25:55.177909+0000 mon.a (mon.0) 10917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:55 smithi179 bash[23186]: audit 2024-09-21T03:25:55.183161+0000 mon.a (mon.0) 10918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:25:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: cluster 2024-09-21T03:25:53.589158+0000 mgr.a (mgr.14388) 13478 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:25:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: audit 2024-09-21T03:25:54.584233+0000 mon.a (mon.0) 10912 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:25:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: audit 2024-09-21T03:25:55.157234+0000 mon.a (mon.0) 10913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: audit 2024-09-21T03:25:55.165133+0000 mon.a (mon.0) 10914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: audit 2024-09-21T03:25:55.167605+0000 mon.a (mon.0) 10915 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:25:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: audit 2024-09-21T03:25:55.169243+0000 mon.a (mon.0) 10916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:25:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: audit 2024-09-21T03:25:55.177909+0000 mon.a (mon.0) 10917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:25:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:55 smithi049 bash[23528]: audit 2024-09-21T03:25:55.183161+0000 mon.a (mon.0) 10918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:25:56.343 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:56 smithi044 bash[22676]: audit 2024-09-21T03:25:55.185070+0000 mgr.a (mgr.14388) 13479 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:25:56.344 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22930]: debug 2024-09-21T03:25:55.983+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:25:56.344 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:25:55 smithi044 bash[22930]: debug 2024-09-21T03:25:55.987+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:25:56.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:56 smithi179 bash[23186]: audit 2024-09-21T03:25:55.185070+0000 mgr.a (mgr.14388) 13479 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:25:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:25:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:25:56.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:25:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:56 smithi049 bash[23528]: audit 2024-09-21T03:25:55.185070+0000 mgr.a (mgr.14388) 13479 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:25:57.296 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:25:57.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:25:57.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:25:57.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:25:57.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:25:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:57 smithi044 bash[22676]: cluster 2024-09-21T03:25:55.591177+0000 mgr.a (mgr.14388) 13480 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:57 smithi044 bash[22676]: audit 2024-09-21T03:25:55.987986+0000 mgr.a (mgr.14388) 13481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:25:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:57 smithi044 bash[22676]: cephadm 2024-09-21T03:25:55.989809+0000 mgr.a (mgr.14388) 13482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:25:57.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:57 smithi179 bash[23186]: cluster 2024-09-21T03:25:55.591177+0000 mgr.a (mgr.14388) 13480 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:57 smithi179 bash[23186]: audit 2024-09-21T03:25:55.987986+0000 mgr.a (mgr.14388) 13481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:25:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:57 smithi179 bash[23186]: cephadm 2024-09-21T03:25:55.989809+0000 mgr.a (mgr.14388) 13482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:25:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:57 smithi049 bash[23528]: cluster 2024-09-21T03:25:55.591177+0000 mgr.a (mgr.14388) 13480 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:57 smithi049 bash[23528]: audit 2024-09-21T03:25:55.987986+0000 mgr.a (mgr.14388) 13481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:25:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:57 smithi049 bash[23528]: cephadm 2024-09-21T03:25:55.989809+0000 mgr.a (mgr.14388) 13482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:25:58.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:58 smithi179 bash[23186]: audit 2024-09-21T03:25:56.861363+0000 mgr.a (mgr.14388) 13483 : audit [DBG] from='client.293493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:58 smithi044 bash[22676]: audit 2024-09-21T03:25:56.861363+0000 mgr.a (mgr.14388) 13483 : audit [DBG] from='client.293493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:58 smithi049 bash[23528]: audit 2024-09-21T03:25:56.861363+0000 mgr.a (mgr.14388) 13483 : audit [DBG] from='client.293493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:25:59 smithi044 bash[22676]: cluster 2024-09-21T03:25:57.592132+0000 mgr.a (mgr.14388) 13484 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:59.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:25:59 smithi179 bash[23186]: cluster 2024-09-21T03:25:57.592132+0000 mgr.a (mgr.14388) 13484 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:25:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:25:59 smithi049 bash[23528]: cluster 2024-09-21T03:25:57.592132+0000 mgr.a (mgr.14388) 13484 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:26:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:00 smithi049 bash[23528]: cluster 2024-09-21T03:25:59.592961+0000 mgr.a (mgr.14388) 13485 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:26:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:00 smithi044 bash[22676]: cluster 2024-09-21T03:25:59.592961+0000 mgr.a (mgr.14388) 13485 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:26:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:00 smithi179 bash[23186]: cluster 2024-09-21T03:25:59.592961+0000 mgr.a (mgr.14388) 13485 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:26:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:02 smithi044 bash[22676]: cluster 2024-09-21T03:26:01.595236+0000 mgr.a (mgr.14388) 13486 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T03:26:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:02 smithi179 bash[23186]: cluster 2024-09-21T03:26:01.595236+0000 mgr.a (mgr.14388) 13486 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T03:26:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:02 smithi049 bash[23528]: cluster 2024-09-21T03:26:01.595236+0000 mgr.a (mgr.14388) 13486 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T03:26:03.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:03.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:03.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:03.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:03.072 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:03.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:03 smithi044 bash[22676]: audit 2024-09-21T03:26:02.632686+0000 mgr.a (mgr.14388) 13487 : audit [DBG] from='client.293571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:04.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:03 smithi179 bash[23186]: audit 2024-09-21T03:26:02.632686+0000 mgr.a (mgr.14388) 13487 : audit [DBG] from='client.293571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:04.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:03 smithi049 bash[23528]: audit 2024-09-21T03:26:02.632686+0000 mgr.a (mgr.14388) 13487 : audit [DBG] from='client.293571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:04 smithi044 bash[22676]: cluster 2024-09-21T03:26:03.596218+0000 mgr.a (mgr.14388) 13488 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:04 smithi179 bash[23186]: cluster 2024-09-21T03:26:03.596218+0000 mgr.a (mgr.14388) 13488 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:04 smithi049 bash[23528]: cluster 2024-09-21T03:26:03.596218+0000 mgr.a (mgr.14388) 13488 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:06 smithi044 bash[22676]: audit 2024-09-21T03:26:05.394367+0000 mon.a (mon.0) 10919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:06 smithi044 bash[22676]: audit 2024-09-21T03:26:05.403302+0000 mon.a (mon.0) 10920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:06 smithi044 bash[22676]: audit 2024-09-21T03:26:05.413915+0000 mon.a (mon.0) 10921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:06 smithi044 bash[22676]: cluster 2024-09-21T03:26:05.598486+0000 mgr.a (mgr.14388) 13489 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:06 smithi044 bash[22676]: audit 2024-09-21T03:26:05.716127+0000 mon.a (mon.0) 10922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:06 smithi044 bash[22676]: audit 2024-09-21T03:26:05.724637+0000 mon.a (mon.0) 10923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:06 smithi044 bash[22676]: audit 2024-09-21T03:26:05.734749+0000 mon.a (mon.0) 10924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:06 smithi179 bash[23186]: audit 2024-09-21T03:26:05.394367+0000 mon.a (mon.0) 10919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:06 smithi179 bash[23186]: audit 2024-09-21T03:26:05.403302+0000 mon.a (mon.0) 10920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:06 smithi179 bash[23186]: audit 2024-09-21T03:26:05.413915+0000 mon.a (mon.0) 10921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:06 smithi179 bash[23186]: cluster 2024-09-21T03:26:05.598486+0000 mgr.a (mgr.14388) 13489 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:06 smithi179 bash[23186]: audit 2024-09-21T03:26:05.716127+0000 mon.a (mon.0) 10922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:06 smithi179 bash[23186]: audit 2024-09-21T03:26:05.724637+0000 mon.a (mon.0) 10923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:06 smithi179 bash[23186]: audit 2024-09-21T03:26:05.734749+0000 mon.a (mon.0) 10924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:06 smithi049 bash[23528]: audit 2024-09-21T03:26:05.394367+0000 mon.a (mon.0) 10919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:06 smithi049 bash[23528]: audit 2024-09-21T03:26:05.403302+0000 mon.a (mon.0) 10920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:06 smithi049 bash[23528]: audit 2024-09-21T03:26:05.413915+0000 mon.a (mon.0) 10921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:06 smithi049 bash[23528]: cluster 2024-09-21T03:26:05.598486+0000 mgr.a (mgr.14388) 13489 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:06 smithi049 bash[23528]: audit 2024-09-21T03:26:05.716127+0000 mon.a (mon.0) 10922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:06 smithi049 bash[23528]: audit 2024-09-21T03:26:05.724637+0000 mon.a (mon.0) 10923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:06 smithi049 bash[23528]: audit 2024-09-21T03:26:05.734749+0000 mon.a (mon.0) 10924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:08.875 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:08.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:08.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:08.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:08.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:08 smithi044 bash[22676]: cluster 2024-09-21T03:26:07.599435+0000 mgr.a (mgr.14388) 13490 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:09.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:08 smithi179 bash[23186]: cluster 2024-09-21T03:26:07.599435+0000 mgr.a (mgr.14388) 13490 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:08 smithi049 bash[23528]: cluster 2024-09-21T03:26:07.599435+0000 mgr.a (mgr.14388) 13490 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:09.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:09 smithi044 bash[22676]: audit 2024-09-21T03:26:08.411586+0000 mgr.a (mgr.14388) 13491 : audit [DBG] from='client.293646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:10.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:09 smithi179 bash[23186]: audit 2024-09-21T03:26:08.411586+0000 mgr.a (mgr.14388) 13491 : audit [DBG] from='client.293646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:09 smithi049 bash[23528]: audit 2024-09-21T03:26:08.411586+0000 mgr.a (mgr.14388) 13491 : audit [DBG] from='client.293646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:10 smithi049 bash[23528]: cluster 2024-09-21T03:26:09.600381+0000 mgr.a (mgr.14388) 13492 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:10.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:10 smithi044 bash[22676]: cluster 2024-09-21T03:26:09.600381+0000 mgr.a (mgr.14388) 13492 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:11.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:10 smithi179 bash[23186]: cluster 2024-09-21T03:26:09.600381+0000 mgr.a (mgr.14388) 13492 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:26:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:12 smithi049 bash[23528]: cluster 2024-09-21T03:26:11.602650+0000 mgr.a (mgr.14388) 13493 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-09-21T03:26:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:12 smithi044 bash[22676]: cluster 2024-09-21T03:26:11.602650+0000 mgr.a (mgr.14388) 13493 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-09-21T03:26:13.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:12 smithi179 bash[23186]: cluster 2024-09-21T03:26:11.602650+0000 mgr.a (mgr.14388) 13493 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-09-21T03:26:13.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:14 smithi179 bash[23186]: audit 2024-09-21T03:26:13.250687+0000 mon.a (mon.0) 10925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:14 smithi179 bash[23186]: audit 2024-09-21T03:26:13.259258+0000 mon.a (mon.0) 10926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:14 smithi179 bash[23186]: audit 2024-09-21T03:26:13.269692+0000 mon.a (mon.0) 10927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:14 smithi179 bash[23186]: cluster 2024-09-21T03:26:13.603412+0000 mgr.a (mgr.14388) 13494 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:14 smithi179 bash[23186]: audit 2024-09-21T03:26:14.211464+0000 mgr.a (mgr.14388) 13495 : audit [DBG] from='client.293721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:14 smithi049 bash[23528]: audit 2024-09-21T03:26:13.250687+0000 mon.a (mon.0) 10925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:14 smithi049 bash[23528]: audit 2024-09-21T03:26:13.259258+0000 mon.a (mon.0) 10926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:14 smithi049 bash[23528]: audit 2024-09-21T03:26:13.269692+0000 mon.a (mon.0) 10927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:14 smithi049 bash[23528]: cluster 2024-09-21T03:26:13.603412+0000 mgr.a (mgr.14388) 13494 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:14 smithi049 bash[23528]: audit 2024-09-21T03:26:14.211464+0000 mgr.a (mgr.14388) 13495 : audit [DBG] from='client.293721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:14.647 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:14.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:14.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:14.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:14.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:14 smithi044 bash[22676]: audit 2024-09-21T03:26:13.250687+0000 mon.a (mon.0) 10925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:14 smithi044 bash[22676]: audit 2024-09-21T03:26:13.259258+0000 mon.a (mon.0) 10926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:14 smithi044 bash[22676]: audit 2024-09-21T03:26:13.269692+0000 mon.a (mon.0) 10927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:14 smithi044 bash[22676]: cluster 2024-09-21T03:26:13.603412+0000 mgr.a (mgr.14388) 13494 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:14 smithi044 bash[22676]: audit 2024-09-21T03:26:14.211464+0000 mgr.a (mgr.14388) 13495 : audit [DBG] from='client.293721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:16.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:16 smithi044 bash[22676]: cluster 2024-09-21T03:26:15.605964+0000 mgr.a (mgr.14388) 13496 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:26:17.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:16 smithi179 bash[23186]: cluster 2024-09-21T03:26:15.605964+0000 mgr.a (mgr.14388) 13496 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:26:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:16 smithi049 bash[23528]: cluster 2024-09-21T03:26:15.605964+0000 mgr.a (mgr.14388) 13496 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:26:18.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:18 smithi044 bash[22676]: cluster 2024-09-21T03:26:17.606841+0000 mgr.a (mgr.14388) 13497 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:18.976 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:18 smithi179 bash[23186]: cluster 2024-09-21T03:26:17.606841+0000 mgr.a (mgr.14388) 13497 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:18 smithi049 bash[23528]: cluster 2024-09-21T03:26:17.606841+0000 mgr.a (mgr.14388) 13497 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:19.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:19.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:19.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:20.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:20.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:20.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:20.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:20.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:20 smithi044 bash[22676]: cluster 2024-09-21T03:26:19.607632+0000 mgr.a (mgr.14388) 13498 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:20 smithi044 bash[22676]: audit 2024-09-21T03:26:19.981626+0000 mgr.a (mgr.14388) 13499 : audit [DBG] from='client.293799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:20 smithi179 bash[23186]: cluster 2024-09-21T03:26:19.607632+0000 mgr.a (mgr.14388) 13498 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:21.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:20 smithi179 bash[23186]: audit 2024-09-21T03:26:19.981626+0000 mgr.a (mgr.14388) 13499 : audit [DBG] from='client.293799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:20 smithi049 bash[23528]: cluster 2024-09-21T03:26:19.607632+0000 mgr.a (mgr.14388) 13498 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:20 smithi049 bash[23528]: audit 2024-09-21T03:26:19.981626+0000 mgr.a (mgr.14388) 13499 : audit [DBG] from='client.293799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:22.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:22 smithi044 bash[22676]: cluster 2024-09-21T03:26:21.610492+0000 mgr.a (mgr.14388) 13500 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:23.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:22 smithi179 bash[23186]: cluster 2024-09-21T03:26:21.610492+0000 mgr.a (mgr.14388) 13500 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:22 smithi049 bash[23528]: cluster 2024-09-21T03:26:21.610492+0000 mgr.a (mgr.14388) 13500 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T03:26:24.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:24 smithi044 bash[22676]: cluster 2024-09-21T03:26:23.611263+0000 mgr.a (mgr.14388) 13501 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:26:25.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:24 smithi179 bash[23186]: cluster 2024-09-21T03:26:23.611263+0000 mgr.a (mgr.14388) 13501 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:26:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:24 smithi049 bash[23528]: cluster 2024-09-21T03:26:23.611263+0000 mgr.a (mgr.14388) 13501 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:26:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:26.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:26.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:26.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:26.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:26.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: audit 2024-09-21T03:26:25.570293+0000 mon.a (mon.0) 10928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: audit 2024-09-21T03:26:25.574623+0000 mon.a (mon.0) 10929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: audit 2024-09-21T03:26:25.580755+0000 mon.a (mon.0) 10930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: cluster 2024-09-21T03:26:25.613057+0000 mgr.a (mgr.14388) 13502 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: audit 2024-09-21T03:26:25.758273+0000 mgr.a (mgr.14388) 13503 : audit [DBG] from='client.293874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: audit 2024-09-21T03:26:25.912142+0000 mon.a (mon.0) 10931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: audit 2024-09-21T03:26:25.918005+0000 mon.a (mon.0) 10932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:26 smithi044 bash[22676]: audit 2024-09-21T03:26:25.925409+0000 mon.a (mon.0) 10933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: audit 2024-09-21T03:26:25.570293+0000 mon.a (mon.0) 10928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: audit 2024-09-21T03:26:25.574623+0000 mon.a (mon.0) 10929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: audit 2024-09-21T03:26:25.580755+0000 mon.a (mon.0) 10930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: cluster 2024-09-21T03:26:25.613057+0000 mgr.a (mgr.14388) 13502 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: audit 2024-09-21T03:26:25.758273+0000 mgr.a (mgr.14388) 13503 : audit [DBG] from='client.293874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: audit 2024-09-21T03:26:25.912142+0000 mon.a (mon.0) 10931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: audit 2024-09-21T03:26:25.918005+0000 mon.a (mon.0) 10932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:26 smithi179 bash[23186]: audit 2024-09-21T03:26:25.925409+0000 mon.a (mon.0) 10933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: audit 2024-09-21T03:26:25.570293+0000 mon.a (mon.0) 10928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: audit 2024-09-21T03:26:25.574623+0000 mon.a (mon.0) 10929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: audit 2024-09-21T03:26:25.580755+0000 mon.a (mon.0) 10930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: cluster 2024-09-21T03:26:25.613057+0000 mgr.a (mgr.14388) 13502 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: audit 2024-09-21T03:26:25.758273+0000 mgr.a (mgr.14388) 13503 : audit [DBG] from='client.293874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: audit 2024-09-21T03:26:25.912142+0000 mon.a (mon.0) 10931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: audit 2024-09-21T03:26:25.918005+0000 mon.a (mon.0) 10932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:26 smithi049 bash[23528]: audit 2024-09-21T03:26:25.925409+0000 mon.a (mon.0) 10933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:28 smithi044 bash[22676]: cluster 2024-09-21T03:26:27.613962+0000 mgr.a (mgr.14388) 13504 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:26:29.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:28 smithi179 bash[23186]: cluster 2024-09-21T03:26:27.613962+0000 mgr.a (mgr.14388) 13504 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:26:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:28 smithi049 bash[23528]: cluster 2024-09-21T03:26:27.613962+0000 mgr.a (mgr.14388) 13504 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:26:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:30 smithi044 bash[22676]: cluster 2024-09-21T03:26:29.614747+0000 mgr.a (mgr.14388) 13505 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:26:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:30 smithi179 bash[23186]: cluster 2024-09-21T03:26:29.614747+0000 mgr.a (mgr.14388) 13505 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:26:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:30 smithi049 bash[23528]: cluster 2024-09-21T03:26:29.614747+0000 mgr.a (mgr.14388) 13505 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:26:31.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:31.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:31.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:31.936 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:32 smithi044 bash[22676]: audit 2024-09-21T03:26:31.511950+0000 mgr.a (mgr.14388) 13506 : audit [DBG] from='client.293952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:32 smithi044 bash[22676]: cluster 2024-09-21T03:26:31.616227+0000 mgr.a (mgr.14388) 13507 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:33.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:32 smithi179 bash[23186]: audit 2024-09-21T03:26:31.511950+0000 mgr.a (mgr.14388) 13506 : audit [DBG] from='client.293952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:32 smithi179 bash[23186]: cluster 2024-09-21T03:26:31.616227+0000 mgr.a (mgr.14388) 13507 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:32 smithi049 bash[23528]: audit 2024-09-21T03:26:31.511950+0000 mgr.a (mgr.14388) 13506 : audit [DBG] from='client.293952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:32 smithi049 bash[23528]: cluster 2024-09-21T03:26:31.616227+0000 mgr.a (mgr.14388) 13507 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:34 smithi044 bash[22676]: audit 2024-09-21T03:26:33.460689+0000 mon.a (mon.0) 10934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:34 smithi044 bash[22676]: audit 2024-09-21T03:26:33.469781+0000 mon.a (mon.0) 10935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:34 smithi044 bash[22676]: audit 2024-09-21T03:26:33.480516+0000 mon.a (mon.0) 10936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:34 smithi044 bash[22676]: cluster 2024-09-21T03:26:33.617225+0000 mgr.a (mgr.14388) 13508 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:34 smithi179 bash[23186]: audit 2024-09-21T03:26:33.460689+0000 mon.a (mon.0) 10934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:34 smithi179 bash[23186]: audit 2024-09-21T03:26:33.469781+0000 mon.a (mon.0) 10935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:34 smithi179 bash[23186]: audit 2024-09-21T03:26:33.480516+0000 mon.a (mon.0) 10936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:34 smithi179 bash[23186]: cluster 2024-09-21T03:26:33.617225+0000 mgr.a (mgr.14388) 13508 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:34.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:34 smithi049 bash[23528]: audit 2024-09-21T03:26:33.460689+0000 mon.a (mon.0) 10934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:34 smithi049 bash[23528]: audit 2024-09-21T03:26:33.469781+0000 mon.a (mon.0) 10935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:34 smithi049 bash[23528]: audit 2024-09-21T03:26:33.480516+0000 mon.a (mon.0) 10936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:34.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:34 smithi049 bash[23528]: cluster 2024-09-21T03:26:33.617225+0000 mgr.a (mgr.14388) 13508 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:36.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:36.949 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:36 smithi044 bash[22676]: cluster 2024-09-21T03:26:35.619399+0000 mgr.a (mgr.14388) 13509 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:37.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:36 smithi179 bash[23186]: cluster 2024-09-21T03:26:35.619399+0000 mgr.a (mgr.14388) 13509 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:36 smithi049 bash[23528]: cluster 2024-09-21T03:26:35.619399+0000 mgr.a (mgr.14388) 13509 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:37.717 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:37.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:37.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:37.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:37.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:38 smithi044 bash[22676]: audit 2024-09-21T03:26:37.271949+0000 mgr.a (mgr.14388) 13510 : audit [DBG] from='client.294030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:38 smithi044 bash[22676]: cluster 2024-09-21T03:26:37.620337+0000 mgr.a (mgr.14388) 13511 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:38 smithi179 bash[23186]: audit 2024-09-21T03:26:37.271949+0000 mgr.a (mgr.14388) 13510 : audit [DBG] from='client.294030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:38 smithi179 bash[23186]: cluster 2024-09-21T03:26:37.620337+0000 mgr.a (mgr.14388) 13511 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:38 smithi049 bash[23528]: audit 2024-09-21T03:26:37.271949+0000 mgr.a (mgr.14388) 13510 : audit [DBG] from='client.294030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:38 smithi049 bash[23528]: cluster 2024-09-21T03:26:37.620337+0000 mgr.a (mgr.14388) 13511 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:40 smithi044 bash[22676]: cluster 2024-09-21T03:26:39.621053+0000 mgr.a (mgr.14388) 13512 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:41.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:40 smithi179 bash[23186]: cluster 2024-09-21T03:26:39.621053+0000 mgr.a (mgr.14388) 13512 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:40 smithi049 bash[23528]: cluster 2024-09-21T03:26:39.621053+0000 mgr.a (mgr.14388) 13512 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:42.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:42.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:42.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:42 smithi044 bash[22676]: cluster 2024-09-21T03:26:41.623244+0000 mgr.a (mgr.14388) 13513 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:43.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:42 smithi179 bash[23186]: cluster 2024-09-21T03:26:41.623244+0000 mgr.a (mgr.14388) 13513 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:42 smithi049 bash[23528]: cluster 2024-09-21T03:26:41.623244+0000 mgr.a (mgr.14388) 13513 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:43.513 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:43 smithi044 bash[22676]: audit 2024-09-21T03:26:43.054201+0000 mgr.a (mgr.14388) 13514 : audit [DBG] from='client.294108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:44.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:43 smithi179 bash[23186]: audit 2024-09-21T03:26:43.054201+0000 mgr.a (mgr.14388) 13514 : audit [DBG] from='client.294108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:43 smithi049 bash[23528]: audit 2024-09-21T03:26:43.054201+0000 mgr.a (mgr.14388) 13514 : audit [DBG] from='client.294108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:44 smithi044 bash[22676]: cluster 2024-09-21T03:26:43.624232+0000 mgr.a (mgr.14388) 13515 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:45.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:44 smithi179 bash[23186]: cluster 2024-09-21T03:26:43.624232+0000 mgr.a (mgr.14388) 13515 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:44 smithi049 bash[23528]: cluster 2024-09-21T03:26:43.624232+0000 mgr.a (mgr.14388) 13515 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:46 smithi049 bash[23528]: cluster 2024-09-21T03:26:45.625673+0000 mgr.a (mgr.14388) 13516 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:46 smithi049 bash[23528]: audit 2024-09-21T03:26:45.788817+0000 mon.a (mon.0) 10937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:46 smithi049 bash[23528]: audit 2024-09-21T03:26:45.797753+0000 mon.a (mon.0) 10938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:46 smithi049 bash[23528]: audit 2024-09-21T03:26:45.808531+0000 mon.a (mon.0) 10939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:46 smithi049 bash[23528]: audit 2024-09-21T03:26:46.132663+0000 mon.a (mon.0) 10940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:46 smithi049 bash[23528]: audit 2024-09-21T03:26:46.141322+0000 mon.a (mon.0) 10941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:46 smithi049 bash[23528]: audit 2024-09-21T03:26:46.151296+0000 mon.a (mon.0) 10942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:46 smithi044 bash[22676]: cluster 2024-09-21T03:26:45.625673+0000 mgr.a (mgr.14388) 13516 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:46 smithi044 bash[22676]: audit 2024-09-21T03:26:45.788817+0000 mon.a (mon.0) 10937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:46 smithi044 bash[22676]: audit 2024-09-21T03:26:45.797753+0000 mon.a (mon.0) 10938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:46 smithi044 bash[22676]: audit 2024-09-21T03:26:45.808531+0000 mon.a (mon.0) 10939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:46 smithi044 bash[22676]: audit 2024-09-21T03:26:46.132663+0000 mon.a (mon.0) 10940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:46 smithi044 bash[22676]: audit 2024-09-21T03:26:46.141322+0000 mon.a (mon.0) 10941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:46 smithi044 bash[22676]: audit 2024-09-21T03:26:46.151296+0000 mon.a (mon.0) 10942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:46 smithi179 bash[23186]: cluster 2024-09-21T03:26:45.625673+0000 mgr.a (mgr.14388) 13516 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:46 smithi179 bash[23186]: audit 2024-09-21T03:26:45.788817+0000 mon.a (mon.0) 10937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:46 smithi179 bash[23186]: audit 2024-09-21T03:26:45.797753+0000 mon.a (mon.0) 10938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:46 smithi179 bash[23186]: audit 2024-09-21T03:26:45.808531+0000 mon.a (mon.0) 10939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:46 smithi179 bash[23186]: audit 2024-09-21T03:26:46.132663+0000 mon.a (mon.0) 10940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:46 smithi179 bash[23186]: audit 2024-09-21T03:26:46.141322+0000 mon.a (mon.0) 10941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:46 smithi179 bash[23186]: audit 2024-09-21T03:26:46.151296+0000 mon.a (mon.0) 10942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:48.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:48.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:48.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:48 smithi049 bash[23528]: cluster 2024-09-21T03:26:47.626413+0000 mgr.a (mgr.14388) 13517 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:48 smithi044 bash[22676]: cluster 2024-09-21T03:26:47.626413+0000 mgr.a (mgr.14388) 13517 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:49.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:48 smithi179 bash[23186]: cluster 2024-09-21T03:26:47.626413+0000 mgr.a (mgr.14388) 13517 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:49.278 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:49.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:49.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:49.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:49.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:49 smithi049 bash[23528]: audit 2024-09-21T03:26:48.849266+0000 mgr.a (mgr.14388) 13518 : audit [DBG] from='client.294180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:50.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:49 smithi044 bash[22676]: audit 2024-09-21T03:26:48.849266+0000 mgr.a (mgr.14388) 13518 : audit [DBG] from='client.294180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:50.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:49 smithi179 bash[23186]: audit 2024-09-21T03:26:48.849266+0000 mgr.a (mgr.14388) 13518 : audit [DBG] from='client.294180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:50 smithi044 bash[22676]: cluster 2024-09-21T03:26:49.627311+0000 mgr.a (mgr.14388) 13519 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:51.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:50 smithi179 bash[23186]: cluster 2024-09-21T03:26:49.627311+0000 mgr.a (mgr.14388) 13519 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:50 smithi049 bash[23528]: cluster 2024-09-21T03:26:49.627311+0000 mgr.a (mgr.14388) 13519 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:52 smithi049 bash[23528]: cluster 2024-09-21T03:26:51.629579+0000 mgr.a (mgr.14388) 13520 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:52 smithi044 bash[22676]: cluster 2024-09-21T03:26:51.629579+0000 mgr.a (mgr.14388) 13520 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:53.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:52 smithi179 bash[23186]: cluster 2024-09-21T03:26:51.629579+0000 mgr.a (mgr.14388) 13520 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:26:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:26:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:26:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:54 smithi049 bash[23528]: cluster 2024-09-21T03:26:53.630332+0000 mgr.a (mgr.14388) 13521 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:54 smithi049 bash[23528]: audit 2024-09-21T03:26:53.696448+0000 mon.a (mon.0) 10943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:54 smithi049 bash[23528]: audit 2024-09-21T03:26:53.705329+0000 mon.a (mon.0) 10944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:54 smithi049 bash[23528]: audit 2024-09-21T03:26:53.715785+0000 mon.a (mon.0) 10945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:54 smithi044 bash[22676]: cluster 2024-09-21T03:26:53.630332+0000 mgr.a (mgr.14388) 13521 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:54 smithi044 bash[22676]: audit 2024-09-21T03:26:53.696448+0000 mon.a (mon.0) 10943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:54 smithi044 bash[22676]: audit 2024-09-21T03:26:53.705329+0000 mon.a (mon.0) 10944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:54 smithi044 bash[22676]: audit 2024-09-21T03:26:53.715785+0000 mon.a (mon.0) 10945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:54 smithi179 bash[23186]: cluster 2024-09-21T03:26:53.630332+0000 mgr.a (mgr.14388) 13521 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:54 smithi179 bash[23186]: audit 2024-09-21T03:26:53.696448+0000 mon.a (mon.0) 10943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:54 smithi179 bash[23186]: audit 2024-09-21T03:26:53.705329+0000 mon.a (mon.0) 10944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:55.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:54 smithi179 bash[23186]: audit 2024-09-21T03:26:53.715785+0000 mon.a (mon.0) 10945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:55.056 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:26:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:26:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:26:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:26:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:26:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:55 smithi044 bash[22676]: audit 2024-09-21T03:26:54.616520+0000 mgr.a (mgr.14388) 13522 : audit [DBG] from='client.294258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:56.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:55 smithi179 bash[23186]: audit 2024-09-21T03:26:54.616520+0000 mgr.a (mgr.14388) 13522 : audit [DBG] from='client.294258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:55 smithi049 bash[23528]: audit 2024-09-21T03:26:54.616520+0000 mgr.a (mgr.14388) 13522 : audit [DBG] from='client.294258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:56.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22930]: debug 2024-09-21T03:26:56.838+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22930]: debug 2024-09-21T03:26:56.838+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22676]: cluster 2024-09-21T03:26:55.631550+0000 mgr.a (mgr.14388) 13523 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22676]: audit 2024-09-21T03:26:56.059019+0000 mon.a (mon.0) 10946 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22676]: audit 2024-09-21T03:26:56.066000+0000 mon.a (mon.0) 10947 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22676]: audit 2024-09-21T03:26:56.067854+0000 mon.a (mon.0) 10948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22676]: audit 2024-09-21T03:26:56.079480+0000 mon.a (mon.0) 10949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22676]: audit 2024-09-21T03:26:56.085933+0000 mon.a (mon.0) 10950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:26:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:56 smithi044 bash[22676]: audit 2024-09-21T03:26:56.088327+0000 mgr.a (mgr.14388) 13524 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:56 smithi179 bash[23186]: cluster 2024-09-21T03:26:55.631550+0000 mgr.a (mgr.14388) 13523 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:56 smithi179 bash[23186]: audit 2024-09-21T03:26:56.059019+0000 mon.a (mon.0) 10946 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:56 smithi179 bash[23186]: audit 2024-09-21T03:26:56.066000+0000 mon.a (mon.0) 10947 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:56 smithi179 bash[23186]: audit 2024-09-21T03:26:56.067854+0000 mon.a (mon.0) 10948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:56 smithi179 bash[23186]: audit 2024-09-21T03:26:56.079480+0000 mon.a (mon.0) 10949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:56 smithi179 bash[23186]: audit 2024-09-21T03:26:56.085933+0000 mon.a (mon.0) 10950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:26:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:56 smithi179 bash[23186]: audit 2024-09-21T03:26:56.088327+0000 mgr.a (mgr.14388) 13524 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:26:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:56 smithi049 bash[23528]: cluster 2024-09-21T03:26:55.631550+0000 mgr.a (mgr.14388) 13523 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:26:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:56 smithi049 bash[23528]: audit 2024-09-21T03:26:56.059019+0000 mon.a (mon.0) 10946 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:26:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:56 smithi049 bash[23528]: audit 2024-09-21T03:26:56.066000+0000 mon.a (mon.0) 10947 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:26:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:56 smithi049 bash[23528]: audit 2024-09-21T03:26:56.067854+0000 mon.a (mon.0) 10948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:26:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:56 smithi049 bash[23528]: audit 2024-09-21T03:26:56.079480+0000 mon.a (mon.0) 10949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:26:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:56 smithi049 bash[23528]: audit 2024-09-21T03:26:56.085933+0000 mon.a (mon.0) 10950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:26:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:56 smithi049 bash[23528]: audit 2024-09-21T03:26:56.088327+0000 mgr.a (mgr.14388) 13524 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:26:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:57 smithi044 bash[22676]: audit 2024-09-21T03:26:56.843399+0000 mgr.a (mgr.14388) 13525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:26:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:57 smithi044 bash[22676]: cephadm 2024-09-21T03:26:56.844512+0000 mgr.a (mgr.14388) 13526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:26:58.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:57 smithi179 bash[23186]: audit 2024-09-21T03:26:56.843399+0000 mgr.a (mgr.14388) 13525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:26:58.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:57 smithi179 bash[23186]: cephadm 2024-09-21T03:26:56.844512+0000 mgr.a (mgr.14388) 13526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:26:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:57 smithi049 bash[23528]: audit 2024-09-21T03:26:56.843399+0000 mgr.a (mgr.14388) 13525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:26:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:57 smithi049 bash[23528]: cephadm 2024-09-21T03:26:56.844512+0000 mgr.a (mgr.14388) 13526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:26:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:26:58 smithi044 bash[22676]: cluster 2024-09-21T03:26:57.632472+0000 mgr.a (mgr.14388) 13527 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:59.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:26:58 smithi179 bash[23186]: cluster 2024-09-21T03:26:57.632472+0000 mgr.a (mgr.14388) 13527 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:26:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:26:58 smithi049 bash[23528]: cluster 2024-09-21T03:26:57.632472+0000 mgr.a (mgr.14388) 13527 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:00.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:00.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:00.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:00.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:00.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:00.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:00.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:00.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:00 smithi044 bash[22676]: cluster 2024-09-21T03:26:59.633168+0000 mgr.a (mgr.14388) 13528 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:01.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:00 smithi179 bash[23186]: cluster 2024-09-21T03:26:59.633168+0000 mgr.a (mgr.14388) 13528 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:00 smithi049 bash[23528]: cluster 2024-09-21T03:26:59.633168+0000 mgr.a (mgr.14388) 13528 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:01.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:01 smithi044 bash[22676]: audit 2024-09-21T03:27:00.395311+0000 mgr.a (mgr.14388) 13529 : audit [DBG] from='client.294438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:02.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:01 smithi179 bash[23186]: audit 2024-09-21T03:27:00.395311+0000 mgr.a (mgr.14388) 13529 : audit [DBG] from='client.294438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:01 smithi049 bash[23528]: audit 2024-09-21T03:27:00.395311+0000 mgr.a (mgr.14388) 13529 : audit [DBG] from='client.294438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:02 smithi044 bash[22676]: cluster 2024-09-21T03:27:01.635975+0000 mgr.a (mgr.14388) 13530 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:03.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:02 smithi179 bash[23186]: cluster 2024-09-21T03:27:01.635975+0000 mgr.a (mgr.14388) 13530 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:02 smithi049 bash[23528]: cluster 2024-09-21T03:27:01.635975+0000 mgr.a (mgr.14388) 13530 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:04.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:04 smithi044 bash[22676]: cluster 2024-09-21T03:27:03.636799+0000 mgr.a (mgr.14388) 13531 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:05.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:04 smithi179 bash[23186]: cluster 2024-09-21T03:27:03.636799+0000 mgr.a (mgr.14388) 13531 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:04 smithi049 bash[23528]: cluster 2024-09-21T03:27:03.636799+0000 mgr.a (mgr.14388) 13531 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:05.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:05.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:05.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:06.548 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:06.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: cluster 2024-09-21T03:27:05.638834+0000 mgr.a (mgr.14388) 13532 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: audit 2024-09-21T03:27:05.938261+0000 mon.a (mon.0) 10951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: audit 2024-09-21T03:27:05.942767+0000 mon.a (mon.0) 10952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: audit 2024-09-21T03:27:05.947607+0000 mon.a (mon.0) 10953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: audit 2024-09-21T03:27:06.131493+0000 mgr.a (mgr.14388) 13533 : audit [DBG] from='client.294510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: audit 2024-09-21T03:27:06.324536+0000 mon.a (mon.0) 10954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: audit 2024-09-21T03:27:06.329911+0000 mon.a (mon.0) 10955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:06 smithi044 bash[22676]: audit 2024-09-21T03:27:06.335080+0000 mon.a (mon.0) 10956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: cluster 2024-09-21T03:27:05.638834+0000 mgr.a (mgr.14388) 13532 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: audit 2024-09-21T03:27:05.938261+0000 mon.a (mon.0) 10951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: audit 2024-09-21T03:27:05.942767+0000 mon.a (mon.0) 10952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: audit 2024-09-21T03:27:05.947607+0000 mon.a (mon.0) 10953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: audit 2024-09-21T03:27:06.131493+0000 mgr.a (mgr.14388) 13533 : audit [DBG] from='client.294510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: audit 2024-09-21T03:27:06.324536+0000 mon.a (mon.0) 10954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: audit 2024-09-21T03:27:06.329911+0000 mon.a (mon.0) 10955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:06 smithi179 bash[23186]: audit 2024-09-21T03:27:06.335080+0000 mon.a (mon.0) 10956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: cluster 2024-09-21T03:27:05.638834+0000 mgr.a (mgr.14388) 13532 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: audit 2024-09-21T03:27:05.938261+0000 mon.a (mon.0) 10951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: audit 2024-09-21T03:27:05.942767+0000 mon.a (mon.0) 10952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: audit 2024-09-21T03:27:05.947607+0000 mon.a (mon.0) 10953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: audit 2024-09-21T03:27:06.131493+0000 mgr.a (mgr.14388) 13533 : audit [DBG] from='client.294510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: audit 2024-09-21T03:27:06.324536+0000 mon.a (mon.0) 10954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: audit 2024-09-21T03:27:06.329911+0000 mon.a (mon.0) 10955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:06 smithi049 bash[23528]: audit 2024-09-21T03:27:06.335080+0000 mon.a (mon.0) 10956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:08 smithi044 bash[22676]: cluster 2024-09-21T03:27:07.639719+0000 mgr.a (mgr.14388) 13534 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:09.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:08 smithi179 bash[23186]: cluster 2024-09-21T03:27:07.639719+0000 mgr.a (mgr.14388) 13534 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:08 smithi049 bash[23528]: cluster 2024-09-21T03:27:07.639719+0000 mgr.a (mgr.14388) 13534 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:10 smithi044 bash[22676]: cluster 2024-09-21T03:27:09.640520+0000 mgr.a (mgr.14388) 13535 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:11.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:10 smithi179 bash[23186]: cluster 2024-09-21T03:27:09.640520+0000 mgr.a (mgr.14388) 13535 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:10 smithi049 bash[23528]: cluster 2024-09-21T03:27:09.640520+0000 mgr.a (mgr.14388) 13535 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:27:11.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:11.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:11.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:12.345 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:12.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:12.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:12.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:12.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:12 smithi044 bash[22676]: cluster 2024-09-21T03:27:11.642700+0000 mgr.a (mgr.14388) 13536 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:12 smithi044 bash[22676]: audit 2024-09-21T03:27:11.890565+0000 mgr.a (mgr.14388) 13537 : audit [DBG] from='client.294588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:13.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:12 smithi179 bash[23186]: cluster 2024-09-21T03:27:11.642700+0000 mgr.a (mgr.14388) 13536 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:12 smithi179 bash[23186]: audit 2024-09-21T03:27:11.890565+0000 mgr.a (mgr.14388) 13537 : audit [DBG] from='client.294588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:12 smithi049 bash[23528]: cluster 2024-09-21T03:27:11.642700+0000 mgr.a (mgr.14388) 13536 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:27:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:12 smithi049 bash[23528]: audit 2024-09-21T03:27:11.890565+0000 mgr.a (mgr.14388) 13537 : audit [DBG] from='client.294588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:14 smithi044 bash[22676]: cluster 2024-09-21T03:27:13.643590+0000 mgr.a (mgr.14388) 13538 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:14 smithi044 bash[22676]: audit 2024-09-21T03:27:13.935057+0000 mon.a (mon.0) 10957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:14 smithi044 bash[22676]: audit 2024-09-21T03:27:13.943735+0000 mon.a (mon.0) 10958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:14 smithi044 bash[22676]: audit 2024-09-21T03:27:13.954346+0000 mon.a (mon.0) 10959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:14 smithi179 bash[23186]: cluster 2024-09-21T03:27:13.643590+0000 mgr.a (mgr.14388) 13538 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:14 smithi179 bash[23186]: audit 2024-09-21T03:27:13.935057+0000 mon.a (mon.0) 10957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:14 smithi179 bash[23186]: audit 2024-09-21T03:27:13.943735+0000 mon.a (mon.0) 10958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:14 smithi179 bash[23186]: audit 2024-09-21T03:27:13.954346+0000 mon.a (mon.0) 10959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:14 smithi049 bash[23528]: cluster 2024-09-21T03:27:13.643590+0000 mgr.a (mgr.14388) 13538 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:14 smithi049 bash[23528]: audit 2024-09-21T03:27:13.935057+0000 mon.a (mon.0) 10957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:14 smithi049 bash[23528]: audit 2024-09-21T03:27:13.943735+0000 mon.a (mon.0) 10958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:14 smithi049 bash[23528]: audit 2024-09-21T03:27:13.954346+0000 mon.a (mon.0) 10959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:17.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:16 smithi044 bash[22676]: cluster 2024-09-21T03:27:15.645721+0000 mgr.a (mgr.14388) 13539 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:17.252 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:16 smithi049 bash[23528]: cluster 2024-09-21T03:27:15.645721+0000 mgr.a (mgr.14388) 13539 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:17.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:16 smithi179 bash[23186]: cluster 2024-09-21T03:27:15.645721+0000 mgr.a (mgr.14388) 13539 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:18.132 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:18.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:18 smithi044 bash[22676]: cluster 2024-09-21T03:27:17.646437+0000 mgr.a (mgr.14388) 13540 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:18 smithi044 bash[22676]: audit 2024-09-21T03:27:17.674500+0000 mgr.a (mgr.14388) 13541 : audit [DBG] from='client.294663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:18 smithi179 bash[23186]: cluster 2024-09-21T03:27:17.646437+0000 mgr.a (mgr.14388) 13540 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:19.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:18 smithi179 bash[23186]: audit 2024-09-21T03:27:17.674500+0000 mgr.a (mgr.14388) 13541 : audit [DBG] from='client.294663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:18 smithi049 bash[23528]: cluster 2024-09-21T03:27:17.646437+0000 mgr.a (mgr.14388) 13540 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:18 smithi049 bash[23528]: audit 2024-09-21T03:27:17.674500+0000 mgr.a (mgr.14388) 13541 : audit [DBG] from='client.294663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:20 smithi044 bash[22676]: cluster 2024-09-21T03:27:19.647318+0000 mgr.a (mgr.14388) 13542 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:21.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:20 smithi179 bash[23186]: cluster 2024-09-21T03:27:19.647318+0000 mgr.a (mgr.14388) 13542 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:20 smithi049 bash[23528]: cluster 2024-09-21T03:27:19.647318+0000 mgr.a (mgr.14388) 13542 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:22 smithi044 bash[22676]: cluster 2024-09-21T03:27:21.649612+0000 mgr.a (mgr.14388) 13543 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:23.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:22 smithi179 bash[23186]: cluster 2024-09-21T03:27:21.649612+0000 mgr.a (mgr.14388) 13543 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:22 smithi049 bash[23528]: cluster 2024-09-21T03:27:21.649612+0000 mgr.a (mgr.14388) 13543 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:23.895 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:24 smithi044 bash[22676]: audit 2024-09-21T03:27:23.464557+0000 mgr.a (mgr.14388) 13544 : audit [DBG] from='client.294738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:24 smithi044 bash[22676]: cluster 2024-09-21T03:27:23.650157+0000 mgr.a (mgr.14388) 13545 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:25.252 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:24 smithi179 bash[23186]: audit 2024-09-21T03:27:23.464557+0000 mgr.a (mgr.14388) 13544 : audit [DBG] from='client.294738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:24 smithi179 bash[23186]: cluster 2024-09-21T03:27:23.650157+0000 mgr.a (mgr.14388) 13545 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:24 smithi049 bash[23528]: audit 2024-09-21T03:27:23.464557+0000 mgr.a (mgr.14388) 13544 : audit [DBG] from='client.294738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:24 smithi049 bash[23528]: cluster 2024-09-21T03:27:23.650157+0000 mgr.a (mgr.14388) 13545 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:27 smithi044 bash[22676]: cluster 2024-09-21T03:27:25.652393+0000 mgr.a (mgr.14388) 13546 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:27.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:27 smithi044 bash[22676]: audit 2024-09-21T03:27:26.169436+0000 mon.a (mon.0) 10960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:27 smithi044 bash[22676]: audit 2024-09-21T03:27:26.178088+0000 mon.a (mon.0) 10961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:27 smithi044 bash[22676]: audit 2024-09-21T03:27:26.188401+0000 mon.a (mon.0) 10962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:27 smithi044 bash[22676]: audit 2024-09-21T03:27:26.544687+0000 mon.a (mon.0) 10963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:27 smithi044 bash[22676]: audit 2024-09-21T03:27:26.553189+0000 mon.a (mon.0) 10964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.539 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:27 smithi044 bash[22676]: audit 2024-09-21T03:27:26.563135+0000 mon.a (mon.0) 10965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:27 smithi179 bash[23186]: cluster 2024-09-21T03:27:25.652393+0000 mgr.a (mgr.14388) 13546 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:27.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:27 smithi179 bash[23186]: audit 2024-09-21T03:27:26.169436+0000 mon.a (mon.0) 10960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:27 smithi179 bash[23186]: audit 2024-09-21T03:27:26.178088+0000 mon.a (mon.0) 10961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:27 smithi179 bash[23186]: audit 2024-09-21T03:27:26.188401+0000 mon.a (mon.0) 10962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:27 smithi179 bash[23186]: audit 2024-09-21T03:27:26.544687+0000 mon.a (mon.0) 10963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:27 smithi179 bash[23186]: audit 2024-09-21T03:27:26.553189+0000 mon.a (mon.0) 10964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:27 smithi179 bash[23186]: audit 2024-09-21T03:27:26.563135+0000 mon.a (mon.0) 10965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:27 smithi049 bash[23528]: cluster 2024-09-21T03:27:25.652393+0000 mgr.a (mgr.14388) 13546 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:27 smithi049 bash[23528]: audit 2024-09-21T03:27:26.169436+0000 mon.a (mon.0) 10960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:27 smithi049 bash[23528]: audit 2024-09-21T03:27:26.178088+0000 mon.a (mon.0) 10961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:27 smithi049 bash[23528]: audit 2024-09-21T03:27:26.188401+0000 mon.a (mon.0) 10962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:27 smithi049 bash[23528]: audit 2024-09-21T03:27:26.544687+0000 mon.a (mon.0) 10963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:27 smithi049 bash[23528]: audit 2024-09-21T03:27:26.553189+0000 mon.a (mon.0) 10964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:27.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:27 smithi049 bash[23528]: audit 2024-09-21T03:27:26.563135+0000 mon.a (mon.0) 10965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:28.897 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:28.897 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:29 smithi044 bash[22676]: cluster 2024-09-21T03:27:27.653183+0000 mgr.a (mgr.14388) 13547 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:29.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:29 smithi179 bash[23186]: cluster 2024-09-21T03:27:27.653183+0000 mgr.a (mgr.14388) 13547 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:29 smithi049 bash[23528]: cluster 2024-09-21T03:27:27.653183+0000 mgr.a (mgr.14388) 13547 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:29.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:30 smithi049 bash[23528]: audit 2024-09-21T03:27:29.237215+0000 mgr.a (mgr.14388) 13548 : audit [DBG] from='client.294816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:30 smithi049 bash[23528]: cluster 2024-09-21T03:27:29.653785+0000 mgr.a (mgr.14388) 13549 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:30 smithi044 bash[22676]: audit 2024-09-21T03:27:29.237215+0000 mgr.a (mgr.14388) 13548 : audit [DBG] from='client.294816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:30 smithi044 bash[22676]: cluster 2024-09-21T03:27:29.653785+0000 mgr.a (mgr.14388) 13549 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:31.002 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:30 smithi179 bash[23186]: audit 2024-09-21T03:27:29.237215+0000 mgr.a (mgr.14388) 13548 : audit [DBG] from='client.294816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:30 smithi179 bash[23186]: cluster 2024-09-21T03:27:29.653785+0000 mgr.a (mgr.14388) 13549 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:32 smithi049 bash[23528]: cluster 2024-09-21T03:27:31.655994+0000 mgr.a (mgr.14388) 13550 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:32.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:32 smithi044 bash[22676]: cluster 2024-09-21T03:27:31.655994+0000 mgr.a (mgr.14388) 13550 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:33.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:32 smithi179 bash[23186]: cluster 2024-09-21T03:27:31.655994+0000 mgr.a (mgr.14388) 13550 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:34.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:34.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:34.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:35.435 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:35 smithi044 bash[22676]: cluster 2024-09-21T03:27:33.656759+0000 mgr.a (mgr.14388) 13551 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:35 smithi044 bash[22676]: audit 2024-09-21T03:27:34.145919+0000 mon.a (mon.0) 10966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:35 smithi044 bash[22676]: audit 2024-09-21T03:27:34.154763+0000 mon.a (mon.0) 10967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:35 smithi044 bash[22676]: audit 2024-09-21T03:27:34.165025+0000 mon.a (mon.0) 10968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:35 smithi179 bash[23186]: cluster 2024-09-21T03:27:33.656759+0000 mgr.a (mgr.14388) 13551 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:35 smithi179 bash[23186]: audit 2024-09-21T03:27:34.145919+0000 mon.a (mon.0) 10966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:35 smithi179 bash[23186]: audit 2024-09-21T03:27:34.154763+0000 mon.a (mon.0) 10967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:35 smithi179 bash[23186]: audit 2024-09-21T03:27:34.165025+0000 mon.a (mon.0) 10968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:35 smithi049 bash[23528]: cluster 2024-09-21T03:27:33.656759+0000 mgr.a (mgr.14388) 13551 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:35 smithi049 bash[23528]: audit 2024-09-21T03:27:34.145919+0000 mon.a (mon.0) 10966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:35 smithi049 bash[23528]: audit 2024-09-21T03:27:34.154763+0000 mon.a (mon.0) 10967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:35 smithi049 bash[23528]: audit 2024-09-21T03:27:34.165025+0000 mon.a (mon.0) 10968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:36.471 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:36 smithi049 bash[23528]: audit 2024-09-21T03:27:35.022276+0000 mgr.a (mgr.14388) 13552 : audit [DBG] from='client.294891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:36.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:36 smithi044 bash[22676]: audit 2024-09-21T03:27:35.022276+0000 mgr.a (mgr.14388) 13552 : audit [DBG] from='client.294891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:36.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:36 smithi179 bash[23186]: audit 2024-09-21T03:27:35.022276+0000 mgr.a (mgr.14388) 13552 : audit [DBG] from='client.294891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:37.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:37 smithi044 bash[22676]: cluster 2024-09-21T03:27:35.659642+0000 mgr.a (mgr.14388) 13553 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:37 smithi179 bash[23186]: cluster 2024-09-21T03:27:35.659642+0000 mgr.a (mgr.14388) 13553 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:37 smithi049 bash[23528]: cluster 2024-09-21T03:27:35.659642+0000 mgr.a (mgr.14388) 13553 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:39.451 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:39 smithi179 bash[23186]: cluster 2024-09-21T03:27:37.660492+0000 mgr.a (mgr.14388) 13554 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:27:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:39 smithi044 bash[22676]: cluster 2024-09-21T03:27:37.660492+0000 mgr.a (mgr.14388) 13554 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:27:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:39 smithi049 bash[23528]: cluster 2024-09-21T03:27:37.660492+0000 mgr.a (mgr.14388) 13554 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:27:40.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:40.437 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:40.437 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:41.223 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:41.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:41.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:41.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:41.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:41 smithi044 bash[22676]: cluster 2024-09-21T03:27:39.661050+0000 mgr.a (mgr.14388) 13555 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:27:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:41 smithi179 bash[23186]: cluster 2024-09-21T03:27:39.661050+0000 mgr.a (mgr.14388) 13555 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:27:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:41 smithi049 bash[23528]: cluster 2024-09-21T03:27:39.661050+0000 mgr.a (mgr.14388) 13555 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:27:42.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:42 smithi044 bash[22676]: audit 2024-09-21T03:27:40.779042+0000 mgr.a (mgr.14388) 13556 : audit [DBG] from='client.294966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:42.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:42 smithi179 bash[23186]: audit 2024-09-21T03:27:40.779042+0000 mgr.a (mgr.14388) 13556 : audit [DBG] from='client.294966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:42 smithi049 bash[23528]: audit 2024-09-21T03:27:40.779042+0000 mgr.a (mgr.14388) 13556 : audit [DBG] from='client.294966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:43 smithi044 bash[22676]: cluster 2024-09-21T03:27:41.663959+0000 mgr.a (mgr.14388) 13557 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:43 smithi179 bash[23186]: cluster 2024-09-21T03:27:41.663959+0000 mgr.a (mgr.14388) 13557 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:43 smithi049 bash[23528]: cluster 2024-09-21T03:27:41.663959+0000 mgr.a (mgr.14388) 13557 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:45 smithi044 bash[22676]: cluster 2024-09-21T03:27:43.664751+0000 mgr.a (mgr.14388) 13558 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:27:45.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:45 smithi179 bash[23186]: cluster 2024-09-21T03:27:43.664751+0000 mgr.a (mgr.14388) 13558 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:27:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:45 smithi049 bash[23528]: cluster 2024-09-21T03:27:43.664751+0000 mgr.a (mgr.14388) 13558 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:27:46.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:46.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:46.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:46.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:46.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:46.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:46.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:46.981 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:47 smithi044 bash[22676]: cluster 2024-09-21T03:27:45.666813+0000 mgr.a (mgr.14388) 13559 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:47 smithi044 bash[22676]: audit 2024-09-21T03:27:46.345319+0000 mon.a (mon.0) 10969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:47 smithi044 bash[22676]: audit 2024-09-21T03:27:46.349931+0000 mon.a (mon.0) 10970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:47 smithi044 bash[22676]: audit 2024-09-21T03:27:46.354903+0000 mon.a (mon.0) 10971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:47 smithi044 bash[22676]: audit 2024-09-21T03:27:46.756146+0000 mon.a (mon.0) 10972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:47 smithi044 bash[22676]: audit 2024-09-21T03:27:46.762356+0000 mon.a (mon.0) 10973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:47 smithi044 bash[22676]: audit 2024-09-21T03:27:46.768115+0000 mon.a (mon.0) 10974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:47 smithi179 bash[23186]: cluster 2024-09-21T03:27:45.666813+0000 mgr.a (mgr.14388) 13559 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:47 smithi179 bash[23186]: audit 2024-09-21T03:27:46.345319+0000 mon.a (mon.0) 10969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:47 smithi179 bash[23186]: audit 2024-09-21T03:27:46.349931+0000 mon.a (mon.0) 10970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:47 smithi179 bash[23186]: audit 2024-09-21T03:27:46.354903+0000 mon.a (mon.0) 10971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:47 smithi179 bash[23186]: audit 2024-09-21T03:27:46.756146+0000 mon.a (mon.0) 10972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:47 smithi179 bash[23186]: audit 2024-09-21T03:27:46.762356+0000 mon.a (mon.0) 10973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:47 smithi179 bash[23186]: audit 2024-09-21T03:27:46.768115+0000 mon.a (mon.0) 10974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:47 smithi049 bash[23528]: cluster 2024-09-21T03:27:45.666813+0000 mgr.a (mgr.14388) 13559 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:47 smithi049 bash[23528]: audit 2024-09-21T03:27:46.345319+0000 mon.a (mon.0) 10969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:47 smithi049 bash[23528]: audit 2024-09-21T03:27:46.349931+0000 mon.a (mon.0) 10970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:47 smithi049 bash[23528]: audit 2024-09-21T03:27:46.354903+0000 mon.a (mon.0) 10971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:47 smithi049 bash[23528]: audit 2024-09-21T03:27:46.756146+0000 mon.a (mon.0) 10972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:47 smithi049 bash[23528]: audit 2024-09-21T03:27:46.762356+0000 mon.a (mon.0) 10973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:47.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:47 smithi049 bash[23528]: audit 2024-09-21T03:27:46.768115+0000 mon.a (mon.0) 10974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:48 smithi044 bash[22676]: audit 2024-09-21T03:27:46.554067+0000 mgr.a (mgr.14388) 13560 : audit [DBG] from='client.295041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:48.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:48 smithi179 bash[23186]: audit 2024-09-21T03:27:46.554067+0000 mgr.a (mgr.14388) 13560 : audit [DBG] from='client.295041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:48 smithi049 bash[23528]: audit 2024-09-21T03:27:46.554067+0000 mgr.a (mgr.14388) 13560 : audit [DBG] from='client.295041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:49 smithi044 bash[22676]: cluster 2024-09-21T03:27:47.667793+0000 mgr.a (mgr.14388) 13561 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:49 smithi179 bash[23186]: cluster 2024-09-21T03:27:47.667793+0000 mgr.a (mgr.14388) 13561 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:49 smithi049 bash[23528]: cluster 2024-09-21T03:27:47.667793+0000 mgr.a (mgr.14388) 13561 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:51 smithi044 bash[22676]: cluster 2024-09-21T03:27:49.668579+0000 mgr.a (mgr.14388) 13562 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:51 smithi179 bash[23186]: cluster 2024-09-21T03:27:49.668579+0000 mgr.a (mgr.14388) 13562 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:51 smithi049 bash[23528]: cluster 2024-09-21T03:27:49.668579+0000 mgr.a (mgr.14388) 13562 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:51.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:51.983 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:52.731 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:52.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:52.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:52.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:52.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:53 smithi049 bash[23528]: cluster 2024-09-21T03:27:51.671042+0000 mgr.a (mgr.14388) 13563 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:53 smithi044 bash[22676]: cluster 2024-09-21T03:27:51.671042+0000 mgr.a (mgr.14388) 13563 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:53 smithi179 bash[23186]: cluster 2024-09-21T03:27:51.671042+0000 mgr.a (mgr.14388) 13563 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:54.451 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:54 smithi049 bash[23528]: audit 2024-09-21T03:27:52.313528+0000 mgr.a (mgr.14388) 13564 : audit [DBG] from='client.295119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:54 smithi044 bash[22676]: audit 2024-09-21T03:27:52.313528+0000 mgr.a (mgr.14388) 13564 : audit [DBG] from='client.295119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:54.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:54 smithi179 bash[23186]: audit 2024-09-21T03:27:52.313528+0000 mgr.a (mgr.14388) 13564 : audit [DBG] from='client.295119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:55 smithi044 bash[22676]: cluster 2024-09-21T03:27:53.672054+0000 mgr.a (mgr.14388) 13565 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:55 smithi044 bash[22676]: audit 2024-09-21T03:27:54.312415+0000 mon.a (mon.0) 10975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:55 smithi044 bash[22676]: audit 2024-09-21T03:27:54.321016+0000 mon.a (mon.0) 10976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:55 smithi044 bash[22676]: audit 2024-09-21T03:27:54.331480+0000 mon.a (mon.0) 10977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:55 smithi179 bash[23186]: cluster 2024-09-21T03:27:53.672054+0000 mgr.a (mgr.14388) 13565 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:55 smithi179 bash[23186]: audit 2024-09-21T03:27:54.312415+0000 mon.a (mon.0) 10975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:55 smithi179 bash[23186]: audit 2024-09-21T03:27:54.321016+0000 mon.a (mon.0) 10976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:55 smithi179 bash[23186]: audit 2024-09-21T03:27:54.331480+0000 mon.a (mon.0) 10977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:55 smithi049 bash[23528]: cluster 2024-09-21T03:27:53.672054+0000 mgr.a (mgr.14388) 13565 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:55 smithi049 bash[23528]: audit 2024-09-21T03:27:54.312415+0000 mon.a (mon.0) 10975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:55 smithi049 bash[23528]: audit 2024-09-21T03:27:54.321016+0000 mon.a (mon.0) 10976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:55 smithi049 bash[23528]: audit 2024-09-21T03:27:54.331480+0000 mon.a (mon.0) 10977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22676]: cluster 2024-09-21T03:27:55.674306+0000 mgr.a (mgr.14388) 13566 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22676]: audit 2024-09-21T03:27:56.894107+0000 mon.a (mon.0) 10978 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:27:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22676]: audit 2024-09-21T03:27:56.900461+0000 mon.a (mon.0) 10979 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:27:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22676]: audit 2024-09-21T03:27:56.902465+0000 mon.a (mon.0) 10980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:27:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22676]: audit 2024-09-21T03:27:56.913578+0000 mon.a (mon.0) 10981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22676]: audit 2024-09-21T03:27:56.919813+0000 mon.a (mon.0) 10982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:27:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:57 smithi179 bash[23186]: cluster 2024-09-21T03:27:55.674306+0000 mgr.a (mgr.14388) 13566 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:57 smithi179 bash[23186]: audit 2024-09-21T03:27:56.894107+0000 mon.a (mon.0) 10978 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:27:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:57 smithi179 bash[23186]: audit 2024-09-21T03:27:56.900461+0000 mon.a (mon.0) 10979 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:27:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:57 smithi179 bash[23186]: audit 2024-09-21T03:27:56.902465+0000 mon.a (mon.0) 10980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:27:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:57 smithi179 bash[23186]: audit 2024-09-21T03:27:56.913578+0000 mon.a (mon.0) 10981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:57 smithi179 bash[23186]: audit 2024-09-21T03:27:56.919813+0000 mon.a (mon.0) 10982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:27:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:57 smithi049 bash[23528]: cluster 2024-09-21T03:27:55.674306+0000 mgr.a (mgr.14388) 13566 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:27:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:57 smithi049 bash[23528]: audit 2024-09-21T03:27:56.894107+0000 mon.a (mon.0) 10978 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:27:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:57 smithi049 bash[23528]: audit 2024-09-21T03:27:56.900461+0000 mon.a (mon.0) 10979 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:27:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:57 smithi049 bash[23528]: audit 2024-09-21T03:27:56.902465+0000 mon.a (mon.0) 10980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:27:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:57 smithi049 bash[23528]: audit 2024-09-21T03:27:56.913578+0000 mon.a (mon.0) 10981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:27:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:57 smithi049 bash[23528]: audit 2024-09-21T03:27:56.919813+0000 mon.a (mon.0) 10982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:27:57.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:27:57.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:27:57.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:27:57.829 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22930]: debug 2024-09-21T03:27:57.701+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:27:57.829 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:27:57 smithi044 bash[22930]: debug 2024-09-21T03:27:57.701+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:27:58.465 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:27:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:27:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:27:58.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:27:58.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:27:58.546 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:58 smithi044 bash[22676]: audit 2024-09-21T03:27:56.922244+0000 mgr.a (mgr.14388) 13567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:27:58.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:58 smithi179 bash[23186]: audit 2024-09-21T03:27:56.922244+0000 mgr.a (mgr.14388) 13567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:27:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:58 smithi049 bash[23528]: audit 2024-09-21T03:27:56.922244+0000 mgr.a (mgr.14388) 13567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:27:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:59 smithi044 bash[22676]: cluster 2024-09-21T03:27:57.674867+0000 mgr.a (mgr.14388) 13568 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:59 smithi044 bash[22676]: audit 2024-09-21T03:27:57.705273+0000 mgr.a (mgr.14388) 13569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:27:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:59 smithi044 bash[22676]: cephadm 2024-09-21T03:27:57.706396+0000 mgr.a (mgr.14388) 13570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:27:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:27:59 smithi044 bash[22676]: audit 2024-09-21T03:27:58.039500+0000 mgr.a (mgr.14388) 13571 : audit [DBG] from='client.295305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:59.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:59 smithi179 bash[23186]: cluster 2024-09-21T03:27:57.674867+0000 mgr.a (mgr.14388) 13568 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:59.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:59 smithi179 bash[23186]: audit 2024-09-21T03:27:57.705273+0000 mgr.a (mgr.14388) 13569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:27:59.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:59 smithi179 bash[23186]: cephadm 2024-09-21T03:27:57.706396+0000 mgr.a (mgr.14388) 13570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:27:59.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:27:59 smithi179 bash[23186]: audit 2024-09-21T03:27:58.039500+0000 mgr.a (mgr.14388) 13571 : audit [DBG] from='client.295305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:59 smithi049 bash[23528]: cluster 2024-09-21T03:27:57.674867+0000 mgr.a (mgr.14388) 13568 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:27:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:59 smithi049 bash[23528]: audit 2024-09-21T03:27:57.705273+0000 mgr.a (mgr.14388) 13569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:27:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:59 smithi049 bash[23528]: cephadm 2024-09-21T03:27:57.706396+0000 mgr.a (mgr.14388) 13570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:27:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:27:59 smithi049 bash[23528]: audit 2024-09-21T03:27:58.039500+0000 mgr.a (mgr.14388) 13571 : audit [DBG] from='client.295305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:01 smithi044 bash[22676]: cluster 2024-09-21T03:27:59.675483+0000 mgr.a (mgr.14388) 13572 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:01.502 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:01 smithi179 bash[23186]: cluster 2024-09-21T03:27:59.675483+0000 mgr.a (mgr.14388) 13572 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:01 smithi049 bash[23528]: cluster 2024-09-21T03:27:59.675483+0000 mgr.a (mgr.14388) 13572 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:03.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:03.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:03 smithi179 bash[23186]: cluster 2024-09-21T03:28:01.677710+0000 mgr.a (mgr.14388) 13573 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:03 smithi049 bash[23528]: cluster 2024-09-21T03:28:01.677710+0000 mgr.a (mgr.14388) 13573 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:03 smithi044 bash[22676]: cluster 2024-09-21T03:28:01.677710+0000 mgr.a (mgr.14388) 13573 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:04.251 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:04.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:04.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:04.251 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:04.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:05 smithi179 bash[23186]: cluster 2024-09-21T03:28:03.678460+0000 mgr.a (mgr.14388) 13574 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:05 smithi179 bash[23186]: audit 2024-09-21T03:28:03.800654+0000 mgr.a (mgr.14388) 13575 : audit [DBG] from='client.295383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:05 smithi049 bash[23528]: cluster 2024-09-21T03:28:03.678460+0000 mgr.a (mgr.14388) 13574 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:05 smithi049 bash[23528]: audit 2024-09-21T03:28:03.800654+0000 mgr.a (mgr.14388) 13575 : audit [DBG] from='client.295383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:05 smithi044 bash[22676]: cluster 2024-09-21T03:28:03.678460+0000 mgr.a (mgr.14388) 13574 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:05 smithi044 bash[22676]: audit 2024-09-21T03:28:03.800654+0000 mgr.a (mgr.14388) 13575 : audit [DBG] from='client.295383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:06 smithi179 bash[23186]: cluster 2024-09-21T03:28:05.680806+0000 mgr.a (mgr.14388) 13576 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:06 smithi049 bash[23528]: cluster 2024-09-21T03:28:05.680806+0000 mgr.a (mgr.14388) 13576 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:06.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:06 smithi044 bash[22676]: cluster 2024-09-21T03:28:05.680806+0000 mgr.a (mgr.14388) 13576 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:07 smithi044 bash[22676]: audit 2024-09-21T03:28:06.561029+0000 mon.a (mon.0) 10983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:07.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:07 smithi044 bash[22676]: audit 2024-09-21T03:28:06.569712+0000 mon.a (mon.0) 10984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:07 smithi044 bash[22676]: audit 2024-09-21T03:28:06.581326+0000 mon.a (mon.0) 10985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:07 smithi044 bash[22676]: audit 2024-09-21T03:28:06.978748+0000 mon.a (mon.0) 10986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:07 smithi044 bash[22676]: audit 2024-09-21T03:28:06.988497+0000 mon.a (mon.0) 10987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:07 smithi044 bash[22676]: audit 2024-09-21T03:28:07.002751+0000 mon.a (mon.0) 10988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:07 smithi179 bash[23186]: audit 2024-09-21T03:28:06.561029+0000 mon.a (mon.0) 10983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:07 smithi179 bash[23186]: audit 2024-09-21T03:28:06.569712+0000 mon.a (mon.0) 10984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:07 smithi179 bash[23186]: audit 2024-09-21T03:28:06.581326+0000 mon.a (mon.0) 10985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:07 smithi179 bash[23186]: audit 2024-09-21T03:28:06.978748+0000 mon.a (mon.0) 10986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:07 smithi179 bash[23186]: audit 2024-09-21T03:28:06.988497+0000 mon.a (mon.0) 10987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:07 smithi179 bash[23186]: audit 2024-09-21T03:28:07.002751+0000 mon.a (mon.0) 10988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:07 smithi049 bash[23528]: audit 2024-09-21T03:28:06.561029+0000 mon.a (mon.0) 10983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:07 smithi049 bash[23528]: audit 2024-09-21T03:28:06.569712+0000 mon.a (mon.0) 10984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:07 smithi049 bash[23528]: audit 2024-09-21T03:28:06.581326+0000 mon.a (mon.0) 10985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:07 smithi049 bash[23528]: audit 2024-09-21T03:28:06.978748+0000 mon.a (mon.0) 10986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:07 smithi049 bash[23528]: audit 2024-09-21T03:28:06.988497+0000 mon.a (mon.0) 10987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:07 smithi049 bash[23528]: audit 2024-09-21T03:28:07.002751+0000 mon.a (mon.0) 10988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:08.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:08 smithi044 bash[22676]: cluster 2024-09-21T03:28:07.681793+0000 mgr.a (mgr.14388) 13577 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:09.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:08 smithi179 bash[23186]: cluster 2024-09-21T03:28:07.681793+0000 mgr.a (mgr.14388) 13577 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:08 smithi049 bash[23528]: cluster 2024-09-21T03:28:07.681793+0000 mgr.a (mgr.14388) 13577 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:09.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:09.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:09.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:10.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:10.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:10.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:10.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:10.013 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:10 smithi179 bash[23186]: audit 2024-09-21T03:28:09.582045+0000 mgr.a (mgr.14388) 13578 : audit [DBG] from='client.295461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:11.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:10 smithi179 bash[23186]: cluster 2024-09-21T03:28:09.682350+0000 mgr.a (mgr.14388) 13579 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:10 smithi049 bash[23528]: audit 2024-09-21T03:28:09.582045+0000 mgr.a (mgr.14388) 13578 : audit [DBG] from='client.295461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:10 smithi049 bash[23528]: cluster 2024-09-21T03:28:09.682350+0000 mgr.a (mgr.14388) 13579 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:10 smithi044 bash[22676]: audit 2024-09-21T03:28:09.582045+0000 mgr.a (mgr.14388) 13578 : audit [DBG] from='client.295461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:10 smithi044 bash[22676]: cluster 2024-09-21T03:28:09.682350+0000 mgr.a (mgr.14388) 13579 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:13.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:12 smithi179 bash[23186]: cluster 2024-09-21T03:28:11.684682+0000 mgr.a (mgr.14388) 13580 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:12 smithi049 bash[23528]: cluster 2024-09-21T03:28:11.684682+0000 mgr.a (mgr.14388) 13580 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:12 smithi044 bash[22676]: cluster 2024-09-21T03:28:11.684682+0000 mgr.a (mgr.14388) 13580 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:28:14.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:14 smithi049 bash[23528]: cluster 2024-09-21T03:28:13.685500+0000 mgr.a (mgr.14388) 13581 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:14.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:14 smithi049 bash[23528]: audit 2024-09-21T03:28:14.551608+0000 mon.a (mon.0) 10989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:14.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:14 smithi049 bash[23528]: audit 2024-09-21T03:28:14.560428+0000 mon.a (mon.0) 10990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:14.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:14 smithi049 bash[23528]: audit 2024-09-21T03:28:14.571115+0000 mon.a (mon.0) 10991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:14 smithi179 bash[23186]: cluster 2024-09-21T03:28:13.685500+0000 mgr.a (mgr.14388) 13581 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:14 smithi179 bash[23186]: audit 2024-09-21T03:28:14.551608+0000 mon.a (mon.0) 10989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:14 smithi179 bash[23186]: audit 2024-09-21T03:28:14.560428+0000 mon.a (mon.0) 10990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:15.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:14 smithi179 bash[23186]: audit 2024-09-21T03:28:14.571115+0000 mon.a (mon.0) 10991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:15.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:15.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:15.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:14 smithi044 bash[22676]: cluster 2024-09-21T03:28:13.685500+0000 mgr.a (mgr.14388) 13581 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:14 smithi044 bash[22676]: audit 2024-09-21T03:28:14.551608+0000 mon.a (mon.0) 10989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:14 smithi044 bash[22676]: audit 2024-09-21T03:28:14.560428+0000 mon.a (mon.0) 10990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:14 smithi044 bash[22676]: audit 2024-09-21T03:28:14.571115+0000 mon.a (mon.0) 10991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:15.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:16 smithi179 bash[23186]: audit 2024-09-21T03:28:15.346166+0000 mgr.a (mgr.14388) 13582 : audit [DBG] from='client.295536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:17.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:16 smithi179 bash[23186]: cluster 2024-09-21T03:28:15.686813+0000 mgr.a (mgr.14388) 13583 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:16 smithi049 bash[23528]: audit 2024-09-21T03:28:15.346166+0000 mgr.a (mgr.14388) 13582 : audit [DBG] from='client.295536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:16 smithi049 bash[23528]: cluster 2024-09-21T03:28:15.686813+0000 mgr.a (mgr.14388) 13583 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:16 smithi044 bash[22676]: audit 2024-09-21T03:28:15.346166+0000 mgr.a (mgr.14388) 13582 : audit [DBG] from='client.295536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:16 smithi044 bash[22676]: cluster 2024-09-21T03:28:15.686813+0000 mgr.a (mgr.14388) 13583 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:18 smithi049 bash[23528]: cluster 2024-09-21T03:28:17.687573+0000 mgr.a (mgr.14388) 13584 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:28:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:18 smithi044 bash[22676]: cluster 2024-09-21T03:28:17.687573+0000 mgr.a (mgr.14388) 13584 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:28:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:18 smithi179 bash[23186]: cluster 2024-09-21T03:28:17.687573+0000 mgr.a (mgr.14388) 13584 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:28:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:20.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:20.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:21.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:20 smithi179 bash[23186]: cluster 2024-09-21T03:28:19.688522+0000 mgr.a (mgr.14388) 13585 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:28:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:20 smithi049 bash[23528]: cluster 2024-09-21T03:28:19.688522+0000 mgr.a (mgr.14388) 13585 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:28:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:20 smithi044 bash[22676]: cluster 2024-09-21T03:28:19.688522+0000 mgr.a (mgr.14388) 13585 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:28:21.560 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:21.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:21.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:21.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:21.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:21 smithi179 bash[23186]: audit 2024-09-21T03:28:21.123877+0000 mgr.a (mgr.14388) 13586 : audit [DBG] from='client.295611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:21 smithi049 bash[23528]: audit 2024-09-21T03:28:21.123877+0000 mgr.a (mgr.14388) 13586 : audit [DBG] from='client.295611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:22.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:21 smithi044 bash[22676]: audit 2024-09-21T03:28:21.123877+0000 mgr.a (mgr.14388) 13586 : audit [DBG] from='client.295611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:22 smithi049 bash[23528]: cluster 2024-09-21T03:28:21.691592+0000 mgr.a (mgr.14388) 13587 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:22 smithi044 bash[22676]: cluster 2024-09-21T03:28:21.691592+0000 mgr.a (mgr.14388) 13587 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:23.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:22 smithi179 bash[23186]: cluster 2024-09-21T03:28:21.691592+0000 mgr.a (mgr.14388) 13587 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:24 smithi049 bash[23528]: cluster 2024-09-21T03:28:23.692609+0000 mgr.a (mgr.14388) 13588 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:24 smithi044 bash[22676]: cluster 2024-09-21T03:28:23.692609+0000 mgr.a (mgr.14388) 13588 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:24 smithi179 bash[23186]: cluster 2024-09-21T03:28:23.692609+0000 mgr.a (mgr.14388) 13588 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:26.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:26.562 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:26.562 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:26 smithi179 bash[23186]: cluster 2024-09-21T03:28:25.694748+0000 mgr.a (mgr.14388) 13589 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:26 smithi179 bash[23186]: audit 2024-09-21T03:28:26.736144+0000 mon.a (mon.0) 10992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:26 smithi179 bash[23186]: audit 2024-09-21T03:28:26.742791+0000 mon.a (mon.0) 10993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:26 smithi179 bash[23186]: audit 2024-09-21T03:28:26.750481+0000 mon.a (mon.0) 10994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:26 smithi049 bash[23528]: cluster 2024-09-21T03:28:25.694748+0000 mgr.a (mgr.14388) 13589 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:26 smithi049 bash[23528]: audit 2024-09-21T03:28:26.736144+0000 mon.a (mon.0) 10992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:26 smithi049 bash[23528]: audit 2024-09-21T03:28:26.742791+0000 mon.a (mon.0) 10993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:26 smithi049 bash[23528]: audit 2024-09-21T03:28:26.750481+0000 mon.a (mon.0) 10994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:26 smithi044 bash[22676]: cluster 2024-09-21T03:28:25.694748+0000 mgr.a (mgr.14388) 13589 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:26 smithi044 bash[22676]: audit 2024-09-21T03:28:26.736144+0000 mon.a (mon.0) 10992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:26 smithi044 bash[22676]: audit 2024-09-21T03:28:26.742791+0000 mon.a (mon.0) 10993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:26 smithi044 bash[22676]: audit 2024-09-21T03:28:26.750481+0000 mon.a (mon.0) 10994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:27.346 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:27.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:27.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:27.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:27.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:28 smithi044 bash[22676]: audit 2024-09-21T03:28:26.915185+0000 mgr.a (mgr.14388) 13590 : audit [DBG] from='client.295689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:28 smithi044 bash[22676]: audit 2024-09-21T03:28:27.195358+0000 mon.a (mon.0) 10995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:28 smithi044 bash[22676]: audit 2024-09-21T03:28:27.201043+0000 mon.a (mon.0) 10996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:28 smithi044 bash[22676]: audit 2024-09-21T03:28:27.206222+0000 mon.a (mon.0) 10997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:28 smithi179 bash[23186]: audit 2024-09-21T03:28:26.915185+0000 mgr.a (mgr.14388) 13590 : audit [DBG] from='client.295689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:28 smithi179 bash[23186]: audit 2024-09-21T03:28:27.195358+0000 mon.a (mon.0) 10995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:28 smithi179 bash[23186]: audit 2024-09-21T03:28:27.201043+0000 mon.a (mon.0) 10996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:28 smithi179 bash[23186]: audit 2024-09-21T03:28:27.206222+0000 mon.a (mon.0) 10997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:28 smithi049 bash[23528]: audit 2024-09-21T03:28:26.915185+0000 mgr.a (mgr.14388) 13590 : audit [DBG] from='client.295689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:28 smithi049 bash[23528]: audit 2024-09-21T03:28:27.195358+0000 mon.a (mon.0) 10995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:28 smithi049 bash[23528]: audit 2024-09-21T03:28:27.201043+0000 mon.a (mon.0) 10996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:28 smithi049 bash[23528]: audit 2024-09-21T03:28:27.206222+0000 mon.a (mon.0) 10997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:29 smithi044 bash[22676]: cluster 2024-09-21T03:28:27.695745+0000 mgr.a (mgr.14388) 13591 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:29 smithi179 bash[23186]: cluster 2024-09-21T03:28:27.695745+0000 mgr.a (mgr.14388) 13591 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:29 smithi049 bash[23528]: cluster 2024-09-21T03:28:27.695745+0000 mgr.a (mgr.14388) 13591 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:30 smithi049 bash[23528]: cluster 2024-09-21T03:28:29.696544+0000 mgr.a (mgr.14388) 13592 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:30 smithi044 bash[22676]: cluster 2024-09-21T03:28:29.696544+0000 mgr.a (mgr.14388) 13592 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:30 smithi179 bash[23186]: cluster 2024-09-21T03:28:29.696544+0000 mgr.a (mgr.14388) 13592 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:32.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:32 smithi049 bash[23528]: cluster 2024-09-21T03:28:31.698802+0000 mgr.a (mgr.14388) 13593 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:33.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:33.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:33.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:33.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:33.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:32 smithi044 bash[22676]: cluster 2024-09-21T03:28:31.698802+0000 mgr.a (mgr.14388) 13593 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:32 smithi179 bash[23186]: cluster 2024-09-21T03:28:31.698802+0000 mgr.a (mgr.14388) 13593 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:34.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:33 smithi049 bash[23528]: audit 2024-09-21T03:28:32.681138+0000 mgr.a (mgr.14388) 13594 : audit [DBG] from='client.295764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:33 smithi044 bash[22676]: audit 2024-09-21T03:28:32.681138+0000 mgr.a (mgr.14388) 13594 : audit [DBG] from='client.295764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:34.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:33 smithi179 bash[23186]: audit 2024-09-21T03:28:32.681138+0000 mgr.a (mgr.14388) 13594 : audit [DBG] from='client.295764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:35.032 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:34 smithi049 bash[23528]: cluster 2024-09-21T03:28:33.699780+0000 mgr.a (mgr.14388) 13595 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:34 smithi044 bash[22676]: cluster 2024-09-21T03:28:33.699780+0000 mgr.a (mgr.14388) 13595 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:34 smithi179 bash[23186]: cluster 2024-09-21T03:28:33.699780+0000 mgr.a (mgr.14388) 13595 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:35 smithi049 bash[23528]: audit 2024-09-21T03:28:34.789770+0000 mon.a (mon.0) 10998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:35 smithi049 bash[23528]: audit 2024-09-21T03:28:34.798433+0000 mon.a (mon.0) 10999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:35 smithi049 bash[23528]: audit 2024-09-21T03:28:34.809022+0000 mon.a (mon.0) 11000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:35 smithi044 bash[22676]: audit 2024-09-21T03:28:34.789770+0000 mon.a (mon.0) 10998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:35 smithi044 bash[22676]: audit 2024-09-21T03:28:34.798433+0000 mon.a (mon.0) 10999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:35 smithi044 bash[22676]: audit 2024-09-21T03:28:34.809022+0000 mon.a (mon.0) 11000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:35 smithi179 bash[23186]: audit 2024-09-21T03:28:34.789770+0000 mon.a (mon.0) 10998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:35 smithi179 bash[23186]: audit 2024-09-21T03:28:34.798433+0000 mon.a (mon.0) 10999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:36.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:35 smithi179 bash[23186]: audit 2024-09-21T03:28:34.809022+0000 mon.a (mon.0) 11000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:37.182 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:36 smithi044 bash[22676]: cluster 2024-09-21T03:28:35.701956+0000 mgr.a (mgr.14388) 13596 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:36 smithi179 bash[23186]: cluster 2024-09-21T03:28:35.701956+0000 mgr.a (mgr.14388) 13596 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:36 smithi049 bash[23528]: cluster 2024-09-21T03:28:35.701956+0000 mgr.a (mgr.14388) 13596 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:38.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:38.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:38.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:38.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:38.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:38.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:38.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:39.117 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:38 smithi179 bash[23186]: cluster 2024-09-21T03:28:37.702699+0000 mgr.a (mgr.14388) 13597 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:38 smithi044 bash[22676]: cluster 2024-09-21T03:28:37.702699+0000 mgr.a (mgr.14388) 13597 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:39.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:38 smithi049 bash[23528]: cluster 2024-09-21T03:28:37.702699+0000 mgr.a (mgr.14388) 13597 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:40.081 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:39 smithi179 bash[23186]: audit 2024-09-21T03:28:38.467622+0000 mgr.a (mgr.14388) 13598 : audit [DBG] from='client.295842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:40.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:39 smithi044 bash[22676]: audit 2024-09-21T03:28:38.467622+0000 mgr.a (mgr.14388) 13598 : audit [DBG] from='client.295842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:39 smithi049 bash[23528]: audit 2024-09-21T03:28:38.467622+0000 mgr.a (mgr.14388) 13598 : audit [DBG] from='client.295842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:40 smithi044 bash[22676]: cluster 2024-09-21T03:28:39.703726+0000 mgr.a (mgr.14388) 13599 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:41.106 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:40 smithi179 bash[23186]: cluster 2024-09-21T03:28:39.703726+0000 mgr.a (mgr.14388) 13599 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:40 smithi049 bash[23528]: cluster 2024-09-21T03:28:39.703726+0000 mgr.a (mgr.14388) 13599 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:42 smithi179 bash[23186]: cluster 2024-09-21T03:28:41.706027+0000 mgr.a (mgr.14388) 13600 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:42 smithi044 bash[22676]: cluster 2024-09-21T03:28:41.706027+0000 mgr.a (mgr.14388) 13600 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:42 smithi049 bash[23528]: cluster 2024-09-21T03:28:41.706027+0000 mgr.a (mgr.14388) 13600 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:44.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:44.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:44.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:44.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:44 smithi044 bash[22676]: cluster 2024-09-21T03:28:43.706815+0000 mgr.a (mgr.14388) 13601 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:44 smithi044 bash[22676]: audit 2024-09-21T03:28:44.247666+0000 mgr.a (mgr.14388) 13602 : audit [DBG] from='client.295920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:44 smithi179 bash[23186]: cluster 2024-09-21T03:28:43.706815+0000 mgr.a (mgr.14388) 13601 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:44 smithi179 bash[23186]: audit 2024-09-21T03:28:44.247666+0000 mgr.a (mgr.14388) 13602 : audit [DBG] from='client.295920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:44 smithi049 bash[23528]: cluster 2024-09-21T03:28:43.706815+0000 mgr.a (mgr.14388) 13601 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:44 smithi049 bash[23528]: audit 2024-09-21T03:28:44.247666+0000 mgr.a (mgr.14388) 13602 : audit [DBG] from='client.295920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:46 smithi044 bash[22676]: cluster 2024-09-21T03:28:45.709147+0000 mgr.a (mgr.14388) 13603 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:46 smithi179 bash[23186]: cluster 2024-09-21T03:28:45.709147+0000 mgr.a (mgr.14388) 13603 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:46 smithi049 bash[23528]: cluster 2024-09-21T03:28:45.709147+0000 mgr.a (mgr.14388) 13603 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:28:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:47 smithi044 bash[22676]: audit 2024-09-21T03:28:46.970827+0000 mon.a (mon.0) 11001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:47 smithi044 bash[22676]: audit 2024-09-21T03:28:46.980240+0000 mon.a (mon.0) 11002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:47 smithi044 bash[22676]: audit 2024-09-21T03:28:46.992076+0000 mon.a (mon.0) 11003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:47 smithi044 bash[22676]: audit 2024-09-21T03:28:47.384116+0000 mon.a (mon.0) 11004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:47 smithi044 bash[22676]: audit 2024-09-21T03:28:47.393881+0000 mon.a (mon.0) 11005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:47 smithi044 bash[22676]: audit 2024-09-21T03:28:47.405280+0000 mon.a (mon.0) 11006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:47 smithi179 bash[23186]: audit 2024-09-21T03:28:46.970827+0000 mon.a (mon.0) 11001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:47 smithi179 bash[23186]: audit 2024-09-21T03:28:46.980240+0000 mon.a (mon.0) 11002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:47 smithi179 bash[23186]: audit 2024-09-21T03:28:46.992076+0000 mon.a (mon.0) 11003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:47 smithi179 bash[23186]: audit 2024-09-21T03:28:47.384116+0000 mon.a (mon.0) 11004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:47 smithi179 bash[23186]: audit 2024-09-21T03:28:47.393881+0000 mon.a (mon.0) 11005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:47 smithi179 bash[23186]: audit 2024-09-21T03:28:47.405280+0000 mon.a (mon.0) 11006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:47 smithi049 bash[23528]: audit 2024-09-21T03:28:46.970827+0000 mon.a (mon.0) 11001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:47 smithi049 bash[23528]: audit 2024-09-21T03:28:46.980240+0000 mon.a (mon.0) 11002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:47 smithi049 bash[23528]: audit 2024-09-21T03:28:46.992076+0000 mon.a (mon.0) 11003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:47 smithi049 bash[23528]: audit 2024-09-21T03:28:47.384116+0000 mon.a (mon.0) 11004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:47 smithi049 bash[23528]: audit 2024-09-21T03:28:47.393881+0000 mon.a (mon.0) 11005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:47 smithi049 bash[23528]: audit 2024-09-21T03:28:47.405280+0000 mon.a (mon.0) 11006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:48 smithi044 bash[22676]: cluster 2024-09-21T03:28:47.710002+0000 mgr.a (mgr.14388) 13604 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:48 smithi179 bash[23186]: cluster 2024-09-21T03:28:47.710002+0000 mgr.a (mgr.14388) 13604 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:48 smithi049 bash[23528]: cluster 2024-09-21T03:28:47.710002+0000 mgr.a (mgr.14388) 13604 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:50.472 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:50.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:50 smithi044 bash[22676]: cluster 2024-09-21T03:28:49.710730+0000 mgr.a (mgr.14388) 13605 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:50 smithi044 bash[22676]: audit 2024-09-21T03:28:50.023574+0000 mgr.a (mgr.14388) 13606 : audit [DBG] from='client.295995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:50 smithi179 bash[23186]: cluster 2024-09-21T03:28:49.710730+0000 mgr.a (mgr.14388) 13605 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:50 smithi179 bash[23186]: audit 2024-09-21T03:28:50.023574+0000 mgr.a (mgr.14388) 13606 : audit [DBG] from='client.295995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:50 smithi049 bash[23528]: cluster 2024-09-21T03:28:49.710730+0000 mgr.a (mgr.14388) 13605 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:50 smithi049 bash[23528]: audit 2024-09-21T03:28:50.023574+0000 mgr.a (mgr.14388) 13606 : audit [DBG] from='client.295995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:52 smithi044 bash[22676]: cluster 2024-09-21T03:28:51.713567+0000 mgr.a (mgr.14388) 13607 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:52 smithi179 bash[23186]: cluster 2024-09-21T03:28:51.713567+0000 mgr.a (mgr.14388) 13607 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:52 smithi049 bash[23528]: cluster 2024-09-21T03:28:51.713567+0000 mgr.a (mgr.14388) 13607 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:54 smithi044 bash[22676]: cluster 2024-09-21T03:28:53.714403+0000 mgr.a (mgr.14388) 13608 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:54 smithi179 bash[23186]: cluster 2024-09-21T03:28:53.714403+0000 mgr.a (mgr.14388) 13608 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:54 smithi049 bash[23528]: cluster 2024-09-21T03:28:53.714403+0000 mgr.a (mgr.14388) 13608 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:55.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:28:55.475 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:28:55.475 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:28:56.248 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:28:56.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:28:56.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:28:56.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:28:56.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:28:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:56 smithi049 bash[23528]: audit 2024-09-21T03:28:55.029054+0000 mon.a (mon.0) 11007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:56 smithi049 bash[23528]: audit 2024-09-21T03:28:55.037764+0000 mon.a (mon.0) 11008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:56 smithi049 bash[23528]: audit 2024-09-21T03:28:55.048398+0000 mon.a (mon.0) 11009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:56 smithi044 bash[22676]: audit 2024-09-21T03:28:55.029054+0000 mon.a (mon.0) 11007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:56 smithi044 bash[22676]: audit 2024-09-21T03:28:55.037764+0000 mon.a (mon.0) 11008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:56 smithi044 bash[22676]: audit 2024-09-21T03:28:55.048398+0000 mon.a (mon.0) 11009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:56 smithi179 bash[23186]: audit 2024-09-21T03:28:55.029054+0000 mon.a (mon.0) 11007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:56 smithi179 bash[23186]: audit 2024-09-21T03:28:55.037764+0000 mon.a (mon.0) 11008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:56.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:56 smithi179 bash[23186]: audit 2024-09-21T03:28:55.048398+0000 mon.a (mon.0) 11009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:57 smithi049 bash[23528]: cluster 2024-09-21T03:28:55.715690+0000 mgr.a (mgr.14388) 13609 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:57 smithi049 bash[23528]: audit 2024-09-21T03:28:55.808729+0000 mgr.a (mgr.14388) 13610 : audit [DBG] from='client.296073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:57.405 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:57 smithi044 bash[22676]: cluster 2024-09-21T03:28:55.715690+0000 mgr.a (mgr.14388) 13609 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:57.405 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:57 smithi044 bash[22676]: audit 2024-09-21T03:28:55.808729+0000 mgr.a (mgr.14388) 13610 : audit [DBG] from='client.296073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:57 smithi179 bash[23186]: cluster 2024-09-21T03:28:55.715690+0000 mgr.a (mgr.14388) 13609 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:28:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:57 smithi179 bash[23186]: audit 2024-09-21T03:28:55.808729+0000 mgr.a (mgr.14388) 13610 : audit [DBG] from='client.296073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:58.349 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:58 smithi044 bash[22676]: audit 2024-09-21T03:28:57.758368+0000 mon.a (mon.0) 11010 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:28:58.349 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:58 smithi044 bash[22676]: audit 2024-09-21T03:28:57.765388+0000 mon.a (mon.0) 11011 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:28:58.349 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:58 smithi044 bash[22676]: audit 2024-09-21T03:28:57.766869+0000 mon.a (mon.0) 11012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:28:58.349 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:58 smithi044 bash[22676]: audit 2024-09-21T03:28:57.778300+0000 mon.a (mon.0) 11013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:58.349 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:58 smithi044 bash[22676]: audit 2024-09-21T03:28:57.784768+0000 mon.a (mon.0) 11014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:28:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:58 smithi179 bash[23186]: audit 2024-09-21T03:28:57.758368+0000 mon.a (mon.0) 11010 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:28:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:58 smithi179 bash[23186]: audit 2024-09-21T03:28:57.765388+0000 mon.a (mon.0) 11011 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:28:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:58 smithi179 bash[23186]: audit 2024-09-21T03:28:57.766869+0000 mon.a (mon.0) 11012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:28:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:58 smithi179 bash[23186]: audit 2024-09-21T03:28:57.778300+0000 mon.a (mon.0) 11013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:58 smithi179 bash[23186]: audit 2024-09-21T03:28:57.784768+0000 mon.a (mon.0) 11014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:28:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:58 smithi049 bash[23528]: audit 2024-09-21T03:28:57.758368+0000 mon.a (mon.0) 11010 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:28:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:58 smithi049 bash[23528]: audit 2024-09-21T03:28:57.765388+0000 mon.a (mon.0) 11011 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:28:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:58 smithi049 bash[23528]: audit 2024-09-21T03:28:57.766869+0000 mon.a (mon.0) 11012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:28:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:58 smithi049 bash[23528]: audit 2024-09-21T03:28:57.778300+0000 mon.a (mon.0) 11013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:28:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:58 smithi049 bash[23528]: audit 2024-09-21T03:28:57.784768+0000 mon.a (mon.0) 11014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:28:58.706 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:28:58 smithi044 bash[22930]: debug 2024-09-21T03:28:58.532+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:28:58.706 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:28:58 smithi044 bash[22930]: debug 2024-09-21T03:28:58.532+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:28:59.355 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:59 smithi179 bash[23186]: cluster 2024-09-21T03:28:57.716541+0000 mgr.a (mgr.14388) 13611 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:59.355 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:28:59 smithi179 bash[23186]: audit 2024-09-21T03:28:57.787408+0000 mgr.a (mgr.14388) 13612 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:28:59.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:59 smithi044 bash[22676]: cluster 2024-09-21T03:28:57.716541+0000 mgr.a (mgr.14388) 13611 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:59.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:28:59 smithi044 bash[22676]: audit 2024-09-21T03:28:57.787408+0000 mgr.a (mgr.14388) 13612 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:28:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:59 smithi049 bash[23528]: cluster 2024-09-21T03:28:57.716541+0000 mgr.a (mgr.14388) 13611 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:28:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:28:59 smithi049 bash[23528]: audit 2024-09-21T03:28:57.787408+0000 mgr.a (mgr.14388) 13612 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:29:00.328 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:00 smithi179 bash[23186]: audit 2024-09-21T03:28:58.533441+0000 mgr.a (mgr.14388) 13613 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:29:00.328 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:00 smithi179 bash[23186]: cephadm 2024-09-21T03:28:58.534570+0000 mgr.a (mgr.14388) 13614 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:29:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:00 smithi044 bash[22676]: audit 2024-09-21T03:28:58.533441+0000 mgr.a (mgr.14388) 13613 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:29:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:00 smithi044 bash[22676]: cephadm 2024-09-21T03:28:58.534570+0000 mgr.a (mgr.14388) 13614 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:29:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:00 smithi049 bash[23528]: audit 2024-09-21T03:28:58.533441+0000 mgr.a (mgr.14388) 13613 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:29:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:00 smithi049 bash[23528]: cephadm 2024-09-21T03:28:58.534570+0000 mgr.a (mgr.14388) 13614 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:29:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:01 smithi044 bash[22676]: cluster 2024-09-21T03:28:59.717553+0000 mgr.a (mgr.14388) 13615 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:29:01.250 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:01.251 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:01.251 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:01 smithi049 bash[23528]: cluster 2024-09-21T03:28:59.717553+0000 mgr.a (mgr.14388) 13615 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:29:01.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:01 smithi179 bash[23186]: cluster 2024-09-21T03:28:59.717553+0000 mgr.a (mgr.14388) 13615 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:29:02.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:02.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:02.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:02.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:02.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:03 smithi179 bash[23186]: audit 2024-09-21T03:29:01.584659+0000 mgr.a (mgr.14388) 13616 : audit [DBG] from='client.296250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:03.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:03 smithi179 bash[23186]: cluster 2024-09-21T03:29:01.728757+0000 mgr.a (mgr.14388) 13617 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:03 smithi044 bash[22676]: audit 2024-09-21T03:29:01.584659+0000 mgr.a (mgr.14388) 13616 : audit [DBG] from='client.296250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:03 smithi044 bash[22676]: cluster 2024-09-21T03:29:01.728757+0000 mgr.a (mgr.14388) 13617 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:03 smithi049 bash[23528]: audit 2024-09-21T03:29:01.584659+0000 mgr.a (mgr.14388) 13616 : audit [DBG] from='client.296250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:03 smithi049 bash[23528]: cluster 2024-09-21T03:29:01.728757+0000 mgr.a (mgr.14388) 13617 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:05 smithi044 bash[22676]: cluster 2024-09-21T03:29:03.729913+0000 mgr.a (mgr.14388) 13618 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:05 smithi179 bash[23186]: cluster 2024-09-21T03:29:03.729913+0000 mgr.a (mgr.14388) 13618 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:05 smithi049 bash[23528]: cluster 2024-09-21T03:29:03.729913+0000 mgr.a (mgr.14388) 13618 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:07.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:07.020 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:07.020 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:07 smithi044 bash[22676]: cluster 2024-09-21T03:29:05.732138+0000 mgr.a (mgr.14388) 13619 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:07 smithi179 bash[23186]: cluster 2024-09-21T03:29:05.732138+0000 mgr.a (mgr.14388) 13619 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:07 smithi049 bash[23528]: cluster 2024-09-21T03:29:05.732138+0000 mgr.a (mgr.14388) 13619 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:07.807 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:07.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:08 smithi044 bash[22676]: audit 2024-09-21T03:29:07.146214+0000 mon.a (mon.0) 11015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:08 smithi044 bash[22676]: audit 2024-09-21T03:29:07.152957+0000 mon.a (mon.0) 11016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:08 smithi044 bash[22676]: audit 2024-09-21T03:29:07.160395+0000 mon.a (mon.0) 11017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:08 smithi044 bash[22676]: audit 2024-09-21T03:29:07.596931+0000 mon.a (mon.0) 11018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:08 smithi044 bash[22676]: audit 2024-09-21T03:29:07.609485+0000 mon.a (mon.0) 11019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:08 smithi044 bash[22676]: audit 2024-09-21T03:29:07.617710+0000 mon.a (mon.0) 11020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:08 smithi179 bash[23186]: audit 2024-09-21T03:29:07.146214+0000 mon.a (mon.0) 11015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:08 smithi179 bash[23186]: audit 2024-09-21T03:29:07.152957+0000 mon.a (mon.0) 11016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:08 smithi179 bash[23186]: audit 2024-09-21T03:29:07.160395+0000 mon.a (mon.0) 11017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:08 smithi179 bash[23186]: audit 2024-09-21T03:29:07.596931+0000 mon.a (mon.0) 11018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:08 smithi179 bash[23186]: audit 2024-09-21T03:29:07.609485+0000 mon.a (mon.0) 11019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:08 smithi179 bash[23186]: audit 2024-09-21T03:29:07.617710+0000 mon.a (mon.0) 11020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:08 smithi049 bash[23528]: audit 2024-09-21T03:29:07.146214+0000 mon.a (mon.0) 11015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:08 smithi049 bash[23528]: audit 2024-09-21T03:29:07.152957+0000 mon.a (mon.0) 11016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:08 smithi049 bash[23528]: audit 2024-09-21T03:29:07.160395+0000 mon.a (mon.0) 11017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:08 smithi049 bash[23528]: audit 2024-09-21T03:29:07.596931+0000 mon.a (mon.0) 11018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:08 smithi049 bash[23528]: audit 2024-09-21T03:29:07.609485+0000 mon.a (mon.0) 11019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:08 smithi049 bash[23528]: audit 2024-09-21T03:29:07.617710+0000 mon.a (mon.0) 11020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:09 smithi044 bash[22676]: audit 2024-09-21T03:29:07.358225+0000 mgr.a (mgr.14388) 13620 : audit [DBG] from='client.296325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:09 smithi044 bash[22676]: cluster 2024-09-21T03:29:07.732781+0000 mgr.a (mgr.14388) 13621 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:09 smithi179 bash[23186]: audit 2024-09-21T03:29:07.358225+0000 mgr.a (mgr.14388) 13620 : audit [DBG] from='client.296325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:09 smithi179 bash[23186]: cluster 2024-09-21T03:29:07.732781+0000 mgr.a (mgr.14388) 13621 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:09 smithi049 bash[23528]: audit 2024-09-21T03:29:07.358225+0000 mgr.a (mgr.14388) 13620 : audit [DBG] from='client.296325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:09 smithi049 bash[23528]: cluster 2024-09-21T03:29:07.732781+0000 mgr.a (mgr.14388) 13621 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:11 smithi044 bash[22676]: cluster 2024-09-21T03:29:09.733575+0000 mgr.a (mgr.14388) 13622 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:11 smithi179 bash[23186]: cluster 2024-09-21T03:29:09.733575+0000 mgr.a (mgr.14388) 13622 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:11 smithi049 bash[23528]: cluster 2024-09-21T03:29:09.733575+0000 mgr.a (mgr.14388) 13622 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:12.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:13 smithi044 bash[22676]: cluster 2024-09-21T03:29:11.735821+0000 mgr.a (mgr.14388) 13623 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:13 smithi179 bash[23186]: cluster 2024-09-21T03:29:11.735821+0000 mgr.a (mgr.14388) 13623 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:13 smithi049 bash[23528]: cluster 2024-09-21T03:29:11.735821+0000 mgr.a (mgr.14388) 13623 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:29:13.578 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:13.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:13.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:14 smithi044 bash[22676]: audit 2024-09-21T03:29:13.144219+0000 mgr.a (mgr.14388) 13624 : audit [DBG] from='client.296400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:14 smithi179 bash[23186]: audit 2024-09-21T03:29:13.144219+0000 mgr.a (mgr.14388) 13624 : audit [DBG] from='client.296400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:14 smithi049 bash[23528]: audit 2024-09-21T03:29:13.144219+0000 mgr.a (mgr.14388) 13624 : audit [DBG] from='client.296400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:15 smithi044 bash[22676]: cluster 2024-09-21T03:29:13.736784+0000 mgr.a (mgr.14388) 13625 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:15 smithi179 bash[23186]: cluster 2024-09-21T03:29:13.736784+0000 mgr.a (mgr.14388) 13625 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:15 smithi049 bash[23528]: cluster 2024-09-21T03:29:13.736784+0000 mgr.a (mgr.14388) 13625 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:16.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:16 smithi049 bash[23528]: audit 2024-09-21T03:29:15.266444+0000 mon.a (mon.0) 11021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:16 smithi049 bash[23528]: audit 2024-09-21T03:29:15.274969+0000 mon.a (mon.0) 11022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:16 smithi049 bash[23528]: audit 2024-09-21T03:29:15.285932+0000 mon.a (mon.0) 11023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:16 smithi044 bash[22676]: audit 2024-09-21T03:29:15.266444+0000 mon.a (mon.0) 11021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:16 smithi044 bash[22676]: audit 2024-09-21T03:29:15.274969+0000 mon.a (mon.0) 11022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:16 smithi044 bash[22676]: audit 2024-09-21T03:29:15.285932+0000 mon.a (mon.0) 11023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:16 smithi179 bash[23186]: audit 2024-09-21T03:29:15.266444+0000 mon.a (mon.0) 11021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:16 smithi179 bash[23186]: audit 2024-09-21T03:29:15.274969+0000 mon.a (mon.0) 11022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:16 smithi179 bash[23186]: audit 2024-09-21T03:29:15.285932+0000 mon.a (mon.0) 11023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:17 smithi049 bash[23528]: cluster 2024-09-21T03:29:15.739076+0000 mgr.a (mgr.14388) 13626 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:17.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:17 smithi044 bash[22676]: cluster 2024-09-21T03:29:15.739076+0000 mgr.a (mgr.14388) 13626 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:17 smithi179 bash[23186]: cluster 2024-09-21T03:29:15.739076+0000 mgr.a (mgr.14388) 13626 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:18.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:19.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:19.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:19.542 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:19 smithi044 bash[22676]: cluster 2024-09-21T03:29:17.740005+0000 mgr.a (mgr.14388) 13627 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:19 smithi049 bash[23528]: cluster 2024-09-21T03:29:17.740005+0000 mgr.a (mgr.14388) 13627 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:19.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:19 smithi179 bash[23186]: cluster 2024-09-21T03:29:17.740005+0000 mgr.a (mgr.14388) 13627 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:20.538 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:20 smithi044 bash[22676]: audit 2024-09-21T03:29:18.922689+0000 mgr.a (mgr.14388) 13628 : audit [DBG] from='client.296475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:20 smithi049 bash[23528]: audit 2024-09-21T03:29:18.922689+0000 mgr.a (mgr.14388) 13628 : audit [DBG] from='client.296475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:20.684 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:20 smithi179 bash[23186]: audit 2024-09-21T03:29:18.922689+0000 mgr.a (mgr.14388) 13628 : audit [DBG] from='client.296475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:21 smithi049 bash[23528]: cluster 2024-09-21T03:29:19.740980+0000 mgr.a (mgr.14388) 13629 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:21.598 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:21 smithi179 bash[23186]: cluster 2024-09-21T03:29:19.740980+0000 mgr.a (mgr.14388) 13629 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:21 smithi044 bash[22676]: cluster 2024-09-21T03:29:19.740980+0000 mgr.a (mgr.14388) 13629 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:22.604 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:22 smithi179 bash[23186]: cluster 2024-09-21T03:29:21.743266+0000 mgr.a (mgr.14388) 13630 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:22 smithi044 bash[22676]: cluster 2024-09-21T03:29:21.743266+0000 mgr.a (mgr.14388) 13630 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:22 smithi049 bash[23528]: cluster 2024-09-21T03:29:21.743266+0000 mgr.a (mgr.14388) 13630 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:24.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:24.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:24.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:24 smithi049 bash[23528]: cluster 2024-09-21T03:29:23.744059+0000 mgr.a (mgr.14388) 13631 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:25.156 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:24 smithi044 bash[22676]: cluster 2024-09-21T03:29:23.744059+0000 mgr.a (mgr.14388) 13631 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:24 smithi179 bash[23186]: cluster 2024-09-21T03:29:23.744059+0000 mgr.a (mgr.14388) 13631 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:26.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:25 smithi044 bash[22676]: audit 2024-09-21T03:29:24.700767+0000 mgr.a (mgr.14388) 13632 : audit [DBG] from='client.296550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:26.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:25 smithi179 bash[23186]: audit 2024-09-21T03:29:24.700767+0000 mgr.a (mgr.14388) 13632 : audit [DBG] from='client.296550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:25 smithi049 bash[23528]: audit 2024-09-21T03:29:24.700767+0000 mgr.a (mgr.14388) 13632 : audit [DBG] from='client.296550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:26 smithi044 bash[22676]: cluster 2024-09-21T03:29:25.746515+0000 mgr.a (mgr.14388) 13633 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:29:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:26 smithi179 bash[23186]: cluster 2024-09-21T03:29:25.746515+0000 mgr.a (mgr.14388) 13633 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:29:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:26 smithi049 bash[23528]: cluster 2024-09-21T03:29:25.746515+0000 mgr.a (mgr.14388) 13633 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:29:28.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:28 smithi044 bash[22676]: audit 2024-09-21T03:29:27.357337+0000 mon.a (mon.0) 11024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:28 smithi044 bash[22676]: audit 2024-09-21T03:29:27.365162+0000 mon.a (mon.0) 11025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:28 smithi044 bash[22676]: audit 2024-09-21T03:29:27.374693+0000 mon.a (mon.0) 11026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:28 smithi044 bash[22676]: cluster 2024-09-21T03:29:27.747343+0000 mgr.a (mgr.14388) 13634 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:29:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:28 smithi044 bash[22676]: audit 2024-09-21T03:29:27.825432+0000 mon.a (mon.0) 11027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:28 smithi044 bash[22676]: audit 2024-09-21T03:29:27.834363+0000 mon.a (mon.0) 11028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:28 smithi044 bash[22676]: audit 2024-09-21T03:29:27.844820+0000 mon.a (mon.0) 11029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:28 smithi179 bash[23186]: audit 2024-09-21T03:29:27.357337+0000 mon.a (mon.0) 11024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:28 smithi179 bash[23186]: audit 2024-09-21T03:29:27.365162+0000 mon.a (mon.0) 11025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:28 smithi179 bash[23186]: audit 2024-09-21T03:29:27.374693+0000 mon.a (mon.0) 11026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:28 smithi179 bash[23186]: cluster 2024-09-21T03:29:27.747343+0000 mgr.a (mgr.14388) 13634 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:29:28.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:28 smithi179 bash[23186]: audit 2024-09-21T03:29:27.825432+0000 mon.a (mon.0) 11027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:28 smithi179 bash[23186]: audit 2024-09-21T03:29:27.834363+0000 mon.a (mon.0) 11028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:28 smithi179 bash[23186]: audit 2024-09-21T03:29:27.844820+0000 mon.a (mon.0) 11029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:28 smithi049 bash[23528]: audit 2024-09-21T03:29:27.357337+0000 mon.a (mon.0) 11024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:28 smithi049 bash[23528]: audit 2024-09-21T03:29:27.365162+0000 mon.a (mon.0) 11025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:28 smithi049 bash[23528]: audit 2024-09-21T03:29:27.374693+0000 mon.a (mon.0) 11026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:28 smithi049 bash[23528]: cluster 2024-09-21T03:29:27.747343+0000 mgr.a (mgr.14388) 13634 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:29:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:28 smithi049 bash[23528]: audit 2024-09-21T03:29:27.825432+0000 mon.a (mon.0) 11027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:28 smithi049 bash[23528]: audit 2024-09-21T03:29:27.834363+0000 mon.a (mon.0) 11028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:28 smithi049 bash[23528]: audit 2024-09-21T03:29:27.844820+0000 mon.a (mon.0) 11029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:30.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:30.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:30.947 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:30.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:31.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:30 smithi044 bash[22676]: cluster 2024-09-21T03:29:29.748132+0000 mgr.a (mgr.14388) 13635 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:29:31.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:30 smithi179 bash[23186]: cluster 2024-09-21T03:29:29.748132+0000 mgr.a (mgr.14388) 13635 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:29:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:30 smithi049 bash[23528]: cluster 2024-09-21T03:29:29.748132+0000 mgr.a (mgr.14388) 13635 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:29:32.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:31 smithi044 bash[22676]: audit 2024-09-21T03:29:30.491926+0000 mgr.a (mgr.14388) 13636 : audit [DBG] from='client.296625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:32.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:31 smithi179 bash[23186]: audit 2024-09-21T03:29:30.491926+0000 mgr.a (mgr.14388) 13636 : audit [DBG] from='client.296625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:31 smithi049 bash[23528]: audit 2024-09-21T03:29:30.491926+0000 mgr.a (mgr.14388) 13636 : audit [DBG] from='client.296625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:32 smithi044 bash[22676]: cluster 2024-09-21T03:29:31.750983+0000 mgr.a (mgr.14388) 13637 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:32 smithi179 bash[23186]: cluster 2024-09-21T03:29:31.750983+0000 mgr.a (mgr.14388) 13637 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:32 smithi049 bash[23528]: cluster 2024-09-21T03:29:31.750983+0000 mgr.a (mgr.14388) 13637 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:34 smithi044 bash[22676]: cluster 2024-09-21T03:29:33.751776+0000 mgr.a (mgr.14388) 13638 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:29:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:34 smithi179 bash[23186]: cluster 2024-09-21T03:29:33.751776+0000 mgr.a (mgr.14388) 13638 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:29:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:34 smithi049 bash[23528]: cluster 2024-09-21T03:29:33.751776+0000 mgr.a (mgr.14388) 13638 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:29:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:36 smithi044 bash[22676]: audit 2024-09-21T03:29:35.488004+0000 mon.a (mon.0) 11030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:36 smithi044 bash[22676]: audit 2024-09-21T03:29:35.498617+0000 mon.a (mon.0) 11031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:36 smithi044 bash[22676]: audit 2024-09-21T03:29:35.510914+0000 mon.a (mon.0) 11032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:36 smithi044 bash[22676]: cluster 2024-09-21T03:29:35.753939+0000 mgr.a (mgr.14388) 13639 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:36.740 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:36 smithi179 bash[23186]: audit 2024-09-21T03:29:35.488004+0000 mon.a (mon.0) 11030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:36 smithi179 bash[23186]: audit 2024-09-21T03:29:35.498617+0000 mon.a (mon.0) 11031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:36 smithi179 bash[23186]: audit 2024-09-21T03:29:35.510914+0000 mon.a (mon.0) 11032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:36 smithi179 bash[23186]: cluster 2024-09-21T03:29:35.753939+0000 mgr.a (mgr.14388) 13639 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:36 smithi049 bash[23528]: audit 2024-09-21T03:29:35.488004+0000 mon.a (mon.0) 11030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:36 smithi049 bash[23528]: audit 2024-09-21T03:29:35.498617+0000 mon.a (mon.0) 11031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:36 smithi049 bash[23528]: audit 2024-09-21T03:29:35.510914+0000 mon.a (mon.0) 11032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:36 smithi049 bash[23528]: cluster 2024-09-21T03:29:35.753939+0000 mgr.a (mgr.14388) 13639 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:37.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:37 smithi049 bash[23528]: audit 2024-09-21T03:29:36.286054+0000 mgr.a (mgr.14388) 13640 : audit [DBG] from='client.296700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:37 smithi044 bash[22676]: audit 2024-09-21T03:29:36.286054+0000 mgr.a (mgr.14388) 13640 : audit [DBG] from='client.296700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:38.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:37 smithi179 bash[23186]: audit 2024-09-21T03:29:36.286054+0000 mgr.a (mgr.14388) 13640 : audit [DBG] from='client.296700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:38 smithi049 bash[23528]: cluster 2024-09-21T03:29:37.754886+0000 mgr.a (mgr.14388) 13641 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:29:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:38 smithi044 bash[22676]: cluster 2024-09-21T03:29:37.754886+0000 mgr.a (mgr.14388) 13641 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:29:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:38 smithi179 bash[23186]: cluster 2024-09-21T03:29:37.754886+0000 mgr.a (mgr.14388) 13641 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:29:41.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:40 smithi179 bash[23186]: cluster 2024-09-21T03:29:39.755705+0000 mgr.a (mgr.14388) 13642 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:29:41.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:40 smithi044 bash[22676]: cluster 2024-09-21T03:29:39.755705+0000 mgr.a (mgr.14388) 13642 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:29:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:40 smithi049 bash[23528]: cluster 2024-09-21T03:29:39.755705+0000 mgr.a (mgr.14388) 13642 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:29:41.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:41.742 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:42.508 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:42 smithi044 bash[22676]: cluster 2024-09-21T03:29:41.757639+0000 mgr.a (mgr.14388) 13643 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:29:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:42 smithi044 bash[22676]: audit 2024-09-21T03:29:42.082407+0000 mgr.a (mgr.14388) 13644 : audit [DBG] from='client.296778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:42 smithi179 bash[23186]: cluster 2024-09-21T03:29:41.757639+0000 mgr.a (mgr.14388) 13643 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:29:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:42 smithi179 bash[23186]: audit 2024-09-21T03:29:42.082407+0000 mgr.a (mgr.14388) 13644 : audit [DBG] from='client.296778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:42 smithi049 bash[23528]: cluster 2024-09-21T03:29:41.757639+0000 mgr.a (mgr.14388) 13643 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:29:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:42 smithi049 bash[23528]: audit 2024-09-21T03:29:42.082407+0000 mgr.a (mgr.14388) 13644 : audit [DBG] from='client.296778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:44 smithi044 bash[22676]: cluster 2024-09-21T03:29:43.758532+0000 mgr.a (mgr.14388) 13645 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:44 smithi179 bash[23186]: cluster 2024-09-21T03:29:43.758532+0000 mgr.a (mgr.14388) 13645 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:44 smithi049 bash[23528]: cluster 2024-09-21T03:29:43.758532+0000 mgr.a (mgr.14388) 13645 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:46 smithi044 bash[22676]: cluster 2024-09-21T03:29:45.760732+0000 mgr.a (mgr.14388) 13646 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:46 smithi179 bash[23186]: cluster 2024-09-21T03:29:45.760732+0000 mgr.a (mgr.14388) 13646 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:46 smithi049 bash[23528]: cluster 2024-09-21T03:29:45.760732+0000 mgr.a (mgr.14388) 13646 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:47.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:47.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:47.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:48.311 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:48.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:48.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:48.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:48.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:48.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: audit 2024-09-21T03:29:47.574153+0000 mon.a (mon.0) 11033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: audit 2024-09-21T03:29:47.579941+0000 mon.a (mon.0) 11034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: audit 2024-09-21T03:29:47.586913+0000 mon.a (mon.0) 11035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: cluster 2024-09-21T03:29:47.761486+0000 mgr.a (mgr.14388) 13647 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: audit 2024-09-21T03:29:47.851168+0000 mgr.a (mgr.14388) 13648 : audit [DBG] from='client.296856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: audit 2024-09-21T03:29:48.034757+0000 mon.a (mon.0) 11036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: audit 2024-09-21T03:29:48.039677+0000 mon.a (mon.0) 11037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:48 smithi044 bash[22676]: audit 2024-09-21T03:29:48.045108+0000 mon.a (mon.0) 11038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: audit 2024-09-21T03:29:47.574153+0000 mon.a (mon.0) 11033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: audit 2024-09-21T03:29:47.579941+0000 mon.a (mon.0) 11034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: audit 2024-09-21T03:29:47.586913+0000 mon.a (mon.0) 11035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: cluster 2024-09-21T03:29:47.761486+0000 mgr.a (mgr.14388) 13647 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:49.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: audit 2024-09-21T03:29:47.851168+0000 mgr.a (mgr.14388) 13648 : audit [DBG] from='client.296856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: audit 2024-09-21T03:29:48.034757+0000 mon.a (mon.0) 11036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: audit 2024-09-21T03:29:48.039677+0000 mon.a (mon.0) 11037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:48 smithi179 bash[23186]: audit 2024-09-21T03:29:48.045108+0000 mon.a (mon.0) 11038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: audit 2024-09-21T03:29:47.574153+0000 mon.a (mon.0) 11033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: audit 2024-09-21T03:29:47.579941+0000 mon.a (mon.0) 11034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: audit 2024-09-21T03:29:47.586913+0000 mon.a (mon.0) 11035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: cluster 2024-09-21T03:29:47.761486+0000 mgr.a (mgr.14388) 13647 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: audit 2024-09-21T03:29:47.851168+0000 mgr.a (mgr.14388) 13648 : audit [DBG] from='client.296856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: audit 2024-09-21T03:29:48.034757+0000 mon.a (mon.0) 11036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: audit 2024-09-21T03:29:48.039677+0000 mon.a (mon.0) 11037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:48 smithi049 bash[23528]: audit 2024-09-21T03:29:48.045108+0000 mon.a (mon.0) 11038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:51.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:50 smithi044 bash[22676]: cluster 2024-09-21T03:29:49.762378+0000 mgr.a (mgr.14388) 13649 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:51.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:50 smithi179 bash[23186]: cluster 2024-09-21T03:29:49.762378+0000 mgr.a (mgr.14388) 13649 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:50 smithi049 bash[23528]: cluster 2024-09-21T03:29:49.762378+0000 mgr.a (mgr.14388) 13649 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:52 smithi044 bash[22676]: cluster 2024-09-21T03:29:51.764656+0000 mgr.a (mgr.14388) 13650 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:52 smithi179 bash[23186]: cluster 2024-09-21T03:29:51.764656+0000 mgr.a (mgr.14388) 13650 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:52 smithi049 bash[23528]: cluster 2024-09-21T03:29:51.764656+0000 mgr.a (mgr.14388) 13650 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:53.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:53.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:53.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:54.068 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:54.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:54.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:54.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:54.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:54 smithi044 bash[22676]: audit 2024-09-21T03:29:53.640307+0000 mgr.a (mgr.14388) 13651 : audit [DBG] from='client.296931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:54 smithi044 bash[22676]: cluster 2024-09-21T03:29:53.765146+0000 mgr.a (mgr.14388) 13652 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:54 smithi179 bash[23186]: audit 2024-09-21T03:29:53.640307+0000 mgr.a (mgr.14388) 13651 : audit [DBG] from='client.296931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:54 smithi179 bash[23186]: cluster 2024-09-21T03:29:53.765146+0000 mgr.a (mgr.14388) 13652 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:54 smithi049 bash[23528]: audit 2024-09-21T03:29:53.640307+0000 mgr.a (mgr.14388) 13651 : audit [DBG] from='client.296931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:54 smithi049 bash[23528]: cluster 2024-09-21T03:29:53.765146+0000 mgr.a (mgr.14388) 13652 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:56 smithi044 bash[22676]: audit 2024-09-21T03:29:55.724645+0000 mon.a (mon.0) 11039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:56 smithi044 bash[22676]: audit 2024-09-21T03:29:55.733207+0000 mon.a (mon.0) 11040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:56 smithi044 bash[22676]: audit 2024-09-21T03:29:55.744427+0000 mon.a (mon.0) 11041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:56 smithi044 bash[22676]: cluster 2024-09-21T03:29:55.767450+0000 mgr.a (mgr.14388) 13653 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:56 smithi179 bash[23186]: audit 2024-09-21T03:29:55.724645+0000 mon.a (mon.0) 11039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:56 smithi179 bash[23186]: audit 2024-09-21T03:29:55.733207+0000 mon.a (mon.0) 11040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:56 smithi179 bash[23186]: audit 2024-09-21T03:29:55.744427+0000 mon.a (mon.0) 11041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:57.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:56 smithi179 bash[23186]: cluster 2024-09-21T03:29:55.767450+0000 mgr.a (mgr.14388) 13653 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:57.016 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:56 smithi049 bash[23528]: audit 2024-09-21T03:29:55.724645+0000 mon.a (mon.0) 11039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:57.016 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:56 smithi049 bash[23528]: audit 2024-09-21T03:29:55.733207+0000 mon.a (mon.0) 11040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:57.016 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:56 smithi049 bash[23528]: audit 2024-09-21T03:29:55.744427+0000 mon.a (mon.0) 11041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:57.016 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:56 smithi049 bash[23528]: cluster 2024-09-21T03:29:55.767450+0000 mgr.a (mgr.14388) 13653 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:29:59.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:29:59.069 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:29:59.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:29:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:58 smithi044 bash[22676]: cluster 2024-09-21T03:29:57.768222+0000 mgr.a (mgr.14388) 13654 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:58 smithi044 bash[22676]: audit 2024-09-21T03:29:58.583671+0000 mon.a (mon.0) 11042 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:29:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:58 smithi044 bash[22676]: audit 2024-09-21T03:29:58.590399+0000 mon.a (mon.0) 11043 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:29:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:58 smithi044 bash[22676]: audit 2024-09-21T03:29:58.592256+0000 mon.a (mon.0) 11044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:29:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:58 smithi044 bash[22676]: audit 2024-09-21T03:29:58.603354+0000 mon.a (mon.0) 11045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:58 smithi044 bash[22676]: audit 2024-09-21T03:29:58.609570+0000 mon.a (mon.0) 11046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:29:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:58 smithi179 bash[23186]: cluster 2024-09-21T03:29:57.768222+0000 mgr.a (mgr.14388) 13654 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:58 smithi179 bash[23186]: audit 2024-09-21T03:29:58.583671+0000 mon.a (mon.0) 11042 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:29:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:58 smithi179 bash[23186]: audit 2024-09-21T03:29:58.590399+0000 mon.a (mon.0) 11043 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:29:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:58 smithi179 bash[23186]: audit 2024-09-21T03:29:58.592256+0000 mon.a (mon.0) 11044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:29:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:58 smithi179 bash[23186]: audit 2024-09-21T03:29:58.603354+0000 mon.a (mon.0) 11045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:58 smithi179 bash[23186]: audit 2024-09-21T03:29:58.609570+0000 mon.a (mon.0) 11046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:29:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:58 smithi049 bash[23528]: cluster 2024-09-21T03:29:57.768222+0000 mgr.a (mgr.14388) 13654 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:29:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:58 smithi049 bash[23528]: audit 2024-09-21T03:29:58.583671+0000 mon.a (mon.0) 11042 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:29:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:58 smithi049 bash[23528]: audit 2024-09-21T03:29:58.590399+0000 mon.a (mon.0) 11043 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:29:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:58 smithi049 bash[23528]: audit 2024-09-21T03:29:58.592256+0000 mon.a (mon.0) 11044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:29:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:58 smithi049 bash[23528]: audit 2024-09-21T03:29:58.603354+0000 mon.a (mon.0) 11045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:29:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:58 smithi049 bash[23528]: audit 2024-09-21T03:29:58.609570+0000 mon.a (mon.0) 11046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:29:59.642 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:29:59 smithi044 bash[22930]: debug 2024-09-21T03:29:59.368+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:29:59.642 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:29:59 smithi044 bash[22930]: debug 2024-09-21T03:29:59.368+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:29:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:29:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:29:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:29:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:29:59.839 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:29:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:29:59 smithi044 bash[22676]: audit 2024-09-21T03:29:58.611952+0000 mgr.a (mgr.14388) 13655 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:30:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:29:59 smithi179 bash[23186]: audit 2024-09-21T03:29:58.611952+0000 mgr.a (mgr.14388) 13655 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:30:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:29:59 smithi049 bash[23528]: audit 2024-09-21T03:29:58.611952+0000 mgr.a (mgr.14388) 13655 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:30:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:00 smithi044 bash[22676]: audit 2024-09-21T03:29:59.369873+0000 mgr.a (mgr.14388) 13656 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:30:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:00 smithi044 bash[22676]: cephadm 2024-09-21T03:29:59.371072+0000 mgr.a (mgr.14388) 13657 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:30:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:00 smithi044 bash[22676]: audit 2024-09-21T03:29:59.415668+0000 mgr.a (mgr.14388) 13658 : audit [DBG] from='client.297096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:00 smithi044 bash[22676]: cluster 2024-09-21T03:29:59.768807+0000 mgr.a (mgr.14388) 13659 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:00 smithi044 bash[22676]: cluster 2024-09-21T03:30:00.000126+0000 mon.a (mon.0) 11047 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:00 smithi179 bash[23186]: audit 2024-09-21T03:29:59.369873+0000 mgr.a (mgr.14388) 13656 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:00 smithi179 bash[23186]: cephadm 2024-09-21T03:29:59.371072+0000 mgr.a (mgr.14388) 13657 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:00 smithi179 bash[23186]: audit 2024-09-21T03:29:59.415668+0000 mgr.a (mgr.14388) 13658 : audit [DBG] from='client.297096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:00 smithi179 bash[23186]: cluster 2024-09-21T03:29:59.768807+0000 mgr.a (mgr.14388) 13659 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:00 smithi179 bash[23186]: cluster 2024-09-21T03:30:00.000126+0000 mon.a (mon.0) 11047 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:30:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:00 smithi049 bash[23528]: audit 2024-09-21T03:29:59.369873+0000 mgr.a (mgr.14388) 13656 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:30:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:00 smithi049 bash[23528]: cephadm 2024-09-21T03:29:59.371072+0000 mgr.a (mgr.14388) 13657 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:30:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:00 smithi049 bash[23528]: audit 2024-09-21T03:29:59.415668+0000 mgr.a (mgr.14388) 13658 : audit [DBG] from='client.297096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:00 smithi049 bash[23528]: cluster 2024-09-21T03:29:59.768807+0000 mgr.a (mgr.14388) 13659 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:00 smithi049 bash[23528]: cluster 2024-09-21T03:30:00.000126+0000 mon.a (mon.0) 11047 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:30:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:02 smithi049 bash[23528]: cluster 2024-09-21T03:30:01.770218+0000 mgr.a (mgr.14388) 13660 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:03.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:02 smithi179 bash[23186]: cluster 2024-09-21T03:30:01.770218+0000 mgr.a (mgr.14388) 13660 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:02 smithi044 bash[22676]: cluster 2024-09-21T03:30:01.770218+0000 mgr.a (mgr.14388) 13660 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:04.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:04.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:04.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:04 smithi044 bash[22676]: cluster 2024-09-21T03:30:03.770964+0000 mgr.a (mgr.14388) 13661 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:04 smithi179 bash[23186]: cluster 2024-09-21T03:30:03.770964+0000 mgr.a (mgr.14388) 13661 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:04 smithi049 bash[23528]: cluster 2024-09-21T03:30:03.770964+0000 mgr.a (mgr.14388) 13661 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:05.605 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:05.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:05.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:05.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:05.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:05 smithi044 bash[22676]: audit 2024-09-21T03:30:05.177144+0000 mgr.a (mgr.14388) 13662 : audit [DBG] from='client.297192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:05 smithi179 bash[23186]: audit 2024-09-21T03:30:05.177144+0000 mgr.a (mgr.14388) 13662 : audit [DBG] from='client.297192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:05 smithi049 bash[23528]: audit 2024-09-21T03:30:05.177144+0000 mgr.a (mgr.14388) 13662 : audit [DBG] from='client.297192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:06 smithi044 bash[22676]: cluster 2024-09-21T03:30:05.774031+0000 mgr.a (mgr.14388) 13663 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:06 smithi179 bash[23186]: cluster 2024-09-21T03:30:05.774031+0000 mgr.a (mgr.14388) 13663 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:06 smithi049 bash[23528]: cluster 2024-09-21T03:30:05.774031+0000 mgr.a (mgr.14388) 13663 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:08 smithi049 bash[23528]: cluster 2024-09-21T03:30:07.774633+0000 mgr.a (mgr.14388) 13664 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:30:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:08 smithi049 bash[23528]: audit 2024-09-21T03:30:07.802572+0000 mon.a (mon.0) 11048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:08 smithi049 bash[23528]: audit 2024-09-21T03:30:07.810349+0000 mon.a (mon.0) 11049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:08 smithi049 bash[23528]: audit 2024-09-21T03:30:07.821343+0000 mon.a (mon.0) 11050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:08 smithi049 bash[23528]: audit 2024-09-21T03:30:08.253592+0000 mon.a (mon.0) 11051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:08 smithi049 bash[23528]: audit 2024-09-21T03:30:08.261940+0000 mon.a (mon.0) 11052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:08 smithi049 bash[23528]: audit 2024-09-21T03:30:08.272189+0000 mon.a (mon.0) 11053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:08 smithi044 bash[22676]: cluster 2024-09-21T03:30:07.774633+0000 mgr.a (mgr.14388) 13664 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:30:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:08 smithi044 bash[22676]: audit 2024-09-21T03:30:07.802572+0000 mon.a (mon.0) 11048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:08 smithi044 bash[22676]: audit 2024-09-21T03:30:07.810349+0000 mon.a (mon.0) 11049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:08 smithi044 bash[22676]: audit 2024-09-21T03:30:07.821343+0000 mon.a (mon.0) 11050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:08 smithi044 bash[22676]: audit 2024-09-21T03:30:08.253592+0000 mon.a (mon.0) 11051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:08 smithi044 bash[22676]: audit 2024-09-21T03:30:08.261940+0000 mon.a (mon.0) 11052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:08 smithi044 bash[22676]: audit 2024-09-21T03:30:08.272189+0000 mon.a (mon.0) 11053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:08 smithi179 bash[23186]: cluster 2024-09-21T03:30:07.774633+0000 mgr.a (mgr.14388) 13664 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:08 smithi179 bash[23186]: audit 2024-09-21T03:30:07.802572+0000 mon.a (mon.0) 11048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:08 smithi179 bash[23186]: audit 2024-09-21T03:30:07.810349+0000 mon.a (mon.0) 11049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:08 smithi179 bash[23186]: audit 2024-09-21T03:30:07.821343+0000 mon.a (mon.0) 11050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:08 smithi179 bash[23186]: audit 2024-09-21T03:30:08.253592+0000 mon.a (mon.0) 11051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:08 smithi179 bash[23186]: audit 2024-09-21T03:30:08.261940+0000 mon.a (mon.0) 11052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:08 smithi179 bash[23186]: audit 2024-09-21T03:30:08.272189+0000 mon.a (mon.0) 11053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:10.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:10.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:10.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:11.150 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:10 smithi044 bash[22676]: cluster 2024-09-21T03:30:09.775354+0000 mgr.a (mgr.14388) 13665 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:30:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:10 smithi179 bash[23186]: cluster 2024-09-21T03:30:09.775354+0000 mgr.a (mgr.14388) 13665 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:30:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:10 smithi049 bash[23528]: cluster 2024-09-21T03:30:09.775354+0000 mgr.a (mgr.14388) 13665 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:30:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:11.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:11.414 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:11 smithi044 bash[22676]: audit 2024-09-21T03:30:10.950799+0000 mgr.a (mgr.14388) 13666 : audit [DBG] from='client.297270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:11 smithi179 bash[23186]: audit 2024-09-21T03:30:10.950799+0000 mgr.a (mgr.14388) 13666 : audit [DBG] from='client.297270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:11 smithi049 bash[23528]: audit 2024-09-21T03:30:10.950799+0000 mgr.a (mgr.14388) 13666 : audit [DBG] from='client.297270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:12 smithi044 bash[22676]: cluster 2024-09-21T03:30:11.778372+0000 mgr.a (mgr.14388) 13667 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:12 smithi179 bash[23186]: cluster 2024-09-21T03:30:11.778372+0000 mgr.a (mgr.14388) 13667 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:12 smithi049 bash[23528]: cluster 2024-09-21T03:30:11.778372+0000 mgr.a (mgr.14388) 13667 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:30:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:14 smithi044 bash[22676]: cluster 2024-09-21T03:30:13.779218+0000 mgr.a (mgr.14388) 13668 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:30:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:14 smithi179 bash[23186]: cluster 2024-09-21T03:30:13.779218+0000 mgr.a (mgr.14388) 13668 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:30:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:14 smithi049 bash[23528]: cluster 2024-09-21T03:30:13.779218+0000 mgr.a (mgr.14388) 13668 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:30:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:16.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:17.195 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:17.223 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:16 smithi049 bash[23528]: cluster 2024-09-21T03:30:15.781139+0000 mgr.a (mgr.14388) 13669 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:17.223 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:16 smithi049 bash[23528]: audit 2024-09-21T03:30:15.966575+0000 mon.a (mon.0) 11054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.223 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:16 smithi049 bash[23528]: audit 2024-09-21T03:30:15.976937+0000 mon.a (mon.0) 11055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.223 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:16 smithi049 bash[23528]: audit 2024-09-21T03:30:15.989098+0000 mon.a (mon.0) 11056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:16 smithi044 bash[22676]: cluster 2024-09-21T03:30:15.781139+0000 mgr.a (mgr.14388) 13669 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:16 smithi044 bash[22676]: audit 2024-09-21T03:30:15.966575+0000 mon.a (mon.0) 11054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:16 smithi044 bash[22676]: audit 2024-09-21T03:30:15.976937+0000 mon.a (mon.0) 11055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:16 smithi044 bash[22676]: audit 2024-09-21T03:30:15.989098+0000 mon.a (mon.0) 11056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:16 smithi179 bash[23186]: cluster 2024-09-21T03:30:15.781139+0000 mgr.a (mgr.14388) 13669 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:16 smithi179 bash[23186]: audit 2024-09-21T03:30:15.966575+0000 mon.a (mon.0) 11054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:16 smithi179 bash[23186]: audit 2024-09-21T03:30:15.976937+0000 mon.a (mon.0) 11055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:16 smithi179 bash[23186]: audit 2024-09-21T03:30:15.989098+0000 mon.a (mon.0) 11056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:18.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:17 smithi044 bash[22676]: audit 2024-09-21T03:30:16.753483+0000 mgr.a (mgr.14388) 13670 : audit [DBG] from='client.297348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:18.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:17 smithi179 bash[23186]: audit 2024-09-21T03:30:16.753483+0000 mgr.a (mgr.14388) 13670 : audit [DBG] from='client.297348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:17 smithi049 bash[23528]: audit 2024-09-21T03:30:16.753483+0000 mgr.a (mgr.14388) 13670 : audit [DBG] from='client.297348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:18 smithi044 bash[22676]: cluster 2024-09-21T03:30:17.782036+0000 mgr.a (mgr.14388) 13671 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:19.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:18 smithi179 bash[23186]: cluster 2024-09-21T03:30:17.782036+0000 mgr.a (mgr.14388) 13671 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:18 smithi049 bash[23528]: cluster 2024-09-21T03:30:17.782036+0000 mgr.a (mgr.14388) 13671 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:20 smithi044 bash[22676]: cluster 2024-09-21T03:30:19.782824+0000 mgr.a (mgr.14388) 13672 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:21.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:20 smithi179 bash[23186]: cluster 2024-09-21T03:30:19.782824+0000 mgr.a (mgr.14388) 13672 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:20 smithi049 bash[23528]: cluster 2024-09-21T03:30:19.782824+0000 mgr.a (mgr.14388) 13672 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:22.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:22.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:22.976 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:23.234 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:22 smithi179 bash[23186]: cluster 2024-09-21T03:30:21.784330+0000 mgr.a (mgr.14388) 13673 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:22 smithi044 bash[22676]: cluster 2024-09-21T03:30:21.784330+0000 mgr.a (mgr.14388) 13673 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:22 smithi049 bash[23528]: cluster 2024-09-21T03:30:21.784330+0000 mgr.a (mgr.14388) 13673 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:24.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:23 smithi179 bash[23186]: audit 2024-09-21T03:30:22.530454+0000 mgr.a (mgr.14388) 13674 : audit [DBG] from='client.297423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:23 smithi049 bash[23528]: audit 2024-09-21T03:30:22.530454+0000 mgr.a (mgr.14388) 13674 : audit [DBG] from='client.297423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:24.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:23 smithi044 bash[22676]: audit 2024-09-21T03:30:22.530454+0000 mgr.a (mgr.14388) 13674 : audit [DBG] from='client.297423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:25.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:24 smithi179 bash[23186]: cluster 2024-09-21T03:30:23.785211+0000 mgr.a (mgr.14388) 13675 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:24 smithi049 bash[23528]: cluster 2024-09-21T03:30:23.785211+0000 mgr.a (mgr.14388) 13675 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:24 smithi044 bash[22676]: cluster 2024-09-21T03:30:23.785211+0000 mgr.a (mgr.14388) 13675 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:27 smithi179 bash[23186]: cluster 2024-09-21T03:30:25.787344+0000 mgr.a (mgr.14388) 13676 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:27 smithi049 bash[23528]: cluster 2024-09-21T03:30:25.787344+0000 mgr.a (mgr.14388) 13676 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:26 smithi044 bash[22676]: cluster 2024-09-21T03:30:25.787344+0000 mgr.a (mgr.14388) 13676 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:27.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:27.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:27.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:28.746 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:28 smithi179 bash[23186]: cluster 2024-09-21T03:30:27.788143+0000 mgr.a (mgr.14388) 13677 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:28 smithi179 bash[23186]: audit 2024-09-21T03:30:27.997932+0000 mon.a (mon.0) 11057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:28 smithi179 bash[23186]: audit 2024-09-21T03:30:28.008601+0000 mon.a (mon.0) 11058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:28 smithi179 bash[23186]: audit 2024-09-21T03:30:28.015038+0000 mon.a (mon.0) 11059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:28 smithi179 bash[23186]: audit 2024-09-21T03:30:28.473214+0000 mon.a (mon.0) 11060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:28 smithi179 bash[23186]: audit 2024-09-21T03:30:28.481234+0000 mon.a (mon.0) 11061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:28 smithi179 bash[23186]: audit 2024-09-21T03:30:28.487840+0000 mon.a (mon.0) 11062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:28 smithi049 bash[23528]: cluster 2024-09-21T03:30:27.788143+0000 mgr.a (mgr.14388) 13677 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:28 smithi049 bash[23528]: audit 2024-09-21T03:30:27.997932+0000 mon.a (mon.0) 11057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:28 smithi049 bash[23528]: audit 2024-09-21T03:30:28.008601+0000 mon.a (mon.0) 11058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:28 smithi049 bash[23528]: audit 2024-09-21T03:30:28.015038+0000 mon.a (mon.0) 11059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:28 smithi049 bash[23528]: audit 2024-09-21T03:30:28.473214+0000 mon.a (mon.0) 11060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:28 smithi049 bash[23528]: audit 2024-09-21T03:30:28.481234+0000 mon.a (mon.0) 11061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:28 smithi049 bash[23528]: audit 2024-09-21T03:30:28.487840+0000 mon.a (mon.0) 11062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:28 smithi044 bash[22676]: cluster 2024-09-21T03:30:27.788143+0000 mgr.a (mgr.14388) 13677 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:28 smithi044 bash[22676]: audit 2024-09-21T03:30:27.997932+0000 mon.a (mon.0) 11057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:28 smithi044 bash[22676]: audit 2024-09-21T03:30:28.008601+0000 mon.a (mon.0) 11058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:28 smithi044 bash[22676]: audit 2024-09-21T03:30:28.015038+0000 mon.a (mon.0) 11059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:28 smithi044 bash[22676]: audit 2024-09-21T03:30:28.473214+0000 mon.a (mon.0) 11060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:28 smithi044 bash[22676]: audit 2024-09-21T03:30:28.481234+0000 mon.a (mon.0) 11061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:28 smithi044 bash[22676]: audit 2024-09-21T03:30:28.487840+0000 mon.a (mon.0) 11062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:30.262 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:30 smithi179 bash[23186]: audit 2024-09-21T03:30:28.314580+0000 mgr.a (mgr.14388) 13678 : audit [DBG] from='client.297498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:30 smithi049 bash[23528]: audit 2024-09-21T03:30:28.314580+0000 mgr.a (mgr.14388) 13678 : audit [DBG] from='client.297498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:30 smithi044 bash[22676]: audit 2024-09-21T03:30:28.314580+0000 mgr.a (mgr.14388) 13678 : audit [DBG] from='client.297498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:31 smithi049 bash[23528]: cluster 2024-09-21T03:30:29.789061+0000 mgr.a (mgr.14388) 13679 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:31 smithi044 bash[22676]: cluster 2024-09-21T03:30:29.789061+0000 mgr.a (mgr.14388) 13679 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:31.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:31 smithi179 bash[23186]: cluster 2024-09-21T03:30:29.789061+0000 mgr.a (mgr.14388) 13679 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:33 smithi049 bash[23528]: cluster 2024-09-21T03:30:31.790213+0000 mgr.a (mgr.14388) 13680 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:33 smithi044 bash[22676]: cluster 2024-09-21T03:30:31.790213+0000 mgr.a (mgr.14388) 13680 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:33 smithi179 bash[23186]: cluster 2024-09-21T03:30:31.790213+0000 mgr.a (mgr.14388) 13680 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:33.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:33.748 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:33.749 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:34.533 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:34.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:35 smithi049 bash[23528]: cluster 2024-09-21T03:30:33.790969+0000 mgr.a (mgr.14388) 13681 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:35 smithi049 bash[23528]: audit 2024-09-21T03:30:34.080061+0000 mgr.a (mgr.14388) 13682 : audit [DBG] from='client.297576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:35 smithi044 bash[22676]: cluster 2024-09-21T03:30:33.790969+0000 mgr.a (mgr.14388) 13681 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:35 smithi044 bash[22676]: audit 2024-09-21T03:30:34.080061+0000 mgr.a (mgr.14388) 13682 : audit [DBG] from='client.297576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:35 smithi179 bash[23186]: cluster 2024-09-21T03:30:33.790969+0000 mgr.a (mgr.14388) 13681 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:35 smithi179 bash[23186]: audit 2024-09-21T03:30:34.080061+0000 mgr.a (mgr.14388) 13682 : audit [DBG] from='client.297576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:37 smithi044 bash[22676]: cluster 2024-09-21T03:30:35.793288+0000 mgr.a (mgr.14388) 13683 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:37 smithi044 bash[22676]: audit 2024-09-21T03:30:36.182051+0000 mon.a (mon.0) 11063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:37 smithi044 bash[22676]: audit 2024-09-21T03:30:36.191976+0000 mon.a (mon.0) 11064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:37 smithi044 bash[22676]: audit 2024-09-21T03:30:36.202566+0000 mon.a (mon.0) 11065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:37 smithi179 bash[23186]: cluster 2024-09-21T03:30:35.793288+0000 mgr.a (mgr.14388) 13683 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:37 smithi179 bash[23186]: audit 2024-09-21T03:30:36.182051+0000 mon.a (mon.0) 11063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:37 smithi179 bash[23186]: audit 2024-09-21T03:30:36.191976+0000 mon.a (mon.0) 11064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:37 smithi179 bash[23186]: audit 2024-09-21T03:30:36.202566+0000 mon.a (mon.0) 11065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:37 smithi049 bash[23528]: cluster 2024-09-21T03:30:35.793288+0000 mgr.a (mgr.14388) 13683 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:37 smithi049 bash[23528]: audit 2024-09-21T03:30:36.182051+0000 mon.a (mon.0) 11063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:37 smithi049 bash[23528]: audit 2024-09-21T03:30:36.191976+0000 mon.a (mon.0) 11064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:37 smithi049 bash[23528]: audit 2024-09-21T03:30:36.202566+0000 mon.a (mon.0) 11065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:39 smithi179 bash[23186]: cluster 2024-09-21T03:30:37.794071+0000 mgr.a (mgr.14388) 13684 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:39.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:39.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:39.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:39 smithi049 bash[23528]: cluster 2024-09-21T03:30:37.794071+0000 mgr.a (mgr.14388) 13684 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:39 smithi044 bash[22676]: cluster 2024-09-21T03:30:37.794071+0000 mgr.a (mgr.14388) 13684 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:40.292 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:40.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:40.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:40.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:40.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:41 smithi044 bash[22676]: cluster 2024-09-21T03:30:39.794495+0000 mgr.a (mgr.14388) 13685 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:41 smithi044 bash[22676]: audit 2024-09-21T03:30:39.867310+0000 mgr.a (mgr.14388) 13686 : audit [DBG] from='client.297651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:41 smithi179 bash[23186]: cluster 2024-09-21T03:30:39.794495+0000 mgr.a (mgr.14388) 13685 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:41.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:41 smithi179 bash[23186]: audit 2024-09-21T03:30:39.867310+0000 mgr.a (mgr.14388) 13686 : audit [DBG] from='client.297651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:41 smithi049 bash[23528]: cluster 2024-09-21T03:30:39.794495+0000 mgr.a (mgr.14388) 13685 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:41 smithi049 bash[23528]: audit 2024-09-21T03:30:39.867310+0000 mgr.a (mgr.14388) 13686 : audit [DBG] from='client.297651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:43 smithi044 bash[22676]: cluster 2024-09-21T03:30:41.797425+0000 mgr.a (mgr.14388) 13687 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:30:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:43 smithi179 bash[23186]: cluster 2024-09-21T03:30:41.797425+0000 mgr.a (mgr.14388) 13687 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:30:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:43 smithi049 bash[23528]: cluster 2024-09-21T03:30:41.797425+0000 mgr.a (mgr.14388) 13687 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:30:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:45 smithi044 bash[22676]: cluster 2024-09-21T03:30:43.798411+0000 mgr.a (mgr.14388) 13688 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:30:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:45 smithi179 bash[23186]: cluster 2024-09-21T03:30:43.798411+0000 mgr.a (mgr.14388) 13688 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:30:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:45 smithi049 bash[23528]: cluster 2024-09-21T03:30:43.798411+0000 mgr.a (mgr.14388) 13688 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:30:46.060 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:46.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:46.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:46.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:46.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:47 smithi044 bash[22676]: audit 2024-09-21T03:30:45.625567+0000 mgr.a (mgr.14388) 13689 : audit [DBG] from='client.297729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:47 smithi044 bash[22676]: cluster 2024-09-21T03:30:45.800297+0000 mgr.a (mgr.14388) 13690 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:47 smithi179 bash[23186]: audit 2024-09-21T03:30:45.625567+0000 mgr.a (mgr.14388) 13689 : audit [DBG] from='client.297729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:47 smithi179 bash[23186]: cluster 2024-09-21T03:30:45.800297+0000 mgr.a (mgr.14388) 13690 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:47 smithi049 bash[23528]: audit 2024-09-21T03:30:45.625567+0000 mgr.a (mgr.14388) 13689 : audit [DBG] from='client.297729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:47 smithi049 bash[23528]: cluster 2024-09-21T03:30:45.800297+0000 mgr.a (mgr.14388) 13690 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:49 smithi044 bash[22676]: cluster 2024-09-21T03:30:47.801185+0000 mgr.a (mgr.14388) 13691 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:30:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:49 smithi044 bash[22676]: audit 2024-09-21T03:30:48.187244+0000 mon.a (mon.0) 11066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:49 smithi044 bash[22676]: audit 2024-09-21T03:30:48.194301+0000 mon.a (mon.0) 11067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:49 smithi044 bash[22676]: audit 2024-09-21T03:30:48.204528+0000 mon.a (mon.0) 11068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:49 smithi044 bash[22676]: audit 2024-09-21T03:30:48.694015+0000 mon.a (mon.0) 11069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:49 smithi044 bash[22676]: audit 2024-09-21T03:30:48.702547+0000 mon.a (mon.0) 11070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:49 smithi044 bash[22676]: audit 2024-09-21T03:30:48.712579+0000 mon.a (mon.0) 11071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:49 smithi179 bash[23186]: cluster 2024-09-21T03:30:47.801185+0000 mgr.a (mgr.14388) 13691 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:30:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:49 smithi179 bash[23186]: audit 2024-09-21T03:30:48.187244+0000 mon.a (mon.0) 11066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:49 smithi179 bash[23186]: audit 2024-09-21T03:30:48.194301+0000 mon.a (mon.0) 11067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:49 smithi179 bash[23186]: audit 2024-09-21T03:30:48.204528+0000 mon.a (mon.0) 11068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:49 smithi179 bash[23186]: audit 2024-09-21T03:30:48.694015+0000 mon.a (mon.0) 11069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:49 smithi179 bash[23186]: audit 2024-09-21T03:30:48.702547+0000 mon.a (mon.0) 11070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:49 smithi179 bash[23186]: audit 2024-09-21T03:30:48.712579+0000 mon.a (mon.0) 11071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:49 smithi049 bash[23528]: cluster 2024-09-21T03:30:47.801185+0000 mgr.a (mgr.14388) 13691 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:30:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:49 smithi049 bash[23528]: audit 2024-09-21T03:30:48.187244+0000 mon.a (mon.0) 11066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:49 smithi049 bash[23528]: audit 2024-09-21T03:30:48.194301+0000 mon.a (mon.0) 11067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:49 smithi049 bash[23528]: audit 2024-09-21T03:30:48.204528+0000 mon.a (mon.0) 11068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:49 smithi049 bash[23528]: audit 2024-09-21T03:30:48.694015+0000 mon.a (mon.0) 11069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:49 smithi049 bash[23528]: audit 2024-09-21T03:30:48.702547+0000 mon.a (mon.0) 11070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:49 smithi049 bash[23528]: audit 2024-09-21T03:30:48.712579+0000 mon.a (mon.0) 11071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:51.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:51.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:51.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:51 smithi044 bash[22676]: cluster 2024-09-21T03:30:49.801717+0000 mgr.a (mgr.14388) 13692 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:30:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:51 smithi179 bash[23186]: cluster 2024-09-21T03:30:49.801717+0000 mgr.a (mgr.14388) 13692 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:30:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:51 smithi049 bash[23528]: cluster 2024-09-21T03:30:49.801717+0000 mgr.a (mgr.14388) 13692 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:30:51.842 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:53 smithi044 bash[22676]: audit 2024-09-21T03:30:51.395337+0000 mgr.a (mgr.14388) 13693 : audit [DBG] from='client.297804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:53 smithi044 bash[22676]: cluster 2024-09-21T03:30:51.803199+0000 mgr.a (mgr.14388) 13694 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:53 smithi179 bash[23186]: audit 2024-09-21T03:30:51.395337+0000 mgr.a (mgr.14388) 13693 : audit [DBG] from='client.297804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:53 smithi179 bash[23186]: cluster 2024-09-21T03:30:51.803199+0000 mgr.a (mgr.14388) 13694 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:53 smithi049 bash[23528]: audit 2024-09-21T03:30:51.395337+0000 mgr.a (mgr.14388) 13693 : audit [DBG] from='client.297804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:53 smithi049 bash[23528]: cluster 2024-09-21T03:30:51.803199+0000 mgr.a (mgr.14388) 13694 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:55 smithi044 bash[22676]: cluster 2024-09-21T03:30:53.803916+0000 mgr.a (mgr.14388) 13695 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:30:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:55 smithi179 bash[23186]: cluster 2024-09-21T03:30:53.803916+0000 mgr.a (mgr.14388) 13695 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:30:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:55 smithi049 bash[23528]: cluster 2024-09-21T03:30:53.803916+0000 mgr.a (mgr.14388) 13695 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:30:56.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:30:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:30:56.844 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:30:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:57 smithi044 bash[22676]: cluster 2024-09-21T03:30:55.805944+0000 mgr.a (mgr.14388) 13696 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:57 smithi044 bash[22676]: audit 2024-09-21T03:30:56.419456+0000 mon.a (mon.0) 11072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:57 smithi044 bash[22676]: audit 2024-09-21T03:30:56.429304+0000 mon.a (mon.0) 11073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:57 smithi044 bash[22676]: audit 2024-09-21T03:30:56.441039+0000 mon.a (mon.0) 11074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:57 smithi179 bash[23186]: cluster 2024-09-21T03:30:55.805944+0000 mgr.a (mgr.14388) 13696 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:57 smithi179 bash[23186]: audit 2024-09-21T03:30:56.419456+0000 mon.a (mon.0) 11072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:57 smithi179 bash[23186]: audit 2024-09-21T03:30:56.429304+0000 mon.a (mon.0) 11073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:57 smithi179 bash[23186]: audit 2024-09-21T03:30:56.441039+0000 mon.a (mon.0) 11074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:57 smithi049 bash[23528]: cluster 2024-09-21T03:30:55.805944+0000 mgr.a (mgr.14388) 13696 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:30:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:57 smithi049 bash[23528]: audit 2024-09-21T03:30:56.419456+0000 mon.a (mon.0) 11072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:57 smithi049 bash[23528]: audit 2024-09-21T03:30:56.429304+0000 mon.a (mon.0) 11073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:57 smithi049 bash[23528]: audit 2024-09-21T03:30:56.441039+0000 mon.a (mon.0) 11074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:30:57.628 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:30:57.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:30:57.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:30:57.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:30:57.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:30:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:58 smithi044 bash[22676]: audit 2024-09-21T03:30:57.181821+0000 mgr.a (mgr.14388) 13697 : audit [DBG] from='client.297879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:58 smithi179 bash[23186]: audit 2024-09-21T03:30:57.181821+0000 mgr.a (mgr.14388) 13697 : audit [DBG] from='client.297879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:58.537 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:58 smithi049 bash[23528]: audit 2024-09-21T03:30:57.181821+0000 mgr.a (mgr.14388) 13697 : audit [DBG] from='client.297879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:30:59 smithi044 bash[22676]: cluster 2024-09-21T03:30:57.806816+0000 mgr.a (mgr.14388) 13698 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:30:59 smithi179 bash[23186]: cluster 2024-09-21T03:30:57.806816+0000 mgr.a (mgr.14388) 13698 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:30:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:30:59 smithi049 bash[23528]: cluster 2024-09-21T03:30:57.806816+0000 mgr.a (mgr.14388) 13698 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:00.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:31:00 smithi044 bash[22930]: debug 2024-09-21T03:31:00.263+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:31:00.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:31:00 smithi044 bash[22930]: debug 2024-09-21T03:31:00.263+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:31:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:00 smithi044 bash[22676]: audit 2024-09-21T03:30:59.443555+0000 mon.a (mon.0) 11075 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:31:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:00 smithi044 bash[22676]: audit 2024-09-21T03:30:59.455226+0000 mon.a (mon.0) 11076 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:31:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:00 smithi044 bash[22676]: audit 2024-09-21T03:30:59.457080+0000 mon.a (mon.0) 11077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:31:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:00 smithi044 bash[22676]: audit 2024-09-21T03:30:59.468752+0000 mon.a (mon.0) 11078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:00 smithi044 bash[22676]: audit 2024-09-21T03:30:59.475124+0000 mon.a (mon.0) 11079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:31:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:00 smithi179 bash[23186]: audit 2024-09-21T03:30:59.443555+0000 mon.a (mon.0) 11075 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:31:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:00 smithi179 bash[23186]: audit 2024-09-21T03:30:59.455226+0000 mon.a (mon.0) 11076 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:31:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:00 smithi179 bash[23186]: audit 2024-09-21T03:30:59.457080+0000 mon.a (mon.0) 11077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:31:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:00 smithi179 bash[23186]: audit 2024-09-21T03:30:59.468752+0000 mon.a (mon.0) 11078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:00 smithi179 bash[23186]: audit 2024-09-21T03:30:59.475124+0000 mon.a (mon.0) 11079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:31:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:00 smithi049 bash[23528]: audit 2024-09-21T03:30:59.443555+0000 mon.a (mon.0) 11075 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:31:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:00 smithi049 bash[23528]: audit 2024-09-21T03:30:59.455226+0000 mon.a (mon.0) 11076 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:31:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:00 smithi049 bash[23528]: audit 2024-09-21T03:30:59.457080+0000 mon.a (mon.0) 11077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:31:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:00 smithi049 bash[23528]: audit 2024-09-21T03:30:59.468752+0000 mon.a (mon.0) 11078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:00 smithi049 bash[23528]: audit 2024-09-21T03:30:59.475124+0000 mon.a (mon.0) 11079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:31:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:01 smithi044 bash[22676]: audit 2024-09-21T03:30:59.477761+0000 mgr.a (mgr.14388) 13699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:31:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:01 smithi044 bash[22676]: cluster 2024-09-21T03:30:59.807379+0000 mgr.a (mgr.14388) 13700 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:01 smithi044 bash[22676]: audit 2024-09-21T03:31:00.266879+0000 mgr.a (mgr.14388) 13701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:31:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:01 smithi044 bash[22676]: cephadm 2024-09-21T03:31:00.268020+0000 mgr.a (mgr.14388) 13702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:31:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:01 smithi179 bash[23186]: audit 2024-09-21T03:30:59.477761+0000 mgr.a (mgr.14388) 13699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:31:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:01 smithi179 bash[23186]: cluster 2024-09-21T03:30:59.807379+0000 mgr.a (mgr.14388) 13700 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:01 smithi179 bash[23186]: audit 2024-09-21T03:31:00.266879+0000 mgr.a (mgr.14388) 13701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:31:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:01 smithi179 bash[23186]: cephadm 2024-09-21T03:31:00.268020+0000 mgr.a (mgr.14388) 13702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:31:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:01 smithi049 bash[23528]: audit 2024-09-21T03:30:59.477761+0000 mgr.a (mgr.14388) 13699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:31:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:01 smithi049 bash[23528]: cluster 2024-09-21T03:30:59.807379+0000 mgr.a (mgr.14388) 13700 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:01 smithi049 bash[23528]: audit 2024-09-21T03:31:00.266879+0000 mgr.a (mgr.14388) 13701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:31:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:01 smithi049 bash[23528]: cephadm 2024-09-21T03:31:00.268020+0000 mgr.a (mgr.14388) 13702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:31:02.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:03.367 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:03.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:03.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:03.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:03.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:03 smithi044 bash[22676]: cluster 2024-09-21T03:31:01.809843+0000 mgr.a (mgr.14388) 13703 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T03:31:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:03 smithi179 bash[23186]: cluster 2024-09-21T03:31:01.809843+0000 mgr.a (mgr.14388) 13703 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T03:31:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:03 smithi049 bash[23528]: cluster 2024-09-21T03:31:01.809843+0000 mgr.a (mgr.14388) 13703 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T03:31:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:04 smithi044 bash[22676]: audit 2024-09-21T03:31:02.955253+0000 mgr.a (mgr.14388) 13704 : audit [DBG] from='client.298062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:04 smithi179 bash[23186]: audit 2024-09-21T03:31:02.955253+0000 mgr.a (mgr.14388) 13704 : audit [DBG] from='client.298062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:04 smithi049 bash[23528]: audit 2024-09-21T03:31:02.955253+0000 mgr.a (mgr.14388) 13704 : audit [DBG] from='client.298062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:05 smithi044 bash[22676]: cluster 2024-09-21T03:31:03.810811+0000 mgr.a (mgr.14388) 13705 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:31:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:05 smithi179 bash[23186]: cluster 2024-09-21T03:31:03.810811+0000 mgr.a (mgr.14388) 13705 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:31:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:05 smithi049 bash[23528]: cluster 2024-09-21T03:31:03.810811+0000 mgr.a (mgr.14388) 13705 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:31:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:07 smithi179 bash[23186]: cluster 2024-09-21T03:31:05.813027+0000 mgr.a (mgr.14388) 13706 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:07 smithi049 bash[23528]: cluster 2024-09-21T03:31:05.813027+0000 mgr.a (mgr.14388) 13706 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:07 smithi044 bash[22676]: cluster 2024-09-21T03:31:05.813027+0000 mgr.a (mgr.14388) 13706 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:08.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:08.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:08.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:09.110 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:09.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:09.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:09 smithi179 bash[23186]: cluster 2024-09-21T03:31:07.813807+0000 mgr.a (mgr.14388) 13707 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:09 smithi179 bash[23186]: audit 2024-09-21T03:31:08.405908+0000 mon.a (mon.0) 11080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:09 smithi179 bash[23186]: audit 2024-09-21T03:31:08.414311+0000 mon.a (mon.0) 11081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:09 smithi179 bash[23186]: audit 2024-09-21T03:31:08.425355+0000 mon.a (mon.0) 11082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:09 smithi179 bash[23186]: audit 2024-09-21T03:31:08.858460+0000 mon.a (mon.0) 11083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:09 smithi179 bash[23186]: audit 2024-09-21T03:31:08.863511+0000 mon.a (mon.0) 11084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:09 smithi179 bash[23186]: audit 2024-09-21T03:31:08.868605+0000 mon.a (mon.0) 11085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:09 smithi049 bash[23528]: cluster 2024-09-21T03:31:07.813807+0000 mgr.a (mgr.14388) 13707 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:09 smithi049 bash[23528]: audit 2024-09-21T03:31:08.405908+0000 mon.a (mon.0) 11080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:09 smithi049 bash[23528]: audit 2024-09-21T03:31:08.414311+0000 mon.a (mon.0) 11081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:09 smithi049 bash[23528]: audit 2024-09-21T03:31:08.425355+0000 mon.a (mon.0) 11082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:09 smithi049 bash[23528]: audit 2024-09-21T03:31:08.858460+0000 mon.a (mon.0) 11083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:09 smithi049 bash[23528]: audit 2024-09-21T03:31:08.863511+0000 mon.a (mon.0) 11084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:09 smithi049 bash[23528]: audit 2024-09-21T03:31:08.868605+0000 mon.a (mon.0) 11085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:09 smithi044 bash[22676]: cluster 2024-09-21T03:31:07.813807+0000 mgr.a (mgr.14388) 13707 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:09 smithi044 bash[22676]: audit 2024-09-21T03:31:08.405908+0000 mon.a (mon.0) 11080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:09 smithi044 bash[22676]: audit 2024-09-21T03:31:08.414311+0000 mon.a (mon.0) 11081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:09 smithi044 bash[22676]: audit 2024-09-21T03:31:08.425355+0000 mon.a (mon.0) 11082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:09 smithi044 bash[22676]: audit 2024-09-21T03:31:08.858460+0000 mon.a (mon.0) 11083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:09 smithi044 bash[22676]: audit 2024-09-21T03:31:08.863511+0000 mon.a (mon.0) 11084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:09 smithi044 bash[22676]: audit 2024-09-21T03:31:08.868605+0000 mon.a (mon.0) 11085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:10 smithi049 bash[23528]: audit 2024-09-21T03:31:08.703149+0000 mgr.a (mgr.14388) 13708 : audit [DBG] from='client.298137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:10 smithi044 bash[22676]: audit 2024-09-21T03:31:08.703149+0000 mgr.a (mgr.14388) 13708 : audit [DBG] from='client.298137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:10.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:10 smithi179 bash[23186]: audit 2024-09-21T03:31:08.703149+0000 mgr.a (mgr.14388) 13708 : audit [DBG] from='client.298137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:11 smithi049 bash[23528]: cluster 2024-09-21T03:31:09.814883+0000 mgr.a (mgr.14388) 13709 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:11 smithi044 bash[22676]: cluster 2024-09-21T03:31:09.814883+0000 mgr.a (mgr.14388) 13709 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:11 smithi179 bash[23186]: cluster 2024-09-21T03:31:09.814883+0000 mgr.a (mgr.14388) 13709 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:13 smithi049 bash[23528]: cluster 2024-09-21T03:31:11.817162+0000 mgr.a (mgr.14388) 13710 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:13 smithi044 bash[22676]: cluster 2024-09-21T03:31:11.817162+0000 mgr.a (mgr.14388) 13710 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:13 smithi179 bash[23186]: cluster 2024-09-21T03:31:11.817162+0000 mgr.a (mgr.14388) 13710 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:31:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:14.889 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:14.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:14.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:14.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:14.889 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:15 smithi049 bash[23528]: cluster 2024-09-21T03:31:13.817913+0000 mgr.a (mgr.14388) 13711 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:31:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:15 smithi044 bash[22676]: cluster 2024-09-21T03:31:13.817913+0000 mgr.a (mgr.14388) 13711 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:31:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:15 smithi179 bash[23186]: cluster 2024-09-21T03:31:13.817913+0000 mgr.a (mgr.14388) 13711 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:31:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:16 smithi049 bash[23528]: audit 2024-09-21T03:31:14.447871+0000 mgr.a (mgr.14388) 13712 : audit [DBG] from='client.298212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:16 smithi044 bash[22676]: audit 2024-09-21T03:31:14.447871+0000 mgr.a (mgr.14388) 13712 : audit [DBG] from='client.298212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:16.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:16 smithi179 bash[23186]: audit 2024-09-21T03:31:14.447871+0000 mgr.a (mgr.14388) 13712 : audit [DBG] from='client.298212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:17 smithi049 bash[23528]: cluster 2024-09-21T03:31:15.820286+0000 mgr.a (mgr.14388) 13713 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:31:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:17 smithi049 bash[23528]: audit 2024-09-21T03:31:16.660244+0000 mon.a (mon.0) 11086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:17 smithi049 bash[23528]: audit 2024-09-21T03:31:16.668996+0000 mon.a (mon.0) 11087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:17 smithi049 bash[23528]: audit 2024-09-21T03:31:16.679472+0000 mon.a (mon.0) 11088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:17 smithi044 bash[22676]: cluster 2024-09-21T03:31:15.820286+0000 mgr.a (mgr.14388) 13713 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:31:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:17 smithi044 bash[22676]: audit 2024-09-21T03:31:16.660244+0000 mon.a (mon.0) 11086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:17 smithi044 bash[22676]: audit 2024-09-21T03:31:16.668996+0000 mon.a (mon.0) 11087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:17 smithi044 bash[22676]: audit 2024-09-21T03:31:16.679472+0000 mon.a (mon.0) 11088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:17 smithi179 bash[23186]: cluster 2024-09-21T03:31:15.820286+0000 mgr.a (mgr.14388) 13713 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:31:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:17 smithi179 bash[23186]: audit 2024-09-21T03:31:16.660244+0000 mon.a (mon.0) 11086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:17 smithi179 bash[23186]: audit 2024-09-21T03:31:16.668996+0000 mon.a (mon.0) 11087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:17 smithi179 bash[23186]: audit 2024-09-21T03:31:16.679472+0000 mon.a (mon.0) 11088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:19 smithi049 bash[23528]: cluster 2024-09-21T03:31:17.821118+0000 mgr.a (mgr.14388) 13714 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:19.633 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:19 smithi044 bash[22676]: cluster 2024-09-21T03:31:17.821118+0000 mgr.a (mgr.14388) 13714 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:19 smithi179 bash[23186]: cluster 2024-09-21T03:31:17.821118+0000 mgr.a (mgr.14388) 13714 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:19.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:19.891 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:19.891 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:20.684 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:21.542 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:21 smithi044 bash[22676]: cluster 2024-09-21T03:31:19.821907+0000 mgr.a (mgr.14388) 13715 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:21.542 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:21 smithi044 bash[22676]: audit 2024-09-21T03:31:20.228875+0000 mgr.a (mgr.14388) 13716 : audit [DBG] from='client.298287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:21 smithi049 bash[23528]: cluster 2024-09-21T03:31:19.821907+0000 mgr.a (mgr.14388) 13715 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:21 smithi049 bash[23528]: audit 2024-09-21T03:31:20.228875+0000 mgr.a (mgr.14388) 13716 : audit [DBG] from='client.298287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:21 smithi179 bash[23186]: cluster 2024-09-21T03:31:19.821907+0000 mgr.a (mgr.14388) 13715 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:21 smithi179 bash[23186]: audit 2024-09-21T03:31:20.228875+0000 mgr.a (mgr.14388) 13716 : audit [DBG] from='client.298287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:23 smithi044 bash[22676]: cluster 2024-09-21T03:31:21.824972+0000 mgr.a (mgr.14388) 13717 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:23 smithi049 bash[23528]: cluster 2024-09-21T03:31:21.824972+0000 mgr.a (mgr.14388) 13717 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:23.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:23 smithi179 bash[23186]: cluster 2024-09-21T03:31:21.824972+0000 mgr.a (mgr.14388) 13717 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:25 smithi049 bash[23528]: cluster 2024-09-21T03:31:23.825984+0000 mgr.a (mgr.14388) 13718 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:25.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:25.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:25 smithi044 bash[22676]: cluster 2024-09-21T03:31:23.825984+0000 mgr.a (mgr.14388) 13718 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:25 smithi179 bash[23186]: cluster 2024-09-21T03:31:23.825984+0000 mgr.a (mgr.14388) 13718 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:26.463 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:26.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:26.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:26.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:26.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:27 smithi044 bash[22676]: cluster 2024-09-21T03:31:25.827350+0000 mgr.a (mgr.14388) 13719 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:27 smithi044 bash[22676]: audit 2024-09-21T03:31:26.023341+0000 mgr.a (mgr.14388) 13720 : audit [DBG] from='client.298365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:27 smithi179 bash[23186]: cluster 2024-09-21T03:31:25.827350+0000 mgr.a (mgr.14388) 13719 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:27.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:27 smithi179 bash[23186]: audit 2024-09-21T03:31:26.023341+0000 mgr.a (mgr.14388) 13720 : audit [DBG] from='client.298365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:27 smithi049 bash[23528]: cluster 2024-09-21T03:31:25.827350+0000 mgr.a (mgr.14388) 13719 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:27 smithi049 bash[23528]: audit 2024-09-21T03:31:26.023341+0000 mgr.a (mgr.14388) 13720 : audit [DBG] from='client.298365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:29 smithi179 bash[23186]: cluster 2024-09-21T03:31:27.828317+0000 mgr.a (mgr.14388) 13721 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:29 smithi179 bash[23186]: audit 2024-09-21T03:31:28.640802+0000 mon.a (mon.0) 11089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:29 smithi179 bash[23186]: audit 2024-09-21T03:31:28.650714+0000 mon.a (mon.0) 11090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:29 smithi179 bash[23186]: audit 2024-09-21T03:31:28.662685+0000 mon.a (mon.0) 11091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:29 smithi179 bash[23186]: audit 2024-09-21T03:31:29.060770+0000 mon.a (mon.0) 11092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:29 smithi179 bash[23186]: audit 2024-09-21T03:31:29.070507+0000 mon.a (mon.0) 11093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:29 smithi179 bash[23186]: audit 2024-09-21T03:31:29.081770+0000 mon.a (mon.0) 11094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:29 smithi044 bash[22676]: cluster 2024-09-21T03:31:27.828317+0000 mgr.a (mgr.14388) 13721 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:29 smithi044 bash[22676]: audit 2024-09-21T03:31:28.640802+0000 mon.a (mon.0) 11089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:29 smithi044 bash[22676]: audit 2024-09-21T03:31:28.650714+0000 mon.a (mon.0) 11090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:29 smithi044 bash[22676]: audit 2024-09-21T03:31:28.662685+0000 mon.a (mon.0) 11091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:29 smithi044 bash[22676]: audit 2024-09-21T03:31:29.060770+0000 mon.a (mon.0) 11092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:29 smithi044 bash[22676]: audit 2024-09-21T03:31:29.070507+0000 mon.a (mon.0) 11093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:29 smithi044 bash[22676]: audit 2024-09-21T03:31:29.081770+0000 mon.a (mon.0) 11094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:29 smithi049 bash[23528]: cluster 2024-09-21T03:31:27.828317+0000 mgr.a (mgr.14388) 13721 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:29 smithi049 bash[23528]: audit 2024-09-21T03:31:28.640802+0000 mon.a (mon.0) 11089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:29 smithi049 bash[23528]: audit 2024-09-21T03:31:28.650714+0000 mon.a (mon.0) 11090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:29 smithi049 bash[23528]: audit 2024-09-21T03:31:28.662685+0000 mon.a (mon.0) 11091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:29 smithi049 bash[23528]: audit 2024-09-21T03:31:29.060770+0000 mon.a (mon.0) 11092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:29 smithi049 bash[23528]: audit 2024-09-21T03:31:29.070507+0000 mon.a (mon.0) 11093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:29 smithi049 bash[23528]: audit 2024-09-21T03:31:29.081770+0000 mon.a (mon.0) 11094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:30 smithi044 bash[22676]: cluster 2024-09-21T03:31:29.829115+0000 mgr.a (mgr.14388) 13722 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:31:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:30 smithi179 bash[23186]: cluster 2024-09-21T03:31:29.829115+0000 mgr.a (mgr.14388) 13722 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:31:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:30 smithi049 bash[23528]: cluster 2024-09-21T03:31:29.829115+0000 mgr.a (mgr.14388) 13722 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:31:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:32.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:32.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:32.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:32.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:32 smithi044 bash[22676]: audit 2024-09-21T03:31:31.800363+0000 mgr.a (mgr.14388) 13723 : audit [DBG] from='client.298440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:32 smithi044 bash[22676]: cluster 2024-09-21T03:31:31.831305+0000 mgr.a (mgr.14388) 13724 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:32 smithi179 bash[23186]: audit 2024-09-21T03:31:31.800363+0000 mgr.a (mgr.14388) 13723 : audit [DBG] from='client.298440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:33.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:32 smithi179 bash[23186]: cluster 2024-09-21T03:31:31.831305+0000 mgr.a (mgr.14388) 13724 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:32 smithi049 bash[23528]: audit 2024-09-21T03:31:31.800363+0000 mgr.a (mgr.14388) 13723 : audit [DBG] from='client.298440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:32 smithi049 bash[23528]: cluster 2024-09-21T03:31:31.831305+0000 mgr.a (mgr.14388) 13724 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:35.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:34 smithi044 bash[22676]: cluster 2024-09-21T03:31:33.832327+0000 mgr.a (mgr.14388) 13725 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:35.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:34 smithi179 bash[23186]: cluster 2024-09-21T03:31:33.832327+0000 mgr.a (mgr.14388) 13725 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:34 smithi049 bash[23528]: cluster 2024-09-21T03:31:33.832327+0000 mgr.a (mgr.14388) 13725 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:36 smithi044 bash[22676]: cluster 2024-09-21T03:31:35.834553+0000 mgr.a (mgr.14388) 13726 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:37.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:36 smithi044 bash[22676]: audit 2024-09-21T03:31:36.876347+0000 mon.a (mon.0) 11095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:36 smithi044 bash[22676]: audit 2024-09-21T03:31:36.886193+0000 mon.a (mon.0) 11096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:36 smithi179 bash[23186]: cluster 2024-09-21T03:31:35.834553+0000 mgr.a (mgr.14388) 13726 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:36 smithi179 bash[23186]: audit 2024-09-21T03:31:36.876347+0000 mon.a (mon.0) 11095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:37.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:36 smithi179 bash[23186]: audit 2024-09-21T03:31:36.886193+0000 mon.a (mon.0) 11096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:36 smithi049 bash[23528]: cluster 2024-09-21T03:31:35.834553+0000 mgr.a (mgr.14388) 13726 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:36 smithi049 bash[23528]: audit 2024-09-21T03:31:36.876347+0000 mon.a (mon.0) 11095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:36 smithi049 bash[23528]: audit 2024-09-21T03:31:36.886193+0000 mon.a (mon.0) 11096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:38.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:38.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:38.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:38.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:38.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:38.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:37 smithi044 bash[22676]: audit 2024-09-21T03:31:36.897792+0000 mon.a (mon.0) 11097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:38.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:37 smithi179 bash[23186]: audit 2024-09-21T03:31:36.897792+0000 mon.a (mon.0) 11097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:37 smithi049 bash[23528]: audit 2024-09-21T03:31:36.897792+0000 mon.a (mon.0) 11097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:38 smithi044 bash[22676]: audit 2024-09-21T03:31:37.588120+0000 mgr.a (mgr.14388) 13727 : audit [DBG] from='client.298518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:39.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:38 smithi044 bash[22676]: cluster 2024-09-21T03:31:37.835108+0000 mgr.a (mgr.14388) 13728 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:38 smithi179 bash[23186]: audit 2024-09-21T03:31:37.588120+0000 mgr.a (mgr.14388) 13727 : audit [DBG] from='client.298518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:39.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:38 smithi179 bash[23186]: cluster 2024-09-21T03:31:37.835108+0000 mgr.a (mgr.14388) 13728 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:39.289 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:38 smithi049 bash[23528]: audit 2024-09-21T03:31:37.588120+0000 mgr.a (mgr.14388) 13727 : audit [DBG] from='client.298518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:39.289 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:38 smithi049 bash[23528]: cluster 2024-09-21T03:31:37.835108+0000 mgr.a (mgr.14388) 13728 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:41.136 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:40 smithi044 bash[22676]: cluster 2024-09-21T03:31:39.836014+0000 mgr.a (mgr.14388) 13729 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:41.248 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:40 smithi179 bash[23186]: cluster 2024-09-21T03:31:39.836014+0000 mgr.a (mgr.14388) 13729 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:40 smithi049 bash[23528]: cluster 2024-09-21T03:31:39.836014+0000 mgr.a (mgr.14388) 13729 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:42 smithi044 bash[22676]: cluster 2024-09-21T03:31:41.838308+0000 mgr.a (mgr.14388) 13730 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:43.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:42 smithi179 bash[23186]: cluster 2024-09-21T03:31:41.838308+0000 mgr.a (mgr.14388) 13730 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:42 smithi049 bash[23528]: cluster 2024-09-21T03:31:41.838308+0000 mgr.a (mgr.14388) 13730 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:43.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:43.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:43.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:43.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:43.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:44 smithi044 bash[22676]: audit 2024-09-21T03:31:43.342849+0000 mgr.a (mgr.14388) 13731 : audit [DBG] from='client.298593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:44 smithi044 bash[22676]: cluster 2024-09-21T03:31:43.839320+0000 mgr.a (mgr.14388) 13732 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:44 smithi179 bash[23186]: audit 2024-09-21T03:31:43.342849+0000 mgr.a (mgr.14388) 13731 : audit [DBG] from='client.298593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:45.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:44 smithi179 bash[23186]: cluster 2024-09-21T03:31:43.839320+0000 mgr.a (mgr.14388) 13732 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:44 smithi049 bash[23528]: audit 2024-09-21T03:31:43.342849+0000 mgr.a (mgr.14388) 13731 : audit [DBG] from='client.298593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:44 smithi049 bash[23528]: cluster 2024-09-21T03:31:43.839320+0000 mgr.a (mgr.14388) 13732 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:46 smithi044 bash[22676]: cluster 2024-09-21T03:31:45.841574+0000 mgr.a (mgr.14388) 13733 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:46 smithi179 bash[23186]: cluster 2024-09-21T03:31:45.841574+0000 mgr.a (mgr.14388) 13733 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:46 smithi049 bash[23528]: cluster 2024-09-21T03:31:45.841574+0000 mgr.a (mgr.14388) 13733 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:48.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:48.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:48.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:48 smithi044 bash[22676]: cluster 2024-09-21T03:31:47.842332+0000 mgr.a (mgr.14388) 13734 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:48 smithi044 bash[22676]: audit 2024-09-21T03:31:48.867141+0000 mon.a (mon.0) 11098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:48 smithi044 bash[22676]: audit 2024-09-21T03:31:48.872231+0000 mon.a (mon.0) 11099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:48 smithi044 bash[22676]: audit 2024-09-21T03:31:48.882773+0000 mon.a (mon.0) 11100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:48 smithi179 bash[23186]: cluster 2024-09-21T03:31:47.842332+0000 mgr.a (mgr.14388) 13734 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:48 smithi179 bash[23186]: audit 2024-09-21T03:31:48.867141+0000 mon.a (mon.0) 11098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:48 smithi179 bash[23186]: audit 2024-09-21T03:31:48.872231+0000 mon.a (mon.0) 11099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:48 smithi179 bash[23186]: audit 2024-09-21T03:31:48.882773+0000 mon.a (mon.0) 11100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:48 smithi049 bash[23528]: cluster 2024-09-21T03:31:47.842332+0000 mgr.a (mgr.14388) 13734 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:48 smithi049 bash[23528]: audit 2024-09-21T03:31:48.867141+0000 mon.a (mon.0) 11098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:48 smithi049 bash[23528]: audit 2024-09-21T03:31:48.872231+0000 mon.a (mon.0) 11099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:48 smithi049 bash[23528]: audit 2024-09-21T03:31:48.882773+0000 mon.a (mon.0) 11100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:49.569 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:49.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:49.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:50 smithi049 bash[23528]: audit 2024-09-21T03:31:49.110258+0000 mgr.a (mgr.14388) 13735 : audit [DBG] from='client.298668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:50 smithi049 bash[23528]: audit 2024-09-21T03:31:49.278474+0000 mon.a (mon.0) 11101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:50 smithi049 bash[23528]: audit 2024-09-21T03:31:49.286166+0000 mon.a (mon.0) 11102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:50 smithi049 bash[23528]: audit 2024-09-21T03:31:49.295013+0000 mon.a (mon.0) 11103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:50 smithi044 bash[22676]: audit 2024-09-21T03:31:49.110258+0000 mgr.a (mgr.14388) 13735 : audit [DBG] from='client.298668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:50 smithi044 bash[22676]: audit 2024-09-21T03:31:49.278474+0000 mon.a (mon.0) 11101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:50 smithi044 bash[22676]: audit 2024-09-21T03:31:49.286166+0000 mon.a (mon.0) 11102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:50 smithi044 bash[22676]: audit 2024-09-21T03:31:49.295013+0000 mon.a (mon.0) 11103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:50 smithi179 bash[23186]: audit 2024-09-21T03:31:49.110258+0000 mgr.a (mgr.14388) 13735 : audit [DBG] from='client.298668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:50 smithi179 bash[23186]: audit 2024-09-21T03:31:49.278474+0000 mon.a (mon.0) 11101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:50 smithi179 bash[23186]: audit 2024-09-21T03:31:49.286166+0000 mon.a (mon.0) 11102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:50 smithi179 bash[23186]: audit 2024-09-21T03:31:49.295013+0000 mon.a (mon.0) 11103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:51 smithi049 bash[23528]: cluster 2024-09-21T03:31:49.843310+0000 mgr.a (mgr.14388) 13736 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:51 smithi044 bash[22676]: cluster 2024-09-21T03:31:49.843310+0000 mgr.a (mgr.14388) 13736 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:51 smithi179 bash[23186]: cluster 2024-09-21T03:31:49.843310+0000 mgr.a (mgr.14388) 13736 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:53 smithi049 bash[23528]: cluster 2024-09-21T03:31:51.845624+0000 mgr.a (mgr.14388) 13737 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:53 smithi044 bash[22676]: cluster 2024-09-21T03:31:51.845624+0000 mgr.a (mgr.14388) 13737 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:53.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:53 smithi179 bash[23186]: cluster 2024-09-21T03:31:51.845624+0000 mgr.a (mgr.14388) 13737 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:31:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:31:54.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:31:54.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:31:55.361 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:31:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:31:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:31:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:31:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:31:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:55 smithi044 bash[22676]: cluster 2024-09-21T03:31:53.846422+0000 mgr.a (mgr.14388) 13738 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:55 smithi179 bash[23186]: cluster 2024-09-21T03:31:53.846422+0000 mgr.a (mgr.14388) 13738 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:55 smithi049 bash[23528]: cluster 2024-09-21T03:31:53.846422+0000 mgr.a (mgr.14388) 13738 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:56 smithi044 bash[22676]: audit 2024-09-21T03:31:54.906320+0000 mgr.a (mgr.14388) 13739 : audit [DBG] from='client.298743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:56.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:56 smithi179 bash[23186]: audit 2024-09-21T03:31:54.906320+0000 mgr.a (mgr.14388) 13739 : audit [DBG] from='client.298743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:56 smithi049 bash[23528]: audit 2024-09-21T03:31:54.906320+0000 mgr.a (mgr.14388) 13739 : audit [DBG] from='client.298743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:57 smithi049 bash[23528]: cluster 2024-09-21T03:31:55.849430+0000 mgr.a (mgr.14388) 13740 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:57 smithi049 bash[23528]: audit 2024-09-21T03:31:57.091572+0000 mon.a (mon.0) 11104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:57 smithi049 bash[23528]: audit 2024-09-21T03:31:57.101680+0000 mon.a (mon.0) 11105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:57 smithi049 bash[23528]: audit 2024-09-21T03:31:57.113469+0000 mon.a (mon.0) 11106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:57 smithi044 bash[22676]: cluster 2024-09-21T03:31:55.849430+0000 mgr.a (mgr.14388) 13740 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:57 smithi044 bash[22676]: audit 2024-09-21T03:31:57.091572+0000 mon.a (mon.0) 11104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:57 smithi044 bash[22676]: audit 2024-09-21T03:31:57.101680+0000 mon.a (mon.0) 11105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:57 smithi044 bash[22676]: audit 2024-09-21T03:31:57.113469+0000 mon.a (mon.0) 11106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:57 smithi179 bash[23186]: cluster 2024-09-21T03:31:55.849430+0000 mgr.a (mgr.14388) 13740 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:31:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:57 smithi179 bash[23186]: audit 2024-09-21T03:31:57.091572+0000 mon.a (mon.0) 11104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:57 smithi179 bash[23186]: audit 2024-09-21T03:31:57.101680+0000 mon.a (mon.0) 11105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:57 smithi179 bash[23186]: audit 2024-09-21T03:31:57.113469+0000 mon.a (mon.0) 11106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:31:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:31:58 smithi049 bash[23528]: cluster 2024-09-21T03:31:57.850253+0000 mgr.a (mgr.14388) 13741 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:58.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:31:58 smithi044 bash[22676]: cluster 2024-09-21T03:31:57.850253+0000 mgr.a (mgr.14388) 13741 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:31:58.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:31:58 smithi179 bash[23186]: cluster 2024-09-21T03:31:57.850253+0000 mgr.a (mgr.14388) 13741 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:00.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:00.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:00.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:01.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:00 smithi044 bash[22676]: cluster 2024-09-21T03:31:59.851021+0000 mgr.a (mgr.14388) 13742 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:01.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:00 smithi044 bash[22676]: audit 2024-09-21T03:32:00.315595+0000 mon.a (mon.0) 11107 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:32:01.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:00 smithi044 bash[22676]: audit 2024-09-21T03:32:00.322406+0000 mon.a (mon.0) 11108 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:32:01.152 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:00 smithi044 bash[22676]: audit 2024-09-21T03:32:00.324373+0000 mon.a (mon.0) 11109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:32:01.152 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:00 smithi044 bash[22676]: audit 2024-09-21T03:32:00.335989+0000 mon.a (mon.0) 11110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:01.152 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:00 smithi044 bash[22676]: audit 2024-09-21T03:32:00.342305+0000 mon.a (mon.0) 11111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:32:01.165 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:00 smithi049 bash[23528]: cluster 2024-09-21T03:31:59.851021+0000 mgr.a (mgr.14388) 13742 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:01.165 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:00 smithi049 bash[23528]: audit 2024-09-21T03:32:00.315595+0000 mon.a (mon.0) 11107 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:32:01.165 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:00 smithi049 bash[23528]: audit 2024-09-21T03:32:00.322406+0000 mon.a (mon.0) 11108 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:32:01.165 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:00 smithi049 bash[23528]: audit 2024-09-21T03:32:00.324373+0000 mon.a (mon.0) 11109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:32:01.165 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:00 smithi049 bash[23528]: audit 2024-09-21T03:32:00.335989+0000 mon.a (mon.0) 11110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:01.166 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:00 smithi049 bash[23528]: audit 2024-09-21T03:32:00.342305+0000 mon.a (mon.0) 11111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:32:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:00 smithi179 bash[23186]: cluster 2024-09-21T03:31:59.851021+0000 mgr.a (mgr.14388) 13742 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:00 smithi179 bash[23186]: audit 2024-09-21T03:32:00.315595+0000 mon.a (mon.0) 11107 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:32:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:00 smithi179 bash[23186]: audit 2024-09-21T03:32:00.322406+0000 mon.a (mon.0) 11108 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:32:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:00 smithi179 bash[23186]: audit 2024-09-21T03:32:00.324373+0000 mon.a (mon.0) 11109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:32:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:00 smithi179 bash[23186]: audit 2024-09-21T03:32:00.335989+0000 mon.a (mon.0) 11110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:00 smithi179 bash[23186]: audit 2024-09-21T03:32:00.342305+0000 mon.a (mon.0) 11111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:32:01.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:32:01 smithi044 bash[22930]: debug 2024-09-21T03:32:01.146+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:32:01.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:32:01 smithi044 bash[22930]: debug 2024-09-21T03:32:01.158+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:32:01.552 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:01.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:02.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:01 smithi179 bash[23186]: audit 2024-09-21T03:32:00.344691+0000 mgr.a (mgr.14388) 13743 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:32:02.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:01 smithi179 bash[23186]: audit 2024-09-21T03:32:00.722893+0000 mgr.a (mgr.14388) 13744 : audit [DBG] from='client.298836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:02.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:01 smithi179 bash[23186]: audit 2024-09-21T03:32:01.151180+0000 mgr.a (mgr.14388) 13745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:32:02.236 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:01 smithi179 bash[23186]: cephadm 2024-09-21T03:32:01.162640+0000 mgr.a (mgr.14388) 13746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:32:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:01 smithi044 bash[22676]: audit 2024-09-21T03:32:00.344691+0000 mgr.a (mgr.14388) 13743 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:32:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:01 smithi044 bash[22676]: audit 2024-09-21T03:32:00.722893+0000 mgr.a (mgr.14388) 13744 : audit [DBG] from='client.298836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:01 smithi044 bash[22676]: audit 2024-09-21T03:32:01.151180+0000 mgr.a (mgr.14388) 13745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:32:02.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:01 smithi044 bash[22676]: cephadm 2024-09-21T03:32:01.162640+0000 mgr.a (mgr.14388) 13746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:32:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:01 smithi049 bash[23528]: audit 2024-09-21T03:32:00.344691+0000 mgr.a (mgr.14388) 13743 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:32:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:01 smithi049 bash[23528]: audit 2024-09-21T03:32:00.722893+0000 mgr.a (mgr.14388) 13744 : audit [DBG] from='client.298836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:01 smithi049 bash[23528]: audit 2024-09-21T03:32:01.151180+0000 mgr.a (mgr.14388) 13745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:32:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:01 smithi049 bash[23528]: cephadm 2024-09-21T03:32:01.162640+0000 mgr.a (mgr.14388) 13746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:32:02.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:02 smithi044 bash[22676]: cluster 2024-09-21T03:32:01.853241+0000 mgr.a (mgr.14388) 13747 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:03.192 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:02 smithi179 bash[23186]: cluster 2024-09-21T03:32:01.853241+0000 mgr.a (mgr.14388) 13747 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:02 smithi049 bash[23528]: cluster 2024-09-21T03:32:01.853241+0000 mgr.a (mgr.14388) 13747 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:04 smithi044 bash[22676]: cluster 2024-09-21T03:32:03.854231+0000 mgr.a (mgr.14388) 13748 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:04 smithi179 bash[23186]: cluster 2024-09-21T03:32:03.854231+0000 mgr.a (mgr.14388) 13748 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:04 smithi049 bash[23528]: cluster 2024-09-21T03:32:03.854231+0000 mgr.a (mgr.14388) 13748 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:06 smithi044 bash[22676]: cluster 2024-09-21T03:32:05.856212+0000 mgr.a (mgr.14388) 13749 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:06 smithi179 bash[23186]: cluster 2024-09-21T03:32:05.856212+0000 mgr.a (mgr.14388) 13749 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:06 smithi049 bash[23528]: cluster 2024-09-21T03:32:05.856212+0000 mgr.a (mgr.14388) 13749 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:07.354 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:07 smithi044 bash[22676]: audit 2024-09-21T03:32:06.896155+0000 mgr.a (mgr.14388) 13750 : audit [DBG] from='client.299004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:08.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:07 smithi179 bash[23186]: audit 2024-09-21T03:32:06.896155+0000 mgr.a (mgr.14388) 13750 : audit [DBG] from='client.299004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:07 smithi049 bash[23528]: audit 2024-09-21T03:32:06.896155+0000 mgr.a (mgr.14388) 13750 : audit [DBG] from='client.299004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:08 smithi044 bash[22676]: cluster 2024-09-21T03:32:07.857283+0000 mgr.a (mgr.14388) 13751 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:08 smithi179 bash[23186]: cluster 2024-09-21T03:32:07.857283+0000 mgr.a (mgr.14388) 13751 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:08 smithi049 bash[23528]: cluster 2024-09-21T03:32:07.857283+0000 mgr.a (mgr.14388) 13751 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:10 smithi044 bash[22676]: audit 2024-09-21T03:32:09.093695+0000 mon.a (mon.0) 11112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:10 smithi044 bash[22676]: audit 2024-09-21T03:32:09.102051+0000 mon.a (mon.0) 11113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:10 smithi044 bash[22676]: audit 2024-09-21T03:32:09.112374+0000 mon.a (mon.0) 11114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:10 smithi044 bash[22676]: audit 2024-09-21T03:32:09.504820+0000 mon.a (mon.0) 11115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:10 smithi044 bash[22676]: audit 2024-09-21T03:32:09.513023+0000 mon.a (mon.0) 11116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:10 smithi044 bash[22676]: audit 2024-09-21T03:32:09.523158+0000 mon.a (mon.0) 11117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:10 smithi179 bash[23186]: audit 2024-09-21T03:32:09.093695+0000 mon.a (mon.0) 11112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:10 smithi179 bash[23186]: audit 2024-09-21T03:32:09.102051+0000 mon.a (mon.0) 11113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:10 smithi179 bash[23186]: audit 2024-09-21T03:32:09.112374+0000 mon.a (mon.0) 11114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:10 smithi179 bash[23186]: audit 2024-09-21T03:32:09.504820+0000 mon.a (mon.0) 11115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:10 smithi179 bash[23186]: audit 2024-09-21T03:32:09.513023+0000 mon.a (mon.0) 11116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:10 smithi179 bash[23186]: audit 2024-09-21T03:32:09.523158+0000 mon.a (mon.0) 11117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:10 smithi049 bash[23528]: audit 2024-09-21T03:32:09.093695+0000 mon.a (mon.0) 11112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:10 smithi049 bash[23528]: audit 2024-09-21T03:32:09.102051+0000 mon.a (mon.0) 11113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:10 smithi049 bash[23528]: audit 2024-09-21T03:32:09.112374+0000 mon.a (mon.0) 11114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:10 smithi049 bash[23528]: audit 2024-09-21T03:32:09.504820+0000 mon.a (mon.0) 11115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:10 smithi049 bash[23528]: audit 2024-09-21T03:32:09.513023+0000 mon.a (mon.0) 11116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:10 smithi049 bash[23528]: audit 2024-09-21T03:32:09.523158+0000 mon.a (mon.0) 11117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:11 smithi044 bash[22676]: cluster 2024-09-21T03:32:09.858242+0000 mgr.a (mgr.14388) 13752 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:11 smithi179 bash[23186]: cluster 2024-09-21T03:32:09.858242+0000 mgr.a (mgr.14388) 13752 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:11 smithi049 bash[23528]: cluster 2024-09-21T03:32:09.858242+0000 mgr.a (mgr.14388) 13752 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:13.121 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:13.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:13.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:13.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:13.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:13 smithi044 bash[22676]: cluster 2024-09-21T03:32:11.860469+0000 mgr.a (mgr.14388) 13753 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:13 smithi179 bash[23186]: cluster 2024-09-21T03:32:11.860469+0000 mgr.a (mgr.14388) 13753 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:13 smithi049 bash[23528]: cluster 2024-09-21T03:32:11.860469+0000 mgr.a (mgr.14388) 13753 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:14.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:14 smithi044 bash[22676]: audit 2024-09-21T03:32:12.688005+0000 mgr.a (mgr.14388) 13754 : audit [DBG] from='client.299082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:14.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:14 smithi179 bash[23186]: audit 2024-09-21T03:32:12.688005+0000 mgr.a (mgr.14388) 13754 : audit [DBG] from='client.299082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:14.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:14 smithi049 bash[23528]: audit 2024-09-21T03:32:12.688005+0000 mgr.a (mgr.14388) 13754 : audit [DBG] from='client.299082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:15 smithi044 bash[22676]: cluster 2024-09-21T03:32:13.861651+0000 mgr.a (mgr.14388) 13755 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:15.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:15 smithi179 bash[23186]: cluster 2024-09-21T03:32:13.861651+0000 mgr.a (mgr.14388) 13755 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:15 smithi049 bash[23528]: cluster 2024-09-21T03:32:13.861651+0000 mgr.a (mgr.14388) 13755 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:17 smithi044 bash[22676]: cluster 2024-09-21T03:32:15.864052+0000 mgr.a (mgr.14388) 13756 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:17 smithi179 bash[23186]: cluster 2024-09-21T03:32:15.864052+0000 mgr.a (mgr.14388) 13756 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:17 smithi049 bash[23528]: cluster 2024-09-21T03:32:15.864052+0000 mgr.a (mgr.14388) 13756 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:32:18.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:18.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:18.646 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:18 smithi049 bash[23528]: audit 2024-09-21T03:32:17.313374+0000 mon.a (mon.0) 11118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.646 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:18 smithi049 bash[23528]: audit 2024-09-21T03:32:17.321922+0000 mon.a (mon.0) 11119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.646 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:18 smithi049 bash[23528]: audit 2024-09-21T03:32:17.332257+0000 mon.a (mon.0) 11120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:18 smithi044 bash[22676]: audit 2024-09-21T03:32:17.313374+0000 mon.a (mon.0) 11118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:18 smithi044 bash[22676]: audit 2024-09-21T03:32:17.321922+0000 mon.a (mon.0) 11119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:18 smithi044 bash[22676]: audit 2024-09-21T03:32:17.332257+0000 mon.a (mon.0) 11120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:18 smithi179 bash[23186]: audit 2024-09-21T03:32:17.313374+0000 mon.a (mon.0) 11118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:18 smithi179 bash[23186]: audit 2024-09-21T03:32:17.321922+0000 mon.a (mon.0) 11119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:18 smithi179 bash[23186]: audit 2024-09-21T03:32:17.332257+0000 mon.a (mon.0) 11120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:18.887 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:19.627 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:19 smithi049 bash[23528]: cluster 2024-09-21T03:32:17.864864+0000 mgr.a (mgr.14388) 13757 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:19 smithi044 bash[22676]: cluster 2024-09-21T03:32:17.864864+0000 mgr.a (mgr.14388) 13757 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:19 smithi179 bash[23186]: cluster 2024-09-21T03:32:17.864864+0000 mgr.a (mgr.14388) 13757 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:20.576 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:20 smithi049 bash[23528]: audit 2024-09-21T03:32:18.456280+0000 mgr.a (mgr.14388) 13758 : audit [DBG] from='client.299160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:20.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:20 smithi044 bash[22676]: audit 2024-09-21T03:32:18.456280+0000 mgr.a (mgr.14388) 13758 : audit [DBG] from='client.299160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:20.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:20 smithi179 bash[23186]: audit 2024-09-21T03:32:18.456280+0000 mgr.a (mgr.14388) 13758 : audit [DBG] from='client.299160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:21.597 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:21 smithi049 bash[23528]: cluster 2024-09-21T03:32:19.865877+0000 mgr.a (mgr.14388) 13759 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:21.672 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:21 smithi044 bash[22676]: cluster 2024-09-21T03:32:19.865877+0000 mgr.a (mgr.14388) 13759 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:21 smithi179 bash[23186]: cluster 2024-09-21T03:32:19.865877+0000 mgr.a (mgr.14388) 13759 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:22 smithi049 bash[23528]: cluster 2024-09-21T03:32:21.868163+0000 mgr.a (mgr.14388) 13760 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:22.628 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:22 smithi179 bash[23186]: cluster 2024-09-21T03:32:21.868163+0000 mgr.a (mgr.14388) 13760 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:22 smithi044 bash[22676]: cluster 2024-09-21T03:32:21.868163+0000 mgr.a (mgr.14388) 13760 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:23.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:23.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:24.642 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:24.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:24.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:24.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:24.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:25.201 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:24 smithi179 bash[23186]: cluster 2024-09-21T03:32:23.868699+0000 mgr.a (mgr.14388) 13761 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:25.202 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:24 smithi179 bash[23186]: audit 2024-09-21T03:32:24.216123+0000 mgr.a (mgr.14388) 13762 : audit [DBG] from='client.299238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:25.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:24 smithi044 bash[22676]: cluster 2024-09-21T03:32:23.868699+0000 mgr.a (mgr.14388) 13761 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:24 smithi044 bash[22676]: audit 2024-09-21T03:32:24.216123+0000 mgr.a (mgr.14388) 13762 : audit [DBG] from='client.299238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:24 smithi049 bash[23528]: cluster 2024-09-21T03:32:23.868699+0000 mgr.a (mgr.14388) 13761 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:24 smithi049 bash[23528]: audit 2024-09-21T03:32:24.216123+0000 mgr.a (mgr.14388) 13762 : audit [DBG] from='client.299238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:27.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:26 smithi044 bash[22676]: cluster 2024-09-21T03:32:25.871020+0000 mgr.a (mgr.14388) 13763 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:27.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:26 smithi179 bash[23186]: cluster 2024-09-21T03:32:25.871020+0000 mgr.a (mgr.14388) 13763 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:26 smithi049 bash[23528]: cluster 2024-09-21T03:32:25.871020+0000 mgr.a (mgr.14388) 13763 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:29.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:28 smithi044 bash[22676]: cluster 2024-09-21T03:32:27.871839+0000 mgr.a (mgr.14388) 13764 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:29.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:28 smithi179 bash[23186]: cluster 2024-09-21T03:32:27.871839+0000 mgr.a (mgr.14388) 13764 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:28 smithi049 bash[23528]: cluster 2024-09-21T03:32:27.871839+0000 mgr.a (mgr.14388) 13764 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:29.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:29.644 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:29.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:30.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:30.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:30.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:30.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:30.424 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:30 smithi044 bash[22676]: audit 2024-09-21T03:32:29.316253+0000 mon.a (mon.0) 11121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:30 smithi044 bash[22676]: audit 2024-09-21T03:32:29.324514+0000 mon.a (mon.0) 11122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:30 smithi044 bash[22676]: audit 2024-09-21T03:32:29.334820+0000 mon.a (mon.0) 11123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:30 smithi044 bash[22676]: audit 2024-09-21T03:32:29.727884+0000 mon.a (mon.0) 11124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:30 smithi044 bash[22676]: audit 2024-09-21T03:32:29.733732+0000 mon.a (mon.0) 11125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:30 smithi044 bash[22676]: audit 2024-09-21T03:32:29.741314+0000 mon.a (mon.0) 11126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:30 smithi179 bash[23186]: audit 2024-09-21T03:32:29.316253+0000 mon.a (mon.0) 11121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:30 smithi179 bash[23186]: audit 2024-09-21T03:32:29.324514+0000 mon.a (mon.0) 11122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:30 smithi179 bash[23186]: audit 2024-09-21T03:32:29.334820+0000 mon.a (mon.0) 11123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:30 smithi179 bash[23186]: audit 2024-09-21T03:32:29.727884+0000 mon.a (mon.0) 11124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:30 smithi179 bash[23186]: audit 2024-09-21T03:32:29.733732+0000 mon.a (mon.0) 11125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:30 smithi179 bash[23186]: audit 2024-09-21T03:32:29.741314+0000 mon.a (mon.0) 11126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:30 smithi049 bash[23528]: audit 2024-09-21T03:32:29.316253+0000 mon.a (mon.0) 11121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:30 smithi049 bash[23528]: audit 2024-09-21T03:32:29.324514+0000 mon.a (mon.0) 11122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:30 smithi049 bash[23528]: audit 2024-09-21T03:32:29.334820+0000 mon.a (mon.0) 11123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:30 smithi049 bash[23528]: audit 2024-09-21T03:32:29.727884+0000 mon.a (mon.0) 11124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:30 smithi049 bash[23528]: audit 2024-09-21T03:32:29.733732+0000 mon.a (mon.0) 11125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:30 smithi049 bash[23528]: audit 2024-09-21T03:32:29.741314+0000 mon.a (mon.0) 11126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:31 smithi044 bash[22676]: cluster 2024-09-21T03:32:29.872604+0000 mgr.a (mgr.14388) 13765 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:31 smithi044 bash[22676]: audit 2024-09-21T03:32:29.982541+0000 mgr.a (mgr.14388) 13766 : audit [DBG] from='client.299313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:31.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:31 smithi179 bash[23186]: cluster 2024-09-21T03:32:29.872604+0000 mgr.a (mgr.14388) 13765 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:31.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:31 smithi179 bash[23186]: audit 2024-09-21T03:32:29.982541+0000 mgr.a (mgr.14388) 13766 : audit [DBG] from='client.299313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:31 smithi049 bash[23528]: cluster 2024-09-21T03:32:29.872604+0000 mgr.a (mgr.14388) 13765 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:31 smithi049 bash[23528]: audit 2024-09-21T03:32:29.982541+0000 mgr.a (mgr.14388) 13766 : audit [DBG] from='client.299313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:33 smithi044 bash[22676]: cluster 2024-09-21T03:32:31.875467+0000 mgr.a (mgr.14388) 13767 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:33 smithi179 bash[23186]: cluster 2024-09-21T03:32:31.875467+0000 mgr.a (mgr.14388) 13767 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:33 smithi049 bash[23528]: cluster 2024-09-21T03:32:31.875467+0000 mgr.a (mgr.14388) 13767 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:35.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:35.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:35.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:35 smithi044 bash[22676]: cluster 2024-09-21T03:32:33.876437+0000 mgr.a (mgr.14388) 13768 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:35.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:35 smithi179 bash[23186]: cluster 2024-09-21T03:32:33.876437+0000 mgr.a (mgr.14388) 13768 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:35 smithi049 bash[23528]: cluster 2024-09-21T03:32:33.876437+0000 mgr.a (mgr.14388) 13768 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:36.196 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:36.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:36.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:36.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:36.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:36 smithi044 bash[22676]: audit 2024-09-21T03:32:35.754612+0000 mgr.a (mgr.14388) 13769 : audit [DBG] from='client.299391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:36 smithi044 bash[22676]: cluster 2024-09-21T03:32:35.878070+0000 mgr.a (mgr.14388) 13770 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:36 smithi179 bash[23186]: audit 2024-09-21T03:32:35.754612+0000 mgr.a (mgr.14388) 13769 : audit [DBG] from='client.299391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:36 smithi179 bash[23186]: cluster 2024-09-21T03:32:35.878070+0000 mgr.a (mgr.14388) 13770 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:36 smithi049 bash[23528]: audit 2024-09-21T03:32:35.754612+0000 mgr.a (mgr.14388) 13769 : audit [DBG] from='client.299391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:36 smithi049 bash[23528]: cluster 2024-09-21T03:32:35.878070+0000 mgr.a (mgr.14388) 13770 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:38 smithi049 bash[23528]: audit 2024-09-21T03:32:37.546564+0000 mon.a (mon.0) 11127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:38 smithi049 bash[23528]: audit 2024-09-21T03:32:37.555650+0000 mon.a (mon.0) 11128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:38 smithi049 bash[23528]: audit 2024-09-21T03:32:37.567886+0000 mon.a (mon.0) 11129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:38 smithi049 bash[23528]: cluster 2024-09-21T03:32:37.878927+0000 mgr.a (mgr.14388) 13771 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:38 smithi044 bash[22676]: audit 2024-09-21T03:32:37.546564+0000 mon.a (mon.0) 11127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:38 smithi044 bash[22676]: audit 2024-09-21T03:32:37.555650+0000 mon.a (mon.0) 11128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:38.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:38 smithi044 bash[22676]: audit 2024-09-21T03:32:37.567886+0000 mon.a (mon.0) 11129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:38 smithi044 bash[22676]: cluster 2024-09-21T03:32:37.878927+0000 mgr.a (mgr.14388) 13771 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:38 smithi179 bash[23186]: audit 2024-09-21T03:32:37.546564+0000 mon.a (mon.0) 11127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:38 smithi179 bash[23186]: audit 2024-09-21T03:32:37.555650+0000 mon.a (mon.0) 11128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:39.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:38 smithi179 bash[23186]: audit 2024-09-21T03:32:37.567886+0000 mon.a (mon.0) 11129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:38 smithi179 bash[23186]: cluster 2024-09-21T03:32:37.878927+0000 mgr.a (mgr.14388) 13771 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:32:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:40 smithi044 bash[22676]: cluster 2024-09-21T03:32:39.879729+0000 mgr.a (mgr.14388) 13772 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:32:41.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:41.198 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:41.198 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:41.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:40 smithi179 bash[23186]: cluster 2024-09-21T03:32:39.879729+0000 mgr.a (mgr.14388) 13772 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:32:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:40 smithi049 bash[23528]: cluster 2024-09-21T03:32:39.879729+0000 mgr.a (mgr.14388) 13772 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:32:42.001 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:42.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:42.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:42.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:42.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:43.115 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:42 smithi179 bash[23186]: audit 2024-09-21T03:32:41.542835+0000 mgr.a (mgr.14388) 13773 : audit [DBG] from='client.299469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:43.116 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:42 smithi179 bash[23186]: cluster 2024-09-21T03:32:41.881112+0000 mgr.a (mgr.14388) 13774 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:42 smithi044 bash[22676]: audit 2024-09-21T03:32:41.542835+0000 mgr.a (mgr.14388) 13773 : audit [DBG] from='client.299469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:43.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:42 smithi044 bash[22676]: cluster 2024-09-21T03:32:41.881112+0000 mgr.a (mgr.14388) 13774 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:42 smithi049 bash[23528]: audit 2024-09-21T03:32:41.542835+0000 mgr.a (mgr.14388) 13773 : audit [DBG] from='client.299469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:42 smithi049 bash[23528]: cluster 2024-09-21T03:32:41.881112+0000 mgr.a (mgr.14388) 13774 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:45.213 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:44 smithi179 bash[23186]: cluster 2024-09-21T03:32:43.881727+0000 mgr.a (mgr.14388) 13775 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:44 smithi044 bash[22676]: cluster 2024-09-21T03:32:43.881727+0000 mgr.a (mgr.14388) 13775 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:44 smithi049 bash[23528]: cluster 2024-09-21T03:32:43.881727+0000 mgr.a (mgr.14388) 13775 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:47.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:47.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:46 smithi044 bash[22676]: cluster 2024-09-21T03:32:45.883852+0000 mgr.a (mgr.14388) 13776 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:46 smithi179 bash[23186]: cluster 2024-09-21T03:32:45.883852+0000 mgr.a (mgr.14388) 13776 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:46 smithi049 bash[23528]: cluster 2024-09-21T03:32:45.883852+0000 mgr.a (mgr.14388) 13776 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:47.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:47.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:47.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:47.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:47.768 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:48 smithi044 bash[22676]: audit 2024-09-21T03:32:47.335221+0000 mgr.a (mgr.14388) 13777 : audit [DBG] from='client.299544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:48 smithi044 bash[22676]: cluster 2024-09-21T03:32:47.884786+0000 mgr.a (mgr.14388) 13778 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:49.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:48 smithi179 bash[23186]: audit 2024-09-21T03:32:47.335221+0000 mgr.a (mgr.14388) 13777 : audit [DBG] from='client.299544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:48 smithi179 bash[23186]: cluster 2024-09-21T03:32:47.884786+0000 mgr.a (mgr.14388) 13778 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:48 smithi049 bash[23528]: audit 2024-09-21T03:32:47.335221+0000 mgr.a (mgr.14388) 13777 : audit [DBG] from='client.299544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:48 smithi049 bash[23528]: cluster 2024-09-21T03:32:47.884786+0000 mgr.a (mgr.14388) 13778 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:50.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:50 smithi044 bash[22676]: audit 2024-09-21T03:32:49.552062+0000 mon.a (mon.0) 11130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:50 smithi044 bash[22676]: audit 2024-09-21T03:32:49.558184+0000 mon.a (mon.0) 11131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:50 smithi044 bash[22676]: audit 2024-09-21T03:32:49.566439+0000 mon.a (mon.0) 11132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:50 smithi044 bash[22676]: cluster 2024-09-21T03:32:49.885592+0000 mgr.a (mgr.14388) 13779 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:50 smithi044 bash[22676]: audit 2024-09-21T03:32:49.950186+0000 mon.a (mon.0) 11133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:50 smithi044 bash[22676]: audit 2024-09-21T03:32:49.958857+0000 mon.a (mon.0) 11134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:50 smithi044 bash[22676]: audit 2024-09-21T03:32:49.968991+0000 mon.a (mon.0) 11135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:50 smithi179 bash[23186]: audit 2024-09-21T03:32:49.552062+0000 mon.a (mon.0) 11130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:50 smithi179 bash[23186]: audit 2024-09-21T03:32:49.558184+0000 mon.a (mon.0) 11131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:50 smithi179 bash[23186]: audit 2024-09-21T03:32:49.566439+0000 mon.a (mon.0) 11132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:50 smithi179 bash[23186]: cluster 2024-09-21T03:32:49.885592+0000 mgr.a (mgr.14388) 13779 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:50 smithi179 bash[23186]: audit 2024-09-21T03:32:49.950186+0000 mon.a (mon.0) 11133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:50 smithi179 bash[23186]: audit 2024-09-21T03:32:49.958857+0000 mon.a (mon.0) 11134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:50 smithi179 bash[23186]: audit 2024-09-21T03:32:49.968991+0000 mon.a (mon.0) 11135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:50 smithi049 bash[23528]: audit 2024-09-21T03:32:49.552062+0000 mon.a (mon.0) 11130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:50 smithi049 bash[23528]: audit 2024-09-21T03:32:49.558184+0000 mon.a (mon.0) 11131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:50 smithi049 bash[23528]: audit 2024-09-21T03:32:49.566439+0000 mon.a (mon.0) 11132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:50 smithi049 bash[23528]: cluster 2024-09-21T03:32:49.885592+0000 mgr.a (mgr.14388) 13779 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:50 smithi049 bash[23528]: audit 2024-09-21T03:32:49.950186+0000 mon.a (mon.0) 11133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:50 smithi049 bash[23528]: audit 2024-09-21T03:32:49.958857+0000 mon.a (mon.0) 11134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:50 smithi049 bash[23528]: audit 2024-09-21T03:32:49.968991+0000 mon.a (mon.0) 11135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:53.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:52 smithi044 bash[22676]: cluster 2024-09-21T03:32:51.887820+0000 mgr.a (mgr.14388) 13780 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:53.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:52 smithi179 bash[23186]: cluster 2024-09-21T03:32:51.887820+0000 mgr.a (mgr.14388) 13780 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:53.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:52 smithi049 bash[23528]: cluster 2024-09-21T03:32:51.887820+0000 mgr.a (mgr.14388) 13780 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:53.568 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:53.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:53.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:53.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:53.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:32:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:53 smithi044 bash[22676]: audit 2024-09-21T03:32:53.108685+0000 mgr.a (mgr.14388) 13781 : audit [DBG] from='client.299619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:54.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:53 smithi179 bash[23186]: audit 2024-09-21T03:32:53.108685+0000 mgr.a (mgr.14388) 13781 : audit [DBG] from='client.299619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:54.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:53 smithi049 bash[23528]: audit 2024-09-21T03:32:53.108685+0000 mgr.a (mgr.14388) 13781 : audit [DBG] from='client.299619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:54 smithi044 bash[22676]: cluster 2024-09-21T03:32:53.888800+0000 mgr.a (mgr.14388) 13782 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:54 smithi179 bash[23186]: cluster 2024-09-21T03:32:53.888800+0000 mgr.a (mgr.14388) 13782 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:54 smithi049 bash[23528]: cluster 2024-09-21T03:32:53.888800+0000 mgr.a (mgr.14388) 13782 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:57.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:56 smithi044 bash[22676]: cluster 2024-09-21T03:32:55.891047+0000 mgr.a (mgr.14388) 13783 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:57.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:56 smithi179 bash[23186]: cluster 2024-09-21T03:32:55.891047+0000 mgr.a (mgr.14388) 13783 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:56 smithi049 bash[23528]: cluster 2024-09-21T03:32:55.891047+0000 mgr.a (mgr.14388) 13783 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:32:58.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:32:58.571 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:32:58.571 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:32:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:58 smithi049 bash[23528]: audit 2024-09-21T03:32:57.783306+0000 mon.a (mon.0) 11136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:58 smithi049 bash[23528]: audit 2024-09-21T03:32:57.792037+0000 mon.a (mon.0) 11137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:58 smithi049 bash[23528]: audit 2024-09-21T03:32:57.802849+0000 mon.a (mon.0) 11138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:58 smithi049 bash[23528]: cluster 2024-09-21T03:32:57.891818+0000 mgr.a (mgr.14388) 13784 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:58 smithi044 bash[22676]: audit 2024-09-21T03:32:57.783306+0000 mon.a (mon.0) 11136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:58 smithi044 bash[22676]: audit 2024-09-21T03:32:57.792037+0000 mon.a (mon.0) 11137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:58 smithi044 bash[22676]: audit 2024-09-21T03:32:57.802849+0000 mon.a (mon.0) 11138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:58 smithi044 bash[22676]: cluster 2024-09-21T03:32:57.891818+0000 mgr.a (mgr.14388) 13784 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:58 smithi179 bash[23186]: audit 2024-09-21T03:32:57.783306+0000 mon.a (mon.0) 11136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:58 smithi179 bash[23186]: audit 2024-09-21T03:32:57.792037+0000 mon.a (mon.0) 11137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:58 smithi179 bash[23186]: audit 2024-09-21T03:32:57.802849+0000 mon.a (mon.0) 11138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:32:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:58 smithi179 bash[23186]: cluster 2024-09-21T03:32:57.891818+0000 mgr.a (mgr.14388) 13784 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:32:59.354 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:32:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:32:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:32:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:32:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:00.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:32:59 smithi044 bash[22676]: audit 2024-09-21T03:32:58.909818+0000 mgr.a (mgr.14388) 13785 : audit [DBG] from='client.299694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:00.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:32:59 smithi179 bash[23186]: audit 2024-09-21T03:32:58.909818+0000 mgr.a (mgr.14388) 13785 : audit [DBG] from='client.299694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:32:59 smithi049 bash[23528]: audit 2024-09-21T03:32:58.909818+0000 mgr.a (mgr.14388) 13785 : audit [DBG] from='client.299694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:00 smithi044 bash[22676]: cluster 2024-09-21T03:32:59.892865+0000 mgr.a (mgr.14388) 13786 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:01.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:00 smithi179 bash[23186]: cluster 2024-09-21T03:32:59.892865+0000 mgr.a (mgr.14388) 13786 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:01.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:00 smithi049 bash[23528]: cluster 2024-09-21T03:32:59.892865+0000 mgr.a (mgr.14388) 13786 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:02.107 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:33:02 smithi044 bash[22930]: debug 2024-09-21T03:33:02.029+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:33:02.107 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:33:02 smithi044 bash[22930]: debug 2024-09-21T03:33:02.033+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:33:02.107 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:01 smithi044 bash[22676]: audit 2024-09-21T03:33:01.219066+0000 mon.a (mon.0) 11139 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:33:02.107 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:01 smithi044 bash[22676]: audit 2024-09-21T03:33:01.226349+0000 mon.a (mon.0) 11140 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:33:02.107 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:01 smithi044 bash[22676]: audit 2024-09-21T03:33:01.228182+0000 mon.a (mon.0) 11141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:33:02.108 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:01 smithi044 bash[22676]: audit 2024-09-21T03:33:01.239385+0000 mon.a (mon.0) 11142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:02.108 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:01 smithi044 bash[22676]: audit 2024-09-21T03:33:01.245768+0000 mon.a (mon.0) 11143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:33:02.108 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:01 smithi044 bash[22676]: audit 2024-09-21T03:33:01.248064+0000 mgr.a (mgr.14388) 13787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:33:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:01 smithi179 bash[23186]: audit 2024-09-21T03:33:01.219066+0000 mon.a (mon.0) 11139 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:33:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:01 smithi179 bash[23186]: audit 2024-09-21T03:33:01.226349+0000 mon.a (mon.0) 11140 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:33:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:01 smithi179 bash[23186]: audit 2024-09-21T03:33:01.228182+0000 mon.a (mon.0) 11141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:33:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:01 smithi179 bash[23186]: audit 2024-09-21T03:33:01.239385+0000 mon.a (mon.0) 11142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:01 smithi179 bash[23186]: audit 2024-09-21T03:33:01.245768+0000 mon.a (mon.0) 11143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:33:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:01 smithi179 bash[23186]: audit 2024-09-21T03:33:01.248064+0000 mgr.a (mgr.14388) 13787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:33:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:01 smithi049 bash[23528]: audit 2024-09-21T03:33:01.219066+0000 mon.a (mon.0) 11139 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:33:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:01 smithi049 bash[23528]: audit 2024-09-21T03:33:01.226349+0000 mon.a (mon.0) 11140 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:33:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:01 smithi049 bash[23528]: audit 2024-09-21T03:33:01.228182+0000 mon.a (mon.0) 11141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:33:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:01 smithi049 bash[23528]: audit 2024-09-21T03:33:01.239385+0000 mon.a (mon.0) 11142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:01 smithi049 bash[23528]: audit 2024-09-21T03:33:01.245768+0000 mon.a (mon.0) 11143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:33:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:01 smithi049 bash[23528]: audit 2024-09-21T03:33:01.248064+0000 mgr.a (mgr.14388) 13787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:33:03.093 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:02 smithi049 bash[23528]: cluster 2024-09-21T03:33:01.895105+0000 mgr.a (mgr.14388) 13788 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:03.093 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:02 smithi049 bash[23528]: audit 2024-09-21T03:33:02.032234+0000 mgr.a (mgr.14388) 13789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:33:03.093 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:02 smithi049 bash[23528]: cephadm 2024-09-21T03:33:02.033306+0000 mgr.a (mgr.14388) 13790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:33:03.125 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:02 smithi179 bash[23186]: cluster 2024-09-21T03:33:01.895105+0000 mgr.a (mgr.14388) 13788 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:03.125 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:02 smithi179 bash[23186]: audit 2024-09-21T03:33:02.032234+0000 mgr.a (mgr.14388) 13789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:33:03.125 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:02 smithi179 bash[23186]: cephadm 2024-09-21T03:33:02.033306+0000 mgr.a (mgr.14388) 13790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:33:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:02 smithi044 bash[22676]: cluster 2024-09-21T03:33:01.895105+0000 mgr.a (mgr.14388) 13788 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:02 smithi044 bash[22676]: audit 2024-09-21T03:33:02.032234+0000 mgr.a (mgr.14388) 13789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:33:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:02 smithi044 bash[22676]: cephadm 2024-09-21T03:33:02.033306+0000 mgr.a (mgr.14388) 13790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:33:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:05.102 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:05.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:04 smithi044 bash[22676]: cluster 2024-09-21T03:33:03.895514+0000 mgr.a (mgr.14388) 13791 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:05.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:04 smithi179 bash[23186]: cluster 2024-09-21T03:33:03.895514+0000 mgr.a (mgr.14388) 13791 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:04 smithi049 bash[23528]: cluster 2024-09-21T03:33:03.895514+0000 mgr.a (mgr.14388) 13791 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:06.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:05 smithi044 bash[22676]: audit 2024-09-21T03:33:04.674589+0000 mgr.a (mgr.14388) 13792 : audit [DBG] from='client.299877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:06.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:05 smithi179 bash[23186]: audit 2024-09-21T03:33:04.674589+0000 mgr.a (mgr.14388) 13792 : audit [DBG] from='client.299877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:05 smithi049 bash[23528]: audit 2024-09-21T03:33:04.674589+0000 mgr.a (mgr.14388) 13792 : audit [DBG] from='client.299877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:07.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:06 smithi044 bash[22676]: cluster 2024-09-21T03:33:05.897858+0000 mgr.a (mgr.14388) 13793 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:07.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:06 smithi179 bash[23186]: cluster 2024-09-21T03:33:05.897858+0000 mgr.a (mgr.14388) 13793 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:06 smithi049 bash[23528]: cluster 2024-09-21T03:33:05.897858+0000 mgr.a (mgr.14388) 13793 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:09.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:08 smithi044 bash[22676]: cluster 2024-09-21T03:33:07.898642+0000 mgr.a (mgr.14388) 13794 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:09.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:08 smithi179 bash[23186]: cluster 2024-09-21T03:33:07.898642+0000 mgr.a (mgr.14388) 13794 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:08 smithi049 bash[23528]: cluster 2024-09-21T03:33:07.898642+0000 mgr.a (mgr.14388) 13794 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:10.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:10.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:10.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:10.863 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:10.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:10 smithi049 bash[23528]: audit 2024-09-21T03:33:09.771371+0000 mon.a (mon.0) 11144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:10 smithi049 bash[23528]: audit 2024-09-21T03:33:09.779105+0000 mon.a (mon.0) 11145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:10 smithi049 bash[23528]: audit 2024-09-21T03:33:09.789930+0000 mon.a (mon.0) 11146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:10 smithi049 bash[23528]: cluster 2024-09-21T03:33:09.899411+0000 mgr.a (mgr.14388) 13795 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:10 smithi049 bash[23528]: audit 2024-09-21T03:33:10.153216+0000 mon.a (mon.0) 11147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:10 smithi049 bash[23528]: audit 2024-09-21T03:33:10.162769+0000 mon.a (mon.0) 11148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:10 smithi049 bash[23528]: audit 2024-09-21T03:33:10.173190+0000 mon.a (mon.0) 11149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:10 smithi044 bash[22676]: audit 2024-09-21T03:33:09.771371+0000 mon.a (mon.0) 11144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:10 smithi044 bash[22676]: audit 2024-09-21T03:33:09.779105+0000 mon.a (mon.0) 11145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:10 smithi044 bash[22676]: audit 2024-09-21T03:33:09.789930+0000 mon.a (mon.0) 11146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:10 smithi044 bash[22676]: cluster 2024-09-21T03:33:09.899411+0000 mgr.a (mgr.14388) 13795 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:10 smithi044 bash[22676]: audit 2024-09-21T03:33:10.153216+0000 mon.a (mon.0) 11147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:10 smithi044 bash[22676]: audit 2024-09-21T03:33:10.162769+0000 mon.a (mon.0) 11148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:10 smithi044 bash[22676]: audit 2024-09-21T03:33:10.173190+0000 mon.a (mon.0) 11149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:10 smithi179 bash[23186]: audit 2024-09-21T03:33:09.771371+0000 mon.a (mon.0) 11144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:10 smithi179 bash[23186]: audit 2024-09-21T03:33:09.779105+0000 mon.a (mon.0) 11145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:10 smithi179 bash[23186]: audit 2024-09-21T03:33:09.789930+0000 mon.a (mon.0) 11146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:10 smithi179 bash[23186]: cluster 2024-09-21T03:33:09.899411+0000 mgr.a (mgr.14388) 13795 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:10 smithi179 bash[23186]: audit 2024-09-21T03:33:10.153216+0000 mon.a (mon.0) 11147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:10 smithi179 bash[23186]: audit 2024-09-21T03:33:10.162769+0000 mon.a (mon.0) 11148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:10 smithi179 bash[23186]: audit 2024-09-21T03:33:10.173190+0000 mon.a (mon.0) 11149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:12.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:11 smithi049 bash[23528]: audit 2024-09-21T03:33:10.437704+0000 mgr.a (mgr.14388) 13796 : audit [DBG] from='client.299955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:12.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:11 smithi044 bash[22676]: audit 2024-09-21T03:33:10.437704+0000 mgr.a (mgr.14388) 13796 : audit [DBG] from='client.299955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:12.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:11 smithi179 bash[23186]: audit 2024-09-21T03:33:10.437704+0000 mgr.a (mgr.14388) 13796 : audit [DBG] from='client.299955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:12 smithi049 bash[23528]: cluster 2024-09-21T03:33:11.902394+0000 mgr.a (mgr.14388) 13797 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:12 smithi044 bash[22676]: cluster 2024-09-21T03:33:11.902394+0000 mgr.a (mgr.14388) 13797 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:13.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:12 smithi179 bash[23186]: cluster 2024-09-21T03:33:11.902394+0000 mgr.a (mgr.14388) 13797 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:14 smithi044 bash[22676]: cluster 2024-09-21T03:33:13.903365+0000 mgr.a (mgr.14388) 13798 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:15.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:14 smithi179 bash[23186]: cluster 2024-09-21T03:33:13.903365+0000 mgr.a (mgr.14388) 13798 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:14 smithi049 bash[23528]: cluster 2024-09-21T03:33:13.903365+0000 mgr.a (mgr.14388) 13798 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:33:15.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:15.865 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:15.866 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:16.663 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:16.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:16.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:16.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:16.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:16 smithi044 bash[22676]: cluster 2024-09-21T03:33:15.905547+0000 mgr.a (mgr.14388) 13799 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:16 smithi044 bash[22676]: audit 2024-09-21T03:33:16.202364+0000 mgr.a (mgr.14388) 13800 : audit [DBG] from='client.300033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:16 smithi179 bash[23186]: cluster 2024-09-21T03:33:15.905547+0000 mgr.a (mgr.14388) 13799 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:16 smithi179 bash[23186]: audit 2024-09-21T03:33:16.202364+0000 mgr.a (mgr.14388) 13800 : audit [DBG] from='client.300033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:16 smithi049 bash[23528]: cluster 2024-09-21T03:33:15.905547+0000 mgr.a (mgr.14388) 13799 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:16 smithi049 bash[23528]: audit 2024-09-21T03:33:16.202364+0000 mgr.a (mgr.14388) 13800 : audit [DBG] from='client.300033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:19.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:19 smithi049 bash[23528]: cluster 2024-09-21T03:33:17.906670+0000 mgr.a (mgr.14388) 13801 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:33:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:19 smithi049 bash[23528]: audit 2024-09-21T03:33:18.019452+0000 mon.a (mon.0) 11150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:19 smithi049 bash[23528]: audit 2024-09-21T03:33:18.028038+0000 mon.a (mon.0) 11151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:19 smithi049 bash[23528]: audit 2024-09-21T03:33:18.038667+0000 mon.a (mon.0) 11152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:19 smithi044 bash[22676]: cluster 2024-09-21T03:33:17.906670+0000 mgr.a (mgr.14388) 13801 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:33:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:19 smithi044 bash[22676]: audit 2024-09-21T03:33:18.019452+0000 mon.a (mon.0) 11150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:19 smithi044 bash[22676]: audit 2024-09-21T03:33:18.028038+0000 mon.a (mon.0) 11151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:19 smithi044 bash[22676]: audit 2024-09-21T03:33:18.038667+0000 mon.a (mon.0) 11152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:19 smithi179 bash[23186]: cluster 2024-09-21T03:33:17.906670+0000 mgr.a (mgr.14388) 13801 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:33:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:19 smithi179 bash[23186]: audit 2024-09-21T03:33:18.019452+0000 mon.a (mon.0) 11150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:19 smithi179 bash[23186]: audit 2024-09-21T03:33:18.028038+0000 mon.a (mon.0) 11151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:19.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:19 smithi179 bash[23186]: audit 2024-09-21T03:33:18.038667+0000 mon.a (mon.0) 11152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:21.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:21 smithi049 bash[23528]: cluster 2024-09-21T03:33:19.907476+0000 mgr.a (mgr.14388) 13802 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:33:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:21 smithi044 bash[22676]: cluster 2024-09-21T03:33:19.907476+0000 mgr.a (mgr.14388) 13802 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:33:21.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:21 smithi179 bash[23186]: cluster 2024-09-21T03:33:19.907476+0000 mgr.a (mgr.14388) 13802 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:33:21.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:21.666 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:22.454 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:22.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:22.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:22.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:22.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:23 smithi044 bash[22676]: cluster 2024-09-21T03:33:21.909773+0000 mgr.a (mgr.14388) 13803 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:33:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:23 smithi044 bash[22676]: audit 2024-09-21T03:33:22.002439+0000 mgr.a (mgr.14388) 13804 : audit [DBG] from='client.300108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:23.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:23 smithi179 bash[23186]: cluster 2024-09-21T03:33:21.909773+0000 mgr.a (mgr.14388) 13803 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:33:23.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:23 smithi179 bash[23186]: audit 2024-09-21T03:33:22.002439+0000 mgr.a (mgr.14388) 13804 : audit [DBG] from='client.300108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:23 smithi049 bash[23528]: cluster 2024-09-21T03:33:21.909773+0000 mgr.a (mgr.14388) 13803 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:33:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:23 smithi049 bash[23528]: audit 2024-09-21T03:33:22.002439+0000 mgr.a (mgr.14388) 13804 : audit [DBG] from='client.300108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:25.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:25 smithi049 bash[23528]: cluster 2024-09-21T03:33:23.910695+0000 mgr.a (mgr.14388) 13805 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:25 smithi044 bash[22676]: cluster 2024-09-21T03:33:23.910695+0000 mgr.a (mgr.14388) 13805 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:25 smithi179 bash[23186]: cluster 2024-09-21T03:33:23.910695+0000 mgr.a (mgr.14388) 13805 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:27 smithi049 bash[23528]: cluster 2024-09-21T03:33:25.912890+0000 mgr.a (mgr.14388) 13806 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:27.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:27.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:27.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:27 smithi044 bash[22676]: cluster 2024-09-21T03:33:25.912890+0000 mgr.a (mgr.14388) 13806 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:27 smithi179 bash[23186]: cluster 2024-09-21T03:33:25.912890+0000 mgr.a (mgr.14388) 13806 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:28.219 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:29 smithi049 bash[23528]: audit 2024-09-21T03:33:27.787408+0000 mgr.a (mgr.14388) 13807 : audit [DBG] from='client.300183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:29 smithi049 bash[23528]: cluster 2024-09-21T03:33:27.913439+0000 mgr.a (mgr.14388) 13808 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:29 smithi044 bash[22676]: audit 2024-09-21T03:33:27.787408+0000 mgr.a (mgr.14388) 13807 : audit [DBG] from='client.300183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:29 smithi044 bash[22676]: cluster 2024-09-21T03:33:27.913439+0000 mgr.a (mgr.14388) 13808 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:29 smithi179 bash[23186]: audit 2024-09-21T03:33:27.787408+0000 mgr.a (mgr.14388) 13807 : audit [DBG] from='client.300183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:29 smithi179 bash[23186]: cluster 2024-09-21T03:33:27.913439+0000 mgr.a (mgr.14388) 13808 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:31 smithi179 bash[23186]: cluster 2024-09-21T03:33:29.914239+0000 mgr.a (mgr.14388) 13809 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:31 smithi179 bash[23186]: audit 2024-09-21T03:33:30.000044+0000 mon.a (mon.0) 11153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:31 smithi179 bash[23186]: audit 2024-09-21T03:33:30.006327+0000 mon.a (mon.0) 11154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:31 smithi179 bash[23186]: audit 2024-09-21T03:33:30.014857+0000 mon.a (mon.0) 11155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:31 smithi179 bash[23186]: audit 2024-09-21T03:33:30.380676+0000 mon.a (mon.0) 11156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:31 smithi179 bash[23186]: audit 2024-09-21T03:33:30.389125+0000 mon.a (mon.0) 11157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:31 smithi179 bash[23186]: audit 2024-09-21T03:33:30.399190+0000 mon.a (mon.0) 11158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:31 smithi049 bash[23528]: cluster 2024-09-21T03:33:29.914239+0000 mgr.a (mgr.14388) 13809 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:31 smithi049 bash[23528]: audit 2024-09-21T03:33:30.000044+0000 mon.a (mon.0) 11153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:31 smithi049 bash[23528]: audit 2024-09-21T03:33:30.006327+0000 mon.a (mon.0) 11154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:31 smithi049 bash[23528]: audit 2024-09-21T03:33:30.014857+0000 mon.a (mon.0) 11155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:31 smithi049 bash[23528]: audit 2024-09-21T03:33:30.380676+0000 mon.a (mon.0) 11156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:31 smithi049 bash[23528]: audit 2024-09-21T03:33:30.389125+0000 mon.a (mon.0) 11157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:31 smithi049 bash[23528]: audit 2024-09-21T03:33:30.399190+0000 mon.a (mon.0) 11158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:31 smithi044 bash[22676]: cluster 2024-09-21T03:33:29.914239+0000 mgr.a (mgr.14388) 13809 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:31 smithi044 bash[22676]: audit 2024-09-21T03:33:30.000044+0000 mon.a (mon.0) 11153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:31 smithi044 bash[22676]: audit 2024-09-21T03:33:30.006327+0000 mon.a (mon.0) 11154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:31 smithi044 bash[22676]: audit 2024-09-21T03:33:30.014857+0000 mon.a (mon.0) 11155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:31 smithi044 bash[22676]: audit 2024-09-21T03:33:30.380676+0000 mon.a (mon.0) 11156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:31 smithi044 bash[22676]: audit 2024-09-21T03:33:30.389125+0000 mon.a (mon.0) 11157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:31 smithi044 bash[22676]: audit 2024-09-21T03:33:30.399190+0000 mon.a (mon.0) 11158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:33.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:33.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:33.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:33 smithi049 bash[23528]: cluster 2024-09-21T03:33:31.916624+0000 mgr.a (mgr.14388) 13810 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:33 smithi044 bash[22676]: cluster 2024-09-21T03:33:31.916624+0000 mgr.a (mgr.14388) 13810 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:33 smithi179 bash[23186]: cluster 2024-09-21T03:33:31.916624+0000 mgr.a (mgr.14388) 13810 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:33.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:33.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:33.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:33.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:33.985 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:35 smithi049 bash[23528]: audit 2024-09-21T03:33:33.551357+0000 mgr.a (mgr.14388) 13811 : audit [DBG] from='client.300258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:35 smithi049 bash[23528]: cluster 2024-09-21T03:33:33.917219+0000 mgr.a (mgr.14388) 13812 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:35 smithi044 bash[22676]: audit 2024-09-21T03:33:33.551357+0000 mgr.a (mgr.14388) 13811 : audit [DBG] from='client.300258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:35 smithi044 bash[22676]: cluster 2024-09-21T03:33:33.917219+0000 mgr.a (mgr.14388) 13812 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:35 smithi179 bash[23186]: audit 2024-09-21T03:33:33.551357+0000 mgr.a (mgr.14388) 13811 : audit [DBG] from='client.300258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:35.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:35 smithi179 bash[23186]: cluster 2024-09-21T03:33:33.917219+0000 mgr.a (mgr.14388) 13812 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:37 smithi049 bash[23528]: cluster 2024-09-21T03:33:35.919365+0000 mgr.a (mgr.14388) 13813 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:37 smithi044 bash[22676]: cluster 2024-09-21T03:33:35.919365+0000 mgr.a (mgr.14388) 13813 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:37 smithi179 bash[23186]: cluster 2024-09-21T03:33:35.919365+0000 mgr.a (mgr.14388) 13813 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:38.986 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:39.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:39 smithi179 bash[23186]: cluster 2024-09-21T03:33:37.920075+0000 mgr.a (mgr.14388) 13814 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:39 smithi179 bash[23186]: audit 2024-09-21T03:33:38.252918+0000 mon.a (mon.0) 11159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:39 smithi179 bash[23186]: audit 2024-09-21T03:33:38.261544+0000 mon.a (mon.0) 11160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:39 smithi179 bash[23186]: audit 2024-09-21T03:33:38.273206+0000 mon.a (mon.0) 11161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:39 smithi049 bash[23528]: cluster 2024-09-21T03:33:37.920075+0000 mgr.a (mgr.14388) 13814 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:39 smithi049 bash[23528]: audit 2024-09-21T03:33:38.252918+0000 mon.a (mon.0) 11159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:39 smithi049 bash[23528]: audit 2024-09-21T03:33:38.261544+0000 mon.a (mon.0) 11160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:39 smithi049 bash[23528]: audit 2024-09-21T03:33:38.273206+0000 mon.a (mon.0) 11161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:39 smithi044 bash[22676]: cluster 2024-09-21T03:33:37.920075+0000 mgr.a (mgr.14388) 13814 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:39 smithi044 bash[22676]: audit 2024-09-21T03:33:38.252918+0000 mon.a (mon.0) 11159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:39 smithi044 bash[22676]: audit 2024-09-21T03:33:38.261544+0000 mon.a (mon.0) 11160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:39 smithi044 bash[22676]: audit 2024-09-21T03:33:38.273206+0000 mon.a (mon.0) 11161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:39.780 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:39.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:40 smithi049 bash[23528]: audit 2024-09-21T03:33:39.325022+0000 mgr.a (mgr.14388) 13815 : audit [DBG] from='client.300336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:40 smithi044 bash[22676]: audit 2024-09-21T03:33:39.325022+0000 mgr.a (mgr.14388) 13815 : audit [DBG] from='client.300336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:40.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:40 smithi179 bash[23186]: audit 2024-09-21T03:33:39.325022+0000 mgr.a (mgr.14388) 13815 : audit [DBG] from='client.300336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:41.533 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:41 smithi049 bash[23528]: cluster 2024-09-21T03:33:39.920999+0000 mgr.a (mgr.14388) 13816 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:41 smithi044 bash[22676]: cluster 2024-09-21T03:33:39.920999+0000 mgr.a (mgr.14388) 13816 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:41 smithi179 bash[23186]: cluster 2024-09-21T03:33:39.920999+0000 mgr.a (mgr.14388) 13816 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:43 smithi179 bash[23186]: cluster 2024-09-21T03:33:41.923298+0000 mgr.a (mgr.14388) 13817 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:43 smithi049 bash[23528]: cluster 2024-09-21T03:33:41.923298+0000 mgr.a (mgr.14388) 13817 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:43 smithi044 bash[22676]: cluster 2024-09-21T03:33:41.923298+0000 mgr.a (mgr.14388) 13817 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:33:44.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:44.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:44.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:45.517 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:45.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:45.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:45.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:45.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:45 smithi049 bash[23528]: cluster 2024-09-21T03:33:43.924092+0000 mgr.a (mgr.14388) 13818 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:45 smithi044 bash[22676]: cluster 2024-09-21T03:33:43.924092+0000 mgr.a (mgr.14388) 13818 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:45 smithi179 bash[23186]: cluster 2024-09-21T03:33:43.924092+0000 mgr.a (mgr.14388) 13818 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:46 smithi049 bash[23528]: audit 2024-09-21T03:33:45.106055+0000 mgr.a (mgr.14388) 13819 : audit [DBG] from='client.300414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:46.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:46 smithi044 bash[22676]: audit 2024-09-21T03:33:45.106055+0000 mgr.a (mgr.14388) 13819 : audit [DBG] from='client.300414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:46 smithi179 bash[23186]: audit 2024-09-21T03:33:45.106055+0000 mgr.a (mgr.14388) 13819 : audit [DBG] from='client.300414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:47 smithi049 bash[23528]: cluster 2024-09-21T03:33:45.927085+0000 mgr.a (mgr.14388) 13820 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:47 smithi044 bash[22676]: cluster 2024-09-21T03:33:45.927085+0000 mgr.a (mgr.14388) 13820 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:47 smithi179 bash[23186]: cluster 2024-09-21T03:33:45.927085+0000 mgr.a (mgr.14388) 13820 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:49 smithi049 bash[23528]: cluster 2024-09-21T03:33:47.927877+0000 mgr.a (mgr.14388) 13821 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:49 smithi044 bash[22676]: cluster 2024-09-21T03:33:47.927877+0000 mgr.a (mgr.14388) 13821 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:49 smithi179 bash[23186]: cluster 2024-09-21T03:33:47.927877+0000 mgr.a (mgr.14388) 13821 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:50.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:50.519 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:50.519 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:51.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:51.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:51.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:51.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:51.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:51 smithi044 bash[22676]: cluster 2024-09-21T03:33:49.928645+0000 mgr.a (mgr.14388) 13822 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:51 smithi044 bash[22676]: audit 2024-09-21T03:33:50.174277+0000 mon.a (mon.0) 11162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:51 smithi044 bash[22676]: audit 2024-09-21T03:33:50.180089+0000 mon.a (mon.0) 11163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:51 smithi044 bash[22676]: audit 2024-09-21T03:33:50.185805+0000 mon.a (mon.0) 11164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:51 smithi044 bash[22676]: audit 2024-09-21T03:33:50.603248+0000 mon.a (mon.0) 11165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:51 smithi044 bash[22676]: audit 2024-09-21T03:33:50.610821+0000 mon.a (mon.0) 11166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:51 smithi044 bash[22676]: audit 2024-09-21T03:33:50.618666+0000 mon.a (mon.0) 11167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:51 smithi179 bash[23186]: cluster 2024-09-21T03:33:49.928645+0000 mgr.a (mgr.14388) 13822 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:51 smithi179 bash[23186]: audit 2024-09-21T03:33:50.174277+0000 mon.a (mon.0) 11162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:51 smithi179 bash[23186]: audit 2024-09-21T03:33:50.180089+0000 mon.a (mon.0) 11163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:51 smithi179 bash[23186]: audit 2024-09-21T03:33:50.185805+0000 mon.a (mon.0) 11164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:51 smithi179 bash[23186]: audit 2024-09-21T03:33:50.603248+0000 mon.a (mon.0) 11165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:51 smithi179 bash[23186]: audit 2024-09-21T03:33:50.610821+0000 mon.a (mon.0) 11166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:51 smithi179 bash[23186]: audit 2024-09-21T03:33:50.618666+0000 mon.a (mon.0) 11167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:51 smithi049 bash[23528]: cluster 2024-09-21T03:33:49.928645+0000 mgr.a (mgr.14388) 13822 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:51 smithi049 bash[23528]: audit 2024-09-21T03:33:50.174277+0000 mon.a (mon.0) 11162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:51 smithi049 bash[23528]: audit 2024-09-21T03:33:50.180089+0000 mon.a (mon.0) 11163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:51 smithi049 bash[23528]: audit 2024-09-21T03:33:50.185805+0000 mon.a (mon.0) 11164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:51 smithi049 bash[23528]: audit 2024-09-21T03:33:50.603248+0000 mon.a (mon.0) 11165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:51 smithi049 bash[23528]: audit 2024-09-21T03:33:50.610821+0000 mon.a (mon.0) 11166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:51.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:51 smithi049 bash[23528]: audit 2024-09-21T03:33:50.618666+0000 mon.a (mon.0) 11167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:52 smithi044 bash[22676]: audit 2024-09-21T03:33:50.852899+0000 mgr.a (mgr.14388) 13823 : audit [DBG] from='client.300492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:52.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:52 smithi179 bash[23186]: audit 2024-09-21T03:33:50.852899+0000 mgr.a (mgr.14388) 13823 : audit [DBG] from='client.300492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:52 smithi049 bash[23528]: audit 2024-09-21T03:33:50.852899+0000 mgr.a (mgr.14388) 13823 : audit [DBG] from='client.300492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:53 smithi044 bash[22676]: cluster 2024-09-21T03:33:51.931490+0000 mgr.a (mgr.14388) 13824 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:53.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:53 smithi179 bash[23186]: cluster 2024-09-21T03:33:51.931490+0000 mgr.a (mgr.14388) 13824 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:53 smithi049 bash[23528]: cluster 2024-09-21T03:33:51.931490+0000 mgr.a (mgr.14388) 13824 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:55 smithi044 bash[22676]: cluster 2024-09-21T03:33:53.932240+0000 mgr.a (mgr.14388) 13825 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:55 smithi179 bash[23186]: cluster 2024-09-21T03:33:53.932240+0000 mgr.a (mgr.14388) 13825 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:55 smithi049 bash[23528]: cluster 2024-09-21T03:33:53.932240+0000 mgr.a (mgr.14388) 13825 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:33:56.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:33:56.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:33:56.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:33:57.081 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:33:57.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:33:57.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:33:57.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:33:57.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:33:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:57 smithi044 bash[22676]: cluster 2024-09-21T03:33:55.934310+0000 mgr.a (mgr.14388) 13826 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:57 smithi179 bash[23186]: cluster 2024-09-21T03:33:55.934310+0000 mgr.a (mgr.14388) 13826 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:57 smithi049 bash[23528]: cluster 2024-09-21T03:33:55.934310+0000 mgr.a (mgr.14388) 13826 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:58 smithi044 bash[22676]: audit 2024-09-21T03:33:56.643009+0000 mgr.a (mgr.14388) 13827 : audit [DBG] from='client.300570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:58 smithi179 bash[23186]: audit 2024-09-21T03:33:56.643009+0000 mgr.a (mgr.14388) 13827 : audit [DBG] from='client.300570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:58.508 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:58 smithi049 bash[23528]: audit 2024-09-21T03:33:56.643009+0000 mgr.a (mgr.14388) 13827 : audit [DBG] from='client.300570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:59 smithi044 bash[22676]: cluster 2024-09-21T03:33:57.935238+0000 mgr.a (mgr.14388) 13828 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:59 smithi044 bash[22676]: audit 2024-09-21T03:33:58.486215+0000 mon.a (mon.0) 11168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:59 smithi044 bash[22676]: audit 2024-09-21T03:33:58.495121+0000 mon.a (mon.0) 11169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:33:59 smithi044 bash[22676]: audit 2024-09-21T03:33:58.505705+0000 mon.a (mon.0) 11170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:59 smithi179 bash[23186]: cluster 2024-09-21T03:33:57.935238+0000 mgr.a (mgr.14388) 13828 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:59 smithi179 bash[23186]: audit 2024-09-21T03:33:58.486215+0000 mon.a (mon.0) 11168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:59 smithi179 bash[23186]: audit 2024-09-21T03:33:58.495121+0000 mon.a (mon.0) 11169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:33:59 smithi179 bash[23186]: audit 2024-09-21T03:33:58.505705+0000 mon.a (mon.0) 11170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:59 smithi049 bash[23528]: cluster 2024-09-21T03:33:57.935238+0000 mgr.a (mgr.14388) 13828 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:33:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:59 smithi049 bash[23528]: audit 2024-09-21T03:33:58.486215+0000 mon.a (mon.0) 11168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:59 smithi049 bash[23528]: audit 2024-09-21T03:33:58.495121+0000 mon.a (mon.0) 11169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:33:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:33:59 smithi049 bash[23528]: audit 2024-09-21T03:33:58.505705+0000 mon.a (mon.0) 11170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:01 smithi044 bash[22676]: cluster 2024-09-21T03:33:59.936027+0000 mgr.a (mgr.14388) 13829 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:01 smithi179 bash[23186]: cluster 2024-09-21T03:33:59.936027+0000 mgr.a (mgr.14388) 13829 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:01 smithi049 bash[23528]: cluster 2024-09-21T03:33:59.936027+0000 mgr.a (mgr.14388) 13829 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:02.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:02.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:02.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:02 smithi049 bash[23528]: audit 2024-09-21T03:34:02.081864+0000 mon.a (mon.0) 11171 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:34:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:02 smithi049 bash[23528]: audit 2024-09-21T03:34:02.088433+0000 mon.a (mon.0) 11172 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:34:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:02 smithi049 bash[23528]: audit 2024-09-21T03:34:02.090060+0000 mon.a (mon.0) 11173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:34:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:02 smithi049 bash[23528]: audit 2024-09-21T03:34:02.100802+0000 mon.a (mon.0) 11174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:02 smithi049 bash[23528]: audit 2024-09-21T03:34:02.105572+0000 mon.a (mon.0) 11175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:34:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:02 smithi044 bash[22676]: audit 2024-09-21T03:34:02.081864+0000 mon.a (mon.0) 11171 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:34:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:02 smithi044 bash[22676]: audit 2024-09-21T03:34:02.088433+0000 mon.a (mon.0) 11172 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:34:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:02 smithi044 bash[22676]: audit 2024-09-21T03:34:02.090060+0000 mon.a (mon.0) 11173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:34:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:02 smithi044 bash[22676]: audit 2024-09-21T03:34:02.100802+0000 mon.a (mon.0) 11174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:02.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:02 smithi044 bash[22676]: audit 2024-09-21T03:34:02.105572+0000 mon.a (mon.0) 11175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:34:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:02 smithi179 bash[23186]: audit 2024-09-21T03:34:02.081864+0000 mon.a (mon.0) 11171 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:34:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:02 smithi179 bash[23186]: audit 2024-09-21T03:34:02.088433+0000 mon.a (mon.0) 11172 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:34:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:02 smithi179 bash[23186]: audit 2024-09-21T03:34:02.090060+0000 mon.a (mon.0) 11173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:34:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:02 smithi179 bash[23186]: audit 2024-09-21T03:34:02.100802+0000 mon.a (mon.0) 11174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:02 smithi179 bash[23186]: audit 2024-09-21T03:34:02.105572+0000 mon.a (mon.0) 11175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:34:03.219 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:34:02 smithi044 bash[22930]: debug 2024-09-21T03:34:02.916+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:34:03.219 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:34:02 smithi044 bash[22930]: debug 2024-09-21T03:34:02.932+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:34:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:03.340 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:03 smithi044 bash[22676]: cluster 2024-09-21T03:34:01.938316+0000 mgr.a (mgr.14388) 13830 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:03 smithi044 bash[22676]: audit 2024-09-21T03:34:02.106896+0000 mgr.a (mgr.14388) 13831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:34:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:03 smithi179 bash[23186]: cluster 2024-09-21T03:34:01.938316+0000 mgr.a (mgr.14388) 13830 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:03 smithi179 bash[23186]: audit 2024-09-21T03:34:02.106896+0000 mgr.a (mgr.14388) 13831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:34:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:03 smithi049 bash[23528]: cluster 2024-09-21T03:34:01.938316+0000 mgr.a (mgr.14388) 13830 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:03 smithi049 bash[23528]: audit 2024-09-21T03:34:02.106896+0000 mgr.a (mgr.14388) 13831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:34:04.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:04 smithi049 bash[23528]: audit 2024-09-21T03:34:02.437379+0000 mgr.a (mgr.14388) 13832 : audit [DBG] from='client.300648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:04.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:04 smithi049 bash[23528]: audit 2024-09-21T03:34:02.919346+0000 mgr.a (mgr.14388) 13833 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:34:04.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:04 smithi049 bash[23528]: cephadm 2024-09-21T03:34:02.933369+0000 mgr.a (mgr.14388) 13834 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:34:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:04 smithi044 bash[22676]: audit 2024-09-21T03:34:02.437379+0000 mgr.a (mgr.14388) 13832 : audit [DBG] from='client.300648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:04 smithi044 bash[22676]: audit 2024-09-21T03:34:02.919346+0000 mgr.a (mgr.14388) 13833 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:34:04.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:04 smithi044 bash[22676]: cephadm 2024-09-21T03:34:02.933369+0000 mgr.a (mgr.14388) 13834 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:34:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:04 smithi179 bash[23186]: audit 2024-09-21T03:34:02.437379+0000 mgr.a (mgr.14388) 13832 : audit [DBG] from='client.300648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:04 smithi179 bash[23186]: audit 2024-09-21T03:34:02.919346+0000 mgr.a (mgr.14388) 13833 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:34:04.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:04 smithi179 bash[23186]: cephadm 2024-09-21T03:34:02.933369+0000 mgr.a (mgr.14388) 13834 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:34:05.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:05 smithi044 bash[22676]: cluster 2024-09-21T03:34:03.939227+0000 mgr.a (mgr.14388) 13835 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:05.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:05 smithi179 bash[23186]: cluster 2024-09-21T03:34:03.939227+0000 mgr.a (mgr.14388) 13835 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:05 smithi049 bash[23528]: cluster 2024-09-21T03:34:03.939227+0000 mgr.a (mgr.14388) 13835 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:07 smithi179 bash[23186]: cluster 2024-09-21T03:34:05.941522+0000 mgr.a (mgr.14388) 13836 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:07 smithi049 bash[23528]: cluster 2024-09-21T03:34:05.941522+0000 mgr.a (mgr.14388) 13836 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:07 smithi044 bash[22676]: cluster 2024-09-21T03:34:05.941522+0000 mgr.a (mgr.14388) 13836 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:08.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:08.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:08.342 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:09.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:09.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:09.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:09.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:09.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:09 smithi179 bash[23186]: cluster 2024-09-21T03:34:07.942262+0000 mgr.a (mgr.14388) 13837 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:09 smithi049 bash[23528]: cluster 2024-09-21T03:34:07.942262+0000 mgr.a (mgr.14388) 13837 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:09 smithi044 bash[22676]: cluster 2024-09-21T03:34:07.942262+0000 mgr.a (mgr.14388) 13837 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:10 smithi179 bash[23186]: audit 2024-09-21T03:34:08.682468+0000 mgr.a (mgr.14388) 13838 : audit [DBG] from='client.300828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:10.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:10 smithi049 bash[23528]: audit 2024-09-21T03:34:08.682468+0000 mgr.a (mgr.14388) 13838 : audit [DBG] from='client.300828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:10 smithi044 bash[22676]: audit 2024-09-21T03:34:08.682468+0000 mgr.a (mgr.14388) 13838 : audit [DBG] from='client.300828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:11 smithi179 bash[23186]: cluster 2024-09-21T03:34:09.943150+0000 mgr.a (mgr.14388) 13839 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:11 smithi179 bash[23186]: audit 2024-09-21T03:34:10.413663+0000 mon.a (mon.0) 11176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:11 smithi179 bash[23186]: audit 2024-09-21T03:34:10.422590+0000 mon.a (mon.0) 11177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:11 smithi179 bash[23186]: audit 2024-09-21T03:34:10.433543+0000 mon.a (mon.0) 11178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:11 smithi179 bash[23186]: audit 2024-09-21T03:34:10.823844+0000 mon.a (mon.0) 11179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:11 smithi179 bash[23186]: audit 2024-09-21T03:34:10.832209+0000 mon.a (mon.0) 11180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:11 smithi179 bash[23186]: audit 2024-09-21T03:34:10.842243+0000 mon.a (mon.0) 11181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:11 smithi049 bash[23528]: cluster 2024-09-21T03:34:09.943150+0000 mgr.a (mgr.14388) 13839 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:11 smithi049 bash[23528]: audit 2024-09-21T03:34:10.413663+0000 mon.a (mon.0) 11176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:11 smithi049 bash[23528]: audit 2024-09-21T03:34:10.422590+0000 mon.a (mon.0) 11177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:11 smithi049 bash[23528]: audit 2024-09-21T03:34:10.433543+0000 mon.a (mon.0) 11178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:11 smithi049 bash[23528]: audit 2024-09-21T03:34:10.823844+0000 mon.a (mon.0) 11179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:11 smithi049 bash[23528]: audit 2024-09-21T03:34:10.832209+0000 mon.a (mon.0) 11180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:11 smithi049 bash[23528]: audit 2024-09-21T03:34:10.842243+0000 mon.a (mon.0) 11181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:11 smithi044 bash[22676]: cluster 2024-09-21T03:34:09.943150+0000 mgr.a (mgr.14388) 13839 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:11 smithi044 bash[22676]: audit 2024-09-21T03:34:10.413663+0000 mon.a (mon.0) 11176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:11 smithi044 bash[22676]: audit 2024-09-21T03:34:10.422590+0000 mon.a (mon.0) 11177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:11 smithi044 bash[22676]: audit 2024-09-21T03:34:10.433543+0000 mon.a (mon.0) 11178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:11 smithi044 bash[22676]: audit 2024-09-21T03:34:10.823844+0000 mon.a (mon.0) 11179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:11 smithi044 bash[22676]: audit 2024-09-21T03:34:10.832209+0000 mon.a (mon.0) 11180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:11 smithi044 bash[22676]: audit 2024-09-21T03:34:10.842243+0000 mon.a (mon.0) 11181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:13 smithi049 bash[23528]: cluster 2024-09-21T03:34:11.945403+0000 mgr.a (mgr.14388) 13840 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:13 smithi044 bash[22676]: cluster 2024-09-21T03:34:11.945403+0000 mgr.a (mgr.14388) 13840 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:13.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:13 smithi179 bash[23186]: cluster 2024-09-21T03:34:11.945403+0000 mgr.a (mgr.14388) 13840 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:14.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:14.910 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:14.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:14.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:14.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:14.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:15.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:15 smithi049 bash[23528]: cluster 2024-09-21T03:34:13.946127+0000 mgr.a (mgr.14388) 13841 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:15 smithi044 bash[22676]: cluster 2024-09-21T03:34:13.946127+0000 mgr.a (mgr.14388) 13841 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:15.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:15 smithi179 bash[23186]: cluster 2024-09-21T03:34:13.946127+0000 mgr.a (mgr.14388) 13841 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:16.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:16 smithi049 bash[23528]: audit 2024-09-21T03:34:14.469855+0000 mgr.a (mgr.14388) 13842 : audit [DBG] from='client.300906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:16 smithi044 bash[22676]: audit 2024-09-21T03:34:14.469855+0000 mgr.a (mgr.14388) 13842 : audit [DBG] from='client.300906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:16 smithi179 bash[23186]: audit 2024-09-21T03:34:14.469855+0000 mgr.a (mgr.14388) 13842 : audit [DBG] from='client.300906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:17 smithi049 bash[23528]: cluster 2024-09-21T03:34:15.948509+0000 mgr.a (mgr.14388) 13843 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:17 smithi044 bash[22676]: cluster 2024-09-21T03:34:15.948509+0000 mgr.a (mgr.14388) 13843 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:17 smithi179 bash[23186]: cluster 2024-09-21T03:34:15.948509+0000 mgr.a (mgr.14388) 13843 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:34:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:19 smithi049 bash[23528]: cluster 2024-09-21T03:34:17.949326+0000 mgr.a (mgr.14388) 13844 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:19 smithi049 bash[23528]: audit 2024-09-21T03:34:18.722392+0000 mon.a (mon.0) 11182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:19 smithi049 bash[23528]: audit 2024-09-21T03:34:18.732492+0000 mon.a (mon.0) 11183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:19 smithi049 bash[23528]: audit 2024-09-21T03:34:18.744278+0000 mon.a (mon.0) 11184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:19 smithi044 bash[22676]: cluster 2024-09-21T03:34:17.949326+0000 mgr.a (mgr.14388) 13844 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:19 smithi044 bash[22676]: audit 2024-09-21T03:34:18.722392+0000 mon.a (mon.0) 11182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:19 smithi044 bash[22676]: audit 2024-09-21T03:34:18.732492+0000 mon.a (mon.0) 11183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:19 smithi044 bash[22676]: audit 2024-09-21T03:34:18.744278+0000 mon.a (mon.0) 11184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:19 smithi179 bash[23186]: cluster 2024-09-21T03:34:17.949326+0000 mgr.a (mgr.14388) 13844 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:19.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:19 smithi179 bash[23186]: audit 2024-09-21T03:34:18.722392+0000 mon.a (mon.0) 11182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:19 smithi179 bash[23186]: audit 2024-09-21T03:34:18.732492+0000 mon.a (mon.0) 11183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:19 smithi179 bash[23186]: audit 2024-09-21T03:34:18.744278+0000 mon.a (mon.0) 11184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:20.684 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:21 smithi049 bash[23528]: cluster 2024-09-21T03:34:19.949864+0000 mgr.a (mgr.14388) 13845 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:21 smithi049 bash[23528]: audit 2024-09-21T03:34:20.243052+0000 mgr.a (mgr.14388) 13846 : audit [DBG] from='client.300981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:21 smithi044 bash[22676]: cluster 2024-09-21T03:34:19.949864+0000 mgr.a (mgr.14388) 13845 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:21 smithi044 bash[22676]: audit 2024-09-21T03:34:20.243052+0000 mgr.a (mgr.14388) 13846 : audit [DBG] from='client.300981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:21 smithi179 bash[23186]: cluster 2024-09-21T03:34:19.949864+0000 mgr.a (mgr.14388) 13845 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:21.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:21 smithi179 bash[23186]: audit 2024-09-21T03:34:20.243052+0000 mgr.a (mgr.14388) 13846 : audit [DBG] from='client.300981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:23 smithi044 bash[22676]: cluster 2024-09-21T03:34:21.952691+0000 mgr.a (mgr.14388) 13847 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:23 smithi179 bash[23186]: cluster 2024-09-21T03:34:21.952691+0000 mgr.a (mgr.14388) 13847 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:23 smithi049 bash[23528]: cluster 2024-09-21T03:34:21.952691+0000 mgr.a (mgr.14388) 13847 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:25.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:25 smithi179 bash[23186]: cluster 2024-09-21T03:34:23.953563+0000 mgr.a (mgr.14388) 13848 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:34:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:25 smithi049 bash[23528]: cluster 2024-09-21T03:34:23.953563+0000 mgr.a (mgr.14388) 13848 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:34:25.664 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:25 smithi044 bash[22676]: cluster 2024-09-21T03:34:23.953563+0000 mgr.a (mgr.14388) 13848 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:34:25.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:25.686 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:25.686 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:26.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:26.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:26.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:26.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:26.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:27 smithi049 bash[23528]: cluster 2024-09-21T03:34:25.955456+0000 mgr.a (mgr.14388) 13849 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:27 smithi049 bash[23528]: audit 2024-09-21T03:34:26.015447+0000 mgr.a (mgr.14388) 13850 : audit [DBG] from='client.301059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:27 smithi044 bash[22676]: cluster 2024-09-21T03:34:25.955456+0000 mgr.a (mgr.14388) 13849 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:27 smithi044 bash[22676]: audit 2024-09-21T03:34:26.015447+0000 mgr.a (mgr.14388) 13850 : audit [DBG] from='client.301059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:27 smithi179 bash[23186]: cluster 2024-09-21T03:34:25.955456+0000 mgr.a (mgr.14388) 13849 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:27 smithi179 bash[23186]: audit 2024-09-21T03:34:26.015447+0000 mgr.a (mgr.14388) 13850 : audit [DBG] from='client.301059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:29 smithi049 bash[23528]: cluster 2024-09-21T03:34:27.956341+0000 mgr.a (mgr.14388) 13851 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:34:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:29 smithi044 bash[22676]: cluster 2024-09-21T03:34:27.956341+0000 mgr.a (mgr.14388) 13851 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:34:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:29 smithi179 bash[23186]: cluster 2024-09-21T03:34:27.956341+0000 mgr.a (mgr.14388) 13851 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:34:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:31 smithi179 bash[23186]: cluster 2024-09-21T03:34:29.957102+0000 mgr.a (mgr.14388) 13852 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:34:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:31 smithi179 bash[23186]: audit 2024-09-21T03:34:30.653798+0000 mon.a (mon.0) 11185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:31 smithi179 bash[23186]: audit 2024-09-21T03:34:30.662400+0000 mon.a (mon.0) 11186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:31 smithi179 bash[23186]: audit 2024-09-21T03:34:30.672905+0000 mon.a (mon.0) 11187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:31 smithi179 bash[23186]: audit 2024-09-21T03:34:31.057348+0000 mon.a (mon.0) 11188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:31 smithi179 bash[23186]: audit 2024-09-21T03:34:31.065905+0000 mon.a (mon.0) 11189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:31 smithi179 bash[23186]: audit 2024-09-21T03:34:31.076017+0000 mon.a (mon.0) 11190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:31 smithi044 bash[22676]: cluster 2024-09-21T03:34:29.957102+0000 mgr.a (mgr.14388) 13852 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:34:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:31 smithi044 bash[22676]: audit 2024-09-21T03:34:30.653798+0000 mon.a (mon.0) 11185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:31 smithi044 bash[22676]: audit 2024-09-21T03:34:30.662400+0000 mon.a (mon.0) 11186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:31 smithi044 bash[22676]: audit 2024-09-21T03:34:30.672905+0000 mon.a (mon.0) 11187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:31 smithi044 bash[22676]: audit 2024-09-21T03:34:31.057348+0000 mon.a (mon.0) 11188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:31 smithi044 bash[22676]: audit 2024-09-21T03:34:31.065905+0000 mon.a (mon.0) 11189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:31 smithi044 bash[22676]: audit 2024-09-21T03:34:31.076017+0000 mon.a (mon.0) 11190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:31 smithi049 bash[23528]: cluster 2024-09-21T03:34:29.957102+0000 mgr.a (mgr.14388) 13852 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:34:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:31 smithi049 bash[23528]: audit 2024-09-21T03:34:30.653798+0000 mon.a (mon.0) 11185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:31 smithi049 bash[23528]: audit 2024-09-21T03:34:30.662400+0000 mon.a (mon.0) 11186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:31 smithi049 bash[23528]: audit 2024-09-21T03:34:30.672905+0000 mon.a (mon.0) 11187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:31 smithi049 bash[23528]: audit 2024-09-21T03:34:31.057348+0000 mon.a (mon.0) 11188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:31 smithi049 bash[23528]: audit 2024-09-21T03:34:31.065905+0000 mon.a (mon.0) 11189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:31.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:31 smithi049 bash[23528]: audit 2024-09-21T03:34:31.076017+0000 mon.a (mon.0) 11190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:32.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:33 smithi044 bash[22676]: audit 2024-09-21T03:34:31.798507+0000 mgr.a (mgr.14388) 13853 : audit [DBG] from='client.301134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:33 smithi044 bash[22676]: cluster 2024-09-21T03:34:31.958866+0000 mgr.a (mgr.14388) 13854 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:33.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:33 smithi179 bash[23186]: audit 2024-09-21T03:34:31.798507+0000 mgr.a (mgr.14388) 13853 : audit [DBG] from='client.301134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:33.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:33 smithi179 bash[23186]: cluster 2024-09-21T03:34:31.958866+0000 mgr.a (mgr.14388) 13854 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:33 smithi049 bash[23528]: audit 2024-09-21T03:34:31.798507+0000 mgr.a (mgr.14388) 13853 : audit [DBG] from='client.301134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:33 smithi049 bash[23528]: cluster 2024-09-21T03:34:31.958866+0000 mgr.a (mgr.14388) 13854 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:35 smithi044 bash[22676]: cluster 2024-09-21T03:34:33.959747+0000 mgr.a (mgr.14388) 13855 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:35 smithi179 bash[23186]: cluster 2024-09-21T03:34:33.959747+0000 mgr.a (mgr.14388) 13855 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:35 smithi049 bash[23528]: cluster 2024-09-21T03:34:33.959747+0000 mgr.a (mgr.14388) 13855 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:37.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:37.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:37 smithi044 bash[22676]: cluster 2024-09-21T03:34:35.961966+0000 mgr.a (mgr.14388) 13856 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:37 smithi179 bash[23186]: cluster 2024-09-21T03:34:35.961966+0000 mgr.a (mgr.14388) 13856 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:37 smithi049 bash[23528]: cluster 2024-09-21T03:34:35.961966+0000 mgr.a (mgr.14388) 13856 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:37.984 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:37.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:37.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:37.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:37.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:39 smithi044 bash[22676]: audit 2024-09-21T03:34:37.552551+0000 mgr.a (mgr.14388) 13857 : audit [DBG] from='client.301212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:39.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:39 smithi044 bash[22676]: cluster 2024-09-21T03:34:37.962564+0000 mgr.a (mgr.14388) 13858 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:39.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:39 smithi044 bash[22676]: audit 2024-09-21T03:34:38.956964+0000 mon.a (mon.0) 11191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:39 smithi044 bash[22676]: audit 2024-09-21T03:34:38.963073+0000 mon.a (mon.0) 11192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:39 smithi044 bash[22676]: audit 2024-09-21T03:34:38.969844+0000 mon.a (mon.0) 11193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:39 smithi179 bash[23186]: audit 2024-09-21T03:34:37.552551+0000 mgr.a (mgr.14388) 13857 : audit [DBG] from='client.301212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:39 smithi179 bash[23186]: cluster 2024-09-21T03:34:37.962564+0000 mgr.a (mgr.14388) 13858 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:39 smithi179 bash[23186]: audit 2024-09-21T03:34:38.956964+0000 mon.a (mon.0) 11191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:39 smithi179 bash[23186]: audit 2024-09-21T03:34:38.963073+0000 mon.a (mon.0) 11192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:39 smithi179 bash[23186]: audit 2024-09-21T03:34:38.969844+0000 mon.a (mon.0) 11193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:39 smithi049 bash[23528]: audit 2024-09-21T03:34:37.552551+0000 mgr.a (mgr.14388) 13857 : audit [DBG] from='client.301212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:39 smithi049 bash[23528]: cluster 2024-09-21T03:34:37.962564+0000 mgr.a (mgr.14388) 13858 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:39 smithi049 bash[23528]: audit 2024-09-21T03:34:38.956964+0000 mon.a (mon.0) 11191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:39 smithi049 bash[23528]: audit 2024-09-21T03:34:38.963073+0000 mon.a (mon.0) 11192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:39 smithi049 bash[23528]: audit 2024-09-21T03:34:38.969844+0000 mon.a (mon.0) 11193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:41.668 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:41 smithi049 bash[23528]: cluster 2024-09-21T03:34:39.963439+0000 mgr.a (mgr.14388) 13859 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:41 smithi044 bash[22676]: cluster 2024-09-21T03:34:39.963439+0000 mgr.a (mgr.14388) 13859 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:41.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:41 smithi179 bash[23186]: cluster 2024-09-21T03:34:39.963439+0000 mgr.a (mgr.14388) 13859 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:42.985 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:43.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:43 smithi044 bash[22676]: cluster 2024-09-21T03:34:41.965836+0000 mgr.a (mgr.14388) 13860 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:43.588 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:43 smithi049 bash[23528]: cluster 2024-09-21T03:34:41.965836+0000 mgr.a (mgr.14388) 13860 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:43.734 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:43.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:43.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:43.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:43.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:43 smithi179 bash[23186]: cluster 2024-09-21T03:34:41.965836+0000 mgr.a (mgr.14388) 13860 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:44 smithi044 bash[22676]: audit 2024-09-21T03:34:43.330026+0000 mgr.a (mgr.14388) 13861 : audit [DBG] from='client.301287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:44.610 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:44 smithi049 bash[23528]: audit 2024-09-21T03:34:43.330026+0000 mgr.a (mgr.14388) 13861 : audit [DBG] from='client.301287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:44.637 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:44 smithi179 bash[23186]: audit 2024-09-21T03:34:43.330026+0000 mgr.a (mgr.14388) 13861 : audit [DBG] from='client.301287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:45 smithi049 bash[23528]: cluster 2024-09-21T03:34:43.966535+0000 mgr.a (mgr.14388) 13862 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:45 smithi044 bash[22676]: cluster 2024-09-21T03:34:43.966535+0000 mgr.a (mgr.14388) 13862 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:45.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:45 smithi179 bash[23186]: cluster 2024-09-21T03:34:43.966535+0000 mgr.a (mgr.14388) 13862 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:47 smithi044 bash[22676]: cluster 2024-09-21T03:34:45.968001+0000 mgr.a (mgr.14388) 13863 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:47 smithi179 bash[23186]: cluster 2024-09-21T03:34:45.968001+0000 mgr.a (mgr.14388) 13863 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:47 smithi049 bash[23528]: cluster 2024-09-21T03:34:45.968001+0000 mgr.a (mgr.14388) 13863 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:48.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:48.737 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:48.737 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:49.531 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:49.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:49.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:49.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:49 smithi044 bash[22676]: cluster 2024-09-21T03:34:47.968717+0000 mgr.a (mgr.14388) 13864 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:49 smithi179 bash[23186]: cluster 2024-09-21T03:34:47.968717+0000 mgr.a (mgr.14388) 13864 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:49 smithi049 bash[23528]: cluster 2024-09-21T03:34:47.968717+0000 mgr.a (mgr.14388) 13864 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:50 smithi044 bash[22676]: audit 2024-09-21T03:34:49.071823+0000 mgr.a (mgr.14388) 13865 : audit [DBG] from='client.301362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:50 smithi179 bash[23186]: audit 2024-09-21T03:34:49.071823+0000 mgr.a (mgr.14388) 13865 : audit [DBG] from='client.301362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:50 smithi049 bash[23528]: audit 2024-09-21T03:34:49.071823+0000 mgr.a (mgr.14388) 13865 : audit [DBG] from='client.301362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:51 smithi044 bash[22676]: cluster 2024-09-21T03:34:49.970345+0000 mgr.a (mgr.14388) 13866 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:34:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:51 smithi044 bash[22676]: audit 2024-09-21T03:34:50.888724+0000 mon.a (mon.0) 11194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:51 smithi044 bash[22676]: audit 2024-09-21T03:34:50.898466+0000 mon.a (mon.0) 11195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:51 smithi044 bash[22676]: audit 2024-09-21T03:34:50.910165+0000 mon.a (mon.0) 11196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:51 smithi044 bash[22676]: audit 2024-09-21T03:34:51.244549+0000 mon.a (mon.0) 11197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:51 smithi044 bash[22676]: audit 2024-09-21T03:34:51.253006+0000 mon.a (mon.0) 11198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:51 smithi044 bash[22676]: audit 2024-09-21T03:34:51.263168+0000 mon.a (mon.0) 11199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:51 smithi179 bash[23186]: cluster 2024-09-21T03:34:49.970345+0000 mgr.a (mgr.14388) 13866 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:34:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:51 smithi179 bash[23186]: audit 2024-09-21T03:34:50.888724+0000 mon.a (mon.0) 11194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:51 smithi179 bash[23186]: audit 2024-09-21T03:34:50.898466+0000 mon.a (mon.0) 11195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:51 smithi179 bash[23186]: audit 2024-09-21T03:34:50.910165+0000 mon.a (mon.0) 11196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:51 smithi179 bash[23186]: audit 2024-09-21T03:34:51.244549+0000 mon.a (mon.0) 11197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:51 smithi179 bash[23186]: audit 2024-09-21T03:34:51.253006+0000 mon.a (mon.0) 11198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:51 smithi179 bash[23186]: audit 2024-09-21T03:34:51.263168+0000 mon.a (mon.0) 11199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:51 smithi049 bash[23528]: cluster 2024-09-21T03:34:49.970345+0000 mgr.a (mgr.14388) 13866 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:34:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:51 smithi049 bash[23528]: audit 2024-09-21T03:34:50.888724+0000 mon.a (mon.0) 11194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:51 smithi049 bash[23528]: audit 2024-09-21T03:34:50.898466+0000 mon.a (mon.0) 11195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:51 smithi049 bash[23528]: audit 2024-09-21T03:34:50.910165+0000 mon.a (mon.0) 11196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:51 smithi049 bash[23528]: audit 2024-09-21T03:34:51.244549+0000 mon.a (mon.0) 11197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:51 smithi049 bash[23528]: audit 2024-09-21T03:34:51.253006+0000 mon.a (mon.0) 11198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:51 smithi049 bash[23528]: audit 2024-09-21T03:34:51.263168+0000 mon.a (mon.0) 11199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:34:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:52 smithi044 bash[22676]: cluster 2024-09-21T03:34:51.972036+0000 mgr.a (mgr.14388) 13867 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:52.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:52 smithi179 bash[23186]: cluster 2024-09-21T03:34:51.972036+0000 mgr.a (mgr.14388) 13867 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:52 smithi049 bash[23528]: cluster 2024-09-21T03:34:51.972036+0000 mgr.a (mgr.14388) 13867 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:34:54.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:34:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:34:54.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:34:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:55 smithi049 bash[23528]: cluster 2024-09-21T03:34:53.972818+0000 mgr.a (mgr.14388) 13868 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:55.324 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:34:55.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:34:55.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:34:55.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:34:55.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:34:55.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:55 smithi044 bash[22676]: cluster 2024-09-21T03:34:53.972818+0000 mgr.a (mgr.14388) 13868 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:55.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:55 smithi179 bash[23186]: cluster 2024-09-21T03:34:53.972818+0000 mgr.a (mgr.14388) 13868 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:34:56.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:56 smithi049 bash[23528]: audit 2024-09-21T03:34:54.866830+0000 mgr.a (mgr.14388) 13869 : audit [DBG] from='client.301440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:56.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:56 smithi044 bash[22676]: audit 2024-09-21T03:34:54.866830+0000 mgr.a (mgr.14388) 13869 : audit [DBG] from='client.301440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:56 smithi179 bash[23186]: audit 2024-09-21T03:34:54.866830+0000 mgr.a (mgr.14388) 13869 : audit [DBG] from='client.301440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:57.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:57 smithi049 bash[23528]: cluster 2024-09-21T03:34:55.975662+0000 mgr.a (mgr.14388) 13870 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:34:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:57 smithi044 bash[22676]: cluster 2024-09-21T03:34:55.975662+0000 mgr.a (mgr.14388) 13870 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:34:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:57 smithi179 bash[23186]: cluster 2024-09-21T03:34:55.975662+0000 mgr.a (mgr.14388) 13870 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:34:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:34:59 smithi049 bash[23528]: cluster 2024-09-21T03:34:57.976443+0000 mgr.a (mgr.14388) 13871 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:34:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:34:59 smithi044 bash[22676]: cluster 2024-09-21T03:34:57.976443+0000 mgr.a (mgr.14388) 13871 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:34:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:34:59 smithi179 bash[23186]: cluster 2024-09-21T03:34:57.976443+0000 mgr.a (mgr.14388) 13871 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:35:00.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:00 smithi044 bash[22676]: audit 2024-09-21T03:34:59.180670+0000 mon.a (mon.0) 11200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:00 smithi044 bash[22676]: audit 2024-09-21T03:34:59.189452+0000 mon.a (mon.0) 11201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:00 smithi044 bash[22676]: audit 2024-09-21T03:34:59.199916+0000 mon.a (mon.0) 11202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:00 smithi179 bash[23186]: audit 2024-09-21T03:34:59.180670+0000 mon.a (mon.0) 11200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:00 smithi179 bash[23186]: audit 2024-09-21T03:34:59.189452+0000 mon.a (mon.0) 11201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:00 smithi179 bash[23186]: audit 2024-09-21T03:34:59.199916+0000 mon.a (mon.0) 11202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:00 smithi049 bash[23528]: audit 2024-09-21T03:34:59.180670+0000 mon.a (mon.0) 11200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:00 smithi049 bash[23528]: audit 2024-09-21T03:34:59.189452+0000 mon.a (mon.0) 11201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:00 smithi049 bash[23528]: audit 2024-09-21T03:34:59.199916+0000 mon.a (mon.0) 11202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:01.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:01 smithi044 bash[22676]: cluster 2024-09-21T03:34:59.977624+0000 mgr.a (mgr.14388) 13872 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:35:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:01 smithi179 bash[23186]: cluster 2024-09-21T03:34:59.977624+0000 mgr.a (mgr.14388) 13872 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:35:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:01 smithi049 bash[23528]: cluster 2024-09-21T03:34:59.977624+0000 mgr.a (mgr.14388) 13872 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:35:02.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:02 smithi049 bash[23528]: audit 2024-09-21T03:35:00.667687+0000 mgr.a (mgr.14388) 13873 : audit [DBG] from='client.301518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:02.472 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:02 smithi044 bash[22676]: audit 2024-09-21T03:35:00.667687+0000 mgr.a (mgr.14388) 13873 : audit [DBG] from='client.301518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:02.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:02 smithi179 bash[23186]: audit 2024-09-21T03:35:00.667687+0000 mgr.a (mgr.14388) 13873 : audit [DBG] from='client.301518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:03.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:03 smithi044 bash[22676]: cluster 2024-09-21T03:35:01.979949+0000 mgr.a (mgr.14388) 13874 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:35:03.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:03 smithi044 bash[22676]: audit 2024-09-21T03:35:02.994615+0000 mon.a (mon.0) 11203 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:35:03.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:03 smithi179 bash[23186]: cluster 2024-09-21T03:35:01.979949+0000 mgr.a (mgr.14388) 13874 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:35:03.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:03 smithi179 bash[23186]: audit 2024-09-21T03:35:02.994615+0000 mon.a (mon.0) 11203 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:35:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:03 smithi049 bash[23528]: cluster 2024-09-21T03:35:01.979949+0000 mgr.a (mgr.14388) 13874 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:35:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:03 smithi049 bash[23528]: audit 2024-09-21T03:35:02.994615+0000 mon.a (mon.0) 11203 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:35:04.606 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22930]: debug 2024-09-21T03:35:04.331+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:35:04.606 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22930]: debug 2024-09-21T03:35:04.331+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.604783+0000 mon.a (mon.0) 11204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.611201+0000 mon.a (mon.0) 11205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.617432+0000 mon.a (mon.0) 11206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.622560+0000 mon.a (mon.0) 11207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.623544+0000 mon.a (mon.0) 11208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.624188+0000 mon.a (mon.0) 11209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.628647+0000 mon.a (mon.0) 11210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.631552+0000 mon.a (mon.0) 11211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:03.632543+0000 mgr.a (mgr.14388) 13875 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: cluster 2024-09-21T03:35:03.980482+0000 mgr.a (mgr.14388) 13876 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: audit 2024-09-21T03:35:04.335409+0000 mgr.a (mgr.14388) 13877 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:35:04.930 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:04 smithi179 bash[23186]: cephadm 2024-09-21T03:35:04.336563+0000 mgr.a (mgr.14388) 13878 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.604783+0000 mon.a (mon.0) 11204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.611201+0000 mon.a (mon.0) 11205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.617432+0000 mon.a (mon.0) 11206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.622560+0000 mon.a (mon.0) 11207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.623544+0000 mon.a (mon.0) 11208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.624188+0000 mon.a (mon.0) 11209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.628647+0000 mon.a (mon.0) 11210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.631552+0000 mon.a (mon.0) 11211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:03.632543+0000 mgr.a (mgr.14388) 13875 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: cluster 2024-09-21T03:35:03.980482+0000 mgr.a (mgr.14388) 13876 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: audit 2024-09-21T03:35:04.335409+0000 mgr.a (mgr.14388) 13877 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:35:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:04 smithi044 bash[22676]: cephadm 2024-09-21T03:35:04.336563+0000 mgr.a (mgr.14388) 13878 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.604783+0000 mon.a (mon.0) 11204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.611201+0000 mon.a (mon.0) 11205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.617432+0000 mon.a (mon.0) 11206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.622560+0000 mon.a (mon.0) 11207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.623544+0000 mon.a (mon.0) 11208 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.624188+0000 mon.a (mon.0) 11209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.628647+0000 mon.a (mon.0) 11210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.631552+0000 mon.a (mon.0) 11211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:03.632543+0000 mgr.a (mgr.14388) 13875 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: cluster 2024-09-21T03:35:03.980482+0000 mgr.a (mgr.14388) 13876 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: audit 2024-09-21T03:35:04.335409+0000 mgr.a (mgr.14388) 13877 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:35:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:04 smithi049 bash[23528]: cephadm 2024-09-21T03:35:04.336563+0000 mgr.a (mgr.14388) 13878 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:35:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:06.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:06.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:06.891 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:06.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:06.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:06.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:06.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:07 smithi049 bash[23528]: cluster 2024-09-21T03:35:05.982914+0000 mgr.a (mgr.14388) 13879 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:07.412 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:07 smithi179 bash[23186]: cluster 2024-09-21T03:35:05.982914+0000 mgr.a (mgr.14388) 13879 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:07 smithi044 bash[22676]: cluster 2024-09-21T03:35:05.982914+0000 mgr.a (mgr.14388) 13879 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:08 smithi049 bash[23528]: audit 2024-09-21T03:35:06.471797+0000 mgr.a (mgr.14388) 13880 : audit [DBG] from='client.301698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:08.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:08 smithi044 bash[22676]: audit 2024-09-21T03:35:06.471797+0000 mgr.a (mgr.14388) 13880 : audit [DBG] from='client.301698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:08.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:08 smithi179 bash[23186]: audit 2024-09-21T03:35:06.471797+0000 mgr.a (mgr.14388) 13880 : audit [DBG] from='client.301698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:09 smithi049 bash[23528]: cluster 2024-09-21T03:35:07.983926+0000 mgr.a (mgr.14388) 13881 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:35:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:09 smithi044 bash[22676]: cluster 2024-09-21T03:35:07.983926+0000 mgr.a (mgr.14388) 13881 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:35:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:09 smithi179 bash[23186]: cluster 2024-09-21T03:35:07.983926+0000 mgr.a (mgr.14388) 13881 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:35:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:11 smithi044 bash[22676]: cluster 2024-09-21T03:35:09.985296+0000 mgr.a (mgr.14388) 13882 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:11.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:11 smithi179 bash[23186]: cluster 2024-09-21T03:35:09.985296+0000 mgr.a (mgr.14388) 13882 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:11 smithi049 bash[23528]: cluster 2024-09-21T03:35:09.985296+0000 mgr.a (mgr.14388) 13882 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:12 smithi049 bash[23528]: audit 2024-09-21T03:35:11.095452+0000 mon.a (mon.0) 11212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:12 smithi049 bash[23528]: audit 2024-09-21T03:35:11.103869+0000 mon.a (mon.0) 11213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:12 smithi049 bash[23528]: audit 2024-09-21T03:35:11.113055+0000 mon.a (mon.0) 11214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:12 smithi049 bash[23528]: audit 2024-09-21T03:35:11.476375+0000 mon.a (mon.0) 11215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:12 smithi049 bash[23528]: audit 2024-09-21T03:35:11.485285+0000 mon.a (mon.0) 11216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:12 smithi049 bash[23528]: audit 2024-09-21T03:35:11.496877+0000 mon.a (mon.0) 11217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:12 smithi044 bash[22676]: audit 2024-09-21T03:35:11.095452+0000 mon.a (mon.0) 11212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:12 smithi044 bash[22676]: audit 2024-09-21T03:35:11.103869+0000 mon.a (mon.0) 11213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:12 smithi044 bash[22676]: audit 2024-09-21T03:35:11.113055+0000 mon.a (mon.0) 11214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:12 smithi044 bash[22676]: audit 2024-09-21T03:35:11.476375+0000 mon.a (mon.0) 11215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:12 smithi044 bash[22676]: audit 2024-09-21T03:35:11.485285+0000 mon.a (mon.0) 11216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:12 smithi044 bash[22676]: audit 2024-09-21T03:35:11.496877+0000 mon.a (mon.0) 11217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:12 smithi179 bash[23186]: audit 2024-09-21T03:35:11.095452+0000 mon.a (mon.0) 11212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:12 smithi179 bash[23186]: audit 2024-09-21T03:35:11.103869+0000 mon.a (mon.0) 11213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:12 smithi179 bash[23186]: audit 2024-09-21T03:35:11.113055+0000 mon.a (mon.0) 11214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:12 smithi179 bash[23186]: audit 2024-09-21T03:35:11.476375+0000 mon.a (mon.0) 11215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:12 smithi179 bash[23186]: audit 2024-09-21T03:35:11.485285+0000 mon.a (mon.0) 11216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:12 smithi179 bash[23186]: audit 2024-09-21T03:35:11.496877+0000 mon.a (mon.0) 11217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:12.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:13 smithi044 bash[22676]: cluster 2024-09-21T03:35:11.986298+0000 mgr.a (mgr.14388) 13883 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:13 smithi044 bash[22676]: audit 2024-09-21T03:35:12.234240+0000 mgr.a (mgr.14388) 13884 : audit [DBG] from='client.301773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:13.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:13 smithi179 bash[23186]: cluster 2024-09-21T03:35:11.986298+0000 mgr.a (mgr.14388) 13883 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:13.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:13 smithi179 bash[23186]: audit 2024-09-21T03:35:12.234240+0000 mgr.a (mgr.14388) 13884 : audit [DBG] from='client.301773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:13 smithi049 bash[23528]: cluster 2024-09-21T03:35:11.986298+0000 mgr.a (mgr.14388) 13883 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:13 smithi049 bash[23528]: audit 2024-09-21T03:35:12.234240+0000 mgr.a (mgr.14388) 13884 : audit [DBG] from='client.301773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:15 smithi044 bash[22676]: cluster 2024-09-21T03:35:13.987254+0000 mgr.a (mgr.14388) 13885 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:15 smithi179 bash[23186]: cluster 2024-09-21T03:35:13.987254+0000 mgr.a (mgr.14388) 13885 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:15 smithi049 bash[23528]: cluster 2024-09-21T03:35:13.987254+0000 mgr.a (mgr.14388) 13885 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:17 smithi044 bash[22676]: cluster 2024-09-21T03:35:15.989494+0000 mgr.a (mgr.14388) 13886 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:17.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:17 smithi179 bash[23186]: cluster 2024-09-21T03:35:15.989494+0000 mgr.a (mgr.14388) 13886 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:17 smithi049 bash[23528]: cluster 2024-09-21T03:35:15.989494+0000 mgr.a (mgr.14388) 13886 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:35:17.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:17.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:17.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:18.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:18.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:18.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:18.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:18.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:19.439 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:19 smithi049 bash[23528]: cluster 2024-09-21T03:35:17.990200+0000 mgr.a (mgr.14388) 13887 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:19.439 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:19 smithi049 bash[23528]: audit 2024-09-21T03:35:18.009053+0000 mgr.a (mgr.14388) 13888 : audit [DBG] from='client.301845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:19.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:19 smithi044 bash[22676]: cluster 2024-09-21T03:35:17.990200+0000 mgr.a (mgr.14388) 13887 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:19.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:19 smithi044 bash[22676]: audit 2024-09-21T03:35:18.009053+0000 mgr.a (mgr.14388) 13888 : audit [DBG] from='client.301845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:19 smithi179 bash[23186]: cluster 2024-09-21T03:35:17.990200+0000 mgr.a (mgr.14388) 13887 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:19.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:19 smithi179 bash[23186]: audit 2024-09-21T03:35:18.009053+0000 mgr.a (mgr.14388) 13888 : audit [DBG] from='client.301845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:20.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:20 smithi044 bash[22676]: audit 2024-09-21T03:35:19.417235+0000 mon.a (mon.0) 11218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:20 smithi044 bash[22676]: audit 2024-09-21T03:35:19.425952+0000 mon.a (mon.0) 11219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:20 smithi044 bash[22676]: audit 2024-09-21T03:35:19.436392+0000 mon.a (mon.0) 11220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:20 smithi044 bash[22676]: cluster 2024-09-21T03:35:19.991646+0000 mgr.a (mgr.14388) 13889 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:35:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:20 smithi179 bash[23186]: audit 2024-09-21T03:35:19.417235+0000 mon.a (mon.0) 11218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:20 smithi179 bash[23186]: audit 2024-09-21T03:35:19.425952+0000 mon.a (mon.0) 11219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:20 smithi179 bash[23186]: audit 2024-09-21T03:35:19.436392+0000 mon.a (mon.0) 11220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:20 smithi179 bash[23186]: cluster 2024-09-21T03:35:19.991646+0000 mgr.a (mgr.14388) 13889 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:35:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:20 smithi049 bash[23528]: audit 2024-09-21T03:35:19.417235+0000 mon.a (mon.0) 11218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:20 smithi049 bash[23528]: audit 2024-09-21T03:35:19.425952+0000 mon.a (mon.0) 11219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:20 smithi049 bash[23528]: audit 2024-09-21T03:35:19.436392+0000 mon.a (mon.0) 11220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:20 smithi049 bash[23528]: cluster 2024-09-21T03:35:19.991646+0000 mgr.a (mgr.14388) 13889 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:35:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:23 smithi044 bash[22676]: cluster 2024-09-21T03:35:21.993418+0000 mgr.a (mgr.14388) 13890 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:35:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:23 smithi049 bash[23528]: cluster 2024-09-21T03:35:21.993418+0000 mgr.a (mgr.14388) 13890 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:35:23.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:23.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:23.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:23.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:23 smithi179 bash[23186]: cluster 2024-09-21T03:35:21.993418+0000 mgr.a (mgr.14388) 13890 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:35:24.218 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:24.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:24.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:24.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:24.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:25.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:25 smithi179 bash[23186]: audit 2024-09-21T03:35:23.781128+0000 mgr.a (mgr.14388) 13891 : audit [DBG] from='client.301923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:25.204 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:25 smithi179 bash[23186]: cluster 2024-09-21T03:35:23.993904+0000 mgr.a (mgr.14388) 13892 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:25 smithi044 bash[22676]: audit 2024-09-21T03:35:23.781128+0000 mgr.a (mgr.14388) 13891 : audit [DBG] from='client.301923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:25 smithi044 bash[22676]: cluster 2024-09-21T03:35:23.993904+0000 mgr.a (mgr.14388) 13892 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:25.492 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:25 smithi049 bash[23528]: audit 2024-09-21T03:35:23.781128+0000 mgr.a (mgr.14388) 13891 : audit [DBG] from='client.301923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:25.492 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:25 smithi049 bash[23528]: cluster 2024-09-21T03:35:23.993904+0000 mgr.a (mgr.14388) 13892 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:27.442 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:27 smithi179 bash[23186]: cluster 2024-09-21T03:35:25.995468+0000 mgr.a (mgr.14388) 13893 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:35:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:27 smithi044 bash[22676]: cluster 2024-09-21T03:35:25.995468+0000 mgr.a (mgr.14388) 13893 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:35:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:27 smithi049 bash[23528]: cluster 2024-09-21T03:35:25.995468+0000 mgr.a (mgr.14388) 13893 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:35:29.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:29.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:29.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:29 smithi044 bash[22676]: cluster 2024-09-21T03:35:27.996193+0000 mgr.a (mgr.14388) 13894 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:29 smithi179 bash[23186]: cluster 2024-09-21T03:35:27.996193+0000 mgr.a (mgr.14388) 13894 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:29 smithi049 bash[23528]: cluster 2024-09-21T03:35:27.996193+0000 mgr.a (mgr.14388) 13894 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:29.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:29.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:31.351 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:31 smithi044 bash[22676]: audit 2024-09-21T03:35:29.552020+0000 mgr.a (mgr.14388) 13895 : audit [DBG] from='client.302001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:31.351 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:31 smithi044 bash[22676]: cluster 2024-09-21T03:35:29.997056+0000 mgr.a (mgr.14388) 13896 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:35:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:31 smithi179 bash[23186]: audit 2024-09-21T03:35:29.552020+0000 mgr.a (mgr.14388) 13895 : audit [DBG] from='client.302001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:31 smithi179 bash[23186]: cluster 2024-09-21T03:35:29.997056+0000 mgr.a (mgr.14388) 13896 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:35:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:31 smithi049 bash[23528]: audit 2024-09-21T03:35:29.552020+0000 mgr.a (mgr.14388) 13895 : audit [DBG] from='client.302001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:31.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:31 smithi049 bash[23528]: cluster 2024-09-21T03:35:29.997056+0000 mgr.a (mgr.14388) 13896 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:35:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:32 smithi044 bash[22676]: audit 2024-09-21T03:35:31.329562+0000 mon.a (mon.0) 11221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:32 smithi044 bash[22676]: audit 2024-09-21T03:35:31.337841+0000 mon.a (mon.0) 11222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:32 smithi044 bash[22676]: audit 2024-09-21T03:35:31.348228+0000 mon.a (mon.0) 11223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:32 smithi044 bash[22676]: audit 2024-09-21T03:35:31.704816+0000 mon.a (mon.0) 11224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:32 smithi044 bash[22676]: audit 2024-09-21T03:35:31.713227+0000 mon.a (mon.0) 11225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:32 smithi044 bash[22676]: audit 2024-09-21T03:35:31.723248+0000 mon.a (mon.0) 11226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:32 smithi179 bash[23186]: audit 2024-09-21T03:35:31.329562+0000 mon.a (mon.0) 11221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:32 smithi179 bash[23186]: audit 2024-09-21T03:35:31.337841+0000 mon.a (mon.0) 11222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:32 smithi179 bash[23186]: audit 2024-09-21T03:35:31.348228+0000 mon.a (mon.0) 11223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:32 smithi179 bash[23186]: audit 2024-09-21T03:35:31.704816+0000 mon.a (mon.0) 11224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:32 smithi179 bash[23186]: audit 2024-09-21T03:35:31.713227+0000 mon.a (mon.0) 11225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:32 smithi179 bash[23186]: audit 2024-09-21T03:35:31.723248+0000 mon.a (mon.0) 11226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:32 smithi049 bash[23528]: audit 2024-09-21T03:35:31.329562+0000 mon.a (mon.0) 11221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:32 smithi049 bash[23528]: audit 2024-09-21T03:35:31.337841+0000 mon.a (mon.0) 11222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:32 smithi049 bash[23528]: audit 2024-09-21T03:35:31.348228+0000 mon.a (mon.0) 11223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:32 smithi049 bash[23528]: audit 2024-09-21T03:35:31.704816+0000 mon.a (mon.0) 11224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:32 smithi049 bash[23528]: audit 2024-09-21T03:35:31.713227+0000 mon.a (mon.0) 11225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:32 smithi049 bash[23528]: audit 2024-09-21T03:35:31.723248+0000 mon.a (mon.0) 11226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:33 smithi044 bash[22676]: cluster 2024-09-21T03:35:31.998751+0000 mgr.a (mgr.14388) 13897 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:35:33.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:33 smithi179 bash[23186]: cluster 2024-09-21T03:35:31.998751+0000 mgr.a (mgr.14388) 13897 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:35:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:33 smithi049 bash[23528]: cluster 2024-09-21T03:35:31.998751+0000 mgr.a (mgr.14388) 13897 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:35:34.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:34.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:34.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:35 smithi044 bash[22676]: cluster 2024-09-21T03:35:33.999513+0000 mgr.a (mgr.14388) 13898 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:35.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:35.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:35 smithi179 bash[23186]: cluster 2024-09-21T03:35:33.999513+0000 mgr.a (mgr.14388) 13898 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:35 smithi049 bash[23528]: cluster 2024-09-21T03:35:33.999513+0000 mgr.a (mgr.14388) 13898 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:36 smithi044 bash[22676]: audit 2024-09-21T03:35:35.325511+0000 mgr.a (mgr.14388) 13899 : audit [DBG] from='client.302076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:36 smithi179 bash[23186]: audit 2024-09-21T03:35:35.325511+0000 mgr.a (mgr.14388) 13899 : audit [DBG] from='client.302076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:36 smithi049 bash[23528]: audit 2024-09-21T03:35:35.325511+0000 mgr.a (mgr.14388) 13899 : audit [DBG] from='client.302076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:37 smithi044 bash[22676]: cluster 2024-09-21T03:35:36.002409+0000 mgr.a (mgr.14388) 13900 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:37 smithi179 bash[23186]: cluster 2024-09-21T03:35:36.002409+0000 mgr.a (mgr.14388) 13900 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:37 smithi049 bash[23528]: cluster 2024-09-21T03:35:36.002409+0000 mgr.a (mgr.14388) 13900 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:39 smithi179 bash[23186]: cluster 2024-09-21T03:35:38.003252+0000 mgr.a (mgr.14388) 13901 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:39.678 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:39 smithi049 bash[23528]: cluster 2024-09-21T03:35:38.003252+0000 mgr.a (mgr.14388) 13901 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:39 smithi044 bash[22676]: cluster 2024-09-21T03:35:38.003252+0000 mgr.a (mgr.14388) 13901 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:40 smithi044 bash[22676]: audit 2024-09-21T03:35:39.654743+0000 mon.a (mon.0) 11227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:40 smithi044 bash[22676]: audit 2024-09-21T03:35:39.663560+0000 mon.a (mon.0) 11228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:40.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:40 smithi044 bash[22676]: audit 2024-09-21T03:35:39.675894+0000 mon.a (mon.0) 11229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:40 smithi044 bash[22676]: cluster 2024-09-21T03:35:40.004437+0000 mgr.a (mgr.14388) 13902 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:35:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:40 smithi179 bash[23186]: audit 2024-09-21T03:35:39.654743+0000 mon.a (mon.0) 11227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:40 smithi179 bash[23186]: audit 2024-09-21T03:35:39.663560+0000 mon.a (mon.0) 11228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:40 smithi179 bash[23186]: audit 2024-09-21T03:35:39.675894+0000 mon.a (mon.0) 11229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:40 smithi179 bash[23186]: cluster 2024-09-21T03:35:40.004437+0000 mgr.a (mgr.14388) 13902 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:35:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:40 smithi049 bash[23528]: audit 2024-09-21T03:35:39.654743+0000 mon.a (mon.0) 11227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:40 smithi049 bash[23528]: audit 2024-09-21T03:35:39.663560+0000 mon.a (mon.0) 11228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:40 smithi049 bash[23528]: audit 2024-09-21T03:35:39.675894+0000 mon.a (mon.0) 11229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:40 smithi049 bash[23528]: cluster 2024-09-21T03:35:40.004437+0000 mgr.a (mgr.14388) 13902 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:35:41.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:41.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:41.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:41.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:41.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:41 smithi044 bash[22676]: audit 2024-09-21T03:35:41.084354+0000 mgr.a (mgr.14388) 13903 : audit [DBG] from='client.302154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:42.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:41 smithi179 bash[23186]: audit 2024-09-21T03:35:41.084354+0000 mgr.a (mgr.14388) 13903 : audit [DBG] from='client.302154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:41 smithi049 bash[23528]: audit 2024-09-21T03:35:41.084354+0000 mgr.a (mgr.14388) 13903 : audit [DBG] from='client.302154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:42 smithi044 bash[22676]: cluster 2024-09-21T03:35:42.006891+0000 mgr.a (mgr.14388) 13904 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:35:43.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:42 smithi179 bash[23186]: cluster 2024-09-21T03:35:42.006891+0000 mgr.a (mgr.14388) 13904 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:35:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:42 smithi049 bash[23528]: cluster 2024-09-21T03:35:42.006891+0000 mgr.a (mgr.14388) 13904 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:35:45.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:45 smithi044 bash[22676]: cluster 2024-09-21T03:35:44.007693+0000 mgr.a (mgr.14388) 13905 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:45.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:45 smithi049 bash[23528]: cluster 2024-09-21T03:35:44.007693+0000 mgr.a (mgr.14388) 13905 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:45.364 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:45 smithi179 bash[23186]: cluster 2024-09-21T03:35:44.007693+0000 mgr.a (mgr.14388) 13905 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:35:46.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:46.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:46.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:47.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:47 smithi179 bash[23186]: cluster 2024-09-21T03:35:46.009689+0000 mgr.a (mgr.14388) 13906 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:47.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:47.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:47.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:47.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:47.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:47 smithi044 bash[22676]: cluster 2024-09-21T03:35:46.009689+0000 mgr.a (mgr.14388) 13906 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:47 smithi049 bash[23528]: cluster 2024-09-21T03:35:46.009689+0000 mgr.a (mgr.14388) 13906 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:48.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:48 smithi044 bash[22676]: audit 2024-09-21T03:35:46.867669+0000 mgr.a (mgr.14388) 13907 : audit [DBG] from='client.302232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:48.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:48 smithi179 bash[23186]: audit 2024-09-21T03:35:46.867669+0000 mgr.a (mgr.14388) 13907 : audit [DBG] from='client.302232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:48 smithi049 bash[23528]: audit 2024-09-21T03:35:46.867669+0000 mgr.a (mgr.14388) 13907 : audit [DBG] from='client.302232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:49 smithi044 bash[22676]: cluster 2024-09-21T03:35:48.010675+0000 mgr.a (mgr.14388) 13908 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:49 smithi179 bash[23186]: cluster 2024-09-21T03:35:48.010675+0000 mgr.a (mgr.14388) 13908 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:49 smithi049 bash[23528]: cluster 2024-09-21T03:35:48.010675+0000 mgr.a (mgr.14388) 13908 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:35:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:51 smithi044 bash[22676]: cluster 2024-09-21T03:35:50.012030+0000 mgr.a (mgr.14388) 13909 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T03:35:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:51 smithi179 bash[23186]: cluster 2024-09-21T03:35:50.012030+0000 mgr.a (mgr.14388) 13909 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T03:35:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:51 smithi049 bash[23528]: cluster 2024-09-21T03:35:50.012030+0000 mgr.a (mgr.14388) 13909 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T03:35:52.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:52.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:52.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:52 smithi049 bash[23528]: audit 2024-09-21T03:35:51.544022+0000 mon.a (mon.0) 11230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:52 smithi049 bash[23528]: audit 2024-09-21T03:35:51.551686+0000 mon.a (mon.0) 11231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:52 smithi049 bash[23528]: audit 2024-09-21T03:35:51.562265+0000 mon.a (mon.0) 11232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:52 smithi049 bash[23528]: audit 2024-09-21T03:35:51.926568+0000 mon.a (mon.0) 11233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:52 smithi049 bash[23528]: audit 2024-09-21T03:35:51.934812+0000 mon.a (mon.0) 11234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:52 smithi049 bash[23528]: audit 2024-09-21T03:35:51.944701+0000 mon.a (mon.0) 11235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:52 smithi049 bash[23528]: cluster 2024-09-21T03:35:52.013762+0000 mgr.a (mgr.14388) 13910 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:52 smithi044 bash[22676]: audit 2024-09-21T03:35:51.544022+0000 mon.a (mon.0) 11230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:52 smithi044 bash[22676]: audit 2024-09-21T03:35:51.551686+0000 mon.a (mon.0) 11231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:52 smithi044 bash[22676]: audit 2024-09-21T03:35:51.562265+0000 mon.a (mon.0) 11232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:52 smithi044 bash[22676]: audit 2024-09-21T03:35:51.926568+0000 mon.a (mon.0) 11233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:52 smithi044 bash[22676]: audit 2024-09-21T03:35:51.934812+0000 mon.a (mon.0) 11234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:52 smithi044 bash[22676]: audit 2024-09-21T03:35:51.944701+0000 mon.a (mon.0) 11235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:52 smithi044 bash[22676]: cluster 2024-09-21T03:35:52.013762+0000 mgr.a (mgr.14388) 13910 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:52 smithi179 bash[23186]: audit 2024-09-21T03:35:51.544022+0000 mon.a (mon.0) 11230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:52 smithi179 bash[23186]: audit 2024-09-21T03:35:51.551686+0000 mon.a (mon.0) 11231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:52 smithi179 bash[23186]: audit 2024-09-21T03:35:51.562265+0000 mon.a (mon.0) 11232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:52 smithi179 bash[23186]: audit 2024-09-21T03:35:51.926568+0000 mon.a (mon.0) 11233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:52 smithi179 bash[23186]: audit 2024-09-21T03:35:51.934812+0000 mon.a (mon.0) 11234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:52 smithi179 bash[23186]: audit 2024-09-21T03:35:51.944701+0000 mon.a (mon.0) 11235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:35:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:52 smithi179 bash[23186]: cluster 2024-09-21T03:35:52.013762+0000 mgr.a (mgr.14388) 13910 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:53.114 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:53.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:53.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:53.114 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:53.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:54.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:53 smithi044 bash[22676]: audit 2024-09-21T03:35:52.666721+0000 mgr.a (mgr.14388) 13911 : audit [DBG] from='client.302310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:54.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:53 smithi179 bash[23186]: audit 2024-09-21T03:35:52.666721+0000 mgr.a (mgr.14388) 13911 : audit [DBG] from='client.302310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:53 smithi049 bash[23528]: audit 2024-09-21T03:35:52.666721+0000 mgr.a (mgr.14388) 13911 : audit [DBG] from='client.302310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:55.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:54 smithi044 bash[22676]: cluster 2024-09-21T03:35:54.014860+0000 mgr.a (mgr.14388) 13912 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:55.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:54 smithi179 bash[23186]: cluster 2024-09-21T03:35:54.014860+0000 mgr.a (mgr.14388) 13912 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:55.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:54 smithi049 bash[23528]: cluster 2024-09-21T03:35:54.014860+0000 mgr.a (mgr.14388) 13912 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:57 smithi044 bash[22676]: cluster 2024-09-21T03:35:56.017108+0000 mgr.a (mgr.14388) 13913 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:35:57.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:57 smithi179 bash[23186]: cluster 2024-09-21T03:35:56.017108+0000 mgr.a (mgr.14388) 13913 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:35:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:57 smithi049 bash[23528]: cluster 2024-09-21T03:35:56.017108+0000 mgr.a (mgr.14388) 13913 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:35:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:35:58.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:35:58.116 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:35:58.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:35:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:35:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:35:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:35:58.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:35:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:35:59 smithi044 bash[22676]: cluster 2024-09-21T03:35:58.017905+0000 mgr.a (mgr.14388) 13914 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:59.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:35:59 smithi179 bash[23186]: cluster 2024-09-21T03:35:58.017905+0000 mgr.a (mgr.14388) 13914 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:35:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:35:59 smithi049 bash[23528]: cluster 2024-09-21T03:35:58.017905+0000 mgr.a (mgr.14388) 13914 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:36:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:00 smithi049 bash[23528]: audit 2024-09-21T03:35:58.447749+0000 mgr.a (mgr.14388) 13915 : audit [DBG] from='client.302388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:00 smithi049 bash[23528]: audit 2024-09-21T03:35:59.897355+0000 mon.a (mon.0) 11236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:00 smithi049 bash[23528]: audit 2024-09-21T03:35:59.907184+0000 mon.a (mon.0) 11237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:00 smithi049 bash[23528]: audit 2024-09-21T03:35:59.917712+0000 mon.a (mon.0) 11238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:00 smithi044 bash[22676]: audit 2024-09-21T03:35:58.447749+0000 mgr.a (mgr.14388) 13915 : audit [DBG] from='client.302388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:00.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:00 smithi044 bash[22676]: audit 2024-09-21T03:35:59.897355+0000 mon.a (mon.0) 11236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:00 smithi044 bash[22676]: audit 2024-09-21T03:35:59.907184+0000 mon.a (mon.0) 11237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:00 smithi044 bash[22676]: audit 2024-09-21T03:35:59.917712+0000 mon.a (mon.0) 11238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:00 smithi179 bash[23186]: audit 2024-09-21T03:35:58.447749+0000 mgr.a (mgr.14388) 13915 : audit [DBG] from='client.302388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:00 smithi179 bash[23186]: audit 2024-09-21T03:35:59.897355+0000 mon.a (mon.0) 11236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:00 smithi179 bash[23186]: audit 2024-09-21T03:35:59.907184+0000 mon.a (mon.0) 11237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:00 smithi179 bash[23186]: audit 2024-09-21T03:35:59.917712+0000 mon.a (mon.0) 11238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:01.398 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:01 smithi044 bash[22676]: cluster 2024-09-21T03:36:00.019519+0000 mgr.a (mgr.14388) 13916 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:36:01.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:01 smithi179 bash[23186]: cluster 2024-09-21T03:36:00.019519+0000 mgr.a (mgr.14388) 13916 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:36:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:01 smithi049 bash[23528]: cluster 2024-09-21T03:36:00.019519+0000 mgr.a (mgr.14388) 13916 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:36:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:03 smithi044 bash[22676]: cluster 2024-09-21T03:36:02.021307+0000 mgr.a (mgr.14388) 13917 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:36:03.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:03 smithi179 bash[23186]: cluster 2024-09-21T03:36:02.021307+0000 mgr.a (mgr.14388) 13917 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:36:03.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:03 smithi049 bash[23528]: cluster 2024-09-21T03:36:02.021307+0000 mgr.a (mgr.14388) 13917 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:36:03.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:03.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:04.664 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:04.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:04.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:04.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:04.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: cluster 2024-09-21T03:36:04.021795+0000 mgr.a (mgr.14388) 13918 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.257581+0000 mgr.a (mgr.14388) 13919 : audit [DBG] from='client.302463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.386712+0000 mon.a (mon.0) 11239 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:36:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.936339+0000 mon.a (mon.0) 11240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.943470+0000 mon.a (mon.0) 11241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.945855+0000 mon.a (mon.0) 11242 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:36:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.947155+0000 mon.a (mon.0) 11243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:36:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.955725+0000 mon.a (mon.0) 11244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22676]: audit 2024-09-21T03:36:04.959023+0000 mon.a (mon.0) 11245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: cluster 2024-09-21T03:36:04.021795+0000 mgr.a (mgr.14388) 13918 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.257581+0000 mgr.a (mgr.14388) 13919 : audit [DBG] from='client.302463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.386712+0000 mon.a (mon.0) 11239 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.936339+0000 mon.a (mon.0) 11240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.943470+0000 mon.a (mon.0) 11241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.945855+0000 mon.a (mon.0) 11242 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.947155+0000 mon.a (mon.0) 11243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:36:05.356 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.955725+0000 mon.a (mon.0) 11244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.357 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:05 smithi179 bash[23186]: audit 2024-09-21T03:36:04.959023+0000 mon.a (mon.0) 11245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:36:05.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: cluster 2024-09-21T03:36:04.021795+0000 mgr.a (mgr.14388) 13918 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.257581+0000 mgr.a (mgr.14388) 13919 : audit [DBG] from='client.302463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.386712+0000 mon.a (mon.0) 11239 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.936339+0000 mon.a (mon.0) 11240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.943470+0000 mon.a (mon.0) 11241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.945855+0000 mon.a (mon.0) 11242 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.947155+0000 mon.a (mon.0) 11243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.955725+0000 mon.a (mon.0) 11244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:05 smithi049 bash[23528]: audit 2024-09-21T03:36:04.959023+0000 mon.a (mon.0) 11245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:36:05.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22930]: debug 2024-09-21T03:36:05.694+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:36:05.987 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:36:05 smithi044 bash[22930]: debug 2024-09-21T03:36:05.698+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:36:06.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:06 smithi044 bash[22676]: audit 2024-09-21T03:36:04.963001+0000 mgr.a (mgr.14388) 13920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:36:06.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:06 smithi179 bash[23186]: audit 2024-09-21T03:36:04.963001+0000 mgr.a (mgr.14388) 13920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:36:06.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:06 smithi049 bash[23528]: audit 2024-09-21T03:36:04.963001+0000 mgr.a (mgr.14388) 13920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:36:07.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:07 smithi049 bash[23528]: audit 2024-09-21T03:36:05.700065+0000 mgr.a (mgr.14388) 13921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:36:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:07 smithi049 bash[23528]: cephadm 2024-09-21T03:36:05.701271+0000 mgr.a (mgr.14388) 13922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:36:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:07 smithi049 bash[23528]: cluster 2024-09-21T03:36:06.023461+0000 mgr.a (mgr.14388) 13923 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-09-21T03:36:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:07 smithi044 bash[22676]: audit 2024-09-21T03:36:05.700065+0000 mgr.a (mgr.14388) 13921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:36:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:07 smithi044 bash[22676]: cephadm 2024-09-21T03:36:05.701271+0000 mgr.a (mgr.14388) 13922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:36:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:07 smithi044 bash[22676]: cluster 2024-09-21T03:36:06.023461+0000 mgr.a (mgr.14388) 13923 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-09-21T03:36:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:07 smithi179 bash[23186]: audit 2024-09-21T03:36:05.700065+0000 mgr.a (mgr.14388) 13921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:36:07.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:07 smithi179 bash[23186]: cephadm 2024-09-21T03:36:05.701271+0000 mgr.a (mgr.14388) 13922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:36:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:07 smithi179 bash[23186]: cluster 2024-09-21T03:36:06.023461+0000 mgr.a (mgr.14388) 13923 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-09-21T03:36:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:09 smithi044 bash[22676]: cluster 2024-09-21T03:36:08.024217+0000 mgr.a (mgr.14388) 13924 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:36:09.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:09 smithi179 bash[23186]: cluster 2024-09-21T03:36:08.024217+0000 mgr.a (mgr.14388) 13924 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:36:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:09 smithi049 bash[23528]: cluster 2024-09-21T03:36:08.024217+0000 mgr.a (mgr.14388) 13924 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:36:09.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:09.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:10.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:11 smithi044 bash[22676]: audit 2024-09-21T03:36:10.003769+0000 mgr.a (mgr.14388) 13925 : audit [DBG] from='client.302643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:11 smithi044 bash[22676]: cluster 2024-09-21T03:36:10.026983+0000 mgr.a (mgr.14388) 13926 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T03:36:11.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:11 smithi179 bash[23186]: audit 2024-09-21T03:36:10.003769+0000 mgr.a (mgr.14388) 13925 : audit [DBG] from='client.302643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:11 smithi179 bash[23186]: cluster 2024-09-21T03:36:10.026983+0000 mgr.a (mgr.14388) 13926 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T03:36:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:11 smithi049 bash[23528]: audit 2024-09-21T03:36:10.003769+0000 mgr.a (mgr.14388) 13925 : audit [DBG] from='client.302643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:11 smithi049 bash[23528]: cluster 2024-09-21T03:36:10.026983+0000 mgr.a (mgr.14388) 13926 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-21T03:36:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:12 smithi049 bash[23528]: audit 2024-09-21T03:36:11.781619+0000 mon.a (mon.0) 11246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:12 smithi049 bash[23528]: audit 2024-09-21T03:36:11.788195+0000 mon.a (mon.0) 11247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:12 smithi049 bash[23528]: audit 2024-09-21T03:36:11.797297+0000 mon.a (mon.0) 11248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:12 smithi049 bash[23528]: cluster 2024-09-21T03:36:12.029334+0000 mgr.a (mgr.14388) 13927 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:12 smithi049 bash[23528]: audit 2024-09-21T03:36:12.152619+0000 mon.a (mon.0) 11249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:12 smithi049 bash[23528]: audit 2024-09-21T03:36:12.161576+0000 mon.a (mon.0) 11250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:12 smithi049 bash[23528]: audit 2024-09-21T03:36:12.171731+0000 mon.a (mon.0) 11251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:12 smithi044 bash[22676]: audit 2024-09-21T03:36:11.781619+0000 mon.a (mon.0) 11246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:12 smithi044 bash[22676]: audit 2024-09-21T03:36:11.788195+0000 mon.a (mon.0) 11247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:12 smithi044 bash[22676]: audit 2024-09-21T03:36:11.797297+0000 mon.a (mon.0) 11248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:12 smithi044 bash[22676]: cluster 2024-09-21T03:36:12.029334+0000 mgr.a (mgr.14388) 13927 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:12 smithi044 bash[22676]: audit 2024-09-21T03:36:12.152619+0000 mon.a (mon.0) 11249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:12 smithi044 bash[22676]: audit 2024-09-21T03:36:12.161576+0000 mon.a (mon.0) 11250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:12 smithi044 bash[22676]: audit 2024-09-21T03:36:12.171731+0000 mon.a (mon.0) 11251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:12 smithi179 bash[23186]: audit 2024-09-21T03:36:11.781619+0000 mon.a (mon.0) 11246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:12 smithi179 bash[23186]: audit 2024-09-21T03:36:11.788195+0000 mon.a (mon.0) 11247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:12 smithi179 bash[23186]: audit 2024-09-21T03:36:11.797297+0000 mon.a (mon.0) 11248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:12 smithi179 bash[23186]: cluster 2024-09-21T03:36:12.029334+0000 mgr.a (mgr.14388) 13927 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:12 smithi179 bash[23186]: audit 2024-09-21T03:36:12.152619+0000 mon.a (mon.0) 11249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:12 smithi179 bash[23186]: audit 2024-09-21T03:36:12.161576+0000 mon.a (mon.0) 11250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:12 smithi179 bash[23186]: audit 2024-09-21T03:36:12.171731+0000 mon.a (mon.0) 11251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:15.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:15.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:15.465 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:15.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:15 smithi044 bash[22676]: cluster 2024-09-21T03:36:14.030138+0000 mgr.a (mgr.14388) 13928 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:15.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:15 smithi179 bash[23186]: cluster 2024-09-21T03:36:14.030138+0000 mgr.a (mgr.14388) 13928 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:15 smithi049 bash[23528]: cluster 2024-09-21T03:36:14.030138+0000 mgr.a (mgr.14388) 13928 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:16.229 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:16.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:16.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:16.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:16.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:17 smithi044 bash[22676]: audit 2024-09-21T03:36:15.792331+0000 mgr.a (mgr.14388) 13929 : audit [DBG] from='client.302718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:17 smithi044 bash[22676]: cluster 2024-09-21T03:36:16.036690+0000 mgr.a (mgr.14388) 13930 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:17.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:17 smithi179 bash[23186]: audit 2024-09-21T03:36:15.792331+0000 mgr.a (mgr.14388) 13929 : audit [DBG] from='client.302718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:17.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:17 smithi179 bash[23186]: cluster 2024-09-21T03:36:16.036690+0000 mgr.a (mgr.14388) 13930 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:17 smithi049 bash[23528]: audit 2024-09-21T03:36:15.792331+0000 mgr.a (mgr.14388) 13929 : audit [DBG] from='client.302718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:17.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:17 smithi049 bash[23528]: cluster 2024-09-21T03:36:16.036690+0000 mgr.a (mgr.14388) 13930 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:19 smithi044 bash[22676]: cluster 2024-09-21T03:36:18.037658+0000 mgr.a (mgr.14388) 13931 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:19.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:19 smithi179 bash[23186]: cluster 2024-09-21T03:36:18.037658+0000 mgr.a (mgr.14388) 13931 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:19 smithi049 bash[23528]: cluster 2024-09-21T03:36:18.037658+0000 mgr.a (mgr.14388) 13931 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:21.231 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:21.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:21.232 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:21 smithi044 bash[22676]: cluster 2024-09-21T03:36:20.039029+0000 mgr.a (mgr.14388) 13932 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:21 smithi044 bash[22676]: audit 2024-09-21T03:36:20.127020+0000 mon.a (mon.0) 11252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:21 smithi044 bash[22676]: audit 2024-09-21T03:36:20.135838+0000 mon.a (mon.0) 11253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:21 smithi044 bash[22676]: audit 2024-09-21T03:36:20.146941+0000 mon.a (mon.0) 11254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:21 smithi179 bash[23186]: cluster 2024-09-21T03:36:20.039029+0000 mgr.a (mgr.14388) 13932 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:21 smithi179 bash[23186]: audit 2024-09-21T03:36:20.127020+0000 mon.a (mon.0) 11252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:21 smithi179 bash[23186]: audit 2024-09-21T03:36:20.135838+0000 mon.a (mon.0) 11253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:21 smithi179 bash[23186]: audit 2024-09-21T03:36:20.146941+0000 mon.a (mon.0) 11254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:21 smithi049 bash[23528]: cluster 2024-09-21T03:36:20.039029+0000 mgr.a (mgr.14388) 13932 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T03:36:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:21 smithi049 bash[23528]: audit 2024-09-21T03:36:20.127020+0000 mon.a (mon.0) 11252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:21 smithi049 bash[23528]: audit 2024-09-21T03:36:20.135838+0000 mon.a (mon.0) 11253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:21.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:21 smithi049 bash[23528]: audit 2024-09-21T03:36:20.146941+0000 mon.a (mon.0) 11254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:22.027 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:22.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:23.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:23 smithi044 bash[22676]: audit 2024-09-21T03:36:21.568018+0000 mgr.a (mgr.14388) 13933 : audit [DBG] from='client.302793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:23.538 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:23 smithi044 bash[22676]: cluster 2024-09-21T03:36:22.040150+0000 mgr.a (mgr.14388) 13934 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 426 B/s wr, 48 op/s 2024-09-21T03:36:23.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:23 smithi179 bash[23186]: audit 2024-09-21T03:36:21.568018+0000 mgr.a (mgr.14388) 13933 : audit [DBG] from='client.302793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:23.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:23 smithi179 bash[23186]: cluster 2024-09-21T03:36:22.040150+0000 mgr.a (mgr.14388) 13934 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 426 B/s wr, 48 op/s 2024-09-21T03:36:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:23 smithi049 bash[23528]: audit 2024-09-21T03:36:21.568018+0000 mgr.a (mgr.14388) 13933 : audit [DBG] from='client.302793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:23 smithi049 bash[23528]: cluster 2024-09-21T03:36:22.040150+0000 mgr.a (mgr.14388) 13934 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 426 B/s wr, 48 op/s 2024-09-21T03:36:25.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:25 smithi044 bash[22676]: cluster 2024-09-21T03:36:24.040864+0000 mgr.a (mgr.14388) 13935 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:25 smithi179 bash[23186]: cluster 2024-09-21T03:36:24.040864+0000 mgr.a (mgr.14388) 13935 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:25.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:25 smithi049 bash[23528]: cluster 2024-09-21T03:36:24.040864+0000 mgr.a (mgr.14388) 13935 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:27.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:27.423 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:27 smithi179 bash[23186]: cluster 2024-09-21T03:36:26.042940+0000 mgr.a (mgr.14388) 13936 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:36:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:27 smithi044 bash[22676]: cluster 2024-09-21T03:36:26.042940+0000 mgr.a (mgr.14388) 13936 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:36:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:27 smithi049 bash[23528]: cluster 2024-09-21T03:36:26.042940+0000 mgr.a (mgr.14388) 13936 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:36:27.792 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:27.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:27.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:27.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:27.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:28.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:28 smithi044 bash[22676]: audit 2024-09-21T03:36:27.363096+0000 mgr.a (mgr.14388) 13937 : audit [DBG] from='client.302871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:28 smithi179 bash[23186]: audit 2024-09-21T03:36:27.363096+0000 mgr.a (mgr.14388) 13937 : audit [DBG] from='client.302871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:28 smithi049 bash[23528]: audit 2024-09-21T03:36:27.363096+0000 mgr.a (mgr.14388) 13937 : audit [DBG] from='client.302871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:29 smithi044 bash[22676]: cluster 2024-09-21T03:36:28.043893+0000 mgr.a (mgr.14388) 13938 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:29 smithi179 bash[23186]: cluster 2024-09-21T03:36:28.043893+0000 mgr.a (mgr.14388) 13938 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:29 smithi049 bash[23528]: cluster 2024-09-21T03:36:28.043893+0000 mgr.a (mgr.14388) 13938 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:30.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:30 smithi044 bash[22676]: cluster 2024-09-21T03:36:30.045320+0000 mgr.a (mgr.14388) 13939 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:36:31.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:30 smithi179 bash[23186]: cluster 2024-09-21T03:36:30.045320+0000 mgr.a (mgr.14388) 13939 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:36:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:30 smithi049 bash[23528]: cluster 2024-09-21T03:36:30.045320+0000 mgr.a (mgr.14388) 13939 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:36:32.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:32.794 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:32 smithi044 bash[22676]: audit 2024-09-21T03:36:31.963511+0000 mon.a (mon.0) 11255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:32 smithi044 bash[22676]: audit 2024-09-21T03:36:31.969218+0000 mon.a (mon.0) 11256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:32 smithi044 bash[22676]: audit 2024-09-21T03:36:31.975287+0000 mon.a (mon.0) 11257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:32 smithi044 bash[22676]: cluster 2024-09-21T03:36:32.046948+0000 mgr.a (mgr.14388) 13940 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:36:33.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:32 smithi044 bash[22676]: audit 2024-09-21T03:36:32.377029+0000 mon.a (mon.0) 11258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:32 smithi044 bash[22676]: audit 2024-09-21T03:36:32.385518+0000 mon.a (mon.0) 11259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:32 smithi044 bash[22676]: audit 2024-09-21T03:36:32.395686+0000 mon.a (mon.0) 11260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:32 smithi179 bash[23186]: audit 2024-09-21T03:36:31.963511+0000 mon.a (mon.0) 11255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:32 smithi179 bash[23186]: audit 2024-09-21T03:36:31.969218+0000 mon.a (mon.0) 11256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:32 smithi179 bash[23186]: audit 2024-09-21T03:36:31.975287+0000 mon.a (mon.0) 11257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:32 smithi179 bash[23186]: cluster 2024-09-21T03:36:32.046948+0000 mgr.a (mgr.14388) 13940 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:32 smithi179 bash[23186]: audit 2024-09-21T03:36:32.377029+0000 mon.a (mon.0) 11258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:32 smithi179 bash[23186]: audit 2024-09-21T03:36:32.385518+0000 mon.a (mon.0) 11259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:32 smithi179 bash[23186]: audit 2024-09-21T03:36:32.395686+0000 mon.a (mon.0) 11260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:32 smithi049 bash[23528]: audit 2024-09-21T03:36:31.963511+0000 mon.a (mon.0) 11255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:32 smithi049 bash[23528]: audit 2024-09-21T03:36:31.969218+0000 mon.a (mon.0) 11256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:32 smithi049 bash[23528]: audit 2024-09-21T03:36:31.975287+0000 mon.a (mon.0) 11257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:32 smithi049 bash[23528]: cluster 2024-09-21T03:36:32.046948+0000 mgr.a (mgr.14388) 13940 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:36:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:32 smithi049 bash[23528]: audit 2024-09-21T03:36:32.377029+0000 mon.a (mon.0) 11258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:32 smithi049 bash[23528]: audit 2024-09-21T03:36:32.385518+0000 mon.a (mon.0) 11259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:32 smithi049 bash[23528]: audit 2024-09-21T03:36:32.395686+0000 mon.a (mon.0) 11260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:33.581 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:33.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:33.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:33.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:33.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:34.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:33 smithi044 bash[22676]: audit 2024-09-21T03:36:33.138273+0000 mgr.a (mgr.14388) 13941 : audit [DBG] from='client.302949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:34.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:33 smithi179 bash[23186]: audit 2024-09-21T03:36:33.138273+0000 mgr.a (mgr.14388) 13941 : audit [DBG] from='client.302949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:33 smithi049 bash[23528]: audit 2024-09-21T03:36:33.138273+0000 mgr.a (mgr.14388) 13941 : audit [DBG] from='client.302949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:35.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:34 smithi179 bash[23186]: cluster 2024-09-21T03:36:34.047983+0000 mgr.a (mgr.14388) 13942 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:35.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:34 smithi049 bash[23528]: cluster 2024-09-21T03:36:34.047983+0000 mgr.a (mgr.14388) 13942 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:34 smithi044 bash[22676]: cluster 2024-09-21T03:36:34.047983+0000 mgr.a (mgr.14388) 13942 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:37 smithi044 bash[22676]: cluster 2024-09-21T03:36:36.050190+0000 mgr.a (mgr.14388) 13943 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:36:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:37 smithi179 bash[23186]: cluster 2024-09-21T03:36:36.050190+0000 mgr.a (mgr.14388) 13943 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:36:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:37 smithi049 bash[23528]: cluster 2024-09-21T03:36:36.050190+0000 mgr.a (mgr.14388) 13943 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:36:38.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:38.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:38.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:39.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:39.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:39.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:39.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:39.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:39 smithi044 bash[22676]: cluster 2024-09-21T03:36:38.050974+0000 mgr.a (mgr.14388) 13944 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:39 smithi179 bash[23186]: cluster 2024-09-21T03:36:38.050974+0000 mgr.a (mgr.14388) 13944 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:39 smithi049 bash[23528]: cluster 2024-09-21T03:36:38.050974+0000 mgr.a (mgr.14388) 13944 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:40.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:40 smithi044 bash[22676]: audit 2024-09-21T03:36:38.920329+0000 mgr.a (mgr.14388) 13945 : audit [DBG] from='client.303027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:40.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:40 smithi179 bash[23186]: audit 2024-09-21T03:36:38.920329+0000 mgr.a (mgr.14388) 13945 : audit [DBG] from='client.303027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:40 smithi049 bash[23528]: audit 2024-09-21T03:36:38.920329+0000 mgr.a (mgr.14388) 13945 : audit [DBG] from='client.303027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:41 smithi044 bash[22676]: cluster 2024-09-21T03:36:40.051950+0000 mgr.a (mgr.14388) 13946 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:36:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:41 smithi044 bash[22676]: audit 2024-09-21T03:36:40.306342+0000 mon.a (mon.0) 11261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:41 smithi044 bash[22676]: audit 2024-09-21T03:36:40.314958+0000 mon.a (mon.0) 11262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:41 smithi044 bash[22676]: audit 2024-09-21T03:36:40.327033+0000 mon.a (mon.0) 11263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:41 smithi179 bash[23186]: cluster 2024-09-21T03:36:40.051950+0000 mgr.a (mgr.14388) 13946 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:36:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:41 smithi179 bash[23186]: audit 2024-09-21T03:36:40.306342+0000 mon.a (mon.0) 11261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:41 smithi179 bash[23186]: audit 2024-09-21T03:36:40.314958+0000 mon.a (mon.0) 11262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:41 smithi179 bash[23186]: audit 2024-09-21T03:36:40.327033+0000 mon.a (mon.0) 11263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:41 smithi049 bash[23528]: cluster 2024-09-21T03:36:40.051950+0000 mgr.a (mgr.14388) 13946 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:36:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:41 smithi049 bash[23528]: audit 2024-09-21T03:36:40.306342+0000 mon.a (mon.0) 11261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:41 smithi049 bash[23528]: audit 2024-09-21T03:36:40.314958+0000 mon.a (mon.0) 11262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:41 smithi049 bash[23528]: audit 2024-09-21T03:36:40.327033+0000 mon.a (mon.0) 11263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:43 smithi044 bash[22676]: cluster 2024-09-21T03:36:42.053505+0000 mgr.a (mgr.14388) 13947 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:36:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:43 smithi179 bash[23186]: cluster 2024-09-21T03:36:42.053505+0000 mgr.a (mgr.14388) 13947 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:36:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:43 smithi049 bash[23528]: cluster 2024-09-21T03:36:42.053505+0000 mgr.a (mgr.14388) 13947 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:36:44.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:44.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:44.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:45.136 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:45.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:45.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:45.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:45.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:45 smithi044 bash[22676]: cluster 2024-09-21T03:36:44.054275+0000 mgr.a (mgr.14388) 13948 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:45.592 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:45 smithi049 bash[23528]: cluster 2024-09-21T03:36:44.054275+0000 mgr.a (mgr.14388) 13948 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:45 smithi179 bash[23186]: cluster 2024-09-21T03:36:44.054275+0000 mgr.a (mgr.14388) 13948 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:46.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:46 smithi179 bash[23186]: audit 2024-09-21T03:36:44.704112+0000 mgr.a (mgr.14388) 13949 : audit [DBG] from='client.303105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:46.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:46 smithi044 bash[22676]: audit 2024-09-21T03:36:44.704112+0000 mgr.a (mgr.14388) 13949 : audit [DBG] from='client.303105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:46.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:46 smithi049 bash[23528]: audit 2024-09-21T03:36:44.704112+0000 mgr.a (mgr.14388) 13949 : audit [DBG] from='client.303105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:47 smithi044 bash[22676]: cluster 2024-09-21T03:36:46.056743+0000 mgr.a (mgr.14388) 13950 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:36:47.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:47 smithi179 bash[23186]: cluster 2024-09-21T03:36:46.056743+0000 mgr.a (mgr.14388) 13950 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:36:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:47 smithi049 bash[23528]: cluster 2024-09-21T03:36:46.056743+0000 mgr.a (mgr.14388) 13950 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:36:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:49 smithi044 bash[22676]: cluster 2024-09-21T03:36:48.057657+0000 mgr.a (mgr.14388) 13951 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:36:49.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:49 smithi179 bash[23186]: cluster 2024-09-21T03:36:48.057657+0000 mgr.a (mgr.14388) 13951 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:36:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:49 smithi049 bash[23528]: cluster 2024-09-21T03:36:48.057657+0000 mgr.a (mgr.14388) 13951 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:36:50.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:50.916 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:50.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:51 smithi044 bash[22676]: cluster 2024-09-21T03:36:50.058967+0000 mgr.a (mgr.14388) 13952 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:51.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:51 smithi179 bash[23186]: cluster 2024-09-21T03:36:50.058967+0000 mgr.a (mgr.14388) 13952 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:51 smithi049 bash[23528]: cluster 2024-09-21T03:36:50.058967+0000 mgr.a (mgr.14388) 13952 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:52 smithi044 bash[22676]: audit 2024-09-21T03:36:50.472213+0000 mgr.a (mgr.14388) 13953 : audit [DBG] from='client.303183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:52.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:52 smithi044 bash[22676]: audit 2024-09-21T03:36:52.180567+0000 mon.a (mon.0) 11264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:52 smithi044 bash[22676]: audit 2024-09-21T03:36:52.188674+0000 mon.a (mon.0) 11265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:52 smithi044 bash[22676]: audit 2024-09-21T03:36:52.198532+0000 mon.a (mon.0) 11266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.619 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:52 smithi179 bash[23186]: audit 2024-09-21T03:36:50.472213+0000 mgr.a (mgr.14388) 13953 : audit [DBG] from='client.303183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:52.619 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:52 smithi179 bash[23186]: audit 2024-09-21T03:36:52.180567+0000 mon.a (mon.0) 11264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.619 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:52 smithi179 bash[23186]: audit 2024-09-21T03:36:52.188674+0000 mon.a (mon.0) 11265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.619 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:52 smithi179 bash[23186]: audit 2024-09-21T03:36:52.198532+0000 mon.a (mon.0) 11266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:52 smithi049 bash[23528]: audit 2024-09-21T03:36:50.472213+0000 mgr.a (mgr.14388) 13953 : audit [DBG] from='client.303183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:52 smithi049 bash[23528]: audit 2024-09-21T03:36:52.180567+0000 mon.a (mon.0) 11264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:52 smithi049 bash[23528]: audit 2024-09-21T03:36:52.188674+0000 mon.a (mon.0) 11265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:52 smithi049 bash[23528]: audit 2024-09-21T03:36:52.198532+0000 mon.a (mon.0) 11266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:53 smithi044 bash[22676]: cluster 2024-09-21T03:36:52.061367+0000 mgr.a (mgr.14388) 13954 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:36:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:53 smithi044 bash[22676]: audit 2024-09-21T03:36:52.598647+0000 mon.a (mon.0) 11267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:53 smithi044 bash[22676]: audit 2024-09-21T03:36:52.606932+0000 mon.a (mon.0) 11268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:53 smithi044 bash[22676]: audit 2024-09-21T03:36:52.616837+0000 mon.a (mon.0) 11269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:53 smithi179 bash[23186]: cluster 2024-09-21T03:36:52.061367+0000 mgr.a (mgr.14388) 13954 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:36:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:53 smithi179 bash[23186]: audit 2024-09-21T03:36:52.598647+0000 mon.a (mon.0) 11267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:53 smithi179 bash[23186]: audit 2024-09-21T03:36:52.606932+0000 mon.a (mon.0) 11268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:53 smithi179 bash[23186]: audit 2024-09-21T03:36:52.616837+0000 mon.a (mon.0) 11269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:53 smithi049 bash[23528]: cluster 2024-09-21T03:36:52.061367+0000 mgr.a (mgr.14388) 13954 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:36:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:53 smithi049 bash[23528]: audit 2024-09-21T03:36:52.598647+0000 mon.a (mon.0) 11267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:53 smithi049 bash[23528]: audit 2024-09-21T03:36:52.606932+0000 mon.a (mon.0) 11268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:53 smithi049 bash[23528]: audit 2024-09-21T03:36:52.616837+0000 mon.a (mon.0) 11269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:36:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:55 smithi044 bash[22676]: cluster 2024-09-21T03:36:54.062169+0000 mgr.a (mgr.14388) 13955 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:36:55.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:55 smithi179 bash[23186]: cluster 2024-09-21T03:36:54.062169+0000 mgr.a (mgr.14388) 13955 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:36:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:55 smithi049 bash[23528]: cluster 2024-09-21T03:36:54.062169+0000 mgr.a (mgr.14388) 13955 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:36:55.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:36:55.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:36:55.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:36:56.705 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:36:56.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:36:56.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:36:56.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:36:56.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:36:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:57 smithi044 bash[22676]: cluster 2024-09-21T03:36:56.063214+0000 mgr.a (mgr.14388) 13956 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:57 smithi044 bash[22676]: audit 2024-09-21T03:36:56.257620+0000 mgr.a (mgr.14388) 13957 : audit [DBG] from='client.303258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:57 smithi179 bash[23186]: cluster 2024-09-21T03:36:56.063214+0000 mgr.a (mgr.14388) 13956 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:57 smithi179 bash[23186]: audit 2024-09-21T03:36:56.257620+0000 mgr.a (mgr.14388) 13957 : audit [DBG] from='client.303258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:57 smithi049 bash[23528]: cluster 2024-09-21T03:36:56.063214+0000 mgr.a (mgr.14388) 13956 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:36:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:57 smithi049 bash[23528]: audit 2024-09-21T03:36:56.257620+0000 mgr.a (mgr.14388) 13957 : audit [DBG] from='client.303258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:36:59 smithi044 bash[22676]: cluster 2024-09-21T03:36:58.064113+0000 mgr.a (mgr.14388) 13958 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:36:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:36:59 smithi179 bash[23186]: cluster 2024-09-21T03:36:58.064113+0000 mgr.a (mgr.14388) 13958 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:36:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:36:59 smithi049 bash[23528]: cluster 2024-09-21T03:36:58.064113+0000 mgr.a (mgr.14388) 13958 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:37:01.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:01.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:01.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:01 smithi044 bash[22676]: cluster 2024-09-21T03:37:00.065508+0000 mgr.a (mgr.14388) 13959 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:01 smithi044 bash[22676]: audit 2024-09-21T03:37:00.499211+0000 mon.a (mon.0) 11270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:01 smithi044 bash[22676]: audit 2024-09-21T03:37:00.508355+0000 mon.a (mon.0) 11271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:01 smithi044 bash[22676]: audit 2024-09-21T03:37:00.518737+0000 mon.a (mon.0) 11272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:01 smithi179 bash[23186]: cluster 2024-09-21T03:37:00.065508+0000 mgr.a (mgr.14388) 13959 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:01 smithi179 bash[23186]: audit 2024-09-21T03:37:00.499211+0000 mon.a (mon.0) 11270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:01 smithi179 bash[23186]: audit 2024-09-21T03:37:00.508355+0000 mon.a (mon.0) 11271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:01 smithi179 bash[23186]: audit 2024-09-21T03:37:00.518737+0000 mon.a (mon.0) 11272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:01 smithi049 bash[23528]: cluster 2024-09-21T03:37:00.065508+0000 mgr.a (mgr.14388) 13959 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:01 smithi049 bash[23528]: audit 2024-09-21T03:37:00.499211+0000 mon.a (mon.0) 11270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:01 smithi049 bash[23528]: audit 2024-09-21T03:37:00.508355+0000 mon.a (mon.0) 11271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:01.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:01 smithi049 bash[23528]: audit 2024-09-21T03:37:00.518737+0000 mon.a (mon.0) 11272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:02.474 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:02.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:02.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:02.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:02.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:03 smithi044 bash[22676]: audit 2024-09-21T03:37:02.035473+0000 mgr.a (mgr.14388) 13960 : audit [DBG] from='client.303333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:03.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:03 smithi044 bash[22676]: cluster 2024-09-21T03:37:02.067024+0000 mgr.a (mgr.14388) 13961 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:03 smithi179 bash[23186]: audit 2024-09-21T03:37:02.035473+0000 mgr.a (mgr.14388) 13960 : audit [DBG] from='client.303333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:03 smithi179 bash[23186]: cluster 2024-09-21T03:37:02.067024+0000 mgr.a (mgr.14388) 13961 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:03 smithi049 bash[23528]: audit 2024-09-21T03:37:02.035473+0000 mgr.a (mgr.14388) 13960 : audit [DBG] from='client.303333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:03 smithi049 bash[23528]: cluster 2024-09-21T03:37:02.067024+0000 mgr.a (mgr.14388) 13961 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:05 smithi044 bash[22676]: cluster 2024-09-21T03:37:04.067714+0000 mgr.a (mgr.14388) 13962 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:05 smithi179 bash[23186]: cluster 2024-09-21T03:37:04.067714+0000 mgr.a (mgr.14388) 13962 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:05 smithi049 bash[23528]: cluster 2024-09-21T03:37:04.067714+0000 mgr.a (mgr.14388) 13962 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:06.484 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:06 smithi049 bash[23528]: audit 2024-09-21T03:37:05.756108+0000 mon.a (mon.0) 11273 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:37:06.484 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:06 smithi049 bash[23528]: audit 2024-09-21T03:37:05.763612+0000 mon.a (mon.0) 11274 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:37:06.485 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:06 smithi049 bash[23528]: audit 2024-09-21T03:37:05.765642+0000 mon.a (mon.0) 11275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:37:06.485 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:06 smithi049 bash[23528]: audit 2024-09-21T03:37:05.778708+0000 mon.a (mon.0) 11276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:06.485 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:06 smithi049 bash[23528]: audit 2024-09-21T03:37:05.785708+0000 mon.a (mon.0) 11277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:37:06.610 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:06 smithi179 bash[23186]: audit 2024-09-21T03:37:05.756108+0000 mon.a (mon.0) 11273 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:37:06.610 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:06 smithi179 bash[23186]: audit 2024-09-21T03:37:05.763612+0000 mon.a (mon.0) 11274 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:37:06.610 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:06 smithi179 bash[23186]: audit 2024-09-21T03:37:05.765642+0000 mon.a (mon.0) 11275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:37:06.610 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:06 smithi179 bash[23186]: audit 2024-09-21T03:37:05.778708+0000 mon.a (mon.0) 11276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:06.611 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:06 smithi179 bash[23186]: audit 2024-09-21T03:37:05.785708+0000 mon.a (mon.0) 11277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:37:06.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:37:06 smithi044 bash[22930]: debug 2024-09-21T03:37:06.545+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:37:06.737 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:37:06 smithi044 bash[22930]: debug 2024-09-21T03:37:06.545+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:37:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:06 smithi044 bash[22676]: audit 2024-09-21T03:37:05.756108+0000 mon.a (mon.0) 11273 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:37:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:06 smithi044 bash[22676]: audit 2024-09-21T03:37:05.763612+0000 mon.a (mon.0) 11274 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:37:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:06 smithi044 bash[22676]: audit 2024-09-21T03:37:05.765642+0000 mon.a (mon.0) 11275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:37:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:06 smithi044 bash[22676]: audit 2024-09-21T03:37:05.778708+0000 mon.a (mon.0) 11276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:06 smithi044 bash[22676]: audit 2024-09-21T03:37:05.785708+0000 mon.a (mon.0) 11277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:37:07.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:07.476 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:07.476 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:07 smithi179 bash[23186]: audit 2024-09-21T03:37:05.788158+0000 mgr.a (mgr.14388) 13963 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:37:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:07 smithi179 bash[23186]: cluster 2024-09-21T03:37:06.070352+0000 mgr.a (mgr.14388) 13964 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:07 smithi049 bash[23528]: audit 2024-09-21T03:37:05.788158+0000 mgr.a (mgr.14388) 13963 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:37:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:07 smithi049 bash[23528]: cluster 2024-09-21T03:37:06.070352+0000 mgr.a (mgr.14388) 13964 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:07.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:07 smithi044 bash[22676]: audit 2024-09-21T03:37:05.788158+0000 mgr.a (mgr.14388) 13963 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:37:07.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:07 smithi044 bash[22676]: cluster 2024-09-21T03:37:06.070352+0000 mgr.a (mgr.14388) 13964 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:08.262 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:08.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:08.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:08.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:08.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:08 smithi044 bash[22676]: audit 2024-09-21T03:37:06.547169+0000 mgr.a (mgr.14388) 13965 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:37:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:08 smithi044 bash[22676]: cephadm 2024-09-21T03:37:06.548574+0000 mgr.a (mgr.14388) 13966 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:37:08.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:08 smithi179 bash[23186]: audit 2024-09-21T03:37:06.547169+0000 mgr.a (mgr.14388) 13965 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:37:08.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:08 smithi179 bash[23186]: cephadm 2024-09-21T03:37:06.548574+0000 mgr.a (mgr.14388) 13966 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:37:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:08 smithi049 bash[23528]: audit 2024-09-21T03:37:06.547169+0000 mgr.a (mgr.14388) 13965 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:37:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:08 smithi049 bash[23528]: cephadm 2024-09-21T03:37:06.548574+0000 mgr.a (mgr.14388) 13966 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:37:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:09 smithi044 bash[22676]: audit 2024-09-21T03:37:07.803128+0000 mgr.a (mgr.14388) 13967 : audit [DBG] from='client.303516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:09 smithi044 bash[22676]: cluster 2024-09-21T03:37:08.070970+0000 mgr.a (mgr.14388) 13968 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:09.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:09 smithi179 bash[23186]: audit 2024-09-21T03:37:07.803128+0000 mgr.a (mgr.14388) 13967 : audit [DBG] from='client.303516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:09.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:09 smithi179 bash[23186]: cluster 2024-09-21T03:37:08.070970+0000 mgr.a (mgr.14388) 13968 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:09 smithi049 bash[23528]: audit 2024-09-21T03:37:07.803128+0000 mgr.a (mgr.14388) 13967 : audit [DBG] from='client.303516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:09 smithi049 bash[23528]: cluster 2024-09-21T03:37:08.070970+0000 mgr.a (mgr.14388) 13968 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:11 smithi044 bash[22676]: cluster 2024-09-21T03:37:10.072363+0000 mgr.a (mgr.14388) 13969 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:37:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:11 smithi179 bash[23186]: cluster 2024-09-21T03:37:10.072363+0000 mgr.a (mgr.14388) 13969 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:37:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:11 smithi049 bash[23528]: cluster 2024-09-21T03:37:10.072363+0000 mgr.a (mgr.14388) 13969 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:37:13.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:13.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:13 smithi044 bash[22676]: cluster 2024-09-21T03:37:12.074148+0000 mgr.a (mgr.14388) 13970 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:13 smithi044 bash[22676]: audit 2024-09-21T03:37:12.414007+0000 mon.a (mon.0) 11278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:13 smithi044 bash[22676]: audit 2024-09-21T03:37:12.422057+0000 mon.a (mon.0) 11279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:13 smithi044 bash[22676]: audit 2024-09-21T03:37:12.432843+0000 mon.a (mon.0) 11280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:13 smithi044 bash[22676]: audit 2024-09-21T03:37:12.824828+0000 mon.a (mon.0) 11281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:13 smithi044 bash[22676]: audit 2024-09-21T03:37:12.833404+0000 mon.a (mon.0) 11282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:13 smithi044 bash[22676]: audit 2024-09-21T03:37:12.843797+0000 mon.a (mon.0) 11283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:13 smithi179 bash[23186]: cluster 2024-09-21T03:37:12.074148+0000 mgr.a (mgr.14388) 13970 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:13 smithi179 bash[23186]: audit 2024-09-21T03:37:12.414007+0000 mon.a (mon.0) 11278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:13 smithi179 bash[23186]: audit 2024-09-21T03:37:12.422057+0000 mon.a (mon.0) 11279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:13 smithi179 bash[23186]: audit 2024-09-21T03:37:12.432843+0000 mon.a (mon.0) 11280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:13 smithi179 bash[23186]: audit 2024-09-21T03:37:12.824828+0000 mon.a (mon.0) 11281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:13 smithi179 bash[23186]: audit 2024-09-21T03:37:12.833404+0000 mon.a (mon.0) 11282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:13 smithi179 bash[23186]: audit 2024-09-21T03:37:12.843797+0000 mon.a (mon.0) 11283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:13 smithi049 bash[23528]: cluster 2024-09-21T03:37:12.074148+0000 mgr.a (mgr.14388) 13970 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:13 smithi049 bash[23528]: audit 2024-09-21T03:37:12.414007+0000 mon.a (mon.0) 11278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:13 smithi049 bash[23528]: audit 2024-09-21T03:37:12.422057+0000 mon.a (mon.0) 11279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:13 smithi049 bash[23528]: audit 2024-09-21T03:37:12.432843+0000 mon.a (mon.0) 11280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:13 smithi049 bash[23528]: audit 2024-09-21T03:37:12.824828+0000 mon.a (mon.0) 11281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:13 smithi049 bash[23528]: audit 2024-09-21T03:37:12.833404+0000 mon.a (mon.0) 11282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:13 smithi049 bash[23528]: audit 2024-09-21T03:37:12.843797+0000 mon.a (mon.0) 11283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:14.057 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:14.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:15 smithi044 bash[22676]: audit 2024-09-21T03:37:13.605547+0000 mgr.a (mgr.14388) 13971 : audit [DBG] from='client.303591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:15 smithi044 bash[22676]: cluster 2024-09-21T03:37:14.074690+0000 mgr.a (mgr.14388) 13972 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:15 smithi179 bash[23186]: audit 2024-09-21T03:37:13.605547+0000 mgr.a (mgr.14388) 13971 : audit [DBG] from='client.303591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:15 smithi179 bash[23186]: cluster 2024-09-21T03:37:14.074690+0000 mgr.a (mgr.14388) 13972 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:15 smithi049 bash[23528]: audit 2024-09-21T03:37:13.605547+0000 mgr.a (mgr.14388) 13971 : audit [DBG] from='client.303591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:15 smithi049 bash[23528]: cluster 2024-09-21T03:37:14.074690+0000 mgr.a (mgr.14388) 13972 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:17 smithi044 bash[22676]: cluster 2024-09-21T03:37:16.076902+0000 mgr.a (mgr.14388) 13973 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:17.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:17 smithi179 bash[23186]: cluster 2024-09-21T03:37:16.076902+0000 mgr.a (mgr.14388) 13973 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:17 smithi049 bash[23528]: cluster 2024-09-21T03:37:16.076902+0000 mgr.a (mgr.14388) 13973 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:18 smithi044 bash[22676]: cluster 2024-09-21T03:37:18.077699+0000 mgr.a (mgr.14388) 13974 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:18 smithi179 bash[23186]: cluster 2024-09-21T03:37:18.077699+0000 mgr.a (mgr.14388) 13974 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:18 smithi049 bash[23528]: cluster 2024-09-21T03:37:18.077699+0000 mgr.a (mgr.14388) 13974 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:19.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:19 smithi044 bash[22676]: audit 2024-09-21T03:37:19.395058+0000 mgr.a (mgr.14388) 13975 : audit [DBG] from='client.303666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:19 smithi179 bash[23186]: audit 2024-09-21T03:37:19.395058+0000 mgr.a (mgr.14388) 13975 : audit [DBG] from='client.303666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:19 smithi049 bash[23528]: audit 2024-09-21T03:37:19.395058+0000 mgr.a (mgr.14388) 13975 : audit [DBG] from='client.303666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:19.832 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:20 smithi044 bash[22676]: cluster 2024-09-21T03:37:20.079141+0000 mgr.a (mgr.14388) 13976 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:20 smithi179 bash[23186]: cluster 2024-09-21T03:37:20.079141+0000 mgr.a (mgr.14388) 13976 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:20.761 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:20 smithi049 bash[23528]: cluster 2024-09-21T03:37:20.079141+0000 mgr.a (mgr.14388) 13976 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:37:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:21 smithi044 bash[22676]: audit 2024-09-21T03:37:20.737825+0000 mon.a (mon.0) 11284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:21 smithi044 bash[22676]: audit 2024-09-21T03:37:20.746465+0000 mon.a (mon.0) 11285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:21.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:21 smithi044 bash[22676]: audit 2024-09-21T03:37:20.757155+0000 mon.a (mon.0) 11286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:22.003 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:21 smithi179 bash[23186]: audit 2024-09-21T03:37:20.737825+0000 mon.a (mon.0) 11284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:22.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:21 smithi179 bash[23186]: audit 2024-09-21T03:37:20.746465+0000 mon.a (mon.0) 11285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:22.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:21 smithi179 bash[23186]: audit 2024-09-21T03:37:20.757155+0000 mon.a (mon.0) 11286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:21 smithi049 bash[23528]: audit 2024-09-21T03:37:20.737825+0000 mon.a (mon.0) 11284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:22.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:21 smithi049 bash[23528]: audit 2024-09-21T03:37:20.746465+0000 mon.a (mon.0) 11285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:21 smithi049 bash[23528]: audit 2024-09-21T03:37:20.757155+0000 mon.a (mon.0) 11286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:22 smithi179 bash[23186]: cluster 2024-09-21T03:37:22.080864+0000 mgr.a (mgr.14388) 13977 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:37:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:22 smithi049 bash[23528]: cluster 2024-09-21T03:37:22.080864+0000 mgr.a (mgr.14388) 13977 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:37:23.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:22 smithi044 bash[22676]: cluster 2024-09-21T03:37:22.080864+0000 mgr.a (mgr.14388) 13977 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:37:24.833 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:24.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:25.401 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:25 smithi044 bash[22676]: cluster 2024-09-21T03:37:24.081724+0000 mgr.a (mgr.14388) 13978 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:25 smithi179 bash[23186]: cluster 2024-09-21T03:37:24.081724+0000 mgr.a (mgr.14388) 13978 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:25 smithi049 bash[23528]: cluster 2024-09-21T03:37:24.081724+0000 mgr.a (mgr.14388) 13978 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:25.590 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:25.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:26 smithi044 bash[22676]: audit 2024-09-21T03:37:25.171119+0000 mgr.a (mgr.14388) 13979 : audit [DBG] from='client.303741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:26 smithi179 bash[23186]: audit 2024-09-21T03:37:25.171119+0000 mgr.a (mgr.14388) 13979 : audit [DBG] from='client.303741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:26 smithi049 bash[23528]: audit 2024-09-21T03:37:25.171119+0000 mgr.a (mgr.14388) 13979 : audit [DBG] from='client.303741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:27.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:27 smithi049 bash[23528]: cluster 2024-09-21T03:37:26.084674+0000 mgr.a (mgr.14388) 13980 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:27 smithi044 bash[22676]: cluster 2024-09-21T03:37:26.084674+0000 mgr.a (mgr.14388) 13980 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:27.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:27 smithi179 bash[23186]: cluster 2024-09-21T03:37:26.084674+0000 mgr.a (mgr.14388) 13980 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:29 smithi179 bash[23186]: cluster 2024-09-21T03:37:28.085524+0000 mgr.a (mgr.14388) 13981 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:37:29.421 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:29 smithi049 bash[23528]: cluster 2024-09-21T03:37:28.085524+0000 mgr.a (mgr.14388) 13981 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:37:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:29 smithi044 bash[22676]: cluster 2024-09-21T03:37:28.085524+0000 mgr.a (mgr.14388) 13981 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:37:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:31.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:31 smithi044 bash[22676]: cluster 2024-09-21T03:37:30.086870+0000 mgr.a (mgr.14388) 13982 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:37:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:31 smithi179 bash[23186]: cluster 2024-09-21T03:37:30.086870+0000 mgr.a (mgr.14388) 13982 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:37:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:31 smithi049 bash[23528]: cluster 2024-09-21T03:37:30.086870+0000 mgr.a (mgr.14388) 13982 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:37:32.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:32 smithi044 bash[22676]: audit 2024-09-21T03:37:30.921016+0000 mgr.a (mgr.14388) 13983 : audit [DBG] from='client.303816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:32.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:32 smithi179 bash[23186]: audit 2024-09-21T03:37:30.921016+0000 mgr.a (mgr.14388) 13983 : audit [DBG] from='client.303816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:32 smithi049 bash[23528]: audit 2024-09-21T03:37:30.921016+0000 mgr.a (mgr.14388) 13983 : audit [DBG] from='client.303816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:33 smithi044 bash[22676]: cluster 2024-09-21T03:37:32.089227+0000 mgr.a (mgr.14388) 13984 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:37:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:33 smithi044 bash[22676]: audit 2024-09-21T03:37:32.649461+0000 mon.a (mon.0) 11287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:33 smithi044 bash[22676]: audit 2024-09-21T03:37:32.659220+0000 mon.a (mon.0) 11288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:33 smithi044 bash[22676]: audit 2024-09-21T03:37:32.671190+0000 mon.a (mon.0) 11289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:33 smithi044 bash[22676]: audit 2024-09-21T03:37:33.050162+0000 mon.a (mon.0) 11290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:33 smithi044 bash[22676]: audit 2024-09-21T03:37:33.061534+0000 mon.a (mon.0) 11291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:33 smithi044 bash[22676]: audit 2024-09-21T03:37:33.072811+0000 mon.a (mon.0) 11292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:33 smithi179 bash[23186]: cluster 2024-09-21T03:37:32.089227+0000 mgr.a (mgr.14388) 13984 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:37:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:33 smithi179 bash[23186]: audit 2024-09-21T03:37:32.649461+0000 mon.a (mon.0) 11287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:33 smithi179 bash[23186]: audit 2024-09-21T03:37:32.659220+0000 mon.a (mon.0) 11288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:33 smithi179 bash[23186]: audit 2024-09-21T03:37:32.671190+0000 mon.a (mon.0) 11289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:33 smithi179 bash[23186]: audit 2024-09-21T03:37:33.050162+0000 mon.a (mon.0) 11290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:33 smithi179 bash[23186]: audit 2024-09-21T03:37:33.061534+0000 mon.a (mon.0) 11291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:33 smithi179 bash[23186]: audit 2024-09-21T03:37:33.072811+0000 mon.a (mon.0) 11292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:33 smithi049 bash[23528]: cluster 2024-09-21T03:37:32.089227+0000 mgr.a (mgr.14388) 13984 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:37:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:33 smithi049 bash[23528]: audit 2024-09-21T03:37:32.649461+0000 mon.a (mon.0) 11287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:33 smithi049 bash[23528]: audit 2024-09-21T03:37:32.659220+0000 mon.a (mon.0) 11288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:33 smithi049 bash[23528]: audit 2024-09-21T03:37:32.671190+0000 mon.a (mon.0) 11289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:33 smithi049 bash[23528]: audit 2024-09-21T03:37:33.050162+0000 mon.a (mon.0) 11290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:33 smithi049 bash[23528]: audit 2024-09-21T03:37:33.061534+0000 mon.a (mon.0) 11291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:33.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:33 smithi049 bash[23528]: audit 2024-09-21T03:37:33.072811+0000 mon.a (mon.0) 11292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:35 smithi044 bash[22676]: cluster 2024-09-21T03:37:34.090020+0000 mgr.a (mgr.14388) 13985 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:37:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:35 smithi179 bash[23186]: cluster 2024-09-21T03:37:34.090020+0000 mgr.a (mgr.14388) 13985 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:37:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:35 smithi049 bash[23528]: cluster 2024-09-21T03:37:34.090020+0000 mgr.a (mgr.14388) 13985 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:37:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:37.147 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:37 smithi044 bash[22676]: cluster 2024-09-21T03:37:36.091996+0000 mgr.a (mgr.14388) 13986 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:37.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:37 smithi179 bash[23186]: cluster 2024-09-21T03:37:36.091996+0000 mgr.a (mgr.14388) 13986 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:37 smithi049 bash[23528]: cluster 2024-09-21T03:37:36.091996+0000 mgr.a (mgr.14388) 13986 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:38 smithi044 bash[22676]: audit 2024-09-21T03:37:36.690965+0000 mgr.a (mgr.14388) 13987 : audit [DBG] from='client.303894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:38 smithi179 bash[23186]: audit 2024-09-21T03:37:36.690965+0000 mgr.a (mgr.14388) 13987 : audit [DBG] from='client.303894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:38 smithi049 bash[23528]: audit 2024-09-21T03:37:36.690965+0000 mgr.a (mgr.14388) 13987 : audit [DBG] from='client.303894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:39 smithi044 bash[22676]: cluster 2024-09-21T03:37:38.092888+0000 mgr.a (mgr.14388) 13988 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:39 smithi179 bash[23186]: cluster 2024-09-21T03:37:38.092888+0000 mgr.a (mgr.14388) 13988 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:39 smithi049 bash[23528]: cluster 2024-09-21T03:37:38.092888+0000 mgr.a (mgr.14388) 13988 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:41 smithi049 bash[23528]: cluster 2024-09-21T03:37:40.094265+0000 mgr.a (mgr.14388) 13989 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:37:41.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:41 smithi049 bash[23528]: audit 2024-09-21T03:37:40.950086+0000 mon.a (mon.0) 11293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:41 smithi049 bash[23528]: audit 2024-09-21T03:37:40.958799+0000 mon.a (mon.0) 11294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:41 smithi049 bash[23528]: audit 2024-09-21T03:37:40.969424+0000 mon.a (mon.0) 11295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:41 smithi044 bash[22676]: cluster 2024-09-21T03:37:40.094265+0000 mgr.a (mgr.14388) 13989 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:37:41.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:41 smithi044 bash[22676]: audit 2024-09-21T03:37:40.950086+0000 mon.a (mon.0) 11293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:41 smithi044 bash[22676]: audit 2024-09-21T03:37:40.958799+0000 mon.a (mon.0) 11294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:41 smithi044 bash[22676]: audit 2024-09-21T03:37:40.969424+0000 mon.a (mon.0) 11295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:41 smithi179 bash[23186]: cluster 2024-09-21T03:37:40.094265+0000 mgr.a (mgr.14388) 13989 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:37:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:41 smithi179 bash[23186]: audit 2024-09-21T03:37:40.950086+0000 mon.a (mon.0) 11293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:41 smithi179 bash[23186]: audit 2024-09-21T03:37:40.958799+0000 mon.a (mon.0) 11294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:41 smithi179 bash[23186]: audit 2024-09-21T03:37:40.969424+0000 mon.a (mon.0) 11295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:42.954 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:42.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:43.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:43 smithi044 bash[22676]: cluster 2024-09-21T03:37:42.096025+0000 mgr.a (mgr.14388) 13990 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:43.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:43 smithi179 bash[23186]: cluster 2024-09-21T03:37:42.096025+0000 mgr.a (mgr.14388) 13990 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:43 smithi049 bash[23528]: cluster 2024-09-21T03:37:42.096025+0000 mgr.a (mgr.14388) 13990 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:44.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:44 smithi044 bash[22676]: audit 2024-09-21T03:37:42.493088+0000 mgr.a (mgr.14388) 13991 : audit [DBG] from='client.303972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:44.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:44 smithi179 bash[23186]: audit 2024-09-21T03:37:42.493088+0000 mgr.a (mgr.14388) 13991 : audit [DBG] from='client.303972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:44 smithi049 bash[23528]: audit 2024-09-21T03:37:42.493088+0000 mgr.a (mgr.14388) 13991 : audit [DBG] from='client.303972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:45 smithi044 bash[22676]: cluster 2024-09-21T03:37:44.096975+0000 mgr.a (mgr.14388) 13992 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:45 smithi179 bash[23186]: cluster 2024-09-21T03:37:44.096975+0000 mgr.a (mgr.14388) 13992 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:45 smithi049 bash[23528]: cluster 2024-09-21T03:37:44.096975+0000 mgr.a (mgr.14388) 13992 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:47.469 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:47 smithi049 bash[23528]: cluster 2024-09-21T03:37:46.099318+0000 mgr.a (mgr.14388) 13993 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:47 smithi044 bash[22676]: cluster 2024-09-21T03:37:46.099318+0000 mgr.a (mgr.14388) 13993 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:47.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:47 smithi179 bash[23186]: cluster 2024-09-21T03:37:46.099318+0000 mgr.a (mgr.14388) 13993 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:47.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:47.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:47.956 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:48.708 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:48.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:48.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:48.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:48.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:49 smithi044 bash[22676]: cluster 2024-09-21T03:37:48.099772+0000 mgr.a (mgr.14388) 13994 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:49 smithi044 bash[22676]: audit 2024-09-21T03:37:48.286444+0000 mgr.a (mgr.14388) 13995 : audit [DBG] from='client.304050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:49 smithi179 bash[23186]: cluster 2024-09-21T03:37:48.099772+0000 mgr.a (mgr.14388) 13994 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:49 smithi179 bash[23186]: audit 2024-09-21T03:37:48.286444+0000 mgr.a (mgr.14388) 13995 : audit [DBG] from='client.304050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:49 smithi049 bash[23528]: cluster 2024-09-21T03:37:48.099772+0000 mgr.a (mgr.14388) 13994 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:49 smithi049 bash[23528]: audit 2024-09-21T03:37:48.286444+0000 mgr.a (mgr.14388) 13995 : audit [DBG] from='client.304050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:51 smithi044 bash[22676]: cluster 2024-09-21T03:37:50.101166+0000 mgr.a (mgr.14388) 13996 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:37:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:51 smithi179 bash[23186]: cluster 2024-09-21T03:37:50.101166+0000 mgr.a (mgr.14388) 13996 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:37:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:51 smithi049 bash[23528]: cluster 2024-09-21T03:37:50.101166+0000 mgr.a (mgr.14388) 13996 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:37:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:53 smithi044 bash[22676]: cluster 2024-09-21T03:37:52.102921+0000 mgr.a (mgr.14388) 13997 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:53 smithi044 bash[22676]: audit 2024-09-21T03:37:52.896285+0000 mon.a (mon.0) 11296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:53 smithi044 bash[22676]: audit 2024-09-21T03:37:52.905843+0000 mon.a (mon.0) 11297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:53 smithi044 bash[22676]: audit 2024-09-21T03:37:52.916350+0000 mon.a (mon.0) 11298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:53 smithi179 bash[23186]: cluster 2024-09-21T03:37:52.102921+0000 mgr.a (mgr.14388) 13997 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:53 smithi179 bash[23186]: audit 2024-09-21T03:37:52.896285+0000 mon.a (mon.0) 11296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:53 smithi179 bash[23186]: audit 2024-09-21T03:37:52.905843+0000 mon.a (mon.0) 11297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:53 smithi179 bash[23186]: audit 2024-09-21T03:37:52.916350+0000 mon.a (mon.0) 11298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:53 smithi049 bash[23528]: cluster 2024-09-21T03:37:52.102921+0000 mgr.a (mgr.14388) 13997 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:53 smithi049 bash[23528]: audit 2024-09-21T03:37:52.896285+0000 mon.a (mon.0) 11296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:53 smithi049 bash[23528]: audit 2024-09-21T03:37:52.905843+0000 mon.a (mon.0) 11297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:53 smithi049 bash[23528]: audit 2024-09-21T03:37:52.916350+0000 mon.a (mon.0) 11298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:53.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:53.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:53.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:54.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:37:54.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:37:54.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:37:54.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:37:54.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:37:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:54 smithi049 bash[23528]: audit 2024-09-21T03:37:53.283309+0000 mon.a (mon.0) 11299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:54 smithi049 bash[23528]: audit 2024-09-21T03:37:53.291951+0000 mon.a (mon.0) 11300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:54 smithi049 bash[23528]: audit 2024-09-21T03:37:53.302065+0000 mon.a (mon.0) 11301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:54 smithi044 bash[22676]: audit 2024-09-21T03:37:53.283309+0000 mon.a (mon.0) 11299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:54 smithi044 bash[22676]: audit 2024-09-21T03:37:53.291951+0000 mon.a (mon.0) 11300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:54 smithi044 bash[22676]: audit 2024-09-21T03:37:53.302065+0000 mon.a (mon.0) 11301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:54 smithi179 bash[23186]: audit 2024-09-21T03:37:53.283309+0000 mon.a (mon.0) 11299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:54 smithi179 bash[23186]: audit 2024-09-21T03:37:53.291951+0000 mon.a (mon.0) 11300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:54 smithi179 bash[23186]: audit 2024-09-21T03:37:53.302065+0000 mon.a (mon.0) 11301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:37:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:55 smithi044 bash[22676]: audit 2024-09-21T03:37:54.041819+0000 mgr.a (mgr.14388) 13998 : audit [DBG] from='client.304128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:55 smithi044 bash[22676]: cluster 2024-09-21T03:37:54.103462+0000 mgr.a (mgr.14388) 13999 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:55 smithi179 bash[23186]: audit 2024-09-21T03:37:54.041819+0000 mgr.a (mgr.14388) 13998 : audit [DBG] from='client.304128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:55 smithi179 bash[23186]: cluster 2024-09-21T03:37:54.103462+0000 mgr.a (mgr.14388) 13999 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:55 smithi049 bash[23528]: audit 2024-09-21T03:37:54.041819+0000 mgr.a (mgr.14388) 13998 : audit [DBG] from='client.304128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:55 smithi049 bash[23528]: cluster 2024-09-21T03:37:54.103462+0000 mgr.a (mgr.14388) 13999 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:57 smithi044 bash[22676]: cluster 2024-09-21T03:37:56.105780+0000 mgr.a (mgr.14388) 14000 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:57.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:57 smithi179 bash[23186]: cluster 2024-09-21T03:37:56.105780+0000 mgr.a (mgr.14388) 14000 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:57 smithi049 bash[23528]: cluster 2024-09-21T03:37:56.105780+0000 mgr.a (mgr.14388) 14000 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:37:59.499 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:37:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:37:59.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:37:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:37:59 smithi044 bash[22676]: cluster 2024-09-21T03:37:58.106573+0000 mgr.a (mgr.14388) 14001 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:59.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:37:59 smithi179 bash[23186]: cluster 2024-09-21T03:37:58.106573+0000 mgr.a (mgr.14388) 14001 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:37:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:37:59 smithi049 bash[23528]: cluster 2024-09-21T03:37:58.106573+0000 mgr.a (mgr.14388) 14001 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:00.293 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:00.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:00.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:00.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:00.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:01 smithi049 bash[23528]: audit 2024-09-21T03:37:59.842006+0000 mgr.a (mgr.14388) 14002 : audit [DBG] from='client.304203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:01 smithi049 bash[23528]: cluster 2024-09-21T03:38:00.107530+0000 mgr.a (mgr.14388) 14003 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:01 smithi049 bash[23528]: audit 2024-09-21T03:38:01.184646+0000 mon.a (mon.0) 11302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:01 smithi049 bash[23528]: audit 2024-09-21T03:38:01.193847+0000 mon.a (mon.0) 11303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:01 smithi049 bash[23528]: audit 2024-09-21T03:38:01.204789+0000 mon.a (mon.0) 11304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:01 smithi044 bash[22676]: audit 2024-09-21T03:37:59.842006+0000 mgr.a (mgr.14388) 14002 : audit [DBG] from='client.304203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:01 smithi044 bash[22676]: cluster 2024-09-21T03:38:00.107530+0000 mgr.a (mgr.14388) 14003 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:01 smithi044 bash[22676]: audit 2024-09-21T03:38:01.184646+0000 mon.a (mon.0) 11302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:01 smithi044 bash[22676]: audit 2024-09-21T03:38:01.193847+0000 mon.a (mon.0) 11303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:01 smithi044 bash[22676]: audit 2024-09-21T03:38:01.204789+0000 mon.a (mon.0) 11304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:01 smithi179 bash[23186]: audit 2024-09-21T03:37:59.842006+0000 mgr.a (mgr.14388) 14002 : audit [DBG] from='client.304203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:01 smithi179 bash[23186]: cluster 2024-09-21T03:38:00.107530+0000 mgr.a (mgr.14388) 14003 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:01 smithi179 bash[23186]: audit 2024-09-21T03:38:01.184646+0000 mon.a (mon.0) 11302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:01 smithi179 bash[23186]: audit 2024-09-21T03:38:01.193847+0000 mon.a (mon.0) 11303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:01 smithi179 bash[23186]: audit 2024-09-21T03:38:01.204789+0000 mon.a (mon.0) 11304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:03 smithi044 bash[22676]: cluster 2024-09-21T03:38:02.109504+0000 mgr.a (mgr.14388) 14004 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:38:03.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:03 smithi179 bash[23186]: cluster 2024-09-21T03:38:02.109504+0000 mgr.a (mgr.14388) 14004 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:38:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:03 smithi049 bash[23528]: cluster 2024-09-21T03:38:02.109504+0000 mgr.a (mgr.14388) 14004 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:38:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:05.295 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:05.633 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:05 smithi044 bash[22676]: cluster 2024-09-21T03:38:04.110258+0000 mgr.a (mgr.14388) 14005 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:38:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:05 smithi179 bash[23186]: cluster 2024-09-21T03:38:04.110258+0000 mgr.a (mgr.14388) 14005 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:38:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:05 smithi049 bash[23528]: cluster 2024-09-21T03:38:04.110258+0000 mgr.a (mgr.14388) 14005 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:38:06.075 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:06.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:06.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:06.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:06.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:07 smithi179 bash[23186]: audit 2024-09-21T03:38:05.637471+0000 mgr.a (mgr.14388) 14006 : audit [DBG] from='client.304281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:07 smithi179 bash[23186]: cluster 2024-09-21T03:38:06.111621+0000 mgr.a (mgr.14388) 14007 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:07 smithi179 bash[23186]: audit 2024-09-21T03:38:06.609109+0000 mon.a (mon.0) 11305 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:07 smithi179 bash[23186]: audit 2024-09-21T03:38:06.616352+0000 mon.a (mon.0) 11306 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:07 smithi179 bash[23186]: audit 2024-09-21T03:38:06.618232+0000 mon.a (mon.0) 11307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:07 smithi179 bash[23186]: audit 2024-09-21T03:38:06.630850+0000 mon.a (mon.0) 11308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:07 smithi179 bash[23186]: audit 2024-09-21T03:38:06.637410+0000 mon.a (mon.0) 11309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:38:07.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22930]: debug 2024-09-21T03:38:07.380+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:38:07.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22930]: debug 2024-09-21T03:38:07.380+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:38:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22676]: audit 2024-09-21T03:38:05.637471+0000 mgr.a (mgr.14388) 14006 : audit [DBG] from='client.304281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22676]: cluster 2024-09-21T03:38:06.111621+0000 mgr.a (mgr.14388) 14007 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22676]: audit 2024-09-21T03:38:06.609109+0000 mon.a (mon.0) 11305 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:38:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22676]: audit 2024-09-21T03:38:06.616352+0000 mon.a (mon.0) 11306 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:38:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22676]: audit 2024-09-21T03:38:06.618232+0000 mon.a (mon.0) 11307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:38:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22676]: audit 2024-09-21T03:38:06.630850+0000 mon.a (mon.0) 11308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:07 smithi044 bash[22676]: audit 2024-09-21T03:38:06.637410+0000 mon.a (mon.0) 11309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:38:07.620 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:07 smithi049 bash[23528]: audit 2024-09-21T03:38:05.637471+0000 mgr.a (mgr.14388) 14006 : audit [DBG] from='client.304281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:07.620 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:07 smithi049 bash[23528]: cluster 2024-09-21T03:38:06.111621+0000 mgr.a (mgr.14388) 14007 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:07.621 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:07 smithi049 bash[23528]: audit 2024-09-21T03:38:06.609109+0000 mon.a (mon.0) 11305 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:38:07.621 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:07 smithi049 bash[23528]: audit 2024-09-21T03:38:06.616352+0000 mon.a (mon.0) 11306 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:38:07.621 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:07 smithi049 bash[23528]: audit 2024-09-21T03:38:06.618232+0000 mon.a (mon.0) 11307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:38:07.621 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:07 smithi049 bash[23528]: audit 2024-09-21T03:38:06.630850+0000 mon.a (mon.0) 11308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:07.621 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:07 smithi049 bash[23528]: audit 2024-09-21T03:38:06.637410+0000 mon.a (mon.0) 11309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:38:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:08 smithi179 bash[23186]: audit 2024-09-21T03:38:06.640116+0000 mgr.a (mgr.14388) 14008 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:38:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:08 smithi179 bash[23186]: audit 2024-09-21T03:38:07.382532+0000 mgr.a (mgr.14388) 14009 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:38:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:08 smithi179 bash[23186]: cephadm 2024-09-21T03:38:07.383616+0000 mgr.a (mgr.14388) 14010 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:38:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:08 smithi044 bash[22676]: audit 2024-09-21T03:38:06.640116+0000 mgr.a (mgr.14388) 14008 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:38:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:08 smithi044 bash[22676]: audit 2024-09-21T03:38:07.382532+0000 mgr.a (mgr.14388) 14009 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:38:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:08 smithi044 bash[22676]: cephadm 2024-09-21T03:38:07.383616+0000 mgr.a (mgr.14388) 14010 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:38:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:08 smithi049 bash[23528]: audit 2024-09-21T03:38:06.640116+0000 mgr.a (mgr.14388) 14008 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:38:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:08 smithi049 bash[23528]: audit 2024-09-21T03:38:07.382532+0000 mgr.a (mgr.14388) 14009 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:38:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:08 smithi049 bash[23528]: cephadm 2024-09-21T03:38:07.383616+0000 mgr.a (mgr.14388) 14010 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:38:09.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:09 smithi179 bash[23186]: cluster 2024-09-21T03:38:08.112479+0000 mgr.a (mgr.14388) 14011 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:38:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:09 smithi044 bash[22676]: cluster 2024-09-21T03:38:08.112479+0000 mgr.a (mgr.14388) 14011 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:38:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:09 smithi049 bash[23528]: cluster 2024-09-21T03:38:08.112479+0000 mgr.a (mgr.14388) 14011 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:38:11.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:11.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:11.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:11 smithi044 bash[22676]: cluster 2024-09-21T03:38:10.113869+0000 mgr.a (mgr.14388) 14012 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 4 op/s 2024-09-21T03:38:11.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:11 smithi179 bash[23186]: cluster 2024-09-21T03:38:10.113869+0000 mgr.a (mgr.14388) 14012 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 4 op/s 2024-09-21T03:38:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:11 smithi049 bash[23528]: cluster 2024-09-21T03:38:10.113869+0000 mgr.a (mgr.14388) 14012 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 4 op/s 2024-09-21T03:38:11.870 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:12 smithi044 bash[22676]: audit 2024-09-21T03:38:11.414446+0000 mgr.a (mgr.14388) 14013 : audit [DBG] from='client.304461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:12.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:12 smithi179 bash[23186]: audit 2024-09-21T03:38:11.414446+0000 mgr.a (mgr.14388) 14013 : audit [DBG] from='client.304461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:12 smithi049 bash[23528]: audit 2024-09-21T03:38:11.414446+0000 mgr.a (mgr.14388) 14013 : audit [DBG] from='client.304461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:13 smithi044 bash[22676]: cluster 2024-09-21T03:38:12.116286+0000 mgr.a (mgr.14388) 14014 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:13 smithi044 bash[22676]: audit 2024-09-21T03:38:13.136597+0000 mon.a (mon.0) 11310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:13 smithi044 bash[22676]: audit 2024-09-21T03:38:13.143868+0000 mon.a (mon.0) 11311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:13 smithi044 bash[22676]: audit 2024-09-21T03:38:13.153116+0000 mon.a (mon.0) 11312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:13 smithi179 bash[23186]: cluster 2024-09-21T03:38:12.116286+0000 mgr.a (mgr.14388) 14014 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:13 smithi179 bash[23186]: audit 2024-09-21T03:38:13.136597+0000 mon.a (mon.0) 11310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:13 smithi179 bash[23186]: audit 2024-09-21T03:38:13.143868+0000 mon.a (mon.0) 11311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:13 smithi179 bash[23186]: audit 2024-09-21T03:38:13.153116+0000 mon.a (mon.0) 11312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:13 smithi049 bash[23528]: cluster 2024-09-21T03:38:12.116286+0000 mgr.a (mgr.14388) 14014 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:13 smithi049 bash[23528]: audit 2024-09-21T03:38:13.136597+0000 mon.a (mon.0) 11310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:13 smithi049 bash[23528]: audit 2024-09-21T03:38:13.143868+0000 mon.a (mon.0) 11311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:13 smithi049 bash[23528]: audit 2024-09-21T03:38:13.153116+0000 mon.a (mon.0) 11312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:14 smithi049 bash[23528]: audit 2024-09-21T03:38:13.509650+0000 mon.a (mon.0) 11313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:14 smithi049 bash[23528]: audit 2024-09-21T03:38:13.518014+0000 mon.a (mon.0) 11314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:14 smithi049 bash[23528]: audit 2024-09-21T03:38:13.527888+0000 mon.a (mon.0) 11315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:14 smithi049 bash[23528]: cluster 2024-09-21T03:38:14.117076+0000 mgr.a (mgr.14388) 14015 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:14 smithi044 bash[22676]: audit 2024-09-21T03:38:13.509650+0000 mon.a (mon.0) 11313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:14 smithi044 bash[22676]: audit 2024-09-21T03:38:13.518014+0000 mon.a (mon.0) 11314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:14 smithi044 bash[22676]: audit 2024-09-21T03:38:13.527888+0000 mon.a (mon.0) 11315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:14.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:14 smithi044 bash[22676]: cluster 2024-09-21T03:38:14.117076+0000 mgr.a (mgr.14388) 14015 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:38:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:14 smithi179 bash[23186]: audit 2024-09-21T03:38:13.509650+0000 mon.a (mon.0) 11313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:14 smithi179 bash[23186]: audit 2024-09-21T03:38:13.518014+0000 mon.a (mon.0) 11314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:14 smithi179 bash[23186]: audit 2024-09-21T03:38:13.527888+0000 mon.a (mon.0) 11315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:14 smithi179 bash[23186]: cluster 2024-09-21T03:38:14.117076+0000 mgr.a (mgr.14388) 14015 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:38:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:17.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:17 smithi049 bash[23528]: cluster 2024-09-21T03:38:16.119044+0000 mgr.a (mgr.14388) 14016 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:17.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:17 smithi044 bash[22676]: cluster 2024-09-21T03:38:16.119044+0000 mgr.a (mgr.14388) 14016 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:17.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:17 smithi179 bash[23186]: cluster 2024-09-21T03:38:16.119044+0000 mgr.a (mgr.14388) 14016 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:17.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:17.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:17.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:17.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:17.631 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:18.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:18 smithi044 bash[22676]: audit 2024-09-21T03:38:17.205911+0000 mgr.a (mgr.14388) 14017 : audit [DBG] from='client.304536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:18.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:18 smithi179 bash[23186]: audit 2024-09-21T03:38:17.205911+0000 mgr.a (mgr.14388) 14017 : audit [DBG] from='client.304536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:18.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:18 smithi049 bash[23528]: audit 2024-09-21T03:38:17.205911+0000 mgr.a (mgr.14388) 14017 : audit [DBG] from='client.304536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:19 smithi044 bash[22676]: cluster 2024-09-21T03:38:18.119946+0000 mgr.a (mgr.14388) 14018 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:19.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:19 smithi179 bash[23186]: cluster 2024-09-21T03:38:18.119946+0000 mgr.a (mgr.14388) 14018 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:19 smithi049 bash[23528]: cluster 2024-09-21T03:38:18.119946+0000 mgr.a (mgr.14388) 14018 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:21 smithi044 bash[22676]: cluster 2024-09-21T03:38:20.121206+0000 mgr.a (mgr.14388) 14019 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:21 smithi179 bash[23186]: cluster 2024-09-21T03:38:20.121206+0000 mgr.a (mgr.14388) 14019 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:21 smithi049 bash[23528]: cluster 2024-09-21T03:38:20.121206+0000 mgr.a (mgr.14388) 14019 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:38:22.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:22.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:22.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:22 smithi044 bash[22676]: audit 2024-09-21T03:38:21.415369+0000 mon.a (mon.0) 11316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:22 smithi044 bash[22676]: audit 2024-09-21T03:38:21.424294+0000 mon.a (mon.0) 11317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:22 smithi044 bash[22676]: audit 2024-09-21T03:38:21.435270+0000 mon.a (mon.0) 11318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:22 smithi179 bash[23186]: audit 2024-09-21T03:38:21.415369+0000 mon.a (mon.0) 11316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:22 smithi179 bash[23186]: audit 2024-09-21T03:38:21.424294+0000 mon.a (mon.0) 11317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:22 smithi179 bash[23186]: audit 2024-09-21T03:38:21.435270+0000 mon.a (mon.0) 11318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:22 smithi049 bash[23528]: audit 2024-09-21T03:38:21.415369+0000 mon.a (mon.0) 11316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:22 smithi049 bash[23528]: audit 2024-09-21T03:38:21.424294+0000 mon.a (mon.0) 11317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:22 smithi049 bash[23528]: audit 2024-09-21T03:38:21.435270+0000 mon.a (mon.0) 11318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:23.414 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:23 smithi044 bash[22676]: cluster 2024-09-21T03:38:22.122908+0000 mgr.a (mgr.14388) 14020 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:38:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:23 smithi179 bash[23186]: cluster 2024-09-21T03:38:22.122908+0000 mgr.a (mgr.14388) 14020 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:38:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:23 smithi049 bash[23528]: cluster 2024-09-21T03:38:22.122908+0000 mgr.a (mgr.14388) 14020 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:38:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:24 smithi044 bash[22676]: audit 2024-09-21T03:38:22.966177+0000 mgr.a (mgr.14388) 14021 : audit [DBG] from='client.304614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:24 smithi179 bash[23186]: audit 2024-09-21T03:38:22.966177+0000 mgr.a (mgr.14388) 14021 : audit [DBG] from='client.304614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:24 smithi049 bash[23528]: audit 2024-09-21T03:38:22.966177+0000 mgr.a (mgr.14388) 14021 : audit [DBG] from='client.304614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:25.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:25 smithi044 bash[22676]: cluster 2024-09-21T03:38:24.123804+0000 mgr.a (mgr.14388) 14022 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:25.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:25 smithi179 bash[23186]: cluster 2024-09-21T03:38:24.123804+0000 mgr.a (mgr.14388) 14022 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:25 smithi049 bash[23528]: cluster 2024-09-21T03:38:24.123804+0000 mgr.a (mgr.14388) 14022 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:26.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:26 smithi179 bash[23186]: cluster 2024-09-21T03:38:26.126091+0000 mgr.a (mgr.14388) 14023 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:26.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:26 smithi044 bash[22676]: cluster 2024-09-21T03:38:26.126091+0000 mgr.a (mgr.14388) 14023 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:26 smithi049 bash[23528]: cluster 2024-09-21T03:38:26.126091+0000 mgr.a (mgr.14388) 14023 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:28.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:28.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:29.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:29.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:29 smithi049 bash[23528]: cluster 2024-09-21T03:38:28.126674+0000 mgr.a (mgr.14388) 14024 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:29.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:29 smithi044 bash[22676]: cluster 2024-09-21T03:38:28.126674+0000 mgr.a (mgr.14388) 14024 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:29.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:29 smithi179 bash[23186]: cluster 2024-09-21T03:38:28.126674+0000 mgr.a (mgr.14388) 14024 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:30 smithi049 bash[23528]: audit 2024-09-21T03:38:28.750801+0000 mgr.a (mgr.14388) 14025 : audit [DBG] from='client.304692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:30.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:30 smithi044 bash[22676]: audit 2024-09-21T03:38:28.750801+0000 mgr.a (mgr.14388) 14025 : audit [DBG] from='client.304692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:30.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:30 smithi179 bash[23186]: audit 2024-09-21T03:38:28.750801+0000 mgr.a (mgr.14388) 14025 : audit [DBG] from='client.304692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:31.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:31 smithi044 bash[22676]: cluster 2024-09-21T03:38:30.128115+0000 mgr.a (mgr.14388) 14026 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:38:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:31 smithi179 bash[23186]: cluster 2024-09-21T03:38:30.128115+0000 mgr.a (mgr.14388) 14026 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:38:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:31 smithi049 bash[23528]: cluster 2024-09-21T03:38:30.128115+0000 mgr.a (mgr.14388) 14026 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:38:33.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:33 smithi044 bash[22676]: cluster 2024-09-21T03:38:32.129910+0000 mgr.a (mgr.14388) 14027 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:38:33.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:33 smithi179 bash[23186]: cluster 2024-09-21T03:38:32.129910+0000 mgr.a (mgr.14388) 14027 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:38:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:33 smithi049 bash[23528]: cluster 2024-09-21T03:38:32.129910+0000 mgr.a (mgr.14388) 14027 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:38:34.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:34.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:34.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:34 smithi044 bash[22676]: audit 2024-09-21T03:38:33.375423+0000 mon.a (mon.0) 11319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:34 smithi044 bash[22676]: audit 2024-09-21T03:38:33.385048+0000 mon.a (mon.0) 11320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:34 smithi044 bash[22676]: audit 2024-09-21T03:38:33.396578+0000 mon.a (mon.0) 11321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:34 smithi044 bash[22676]: audit 2024-09-21T03:38:33.738824+0000 mon.a (mon.0) 11322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:34 smithi044 bash[22676]: audit 2024-09-21T03:38:33.748416+0000 mon.a (mon.0) 11323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:34 smithi044 bash[22676]: audit 2024-09-21T03:38:33.759550+0000 mon.a (mon.0) 11324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:34 smithi179 bash[23186]: audit 2024-09-21T03:38:33.375423+0000 mon.a (mon.0) 11319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:34 smithi179 bash[23186]: audit 2024-09-21T03:38:33.385048+0000 mon.a (mon.0) 11320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:34 smithi179 bash[23186]: audit 2024-09-21T03:38:33.396578+0000 mon.a (mon.0) 11321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:34 smithi179 bash[23186]: audit 2024-09-21T03:38:33.738824+0000 mon.a (mon.0) 11322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:34 smithi179 bash[23186]: audit 2024-09-21T03:38:33.748416+0000 mon.a (mon.0) 11323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:34 smithi179 bash[23186]: audit 2024-09-21T03:38:33.759550+0000 mon.a (mon.0) 11324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:34 smithi049 bash[23528]: audit 2024-09-21T03:38:33.375423+0000 mon.a (mon.0) 11319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:34 smithi049 bash[23528]: audit 2024-09-21T03:38:33.385048+0000 mon.a (mon.0) 11320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:34 smithi049 bash[23528]: audit 2024-09-21T03:38:33.396578+0000 mon.a (mon.0) 11321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:34 smithi049 bash[23528]: audit 2024-09-21T03:38:33.738824+0000 mon.a (mon.0) 11322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:34 smithi049 bash[23528]: audit 2024-09-21T03:38:33.748416+0000 mon.a (mon.0) 11323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:34 smithi049 bash[23528]: audit 2024-09-21T03:38:33.759550+0000 mon.a (mon.0) 11324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:34.934 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:34.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:34.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:34.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:34.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:35 smithi044 bash[22676]: cluster 2024-09-21T03:38:34.130719+0000 mgr.a (mgr.14388) 14028 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:35.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:35 smithi179 bash[23186]: cluster 2024-09-21T03:38:34.130719+0000 mgr.a (mgr.14388) 14028 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:35 smithi049 bash[23528]: cluster 2024-09-21T03:38:34.130719+0000 mgr.a (mgr.14388) 14028 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:36 smithi044 bash[22676]: audit 2024-09-21T03:38:34.508917+0000 mgr.a (mgr.14388) 14029 : audit [DBG] from='client.304770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:36.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:36 smithi179 bash[23186]: audit 2024-09-21T03:38:34.508917+0000 mgr.a (mgr.14388) 14029 : audit [DBG] from='client.304770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:36 smithi049 bash[23528]: audit 2024-09-21T03:38:34.508917+0000 mgr.a (mgr.14388) 14029 : audit [DBG] from='client.304770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:37 smithi044 bash[22676]: cluster 2024-09-21T03:38:36.133108+0000 mgr.a (mgr.14388) 14030 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:37.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:37 smithi179 bash[23186]: cluster 2024-09-21T03:38:36.133108+0000 mgr.a (mgr.14388) 14030 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:37 smithi049 bash[23528]: cluster 2024-09-21T03:38:36.133108+0000 mgr.a (mgr.14388) 14030 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:39 smithi044 bash[22676]: cluster 2024-09-21T03:38:38.134020+0000 mgr.a (mgr.14388) 14031 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:39.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:39 smithi179 bash[23186]: cluster 2024-09-21T03:38:38.134020+0000 mgr.a (mgr.14388) 14031 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:39 smithi049 bash[23528]: cluster 2024-09-21T03:38:38.134020+0000 mgr.a (mgr.14388) 14031 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:39.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:39.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:39.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:40.731 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:40.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:40.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:41.672 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:41 smithi049 bash[23528]: cluster 2024-09-21T03:38:40.135236+0000 mgr.a (mgr.14388) 14032 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:41.673 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:41 smithi049 bash[23528]: audit 2024-09-21T03:38:40.274672+0000 mgr.a (mgr.14388) 14033 : audit [DBG] from='client.304848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:41 smithi044 bash[22676]: cluster 2024-09-21T03:38:40.135236+0000 mgr.a (mgr.14388) 14032 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:41 smithi044 bash[22676]: audit 2024-09-21T03:38:40.274672+0000 mgr.a (mgr.14388) 14033 : audit [DBG] from='client.304848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:41 smithi179 bash[23186]: cluster 2024-09-21T03:38:40.135236+0000 mgr.a (mgr.14388) 14032 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:41 smithi179 bash[23186]: audit 2024-09-21T03:38:40.274672+0000 mgr.a (mgr.14388) 14033 : audit [DBG] from='client.304848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:42.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:42 smithi044 bash[22676]: audit 2024-09-21T03:38:41.648165+0000 mon.a (mon.0) 11325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:42 smithi044 bash[22676]: audit 2024-09-21T03:38:41.658141+0000 mon.a (mon.0) 11326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:42 smithi044 bash[22676]: audit 2024-09-21T03:38:41.669961+0000 mon.a (mon.0) 11327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:42 smithi044 bash[22676]: cluster 2024-09-21T03:38:42.137504+0000 mgr.a (mgr.14388) 14034 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:38:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:42 smithi179 bash[23186]: audit 2024-09-21T03:38:41.648165+0000 mon.a (mon.0) 11325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:42 smithi179 bash[23186]: audit 2024-09-21T03:38:41.658141+0000 mon.a (mon.0) 11326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:42 smithi179 bash[23186]: audit 2024-09-21T03:38:41.669961+0000 mon.a (mon.0) 11327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:42 smithi179 bash[23186]: cluster 2024-09-21T03:38:42.137504+0000 mgr.a (mgr.14388) 14034 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:38:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:42 smithi049 bash[23528]: audit 2024-09-21T03:38:41.648165+0000 mon.a (mon.0) 11325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:42 smithi049 bash[23528]: audit 2024-09-21T03:38:41.658141+0000 mon.a (mon.0) 11326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:42 smithi049 bash[23528]: audit 2024-09-21T03:38:41.669961+0000 mon.a (mon.0) 11327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:42 smithi049 bash[23528]: cluster 2024-09-21T03:38:42.137504+0000 mgr.a (mgr.14388) 14034 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:38:45.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:45 smithi044 bash[22676]: cluster 2024-09-21T03:38:44.138389+0000 mgr.a (mgr.14388) 14035 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:38:45.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:45 smithi179 bash[23186]: cluster 2024-09-21T03:38:44.138389+0000 mgr.a (mgr.14388) 14035 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:38:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:45 smithi049 bash[23528]: cluster 2024-09-21T03:38:44.138389+0000 mgr.a (mgr.14388) 14035 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:38:45.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:45.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:45.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:46.491 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:46.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:46.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:46.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:46.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:47.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:47 smithi044 bash[22676]: audit 2024-09-21T03:38:46.072144+0000 mgr.a (mgr.14388) 14036 : audit [DBG] from='client.304926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:47 smithi044 bash[22676]: cluster 2024-09-21T03:38:46.139918+0000 mgr.a (mgr.14388) 14037 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:47 smithi179 bash[23186]: audit 2024-09-21T03:38:46.072144+0000 mgr.a (mgr.14388) 14036 : audit [DBG] from='client.304926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:47 smithi179 bash[23186]: cluster 2024-09-21T03:38:46.139918+0000 mgr.a (mgr.14388) 14037 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:47 smithi049 bash[23528]: audit 2024-09-21T03:38:46.072144+0000 mgr.a (mgr.14388) 14036 : audit [DBG] from='client.304926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:47 smithi049 bash[23528]: cluster 2024-09-21T03:38:46.139918+0000 mgr.a (mgr.14388) 14037 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:49 smithi049 bash[23528]: cluster 2024-09-21T03:38:48.140758+0000 mgr.a (mgr.14388) 14038 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:38:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:49 smithi044 bash[22676]: cluster 2024-09-21T03:38:48.140758+0000 mgr.a (mgr.14388) 14038 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:38:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:49 smithi179 bash[23186]: cluster 2024-09-21T03:38:48.140758+0000 mgr.a (mgr.14388) 14038 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:38:51.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:51 smithi044 bash[22676]: cluster 2024-09-21T03:38:50.142117+0000 mgr.a (mgr.14388) 14039 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:38:51.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:51.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:51 smithi179 bash[23186]: cluster 2024-09-21T03:38:50.142117+0000 mgr.a (mgr.14388) 14039 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:38:51.525 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:51 smithi049 bash[23528]: cluster 2024-09-21T03:38:50.142117+0000 mgr.a (mgr.14388) 14039 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:38:52.270 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:52.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:52.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:52.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:52.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:53 smithi044 bash[22676]: audit 2024-09-21T03:38:51.827931+0000 mgr.a (mgr.14388) 14040 : audit [DBG] from='client.305004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:53.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:53 smithi044 bash[22676]: cluster 2024-09-21T03:38:52.143196+0000 mgr.a (mgr.14388) 14041 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:53 smithi179 bash[23186]: audit 2024-09-21T03:38:51.827931+0000 mgr.a (mgr.14388) 14040 : audit [DBG] from='client.305004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:53 smithi179 bash[23186]: cluster 2024-09-21T03:38:52.143196+0000 mgr.a (mgr.14388) 14041 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:53 smithi049 bash[23528]: audit 2024-09-21T03:38:51.827931+0000 mgr.a (mgr.14388) 14040 : audit [DBG] from='client.305004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:53.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:53 smithi049 bash[23528]: cluster 2024-09-21T03:38:52.143196+0000 mgr.a (mgr.14388) 14041 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:54 smithi044 bash[22676]: audit 2024-09-21T03:38:53.602083+0000 mon.a (mon.0) 11328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:54 smithi044 bash[22676]: audit 2024-09-21T03:38:53.610104+0000 mon.a (mon.0) 11329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:54 smithi044 bash[22676]: audit 2024-09-21T03:38:53.620330+0000 mon.a (mon.0) 11330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:54 smithi044 bash[22676]: audit 2024-09-21T03:38:53.965769+0000 mon.a (mon.0) 11331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:54 smithi044 bash[22676]: audit 2024-09-21T03:38:53.974256+0000 mon.a (mon.0) 11332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:54 smithi044 bash[22676]: audit 2024-09-21T03:38:53.984371+0000 mon.a (mon.0) 11333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:54 smithi044 bash[22676]: cluster 2024-09-21T03:38:54.144011+0000 mgr.a (mgr.14388) 14042 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:54 smithi179 bash[23186]: audit 2024-09-21T03:38:53.602083+0000 mon.a (mon.0) 11328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:54 smithi179 bash[23186]: audit 2024-09-21T03:38:53.610104+0000 mon.a (mon.0) 11329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:54 smithi179 bash[23186]: audit 2024-09-21T03:38:53.620330+0000 mon.a (mon.0) 11330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:54 smithi179 bash[23186]: audit 2024-09-21T03:38:53.965769+0000 mon.a (mon.0) 11331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:54 smithi179 bash[23186]: audit 2024-09-21T03:38:53.974256+0000 mon.a (mon.0) 11332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:54 smithi179 bash[23186]: audit 2024-09-21T03:38:53.984371+0000 mon.a (mon.0) 11333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:54 smithi179 bash[23186]: cluster 2024-09-21T03:38:54.144011+0000 mgr.a (mgr.14388) 14042 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:54 smithi049 bash[23528]: audit 2024-09-21T03:38:53.602083+0000 mon.a (mon.0) 11328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:54 smithi049 bash[23528]: audit 2024-09-21T03:38:53.610104+0000 mon.a (mon.0) 11329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:54 smithi049 bash[23528]: audit 2024-09-21T03:38:53.620330+0000 mon.a (mon.0) 11330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:54 smithi049 bash[23528]: audit 2024-09-21T03:38:53.965769+0000 mon.a (mon.0) 11331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:54 smithi049 bash[23528]: audit 2024-09-21T03:38:53.974256+0000 mon.a (mon.0) 11332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:54 smithi049 bash[23528]: audit 2024-09-21T03:38:53.984371+0000 mon.a (mon.0) 11333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:38:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:54 smithi049 bash[23528]: cluster 2024-09-21T03:38:54.144011+0000 mgr.a (mgr.14388) 14042 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:57.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:38:57.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:38:57.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:38:57.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:57 smithi044 bash[22676]: cluster 2024-09-21T03:38:56.146228+0000 mgr.a (mgr.14388) 14043 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:57 smithi179 bash[23186]: cluster 2024-09-21T03:38:56.146228+0000 mgr.a (mgr.14388) 14043 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:57.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:57 smithi049 bash[23528]: cluster 2024-09-21T03:38:56.146228+0000 mgr.a (mgr.14388) 14043 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:38:58.048 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:38:58.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:38:58.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:38:58.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:38:58.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:38:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:59 smithi044 bash[22676]: audit 2024-09-21T03:38:57.607295+0000 mgr.a (mgr.14388) 14044 : audit [DBG] from='client.305082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:38:59 smithi044 bash[22676]: cluster 2024-09-21T03:38:58.146941+0000 mgr.a (mgr.14388) 14045 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:59 smithi179 bash[23186]: audit 2024-09-21T03:38:57.607295+0000 mgr.a (mgr.14388) 14044 : audit [DBG] from='client.305082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:38:59 smithi179 bash[23186]: cluster 2024-09-21T03:38:58.146941+0000 mgr.a (mgr.14388) 14045 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:38:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:59 smithi049 bash[23528]: audit 2024-09-21T03:38:57.607295+0000 mgr.a (mgr.14388) 14044 : audit [DBG] from='client.305082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:38:59 smithi049 bash[23528]: cluster 2024-09-21T03:38:58.146941+0000 mgr.a (mgr.14388) 14045 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:01.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:01 smithi044 bash[22676]: cluster 2024-09-21T03:39:00.148396+0000 mgr.a (mgr.14388) 14046 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:39:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:01 smithi179 bash[23186]: cluster 2024-09-21T03:39:00.148396+0000 mgr.a (mgr.14388) 14046 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:39:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:01 smithi049 bash[23528]: cluster 2024-09-21T03:39:00.148396+0000 mgr.a (mgr.14388) 14046 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:39:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:03.050 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:03.050 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:02 smithi044 bash[22676]: audit 2024-09-21T03:39:01.887784+0000 mon.a (mon.0) 11334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:02 smithi044 bash[22676]: audit 2024-09-21T03:39:01.896677+0000 mon.a (mon.0) 11335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:02 smithi044 bash[22676]: audit 2024-09-21T03:39:01.907199+0000 mon.a (mon.0) 11336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:02 smithi044 bash[22676]: cluster 2024-09-21T03:39:02.150316+0000 mgr.a (mgr.14388) 14047 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:39:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:02 smithi179 bash[23186]: audit 2024-09-21T03:39:01.887784+0000 mon.a (mon.0) 11334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:02 smithi179 bash[23186]: audit 2024-09-21T03:39:01.896677+0000 mon.a (mon.0) 11335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:02 smithi179 bash[23186]: audit 2024-09-21T03:39:01.907199+0000 mon.a (mon.0) 11336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:02 smithi179 bash[23186]: cluster 2024-09-21T03:39:02.150316+0000 mgr.a (mgr.14388) 14047 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:39:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:02 smithi049 bash[23528]: audit 2024-09-21T03:39:01.887784+0000 mon.a (mon.0) 11334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:02 smithi049 bash[23528]: audit 2024-09-21T03:39:01.896677+0000 mon.a (mon.0) 11335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:02 smithi049 bash[23528]: audit 2024-09-21T03:39:01.907199+0000 mon.a (mon.0) 11336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:02 smithi049 bash[23528]: cluster 2024-09-21T03:39:02.150316+0000 mgr.a (mgr.14388) 14047 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:39:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:03.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:03.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:03.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:03.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:04.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:03 smithi044 bash[22676]: audit 2024-09-21T03:39:03.384917+0000 mgr.a (mgr.14388) 14048 : audit [DBG] from='client.305154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:04.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:03 smithi179 bash[23186]: audit 2024-09-21T03:39:03.384917+0000 mgr.a (mgr.14388) 14048 : audit [DBG] from='client.305154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:03 smithi049 bash[23528]: audit 2024-09-21T03:39:03.384917+0000 mgr.a (mgr.14388) 14048 : audit [DBG] from='client.305154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:04 smithi044 bash[22676]: cluster 2024-09-21T03:39:04.151306+0000 mgr.a (mgr.14388) 14049 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:04 smithi179 bash[23186]: cluster 2024-09-21T03:39:04.151306+0000 mgr.a (mgr.14388) 14049 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:04 smithi049 bash[23528]: cluster 2024-09-21T03:39:04.151306+0000 mgr.a (mgr.14388) 14049 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:07 smithi044 bash[22676]: cluster 2024-09-21T03:39:06.153776+0000 mgr.a (mgr.14388) 14050 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:07 smithi049 bash[23528]: cluster 2024-09-21T03:39:06.153776+0000 mgr.a (mgr.14388) 14050 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:07 smithi179 bash[23186]: cluster 2024-09-21T03:39:06.153776+0000 mgr.a (mgr.14388) 14050 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:08.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:39:08 smithi044 bash[22930]: debug 2024-09-21T03:39:08.243+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:39:08.487 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:39:08 smithi044 bash[22930]: debug 2024-09-21T03:39:08.247+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:39:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:08 smithi044 bash[22676]: audit 2024-09-21T03:39:07.433135+0000 mon.a (mon.0) 11337 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:39:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:08 smithi044 bash[22676]: audit 2024-09-21T03:39:07.439373+0000 mon.a (mon.0) 11338 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:39:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:08 smithi044 bash[22676]: audit 2024-09-21T03:39:07.441110+0000 mon.a (mon.0) 11339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:39:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:08 smithi044 bash[22676]: audit 2024-09-21T03:39:07.451794+0000 mon.a (mon.0) 11340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:08 smithi044 bash[22676]: audit 2024-09-21T03:39:07.458249+0000 mon.a (mon.0) 11341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:39:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:08 smithi179 bash[23186]: audit 2024-09-21T03:39:07.433135+0000 mon.a (mon.0) 11337 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:39:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:08 smithi179 bash[23186]: audit 2024-09-21T03:39:07.439373+0000 mon.a (mon.0) 11338 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:39:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:08 smithi179 bash[23186]: audit 2024-09-21T03:39:07.441110+0000 mon.a (mon.0) 11339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:39:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:08 smithi179 bash[23186]: audit 2024-09-21T03:39:07.451794+0000 mon.a (mon.0) 11340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:08 smithi179 bash[23186]: audit 2024-09-21T03:39:07.458249+0000 mon.a (mon.0) 11341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:39:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:08 smithi049 bash[23528]: audit 2024-09-21T03:39:07.433135+0000 mon.a (mon.0) 11337 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:39:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:08 smithi049 bash[23528]: audit 2024-09-21T03:39:07.439373+0000 mon.a (mon.0) 11338 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:39:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:08 smithi049 bash[23528]: audit 2024-09-21T03:39:07.441110+0000 mon.a (mon.0) 11339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:39:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:08 smithi049 bash[23528]: audit 2024-09-21T03:39:07.451794+0000 mon.a (mon.0) 11340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:08 smithi049 bash[23528]: audit 2024-09-21T03:39:07.458249+0000 mon.a (mon.0) 11341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:39:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:08.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:09 smithi044 bash[22676]: audit 2024-09-21T03:39:07.460674+0000 mgr.a (mgr.14388) 14051 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:39:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:09 smithi044 bash[22676]: cluster 2024-09-21T03:39:08.154377+0000 mgr.a (mgr.14388) 14052 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:09 smithi044 bash[22676]: audit 2024-09-21T03:39:08.248822+0000 mgr.a (mgr.14388) 14053 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:39:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:09 smithi044 bash[22676]: cephadm 2024-09-21T03:39:08.249955+0000 mgr.a (mgr.14388) 14054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:39:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:09 smithi179 bash[23186]: audit 2024-09-21T03:39:07.460674+0000 mgr.a (mgr.14388) 14051 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:39:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:09 smithi179 bash[23186]: cluster 2024-09-21T03:39:08.154377+0000 mgr.a (mgr.14388) 14052 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:09 smithi179 bash[23186]: audit 2024-09-21T03:39:08.248822+0000 mgr.a (mgr.14388) 14053 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:39:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:09 smithi179 bash[23186]: cephadm 2024-09-21T03:39:08.249955+0000 mgr.a (mgr.14388) 14054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:39:09.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:09 smithi049 bash[23528]: audit 2024-09-21T03:39:07.460674+0000 mgr.a (mgr.14388) 14051 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:39:09.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:09 smithi049 bash[23528]: cluster 2024-09-21T03:39:08.154377+0000 mgr.a (mgr.14388) 14052 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:09.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:09 smithi049 bash[23528]: audit 2024-09-21T03:39:08.248822+0000 mgr.a (mgr.14388) 14053 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:39:09.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:09 smithi049 bash[23528]: cephadm 2024-09-21T03:39:08.249955+0000 mgr.a (mgr.14388) 14054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:39:09.615 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:09.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:09.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:09.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:09.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:10 smithi044 bash[22676]: audit 2024-09-21T03:39:09.163310+0000 mgr.a (mgr.14388) 14055 : audit [DBG] from='client.305334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:10.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:10 smithi179 bash[23186]: audit 2024-09-21T03:39:09.163310+0000 mgr.a (mgr.14388) 14055 : audit [DBG] from='client.305334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:10 smithi049 bash[23528]: audit 2024-09-21T03:39:09.163310+0000 mgr.a (mgr.14388) 14055 : audit [DBG] from='client.305334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:11.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:11 smithi044 bash[22676]: cluster 2024-09-21T03:39:10.155925+0000 mgr.a (mgr.14388) 14056 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:39:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:11 smithi179 bash[23186]: cluster 2024-09-21T03:39:10.155925+0000 mgr.a (mgr.14388) 14056 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:39:11.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:11 smithi049 bash[23528]: cluster 2024-09-21T03:39:10.155925+0000 mgr.a (mgr.14388) 14056 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:39:13.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:13 smithi044 bash[22676]: cluster 2024-09-21T03:39:12.157675+0000 mgr.a (mgr.14388) 14057 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:13.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:13 smithi179 bash[23186]: cluster 2024-09-21T03:39:12.157675+0000 mgr.a (mgr.14388) 14057 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:13.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:13 smithi049 bash[23528]: cluster 2024-09-21T03:39:12.157675+0000 mgr.a (mgr.14388) 14057 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:14.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:14.617 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:14.618 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:14 smithi044 bash[22676]: audit 2024-09-21T03:39:13.835227+0000 mon.a (mon.0) 11342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:14 smithi044 bash[22676]: audit 2024-09-21T03:39:13.842662+0000 mon.a (mon.0) 11343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:14 smithi044 bash[22676]: audit 2024-09-21T03:39:13.853231+0000 mon.a (mon.0) 11344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:14 smithi044 bash[22676]: cluster 2024-09-21T03:39:14.158467+0000 mgr.a (mgr.14388) 14058 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:15.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:14 smithi044 bash[22676]: audit 2024-09-21T03:39:14.196237+0000 mon.a (mon.0) 11345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:14 smithi044 bash[22676]: audit 2024-09-21T03:39:14.204763+0000 mon.a (mon.0) 11346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:14 smithi044 bash[22676]: audit 2024-09-21T03:39:14.214887+0000 mon.a (mon.0) 11347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:14 smithi179 bash[23186]: audit 2024-09-21T03:39:13.835227+0000 mon.a (mon.0) 11342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:14 smithi179 bash[23186]: audit 2024-09-21T03:39:13.842662+0000 mon.a (mon.0) 11343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:14 smithi179 bash[23186]: audit 2024-09-21T03:39:13.853231+0000 mon.a (mon.0) 11344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:14 smithi179 bash[23186]: cluster 2024-09-21T03:39:14.158467+0000 mgr.a (mgr.14388) 14058 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:14 smithi179 bash[23186]: audit 2024-09-21T03:39:14.196237+0000 mon.a (mon.0) 11345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:14 smithi179 bash[23186]: audit 2024-09-21T03:39:14.204763+0000 mon.a (mon.0) 11346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:14 smithi179 bash[23186]: audit 2024-09-21T03:39:14.214887+0000 mon.a (mon.0) 11347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:14 smithi049 bash[23528]: audit 2024-09-21T03:39:13.835227+0000 mon.a (mon.0) 11342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:14 smithi049 bash[23528]: audit 2024-09-21T03:39:13.842662+0000 mon.a (mon.0) 11343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:14 smithi049 bash[23528]: audit 2024-09-21T03:39:13.853231+0000 mon.a (mon.0) 11344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:14 smithi049 bash[23528]: cluster 2024-09-21T03:39:14.158467+0000 mgr.a (mgr.14388) 14058 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:14 smithi049 bash[23528]: audit 2024-09-21T03:39:14.196237+0000 mon.a (mon.0) 11345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:14 smithi049 bash[23528]: audit 2024-09-21T03:39:14.204763+0000 mon.a (mon.0) 11346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:14 smithi049 bash[23528]: audit 2024-09-21T03:39:14.214887+0000 mon.a (mon.0) 11347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:15.392 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:15.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:15.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:15.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:15.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:16.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:15 smithi044 bash[22676]: audit 2024-09-21T03:39:14.953504+0000 mgr.a (mgr.14388) 14059 : audit [DBG] from='client.305409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:16.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:15 smithi179 bash[23186]: audit 2024-09-21T03:39:14.953504+0000 mgr.a (mgr.14388) 14059 : audit [DBG] from='client.305409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:15 smithi049 bash[23528]: audit 2024-09-21T03:39:14.953504+0000 mgr.a (mgr.14388) 14059 : audit [DBG] from='client.305409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:17.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:16 smithi044 bash[22676]: cluster 2024-09-21T03:39:16.161430+0000 mgr.a (mgr.14388) 14060 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:17.253 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:16 smithi179 bash[23186]: cluster 2024-09-21T03:39:16.161430+0000 mgr.a (mgr.14388) 14060 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:16 smithi049 bash[23528]: cluster 2024-09-21T03:39:16.161430+0000 mgr.a (mgr.14388) 14060 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:39:19.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:19 smithi044 bash[22676]: cluster 2024-09-21T03:39:18.162216+0000 mgr.a (mgr.14388) 14061 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:39:19.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:19 smithi179 bash[23186]: cluster 2024-09-21T03:39:18.162216+0000 mgr.a (mgr.14388) 14061 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:39:19.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:19 smithi049 bash[23528]: cluster 2024-09-21T03:39:18.162216+0000 mgr.a (mgr.14388) 14061 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:39:20.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:20.394 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:20.394 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:21.194 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:21.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:21.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:21.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:21.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:21 smithi044 bash[22676]: cluster 2024-09-21T03:39:20.163414+0000 mgr.a (mgr.14388) 14062 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:39:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:21 smithi179 bash[23186]: cluster 2024-09-21T03:39:20.163414+0000 mgr.a (mgr.14388) 14062 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:39:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:21 smithi049 bash[23528]: cluster 2024-09-21T03:39:20.163414+0000 mgr.a (mgr.14388) 14062 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:39:22.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:22 smithi044 bash[22676]: audit 2024-09-21T03:39:20.731972+0000 mgr.a (mgr.14388) 14063 : audit [DBG] from='client.305487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:22 smithi044 bash[22676]: audit 2024-09-21T03:39:22.122384+0000 mon.a (mon.0) 11348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:22 smithi044 bash[22676]: audit 2024-09-21T03:39:22.131286+0000 mon.a (mon.0) 11349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:22 smithi044 bash[22676]: audit 2024-09-21T03:39:22.141712+0000 mon.a (mon.0) 11350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:22 smithi179 bash[23186]: audit 2024-09-21T03:39:20.731972+0000 mgr.a (mgr.14388) 14063 : audit [DBG] from='client.305487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:22 smithi179 bash[23186]: audit 2024-09-21T03:39:22.122384+0000 mon.a (mon.0) 11348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:22 smithi179 bash[23186]: audit 2024-09-21T03:39:22.131286+0000 mon.a (mon.0) 11349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:22 smithi179 bash[23186]: audit 2024-09-21T03:39:22.141712+0000 mon.a (mon.0) 11350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:22 smithi049 bash[23528]: audit 2024-09-21T03:39:20.731972+0000 mgr.a (mgr.14388) 14063 : audit [DBG] from='client.305487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:22 smithi049 bash[23528]: audit 2024-09-21T03:39:22.122384+0000 mon.a (mon.0) 11348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:22 smithi049 bash[23528]: audit 2024-09-21T03:39:22.131286+0000 mon.a (mon.0) 11349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:22.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:22 smithi049 bash[23528]: audit 2024-09-21T03:39:22.141712+0000 mon.a (mon.0) 11350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:23.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:23 smithi044 bash[22676]: cluster 2024-09-21T03:39:22.165754+0000 mgr.a (mgr.14388) 14064 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T03:39:23.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:23 smithi179 bash[23186]: cluster 2024-09-21T03:39:22.165754+0000 mgr.a (mgr.14388) 14064 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T03:39:23.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:23 smithi049 bash[23528]: cluster 2024-09-21T03:39:22.165754+0000 mgr.a (mgr.14388) 14064 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T03:39:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:25 smithi044 bash[22676]: cluster 2024-09-21T03:39:24.166557+0000 mgr.a (mgr.14388) 14065 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:39:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:25 smithi179 bash[23186]: cluster 2024-09-21T03:39:24.166557+0000 mgr.a (mgr.14388) 14065 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:39:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:25 smithi049 bash[23528]: cluster 2024-09-21T03:39:24.166557+0000 mgr.a (mgr.14388) 14065 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:39:26.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:26.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:26.977 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:27.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:27 smithi044 bash[22676]: cluster 2024-09-21T03:39:26.168647+0000 mgr.a (mgr.14388) 14066 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:27.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:27 smithi179 bash[23186]: cluster 2024-09-21T03:39:26.168647+0000 mgr.a (mgr.14388) 14066 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:27 smithi049 bash[23528]: cluster 2024-09-21T03:39:26.168647+0000 mgr.a (mgr.14388) 14066 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:28.503 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:28 smithi179 bash[23186]: audit 2024-09-21T03:39:26.533270+0000 mgr.a (mgr.14388) 14067 : audit [DBG] from='client.305562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:28.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:28 smithi049 bash[23528]: audit 2024-09-21T03:39:26.533270+0000 mgr.a (mgr.14388) 14067 : audit [DBG] from='client.305562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:28.597 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:28 smithi044 bash[22676]: audit 2024-09-21T03:39:26.533270+0000 mgr.a (mgr.14388) 14067 : audit [DBG] from='client.305562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:29.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:29 smithi179 bash[23186]: cluster 2024-09-21T03:39:28.169807+0000 mgr.a (mgr.14388) 14068 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:39:29.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:29 smithi044 bash[22676]: cluster 2024-09-21T03:39:28.169807+0000 mgr.a (mgr.14388) 14068 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:39:29.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:29 smithi049 bash[23528]: cluster 2024-09-21T03:39:28.169807+0000 mgr.a (mgr.14388) 14068 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:39:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:31 smithi179 bash[23186]: cluster 2024-09-21T03:39:30.171389+0000 mgr.a (mgr.14388) 14069 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-21T03:39:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:31 smithi049 bash[23528]: cluster 2024-09-21T03:39:30.171389+0000 mgr.a (mgr.14388) 14069 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-21T03:39:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:31 smithi044 bash[22676]: cluster 2024-09-21T03:39:30.171389+0000 mgr.a (mgr.14388) 14069 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-21T03:39:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:31.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:31.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:32.750 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:32.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:32.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:32.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:32.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:33 smithi049 bash[23528]: cluster 2024-09-21T03:39:32.173084+0000 mgr.a (mgr.14388) 14070 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:39:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:33 smithi049 bash[23528]: audit 2024-09-21T03:39:32.311183+0000 mgr.a (mgr.14388) 14071 : audit [DBG] from='client.305640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:33 smithi044 bash[22676]: cluster 2024-09-21T03:39:32.173084+0000 mgr.a (mgr.14388) 14070 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:39:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:33 smithi044 bash[22676]: audit 2024-09-21T03:39:32.311183+0000 mgr.a (mgr.14388) 14071 : audit [DBG] from='client.305640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:33.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:33 smithi179 bash[23186]: cluster 2024-09-21T03:39:32.173084+0000 mgr.a (mgr.14388) 14070 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:39:33.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:33 smithi179 bash[23186]: audit 2024-09-21T03:39:32.311183+0000 mgr.a (mgr.14388) 14071 : audit [DBG] from='client.305640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:35.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:35 smithi044 bash[22676]: audit 2024-09-21T03:39:34.059010+0000 mon.a (mon.0) 11351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:35 smithi044 bash[22676]: audit 2024-09-21T03:39:34.067621+0000 mon.a (mon.0) 11352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:35 smithi044 bash[22676]: audit 2024-09-21T03:39:34.078464+0000 mon.a (mon.0) 11353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:35 smithi044 bash[22676]: cluster 2024-09-21T03:39:34.174026+0000 mgr.a (mgr.14388) 14072 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:35 smithi044 bash[22676]: audit 2024-09-21T03:39:34.425146+0000 mon.a (mon.0) 11354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:35 smithi044 bash[22676]: audit 2024-09-21T03:39:34.434002+0000 mon.a (mon.0) 11355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:35 smithi044 bash[22676]: audit 2024-09-21T03:39:34.444583+0000 mon.a (mon.0) 11356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:35 smithi179 bash[23186]: audit 2024-09-21T03:39:34.059010+0000 mon.a (mon.0) 11351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:35 smithi179 bash[23186]: audit 2024-09-21T03:39:34.067621+0000 mon.a (mon.0) 11352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:35 smithi179 bash[23186]: audit 2024-09-21T03:39:34.078464+0000 mon.a (mon.0) 11353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:35 smithi179 bash[23186]: cluster 2024-09-21T03:39:34.174026+0000 mgr.a (mgr.14388) 14072 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:35 smithi179 bash[23186]: audit 2024-09-21T03:39:34.425146+0000 mon.a (mon.0) 11354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:35 smithi179 bash[23186]: audit 2024-09-21T03:39:34.434002+0000 mon.a (mon.0) 11355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:35 smithi179 bash[23186]: audit 2024-09-21T03:39:34.444583+0000 mon.a (mon.0) 11356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:35 smithi049 bash[23528]: audit 2024-09-21T03:39:34.059010+0000 mon.a (mon.0) 11351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:35 smithi049 bash[23528]: audit 2024-09-21T03:39:34.067621+0000 mon.a (mon.0) 11352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:35 smithi049 bash[23528]: audit 2024-09-21T03:39:34.078464+0000 mon.a (mon.0) 11353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:35 smithi049 bash[23528]: cluster 2024-09-21T03:39:34.174026+0000 mgr.a (mgr.14388) 14072 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:35 smithi049 bash[23528]: audit 2024-09-21T03:39:34.425146+0000 mon.a (mon.0) 11354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:35 smithi049 bash[23528]: audit 2024-09-21T03:39:34.434002+0000 mon.a (mon.0) 11355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:35 smithi049 bash[23528]: audit 2024-09-21T03:39:34.444583+0000 mon.a (mon.0) 11356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:37 smithi044 bash[22676]: cluster 2024-09-21T03:39:36.176196+0000 mgr.a (mgr.14388) 14073 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:37 smithi179 bash[23186]: cluster 2024-09-21T03:39:36.176196+0000 mgr.a (mgr.14388) 14073 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:37 smithi049 bash[23528]: cluster 2024-09-21T03:39:36.176196+0000 mgr.a (mgr.14388) 14073 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:37.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:38.508 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:38.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:38.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:38.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:38.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:39 smithi044 bash[22676]: audit 2024-09-21T03:39:38.076779+0000 mgr.a (mgr.14388) 14074 : audit [DBG] from='client.305718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:39 smithi044 bash[22676]: cluster 2024-09-21T03:39:38.176686+0000 mgr.a (mgr.14388) 14075 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:39 smithi179 bash[23186]: audit 2024-09-21T03:39:38.076779+0000 mgr.a (mgr.14388) 14074 : audit [DBG] from='client.305718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:39 smithi179 bash[23186]: cluster 2024-09-21T03:39:38.176686+0000 mgr.a (mgr.14388) 14075 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:39 smithi049 bash[23528]: audit 2024-09-21T03:39:38.076779+0000 mgr.a (mgr.14388) 14074 : audit [DBG] from='client.305718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:39 smithi049 bash[23528]: cluster 2024-09-21T03:39:38.176686+0000 mgr.a (mgr.14388) 14075 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:41 smithi179 bash[23186]: cluster 2024-09-21T03:39:40.178115+0000 mgr.a (mgr.14388) 14076 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:39:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:41 smithi049 bash[23528]: cluster 2024-09-21T03:39:40.178115+0000 mgr.a (mgr.14388) 14076 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:39:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:41 smithi044 bash[22676]: cluster 2024-09-21T03:39:40.178115+0000 mgr.a (mgr.14388) 14076 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:39:43.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:43.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:43.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:43 smithi044 bash[22676]: cluster 2024-09-21T03:39:42.179826+0000 mgr.a (mgr.14388) 14077 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:39:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:43 smithi044 bash[22676]: audit 2024-09-21T03:39:42.358690+0000 mon.a (mon.0) 11357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:43 smithi044 bash[22676]: audit 2024-09-21T03:39:42.367374+0000 mon.a (mon.0) 11358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:43 smithi044 bash[22676]: audit 2024-09-21T03:39:42.378261+0000 mon.a (mon.0) 11359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:43 smithi179 bash[23186]: cluster 2024-09-21T03:39:42.179826+0000 mgr.a (mgr.14388) 14077 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:39:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:43 smithi179 bash[23186]: audit 2024-09-21T03:39:42.358690+0000 mon.a (mon.0) 11357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:43 smithi179 bash[23186]: audit 2024-09-21T03:39:42.367374+0000 mon.a (mon.0) 11358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:43 smithi179 bash[23186]: audit 2024-09-21T03:39:42.378261+0000 mon.a (mon.0) 11359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:43 smithi049 bash[23528]: cluster 2024-09-21T03:39:42.179826+0000 mgr.a (mgr.14388) 14077 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:39:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:43 smithi049 bash[23528]: audit 2024-09-21T03:39:42.358690+0000 mon.a (mon.0) 11357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:43 smithi049 bash[23528]: audit 2024-09-21T03:39:42.367374+0000 mon.a (mon.0) 11358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:43 smithi049 bash[23528]: audit 2024-09-21T03:39:42.378261+0000 mon.a (mon.0) 11359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:44.303 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:45 smithi044 bash[22676]: audit 2024-09-21T03:39:43.846167+0000 mgr.a (mgr.14388) 14078 : audit [DBG] from='client.305793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:45 smithi044 bash[22676]: cluster 2024-09-21T03:39:44.180359+0000 mgr.a (mgr.14388) 14079 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:45 smithi179 bash[23186]: audit 2024-09-21T03:39:43.846167+0000 mgr.a (mgr.14388) 14078 : audit [DBG] from='client.305793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:45 smithi179 bash[23186]: cluster 2024-09-21T03:39:44.180359+0000 mgr.a (mgr.14388) 14079 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:45 smithi049 bash[23528]: audit 2024-09-21T03:39:43.846167+0000 mgr.a (mgr.14388) 14078 : audit [DBG] from='client.305793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:45 smithi049 bash[23528]: cluster 2024-09-21T03:39:44.180359+0000 mgr.a (mgr.14388) 14079 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:47 smithi044 bash[22676]: cluster 2024-09-21T03:39:46.182707+0000 mgr.a (mgr.14388) 14080 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:47 smithi179 bash[23186]: cluster 2024-09-21T03:39:46.182707+0000 mgr.a (mgr.14388) 14080 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:47 smithi049 bash[23528]: cluster 2024-09-21T03:39:46.182707+0000 mgr.a (mgr.14388) 14080 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:39:49.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:49.304 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:49.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:49 smithi179 bash[23186]: cluster 2024-09-21T03:39:48.183503+0000 mgr.a (mgr.14388) 14081 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:49.679 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:49 smithi044 bash[22676]: cluster 2024-09-21T03:39:48.183503+0000 mgr.a (mgr.14388) 14081 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:49 smithi049 bash[23528]: cluster 2024-09-21T03:39:48.183503+0000 mgr.a (mgr.14388) 14081 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:50.094 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:51.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:51 smithi049 bash[23528]: audit 2024-09-21T03:39:49.649764+0000 mgr.a (mgr.14388) 14082 : audit [DBG] from='client.305871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:51.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:51 smithi049 bash[23528]: cluster 2024-09-21T03:39:50.184464+0000 mgr.a (mgr.14388) 14083 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-21T03:39:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:51 smithi044 bash[22676]: audit 2024-09-21T03:39:49.649764+0000 mgr.a (mgr.14388) 14082 : audit [DBG] from='client.305871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:51 smithi044 bash[22676]: cluster 2024-09-21T03:39:50.184464+0000 mgr.a (mgr.14388) 14083 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-21T03:39:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:51 smithi179 bash[23186]: audit 2024-09-21T03:39:49.649764+0000 mgr.a (mgr.14388) 14082 : audit [DBG] from='client.305871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:51 smithi179 bash[23186]: cluster 2024-09-21T03:39:50.184464+0000 mgr.a (mgr.14388) 14083 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-21T03:39:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:53 smithi044 bash[22676]: cluster 2024-09-21T03:39:52.186187+0000 mgr.a (mgr.14388) 14084 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:53 smithi179 bash[23186]: cluster 2024-09-21T03:39:52.186187+0000 mgr.a (mgr.14388) 14084 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:53 smithi049 bash[23528]: cluster 2024-09-21T03:39:52.186187+0000 mgr.a (mgr.14388) 14084 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:55.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:39:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:39:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:39:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:55 smithi049 bash[23528]: cluster 2024-09-21T03:39:54.186952+0000 mgr.a (mgr.14388) 14085 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:39:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:55 smithi049 bash[23528]: audit 2024-09-21T03:39:54.297904+0000 mon.a (mon.0) 11360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:55 smithi049 bash[23528]: audit 2024-09-21T03:39:54.306623+0000 mon.a (mon.0) 11361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:55 smithi049 bash[23528]: audit 2024-09-21T03:39:54.317179+0000 mon.a (mon.0) 11362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:55 smithi049 bash[23528]: audit 2024-09-21T03:39:54.655826+0000 mon.a (mon.0) 11363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:55 smithi049 bash[23528]: audit 2024-09-21T03:39:54.664157+0000 mon.a (mon.0) 11364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:55 smithi049 bash[23528]: audit 2024-09-21T03:39:54.674763+0000 mon.a (mon.0) 11365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:55 smithi044 bash[22676]: cluster 2024-09-21T03:39:54.186952+0000 mgr.a (mgr.14388) 14085 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:39:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:55 smithi044 bash[22676]: audit 2024-09-21T03:39:54.297904+0000 mon.a (mon.0) 11360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:55 smithi044 bash[22676]: audit 2024-09-21T03:39:54.306623+0000 mon.a (mon.0) 11361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:55 smithi044 bash[22676]: audit 2024-09-21T03:39:54.317179+0000 mon.a (mon.0) 11362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:55 smithi044 bash[22676]: audit 2024-09-21T03:39:54.655826+0000 mon.a (mon.0) 11363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:55 smithi044 bash[22676]: audit 2024-09-21T03:39:54.664157+0000 mon.a (mon.0) 11364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:55 smithi044 bash[22676]: audit 2024-09-21T03:39:54.674763+0000 mon.a (mon.0) 11365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:55 smithi179 bash[23186]: cluster 2024-09-21T03:39:54.186952+0000 mgr.a (mgr.14388) 14085 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:39:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:55 smithi179 bash[23186]: audit 2024-09-21T03:39:54.297904+0000 mon.a (mon.0) 11360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:55 smithi179 bash[23186]: audit 2024-09-21T03:39:54.306623+0000 mon.a (mon.0) 11361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:55 smithi179 bash[23186]: audit 2024-09-21T03:39:54.317179+0000 mon.a (mon.0) 11362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:55 smithi179 bash[23186]: audit 2024-09-21T03:39:54.655826+0000 mon.a (mon.0) 11363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:55 smithi179 bash[23186]: audit 2024-09-21T03:39:54.664157+0000 mon.a (mon.0) 11364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:55 smithi179 bash[23186]: audit 2024-09-21T03:39:54.674763+0000 mon.a (mon.0) 11365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:39:55.876 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:39:55.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:39:55.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:39:55.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:39:55.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:39:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:56 smithi044 bash[22676]: audit 2024-09-21T03:39:55.430226+0000 mgr.a (mgr.14388) 14086 : audit [DBG] from='client.305946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:56 smithi179 bash[23186]: audit 2024-09-21T03:39:55.430226+0000 mgr.a (mgr.14388) 14086 : audit [DBG] from='client.305946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:56 smithi049 bash[23528]: audit 2024-09-21T03:39:55.430226+0000 mgr.a (mgr.14388) 14086 : audit [DBG] from='client.305946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:57 smithi044 bash[22676]: cluster 2024-09-21T03:39:56.189834+0000 mgr.a (mgr.14388) 14087 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:57 smithi179 bash[23186]: cluster 2024-09-21T03:39:56.189834+0000 mgr.a (mgr.14388) 14087 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:57 smithi049 bash[23528]: cluster 2024-09-21T03:39:56.189834+0000 mgr.a (mgr.14388) 14087 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:39:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:39:59 smithi044 bash[22676]: cluster 2024-09-21T03:39:58.190617+0000 mgr.a (mgr.14388) 14088 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:39:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:39:59 smithi179 bash[23186]: cluster 2024-09-21T03:39:58.190617+0000 mgr.a (mgr.14388) 14088 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:39:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:39:59 smithi049 bash[23528]: cluster 2024-09-21T03:39:58.190617+0000 mgr.a (mgr.14388) 14088 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:40:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:00 smithi044 bash[22676]: cluster 2024-09-21T03:40:00.000152+0000 mon.a (mon.0) 11366 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:40:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:00 smithi179 bash[23186]: cluster 2024-09-21T03:40:00.000152+0000 mon.a (mon.0) 11366 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:40:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:00 smithi049 bash[23528]: cluster 2024-09-21T03:40:00.000152+0000 mon.a (mon.0) 11366 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:40:00.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:00.879 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:00.879 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:01.657 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:01.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:01.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:01.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:01.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:01 smithi044 bash[22676]: cluster 2024-09-21T03:40:00.191801+0000 mgr.a (mgr.14388) 14089 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:40:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:01 smithi179 bash[23186]: cluster 2024-09-21T03:40:00.191801+0000 mgr.a (mgr.14388) 14089 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:40:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:01 smithi049 bash[23528]: cluster 2024-09-21T03:40:00.191801+0000 mgr.a (mgr.14388) 14089 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:40:02.619 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:02 smithi049 bash[23528]: audit 2024-09-21T03:40:01.218510+0000 mgr.a (mgr.14388) 14090 : audit [DBG] from='client.306024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:02 smithi044 bash[22676]: audit 2024-09-21T03:40:01.218510+0000 mgr.a (mgr.14388) 14090 : audit [DBG] from='client.306024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:02 smithi179 bash[23186]: audit 2024-09-21T03:40:01.218510+0000 mgr.a (mgr.14388) 14090 : audit [DBG] from='client.306024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:03 smithi044 bash[22676]: cluster 2024-09-21T03:40:02.194232+0000 mgr.a (mgr.14388) 14091 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:40:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:03 smithi044 bash[22676]: audit 2024-09-21T03:40:02.597285+0000 mon.a (mon.0) 11367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:03 smithi044 bash[22676]: audit 2024-09-21T03:40:02.605786+0000 mon.a (mon.0) 11368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:03 smithi044 bash[22676]: audit 2024-09-21T03:40:02.616373+0000 mon.a (mon.0) 11369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:03 smithi179 bash[23186]: cluster 2024-09-21T03:40:02.194232+0000 mgr.a (mgr.14388) 14091 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:40:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:03 smithi179 bash[23186]: audit 2024-09-21T03:40:02.597285+0000 mon.a (mon.0) 11367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:03 smithi179 bash[23186]: audit 2024-09-21T03:40:02.605786+0000 mon.a (mon.0) 11368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:03 smithi179 bash[23186]: audit 2024-09-21T03:40:02.616373+0000 mon.a (mon.0) 11369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:03 smithi049 bash[23528]: cluster 2024-09-21T03:40:02.194232+0000 mgr.a (mgr.14388) 14091 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:40:03.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:03 smithi049 bash[23528]: audit 2024-09-21T03:40:02.597285+0000 mon.a (mon.0) 11367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:03 smithi049 bash[23528]: audit 2024-09-21T03:40:02.605786+0000 mon.a (mon.0) 11368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:03.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:03 smithi049 bash[23528]: audit 2024-09-21T03:40:02.616373+0000 mon.a (mon.0) 11369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:05 smithi044 bash[22676]: cluster 2024-09-21T03:40:04.195043+0000 mgr.a (mgr.14388) 14092 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:40:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:05 smithi179 bash[23186]: cluster 2024-09-21T03:40:04.195043+0000 mgr.a (mgr.14388) 14092 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:40:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:05 smithi049 bash[23528]: cluster 2024-09-21T03:40:04.195043+0000 mgr.a (mgr.14388) 14092 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:40:06.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:06.659 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:06.659 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:07.413 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:07.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:07.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:07.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:07.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:07.451 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:07 smithi044 bash[22676]: cluster 2024-09-21T03:40:06.196346+0000 mgr.a (mgr.14388) 14093 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:40:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:07 smithi179 bash[23186]: cluster 2024-09-21T03:40:06.196346+0000 mgr.a (mgr.14388) 14093 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:40:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:07 smithi049 bash[23528]: cluster 2024-09-21T03:40:06.196346+0000 mgr.a (mgr.14388) 14093 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:40:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:08 smithi179 bash[23186]: audit 2024-09-21T03:40:06.986260+0000 mgr.a (mgr.14388) 14094 : audit [DBG] from='client.306099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:08 smithi179 bash[23186]: audit 2024-09-21T03:40:08.308419+0000 mon.a (mon.0) 11370 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:40:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:08 smithi179 bash[23186]: audit 2024-09-21T03:40:08.315638+0000 mon.a (mon.0) 11371 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:40:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:08 smithi179 bash[23186]: audit 2024-09-21T03:40:08.317583+0000 mon.a (mon.0) 11372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:40:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:08 smithi179 bash[23186]: audit 2024-09-21T03:40:08.329440+0000 mon.a (mon.0) 11373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:08 smithi179 bash[23186]: audit 2024-09-21T03:40:08.333292+0000 mon.a (mon.0) 11374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:40:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:08 smithi044 bash[22676]: audit 2024-09-21T03:40:06.986260+0000 mgr.a (mgr.14388) 14094 : audit [DBG] from='client.306099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:08 smithi044 bash[22676]: audit 2024-09-21T03:40:08.308419+0000 mon.a (mon.0) 11370 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:40:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:08 smithi044 bash[22676]: audit 2024-09-21T03:40:08.315638+0000 mon.a (mon.0) 11371 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:40:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:08 smithi044 bash[22676]: audit 2024-09-21T03:40:08.317583+0000 mon.a (mon.0) 11372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:40:08.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:08 smithi044 bash[22676]: audit 2024-09-21T03:40:08.329440+0000 mon.a (mon.0) 11373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:08 smithi044 bash[22676]: audit 2024-09-21T03:40:08.333292+0000 mon.a (mon.0) 11374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:40:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:08 smithi049 bash[23528]: audit 2024-09-21T03:40:06.986260+0000 mgr.a (mgr.14388) 14094 : audit [DBG] from='client.306099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:08 smithi049 bash[23528]: audit 2024-09-21T03:40:08.308419+0000 mon.a (mon.0) 11370 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:40:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:08 smithi049 bash[23528]: audit 2024-09-21T03:40:08.315638+0000 mon.a (mon.0) 11371 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:40:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:08 smithi049 bash[23528]: audit 2024-09-21T03:40:08.317583+0000 mon.a (mon.0) 11372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:40:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:08 smithi049 bash[23528]: audit 2024-09-21T03:40:08.329440+0000 mon.a (mon.0) 11373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:08 smithi049 bash[23528]: audit 2024-09-21T03:40:08.333292+0000 mon.a (mon.0) 11374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:40:09.354 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:40:09 smithi044 bash[22930]: debug 2024-09-21T03:40:09.090+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:40:09.354 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:40:09 smithi044 bash[22930]: debug 2024-09-21T03:40:09.090+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:40:09.577 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:09 smithi179 bash[23186]: cluster 2024-09-21T03:40:08.197505+0000 mgr.a (mgr.14388) 14095 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:09.577 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:09 smithi179 bash[23186]: audit 2024-09-21T03:40:08.336071+0000 mgr.a (mgr.14388) 14096 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:40:09.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:09 smithi044 bash[22676]: cluster 2024-09-21T03:40:08.197505+0000 mgr.a (mgr.14388) 14095 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:09.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:09 smithi044 bash[22676]: audit 2024-09-21T03:40:08.336071+0000 mgr.a (mgr.14388) 14096 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:40:09.731 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:09 smithi049 bash[23528]: cluster 2024-09-21T03:40:08.197505+0000 mgr.a (mgr.14388) 14095 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:09.731 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:09 smithi049 bash[23528]: audit 2024-09-21T03:40:08.336071+0000 mgr.a (mgr.14388) 14096 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:40:10.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:10 smithi179 bash[23186]: audit 2024-09-21T03:40:09.094122+0000 mgr.a (mgr.14388) 14097 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:40:10.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:10 smithi179 bash[23186]: cephadm 2024-09-21T03:40:09.095299+0000 mgr.a (mgr.14388) 14098 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:40:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:10 smithi044 bash[22676]: audit 2024-09-21T03:40:09.094122+0000 mgr.a (mgr.14388) 14097 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:40:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:10 smithi044 bash[22676]: cephadm 2024-09-21T03:40:09.095299+0000 mgr.a (mgr.14388) 14098 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:40:10.748 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:10 smithi049 bash[23528]: audit 2024-09-21T03:40:09.094122+0000 mgr.a (mgr.14388) 14097 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:40:10.748 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:10 smithi049 bash[23528]: cephadm 2024-09-21T03:40:09.095299+0000 mgr.a (mgr.14388) 14098 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:40:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:11 smithi044 bash[22676]: cluster 2024-09-21T03:40:10.198768+0000 mgr.a (mgr.14388) 14099 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:40:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:11 smithi179 bash[23186]: cluster 2024-09-21T03:40:10.198768+0000 mgr.a (mgr.14388) 14099 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:40:11.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:11 smithi049 bash[23528]: cluster 2024-09-21T03:40:10.198768+0000 mgr.a (mgr.14388) 14099 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-21T03:40:12.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:12.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:12.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:13.159 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:13.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:13.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:13.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:13.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:13 smithi044 bash[22676]: cluster 2024-09-21T03:40:12.200465+0000 mgr.a (mgr.14388) 14100 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:13 smithi179 bash[23186]: cluster 2024-09-21T03:40:12.200465+0000 mgr.a (mgr.14388) 14100 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:13 smithi049 bash[23528]: cluster 2024-09-21T03:40:12.200465+0000 mgr.a (mgr.14388) 14100 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:14.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:14 smithi044 bash[22676]: audit 2024-09-21T03:40:12.744225+0000 mgr.a (mgr.14388) 14101 : audit [DBG] from='client.306282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:14 smithi179 bash[23186]: audit 2024-09-21T03:40:12.744225+0000 mgr.a (mgr.14388) 14101 : audit [DBG] from='client.306282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:14 smithi049 bash[23528]: audit 2024-09-21T03:40:12.744225+0000 mgr.a (mgr.14388) 14101 : audit [DBG] from='client.306282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:15 smithi044 bash[22676]: cluster 2024-09-21T03:40:14.201494+0000 mgr.a (mgr.14388) 14102 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:15 smithi044 bash[22676]: audit 2024-09-21T03:40:14.533308+0000 mon.a (mon.0) 11375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:15 smithi044 bash[22676]: audit 2024-09-21T03:40:14.542407+0000 mon.a (mon.0) 11376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:15 smithi044 bash[22676]: audit 2024-09-21T03:40:14.552804+0000 mon.a (mon.0) 11377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:15 smithi044 bash[22676]: audit 2024-09-21T03:40:14.886701+0000 mon.a (mon.0) 11378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:15 smithi044 bash[22676]: audit 2024-09-21T03:40:14.895030+0000 mon.a (mon.0) 11379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:15 smithi044 bash[22676]: audit 2024-09-21T03:40:14.905475+0000 mon.a (mon.0) 11380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:15 smithi179 bash[23186]: cluster 2024-09-21T03:40:14.201494+0000 mgr.a (mgr.14388) 14102 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:15 smithi179 bash[23186]: audit 2024-09-21T03:40:14.533308+0000 mon.a (mon.0) 11375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:15 smithi179 bash[23186]: audit 2024-09-21T03:40:14.542407+0000 mon.a (mon.0) 11376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:15 smithi179 bash[23186]: audit 2024-09-21T03:40:14.552804+0000 mon.a (mon.0) 11377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:15 smithi179 bash[23186]: audit 2024-09-21T03:40:14.886701+0000 mon.a (mon.0) 11378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:15 smithi179 bash[23186]: audit 2024-09-21T03:40:14.895030+0000 mon.a (mon.0) 11379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:15 smithi179 bash[23186]: audit 2024-09-21T03:40:14.905475+0000 mon.a (mon.0) 11380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:15 smithi049 bash[23528]: cluster 2024-09-21T03:40:14.201494+0000 mgr.a (mgr.14388) 14102 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:15 smithi049 bash[23528]: audit 2024-09-21T03:40:14.533308+0000 mon.a (mon.0) 11375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:15 smithi049 bash[23528]: audit 2024-09-21T03:40:14.542407+0000 mon.a (mon.0) 11376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:15 smithi049 bash[23528]: audit 2024-09-21T03:40:14.552804+0000 mon.a (mon.0) 11377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:15 smithi049 bash[23528]: audit 2024-09-21T03:40:14.886701+0000 mon.a (mon.0) 11378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:15 smithi049 bash[23528]: audit 2024-09-21T03:40:14.895030+0000 mon.a (mon.0) 11379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:15 smithi049 bash[23528]: audit 2024-09-21T03:40:14.905475+0000 mon.a (mon.0) 11380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:17 smithi044 bash[22676]: cluster 2024-09-21T03:40:16.203769+0000 mgr.a (mgr.14388) 14103 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:17 smithi179 bash[23186]: cluster 2024-09-21T03:40:16.203769+0000 mgr.a (mgr.14388) 14103 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:17 smithi049 bash[23528]: cluster 2024-09-21T03:40:16.203769+0000 mgr.a (mgr.14388) 14103 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:18.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:18.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:18.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:18.918 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:18.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:19 smithi044 bash[22676]: cluster 2024-09-21T03:40:18.204543+0000 mgr.a (mgr.14388) 14104 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:19 smithi179 bash[23186]: cluster 2024-09-21T03:40:18.204543+0000 mgr.a (mgr.14388) 14104 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:19 smithi049 bash[23528]: cluster 2024-09-21T03:40:18.204543+0000 mgr.a (mgr.14388) 14104 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:20 smithi044 bash[22676]: audit 2024-09-21T03:40:18.489832+0000 mgr.a (mgr.14388) 14105 : audit [DBG] from='client.306357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:20 smithi179 bash[23186]: audit 2024-09-21T03:40:18.489832+0000 mgr.a (mgr.14388) 14105 : audit [DBG] from='client.306357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:20 smithi049 bash[23528]: audit 2024-09-21T03:40:18.489832+0000 mgr.a (mgr.14388) 14105 : audit [DBG] from='client.306357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:21 smithi044 bash[22676]: cluster 2024-09-21T03:40:20.206071+0000 mgr.a (mgr.14388) 14106 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:21 smithi179 bash[23186]: cluster 2024-09-21T03:40:20.206071+0000 mgr.a (mgr.14388) 14106 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:21 smithi049 bash[23528]: cluster 2024-09-21T03:40:20.206071+0000 mgr.a (mgr.14388) 14106 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:40:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:23 smithi044 bash[22676]: cluster 2024-09-21T03:40:22.207762+0000 mgr.a (mgr.14388) 14107 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:40:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:23 smithi044 bash[22676]: audit 2024-09-21T03:40:22.834693+0000 mon.a (mon.0) 11381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:23 smithi044 bash[22676]: audit 2024-09-21T03:40:22.844089+0000 mon.a (mon.0) 11382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:23 smithi044 bash[22676]: audit 2024-09-21T03:40:22.854817+0000 mon.a (mon.0) 11383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:23 smithi179 bash[23186]: cluster 2024-09-21T03:40:22.207762+0000 mgr.a (mgr.14388) 14107 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:40:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:23 smithi179 bash[23186]: audit 2024-09-21T03:40:22.834693+0000 mon.a (mon.0) 11381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:23 smithi179 bash[23186]: audit 2024-09-21T03:40:22.844089+0000 mon.a (mon.0) 11382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:23 smithi179 bash[23186]: audit 2024-09-21T03:40:22.854817+0000 mon.a (mon.0) 11383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:23 smithi049 bash[23528]: cluster 2024-09-21T03:40:22.207762+0000 mgr.a (mgr.14388) 14107 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:40:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:23 smithi049 bash[23528]: audit 2024-09-21T03:40:22.834693+0000 mon.a (mon.0) 11381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:23 smithi049 bash[23528]: audit 2024-09-21T03:40:22.844089+0000 mon.a (mon.0) 11382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:23 smithi049 bash[23528]: audit 2024-09-21T03:40:22.854817+0000 mon.a (mon.0) 11383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:23.920 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:23.920 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:24.675 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:25 smithi044 bash[22676]: cluster 2024-09-21T03:40:24.208498+0000 mgr.a (mgr.14388) 14108 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:25 smithi044 bash[22676]: audit 2024-09-21T03:40:24.256365+0000 mgr.a (mgr.14388) 14109 : audit [DBG] from='client.306435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:25 smithi179 bash[23186]: cluster 2024-09-21T03:40:24.208498+0000 mgr.a (mgr.14388) 14108 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:25 smithi179 bash[23186]: audit 2024-09-21T03:40:24.256365+0000 mgr.a (mgr.14388) 14109 : audit [DBG] from='client.306435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:25 smithi049 bash[23528]: cluster 2024-09-21T03:40:24.208498+0000 mgr.a (mgr.14388) 14108 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:25 smithi049 bash[23528]: audit 2024-09-21T03:40:24.256365+0000 mgr.a (mgr.14388) 14109 : audit [DBG] from='client.306435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:27.567 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:27 smithi044 bash[22676]: cluster 2024-09-21T03:40:26.210903+0000 mgr.a (mgr.14388) 14110 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:27 smithi179 bash[23186]: cluster 2024-09-21T03:40:26.210903+0000 mgr.a (mgr.14388) 14110 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:27 smithi049 bash[23528]: cluster 2024-09-21T03:40:26.210903+0000 mgr.a (mgr.14388) 14110 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:29.705 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:29 smithi044 bash[22676]: cluster 2024-09-21T03:40:28.211751+0000 mgr.a (mgr.14388) 14111 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:29.705 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:29 smithi179 bash[23186]: cluster 2024-09-21T03:40:28.211751+0000 mgr.a (mgr.14388) 14111 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:29 smithi049 bash[23528]: cluster 2024-09-21T03:40:28.211751+0000 mgr.a (mgr.14388) 14111 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:30.420 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:30 smithi179 bash[23186]: audit 2024-09-21T03:40:30.007921+0000 mgr.a (mgr.14388) 14112 : audit [DBG] from='client.306510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:30 smithi179 bash[23186]: cluster 2024-09-21T03:40:30.212583+0000 mgr.a (mgr.14388) 14113 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:30 smithi044 bash[22676]: audit 2024-09-21T03:40:30.007921+0000 mgr.a (mgr.14388) 14112 : audit [DBG] from='client.306510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:30 smithi044 bash[22676]: cluster 2024-09-21T03:40:30.212583+0000 mgr.a (mgr.14388) 14113 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:30 smithi049 bash[23528]: audit 2024-09-21T03:40:30.007921+0000 mgr.a (mgr.14388) 14112 : audit [DBG] from='client.306510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:30 smithi049 bash[23528]: cluster 2024-09-21T03:40:30.212583+0000 mgr.a (mgr.14388) 14113 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:33 smithi049 bash[23528]: cluster 2024-09-21T03:40:32.214892+0000 mgr.a (mgr.14388) 14114 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:40:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:33 smithi044 bash[22676]: cluster 2024-09-21T03:40:32.214892+0000 mgr.a (mgr.14388) 14114 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:40:33.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:33 smithi179 bash[23186]: cluster 2024-09-21T03:40:32.214892+0000 mgr.a (mgr.14388) 14114 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:40:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:35.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:35.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:35 smithi179 bash[23186]: cluster 2024-09-21T03:40:34.215666+0000 mgr.a (mgr.14388) 14115 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:40:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:35 smithi179 bash[23186]: audit 2024-09-21T03:40:34.767246+0000 mon.a (mon.0) 11384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:35 smithi179 bash[23186]: audit 2024-09-21T03:40:34.775197+0000 mon.a (mon.0) 11385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:35 smithi179 bash[23186]: audit 2024-09-21T03:40:34.785683+0000 mon.a (mon.0) 11386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:35 smithi179 bash[23186]: audit 2024-09-21T03:40:35.118426+0000 mon.a (mon.0) 11387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:35 smithi179 bash[23186]: audit 2024-09-21T03:40:35.128092+0000 mon.a (mon.0) 11388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:35 smithi179 bash[23186]: audit 2024-09-21T03:40:35.139175+0000 mon.a (mon.0) 11389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:35 smithi049 bash[23528]: cluster 2024-09-21T03:40:34.215666+0000 mgr.a (mgr.14388) 14115 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:40:35.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:35 smithi049 bash[23528]: audit 2024-09-21T03:40:34.767246+0000 mon.a (mon.0) 11384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:35 smithi049 bash[23528]: audit 2024-09-21T03:40:34.775197+0000 mon.a (mon.0) 11385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:35 smithi049 bash[23528]: audit 2024-09-21T03:40:34.785683+0000 mon.a (mon.0) 11386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:35 smithi049 bash[23528]: audit 2024-09-21T03:40:35.118426+0000 mon.a (mon.0) 11387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:35 smithi049 bash[23528]: audit 2024-09-21T03:40:35.128092+0000 mon.a (mon.0) 11388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:35 smithi049 bash[23528]: audit 2024-09-21T03:40:35.139175+0000 mon.a (mon.0) 11389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:35 smithi044 bash[22676]: cluster 2024-09-21T03:40:34.215666+0000 mgr.a (mgr.14388) 14115 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:40:35.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:35 smithi044 bash[22676]: audit 2024-09-21T03:40:34.767246+0000 mon.a (mon.0) 11384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:35 smithi044 bash[22676]: audit 2024-09-21T03:40:34.775197+0000 mon.a (mon.0) 11385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:35 smithi044 bash[22676]: audit 2024-09-21T03:40:34.785683+0000 mon.a (mon.0) 11386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:35 smithi044 bash[22676]: audit 2024-09-21T03:40:35.118426+0000 mon.a (mon.0) 11387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:35 smithi044 bash[22676]: audit 2024-09-21T03:40:35.128092+0000 mon.a (mon.0) 11388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:35 smithi044 bash[22676]: audit 2024-09-21T03:40:35.139175+0000 mon.a (mon.0) 11389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:36.179 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:36.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:36.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:36.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:36.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:37 smithi049 bash[23528]: audit 2024-09-21T03:40:35.750655+0000 mgr.a (mgr.14388) 14116 : audit [DBG] from='client.306585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:37 smithi049 bash[23528]: cluster 2024-09-21T03:40:36.217037+0000 mgr.a (mgr.14388) 14117 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:37 smithi044 bash[22676]: audit 2024-09-21T03:40:35.750655+0000 mgr.a (mgr.14388) 14116 : audit [DBG] from='client.306585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:37 smithi044 bash[22676]: cluster 2024-09-21T03:40:36.217037+0000 mgr.a (mgr.14388) 14117 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:37.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:37 smithi179 bash[23186]: audit 2024-09-21T03:40:35.750655+0000 mgr.a (mgr.14388) 14116 : audit [DBG] from='client.306585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:37.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:37 smithi179 bash[23186]: cluster 2024-09-21T03:40:36.217037+0000 mgr.a (mgr.14388) 14117 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:39 smithi049 bash[23528]: cluster 2024-09-21T03:40:38.217808+0000 mgr.a (mgr.14388) 14118 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:40:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:39 smithi044 bash[22676]: cluster 2024-09-21T03:40:38.217808+0000 mgr.a (mgr.14388) 14118 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:40:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:39 smithi179 bash[23186]: cluster 2024-09-21T03:40:38.217808+0000 mgr.a (mgr.14388) 14118 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:40:41.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:41.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:41.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:41.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:41 smithi049 bash[23528]: cluster 2024-09-21T03:40:40.219002+0000 mgr.a (mgr.14388) 14119 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:40:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:41 smithi044 bash[22676]: cluster 2024-09-21T03:40:40.219002+0000 mgr.a (mgr.14388) 14119 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:40:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:41 smithi179 bash[23186]: cluster 2024-09-21T03:40:40.219002+0000 mgr.a (mgr.14388) 14119 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:40:41.958 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:41.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:43 smithi049 bash[23528]: audit 2024-09-21T03:40:41.517159+0000 mgr.a (mgr.14388) 14120 : audit [DBG] from='client.306663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:43 smithi049 bash[23528]: cluster 2024-09-21T03:40:42.221497+0000 mgr.a (mgr.14388) 14121 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:43 smithi049 bash[23528]: audit 2024-09-21T03:40:43.079517+0000 mon.a (mon.0) 11390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:43 smithi049 bash[23528]: audit 2024-09-21T03:40:43.088473+0000 mon.a (mon.0) 11391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:43 smithi049 bash[23528]: audit 2024-09-21T03:40:43.099147+0000 mon.a (mon.0) 11392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:43 smithi044 bash[22676]: audit 2024-09-21T03:40:41.517159+0000 mgr.a (mgr.14388) 14120 : audit [DBG] from='client.306663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:43 smithi044 bash[22676]: cluster 2024-09-21T03:40:42.221497+0000 mgr.a (mgr.14388) 14121 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:43 smithi044 bash[22676]: audit 2024-09-21T03:40:43.079517+0000 mon.a (mon.0) 11390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:43 smithi044 bash[22676]: audit 2024-09-21T03:40:43.088473+0000 mon.a (mon.0) 11391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:43 smithi044 bash[22676]: audit 2024-09-21T03:40:43.099147+0000 mon.a (mon.0) 11392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:43 smithi179 bash[23186]: audit 2024-09-21T03:40:41.517159+0000 mgr.a (mgr.14388) 14120 : audit [DBG] from='client.306663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:43 smithi179 bash[23186]: cluster 2024-09-21T03:40:42.221497+0000 mgr.a (mgr.14388) 14121 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:43 smithi179 bash[23186]: audit 2024-09-21T03:40:43.079517+0000 mon.a (mon.0) 11390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:43 smithi179 bash[23186]: audit 2024-09-21T03:40:43.088473+0000 mon.a (mon.0) 11391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:43 smithi179 bash[23186]: audit 2024-09-21T03:40:43.099147+0000 mon.a (mon.0) 11392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:45.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:45 smithi049 bash[23528]: cluster 2024-09-21T03:40:44.222264+0000 mgr.a (mgr.14388) 14122 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:40:45.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:45 smithi044 bash[22676]: cluster 2024-09-21T03:40:44.222264+0000 mgr.a (mgr.14388) 14122 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:40:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:45 smithi179 bash[23186]: cluster 2024-09-21T03:40:44.222264+0000 mgr.a (mgr.14388) 14122 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:40:46.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:47.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:47 smithi044 bash[22676]: cluster 2024-09-21T03:40:46.224390+0000 mgr.a (mgr.14388) 14123 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:47.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:47 smithi179 bash[23186]: cluster 2024-09-21T03:40:46.224390+0000 mgr.a (mgr.14388) 14123 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:47 smithi049 bash[23528]: cluster 2024-09-21T03:40:46.224390+0000 mgr.a (mgr.14388) 14123 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:48 smithi179 bash[23186]: audit 2024-09-21T03:40:47.295711+0000 mgr.a (mgr.14388) 14124 : audit [DBG] from='client.306741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:48.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:48 smithi044 bash[22676]: audit 2024-09-21T03:40:47.295711+0000 mgr.a (mgr.14388) 14124 : audit [DBG] from='client.306741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:48.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:48 smithi049 bash[23528]: audit 2024-09-21T03:40:47.295711+0000 mgr.a (mgr.14388) 14124 : audit [DBG] from='client.306741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:49 smithi044 bash[22676]: cluster 2024-09-21T03:40:48.225448+0000 mgr.a (mgr.14388) 14125 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:49 smithi179 bash[23186]: cluster 2024-09-21T03:40:48.225448+0000 mgr.a (mgr.14388) 14125 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:49 smithi049 bash[23528]: cluster 2024-09-21T03:40:48.225448+0000 mgr.a (mgr.14388) 14125 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:51.596 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:51 smithi049 bash[23528]: cluster 2024-09-21T03:40:50.226709+0000 mgr.a (mgr.14388) 14126 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:40:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:51 smithi044 bash[22676]: cluster 2024-09-21T03:40:50.226709+0000 mgr.a (mgr.14388) 14126 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:40:51.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:51 smithi179 bash[23186]: cluster 2024-09-21T03:40:50.226709+0000 mgr.a (mgr.14388) 14126 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:40:52.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:52.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:52.752 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:53.542 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:53.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:53.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:53.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:53.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:53 smithi044 bash[22676]: cluster 2024-09-21T03:40:52.228138+0000 mgr.a (mgr.14388) 14127 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:40:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:53 smithi179 bash[23186]: cluster 2024-09-21T03:40:52.228138+0000 mgr.a (mgr.14388) 14127 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:40:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:53 smithi049 bash[23528]: cluster 2024-09-21T03:40:52.228138+0000 mgr.a (mgr.14388) 14127 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:40:54.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:54 smithi044 bash[22676]: audit 2024-09-21T03:40:53.083494+0000 mgr.a (mgr.14388) 14128 : audit [DBG] from='client.306819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:54 smithi179 bash[23186]: audit 2024-09-21T03:40:53.083494+0000 mgr.a (mgr.14388) 14128 : audit [DBG] from='client.306819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:54 smithi049 bash[23528]: audit 2024-09-21T03:40:53.083494+0000 mgr.a (mgr.14388) 14128 : audit [DBG] from='client.306819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:55 smithi044 bash[22676]: cluster 2024-09-21T03:40:54.229351+0000 mgr.a (mgr.14388) 14129 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:55 smithi044 bash[22676]: audit 2024-09-21T03:40:54.995236+0000 mon.a (mon.0) 11393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:55 smithi044 bash[22676]: audit 2024-09-21T03:40:55.001141+0000 mon.a (mon.0) 11394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:55 smithi044 bash[22676]: audit 2024-09-21T03:40:55.011634+0000 mon.a (mon.0) 11395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:55 smithi179 bash[23186]: cluster 2024-09-21T03:40:54.229351+0000 mgr.a (mgr.14388) 14129 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:55 smithi179 bash[23186]: audit 2024-09-21T03:40:54.995236+0000 mon.a (mon.0) 11393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:55 smithi179 bash[23186]: audit 2024-09-21T03:40:55.001141+0000 mon.a (mon.0) 11394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:55 smithi179 bash[23186]: audit 2024-09-21T03:40:55.011634+0000 mon.a (mon.0) 11395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:55 smithi049 bash[23528]: cluster 2024-09-21T03:40:54.229351+0000 mgr.a (mgr.14388) 14129 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:55 smithi049 bash[23528]: audit 2024-09-21T03:40:54.995236+0000 mon.a (mon.0) 11393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:55 smithi049 bash[23528]: audit 2024-09-21T03:40:55.001141+0000 mon.a (mon.0) 11394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:55 smithi049 bash[23528]: audit 2024-09-21T03:40:55.011634+0000 mon.a (mon.0) 11395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:56 smithi044 bash[22676]: audit 2024-09-21T03:40:55.348180+0000 mon.a (mon.0) 11396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:56 smithi044 bash[22676]: audit 2024-09-21T03:40:55.356892+0000 mon.a (mon.0) 11397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:56 smithi044 bash[22676]: audit 2024-09-21T03:40:55.367148+0000 mon.a (mon.0) 11398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:56 smithi179 bash[23186]: audit 2024-09-21T03:40:55.348180+0000 mon.a (mon.0) 11396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:56 smithi179 bash[23186]: audit 2024-09-21T03:40:55.356892+0000 mon.a (mon.0) 11397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:56 smithi179 bash[23186]: audit 2024-09-21T03:40:55.367148+0000 mon.a (mon.0) 11398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:56 smithi049 bash[23528]: audit 2024-09-21T03:40:55.348180+0000 mon.a (mon.0) 11396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:56 smithi049 bash[23528]: audit 2024-09-21T03:40:55.356892+0000 mon.a (mon.0) 11397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:56.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:56 smithi049 bash[23528]: audit 2024-09-21T03:40:55.367148+0000 mon.a (mon.0) 11398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:40:57.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:57 smithi044 bash[22676]: cluster 2024-09-21T03:40:56.231781+0000 mgr.a (mgr.14388) 14130 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:57 smithi179 bash[23186]: cluster 2024-09-21T03:40:56.231781+0000 mgr.a (mgr.14388) 14130 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:57 smithi049 bash[23528]: cluster 2024-09-21T03:40:56.231781+0000 mgr.a (mgr.14388) 14130 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:40:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:40:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:40:58.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:40:59.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:40:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:40:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:40:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:40:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:40:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:40:59 smithi044 bash[22676]: cluster 2024-09-21T03:40:58.232820+0000 mgr.a (mgr.14388) 14131 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:40:59 smithi179 bash[23186]: cluster 2024-09-21T03:40:58.232820+0000 mgr.a (mgr.14388) 14131 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:40:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:40:59 smithi049 bash[23528]: cluster 2024-09-21T03:40:58.232820+0000 mgr.a (mgr.14388) 14131 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:00.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:00 smithi044 bash[22676]: audit 2024-09-21T03:40:58.880766+0000 mgr.a (mgr.14388) 14132 : audit [DBG] from='client.306891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:00 smithi179 bash[23186]: audit 2024-09-21T03:40:58.880766+0000 mgr.a (mgr.14388) 14132 : audit [DBG] from='client.306891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:00 smithi049 bash[23528]: audit 2024-09-21T03:40:58.880766+0000 mgr.a (mgr.14388) 14132 : audit [DBG] from='client.306891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:01 smithi044 bash[22676]: cluster 2024-09-21T03:41:00.234464+0000 mgr.a (mgr.14388) 14133 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:01 smithi179 bash[23186]: cluster 2024-09-21T03:41:00.234464+0000 mgr.a (mgr.14388) 14133 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:01 smithi049 bash[23528]: cluster 2024-09-21T03:41:00.234464+0000 mgr.a (mgr.14388) 14133 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:03 smithi044 bash[22676]: cluster 2024-09-21T03:41:02.236335+0000 mgr.a (mgr.14388) 14134 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:03 smithi044 bash[22676]: audit 2024-09-21T03:41:03.317880+0000 mon.a (mon.0) 11399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:03 smithi044 bash[22676]: audit 2024-09-21T03:41:03.326629+0000 mon.a (mon.0) 11400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:03 smithi044 bash[22676]: audit 2024-09-21T03:41:03.336903+0000 mon.a (mon.0) 11401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:03 smithi179 bash[23186]: cluster 2024-09-21T03:41:02.236335+0000 mgr.a (mgr.14388) 14134 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:03 smithi179 bash[23186]: audit 2024-09-21T03:41:03.317880+0000 mon.a (mon.0) 11399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:03 smithi179 bash[23186]: audit 2024-09-21T03:41:03.326629+0000 mon.a (mon.0) 11400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:03 smithi179 bash[23186]: audit 2024-09-21T03:41:03.336903+0000 mon.a (mon.0) 11401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:03 smithi049 bash[23528]: cluster 2024-09-21T03:41:02.236335+0000 mgr.a (mgr.14388) 14134 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:03 smithi049 bash[23528]: audit 2024-09-21T03:41:03.317880+0000 mon.a (mon.0) 11399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:03 smithi049 bash[23528]: audit 2024-09-21T03:41:03.326629+0000 mon.a (mon.0) 11400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:03.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:03 smithi049 bash[23528]: audit 2024-09-21T03:41:03.336903+0000 mon.a (mon.0) 11401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:04.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:04.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:04.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:05.093 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:05.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:05.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:05.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:05.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:05 smithi044 bash[22676]: cluster 2024-09-21T03:41:04.237323+0000 mgr.a (mgr.14388) 14135 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:05 smithi179 bash[23186]: cluster 2024-09-21T03:41:04.237323+0000 mgr.a (mgr.14388) 14135 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:05 smithi049 bash[23528]: cluster 2024-09-21T03:41:04.237323+0000 mgr.a (mgr.14388) 14135 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:06.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:06 smithi044 bash[22676]: audit 2024-09-21T03:41:04.663309+0000 mgr.a (mgr.14388) 14136 : audit [DBG] from='client.306969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:06 smithi179 bash[23186]: audit 2024-09-21T03:41:04.663309+0000 mgr.a (mgr.14388) 14136 : audit [DBG] from='client.306969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:06.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:06 smithi049 bash[23528]: audit 2024-09-21T03:41:04.663309+0000 mgr.a (mgr.14388) 14136 : audit [DBG] from='client.306969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:07.662 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:07 smithi044 bash[22676]: cluster 2024-09-21T03:41:06.239763+0000 mgr.a (mgr.14388) 14137 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:07 smithi179 bash[23186]: cluster 2024-09-21T03:41:06.239763+0000 mgr.a (mgr.14388) 14137 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:07 smithi049 bash[23528]: cluster 2024-09-21T03:41:06.239763+0000 mgr.a (mgr.14388) 14137 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22676]: cluster 2024-09-21T03:41:08.240556+0000 mgr.a (mgr.14388) 14138 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:41:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22676]: audit 2024-09-21T03:41:09.145614+0000 mon.a (mon.0) 11402 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:41:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22676]: audit 2024-09-21T03:41:09.157426+0000 mon.a (mon.0) 11403 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:41:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22676]: audit 2024-09-21T03:41:09.159412+0000 mon.a (mon.0) 11404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:41:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22676]: audit 2024-09-21T03:41:09.171169+0000 mon.a (mon.0) 11405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22676]: audit 2024-09-21T03:41:09.177526+0000 mon.a (mon.0) 11406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:41:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:09 smithi179 bash[23186]: cluster 2024-09-21T03:41:08.240556+0000 mgr.a (mgr.14388) 14138 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:41:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:09 smithi179 bash[23186]: audit 2024-09-21T03:41:09.145614+0000 mon.a (mon.0) 11402 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:41:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:09 smithi179 bash[23186]: audit 2024-09-21T03:41:09.157426+0000 mon.a (mon.0) 11403 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:41:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:09 smithi179 bash[23186]: audit 2024-09-21T03:41:09.159412+0000 mon.a (mon.0) 11404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:41:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:09 smithi179 bash[23186]: audit 2024-09-21T03:41:09.171169+0000 mon.a (mon.0) 11405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:09 smithi179 bash[23186]: audit 2024-09-21T03:41:09.177526+0000 mon.a (mon.0) 11406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:41:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:09 smithi049 bash[23528]: cluster 2024-09-21T03:41:08.240556+0000 mgr.a (mgr.14388) 14138 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:41:09.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:09 smithi049 bash[23528]: audit 2024-09-21T03:41:09.145614+0000 mon.a (mon.0) 11402 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:41:09.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:09 smithi049 bash[23528]: audit 2024-09-21T03:41:09.157426+0000 mon.a (mon.0) 11403 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:41:09.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:09 smithi049 bash[23528]: audit 2024-09-21T03:41:09.159412+0000 mon.a (mon.0) 11404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:41:09.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:09 smithi049 bash[23528]: audit 2024-09-21T03:41:09.171169+0000 mon.a (mon.0) 11405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:09.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:09 smithi049 bash[23528]: audit 2024-09-21T03:41:09.177526+0000 mon.a (mon.0) 11406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:41:10.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:10.094 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:10.094 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:10.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22930]: debug 2024-09-21T03:41:09.977+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:41:10.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:41:09 smithi044 bash[22930]: debug 2024-09-21T03:41:09.981+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:41:10.665 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:10 smithi179 bash[23186]: audit 2024-09-21T03:41:09.179945+0000 mgr.a (mgr.14388) 14139 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:41:10.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:10 smithi044 bash[22676]: audit 2024-09-21T03:41:09.179945+0000 mgr.a (mgr.14388) 14139 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:41:10.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:10.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:10.801 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:10 smithi049 bash[23528]: audit 2024-09-21T03:41:09.179945+0000 mgr.a (mgr.14388) 14139 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:41:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:11 smithi044 bash[22676]: audit 2024-09-21T03:41:09.985188+0000 mgr.a (mgr.14388) 14140 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:41:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:11 smithi044 bash[22676]: cephadm 2024-09-21T03:41:09.986296+0000 mgr.a (mgr.14388) 14141 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:41:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:11 smithi044 bash[22676]: cluster 2024-09-21T03:41:10.241794+0000 mgr.a (mgr.14388) 14142 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 4 op/s 2024-09-21T03:41:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:11 smithi044 bash[22676]: audit 2024-09-21T03:41:10.399303+0000 mgr.a (mgr.14388) 14143 : audit [DBG] from='client.307146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:11 smithi179 bash[23186]: audit 2024-09-21T03:41:09.985188+0000 mgr.a (mgr.14388) 14140 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:41:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:11 smithi179 bash[23186]: cephadm 2024-09-21T03:41:09.986296+0000 mgr.a (mgr.14388) 14141 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:41:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:11 smithi179 bash[23186]: cluster 2024-09-21T03:41:10.241794+0000 mgr.a (mgr.14388) 14142 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 4 op/s 2024-09-21T03:41:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:11 smithi179 bash[23186]: audit 2024-09-21T03:41:10.399303+0000 mgr.a (mgr.14388) 14143 : audit [DBG] from='client.307146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:11 smithi049 bash[23528]: audit 2024-09-21T03:41:09.985188+0000 mgr.a (mgr.14388) 14140 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:41:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:11 smithi049 bash[23528]: cephadm 2024-09-21T03:41:09.986296+0000 mgr.a (mgr.14388) 14141 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:41:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:11 smithi049 bash[23528]: cluster 2024-09-21T03:41:10.241794+0000 mgr.a (mgr.14388) 14142 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 4 op/s 2024-09-21T03:41:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:11 smithi049 bash[23528]: audit 2024-09-21T03:41:10.399303+0000 mgr.a (mgr.14388) 14143 : audit [DBG] from='client.307146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:13 smithi044 bash[22676]: cluster 2024-09-21T03:41:12.243238+0000 mgr.a (mgr.14388) 14144 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:13 smithi179 bash[23186]: cluster 2024-09-21T03:41:12.243238+0000 mgr.a (mgr.14388) 14144 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:13.789 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:13 smithi049 bash[23528]: cluster 2024-09-21T03:41:12.243238+0000 mgr.a (mgr.14388) 14144 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:15 smithi044 bash[22676]: cluster 2024-09-21T03:41:14.244143+0000 mgr.a (mgr.14388) 14145 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:15 smithi044 bash[22676]: audit 2024-09-21T03:41:15.223038+0000 mon.a (mon.0) 11407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:15 smithi044 bash[22676]: audit 2024-09-21T03:41:15.231742+0000 mon.a (mon.0) 11408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:15 smithi044 bash[22676]: audit 2024-09-21T03:41:15.242505+0000 mon.a (mon.0) 11409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:15 smithi179 bash[23186]: cluster 2024-09-21T03:41:14.244143+0000 mgr.a (mgr.14388) 14145 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:15 smithi179 bash[23186]: audit 2024-09-21T03:41:15.223038+0000 mon.a (mon.0) 11407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:15 smithi179 bash[23186]: audit 2024-09-21T03:41:15.231742+0000 mon.a (mon.0) 11408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:15 smithi179 bash[23186]: audit 2024-09-21T03:41:15.242505+0000 mon.a (mon.0) 11409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:15 smithi049 bash[23528]: cluster 2024-09-21T03:41:14.244143+0000 mgr.a (mgr.14388) 14145 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:15 smithi049 bash[23528]: audit 2024-09-21T03:41:15.223038+0000 mon.a (mon.0) 11407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:15 smithi049 bash[23528]: audit 2024-09-21T03:41:15.231742+0000 mon.a (mon.0) 11408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:15 smithi049 bash[23528]: audit 2024-09-21T03:41:15.242505+0000 mon.a (mon.0) 11409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:16.591 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:16.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:16.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:16.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:16 smithi044 bash[22676]: audit 2024-09-21T03:41:15.572024+0000 mon.a (mon.0) 11410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:16 smithi044 bash[22676]: audit 2024-09-21T03:41:15.580656+0000 mon.a (mon.0) 11411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:16 smithi044 bash[22676]: audit 2024-09-21T03:41:15.590693+0000 mon.a (mon.0) 11412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:16 smithi044 bash[22676]: audit 2024-09-21T03:41:16.137863+0000 mgr.a (mgr.14388) 14146 : audit [DBG] from='client.307224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:16 smithi044 bash[22676]: cluster 2024-09-21T03:41:16.245511+0000 mgr.a (mgr.14388) 14147 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:16 smithi179 bash[23186]: audit 2024-09-21T03:41:15.572024+0000 mon.a (mon.0) 11410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:16 smithi179 bash[23186]: audit 2024-09-21T03:41:15.580656+0000 mon.a (mon.0) 11411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:16 smithi179 bash[23186]: audit 2024-09-21T03:41:15.590693+0000 mon.a (mon.0) 11412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:16 smithi179 bash[23186]: audit 2024-09-21T03:41:16.137863+0000 mgr.a (mgr.14388) 14146 : audit [DBG] from='client.307224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:16 smithi179 bash[23186]: cluster 2024-09-21T03:41:16.245511+0000 mgr.a (mgr.14388) 14147 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:16 smithi049 bash[23528]: audit 2024-09-21T03:41:15.572024+0000 mon.a (mon.0) 11410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:16 smithi049 bash[23528]: audit 2024-09-21T03:41:15.580656+0000 mon.a (mon.0) 11411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:16 smithi049 bash[23528]: audit 2024-09-21T03:41:15.590693+0000 mon.a (mon.0) 11412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:16 smithi049 bash[23528]: audit 2024-09-21T03:41:16.137863+0000 mgr.a (mgr.14388) 14146 : audit [DBG] from='client.307224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:16 smithi049 bash[23528]: cluster 2024-09-21T03:41:16.245511+0000 mgr.a (mgr.14388) 14147 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:19 smithi044 bash[22676]: cluster 2024-09-21T03:41:18.246388+0000 mgr.a (mgr.14388) 14148 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:19 smithi179 bash[23186]: cluster 2024-09-21T03:41:18.246388+0000 mgr.a (mgr.14388) 14148 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:19 smithi049 bash[23528]: cluster 2024-09-21T03:41:18.246388+0000 mgr.a (mgr.14388) 14148 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:21.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:21.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:21.594 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:21 smithi044 bash[22676]: cluster 2024-09-21T03:41:20.247715+0000 mgr.a (mgr.14388) 14149 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:21 smithi179 bash[23186]: cluster 2024-09-21T03:41:20.247715+0000 mgr.a (mgr.14388) 14149 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:21 smithi049 bash[23528]: cluster 2024-09-21T03:41:20.247715+0000 mgr.a (mgr.14388) 14149 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:22.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:23.575 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:23 smithi049 bash[23528]: audit 2024-09-21T03:41:21.935053+0000 mgr.a (mgr.14388) 14150 : audit [DBG] from='client.307302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:23.576 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:23 smithi049 bash[23528]: cluster 2024-09-21T03:41:22.249085+0000 mgr.a (mgr.14388) 14151 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:41:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:23 smithi044 bash[22676]: audit 2024-09-21T03:41:21.935053+0000 mgr.a (mgr.14388) 14150 : audit [DBG] from='client.307302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:23 smithi044 bash[22676]: cluster 2024-09-21T03:41:22.249085+0000 mgr.a (mgr.14388) 14151 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:41:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:23 smithi179 bash[23186]: audit 2024-09-21T03:41:21.935053+0000 mgr.a (mgr.14388) 14150 : audit [DBG] from='client.307302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:23 smithi179 bash[23186]: cluster 2024-09-21T03:41:22.249085+0000 mgr.a (mgr.14388) 14151 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T03:41:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:24 smithi044 bash[22676]: audit 2024-09-21T03:41:23.553111+0000 mon.a (mon.0) 11413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:24 smithi044 bash[22676]: audit 2024-09-21T03:41:23.561985+0000 mon.a (mon.0) 11414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:24 smithi044 bash[22676]: audit 2024-09-21T03:41:23.572692+0000 mon.a (mon.0) 11415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:24 smithi044 bash[22676]: cluster 2024-09-21T03:41:24.250069+0000 mgr.a (mgr.14388) 14152 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:24 smithi179 bash[23186]: audit 2024-09-21T03:41:23.553111+0000 mon.a (mon.0) 11413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:24 smithi179 bash[23186]: audit 2024-09-21T03:41:23.561985+0000 mon.a (mon.0) 11414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:24 smithi179 bash[23186]: audit 2024-09-21T03:41:23.572692+0000 mon.a (mon.0) 11415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:24 smithi179 bash[23186]: cluster 2024-09-21T03:41:24.250069+0000 mgr.a (mgr.14388) 14152 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:24 smithi049 bash[23528]: audit 2024-09-21T03:41:23.553111+0000 mon.a (mon.0) 11413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:24 smithi049 bash[23528]: audit 2024-09-21T03:41:23.561985+0000 mon.a (mon.0) 11414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:24 smithi049 bash[23528]: audit 2024-09-21T03:41:23.572692+0000 mon.a (mon.0) 11415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:24 smithi049 bash[23528]: cluster 2024-09-21T03:41:24.250069+0000 mgr.a (mgr.14388) 14152 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:27.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:27.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:27.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:27.605 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:27 smithi044 bash[22676]: cluster 2024-09-21T03:41:26.252332+0000 mgr.a (mgr.14388) 14153 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:41:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:27 smithi179 bash[23186]: cluster 2024-09-21T03:41:26.252332+0000 mgr.a (mgr.14388) 14153 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:41:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:27 smithi049 bash[23528]: cluster 2024-09-21T03:41:26.252332+0000 mgr.a (mgr.14388) 14153 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:41:28.152 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:28.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:28.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:28.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:28.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:29 smithi044 bash[22676]: audit 2024-09-21T03:41:27.733567+0000 mgr.a (mgr.14388) 14154 : audit [DBG] from='client.307380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:29 smithi044 bash[22676]: cluster 2024-09-21T03:41:28.253313+0000 mgr.a (mgr.14388) 14155 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:29.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:29 smithi179 bash[23186]: audit 2024-09-21T03:41:27.733567+0000 mgr.a (mgr.14388) 14154 : audit [DBG] from='client.307380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:29 smithi179 bash[23186]: cluster 2024-09-21T03:41:28.253313+0000 mgr.a (mgr.14388) 14155 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:29 smithi049 bash[23528]: audit 2024-09-21T03:41:27.733567+0000 mgr.a (mgr.14388) 14154 : audit [DBG] from='client.307380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:29 smithi049 bash[23528]: cluster 2024-09-21T03:41:28.253313+0000 mgr.a (mgr.14388) 14155 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:31 smithi179 bash[23186]: cluster 2024-09-21T03:41:30.254657+0000 mgr.a (mgr.14388) 14156 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:31.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:31 smithi049 bash[23528]: cluster 2024-09-21T03:41:30.254657+0000 mgr.a (mgr.14388) 14156 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:31 smithi044 bash[22676]: cluster 2024-09-21T03:41:30.254657+0000 mgr.a (mgr.14388) 14156 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:33.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:33 smithi049 bash[23528]: cluster 2024-09-21T03:41:32.256409+0000 mgr.a (mgr.14388) 14157 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:33.656 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:33 smithi179 bash[23186]: cluster 2024-09-21T03:41:32.256409+0000 mgr.a (mgr.14388) 14157 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:33 smithi044 bash[22676]: cluster 2024-09-21T03:41:32.256409+0000 mgr.a (mgr.14388) 14157 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:33.928 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:33.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:33.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:33.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:33.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:35 smithi044 bash[22676]: audit 2024-09-21T03:41:33.491051+0000 mgr.a (mgr.14388) 14158 : audit [DBG] from='client.307458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:35.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:35 smithi044 bash[22676]: cluster 2024-09-21T03:41:34.257365+0000 mgr.a (mgr.14388) 14159 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:35.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:35 smithi179 bash[23186]: audit 2024-09-21T03:41:33.491051+0000 mgr.a (mgr.14388) 14158 : audit [DBG] from='client.307458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:35.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:35 smithi179 bash[23186]: cluster 2024-09-21T03:41:34.257365+0000 mgr.a (mgr.14388) 14159 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:35 smithi049 bash[23528]: audit 2024-09-21T03:41:33.491051+0000 mgr.a (mgr.14388) 14158 : audit [DBG] from='client.307458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:35 smithi049 bash[23528]: cluster 2024-09-21T03:41:34.257365+0000 mgr.a (mgr.14388) 14159 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:36 smithi044 bash[22676]: audit 2024-09-21T03:41:35.466846+0000 mon.a (mon.0) 11416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:36 smithi044 bash[22676]: audit 2024-09-21T03:41:35.475906+0000 mon.a (mon.0) 11417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:36 smithi044 bash[22676]: audit 2024-09-21T03:41:35.488163+0000 mon.a (mon.0) 11418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:36 smithi044 bash[22676]: audit 2024-09-21T03:41:35.775509+0000 mon.a (mon.0) 11419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:36 smithi044 bash[22676]: audit 2024-09-21T03:41:35.785671+0000 mon.a (mon.0) 11420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:36 smithi044 bash[22676]: audit 2024-09-21T03:41:35.797370+0000 mon.a (mon.0) 11421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:36 smithi179 bash[23186]: audit 2024-09-21T03:41:35.466846+0000 mon.a (mon.0) 11416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:36 smithi179 bash[23186]: audit 2024-09-21T03:41:35.475906+0000 mon.a (mon.0) 11417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:36 smithi179 bash[23186]: audit 2024-09-21T03:41:35.488163+0000 mon.a (mon.0) 11418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:36 smithi179 bash[23186]: audit 2024-09-21T03:41:35.775509+0000 mon.a (mon.0) 11419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:36 smithi179 bash[23186]: audit 2024-09-21T03:41:35.785671+0000 mon.a (mon.0) 11420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:36 smithi179 bash[23186]: audit 2024-09-21T03:41:35.797370+0000 mon.a (mon.0) 11421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:36 smithi049 bash[23528]: audit 2024-09-21T03:41:35.466846+0000 mon.a (mon.0) 11416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:36 smithi049 bash[23528]: audit 2024-09-21T03:41:35.475906+0000 mon.a (mon.0) 11417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:36 smithi049 bash[23528]: audit 2024-09-21T03:41:35.488163+0000 mon.a (mon.0) 11418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:36 smithi049 bash[23528]: audit 2024-09-21T03:41:35.775509+0000 mon.a (mon.0) 11419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:36 smithi049 bash[23528]: audit 2024-09-21T03:41:35.785671+0000 mon.a (mon.0) 11420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:36 smithi049 bash[23528]: audit 2024-09-21T03:41:35.797370+0000 mon.a (mon.0) 11421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:37 smithi044 bash[22676]: cluster 2024-09-21T03:41:36.259630+0000 mgr.a (mgr.14388) 14160 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:41:37.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:37 smithi179 bash[23186]: cluster 2024-09-21T03:41:36.259630+0000 mgr.a (mgr.14388) 14160 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:41:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:37 smithi049 bash[23528]: cluster 2024-09-21T03:41:36.259630+0000 mgr.a (mgr.14388) 14160 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:41:38.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:38.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:38.930 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:39.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:39.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:39.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:39.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:39 smithi044 bash[22676]: cluster 2024-09-21T03:41:38.260387+0000 mgr.a (mgr.14388) 14161 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:39 smithi179 bash[23186]: cluster 2024-09-21T03:41:38.260387+0000 mgr.a (mgr.14388) 14161 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:39 smithi049 bash[23528]: cluster 2024-09-21T03:41:38.260387+0000 mgr.a (mgr.14388) 14161 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:40.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:40 smithi044 bash[22676]: audit 2024-09-21T03:41:39.266222+0000 mgr.a (mgr.14388) 14162 : audit [DBG] from='client.307533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:40 smithi179 bash[23186]: audit 2024-09-21T03:41:39.266222+0000 mgr.a (mgr.14388) 14162 : audit [DBG] from='client.307533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:40 smithi049 bash[23528]: audit 2024-09-21T03:41:39.266222+0000 mgr.a (mgr.14388) 14162 : audit [DBG] from='client.307533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:41 smithi044 bash[22676]: cluster 2024-09-21T03:41:40.261947+0000 mgr.a (mgr.14388) 14163 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:41 smithi179 bash[23186]: cluster 2024-09-21T03:41:40.261947+0000 mgr.a (mgr.14388) 14163 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:41 smithi049 bash[23528]: cluster 2024-09-21T03:41:40.261947+0000 mgr.a (mgr.14388) 14163 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:41:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:43 smithi044 bash[22676]: cluster 2024-09-21T03:41:42.263641+0000 mgr.a (mgr.14388) 14164 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:43.753 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:43 smithi049 bash[23528]: cluster 2024-09-21T03:41:42.263641+0000 mgr.a (mgr.14388) 14164 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:43 smithi179 bash[23186]: cluster 2024-09-21T03:41:42.263641+0000 mgr.a (mgr.14388) 14164 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:41:44.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:44.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:44.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:44 smithi044 bash[22676]: audit 2024-09-21T03:41:43.729754+0000 mon.a (mon.0) 11422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:44 smithi044 bash[22676]: audit 2024-09-21T03:41:43.739538+0000 mon.a (mon.0) 11423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:44 smithi044 bash[22676]: audit 2024-09-21T03:41:43.750298+0000 mon.a (mon.0) 11424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:44 smithi044 bash[22676]: cluster 2024-09-21T03:41:44.264450+0000 mgr.a (mgr.14388) 14165 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:44 smithi179 bash[23186]: audit 2024-09-21T03:41:43.729754+0000 mon.a (mon.0) 11422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:44 smithi179 bash[23186]: audit 2024-09-21T03:41:43.739538+0000 mon.a (mon.0) 11423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:44 smithi179 bash[23186]: audit 2024-09-21T03:41:43.750298+0000 mon.a (mon.0) 11424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:44 smithi179 bash[23186]: cluster 2024-09-21T03:41:44.264450+0000 mgr.a (mgr.14388) 14165 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:44 smithi049 bash[23528]: audit 2024-09-21T03:41:43.729754+0000 mon.a (mon.0) 11422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:44 smithi049 bash[23528]: audit 2024-09-21T03:41:43.739538+0000 mon.a (mon.0) 11423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:44 smithi049 bash[23528]: audit 2024-09-21T03:41:43.750298+0000 mon.a (mon.0) 11424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:44 smithi049 bash[23528]: cluster 2024-09-21T03:41:44.264450+0000 mgr.a (mgr.14388) 14165 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:45.491 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:45.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:46.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:45 smithi179 bash[23186]: audit 2024-09-21T03:41:45.032049+0000 mgr.a (mgr.14388) 14166 : audit [DBG] from='client.307611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:45 smithi049 bash[23528]: audit 2024-09-21T03:41:45.032049+0000 mgr.a (mgr.14388) 14166 : audit [DBG] from='client.307611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:46.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:45 smithi044 bash[22676]: audit 2024-09-21T03:41:45.032049+0000 mgr.a (mgr.14388) 14166 : audit [DBG] from='client.307611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:46.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:46 smithi044 bash[22676]: cluster 2024-09-21T03:41:46.267332+0000 mgr.a (mgr.14388) 14167 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:41:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:46 smithi049 bash[23528]: cluster 2024-09-21T03:41:46.267332+0000 mgr.a (mgr.14388) 14167 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:41:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:46 smithi179 bash[23186]: cluster 2024-09-21T03:41:46.267332+0000 mgr.a (mgr.14388) 14167 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T03:41:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:49 smithi044 bash[22676]: cluster 2024-09-21T03:41:48.268133+0000 mgr.a (mgr.14388) 14168 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:41:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:49 smithi179 bash[23186]: cluster 2024-09-21T03:41:48.268133+0000 mgr.a (mgr.14388) 14168 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:41:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:49 smithi049 bash[23528]: cluster 2024-09-21T03:41:48.268133+0000 mgr.a (mgr.14388) 14168 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T03:41:50.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:50.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:51.257 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:51.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:51.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:51.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:51.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:51 smithi179 bash[23186]: cluster 2024-09-21T03:41:50.269772+0000 mgr.a (mgr.14388) 14169 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:41:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:51 smithi044 bash[22676]: cluster 2024-09-21T03:41:50.269772+0000 mgr.a (mgr.14388) 14169 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:41:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:51 smithi049 bash[23528]: cluster 2024-09-21T03:41:50.269772+0000 mgr.a (mgr.14388) 14169 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:41:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:52 smithi179 bash[23186]: audit 2024-09-21T03:41:50.830582+0000 mgr.a (mgr.14388) 14170 : audit [DBG] from='client.307689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:52.656 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:52 smithi049 bash[23528]: audit 2024-09-21T03:41:50.830582+0000 mgr.a (mgr.14388) 14170 : audit [DBG] from='client.307689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:52.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:52 smithi044 bash[22676]: audit 2024-09-21T03:41:50.830582+0000 mgr.a (mgr.14388) 14170 : audit [DBG] from='client.307689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:53 smithi179 bash[23186]: cluster 2024-09-21T03:41:52.271666+0000 mgr.a (mgr.14388) 14171 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:41:53.675 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:53 smithi049 bash[23528]: cluster 2024-09-21T03:41:52.271666+0000 mgr.a (mgr.14388) 14171 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:41:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:53 smithi044 bash[22676]: cluster 2024-09-21T03:41:52.271666+0000 mgr.a (mgr.14388) 14171 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T03:41:55.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:55 smithi049 bash[23528]: cluster 2024-09-21T03:41:54.272472+0000 mgr.a (mgr.14388) 14172 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:41:55.729 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:55 smithi044 bash[22676]: cluster 2024-09-21T03:41:54.272472+0000 mgr.a (mgr.14388) 14172 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:41:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:55 smithi179 bash[23186]: cluster 2024-09-21T03:41:54.272472+0000 mgr.a (mgr.14388) 14172 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:41:56.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:41:56.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:41:56.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:41:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:56 smithi044 bash[22676]: audit 2024-09-21T03:41:55.709055+0000 mon.a (mon.0) 11425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:56 smithi044 bash[22676]: audit 2024-09-21T03:41:55.716329+0000 mon.a (mon.0) 11426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:56 smithi044 bash[22676]: audit 2024-09-21T03:41:55.726543+0000 mon.a (mon.0) 11427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:56 smithi044 bash[22676]: audit 2024-09-21T03:41:56.004694+0000 mon.a (mon.0) 11428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:56.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:56 smithi044 bash[22676]: audit 2024-09-21T03:41:56.013268+0000 mon.a (mon.0) 11429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:56 smithi044 bash[22676]: audit 2024-09-21T03:41:56.023432+0000 mon.a (mon.0) 11430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:56 smithi044 bash[22676]: cluster 2024-09-21T03:41:56.274592+0000 mgr.a (mgr.14388) 14173 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:56 smithi179 bash[23186]: audit 2024-09-21T03:41:55.709055+0000 mon.a (mon.0) 11425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:56 smithi179 bash[23186]: audit 2024-09-21T03:41:55.716329+0000 mon.a (mon.0) 11426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:56 smithi179 bash[23186]: audit 2024-09-21T03:41:55.726543+0000 mon.a (mon.0) 11427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:56 smithi179 bash[23186]: audit 2024-09-21T03:41:56.004694+0000 mon.a (mon.0) 11428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:56 smithi179 bash[23186]: audit 2024-09-21T03:41:56.013268+0000 mon.a (mon.0) 11429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:56 smithi179 bash[23186]: audit 2024-09-21T03:41:56.023432+0000 mon.a (mon.0) 11430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:56 smithi179 bash[23186]: cluster 2024-09-21T03:41:56.274592+0000 mgr.a (mgr.14388) 14173 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:57.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:41:57.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:41:57.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:41:57.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:41:57.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:41:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:56 smithi049 bash[23528]: audit 2024-09-21T03:41:55.709055+0000 mon.a (mon.0) 11425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:56 smithi049 bash[23528]: audit 2024-09-21T03:41:55.716329+0000 mon.a (mon.0) 11426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:56 smithi049 bash[23528]: audit 2024-09-21T03:41:55.726543+0000 mon.a (mon.0) 11427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:56 smithi049 bash[23528]: audit 2024-09-21T03:41:56.004694+0000 mon.a (mon.0) 11428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:56 smithi049 bash[23528]: audit 2024-09-21T03:41:56.013268+0000 mon.a (mon.0) 11429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:56 smithi049 bash[23528]: audit 2024-09-21T03:41:56.023432+0000 mon.a (mon.0) 11430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:41:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:56 smithi049 bash[23528]: cluster 2024-09-21T03:41:56.274592+0000 mgr.a (mgr.14388) 14173 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:41:58.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:58 smithi049 bash[23528]: audit 2024-09-21T03:41:56.592545+0000 mgr.a (mgr.14388) 14174 : audit [DBG] from='client.307767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:58.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:58 smithi044 bash[22676]: audit 2024-09-21T03:41:56.592545+0000 mgr.a (mgr.14388) 14174 : audit [DBG] from='client.307767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:58 smithi179 bash[23186]: audit 2024-09-21T03:41:56.592545+0000 mgr.a (mgr.14388) 14174 : audit [DBG] from='client.307767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:59.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:41:59 smithi049 bash[23528]: cluster 2024-09-21T03:41:58.275536+0000 mgr.a (mgr.14388) 14175 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:41:59.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:41:59 smithi044 bash[22676]: cluster 2024-09-21T03:41:58.275536+0000 mgr.a (mgr.14388) 14175 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:41:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:41:59 smithi179 bash[23186]: cluster 2024-09-21T03:41:58.275536+0000 mgr.a (mgr.14388) 14175 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:42:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:01 smithi044 bash[22676]: cluster 2024-09-21T03:42:00.277378+0000 mgr.a (mgr.14388) 14176 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:42:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:01 smithi179 bash[23186]: cluster 2024-09-21T03:42:00.277378+0000 mgr.a (mgr.14388) 14176 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:42:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:01 smithi049 bash[23528]: cluster 2024-09-21T03:42:00.277378+0000 mgr.a (mgr.14388) 14176 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:42:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:02.820 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:02.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:03 smithi044 bash[22676]: cluster 2024-09-21T03:42:02.278546+0000 mgr.a (mgr.14388) 14177 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:03 smithi044 bash[22676]: audit 2024-09-21T03:42:02.362561+0000 mgr.a (mgr.14388) 14178 : audit [DBG] from='client.307845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:03 smithi179 bash[23186]: cluster 2024-09-21T03:42:02.278546+0000 mgr.a (mgr.14388) 14177 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:03 smithi179 bash[23186]: audit 2024-09-21T03:42:02.362561+0000 mgr.a (mgr.14388) 14178 : audit [DBG] from='client.307845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:03 smithi049 bash[23528]: cluster 2024-09-21T03:42:02.278546+0000 mgr.a (mgr.14388) 14177 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:03 smithi049 bash[23528]: audit 2024-09-21T03:42:02.362561+0000 mgr.a (mgr.14388) 14178 : audit [DBG] from='client.307845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:05.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:04 smithi044 bash[22676]: audit 2024-09-21T03:42:03.970239+0000 mon.a (mon.0) 11431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:04 smithi044 bash[22676]: audit 2024-09-21T03:42:03.978877+0000 mon.a (mon.0) 11432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:04 smithi044 bash[22676]: audit 2024-09-21T03:42:03.989334+0000 mon.a (mon.0) 11433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:04 smithi044 bash[22676]: cluster 2024-09-21T03:42:04.279439+0000 mgr.a (mgr.14388) 14179 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:04 smithi179 bash[23186]: audit 2024-09-21T03:42:03.970239+0000 mon.a (mon.0) 11431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:04 smithi179 bash[23186]: audit 2024-09-21T03:42:03.978877+0000 mon.a (mon.0) 11432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:04 smithi179 bash[23186]: audit 2024-09-21T03:42:03.989334+0000 mon.a (mon.0) 11433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:04 smithi179 bash[23186]: cluster 2024-09-21T03:42:04.279439+0000 mgr.a (mgr.14388) 14179 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:05.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:04 smithi049 bash[23528]: audit 2024-09-21T03:42:03.970239+0000 mon.a (mon.0) 11431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:04 smithi049 bash[23528]: audit 2024-09-21T03:42:03.978877+0000 mon.a (mon.0) 11432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:04 smithi049 bash[23528]: audit 2024-09-21T03:42:03.989334+0000 mon.a (mon.0) 11433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:04 smithi049 bash[23528]: cluster 2024-09-21T03:42:04.279439+0000 mgr.a (mgr.14388) 14179 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:07 smithi044 bash[22676]: cluster 2024-09-21T03:42:06.281717+0000 mgr.a (mgr.14388) 14180 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:07 smithi179 bash[23186]: cluster 2024-09-21T03:42:06.281717+0000 mgr.a (mgr.14388) 14180 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:07 smithi049 bash[23528]: cluster 2024-09-21T03:42:06.281717+0000 mgr.a (mgr.14388) 14180 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:07.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:07.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:07.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:08.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:08.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:08.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:08.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:08.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:09 smithi044 bash[22676]: audit 2024-09-21T03:42:08.144964+0000 mgr.a (mgr.14388) 14181 : audit [DBG] from='client.307923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:09 smithi044 bash[22676]: cluster 2024-09-21T03:42:08.282647+0000 mgr.a (mgr.14388) 14182 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:09.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:09 smithi179 bash[23186]: audit 2024-09-21T03:42:08.144964+0000 mgr.a (mgr.14388) 14181 : audit [DBG] from='client.307923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:09.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:09 smithi179 bash[23186]: cluster 2024-09-21T03:42:08.282647+0000 mgr.a (mgr.14388) 14182 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:09 smithi049 bash[23528]: audit 2024-09-21T03:42:08.144964+0000 mgr.a (mgr.14388) 14181 : audit [DBG] from='client.307923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:09 smithi049 bash[23528]: cluster 2024-09-21T03:42:08.282647+0000 mgr.a (mgr.14388) 14182 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:10 smithi044 bash[22676]: audit 2024-09-21T03:42:10.035978+0000 mon.a (mon.0) 11434 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:42:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:10 smithi044 bash[22676]: audit 2024-09-21T03:42:10.040899+0000 mon.a (mon.0) 11435 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:42:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:10 smithi044 bash[22676]: audit 2024-09-21T03:42:10.042667+0000 mon.a (mon.0) 11436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:42:10.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:10 smithi044 bash[22676]: audit 2024-09-21T03:42:10.054745+0000 mon.a (mon.0) 11437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:10 smithi044 bash[22676]: audit 2024-09-21T03:42:10.062721+0000 mon.a (mon.0) 11438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:42:10.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:10 smithi179 bash[23186]: audit 2024-09-21T03:42:10.035978+0000 mon.a (mon.0) 11434 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:42:10.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:10 smithi179 bash[23186]: audit 2024-09-21T03:42:10.040899+0000 mon.a (mon.0) 11435 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:42:10.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:10 smithi179 bash[23186]: audit 2024-09-21T03:42:10.042667+0000 mon.a (mon.0) 11436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:42:10.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:10 smithi179 bash[23186]: audit 2024-09-21T03:42:10.054745+0000 mon.a (mon.0) 11437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:10.660 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:10 smithi179 bash[23186]: audit 2024-09-21T03:42:10.062721+0000 mon.a (mon.0) 11438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:42:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:10 smithi049 bash[23528]: audit 2024-09-21T03:42:10.035978+0000 mon.a (mon.0) 11434 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:42:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:10 smithi049 bash[23528]: audit 2024-09-21T03:42:10.040899+0000 mon.a (mon.0) 11435 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:42:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:10 smithi049 bash[23528]: audit 2024-09-21T03:42:10.042667+0000 mon.a (mon.0) 11436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:42:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:10 smithi049 bash[23528]: audit 2024-09-21T03:42:10.054745+0000 mon.a (mon.0) 11437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:10 smithi049 bash[23528]: audit 2024-09-21T03:42:10.062721+0000 mon.a (mon.0) 11438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:42:11.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:42:10 smithi044 bash[22930]: debug 2024-09-21T03:42:10.860+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:42:11.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:42:10 smithi044 bash[22930]: debug 2024-09-21T03:42:10.860+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:42:11.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:11 smithi179 bash[23186]: audit 2024-09-21T03:42:10.065241+0000 mgr.a (mgr.14388) 14183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:42:11.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:11 smithi179 bash[23186]: cluster 2024-09-21T03:42:10.283774+0000 mgr.a (mgr.14388) 14184 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:42:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:11 smithi044 bash[22676]: audit 2024-09-21T03:42:10.065241+0000 mgr.a (mgr.14388) 14183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:42:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:11 smithi044 bash[22676]: cluster 2024-09-21T03:42:10.283774+0000 mgr.a (mgr.14388) 14184 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:42:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:11 smithi049 bash[23528]: audit 2024-09-21T03:42:10.065241+0000 mgr.a (mgr.14388) 14183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:42:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:11 smithi049 bash[23528]: cluster 2024-09-21T03:42:10.283774+0000 mgr.a (mgr.14388) 14184 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:42:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:12 smithi049 bash[23528]: audit 2024-09-21T03:42:10.861809+0000 mgr.a (mgr.14388) 14185 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:42:12.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:12 smithi049 bash[23528]: cephadm 2024-09-21T03:42:10.863439+0000 mgr.a (mgr.14388) 14186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:42:12.661 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:12 smithi179 bash[23186]: audit 2024-09-21T03:42:10.861809+0000 mgr.a (mgr.14388) 14185 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:42:12.661 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:12 smithi179 bash[23186]: cephadm 2024-09-21T03:42:10.863439+0000 mgr.a (mgr.14388) 14186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:42:12.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:12 smithi044 bash[22676]: audit 2024-09-21T03:42:10.861809+0000 mgr.a (mgr.14388) 14185 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:42:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:12 smithi044 bash[22676]: cephadm 2024-09-21T03:42:10.863439+0000 mgr.a (mgr.14388) 14186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:42:13.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:13.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:13.629 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:13 smithi049 bash[23528]: cluster 2024-09-21T03:42:12.285514+0000 mgr.a (mgr.14388) 14187 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:42:13.682 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:13 smithi179 bash[23186]: cluster 2024-09-21T03:42:12.285514+0000 mgr.a (mgr.14388) 14187 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:42:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:13 smithi044 bash[22676]: cluster 2024-09-21T03:42:12.285514+0000 mgr.a (mgr.14388) 14187 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:42:14.335 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:14.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:14.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:14.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:14.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:15 smithi049 bash[23528]: audit 2024-09-21T03:42:13.916443+0000 mgr.a (mgr.14388) 14188 : audit [DBG] from='client.308103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:15.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:15 smithi049 bash[23528]: cluster 2024-09-21T03:42:14.286097+0000 mgr.a (mgr.14388) 14189 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:15 smithi044 bash[22676]: audit 2024-09-21T03:42:13.916443+0000 mgr.a (mgr.14388) 14188 : audit [DBG] from='client.308103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:15 smithi044 bash[22676]: cluster 2024-09-21T03:42:14.286097+0000 mgr.a (mgr.14388) 14189 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:15 smithi179 bash[23186]: audit 2024-09-21T03:42:13.916443+0000 mgr.a (mgr.14388) 14188 : audit [DBG] from='client.308103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:15 smithi179 bash[23186]: cluster 2024-09-21T03:42:14.286097+0000 mgr.a (mgr.14388) 14189 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:16 smithi044 bash[22676]: audit 2024-09-21T03:42:15.931571+0000 mon.a (mon.0) 11439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:16 smithi044 bash[22676]: audit 2024-09-21T03:42:15.938735+0000 mon.a (mon.0) 11440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:16 smithi044 bash[22676]: audit 2024-09-21T03:42:15.947749+0000 mon.a (mon.0) 11441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:16 smithi044 bash[22676]: audit 2024-09-21T03:42:16.232708+0000 mon.a (mon.0) 11442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:16 smithi044 bash[22676]: audit 2024-09-21T03:42:16.241267+0000 mon.a (mon.0) 11443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:16 smithi044 bash[22676]: audit 2024-09-21T03:42:16.251306+0000 mon.a (mon.0) 11444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:16 smithi044 bash[22676]: cluster 2024-09-21T03:42:16.288334+0000 mgr.a (mgr.14388) 14190 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:16 smithi179 bash[23186]: audit 2024-09-21T03:42:15.931571+0000 mon.a (mon.0) 11439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:16 smithi179 bash[23186]: audit 2024-09-21T03:42:15.938735+0000 mon.a (mon.0) 11440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:16 smithi179 bash[23186]: audit 2024-09-21T03:42:15.947749+0000 mon.a (mon.0) 11441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:16 smithi179 bash[23186]: audit 2024-09-21T03:42:16.232708+0000 mon.a (mon.0) 11442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:16 smithi179 bash[23186]: audit 2024-09-21T03:42:16.241267+0000 mon.a (mon.0) 11443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:16 smithi179 bash[23186]: audit 2024-09-21T03:42:16.251306+0000 mon.a (mon.0) 11444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:16 smithi179 bash[23186]: cluster 2024-09-21T03:42:16.288334+0000 mgr.a (mgr.14388) 14190 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:17.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:16 smithi049 bash[23528]: audit 2024-09-21T03:42:15.931571+0000 mon.a (mon.0) 11439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:16 smithi049 bash[23528]: audit 2024-09-21T03:42:15.938735+0000 mon.a (mon.0) 11440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:16 smithi049 bash[23528]: audit 2024-09-21T03:42:15.947749+0000 mon.a (mon.0) 11441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:16 smithi049 bash[23528]: audit 2024-09-21T03:42:16.232708+0000 mon.a (mon.0) 11442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:16 smithi049 bash[23528]: audit 2024-09-21T03:42:16.241267+0000 mon.a (mon.0) 11443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:16 smithi049 bash[23528]: audit 2024-09-21T03:42:16.251306+0000 mon.a (mon.0) 11444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:16 smithi049 bash[23528]: cluster 2024-09-21T03:42:16.288334+0000 mgr.a (mgr.14388) 14190 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:19.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:19 smithi044 bash[22676]: cluster 2024-09-21T03:42:18.289095+0000 mgr.a (mgr.14388) 14191 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:19 smithi179 bash[23186]: cluster 2024-09-21T03:42:18.289095+0000 mgr.a (mgr.14388) 14191 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:19 smithi049 bash[23528]: cluster 2024-09-21T03:42:18.289095+0000 mgr.a (mgr.14388) 14191 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:20.120 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:20.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:20.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:20.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:20.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:21 smithi044 bash[22676]: audit 2024-09-21T03:42:19.672997+0000 mgr.a (mgr.14388) 14192 : audit [DBG] from='client.308181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:21.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:21 smithi044 bash[22676]: cluster 2024-09-21T03:42:20.291107+0000 mgr.a (mgr.14388) 14193 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:21 smithi179 bash[23186]: audit 2024-09-21T03:42:19.672997+0000 mgr.a (mgr.14388) 14192 : audit [DBG] from='client.308181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:21 smithi179 bash[23186]: cluster 2024-09-21T03:42:20.291107+0000 mgr.a (mgr.14388) 14193 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:21 smithi049 bash[23528]: audit 2024-09-21T03:42:19.672997+0000 mgr.a (mgr.14388) 14192 : audit [DBG] from='client.308181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:21 smithi049 bash[23528]: cluster 2024-09-21T03:42:20.291107+0000 mgr.a (mgr.14388) 14193 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:42:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:23 smithi044 bash[22676]: cluster 2024-09-21T03:42:22.292391+0000 mgr.a (mgr.14388) 14194 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:23.819 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:23 smithi049 bash[23528]: cluster 2024-09-21T03:42:22.292391+0000 mgr.a (mgr.14388) 14194 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:23.820 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:23 smithi179 bash[23186]: cluster 2024-09-21T03:42:22.292391+0000 mgr.a (mgr.14388) 14194 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:25.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:25.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:25.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:25 smithi044 bash[22676]: audit 2024-09-21T03:42:24.207583+0000 mon.a (mon.0) 11445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:25 smithi044 bash[22676]: audit 2024-09-21T03:42:24.216630+0000 mon.a (mon.0) 11446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:25 smithi044 bash[22676]: audit 2024-09-21T03:42:24.227535+0000 mon.a (mon.0) 11447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:25 smithi044 bash[22676]: cluster 2024-09-21T03:42:24.293327+0000 mgr.a (mgr.14388) 14195 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:25 smithi179 bash[23186]: audit 2024-09-21T03:42:24.207583+0000 mon.a (mon.0) 11445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:25 smithi179 bash[23186]: audit 2024-09-21T03:42:24.216630+0000 mon.a (mon.0) 11446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:25 smithi179 bash[23186]: audit 2024-09-21T03:42:24.227535+0000 mon.a (mon.0) 11447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:25 smithi179 bash[23186]: cluster 2024-09-21T03:42:24.293327+0000 mgr.a (mgr.14388) 14195 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:25 smithi049 bash[23528]: audit 2024-09-21T03:42:24.207583+0000 mon.a (mon.0) 11445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:25 smithi049 bash[23528]: audit 2024-09-21T03:42:24.216630+0000 mon.a (mon.0) 11446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:25 smithi049 bash[23528]: audit 2024-09-21T03:42:24.227535+0000 mon.a (mon.0) 11447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:25.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:25 smithi049 bash[23528]: cluster 2024-09-21T03:42:24.293327+0000 mgr.a (mgr.14388) 14195 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:25.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:26.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:26 smithi044 bash[22676]: audit 2024-09-21T03:42:25.459101+0000 mgr.a (mgr.14388) 14196 : audit [DBG] from='client.308259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:26 smithi179 bash[23186]: audit 2024-09-21T03:42:25.459101+0000 mgr.a (mgr.14388) 14196 : audit [DBG] from='client.308259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:26 smithi049 bash[23528]: audit 2024-09-21T03:42:25.459101+0000 mgr.a (mgr.14388) 14196 : audit [DBG] from='client.308259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:27.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:27 smithi179 bash[23186]: cluster 2024-09-21T03:42:26.296297+0000 mgr.a (mgr.14388) 14197 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:27.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:27 smithi049 bash[23528]: cluster 2024-09-21T03:42:26.296297+0000 mgr.a (mgr.14388) 14197 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:27 smithi044 bash[22676]: cluster 2024-09-21T03:42:26.296297+0000 mgr.a (mgr.14388) 14197 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:29 smithi044 bash[22676]: cluster 2024-09-21T03:42:28.297306+0000 mgr.a (mgr.14388) 14198 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:42:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:29 smithi179 bash[23186]: cluster 2024-09-21T03:42:28.297306+0000 mgr.a (mgr.14388) 14198 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:42:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:29 smithi049 bash[23528]: cluster 2024-09-21T03:42:28.297306+0000 mgr.a (mgr.14388) 14198 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:42:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:31.659 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:31.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:31.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:31 smithi044 bash[22676]: cluster 2024-09-21T03:42:30.298382+0000 mgr.a (mgr.14388) 14199 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:42:31.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:31 smithi179 bash[23186]: cluster 2024-09-21T03:42:30.298382+0000 mgr.a (mgr.14388) 14199 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:42:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:31 smithi049 bash[23528]: cluster 2024-09-21T03:42:30.298382+0000 mgr.a (mgr.14388) 14199 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:42:32.489 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:32 smithi179 bash[23186]: audit 2024-09-21T03:42:31.238965+0000 mgr.a (mgr.14388) 14200 : audit [DBG] from='client.308337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:32.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:32 smithi044 bash[22676]: audit 2024-09-21T03:42:31.238965+0000 mgr.a (mgr.14388) 14200 : audit [DBG] from='client.308337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:32.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:32 smithi049 bash[23528]: audit 2024-09-21T03:42:31.238965+0000 mgr.a (mgr.14388) 14200 : audit [DBG] from='client.308337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:33 smithi179 bash[23186]: cluster 2024-09-21T03:42:32.300099+0000 mgr.a (mgr.14388) 14201 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:42:33.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:33 smithi044 bash[22676]: cluster 2024-09-21T03:42:32.300099+0000 mgr.a (mgr.14388) 14201 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:42:33.774 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:33 smithi049 bash[23528]: cluster 2024-09-21T03:42:32.300099+0000 mgr.a (mgr.14388) 14201 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:42:35.645 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:35 smithi049 bash[23528]: cluster 2024-09-21T03:42:34.300869+0000 mgr.a (mgr.14388) 14202 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:42:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:35 smithi044 bash[22676]: cluster 2024-09-21T03:42:34.300869+0000 mgr.a (mgr.14388) 14202 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:42:35.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:35 smithi179 bash[23186]: cluster 2024-09-21T03:42:34.300869+0000 mgr.a (mgr.14388) 14202 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:42:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:36.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:36.662 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:37.456 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:37.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:37.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:37.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:37.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:37.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:37 smithi044 bash[22676]: audit 2024-09-21T03:42:36.165122+0000 mon.a (mon.0) 11448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:37 smithi044 bash[22676]: audit 2024-09-21T03:42:36.173527+0000 mon.a (mon.0) 11449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:37 smithi044 bash[22676]: audit 2024-09-21T03:42:36.183989+0000 mon.a (mon.0) 11450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:37 smithi044 bash[22676]: cluster 2024-09-21T03:42:36.302983+0000 mgr.a (mgr.14388) 14203 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:42:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:37 smithi044 bash[22676]: audit 2024-09-21T03:42:36.460659+0000 mon.a (mon.0) 11451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:37 smithi044 bash[22676]: audit 2024-09-21T03:42:36.469301+0000 mon.a (mon.0) 11452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:37 smithi044 bash[22676]: audit 2024-09-21T03:42:36.479183+0000 mon.a (mon.0) 11453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:37 smithi179 bash[23186]: audit 2024-09-21T03:42:36.165122+0000 mon.a (mon.0) 11448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:37 smithi179 bash[23186]: audit 2024-09-21T03:42:36.173527+0000 mon.a (mon.0) 11449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:37 smithi179 bash[23186]: audit 2024-09-21T03:42:36.183989+0000 mon.a (mon.0) 11450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:37 smithi179 bash[23186]: cluster 2024-09-21T03:42:36.302983+0000 mgr.a (mgr.14388) 14203 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:42:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:37 smithi179 bash[23186]: audit 2024-09-21T03:42:36.460659+0000 mon.a (mon.0) 11451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:37 smithi179 bash[23186]: audit 2024-09-21T03:42:36.469301+0000 mon.a (mon.0) 11452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:37 smithi179 bash[23186]: audit 2024-09-21T03:42:36.479183+0000 mon.a (mon.0) 11453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:37 smithi049 bash[23528]: audit 2024-09-21T03:42:36.165122+0000 mon.a (mon.0) 11448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:37 smithi049 bash[23528]: audit 2024-09-21T03:42:36.173527+0000 mon.a (mon.0) 11449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:37 smithi049 bash[23528]: audit 2024-09-21T03:42:36.183989+0000 mon.a (mon.0) 11450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:37 smithi049 bash[23528]: cluster 2024-09-21T03:42:36.302983+0000 mgr.a (mgr.14388) 14203 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:42:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:37 smithi049 bash[23528]: audit 2024-09-21T03:42:36.460659+0000 mon.a (mon.0) 11451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:37 smithi049 bash[23528]: audit 2024-09-21T03:42:36.469301+0000 mon.a (mon.0) 11452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:37 smithi049 bash[23528]: audit 2024-09-21T03:42:36.479183+0000 mon.a (mon.0) 11453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:38.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:38 smithi044 bash[22676]: audit 2024-09-21T03:42:36.995869+0000 mgr.a (mgr.14388) 14204 : audit [DBG] from='client.308412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:38 smithi179 bash[23186]: audit 2024-09-21T03:42:36.995869+0000 mgr.a (mgr.14388) 14204 : audit [DBG] from='client.308412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:38 smithi049 bash[23528]: audit 2024-09-21T03:42:36.995869+0000 mgr.a (mgr.14388) 14204 : audit [DBG] from='client.308412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:39.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:39 smithi044 bash[22676]: cluster 2024-09-21T03:42:38.304043+0000 mgr.a (mgr.14388) 14205 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:39 smithi179 bash[23186]: cluster 2024-09-21T03:42:38.304043+0000 mgr.a (mgr.14388) 14205 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:39 smithi049 bash[23528]: cluster 2024-09-21T03:42:38.304043+0000 mgr.a (mgr.14388) 14205 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:41 smithi044 bash[22676]: cluster 2024-09-21T03:42:40.306384+0000 mgr.a (mgr.14388) 14206 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:41 smithi179 bash[23186]: cluster 2024-09-21T03:42:40.306384+0000 mgr.a (mgr.14388) 14206 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:41 smithi049 bash[23528]: cluster 2024-09-21T03:42:40.306384+0000 mgr.a (mgr.14388) 14206 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:43.220 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:43.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:43.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:43.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:43.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:43 smithi044 bash[22676]: cluster 2024-09-21T03:42:42.307342+0000 mgr.a (mgr.14388) 14207 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:43 smithi179 bash[23186]: cluster 2024-09-21T03:42:42.307342+0000 mgr.a (mgr.14388) 14207 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:43 smithi049 bash[23528]: cluster 2024-09-21T03:42:42.307342+0000 mgr.a (mgr.14388) 14207 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:42:44.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:44 smithi044 bash[22676]: audit 2024-09-21T03:42:42.790777+0000 mgr.a (mgr.14388) 14208 : audit [DBG] from='client.308487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:44 smithi179 bash[23186]: audit 2024-09-21T03:42:42.790777+0000 mgr.a (mgr.14388) 14208 : audit [DBG] from='client.308487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:44 smithi049 bash[23528]: audit 2024-09-21T03:42:42.790777+0000 mgr.a (mgr.14388) 14208 : audit [DBG] from='client.308487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:45 smithi044 bash[22676]: cluster 2024-09-21T03:42:44.308287+0000 mgr.a (mgr.14388) 14209 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:45 smithi044 bash[22676]: audit 2024-09-21T03:42:44.444318+0000 mon.a (mon.0) 11454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:45 smithi044 bash[22676]: audit 2024-09-21T03:42:44.454581+0000 mon.a (mon.0) 11455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:45 smithi044 bash[22676]: audit 2024-09-21T03:42:44.465067+0000 mon.a (mon.0) 11456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:45 smithi179 bash[23186]: cluster 2024-09-21T03:42:44.308287+0000 mgr.a (mgr.14388) 14209 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:45 smithi179 bash[23186]: audit 2024-09-21T03:42:44.444318+0000 mon.a (mon.0) 11454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:45 smithi179 bash[23186]: audit 2024-09-21T03:42:44.454581+0000 mon.a (mon.0) 11455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:45 smithi179 bash[23186]: audit 2024-09-21T03:42:44.465067+0000 mon.a (mon.0) 11456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:45 smithi049 bash[23528]: cluster 2024-09-21T03:42:44.308287+0000 mgr.a (mgr.14388) 14209 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:45 smithi049 bash[23528]: audit 2024-09-21T03:42:44.444318+0000 mon.a (mon.0) 11454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:45 smithi049 bash[23528]: audit 2024-09-21T03:42:44.454581+0000 mon.a (mon.0) 11455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:45 smithi049 bash[23528]: audit 2024-09-21T03:42:44.465067+0000 mon.a (mon.0) 11456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:47 smithi044 bash[22676]: cluster 2024-09-21T03:42:46.310538+0000 mgr.a (mgr.14388) 14210 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:47 smithi179 bash[23186]: cluster 2024-09-21T03:42:46.310538+0000 mgr.a (mgr.14388) 14210 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:47 smithi049 bash[23528]: cluster 2024-09-21T03:42:46.310538+0000 mgr.a (mgr.14388) 14210 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:48.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:48.999 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:48.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:48.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:48.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:48.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:49.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:49 smithi044 bash[22676]: cluster 2024-09-21T03:42:48.311222+0000 mgr.a (mgr.14388) 14211 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:49 smithi179 bash[23186]: cluster 2024-09-21T03:42:48.311222+0000 mgr.a (mgr.14388) 14211 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:49 smithi049 bash[23528]: cluster 2024-09-21T03:42:48.311222+0000 mgr.a (mgr.14388) 14211 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:50.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:50 smithi044 bash[22676]: audit 2024-09-21T03:42:48.563455+0000 mgr.a (mgr.14388) 14212 : audit [DBG] from='client.308565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:50 smithi179 bash[23186]: audit 2024-09-21T03:42:48.563455+0000 mgr.a (mgr.14388) 14212 : audit [DBG] from='client.308565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:50 smithi049 bash[23528]: audit 2024-09-21T03:42:48.563455+0000 mgr.a (mgr.14388) 14212 : audit [DBG] from='client.308565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:51 smithi044 bash[22676]: cluster 2024-09-21T03:42:50.313301+0000 mgr.a (mgr.14388) 14213 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:51 smithi179 bash[23186]: cluster 2024-09-21T03:42:50.313301+0000 mgr.a (mgr.14388) 14213 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:51 smithi049 bash[23528]: cluster 2024-09-21T03:42:50.313301+0000 mgr.a (mgr.14388) 14213 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:53 smithi044 bash[22676]: cluster 2024-09-21T03:42:52.314100+0000 mgr.a (mgr.14388) 14214 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:53 smithi179 bash[23186]: cluster 2024-09-21T03:42:52.314100+0000 mgr.a (mgr.14388) 14214 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:53 smithi049 bash[23528]: cluster 2024-09-21T03:42:52.314100+0000 mgr.a (mgr.14388) 14214 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:54.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:54.001 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:54.001 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:54.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:42:54.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:42:54.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:42:54.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:42:54.772 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:42:55.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:55 smithi044 bash[22676]: cluster 2024-09-21T03:42:54.314890+0000 mgr.a (mgr.14388) 14215 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:55 smithi044 bash[22676]: audit 2024-09-21T03:42:54.334664+0000 mgr.a (mgr.14388) 14216 : audit [DBG] from='client.308640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:55 smithi179 bash[23186]: cluster 2024-09-21T03:42:54.314890+0000 mgr.a (mgr.14388) 14215 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:55 smithi179 bash[23186]: audit 2024-09-21T03:42:54.334664+0000 mgr.a (mgr.14388) 14216 : audit [DBG] from='client.308640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:55 smithi049 bash[23528]: cluster 2024-09-21T03:42:54.314890+0000 mgr.a (mgr.14388) 14215 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:55 smithi049 bash[23528]: audit 2024-09-21T03:42:54.334664+0000 mgr.a (mgr.14388) 14216 : audit [DBG] from='client.308640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:57 smithi044 bash[22676]: cluster 2024-09-21T03:42:56.317463+0000 mgr.a (mgr.14388) 14217 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:57 smithi044 bash[22676]: audit 2024-09-21T03:42:56.407553+0000 mon.a (mon.0) 11457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:57 smithi044 bash[22676]: audit 2024-09-21T03:42:56.416185+0000 mon.a (mon.0) 11458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:57 smithi044 bash[22676]: audit 2024-09-21T03:42:56.426431+0000 mon.a (mon.0) 11459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:57 smithi044 bash[22676]: audit 2024-09-21T03:42:56.688256+0000 mon.a (mon.0) 11460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:57 smithi044 bash[22676]: audit 2024-09-21T03:42:56.696730+0000 mon.a (mon.0) 11461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:57 smithi044 bash[22676]: audit 2024-09-21T03:42:56.707091+0000 mon.a (mon.0) 11462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:57 smithi179 bash[23186]: cluster 2024-09-21T03:42:56.317463+0000 mgr.a (mgr.14388) 14217 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:57 smithi179 bash[23186]: audit 2024-09-21T03:42:56.407553+0000 mon.a (mon.0) 11457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:57 smithi179 bash[23186]: audit 2024-09-21T03:42:56.416185+0000 mon.a (mon.0) 11458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:57 smithi179 bash[23186]: audit 2024-09-21T03:42:56.426431+0000 mon.a (mon.0) 11459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:57 smithi179 bash[23186]: audit 2024-09-21T03:42:56.688256+0000 mon.a (mon.0) 11460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:57 smithi179 bash[23186]: audit 2024-09-21T03:42:56.696730+0000 mon.a (mon.0) 11461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:57 smithi179 bash[23186]: audit 2024-09-21T03:42:56.707091+0000 mon.a (mon.0) 11462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:57 smithi049 bash[23528]: cluster 2024-09-21T03:42:56.317463+0000 mgr.a (mgr.14388) 14217 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:42:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:57 smithi049 bash[23528]: audit 2024-09-21T03:42:56.407553+0000 mon.a (mon.0) 11457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:57 smithi049 bash[23528]: audit 2024-09-21T03:42:56.416185+0000 mon.a (mon.0) 11458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:57 smithi049 bash[23528]: audit 2024-09-21T03:42:56.426431+0000 mon.a (mon.0) 11459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:57 smithi049 bash[23528]: audit 2024-09-21T03:42:56.688256+0000 mon.a (mon.0) 11460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:57 smithi049 bash[23528]: audit 2024-09-21T03:42:56.696730+0000 mon.a (mon.0) 11461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:57 smithi049 bash[23528]: audit 2024-09-21T03:42:56.707091+0000 mon.a (mon.0) 11462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:42:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:42:59 smithi044 bash[22676]: cluster 2024-09-21T03:42:58.318432+0000 mgr.a (mgr.14388) 14218 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:42:59 smithi179 bash[23186]: cluster 2024-09-21T03:42:58.318432+0000 mgr.a (mgr.14388) 14218 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:42:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:42:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:42:59.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:42:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:42:59 smithi049 bash[23528]: cluster 2024-09-21T03:42:58.318432+0000 mgr.a (mgr.14388) 14218 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:00.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:01 smithi044 bash[22676]: audit 2024-09-21T03:43:00.113710+0000 mgr.a (mgr.14388) 14219 : audit [DBG] from='client.308718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:01 smithi044 bash[22676]: cluster 2024-09-21T03:43:00.319766+0000 mgr.a (mgr.14388) 14220 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:01 smithi179 bash[23186]: audit 2024-09-21T03:43:00.113710+0000 mgr.a (mgr.14388) 14219 : audit [DBG] from='client.308718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:01 smithi179 bash[23186]: cluster 2024-09-21T03:43:00.319766+0000 mgr.a (mgr.14388) 14220 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:01 smithi049 bash[23528]: audit 2024-09-21T03:43:00.113710+0000 mgr.a (mgr.14388) 14219 : audit [DBG] from='client.308718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:01.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:01 smithi049 bash[23528]: cluster 2024-09-21T03:43:00.319766+0000 mgr.a (mgr.14388) 14220 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:03 smithi044 bash[22676]: cluster 2024-09-21T03:43:02.320710+0000 mgr.a (mgr.14388) 14221 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:43:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:03 smithi179 bash[23186]: cluster 2024-09-21T03:43:02.320710+0000 mgr.a (mgr.14388) 14221 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:43:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:03 smithi049 bash[23528]: cluster 2024-09-21T03:43:02.320710+0000 mgr.a (mgr.14388) 14221 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:43:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:05 smithi044 bash[22676]: cluster 2024-09-21T03:43:04.321525+0000 mgr.a (mgr.14388) 14222 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:05 smithi044 bash[22676]: audit 2024-09-21T03:43:04.677650+0000 mon.a (mon.0) 11463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:05 smithi044 bash[22676]: audit 2024-09-21T03:43:04.686207+0000 mon.a (mon.0) 11464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:05 smithi044 bash[22676]: audit 2024-09-21T03:43:04.696871+0000 mon.a (mon.0) 11465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:05 smithi179 bash[23186]: cluster 2024-09-21T03:43:04.321525+0000 mgr.a (mgr.14388) 14222 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:05 smithi179 bash[23186]: audit 2024-09-21T03:43:04.677650+0000 mon.a (mon.0) 11463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:05 smithi179 bash[23186]: audit 2024-09-21T03:43:04.686207+0000 mon.a (mon.0) 11464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:05 smithi179 bash[23186]: audit 2024-09-21T03:43:04.696871+0000 mon.a (mon.0) 11465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:05 smithi049 bash[23528]: cluster 2024-09-21T03:43:04.321525+0000 mgr.a (mgr.14388) 14222 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:05 smithi049 bash[23528]: audit 2024-09-21T03:43:04.677650+0000 mon.a (mon.0) 11463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:05 smithi049 bash[23528]: audit 2024-09-21T03:43:04.686207+0000 mon.a (mon.0) 11464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:05 smithi049 bash[23528]: audit 2024-09-21T03:43:04.696871+0000 mon.a (mon.0) 11465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:06.348 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:06.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:06.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:06.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:06.349 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:07 smithi044 bash[22676]: audit 2024-09-21T03:43:05.900872+0000 mgr.a (mgr.14388) 14223 : audit [DBG] from='client.308790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:07 smithi044 bash[22676]: cluster 2024-09-21T03:43:06.322796+0000 mgr.a (mgr.14388) 14224 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:07 smithi179 bash[23186]: audit 2024-09-21T03:43:05.900872+0000 mgr.a (mgr.14388) 14223 : audit [DBG] from='client.308790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:07 smithi179 bash[23186]: cluster 2024-09-21T03:43:06.322796+0000 mgr.a (mgr.14388) 14224 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:07 smithi049 bash[23528]: audit 2024-09-21T03:43:05.900872+0000 mgr.a (mgr.14388) 14223 : audit [DBG] from='client.308790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:07 smithi049 bash[23528]: cluster 2024-09-21T03:43:06.322796+0000 mgr.a (mgr.14388) 14224 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:09.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:09 smithi044 bash[22676]: cluster 2024-09-21T03:43:08.323701+0000 mgr.a (mgr.14388) 14225 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:09.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:09 smithi179 bash[23186]: cluster 2024-09-21T03:43:08.323701+0000 mgr.a (mgr.14388) 14225 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:09 smithi049 bash[23528]: cluster 2024-09-21T03:43:08.323701+0000 mgr.a (mgr.14388) 14225 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:11.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22676]: cluster 2024-09-21T03:43:10.324881+0000 mgr.a (mgr.14388) 14226 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22676]: audit 2024-09-21T03:43:10.940794+0000 mon.a (mon.0) 11466 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:43:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22676]: audit 2024-09-21T03:43:10.946847+0000 mon.a (mon.0) 11467 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:43:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22676]: audit 2024-09-21T03:43:10.948495+0000 mon.a (mon.0) 11468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:43:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22676]: audit 2024-09-21T03:43:10.961962+0000 mon.a (mon.0) 11469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22676]: audit 2024-09-21T03:43:10.968536+0000 mon.a (mon.0) 11470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:43:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:11 smithi179 bash[23186]: cluster 2024-09-21T03:43:10.324881+0000 mgr.a (mgr.14388) 14226 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:11 smithi179 bash[23186]: audit 2024-09-21T03:43:10.940794+0000 mon.a (mon.0) 11466 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:43:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:11 smithi179 bash[23186]: audit 2024-09-21T03:43:10.946847+0000 mon.a (mon.0) 11467 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:43:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:11 smithi179 bash[23186]: audit 2024-09-21T03:43:10.948495+0000 mon.a (mon.0) 11468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:43:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:11 smithi179 bash[23186]: audit 2024-09-21T03:43:10.961962+0000 mon.a (mon.0) 11469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:11 smithi179 bash[23186]: audit 2024-09-21T03:43:10.968536+0000 mon.a (mon.0) 11470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:43:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:11 smithi049 bash[23528]: cluster 2024-09-21T03:43:10.324881+0000 mgr.a (mgr.14388) 14226 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:11 smithi049 bash[23528]: audit 2024-09-21T03:43:10.940794+0000 mon.a (mon.0) 11466 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:43:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:11 smithi049 bash[23528]: audit 2024-09-21T03:43:10.946847+0000 mon.a (mon.0) 11467 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:43:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:11 smithi049 bash[23528]: audit 2024-09-21T03:43:10.948495+0000 mon.a (mon.0) 11468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:43:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:11 smithi049 bash[23528]: audit 2024-09-21T03:43:10.961962+0000 mon.a (mon.0) 11469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:11 smithi049 bash[23528]: audit 2024-09-21T03:43:10.968536+0000 mon.a (mon.0) 11470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:43:12.156 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:12.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22930]: debug 2024-09-21T03:43:11.747+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:43:12.237 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:43:11 smithi044 bash[22930]: debug 2024-09-21T03:43:11.755+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:43:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:12 smithi044 bash[22676]: audit 2024-09-21T03:43:10.970941+0000 mgr.a (mgr.14388) 14227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:43:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:12 smithi179 bash[23186]: audit 2024-09-21T03:43:10.970941+0000 mgr.a (mgr.14388) 14227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:43:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:12 smithi049 bash[23528]: audit 2024-09-21T03:43:10.970941+0000 mgr.a (mgr.14388) 14227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:43:13.625 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:13 smithi179 bash[23186]: audit 2024-09-21T03:43:11.684798+0000 mgr.a (mgr.14388) 14228 : audit [DBG] from='client.308937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:13.625 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:13 smithi179 bash[23186]: audit 2024-09-21T03:43:11.749427+0000 mgr.a (mgr.14388) 14229 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:43:13.625 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:13 smithi179 bash[23186]: cephadm 2024-09-21T03:43:11.760639+0000 mgr.a (mgr.14388) 14230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:43:13.625 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:13 smithi179 bash[23186]: cluster 2024-09-21T03:43:12.325846+0000 mgr.a (mgr.14388) 14231 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:13 smithi044 bash[22676]: audit 2024-09-21T03:43:11.684798+0000 mgr.a (mgr.14388) 14228 : audit [DBG] from='client.308937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:13 smithi044 bash[22676]: audit 2024-09-21T03:43:11.749427+0000 mgr.a (mgr.14388) 14229 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:43:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:13 smithi044 bash[22676]: cephadm 2024-09-21T03:43:11.760639+0000 mgr.a (mgr.14388) 14230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:43:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:13 smithi044 bash[22676]: cluster 2024-09-21T03:43:12.325846+0000 mgr.a (mgr.14388) 14231 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:13 smithi049 bash[23528]: audit 2024-09-21T03:43:11.684798+0000 mgr.a (mgr.14388) 14228 : audit [DBG] from='client.308937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:13 smithi049 bash[23528]: audit 2024-09-21T03:43:11.749427+0000 mgr.a (mgr.14388) 14229 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:43:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:13 smithi049 bash[23528]: cephadm 2024-09-21T03:43:11.760639+0000 mgr.a (mgr.14388) 14230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:43:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:13 smithi049 bash[23528]: cluster 2024-09-21T03:43:12.325846+0000 mgr.a (mgr.14388) 14231 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:15 smithi044 bash[22676]: cluster 2024-09-21T03:43:14.326657+0000 mgr.a (mgr.14388) 14232 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:15 smithi179 bash[23186]: cluster 2024-09-21T03:43:14.326657+0000 mgr.a (mgr.14388) 14232 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:15 smithi049 bash[23528]: cluster 2024-09-21T03:43:14.326657+0000 mgr.a (mgr.14388) 14232 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:17 smithi044 bash[22676]: cluster 2024-09-21T03:43:16.328902+0000 mgr.a (mgr.14388) 14233 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:17 smithi044 bash[22676]: audit 2024-09-21T03:43:16.638550+0000 mon.a (mon.0) 11471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:17 smithi044 bash[22676]: audit 2024-09-21T03:43:16.646910+0000 mon.a (mon.0) 11472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:17 smithi044 bash[22676]: audit 2024-09-21T03:43:16.658827+0000 mon.a (mon.0) 11473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:17 smithi044 bash[22676]: audit 2024-09-21T03:43:16.911355+0000 mon.a (mon.0) 11474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:17 smithi044 bash[22676]: audit 2024-09-21T03:43:16.920843+0000 mon.a (mon.0) 11475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:17 smithi044 bash[22676]: audit 2024-09-21T03:43:16.930852+0000 mon.a (mon.0) 11476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:17 smithi179 bash[23186]: cluster 2024-09-21T03:43:16.328902+0000 mgr.a (mgr.14388) 14233 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:17 smithi179 bash[23186]: audit 2024-09-21T03:43:16.638550+0000 mon.a (mon.0) 11471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:17 smithi179 bash[23186]: audit 2024-09-21T03:43:16.646910+0000 mon.a (mon.0) 11472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:17 smithi179 bash[23186]: audit 2024-09-21T03:43:16.658827+0000 mon.a (mon.0) 11473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:17 smithi179 bash[23186]: audit 2024-09-21T03:43:16.911355+0000 mon.a (mon.0) 11474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:17 smithi179 bash[23186]: audit 2024-09-21T03:43:16.920843+0000 mon.a (mon.0) 11475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:17 smithi179 bash[23186]: audit 2024-09-21T03:43:16.930852+0000 mon.a (mon.0) 11476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:17 smithi049 bash[23528]: cluster 2024-09-21T03:43:16.328902+0000 mgr.a (mgr.14388) 14233 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:17 smithi049 bash[23528]: audit 2024-09-21T03:43:16.638550+0000 mon.a (mon.0) 11471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:17 smithi049 bash[23528]: audit 2024-09-21T03:43:16.646910+0000 mon.a (mon.0) 11472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:17 smithi049 bash[23528]: audit 2024-09-21T03:43:16.658827+0000 mon.a (mon.0) 11473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:17 smithi049 bash[23528]: audit 2024-09-21T03:43:16.911355+0000 mon.a (mon.0) 11474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:17 smithi049 bash[23528]: audit 2024-09-21T03:43:16.920843+0000 mon.a (mon.0) 11475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:17 smithi049 bash[23528]: audit 2024-09-21T03:43:16.930852+0000 mon.a (mon.0) 11476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:17.932 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:17.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:17.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:17.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:17.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:18.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:18 smithi044 bash[22676]: audit 2024-09-21T03:43:17.496088+0000 mgr.a (mgr.14388) 14234 : audit [DBG] from='client.309051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:18 smithi179 bash[23186]: audit 2024-09-21T03:43:17.496088+0000 mgr.a (mgr.14388) 14234 : audit [DBG] from='client.309051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:18 smithi049 bash[23528]: audit 2024-09-21T03:43:17.496088+0000 mgr.a (mgr.14388) 14234 : audit [DBG] from='client.309051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:19.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:19 smithi044 bash[22676]: cluster 2024-09-21T03:43:18.329877+0000 mgr.a (mgr.14388) 14235 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:19 smithi179 bash[23186]: cluster 2024-09-21T03:43:18.329877+0000 mgr.a (mgr.14388) 14235 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:19 smithi049 bash[23528]: cluster 2024-09-21T03:43:18.329877+0000 mgr.a (mgr.14388) 14235 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:20 smithi049 bash[23528]: cluster 2024-09-21T03:43:20.332049+0000 mgr.a (mgr.14388) 14236 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:21.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:20 smithi044 bash[22676]: cluster 2024-09-21T03:43:20.332049+0000 mgr.a (mgr.14388) 14236 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:21.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:20 smithi179 bash[23186]: cluster 2024-09-21T03:43:20.332049+0000 mgr.a (mgr.14388) 14236 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:22.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:22.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:23.691 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:23 smithi044 bash[22676]: cluster 2024-09-21T03:43:22.332812+0000 mgr.a (mgr.14388) 14237 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:23 smithi179 bash[23186]: cluster 2024-09-21T03:43:22.332812+0000 mgr.a (mgr.14388) 14237 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:23 smithi049 bash[23528]: cluster 2024-09-21T03:43:22.332812+0000 mgr.a (mgr.14388) 14237 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:24.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:24 smithi044 bash[22676]: audit 2024-09-21T03:43:23.258399+0000 mgr.a (mgr.14388) 14238 : audit [DBG] from='client.309129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:24 smithi179 bash[23186]: audit 2024-09-21T03:43:23.258399+0000 mgr.a (mgr.14388) 14238 : audit [DBG] from='client.309129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:24 smithi049 bash[23528]: audit 2024-09-21T03:43:23.258399+0000 mgr.a (mgr.14388) 14238 : audit [DBG] from='client.309129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:25 smithi044 bash[22676]: cluster 2024-09-21T03:43:24.333849+0000 mgr.a (mgr.14388) 14239 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:25 smithi044 bash[22676]: audit 2024-09-21T03:43:24.901099+0000 mon.a (mon.0) 11477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:25 smithi044 bash[22676]: audit 2024-09-21T03:43:24.910064+0000 mon.a (mon.0) 11478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:25 smithi044 bash[22676]: audit 2024-09-21T03:43:24.920598+0000 mon.a (mon.0) 11479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:25 smithi179 bash[23186]: cluster 2024-09-21T03:43:24.333849+0000 mgr.a (mgr.14388) 14239 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:25 smithi179 bash[23186]: audit 2024-09-21T03:43:24.901099+0000 mon.a (mon.0) 11477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:25 smithi179 bash[23186]: audit 2024-09-21T03:43:24.910064+0000 mon.a (mon.0) 11478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:25 smithi179 bash[23186]: audit 2024-09-21T03:43:24.920598+0000 mon.a (mon.0) 11479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:25 smithi049 bash[23528]: cluster 2024-09-21T03:43:24.333849+0000 mgr.a (mgr.14388) 14239 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:25 smithi049 bash[23528]: audit 2024-09-21T03:43:24.901099+0000 mon.a (mon.0) 11477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:25 smithi049 bash[23528]: audit 2024-09-21T03:43:24.910064+0000 mon.a (mon.0) 11478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:25 smithi049 bash[23528]: audit 2024-09-21T03:43:24.920598+0000 mon.a (mon.0) 11479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:27.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:27 smithi044 bash[22676]: cluster 2024-09-21T03:43:26.336091+0000 mgr.a (mgr.14388) 14240 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:27 smithi179 bash[23186]: cluster 2024-09-21T03:43:26.336091+0000 mgr.a (mgr.14388) 14240 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:27 smithi049 bash[23528]: cluster 2024-09-21T03:43:26.336091+0000 mgr.a (mgr.14388) 14240 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:43:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:29.454 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:29.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:29.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:29.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:29.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:29 smithi044 bash[22676]: cluster 2024-09-21T03:43:28.336881+0000 mgr.a (mgr.14388) 14241 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:29 smithi179 bash[23186]: cluster 2024-09-21T03:43:28.336881+0000 mgr.a (mgr.14388) 14241 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:29 smithi049 bash[23528]: cluster 2024-09-21T03:43:28.336881+0000 mgr.a (mgr.14388) 14241 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:30.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:30 smithi044 bash[22676]: audit 2024-09-21T03:43:29.015843+0000 mgr.a (mgr.14388) 14242 : audit [DBG] from='client.309207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:30 smithi179 bash[23186]: audit 2024-09-21T03:43:29.015843+0000 mgr.a (mgr.14388) 14242 : audit [DBG] from='client.309207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:30 smithi049 bash[23528]: audit 2024-09-21T03:43:29.015843+0000 mgr.a (mgr.14388) 14242 : audit [DBG] from='client.309207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:31.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:31 smithi044 bash[22676]: cluster 2024-09-21T03:43:30.339230+0000 mgr.a (mgr.14388) 14243 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:43:31.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:31 smithi179 bash[23186]: cluster 2024-09-21T03:43:30.339230+0000 mgr.a (mgr.14388) 14243 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:43:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:31 smithi049 bash[23528]: cluster 2024-09-21T03:43:30.339230+0000 mgr.a (mgr.14388) 14243 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:43:33.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:33 smithi179 bash[23186]: cluster 2024-09-21T03:43:32.340215+0000 mgr.a (mgr.14388) 14244 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:33.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:33 smithi044 bash[22676]: cluster 2024-09-21T03:43:32.340215+0000 mgr.a (mgr.14388) 14244 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:33 smithi049 bash[23528]: cluster 2024-09-21T03:43:32.340215+0000 mgr.a (mgr.14388) 14244 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:34.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:34.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:35.252 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:35 smithi044 bash[22676]: cluster 2024-09-21T03:43:34.340990+0000 mgr.a (mgr.14388) 14245 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:35.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:35 smithi179 bash[23186]: cluster 2024-09-21T03:43:34.340990+0000 mgr.a (mgr.14388) 14245 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:35 smithi049 bash[23528]: cluster 2024-09-21T03:43:34.340990+0000 mgr.a (mgr.14388) 14245 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:36.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:36 smithi044 bash[22676]: audit 2024-09-21T03:43:34.797107+0000 mgr.a (mgr.14388) 14246 : audit [DBG] from='client.309282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:36 smithi179 bash[23186]: audit 2024-09-21T03:43:34.797107+0000 mgr.a (mgr.14388) 14246 : audit [DBG] from='client.309282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:36.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:36 smithi049 bash[23528]: audit 2024-09-21T03:43:34.797107+0000 mgr.a (mgr.14388) 14246 : audit [DBG] from='client.309282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:37 smithi049 bash[23528]: cluster 2024-09-21T03:43:36.343635+0000 mgr.a (mgr.14388) 14247 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:43:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:37 smithi049 bash[23528]: audit 2024-09-21T03:43:36.833395+0000 mon.a (mon.0) 11480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:37 smithi049 bash[23528]: audit 2024-09-21T03:43:36.838636+0000 mon.a (mon.0) 11481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:37 smithi049 bash[23528]: audit 2024-09-21T03:43:36.846600+0000 mon.a (mon.0) 11482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:37 smithi049 bash[23528]: audit 2024-09-21T03:43:37.113336+0000 mon.a (mon.0) 11483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:37 smithi049 bash[23528]: audit 2024-09-21T03:43:37.123573+0000 mon.a (mon.0) 11484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:37 smithi049 bash[23528]: audit 2024-09-21T03:43:37.134005+0000 mon.a (mon.0) 11485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:37 smithi044 bash[22676]: cluster 2024-09-21T03:43:36.343635+0000 mgr.a (mgr.14388) 14247 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:37 smithi044 bash[22676]: audit 2024-09-21T03:43:36.833395+0000 mon.a (mon.0) 11480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:37 smithi044 bash[22676]: audit 2024-09-21T03:43:36.838636+0000 mon.a (mon.0) 11481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:37 smithi044 bash[22676]: audit 2024-09-21T03:43:36.846600+0000 mon.a (mon.0) 11482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:37 smithi044 bash[22676]: audit 2024-09-21T03:43:37.113336+0000 mon.a (mon.0) 11483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:37 smithi044 bash[22676]: audit 2024-09-21T03:43:37.123573+0000 mon.a (mon.0) 11484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:37 smithi044 bash[22676]: audit 2024-09-21T03:43:37.134005+0000 mon.a (mon.0) 11485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:37 smithi179 bash[23186]: cluster 2024-09-21T03:43:36.343635+0000 mgr.a (mgr.14388) 14247 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:43:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:37 smithi179 bash[23186]: audit 2024-09-21T03:43:36.833395+0000 mon.a (mon.0) 11480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:37 smithi179 bash[23186]: audit 2024-09-21T03:43:36.838636+0000 mon.a (mon.0) 11481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:37 smithi179 bash[23186]: audit 2024-09-21T03:43:36.846600+0000 mon.a (mon.0) 11482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:37 smithi179 bash[23186]: audit 2024-09-21T03:43:37.113336+0000 mon.a (mon.0) 11483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:37 smithi179 bash[23186]: audit 2024-09-21T03:43:37.123573+0000 mon.a (mon.0) 11484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:37 smithi179 bash[23186]: audit 2024-09-21T03:43:37.134005+0000 mon.a (mon.0) 11485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:39.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:39 smithi044 bash[22676]: cluster 2024-09-21T03:43:38.344462+0000 mgr.a (mgr.14388) 14248 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:43:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:39 smithi179 bash[23186]: cluster 2024-09-21T03:43:38.344462+0000 mgr.a (mgr.14388) 14248 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:43:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:39 smithi049 bash[23528]: cluster 2024-09-21T03:43:38.344462+0000 mgr.a (mgr.14388) 14248 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:43:40.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:41.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:41 smithi044 bash[22676]: cluster 2024-09-21T03:43:40.346429+0000 mgr.a (mgr.14388) 14249 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:41 smithi179 bash[23186]: cluster 2024-09-21T03:43:40.346429+0000 mgr.a (mgr.14388) 14249 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:41 smithi049 bash[23528]: cluster 2024-09-21T03:43:40.346429+0000 mgr.a (mgr.14388) 14249 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:42 smithi044 bash[22676]: audit 2024-09-21T03:43:40.588479+0000 mgr.a (mgr.14388) 14250 : audit [DBG] from='client.309360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:42 smithi179 bash[23186]: audit 2024-09-21T03:43:40.588479+0000 mgr.a (mgr.14388) 14250 : audit [DBG] from='client.309360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:42 smithi049 bash[23528]: audit 2024-09-21T03:43:40.588479+0000 mgr.a (mgr.14388) 14250 : audit [DBG] from='client.309360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:43.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:43 smithi044 bash[22676]: cluster 2024-09-21T03:43:42.347487+0000 mgr.a (mgr.14388) 14251 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:43:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:43 smithi179 bash[23186]: cluster 2024-09-21T03:43:42.347487+0000 mgr.a (mgr.14388) 14251 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:43:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:43 smithi049 bash[23528]: cluster 2024-09-21T03:43:42.347487+0000 mgr.a (mgr.14388) 14251 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:43:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:45 smithi044 bash[22676]: cluster 2024-09-21T03:43:44.348294+0000 mgr.a (mgr.14388) 14252 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:45 smithi044 bash[22676]: audit 2024-09-21T03:43:45.133217+0000 mon.a (mon.0) 11486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:45 smithi044 bash[22676]: audit 2024-09-21T03:43:45.143054+0000 mon.a (mon.0) 11487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:45 smithi044 bash[22676]: audit 2024-09-21T03:43:45.153580+0000 mon.a (mon.0) 11488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:45 smithi179 bash[23186]: cluster 2024-09-21T03:43:44.348294+0000 mgr.a (mgr.14388) 14252 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:45 smithi179 bash[23186]: audit 2024-09-21T03:43:45.133217+0000 mon.a (mon.0) 11486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:45 smithi179 bash[23186]: audit 2024-09-21T03:43:45.143054+0000 mon.a (mon.0) 11487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:45 smithi179 bash[23186]: audit 2024-09-21T03:43:45.153580+0000 mon.a (mon.0) 11488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:45 smithi049 bash[23528]: cluster 2024-09-21T03:43:44.348294+0000 mgr.a (mgr.14388) 14252 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:43:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:45 smithi049 bash[23528]: audit 2024-09-21T03:43:45.133217+0000 mon.a (mon.0) 11486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:45 smithi049 bash[23528]: audit 2024-09-21T03:43:45.143054+0000 mon.a (mon.0) 11487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:45 smithi049 bash[23528]: audit 2024-09-21T03:43:45.153580+0000 mon.a (mon.0) 11488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:46.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:46.020 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:46.020 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:46.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:46.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:47.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:47 smithi044 bash[22676]: cluster 2024-09-21T03:43:46.350609+0000 mgr.a (mgr.14388) 14253 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:47 smithi044 bash[22676]: audit 2024-09-21T03:43:46.352455+0000 mgr.a (mgr.14388) 14254 : audit [DBG] from='client.309438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:47 smithi179 bash[23186]: cluster 2024-09-21T03:43:46.350609+0000 mgr.a (mgr.14388) 14253 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:47 smithi179 bash[23186]: audit 2024-09-21T03:43:46.352455+0000 mgr.a (mgr.14388) 14254 : audit [DBG] from='client.309438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:47 smithi049 bash[23528]: cluster 2024-09-21T03:43:46.350609+0000 mgr.a (mgr.14388) 14253 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:47 smithi049 bash[23528]: audit 2024-09-21T03:43:46.352455+0000 mgr.a (mgr.14388) 14254 : audit [DBG] from='client.309438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:49 smithi044 bash[22676]: cluster 2024-09-21T03:43:48.351564+0000 mgr.a (mgr.14388) 14255 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:43:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:49 smithi179 bash[23186]: cluster 2024-09-21T03:43:48.351564+0000 mgr.a (mgr.14388) 14255 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:43:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:49 smithi049 bash[23528]: cluster 2024-09-21T03:43:48.351564+0000 mgr.a (mgr.14388) 14255 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:43:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:51 smithi044 bash[22676]: cluster 2024-09-21T03:43:50.353836+0000 mgr.a (mgr.14388) 14256 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:43:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:51 smithi179 bash[23186]: cluster 2024-09-21T03:43:50.353836+0000 mgr.a (mgr.14388) 14256 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:43:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:51.801 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:51 smithi049 bash[23528]: cluster 2024-09-21T03:43:50.353836+0000 mgr.a (mgr.14388) 14256 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:43:52.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:52.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:52.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:52.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:52.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:53 smithi044 bash[22676]: audit 2024-09-21T03:43:52.132987+0000 mgr.a (mgr.14388) 14257 : audit [DBG] from='client.309516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:53 smithi044 bash[22676]: cluster 2024-09-21T03:43:52.354334+0000 mgr.a (mgr.14388) 14258 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:53 smithi179 bash[23186]: audit 2024-09-21T03:43:52.132987+0000 mgr.a (mgr.14388) 14257 : audit [DBG] from='client.309516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:53 smithi179 bash[23186]: cluster 2024-09-21T03:43:52.354334+0000 mgr.a (mgr.14388) 14258 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:53 smithi049 bash[23528]: audit 2024-09-21T03:43:52.132987+0000 mgr.a (mgr.14388) 14257 : audit [DBG] from='client.309516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:53 smithi049 bash[23528]: cluster 2024-09-21T03:43:52.354334+0000 mgr.a (mgr.14388) 14258 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:55.752 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:55 smithi049 bash[23528]: cluster 2024-09-21T03:43:54.355319+0000 mgr.a (mgr.14388) 14259 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:55 smithi179 bash[23186]: cluster 2024-09-21T03:43:54.355319+0000 mgr.a (mgr.14388) 14259 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:55.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:55 smithi044 bash[22676]: cluster 2024-09-21T03:43:54.355319+0000 mgr.a (mgr.14388) 14259 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:57.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:43:57.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:43:57.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:43:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:57 smithi179 bash[23186]: cluster 2024-09-21T03:43:56.357605+0000 mgr.a (mgr.14388) 14260 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:43:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:57 smithi179 bash[23186]: audit 2024-09-21T03:43:57.053612+0000 mon.a (mon.0) 11489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:57 smithi179 bash[23186]: audit 2024-09-21T03:43:57.062563+0000 mon.a (mon.0) 11490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:57 smithi179 bash[23186]: audit 2024-09-21T03:43:57.073902+0000 mon.a (mon.0) 11491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:57 smithi179 bash[23186]: audit 2024-09-21T03:43:57.309268+0000 mon.a (mon.0) 11492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:57 smithi179 bash[23186]: audit 2024-09-21T03:43:57.317886+0000 mon.a (mon.0) 11493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:57 smithi179 bash[23186]: audit 2024-09-21T03:43:57.328017+0000 mon.a (mon.0) 11494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:57 smithi049 bash[23528]: cluster 2024-09-21T03:43:56.357605+0000 mgr.a (mgr.14388) 14260 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:43:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:57 smithi049 bash[23528]: audit 2024-09-21T03:43:57.053612+0000 mon.a (mon.0) 11489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:57 smithi049 bash[23528]: audit 2024-09-21T03:43:57.062563+0000 mon.a (mon.0) 11490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:57 smithi049 bash[23528]: audit 2024-09-21T03:43:57.073902+0000 mon.a (mon.0) 11491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:57 smithi049 bash[23528]: audit 2024-09-21T03:43:57.309268+0000 mon.a (mon.0) 11492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:57 smithi049 bash[23528]: audit 2024-09-21T03:43:57.317886+0000 mon.a (mon.0) 11493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:57 smithi049 bash[23528]: audit 2024-09-21T03:43:57.328017+0000 mon.a (mon.0) 11494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:57 smithi044 bash[22676]: cluster 2024-09-21T03:43:56.357605+0000 mgr.a (mgr.14388) 14260 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:43:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:57 smithi044 bash[22676]: audit 2024-09-21T03:43:57.053612+0000 mon.a (mon.0) 11489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:57 smithi044 bash[22676]: audit 2024-09-21T03:43:57.062563+0000 mon.a (mon.0) 11490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:57 smithi044 bash[22676]: audit 2024-09-21T03:43:57.073902+0000 mon.a (mon.0) 11491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:57 smithi044 bash[22676]: audit 2024-09-21T03:43:57.309268+0000 mon.a (mon.0) 11492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:57 smithi044 bash[22676]: audit 2024-09-21T03:43:57.317886+0000 mon.a (mon.0) 11493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:57 smithi044 bash[22676]: audit 2024-09-21T03:43:57.328017+0000 mon.a (mon.0) 11494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:43:58.345 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:43:58.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:43:58.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:43:58.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:43:58.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:43:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:59 smithi179 bash[23186]: audit 2024-09-21T03:43:57.904730+0000 mgr.a (mgr.14388) 14261 : audit [DBG] from='client.309594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:43:59 smithi179 bash[23186]: cluster 2024-09-21T03:43:58.358367+0000 mgr.a (mgr.14388) 14262 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:59 smithi049 bash[23528]: audit 2024-09-21T03:43:57.904730+0000 mgr.a (mgr.14388) 14261 : audit [DBG] from='client.309594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:59.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:43:59 smithi049 bash[23528]: cluster 2024-09-21T03:43:58.358367+0000 mgr.a (mgr.14388) 14262 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:43:59.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:59 smithi044 bash[22676]: audit 2024-09-21T03:43:57.904730+0000 mgr.a (mgr.14388) 14261 : audit [DBG] from='client.309594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:59.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:43:59 smithi044 bash[22676]: cluster 2024-09-21T03:43:58.358367+0000 mgr.a (mgr.14388) 14262 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:00 smithi049 bash[23528]: cluster 2024-09-21T03:44:00.360478+0000 mgr.a (mgr.14388) 14263 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:01.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:00 smithi044 bash[22676]: cluster 2024-09-21T03:44:00.360478+0000 mgr.a (mgr.14388) 14263 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:00 smithi179 bash[23186]: cluster 2024-09-21T03:44:00.360478+0000 mgr.a (mgr.14388) 14263 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:03.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:03.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:03.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:03 smithi044 bash[22676]: cluster 2024-09-21T03:44:02.361275+0000 mgr.a (mgr.14388) 14264 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:03 smithi179 bash[23186]: cluster 2024-09-21T03:44:02.361275+0000 mgr.a (mgr.14388) 14264 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:03 smithi049 bash[23528]: cluster 2024-09-21T03:44:02.361275+0000 mgr.a (mgr.14388) 14264 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:04.141 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:04.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:04.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:04.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:04.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:05 smithi044 bash[22676]: audit 2024-09-21T03:44:03.682090+0000 mgr.a (mgr.14388) 14265 : audit [DBG] from='client.309672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:05 smithi044 bash[22676]: cluster 2024-09-21T03:44:04.362305+0000 mgr.a (mgr.14388) 14266 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:05 smithi044 bash[22676]: audit 2024-09-21T03:44:05.346407+0000 mon.a (mon.0) 11495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:05 smithi044 bash[22676]: audit 2024-09-21T03:44:05.356145+0000 mon.a (mon.0) 11496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:05 smithi044 bash[22676]: audit 2024-09-21T03:44:05.367277+0000 mon.a (mon.0) 11497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:05 smithi179 bash[23186]: audit 2024-09-21T03:44:03.682090+0000 mgr.a (mgr.14388) 14265 : audit [DBG] from='client.309672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:05 smithi179 bash[23186]: cluster 2024-09-21T03:44:04.362305+0000 mgr.a (mgr.14388) 14266 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:05 smithi179 bash[23186]: audit 2024-09-21T03:44:05.346407+0000 mon.a (mon.0) 11495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:05 smithi179 bash[23186]: audit 2024-09-21T03:44:05.356145+0000 mon.a (mon.0) 11496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:05 smithi179 bash[23186]: audit 2024-09-21T03:44:05.367277+0000 mon.a (mon.0) 11497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:05 smithi049 bash[23528]: audit 2024-09-21T03:44:03.682090+0000 mgr.a (mgr.14388) 14265 : audit [DBG] from='client.309672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:05 smithi049 bash[23528]: cluster 2024-09-21T03:44:04.362305+0000 mgr.a (mgr.14388) 14266 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:05 smithi049 bash[23528]: audit 2024-09-21T03:44:05.346407+0000 mon.a (mon.0) 11495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:05 smithi049 bash[23528]: audit 2024-09-21T03:44:05.356145+0000 mon.a (mon.0) 11496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:05.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:05 smithi049 bash[23528]: audit 2024-09-21T03:44:05.367277+0000 mon.a (mon.0) 11497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:07.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:07 smithi044 bash[22676]: cluster 2024-09-21T03:44:06.364579+0000 mgr.a (mgr.14388) 14267 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:07 smithi179 bash[23186]: cluster 2024-09-21T03:44:06.364579+0000 mgr.a (mgr.14388) 14267 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:07 smithi049 bash[23528]: cluster 2024-09-21T03:44:06.364579+0000 mgr.a (mgr.14388) 14267 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:09.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:09.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:09.143 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:09.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:09 smithi044 bash[22676]: cluster 2024-09-21T03:44:08.365389+0000 mgr.a (mgr.14388) 14268 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:09.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:09 smithi179 bash[23186]: cluster 2024-09-21T03:44:08.365389+0000 mgr.a (mgr.14388) 14268 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:09 smithi049 bash[23528]: cluster 2024-09-21T03:44:08.365389+0000 mgr.a (mgr.14388) 14268 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:09.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:09.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:09.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:09.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:09.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:10.719 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:10 smithi044 bash[22676]: audit 2024-09-21T03:44:09.474137+0000 mgr.a (mgr.14388) 14269 : audit [DBG] from='client.309750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:10 smithi179 bash[23186]: audit 2024-09-21T03:44:09.474137+0000 mgr.a (mgr.14388) 14269 : audit [DBG] from='client.309750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:10 smithi049 bash[23528]: audit 2024-09-21T03:44:09.474137+0000 mgr.a (mgr.14388) 14269 : audit [DBG] from='client.309750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:11 smithi044 bash[22676]: cluster 2024-09-21T03:44:10.367696+0000 mgr.a (mgr.14388) 14270 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:11 smithi179 bash[23186]: cluster 2024-09-21T03:44:10.367696+0000 mgr.a (mgr.14388) 14270 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:11 smithi049 bash[23528]: cluster 2024-09-21T03:44:10.367696+0000 mgr.a (mgr.14388) 14270 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:12.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:44:12 smithi044 bash[22930]: debug 2024-09-21T03:44:12.614+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:44:12.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:44:12 smithi044 bash[22930]: debug 2024-09-21T03:44:12.614+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:44:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:12 smithi044 bash[22676]: audit 2024-09-21T03:44:11.812801+0000 mon.a (mon.0) 11498 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:44:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:12 smithi044 bash[22676]: audit 2024-09-21T03:44:11.820337+0000 mon.a (mon.0) 11499 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:44:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:12 smithi044 bash[22676]: audit 2024-09-21T03:44:11.822260+0000 mon.a (mon.0) 11500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:44:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:12 smithi044 bash[22676]: audit 2024-09-21T03:44:11.833801+0000 mon.a (mon.0) 11501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:12 smithi044 bash[22676]: audit 2024-09-21T03:44:11.840475+0000 mon.a (mon.0) 11502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:44:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:12 smithi179 bash[23186]: audit 2024-09-21T03:44:11.812801+0000 mon.a (mon.0) 11498 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:44:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:12 smithi179 bash[23186]: audit 2024-09-21T03:44:11.820337+0000 mon.a (mon.0) 11499 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:44:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:12 smithi179 bash[23186]: audit 2024-09-21T03:44:11.822260+0000 mon.a (mon.0) 11500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:44:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:12 smithi179 bash[23186]: audit 2024-09-21T03:44:11.833801+0000 mon.a (mon.0) 11501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:12 smithi179 bash[23186]: audit 2024-09-21T03:44:11.840475+0000 mon.a (mon.0) 11502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:44:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:12 smithi049 bash[23528]: audit 2024-09-21T03:44:11.812801+0000 mon.a (mon.0) 11498 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:44:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:12 smithi049 bash[23528]: audit 2024-09-21T03:44:11.820337+0000 mon.a (mon.0) 11499 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:44:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:12 smithi049 bash[23528]: audit 2024-09-21T03:44:11.822260+0000 mon.a (mon.0) 11500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:44:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:12 smithi049 bash[23528]: audit 2024-09-21T03:44:11.833801+0000 mon.a (mon.0) 11501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:12 smithi049 bash[23528]: audit 2024-09-21T03:44:11.840475+0000 mon.a (mon.0) 11502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:44:13.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:13 smithi179 bash[23186]: audit 2024-09-21T03:44:11.842880+0000 mgr.a (mgr.14388) 14271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:44:13.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:13 smithi179 bash[23186]: cluster 2024-09-21T03:44:12.368252+0000 mgr.a (mgr.14388) 14272 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:13 smithi044 bash[22676]: audit 2024-09-21T03:44:11.842880+0000 mgr.a (mgr.14388) 14271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:44:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:13 smithi044 bash[22676]: cluster 2024-09-21T03:44:12.368252+0000 mgr.a (mgr.14388) 14272 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:13 smithi049 bash[23528]: audit 2024-09-21T03:44:11.842880+0000 mgr.a (mgr.14388) 14271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:44:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:13 smithi049 bash[23528]: cluster 2024-09-21T03:44:12.368252+0000 mgr.a (mgr.14388) 14272 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:14 smithi044 bash[22676]: audit 2024-09-21T03:44:12.619661+0000 mgr.a (mgr.14388) 14273 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:44:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:14 smithi044 bash[22676]: cephadm 2024-09-21T03:44:12.621193+0000 mgr.a (mgr.14388) 14274 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:44:14.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:14 smithi179 bash[23186]: audit 2024-09-21T03:44:12.619661+0000 mgr.a (mgr.14388) 14273 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:44:14.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:14 smithi179 bash[23186]: cephadm 2024-09-21T03:44:12.621193+0000 mgr.a (mgr.14388) 14274 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:14 smithi049 bash[23528]: audit 2024-09-21T03:44:12.619661+0000 mgr.a (mgr.14388) 14273 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:44:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:14 smithi049 bash[23528]: cephadm 2024-09-21T03:44:12.621193+0000 mgr.a (mgr.14388) 14274 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:14.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:15.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:15 smithi044 bash[22676]: cluster 2024-09-21T03:44:14.369129+0000 mgr.a (mgr.14388) 14275 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:15 smithi179 bash[23186]: cluster 2024-09-21T03:44:14.369129+0000 mgr.a (mgr.14388) 14275 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:15 smithi049 bash[23528]: cluster 2024-09-21T03:44:14.369129+0000 mgr.a (mgr.14388) 14275 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:16 smithi179 bash[23186]: audit 2024-09-21T03:44:15.242166+0000 mgr.a (mgr.14388) 14276 : audit [DBG] from='client.309936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:16.679 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:16 smithi049 bash[23528]: audit 2024-09-21T03:44:15.242166+0000 mgr.a (mgr.14388) 14276 : audit [DBG] from='client.309936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:16.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:16 smithi044 bash[22676]: audit 2024-09-21T03:44:15.242166+0000 mgr.a (mgr.14388) 14276 : audit [DBG] from='client.309936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:17 smithi044 bash[22676]: cluster 2024-09-21T03:44:16.372035+0000 mgr.a (mgr.14388) 14277 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:17 smithi044 bash[22676]: audit 2024-09-21T03:44:17.287891+0000 mon.a (mon.0) 11503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:17 smithi044 bash[22676]: audit 2024-09-21T03:44:17.296661+0000 mon.a (mon.0) 11504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:17 smithi044 bash[22676]: audit 2024-09-21T03:44:17.308875+0000 mon.a (mon.0) 11505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:17 smithi179 bash[23186]: cluster 2024-09-21T03:44:16.372035+0000 mgr.a (mgr.14388) 14277 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:17 smithi179 bash[23186]: audit 2024-09-21T03:44:17.287891+0000 mon.a (mon.0) 11503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:17 smithi179 bash[23186]: audit 2024-09-21T03:44:17.296661+0000 mon.a (mon.0) 11504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:17 smithi179 bash[23186]: audit 2024-09-21T03:44:17.308875+0000 mon.a (mon.0) 11505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:17 smithi049 bash[23528]: cluster 2024-09-21T03:44:16.372035+0000 mgr.a (mgr.14388) 14277 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:17 smithi049 bash[23528]: audit 2024-09-21T03:44:17.287891+0000 mon.a (mon.0) 11503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:17 smithi049 bash[23528]: audit 2024-09-21T03:44:17.296661+0000 mon.a (mon.0) 11504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:17 smithi049 bash[23528]: audit 2024-09-21T03:44:17.308875+0000 mon.a (mon.0) 11505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:18 smithi049 bash[23528]: audit 2024-09-21T03:44:17.536008+0000 mon.a (mon.0) 11506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:18 smithi049 bash[23528]: audit 2024-09-21T03:44:17.544353+0000 mon.a (mon.0) 11507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:18 smithi049 bash[23528]: audit 2024-09-21T03:44:17.554383+0000 mon.a (mon.0) 11508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:18 smithi049 bash[23528]: cluster 2024-09-21T03:44:18.372962+0000 mgr.a (mgr.14388) 14278 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:18 smithi044 bash[22676]: audit 2024-09-21T03:44:17.536008+0000 mon.a (mon.0) 11506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:18 smithi044 bash[22676]: audit 2024-09-21T03:44:17.544353+0000 mon.a (mon.0) 11507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:18 smithi044 bash[22676]: audit 2024-09-21T03:44:17.554383+0000 mon.a (mon.0) 11508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:18 smithi044 bash[22676]: cluster 2024-09-21T03:44:18.372962+0000 mgr.a (mgr.14388) 14278 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:18 smithi179 bash[23186]: audit 2024-09-21T03:44:17.536008+0000 mon.a (mon.0) 11506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:18 smithi179 bash[23186]: audit 2024-09-21T03:44:17.544353+0000 mon.a (mon.0) 11507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:18 smithi179 bash[23186]: audit 2024-09-21T03:44:17.554383+0000 mon.a (mon.0) 11508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:18 smithi179 bash[23186]: cluster 2024-09-21T03:44:18.372962+0000 mgr.a (mgr.14388) 14278 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:20.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:20.700 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:20.700 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:21.464 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:21.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:21.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:21.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:21.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:21 smithi044 bash[22676]: cluster 2024-09-21T03:44:20.374960+0000 mgr.a (mgr.14388) 14279 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:21 smithi179 bash[23186]: cluster 2024-09-21T03:44:20.374960+0000 mgr.a (mgr.14388) 14279 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:21 smithi049 bash[23528]: cluster 2024-09-21T03:44:20.374960+0000 mgr.a (mgr.14388) 14279 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:22.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:22 smithi044 bash[22676]: audit 2024-09-21T03:44:21.028948+0000 mgr.a (mgr.14388) 14280 : audit [DBG] from='client.310014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:22 smithi179 bash[23186]: audit 2024-09-21T03:44:21.028948+0000 mgr.a (mgr.14388) 14280 : audit [DBG] from='client.310014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:22.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:22 smithi049 bash[23528]: audit 2024-09-21T03:44:21.028948+0000 mgr.a (mgr.14388) 14280 : audit [DBG] from='client.310014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:23.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:23 smithi044 bash[22676]: cluster 2024-09-21T03:44:22.375965+0000 mgr.a (mgr.14388) 14281 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:23 smithi179 bash[23186]: cluster 2024-09-21T03:44:22.375965+0000 mgr.a (mgr.14388) 14281 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:23 smithi049 bash[23528]: cluster 2024-09-21T03:44:22.375965+0000 mgr.a (mgr.14388) 14281 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:25 smithi044 bash[22676]: cluster 2024-09-21T03:44:24.376777+0000 mgr.a (mgr.14388) 14282 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:25 smithi179 bash[23186]: cluster 2024-09-21T03:44:24.376777+0000 mgr.a (mgr.14388) 14282 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:25 smithi049 bash[23528]: cluster 2024-09-21T03:44:24.376777+0000 mgr.a (mgr.14388) 14282 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:44:26.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:26.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:26.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:26 smithi044 bash[22676]: audit 2024-09-21T03:44:25.583212+0000 mon.a (mon.0) 11509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:26.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:26 smithi044 bash[22676]: audit 2024-09-21T03:44:25.593329+0000 mon.a (mon.0) 11510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:26 smithi044 bash[22676]: audit 2024-09-21T03:44:25.605189+0000 mon.a (mon.0) 11511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:26 smithi044 bash[22676]: cluster 2024-09-21T03:44:26.379018+0000 mgr.a (mgr.14388) 14283 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:26 smithi179 bash[23186]: audit 2024-09-21T03:44:25.583212+0000 mon.a (mon.0) 11509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:26 smithi179 bash[23186]: audit 2024-09-21T03:44:25.593329+0000 mon.a (mon.0) 11510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:26 smithi179 bash[23186]: audit 2024-09-21T03:44:25.605189+0000 mon.a (mon.0) 11511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:26 smithi179 bash[23186]: cluster 2024-09-21T03:44:26.379018+0000 mgr.a (mgr.14388) 14283 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:26 smithi049 bash[23528]: audit 2024-09-21T03:44:25.583212+0000 mon.a (mon.0) 11509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:26 smithi049 bash[23528]: audit 2024-09-21T03:44:25.593329+0000 mon.a (mon.0) 11510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:26 smithi049 bash[23528]: audit 2024-09-21T03:44:25.605189+0000 mon.a (mon.0) 11511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:26 smithi049 bash[23528]: cluster 2024-09-21T03:44:26.379018+0000 mgr.a (mgr.14388) 14283 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:44:27.226 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:27.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:27.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:27.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:27.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:27 smithi044 bash[22676]: audit 2024-09-21T03:44:26.803684+0000 mgr.a (mgr.14388) 14284 : audit [DBG] from='client.310092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:27 smithi179 bash[23186]: audit 2024-09-21T03:44:26.803684+0000 mgr.a (mgr.14388) 14284 : audit [DBG] from='client.310092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:27 smithi049 bash[23528]: audit 2024-09-21T03:44:26.803684+0000 mgr.a (mgr.14388) 14284 : audit [DBG] from='client.310092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:28 smithi049 bash[23528]: cluster 2024-09-21T03:44:28.379926+0000 mgr.a (mgr.14388) 14285 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:28.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:28 smithi044 bash[22676]: cluster 2024-09-21T03:44:28.379926+0000 mgr.a (mgr.14388) 14285 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:28 smithi179 bash[23186]: cluster 2024-09-21T03:44:28.379926+0000 mgr.a (mgr.14388) 14285 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:31.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:30 smithi049 bash[23528]: cluster 2024-09-21T03:44:30.382152+0000 mgr.a (mgr.14388) 14286 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:31.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:30 smithi044 bash[22676]: cluster 2024-09-21T03:44:30.382152+0000 mgr.a (mgr.14388) 14286 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:30 smithi179 bash[23186]: cluster 2024-09-21T03:44:30.382152+0000 mgr.a (mgr.14388) 14286 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:32.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:32.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:32.229 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:32.993 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:32.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:33.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:33 smithi044 bash[22676]: cluster 2024-09-21T03:44:32.382608+0000 mgr.a (mgr.14388) 14287 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:33.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:33 smithi179 bash[23186]: cluster 2024-09-21T03:44:32.382608+0000 mgr.a (mgr.14388) 14287 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:33 smithi049 bash[23528]: cluster 2024-09-21T03:44:32.382608+0000 mgr.a (mgr.14388) 14287 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:34.706 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:34 smithi179 bash[23186]: audit 2024-09-21T03:44:32.557957+0000 mgr.a (mgr.14388) 14288 : audit [DBG] from='client.310170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:34.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:34 smithi044 bash[22676]: audit 2024-09-21T03:44:32.557957+0000 mgr.a (mgr.14388) 14288 : audit [DBG] from='client.310170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:34 smithi049 bash[23528]: audit 2024-09-21T03:44:32.557957+0000 mgr.a (mgr.14388) 14288 : audit [DBG] from='client.310170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:35.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:35 smithi044 bash[22676]: cluster 2024-09-21T03:44:34.383468+0000 mgr.a (mgr.14388) 14289 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:35.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:35 smithi179 bash[23186]: cluster 2024-09-21T03:44:34.383468+0000 mgr.a (mgr.14388) 14289 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:35 smithi049 bash[23528]: cluster 2024-09-21T03:44:34.383468+0000 mgr.a (mgr.14388) 14289 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:37.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:37 smithi049 bash[23528]: cluster 2024-09-21T03:44:36.385739+0000 mgr.a (mgr.14388) 14290 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:37.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:37 smithi044 bash[22676]: cluster 2024-09-21T03:44:36.385739+0000 mgr.a (mgr.14388) 14290 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:37.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:37 smithi179 bash[23186]: cluster 2024-09-21T03:44:36.385739+0000 mgr.a (mgr.14388) 14290 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:38 smithi179 bash[23186]: audit 2024-09-21T03:44:37.494334+0000 mon.a (mon.0) 11512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:38 smithi179 bash[23186]: audit 2024-09-21T03:44:37.503076+0000 mon.a (mon.0) 11513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:38 smithi179 bash[23186]: audit 2024-09-21T03:44:37.515010+0000 mon.a (mon.0) 11514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:38 smithi179 bash[23186]: audit 2024-09-21T03:44:37.740849+0000 mon.a (mon.0) 11515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:38 smithi179 bash[23186]: audit 2024-09-21T03:44:37.750221+0000 mon.a (mon.0) 11516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:38 smithi179 bash[23186]: audit 2024-09-21T03:44:37.760109+0000 mon.a (mon.0) 11517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.792 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:38.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:38.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:38.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:38.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:38 smithi049 bash[23528]: audit 2024-09-21T03:44:37.494334+0000 mon.a (mon.0) 11512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:38 smithi049 bash[23528]: audit 2024-09-21T03:44:37.503076+0000 mon.a (mon.0) 11513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:38 smithi049 bash[23528]: audit 2024-09-21T03:44:37.515010+0000 mon.a (mon.0) 11514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:38 smithi049 bash[23528]: audit 2024-09-21T03:44:37.740849+0000 mon.a (mon.0) 11515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:38 smithi049 bash[23528]: audit 2024-09-21T03:44:37.750221+0000 mon.a (mon.0) 11516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:38 smithi049 bash[23528]: audit 2024-09-21T03:44:37.760109+0000 mon.a (mon.0) 11517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:38 smithi044 bash[22676]: audit 2024-09-21T03:44:37.494334+0000 mon.a (mon.0) 11512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:38 smithi044 bash[22676]: audit 2024-09-21T03:44:37.503076+0000 mon.a (mon.0) 11513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:38 smithi044 bash[22676]: audit 2024-09-21T03:44:37.515010+0000 mon.a (mon.0) 11514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:38 smithi044 bash[22676]: audit 2024-09-21T03:44:37.740849+0000 mon.a (mon.0) 11515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:38 smithi044 bash[22676]: audit 2024-09-21T03:44:37.750221+0000 mon.a (mon.0) 11516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:38 smithi044 bash[22676]: audit 2024-09-21T03:44:37.760109+0000 mon.a (mon.0) 11517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:39 smithi179 bash[23186]: audit 2024-09-21T03:44:38.330456+0000 mgr.a (mgr.14388) 14291 : audit [DBG] from='client.310245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:39 smithi179 bash[23186]: cluster 2024-09-21T03:44:38.386472+0000 mgr.a (mgr.14388) 14292 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:39 smithi049 bash[23528]: audit 2024-09-21T03:44:38.330456+0000 mgr.a (mgr.14388) 14291 : audit [DBG] from='client.310245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:39.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:39 smithi049 bash[23528]: cluster 2024-09-21T03:44:38.386472+0000 mgr.a (mgr.14388) 14292 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:39 smithi044 bash[22676]: audit 2024-09-21T03:44:38.330456+0000 mgr.a (mgr.14388) 14291 : audit [DBG] from='client.310245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:39 smithi044 bash[22676]: cluster 2024-09-21T03:44:38.386472+0000 mgr.a (mgr.14388) 14292 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:41 smithi179 bash[23186]: cluster 2024-09-21T03:44:40.388761+0000 mgr.a (mgr.14388) 14293 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:41 smithi049 bash[23528]: cluster 2024-09-21T03:44:40.388761+0000 mgr.a (mgr.14388) 14293 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:41.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:41 smithi044 bash[22676]: cluster 2024-09-21T03:44:40.388761+0000 mgr.a (mgr.14388) 14293 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:43.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:43.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:43.795 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:43 smithi049 bash[23528]: cluster 2024-09-21T03:44:42.389570+0000 mgr.a (mgr.14388) 14294 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:43.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:43 smithi044 bash[22676]: cluster 2024-09-21T03:44:42.389570+0000 mgr.a (mgr.14388) 14294 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:43 smithi179 bash[23186]: cluster 2024-09-21T03:44:42.389570+0000 mgr.a (mgr.14388) 14294 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:44.579 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:44.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:44.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:44.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:44.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:45 smithi049 bash[23528]: audit 2024-09-21T03:44:44.127102+0000 mgr.a (mgr.14388) 14295 : audit [DBG] from='client.310320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:45 smithi049 bash[23528]: cluster 2024-09-21T03:44:44.390133+0000 mgr.a (mgr.14388) 14296 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:45 smithi044 bash[22676]: audit 2024-09-21T03:44:44.127102+0000 mgr.a (mgr.14388) 14295 : audit [DBG] from='client.310320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:45 smithi044 bash[22676]: cluster 2024-09-21T03:44:44.390133+0000 mgr.a (mgr.14388) 14296 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:46.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:45 smithi179 bash[23186]: audit 2024-09-21T03:44:44.127102+0000 mgr.a (mgr.14388) 14295 : audit [DBG] from='client.310320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:46.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:45 smithi179 bash[23186]: cluster 2024-09-21T03:44:44.390133+0000 mgr.a (mgr.14388) 14296 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:46 smithi044 bash[22676]: audit 2024-09-21T03:44:45.824987+0000 mon.a (mon.0) 11518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:46 smithi044 bash[22676]: audit 2024-09-21T03:44:45.833918+0000 mon.a (mon.0) 11519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:46 smithi044 bash[22676]: audit 2024-09-21T03:44:45.844320+0000 mon.a (mon.0) 11520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:46 smithi044 bash[22676]: cluster 2024-09-21T03:44:46.392463+0000 mgr.a (mgr.14388) 14297 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:46 smithi179 bash[23186]: audit 2024-09-21T03:44:45.824987+0000 mon.a (mon.0) 11518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:46 smithi179 bash[23186]: audit 2024-09-21T03:44:45.833918+0000 mon.a (mon.0) 11519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:46 smithi179 bash[23186]: audit 2024-09-21T03:44:45.844320+0000 mon.a (mon.0) 11520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:46 smithi179 bash[23186]: cluster 2024-09-21T03:44:46.392463+0000 mgr.a (mgr.14388) 14297 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:47.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:46 smithi049 bash[23528]: audit 2024-09-21T03:44:45.824987+0000 mon.a (mon.0) 11518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:46 smithi049 bash[23528]: audit 2024-09-21T03:44:45.833918+0000 mon.a (mon.0) 11519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:46 smithi049 bash[23528]: audit 2024-09-21T03:44:45.844320+0000 mon.a (mon.0) 11520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:46 smithi049 bash[23528]: cluster 2024-09-21T03:44:46.392463+0000 mgr.a (mgr.14388) 14297 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:44:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:49.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:49 smithi044 bash[22676]: cluster 2024-09-21T03:44:48.393266+0000 mgr.a (mgr.14388) 14298 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:49 smithi179 bash[23186]: cluster 2024-09-21T03:44:48.393266+0000 mgr.a (mgr.14388) 14298 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:49.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:49 smithi049 bash[23528]: cluster 2024-09-21T03:44:48.393266+0000 mgr.a (mgr.14388) 14298 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:50.340 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:51 smithi044 bash[22676]: audit 2024-09-21T03:44:49.913500+0000 mgr.a (mgr.14388) 14299 : audit [DBG] from='client.310398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:51 smithi044 bash[22676]: cluster 2024-09-21T03:44:50.394422+0000 mgr.a (mgr.14388) 14300 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:44:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:51 smithi179 bash[23186]: audit 2024-09-21T03:44:49.913500+0000 mgr.a (mgr.14388) 14299 : audit [DBG] from='client.310398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:51 smithi179 bash[23186]: cluster 2024-09-21T03:44:50.394422+0000 mgr.a (mgr.14388) 14300 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:44:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:51 smithi049 bash[23528]: audit 2024-09-21T03:44:49.913500+0000 mgr.a (mgr.14388) 14299 : audit [DBG] from='client.310398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:51 smithi049 bash[23528]: cluster 2024-09-21T03:44:50.394422+0000 mgr.a (mgr.14388) 14300 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:44:53.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:53 smithi044 bash[22676]: cluster 2024-09-21T03:44:52.395164+0000 mgr.a (mgr.14388) 14301 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:44:53.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:53 smithi179 bash[23186]: cluster 2024-09-21T03:44:52.395164+0000 mgr.a (mgr.14388) 14301 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:44:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:53 smithi049 bash[23528]: cluster 2024-09-21T03:44:52.395164+0000 mgr.a (mgr.14388) 14301 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:44:55.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:44:55.343 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:44:55.343 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:44:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:55 smithi044 bash[22676]: cluster 2024-09-21T03:44:54.395956+0000 mgr.a (mgr.14388) 14302 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:44:55.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:55 smithi179 bash[23186]: cluster 2024-09-21T03:44:54.395956+0000 mgr.a (mgr.14388) 14302 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:44:55.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:55 smithi049 bash[23528]: cluster 2024-09-21T03:44:54.395956+0000 mgr.a (mgr.14388) 14302 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:44:56.131 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:44:56.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:44:56.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:44:56.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:44:56.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:44:57.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:57 smithi044 bash[22676]: audit 2024-09-21T03:44:55.679351+0000 mgr.a (mgr.14388) 14303 : audit [DBG] from='client.310476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:57.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:57 smithi044 bash[22676]: cluster 2024-09-21T03:44:56.398994+0000 mgr.a (mgr.14388) 14304 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:57 smithi179 bash[23186]: audit 2024-09-21T03:44:55.679351+0000 mgr.a (mgr.14388) 14303 : audit [DBG] from='client.310476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:57 smithi179 bash[23186]: cluster 2024-09-21T03:44:56.398994+0000 mgr.a (mgr.14388) 14304 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:57.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:57 smithi049 bash[23528]: audit 2024-09-21T03:44:55.679351+0000 mgr.a (mgr.14388) 14303 : audit [DBG] from='client.310476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:44:57.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:57 smithi049 bash[23528]: cluster 2024-09-21T03:44:56.398994+0000 mgr.a (mgr.14388) 14304 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:44:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:58 smithi044 bash[22676]: audit 2024-09-21T03:44:57.711746+0000 mon.a (mon.0) 11521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:58 smithi044 bash[22676]: audit 2024-09-21T03:44:57.720882+0000 mon.a (mon.0) 11522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:58 smithi044 bash[22676]: audit 2024-09-21T03:44:57.732607+0000 mon.a (mon.0) 11523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:58 smithi044 bash[22676]: audit 2024-09-21T03:44:57.966719+0000 mon.a (mon.0) 11524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:58 smithi044 bash[22676]: audit 2024-09-21T03:44:57.976289+0000 mon.a (mon.0) 11525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:58 smithi044 bash[22676]: audit 2024-09-21T03:44:57.986259+0000 mon.a (mon.0) 11526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:44:58 smithi044 bash[22676]: cluster 2024-09-21T03:44:58.399769+0000 mgr.a (mgr.14388) 14305 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:44:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:58 smithi179 bash[23186]: audit 2024-09-21T03:44:57.711746+0000 mon.a (mon.0) 11521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:58 smithi179 bash[23186]: audit 2024-09-21T03:44:57.720882+0000 mon.a (mon.0) 11522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:58 smithi179 bash[23186]: audit 2024-09-21T03:44:57.732607+0000 mon.a (mon.0) 11523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:58 smithi179 bash[23186]: audit 2024-09-21T03:44:57.966719+0000 mon.a (mon.0) 11524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:58 smithi179 bash[23186]: audit 2024-09-21T03:44:57.976289+0000 mon.a (mon.0) 11525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:58 smithi179 bash[23186]: audit 2024-09-21T03:44:57.986259+0000 mon.a (mon.0) 11526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:44:58 smithi179 bash[23186]: cluster 2024-09-21T03:44:58.399769+0000 mgr.a (mgr.14388) 14305 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:44:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:58 smithi049 bash[23528]: audit 2024-09-21T03:44:57.711746+0000 mon.a (mon.0) 11521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:58 smithi049 bash[23528]: audit 2024-09-21T03:44:57.720882+0000 mon.a (mon.0) 11522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:58 smithi049 bash[23528]: audit 2024-09-21T03:44:57.732607+0000 mon.a (mon.0) 11523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:58 smithi049 bash[23528]: audit 2024-09-21T03:44:57.966719+0000 mon.a (mon.0) 11524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:58 smithi049 bash[23528]: audit 2024-09-21T03:44:57.976289+0000 mon.a (mon.0) 11525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:58 smithi049 bash[23528]: audit 2024-09-21T03:44:57.986259+0000 mon.a (mon.0) 11526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:44:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:44:58 smithi049 bash[23528]: cluster 2024-09-21T03:44:58.399769+0000 mgr.a (mgr.14388) 14305 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:45:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:01 smithi044 bash[22676]: cluster 2024-09-21T03:45:00.401705+0000 mgr.a (mgr.14388) 14306 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:01 smithi179 bash[23186]: cluster 2024-09-21T03:45:00.401705+0000 mgr.a (mgr.14388) 14306 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:01.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:01 smithi049 bash[23528]: cluster 2024-09-21T03:45:00.401705+0000 mgr.a (mgr.14388) 14306 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:01.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:01.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:01.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:01.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:01.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:02 smithi044 bash[22676]: audit 2024-09-21T03:45:01.469041+0000 mgr.a (mgr.14388) 14307 : audit [DBG] from='client.310554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:02 smithi179 bash[23186]: audit 2024-09-21T03:45:01.469041+0000 mgr.a (mgr.14388) 14307 : audit [DBG] from='client.310554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:02.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:02 smithi049 bash[23528]: audit 2024-09-21T03:45:01.469041+0000 mgr.a (mgr.14388) 14307 : audit [DBG] from='client.310554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:03.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:03 smithi044 bash[22676]: cluster 2024-09-21T03:45:02.402714+0000 mgr.a (mgr.14388) 14308 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:03 smithi179 bash[23186]: cluster 2024-09-21T03:45:02.402714+0000 mgr.a (mgr.14388) 14308 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:03 smithi049 bash[23528]: cluster 2024-09-21T03:45:02.402714+0000 mgr.a (mgr.14388) 14308 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:05.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:05 smithi044 bash[22676]: cluster 2024-09-21T03:45:04.403498+0000 mgr.a (mgr.14388) 14309 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:05 smithi179 bash[23186]: cluster 2024-09-21T03:45:04.403498+0000 mgr.a (mgr.14388) 14309 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:05 smithi049 bash[23528]: cluster 2024-09-21T03:45:04.403498+0000 mgr.a (mgr.14388) 14309 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:06.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:06.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:06.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:07.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:07 smithi044 bash[22676]: audit 2024-09-21T03:45:06.062015+0000 mon.a (mon.0) 11527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:07 smithi044 bash[22676]: audit 2024-09-21T03:45:06.071940+0000 mon.a (mon.0) 11528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:07 smithi044 bash[22676]: audit 2024-09-21T03:45:06.082884+0000 mon.a (mon.0) 11529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:07 smithi044 bash[22676]: cluster 2024-09-21T03:45:06.405794+0000 mgr.a (mgr.14388) 14310 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:45:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:07 smithi179 bash[23186]: audit 2024-09-21T03:45:06.062015+0000 mon.a (mon.0) 11527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:07 smithi179 bash[23186]: audit 2024-09-21T03:45:06.071940+0000 mon.a (mon.0) 11528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:07 smithi179 bash[23186]: audit 2024-09-21T03:45:06.082884+0000 mon.a (mon.0) 11529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:07 smithi179 bash[23186]: cluster 2024-09-21T03:45:06.405794+0000 mgr.a (mgr.14388) 14310 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:45:07.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:07 smithi049 bash[23528]: audit 2024-09-21T03:45:06.062015+0000 mon.a (mon.0) 11527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:07 smithi049 bash[23528]: audit 2024-09-21T03:45:06.071940+0000 mon.a (mon.0) 11528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:07 smithi049 bash[23528]: audit 2024-09-21T03:45:06.082884+0000 mon.a (mon.0) 11529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:07.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:07 smithi049 bash[23528]: cluster 2024-09-21T03:45:06.405794+0000 mgr.a (mgr.14388) 14310 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:45:07.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:07.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:07.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:07.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:07.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:08 smithi044 bash[22676]: audit 2024-09-21T03:45:07.249025+0000 mgr.a (mgr.14388) 14311 : audit [DBG] from='client.310632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:08 smithi179 bash[23186]: audit 2024-09-21T03:45:07.249025+0000 mgr.a (mgr.14388) 14311 : audit [DBG] from='client.310632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:08.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:08 smithi049 bash[23528]: audit 2024-09-21T03:45:07.249025+0000 mgr.a (mgr.14388) 14311 : audit [DBG] from='client.310632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:09.343 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:09 smithi044 bash[22676]: cluster 2024-09-21T03:45:08.406849+0000 mgr.a (mgr.14388) 14312 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:09 smithi179 bash[23186]: cluster 2024-09-21T03:45:08.406849+0000 mgr.a (mgr.14388) 14312 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:09 smithi049 bash[23528]: cluster 2024-09-21T03:45:08.406849+0000 mgr.a (mgr.14388) 14312 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:11 smithi044 bash[22676]: cluster 2024-09-21T03:45:10.409229+0000 mgr.a (mgr.14388) 14313 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:45:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:11 smithi179 bash[23186]: cluster 2024-09-21T03:45:10.409229+0000 mgr.a (mgr.14388) 14313 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:45:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:11 smithi049 bash[23528]: cluster 2024-09-21T03:45:10.409229+0000 mgr.a (mgr.14388) 14313 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:45:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:13.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:13.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:13.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: cluster 2024-09-21T03:45:12.410099+0000 mgr.a (mgr.14388) 14314 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:12.681555+0000 mon.a (mon.0) 11530 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.293704+0000 mon.a (mon.0) 11531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.298236+0000 mon.a (mon.0) 11532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.311106+0000 mon.a (mon.0) 11533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.314684+0000 mon.a (mon.0) 11534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.315638+0000 mon.a (mon.0) 11535 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.316401+0000 mon.a (mon.0) 11536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.321426+0000 mon.a (mon.0) 11537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:13 smithi044 bash[22676]: audit 2024-09-21T03:45:13.324191+0000 mon.a (mon.0) 11538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:45:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: cluster 2024-09-21T03:45:12.410099+0000 mgr.a (mgr.14388) 14314 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:12.681555+0000 mon.a (mon.0) 11530 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:45:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.293704+0000 mon.a (mon.0) 11531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.298236+0000 mon.a (mon.0) 11532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.311106+0000 mon.a (mon.0) 11533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.314684+0000 mon.a (mon.0) 11534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.315638+0000 mon.a (mon.0) 11535 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:45:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.316401+0000 mon.a (mon.0) 11536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:45:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.321426+0000 mon.a (mon.0) 11537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:13 smithi179 bash[23186]: audit 2024-09-21T03:45:13.324191+0000 mon.a (mon.0) 11538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: cluster 2024-09-21T03:45:12.410099+0000 mgr.a (mgr.14388) 14314 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:12.681555+0000 mon.a (mon.0) 11530 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.293704+0000 mon.a (mon.0) 11531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.298236+0000 mon.a (mon.0) 11532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.311106+0000 mon.a (mon.0) 11533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.314684+0000 mon.a (mon.0) 11534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.315638+0000 mon.a (mon.0) 11535 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:45:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.316401+0000 mon.a (mon.0) 11536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:45:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.321426+0000 mon.a (mon.0) 11537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:13 smithi049 bash[23528]: audit 2024-09-21T03:45:13.324191+0000 mon.a (mon.0) 11538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:45:14.472 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:45:14 smithi044 bash[22930]: debug 2024-09-21T03:45:14.157+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:45:14.472 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:45:14 smithi044 bash[22930]: debug 2024-09-21T03:45:14.161+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:45:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:14 smithi044 bash[22676]: audit 2024-09-21T03:45:13.028571+0000 mgr.a (mgr.14388) 14315 : audit [DBG] from='client.310707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:14 smithi044 bash[22676]: audit 2024-09-21T03:45:13.325934+0000 mgr.a (mgr.14388) 14316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:45:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:14 smithi179 bash[23186]: audit 2024-09-21T03:45:13.028571+0000 mgr.a (mgr.14388) 14315 : audit [DBG] from='client.310707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:14 smithi179 bash[23186]: audit 2024-09-21T03:45:13.325934+0000 mgr.a (mgr.14388) 14316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:45:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:14 smithi049 bash[23528]: audit 2024-09-21T03:45:13.028571+0000 mgr.a (mgr.14388) 14315 : audit [DBG] from='client.310707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:14 smithi049 bash[23528]: audit 2024-09-21T03:45:13.325934+0000 mgr.a (mgr.14388) 14316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:45:15.600 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:15 smithi179 bash[23186]: audit 2024-09-21T03:45:14.164965+0000 mgr.a (mgr.14388) 14317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:45:15.600 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:15 smithi179 bash[23186]: cephadm 2024-09-21T03:45:14.166205+0000 mgr.a (mgr.14388) 14318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:45:15.600 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:15 smithi179 bash[23186]: cluster 2024-09-21T03:45:14.411043+0000 mgr.a (mgr.14388) 14319 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:15 smithi044 bash[22676]: audit 2024-09-21T03:45:14.164965+0000 mgr.a (mgr.14388) 14317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:45:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:15 smithi044 bash[22676]: cephadm 2024-09-21T03:45:14.166205+0000 mgr.a (mgr.14388) 14318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:45:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:15 smithi044 bash[22676]: cluster 2024-09-21T03:45:14.411043+0000 mgr.a (mgr.14388) 14319 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:15.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:15 smithi049 bash[23528]: audit 2024-09-21T03:45:14.164965+0000 mgr.a (mgr.14388) 14317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:15 smithi049 bash[23528]: cephadm 2024-09-21T03:45:14.166205+0000 mgr.a (mgr.14388) 14318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:45:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:15 smithi049 bash[23528]: cluster 2024-09-21T03:45:14.411043+0000 mgr.a (mgr.14388) 14319 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:17.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:17 smithi044 bash[22676]: cluster 2024-09-21T03:45:16.413317+0000 mgr.a (mgr.14388) 14320 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:17 smithi179 bash[23186]: cluster 2024-09-21T03:45:16.413317+0000 mgr.a (mgr.14388) 14320 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:17.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:17 smithi049 bash[23528]: cluster 2024-09-21T03:45:16.413317+0000 mgr.a (mgr.14388) 14320 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:18.479 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:19.235 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:19.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:18 smithi044 bash[22676]: audit 2024-09-21T03:45:17.937338+0000 mon.a (mon.0) 11539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:18 smithi044 bash[22676]: audit 2024-09-21T03:45:17.945314+0000 mon.a (mon.0) 11540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:18 smithi044 bash[22676]: audit 2024-09-21T03:45:17.955806+0000 mon.a (mon.0) 11541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:18 smithi044 bash[22676]: audit 2024-09-21T03:45:18.128322+0000 mon.a (mon.0) 11542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:18 smithi044 bash[22676]: audit 2024-09-21T03:45:18.136608+0000 mon.a (mon.0) 11543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:18 smithi044 bash[22676]: audit 2024-09-21T03:45:18.146578+0000 mon.a (mon.0) 11544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:18 smithi044 bash[22676]: cluster 2024-09-21T03:45:18.414042+0000 mgr.a (mgr.14388) 14321 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:18 smithi179 bash[23186]: audit 2024-09-21T03:45:17.937338+0000 mon.a (mon.0) 11539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:18 smithi179 bash[23186]: audit 2024-09-21T03:45:17.945314+0000 mon.a (mon.0) 11540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:18 smithi179 bash[23186]: audit 2024-09-21T03:45:17.955806+0000 mon.a (mon.0) 11541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:18 smithi179 bash[23186]: audit 2024-09-21T03:45:18.128322+0000 mon.a (mon.0) 11542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:18 smithi179 bash[23186]: audit 2024-09-21T03:45:18.136608+0000 mon.a (mon.0) 11543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:18 smithi179 bash[23186]: audit 2024-09-21T03:45:18.146578+0000 mon.a (mon.0) 11544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:18 smithi179 bash[23186]: cluster 2024-09-21T03:45:18.414042+0000 mgr.a (mgr.14388) 14321 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:18 smithi049 bash[23528]: audit 2024-09-21T03:45:17.937338+0000 mon.a (mon.0) 11539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:18 smithi049 bash[23528]: audit 2024-09-21T03:45:17.945314+0000 mon.a (mon.0) 11540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:18 smithi049 bash[23528]: audit 2024-09-21T03:45:17.955806+0000 mon.a (mon.0) 11541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:18 smithi049 bash[23528]: audit 2024-09-21T03:45:18.128322+0000 mon.a (mon.0) 11542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:18 smithi049 bash[23528]: audit 2024-09-21T03:45:18.136608+0000 mon.a (mon.0) 11543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:18 smithi049 bash[23528]: audit 2024-09-21T03:45:18.146578+0000 mon.a (mon.0) 11544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:18 smithi049 bash[23528]: cluster 2024-09-21T03:45:18.414042+0000 mgr.a (mgr.14388) 14321 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:20 smithi044 bash[22676]: audit 2024-09-21T03:45:18.808644+0000 mgr.a (mgr.14388) 14322 : audit [DBG] from='client.310893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:20.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:20 smithi179 bash[23186]: audit 2024-09-21T03:45:18.808644+0000 mgr.a (mgr.14388) 14322 : audit [DBG] from='client.310893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:20.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:20 smithi049 bash[23528]: audit 2024-09-21T03:45:18.808644+0000 mgr.a (mgr.14388) 14322 : audit [DBG] from='client.310893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:21.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:21 smithi044 bash[22676]: cluster 2024-09-21T03:45:20.416304+0000 mgr.a (mgr.14388) 14323 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:21 smithi179 bash[23186]: cluster 2024-09-21T03:45:20.416304+0000 mgr.a (mgr.14388) 14323 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:21.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:21 smithi049 bash[23528]: cluster 2024-09-21T03:45:20.416304+0000 mgr.a (mgr.14388) 14323 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:23 smithi044 bash[22676]: cluster 2024-09-21T03:45:22.417082+0000 mgr.a (mgr.14388) 14324 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:23 smithi179 bash[23186]: cluster 2024-09-21T03:45:22.417082+0000 mgr.a (mgr.14388) 14324 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:23 smithi049 bash[23528]: cluster 2024-09-21T03:45:22.417082+0000 mgr.a (mgr.14388) 14324 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:24.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:24.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:24.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:24.994 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:24.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:24.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:24.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:25.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:25 smithi044 bash[22676]: cluster 2024-09-21T03:45:24.417809+0000 mgr.a (mgr.14388) 14325 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:25 smithi179 bash[23186]: cluster 2024-09-21T03:45:24.417809+0000 mgr.a (mgr.14388) 14325 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:25 smithi049 bash[23528]: cluster 2024-09-21T03:45:24.417809+0000 mgr.a (mgr.14388) 14325 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:26 smithi044 bash[22676]: audit 2024-09-21T03:45:24.565231+0000 mgr.a (mgr.14388) 14326 : audit [DBG] from='client.310971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:26 smithi044 bash[22676]: audit 2024-09-21T03:45:26.297554+0000 mon.a (mon.0) 11545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:26 smithi044 bash[22676]: audit 2024-09-21T03:45:26.306316+0000 mon.a (mon.0) 11546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:26 smithi044 bash[22676]: audit 2024-09-21T03:45:26.316549+0000 mon.a (mon.0) 11547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:26 smithi179 bash[23186]: audit 2024-09-21T03:45:24.565231+0000 mgr.a (mgr.14388) 14326 : audit [DBG] from='client.310971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:26 smithi179 bash[23186]: audit 2024-09-21T03:45:26.297554+0000 mon.a (mon.0) 11545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:26 smithi179 bash[23186]: audit 2024-09-21T03:45:26.306316+0000 mon.a (mon.0) 11546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:26 smithi179 bash[23186]: audit 2024-09-21T03:45:26.316549+0000 mon.a (mon.0) 11547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:26 smithi049 bash[23528]: audit 2024-09-21T03:45:24.565231+0000 mgr.a (mgr.14388) 14326 : audit [DBG] from='client.310971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:26 smithi049 bash[23528]: audit 2024-09-21T03:45:26.297554+0000 mon.a (mon.0) 11545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:26 smithi049 bash[23528]: audit 2024-09-21T03:45:26.306316+0000 mon.a (mon.0) 11546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:26 smithi049 bash[23528]: audit 2024-09-21T03:45:26.316549+0000 mon.a (mon.0) 11547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:27.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:27 smithi044 bash[22676]: cluster 2024-09-21T03:45:26.420141+0000 mgr.a (mgr.14388) 14327 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:27 smithi179 bash[23186]: cluster 2024-09-21T03:45:26.420141+0000 mgr.a (mgr.14388) 14327 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:27 smithi049 bash[23528]: cluster 2024-09-21T03:45:26.420141+0000 mgr.a (mgr.14388) 14327 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:45:29.652 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:29 smithi044 bash[22676]: cluster 2024-09-21T03:45:28.420954+0000 mgr.a (mgr.14388) 14328 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:29 smithi179 bash[23186]: cluster 2024-09-21T03:45:28.420954+0000 mgr.a (mgr.14388) 14328 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:29 smithi049 bash[23528]: cluster 2024-09-21T03:45:28.420954+0000 mgr.a (mgr.14388) 14328 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:45:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:29.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:30.770 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:30.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:31.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:31 smithi179 bash[23186]: audit 2024-09-21T03:45:30.335350+0000 mgr.a (mgr.14388) 14329 : audit [DBG] from='client.311049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:31.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:31 smithi179 bash[23186]: cluster 2024-09-21T03:45:30.422513+0000 mgr.a (mgr.14388) 14330 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:31 smithi049 bash[23528]: audit 2024-09-21T03:45:30.335350+0000 mgr.a (mgr.14388) 14329 : audit [DBG] from='client.311049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:31 smithi049 bash[23528]: cluster 2024-09-21T03:45:30.422513+0000 mgr.a (mgr.14388) 14330 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:31.846 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:31 smithi044 bash[22676]: audit 2024-09-21T03:45:30.335350+0000 mgr.a (mgr.14388) 14329 : audit [DBG] from='client.311049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:31.846 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:31 smithi044 bash[22676]: cluster 2024-09-21T03:45:30.422513+0000 mgr.a (mgr.14388) 14330 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:33.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:33 smithi179 bash[23186]: cluster 2024-09-21T03:45:32.423368+0000 mgr.a (mgr.14388) 14331 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:45:33.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:33 smithi049 bash[23528]: cluster 2024-09-21T03:45:32.423368+0000 mgr.a (mgr.14388) 14331 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:45:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:33 smithi044 bash[22676]: cluster 2024-09-21T03:45:32.423368+0000 mgr.a (mgr.14388) 14331 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:45:35.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:35 smithi179 bash[23186]: cluster 2024-09-21T03:45:34.424152+0000 mgr.a (mgr.14388) 14332 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:45:35.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:35.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:35.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:35 smithi049 bash[23528]: cluster 2024-09-21T03:45:34.424152+0000 mgr.a (mgr.14388) 14332 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:45:35.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:35 smithi044 bash[22676]: cluster 2024-09-21T03:45:34.424152+0000 mgr.a (mgr.14388) 14332 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:45:36.571 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:36.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:36.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:36.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:36.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:37.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:37 smithi179 bash[23186]: audit 2024-09-21T03:45:36.108894+0000 mgr.a (mgr.14388) 14333 : audit [DBG] from='client.311127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:37.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:37 smithi179 bash[23186]: cluster 2024-09-21T03:45:36.425737+0000 mgr.a (mgr.14388) 14334 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:37 smithi049 bash[23528]: audit 2024-09-21T03:45:36.108894+0000 mgr.a (mgr.14388) 14333 : audit [DBG] from='client.311127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:37 smithi049 bash[23528]: cluster 2024-09-21T03:45:36.425737+0000 mgr.a (mgr.14388) 14334 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:37.860 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:37 smithi044 bash[22676]: audit 2024-09-21T03:45:36.108894+0000 mgr.a (mgr.14388) 14333 : audit [DBG] from='client.311127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:37.860 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:37 smithi044 bash[22676]: cluster 2024-09-21T03:45:36.425737+0000 mgr.a (mgr.14388) 14334 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:39 smithi049 bash[23528]: audit 2024-09-21T03:45:38.146393+0000 mon.a (mon.0) 11548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:39 smithi049 bash[23528]: audit 2024-09-21T03:45:38.155946+0000 mon.a (mon.0) 11549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:39 smithi049 bash[23528]: audit 2024-09-21T03:45:38.166525+0000 mon.a (mon.0) 11550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:39 smithi049 bash[23528]: audit 2024-09-21T03:45:38.340171+0000 mon.a (mon.0) 11551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:39 smithi049 bash[23528]: audit 2024-09-21T03:45:38.348573+0000 mon.a (mon.0) 11552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:39 smithi049 bash[23528]: audit 2024-09-21T03:45:38.358631+0000 mon.a (mon.0) 11553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:39 smithi049 bash[23528]: cluster 2024-09-21T03:45:38.426630+0000 mgr.a (mgr.14388) 14335 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:45:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:39 smithi044 bash[22676]: audit 2024-09-21T03:45:38.146393+0000 mon.a (mon.0) 11548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:39 smithi044 bash[22676]: audit 2024-09-21T03:45:38.155946+0000 mon.a (mon.0) 11549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:39 smithi044 bash[22676]: audit 2024-09-21T03:45:38.166525+0000 mon.a (mon.0) 11550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:39 smithi044 bash[22676]: audit 2024-09-21T03:45:38.340171+0000 mon.a (mon.0) 11551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:39 smithi044 bash[22676]: audit 2024-09-21T03:45:38.348573+0000 mon.a (mon.0) 11552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:39 smithi044 bash[22676]: audit 2024-09-21T03:45:38.358631+0000 mon.a (mon.0) 11553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:39 smithi044 bash[22676]: cluster 2024-09-21T03:45:38.426630+0000 mgr.a (mgr.14388) 14335 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:45:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:39 smithi179 bash[23186]: audit 2024-09-21T03:45:38.146393+0000 mon.a (mon.0) 11548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:39 smithi179 bash[23186]: audit 2024-09-21T03:45:38.155946+0000 mon.a (mon.0) 11549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:39 smithi179 bash[23186]: audit 2024-09-21T03:45:38.166525+0000 mon.a (mon.0) 11550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:39 smithi179 bash[23186]: audit 2024-09-21T03:45:38.340171+0000 mon.a (mon.0) 11551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:39 smithi179 bash[23186]: audit 2024-09-21T03:45:38.348573+0000 mon.a (mon.0) 11552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:39 smithi179 bash[23186]: audit 2024-09-21T03:45:38.358631+0000 mon.a (mon.0) 11553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:39 smithi179 bash[23186]: cluster 2024-09-21T03:45:38.426630+0000 mgr.a (mgr.14388) 14335 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:45:41.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:41.573 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:41.573 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:41 smithi044 bash[22676]: cluster 2024-09-21T03:45:40.428909+0000 mgr.a (mgr.14388) 14336 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:45:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:41 smithi179 bash[23186]: cluster 2024-09-21T03:45:40.428909+0000 mgr.a (mgr.14388) 14336 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:45:41.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:41 smithi049 bash[23528]: cluster 2024-09-21T03:45:40.428909+0000 mgr.a (mgr.14388) 14336 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:45:42.348 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:42.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:42.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:42.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:42.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:43 smithi179 bash[23186]: audit 2024-09-21T03:45:41.908871+0000 mgr.a (mgr.14388) 14337 : audit [DBG] from='client.311205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:43.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:43 smithi179 bash[23186]: cluster 2024-09-21T03:45:42.429504+0000 mgr.a (mgr.14388) 14338 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:43 smithi049 bash[23528]: audit 2024-09-21T03:45:41.908871+0000 mgr.a (mgr.14388) 14337 : audit [DBG] from='client.311205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:43 smithi049 bash[23528]: cluster 2024-09-21T03:45:42.429504+0000 mgr.a (mgr.14388) 14338 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:43 smithi044 bash[22676]: audit 2024-09-21T03:45:41.908871+0000 mgr.a (mgr.14388) 14337 : audit [DBG] from='client.311205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:43 smithi044 bash[22676]: cluster 2024-09-21T03:45:42.429504+0000 mgr.a (mgr.14388) 14338 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:45 smithi179 bash[23186]: cluster 2024-09-21T03:45:44.430271+0000 mgr.a (mgr.14388) 14339 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:45.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:45 smithi049 bash[23528]: cluster 2024-09-21T03:45:44.430271+0000 mgr.a (mgr.14388) 14339 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:45 smithi044 bash[22676]: cluster 2024-09-21T03:45:44.430271+0000 mgr.a (mgr.14388) 14339 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:47.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:47.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:47.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:47.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:47 smithi049 bash[23528]: cluster 2024-09-21T03:45:46.432524+0000 mgr.a (mgr.14388) 14340 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:45:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:47 smithi049 bash[23528]: audit 2024-09-21T03:45:46.533208+0000 mon.a (mon.0) 11554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:47 smithi049 bash[23528]: audit 2024-09-21T03:45:46.541758+0000 mon.a (mon.0) 11555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:47 smithi049 bash[23528]: audit 2024-09-21T03:45:46.552379+0000 mon.a (mon.0) 11556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:47.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:47 smithi044 bash[22676]: cluster 2024-09-21T03:45:46.432524+0000 mgr.a (mgr.14388) 14340 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:45:47.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:47 smithi044 bash[22676]: audit 2024-09-21T03:45:46.533208+0000 mon.a (mon.0) 11554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:47.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:47 smithi044 bash[22676]: audit 2024-09-21T03:45:46.541758+0000 mon.a (mon.0) 11555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:47.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:47 smithi044 bash[22676]: audit 2024-09-21T03:45:46.552379+0000 mon.a (mon.0) 11556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:48.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:47 smithi179 bash[23186]: cluster 2024-09-21T03:45:46.432524+0000 mgr.a (mgr.14388) 14340 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:45:48.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:47 smithi179 bash[23186]: audit 2024-09-21T03:45:46.533208+0000 mon.a (mon.0) 11554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:48.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:47 smithi179 bash[23186]: audit 2024-09-21T03:45:46.541758+0000 mon.a (mon.0) 11555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:48.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:47 smithi179 bash[23186]: audit 2024-09-21T03:45:46.552379+0000 mon.a (mon.0) 11556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:48.134 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:48.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:48.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:48.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:48.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:49.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:49 smithi049 bash[23528]: audit 2024-09-21T03:45:47.688631+0000 mgr.a (mgr.14388) 14341 : audit [DBG] from='client.311283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:49.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:49 smithi049 bash[23528]: cluster 2024-09-21T03:45:48.433473+0000 mgr.a (mgr.14388) 14342 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:49.817 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:49 smithi044 bash[22676]: audit 2024-09-21T03:45:47.688631+0000 mgr.a (mgr.14388) 14341 : audit [DBG] from='client.311283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:49.817 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:49 smithi044 bash[22676]: cluster 2024-09-21T03:45:48.433473+0000 mgr.a (mgr.14388) 14342 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:49 smithi179 bash[23186]: audit 2024-09-21T03:45:47.688631+0000 mgr.a (mgr.14388) 14341 : audit [DBG] from='client.311283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:49 smithi179 bash[23186]: cluster 2024-09-21T03:45:48.433473+0000 mgr.a (mgr.14388) 14342 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:45:51.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:51 smithi044 bash[22676]: cluster 2024-09-21T03:45:50.435760+0000 mgr.a (mgr.14388) 14343 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:45:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:51 smithi049 bash[23528]: cluster 2024-09-21T03:45:50.435760+0000 mgr.a (mgr.14388) 14343 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:45:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:51 smithi179 bash[23186]: cluster 2024-09-21T03:45:50.435760+0000 mgr.a (mgr.14388) 14343 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:45:53.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:53.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:53.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:53 smithi049 bash[23528]: cluster 2024-09-21T03:45:52.436575+0000 mgr.a (mgr.14388) 14344 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T03:45:53.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:53.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:53.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:53.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:53.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:53.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:53 smithi044 bash[22676]: cluster 2024-09-21T03:45:52.436575+0000 mgr.a (mgr.14388) 14344 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T03:45:54.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:53 smithi179 bash[23186]: cluster 2024-09-21T03:45:52.436575+0000 mgr.a (mgr.14388) 14344 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T03:45:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:54 smithi044 bash[22676]: audit 2024-09-21T03:45:53.469795+0000 mgr.a (mgr.14388) 14345 : audit [DBG] from='client.311361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:54 smithi179 bash[23186]: audit 2024-09-21T03:45:53.469795+0000 mgr.a (mgr.14388) 14345 : audit [DBG] from='client.311361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:54 smithi049 bash[23528]: audit 2024-09-21T03:45:53.469795+0000 mgr.a (mgr.14388) 14345 : audit [DBG] from='client.311361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:55.817 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:55 smithi179 bash[23186]: cluster 2024-09-21T03:45:54.437664+0000 mgr.a (mgr.14388) 14346 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T03:45:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:55 smithi044 bash[22676]: cluster 2024-09-21T03:45:54.437664+0000 mgr.a (mgr.14388) 14346 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T03:45:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:55 smithi049 bash[23528]: cluster 2024-09-21T03:45:54.437664+0000 mgr.a (mgr.14388) 14346 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T03:45:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:56 smithi044 bash[22676]: cluster 2024-09-21T03:45:56.439964+0000 mgr.a (mgr.14388) 14347 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:45:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:56 smithi179 bash[23186]: cluster 2024-09-21T03:45:56.439964+0000 mgr.a (mgr.14388) 14347 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:45:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:56 smithi049 bash[23528]: cluster 2024-09-21T03:45:56.439964+0000 mgr.a (mgr.14388) 14347 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:45:58.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:45:58.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:45:58.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:45:59.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:59 smithi049 bash[23528]: audit 2024-09-21T03:45:58.354403+0000 mon.a (mon.0) 11557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:59 smithi049 bash[23528]: audit 2024-09-21T03:45:58.363552+0000 mon.a (mon.0) 11558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:59 smithi049 bash[23528]: audit 2024-09-21T03:45:58.375384+0000 mon.a (mon.0) 11559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:59 smithi049 bash[23528]: cluster 2024-09-21T03:45:58.440568+0000 mgr.a (mgr.14388) 14348 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:45:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:59 smithi049 bash[23528]: audit 2024-09-21T03:45:58.567771+0000 mon.a (mon.0) 11560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:59 smithi049 bash[23528]: audit 2024-09-21T03:45:58.576355+0000 mon.a (mon.0) 11561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:45:59 smithi049 bash[23528]: audit 2024-09-21T03:45:58.586418+0000 mon.a (mon.0) 11562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.697 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:45:59.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:45:59.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:45:59.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:45:59.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:45:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:59 smithi044 bash[22676]: audit 2024-09-21T03:45:58.354403+0000 mon.a (mon.0) 11557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:59 smithi044 bash[22676]: audit 2024-09-21T03:45:58.363552+0000 mon.a (mon.0) 11558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:59 smithi044 bash[22676]: audit 2024-09-21T03:45:58.375384+0000 mon.a (mon.0) 11559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:59 smithi044 bash[22676]: cluster 2024-09-21T03:45:58.440568+0000 mgr.a (mgr.14388) 14348 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:45:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:59 smithi044 bash[22676]: audit 2024-09-21T03:45:58.567771+0000 mon.a (mon.0) 11560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:59 smithi044 bash[22676]: audit 2024-09-21T03:45:58.576355+0000 mon.a (mon.0) 11561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:45:59 smithi044 bash[22676]: audit 2024-09-21T03:45:58.586418+0000 mon.a (mon.0) 11562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:59 smithi179 bash[23186]: audit 2024-09-21T03:45:58.354403+0000 mon.a (mon.0) 11557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:59 smithi179 bash[23186]: audit 2024-09-21T03:45:58.363552+0000 mon.a (mon.0) 11558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:59 smithi179 bash[23186]: audit 2024-09-21T03:45:58.375384+0000 mon.a (mon.0) 11559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:59 smithi179 bash[23186]: cluster 2024-09-21T03:45:58.440568+0000 mgr.a (mgr.14388) 14348 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:45:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:59 smithi179 bash[23186]: audit 2024-09-21T03:45:58.567771+0000 mon.a (mon.0) 11560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:59 smithi179 bash[23186]: audit 2024-09-21T03:45:58.576355+0000 mon.a (mon.0) 11561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:45:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:45:59 smithi179 bash[23186]: audit 2024-09-21T03:45:58.586418+0000 mon.a (mon.0) 11562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:00 smithi044 bash[22676]: audit 2024-09-21T03:45:59.259092+0000 mgr.a (mgr.14388) 14349 : audit [DBG] from='client.311436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:00 smithi179 bash[23186]: audit 2024-09-21T03:45:59.259092+0000 mgr.a (mgr.14388) 14349 : audit [DBG] from='client.311436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:00 smithi049 bash[23528]: audit 2024-09-21T03:45:59.259092+0000 mgr.a (mgr.14388) 14349 : audit [DBG] from='client.311436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:01.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:01 smithi044 bash[22676]: cluster 2024-09-21T03:46:00.442973+0000 mgr.a (mgr.14388) 14350 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:01.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:01 smithi049 bash[23528]: cluster 2024-09-21T03:46:00.442973+0000 mgr.a (mgr.14388) 14350 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:01 smithi179 bash[23186]: cluster 2024-09-21T03:46:00.442973+0000 mgr.a (mgr.14388) 14350 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:03 smithi179 bash[23186]: cluster 2024-09-21T03:46:02.443762+0000 mgr.a (mgr.14388) 14351 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:03 smithi049 bash[23528]: cluster 2024-09-21T03:46:02.443762+0000 mgr.a (mgr.14388) 14351 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:03.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:03 smithi044 bash[22676]: cluster 2024-09-21T03:46:02.443762+0000 mgr.a (mgr.14388) 14351 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:05.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:05.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:05.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:05.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:05.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:05.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:05 smithi049 bash[23528]: cluster 2024-09-21T03:46:04.444534+0000 mgr.a (mgr.14388) 14352 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:05.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:05 smithi044 bash[22676]: cluster 2024-09-21T03:46:04.444534+0000 mgr.a (mgr.14388) 14352 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:05 smithi179 bash[23186]: cluster 2024-09-21T03:46:04.444534+0000 mgr.a (mgr.14388) 14352 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:06.767 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:06 smithi049 bash[23528]: audit 2024-09-21T03:46:05.024462+0000 mgr.a (mgr.14388) 14353 : audit [DBG] from='client.311514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:06 smithi044 bash[22676]: audit 2024-09-21T03:46:05.024462+0000 mgr.a (mgr.14388) 14353 : audit [DBG] from='client.311514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:06 smithi179 bash[23186]: audit 2024-09-21T03:46:05.024462+0000 mgr.a (mgr.14388) 14353 : audit [DBG] from='client.311514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:07 smithi049 bash[23528]: cluster 2024-09-21T03:46:06.447539+0000 mgr.a (mgr.14388) 14354 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:07 smithi049 bash[23528]: audit 2024-09-21T03:46:06.743835+0000 mon.a (mon.0) 11563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:07.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:07 smithi049 bash[23528]: audit 2024-09-21T03:46:06.752450+0000 mon.a (mon.0) 11564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:07.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:07 smithi049 bash[23528]: audit 2024-09-21T03:46:06.763618+0000 mon.a (mon.0) 11565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:07 smithi044 bash[22676]: cluster 2024-09-21T03:46:06.447539+0000 mgr.a (mgr.14388) 14354 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:07 smithi044 bash[22676]: audit 2024-09-21T03:46:06.743835+0000 mon.a (mon.0) 11563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:07 smithi044 bash[22676]: audit 2024-09-21T03:46:06.752450+0000 mon.a (mon.0) 11564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:07 smithi044 bash[22676]: audit 2024-09-21T03:46:06.763618+0000 mon.a (mon.0) 11565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:07 smithi179 bash[23186]: cluster 2024-09-21T03:46:06.447539+0000 mgr.a (mgr.14388) 14354 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:46:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:07 smithi179 bash[23186]: audit 2024-09-21T03:46:06.743835+0000 mon.a (mon.0) 11563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:07 smithi179 bash[23186]: audit 2024-09-21T03:46:06.752450+0000 mon.a (mon.0) 11564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:07 smithi179 bash[23186]: audit 2024-09-21T03:46:06.763618+0000 mon.a (mon.0) 11565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:09.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:09 smithi049 bash[23528]: cluster 2024-09-21T03:46:08.448380+0000 mgr.a (mgr.14388) 14355 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:46:09.864 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:09 smithi044 bash[22676]: cluster 2024-09-21T03:46:08.448380+0000 mgr.a (mgr.14388) 14355 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:46:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:09 smithi179 bash[23186]: cluster 2024-09-21T03:46:08.448380+0000 mgr.a (mgr.14388) 14355 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:46:10.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:10.450 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:10.450 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:11.236 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:11.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:11 smithi044 bash[22676]: cluster 2024-09-21T03:46:10.449642+0000 mgr.a (mgr.14388) 14356 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T03:46:11.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:11 smithi049 bash[23528]: cluster 2024-09-21T03:46:10.449642+0000 mgr.a (mgr.14388) 14356 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T03:46:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:11 smithi179 bash[23186]: cluster 2024-09-21T03:46:10.449642+0000 mgr.a (mgr.14388) 14356 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T03:46:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:12 smithi049 bash[23528]: audit 2024-09-21T03:46:10.784426+0000 mgr.a (mgr.14388) 14357 : audit [DBG] from='client.311592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:12.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:12 smithi044 bash[22676]: audit 2024-09-21T03:46:10.784426+0000 mgr.a (mgr.14388) 14357 : audit [DBG] from='client.311592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:12 smithi179 bash[23186]: audit 2024-09-21T03:46:10.784426+0000 mgr.a (mgr.14388) 14357 : audit [DBG] from='client.311592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:13 smithi049 bash[23528]: cluster 2024-09-21T03:46:12.450577+0000 mgr.a (mgr.14388) 14358 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:13.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:13 smithi044 bash[22676]: cluster 2024-09-21T03:46:12.450577+0000 mgr.a (mgr.14388) 14358 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:14.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:13 smithi179 bash[23186]: cluster 2024-09-21T03:46:12.450577+0000 mgr.a (mgr.14388) 14358 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:14 smithi049 bash[23528]: audit 2024-09-21T03:46:14.219359+0000 mon.a (mon.0) 11566 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:46:14.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:14 smithi044 bash[22676]: audit 2024-09-21T03:46:14.219359+0000 mon.a (mon.0) 11566 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:46:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:14 smithi179 bash[23186]: audit 2024-09-21T03:46:14.219359+0000 mon.a (mon.0) 11566 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:46:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:15 smithi049 bash[23528]: cluster 2024-09-21T03:46:14.451380+0000 mgr.a (mgr.14388) 14359 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:15.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:15 smithi049 bash[23528]: audit 2024-09-21T03:46:14.773591+0000 mon.a (mon.0) 11567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:15.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:15 smithi049 bash[23528]: audit 2024-09-21T03:46:14.781926+0000 mon.a (mon.0) 11568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:15.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:15 smithi049 bash[23528]: audit 2024-09-21T03:46:14.784348+0000 mon.a (mon.0) 11569 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:46:15.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:15 smithi049 bash[23528]: audit 2024-09-21T03:46:14.786352+0000 mon.a (mon.0) 11570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:46:15.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:15 smithi049 bash[23528]: audit 2024-09-21T03:46:14.797110+0000 mon.a (mon.0) 11571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:15.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:15 smithi049 bash[23528]: audit 2024-09-21T03:46:14.805206+0000 mon.a (mon.0) 11572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22930]: debug 2024-09-21T03:46:15.576+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22930]: debug 2024-09-21T03:46:15.576+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22676]: cluster 2024-09-21T03:46:14.451380+0000 mgr.a (mgr.14388) 14359 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22676]: audit 2024-09-21T03:46:14.773591+0000 mon.a (mon.0) 11567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22676]: audit 2024-09-21T03:46:14.781926+0000 mon.a (mon.0) 11568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22676]: audit 2024-09-21T03:46:14.784348+0000 mon.a (mon.0) 11569 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22676]: audit 2024-09-21T03:46:14.786352+0000 mon.a (mon.0) 11570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:46:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22676]: audit 2024-09-21T03:46:14.797110+0000 mon.a (mon.0) 11571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:15 smithi044 bash[22676]: audit 2024-09-21T03:46:14.805206+0000 mon.a (mon.0) 11572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:46:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:15 smithi179 bash[23186]: cluster 2024-09-21T03:46:14.451380+0000 mgr.a (mgr.14388) 14359 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:46:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:15 smithi179 bash[23186]: audit 2024-09-21T03:46:14.773591+0000 mon.a (mon.0) 11567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:15 smithi179 bash[23186]: audit 2024-09-21T03:46:14.781926+0000 mon.a (mon.0) 11568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:15 smithi179 bash[23186]: audit 2024-09-21T03:46:14.784348+0000 mon.a (mon.0) 11569 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:46:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:15 smithi179 bash[23186]: audit 2024-09-21T03:46:14.786352+0000 mon.a (mon.0) 11570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:46:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:15 smithi179 bash[23186]: audit 2024-09-21T03:46:14.797110+0000 mon.a (mon.0) 11571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:15 smithi179 bash[23186]: audit 2024-09-21T03:46:14.805206+0000 mon.a (mon.0) 11572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:46:16.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:16.238 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:16.238 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:16 smithi044 bash[22676]: audit 2024-09-21T03:46:14.807832+0000 mgr.a (mgr.14388) 14360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:46:16.999 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:16 smithi179 bash[23186]: audit 2024-09-21T03:46:14.807832+0000 mgr.a (mgr.14388) 14360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:46:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:16 smithi049 bash[23528]: audit 2024-09-21T03:46:14.807832+0000 mgr.a (mgr.14388) 14360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:46:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:17 smithi044 bash[22676]: audit 2024-09-21T03:46:15.577985+0000 mgr.a (mgr.14388) 14361 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:46:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:17 smithi044 bash[22676]: cephadm 2024-09-21T03:46:15.579931+0000 mgr.a (mgr.14388) 14362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:46:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:17 smithi044 bash[22676]: cluster 2024-09-21T03:46:16.453955+0000 mgr.a (mgr.14388) 14363 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:46:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:17 smithi044 bash[22676]: audit 2024-09-21T03:46:16.574341+0000 mgr.a (mgr.14388) 14364 : audit [DBG] from='client.311775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:18.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:17 smithi179 bash[23186]: audit 2024-09-21T03:46:15.577985+0000 mgr.a (mgr.14388) 14361 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:46:18.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:17 smithi179 bash[23186]: cephadm 2024-09-21T03:46:15.579931+0000 mgr.a (mgr.14388) 14362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:46:18.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:17 smithi179 bash[23186]: cluster 2024-09-21T03:46:16.453955+0000 mgr.a (mgr.14388) 14363 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:46:18.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:17 smithi179 bash[23186]: audit 2024-09-21T03:46:16.574341+0000 mgr.a (mgr.14388) 14364 : audit [DBG] from='client.311775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:17 smithi049 bash[23528]: audit 2024-09-21T03:46:15.577985+0000 mgr.a (mgr.14388) 14361 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:46:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:17 smithi049 bash[23528]: cephadm 2024-09-21T03:46:15.579931+0000 mgr.a (mgr.14388) 14362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:46:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:17 smithi049 bash[23528]: cluster 2024-09-21T03:46:16.453955+0000 mgr.a (mgr.14388) 14363 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:46:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:17 smithi049 bash[23528]: audit 2024-09-21T03:46:16.574341+0000 mgr.a (mgr.14388) 14364 : audit [DBG] from='client.311775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:18 smithi179 bash[23186]: cluster 2024-09-21T03:46:18.454916+0000 mgr.a (mgr.14388) 14365 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:46:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:18 smithi049 bash[23528]: cluster 2024-09-21T03:46:18.454916+0000 mgr.a (mgr.14388) 14365 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:46:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:18 smithi044 bash[22676]: cluster 2024-09-21T03:46:18.454916+0000 mgr.a (mgr.14388) 14365 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T03:46:19.891 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:19 smithi049 bash[23528]: audit 2024-09-21T03:46:18.600389+0000 mon.a (mon.0) 11573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.891 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:19 smithi049 bash[23528]: audit 2024-09-21T03:46:18.609012+0000 mon.a (mon.0) 11574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.892 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:19 smithi049 bash[23528]: audit 2024-09-21T03:46:18.618399+0000 mon.a (mon.0) 11575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.892 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:19 smithi049 bash[23528]: audit 2024-09-21T03:46:18.741838+0000 mon.a (mon.0) 11576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.892 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:19 smithi049 bash[23528]: audit 2024-09-21T03:46:18.750527+0000 mon.a (mon.0) 11577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.892 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:19 smithi049 bash[23528]: audit 2024-09-21T03:46:18.761148+0000 mon.a (mon.0) 11578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:19 smithi044 bash[22676]: audit 2024-09-21T03:46:18.600389+0000 mon.a (mon.0) 11573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:19 smithi044 bash[22676]: audit 2024-09-21T03:46:18.609012+0000 mon.a (mon.0) 11574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:19 smithi044 bash[22676]: audit 2024-09-21T03:46:18.618399+0000 mon.a (mon.0) 11575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:19 smithi044 bash[22676]: audit 2024-09-21T03:46:18.741838+0000 mon.a (mon.0) 11576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:19 smithi044 bash[22676]: audit 2024-09-21T03:46:18.750527+0000 mon.a (mon.0) 11577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:19 smithi044 bash[22676]: audit 2024-09-21T03:46:18.761148+0000 mon.a (mon.0) 11578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:19 smithi179 bash[23186]: audit 2024-09-21T03:46:18.600389+0000 mon.a (mon.0) 11573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:19 smithi179 bash[23186]: audit 2024-09-21T03:46:18.609012+0000 mon.a (mon.0) 11574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:19 smithi179 bash[23186]: audit 2024-09-21T03:46:18.618399+0000 mon.a (mon.0) 11575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:19 smithi179 bash[23186]: audit 2024-09-21T03:46:18.741838+0000 mon.a (mon.0) 11576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:19 smithi179 bash[23186]: audit 2024-09-21T03:46:18.750527+0000 mon.a (mon.0) 11577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:19 smithi179 bash[23186]: audit 2024-09-21T03:46:18.761148+0000 mon.a (mon.0) 11578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:20 smithi049 bash[23528]: cluster 2024-09-21T03:46:20.457068+0000 mgr.a (mgr.14388) 14366 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-09-21T03:46:20.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:20 smithi044 bash[22676]: cluster 2024-09-21T03:46:20.457068+0000 mgr.a (mgr.14388) 14366 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-09-21T03:46:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:20 smithi179 bash[23186]: cluster 2024-09-21T03:46:20.457068+0000 mgr.a (mgr.14388) 14366 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-09-21T03:46:22.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:22.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:22.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:22.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:22.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:23.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:23 smithi049 bash[23528]: audit 2024-09-21T03:46:22.333945+0000 mgr.a (mgr.14388) 14367 : audit [DBG] from='client.311850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:23 smithi049 bash[23528]: cluster 2024-09-21T03:46:22.457624+0000 mgr.a (mgr.14388) 14368 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 426 B/s wr, 51 op/s 2024-09-21T03:46:23.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:23 smithi044 bash[22676]: audit 2024-09-21T03:46:22.333945+0000 mgr.a (mgr.14388) 14367 : audit [DBG] from='client.311850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:23.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:23 smithi044 bash[22676]: cluster 2024-09-21T03:46:22.457624+0000 mgr.a (mgr.14388) 14368 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 426 B/s wr, 51 op/s 2024-09-21T03:46:24.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:23 smithi179 bash[23186]: audit 2024-09-21T03:46:22.333945+0000 mgr.a (mgr.14388) 14367 : audit [DBG] from='client.311850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:24.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:23 smithi179 bash[23186]: cluster 2024-09-21T03:46:22.457624+0000 mgr.a (mgr.14388) 14368 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 426 B/s wr, 51 op/s 2024-09-21T03:46:25.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:25 smithi049 bash[23528]: cluster 2024-09-21T03:46:24.458498+0000 mgr.a (mgr.14388) 14369 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 426 B/s wr, 51 op/s 2024-09-21T03:46:25.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:25 smithi044 bash[22676]: cluster 2024-09-21T03:46:24.458498+0000 mgr.a (mgr.14388) 14369 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 426 B/s wr, 51 op/s 2024-09-21T03:46:26.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:25 smithi179 bash[23186]: cluster 2024-09-21T03:46:24.458498+0000 mgr.a (mgr.14388) 14369 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 426 B/s wr, 51 op/s 2024-09-21T03:46:27.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:27.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:27.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:27 smithi049 bash[23528]: cluster 2024-09-21T03:46:26.460834+0000 mgr.a (mgr.14388) 14370 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 426 B/s wr, 52 op/s 2024-09-21T03:46:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:27 smithi049 bash[23528]: audit 2024-09-21T03:46:26.980803+0000 mon.a (mon.0) 11579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:27.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:27 smithi049 bash[23528]: audit 2024-09-21T03:46:26.989983+0000 mon.a (mon.0) 11580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:27 smithi049 bash[23528]: audit 2024-09-21T03:46:27.001024+0000 mon.a (mon.0) 11581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:27 smithi044 bash[22676]: cluster 2024-09-21T03:46:26.460834+0000 mgr.a (mgr.14388) 14370 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 426 B/s wr, 52 op/s 2024-09-21T03:46:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:27 smithi044 bash[22676]: audit 2024-09-21T03:46:26.980803+0000 mon.a (mon.0) 11579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:27 smithi044 bash[22676]: audit 2024-09-21T03:46:26.989983+0000 mon.a (mon.0) 11580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:27 smithi044 bash[22676]: audit 2024-09-21T03:46:27.001024+0000 mon.a (mon.0) 11581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:27 smithi179 bash[23186]: cluster 2024-09-21T03:46:26.460834+0000 mgr.a (mgr.14388) 14370 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 426 B/s wr, 52 op/s 2024-09-21T03:46:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:27 smithi179 bash[23186]: audit 2024-09-21T03:46:26.980803+0000 mon.a (mon.0) 11579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:27 smithi179 bash[23186]: audit 2024-09-21T03:46:26.989983+0000 mon.a (mon.0) 11580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:27 smithi179 bash[23186]: audit 2024-09-21T03:46:27.001024+0000 mon.a (mon.0) 11581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:28.531 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:29 smithi049 bash[23528]: audit 2024-09-21T03:46:28.104460+0000 mgr.a (mgr.14388) 14371 : audit [DBG] from='client.311925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:29 smithi049 bash[23528]: cluster 2024-09-21T03:46:28.461321+0000 mgr.a (mgr.14388) 14372 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:46:29.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:29 smithi044 bash[22676]: audit 2024-09-21T03:46:28.104460+0000 mgr.a (mgr.14388) 14371 : audit [DBG] from='client.311925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:29.908 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:29 smithi044 bash[22676]: cluster 2024-09-21T03:46:28.461321+0000 mgr.a (mgr.14388) 14372 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:46:30.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:29 smithi179 bash[23186]: audit 2024-09-21T03:46:28.104460+0000 mgr.a (mgr.14388) 14371 : audit [DBG] from='client.311925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:30.147 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:29 smithi179 bash[23186]: cluster 2024-09-21T03:46:28.461321+0000 mgr.a (mgr.14388) 14372 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:46:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:31 smithi049 bash[23528]: cluster 2024-09-21T03:46:30.463455+0000 mgr.a (mgr.14388) 14373 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:46:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:31 smithi044 bash[22676]: cluster 2024-09-21T03:46:30.463455+0000 mgr.a (mgr.14388) 14373 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:46:32.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:31 smithi179 bash[23186]: cluster 2024-09-21T03:46:30.463455+0000 mgr.a (mgr.14388) 14373 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:46:33.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:33.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:33.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:33.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:33 smithi049 bash[23528]: cluster 2024-09-21T03:46:32.463955+0000 mgr.a (mgr.14388) 14374 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:33 smithi044 bash[22676]: cluster 2024-09-21T03:46:32.463955+0000 mgr.a (mgr.14388) 14374 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:34.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:33 smithi179 bash[23186]: cluster 2024-09-21T03:46:32.463955+0000 mgr.a (mgr.14388) 14374 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:34.329 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:34.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:34.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:34.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:34.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:35 smithi049 bash[23528]: audit 2024-09-21T03:46:33.870679+0000 mgr.a (mgr.14388) 14375 : audit [DBG] from='client.312003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:35.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:35 smithi049 bash[23528]: cluster 2024-09-21T03:46:34.464849+0000 mgr.a (mgr.14388) 14376 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:35.828 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:35 smithi179 bash[23186]: audit 2024-09-21T03:46:33.870679+0000 mgr.a (mgr.14388) 14375 : audit [DBG] from='client.312003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:35.828 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:35 smithi179 bash[23186]: cluster 2024-09-21T03:46:34.464849+0000 mgr.a (mgr.14388) 14376 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:35 smithi044 bash[22676]: audit 2024-09-21T03:46:33.870679+0000 mgr.a (mgr.14388) 14375 : audit [DBG] from='client.312003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:35 smithi044 bash[22676]: cluster 2024-09-21T03:46:34.464849+0000 mgr.a (mgr.14388) 14376 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:37.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:37 smithi049 bash[23528]: cluster 2024-09-21T03:46:36.467137+0000 mgr.a (mgr.14388) 14377 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:46:37.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:37 smithi044 bash[22676]: cluster 2024-09-21T03:46:36.467137+0000 mgr.a (mgr.14388) 14377 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:46:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:37 smithi179 bash[23186]: cluster 2024-09-21T03:46:36.467137+0000 mgr.a (mgr.14388) 14377 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:46:39.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:39.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:39.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:39 smithi179 bash[23186]: cluster 2024-09-21T03:46:38.468064+0000 mgr.a (mgr.14388) 14378 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:39 smithi179 bash[23186]: audit 2024-09-21T03:46:38.834311+0000 mon.a (mon.0) 11582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:39 smithi179 bash[23186]: audit 2024-09-21T03:46:38.842688+0000 mon.a (mon.0) 11583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:39 smithi179 bash[23186]: audit 2024-09-21T03:46:38.854584+0000 mon.a (mon.0) 11584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:39 smithi179 bash[23186]: audit 2024-09-21T03:46:38.903725+0000 mon.a (mon.0) 11585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:39 smithi179 bash[23186]: audit 2024-09-21T03:46:38.913700+0000 mon.a (mon.0) 11586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:39 smithi179 bash[23186]: audit 2024-09-21T03:46:38.925320+0000 mon.a (mon.0) 11587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:39 smithi049 bash[23528]: cluster 2024-09-21T03:46:38.468064+0000 mgr.a (mgr.14388) 14378 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:39 smithi049 bash[23528]: audit 2024-09-21T03:46:38.834311+0000 mon.a (mon.0) 11582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:39 smithi049 bash[23528]: audit 2024-09-21T03:46:38.842688+0000 mon.a (mon.0) 11583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:39 smithi049 bash[23528]: audit 2024-09-21T03:46:38.854584+0000 mon.a (mon.0) 11584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:39 smithi049 bash[23528]: audit 2024-09-21T03:46:38.903725+0000 mon.a (mon.0) 11585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:39 smithi049 bash[23528]: audit 2024-09-21T03:46:38.913700+0000 mon.a (mon.0) 11586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:39 smithi049 bash[23528]: audit 2024-09-21T03:46:38.925320+0000 mon.a (mon.0) 11587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:39 smithi044 bash[22676]: cluster 2024-09-21T03:46:38.468064+0000 mgr.a (mgr.14388) 14378 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:39 smithi044 bash[22676]: audit 2024-09-21T03:46:38.834311+0000 mon.a (mon.0) 11582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:39 smithi044 bash[22676]: audit 2024-09-21T03:46:38.842688+0000 mon.a (mon.0) 11583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:39 smithi044 bash[22676]: audit 2024-09-21T03:46:38.854584+0000 mon.a (mon.0) 11584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:39 smithi044 bash[22676]: audit 2024-09-21T03:46:38.903725+0000 mon.a (mon.0) 11585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:39 smithi044 bash[22676]: audit 2024-09-21T03:46:38.913700+0000 mon.a (mon.0) 11586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:39 smithi044 bash[22676]: audit 2024-09-21T03:46:38.925320+0000 mon.a (mon.0) 11587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:40.105 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:41 smithi044 bash[22676]: audit 2024-09-21T03:46:39.668427+0000 mgr.a (mgr.14388) 14379 : audit [DBG] from='client.312081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:41 smithi044 bash[22676]: cluster 2024-09-21T03:46:40.471106+0000 mgr.a (mgr.14388) 14380 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:46:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:41 smithi179 bash[23186]: audit 2024-09-21T03:46:39.668427+0000 mgr.a (mgr.14388) 14379 : audit [DBG] from='client.312081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:41 smithi179 bash[23186]: cluster 2024-09-21T03:46:40.471106+0000 mgr.a (mgr.14388) 14380 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:46:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:41 smithi049 bash[23528]: audit 2024-09-21T03:46:39.668427+0000 mgr.a (mgr.14388) 14379 : audit [DBG] from='client.312081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:41 smithi049 bash[23528]: cluster 2024-09-21T03:46:40.471106+0000 mgr.a (mgr.14388) 14380 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:46:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:43 smithi044 bash[22676]: cluster 2024-09-21T03:46:42.471905+0000 mgr.a (mgr.14388) 14381 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:46:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:43 smithi179 bash[23186]: cluster 2024-09-21T03:46:42.471905+0000 mgr.a (mgr.14388) 14381 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:46:44.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:43 smithi049 bash[23528]: cluster 2024-09-21T03:46:42.471905+0000 mgr.a (mgr.14388) 14381 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:46:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:44 smithi044 bash[22676]: cluster 2024-09-21T03:46:44.472697+0000 mgr.a (mgr.14388) 14382 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:46:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:44 smithi179 bash[23186]: cluster 2024-09-21T03:46:44.472697+0000 mgr.a (mgr.14388) 14382 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:46:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:44 smithi049 bash[23528]: cluster 2024-09-21T03:46:44.472697+0000 mgr.a (mgr.14388) 14382 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:46:45.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:45.108 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:45.108 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:45.907 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:45.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:45 smithi044 bash[22676]: audit 2024-09-21T03:46:45.446167+0000 mgr.a (mgr.14388) 14383 : audit [DBG] from='client.312159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:45 smithi179 bash[23186]: audit 2024-09-21T03:46:45.446167+0000 mgr.a (mgr.14388) 14383 : audit [DBG] from='client.312159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:45 smithi049 bash[23528]: audit 2024-09-21T03:46:45.446167+0000 mgr.a (mgr.14388) 14383 : audit [DBG] from='client.312159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:46 smithi044 bash[22676]: cluster 2024-09-21T03:46:46.475727+0000 mgr.a (mgr.14388) 14384 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:46 smithi179 bash[23186]: cluster 2024-09-21T03:46:46.475727+0000 mgr.a (mgr.14388) 14384 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:46 smithi049 bash[23528]: cluster 2024-09-21T03:46:46.475727+0000 mgr.a (mgr.14388) 14384 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:48 smithi044 bash[22676]: audit 2024-09-21T03:46:47.224951+0000 mon.a (mon.0) 11588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:48 smithi044 bash[22676]: audit 2024-09-21T03:46:47.233630+0000 mon.a (mon.0) 11589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:48 smithi044 bash[22676]: audit 2024-09-21T03:46:47.244224+0000 mon.a (mon.0) 11590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:48 smithi179 bash[23186]: audit 2024-09-21T03:46:47.224951+0000 mon.a (mon.0) 11588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:48 smithi179 bash[23186]: audit 2024-09-21T03:46:47.233630+0000 mon.a (mon.0) 11589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:48 smithi179 bash[23186]: audit 2024-09-21T03:46:47.244224+0000 mon.a (mon.0) 11590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:48 smithi049 bash[23528]: audit 2024-09-21T03:46:47.224951+0000 mon.a (mon.0) 11588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:48 smithi049 bash[23528]: audit 2024-09-21T03:46:47.233630+0000 mon.a (mon.0) 11589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:48 smithi049 bash[23528]: audit 2024-09-21T03:46:47.244224+0000 mon.a (mon.0) 11590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:49 smithi044 bash[22676]: cluster 2024-09-21T03:46:48.476547+0000 mgr.a (mgr.14388) 14385 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:46:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:49 smithi179 bash[23186]: cluster 2024-09-21T03:46:48.476547+0000 mgr.a (mgr.14388) 14385 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:46:49.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:49 smithi049 bash[23528]: cluster 2024-09-21T03:46:48.476547+0000 mgr.a (mgr.14388) 14385 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:46:50.908 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:50.909 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:51.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:51.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:51.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:51.658 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:51 smithi049 bash[23528]: cluster 2024-09-21T03:46:50.478647+0000 mgr.a (mgr.14388) 14386 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:51.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:51 smithi044 bash[22676]: cluster 2024-09-21T03:46:50.478647+0000 mgr.a (mgr.14388) 14386 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:51 smithi179 bash[23186]: cluster 2024-09-21T03:46:50.478647+0000 mgr.a (mgr.14388) 14386 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:52 smithi049 bash[23528]: audit 2024-09-21T03:46:51.237330+0000 mgr.a (mgr.14388) 14387 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:52 smithi044 bash[22676]: audit 2024-09-21T03:46:51.237330+0000 mgr.a (mgr.14388) 14387 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:52 smithi179 bash[23186]: audit 2024-09-21T03:46:51.237330+0000 mgr.a (mgr.14388) 14387 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:53.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:53 smithi049 bash[23528]: cluster 2024-09-21T03:46:52.479628+0000 mgr.a (mgr.14388) 14388 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:46:53.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:53 smithi044 bash[22676]: cluster 2024-09-21T03:46:52.479628+0000 mgr.a (mgr.14388) 14388 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:46:54.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:53 smithi179 bash[23186]: cluster 2024-09-21T03:46:52.479628+0000 mgr.a (mgr.14388) 14388 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:46:55.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:55 smithi049 bash[23528]: cluster 2024-09-21T03:46:54.480412+0000 mgr.a (mgr.14388) 14389 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:46:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:55 smithi044 bash[22676]: cluster 2024-09-21T03:46:54.480412+0000 mgr.a (mgr.14388) 14389 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:46:56.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:55 smithi179 bash[23186]: cluster 2024-09-21T03:46:54.480412+0000 mgr.a (mgr.14388) 14389 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:46:56.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:46:56.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:46:56.660 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:46:57.444 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:46:57.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:46:57.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:46:57.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:46:57.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:46:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:57 smithi179 bash[23186]: cluster 2024-09-21T03:46:56.482697+0000 mgr.a (mgr.14388) 14390 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:46:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:57 smithi044 bash[22676]: cluster 2024-09-21T03:46:56.482697+0000 mgr.a (mgr.14388) 14390 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:46:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:57 smithi049 bash[23528]: cluster 2024-09-21T03:46:56.482697+0000 mgr.a (mgr.14388) 14390 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:46:58.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:58 smithi044 bash[22676]: audit 2024-09-21T03:46:56.992782+0000 mgr.a (mgr.14388) 14391 : audit [DBG] from='client.312309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:58.996 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:58 smithi179 bash[23186]: audit 2024-09-21T03:46:56.992782+0000 mgr.a (mgr.14388) 14391 : audit [DBG] from='client.312309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:58 smithi049 bash[23528]: audit 2024-09-21T03:46:56.992782+0000 mgr.a (mgr.14388) 14391 : audit [DBG] from='client.312309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:59.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:59 smithi044 bash[22676]: cluster 2024-09-21T03:46:58.483850+0000 mgr.a (mgr.14388) 14392 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:46:59.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:59 smithi044 bash[22676]: audit 2024-09-21T03:46:59.064522+0000 mon.a (mon.0) 11591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:59.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:59 smithi044 bash[22676]: audit 2024-09-21T03:46:59.073003+0000 mon.a (mon.0) 11592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:59.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:59 smithi044 bash[22676]: audit 2024-09-21T03:46:59.083250+0000 mon.a (mon.0) 11593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:59.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:59 smithi044 bash[22676]: audit 2024-09-21T03:46:59.105642+0000 mon.a (mon.0) 11594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:59 smithi044 bash[22676]: audit 2024-09-21T03:46:59.113964+0000 mon.a (mon.0) 11595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:46:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:46:59 smithi044 bash[22676]: audit 2024-09-21T03:46:59.124238+0000 mon.a (mon.0) 11596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:59 smithi179 bash[23186]: cluster 2024-09-21T03:46:58.483850+0000 mgr.a (mgr.14388) 14392 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:59 smithi179 bash[23186]: audit 2024-09-21T03:46:59.064522+0000 mon.a (mon.0) 11591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:59 smithi179 bash[23186]: audit 2024-09-21T03:46:59.073003+0000 mon.a (mon.0) 11592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:59 smithi179 bash[23186]: audit 2024-09-21T03:46:59.083250+0000 mon.a (mon.0) 11593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:59 smithi179 bash[23186]: audit 2024-09-21T03:46:59.105642+0000 mon.a (mon.0) 11594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:59 smithi179 bash[23186]: audit 2024-09-21T03:46:59.113964+0000 mon.a (mon.0) 11595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:46:59 smithi179 bash[23186]: audit 2024-09-21T03:46:59.124238+0000 mon.a (mon.0) 11596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:59 smithi049 bash[23528]: cluster 2024-09-21T03:46:58.483850+0000 mgr.a (mgr.14388) 14392 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:59 smithi049 bash[23528]: audit 2024-09-21T03:46:59.064522+0000 mon.a (mon.0) 11591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:59 smithi049 bash[23528]: audit 2024-09-21T03:46:59.073003+0000 mon.a (mon.0) 11592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:59 smithi049 bash[23528]: audit 2024-09-21T03:46:59.083250+0000 mon.a (mon.0) 11593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:59 smithi049 bash[23528]: audit 2024-09-21T03:46:59.105642+0000 mon.a (mon.0) 11594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:59 smithi049 bash[23528]: audit 2024-09-21T03:46:59.113964+0000 mon.a (mon.0) 11595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:46:59 smithi049 bash[23528]: audit 2024-09-21T03:46:59.124238+0000 mon.a (mon.0) 11596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:00.918 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:00 smithi049 bash[23528]: cluster 2024-09-21T03:47:00.486213+0000 mgr.a (mgr.14388) 14393 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:00 smithi044 bash[22676]: cluster 2024-09-21T03:47:00.486213+0000 mgr.a (mgr.14388) 14393 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:00 smithi179 bash[23186]: cluster 2024-09-21T03:47:00.486213+0000 mgr.a (mgr.14388) 14393 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:02.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:02.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:02.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:03.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:03.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:03.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:03.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:03.210 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:03.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:03 smithi049 bash[23528]: cluster 2024-09-21T03:47:02.486998+0000 mgr.a (mgr.14388) 14394 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:03 smithi044 bash[22676]: cluster 2024-09-21T03:47:02.486998+0000 mgr.a (mgr.14388) 14394 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:03 smithi179 bash[23186]: cluster 2024-09-21T03:47:02.486998+0000 mgr.a (mgr.14388) 14394 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:04 smithi044 bash[22676]: audit 2024-09-21T03:47:02.782428+0000 mgr.a (mgr.14388) 14395 : audit [DBG] from='client.312384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:04 smithi179 bash[23186]: audit 2024-09-21T03:47:02.782428+0000 mgr.a (mgr.14388) 14395 : audit [DBG] from='client.312384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:04 smithi049 bash[23528]: audit 2024-09-21T03:47:02.782428+0000 mgr.a (mgr.14388) 14395 : audit [DBG] from='client.312384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:05.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:05 smithi044 bash[22676]: cluster 2024-09-21T03:47:04.488026+0000 mgr.a (mgr.14388) 14396 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:05 smithi179 bash[23186]: cluster 2024-09-21T03:47:04.488026+0000 mgr.a (mgr.14388) 14396 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:05 smithi049 bash[23528]: cluster 2024-09-21T03:47:04.488026+0000 mgr.a (mgr.14388) 14396 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:07.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:07 smithi049 bash[23528]: cluster 2024-09-21T03:47:06.490350+0000 mgr.a (mgr.14388) 14397 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:07.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:07 smithi049 bash[23528]: audit 2024-09-21T03:47:07.457279+0000 mon.a (mon.0) 11597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:07.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:07 smithi049 bash[23528]: audit 2024-09-21T03:47:07.466013+0000 mon.a (mon.0) 11598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:07.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:07 smithi049 bash[23528]: audit 2024-09-21T03:47:07.476757+0000 mon.a (mon.0) 11599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:07 smithi044 bash[22676]: cluster 2024-09-21T03:47:06.490350+0000 mgr.a (mgr.14388) 14397 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:07 smithi044 bash[22676]: audit 2024-09-21T03:47:07.457279+0000 mon.a (mon.0) 11597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:07 smithi044 bash[22676]: audit 2024-09-21T03:47:07.466013+0000 mon.a (mon.0) 11598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:07.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:07 smithi044 bash[22676]: audit 2024-09-21T03:47:07.476757+0000 mon.a (mon.0) 11599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:07 smithi179 bash[23186]: cluster 2024-09-21T03:47:06.490350+0000 mgr.a (mgr.14388) 14397 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:07 smithi179 bash[23186]: audit 2024-09-21T03:47:07.457279+0000 mon.a (mon.0) 11597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:07 smithi179 bash[23186]: audit 2024-09-21T03:47:07.466013+0000 mon.a (mon.0) 11598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:08.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:07 smithi179 bash[23186]: audit 2024-09-21T03:47:07.476757+0000 mon.a (mon.0) 11599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:08.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:08.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:08.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:08.993 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:08.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:08.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:08.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:08.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:09 smithi044 bash[22676]: cluster 2024-09-21T03:47:08.491091+0000 mgr.a (mgr.14388) 14398 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:09.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:09 smithi044 bash[22676]: audit 2024-09-21T03:47:08.547368+0000 mgr.a (mgr.14388) 14399 : audit [DBG] from='client.312459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:09 smithi179 bash[23186]: cluster 2024-09-21T03:47:08.491091+0000 mgr.a (mgr.14388) 14398 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:09 smithi179 bash[23186]: audit 2024-09-21T03:47:08.547368+0000 mgr.a (mgr.14388) 14399 : audit [DBG] from='client.312459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:09 smithi049 bash[23528]: cluster 2024-09-21T03:47:08.491091+0000 mgr.a (mgr.14388) 14398 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:09 smithi049 bash[23528]: audit 2024-09-21T03:47:08.547368+0000 mgr.a (mgr.14388) 14399 : audit [DBG] from='client.312459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:10 smithi044 bash[22676]: cluster 2024-09-21T03:47:10.492535+0000 mgr.a (mgr.14388) 14400 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:10 smithi179 bash[23186]: cluster 2024-09-21T03:47:10.492535+0000 mgr.a (mgr.14388) 14400 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:10 smithi049 bash[23528]: cluster 2024-09-21T03:47:10.492535+0000 mgr.a (mgr.14388) 14400 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:13.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:13 smithi049 bash[23528]: cluster 2024-09-21T03:47:12.493008+0000 mgr.a (mgr.14388) 14401 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:13.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:13 smithi044 bash[22676]: cluster 2024-09-21T03:47:12.493008+0000 mgr.a (mgr.14388) 14401 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:13.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:13.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:14.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:13 smithi179 bash[23186]: cluster 2024-09-21T03:47:12.493008+0000 mgr.a (mgr.14388) 14401 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:14.795 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:14.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:14.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:14.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:14.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:15 smithi044 bash[22676]: audit 2024-09-21T03:47:14.335862+0000 mgr.a (mgr.14388) 14402 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:15.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:15 smithi044 bash[22676]: cluster 2024-09-21T03:47:14.493577+0000 mgr.a (mgr.14388) 14403 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:15 smithi179 bash[23186]: audit 2024-09-21T03:47:14.335862+0000 mgr.a (mgr.14388) 14402 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:15 smithi179 bash[23186]: cluster 2024-09-21T03:47:14.493577+0000 mgr.a (mgr.14388) 14403 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:15 smithi049 bash[23528]: audit 2024-09-21T03:47:14.335862+0000 mgr.a (mgr.14388) 14402 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:15 smithi049 bash[23528]: cluster 2024-09-21T03:47:14.493577+0000 mgr.a (mgr.14388) 14403 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:16.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:47:16 smithi044 bash[22930]: debug 2024-09-21T03:47:16.463+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:47:16.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:47:16 smithi044 bash[22930]: debug 2024-09-21T03:47:16.463+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:47:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:16 smithi044 bash[22676]: audit 2024-09-21T03:47:15.668672+0000 mon.a (mon.0) 11600 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:16 smithi044 bash[22676]: audit 2024-09-21T03:47:15.675873+0000 mon.a (mon.0) 11601 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:16 smithi044 bash[22676]: audit 2024-09-21T03:47:15.677735+0000 mon.a (mon.0) 11602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:16 smithi044 bash[22676]: audit 2024-09-21T03:47:15.690745+0000 mon.a (mon.0) 11603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:16 smithi044 bash[22676]: audit 2024-09-21T03:47:15.697284+0000 mon.a (mon.0) 11604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:47:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:16 smithi179 bash[23186]: audit 2024-09-21T03:47:15.668672+0000 mon.a (mon.0) 11600 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:47:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:16 smithi179 bash[23186]: audit 2024-09-21T03:47:15.675873+0000 mon.a (mon.0) 11601 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:47:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:16 smithi179 bash[23186]: audit 2024-09-21T03:47:15.677735+0000 mon.a (mon.0) 11602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:47:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:16 smithi179 bash[23186]: audit 2024-09-21T03:47:15.690745+0000 mon.a (mon.0) 11603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:16 smithi179 bash[23186]: audit 2024-09-21T03:47:15.697284+0000 mon.a (mon.0) 11604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:47:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:16 smithi049 bash[23528]: audit 2024-09-21T03:47:15.668672+0000 mon.a (mon.0) 11600 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:47:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:16 smithi049 bash[23528]: audit 2024-09-21T03:47:15.675873+0000 mon.a (mon.0) 11601 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:47:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:16 smithi049 bash[23528]: audit 2024-09-21T03:47:15.677735+0000 mon.a (mon.0) 11602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:47:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:16 smithi049 bash[23528]: audit 2024-09-21T03:47:15.690745+0000 mon.a (mon.0) 11603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:16 smithi049 bash[23528]: audit 2024-09-21T03:47:15.697284+0000 mon.a (mon.0) 11604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:47:17.864 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:17 smithi179 bash[23186]: audit 2024-09-21T03:47:15.699983+0000 mgr.a (mgr.14388) 14404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:47:17.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:17 smithi179 bash[23186]: audit 2024-09-21T03:47:16.465735+0000 mgr.a (mgr.14388) 14405 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:47:17.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:17 smithi179 bash[23186]: cephadm 2024-09-21T03:47:16.467509+0000 mgr.a (mgr.14388) 14406 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:47:17.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:17 smithi179 bash[23186]: cluster 2024-09-21T03:47:16.495397+0000 mgr.a (mgr.14388) 14407 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:17 smithi044 bash[22676]: audit 2024-09-21T03:47:15.699983+0000 mgr.a (mgr.14388) 14404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:47:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:17 smithi044 bash[22676]: audit 2024-09-21T03:47:16.465735+0000 mgr.a (mgr.14388) 14405 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:47:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:17 smithi044 bash[22676]: cephadm 2024-09-21T03:47:16.467509+0000 mgr.a (mgr.14388) 14406 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:47:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:17 smithi044 bash[22676]: cluster 2024-09-21T03:47:16.495397+0000 mgr.a (mgr.14388) 14407 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:17 smithi049 bash[23528]: audit 2024-09-21T03:47:15.699983+0000 mgr.a (mgr.14388) 14404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:47:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:17 smithi049 bash[23528]: audit 2024-09-21T03:47:16.465735+0000 mgr.a (mgr.14388) 14405 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:47:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:17 smithi049 bash[23528]: cephadm 2024-09-21T03:47:16.467509+0000 mgr.a (mgr.14388) 14406 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:47:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:17 smithi049 bash[23528]: cluster 2024-09-21T03:47:16.495397+0000 mgr.a (mgr.14388) 14407 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:19 smithi044 bash[22676]: cluster 2024-09-21T03:47:18.496220+0000 mgr.a (mgr.14388) 14408 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:19 smithi044 bash[22676]: audit 2024-09-21T03:47:19.294427+0000 mon.a (mon.0) 11605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:19 smithi044 bash[22676]: audit 2024-09-21T03:47:19.302900+0000 mon.a (mon.0) 11606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:19 smithi044 bash[22676]: audit 2024-09-21T03:47:19.314138+0000 mon.a (mon.0) 11607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:19 smithi044 bash[22676]: audit 2024-09-21T03:47:19.323029+0000 mon.a (mon.0) 11608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:19 smithi044 bash[22676]: audit 2024-09-21T03:47:19.331208+0000 mon.a (mon.0) 11609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:19 smithi044 bash[22676]: audit 2024-09-21T03:47:19.340747+0000 mon.a (mon.0) 11610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:19 smithi179 bash[23186]: cluster 2024-09-21T03:47:18.496220+0000 mgr.a (mgr.14388) 14408 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:19 smithi179 bash[23186]: audit 2024-09-21T03:47:19.294427+0000 mon.a (mon.0) 11605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:19 smithi179 bash[23186]: audit 2024-09-21T03:47:19.302900+0000 mon.a (mon.0) 11606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:19 smithi179 bash[23186]: audit 2024-09-21T03:47:19.314138+0000 mon.a (mon.0) 11607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:19 smithi179 bash[23186]: audit 2024-09-21T03:47:19.323029+0000 mon.a (mon.0) 11608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:19 smithi179 bash[23186]: audit 2024-09-21T03:47:19.331208+0000 mon.a (mon.0) 11609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:19 smithi179 bash[23186]: audit 2024-09-21T03:47:19.340747+0000 mon.a (mon.0) 11610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:19.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:19.798 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:19.798 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:19 smithi049 bash[23528]: cluster 2024-09-21T03:47:18.496220+0000 mgr.a (mgr.14388) 14408 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:19 smithi049 bash[23528]: audit 2024-09-21T03:47:19.294427+0000 mon.a (mon.0) 11605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:19 smithi049 bash[23528]: audit 2024-09-21T03:47:19.302900+0000 mon.a (mon.0) 11606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:19 smithi049 bash[23528]: audit 2024-09-21T03:47:19.314138+0000 mon.a (mon.0) 11607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:19 smithi049 bash[23528]: audit 2024-09-21T03:47:19.323029+0000 mon.a (mon.0) 11608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:19 smithi049 bash[23528]: audit 2024-09-21T03:47:19.331208+0000 mon.a (mon.0) 11609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:19 smithi049 bash[23528]: audit 2024-09-21T03:47:19.340747+0000 mon.a (mon.0) 11610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:20.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:20.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:20.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:20.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:20.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:20.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:20 smithi044 bash[22676]: audit 2024-09-21T03:47:20.133563+0000 mgr.a (mgr.14388) 14409 : audit [DBG] from='client.312714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:20.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:20 smithi044 bash[22676]: cluster 2024-09-21T03:47:20.497889+0000 mgr.a (mgr.14388) 14410 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:20.993 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:20 smithi049 bash[23528]: audit 2024-09-21T03:47:20.133563+0000 mgr.a (mgr.14388) 14409 : audit [DBG] from='client.312714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:20.993 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:20 smithi049 bash[23528]: cluster 2024-09-21T03:47:20.497889+0000 mgr.a (mgr.14388) 14410 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:20 smithi179 bash[23186]: audit 2024-09-21T03:47:20.133563+0000 mgr.a (mgr.14388) 14409 : audit [DBG] from='client.312714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:20 smithi179 bash[23186]: cluster 2024-09-21T03:47:20.497889+0000 mgr.a (mgr.14388) 14410 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:23.814 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:23 smithi049 bash[23528]: cluster 2024-09-21T03:47:22.498660+0000 mgr.a (mgr.14388) 14411 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:23.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:23 smithi044 bash[22676]: cluster 2024-09-21T03:47:22.498660+0000 mgr.a (mgr.14388) 14411 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:24.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:23 smithi179 bash[23186]: cluster 2024-09-21T03:47:22.498660+0000 mgr.a (mgr.14388) 14411 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:25.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:25.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:25.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:25 smithi044 bash[22676]: cluster 2024-09-21T03:47:24.499441+0000 mgr.a (mgr.14388) 14412 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:26.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:25 smithi179 bash[23186]: cluster 2024-09-21T03:47:24.499441+0000 mgr.a (mgr.14388) 14412 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:25 smithi049 bash[23528]: cluster 2024-09-21T03:47:24.499441+0000 mgr.a (mgr.14388) 14412 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:26.365 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:27 smithi044 bash[22676]: audit 2024-09-21T03:47:25.915017+0000 mgr.a (mgr.14388) 14413 : audit [DBG] from='client.312789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:27 smithi044 bash[22676]: cluster 2024-09-21T03:47:26.502421+0000 mgr.a (mgr.14388) 14414 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:27 smithi179 bash[23186]: audit 2024-09-21T03:47:25.915017+0000 mgr.a (mgr.14388) 14413 : audit [DBG] from='client.312789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:28.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:27 smithi179 bash[23186]: cluster 2024-09-21T03:47:26.502421+0000 mgr.a (mgr.14388) 14414 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:27 smithi049 bash[23528]: audit 2024-09-21T03:47:25.915017+0000 mgr.a (mgr.14388) 14413 : audit [DBG] from='client.312789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:28.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:27 smithi049 bash[23528]: cluster 2024-09-21T03:47:26.502421+0000 mgr.a (mgr.14388) 14414 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:28 smithi044 bash[22676]: audit 2024-09-21T03:47:27.693549+0000 mon.a (mon.0) 11611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:28 smithi044 bash[22676]: audit 2024-09-21T03:47:27.702223+0000 mon.a (mon.0) 11612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:28 smithi044 bash[22676]: audit 2024-09-21T03:47:27.712692+0000 mon.a (mon.0) 11613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:28 smithi044 bash[22676]: cluster 2024-09-21T03:47:28.503199+0000 mgr.a (mgr.14388) 14415 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:28 smithi179 bash[23186]: audit 2024-09-21T03:47:27.693549+0000 mon.a (mon.0) 11611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:28 smithi179 bash[23186]: audit 2024-09-21T03:47:27.702223+0000 mon.a (mon.0) 11612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:28 smithi179 bash[23186]: audit 2024-09-21T03:47:27.712692+0000 mon.a (mon.0) 11613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:28 smithi179 bash[23186]: cluster 2024-09-21T03:47:28.503199+0000 mgr.a (mgr.14388) 14415 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:28 smithi049 bash[23528]: audit 2024-09-21T03:47:27.693549+0000 mon.a (mon.0) 11611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:28 smithi049 bash[23528]: audit 2024-09-21T03:47:27.702223+0000 mon.a (mon.0) 11612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:28 smithi049 bash[23528]: audit 2024-09-21T03:47:27.712692+0000 mon.a (mon.0) 11613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:28 smithi049 bash[23528]: cluster 2024-09-21T03:47:28.503199+0000 mgr.a (mgr.14388) 14415 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:47:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:31.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:31.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:31 smithi044 bash[22676]: cluster 2024-09-21T03:47:30.505359+0000 mgr.a (mgr.14388) 14416 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:32.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:31 smithi179 bash[23186]: cluster 2024-09-21T03:47:30.505359+0000 mgr.a (mgr.14388) 14416 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:31 smithi049 bash[23528]: cluster 2024-09-21T03:47:30.505359+0000 mgr.a (mgr.14388) 14416 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:47:32.154 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:32.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:32.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:32.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:32.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:33.939 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:33 smithi049 bash[23528]: audit 2024-09-21T03:47:31.707855+0000 mgr.a (mgr.14388) 14417 : audit [DBG] from='client.312861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:33.939 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:33 smithi049 bash[23528]: cluster 2024-09-21T03:47:32.506362+0000 mgr.a (mgr.14388) 14418 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:33 smithi044 bash[22676]: audit 2024-09-21T03:47:31.707855+0000 mgr.a (mgr.14388) 14417 : audit [DBG] from='client.312861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:33 smithi044 bash[22676]: cluster 2024-09-21T03:47:32.506362+0000 mgr.a (mgr.14388) 14418 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:34.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:33 smithi179 bash[23186]: audit 2024-09-21T03:47:31.707855+0000 mgr.a (mgr.14388) 14417 : audit [DBG] from='client.312861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:34.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:33 smithi179 bash[23186]: cluster 2024-09-21T03:47:32.506362+0000 mgr.a (mgr.14388) 14418 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:34 smithi044 bash[22676]: cluster 2024-09-21T03:47:34.507136+0000 mgr.a (mgr.14388) 14419 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:34 smithi179 bash[23186]: cluster 2024-09-21T03:47:34.507136+0000 mgr.a (mgr.14388) 14419 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:34 smithi049 bash[23528]: cluster 2024-09-21T03:47:34.507136+0000 mgr.a (mgr.14388) 14419 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:37.837 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:37 smithi179 bash[23186]: cluster 2024-09-21T03:47:36.509397+0000 mgr.a (mgr.14388) 14420 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:37.904 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:37.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:37.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:37.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:37.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:37.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:37 smithi044 bash[22676]: cluster 2024-09-21T03:47:36.509397+0000 mgr.a (mgr.14388) 14420 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:38.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:37 smithi049 bash[23528]: cluster 2024-09-21T03:47:36.509397+0000 mgr.a (mgr.14388) 14420 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:38 smithi044 bash[22676]: audit 2024-09-21T03:47:37.478365+0000 mgr.a (mgr.14388) 14421 : audit [DBG] from='client.312939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:38 smithi179 bash[23186]: audit 2024-09-21T03:47:37.478365+0000 mgr.a (mgr.14388) 14421 : audit [DBG] from='client.312939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:38 smithi049 bash[23528]: audit 2024-09-21T03:47:37.478365+0000 mgr.a (mgr.14388) 14421 : audit [DBG] from='client.312939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:39 smithi044 bash[22676]: cluster 2024-09-21T03:47:38.510376+0000 mgr.a (mgr.14388) 14422 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:39 smithi044 bash[22676]: audit 2024-09-21T03:47:39.489738+0000 mon.a (mon.0) 11614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:39 smithi044 bash[22676]: audit 2024-09-21T03:47:39.498177+0000 mon.a (mon.0) 11615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:39 smithi044 bash[22676]: audit 2024-09-21T03:47:39.508618+0000 mon.a (mon.0) 11616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:39 smithi044 bash[22676]: audit 2024-09-21T03:47:39.549515+0000 mon.a (mon.0) 11617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:39 smithi044 bash[22676]: audit 2024-09-21T03:47:39.556753+0000 mon.a (mon.0) 11618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:39 smithi044 bash[22676]: audit 2024-09-21T03:47:39.564700+0000 mon.a (mon.0) 11619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:39 smithi179 bash[23186]: cluster 2024-09-21T03:47:38.510376+0000 mgr.a (mgr.14388) 14422 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:39 smithi179 bash[23186]: audit 2024-09-21T03:47:39.489738+0000 mon.a (mon.0) 11614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:39 smithi179 bash[23186]: audit 2024-09-21T03:47:39.498177+0000 mon.a (mon.0) 11615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:39 smithi179 bash[23186]: audit 2024-09-21T03:47:39.508618+0000 mon.a (mon.0) 11616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:39 smithi179 bash[23186]: audit 2024-09-21T03:47:39.549515+0000 mon.a (mon.0) 11617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:39 smithi179 bash[23186]: audit 2024-09-21T03:47:39.556753+0000 mon.a (mon.0) 11618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:39 smithi179 bash[23186]: audit 2024-09-21T03:47:39.564700+0000 mon.a (mon.0) 11619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:39 smithi049 bash[23528]: cluster 2024-09-21T03:47:38.510376+0000 mgr.a (mgr.14388) 14422 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:39 smithi049 bash[23528]: audit 2024-09-21T03:47:39.489738+0000 mon.a (mon.0) 11614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:39 smithi049 bash[23528]: audit 2024-09-21T03:47:39.498177+0000 mon.a (mon.0) 11615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:39 smithi049 bash[23528]: audit 2024-09-21T03:47:39.508618+0000 mon.a (mon.0) 11616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:39 smithi049 bash[23528]: audit 2024-09-21T03:47:39.549515+0000 mon.a (mon.0) 11617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:39 smithi049 bash[23528]: audit 2024-09-21T03:47:39.556753+0000 mon.a (mon.0) 11618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:39 smithi049 bash[23528]: audit 2024-09-21T03:47:39.564700+0000 mon.a (mon.0) 11619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:40 smithi179 bash[23186]: cluster 2024-09-21T03:47:40.512567+0000 mgr.a (mgr.14388) 14423 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:40.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:40 smithi049 bash[23528]: cluster 2024-09-21T03:47:40.512567+0000 mgr.a (mgr.14388) 14423 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:40 smithi044 bash[22676]: cluster 2024-09-21T03:47:40.512567+0000 mgr.a (mgr.14388) 14423 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:42.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:42 smithi049 bash[23528]: cluster 2024-09-21T03:47:42.513355+0000 mgr.a (mgr.14388) 14424 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:42.905 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:42.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:42.906 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:42 smithi044 bash[22676]: cluster 2024-09-21T03:47:42.513355+0000 mgr.a (mgr.14388) 14424 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:42 smithi179 bash[23186]: cluster 2024-09-21T03:47:42.513355+0000 mgr.a (mgr.14388) 14424 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:43.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:43 smithi049 bash[23528]: audit 2024-09-21T03:47:43.246882+0000 mgr.a (mgr.14388) 14425 : audit [DBG] from='client.313014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:43 smithi044 bash[22676]: audit 2024-09-21T03:47:43.246882+0000 mgr.a (mgr.14388) 14425 : audit [DBG] from='client.313014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:43 smithi179 bash[23186]: audit 2024-09-21T03:47:43.246882+0000 mgr.a (mgr.14388) 14425 : audit [DBG] from='client.313014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:44 smithi044 bash[22676]: cluster 2024-09-21T03:47:44.514360+0000 mgr.a (mgr.14388) 14426 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:44 smithi179 bash[23186]: cluster 2024-09-21T03:47:44.514360+0000 mgr.a (mgr.14388) 14426 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:44 smithi049 bash[23528]: cluster 2024-09-21T03:47:44.514360+0000 mgr.a (mgr.14388) 14426 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:47:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:46 smithi044 bash[22676]: cluster 2024-09-21T03:47:46.516600+0000 mgr.a (mgr.14388) 14427 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:46 smithi179 bash[23186]: cluster 2024-09-21T03:47:46.516600+0000 mgr.a (mgr.14388) 14427 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:46 smithi049 bash[23528]: cluster 2024-09-21T03:47:46.516600+0000 mgr.a (mgr.14388) 14427 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T03:47:48.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:48.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:48.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:49.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:48 smithi044 bash[22676]: audit 2024-09-21T03:47:47.925738+0000 mon.a (mon.0) 11620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:48 smithi044 bash[22676]: audit 2024-09-21T03:47:47.935366+0000 mon.a (mon.0) 11621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:48 smithi044 bash[22676]: audit 2024-09-21T03:47:47.946349+0000 mon.a (mon.0) 11622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:48 smithi044 bash[22676]: cluster 2024-09-21T03:47:48.517395+0000 mgr.a (mgr.14388) 14428 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:48 smithi179 bash[23186]: audit 2024-09-21T03:47:47.925738+0000 mon.a (mon.0) 11620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:48 smithi179 bash[23186]: audit 2024-09-21T03:47:47.935366+0000 mon.a (mon.0) 11621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:48 smithi179 bash[23186]: audit 2024-09-21T03:47:47.946349+0000 mon.a (mon.0) 11622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:48 smithi179 bash[23186]: cluster 2024-09-21T03:47:48.517395+0000 mgr.a (mgr.14388) 14428 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:49.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:48 smithi049 bash[23528]: audit 2024-09-21T03:47:47.925738+0000 mon.a (mon.0) 11620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:48 smithi049 bash[23528]: audit 2024-09-21T03:47:47.935366+0000 mon.a (mon.0) 11621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:48 smithi049 bash[23528]: audit 2024-09-21T03:47:47.946349+0000 mon.a (mon.0) 11622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:47:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:48 smithi049 bash[23528]: cluster 2024-09-21T03:47:48.517395+0000 mgr.a (mgr.14388) 14428 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:49.495 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:50.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:49 smithi044 bash[22676]: audit 2024-09-21T03:47:49.042913+0000 mgr.a (mgr.14388) 14429 : audit [DBG] from='client.313086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:50.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:49 smithi179 bash[23186]: audit 2024-09-21T03:47:49.042913+0000 mgr.a (mgr.14388) 14429 : audit [DBG] from='client.313086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:50.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:49 smithi049 bash[23528]: audit 2024-09-21T03:47:49.042913+0000 mgr.a (mgr.14388) 14429 : audit [DBG] from='client.313086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:51.184 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:50 smithi044 bash[22676]: cluster 2024-09-21T03:47:50.519712+0000 mgr.a (mgr.14388) 14430 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:51.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:50 smithi179 bash[23186]: cluster 2024-09-21T03:47:50.519712+0000 mgr.a (mgr.14388) 14430 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:51.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:50 smithi049 bash[23528]: cluster 2024-09-21T03:47:50.519712+0000 mgr.a (mgr.14388) 14430 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:47:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:52 smithi044 bash[22676]: cluster 2024-09-21T03:47:52.520531+0000 mgr.a (mgr.14388) 14431 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:52 smithi179 bash[23186]: cluster 2024-09-21T03:47:52.520531+0000 mgr.a (mgr.14388) 14431 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:52 smithi049 bash[23528]: cluster 2024-09-21T03:47:52.520531+0000 mgr.a (mgr.14388) 14431 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:54.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:47:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:47:54.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:47:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:54 smithi049 bash[23528]: cluster 2024-09-21T03:47:54.521097+0000 mgr.a (mgr.14388) 14432 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:54.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:54 smithi044 bash[22676]: cluster 2024-09-21T03:47:54.521097+0000 mgr.a (mgr.14388) 14432 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:54 smithi179 bash[23186]: cluster 2024-09-21T03:47:54.521097+0000 mgr.a (mgr.14388) 14432 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:55.265 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:47:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:47:55.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:47:55.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:47:55.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:47:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:55 smithi044 bash[22676]: audit 2024-09-21T03:47:54.837029+0000 mgr.a (mgr.14388) 14433 : audit [DBG] from='client.313158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:56.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:55 smithi179 bash[23186]: audit 2024-09-21T03:47:54.837029+0000 mgr.a (mgr.14388) 14433 : audit [DBG] from='client.313158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:55 smithi049 bash[23528]: audit 2024-09-21T03:47:54.837029+0000 mgr.a (mgr.14388) 14433 : audit [DBG] from='client.313158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:56 smithi044 bash[22676]: cluster 2024-09-21T03:47:56.523873+0000 mgr.a (mgr.14388) 14434 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:56 smithi179 bash[23186]: cluster 2024-09-21T03:47:56.523873+0000 mgr.a (mgr.14388) 14434 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:56 smithi049 bash[23528]: cluster 2024-09-21T03:47:56.523873+0000 mgr.a (mgr.14388) 14434 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:47:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:47:58 smithi044 bash[22676]: cluster 2024-09-21T03:47:58.524661+0000 mgr.a (mgr.14388) 14435 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:47:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:47:58 smithi179 bash[23186]: cluster 2024-09-21T03:47:58.524661+0000 mgr.a (mgr.14388) 14435 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:47:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:47:58 smithi049 bash[23528]: cluster 2024-09-21T03:47:58.524661+0000 mgr.a (mgr.14388) 14435 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:00.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:00.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:00.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:00.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:00 smithi044 bash[22676]: audit 2024-09-21T03:47:59.668592+0000 mon.a (mon.0) 11623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:00 smithi044 bash[22676]: audit 2024-09-21T03:47:59.675648+0000 mon.a (mon.0) 11624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:00 smithi044 bash[22676]: audit 2024-09-21T03:47:59.684247+0000 mon.a (mon.0) 11625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:00 smithi044 bash[22676]: audit 2024-09-21T03:47:59.740942+0000 mon.a (mon.0) 11626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:00 smithi044 bash[22676]: audit 2024-09-21T03:47:59.747848+0000 mon.a (mon.0) 11627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:00 smithi044 bash[22676]: audit 2024-09-21T03:47:59.756169+0000 mon.a (mon.0) 11628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:00 smithi044 bash[22676]: cluster 2024-09-21T03:48:00.526855+0000 mgr.a (mgr.14388) 14436 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:00 smithi179 bash[23186]: audit 2024-09-21T03:47:59.668592+0000 mon.a (mon.0) 11623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:00 smithi179 bash[23186]: audit 2024-09-21T03:47:59.675648+0000 mon.a (mon.0) 11624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:00 smithi179 bash[23186]: audit 2024-09-21T03:47:59.684247+0000 mon.a (mon.0) 11625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:00 smithi179 bash[23186]: audit 2024-09-21T03:47:59.740942+0000 mon.a (mon.0) 11626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:00 smithi179 bash[23186]: audit 2024-09-21T03:47:59.747848+0000 mon.a (mon.0) 11627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:00 smithi179 bash[23186]: audit 2024-09-21T03:47:59.756169+0000 mon.a (mon.0) 11628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:00 smithi179 bash[23186]: cluster 2024-09-21T03:48:00.526855+0000 mgr.a (mgr.14388) 14436 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:01.046 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:01.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:01.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:01.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:01.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:00 smithi049 bash[23528]: audit 2024-09-21T03:47:59.668592+0000 mon.a (mon.0) 11623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:00 smithi049 bash[23528]: audit 2024-09-21T03:47:59.675648+0000 mon.a (mon.0) 11624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:00 smithi049 bash[23528]: audit 2024-09-21T03:47:59.684247+0000 mon.a (mon.0) 11625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:00 smithi049 bash[23528]: audit 2024-09-21T03:47:59.740942+0000 mon.a (mon.0) 11626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:00 smithi049 bash[23528]: audit 2024-09-21T03:47:59.747848+0000 mon.a (mon.0) 11627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:00 smithi049 bash[23528]: audit 2024-09-21T03:47:59.756169+0000 mon.a (mon.0) 11628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:00 smithi049 bash[23528]: cluster 2024-09-21T03:48:00.526855+0000 mgr.a (mgr.14388) 14436 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:01 smithi049 bash[23528]: audit 2024-09-21T03:48:00.601384+0000 mgr.a (mgr.14388) 14437 : audit [DBG] from='client.313236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:02.084 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:01 smithi044 bash[22676]: audit 2024-09-21T03:48:00.601384+0000 mgr.a (mgr.14388) 14437 : audit [DBG] from='client.313236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:02.135 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:01 smithi179 bash[23186]: audit 2024-09-21T03:48:00.601384+0000 mgr.a (mgr.14388) 14437 : audit [DBG] from='client.313236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:02 smithi049 bash[23528]: cluster 2024-09-21T03:48:02.527840+0000 mgr.a (mgr.14388) 14438 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:02 smithi044 bash[22676]: cluster 2024-09-21T03:48:02.527840+0000 mgr.a (mgr.14388) 14438 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:02 smithi179 bash[23186]: cluster 2024-09-21T03:48:02.527840+0000 mgr.a (mgr.14388) 14438 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:04 smithi044 bash[22676]: cluster 2024-09-21T03:48:04.528635+0000 mgr.a (mgr.14388) 14439 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:48:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:04 smithi179 bash[23186]: cluster 2024-09-21T03:48:04.528635+0000 mgr.a (mgr.14388) 14439 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:48:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:04 smithi049 bash[23528]: cluster 2024-09-21T03:48:04.528635+0000 mgr.a (mgr.14388) 14439 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:48:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:06.812 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:06.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:06.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:06.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:06.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:06 smithi044 bash[22676]: audit 2024-09-21T03:48:06.382277+0000 mgr.a (mgr.14388) 14440 : audit [DBG] from='client.313314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:06 smithi044 bash[22676]: cluster 2024-09-21T03:48:06.530174+0000 mgr.a (mgr.14388) 14441 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:06 smithi179 bash[23186]: audit 2024-09-21T03:48:06.382277+0000 mgr.a (mgr.14388) 14440 : audit [DBG] from='client.313314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:06 smithi179 bash[23186]: cluster 2024-09-21T03:48:06.530174+0000 mgr.a (mgr.14388) 14441 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:06 smithi049 bash[23528]: audit 2024-09-21T03:48:06.382277+0000 mgr.a (mgr.14388) 14440 : audit [DBG] from='client.313314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:06 smithi049 bash[23528]: cluster 2024-09-21T03:48:06.530174+0000 mgr.a (mgr.14388) 14441 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:09 smithi044 bash[22676]: audit 2024-09-21T03:48:08.163507+0000 mon.a (mon.0) 11629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:09 smithi044 bash[22676]: audit 2024-09-21T03:48:08.172556+0000 mon.a (mon.0) 11630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:09 smithi044 bash[22676]: audit 2024-09-21T03:48:08.183335+0000 mon.a (mon.0) 11631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:09 smithi044 bash[22676]: cluster 2024-09-21T03:48:08.531035+0000 mgr.a (mgr.14388) 14442 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:09.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:09 smithi179 bash[23186]: audit 2024-09-21T03:48:08.163507+0000 mon.a (mon.0) 11629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:09 smithi179 bash[23186]: audit 2024-09-21T03:48:08.172556+0000 mon.a (mon.0) 11630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:09 smithi179 bash[23186]: audit 2024-09-21T03:48:08.183335+0000 mon.a (mon.0) 11631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:09 smithi179 bash[23186]: cluster 2024-09-21T03:48:08.531035+0000 mgr.a (mgr.14388) 14442 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:09.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:09 smithi049 bash[23528]: audit 2024-09-21T03:48:08.163507+0000 mon.a (mon.0) 11629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:09 smithi049 bash[23528]: audit 2024-09-21T03:48:08.172556+0000 mon.a (mon.0) 11630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:09 smithi049 bash[23528]: audit 2024-09-21T03:48:08.183335+0000 mon.a (mon.0) 11631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:09 smithi049 bash[23528]: cluster 2024-09-21T03:48:08.531035+0000 mgr.a (mgr.14388) 14442 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:10 smithi044 bash[22676]: cluster 2024-09-21T03:48:10.533328+0000 mgr.a (mgr.14388) 14443 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:10 smithi179 bash[23186]: cluster 2024-09-21T03:48:10.533328+0000 mgr.a (mgr.14388) 14443 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:10 smithi049 bash[23528]: cluster 2024-09-21T03:48:10.533328+0000 mgr.a (mgr.14388) 14443 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:11.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:11.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:11.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:12.610 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:12.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:12 smithi044 bash[22676]: audit 2024-09-21T03:48:12.155752+0000 mgr.a (mgr.14388) 14444 : audit [DBG] from='client.313392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:12.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:12 smithi044 bash[22676]: cluster 2024-09-21T03:48:12.533901+0000 mgr.a (mgr.14388) 14445 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:12 smithi179 bash[23186]: audit 2024-09-21T03:48:12.155752+0000 mgr.a (mgr.14388) 14444 : audit [DBG] from='client.313392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:12 smithi179 bash[23186]: cluster 2024-09-21T03:48:12.533901+0000 mgr.a (mgr.14388) 14445 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:12 smithi049 bash[23528]: audit 2024-09-21T03:48:12.155752+0000 mgr.a (mgr.14388) 14444 : audit [DBG] from='client.313392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:12 smithi049 bash[23528]: cluster 2024-09-21T03:48:12.533901+0000 mgr.a (mgr.14388) 14445 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:14.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:14 smithi044 bash[22676]: cluster 2024-09-21T03:48:14.534698+0000 mgr.a (mgr.14388) 14446 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:14 smithi179 bash[23186]: cluster 2024-09-21T03:48:14.534698+0000 mgr.a (mgr.14388) 14446 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:14 smithi049 bash[23528]: cluster 2024-09-21T03:48:14.534698+0000 mgr.a (mgr.14388) 14446 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:16.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:16 smithi044 bash[22676]: cluster 2024-09-21T03:48:16.537079+0000 mgr.a (mgr.14388) 14447 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:16 smithi044 bash[22676]: audit 2024-09-21T03:48:16.543605+0000 mon.a (mon.0) 11632 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:48:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:16 smithi044 bash[22676]: audit 2024-09-21T03:48:16.550574+0000 mon.a (mon.0) 11633 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:48:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:16 smithi044 bash[22676]: audit 2024-09-21T03:48:16.552429+0000 mon.a (mon.0) 11634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:48:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:16 smithi044 bash[22676]: audit 2024-09-21T03:48:16.563924+0000 mon.a (mon.0) 11635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:16 smithi044 bash[22676]: audit 2024-09-21T03:48:16.571053+0000 mon.a (mon.0) 11636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:48:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:16 smithi179 bash[23186]: cluster 2024-09-21T03:48:16.537079+0000 mgr.a (mgr.14388) 14447 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:16 smithi179 bash[23186]: audit 2024-09-21T03:48:16.543605+0000 mon.a (mon.0) 11632 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:48:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:16 smithi179 bash[23186]: audit 2024-09-21T03:48:16.550574+0000 mon.a (mon.0) 11633 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:48:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:16 smithi179 bash[23186]: audit 2024-09-21T03:48:16.552429+0000 mon.a (mon.0) 11634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:48:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:16 smithi179 bash[23186]: audit 2024-09-21T03:48:16.563924+0000 mon.a (mon.0) 11635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:16 smithi179 bash[23186]: audit 2024-09-21T03:48:16.571053+0000 mon.a (mon.0) 11636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:48:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:16 smithi049 bash[23528]: cluster 2024-09-21T03:48:16.537079+0000 mgr.a (mgr.14388) 14447 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:16 smithi049 bash[23528]: audit 2024-09-21T03:48:16.543605+0000 mon.a (mon.0) 11632 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:48:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:16 smithi049 bash[23528]: audit 2024-09-21T03:48:16.550574+0000 mon.a (mon.0) 11633 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:48:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:16 smithi049 bash[23528]: audit 2024-09-21T03:48:16.552429+0000 mon.a (mon.0) 11634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:48:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:16 smithi049 bash[23528]: audit 2024-09-21T03:48:16.563924+0000 mon.a (mon.0) 11635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:16 smithi049 bash[23528]: audit 2024-09-21T03:48:16.571053+0000 mon.a (mon.0) 11636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:48:17.601 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:48:17 smithi044 bash[22930]: debug 2024-09-21T03:48:17.342+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:48:17.601 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:48:17 smithi044 bash[22930]: debug 2024-09-21T03:48:17.346+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:48:17.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:17.612 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:17.612 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:17 smithi044 bash[22676]: audit 2024-09-21T03:48:16.573631+0000 mgr.a (mgr.14388) 14448 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:48:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:17 smithi044 bash[22676]: audit 2024-09-21T03:48:17.348277+0000 mgr.a (mgr.14388) 14449 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:48:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:17 smithi044 bash[22676]: cephadm 2024-09-21T03:48:17.349816+0000 mgr.a (mgr.14388) 14450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:48:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:17 smithi179 bash[23186]: audit 2024-09-21T03:48:16.573631+0000 mgr.a (mgr.14388) 14448 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:48:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:17 smithi179 bash[23186]: audit 2024-09-21T03:48:17.348277+0000 mgr.a (mgr.14388) 14449 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:48:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:17 smithi179 bash[23186]: cephadm 2024-09-21T03:48:17.349816+0000 mgr.a (mgr.14388) 14450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:48:18.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:17 smithi049 bash[23528]: audit 2024-09-21T03:48:16.573631+0000 mgr.a (mgr.14388) 14448 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:48:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:17 smithi049 bash[23528]: audit 2024-09-21T03:48:17.348277+0000 mgr.a (mgr.14388) 14449 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:48:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:17 smithi049 bash[23528]: cephadm 2024-09-21T03:48:17.349816+0000 mgr.a (mgr.14388) 14450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:48:18.391 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:18.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:18.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:18.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:18.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:18.980 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:18 smithi179 bash[23186]: audit 2024-09-21T03:48:17.946871+0000 mgr.a (mgr.14388) 14451 : audit [DBG] from='client.313575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:18.981 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:18 smithi179 bash[23186]: cluster 2024-09-21T03:48:18.538107+0000 mgr.a (mgr.14388) 14452 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:18.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:18 smithi044 bash[22676]: audit 2024-09-21T03:48:17.946871+0000 mgr.a (mgr.14388) 14451 : audit [DBG] from='client.313575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:18 smithi044 bash[22676]: cluster 2024-09-21T03:48:18.538107+0000 mgr.a (mgr.14388) 14452 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:18 smithi049 bash[23528]: audit 2024-09-21T03:48:17.946871+0000 mgr.a (mgr.14388) 14451 : audit [DBG] from='client.313575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:18 smithi049 bash[23528]: cluster 2024-09-21T03:48:18.538107+0000 mgr.a (mgr.14388) 14452 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:21.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:20 smithi179 bash[23186]: audit 2024-09-21T03:48:19.849541+0000 mon.a (mon.0) 11637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:20 smithi179 bash[23186]: audit 2024-09-21T03:48:19.857973+0000 mon.a (mon.0) 11638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:20 smithi179 bash[23186]: audit 2024-09-21T03:48:19.867438+0000 mon.a (mon.0) 11639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:20 smithi179 bash[23186]: audit 2024-09-21T03:48:19.977351+0000 mon.a (mon.0) 11640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:20 smithi179 bash[23186]: audit 2024-09-21T03:48:19.985889+0000 mon.a (mon.0) 11641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:20 smithi179 bash[23186]: audit 2024-09-21T03:48:19.996726+0000 mon.a (mon.0) 11642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:20 smithi179 bash[23186]: cluster 2024-09-21T03:48:20.540491+0000 mgr.a (mgr.14388) 14453 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:20 smithi044 bash[22676]: audit 2024-09-21T03:48:19.849541+0000 mon.a (mon.0) 11637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:20 smithi044 bash[22676]: audit 2024-09-21T03:48:19.857973+0000 mon.a (mon.0) 11638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:20 smithi044 bash[22676]: audit 2024-09-21T03:48:19.867438+0000 mon.a (mon.0) 11639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:20 smithi044 bash[22676]: audit 2024-09-21T03:48:19.977351+0000 mon.a (mon.0) 11640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:20 smithi044 bash[22676]: audit 2024-09-21T03:48:19.985889+0000 mon.a (mon.0) 11641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:20 smithi044 bash[22676]: audit 2024-09-21T03:48:19.996726+0000 mon.a (mon.0) 11642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:20 smithi044 bash[22676]: cluster 2024-09-21T03:48:20.540491+0000 mgr.a (mgr.14388) 14453 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:21.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:20 smithi049 bash[23528]: audit 2024-09-21T03:48:19.849541+0000 mon.a (mon.0) 11637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:20 smithi049 bash[23528]: audit 2024-09-21T03:48:19.857973+0000 mon.a (mon.0) 11638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:20 smithi049 bash[23528]: audit 2024-09-21T03:48:19.867438+0000 mon.a (mon.0) 11639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:20 smithi049 bash[23528]: audit 2024-09-21T03:48:19.977351+0000 mon.a (mon.0) 11640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:20 smithi049 bash[23528]: audit 2024-09-21T03:48:19.985889+0000 mon.a (mon.0) 11641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:20 smithi049 bash[23528]: audit 2024-09-21T03:48:19.996726+0000 mon.a (mon.0) 11642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:20 smithi049 bash[23528]: cluster 2024-09-21T03:48:20.540491+0000 mgr.a (mgr.14388) 14453 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:22 smithi044 bash[22676]: cluster 2024-09-21T03:48:22.541352+0000 mgr.a (mgr.14388) 14454 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:22 smithi179 bash[23186]: cluster 2024-09-21T03:48:22.541352+0000 mgr.a (mgr.14388) 14454 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:22 smithi049 bash[23528]: cluster 2024-09-21T03:48:22.541352+0000 mgr.a (mgr.14388) 14454 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:23.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:23.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:23.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:24.178 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:24.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:24 smithi049 bash[23528]: audit 2024-09-21T03:48:23.732219+0000 mgr.a (mgr.14388) 14455 : audit [DBG] from='client.313653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:24 smithi049 bash[23528]: cluster 2024-09-21T03:48:24.542336+0000 mgr.a (mgr.14388) 14456 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:24 smithi044 bash[22676]: audit 2024-09-21T03:48:23.732219+0000 mgr.a (mgr.14388) 14455 : audit [DBG] from='client.313653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:24 smithi044 bash[22676]: cluster 2024-09-21T03:48:24.542336+0000 mgr.a (mgr.14388) 14456 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:24 smithi179 bash[23186]: audit 2024-09-21T03:48:23.732219+0000 mgr.a (mgr.14388) 14455 : audit [DBG] from='client.313653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:24 smithi179 bash[23186]: cluster 2024-09-21T03:48:24.542336+0000 mgr.a (mgr.14388) 14456 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:26 smithi044 bash[22676]: cluster 2024-09-21T03:48:26.544587+0000 mgr.a (mgr.14388) 14457 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:26 smithi179 bash[23186]: cluster 2024-09-21T03:48:26.544587+0000 mgr.a (mgr.14388) 14457 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:26 smithi049 bash[23528]: cluster 2024-09-21T03:48:26.544587+0000 mgr.a (mgr.14388) 14457 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:29.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:29 smithi044 bash[22676]: audit 2024-09-21T03:48:28.398359+0000 mon.a (mon.0) 11643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:29 smithi044 bash[22676]: audit 2024-09-21T03:48:28.407864+0000 mon.a (mon.0) 11644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:29 smithi044 bash[22676]: audit 2024-09-21T03:48:28.418752+0000 mon.a (mon.0) 11645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:29 smithi044 bash[22676]: cluster 2024-09-21T03:48:28.545378+0000 mgr.a (mgr.14388) 14458 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:29 smithi179 bash[23186]: audit 2024-09-21T03:48:28.398359+0000 mon.a (mon.0) 11643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:29 smithi179 bash[23186]: audit 2024-09-21T03:48:28.407864+0000 mon.a (mon.0) 11644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:29 smithi179 bash[23186]: audit 2024-09-21T03:48:28.418752+0000 mon.a (mon.0) 11645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:29 smithi179 bash[23186]: cluster 2024-09-21T03:48:28.545378+0000 mgr.a (mgr.14388) 14458 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:29.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:29 smithi049 bash[23528]: audit 2024-09-21T03:48:28.398359+0000 mon.a (mon.0) 11643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:29 smithi049 bash[23528]: audit 2024-09-21T03:48:28.407864+0000 mon.a (mon.0) 11644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:29 smithi049 bash[23528]: audit 2024-09-21T03:48:28.418752+0000 mon.a (mon.0) 11645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:29 smithi049 bash[23528]: cluster 2024-09-21T03:48:28.545378+0000 mgr.a (mgr.14388) 14458 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:29.968 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:29.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:30 smithi044 bash[22676]: audit 2024-09-21T03:48:29.519012+0000 mgr.a (mgr.14388) 14459 : audit [DBG] from='client.313731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:30 smithi179 bash[23186]: audit 2024-09-21T03:48:29.519012+0000 mgr.a (mgr.14388) 14459 : audit [DBG] from='client.313731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:30 smithi049 bash[23528]: audit 2024-09-21T03:48:29.519012+0000 mgr.a (mgr.14388) 14459 : audit [DBG] from='client.313731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:31.704 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:31 smithi044 bash[22676]: cluster 2024-09-21T03:48:30.547843+0000 mgr.a (mgr.14388) 14460 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:31.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:31 smithi179 bash[23186]: cluster 2024-09-21T03:48:30.547843+0000 mgr.a (mgr.14388) 14460 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:31.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:31 smithi049 bash[23528]: cluster 2024-09-21T03:48:30.547843+0000 mgr.a (mgr.14388) 14460 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:48:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:32 smithi044 bash[22676]: cluster 2024-09-21T03:48:32.548819+0000 mgr.a (mgr.14388) 14461 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:32 smithi179 bash[23186]: cluster 2024-09-21T03:48:32.548819+0000 mgr.a (mgr.14388) 14461 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:32 smithi049 bash[23528]: cluster 2024-09-21T03:48:32.548819+0000 mgr.a (mgr.14388) 14461 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:34.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:34.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:34.987 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:34 smithi044 bash[22676]: cluster 2024-09-21T03:48:34.549670+0000 mgr.a (mgr.14388) 14462 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:34 smithi179 bash[23186]: cluster 2024-09-21T03:48:34.549670+0000 mgr.a (mgr.14388) 14462 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:34 smithi049 bash[23528]: cluster 2024-09-21T03:48:34.549670+0000 mgr.a (mgr.14388) 14462 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:35.751 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:35.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:35.751 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:35.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:35.752 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:35 smithi044 bash[22676]: audit 2024-09-21T03:48:35.311079+0000 mgr.a (mgr.14388) 14463 : audit [DBG] from='client.313803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:36.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:35 smithi179 bash[23186]: audit 2024-09-21T03:48:35.311079+0000 mgr.a (mgr.14388) 14463 : audit [DBG] from='client.313803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:35 smithi049 bash[23528]: audit 2024-09-21T03:48:35.311079+0000 mgr.a (mgr.14388) 14463 : audit [DBG] from='client.313803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:36.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:36 smithi044 bash[22676]: cluster 2024-09-21T03:48:36.552574+0000 mgr.a (mgr.14388) 14464 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:36 smithi179 bash[23186]: cluster 2024-09-21T03:48:36.552574+0000 mgr.a (mgr.14388) 14464 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:36 smithi049 bash[23528]: cluster 2024-09-21T03:48:36.552574+0000 mgr.a (mgr.14388) 14464 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:38 smithi044 bash[22676]: cluster 2024-09-21T03:48:38.553394+0000 mgr.a (mgr.14388) 14465 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:38.999 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:38 smithi179 bash[23186]: cluster 2024-09-21T03:48:38.553394+0000 mgr.a (mgr.14388) 14465 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:39.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:38 smithi049 bash[23528]: cluster 2024-09-21T03:48:38.553394+0000 mgr.a (mgr.14388) 14465 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:41 smithi179 bash[23186]: audit 2024-09-21T03:48:40.027656+0000 mon.a (mon.0) 11646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:41 smithi179 bash[23186]: audit 2024-09-21T03:48:40.033534+0000 mon.a (mon.0) 11647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:41 smithi179 bash[23186]: audit 2024-09-21T03:48:40.042654+0000 mon.a (mon.0) 11648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:41 smithi179 bash[23186]: audit 2024-09-21T03:48:40.214999+0000 mon.a (mon.0) 11649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:41 smithi179 bash[23186]: audit 2024-09-21T03:48:40.223617+0000 mon.a (mon.0) 11650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:41 smithi179 bash[23186]: audit 2024-09-21T03:48:40.233773+0000 mon.a (mon.0) 11651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:41 smithi179 bash[23186]: cluster 2024-09-21T03:48:40.555428+0000 mgr.a (mgr.14388) 14466 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:41 smithi049 bash[23528]: audit 2024-09-21T03:48:40.027656+0000 mon.a (mon.0) 11646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:41 smithi049 bash[23528]: audit 2024-09-21T03:48:40.033534+0000 mon.a (mon.0) 11647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:41 smithi049 bash[23528]: audit 2024-09-21T03:48:40.042654+0000 mon.a (mon.0) 11648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:41 smithi049 bash[23528]: audit 2024-09-21T03:48:40.214999+0000 mon.a (mon.0) 11649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:41 smithi049 bash[23528]: audit 2024-09-21T03:48:40.223617+0000 mon.a (mon.0) 11650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:41 smithi049 bash[23528]: audit 2024-09-21T03:48:40.233773+0000 mon.a (mon.0) 11651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:41 smithi049 bash[23528]: cluster 2024-09-21T03:48:40.555428+0000 mgr.a (mgr.14388) 14466 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:41 smithi044 bash[22676]: audit 2024-09-21T03:48:40.027656+0000 mon.a (mon.0) 11646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:41 smithi044 bash[22676]: audit 2024-09-21T03:48:40.033534+0000 mon.a (mon.0) 11647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:41 smithi044 bash[22676]: audit 2024-09-21T03:48:40.042654+0000 mon.a (mon.0) 11648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:41 smithi044 bash[22676]: audit 2024-09-21T03:48:40.214999+0000 mon.a (mon.0) 11649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:41 smithi044 bash[22676]: audit 2024-09-21T03:48:40.223617+0000 mon.a (mon.0) 11650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:41 smithi044 bash[22676]: audit 2024-09-21T03:48:40.233773+0000 mon.a (mon.0) 11651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:41 smithi044 bash[22676]: cluster 2024-09-21T03:48:40.555428+0000 mgr.a (mgr.14388) 14466 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:41.511 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:41.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:42 smithi044 bash[22676]: audit 2024-09-21T03:48:41.079499+0000 mgr.a (mgr.14388) 14467 : audit [DBG] from='client.313878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:42.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:42 smithi179 bash[23186]: audit 2024-09-21T03:48:41.079499+0000 mgr.a (mgr.14388) 14467 : audit [DBG] from='client.313878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:42 smithi049 bash[23528]: audit 2024-09-21T03:48:41.079499+0000 mgr.a (mgr.14388) 14467 : audit [DBG] from='client.313878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:43.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:43 smithi049 bash[23528]: cluster 2024-09-21T03:48:42.556363+0000 mgr.a (mgr.14388) 14468 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:43.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:43 smithi179 bash[23186]: cluster 2024-09-21T03:48:42.556363+0000 mgr.a (mgr.14388) 14468 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:43.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:43 smithi044 bash[22676]: cluster 2024-09-21T03:48:42.556363+0000 mgr.a (mgr.14388) 14468 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:48:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:44 smithi044 bash[22676]: cluster 2024-09-21T03:48:44.557314+0000 mgr.a (mgr.14388) 14469 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:48:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:44 smithi179 bash[23186]: cluster 2024-09-21T03:48:44.557314+0000 mgr.a (mgr.14388) 14469 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:48:45.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:44 smithi049 bash[23528]: cluster 2024-09-21T03:48:44.557314+0000 mgr.a (mgr.14388) 14469 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:48:46.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:46.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:46.514 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:46 smithi044 bash[22676]: cluster 2024-09-21T03:48:46.558841+0000 mgr.a (mgr.14388) 14470 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:46 smithi179 bash[23186]: cluster 2024-09-21T03:48:46.558841+0000 mgr.a (mgr.14388) 14470 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:46 smithi049 bash[23528]: cluster 2024-09-21T03:48:46.558841+0000 mgr.a (mgr.14388) 14470 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:47.316 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:47.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:47.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:47.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:47.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:47.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:47 smithi044 bash[22676]: audit 2024-09-21T03:48:46.848260+0000 mgr.a (mgr.14388) 14471 : audit [DBG] from='client.313950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:48.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:47 smithi179 bash[23186]: audit 2024-09-21T03:48:46.848260+0000 mgr.a (mgr.14388) 14471 : audit [DBG] from='client.313950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:47 smithi049 bash[23528]: audit 2024-09-21T03:48:46.848260+0000 mgr.a (mgr.14388) 14471 : audit [DBG] from='client.313950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:48 smithi044 bash[22676]: cluster 2024-09-21T03:48:48.559730+0000 mgr.a (mgr.14388) 14472 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:48 smithi179 bash[23186]: cluster 2024-09-21T03:48:48.559730+0000 mgr.a (mgr.14388) 14472 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:48 smithi049 bash[23528]: cluster 2024-09-21T03:48:48.559730+0000 mgr.a (mgr.14388) 14472 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:49 smithi044 bash[22676]: audit 2024-09-21T03:48:48.637736+0000 mon.a (mon.0) 11652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:49 smithi044 bash[22676]: audit 2024-09-21T03:48:48.652088+0000 mon.a (mon.0) 11653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:49 smithi044 bash[22676]: audit 2024-09-21T03:48:48.663077+0000 mon.a (mon.0) 11654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:50.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:49 smithi179 bash[23186]: audit 2024-09-21T03:48:48.637736+0000 mon.a (mon.0) 11652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:50.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:49 smithi179 bash[23186]: audit 2024-09-21T03:48:48.652088+0000 mon.a (mon.0) 11653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:50.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:49 smithi179 bash[23186]: audit 2024-09-21T03:48:48.663077+0000 mon.a (mon.0) 11654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:50.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:49 smithi049 bash[23528]: audit 2024-09-21T03:48:48.637736+0000 mon.a (mon.0) 11652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:50.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:49 smithi049 bash[23528]: audit 2024-09-21T03:48:48.652088+0000 mon.a (mon.0) 11653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:50.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:49 smithi049 bash[23528]: audit 2024-09-21T03:48:48.663077+0000 mon.a (mon.0) 11654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:48:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:50 smithi044 bash[22676]: cluster 2024-09-21T03:48:50.562036+0000 mgr.a (mgr.14388) 14473 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:50 smithi179 bash[23186]: cluster 2024-09-21T03:48:50.562036+0000 mgr.a (mgr.14388) 14473 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:51.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:50 smithi049 bash[23528]: cluster 2024-09-21T03:48:50.562036+0000 mgr.a (mgr.14388) 14473 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:52.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:52.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:52.319 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:52 smithi044 bash[22676]: cluster 2024-09-21T03:48:52.562799+0000 mgr.a (mgr.14388) 14474 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:52 smithi179 bash[23186]: cluster 2024-09-21T03:48:52.562799+0000 mgr.a (mgr.14388) 14474 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:52 smithi049 bash[23528]: cluster 2024-09-21T03:48:52.562799+0000 mgr.a (mgr.14388) 14474 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:53.089 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:53.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:53.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:53.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:53.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:53 smithi044 bash[22676]: audit 2024-09-21T03:48:52.650995+0000 mgr.a (mgr.14388) 14475 : audit [DBG] from='client.314028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:54.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:53 smithi179 bash[23186]: audit 2024-09-21T03:48:52.650995+0000 mgr.a (mgr.14388) 14475 : audit [DBG] from='client.314028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:53 smithi049 bash[23528]: audit 2024-09-21T03:48:52.650995+0000 mgr.a (mgr.14388) 14475 : audit [DBG] from='client.314028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:54 smithi044 bash[22676]: cluster 2024-09-21T03:48:54.563767+0000 mgr.a (mgr.14388) 14476 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:54 smithi179 bash[23186]: cluster 2024-09-21T03:48:54.563767+0000 mgr.a (mgr.14388) 14476 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:54 smithi049 bash[23528]: cluster 2024-09-21T03:48:54.563767+0000 mgr.a (mgr.14388) 14476 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:56 smithi044 bash[22676]: cluster 2024-09-21T03:48:56.566071+0000 mgr.a (mgr.14388) 14477 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:56 smithi179 bash[23186]: cluster 2024-09-21T03:48:56.566071+0000 mgr.a (mgr.14388) 14477 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:56 smithi049 bash[23528]: cluster 2024-09-21T03:48:56.566071+0000 mgr.a (mgr.14388) 14477 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:48:58.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:48:58.091 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:48:58.091 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:48:58.873 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:48:58.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:48:58.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:48:58.873 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:48:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:48:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:58 smithi044 bash[22676]: audit 2024-09-21T03:48:58.426974+0000 mgr.a (mgr.14388) 14478 : audit [DBG] from='client.314106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:48:58 smithi044 bash[22676]: cluster 2024-09-21T03:48:58.572266+0000 mgr.a (mgr.14388) 14479 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:58 smithi179 bash[23186]: audit 2024-09-21T03:48:58.426974+0000 mgr.a (mgr.14388) 14478 : audit [DBG] from='client.314106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:48:58 smithi179 bash[23186]: cluster 2024-09-21T03:48:58.572266+0000 mgr.a (mgr.14388) 14479 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:48:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:58 smithi049 bash[23528]: audit 2024-09-21T03:48:58.426974+0000 mgr.a (mgr.14388) 14478 : audit [DBG] from='client.314106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:48:58 smithi049 bash[23528]: cluster 2024-09-21T03:48:58.572266+0000 mgr.a (mgr.14388) 14479 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:01 smithi044 bash[22676]: audit 2024-09-21T03:49:00.201662+0000 mon.a (mon.0) 11655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:01 smithi044 bash[22676]: audit 2024-09-21T03:49:00.210213+0000 mon.a (mon.0) 11656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:01 smithi044 bash[22676]: audit 2024-09-21T03:49:00.220339+0000 mon.a (mon.0) 11657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:01 smithi044 bash[22676]: audit 2024-09-21T03:49:00.451230+0000 mon.a (mon.0) 11658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:01 smithi044 bash[22676]: audit 2024-09-21T03:49:00.459432+0000 mon.a (mon.0) 11659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:01 smithi044 bash[22676]: audit 2024-09-21T03:49:00.469535+0000 mon.a (mon.0) 11660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:01 smithi044 bash[22676]: cluster 2024-09-21T03:49:00.574730+0000 mgr.a (mgr.14388) 14480 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:01 smithi179 bash[23186]: audit 2024-09-21T03:49:00.201662+0000 mon.a (mon.0) 11655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:01 smithi179 bash[23186]: audit 2024-09-21T03:49:00.210213+0000 mon.a (mon.0) 11656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:01 smithi179 bash[23186]: audit 2024-09-21T03:49:00.220339+0000 mon.a (mon.0) 11657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:01 smithi179 bash[23186]: audit 2024-09-21T03:49:00.451230+0000 mon.a (mon.0) 11658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:01 smithi179 bash[23186]: audit 2024-09-21T03:49:00.459432+0000 mon.a (mon.0) 11659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:01 smithi179 bash[23186]: audit 2024-09-21T03:49:00.469535+0000 mon.a (mon.0) 11660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:01 smithi179 bash[23186]: cluster 2024-09-21T03:49:00.574730+0000 mgr.a (mgr.14388) 14480 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:01 smithi049 bash[23528]: audit 2024-09-21T03:49:00.201662+0000 mon.a (mon.0) 11655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:01 smithi049 bash[23528]: audit 2024-09-21T03:49:00.210213+0000 mon.a (mon.0) 11656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:01 smithi049 bash[23528]: audit 2024-09-21T03:49:00.220339+0000 mon.a (mon.0) 11657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:01 smithi049 bash[23528]: audit 2024-09-21T03:49:00.451230+0000 mon.a (mon.0) 11658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:01 smithi049 bash[23528]: audit 2024-09-21T03:49:00.459432+0000 mon.a (mon.0) 11659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:01 smithi049 bash[23528]: audit 2024-09-21T03:49:00.469535+0000 mon.a (mon.0) 11660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:01.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:01 smithi049 bash[23528]: cluster 2024-09-21T03:49:00.574730+0000 mgr.a (mgr.14388) 14480 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:02 smithi044 bash[22676]: cluster 2024-09-21T03:49:02.575713+0000 mgr.a (mgr.14388) 14481 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:02 smithi179 bash[23186]: cluster 2024-09-21T03:49:02.575713+0000 mgr.a (mgr.14388) 14481 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:02 smithi049 bash[23528]: cluster 2024-09-21T03:49:02.575713+0000 mgr.a (mgr.14388) 14481 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:03.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:03.875 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:03.876 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:04.608 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:04.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:04.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:04.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:04.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:04 smithi044 bash[22676]: audit 2024-09-21T03:49:04.192171+0000 mgr.a (mgr.14388) 14482 : audit [DBG] from='client.314181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:04 smithi044 bash[22676]: cluster 2024-09-21T03:49:04.576290+0000 mgr.a (mgr.14388) 14483 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:05.002 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:04 smithi049 bash[23528]: audit 2024-09-21T03:49:04.192171+0000 mgr.a (mgr.14388) 14482 : audit [DBG] from='client.314181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:05.002 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:04 smithi049 bash[23528]: cluster 2024-09-21T03:49:04.576290+0000 mgr.a (mgr.14388) 14483 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:04 smithi179 bash[23186]: audit 2024-09-21T03:49:04.192171+0000 mgr.a (mgr.14388) 14482 : audit [DBG] from='client.314181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:04 smithi179 bash[23186]: cluster 2024-09-21T03:49:04.576290+0000 mgr.a (mgr.14388) 14483 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:06 smithi044 bash[22676]: cluster 2024-09-21T03:49:06.578661+0000 mgr.a (mgr.14388) 14484 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:06 smithi179 bash[23186]: cluster 2024-09-21T03:49:06.578661+0000 mgr.a (mgr.14388) 14484 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:07.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:06 smithi049 bash[23528]: cluster 2024-09-21T03:49:06.578661+0000 mgr.a (mgr.14388) 14484 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:08.906 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:08 smithi049 bash[23528]: cluster 2024-09-21T03:49:08.579615+0000 mgr.a (mgr.14388) 14485 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:08 smithi044 bash[22676]: cluster 2024-09-21T03:49:08.579615+0000 mgr.a (mgr.14388) 14485 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:08 smithi179 bash[23186]: cluster 2024-09-21T03:49:08.579615+0000 mgr.a (mgr.14388) 14485 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:09.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:09.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:09.611 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:09 smithi044 bash[22676]: audit 2024-09-21T03:49:08.882827+0000 mon.a (mon.0) 11661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:09 smithi044 bash[22676]: audit 2024-09-21T03:49:08.891550+0000 mon.a (mon.0) 11662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:09 smithi044 bash[22676]: audit 2024-09-21T03:49:08.902770+0000 mon.a (mon.0) 11663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:09 smithi179 bash[23186]: audit 2024-09-21T03:49:08.882827+0000 mon.a (mon.0) 11661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:09 smithi179 bash[23186]: audit 2024-09-21T03:49:08.891550+0000 mon.a (mon.0) 11662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:09 smithi179 bash[23186]: audit 2024-09-21T03:49:08.902770+0000 mon.a (mon.0) 11663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:09 smithi049 bash[23528]: audit 2024-09-21T03:49:08.882827+0000 mon.a (mon.0) 11661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:09 smithi049 bash[23528]: audit 2024-09-21T03:49:08.891550+0000 mon.a (mon.0) 11662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:09 smithi049 bash[23528]: audit 2024-09-21T03:49:08.902770+0000 mon.a (mon.0) 11663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:10.387 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:10.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:10.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:10.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:10.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:10 smithi044 bash[22676]: audit 2024-09-21T03:49:09.946890+0000 mgr.a (mgr.14388) 14486 : audit [DBG] from='client.314256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:10 smithi044 bash[22676]: cluster 2024-09-21T03:49:10.582568+0000 mgr.a (mgr.14388) 14487 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:10 smithi179 bash[23186]: audit 2024-09-21T03:49:09.946890+0000 mgr.a (mgr.14388) 14486 : audit [DBG] from='client.314256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:10 smithi179 bash[23186]: cluster 2024-09-21T03:49:10.582568+0000 mgr.a (mgr.14388) 14487 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:10 smithi049 bash[23528]: audit 2024-09-21T03:49:09.946890+0000 mgr.a (mgr.14388) 14486 : audit [DBG] from='client.314256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:11.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:10 smithi049 bash[23528]: cluster 2024-09-21T03:49:10.582568+0000 mgr.a (mgr.14388) 14487 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:13.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:13 smithi044 bash[22676]: cluster 2024-09-21T03:49:12.583385+0000 mgr.a (mgr.14388) 14488 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:14.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:13 smithi179 bash[23186]: cluster 2024-09-21T03:49:12.583385+0000 mgr.a (mgr.14388) 14488 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:14.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:13 smithi049 bash[23528]: cluster 2024-09-21T03:49:12.583385+0000 mgr.a (mgr.14388) 14488 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:15.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:15.389 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:15.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:15 smithi044 bash[22676]: cluster 2024-09-21T03:49:14.584192+0000 mgr.a (mgr.14388) 14489 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:15 smithi179 bash[23186]: cluster 2024-09-21T03:49:14.584192+0000 mgr.a (mgr.14388) 14489 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:16.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:15 smithi049 bash[23528]: cluster 2024-09-21T03:49:14.584192+0000 mgr.a (mgr.14388) 14489 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:16.170 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:16.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:16.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:16 smithi044 bash[22676]: audit 2024-09-21T03:49:15.724358+0000 mgr.a (mgr.14388) 14490 : audit [DBG] from='client.314331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:16.994 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:16 smithi049 bash[23528]: audit 2024-09-21T03:49:15.724358+0000 mgr.a (mgr.14388) 14490 : audit [DBG] from='client.314331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:16 smithi179 bash[23186]: audit 2024-09-21T03:49:15.724358+0000 mgr.a (mgr.14388) 14490 : audit [DBG] from='client.314331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:17 smithi044 bash[22676]: cluster 2024-09-21T03:49:16.587089+0000 mgr.a (mgr.14388) 14491 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:17 smithi044 bash[22676]: audit 2024-09-21T03:49:17.403798+0000 mon.a (mon.0) 11664 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:49:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:17 smithi044 bash[22676]: audit 2024-09-21T03:49:17.410707+0000 mon.a (mon.0) 11665 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:49:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:17 smithi044 bash[22676]: audit 2024-09-21T03:49:17.412541+0000 mon.a (mon.0) 11666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:49:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:17 smithi044 bash[22676]: audit 2024-09-21T03:49:17.424055+0000 mon.a (mon.0) 11667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:17 smithi044 bash[22676]: audit 2024-09-21T03:49:17.430462+0000 mon.a (mon.0) 11668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:49:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:17 smithi044 bash[22676]: audit 2024-09-21T03:49:17.433264+0000 mgr.a (mgr.14388) 14492 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:49:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:17 smithi179 bash[23186]: cluster 2024-09-21T03:49:16.587089+0000 mgr.a (mgr.14388) 14491 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:17 smithi179 bash[23186]: audit 2024-09-21T03:49:17.403798+0000 mon.a (mon.0) 11664 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:49:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:17 smithi179 bash[23186]: audit 2024-09-21T03:49:17.410707+0000 mon.a (mon.0) 11665 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:49:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:17 smithi179 bash[23186]: audit 2024-09-21T03:49:17.412541+0000 mon.a (mon.0) 11666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:49:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:17 smithi179 bash[23186]: audit 2024-09-21T03:49:17.424055+0000 mon.a (mon.0) 11667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:17 smithi179 bash[23186]: audit 2024-09-21T03:49:17.430462+0000 mon.a (mon.0) 11668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:49:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:17 smithi179 bash[23186]: audit 2024-09-21T03:49:17.433264+0000 mgr.a (mgr.14388) 14492 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:49:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:17 smithi049 bash[23528]: cluster 2024-09-21T03:49:16.587089+0000 mgr.a (mgr.14388) 14491 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:17 smithi049 bash[23528]: audit 2024-09-21T03:49:17.403798+0000 mon.a (mon.0) 11664 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:49:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:17 smithi049 bash[23528]: audit 2024-09-21T03:49:17.410707+0000 mon.a (mon.0) 11665 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:49:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:17 smithi049 bash[23528]: audit 2024-09-21T03:49:17.412541+0000 mon.a (mon.0) 11666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:49:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:17 smithi049 bash[23528]: audit 2024-09-21T03:49:17.424055+0000 mon.a (mon.0) 11667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:17 smithi049 bash[23528]: audit 2024-09-21T03:49:17.430462+0000 mon.a (mon.0) 11668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:49:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:17 smithi049 bash[23528]: audit 2024-09-21T03:49:17.433264+0000 mgr.a (mgr.14388) 14492 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:49:18.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:49:18 smithi044 bash[22930]: debug 2024-09-21T03:49:18.205+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:49:18.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:49:18 smithi044 bash[22930]: debug 2024-09-21T03:49:18.205+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:49:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:18 smithi044 bash[22676]: audit 2024-09-21T03:49:18.209795+0000 mgr.a (mgr.14388) 14493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:49:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:18 smithi044 bash[22676]: cephadm 2024-09-21T03:49:18.211394+0000 mgr.a (mgr.14388) 14494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:49:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:18 smithi179 bash[23186]: audit 2024-09-21T03:49:18.209795+0000 mgr.a (mgr.14388) 14493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:49:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:18 smithi179 bash[23186]: cephadm 2024-09-21T03:49:18.211394+0000 mgr.a (mgr.14388) 14494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:49:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:18 smithi049 bash[23528]: audit 2024-09-21T03:49:18.209795+0000 mgr.a (mgr.14388) 14493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:49:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:18 smithi049 bash[23528]: cephadm 2024-09-21T03:49:18.211394+0000 mgr.a (mgr.14388) 14494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:49:19.964 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:19 smithi179 bash[23186]: cluster 2024-09-21T03:49:18.587986+0000 mgr.a (mgr.14388) 14495 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:19.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:19 smithi044 bash[22676]: cluster 2024-09-21T03:49:18.587986+0000 mgr.a (mgr.14388) 14495 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:19 smithi049 bash[23528]: cluster 2024-09-21T03:49:18.587986+0000 mgr.a (mgr.14388) 14495 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:49:21.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:21 smithi044 bash[22676]: audit 2024-09-21T03:49:20.408862+0000 mon.a (mon.0) 11669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:21 smithi044 bash[22676]: audit 2024-09-21T03:49:20.417673+0000 mon.a (mon.0) 11670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:21 smithi044 bash[22676]: audit 2024-09-21T03:49:20.428179+0000 mon.a (mon.0) 11671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:21 smithi044 bash[22676]: audit 2024-09-21T03:49:20.690000+0000 mon.a (mon.0) 11672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:21 smithi044 bash[22676]: audit 2024-09-21T03:49:20.698398+0000 mon.a (mon.0) 11673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:21 smithi044 bash[22676]: audit 2024-09-21T03:49:20.708254+0000 mon.a (mon.0) 11674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:21 smithi179 bash[23186]: audit 2024-09-21T03:49:20.408862+0000 mon.a (mon.0) 11669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:21 smithi179 bash[23186]: audit 2024-09-21T03:49:20.417673+0000 mon.a (mon.0) 11670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:21 smithi179 bash[23186]: audit 2024-09-21T03:49:20.428179+0000 mon.a (mon.0) 11671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:21 smithi179 bash[23186]: audit 2024-09-21T03:49:20.690000+0000 mon.a (mon.0) 11672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:21 smithi179 bash[23186]: audit 2024-09-21T03:49:20.698398+0000 mon.a (mon.0) 11673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:21 smithi179 bash[23186]: audit 2024-09-21T03:49:20.708254+0000 mon.a (mon.0) 11674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:21 smithi049 bash[23528]: audit 2024-09-21T03:49:20.408862+0000 mon.a (mon.0) 11669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:21 smithi049 bash[23528]: audit 2024-09-21T03:49:20.417673+0000 mon.a (mon.0) 11670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:21 smithi049 bash[23528]: audit 2024-09-21T03:49:20.428179+0000 mon.a (mon.0) 11671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:21 smithi049 bash[23528]: audit 2024-09-21T03:49:20.690000+0000 mon.a (mon.0) 11672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:21 smithi049 bash[23528]: audit 2024-09-21T03:49:20.698398+0000 mon.a (mon.0) 11673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:21 smithi049 bash[23528]: audit 2024-09-21T03:49:20.708254+0000 mon.a (mon.0) 11674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:21.970 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:21.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:21.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:21.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:21.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:22.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:22 smithi044 bash[22676]: cluster 2024-09-21T03:49:20.589572+0000 mgr.a (mgr.14388) 14496 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:22.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:22 smithi044 bash[22676]: audit 2024-09-21T03:49:21.509992+0000 mgr.a (mgr.14388) 14497 : audit [DBG] from='client.314508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:22 smithi179 bash[23186]: cluster 2024-09-21T03:49:20.589572+0000 mgr.a (mgr.14388) 14496 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:22 smithi179 bash[23186]: audit 2024-09-21T03:49:21.509992+0000 mgr.a (mgr.14388) 14497 : audit [DBG] from='client.314508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:22 smithi049 bash[23528]: cluster 2024-09-21T03:49:20.589572+0000 mgr.a (mgr.14388) 14496 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:22 smithi049 bash[23528]: audit 2024-09-21T03:49:21.509992+0000 mgr.a (mgr.14388) 14497 : audit [DBG] from='client.314508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:24 smithi044 bash[22676]: cluster 2024-09-21T03:49:22.590433+0000 mgr.a (mgr.14388) 14498 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:24 smithi179 bash[23186]: cluster 2024-09-21T03:49:22.590433+0000 mgr.a (mgr.14388) 14498 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:24 smithi049 bash[23528]: cluster 2024-09-21T03:49:22.590433+0000 mgr.a (mgr.14388) 14498 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:26 smithi049 bash[23528]: cluster 2024-09-21T03:49:24.591238+0000 mgr.a (mgr.14388) 14499 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:26 smithi044 bash[22676]: cluster 2024-09-21T03:49:24.591238+0000 mgr.a (mgr.14388) 14499 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:26 smithi179 bash[23186]: cluster 2024-09-21T03:49:24.591238+0000 mgr.a (mgr.14388) 14499 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:26.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:26.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:26.973 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:27.723 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:27.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:27.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:27.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:27.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:28 smithi044 bash[22676]: cluster 2024-09-21T03:49:26.593521+0000 mgr.a (mgr.14388) 14500 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:28 smithi044 bash[22676]: audit 2024-09-21T03:49:27.302439+0000 mgr.a (mgr.14388) 14501 : audit [DBG] from='client.314583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:28 smithi179 bash[23186]: cluster 2024-09-21T03:49:26.593521+0000 mgr.a (mgr.14388) 14500 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:28 smithi179 bash[23186]: audit 2024-09-21T03:49:27.302439+0000 mgr.a (mgr.14388) 14501 : audit [DBG] from='client.314583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:28 smithi049 bash[23528]: cluster 2024-09-21T03:49:26.593521+0000 mgr.a (mgr.14388) 14500 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:28 smithi049 bash[23528]: audit 2024-09-21T03:49:27.302439+0000 mgr.a (mgr.14388) 14501 : audit [DBG] from='client.314583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:30.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:30 smithi044 bash[22676]: cluster 2024-09-21T03:49:28.594456+0000 mgr.a (mgr.14388) 14502 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:30.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:30 smithi044 bash[22676]: audit 2024-09-21T03:49:29.120858+0000 mon.a (mon.0) 11675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:30 smithi044 bash[22676]: audit 2024-09-21T03:49:29.129421+0000 mon.a (mon.0) 11676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:30 smithi044 bash[22676]: audit 2024-09-21T03:49:29.141293+0000 mon.a (mon.0) 11677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:30 smithi179 bash[23186]: cluster 2024-09-21T03:49:28.594456+0000 mgr.a (mgr.14388) 14502 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:30 smithi179 bash[23186]: audit 2024-09-21T03:49:29.120858+0000 mon.a (mon.0) 11675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:30 smithi179 bash[23186]: audit 2024-09-21T03:49:29.129421+0000 mon.a (mon.0) 11676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:30 smithi179 bash[23186]: audit 2024-09-21T03:49:29.141293+0000 mon.a (mon.0) 11677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:30 smithi049 bash[23528]: cluster 2024-09-21T03:49:28.594456+0000 mgr.a (mgr.14388) 14502 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:30 smithi049 bash[23528]: audit 2024-09-21T03:49:29.120858+0000 mon.a (mon.0) 11675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:30 smithi049 bash[23528]: audit 2024-09-21T03:49:29.129421+0000 mon.a (mon.0) 11676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:30 smithi049 bash[23528]: audit 2024-09-21T03:49:29.141293+0000 mon.a (mon.0) 11677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:32.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:32 smithi044 bash[22676]: cluster 2024-09-21T03:49:30.596666+0000 mgr.a (mgr.14388) 14503 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:32.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:32 smithi179 bash[23186]: cluster 2024-09-21T03:49:30.596666+0000 mgr.a (mgr.14388) 14503 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:32 smithi049 bash[23528]: cluster 2024-09-21T03:49:30.596666+0000 mgr.a (mgr.14388) 14503 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:49:32.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:32.725 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:32.726 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:33.522 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:33.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:33.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:33.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:33.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:34 smithi044 bash[22676]: cluster 2024-09-21T03:49:32.597642+0000 mgr.a (mgr.14388) 14504 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:34 smithi044 bash[22676]: audit 2024-09-21T03:49:33.070060+0000 mgr.a (mgr.14388) 14505 : audit [DBG] from='client.314661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:34.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:34 smithi179 bash[23186]: cluster 2024-09-21T03:49:32.597642+0000 mgr.a (mgr.14388) 14504 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:34 smithi179 bash[23186]: audit 2024-09-21T03:49:33.070060+0000 mgr.a (mgr.14388) 14505 : audit [DBG] from='client.314661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:34 smithi049 bash[23528]: cluster 2024-09-21T03:49:32.597642+0000 mgr.a (mgr.14388) 14504 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:34 smithi049 bash[23528]: audit 2024-09-21T03:49:33.070060+0000 mgr.a (mgr.14388) 14505 : audit [DBG] from='client.314661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:36.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:36 smithi044 bash[22676]: cluster 2024-09-21T03:49:34.598459+0000 mgr.a (mgr.14388) 14506 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:36.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:36 smithi179 bash[23186]: cluster 2024-09-21T03:49:34.598459+0000 mgr.a (mgr.14388) 14506 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:36 smithi049 bash[23528]: cluster 2024-09-21T03:49:34.598459+0000 mgr.a (mgr.14388) 14506 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:38.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:38 smithi044 bash[22676]: cluster 2024-09-21T03:49:36.600658+0000 mgr.a (mgr.14388) 14507 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:38 smithi179 bash[23186]: cluster 2024-09-21T03:49:36.600658+0000 mgr.a (mgr.14388) 14507 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:38.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:38.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:38.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:38 smithi049 bash[23528]: cluster 2024-09-21T03:49:36.600658+0000 mgr.a (mgr.14388) 14507 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:39.282 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:40.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:40 smithi179 bash[23186]: cluster 2024-09-21T03:49:38.601214+0000 mgr.a (mgr.14388) 14508 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:40.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:40 smithi179 bash[23186]: audit 2024-09-21T03:49:38.851112+0000 mgr.a (mgr.14388) 14509 : audit [DBG] from='client.314739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:40 smithi044 bash[22676]: cluster 2024-09-21T03:49:38.601214+0000 mgr.a (mgr.14388) 14508 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:40 smithi044 bash[22676]: audit 2024-09-21T03:49:38.851112+0000 mgr.a (mgr.14388) 14509 : audit [DBG] from='client.314739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:40 smithi049 bash[23528]: cluster 2024-09-21T03:49:38.601214+0000 mgr.a (mgr.14388) 14508 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:40 smithi049 bash[23528]: audit 2024-09-21T03:49:38.851112+0000 mgr.a (mgr.14388) 14509 : audit [DBG] from='client.314739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:41.975 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:41 smithi179 bash[23186]: cluster 2024-09-21T03:49:40.603534+0000 mgr.a (mgr.14388) 14510 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:41.975 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:41 smithi179 bash[23186]: audit 2024-09-21T03:49:40.614558+0000 mon.a (mon.0) 11678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.976 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:41 smithi179 bash[23186]: audit 2024-09-21T03:49:40.623411+0000 mon.a (mon.0) 11679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.976 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:41 smithi179 bash[23186]: audit 2024-09-21T03:49:40.634541+0000 mon.a (mon.0) 11680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.976 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:41 smithi179 bash[23186]: audit 2024-09-21T03:49:40.893646+0000 mon.a (mon.0) 11681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.976 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:41 smithi179 bash[23186]: audit 2024-09-21T03:49:40.900508+0000 mon.a (mon.0) 11682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.976 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:41 smithi179 bash[23186]: audit 2024-09-21T03:49:40.908297+0000 mon.a (mon.0) 11683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:41 smithi044 bash[22676]: cluster 2024-09-21T03:49:40.603534+0000 mgr.a (mgr.14388) 14510 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:41 smithi044 bash[22676]: audit 2024-09-21T03:49:40.614558+0000 mon.a (mon.0) 11678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:41 smithi044 bash[22676]: audit 2024-09-21T03:49:40.623411+0000 mon.a (mon.0) 11679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:41 smithi044 bash[22676]: audit 2024-09-21T03:49:40.634541+0000 mon.a (mon.0) 11680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:41 smithi044 bash[22676]: audit 2024-09-21T03:49:40.893646+0000 mon.a (mon.0) 11681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:41 smithi044 bash[22676]: audit 2024-09-21T03:49:40.900508+0000 mon.a (mon.0) 11682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:41 smithi044 bash[22676]: audit 2024-09-21T03:49:40.908297+0000 mon.a (mon.0) 11683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:41 smithi049 bash[23528]: cluster 2024-09-21T03:49:40.603534+0000 mgr.a (mgr.14388) 14510 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:49:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:41 smithi049 bash[23528]: audit 2024-09-21T03:49:40.614558+0000 mon.a (mon.0) 11678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:41 smithi049 bash[23528]: audit 2024-09-21T03:49:40.623411+0000 mon.a (mon.0) 11679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:41 smithi049 bash[23528]: audit 2024-09-21T03:49:40.634541+0000 mon.a (mon.0) 11680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:41 smithi049 bash[23528]: audit 2024-09-21T03:49:40.893646+0000 mon.a (mon.0) 11681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:41 smithi049 bash[23528]: audit 2024-09-21T03:49:40.900508+0000 mon.a (mon.0) 11682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:41 smithi049 bash[23528]: audit 2024-09-21T03:49:40.908297+0000 mon.a (mon.0) 11683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:43 smithi044 bash[22676]: cluster 2024-09-21T03:49:42.604345+0000 mgr.a (mgr.14388) 14511 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:44.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:43 smithi179 bash[23186]: cluster 2024-09-21T03:49:42.604345+0000 mgr.a (mgr.14388) 14511 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:44.026 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:43 smithi049 bash[23528]: cluster 2024-09-21T03:49:42.604345+0000 mgr.a (mgr.14388) 14511 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:44.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:44.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:44.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:45.085 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:45.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:45.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:45.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:45.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:45.898 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:45 smithi049 bash[23528]: cluster 2024-09-21T03:49:44.605076+0000 mgr.a (mgr.14388) 14512 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:45.898 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:45 smithi049 bash[23528]: audit 2024-09-21T03:49:44.621540+0000 mgr.a (mgr.14388) 14513 : audit [DBG] from='client.314817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:45 smithi044 bash[22676]: cluster 2024-09-21T03:49:44.605076+0000 mgr.a (mgr.14388) 14512 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:45 smithi044 bash[22676]: audit 2024-09-21T03:49:44.621540+0000 mgr.a (mgr.14388) 14513 : audit [DBG] from='client.314817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:46.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:45 smithi179 bash[23186]: cluster 2024-09-21T03:49:44.605076+0000 mgr.a (mgr.14388) 14512 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:45 smithi179 bash[23186]: audit 2024-09-21T03:49:44.621540+0000 mgr.a (mgr.14388) 14513 : audit [DBG] from='client.314817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:47.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:47 smithi044 bash[22676]: cluster 2024-09-21T03:49:46.607449+0000 mgr.a (mgr.14388) 14514 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:49:48.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:47 smithi179 bash[23186]: cluster 2024-09-21T03:49:46.607449+0000 mgr.a (mgr.14388) 14514 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:49:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:47 smithi049 bash[23528]: cluster 2024-09-21T03:49:46.607449+0000 mgr.a (mgr.14388) 14514 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:49:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:50 smithi044 bash[22676]: cluster 2024-09-21T03:49:48.608228+0000 mgr.a (mgr.14388) 14515 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:49:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:50 smithi044 bash[22676]: audit 2024-09-21T03:49:49.341580+0000 mon.a (mon.0) 11684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:50 smithi044 bash[22676]: audit 2024-09-21T03:49:49.351975+0000 mon.a (mon.0) 11685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:50 smithi044 bash[22676]: audit 2024-09-21T03:49:49.363958+0000 mon.a (mon.0) 11686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:50 smithi179 bash[23186]: cluster 2024-09-21T03:49:48.608228+0000 mgr.a (mgr.14388) 14515 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:49:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:50 smithi179 bash[23186]: audit 2024-09-21T03:49:49.341580+0000 mon.a (mon.0) 11684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:50 smithi179 bash[23186]: audit 2024-09-21T03:49:49.351975+0000 mon.a (mon.0) 11685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:50 smithi179 bash[23186]: audit 2024-09-21T03:49:49.363958+0000 mon.a (mon.0) 11686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:50 smithi049 bash[23528]: cluster 2024-09-21T03:49:48.608228+0000 mgr.a (mgr.14388) 14515 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:49:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:50 smithi049 bash[23528]: audit 2024-09-21T03:49:49.341580+0000 mon.a (mon.0) 11684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:50 smithi049 bash[23528]: audit 2024-09-21T03:49:49.351975+0000 mon.a (mon.0) 11685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:50 smithi049 bash[23528]: audit 2024-09-21T03:49:49.363958+0000 mon.a (mon.0) 11686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:49:50.850 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:51 smithi044 bash[22676]: audit 2024-09-21T03:49:50.417937+0000 mgr.a (mgr.14388) 14516 : audit [DBG] from='client.314892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:51 smithi179 bash[23186]: audit 2024-09-21T03:49:50.417937+0000 mgr.a (mgr.14388) 14516 : audit [DBG] from='client.314892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:51.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:51 smithi049 bash[23528]: audit 2024-09-21T03:49:50.417937+0000 mgr.a (mgr.14388) 14516 : audit [DBG] from='client.314892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:52.635 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:52 smithi044 bash[22676]: cluster 2024-09-21T03:49:50.609702+0000 mgr.a (mgr.14388) 14517 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:52 smithi179 bash[23186]: cluster 2024-09-21T03:49:50.609702+0000 mgr.a (mgr.14388) 14517 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:52.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:52 smithi049 bash[23528]: cluster 2024-09-21T03:49:50.609702+0000 mgr.a (mgr.14388) 14517 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:54 smithi044 bash[22676]: cluster 2024-09-21T03:49:52.610624+0000 mgr.a (mgr.14388) 14518 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:49:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:54 smithi179 bash[23186]: cluster 2024-09-21T03:49:52.610624+0000 mgr.a (mgr.14388) 14518 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:49:54.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:54 smithi049 bash[23528]: cluster 2024-09-21T03:49:52.610624+0000 mgr.a (mgr.14388) 14518 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:49:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:49:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:49:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:49:56.645 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:49:56.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:49:56.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:49:56.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:49:56.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:49:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:56 smithi044 bash[22676]: cluster 2024-09-21T03:49:54.611290+0000 mgr.a (mgr.14388) 14519 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:49:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:56 smithi179 bash[23186]: cluster 2024-09-21T03:49:54.611290+0000 mgr.a (mgr.14388) 14519 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:49:56.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:56 smithi049 bash[23528]: cluster 2024-09-21T03:49:54.611290+0000 mgr.a (mgr.14388) 14519 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:49:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:57 smithi044 bash[22676]: audit 2024-09-21T03:49:56.185844+0000 mgr.a (mgr.14388) 14520 : audit [DBG] from='client.314970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:57 smithi179 bash[23186]: audit 2024-09-21T03:49:56.185844+0000 mgr.a (mgr.14388) 14520 : audit [DBG] from='client.314970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:57.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:57 smithi049 bash[23528]: audit 2024-09-21T03:49:56.185844+0000 mgr.a (mgr.14388) 14520 : audit [DBG] from='client.314970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:49:58 smithi049 bash[23528]: cluster 2024-09-21T03:49:56.612794+0000 mgr.a (mgr.14388) 14521 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:58.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:49:58 smithi044 bash[22676]: cluster 2024-09-21T03:49:56.612794+0000 mgr.a (mgr.14388) 14521 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:49:58.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:49:58 smithi179 bash[23186]: cluster 2024-09-21T03:49:56.612794+0000 mgr.a (mgr.14388) 14521 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:00.657 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:00 smithi179 bash[23186]: cluster 2024-09-21T03:49:58.613561+0000 mgr.a (mgr.14388) 14522 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:50:00.657 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:00 smithi179 bash[23186]: cluster 2024-09-21T03:50:00.000148+0000 mon.a (mon.0) 11687 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:50:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:00 smithi044 bash[22676]: cluster 2024-09-21T03:49:58.613561+0000 mgr.a (mgr.14388) 14522 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:50:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:00 smithi044 bash[22676]: cluster 2024-09-21T03:50:00.000148+0000 mon.a (mon.0) 11687 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:50:00.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:00 smithi049 bash[23528]: cluster 2024-09-21T03:49:58.613561+0000 mgr.a (mgr.14388) 14522 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T03:50:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:00 smithi049 bash[23528]: cluster 2024-09-21T03:50:00.000148+0000 mon.a (mon.0) 11687 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T03:50:01.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:01.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:01.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:01 smithi049 bash[23528]: cluster 2024-09-21T03:50:00.615578+0000 mgr.a (mgr.14388) 14523 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:50:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:01 smithi049 bash[23528]: audit 2024-09-21T03:50:00.798858+0000 mon.a (mon.0) 11688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:01 smithi049 bash[23528]: audit 2024-09-21T03:50:00.807354+0000 mon.a (mon.0) 11689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:01 smithi049 bash[23528]: audit 2024-09-21T03:50:00.817781+0000 mon.a (mon.0) 11690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:01 smithi049 bash[23528]: audit 2024-09-21T03:50:01.125767+0000 mon.a (mon.0) 11691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:01 smithi049 bash[23528]: audit 2024-09-21T03:50:01.134652+0000 mon.a (mon.0) 11692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:01 smithi049 bash[23528]: audit 2024-09-21T03:50:01.145336+0000 mon.a (mon.0) 11693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:01 smithi044 bash[22676]: cluster 2024-09-21T03:50:00.615578+0000 mgr.a (mgr.14388) 14523 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:50:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:01 smithi044 bash[22676]: audit 2024-09-21T03:50:00.798858+0000 mon.a (mon.0) 11688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:01 smithi044 bash[22676]: audit 2024-09-21T03:50:00.807354+0000 mon.a (mon.0) 11689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:01 smithi044 bash[22676]: audit 2024-09-21T03:50:00.817781+0000 mon.a (mon.0) 11690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:01 smithi044 bash[22676]: audit 2024-09-21T03:50:01.125767+0000 mon.a (mon.0) 11691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:01 smithi044 bash[22676]: audit 2024-09-21T03:50:01.134652+0000 mon.a (mon.0) 11692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:01 smithi044 bash[22676]: audit 2024-09-21T03:50:01.145336+0000 mon.a (mon.0) 11693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:01 smithi179 bash[23186]: cluster 2024-09-21T03:50:00.615578+0000 mgr.a (mgr.14388) 14523 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T03:50:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:01 smithi179 bash[23186]: audit 2024-09-21T03:50:00.798858+0000 mon.a (mon.0) 11688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:01 smithi179 bash[23186]: audit 2024-09-21T03:50:00.807354+0000 mon.a (mon.0) 11689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:01 smithi179 bash[23186]: audit 2024-09-21T03:50:00.817781+0000 mon.a (mon.0) 11690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:01 smithi179 bash[23186]: audit 2024-09-21T03:50:01.125767+0000 mon.a (mon.0) 11691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:01 smithi179 bash[23186]: audit 2024-09-21T03:50:01.134652+0000 mon.a (mon.0) 11692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:01 smithi179 bash[23186]: audit 2024-09-21T03:50:01.145336+0000 mon.a (mon.0) 11693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:02.423 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:02.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:02.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:03.058 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:02 smithi179 bash[23186]: audit 2024-09-21T03:50:01.981401+0000 mgr.a (mgr.14388) 14524 : audit [DBG] from='client.315048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:02 smithi044 bash[22676]: audit 2024-09-21T03:50:01.981401+0000 mgr.a (mgr.14388) 14524 : audit [DBG] from='client.315048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:03.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:02 smithi049 bash[23528]: audit 2024-09-21T03:50:01.981401+0000 mgr.a (mgr.14388) 14524 : audit [DBG] from='client.315048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:04.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:03 smithi044 bash[22676]: cluster 2024-09-21T03:50:02.616434+0000 mgr.a (mgr.14388) 14525 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:04.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:03 smithi179 bash[23186]: cluster 2024-09-21T03:50:02.616434+0000 mgr.a (mgr.14388) 14525 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:04.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:03 smithi049 bash[23528]: cluster 2024-09-21T03:50:02.616434+0000 mgr.a (mgr.14388) 14525 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:05.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:05 smithi044 bash[22676]: cluster 2024-09-21T03:50:04.617221+0000 mgr.a (mgr.14388) 14526 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:06.153 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:05 smithi179 bash[23186]: cluster 2024-09-21T03:50:04.617221+0000 mgr.a (mgr.14388) 14526 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:06.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:05 smithi049 bash[23528]: cluster 2024-09-21T03:50:04.617221+0000 mgr.a (mgr.14388) 14526 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:07.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:08.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:08.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:08.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:08.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:08.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:08.237 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:07 smithi044 bash[22676]: cluster 2024-09-21T03:50:06.619470+0000 mgr.a (mgr.14388) 14527 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:07 smithi179 bash[23186]: cluster 2024-09-21T03:50:06.619470+0000 mgr.a (mgr.14388) 14527 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:08.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:07 smithi049 bash[23528]: cluster 2024-09-21T03:50:06.619470+0000 mgr.a (mgr.14388) 14527 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:08 smithi044 bash[22676]: audit 2024-09-21T03:50:07.754739+0000 mgr.a (mgr.14388) 14528 : audit [DBG] from='client.315126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:08 smithi179 bash[23186]: audit 2024-09-21T03:50:07.754739+0000 mgr.a (mgr.14388) 14528 : audit [DBG] from='client.315126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:09.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:08 smithi049 bash[23528]: audit 2024-09-21T03:50:07.754739+0000 mgr.a (mgr.14388) 14528 : audit [DBG] from='client.315126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:10 smithi044 bash[22676]: cluster 2024-09-21T03:50:08.620341+0000 mgr.a (mgr.14388) 14529 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:10 smithi044 bash[22676]: audit 2024-09-21T03:50:09.580584+0000 mon.a (mon.0) 11694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:10 smithi044 bash[22676]: audit 2024-09-21T03:50:09.589343+0000 mon.a (mon.0) 11695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:10 smithi044 bash[22676]: audit 2024-09-21T03:50:09.599905+0000 mon.a (mon.0) 11696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:10 smithi179 bash[23186]: cluster 2024-09-21T03:50:08.620341+0000 mgr.a (mgr.14388) 14529 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:10 smithi179 bash[23186]: audit 2024-09-21T03:50:09.580584+0000 mon.a (mon.0) 11694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:10 smithi179 bash[23186]: audit 2024-09-21T03:50:09.589343+0000 mon.a (mon.0) 11695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:10 smithi179 bash[23186]: audit 2024-09-21T03:50:09.599905+0000 mon.a (mon.0) 11696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:10 smithi049 bash[23528]: cluster 2024-09-21T03:50:08.620341+0000 mgr.a (mgr.14388) 14529 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:10 smithi049 bash[23528]: audit 2024-09-21T03:50:09.580584+0000 mon.a (mon.0) 11694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:11.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:10 smithi049 bash[23528]: audit 2024-09-21T03:50:09.589343+0000 mon.a (mon.0) 11695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:10 smithi049 bash[23528]: audit 2024-09-21T03:50:09.599905+0000 mon.a (mon.0) 11696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:12.850 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:12 smithi044 bash[22676]: cluster 2024-09-21T03:50:10.622627+0000 mgr.a (mgr.14388) 14530 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:12 smithi179 bash[23186]: cluster 2024-09-21T03:50:10.622627+0000 mgr.a (mgr.14388) 14530 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:12 smithi049 bash[23528]: cluster 2024-09-21T03:50:10.622627+0000 mgr.a (mgr.14388) 14530 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:13.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:13.940 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:13.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:13.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:13.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:13.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:14.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:14 smithi044 bash[22676]: cluster 2024-09-21T03:50:12.623150+0000 mgr.a (mgr.14388) 14531 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:14.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:14 smithi044 bash[22676]: audit 2024-09-21T03:50:13.522328+0000 mgr.a (mgr.14388) 14532 : audit [DBG] from='client.315204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:14 smithi179 bash[23186]: cluster 2024-09-21T03:50:12.623150+0000 mgr.a (mgr.14388) 14531 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:14 smithi179 bash[23186]: audit 2024-09-21T03:50:13.522328+0000 mgr.a (mgr.14388) 14532 : audit [DBG] from='client.315204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:14 smithi049 bash[23528]: cluster 2024-09-21T03:50:12.623150+0000 mgr.a (mgr.14388) 14531 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:14 smithi049 bash[23528]: audit 2024-09-21T03:50:13.522328+0000 mgr.a (mgr.14388) 14532 : audit [DBG] from='client.315204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:16 smithi044 bash[22676]: cluster 2024-09-21T03:50:14.623640+0000 mgr.a (mgr.14388) 14533 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:16 smithi179 bash[23186]: cluster 2024-09-21T03:50:14.623640+0000 mgr.a (mgr.14388) 14533 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:16 smithi049 bash[23528]: cluster 2024-09-21T03:50:14.623640+0000 mgr.a (mgr.14388) 14533 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:18 smithi044 bash[22676]: cluster 2024-09-21T03:50:16.625974+0000 mgr.a (mgr.14388) 14534 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:18 smithi044 bash[22676]: audit 2024-09-21T03:50:18.289898+0000 mon.a (mon.0) 11697 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:50:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:18 smithi044 bash[22676]: audit 2024-09-21T03:50:18.297354+0000 mon.a (mon.0) 11698 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:50:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:18 smithi044 bash[22676]: audit 2024-09-21T03:50:18.299563+0000 mon.a (mon.0) 11699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:50:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:18 smithi044 bash[22676]: audit 2024-09-21T03:50:18.311490+0000 mon.a (mon.0) 11700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:18 smithi044 bash[22676]: audit 2024-09-21T03:50:18.318092+0000 mon.a (mon.0) 11701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:50:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:18 smithi179 bash[23186]: cluster 2024-09-21T03:50:16.625974+0000 mgr.a (mgr.14388) 14534 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:18 smithi179 bash[23186]: audit 2024-09-21T03:50:18.289898+0000 mon.a (mon.0) 11697 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:50:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:18 smithi179 bash[23186]: audit 2024-09-21T03:50:18.297354+0000 mon.a (mon.0) 11698 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:50:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:18 smithi179 bash[23186]: audit 2024-09-21T03:50:18.299563+0000 mon.a (mon.0) 11699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:50:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:18 smithi179 bash[23186]: audit 2024-09-21T03:50:18.311490+0000 mon.a (mon.0) 11700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:18 smithi179 bash[23186]: audit 2024-09-21T03:50:18.318092+0000 mon.a (mon.0) 11701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:50:19.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:18 smithi049 bash[23528]: cluster 2024-09-21T03:50:16.625974+0000 mgr.a (mgr.14388) 14534 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:18 smithi049 bash[23528]: audit 2024-09-21T03:50:18.289898+0000 mon.a (mon.0) 11697 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:50:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:18 smithi049 bash[23528]: audit 2024-09-21T03:50:18.297354+0000 mon.a (mon.0) 11698 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:50:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:18 smithi049 bash[23528]: audit 2024-09-21T03:50:18.299563+0000 mon.a (mon.0) 11699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:50:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:18 smithi049 bash[23528]: audit 2024-09-21T03:50:18.311490+0000 mon.a (mon.0) 11700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:18 smithi049 bash[23528]: audit 2024-09-21T03:50:18.318092+0000 mon.a (mon.0) 11701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:50:19.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:50:19 smithi044 bash[22930]: debug 2024-09-21T03:50:19.092+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:50:19.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:50:19 smithi044 bash[22930]: debug 2024-09-21T03:50:19.092+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:50:19.676 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:19.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:19.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:19.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:19.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:19.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:19 smithi044 bash[22676]: audit 2024-09-21T03:50:18.320550+0000 mgr.a (mgr.14388) 14535 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:50:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:19 smithi179 bash[23186]: audit 2024-09-21T03:50:18.320550+0000 mgr.a (mgr.14388) 14535 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:50:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:19 smithi049 bash[23528]: audit 2024-09-21T03:50:18.320550+0000 mgr.a (mgr.14388) 14535 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:50:20.862 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:20 smithi179 bash[23186]: cluster 2024-09-21T03:50:18.626480+0000 mgr.a (mgr.14388) 14536 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:20.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:20 smithi179 bash[23186]: audit 2024-09-21T03:50:19.094888+0000 mgr.a (mgr.14388) 14537 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:50:20.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:20 smithi179 bash[23186]: cephadm 2024-09-21T03:50:19.096054+0000 mgr.a (mgr.14388) 14538 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:50:20.863 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:20 smithi179 bash[23186]: audit 2024-09-21T03:50:19.255258+0000 mgr.a (mgr.14388) 14539 : audit [DBG] from='client.315390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:20 smithi044 bash[22676]: cluster 2024-09-21T03:50:18.626480+0000 mgr.a (mgr.14388) 14536 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:20 smithi044 bash[22676]: audit 2024-09-21T03:50:19.094888+0000 mgr.a (mgr.14388) 14537 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:50:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:20 smithi044 bash[22676]: cephadm 2024-09-21T03:50:19.096054+0000 mgr.a (mgr.14388) 14538 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:50:20.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:20 smithi044 bash[22676]: audit 2024-09-21T03:50:19.255258+0000 mgr.a (mgr.14388) 14539 : audit [DBG] from='client.315390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:20 smithi049 bash[23528]: cluster 2024-09-21T03:50:18.626480+0000 mgr.a (mgr.14388) 14536 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:20 smithi049 bash[23528]: audit 2024-09-21T03:50:19.094888+0000 mgr.a (mgr.14388) 14537 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:50:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:20 smithi049 bash[23528]: cephadm 2024-09-21T03:50:19.096054+0000 mgr.a (mgr.14388) 14538 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:50:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:20 smithi049 bash[23528]: audit 2024-09-21T03:50:19.255258+0000 mgr.a (mgr.14388) 14539 : audit [DBG] from='client.315390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:21 smithi044 bash[22676]: cluster 2024-09-21T03:50:20.628903+0000 mgr.a (mgr.14388) 14540 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:21 smithi044 bash[22676]: audit 2024-09-21T03:50:20.967903+0000 mon.a (mon.0) 11702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:21 smithi044 bash[22676]: audit 2024-09-21T03:50:20.976205+0000 mon.a (mon.0) 11703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:21 smithi044 bash[22676]: audit 2024-09-21T03:50:20.986595+0000 mon.a (mon.0) 11704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:21 smithi044 bash[22676]: audit 2024-09-21T03:50:21.358847+0000 mon.a (mon.0) 11705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:21 smithi044 bash[22676]: audit 2024-09-21T03:50:21.366600+0000 mon.a (mon.0) 11706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:21 smithi044 bash[22676]: audit 2024-09-21T03:50:21.376590+0000 mon.a (mon.0) 11707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:21 smithi179 bash[23186]: cluster 2024-09-21T03:50:20.628903+0000 mgr.a (mgr.14388) 14540 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:21 smithi179 bash[23186]: audit 2024-09-21T03:50:20.967903+0000 mon.a (mon.0) 11702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:21 smithi179 bash[23186]: audit 2024-09-21T03:50:20.976205+0000 mon.a (mon.0) 11703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:21 smithi179 bash[23186]: audit 2024-09-21T03:50:20.986595+0000 mon.a (mon.0) 11704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:21 smithi179 bash[23186]: audit 2024-09-21T03:50:21.358847+0000 mon.a (mon.0) 11705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:21 smithi179 bash[23186]: audit 2024-09-21T03:50:21.366600+0000 mon.a (mon.0) 11706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:21 smithi179 bash[23186]: audit 2024-09-21T03:50:21.376590+0000 mon.a (mon.0) 11707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:21 smithi049 bash[23528]: cluster 2024-09-21T03:50:20.628903+0000 mgr.a (mgr.14388) 14540 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:21 smithi049 bash[23528]: audit 2024-09-21T03:50:20.967903+0000 mon.a (mon.0) 11702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:21 smithi049 bash[23528]: audit 2024-09-21T03:50:20.976205+0000 mon.a (mon.0) 11703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:21 smithi049 bash[23528]: audit 2024-09-21T03:50:20.986595+0000 mon.a (mon.0) 11704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:21 smithi049 bash[23528]: audit 2024-09-21T03:50:21.358847+0000 mon.a (mon.0) 11705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:21 smithi049 bash[23528]: audit 2024-09-21T03:50:21.366600+0000 mon.a (mon.0) 11706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:21 smithi049 bash[23528]: audit 2024-09-21T03:50:21.376590+0000 mon.a (mon.0) 11707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:24.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:23 smithi044 bash[22676]: cluster 2024-09-21T03:50:22.629708+0000 mgr.a (mgr.14388) 14541 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:24.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:23 smithi179 bash[23186]: cluster 2024-09-21T03:50:22.629708+0000 mgr.a (mgr.14388) 14541 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:24.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:23 smithi049 bash[23528]: cluster 2024-09-21T03:50:22.629708+0000 mgr.a (mgr.14388) 14541 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:24.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:24.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:24.678 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:25.456 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:25.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:25.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:26.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:25 smithi044 bash[22676]: cluster 2024-09-21T03:50:24.630501+0000 mgr.a (mgr.14388) 14542 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:26.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:25 smithi044 bash[22676]: audit 2024-09-21T03:50:25.014372+0000 mgr.a (mgr.14388) 14543 : audit [DBG] from='client.315468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:26.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:25 smithi179 bash[23186]: cluster 2024-09-21T03:50:24.630501+0000 mgr.a (mgr.14388) 14542 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:25 smithi179 bash[23186]: audit 2024-09-21T03:50:25.014372+0000 mgr.a (mgr.14388) 14543 : audit [DBG] from='client.315468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:26.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:25 smithi049 bash[23528]: cluster 2024-09-21T03:50:24.630501+0000 mgr.a (mgr.14388) 14542 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:26.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:25 smithi049 bash[23528]: audit 2024-09-21T03:50:25.014372+0000 mgr.a (mgr.14388) 14543 : audit [DBG] from='client.315468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:28.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:27 smithi044 bash[22676]: cluster 2024-09-21T03:50:26.633459+0000 mgr.a (mgr.14388) 14544 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:28.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:27 smithi179 bash[23186]: cluster 2024-09-21T03:50:26.633459+0000 mgr.a (mgr.14388) 14544 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:28.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:27 smithi049 bash[23528]: cluster 2024-09-21T03:50:26.633459+0000 mgr.a (mgr.14388) 14544 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:29 smithi044 bash[22676]: cluster 2024-09-21T03:50:28.634268+0000 mgr.a (mgr.14388) 14545 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:50:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:29 smithi044 bash[22676]: audit 2024-09-21T03:50:29.792356+0000 mon.a (mon.0) 11708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:29 smithi044 bash[22676]: audit 2024-09-21T03:50:29.801477+0000 mon.a (mon.0) 11709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:29 smithi044 bash[22676]: audit 2024-09-21T03:50:29.812233+0000 mon.a (mon.0) 11710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:29 smithi179 bash[23186]: cluster 2024-09-21T03:50:28.634268+0000 mgr.a (mgr.14388) 14545 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:50:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:29 smithi179 bash[23186]: audit 2024-09-21T03:50:29.792356+0000 mon.a (mon.0) 11708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:29 smithi179 bash[23186]: audit 2024-09-21T03:50:29.801477+0000 mon.a (mon.0) 11709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:29 smithi179 bash[23186]: audit 2024-09-21T03:50:29.812233+0000 mon.a (mon.0) 11710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:29 smithi049 bash[23528]: cluster 2024-09-21T03:50:28.634268+0000 mgr.a (mgr.14388) 14545 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:50:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:29 smithi049 bash[23528]: audit 2024-09-21T03:50:29.792356+0000 mon.a (mon.0) 11708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:29 smithi049 bash[23528]: audit 2024-09-21T03:50:29.801477+0000 mon.a (mon.0) 11709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:29 smithi049 bash[23528]: audit 2024-09-21T03:50:29.812233+0000 mon.a (mon.0) 11710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:30.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:30.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:31.261 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:31.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:31.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:31.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:31.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:32.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:31 smithi044 bash[22676]: cluster 2024-09-21T03:50:30.635561+0000 mgr.a (mgr.14388) 14546 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:32.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:31 smithi044 bash[22676]: audit 2024-09-21T03:50:30.800078+0000 mgr.a (mgr.14388) 14547 : audit [DBG] from='client.315543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:32.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:31 smithi179 bash[23186]: cluster 2024-09-21T03:50:30.635561+0000 mgr.a (mgr.14388) 14546 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:31 smithi179 bash[23186]: audit 2024-09-21T03:50:30.800078+0000 mgr.a (mgr.14388) 14547 : audit [DBG] from='client.315543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:32.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:31 smithi049 bash[23528]: cluster 2024-09-21T03:50:30.635561+0000 mgr.a (mgr.14388) 14546 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:50:32.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:31 smithi049 bash[23528]: audit 2024-09-21T03:50:30.800078+0000 mgr.a (mgr.14388) 14547 : audit [DBG] from='client.315543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:34.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:33 smithi044 bash[22676]: cluster 2024-09-21T03:50:32.636133+0000 mgr.a (mgr.14388) 14548 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:50:34.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:33 smithi179 bash[23186]: cluster 2024-09-21T03:50:32.636133+0000 mgr.a (mgr.14388) 14548 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:50:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:33 smithi049 bash[23528]: cluster 2024-09-21T03:50:32.636133+0000 mgr.a (mgr.14388) 14548 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:50:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:35 smithi179 bash[23186]: cluster 2024-09-21T03:50:34.636798+0000 mgr.a (mgr.14388) 14549 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:50:36.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:36.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:36.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:36.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:35 smithi049 bash[23528]: cluster 2024-09-21T03:50:34.636798+0000 mgr.a (mgr.14388) 14549 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:50:36.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:35 smithi044 bash[22676]: cluster 2024-09-21T03:50:34.636798+0000 mgr.a (mgr.14388) 14549 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:50:37.059 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:38 smithi179 bash[23186]: audit 2024-09-21T03:50:36.599887+0000 mgr.a (mgr.14388) 14550 : audit [DBG] from='client.315621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:38 smithi179 bash[23186]: cluster 2024-09-21T03:50:36.638848+0000 mgr.a (mgr.14388) 14551 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:38 smithi049 bash[23528]: audit 2024-09-21T03:50:36.599887+0000 mgr.a (mgr.14388) 14550 : audit [DBG] from='client.315621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:38.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:38 smithi049 bash[23528]: cluster 2024-09-21T03:50:36.638848+0000 mgr.a (mgr.14388) 14551 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:38.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:38 smithi044 bash[22676]: audit 2024-09-21T03:50:36.599887+0000 mgr.a (mgr.14388) 14550 : audit [DBG] from='client.315621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:38.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:38 smithi044 bash[22676]: cluster 2024-09-21T03:50:36.638848+0000 mgr.a (mgr.14388) 14551 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:40 smithi049 bash[23528]: cluster 2024-09-21T03:50:38.639779+0000 mgr.a (mgr.14388) 14552 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:40 smithi044 bash[22676]: cluster 2024-09-21T03:50:38.639779+0000 mgr.a (mgr.14388) 14552 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:40 smithi179 bash[23186]: cluster 2024-09-21T03:50:38.639779+0000 mgr.a (mgr.14388) 14552 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:42.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:42.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:42.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:42 smithi044 bash[22676]: cluster 2024-09-21T03:50:40.642048+0000 mgr.a (mgr.14388) 14553 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:42 smithi044 bash[22676]: audit 2024-09-21T03:50:41.161429+0000 mon.a (mon.0) 11711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:42 smithi044 bash[22676]: audit 2024-09-21T03:50:41.170169+0000 mon.a (mon.0) 11712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:42 smithi044 bash[22676]: audit 2024-09-21T03:50:41.180773+0000 mon.a (mon.0) 11713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:42 smithi044 bash[22676]: audit 2024-09-21T03:50:41.580673+0000 mon.a (mon.0) 11714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:42 smithi044 bash[22676]: audit 2024-09-21T03:50:41.589225+0000 mon.a (mon.0) 11715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:42 smithi044 bash[22676]: audit 2024-09-21T03:50:41.600743+0000 mon.a (mon.0) 11716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:42 smithi179 bash[23186]: cluster 2024-09-21T03:50:40.642048+0000 mgr.a (mgr.14388) 14553 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:42 smithi179 bash[23186]: audit 2024-09-21T03:50:41.161429+0000 mon.a (mon.0) 11711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:42 smithi179 bash[23186]: audit 2024-09-21T03:50:41.170169+0000 mon.a (mon.0) 11712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:42 smithi179 bash[23186]: audit 2024-09-21T03:50:41.180773+0000 mon.a (mon.0) 11713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:42 smithi179 bash[23186]: audit 2024-09-21T03:50:41.580673+0000 mon.a (mon.0) 11714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:42 smithi179 bash[23186]: audit 2024-09-21T03:50:41.589225+0000 mon.a (mon.0) 11715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:42 smithi179 bash[23186]: audit 2024-09-21T03:50:41.600743+0000 mon.a (mon.0) 11716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:42 smithi049 bash[23528]: cluster 2024-09-21T03:50:40.642048+0000 mgr.a (mgr.14388) 14553 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:42 smithi049 bash[23528]: audit 2024-09-21T03:50:41.161429+0000 mon.a (mon.0) 11711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:42 smithi049 bash[23528]: audit 2024-09-21T03:50:41.170169+0000 mon.a (mon.0) 11712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:42 smithi049 bash[23528]: audit 2024-09-21T03:50:41.180773+0000 mon.a (mon.0) 11713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:42 smithi049 bash[23528]: audit 2024-09-21T03:50:41.580673+0000 mon.a (mon.0) 11714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:42 smithi049 bash[23528]: audit 2024-09-21T03:50:41.589225+0000 mon.a (mon.0) 11715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:42 smithi049 bash[23528]: audit 2024-09-21T03:50:41.600743+0000 mon.a (mon.0) 11716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:42.849 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:42.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:42.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:42.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:42.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:43 smithi044 bash[22676]: audit 2024-09-21T03:50:42.395422+0000 mgr.a (mgr.14388) 14554 : audit [DBG] from='client.315696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:43 smithi179 bash[23186]: audit 2024-09-21T03:50:42.395422+0000 mgr.a (mgr.14388) 14554 : audit [DBG] from='client.315696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:43.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:43 smithi049 bash[23528]: audit 2024-09-21T03:50:42.395422+0000 mgr.a (mgr.14388) 14554 : audit [DBG] from='client.315696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:44.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:44 smithi044 bash[22676]: cluster 2024-09-21T03:50:42.642864+0000 mgr.a (mgr.14388) 14555 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:44 smithi179 bash[23186]: cluster 2024-09-21T03:50:42.642864+0000 mgr.a (mgr.14388) 14555 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:44 smithi049 bash[23528]: cluster 2024-09-21T03:50:42.642864+0000 mgr.a (mgr.14388) 14555 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:46 smithi044 bash[22676]: cluster 2024-09-21T03:50:44.643804+0000 mgr.a (mgr.14388) 14556 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:46 smithi179 bash[23186]: cluster 2024-09-21T03:50:44.643804+0000 mgr.a (mgr.14388) 14556 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:46 smithi049 bash[23528]: cluster 2024-09-21T03:50:44.643804+0000 mgr.a (mgr.14388) 14556 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:47.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:47.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:47.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:48 smithi044 bash[22676]: cluster 2024-09-21T03:50:46.646140+0000 mgr.a (mgr.14388) 14557 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:48 smithi179 bash[23186]: cluster 2024-09-21T03:50:46.646140+0000 mgr.a (mgr.14388) 14557 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:48 smithi049 bash[23528]: cluster 2024-09-21T03:50:46.646140+0000 mgr.a (mgr.14388) 14557 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:48.626 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:48.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:48.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:48.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:48.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:49 smithi044 bash[22676]: audit 2024-09-21T03:50:48.185623+0000 mgr.a (mgr.14388) 14558 : audit [DBG] from='client.315774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:49 smithi179 bash[23186]: audit 2024-09-21T03:50:48.185623+0000 mgr.a (mgr.14388) 14558 : audit [DBG] from='client.315774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:49.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:49 smithi049 bash[23528]: audit 2024-09-21T03:50:48.185623+0000 mgr.a (mgr.14388) 14558 : audit [DBG] from='client.315774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:50 smithi044 bash[22676]: cluster 2024-09-21T03:50:48.646760+0000 mgr.a (mgr.14388) 14559 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:50 smithi044 bash[22676]: audit 2024-09-21T03:50:50.030440+0000 mon.a (mon.0) 11717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:50 smithi044 bash[22676]: audit 2024-09-21T03:50:50.039617+0000 mon.a (mon.0) 11718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:50 smithi044 bash[22676]: audit 2024-09-21T03:50:50.050736+0000 mon.a (mon.0) 11719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:50 smithi179 bash[23186]: cluster 2024-09-21T03:50:48.646760+0000 mgr.a (mgr.14388) 14559 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:50 smithi179 bash[23186]: audit 2024-09-21T03:50:50.030440+0000 mon.a (mon.0) 11717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:50 smithi179 bash[23186]: audit 2024-09-21T03:50:50.039617+0000 mon.a (mon.0) 11718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:50 smithi179 bash[23186]: audit 2024-09-21T03:50:50.050736+0000 mon.a (mon.0) 11719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:50 smithi049 bash[23528]: cluster 2024-09-21T03:50:48.646760+0000 mgr.a (mgr.14388) 14559 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:50 smithi049 bash[23528]: audit 2024-09-21T03:50:50.030440+0000 mon.a (mon.0) 11717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:50 smithi049 bash[23528]: audit 2024-09-21T03:50:50.039617+0000 mon.a (mon.0) 11718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:50 smithi049 bash[23528]: audit 2024-09-21T03:50:50.050736+0000 mon.a (mon.0) 11719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:50:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:52 smithi044 bash[22676]: cluster 2024-09-21T03:50:50.649001+0000 mgr.a (mgr.14388) 14560 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:52.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:52 smithi179 bash[23186]: cluster 2024-09-21T03:50:50.649001+0000 mgr.a (mgr.14388) 14560 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:52.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:52 smithi049 bash[23528]: cluster 2024-09-21T03:50:50.649001+0000 mgr.a (mgr.14388) 14560 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:53.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:53.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:53.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:50:54.427 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:50:54.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:50:54.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:50:54.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:50:54.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:50:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:54 smithi044 bash[22676]: cluster 2024-09-21T03:50:52.649898+0000 mgr.a (mgr.14388) 14561 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:54 smithi179 bash[23186]: cluster 2024-09-21T03:50:52.649898+0000 mgr.a (mgr.14388) 14561 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:54.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:54 smithi049 bash[23528]: cluster 2024-09-21T03:50:52.649898+0000 mgr.a (mgr.14388) 14561 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:55 smithi044 bash[22676]: audit 2024-09-21T03:50:53.964753+0000 mgr.a (mgr.14388) 14562 : audit [DBG] from='client.315852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:55.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:55 smithi179 bash[23186]: audit 2024-09-21T03:50:53.964753+0000 mgr.a (mgr.14388) 14562 : audit [DBG] from='client.315852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:55.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:55 smithi049 bash[23528]: audit 2024-09-21T03:50:53.964753+0000 mgr.a (mgr.14388) 14562 : audit [DBG] from='client.315852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:56 smithi044 bash[22676]: cluster 2024-09-21T03:50:54.651121+0000 mgr.a (mgr.14388) 14563 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:56 smithi179 bash[23186]: cluster 2024-09-21T03:50:54.651121+0000 mgr.a (mgr.14388) 14563 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:56 smithi049 bash[23528]: cluster 2024-09-21T03:50:54.651121+0000 mgr.a (mgr.14388) 14563 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:50:58.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:50:58 smithi044 bash[22676]: cluster 2024-09-21T03:50:56.653594+0000 mgr.a (mgr.14388) 14564 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:50:58 smithi179 bash[23186]: cluster 2024-09-21T03:50:56.653594+0000 mgr.a (mgr.14388) 14564 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:50:58 smithi049 bash[23528]: cluster 2024-09-21T03:50:56.653594+0000 mgr.a (mgr.14388) 14564 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:50:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:50:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:50:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:00.234 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:00.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:00.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:00 smithi049 bash[23528]: cluster 2024-09-21T03:50:58.654387+0000 mgr.a (mgr.14388) 14565 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:00.468 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:00 smithi179 bash[23186]: cluster 2024-09-21T03:50:58.654387+0000 mgr.a (mgr.14388) 14565 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:00 smithi044 bash[22676]: cluster 2024-09-21T03:50:58.654387+0000 mgr.a (mgr.14388) 14565 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:01.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:01 smithi179 bash[23186]: audit 2024-09-21T03:50:59.767020+0000 mgr.a (mgr.14388) 14566 : audit [DBG] from='client.315924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:01 smithi044 bash[22676]: audit 2024-09-21T03:50:59.767020+0000 mgr.a (mgr.14388) 14566 : audit [DBG] from='client.315924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:01.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:01 smithi049 bash[23528]: audit 2024-09-21T03:50:59.767020+0000 mgr.a (mgr.14388) 14566 : audit [DBG] from='client.315924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:02 smithi044 bash[22676]: cluster 2024-09-21T03:51:00.657394+0000 mgr.a (mgr.14388) 14567 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:02 smithi044 bash[22676]: audit 2024-09-21T03:51:01.394180+0000 mon.a (mon.0) 11720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:02 smithi044 bash[22676]: audit 2024-09-21T03:51:01.402605+0000 mon.a (mon.0) 11721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:02 smithi044 bash[22676]: audit 2024-09-21T03:51:01.413012+0000 mon.a (mon.0) 11722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:02 smithi044 bash[22676]: audit 2024-09-21T03:51:01.783920+0000 mon.a (mon.0) 11723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:02 smithi044 bash[22676]: audit 2024-09-21T03:51:01.792110+0000 mon.a (mon.0) 11724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:02 smithi044 bash[22676]: audit 2024-09-21T03:51:01.802178+0000 mon.a (mon.0) 11725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:02 smithi179 bash[23186]: cluster 2024-09-21T03:51:00.657394+0000 mgr.a (mgr.14388) 14567 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:02 smithi179 bash[23186]: audit 2024-09-21T03:51:01.394180+0000 mon.a (mon.0) 11720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:02 smithi179 bash[23186]: audit 2024-09-21T03:51:01.402605+0000 mon.a (mon.0) 11721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:02 smithi179 bash[23186]: audit 2024-09-21T03:51:01.413012+0000 mon.a (mon.0) 11722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:02 smithi179 bash[23186]: audit 2024-09-21T03:51:01.783920+0000 mon.a (mon.0) 11723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:02 smithi179 bash[23186]: audit 2024-09-21T03:51:01.792110+0000 mon.a (mon.0) 11724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:02 smithi179 bash[23186]: audit 2024-09-21T03:51:01.802178+0000 mon.a (mon.0) 11725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:02 smithi049 bash[23528]: cluster 2024-09-21T03:51:00.657394+0000 mgr.a (mgr.14388) 14567 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:02 smithi049 bash[23528]: audit 2024-09-21T03:51:01.394180+0000 mon.a (mon.0) 11720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:02 smithi049 bash[23528]: audit 2024-09-21T03:51:01.402605+0000 mon.a (mon.0) 11721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:02 smithi049 bash[23528]: audit 2024-09-21T03:51:01.413012+0000 mon.a (mon.0) 11722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:02 smithi049 bash[23528]: audit 2024-09-21T03:51:01.783920+0000 mon.a (mon.0) 11723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:02 smithi049 bash[23528]: audit 2024-09-21T03:51:01.792110+0000 mon.a (mon.0) 11724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:02 smithi049 bash[23528]: audit 2024-09-21T03:51:01.802178+0000 mon.a (mon.0) 11725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:04 smithi044 bash[22676]: cluster 2024-09-21T03:51:02.658194+0000 mgr.a (mgr.14388) 14568 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:04 smithi179 bash[23186]: cluster 2024-09-21T03:51:02.658194+0000 mgr.a (mgr.14388) 14568 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:04.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:04 smithi049 bash[23528]: cluster 2024-09-21T03:51:02.658194+0000 mgr.a (mgr.14388) 14568 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:05.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:05.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:05.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:06.003 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:06.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:06 smithi044 bash[22676]: cluster 2024-09-21T03:51:04.658984+0000 mgr.a (mgr.14388) 14569 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:06.829 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:06 smithi044 bash[22676]: audit 2024-09-21T03:51:05.569786+0000 mgr.a (mgr.14388) 14570 : audit [DBG] from='client.315999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:06.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:06 smithi049 bash[23528]: cluster 2024-09-21T03:51:04.658984+0000 mgr.a (mgr.14388) 14569 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:06.829 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:06 smithi049 bash[23528]: audit 2024-09-21T03:51:05.569786+0000 mgr.a (mgr.14388) 14570 : audit [DBG] from='client.315999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:06.829 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:06 smithi179 bash[23186]: cluster 2024-09-21T03:51:04.658984+0000 mgr.a (mgr.14388) 14569 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:06.830 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:06 smithi179 bash[23186]: audit 2024-09-21T03:51:05.569786+0000 mgr.a (mgr.14388) 14570 : audit [DBG] from='client.315999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:08 smithi044 bash[22676]: cluster 2024-09-21T03:51:06.662013+0000 mgr.a (mgr.14388) 14571 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:08.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:08 smithi179 bash[23186]: cluster 2024-09-21T03:51:06.662013+0000 mgr.a (mgr.14388) 14571 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:08.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:08 smithi049 bash[23528]: cluster 2024-09-21T03:51:06.662013+0000 mgr.a (mgr.14388) 14571 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:10 smithi049 bash[23528]: cluster 2024-09-21T03:51:08.662849+0000 mgr.a (mgr.14388) 14572 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:10 smithi049 bash[23528]: audit 2024-09-21T03:51:10.249105+0000 mon.a (mon.0) 11726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:10 smithi049 bash[23528]: audit 2024-09-21T03:51:10.257698+0000 mon.a (mon.0) 11727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:10 smithi049 bash[23528]: audit 2024-09-21T03:51:10.269735+0000 mon.a (mon.0) 11728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:10 smithi044 bash[22676]: cluster 2024-09-21T03:51:08.662849+0000 mgr.a (mgr.14388) 14572 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:10 smithi044 bash[22676]: audit 2024-09-21T03:51:10.249105+0000 mon.a (mon.0) 11726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:10 smithi044 bash[22676]: audit 2024-09-21T03:51:10.257698+0000 mon.a (mon.0) 11727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:10 smithi044 bash[22676]: audit 2024-09-21T03:51:10.269735+0000 mon.a (mon.0) 11728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:10 smithi179 bash[23186]: cluster 2024-09-21T03:51:08.662849+0000 mgr.a (mgr.14388) 14572 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:10 smithi179 bash[23186]: audit 2024-09-21T03:51:10.249105+0000 mon.a (mon.0) 11726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:10 smithi179 bash[23186]: audit 2024-09-21T03:51:10.257698+0000 mon.a (mon.0) 11727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:10 smithi179 bash[23186]: audit 2024-09-21T03:51:10.269735+0000 mon.a (mon.0) 11728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:11.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:11.782 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:11.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:11.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:12 smithi044 bash[22676]: cluster 2024-09-21T03:51:10.664925+0000 mgr.a (mgr.14388) 14573 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:12 smithi044 bash[22676]: audit 2024-09-21T03:51:11.343779+0000 mgr.a (mgr.14388) 14574 : audit [DBG] from='client.316071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:12 smithi179 bash[23186]: cluster 2024-09-21T03:51:10.664925+0000 mgr.a (mgr.14388) 14573 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:12 smithi179 bash[23186]: audit 2024-09-21T03:51:11.343779+0000 mgr.a (mgr.14388) 14574 : audit [DBG] from='client.316071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:12 smithi049 bash[23528]: cluster 2024-09-21T03:51:10.664925+0000 mgr.a (mgr.14388) 14573 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:12 smithi049 bash[23528]: audit 2024-09-21T03:51:11.343779+0000 mgr.a (mgr.14388) 14574 : audit [DBG] from='client.316071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:14 smithi044 bash[22676]: cluster 2024-09-21T03:51:12.665955+0000 mgr.a (mgr.14388) 14575 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:14 smithi179 bash[23186]: cluster 2024-09-21T03:51:12.665955+0000 mgr.a (mgr.14388) 14575 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:14 smithi049 bash[23528]: cluster 2024-09-21T03:51:12.665955+0000 mgr.a (mgr.14388) 14575 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:16 smithi044 bash[22676]: cluster 2024-09-21T03:51:14.666794+0000 mgr.a (mgr.14388) 14576 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:16 smithi179 bash[23186]: cluster 2024-09-21T03:51:14.666794+0000 mgr.a (mgr.14388) 14576 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:16.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:16.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:16.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:16 smithi049 bash[23528]: cluster 2024-09-21T03:51:14.666794+0000 mgr.a (mgr.14388) 14576 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:17.564 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:17.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:17.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:17.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:17.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:18 smithi044 bash[22676]: cluster 2024-09-21T03:51:16.669068+0000 mgr.a (mgr.14388) 14577 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:18 smithi044 bash[22676]: audit 2024-09-21T03:51:17.123154+0000 mgr.a (mgr.14388) 14578 : audit [DBG] from='client.316149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:18 smithi179 bash[23186]: cluster 2024-09-21T03:51:16.669068+0000 mgr.a (mgr.14388) 14577 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:18 smithi179 bash[23186]: audit 2024-09-21T03:51:17.123154+0000 mgr.a (mgr.14388) 14578 : audit [DBG] from='client.316149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:18 smithi049 bash[23528]: cluster 2024-09-21T03:51:16.669068+0000 mgr.a (mgr.14388) 14577 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:18 smithi049 bash[23528]: audit 2024-09-21T03:51:17.123154+0000 mgr.a (mgr.14388) 14578 : audit [DBG] from='client.316149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:19 smithi044 bash[22676]: audit 2024-09-21T03:51:19.146682+0000 mon.a (mon.0) 11729 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:51:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:19 smithi044 bash[22676]: audit 2024-09-21T03:51:19.158122+0000 mon.a (mon.0) 11730 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:51:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:19 smithi044 bash[22676]: audit 2024-09-21T03:51:19.160058+0000 mon.a (mon.0) 11731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:51:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:19 smithi044 bash[22676]: audit 2024-09-21T03:51:19.171703+0000 mon.a (mon.0) 11732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:19 smithi044 bash[22676]: audit 2024-09-21T03:51:19.178765+0000 mon.a (mon.0) 11733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:19 smithi179 bash[23186]: audit 2024-09-21T03:51:19.146682+0000 mon.a (mon.0) 11729 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:19 smithi179 bash[23186]: audit 2024-09-21T03:51:19.158122+0000 mon.a (mon.0) 11730 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:19 smithi179 bash[23186]: audit 2024-09-21T03:51:19.160058+0000 mon.a (mon.0) 11731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:19 smithi179 bash[23186]: audit 2024-09-21T03:51:19.171703+0000 mon.a (mon.0) 11732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:19 smithi179 bash[23186]: audit 2024-09-21T03:51:19.178765+0000 mon.a (mon.0) 11733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:51:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:19 smithi049 bash[23528]: audit 2024-09-21T03:51:19.146682+0000 mon.a (mon.0) 11729 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:51:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:19 smithi049 bash[23528]: audit 2024-09-21T03:51:19.158122+0000 mon.a (mon.0) 11730 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:51:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:19 smithi049 bash[23528]: audit 2024-09-21T03:51:19.160058+0000 mon.a (mon.0) 11731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:51:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:19 smithi049 bash[23528]: audit 2024-09-21T03:51:19.171703+0000 mon.a (mon.0) 11732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:19.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:19 smithi049 bash[23528]: audit 2024-09-21T03:51:19.178765+0000 mon.a (mon.0) 11733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:51:20.440 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:51:19 smithi044 bash[22930]: debug 2024-09-21T03:51:19.983+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:51:20.440 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:51:19 smithi044 bash[22930]: debug 2024-09-21T03:51:19.983+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:51:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:20 smithi044 bash[22676]: cluster 2024-09-21T03:51:18.670077+0000 mgr.a (mgr.14388) 14579 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:20 smithi044 bash[22676]: audit 2024-09-21T03:51:19.181616+0000 mgr.a (mgr.14388) 14580 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:51:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:20 smithi179 bash[23186]: cluster 2024-09-21T03:51:18.670077+0000 mgr.a (mgr.14388) 14579 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:20 smithi179 bash[23186]: audit 2024-09-21T03:51:19.181616+0000 mgr.a (mgr.14388) 14580 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:51:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:20 smithi049 bash[23528]: cluster 2024-09-21T03:51:18.670077+0000 mgr.a (mgr.14388) 14579 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:20 smithi049 bash[23528]: audit 2024-09-21T03:51:19.181616+0000 mgr.a (mgr.14388) 14580 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:51:21.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:21 smithi179 bash[23186]: audit 2024-09-21T03:51:19.987337+0000 mgr.a (mgr.14388) 14581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:51:21.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:21 smithi179 bash[23186]: cephadm 2024-09-21T03:51:19.988899+0000 mgr.a (mgr.14388) 14582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:51:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:21 smithi044 bash[22676]: audit 2024-09-21T03:51:19.987337+0000 mgr.a (mgr.14388) 14581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:51:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:21 smithi044 bash[22676]: cephadm 2024-09-21T03:51:19.988899+0000 mgr.a (mgr.14388) 14582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:51:21.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:21 smithi049 bash[23528]: audit 2024-09-21T03:51:19.987337+0000 mgr.a (mgr.14388) 14581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:51:21.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:21 smithi049 bash[23528]: cephadm 2024-09-21T03:51:19.988899+0000 mgr.a (mgr.14388) 14582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:51:22.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:22.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:22.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:22 smithi044 bash[22676]: cluster 2024-09-21T03:51:20.672669+0000 mgr.a (mgr.14388) 14583 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:22 smithi044 bash[22676]: audit 2024-09-21T03:51:21.585804+0000 mon.a (mon.0) 11734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:22 smithi044 bash[22676]: audit 2024-09-21T03:51:21.594154+0000 mon.a (mon.0) 11735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:22 smithi044 bash[22676]: audit 2024-09-21T03:51:21.604189+0000 mon.a (mon.0) 11736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:22 smithi044 bash[22676]: audit 2024-09-21T03:51:21.992249+0000 mon.a (mon.0) 11737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:22 smithi044 bash[22676]: audit 2024-09-21T03:51:22.000296+0000 mon.a (mon.0) 11738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:22 smithi044 bash[22676]: audit 2024-09-21T03:51:22.010522+0000 mon.a (mon.0) 11739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:22 smithi179 bash[23186]: cluster 2024-09-21T03:51:20.672669+0000 mgr.a (mgr.14388) 14583 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:22 smithi179 bash[23186]: audit 2024-09-21T03:51:21.585804+0000 mon.a (mon.0) 11734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:22 smithi179 bash[23186]: audit 2024-09-21T03:51:21.594154+0000 mon.a (mon.0) 11735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:22 smithi179 bash[23186]: audit 2024-09-21T03:51:21.604189+0000 mon.a (mon.0) 11736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:22 smithi179 bash[23186]: audit 2024-09-21T03:51:21.992249+0000 mon.a (mon.0) 11737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:22 smithi179 bash[23186]: audit 2024-09-21T03:51:22.000296+0000 mon.a (mon.0) 11738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:22 smithi179 bash[23186]: audit 2024-09-21T03:51:22.010522+0000 mon.a (mon.0) 11739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:22 smithi049 bash[23528]: cluster 2024-09-21T03:51:20.672669+0000 mgr.a (mgr.14388) 14583 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:22 smithi049 bash[23528]: audit 2024-09-21T03:51:21.585804+0000 mon.a (mon.0) 11734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:22 smithi049 bash[23528]: audit 2024-09-21T03:51:21.594154+0000 mon.a (mon.0) 11735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:22 smithi049 bash[23528]: audit 2024-09-21T03:51:21.604189+0000 mon.a (mon.0) 11736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:22 smithi049 bash[23528]: audit 2024-09-21T03:51:21.992249+0000 mon.a (mon.0) 11737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:22 smithi049 bash[23528]: audit 2024-09-21T03:51:22.000296+0000 mon.a (mon.0) 11738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:22 smithi049 bash[23528]: audit 2024-09-21T03:51:22.010522+0000 mon.a (mon.0) 11739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:23.358 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:24 smithi044 bash[22676]: cluster 2024-09-21T03:51:22.673145+0000 mgr.a (mgr.14388) 14584 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:24 smithi044 bash[22676]: audit 2024-09-21T03:51:22.900418+0000 mgr.a (mgr.14388) 14585 : audit [DBG] from='client.316329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:24 smithi179 bash[23186]: cluster 2024-09-21T03:51:22.673145+0000 mgr.a (mgr.14388) 14584 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:24 smithi179 bash[23186]: audit 2024-09-21T03:51:22.900418+0000 mgr.a (mgr.14388) 14585 : audit [DBG] from='client.316329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:24 smithi049 bash[23528]: cluster 2024-09-21T03:51:22.673145+0000 mgr.a (mgr.14388) 14584 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:25.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:24 smithi049 bash[23528]: audit 2024-09-21T03:51:22.900418+0000 mgr.a (mgr.14388) 14585 : audit [DBG] from='client.316329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:26.875 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:26 smithi049 bash[23528]: cluster 2024-09-21T03:51:24.674116+0000 mgr.a (mgr.14388) 14586 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:26 smithi044 bash[22676]: cluster 2024-09-21T03:51:24.674116+0000 mgr.a (mgr.14388) 14586 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:26 smithi179 bash[23186]: cluster 2024-09-21T03:51:24.674116+0000 mgr.a (mgr.14388) 14586 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:28.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:28.361 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:28.361 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:28 smithi044 bash[22676]: cluster 2024-09-21T03:51:26.676360+0000 mgr.a (mgr.14388) 14587 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:28 smithi179 bash[23186]: cluster 2024-09-21T03:51:26.676360+0000 mgr.a (mgr.14388) 14587 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:28 smithi049 bash[23528]: cluster 2024-09-21T03:51:26.676360+0000 mgr.a (mgr.14388) 14587 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:29.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:30 smithi049 bash[23528]: cluster 2024-09-21T03:51:28.677081+0000 mgr.a (mgr.14388) 14588 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:30 smithi049 bash[23528]: audit 2024-09-21T03:51:28.695903+0000 mgr.a (mgr.14388) 14589 : audit [DBG] from='client.316407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:30 smithi049 bash[23528]: audit 2024-09-21T03:51:30.483392+0000 mon.a (mon.0) 11740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:30 smithi049 bash[23528]: audit 2024-09-21T03:51:30.492300+0000 mon.a (mon.0) 11741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:30 smithi049 bash[23528]: audit 2024-09-21T03:51:30.504235+0000 mon.a (mon.0) 11742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:30 smithi044 bash[22676]: cluster 2024-09-21T03:51:28.677081+0000 mgr.a (mgr.14388) 14588 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:30 smithi044 bash[22676]: audit 2024-09-21T03:51:28.695903+0000 mgr.a (mgr.14388) 14589 : audit [DBG] from='client.316407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:30 smithi044 bash[22676]: audit 2024-09-21T03:51:30.483392+0000 mon.a (mon.0) 11740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:30 smithi044 bash[22676]: audit 2024-09-21T03:51:30.492300+0000 mon.a (mon.0) 11741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:30 smithi044 bash[22676]: audit 2024-09-21T03:51:30.504235+0000 mon.a (mon.0) 11742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:30 smithi179 bash[23186]: cluster 2024-09-21T03:51:28.677081+0000 mgr.a (mgr.14388) 14588 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:30 smithi179 bash[23186]: audit 2024-09-21T03:51:28.695903+0000 mgr.a (mgr.14388) 14589 : audit [DBG] from='client.316407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:30 smithi179 bash[23186]: audit 2024-09-21T03:51:30.483392+0000 mon.a (mon.0) 11740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:30 smithi179 bash[23186]: audit 2024-09-21T03:51:30.492300+0000 mon.a (mon.0) 11741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:30 smithi179 bash[23186]: audit 2024-09-21T03:51:30.504235+0000 mon.a (mon.0) 11742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:32.897 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:32 smithi044 bash[22676]: cluster 2024-09-21T03:51:30.679417+0000 mgr.a (mgr.14388) 14590 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:32 smithi179 bash[23186]: cluster 2024-09-21T03:51:30.679417+0000 mgr.a (mgr.14388) 14590 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:33.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:32 smithi049 bash[23528]: cluster 2024-09-21T03:51:30.679417+0000 mgr.a (mgr.14388) 14590 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:51:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:34.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:34.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:34.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:34.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:34 smithi044 bash[22676]: cluster 2024-09-21T03:51:32.680227+0000 mgr.a (mgr.14388) 14591 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:34 smithi179 bash[23186]: cluster 2024-09-21T03:51:32.680227+0000 mgr.a (mgr.14388) 14591 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:34 smithi049 bash[23528]: cluster 2024-09-21T03:51:32.680227+0000 mgr.a (mgr.14388) 14591 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:35 smithi044 bash[22676]: audit 2024-09-21T03:51:34.470527+0000 mgr.a (mgr.14388) 14592 : audit [DBG] from='client.316485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:36.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:35 smithi179 bash[23186]: audit 2024-09-21T03:51:34.470527+0000 mgr.a (mgr.14388) 14592 : audit [DBG] from='client.316485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:36.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:35 smithi049 bash[23528]: audit 2024-09-21T03:51:34.470527+0000 mgr.a (mgr.14388) 14592 : audit [DBG] from='client.316485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:36 smithi044 bash[22676]: cluster 2024-09-21T03:51:34.680749+0000 mgr.a (mgr.14388) 14593 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:36 smithi179 bash[23186]: cluster 2024-09-21T03:51:34.680749+0000 mgr.a (mgr.14388) 14593 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:36 smithi049 bash[23528]: cluster 2024-09-21T03:51:34.680749+0000 mgr.a (mgr.14388) 14593 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:37.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:37 smithi044 bash[22676]: cluster 2024-09-21T03:51:36.683123+0000 mgr.a (mgr.14388) 14594 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:38.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:37 smithi179 bash[23186]: cluster 2024-09-21T03:51:36.683123+0000 mgr.a (mgr.14388) 14594 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:37 smithi049 bash[23528]: cluster 2024-09-21T03:51:36.683123+0000 mgr.a (mgr.14388) 14594 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:39.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:39.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:40.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:39 smithi179 bash[23186]: cluster 2024-09-21T03:51:38.684062+0000 mgr.a (mgr.14388) 14595 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:39 smithi049 bash[23528]: cluster 2024-09-21T03:51:38.684062+0000 mgr.a (mgr.14388) 14595 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:39 smithi044 bash[22676]: cluster 2024-09-21T03:51:38.684062+0000 mgr.a (mgr.14388) 14595 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:40.726 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:40.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:40.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:40.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:40.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:40 smithi179 bash[23186]: audit 2024-09-21T03:51:40.258797+0000 mgr.a (mgr.14388) 14596 : audit [DBG] from='client.316560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:40 smithi049 bash[23528]: audit 2024-09-21T03:51:40.258797+0000 mgr.a (mgr.14388) 14596 : audit [DBG] from='client.316560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:41.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:40 smithi044 bash[22676]: audit 2024-09-21T03:51:40.258797+0000 mgr.a (mgr.14388) 14596 : audit [DBG] from='client.316560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:41 smithi179 bash[23186]: cluster 2024-09-21T03:51:40.685644+0000 mgr.a (mgr.14388) 14597 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:42.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:41 smithi049 bash[23528]: cluster 2024-09-21T03:51:40.685644+0000 mgr.a (mgr.14388) 14597 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:42.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:41 smithi044 bash[22676]: cluster 2024-09-21T03:51:40.685644+0000 mgr.a (mgr.14388) 14597 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:43.115 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:42 smithi179 bash[23186]: audit 2024-09-21T03:51:41.818296+0000 mon.a (mon.0) 11743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.115 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:42 smithi179 bash[23186]: audit 2024-09-21T03:51:41.827936+0000 mon.a (mon.0) 11744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.115 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:42 smithi179 bash[23186]: audit 2024-09-21T03:51:41.838263+0000 mon.a (mon.0) 11745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.116 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:42 smithi179 bash[23186]: audit 2024-09-21T03:51:42.212544+0000 mon.a (mon.0) 11746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.116 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:42 smithi179 bash[23186]: audit 2024-09-21T03:51:42.220045+0000 mon.a (mon.0) 11747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.116 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:42 smithi179 bash[23186]: audit 2024-09-21T03:51:42.229172+0000 mon.a (mon.0) 11748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:42 smithi044 bash[22676]: audit 2024-09-21T03:51:41.818296+0000 mon.a (mon.0) 11743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:42 smithi044 bash[22676]: audit 2024-09-21T03:51:41.827936+0000 mon.a (mon.0) 11744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:42 smithi044 bash[22676]: audit 2024-09-21T03:51:41.838263+0000 mon.a (mon.0) 11745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:42 smithi044 bash[22676]: audit 2024-09-21T03:51:42.212544+0000 mon.a (mon.0) 11746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:42 smithi044 bash[22676]: audit 2024-09-21T03:51:42.220045+0000 mon.a (mon.0) 11747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:42 smithi044 bash[22676]: audit 2024-09-21T03:51:42.229172+0000 mon.a (mon.0) 11748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:42 smithi049 bash[23528]: audit 2024-09-21T03:51:41.818296+0000 mon.a (mon.0) 11743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:42 smithi049 bash[23528]: audit 2024-09-21T03:51:41.827936+0000 mon.a (mon.0) 11744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:42 smithi049 bash[23528]: audit 2024-09-21T03:51:41.838263+0000 mon.a (mon.0) 11745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:42 smithi049 bash[23528]: audit 2024-09-21T03:51:42.212544+0000 mon.a (mon.0) 11746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:42 smithi049 bash[23528]: audit 2024-09-21T03:51:42.220045+0000 mon.a (mon.0) 11747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:42 smithi049 bash[23528]: audit 2024-09-21T03:51:42.229172+0000 mon.a (mon.0) 11748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:44.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:44 smithi044 bash[22676]: cluster 2024-09-21T03:51:42.686558+0000 mgr.a (mgr.14388) 14598 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:44 smithi179 bash[23186]: cluster 2024-09-21T03:51:42.686558+0000 mgr.a (mgr.14388) 14598 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:44.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:44 smithi049 bash[23528]: cluster 2024-09-21T03:51:42.686558+0000 mgr.a (mgr.14388) 14598 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:45.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:45.729 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:45.729 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:46 smithi044 bash[22676]: cluster 2024-09-21T03:51:44.687506+0000 mgr.a (mgr.14388) 14599 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:51:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:46 smithi179 bash[23186]: cluster 2024-09-21T03:51:44.687506+0000 mgr.a (mgr.14388) 14599 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:51:46.522 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:46.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:46.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:46.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:46.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:46.532 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:46 smithi049 bash[23528]: cluster 2024-09-21T03:51:44.687506+0000 mgr.a (mgr.14388) 14599 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:51:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:47 smithi044 bash[22676]: audit 2024-09-21T03:51:46.064932+0000 mgr.a (mgr.14388) 14600 : audit [DBG] from='client.316638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:47 smithi179 bash[23186]: audit 2024-09-21T03:51:46.064932+0000 mgr.a (mgr.14388) 14600 : audit [DBG] from='client.316638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:47.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:47 smithi049 bash[23528]: audit 2024-09-21T03:51:46.064932+0000 mgr.a (mgr.14388) 14600 : audit [DBG] from='client.316638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:48 smithi179 bash[23186]: cluster 2024-09-21T03:51:46.690355+0000 mgr.a (mgr.14388) 14601 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:48.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:48 smithi049 bash[23528]: cluster 2024-09-21T03:51:46.690355+0000 mgr.a (mgr.14388) 14601 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:48.693 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:48 smithi044 bash[22676]: cluster 2024-09-21T03:51:46.690355+0000 mgr.a (mgr.14388) 14601 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:50.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:50 smithi179 bash[23186]: cluster 2024-09-21T03:51:48.690921+0000 mgr.a (mgr.14388) 14602 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:50.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:50 smithi049 bash[23528]: cluster 2024-09-21T03:51:48.690921+0000 mgr.a (mgr.14388) 14602 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:50 smithi044 bash[22676]: cluster 2024-09-21T03:51:48.690921+0000 mgr.a (mgr.14388) 14602 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:51:51.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:51.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:51.524 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:51 smithi044 bash[22676]: cluster 2024-09-21T03:51:50.693466+0000 mgr.a (mgr.14388) 14603 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:51 smithi044 bash[22676]: audit 2024-09-21T03:51:50.721310+0000 mon.a (mon.0) 11749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:51 smithi044 bash[22676]: audit 2024-09-21T03:51:50.729892+0000 mon.a (mon.0) 11750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:51 smithi044 bash[22676]: audit 2024-09-21T03:51:50.740749+0000 mon.a (mon.0) 11751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:51 smithi179 bash[23186]: cluster 2024-09-21T03:51:50.693466+0000 mgr.a (mgr.14388) 14603 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:51 smithi179 bash[23186]: audit 2024-09-21T03:51:50.721310+0000 mon.a (mon.0) 11749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:51 smithi179 bash[23186]: audit 2024-09-21T03:51:50.729892+0000 mon.a (mon.0) 11750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:51 smithi179 bash[23186]: audit 2024-09-21T03:51:50.740749+0000 mon.a (mon.0) 11751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:52.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:51 smithi049 bash[23528]: cluster 2024-09-21T03:51:50.693466+0000 mgr.a (mgr.14388) 14603 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:51 smithi049 bash[23528]: audit 2024-09-21T03:51:50.721310+0000 mon.a (mon.0) 11749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:51 smithi049 bash[23528]: audit 2024-09-21T03:51:50.729892+0000 mon.a (mon.0) 11750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:51 smithi049 bash[23528]: audit 2024-09-21T03:51:50.740749+0000 mon.a (mon.0) 11751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:51:52.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:52.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:52.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:52.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:52.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:52 smithi044 bash[22676]: audit 2024-09-21T03:51:51.864288+0000 mgr.a (mgr.14388) 14604 : audit [DBG] from='client.316710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:52 smithi179 bash[23186]: audit 2024-09-21T03:51:51.864288+0000 mgr.a (mgr.14388) 14604 : audit [DBG] from='client.316710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:52 smithi049 bash[23528]: audit 2024-09-21T03:51:51.864288+0000 mgr.a (mgr.14388) 14604 : audit [DBG] from='client.316710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:53.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:53 smithi044 bash[22676]: cluster 2024-09-21T03:51:52.694627+0000 mgr.a (mgr.14388) 14605 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:54.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:53 smithi179 bash[23186]: cluster 2024-09-21T03:51:52.694627+0000 mgr.a (mgr.14388) 14605 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:54.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:53 smithi049 bash[23528]: cluster 2024-09-21T03:51:52.694627+0000 mgr.a (mgr.14388) 14605 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:55 smithi044 bash[22676]: cluster 2024-09-21T03:51:54.695644+0000 mgr.a (mgr.14388) 14606 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:56.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:55 smithi179 bash[23186]: cluster 2024-09-21T03:51:54.695644+0000 mgr.a (mgr.14388) 14606 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:56.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:55 smithi049 bash[23528]: cluster 2024-09-21T03:51:54.695644+0000 mgr.a (mgr.14388) 14606 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:51:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:51:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:51:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:51:58.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:57 smithi179 bash[23186]: cluster 2024-09-21T03:51:56.698078+0000 mgr.a (mgr.14388) 14607 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:58.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:57 smithi049 bash[23528]: cluster 2024-09-21T03:51:56.698078+0000 mgr.a (mgr.14388) 14607 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:58.095 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:51:58.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:51:58.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:51:58.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:51:58.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:51:58.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:57 smithi044 bash[22676]: cluster 2024-09-21T03:51:56.698078+0000 mgr.a (mgr.14388) 14607 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:51:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:58 smithi179 bash[23186]: audit 2024-09-21T03:51:57.658235+0000 mgr.a (mgr.14388) 14608 : audit [DBG] from='client.316782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:58 smithi049 bash[23528]: audit 2024-09-21T03:51:57.658235+0000 mgr.a (mgr.14388) 14608 : audit [DBG] from='client.316782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:58 smithi044 bash[22676]: audit 2024-09-21T03:51:57.658235+0000 mgr.a (mgr.14388) 14608 : audit [DBG] from='client.316782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:51:59 smithi179 bash[23186]: cluster 2024-09-21T03:51:58.699099+0000 mgr.a (mgr.14388) 14609 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:00.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:51:59 smithi049 bash[23528]: cluster 2024-09-21T03:51:58.699099+0000 mgr.a (mgr.14388) 14609 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:00.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:51:59 smithi044 bash[22676]: cluster 2024-09-21T03:51:58.699099+0000 mgr.a (mgr.14388) 14609 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:02.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:01 smithi179 bash[23186]: cluster 2024-09-21T03:52:00.701329+0000 mgr.a (mgr.14388) 14610 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:02.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:01 smithi049 bash[23528]: cluster 2024-09-21T03:52:00.701329+0000 mgr.a (mgr.14388) 14610 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:01 smithi044 bash[22676]: cluster 2024-09-21T03:52:00.701329+0000 mgr.a (mgr.14388) 14610 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:03.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:03.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:03.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:03 smithi179 bash[23186]: audit 2024-09-21T03:52:02.062647+0000 mon.a (mon.0) 11752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:03 smithi179 bash[23186]: audit 2024-09-21T03:52:02.073034+0000 mon.a (mon.0) 11753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:03 smithi179 bash[23186]: audit 2024-09-21T03:52:02.097140+0000 mon.a (mon.0) 11754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:03 smithi179 bash[23186]: audit 2024-09-21T03:52:02.444782+0000 mon.a (mon.0) 11755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:03 smithi179 bash[23186]: audit 2024-09-21T03:52:02.453483+0000 mon.a (mon.0) 11756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:03 smithi179 bash[23186]: audit 2024-09-21T03:52:02.464964+0000 mon.a (mon.0) 11757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:03 smithi044 bash[22676]: audit 2024-09-21T03:52:02.062647+0000 mon.a (mon.0) 11752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:03 smithi044 bash[22676]: audit 2024-09-21T03:52:02.073034+0000 mon.a (mon.0) 11753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:03 smithi044 bash[22676]: audit 2024-09-21T03:52:02.097140+0000 mon.a (mon.0) 11754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:03 smithi044 bash[22676]: audit 2024-09-21T03:52:02.444782+0000 mon.a (mon.0) 11755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:03 smithi044 bash[22676]: audit 2024-09-21T03:52:02.453483+0000 mon.a (mon.0) 11756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:03 smithi044 bash[22676]: audit 2024-09-21T03:52:02.464964+0000 mon.a (mon.0) 11757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:03 smithi049 bash[23528]: audit 2024-09-21T03:52:02.062647+0000 mon.a (mon.0) 11752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:03 smithi049 bash[23528]: audit 2024-09-21T03:52:02.073034+0000 mon.a (mon.0) 11753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:03 smithi049 bash[23528]: audit 2024-09-21T03:52:02.097140+0000 mon.a (mon.0) 11754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:03 smithi049 bash[23528]: audit 2024-09-21T03:52:02.444782+0000 mon.a (mon.0) 11755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:03 smithi049 bash[23528]: audit 2024-09-21T03:52:02.453483+0000 mon.a (mon.0) 11756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:03 smithi049 bash[23528]: audit 2024-09-21T03:52:02.464964+0000 mon.a (mon.0) 11757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:03.886 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:03.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:03.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:03.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:03.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:04 smithi044 bash[22676]: cluster 2024-09-21T03:52:02.702091+0000 mgr.a (mgr.14388) 14611 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:04 smithi044 bash[22676]: audit 2024-09-21T03:52:03.436721+0000 mgr.a (mgr.14388) 14612 : audit [DBG] from='client.316860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:04 smithi179 bash[23186]: cluster 2024-09-21T03:52:02.702091+0000 mgr.a (mgr.14388) 14611 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:04 smithi179 bash[23186]: audit 2024-09-21T03:52:03.436721+0000 mgr.a (mgr.14388) 14612 : audit [DBG] from='client.316860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:04 smithi049 bash[23528]: cluster 2024-09-21T03:52:02.702091+0000 mgr.a (mgr.14388) 14611 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:04 smithi049 bash[23528]: audit 2024-09-21T03:52:03.436721+0000 mgr.a (mgr.14388) 14612 : audit [DBG] from='client.316860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:06 smithi044 bash[22676]: cluster 2024-09-21T03:52:04.703073+0000 mgr.a (mgr.14388) 14613 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:06 smithi179 bash[23186]: cluster 2024-09-21T03:52:04.703073+0000 mgr.a (mgr.14388) 14613 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:06.772 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:06 smithi049 bash[23528]: cluster 2024-09-21T03:52:04.703073+0000 mgr.a (mgr.14388) 14613 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:08 smithi044 bash[22676]: cluster 2024-09-21T03:52:06.705580+0000 mgr.a (mgr.14388) 14614 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:08.746 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:08 smithi049 bash[23528]: cluster 2024-09-21T03:52:06.705580+0000 mgr.a (mgr.14388) 14614 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:08 smithi179 bash[23186]: cluster 2024-09-21T03:52:06.705580+0000 mgr.a (mgr.14388) 14614 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:08.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:08.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:09.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:09.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:09.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:09.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:09.683 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:10 smithi044 bash[22676]: cluster 2024-09-21T03:52:08.706494+0000 mgr.a (mgr.14388) 14615 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:10 smithi044 bash[22676]: audit 2024-09-21T03:52:09.227789+0000 mgr.a (mgr.14388) 14616 : audit [DBG] from='client.316938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:10 smithi179 bash[23186]: cluster 2024-09-21T03:52:08.706494+0000 mgr.a (mgr.14388) 14615 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:10 smithi179 bash[23186]: audit 2024-09-21T03:52:09.227789+0000 mgr.a (mgr.14388) 14616 : audit [DBG] from='client.316938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:10.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:10 smithi049 bash[23528]: cluster 2024-09-21T03:52:08.706494+0000 mgr.a (mgr.14388) 14615 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:10 smithi049 bash[23528]: audit 2024-09-21T03:52:09.227789+0000 mgr.a (mgr.14388) 14616 : audit [DBG] from='client.316938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:12.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:11 smithi044 bash[22676]: cluster 2024-09-21T03:52:10.708850+0000 mgr.a (mgr.14388) 14617 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:12.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:11 smithi044 bash[22676]: audit 2024-09-21T03:52:10.954074+0000 mon.a (mon.0) 11758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:11 smithi044 bash[22676]: audit 2024-09-21T03:52:10.964173+0000 mon.a (mon.0) 11759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:11 smithi044 bash[22676]: audit 2024-09-21T03:52:10.976156+0000 mon.a (mon.0) 11760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:11 smithi179 bash[23186]: cluster 2024-09-21T03:52:10.708850+0000 mgr.a (mgr.14388) 14617 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:11 smithi179 bash[23186]: audit 2024-09-21T03:52:10.954074+0000 mon.a (mon.0) 11758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:11 smithi179 bash[23186]: audit 2024-09-21T03:52:10.964173+0000 mon.a (mon.0) 11759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:11 smithi179 bash[23186]: audit 2024-09-21T03:52:10.976156+0000 mon.a (mon.0) 11760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:11 smithi049 bash[23528]: cluster 2024-09-21T03:52:10.708850+0000 mgr.a (mgr.14388) 14617 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:12.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:11 smithi049 bash[23528]: audit 2024-09-21T03:52:10.954074+0000 mon.a (mon.0) 11758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:11 smithi049 bash[23528]: audit 2024-09-21T03:52:10.964173+0000 mon.a (mon.0) 11759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:11 smithi049 bash[23528]: audit 2024-09-21T03:52:10.976156+0000 mon.a (mon.0) 11760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:13 smithi044 bash[22676]: cluster 2024-09-21T03:52:12.709664+0000 mgr.a (mgr.14388) 14618 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:14.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:13 smithi179 bash[23186]: cluster 2024-09-21T03:52:12.709664+0000 mgr.a (mgr.14388) 14618 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:14.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:13 smithi049 bash[23528]: cluster 2024-09-21T03:52:12.709664+0000 mgr.a (mgr.14388) 14618 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:14.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:14.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:14.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:15.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:15.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:15.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:15.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:15.494 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:15 smithi044 bash[22676]: cluster 2024-09-21T03:52:14.710354+0000 mgr.a (mgr.14388) 14619 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:15 smithi044 bash[22676]: audit 2024-09-21T03:52:15.024175+0000 mgr.a (mgr.14388) 14620 : audit [DBG] from='client.317016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:16.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:15 smithi179 bash[23186]: cluster 2024-09-21T03:52:14.710354+0000 mgr.a (mgr.14388) 14619 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:15 smithi179 bash[23186]: audit 2024-09-21T03:52:15.024175+0000 mgr.a (mgr.14388) 14620 : audit [DBG] from='client.317016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:15 smithi049 bash[23528]: cluster 2024-09-21T03:52:14.710354+0000 mgr.a (mgr.14388) 14619 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:16.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:15 smithi049 bash[23528]: audit 2024-09-21T03:52:15.024175+0000 mgr.a (mgr.14388) 14620 : audit [DBG] from='client.317016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:17 smithi044 bash[22676]: cluster 2024-09-21T03:52:16.711670+0000 mgr.a (mgr.14388) 14621 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:18.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:17 smithi179 bash[23186]: cluster 2024-09-21T03:52:16.711670+0000 mgr.a (mgr.14388) 14621 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:18.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:17 smithi049 bash[23528]: cluster 2024-09-21T03:52:16.711670+0000 mgr.a (mgr.14388) 14621 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:19 smithi044 bash[22676]: cluster 2024-09-21T03:52:18.712403+0000 mgr.a (mgr.14388) 14622 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:19 smithi179 bash[23186]: cluster 2024-09-21T03:52:18.712403+0000 mgr.a (mgr.14388) 14622 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:20.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:19 smithi049 bash[23528]: cluster 2024-09-21T03:52:18.712403+0000 mgr.a (mgr.14388) 14622 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:20.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:20.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:21.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22930]: debug 2024-09-21T03:52:20.858+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:52:21.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22930]: debug 2024-09-21T03:52:20.870+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:52:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22676]: audit 2024-09-21T03:52:20.048813+0000 mon.a (mon.0) 11761 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:52:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22676]: audit 2024-09-21T03:52:20.055781+0000 mon.a (mon.0) 11762 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:52:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22676]: audit 2024-09-21T03:52:20.057966+0000 mon.a (mon.0) 11763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:52:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22676]: audit 2024-09-21T03:52:20.069671+0000 mon.a (mon.0) 11764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22676]: audit 2024-09-21T03:52:20.076175+0000 mon.a (mon.0) 11765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:52:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:20 smithi044 bash[22676]: audit 2024-09-21T03:52:20.078538+0000 mgr.a (mgr.14388) 14623 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:52:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:20 smithi179 bash[23186]: audit 2024-09-21T03:52:20.048813+0000 mon.a (mon.0) 11761 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:52:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:20 smithi179 bash[23186]: audit 2024-09-21T03:52:20.055781+0000 mon.a (mon.0) 11762 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:52:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:20 smithi179 bash[23186]: audit 2024-09-21T03:52:20.057966+0000 mon.a (mon.0) 11763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:52:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:20 smithi179 bash[23186]: audit 2024-09-21T03:52:20.069671+0000 mon.a (mon.0) 11764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:20 smithi179 bash[23186]: audit 2024-09-21T03:52:20.076175+0000 mon.a (mon.0) 11765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:52:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:20 smithi179 bash[23186]: audit 2024-09-21T03:52:20.078538+0000 mgr.a (mgr.14388) 14623 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:52:21.267 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:20 smithi049 bash[23528]: audit 2024-09-21T03:52:20.048813+0000 mon.a (mon.0) 11761 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:52:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:20 smithi049 bash[23528]: audit 2024-09-21T03:52:20.055781+0000 mon.a (mon.0) 11762 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:52:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:20 smithi049 bash[23528]: audit 2024-09-21T03:52:20.057966+0000 mon.a (mon.0) 11763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:52:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:20 smithi049 bash[23528]: audit 2024-09-21T03:52:20.069671+0000 mon.a (mon.0) 11764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:20 smithi049 bash[23528]: audit 2024-09-21T03:52:20.076175+0000 mon.a (mon.0) 11765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:52:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:20 smithi049 bash[23528]: audit 2024-09-21T03:52:20.078538+0000 mgr.a (mgr.14388) 14623 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:52:22.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:22 smithi179 bash[23186]: cluster 2024-09-21T03:52:20.713816+0000 mgr.a (mgr.14388) 14624 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:22.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:22 smithi179 bash[23186]: audit 2024-09-21T03:52:20.823494+0000 mgr.a (mgr.14388) 14625 : audit [DBG] from='client.317163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:22.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:22 smithi179 bash[23186]: audit 2024-09-21T03:52:20.863086+0000 mgr.a (mgr.14388) 14626 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:52:22.331 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:22 smithi179 bash[23186]: cephadm 2024-09-21T03:52:20.874641+0000 mgr.a (mgr.14388) 14627 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:52:22.470 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:22 smithi049 bash[23528]: cluster 2024-09-21T03:52:20.713816+0000 mgr.a (mgr.14388) 14624 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:22.470 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:22 smithi049 bash[23528]: audit 2024-09-21T03:52:20.823494+0000 mgr.a (mgr.14388) 14625 : audit [DBG] from='client.317163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:22.470 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:22 smithi049 bash[23528]: audit 2024-09-21T03:52:20.863086+0000 mgr.a (mgr.14388) 14626 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:52:22.470 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:22 smithi049 bash[23528]: cephadm 2024-09-21T03:52:20.874641+0000 mgr.a (mgr.14388) 14627 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:52:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:22 smithi044 bash[22676]: cluster 2024-09-21T03:52:20.713816+0000 mgr.a (mgr.14388) 14624 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:22 smithi044 bash[22676]: audit 2024-09-21T03:52:20.823494+0000 mgr.a (mgr.14388) 14625 : audit [DBG] from='client.317163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:22 smithi044 bash[22676]: audit 2024-09-21T03:52:20.863086+0000 mgr.a (mgr.14388) 14626 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:52:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:22 smithi044 bash[22676]: cephadm 2024-09-21T03:52:20.874641+0000 mgr.a (mgr.14388) 14627 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:52:23.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:23 smithi179 bash[23186]: audit 2024-09-21T03:52:22.307802+0000 mon.a (mon.0) 11766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:23 smithi179 bash[23186]: audit 2024-09-21T03:52:22.316414+0000 mon.a (mon.0) 11767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:23 smithi179 bash[23186]: audit 2024-09-21T03:52:22.327527+0000 mon.a (mon.0) 11768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:23 smithi179 bash[23186]: audit 2024-09-21T03:52:22.637152+0000 mon.a (mon.0) 11769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:23 smithi179 bash[23186]: audit 2024-09-21T03:52:22.645306+0000 mon.a (mon.0) 11770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:23 smithi179 bash[23186]: audit 2024-09-21T03:52:22.655378+0000 mon.a (mon.0) 11771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:23 smithi044 bash[22676]: audit 2024-09-21T03:52:22.307802+0000 mon.a (mon.0) 11766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:23 smithi044 bash[22676]: audit 2024-09-21T03:52:22.316414+0000 mon.a (mon.0) 11767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:23 smithi044 bash[22676]: audit 2024-09-21T03:52:22.327527+0000 mon.a (mon.0) 11768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:23 smithi044 bash[22676]: audit 2024-09-21T03:52:22.637152+0000 mon.a (mon.0) 11769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:23 smithi044 bash[22676]: audit 2024-09-21T03:52:22.645306+0000 mon.a (mon.0) 11770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:23 smithi044 bash[22676]: audit 2024-09-21T03:52:22.655378+0000 mon.a (mon.0) 11771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:23 smithi049 bash[23528]: audit 2024-09-21T03:52:22.307802+0000 mon.a (mon.0) 11766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:23 smithi049 bash[23528]: audit 2024-09-21T03:52:22.316414+0000 mon.a (mon.0) 11767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:23 smithi049 bash[23528]: audit 2024-09-21T03:52:22.327527+0000 mon.a (mon.0) 11768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:23 smithi049 bash[23528]: audit 2024-09-21T03:52:22.637152+0000 mon.a (mon.0) 11769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:23 smithi049 bash[23528]: audit 2024-09-21T03:52:22.645306+0000 mon.a (mon.0) 11770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:23 smithi049 bash[23528]: audit 2024-09-21T03:52:22.655378+0000 mon.a (mon.0) 11771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:24.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:24 smithi179 bash[23186]: cluster 2024-09-21T03:52:22.714668+0000 mgr.a (mgr.14388) 14628 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:24 smithi044 bash[22676]: cluster 2024-09-21T03:52:22.714668+0000 mgr.a (mgr.14388) 14628 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:24.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:24 smithi049 bash[23528]: cluster 2024-09-21T03:52:22.714668+0000 mgr.a (mgr.14388) 14628 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:26.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:26.269 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:26.270 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:26.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:26 smithi049 bash[23528]: cluster 2024-09-21T03:52:24.715466+0000 mgr.a (mgr.14388) 14629 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:26 smithi044 bash[22676]: cluster 2024-09-21T03:52:24.715466+0000 mgr.a (mgr.14388) 14629 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:26 smithi179 bash[23186]: cluster 2024-09-21T03:52:24.715466+0000 mgr.a (mgr.14388) 14629 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:52:27.057 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:27.664 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:27 smithi049 bash[23528]: audit 2024-09-21T03:52:26.604648+0000 mgr.a (mgr.14388) 14630 : audit [DBG] from='client.317274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:27 smithi044 bash[22676]: audit 2024-09-21T03:52:26.604648+0000 mgr.a (mgr.14388) 14630 : audit [DBG] from='client.317274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:27 smithi179 bash[23186]: audit 2024-09-21T03:52:26.604648+0000 mgr.a (mgr.14388) 14630 : audit [DBG] from='client.317274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:28 smithi044 bash[22676]: cluster 2024-09-21T03:52:26.716881+0000 mgr.a (mgr.14388) 14631 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:28 smithi179 bash[23186]: cluster 2024-09-21T03:52:26.716881+0000 mgr.a (mgr.14388) 14631 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:28.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:28 smithi049 bash[23528]: cluster 2024-09-21T03:52:26.716881+0000 mgr.a (mgr.14388) 14631 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:30 smithi044 bash[22676]: cluster 2024-09-21T03:52:28.717807+0000 mgr.a (mgr.14388) 14632 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:30 smithi179 bash[23186]: cluster 2024-09-21T03:52:28.717807+0000 mgr.a (mgr.14388) 14632 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:30.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:30 smithi049 bash[23528]: cluster 2024-09-21T03:52:28.717807+0000 mgr.a (mgr.14388) 14632 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:32.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:32.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:32.059 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:32 smithi044 bash[22676]: cluster 2024-09-21T03:52:30.720084+0000 mgr.a (mgr.14388) 14633 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:32 smithi044 bash[22676]: audit 2024-09-21T03:52:31.197346+0000 mon.a (mon.0) 11772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:32 smithi044 bash[22676]: audit 2024-09-21T03:52:31.206190+0000 mon.a (mon.0) 11773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:32 smithi044 bash[22676]: audit 2024-09-21T03:52:31.216879+0000 mon.a (mon.0) 11774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:32 smithi179 bash[23186]: cluster 2024-09-21T03:52:30.720084+0000 mgr.a (mgr.14388) 14633 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:32.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:32 smithi179 bash[23186]: audit 2024-09-21T03:52:31.197346+0000 mon.a (mon.0) 11772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:32 smithi179 bash[23186]: audit 2024-09-21T03:52:31.206190+0000 mon.a (mon.0) 11773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:32 smithi179 bash[23186]: audit 2024-09-21T03:52:31.216879+0000 mon.a (mon.0) 11774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:32 smithi049 bash[23528]: cluster 2024-09-21T03:52:30.720084+0000 mgr.a (mgr.14388) 14633 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:32.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:32 smithi049 bash[23528]: audit 2024-09-21T03:52:31.197346+0000 mon.a (mon.0) 11772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:32 smithi049 bash[23528]: audit 2024-09-21T03:52:31.206190+0000 mon.a (mon.0) 11773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:32 smithi049 bash[23528]: audit 2024-09-21T03:52:31.216879+0000 mon.a (mon.0) 11774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:32.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:33 smithi044 bash[22676]: audit 2024-09-21T03:52:32.399507+0000 mgr.a (mgr.14388) 14634 : audit [DBG] from='client.317352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:33 smithi179 bash[23186]: audit 2024-09-21T03:52:32.399507+0000 mgr.a (mgr.14388) 14634 : audit [DBG] from='client.317352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:33.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:33 smithi049 bash[23528]: audit 2024-09-21T03:52:32.399507+0000 mgr.a (mgr.14388) 14634 : audit [DBG] from='client.317352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:34.462 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:34 smithi044 bash[22676]: cluster 2024-09-21T03:52:32.720638+0000 mgr.a (mgr.14388) 14635 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:34 smithi179 bash[23186]: cluster 2024-09-21T03:52:32.720638+0000 mgr.a (mgr.14388) 14635 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:34.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:34 smithi049 bash[23528]: cluster 2024-09-21T03:52:32.720638+0000 mgr.a (mgr.14388) 14635 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:36.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:36 smithi044 bash[22676]: cluster 2024-09-21T03:52:34.721534+0000 mgr.a (mgr.14388) 14636 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:36 smithi179 bash[23186]: cluster 2024-09-21T03:52:34.721534+0000 mgr.a (mgr.14388) 14636 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:36.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:36 smithi049 bash[23528]: cluster 2024-09-21T03:52:34.721534+0000 mgr.a (mgr.14388) 14636 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:37.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:37.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:37.858 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:38.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:38 smithi044 bash[22676]: cluster 2024-09-21T03:52:36.723839+0000 mgr.a (mgr.14388) 14637 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:38.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:38 smithi179 bash[23186]: cluster 2024-09-21T03:52:36.723839+0000 mgr.a (mgr.14388) 14637 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:38.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:38 smithi049 bash[23528]: cluster 2024-09-21T03:52:36.723839+0000 mgr.a (mgr.14388) 14637 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:52:38.620 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:38.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:38.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:38.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:38.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:39 smithi044 bash[22676]: audit 2024-09-21T03:52:38.190665+0000 mgr.a (mgr.14388) 14638 : audit [DBG] from='client.317430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:39 smithi179 bash[23186]: audit 2024-09-21T03:52:38.190665+0000 mgr.a (mgr.14388) 14638 : audit [DBG] from='client.317430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:39.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:39 smithi049 bash[23528]: audit 2024-09-21T03:52:38.190665+0000 mgr.a (mgr.14388) 14638 : audit [DBG] from='client.317430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:40 smithi044 bash[22676]: cluster 2024-09-21T03:52:38.724937+0000 mgr.a (mgr.14388) 14639 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:40 smithi179 bash[23186]: cluster 2024-09-21T03:52:38.724937+0000 mgr.a (mgr.14388) 14639 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:40.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:40 smithi049 bash[23528]: cluster 2024-09-21T03:52:38.724937+0000 mgr.a (mgr.14388) 14639 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:42.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:42 smithi044 bash[22676]: cluster 2024-09-21T03:52:40.727380+0000 mgr.a (mgr.14388) 14640 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:42.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:42 smithi179 bash[23186]: cluster 2024-09-21T03:52:40.727380+0000 mgr.a (mgr.14388) 14640 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:42.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:42 smithi049 bash[23528]: cluster 2024-09-21T03:52:40.727380+0000 mgr.a (mgr.14388) 14640 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:43.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:43.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:43.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:43 smithi179 bash[23186]: audit 2024-09-21T03:52:42.527207+0000 mon.a (mon.0) 11775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:43 smithi179 bash[23186]: audit 2024-09-21T03:52:42.535773+0000 mon.a (mon.0) 11776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:43 smithi179 bash[23186]: audit 2024-09-21T03:52:42.546084+0000 mon.a (mon.0) 11777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:43 smithi179 bash[23186]: audit 2024-09-21T03:52:42.841505+0000 mon.a (mon.0) 11778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:43 smithi179 bash[23186]: audit 2024-09-21T03:52:42.850172+0000 mon.a (mon.0) 11779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:43 smithi179 bash[23186]: audit 2024-09-21T03:52:42.861458+0000 mon.a (mon.0) 11780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:43 smithi049 bash[23528]: audit 2024-09-21T03:52:42.527207+0000 mon.a (mon.0) 11775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:43 smithi049 bash[23528]: audit 2024-09-21T03:52:42.535773+0000 mon.a (mon.0) 11776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:43 smithi049 bash[23528]: audit 2024-09-21T03:52:42.546084+0000 mon.a (mon.0) 11777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:43 smithi049 bash[23528]: audit 2024-09-21T03:52:42.841505+0000 mon.a (mon.0) 11778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:43 smithi049 bash[23528]: audit 2024-09-21T03:52:42.850172+0000 mon.a (mon.0) 11779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:43 smithi049 bash[23528]: audit 2024-09-21T03:52:42.861458+0000 mon.a (mon.0) 11780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:43 smithi044 bash[22676]: audit 2024-09-21T03:52:42.527207+0000 mon.a (mon.0) 11775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:43 smithi044 bash[22676]: audit 2024-09-21T03:52:42.535773+0000 mon.a (mon.0) 11776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:43 smithi044 bash[22676]: audit 2024-09-21T03:52:42.546084+0000 mon.a (mon.0) 11777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:43 smithi044 bash[22676]: audit 2024-09-21T03:52:42.841505+0000 mon.a (mon.0) 11778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:43 smithi044 bash[22676]: audit 2024-09-21T03:52:42.850172+0000 mon.a (mon.0) 11779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:43.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:43 smithi044 bash[22676]: audit 2024-09-21T03:52:42.861458+0000 mon.a (mon.0) 11780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:44.386 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:44.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:44.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:44.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:44.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:44 smithi179 bash[23186]: cluster 2024-09-21T03:52:42.728348+0000 mgr.a (mgr.14388) 14641 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:44.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:44 smithi049 bash[23528]: cluster 2024-09-21T03:52:42.728348+0000 mgr.a (mgr.14388) 14641 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:44 smithi044 bash[22676]: cluster 2024-09-21T03:52:42.728348+0000 mgr.a (mgr.14388) 14641 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:45 smithi044 bash[22676]: audit 2024-09-21T03:52:43.953570+0000 mgr.a (mgr.14388) 14642 : audit [DBG] from='client.317508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:45.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:45 smithi179 bash[23186]: audit 2024-09-21T03:52:43.953570+0000 mgr.a (mgr.14388) 14642 : audit [DBG] from='client.317508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:46.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:45 smithi049 bash[23528]: audit 2024-09-21T03:52:43.953570+0000 mgr.a (mgr.14388) 14642 : audit [DBG] from='client.317508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:46 smithi044 bash[22676]: cluster 2024-09-21T03:52:44.729394+0000 mgr.a (mgr.14388) 14643 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:46 smithi179 bash[23186]: cluster 2024-09-21T03:52:44.729394+0000 mgr.a (mgr.14388) 14643 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:47.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:46 smithi049 bash[23528]: cluster 2024-09-21T03:52:44.729394+0000 mgr.a (mgr.14388) 14643 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:48 smithi044 bash[22676]: cluster 2024-09-21T03:52:46.731645+0000 mgr.a (mgr.14388) 14644 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:48 smithi179 bash[23186]: cluster 2024-09-21T03:52:46.731645+0000 mgr.a (mgr.14388) 14644 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:48 smithi049 bash[23528]: cluster 2024-09-21T03:52:46.731645+0000 mgr.a (mgr.14388) 14644 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:52:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:49.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:49.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:50.153 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:50.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:50 smithi049 bash[23528]: cluster 2024-09-21T03:52:48.732544+0000 mgr.a (mgr.14388) 14645 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:50.904 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:50 smithi179 bash[23186]: cluster 2024-09-21T03:52:48.732544+0000 mgr.a (mgr.14388) 14645 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:50 smithi044 bash[22676]: cluster 2024-09-21T03:52:48.732544+0000 mgr.a (mgr.14388) 14645 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:51 smithi049 bash[23528]: audit 2024-09-21T03:52:49.721016+0000 mgr.a (mgr.14388) 14646 : audit [DBG] from='client.317580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:51 smithi049 bash[23528]: audit 2024-09-21T03:52:51.399762+0000 mon.a (mon.0) 11781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:51 smithi049 bash[23528]: audit 2024-09-21T03:52:51.408516+0000 mon.a (mon.0) 11782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:51.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:51 smithi049 bash[23528]: audit 2024-09-21T03:52:51.419051+0000 mon.a (mon.0) 11783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:51 smithi044 bash[22676]: audit 2024-09-21T03:52:49.721016+0000 mgr.a (mgr.14388) 14646 : audit [DBG] from='client.317580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:51 smithi044 bash[22676]: audit 2024-09-21T03:52:51.399762+0000 mon.a (mon.0) 11781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:51 smithi044 bash[22676]: audit 2024-09-21T03:52:51.408516+0000 mon.a (mon.0) 11782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:51 smithi044 bash[22676]: audit 2024-09-21T03:52:51.419051+0000 mon.a (mon.0) 11783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:51 smithi179 bash[23186]: audit 2024-09-21T03:52:49.721016+0000 mgr.a (mgr.14388) 14646 : audit [DBG] from='client.317580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:51 smithi179 bash[23186]: audit 2024-09-21T03:52:51.399762+0000 mon.a (mon.0) 11781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:51 smithi179 bash[23186]: audit 2024-09-21T03:52:51.408516+0000 mon.a (mon.0) 11782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:51 smithi179 bash[23186]: audit 2024-09-21T03:52:51.419051+0000 mon.a (mon.0) 11783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:52:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:52 smithi044 bash[22676]: cluster 2024-09-21T03:52:50.735559+0000 mgr.a (mgr.14388) 14647 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:52:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:52 smithi179 bash[23186]: cluster 2024-09-21T03:52:50.735559+0000 mgr.a (mgr.14388) 14647 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:52:53.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:52 smithi049 bash[23528]: cluster 2024-09-21T03:52:50.735559+0000 mgr.a (mgr.14388) 14647 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T03:52:54.858 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:54 smithi044 bash[22676]: cluster 2024-09-21T03:52:52.736420+0000 mgr.a (mgr.14388) 14648 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:52:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:54 smithi179 bash[23186]: cluster 2024-09-21T03:52:52.736420+0000 mgr.a (mgr.14388) 14648 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:52:55.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:54 smithi049 bash[23528]: cluster 2024-09-21T03:52:52.736420+0000 mgr.a (mgr.14388) 14648 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:52:55.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:52:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:52:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:52:55.962 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:52:55.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:52:55.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:52:55.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:52:55.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:52:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:56 smithi044 bash[22676]: cluster 2024-09-21T03:52:54.737390+0000 mgr.a (mgr.14388) 14649 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:52:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:56 smithi044 bash[22676]: audit 2024-09-21T03:52:55.495252+0000 mgr.a (mgr.14388) 14650 : audit [DBG] from='client.317655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:56 smithi179 bash[23186]: cluster 2024-09-21T03:52:54.737390+0000 mgr.a (mgr.14388) 14649 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:52:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:56 smithi179 bash[23186]: audit 2024-09-21T03:52:55.495252+0000 mgr.a (mgr.14388) 14650 : audit [DBG] from='client.317655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:56 smithi049 bash[23528]: cluster 2024-09-21T03:52:54.737390+0000 mgr.a (mgr.14388) 14649 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T03:52:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:56 smithi049 bash[23528]: audit 2024-09-21T03:52:55.495252+0000 mgr.a (mgr.14388) 14650 : audit [DBG] from='client.317655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:52:58 smithi044 bash[22676]: cluster 2024-09-21T03:52:56.740259+0000 mgr.a (mgr.14388) 14651 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:52:58 smithi179 bash[23186]: cluster 2024-09-21T03:52:56.740259+0000 mgr.a (mgr.14388) 14651 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:52:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:52:58 smithi049 bash[23528]: cluster 2024-09-21T03:52:56.740259+0000 mgr.a (mgr.14388) 14651 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:00.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:00.965 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:00.965 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:00 smithi044 bash[22676]: cluster 2024-09-21T03:52:58.741055+0000 mgr.a (mgr.14388) 14652 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:53:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:00 smithi179 bash[23186]: cluster 2024-09-21T03:52:58.741055+0000 mgr.a (mgr.14388) 14652 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:53:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:00 smithi049 bash[23528]: cluster 2024-09-21T03:52:58.741055+0000 mgr.a (mgr.14388) 14652 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:53:01.757 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:01.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:01.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:01.758 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:02 smithi044 bash[22676]: cluster 2024-09-21T03:53:00.743084+0000 mgr.a (mgr.14388) 14653 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:02 smithi044 bash[22676]: audit 2024-09-21T03:53:01.302219+0000 mgr.a (mgr.14388) 14654 : audit [DBG] from='client.317733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:02 smithi179 bash[23186]: cluster 2024-09-21T03:53:00.743084+0000 mgr.a (mgr.14388) 14653 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:02 smithi179 bash[23186]: audit 2024-09-21T03:53:01.302219+0000 mgr.a (mgr.14388) 14654 : audit [DBG] from='client.317733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:02 smithi049 bash[23528]: cluster 2024-09-21T03:53:00.743084+0000 mgr.a (mgr.14388) 14653 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:02 smithi049 bash[23528]: audit 2024-09-21T03:53:01.302219+0000 mgr.a (mgr.14388) 14654 : audit [DBG] from='client.317733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:04.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:03 smithi179 bash[23186]: cluster 2024-09-21T03:53:02.743941+0000 mgr.a (mgr.14388) 14655 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:53:04.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:03 smithi179 bash[23186]: audit 2024-09-21T03:53:02.762933+0000 mon.a (mon.0) 11784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:03 smithi179 bash[23186]: audit 2024-09-21T03:53:02.771634+0000 mon.a (mon.0) 11785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:03 smithi179 bash[23186]: audit 2024-09-21T03:53:02.782086+0000 mon.a (mon.0) 11786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:03 smithi179 bash[23186]: audit 2024-09-21T03:53:03.069478+0000 mon.a (mon.0) 11787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:03 smithi179 bash[23186]: audit 2024-09-21T03:53:03.077618+0000 mon.a (mon.0) 11788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:03 smithi179 bash[23186]: audit 2024-09-21T03:53:03.089537+0000 mon.a (mon.0) 11789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:03 smithi049 bash[23528]: cluster 2024-09-21T03:53:02.743941+0000 mgr.a (mgr.14388) 14655 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:53:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:03 smithi049 bash[23528]: audit 2024-09-21T03:53:02.762933+0000 mon.a (mon.0) 11784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:03 smithi049 bash[23528]: audit 2024-09-21T03:53:02.771634+0000 mon.a (mon.0) 11785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:03 smithi049 bash[23528]: audit 2024-09-21T03:53:02.782086+0000 mon.a (mon.0) 11786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:03 smithi049 bash[23528]: audit 2024-09-21T03:53:03.069478+0000 mon.a (mon.0) 11787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:03 smithi049 bash[23528]: audit 2024-09-21T03:53:03.077618+0000 mon.a (mon.0) 11788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:03 smithi049 bash[23528]: audit 2024-09-21T03:53:03.089537+0000 mon.a (mon.0) 11789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:03 smithi044 bash[22676]: cluster 2024-09-21T03:53:02.743941+0000 mgr.a (mgr.14388) 14655 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:53:04.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:03 smithi044 bash[22676]: audit 2024-09-21T03:53:02.762933+0000 mon.a (mon.0) 11784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:03 smithi044 bash[22676]: audit 2024-09-21T03:53:02.771634+0000 mon.a (mon.0) 11785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:03 smithi044 bash[22676]: audit 2024-09-21T03:53:02.782086+0000 mon.a (mon.0) 11786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:03 smithi044 bash[22676]: audit 2024-09-21T03:53:03.069478+0000 mon.a (mon.0) 11787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:03 smithi044 bash[22676]: audit 2024-09-21T03:53:03.077618+0000 mon.a (mon.0) 11788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:03 smithi044 bash[22676]: audit 2024-09-21T03:53:03.089537+0000 mon.a (mon.0) 11789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:05 smithi179 bash[23186]: cluster 2024-09-21T03:53:04.744731+0000 mgr.a (mgr.14388) 14656 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:53:06.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:05 smithi049 bash[23528]: cluster 2024-09-21T03:53:04.744731+0000 mgr.a (mgr.14388) 14656 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:53:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:05 smithi044 bash[22676]: cluster 2024-09-21T03:53:04.744731+0000 mgr.a (mgr.14388) 14656 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T03:53:06.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:06.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:06.760 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:07.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:07.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:07.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:07.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:07.508 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:08.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:07 smithi049 bash[23528]: cluster 2024-09-21T03:53:06.746949+0000 mgr.a (mgr.14388) 14657 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:53:08.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:07 smithi049 bash[23528]: audit 2024-09-21T03:53:07.085713+0000 mgr.a (mgr.14388) 14658 : audit [DBG] from='client.317811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:08.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:07 smithi044 bash[22676]: cluster 2024-09-21T03:53:06.746949+0000 mgr.a (mgr.14388) 14657 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:53:08.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:07 smithi044 bash[22676]: audit 2024-09-21T03:53:07.085713+0000 mgr.a (mgr.14388) 14658 : audit [DBG] from='client.317811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:07 smithi179 bash[23186]: cluster 2024-09-21T03:53:06.746949+0000 mgr.a (mgr.14388) 14657 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T03:53:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:07 smithi179 bash[23186]: audit 2024-09-21T03:53:07.085713+0000 mgr.a (mgr.14388) 14658 : audit [DBG] from='client.317811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:10.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:09 smithi049 bash[23528]: cluster 2024-09-21T03:53:08.747872+0000 mgr.a (mgr.14388) 14659 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:09 smithi044 bash[22676]: cluster 2024-09-21T03:53:08.747872+0000 mgr.a (mgr.14388) 14659 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:10.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:09 smithi179 bash[23186]: cluster 2024-09-21T03:53:08.747872+0000 mgr.a (mgr.14388) 14659 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:12.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:12.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:12.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:12 smithi044 bash[22676]: cluster 2024-09-21T03:53:10.750133+0000 mgr.a (mgr.14388) 14660 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:12 smithi044 bash[22676]: audit 2024-09-21T03:53:11.610524+0000 mon.a (mon.0) 11790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:12 smithi044 bash[22676]: audit 2024-09-21T03:53:11.619171+0000 mon.a (mon.0) 11791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:12 smithi044 bash[22676]: audit 2024-09-21T03:53:11.629590+0000 mon.a (mon.0) 11792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:12 smithi179 bash[23186]: cluster 2024-09-21T03:53:10.750133+0000 mgr.a (mgr.14388) 14660 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:12 smithi179 bash[23186]: audit 2024-09-21T03:53:11.610524+0000 mon.a (mon.0) 11790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:12 smithi179 bash[23186]: audit 2024-09-21T03:53:11.619171+0000 mon.a (mon.0) 11791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:12 smithi179 bash[23186]: audit 2024-09-21T03:53:11.629590+0000 mon.a (mon.0) 11792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:12 smithi049 bash[23528]: cluster 2024-09-21T03:53:10.750133+0000 mgr.a (mgr.14388) 14660 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:12 smithi049 bash[23528]: audit 2024-09-21T03:53:11.610524+0000 mon.a (mon.0) 11790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:12 smithi049 bash[23528]: audit 2024-09-21T03:53:11.619171+0000 mon.a (mon.0) 11791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:12 smithi049 bash[23528]: audit 2024-09-21T03:53:11.629590+0000 mon.a (mon.0) 11792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:14.902 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:14 smithi044 bash[22676]: cluster 2024-09-21T03:53:12.750880+0000 mgr.a (mgr.14388) 14661 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:14.903 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:14 smithi044 bash[22676]: audit 2024-09-21T03:53:12.850529+0000 mgr.a (mgr.14388) 14662 : audit [DBG] from='client.317889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:14 smithi179 bash[23186]: cluster 2024-09-21T03:53:12.750880+0000 mgr.a (mgr.14388) 14661 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:14 smithi179 bash[23186]: audit 2024-09-21T03:53:12.850529+0000 mgr.a (mgr.14388) 14662 : audit [DBG] from='client.317889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:15.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:14 smithi049 bash[23528]: cluster 2024-09-21T03:53:12.750880+0000 mgr.a (mgr.14388) 14661 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:15.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:14 smithi049 bash[23528]: audit 2024-09-21T03:53:12.850529+0000 mgr.a (mgr.14388) 14662 : audit [DBG] from='client.317889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:16 smithi044 bash[22676]: cluster 2024-09-21T03:53:14.751694+0000 mgr.a (mgr.14388) 14663 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:16 smithi179 bash[23186]: cluster 2024-09-21T03:53:14.751694+0000 mgr.a (mgr.14388) 14663 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:17.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:16 smithi049 bash[23528]: cluster 2024-09-21T03:53:14.751694+0000 mgr.a (mgr.14388) 14663 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:18 smithi044 bash[22676]: cluster 2024-09-21T03:53:16.753907+0000 mgr.a (mgr.14388) 14664 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:18 smithi179 bash[23186]: cluster 2024-09-21T03:53:16.753907+0000 mgr.a (mgr.14388) 14664 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:18 smithi049 bash[23528]: cluster 2024-09-21T03:53:16.753907+0000 mgr.a (mgr.14388) 14664 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:19.054 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:19.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:19.054 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:19.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:19.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:19.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:19 smithi044 bash[22676]: audit 2024-09-21T03:53:18.630007+0000 mgr.a (mgr.14388) 14665 : audit [DBG] from='client.317964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:19 smithi179 bash[23186]: audit 2024-09-21T03:53:18.630007+0000 mgr.a (mgr.14388) 14665 : audit [DBG] from='client.317964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:20.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:19 smithi049 bash[23528]: audit 2024-09-21T03:53:18.630007+0000 mgr.a (mgr.14388) 14665 : audit [DBG] from='client.317964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:20 smithi044 bash[22676]: cluster 2024-09-21T03:53:18.754408+0000 mgr.a (mgr.14388) 14666 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:20 smithi179 bash[23186]: cluster 2024-09-21T03:53:18.754408+0000 mgr.a (mgr.14388) 14666 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:21.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:20 smithi049 bash[23528]: cluster 2024-09-21T03:53:18.754408+0000 mgr.a (mgr.14388) 14666 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:21.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:53:21 smithi044 bash[22930]: debug 2024-09-21T03:53:21.733+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:53:21.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:53:21 smithi044 bash[22930]: debug 2024-09-21T03:53:21.737+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:53:21.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:21 smithi044 bash[22676]: audit 2024-09-21T03:53:20.931212+0000 mon.a (mon.0) 11793 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:53:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:21 smithi044 bash[22676]: audit 2024-09-21T03:53:20.938219+0000 mon.a (mon.0) 11794 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:53:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:21 smithi044 bash[22676]: audit 2024-09-21T03:53:20.940180+0000 mon.a (mon.0) 11795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:53:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:21 smithi044 bash[22676]: audit 2024-09-21T03:53:20.951493+0000 mon.a (mon.0) 11796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:21 smithi044 bash[22676]: audit 2024-09-21T03:53:20.957920+0000 mon.a (mon.0) 11797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:53:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:21 smithi179 bash[23186]: audit 2024-09-21T03:53:20.931212+0000 mon.a (mon.0) 11793 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:53:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:21 smithi179 bash[23186]: audit 2024-09-21T03:53:20.938219+0000 mon.a (mon.0) 11794 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:53:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:21 smithi179 bash[23186]: audit 2024-09-21T03:53:20.940180+0000 mon.a (mon.0) 11795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:53:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:21 smithi179 bash[23186]: audit 2024-09-21T03:53:20.951493+0000 mon.a (mon.0) 11796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:21 smithi179 bash[23186]: audit 2024-09-21T03:53:20.957920+0000 mon.a (mon.0) 11797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:53:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:21 smithi049 bash[23528]: audit 2024-09-21T03:53:20.931212+0000 mon.a (mon.0) 11793 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:53:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:21 smithi049 bash[23528]: audit 2024-09-21T03:53:20.938219+0000 mon.a (mon.0) 11794 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:53:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:21 smithi049 bash[23528]: audit 2024-09-21T03:53:20.940180+0000 mon.a (mon.0) 11795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:53:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:21 smithi049 bash[23528]: audit 2024-09-21T03:53:20.951493+0000 mon.a (mon.0) 11796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:21 smithi049 bash[23528]: audit 2024-09-21T03:53:20.957920+0000 mon.a (mon.0) 11797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:53:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:22 smithi044 bash[22676]: cluster 2024-09-21T03:53:20.756698+0000 mgr.a (mgr.14388) 14667 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:22 smithi044 bash[22676]: audit 2024-09-21T03:53:20.960309+0000 mgr.a (mgr.14388) 14668 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:53:22.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:22 smithi179 bash[23186]: cluster 2024-09-21T03:53:20.756698+0000 mgr.a (mgr.14388) 14667 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:22.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:22 smithi179 bash[23186]: audit 2024-09-21T03:53:20.960309+0000 mgr.a (mgr.14388) 14668 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:53:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:22 smithi049 bash[23528]: cluster 2024-09-21T03:53:20.756698+0000 mgr.a (mgr.14388) 14667 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:22 smithi049 bash[23528]: audit 2024-09-21T03:53:20.960309+0000 mgr.a (mgr.14388) 14668 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:53:23.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: audit 2024-09-21T03:53:21.736867+0000 mgr.a (mgr.14388) 14669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:53:23.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: cephadm 2024-09-21T03:53:21.738272+0000 mgr.a (mgr.14388) 14670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:53:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: audit 2024-09-21T03:53:22.975001+0000 mon.a (mon.0) 11798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: audit 2024-09-21T03:53:22.983509+0000 mon.a (mon.0) 11799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: audit 2024-09-21T03:53:22.994170+0000 mon.a (mon.0) 11800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: audit 2024-09-21T03:53:23.273385+0000 mon.a (mon.0) 11801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: audit 2024-09-21T03:53:23.279131+0000 mon.a (mon.0) 11802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:23 smithi044 bash[22676]: audit 2024-09-21T03:53:23.287394+0000 mon.a (mon.0) 11803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: audit 2024-09-21T03:53:21.736867+0000 mgr.a (mgr.14388) 14669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:53:24.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: cephadm 2024-09-21T03:53:21.738272+0000 mgr.a (mgr.14388) 14670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:53:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: audit 2024-09-21T03:53:22.975001+0000 mon.a (mon.0) 11798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: audit 2024-09-21T03:53:22.983509+0000 mon.a (mon.0) 11799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: audit 2024-09-21T03:53:22.994170+0000 mon.a (mon.0) 11800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: audit 2024-09-21T03:53:23.273385+0000 mon.a (mon.0) 11801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: audit 2024-09-21T03:53:23.279131+0000 mon.a (mon.0) 11802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:23 smithi179 bash[23186]: audit 2024-09-21T03:53:23.287394+0000 mon.a (mon.0) 11803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: audit 2024-09-21T03:53:21.736867+0000 mgr.a (mgr.14388) 14669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: cephadm 2024-09-21T03:53:21.738272+0000 mgr.a (mgr.14388) 14670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: audit 2024-09-21T03:53:22.975001+0000 mon.a (mon.0) 11798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: audit 2024-09-21T03:53:22.983509+0000 mon.a (mon.0) 11799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: audit 2024-09-21T03:53:22.994170+0000 mon.a (mon.0) 11800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: audit 2024-09-21T03:53:23.273385+0000 mon.a (mon.0) 11801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: audit 2024-09-21T03:53:23.279131+0000 mon.a (mon.0) 11802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:23 smithi049 bash[23528]: audit 2024-09-21T03:53:23.287394+0000 mon.a (mon.0) 11803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:24.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:24.056 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:24.056 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:24.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:24.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:24.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:24.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:24.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:24 smithi044 bash[22676]: cluster 2024-09-21T03:53:22.757632+0000 mgr.a (mgr.14388) 14671 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:24 smithi044 bash[22676]: audit 2024-09-21T03:53:24.390449+0000 mgr.a (mgr.14388) 14672 : audit [DBG] from='client.318147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:24 smithi179 bash[23186]: cluster 2024-09-21T03:53:22.757632+0000 mgr.a (mgr.14388) 14671 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:24 smithi179 bash[23186]: audit 2024-09-21T03:53:24.390449+0000 mgr.a (mgr.14388) 14672 : audit [DBG] from='client.318147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:24 smithi049 bash[23528]: cluster 2024-09-21T03:53:22.757632+0000 mgr.a (mgr.14388) 14671 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:24 smithi049 bash[23528]: audit 2024-09-21T03:53:24.390449+0000 mgr.a (mgr.14388) 14672 : audit [DBG] from='client.318147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:25.977 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:25 smithi179 bash[23186]: cluster 2024-09-21T03:53:24.758180+0000 mgr.a (mgr.14388) 14673 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:25 smithi044 bash[22676]: cluster 2024-09-21T03:53:24.758180+0000 mgr.a (mgr.14388) 14673 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:26.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:25 smithi049 bash[23528]: cluster 2024-09-21T03:53:24.758180+0000 mgr.a (mgr.14388) 14673 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:27 smithi049 bash[23528]: cluster 2024-09-21T03:53:26.760383+0000 mgr.a (mgr.14388) 14674 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:28.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:27 smithi044 bash[22676]: cluster 2024-09-21T03:53:26.760383+0000 mgr.a (mgr.14388) 14674 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:28.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:27 smithi179 bash[23186]: cluster 2024-09-21T03:53:26.760383+0000 mgr.a (mgr.14388) 14674 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:29.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:29.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:29.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:30.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:29 smithi044 bash[22676]: cluster 2024-09-21T03:53:28.761134+0000 mgr.a (mgr.14388) 14675 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:30.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:29 smithi179 bash[23186]: cluster 2024-09-21T03:53:28.761134+0000 mgr.a (mgr.14388) 14675 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:30.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:29 smithi049 bash[23528]: cluster 2024-09-21T03:53:28.761134+0000 mgr.a (mgr.14388) 14675 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:30.583 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:31.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:30 smithi044 bash[22676]: audit 2024-09-21T03:53:30.163095+0000 mgr.a (mgr.14388) 14676 : audit [DBG] from='client.318222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:30 smithi179 bash[23186]: audit 2024-09-21T03:53:30.163095+0000 mgr.a (mgr.14388) 14676 : audit [DBG] from='client.318222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:31.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:30 smithi049 bash[23528]: audit 2024-09-21T03:53:30.163095+0000 mgr.a (mgr.14388) 14676 : audit [DBG] from='client.318222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:31 smithi044 bash[22676]: cluster 2024-09-21T03:53:30.763912+0000 mgr.a (mgr.14388) 14677 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:31 smithi044 bash[22676]: audit 2024-09-21T03:53:31.777602+0000 mon.a (mon.0) 11804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:31 smithi044 bash[22676]: audit 2024-09-21T03:53:31.783834+0000 mon.a (mon.0) 11805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:31 smithi044 bash[22676]: audit 2024-09-21T03:53:31.790144+0000 mon.a (mon.0) 11806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:31 smithi049 bash[23528]: cluster 2024-09-21T03:53:30.763912+0000 mgr.a (mgr.14388) 14677 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:32.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:31 smithi049 bash[23528]: audit 2024-09-21T03:53:31.777602+0000 mon.a (mon.0) 11804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:31 smithi049 bash[23528]: audit 2024-09-21T03:53:31.783834+0000 mon.a (mon.0) 11805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:31 smithi049 bash[23528]: audit 2024-09-21T03:53:31.790144+0000 mon.a (mon.0) 11806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:32.092 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:31 smithi179 bash[23186]: cluster 2024-09-21T03:53:30.763912+0000 mgr.a (mgr.14388) 14677 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:32.092 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:31 smithi179 bash[23186]: audit 2024-09-21T03:53:31.777602+0000 mon.a (mon.0) 11804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:32.092 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:31 smithi179 bash[23186]: audit 2024-09-21T03:53:31.783834+0000 mon.a (mon.0) 11805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:32.093 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:31 smithi179 bash[23186]: audit 2024-09-21T03:53:31.790144+0000 mon.a (mon.0) 11806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:34.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:33 smithi044 bash[22676]: cluster 2024-09-21T03:53:32.764705+0000 mgr.a (mgr.14388) 14678 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:53:34.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:33 smithi179 bash[23186]: cluster 2024-09-21T03:53:32.764705+0000 mgr.a (mgr.14388) 14678 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:53:34.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:33 smithi049 bash[23528]: cluster 2024-09-21T03:53:32.764705+0000 mgr.a (mgr.14388) 14678 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:53:35.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:35.585 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:35.586 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:35 smithi044 bash[22676]: cluster 2024-09-21T03:53:34.765453+0000 mgr.a (mgr.14388) 14679 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:53:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:35 smithi179 bash[23186]: cluster 2024-09-21T03:53:34.765453+0000 mgr.a (mgr.14388) 14679 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:53:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:35 smithi049 bash[23528]: cluster 2024-09-21T03:53:34.765453+0000 mgr.a (mgr.14388) 14679 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:53:36.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:36 smithi044 bash[22676]: audit 2024-09-21T03:53:35.923815+0000 mgr.a (mgr.14388) 14680 : audit [DBG] from='client.318300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:37.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:36 smithi179 bash[23186]: audit 2024-09-21T03:53:35.923815+0000 mgr.a (mgr.14388) 14680 : audit [DBG] from='client.318300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:37.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:36 smithi049 bash[23528]: audit 2024-09-21T03:53:35.923815+0000 mgr.a (mgr.14388) 14680 : audit [DBG] from='client.318300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:37.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:37 smithi044 bash[22676]: cluster 2024-09-21T03:53:36.768500+0000 mgr.a (mgr.14388) 14681 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:38.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:37 smithi179 bash[23186]: cluster 2024-09-21T03:53:36.768500+0000 mgr.a (mgr.14388) 14681 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:38.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:37 smithi049 bash[23528]: cluster 2024-09-21T03:53:36.768500+0000 mgr.a (mgr.14388) 14681 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:53:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:39 smithi044 bash[22676]: cluster 2024-09-21T03:53:38.769365+0000 mgr.a (mgr.14388) 14682 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:53:40.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:39 smithi179 bash[23186]: cluster 2024-09-21T03:53:38.769365+0000 mgr.a (mgr.14388) 14682 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:53:40.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:39 smithi049 bash[23528]: cluster 2024-09-21T03:53:38.769365+0000 mgr.a (mgr.14388) 14682 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:53:41.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:41.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:42.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:42.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:41 smithi044 bash[22676]: cluster 2024-09-21T03:53:40.771260+0000 mgr.a (mgr.14388) 14683 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:42.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:41 smithi179 bash[23186]: cluster 2024-09-21T03:53:40.771260+0000 mgr.a (mgr.14388) 14683 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:42.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:41 smithi049 bash[23528]: cluster 2024-09-21T03:53:40.771260+0000 mgr.a (mgr.14388) 14683 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:43.231 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:42 smithi179 bash[23186]: audit 2024-09-21T03:53:41.709339+0000 mgr.a (mgr.14388) 14684 : audit [DBG] from='client.318378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:43.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:42 smithi044 bash[22676]: audit 2024-09-21T03:53:41.709339+0000 mgr.a (mgr.14388) 14684 : audit [DBG] from='client.318378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:42 smithi049 bash[23528]: audit 2024-09-21T03:53:41.709339+0000 mgr.a (mgr.14388) 14684 : audit [DBG] from='client.318378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:44.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:44 smithi044 bash[22676]: cluster 2024-09-21T03:53:42.772158+0000 mgr.a (mgr.14388) 14685 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:44.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:44 smithi044 bash[22676]: audit 2024-09-21T03:53:43.208670+0000 mon.a (mon.0) 11807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:44 smithi044 bash[22676]: audit 2024-09-21T03:53:43.217110+0000 mon.a (mon.0) 11808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:44 smithi044 bash[22676]: audit 2024-09-21T03:53:43.227532+0000 mon.a (mon.0) 11809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:44 smithi044 bash[22676]: audit 2024-09-21T03:53:43.495567+0000 mon.a (mon.0) 11810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:44 smithi044 bash[22676]: audit 2024-09-21T03:53:43.503731+0000 mon.a (mon.0) 11811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:44 smithi044 bash[22676]: audit 2024-09-21T03:53:43.513987+0000 mon.a (mon.0) 11812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:44 smithi179 bash[23186]: cluster 2024-09-21T03:53:42.772158+0000 mgr.a (mgr.14388) 14685 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:44 smithi179 bash[23186]: audit 2024-09-21T03:53:43.208670+0000 mon.a (mon.0) 11807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:44 smithi179 bash[23186]: audit 2024-09-21T03:53:43.217110+0000 mon.a (mon.0) 11808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:44 smithi179 bash[23186]: audit 2024-09-21T03:53:43.227532+0000 mon.a (mon.0) 11809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:44 smithi179 bash[23186]: audit 2024-09-21T03:53:43.495567+0000 mon.a (mon.0) 11810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:44 smithi179 bash[23186]: audit 2024-09-21T03:53:43.503731+0000 mon.a (mon.0) 11811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:44 smithi179 bash[23186]: audit 2024-09-21T03:53:43.513987+0000 mon.a (mon.0) 11812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:44 smithi049 bash[23528]: cluster 2024-09-21T03:53:42.772158+0000 mgr.a (mgr.14388) 14685 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:44 smithi049 bash[23528]: audit 2024-09-21T03:53:43.208670+0000 mon.a (mon.0) 11807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:44 smithi049 bash[23528]: audit 2024-09-21T03:53:43.217110+0000 mon.a (mon.0) 11808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:44 smithi049 bash[23528]: audit 2024-09-21T03:53:43.227532+0000 mon.a (mon.0) 11809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:44 smithi049 bash[23528]: audit 2024-09-21T03:53:43.495567+0000 mon.a (mon.0) 11810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:44 smithi049 bash[23528]: audit 2024-09-21T03:53:43.503731+0000 mon.a (mon.0) 11811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:44 smithi049 bash[23528]: audit 2024-09-21T03:53:43.513987+0000 mon.a (mon.0) 11812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:46 smithi179 bash[23186]: cluster 2024-09-21T03:53:44.772942+0000 mgr.a (mgr.14388) 14686 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:46 smithi044 bash[22676]: cluster 2024-09-21T03:53:44.772942+0000 mgr.a (mgr.14388) 14686 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:46.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:46 smithi049 bash[23528]: cluster 2024-09-21T03:53:44.772942+0000 mgr.a (mgr.14388) 14686 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:47.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:47.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:47.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:47.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:47.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:47.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:47.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:47.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:48.472 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:48 smithi049 bash[23528]: cluster 2024-09-21T03:53:46.775133+0000 mgr.a (mgr.14388) 14687 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:48.472 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:48 smithi049 bash[23528]: audit 2024-09-21T03:53:47.475210+0000 mgr.a (mgr.14388) 14688 : audit [DBG] from='client.318456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:48 smithi044 bash[22676]: cluster 2024-09-21T03:53:46.775133+0000 mgr.a (mgr.14388) 14687 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:48 smithi044 bash[22676]: audit 2024-09-21T03:53:47.475210+0000 mgr.a (mgr.14388) 14688 : audit [DBG] from='client.318456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:48 smithi179 bash[23186]: cluster 2024-09-21T03:53:46.775133+0000 mgr.a (mgr.14388) 14687 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:48 smithi179 bash[23186]: audit 2024-09-21T03:53:47.475210+0000 mgr.a (mgr.14388) 14688 : audit [DBG] from='client.318456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:50 smithi044 bash[22676]: cluster 2024-09-21T03:53:48.776013+0000 mgr.a (mgr.14388) 14689 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:50 smithi179 bash[23186]: cluster 2024-09-21T03:53:48.776013+0000 mgr.a (mgr.14388) 14689 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:50 smithi049 bash[23528]: cluster 2024-09-21T03:53:48.776013+0000 mgr.a (mgr.14388) 14689 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:52 smithi044 bash[22676]: cluster 2024-09-21T03:53:50.778189+0000 mgr.a (mgr.14388) 14690 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:52 smithi044 bash[22676]: audit 2024-09-21T03:53:51.933703+0000 mon.a (mon.0) 11813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:52 smithi044 bash[22676]: audit 2024-09-21T03:53:51.942312+0000 mon.a (mon.0) 11814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:52 smithi044 bash[22676]: audit 2024-09-21T03:53:51.952920+0000 mon.a (mon.0) 11815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:52 smithi179 bash[23186]: cluster 2024-09-21T03:53:50.778189+0000 mgr.a (mgr.14388) 14690 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:52 smithi179 bash[23186]: audit 2024-09-21T03:53:51.933703+0000 mon.a (mon.0) 11813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:52 smithi179 bash[23186]: audit 2024-09-21T03:53:51.942312+0000 mon.a (mon.0) 11814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:52 smithi179 bash[23186]: audit 2024-09-21T03:53:51.952920+0000 mon.a (mon.0) 11815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:52 smithi049 bash[23528]: cluster 2024-09-21T03:53:50.778189+0000 mgr.a (mgr.14388) 14690 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:52 smithi049 bash[23528]: audit 2024-09-21T03:53:51.933703+0000 mon.a (mon.0) 11813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:52 smithi049 bash[23528]: audit 2024-09-21T03:53:51.942312+0000 mon.a (mon.0) 11814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:52 smithi049 bash[23528]: audit 2024-09-21T03:53:51.952920+0000 mon.a (mon.0) 11815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:52.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:52.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:53.674 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:53.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:53.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:53.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:53.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:53:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:54 smithi044 bash[22676]: cluster 2024-09-21T03:53:52.778971+0000 mgr.a (mgr.14388) 14691 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:54 smithi044 bash[22676]: audit 2024-09-21T03:53:53.254770+0000 mgr.a (mgr.14388) 14692 : audit [DBG] from='client.318531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:54 smithi179 bash[23186]: cluster 2024-09-21T03:53:52.778971+0000 mgr.a (mgr.14388) 14691 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:54 smithi179 bash[23186]: audit 2024-09-21T03:53:53.254770+0000 mgr.a (mgr.14388) 14692 : audit [DBG] from='client.318531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:54 smithi049 bash[23528]: cluster 2024-09-21T03:53:52.778971+0000 mgr.a (mgr.14388) 14691 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:54 smithi049 bash[23528]: audit 2024-09-21T03:53:53.254770+0000 mgr.a (mgr.14388) 14692 : audit [DBG] from='client.318531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:56 smithi044 bash[22676]: cluster 2024-09-21T03:53:54.779872+0000 mgr.a (mgr.14388) 14693 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:56 smithi179 bash[23186]: cluster 2024-09-21T03:53:54.779872+0000 mgr.a (mgr.14388) 14693 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:56.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:56 smithi049 bash[23528]: cluster 2024-09-21T03:53:54.779872+0000 mgr.a (mgr.14388) 14693 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:53:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:53:58 smithi179 bash[23186]: cluster 2024-09-21T03:53:56.782164+0000 mgr.a (mgr.14388) 14694 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:58.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:53:58 smithi049 bash[23528]: cluster 2024-09-21T03:53:56.782164+0000 mgr.a (mgr.14388) 14694 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:58.676 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:53:58.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:53:58.677 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:53:58.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:53:58 smithi044 bash[22676]: cluster 2024-09-21T03:53:56.782164+0000 mgr.a (mgr.14388) 14694 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:53:59.453 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:53:59.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:53:59.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:53:59.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:53:59.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:00 smithi179 bash[23186]: cluster 2024-09-21T03:53:58.782579+0000 mgr.a (mgr.14388) 14695 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:00 smithi179 bash[23186]: audit 2024-09-21T03:53:59.003666+0000 mgr.a (mgr.14388) 14696 : audit [DBG] from='client.318609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:00 smithi049 bash[23528]: cluster 2024-09-21T03:53:58.782579+0000 mgr.a (mgr.14388) 14695 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:00.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:00 smithi049 bash[23528]: audit 2024-09-21T03:53:59.003666+0000 mgr.a (mgr.14388) 14696 : audit [DBG] from='client.318609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:00 smithi044 bash[22676]: cluster 2024-09-21T03:53:58.782579+0000 mgr.a (mgr.14388) 14695 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:00.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:00 smithi044 bash[22676]: audit 2024-09-21T03:53:59.003666+0000 mgr.a (mgr.14388) 14696 : audit [DBG] from='client.318609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:02 smithi179 bash[23186]: cluster 2024-09-21T03:54:00.784873+0000 mgr.a (mgr.14388) 14697 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:54:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:02 smithi049 bash[23528]: cluster 2024-09-21T03:54:00.784873+0000 mgr.a (mgr.14388) 14697 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:54:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:02 smithi044 bash[22676]: cluster 2024-09-21T03:54:00.784873+0000 mgr.a (mgr.14388) 14697 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:04 smithi044 bash[22676]: cluster 2024-09-21T03:54:02.785671+0000 mgr.a (mgr.14388) 14698 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:04 smithi044 bash[22676]: audit 2024-09-21T03:54:03.441076+0000 mon.a (mon.0) 11816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:04 smithi044 bash[22676]: audit 2024-09-21T03:54:03.449444+0000 mon.a (mon.0) 11817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:04 smithi044 bash[22676]: audit 2024-09-21T03:54:03.459824+0000 mon.a (mon.0) 11818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:04 smithi044 bash[22676]: audit 2024-09-21T03:54:03.719542+0000 mon.a (mon.0) 11819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:04 smithi044 bash[22676]: audit 2024-09-21T03:54:03.727857+0000 mon.a (mon.0) 11820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:04 smithi044 bash[22676]: audit 2024-09-21T03:54:03.738044+0000 mon.a (mon.0) 11821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:04 smithi179 bash[23186]: cluster 2024-09-21T03:54:02.785671+0000 mgr.a (mgr.14388) 14698 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:04 smithi179 bash[23186]: audit 2024-09-21T03:54:03.441076+0000 mon.a (mon.0) 11816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:04 smithi179 bash[23186]: audit 2024-09-21T03:54:03.449444+0000 mon.a (mon.0) 11817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:04 smithi179 bash[23186]: audit 2024-09-21T03:54:03.459824+0000 mon.a (mon.0) 11818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:04 smithi179 bash[23186]: audit 2024-09-21T03:54:03.719542+0000 mon.a (mon.0) 11819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:04 smithi179 bash[23186]: audit 2024-09-21T03:54:03.727857+0000 mon.a (mon.0) 11820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:04 smithi179 bash[23186]: audit 2024-09-21T03:54:03.738044+0000 mon.a (mon.0) 11821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:04 smithi049 bash[23528]: cluster 2024-09-21T03:54:02.785671+0000 mgr.a (mgr.14388) 14698 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:04 smithi049 bash[23528]: audit 2024-09-21T03:54:03.441076+0000 mon.a (mon.0) 11816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:04 smithi049 bash[23528]: audit 2024-09-21T03:54:03.449444+0000 mon.a (mon.0) 11817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:04 smithi049 bash[23528]: audit 2024-09-21T03:54:03.459824+0000 mon.a (mon.0) 11818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:04 smithi049 bash[23528]: audit 2024-09-21T03:54:03.719542+0000 mon.a (mon.0) 11819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:04 smithi049 bash[23528]: audit 2024-09-21T03:54:03.727857+0000 mon.a (mon.0) 11820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:04 smithi049 bash[23528]: audit 2024-09-21T03:54:03.738044+0000 mon.a (mon.0) 11821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:06 smithi044 bash[22676]: cluster 2024-09-21T03:54:04.786409+0000 mgr.a (mgr.14388) 14699 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:06 smithi044 bash[22676]: audit 2024-09-21T03:54:04.789182+0000 mgr.a (mgr.14388) 14700 : audit [DBG] from='client.318687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:06 smithi179 bash[23186]: cluster 2024-09-21T03:54:04.786409+0000 mgr.a (mgr.14388) 14699 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:06 smithi179 bash[23186]: audit 2024-09-21T03:54:04.789182+0000 mgr.a (mgr.14388) 14700 : audit [DBG] from='client.318687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:06 smithi049 bash[23528]: cluster 2024-09-21T03:54:04.786409+0000 mgr.a (mgr.14388) 14699 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:06 smithi049 bash[23528]: audit 2024-09-21T03:54:04.789182+0000 mgr.a (mgr.14388) 14700 : audit [DBG] from='client.318687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:08 smithi044 bash[22676]: cluster 2024-09-21T03:54:06.789373+0000 mgr.a (mgr.14388) 14701 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:54:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:08 smithi179 bash[23186]: cluster 2024-09-21T03:54:06.789373+0000 mgr.a (mgr.14388) 14701 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:54:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:08 smithi049 bash[23528]: cluster 2024-09-21T03:54:06.789373+0000 mgr.a (mgr.14388) 14701 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:54:10.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:10.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:10 smithi044 bash[22676]: cluster 2024-09-21T03:54:08.790194+0000 mgr.a (mgr.14388) 14702 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:54:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:10 smithi179 bash[23186]: cluster 2024-09-21T03:54:08.790194+0000 mgr.a (mgr.14388) 14702 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:54:10.782 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:10 smithi049 bash[23528]: cluster 2024-09-21T03:54:08.790194+0000 mgr.a (mgr.14388) 14702 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:54:11.000 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:11.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:11.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:11 smithi044 bash[22676]: audit 2024-09-21T03:54:10.568663+0000 mgr.a (mgr.14388) 14703 : audit [DBG] from='client.318762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:11.750 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:11 smithi049 bash[23528]: audit 2024-09-21T03:54:10.568663+0000 mgr.a (mgr.14388) 14703 : audit [DBG] from='client.318762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:11 smithi179 bash[23186]: audit 2024-09-21T03:54:10.568663+0000 mgr.a (mgr.14388) 14703 : audit [DBG] from='client.318762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:12 smithi044 bash[22676]: cluster 2024-09-21T03:54:10.798734+0000 mgr.a (mgr.14388) 14704 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:12 smithi044 bash[22676]: audit 2024-09-21T03:54:12.130013+0000 mon.a (mon.0) 11822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:12 smithi044 bash[22676]: audit 2024-09-21T03:54:12.138880+0000 mon.a (mon.0) 11823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:12 smithi044 bash[22676]: audit 2024-09-21T03:54:12.149299+0000 mon.a (mon.0) 11824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:12 smithi179 bash[23186]: cluster 2024-09-21T03:54:10.798734+0000 mgr.a (mgr.14388) 14704 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:12 smithi179 bash[23186]: audit 2024-09-21T03:54:12.130013+0000 mon.a (mon.0) 11822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:12 smithi179 bash[23186]: audit 2024-09-21T03:54:12.138880+0000 mon.a (mon.0) 11823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:12 smithi179 bash[23186]: audit 2024-09-21T03:54:12.149299+0000 mon.a (mon.0) 11824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:12 smithi049 bash[23528]: cluster 2024-09-21T03:54:10.798734+0000 mgr.a (mgr.14388) 14704 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:12 smithi049 bash[23528]: audit 2024-09-21T03:54:12.130013+0000 mon.a (mon.0) 11822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:12 smithi049 bash[23528]: audit 2024-09-21T03:54:12.138880+0000 mon.a (mon.0) 11823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:12 smithi049 bash[23528]: audit 2024-09-21T03:54:12.149299+0000 mon.a (mon.0) 11824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:14 smithi044 bash[22676]: cluster 2024-09-21T03:54:12.799818+0000 mgr.a (mgr.14388) 14705 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:14 smithi179 bash[23186]: cluster 2024-09-21T03:54:12.799818+0000 mgr.a (mgr.14388) 14705 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:14.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:14 smithi049 bash[23528]: cluster 2024-09-21T03:54:12.799818+0000 mgr.a (mgr.14388) 14705 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:16.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:16.003 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:16.003 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:16 smithi044 bash[22676]: cluster 2024-09-21T03:54:14.800798+0000 mgr.a (mgr.14388) 14706 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:16 smithi179 bash[23186]: cluster 2024-09-21T03:54:14.800798+0000 mgr.a (mgr.14388) 14706 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:16.791 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:16.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:16.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:16.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:16.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:16.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:16 smithi049 bash[23528]: cluster 2024-09-21T03:54:14.800798+0000 mgr.a (mgr.14388) 14706 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:17 smithi044 bash[22676]: audit 2024-09-21T03:54:16.338679+0000 mgr.a (mgr.14388) 14707 : audit [DBG] from='client.318840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:17 smithi179 bash[23186]: audit 2024-09-21T03:54:16.338679+0000 mgr.a (mgr.14388) 14707 : audit [DBG] from='client.318840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:17 smithi049 bash[23528]: audit 2024-09-21T03:54:16.338679+0000 mgr.a (mgr.14388) 14707 : audit [DBG] from='client.318840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:18 smithi044 bash[22676]: cluster 2024-09-21T03:54:16.802246+0000 mgr.a (mgr.14388) 14708 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:18 smithi179 bash[23186]: cluster 2024-09-21T03:54:16.802246+0000 mgr.a (mgr.14388) 14708 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:18 smithi049 bash[23528]: cluster 2024-09-21T03:54:16.802246+0000 mgr.a (mgr.14388) 14708 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:20 smithi044 bash[22676]: cluster 2024-09-21T03:54:18.803013+0000 mgr.a (mgr.14388) 14709 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:54:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:20 smithi179 bash[23186]: cluster 2024-09-21T03:54:18.803013+0000 mgr.a (mgr.14388) 14709 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:54:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:20 smithi049 bash[23528]: cluster 2024-09-21T03:54:18.803013+0000 mgr.a (mgr.14388) 14709 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:54:21.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:21.793 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:22 smithi179 bash[23186]: cluster 2024-09-21T03:54:20.805027+0000 mgr.a (mgr.14388) 14710 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:54:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:22 smithi179 bash[23186]: audit 2024-09-21T03:54:21.812104+0000 mon.a (mon.0) 11825 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:54:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:22 smithi179 bash[23186]: audit 2024-09-21T03:54:21.816985+0000 mon.a (mon.0) 11826 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:54:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:22 smithi179 bash[23186]: audit 2024-09-21T03:54:21.818377+0000 mon.a (mon.0) 11827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:54:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:22 smithi179 bash[23186]: audit 2024-09-21T03:54:21.829961+0000 mon.a (mon.0) 11828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:22 smithi179 bash[23186]: audit 2024-09-21T03:54:21.836407+0000 mon.a (mon.0) 11829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:54:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:22 smithi049 bash[23528]: cluster 2024-09-21T03:54:20.805027+0000 mgr.a (mgr.14388) 14710 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:54:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:22 smithi049 bash[23528]: audit 2024-09-21T03:54:21.812104+0000 mon.a (mon.0) 11825 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:54:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:22 smithi049 bash[23528]: audit 2024-09-21T03:54:21.816985+0000 mon.a (mon.0) 11826 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:54:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:22 smithi049 bash[23528]: audit 2024-09-21T03:54:21.818377+0000 mon.a (mon.0) 11827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:54:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:22 smithi049 bash[23528]: audit 2024-09-21T03:54:21.829961+0000 mon.a (mon.0) 11828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:22 smithi049 bash[23528]: audit 2024-09-21T03:54:21.836407+0000 mon.a (mon.0) 11829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:54:22.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22930]: debug 2024-09-21T03:54:22.620+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:54:22.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22930]: debug 2024-09-21T03:54:22.636+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:54:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22676]: cluster 2024-09-21T03:54:20.805027+0000 mgr.a (mgr.14388) 14710 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:54:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22676]: audit 2024-09-21T03:54:21.812104+0000 mon.a (mon.0) 11825 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:54:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22676]: audit 2024-09-21T03:54:21.816985+0000 mon.a (mon.0) 11826 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:54:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22676]: audit 2024-09-21T03:54:21.818377+0000 mon.a (mon.0) 11827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:54:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22676]: audit 2024-09-21T03:54:21.829961+0000 mon.a (mon.0) 11828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:22 smithi044 bash[22676]: audit 2024-09-21T03:54:21.836407+0000 mon.a (mon.0) 11829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:54:23.033 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:23 smithi179 bash[23186]: audit 2024-09-21T03:54:21.838811+0000 mgr.a (mgr.14388) 14711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:54:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:23 smithi179 bash[23186]: audit 2024-09-21T03:54:22.150057+0000 mgr.a (mgr.14388) 14712 : audit [DBG] from='client.318918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:23 smithi179 bash[23186]: audit 2024-09-21T03:54:22.621809+0000 mgr.a (mgr.14388) 14713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:54:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:23 smithi179 bash[23186]: cephadm 2024-09-21T03:54:22.639122+0000 mgr.a (mgr.14388) 14714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:54:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:23 smithi049 bash[23528]: audit 2024-09-21T03:54:21.838811+0000 mgr.a (mgr.14388) 14711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:54:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:23 smithi049 bash[23528]: audit 2024-09-21T03:54:22.150057+0000 mgr.a (mgr.14388) 14712 : audit [DBG] from='client.318918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:23 smithi049 bash[23528]: audit 2024-09-21T03:54:22.621809+0000 mgr.a (mgr.14388) 14713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:54:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:23 smithi049 bash[23528]: cephadm 2024-09-21T03:54:22.639122+0000 mgr.a (mgr.14388) 14714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:54:23.953 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:23 smithi044 bash[22676]: audit 2024-09-21T03:54:21.838811+0000 mgr.a (mgr.14388) 14711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:54:23.954 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:23 smithi044 bash[22676]: audit 2024-09-21T03:54:22.150057+0000 mgr.a (mgr.14388) 14712 : audit [DBG] from='client.318918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:23.954 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:23 smithi044 bash[22676]: audit 2024-09-21T03:54:22.621809+0000 mgr.a (mgr.14388) 14713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:54:23.954 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:23 smithi044 bash[22676]: cephadm 2024-09-21T03:54:22.639122+0000 mgr.a (mgr.14388) 14714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:54:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:24 smithi179 bash[23186]: cluster 2024-09-21T03:54:22.805623+0000 mgr.a (mgr.14388) 14715 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:24 smithi179 bash[23186]: audit 2024-09-21T03:54:23.674917+0000 mon.a (mon.0) 11830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:24 smithi179 bash[23186]: audit 2024-09-21T03:54:23.683346+0000 mon.a (mon.0) 11831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:24 smithi179 bash[23186]: audit 2024-09-21T03:54:23.693831+0000 mon.a (mon.0) 11832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:24 smithi179 bash[23186]: audit 2024-09-21T03:54:23.931250+0000 mon.a (mon.0) 11833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:24 smithi179 bash[23186]: audit 2024-09-21T03:54:23.939777+0000 mon.a (mon.0) 11834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:24 smithi179 bash[23186]: audit 2024-09-21T03:54:23.950122+0000 mon.a (mon.0) 11835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:24 smithi049 bash[23528]: cluster 2024-09-21T03:54:22.805623+0000 mgr.a (mgr.14388) 14715 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:24 smithi049 bash[23528]: audit 2024-09-21T03:54:23.674917+0000 mon.a (mon.0) 11830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:24 smithi049 bash[23528]: audit 2024-09-21T03:54:23.683346+0000 mon.a (mon.0) 11831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:24 smithi049 bash[23528]: audit 2024-09-21T03:54:23.693831+0000 mon.a (mon.0) 11832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:24 smithi049 bash[23528]: audit 2024-09-21T03:54:23.931250+0000 mon.a (mon.0) 11833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:24 smithi049 bash[23528]: audit 2024-09-21T03:54:23.939777+0000 mon.a (mon.0) 11834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:24 smithi049 bash[23528]: audit 2024-09-21T03:54:23.950122+0000 mon.a (mon.0) 11835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:24 smithi044 bash[22676]: cluster 2024-09-21T03:54:22.805623+0000 mgr.a (mgr.14388) 14715 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:24 smithi044 bash[22676]: audit 2024-09-21T03:54:23.674917+0000 mon.a (mon.0) 11830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:24 smithi044 bash[22676]: audit 2024-09-21T03:54:23.683346+0000 mon.a (mon.0) 11831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:24 smithi044 bash[22676]: audit 2024-09-21T03:54:23.693831+0000 mon.a (mon.0) 11832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:24 smithi044 bash[22676]: audit 2024-09-21T03:54:23.931250+0000 mon.a (mon.0) 11833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:24 smithi044 bash[22676]: audit 2024-09-21T03:54:23.939777+0000 mon.a (mon.0) 11834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:24 smithi044 bash[22676]: audit 2024-09-21T03:54:23.950122+0000 mon.a (mon.0) 11835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:26 smithi179 bash[23186]: cluster 2024-09-21T03:54:24.806484+0000 mgr.a (mgr.14388) 14716 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:26.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:26 smithi049 bash[23528]: cluster 2024-09-21T03:54:24.806484+0000 mgr.a (mgr.14388) 14716 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:26 smithi044 bash[22676]: cluster 2024-09-21T03:54:24.806484+0000 mgr.a (mgr.14388) 14716 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:28.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:28.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:28.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:28 smithi049 bash[23528]: cluster 2024-09-21T03:54:26.808721+0000 mgr.a (mgr.14388) 14717 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:28.820 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:28 smithi044 bash[22676]: cluster 2024-09-21T03:54:26.808721+0000 mgr.a (mgr.14388) 14717 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:28 smithi179 bash[23186]: cluster 2024-09-21T03:54:26.808721+0000 mgr.a (mgr.14388) 14717 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:29.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:29 smithi049 bash[23528]: audit 2024-09-21T03:54:28.369069+0000 mgr.a (mgr.14388) 14718 : audit [DBG] from='client.319101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:29 smithi044 bash[22676]: audit 2024-09-21T03:54:28.369069+0000 mgr.a (mgr.14388) 14718 : audit [DBG] from='client.319101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:29 smithi179 bash[23186]: audit 2024-09-21T03:54:28.369069+0000 mgr.a (mgr.14388) 14718 : audit [DBG] from='client.319101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:30.750 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:30 smithi049 bash[23528]: cluster 2024-09-21T03:54:28.809209+0000 mgr.a (mgr.14388) 14719 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:30 smithi044 bash[22676]: cluster 2024-09-21T03:54:28.809209+0000 mgr.a (mgr.14388) 14719 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:30 smithi179 bash[23186]: cluster 2024-09-21T03:54:28.809209+0000 mgr.a (mgr.14388) 14719 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:32 smithi049 bash[23528]: cluster 2024-09-21T03:54:30.811356+0000 mgr.a (mgr.14388) 14720 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:32 smithi049 bash[23528]: audit 2024-09-21T03:54:32.327471+0000 mon.a (mon.0) 11836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:32 smithi049 bash[23528]: audit 2024-09-21T03:54:32.336158+0000 mon.a (mon.0) 11837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:32 smithi049 bash[23528]: audit 2024-09-21T03:54:32.346324+0000 mon.a (mon.0) 11838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:32 smithi044 bash[22676]: cluster 2024-09-21T03:54:30.811356+0000 mgr.a (mgr.14388) 14720 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:32 smithi044 bash[22676]: audit 2024-09-21T03:54:32.327471+0000 mon.a (mon.0) 11836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:32 smithi044 bash[22676]: audit 2024-09-21T03:54:32.336158+0000 mon.a (mon.0) 11837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:32 smithi044 bash[22676]: audit 2024-09-21T03:54:32.346324+0000 mon.a (mon.0) 11838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:32 smithi179 bash[23186]: cluster 2024-09-21T03:54:30.811356+0000 mgr.a (mgr.14388) 14720 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:32 smithi179 bash[23186]: audit 2024-09-21T03:54:32.327471+0000 mon.a (mon.0) 11836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:32 smithi179 bash[23186]: audit 2024-09-21T03:54:32.336158+0000 mon.a (mon.0) 11837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:32 smithi179 bash[23186]: audit 2024-09-21T03:54:32.346324+0000 mon.a (mon.0) 11838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:33.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:33.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:34.599 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:34.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:34.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:34.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:34.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:34.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:34 smithi049 bash[23528]: cluster 2024-09-21T03:54:32.812185+0000 mgr.a (mgr.14388) 14721 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:34.946 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:34 smithi044 bash[22676]: cluster 2024-09-21T03:54:32.812185+0000 mgr.a (mgr.14388) 14721 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:34 smithi179 bash[23186]: cluster 2024-09-21T03:54:32.812185+0000 mgr.a (mgr.14388) 14721 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:35.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:35 smithi049 bash[23528]: audit 2024-09-21T03:54:34.154387+0000 mgr.a (mgr.14388) 14722 : audit [DBG] from='client.319179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:35.936 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:35 smithi044 bash[22676]: audit 2024-09-21T03:54:34.154387+0000 mgr.a (mgr.14388) 14722 : audit [DBG] from='client.319179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:35 smithi179 bash[23186]: audit 2024-09-21T03:54:34.154387+0000 mgr.a (mgr.14388) 14722 : audit [DBG] from='client.319179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:36 smithi049 bash[23528]: cluster 2024-09-21T03:54:34.813107+0000 mgr.a (mgr.14388) 14723 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:36.843 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:36 smithi044 bash[22676]: cluster 2024-09-21T03:54:34.813107+0000 mgr.a (mgr.14388) 14723 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:36 smithi179 bash[23186]: cluster 2024-09-21T03:54:34.813107+0000 mgr.a (mgr.14388) 14723 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:38 smithi049 bash[23528]: cluster 2024-09-21T03:54:36.815328+0000 mgr.a (mgr.14388) 14724 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:38.815 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:38 smithi044 bash[22676]: cluster 2024-09-21T03:54:36.815328+0000 mgr.a (mgr.14388) 14724 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:38 smithi179 bash[23186]: cluster 2024-09-21T03:54:36.815328+0000 mgr.a (mgr.14388) 14724 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:54:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:40.394 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:40.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:40.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:40.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:40.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:40 smithi049 bash[23528]: cluster 2024-09-21T03:54:38.816108+0000 mgr.a (mgr.14388) 14725 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:40 smithi044 bash[22676]: cluster 2024-09-21T03:54:38.816108+0000 mgr.a (mgr.14388) 14725 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:40 smithi179 bash[23186]: cluster 2024-09-21T03:54:38.816108+0000 mgr.a (mgr.14388) 14725 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:41 smithi044 bash[22676]: audit 2024-09-21T03:54:39.935857+0000 mgr.a (mgr.14388) 14726 : audit [DBG] from='client.319254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:41 smithi179 bash[23186]: audit 2024-09-21T03:54:39.935857+0000 mgr.a (mgr.14388) 14726 : audit [DBG] from='client.319254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:41 smithi049 bash[23528]: audit 2024-09-21T03:54:39.935857+0000 mgr.a (mgr.14388) 14726 : audit [DBG] from='client.319254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:42 smithi044 bash[22676]: cluster 2024-09-21T03:54:40.819136+0000 mgr.a (mgr.14388) 14727 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:42 smithi179 bash[23186]: cluster 2024-09-21T03:54:40.819136+0000 mgr.a (mgr.14388) 14727 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:43.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:42 smithi049 bash[23528]: cluster 2024-09-21T03:54:40.819136+0000 mgr.a (mgr.14388) 14727 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:44 smithi044 bash[22676]: cluster 2024-09-21T03:54:42.819916+0000 mgr.a (mgr.14388) 14728 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:44 smithi044 bash[22676]: audit 2024-09-21T03:54:43.903128+0000 mon.a (mon.0) 11839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:44 smithi044 bash[22676]: audit 2024-09-21T03:54:43.911540+0000 mon.a (mon.0) 11840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:44 smithi044 bash[22676]: audit 2024-09-21T03:54:43.922177+0000 mon.a (mon.0) 11841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:44 smithi044 bash[22676]: audit 2024-09-21T03:54:44.161932+0000 mon.a (mon.0) 11842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:44 smithi044 bash[22676]: audit 2024-09-21T03:54:44.170335+0000 mon.a (mon.0) 11843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:44 smithi044 bash[22676]: audit 2024-09-21T03:54:44.180571+0000 mon.a (mon.0) 11844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:44 smithi179 bash[23186]: cluster 2024-09-21T03:54:42.819916+0000 mgr.a (mgr.14388) 14728 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:44 smithi179 bash[23186]: audit 2024-09-21T03:54:43.903128+0000 mon.a (mon.0) 11839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:44 smithi179 bash[23186]: audit 2024-09-21T03:54:43.911540+0000 mon.a (mon.0) 11840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:44 smithi179 bash[23186]: audit 2024-09-21T03:54:43.922177+0000 mon.a (mon.0) 11841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:44 smithi179 bash[23186]: audit 2024-09-21T03:54:44.161932+0000 mon.a (mon.0) 11842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:44 smithi179 bash[23186]: audit 2024-09-21T03:54:44.170335+0000 mon.a (mon.0) 11843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:44 smithi179 bash[23186]: audit 2024-09-21T03:54:44.180571+0000 mon.a (mon.0) 11844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:44 smithi049 bash[23528]: cluster 2024-09-21T03:54:42.819916+0000 mgr.a (mgr.14388) 14728 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:44 smithi049 bash[23528]: audit 2024-09-21T03:54:43.903128+0000 mon.a (mon.0) 11839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:44 smithi049 bash[23528]: audit 2024-09-21T03:54:43.911540+0000 mon.a (mon.0) 11840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:44 smithi049 bash[23528]: audit 2024-09-21T03:54:43.922177+0000 mon.a (mon.0) 11841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:44 smithi049 bash[23528]: audit 2024-09-21T03:54:44.161932+0000 mon.a (mon.0) 11842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:44 smithi049 bash[23528]: audit 2024-09-21T03:54:44.170335+0000 mon.a (mon.0) 11843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:44 smithi049 bash[23528]: audit 2024-09-21T03:54:44.180571+0000 mon.a (mon.0) 11844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:45.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:45.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:45.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:46.189 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:46.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:46 smithi044 bash[22676]: cluster 2024-09-21T03:54:44.820699+0000 mgr.a (mgr.14388) 14729 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:54:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:46 smithi179 bash[23186]: cluster 2024-09-21T03:54:44.820699+0000 mgr.a (mgr.14388) 14729 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:54:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:46 smithi049 bash[23528]: cluster 2024-09-21T03:54:44.820699+0000 mgr.a (mgr.14388) 14729 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:54:47.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:47 smithi044 bash[22676]: audit 2024-09-21T03:54:45.729141+0000 mgr.a (mgr.14388) 14730 : audit [DBG] from='client.319332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:48.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:47 smithi179 bash[23186]: audit 2024-09-21T03:54:45.729141+0000 mgr.a (mgr.14388) 14730 : audit [DBG] from='client.319332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:48.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:47 smithi049 bash[23528]: audit 2024-09-21T03:54:45.729141+0000 mgr.a (mgr.14388) 14730 : audit [DBG] from='client.319332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:48 smithi044 bash[22676]: cluster 2024-09-21T03:54:46.823766+0000 mgr.a (mgr.14388) 14731 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:48 smithi179 bash[23186]: cluster 2024-09-21T03:54:46.823766+0000 mgr.a (mgr.14388) 14731 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:48 smithi049 bash[23528]: cluster 2024-09-21T03:54:46.823766+0000 mgr.a (mgr.14388) 14731 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:50.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:50 smithi049 bash[23528]: cluster 2024-09-21T03:54:48.824566+0000 mgr.a (mgr.14388) 14732 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:50 smithi044 bash[22676]: cluster 2024-09-21T03:54:48.824566+0000 mgr.a (mgr.14388) 14732 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:50 smithi179 bash[23186]: cluster 2024-09-21T03:54:48.824566+0000 mgr.a (mgr.14388) 14732 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:54:51.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:51.936 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:51.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:52 smithi049 bash[23528]: cluster 2024-09-21T03:54:50.826638+0000 mgr.a (mgr.14388) 14733 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:52 smithi049 bash[23528]: audit 2024-09-21T03:54:51.522761+0000 mgr.a (mgr.14388) 14734 : audit [DBG] from='client.319407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:52 smithi049 bash[23528]: audit 2024-09-21T03:54:52.559409+0000 mon.a (mon.0) 11845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:52 smithi049 bash[23528]: audit 2024-09-21T03:54:52.567050+0000 mon.a (mon.0) 11846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:52 smithi049 bash[23528]: audit 2024-09-21T03:54:52.578060+0000 mon.a (mon.0) 11847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:52 smithi044 bash[22676]: cluster 2024-09-21T03:54:50.826638+0000 mgr.a (mgr.14388) 14733 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:52 smithi044 bash[22676]: audit 2024-09-21T03:54:51.522761+0000 mgr.a (mgr.14388) 14734 : audit [DBG] from='client.319407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:52 smithi044 bash[22676]: audit 2024-09-21T03:54:52.559409+0000 mon.a (mon.0) 11845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:52 smithi044 bash[22676]: audit 2024-09-21T03:54:52.567050+0000 mon.a (mon.0) 11846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:52 smithi044 bash[22676]: audit 2024-09-21T03:54:52.578060+0000 mon.a (mon.0) 11847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:52 smithi179 bash[23186]: cluster 2024-09-21T03:54:50.826638+0000 mgr.a (mgr.14388) 14733 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:52 smithi179 bash[23186]: audit 2024-09-21T03:54:51.522761+0000 mgr.a (mgr.14388) 14734 : audit [DBG] from='client.319407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:52 smithi179 bash[23186]: audit 2024-09-21T03:54:52.559409+0000 mon.a (mon.0) 11845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:52 smithi179 bash[23186]: audit 2024-09-21T03:54:52.567050+0000 mon.a (mon.0) 11846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:52 smithi179 bash[23186]: audit 2024-09-21T03:54:52.578060+0000 mon.a (mon.0) 11847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:54:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:54 smithi179 bash[23186]: cluster 2024-09-21T03:54:52.827571+0000 mgr.a (mgr.14388) 14735 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:54 smithi044 bash[22676]: cluster 2024-09-21T03:54:52.827571+0000 mgr.a (mgr.14388) 14735 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:54 smithi049 bash[23528]: cluster 2024-09-21T03:54:52.827571+0000 mgr.a (mgr.14388) 14735 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:56.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:56 smithi044 bash[22676]: cluster 2024-09-21T03:54:54.828379+0000 mgr.a (mgr.14388) 14736 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:56.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:54:56.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:54:56.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:54:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:56 smithi179 bash[23186]: cluster 2024-09-21T03:54:54.828379+0000 mgr.a (mgr.14388) 14736 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:57.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:56 smithi049 bash[23528]: cluster 2024-09-21T03:54:54.828379+0000 mgr.a (mgr.14388) 14736 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:54:57.714 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:54:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:54:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:54:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:54:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:54:58.857 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:58 smithi044 bash[22676]: cluster 2024-09-21T03:54:56.830655+0000 mgr.a (mgr.14388) 14737 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:54:58.857 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:54:58 smithi044 bash[22676]: audit 2024-09-21T03:54:57.277281+0000 mgr.a (mgr.14388) 14738 : audit [DBG] from='client.319485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:58 smithi179 bash[23186]: cluster 2024-09-21T03:54:56.830655+0000 mgr.a (mgr.14388) 14737 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:54:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:54:58 smithi179 bash[23186]: audit 2024-09-21T03:54:57.277281+0000 mgr.a (mgr.14388) 14738 : audit [DBG] from='client.319485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:59.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:58 smithi049 bash[23528]: cluster 2024-09-21T03:54:56.830655+0000 mgr.a (mgr.14388) 14737 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:54:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:54:58 smithi049 bash[23528]: audit 2024-09-21T03:54:57.277281+0000 mgr.a (mgr.14388) 14738 : audit [DBG] from='client.319485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:00 smithi044 bash[22676]: cluster 2024-09-21T03:54:58.831308+0000 mgr.a (mgr.14388) 14739 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:00 smithi179 bash[23186]: cluster 2024-09-21T03:54:58.831308+0000 mgr.a (mgr.14388) 14739 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:01.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:00 smithi049 bash[23528]: cluster 2024-09-21T03:54:58.831308+0000 mgr.a (mgr.14388) 14739 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:02.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:02.716 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:02.716 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:02 smithi044 bash[22676]: cluster 2024-09-21T03:55:00.833547+0000 mgr.a (mgr.14388) 14740 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:02 smithi179 bash[23186]: cluster 2024-09-21T03:55:00.833547+0000 mgr.a (mgr.14388) 14740 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:03.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:02 smithi049 bash[23528]: cluster 2024-09-21T03:55:00.833547+0000 mgr.a (mgr.14388) 14740 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:03.506 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: cluster 2024-09-21T03:55:02.833986+0000 mgr.a (mgr.14388) 14741 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: audit 2024-09-21T03:55:03.053033+0000 mgr.a (mgr.14388) 14742 : audit [DBG] from='client.319563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: audit 2024-09-21T03:55:04.096208+0000 mon.a (mon.0) 11848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: audit 2024-09-21T03:55:04.106877+0000 mon.a (mon.0) 11849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: audit 2024-09-21T03:55:04.119212+0000 mon.a (mon.0) 11850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: audit 2024-09-21T03:55:04.397550+0000 mon.a (mon.0) 11851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: audit 2024-09-21T03:55:04.407130+0000 mon.a (mon.0) 11852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:04 smithi044 bash[22676]: audit 2024-09-21T03:55:04.417219+0000 mon.a (mon.0) 11853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: cluster 2024-09-21T03:55:02.833986+0000 mgr.a (mgr.14388) 14741 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: audit 2024-09-21T03:55:03.053033+0000 mgr.a (mgr.14388) 14742 : audit [DBG] from='client.319563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: audit 2024-09-21T03:55:04.096208+0000 mon.a (mon.0) 11848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: audit 2024-09-21T03:55:04.106877+0000 mon.a (mon.0) 11849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: audit 2024-09-21T03:55:04.119212+0000 mon.a (mon.0) 11850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: audit 2024-09-21T03:55:04.397550+0000 mon.a (mon.0) 11851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: audit 2024-09-21T03:55:04.407130+0000 mon.a (mon.0) 11852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:04 smithi179 bash[23186]: audit 2024-09-21T03:55:04.417219+0000 mon.a (mon.0) 11853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: cluster 2024-09-21T03:55:02.833986+0000 mgr.a (mgr.14388) 14741 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: audit 2024-09-21T03:55:03.053033+0000 mgr.a (mgr.14388) 14742 : audit [DBG] from='client.319563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: audit 2024-09-21T03:55:04.096208+0000 mon.a (mon.0) 11848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: audit 2024-09-21T03:55:04.106877+0000 mon.a (mon.0) 11849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: audit 2024-09-21T03:55:04.119212+0000 mon.a (mon.0) 11850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: audit 2024-09-21T03:55:04.397550+0000 mon.a (mon.0) 11851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: audit 2024-09-21T03:55:04.407130+0000 mon.a (mon.0) 11852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:04 smithi049 bash[23528]: audit 2024-09-21T03:55:04.417219+0000 mon.a (mon.0) 11853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:06 smithi179 bash[23186]: cluster 2024-09-21T03:55:04.834831+0000 mgr.a (mgr.14388) 14743 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:06 smithi044 bash[22676]: cluster 2024-09-21T03:55:04.834831+0000 mgr.a (mgr.14388) 14743 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:06 smithi049 bash[23528]: cluster 2024-09-21T03:55:04.834831+0000 mgr.a (mgr.14388) 14743 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:08.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:08.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:08.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:08.888 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:08 smithi179 bash[23186]: cluster 2024-09-21T03:55:06.837065+0000 mgr.a (mgr.14388) 14744 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:08 smithi044 bash[22676]: cluster 2024-09-21T03:55:06.837065+0000 mgr.a (mgr.14388) 14744 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:08 smithi049 bash[23528]: cluster 2024-09-21T03:55:06.837065+0000 mgr.a (mgr.14388) 14744 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:09.302 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:09.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:09.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:09.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:09.302 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:10.889 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:10 smithi049 bash[23528]: cluster 2024-09-21T03:55:08.837825+0000 mgr.a (mgr.14388) 14745 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:10.889 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:10 smithi049 bash[23528]: audit 2024-09-21T03:55:08.846144+0000 mgr.a (mgr.14388) 14746 : audit [DBG] from='client.319638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:10 smithi044 bash[22676]: cluster 2024-09-21T03:55:08.837825+0000 mgr.a (mgr.14388) 14745 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:10 smithi044 bash[22676]: audit 2024-09-21T03:55:08.846144+0000 mgr.a (mgr.14388) 14746 : audit [DBG] from='client.319638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:10 smithi179 bash[23186]: cluster 2024-09-21T03:55:08.837825+0000 mgr.a (mgr.14388) 14745 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:10 smithi179 bash[23186]: audit 2024-09-21T03:55:08.846144+0000 mgr.a (mgr.14388) 14746 : audit [DBG] from='client.319638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:12 smithi044 bash[22676]: cluster 2024-09-21T03:55:10.840202+0000 mgr.a (mgr.14388) 14747 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:12 smithi179 bash[23186]: cluster 2024-09-21T03:55:10.840202+0000 mgr.a (mgr.14388) 14747 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:13.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:12 smithi049 bash[23528]: cluster 2024-09-21T03:55:10.840202+0000 mgr.a (mgr.14388) 14747 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:13 smithi049 bash[23528]: audit 2024-09-21T03:55:12.769449+0000 mon.a (mon.0) 11854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:13 smithi049 bash[23528]: audit 2024-09-21T03:55:12.779462+0000 mon.a (mon.0) 11855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:13 smithi049 bash[23528]: audit 2024-09-21T03:55:12.791739+0000 mon.a (mon.0) 11856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:13 smithi049 bash[23528]: cluster 2024-09-21T03:55:12.840977+0000 mgr.a (mgr.14388) 14748 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:13 smithi044 bash[22676]: audit 2024-09-21T03:55:12.769449+0000 mon.a (mon.0) 11854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:13 smithi044 bash[22676]: audit 2024-09-21T03:55:12.779462+0000 mon.a (mon.0) 11855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:13 smithi044 bash[22676]: audit 2024-09-21T03:55:12.791739+0000 mon.a (mon.0) 11856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:13 smithi044 bash[22676]: cluster 2024-09-21T03:55:12.840977+0000 mgr.a (mgr.14388) 14748 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:14.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:13 smithi179 bash[23186]: audit 2024-09-21T03:55:12.769449+0000 mon.a (mon.0) 11854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:13 smithi179 bash[23186]: audit 2024-09-21T03:55:12.779462+0000 mon.a (mon.0) 11855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:13 smithi179 bash[23186]: audit 2024-09-21T03:55:12.791739+0000 mon.a (mon.0) 11856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:13 smithi179 bash[23186]: cluster 2024-09-21T03:55:12.840977+0000 mgr.a (mgr.14388) 14748 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:14.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:14 smithi044 bash[22676]: audit 2024-09-21T03:55:14.643091+0000 mgr.a (mgr.14388) 14749 : audit [DBG] from='client.319713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:15.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:14 smithi049 bash[23528]: audit 2024-09-21T03:55:14.643091+0000 mgr.a (mgr.14388) 14749 : audit [DBG] from='client.319713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:15.064 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:14 smithi179 bash[23186]: audit 2024-09-21T03:55:14.643091+0000 mgr.a (mgr.14388) 14749 : audit [DBG] from='client.319713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:15.093 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:15.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:15 smithi044 bash[22676]: cluster 2024-09-21T03:55:14.841643+0000 mgr.a (mgr.14388) 14750 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:16.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:15 smithi179 bash[23186]: cluster 2024-09-21T03:55:14.841643+0000 mgr.a (mgr.14388) 14750 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:16.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:15 smithi049 bash[23528]: cluster 2024-09-21T03:55:14.841643+0000 mgr.a (mgr.14388) 14750 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:17 smithi044 bash[22676]: cluster 2024-09-21T03:55:16.842833+0000 mgr.a (mgr.14388) 14751 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:55:18.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:17 smithi179 bash[23186]: cluster 2024-09-21T03:55:16.842833+0000 mgr.a (mgr.14388) 14751 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:55:18.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:17 smithi049 bash[23528]: cluster 2024-09-21T03:55:16.842833+0000 mgr.a (mgr.14388) 14751 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T03:55:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:20.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:19 smithi044 bash[22676]: cluster 2024-09-21T03:55:18.843588+0000 mgr.a (mgr.14388) 14752 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:55:20.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:19 smithi179 bash[23186]: cluster 2024-09-21T03:55:18.843588+0000 mgr.a (mgr.14388) 14752 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:55:20.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:19 smithi049 bash[23528]: cluster 2024-09-21T03:55:18.843588+0000 mgr.a (mgr.14388) 14752 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T03:55:20.885 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:20.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:20.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:20.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:20.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:20 smithi044 bash[22676]: audit 2024-09-21T03:55:20.430538+0000 mgr.a (mgr.14388) 14753 : audit [DBG] from='client.319785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:21.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:20 smithi179 bash[23186]: audit 2024-09-21T03:55:20.430538+0000 mgr.a (mgr.14388) 14753 : audit [DBG] from='client.319785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:20 smithi049 bash[23528]: audit 2024-09-21T03:55:20.430538+0000 mgr.a (mgr.14388) 14753 : audit [DBG] from='client.319785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:21 smithi044 bash[22676]: cluster 2024-09-21T03:55:20.845202+0000 mgr.a (mgr.14388) 14754 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:22.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:21 smithi179 bash[23186]: cluster 2024-09-21T03:55:20.845202+0000 mgr.a (mgr.14388) 14754 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:21 smithi049 bash[23528]: cluster 2024-09-21T03:55:20.845202+0000 mgr.a (mgr.14388) 14754 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:22 smithi044 bash[22676]: audit 2024-09-21T03:55:22.694277+0000 mon.a (mon.0) 11857 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:55:23.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:22 smithi179 bash[23186]: audit 2024-09-21T03:55:22.694277+0000 mon.a (mon.0) 11857 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:55:23.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:22 smithi049 bash[23528]: audit 2024-09-21T03:55:22.694277+0000 mon.a (mon.0) 11857 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:55:24.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22930]: debug 2024-09-21T03:55:24.091+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:55:24.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22930]: debug 2024-09-21T03:55:24.095+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: cluster 2024-09-21T03:55:22.845953+0000 mgr.a (mgr.14388) 14755 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.308175+0000 mon.a (mon.0) 11858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.315317+0000 mon.a (mon.0) 11859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.321895+0000 mon.a (mon.0) 11860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.328897+0000 mon.a (mon.0) 11861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.330396+0000 mon.a (mon.0) 11862 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.331490+0000 mon.a (mon.0) 11863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.339666+0000 mon.a (mon.0) 11864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.345243+0000 mon.a (mon.0) 11865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:55:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:24 smithi044 bash[22676]: audit 2024-09-21T03:55:23.347605+0000 mgr.a (mgr.14388) 14756 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: cluster 2024-09-21T03:55:22.845953+0000 mgr.a (mgr.14388) 14755 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.308175+0000 mon.a (mon.0) 11858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.315317+0000 mon.a (mon.0) 11859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.321895+0000 mon.a (mon.0) 11860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.328897+0000 mon.a (mon.0) 11861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.330396+0000 mon.a (mon.0) 11862 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.331490+0000 mon.a (mon.0) 11863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:55:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.339666+0000 mon.a (mon.0) 11864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.345243+0000 mon.a (mon.0) 11865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:55:24.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:24 smithi179 bash[23186]: audit 2024-09-21T03:55:23.347605+0000 mgr.a (mgr.14388) 14756 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: cluster 2024-09-21T03:55:22.845953+0000 mgr.a (mgr.14388) 14755 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.308175+0000 mon.a (mon.0) 11858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.315317+0000 mon.a (mon.0) 11859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.321895+0000 mon.a (mon.0) 11860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.328897+0000 mon.a (mon.0) 11861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.330396+0000 mon.a (mon.0) 11862 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.331490+0000 mon.a (mon.0) 11863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:55:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.339666+0000 mon.a (mon.0) 11864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.345243+0000 mon.a (mon.0) 11865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:55:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:24 smithi049 bash[23528]: audit 2024-09-21T03:55:23.347605+0000 mgr.a (mgr.14388) 14756 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:55:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: audit 2024-09-21T03:55:24.097084+0000 mgr.a (mgr.14388) 14757 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:55:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: cephadm 2024-09-21T03:55:24.098284+0000 mgr.a (mgr.14388) 14758 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:55:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: audit 2024-09-21T03:55:24.329315+0000 mon.a (mon.0) 11866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: audit 2024-09-21T03:55:24.337902+0000 mon.a (mon.0) 11867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: audit 2024-09-21T03:55:24.348518+0000 mon.a (mon.0) 11868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: audit 2024-09-21T03:55:24.622499+0000 mon.a (mon.0) 11869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: audit 2024-09-21T03:55:24.630585+0000 mon.a (mon.0) 11870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:25 smithi044 bash[22676]: audit 2024-09-21T03:55:24.640905+0000 mon.a (mon.0) 11871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: audit 2024-09-21T03:55:24.097084+0000 mgr.a (mgr.14388) 14757 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: cephadm 2024-09-21T03:55:24.098284+0000 mgr.a (mgr.14388) 14758 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: audit 2024-09-21T03:55:24.329315+0000 mon.a (mon.0) 11866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: audit 2024-09-21T03:55:24.337902+0000 mon.a (mon.0) 11867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: audit 2024-09-21T03:55:24.348518+0000 mon.a (mon.0) 11868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: audit 2024-09-21T03:55:24.622499+0000 mon.a (mon.0) 11869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: audit 2024-09-21T03:55:24.630585+0000 mon.a (mon.0) 11870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:25 smithi179 bash[23186]: audit 2024-09-21T03:55:24.640905+0000 mon.a (mon.0) 11871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: audit 2024-09-21T03:55:24.097084+0000 mgr.a (mgr.14388) 14757 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: cephadm 2024-09-21T03:55:24.098284+0000 mgr.a (mgr.14388) 14758 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: audit 2024-09-21T03:55:24.329315+0000 mon.a (mon.0) 11866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: audit 2024-09-21T03:55:24.337902+0000 mon.a (mon.0) 11867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: audit 2024-09-21T03:55:24.348518+0000 mon.a (mon.0) 11868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: audit 2024-09-21T03:55:24.622499+0000 mon.a (mon.0) 11869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: audit 2024-09-21T03:55:24.630585+0000 mon.a (mon.0) 11870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:25 smithi049 bash[23528]: audit 2024-09-21T03:55:24.640905+0000 mon.a (mon.0) 11871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:25.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:25.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:25.888 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:26.670 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:26.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:26.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:26.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:26.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:26.860 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:26 smithi179 bash[23186]: cluster 2024-09-21T03:55:24.846898+0000 mgr.a (mgr.14388) 14759 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:55:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:26 smithi044 bash[22676]: cluster 2024-09-21T03:55:24.846898+0000 mgr.a (mgr.14388) 14759 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:55:27.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:26 smithi049 bash[23528]: cluster 2024-09-21T03:55:24.846898+0000 mgr.a (mgr.14388) 14759 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:55:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:27 smithi179 bash[23186]: audit 2024-09-21T03:55:26.221065+0000 mgr.a (mgr.14388) 14760 : audit [DBG] from='client.319965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:27.959 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:27 smithi049 bash[23528]: audit 2024-09-21T03:55:26.221065+0000 mgr.a (mgr.14388) 14760 : audit [DBG] from='client.319965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:27 smithi044 bash[22676]: audit 2024-09-21T03:55:26.221065+0000 mgr.a (mgr.14388) 14760 : audit [DBG] from='client.319965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:28 smithi044 bash[22676]: cluster 2024-09-21T03:55:26.849889+0000 mgr.a (mgr.14388) 14761 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:28 smithi179 bash[23186]: cluster 2024-09-21T03:55:26.849889+0000 mgr.a (mgr.14388) 14761 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:28 smithi049 bash[23528]: cluster 2024-09-21T03:55:26.849889+0000 mgr.a (mgr.14388) 14761 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:30 smithi044 bash[22676]: cluster 2024-09-21T03:55:28.850703+0000 mgr.a (mgr.14388) 14762 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:55:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:30 smithi179 bash[23186]: cluster 2024-09-21T03:55:28.850703+0000 mgr.a (mgr.14388) 14762 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:55:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:30 smithi049 bash[23528]: cluster 2024-09-21T03:55:28.850703+0000 mgr.a (mgr.14388) 14762 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:55:31.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:31.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:31.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:32.440 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:32.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:32.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:32.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:32.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:32 smithi044 bash[22676]: cluster 2024-09-21T03:55:30.852703+0000 mgr.a (mgr.14388) 14763 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:32 smithi179 bash[23186]: cluster 2024-09-21T03:55:30.852703+0000 mgr.a (mgr.14388) 14763 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:33.014 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:32 smithi049 bash[23528]: cluster 2024-09-21T03:55:30.852703+0000 mgr.a (mgr.14388) 14763 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:33.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:33 smithi049 bash[23528]: audit 2024-09-21T03:55:32.002446+0000 mgr.a (mgr.14388) 14764 : audit [DBG] from='client.320040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:33.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:33 smithi049 bash[23528]: audit 2024-09-21T03:55:32.991482+0000 mon.a (mon.0) 11872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:33.932 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:33 smithi049 bash[23528]: audit 2024-09-21T03:55:33.000157+0000 mon.a (mon.0) 11873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:33.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:33 smithi049 bash[23528]: audit 2024-09-21T03:55:33.010612+0000 mon.a (mon.0) 11874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:33 smithi044 bash[22676]: audit 2024-09-21T03:55:32.002446+0000 mgr.a (mgr.14388) 14764 : audit [DBG] from='client.320040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:33 smithi044 bash[22676]: audit 2024-09-21T03:55:32.991482+0000 mon.a (mon.0) 11872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:33 smithi044 bash[22676]: audit 2024-09-21T03:55:33.000157+0000 mon.a (mon.0) 11873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:33 smithi044 bash[22676]: audit 2024-09-21T03:55:33.010612+0000 mon.a (mon.0) 11874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:34.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:33 smithi179 bash[23186]: audit 2024-09-21T03:55:32.002446+0000 mgr.a (mgr.14388) 14764 : audit [DBG] from='client.320040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:33 smithi179 bash[23186]: audit 2024-09-21T03:55:32.991482+0000 mon.a (mon.0) 11872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:33 smithi179 bash[23186]: audit 2024-09-21T03:55:33.000157+0000 mon.a (mon.0) 11873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:33 smithi179 bash[23186]: audit 2024-09-21T03:55:33.010612+0000 mon.a (mon.0) 11874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:34 smithi044 bash[22676]: cluster 2024-09-21T03:55:32.853706+0000 mgr.a (mgr.14388) 14765 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:34 smithi179 bash[23186]: cluster 2024-09-21T03:55:32.853706+0000 mgr.a (mgr.14388) 14765 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:34 smithi049 bash[23528]: cluster 2024-09-21T03:55:32.853706+0000 mgr.a (mgr.14388) 14765 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:36.943 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:36 smithi044 bash[22676]: cluster 2024-09-21T03:55:34.854497+0000 mgr.a (mgr.14388) 14766 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:36 smithi179 bash[23186]: cluster 2024-09-21T03:55:34.854497+0000 mgr.a (mgr.14388) 14766 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:37.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:36 smithi049 bash[23528]: cluster 2024-09-21T03:55:34.854497+0000 mgr.a (mgr.14388) 14766 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:37.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:37.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:37.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:38.194 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:38.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:38.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:38.194 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:38.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:38 smithi044 bash[22676]: cluster 2024-09-21T03:55:36.856731+0000 mgr.a (mgr.14388) 14767 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:38 smithi179 bash[23186]: cluster 2024-09-21T03:55:36.856731+0000 mgr.a (mgr.14388) 14767 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:38 smithi049 bash[23528]: cluster 2024-09-21T03:55:36.856731+0000 mgr.a (mgr.14388) 14767 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:55:39.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:39 smithi044 bash[22676]: audit 2024-09-21T03:55:37.776065+0000 mgr.a (mgr.14388) 14768 : audit [DBG] from='client.320112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:40.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:39 smithi179 bash[23186]: audit 2024-09-21T03:55:37.776065+0000 mgr.a (mgr.14388) 14768 : audit [DBG] from='client.320112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:39 smithi049 bash[23528]: audit 2024-09-21T03:55:37.776065+0000 mgr.a (mgr.14388) 14768 : audit [DBG] from='client.320112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:40 smithi044 bash[22676]: cluster 2024-09-21T03:55:38.857284+0000 mgr.a (mgr.14388) 14769 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:40 smithi179 bash[23186]: cluster 2024-09-21T03:55:38.857284+0000 mgr.a (mgr.14388) 14769 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:40 smithi049 bash[23528]: cluster 2024-09-21T03:55:38.857284+0000 mgr.a (mgr.14388) 14769 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:41 smithi044 bash[22676]: cluster 2024-09-21T03:55:40.859483+0000 mgr.a (mgr.14388) 14770 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:41 smithi179 bash[23186]: cluster 2024-09-21T03:55:40.859483+0000 mgr.a (mgr.14388) 14770 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:41 smithi049 bash[23528]: cluster 2024-09-21T03:55:40.859483+0000 mgr.a (mgr.14388) 14770 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:43.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:43.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:43.196 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:43.946 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:44.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:43 smithi044 bash[22676]: cluster 2024-09-21T03:55:42.860256+0000 mgr.a (mgr.14388) 14771 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:44.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:43 smithi044 bash[22676]: audit 2024-09-21T03:55:43.528486+0000 mgr.a (mgr.14388) 14772 : audit [DBG] from='client.320187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:43 smithi179 bash[23186]: cluster 2024-09-21T03:55:42.860256+0000 mgr.a (mgr.14388) 14771 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:43 smithi179 bash[23186]: audit 2024-09-21T03:55:43.528486+0000 mgr.a (mgr.14388) 14772 : audit [DBG] from='client.320187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:44.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:43 smithi049 bash[23528]: cluster 2024-09-21T03:55:42.860256+0000 mgr.a (mgr.14388) 14771 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:44.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:43 smithi049 bash[23528]: audit 2024-09-21T03:55:43.528486+0000 mgr.a (mgr.14388) 14772 : audit [DBG] from='client.320187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:45.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:45 smithi179 bash[23186]: audit 2024-09-21T03:55:44.560487+0000 mon.a (mon.0) 11875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:45 smithi179 bash[23186]: audit 2024-09-21T03:55:44.568835+0000 mon.a (mon.0) 11876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:45 smithi179 bash[23186]: audit 2024-09-21T03:55:44.579285+0000 mon.a (mon.0) 11877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:45 smithi179 bash[23186]: audit 2024-09-21T03:55:44.850059+0000 mon.a (mon.0) 11878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:45 smithi179 bash[23186]: audit 2024-09-21T03:55:44.858374+0000 mon.a (mon.0) 11879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:45 smithi179 bash[23186]: audit 2024-09-21T03:55:44.869039+0000 mon.a (mon.0) 11880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:45 smithi044 bash[22676]: audit 2024-09-21T03:55:44.560487+0000 mon.a (mon.0) 11875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:45 smithi044 bash[22676]: audit 2024-09-21T03:55:44.568835+0000 mon.a (mon.0) 11876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:45 smithi044 bash[22676]: audit 2024-09-21T03:55:44.579285+0000 mon.a (mon.0) 11877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:45 smithi044 bash[22676]: audit 2024-09-21T03:55:44.850059+0000 mon.a (mon.0) 11878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:45 smithi044 bash[22676]: audit 2024-09-21T03:55:44.858374+0000 mon.a (mon.0) 11879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:45 smithi044 bash[22676]: audit 2024-09-21T03:55:44.869039+0000 mon.a (mon.0) 11880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:45 smithi049 bash[23528]: audit 2024-09-21T03:55:44.560487+0000 mon.a (mon.0) 11875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:45 smithi049 bash[23528]: audit 2024-09-21T03:55:44.568835+0000 mon.a (mon.0) 11876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:45 smithi049 bash[23528]: audit 2024-09-21T03:55:44.579285+0000 mon.a (mon.0) 11877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:45 smithi049 bash[23528]: audit 2024-09-21T03:55:44.850059+0000 mon.a (mon.0) 11878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:45 smithi049 bash[23528]: audit 2024-09-21T03:55:44.858374+0000 mon.a (mon.0) 11879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:45 smithi049 bash[23528]: audit 2024-09-21T03:55:44.869039+0000 mon.a (mon.0) 11880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:46.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:46 smithi179 bash[23186]: cluster 2024-09-21T03:55:44.861177+0000 mgr.a (mgr.14388) 14773 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:46 smithi044 bash[22676]: cluster 2024-09-21T03:55:44.861177+0000 mgr.a (mgr.14388) 14773 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:46 smithi049 bash[23528]: cluster 2024-09-21T03:55:44.861177+0000 mgr.a (mgr.14388) 14773 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:48.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:48.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:48.949 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:48 smithi044 bash[22676]: cluster 2024-09-21T03:55:46.863479+0000 mgr.a (mgr.14388) 14774 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:48 smithi179 bash[23186]: cluster 2024-09-21T03:55:46.863479+0000 mgr.a (mgr.14388) 14774 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:49.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:48 smithi049 bash[23528]: cluster 2024-09-21T03:55:46.863479+0000 mgr.a (mgr.14388) 14774 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:55:49.705 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:49.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:49.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:49.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:49.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:50 smithi049 bash[23528]: cluster 2024-09-21T03:55:48.864393+0000 mgr.a (mgr.14388) 14775 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:50 smithi049 bash[23528]: audit 2024-09-21T03:55:49.272777+0000 mgr.a (mgr.14388) 14776 : audit [DBG] from='client.320265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:50 smithi044 bash[22676]: cluster 2024-09-21T03:55:48.864393+0000 mgr.a (mgr.14388) 14775 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:50 smithi044 bash[22676]: audit 2024-09-21T03:55:49.272777+0000 mgr.a (mgr.14388) 14776 : audit [DBG] from='client.320265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:50 smithi179 bash[23186]: cluster 2024-09-21T03:55:48.864393+0000 mgr.a (mgr.14388) 14775 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:55:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:50 smithi179 bash[23186]: audit 2024-09-21T03:55:49.272777+0000 mgr.a (mgr.14388) 14776 : audit [DBG] from='client.320265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:52 smithi044 bash[22676]: cluster 2024-09-21T03:55:50.866833+0000 mgr.a (mgr.14388) 14777 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:55:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:52 smithi179 bash[23186]: cluster 2024-09-21T03:55:50.866833+0000 mgr.a (mgr.14388) 14777 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:55:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:52 smithi049 bash[23528]: cluster 2024-09-21T03:55:50.866833+0000 mgr.a (mgr.14388) 14777 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:55:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:54 smithi044 bash[22676]: cluster 2024-09-21T03:55:52.867620+0000 mgr.a (mgr.14388) 14778 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:55:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:54 smithi044 bash[22676]: audit 2024-09-21T03:55:53.223904+0000 mon.a (mon.0) 11881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:54 smithi044 bash[22676]: audit 2024-09-21T03:55:53.232968+0000 mon.a (mon.0) 11882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:54 smithi044 bash[22676]: audit 2024-09-21T03:55:53.243349+0000 mon.a (mon.0) 11883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:54 smithi179 bash[23186]: cluster 2024-09-21T03:55:52.867620+0000 mgr.a (mgr.14388) 14778 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:55:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:54 smithi179 bash[23186]: audit 2024-09-21T03:55:53.223904+0000 mon.a (mon.0) 11881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:54 smithi179 bash[23186]: audit 2024-09-21T03:55:53.232968+0000 mon.a (mon.0) 11882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:54 smithi179 bash[23186]: audit 2024-09-21T03:55:53.243349+0000 mon.a (mon.0) 11883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:54 smithi049 bash[23528]: cluster 2024-09-21T03:55:52.867620+0000 mgr.a (mgr.14388) 14778 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:55:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:54 smithi049 bash[23528]: audit 2024-09-21T03:55:53.223904+0000 mon.a (mon.0) 11881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:54 smithi049 bash[23528]: audit 2024-09-21T03:55:53.232968+0000 mon.a (mon.0) 11882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:54 smithi049 bash[23528]: audit 2024-09-21T03:55:53.243349+0000 mon.a (mon.0) 11883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:55:54.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:55:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:55:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:55:55.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:55:55.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:55:55.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:55:55.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:55:55.457 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:55:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:56 smithi044 bash[22676]: cluster 2024-09-21T03:55:54.868373+0000 mgr.a (mgr.14388) 14779 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:55:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:56 smithi044 bash[22676]: audit 2024-09-21T03:55:55.041044+0000 mgr.a (mgr.14388) 14780 : audit [DBG] from='client.320340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:56 smithi179 bash[23186]: cluster 2024-09-21T03:55:54.868373+0000 mgr.a (mgr.14388) 14779 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:55:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:56 smithi179 bash[23186]: audit 2024-09-21T03:55:55.041044+0000 mgr.a (mgr.14388) 14780 : audit [DBG] from='client.320340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:56 smithi049 bash[23528]: cluster 2024-09-21T03:55:54.868373+0000 mgr.a (mgr.14388) 14779 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:55:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:56 smithi049 bash[23528]: audit 2024-09-21T03:55:55.041044+0000 mgr.a (mgr.14388) 14780 : audit [DBG] from='client.320340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:58.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:55:58 smithi044 bash[22676]: cluster 2024-09-21T03:55:56.871259+0000 mgr.a (mgr.14388) 14781 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:55:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:55:58 smithi179 bash[23186]: cluster 2024-09-21T03:55:56.871259+0000 mgr.a (mgr.14388) 14781 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:55:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:55:58 smithi049 bash[23528]: cluster 2024-09-21T03:55:56.871259+0000 mgr.a (mgr.14388) 14781 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:56:00.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:00.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:00.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:00 smithi044 bash[22676]: cluster 2024-09-21T03:55:58.872063+0000 mgr.a (mgr.14388) 14782 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:56:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:00 smithi179 bash[23186]: cluster 2024-09-21T03:55:58.872063+0000 mgr.a (mgr.14388) 14782 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:56:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:00 smithi049 bash[23528]: cluster 2024-09-21T03:55:58.872063+0000 mgr.a (mgr.14388) 14782 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:56:01.221 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:01.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:01.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:02 smithi179 bash[23186]: audit 2024-09-21T03:56:00.787083+0000 mgr.a (mgr.14388) 14783 : audit [DBG] from='client.320418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:02 smithi179 bash[23186]: cluster 2024-09-21T03:56:00.873475+0000 mgr.a (mgr.14388) 14784 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:56:02.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:02 smithi049 bash[23528]: audit 2024-09-21T03:56:00.787083+0000 mgr.a (mgr.14388) 14783 : audit [DBG] from='client.320418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:02.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:02 smithi049 bash[23528]: cluster 2024-09-21T03:56:00.873475+0000 mgr.a (mgr.14388) 14784 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:56:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:02 smithi044 bash[22676]: audit 2024-09-21T03:56:00.787083+0000 mgr.a (mgr.14388) 14783 : audit [DBG] from='client.320418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:02 smithi044 bash[22676]: cluster 2024-09-21T03:56:00.873475+0000 mgr.a (mgr.14388) 14784 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:56:04.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:04 smithi179 bash[23186]: cluster 2024-09-21T03:56:02.874347+0000 mgr.a (mgr.14388) 14785 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T03:56:04.552 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:04 smithi049 bash[23528]: cluster 2024-09-21T03:56:02.874347+0000 mgr.a (mgr.14388) 14785 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T03:56:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:04 smithi044 bash[22676]: cluster 2024-09-21T03:56:02.874347+0000 mgr.a (mgr.14388) 14785 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T03:56:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:05 smithi049 bash[23528]: audit 2024-09-21T03:56:04.791139+0000 mon.a (mon.0) 11884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:05 smithi049 bash[23528]: audit 2024-09-21T03:56:04.799671+0000 mon.a (mon.0) 11885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:05 smithi049 bash[23528]: audit 2024-09-21T03:56:04.810436+0000 mon.a (mon.0) 11886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:05 smithi049 bash[23528]: cluster 2024-09-21T03:56:04.874980+0000 mgr.a (mgr.14388) 14786 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T03:56:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:05 smithi049 bash[23528]: audit 2024-09-21T03:56:05.071959+0000 mon.a (mon.0) 11887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:05 smithi049 bash[23528]: audit 2024-09-21T03:56:05.080345+0000 mon.a (mon.0) 11888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:05 smithi049 bash[23528]: audit 2024-09-21T03:56:05.090551+0000 mon.a (mon.0) 11889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.221 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:05 smithi179 bash[23186]: audit 2024-09-21T03:56:04.791139+0000 mon.a (mon.0) 11884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.222 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:05 smithi179 bash[23186]: audit 2024-09-21T03:56:04.799671+0000 mon.a (mon.0) 11885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.222 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:05 smithi179 bash[23186]: audit 2024-09-21T03:56:04.810436+0000 mon.a (mon.0) 11886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.222 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:05 smithi179 bash[23186]: cluster 2024-09-21T03:56:04.874980+0000 mgr.a (mgr.14388) 14786 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T03:56:06.222 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:05 smithi179 bash[23186]: audit 2024-09-21T03:56:05.071959+0000 mon.a (mon.0) 11887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.222 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:05 smithi179 bash[23186]: audit 2024-09-21T03:56:05.080345+0000 mon.a (mon.0) 11888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.222 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:05 smithi179 bash[23186]: audit 2024-09-21T03:56:05.090551+0000 mon.a (mon.0) 11889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:06.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:06.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:05 smithi044 bash[22676]: audit 2024-09-21T03:56:04.791139+0000 mon.a (mon.0) 11884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:05 smithi044 bash[22676]: audit 2024-09-21T03:56:04.799671+0000 mon.a (mon.0) 11885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:05 smithi044 bash[22676]: audit 2024-09-21T03:56:04.810436+0000 mon.a (mon.0) 11886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:05 smithi044 bash[22676]: cluster 2024-09-21T03:56:04.874980+0000 mgr.a (mgr.14388) 14786 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T03:56:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:05 smithi044 bash[22676]: audit 2024-09-21T03:56:05.071959+0000 mon.a (mon.0) 11887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:05 smithi044 bash[22676]: audit 2024-09-21T03:56:05.080345+0000 mon.a (mon.0) 11888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:05 smithi044 bash[22676]: audit 2024-09-21T03:56:05.090551+0000 mon.a (mon.0) 11889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:07.001 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:07.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:07.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:07.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:07.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:06 smithi044 bash[22676]: audit 2024-09-21T03:56:06.555537+0000 mgr.a (mgr.14388) 14787 : audit [DBG] from='client.320490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:06 smithi179 bash[23186]: audit 2024-09-21T03:56:06.555537+0000 mgr.a (mgr.14388) 14787 : audit [DBG] from='client.320490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:06 smithi049 bash[23528]: audit 2024-09-21T03:56:06.555537+0000 mgr.a (mgr.14388) 14787 : audit [DBG] from='client.320490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:07.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:07 smithi179 bash[23186]: cluster 2024-09-21T03:56:06.876271+0000 mgr.a (mgr.14388) 14788 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T03:56:08.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:07 smithi044 bash[22676]: cluster 2024-09-21T03:56:06.876271+0000 mgr.a (mgr.14388) 14788 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T03:56:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:07 smithi049 bash[23528]: cluster 2024-09-21T03:56:06.876271+0000 mgr.a (mgr.14388) 14788 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T03:56:10.196 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:09 smithi179 bash[23186]: cluster 2024-09-21T03:56:08.877075+0000 mgr.a (mgr.14388) 14789 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:09 smithi044 bash[22676]: cluster 2024-09-21T03:56:08.877075+0000 mgr.a (mgr.14388) 14789 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:09 smithi049 bash[23528]: cluster 2024-09-21T03:56:08.877075+0000 mgr.a (mgr.14388) 14789 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:12.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:12.003 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:12.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:12.190 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:11 smithi049 bash[23528]: cluster 2024-09-21T03:56:10.879567+0000 mgr.a (mgr.14388) 14790 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:12.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:11 smithi044 bash[22676]: cluster 2024-09-21T03:56:10.879567+0000 mgr.a (mgr.14388) 14790 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:12.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:11 smithi179 bash[23186]: cluster 2024-09-21T03:56:10.879567+0000 mgr.a (mgr.14388) 14790 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:12.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:12.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:12.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:12 smithi044 bash[22676]: audit 2024-09-21T03:56:12.345893+0000 mgr.a (mgr.14388) 14791 : audit [DBG] from='client.114311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:12 smithi179 bash[23186]: audit 2024-09-21T03:56:12.345893+0000 mgr.a (mgr.14388) 14791 : audit [DBG] from='client.114311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:13.302 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:12 smithi049 bash[23528]: audit 2024-09-21T03:56:12.345893+0000 mgr.a (mgr.14388) 14791 : audit [DBG] from='client.114311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:14 smithi049 bash[23528]: cluster 2024-09-21T03:56:12.880372+0000 mgr.a (mgr.14388) 14792 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:14 smithi049 bash[23528]: audit 2024-09-21T03:56:13.451445+0000 mon.a (mon.0) 11890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:14 smithi049 bash[23528]: audit 2024-09-21T03:56:13.460384+0000 mon.a (mon.0) 11891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:14 smithi049 bash[23528]: audit 2024-09-21T03:56:13.471134+0000 mon.a (mon.0) 11892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:14 smithi044 bash[22676]: cluster 2024-09-21T03:56:12.880372+0000 mgr.a (mgr.14388) 14792 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:14 smithi044 bash[22676]: audit 2024-09-21T03:56:13.451445+0000 mon.a (mon.0) 11890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:14 smithi044 bash[22676]: audit 2024-09-21T03:56:13.460384+0000 mon.a (mon.0) 11891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:14 smithi044 bash[22676]: audit 2024-09-21T03:56:13.471134+0000 mon.a (mon.0) 11892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:14 smithi179 bash[23186]: cluster 2024-09-21T03:56:12.880372+0000 mgr.a (mgr.14388) 14792 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:14 smithi179 bash[23186]: audit 2024-09-21T03:56:13.451445+0000 mon.a (mon.0) 11890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:14 smithi179 bash[23186]: audit 2024-09-21T03:56:13.460384+0000 mon.a (mon.0) 11891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:14 smithi179 bash[23186]: audit 2024-09-21T03:56:13.471134+0000 mon.a (mon.0) 11892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:16 smithi044 bash[22676]: cluster 2024-09-21T03:56:14.881134+0000 mgr.a (mgr.14388) 14793 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:16 smithi179 bash[23186]: cluster 2024-09-21T03:56:14.881134+0000 mgr.a (mgr.14388) 14793 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:16.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:16 smithi049 bash[23528]: cluster 2024-09-21T03:56:14.881134+0000 mgr.a (mgr.14388) 14793 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:17.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:18.565 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:18.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:18.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:18.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:18.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:18 smithi044 bash[22676]: cluster 2024-09-21T03:56:16.883353+0000 mgr.a (mgr.14388) 14794 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T03:56:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:18 smithi179 bash[23186]: cluster 2024-09-21T03:56:16.883353+0000 mgr.a (mgr.14388) 14794 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T03:56:18.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:18 smithi049 bash[23528]: cluster 2024-09-21T03:56:16.883353+0000 mgr.a (mgr.14388) 14794 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T03:56:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:19 smithi044 bash[22676]: audit 2024-09-21T03:56:18.136407+0000 mgr.a (mgr.14388) 14795 : audit [DBG] from='client.320646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:19 smithi179 bash[23186]: audit 2024-09-21T03:56:18.136407+0000 mgr.a (mgr.14388) 14795 : audit [DBG] from='client.320646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:19.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:19 smithi049 bash[23528]: audit 2024-09-21T03:56:18.136407+0000 mgr.a (mgr.14388) 14795 : audit [DBG] from='client.320646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:20 smithi044 bash[22676]: cluster 2024-09-21T03:56:18.884318+0000 mgr.a (mgr.14388) 14796 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:20 smithi179 bash[23186]: cluster 2024-09-21T03:56:18.884318+0000 mgr.a (mgr.14388) 14796 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:20.802 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:20 smithi049 bash[23528]: cluster 2024-09-21T03:56:18.884318+0000 mgr.a (mgr.14388) 14796 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:22.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:22 smithi044 bash[22676]: cluster 2024-09-21T03:56:20.886637+0000 mgr.a (mgr.14388) 14797 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T03:56:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:22 smithi179 bash[23186]: cluster 2024-09-21T03:56:20.886637+0000 mgr.a (mgr.14388) 14797 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T03:56:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:22 smithi049 bash[23528]: cluster 2024-09-21T03:56:20.886637+0000 mgr.a (mgr.14388) 14797 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-21T03:56:23.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:24.330 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:24.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:24.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:24.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:24.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:24 smithi044 bash[22676]: cluster 2024-09-21T03:56:22.887455+0000 mgr.a (mgr.14388) 14798 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:24 smithi044 bash[22676]: audit 2024-09-21T03:56:24.149960+0000 mon.a (mon.0) 11893 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:56:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:24 smithi179 bash[23186]: cluster 2024-09-21T03:56:22.887455+0000 mgr.a (mgr.14388) 14798 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:24 smithi179 bash[23186]: audit 2024-09-21T03:56:24.149960+0000 mon.a (mon.0) 11893 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:56:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:24 smithi049 bash[23528]: cluster 2024-09-21T03:56:22.887455+0000 mgr.a (mgr.14388) 14798 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:24 smithi049 bash[23528]: audit 2024-09-21T03:56:24.149960+0000 mon.a (mon.0) 11893 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:56:25.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22930]: debug 2024-09-21T03:56:25.506+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:56:25.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22930]: debug 2024-09-21T03:56:25.510+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:23.898786+0000 mgr.a (mgr.14388) 14799 : audit [DBG] from='client.320721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:24.697485+0000 mon.a (mon.0) 11894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:24.705777+0000 mon.a (mon.0) 11895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:24.708675+0000 mon.a (mon.0) 11896 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:24.710636+0000 mon.a (mon.0) 11897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:24.720937+0000 mon.a (mon.0) 11898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:24.727368+0000 mon.a (mon.0) 11899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:25.008688+0000 mon.a (mon.0) 11900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:25.016196+0000 mon.a (mon.0) 11901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:25.023343+0000 mon.a (mon.0) 11902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:25.229068+0000 mon.a (mon.0) 11903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:25.234367+0000 mon.a (mon.0) 11904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:25 smithi044 bash[22676]: audit 2024-09-21T03:56:25.239215+0000 mon.a (mon.0) 11905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:23.898786+0000 mgr.a (mgr.14388) 14799 : audit [DBG] from='client.320721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:24.697485+0000 mon.a (mon.0) 11894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:24.705777+0000 mon.a (mon.0) 11895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:24.708675+0000 mon.a (mon.0) 11896 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:24.710636+0000 mon.a (mon.0) 11897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:24.720937+0000 mon.a (mon.0) 11898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:24.727368+0000 mon.a (mon.0) 11899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:25.008688+0000 mon.a (mon.0) 11900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:25.016196+0000 mon.a (mon.0) 11901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:25.023343+0000 mon.a (mon.0) 11902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:25.229068+0000 mon.a (mon.0) 11903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:25.234367+0000 mon.a (mon.0) 11904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:25 smithi179 bash[23186]: audit 2024-09-21T03:56:25.239215+0000 mon.a (mon.0) 11905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:23.898786+0000 mgr.a (mgr.14388) 14799 : audit [DBG] from='client.320721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:24.697485+0000 mon.a (mon.0) 11894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:24.705777+0000 mon.a (mon.0) 11895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:24.708675+0000 mon.a (mon.0) 11896 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:24.710636+0000 mon.a (mon.0) 11897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:24.720937+0000 mon.a (mon.0) 11898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:24.727368+0000 mon.a (mon.0) 11899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:56:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:25.008688+0000 mon.a (mon.0) 11900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:25.016196+0000 mon.a (mon.0) 11901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:25.023343+0000 mon.a (mon.0) 11902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:25.229068+0000 mon.a (mon.0) 11903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:25.234367+0000 mon.a (mon.0) 11904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:25 smithi049 bash[23528]: audit 2024-09-21T03:56:25.239215+0000 mon.a (mon.0) 11905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:26 smithi044 bash[22676]: audit 2024-09-21T03:56:24.730272+0000 mgr.a (mgr.14388) 14800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:56:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:26 smithi044 bash[22676]: cluster 2024-09-21T03:56:24.888098+0000 mgr.a (mgr.14388) 14801 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:26 smithi044 bash[22676]: audit 2024-09-21T03:56:25.513023+0000 mgr.a (mgr.14388) 14802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:56:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:26 smithi044 bash[22676]: cephadm 2024-09-21T03:56:25.514222+0000 mgr.a (mgr.14388) 14803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:56:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:26 smithi179 bash[23186]: audit 2024-09-21T03:56:24.730272+0000 mgr.a (mgr.14388) 14800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:56:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:26 smithi179 bash[23186]: cluster 2024-09-21T03:56:24.888098+0000 mgr.a (mgr.14388) 14801 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:26 smithi179 bash[23186]: audit 2024-09-21T03:56:25.513023+0000 mgr.a (mgr.14388) 14802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:56:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:26 smithi179 bash[23186]: cephadm 2024-09-21T03:56:25.514222+0000 mgr.a (mgr.14388) 14803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:26 smithi049 bash[23528]: audit 2024-09-21T03:56:24.730272+0000 mgr.a (mgr.14388) 14800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:26 smithi049 bash[23528]: cluster 2024-09-21T03:56:24.888098+0000 mgr.a (mgr.14388) 14801 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-21T03:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:26 smithi049 bash[23528]: audit 2024-09-21T03:56:25.513023+0000 mgr.a (mgr.14388) 14802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:56:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:26 smithi049 bash[23528]: cephadm 2024-09-21T03:56:25.514222+0000 mgr.a (mgr.14388) 14803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:56:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:28 smithi044 bash[22676]: cluster 2024-09-21T03:56:26.890952+0000 mgr.a (mgr.14388) 14804 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 255 B/s wr, 65 op/s 2024-09-21T03:56:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:28 smithi179 bash[23186]: cluster 2024-09-21T03:56:26.890952+0000 mgr.a (mgr.14388) 14804 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 255 B/s wr, 65 op/s 2024-09-21T03:56:29.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:28 smithi049 bash[23528]: cluster 2024-09-21T03:56:26.890952+0000 mgr.a (mgr.14388) 14804 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 255 B/s wr, 65 op/s 2024-09-21T03:56:29.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:29.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:29.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:29 smithi044 bash[22676]: cluster 2024-09-21T03:56:28.891745+0000 mgr.a (mgr.14388) 14805 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:56:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:29 smithi044 bash[22676]: audit 2024-09-21T03:56:29.657526+0000 mgr.a (mgr.14388) 14806 : audit [DBG] from='client.320907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:30.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:29 smithi179 bash[23186]: cluster 2024-09-21T03:56:28.891745+0000 mgr.a (mgr.14388) 14805 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:56:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:29 smithi179 bash[23186]: audit 2024-09-21T03:56:29.657526+0000 mgr.a (mgr.14388) 14806 : audit [DBG] from='client.320907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:29 smithi049 bash[23528]: cluster 2024-09-21T03:56:28.891745+0000 mgr.a (mgr.14388) 14805 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T03:56:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:29 smithi049 bash[23528]: audit 2024-09-21T03:56:29.657526+0000 mgr.a (mgr.14388) 14806 : audit [DBG] from='client.320907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:30.086 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:30.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:30.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:30.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:30.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:32.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:31 smithi044 bash[22676]: cluster 2024-09-21T03:56:30.894144+0000 mgr.a (mgr.14388) 14807 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:32.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:31 smithi179 bash[23186]: cluster 2024-09-21T03:56:30.894144+0000 mgr.a (mgr.14388) 14807 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:32.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:31 smithi049 bash[23528]: cluster 2024-09-21T03:56:30.894144+0000 mgr.a (mgr.14388) 14807 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:34 smithi044 bash[22676]: cluster 2024-09-21T03:56:32.894900+0000 mgr.a (mgr.14388) 14808 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:34 smithi044 bash[22676]: audit 2024-09-21T03:56:33.685474+0000 mon.a (mon.0) 11906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:34 smithi044 bash[22676]: audit 2024-09-21T03:56:33.694460+0000 mon.a (mon.0) 11907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:34 smithi044 bash[22676]: audit 2024-09-21T03:56:33.705749+0000 mon.a (mon.0) 11908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:34 smithi179 bash[23186]: cluster 2024-09-21T03:56:32.894900+0000 mgr.a (mgr.14388) 14808 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:34 smithi179 bash[23186]: audit 2024-09-21T03:56:33.685474+0000 mon.a (mon.0) 11906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:34 smithi179 bash[23186]: audit 2024-09-21T03:56:33.694460+0000 mon.a (mon.0) 11907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:34 smithi179 bash[23186]: audit 2024-09-21T03:56:33.705749+0000 mon.a (mon.0) 11908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:35.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:34 smithi049 bash[23528]: cluster 2024-09-21T03:56:32.894900+0000 mgr.a (mgr.14388) 14808 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:34 smithi049 bash[23528]: audit 2024-09-21T03:56:33.685474+0000 mon.a (mon.0) 11906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:34 smithi049 bash[23528]: audit 2024-09-21T03:56:33.694460+0000 mon.a (mon.0) 11907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:34 smithi049 bash[23528]: audit 2024-09-21T03:56:33.705749+0000 mon.a (mon.0) 11908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:35.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:35.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:35.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:35.866 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:35.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:35.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:35.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:36.997 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:36 smithi044 bash[22676]: cluster 2024-09-21T03:56:34.895675+0000 mgr.a (mgr.14388) 14809 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:36.997 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:36 smithi044 bash[22676]: audit 2024-09-21T03:56:35.422371+0000 mgr.a (mgr.14388) 14810 : audit [DBG] from='client.320985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:36 smithi179 bash[23186]: cluster 2024-09-21T03:56:34.895675+0000 mgr.a (mgr.14388) 14809 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:36 smithi179 bash[23186]: audit 2024-09-21T03:56:35.422371+0000 mgr.a (mgr.14388) 14810 : audit [DBG] from='client.320985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:37.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:36 smithi049 bash[23528]: cluster 2024-09-21T03:56:34.895675+0000 mgr.a (mgr.14388) 14809 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:37.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:36 smithi049 bash[23528]: audit 2024-09-21T03:56:35.422371+0000 mgr.a (mgr.14388) 14810 : audit [DBG] from='client.320985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:38 smithi044 bash[22676]: cluster 2024-09-21T03:56:36.898571+0000 mgr.a (mgr.14388) 14811 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:38 smithi179 bash[23186]: cluster 2024-09-21T03:56:36.898571+0000 mgr.a (mgr.14388) 14811 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:38 smithi049 bash[23528]: cluster 2024-09-21T03:56:36.898571+0000 mgr.a (mgr.14388) 14811 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:56:40.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:40.868 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:40.868 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:40 smithi044 bash[22676]: cluster 2024-09-21T03:56:38.899398+0000 mgr.a (mgr.14388) 14812 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:56:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:40 smithi179 bash[23186]: cluster 2024-09-21T03:56:38.899398+0000 mgr.a (mgr.14388) 14812 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:56:41.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:40 smithi049 bash[23528]: cluster 2024-09-21T03:56:38.899398+0000 mgr.a (mgr.14388) 14812 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T03:56:41.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:41.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:41.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:41.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:41.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:42 smithi044 bash[22676]: cluster 2024-09-21T03:56:40.900716+0000 mgr.a (mgr.14388) 14813 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:56:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:42 smithi044 bash[22676]: audit 2024-09-21T03:56:41.207427+0000 mgr.a (mgr.14388) 14814 : audit [DBG] from='client.321060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:42 smithi179 bash[23186]: cluster 2024-09-21T03:56:40.900716+0000 mgr.a (mgr.14388) 14813 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:56:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:42 smithi179 bash[23186]: audit 2024-09-21T03:56:41.207427+0000 mgr.a (mgr.14388) 14814 : audit [DBG] from='client.321060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:42 smithi049 bash[23528]: cluster 2024-09-21T03:56:40.900716+0000 mgr.a (mgr.14388) 14813 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:56:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:42 smithi049 bash[23528]: audit 2024-09-21T03:56:41.207427+0000 mgr.a (mgr.14388) 14814 : audit [DBG] from='client.321060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:44 smithi044 bash[22676]: cluster 2024-09-21T03:56:42.901643+0000 mgr.a (mgr.14388) 14815 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:56:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:44 smithi179 bash[23186]: cluster 2024-09-21T03:56:42.901643+0000 mgr.a (mgr.14388) 14815 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:56:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:44 smithi049 bash[23528]: cluster 2024-09-21T03:56:42.901643+0000 mgr.a (mgr.14388) 14815 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:56:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:46 smithi179 bash[23186]: cluster 2024-09-21T03:56:44.902433+0000 mgr.a (mgr.14388) 14816 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:56:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:46 smithi179 bash[23186]: audit 2024-09-21T03:56:45.241130+0000 mon.a (mon.0) 11909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:46 smithi179 bash[23186]: audit 2024-09-21T03:56:45.248550+0000 mon.a (mon.0) 11910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:46 smithi179 bash[23186]: audit 2024-09-21T03:56:45.255870+0000 mon.a (mon.0) 11911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:46 smithi179 bash[23186]: audit 2024-09-21T03:56:45.405212+0000 mon.a (mon.0) 11912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:46 smithi179 bash[23186]: audit 2024-09-21T03:56:45.411310+0000 mon.a (mon.0) 11913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:46 smithi179 bash[23186]: audit 2024-09-21T03:56:45.418781+0000 mon.a (mon.0) 11914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:46 smithi049 bash[23528]: cluster 2024-09-21T03:56:44.902433+0000 mgr.a (mgr.14388) 14816 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:56:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:46 smithi049 bash[23528]: audit 2024-09-21T03:56:45.241130+0000 mon.a (mon.0) 11909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:46 smithi049 bash[23528]: audit 2024-09-21T03:56:45.248550+0000 mon.a (mon.0) 11910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:46 smithi049 bash[23528]: audit 2024-09-21T03:56:45.255870+0000 mon.a (mon.0) 11911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:46 smithi049 bash[23528]: audit 2024-09-21T03:56:45.405212+0000 mon.a (mon.0) 11912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:46 smithi049 bash[23528]: audit 2024-09-21T03:56:45.411310+0000 mon.a (mon.0) 11913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:46 smithi049 bash[23528]: audit 2024-09-21T03:56:45.418781+0000 mon.a (mon.0) 11914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:46.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:46.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:46.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:46 smithi044 bash[22676]: cluster 2024-09-21T03:56:44.902433+0000 mgr.a (mgr.14388) 14816 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:56:46.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:46 smithi044 bash[22676]: audit 2024-09-21T03:56:45.241130+0000 mon.a (mon.0) 11909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:46 smithi044 bash[22676]: audit 2024-09-21T03:56:45.248550+0000 mon.a (mon.0) 11910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:46 smithi044 bash[22676]: audit 2024-09-21T03:56:45.255870+0000 mon.a (mon.0) 11911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:46 smithi044 bash[22676]: audit 2024-09-21T03:56:45.405212+0000 mon.a (mon.0) 11912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:46 smithi044 bash[22676]: audit 2024-09-21T03:56:45.411310+0000 mon.a (mon.0) 11913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:46 smithi044 bash[22676]: audit 2024-09-21T03:56:45.418781+0000 mon.a (mon.0) 11914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:47.465 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:47.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:47.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:47.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:47.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:48.318 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:48 smithi179 bash[23186]: cluster 2024-09-21T03:56:46.904281+0000 mgr.a (mgr.14388) 14817 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:48.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:48 smithi179 bash[23186]: audit 2024-09-21T03:56:47.008503+0000 mgr.a (mgr.14388) 14818 : audit [DBG] from='client.321135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:48 smithi049 bash[23528]: cluster 2024-09-21T03:56:46.904281+0000 mgr.a (mgr.14388) 14817 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:48 smithi049 bash[23528]: audit 2024-09-21T03:56:47.008503+0000 mgr.a (mgr.14388) 14818 : audit [DBG] from='client.321135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:48 smithi044 bash[22676]: cluster 2024-09-21T03:56:46.904281+0000 mgr.a (mgr.14388) 14817 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:48 smithi044 bash[22676]: audit 2024-09-21T03:56:47.008503+0000 mgr.a (mgr.14388) 14818 : audit [DBG] from='client.321135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:50 smithi179 bash[23186]: cluster 2024-09-21T03:56:48.905178+0000 mgr.a (mgr.14388) 14819 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:50 smithi049 bash[23528]: cluster 2024-09-21T03:56:48.905178+0000 mgr.a (mgr.14388) 14819 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:50 smithi044 bash[22676]: cluster 2024-09-21T03:56:48.905178+0000 mgr.a (mgr.14388) 14819 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:52.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:52.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:52.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:52 smithi049 bash[23528]: cluster 2024-09-21T03:56:50.907549+0000 mgr.a (mgr.14388) 14820 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:52.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:52 smithi044 bash[22676]: cluster 2024-09-21T03:56:50.907549+0000 mgr.a (mgr.14388) 14820 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:52 smithi179 bash[23186]: cluster 2024-09-21T03:56:50.907549+0000 mgr.a (mgr.14388) 14820 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:53.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:54 smithi049 bash[23528]: audit 2024-09-21T03:56:52.799823+0000 mgr.a (mgr.14388) 14821 : audit [DBG] from='client.321213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:54 smithi049 bash[23528]: cluster 2024-09-21T03:56:52.908097+0000 mgr.a (mgr.14388) 14822 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:54 smithi049 bash[23528]: audit 2024-09-21T03:56:53.894375+0000 mon.a (mon.0) 11915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:54 smithi049 bash[23528]: audit 2024-09-21T03:56:53.903451+0000 mon.a (mon.0) 11916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:54 smithi049 bash[23528]: audit 2024-09-21T03:56:53.914118+0000 mon.a (mon.0) 11917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:54 smithi044 bash[22676]: audit 2024-09-21T03:56:52.799823+0000 mgr.a (mgr.14388) 14821 : audit [DBG] from='client.321213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:54 smithi044 bash[22676]: cluster 2024-09-21T03:56:52.908097+0000 mgr.a (mgr.14388) 14822 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:54 smithi044 bash[22676]: audit 2024-09-21T03:56:53.894375+0000 mon.a (mon.0) 11915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:54 smithi044 bash[22676]: audit 2024-09-21T03:56:53.903451+0000 mon.a (mon.0) 11916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:54 smithi044 bash[22676]: audit 2024-09-21T03:56:53.914118+0000 mon.a (mon.0) 11917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:54 smithi179 bash[23186]: audit 2024-09-21T03:56:52.799823+0000 mgr.a (mgr.14388) 14821 : audit [DBG] from='client.321213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:54 smithi179 bash[23186]: cluster 2024-09-21T03:56:52.908097+0000 mgr.a (mgr.14388) 14822 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:54 smithi179 bash[23186]: audit 2024-09-21T03:56:53.894375+0000 mon.a (mon.0) 11915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:54 smithi179 bash[23186]: audit 2024-09-21T03:56:53.903451+0000 mon.a (mon.0) 11916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:54 smithi179 bash[23186]: audit 2024-09-21T03:56:53.914118+0000 mon.a (mon.0) 11917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:56:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:56 smithi049 bash[23528]: cluster 2024-09-21T03:56:54.908938+0000 mgr.a (mgr.14388) 14823 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:56 smithi044 bash[22676]: cluster 2024-09-21T03:56:54.908938+0000 mgr.a (mgr.14388) 14823 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:56 smithi179 bash[23186]: cluster 2024-09-21T03:56:54.908938+0000 mgr.a (mgr.14388) 14823 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:56:58.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:56:58.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:56:58.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:56:58.422 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:58 smithi044 bash[22676]: cluster 2024-09-21T03:56:56.911168+0000 mgr.a (mgr.14388) 14824 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:58 smithi179 bash[23186]: cluster 2024-09-21T03:56:56.911168+0000 mgr.a (mgr.14388) 14824 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:58 smithi049 bash[23528]: cluster 2024-09-21T03:56:56.911168+0000 mgr.a (mgr.14388) 14824 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:56:59.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:56:59.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:56:59.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:56:59.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:56:59.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:56:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:56:59 smithi044 bash[22676]: audit 2024-09-21T03:56:58.580917+0000 mgr.a (mgr.14388) 14825 : audit [DBG] from='client.321291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:56:59 smithi049 bash[23528]: audit 2024-09-21T03:56:58.580917+0000 mgr.a (mgr.14388) 14825 : audit [DBG] from='client.321291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:56:59 smithi179 bash[23186]: audit 2024-09-21T03:56:58.580917+0000 mgr.a (mgr.14388) 14825 : audit [DBG] from='client.321291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:00.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:00 smithi049 bash[23528]: cluster 2024-09-21T03:56:58.919294+0000 mgr.a (mgr.14388) 14826 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:00.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:00 smithi044 bash[22676]: cluster 2024-09-21T03:56:58.919294+0000 mgr.a (mgr.14388) 14826 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:00 smithi179 bash[23186]: cluster 2024-09-21T03:56:58.919294+0000 mgr.a (mgr.14388) 14826 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:02.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:02 smithi049 bash[23528]: cluster 2024-09-21T03:57:00.921604+0000 mgr.a (mgr.14388) 14827 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:02 smithi044 bash[22676]: cluster 2024-09-21T03:57:00.921604+0000 mgr.a (mgr.14388) 14827 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:02 smithi179 bash[23186]: cluster 2024-09-21T03:57:00.921604+0000 mgr.a (mgr.14388) 14827 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:04.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:04.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:04 smithi049 bash[23528]: cluster 2024-09-21T03:57:02.922374+0000 mgr.a (mgr.14388) 14828 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:04 smithi044 bash[22676]: cluster 2024-09-21T03:57:02.922374+0000 mgr.a (mgr.14388) 14828 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:04 smithi179 bash[23186]: cluster 2024-09-21T03:57:02.922374+0000 mgr.a (mgr.14388) 14828 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:04.812 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:04.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:04.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:04.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:04.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:05 smithi049 bash[23528]: audit 2024-09-21T03:57:04.357343+0000 mgr.a (mgr.14388) 14829 : audit [DBG] from='client.321366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:05.664 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:05 smithi044 bash[22676]: audit 2024-09-21T03:57:04.357343+0000 mgr.a (mgr.14388) 14829 : audit [DBG] from='client.321366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:05 smithi179 bash[23186]: audit 2024-09-21T03:57:04.357343+0000 mgr.a (mgr.14388) 14829 : audit [DBG] from='client.321366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:06 smithi044 bash[22676]: cluster 2024-09-21T03:57:04.923327+0000 mgr.a (mgr.14388) 14830 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:06 smithi044 bash[22676]: audit 2024-09-21T03:57:05.453197+0000 mon.a (mon.0) 11918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:06 smithi044 bash[22676]: audit 2024-09-21T03:57:05.460621+0000 mon.a (mon.0) 11919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:06 smithi044 bash[22676]: audit 2024-09-21T03:57:05.469685+0000 mon.a (mon.0) 11920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:06 smithi044 bash[22676]: audit 2024-09-21T03:57:05.638894+0000 mon.a (mon.0) 11921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:06 smithi044 bash[22676]: audit 2024-09-21T03:57:05.648902+0000 mon.a (mon.0) 11922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:06 smithi044 bash[22676]: audit 2024-09-21T03:57:05.660767+0000 mon.a (mon.0) 11923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:06 smithi179 bash[23186]: cluster 2024-09-21T03:57:04.923327+0000 mgr.a (mgr.14388) 14830 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:06 smithi179 bash[23186]: audit 2024-09-21T03:57:05.453197+0000 mon.a (mon.0) 11918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:06 smithi179 bash[23186]: audit 2024-09-21T03:57:05.460621+0000 mon.a (mon.0) 11919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:06 smithi179 bash[23186]: audit 2024-09-21T03:57:05.469685+0000 mon.a (mon.0) 11920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:06 smithi179 bash[23186]: audit 2024-09-21T03:57:05.638894+0000 mon.a (mon.0) 11921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:06 smithi179 bash[23186]: audit 2024-09-21T03:57:05.648902+0000 mon.a (mon.0) 11922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:06 smithi179 bash[23186]: audit 2024-09-21T03:57:05.660767+0000 mon.a (mon.0) 11923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:06 smithi049 bash[23528]: cluster 2024-09-21T03:57:04.923327+0000 mgr.a (mgr.14388) 14830 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:06 smithi049 bash[23528]: audit 2024-09-21T03:57:05.453197+0000 mon.a (mon.0) 11918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:06 smithi049 bash[23528]: audit 2024-09-21T03:57:05.460621+0000 mon.a (mon.0) 11919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:06 smithi049 bash[23528]: audit 2024-09-21T03:57:05.469685+0000 mon.a (mon.0) 11920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:06 smithi049 bash[23528]: audit 2024-09-21T03:57:05.638894+0000 mon.a (mon.0) 11921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:06 smithi049 bash[23528]: audit 2024-09-21T03:57:05.648902+0000 mon.a (mon.0) 11922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:06 smithi049 bash[23528]: audit 2024-09-21T03:57:05.660767+0000 mon.a (mon.0) 11923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:08 smithi044 bash[22676]: cluster 2024-09-21T03:57:06.925611+0000 mgr.a (mgr.14388) 14831 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:08.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:08 smithi179 bash[23186]: cluster 2024-09-21T03:57:06.925611+0000 mgr.a (mgr.14388) 14831 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:08 smithi049 bash[23528]: cluster 2024-09-21T03:57:06.925611+0000 mgr.a (mgr.14388) 14831 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:09.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:09.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:09.814 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:10.601 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:10 smithi044 bash[22676]: cluster 2024-09-21T03:57:08.926361+0000 mgr.a (mgr.14388) 14832 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:10 smithi179 bash[23186]: cluster 2024-09-21T03:57:08.926361+0000 mgr.a (mgr.14388) 14832 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:10 smithi049 bash[23528]: cluster 2024-09-21T03:57:08.926361+0000 mgr.a (mgr.14388) 14832 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:11 smithi044 bash[22676]: audit 2024-09-21T03:57:10.154906+0000 mgr.a (mgr.14388) 14833 : audit [DBG] from='client.321441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:11.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:11 smithi179 bash[23186]: audit 2024-09-21T03:57:10.154906+0000 mgr.a (mgr.14388) 14833 : audit [DBG] from='client.321441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:11.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:11 smithi049 bash[23528]: audit 2024-09-21T03:57:10.154906+0000 mgr.a (mgr.14388) 14833 : audit [DBG] from='client.321441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:12 smithi044 bash[22676]: cluster 2024-09-21T03:57:10.929123+0000 mgr.a (mgr.14388) 14834 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:12 smithi179 bash[23186]: cluster 2024-09-21T03:57:10.929123+0000 mgr.a (mgr.14388) 14834 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:12 smithi049 bash[23528]: cluster 2024-09-21T03:57:10.929123+0000 mgr.a (mgr.14388) 14834 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:14 smithi044 bash[22676]: cluster 2024-09-21T03:57:12.929907+0000 mgr.a (mgr.14388) 14835 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:14 smithi044 bash[22676]: audit 2024-09-21T03:57:14.066946+0000 mon.a (mon.0) 11924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:14 smithi044 bash[22676]: audit 2024-09-21T03:57:14.076862+0000 mon.a (mon.0) 11925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:14 smithi044 bash[22676]: audit 2024-09-21T03:57:14.087213+0000 mon.a (mon.0) 11926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:14 smithi179 bash[23186]: cluster 2024-09-21T03:57:12.929907+0000 mgr.a (mgr.14388) 14835 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:14 smithi179 bash[23186]: audit 2024-09-21T03:57:14.066946+0000 mon.a (mon.0) 11924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:14 smithi179 bash[23186]: audit 2024-09-21T03:57:14.076862+0000 mon.a (mon.0) 11925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:14 smithi179 bash[23186]: audit 2024-09-21T03:57:14.087213+0000 mon.a (mon.0) 11926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:14 smithi049 bash[23528]: cluster 2024-09-21T03:57:12.929907+0000 mgr.a (mgr.14388) 14835 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:14.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:14 smithi049 bash[23528]: audit 2024-09-21T03:57:14.066946+0000 mon.a (mon.0) 11924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.798 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:14 smithi049 bash[23528]: audit 2024-09-21T03:57:14.076862+0000 mon.a (mon.0) 11925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:14.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:14 smithi049 bash[23528]: audit 2024-09-21T03:57:14.087213+0000 mon.a (mon.0) 11926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:15.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:15.604 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:15.604 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:16.394 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:16.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:16 smithi044 bash[22676]: cluster 2024-09-21T03:57:14.930821+0000 mgr.a (mgr.14388) 14836 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:57:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:16 smithi179 bash[23186]: cluster 2024-09-21T03:57:14.930821+0000 mgr.a (mgr.14388) 14836 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:57:16.797 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:16 smithi049 bash[23528]: cluster 2024-09-21T03:57:14.930821+0000 mgr.a (mgr.14388) 14836 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:57:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:17 smithi044 bash[22676]: audit 2024-09-21T03:57:15.940657+0000 mgr.a (mgr.14388) 14837 : audit [DBG] from='client.321516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:17 smithi179 bash[23186]: audit 2024-09-21T03:57:15.940657+0000 mgr.a (mgr.14388) 14837 : audit [DBG] from='client.321516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:17.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:17 smithi049 bash[23528]: audit 2024-09-21T03:57:15.940657+0000 mgr.a (mgr.14388) 14837 : audit [DBG] from='client.321516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:18.566 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:18 smithi044 bash[22676]: cluster 2024-09-21T03:57:16.933764+0000 mgr.a (mgr.14388) 14838 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:18 smithi179 bash[23186]: cluster 2024-09-21T03:57:16.933764+0000 mgr.a (mgr.14388) 14838 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:18 smithi049 bash[23528]: cluster 2024-09-21T03:57:16.933764+0000 mgr.a (mgr.14388) 14838 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:20 smithi044 bash[22676]: cluster 2024-09-21T03:57:18.934538+0000 mgr.a (mgr.14388) 14839 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:20 smithi179 bash[23186]: cluster 2024-09-21T03:57:18.934538+0000 mgr.a (mgr.14388) 14839 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:20 smithi049 bash[23528]: cluster 2024-09-21T03:57:18.934538+0000 mgr.a (mgr.14388) 14839 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:21.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:21.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:21.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:22.188 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:22 smithi049 bash[23528]: cluster 2024-09-21T03:57:20.935714+0000 mgr.a (mgr.14388) 14840 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:22 smithi044 bash[22676]: cluster 2024-09-21T03:57:20.935714+0000 mgr.a (mgr.14388) 14840 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:22 smithi179 bash[23186]: cluster 2024-09-21T03:57:20.935714+0000 mgr.a (mgr.14388) 14840 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:23.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:23 smithi049 bash[23528]: audit 2024-09-21T03:57:21.734159+0000 mgr.a (mgr.14388) 14841 : audit [DBG] from='client.321591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:23.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:23 smithi044 bash[22676]: audit 2024-09-21T03:57:21.734159+0000 mgr.a (mgr.14388) 14841 : audit [DBG] from='client.321591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:24.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:23 smithi179 bash[23186]: audit 2024-09-21T03:57:21.734159+0000 mgr.a (mgr.14388) 14841 : audit [DBG] from='client.321591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:24 smithi049 bash[23528]: cluster 2024-09-21T03:57:22.936715+0000 mgr.a (mgr.14388) 14842 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:24 smithi044 bash[22676]: cluster 2024-09-21T03:57:22.936715+0000 mgr.a (mgr.14388) 14842 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:24 smithi179 bash[23186]: cluster 2024-09-21T03:57:22.936715+0000 mgr.a (mgr.14388) 14842 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:26.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22930]: debug 2024-09-21T03:57:26.441+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:57:26.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22930]: debug 2024-09-21T03:57:26.441+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:57:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: cluster 2024-09-21T03:57:24.937573+0000 mgr.a (mgr.14388) 14843 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.587004+0000 mon.a (mon.0) 11927 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:57:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.594337+0000 mon.a (mon.0) 11928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:57:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.596355+0000 mon.a (mon.0) 11929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:57:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.607422+0000 mon.a (mon.0) 11930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.613859+0000 mon.a (mon.0) 11931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:57:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.616407+0000 mgr.a (mgr.14388) 14844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:57:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.682022+0000 mon.a (mon.0) 11932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.688668+0000 mon.a (mon.0) 11933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.698065+0000 mon.a (mon.0) 11934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.806213+0000 mon.a (mon.0) 11935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.812167+0000 mon.a (mon.0) 11936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:26 smithi044 bash[22676]: audit 2024-09-21T03:57:25.819470+0000 mon.a (mon.0) 11937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: cluster 2024-09-21T03:57:24.937573+0000 mgr.a (mgr.14388) 14843 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.587004+0000 mon.a (mon.0) 11927 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.594337+0000 mon.a (mon.0) 11928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.596355+0000 mon.a (mon.0) 11929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.607422+0000 mon.a (mon.0) 11930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.613859+0000 mon.a (mon.0) 11931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.616407+0000 mgr.a (mgr.14388) 14844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.682022+0000 mon.a (mon.0) 11932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.688668+0000 mon.a (mon.0) 11933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.698065+0000 mon.a (mon.0) 11934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.806213+0000 mon.a (mon.0) 11935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.812167+0000 mon.a (mon.0) 11936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:26.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:26 smithi049 bash[23528]: audit 2024-09-21T03:57:25.819470+0000 mon.a (mon.0) 11937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: cluster 2024-09-21T03:57:24.937573+0000 mgr.a (mgr.14388) 14843 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.587004+0000 mon.a (mon.0) 11927 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:57:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.594337+0000 mon.a (mon.0) 11928 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:57:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.596355+0000 mon.a (mon.0) 11929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:57:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.607422+0000 mon.a (mon.0) 11930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.613859+0000 mon.a (mon.0) 11931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.616407+0000 mgr.a (mgr.14388) 14844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.682022+0000 mon.a (mon.0) 11932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.688668+0000 mon.a (mon.0) 11933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.698065+0000 mon.a (mon.0) 11934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.806213+0000 mon.a (mon.0) 11935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.812167+0000 mon.a (mon.0) 11936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:26 smithi179 bash[23186]: audit 2024-09-21T03:57:25.819470+0000 mon.a (mon.0) 11937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:27.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:27 smithi179 bash[23186]: audit 2024-09-21T03:57:26.442514+0000 mgr.a (mgr.14388) 14845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:57:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:27 smithi179 bash[23186]: cephadm 2024-09-21T03:57:26.443960+0000 mgr.a (mgr.14388) 14846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:27 smithi049 bash[23528]: audit 2024-09-21T03:57:26.442514+0000 mgr.a (mgr.14388) 14845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:57:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:27 smithi049 bash[23528]: cephadm 2024-09-21T03:57:26.443960+0000 mgr.a (mgr.14388) 14846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:57:27.944 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:27.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:27.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:27.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:27.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:27 smithi044 bash[22676]: audit 2024-09-21T03:57:26.442514+0000 mgr.a (mgr.14388) 14845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:57:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:27 smithi044 bash[22676]: cephadm 2024-09-21T03:57:26.443960+0000 mgr.a (mgr.14388) 14846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:57:28.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:28 smithi179 bash[23186]: cluster 2024-09-21T03:57:26.940412+0000 mgr.a (mgr.14388) 14847 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:28.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:28 smithi179 bash[23186]: audit 2024-09-21T03:57:27.518958+0000 mgr.a (mgr.14388) 14848 : audit [DBG] from='client.321777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:28 smithi049 bash[23528]: cluster 2024-09-21T03:57:26.940412+0000 mgr.a (mgr.14388) 14847 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:28 smithi049 bash[23528]: audit 2024-09-21T03:57:27.518958+0000 mgr.a (mgr.14388) 14848 : audit [DBG] from='client.321777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:28 smithi044 bash[22676]: cluster 2024-09-21T03:57:26.940412+0000 mgr.a (mgr.14388) 14847 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:57:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:28 smithi044 bash[22676]: audit 2024-09-21T03:57:27.518958+0000 mgr.a (mgr.14388) 14848 : audit [DBG] from='client.321777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:30 smithi179 bash[23186]: cluster 2024-09-21T03:57:28.941355+0000 mgr.a (mgr.14388) 14849 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:30 smithi049 bash[23528]: cluster 2024-09-21T03:57:28.941355+0000 mgr.a (mgr.14388) 14849 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:30 smithi044 bash[22676]: cluster 2024-09-21T03:57:28.941355+0000 mgr.a (mgr.14388) 14849 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:32 smithi049 bash[23528]: cluster 2024-09-21T03:57:30.943617+0000 mgr.a (mgr.14388) 14850 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:32 smithi044 bash[22676]: cluster 2024-09-21T03:57:30.943617+0000 mgr.a (mgr.14388) 14850 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:32 smithi179 bash[23186]: cluster 2024-09-21T03:57:30.943617+0000 mgr.a (mgr.14388) 14850 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:33.729 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:33.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:33.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:33.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:33.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:34 smithi049 bash[23528]: cluster 2024-09-21T03:57:32.944362+0000 mgr.a (mgr.14388) 14851 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:34 smithi049 bash[23528]: audit 2024-09-21T03:57:33.280497+0000 mgr.a (mgr.14388) 14852 : audit [DBG] from='client.321852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:34 smithi049 bash[23528]: audit 2024-09-21T03:57:34.247828+0000 mon.a (mon.0) 11938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:34 smithi049 bash[23528]: audit 2024-09-21T03:57:34.258089+0000 mon.a (mon.0) 11939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:34 smithi049 bash[23528]: audit 2024-09-21T03:57:34.269174+0000 mon.a (mon.0) 11940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:34 smithi044 bash[22676]: cluster 2024-09-21T03:57:32.944362+0000 mgr.a (mgr.14388) 14851 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:34 smithi044 bash[22676]: audit 2024-09-21T03:57:33.280497+0000 mgr.a (mgr.14388) 14852 : audit [DBG] from='client.321852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:34 smithi044 bash[22676]: audit 2024-09-21T03:57:34.247828+0000 mon.a (mon.0) 11938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:34 smithi044 bash[22676]: audit 2024-09-21T03:57:34.258089+0000 mon.a (mon.0) 11939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:34 smithi044 bash[22676]: audit 2024-09-21T03:57:34.269174+0000 mon.a (mon.0) 11940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:34 smithi179 bash[23186]: cluster 2024-09-21T03:57:32.944362+0000 mgr.a (mgr.14388) 14851 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:34 smithi179 bash[23186]: audit 2024-09-21T03:57:33.280497+0000 mgr.a (mgr.14388) 14852 : audit [DBG] from='client.321852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:34 smithi179 bash[23186]: audit 2024-09-21T03:57:34.247828+0000 mon.a (mon.0) 11938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:34 smithi179 bash[23186]: audit 2024-09-21T03:57:34.258089+0000 mon.a (mon.0) 11939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:34 smithi179 bash[23186]: audit 2024-09-21T03:57:34.269174+0000 mon.a (mon.0) 11940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:36 smithi049 bash[23528]: cluster 2024-09-21T03:57:34.945304+0000 mgr.a (mgr.14388) 14853 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:36.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:36 smithi044 bash[22676]: cluster 2024-09-21T03:57:34.945304+0000 mgr.a (mgr.14388) 14853 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:36 smithi179 bash[23186]: cluster 2024-09-21T03:57:34.945304+0000 mgr.a (mgr.14388) 14853 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:38.838 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:38 smithi044 bash[22676]: cluster 2024-09-21T03:57:36.947510+0000 mgr.a (mgr.14388) 14854 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:38 smithi179 bash[23186]: cluster 2024-09-21T03:57:36.947510+0000 mgr.a (mgr.14388) 14854 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:38 smithi049 bash[23528]: cluster 2024-09-21T03:57:36.947510+0000 mgr.a (mgr.14388) 14854 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:39.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:39.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:39.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:39.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:39.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:40 smithi044 bash[22676]: cluster 2024-09-21T03:57:38.947974+0000 mgr.a (mgr.14388) 14855 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:40 smithi044 bash[22676]: audit 2024-09-21T03:57:39.070151+0000 mgr.a (mgr.14388) 14856 : audit [DBG] from='client.321930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:40 smithi179 bash[23186]: cluster 2024-09-21T03:57:38.947974+0000 mgr.a (mgr.14388) 14855 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:40 smithi179 bash[23186]: audit 2024-09-21T03:57:39.070151+0000 mgr.a (mgr.14388) 14856 : audit [DBG] from='client.321930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:40 smithi049 bash[23528]: cluster 2024-09-21T03:57:38.947974+0000 mgr.a (mgr.14388) 14855 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:40 smithi049 bash[23528]: audit 2024-09-21T03:57:39.070151+0000 mgr.a (mgr.14388) 14856 : audit [DBG] from='client.321930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:42.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:42 smithi044 bash[22676]: cluster 2024-09-21T03:57:40.950139+0000 mgr.a (mgr.14388) 14857 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:43.008 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:42 smithi179 bash[23186]: cluster 2024-09-21T03:57:40.950139+0000 mgr.a (mgr.14388) 14857 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:42 smithi049 bash[23528]: cluster 2024-09-21T03:57:40.950139+0000 mgr.a (mgr.14388) 14857 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:57:44.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:44.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:44.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:44 smithi044 bash[22676]: cluster 2024-09-21T03:57:42.950869+0000 mgr.a (mgr.14388) 14858 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:44 smithi179 bash[23186]: cluster 2024-09-21T03:57:42.950869+0000 mgr.a (mgr.14388) 14858 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:44 smithi049 bash[23528]: cluster 2024-09-21T03:57:42.950869+0000 mgr.a (mgr.14388) 14858 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:45.305 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: audit 2024-09-21T03:57:44.850610+0000 mgr.a (mgr.14388) 14859 : audit [DBG] from='client.322008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: cluster 2024-09-21T03:57:44.951321+0000 mgr.a (mgr.14388) 14860 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: audit 2024-09-21T03:57:45.896679+0000 mon.a (mon.0) 11941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: audit 2024-09-21T03:57:45.905189+0000 mon.a (mon.0) 11942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: audit 2024-09-21T03:57:45.916250+0000 mon.a (mon.0) 11943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: audit 2024-09-21T03:57:46.038689+0000 mon.a (mon.0) 11944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: audit 2024-09-21T03:57:46.047179+0000 mon.a (mon.0) 11945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:46 smithi044 bash[22676]: audit 2024-09-21T03:57:46.057387+0000 mon.a (mon.0) 11946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: audit 2024-09-21T03:57:44.850610+0000 mgr.a (mgr.14388) 14859 : audit [DBG] from='client.322008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: cluster 2024-09-21T03:57:44.951321+0000 mgr.a (mgr.14388) 14860 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: audit 2024-09-21T03:57:45.896679+0000 mon.a (mon.0) 11941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: audit 2024-09-21T03:57:45.905189+0000 mon.a (mon.0) 11942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: audit 2024-09-21T03:57:45.916250+0000 mon.a (mon.0) 11943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: audit 2024-09-21T03:57:46.038689+0000 mon.a (mon.0) 11944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: audit 2024-09-21T03:57:46.047179+0000 mon.a (mon.0) 11945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:46 smithi179 bash[23186]: audit 2024-09-21T03:57:46.057387+0000 mon.a (mon.0) 11946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: audit 2024-09-21T03:57:44.850610+0000 mgr.a (mgr.14388) 14859 : audit [DBG] from='client.322008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: cluster 2024-09-21T03:57:44.951321+0000 mgr.a (mgr.14388) 14860 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: audit 2024-09-21T03:57:45.896679+0000 mon.a (mon.0) 11941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: audit 2024-09-21T03:57:45.905189+0000 mon.a (mon.0) 11942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: audit 2024-09-21T03:57:45.916250+0000 mon.a (mon.0) 11943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: audit 2024-09-21T03:57:46.038689+0000 mon.a (mon.0) 11944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: audit 2024-09-21T03:57:46.047179+0000 mon.a (mon.0) 11945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:46 smithi049 bash[23528]: audit 2024-09-21T03:57:46.057387+0000 mon.a (mon.0) 11946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:48.861 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:48 smithi179 bash[23186]: cluster 2024-09-21T03:57:46.954161+0000 mgr.a (mgr.14388) 14861 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:57:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:48 smithi044 bash[22676]: cluster 2024-09-21T03:57:46.954161+0000 mgr.a (mgr.14388) 14861 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:57:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:48 smithi049 bash[23528]: cluster 2024-09-21T03:57:46.954161+0000 mgr.a (mgr.14388) 14861 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T03:57:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:50.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:50.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:50 smithi179 bash[23186]: cluster 2024-09-21T03:57:48.954975+0000 mgr.a (mgr.14388) 14862 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:57:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:50 smithi044 bash[22676]: cluster 2024-09-21T03:57:48.954975+0000 mgr.a (mgr.14388) 14862 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:57:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:50 smithi049 bash[23528]: cluster 2024-09-21T03:57:48.954975+0000 mgr.a (mgr.14388) 14862 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T03:57:51.059 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:51.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:51.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:51.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:51.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:51.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:51 smithi044 bash[22676]: audit 2024-09-21T03:57:50.638721+0000 mgr.a (mgr.14388) 14863 : audit [DBG] from='client.322086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:51 smithi179 bash[23186]: audit 2024-09-21T03:57:50.638721+0000 mgr.a (mgr.14388) 14863 : audit [DBG] from='client.322086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:51 smithi049 bash[23528]: audit 2024-09-21T03:57:50.638721+0000 mgr.a (mgr.14388) 14863 : audit [DBG] from='client.322086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:52 smithi044 bash[22676]: cluster 2024-09-21T03:57:50.960475+0000 mgr.a (mgr.14388) 14864 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:52 smithi179 bash[23186]: cluster 2024-09-21T03:57:50.960475+0000 mgr.a (mgr.14388) 14864 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:52 smithi049 bash[23528]: cluster 2024-09-21T03:57:50.960475+0000 mgr.a (mgr.14388) 14864 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:54 smithi049 bash[23528]: cluster 2024-09-21T03:57:52.961480+0000 mgr.a (mgr.14388) 14865 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:54 smithi049 bash[23528]: audit 2024-09-21T03:57:54.451255+0000 mon.a (mon.0) 11947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:54 smithi049 bash[23528]: audit 2024-09-21T03:57:54.460037+0000 mon.a (mon.0) 11948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:54 smithi049 bash[23528]: audit 2024-09-21T03:57:54.472034+0000 mon.a (mon.0) 11949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:54 smithi044 bash[22676]: cluster 2024-09-21T03:57:52.961480+0000 mgr.a (mgr.14388) 14865 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:54 smithi044 bash[22676]: audit 2024-09-21T03:57:54.451255+0000 mon.a (mon.0) 11947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:54 smithi044 bash[22676]: audit 2024-09-21T03:57:54.460037+0000 mon.a (mon.0) 11948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:54 smithi044 bash[22676]: audit 2024-09-21T03:57:54.472034+0000 mon.a (mon.0) 11949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:54 smithi179 bash[23186]: cluster 2024-09-21T03:57:52.961480+0000 mgr.a (mgr.14388) 14865 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:54 smithi179 bash[23186]: audit 2024-09-21T03:57:54.451255+0000 mon.a (mon.0) 11947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:54 smithi179 bash[23186]: audit 2024-09-21T03:57:54.460037+0000 mon.a (mon.0) 11948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:54 smithi179 bash[23186]: audit 2024-09-21T03:57:54.472034+0000 mon.a (mon.0) 11949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:57:56.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:57:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:57:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:57:56.855 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:57:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:57:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:57:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:57:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:57:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:56 smithi044 bash[22676]: cluster 2024-09-21T03:57:54.962295+0000 mgr.a (mgr.14388) 14866 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:56 smithi179 bash[23186]: cluster 2024-09-21T03:57:54.962295+0000 mgr.a (mgr.14388) 14866 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:56 smithi049 bash[23528]: cluster 2024-09-21T03:57:54.962295+0000 mgr.a (mgr.14388) 14866 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:57:57.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:57 smithi049 bash[23528]: audit 2024-09-21T03:57:56.399515+0000 mgr.a (mgr.14388) 14867 : audit [DBG] from='client.322164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:57.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:57 smithi044 bash[22676]: audit 2024-09-21T03:57:56.399515+0000 mgr.a (mgr.14388) 14867 : audit [DBG] from='client.322164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:58.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:57 smithi179 bash[23186]: audit 2024-09-21T03:57:56.399515+0000 mgr.a (mgr.14388) 14867 : audit [DBG] from='client.322164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:57:58 smithi044 bash[22676]: cluster 2024-09-21T03:57:56.963733+0000 mgr.a (mgr.14388) 14868 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:57:58 smithi179 bash[23186]: cluster 2024-09-21T03:57:56.963733+0000 mgr.a (mgr.14388) 14868 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:57:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:57:58 smithi049 bash[23528]: cluster 2024-09-21T03:57:56.963733+0000 mgr.a (mgr.14388) 14868 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:00 smithi044 bash[22676]: cluster 2024-09-21T03:57:58.964516+0000 mgr.a (mgr.14388) 14869 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:58:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:00 smithi179 bash[23186]: cluster 2024-09-21T03:57:58.964516+0000 mgr.a (mgr.14388) 14869 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:58:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:00 smithi049 bash[23528]: cluster 2024-09-21T03:57:58.964516+0000 mgr.a (mgr.14388) 14869 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T03:58:01.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:01.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:01.857 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:02.615 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:02 smithi044 bash[22676]: cluster 2024-09-21T03:58:00.966600+0000 mgr.a (mgr.14388) 14870 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:58:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:02 smithi179 bash[23186]: cluster 2024-09-21T03:58:00.966600+0000 mgr.a (mgr.14388) 14870 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:58:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:02 smithi049 bash[23528]: cluster 2024-09-21T03:58:00.966600+0000 mgr.a (mgr.14388) 14870 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T03:58:03.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:03 smithi044 bash[22676]: audit 2024-09-21T03:58:02.193850+0000 mgr.a (mgr.14388) 14871 : audit [DBG] from='client.322239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:04.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:03 smithi179 bash[23186]: audit 2024-09-21T03:58:02.193850+0000 mgr.a (mgr.14388) 14871 : audit [DBG] from='client.322239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:03 smithi049 bash[23528]: audit 2024-09-21T03:58:02.193850+0000 mgr.a (mgr.14388) 14871 : audit [DBG] from='client.322239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:04 smithi044 bash[22676]: cluster 2024-09-21T03:58:02.967707+0000 mgr.a (mgr.14388) 14872 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:04 smithi179 bash[23186]: cluster 2024-09-21T03:58:02.967707+0000 mgr.a (mgr.14388) 14872 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:04 smithi049 bash[23528]: cluster 2024-09-21T03:58:02.967707+0000 mgr.a (mgr.14388) 14872 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:06 smithi044 bash[22676]: cluster 2024-09-21T03:58:04.968676+0000 mgr.a (mgr.14388) 14873 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:06 smithi044 bash[22676]: audit 2024-09-21T03:58:06.111430+0000 mon.a (mon.0) 11950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:06 smithi044 bash[22676]: audit 2024-09-21T03:58:06.118221+0000 mon.a (mon.0) 11951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:06 smithi044 bash[22676]: audit 2024-09-21T03:58:06.126758+0000 mon.a (mon.0) 11952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:06 smithi044 bash[22676]: audit 2024-09-21T03:58:06.266368+0000 mon.a (mon.0) 11953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:06 smithi044 bash[22676]: audit 2024-09-21T03:58:06.275463+0000 mon.a (mon.0) 11954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:06 smithi044 bash[22676]: audit 2024-09-21T03:58:06.286895+0000 mon.a (mon.0) 11955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:06 smithi179 bash[23186]: cluster 2024-09-21T03:58:04.968676+0000 mgr.a (mgr.14388) 14873 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:06 smithi179 bash[23186]: audit 2024-09-21T03:58:06.111430+0000 mon.a (mon.0) 11950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:06 smithi179 bash[23186]: audit 2024-09-21T03:58:06.118221+0000 mon.a (mon.0) 11951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:06 smithi179 bash[23186]: audit 2024-09-21T03:58:06.126758+0000 mon.a (mon.0) 11952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:06 smithi179 bash[23186]: audit 2024-09-21T03:58:06.266368+0000 mon.a (mon.0) 11953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:06 smithi179 bash[23186]: audit 2024-09-21T03:58:06.275463+0000 mon.a (mon.0) 11954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:06 smithi179 bash[23186]: audit 2024-09-21T03:58:06.286895+0000 mon.a (mon.0) 11955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:06 smithi049 bash[23528]: cluster 2024-09-21T03:58:04.968676+0000 mgr.a (mgr.14388) 14873 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:06 smithi049 bash[23528]: audit 2024-09-21T03:58:06.111430+0000 mon.a (mon.0) 11950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:06 smithi049 bash[23528]: audit 2024-09-21T03:58:06.118221+0000 mon.a (mon.0) 11951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:06 smithi049 bash[23528]: audit 2024-09-21T03:58:06.126758+0000 mon.a (mon.0) 11952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:06 smithi049 bash[23528]: audit 2024-09-21T03:58:06.266368+0000 mon.a (mon.0) 11953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:06 smithi049 bash[23528]: audit 2024-09-21T03:58:06.275463+0000 mon.a (mon.0) 11954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:06 smithi049 bash[23528]: audit 2024-09-21T03:58:06.286895+0000 mon.a (mon.0) 11955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:07.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:08.384 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:08.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:08.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:08.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:08.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:08 smithi044 bash[22676]: cluster 2024-09-21T03:58:06.970971+0000 mgr.a (mgr.14388) 14874 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:08 smithi179 bash[23186]: cluster 2024-09-21T03:58:06.970971+0000 mgr.a (mgr.14388) 14874 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:08 smithi049 bash[23528]: cluster 2024-09-21T03:58:06.970971+0000 mgr.a (mgr.14388) 14874 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:09.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:09 smithi044 bash[22676]: audit 2024-09-21T03:58:07.952423+0000 mgr.a (mgr.14388) 14875 : audit [DBG] from='client.322317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:09 smithi179 bash[23186]: audit 2024-09-21T03:58:07.952423+0000 mgr.a (mgr.14388) 14875 : audit [DBG] from='client.322317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:10.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:09 smithi049 bash[23528]: audit 2024-09-21T03:58:07.952423+0000 mgr.a (mgr.14388) 14875 : audit [DBG] from='client.322317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:10 smithi044 bash[22676]: cluster 2024-09-21T03:58:08.971968+0000 mgr.a (mgr.14388) 14876 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:10 smithi179 bash[23186]: cluster 2024-09-21T03:58:08.971968+0000 mgr.a (mgr.14388) 14876 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:10 smithi049 bash[23528]: cluster 2024-09-21T03:58:08.971968+0000 mgr.a (mgr.14388) 14876 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:12 smithi044 bash[22676]: cluster 2024-09-21T03:58:10.974254+0000 mgr.a (mgr.14388) 14877 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:12 smithi179 bash[23186]: cluster 2024-09-21T03:58:10.974254+0000 mgr.a (mgr.14388) 14877 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:12 smithi049 bash[23528]: cluster 2024-09-21T03:58:10.974254+0000 mgr.a (mgr.14388) 14877 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:13.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:13.386 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:13.386 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:14.174 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:14.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:14.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:14 smithi044 bash[22676]: cluster 2024-09-21T03:58:12.975069+0000 mgr.a (mgr.14388) 14878 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:14 smithi179 bash[23186]: cluster 2024-09-21T03:58:12.975069+0000 mgr.a (mgr.14388) 14878 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:15.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:14 smithi049 bash[23528]: cluster 2024-09-21T03:58:12.975069+0000 mgr.a (mgr.14388) 14878 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:15 smithi049 bash[23528]: audit 2024-09-21T03:58:13.722977+0000 mgr.a (mgr.14388) 14879 : audit [DBG] from='client.322395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:15 smithi049 bash[23528]: audit 2024-09-21T03:58:14.684383+0000 mon.a (mon.0) 11956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:15 smithi049 bash[23528]: audit 2024-09-21T03:58:14.693543+0000 mon.a (mon.0) 11957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:15.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:15 smithi049 bash[23528]: audit 2024-09-21T03:58:14.704100+0000 mon.a (mon.0) 11958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:15 smithi044 bash[22676]: audit 2024-09-21T03:58:13.722977+0000 mgr.a (mgr.14388) 14879 : audit [DBG] from='client.322395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:15 smithi044 bash[22676]: audit 2024-09-21T03:58:14.684383+0000 mon.a (mon.0) 11956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:15 smithi044 bash[22676]: audit 2024-09-21T03:58:14.693543+0000 mon.a (mon.0) 11957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:15 smithi044 bash[22676]: audit 2024-09-21T03:58:14.704100+0000 mon.a (mon.0) 11958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:15 smithi179 bash[23186]: audit 2024-09-21T03:58:13.722977+0000 mgr.a (mgr.14388) 14879 : audit [DBG] from='client.322395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:15 smithi179 bash[23186]: audit 2024-09-21T03:58:14.684383+0000 mon.a (mon.0) 11956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:15 smithi179 bash[23186]: audit 2024-09-21T03:58:14.693543+0000 mon.a (mon.0) 11957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:15 smithi179 bash[23186]: audit 2024-09-21T03:58:14.704100+0000 mon.a (mon.0) 11958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:16 smithi044 bash[22676]: cluster 2024-09-21T03:58:14.975946+0000 mgr.a (mgr.14388) 14880 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:16 smithi179 bash[23186]: cluster 2024-09-21T03:58:14.975946+0000 mgr.a (mgr.14388) 14880 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:16 smithi049 bash[23528]: cluster 2024-09-21T03:58:14.975946+0000 mgr.a (mgr.14388) 14880 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:18 smithi044 bash[22676]: cluster 2024-09-21T03:58:16.978216+0000 mgr.a (mgr.14388) 14881 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:18 smithi179 bash[23186]: cluster 2024-09-21T03:58:16.978216+0000 mgr.a (mgr.14388) 14881 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:18 smithi049 bash[23528]: cluster 2024-09-21T03:58:16.978216+0000 mgr.a (mgr.14388) 14881 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:19.956 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:19.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:19.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:19.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:19.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:20 smithi044 bash[22676]: cluster 2024-09-21T03:58:18.978982+0000 mgr.a (mgr.14388) 14882 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:20 smithi044 bash[22676]: audit 2024-09-21T03:58:19.514597+0000 mgr.a (mgr.14388) 14883 : audit [DBG] from='client.322470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:20 smithi179 bash[23186]: cluster 2024-09-21T03:58:18.978982+0000 mgr.a (mgr.14388) 14882 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:20 smithi179 bash[23186]: audit 2024-09-21T03:58:19.514597+0000 mgr.a (mgr.14388) 14883 : audit [DBG] from='client.322470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:20 smithi049 bash[23528]: cluster 2024-09-21T03:58:18.978982+0000 mgr.a (mgr.14388) 14882 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:20 smithi049 bash[23528]: audit 2024-09-21T03:58:19.514597+0000 mgr.a (mgr.14388) 14883 : audit [DBG] from='client.322470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:22 smithi044 bash[22676]: cluster 2024-09-21T03:58:20.981488+0000 mgr.a (mgr.14388) 14884 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:22 smithi179 bash[23186]: cluster 2024-09-21T03:58:20.981488+0000 mgr.a (mgr.14388) 14884 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:22 smithi049 bash[23528]: cluster 2024-09-21T03:58:20.981488+0000 mgr.a (mgr.14388) 14884 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:24.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:24.959 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:24.959 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:24 smithi044 bash[22676]: cluster 2024-09-21T03:58:22.982318+0000 mgr.a (mgr.14388) 14885 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:24 smithi179 bash[23186]: cluster 2024-09-21T03:58:22.982318+0000 mgr.a (mgr.14388) 14885 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:24 smithi049 bash[23528]: cluster 2024-09-21T03:58:22.982318+0000 mgr.a (mgr.14388) 14885 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:25.723 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:25.724 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: cluster 2024-09-21T03:58:24.982862+0000 mgr.a (mgr.14388) 14886 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:25.291267+0000 mgr.a (mgr.14388) 14887 : audit [DBG] from='client.322548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.347166+0000 mon.a (mon.0) 11959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.354506+0000 mon.a (mon.0) 11960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.363200+0000 mon.a (mon.0) 11961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.507613+0000 mon.a (mon.0) 11962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.508530+0000 mon.a (mon.0) 11963 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.517824+0000 mon.a (mon.0) 11964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.518532+0000 mon.a (mon.0) 11965 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.523088+0000 mon.a (mon.0) 11966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.530086+0000 mon.a (mon.0) 11967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.537791+0000 mon.a (mon.0) 11968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:26 smithi044 bash[22676]: audit 2024-09-21T03:58:26.544050+0000 mon.a (mon.0) 11969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:58:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: cluster 2024-09-21T03:58:24.982862+0000 mgr.a (mgr.14388) 14886 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:25.291267+0000 mgr.a (mgr.14388) 14887 : audit [DBG] from='client.322548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.347166+0000 mon.a (mon.0) 11959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.354506+0000 mon.a (mon.0) 11960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.363200+0000 mon.a (mon.0) 11961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.507613+0000 mon.a (mon.0) 11962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.508530+0000 mon.a (mon.0) 11963 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:58:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.517824+0000 mon.a (mon.0) 11964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.518532+0000 mon.a (mon.0) 11965 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:58:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.523088+0000 mon.a (mon.0) 11966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:58:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.530086+0000 mon.a (mon.0) 11967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.537791+0000 mon.a (mon.0) 11968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:26 smithi179 bash[23186]: audit 2024-09-21T03:58:26.544050+0000 mon.a (mon.0) 11969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:58:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: cluster 2024-09-21T03:58:24.982862+0000 mgr.a (mgr.14388) 14886 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:25.291267+0000 mgr.a (mgr.14388) 14887 : audit [DBG] from='client.322548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.347166+0000 mon.a (mon.0) 11959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.354506+0000 mon.a (mon.0) 11960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.363200+0000 mon.a (mon.0) 11961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.507613+0000 mon.a (mon.0) 11962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.508530+0000 mon.a (mon.0) 11963 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.517824+0000 mon.a (mon.0) 11964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.518532+0000 mon.a (mon.0) 11965 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.523088+0000 mon.a (mon.0) 11966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.530086+0000 mon.a (mon.0) 11967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.537791+0000 mon.a (mon.0) 11968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:26 smithi049 bash[23528]: audit 2024-09-21T03:58:26.544050+0000 mon.a (mon.0) 11969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:58:27.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:58:27 smithi044 bash[22930]: debug 2024-09-21T03:58:27.344+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:58:27.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:58:27 smithi044 bash[22930]: debug 2024-09-21T03:58:27.348+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:58:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:27 smithi044 bash[22676]: audit 2024-09-21T03:58:26.546849+0000 mgr.a (mgr.14388) 14888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:58:27.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:27 smithi044 bash[22676]: cluster 2024-09-21T03:58:26.984164+0000 mgr.a (mgr.14388) 14889 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:27 smithi044 bash[22676]: audit 2024-09-21T03:58:27.348091+0000 mgr.a (mgr.14388) 14890 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:58:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:27 smithi044 bash[22676]: cephadm 2024-09-21T03:58:27.349734+0000 mgr.a (mgr.14388) 14891 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:58:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:27 smithi179 bash[23186]: audit 2024-09-21T03:58:26.546849+0000 mgr.a (mgr.14388) 14888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:58:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:27 smithi179 bash[23186]: cluster 2024-09-21T03:58:26.984164+0000 mgr.a (mgr.14388) 14889 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:27 smithi179 bash[23186]: audit 2024-09-21T03:58:27.348091+0000 mgr.a (mgr.14388) 14890 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:58:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:27 smithi179 bash[23186]: cephadm 2024-09-21T03:58:27.349734+0000 mgr.a (mgr.14388) 14891 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:27 smithi049 bash[23528]: audit 2024-09-21T03:58:26.546849+0000 mgr.a (mgr.14388) 14888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:27 smithi049 bash[23528]: cluster 2024-09-21T03:58:26.984164+0000 mgr.a (mgr.14388) 14889 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:27 smithi049 bash[23528]: audit 2024-09-21T03:58:27.348091+0000 mgr.a (mgr.14388) 14890 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:58:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:27 smithi049 bash[23528]: cephadm 2024-09-21T03:58:27.349734+0000 mgr.a (mgr.14388) 14891 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:58:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:30 smithi179 bash[23186]: cluster 2024-09-21T03:58:28.985059+0000 mgr.a (mgr.14388) 14892 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:58:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:30 smithi049 bash[23528]: cluster 2024-09-21T03:58:28.985059+0000 mgr.a (mgr.14388) 14892 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:58:30.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:30 smithi044 bash[22676]: cluster 2024-09-21T03:58:28.985059+0000 mgr.a (mgr.14388) 14892 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:58:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:31.479 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:32.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:32 smithi049 bash[23528]: cluster 2024-09-21T03:58:30.987194+0000 mgr.a (mgr.14388) 14893 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:32.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:32 smithi049 bash[23528]: audit 2024-09-21T03:58:31.050366+0000 mgr.a (mgr.14388) 14894 : audit [DBG] from='client.322734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:32 smithi044 bash[22676]: cluster 2024-09-21T03:58:30.987194+0000 mgr.a (mgr.14388) 14893 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:32 smithi044 bash[22676]: audit 2024-09-21T03:58:31.050366+0000 mgr.a (mgr.14388) 14894 : audit [DBG] from='client.322734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:32.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:32 smithi179 bash[23186]: cluster 2024-09-21T03:58:30.987194+0000 mgr.a (mgr.14388) 14893 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:32.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:32 smithi179 bash[23186]: audit 2024-09-21T03:58:31.050366+0000 mgr.a (mgr.14388) 14894 : audit [DBG] from='client.322734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:34 smithi049 bash[23528]: cluster 2024-09-21T03:58:32.988115+0000 mgr.a (mgr.14388) 14895 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:58:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:34 smithi044 bash[22676]: cluster 2024-09-21T03:58:32.988115+0000 mgr.a (mgr.14388) 14895 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:58:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:34 smithi179 bash[23186]: cluster 2024-09-21T03:58:32.988115+0000 mgr.a (mgr.14388) 14895 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:58:36.126 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:35 smithi049 bash[23528]: audit 2024-09-21T03:58:34.915804+0000 mon.a (mon.0) 11970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.126 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:35 smithi049 bash[23528]: audit 2024-09-21T03:58:34.924487+0000 mon.a (mon.0) 11971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.126 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:35 smithi049 bash[23528]: audit 2024-09-21T03:58:34.934876+0000 mon.a (mon.0) 11972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.126 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:35 smithi049 bash[23528]: cluster 2024-09-21T03:58:34.988861+0000 mgr.a (mgr.14388) 14896 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:58:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:35 smithi044 bash[22676]: audit 2024-09-21T03:58:34.915804+0000 mon.a (mon.0) 11970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:35 smithi044 bash[22676]: audit 2024-09-21T03:58:34.924487+0000 mon.a (mon.0) 11971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:35 smithi044 bash[22676]: audit 2024-09-21T03:58:34.934876+0000 mon.a (mon.0) 11972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:35 smithi044 bash[22676]: cluster 2024-09-21T03:58:34.988861+0000 mgr.a (mgr.14388) 14896 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:58:36.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:35 smithi179 bash[23186]: audit 2024-09-21T03:58:34.915804+0000 mon.a (mon.0) 11970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:35 smithi179 bash[23186]: audit 2024-09-21T03:58:34.924487+0000 mon.a (mon.0) 11971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:35 smithi179 bash[23186]: audit 2024-09-21T03:58:34.934876+0000 mon.a (mon.0) 11972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:35 smithi179 bash[23186]: cluster 2024-09-21T03:58:34.988861+0000 mgr.a (mgr.14388) 14896 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:58:36.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:36.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:36.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:37.264 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:37.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:37.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:37.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:37.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:38.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:38 smithi049 bash[23528]: audit 2024-09-21T03:58:36.813690+0000 mgr.a (mgr.14388) 14897 : audit [DBG] from='client.322809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:38.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:38 smithi049 bash[23528]: cluster 2024-09-21T03:58:36.990260+0000 mgr.a (mgr.14388) 14898 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:38.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:38 smithi044 bash[22676]: audit 2024-09-21T03:58:36.813690+0000 mgr.a (mgr.14388) 14897 : audit [DBG] from='client.322809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:38.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:38 smithi044 bash[22676]: cluster 2024-09-21T03:58:36.990260+0000 mgr.a (mgr.14388) 14898 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:38 smithi179 bash[23186]: audit 2024-09-21T03:58:36.813690+0000 mgr.a (mgr.14388) 14897 : audit [DBG] from='client.322809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:38 smithi179 bash[23186]: cluster 2024-09-21T03:58:36.990260+0000 mgr.a (mgr.14388) 14898 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:40 smithi049 bash[23528]: cluster 2024-09-21T03:58:38.991178+0000 mgr.a (mgr.14388) 14899 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:40 smithi044 bash[22676]: cluster 2024-09-21T03:58:38.991178+0000 mgr.a (mgr.14388) 14899 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:40 smithi179 bash[23186]: cluster 2024-09-21T03:58:38.991178+0000 mgr.a (mgr.14388) 14899 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:42.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:42.432 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:42 smithi044 bash[22676]: cluster 2024-09-21T03:58:40.993473+0000 mgr.a (mgr.14388) 14900 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:42.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:42 smithi179 bash[23186]: cluster 2024-09-21T03:58:40.993473+0000 mgr.a (mgr.14388) 14900 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:42.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:42 smithi049 bash[23528]: cluster 2024-09-21T03:58:40.993473+0000 mgr.a (mgr.14388) 14900 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:58:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:43.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:43 smithi044 bash[22676]: audit 2024-09-21T03:58:42.591735+0000 mgr.a (mgr.14388) 14901 : audit [DBG] from='client.322887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:43 smithi179 bash[23186]: audit 2024-09-21T03:58:42.591735+0000 mgr.a (mgr.14388) 14901 : audit [DBG] from='client.322887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:43.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:43 smithi049 bash[23528]: audit 2024-09-21T03:58:42.591735+0000 mgr.a (mgr.14388) 14901 : audit [DBG] from='client.322887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:44.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:44 smithi044 bash[22676]: cluster 2024-09-21T03:58:42.994058+0000 mgr.a (mgr.14388) 14902 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:44.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:44 smithi179 bash[23186]: cluster 2024-09-21T03:58:42.994058+0000 mgr.a (mgr.14388) 14902 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:44 smithi049 bash[23528]: cluster 2024-09-21T03:58:42.994058+0000 mgr.a (mgr.14388) 14902 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:46 smithi044 bash[22676]: cluster 2024-09-21T03:58:44.994784+0000 mgr.a (mgr.14388) 14903 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:46 smithi179 bash[23186]: cluster 2024-09-21T03:58:44.994784+0000 mgr.a (mgr.14388) 14903 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:46 smithi049 bash[23528]: cluster 2024-09-21T03:58:44.994784+0000 mgr.a (mgr.14388) 14903 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:47.577 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:47 smithi044 bash[22676]: audit 2024-09-21T03:58:46.573947+0000 mon.a (mon.0) 11973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:47.577 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:47 smithi044 bash[22676]: audit 2024-09-21T03:58:46.579639+0000 mon.a (mon.0) 11974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:47.577 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:47 smithi044 bash[22676]: audit 2024-09-21T03:58:46.588241+0000 mon.a (mon.0) 11975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:47.577 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:47 smithi044 bash[22676]: audit 2024-09-21T03:58:46.752970+0000 mon.a (mon.0) 11976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:47.577 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:47 smithi044 bash[22676]: audit 2024-09-21T03:58:46.762351+0000 mon.a (mon.0) 11977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:47 smithi179 bash[23186]: audit 2024-09-21T03:58:46.573947+0000 mon.a (mon.0) 11973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:47 smithi179 bash[23186]: audit 2024-09-21T03:58:46.579639+0000 mon.a (mon.0) 11974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:47 smithi179 bash[23186]: audit 2024-09-21T03:58:46.588241+0000 mon.a (mon.0) 11975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:47 smithi179 bash[23186]: audit 2024-09-21T03:58:46.752970+0000 mon.a (mon.0) 11976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:47 smithi179 bash[23186]: audit 2024-09-21T03:58:46.762351+0000 mon.a (mon.0) 11977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:47 smithi179 bash[23186]: audit 2024-09-21T03:58:46.772369+0000 mon.a (mon.0) 11978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:48.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:48.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:47 smithi049 bash[23528]: audit 2024-09-21T03:58:46.573947+0000 mon.a (mon.0) 11973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:47 smithi049 bash[23528]: audit 2024-09-21T03:58:46.579639+0000 mon.a (mon.0) 11974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:47 smithi049 bash[23528]: audit 2024-09-21T03:58:46.588241+0000 mon.a (mon.0) 11975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:47 smithi049 bash[23528]: audit 2024-09-21T03:58:46.752970+0000 mon.a (mon.0) 11976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:47 smithi049 bash[23528]: audit 2024-09-21T03:58:46.762351+0000 mon.a (mon.0) 11977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:47 smithi049 bash[23528]: audit 2024-09-21T03:58:46.772369+0000 mon.a (mon.0) 11978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.808 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:48.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:48.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:48.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:48.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:48.844 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:48 smithi179 bash[23186]: cluster 2024-09-21T03:58:46.997008+0000 mgr.a (mgr.14388) 14904 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:47 smithi044 bash[22676]: audit 2024-09-21T03:58:46.772369+0000 mon.a (mon.0) 11978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:48 smithi044 bash[22676]: cluster 2024-09-21T03:58:46.997008+0000 mgr.a (mgr.14388) 14904 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:48 smithi049 bash[23528]: cluster 2024-09-21T03:58:46.997008+0000 mgr.a (mgr.14388) 14904 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:49.849 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:49 smithi179 bash[23186]: audit 2024-09-21T03:58:48.360728+0000 mgr.a (mgr.14388) 14905 : audit [DBG] from='client.322965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:49 smithi044 bash[22676]: audit 2024-09-21T03:58:48.360728+0000 mgr.a (mgr.14388) 14905 : audit [DBG] from='client.322965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:50.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:49 smithi049 bash[23528]: audit 2024-09-21T03:58:48.360728+0000 mgr.a (mgr.14388) 14905 : audit [DBG] from='client.322965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:50 smithi044 bash[22676]: cluster 2024-09-21T03:58:48.997999+0000 mgr.a (mgr.14388) 14906 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:50 smithi179 bash[23186]: cluster 2024-09-21T03:58:48.997999+0000 mgr.a (mgr.14388) 14906 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:50 smithi049 bash[23528]: cluster 2024-09-21T03:58:48.997999+0000 mgr.a (mgr.14388) 14906 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:52 smithi179 bash[23186]: cluster 2024-09-21T03:58:51.000207+0000 mgr.a (mgr.14388) 14907 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:52 smithi044 bash[22676]: cluster 2024-09-21T03:58:51.000207+0000 mgr.a (mgr.14388) 14907 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:52 smithi049 bash[23528]: cluster 2024-09-21T03:58:51.000207+0000 mgr.a (mgr.14388) 14907 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:53.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:53.810 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:53.811 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:58:54.568 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:58:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:58:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:58:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:58:54.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:58:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:54 smithi044 bash[22676]: cluster 2024-09-21T03:58:53.001114+0000 mgr.a (mgr.14388) 14908 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:54 smithi179 bash[23186]: cluster 2024-09-21T03:58:53.001114+0000 mgr.a (mgr.14388) 14908 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:54 smithi049 bash[23528]: cluster 2024-09-21T03:58:53.001114+0000 mgr.a (mgr.14388) 14908 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:55 smithi044 bash[22676]: audit 2024-09-21T03:58:54.139238+0000 mgr.a (mgr.14388) 14909 : audit [DBG] from='client.323040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:55.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:55 smithi044 bash[22676]: audit 2024-09-21T03:58:55.113962+0000 mon.a (mon.0) 11979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:55 smithi044 bash[22676]: audit 2024-09-21T03:58:55.124765+0000 mon.a (mon.0) 11980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:55 smithi044 bash[22676]: audit 2024-09-21T03:58:55.136711+0000 mon.a (mon.0) 11981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:55 smithi179 bash[23186]: audit 2024-09-21T03:58:54.139238+0000 mgr.a (mgr.14388) 14909 : audit [DBG] from='client.323040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:55 smithi179 bash[23186]: audit 2024-09-21T03:58:55.113962+0000 mon.a (mon.0) 11979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:55 smithi179 bash[23186]: audit 2024-09-21T03:58:55.124765+0000 mon.a (mon.0) 11980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:55 smithi179 bash[23186]: audit 2024-09-21T03:58:55.136711+0000 mon.a (mon.0) 11981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:56.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:55 smithi049 bash[23528]: audit 2024-09-21T03:58:54.139238+0000 mgr.a (mgr.14388) 14909 : audit [DBG] from='client.323040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:56.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:55 smithi049 bash[23528]: audit 2024-09-21T03:58:55.113962+0000 mon.a (mon.0) 11979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:56.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:55 smithi049 bash[23528]: audit 2024-09-21T03:58:55.124765+0000 mon.a (mon.0) 11980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:56.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:55 smithi049 bash[23528]: audit 2024-09-21T03:58:55.136711+0000 mon.a (mon.0) 11981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:58:56.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:56 smithi049 bash[23528]: cluster 2024-09-21T03:58:55.002070+0000 mgr.a (mgr.14388) 14910 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:56 smithi044 bash[22676]: cluster 2024-09-21T03:58:55.002070+0000 mgr.a (mgr.14388) 14910 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:56 smithi179 bash[23186]: cluster 2024-09-21T03:58:55.002070+0000 mgr.a (mgr.14388) 14910 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:58:58.864 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:58:58 smithi049 bash[23528]: cluster 2024-09-21T03:58:57.004318+0000 mgr.a (mgr.14388) 14911 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:58:58 smithi044 bash[22676]: cluster 2024-09-21T03:58:57.004318+0000 mgr.a (mgr.14388) 14911 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:58:58 smithi179 bash[23186]: cluster 2024-09-21T03:58:57.004318+0000 mgr.a (mgr.14388) 14911 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:58:59.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:58:59.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:58:59.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:00.366 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:00.944 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:00 smithi044 bash[22676]: cluster 2024-09-21T03:58:59.005139+0000 mgr.a (mgr.14388) 14912 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:00 smithi179 bash[23186]: cluster 2024-09-21T03:58:59.005139+0000 mgr.a (mgr.14388) 14912 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:00 smithi049 bash[23528]: cluster 2024-09-21T03:58:59.005139+0000 mgr.a (mgr.14388) 14912 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:01.880 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:01 smithi044 bash[22676]: audit 2024-09-21T03:58:59.905627+0000 mgr.a (mgr.14388) 14913 : audit [DBG] from='client.323115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:01 smithi179 bash[23186]: audit 2024-09-21T03:58:59.905627+0000 mgr.a (mgr.14388) 14913 : audit [DBG] from='client.323115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:01 smithi049 bash[23528]: audit 2024-09-21T03:58:59.905627+0000 mgr.a (mgr.14388) 14913 : audit [DBG] from='client.323115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:02 smithi044 bash[22676]: cluster 2024-09-21T03:59:01.008141+0000 mgr.a (mgr.14388) 14914 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:02 smithi179 bash[23186]: cluster 2024-09-21T03:59:01.008141+0000 mgr.a (mgr.14388) 14914 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:02 smithi049 bash[23528]: cluster 2024-09-21T03:59:01.008141+0000 mgr.a (mgr.14388) 14914 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:04 smithi044 bash[22676]: cluster 2024-09-21T03:59:03.008965+0000 mgr.a (mgr.14388) 14915 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:04 smithi179 bash[23186]: cluster 2024-09-21T03:59:03.008965+0000 mgr.a (mgr.14388) 14915 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:05.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:04 smithi049 bash[23528]: cluster 2024-09-21T03:59:03.008965+0000 mgr.a (mgr.14388) 14915 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:05.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:05.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:05.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:06.144 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:06.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:06.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:06.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:06.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:06.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:06 smithi044 bash[22676]: cluster 2024-09-21T03:59:05.009764+0000 mgr.a (mgr.14388) 14916 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:06.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:06 smithi044 bash[22676]: audit 2024-09-21T03:59:05.699988+0000 mgr.a (mgr.14388) 14917 : audit [DBG] from='client.323193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:06 smithi179 bash[23186]: cluster 2024-09-21T03:59:05.009764+0000 mgr.a (mgr.14388) 14916 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:06 smithi179 bash[23186]: audit 2024-09-21T03:59:05.699988+0000 mgr.a (mgr.14388) 14917 : audit [DBG] from='client.323193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:06 smithi049 bash[23528]: cluster 2024-09-21T03:59:05.009764+0000 mgr.a (mgr.14388) 14916 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:06 smithi049 bash[23528]: audit 2024-09-21T03:59:05.699988+0000 mgr.a (mgr.14388) 14917 : audit [DBG] from='client.323193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:07 smithi044 bash[22676]: audit 2024-09-21T03:59:06.802375+0000 mon.a (mon.0) 11982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:07 smithi044 bash[22676]: audit 2024-09-21T03:59:06.808530+0000 mon.a (mon.0) 11983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:07 smithi044 bash[22676]: audit 2024-09-21T03:59:06.817279+0000 mon.a (mon.0) 11984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:07 smithi044 bash[22676]: audit 2024-09-21T03:59:06.965852+0000 mon.a (mon.0) 11985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:07 smithi044 bash[22676]: audit 2024-09-21T03:59:06.971789+0000 mon.a (mon.0) 11986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:07 smithi044 bash[22676]: audit 2024-09-21T03:59:06.978331+0000 mon.a (mon.0) 11987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:07 smithi044 bash[22676]: cluster 2024-09-21T03:59:07.012736+0000 mgr.a (mgr.14388) 14918 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:07 smithi179 bash[23186]: audit 2024-09-21T03:59:06.802375+0000 mon.a (mon.0) 11982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:07 smithi179 bash[23186]: audit 2024-09-21T03:59:06.808530+0000 mon.a (mon.0) 11983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:07 smithi179 bash[23186]: audit 2024-09-21T03:59:06.817279+0000 mon.a (mon.0) 11984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:07 smithi179 bash[23186]: audit 2024-09-21T03:59:06.965852+0000 mon.a (mon.0) 11985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:07 smithi179 bash[23186]: audit 2024-09-21T03:59:06.971789+0000 mon.a (mon.0) 11986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:07 smithi179 bash[23186]: audit 2024-09-21T03:59:06.978331+0000 mon.a (mon.0) 11987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:07 smithi179 bash[23186]: cluster 2024-09-21T03:59:07.012736+0000 mgr.a (mgr.14388) 14918 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:07 smithi049 bash[23528]: audit 2024-09-21T03:59:06.802375+0000 mon.a (mon.0) 11982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:07 smithi049 bash[23528]: audit 2024-09-21T03:59:06.808530+0000 mon.a (mon.0) 11983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:07 smithi049 bash[23528]: audit 2024-09-21T03:59:06.817279+0000 mon.a (mon.0) 11984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:07 smithi049 bash[23528]: audit 2024-09-21T03:59:06.965852+0000 mon.a (mon.0) 11985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:07 smithi049 bash[23528]: audit 2024-09-21T03:59:06.971789+0000 mon.a (mon.0) 11986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:07 smithi049 bash[23528]: audit 2024-09-21T03:59:06.978331+0000 mon.a (mon.0) 11987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:07 smithi049 bash[23528]: cluster 2024-09-21T03:59:07.012736+0000 mgr.a (mgr.14388) 14918 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:10.370 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:10 smithi179 bash[23186]: cluster 2024-09-21T03:59:09.013574+0000 mgr.a (mgr.14388) 14919 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:10 smithi044 bash[22676]: cluster 2024-09-21T03:59:09.013574+0000 mgr.a (mgr.14388) 14919 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:10 smithi049 bash[23528]: cluster 2024-09-21T03:59:09.013574+0000 mgr.a (mgr.14388) 14919 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:11.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:11.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:11.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:11.924 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:11.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:12.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:12 smithi179 bash[23186]: cluster 2024-09-21T03:59:11.015538+0000 mgr.a (mgr.14388) 14920 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:12.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:12 smithi179 bash[23186]: audit 2024-09-21T03:59:11.481364+0000 mgr.a (mgr.14388) 14921 : audit [DBG] from='client.323268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:12.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:12 smithi044 bash[22676]: cluster 2024-09-21T03:59:11.015538+0000 mgr.a (mgr.14388) 14920 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:12.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:12 smithi044 bash[22676]: audit 2024-09-21T03:59:11.481364+0000 mgr.a (mgr.14388) 14921 : audit [DBG] from='client.323268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:12.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:12 smithi049 bash[23528]: cluster 2024-09-21T03:59:11.015538+0000 mgr.a (mgr.14388) 14920 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:12.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:12 smithi049 bash[23528]: audit 2024-09-21T03:59:11.481364+0000 mgr.a (mgr.14388) 14921 : audit [DBG] from='client.323268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:14.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:14 smithi044 bash[22676]: cluster 2024-09-21T03:59:13.016469+0000 mgr.a (mgr.14388) 14922 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:14.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:14 smithi179 bash[23186]: cluster 2024-09-21T03:59:13.016469+0000 mgr.a (mgr.14388) 14922 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:14 smithi049 bash[23528]: cluster 2024-09-21T03:59:13.016469+0000 mgr.a (mgr.14388) 14922 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:16.670 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:16 smithi049 bash[23528]: cluster 2024-09-21T03:59:15.017299+0000 mgr.a (mgr.14388) 14923 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:16.670 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:16 smithi049 bash[23528]: audit 2024-09-21T03:59:15.325994+0000 mon.a (mon.0) 11988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.670 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:16 smithi049 bash[23528]: audit 2024-09-21T03:59:15.334729+0000 mon.a (mon.0) 11989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.670 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:16 smithi049 bash[23528]: audit 2024-09-21T03:59:15.345278+0000 mon.a (mon.0) 11990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:16 smithi044 bash[22676]: cluster 2024-09-21T03:59:15.017299+0000 mgr.a (mgr.14388) 14923 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:16 smithi044 bash[22676]: audit 2024-09-21T03:59:15.325994+0000 mon.a (mon.0) 11988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:16 smithi044 bash[22676]: audit 2024-09-21T03:59:15.334729+0000 mon.a (mon.0) 11989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:16 smithi044 bash[22676]: audit 2024-09-21T03:59:15.345278+0000 mon.a (mon.0) 11990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:16 smithi179 bash[23186]: cluster 2024-09-21T03:59:15.017299+0000 mgr.a (mgr.14388) 14923 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:16 smithi179 bash[23186]: audit 2024-09-21T03:59:15.325994+0000 mon.a (mon.0) 11988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:16 smithi179 bash[23186]: audit 2024-09-21T03:59:15.334729+0000 mon.a (mon.0) 11989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:16 smithi179 bash[23186]: audit 2024-09-21T03:59:15.345278+0000 mon.a (mon.0) 11990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:16.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:16.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:16.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:17.685 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:17.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:17.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:17.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:17.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:18 smithi049 bash[23528]: cluster 2024-09-21T03:59:17.019436+0000 mgr.a (mgr.14388) 14924 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:18 smithi049 bash[23528]: audit 2024-09-21T03:59:17.257841+0000 mgr.a (mgr.14388) 14925 : audit [DBG] from='client.323343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:18 smithi044 bash[22676]: cluster 2024-09-21T03:59:17.019436+0000 mgr.a (mgr.14388) 14924 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:18 smithi044 bash[22676]: audit 2024-09-21T03:59:17.257841+0000 mgr.a (mgr.14388) 14925 : audit [DBG] from='client.323343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:18 smithi179 bash[23186]: cluster 2024-09-21T03:59:17.019436+0000 mgr.a (mgr.14388) 14924 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:18 smithi179 bash[23186]: audit 2024-09-21T03:59:17.257841+0000 mgr.a (mgr.14388) 14925 : audit [DBG] from='client.323343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:20.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:20 smithi044 bash[22676]: cluster 2024-09-21T03:59:19.020383+0000 mgr.a (mgr.14388) 14926 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:20 smithi179 bash[23186]: cluster 2024-09-21T03:59:19.020383+0000 mgr.a (mgr.14388) 14926 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:20 smithi049 bash[23528]: cluster 2024-09-21T03:59:19.020383+0000 mgr.a (mgr.14388) 14926 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:22 smithi179 bash[23186]: cluster 2024-09-21T03:59:21.022696+0000 mgr.a (mgr.14388) 14927 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:22.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:22.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:22.687 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:22.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:22 smithi044 bash[22676]: cluster 2024-09-21T03:59:21.022696+0000 mgr.a (mgr.14388) 14927 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:22 smithi049 bash[23528]: cluster 2024-09-21T03:59:21.022696+0000 mgr.a (mgr.14388) 14927 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:23.492 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:24 smithi044 bash[22676]: cluster 2024-09-21T03:59:23.023454+0000 mgr.a (mgr.14388) 14928 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:24 smithi044 bash[22676]: audit 2024-09-21T03:59:23.028933+0000 mgr.a (mgr.14388) 14929 : audit [DBG] from='client.323418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:24 smithi179 bash[23186]: cluster 2024-09-21T03:59:23.023454+0000 mgr.a (mgr.14388) 14928 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:24 smithi179 bash[23186]: audit 2024-09-21T03:59:23.028933+0000 mgr.a (mgr.14388) 14929 : audit [DBG] from='client.323418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:24 smithi049 bash[23528]: cluster 2024-09-21T03:59:23.023454+0000 mgr.a (mgr.14388) 14928 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:24 smithi049 bash[23528]: audit 2024-09-21T03:59:23.028933+0000 mgr.a (mgr.14388) 14929 : audit [DBG] from='client.323418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:26 smithi044 bash[22676]: cluster 2024-09-21T03:59:25.024354+0000 mgr.a (mgr.14388) 14930 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:26 smithi179 bash[23186]: cluster 2024-09-21T03:59:25.024354+0000 mgr.a (mgr.14388) 14930 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:26 smithi049 bash[23528]: cluster 2024-09-21T03:59:25.024354+0000 mgr.a (mgr.14388) 14930 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:28.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: cluster 2024-09-21T03:59:27.025679+0000 mgr.a (mgr.14388) 14931 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:28.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.029647+0000 mon.a (mon.0) 11991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.038589+0000 mon.a (mon.0) 11992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.052057+0000 mon.a (mon.0) 11993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.194395+0000 mon.a (mon.0) 11994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.201628+0000 mon.a (mon.0) 11995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.211440+0000 mon.a (mon.0) 11996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.412420+0000 mon.a (mon.0) 11997 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.419280+0000 mon.a (mon.0) 11998 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.421095+0000 mon.a (mon.0) 11999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.433448+0000 mon.a (mon.0) 12000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.439623+0000 mon.a (mon.0) 12001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:59:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:28 smithi049 bash[23528]: audit 2024-09-21T03:59:27.442059+0000 mgr.a (mgr.14388) 14932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:59:28.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22930]: debug 2024-09-21T03:59:28.259+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22930]: debug 2024-09-21T03:59:28.259+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: cluster 2024-09-21T03:59:27.025679+0000 mgr.a (mgr.14388) 14931 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.029647+0000 mon.a (mon.0) 11991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.038589+0000 mon.a (mon.0) 11992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.052057+0000 mon.a (mon.0) 11993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.194395+0000 mon.a (mon.0) 11994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.201628+0000 mon.a (mon.0) 11995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.211440+0000 mon.a (mon.0) 11996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.412420+0000 mon.a (mon.0) 11997 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:59:28.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.419280+0000 mon.a (mon.0) 11998 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:59:28.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.421095+0000 mon.a (mon.0) 11999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:59:28.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.433448+0000 mon.a (mon.0) 12000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.439623+0000 mon.a (mon.0) 12001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:59:28.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:28 smithi044 bash[22676]: audit 2024-09-21T03:59:27.442059+0000 mgr.a (mgr.14388) 14932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:59:28.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: cluster 2024-09-21T03:59:27.025679+0000 mgr.a (mgr.14388) 14931 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.029647+0000 mon.a (mon.0) 11991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.038589+0000 mon.a (mon.0) 11992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.052057+0000 mon.a (mon.0) 11993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.194395+0000 mon.a (mon.0) 11994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.201628+0000 mon.a (mon.0) 11995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.211440+0000 mon.a (mon.0) 11996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.412420+0000 mon.a (mon.0) 11997 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T03:59:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.419280+0000 mon.a (mon.0) 11998 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T03:59:28.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.421095+0000 mon.a (mon.0) 11999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T03:59:28.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.433448+0000 mon.a (mon.0) 12000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:28.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.439623+0000 mon.a (mon.0) 12001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:59:28.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:28 smithi179 bash[23186]: audit 2024-09-21T03:59:27.442059+0000 mgr.a (mgr.14388) 14932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T03:59:29.295 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:29.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:29.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:29.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:29.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:29 smithi049 bash[23528]: audit 2024-09-21T03:59:28.261831+0000 mgr.a (mgr.14388) 14933 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:59:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:29 smithi049 bash[23528]: cephadm 2024-09-21T03:59:28.263833+0000 mgr.a (mgr.14388) 14934 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:59:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:29 smithi044 bash[22676]: audit 2024-09-21T03:59:28.261831+0000 mgr.a (mgr.14388) 14933 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:59:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:29 smithi044 bash[22676]: cephadm 2024-09-21T03:59:28.263833+0000 mgr.a (mgr.14388) 14934 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:59:29.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:29 smithi179 bash[23186]: audit 2024-09-21T03:59:28.261831+0000 mgr.a (mgr.14388) 14933 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T03:59:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:29 smithi179 bash[23186]: cephadm 2024-09-21T03:59:28.263833+0000 mgr.a (mgr.14388) 14934 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T03:59:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:30 smithi049 bash[23528]: audit 2024-09-21T03:59:28.834821+0000 mgr.a (mgr.14388) 14935 : audit [DBG] from='client.323598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:30 smithi049 bash[23528]: cluster 2024-09-21T03:59:29.026182+0000 mgr.a (mgr.14388) 14936 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:30.318 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:30 smithi179 bash[23186]: audit 2024-09-21T03:59:28.834821+0000 mgr.a (mgr.14388) 14935 : audit [DBG] from='client.323598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:30.318 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:30 smithi179 bash[23186]: cluster 2024-09-21T03:59:29.026182+0000 mgr.a (mgr.14388) 14936 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:30.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:30 smithi044 bash[22676]: audit 2024-09-21T03:59:28.834821+0000 mgr.a (mgr.14388) 14935 : audit [DBG] from='client.323598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:30.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:30 smithi044 bash[22676]: cluster 2024-09-21T03:59:29.026182+0000 mgr.a (mgr.14388) 14936 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:32 smithi044 bash[22676]: cluster 2024-09-21T03:59:31.028429+0000 mgr.a (mgr.14388) 14937 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:32.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:32 smithi179 bash[23186]: cluster 2024-09-21T03:59:31.028429+0000 mgr.a (mgr.14388) 14937 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:32.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:32 smithi049 bash[23528]: cluster 2024-09-21T03:59:31.028429+0000 mgr.a (mgr.14388) 14937 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:34.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:34.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:34.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:34 smithi044 bash[22676]: cluster 2024-09-21T03:59:33.029279+0000 mgr.a (mgr.14388) 14938 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:34.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:34 smithi179 bash[23186]: cluster 2024-09-21T03:59:33.029279+0000 mgr.a (mgr.14388) 14938 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:34.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:34 smithi049 bash[23528]: cluster 2024-09-21T03:59:33.029279+0000 mgr.a (mgr.14388) 14938 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:35.082 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:35.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:35.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:35.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:35.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:35 smithi044 bash[22676]: audit 2024-09-21T03:59:34.632660+0000 mgr.a (mgr.14388) 14939 : audit [DBG] from='client.323676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:35.499 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:35 smithi049 bash[23528]: audit 2024-09-21T03:59:34.632660+0000 mgr.a (mgr.14388) 14939 : audit [DBG] from='client.323676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:35 smithi179 bash[23186]: audit 2024-09-21T03:59:34.632660+0000 mgr.a (mgr.14388) 14939 : audit [DBG] from='client.323676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:36.728 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:36 smithi049 bash[23528]: cluster 2024-09-21T03:59:35.029820+0000 mgr.a (mgr.14388) 14940 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:36.729 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:36 smithi049 bash[23528]: audit 2024-09-21T03:59:35.474003+0000 mon.a (mon.0) 12002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.729 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:36 smithi049 bash[23528]: audit 2024-09-21T03:59:35.483971+0000 mon.a (mon.0) 12003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.729 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:36 smithi049 bash[23528]: audit 2024-09-21T03:59:35.496041+0000 mon.a (mon.0) 12004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:36 smithi044 bash[22676]: cluster 2024-09-21T03:59:35.029820+0000 mgr.a (mgr.14388) 14940 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:36 smithi044 bash[22676]: audit 2024-09-21T03:59:35.474003+0000 mon.a (mon.0) 12002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:36 smithi044 bash[22676]: audit 2024-09-21T03:59:35.483971+0000 mon.a (mon.0) 12003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:36 smithi044 bash[22676]: audit 2024-09-21T03:59:35.496041+0000 mon.a (mon.0) 12004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:36 smithi179 bash[23186]: cluster 2024-09-21T03:59:35.029820+0000 mgr.a (mgr.14388) 14940 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:36 smithi179 bash[23186]: audit 2024-09-21T03:59:35.474003+0000 mon.a (mon.0) 12002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:36 smithi179 bash[23186]: audit 2024-09-21T03:59:35.483971+0000 mon.a (mon.0) 12003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:36 smithi179 bash[23186]: audit 2024-09-21T03:59:35.496041+0000 mon.a (mon.0) 12004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:38 smithi044 bash[22676]: cluster 2024-09-21T03:59:37.032146+0000 mgr.a (mgr.14388) 14941 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:38 smithi179 bash[23186]: cluster 2024-09-21T03:59:37.032146+0000 mgr.a (mgr.14388) 14941 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:38 smithi049 bash[23528]: cluster 2024-09-21T03:59:37.032146+0000 mgr.a (mgr.14388) 14941 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:40.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:40 smithi044 bash[22676]: cluster 2024-09-21T03:59:39.032978+0000 mgr.a (mgr.14388) 14942 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:40 smithi179 bash[23186]: cluster 2024-09-21T03:59:39.032978+0000 mgr.a (mgr.14388) 14942 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:40 smithi049 bash[23528]: cluster 2024-09-21T03:59:39.032978+0000 mgr.a (mgr.14388) 14942 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:40.880 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:41 smithi044 bash[22676]: audit 2024-09-21T03:59:40.419735+0000 mgr.a (mgr.14388) 14943 : audit [DBG] from='client.323754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:41.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:41 smithi179 bash[23186]: audit 2024-09-21T03:59:40.419735+0000 mgr.a (mgr.14388) 14943 : audit [DBG] from='client.323754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:41.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:41 smithi049 bash[23528]: audit 2024-09-21T03:59:40.419735+0000 mgr.a (mgr.14388) 14943 : audit [DBG] from='client.323754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:42 smithi044 bash[22676]: cluster 2024-09-21T03:59:41.035933+0000 mgr.a (mgr.14388) 14944 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:42 smithi179 bash[23186]: cluster 2024-09-21T03:59:41.035933+0000 mgr.a (mgr.14388) 14944 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:42 smithi049 bash[23528]: cluster 2024-09-21T03:59:41.035933+0000 mgr.a (mgr.14388) 14944 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:59:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:44 smithi179 bash[23186]: cluster 2024-09-21T03:59:43.036747+0000 mgr.a (mgr.14388) 14945 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:44.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:44 smithi049 bash[23528]: cluster 2024-09-21T03:59:43.036747+0000 mgr.a (mgr.14388) 14945 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:44 smithi044 bash[22676]: cluster 2024-09-21T03:59:43.036747+0000 mgr.a (mgr.14388) 14945 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:45.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:45.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:45.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:46.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:46.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:46.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:46.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:46.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:46 smithi179 bash[23186]: cluster 2024-09-21T03:59:45.037553+0000 mgr.a (mgr.14388) 14946 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:59:46.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:46 smithi049 bash[23528]: cluster 2024-09-21T03:59:45.037553+0000 mgr.a (mgr.14388) 14946 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:59:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:46 smithi044 bash[22676]: cluster 2024-09-21T03:59:45.037553+0000 mgr.a (mgr.14388) 14946 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T03:59:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:47 smithi044 bash[22676]: audit 2024-09-21T03:59:46.204652+0000 mgr.a (mgr.14388) 14947 : audit [DBG] from='client.323832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:47 smithi044 bash[22676]: audit 2024-09-21T03:59:47.252163+0000 mon.a (mon.0) 12005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:47 smithi044 bash[22676]: audit 2024-09-21T03:59:47.259389+0000 mon.a (mon.0) 12006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:47 smithi044 bash[22676]: audit 2024-09-21T03:59:47.268542+0000 mon.a (mon.0) 12007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:47 smithi044 bash[22676]: audit 2024-09-21T03:59:47.429829+0000 mon.a (mon.0) 12008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:47 smithi044 bash[22676]: audit 2024-09-21T03:59:47.439233+0000 mon.a (mon.0) 12009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:47 smithi044 bash[22676]: audit 2024-09-21T03:59:47.450902+0000 mon.a (mon.0) 12010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:47 smithi179 bash[23186]: audit 2024-09-21T03:59:46.204652+0000 mgr.a (mgr.14388) 14947 : audit [DBG] from='client.323832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:47 smithi179 bash[23186]: audit 2024-09-21T03:59:47.252163+0000 mon.a (mon.0) 12005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:47 smithi179 bash[23186]: audit 2024-09-21T03:59:47.259389+0000 mon.a (mon.0) 12006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:47 smithi179 bash[23186]: audit 2024-09-21T03:59:47.268542+0000 mon.a (mon.0) 12007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:47 smithi179 bash[23186]: audit 2024-09-21T03:59:47.429829+0000 mon.a (mon.0) 12008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:47 smithi179 bash[23186]: audit 2024-09-21T03:59:47.439233+0000 mon.a (mon.0) 12009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:47 smithi179 bash[23186]: audit 2024-09-21T03:59:47.450902+0000 mon.a (mon.0) 12010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:47 smithi049 bash[23528]: audit 2024-09-21T03:59:46.204652+0000 mgr.a (mgr.14388) 14947 : audit [DBG] from='client.323832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:47 smithi049 bash[23528]: audit 2024-09-21T03:59:47.252163+0000 mon.a (mon.0) 12005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:47 smithi049 bash[23528]: audit 2024-09-21T03:59:47.259389+0000 mon.a (mon.0) 12006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:47 smithi049 bash[23528]: audit 2024-09-21T03:59:47.268542+0000 mon.a (mon.0) 12007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:47 smithi049 bash[23528]: audit 2024-09-21T03:59:47.429829+0000 mon.a (mon.0) 12008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:47 smithi049 bash[23528]: audit 2024-09-21T03:59:47.439233+0000 mon.a (mon.0) 12009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:47.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:47 smithi049 bash[23528]: audit 2024-09-21T03:59:47.450902+0000 mon.a (mon.0) 12010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:48 smithi049 bash[23528]: cluster 2024-09-21T03:59:47.040440+0000 mgr.a (mgr.14388) 14948 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:48 smithi044 bash[22676]: cluster 2024-09-21T03:59:47.040440+0000 mgr.a (mgr.14388) 14948 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:48 smithi179 bash[23186]: cluster 2024-09-21T03:59:47.040440+0000 mgr.a (mgr.14388) 14948 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:50 smithi049 bash[23528]: cluster 2024-09-21T03:59:49.041237+0000 mgr.a (mgr.14388) 14949 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:50.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:50 smithi179 bash[23186]: cluster 2024-09-21T03:59:49.041237+0000 mgr.a (mgr.14388) 14949 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:50 smithi044 bash[22676]: cluster 2024-09-21T03:59:49.041237+0000 mgr.a (mgr.14388) 14949 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T03:59:51.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:52.414 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:52.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:52.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:52.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:52.414 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:52 smithi179 bash[23186]: cluster 2024-09-21T03:59:51.043219+0000 mgr.a (mgr.14388) 14950 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:52 smithi049 bash[23528]: cluster 2024-09-21T03:59:51.043219+0000 mgr.a (mgr.14388) 14950 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:52 smithi044 bash[22676]: cluster 2024-09-21T03:59:51.043219+0000 mgr.a (mgr.14388) 14950 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:53.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:53 smithi049 bash[23528]: audit 2024-09-21T03:59:51.964032+0000 mgr.a (mgr.14388) 14951 : audit [DBG] from='client.323910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:53.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:53 smithi044 bash[22676]: audit 2024-09-21T03:59:51.964032+0000 mgr.a (mgr.14388) 14951 : audit [DBG] from='client.323910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:54.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:53 smithi179 bash[23186]: audit 2024-09-21T03:59:51.964032+0000 mgr.a (mgr.14388) 14951 : audit [DBG] from='client.323910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:54 smithi049 bash[23528]: cluster 2024-09-21T03:59:53.044238+0000 mgr.a (mgr.14388) 14952 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:54 smithi044 bash[22676]: cluster 2024-09-21T03:59:53.044238+0000 mgr.a (mgr.14388) 14952 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:54 smithi179 bash[23186]: cluster 2024-09-21T03:59:53.044238+0000 mgr.a (mgr.14388) 14952 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:56.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:56 smithi049 bash[23528]: cluster 2024-09-21T03:59:55.045179+0000 mgr.a (mgr.14388) 14953 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:56.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:56 smithi049 bash[23528]: audit 2024-09-21T03:59:55.676147+0000 mon.a (mon.0) 12011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:56.934 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:56 smithi049 bash[23528]: audit 2024-09-21T03:59:55.685146+0000 mon.a (mon.0) 12012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:56.934 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:56 smithi049 bash[23528]: audit 2024-09-21T03:59:55.696311+0000 mon.a (mon.0) 12013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:56 smithi044 bash[22676]: cluster 2024-09-21T03:59:55.045179+0000 mgr.a (mgr.14388) 14953 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:56 smithi044 bash[22676]: audit 2024-09-21T03:59:55.676147+0000 mon.a (mon.0) 12011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:56 smithi044 bash[22676]: audit 2024-09-21T03:59:55.685146+0000 mon.a (mon.0) 12012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:56 smithi044 bash[22676]: audit 2024-09-21T03:59:55.696311+0000 mon.a (mon.0) 12013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:56 smithi179 bash[23186]: cluster 2024-09-21T03:59:55.045179+0000 mgr.a (mgr.14388) 14953 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T03:59:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:56 smithi179 bash[23186]: audit 2024-09-21T03:59:55.676147+0000 mon.a (mon.0) 12011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:56 smithi179 bash[23186]: audit 2024-09-21T03:59:55.685146+0000 mon.a (mon.0) 12012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:56 smithi179 bash[23186]: audit 2024-09-21T03:59:55.696311+0000 mon.a (mon.0) 12013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T03:59:57.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T03:59:57.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T03:59:57.416 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T03:59:58.179 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T03:59:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T03:59:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T03:59:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T03:59:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T03:59:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:58 smithi044 bash[22676]: cluster 2024-09-21T03:59:57.047453+0000 mgr.a (mgr.14388) 14954 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 03:59:58 smithi044 bash[22676]: audit 2024-09-21T03:59:57.745702+0000 mgr.a (mgr.14388) 14955 : audit [DBG] from='client.323985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:58 smithi179 bash[23186]: cluster 2024-09-21T03:59:57.047453+0000 mgr.a (mgr.14388) 14954 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 03:59:58 smithi179 bash[23186]: audit 2024-09-21T03:59:57.745702+0000 mgr.a (mgr.14388) 14955 : audit [DBG] from='client.323985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:58 smithi049 bash[23528]: cluster 2024-09-21T03:59:57.047453+0000 mgr.a (mgr.14388) 14954 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T03:59:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 03:59:58 smithi049 bash[23528]: audit 2024-09-21T03:59:57.745702+0000 mgr.a (mgr.14388) 14955 : audit [DBG] from='client.323985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:00.970 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:00 smithi044 bash[22676]: cluster 2024-09-21T03:59:59.048387+0000 mgr.a (mgr.14388) 14956 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:00.970 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:00 smithi044 bash[22676]: cluster 2024-09-21T04:00:00.000120+0000 mon.a (mon.0) 12014 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:00:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:00 smithi179 bash[23186]: cluster 2024-09-21T03:59:59.048387+0000 mgr.a (mgr.14388) 14956 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:00 smithi179 bash[23186]: cluster 2024-09-21T04:00:00.000120+0000 mon.a (mon.0) 12014 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:00:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:00 smithi049 bash[23528]: cluster 2024-09-21T03:59:59.048387+0000 mgr.a (mgr.14388) 14956 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:00 smithi049 bash[23528]: cluster 2024-09-21T04:00:00.000120+0000 mon.a (mon.0) 12014 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:00:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:02 smithi044 bash[22676]: cluster 2024-09-21T04:00:01.049688+0000 mgr.a (mgr.14388) 14957 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:02 smithi179 bash[23186]: cluster 2024-09-21T04:00:01.049688+0000 mgr.a (mgr.14388) 14957 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:02 smithi049 bash[23528]: cluster 2024-09-21T04:00:01.049688+0000 mgr.a (mgr.14388) 14957 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:03.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:03.960 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:03.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:03.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:03.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:03.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:04 smithi044 bash[22676]: cluster 2024-09-21T04:00:03.050455+0000 mgr.a (mgr.14388) 14958 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:04 smithi044 bash[22676]: audit 2024-09-21T04:00:03.513799+0000 mgr.a (mgr.14388) 14959 : audit [DBG] from='client.324060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:04 smithi179 bash[23186]: cluster 2024-09-21T04:00:03.050455+0000 mgr.a (mgr.14388) 14958 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:04 smithi179 bash[23186]: audit 2024-09-21T04:00:03.513799+0000 mgr.a (mgr.14388) 14959 : audit [DBG] from='client.324060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:04 smithi049 bash[23528]: cluster 2024-09-21T04:00:03.050455+0000 mgr.a (mgr.14388) 14958 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:04 smithi049 bash[23528]: audit 2024-09-21T04:00:03.513799+0000 mgr.a (mgr.14388) 14959 : audit [DBG] from='client.324060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:06 smithi044 bash[22676]: cluster 2024-09-21T04:00:05.051363+0000 mgr.a (mgr.14388) 14960 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:06 smithi179 bash[23186]: cluster 2024-09-21T04:00:05.051363+0000 mgr.a (mgr.14388) 14960 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:06 smithi049 bash[23528]: cluster 2024-09-21T04:00:05.051363+0000 mgr.a (mgr.14388) 14960 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:08 smithi044 bash[22676]: cluster 2024-09-21T04:00:07.053642+0000 mgr.a (mgr.14388) 14961 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:08 smithi044 bash[22676]: audit 2024-09-21T04:00:07.474551+0000 mon.a (mon.0) 12015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:08 smithi044 bash[22676]: audit 2024-09-21T04:00:07.479877+0000 mon.a (mon.0) 12016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:08 smithi044 bash[22676]: audit 2024-09-21T04:00:07.487649+0000 mon.a (mon.0) 12017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:08 smithi044 bash[22676]: audit 2024-09-21T04:00:07.668123+0000 mon.a (mon.0) 12018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:08 smithi044 bash[22676]: audit 2024-09-21T04:00:07.677169+0000 mon.a (mon.0) 12019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:08 smithi044 bash[22676]: audit 2024-09-21T04:00:07.687913+0000 mon.a (mon.0) 12020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:08 smithi179 bash[23186]: cluster 2024-09-21T04:00:07.053642+0000 mgr.a (mgr.14388) 14961 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:08 smithi179 bash[23186]: audit 2024-09-21T04:00:07.474551+0000 mon.a (mon.0) 12015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:08 smithi179 bash[23186]: audit 2024-09-21T04:00:07.479877+0000 mon.a (mon.0) 12016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:08 smithi179 bash[23186]: audit 2024-09-21T04:00:07.487649+0000 mon.a (mon.0) 12017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:08 smithi179 bash[23186]: audit 2024-09-21T04:00:07.668123+0000 mon.a (mon.0) 12018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:08 smithi179 bash[23186]: audit 2024-09-21T04:00:07.677169+0000 mon.a (mon.0) 12019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:08 smithi179 bash[23186]: audit 2024-09-21T04:00:07.687913+0000 mon.a (mon.0) 12020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:08 smithi049 bash[23528]: cluster 2024-09-21T04:00:07.053642+0000 mgr.a (mgr.14388) 14961 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:08 smithi049 bash[23528]: audit 2024-09-21T04:00:07.474551+0000 mon.a (mon.0) 12015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:08 smithi049 bash[23528]: audit 2024-09-21T04:00:07.479877+0000 mon.a (mon.0) 12016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:08 smithi049 bash[23528]: audit 2024-09-21T04:00:07.487649+0000 mon.a (mon.0) 12017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:08 smithi049 bash[23528]: audit 2024-09-21T04:00:07.668123+0000 mon.a (mon.0) 12018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:08 smithi049 bash[23528]: audit 2024-09-21T04:00:07.677169+0000 mon.a (mon.0) 12019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:08 smithi049 bash[23528]: audit 2024-09-21T04:00:07.687913+0000 mon.a (mon.0) 12020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:08.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:08.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:08.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:09.722 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:10 smithi044 bash[22676]: cluster 2024-09-21T04:00:09.054078+0000 mgr.a (mgr.14388) 14962 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:10 smithi044 bash[22676]: audit 2024-09-21T04:00:09.289683+0000 mgr.a (mgr.14388) 14963 : audit [DBG] from='client.324138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:10 smithi179 bash[23186]: cluster 2024-09-21T04:00:09.054078+0000 mgr.a (mgr.14388) 14962 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:10 smithi179 bash[23186]: audit 2024-09-21T04:00:09.289683+0000 mgr.a (mgr.14388) 14963 : audit [DBG] from='client.324138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:10 smithi049 bash[23528]: cluster 2024-09-21T04:00:09.054078+0000 mgr.a (mgr.14388) 14962 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:10 smithi049 bash[23528]: audit 2024-09-21T04:00:09.289683+0000 mgr.a (mgr.14388) 14963 : audit [DBG] from='client.324138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:12 smithi044 bash[22676]: cluster 2024-09-21T04:00:11.056521+0000 mgr.a (mgr.14388) 14964 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:12 smithi179 bash[23186]: cluster 2024-09-21T04:00:11.056521+0000 mgr.a (mgr.14388) 14964 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:12 smithi049 bash[23528]: cluster 2024-09-21T04:00:11.056521+0000 mgr.a (mgr.14388) 14964 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:14 smithi179 bash[23186]: cluster 2024-09-21T04:00:13.057497+0000 mgr.a (mgr.14388) 14965 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:14 smithi049 bash[23528]: cluster 2024-09-21T04:00:13.057497+0000 mgr.a (mgr.14388) 14965 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:14.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:14 smithi044 bash[22676]: cluster 2024-09-21T04:00:13.057497+0000 mgr.a (mgr.14388) 14965 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:15.506 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:15.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:15.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:15.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:15.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:16 smithi049 bash[23528]: audit 2024-09-21T04:00:15.057988+0000 mgr.a (mgr.14388) 14966 : audit [DBG] from='client.324213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:16 smithi049 bash[23528]: cluster 2024-09-21T04:00:15.058353+0000 mgr.a (mgr.14388) 14967 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:16 smithi049 bash[23528]: audit 2024-09-21T04:00:15.913295+0000 mon.a (mon.0) 12021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:16 smithi049 bash[23528]: audit 2024-09-21T04:00:15.921963+0000 mon.a (mon.0) 12022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:16 smithi049 bash[23528]: audit 2024-09-21T04:00:15.932712+0000 mon.a (mon.0) 12023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:16 smithi179 bash[23186]: audit 2024-09-21T04:00:15.057988+0000 mgr.a (mgr.14388) 14966 : audit [DBG] from='client.324213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:16 smithi179 bash[23186]: cluster 2024-09-21T04:00:15.058353+0000 mgr.a (mgr.14388) 14967 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:16 smithi179 bash[23186]: audit 2024-09-21T04:00:15.913295+0000 mon.a (mon.0) 12021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:16 smithi179 bash[23186]: audit 2024-09-21T04:00:15.921963+0000 mon.a (mon.0) 12022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:16 smithi179 bash[23186]: audit 2024-09-21T04:00:15.932712+0000 mon.a (mon.0) 12023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:16 smithi044 bash[22676]: audit 2024-09-21T04:00:15.057988+0000 mgr.a (mgr.14388) 14966 : audit [DBG] from='client.324213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:16 smithi044 bash[22676]: cluster 2024-09-21T04:00:15.058353+0000 mgr.a (mgr.14388) 14967 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:16 smithi044 bash[22676]: audit 2024-09-21T04:00:15.913295+0000 mon.a (mon.0) 12021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:16 smithi044 bash[22676]: audit 2024-09-21T04:00:15.921963+0000 mon.a (mon.0) 12022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:16 smithi044 bash[22676]: audit 2024-09-21T04:00:15.932712+0000 mon.a (mon.0) 12023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:18 smithi179 bash[23186]: cluster 2024-09-21T04:00:17.061128+0000 mgr.a (mgr.14388) 14968 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:18 smithi049 bash[23528]: cluster 2024-09-21T04:00:17.061128+0000 mgr.a (mgr.14388) 14968 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:18 smithi044 bash[22676]: cluster 2024-09-21T04:00:17.061128+0000 mgr.a (mgr.14388) 14968 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:20.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:20.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:20.509 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:20 smithi179 bash[23186]: cluster 2024-09-21T04:00:19.061909+0000 mgr.a (mgr.14388) 14969 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:20 smithi049 bash[23528]: cluster 2024-09-21T04:00:19.061909+0000 mgr.a (mgr.14388) 14969 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:20 smithi044 bash[22676]: cluster 2024-09-21T04:00:19.061909+0000 mgr.a (mgr.14388) 14969 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:21.294 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:22 smithi049 bash[23528]: audit 2024-09-21T04:00:20.845347+0000 mgr.a (mgr.14388) 14970 : audit [DBG] from='client.324291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:22 smithi049 bash[23528]: cluster 2024-09-21T04:00:21.063187+0000 mgr.a (mgr.14388) 14971 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:22 smithi044 bash[22676]: audit 2024-09-21T04:00:20.845347+0000 mgr.a (mgr.14388) 14970 : audit [DBG] from='client.324291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:22 smithi044 bash[22676]: cluster 2024-09-21T04:00:21.063187+0000 mgr.a (mgr.14388) 14971 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:22 smithi179 bash[23186]: audit 2024-09-21T04:00:20.845347+0000 mgr.a (mgr.14388) 14970 : audit [DBG] from='client.324291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:22 smithi179 bash[23186]: cluster 2024-09-21T04:00:21.063187+0000 mgr.a (mgr.14388) 14971 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:24 smithi049 bash[23528]: cluster 2024-09-21T04:00:23.063745+0000 mgr.a (mgr.14388) 14972 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:24 smithi044 bash[22676]: cluster 2024-09-21T04:00:23.063745+0000 mgr.a (mgr.14388) 14972 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:25.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:24 smithi179 bash[23186]: cluster 2024-09-21T04:00:23.063745+0000 mgr.a (mgr.14388) 14972 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:26.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:26.296 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:26 smithi049 bash[23528]: cluster 2024-09-21T04:00:25.066025+0000 mgr.a (mgr.14388) 14973 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:26 smithi044 bash[22676]: cluster 2024-09-21T04:00:25.066025+0000 mgr.a (mgr.14388) 14973 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:26 smithi179 bash[23186]: cluster 2024-09-21T04:00:25.066025+0000 mgr.a (mgr.14388) 14973 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:27.067 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:27.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:27.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:27.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:27.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:27.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:27 smithi049 bash[23528]: audit 2024-09-21T04:00:26.630205+0000 mgr.a (mgr.14388) 14974 : audit [DBG] from='client.324366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:27.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:27 smithi044 bash[22676]: audit 2024-09-21T04:00:26.630205+0000 mgr.a (mgr.14388) 14974 : audit [DBG] from='client.324366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:27 smithi179 bash[23186]: audit 2024-09-21T04:00:26.630205+0000 mgr.a (mgr.14388) 14974 : audit [DBG] from='client.324366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: cluster 2024-09-21T04:00:27.066551+0000 mgr.a (mgr.14388) 14975 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:27.705663+0000 mon.a (mon.0) 12024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:27.712362+0000 mon.a (mon.0) 12025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:27.719920+0000 mon.a (mon.0) 12026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:27.903359+0000 mon.a (mon.0) 12027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:27.911542+0000 mon.a (mon.0) 12028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:27.922657+0000 mon.a (mon.0) 12029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:28.347578+0000 mon.a (mon.0) 12030 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:28.354196+0000 mon.a (mon.0) 12031 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:28.356011+0000 mon.a (mon.0) 12032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:28.367064+0000 mon.a (mon.0) 12033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:28 smithi044 bash[22676]: audit 2024-09-21T04:00:28.374044+0000 mon.a (mon.0) 12034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: cluster 2024-09-21T04:00:27.066551+0000 mgr.a (mgr.14388) 14975 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:27.705663+0000 mon.a (mon.0) 12024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:27.712362+0000 mon.a (mon.0) 12025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:27.719920+0000 mon.a (mon.0) 12026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:27.903359+0000 mon.a (mon.0) 12027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:27.911542+0000 mon.a (mon.0) 12028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:27.922657+0000 mon.a (mon.0) 12029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:28.347578+0000 mon.a (mon.0) 12030 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:00:29.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:28.354196+0000 mon.a (mon.0) 12031 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:00:29.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:28.356011+0000 mon.a (mon.0) 12032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:00:29.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:28.367064+0000 mon.a (mon.0) 12033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:28 smithi179 bash[23186]: audit 2024-09-21T04:00:28.374044+0000 mon.a (mon.0) 12034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:00:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: cluster 2024-09-21T04:00:27.066551+0000 mgr.a (mgr.14388) 14975 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:27.705663+0000 mon.a (mon.0) 12024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:27.712362+0000 mon.a (mon.0) 12025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:27.719920+0000 mon.a (mon.0) 12026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:27.903359+0000 mon.a (mon.0) 12027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:27.911542+0000 mon.a (mon.0) 12028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:27.922657+0000 mon.a (mon.0) 12029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:28.347578+0000 mon.a (mon.0) 12030 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:28.354196+0000 mon.a (mon.0) 12031 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:00:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:28.356011+0000 mon.a (mon.0) 12032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:00:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:28.367064+0000 mon.a (mon.0) 12033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:28 smithi049 bash[23528]: audit 2024-09-21T04:00:28.374044+0000 mon.a (mon.0) 12034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:00:29.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:00:29 smithi044 bash[22930]: debug 2024-09-21T04:00:29.186+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:00:29.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:00:29 smithi044 bash[22930]: debug 2024-09-21T04:00:29.186+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:00:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:29 smithi044 bash[22676]: audit 2024-09-21T04:00:28.376778+0000 mgr.a (mgr.14388) 14976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:00:30.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:29 smithi179 bash[23186]: audit 2024-09-21T04:00:28.376778+0000 mgr.a (mgr.14388) 14976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:00:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:29 smithi049 bash[23528]: audit 2024-09-21T04:00:28.376778+0000 mgr.a (mgr.14388) 14976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:00:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:30 smithi044 bash[22676]: cluster 2024-09-21T04:00:29.067231+0000 mgr.a (mgr.14388) 14977 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:30 smithi044 bash[22676]: audit 2024-09-21T04:00:29.189348+0000 mgr.a (mgr.14388) 14978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:00:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:30 smithi044 bash[22676]: cephadm 2024-09-21T04:00:29.190740+0000 mgr.a (mgr.14388) 14979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:00:30.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:30 smithi179 bash[23186]: cluster 2024-09-21T04:00:29.067231+0000 mgr.a (mgr.14388) 14977 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:30.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:30 smithi179 bash[23186]: audit 2024-09-21T04:00:29.189348+0000 mgr.a (mgr.14388) 14978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:00:30.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:30 smithi179 bash[23186]: cephadm 2024-09-21T04:00:29.190740+0000 mgr.a (mgr.14388) 14979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:00:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:30 smithi049 bash[23528]: cluster 2024-09-21T04:00:29.067231+0000 mgr.a (mgr.14388) 14977 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:30 smithi049 bash[23528]: audit 2024-09-21T04:00:29.189348+0000 mgr.a (mgr.14388) 14978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:00:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:30 smithi049 bash[23528]: cephadm 2024-09-21T04:00:29.190740+0000 mgr.a (mgr.14388) 14979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:00:32.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:32.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:32.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:32.835 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:32.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:32.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:32.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:32.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:32 smithi044 bash[22676]: cluster 2024-09-21T04:00:31.069496+0000 mgr.a (mgr.14388) 14980 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:32 smithi179 bash[23186]: cluster 2024-09-21T04:00:31.069496+0000 mgr.a (mgr.14388) 14980 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:32 smithi049 bash[23528]: cluster 2024-09-21T04:00:31.069496+0000 mgr.a (mgr.14388) 14980 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:33 smithi179 bash[23186]: audit 2024-09-21T04:00:32.398643+0000 mgr.a (mgr.14388) 14981 : audit [DBG] from='client.324546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:33 smithi044 bash[22676]: audit 2024-09-21T04:00:32.398643+0000 mgr.a (mgr.14388) 14981 : audit [DBG] from='client.324546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:34.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:33 smithi049 bash[23528]: audit 2024-09-21T04:00:32.398643+0000 mgr.a (mgr.14388) 14981 : audit [DBG] from='client.324546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:34 smithi044 bash[22676]: cluster 2024-09-21T04:00:33.070485+0000 mgr.a (mgr.14388) 14982 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:34 smithi179 bash[23186]: cluster 2024-09-21T04:00:33.070485+0000 mgr.a (mgr.14388) 14982 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:34 smithi049 bash[23528]: cluster 2024-09-21T04:00:33.070485+0000 mgr.a (mgr.14388) 14982 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:36.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:36 smithi044 bash[22676]: cluster 2024-09-21T04:00:35.072605+0000 mgr.a (mgr.14388) 14983 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:36 smithi044 bash[22676]: audit 2024-09-21T04:00:36.146332+0000 mon.a (mon.0) 12035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:36 smithi044 bash[22676]: audit 2024-09-21T04:00:36.155056+0000 mon.a (mon.0) 12036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:36 smithi044 bash[22676]: audit 2024-09-21T04:00:36.165635+0000 mon.a (mon.0) 12037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:36 smithi179 bash[23186]: cluster 2024-09-21T04:00:35.072605+0000 mgr.a (mgr.14388) 14983 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:36 smithi179 bash[23186]: audit 2024-09-21T04:00:36.146332+0000 mon.a (mon.0) 12035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:36 smithi179 bash[23186]: audit 2024-09-21T04:00:36.155056+0000 mon.a (mon.0) 12036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:36 smithi179 bash[23186]: audit 2024-09-21T04:00:36.165635+0000 mon.a (mon.0) 12037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:36 smithi049 bash[23528]: cluster 2024-09-21T04:00:35.072605+0000 mgr.a (mgr.14388) 14983 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:36 smithi049 bash[23528]: audit 2024-09-21T04:00:36.146332+0000 mon.a (mon.0) 12035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:36 smithi049 bash[23528]: audit 2024-09-21T04:00:36.155056+0000 mon.a (mon.0) 12036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:36 smithi049 bash[23528]: audit 2024-09-21T04:00:36.165635+0000 mon.a (mon.0) 12037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:37.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:37.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:37.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:38.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:38.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:38.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:38.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:38.623 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:38 smithi179 bash[23186]: cluster 2024-09-21T04:00:37.073417+0000 mgr.a (mgr.14388) 14984 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:38 smithi049 bash[23528]: cluster 2024-09-21T04:00:37.073417+0000 mgr.a (mgr.14388) 14984 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:38 smithi044 bash[22676]: cluster 2024-09-21T04:00:37.073417+0000 mgr.a (mgr.14388) 14984 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:39 smithi179 bash[23186]: audit 2024-09-21T04:00:38.169514+0000 mgr.a (mgr.14388) 14985 : audit [DBG] from='client.324624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:39 smithi049 bash[23528]: audit 2024-09-21T04:00:38.169514+0000 mgr.a (mgr.14388) 14985 : audit [DBG] from='client.324624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:39 smithi044 bash[22676]: audit 2024-09-21T04:00:38.169514+0000 mgr.a (mgr.14388) 14985 : audit [DBG] from='client.324624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:40 smithi179 bash[23186]: cluster 2024-09-21T04:00:39.074328+0000 mgr.a (mgr.14388) 14986 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:40 smithi049 bash[23528]: cluster 2024-09-21T04:00:39.074328+0000 mgr.a (mgr.14388) 14986 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:41.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:40 smithi044 bash[22676]: cluster 2024-09-21T04:00:39.074328+0000 mgr.a (mgr.14388) 14986 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:42 smithi049 bash[23528]: cluster 2024-09-21T04:00:41.076654+0000 mgr.a (mgr.14388) 14987 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:43.210 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:42 smithi044 bash[22676]: cluster 2024-09-21T04:00:41.076654+0000 mgr.a (mgr.14388) 14987 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:42 smithi179 bash[23186]: cluster 2024-09-21T04:00:41.076654+0000 mgr.a (mgr.14388) 14987 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:00:43.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:43.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:43.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:44.066 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:43 smithi044 bash[22676]: cluster 2024-09-21T04:00:43.077539+0000 mgr.a (mgr.14388) 14988 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:43 smithi179 bash[23186]: cluster 2024-09-21T04:00:43.077539+0000 mgr.a (mgr.14388) 14988 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:44.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:43 smithi049 bash[23528]: cluster 2024-09-21T04:00:43.077539+0000 mgr.a (mgr.14388) 14988 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:44.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:44.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:44.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:44.401 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:44 smithi179 bash[23186]: audit 2024-09-21T04:00:43.961814+0000 mgr.a (mgr.14388) 14989 : audit [DBG] from='client.324702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:44 smithi044 bash[22676]: audit 2024-09-21T04:00:43.961814+0000 mgr.a (mgr.14388) 14989 : audit [DBG] from='client.324702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:44 smithi049 bash[23528]: audit 2024-09-21T04:00:43.961814+0000 mgr.a (mgr.14388) 14989 : audit [DBG] from='client.324702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:45 smithi044 bash[22676]: cluster 2024-09-21T04:00:45.079848+0000 mgr.a (mgr.14388) 14990 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:46.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:45 smithi179 bash[23186]: cluster 2024-09-21T04:00:45.079848+0000 mgr.a (mgr.14388) 14990 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:46.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:45 smithi049 bash[23528]: cluster 2024-09-21T04:00:45.079848+0000 mgr.a (mgr.14388) 14990 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:00:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:48 smithi179 bash[23186]: cluster 2024-09-21T04:00:47.080663+0000 mgr.a (mgr.14388) 14991 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:48 smithi179 bash[23186]: audit 2024-09-21T04:00:47.933690+0000 mon.a (mon.0) 12038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:48 smithi179 bash[23186]: audit 2024-09-21T04:00:47.940321+0000 mon.a (mon.0) 12039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:48 smithi179 bash[23186]: audit 2024-09-21T04:00:47.949061+0000 mon.a (mon.0) 12040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:48 smithi044 bash[22676]: cluster 2024-09-21T04:00:47.080663+0000 mgr.a (mgr.14388) 14991 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:48 smithi044 bash[22676]: audit 2024-09-21T04:00:47.933690+0000 mon.a (mon.0) 12038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:48 smithi044 bash[22676]: audit 2024-09-21T04:00:47.940321+0000 mon.a (mon.0) 12039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:48 smithi044 bash[22676]: audit 2024-09-21T04:00:47.949061+0000 mon.a (mon.0) 12040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:48 smithi049 bash[23528]: cluster 2024-09-21T04:00:47.080663+0000 mgr.a (mgr.14388) 14991 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:48 smithi049 bash[23528]: audit 2024-09-21T04:00:47.933690+0000 mon.a (mon.0) 12038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:48 smithi049 bash[23528]: audit 2024-09-21T04:00:47.940321+0000 mon.a (mon.0) 12039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:48 smithi049 bash[23528]: audit 2024-09-21T04:00:47.949061+0000 mon.a (mon.0) 12040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:49 smithi044 bash[22676]: audit 2024-09-21T04:00:48.147229+0000 mon.a (mon.0) 12041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:49 smithi044 bash[22676]: audit 2024-09-21T04:00:48.154050+0000 mon.a (mon.0) 12042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:49 smithi044 bash[22676]: audit 2024-09-21T04:00:48.165159+0000 mon.a (mon.0) 12043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:49 smithi179 bash[23186]: audit 2024-09-21T04:00:48.147229+0000 mon.a (mon.0) 12041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:49 smithi179 bash[23186]: audit 2024-09-21T04:00:48.154050+0000 mon.a (mon.0) 12042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:49 smithi179 bash[23186]: audit 2024-09-21T04:00:48.165159+0000 mon.a (mon.0) 12043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:49 smithi049 bash[23528]: audit 2024-09-21T04:00:48.147229+0000 mon.a (mon.0) 12041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:49 smithi049 bash[23528]: audit 2024-09-21T04:00:48.154050+0000 mon.a (mon.0) 12042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:49 smithi049 bash[23528]: audit 2024-09-21T04:00:48.165159+0000 mon.a (mon.0) 12043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:50.178 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:50.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:50.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:50.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:50.179 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:50 smithi044 bash[22676]: cluster 2024-09-21T04:00:49.081627+0000 mgr.a (mgr.14388) 14992 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:50 smithi044 bash[22676]: audit 2024-09-21T04:00:49.737237+0000 mgr.a (mgr.14388) 14993 : audit [DBG] from='client.324780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:50.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:50 smithi179 bash[23186]: cluster 2024-09-21T04:00:49.081627+0000 mgr.a (mgr.14388) 14992 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:50 smithi179 bash[23186]: audit 2024-09-21T04:00:49.737237+0000 mgr.a (mgr.14388) 14993 : audit [DBG] from='client.324780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:50 smithi049 bash[23528]: cluster 2024-09-21T04:00:49.081627+0000 mgr.a (mgr.14388) 14992 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:50.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:50 smithi049 bash[23528]: audit 2024-09-21T04:00:49.737237+0000 mgr.a (mgr.14388) 14993 : audit [DBG] from='client.324780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:52 smithi044 bash[22676]: cluster 2024-09-21T04:00:51.084487+0000 mgr.a (mgr.14388) 14994 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:52.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:52 smithi179 bash[23186]: cluster 2024-09-21T04:00:51.084487+0000 mgr.a (mgr.14388) 14994 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:52 smithi049 bash[23528]: cluster 2024-09-21T04:00:51.084487+0000 mgr.a (mgr.14388) 14994 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:54 smithi044 bash[22676]: cluster 2024-09-21T04:00:53.085270+0000 mgr.a (mgr.14388) 14995 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:54.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:54 smithi179 bash[23186]: cluster 2024-09-21T04:00:53.085270+0000 mgr.a (mgr.14388) 14995 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:54 smithi049 bash[23528]: cluster 2024-09-21T04:00:53.085270+0000 mgr.a (mgr.14388) 14995 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:55.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:00:55.180 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:00:55.181 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:00:55.977 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:00:55.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:00:55.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:00:55.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:00:55.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:00:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:56 smithi044 bash[22676]: cluster 2024-09-21T04:00:55.087247+0000 mgr.a (mgr.14388) 14996 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:56 smithi044 bash[22676]: audit 2024-09-21T04:00:55.518503+0000 mgr.a (mgr.14388) 14997 : audit [DBG] from='client.324855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:56 smithi179 bash[23186]: cluster 2024-09-21T04:00:55.087247+0000 mgr.a (mgr.14388) 14996 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:56 smithi179 bash[23186]: audit 2024-09-21T04:00:55.518503+0000 mgr.a (mgr.14388) 14997 : audit [DBG] from='client.324855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:56 smithi049 bash[23528]: cluster 2024-09-21T04:00:55.087247+0000 mgr.a (mgr.14388) 14996 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:00:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:56 smithi049 bash[23528]: audit 2024-09-21T04:00:55.518503+0000 mgr.a (mgr.14388) 14997 : audit [DBG] from='client.324855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:57.694 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:57 smithi049 bash[23528]: audit 2024-09-21T04:00:56.349979+0000 mon.a (mon.0) 12044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.695 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:57 smithi049 bash[23528]: audit 2024-09-21T04:00:56.358899+0000 mon.a (mon.0) 12045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.695 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:57 smithi049 bash[23528]: audit 2024-09-21T04:00:56.369779+0000 mon.a (mon.0) 12046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:57 smithi044 bash[22676]: audit 2024-09-21T04:00:56.349979+0000 mon.a (mon.0) 12044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:57 smithi044 bash[22676]: audit 2024-09-21T04:00:56.358899+0000 mon.a (mon.0) 12045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:57 smithi044 bash[22676]: audit 2024-09-21T04:00:56.369779+0000 mon.a (mon.0) 12046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:57 smithi179 bash[23186]: audit 2024-09-21T04:00:56.349979+0000 mon.a (mon.0) 12044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:57 smithi179 bash[23186]: audit 2024-09-21T04:00:56.358899+0000 mon.a (mon.0) 12045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:57 smithi179 bash[23186]: audit 2024-09-21T04:00:56.369779+0000 mon.a (mon.0) 12046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:00:58.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:00:58 smithi049 bash[23528]: cluster 2024-09-21T04:00:57.088153+0000 mgr.a (mgr.14388) 14998 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:58.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:00:58 smithi044 bash[22676]: cluster 2024-09-21T04:00:57.088153+0000 mgr.a (mgr.14388) 14998 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:00:58.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:00:58 smithi179 bash[23186]: cluster 2024-09-21T04:00:57.088153+0000 mgr.a (mgr.14388) 14998 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:01:00.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:00 smithi044 bash[22676]: cluster 2024-09-21T04:00:59.088950+0000 mgr.a (mgr.14388) 14999 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:01:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:00 smithi179 bash[23186]: cluster 2024-09-21T04:00:59.088950+0000 mgr.a (mgr.14388) 14999 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:01:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:00 smithi049 bash[23528]: cluster 2024-09-21T04:00:59.088950+0000 mgr.a (mgr.14388) 14999 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:01:00.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:00.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:01.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:01.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:01.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:01.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:02.655 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:02 smithi044 bash[22676]: cluster 2024-09-21T04:01:01.090032+0000 mgr.a (mgr.14388) 15000 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:02.655 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:02 smithi044 bash[22676]: audit 2024-09-21T04:01:01.313152+0000 mgr.a (mgr.14388) 15001 : audit [DBG] from='client.324927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:02 smithi179 bash[23186]: cluster 2024-09-21T04:01:01.090032+0000 mgr.a (mgr.14388) 15000 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:02 smithi179 bash[23186]: audit 2024-09-21T04:01:01.313152+0000 mgr.a (mgr.14388) 15001 : audit [DBG] from='client.324927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:02 smithi049 bash[23528]: cluster 2024-09-21T04:01:01.090032+0000 mgr.a (mgr.14388) 15000 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:02.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:02 smithi049 bash[23528]: audit 2024-09-21T04:01:01.313152+0000 mgr.a (mgr.14388) 15001 : audit [DBG] from='client.324927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:04.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:04 smithi044 bash[22676]: cluster 2024-09-21T04:01:03.090882+0000 mgr.a (mgr.14388) 15002 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:04 smithi179 bash[23186]: cluster 2024-09-21T04:01:03.090882+0000 mgr.a (mgr.14388) 15002 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:04 smithi049 bash[23528]: cluster 2024-09-21T04:01:03.090882+0000 mgr.a (mgr.14388) 15002 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:06 smithi044 bash[22676]: cluster 2024-09-21T04:01:05.093228+0000 mgr.a (mgr.14388) 15003 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:06.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:06.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:06 smithi179 bash[23186]: cluster 2024-09-21T04:01:05.093228+0000 mgr.a (mgr.14388) 15003 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:06 smithi049 bash[23528]: cluster 2024-09-21T04:01:05.093228+0000 mgr.a (mgr.14388) 15003 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:07.508 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:07.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:07.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:07.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:07.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: audit 2024-09-21T04:01:07.081164+0000 mgr.a (mgr.14388) 15004 : audit [DBG] from='client.325005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: cluster 2024-09-21T04:01:07.095212+0000 mgr.a (mgr.14388) 15005 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: audit 2024-09-21T04:01:08.161009+0000 mon.a (mon.0) 12047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: audit 2024-09-21T04:01:08.171137+0000 mon.a (mon.0) 12048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: audit 2024-09-21T04:01:08.180471+0000 mon.a (mon.0) 12049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: audit 2024-09-21T04:01:08.369578+0000 mon.a (mon.0) 12050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: audit 2024-09-21T04:01:08.378632+0000 mon.a (mon.0) 12051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:08 smithi179 bash[23186]: audit 2024-09-21T04:01:08.388128+0000 mon.a (mon.0) 12052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: audit 2024-09-21T04:01:07.081164+0000 mgr.a (mgr.14388) 15004 : audit [DBG] from='client.325005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: cluster 2024-09-21T04:01:07.095212+0000 mgr.a (mgr.14388) 15005 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: audit 2024-09-21T04:01:08.161009+0000 mon.a (mon.0) 12047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: audit 2024-09-21T04:01:08.171137+0000 mon.a (mon.0) 12048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: audit 2024-09-21T04:01:08.180471+0000 mon.a (mon.0) 12049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: audit 2024-09-21T04:01:08.369578+0000 mon.a (mon.0) 12050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: audit 2024-09-21T04:01:08.378632+0000 mon.a (mon.0) 12051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:08 smithi044 bash[22676]: audit 2024-09-21T04:01:08.388128+0000 mon.a (mon.0) 12052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: audit 2024-09-21T04:01:07.081164+0000 mgr.a (mgr.14388) 15004 : audit [DBG] from='client.325005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: cluster 2024-09-21T04:01:07.095212+0000 mgr.a (mgr.14388) 15005 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: audit 2024-09-21T04:01:08.161009+0000 mon.a (mon.0) 12047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: audit 2024-09-21T04:01:08.171137+0000 mon.a (mon.0) 12048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: audit 2024-09-21T04:01:08.180471+0000 mon.a (mon.0) 12049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: audit 2024-09-21T04:01:08.369578+0000 mon.a (mon.0) 12050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: audit 2024-09-21T04:01:08.378632+0000 mon.a (mon.0) 12051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:08 smithi049 bash[23528]: audit 2024-09-21T04:01:08.388128+0000 mon.a (mon.0) 12052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:10 smithi044 bash[22676]: cluster 2024-09-21T04:01:09.096283+0000 mgr.a (mgr.14388) 15006 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:10 smithi179 bash[23186]: cluster 2024-09-21T04:01:09.096283+0000 mgr.a (mgr.14388) 15006 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:10 smithi049 bash[23528]: cluster 2024-09-21T04:01:09.096283+0000 mgr.a (mgr.14388) 15006 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:12.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:12.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:12.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:12 smithi044 bash[22676]: cluster 2024-09-21T04:01:11.098580+0000 mgr.a (mgr.14388) 15007 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:12.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:12 smithi179 bash[23186]: cluster 2024-09-21T04:01:11.098580+0000 mgr.a (mgr.14388) 15007 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:12 smithi049 bash[23528]: cluster 2024-09-21T04:01:11.098580+0000 mgr.a (mgr.14388) 15007 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:13.294 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:13.295 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:14 smithi179 bash[23186]: audit 2024-09-21T04:01:12.840191+0000 mgr.a (mgr.14388) 15008 : audit [DBG] from='client.325083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:14 smithi179 bash[23186]: cluster 2024-09-21T04:01:13.099199+0000 mgr.a (mgr.14388) 15009 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:14 smithi044 bash[22676]: audit 2024-09-21T04:01:12.840191+0000 mgr.a (mgr.14388) 15008 : audit [DBG] from='client.325083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:14 smithi044 bash[22676]: cluster 2024-09-21T04:01:13.099199+0000 mgr.a (mgr.14388) 15009 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:14 smithi049 bash[23528]: audit 2024-09-21T04:01:12.840191+0000 mgr.a (mgr.14388) 15008 : audit [DBG] from='client.325083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:14 smithi049 bash[23528]: cluster 2024-09-21T04:01:13.099199+0000 mgr.a (mgr.14388) 15009 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:16 smithi044 bash[22676]: cluster 2024-09-21T04:01:15.101558+0000 mgr.a (mgr.14388) 15010 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:16 smithi179 bash[23186]: cluster 2024-09-21T04:01:15.101558+0000 mgr.a (mgr.14388) 15010 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:16.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:16 smithi049 bash[23528]: cluster 2024-09-21T04:01:15.101558+0000 mgr.a (mgr.14388) 15010 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:17.887 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:17 smithi049 bash[23528]: audit 2024-09-21T04:01:16.591506+0000 mon.a (mon.0) 12053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:17.888 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:17 smithi049 bash[23528]: audit 2024-09-21T04:01:16.600317+0000 mon.a (mon.0) 12054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:17.888 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:17 smithi049 bash[23528]: audit 2024-09-21T04:01:16.610726+0000 mon.a (mon.0) 12055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:17 smithi044 bash[22676]: audit 2024-09-21T04:01:16.591506+0000 mon.a (mon.0) 12053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:17 smithi044 bash[22676]: audit 2024-09-21T04:01:16.600317+0000 mon.a (mon.0) 12054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:17 smithi044 bash[22676]: audit 2024-09-21T04:01:16.610726+0000 mon.a (mon.0) 12055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:18.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:17 smithi179 bash[23186]: audit 2024-09-21T04:01:16.591506+0000 mon.a (mon.0) 12053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:17 smithi179 bash[23186]: audit 2024-09-21T04:01:16.600317+0000 mon.a (mon.0) 12054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:17 smithi179 bash[23186]: audit 2024-09-21T04:01:16.610726+0000 mon.a (mon.0) 12055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:18.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:18 smithi044 bash[22676]: cluster 2024-09-21T04:01:17.102341+0000 mgr.a (mgr.14388) 15011 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:19.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:18 smithi179 bash[23186]: cluster 2024-09-21T04:01:17.102341+0000 mgr.a (mgr.14388) 15011 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:19.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:18 smithi049 bash[23528]: cluster 2024-09-21T04:01:17.102341+0000 mgr.a (mgr.14388) 15011 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:19.063 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:19.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:19 smithi044 bash[22676]: audit 2024-09-21T04:01:18.635597+0000 mgr.a (mgr.14388) 15012 : audit [DBG] from='client.325161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:19.994 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:19 smithi049 bash[23528]: audit 2024-09-21T04:01:18.635597+0000 mgr.a (mgr.14388) 15012 : audit [DBG] from='client.325161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:20.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:19 smithi179 bash[23186]: audit 2024-09-21T04:01:18.635597+0000 mgr.a (mgr.14388) 15012 : audit [DBG] from='client.325161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:20 smithi044 bash[22676]: cluster 2024-09-21T04:01:19.102840+0000 mgr.a (mgr.14388) 15013 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:21.003 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:20 smithi049 bash[23528]: cluster 2024-09-21T04:01:19.102840+0000 mgr.a (mgr.14388) 15013 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:20 smithi179 bash[23186]: cluster 2024-09-21T04:01:19.102840+0000 mgr.a (mgr.14388) 15013 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:22.980 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:22 smithi044 bash[22676]: cluster 2024-09-21T04:01:21.105113+0000 mgr.a (mgr.14388) 15014 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:22 smithi179 bash[23186]: cluster 2024-09-21T04:01:21.105113+0000 mgr.a (mgr.14388) 15014 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:22 smithi049 bash[23528]: cluster 2024-09-21T04:01:21.105113+0000 mgr.a (mgr.14388) 15014 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:24.828 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:24.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:24.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:24.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:24.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:24.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:24 smithi044 bash[22676]: cluster 2024-09-21T04:01:23.105929+0000 mgr.a (mgr.14388) 15015 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:24 smithi179 bash[23186]: cluster 2024-09-21T04:01:23.105929+0000 mgr.a (mgr.14388) 15015 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:24 smithi049 bash[23528]: cluster 2024-09-21T04:01:23.105929+0000 mgr.a (mgr.14388) 15015 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:25.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:25 smithi044 bash[22676]: audit 2024-09-21T04:01:24.388590+0000 mgr.a (mgr.14388) 15016 : audit [DBG] from='client.325236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:26.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:25 smithi179 bash[23186]: audit 2024-09-21T04:01:24.388590+0000 mgr.a (mgr.14388) 15016 : audit [DBG] from='client.325236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:25 smithi049 bash[23528]: audit 2024-09-21T04:01:24.388590+0000 mgr.a (mgr.14388) 15016 : audit [DBG] from='client.325236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:26.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:26 smithi044 bash[22676]: cluster 2024-09-21T04:01:25.108223+0000 mgr.a (mgr.14388) 15017 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:26 smithi179 bash[23186]: cluster 2024-09-21T04:01:25.108223+0000 mgr.a (mgr.14388) 15017 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:26 smithi049 bash[23528]: cluster 2024-09-21T04:01:25.108223+0000 mgr.a (mgr.14388) 15017 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:28 smithi179 bash[23186]: cluster 2024-09-21T04:01:27.108976+0000 mgr.a (mgr.14388) 15018 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:28 smithi179 bash[23186]: audit 2024-09-21T04:01:28.390398+0000 mon.a (mon.0) 12056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:28 smithi179 bash[23186]: audit 2024-09-21T04:01:28.399631+0000 mon.a (mon.0) 12057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:28 smithi179 bash[23186]: audit 2024-09-21T04:01:28.409069+0000 mon.a (mon.0) 12058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:28 smithi179 bash[23186]: audit 2024-09-21T04:01:28.572737+0000 mon.a (mon.0) 12059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:28 smithi179 bash[23186]: audit 2024-09-21T04:01:28.581122+0000 mon.a (mon.0) 12060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:28 smithi179 bash[23186]: audit 2024-09-21T04:01:28.592462+0000 mon.a (mon.0) 12061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:28 smithi044 bash[22676]: cluster 2024-09-21T04:01:27.108976+0000 mgr.a (mgr.14388) 15018 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:28 smithi044 bash[22676]: audit 2024-09-21T04:01:28.390398+0000 mon.a (mon.0) 12056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:28 smithi044 bash[22676]: audit 2024-09-21T04:01:28.399631+0000 mon.a (mon.0) 12057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:28 smithi044 bash[22676]: audit 2024-09-21T04:01:28.409069+0000 mon.a (mon.0) 12058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:28 smithi044 bash[22676]: audit 2024-09-21T04:01:28.572737+0000 mon.a (mon.0) 12059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:28 smithi044 bash[22676]: audit 2024-09-21T04:01:28.581122+0000 mon.a (mon.0) 12060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:28 smithi044 bash[22676]: audit 2024-09-21T04:01:28.592462+0000 mon.a (mon.0) 12061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:28 smithi049 bash[23528]: cluster 2024-09-21T04:01:27.108976+0000 mgr.a (mgr.14388) 15018 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:28 smithi049 bash[23528]: audit 2024-09-21T04:01:28.390398+0000 mon.a (mon.0) 12056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:28 smithi049 bash[23528]: audit 2024-09-21T04:01:28.399631+0000 mon.a (mon.0) 12057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:28 smithi049 bash[23528]: audit 2024-09-21T04:01:28.409069+0000 mon.a (mon.0) 12058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:28 smithi049 bash[23528]: audit 2024-09-21T04:01:28.572737+0000 mon.a (mon.0) 12059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:28 smithi049 bash[23528]: audit 2024-09-21T04:01:28.581122+0000 mon.a (mon.0) 12060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:28 smithi049 bash[23528]: audit 2024-09-21T04:01:28.592462+0000 mon.a (mon.0) 12061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:29.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:29.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:29 smithi044 bash[22676]: audit 2024-09-21T04:01:29.254276+0000 mon.a (mon.0) 12062 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:01:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:29 smithi044 bash[22676]: audit 2024-09-21T04:01:29.264611+0000 mon.a (mon.0) 12063 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:01:29.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:29 smithi044 bash[22676]: audit 2024-09-21T04:01:29.266375+0000 mon.a (mon.0) 12064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:01:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:29 smithi044 bash[22676]: audit 2024-09-21T04:01:29.277490+0000 mon.a (mon.0) 12065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:29 smithi044 bash[22676]: audit 2024-09-21T04:01:29.283669+0000 mon.a (mon.0) 12066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:01:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:29 smithi179 bash[23186]: audit 2024-09-21T04:01:29.254276+0000 mon.a (mon.0) 12062 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:01:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:29 smithi179 bash[23186]: audit 2024-09-21T04:01:29.264611+0000 mon.a (mon.0) 12063 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:01:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:29 smithi179 bash[23186]: audit 2024-09-21T04:01:29.266375+0000 mon.a (mon.0) 12064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:01:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:29 smithi179 bash[23186]: audit 2024-09-21T04:01:29.277490+0000 mon.a (mon.0) 12065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:29 smithi179 bash[23186]: audit 2024-09-21T04:01:29.283669+0000 mon.a (mon.0) 12066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:01:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:29 smithi049 bash[23528]: audit 2024-09-21T04:01:29.254276+0000 mon.a (mon.0) 12062 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:01:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:29 smithi049 bash[23528]: audit 2024-09-21T04:01:29.264611+0000 mon.a (mon.0) 12063 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:01:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:29 smithi049 bash[23528]: audit 2024-09-21T04:01:29.266375+0000 mon.a (mon.0) 12064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:01:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:29 smithi049 bash[23528]: audit 2024-09-21T04:01:29.277490+0000 mon.a (mon.0) 12065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:30.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:29 smithi049 bash[23528]: audit 2024-09-21T04:01:29.283669+0000 mon.a (mon.0) 12066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:01:30.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:01:30 smithi044 bash[22930]: debug 2024-09-21T04:01:30.073+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:01:30.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:01:30 smithi044 bash[22930]: debug 2024-09-21T04:01:30.073+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:01:30.559 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:30.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:30 smithi044 bash[22676]: cluster 2024-09-21T04:01:29.109784+0000 mgr.a (mgr.14388) 15019 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:30 smithi044 bash[22676]: audit 2024-09-21T04:01:29.286000+0000 mgr.a (mgr.14388) 15020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:01:31.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:30 smithi179 bash[23186]: cluster 2024-09-21T04:01:29.109784+0000 mgr.a (mgr.14388) 15019 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:30 smithi179 bash[23186]: audit 2024-09-21T04:01:29.286000+0000 mgr.a (mgr.14388) 15020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:01:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:30 smithi049 bash[23528]: cluster 2024-09-21T04:01:29.109784+0000 mgr.a (mgr.14388) 15019 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:30 smithi049 bash[23528]: audit 2024-09-21T04:01:29.286000+0000 mgr.a (mgr.14388) 15020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:01:31.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:31 smithi044 bash[22676]: audit 2024-09-21T04:01:30.075727+0000 mgr.a (mgr.14388) 15021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:01:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:31 smithi044 bash[22676]: cephadm 2024-09-21T04:01:30.076905+0000 mgr.a (mgr.14388) 15022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:01:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:31 smithi044 bash[22676]: audit 2024-09-21T04:01:30.148665+0000 mgr.a (mgr.14388) 15023 : audit [DBG] from='client.325404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:31.996 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:31 smithi179 bash[23186]: audit 2024-09-21T04:01:30.075727+0000 mgr.a (mgr.14388) 15021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:01:31.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:31 smithi179 bash[23186]: cephadm 2024-09-21T04:01:30.076905+0000 mgr.a (mgr.14388) 15022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:01:31.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:31 smithi179 bash[23186]: audit 2024-09-21T04:01:30.148665+0000 mgr.a (mgr.14388) 15023 : audit [DBG] from='client.325404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:31 smithi049 bash[23528]: audit 2024-09-21T04:01:30.075727+0000 mgr.a (mgr.14388) 15021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:01:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:31 smithi049 bash[23528]: cephadm 2024-09-21T04:01:30.076905+0000 mgr.a (mgr.14388) 15022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:01:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:31 smithi049 bash[23528]: audit 2024-09-21T04:01:30.148665+0000 mgr.a (mgr.14388) 15023 : audit [DBG] from='client.325404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:32 smithi044 bash[22676]: cluster 2024-09-21T04:01:31.112755+0000 mgr.a (mgr.14388) 15024 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:01:33.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:32 smithi179 bash[23186]: cluster 2024-09-21T04:01:31.112755+0000 mgr.a (mgr.14388) 15024 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:01:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:32 smithi049 bash[23528]: cluster 2024-09-21T04:01:31.112755+0000 mgr.a (mgr.14388) 15024 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:01:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:34 smithi044 bash[22676]: cluster 2024-09-21T04:01:33.113578+0000 mgr.a (mgr.14388) 15025 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:01:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:34 smithi179 bash[23186]: cluster 2024-09-21T04:01:33.113578+0000 mgr.a (mgr.14388) 15025 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:01:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:34 smithi049 bash[23528]: cluster 2024-09-21T04:01:33.113578+0000 mgr.a (mgr.14388) 15025 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:01:35.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:35.562 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:35.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:36.330 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:36.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:36 smithi044 bash[22676]: cluster 2024-09-21T04:01:35.115878+0000 mgr.a (mgr.14388) 15026 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:01:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:36 smithi179 bash[23186]: cluster 2024-09-21T04:01:35.115878+0000 mgr.a (mgr.14388) 15026 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:01:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:36 smithi049 bash[23528]: cluster 2024-09-21T04:01:35.115878+0000 mgr.a (mgr.14388) 15026 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:01:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:37 smithi044 bash[22676]: audit 2024-09-21T04:01:35.894860+0000 mgr.a (mgr.14388) 15027 : audit [DBG] from='client.325497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:37 smithi044 bash[22676]: audit 2024-09-21T04:01:36.826763+0000 mon.a (mon.0) 12067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:37 smithi044 bash[22676]: audit 2024-09-21T04:01:36.835625+0000 mon.a (mon.0) 12068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:37 smithi044 bash[22676]: audit 2024-09-21T04:01:36.846404+0000 mon.a (mon.0) 12069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:37 smithi179 bash[23186]: audit 2024-09-21T04:01:35.894860+0000 mgr.a (mgr.14388) 15027 : audit [DBG] from='client.325497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:37 smithi179 bash[23186]: audit 2024-09-21T04:01:36.826763+0000 mon.a (mon.0) 12067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:37 smithi179 bash[23186]: audit 2024-09-21T04:01:36.835625+0000 mon.a (mon.0) 12068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:37 smithi179 bash[23186]: audit 2024-09-21T04:01:36.846404+0000 mon.a (mon.0) 12069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:37 smithi049 bash[23528]: audit 2024-09-21T04:01:35.894860+0000 mgr.a (mgr.14388) 15027 : audit [DBG] from='client.325497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:37 smithi049 bash[23528]: audit 2024-09-21T04:01:36.826763+0000 mon.a (mon.0) 12067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:37 smithi049 bash[23528]: audit 2024-09-21T04:01:36.835625+0000 mon.a (mon.0) 12068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:37 smithi049 bash[23528]: audit 2024-09-21T04:01:36.846404+0000 mon.a (mon.0) 12069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:38 smithi049 bash[23528]: cluster 2024-09-21T04:01:37.116837+0000 mgr.a (mgr.14388) 15028 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:01:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:38 smithi044 bash[22676]: cluster 2024-09-21T04:01:37.116837+0000 mgr.a (mgr.14388) 15028 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:01:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:38 smithi179 bash[23186]: cluster 2024-09-21T04:01:37.116837+0000 mgr.a (mgr.14388) 15028 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:01:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:40 smithi044 bash[22676]: cluster 2024-09-21T04:01:39.117624+0000 mgr.a (mgr.14388) 15029 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:01:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:40 smithi179 bash[23186]: cluster 2024-09-21T04:01:39.117624+0000 mgr.a (mgr.14388) 15029 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:01:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:40 smithi049 bash[23528]: cluster 2024-09-21T04:01:39.117624+0000 mgr.a (mgr.14388) 15029 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:01:41.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:41.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:41.332 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:42.095 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:42.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:42.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:42.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:42.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:42 smithi044 bash[22676]: cluster 2024-09-21T04:01:41.119887+0000 mgr.a (mgr.14388) 15030 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:01:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:42 smithi044 bash[22676]: audit 2024-09-21T04:01:41.657320+0000 mgr.a (mgr.14388) 15031 : audit [DBG] from='client.325575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:42 smithi179 bash[23186]: cluster 2024-09-21T04:01:41.119887+0000 mgr.a (mgr.14388) 15030 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:01:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:42 smithi179 bash[23186]: audit 2024-09-21T04:01:41.657320+0000 mgr.a (mgr.14388) 15031 : audit [DBG] from='client.325575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:42 smithi049 bash[23528]: cluster 2024-09-21T04:01:41.119887+0000 mgr.a (mgr.14388) 15030 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:01:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:42 smithi049 bash[23528]: audit 2024-09-21T04:01:41.657320+0000 mgr.a (mgr.14388) 15031 : audit [DBG] from='client.325575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:44 smithi044 bash[22676]: cluster 2024-09-21T04:01:43.121179+0000 mgr.a (mgr.14388) 15032 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:01:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:44 smithi179 bash[23186]: cluster 2024-09-21T04:01:43.121179+0000 mgr.a (mgr.14388) 15032 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:01:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:44 smithi049 bash[23528]: cluster 2024-09-21T04:01:43.121179+0000 mgr.a (mgr.14388) 15032 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:01:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:46 smithi044 bash[22676]: cluster 2024-09-21T04:01:45.123579+0000 mgr.a (mgr.14388) 15033 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:01:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:46 smithi179 bash[23186]: cluster 2024-09-21T04:01:45.123579+0000 mgr.a (mgr.14388) 15033 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:01:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:46 smithi049 bash[23528]: cluster 2024-09-21T04:01:45.123579+0000 mgr.a (mgr.14388) 15033 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:01:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:47.859 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:47.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:47.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:47.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:47.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:48 smithi044 bash[22676]: cluster 2024-09-21T04:01:47.124128+0000 mgr.a (mgr.14388) 15034 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:48 smithi044 bash[22676]: audit 2024-09-21T04:01:47.425799+0000 mgr.a (mgr.14388) 15035 : audit [DBG] from='client.325650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:48 smithi044 bash[22676]: audit 2024-09-21T04:01:48.620634+0000 mon.a (mon.0) 12070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:48 smithi044 bash[22676]: audit 2024-09-21T04:01:48.626795+0000 mon.a (mon.0) 12071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:48 smithi044 bash[22676]: audit 2024-09-21T04:01:48.635165+0000 mon.a (mon.0) 12072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:48 smithi179 bash[23186]: cluster 2024-09-21T04:01:47.124128+0000 mgr.a (mgr.14388) 15034 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:48 smithi179 bash[23186]: audit 2024-09-21T04:01:47.425799+0000 mgr.a (mgr.14388) 15035 : audit [DBG] from='client.325650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:48 smithi179 bash[23186]: audit 2024-09-21T04:01:48.620634+0000 mon.a (mon.0) 12070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:48 smithi179 bash[23186]: audit 2024-09-21T04:01:48.626795+0000 mon.a (mon.0) 12071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:48 smithi179 bash[23186]: audit 2024-09-21T04:01:48.635165+0000 mon.a (mon.0) 12072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:48 smithi049 bash[23528]: cluster 2024-09-21T04:01:47.124128+0000 mgr.a (mgr.14388) 15034 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:48 smithi049 bash[23528]: audit 2024-09-21T04:01:47.425799+0000 mgr.a (mgr.14388) 15035 : audit [DBG] from='client.325650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:48 smithi049 bash[23528]: audit 2024-09-21T04:01:48.620634+0000 mon.a (mon.0) 12070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:48 smithi049 bash[23528]: audit 2024-09-21T04:01:48.626795+0000 mon.a (mon.0) 12071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:48 smithi049 bash[23528]: audit 2024-09-21T04:01:48.635165+0000 mon.a (mon.0) 12072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:49 smithi044 bash[22676]: audit 2024-09-21T04:01:48.815052+0000 mon.a (mon.0) 12073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:49 smithi044 bash[22676]: audit 2024-09-21T04:01:48.823310+0000 mon.a (mon.0) 12074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:49 smithi044 bash[22676]: audit 2024-09-21T04:01:48.833392+0000 mon.a (mon.0) 12075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:49 smithi044 bash[22676]: cluster 2024-09-21T04:01:49.125013+0000 mgr.a (mgr.14388) 15036 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:49 smithi179 bash[23186]: audit 2024-09-21T04:01:48.815052+0000 mon.a (mon.0) 12073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:49 smithi179 bash[23186]: audit 2024-09-21T04:01:48.823310+0000 mon.a (mon.0) 12074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:49 smithi179 bash[23186]: audit 2024-09-21T04:01:48.833392+0000 mon.a (mon.0) 12075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:49 smithi179 bash[23186]: cluster 2024-09-21T04:01:49.125013+0000 mgr.a (mgr.14388) 15036 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:49 smithi049 bash[23528]: audit 2024-09-21T04:01:48.815052+0000 mon.a (mon.0) 12073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:49 smithi049 bash[23528]: audit 2024-09-21T04:01:48.823310+0000 mon.a (mon.0) 12074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:49 smithi049 bash[23528]: audit 2024-09-21T04:01:48.833392+0000 mon.a (mon.0) 12075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:49 smithi049 bash[23528]: cluster 2024-09-21T04:01:49.125013+0000 mgr.a (mgr.14388) 15036 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:52.461 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:52 smithi179 bash[23186]: cluster 2024-09-21T04:01:51.127249+0000 mgr.a (mgr.14388) 15037 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:52 smithi044 bash[22676]: cluster 2024-09-21T04:01:51.127249+0000 mgr.a (mgr.14388) 15037 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:52.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:52 smithi049 bash[23528]: cluster 2024-09-21T04:01:51.127249+0000 mgr.a (mgr.14388) 15037 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:52.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:52.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:52.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:53.629 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:53.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:53.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:53.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:53.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:01:54.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:54 smithi044 bash[22676]: cluster 2024-09-21T04:01:53.127995+0000 mgr.a (mgr.14388) 15038 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:54 smithi044 bash[22676]: audit 2024-09-21T04:01:53.195513+0000 mgr.a (mgr.14388) 15039 : audit [DBG] from='client.325728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:54 smithi179 bash[23186]: cluster 2024-09-21T04:01:53.127995+0000 mgr.a (mgr.14388) 15038 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:54 smithi179 bash[23186]: audit 2024-09-21T04:01:53.195513+0000 mgr.a (mgr.14388) 15039 : audit [DBG] from='client.325728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:54 smithi049 bash[23528]: cluster 2024-09-21T04:01:53.127995+0000 mgr.a (mgr.14388) 15038 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:54 smithi049 bash[23528]: audit 2024-09-21T04:01:53.195513+0000 mgr.a (mgr.14388) 15039 : audit [DBG] from='client.325728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:01:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:56 smithi044 bash[22676]: cluster 2024-09-21T04:01:55.130323+0000 mgr.a (mgr.14388) 15040 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:56 smithi179 bash[23186]: cluster 2024-09-21T04:01:55.130323+0000 mgr.a (mgr.14388) 15040 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:56.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:56 smithi049 bash[23528]: cluster 2024-09-21T04:01:55.130323+0000 mgr.a (mgr.14388) 15040 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:01:58.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:58 smithi049 bash[23528]: audit 2024-09-21T04:01:57.031377+0000 mon.a (mon.0) 12076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:58 smithi049 bash[23528]: audit 2024-09-21T04:01:57.039988+0000 mon.a (mon.0) 12077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:58 smithi049 bash[23528]: audit 2024-09-21T04:01:57.050633+0000 mon.a (mon.0) 12078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:01:58 smithi049 bash[23528]: cluster 2024-09-21T04:01:57.131087+0000 mgr.a (mgr.14388) 15041 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:58.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:58 smithi044 bash[22676]: audit 2024-09-21T04:01:57.031377+0000 mon.a (mon.0) 12076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:58 smithi044 bash[22676]: audit 2024-09-21T04:01:57.039988+0000 mon.a (mon.0) 12077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:58 smithi044 bash[22676]: audit 2024-09-21T04:01:57.050633+0000 mon.a (mon.0) 12078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:01:58 smithi044 bash[22676]: cluster 2024-09-21T04:01:57.131087+0000 mgr.a (mgr.14388) 15041 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:58 smithi179 bash[23186]: audit 2024-09-21T04:01:57.031377+0000 mon.a (mon.0) 12076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:58 smithi179 bash[23186]: audit 2024-09-21T04:01:57.039988+0000 mon.a (mon.0) 12077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:58 smithi179 bash[23186]: audit 2024-09-21T04:01:57.050633+0000 mon.a (mon.0) 12078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:01:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:01:58 smithi179 bash[23186]: cluster 2024-09-21T04:01:57.131087+0000 mgr.a (mgr.14388) 15041 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:01:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:01:58.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:01:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:01:59.385 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:01:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:01:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:01:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:01:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:00.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:00 smithi049 bash[23528]: audit 2024-09-21T04:01:58.959968+0000 mgr.a (mgr.14388) 15042 : audit [DBG] from='client.325806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:00.284 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:00 smithi049 bash[23528]: cluster 2024-09-21T04:01:59.131692+0000 mgr.a (mgr.14388) 15043 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:00 smithi044 bash[22676]: audit 2024-09-21T04:01:58.959968+0000 mgr.a (mgr.14388) 15042 : audit [DBG] from='client.325806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:00 smithi044 bash[22676]: cluster 2024-09-21T04:01:59.131692+0000 mgr.a (mgr.14388) 15043 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:00 smithi179 bash[23186]: audit 2024-09-21T04:01:58.959968+0000 mgr.a (mgr.14388) 15042 : audit [DBG] from='client.325806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:00 smithi179 bash[23186]: cluster 2024-09-21T04:01:59.131692+0000 mgr.a (mgr.14388) 15043 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:02.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:02 smithi044 bash[22676]: cluster 2024-09-21T04:02:01.134057+0000 mgr.a (mgr.14388) 15044 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:02 smithi179 bash[23186]: cluster 2024-09-21T04:02:01.134057+0000 mgr.a (mgr.14388) 15044 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:02.513 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:02 smithi049 bash[23528]: cluster 2024-09-21T04:02:01.134057+0000 mgr.a (mgr.14388) 15044 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:04.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:04.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:04 smithi044 bash[22676]: cluster 2024-09-21T04:02:03.134885+0000 mgr.a (mgr.14388) 15045 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:04 smithi179 bash[23186]: cluster 2024-09-21T04:02:03.134885+0000 mgr.a (mgr.14388) 15045 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:04.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:04 smithi049 bash[23528]: cluster 2024-09-21T04:02:03.134885+0000 mgr.a (mgr.14388) 15045 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:05.171 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:05.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:05.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:05.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:05.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:05 smithi044 bash[22676]: audit 2024-09-21T04:02:04.715447+0000 mgr.a (mgr.14388) 15046 : audit [DBG] from='client.325884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:05 smithi179 bash[23186]: audit 2024-09-21T04:02:04.715447+0000 mgr.a (mgr.14388) 15046 : audit [DBG] from='client.325884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:05.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:05 smithi049 bash[23528]: audit 2024-09-21T04:02:04.715447+0000 mgr.a (mgr.14388) 15046 : audit [DBG] from='client.325884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:06.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:06 smithi044 bash[22676]: cluster 2024-09-21T04:02:05.136247+0000 mgr.a (mgr.14388) 15047 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:02:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:06 smithi179 bash[23186]: cluster 2024-09-21T04:02:05.136247+0000 mgr.a (mgr.14388) 15047 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:02:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:06 smithi049 bash[23528]: cluster 2024-09-21T04:02:05.136247+0000 mgr.a (mgr.14388) 15047 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:02:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:08 smithi044 bash[22676]: cluster 2024-09-21T04:02:07.137160+0000 mgr.a (mgr.14388) 15048 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:02:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:08 smithi179 bash[23186]: cluster 2024-09-21T04:02:07.137160+0000 mgr.a (mgr.14388) 15048 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:02:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:08 smithi049 bash[23528]: cluster 2024-09-21T04:02:07.137160+0000 mgr.a (mgr.14388) 15048 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:02:10.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:10.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:10.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:09 smithi044 bash[22676]: audit 2024-09-21T04:02:08.840887+0000 mon.a (mon.0) 12079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:09 smithi044 bash[22676]: audit 2024-09-21T04:02:08.847625+0000 mon.a (mon.0) 12080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:09 smithi044 bash[22676]: audit 2024-09-21T04:02:08.855490+0000 mon.a (mon.0) 12081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:09 smithi044 bash[22676]: audit 2024-09-21T04:02:09.055768+0000 mon.a (mon.0) 12082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:09 smithi044 bash[22676]: audit 2024-09-21T04:02:09.063893+0000 mon.a (mon.0) 12083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:09 smithi044 bash[22676]: audit 2024-09-21T04:02:09.074283+0000 mon.a (mon.0) 12084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:09 smithi044 bash[22676]: cluster 2024-09-21T04:02:09.138151+0000 mgr.a (mgr.14388) 15049 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:02:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:09 smithi179 bash[23186]: audit 2024-09-21T04:02:08.840887+0000 mon.a (mon.0) 12079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:09 smithi179 bash[23186]: audit 2024-09-21T04:02:08.847625+0000 mon.a (mon.0) 12080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:09 smithi179 bash[23186]: audit 2024-09-21T04:02:08.855490+0000 mon.a (mon.0) 12081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:09 smithi179 bash[23186]: audit 2024-09-21T04:02:09.055768+0000 mon.a (mon.0) 12082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:09 smithi179 bash[23186]: audit 2024-09-21T04:02:09.063893+0000 mon.a (mon.0) 12083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:09 smithi179 bash[23186]: audit 2024-09-21T04:02:09.074283+0000 mon.a (mon.0) 12084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:09 smithi179 bash[23186]: cluster 2024-09-21T04:02:09.138151+0000 mgr.a (mgr.14388) 15049 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:02:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:09 smithi049 bash[23528]: audit 2024-09-21T04:02:08.840887+0000 mon.a (mon.0) 12079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:09 smithi049 bash[23528]: audit 2024-09-21T04:02:08.847625+0000 mon.a (mon.0) 12080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:09 smithi049 bash[23528]: audit 2024-09-21T04:02:08.855490+0000 mon.a (mon.0) 12081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:09 smithi049 bash[23528]: audit 2024-09-21T04:02:09.055768+0000 mon.a (mon.0) 12082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:09 smithi049 bash[23528]: audit 2024-09-21T04:02:09.063893+0000 mon.a (mon.0) 12083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:09 smithi049 bash[23528]: audit 2024-09-21T04:02:09.074283+0000 mon.a (mon.0) 12084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:09 smithi049 bash[23528]: cluster 2024-09-21T04:02:09.138151+0000 mgr.a (mgr.14388) 15049 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:02:10.950 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:10.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:10.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:10.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:10.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:11.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:11 smithi044 bash[22676]: audit 2024-09-21T04:02:10.505698+0000 mgr.a (mgr.14388) 15050 : audit [DBG] from='client.325959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:11 smithi179 bash[23186]: audit 2024-09-21T04:02:10.505698+0000 mgr.a (mgr.14388) 15050 : audit [DBG] from='client.325959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:11 smithi049 bash[23528]: audit 2024-09-21T04:02:10.505698+0000 mgr.a (mgr.14388) 15050 : audit [DBG] from='client.325959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:12.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:12 smithi044 bash[22676]: cluster 2024-09-21T04:02:11.141234+0000 mgr.a (mgr.14388) 15051 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:12.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:12 smithi179 bash[23186]: cluster 2024-09-21T04:02:11.141234+0000 mgr.a (mgr.14388) 15051 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:12.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:12 smithi049 bash[23528]: cluster 2024-09-21T04:02:11.141234+0000 mgr.a (mgr.14388) 15051 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:14 smithi044 bash[22676]: cluster 2024-09-21T04:02:13.142193+0000 mgr.a (mgr.14388) 15052 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:02:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:14 smithi179 bash[23186]: cluster 2024-09-21T04:02:13.142193+0000 mgr.a (mgr.14388) 15052 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:02:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:14 smithi049 bash[23528]: cluster 2024-09-21T04:02:13.142193+0000 mgr.a (mgr.14388) 15052 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:02:15.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:15.952 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:15.952 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:16.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:16 smithi044 bash[22676]: cluster 2024-09-21T04:02:15.144465+0000 mgr.a (mgr.14388) 15053 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:16.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:16 smithi179 bash[23186]: cluster 2024-09-21T04:02:15.144465+0000 mgr.a (mgr.14388) 15053 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:16 smithi049 bash[23528]: cluster 2024-09-21T04:02:15.144465+0000 mgr.a (mgr.14388) 15053 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:16.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:16.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:17.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:17 smithi044 bash[22676]: audit 2024-09-21T04:02:16.288717+0000 mgr.a (mgr.14388) 15054 : audit [DBG] from='client.326034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:17 smithi179 bash[23186]: audit 2024-09-21T04:02:16.288717+0000 mgr.a (mgr.14388) 15054 : audit [DBG] from='client.326034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:17.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:17 smithi049 bash[23528]: audit 2024-09-21T04:02:16.288717+0000 mgr.a (mgr.14388) 15054 : audit [DBG] from='client.326034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:18 smithi049 bash[23528]: cluster 2024-09-21T04:02:17.145630+0000 mgr.a (mgr.14388) 15055 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:02:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:18 smithi049 bash[23528]: audit 2024-09-21T04:02:17.266825+0000 mon.a (mon.0) 12085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:18 smithi049 bash[23528]: audit 2024-09-21T04:02:17.275769+0000 mon.a (mon.0) 12086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:18 smithi049 bash[23528]: audit 2024-09-21T04:02:17.286379+0000 mon.a (mon.0) 12087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:18 smithi044 bash[22676]: cluster 2024-09-21T04:02:17.145630+0000 mgr.a (mgr.14388) 15055 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:02:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:18 smithi044 bash[22676]: audit 2024-09-21T04:02:17.266825+0000 mon.a (mon.0) 12085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:18 smithi044 bash[22676]: audit 2024-09-21T04:02:17.275769+0000 mon.a (mon.0) 12086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:18 smithi044 bash[22676]: audit 2024-09-21T04:02:17.286379+0000 mon.a (mon.0) 12087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:18 smithi179 bash[23186]: cluster 2024-09-21T04:02:17.145630+0000 mgr.a (mgr.14388) 15055 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:02:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:18 smithi179 bash[23186]: audit 2024-09-21T04:02:17.266825+0000 mon.a (mon.0) 12085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:18 smithi179 bash[23186]: audit 2024-09-21T04:02:17.275769+0000 mon.a (mon.0) 12086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:18 smithi179 bash[23186]: audit 2024-09-21T04:02:17.286379+0000 mon.a (mon.0) 12087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:20.386 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:20 smithi049 bash[23528]: cluster 2024-09-21T04:02:19.146738+0000 mgr.a (mgr.14388) 15056 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:02:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:20 smithi044 bash[22676]: cluster 2024-09-21T04:02:19.146738+0000 mgr.a (mgr.14388) 15056 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:02:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:20 smithi179 bash[23186]: cluster 2024-09-21T04:02:19.146738+0000 mgr.a (mgr.14388) 15056 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:02:21.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:21.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:21.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:22.491 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:22.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:22.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:22.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:22.492 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:22.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:22 smithi049 bash[23528]: cluster 2024-09-21T04:02:21.148945+0000 mgr.a (mgr.14388) 15057 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:02:22.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:22 smithi044 bash[22676]: cluster 2024-09-21T04:02:21.148945+0000 mgr.a (mgr.14388) 15057 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:02:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:22 smithi179 bash[23186]: cluster 2024-09-21T04:02:21.148945+0000 mgr.a (mgr.14388) 15057 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:02:23.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:23 smithi049 bash[23528]: audit 2024-09-21T04:02:22.062781+0000 mgr.a (mgr.14388) 15058 : audit [DBG] from='client.326109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:23 smithi044 bash[22676]: audit 2024-09-21T04:02:22.062781+0000 mgr.a (mgr.14388) 15058 : audit [DBG] from='client.326109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:23 smithi179 bash[23186]: audit 2024-09-21T04:02:22.062781+0000 mgr.a (mgr.14388) 15058 : audit [DBG] from='client.326109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:24.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:24 smithi049 bash[23528]: cluster 2024-09-21T04:02:23.149700+0000 mgr.a (mgr.14388) 15059 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:24 smithi044 bash[22676]: cluster 2024-09-21T04:02:23.149700+0000 mgr.a (mgr.14388) 15059 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:24 smithi179 bash[23186]: cluster 2024-09-21T04:02:23.149700+0000 mgr.a (mgr.14388) 15059 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:26.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:26 smithi049 bash[23528]: cluster 2024-09-21T04:02:25.151488+0000 mgr.a (mgr.14388) 15060 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:26 smithi044 bash[22676]: cluster 2024-09-21T04:02:25.151488+0000 mgr.a (mgr.14388) 15060 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:26 smithi179 bash[23186]: cluster 2024-09-21T04:02:25.151488+0000 mgr.a (mgr.14388) 15060 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:27.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:27.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:27.494 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:28.256 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:28.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:28.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:28 smithi049 bash[23528]: cluster 2024-09-21T04:02:27.152288+0000 mgr.a (mgr.14388) 15061 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:28 smithi044 bash[22676]: cluster 2024-09-21T04:02:27.152288+0000 mgr.a (mgr.14388) 15061 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:28 smithi179 bash[23186]: cluster 2024-09-21T04:02:27.152288+0000 mgr.a (mgr.14388) 15061 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:29 smithi179 bash[23186]: audit 2024-09-21T04:02:27.822204+0000 mgr.a (mgr.14388) 15062 : audit [DBG] from='client.326184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:29 smithi179 bash[23186]: audit 2024-09-21T04:02:29.068149+0000 mon.a (mon.0) 12088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:29 smithi179 bash[23186]: audit 2024-09-21T04:02:29.089903+0000 mon.a (mon.0) 12089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:29 smithi179 bash[23186]: audit 2024-09-21T04:02:29.101661+0000 mon.a (mon.0) 12090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:29 smithi179 bash[23186]: audit 2024-09-21T04:02:29.267625+0000 mon.a (mon.0) 12091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:29 smithi179 bash[23186]: audit 2024-09-21T04:02:29.274433+0000 mon.a (mon.0) 12092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:29 smithi179 bash[23186]: audit 2024-09-21T04:02:29.283412+0000 mon.a (mon.0) 12093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:29 smithi049 bash[23528]: audit 2024-09-21T04:02:27.822204+0000 mgr.a (mgr.14388) 15062 : audit [DBG] from='client.326184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:29 smithi049 bash[23528]: audit 2024-09-21T04:02:29.068149+0000 mon.a (mon.0) 12088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:29 smithi049 bash[23528]: audit 2024-09-21T04:02:29.089903+0000 mon.a (mon.0) 12089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:29 smithi049 bash[23528]: audit 2024-09-21T04:02:29.101661+0000 mon.a (mon.0) 12090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:29 smithi049 bash[23528]: audit 2024-09-21T04:02:29.267625+0000 mon.a (mon.0) 12091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:29 smithi049 bash[23528]: audit 2024-09-21T04:02:29.274433+0000 mon.a (mon.0) 12092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:29 smithi049 bash[23528]: audit 2024-09-21T04:02:29.283412+0000 mon.a (mon.0) 12093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:29 smithi044 bash[22676]: audit 2024-09-21T04:02:27.822204+0000 mgr.a (mgr.14388) 15062 : audit [DBG] from='client.326184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:29 smithi044 bash[22676]: audit 2024-09-21T04:02:29.068149+0000 mon.a (mon.0) 12088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:29 smithi044 bash[22676]: audit 2024-09-21T04:02:29.089903+0000 mon.a (mon.0) 12089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:29 smithi044 bash[22676]: audit 2024-09-21T04:02:29.101661+0000 mon.a (mon.0) 12090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:29 smithi044 bash[22676]: audit 2024-09-21T04:02:29.267625+0000 mon.a (mon.0) 12091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:29 smithi044 bash[22676]: audit 2024-09-21T04:02:29.274433+0000 mon.a (mon.0) 12092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:29 smithi044 bash[22676]: audit 2024-09-21T04:02:29.283412+0000 mon.a (mon.0) 12093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:30 smithi049 bash[23528]: cluster 2024-09-21T04:02:29.153126+0000 mgr.a (mgr.14388) 15063 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:30 smithi049 bash[23528]: audit 2024-09-21T04:02:30.129094+0000 mon.a (mon.0) 12094 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:02:30.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:30 smithi049 bash[23528]: audit 2024-09-21T04:02:30.136248+0000 mon.a (mon.0) 12095 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:02:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:30 smithi049 bash[23528]: audit 2024-09-21T04:02:30.138376+0000 mon.a (mon.0) 12096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:02:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:30 smithi049 bash[23528]: audit 2024-09-21T04:02:30.149372+0000 mon.a (mon.0) 12097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:30 smithi049 bash[23528]: audit 2024-09-21T04:02:30.155578+0000 mon.a (mon.0) 12098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:02:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22676]: cluster 2024-09-21T04:02:29.153126+0000 mgr.a (mgr.14388) 15063 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22676]: audit 2024-09-21T04:02:30.129094+0000 mon.a (mon.0) 12094 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:02:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22676]: audit 2024-09-21T04:02:30.136248+0000 mon.a (mon.0) 12095 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:02:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22676]: audit 2024-09-21T04:02:30.138376+0000 mon.a (mon.0) 12096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:02:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22676]: audit 2024-09-21T04:02:30.149372+0000 mon.a (mon.0) 12097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22676]: audit 2024-09-21T04:02:30.155578+0000 mon.a (mon.0) 12098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:02:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:30 smithi179 bash[23186]: cluster 2024-09-21T04:02:29.153126+0000 mgr.a (mgr.14388) 15063 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:30 smithi179 bash[23186]: audit 2024-09-21T04:02:30.129094+0000 mon.a (mon.0) 12094 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:02:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:30 smithi179 bash[23186]: audit 2024-09-21T04:02:30.136248+0000 mon.a (mon.0) 12095 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:02:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:30 smithi179 bash[23186]: audit 2024-09-21T04:02:30.138376+0000 mon.a (mon.0) 12096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:02:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:30 smithi179 bash[23186]: audit 2024-09-21T04:02:30.149372+0000 mon.a (mon.0) 12097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:30 smithi179 bash[23186]: audit 2024-09-21T04:02:30.155578+0000 mon.a (mon.0) 12098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:02:31.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22930]: debug 2024-09-21T04:02:30.960+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:02:31.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:02:30 smithi044 bash[22930]: debug 2024-09-21T04:02:30.960+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:02:31.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:31 smithi049 bash[23528]: audit 2024-09-21T04:02:30.158033+0000 mgr.a (mgr.14388) 15064 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:02:31.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:31 smithi044 bash[22676]: audit 2024-09-21T04:02:30.158033+0000 mgr.a (mgr.14388) 15064 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:02:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:31 smithi179 bash[23186]: audit 2024-09-21T04:02:30.158033+0000 mgr.a (mgr.14388) 15064 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:02:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:32 smithi179 bash[23186]: audit 2024-09-21T04:02:30.963817+0000 mgr.a (mgr.14388) 15065 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:02:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:32 smithi179 bash[23186]: cephadm 2024-09-21T04:02:30.965044+0000 mgr.a (mgr.14388) 15066 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:02:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:32 smithi179 bash[23186]: cluster 2024-09-21T04:02:31.156054+0000 mgr.a (mgr.14388) 15067 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:32 smithi044 bash[22676]: audit 2024-09-21T04:02:30.963817+0000 mgr.a (mgr.14388) 15065 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:02:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:32 smithi044 bash[22676]: cephadm 2024-09-21T04:02:30.965044+0000 mgr.a (mgr.14388) 15066 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:02:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:32 smithi044 bash[22676]: cluster 2024-09-21T04:02:31.156054+0000 mgr.a (mgr.14388) 15067 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:32 smithi049 bash[23528]: audit 2024-09-21T04:02:30.963817+0000 mgr.a (mgr.14388) 15065 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:02:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:32 smithi049 bash[23528]: cephadm 2024-09-21T04:02:30.965044+0000 mgr.a (mgr.14388) 15066 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:02:32.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:32 smithi049 bash[23528]: cluster 2024-09-21T04:02:31.156054+0000 mgr.a (mgr.14388) 15067 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:02:33.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:33.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:33.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:34.031 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:34 smithi179 bash[23186]: cluster 2024-09-21T04:02:33.156985+0000 mgr.a (mgr.14388) 15068 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:34 smithi179 bash[23186]: audit 2024-09-21T04:02:33.593054+0000 mgr.a (mgr.14388) 15069 : audit [DBG] from='client.326367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:34 smithi044 bash[22676]: cluster 2024-09-21T04:02:33.156985+0000 mgr.a (mgr.14388) 15068 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:34 smithi044 bash[22676]: audit 2024-09-21T04:02:33.593054+0000 mgr.a (mgr.14388) 15069 : audit [DBG] from='client.326367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:34 smithi049 bash[23528]: cluster 2024-09-21T04:02:33.156985+0000 mgr.a (mgr.14388) 15068 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:34 smithi049 bash[23528]: audit 2024-09-21T04:02:33.593054+0000 mgr.a (mgr.14388) 15069 : audit [DBG] from='client.326367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:36 smithi044 bash[22676]: cluster 2024-09-21T04:02:35.159361+0000 mgr.a (mgr.14388) 15070 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:36 smithi179 bash[23186]: cluster 2024-09-21T04:02:35.159361+0000 mgr.a (mgr.14388) 15070 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:36 smithi049 bash[23528]: cluster 2024-09-21T04:02:35.159361+0000 mgr.a (mgr.14388) 15070 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:38 smithi044 bash[22676]: cluster 2024-09-21T04:02:37.160137+0000 mgr.a (mgr.14388) 15071 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:38 smithi044 bash[22676]: audit 2024-09-21T04:02:37.487398+0000 mon.a (mon.0) 12099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:38 smithi044 bash[22676]: audit 2024-09-21T04:02:37.495983+0000 mon.a (mon.0) 12100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:38 smithi044 bash[22676]: audit 2024-09-21T04:02:37.506431+0000 mon.a (mon.0) 12101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:38 smithi179 bash[23186]: cluster 2024-09-21T04:02:37.160137+0000 mgr.a (mgr.14388) 15071 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:38 smithi179 bash[23186]: audit 2024-09-21T04:02:37.487398+0000 mon.a (mon.0) 12099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:38 smithi179 bash[23186]: audit 2024-09-21T04:02:37.495983+0000 mon.a (mon.0) 12100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:38 smithi179 bash[23186]: audit 2024-09-21T04:02:37.506431+0000 mon.a (mon.0) 12101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:38 smithi049 bash[23528]: cluster 2024-09-21T04:02:37.160137+0000 mgr.a (mgr.14388) 15071 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:38 smithi049 bash[23528]: audit 2024-09-21T04:02:37.487398+0000 mon.a (mon.0) 12099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:38 smithi049 bash[23528]: audit 2024-09-21T04:02:37.495983+0000 mon.a (mon.0) 12100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:38 smithi049 bash[23528]: audit 2024-09-21T04:02:37.506431+0000 mon.a (mon.0) 12101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:39.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:39.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:39.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:40.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:40 smithi049 bash[23528]: cluster 2024-09-21T04:02:39.160738+0000 mgr.a (mgr.14388) 15072 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:40.749 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:40 smithi049 bash[23528]: audit 2024-09-21T04:02:39.372664+0000 mgr.a (mgr.14388) 15073 : audit [DBG] from='client.326445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:40 smithi179 bash[23186]: cluster 2024-09-21T04:02:39.160738+0000 mgr.a (mgr.14388) 15072 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:40 smithi179 bash[23186]: audit 2024-09-21T04:02:39.372664+0000 mgr.a (mgr.14388) 15073 : audit [DBG] from='client.326445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:40 smithi044 bash[22676]: cluster 2024-09-21T04:02:39.160738+0000 mgr.a (mgr.14388) 15072 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:40 smithi044 bash[22676]: audit 2024-09-21T04:02:39.372664+0000 mgr.a (mgr.14388) 15073 : audit [DBG] from='client.326445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:42 smithi044 bash[22676]: cluster 2024-09-21T04:02:41.163264+0000 mgr.a (mgr.14388) 15074 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:42 smithi179 bash[23186]: cluster 2024-09-21T04:02:41.163264+0000 mgr.a (mgr.14388) 15074 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:42 smithi049 bash[23528]: cluster 2024-09-21T04:02:41.163264+0000 mgr.a (mgr.14388) 15074 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:44 smithi044 bash[22676]: cluster 2024-09-21T04:02:43.164241+0000 mgr.a (mgr.14388) 15075 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:44 smithi179 bash[23186]: cluster 2024-09-21T04:02:43.164241+0000 mgr.a (mgr.14388) 15075 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:44.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:44 smithi049 bash[23528]: cluster 2024-09-21T04:02:43.164241+0000 mgr.a (mgr.14388) 15075 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:45.612 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:46 smithi179 bash[23186]: cluster 2024-09-21T04:02:45.165309+0000 mgr.a (mgr.14388) 15076 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:46 smithi179 bash[23186]: audit 2024-09-21T04:02:45.172624+0000 mgr.a (mgr.14388) 15077 : audit [DBG] from='client.326520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:46.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:46 smithi049 bash[23528]: cluster 2024-09-21T04:02:45.165309+0000 mgr.a (mgr.14388) 15076 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:46.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:46 smithi049 bash[23528]: audit 2024-09-21T04:02:45.172624+0000 mgr.a (mgr.14388) 15077 : audit [DBG] from='client.326520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:46 smithi044 bash[22676]: cluster 2024-09-21T04:02:45.165309+0000 mgr.a (mgr.14388) 15076 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:02:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:46 smithi044 bash[22676]: audit 2024-09-21T04:02:45.172624+0000 mgr.a (mgr.14388) 15077 : audit [DBG] from='client.326520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:48 smithi049 bash[23528]: cluster 2024-09-21T04:02:47.166117+0000 mgr.a (mgr.14388) 15078 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:48.899 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:48 smithi044 bash[22676]: cluster 2024-09-21T04:02:47.166117+0000 mgr.a (mgr.14388) 15078 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:48 smithi179 bash[23186]: cluster 2024-09-21T04:02:47.166117+0000 mgr.a (mgr.14388) 15078 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:50 smithi044 bash[22676]: cluster 2024-09-21T04:02:49.166936+0000 mgr.a (mgr.14388) 15079 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:50 smithi044 bash[22676]: audit 2024-09-21T04:02:49.311563+0000 mon.a (mon.0) 12102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:50 smithi044 bash[22676]: audit 2024-09-21T04:02:49.317593+0000 mon.a (mon.0) 12103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:50 smithi044 bash[22676]: audit 2024-09-21T04:02:49.326648+0000 mon.a (mon.0) 12104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:50 smithi044 bash[22676]: audit 2024-09-21T04:02:49.484951+0000 mon.a (mon.0) 12105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:50 smithi044 bash[22676]: audit 2024-09-21T04:02:49.493663+0000 mon.a (mon.0) 12106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:50 smithi044 bash[22676]: audit 2024-09-21T04:02:49.503308+0000 mon.a (mon.0) 12107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:50 smithi179 bash[23186]: cluster 2024-09-21T04:02:49.166936+0000 mgr.a (mgr.14388) 15079 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:50 smithi179 bash[23186]: audit 2024-09-21T04:02:49.311563+0000 mon.a (mon.0) 12102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:50 smithi179 bash[23186]: audit 2024-09-21T04:02:49.317593+0000 mon.a (mon.0) 12103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:50 smithi179 bash[23186]: audit 2024-09-21T04:02:49.326648+0000 mon.a (mon.0) 12104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:50 smithi179 bash[23186]: audit 2024-09-21T04:02:49.484951+0000 mon.a (mon.0) 12105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:50 smithi179 bash[23186]: audit 2024-09-21T04:02:49.493663+0000 mon.a (mon.0) 12106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:50 smithi179 bash[23186]: audit 2024-09-21T04:02:49.503308+0000 mon.a (mon.0) 12107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:50 smithi049 bash[23528]: cluster 2024-09-21T04:02:49.166936+0000 mgr.a (mgr.14388) 15079 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:50 smithi049 bash[23528]: audit 2024-09-21T04:02:49.311563+0000 mon.a (mon.0) 12102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:50 smithi049 bash[23528]: audit 2024-09-21T04:02:49.317593+0000 mon.a (mon.0) 12103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:50 smithi049 bash[23528]: audit 2024-09-21T04:02:49.326648+0000 mon.a (mon.0) 12104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:50 smithi049 bash[23528]: audit 2024-09-21T04:02:49.484951+0000 mon.a (mon.0) 12105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:50 smithi049 bash[23528]: audit 2024-09-21T04:02:49.493663+0000 mon.a (mon.0) 12106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:50 smithi049 bash[23528]: audit 2024-09-21T04:02:49.503308+0000 mon.a (mon.0) 12107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:51.377 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:51.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:51.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:51.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:51.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:52.584 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:52 smithi179 bash[23186]: audit 2024-09-21T04:02:50.944231+0000 mgr.a (mgr.14388) 15080 : audit [DBG] from='client.326598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:52.584 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:52 smithi179 bash[23186]: cluster 2024-09-21T04:02:51.168274+0000 mgr.a (mgr.14388) 15081 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:52.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:52 smithi044 bash[22676]: audit 2024-09-21T04:02:50.944231+0000 mgr.a (mgr.14388) 15080 : audit [DBG] from='client.326598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:52.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:52 smithi044 bash[22676]: cluster 2024-09-21T04:02:51.168274+0000 mgr.a (mgr.14388) 15081 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:52 smithi049 bash[23528]: audit 2024-09-21T04:02:50.944231+0000 mgr.a (mgr.14388) 15080 : audit [DBG] from='client.326598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:52 smithi049 bash[23528]: cluster 2024-09-21T04:02:51.168274+0000 mgr.a (mgr.14388) 15081 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:54 smithi044 bash[22676]: cluster 2024-09-21T04:02:53.169160+0000 mgr.a (mgr.14388) 15082 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:54 smithi179 bash[23186]: cluster 2024-09-21T04:02:53.169160+0000 mgr.a (mgr.14388) 15082 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:54.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:54 smithi049 bash[23528]: cluster 2024-09-21T04:02:53.169160+0000 mgr.a (mgr.14388) 15082 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:02:56.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:02:56.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:02:56.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:02:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:56 smithi179 bash[23186]: cluster 2024-09-21T04:02:55.171367+0000 mgr.a (mgr.14388) 15083 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:56 smithi044 bash[22676]: cluster 2024-09-21T04:02:55.171367+0000 mgr.a (mgr.14388) 15083 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:56.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:56 smithi049 bash[23528]: cluster 2024-09-21T04:02:55.171367+0000 mgr.a (mgr.14388) 15083 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:57.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:02:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:02:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:02:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:02:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:02:57.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:57 smithi044 bash[22676]: audit 2024-09-21T04:02:56.709261+0000 mgr.a (mgr.14388) 15084 : audit [DBG] from='client.326676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:57.746 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:57 smithi049 bash[23528]: audit 2024-09-21T04:02:56.709261+0000 mgr.a (mgr.14388) 15084 : audit [DBG] from='client.326676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:57 smithi179 bash[23186]: audit 2024-09-21T04:02:56.709261+0000 mgr.a (mgr.14388) 15084 : audit [DBG] from='client.326676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:58 smithi044 bash[22676]: cluster 2024-09-21T04:02:57.171890+0000 mgr.a (mgr.14388) 15085 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:58 smithi044 bash[22676]: audit 2024-09-21T04:02:57.722776+0000 mon.a (mon.0) 12108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:58 smithi044 bash[22676]: audit 2024-09-21T04:02:57.731547+0000 mon.a (mon.0) 12109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:02:58 smithi044 bash[22676]: audit 2024-09-21T04:02:57.742027+0000 mon.a (mon.0) 12110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:58 smithi179 bash[23186]: cluster 2024-09-21T04:02:57.171890+0000 mgr.a (mgr.14388) 15085 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:58 smithi179 bash[23186]: audit 2024-09-21T04:02:57.722776+0000 mon.a (mon.0) 12108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:58 smithi179 bash[23186]: audit 2024-09-21T04:02:57.731547+0000 mon.a (mon.0) 12109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:02:58 smithi179 bash[23186]: audit 2024-09-21T04:02:57.742027+0000 mon.a (mon.0) 12110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:58 smithi049 bash[23528]: cluster 2024-09-21T04:02:57.171890+0000 mgr.a (mgr.14388) 15085 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:02:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:58 smithi049 bash[23528]: audit 2024-09-21T04:02:57.722776+0000 mon.a (mon.0) 12108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:58 smithi049 bash[23528]: audit 2024-09-21T04:02:57.731547+0000 mon.a (mon.0) 12109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:02:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:02:58 smithi049 bash[23528]: audit 2024-09-21T04:02:57.742027+0000 mon.a (mon.0) 12110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:00 smithi044 bash[22676]: cluster 2024-09-21T04:02:59.172662+0000 mgr.a (mgr.14388) 15086 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:00 smithi179 bash[23186]: cluster 2024-09-21T04:02:59.172662+0000 mgr.a (mgr.14388) 15086 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:00 smithi049 bash[23528]: cluster 2024-09-21T04:02:59.172662+0000 mgr.a (mgr.14388) 15086 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:02.910 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:02.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:02 smithi044 bash[22676]: cluster 2024-09-21T04:03:01.174942+0000 mgr.a (mgr.14388) 15087 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:02 smithi179 bash[23186]: cluster 2024-09-21T04:03:01.174942+0000 mgr.a (mgr.14388) 15087 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:02 smithi049 bash[23528]: cluster 2024-09-21T04:03:01.174942+0000 mgr.a (mgr.14388) 15087 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:03.782 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:03 smithi044 bash[22676]: audit 2024-09-21T04:03:02.464864+0000 mgr.a (mgr.14388) 15088 : audit [DBG] from='client.326754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:03 smithi179 bash[23186]: audit 2024-09-21T04:03:02.464864+0000 mgr.a (mgr.14388) 15088 : audit [DBG] from='client.326754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:03 smithi049 bash[23528]: audit 2024-09-21T04:03:02.464864+0000 mgr.a (mgr.14388) 15088 : audit [DBG] from='client.326754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:04 smithi179 bash[23186]: cluster 2024-09-21T04:03:03.175901+0000 mgr.a (mgr.14388) 15089 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:04 smithi049 bash[23528]: cluster 2024-09-21T04:03:03.175901+0000 mgr.a (mgr.14388) 15089 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:05.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:04 smithi044 bash[22676]: cluster 2024-09-21T04:03:03.175901+0000 mgr.a (mgr.14388) 15089 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:07.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:06 smithi179 bash[23186]: cluster 2024-09-21T04:03:05.178217+0000 mgr.a (mgr.14388) 15090 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:06 smithi049 bash[23528]: cluster 2024-09-21T04:03:05.178217+0000 mgr.a (mgr.14388) 15090 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:06 smithi044 bash[22676]: cluster 2024-09-21T04:03:05.178217+0000 mgr.a (mgr.14388) 15090 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:07.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:07.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:07.913 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:08.671 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:08.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:08.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:08.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:08.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:08 smithi179 bash[23186]: cluster 2024-09-21T04:03:07.179013+0000 mgr.a (mgr.14388) 15091 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:08 smithi049 bash[23528]: cluster 2024-09-21T04:03:07.179013+0000 mgr.a (mgr.14388) 15091 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:08 smithi044 bash[22676]: cluster 2024-09-21T04:03:07.179013+0000 mgr.a (mgr.14388) 15091 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:09 smithi179 bash[23186]: audit 2024-09-21T04:03:08.246703+0000 mgr.a (mgr.14388) 15092 : audit [DBG] from='client.326832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:09 smithi179 bash[23186]: audit 2024-09-21T04:03:09.513515+0000 mon.a (mon.0) 12111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:09 smithi179 bash[23186]: audit 2024-09-21T04:03:09.519256+0000 mon.a (mon.0) 12112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:09 smithi179 bash[23186]: audit 2024-09-21T04:03:09.526392+0000 mon.a (mon.0) 12113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:09 smithi179 bash[23186]: audit 2024-09-21T04:03:09.639999+0000 mon.a (mon.0) 12114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:09 smithi179 bash[23186]: audit 2024-09-21T04:03:09.644605+0000 mon.a (mon.0) 12115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:09 smithi179 bash[23186]: audit 2024-09-21T04:03:09.649814+0000 mon.a (mon.0) 12116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:09 smithi049 bash[23528]: audit 2024-09-21T04:03:08.246703+0000 mgr.a (mgr.14388) 15092 : audit [DBG] from='client.326832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:10.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:09 smithi049 bash[23528]: audit 2024-09-21T04:03:09.513515+0000 mon.a (mon.0) 12111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:09 smithi049 bash[23528]: audit 2024-09-21T04:03:09.519256+0000 mon.a (mon.0) 12112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:09 smithi049 bash[23528]: audit 2024-09-21T04:03:09.526392+0000 mon.a (mon.0) 12113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:09 smithi049 bash[23528]: audit 2024-09-21T04:03:09.639999+0000 mon.a (mon.0) 12114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:09 smithi049 bash[23528]: audit 2024-09-21T04:03:09.644605+0000 mon.a (mon.0) 12115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:09 smithi049 bash[23528]: audit 2024-09-21T04:03:09.649814+0000 mon.a (mon.0) 12116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:09 smithi044 bash[22676]: audit 2024-09-21T04:03:08.246703+0000 mgr.a (mgr.14388) 15092 : audit [DBG] from='client.326832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:09 smithi044 bash[22676]: audit 2024-09-21T04:03:09.513515+0000 mon.a (mon.0) 12111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:09 smithi044 bash[22676]: audit 2024-09-21T04:03:09.519256+0000 mon.a (mon.0) 12112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:09 smithi044 bash[22676]: audit 2024-09-21T04:03:09.526392+0000 mon.a (mon.0) 12113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:09 smithi044 bash[22676]: audit 2024-09-21T04:03:09.639999+0000 mon.a (mon.0) 12114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:09 smithi044 bash[22676]: audit 2024-09-21T04:03:09.644605+0000 mon.a (mon.0) 12115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:09 smithi044 bash[22676]: audit 2024-09-21T04:03:09.649814+0000 mon.a (mon.0) 12116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:10 smithi049 bash[23528]: cluster 2024-09-21T04:03:09.180033+0000 mgr.a (mgr.14388) 15093 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:10 smithi044 bash[22676]: cluster 2024-09-21T04:03:09.180033+0000 mgr.a (mgr.14388) 15093 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:10 smithi179 bash[23186]: cluster 2024-09-21T04:03:09.180033+0000 mgr.a (mgr.14388) 15093 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:12 smithi049 bash[23528]: cluster 2024-09-21T04:03:11.182354+0000 mgr.a (mgr.14388) 15094 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:12 smithi044 bash[22676]: cluster 2024-09-21T04:03:11.182354+0000 mgr.a (mgr.14388) 15094 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:12 smithi179 bash[23186]: cluster 2024-09-21T04:03:11.182354+0000 mgr.a (mgr.14388) 15094 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:13.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:13.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:13.673 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:14.464 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:15.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:14 smithi049 bash[23528]: cluster 2024-09-21T04:03:13.183133+0000 mgr.a (mgr.14388) 15095 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:14 smithi044 bash[22676]: cluster 2024-09-21T04:03:13.183133+0000 mgr.a (mgr.14388) 15095 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:14 smithi179 bash[23186]: cluster 2024-09-21T04:03:13.183133+0000 mgr.a (mgr.14388) 15095 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:16.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:15 smithi049 bash[23528]: audit 2024-09-21T04:03:14.011561+0000 mgr.a (mgr.14388) 15096 : audit [DBG] from='client.326907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:15 smithi044 bash[22676]: audit 2024-09-21T04:03:14.011561+0000 mgr.a (mgr.14388) 15096 : audit [DBG] from='client.326907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:16.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:15 smithi179 bash[23186]: audit 2024-09-21T04:03:14.011561+0000 mgr.a (mgr.14388) 15096 : audit [DBG] from='client.326907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:16 smithi179 bash[23186]: cluster 2024-09-21T04:03:15.185573+0000 mgr.a (mgr.14388) 15097 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:16 smithi049 bash[23528]: cluster 2024-09-21T04:03:15.185573+0000 mgr.a (mgr.14388) 15097 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:16 smithi044 bash[22676]: cluster 2024-09-21T04:03:15.185573+0000 mgr.a (mgr.14388) 15097 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:18 smithi049 bash[23528]: cluster 2024-09-21T04:03:17.186367+0000 mgr.a (mgr.14388) 15098 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:18 smithi049 bash[23528]: audit 2024-09-21T04:03:17.956052+0000 mon.a (mon.0) 12117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:18 smithi049 bash[23528]: audit 2024-09-21T04:03:17.964819+0000 mon.a (mon.0) 12118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:18 smithi049 bash[23528]: audit 2024-09-21T04:03:17.975415+0000 mon.a (mon.0) 12119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:18 smithi044 bash[22676]: cluster 2024-09-21T04:03:17.186367+0000 mgr.a (mgr.14388) 15098 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:18 smithi044 bash[22676]: audit 2024-09-21T04:03:17.956052+0000 mon.a (mon.0) 12117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:18 smithi044 bash[22676]: audit 2024-09-21T04:03:17.964819+0000 mon.a (mon.0) 12118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:18 smithi044 bash[22676]: audit 2024-09-21T04:03:17.975415+0000 mon.a (mon.0) 12119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:18 smithi179 bash[23186]: cluster 2024-09-21T04:03:17.186367+0000 mgr.a (mgr.14388) 15098 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:18 smithi179 bash[23186]: audit 2024-09-21T04:03:17.956052+0000 mon.a (mon.0) 12117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:18 smithi179 bash[23186]: audit 2024-09-21T04:03:17.964819+0000 mon.a (mon.0) 12118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:18 smithi179 bash[23186]: audit 2024-09-21T04:03:17.975415+0000 mon.a (mon.0) 12119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:20.269 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:20 smithi049 bash[23528]: cluster 2024-09-21T04:03:19.187145+0000 mgr.a (mgr.14388) 15099 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:20 smithi044 bash[22676]: cluster 2024-09-21T04:03:19.187145+0000 mgr.a (mgr.14388) 15099 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:20 smithi179 bash[23186]: cluster 2024-09-21T04:03:19.187145+0000 mgr.a (mgr.14388) 15099 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:21 smithi049 bash[23528]: audit 2024-09-21T04:03:19.804556+0000 mgr.a (mgr.14388) 15100 : audit [DBG] from='client.326982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:21 smithi044 bash[22676]: audit 2024-09-21T04:03:19.804556+0000 mgr.a (mgr.14388) 15100 : audit [DBG] from='client.326982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:21 smithi179 bash[23186]: audit 2024-09-21T04:03:19.804556+0000 mgr.a (mgr.14388) 15100 : audit [DBG] from='client.326982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:22 smithi044 bash[22676]: cluster 2024-09-21T04:03:21.190097+0000 mgr.a (mgr.14388) 15101 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:22 smithi179 bash[23186]: cluster 2024-09-21T04:03:21.190097+0000 mgr.a (mgr.14388) 15101 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:22 smithi049 bash[23528]: cluster 2024-09-21T04:03:21.190097+0000 mgr.a (mgr.14388) 15101 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:24.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:23 smithi044 bash[22676]: cluster 2024-09-21T04:03:23.190872+0000 mgr.a (mgr.14388) 15102 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:24.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:23 smithi179 bash[23186]: cluster 2024-09-21T04:03:23.190872+0000 mgr.a (mgr.14388) 15102 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:24.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:23 smithi049 bash[23528]: cluster 2024-09-21T04:03:23.190872+0000 mgr.a (mgr.14388) 15102 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:25.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:25.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:25.272 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:26.042 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:26.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:26 smithi044 bash[22676]: cluster 2024-09-21T04:03:25.192865+0000 mgr.a (mgr.14388) 15103 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:26 smithi044 bash[22676]: audit 2024-09-21T04:03:25.618527+0000 mgr.a (mgr.14388) 15104 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:26 smithi179 bash[23186]: cluster 2024-09-21T04:03:25.192865+0000 mgr.a (mgr.14388) 15103 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:26 smithi179 bash[23186]: audit 2024-09-21T04:03:25.618527+0000 mgr.a (mgr.14388) 15104 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:26.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:26 smithi049 bash[23528]: cluster 2024-09-21T04:03:25.192865+0000 mgr.a (mgr.14388) 15103 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:26.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:26 smithi049 bash[23528]: audit 2024-09-21T04:03:25.618527+0000 mgr.a (mgr.14388) 15104 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:28.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:28 smithi049 bash[23528]: cluster 2024-09-21T04:03:27.193803+0000 mgr.a (mgr.14388) 15105 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:28 smithi044 bash[22676]: cluster 2024-09-21T04:03:27.193803+0000 mgr.a (mgr.14388) 15105 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:28 smithi179 bash[23186]: cluster 2024-09-21T04:03:27.193803+0000 mgr.a (mgr.14388) 15105 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:30 smithi044 bash[22676]: cluster 2024-09-21T04:03:29.194626+0000 mgr.a (mgr.14388) 15106 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:03:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:30 smithi044 bash[22676]: audit 2024-09-21T04:03:29.723054+0000 mon.a (mon.0) 12120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:30 smithi044 bash[22676]: audit 2024-09-21T04:03:29.728810+0000 mon.a (mon.0) 12121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:30 smithi044 bash[22676]: audit 2024-09-21T04:03:29.736988+0000 mon.a (mon.0) 12122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:30 smithi044 bash[22676]: audit 2024-09-21T04:03:29.866854+0000 mon.a (mon.0) 12123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:30 smithi044 bash[22676]: audit 2024-09-21T04:03:29.876016+0000 mon.a (mon.0) 12124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:30 smithi044 bash[22676]: audit 2024-09-21T04:03:29.886405+0000 mon.a (mon.0) 12125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:30 smithi179 bash[23186]: cluster 2024-09-21T04:03:29.194626+0000 mgr.a (mgr.14388) 15106 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:03:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:30 smithi179 bash[23186]: audit 2024-09-21T04:03:29.723054+0000 mon.a (mon.0) 12120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:30 smithi179 bash[23186]: audit 2024-09-21T04:03:29.728810+0000 mon.a (mon.0) 12121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:30 smithi179 bash[23186]: audit 2024-09-21T04:03:29.736988+0000 mon.a (mon.0) 12122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:30 smithi179 bash[23186]: audit 2024-09-21T04:03:29.866854+0000 mon.a (mon.0) 12123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:30 smithi179 bash[23186]: audit 2024-09-21T04:03:29.876016+0000 mon.a (mon.0) 12124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:30 smithi179 bash[23186]: audit 2024-09-21T04:03:29.886405+0000 mon.a (mon.0) 12125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:31.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:31.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:30 smithi049 bash[23528]: cluster 2024-09-21T04:03:29.194626+0000 mgr.a (mgr.14388) 15106 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:03:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:30 smithi049 bash[23528]: audit 2024-09-21T04:03:29.723054+0000 mon.a (mon.0) 12120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:30 smithi049 bash[23528]: audit 2024-09-21T04:03:29.728810+0000 mon.a (mon.0) 12121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:30 smithi049 bash[23528]: audit 2024-09-21T04:03:29.736988+0000 mon.a (mon.0) 12122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:30 smithi049 bash[23528]: audit 2024-09-21T04:03:29.866854+0000 mon.a (mon.0) 12123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:30 smithi049 bash[23528]: audit 2024-09-21T04:03:29.876016+0000 mon.a (mon.0) 12124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:30 smithi049 bash[23528]: audit 2024-09-21T04:03:29.886405+0000 mon.a (mon.0) 12125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:03:31 smithi044 bash[22930]: debug 2024-09-21T04:03:31.855+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:03:31.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:03:31 smithi044 bash[22930]: debug 2024-09-21T04:03:31.871+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:03:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:31 smithi044 bash[22676]: audit 2024-09-21T04:03:31.019293+0000 mon.a (mon.0) 12126 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:03:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:31 smithi044 bash[22676]: audit 2024-09-21T04:03:31.025867+0000 mon.a (mon.0) 12127 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:03:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:31 smithi044 bash[22676]: audit 2024-09-21T04:03:31.027761+0000 mon.a (mon.0) 12128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:03:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:31 smithi044 bash[22676]: audit 2024-09-21T04:03:31.039114+0000 mon.a (mon.0) 12129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:31 smithi044 bash[22676]: audit 2024-09-21T04:03:31.045811+0000 mon.a (mon.0) 12130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:03:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:31 smithi179 bash[23186]: audit 2024-09-21T04:03:31.019293+0000 mon.a (mon.0) 12126 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:03:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:31 smithi179 bash[23186]: audit 2024-09-21T04:03:31.025867+0000 mon.a (mon.0) 12127 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:03:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:31 smithi179 bash[23186]: audit 2024-09-21T04:03:31.027761+0000 mon.a (mon.0) 12128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:03:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:31 smithi179 bash[23186]: audit 2024-09-21T04:03:31.039114+0000 mon.a (mon.0) 12129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:31 smithi179 bash[23186]: audit 2024-09-21T04:03:31.045811+0000 mon.a (mon.0) 12130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:03:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:31 smithi049 bash[23528]: audit 2024-09-21T04:03:31.019293+0000 mon.a (mon.0) 12126 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:03:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:31 smithi049 bash[23528]: audit 2024-09-21T04:03:31.025867+0000 mon.a (mon.0) 12127 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:03:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:31 smithi049 bash[23528]: audit 2024-09-21T04:03:31.027761+0000 mon.a (mon.0) 12128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:03:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:31 smithi049 bash[23528]: audit 2024-09-21T04:03:31.039114+0000 mon.a (mon.0) 12129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:31 smithi049 bash[23528]: audit 2024-09-21T04:03:31.045811+0000 mon.a (mon.0) 12130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:03:32.280 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:32.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:32.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:32.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:32.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:32 smithi044 bash[22676]: audit 2024-09-21T04:03:31.048139+0000 mgr.a (mgr.14388) 15107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:03:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:32 smithi044 bash[22676]: cluster 2024-09-21T04:03:31.196697+0000 mgr.a (mgr.14388) 15108 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:32 smithi044 bash[22676]: audit 2024-09-21T04:03:31.385598+0000 mgr.a (mgr.14388) 15109 : audit [DBG] from='client.327141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:32 smithi179 bash[23186]: audit 2024-09-21T04:03:31.048139+0000 mgr.a (mgr.14388) 15107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:03:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:32 smithi179 bash[23186]: cluster 2024-09-21T04:03:31.196697+0000 mgr.a (mgr.14388) 15108 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:32 smithi179 bash[23186]: audit 2024-09-21T04:03:31.385598+0000 mgr.a (mgr.14388) 15109 : audit [DBG] from='client.327141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:32 smithi049 bash[23528]: audit 2024-09-21T04:03:31.048139+0000 mgr.a (mgr.14388) 15107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:03:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:32 smithi049 bash[23528]: cluster 2024-09-21T04:03:31.196697+0000 mgr.a (mgr.14388) 15108 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:32 smithi049 bash[23528]: audit 2024-09-21T04:03:31.385598+0000 mgr.a (mgr.14388) 15109 : audit [DBG] from='client.327141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:33.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:33 smithi044 bash[22676]: audit 2024-09-21T04:03:31.858609+0000 mgr.a (mgr.14388) 15110 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:03:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:33 smithi044 bash[22676]: cephadm 2024-09-21T04:03:31.873613+0000 mgr.a (mgr.14388) 15111 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:03:34.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:33 smithi179 bash[23186]: audit 2024-09-21T04:03:31.858609+0000 mgr.a (mgr.14388) 15110 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:03:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:33 smithi179 bash[23186]: cephadm 2024-09-21T04:03:31.873613+0000 mgr.a (mgr.14388) 15111 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:03:34.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:33 smithi049 bash[23528]: audit 2024-09-21T04:03:31.858609+0000 mgr.a (mgr.14388) 15110 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:03:34.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:33 smithi049 bash[23528]: cephadm 2024-09-21T04:03:31.873613+0000 mgr.a (mgr.14388) 15111 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:03:34.890 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:34 smithi179 bash[23186]: cluster 2024-09-21T04:03:33.197662+0000 mgr.a (mgr.14388) 15112 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:34 smithi049 bash[23528]: cluster 2024-09-21T04:03:33.197662+0000 mgr.a (mgr.14388) 15112 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:35.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:34 smithi044 bash[22676]: cluster 2024-09-21T04:03:33.197662+0000 mgr.a (mgr.14388) 15112 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:36.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:36 smithi179 bash[23186]: cluster 2024-09-21T04:03:35.199996+0000 mgr.a (mgr.14388) 15113 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:36 smithi049 bash[23528]: cluster 2024-09-21T04:03:35.199996+0000 mgr.a (mgr.14388) 15113 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:36 smithi044 bash[22676]: cluster 2024-09-21T04:03:35.199996+0000 mgr.a (mgr.14388) 15113 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:37.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:37.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:37.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:38.047 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:38.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:38.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:38.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:38.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:38 smithi179 bash[23186]: cluster 2024-09-21T04:03:37.200802+0000 mgr.a (mgr.14388) 15114 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:38 smithi179 bash[23186]: audit 2024-09-21T04:03:37.612821+0000 mgr.a (mgr.14388) 15115 : audit [DBG] from='client.327318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:38 smithi179 bash[23186]: audit 2024-09-21T04:03:38.190189+0000 mon.a (mon.0) 12131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:38 smithi179 bash[23186]: audit 2024-09-21T04:03:38.198970+0000 mon.a (mon.0) 12132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:38 smithi179 bash[23186]: audit 2024-09-21T04:03:38.209209+0000 mon.a (mon.0) 12133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:38 smithi049 bash[23528]: cluster 2024-09-21T04:03:37.200802+0000 mgr.a (mgr.14388) 15114 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:38 smithi049 bash[23528]: audit 2024-09-21T04:03:37.612821+0000 mgr.a (mgr.14388) 15115 : audit [DBG] from='client.327318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:38 smithi049 bash[23528]: audit 2024-09-21T04:03:38.190189+0000 mon.a (mon.0) 12131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:38 smithi049 bash[23528]: audit 2024-09-21T04:03:38.198970+0000 mon.a (mon.0) 12132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:38 smithi049 bash[23528]: audit 2024-09-21T04:03:38.209209+0000 mon.a (mon.0) 12133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:38 smithi044 bash[22676]: cluster 2024-09-21T04:03:37.200802+0000 mgr.a (mgr.14388) 15114 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:38 smithi044 bash[22676]: audit 2024-09-21T04:03:37.612821+0000 mgr.a (mgr.14388) 15115 : audit [DBG] from='client.327318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:38 smithi044 bash[22676]: audit 2024-09-21T04:03:38.190189+0000 mon.a (mon.0) 12131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:38 smithi044 bash[22676]: audit 2024-09-21T04:03:38.198970+0000 mon.a (mon.0) 12132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:38 smithi044 bash[22676]: audit 2024-09-21T04:03:38.209209+0000 mon.a (mon.0) 12133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:40 smithi179 bash[23186]: cluster 2024-09-21T04:03:39.201725+0000 mgr.a (mgr.14388) 15116 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:40 smithi049 bash[23528]: cluster 2024-09-21T04:03:39.201725+0000 mgr.a (mgr.14388) 15116 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:41.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:40 smithi044 bash[22676]: cluster 2024-09-21T04:03:39.201725+0000 mgr.a (mgr.14388) 15116 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:43.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:42 smithi049 bash[23528]: cluster 2024-09-21T04:03:41.203967+0000 mgr.a (mgr.14388) 15117 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:42 smithi044 bash[22676]: cluster 2024-09-21T04:03:41.203967+0000 mgr.a (mgr.14388) 15117 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:42 smithi179 bash[23186]: cluster 2024-09-21T04:03:41.203967+0000 mgr.a (mgr.14388) 15117 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:43.844 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:43.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:43.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:43.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:43.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:44 smithi049 bash[23528]: cluster 2024-09-21T04:03:43.204456+0000 mgr.a (mgr.14388) 15118 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:45.045 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:44 smithi049 bash[23528]: audit 2024-09-21T04:03:43.389507+0000 mgr.a (mgr.14388) 15119 : audit [DBG] from='client.327396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:44 smithi044 bash[22676]: cluster 2024-09-21T04:03:43.204456+0000 mgr.a (mgr.14388) 15118 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:44 smithi044 bash[22676]: audit 2024-09-21T04:03:43.389507+0000 mgr.a (mgr.14388) 15119 : audit [DBG] from='client.327396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:45.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:44 smithi179 bash[23186]: cluster 2024-09-21T04:03:43.204456+0000 mgr.a (mgr.14388) 15118 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:44 smithi179 bash[23186]: audit 2024-09-21T04:03:43.389507+0000 mgr.a (mgr.14388) 15119 : audit [DBG] from='client.327396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:46 smithi049 bash[23528]: cluster 2024-09-21T04:03:45.206800+0000 mgr.a (mgr.14388) 15120 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:46 smithi044 bash[22676]: cluster 2024-09-21T04:03:45.206800+0000 mgr.a (mgr.14388) 15120 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:46 smithi179 bash[23186]: cluster 2024-09-21T04:03:45.206800+0000 mgr.a (mgr.14388) 15120 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:03:48.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:48.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:48.847 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:48 smithi049 bash[23528]: cluster 2024-09-21T04:03:47.207616+0000 mgr.a (mgr.14388) 15121 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:48 smithi044 bash[22676]: cluster 2024-09-21T04:03:47.207616+0000 mgr.a (mgr.14388) 15121 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:48 smithi179 bash[23186]: cluster 2024-09-21T04:03:47.207616+0000 mgr.a (mgr.14388) 15121 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:49.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:49.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:49.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:49.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:49.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: audit 2024-09-21T04:03:49.183075+0000 mgr.a (mgr.14388) 15122 : audit [DBG] from='client.327474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: cluster 2024-09-21T04:03:49.208693+0000 mgr.a (mgr.14388) 15123 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: audit 2024-09-21T04:03:49.934909+0000 mon.a (mon.0) 12134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: audit 2024-09-21T04:03:49.940304+0000 mon.a (mon.0) 12135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: audit 2024-09-21T04:03:49.946708+0000 mon.a (mon.0) 12136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: audit 2024-09-21T04:03:50.056014+0000 mon.a (mon.0) 12137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: audit 2024-09-21T04:03:50.061699+0000 mon.a (mon.0) 12138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:50 smithi044 bash[22676]: audit 2024-09-21T04:03:50.070828+0000 mon.a (mon.0) 12139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: audit 2024-09-21T04:03:49.183075+0000 mgr.a (mgr.14388) 15122 : audit [DBG] from='client.327474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: cluster 2024-09-21T04:03:49.208693+0000 mgr.a (mgr.14388) 15123 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: audit 2024-09-21T04:03:49.934909+0000 mon.a (mon.0) 12134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: audit 2024-09-21T04:03:49.940304+0000 mon.a (mon.0) 12135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: audit 2024-09-21T04:03:49.946708+0000 mon.a (mon.0) 12136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: audit 2024-09-21T04:03:50.056014+0000 mon.a (mon.0) 12137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: audit 2024-09-21T04:03:50.061699+0000 mon.a (mon.0) 12138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:50 smithi049 bash[23528]: audit 2024-09-21T04:03:50.070828+0000 mon.a (mon.0) 12139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: audit 2024-09-21T04:03:49.183075+0000 mgr.a (mgr.14388) 15122 : audit [DBG] from='client.327474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: cluster 2024-09-21T04:03:49.208693+0000 mgr.a (mgr.14388) 15123 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: audit 2024-09-21T04:03:49.934909+0000 mon.a (mon.0) 12134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: audit 2024-09-21T04:03:49.940304+0000 mon.a (mon.0) 12135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: audit 2024-09-21T04:03:49.946708+0000 mon.a (mon.0) 12136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: audit 2024-09-21T04:03:50.056014+0000 mon.a (mon.0) 12137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: audit 2024-09-21T04:03:50.061699+0000 mon.a (mon.0) 12138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:50 smithi179 bash[23186]: audit 2024-09-21T04:03:50.070828+0000 mon.a (mon.0) 12139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:52 smithi049 bash[23528]: cluster 2024-09-21T04:03:51.211136+0000 mgr.a (mgr.14388) 15124 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:52 smithi044 bash[22676]: cluster 2024-09-21T04:03:51.211136+0000 mgr.a (mgr.14388) 15124 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:52 smithi179 bash[23186]: cluster 2024-09-21T04:03:51.211136+0000 mgr.a (mgr.14388) 15124 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:03:54.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:03:54.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:03:54.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:03:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:54 smithi179 bash[23186]: cluster 2024-09-21T04:03:53.211944+0000 mgr.a (mgr.14388) 15125 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:54 smithi049 bash[23528]: cluster 2024-09-21T04:03:53.211944+0000 mgr.a (mgr.14388) 15125 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:55.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:54 smithi044 bash[22676]: cluster 2024-09-21T04:03:53.211944+0000 mgr.a (mgr.14388) 15125 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:55.398 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:03:55.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:03:55.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:03:55.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:03:55.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:03:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:56 smithi049 bash[23528]: audit 2024-09-21T04:03:54.959715+0000 mgr.a (mgr.14388) 15126 : audit [DBG] from='client.327549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:56 smithi049 bash[23528]: cluster 2024-09-21T04:03:55.213441+0000 mgr.a (mgr.14388) 15127 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:57.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:56 smithi179 bash[23186]: audit 2024-09-21T04:03:54.959715+0000 mgr.a (mgr.14388) 15126 : audit [DBG] from='client.327549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:57.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:56 smithi179 bash[23186]: cluster 2024-09-21T04:03:55.213441+0000 mgr.a (mgr.14388) 15127 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:56 smithi044 bash[22676]: audit 2024-09-21T04:03:54.959715+0000 mgr.a (mgr.14388) 15126 : audit [DBG] from='client.327549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:03:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:56 smithi044 bash[22676]: cluster 2024-09-21T04:03:55.213441+0000 mgr.a (mgr.14388) 15127 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:03:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:58 smithi049 bash[23528]: cluster 2024-09-21T04:03:57.214286+0000 mgr.a (mgr.14388) 15128 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:58 smithi049 bash[23528]: audit 2024-09-21T04:03:58.389354+0000 mon.a (mon.0) 12140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:58 smithi049 bash[23528]: audit 2024-09-21T04:03:58.398209+0000 mon.a (mon.0) 12141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:03:58 smithi049 bash[23528]: audit 2024-09-21T04:03:58.408828+0000 mon.a (mon.0) 12142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:58 smithi044 bash[22676]: cluster 2024-09-21T04:03:57.214286+0000 mgr.a (mgr.14388) 15128 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:58 smithi044 bash[22676]: audit 2024-09-21T04:03:58.389354+0000 mon.a (mon.0) 12140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:58 smithi044 bash[22676]: audit 2024-09-21T04:03:58.398209+0000 mon.a (mon.0) 12141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:03:58 smithi044 bash[22676]: audit 2024-09-21T04:03:58.408828+0000 mon.a (mon.0) 12142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:58 smithi179 bash[23186]: cluster 2024-09-21T04:03:57.214286+0000 mgr.a (mgr.14388) 15128 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:03:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:58 smithi179 bash[23186]: audit 2024-09-21T04:03:58.389354+0000 mon.a (mon.0) 12140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:58 smithi179 bash[23186]: audit 2024-09-21T04:03:58.398209+0000 mon.a (mon.0) 12141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:03:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:03:58 smithi179 bash[23186]: audit 2024-09-21T04:03:58.408828+0000 mon.a (mon.0) 12142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:00.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:00.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:00 smithi049 bash[23528]: cluster 2024-09-21T04:03:59.215102+0000 mgr.a (mgr.14388) 15129 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:04:01.195 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:00 smithi044 bash[22676]: cluster 2024-09-21T04:03:59.215102+0000 mgr.a (mgr.14388) 15129 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:04:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:00 smithi179 bash[23186]: cluster 2024-09-21T04:03:59.215102+0000 mgr.a (mgr.14388) 15129 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:04:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:01 smithi049 bash[23528]: audit 2024-09-21T04:04:00.739263+0000 mgr.a (mgr.14388) 15130 : audit [DBG] from='client.327627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:01 smithi044 bash[22676]: audit 2024-09-21T04:04:00.739263+0000 mgr.a (mgr.14388) 15130 : audit [DBG] from='client.327627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:01 smithi179 bash[23186]: audit 2024-09-21T04:04:00.739263+0000 mgr.a (mgr.14388) 15130 : audit [DBG] from='client.327627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:03.061 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:02 smithi044 bash[22676]: cluster 2024-09-21T04:04:01.216553+0000 mgr.a (mgr.14388) 15131 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:03.173 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:02 smithi049 bash[23528]: cluster 2024-09-21T04:04:01.216553+0000 mgr.a (mgr.14388) 15131 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:02 smithi179 bash[23186]: cluster 2024-09-21T04:04:01.216553+0000 mgr.a (mgr.14388) 15131 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:04 smithi049 bash[23528]: cluster 2024-09-21T04:04:03.217483+0000 mgr.a (mgr.14388) 15132 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:04:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:04 smithi044 bash[22676]: cluster 2024-09-21T04:04:03.217483+0000 mgr.a (mgr.14388) 15132 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:04:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:04 smithi179 bash[23186]: cluster 2024-09-21T04:04:03.217483+0000 mgr.a (mgr.14388) 15132 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:04:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:05 smithi044 bash[22676]: cluster 2024-09-21T04:04:05.219561+0000 mgr.a (mgr.14388) 15133 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:05 smithi179 bash[23186]: cluster 2024-09-21T04:04:05.219561+0000 mgr.a (mgr.14388) 15133 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:06.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:05 smithi049 bash[23528]: cluster 2024-09-21T04:04:05.219561+0000 mgr.a (mgr.14388) 15133 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:06.925 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:06.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:06.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:06.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:06.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:06 smithi044 bash[22676]: audit 2024-09-21T04:04:06.510340+0000 mgr.a (mgr.14388) 15134 : audit [DBG] from='client.327705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:06 smithi179 bash[23186]: audit 2024-09-21T04:04:06.510340+0000 mgr.a (mgr.14388) 15134 : audit [DBG] from='client.327705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:06 smithi049 bash[23528]: audit 2024-09-21T04:04:06.510340+0000 mgr.a (mgr.14388) 15134 : audit [DBG] from='client.327705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:08.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:07 smithi044 bash[22676]: cluster 2024-09-21T04:04:07.220512+0000 mgr.a (mgr.14388) 15135 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:08.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:07 smithi179 bash[23186]: cluster 2024-09-21T04:04:07.220512+0000 mgr.a (mgr.14388) 15135 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:07 smithi049 bash[23528]: cluster 2024-09-21T04:04:07.220512+0000 mgr.a (mgr.14388) 15135 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:10 smithi179 bash[23186]: cluster 2024-09-21T04:04:09.221486+0000 mgr.a (mgr.14388) 15136 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:10 smithi179 bash[23186]: audit 2024-09-21T04:04:10.142178+0000 mon.a (mon.0) 12143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:10 smithi179 bash[23186]: audit 2024-09-21T04:04:10.151395+0000 mon.a (mon.0) 12144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:10 smithi179 bash[23186]: audit 2024-09-21T04:04:10.162078+0000 mon.a (mon.0) 12145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:10 smithi049 bash[23528]: cluster 2024-09-21T04:04:09.221486+0000 mgr.a (mgr.14388) 15136 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:10 smithi049 bash[23528]: audit 2024-09-21T04:04:10.142178+0000 mon.a (mon.0) 12143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:10 smithi049 bash[23528]: audit 2024-09-21T04:04:10.151395+0000 mon.a (mon.0) 12144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:10 smithi049 bash[23528]: audit 2024-09-21T04:04:10.162078+0000 mon.a (mon.0) 12145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:10 smithi044 bash[22676]: cluster 2024-09-21T04:04:09.221486+0000 mgr.a (mgr.14388) 15136 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:10 smithi044 bash[22676]: audit 2024-09-21T04:04:10.142178+0000 mon.a (mon.0) 12143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:10 smithi044 bash[22676]: audit 2024-09-21T04:04:10.151395+0000 mon.a (mon.0) 12144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:10 smithi044 bash[22676]: audit 2024-09-21T04:04:10.162078+0000 mon.a (mon.0) 12145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:11 smithi049 bash[23528]: audit 2024-09-21T04:04:10.291274+0000 mon.a (mon.0) 12146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:11 smithi049 bash[23528]: audit 2024-09-21T04:04:10.299370+0000 mon.a (mon.0) 12147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:11 smithi049 bash[23528]: audit 2024-09-21T04:04:10.309625+0000 mon.a (mon.0) 12148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:11 smithi044 bash[22676]: audit 2024-09-21T04:04:10.291274+0000 mon.a (mon.0) 12146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:11 smithi044 bash[22676]: audit 2024-09-21T04:04:10.299370+0000 mon.a (mon.0) 12147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:11 smithi044 bash[22676]: audit 2024-09-21T04:04:10.309625+0000 mon.a (mon.0) 12148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:11 smithi179 bash[23186]: audit 2024-09-21T04:04:10.291274+0000 mon.a (mon.0) 12146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:11 smithi179 bash[23186]: audit 2024-09-21T04:04:10.299370+0000 mon.a (mon.0) 12147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:11 smithi179 bash[23186]: audit 2024-09-21T04:04:10.309625+0000 mon.a (mon.0) 12148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:11.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:11.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:11.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:12.688 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:12.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:12 smithi044 bash[22676]: cluster 2024-09-21T04:04:11.223913+0000 mgr.a (mgr.14388) 15137 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:12 smithi179 bash[23186]: cluster 2024-09-21T04:04:11.223913+0000 mgr.a (mgr.14388) 15137 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:12 smithi049 bash[23528]: cluster 2024-09-21T04:04:11.223913+0000 mgr.a (mgr.14388) 15137 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:13 smithi044 bash[22676]: audit 2024-09-21T04:04:12.250521+0000 mgr.a (mgr.14388) 15138 : audit [DBG] from='client.327783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:13 smithi179 bash[23186]: audit 2024-09-21T04:04:12.250521+0000 mgr.a (mgr.14388) 15138 : audit [DBG] from='client.327783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:13 smithi049 bash[23528]: audit 2024-09-21T04:04:12.250521+0000 mgr.a (mgr.14388) 15138 : audit [DBG] from='client.327783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:14 smithi044 bash[22676]: cluster 2024-09-21T04:04:13.224822+0000 mgr.a (mgr.14388) 15139 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:14 smithi179 bash[23186]: cluster 2024-09-21T04:04:13.224822+0000 mgr.a (mgr.14388) 15139 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:14 smithi049 bash[23528]: cluster 2024-09-21T04:04:13.224822+0000 mgr.a (mgr.14388) 15139 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:16.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:16 smithi044 bash[22676]: cluster 2024-09-21T04:04:15.227009+0000 mgr.a (mgr.14388) 15140 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:16 smithi179 bash[23186]: cluster 2024-09-21T04:04:15.227009+0000 mgr.a (mgr.14388) 15140 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:16.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:16 smithi049 bash[23528]: cluster 2024-09-21T04:04:15.227009+0000 mgr.a (mgr.14388) 15140 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:17.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:17.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:17.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:18.476 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:18.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:18.648 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:18 smithi049 bash[23528]: cluster 2024-09-21T04:04:17.227790+0000 mgr.a (mgr.14388) 15141 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:18 smithi044 bash[22676]: cluster 2024-09-21T04:04:17.227790+0000 mgr.a (mgr.14388) 15141 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:18 smithi179 bash[23186]: cluster 2024-09-21T04:04:17.227790+0000 mgr.a (mgr.14388) 15141 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:19 smithi044 bash[22676]: audit 2024-09-21T04:04:18.019779+0000 mgr.a (mgr.14388) 15142 : audit [DBG] from='client.327861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:19 smithi044 bash[22676]: audit 2024-09-21T04:04:18.625096+0000 mon.a (mon.0) 12149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:19 smithi044 bash[22676]: audit 2024-09-21T04:04:18.633717+0000 mon.a (mon.0) 12150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:19 smithi044 bash[22676]: audit 2024-09-21T04:04:18.643953+0000 mon.a (mon.0) 12151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:19 smithi179 bash[23186]: audit 2024-09-21T04:04:18.019779+0000 mgr.a (mgr.14388) 15142 : audit [DBG] from='client.327861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:19 smithi179 bash[23186]: audit 2024-09-21T04:04:18.625096+0000 mon.a (mon.0) 12149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:19 smithi179 bash[23186]: audit 2024-09-21T04:04:18.633717+0000 mon.a (mon.0) 12150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:19 smithi179 bash[23186]: audit 2024-09-21T04:04:18.643953+0000 mon.a (mon.0) 12151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:19 smithi049 bash[23528]: audit 2024-09-21T04:04:18.019779+0000 mgr.a (mgr.14388) 15142 : audit [DBG] from='client.327861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:19 smithi049 bash[23528]: audit 2024-09-21T04:04:18.625096+0000 mon.a (mon.0) 12149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:19 smithi049 bash[23528]: audit 2024-09-21T04:04:18.633717+0000 mon.a (mon.0) 12150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:19 smithi049 bash[23528]: audit 2024-09-21T04:04:18.643953+0000 mon.a (mon.0) 12151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:20 smithi044 bash[22676]: cluster 2024-09-21T04:04:19.228661+0000 mgr.a (mgr.14388) 15143 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:20 smithi179 bash[23186]: cluster 2024-09-21T04:04:19.228661+0000 mgr.a (mgr.14388) 15143 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:20 smithi049 bash[23528]: cluster 2024-09-21T04:04:19.228661+0000 mgr.a (mgr.14388) 15143 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:22 smithi044 bash[22676]: cluster 2024-09-21T04:04:21.230980+0000 mgr.a (mgr.14388) 15144 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:22 smithi179 bash[23186]: cluster 2024-09-21T04:04:21.230980+0000 mgr.a (mgr.14388) 15144 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:22 smithi049 bash[23528]: cluster 2024-09-21T04:04:21.230980+0000 mgr.a (mgr.14388) 15144 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:23.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:23.479 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:23.479 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:24.277 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:24.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:24.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:24.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:24.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:24 smithi044 bash[22676]: cluster 2024-09-21T04:04:23.231823+0000 mgr.a (mgr.14388) 15145 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:24 smithi049 bash[23528]: cluster 2024-09-21T04:04:23.231823+0000 mgr.a (mgr.14388) 15145 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:24 smithi179 bash[23186]: cluster 2024-09-21T04:04:23.231823+0000 mgr.a (mgr.14388) 15145 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:25.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:25 smithi049 bash[23528]: audit 2024-09-21T04:04:23.812437+0000 mgr.a (mgr.14388) 15146 : audit [DBG] from='client.327936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:25.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:25 smithi044 bash[22676]: audit 2024-09-21T04:04:23.812437+0000 mgr.a (mgr.14388) 15146 : audit [DBG] from='client.327936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:25 smithi179 bash[23186]: audit 2024-09-21T04:04:23.812437+0000 mgr.a (mgr.14388) 15146 : audit [DBG] from='client.327936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:26 smithi044 bash[22676]: cluster 2024-09-21T04:04:25.234195+0000 mgr.a (mgr.14388) 15147 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:26 smithi179 bash[23186]: cluster 2024-09-21T04:04:25.234195+0000 mgr.a (mgr.14388) 15147 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:26 smithi049 bash[23528]: cluster 2024-09-21T04:04:25.234195+0000 mgr.a (mgr.14388) 15147 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:28 smithi044 bash[22676]: cluster 2024-09-21T04:04:27.234990+0000 mgr.a (mgr.14388) 15148 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:28 smithi179 bash[23186]: cluster 2024-09-21T04:04:27.234990+0000 mgr.a (mgr.14388) 15148 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:28 smithi049 bash[23528]: cluster 2024-09-21T04:04:27.234990+0000 mgr.a (mgr.14388) 15148 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:29.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:29.279 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:29.279 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: cluster 2024-09-21T04:04:29.235782+0000 mgr.a (mgr.14388) 15149 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: audit 2024-09-21T04:04:29.615747+0000 mgr.a (mgr.14388) 15150 : audit [DBG] from='client.328014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: audit 2024-09-21T04:04:30.361164+0000 mon.a (mon.0) 12152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: audit 2024-09-21T04:04:30.366626+0000 mon.a (mon.0) 12153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: audit 2024-09-21T04:04:30.371981+0000 mon.a (mon.0) 12154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: audit 2024-09-21T04:04:30.520583+0000 mon.a (mon.0) 12155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: audit 2024-09-21T04:04:30.528716+0000 mon.a (mon.0) 12156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:30 smithi044 bash[22676]: audit 2024-09-21T04:04:30.536872+0000 mon.a (mon.0) 12157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: cluster 2024-09-21T04:04:29.235782+0000 mgr.a (mgr.14388) 15149 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: audit 2024-09-21T04:04:29.615747+0000 mgr.a (mgr.14388) 15150 : audit [DBG] from='client.328014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: audit 2024-09-21T04:04:30.361164+0000 mon.a (mon.0) 12152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: audit 2024-09-21T04:04:30.366626+0000 mon.a (mon.0) 12153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: audit 2024-09-21T04:04:30.371981+0000 mon.a (mon.0) 12154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: audit 2024-09-21T04:04:30.520583+0000 mon.a (mon.0) 12155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: audit 2024-09-21T04:04:30.528716+0000 mon.a (mon.0) 12156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:30 smithi179 bash[23186]: audit 2024-09-21T04:04:30.536872+0000 mon.a (mon.0) 12157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: cluster 2024-09-21T04:04:29.235782+0000 mgr.a (mgr.14388) 15149 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: audit 2024-09-21T04:04:29.615747+0000 mgr.a (mgr.14388) 15150 : audit [DBG] from='client.328014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: audit 2024-09-21T04:04:30.361164+0000 mon.a (mon.0) 12152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: audit 2024-09-21T04:04:30.366626+0000 mon.a (mon.0) 12153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: audit 2024-09-21T04:04:30.371981+0000 mon.a (mon.0) 12154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: audit 2024-09-21T04:04:30.520583+0000 mon.a (mon.0) 12155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: audit 2024-09-21T04:04:30.528716+0000 mon.a (mon.0) 12156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:30 smithi049 bash[23528]: audit 2024-09-21T04:04:30.536872+0000 mon.a (mon.0) 12157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22930]: debug 2024-09-21T04:04:32.738+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22930]: debug 2024-09-21T04:04:32.738+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22676]: cluster 2024-09-21T04:04:31.238215+0000 mgr.a (mgr.14388) 15151 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22676]: audit 2024-09-21T04:04:31.940182+0000 mon.a (mon.0) 12158 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22676]: audit 2024-09-21T04:04:31.943856+0000 mon.a (mon.0) 12159 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22676]: audit 2024-09-21T04:04:31.944727+0000 mon.a (mon.0) 12160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22676]: audit 2024-09-21T04:04:31.950883+0000 mon.a (mon.0) 12161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:32 smithi044 bash[22676]: audit 2024-09-21T04:04:31.953594+0000 mon.a (mon.0) 12162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:04:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:32 smithi179 bash[23186]: cluster 2024-09-21T04:04:31.238215+0000 mgr.a (mgr.14388) 15151 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:04:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:32 smithi179 bash[23186]: audit 2024-09-21T04:04:31.940182+0000 mon.a (mon.0) 12158 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:04:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:32 smithi179 bash[23186]: audit 2024-09-21T04:04:31.943856+0000 mon.a (mon.0) 12159 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:04:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:32 smithi179 bash[23186]: audit 2024-09-21T04:04:31.944727+0000 mon.a (mon.0) 12160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:04:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:32 smithi179 bash[23186]: audit 2024-09-21T04:04:31.950883+0000 mon.a (mon.0) 12161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:32 smithi179 bash[23186]: audit 2024-09-21T04:04:31.953594+0000 mon.a (mon.0) 12162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:04:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:32 smithi049 bash[23528]: cluster 2024-09-21T04:04:31.238215+0000 mgr.a (mgr.14388) 15151 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:04:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:32 smithi049 bash[23528]: audit 2024-09-21T04:04:31.940182+0000 mon.a (mon.0) 12158 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:04:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:32 smithi049 bash[23528]: audit 2024-09-21T04:04:31.943856+0000 mon.a (mon.0) 12159 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:04:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:32 smithi049 bash[23528]: audit 2024-09-21T04:04:31.944727+0000 mon.a (mon.0) 12160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:04:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:32 smithi049 bash[23528]: audit 2024-09-21T04:04:31.950883+0000 mon.a (mon.0) 12161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:32 smithi049 bash[23528]: audit 2024-09-21T04:04:31.953594+0000 mon.a (mon.0) 12162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:04:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:33 smithi044 bash[22676]: audit 2024-09-21T04:04:31.954549+0000 mgr.a (mgr.14388) 15152 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:04:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:33 smithi044 bash[22676]: audit 2024-09-21T04:04:32.741504+0000 mgr.a (mgr.14388) 15153 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:04:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:33 smithi044 bash[22676]: cephadm 2024-09-21T04:04:32.742740+0000 mgr.a (mgr.14388) 15154 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:04:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:33 smithi179 bash[23186]: audit 2024-09-21T04:04:31.954549+0000 mgr.a (mgr.14388) 15152 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:04:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:33 smithi179 bash[23186]: audit 2024-09-21T04:04:32.741504+0000 mgr.a (mgr.14388) 15153 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:04:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:33 smithi179 bash[23186]: cephadm 2024-09-21T04:04:32.742740+0000 mgr.a (mgr.14388) 15154 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:04:34.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:33 smithi049 bash[23528]: audit 2024-09-21T04:04:31.954549+0000 mgr.a (mgr.14388) 15152 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:04:34.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:33 smithi049 bash[23528]: audit 2024-09-21T04:04:32.741504+0000 mgr.a (mgr.14388) 15153 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:04:34.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:33 smithi049 bash[23528]: cephadm 2024-09-21T04:04:32.742740+0000 mgr.a (mgr.14388) 15154 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:04:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:34 smithi044 bash[22676]: cluster 2024-09-21T04:04:33.239125+0000 mgr.a (mgr.14388) 15155 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:04:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:34 smithi179 bash[23186]: cluster 2024-09-21T04:04:33.239125+0000 mgr.a (mgr.14388) 15155 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:04:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:34 smithi049 bash[23528]: cluster 2024-09-21T04:04:33.239125+0000 mgr.a (mgr.14388) 15155 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:04:35.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:35.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:35.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:35.851 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:35.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:35.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:35.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:35.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:36.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:36 smithi044 bash[22676]: cluster 2024-09-21T04:04:35.241428+0000 mgr.a (mgr.14388) 15156 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:36 smithi044 bash[22676]: audit 2024-09-21T04:04:35.417819+0000 mgr.a (mgr.14388) 15157 : audit [DBG] from='client.328197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:36 smithi179 bash[23186]: cluster 2024-09-21T04:04:35.241428+0000 mgr.a (mgr.14388) 15156 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:36 smithi179 bash[23186]: audit 2024-09-21T04:04:35.417819+0000 mgr.a (mgr.14388) 15157 : audit [DBG] from='client.328197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:36 smithi049 bash[23528]: cluster 2024-09-21T04:04:35.241428+0000 mgr.a (mgr.14388) 15156 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:36 smithi049 bash[23528]: audit 2024-09-21T04:04:35.417819+0000 mgr.a (mgr.14388) 15157 : audit [DBG] from='client.328197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:38 smithi044 bash[22676]: cluster 2024-09-21T04:04:37.242386+0000 mgr.a (mgr.14388) 15158 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:38 smithi179 bash[23186]: cluster 2024-09-21T04:04:37.242386+0000 mgr.a (mgr.14388) 15158 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:38 smithi049 bash[23528]: cluster 2024-09-21T04:04:37.242386+0000 mgr.a (mgr.14388) 15158 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:39 smithi044 bash[22676]: audit 2024-09-21T04:04:38.859635+0000 mon.a (mon.0) 12163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:39 smithi044 bash[22676]: audit 2024-09-21T04:04:38.869236+0000 mon.a (mon.0) 12164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:39 smithi044 bash[22676]: audit 2024-09-21T04:04:38.880098+0000 mon.a (mon.0) 12165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:39 smithi044 bash[22676]: cluster 2024-09-21T04:04:39.243199+0000 mgr.a (mgr.14388) 15159 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:40.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:39 smithi179 bash[23186]: audit 2024-09-21T04:04:38.859635+0000 mon.a (mon.0) 12163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:39 smithi179 bash[23186]: audit 2024-09-21T04:04:38.869236+0000 mon.a (mon.0) 12164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:39 smithi179 bash[23186]: audit 2024-09-21T04:04:38.880098+0000 mon.a (mon.0) 12165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:39 smithi179 bash[23186]: cluster 2024-09-21T04:04:39.243199+0000 mgr.a (mgr.14388) 15159 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:39 smithi049 bash[23528]: audit 2024-09-21T04:04:38.859635+0000 mon.a (mon.0) 12163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:39 smithi049 bash[23528]: audit 2024-09-21T04:04:38.869236+0000 mon.a (mon.0) 12164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:39 smithi049 bash[23528]: audit 2024-09-21T04:04:38.880098+0000 mon.a (mon.0) 12165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:39 smithi049 bash[23528]: cluster 2024-09-21T04:04:39.243199+0000 mgr.a (mgr.14388) 15159 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:41.648 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:42 smithi044 bash[22676]: audit 2024-09-21T04:04:41.189009+0000 mgr.a (mgr.14388) 15160 : audit [DBG] from='client.328275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:42 smithi044 bash[22676]: cluster 2024-09-21T04:04:41.246465+0000 mgr.a (mgr.14388) 15161 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:42 smithi179 bash[23186]: audit 2024-09-21T04:04:41.189009+0000 mgr.a (mgr.14388) 15160 : audit [DBG] from='client.328275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:42 smithi179 bash[23186]: cluster 2024-09-21T04:04:41.246465+0000 mgr.a (mgr.14388) 15161 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:42 smithi049 bash[23528]: audit 2024-09-21T04:04:41.189009+0000 mgr.a (mgr.14388) 15160 : audit [DBG] from='client.328275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:42 smithi049 bash[23528]: cluster 2024-09-21T04:04:41.246465+0000 mgr.a (mgr.14388) 15161 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:44.404 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:44 smithi049 bash[23528]: cluster 2024-09-21T04:04:43.247406+0000 mgr.a (mgr.14388) 15162 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:44.729 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:44 smithi044 bash[22676]: cluster 2024-09-21T04:04:43.247406+0000 mgr.a (mgr.14388) 15162 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:44 smithi179 bash[23186]: cluster 2024-09-21T04:04:43.247406+0000 mgr.a (mgr.14388) 15162 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:04:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:46 smithi044 bash[22676]: cluster 2024-09-21T04:04:45.249708+0000 mgr.a (mgr.14388) 15163 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:46.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:46.650 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:46.650 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:46.696 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:46 smithi049 bash[23528]: cluster 2024-09-21T04:04:45.249708+0000 mgr.a (mgr.14388) 15163 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:46 smithi179 bash[23186]: cluster 2024-09-21T04:04:45.249708+0000 mgr.a (mgr.14388) 15163 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:04:47.424 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:48 smithi044 bash[22676]: audit 2024-09-21T04:04:46.986099+0000 mgr.a (mgr.14388) 15164 : audit [DBG] from='client.328353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:48 smithi044 bash[22676]: cluster 2024-09-21T04:04:47.250369+0000 mgr.a (mgr.14388) 15165 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:48 smithi179 bash[23186]: audit 2024-09-21T04:04:46.986099+0000 mgr.a (mgr.14388) 15164 : audit [DBG] from='client.328353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:48 smithi179 bash[23186]: cluster 2024-09-21T04:04:47.250369+0000 mgr.a (mgr.14388) 15165 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:48 smithi049 bash[23528]: audit 2024-09-21T04:04:46.986099+0000 mgr.a (mgr.14388) 15164 : audit [DBG] from='client.328353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:48.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:48 smithi049 bash[23528]: cluster 2024-09-21T04:04:47.250369+0000 mgr.a (mgr.14388) 15165 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:50.592 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:50 smithi179 bash[23186]: cluster 2024-09-21T04:04:49.251408+0000 mgr.a (mgr.14388) 15166 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:50.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:50 smithi044 bash[22676]: cluster 2024-09-21T04:04:49.251408+0000 mgr.a (mgr.14388) 15166 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:50 smithi049 bash[23528]: cluster 2024-09-21T04:04:49.251408+0000 mgr.a (mgr.14388) 15166 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:51 smithi044 bash[22676]: audit 2024-09-21T04:04:50.575199+0000 mon.a (mon.0) 12166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:51 smithi044 bash[22676]: audit 2024-09-21T04:04:50.580623+0000 mon.a (mon.0) 12167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:51 smithi044 bash[22676]: audit 2024-09-21T04:04:50.588462+0000 mon.a (mon.0) 12168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:51 smithi044 bash[22676]: audit 2024-09-21T04:04:50.750506+0000 mon.a (mon.0) 12169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:51 smithi044 bash[22676]: audit 2024-09-21T04:04:50.756755+0000 mon.a (mon.0) 12170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:51 smithi044 bash[22676]: audit 2024-09-21T04:04:50.763626+0000 mon.a (mon.0) 12171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:51 smithi179 bash[23186]: audit 2024-09-21T04:04:50.575199+0000 mon.a (mon.0) 12166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:51 smithi179 bash[23186]: audit 2024-09-21T04:04:50.580623+0000 mon.a (mon.0) 12167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:51 smithi179 bash[23186]: audit 2024-09-21T04:04:50.588462+0000 mon.a (mon.0) 12168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:51 smithi179 bash[23186]: audit 2024-09-21T04:04:50.750506+0000 mon.a (mon.0) 12169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:51 smithi179 bash[23186]: audit 2024-09-21T04:04:50.756755+0000 mon.a (mon.0) 12170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:51 smithi179 bash[23186]: audit 2024-09-21T04:04:50.763626+0000 mon.a (mon.0) 12171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:51 smithi049 bash[23528]: audit 2024-09-21T04:04:50.575199+0000 mon.a (mon.0) 12166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:51 smithi049 bash[23528]: audit 2024-09-21T04:04:50.580623+0000 mon.a (mon.0) 12167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:51 smithi049 bash[23528]: audit 2024-09-21T04:04:50.588462+0000 mon.a (mon.0) 12168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:51 smithi049 bash[23528]: audit 2024-09-21T04:04:50.750506+0000 mon.a (mon.0) 12169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:51 smithi049 bash[23528]: audit 2024-09-21T04:04:50.756755+0000 mon.a (mon.0) 12170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:51 smithi049 bash[23528]: audit 2024-09-21T04:04:50.763626+0000 mon.a (mon.0) 12171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:04:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:52 smithi044 bash[22676]: cluster 2024-09-21T04:04:51.253724+0000 mgr.a (mgr.14388) 15167 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:52 smithi049 bash[23528]: cluster 2024-09-21T04:04:51.253724+0000 mgr.a (mgr.14388) 15167 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:53.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:53.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:53.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:53.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:53.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:52 smithi179 bash[23186]: cluster 2024-09-21T04:04:51.253724+0000 mgr.a (mgr.14388) 15167 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:54.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:53 smithi049 bash[23528]: audit 2024-09-21T04:04:52.764801+0000 mgr.a (mgr.14388) 15168 : audit [DBG] from='client.328431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:53 smithi044 bash[22676]: audit 2024-09-21T04:04:52.764801+0000 mgr.a (mgr.14388) 15168 : audit [DBG] from='client.328431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:53 smithi179 bash[23186]: audit 2024-09-21T04:04:52.764801+0000 mgr.a (mgr.14388) 15168 : audit [DBG] from='client.328431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:04:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:54 smithi179 bash[23186]: cluster 2024-09-21T04:04:53.254469+0000 mgr.a (mgr.14388) 15169 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:54 smithi049 bash[23528]: cluster 2024-09-21T04:04:53.254469+0000 mgr.a (mgr.14388) 15169 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:54 smithi044 bash[22676]: cluster 2024-09-21T04:04:53.254469+0000 mgr.a (mgr.14388) 15169 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:56 smithi179 bash[23186]: cluster 2024-09-21T04:04:55.256626+0000 mgr.a (mgr.14388) 15170 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:56 smithi049 bash[23528]: cluster 2024-09-21T04:04:55.256626+0000 mgr.a (mgr.14388) 15170 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:57.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:56 smithi044 bash[22676]: cluster 2024-09-21T04:04:55.256626+0000 mgr.a (mgr.14388) 15170 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:04:58.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:04:58.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:04:58.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:04:58.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:04:58.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:04:58.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:04:58.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:04:58.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:04:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:58 smithi049 bash[23528]: cluster 2024-09-21T04:04:57.257404+0000 mgr.a (mgr.14388) 15171 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:58 smithi044 bash[22676]: cluster 2024-09-21T04:04:57.257404+0000 mgr.a (mgr.14388) 15171 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:04:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:58 smithi179 bash[23186]: cluster 2024-09-21T04:04:57.257404+0000 mgr.a (mgr.14388) 15171 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:59 smithi049 bash[23528]: audit 2024-09-21T04:04:58.549380+0000 mgr.a (mgr.14388) 15172 : audit [DBG] from='client.328503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:59 smithi049 bash[23528]: audit 2024-09-21T04:04:59.101294+0000 mon.a (mon.0) 12172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:59 smithi049 bash[23528]: audit 2024-09-21T04:04:59.109548+0000 mon.a (mon.0) 12173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:04:59 smithi049 bash[23528]: audit 2024-09-21T04:04:59.119579+0000 mon.a (mon.0) 12174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:59 smithi044 bash[22676]: audit 2024-09-21T04:04:58.549380+0000 mgr.a (mgr.14388) 15172 : audit [DBG] from='client.328503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:59 smithi044 bash[22676]: audit 2024-09-21T04:04:59.101294+0000 mon.a (mon.0) 12172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:59 smithi044 bash[22676]: audit 2024-09-21T04:04:59.109548+0000 mon.a (mon.0) 12173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:04:59 smithi044 bash[22676]: audit 2024-09-21T04:04:59.119579+0000 mon.a (mon.0) 12174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:59 smithi179 bash[23186]: audit 2024-09-21T04:04:58.549380+0000 mgr.a (mgr.14388) 15172 : audit [DBG] from='client.328503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:59 smithi179 bash[23186]: audit 2024-09-21T04:04:59.101294+0000 mon.a (mon.0) 12172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:59 smithi179 bash[23186]: audit 2024-09-21T04:04:59.109548+0000 mon.a (mon.0) 12173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:04:59 smithi179 bash[23186]: audit 2024-09-21T04:04:59.119579+0000 mon.a (mon.0) 12174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:00 smithi049 bash[23528]: cluster 2024-09-21T04:04:59.258238+0000 mgr.a (mgr.14388) 15173 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:01.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:00 smithi179 bash[23186]: cluster 2024-09-21T04:04:59.258238+0000 mgr.a (mgr.14388) 15173 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:01.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:00 smithi044 bash[22676]: cluster 2024-09-21T04:04:59.258238+0000 mgr.a (mgr.14388) 15173 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:02 smithi049 bash[23528]: cluster 2024-09-21T04:05:01.260495+0000 mgr.a (mgr.14388) 15174 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:02 smithi044 bash[22676]: cluster 2024-09-21T04:05:01.260495+0000 mgr.a (mgr.14388) 15174 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:02 smithi179 bash[23186]: cluster 2024-09-21T04:05:01.260495+0000 mgr.a (mgr.14388) 15174 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:03.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:03.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:03.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:04.761 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:04.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:04.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:04.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:04.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:04 smithi044 bash[22676]: cluster 2024-09-21T04:05:03.261322+0000 mgr.a (mgr.14388) 15175 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:04 smithi049 bash[23528]: cluster 2024-09-21T04:05:03.261322+0000 mgr.a (mgr.14388) 15175 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:04 smithi179 bash[23186]: cluster 2024-09-21T04:05:03.261322+0000 mgr.a (mgr.14388) 15175 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:06.197 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:05 smithi044 bash[22676]: audit 2024-09-21T04:05:04.312275+0000 mgr.a (mgr.14388) 15176 : audit [DBG] from='client.328581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:05 smithi179 bash[23186]: audit 2024-09-21T04:05:04.312275+0000 mgr.a (mgr.14388) 15176 : audit [DBG] from='client.328581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:06.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:05 smithi049 bash[23528]: audit 2024-09-21T04:05:04.312275+0000 mgr.a (mgr.14388) 15176 : audit [DBG] from='client.328581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:06 smithi049 bash[23528]: cluster 2024-09-21T04:05:05.263580+0000 mgr.a (mgr.14388) 15177 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:06 smithi044 bash[22676]: cluster 2024-09-21T04:05:05.263580+0000 mgr.a (mgr.14388) 15177 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:06 smithi179 bash[23186]: cluster 2024-09-21T04:05:05.263580+0000 mgr.a (mgr.14388) 15177 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:08 smithi044 bash[22676]: cluster 2024-09-21T04:05:07.264360+0000 mgr.a (mgr.14388) 15178 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:08 smithi179 bash[23186]: cluster 2024-09-21T04:05:07.264360+0000 mgr.a (mgr.14388) 15178 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:08 smithi049 bash[23528]: cluster 2024-09-21T04:05:07.264360+0000 mgr.a (mgr.14388) 15178 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:09.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:09.764 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:09.764 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:09 smithi044 bash[22676]: cluster 2024-09-21T04:05:09.265135+0000 mgr.a (mgr.14388) 15179 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:09 smithi179 bash[23186]: cluster 2024-09-21T04:05:09.265135+0000 mgr.a (mgr.14388) 15179 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:10.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:09 smithi049 bash[23528]: cluster 2024-09-21T04:05:09.265135+0000 mgr.a (mgr.14388) 15179 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:10.531 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:10.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:10.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:10.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:10.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:11 smithi044 bash[22676]: audit 2024-09-21T04:05:10.100274+0000 mgr.a (mgr.14388) 15180 : audit [DBG] from='client.328659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:11 smithi044 bash[22676]: audit 2024-09-21T04:05:10.800708+0000 mon.a (mon.0) 12175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:11 smithi044 bash[22676]: audit 2024-09-21T04:05:10.807106+0000 mon.a (mon.0) 12176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:11 smithi044 bash[22676]: audit 2024-09-21T04:05:10.814656+0000 mon.a (mon.0) 12177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:11 smithi044 bash[22676]: audit 2024-09-21T04:05:10.973590+0000 mon.a (mon.0) 12178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:11 smithi044 bash[22676]: audit 2024-09-21T04:05:10.981747+0000 mon.a (mon.0) 12179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:11 smithi044 bash[22676]: audit 2024-09-21T04:05:10.990380+0000 mon.a (mon.0) 12180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:11 smithi179 bash[23186]: audit 2024-09-21T04:05:10.100274+0000 mgr.a (mgr.14388) 15180 : audit [DBG] from='client.328659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:11 smithi179 bash[23186]: audit 2024-09-21T04:05:10.800708+0000 mon.a (mon.0) 12175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:11 smithi179 bash[23186]: audit 2024-09-21T04:05:10.807106+0000 mon.a (mon.0) 12176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:11 smithi179 bash[23186]: audit 2024-09-21T04:05:10.814656+0000 mon.a (mon.0) 12177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:11 smithi179 bash[23186]: audit 2024-09-21T04:05:10.973590+0000 mon.a (mon.0) 12178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:11 smithi179 bash[23186]: audit 2024-09-21T04:05:10.981747+0000 mon.a (mon.0) 12179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:11 smithi179 bash[23186]: audit 2024-09-21T04:05:10.990380+0000 mon.a (mon.0) 12180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:11 smithi049 bash[23528]: audit 2024-09-21T04:05:10.100274+0000 mgr.a (mgr.14388) 15180 : audit [DBG] from='client.328659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:11 smithi049 bash[23528]: audit 2024-09-21T04:05:10.800708+0000 mon.a (mon.0) 12175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:11 smithi049 bash[23528]: audit 2024-09-21T04:05:10.807106+0000 mon.a (mon.0) 12176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:11 smithi049 bash[23528]: audit 2024-09-21T04:05:10.814656+0000 mon.a (mon.0) 12177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:11 smithi049 bash[23528]: audit 2024-09-21T04:05:10.973590+0000 mon.a (mon.0) 12178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:11 smithi049 bash[23528]: audit 2024-09-21T04:05:10.981747+0000 mon.a (mon.0) 12179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:11 smithi049 bash[23528]: audit 2024-09-21T04:05:10.990380+0000 mon.a (mon.0) 12180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:13.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:12 smithi044 bash[22676]: cluster 2024-09-21T04:05:11.267930+0000 mgr.a (mgr.14388) 15181 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:12 smithi179 bash[23186]: cluster 2024-09-21T04:05:11.267930+0000 mgr.a (mgr.14388) 15181 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:12 smithi049 bash[23528]: cluster 2024-09-21T04:05:11.267930+0000 mgr.a (mgr.14388) 15181 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:14 smithi044 bash[22676]: cluster 2024-09-21T04:05:13.268715+0000 mgr.a (mgr.14388) 15182 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:14 smithi179 bash[23186]: cluster 2024-09-21T04:05:13.268715+0000 mgr.a (mgr.14388) 15182 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:14 smithi049 bash[23528]: cluster 2024-09-21T04:05:13.268715+0000 mgr.a (mgr.14388) 15182 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:15.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:15.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:15.534 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:16.286 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:16.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:16 smithi044 bash[22676]: cluster 2024-09-21T04:05:15.270692+0000 mgr.a (mgr.14388) 15183 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:16 smithi179 bash[23186]: cluster 2024-09-21T04:05:15.270692+0000 mgr.a (mgr.14388) 15183 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:16 smithi049 bash[23528]: cluster 2024-09-21T04:05:15.270692+0000 mgr.a (mgr.14388) 15183 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:18.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:17 smithi044 bash[22676]: audit 2024-09-21T04:05:15.859021+0000 mgr.a (mgr.14388) 15184 : audit [DBG] from='client.328737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:17 smithi179 bash[23186]: audit 2024-09-21T04:05:15.859021+0000 mgr.a (mgr.14388) 15184 : audit [DBG] from='client.328737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:18.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:17 smithi049 bash[23528]: audit 2024-09-21T04:05:15.859021+0000 mgr.a (mgr.14388) 15184 : audit [DBG] from='client.328737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:18 smithi044 bash[22676]: cluster 2024-09-21T04:05:17.271582+0000 mgr.a (mgr.14388) 15185 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:18 smithi179 bash[23186]: cluster 2024-09-21T04:05:17.271582+0000 mgr.a (mgr.14388) 15185 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:18 smithi049 bash[23528]: cluster 2024-09-21T04:05:17.271582+0000 mgr.a (mgr.14388) 15185 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:20 smithi044 bash[22676]: cluster 2024-09-21T04:05:19.272345+0000 mgr.a (mgr.14388) 15186 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:05:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:20 smithi044 bash[22676]: audit 2024-09-21T04:05:19.309043+0000 mon.a (mon.0) 12181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:20 smithi044 bash[22676]: audit 2024-09-21T04:05:19.317760+0000 mon.a (mon.0) 12182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:20 smithi044 bash[22676]: audit 2024-09-21T04:05:19.328390+0000 mon.a (mon.0) 12183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:20 smithi179 bash[23186]: cluster 2024-09-21T04:05:19.272345+0000 mgr.a (mgr.14388) 15186 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:05:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:20 smithi179 bash[23186]: audit 2024-09-21T04:05:19.309043+0000 mon.a (mon.0) 12181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:20 smithi179 bash[23186]: audit 2024-09-21T04:05:19.317760+0000 mon.a (mon.0) 12182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:20 smithi179 bash[23186]: audit 2024-09-21T04:05:19.328390+0000 mon.a (mon.0) 12183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:20 smithi049 bash[23528]: cluster 2024-09-21T04:05:19.272345+0000 mgr.a (mgr.14388) 15186 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:05:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:20 smithi049 bash[23528]: audit 2024-09-21T04:05:19.309043+0000 mon.a (mon.0) 12181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:20 smithi049 bash[23528]: audit 2024-09-21T04:05:19.317760+0000 mon.a (mon.0) 12182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:20 smithi049 bash[23528]: audit 2024-09-21T04:05:19.328390+0000 mon.a (mon.0) 12183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:21.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:21.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:21.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:22.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:22.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:22 smithi044 bash[22676]: cluster 2024-09-21T04:05:21.274585+0000 mgr.a (mgr.14388) 15187 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:22 smithi044 bash[22676]: audit 2024-09-21T04:05:21.622078+0000 mgr.a (mgr.14388) 15188 : audit [DBG] from='client.328812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:22 smithi179 bash[23186]: cluster 2024-09-21T04:05:21.274585+0000 mgr.a (mgr.14388) 15187 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:22 smithi179 bash[23186]: audit 2024-09-21T04:05:21.622078+0000 mgr.a (mgr.14388) 15188 : audit [DBG] from='client.328812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:22 smithi049 bash[23528]: cluster 2024-09-21T04:05:21.274585+0000 mgr.a (mgr.14388) 15187 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:22 smithi049 bash[23528]: audit 2024-09-21T04:05:21.622078+0000 mgr.a (mgr.14388) 15188 : audit [DBG] from='client.328812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:24.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:24 smithi049 bash[23528]: cluster 2024-09-21T04:05:23.275463+0000 mgr.a (mgr.14388) 15189 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:24.570 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:24 smithi044 bash[22676]: cluster 2024-09-21T04:05:23.275463+0000 mgr.a (mgr.14388) 15189 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:24 smithi179 bash[23186]: cluster 2024-09-21T04:05:23.275463+0000 mgr.a (mgr.14388) 15189 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:26 smithi044 bash[22676]: cluster 2024-09-21T04:05:25.277741+0000 mgr.a (mgr.14388) 15190 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:26 smithi179 bash[23186]: cluster 2024-09-21T04:05:25.277741+0000 mgr.a (mgr.14388) 15190 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:26.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:26 smithi049 bash[23528]: cluster 2024-09-21T04:05:25.277741+0000 mgr.a (mgr.14388) 15190 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:27.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:27.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:27.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:27.827 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:27.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:27.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:27.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:27.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:28 smithi044 bash[22676]: cluster 2024-09-21T04:05:27.278472+0000 mgr.a (mgr.14388) 15191 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:28 smithi044 bash[22676]: audit 2024-09-21T04:05:27.399170+0000 mgr.a (mgr.14388) 15192 : audit [DBG] from='client.328887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:28 smithi179 bash[23186]: cluster 2024-09-21T04:05:27.278472+0000 mgr.a (mgr.14388) 15191 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:28 smithi179 bash[23186]: audit 2024-09-21T04:05:27.399170+0000 mgr.a (mgr.14388) 15192 : audit [DBG] from='client.328887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:28 smithi049 bash[23528]: cluster 2024-09-21T04:05:27.278472+0000 mgr.a (mgr.14388) 15191 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:28 smithi049 bash[23528]: audit 2024-09-21T04:05:27.399170+0000 mgr.a (mgr.14388) 15192 : audit [DBG] from='client.328887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:30 smithi044 bash[22676]: cluster 2024-09-21T04:05:29.279462+0000 mgr.a (mgr.14388) 15193 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:30 smithi179 bash[23186]: cluster 2024-09-21T04:05:29.279462+0000 mgr.a (mgr.14388) 15193 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:30 smithi049 bash[23528]: cluster 2024-09-21T04:05:29.279462+0000 mgr.a (mgr.14388) 15193 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:32 smithi049 bash[23528]: audit 2024-09-21T04:05:31.023028+0000 mon.a (mon.0) 12184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:32 smithi049 bash[23528]: audit 2024-09-21T04:05:31.031569+0000 mon.a (mon.0) 12185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:32 smithi049 bash[23528]: audit 2024-09-21T04:05:31.041275+0000 mon.a (mon.0) 12186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:32 smithi049 bash[23528]: audit 2024-09-21T04:05:31.152585+0000 mon.a (mon.0) 12187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:32 smithi049 bash[23528]: audit 2024-09-21T04:05:31.160770+0000 mon.a (mon.0) 12188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:32 smithi049 bash[23528]: audit 2024-09-21T04:05:31.166975+0000 mon.a (mon.0) 12189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:32 smithi049 bash[23528]: cluster 2024-09-21T04:05:31.281873+0000 mgr.a (mgr.14388) 15194 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:32 smithi044 bash[22676]: audit 2024-09-21T04:05:31.023028+0000 mon.a (mon.0) 12184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:32 smithi044 bash[22676]: audit 2024-09-21T04:05:31.031569+0000 mon.a (mon.0) 12185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:32 smithi044 bash[22676]: audit 2024-09-21T04:05:31.041275+0000 mon.a (mon.0) 12186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:32 smithi044 bash[22676]: audit 2024-09-21T04:05:31.152585+0000 mon.a (mon.0) 12187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:32 smithi044 bash[22676]: audit 2024-09-21T04:05:31.160770+0000 mon.a (mon.0) 12188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:32 smithi044 bash[22676]: audit 2024-09-21T04:05:31.166975+0000 mon.a (mon.0) 12189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:32 smithi044 bash[22676]: cluster 2024-09-21T04:05:31.281873+0000 mgr.a (mgr.14388) 15194 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:32 smithi179 bash[23186]: audit 2024-09-21T04:05:31.023028+0000 mon.a (mon.0) 12184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:32 smithi179 bash[23186]: audit 2024-09-21T04:05:31.031569+0000 mon.a (mon.0) 12185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:32 smithi179 bash[23186]: audit 2024-09-21T04:05:31.041275+0000 mon.a (mon.0) 12186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:32 smithi179 bash[23186]: audit 2024-09-21T04:05:31.152585+0000 mon.a (mon.0) 12187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:32 smithi179 bash[23186]: audit 2024-09-21T04:05:31.160770+0000 mon.a (mon.0) 12188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:32 smithi179 bash[23186]: audit 2024-09-21T04:05:31.166975+0000 mon.a (mon.0) 12189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:32 smithi179 bash[23186]: cluster 2024-09-21T04:05:31.281873+0000 mgr.a (mgr.14388) 15194 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:05:32.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:32.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:32.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:33 smithi044 bash[22676]: audit 2024-09-21T04:05:32.798567+0000 mon.a (mon.0) 12190 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:05:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:33 smithi179 bash[23186]: audit 2024-09-21T04:05:32.798567+0000 mon.a (mon.0) 12190 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:05:33.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:33 smithi049 bash[23528]: audit 2024-09-21T04:05:32.798567+0000 mon.a (mon.0) 12190 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:05:33.613 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:33.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:34.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22930]: debug 2024-09-21T04:05:34.325+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:05:34.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22930]: debug 2024-09-21T04:05:34.325+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:05:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.169428+0000 mgr.a (mgr.14388) 15195 : audit [DBG] from='client.328962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: cluster 2024-09-21T04:05:33.282422+0000 mgr.a (mgr.14388) 15196 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.424982+0000 mon.a (mon.0) 12191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.430755+0000 mon.a (mon.0) 12192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.435368+0000 mon.a (mon.0) 12193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.441117+0000 mon.a (mon.0) 12194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.442196+0000 mon.a (mon.0) 12195 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:05:34.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.443053+0000 mon.a (mon.0) 12196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:05:34.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.448111+0000 mon.a (mon.0) 12197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.450487+0000 mon.a (mon.0) 12198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:05:34.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:34 smithi044 bash[22676]: audit 2024-09-21T04:05:33.451629+0000 mgr.a (mgr.14388) 15197 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.169428+0000 mgr.a (mgr.14388) 15195 : audit [DBG] from='client.328962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: cluster 2024-09-21T04:05:33.282422+0000 mgr.a (mgr.14388) 15196 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.424982+0000 mon.a (mon.0) 12191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.430755+0000 mon.a (mon.0) 12192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.435368+0000 mon.a (mon.0) 12193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.441117+0000 mon.a (mon.0) 12194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.442196+0000 mon.a (mon.0) 12195 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:05:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.443053+0000 mon.a (mon.0) 12196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:05:34.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.448111+0000 mon.a (mon.0) 12197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.450487+0000 mon.a (mon.0) 12198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:05:34.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:34 smithi179 bash[23186]: audit 2024-09-21T04:05:33.451629+0000 mgr.a (mgr.14388) 15197 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:05:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.169428+0000 mgr.a (mgr.14388) 15195 : audit [DBG] from='client.328962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: cluster 2024-09-21T04:05:33.282422+0000 mgr.a (mgr.14388) 15196 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.424982+0000 mon.a (mon.0) 12191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.430755+0000 mon.a (mon.0) 12192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.435368+0000 mon.a (mon.0) 12193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.441117+0000 mon.a (mon.0) 12194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.442196+0000 mon.a (mon.0) 12195 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.443053+0000 mon.a (mon.0) 12196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.448111+0000 mon.a (mon.0) 12197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.450487+0000 mon.a (mon.0) 12198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:05:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:34 smithi049 bash[23528]: audit 2024-09-21T04:05:33.451629+0000 mgr.a (mgr.14388) 15197 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:05:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:35 smithi044 bash[22676]: audit 2024-09-21T04:05:34.329294+0000 mgr.a (mgr.14388) 15198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:05:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:35 smithi044 bash[22676]: cephadm 2024-09-21T04:05:34.330455+0000 mgr.a (mgr.14388) 15199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:05:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:35 smithi179 bash[23186]: audit 2024-09-21T04:05:34.329294+0000 mgr.a (mgr.14388) 15198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:05:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:35 smithi179 bash[23186]: cephadm 2024-09-21T04:05:34.330455+0000 mgr.a (mgr.14388) 15199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:05:35.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:35 smithi049 bash[23528]: audit 2024-09-21T04:05:34.329294+0000 mgr.a (mgr.14388) 15198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:05:35.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:35 smithi049 bash[23528]: cephadm 2024-09-21T04:05:34.330455+0000 mgr.a (mgr.14388) 15199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:05:36.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:36 smithi179 bash[23186]: cluster 2024-09-21T04:05:35.284884+0000 mgr.a (mgr.14388) 15200 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:36 smithi044 bash[22676]: cluster 2024-09-21T04:05:35.284884+0000 mgr.a (mgr.14388) 15200 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:36 smithi049 bash[23528]: cluster 2024-09-21T04:05:35.284884+0000 mgr.a (mgr.14388) 15200 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:38.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:38.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:38.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:38 smithi044 bash[22676]: cluster 2024-09-21T04:05:37.285891+0000 mgr.a (mgr.14388) 15201 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:38.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:38 smithi179 bash[23186]: cluster 2024-09-21T04:05:37.285891+0000 mgr.a (mgr.14388) 15201 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:38.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:38 smithi049 bash[23528]: cluster 2024-09-21T04:05:37.285891+0000 mgr.a (mgr.14388) 15201 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:39.396 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:39.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:39.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:39.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:39.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:40 smithi049 bash[23528]: audit 2024-09-21T04:05:38.945176+0000 mgr.a (mgr.14388) 15202 : audit [DBG] from='client.329142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:40 smithi049 bash[23528]: cluster 2024-09-21T04:05:39.293000+0000 mgr.a (mgr.14388) 15203 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:40 smithi049 bash[23528]: audit 2024-09-21T04:05:39.543923+0000 mon.a (mon.0) 12199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:40 smithi049 bash[23528]: audit 2024-09-21T04:05:39.553373+0000 mon.a (mon.0) 12200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:40 smithi049 bash[23528]: audit 2024-09-21T04:05:39.564849+0000 mon.a (mon.0) 12201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:40 smithi044 bash[22676]: audit 2024-09-21T04:05:38.945176+0000 mgr.a (mgr.14388) 15202 : audit [DBG] from='client.329142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:40 smithi044 bash[22676]: cluster 2024-09-21T04:05:39.293000+0000 mgr.a (mgr.14388) 15203 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:40 smithi044 bash[22676]: audit 2024-09-21T04:05:39.543923+0000 mon.a (mon.0) 12199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:40 smithi044 bash[22676]: audit 2024-09-21T04:05:39.553373+0000 mon.a (mon.0) 12200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:40 smithi044 bash[22676]: audit 2024-09-21T04:05:39.564849+0000 mon.a (mon.0) 12201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:40 smithi179 bash[23186]: audit 2024-09-21T04:05:38.945176+0000 mgr.a (mgr.14388) 15202 : audit [DBG] from='client.329142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:40 smithi179 bash[23186]: cluster 2024-09-21T04:05:39.293000+0000 mgr.a (mgr.14388) 15203 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:40 smithi179 bash[23186]: audit 2024-09-21T04:05:39.543923+0000 mon.a (mon.0) 12199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:40 smithi179 bash[23186]: audit 2024-09-21T04:05:39.553373+0000 mon.a (mon.0) 12200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:40 smithi179 bash[23186]: audit 2024-09-21T04:05:39.564849+0000 mon.a (mon.0) 12201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:42 smithi049 bash[23528]: cluster 2024-09-21T04:05:41.295294+0000 mgr.a (mgr.14388) 15204 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:42 smithi044 bash[22676]: cluster 2024-09-21T04:05:41.295294+0000 mgr.a (mgr.14388) 15204 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:42 smithi179 bash[23186]: cluster 2024-09-21T04:05:41.295294+0000 mgr.a (mgr.14388) 15204 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:44.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:44.400 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:44.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:44.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:44 smithi049 bash[23528]: cluster 2024-09-21T04:05:43.296065+0000 mgr.a (mgr.14388) 15205 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:44.838 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:44 smithi044 bash[22676]: cluster 2024-09-21T04:05:43.296065+0000 mgr.a (mgr.14388) 15205 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:44 smithi179 bash[23186]: cluster 2024-09-21T04:05:43.296065+0000 mgr.a (mgr.14388) 15205 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:45.153 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:45.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:45.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:45.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:45.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:45.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:45 smithi049 bash[23528]: audit 2024-09-21T04:05:44.737719+0000 mgr.a (mgr.14388) 15206 : audit [DBG] from='client.329220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:45 smithi044 bash[22676]: audit 2024-09-21T04:05:44.737719+0000 mgr.a (mgr.14388) 15206 : audit [DBG] from='client.329220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:45 smithi179 bash[23186]: audit 2024-09-21T04:05:44.737719+0000 mgr.a (mgr.14388) 15206 : audit [DBG] from='client.329220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:46.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:46 smithi049 bash[23528]: cluster 2024-09-21T04:05:45.298989+0000 mgr.a (mgr.14388) 15207 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:46 smithi044 bash[22676]: cluster 2024-09-21T04:05:45.298989+0000 mgr.a (mgr.14388) 15207 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:46 smithi179 bash[23186]: cluster 2024-09-21T04:05:45.298989+0000 mgr.a (mgr.14388) 15207 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:05:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:48 smithi044 bash[22676]: cluster 2024-09-21T04:05:47.299740+0000 mgr.a (mgr.14388) 15208 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:48 smithi179 bash[23186]: cluster 2024-09-21T04:05:47.299740+0000 mgr.a (mgr.14388) 15208 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:48 smithi049 bash[23528]: cluster 2024-09-21T04:05:47.299740+0000 mgr.a (mgr.14388) 15208 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:50.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:50.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:50.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:50.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:50.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:50.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:50 smithi044 bash[22676]: cluster 2024-09-21T04:05:49.300503+0000 mgr.a (mgr.14388) 15209 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:50 smithi179 bash[23186]: cluster 2024-09-21T04:05:49.300503+0000 mgr.a (mgr.14388) 15209 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:50 smithi049 bash[23528]: cluster 2024-09-21T04:05:49.300503+0000 mgr.a (mgr.14388) 15209 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:51 smithi044 bash[22676]: audit 2024-09-21T04:05:50.483849+0000 mgr.a (mgr.14388) 15210 : audit [DBG] from='client.329298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:51 smithi044 bash[22676]: audit 2024-09-21T04:05:51.225407+0000 mon.a (mon.0) 12202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:51 smithi044 bash[22676]: audit 2024-09-21T04:05:51.231334+0000 mon.a (mon.0) 12203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:51 smithi044 bash[22676]: audit 2024-09-21T04:05:51.237459+0000 mon.a (mon.0) 12204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:51 smithi044 bash[22676]: audit 2024-09-21T04:05:51.376908+0000 mon.a (mon.0) 12205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:51 smithi044 bash[22676]: audit 2024-09-21T04:05:51.383704+0000 mon.a (mon.0) 12206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:51 smithi044 bash[22676]: audit 2024-09-21T04:05:51.392699+0000 mon.a (mon.0) 12207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:51 smithi179 bash[23186]: audit 2024-09-21T04:05:50.483849+0000 mgr.a (mgr.14388) 15210 : audit [DBG] from='client.329298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:51 smithi179 bash[23186]: audit 2024-09-21T04:05:51.225407+0000 mon.a (mon.0) 12202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:51 smithi179 bash[23186]: audit 2024-09-21T04:05:51.231334+0000 mon.a (mon.0) 12203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:51 smithi179 bash[23186]: audit 2024-09-21T04:05:51.237459+0000 mon.a (mon.0) 12204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:51 smithi179 bash[23186]: audit 2024-09-21T04:05:51.376908+0000 mon.a (mon.0) 12205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:51 smithi179 bash[23186]: audit 2024-09-21T04:05:51.383704+0000 mon.a (mon.0) 12206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:51 smithi179 bash[23186]: audit 2024-09-21T04:05:51.392699+0000 mon.a (mon.0) 12207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:51 smithi049 bash[23528]: audit 2024-09-21T04:05:50.483849+0000 mgr.a (mgr.14388) 15210 : audit [DBG] from='client.329298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:51 smithi049 bash[23528]: audit 2024-09-21T04:05:51.225407+0000 mon.a (mon.0) 12202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:51 smithi049 bash[23528]: audit 2024-09-21T04:05:51.231334+0000 mon.a (mon.0) 12203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:51 smithi049 bash[23528]: audit 2024-09-21T04:05:51.237459+0000 mon.a (mon.0) 12204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:51 smithi049 bash[23528]: audit 2024-09-21T04:05:51.376908+0000 mon.a (mon.0) 12205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:51 smithi049 bash[23528]: audit 2024-09-21T04:05:51.383704+0000 mon.a (mon.0) 12206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:51 smithi049 bash[23528]: audit 2024-09-21T04:05:51.392699+0000 mon.a (mon.0) 12207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:05:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:52 smithi044 bash[22676]: cluster 2024-09-21T04:05:51.302664+0000 mgr.a (mgr.14388) 15211 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:52 smithi179 bash[23186]: cluster 2024-09-21T04:05:51.302664+0000 mgr.a (mgr.14388) 15211 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:52 smithi049 bash[23528]: cluster 2024-09-21T04:05:51.302664+0000 mgr.a (mgr.14388) 15211 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:05:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:54 smithi044 bash[22676]: cluster 2024-09-21T04:05:53.303455+0000 mgr.a (mgr.14388) 15212 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:54 smithi179 bash[23186]: cluster 2024-09-21T04:05:53.303455+0000 mgr.a (mgr.14388) 15212 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:54 smithi049 bash[23528]: cluster 2024-09-21T04:05:53.303455+0000 mgr.a (mgr.14388) 15212 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:05:55.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:05:55.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:05:55.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:05:56.688 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:05:56.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:05:56.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:05:56.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:05:56.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:05:56.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:56 smithi179 bash[23186]: cluster 2024-09-21T04:05:55.305475+0000 mgr.a (mgr.14388) 15213 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:05:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:56 smithi044 bash[22676]: cluster 2024-09-21T04:05:55.305475+0000 mgr.a (mgr.14388) 15213 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:05:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:56 smithi049 bash[23528]: cluster 2024-09-21T04:05:55.305475+0000 mgr.a (mgr.14388) 15213 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:05:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:57 smithi179 bash[23186]: audit 2024-09-21T04:05:56.254872+0000 mgr.a (mgr.14388) 15214 : audit [DBG] from='client.329373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:57 smithi044 bash[22676]: audit 2024-09-21T04:05:56.254872+0000 mgr.a (mgr.14388) 15214 : audit [DBG] from='client.329373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:58.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:57 smithi049 bash[23528]: audit 2024-09-21T04:05:56.254872+0000 mgr.a (mgr.14388) 15214 : audit [DBG] from='client.329373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:05:58 smithi179 bash[23186]: cluster 2024-09-21T04:05:57.306491+0000 mgr.a (mgr.14388) 15215 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:05:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:05:58 smithi044 bash[22676]: cluster 2024-09-21T04:05:57.306491+0000 mgr.a (mgr.14388) 15215 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:05:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:05:58 smithi049 bash[23528]: cluster 2024-09-21T04:05:57.306491+0000 mgr.a (mgr.14388) 15215 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:00 smithi049 bash[23528]: cluster 2024-09-21T04:05:59.307322+0000 mgr.a (mgr.14388) 15216 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:00 smithi049 bash[23528]: audit 2024-09-21T04:05:59.776315+0000 mon.a (mon.0) 12208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:00 smithi049 bash[23528]: audit 2024-09-21T04:05:59.786166+0000 mon.a (mon.0) 12209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:00 smithi049 bash[23528]: audit 2024-09-21T04:05:59.796712+0000 mon.a (mon.0) 12210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:00 smithi044 bash[22676]: cluster 2024-09-21T04:05:59.307322+0000 mgr.a (mgr.14388) 15216 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:00 smithi044 bash[22676]: audit 2024-09-21T04:05:59.776315+0000 mon.a (mon.0) 12208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:00 smithi044 bash[22676]: audit 2024-09-21T04:05:59.786166+0000 mon.a (mon.0) 12209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:00 smithi044 bash[22676]: audit 2024-09-21T04:05:59.796712+0000 mon.a (mon.0) 12210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:00 smithi179 bash[23186]: cluster 2024-09-21T04:05:59.307322+0000 mgr.a (mgr.14388) 15216 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:00 smithi179 bash[23186]: audit 2024-09-21T04:05:59.776315+0000 mon.a (mon.0) 12208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:00 smithi179 bash[23186]: audit 2024-09-21T04:05:59.786166+0000 mon.a (mon.0) 12209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:00 smithi179 bash[23186]: audit 2024-09-21T04:05:59.796712+0000 mon.a (mon.0) 12210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:01.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:01.691 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:02.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:02.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:02.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:02.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:02.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:02 smithi049 bash[23528]: cluster 2024-09-21T04:06:01.309583+0000 mgr.a (mgr.14388) 15217 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:02 smithi044 bash[22676]: cluster 2024-09-21T04:06:01.309583+0000 mgr.a (mgr.14388) 15217 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:02 smithi179 bash[23186]: cluster 2024-09-21T04:06:01.309583+0000 mgr.a (mgr.14388) 15217 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:03 smithi049 bash[23528]: audit 2024-09-21T04:06:02.021857+0000 mgr.a (mgr.14388) 15218 : audit [DBG] from='client.329448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:03 smithi044 bash[22676]: audit 2024-09-21T04:06:02.021857+0000 mgr.a (mgr.14388) 15218 : audit [DBG] from='client.329448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:03 smithi179 bash[23186]: audit 2024-09-21T04:06:02.021857+0000 mgr.a (mgr.14388) 15218 : audit [DBG] from='client.329448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:04 smithi049 bash[23528]: cluster 2024-09-21T04:06:03.310584+0000 mgr.a (mgr.14388) 15219 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:05.068 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:04 smithi044 bash[22676]: cluster 2024-09-21T04:06:03.310584+0000 mgr.a (mgr.14388) 15219 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:04 smithi179 bash[23186]: cluster 2024-09-21T04:06:03.310584+0000 mgr.a (mgr.14388) 15219 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:06:06.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:06 smithi044 bash[22676]: cluster 2024-09-21T04:06:05.312897+0000 mgr.a (mgr.14388) 15220 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:06:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:06 smithi049 bash[23528]: cluster 2024-09-21T04:06:05.312897+0000 mgr.a (mgr.14388) 15220 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:06:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:06 smithi179 bash[23186]: cluster 2024-09-21T04:06:05.312897+0000 mgr.a (mgr.14388) 15220 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:06:07.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:07.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:07.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:08.221 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:08 smithi049 bash[23528]: cluster 2024-09-21T04:06:07.313702+0000 mgr.a (mgr.14388) 15221 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:08 smithi049 bash[23528]: audit 2024-09-21T04:06:07.799183+0000 mgr.a (mgr.14388) 15222 : audit [DBG] from='client.329523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:08 smithi044 bash[22676]: cluster 2024-09-21T04:06:07.313702+0000 mgr.a (mgr.14388) 15221 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:08 smithi044 bash[22676]: audit 2024-09-21T04:06:07.799183+0000 mgr.a (mgr.14388) 15222 : audit [DBG] from='client.329523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:08 smithi179 bash[23186]: cluster 2024-09-21T04:06:07.313702+0000 mgr.a (mgr.14388) 15221 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:08 smithi179 bash[23186]: audit 2024-09-21T04:06:07.799183+0000 mgr.a (mgr.14388) 15222 : audit [DBG] from='client.329523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:10 smithi044 bash[22676]: cluster 2024-09-21T04:06:09.314692+0000 mgr.a (mgr.14388) 15223 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:10 smithi179 bash[23186]: cluster 2024-09-21T04:06:09.314692+0000 mgr.a (mgr.14388) 15223 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:10 smithi049 bash[23528]: cluster 2024-09-21T04:06:09.314692+0000 mgr.a (mgr.14388) 15223 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:12 smithi044 bash[22676]: cluster 2024-09-21T04:06:11.317006+0000 mgr.a (mgr.14388) 15224 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:06:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:12 smithi044 bash[22676]: audit 2024-09-21T04:06:11.413280+0000 mon.a (mon.0) 12211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:12 smithi044 bash[22676]: audit 2024-09-21T04:06:11.419787+0000 mon.a (mon.0) 12212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:12 smithi044 bash[22676]: audit 2024-09-21T04:06:11.425920+0000 mon.a (mon.0) 12213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:12 smithi044 bash[22676]: audit 2024-09-21T04:06:11.549331+0000 mon.a (mon.0) 12214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:12 smithi044 bash[22676]: audit 2024-09-21T04:06:11.555463+0000 mon.a (mon.0) 12215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:12 smithi044 bash[22676]: audit 2024-09-21T04:06:11.561522+0000 mon.a (mon.0) 12216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:12 smithi179 bash[23186]: cluster 2024-09-21T04:06:11.317006+0000 mgr.a (mgr.14388) 15224 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:06:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:12 smithi179 bash[23186]: audit 2024-09-21T04:06:11.413280+0000 mon.a (mon.0) 12211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:12 smithi179 bash[23186]: audit 2024-09-21T04:06:11.419787+0000 mon.a (mon.0) 12212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:12 smithi179 bash[23186]: audit 2024-09-21T04:06:11.425920+0000 mon.a (mon.0) 12213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:12 smithi179 bash[23186]: audit 2024-09-21T04:06:11.549331+0000 mon.a (mon.0) 12214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:12 smithi179 bash[23186]: audit 2024-09-21T04:06:11.555463+0000 mon.a (mon.0) 12215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:12 smithi179 bash[23186]: audit 2024-09-21T04:06:11.561522+0000 mon.a (mon.0) 12216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:12 smithi049 bash[23528]: cluster 2024-09-21T04:06:11.317006+0000 mgr.a (mgr.14388) 15224 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:06:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:12 smithi049 bash[23528]: audit 2024-09-21T04:06:11.413280+0000 mon.a (mon.0) 12211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:12 smithi049 bash[23528]: audit 2024-09-21T04:06:11.419787+0000 mon.a (mon.0) 12212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:12 smithi049 bash[23528]: audit 2024-09-21T04:06:11.425920+0000 mon.a (mon.0) 12213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:12 smithi049 bash[23528]: audit 2024-09-21T04:06:11.549331+0000 mon.a (mon.0) 12214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:12 smithi049 bash[23528]: audit 2024-09-21T04:06:11.555463+0000 mon.a (mon.0) 12215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:12 smithi049 bash[23528]: audit 2024-09-21T04:06:11.561522+0000 mon.a (mon.0) 12216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:13.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:13.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:14.026 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:14.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:14.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:14.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:14.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:14 smithi044 bash[22676]: cluster 2024-09-21T04:06:13.317566+0000 mgr.a (mgr.14388) 15225 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:14 smithi044 bash[22676]: audit 2024-09-21T04:06:13.562798+0000 mgr.a (mgr.14388) 15226 : audit [DBG] from='client.329601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:14 smithi179 bash[23186]: cluster 2024-09-21T04:06:13.317566+0000 mgr.a (mgr.14388) 15225 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:14 smithi179 bash[23186]: audit 2024-09-21T04:06:13.562798+0000 mgr.a (mgr.14388) 15226 : audit [DBG] from='client.329601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:14 smithi049 bash[23528]: cluster 2024-09-21T04:06:13.317566+0000 mgr.a (mgr.14388) 15225 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:14 smithi049 bash[23528]: audit 2024-09-21T04:06:13.562798+0000 mgr.a (mgr.14388) 15226 : audit [DBG] from='client.329601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:16 smithi179 bash[23186]: cluster 2024-09-21T04:06:15.319980+0000 mgr.a (mgr.14388) 15227 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T04:06:16.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:16 smithi044 bash[22676]: cluster 2024-09-21T04:06:15.319980+0000 mgr.a (mgr.14388) 15227 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T04:06:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:16 smithi049 bash[23528]: cluster 2024-09-21T04:06:15.319980+0000 mgr.a (mgr.14388) 15227 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T04:06:18.698 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:18 smithi179 bash[23186]: cluster 2024-09-21T04:06:17.320770+0000 mgr.a (mgr.14388) 15228 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:18 smithi044 bash[22676]: cluster 2024-09-21T04:06:17.320770+0000 mgr.a (mgr.14388) 15228 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:18 smithi049 bash[23528]: cluster 2024-09-21T04:06:17.320770+0000 mgr.a (mgr.14388) 15228 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:19.028 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:19.029 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:19.809 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:19.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:19.809 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:19.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:19.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:20 smithi044 bash[22676]: cluster 2024-09-21T04:06:19.321540+0000 mgr.a (mgr.14388) 15229 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:20 smithi044 bash[22676]: audit 2024-09-21T04:06:19.365339+0000 mgr.a (mgr.14388) 15230 : audit [DBG] from='client.142918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:20 smithi044 bash[22676]: audit 2024-09-21T04:06:20.009653+0000 mon.a (mon.0) 12217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:20 smithi044 bash[22676]: audit 2024-09-21T04:06:20.018609+0000 mon.a (mon.0) 12218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:20 smithi044 bash[22676]: audit 2024-09-21T04:06:20.029467+0000 mon.a (mon.0) 12219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:20 smithi179 bash[23186]: cluster 2024-09-21T04:06:19.321540+0000 mgr.a (mgr.14388) 15229 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:20 smithi179 bash[23186]: audit 2024-09-21T04:06:19.365339+0000 mgr.a (mgr.14388) 15230 : audit [DBG] from='client.142918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:20 smithi179 bash[23186]: audit 2024-09-21T04:06:20.009653+0000 mon.a (mon.0) 12217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:20 smithi179 bash[23186]: audit 2024-09-21T04:06:20.018609+0000 mon.a (mon.0) 12218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:20 smithi179 bash[23186]: audit 2024-09-21T04:06:20.029467+0000 mon.a (mon.0) 12219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:20 smithi049 bash[23528]: cluster 2024-09-21T04:06:19.321540+0000 mgr.a (mgr.14388) 15229 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:20 smithi049 bash[23528]: audit 2024-09-21T04:06:19.365339+0000 mgr.a (mgr.14388) 15230 : audit [DBG] from='client.142918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:20.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:20 smithi049 bash[23528]: audit 2024-09-21T04:06:20.009653+0000 mon.a (mon.0) 12217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:20 smithi049 bash[23528]: audit 2024-09-21T04:06:20.018609+0000 mon.a (mon.0) 12218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:20 smithi049 bash[23528]: audit 2024-09-21T04:06:20.029467+0000 mon.a (mon.0) 12219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:22 smithi044 bash[22676]: cluster 2024-09-21T04:06:21.323995+0000 mgr.a (mgr.14388) 15231 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T04:06:22.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:22 smithi179 bash[23186]: cluster 2024-09-21T04:06:21.323995+0000 mgr.a (mgr.14388) 15231 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T04:06:22.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:22 smithi049 bash[23528]: cluster 2024-09-21T04:06:21.323995+0000 mgr.a (mgr.14388) 15231 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-21T04:06:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:24 smithi044 bash[22676]: cluster 2024-09-21T04:06:23.324842+0000 mgr.a (mgr.14388) 15232 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:24 smithi179 bash[23186]: cluster 2024-09-21T04:06:23.324842+0000 mgr.a (mgr.14388) 15232 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:24 smithi049 bash[23528]: cluster 2024-09-21T04:06:23.324842+0000 mgr.a (mgr.14388) 15232 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:24.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:25.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:25.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:26 smithi044 bash[22676]: audit 2024-09-21T04:06:25.140868+0000 mgr.a (mgr.14388) 15233 : audit [DBG] from='client.329754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:26 smithi044 bash[22676]: cluster 2024-09-21T04:06:25.326434+0000 mgr.a (mgr.14388) 15234 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:26.664 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:26 smithi049 bash[23528]: audit 2024-09-21T04:06:25.140868+0000 mgr.a (mgr.14388) 15233 : audit [DBG] from='client.329754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:26.664 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:26 smithi049 bash[23528]: cluster 2024-09-21T04:06:25.326434+0000 mgr.a (mgr.14388) 15234 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:26 smithi179 bash[23186]: audit 2024-09-21T04:06:25.140868+0000 mgr.a (mgr.14388) 15233 : audit [DBG] from='client.329754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:26 smithi179 bash[23186]: cluster 2024-09-21T04:06:25.326434+0000 mgr.a (mgr.14388) 15234 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-21T04:06:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:28 smithi044 bash[22676]: cluster 2024-09-21T04:06:27.327054+0000 mgr.a (mgr.14388) 15235 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:06:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:28 smithi179 bash[23186]: cluster 2024-09-21T04:06:27.327054+0000 mgr.a (mgr.14388) 15235 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:06:28.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:28 smithi049 bash[23528]: cluster 2024-09-21T04:06:27.327054+0000 mgr.a (mgr.14388) 15235 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:06:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:30.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:30.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:30 smithi044 bash[22676]: cluster 2024-09-21T04:06:29.327814+0000 mgr.a (mgr.14388) 15236 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:06:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:30 smithi179 bash[23186]: cluster 2024-09-21T04:06:29.327814+0000 mgr.a (mgr.14388) 15236 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:06:30.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:30 smithi049 bash[23528]: cluster 2024-09-21T04:06:29.327814+0000 mgr.a (mgr.14388) 15236 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:06:31.367 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: audit 2024-09-21T04:06:30.907381+0000 mgr.a (mgr.14388) 15237 : audit [DBG] from='client.329832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: cluster 2024-09-21T04:06:31.329496+0000 mgr.a (mgr.14388) 15238 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: audit 2024-09-21T04:06:31.621294+0000 mon.a (mon.0) 12220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: audit 2024-09-21T04:06:31.626838+0000 mon.a (mon.0) 12221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: audit 2024-09-21T04:06:31.634636+0000 mon.a (mon.0) 12222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: audit 2024-09-21T04:06:31.733110+0000 mon.a (mon.0) 12223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: audit 2024-09-21T04:06:31.742135+0000 mon.a (mon.0) 12224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:32 smithi044 bash[22676]: audit 2024-09-21T04:06:31.750445+0000 mon.a (mon.0) 12225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: audit 2024-09-21T04:06:30.907381+0000 mgr.a (mgr.14388) 15237 : audit [DBG] from='client.329832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: cluster 2024-09-21T04:06:31.329496+0000 mgr.a (mgr.14388) 15238 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: audit 2024-09-21T04:06:31.621294+0000 mon.a (mon.0) 12220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: audit 2024-09-21T04:06:31.626838+0000 mon.a (mon.0) 12221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: audit 2024-09-21T04:06:31.634636+0000 mon.a (mon.0) 12222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: audit 2024-09-21T04:06:31.733110+0000 mon.a (mon.0) 12223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: audit 2024-09-21T04:06:31.742135+0000 mon.a (mon.0) 12224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:32 smithi179 bash[23186]: audit 2024-09-21T04:06:31.750445+0000 mon.a (mon.0) 12225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: audit 2024-09-21T04:06:30.907381+0000 mgr.a (mgr.14388) 15237 : audit [DBG] from='client.329832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: cluster 2024-09-21T04:06:31.329496+0000 mgr.a (mgr.14388) 15238 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: audit 2024-09-21T04:06:31.621294+0000 mon.a (mon.0) 12220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: audit 2024-09-21T04:06:31.626838+0000 mon.a (mon.0) 12221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: audit 2024-09-21T04:06:31.634636+0000 mon.a (mon.0) 12222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: audit 2024-09-21T04:06:31.733110+0000 mon.a (mon.0) 12223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: audit 2024-09-21T04:06:31.742135+0000 mon.a (mon.0) 12224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:32 smithi049 bash[23528]: audit 2024-09-21T04:06:31.750445+0000 mon.a (mon.0) 12225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:34 smithi044 bash[22676]: cluster 2024-09-21T04:06:33.330341+0000 mgr.a (mgr.14388) 15239 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:06:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:34 smithi044 bash[22676]: audit 2024-09-21T04:06:34.385476+0000 mon.a (mon.0) 12226 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:06:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:34 smithi179 bash[23186]: cluster 2024-09-21T04:06:33.330341+0000 mgr.a (mgr.14388) 15239 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:06:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:34 smithi179 bash[23186]: audit 2024-09-21T04:06:34.385476+0000 mon.a (mon.0) 12226 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:06:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:34 smithi049 bash[23528]: cluster 2024-09-21T04:06:33.330341+0000 mgr.a (mgr.14388) 15239 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:06:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:34 smithi049 bash[23528]: audit 2024-09-21T04:06:34.385476+0000 mon.a (mon.0) 12226 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22930]: debug 2024-09-21T04:06:35.792+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22930]: debug 2024-09-21T04:06:35.792+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:34.963757+0000 mon.a (mon.0) 12227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:34.972103+0000 mon.a (mon.0) 12228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:34.974101+0000 mon.a (mon.0) 12229 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:34.975621+0000 mon.a (mon.0) 12230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:34.985532+0000 mon.a (mon.0) 12231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:34.991730+0000 mon.a (mon.0) 12232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:06:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:34.994093+0000 mgr.a (mgr.14388) 15240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:06:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: cluster 2024-09-21T04:06:35.332043+0000 mgr.a (mgr.14388) 15241 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: audit 2024-09-21T04:06:35.795320+0000 mgr.a (mgr.14388) 15242 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:06:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:35 smithi044 bash[22676]: cephadm 2024-09-21T04:06:35.797176+0000 mgr.a (mgr.14388) 15243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:34.963757+0000 mon.a (mon.0) 12227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:34.972103+0000 mon.a (mon.0) 12228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:34.974101+0000 mon.a (mon.0) 12229 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:34.975621+0000 mon.a (mon.0) 12230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:34.985532+0000 mon.a (mon.0) 12231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:34.991730+0000 mon.a (mon.0) 12232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:34.994093+0000 mgr.a (mgr.14388) 15240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: cluster 2024-09-21T04:06:35.332043+0000 mgr.a (mgr.14388) 15241 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: audit 2024-09-21T04:06:35.795320+0000 mgr.a (mgr.14388) 15242 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:06:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:35 smithi179 bash[23186]: cephadm 2024-09-21T04:06:35.797176+0000 mgr.a (mgr.14388) 15243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:34.963757+0000 mon.a (mon.0) 12227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:34.972103+0000 mon.a (mon.0) 12228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:34.974101+0000 mon.a (mon.0) 12229 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:34.975621+0000 mon.a (mon.0) 12230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:34.985532+0000 mon.a (mon.0) 12231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:34.991730+0000 mon.a (mon.0) 12232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:34.994093+0000 mgr.a (mgr.14388) 15240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: cluster 2024-09-21T04:06:35.332043+0000 mgr.a (mgr.14388) 15241 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: audit 2024-09-21T04:06:35.795320+0000 mgr.a (mgr.14388) 15242 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:06:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:35 smithi049 bash[23528]: cephadm 2024-09-21T04:06:35.797176+0000 mgr.a (mgr.14388) 15243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:06:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:37.152 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:37.152 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:36 smithi044 bash[22676]: audit 2024-09-21T04:06:36.704587+0000 mgr.a (mgr.14388) 15244 : audit [DBG] from='client.330009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:36 smithi179 bash[23186]: audit 2024-09-21T04:06:36.704587+0000 mgr.a (mgr.14388) 15244 : audit [DBG] from='client.330009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:37.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:36 smithi049 bash[23528]: audit 2024-09-21T04:06:36.704587+0000 mgr.a (mgr.14388) 15244 : audit [DBG] from='client.330009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:37 smithi179 bash[23186]: cluster 2024-09-21T04:06:37.332979+0000 mgr.a (mgr.14388) 15245 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:38.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:37 smithi049 bash[23528]: cluster 2024-09-21T04:06:37.332979+0000 mgr.a (mgr.14388) 15245 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:37 smithi044 bash[22676]: cluster 2024-09-21T04:06:37.332979+0000 mgr.a (mgr.14388) 15245 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:40.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:40 smithi049 bash[23528]: cluster 2024-09-21T04:06:39.333778+0000 mgr.a (mgr.14388) 15246 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:40.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:40 smithi049 bash[23528]: audit 2024-09-21T04:06:40.247377+0000 mon.a (mon.0) 12233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:40 smithi049 bash[23528]: audit 2024-09-21T04:06:40.256091+0000 mon.a (mon.0) 12234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:40 smithi049 bash[23528]: audit 2024-09-21T04:06:40.266553+0000 mon.a (mon.0) 12235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:40 smithi044 bash[22676]: cluster 2024-09-21T04:06:39.333778+0000 mgr.a (mgr.14388) 15246 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:40 smithi044 bash[22676]: audit 2024-09-21T04:06:40.247377+0000 mon.a (mon.0) 12233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:40 smithi044 bash[22676]: audit 2024-09-21T04:06:40.256091+0000 mon.a (mon.0) 12234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:40 smithi044 bash[22676]: audit 2024-09-21T04:06:40.266553+0000 mon.a (mon.0) 12235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:40 smithi179 bash[23186]: cluster 2024-09-21T04:06:39.333778+0000 mgr.a (mgr.14388) 15246 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:40 smithi179 bash[23186]: audit 2024-09-21T04:06:40.247377+0000 mon.a (mon.0) 12233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:40 smithi179 bash[23186]: audit 2024-09-21T04:06:40.256091+0000 mon.a (mon.0) 12234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:40 smithi179 bash[23186]: audit 2024-09-21T04:06:40.266553+0000 mon.a (mon.0) 12235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:42.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:42.154 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:42.154 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:42 smithi044 bash[22676]: cluster 2024-09-21T04:06:41.335981+0000 mgr.a (mgr.14388) 15247 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:42 smithi179 bash[23186]: cluster 2024-09-21T04:06:41.335981+0000 mgr.a (mgr.14388) 15247 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:42 smithi049 bash[23528]: cluster 2024-09-21T04:06:41.335981+0000 mgr.a (mgr.14388) 15247 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:42.943 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:42.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:42.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:42.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:42.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:43 smithi044 bash[22676]: audit 2024-09-21T04:06:42.491343+0000 mgr.a (mgr.14388) 15248 : audit [DBG] from='client.330084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:43 smithi179 bash[23186]: audit 2024-09-21T04:06:42.491343+0000 mgr.a (mgr.14388) 15248 : audit [DBG] from='client.330084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:43.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:43 smithi049 bash[23528]: audit 2024-09-21T04:06:42.491343+0000 mgr.a (mgr.14388) 15248 : audit [DBG] from='client.330084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:44 smithi044 bash[22676]: cluster 2024-09-21T04:06:43.336981+0000 mgr.a (mgr.14388) 15249 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:44 smithi179 bash[23186]: cluster 2024-09-21T04:06:43.336981+0000 mgr.a (mgr.14388) 15249 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:44.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:44 smithi049 bash[23528]: cluster 2024-09-21T04:06:43.336981+0000 mgr.a (mgr.14388) 15249 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:46 smithi044 bash[22676]: cluster 2024-09-21T04:06:45.339231+0000 mgr.a (mgr.14388) 15250 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:46 smithi179 bash[23186]: cluster 2024-09-21T04:06:45.339231+0000 mgr.a (mgr.14388) 15250 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:46.789 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:46 smithi049 bash[23528]: cluster 2024-09-21T04:06:45.339231+0000 mgr.a (mgr.14388) 15250 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:47.945 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:47.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:47.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:48.702 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:48 smithi049 bash[23528]: cluster 2024-09-21T04:06:47.340029+0000 mgr.a (mgr.14388) 15251 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:48.706 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:48.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:48.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:48.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:48.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:48 smithi044 bash[22676]: cluster 2024-09-21T04:06:47.340029+0000 mgr.a (mgr.14388) 15251 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:48 smithi179 bash[23186]: cluster 2024-09-21T04:06:47.340029+0000 mgr.a (mgr.14388) 15251 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:49 smithi044 bash[22676]: audit 2024-09-21T04:06:48.265720+0000 mgr.a (mgr.14388) 15252 : audit [DBG] from='client.330159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:49 smithi179 bash[23186]: audit 2024-09-21T04:06:48.265720+0000 mgr.a (mgr.14388) 15252 : audit [DBG] from='client.330159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:49.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:49 smithi049 bash[23528]: audit 2024-09-21T04:06:48.265720+0000 mgr.a (mgr.14388) 15252 : audit [DBG] from='client.330159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:50 smithi044 bash[22676]: cluster 2024-09-21T04:06:49.341042+0000 mgr.a (mgr.14388) 15253 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:50.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:50 smithi179 bash[23186]: cluster 2024-09-21T04:06:49.341042+0000 mgr.a (mgr.14388) 15253 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:50 smithi049 bash[23528]: cluster 2024-09-21T04:06:49.341042+0000 mgr.a (mgr.14388) 15253 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:52 smithi044 bash[22676]: cluster 2024-09-21T04:06:51.343480+0000 mgr.a (mgr.14388) 15254 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:52 smithi044 bash[22676]: audit 2024-09-21T04:06:51.825998+0000 mon.a (mon.0) 12236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:52 smithi044 bash[22676]: audit 2024-09-21T04:06:51.832907+0000 mon.a (mon.0) 12237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:52 smithi044 bash[22676]: audit 2024-09-21T04:06:51.841331+0000 mon.a (mon.0) 12238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:52 smithi044 bash[22676]: audit 2024-09-21T04:06:51.930762+0000 mon.a (mon.0) 12239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:52 smithi044 bash[22676]: audit 2024-09-21T04:06:51.938224+0000 mon.a (mon.0) 12240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:52 smithi044 bash[22676]: audit 2024-09-21T04:06:51.948194+0000 mon.a (mon.0) 12241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:52 smithi179 bash[23186]: cluster 2024-09-21T04:06:51.343480+0000 mgr.a (mgr.14388) 15254 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:52 smithi179 bash[23186]: audit 2024-09-21T04:06:51.825998+0000 mon.a (mon.0) 12236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:52 smithi179 bash[23186]: audit 2024-09-21T04:06:51.832907+0000 mon.a (mon.0) 12237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:52 smithi179 bash[23186]: audit 2024-09-21T04:06:51.841331+0000 mon.a (mon.0) 12238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:52 smithi179 bash[23186]: audit 2024-09-21T04:06:51.930762+0000 mon.a (mon.0) 12239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:52 smithi179 bash[23186]: audit 2024-09-21T04:06:51.938224+0000 mon.a (mon.0) 12240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:52 smithi179 bash[23186]: audit 2024-09-21T04:06:51.948194+0000 mon.a (mon.0) 12241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:52 smithi049 bash[23528]: cluster 2024-09-21T04:06:51.343480+0000 mgr.a (mgr.14388) 15254 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:06:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:52 smithi049 bash[23528]: audit 2024-09-21T04:06:51.825998+0000 mon.a (mon.0) 12236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:52 smithi049 bash[23528]: audit 2024-09-21T04:06:51.832907+0000 mon.a (mon.0) 12237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:52 smithi049 bash[23528]: audit 2024-09-21T04:06:51.841331+0000 mon.a (mon.0) 12238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:52 smithi049 bash[23528]: audit 2024-09-21T04:06:51.930762+0000 mon.a (mon.0) 12239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:52 smithi049 bash[23528]: audit 2024-09-21T04:06:51.938224+0000 mon.a (mon.0) 12240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:52 smithi049 bash[23528]: audit 2024-09-21T04:06:51.948194+0000 mon.a (mon.0) 12241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:06:53.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:53.708 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:53.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:06:54.457 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:06:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:06:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:06:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:06:54.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:06:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:54 smithi044 bash[22676]: cluster 2024-09-21T04:06:53.344274+0000 mgr.a (mgr.14388) 15255 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:54 smithi179 bash[23186]: cluster 2024-09-21T04:06:53.344274+0000 mgr.a (mgr.14388) 15255 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:54 smithi049 bash[23528]: cluster 2024-09-21T04:06:53.344274+0000 mgr.a (mgr.14388) 15255 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:56.093 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:55 smithi044 bash[22676]: audit 2024-09-21T04:06:54.041730+0000 mgr.a (mgr.14388) 15256 : audit [DBG] from='client.330237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:55 smithi179 bash[23186]: audit 2024-09-21T04:06:54.041730+0000 mgr.a (mgr.14388) 15256 : audit [DBG] from='client.330237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:55 smithi049 bash[23528]: audit 2024-09-21T04:06:54.041730+0000 mgr.a (mgr.14388) 15256 : audit [DBG] from='client.330237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:06:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:56 smithi044 bash[22676]: cluster 2024-09-21T04:06:55.346642+0000 mgr.a (mgr.14388) 15257 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:06:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:56 smithi179 bash[23186]: cluster 2024-09-21T04:06:55.346642+0000 mgr.a (mgr.14388) 15257 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:06:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:56 smithi049 bash[23528]: cluster 2024-09-21T04:06:55.346642+0000 mgr.a (mgr.14388) 15257 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:06:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:06:58 smithi044 bash[22676]: cluster 2024-09-21T04:06:57.347582+0000 mgr.a (mgr.14388) 15258 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:06:58 smithi179 bash[23186]: cluster 2024-09-21T04:06:57.347582+0000 mgr.a (mgr.14388) 15258 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:06:58 smithi049 bash[23528]: cluster 2024-09-21T04:06:57.347582+0000 mgr.a (mgr.14388) 15258 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:06:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:06:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:06:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:00.203 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:00.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:00.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:00.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:00.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:00 smithi044 bash[22676]: cluster 2024-09-21T04:06:59.348545+0000 mgr.a (mgr.14388) 15259 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:00 smithi044 bash[22676]: audit 2024-09-21T04:06:59.781756+0000 mgr.a (mgr.14388) 15260 : audit [DBG] from='client.330315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:00 smithi044 bash[22676]: audit 2024-09-21T04:07:00.464643+0000 mon.a (mon.0) 12242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:00 smithi044 bash[22676]: audit 2024-09-21T04:07:00.473795+0000 mon.a (mon.0) 12243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:00 smithi044 bash[22676]: audit 2024-09-21T04:07:00.484166+0000 mon.a (mon.0) 12244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:00 smithi179 bash[23186]: cluster 2024-09-21T04:06:59.348545+0000 mgr.a (mgr.14388) 15259 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:00 smithi179 bash[23186]: audit 2024-09-21T04:06:59.781756+0000 mgr.a (mgr.14388) 15260 : audit [DBG] from='client.330315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:00 smithi179 bash[23186]: audit 2024-09-21T04:07:00.464643+0000 mon.a (mon.0) 12242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:00 smithi179 bash[23186]: audit 2024-09-21T04:07:00.473795+0000 mon.a (mon.0) 12243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:00 smithi179 bash[23186]: audit 2024-09-21T04:07:00.484166+0000 mon.a (mon.0) 12244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:00 smithi049 bash[23528]: cluster 2024-09-21T04:06:59.348545+0000 mgr.a (mgr.14388) 15259 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:00 smithi049 bash[23528]: audit 2024-09-21T04:06:59.781756+0000 mgr.a (mgr.14388) 15260 : audit [DBG] from='client.330315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:00 smithi049 bash[23528]: audit 2024-09-21T04:07:00.464643+0000 mon.a (mon.0) 12242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:00 smithi049 bash[23528]: audit 2024-09-21T04:07:00.473795+0000 mon.a (mon.0) 12243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:00 smithi049 bash[23528]: audit 2024-09-21T04:07:00.484166+0000 mon.a (mon.0) 12244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:01 smithi044 bash[22676]: cluster 2024-09-21T04:07:01.351453+0000 mgr.a (mgr.14388) 15261 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:07:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:01 smithi179 bash[23186]: cluster 2024-09-21T04:07:01.351453+0000 mgr.a (mgr.14388) 15261 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:07:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:01 smithi049 bash[23528]: cluster 2024-09-21T04:07:01.351453+0000 mgr.a (mgr.14388) 15261 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:07:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:04 smithi044 bash[22676]: cluster 2024-09-21T04:07:03.352228+0000 mgr.a (mgr.14388) 15262 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:07:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:04 smithi179 bash[23186]: cluster 2024-09-21T04:07:03.352228+0000 mgr.a (mgr.14388) 15262 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:07:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:04 smithi049 bash[23528]: cluster 2024-09-21T04:07:03.352228+0000 mgr.a (mgr.14388) 15262 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:07:05.205 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:05.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:05.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:06.014 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:06.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:06.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:06.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:06.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:06 smithi049 bash[23528]: cluster 2024-09-21T04:07:05.353977+0000 mgr.a (mgr.14388) 15263 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:06 smithi049 bash[23528]: audit 2024-09-21T04:07:05.542809+0000 mgr.a (mgr.14388) 15264 : audit [DBG] from='client.330387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:06.714 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:06 smithi044 bash[22676]: cluster 2024-09-21T04:07:05.353977+0000 mgr.a (mgr.14388) 15263 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:06.714 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:06 smithi044 bash[22676]: audit 2024-09-21T04:07:05.542809+0000 mgr.a (mgr.14388) 15264 : audit [DBG] from='client.330387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:06 smithi179 bash[23186]: cluster 2024-09-21T04:07:05.353977+0000 mgr.a (mgr.14388) 15263 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:06 smithi179 bash[23186]: audit 2024-09-21T04:07:05.542809+0000 mgr.a (mgr.14388) 15264 : audit [DBG] from='client.330387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:08.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:08 smithi049 bash[23528]: cluster 2024-09-21T04:07:07.355019+0000 mgr.a (mgr.14388) 15265 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:07:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:08 smithi044 bash[22676]: cluster 2024-09-21T04:07:07.355019+0000 mgr.a (mgr.14388) 15265 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:07:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:08 smithi179 bash[23186]: cluster 2024-09-21T04:07:07.355019+0000 mgr.a (mgr.14388) 15265 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:07:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:10 smithi044 bash[22676]: cluster 2024-09-21T04:07:09.355880+0000 mgr.a (mgr.14388) 15266 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:07:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:10 smithi179 bash[23186]: cluster 2024-09-21T04:07:09.355880+0000 mgr.a (mgr.14388) 15266 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:07:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:10 smithi049 bash[23528]: cluster 2024-09-21T04:07:09.355880+0000 mgr.a (mgr.14388) 15266 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:07:11.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:11.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:11.017 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:11.806 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:11.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:11.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:11.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:11.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: audit 2024-09-21T04:07:11.348949+0000 mgr.a (mgr.14388) 15267 : audit [DBG] from='client.330465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: cluster 2024-09-21T04:07:11.373165+0000 mgr.a (mgr.14388) 15268 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: audit 2024-09-21T04:07:12.037037+0000 mon.a (mon.0) 12245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: audit 2024-09-21T04:07:12.048522+0000 mon.a (mon.0) 12246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: audit 2024-09-21T04:07:12.057989+0000 mon.a (mon.0) 12247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: audit 2024-09-21T04:07:12.140389+0000 mon.a (mon.0) 12248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: audit 2024-09-21T04:07:12.146529+0000 mon.a (mon.0) 12249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:12 smithi044 bash[22676]: audit 2024-09-21T04:07:12.153479+0000 mon.a (mon.0) 12250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: audit 2024-09-21T04:07:11.348949+0000 mgr.a (mgr.14388) 15267 : audit [DBG] from='client.330465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: cluster 2024-09-21T04:07:11.373165+0000 mgr.a (mgr.14388) 15268 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: audit 2024-09-21T04:07:12.037037+0000 mon.a (mon.0) 12245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: audit 2024-09-21T04:07:12.048522+0000 mon.a (mon.0) 12246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: audit 2024-09-21T04:07:12.057989+0000 mon.a (mon.0) 12247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: audit 2024-09-21T04:07:12.140389+0000 mon.a (mon.0) 12248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: audit 2024-09-21T04:07:12.146529+0000 mon.a (mon.0) 12249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:12 smithi179 bash[23186]: audit 2024-09-21T04:07:12.153479+0000 mon.a (mon.0) 12250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: audit 2024-09-21T04:07:11.348949+0000 mgr.a (mgr.14388) 15267 : audit [DBG] from='client.330465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: cluster 2024-09-21T04:07:11.373165+0000 mgr.a (mgr.14388) 15268 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: audit 2024-09-21T04:07:12.037037+0000 mon.a (mon.0) 12245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: audit 2024-09-21T04:07:12.048522+0000 mon.a (mon.0) 12246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: audit 2024-09-21T04:07:12.057989+0000 mon.a (mon.0) 12247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: audit 2024-09-21T04:07:12.140389+0000 mon.a (mon.0) 12248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: audit 2024-09-21T04:07:12.146529+0000 mon.a (mon.0) 12249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:12 smithi049 bash[23528]: audit 2024-09-21T04:07:12.153479+0000 mon.a (mon.0) 12250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:14 smithi044 bash[22676]: cluster 2024-09-21T04:07:13.374087+0000 mgr.a (mgr.14388) 15269 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:07:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:14 smithi179 bash[23186]: cluster 2024-09-21T04:07:13.374087+0000 mgr.a (mgr.14388) 15269 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:07:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:14 smithi049 bash[23528]: cluster 2024-09-21T04:07:13.374087+0000 mgr.a (mgr.14388) 15269 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:07:16.700 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:16 smithi044 bash[22676]: cluster 2024-09-21T04:07:15.376323+0000 mgr.a (mgr.14388) 15270 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:07:16.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:16 smithi179 bash[23186]: cluster 2024-09-21T04:07:15.376323+0000 mgr.a (mgr.14388) 15270 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:07:16.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:16 smithi049 bash[23528]: cluster 2024-09-21T04:07:15.376323+0000 mgr.a (mgr.14388) 15270 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:07:16.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:16.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:16.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:17.567 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:17.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:17.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:17.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:17.568 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:18 smithi044 bash[22676]: audit 2024-09-21T04:07:17.137165+0000 mgr.a (mgr.14388) 15271 : audit [DBG] from='client.330540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:18 smithi044 bash[22676]: cluster 2024-09-21T04:07:17.376887+0000 mgr.a (mgr.14388) 15272 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:18 smithi179 bash[23186]: audit 2024-09-21T04:07:17.137165+0000 mgr.a (mgr.14388) 15271 : audit [DBG] from='client.330540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:18 smithi179 bash[23186]: cluster 2024-09-21T04:07:17.376887+0000 mgr.a (mgr.14388) 15272 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:18 smithi049 bash[23528]: audit 2024-09-21T04:07:17.137165+0000 mgr.a (mgr.14388) 15271 : audit [DBG] from='client.330540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:18.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:18 smithi049 bash[23528]: cluster 2024-09-21T04:07:17.376887+0000 mgr.a (mgr.14388) 15272 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:20 smithi179 bash[23186]: cluster 2024-09-21T04:07:19.377767+0000 mgr.a (mgr.14388) 15273 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:20.723 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:20 smithi049 bash[23528]: cluster 2024-09-21T04:07:19.377767+0000 mgr.a (mgr.14388) 15273 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:20 smithi044 bash[22676]: cluster 2024-09-21T04:07:19.377767+0000 mgr.a (mgr.14388) 15273 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:21 smithi044 bash[22676]: audit 2024-09-21T04:07:20.699187+0000 mon.a (mon.0) 12251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:21 smithi044 bash[22676]: audit 2024-09-21T04:07:20.707946+0000 mon.a (mon.0) 12252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:21 smithi044 bash[22676]: audit 2024-09-21T04:07:20.718646+0000 mon.a (mon.0) 12253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:21 smithi179 bash[23186]: audit 2024-09-21T04:07:20.699187+0000 mon.a (mon.0) 12251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:21 smithi179 bash[23186]: audit 2024-09-21T04:07:20.707946+0000 mon.a (mon.0) 12252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:21 smithi179 bash[23186]: audit 2024-09-21T04:07:20.718646+0000 mon.a (mon.0) 12253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:21 smithi049 bash[23528]: audit 2024-09-21T04:07:20.699187+0000 mon.a (mon.0) 12251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:21 smithi049 bash[23528]: audit 2024-09-21T04:07:20.707946+0000 mon.a (mon.0) 12252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:22.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:21 smithi049 bash[23528]: audit 2024-09-21T04:07:20.718646+0000 mon.a (mon.0) 12253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:22.569 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:22 smithi044 bash[22676]: cluster 2024-09-21T04:07:21.379933+0000 mgr.a (mgr.14388) 15274 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:23.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:22 smithi179 bash[23186]: cluster 2024-09-21T04:07:21.379933+0000 mgr.a (mgr.14388) 15274 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:22 smithi049 bash[23528]: cluster 2024-09-21T04:07:21.379933+0000 mgr.a (mgr.14388) 15274 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:23.351 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:23.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:24 smithi044 bash[22676]: audit 2024-09-21T04:07:22.900462+0000 mgr.a (mgr.14388) 15275 : audit [DBG] from='client.330618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:24 smithi044 bash[22676]: cluster 2024-09-21T04:07:23.380651+0000 mgr.a (mgr.14388) 15276 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:24 smithi179 bash[23186]: audit 2024-09-21T04:07:22.900462+0000 mgr.a (mgr.14388) 15275 : audit [DBG] from='client.330618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:24 smithi179 bash[23186]: cluster 2024-09-21T04:07:23.380651+0000 mgr.a (mgr.14388) 15276 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:24 smithi049 bash[23528]: audit 2024-09-21T04:07:22.900462+0000 mgr.a (mgr.14388) 15275 : audit [DBG] from='client.330618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:24 smithi049 bash[23528]: cluster 2024-09-21T04:07:23.380651+0000 mgr.a (mgr.14388) 15276 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:26 smithi044 bash[22676]: cluster 2024-09-21T04:07:25.382208+0000 mgr.a (mgr.14388) 15277 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:26 smithi179 bash[23186]: cluster 2024-09-21T04:07:25.382208+0000 mgr.a (mgr.14388) 15277 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:26 smithi049 bash[23528]: cluster 2024-09-21T04:07:25.382208+0000 mgr.a (mgr.14388) 15277 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:28.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:28.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:28.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:28 smithi044 bash[22676]: cluster 2024-09-21T04:07:27.382955+0000 mgr.a (mgr.14388) 15278 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:28 smithi179 bash[23186]: cluster 2024-09-21T04:07:27.382955+0000 mgr.a (mgr.14388) 15278 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:28 smithi049 bash[23528]: cluster 2024-09-21T04:07:27.382955+0000 mgr.a (mgr.14388) 15278 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:29.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:29.873 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:29 smithi049 bash[23528]: audit 2024-09-21T04:07:28.688247+0000 mgr.a (mgr.14388) 15279 : audit [DBG] from='client.330693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:29 smithi044 bash[22676]: audit 2024-09-21T04:07:28.688247+0000 mgr.a (mgr.14388) 15279 : audit [DBG] from='client.330693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:30.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:29 smithi179 bash[23186]: audit 2024-09-21T04:07:28.688247+0000 mgr.a (mgr.14388) 15279 : audit [DBG] from='client.330693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:30 smithi179 bash[23186]: cluster 2024-09-21T04:07:29.383969+0000 mgr.a (mgr.14388) 15280 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:30 smithi049 bash[23528]: cluster 2024-09-21T04:07:29.383969+0000 mgr.a (mgr.14388) 15280 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:30 smithi044 bash[22676]: cluster 2024-09-21T04:07:29.383969+0000 mgr.a (mgr.14388) 15280 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:32 smithi179 bash[23186]: cluster 2024-09-21T04:07:31.386241+0000 mgr.a (mgr.14388) 15281 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:32 smithi179 bash[23186]: audit 2024-09-21T04:07:32.256550+0000 mon.a (mon.0) 12254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:32 smithi179 bash[23186]: audit 2024-09-21T04:07:32.265216+0000 mon.a (mon.0) 12255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:32 smithi179 bash[23186]: audit 2024-09-21T04:07:32.274570+0000 mon.a (mon.0) 12256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:32 smithi179 bash[23186]: audit 2024-09-21T04:07:32.361654+0000 mon.a (mon.0) 12257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:32 smithi179 bash[23186]: audit 2024-09-21T04:07:32.369722+0000 mon.a (mon.0) 12258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:32 smithi179 bash[23186]: audit 2024-09-21T04:07:32.379638+0000 mon.a (mon.0) 12259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:32 smithi049 bash[23528]: cluster 2024-09-21T04:07:31.386241+0000 mgr.a (mgr.14388) 15281 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:32 smithi049 bash[23528]: audit 2024-09-21T04:07:32.256550+0000 mon.a (mon.0) 12254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:32 smithi049 bash[23528]: audit 2024-09-21T04:07:32.265216+0000 mon.a (mon.0) 12255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:32 smithi049 bash[23528]: audit 2024-09-21T04:07:32.274570+0000 mon.a (mon.0) 12256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:32 smithi049 bash[23528]: audit 2024-09-21T04:07:32.361654+0000 mon.a (mon.0) 12257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:32 smithi049 bash[23528]: audit 2024-09-21T04:07:32.369722+0000 mon.a (mon.0) 12258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:32 smithi049 bash[23528]: audit 2024-09-21T04:07:32.379638+0000 mon.a (mon.0) 12259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:32 smithi044 bash[22676]: cluster 2024-09-21T04:07:31.386241+0000 mgr.a (mgr.14388) 15281 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:32 smithi044 bash[22676]: audit 2024-09-21T04:07:32.256550+0000 mon.a (mon.0) 12254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:32 smithi044 bash[22676]: audit 2024-09-21T04:07:32.265216+0000 mon.a (mon.0) 12255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:32 smithi044 bash[22676]: audit 2024-09-21T04:07:32.274570+0000 mon.a (mon.0) 12256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:32 smithi044 bash[22676]: audit 2024-09-21T04:07:32.361654+0000 mon.a (mon.0) 12257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:32 smithi044 bash[22676]: audit 2024-09-21T04:07:32.369722+0000 mon.a (mon.0) 12258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:32 smithi044 bash[22676]: audit 2024-09-21T04:07:32.379638+0000 mon.a (mon.0) 12259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:34.917 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:34.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:34.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:34.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:34.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:34 smithi049 bash[23528]: cluster 2024-09-21T04:07:33.386997+0000 mgr.a (mgr.14388) 15282 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:34 smithi044 bash[22676]: cluster 2024-09-21T04:07:33.386997+0000 mgr.a (mgr.14388) 15282 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:34 smithi179 bash[23186]: cluster 2024-09-21T04:07:33.386997+0000 mgr.a (mgr.14388) 15282 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:35 smithi049 bash[23528]: audit 2024-09-21T04:07:34.477272+0000 mgr.a (mgr.14388) 15283 : audit [DBG] from='client.330771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:35 smithi044 bash[22676]: audit 2024-09-21T04:07:34.477272+0000 mgr.a (mgr.14388) 15283 : audit [DBG] from='client.330771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:35 smithi179 bash[23186]: audit 2024-09-21T04:07:34.477272+0000 mgr.a (mgr.14388) 15283 : audit [DBG] from='client.330771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:36.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22930]: debug 2024-09-21T04:07:36.683+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:07:36.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22930]: debug 2024-09-21T04:07:36.683+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:07:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22676]: cluster 2024-09-21T04:07:35.389384+0000 mgr.a (mgr.14388) 15284 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22676]: audit 2024-09-21T04:07:35.890450+0000 mon.a (mon.0) 12260 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:07:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22676]: audit 2024-09-21T04:07:35.897527+0000 mon.a (mon.0) 12261 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:07:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22676]: audit 2024-09-21T04:07:35.899390+0000 mon.a (mon.0) 12262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:07:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22676]: audit 2024-09-21T04:07:35.912108+0000 mon.a (mon.0) 12263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:36 smithi044 bash[22676]: audit 2024-09-21T04:07:35.918799+0000 mon.a (mon.0) 12264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:07:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:36 smithi049 bash[23528]: cluster 2024-09-21T04:07:35.389384+0000 mgr.a (mgr.14388) 15284 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:36 smithi049 bash[23528]: audit 2024-09-21T04:07:35.890450+0000 mon.a (mon.0) 12260 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:07:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:36 smithi049 bash[23528]: audit 2024-09-21T04:07:35.897527+0000 mon.a (mon.0) 12261 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:07:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:36 smithi049 bash[23528]: audit 2024-09-21T04:07:35.899390+0000 mon.a (mon.0) 12262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:07:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:36 smithi049 bash[23528]: audit 2024-09-21T04:07:35.912108+0000 mon.a (mon.0) 12263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:36 smithi049 bash[23528]: audit 2024-09-21T04:07:35.918799+0000 mon.a (mon.0) 12264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:07:37.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:36 smithi179 bash[23186]: cluster 2024-09-21T04:07:35.389384+0000 mgr.a (mgr.14388) 15284 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:37.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:36 smithi179 bash[23186]: audit 2024-09-21T04:07:35.890450+0000 mon.a (mon.0) 12260 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:07:37.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:36 smithi179 bash[23186]: audit 2024-09-21T04:07:35.897527+0000 mon.a (mon.0) 12261 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:07:37.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:36 smithi179 bash[23186]: audit 2024-09-21T04:07:35.899390+0000 mon.a (mon.0) 12262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:07:37.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:36 smithi179 bash[23186]: audit 2024-09-21T04:07:35.912108+0000 mon.a (mon.0) 12263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:37.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:36 smithi179 bash[23186]: audit 2024-09-21T04:07:35.918799+0000 mon.a (mon.0) 12264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:07:38.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:37 smithi179 bash[23186]: audit 2024-09-21T04:07:35.921435+0000 mgr.a (mgr.14388) 15285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:07:38.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:37 smithi179 bash[23186]: audit 2024-09-21T04:07:36.686843+0000 mgr.a (mgr.14388) 15286 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:07:38.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:37 smithi179 bash[23186]: cephadm 2024-09-21T04:07:36.688434+0000 mgr.a (mgr.14388) 15287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:07:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:37 smithi049 bash[23528]: audit 2024-09-21T04:07:35.921435+0000 mgr.a (mgr.14388) 15285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:07:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:37 smithi049 bash[23528]: audit 2024-09-21T04:07:36.686843+0000 mgr.a (mgr.14388) 15286 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:07:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:37 smithi049 bash[23528]: cephadm 2024-09-21T04:07:36.688434+0000 mgr.a (mgr.14388) 15287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:07:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:37 smithi044 bash[22676]: audit 2024-09-21T04:07:35.921435+0000 mgr.a (mgr.14388) 15285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:07:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:37 smithi044 bash[22676]: audit 2024-09-21T04:07:36.686843+0000 mgr.a (mgr.14388) 15286 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:07:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:37 smithi044 bash[22676]: cephadm 2024-09-21T04:07:36.688434+0000 mgr.a (mgr.14388) 15287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:07:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:38 smithi049 bash[23528]: cluster 2024-09-21T04:07:37.390396+0000 mgr.a (mgr.14388) 15288 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:38 smithi044 bash[22676]: cluster 2024-09-21T04:07:37.390396+0000 mgr.a (mgr.14388) 15288 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:38 smithi179 bash[23186]: cluster 2024-09-21T04:07:37.390396+0000 mgr.a (mgr.14388) 15288 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:39.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:39.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:39.919 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:40.682 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:40 smithi179 bash[23186]: cluster 2024-09-21T04:07:39.391185+0000 mgr.a (mgr.14388) 15289 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:40 smithi049 bash[23528]: cluster 2024-09-21T04:07:39.391185+0000 mgr.a (mgr.14388) 15289 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:40 smithi044 bash[22676]: cluster 2024-09-21T04:07:39.391185+0000 mgr.a (mgr.14388) 15289 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:41 smithi049 bash[23528]: audit 2024-09-21T04:07:40.251525+0000 mgr.a (mgr.14388) 15290 : audit [DBG] from='client.330954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:41 smithi049 bash[23528]: audit 2024-09-21T04:07:40.934385+0000 mon.a (mon.0) 12265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:41 smithi049 bash[23528]: audit 2024-09-21T04:07:40.942638+0000 mon.a (mon.0) 12266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:41 smithi049 bash[23528]: audit 2024-09-21T04:07:40.953096+0000 mon.a (mon.0) 12267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:41 smithi044 bash[22676]: audit 2024-09-21T04:07:40.251525+0000 mgr.a (mgr.14388) 15290 : audit [DBG] from='client.330954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:41 smithi044 bash[22676]: audit 2024-09-21T04:07:40.934385+0000 mon.a (mon.0) 12265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:41 smithi044 bash[22676]: audit 2024-09-21T04:07:40.942638+0000 mon.a (mon.0) 12266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:41 smithi044 bash[22676]: audit 2024-09-21T04:07:40.953096+0000 mon.a (mon.0) 12267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:41 smithi179 bash[23186]: audit 2024-09-21T04:07:40.251525+0000 mgr.a (mgr.14388) 15290 : audit [DBG] from='client.330954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:41 smithi179 bash[23186]: audit 2024-09-21T04:07:40.934385+0000 mon.a (mon.0) 12265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:41 smithi179 bash[23186]: audit 2024-09-21T04:07:40.942638+0000 mon.a (mon.0) 12266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:41 smithi179 bash[23186]: audit 2024-09-21T04:07:40.953096+0000 mon.a (mon.0) 12267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:42 smithi049 bash[23528]: cluster 2024-09-21T04:07:41.394105+0000 mgr.a (mgr.14388) 15291 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:42 smithi044 bash[22676]: cluster 2024-09-21T04:07:41.394105+0000 mgr.a (mgr.14388) 15291 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:42 smithi179 bash[23186]: cluster 2024-09-21T04:07:41.394105+0000 mgr.a (mgr.14388) 15291 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:44 smithi049 bash[23528]: cluster 2024-09-21T04:07:43.394888+0000 mgr.a (mgr.14388) 15292 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:44 smithi044 bash[22676]: cluster 2024-09-21T04:07:43.394888+0000 mgr.a (mgr.14388) 15292 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:44 smithi179 bash[23186]: cluster 2024-09-21T04:07:43.394888+0000 mgr.a (mgr.14388) 15292 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:45.684 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:45.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:45.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:46.460 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:46.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:46.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:46.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:46.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:46 smithi044 bash[22676]: cluster 2024-09-21T04:07:45.396808+0000 mgr.a (mgr.14388) 15293 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:46 smithi179 bash[23186]: cluster 2024-09-21T04:07:45.396808+0000 mgr.a (mgr.14388) 15293 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:46 smithi049 bash[23528]: cluster 2024-09-21T04:07:45.396808+0000 mgr.a (mgr.14388) 15293 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:48.081 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:47 smithi049 bash[23528]: audit 2024-09-21T04:07:46.023615+0000 mgr.a (mgr.14388) 15294 : audit [DBG] from='client.331029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:48.152 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:47 smithi044 bash[22676]: audit 2024-09-21T04:07:46.023615+0000 mgr.a (mgr.14388) 15294 : audit [DBG] from='client.331029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:48.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:47 smithi179 bash[23186]: audit 2024-09-21T04:07:46.023615+0000 mgr.a (mgr.14388) 15294 : audit [DBG] from='client.331029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:48 smithi044 bash[22676]: cluster 2024-09-21T04:07:47.397729+0000 mgr.a (mgr.14388) 15295 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:48 smithi179 bash[23186]: cluster 2024-09-21T04:07:47.397729+0000 mgr.a (mgr.14388) 15295 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:48 smithi049 bash[23528]: cluster 2024-09-21T04:07:47.397729+0000 mgr.a (mgr.14388) 15295 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:50 smithi049 bash[23528]: cluster 2024-09-21T04:07:49.398543+0000 mgr.a (mgr.14388) 15296 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:50 smithi044 bash[22676]: cluster 2024-09-21T04:07:49.398543+0000 mgr.a (mgr.14388) 15296 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:51.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:50 smithi179 bash[23186]: cluster 2024-09-21T04:07:49.398543+0000 mgr.a (mgr.14388) 15296 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:07:51.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:51.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:51.462 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:52.247 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:52.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: cluster 2024-09-21T04:07:51.400806+0000 mgr.a (mgr.14388) 15297 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: audit 2024-09-21T04:07:51.795598+0000 mgr.a (mgr.14388) 15298 : audit [DBG] from='client.331107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: audit 2024-09-21T04:07:52.479941+0000 mon.a (mon.0) 12268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: audit 2024-09-21T04:07:52.488021+0000 mon.a (mon.0) 12269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: audit 2024-09-21T04:07:52.499468+0000 mon.a (mon.0) 12270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: audit 2024-09-21T04:07:52.568394+0000 mon.a (mon.0) 12271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: audit 2024-09-21T04:07:52.577018+0000 mon.a (mon.0) 12272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:52 smithi044 bash[22676]: audit 2024-09-21T04:07:52.587191+0000 mon.a (mon.0) 12273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: cluster 2024-09-21T04:07:51.400806+0000 mgr.a (mgr.14388) 15297 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: audit 2024-09-21T04:07:51.795598+0000 mgr.a (mgr.14388) 15298 : audit [DBG] from='client.331107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: audit 2024-09-21T04:07:52.479941+0000 mon.a (mon.0) 12268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: audit 2024-09-21T04:07:52.488021+0000 mon.a (mon.0) 12269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: audit 2024-09-21T04:07:52.499468+0000 mon.a (mon.0) 12270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: audit 2024-09-21T04:07:52.568394+0000 mon.a (mon.0) 12271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: audit 2024-09-21T04:07:52.577018+0000 mon.a (mon.0) 12272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:52 smithi179 bash[23186]: audit 2024-09-21T04:07:52.587191+0000 mon.a (mon.0) 12273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: cluster 2024-09-21T04:07:51.400806+0000 mgr.a (mgr.14388) 15297 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: audit 2024-09-21T04:07:51.795598+0000 mgr.a (mgr.14388) 15298 : audit [DBG] from='client.331107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: audit 2024-09-21T04:07:52.479941+0000 mon.a (mon.0) 12268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: audit 2024-09-21T04:07:52.488021+0000 mon.a (mon.0) 12269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: audit 2024-09-21T04:07:52.499468+0000 mon.a (mon.0) 12270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: audit 2024-09-21T04:07:52.568394+0000 mon.a (mon.0) 12271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: audit 2024-09-21T04:07:52.577018+0000 mon.a (mon.0) 12272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:53.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:52 smithi049 bash[23528]: audit 2024-09-21T04:07:52.587191+0000 mon.a (mon.0) 12273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:07:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:54 smithi044 bash[22676]: cluster 2024-09-21T04:07:53.401845+0000 mgr.a (mgr.14388) 15299 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:55.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:54 smithi179 bash[23186]: cluster 2024-09-21T04:07:53.401845+0000 mgr.a (mgr.14388) 15299 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:54 smithi049 bash[23528]: cluster 2024-09-21T04:07:53.401845+0000 mgr.a (mgr.14388) 15299 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:56 smithi044 bash[22676]: cluster 2024-09-21T04:07:55.404310+0000 mgr.a (mgr.14388) 15300 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:07:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:07:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:07:57.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:56 smithi179 bash[23186]: cluster 2024-09-21T04:07:55.404310+0000 mgr.a (mgr.14388) 15300 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:56 smithi049 bash[23528]: cluster 2024-09-21T04:07:55.404310+0000 mgr.a (mgr.14388) 15300 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:07:58.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:07:58.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:07:58.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:07:58.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:07:58.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:07:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:58 smithi179 bash[23186]: cluster 2024-09-21T04:07:57.405228+0000 mgr.a (mgr.14388) 15301 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:07:58 smithi179 bash[23186]: audit 2024-09-21T04:07:57.577223+0000 mgr.a (mgr.14388) 15302 : audit [DBG] from='client.331185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:58 smithi044 bash[22676]: cluster 2024-09-21T04:07:57.405228+0000 mgr.a (mgr.14388) 15301 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:07:58 smithi044 bash[22676]: audit 2024-09-21T04:07:57.577223+0000 mgr.a (mgr.14388) 15302 : audit [DBG] from='client.331185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:07:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:58 smithi049 bash[23528]: cluster 2024-09-21T04:07:57.405228+0000 mgr.a (mgr.14388) 15301 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:07:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:07:58 smithi049 bash[23528]: audit 2024-09-21T04:07:57.577223+0000 mgr.a (mgr.14388) 15302 : audit [DBG] from='client.331185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:01.152 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:00 smithi179 bash[23186]: cluster 2024-09-21T04:07:59.406228+0000 mgr.a (mgr.14388) 15303 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:01.201 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:00 smithi049 bash[23528]: cluster 2024-09-21T04:07:59.406228+0000 mgr.a (mgr.14388) 15303 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:00 smithi044 bash[22676]: cluster 2024-09-21T04:07:59.406228+0000 mgr.a (mgr.14388) 15303 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:02 smithi044 bash[22676]: audit 2024-09-21T04:08:01.175689+0000 mon.a (mon.0) 12274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:02 smithi044 bash[22676]: audit 2024-09-21T04:08:01.185650+0000 mon.a (mon.0) 12275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:02 smithi044 bash[22676]: audit 2024-09-21T04:08:01.196328+0000 mon.a (mon.0) 12276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:02 smithi044 bash[22676]: cluster 2024-09-21T04:08:01.408467+0000 mgr.a (mgr.14388) 15304 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:02 smithi179 bash[23186]: audit 2024-09-21T04:08:01.175689+0000 mon.a (mon.0) 12274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:02 smithi179 bash[23186]: audit 2024-09-21T04:08:01.185650+0000 mon.a (mon.0) 12275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:02 smithi179 bash[23186]: audit 2024-09-21T04:08:01.196328+0000 mon.a (mon.0) 12276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:02 smithi179 bash[23186]: cluster 2024-09-21T04:08:01.408467+0000 mgr.a (mgr.14388) 15304 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:02.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:02 smithi049 bash[23528]: audit 2024-09-21T04:08:01.175689+0000 mon.a (mon.0) 12274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:02 smithi049 bash[23528]: audit 2024-09-21T04:08:01.185650+0000 mon.a (mon.0) 12275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:02 smithi049 bash[23528]: audit 2024-09-21T04:08:01.196328+0000 mon.a (mon.0) 12276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:02 smithi049 bash[23528]: cluster 2024-09-21T04:08:01.408467+0000 mgr.a (mgr.14388) 15304 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:03.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:03.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:03.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:03.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:03.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:03.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:04 smithi044 bash[22676]: audit 2024-09-21T04:08:03.356766+0000 mgr.a (mgr.14388) 15305 : audit [DBG] from='client.331263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:04 smithi044 bash[22676]: cluster 2024-09-21T04:08:03.409531+0000 mgr.a (mgr.14388) 15306 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:04 smithi179 bash[23186]: audit 2024-09-21T04:08:03.356766+0000 mgr.a (mgr.14388) 15305 : audit [DBG] from='client.331263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:04 smithi179 bash[23186]: cluster 2024-09-21T04:08:03.409531+0000 mgr.a (mgr.14388) 15306 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:04 smithi049 bash[23528]: audit 2024-09-21T04:08:03.356766+0000 mgr.a (mgr.14388) 15305 : audit [DBG] from='client.331263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:04 smithi049 bash[23528]: cluster 2024-09-21T04:08:03.409531+0000 mgr.a (mgr.14388) 15306 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:06 smithi044 bash[22676]: cluster 2024-09-21T04:08:05.410990+0000 mgr.a (mgr.14388) 15307 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:06 smithi179 bash[23186]: cluster 2024-09-21T04:08:05.410990+0000 mgr.a (mgr.14388) 15307 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:06 smithi049 bash[23528]: cluster 2024-09-21T04:08:05.410990+0000 mgr.a (mgr.14388) 15307 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:08.663 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:08 smithi049 bash[23528]: cluster 2024-09-21T04:08:07.411768+0000 mgr.a (mgr.14388) 15308 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:08 smithi044 bash[22676]: cluster 2024-09-21T04:08:07.411768+0000 mgr.a (mgr.14388) 15308 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:08 smithi179 bash[23186]: cluster 2024-09-21T04:08:07.411768+0000 mgr.a (mgr.14388) 15308 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:08.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:08.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:08.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:09.602 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:09.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:09.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:09.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:09.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:10 smithi044 bash[22676]: audit 2024-09-21T04:08:09.147093+0000 mgr.a (mgr.14388) 15309 : audit [DBG] from='client.331338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:10 smithi044 bash[22676]: cluster 2024-09-21T04:08:09.412364+0000 mgr.a (mgr.14388) 15310 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:10 smithi179 bash[23186]: audit 2024-09-21T04:08:09.147093+0000 mgr.a (mgr.14388) 15309 : audit [DBG] from='client.331338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:10 smithi179 bash[23186]: cluster 2024-09-21T04:08:09.412364+0000 mgr.a (mgr.14388) 15310 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:10 smithi049 bash[23528]: audit 2024-09-21T04:08:09.147093+0000 mgr.a (mgr.14388) 15309 : audit [DBG] from='client.331338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:10 smithi049 bash[23528]: cluster 2024-09-21T04:08:09.412364+0000 mgr.a (mgr.14388) 15310 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:12 smithi044 bash[22676]: cluster 2024-09-21T04:08:11.414710+0000 mgr.a (mgr.14388) 15311 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:12 smithi179 bash[23186]: cluster 2024-09-21T04:08:11.414710+0000 mgr.a (mgr.14388) 15311 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:12 smithi049 bash[23528]: cluster 2024-09-21T04:08:11.414710+0000 mgr.a (mgr.14388) 15311 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:13 smithi044 bash[22676]: audit 2024-09-21T04:08:12.700505+0000 mon.a (mon.0) 12277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:13 smithi044 bash[22676]: audit 2024-09-21T04:08:12.708481+0000 mon.a (mon.0) 12278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:13 smithi044 bash[22676]: audit 2024-09-21T04:08:12.718011+0000 mon.a (mon.0) 12279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:13 smithi044 bash[22676]: audit 2024-09-21T04:08:12.809082+0000 mon.a (mon.0) 12280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:13 smithi044 bash[22676]: audit 2024-09-21T04:08:12.817507+0000 mon.a (mon.0) 12281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:13 smithi044 bash[22676]: audit 2024-09-21T04:08:12.828679+0000 mon.a (mon.0) 12282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:13 smithi179 bash[23186]: audit 2024-09-21T04:08:12.700505+0000 mon.a (mon.0) 12277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:13 smithi179 bash[23186]: audit 2024-09-21T04:08:12.708481+0000 mon.a (mon.0) 12278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:13 smithi179 bash[23186]: audit 2024-09-21T04:08:12.718011+0000 mon.a (mon.0) 12279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:13 smithi179 bash[23186]: audit 2024-09-21T04:08:12.809082+0000 mon.a (mon.0) 12280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:13 smithi179 bash[23186]: audit 2024-09-21T04:08:12.817507+0000 mon.a (mon.0) 12281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:13 smithi179 bash[23186]: audit 2024-09-21T04:08:12.828679+0000 mon.a (mon.0) 12282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:13 smithi049 bash[23528]: audit 2024-09-21T04:08:12.700505+0000 mon.a (mon.0) 12277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:13 smithi049 bash[23528]: audit 2024-09-21T04:08:12.708481+0000 mon.a (mon.0) 12278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:13 smithi049 bash[23528]: audit 2024-09-21T04:08:12.718011+0000 mon.a (mon.0) 12279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:13 smithi049 bash[23528]: audit 2024-09-21T04:08:12.809082+0000 mon.a (mon.0) 12280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:13 smithi049 bash[23528]: audit 2024-09-21T04:08:12.817507+0000 mon.a (mon.0) 12281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:13 smithi049 bash[23528]: audit 2024-09-21T04:08:12.828679+0000 mon.a (mon.0) 12282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:14.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:14.604 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:14.604 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:14 smithi044 bash[22676]: cluster 2024-09-21T04:08:13.415456+0000 mgr.a (mgr.14388) 15312 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:14 smithi179 bash[23186]: cluster 2024-09-21T04:08:13.415456+0000 mgr.a (mgr.14388) 15312 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:14 smithi049 bash[23528]: cluster 2024-09-21T04:08:13.415456+0000 mgr.a (mgr.14388) 15312 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:15.396 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:16 smithi044 bash[22676]: audit 2024-09-21T04:08:14.942433+0000 mgr.a (mgr.14388) 15313 : audit [DBG] from='client.331416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:16 smithi044 bash[22676]: cluster 2024-09-21T04:08:15.417041+0000 mgr.a (mgr.14388) 15314 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:16 smithi179 bash[23186]: audit 2024-09-21T04:08:14.942433+0000 mgr.a (mgr.14388) 15313 : audit [DBG] from='client.331416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:16 smithi179 bash[23186]: cluster 2024-09-21T04:08:15.417041+0000 mgr.a (mgr.14388) 15314 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:16 smithi049 bash[23528]: audit 2024-09-21T04:08:14.942433+0000 mgr.a (mgr.14388) 15313 : audit [DBG] from='client.331416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:16 smithi049 bash[23528]: cluster 2024-09-21T04:08:15.417041+0000 mgr.a (mgr.14388) 15314 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:19.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:18 smithi179 bash[23186]: cluster 2024-09-21T04:08:17.417846+0000 mgr.a (mgr.14388) 15315 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:08:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:18 smithi044 bash[22676]: cluster 2024-09-21T04:08:17.417846+0000 mgr.a (mgr.14388) 15315 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:08:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:18 smithi049 bash[23528]: cluster 2024-09-21T04:08:17.417846+0000 mgr.a (mgr.14388) 15315 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:08:20.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:20.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:20.398 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:20 smithi179 bash[23186]: cluster 2024-09-21T04:08:19.418653+0000 mgr.a (mgr.14388) 15316 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:08:21.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:20 smithi044 bash[22676]: cluster 2024-09-21T04:08:19.418653+0000 mgr.a (mgr.14388) 15316 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:08:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:20 smithi049 bash[23528]: cluster 2024-09-21T04:08:19.418653+0000 mgr.a (mgr.14388) 15316 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:08:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:21 smithi044 bash[22676]: audit 2024-09-21T04:08:20.733210+0000 mgr.a (mgr.14388) 15317 : audit [DBG] from='client.331494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:21 smithi044 bash[22676]: audit 2024-09-21T04:08:21.414252+0000 mon.a (mon.0) 12283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:21 smithi044 bash[22676]: audit 2024-09-21T04:08:21.422959+0000 mon.a (mon.0) 12284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:21 smithi044 bash[22676]: audit 2024-09-21T04:08:21.433305+0000 mon.a (mon.0) 12285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:21 smithi179 bash[23186]: audit 2024-09-21T04:08:20.733210+0000 mgr.a (mgr.14388) 15317 : audit [DBG] from='client.331494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:21 smithi179 bash[23186]: audit 2024-09-21T04:08:21.414252+0000 mon.a (mon.0) 12283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:21 smithi179 bash[23186]: audit 2024-09-21T04:08:21.422959+0000 mon.a (mon.0) 12284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:21 smithi179 bash[23186]: audit 2024-09-21T04:08:21.433305+0000 mon.a (mon.0) 12285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:21 smithi049 bash[23528]: audit 2024-09-21T04:08:20.733210+0000 mgr.a (mgr.14388) 15317 : audit [DBG] from='client.331494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:21 smithi049 bash[23528]: audit 2024-09-21T04:08:21.414252+0000 mon.a (mon.0) 12283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:21 smithi049 bash[23528]: audit 2024-09-21T04:08:21.422959+0000 mon.a (mon.0) 12284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:22.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:21 smithi049 bash[23528]: audit 2024-09-21T04:08:21.433305+0000 mon.a (mon.0) 12285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:22 smithi044 bash[22676]: cluster 2024-09-21T04:08:21.421718+0000 mgr.a (mgr.14388) 15318 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:22 smithi179 bash[23186]: cluster 2024-09-21T04:08:21.421718+0000 mgr.a (mgr.14388) 15318 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:22 smithi049 bash[23528]: cluster 2024-09-21T04:08:21.421718+0000 mgr.a (mgr.14388) 15318 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:24 smithi044 bash[22676]: cluster 2024-09-21T04:08:23.422493+0000 mgr.a (mgr.14388) 15319 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:08:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:24 smithi179 bash[23186]: cluster 2024-09-21T04:08:23.422493+0000 mgr.a (mgr.14388) 15319 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:08:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:24 smithi049 bash[23528]: cluster 2024-09-21T04:08:23.422493+0000 mgr.a (mgr.14388) 15319 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:08:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:26.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:26.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:26.977 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:26 smithi044 bash[22676]: cluster 2024-09-21T04:08:25.424501+0000 mgr.a (mgr.14388) 15320 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:26 smithi179 bash[23186]: cluster 2024-09-21T04:08:25.424501+0000 mgr.a (mgr.14388) 15320 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:27.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:26 smithi049 bash[23528]: cluster 2024-09-21T04:08:25.424501+0000 mgr.a (mgr.14388) 15320 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:28.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:27 smithi049 bash[23528]: audit 2024-09-21T04:08:26.514732+0000 mgr.a (mgr.14388) 15321 : audit [DBG] from='client.331569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:27 smithi044 bash[22676]: audit 2024-09-21T04:08:26.514732+0000 mgr.a (mgr.14388) 15321 : audit [DBG] from='client.331569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:27 smithi179 bash[23186]: audit 2024-09-21T04:08:26.514732+0000 mgr.a (mgr.14388) 15321 : audit [DBG] from='client.331569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:29.027 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:28 smithi049 bash[23528]: cluster 2024-09-21T04:08:27.425098+0000 mgr.a (mgr.14388) 15322 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:28 smithi044 bash[22676]: cluster 2024-09-21T04:08:27.425098+0000 mgr.a (mgr.14388) 15322 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:28 smithi179 bash[23186]: cluster 2024-09-21T04:08:27.425098+0000 mgr.a (mgr.14388) 15322 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:30 smithi044 bash[22676]: cluster 2024-09-21T04:08:29.425889+0000 mgr.a (mgr.14388) 15323 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:31.240 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:30 smithi049 bash[23528]: cluster 2024-09-21T04:08:29.425889+0000 mgr.a (mgr.14388) 15323 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:30 smithi179 bash[23186]: cluster 2024-09-21T04:08:29.425889+0000 mgr.a (mgr.14388) 15323 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:31.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:31.980 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:31 smithi044 bash[22676]: cluster 2024-09-21T04:08:31.428121+0000 mgr.a (mgr.14388) 15324 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:32.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:31 smithi179 bash[23186]: cluster 2024-09-21T04:08:31.428121+0000 mgr.a (mgr.14388) 15324 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:32.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:31 smithi049 bash[23528]: cluster 2024-09-21T04:08:31.428121+0000 mgr.a (mgr.14388) 15324 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:32.773 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:32.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:32.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:32.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:32.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:33.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:32 smithi044 bash[22676]: audit 2024-09-21T04:08:32.316183+0000 mgr.a (mgr.14388) 15325 : audit [DBG] from='client.331644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:33.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:32 smithi044 bash[22676]: audit 2024-09-21T04:08:32.914269+0000 mon.a (mon.0) 12286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:33.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:32 smithi044 bash[22676]: audit 2024-09-21T04:08:32.920517+0000 mon.a (mon.0) 12287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:32 smithi179 bash[23186]: audit 2024-09-21T04:08:32.316183+0000 mgr.a (mgr.14388) 15325 : audit [DBG] from='client.331644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:32 smithi179 bash[23186]: audit 2024-09-21T04:08:32.914269+0000 mon.a (mon.0) 12286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:32 smithi179 bash[23186]: audit 2024-09-21T04:08:32.920517+0000 mon.a (mon.0) 12287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:32 smithi049 bash[23528]: audit 2024-09-21T04:08:32.316183+0000 mgr.a (mgr.14388) 15325 : audit [DBG] from='client.331644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:32 smithi049 bash[23528]: audit 2024-09-21T04:08:32.914269+0000 mon.a (mon.0) 12286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:32 smithi049 bash[23528]: audit 2024-09-21T04:08:32.920517+0000 mon.a (mon.0) 12287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:33 smithi044 bash[22676]: audit 2024-09-21T04:08:32.925676+0000 mon.a (mon.0) 12288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:33 smithi044 bash[22676]: audit 2024-09-21T04:08:32.969163+0000 mon.a (mon.0) 12289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:33 smithi044 bash[22676]: audit 2024-09-21T04:08:32.973525+0000 mon.a (mon.0) 12290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:33 smithi044 bash[22676]: audit 2024-09-21T04:08:32.978517+0000 mon.a (mon.0) 12291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:33 smithi044 bash[22676]: cluster 2024-09-21T04:08:33.428979+0000 mgr.a (mgr.14388) 15326 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:33 smithi179 bash[23186]: audit 2024-09-21T04:08:32.925676+0000 mon.a (mon.0) 12288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:33 smithi179 bash[23186]: audit 2024-09-21T04:08:32.969163+0000 mon.a (mon.0) 12289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:33 smithi179 bash[23186]: audit 2024-09-21T04:08:32.973525+0000 mon.a (mon.0) 12290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:33 smithi179 bash[23186]: audit 2024-09-21T04:08:32.978517+0000 mon.a (mon.0) 12291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:33 smithi179 bash[23186]: cluster 2024-09-21T04:08:33.428979+0000 mgr.a (mgr.14388) 15326 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:33 smithi049 bash[23528]: audit 2024-09-21T04:08:32.925676+0000 mon.a (mon.0) 12288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:33 smithi049 bash[23528]: audit 2024-09-21T04:08:32.969163+0000 mon.a (mon.0) 12289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:33 smithi049 bash[23528]: audit 2024-09-21T04:08:32.973525+0000 mon.a (mon.0) 12290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:33 smithi049 bash[23528]: audit 2024-09-21T04:08:32.978517+0000 mon.a (mon.0) 12291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:33 smithi049 bash[23528]: cluster 2024-09-21T04:08:33.428979+0000 mgr.a (mgr.14388) 15326 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:36 smithi179 bash[23186]: cluster 2024-09-21T04:08:35.431216+0000 mgr.a (mgr.14388) 15327 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:36 smithi049 bash[23528]: cluster 2024-09-21T04:08:35.431216+0000 mgr.a (mgr.14388) 15327 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:36.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:36 smithi044 bash[22676]: cluster 2024-09-21T04:08:35.431216+0000 mgr.a (mgr.14388) 15327 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:08:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:37 smithi179 bash[23186]: audit 2024-09-21T04:08:36.751930+0000 mon.a (mon.0) 12292 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:08:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:37 smithi179 bash[23186]: audit 2024-09-21T04:08:36.758315+0000 mon.a (mon.0) 12293 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:08:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:37 smithi179 bash[23186]: audit 2024-09-21T04:08:36.760084+0000 mon.a (mon.0) 12294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:08:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:37 smithi179 bash[23186]: audit 2024-09-21T04:08:36.771347+0000 mon.a (mon.0) 12295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:37 smithi179 bash[23186]: audit 2024-09-21T04:08:36.778345+0000 mon.a (mon.0) 12296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:08:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:37 smithi179 bash[23186]: audit 2024-09-21T04:08:36.780684+0000 mgr.a (mgr.14388) 15328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:08:37.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:37.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:37 smithi049 bash[23528]: audit 2024-09-21T04:08:36.751930+0000 mon.a (mon.0) 12292 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:08:37.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:37 smithi049 bash[23528]: audit 2024-09-21T04:08:36.758315+0000 mon.a (mon.0) 12293 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:08:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:37 smithi049 bash[23528]: audit 2024-09-21T04:08:36.760084+0000 mon.a (mon.0) 12294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:08:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:37 smithi049 bash[23528]: audit 2024-09-21T04:08:36.771347+0000 mon.a (mon.0) 12295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:37 smithi049 bash[23528]: audit 2024-09-21T04:08:36.778345+0000 mon.a (mon.0) 12296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:08:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:37 smithi049 bash[23528]: audit 2024-09-21T04:08:36.780684+0000 mgr.a (mgr.14388) 15328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22930]: debug 2024-09-21T04:08:37.562+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22930]: debug 2024-09-21T04:08:37.566+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22676]: audit 2024-09-21T04:08:36.751930+0000 mon.a (mon.0) 12292 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22676]: audit 2024-09-21T04:08:36.758315+0000 mon.a (mon.0) 12293 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22676]: audit 2024-09-21T04:08:36.760084+0000 mon.a (mon.0) 12294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22676]: audit 2024-09-21T04:08:36.771347+0000 mon.a (mon.0) 12295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22676]: audit 2024-09-21T04:08:36.778345+0000 mon.a (mon.0) 12296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:08:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:37 smithi044 bash[22676]: audit 2024-09-21T04:08:36.780684+0000 mgr.a (mgr.14388) 15328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:08:38.524 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:38.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:38.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:38.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:38.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:38 smithi049 bash[23528]: cluster 2024-09-21T04:08:37.431746+0000 mgr.a (mgr.14388) 15329 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:38 smithi049 bash[23528]: audit 2024-09-21T04:08:37.568273+0000 mgr.a (mgr.14388) 15330 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:08:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:38 smithi049 bash[23528]: cephadm 2024-09-21T04:08:37.569491+0000 mgr.a (mgr.14388) 15331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:08:39.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:38 smithi044 bash[22676]: cluster 2024-09-21T04:08:37.431746+0000 mgr.a (mgr.14388) 15329 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:39.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:38 smithi044 bash[22676]: audit 2024-09-21T04:08:37.568273+0000 mgr.a (mgr.14388) 15330 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:08:39.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:38 smithi044 bash[22676]: cephadm 2024-09-21T04:08:37.569491+0000 mgr.a (mgr.14388) 15331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:08:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:38 smithi179 bash[23186]: cluster 2024-09-21T04:08:37.431746+0000 mgr.a (mgr.14388) 15329 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:38 smithi179 bash[23186]: audit 2024-09-21T04:08:37.568273+0000 mgr.a (mgr.14388) 15330 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:08:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:38 smithi179 bash[23186]: cephadm 2024-09-21T04:08:37.569491+0000 mgr.a (mgr.14388) 15331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:08:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:39 smithi179 bash[23186]: audit 2024-09-21T04:08:38.092743+0000 mgr.a (mgr.14388) 15332 : audit [DBG] from='client.331827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:39 smithi049 bash[23528]: audit 2024-09-21T04:08:38.092743+0000 mgr.a (mgr.14388) 15332 : audit [DBG] from='client.331827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:39 smithi044 bash[22676]: audit 2024-09-21T04:08:38.092743+0000 mgr.a (mgr.14388) 15332 : audit [DBG] from='client.331827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:40 smithi049 bash[23528]: cluster 2024-09-21T04:08:39.432671+0000 mgr.a (mgr.14388) 15333 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:40 smithi044 bash[22676]: cluster 2024-09-21T04:08:39.432671+0000 mgr.a (mgr.14388) 15333 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:40 smithi179 bash[23186]: cluster 2024-09-21T04:08:39.432671+0000 mgr.a (mgr.14388) 15333 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:42 smithi044 bash[22676]: cluster 2024-09-21T04:08:41.434936+0000 mgr.a (mgr.14388) 15334 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:42 smithi044 bash[22676]: audit 2024-09-21T04:08:41.653394+0000 mon.a (mon.0) 12297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:42 smithi044 bash[22676]: audit 2024-09-21T04:08:41.661844+0000 mon.a (mon.0) 12298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:42 smithi044 bash[22676]: audit 2024-09-21T04:08:41.672376+0000 mon.a (mon.0) 12299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:42 smithi179 bash[23186]: cluster 2024-09-21T04:08:41.434936+0000 mgr.a (mgr.14388) 15334 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:42 smithi179 bash[23186]: audit 2024-09-21T04:08:41.653394+0000 mon.a (mon.0) 12297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:42 smithi179 bash[23186]: audit 2024-09-21T04:08:41.661844+0000 mon.a (mon.0) 12298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:42 smithi179 bash[23186]: audit 2024-09-21T04:08:41.672376+0000 mon.a (mon.0) 12299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:42 smithi049 bash[23528]: cluster 2024-09-21T04:08:41.434936+0000 mgr.a (mgr.14388) 15334 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:42 smithi049 bash[23528]: audit 2024-09-21T04:08:41.653394+0000 mon.a (mon.0) 12297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:42 smithi049 bash[23528]: audit 2024-09-21T04:08:41.661844+0000 mon.a (mon.0) 12298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:42 smithi049 bash[23528]: audit 2024-09-21T04:08:41.672376+0000 mon.a (mon.0) 12299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:43.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:44.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:44.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:44.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:44.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:44.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:44 smithi044 bash[22676]: cluster 2024-09-21T04:08:43.435712+0000 mgr.a (mgr.14388) 15335 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:44 smithi044 bash[22676]: audit 2024-09-21T04:08:43.857391+0000 mgr.a (mgr.14388) 15336 : audit [DBG] from='client.331902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:44 smithi179 bash[23186]: cluster 2024-09-21T04:08:43.435712+0000 mgr.a (mgr.14388) 15335 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:44 smithi179 bash[23186]: audit 2024-09-21T04:08:43.857391+0000 mgr.a (mgr.14388) 15336 : audit [DBG] from='client.331902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:44 smithi049 bash[23528]: cluster 2024-09-21T04:08:43.435712+0000 mgr.a (mgr.14388) 15335 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:44 smithi049 bash[23528]: audit 2024-09-21T04:08:43.857391+0000 mgr.a (mgr.14388) 15336 : audit [DBG] from='client.331902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:46.927 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:46 smithi044 bash[22676]: cluster 2024-09-21T04:08:45.438087+0000 mgr.a (mgr.14388) 15337 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:46 smithi179 bash[23186]: cluster 2024-09-21T04:08:45.438087+0000 mgr.a (mgr.14388) 15337 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:46 smithi049 bash[23528]: cluster 2024-09-21T04:08:45.438087+0000 mgr.a (mgr.14388) 15337 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:48 smithi044 bash[22676]: cluster 2024-09-21T04:08:47.438883+0000 mgr.a (mgr.14388) 15338 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:48 smithi179 bash[23186]: cluster 2024-09-21T04:08:47.438883+0000 mgr.a (mgr.14388) 15338 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:49.035 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:48 smithi049 bash[23528]: cluster 2024-09-21T04:08:47.438883+0000 mgr.a (mgr.14388) 15338 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:49.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:49.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:49.316 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:50.094 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:50.953 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:50 smithi049 bash[23528]: cluster 2024-09-21T04:08:49.439344+0000 mgr.a (mgr.14388) 15339 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:50.954 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:50 smithi049 bash[23528]: audit 2024-09-21T04:08:49.640545+0000 mgr.a (mgr.14388) 15340 : audit [DBG] from='client.331980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:50 smithi044 bash[22676]: cluster 2024-09-21T04:08:49.439344+0000 mgr.a (mgr.14388) 15339 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:50 smithi044 bash[22676]: audit 2024-09-21T04:08:49.640545+0000 mgr.a (mgr.14388) 15340 : audit [DBG] from='client.331980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:50 smithi179 bash[23186]: cluster 2024-09-21T04:08:49.439344+0000 mgr.a (mgr.14388) 15339 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:50 smithi179 bash[23186]: audit 2024-09-21T04:08:49.640545+0000 mgr.a (mgr.14388) 15340 : audit [DBG] from='client.331980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:52 smithi044 bash[22676]: cluster 2024-09-21T04:08:51.441709+0000 mgr.a (mgr.14388) 15341 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:53.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:52 smithi179 bash[23186]: cluster 2024-09-21T04:08:51.441709+0000 mgr.a (mgr.14388) 15341 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:52 smithi049 bash[23528]: cluster 2024-09-21T04:08:51.441709+0000 mgr.a (mgr.14388) 15341 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:08:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:54 smithi044 bash[22676]: audit 2024-09-21T04:08:53.127036+0000 mon.a (mon.0) 12300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:54 smithi044 bash[22676]: audit 2024-09-21T04:08:53.133603+0000 mon.a (mon.0) 12301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:54 smithi044 bash[22676]: audit 2024-09-21T04:08:53.141492+0000 mon.a (mon.0) 12302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:54 smithi044 bash[22676]: audit 2024-09-21T04:08:53.150085+0000 mon.a (mon.0) 12303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:54 smithi044 bash[22676]: audit 2024-09-21T04:08:53.163837+0000 mon.a (mon.0) 12304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:54 smithi044 bash[22676]: audit 2024-09-21T04:08:53.170857+0000 mon.a (mon.0) 12305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:54 smithi044 bash[22676]: cluster 2024-09-21T04:08:53.442476+0000 mgr.a (mgr.14388) 15342 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:08:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:54 smithi179 bash[23186]: audit 2024-09-21T04:08:53.127036+0000 mon.a (mon.0) 12300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:54 smithi179 bash[23186]: audit 2024-09-21T04:08:53.133603+0000 mon.a (mon.0) 12301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:54 smithi179 bash[23186]: audit 2024-09-21T04:08:53.141492+0000 mon.a (mon.0) 12302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:54 smithi179 bash[23186]: audit 2024-09-21T04:08:53.150085+0000 mon.a (mon.0) 12303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:54 smithi179 bash[23186]: audit 2024-09-21T04:08:53.163837+0000 mon.a (mon.0) 12304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:54 smithi179 bash[23186]: audit 2024-09-21T04:08:53.170857+0000 mon.a (mon.0) 12305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:54 smithi179 bash[23186]: cluster 2024-09-21T04:08:53.442476+0000 mgr.a (mgr.14388) 15342 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:08:54.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:54 smithi049 bash[23528]: audit 2024-09-21T04:08:53.127036+0000 mon.a (mon.0) 12300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:54 smithi049 bash[23528]: audit 2024-09-21T04:08:53.133603+0000 mon.a (mon.0) 12301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:54 smithi049 bash[23528]: audit 2024-09-21T04:08:53.141492+0000 mon.a (mon.0) 12302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:54 smithi049 bash[23528]: audit 2024-09-21T04:08:53.150085+0000 mon.a (mon.0) 12303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:54 smithi049 bash[23528]: audit 2024-09-21T04:08:53.163837+0000 mon.a (mon.0) 12304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:54 smithi049 bash[23528]: audit 2024-09-21T04:08:53.170857+0000 mon.a (mon.0) 12305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:08:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:54 smithi049 bash[23528]: cluster 2024-09-21T04:08:53.442476+0000 mgr.a (mgr.14388) 15342 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:08:55.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:08:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:08:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:08:55.860 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:08:55.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:08:55.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:08:55.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:08:55.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:08:56.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:56 smithi049 bash[23528]: audit 2024-09-21T04:08:55.429531+0000 mgr.a (mgr.14388) 15343 : audit [DBG] from='client.332055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:56.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:56 smithi049 bash[23528]: cluster 2024-09-21T04:08:55.451884+0000 mgr.a (mgr.14388) 15344 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:56 smithi044 bash[22676]: audit 2024-09-21T04:08:55.429531+0000 mgr.a (mgr.14388) 15343 : audit [DBG] from='client.332055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:56 smithi044 bash[22676]: cluster 2024-09-21T04:08:55.451884+0000 mgr.a (mgr.14388) 15344 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:56 smithi179 bash[23186]: audit 2024-09-21T04:08:55.429531+0000 mgr.a (mgr.14388) 15343 : audit [DBG] from='client.332055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:08:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:56 smithi179 bash[23186]: cluster 2024-09-21T04:08:55.451884+0000 mgr.a (mgr.14388) 15344 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:08:58.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:08:58 smithi049 bash[23528]: cluster 2024-09-21T04:08:57.452828+0000 mgr.a (mgr.14388) 15345 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:08:58.830 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:08:58 smithi179 bash[23186]: cluster 2024-09-21T04:08:57.452828+0000 mgr.a (mgr.14388) 15345 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:08:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:08:58 smithi044 bash[22676]: cluster 2024-09-21T04:08:57.452828+0000 mgr.a (mgr.14388) 15345 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:00.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:00 smithi049 bash[23528]: cluster 2024-09-21T04:08:59.453726+0000 mgr.a (mgr.14388) 15346 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:00.862 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:00.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:00.863 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:00 smithi044 bash[22676]: cluster 2024-09-21T04:08:59.453726+0000 mgr.a (mgr.14388) 15346 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:00 smithi179 bash[23186]: cluster 2024-09-21T04:08:59.453726+0000 mgr.a (mgr.14388) 15346 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:01.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:01.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:01.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:01.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:01.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:02 smithi179 bash[23186]: audit 2024-09-21T04:09:01.192367+0000 mgr.a (mgr.14388) 15347 : audit [DBG] from='client.332133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:02 smithi179 bash[23186]: cluster 2024-09-21T04:09:01.456413+0000 mgr.a (mgr.14388) 15348 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:02 smithi179 bash[23186]: audit 2024-09-21T04:09:01.893280+0000 mon.a (mon.0) 12306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:02 smithi179 bash[23186]: audit 2024-09-21T04:09:01.902970+0000 mon.a (mon.0) 12307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:02 smithi179 bash[23186]: audit 2024-09-21T04:09:01.913321+0000 mon.a (mon.0) 12308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:02 smithi049 bash[23528]: audit 2024-09-21T04:09:01.192367+0000 mgr.a (mgr.14388) 15347 : audit [DBG] from='client.332133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:02.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:02 smithi049 bash[23528]: cluster 2024-09-21T04:09:01.456413+0000 mgr.a (mgr.14388) 15348 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:02.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:02 smithi049 bash[23528]: audit 2024-09-21T04:09:01.893280+0000 mon.a (mon.0) 12306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:02 smithi049 bash[23528]: audit 2024-09-21T04:09:01.902970+0000 mon.a (mon.0) 12307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:02 smithi049 bash[23528]: audit 2024-09-21T04:09:01.913321+0000 mon.a (mon.0) 12308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:02 smithi044 bash[22676]: audit 2024-09-21T04:09:01.192367+0000 mgr.a (mgr.14388) 15347 : audit [DBG] from='client.332133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:02 smithi044 bash[22676]: cluster 2024-09-21T04:09:01.456413+0000 mgr.a (mgr.14388) 15348 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:02 smithi044 bash[22676]: audit 2024-09-21T04:09:01.893280+0000 mon.a (mon.0) 12306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:02 smithi044 bash[22676]: audit 2024-09-21T04:09:01.902970+0000 mon.a (mon.0) 12307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:02 smithi044 bash[22676]: audit 2024-09-21T04:09:01.913321+0000 mon.a (mon.0) 12308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:04.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:04 smithi049 bash[23528]: cluster 2024-09-21T04:09:03.457377+0000 mgr.a (mgr.14388) 15349 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:09:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:04 smithi044 bash[22676]: cluster 2024-09-21T04:09:03.457377+0000 mgr.a (mgr.14388) 15349 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:09:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:04 smithi179 bash[23186]: cluster 2024-09-21T04:09:03.457377+0000 mgr.a (mgr.14388) 15349 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:09:06.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:06.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:06.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:06 smithi049 bash[23528]: cluster 2024-09-21T04:09:05.459729+0000 mgr.a (mgr.14388) 15350 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:09:06.962 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:06 smithi044 bash[22676]: cluster 2024-09-21T04:09:05.459729+0000 mgr.a (mgr.14388) 15350 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:09:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:06 smithi179 bash[23186]: cluster 2024-09-21T04:09:05.459729+0000 mgr.a (mgr.14388) 15350 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:09:07.380 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:08 smithi049 bash[23528]: audit 2024-09-21T04:09:06.954678+0000 mgr.a (mgr.14388) 15351 : audit [DBG] from='client.332211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:08.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:08 smithi049 bash[23528]: cluster 2024-09-21T04:09:07.460638+0000 mgr.a (mgr.14388) 15352 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:08 smithi044 bash[22676]: audit 2024-09-21T04:09:06.954678+0000 mgr.a (mgr.14388) 15351 : audit [DBG] from='client.332211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:08 smithi044 bash[22676]: cluster 2024-09-21T04:09:07.460638+0000 mgr.a (mgr.14388) 15352 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:08 smithi179 bash[23186]: audit 2024-09-21T04:09:06.954678+0000 mgr.a (mgr.14388) 15351 : audit [DBG] from='client.332211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:08 smithi179 bash[23186]: cluster 2024-09-21T04:09:07.460638+0000 mgr.a (mgr.14388) 15352 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:10.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:10 smithi049 bash[23528]: cluster 2024-09-21T04:09:09.461208+0000 mgr.a (mgr.14388) 15353 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:10 smithi044 bash[22676]: cluster 2024-09-21T04:09:09.461208+0000 mgr.a (mgr.14388) 15353 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:10 smithi179 bash[23186]: cluster 2024-09-21T04:09:09.461208+0000 mgr.a (mgr.14388) 15353 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:12.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:12.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:12.382 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:12 smithi049 bash[23528]: cluster 2024-09-21T04:09:11.463413+0000 mgr.a (mgr.14388) 15354 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:12 smithi044 bash[22676]: cluster 2024-09-21T04:09:11.463413+0000 mgr.a (mgr.14388) 15354 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:12 smithi179 bash[23186]: cluster 2024-09-21T04:09:11.463413+0000 mgr.a (mgr.14388) 15354 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:13.156 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:13.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:13.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:13.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:13.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:13 smithi044 bash[22676]: audit 2024-09-21T04:09:12.720287+0000 mgr.a (mgr.14388) 15355 : audit [DBG] from='client.332286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:13 smithi044 bash[22676]: audit 2024-09-21T04:09:13.292158+0000 mon.a (mon.0) 12309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:13 smithi044 bash[22676]: audit 2024-09-21T04:09:13.299976+0000 mon.a (mon.0) 12310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:13 smithi044 bash[22676]: audit 2024-09-21T04:09:13.309808+0000 mon.a (mon.0) 12311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:13 smithi044 bash[22676]: audit 2024-09-21T04:09:13.333780+0000 mon.a (mon.0) 12312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:13 smithi044 bash[22676]: audit 2024-09-21T04:09:13.341485+0000 mon.a (mon.0) 12313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:13 smithi044 bash[22676]: audit 2024-09-21T04:09:13.350592+0000 mon.a (mon.0) 12314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:13 smithi179 bash[23186]: audit 2024-09-21T04:09:12.720287+0000 mgr.a (mgr.14388) 15355 : audit [DBG] from='client.332286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:13 smithi179 bash[23186]: audit 2024-09-21T04:09:13.292158+0000 mon.a (mon.0) 12309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:13 smithi179 bash[23186]: audit 2024-09-21T04:09:13.299976+0000 mon.a (mon.0) 12310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:13 smithi179 bash[23186]: audit 2024-09-21T04:09:13.309808+0000 mon.a (mon.0) 12311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:13 smithi179 bash[23186]: audit 2024-09-21T04:09:13.333780+0000 mon.a (mon.0) 12312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:13 smithi179 bash[23186]: audit 2024-09-21T04:09:13.341485+0000 mon.a (mon.0) 12313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:13 smithi179 bash[23186]: audit 2024-09-21T04:09:13.350592+0000 mon.a (mon.0) 12314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:13 smithi049 bash[23528]: audit 2024-09-21T04:09:12.720287+0000 mgr.a (mgr.14388) 15355 : audit [DBG] from='client.332286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:13.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:13 smithi049 bash[23528]: audit 2024-09-21T04:09:13.292158+0000 mon.a (mon.0) 12309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:13 smithi049 bash[23528]: audit 2024-09-21T04:09:13.299976+0000 mon.a (mon.0) 12310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:13 smithi049 bash[23528]: audit 2024-09-21T04:09:13.309808+0000 mon.a (mon.0) 12311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:13 smithi049 bash[23528]: audit 2024-09-21T04:09:13.333780+0000 mon.a (mon.0) 12312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:13 smithi049 bash[23528]: audit 2024-09-21T04:09:13.341485+0000 mon.a (mon.0) 12313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:13 smithi049 bash[23528]: audit 2024-09-21T04:09:13.350592+0000 mon.a (mon.0) 12314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:14.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:14 smithi049 bash[23528]: cluster 2024-09-21T04:09:13.464252+0000 mgr.a (mgr.14388) 15356 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:14 smithi044 bash[22676]: cluster 2024-09-21T04:09:13.464252+0000 mgr.a (mgr.14388) 15356 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:14 smithi179 bash[23186]: cluster 2024-09-21T04:09:13.464252+0000 mgr.a (mgr.14388) 15356 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:16 smithi044 bash[22676]: cluster 2024-09-21T04:09:15.466534+0000 mgr.a (mgr.14388) 15357 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:16 smithi179 bash[23186]: cluster 2024-09-21T04:09:15.466534+0000 mgr.a (mgr.14388) 15357 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:16 smithi049 bash[23528]: cluster 2024-09-21T04:09:15.466534+0000 mgr.a (mgr.14388) 15357 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:18.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:18.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:18.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:18.941 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:18 smithi044 bash[22676]: cluster 2024-09-21T04:09:17.467301+0000 mgr.a (mgr.14388) 15358 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:18 smithi179 bash[23186]: cluster 2024-09-21T04:09:17.467301+0000 mgr.a (mgr.14388) 15358 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:18 smithi049 bash[23528]: cluster 2024-09-21T04:09:17.467301+0000 mgr.a (mgr.14388) 15358 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:19 smithi044 bash[22676]: audit 2024-09-21T04:09:18.489454+0000 mgr.a (mgr.14388) 15359 : audit [DBG] from='client.332364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:19 smithi179 bash[23186]: audit 2024-09-21T04:09:18.489454+0000 mgr.a (mgr.14388) 15359 : audit [DBG] from='client.332364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:20.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:19 smithi049 bash[23528]: audit 2024-09-21T04:09:18.489454+0000 mgr.a (mgr.14388) 15359 : audit [DBG] from='client.332364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:20.657 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:20 smithi179 bash[23186]: cluster 2024-09-21T04:09:19.468349+0000 mgr.a (mgr.14388) 15360 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:20 smithi044 bash[22676]: cluster 2024-09-21T04:09:19.468349+0000 mgr.a (mgr.14388) 15360 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:20 smithi049 bash[23528]: cluster 2024-09-21T04:09:19.468349+0000 mgr.a (mgr.14388) 15360 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:22.840 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:22 smithi179 bash[23186]: cluster 2024-09-21T04:09:21.470817+0000 mgr.a (mgr.14388) 15361 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:22.841 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:22 smithi179 bash[23186]: audit 2024-09-21T04:09:22.129898+0000 mon.a (mon.0) 12315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:22.841 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:22 smithi179 bash[23186]: audit 2024-09-21T04:09:22.140313+0000 mon.a (mon.0) 12316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:22.841 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:22 smithi179 bash[23186]: audit 2024-09-21T04:09:22.152515+0000 mon.a (mon.0) 12317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:22 smithi044 bash[22676]: cluster 2024-09-21T04:09:21.470817+0000 mgr.a (mgr.14388) 15361 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:22 smithi044 bash[22676]: audit 2024-09-21T04:09:22.129898+0000 mon.a (mon.0) 12315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:22 smithi044 bash[22676]: audit 2024-09-21T04:09:22.140313+0000 mon.a (mon.0) 12316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:22 smithi044 bash[22676]: audit 2024-09-21T04:09:22.152515+0000 mon.a (mon.0) 12317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:22 smithi049 bash[23528]: cluster 2024-09-21T04:09:21.470817+0000 mgr.a (mgr.14388) 15361 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:22 smithi049 bash[23528]: audit 2024-09-21T04:09:22.129898+0000 mon.a (mon.0) 12315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:22 smithi049 bash[23528]: audit 2024-09-21T04:09:22.140313+0000 mon.a (mon.0) 12316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:23.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:22 smithi049 bash[23528]: audit 2024-09-21T04:09:22.152515+0000 mon.a (mon.0) 12317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:23.943 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:24.720 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:24.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:24.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:24.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:24.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:24 smithi044 bash[22676]: cluster 2024-09-21T04:09:23.471734+0000 mgr.a (mgr.14388) 15362 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:25.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:24 smithi179 bash[23186]: cluster 2024-09-21T04:09:23.471734+0000 mgr.a (mgr.14388) 15362 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:24 smithi049 bash[23528]: cluster 2024-09-21T04:09:23.471734+0000 mgr.a (mgr.14388) 15362 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:25 smithi044 bash[22676]: audit 2024-09-21T04:09:24.276102+0000 mgr.a (mgr.14388) 15363 : audit [DBG] from='client.332439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:25 smithi179 bash[23186]: audit 2024-09-21T04:09:24.276102+0000 mgr.a (mgr.14388) 15363 : audit [DBG] from='client.332439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:25 smithi049 bash[23528]: audit 2024-09-21T04:09:24.276102+0000 mgr.a (mgr.14388) 15363 : audit [DBG] from='client.332439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:26 smithi044 bash[22676]: cluster 2024-09-21T04:09:25.474239+0000 mgr.a (mgr.14388) 15364 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:26 smithi179 bash[23186]: cluster 2024-09-21T04:09:25.474239+0000 mgr.a (mgr.14388) 15364 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:26 smithi049 bash[23528]: cluster 2024-09-21T04:09:25.474239+0000 mgr.a (mgr.14388) 15364 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:28.890 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:28 smithi049 bash[23528]: cluster 2024-09-21T04:09:27.475172+0000 mgr.a (mgr.14388) 15365 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:28 smithi044 bash[22676]: cluster 2024-09-21T04:09:27.475172+0000 mgr.a (mgr.14388) 15365 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:28 smithi179 bash[23186]: cluster 2024-09-21T04:09:27.475172+0000 mgr.a (mgr.14388) 15365 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:29.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:30.459 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:30.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:30.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:30.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:30.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:30.879 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:30 smithi049 bash[23528]: cluster 2024-09-21T04:09:29.475723+0000 mgr.a (mgr.14388) 15366 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:30 smithi044 bash[22676]: cluster 2024-09-21T04:09:29.475723+0000 mgr.a (mgr.14388) 15366 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:30 smithi179 bash[23186]: cluster 2024-09-21T04:09:29.475723+0000 mgr.a (mgr.14388) 15366 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:31.871 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:31 smithi049 bash[23528]: audit 2024-09-21T04:09:30.036991+0000 mgr.a (mgr.14388) 15367 : audit [DBG] from='client.332517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:31 smithi044 bash[22676]: audit 2024-09-21T04:09:30.036991+0000 mgr.a (mgr.14388) 15367 : audit [DBG] from='client.332517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:32.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:31 smithi179 bash[23186]: audit 2024-09-21T04:09:30.036991+0000 mgr.a (mgr.14388) 15367 : audit [DBG] from='client.332517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:32 smithi044 bash[22676]: cluster 2024-09-21T04:09:31.478799+0000 mgr.a (mgr.14388) 15368 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:32 smithi179 bash[23186]: cluster 2024-09-21T04:09:31.478799+0000 mgr.a (mgr.14388) 15368 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:32 smithi049 bash[23528]: cluster 2024-09-21T04:09:31.478799+0000 mgr.a (mgr.14388) 15368 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:34 smithi049 bash[23528]: cluster 2024-09-21T04:09:33.479839+0000 mgr.a (mgr.14388) 15369 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:34 smithi049 bash[23528]: audit 2024-09-21T04:09:33.531189+0000 mon.a (mon.0) 12318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:34 smithi049 bash[23528]: audit 2024-09-21T04:09:33.540057+0000 mon.a (mon.0) 12319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:34 smithi049 bash[23528]: audit 2024-09-21T04:09:33.550468+0000 mon.a (mon.0) 12320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:34 smithi049 bash[23528]: audit 2024-09-21T04:09:33.562849+0000 mon.a (mon.0) 12321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:34 smithi049 bash[23528]: audit 2024-09-21T04:09:33.571131+0000 mon.a (mon.0) 12322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:34 smithi049 bash[23528]: audit 2024-09-21T04:09:33.581033+0000 mon.a (mon.0) 12323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:34 smithi044 bash[22676]: cluster 2024-09-21T04:09:33.479839+0000 mgr.a (mgr.14388) 15369 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:34 smithi044 bash[22676]: audit 2024-09-21T04:09:33.531189+0000 mon.a (mon.0) 12318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:34 smithi044 bash[22676]: audit 2024-09-21T04:09:33.540057+0000 mon.a (mon.0) 12319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:34 smithi044 bash[22676]: audit 2024-09-21T04:09:33.550468+0000 mon.a (mon.0) 12320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:34 smithi044 bash[22676]: audit 2024-09-21T04:09:33.562849+0000 mon.a (mon.0) 12321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:34 smithi044 bash[22676]: audit 2024-09-21T04:09:33.571131+0000 mon.a (mon.0) 12322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:34.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:34 smithi044 bash[22676]: audit 2024-09-21T04:09:33.581033+0000 mon.a (mon.0) 12323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:34 smithi179 bash[23186]: cluster 2024-09-21T04:09:33.479839+0000 mgr.a (mgr.14388) 15369 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:34 smithi179 bash[23186]: audit 2024-09-21T04:09:33.531189+0000 mon.a (mon.0) 12318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:34 smithi179 bash[23186]: audit 2024-09-21T04:09:33.540057+0000 mon.a (mon.0) 12319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:34 smithi179 bash[23186]: audit 2024-09-21T04:09:33.550468+0000 mon.a (mon.0) 12320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:34 smithi179 bash[23186]: audit 2024-09-21T04:09:33.562849+0000 mon.a (mon.0) 12321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:34 smithi179 bash[23186]: audit 2024-09-21T04:09:33.571131+0000 mon.a (mon.0) 12322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:35.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:34 smithi179 bash[23186]: audit 2024-09-21T04:09:33.581033+0000 mon.a (mon.0) 12323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:35.460 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:35.461 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:35.461 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:36.240 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:36 smithi049 bash[23528]: cluster 2024-09-21T04:09:35.481470+0000 mgr.a (mgr.14388) 15370 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:36.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:36 smithi049 bash[23528]: audit 2024-09-21T04:09:35.791838+0000 mgr.a (mgr.14388) 15371 : audit [DBG] from='client.332595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:36 smithi044 bash[22676]: cluster 2024-09-21T04:09:35.481470+0000 mgr.a (mgr.14388) 15370 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:36 smithi044 bash[22676]: audit 2024-09-21T04:09:35.791838+0000 mgr.a (mgr.14388) 15371 : audit [DBG] from='client.332595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:36 smithi179 bash[23186]: cluster 2024-09-21T04:09:35.481470+0000 mgr.a (mgr.14388) 15370 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:36 smithi179 bash[23186]: audit 2024-09-21T04:09:35.791838+0000 mgr.a (mgr.14388) 15371 : audit [DBG] from='client.332595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:38.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22930]: debug 2024-09-21T04:09:38.429+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:09:38.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22930]: debug 2024-09-21T04:09:38.433+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:09:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22676]: cluster 2024-09-21T04:09:37.482430+0000 mgr.a (mgr.14388) 15372 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22676]: audit 2024-09-21T04:09:37.628627+0000 mon.a (mon.0) 12324 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:09:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22676]: audit 2024-09-21T04:09:37.635806+0000 mon.a (mon.0) 12325 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:09:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22676]: audit 2024-09-21T04:09:37.637855+0000 mon.a (mon.0) 12326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:09:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22676]: audit 2024-09-21T04:09:37.649370+0000 mon.a (mon.0) 12327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22676]: audit 2024-09-21T04:09:37.656481+0000 mon.a (mon.0) 12328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:09:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:38 smithi044 bash[22676]: audit 2024-09-21T04:09:37.659049+0000 mgr.a (mgr.14388) 15373 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:09:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:38 smithi049 bash[23528]: cluster 2024-09-21T04:09:37.482430+0000 mgr.a (mgr.14388) 15372 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:38 smithi049 bash[23528]: audit 2024-09-21T04:09:37.628627+0000 mon.a (mon.0) 12324 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:09:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:38 smithi049 bash[23528]: audit 2024-09-21T04:09:37.635806+0000 mon.a (mon.0) 12325 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:09:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:38 smithi049 bash[23528]: audit 2024-09-21T04:09:37.637855+0000 mon.a (mon.0) 12326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:09:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:38 smithi049 bash[23528]: audit 2024-09-21T04:09:37.649370+0000 mon.a (mon.0) 12327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:38 smithi049 bash[23528]: audit 2024-09-21T04:09:37.656481+0000 mon.a (mon.0) 12328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:09:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:38 smithi049 bash[23528]: audit 2024-09-21T04:09:37.659049+0000 mgr.a (mgr.14388) 15373 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:09:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:38 smithi179 bash[23186]: cluster 2024-09-21T04:09:37.482430+0000 mgr.a (mgr.14388) 15372 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:09:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:38 smithi179 bash[23186]: audit 2024-09-21T04:09:37.628627+0000 mon.a (mon.0) 12324 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:09:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:38 smithi179 bash[23186]: audit 2024-09-21T04:09:37.635806+0000 mon.a (mon.0) 12325 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:09:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:38 smithi179 bash[23186]: audit 2024-09-21T04:09:37.637855+0000 mon.a (mon.0) 12326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:09:39.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:38 smithi179 bash[23186]: audit 2024-09-21T04:09:37.649370+0000 mon.a (mon.0) 12327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:39.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:38 smithi179 bash[23186]: audit 2024-09-21T04:09:37.656481+0000 mon.a (mon.0) 12328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:09:39.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:38 smithi179 bash[23186]: audit 2024-09-21T04:09:37.659049+0000 mgr.a (mgr.14388) 15373 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:09:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:39 smithi049 bash[23528]: audit 2024-09-21T04:09:38.437082+0000 mgr.a (mgr.14388) 15374 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:09:39.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:39 smithi049 bash[23528]: cephadm 2024-09-21T04:09:38.438244+0000 mgr.a (mgr.14388) 15375 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:09:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:39 smithi044 bash[22676]: audit 2024-09-21T04:09:38.437082+0000 mgr.a (mgr.14388) 15374 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:09:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:39 smithi044 bash[22676]: cephadm 2024-09-21T04:09:38.438244+0000 mgr.a (mgr.14388) 15375 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:09:40.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:39 smithi179 bash[23186]: audit 2024-09-21T04:09:38.437082+0000 mgr.a (mgr.14388) 15374 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:09:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:39 smithi179 bash[23186]: cephadm 2024-09-21T04:09:38.438244+0000 mgr.a (mgr.14388) 15375 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:09:40.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:40 smithi049 bash[23528]: cluster 2024-09-21T04:09:39.483413+0000 mgr.a (mgr.14388) 15376 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:09:40.862 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:40 smithi179 bash[23186]: cluster 2024-09-21T04:09:39.483413+0000 mgr.a (mgr.14388) 15376 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:09:40.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:40 smithi044 bash[22676]: cluster 2024-09-21T04:09:39.483413+0000 mgr.a (mgr.14388) 15376 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:09:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:42.034 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:42.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:42.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:42.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:42.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:42 smithi179 bash[23186]: cluster 2024-09-21T04:09:41.485611+0000 mgr.a (mgr.14388) 15377 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:42 smithi179 bash[23186]: audit 2024-09-21T04:09:41.582985+0000 mgr.a (mgr.14388) 15378 : audit [DBG] from='client.332781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:42 smithi179 bash[23186]: audit 2024-09-21T04:09:42.369210+0000 mon.a (mon.0) 12329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:42 smithi179 bash[23186]: audit 2024-09-21T04:09:42.379060+0000 mon.a (mon.0) 12330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:42 smithi179 bash[23186]: audit 2024-09-21T04:09:42.390933+0000 mon.a (mon.0) 12331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:42 smithi049 bash[23528]: cluster 2024-09-21T04:09:41.485611+0000 mgr.a (mgr.14388) 15377 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:42 smithi049 bash[23528]: audit 2024-09-21T04:09:41.582985+0000 mgr.a (mgr.14388) 15378 : audit [DBG] from='client.332781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:42.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:42 smithi049 bash[23528]: audit 2024-09-21T04:09:42.369210+0000 mon.a (mon.0) 12329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:42 smithi049 bash[23528]: audit 2024-09-21T04:09:42.379060+0000 mon.a (mon.0) 12330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:42 smithi049 bash[23528]: audit 2024-09-21T04:09:42.390933+0000 mon.a (mon.0) 12331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:42 smithi044 bash[22676]: cluster 2024-09-21T04:09:41.485611+0000 mgr.a (mgr.14388) 15377 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:42 smithi044 bash[22676]: audit 2024-09-21T04:09:41.582985+0000 mgr.a (mgr.14388) 15378 : audit [DBG] from='client.332781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:42 smithi044 bash[22676]: audit 2024-09-21T04:09:42.369210+0000 mon.a (mon.0) 12329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:42 smithi044 bash[22676]: audit 2024-09-21T04:09:42.379060+0000 mon.a (mon.0) 12330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:42 smithi044 bash[22676]: audit 2024-09-21T04:09:42.390933+0000 mon.a (mon.0) 12331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:44 smithi044 bash[22676]: cluster 2024-09-21T04:09:43.486561+0000 mgr.a (mgr.14388) 15379 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:44 smithi179 bash[23186]: cluster 2024-09-21T04:09:43.486561+0000 mgr.a (mgr.14388) 15379 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:44 smithi049 bash[23528]: cluster 2024-09-21T04:09:43.486561+0000 mgr.a (mgr.14388) 15379 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:46 smithi044 bash[22676]: cluster 2024-09-21T04:09:45.488739+0000 mgr.a (mgr.14388) 15380 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:46 smithi179 bash[23186]: cluster 2024-09-21T04:09:45.488739+0000 mgr.a (mgr.14388) 15380 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:47.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:46 smithi049 bash[23528]: cluster 2024-09-21T04:09:45.488739+0000 mgr.a (mgr.14388) 15380 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:47.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:47.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:47.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:47.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:47.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:48 smithi044 bash[22676]: audit 2024-09-21T04:09:47.369844+0000 mgr.a (mgr.14388) 15381 : audit [DBG] from='client.332859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:48 smithi044 bash[22676]: cluster 2024-09-21T04:09:47.489243+0000 mgr.a (mgr.14388) 15382 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:48 smithi179 bash[23186]: audit 2024-09-21T04:09:47.369844+0000 mgr.a (mgr.14388) 15381 : audit [DBG] from='client.332859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:48 smithi179 bash[23186]: cluster 2024-09-21T04:09:47.489243+0000 mgr.a (mgr.14388) 15382 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:48 smithi049 bash[23528]: audit 2024-09-21T04:09:47.369844+0000 mgr.a (mgr.14388) 15381 : audit [DBG] from='client.332859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:48 smithi049 bash[23528]: cluster 2024-09-21T04:09:47.489243+0000 mgr.a (mgr.14388) 15382 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:50.772 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:50 smithi049 bash[23528]: cluster 2024-09-21T04:09:49.490195+0000 mgr.a (mgr.14388) 15383 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:50 smithi044 bash[22676]: cluster 2024-09-21T04:09:49.490195+0000 mgr.a (mgr.14388) 15383 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:50 smithi179 bash[23186]: cluster 2024-09-21T04:09:49.490195+0000 mgr.a (mgr.14388) 15383 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:52.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:52 smithi049 bash[23528]: cluster 2024-09-21T04:09:51.492479+0000 mgr.a (mgr.14388) 15384 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:52.804 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:52.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:52.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:52 smithi044 bash[22676]: cluster 2024-09-21T04:09:51.492479+0000 mgr.a (mgr.14388) 15384 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:52 smithi179 bash[23186]: cluster 2024-09-21T04:09:51.492479+0000 mgr.a (mgr.14388) 15384 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:09:53.601 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:53.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:53.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:53.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:53.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:09:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: audit 2024-09-21T04:09:53.145051+0000 mgr.a (mgr.14388) 15385 : audit [DBG] from='client.332937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: cluster 2024-09-21T04:09:53.493105+0000 mgr.a (mgr.14388) 15386 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: audit 2024-09-21T04:09:53.685093+0000 mon.a (mon.0) 12332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: audit 2024-09-21T04:09:53.690213+0000 mon.a (mon.0) 12333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: audit 2024-09-21T04:09:53.707499+0000 mon.a (mon.0) 12334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: audit 2024-09-21T04:09:53.788497+0000 mon.a (mon.0) 12335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: audit 2024-09-21T04:09:53.796423+0000 mon.a (mon.0) 12336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:54 smithi044 bash[22676]: audit 2024-09-21T04:09:53.806088+0000 mon.a (mon.0) 12337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: audit 2024-09-21T04:09:53.145051+0000 mgr.a (mgr.14388) 15385 : audit [DBG] from='client.332937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: cluster 2024-09-21T04:09:53.493105+0000 mgr.a (mgr.14388) 15386 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: audit 2024-09-21T04:09:53.685093+0000 mon.a (mon.0) 12332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: audit 2024-09-21T04:09:53.690213+0000 mon.a (mon.0) 12333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: audit 2024-09-21T04:09:53.707499+0000 mon.a (mon.0) 12334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: audit 2024-09-21T04:09:53.788497+0000 mon.a (mon.0) 12335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: audit 2024-09-21T04:09:53.796423+0000 mon.a (mon.0) 12336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:54 smithi179 bash[23186]: audit 2024-09-21T04:09:53.806088+0000 mon.a (mon.0) 12337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: audit 2024-09-21T04:09:53.145051+0000 mgr.a (mgr.14388) 15385 : audit [DBG] from='client.332937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:09:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: cluster 2024-09-21T04:09:53.493105+0000 mgr.a (mgr.14388) 15386 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: audit 2024-09-21T04:09:53.685093+0000 mon.a (mon.0) 12332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: audit 2024-09-21T04:09:53.690213+0000 mon.a (mon.0) 12333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: audit 2024-09-21T04:09:53.707499+0000 mon.a (mon.0) 12334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: audit 2024-09-21T04:09:53.788497+0000 mon.a (mon.0) 12335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: audit 2024-09-21T04:09:53.796423+0000 mon.a (mon.0) 12336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:54 smithi049 bash[23528]: audit 2024-09-21T04:09:53.806088+0000 mon.a (mon.0) 12337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:09:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:56 smithi044 bash[22676]: cluster 2024-09-21T04:09:55.495352+0000 mgr.a (mgr.14388) 15387 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:56 smithi179 bash[23186]: cluster 2024-09-21T04:09:55.495352+0000 mgr.a (mgr.14388) 15387 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:56 smithi049 bash[23528]: cluster 2024-09-21T04:09:55.495352+0000 mgr.a (mgr.14388) 15387 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:09:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:09:58.603 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:09:58.604 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:09:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:09:58 smithi044 bash[22676]: cluster 2024-09-21T04:09:57.496175+0000 mgr.a (mgr.14388) 15388 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:09:58 smithi179 bash[23186]: cluster 2024-09-21T04:09:57.496175+0000 mgr.a (mgr.14388) 15388 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:09:58 smithi049 bash[23528]: cluster 2024-09-21T04:09:57.496175+0000 mgr.a (mgr.14388) 15388 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:09:59.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:09:59.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:09:59.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:09:59.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:09:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:00.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:00 smithi179 bash[23186]: audit 2024-09-21T04:09:58.930244+0000 mgr.a (mgr.14388) 15389 : audit [DBG] from='client.333015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:00.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:00 smithi179 bash[23186]: cluster 2024-09-21T04:09:59.497126+0000 mgr.a (mgr.14388) 15390 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:00.865 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:00 smithi179 bash[23186]: cluster 2024-09-21T04:10:00.000155+0000 mon.a (mon.0) 12338 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:00 smithi044 bash[22676]: audit 2024-09-21T04:09:58.930244+0000 mgr.a (mgr.14388) 15389 : audit [DBG] from='client.333015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:00 smithi044 bash[22676]: cluster 2024-09-21T04:09:59.497126+0000 mgr.a (mgr.14388) 15390 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:00 smithi044 bash[22676]: cluster 2024-09-21T04:10:00.000155+0000 mon.a (mon.0) 12338 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:10:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:00 smithi049 bash[23528]: audit 2024-09-21T04:09:58.930244+0000 mgr.a (mgr.14388) 15389 : audit [DBG] from='client.333015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:00 smithi049 bash[23528]: cluster 2024-09-21T04:09:59.497126+0000 mgr.a (mgr.14388) 15390 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:00 smithi049 bash[23528]: cluster 2024-09-21T04:10:00.000155+0000 mon.a (mon.0) 12338 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:10:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:02 smithi044 bash[22676]: cluster 2024-09-21T04:10:01.498416+0000 mgr.a (mgr.14388) 15391 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:02 smithi044 bash[22676]: audit 2024-09-21T04:10:02.608911+0000 mon.a (mon.0) 12339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:02 smithi044 bash[22676]: audit 2024-09-21T04:10:02.617680+0000 mon.a (mon.0) 12340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:02 smithi044 bash[22676]: audit 2024-09-21T04:10:02.628277+0000 mon.a (mon.0) 12341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:02 smithi179 bash[23186]: cluster 2024-09-21T04:10:01.498416+0000 mgr.a (mgr.14388) 15391 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:02 smithi179 bash[23186]: audit 2024-09-21T04:10:02.608911+0000 mon.a (mon.0) 12339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:02 smithi179 bash[23186]: audit 2024-09-21T04:10:02.617680+0000 mon.a (mon.0) 12340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:02 smithi179 bash[23186]: audit 2024-09-21T04:10:02.628277+0000 mon.a (mon.0) 12341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:02 smithi049 bash[23528]: cluster 2024-09-21T04:10:01.498416+0000 mgr.a (mgr.14388) 15391 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:02 smithi049 bash[23528]: audit 2024-09-21T04:10:02.608911+0000 mon.a (mon.0) 12339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:02 smithi049 bash[23528]: audit 2024-09-21T04:10:02.617680+0000 mon.a (mon.0) 12340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:02 smithi049 bash[23528]: audit 2024-09-21T04:10:02.628277+0000 mon.a (mon.0) 12341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:04.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:04 smithi044 bash[22676]: cluster 2024-09-21T04:10:03.499171+0000 mgr.a (mgr.14388) 15392 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:04 smithi179 bash[23186]: cluster 2024-09-21T04:10:03.499171+0000 mgr.a (mgr.14388) 15392 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:04 smithi049 bash[23528]: cluster 2024-09-21T04:10:03.499171+0000 mgr.a (mgr.14388) 15392 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:05.140 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:05.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:05 smithi044 bash[22676]: audit 2024-09-21T04:10:04.692112+0000 mgr.a (mgr.14388) 15393 : audit [DBG] from='client.333087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:05 smithi179 bash[23186]: audit 2024-09-21T04:10:04.692112+0000 mgr.a (mgr.14388) 15393 : audit [DBG] from='client.333087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:05 smithi049 bash[23528]: audit 2024-09-21T04:10:04.692112+0000 mgr.a (mgr.14388) 15393 : audit [DBG] from='client.333087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:06 smithi044 bash[22676]: cluster 2024-09-21T04:10:05.501709+0000 mgr.a (mgr.14388) 15394 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:10:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:06 smithi179 bash[23186]: cluster 2024-09-21T04:10:05.501709+0000 mgr.a (mgr.14388) 15394 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:10:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:06 smithi049 bash[23528]: cluster 2024-09-21T04:10:05.501709+0000 mgr.a (mgr.14388) 15394 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:10:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:08 smithi044 bash[22676]: cluster 2024-09-21T04:10:07.502493+0000 mgr.a (mgr.14388) 15395 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:10:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:08 smithi179 bash[23186]: cluster 2024-09-21T04:10:07.502493+0000 mgr.a (mgr.14388) 15395 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:10:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:08 smithi049 bash[23528]: cluster 2024-09-21T04:10:07.502493+0000 mgr.a (mgr.14388) 15395 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:10:10.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:10.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:10.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:10.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:10.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:10.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:10.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:10.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:10 smithi044 bash[22676]: cluster 2024-09-21T04:10:09.503002+0000 mgr.a (mgr.14388) 15396 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:10:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:10 smithi179 bash[23186]: cluster 2024-09-21T04:10:09.503002+0000 mgr.a (mgr.14388) 15396 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:10:11.013 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:10 smithi049 bash[23528]: cluster 2024-09-21T04:10:09.503002+0000 mgr.a (mgr.14388) 15396 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:10:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:11 smithi179 bash[23186]: audit 2024-09-21T04:10:10.468130+0000 mgr.a (mgr.14388) 15397 : audit [DBG] from='client.333165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:12.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:11 smithi049 bash[23528]: audit 2024-09-21T04:10:10.468130+0000 mgr.a (mgr.14388) 15397 : audit [DBG] from='client.333165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:11 smithi044 bash[22676]: audit 2024-09-21T04:10:10.468130+0000 mgr.a (mgr.14388) 15397 : audit [DBG] from='client.333165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:12 smithi179 bash[23186]: cluster 2024-09-21T04:10:11.506005+0000 mgr.a (mgr.14388) 15398 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:12 smithi049 bash[23528]: cluster 2024-09-21T04:10:11.506005+0000 mgr.a (mgr.14388) 15398 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:12 smithi044 bash[22676]: cluster 2024-09-21T04:10:11.506005+0000 mgr.a (mgr.14388) 15398 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:14 smithi179 bash[23186]: cluster 2024-09-21T04:10:13.506799+0000 mgr.a (mgr.14388) 15399 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:10:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:14 smithi179 bash[23186]: audit 2024-09-21T04:10:13.915472+0000 mon.a (mon.0) 12342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:14 smithi179 bash[23186]: audit 2024-09-21T04:10:13.925073+0000 mon.a (mon.0) 12343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:14 smithi179 bash[23186]: audit 2024-09-21T04:10:13.935525+0000 mon.a (mon.0) 12344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:14 smithi179 bash[23186]: audit 2024-09-21T04:10:14.000000+0000 mon.a (mon.0) 12345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:14 smithi179 bash[23186]: audit 2024-09-21T04:10:14.008346+0000 mon.a (mon.0) 12346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:14 smithi179 bash[23186]: audit 2024-09-21T04:10:14.018245+0000 mon.a (mon.0) 12347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:14 smithi049 bash[23528]: cluster 2024-09-21T04:10:13.506799+0000 mgr.a (mgr.14388) 15399 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:10:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:14 smithi049 bash[23528]: audit 2024-09-21T04:10:13.915472+0000 mon.a (mon.0) 12342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:14 smithi049 bash[23528]: audit 2024-09-21T04:10:13.925073+0000 mon.a (mon.0) 12343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:14 smithi049 bash[23528]: audit 2024-09-21T04:10:13.935525+0000 mon.a (mon.0) 12344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:14 smithi049 bash[23528]: audit 2024-09-21T04:10:14.000000+0000 mon.a (mon.0) 12345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:14 smithi049 bash[23528]: audit 2024-09-21T04:10:14.008346+0000 mon.a (mon.0) 12346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:14 smithi049 bash[23528]: audit 2024-09-21T04:10:14.018245+0000 mon.a (mon.0) 12347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:14 smithi044 bash[22676]: cluster 2024-09-21T04:10:13.506799+0000 mgr.a (mgr.14388) 15399 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:10:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:14 smithi044 bash[22676]: audit 2024-09-21T04:10:13.915472+0000 mon.a (mon.0) 12342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:14 smithi044 bash[22676]: audit 2024-09-21T04:10:13.925073+0000 mon.a (mon.0) 12343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:14 smithi044 bash[22676]: audit 2024-09-21T04:10:13.935525+0000 mon.a (mon.0) 12344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:14 smithi044 bash[22676]: audit 2024-09-21T04:10:14.000000+0000 mon.a (mon.0) 12345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:14 smithi044 bash[22676]: audit 2024-09-21T04:10:14.008346+0000 mon.a (mon.0) 12346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:14 smithi044 bash[22676]: audit 2024-09-21T04:10:14.018245+0000 mon.a (mon.0) 12347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:15.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:15.922 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:15.923 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:16.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:16.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:16.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:16.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:16.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:16 smithi179 bash[23186]: cluster 2024-09-21T04:10:15.508774+0000 mgr.a (mgr.14388) 15400 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:16 smithi049 bash[23528]: cluster 2024-09-21T04:10:15.508774+0000 mgr.a (mgr.14388) 15400 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:16 smithi044 bash[22676]: cluster 2024-09-21T04:10:15.508774+0000 mgr.a (mgr.14388) 15400 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:18.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:17 smithi049 bash[23528]: audit 2024-09-21T04:10:16.251208+0000 mgr.a (mgr.14388) 15401 : audit [DBG] from='client.333243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:17 smithi044 bash[22676]: audit 2024-09-21T04:10:16.251208+0000 mgr.a (mgr.14388) 15401 : audit [DBG] from='client.333243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:17 smithi179 bash[23186]: audit 2024-09-21T04:10:16.251208+0000 mgr.a (mgr.14388) 15401 : audit [DBG] from='client.333243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:18 smithi049 bash[23528]: cluster 2024-09-21T04:10:17.509817+0000 mgr.a (mgr.14388) 15402 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:10:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:18 smithi044 bash[22676]: cluster 2024-09-21T04:10:17.509817+0000 mgr.a (mgr.14388) 15402 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:10:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:18 smithi179 bash[23186]: cluster 2024-09-21T04:10:17.509817+0000 mgr.a (mgr.14388) 15402 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:10:21.045 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:20 smithi179 bash[23186]: cluster 2024-09-21T04:10:19.510522+0000 mgr.a (mgr.14388) 15403 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:10:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:20 smithi049 bash[23528]: cluster 2024-09-21T04:10:19.510522+0000 mgr.a (mgr.14388) 15403 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:10:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:20 smithi044 bash[22676]: cluster 2024-09-21T04:10:19.510522+0000 mgr.a (mgr.14388) 15403 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:10:21.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:21.682 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:21.682 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:22.435 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:22.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:22 smithi049 bash[23528]: cluster 2024-09-21T04:10:21.512747+0000 mgr.a (mgr.14388) 15404 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:10:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:22 smithi044 bash[22676]: cluster 2024-09-21T04:10:21.512747+0000 mgr.a (mgr.14388) 15404 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:10:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:22 smithi179 bash[23186]: cluster 2024-09-21T04:10:21.512747+0000 mgr.a (mgr.14388) 15404 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:10:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:23 smithi044 bash[22676]: audit 2024-09-21T04:10:22.009710+0000 mgr.a (mgr.14388) 15405 : audit [DBG] from='client.333321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:23 smithi044 bash[22676]: audit 2024-09-21T04:10:22.842547+0000 mon.a (mon.0) 12348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:23 smithi044 bash[22676]: audit 2024-09-21T04:10:22.850894+0000 mon.a (mon.0) 12349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:23 smithi044 bash[22676]: audit 2024-09-21T04:10:22.861518+0000 mon.a (mon.0) 12350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:23 smithi179 bash[23186]: audit 2024-09-21T04:10:22.009710+0000 mgr.a (mgr.14388) 15405 : audit [DBG] from='client.333321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:23 smithi179 bash[23186]: audit 2024-09-21T04:10:22.842547+0000 mon.a (mon.0) 12348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:23 smithi179 bash[23186]: audit 2024-09-21T04:10:22.850894+0000 mon.a (mon.0) 12349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:23 smithi179 bash[23186]: audit 2024-09-21T04:10:22.861518+0000 mon.a (mon.0) 12350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:23 smithi049 bash[23528]: audit 2024-09-21T04:10:22.009710+0000 mgr.a (mgr.14388) 15405 : audit [DBG] from='client.333321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:23 smithi049 bash[23528]: audit 2024-09-21T04:10:22.842547+0000 mon.a (mon.0) 12348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:23 smithi049 bash[23528]: audit 2024-09-21T04:10:22.850894+0000 mon.a (mon.0) 12349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:23 smithi049 bash[23528]: audit 2024-09-21T04:10:22.861518+0000 mon.a (mon.0) 12350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:24 smithi044 bash[22676]: cluster 2024-09-21T04:10:23.513718+0000 mgr.a (mgr.14388) 15406 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:24 smithi179 bash[23186]: cluster 2024-09-21T04:10:23.513718+0000 mgr.a (mgr.14388) 15406 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:24 smithi049 bash[23528]: cluster 2024-09-21T04:10:23.513718+0000 mgr.a (mgr.14388) 15406 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:26 smithi044 bash[22676]: cluster 2024-09-21T04:10:25.515829+0000 mgr.a (mgr.14388) 15407 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:26 smithi179 bash[23186]: cluster 2024-09-21T04:10:25.515829+0000 mgr.a (mgr.14388) 15407 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:27.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:26 smithi049 bash[23528]: cluster 2024-09-21T04:10:25.515829+0000 mgr.a (mgr.14388) 15407 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:28.188 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:28.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:28.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:28.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:28.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:28 smithi044 bash[22676]: cluster 2024-09-21T04:10:27.516575+0000 mgr.a (mgr.14388) 15408 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:28 smithi044 bash[22676]: audit 2024-09-21T04:10:27.769692+0000 mgr.a (mgr.14388) 15409 : audit [DBG] from='client.333396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:28 smithi179 bash[23186]: cluster 2024-09-21T04:10:27.516575+0000 mgr.a (mgr.14388) 15408 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:28 smithi179 bash[23186]: audit 2024-09-21T04:10:27.769692+0000 mgr.a (mgr.14388) 15409 : audit [DBG] from='client.333396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:28 smithi049 bash[23528]: cluster 2024-09-21T04:10:27.516575+0000 mgr.a (mgr.14388) 15408 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:28 smithi049 bash[23528]: audit 2024-09-21T04:10:27.769692+0000 mgr.a (mgr.14388) 15409 : audit [DBG] from='client.333396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:31.218 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:30 smithi049 bash[23528]: cluster 2024-09-21T04:10:29.517614+0000 mgr.a (mgr.14388) 15410 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:30 smithi044 bash[22676]: cluster 2024-09-21T04:10:29.517614+0000 mgr.a (mgr.14388) 15410 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:30 smithi179 bash[23186]: cluster 2024-09-21T04:10:29.517614+0000 mgr.a (mgr.14388) 15410 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:32 smithi044 bash[22676]: cluster 2024-09-21T04:10:31.519884+0000 mgr.a (mgr.14388) 15411 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:32 smithi179 bash[23186]: cluster 2024-09-21T04:10:31.519884+0000 mgr.a (mgr.14388) 15411 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:32 smithi049 bash[23528]: cluster 2024-09-21T04:10:31.519884+0000 mgr.a (mgr.14388) 15411 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:33.953 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:33.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:33.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:33.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:33.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: audit 2024-09-21T04:10:33.518388+0000 mgr.a (mgr.14388) 15412 : audit [DBG] from='client.333471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: cluster 2024-09-21T04:10:33.535422+0000 mgr.a (mgr.14388) 15413 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: audit 2024-09-21T04:10:34.080402+0000 mon.a (mon.0) 12351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: audit 2024-09-21T04:10:34.087757+0000 mon.a (mon.0) 12352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: audit 2024-09-21T04:10:34.098779+0000 mon.a (mon.0) 12353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: audit 2024-09-21T04:10:34.226840+0000 mon.a (mon.0) 12354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: audit 2024-09-21T04:10:34.236316+0000 mon.a (mon.0) 12355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:34 smithi044 bash[22676]: audit 2024-09-21T04:10:34.246470+0000 mon.a (mon.0) 12356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: audit 2024-09-21T04:10:33.518388+0000 mgr.a (mgr.14388) 15412 : audit [DBG] from='client.333471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: cluster 2024-09-21T04:10:33.535422+0000 mgr.a (mgr.14388) 15413 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: audit 2024-09-21T04:10:34.080402+0000 mon.a (mon.0) 12351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: audit 2024-09-21T04:10:34.087757+0000 mon.a (mon.0) 12352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: audit 2024-09-21T04:10:34.098779+0000 mon.a (mon.0) 12353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: audit 2024-09-21T04:10:34.226840+0000 mon.a (mon.0) 12354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: audit 2024-09-21T04:10:34.236316+0000 mon.a (mon.0) 12355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:34 smithi179 bash[23186]: audit 2024-09-21T04:10:34.246470+0000 mon.a (mon.0) 12356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: audit 2024-09-21T04:10:33.518388+0000 mgr.a (mgr.14388) 15412 : audit [DBG] from='client.333471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: cluster 2024-09-21T04:10:33.535422+0000 mgr.a (mgr.14388) 15413 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: audit 2024-09-21T04:10:34.080402+0000 mon.a (mon.0) 12351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: audit 2024-09-21T04:10:34.087757+0000 mon.a (mon.0) 12352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: audit 2024-09-21T04:10:34.098779+0000 mon.a (mon.0) 12353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: audit 2024-09-21T04:10:34.226840+0000 mon.a (mon.0) 12354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: audit 2024-09-21T04:10:34.236316+0000 mon.a (mon.0) 12355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:34 smithi049 bash[23528]: audit 2024-09-21T04:10:34.246470+0000 mon.a (mon.0) 12356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:36 smithi044 bash[22676]: cluster 2024-09-21T04:10:35.537810+0000 mgr.a (mgr.14388) 15414 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:36 smithi179 bash[23186]: cluster 2024-09-21T04:10:35.537810+0000 mgr.a (mgr.14388) 15414 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:37.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:36 smithi049 bash[23528]: cluster 2024-09-21T04:10:35.537810+0000 mgr.a (mgr.14388) 15414 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:10:38.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:38.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:38.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:38 smithi044 bash[22676]: cluster 2024-09-21T04:10:37.538603+0000 mgr.a (mgr.14388) 15415 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:38 smithi044 bash[22676]: audit 2024-09-21T04:10:38.489788+0000 mon.a (mon.0) 12357 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:10:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:38 smithi044 bash[22676]: audit 2024-09-21T04:10:38.496541+0000 mon.a (mon.0) 12358 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:10:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:38 smithi044 bash[22676]: audit 2024-09-21T04:10:38.498496+0000 mon.a (mon.0) 12359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:10:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:38 smithi044 bash[22676]: audit 2024-09-21T04:10:38.509721+0000 mon.a (mon.0) 12360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:38 smithi044 bash[22676]: audit 2024-09-21T04:10:38.516019+0000 mon.a (mon.0) 12361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:10:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:38 smithi179 bash[23186]: cluster 2024-09-21T04:10:37.538603+0000 mgr.a (mgr.14388) 15415 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:38 smithi179 bash[23186]: audit 2024-09-21T04:10:38.489788+0000 mon.a (mon.0) 12357 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:10:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:38 smithi179 bash[23186]: audit 2024-09-21T04:10:38.496541+0000 mon.a (mon.0) 12358 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:10:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:38 smithi179 bash[23186]: audit 2024-09-21T04:10:38.498496+0000 mon.a (mon.0) 12359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:10:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:38 smithi179 bash[23186]: audit 2024-09-21T04:10:38.509721+0000 mon.a (mon.0) 12360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:38 smithi179 bash[23186]: audit 2024-09-21T04:10:38.516019+0000 mon.a (mon.0) 12361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:10:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:38 smithi049 bash[23528]: cluster 2024-09-21T04:10:37.538603+0000 mgr.a (mgr.14388) 15415 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:38 smithi049 bash[23528]: audit 2024-09-21T04:10:38.489788+0000 mon.a (mon.0) 12357 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:10:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:38 smithi049 bash[23528]: audit 2024-09-21T04:10:38.496541+0000 mon.a (mon.0) 12358 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:10:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:38 smithi049 bash[23528]: audit 2024-09-21T04:10:38.498496+0000 mon.a (mon.0) 12359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:10:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:38 smithi049 bash[23528]: audit 2024-09-21T04:10:38.509721+0000 mon.a (mon.0) 12360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:38 smithi049 bash[23528]: audit 2024-09-21T04:10:38.516019+0000 mon.a (mon.0) 12361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:10:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:39.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:39.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:39.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:39.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:39.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:10:39 smithi044 bash[22930]: debug 2024-09-21T04:10:39.296+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:10:39.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:10:39 smithi044 bash[22930]: debug 2024-09-21T04:10:39.308+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:10:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:39 smithi044 bash[22676]: audit 2024-09-21T04:10:38.518419+0000 mgr.a (mgr.14388) 15416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:10:40.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:39 smithi179 bash[23186]: audit 2024-09-21T04:10:38.518419+0000 mgr.a (mgr.14388) 15416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:10:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:39 smithi049 bash[23528]: audit 2024-09-21T04:10:38.518419+0000 mgr.a (mgr.14388) 15416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:10:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:40 smithi044 bash[22676]: audit 2024-09-21T04:10:39.282175+0000 mgr.a (mgr.14388) 15417 : audit [DBG] from='client.333624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:40 smithi044 bash[22676]: audit 2024-09-21T04:10:39.298721+0000 mgr.a (mgr.14388) 15418 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:10:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:40 smithi044 bash[22676]: cephadm 2024-09-21T04:10:39.309873+0000 mgr.a (mgr.14388) 15419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:10:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:40 smithi044 bash[22676]: cluster 2024-09-21T04:10:39.539219+0000 mgr.a (mgr.14388) 15420 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:40 smithi179 bash[23186]: audit 2024-09-21T04:10:39.282175+0000 mgr.a (mgr.14388) 15417 : audit [DBG] from='client.333624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:40 smithi179 bash[23186]: audit 2024-09-21T04:10:39.298721+0000 mgr.a (mgr.14388) 15418 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:10:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:40 smithi179 bash[23186]: cephadm 2024-09-21T04:10:39.309873+0000 mgr.a (mgr.14388) 15419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:10:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:40 smithi179 bash[23186]: cluster 2024-09-21T04:10:39.539219+0000 mgr.a (mgr.14388) 15420 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:40 smithi049 bash[23528]: audit 2024-09-21T04:10:39.282175+0000 mgr.a (mgr.14388) 15417 : audit [DBG] from='client.333624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:40 smithi049 bash[23528]: audit 2024-09-21T04:10:39.298721+0000 mgr.a (mgr.14388) 15418 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:10:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:40 smithi049 bash[23528]: cephadm 2024-09-21T04:10:39.309873+0000 mgr.a (mgr.14388) 15419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:10:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:40 smithi049 bash[23528]: cluster 2024-09-21T04:10:39.539219+0000 mgr.a (mgr.14388) 15420 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:42 smithi044 bash[22676]: cluster 2024-09-21T04:10:41.541762+0000 mgr.a (mgr.14388) 15421 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:10:43.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:42 smithi179 bash[23186]: cluster 2024-09-21T04:10:41.541762+0000 mgr.a (mgr.14388) 15421 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:10:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:42 smithi049 bash[23528]: cluster 2024-09-21T04:10:41.541762+0000 mgr.a (mgr.14388) 15421 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:10:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:44 smithi179 bash[23186]: audit 2024-09-21T04:10:43.078356+0000 mon.a (mon.0) 12362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:44 smithi179 bash[23186]: audit 2024-09-21T04:10:43.087216+0000 mon.a (mon.0) 12363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:44 smithi179 bash[23186]: audit 2024-09-21T04:10:43.097878+0000 mon.a (mon.0) 12364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:44 smithi179 bash[23186]: cluster 2024-09-21T04:10:43.542735+0000 mgr.a (mgr.14388) 15422 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:10:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:44 smithi044 bash[22676]: audit 2024-09-21T04:10:43.078356+0000 mon.a (mon.0) 12362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:44 smithi044 bash[22676]: audit 2024-09-21T04:10:43.087216+0000 mon.a (mon.0) 12363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:44 smithi044 bash[22676]: audit 2024-09-21T04:10:43.097878+0000 mon.a (mon.0) 12364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:44 smithi044 bash[22676]: cluster 2024-09-21T04:10:43.542735+0000 mgr.a (mgr.14388) 15422 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:10:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:44 smithi049 bash[23528]: audit 2024-09-21T04:10:43.078356+0000 mon.a (mon.0) 12362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:44 smithi049 bash[23528]: audit 2024-09-21T04:10:43.087216+0000 mon.a (mon.0) 12363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:44 smithi049 bash[23528]: audit 2024-09-21T04:10:43.097878+0000 mon.a (mon.0) 12364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:44 smithi049 bash[23528]: cluster 2024-09-21T04:10:43.542735+0000 mgr.a (mgr.14388) 15422 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:10:44.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:44.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:44.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:45.461 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:46 smithi044 bash[22676]: audit 2024-09-21T04:10:45.035016+0000 mgr.a (mgr.14388) 15423 : audit [DBG] from='client.333735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:46 smithi044 bash[22676]: cluster 2024-09-21T04:10:45.545708+0000 mgr.a (mgr.14388) 15424 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:46 smithi179 bash[23186]: audit 2024-09-21T04:10:45.035016+0000 mgr.a (mgr.14388) 15423 : audit [DBG] from='client.333735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:46 smithi179 bash[23186]: cluster 2024-09-21T04:10:45.545708+0000 mgr.a (mgr.14388) 15424 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:10:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:46 smithi049 bash[23528]: audit 2024-09-21T04:10:45.035016+0000 mgr.a (mgr.14388) 15423 : audit [DBG] from='client.333735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:46.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:46 smithi049 bash[23528]: cluster 2024-09-21T04:10:45.545708+0000 mgr.a (mgr.14388) 15424 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:10:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:48 smithi044 bash[22676]: cluster 2024-09-21T04:10:47.546520+0000 mgr.a (mgr.14388) 15425 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:10:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:48 smithi179 bash[23186]: cluster 2024-09-21T04:10:47.546520+0000 mgr.a (mgr.14388) 15425 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:10:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:48 smithi049 bash[23528]: cluster 2024-09-21T04:10:47.546520+0000 mgr.a (mgr.14388) 15425 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:10:50.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:50.463 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:50.463 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:50 smithi044 bash[22676]: cluster 2024-09-21T04:10:49.547267+0000 mgr.a (mgr.14388) 15426 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:10:50.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:50 smithi049 bash[23528]: cluster 2024-09-21T04:10:49.547267+0000 mgr.a (mgr.14388) 15426 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:10:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:50 smithi179 bash[23186]: cluster 2024-09-21T04:10:49.547267+0000 mgr.a (mgr.14388) 15426 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:10:51.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:51.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:51.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:51.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:51.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:51 smithi044 bash[22676]: audit 2024-09-21T04:10:50.787461+0000 mgr.a (mgr.14388) 15427 : audit [DBG] from='client.333813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:52.002 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:51 smithi049 bash[23528]: audit 2024-09-21T04:10:50.787461+0000 mgr.a (mgr.14388) 15427 : audit [DBG] from='client.333813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:52.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:51 smithi179 bash[23186]: audit 2024-09-21T04:10:50.787461+0000 mgr.a (mgr.14388) 15427 : audit [DBG] from='client.333813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:52 smithi044 bash[22676]: cluster 2024-09-21T04:10:51.550301+0000 mgr.a (mgr.14388) 15428 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:10:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:52 smithi179 bash[23186]: cluster 2024-09-21T04:10:51.550301+0000 mgr.a (mgr.14388) 15428 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:10:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:52 smithi049 bash[23528]: cluster 2024-09-21T04:10:51.550301+0000 mgr.a (mgr.14388) 15428 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:10:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:54 smithi179 bash[23186]: cluster 2024-09-21T04:10:53.551107+0000 mgr.a (mgr.14388) 15429 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:10:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:54 smithi179 bash[23186]: audit 2024-09-21T04:10:54.314545+0000 mon.a (mon.0) 12365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:54 smithi179 bash[23186]: audit 2024-09-21T04:10:54.323303+0000 mon.a (mon.0) 12366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:54 smithi179 bash[23186]: audit 2024-09-21T04:10:54.333915+0000 mon.a (mon.0) 12367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:54 smithi179 bash[23186]: audit 2024-09-21T04:10:54.462671+0000 mon.a (mon.0) 12368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:54 smithi179 bash[23186]: audit 2024-09-21T04:10:54.471217+0000 mon.a (mon.0) 12369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:54 smithi179 bash[23186]: audit 2024-09-21T04:10:54.481438+0000 mon.a (mon.0) 12370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:54 smithi044 bash[22676]: cluster 2024-09-21T04:10:53.551107+0000 mgr.a (mgr.14388) 15429 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:10:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:54 smithi044 bash[22676]: audit 2024-09-21T04:10:54.314545+0000 mon.a (mon.0) 12365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:54 smithi044 bash[22676]: audit 2024-09-21T04:10:54.323303+0000 mon.a (mon.0) 12366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:54 smithi044 bash[22676]: audit 2024-09-21T04:10:54.333915+0000 mon.a (mon.0) 12367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:54 smithi044 bash[22676]: audit 2024-09-21T04:10:54.462671+0000 mon.a (mon.0) 12368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:54 smithi044 bash[22676]: audit 2024-09-21T04:10:54.471217+0000 mon.a (mon.0) 12369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:54 smithi044 bash[22676]: audit 2024-09-21T04:10:54.481438+0000 mon.a (mon.0) 12370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:54 smithi049 bash[23528]: cluster 2024-09-21T04:10:53.551107+0000 mgr.a (mgr.14388) 15429 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:54 smithi049 bash[23528]: audit 2024-09-21T04:10:54.314545+0000 mon.a (mon.0) 12365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:54 smithi049 bash[23528]: audit 2024-09-21T04:10:54.323303+0000 mon.a (mon.0) 12366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:54 smithi049 bash[23528]: audit 2024-09-21T04:10:54.333915+0000 mon.a (mon.0) 12367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:54 smithi049 bash[23528]: audit 2024-09-21T04:10:54.462671+0000 mon.a (mon.0) 12368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:54 smithi049 bash[23528]: audit 2024-09-21T04:10:54.471217+0000 mon.a (mon.0) 12369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:54 smithi049 bash[23528]: audit 2024-09-21T04:10:54.481438+0000 mon.a (mon.0) 12370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:10:56.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:10:56.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:10:56.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:10:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:56 smithi044 bash[22676]: cluster 2024-09-21T04:10:55.553186+0000 mgr.a (mgr.14388) 15430 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:56.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:10:56.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:10:56.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:10:56.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:10:56.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:10:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:56 smithi179 bash[23186]: cluster 2024-09-21T04:10:55.553186+0000 mgr.a (mgr.14388) 15430 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:57.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:56 smithi049 bash[23528]: cluster 2024-09-21T04:10:55.553186+0000 mgr.a (mgr.14388) 15430 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:57 smithi044 bash[22676]: audit 2024-09-21T04:10:56.573424+0000 mgr.a (mgr.14388) 15431 : audit [DBG] from='client.333891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:57 smithi179 bash[23186]: audit 2024-09-21T04:10:56.573424+0000 mgr.a (mgr.14388) 15431 : audit [DBG] from='client.333891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:58.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:57 smithi049 bash[23528]: audit 2024-09-21T04:10:56.573424+0000 mgr.a (mgr.14388) 15431 : audit [DBG] from='client.333891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:10:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:10:58 smithi044 bash[22676]: cluster 2024-09-21T04:10:57.554216+0000 mgr.a (mgr.14388) 15432 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:10:58 smithi179 bash[23186]: cluster 2024-09-21T04:10:57.554216+0000 mgr.a (mgr.14388) 15432 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:10:59.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:10:58 smithi049 bash[23528]: cluster 2024-09-21T04:10:57.554216+0000 mgr.a (mgr.14388) 15432 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:00 smithi044 bash[22676]: cluster 2024-09-21T04:10:59.555019+0000 mgr.a (mgr.14388) 15433 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:00 smithi179 bash[23186]: cluster 2024-09-21T04:10:59.555019+0000 mgr.a (mgr.14388) 15433 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:00 smithi049 bash[23528]: cluster 2024-09-21T04:10:59.555019+0000 mgr.a (mgr.14388) 15433 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:01.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:01.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:01.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:02.768 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:02.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:02.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:02.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:02.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:02 smithi044 bash[22676]: cluster 2024-09-21T04:11:01.557284+0000 mgr.a (mgr.14388) 15434 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:03.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:02 smithi179 bash[23186]: cluster 2024-09-21T04:11:01.557284+0000 mgr.a (mgr.14388) 15434 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:02 smithi049 bash[23528]: cluster 2024-09-21T04:11:01.557284+0000 mgr.a (mgr.14388) 15434 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:03 smithi044 bash[22676]: audit 2024-09-21T04:11:02.330383+0000 mgr.a (mgr.14388) 15435 : audit [DBG] from='client.333969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:03 smithi044 bash[22676]: audit 2024-09-21T04:11:03.298395+0000 mon.a (mon.0) 12371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:03 smithi044 bash[22676]: audit 2024-09-21T04:11:03.303836+0000 mon.a (mon.0) 12372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:03 smithi044 bash[22676]: audit 2024-09-21T04:11:03.308944+0000 mon.a (mon.0) 12373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:03 smithi179 bash[23186]: audit 2024-09-21T04:11:02.330383+0000 mgr.a (mgr.14388) 15435 : audit [DBG] from='client.333969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:03 smithi179 bash[23186]: audit 2024-09-21T04:11:03.298395+0000 mon.a (mon.0) 12371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:03 smithi179 bash[23186]: audit 2024-09-21T04:11:03.303836+0000 mon.a (mon.0) 12372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:03 smithi179 bash[23186]: audit 2024-09-21T04:11:03.308944+0000 mon.a (mon.0) 12373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:03 smithi049 bash[23528]: audit 2024-09-21T04:11:02.330383+0000 mgr.a (mgr.14388) 15435 : audit [DBG] from='client.333969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:04.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:03 smithi049 bash[23528]: audit 2024-09-21T04:11:03.298395+0000 mon.a (mon.0) 12371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:03 smithi049 bash[23528]: audit 2024-09-21T04:11:03.303836+0000 mon.a (mon.0) 12372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:03 smithi049 bash[23528]: audit 2024-09-21T04:11:03.308944+0000 mon.a (mon.0) 12373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:04 smithi179 bash[23186]: cluster 2024-09-21T04:11:03.558191+0000 mgr.a (mgr.14388) 15436 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:04 smithi044 bash[22676]: cluster 2024-09-21T04:11:03.558191+0000 mgr.a (mgr.14388) 15436 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:04 smithi049 bash[23528]: cluster 2024-09-21T04:11:03.558191+0000 mgr.a (mgr.14388) 15436 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:06 smithi044 bash[22676]: cluster 2024-09-21T04:11:05.560382+0000 mgr.a (mgr.14388) 15437 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:06 smithi179 bash[23186]: cluster 2024-09-21T04:11:05.560382+0000 mgr.a (mgr.14388) 15437 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:06 smithi049 bash[23528]: cluster 2024-09-21T04:11:05.560382+0000 mgr.a (mgr.14388) 15437 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:07.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:07.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:07.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:08.535 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:08.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:08.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:08.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:08.536 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:08 smithi044 bash[22676]: cluster 2024-09-21T04:11:07.561182+0000 mgr.a (mgr.14388) 15438 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:08 smithi179 bash[23186]: cluster 2024-09-21T04:11:07.561182+0000 mgr.a (mgr.14388) 15438 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:08 smithi049 bash[23528]: cluster 2024-09-21T04:11:07.561182+0000 mgr.a (mgr.14388) 15438 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:09 smithi044 bash[22676]: audit 2024-09-21T04:11:08.099355+0000 mgr.a (mgr.14388) 15439 : audit [DBG] from='client.334047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:09 smithi179 bash[23186]: audit 2024-09-21T04:11:08.099355+0000 mgr.a (mgr.14388) 15439 : audit [DBG] from='client.334047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:10.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:09 smithi049 bash[23528]: audit 2024-09-21T04:11:08.099355+0000 mgr.a (mgr.14388) 15439 : audit [DBG] from='client.334047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:10 smithi044 bash[22676]: cluster 2024-09-21T04:11:09.562169+0000 mgr.a (mgr.14388) 15440 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:10 smithi179 bash[23186]: cluster 2024-09-21T04:11:09.562169+0000 mgr.a (mgr.14388) 15440 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:11.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:10 smithi049 bash[23528]: cluster 2024-09-21T04:11:09.562169+0000 mgr.a (mgr.14388) 15440 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:12.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:12 smithi049 bash[23528]: cluster 2024-09-21T04:11:11.564482+0000 mgr.a (mgr.14388) 15441 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:12 smithi044 bash[22676]: cluster 2024-09-21T04:11:11.564482+0000 mgr.a (mgr.14388) 15441 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:12 smithi179 bash[23186]: cluster 2024-09-21T04:11:11.564482+0000 mgr.a (mgr.14388) 15441 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:13.538 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:14.333 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:14 smithi044 bash[22676]: cluster 2024-09-21T04:11:13.565057+0000 mgr.a (mgr.14388) 15442 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:14 smithi044 bash[22676]: audit 2024-09-21T04:11:13.874251+0000 mgr.a (mgr.14388) 15443 : audit [DBG] from='client.334125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:14 smithi044 bash[22676]: audit 2024-09-21T04:11:14.455905+0000 mon.a (mon.0) 12374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:14 smithi044 bash[22676]: audit 2024-09-21T04:11:14.461325+0000 mon.a (mon.0) 12375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:14 smithi044 bash[22676]: audit 2024-09-21T04:11:14.481635+0000 mon.a (mon.0) 12376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:14.975 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:14 smithi049 bash[23528]: cluster 2024-09-21T04:11:13.565057+0000 mgr.a (mgr.14388) 15442 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:14.975 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:14 smithi049 bash[23528]: audit 2024-09-21T04:11:13.874251+0000 mgr.a (mgr.14388) 15443 : audit [DBG] from='client.334125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:14.975 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:14 smithi049 bash[23528]: audit 2024-09-21T04:11:14.455905+0000 mon.a (mon.0) 12374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:14.975 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:14 smithi049 bash[23528]: audit 2024-09-21T04:11:14.461325+0000 mon.a (mon.0) 12375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:14.975 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:14 smithi049 bash[23528]: audit 2024-09-21T04:11:14.481635+0000 mon.a (mon.0) 12376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:14 smithi179 bash[23186]: cluster 2024-09-21T04:11:13.565057+0000 mgr.a (mgr.14388) 15442 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:14 smithi179 bash[23186]: audit 2024-09-21T04:11:13.874251+0000 mgr.a (mgr.14388) 15443 : audit [DBG] from='client.334125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:14 smithi179 bash[23186]: audit 2024-09-21T04:11:14.455905+0000 mon.a (mon.0) 12374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:14 smithi179 bash[23186]: audit 2024-09-21T04:11:14.461325+0000 mon.a (mon.0) 12375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:15.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:14 smithi179 bash[23186]: audit 2024-09-21T04:11:14.481635+0000 mon.a (mon.0) 12376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:15.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:15 smithi044 bash[22676]: audit 2024-09-21T04:11:14.695299+0000 mon.a (mon.0) 12377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:15.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:15 smithi044 bash[22676]: audit 2024-09-21T04:11:14.705117+0000 mon.a (mon.0) 12378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:15.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:15 smithi044 bash[22676]: audit 2024-09-21T04:11:14.714808+0000 mon.a (mon.0) 12379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:15 smithi179 bash[23186]: audit 2024-09-21T04:11:14.695299+0000 mon.a (mon.0) 12377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:15 smithi179 bash[23186]: audit 2024-09-21T04:11:14.705117+0000 mon.a (mon.0) 12378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:15 smithi179 bash[23186]: audit 2024-09-21T04:11:14.714808+0000 mon.a (mon.0) 12379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:16.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:15 smithi049 bash[23528]: audit 2024-09-21T04:11:14.695299+0000 mon.a (mon.0) 12377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:16.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:15 smithi049 bash[23528]: audit 2024-09-21T04:11:14.705117+0000 mon.a (mon.0) 12378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:15 smithi049 bash[23528]: audit 2024-09-21T04:11:14.714808+0000 mon.a (mon.0) 12379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:16 smithi044 bash[22676]: cluster 2024-09-21T04:11:15.567235+0000 mgr.a (mgr.14388) 15444 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:16 smithi179 bash[23186]: cluster 2024-09-21T04:11:15.567235+0000 mgr.a (mgr.14388) 15444 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:16 smithi049 bash[23528]: cluster 2024-09-21T04:11:15.567235+0000 mgr.a (mgr.14388) 15444 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:11:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:18 smithi044 bash[22676]: cluster 2024-09-21T04:11:17.568049+0000 mgr.a (mgr.14388) 15445 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:18 smithi179 bash[23186]: cluster 2024-09-21T04:11:17.568049+0000 mgr.a (mgr.14388) 15445 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:18 smithi049 bash[23528]: cluster 2024-09-21T04:11:17.568049+0000 mgr.a (mgr.14388) 15445 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:19.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:20.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:20 smithi044 bash[22676]: cluster 2024-09-21T04:11:19.568601+0000 mgr.a (mgr.14388) 15446 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:20 smithi044 bash[22676]: audit 2024-09-21T04:11:19.677381+0000 mgr.a (mgr.14388) 15447 : audit [DBG] from='client.334200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:20 smithi179 bash[23186]: cluster 2024-09-21T04:11:19.568601+0000 mgr.a (mgr.14388) 15446 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:20 smithi179 bash[23186]: audit 2024-09-21T04:11:19.677381+0000 mgr.a (mgr.14388) 15447 : audit [DBG] from='client.334200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:20 smithi049 bash[23528]: cluster 2024-09-21T04:11:19.568601+0000 mgr.a (mgr.14388) 15446 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:20 smithi049 bash[23528]: audit 2024-09-21T04:11:19.677381+0000 mgr.a (mgr.14388) 15447 : audit [DBG] from='client.334200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:22 smithi044 bash[22676]: cluster 2024-09-21T04:11:21.570944+0000 mgr.a (mgr.14388) 15448 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:11:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:22 smithi179 bash[23186]: cluster 2024-09-21T04:11:21.570944+0000 mgr.a (mgr.14388) 15448 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:11:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:22 smithi049 bash[23528]: cluster 2024-09-21T04:11:21.570944+0000 mgr.a (mgr.14388) 15448 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:11:24.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:24 smithi049 bash[23528]: audit 2024-09-21T04:11:23.525465+0000 mon.a (mon.0) 12380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:24 smithi049 bash[23528]: audit 2024-09-21T04:11:23.534095+0000 mon.a (mon.0) 12381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:24 smithi049 bash[23528]: audit 2024-09-21T04:11:23.545377+0000 mon.a (mon.0) 12382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:24 smithi049 bash[23528]: cluster 2024-09-21T04:11:23.571711+0000 mgr.a (mgr.14388) 15449 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:11:24.814 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:24 smithi179 bash[23186]: audit 2024-09-21T04:11:23.525465+0000 mon.a (mon.0) 12380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.815 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:24 smithi179 bash[23186]: audit 2024-09-21T04:11:23.534095+0000 mon.a (mon.0) 12381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.815 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:24 smithi179 bash[23186]: audit 2024-09-21T04:11:23.545377+0000 mon.a (mon.0) 12382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.815 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:24 smithi179 bash[23186]: cluster 2024-09-21T04:11:23.571711+0000 mgr.a (mgr.14388) 15449 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:11:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:24 smithi044 bash[22676]: audit 2024-09-21T04:11:23.525465+0000 mon.a (mon.0) 12380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:24 smithi044 bash[22676]: audit 2024-09-21T04:11:23.534095+0000 mon.a (mon.0) 12381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:24 smithi044 bash[22676]: audit 2024-09-21T04:11:23.545377+0000 mon.a (mon.0) 12382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:24 smithi044 bash[22676]: cluster 2024-09-21T04:11:23.571711+0000 mgr.a (mgr.14388) 15449 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:11:25.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:25.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:25.134 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:25.936 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:26 smithi044 bash[22676]: audit 2024-09-21T04:11:25.468832+0000 mgr.a (mgr.14388) 15450 : audit [DBG] from='client.334275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:26 smithi044 bash[22676]: cluster 2024-09-21T04:11:25.573180+0000 mgr.a (mgr.14388) 15451 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:26 smithi179 bash[23186]: audit 2024-09-21T04:11:25.468832+0000 mgr.a (mgr.14388) 15450 : audit [DBG] from='client.334275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:26 smithi179 bash[23186]: cluster 2024-09-21T04:11:25.573180+0000 mgr.a (mgr.14388) 15451 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:26 smithi049 bash[23528]: audit 2024-09-21T04:11:25.468832+0000 mgr.a (mgr.14388) 15450 : audit [DBG] from='client.334275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:26 smithi049 bash[23528]: cluster 2024-09-21T04:11:25.573180+0000 mgr.a (mgr.14388) 15451 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:28.800 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:28 smithi044 bash[22676]: cluster 2024-09-21T04:11:27.574078+0000 mgr.a (mgr.14388) 15452 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:11:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:28 smithi179 bash[23186]: cluster 2024-09-21T04:11:27.574078+0000 mgr.a (mgr.14388) 15452 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:11:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:28 smithi049 bash[23528]: cluster 2024-09-21T04:11:27.574078+0000 mgr.a (mgr.14388) 15452 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:11:30.922 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:30 smithi044 bash[22676]: cluster 2024-09-21T04:11:29.574895+0000 mgr.a (mgr.14388) 15453 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:11:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:30.937 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:30.938 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:30 smithi179 bash[23186]: cluster 2024-09-21T04:11:29.574895+0000 mgr.a (mgr.14388) 15453 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:11:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:30 smithi049 bash[23528]: cluster 2024-09-21T04:11:29.574895+0000 mgr.a (mgr.14388) 15453 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:11:31.714 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:31.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:31.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:31.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:31.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:32.946 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:32 smithi049 bash[23528]: audit 2024-09-21T04:11:31.254141+0000 mgr.a (mgr.14388) 15454 : audit [DBG] from='client.334353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:32.946 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:32 smithi049 bash[23528]: cluster 2024-09-21T04:11:31.578041+0000 mgr.a (mgr.14388) 15455 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:32 smithi044 bash[22676]: audit 2024-09-21T04:11:31.254141+0000 mgr.a (mgr.14388) 15454 : audit [DBG] from='client.334353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:32 smithi044 bash[22676]: cluster 2024-09-21T04:11:31.578041+0000 mgr.a (mgr.14388) 15455 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:32 smithi179 bash[23186]: audit 2024-09-21T04:11:31.254141+0000 mgr.a (mgr.14388) 15454 : audit [DBG] from='client.334353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:32 smithi179 bash[23186]: cluster 2024-09-21T04:11:31.578041+0000 mgr.a (mgr.14388) 15455 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:34.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:34 smithi049 bash[23528]: cluster 2024-09-21T04:11:33.578870+0000 mgr.a (mgr.14388) 15456 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:11:34.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:34 smithi179 bash[23186]: cluster 2024-09-21T04:11:33.578870+0000 mgr.a (mgr.14388) 15456 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:11:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:34 smithi044 bash[22676]: cluster 2024-09-21T04:11:33.578870+0000 mgr.a (mgr.14388) 15456 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:11:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:35 smithi044 bash[22676]: audit 2024-09-21T04:11:34.694022+0000 mon.a (mon.0) 12383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:35 smithi044 bash[22676]: audit 2024-09-21T04:11:34.703902+0000 mon.a (mon.0) 12384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:35 smithi044 bash[22676]: audit 2024-09-21T04:11:34.715639+0000 mon.a (mon.0) 12385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:35 smithi044 bash[22676]: audit 2024-09-21T04:11:34.925895+0000 mon.a (mon.0) 12386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:35 smithi044 bash[22676]: audit 2024-09-21T04:11:34.935731+0000 mon.a (mon.0) 12387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:35 smithi044 bash[22676]: audit 2024-09-21T04:11:34.947228+0000 mon.a (mon.0) 12388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:35 smithi179 bash[23186]: audit 2024-09-21T04:11:34.694022+0000 mon.a (mon.0) 12383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:35 smithi179 bash[23186]: audit 2024-09-21T04:11:34.703902+0000 mon.a (mon.0) 12384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:35 smithi179 bash[23186]: audit 2024-09-21T04:11:34.715639+0000 mon.a (mon.0) 12385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:35 smithi179 bash[23186]: audit 2024-09-21T04:11:34.925895+0000 mon.a (mon.0) 12386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:35 smithi179 bash[23186]: audit 2024-09-21T04:11:34.935731+0000 mon.a (mon.0) 12387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:35 smithi179 bash[23186]: audit 2024-09-21T04:11:34.947228+0000 mon.a (mon.0) 12388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:35 smithi049 bash[23528]: audit 2024-09-21T04:11:34.694022+0000 mon.a (mon.0) 12383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:35 smithi049 bash[23528]: audit 2024-09-21T04:11:34.703902+0000 mon.a (mon.0) 12384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:35 smithi049 bash[23528]: audit 2024-09-21T04:11:34.715639+0000 mon.a (mon.0) 12385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:35 smithi049 bash[23528]: audit 2024-09-21T04:11:34.925895+0000 mon.a (mon.0) 12386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:35 smithi049 bash[23528]: audit 2024-09-21T04:11:34.935731+0000 mon.a (mon.0) 12387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:35 smithi049 bash[23528]: audit 2024-09-21T04:11:34.947228+0000 mon.a (mon.0) 12388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:36.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:36.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:36.717 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:36 smithi044 bash[22676]: cluster 2024-09-21T04:11:35.581064+0000 mgr.a (mgr.14388) 15457 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:11:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:36 smithi179 bash[23186]: cluster 2024-09-21T04:11:35.581064+0000 mgr.a (mgr.14388) 15457 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:11:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:36 smithi049 bash[23528]: cluster 2024-09-21T04:11:35.581064+0000 mgr.a (mgr.14388) 15457 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:11:37.482 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:37.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:38 smithi044 bash[22676]: audit 2024-09-21T04:11:37.046031+0000 mgr.a (mgr.14388) 15458 : audit [DBG] from='client.334428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:38 smithi044 bash[22676]: cluster 2024-09-21T04:11:37.582005+0000 mgr.a (mgr.14388) 15459 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:38 smithi179 bash[23186]: audit 2024-09-21T04:11:37.046031+0000 mgr.a (mgr.14388) 15458 : audit [DBG] from='client.334428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:38 smithi179 bash[23186]: cluster 2024-09-21T04:11:37.582005+0000 mgr.a (mgr.14388) 15459 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:38 smithi049 bash[23528]: audit 2024-09-21T04:11:37.046031+0000 mgr.a (mgr.14388) 15458 : audit [DBG] from='client.334428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:38 smithi049 bash[23528]: cluster 2024-09-21T04:11:37.582005+0000 mgr.a (mgr.14388) 15459 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:39 smithi044 bash[22676]: audit 2024-09-21T04:11:39.369049+0000 mon.a (mon.0) 12389 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:11:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:39 smithi044 bash[22676]: audit 2024-09-21T04:11:39.380253+0000 mon.a (mon.0) 12390 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:11:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:39 smithi044 bash[22676]: audit 2024-09-21T04:11:39.381999+0000 mon.a (mon.0) 12391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:11:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:39 smithi044 bash[22676]: audit 2024-09-21T04:11:39.393183+0000 mon.a (mon.0) 12392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:39 smithi044 bash[22676]: audit 2024-09-21T04:11:39.399591+0000 mon.a (mon.0) 12393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:11:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:39 smithi179 bash[23186]: audit 2024-09-21T04:11:39.369049+0000 mon.a (mon.0) 12389 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:11:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:39 smithi179 bash[23186]: audit 2024-09-21T04:11:39.380253+0000 mon.a (mon.0) 12390 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:11:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:39 smithi179 bash[23186]: audit 2024-09-21T04:11:39.381999+0000 mon.a (mon.0) 12391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:11:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:39 smithi179 bash[23186]: audit 2024-09-21T04:11:39.393183+0000 mon.a (mon.0) 12392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:39 smithi179 bash[23186]: audit 2024-09-21T04:11:39.399591+0000 mon.a (mon.0) 12393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:11:40.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:39 smithi049 bash[23528]: audit 2024-09-21T04:11:39.369049+0000 mon.a (mon.0) 12389 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:11:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:39 smithi049 bash[23528]: audit 2024-09-21T04:11:39.380253+0000 mon.a (mon.0) 12390 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:11:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:39 smithi049 bash[23528]: audit 2024-09-21T04:11:39.381999+0000 mon.a (mon.0) 12391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:11:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:39 smithi049 bash[23528]: audit 2024-09-21T04:11:39.393183+0000 mon.a (mon.0) 12392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:39 smithi049 bash[23528]: audit 2024-09-21T04:11:39.399591+0000 mon.a (mon.0) 12393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:11:40.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:11:40 smithi044 bash[22930]: debug 2024-09-21T04:11:40.195+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:11:40.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:11:40 smithi044 bash[22930]: debug 2024-09-21T04:11:40.195+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:11:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:40 smithi044 bash[22676]: audit 2024-09-21T04:11:39.402152+0000 mgr.a (mgr.14388) 15460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:11:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:40 smithi044 bash[22676]: cluster 2024-09-21T04:11:39.582751+0000 mgr.a (mgr.14388) 15461 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:40 smithi179 bash[23186]: audit 2024-09-21T04:11:39.402152+0000 mgr.a (mgr.14388) 15460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:11:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:40 smithi179 bash[23186]: cluster 2024-09-21T04:11:39.582751+0000 mgr.a (mgr.14388) 15461 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:40 smithi049 bash[23528]: audit 2024-09-21T04:11:39.402152+0000 mgr.a (mgr.14388) 15460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:11:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:40 smithi049 bash[23528]: cluster 2024-09-21T04:11:39.582751+0000 mgr.a (mgr.14388) 15461 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:41 smithi044 bash[22676]: audit 2024-09-21T04:11:40.199362+0000 mgr.a (mgr.14388) 15462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:11:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:41 smithi044 bash[22676]: cephadm 2024-09-21T04:11:40.200517+0000 mgr.a (mgr.14388) 15463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:11:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:41 smithi179 bash[23186]: audit 2024-09-21T04:11:40.199362+0000 mgr.a (mgr.14388) 15462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:11:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:41 smithi179 bash[23186]: cephadm 2024-09-21T04:11:40.200517+0000 mgr.a (mgr.14388) 15463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:11:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:41 smithi049 bash[23528]: audit 2024-09-21T04:11:40.199362+0000 mgr.a (mgr.14388) 15462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:11:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:41 smithi049 bash[23528]: cephadm 2024-09-21T04:11:40.200517+0000 mgr.a (mgr.14388) 15463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:11:42.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:42.904 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:42 smithi179 bash[23186]: cluster 2024-09-21T04:11:41.585074+0000 mgr.a (mgr.14388) 15464 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:11:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:42 smithi044 bash[22676]: cluster 2024-09-21T04:11:41.585074+0000 mgr.a (mgr.14388) 15464 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:11:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:42 smithi049 bash[23528]: cluster 2024-09-21T04:11:41.585074+0000 mgr.a (mgr.14388) 15464 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:11:43.274 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:43.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:43.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:43.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:43.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:43.941 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:43 smithi179 bash[23186]: audit 2024-09-21T04:11:42.816287+0000 mgr.a (mgr.14388) 15465 : audit [DBG] from='client.334611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:43 smithi044 bash[22676]: audit 2024-09-21T04:11:42.816287+0000 mgr.a (mgr.14388) 15465 : audit [DBG] from='client.334611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:44.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:43 smithi049 bash[23528]: audit 2024-09-21T04:11:42.816287+0000 mgr.a (mgr.14388) 15465 : audit [DBG] from='client.334611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:44 smithi049 bash[23528]: cluster 2024-09-21T04:11:43.586120+0000 mgr.a (mgr.14388) 15466 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:11:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:44 smithi049 bash[23528]: audit 2024-09-21T04:11:43.771935+0000 mon.a (mon.0) 12394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:44 smithi049 bash[23528]: audit 2024-09-21T04:11:43.780710+0000 mon.a (mon.0) 12395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:44 smithi049 bash[23528]: audit 2024-09-21T04:11:43.791097+0000 mon.a (mon.0) 12396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.173 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:44 smithi179 bash[23186]: cluster 2024-09-21T04:11:43.586120+0000 mgr.a (mgr.14388) 15466 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:11:45.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:44 smithi179 bash[23186]: audit 2024-09-21T04:11:43.771935+0000 mon.a (mon.0) 12394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:44 smithi179 bash[23186]: audit 2024-09-21T04:11:43.780710+0000 mon.a (mon.0) 12395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:44 smithi179 bash[23186]: audit 2024-09-21T04:11:43.791097+0000 mon.a (mon.0) 12396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:44 smithi044 bash[22676]: cluster 2024-09-21T04:11:43.586120+0000 mgr.a (mgr.14388) 15466 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:11:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:44 smithi044 bash[22676]: audit 2024-09-21T04:11:43.771935+0000 mon.a (mon.0) 12394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:44 smithi044 bash[22676]: audit 2024-09-21T04:11:43.780710+0000 mon.a (mon.0) 12395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:44 smithi044 bash[22676]: audit 2024-09-21T04:11:43.791097+0000 mon.a (mon.0) 12396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:46 smithi049 bash[23528]: cluster 2024-09-21T04:11:45.588304+0000 mgr.a (mgr.14388) 15467 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:46 smithi044 bash[22676]: cluster 2024-09-21T04:11:45.588304+0000 mgr.a (mgr.14388) 15467 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:46 smithi179 bash[23186]: cluster 2024-09-21T04:11:45.588304+0000 mgr.a (mgr.14388) 15467 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:48.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:48.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:48.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:48.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:48 smithi044 bash[22676]: cluster 2024-09-21T04:11:47.589075+0000 mgr.a (mgr.14388) 15468 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:49.046 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:49.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:49.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:49.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:49.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:48 smithi049 bash[23528]: cluster 2024-09-21T04:11:47.589075+0000 mgr.a (mgr.14388) 15468 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:48 smithi179 bash[23186]: cluster 2024-09-21T04:11:47.589075+0000 mgr.a (mgr.14388) 15468 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:49 smithi044 bash[22676]: audit 2024-09-21T04:11:48.608473+0000 mgr.a (mgr.14388) 15469 : audit [DBG] from='client.334689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:50.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:49 smithi049 bash[23528]: audit 2024-09-21T04:11:48.608473+0000 mgr.a (mgr.14388) 15469 : audit [DBG] from='client.334689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:49 smithi179 bash[23186]: audit 2024-09-21T04:11:48.608473+0000 mgr.a (mgr.14388) 15469 : audit [DBG] from='client.334689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:50 smithi049 bash[23528]: cluster 2024-09-21T04:11:49.590279+0000 mgr.a (mgr.14388) 15470 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:51.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:50 smithi044 bash[22676]: cluster 2024-09-21T04:11:49.590279+0000 mgr.a (mgr.14388) 15470 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:50 smithi179 bash[23186]: cluster 2024-09-21T04:11:49.590279+0000 mgr.a (mgr.14388) 15470 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:53.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:52 smithi049 bash[23528]: cluster 2024-09-21T04:11:51.592784+0000 mgr.a (mgr.14388) 15471 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:52 smithi044 bash[22676]: cluster 2024-09-21T04:11:51.592784+0000 mgr.a (mgr.14388) 15471 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:52 smithi179 bash[23186]: cluster 2024-09-21T04:11:51.592784+0000 mgr.a (mgr.14388) 15471 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:11:54.048 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:54.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:54.049 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:11:54.836 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:11:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:11:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:11:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:11:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:11:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:54 smithi049 bash[23528]: cluster 2024-09-21T04:11:53.593736+0000 mgr.a (mgr.14388) 15472 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:11:55.180 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:54 smithi179 bash[23186]: cluster 2024-09-21T04:11:53.593736+0000 mgr.a (mgr.14388) 15472 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:11:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:54 smithi044 bash[22676]: cluster 2024-09-21T04:11:53.593736+0000 mgr.a (mgr.14388) 15472 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:11:56.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:55 smithi049 bash[23528]: audit 2024-09-21T04:11:54.385310+0000 mgr.a (mgr.14388) 15473 : audit [DBG] from='client.334767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:55 smithi049 bash[23528]: audit 2024-09-21T04:11:54.847326+0000 mon.a (mon.0) 12397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:55 smithi049 bash[23528]: audit 2024-09-21T04:11:54.852178+0000 mon.a (mon.0) 12398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:55 smithi049 bash[23528]: audit 2024-09-21T04:11:54.857332+0000 mon.a (mon.0) 12399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:55 smithi049 bash[23528]: audit 2024-09-21T04:11:55.155279+0000 mon.a (mon.0) 12400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:55 smithi049 bash[23528]: audit 2024-09-21T04:11:55.163886+0000 mon.a (mon.0) 12401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:55 smithi049 bash[23528]: audit 2024-09-21T04:11:55.175547+0000 mon.a (mon.0) 12402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:55 smithi044 bash[22676]: audit 2024-09-21T04:11:54.385310+0000 mgr.a (mgr.14388) 15473 : audit [DBG] from='client.334767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:55 smithi044 bash[22676]: audit 2024-09-21T04:11:54.847326+0000 mon.a (mon.0) 12397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:55 smithi044 bash[22676]: audit 2024-09-21T04:11:54.852178+0000 mon.a (mon.0) 12398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:55 smithi044 bash[22676]: audit 2024-09-21T04:11:54.857332+0000 mon.a (mon.0) 12399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:55 smithi044 bash[22676]: audit 2024-09-21T04:11:55.155279+0000 mon.a (mon.0) 12400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:55 smithi044 bash[22676]: audit 2024-09-21T04:11:55.163886+0000 mon.a (mon.0) 12401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:55 smithi044 bash[22676]: audit 2024-09-21T04:11:55.175547+0000 mon.a (mon.0) 12402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:55 smithi179 bash[23186]: audit 2024-09-21T04:11:54.385310+0000 mgr.a (mgr.14388) 15473 : audit [DBG] from='client.334767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:11:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:55 smithi179 bash[23186]: audit 2024-09-21T04:11:54.847326+0000 mon.a (mon.0) 12397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:55 smithi179 bash[23186]: audit 2024-09-21T04:11:54.852178+0000 mon.a (mon.0) 12398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:55 smithi179 bash[23186]: audit 2024-09-21T04:11:54.857332+0000 mon.a (mon.0) 12399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:55 smithi179 bash[23186]: audit 2024-09-21T04:11:55.155279+0000 mon.a (mon.0) 12400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:55 smithi179 bash[23186]: audit 2024-09-21T04:11:55.163886+0000 mon.a (mon.0) 12401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:55 smithi179 bash[23186]: audit 2024-09-21T04:11:55.175547+0000 mon.a (mon.0) 12402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:11:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:56 smithi044 bash[22676]: cluster 2024-09-21T04:11:55.596156+0000 mgr.a (mgr.14388) 15474 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:11:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:56 smithi179 bash[23186]: cluster 2024-09-21T04:11:55.596156+0000 mgr.a (mgr.14388) 15474 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:11:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:56 smithi049 bash[23528]: cluster 2024-09-21T04:11:55.596156+0000 mgr.a (mgr.14388) 15474 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:11:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:11:58 smithi044 bash[22676]: cluster 2024-09-21T04:11:57.596971+0000 mgr.a (mgr.14388) 15475 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:11:58 smithi179 bash[23186]: cluster 2024-09-21T04:11:57.596971+0000 mgr.a (mgr.14388) 15475 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:11:58 smithi049 bash[23528]: cluster 2024-09-21T04:11:57.596971+0000 mgr.a (mgr.14388) 15475 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:11:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:11:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:11:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:00.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:00.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:00 smithi044 bash[22676]: cluster 2024-09-21T04:11:59.597761+0000 mgr.a (mgr.14388) 15476 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:00 smithi179 bash[23186]: cluster 2024-09-21T04:11:59.597761+0000 mgr.a (mgr.14388) 15476 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:00 smithi049 bash[23528]: cluster 2024-09-21T04:11:59.597761+0000 mgr.a (mgr.14388) 15476 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:01 smithi044 bash[22676]: audit 2024-09-21T04:12:00.172327+0000 mgr.a (mgr.14388) 15477 : audit [DBG] from='client.334845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:01 smithi179 bash[23186]: audit 2024-09-21T04:12:00.172327+0000 mgr.a (mgr.14388) 15477 : audit [DBG] from='client.334845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:02.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:01 smithi049 bash[23528]: audit 2024-09-21T04:12:00.172327+0000 mgr.a (mgr.14388) 15477 : audit [DBG] from='client.334845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:03.162 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:02 smithi179 bash[23186]: cluster 2024-09-21T04:12:01.600562+0000 mgr.a (mgr.14388) 15478 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:02 smithi044 bash[22676]: cluster 2024-09-21T04:12:01.600562+0000 mgr.a (mgr.14388) 15478 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:02 smithi049 bash[23528]: cluster 2024-09-21T04:12:01.600562+0000 mgr.a (mgr.14388) 15478 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:04 smithi044 bash[22676]: cluster 2024-09-21T04:12:03.601365+0000 mgr.a (mgr.14388) 15479 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:04 smithi044 bash[22676]: audit 2024-09-21T04:12:03.967602+0000 mon.a (mon.0) 12403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:04 smithi044 bash[22676]: audit 2024-09-21T04:12:03.976171+0000 mon.a (mon.0) 12404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:04 smithi044 bash[22676]: audit 2024-09-21T04:12:03.986541+0000 mon.a (mon.0) 12405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:04 smithi179 bash[23186]: cluster 2024-09-21T04:12:03.601365+0000 mgr.a (mgr.14388) 15479 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:04 smithi179 bash[23186]: audit 2024-09-21T04:12:03.967602+0000 mon.a (mon.0) 12403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:04 smithi179 bash[23186]: audit 2024-09-21T04:12:03.976171+0000 mon.a (mon.0) 12404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:04 smithi179 bash[23186]: audit 2024-09-21T04:12:03.986541+0000 mon.a (mon.0) 12405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:04 smithi049 bash[23528]: cluster 2024-09-21T04:12:03.601365+0000 mgr.a (mgr.14388) 15479 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:04 smithi049 bash[23528]: audit 2024-09-21T04:12:03.967602+0000 mon.a (mon.0) 12403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:04 smithi049 bash[23528]: audit 2024-09-21T04:12:03.976171+0000 mon.a (mon.0) 12404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:04 smithi049 bash[23528]: audit 2024-09-21T04:12:03.986541+0000 mon.a (mon.0) 12405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:05.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:05.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:05.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:06.365 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:06.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:06.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:06.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:06.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:06 smithi044 bash[22676]: cluster 2024-09-21T04:12:05.603415+0000 mgr.a (mgr.14388) 15480 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:06 smithi179 bash[23186]: cluster 2024-09-21T04:12:05.603415+0000 mgr.a (mgr.14388) 15480 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:06 smithi049 bash[23528]: cluster 2024-09-21T04:12:05.603415+0000 mgr.a (mgr.14388) 15480 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:07 smithi044 bash[22676]: audit 2024-09-21T04:12:05.934330+0000 mgr.a (mgr.14388) 15481 : audit [DBG] from='client.334923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:07 smithi179 bash[23186]: audit 2024-09-21T04:12:05.934330+0000 mgr.a (mgr.14388) 15481 : audit [DBG] from='client.334923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:08.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:07 smithi049 bash[23528]: audit 2024-09-21T04:12:05.934330+0000 mgr.a (mgr.14388) 15481 : audit [DBG] from='client.334923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:09.137 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:08 smithi044 bash[22676]: cluster 2024-09-21T04:12:07.604331+0000 mgr.a (mgr.14388) 15482 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:08 smithi179 bash[23186]: cluster 2024-09-21T04:12:07.604331+0000 mgr.a (mgr.14388) 15482 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:08 smithi049 bash[23528]: cluster 2024-09-21T04:12:07.604331+0000 mgr.a (mgr.14388) 15482 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:10 smithi044 bash[22676]: cluster 2024-09-21T04:12:09.605136+0000 mgr.a (mgr.14388) 15483 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:12:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:10 smithi179 bash[23186]: cluster 2024-09-21T04:12:09.605136+0000 mgr.a (mgr.14388) 15483 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:12:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:10 smithi049 bash[23528]: cluster 2024-09-21T04:12:09.605136+0000 mgr.a (mgr.14388) 15483 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:12:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:12.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:12.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:12.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:12.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:12.122 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:12 smithi044 bash[22676]: cluster 2024-09-21T04:12:11.607285+0000 mgr.a (mgr.14388) 15484 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:12 smithi044 bash[22676]: audit 2024-09-21T04:12:11.694045+0000 mgr.a (mgr.14388) 15485 : audit [DBG] from='client.334998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:12 smithi179 bash[23186]: cluster 2024-09-21T04:12:11.607285+0000 mgr.a (mgr.14388) 15484 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:12 smithi179 bash[23186]: audit 2024-09-21T04:12:11.694045+0000 mgr.a (mgr.14388) 15485 : audit [DBG] from='client.334998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:12 smithi049 bash[23528]: cluster 2024-09-21T04:12:11.607285+0000 mgr.a (mgr.14388) 15484 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:12 smithi049 bash[23528]: audit 2024-09-21T04:12:11.694045+0000 mgr.a (mgr.14388) 15485 : audit [DBG] from='client.334998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:15.152 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:14 smithi049 bash[23528]: cluster 2024-09-21T04:12:13.608343+0000 mgr.a (mgr.14388) 15486 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:14 smithi044 bash[22676]: cluster 2024-09-21T04:12:13.608343+0000 mgr.a (mgr.14388) 15486 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:14 smithi179 bash[23186]: cluster 2024-09-21T04:12:13.608343+0000 mgr.a (mgr.14388) 15486 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:16.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:16 smithi049 bash[23528]: audit 2024-09-21T04:12:15.068222+0000 mon.a (mon.0) 12406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:16 smithi049 bash[23528]: audit 2024-09-21T04:12:15.077617+0000 mon.a (mon.0) 12407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:16 smithi049 bash[23528]: audit 2024-09-21T04:12:15.089472+0000 mon.a (mon.0) 12408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:16 smithi049 bash[23528]: audit 2024-09-21T04:12:15.384483+0000 mon.a (mon.0) 12409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:16 smithi049 bash[23528]: audit 2024-09-21T04:12:15.392856+0000 mon.a (mon.0) 12410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:16 smithi049 bash[23528]: audit 2024-09-21T04:12:15.403038+0000 mon.a (mon.0) 12411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:16 smithi049 bash[23528]: cluster 2024-09-21T04:12:15.610645+0000 mgr.a (mgr.14388) 15487 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:16 smithi044 bash[22676]: audit 2024-09-21T04:12:15.068222+0000 mon.a (mon.0) 12406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:16 smithi044 bash[22676]: audit 2024-09-21T04:12:15.077617+0000 mon.a (mon.0) 12407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:16 smithi044 bash[22676]: audit 2024-09-21T04:12:15.089472+0000 mon.a (mon.0) 12408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:16 smithi044 bash[22676]: audit 2024-09-21T04:12:15.384483+0000 mon.a (mon.0) 12409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:16 smithi044 bash[22676]: audit 2024-09-21T04:12:15.392856+0000 mon.a (mon.0) 12410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:16 smithi044 bash[22676]: audit 2024-09-21T04:12:15.403038+0000 mon.a (mon.0) 12411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:16 smithi044 bash[22676]: cluster 2024-09-21T04:12:15.610645+0000 mgr.a (mgr.14388) 15487 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:16 smithi179 bash[23186]: audit 2024-09-21T04:12:15.068222+0000 mon.a (mon.0) 12406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:16 smithi179 bash[23186]: audit 2024-09-21T04:12:15.077617+0000 mon.a (mon.0) 12407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:16 smithi179 bash[23186]: audit 2024-09-21T04:12:15.089472+0000 mon.a (mon.0) 12408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:16 smithi179 bash[23186]: audit 2024-09-21T04:12:15.384483+0000 mon.a (mon.0) 12409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:16 smithi179 bash[23186]: audit 2024-09-21T04:12:15.392856+0000 mon.a (mon.0) 12410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:16 smithi179 bash[23186]: audit 2024-09-21T04:12:15.403038+0000 mon.a (mon.0) 12411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:16 smithi179 bash[23186]: cluster 2024-09-21T04:12:15.610645+0000 mgr.a (mgr.14388) 15487 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:17.909 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:17.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:17.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:17.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:17.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:18 smithi044 bash[22676]: audit 2024-09-21T04:12:17.456622+0000 mgr.a (mgr.14388) 15488 : audit [DBG] from='client.335076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:18 smithi044 bash[22676]: cluster 2024-09-21T04:12:17.611279+0000 mgr.a (mgr.14388) 15489 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:18 smithi179 bash[23186]: audit 2024-09-21T04:12:17.456622+0000 mgr.a (mgr.14388) 15488 : audit [DBG] from='client.335076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:18 smithi179 bash[23186]: cluster 2024-09-21T04:12:17.611279+0000 mgr.a (mgr.14388) 15489 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:18 smithi049 bash[23528]: audit 2024-09-21T04:12:17.456622+0000 mgr.a (mgr.14388) 15488 : audit [DBG] from='client.335076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:18 smithi049 bash[23528]: cluster 2024-09-21T04:12:17.611279+0000 mgr.a (mgr.14388) 15489 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:20 smithi044 bash[22676]: cluster 2024-09-21T04:12:19.612159+0000 mgr.a (mgr.14388) 15490 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:20 smithi179 bash[23186]: cluster 2024-09-21T04:12:19.612159+0000 mgr.a (mgr.14388) 15490 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:20 smithi049 bash[23528]: cluster 2024-09-21T04:12:19.612159+0000 mgr.a (mgr.14388) 15490 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:22 smithi044 bash[22676]: cluster 2024-09-21T04:12:21.614458+0000 mgr.a (mgr.14388) 15491 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:22 smithi179 bash[23186]: cluster 2024-09-21T04:12:21.614458+0000 mgr.a (mgr.14388) 15491 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:22 smithi049 bash[23528]: cluster 2024-09-21T04:12:21.614458+0000 mgr.a (mgr.14388) 15491 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:23.666 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:23.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:23.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:23.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:23.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:24.987 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:24 smithi179 bash[23186]: audit 2024-09-21T04:12:23.250538+0000 mgr.a (mgr.14388) 15492 : audit [DBG] from='client.335154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:24.987 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:24 smithi179 bash[23186]: cluster 2024-09-21T04:12:23.615002+0000 mgr.a (mgr.14388) 15493 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:24.988 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:24 smithi179 bash[23186]: audit 2024-09-21T04:12:24.203405+0000 mon.a (mon.0) 12412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:24.988 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:24 smithi179 bash[23186]: audit 2024-09-21T04:12:24.212008+0000 mon.a (mon.0) 12413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:24.988 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:24 smithi179 bash[23186]: audit 2024-09-21T04:12:24.222364+0000 mon.a (mon.0) 12414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:24 smithi044 bash[22676]: audit 2024-09-21T04:12:23.250538+0000 mgr.a (mgr.14388) 15492 : audit [DBG] from='client.335154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:24 smithi044 bash[22676]: cluster 2024-09-21T04:12:23.615002+0000 mgr.a (mgr.14388) 15493 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:24 smithi044 bash[22676]: audit 2024-09-21T04:12:24.203405+0000 mon.a (mon.0) 12412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:24 smithi044 bash[22676]: audit 2024-09-21T04:12:24.212008+0000 mon.a (mon.0) 12413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:24 smithi044 bash[22676]: audit 2024-09-21T04:12:24.222364+0000 mon.a (mon.0) 12414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:24 smithi049 bash[23528]: audit 2024-09-21T04:12:23.250538+0000 mgr.a (mgr.14388) 15492 : audit [DBG] from='client.335154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:24 smithi049 bash[23528]: cluster 2024-09-21T04:12:23.615002+0000 mgr.a (mgr.14388) 15493 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:24 smithi049 bash[23528]: audit 2024-09-21T04:12:24.203405+0000 mon.a (mon.0) 12412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:24 smithi049 bash[23528]: audit 2024-09-21T04:12:24.212008+0000 mon.a (mon.0) 12413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:24 smithi049 bash[23528]: audit 2024-09-21T04:12:24.222364+0000 mon.a (mon.0) 12414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:26 smithi044 bash[22676]: cluster 2024-09-21T04:12:25.617202+0000 mgr.a (mgr.14388) 15494 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:26 smithi179 bash[23186]: cluster 2024-09-21T04:12:25.617202+0000 mgr.a (mgr.14388) 15494 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:26 smithi049 bash[23528]: cluster 2024-09-21T04:12:25.617202+0000 mgr.a (mgr.14388) 15494 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:28.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:28.668 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:28.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:28.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:28 smithi044 bash[22676]: cluster 2024-09-21T04:12:27.617993+0000 mgr.a (mgr.14388) 15495 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:28 smithi179 bash[23186]: cluster 2024-09-21T04:12:27.617993+0000 mgr.a (mgr.14388) 15495 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:28 smithi049 bash[23528]: cluster 2024-09-21T04:12:27.617993+0000 mgr.a (mgr.14388) 15495 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:29.445 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:29.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:30 smithi044 bash[22676]: audit 2024-09-21T04:12:29.004415+0000 mgr.a (mgr.14388) 15496 : audit [DBG] from='client.335229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:30 smithi044 bash[22676]: cluster 2024-09-21T04:12:29.618950+0000 mgr.a (mgr.14388) 15497 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:30 smithi179 bash[23186]: audit 2024-09-21T04:12:29.004415+0000 mgr.a (mgr.14388) 15496 : audit [DBG] from='client.335229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:30 smithi179 bash[23186]: cluster 2024-09-21T04:12:29.618950+0000 mgr.a (mgr.14388) 15497 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:30 smithi049 bash[23528]: audit 2024-09-21T04:12:29.004415+0000 mgr.a (mgr.14388) 15496 : audit [DBG] from='client.335229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:30 smithi049 bash[23528]: cluster 2024-09-21T04:12:29.618950+0000 mgr.a (mgr.14388) 15497 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:32 smithi044 bash[22676]: cluster 2024-09-21T04:12:31.621347+0000 mgr.a (mgr.14388) 15498 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:32 smithi179 bash[23186]: cluster 2024-09-21T04:12:31.621347+0000 mgr.a (mgr.14388) 15498 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:32 smithi049 bash[23528]: cluster 2024-09-21T04:12:31.621347+0000 mgr.a (mgr.14388) 15498 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:12:34.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:34.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:34.447 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:34 smithi044 bash[22676]: cluster 2024-09-21T04:12:33.622269+0000 mgr.a (mgr.14388) 15499 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:34 smithi179 bash[23186]: cluster 2024-09-21T04:12:33.622269+0000 mgr.a (mgr.14388) 15499 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:35.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:34 smithi049 bash[23528]: cluster 2024-09-21T04:12:33.622269+0000 mgr.a (mgr.14388) 15499 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:35.262 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:35.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:35.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:35.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:35.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:35 smithi044 bash[22676]: audit 2024-09-21T04:12:34.781349+0000 mgr.a (mgr.14388) 15500 : audit [DBG] from='client.335304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:35 smithi044 bash[22676]: audit 2024-09-21T04:12:35.222738+0000 mon.a (mon.0) 12415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:35 smithi044 bash[22676]: audit 2024-09-21T04:12:35.230024+0000 mon.a (mon.0) 12416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:35 smithi044 bash[22676]: audit 2024-09-21T04:12:35.237740+0000 mon.a (mon.0) 12417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:35 smithi044 bash[22676]: audit 2024-09-21T04:12:35.609442+0000 mon.a (mon.0) 12418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:35 smithi044 bash[22676]: audit 2024-09-21T04:12:35.619573+0000 mon.a (mon.0) 12419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:35 smithi044 bash[22676]: audit 2024-09-21T04:12:35.630824+0000 mon.a (mon.0) 12420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:35 smithi179 bash[23186]: audit 2024-09-21T04:12:34.781349+0000 mgr.a (mgr.14388) 15500 : audit [DBG] from='client.335304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:35 smithi179 bash[23186]: audit 2024-09-21T04:12:35.222738+0000 mon.a (mon.0) 12415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:35 smithi179 bash[23186]: audit 2024-09-21T04:12:35.230024+0000 mon.a (mon.0) 12416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:35 smithi179 bash[23186]: audit 2024-09-21T04:12:35.237740+0000 mon.a (mon.0) 12417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:35 smithi179 bash[23186]: audit 2024-09-21T04:12:35.609442+0000 mon.a (mon.0) 12418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:35 smithi179 bash[23186]: audit 2024-09-21T04:12:35.619573+0000 mon.a (mon.0) 12419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:35 smithi179 bash[23186]: audit 2024-09-21T04:12:35.630824+0000 mon.a (mon.0) 12420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:35 smithi049 bash[23528]: audit 2024-09-21T04:12:34.781349+0000 mgr.a (mgr.14388) 15500 : audit [DBG] from='client.335304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:35 smithi049 bash[23528]: audit 2024-09-21T04:12:35.222738+0000 mon.a (mon.0) 12415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:35 smithi049 bash[23528]: audit 2024-09-21T04:12:35.230024+0000 mon.a (mon.0) 12416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:35 smithi049 bash[23528]: audit 2024-09-21T04:12:35.237740+0000 mon.a (mon.0) 12417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:35 smithi049 bash[23528]: audit 2024-09-21T04:12:35.609442+0000 mon.a (mon.0) 12418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:35 smithi049 bash[23528]: audit 2024-09-21T04:12:35.619573+0000 mon.a (mon.0) 12419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:35 smithi049 bash[23528]: audit 2024-09-21T04:12:35.630824+0000 mon.a (mon.0) 12420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:36 smithi044 bash[22676]: cluster 2024-09-21T04:12:35.625305+0000 mgr.a (mgr.14388) 15501 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:12:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:36 smithi179 bash[23186]: cluster 2024-09-21T04:12:35.625305+0000 mgr.a (mgr.14388) 15501 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:12:37.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:36 smithi049 bash[23528]: cluster 2024-09-21T04:12:35.625305+0000 mgr.a (mgr.14388) 15501 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:12:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:38 smithi044 bash[22676]: cluster 2024-09-21T04:12:37.626248+0000 mgr.a (mgr.14388) 15502 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:12:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:38 smithi179 bash[23186]: cluster 2024-09-21T04:12:37.626248+0000 mgr.a (mgr.14388) 15502 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:12:39.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:38 smithi049 bash[23528]: cluster 2024-09-21T04:12:37.626248+0000 mgr.a (mgr.14388) 15502 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:12:40.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:40 smithi044 bash[22676]: cluster 2024-09-21T04:12:39.627186+0000 mgr.a (mgr.14388) 15503 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:12:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:40 smithi044 bash[22676]: audit 2024-09-21T04:12:40.262497+0000 mon.a (mon.0) 12421 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:12:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:40 smithi044 bash[22676]: audit 2024-09-21T04:12:40.267818+0000 mon.a (mon.0) 12422 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:12:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:40 smithi044 bash[22676]: audit 2024-09-21T04:12:40.269067+0000 mon.a (mon.0) 12423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:12:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:40 smithi044 bash[22676]: audit 2024-09-21T04:12:40.277145+0000 mon.a (mon.0) 12424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:40 smithi044 bash[22676]: audit 2024-09-21T04:12:40.281481+0000 mon.a (mon.0) 12425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:12:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:40 smithi179 bash[23186]: cluster 2024-09-21T04:12:39.627186+0000 mgr.a (mgr.14388) 15503 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:12:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:40 smithi179 bash[23186]: audit 2024-09-21T04:12:40.262497+0000 mon.a (mon.0) 12421 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:12:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:40 smithi179 bash[23186]: audit 2024-09-21T04:12:40.267818+0000 mon.a (mon.0) 12422 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:12:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:40 smithi179 bash[23186]: audit 2024-09-21T04:12:40.269067+0000 mon.a (mon.0) 12423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:12:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:40 smithi179 bash[23186]: audit 2024-09-21T04:12:40.277145+0000 mon.a (mon.0) 12424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:40 smithi179 bash[23186]: audit 2024-09-21T04:12:40.281481+0000 mon.a (mon.0) 12425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:12:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:40 smithi049 bash[23528]: cluster 2024-09-21T04:12:39.627186+0000 mgr.a (mgr.14388) 15503 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:12:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:40 smithi049 bash[23528]: audit 2024-09-21T04:12:40.262497+0000 mon.a (mon.0) 12421 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:12:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:40 smithi049 bash[23528]: audit 2024-09-21T04:12:40.267818+0000 mon.a (mon.0) 12422 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:12:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:40 smithi049 bash[23528]: audit 2024-09-21T04:12:40.269067+0000 mon.a (mon.0) 12423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:12:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:40 smithi049 bash[23528]: audit 2024-09-21T04:12:40.277145+0000 mon.a (mon.0) 12424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:40 smithi049 bash[23528]: audit 2024-09-21T04:12:40.281481+0000 mon.a (mon.0) 12425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:12:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:41.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:41.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:41.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:41.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:41.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:12:41 smithi044 bash[22930]: debug 2024-09-21T04:12:41.050+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:12:41.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:12:41 smithi044 bash[22930]: debug 2024-09-21T04:12:41.062+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:12:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:41 smithi044 bash[22676]: audit 2024-09-21T04:12:40.283793+0000 mgr.a (mgr.14388) 15504 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:12:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:41 smithi044 bash[22676]: audit 2024-09-21T04:12:40.615582+0000 mgr.a (mgr.14388) 15505 : audit [DBG] from='client.335385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:41 smithi179 bash[23186]: audit 2024-09-21T04:12:40.283793+0000 mgr.a (mgr.14388) 15504 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:12:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:41 smithi179 bash[23186]: audit 2024-09-21T04:12:40.615582+0000 mgr.a (mgr.14388) 15505 : audit [DBG] from='client.335385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:41 smithi049 bash[23528]: audit 2024-09-21T04:12:40.283793+0000 mgr.a (mgr.14388) 15504 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:12:42.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:41 smithi049 bash[23528]: audit 2024-09-21T04:12:40.615582+0000 mgr.a (mgr.14388) 15505 : audit [DBG] from='client.335385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:42 smithi179 bash[23186]: audit 2024-09-21T04:12:41.054633+0000 mgr.a (mgr.14388) 15506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:12:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:42 smithi179 bash[23186]: cephadm 2024-09-21T04:12:41.066161+0000 mgr.a (mgr.14388) 15507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:12:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:42 smithi179 bash[23186]: cluster 2024-09-21T04:12:41.630130+0000 mgr.a (mgr.14388) 15508 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:42 smithi044 bash[22676]: audit 2024-09-21T04:12:41.054633+0000 mgr.a (mgr.14388) 15506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:12:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:42 smithi044 bash[22676]: cephadm 2024-09-21T04:12:41.066161+0000 mgr.a (mgr.14388) 15507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:12:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:42 smithi044 bash[22676]: cluster 2024-09-21T04:12:41.630130+0000 mgr.a (mgr.14388) 15508 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:42 smithi049 bash[23528]: audit 2024-09-21T04:12:41.054633+0000 mgr.a (mgr.14388) 15506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:12:43.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:42 smithi049 bash[23528]: cephadm 2024-09-21T04:12:41.066161+0000 mgr.a (mgr.14388) 15507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:12:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:42 smithi049 bash[23528]: cluster 2024-09-21T04:12:41.630130+0000 mgr.a (mgr.14388) 15508 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:44 smithi044 bash[22676]: cluster 2024-09-21T04:12:43.630905+0000 mgr.a (mgr.14388) 15509 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:44 smithi044 bash[22676]: audit 2024-09-21T04:12:44.449891+0000 mon.a (mon.0) 12426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:44 smithi044 bash[22676]: audit 2024-09-21T04:12:44.458641+0000 mon.a (mon.0) 12427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:44 smithi044 bash[22676]: audit 2024-09-21T04:12:44.469174+0000 mon.a (mon.0) 12428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:44 smithi179 bash[23186]: cluster 2024-09-21T04:12:43.630905+0000 mgr.a (mgr.14388) 15509 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:44 smithi179 bash[23186]: audit 2024-09-21T04:12:44.449891+0000 mon.a (mon.0) 12426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:44 smithi179 bash[23186]: audit 2024-09-21T04:12:44.458641+0000 mon.a (mon.0) 12427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:44 smithi179 bash[23186]: audit 2024-09-21T04:12:44.469174+0000 mon.a (mon.0) 12428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:45.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:44 smithi049 bash[23528]: cluster 2024-09-21T04:12:43.630905+0000 mgr.a (mgr.14388) 15509 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:12:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:44 smithi049 bash[23528]: audit 2024-09-21T04:12:44.449891+0000 mon.a (mon.0) 12426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:44 smithi049 bash[23528]: audit 2024-09-21T04:12:44.458641+0000 mon.a (mon.0) 12427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:44 smithi049 bash[23528]: audit 2024-09-21T04:12:44.469174+0000 mon.a (mon.0) 12428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:46.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:46.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:46.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:46 smithi044 bash[22676]: cluster 2024-09-21T04:12:45.632868+0000 mgr.a (mgr.14388) 15510 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:46 smithi179 bash[23186]: cluster 2024-09-21T04:12:45.632868+0000 mgr.a (mgr.14388) 15510 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:47.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:46 smithi049 bash[23528]: cluster 2024-09-21T04:12:45.632868+0000 mgr.a (mgr.14388) 15510 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:47.233 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:47.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:47.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:47.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:47.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:47 smithi179 bash[23186]: audit 2024-09-21T04:12:46.795284+0000 mgr.a (mgr.14388) 15511 : audit [DBG] from='client.335565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:48.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:47 smithi049 bash[23528]: audit 2024-09-21T04:12:46.795284+0000 mgr.a (mgr.14388) 15511 : audit [DBG] from='client.335565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:48.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:47 smithi044 bash[22676]: audit 2024-09-21T04:12:46.795284+0000 mgr.a (mgr.14388) 15511 : audit [DBG] from='client.335565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:48 smithi179 bash[23186]: cluster 2024-09-21T04:12:47.633754+0000 mgr.a (mgr.14388) 15512 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:12:49.012 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:48 smithi044 bash[22676]: cluster 2024-09-21T04:12:47.633754+0000 mgr.a (mgr.14388) 15512 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:12:49.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:48 smithi049 bash[23528]: cluster 2024-09-21T04:12:47.633754+0000 mgr.a (mgr.14388) 15512 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:12:51.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:50 smithi179 bash[23186]: cluster 2024-09-21T04:12:49.634540+0000 mgr.a (mgr.14388) 15513 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:12:51.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:50 smithi049 bash[23528]: cluster 2024-09-21T04:12:49.634540+0000 mgr.a (mgr.14388) 15513 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:12:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:50 smithi044 bash[22676]: cluster 2024-09-21T04:12:49.634540+0000 mgr.a (mgr.14388) 15513 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:12:52.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:52.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:52.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:53.010 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:53.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:53.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:53.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:53.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:52 smithi049 bash[23528]: cluster 2024-09-21T04:12:51.635841+0000 mgr.a (mgr.14388) 15514 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:52 smithi044 bash[22676]: cluster 2024-09-21T04:12:51.635841+0000 mgr.a (mgr.14388) 15514 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:52 smithi179 bash[23186]: cluster 2024-09-21T04:12:51.635841+0000 mgr.a (mgr.14388) 15514 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:54.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:53 smithi049 bash[23528]: audit 2024-09-21T04:12:52.567465+0000 mgr.a (mgr.14388) 15515 : audit [DBG] from='client.335637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:53 smithi044 bash[22676]: audit 2024-09-21T04:12:52.567465+0000 mgr.a (mgr.14388) 15515 : audit [DBG] from='client.335637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:53 smithi179 bash[23186]: audit 2024-09-21T04:12:52.567465+0000 mgr.a (mgr.14388) 15515 : audit [DBG] from='client.335637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:12:55.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:54 smithi049 bash[23528]: cluster 2024-09-21T04:12:53.636717+0000 mgr.a (mgr.14388) 15516 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:54 smithi044 bash[22676]: cluster 2024-09-21T04:12:53.636717+0000 mgr.a (mgr.14388) 15516 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:54 smithi179 bash[23186]: cluster 2024-09-21T04:12:53.636717+0000 mgr.a (mgr.14388) 15516 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:56 smithi044 bash[22676]: audit 2024-09-21T04:12:55.466477+0000 mon.a (mon.0) 12429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:56 smithi044 bash[22676]: audit 2024-09-21T04:12:55.475191+0000 mon.a (mon.0) 12430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:56 smithi044 bash[22676]: audit 2024-09-21T04:12:55.485983+0000 mon.a (mon.0) 12431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:56 smithi044 bash[22676]: cluster 2024-09-21T04:12:55.638961+0000 mgr.a (mgr.14388) 15517 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:56 smithi044 bash[22676]: audit 2024-09-21T04:12:55.842212+0000 mon.a (mon.0) 12432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:56 smithi044 bash[22676]: audit 2024-09-21T04:12:55.850753+0000 mon.a (mon.0) 12433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:56 smithi044 bash[22676]: audit 2024-09-21T04:12:55.861023+0000 mon.a (mon.0) 12434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:56 smithi179 bash[23186]: audit 2024-09-21T04:12:55.466477+0000 mon.a (mon.0) 12429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:56 smithi179 bash[23186]: audit 2024-09-21T04:12:55.475191+0000 mon.a (mon.0) 12430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:56 smithi179 bash[23186]: audit 2024-09-21T04:12:55.485983+0000 mon.a (mon.0) 12431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:56 smithi179 bash[23186]: cluster 2024-09-21T04:12:55.638961+0000 mgr.a (mgr.14388) 15517 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:56 smithi179 bash[23186]: audit 2024-09-21T04:12:55.842212+0000 mon.a (mon.0) 12432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:56 smithi179 bash[23186]: audit 2024-09-21T04:12:55.850753+0000 mon.a (mon.0) 12433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:56 smithi179 bash[23186]: audit 2024-09-21T04:12:55.861023+0000 mon.a (mon.0) 12434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:56 smithi049 bash[23528]: audit 2024-09-21T04:12:55.466477+0000 mon.a (mon.0) 12429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:56 smithi049 bash[23528]: audit 2024-09-21T04:12:55.475191+0000 mon.a (mon.0) 12430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:56 smithi049 bash[23528]: audit 2024-09-21T04:12:55.485983+0000 mon.a (mon.0) 12431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:56 smithi049 bash[23528]: cluster 2024-09-21T04:12:55.638961+0000 mgr.a (mgr.14388) 15517 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:12:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:56 smithi049 bash[23528]: audit 2024-09-21T04:12:55.842212+0000 mon.a (mon.0) 12432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:56 smithi049 bash[23528]: audit 2024-09-21T04:12:55.850753+0000 mon.a (mon.0) 12433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:56 smithi049 bash[23528]: audit 2024-09-21T04:12:55.861023+0000 mon.a (mon.0) 12434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:12:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:12:58.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:12:58.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:12:58.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:12:58.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:12:58.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:12:58.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:12:58.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:12:58.993 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:58 smithi044 bash[22676]: cluster 2024-09-21T04:12:57.639740+0000 mgr.a (mgr.14388) 15518 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:58 smithi179 bash[23186]: cluster 2024-09-21T04:12:57.639740+0000 mgr.a (mgr.14388) 15518 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:58 smithi049 bash[23528]: cluster 2024-09-21T04:12:57.639740+0000 mgr.a (mgr.14388) 15518 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:12:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:12:59 smithi044 bash[22676]: audit 2024-09-21T04:12:58.350555+0000 mgr.a (mgr.14388) 15519 : audit [DBG] from='client.335715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:12:59 smithi179 bash[23186]: audit 2024-09-21T04:12:58.350555+0000 mgr.a (mgr.14388) 15519 : audit [DBG] from='client.335715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:00.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:12:59 smithi049 bash[23528]: audit 2024-09-21T04:12:58.350555+0000 mgr.a (mgr.14388) 15519 : audit [DBG] from='client.335715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:00 smithi044 bash[22676]: cluster 2024-09-21T04:12:59.640633+0000 mgr.a (mgr.14388) 15520 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:00 smithi179 bash[23186]: cluster 2024-09-21T04:12:59.640633+0000 mgr.a (mgr.14388) 15520 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:00 smithi049 bash[23528]: cluster 2024-09-21T04:12:59.640633+0000 mgr.a (mgr.14388) 15520 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:02 smithi044 bash[22676]: cluster 2024-09-21T04:13:01.642899+0000 mgr.a (mgr.14388) 15521 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:02 smithi179 bash[23186]: cluster 2024-09-21T04:13:01.642899+0000 mgr.a (mgr.14388) 15521 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:02 smithi049 bash[23528]: cluster 2024-09-21T04:13:01.642899+0000 mgr.a (mgr.14388) 15521 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:03.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:03.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:04.577 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:04.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:04.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:04.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:04.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:04 smithi044 bash[22676]: cluster 2024-09-21T04:13:03.643666+0000 mgr.a (mgr.14388) 15522 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:04 smithi044 bash[22676]: audit 2024-09-21T04:13:04.677454+0000 mon.a (mon.0) 12435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:04 smithi044 bash[22676]: audit 2024-09-21T04:13:04.686853+0000 mon.a (mon.0) 12436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:04 smithi044 bash[22676]: audit 2024-09-21T04:13:04.698143+0000 mon.a (mon.0) 12437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:04 smithi179 bash[23186]: cluster 2024-09-21T04:13:03.643666+0000 mgr.a (mgr.14388) 15522 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:04 smithi179 bash[23186]: audit 2024-09-21T04:13:04.677454+0000 mon.a (mon.0) 12435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:04 smithi179 bash[23186]: audit 2024-09-21T04:13:04.686853+0000 mon.a (mon.0) 12436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:04 smithi179 bash[23186]: audit 2024-09-21T04:13:04.698143+0000 mon.a (mon.0) 12437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:04 smithi049 bash[23528]: cluster 2024-09-21T04:13:03.643666+0000 mgr.a (mgr.14388) 15522 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:04 smithi049 bash[23528]: audit 2024-09-21T04:13:04.677454+0000 mon.a (mon.0) 12435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:04 smithi049 bash[23528]: audit 2024-09-21T04:13:04.686853+0000 mon.a (mon.0) 12436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:04 smithi049 bash[23528]: audit 2024-09-21T04:13:04.698143+0000 mon.a (mon.0) 12437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:05.982 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:05 smithi179 bash[23186]: audit 2024-09-21T04:13:04.143888+0000 mgr.a (mgr.14388) 15523 : audit [DBG] from='client.335793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:05 smithi044 bash[22676]: audit 2024-09-21T04:13:04.143888+0000 mgr.a (mgr.14388) 15523 : audit [DBG] from='client.335793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:06.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:05 smithi049 bash[23528]: audit 2024-09-21T04:13:04.143888+0000 mgr.a (mgr.14388) 15523 : audit [DBG] from='client.335793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:06 smithi044 bash[22676]: cluster 2024-09-21T04:13:05.646008+0000 mgr.a (mgr.14388) 15524 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:06 smithi179 bash[23186]: cluster 2024-09-21T04:13:05.646008+0000 mgr.a (mgr.14388) 15524 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:06 smithi049 bash[23528]: cluster 2024-09-21T04:13:05.646008+0000 mgr.a (mgr.14388) 15524 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:08 smithi044 bash[22676]: cluster 2024-09-21T04:13:07.646789+0000 mgr.a (mgr.14388) 15525 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:09.012 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:08 smithi179 bash[23186]: cluster 2024-09-21T04:13:07.646789+0000 mgr.a (mgr.14388) 15525 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:08 smithi049 bash[23528]: cluster 2024-09-21T04:13:07.646789+0000 mgr.a (mgr.14388) 15525 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:10.377 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:10.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:10 smithi179 bash[23186]: cluster 2024-09-21T04:13:09.647696+0000 mgr.a (mgr.14388) 15526 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:10 smithi179 bash[23186]: audit 2024-09-21T04:13:09.912359+0000 mgr.a (mgr.14388) 15527 : audit [DBG] from='client.335868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:11.011 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:10 smithi044 bash[22676]: cluster 2024-09-21T04:13:09.647696+0000 mgr.a (mgr.14388) 15526 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:11.011 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:10 smithi044 bash[22676]: audit 2024-09-21T04:13:09.912359+0000 mgr.a (mgr.14388) 15527 : audit [DBG] from='client.335868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:10 smithi049 bash[23528]: cluster 2024-09-21T04:13:09.647696+0000 mgr.a (mgr.14388) 15526 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:10 smithi049 bash[23528]: audit 2024-09-21T04:13:09.912359+0000 mgr.a (mgr.14388) 15527 : audit [DBG] from='client.335868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:12 smithi179 bash[23186]: cluster 2024-09-21T04:13:11.649959+0000 mgr.a (mgr.14388) 15528 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:12 smithi049 bash[23528]: cluster 2024-09-21T04:13:11.649959+0000 mgr.a (mgr.14388) 15528 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:12 smithi044 bash[22676]: cluster 2024-09-21T04:13:11.649959+0000 mgr.a (mgr.14388) 15528 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:14 smithi179 bash[23186]: cluster 2024-09-21T04:13:13.650699+0000 mgr.a (mgr.14388) 15529 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:13:15.029 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:14 smithi049 bash[23528]: cluster 2024-09-21T04:13:13.650699+0000 mgr.a (mgr.14388) 15529 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:13:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:14 smithi044 bash[22676]: cluster 2024-09-21T04:13:13.650699+0000 mgr.a (mgr.14388) 15529 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:13:15.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:15.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:15.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:16.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:16.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:16.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:16.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: audit 2024-09-21T04:13:15.621107+0000 mon.a (mon.0) 12438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: audit 2024-09-21T04:13:15.626551+0000 mon.a (mon.0) 12439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: audit 2024-09-21T04:13:15.631758+0000 mon.a (mon.0) 12440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: cluster 2024-09-21T04:13:15.651834+0000 mgr.a (mgr.14388) 15530 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: audit 2024-09-21T04:13:15.718182+0000 mgr.a (mgr.14388) 15531 : audit [DBG] from='client.335946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: audit 2024-09-21T04:13:16.063120+0000 mon.a (mon.0) 12441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: audit 2024-09-21T04:13:16.068692+0000 mon.a (mon.0) 12442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:16 smithi044 bash[22676]: audit 2024-09-21T04:13:16.074964+0000 mon.a (mon.0) 12443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: audit 2024-09-21T04:13:15.621107+0000 mon.a (mon.0) 12438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: audit 2024-09-21T04:13:15.626551+0000 mon.a (mon.0) 12439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: audit 2024-09-21T04:13:15.631758+0000 mon.a (mon.0) 12440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: cluster 2024-09-21T04:13:15.651834+0000 mgr.a (mgr.14388) 15530 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: audit 2024-09-21T04:13:15.718182+0000 mgr.a (mgr.14388) 15531 : audit [DBG] from='client.335946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: audit 2024-09-21T04:13:16.063120+0000 mon.a (mon.0) 12441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: audit 2024-09-21T04:13:16.068692+0000 mon.a (mon.0) 12442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:16 smithi179 bash[23186]: audit 2024-09-21T04:13:16.074964+0000 mon.a (mon.0) 12443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: audit 2024-09-21T04:13:15.621107+0000 mon.a (mon.0) 12438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: audit 2024-09-21T04:13:15.626551+0000 mon.a (mon.0) 12439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: audit 2024-09-21T04:13:15.631758+0000 mon.a (mon.0) 12440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: cluster 2024-09-21T04:13:15.651834+0000 mgr.a (mgr.14388) 15530 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: audit 2024-09-21T04:13:15.718182+0000 mgr.a (mgr.14388) 15531 : audit [DBG] from='client.335946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: audit 2024-09-21T04:13:16.063120+0000 mon.a (mon.0) 12441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: audit 2024-09-21T04:13:16.068692+0000 mon.a (mon.0) 12442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:16 smithi049 bash[23528]: audit 2024-09-21T04:13:16.074964+0000 mon.a (mon.0) 12443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:18 smithi044 bash[22676]: cluster 2024-09-21T04:13:17.652664+0000 mgr.a (mgr.14388) 15532 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:13:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:18 smithi179 bash[23186]: cluster 2024-09-21T04:13:17.652664+0000 mgr.a (mgr.14388) 15532 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:13:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:18 smithi049 bash[23528]: cluster 2024-09-21T04:13:17.652664+0000 mgr.a (mgr.14388) 15532 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:13:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:20 smithi044 bash[22676]: cluster 2024-09-21T04:13:19.653450+0000 mgr.a (mgr.14388) 15533 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:13:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:20 smithi179 bash[23186]: cluster 2024-09-21T04:13:19.653450+0000 mgr.a (mgr.14388) 15533 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:13:21.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:20 smithi049 bash[23528]: cluster 2024-09-21T04:13:19.653450+0000 mgr.a (mgr.14388) 15533 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:13:21.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:21.148 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:21.148 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:21.926 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:21.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:22 smithi044 bash[22676]: audit 2024-09-21T04:13:21.480481+0000 mgr.a (mgr.14388) 15534 : audit [DBG] from='client.336024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:22 smithi044 bash[22676]: cluster 2024-09-21T04:13:21.655212+0000 mgr.a (mgr.14388) 15535 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:22 smithi179 bash[23186]: audit 2024-09-21T04:13:21.480481+0000 mgr.a (mgr.14388) 15534 : audit [DBG] from='client.336024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:22 smithi179 bash[23186]: cluster 2024-09-21T04:13:21.655212+0000 mgr.a (mgr.14388) 15535 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:22 smithi049 bash[23528]: audit 2024-09-21T04:13:21.480481+0000 mgr.a (mgr.14388) 15534 : audit [DBG] from='client.336024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:23.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:22 smithi049 bash[23528]: cluster 2024-09-21T04:13:21.655212+0000 mgr.a (mgr.14388) 15535 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:24 smithi044 bash[22676]: cluster 2024-09-21T04:13:23.656162+0000 mgr.a (mgr.14388) 15536 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:24 smithi179 bash[23186]: cluster 2024-09-21T04:13:23.656162+0000 mgr.a (mgr.14388) 15536 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:24 smithi049 bash[23528]: cluster 2024-09-21T04:13:23.656162+0000 mgr.a (mgr.14388) 15536 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:25 smithi044 bash[22676]: audit 2024-09-21T04:13:24.911803+0000 mon.a (mon.0) 12444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:25 smithi044 bash[22676]: audit 2024-09-21T04:13:24.920506+0000 mon.a (mon.0) 12445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:25 smithi044 bash[22676]: audit 2024-09-21T04:13:24.931078+0000 mon.a (mon.0) 12446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:25 smithi179 bash[23186]: audit 2024-09-21T04:13:24.911803+0000 mon.a (mon.0) 12444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:25 smithi179 bash[23186]: audit 2024-09-21T04:13:24.920506+0000 mon.a (mon.0) 12445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:25 smithi179 bash[23186]: audit 2024-09-21T04:13:24.931078+0000 mon.a (mon.0) 12446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:25 smithi049 bash[23528]: audit 2024-09-21T04:13:24.911803+0000 mon.a (mon.0) 12444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:25 smithi049 bash[23528]: audit 2024-09-21T04:13:24.920506+0000 mon.a (mon.0) 12445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:25 smithi049 bash[23528]: audit 2024-09-21T04:13:24.931078+0000 mon.a (mon.0) 12446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:26.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:26.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:26.928 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:27.138 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:26 smithi179 bash[23186]: cluster 2024-09-21T04:13:25.658340+0000 mgr.a (mgr.14388) 15537 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:26 smithi044 bash[22676]: cluster 2024-09-21T04:13:25.658340+0000 mgr.a (mgr.14388) 15537 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:27.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:26 smithi049 bash[23528]: cluster 2024-09-21T04:13:25.658340+0000 mgr.a (mgr.14388) 15537 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:27.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:27.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:27.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:28 smithi044 bash[22676]: audit 2024-09-21T04:13:27.257058+0000 mgr.a (mgr.14388) 15538 : audit [DBG] from='client.336102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:28 smithi044 bash[22676]: cluster 2024-09-21T04:13:27.658881+0000 mgr.a (mgr.14388) 15539 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:28 smithi179 bash[23186]: audit 2024-09-21T04:13:27.257058+0000 mgr.a (mgr.14388) 15538 : audit [DBG] from='client.336102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:28 smithi179 bash[23186]: cluster 2024-09-21T04:13:27.658881+0000 mgr.a (mgr.14388) 15539 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:28 smithi049 bash[23528]: audit 2024-09-21T04:13:27.257058+0000 mgr.a (mgr.14388) 15538 : audit [DBG] from='client.336102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:28 smithi049 bash[23528]: cluster 2024-09-21T04:13:27.658881+0000 mgr.a (mgr.14388) 15539 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:30 smithi044 bash[22676]: cluster 2024-09-21T04:13:29.659392+0000 mgr.a (mgr.14388) 15540 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:30 smithi179 bash[23186]: cluster 2024-09-21T04:13:29.659392+0000 mgr.a (mgr.14388) 15540 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:30 smithi049 bash[23528]: cluster 2024-09-21T04:13:29.659392+0000 mgr.a (mgr.14388) 15540 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:32.696 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:32.696 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:32 smithi044 bash[22676]: cluster 2024-09-21T04:13:31.661713+0000 mgr.a (mgr.14388) 15541 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:32 smithi179 bash[23186]: cluster 2024-09-21T04:13:31.661713+0000 mgr.a (mgr.14388) 15541 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:32 smithi049 bash[23528]: cluster 2024-09-21T04:13:31.661713+0000 mgr.a (mgr.14388) 15541 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:33.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:33.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:33.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:33.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:33.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:34 smithi044 bash[22676]: audit 2024-09-21T04:13:33.024823+0000 mgr.a (mgr.14388) 15542 : audit [DBG] from='client.336180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:34 smithi044 bash[22676]: cluster 2024-09-21T04:13:33.662715+0000 mgr.a (mgr.14388) 15543 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:35.246 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:34 smithi049 bash[23528]: audit 2024-09-21T04:13:33.024823+0000 mgr.a (mgr.14388) 15542 : audit [DBG] from='client.336180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:35.246 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:34 smithi049 bash[23528]: cluster 2024-09-21T04:13:33.662715+0000 mgr.a (mgr.14388) 15543 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:34 smithi179 bash[23186]: audit 2024-09-21T04:13:33.024823+0000 mgr.a (mgr.14388) 15542 : audit [DBG] from='client.336180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:34 smithi179 bash[23186]: cluster 2024-09-21T04:13:33.662715+0000 mgr.a (mgr.14388) 15543 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:36 smithi044 bash[22676]: cluster 2024-09-21T04:13:35.664564+0000 mgr.a (mgr.14388) 15544 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:36 smithi044 bash[22676]: audit 2024-09-21T04:13:35.853933+0000 mon.a (mon.0) 12447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:36 smithi044 bash[22676]: audit 2024-09-21T04:13:35.863630+0000 mon.a (mon.0) 12448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:36 smithi044 bash[22676]: audit 2024-09-21T04:13:35.875036+0000 mon.a (mon.0) 12449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:36 smithi044 bash[22676]: audit 2024-09-21T04:13:36.284486+0000 mon.a (mon.0) 12450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:36 smithi044 bash[22676]: audit 2024-09-21T04:13:36.292864+0000 mon.a (mon.0) 12451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:36 smithi044 bash[22676]: audit 2024-09-21T04:13:36.302901+0000 mon.a (mon.0) 12452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:36 smithi179 bash[23186]: cluster 2024-09-21T04:13:35.664564+0000 mgr.a (mgr.14388) 15544 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:36 smithi179 bash[23186]: audit 2024-09-21T04:13:35.853933+0000 mon.a (mon.0) 12447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:36 smithi179 bash[23186]: audit 2024-09-21T04:13:35.863630+0000 mon.a (mon.0) 12448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:36 smithi179 bash[23186]: audit 2024-09-21T04:13:35.875036+0000 mon.a (mon.0) 12449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:36 smithi179 bash[23186]: audit 2024-09-21T04:13:36.284486+0000 mon.a (mon.0) 12450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:36 smithi179 bash[23186]: audit 2024-09-21T04:13:36.292864+0000 mon.a (mon.0) 12451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:36 smithi179 bash[23186]: audit 2024-09-21T04:13:36.302901+0000 mon.a (mon.0) 12452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:36 smithi049 bash[23528]: cluster 2024-09-21T04:13:35.664564+0000 mgr.a (mgr.14388) 15544 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:36 smithi049 bash[23528]: audit 2024-09-21T04:13:35.853933+0000 mon.a (mon.0) 12447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:36 smithi049 bash[23528]: audit 2024-09-21T04:13:35.863630+0000 mon.a (mon.0) 12448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:36 smithi049 bash[23528]: audit 2024-09-21T04:13:35.875036+0000 mon.a (mon.0) 12449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:36 smithi049 bash[23528]: audit 2024-09-21T04:13:36.284486+0000 mon.a (mon.0) 12450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:36 smithi049 bash[23528]: audit 2024-09-21T04:13:36.292864+0000 mon.a (mon.0) 12451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:36 smithi049 bash[23528]: audit 2024-09-21T04:13:36.302901+0000 mon.a (mon.0) 12452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:38.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:38.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:38.457 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:38 smithi044 bash[22676]: cluster 2024-09-21T04:13:37.665356+0000 mgr.a (mgr.14388) 15545 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:38 smithi179 bash[23186]: cluster 2024-09-21T04:13:37.665356+0000 mgr.a (mgr.14388) 15545 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:39.255 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:38 smithi049 bash[23528]: cluster 2024-09-21T04:13:37.665356+0000 mgr.a (mgr.14388) 15545 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:39 smithi044 bash[22676]: audit 2024-09-21T04:13:38.795532+0000 mgr.a (mgr.14388) 15546 : audit [DBG] from='client.336258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:39 smithi179 bash[23186]: audit 2024-09-21T04:13:38.795532+0000 mgr.a (mgr.14388) 15546 : audit [DBG] from='client.336258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:40.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:39 smithi049 bash[23528]: audit 2024-09-21T04:13:38.795532+0000 mgr.a (mgr.14388) 15546 : audit [DBG] from='client.336258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:40 smithi044 bash[22676]: cluster 2024-09-21T04:13:39.666306+0000 mgr.a (mgr.14388) 15547 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:40 smithi179 bash[23186]: cluster 2024-09-21T04:13:39.666306+0000 mgr.a (mgr.14388) 15547 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:40 smithi049 bash[23528]: cluster 2024-09-21T04:13:39.666306+0000 mgr.a (mgr.14388) 15547 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:42.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:13:41 smithi044 bash[22930]: debug 2024-09-21T04:13:41.949+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:13:42.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:13:41 smithi044 bash[22930]: debug 2024-09-21T04:13:41.949+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:13:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:41 smithi044 bash[22676]: audit 2024-09-21T04:13:41.125152+0000 mon.a (mon.0) 12453 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:13:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:41 smithi044 bash[22676]: audit 2024-09-21T04:13:41.132486+0000 mon.a (mon.0) 12454 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:13:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:41 smithi044 bash[22676]: audit 2024-09-21T04:13:41.134403+0000 mon.a (mon.0) 12455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:13:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:41 smithi044 bash[22676]: audit 2024-09-21T04:13:41.145444+0000 mon.a (mon.0) 12456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:41 smithi044 bash[22676]: audit 2024-09-21T04:13:41.151819+0000 mon.a (mon.0) 12457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:13:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:41 smithi179 bash[23186]: audit 2024-09-21T04:13:41.125152+0000 mon.a (mon.0) 12453 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:13:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:41 smithi179 bash[23186]: audit 2024-09-21T04:13:41.132486+0000 mon.a (mon.0) 12454 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:13:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:41 smithi179 bash[23186]: audit 2024-09-21T04:13:41.134403+0000 mon.a (mon.0) 12455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:13:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:41 smithi179 bash[23186]: audit 2024-09-21T04:13:41.145444+0000 mon.a (mon.0) 12456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:41 smithi179 bash[23186]: audit 2024-09-21T04:13:41.151819+0000 mon.a (mon.0) 12457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:13:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:41 smithi049 bash[23528]: audit 2024-09-21T04:13:41.125152+0000 mon.a (mon.0) 12453 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:13:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:41 smithi049 bash[23528]: audit 2024-09-21T04:13:41.132486+0000 mon.a (mon.0) 12454 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:13:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:41 smithi049 bash[23528]: audit 2024-09-21T04:13:41.134403+0000 mon.a (mon.0) 12455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:13:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:41 smithi049 bash[23528]: audit 2024-09-21T04:13:41.145444+0000 mon.a (mon.0) 12456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:41 smithi049 bash[23528]: audit 2024-09-21T04:13:41.151819+0000 mon.a (mon.0) 12457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:13:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:42 smithi044 bash[22676]: audit 2024-09-21T04:13:41.154202+0000 mgr.a (mgr.14388) 15548 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:13:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:42 smithi044 bash[22676]: cluster 2024-09-21T04:13:41.667743+0000 mgr.a (mgr.14388) 15549 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:42 smithi179 bash[23186]: audit 2024-09-21T04:13:41.154202+0000 mgr.a (mgr.14388) 15548 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:13:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:42 smithi179 bash[23186]: cluster 2024-09-21T04:13:41.667743+0000 mgr.a (mgr.14388) 15549 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:42 smithi049 bash[23528]: audit 2024-09-21T04:13:41.154202+0000 mgr.a (mgr.14388) 15548 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:13:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:42 smithi049 bash[23528]: cluster 2024-09-21T04:13:41.667743+0000 mgr.a (mgr.14388) 15549 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:13:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:43 smithi044 bash[22676]: audit 2024-09-21T04:13:41.955276+0000 mgr.a (mgr.14388) 15550 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:13:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:43 smithi044 bash[22676]: cephadm 2024-09-21T04:13:41.956828+0000 mgr.a (mgr.14388) 15551 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:13:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:43 smithi179 bash[23186]: audit 2024-09-21T04:13:41.955276+0000 mgr.a (mgr.14388) 15550 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:13:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:43 smithi179 bash[23186]: cephadm 2024-09-21T04:13:41.956828+0000 mgr.a (mgr.14388) 15551 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:13:44.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:44.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:44.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:44.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:43 smithi049 bash[23528]: audit 2024-09-21T04:13:41.955276+0000 mgr.a (mgr.14388) 15550 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:13:44.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:43 smithi049 bash[23528]: cephadm 2024-09-21T04:13:41.956828+0000 mgr.a (mgr.14388) 15551 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:13:45.016 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:45.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:45.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:45.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:45.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:45.169 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:44 smithi179 bash[23186]: cluster 2024-09-21T04:13:43.668594+0000 mgr.a (mgr.14388) 15552 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:45.172 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:44 smithi049 bash[23528]: cluster 2024-09-21T04:13:43.668594+0000 mgr.a (mgr.14388) 15552 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:44 smithi044 bash[22676]: cluster 2024-09-21T04:13:43.668594+0000 mgr.a (mgr.14388) 15552 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:13:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:45 smithi044 bash[22676]: audit 2024-09-21T04:13:44.588024+0000 mgr.a (mgr.14388) 15553 : audit [DBG] from='client.336435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:45 smithi044 bash[22676]: audit 2024-09-21T04:13:45.150572+0000 mon.a (mon.0) 12458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:45 smithi044 bash[22676]: audit 2024-09-21T04:13:45.158749+0000 mon.a (mon.0) 12459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:45 smithi044 bash[22676]: audit 2024-09-21T04:13:45.168697+0000 mon.a (mon.0) 12460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:45 smithi179 bash[23186]: audit 2024-09-21T04:13:44.588024+0000 mgr.a (mgr.14388) 15553 : audit [DBG] from='client.336435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:45 smithi179 bash[23186]: audit 2024-09-21T04:13:45.150572+0000 mon.a (mon.0) 12458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:45 smithi179 bash[23186]: audit 2024-09-21T04:13:45.158749+0000 mon.a (mon.0) 12459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:45 smithi179 bash[23186]: audit 2024-09-21T04:13:45.168697+0000 mon.a (mon.0) 12460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:45 smithi049 bash[23528]: audit 2024-09-21T04:13:44.588024+0000 mgr.a (mgr.14388) 15553 : audit [DBG] from='client.336435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:45 smithi049 bash[23528]: audit 2024-09-21T04:13:45.150572+0000 mon.a (mon.0) 12458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:45 smithi049 bash[23528]: audit 2024-09-21T04:13:45.158749+0000 mon.a (mon.0) 12459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:45 smithi049 bash[23528]: audit 2024-09-21T04:13:45.168697+0000 mon.a (mon.0) 12460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:46 smithi179 bash[23186]: cluster 2024-09-21T04:13:45.671201+0000 mgr.a (mgr.14388) 15554 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:46 smithi044 bash[22676]: cluster 2024-09-21T04:13:45.671201+0000 mgr.a (mgr.14388) 15554 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:47.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:46 smithi049 bash[23528]: cluster 2024-09-21T04:13:45.671201+0000 mgr.a (mgr.14388) 15554 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:48 smithi044 bash[22676]: cluster 2024-09-21T04:13:47.672072+0000 mgr.a (mgr.14388) 15555 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:48 smithi179 bash[23186]: cluster 2024-09-21T04:13:47.672072+0000 mgr.a (mgr.14388) 15555 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:48 smithi049 bash[23528]: cluster 2024-09-21T04:13:47.672072+0000 mgr.a (mgr.14388) 15555 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:50.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:50.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:50.767 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:50.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:50.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:50.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:50.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:51.172 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:50 smithi044 bash[22676]: cluster 2024-09-21T04:13:49.673023+0000 mgr.a (mgr.14388) 15556 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:50 smithi179 bash[23186]: cluster 2024-09-21T04:13:49.673023+0000 mgr.a (mgr.14388) 15556 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:50 smithi049 bash[23528]: cluster 2024-09-21T04:13:49.673023+0000 mgr.a (mgr.14388) 15556 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:51 smithi044 bash[22676]: audit 2024-09-21T04:13:50.333290+0000 mgr.a (mgr.14388) 15557 : audit [DBG] from='client.336513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:51 smithi179 bash[23186]: audit 2024-09-21T04:13:50.333290+0000 mgr.a (mgr.14388) 15557 : audit [DBG] from='client.336513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:52.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:51 smithi049 bash[23528]: audit 2024-09-21T04:13:50.333290+0000 mgr.a (mgr.14388) 15557 : audit [DBG] from='client.336513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:52 smithi044 bash[22676]: cluster 2024-09-21T04:13:51.676076+0000 mgr.a (mgr.14388) 15558 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:52 smithi179 bash[23186]: cluster 2024-09-21T04:13:51.676076+0000 mgr.a (mgr.14388) 15558 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:52 smithi049 bash[23528]: cluster 2024-09-21T04:13:51.676076+0000 mgr.a (mgr.14388) 15558 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:54 smithi044 bash[22676]: cluster 2024-09-21T04:13:53.676895+0000 mgr.a (mgr.14388) 15559 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:13:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:54 smithi179 bash[23186]: cluster 2024-09-21T04:13:53.676895+0000 mgr.a (mgr.14388) 15559 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:13:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:54 smithi049 bash[23528]: cluster 2024-09-21T04:13:53.676895+0000 mgr.a (mgr.14388) 15559 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:13:55.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:13:55.768 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:13:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:13:56.544 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:13:56.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:13:56.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:13:56.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:13:56.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:13:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:56 smithi044 bash[22676]: cluster 2024-09-21T04:13:55.678860+0000 mgr.a (mgr.14388) 15560 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:56 smithi044 bash[22676]: audit 2024-09-21T04:13:55.999430+0000 mon.a (mon.0) 12461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:56 smithi044 bash[22676]: audit 2024-09-21T04:13:56.005121+0000 mon.a (mon.0) 12462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:56 smithi044 bash[22676]: audit 2024-09-21T04:13:56.012177+0000 mon.a (mon.0) 12463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:56 smithi044 bash[22676]: audit 2024-09-21T04:13:56.492080+0000 mon.a (mon.0) 12464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:56 smithi044 bash[22676]: audit 2024-09-21T04:13:56.498675+0000 mon.a (mon.0) 12465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:56 smithi044 bash[22676]: audit 2024-09-21T04:13:56.503958+0000 mon.a (mon.0) 12466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:56 smithi179 bash[23186]: cluster 2024-09-21T04:13:55.678860+0000 mgr.a (mgr.14388) 15560 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:56 smithi179 bash[23186]: audit 2024-09-21T04:13:55.999430+0000 mon.a (mon.0) 12461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:56 smithi179 bash[23186]: audit 2024-09-21T04:13:56.005121+0000 mon.a (mon.0) 12462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:56 smithi179 bash[23186]: audit 2024-09-21T04:13:56.012177+0000 mon.a (mon.0) 12463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:56 smithi179 bash[23186]: audit 2024-09-21T04:13:56.492080+0000 mon.a (mon.0) 12464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:56 smithi179 bash[23186]: audit 2024-09-21T04:13:56.498675+0000 mon.a (mon.0) 12465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:56 smithi179 bash[23186]: audit 2024-09-21T04:13:56.503958+0000 mon.a (mon.0) 12466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:56 smithi049 bash[23528]: cluster 2024-09-21T04:13:55.678860+0000 mgr.a (mgr.14388) 15560 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:13:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:56 smithi049 bash[23528]: audit 2024-09-21T04:13:55.999430+0000 mon.a (mon.0) 12461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:56 smithi049 bash[23528]: audit 2024-09-21T04:13:56.005121+0000 mon.a (mon.0) 12462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:56 smithi049 bash[23528]: audit 2024-09-21T04:13:56.012177+0000 mon.a (mon.0) 12463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:56 smithi049 bash[23528]: audit 2024-09-21T04:13:56.492080+0000 mon.a (mon.0) 12464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:56 smithi049 bash[23528]: audit 2024-09-21T04:13:56.498675+0000 mon.a (mon.0) 12465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:56 smithi049 bash[23528]: audit 2024-09-21T04:13:56.503958+0000 mon.a (mon.0) 12466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:13:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:57 smithi044 bash[22676]: audit 2024-09-21T04:13:56.102547+0000 mgr.a (mgr.14388) 15561 : audit [DBG] from='client.336585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:57 smithi179 bash[23186]: audit 2024-09-21T04:13:56.102547+0000 mgr.a (mgr.14388) 15561 : audit [DBG] from='client.336585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:58.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:57 smithi049 bash[23528]: audit 2024-09-21T04:13:56.102547+0000 mgr.a (mgr.14388) 15561 : audit [DBG] from='client.336585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:13:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:13:58 smithi044 bash[22676]: cluster 2024-09-21T04:13:57.679840+0000 mgr.a (mgr.14388) 15562 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:13:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:13:58 smithi179 bash[23186]: cluster 2024-09-21T04:13:57.679840+0000 mgr.a (mgr.14388) 15562 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:13:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:13:58 smithi049 bash[23528]: cluster 2024-09-21T04:13:57.679840+0000 mgr.a (mgr.14388) 15562 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:00 smithi044 bash[22676]: cluster 2024-09-21T04:13:59.680811+0000 mgr.a (mgr.14388) 15563 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:00 smithi179 bash[23186]: cluster 2024-09-21T04:13:59.680811+0000 mgr.a (mgr.14388) 15563 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:00 smithi049 bash[23528]: cluster 2024-09-21T04:13:59.680811+0000 mgr.a (mgr.14388) 15563 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:01.545 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:02.305 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:02 smithi044 bash[22676]: cluster 2024-09-21T04:14:01.682135+0000 mgr.a (mgr.14388) 15564 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:02 smithi044 bash[22676]: audit 2024-09-21T04:14:01.873151+0000 mgr.a (mgr.14388) 15565 : audit [DBG] from='client.336663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:02 smithi179 bash[23186]: cluster 2024-09-21T04:14:01.682135+0000 mgr.a (mgr.14388) 15564 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:02 smithi179 bash[23186]: audit 2024-09-21T04:14:01.873151+0000 mgr.a (mgr.14388) 15565 : audit [DBG] from='client.336663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:02 smithi049 bash[23528]: cluster 2024-09-21T04:14:01.682135+0000 mgr.a (mgr.14388) 15564 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:02 smithi049 bash[23528]: audit 2024-09-21T04:14:01.873151+0000 mgr.a (mgr.14388) 15565 : audit [DBG] from='client.336663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:05.202 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:04 smithi179 bash[23186]: cluster 2024-09-21T04:14:03.683099+0000 mgr.a (mgr.14388) 15566 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:04 smithi044 bash[22676]: cluster 2024-09-21T04:14:03.683099+0000 mgr.a (mgr.14388) 15566 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:04 smithi049 bash[23528]: cluster 2024-09-21T04:14:03.683099+0000 mgr.a (mgr.14388) 15566 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:06 smithi044 bash[22676]: audit 2024-09-21T04:14:05.382344+0000 mon.a (mon.0) 12467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:06 smithi044 bash[22676]: audit 2024-09-21T04:14:05.391004+0000 mon.a (mon.0) 12468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:06 smithi044 bash[22676]: audit 2024-09-21T04:14:05.401527+0000 mon.a (mon.0) 12469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:06 smithi044 bash[22676]: cluster 2024-09-21T04:14:05.685374+0000 mgr.a (mgr.14388) 15567 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:06 smithi179 bash[23186]: audit 2024-09-21T04:14:05.382344+0000 mon.a (mon.0) 12467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:06 smithi179 bash[23186]: audit 2024-09-21T04:14:05.391004+0000 mon.a (mon.0) 12468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:06 smithi179 bash[23186]: audit 2024-09-21T04:14:05.401527+0000 mon.a (mon.0) 12469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:06 smithi179 bash[23186]: cluster 2024-09-21T04:14:05.685374+0000 mgr.a (mgr.14388) 15567 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:06.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:06 smithi049 bash[23528]: audit 2024-09-21T04:14:05.382344+0000 mon.a (mon.0) 12467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:06 smithi049 bash[23528]: audit 2024-09-21T04:14:05.391004+0000 mon.a (mon.0) 12468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:06 smithi049 bash[23528]: audit 2024-09-21T04:14:05.401527+0000 mon.a (mon.0) 12469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:06 smithi049 bash[23528]: cluster 2024-09-21T04:14:05.685374+0000 mgr.a (mgr.14388) 15567 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:07.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:07.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:07.308 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:08.062 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:08.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:08.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:08 smithi044 bash[22676]: audit 2024-09-21T04:14:07.635444+0000 mgr.a (mgr.14388) 15568 : audit [DBG] from='client.336738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:08 smithi044 bash[22676]: cluster 2024-09-21T04:14:07.686074+0000 mgr.a (mgr.14388) 15569 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:08 smithi179 bash[23186]: audit 2024-09-21T04:14:07.635444+0000 mgr.a (mgr.14388) 15568 : audit [DBG] from='client.336738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:08 smithi179 bash[23186]: cluster 2024-09-21T04:14:07.686074+0000 mgr.a (mgr.14388) 15569 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:09.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:08 smithi049 bash[23528]: audit 2024-09-21T04:14:07.635444+0000 mgr.a (mgr.14388) 15568 : audit [DBG] from='client.336738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:08 smithi049 bash[23528]: cluster 2024-09-21T04:14:07.686074+0000 mgr.a (mgr.14388) 15569 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:10 smithi179 bash[23186]: cluster 2024-09-21T04:14:09.686746+0000 mgr.a (mgr.14388) 15570 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:10 smithi049 bash[23528]: cluster 2024-09-21T04:14:09.686746+0000 mgr.a (mgr.14388) 15570 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:10 smithi044 bash[22676]: cluster 2024-09-21T04:14:09.686746+0000 mgr.a (mgr.14388) 15570 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:12 smithi044 bash[22676]: cluster 2024-09-21T04:14:11.688954+0000 mgr.a (mgr.14388) 15571 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:12 smithi179 bash[23186]: cluster 2024-09-21T04:14:11.688954+0000 mgr.a (mgr.14388) 15571 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:13.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:12 smithi049 bash[23528]: cluster 2024-09-21T04:14:11.688954+0000 mgr.a (mgr.14388) 15571 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:13.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:13.065 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:13.828 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:15.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:14 smithi049 bash[23528]: audit 2024-09-21T04:14:13.397673+0000 mgr.a (mgr.14388) 15572 : audit [DBG] from='client.336813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:14 smithi049 bash[23528]: cluster 2024-09-21T04:14:13.689588+0000 mgr.a (mgr.14388) 15573 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:14 smithi044 bash[22676]: audit 2024-09-21T04:14:13.397673+0000 mgr.a (mgr.14388) 15572 : audit [DBG] from='client.336813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:14 smithi044 bash[22676]: cluster 2024-09-21T04:14:13.689588+0000 mgr.a (mgr.14388) 15573 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:14 smithi179 bash[23186]: audit 2024-09-21T04:14:13.397673+0000 mgr.a (mgr.14388) 15572 : audit [DBG] from='client.336813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:14 smithi179 bash[23186]: cluster 2024-09-21T04:14:13.689588+0000 mgr.a (mgr.14388) 15573 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:16.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:16 smithi049 bash[23528]: cluster 2024-09-21T04:14:15.692063+0000 mgr.a (mgr.14388) 15574 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:16.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:16 smithi049 bash[23528]: audit 2024-09-21T04:14:16.228387+0000 mon.a (mon.0) 12470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:16.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:16 smithi049 bash[23528]: audit 2024-09-21T04:14:16.236591+0000 mon.a (mon.0) 12471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:16.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:16 smithi049 bash[23528]: audit 2024-09-21T04:14:16.247164+0000 mon.a (mon.0) 12472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:16.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:16 smithi049 bash[23528]: audit 2024-09-21T04:14:16.711863+0000 mon.a (mon.0) 12473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:16.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:16 smithi049 bash[23528]: audit 2024-09-21T04:14:16.720353+0000 mon.a (mon.0) 12474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:16.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:16 smithi049 bash[23528]: audit 2024-09-21T04:14:16.730553+0000 mon.a (mon.0) 12475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:16 smithi179 bash[23186]: cluster 2024-09-21T04:14:15.692063+0000 mgr.a (mgr.14388) 15574 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:16 smithi179 bash[23186]: audit 2024-09-21T04:14:16.228387+0000 mon.a (mon.0) 12470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:16 smithi179 bash[23186]: audit 2024-09-21T04:14:16.236591+0000 mon.a (mon.0) 12471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:16 smithi179 bash[23186]: audit 2024-09-21T04:14:16.247164+0000 mon.a (mon.0) 12472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:16 smithi179 bash[23186]: audit 2024-09-21T04:14:16.711863+0000 mon.a (mon.0) 12473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:16 smithi179 bash[23186]: audit 2024-09-21T04:14:16.720353+0000 mon.a (mon.0) 12474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:16 smithi179 bash[23186]: audit 2024-09-21T04:14:16.730553+0000 mon.a (mon.0) 12475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:16 smithi044 bash[22676]: cluster 2024-09-21T04:14:15.692063+0000 mgr.a (mgr.14388) 15574 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:16 smithi044 bash[22676]: audit 2024-09-21T04:14:16.228387+0000 mon.a (mon.0) 12470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:16 smithi044 bash[22676]: audit 2024-09-21T04:14:16.236591+0000 mon.a (mon.0) 12471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:16 smithi044 bash[22676]: audit 2024-09-21T04:14:16.247164+0000 mon.a (mon.0) 12472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:16 smithi044 bash[22676]: audit 2024-09-21T04:14:16.711863+0000 mon.a (mon.0) 12473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:16 smithi044 bash[22676]: audit 2024-09-21T04:14:16.720353+0000 mon.a (mon.0) 12474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:16 smithi044 bash[22676]: audit 2024-09-21T04:14:16.730553+0000 mon.a (mon.0) 12475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:18.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:19.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:18 smithi049 bash[23528]: cluster 2024-09-21T04:14:17.692880+0000 mgr.a (mgr.14388) 15575 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:18 smithi044 bash[22676]: cluster 2024-09-21T04:14:17.692880+0000 mgr.a (mgr.14388) 15575 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:18 smithi179 bash[23186]: cluster 2024-09-21T04:14:17.692880+0000 mgr.a (mgr.14388) 15575 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:19.617 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:19.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:20 smithi049 bash[23528]: audit 2024-09-21T04:14:19.163120+0000 mgr.a (mgr.14388) 15576 : audit [DBG] from='client.336888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:20 smithi049 bash[23528]: cluster 2024-09-21T04:14:19.693886+0000 mgr.a (mgr.14388) 15577 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:20 smithi044 bash[22676]: audit 2024-09-21T04:14:19.163120+0000 mgr.a (mgr.14388) 15576 : audit [DBG] from='client.336888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:20 smithi044 bash[22676]: cluster 2024-09-21T04:14:19.693886+0000 mgr.a (mgr.14388) 15577 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:20 smithi179 bash[23186]: audit 2024-09-21T04:14:19.163120+0000 mgr.a (mgr.14388) 15576 : audit [DBG] from='client.336888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:20 smithi179 bash[23186]: cluster 2024-09-21T04:14:19.693886+0000 mgr.a (mgr.14388) 15577 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:23.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:22 smithi049 bash[23528]: cluster 2024-09-21T04:14:21.696185+0000 mgr.a (mgr.14388) 15578 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:22 smithi044 bash[22676]: cluster 2024-09-21T04:14:21.696185+0000 mgr.a (mgr.14388) 15578 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:22 smithi179 bash[23186]: cluster 2024-09-21T04:14:21.696185+0000 mgr.a (mgr.14388) 15578 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:24.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:24.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:25.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:24 smithi049 bash[23528]: cluster 2024-09-21T04:14:23.696966+0000 mgr.a (mgr.14388) 15579 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:24 smithi044 bash[22676]: cluster 2024-09-21T04:14:23.696966+0000 mgr.a (mgr.14388) 15579 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:24 smithi179 bash[23186]: cluster 2024-09-21T04:14:23.696966+0000 mgr.a (mgr.14388) 15579 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:25.373 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:25.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:25 smithi179 bash[23186]: audit 2024-09-21T04:14:24.948666+0000 mgr.a (mgr.14388) 15580 : audit [DBG] from='client.336966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:25.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:25 smithi179 bash[23186]: audit 2024-09-21T04:14:25.620525+0000 mon.a (mon.0) 12476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:25.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:25 smithi179 bash[23186]: audit 2024-09-21T04:14:25.629097+0000 mon.a (mon.0) 12477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:25.872 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:25 smithi179 bash[23186]: audit 2024-09-21T04:14:25.639137+0000 mon.a (mon.0) 12478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:26.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:25 smithi049 bash[23528]: audit 2024-09-21T04:14:24.948666+0000 mgr.a (mgr.14388) 15580 : audit [DBG] from='client.336966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:25 smithi049 bash[23528]: audit 2024-09-21T04:14:25.620525+0000 mon.a (mon.0) 12476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:25 smithi049 bash[23528]: audit 2024-09-21T04:14:25.629097+0000 mon.a (mon.0) 12477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:25 smithi049 bash[23528]: audit 2024-09-21T04:14:25.639137+0000 mon.a (mon.0) 12478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:25 smithi044 bash[22676]: audit 2024-09-21T04:14:24.948666+0000 mgr.a (mgr.14388) 15580 : audit [DBG] from='client.336966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:25 smithi044 bash[22676]: audit 2024-09-21T04:14:25.620525+0000 mon.a (mon.0) 12476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:25 smithi044 bash[22676]: audit 2024-09-21T04:14:25.629097+0000 mon.a (mon.0) 12477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:25 smithi044 bash[22676]: audit 2024-09-21T04:14:25.639137+0000 mon.a (mon.0) 12478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:26 smithi179 bash[23186]: cluster 2024-09-21T04:14:25.699842+0000 mgr.a (mgr.14388) 15581 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:27.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:26 smithi049 bash[23528]: cluster 2024-09-21T04:14:25.699842+0000 mgr.a (mgr.14388) 15581 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:26 smithi044 bash[22676]: cluster 2024-09-21T04:14:25.699842+0000 mgr.a (mgr.14388) 15581 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:29.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:28 smithi049 bash[23528]: cluster 2024-09-21T04:14:27.700647+0000 mgr.a (mgr.14388) 15582 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:28 smithi044 bash[22676]: cluster 2024-09-21T04:14:27.700647+0000 mgr.a (mgr.14388) 15582 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:28 smithi179 bash[23186]: cluster 2024-09-21T04:14:27.700647+0000 mgr.a (mgr.14388) 15582 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:30.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:30.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:30.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:30 smithi044 bash[22676]: cluster 2024-09-21T04:14:29.701468+0000 mgr.a (mgr.14388) 15583 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:31.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:30 smithi049 bash[23528]: cluster 2024-09-21T04:14:29.701468+0000 mgr.a (mgr.14388) 15583 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:31.162 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:30 smithi179 bash[23186]: cluster 2024-09-21T04:14:29.701468+0000 mgr.a (mgr.14388) 15583 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:32.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:31 smithi049 bash[23528]: audit 2024-09-21T04:14:30.708882+0000 mgr.a (mgr.14388) 15584 : audit [DBG] from='client.337044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:32.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:31 smithi044 bash[22676]: audit 2024-09-21T04:14:30.708882+0000 mgr.a (mgr.14388) 15584 : audit [DBG] from='client.337044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:31 smithi179 bash[23186]: audit 2024-09-21T04:14:30.708882+0000 mgr.a (mgr.14388) 15584 : audit [DBG] from='client.337044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:33.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:32 smithi049 bash[23528]: cluster 2024-09-21T04:14:31.704377+0000 mgr.a (mgr.14388) 15585 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:32 smithi044 bash[22676]: cluster 2024-09-21T04:14:31.704377+0000 mgr.a (mgr.14388) 15585 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:32 smithi179 bash[23186]: cluster 2024-09-21T04:14:31.704377+0000 mgr.a (mgr.14388) 15585 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:34 smithi044 bash[22676]: cluster 2024-09-21T04:14:33.705178+0000 mgr.a (mgr.14388) 15586 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:34 smithi179 bash[23186]: cluster 2024-09-21T04:14:33.705178+0000 mgr.a (mgr.14388) 15586 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:35.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:34 smithi049 bash[23528]: cluster 2024-09-21T04:14:33.705178+0000 mgr.a (mgr.14388) 15586 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:14:36.164 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:36.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:36.165 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:36.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:36.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:36.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:36.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:36.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:36 smithi049 bash[23528]: cluster 2024-09-21T04:14:35.707199+0000 mgr.a (mgr.14388) 15587 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:36 smithi049 bash[23528]: audit 2024-09-21T04:14:36.390407+0000 mon.a (mon.0) 12479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:36 smithi049 bash[23528]: audit 2024-09-21T04:14:36.397314+0000 mon.a (mon.0) 12480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:36 smithi049 bash[23528]: audit 2024-09-21T04:14:36.402518+0000 mon.a (mon.0) 12481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:36 smithi044 bash[22676]: cluster 2024-09-21T04:14:35.707199+0000 mgr.a (mgr.14388) 15587 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:36 smithi044 bash[22676]: audit 2024-09-21T04:14:36.390407+0000 mon.a (mon.0) 12479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:36 smithi044 bash[22676]: audit 2024-09-21T04:14:36.397314+0000 mon.a (mon.0) 12480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:36 smithi044 bash[22676]: audit 2024-09-21T04:14:36.402518+0000 mon.a (mon.0) 12481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:36 smithi179 bash[23186]: cluster 2024-09-21T04:14:35.707199+0000 mgr.a (mgr.14388) 15587 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:36 smithi179 bash[23186]: audit 2024-09-21T04:14:36.390407+0000 mon.a (mon.0) 12479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:36 smithi179 bash[23186]: audit 2024-09-21T04:14:36.397314+0000 mon.a (mon.0) 12480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:36 smithi179 bash[23186]: audit 2024-09-21T04:14:36.402518+0000 mon.a (mon.0) 12481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:37 smithi049 bash[23528]: audit 2024-09-21T04:14:36.517705+0000 mgr.a (mgr.14388) 15588 : audit [DBG] from='client.337119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:37 smithi049 bash[23528]: audit 2024-09-21T04:14:36.897113+0000 mon.a (mon.0) 12482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:37 smithi049 bash[23528]: audit 2024-09-21T04:14:36.904667+0000 mon.a (mon.0) 12483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:37 smithi049 bash[23528]: audit 2024-09-21T04:14:36.910694+0000 mon.a (mon.0) 12484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:37 smithi044 bash[22676]: audit 2024-09-21T04:14:36.517705+0000 mgr.a (mgr.14388) 15588 : audit [DBG] from='client.337119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:37 smithi044 bash[22676]: audit 2024-09-21T04:14:36.897113+0000 mon.a (mon.0) 12482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:37 smithi044 bash[22676]: audit 2024-09-21T04:14:36.904667+0000 mon.a (mon.0) 12483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:37 smithi044 bash[22676]: audit 2024-09-21T04:14:36.910694+0000 mon.a (mon.0) 12484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:37 smithi179 bash[23186]: audit 2024-09-21T04:14:36.517705+0000 mgr.a (mgr.14388) 15588 : audit [DBG] from='client.337119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:37 smithi179 bash[23186]: audit 2024-09-21T04:14:36.897113+0000 mon.a (mon.0) 12482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:37 smithi179 bash[23186]: audit 2024-09-21T04:14:36.904667+0000 mon.a (mon.0) 12483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:37 smithi179 bash[23186]: audit 2024-09-21T04:14:36.910694+0000 mon.a (mon.0) 12484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:38 smithi044 bash[22676]: cluster 2024-09-21T04:14:37.708164+0000 mgr.a (mgr.14388) 15589 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:38 smithi179 bash[23186]: cluster 2024-09-21T04:14:37.708164+0000 mgr.a (mgr.14388) 15589 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:39.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:38 smithi049 bash[23528]: cluster 2024-09-21T04:14:37.708164+0000 mgr.a (mgr.14388) 15589 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:40 smithi044 bash[22676]: cluster 2024-09-21T04:14:39.708984+0000 mgr.a (mgr.14388) 15590 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:40 smithi179 bash[23186]: cluster 2024-09-21T04:14:39.708984+0000 mgr.a (mgr.14388) 15590 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:41.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:40 smithi049 bash[23528]: cluster 2024-09-21T04:14:39.708984+0000 mgr.a (mgr.14388) 15590 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:41.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:41.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:41.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22930]: debug 2024-09-21T04:14:42.832+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22930]: debug 2024-09-21T04:14:42.848+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22676]: cluster 2024-09-21T04:14:41.711217+0000 mgr.a (mgr.14388) 15591 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22676]: audit 2024-09-21T04:14:42.028522+0000 mon.a (mon.0) 12485 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22676]: audit 2024-09-21T04:14:42.034042+0000 mon.a (mon.0) 12486 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22676]: audit 2024-09-21T04:14:42.035790+0000 mon.a (mon.0) 12487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22676]: audit 2024-09-21T04:14:42.046453+0000 mon.a (mon.0) 12488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:42 smithi044 bash[22676]: audit 2024-09-21T04:14:42.050774+0000 mon.a (mon.0) 12489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:14:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:42 smithi179 bash[23186]: cluster 2024-09-21T04:14:41.711217+0000 mgr.a (mgr.14388) 15591 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:42 smithi179 bash[23186]: audit 2024-09-21T04:14:42.028522+0000 mon.a (mon.0) 12485 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:14:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:42 smithi179 bash[23186]: audit 2024-09-21T04:14:42.034042+0000 mon.a (mon.0) 12486 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:14:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:42 smithi179 bash[23186]: audit 2024-09-21T04:14:42.035790+0000 mon.a (mon.0) 12487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:14:43.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:42 smithi179 bash[23186]: audit 2024-09-21T04:14:42.046453+0000 mon.a (mon.0) 12488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:43.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:42 smithi179 bash[23186]: audit 2024-09-21T04:14:42.050774+0000 mon.a (mon.0) 12489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:14:43.256 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:43.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:43.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:43.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:43.256 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:42 smithi049 bash[23528]: cluster 2024-09-21T04:14:41.711217+0000 mgr.a (mgr.14388) 15591 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:14:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:42 smithi049 bash[23528]: audit 2024-09-21T04:14:42.028522+0000 mon.a (mon.0) 12485 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:14:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:42 smithi049 bash[23528]: audit 2024-09-21T04:14:42.034042+0000 mon.a (mon.0) 12486 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:14:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:42 smithi049 bash[23528]: audit 2024-09-21T04:14:42.035790+0000 mon.a (mon.0) 12487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:14:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:42 smithi049 bash[23528]: audit 2024-09-21T04:14:42.046453+0000 mon.a (mon.0) 12488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:42 smithi049 bash[23528]: audit 2024-09-21T04:14:42.050774+0000 mon.a (mon.0) 12489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:14:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:43 smithi044 bash[22676]: audit 2024-09-21T04:14:42.053067+0000 mgr.a (mgr.14388) 15592 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:14:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:43 smithi044 bash[22676]: audit 2024-09-21T04:14:42.330535+0000 mgr.a (mgr.14388) 15593 : audit [DBG] from='client.337197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:43 smithi044 bash[22676]: audit 2024-09-21T04:14:42.833337+0000 mgr.a (mgr.14388) 15594 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:14:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:43 smithi044 bash[22676]: cephadm 2024-09-21T04:14:42.850355+0000 mgr.a (mgr.14388) 15595 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:14:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:43 smithi179 bash[23186]: audit 2024-09-21T04:14:42.053067+0000 mgr.a (mgr.14388) 15592 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:14:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:43 smithi179 bash[23186]: audit 2024-09-21T04:14:42.330535+0000 mgr.a (mgr.14388) 15593 : audit [DBG] from='client.337197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:43 smithi179 bash[23186]: audit 2024-09-21T04:14:42.833337+0000 mgr.a (mgr.14388) 15594 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:14:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:43 smithi179 bash[23186]: cephadm 2024-09-21T04:14:42.850355+0000 mgr.a (mgr.14388) 15595 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:14:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:43 smithi049 bash[23528]: audit 2024-09-21T04:14:42.053067+0000 mgr.a (mgr.14388) 15592 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:14:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:43 smithi049 bash[23528]: audit 2024-09-21T04:14:42.330535+0000 mgr.a (mgr.14388) 15593 : audit [DBG] from='client.337197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:43 smithi049 bash[23528]: audit 2024-09-21T04:14:42.833337+0000 mgr.a (mgr.14388) 15594 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:14:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:43 smithi049 bash[23528]: cephadm 2024-09-21T04:14:42.850355+0000 mgr.a (mgr.14388) 15595 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:14:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:44 smithi044 bash[22676]: cluster 2024-09-21T04:14:43.712159+0000 mgr.a (mgr.14388) 15596 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:44 smithi179 bash[23186]: cluster 2024-09-21T04:14:43.712159+0000 mgr.a (mgr.14388) 15596 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:44 smithi049 bash[23528]: cluster 2024-09-21T04:14:43.712159+0000 mgr.a (mgr.14388) 15596 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:46 smithi044 bash[22676]: cluster 2024-09-21T04:14:45.714444+0000 mgr.a (mgr.14388) 15597 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:46 smithi044 bash[22676]: audit 2024-09-21T04:14:45.829716+0000 mon.a (mon.0) 12490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:46 smithi044 bash[22676]: audit 2024-09-21T04:14:45.838393+0000 mon.a (mon.0) 12491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:46 smithi044 bash[22676]: audit 2024-09-21T04:14:45.848868+0000 mon.a (mon.0) 12492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:46 smithi179 bash[23186]: cluster 2024-09-21T04:14:45.714444+0000 mgr.a (mgr.14388) 15597 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:46 smithi179 bash[23186]: audit 2024-09-21T04:14:45.829716+0000 mon.a (mon.0) 12490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:46 smithi179 bash[23186]: audit 2024-09-21T04:14:45.838393+0000 mon.a (mon.0) 12491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:46 smithi179 bash[23186]: audit 2024-09-21T04:14:45.848868+0000 mon.a (mon.0) 12492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:46 smithi049 bash[23528]: cluster 2024-09-21T04:14:45.714444+0000 mgr.a (mgr.14388) 15597 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:46 smithi049 bash[23528]: audit 2024-09-21T04:14:45.829716+0000 mon.a (mon.0) 12490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:46 smithi049 bash[23528]: audit 2024-09-21T04:14:45.838393+0000 mon.a (mon.0) 12491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:46 smithi049 bash[23528]: audit 2024-09-21T04:14:45.848868+0000 mon.a (mon.0) 12492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:48.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:48.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:48.258 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:49.025 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:48 smithi044 bash[22676]: cluster 2024-09-21T04:14:47.715247+0000 mgr.a (mgr.14388) 15598 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:48 smithi179 bash[23186]: cluster 2024-09-21T04:14:47.715247+0000 mgr.a (mgr.14388) 15598 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:48 smithi049 bash[23528]: cluster 2024-09-21T04:14:47.715247+0000 mgr.a (mgr.14388) 15598 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:49 smithi044 bash[22676]: audit 2024-09-21T04:14:48.593600+0000 mgr.a (mgr.14388) 15599 : audit [DBG] from='client.337383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:49 smithi179 bash[23186]: audit 2024-09-21T04:14:48.593600+0000 mgr.a (mgr.14388) 15599 : audit [DBG] from='client.337383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:50.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:49 smithi049 bash[23528]: audit 2024-09-21T04:14:48.593600+0000 mgr.a (mgr.14388) 15599 : audit [DBG] from='client.337383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:50.958 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:50 smithi044 bash[22676]: cluster 2024-09-21T04:14:49.716293+0000 mgr.a (mgr.14388) 15600 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:50 smithi179 bash[23186]: cluster 2024-09-21T04:14:49.716293+0000 mgr.a (mgr.14388) 15600 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:50 smithi049 bash[23528]: cluster 2024-09-21T04:14:49.716293+0000 mgr.a (mgr.14388) 15600 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:53.128 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:52 smithi044 bash[22676]: cluster 2024-09-21T04:14:51.718682+0000 mgr.a (mgr.14388) 15601 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:52 smithi179 bash[23186]: cluster 2024-09-21T04:14:51.718682+0000 mgr.a (mgr.14388) 15601 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:52 smithi049 bash[23528]: cluster 2024-09-21T04:14:51.718682+0000 mgr.a (mgr.14388) 15601 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:54.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:14:54.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:14:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:14:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:14:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:14:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:14:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:54 smithi044 bash[22676]: cluster 2024-09-21T04:14:53.719478+0000 mgr.a (mgr.14388) 15602 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:54 smithi179 bash[23186]: cluster 2024-09-21T04:14:53.719478+0000 mgr.a (mgr.14388) 15602 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:54 smithi049 bash[23528]: cluster 2024-09-21T04:14:53.719478+0000 mgr.a (mgr.14388) 15602 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:55 smithi044 bash[22676]: audit 2024-09-21T04:14:54.365368+0000 mgr.a (mgr.14388) 15603 : audit [DBG] from='client.337461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:55 smithi179 bash[23186]: audit 2024-09-21T04:14:54.365368+0000 mgr.a (mgr.14388) 15603 : audit [DBG] from='client.337461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:55 smithi049 bash[23528]: audit 2024-09-21T04:14:54.365368+0000 mgr.a (mgr.14388) 15603 : audit [DBG] from='client.337461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:14:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:56 smithi044 bash[22676]: cluster 2024-09-21T04:14:55.721863+0000 mgr.a (mgr.14388) 15604 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:56 smithi044 bash[22676]: audit 2024-09-21T04:14:56.626895+0000 mon.a (mon.0) 12493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:56 smithi044 bash[22676]: audit 2024-09-21T04:14:56.636406+0000 mon.a (mon.0) 12494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:56 smithi044 bash[22676]: audit 2024-09-21T04:14:56.648082+0000 mon.a (mon.0) 12495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:57.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:56 smithi049 bash[23528]: cluster 2024-09-21T04:14:55.721863+0000 mgr.a (mgr.14388) 15604 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:57.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:56 smithi049 bash[23528]: audit 2024-09-21T04:14:56.626895+0000 mon.a (mon.0) 12493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:57.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:56 smithi049 bash[23528]: audit 2024-09-21T04:14:56.636406+0000 mon.a (mon.0) 12494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:57.145 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:56 smithi049 bash[23528]: audit 2024-09-21T04:14:56.648082+0000 mon.a (mon.0) 12495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:57.150 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:56 smithi179 bash[23186]: cluster 2024-09-21T04:14:55.721863+0000 mgr.a (mgr.14388) 15604 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:14:57.150 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:56 smithi179 bash[23186]: audit 2024-09-21T04:14:56.626895+0000 mon.a (mon.0) 12493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:57.150 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:56 smithi179 bash[23186]: audit 2024-09-21T04:14:56.636406+0000 mon.a (mon.0) 12494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:57.150 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:56 smithi179 bash[23186]: audit 2024-09-21T04:14:56.648082+0000 mon.a (mon.0) 12495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:58 smithi044 bash[22676]: audit 2024-09-21T04:14:57.125097+0000 mon.a (mon.0) 12496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:58 smithi044 bash[22676]: audit 2024-09-21T04:14:57.134595+0000 mon.a (mon.0) 12497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:58 smithi044 bash[22676]: audit 2024-09-21T04:14:57.145968+0000 mon.a (mon.0) 12498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:14:58 smithi044 bash[22676]: cluster 2024-09-21T04:14:57.722648+0000 mgr.a (mgr.14388) 15605 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:58 smithi179 bash[23186]: audit 2024-09-21T04:14:57.125097+0000 mon.a (mon.0) 12496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:58 smithi179 bash[23186]: audit 2024-09-21T04:14:57.134595+0000 mon.a (mon.0) 12497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:58 smithi179 bash[23186]: audit 2024-09-21T04:14:57.145968+0000 mon.a (mon.0) 12498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:14:58 smithi179 bash[23186]: cluster 2024-09-21T04:14:57.722648+0000 mgr.a (mgr.14388) 15605 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:58 smithi049 bash[23528]: audit 2024-09-21T04:14:57.125097+0000 mon.a (mon.0) 12496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:58 smithi049 bash[23528]: audit 2024-09-21T04:14:57.134595+0000 mon.a (mon.0) 12497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:58 smithi049 bash[23528]: audit 2024-09-21T04:14:57.145968+0000 mon.a (mon.0) 12498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:14:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:14:58 smithi049 bash[23528]: cluster 2024-09-21T04:14:57.722648+0000 mgr.a (mgr.14388) 15605 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:14:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:14:59.812 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:14:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:00.563 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:00.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:01.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:00 smithi049 bash[23528]: cluster 2024-09-21T04:14:59.723433+0000 mgr.a (mgr.14388) 15606 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:01.111 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:00 smithi179 bash[23186]: cluster 2024-09-21T04:14:59.723433+0000 mgr.a (mgr.14388) 15606 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:01.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:00 smithi044 bash[22676]: cluster 2024-09-21T04:14:59.723433+0000 mgr.a (mgr.14388) 15606 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:02.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:01 smithi049 bash[23528]: audit 2024-09-21T04:15:00.143210+0000 mgr.a (mgr.14388) 15607 : audit [DBG] from='client.337533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:01 smithi044 bash[22676]: audit 2024-09-21T04:15:00.143210+0000 mgr.a (mgr.14388) 15607 : audit [DBG] from='client.337533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:01 smithi179 bash[23186]: audit 2024-09-21T04:15:00.143210+0000 mgr.a (mgr.14388) 15607 : audit [DBG] from='client.337533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:03.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:02 smithi049 bash[23528]: cluster 2024-09-21T04:15:01.726436+0000 mgr.a (mgr.14388) 15608 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:02 smithi044 bash[22676]: cluster 2024-09-21T04:15:01.726436+0000 mgr.a (mgr.14388) 15608 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:02 smithi179 bash[23186]: cluster 2024-09-21T04:15:01.726436+0000 mgr.a (mgr.14388) 15608 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:05.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:04 smithi049 bash[23528]: cluster 2024-09-21T04:15:03.727429+0000 mgr.a (mgr.14388) 15609 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:04 smithi044 bash[22676]: cluster 2024-09-21T04:15:03.727429+0000 mgr.a (mgr.14388) 15609 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:04 smithi179 bash[23186]: cluster 2024-09-21T04:15:03.727429+0000 mgr.a (mgr.14388) 15609 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:06.311 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:06.311 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:06.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:06.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:06.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:06 smithi179 bash[23186]: cluster 2024-09-21T04:15:05.729207+0000 mgr.a (mgr.14388) 15610 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:06 smithi179 bash[23186]: audit 2024-09-21T04:15:05.893555+0000 mgr.a (mgr.14388) 15611 : audit [DBG] from='client.337611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:06 smithi179 bash[23186]: audit 2024-09-21T04:15:06.041491+0000 mon.a (mon.0) 12499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:06 smithi179 bash[23186]: audit 2024-09-21T04:15:06.047197+0000 mon.a (mon.0) 12500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:06 smithi179 bash[23186]: audit 2024-09-21T04:15:06.055211+0000 mon.a (mon.0) 12501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:06 smithi049 bash[23528]: cluster 2024-09-21T04:15:05.729207+0000 mgr.a (mgr.14388) 15610 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:06 smithi049 bash[23528]: audit 2024-09-21T04:15:05.893555+0000 mgr.a (mgr.14388) 15611 : audit [DBG] from='client.337611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:06 smithi049 bash[23528]: audit 2024-09-21T04:15:06.041491+0000 mon.a (mon.0) 12499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:06 smithi049 bash[23528]: audit 2024-09-21T04:15:06.047197+0000 mon.a (mon.0) 12500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:06 smithi049 bash[23528]: audit 2024-09-21T04:15:06.055211+0000 mon.a (mon.0) 12501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:06 smithi044 bash[22676]: cluster 2024-09-21T04:15:05.729207+0000 mgr.a (mgr.14388) 15610 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:06 smithi044 bash[22676]: audit 2024-09-21T04:15:05.893555+0000 mgr.a (mgr.14388) 15611 : audit [DBG] from='client.337611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:06 smithi044 bash[22676]: audit 2024-09-21T04:15:06.041491+0000 mon.a (mon.0) 12499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:06 smithi044 bash[22676]: audit 2024-09-21T04:15:06.047197+0000 mon.a (mon.0) 12500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:06 smithi044 bash[22676]: audit 2024-09-21T04:15:06.055211+0000 mon.a (mon.0) 12501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:08 smithi044 bash[22676]: cluster 2024-09-21T04:15:07.730176+0000 mgr.a (mgr.14388) 15612 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:08 smithi179 bash[23186]: cluster 2024-09-21T04:15:07.730176+0000 mgr.a (mgr.14388) 15612 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:08 smithi049 bash[23528]: cluster 2024-09-21T04:15:07.730176+0000 mgr.a (mgr.14388) 15612 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:11.056 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:10 smithi044 bash[22676]: cluster 2024-09-21T04:15:09.731002+0000 mgr.a (mgr.14388) 15613 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:15:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:10 smithi179 bash[23186]: cluster 2024-09-21T04:15:09.731002+0000 mgr.a (mgr.14388) 15613 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:15:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:10 smithi049 bash[23528]: cluster 2024-09-21T04:15:09.731002+0000 mgr.a (mgr.14388) 15613 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:15:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:11.314 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:12.103 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:12.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:12.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:12.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:12.104 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:13.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:12 smithi044 bash[22676]: audit 2024-09-21T04:15:11.646422+0000 mgr.a (mgr.14388) 15614 : audit [DBG] from='client.337689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:13.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:12 smithi044 bash[22676]: cluster 2024-09-21T04:15:11.732564+0000 mgr.a (mgr.14388) 15615 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:12 smithi179 bash[23186]: audit 2024-09-21T04:15:11.646422+0000 mgr.a (mgr.14388) 15614 : audit [DBG] from='client.337689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:12 smithi179 bash[23186]: cluster 2024-09-21T04:15:11.732564+0000 mgr.a (mgr.14388) 15615 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:12 smithi049 bash[23528]: audit 2024-09-21T04:15:11.646422+0000 mgr.a (mgr.14388) 15614 : audit [DBG] from='client.337689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:12 smithi049 bash[23528]: cluster 2024-09-21T04:15:11.732564+0000 mgr.a (mgr.14388) 15615 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:14 smithi044 bash[22676]: cluster 2024-09-21T04:15:13.733501+0000 mgr.a (mgr.14388) 15616 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:14 smithi179 bash[23186]: cluster 2024-09-21T04:15:13.733501+0000 mgr.a (mgr.14388) 15616 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:14 smithi049 bash[23528]: cluster 2024-09-21T04:15:13.733501+0000 mgr.a (mgr.14388) 15616 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:17.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:17.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:17.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:16 smithi044 bash[22676]: cluster 2024-09-21T04:15:15.735726+0000 mgr.a (mgr.14388) 15617 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:16 smithi179 bash[23186]: cluster 2024-09-21T04:15:15.735726+0000 mgr.a (mgr.14388) 15617 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:16 smithi049 bash[23528]: cluster 2024-09-21T04:15:15.735726+0000 mgr.a (mgr.14388) 15617 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:17.896 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:17.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:17.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:17.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:17.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:17 smithi044 bash[22676]: audit 2024-09-21T04:15:16.864288+0000 mon.a (mon.0) 12502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:17 smithi044 bash[22676]: audit 2024-09-21T04:15:16.873539+0000 mon.a (mon.0) 12503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:17 smithi044 bash[22676]: audit 2024-09-21T04:15:16.885136+0000 mon.a (mon.0) 12504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:17 smithi044 bash[22676]: audit 2024-09-21T04:15:17.358102+0000 mon.a (mon.0) 12505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:17 smithi044 bash[22676]: audit 2024-09-21T04:15:17.367395+0000 mon.a (mon.0) 12506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:17 smithi044 bash[22676]: audit 2024-09-21T04:15:17.378129+0000 mon.a (mon.0) 12507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:17 smithi179 bash[23186]: audit 2024-09-21T04:15:16.864288+0000 mon.a (mon.0) 12502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:17 smithi179 bash[23186]: audit 2024-09-21T04:15:16.873539+0000 mon.a (mon.0) 12503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:17 smithi179 bash[23186]: audit 2024-09-21T04:15:16.885136+0000 mon.a (mon.0) 12504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:17 smithi179 bash[23186]: audit 2024-09-21T04:15:17.358102+0000 mon.a (mon.0) 12505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:17 smithi179 bash[23186]: audit 2024-09-21T04:15:17.367395+0000 mon.a (mon.0) 12506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:17 smithi179 bash[23186]: audit 2024-09-21T04:15:17.378129+0000 mon.a (mon.0) 12507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:17 smithi049 bash[23528]: audit 2024-09-21T04:15:16.864288+0000 mon.a (mon.0) 12502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:17 smithi049 bash[23528]: audit 2024-09-21T04:15:16.873539+0000 mon.a (mon.0) 12503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:17 smithi049 bash[23528]: audit 2024-09-21T04:15:16.885136+0000 mon.a (mon.0) 12504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:17 smithi049 bash[23528]: audit 2024-09-21T04:15:17.358102+0000 mon.a (mon.0) 12505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:17 smithi049 bash[23528]: audit 2024-09-21T04:15:17.367395+0000 mon.a (mon.0) 12506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:17 smithi049 bash[23528]: audit 2024-09-21T04:15:17.378129+0000 mon.a (mon.0) 12507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:18 smithi044 bash[22676]: audit 2024-09-21T04:15:17.441406+0000 mgr.a (mgr.14388) 15618 : audit [DBG] from='client.337767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:18 smithi044 bash[22676]: cluster 2024-09-21T04:15:17.736289+0000 mgr.a (mgr.14388) 15619 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:18 smithi179 bash[23186]: audit 2024-09-21T04:15:17.441406+0000 mgr.a (mgr.14388) 15618 : audit [DBG] from='client.337767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:18 smithi179 bash[23186]: cluster 2024-09-21T04:15:17.736289+0000 mgr.a (mgr.14388) 15619 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:18 smithi049 bash[23528]: audit 2024-09-21T04:15:17.441406+0000 mgr.a (mgr.14388) 15618 : audit [DBG] from='client.337767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:18 smithi049 bash[23528]: cluster 2024-09-21T04:15:17.736289+0000 mgr.a (mgr.14388) 15619 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:20 smithi044 bash[22676]: cluster 2024-09-21T04:15:19.737198+0000 mgr.a (mgr.14388) 15620 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:20 smithi179 bash[23186]: cluster 2024-09-21T04:15:19.737198+0000 mgr.a (mgr.14388) 15620 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:21.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:20 smithi049 bash[23528]: cluster 2024-09-21T04:15:19.737198+0000 mgr.a (mgr.14388) 15620 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:22 smithi044 bash[22676]: cluster 2024-09-21T04:15:21.739480+0000 mgr.a (mgr.14388) 15621 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:22 smithi179 bash[23186]: cluster 2024-09-21T04:15:21.739480+0000 mgr.a (mgr.14388) 15621 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:22 smithi049 bash[23528]: cluster 2024-09-21T04:15:21.739480+0000 mgr.a (mgr.14388) 15621 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:23.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:23.686 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:23.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:23.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:23.687 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:24 smithi044 bash[22676]: audit 2024-09-21T04:15:23.231012+0000 mgr.a (mgr.14388) 15622 : audit [DBG] from='client.337845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:24 smithi044 bash[22676]: cluster 2024-09-21T04:15:23.740504+0000 mgr.a (mgr.14388) 15623 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:24 smithi179 bash[23186]: audit 2024-09-21T04:15:23.231012+0000 mgr.a (mgr.14388) 15622 : audit [DBG] from='client.337845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:24 smithi179 bash[23186]: cluster 2024-09-21T04:15:23.740504+0000 mgr.a (mgr.14388) 15623 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:24 smithi049 bash[23528]: audit 2024-09-21T04:15:23.231012+0000 mgr.a (mgr.14388) 15622 : audit [DBG] from='client.337845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:24 smithi049 bash[23528]: cluster 2024-09-21T04:15:23.740504+0000 mgr.a (mgr.14388) 15623 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:26 smithi044 bash[22676]: cluster 2024-09-21T04:15:25.742741+0000 mgr.a (mgr.14388) 15624 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:26 smithi044 bash[22676]: audit 2024-09-21T04:15:26.264595+0000 mon.a (mon.0) 12508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:26 smithi044 bash[22676]: audit 2024-09-21T04:15:26.274396+0000 mon.a (mon.0) 12509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:26 smithi044 bash[22676]: audit 2024-09-21T04:15:26.284834+0000 mon.a (mon.0) 12510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:26 smithi179 bash[23186]: cluster 2024-09-21T04:15:25.742741+0000 mgr.a (mgr.14388) 15624 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:26 smithi179 bash[23186]: audit 2024-09-21T04:15:26.264595+0000 mon.a (mon.0) 12508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:26 smithi179 bash[23186]: audit 2024-09-21T04:15:26.274396+0000 mon.a (mon.0) 12509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:26 smithi179 bash[23186]: audit 2024-09-21T04:15:26.284834+0000 mon.a (mon.0) 12510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:26 smithi049 bash[23528]: cluster 2024-09-21T04:15:25.742741+0000 mgr.a (mgr.14388) 15624 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:26 smithi049 bash[23528]: audit 2024-09-21T04:15:26.264595+0000 mon.a (mon.0) 12508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:26 smithi049 bash[23528]: audit 2024-09-21T04:15:26.274396+0000 mon.a (mon.0) 12509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:26 smithi049 bash[23528]: audit 2024-09-21T04:15:26.284834+0000 mon.a (mon.0) 12510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:29.220 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:28 smithi179 bash[23186]: cluster 2024-09-21T04:15:27.743509+0000 mgr.a (mgr.14388) 15625 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:28 smithi044 bash[22676]: cluster 2024-09-21T04:15:27.743509+0000 mgr.a (mgr.14388) 15625 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:28 smithi049 bash[23528]: cluster 2024-09-21T04:15:27.743509+0000 mgr.a (mgr.14388) 15625 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:29.462 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:29.462 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:29.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:29.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:29.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:31.169 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:30 smithi044 bash[22676]: audit 2024-09-21T04:15:29.021524+0000 mgr.a (mgr.14388) 15626 : audit [DBG] from='client.337923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:31.169 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:30 smithi044 bash[22676]: cluster 2024-09-21T04:15:29.744498+0000 mgr.a (mgr.14388) 15627 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:30 smithi179 bash[23186]: audit 2024-09-21T04:15:29.021524+0000 mgr.a (mgr.14388) 15626 : audit [DBG] from='client.337923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:30 smithi179 bash[23186]: cluster 2024-09-21T04:15:29.744498+0000 mgr.a (mgr.14388) 15627 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:30 smithi049 bash[23528]: audit 2024-09-21T04:15:29.021524+0000 mgr.a (mgr.14388) 15626 : audit [DBG] from='client.337923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:30 smithi049 bash[23528]: cluster 2024-09-21T04:15:29.744498+0000 mgr.a (mgr.14388) 15627 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:32 smithi044 bash[22676]: cluster 2024-09-21T04:15:31.745795+0000 mgr.a (mgr.14388) 15628 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:32 smithi179 bash[23186]: cluster 2024-09-21T04:15:31.745795+0000 mgr.a (mgr.14388) 15628 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:32 smithi049 bash[23528]: cluster 2024-09-21T04:15:31.745795+0000 mgr.a (mgr.14388) 15628 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:15:34.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:34.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:34.464 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:35.229 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:35.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:34 smithi044 bash[22676]: cluster 2024-09-21T04:15:33.746566+0000 mgr.a (mgr.14388) 15629 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:34 smithi179 bash[23186]: cluster 2024-09-21T04:15:33.746566+0000 mgr.a (mgr.14388) 15629 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:35.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:34 smithi049 bash[23528]: cluster 2024-09-21T04:15:33.746566+0000 mgr.a (mgr.14388) 15629 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:35 smithi044 bash[22676]: audit 2024-09-21T04:15:34.790525+0000 mgr.a (mgr.14388) 15630 : audit [DBG] from='client.337998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:35 smithi179 bash[23186]: audit 2024-09-21T04:15:34.790525+0000 mgr.a (mgr.14388) 15630 : audit [DBG] from='client.337998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:36.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:35 smithi049 bash[23528]: audit 2024-09-21T04:15:34.790525+0000 mgr.a (mgr.14388) 15630 : audit [DBG] from='client.337998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:36 smithi044 bash[22676]: cluster 2024-09-21T04:15:35.749056+0000 mgr.a (mgr.14388) 15631 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:36 smithi179 bash[23186]: cluster 2024-09-21T04:15:35.749056+0000 mgr.a (mgr.14388) 15631 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:37.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:36 smithi049 bash[23528]: cluster 2024-09-21T04:15:35.749056+0000 mgr.a (mgr.14388) 15631 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:38.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:38 smithi049 bash[23528]: audit 2024-09-21T04:15:37.077369+0000 mon.a (mon.0) 12511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:38 smithi049 bash[23528]: audit 2024-09-21T04:15:37.085518+0000 mon.a (mon.0) 12512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:38 smithi049 bash[23528]: audit 2024-09-21T04:15:37.094289+0000 mon.a (mon.0) 12513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:38 smithi049 bash[23528]: audit 2024-09-21T04:15:37.588377+0000 mon.a (mon.0) 12514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:38 smithi049 bash[23528]: audit 2024-09-21T04:15:37.596830+0000 mon.a (mon.0) 12515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:38 smithi049 bash[23528]: audit 2024-09-21T04:15:37.606936+0000 mon.a (mon.0) 12516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.247 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:38 smithi049 bash[23528]: cluster 2024-09-21T04:15:37.749835+0000 mgr.a (mgr.14388) 15632 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:38 smithi044 bash[22676]: audit 2024-09-21T04:15:37.077369+0000 mon.a (mon.0) 12511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:38 smithi044 bash[22676]: audit 2024-09-21T04:15:37.085518+0000 mon.a (mon.0) 12512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:38 smithi044 bash[22676]: audit 2024-09-21T04:15:37.094289+0000 mon.a (mon.0) 12513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:38 smithi044 bash[22676]: audit 2024-09-21T04:15:37.588377+0000 mon.a (mon.0) 12514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:38 smithi044 bash[22676]: audit 2024-09-21T04:15:37.596830+0000 mon.a (mon.0) 12515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:38 smithi044 bash[22676]: audit 2024-09-21T04:15:37.606936+0000 mon.a (mon.0) 12516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:38 smithi044 bash[22676]: cluster 2024-09-21T04:15:37.749835+0000 mgr.a (mgr.14388) 15632 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:38 smithi179 bash[23186]: audit 2024-09-21T04:15:37.077369+0000 mon.a (mon.0) 12511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:38 smithi179 bash[23186]: audit 2024-09-21T04:15:37.085518+0000 mon.a (mon.0) 12512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:38 smithi179 bash[23186]: audit 2024-09-21T04:15:37.094289+0000 mon.a (mon.0) 12513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:38 smithi179 bash[23186]: audit 2024-09-21T04:15:37.588377+0000 mon.a (mon.0) 12514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:38 smithi179 bash[23186]: audit 2024-09-21T04:15:37.596830+0000 mon.a (mon.0) 12515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:38 smithi179 bash[23186]: audit 2024-09-21T04:15:37.606936+0000 mon.a (mon.0) 12516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:38 smithi179 bash[23186]: cluster 2024-09-21T04:15:37.749835+0000 mgr.a (mgr.14388) 15632 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:40.231 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:40.231 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:41.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:40 smithi049 bash[23528]: cluster 2024-09-21T04:15:39.750611+0000 mgr.a (mgr.14388) 15633 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:15:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:40 smithi044 bash[22676]: cluster 2024-09-21T04:15:39.750611+0000 mgr.a (mgr.14388) 15633 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:15:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:40 smithi179 bash[23186]: cluster 2024-09-21T04:15:39.750611+0000 mgr.a (mgr.14388) 15633 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:15:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:41 smithi044 bash[22676]: audit 2024-09-21T04:15:40.575148+0000 mgr.a (mgr.14388) 15634 : audit [DBG] from='client.338073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:41 smithi179 bash[23186]: audit 2024-09-21T04:15:40.575148+0000 mgr.a (mgr.14388) 15634 : audit [DBG] from='client.338073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:42.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:41 smithi049 bash[23528]: audit 2024-09-21T04:15:40.575148+0000 mgr.a (mgr.14388) 15634 : audit [DBG] from='client.338073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:42 smithi044 bash[22676]: cluster 2024-09-21T04:15:41.753557+0000 mgr.a (mgr.14388) 15635 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:42 smithi179 bash[23186]: cluster 2024-09-21T04:15:41.753557+0000 mgr.a (mgr.14388) 15635 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:42 smithi049 bash[23528]: cluster 2024-09-21T04:15:41.753557+0000 mgr.a (mgr.14388) 15635 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:42.926261+0000 mon.a (mon.0) 12517 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.537367+0000 mon.a (mon.0) 12518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.541742+0000 mon.a (mon.0) 12519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.546305+0000 mon.a (mon.0) 12520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.550845+0000 mon.a (mon.0) 12521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.551928+0000 mon.a (mon.0) 12522 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.552718+0000 mon.a (mon.0) 12523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.558301+0000 mon.a (mon.0) 12524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:43 smithi044 bash[22676]: audit 2024-09-21T04:15:43.561471+0000 mon.a (mon.0) 12525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:15:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:42.926261+0000 mon.a (mon.0) 12517 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:15:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.537367+0000 mon.a (mon.0) 12518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.541742+0000 mon.a (mon.0) 12519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.546305+0000 mon.a (mon.0) 12520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.550845+0000 mon.a (mon.0) 12521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.551928+0000 mon.a (mon.0) 12522 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:15:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.552718+0000 mon.a (mon.0) 12523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:15:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.558301+0000 mon.a (mon.0) 12524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:43 smithi179 bash[23186]: audit 2024-09-21T04:15:43.561471+0000 mon.a (mon.0) 12525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:42.926261+0000 mon.a (mon.0) 12517 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.537367+0000 mon.a (mon.0) 12518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.541742+0000 mon.a (mon.0) 12519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.546305+0000 mon.a (mon.0) 12520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.550845+0000 mon.a (mon.0) 12521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.551928+0000 mon.a (mon.0) 12522 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.552718+0000 mon.a (mon.0) 12523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.558301+0000 mon.a (mon.0) 12524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:43 smithi049 bash[23528]: audit 2024-09-21T04:15:43.561471+0000 mon.a (mon.0) 12525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:15:44.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:15:44 smithi044 bash[22930]: debug 2024-09-21T04:15:44.311+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:15:44.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:15:44 smithi044 bash[22930]: debug 2024-09-21T04:15:44.311+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:15:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:44 smithi044 bash[22676]: audit 2024-09-21T04:15:43.562684+0000 mgr.a (mgr.14388) 15636 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:15:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:44 smithi044 bash[22676]: cluster 2024-09-21T04:15:43.754086+0000 mgr.a (mgr.14388) 15637 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:44 smithi179 bash[23186]: audit 2024-09-21T04:15:43.562684+0000 mgr.a (mgr.14388) 15636 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:15:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:44 smithi179 bash[23186]: cluster 2024-09-21T04:15:43.754086+0000 mgr.a (mgr.14388) 15637 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:44 smithi049 bash[23528]: audit 2024-09-21T04:15:43.562684+0000 mgr.a (mgr.14388) 15636 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:15:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:44 smithi049 bash[23528]: cluster 2024-09-21T04:15:43.754086+0000 mgr.a (mgr.14388) 15637 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:15:46.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:46.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:45 smithi049 bash[23528]: audit 2024-09-21T04:15:44.315586+0000 mgr.a (mgr.14388) 15638 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:15:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:45 smithi049 bash[23528]: cephadm 2024-09-21T04:15:44.316844+0000 mgr.a (mgr.14388) 15639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:15:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:45 smithi044 bash[22676]: audit 2024-09-21T04:15:44.315586+0000 mgr.a (mgr.14388) 15638 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:15:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:45 smithi044 bash[22676]: cephadm 2024-09-21T04:15:44.316844+0000 mgr.a (mgr.14388) 15639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:15:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:45 smithi179 bash[23186]: audit 2024-09-21T04:15:44.315586+0000 mgr.a (mgr.14388) 15638 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:15:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:45 smithi179 bash[23186]: cephadm 2024-09-21T04:15:44.316844+0000 mgr.a (mgr.14388) 15639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:15:46.805 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:46.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:46.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:46.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:46.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:47.210 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:46 smithi179 bash[23186]: cluster 2024-09-21T04:15:45.756485+0000 mgr.a (mgr.14388) 15640 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:47.210 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:46 smithi179 bash[23186]: audit 2024-09-21T04:15:46.461733+0000 mon.a (mon.0) 12526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.210 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:46 smithi179 bash[23186]: audit 2024-09-21T04:15:46.467724+0000 mon.a (mon.0) 12527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.210 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:46 smithi179 bash[23186]: audit 2024-09-21T04:15:46.474669+0000 mon.a (mon.0) 12528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:46 smithi044 bash[22676]: cluster 2024-09-21T04:15:45.756485+0000 mgr.a (mgr.14388) 15640 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:46 smithi044 bash[22676]: audit 2024-09-21T04:15:46.461733+0000 mon.a (mon.0) 12526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:46 smithi044 bash[22676]: audit 2024-09-21T04:15:46.467724+0000 mon.a (mon.0) 12527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:46 smithi044 bash[22676]: audit 2024-09-21T04:15:46.474669+0000 mon.a (mon.0) 12528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:46 smithi049 bash[23528]: cluster 2024-09-21T04:15:45.756485+0000 mgr.a (mgr.14388) 15640 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:46 smithi049 bash[23528]: audit 2024-09-21T04:15:46.461733+0000 mon.a (mon.0) 12526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:46 smithi049 bash[23528]: audit 2024-09-21T04:15:46.467724+0000 mon.a (mon.0) 12527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:46 smithi049 bash[23528]: audit 2024-09-21T04:15:46.474669+0000 mon.a (mon.0) 12528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:47 smithi044 bash[22676]: audit 2024-09-21T04:15:46.358143+0000 mgr.a (mgr.14388) 15641 : audit [DBG] from='client.338256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:47 smithi179 bash[23186]: audit 2024-09-21T04:15:46.358143+0000 mgr.a (mgr.14388) 15641 : audit [DBG] from='client.338256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:47 smithi049 bash[23528]: audit 2024-09-21T04:15:46.358143+0000 mgr.a (mgr.14388) 15641 : audit [DBG] from='client.338256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:48 smithi044 bash[22676]: cluster 2024-09-21T04:15:47.757472+0000 mgr.a (mgr.14388) 15642 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:48 smithi179 bash[23186]: cluster 2024-09-21T04:15:47.757472+0000 mgr.a (mgr.14388) 15642 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:48 smithi049 bash[23528]: cluster 2024-09-21T04:15:47.757472+0000 mgr.a (mgr.14388) 15642 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:51.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:50 smithi044 bash[22676]: cluster 2024-09-21T04:15:49.758352+0000 mgr.a (mgr.14388) 15643 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:50 smithi179 bash[23186]: cluster 2024-09-21T04:15:49.758352+0000 mgr.a (mgr.14388) 15643 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:50 smithi049 bash[23528]: cluster 2024-09-21T04:15:49.758352+0000 mgr.a (mgr.14388) 15643 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:15:51.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:51.807 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:52.570 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:52.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:52.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:52.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:52.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:52 smithi044 bash[22676]: cluster 2024-09-21T04:15:51.759667+0000 mgr.a (mgr.14388) 15644 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 34 op/s 2024-09-21T04:15:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:52 smithi179 bash[23186]: cluster 2024-09-21T04:15:51.759667+0000 mgr.a (mgr.14388) 15644 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 34 op/s 2024-09-21T04:15:53.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:52 smithi049 bash[23528]: cluster 2024-09-21T04:15:51.759667+0000 mgr.a (mgr.14388) 15644 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 34 op/s 2024-09-21T04:15:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:53 smithi044 bash[22676]: audit 2024-09-21T04:15:52.143625+0000 mgr.a (mgr.14388) 15645 : audit [DBG] from='client.338334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:53 smithi179 bash[23186]: audit 2024-09-21T04:15:52.143625+0000 mgr.a (mgr.14388) 15645 : audit [DBG] from='client.338334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:54.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:53 smithi049 bash[23528]: audit 2024-09-21T04:15:52.143625+0000 mgr.a (mgr.14388) 15645 : audit [DBG] from='client.338334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:55.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:54 smithi044 bash[22676]: cluster 2024-09-21T04:15:53.760269+0000 mgr.a (mgr.14388) 15646 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T04:15:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:54 smithi179 bash[23186]: cluster 2024-09-21T04:15:53.760269+0000 mgr.a (mgr.14388) 15646 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T04:15:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:54 smithi049 bash[23528]: cluster 2024-09-21T04:15:53.760269+0000 mgr.a (mgr.14388) 15646 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T04:15:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:56 smithi044 bash[22676]: cluster 2024-09-21T04:15:55.762511+0000 mgr.a (mgr.14388) 15647 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T04:15:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:56 smithi179 bash[23186]: cluster 2024-09-21T04:15:55.762511+0000 mgr.a (mgr.14388) 15647 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T04:15:57.280 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:56 smithi049 bash[23528]: cluster 2024-09-21T04:15:55.762511+0000 mgr.a (mgr.14388) 15647 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-21T04:15:57.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:15:57.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:15:57.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:15:58.380 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:15:58.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:15:58.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:15:58.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:15:58.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:15:58.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: audit 2024-09-21T04:15:57.265538+0000 mon.a (mon.0) 12529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: audit 2024-09-21T04:15:57.273494+0000 mon.a (mon.0) 12530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: audit 2024-09-21T04:15:57.281932+0000 mon.a (mon.0) 12531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: cluster 2024-09-21T04:15:57.762972+0000 mgr.a (mgr.14388) 15648 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T04:15:58.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: audit 2024-09-21T04:15:57.813013+0000 mon.a (mon.0) 12532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: audit 2024-09-21T04:15:57.821112+0000 mon.a (mon.0) 12533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.526 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: audit 2024-09-21T04:15:57.830999+0000 mon.a (mon.0) 12534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.527 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:15:58 smithi049 bash[23528]: audit 2024-09-21T04:15:57.918346+0000 mgr.a (mgr.14388) 15649 : audit [DBG] from='client.338406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: audit 2024-09-21T04:15:57.265538+0000 mon.a (mon.0) 12529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: audit 2024-09-21T04:15:57.273494+0000 mon.a (mon.0) 12530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: audit 2024-09-21T04:15:57.281932+0000 mon.a (mon.0) 12531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: cluster 2024-09-21T04:15:57.762972+0000 mgr.a (mgr.14388) 15648 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T04:15:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: audit 2024-09-21T04:15:57.813013+0000 mon.a (mon.0) 12532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: audit 2024-09-21T04:15:57.821112+0000 mon.a (mon.0) 12533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: audit 2024-09-21T04:15:57.830999+0000 mon.a (mon.0) 12534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:15:58 smithi044 bash[22676]: audit 2024-09-21T04:15:57.918346+0000 mgr.a (mgr.14388) 15649 : audit [DBG] from='client.338406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:15:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: audit 2024-09-21T04:15:57.265538+0000 mon.a (mon.0) 12529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: audit 2024-09-21T04:15:57.273494+0000 mon.a (mon.0) 12530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: audit 2024-09-21T04:15:57.281932+0000 mon.a (mon.0) 12531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: cluster 2024-09-21T04:15:57.762972+0000 mgr.a (mgr.14388) 15648 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T04:15:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: audit 2024-09-21T04:15:57.813013+0000 mon.a (mon.0) 12532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: audit 2024-09-21T04:15:57.821112+0000 mon.a (mon.0) 12533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: audit 2024-09-21T04:15:57.830999+0000 mon.a (mon.0) 12534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:15:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:15:58 smithi179 bash[23186]: audit 2024-09-21T04:15:57.918346+0000 mgr.a (mgr.14388) 15649 : audit [DBG] from='client.338406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:00 smithi044 bash[22676]: cluster 2024-09-21T04:15:59.763867+0000 mgr.a (mgr.14388) 15650 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T04:16:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:00 smithi179 bash[23186]: cluster 2024-09-21T04:15:59.763867+0000 mgr.a (mgr.14388) 15650 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T04:16:01.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:00 smithi049 bash[23528]: cluster 2024-09-21T04:15:59.763867+0000 mgr.a (mgr.14388) 15650 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T04:16:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:02 smithi044 bash[22676]: cluster 2024-09-21T04:16:01.766184+0000 mgr.a (mgr.14388) 15651 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T04:16:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:02 smithi179 bash[23186]: cluster 2024-09-21T04:16:01.766184+0000 mgr.a (mgr.14388) 15651 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T04:16:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:02 smithi049 bash[23528]: cluster 2024-09-21T04:16:01.766184+0000 mgr.a (mgr.14388) 15651 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-21T04:16:03.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:04.146 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:04 smithi044 bash[22676]: audit 2024-09-21T04:16:03.712273+0000 mgr.a (mgr.14388) 15652 : audit [DBG] from='client.338475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:04 smithi044 bash[22676]: cluster 2024-09-21T04:16:03.767240+0000 mgr.a (mgr.14388) 15653 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:16:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:04 smithi179 bash[23186]: audit 2024-09-21T04:16:03.712273+0000 mgr.a (mgr.14388) 15652 : audit [DBG] from='client.338475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:04 smithi179 bash[23186]: cluster 2024-09-21T04:16:03.767240+0000 mgr.a (mgr.14388) 15653 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:16:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:04 smithi049 bash[23528]: audit 2024-09-21T04:16:03.712273+0000 mgr.a (mgr.14388) 15652 : audit [DBG] from='client.338475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:04 smithi049 bash[23528]: cluster 2024-09-21T04:16:03.767240+0000 mgr.a (mgr.14388) 15653 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:16:07.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:06 smithi049 bash[23528]: cluster 2024-09-21T04:16:05.769648+0000 mgr.a (mgr.14388) 15654 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:16:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:06 smithi049 bash[23528]: audit 2024-09-21T04:16:06.687864+0000 mon.a (mon.0) 12535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:06 smithi049 bash[23528]: audit 2024-09-21T04:16:06.696876+0000 mon.a (mon.0) 12536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:06 smithi049 bash[23528]: audit 2024-09-21T04:16:06.707789+0000 mon.a (mon.0) 12537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:06 smithi044 bash[22676]: cluster 2024-09-21T04:16:05.769648+0000 mgr.a (mgr.14388) 15654 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:16:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:06 smithi044 bash[22676]: audit 2024-09-21T04:16:06.687864+0000 mon.a (mon.0) 12535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:06 smithi044 bash[22676]: audit 2024-09-21T04:16:06.696876+0000 mon.a (mon.0) 12536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:06 smithi044 bash[22676]: audit 2024-09-21T04:16:06.707789+0000 mon.a (mon.0) 12537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:06 smithi179 bash[23186]: cluster 2024-09-21T04:16:05.769648+0000 mgr.a (mgr.14388) 15654 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:16:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:06 smithi179 bash[23186]: audit 2024-09-21T04:16:06.687864+0000 mon.a (mon.0) 12535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:06 smithi179 bash[23186]: audit 2024-09-21T04:16:06.696876+0000 mon.a (mon.0) 12536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:06 smithi179 bash[23186]: audit 2024-09-21T04:16:06.707789+0000 mon.a (mon.0) 12537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:08 smithi179 bash[23186]: cluster 2024-09-21T04:16:07.770438+0000 mgr.a (mgr.14388) 15655 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:09.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:09.148 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:08 smithi044 bash[22676]: cluster 2024-09-21T04:16:07.770438+0000 mgr.a (mgr.14388) 15655 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:08 smithi049 bash[23528]: cluster 2024-09-21T04:16:07.770438+0000 mgr.a (mgr.14388) 15655 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:09.900 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:09.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:09.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:09.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:09.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:10 smithi044 bash[22676]: audit 2024-09-21T04:16:09.476796+0000 mgr.a (mgr.14388) 15656 : audit [DBG] from='client.338547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:10 smithi044 bash[22676]: cluster 2024-09-21T04:16:09.771059+0000 mgr.a (mgr.14388) 15657 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:10 smithi179 bash[23186]: audit 2024-09-21T04:16:09.476796+0000 mgr.a (mgr.14388) 15656 : audit [DBG] from='client.338547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:10 smithi179 bash[23186]: cluster 2024-09-21T04:16:09.771059+0000 mgr.a (mgr.14388) 15657 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:10 smithi049 bash[23528]: audit 2024-09-21T04:16:09.476796+0000 mgr.a (mgr.14388) 15656 : audit [DBG] from='client.338547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:10 smithi049 bash[23528]: cluster 2024-09-21T04:16:09.771059+0000 mgr.a (mgr.14388) 15657 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:12 smithi044 bash[22676]: cluster 2024-09-21T04:16:11.773234+0000 mgr.a (mgr.14388) 15658 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:12 smithi179 bash[23186]: cluster 2024-09-21T04:16:11.773234+0000 mgr.a (mgr.14388) 15658 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:12 smithi049 bash[23528]: cluster 2024-09-21T04:16:11.773234+0000 mgr.a (mgr.14388) 15658 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:14.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:14.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:14.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:14 smithi044 bash[22676]: cluster 2024-09-21T04:16:13.773925+0000 mgr.a (mgr.14388) 15659 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:14 smithi179 bash[23186]: cluster 2024-09-21T04:16:13.773925+0000 mgr.a (mgr.14388) 15659 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:14 smithi049 bash[23528]: cluster 2024-09-21T04:16:13.773925+0000 mgr.a (mgr.14388) 15659 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 136 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:15.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:15.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:15.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:15.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:15.693 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:16 smithi044 bash[22676]: audit 2024-09-21T04:16:15.239961+0000 mgr.a (mgr.14388) 15660 : audit [DBG] from='client.338625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:16 smithi044 bash[22676]: cluster 2024-09-21T04:16:15.775496+0000 mgr.a (mgr.14388) 15661 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:16 smithi179 bash[23186]: audit 2024-09-21T04:16:15.239961+0000 mgr.a (mgr.14388) 15660 : audit [DBG] from='client.338625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:16 smithi179 bash[23186]: cluster 2024-09-21T04:16:15.775496+0000 mgr.a (mgr.14388) 15661 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:16 smithi049 bash[23528]: audit 2024-09-21T04:16:15.239961+0000 mgr.a (mgr.14388) 15660 : audit [DBG] from='client.338625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:16 smithi049 bash[23528]: cluster 2024-09-21T04:16:15.775496+0000 mgr.a (mgr.14388) 15661 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:18 smithi179 bash[23186]: audit 2024-09-21T04:16:17.500604+0000 mon.a (mon.0) 12538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:18 smithi179 bash[23186]: audit 2024-09-21T04:16:17.509579+0000 mon.a (mon.0) 12539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:18 smithi179 bash[23186]: audit 2024-09-21T04:16:17.521332+0000 mon.a (mon.0) 12540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:18 smithi179 bash[23186]: cluster 2024-09-21T04:16:17.776249+0000 mgr.a (mgr.14388) 15662 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:18 smithi179 bash[23186]: audit 2024-09-21T04:16:18.025497+0000 mon.a (mon.0) 12541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:18 smithi179 bash[23186]: audit 2024-09-21T04:16:18.034924+0000 mon.a (mon.0) 12542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:18 smithi179 bash[23186]: audit 2024-09-21T04:16:18.045230+0000 mon.a (mon.0) 12543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.761 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:18 smithi049 bash[23528]: audit 2024-09-21T04:16:17.500604+0000 mon.a (mon.0) 12538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:18 smithi049 bash[23528]: audit 2024-09-21T04:16:17.509579+0000 mon.a (mon.0) 12539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:18 smithi049 bash[23528]: audit 2024-09-21T04:16:17.521332+0000 mon.a (mon.0) 12540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:18 smithi049 bash[23528]: cluster 2024-09-21T04:16:17.776249+0000 mgr.a (mgr.14388) 15662 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:18.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:18 smithi049 bash[23528]: audit 2024-09-21T04:16:18.025497+0000 mon.a (mon.0) 12541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:18 smithi049 bash[23528]: audit 2024-09-21T04:16:18.034924+0000 mon.a (mon.0) 12542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.762 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:18 smithi049 bash[23528]: audit 2024-09-21T04:16:18.045230+0000 mon.a (mon.0) 12543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:18 smithi044 bash[22676]: audit 2024-09-21T04:16:17.500604+0000 mon.a (mon.0) 12538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:18 smithi044 bash[22676]: audit 2024-09-21T04:16:17.509579+0000 mon.a (mon.0) 12539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:18 smithi044 bash[22676]: audit 2024-09-21T04:16:17.521332+0000 mon.a (mon.0) 12540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:18 smithi044 bash[22676]: cluster 2024-09-21T04:16:17.776249+0000 mgr.a (mgr.14388) 15662 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:18 smithi044 bash[22676]: audit 2024-09-21T04:16:18.025497+0000 mon.a (mon.0) 12541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:18 smithi044 bash[22676]: audit 2024-09-21T04:16:18.034924+0000 mon.a (mon.0) 12542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:18 smithi044 bash[22676]: audit 2024-09-21T04:16:18.045230+0000 mon.a (mon.0) 12543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:20.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:20.692 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:21.208 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:20 smithi049 bash[23528]: cluster 2024-09-21T04:16:19.777046+0000 mgr.a (mgr.14388) 15663 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:20 smithi044 bash[22676]: cluster 2024-09-21T04:16:19.777046+0000 mgr.a (mgr.14388) 15663 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:20 smithi179 bash[23186]: cluster 2024-09-21T04:16:19.777046+0000 mgr.a (mgr.14388) 15663 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:21.475 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:21.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:22 smithi044 bash[22676]: audit 2024-09-21T04:16:21.026263+0000 mgr.a (mgr.14388) 15664 : audit [DBG] from='client.338700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:22 smithi044 bash[22676]: cluster 2024-09-21T04:16:21.780000+0000 mgr.a (mgr.14388) 15665 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:22 smithi179 bash[23186]: audit 2024-09-21T04:16:21.026263+0000 mgr.a (mgr.14388) 15664 : audit [DBG] from='client.338700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:22 smithi179 bash[23186]: cluster 2024-09-21T04:16:21.780000+0000 mgr.a (mgr.14388) 15665 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:22 smithi049 bash[23528]: audit 2024-09-21T04:16:21.026263+0000 mgr.a (mgr.14388) 15664 : audit [DBG] from='client.338700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:22 smithi049 bash[23528]: cluster 2024-09-21T04:16:21.780000+0000 mgr.a (mgr.14388) 15665 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:24 smithi044 bash[22676]: cluster 2024-09-21T04:16:23.780790+0000 mgr.a (mgr.14388) 15666 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:24 smithi179 bash[23186]: cluster 2024-09-21T04:16:23.780790+0000 mgr.a (mgr.14388) 15666 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:24 smithi049 bash[23528]: cluster 2024-09-21T04:16:23.780790+0000 mgr.a (mgr.14388) 15666 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:16:26.477 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:26.478 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:26.478 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:27.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:27.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:27.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:27.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:27.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:26 smithi044 bash[22676]: cluster 2024-09-21T04:16:25.782866+0000 mgr.a (mgr.14388) 15667 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:26 smithi179 bash[23186]: cluster 2024-09-21T04:16:25.782866+0000 mgr.a (mgr.14388) 15667 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:27.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:26 smithi049 bash[23528]: cluster 2024-09-21T04:16:25.782866+0000 mgr.a (mgr.14388) 15667 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:16:28.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:27 smithi179 bash[23186]: audit 2024-09-21T04:16:26.810253+0000 mgr.a (mgr.14388) 15668 : audit [DBG] from='client.338778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:28.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:27 smithi179 bash[23186]: audit 2024-09-21T04:16:26.885790+0000 mon.a (mon.0) 12544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:27 smithi179 bash[23186]: audit 2024-09-21T04:16:26.891047+0000 mon.a (mon.0) 12545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:27 smithi179 bash[23186]: audit 2024-09-21T04:16:26.896920+0000 mon.a (mon.0) 12546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:27 smithi044 bash[22676]: audit 2024-09-21T04:16:26.810253+0000 mgr.a (mgr.14388) 15668 : audit [DBG] from='client.338778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:27 smithi044 bash[22676]: audit 2024-09-21T04:16:26.885790+0000 mon.a (mon.0) 12544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:27 smithi044 bash[22676]: audit 2024-09-21T04:16:26.891047+0000 mon.a (mon.0) 12545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:27 smithi044 bash[22676]: audit 2024-09-21T04:16:26.896920+0000 mon.a (mon.0) 12546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:27 smithi049 bash[23528]: audit 2024-09-21T04:16:26.810253+0000 mgr.a (mgr.14388) 15668 : audit [DBG] from='client.338778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:27 smithi049 bash[23528]: audit 2024-09-21T04:16:26.885790+0000 mon.a (mon.0) 12544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:27 smithi049 bash[23528]: audit 2024-09-21T04:16:26.891047+0000 mon.a (mon.0) 12545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:27 smithi049 bash[23528]: audit 2024-09-21T04:16:26.896920+0000 mon.a (mon.0) 12546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:28 smithi044 bash[22676]: cluster 2024-09-21T04:16:27.783778+0000 mgr.a (mgr.14388) 15669 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:28 smithi179 bash[23186]: cluster 2024-09-21T04:16:27.783778+0000 mgr.a (mgr.14388) 15669 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:29.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:28 smithi049 bash[23528]: cluster 2024-09-21T04:16:27.783778+0000 mgr.a (mgr.14388) 15669 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:30 smithi179 bash[23186]: cluster 2024-09-21T04:16:29.784539+0000 mgr.a (mgr.14388) 15670 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:30 smithi044 bash[22676]: cluster 2024-09-21T04:16:29.784539+0000 mgr.a (mgr.14388) 15670 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:30 smithi049 bash[23528]: cluster 2024-09-21T04:16:29.784539+0000 mgr.a (mgr.14388) 15670 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:32.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:33.012 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:33.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:33.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:33.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:33.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:32 smithi044 bash[22676]: cluster 2024-09-21T04:16:31.785782+0000 mgr.a (mgr.14388) 15671 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:32 smithi179 bash[23186]: cluster 2024-09-21T04:16:31.785782+0000 mgr.a (mgr.14388) 15671 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:32 smithi049 bash[23528]: cluster 2024-09-21T04:16:31.785782+0000 mgr.a (mgr.14388) 15671 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:33 smithi044 bash[22676]: audit 2024-09-21T04:16:32.577899+0000 mgr.a (mgr.14388) 15672 : audit [DBG] from='client.338856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:33 smithi179 bash[23186]: audit 2024-09-21T04:16:32.577899+0000 mgr.a (mgr.14388) 15672 : audit [DBG] from='client.338856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:33 smithi049 bash[23528]: audit 2024-09-21T04:16:32.577899+0000 mgr.a (mgr.14388) 15672 : audit [DBG] from='client.338856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:34 smithi044 bash[22676]: cluster 2024-09-21T04:16:33.786526+0000 mgr.a (mgr.14388) 15673 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:34 smithi179 bash[23186]: cluster 2024-09-21T04:16:33.786526+0000 mgr.a (mgr.14388) 15673 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:34 smithi049 bash[23528]: cluster 2024-09-21T04:16:33.786526+0000 mgr.a (mgr.14388) 15673 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:36 smithi044 bash[22676]: cluster 2024-09-21T04:16:35.788744+0000 mgr.a (mgr.14388) 15674 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:36 smithi179 bash[23186]: cluster 2024-09-21T04:16:35.788744+0000 mgr.a (mgr.14388) 15674 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:37.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:36 smithi049 bash[23528]: cluster 2024-09-21T04:16:35.788744+0000 mgr.a (mgr.14388) 15674 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:38.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:38.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:38.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:38.801 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:38.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:38.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:38.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:38.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:38 smithi179 bash[23186]: audit 2024-09-21T04:16:37.743508+0000 mon.a (mon.0) 12547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:38 smithi179 bash[23186]: audit 2024-09-21T04:16:37.751163+0000 mon.a (mon.0) 12548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:38 smithi179 bash[23186]: audit 2024-09-21T04:16:37.762593+0000 mon.a (mon.0) 12549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:38 smithi179 bash[23186]: cluster 2024-09-21T04:16:37.789550+0000 mgr.a (mgr.14388) 15675 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:38 smithi179 bash[23186]: audit 2024-09-21T04:16:38.253094+0000 mon.a (mon.0) 12550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:38 smithi179 bash[23186]: audit 2024-09-21T04:16:38.262576+0000 mon.a (mon.0) 12551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:38 smithi179 bash[23186]: audit 2024-09-21T04:16:38.272361+0000 mon.a (mon.0) 12552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:38 smithi049 bash[23528]: audit 2024-09-21T04:16:37.743508+0000 mon.a (mon.0) 12547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:38 smithi049 bash[23528]: audit 2024-09-21T04:16:37.751163+0000 mon.a (mon.0) 12548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:38 smithi049 bash[23528]: audit 2024-09-21T04:16:37.762593+0000 mon.a (mon.0) 12549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:38 smithi049 bash[23528]: cluster 2024-09-21T04:16:37.789550+0000 mgr.a (mgr.14388) 15675 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:39.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:38 smithi049 bash[23528]: audit 2024-09-21T04:16:38.253094+0000 mon.a (mon.0) 12550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:38 smithi049 bash[23528]: audit 2024-09-21T04:16:38.262576+0000 mon.a (mon.0) 12551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:38 smithi049 bash[23528]: audit 2024-09-21T04:16:38.272361+0000 mon.a (mon.0) 12552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:38 smithi044 bash[22676]: audit 2024-09-21T04:16:37.743508+0000 mon.a (mon.0) 12547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:38 smithi044 bash[22676]: audit 2024-09-21T04:16:37.751163+0000 mon.a (mon.0) 12548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:38 smithi044 bash[22676]: audit 2024-09-21T04:16:37.762593+0000 mon.a (mon.0) 12549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:38 smithi044 bash[22676]: cluster 2024-09-21T04:16:37.789550+0000 mgr.a (mgr.14388) 15675 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:38 smithi044 bash[22676]: audit 2024-09-21T04:16:38.253094+0000 mon.a (mon.0) 12550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:38 smithi044 bash[22676]: audit 2024-09-21T04:16:38.262576+0000 mon.a (mon.0) 12551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:38 smithi044 bash[22676]: audit 2024-09-21T04:16:38.272361+0000 mon.a (mon.0) 12552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:39 smithi049 bash[23528]: audit 2024-09-21T04:16:38.351520+0000 mgr.a (mgr.14388) 15676 : audit [DBG] from='client.338931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:39 smithi044 bash[22676]: audit 2024-09-21T04:16:38.351520+0000 mgr.a (mgr.14388) 15676 : audit [DBG] from='client.338931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:39 smithi179 bash[23186]: audit 2024-09-21T04:16:38.351520+0000 mgr.a (mgr.14388) 15676 : audit [DBG] from='client.338931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:41.048 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:40 smithi049 bash[23528]: cluster 2024-09-21T04:16:39.790455+0000 mgr.a (mgr.14388) 15677 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:40 smithi044 bash[22676]: cluster 2024-09-21T04:16:39.790455+0000 mgr.a (mgr.14388) 15677 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:40 smithi179 bash[23186]: cluster 2024-09-21T04:16:39.790455+0000 mgr.a (mgr.14388) 15677 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:42 smithi044 bash[22676]: cluster 2024-09-21T04:16:41.792683+0000 mgr.a (mgr.14388) 15678 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:42 smithi179 bash[23186]: cluster 2024-09-21T04:16:41.792683+0000 mgr.a (mgr.14388) 15678 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:42 smithi049 bash[23528]: cluster 2024-09-21T04:16:41.792683+0000 mgr.a (mgr.14388) 15678 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:16:43.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:43.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:43.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:44.590 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:44.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:44.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:44.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:44.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:44 smithi044 bash[22676]: cluster 2024-09-21T04:16:43.793476+0000 mgr.a (mgr.14388) 15679 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:44 smithi044 bash[22676]: audit 2024-09-21T04:16:44.384642+0000 mon.a (mon.0) 12553 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:16:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:44 smithi179 bash[23186]: cluster 2024-09-21T04:16:43.793476+0000 mgr.a (mgr.14388) 15679 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:44 smithi179 bash[23186]: audit 2024-09-21T04:16:44.384642+0000 mon.a (mon.0) 12553 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:16:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:44 smithi049 bash[23528]: cluster 2024-09-21T04:16:43.793476+0000 mgr.a (mgr.14388) 15679 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:16:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:44 smithi049 bash[23528]: audit 2024-09-21T04:16:44.384642+0000 mon.a (mon.0) 12553 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:16:45.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22930]: debug 2024-09-21T04:16:45.698+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:16:45.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22930]: debug 2024-09-21T04:16:45.698+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:16:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.138905+0000 mgr.a (mgr.14388) 15680 : audit [DBG] from='client.339009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.912528+0000 mon.a (mon.0) 12554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.920501+0000 mon.a (mon.0) 12555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.923388+0000 mon.a (mon.0) 12556 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:16:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.925342+0000 mon.a (mon.0) 12557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:16:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.935659+0000 mon.a (mon.0) 12558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.942087+0000 mon.a (mon.0) 12559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:16:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:45 smithi044 bash[22676]: audit 2024-09-21T04:16:44.944805+0000 mgr.a (mgr.14388) 15681 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.138905+0000 mgr.a (mgr.14388) 15680 : audit [DBG] from='client.339009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.912528+0000 mon.a (mon.0) 12554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.920501+0000 mon.a (mon.0) 12555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.923388+0000 mon.a (mon.0) 12556 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.925342+0000 mon.a (mon.0) 12557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.935659+0000 mon.a (mon.0) 12558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.942087+0000 mon.a (mon.0) 12559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:16:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:45 smithi179 bash[23186]: audit 2024-09-21T04:16:44.944805+0000 mgr.a (mgr.14388) 15681 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:16:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.138905+0000 mgr.a (mgr.14388) 15680 : audit [DBG] from='client.339009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.912528+0000 mon.a (mon.0) 12554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.920501+0000 mon.a (mon.0) 12555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.923388+0000 mon.a (mon.0) 12556 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:16:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.925342+0000 mon.a (mon.0) 12557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:16:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.935659+0000 mon.a (mon.0) 12558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.942087+0000 mon.a (mon.0) 12559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:16:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:45 smithi049 bash[23528]: audit 2024-09-21T04:16:44.944805+0000 mgr.a (mgr.14388) 15681 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:16:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:46 smithi044 bash[22676]: audit 2024-09-21T04:16:45.703212+0000 mgr.a (mgr.14388) 15682 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:16:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:46 smithi044 bash[22676]: cephadm 2024-09-21T04:16:45.704487+0000 mgr.a (mgr.14388) 15683 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:16:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:46 smithi044 bash[22676]: cluster 2024-09-21T04:16:45.796215+0000 mgr.a (mgr.14388) 15684 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-09-21T04:16:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:46 smithi179 bash[23186]: audit 2024-09-21T04:16:45.703212+0000 mgr.a (mgr.14388) 15682 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:16:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:46 smithi179 bash[23186]: cephadm 2024-09-21T04:16:45.704487+0000 mgr.a (mgr.14388) 15683 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:16:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:46 smithi179 bash[23186]: cluster 2024-09-21T04:16:45.796215+0000 mgr.a (mgr.14388) 15684 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-09-21T04:16:47.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:46 smithi049 bash[23528]: audit 2024-09-21T04:16:45.703212+0000 mgr.a (mgr.14388) 15682 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:16:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:46 smithi049 bash[23528]: cephadm 2024-09-21T04:16:45.704487+0000 mgr.a (mgr.14388) 15683 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:16:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:46 smithi049 bash[23528]: cluster 2024-09-21T04:16:45.796215+0000 mgr.a (mgr.14388) 15684 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-09-21T04:16:48.439 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:48 smithi179 bash[23186]: audit 2024-09-21T04:16:47.109302+0000 mon.a (mon.0) 12560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.439 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:48 smithi179 bash[23186]: audit 2024-09-21T04:16:47.117764+0000 mon.a (mon.0) 12561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.439 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:48 smithi179 bash[23186]: audit 2024-09-21T04:16:47.128304+0000 mon.a (mon.0) 12562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.440 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:48 smithi179 bash[23186]: cluster 2024-09-21T04:16:47.797034+0000 mgr.a (mgr.14388) 15685 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:16:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:48 smithi044 bash[22676]: audit 2024-09-21T04:16:47.109302+0000 mon.a (mon.0) 12560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:48 smithi044 bash[22676]: audit 2024-09-21T04:16:47.117764+0000 mon.a (mon.0) 12561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:48 smithi044 bash[22676]: audit 2024-09-21T04:16:47.128304+0000 mon.a (mon.0) 12562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:48 smithi044 bash[22676]: cluster 2024-09-21T04:16:47.797034+0000 mgr.a (mgr.14388) 15685 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:16:48.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:48 smithi049 bash[23528]: audit 2024-09-21T04:16:47.109302+0000 mon.a (mon.0) 12560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:48 smithi049 bash[23528]: audit 2024-09-21T04:16:47.117764+0000 mon.a (mon.0) 12561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:48 smithi049 bash[23528]: audit 2024-09-21T04:16:47.128304+0000 mon.a (mon.0) 12562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:48 smithi049 bash[23528]: cluster 2024-09-21T04:16:47.797034+0000 mgr.a (mgr.14388) 15685 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:16:49.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:49.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:50.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:51.134 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:50 smithi179 bash[23186]: cluster 2024-09-21T04:16:49.797834+0000 mgr.a (mgr.14388) 15686 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:16:51.134 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:50 smithi179 bash[23186]: audit 2024-09-21T04:16:49.928773+0000 mgr.a (mgr.14388) 15687 : audit [DBG] from='client.339192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:50 smithi044 bash[22676]: cluster 2024-09-21T04:16:49.797834+0000 mgr.a (mgr.14388) 15686 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:16:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:50 smithi044 bash[22676]: audit 2024-09-21T04:16:49.928773+0000 mgr.a (mgr.14388) 15687 : audit [DBG] from='client.339192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:50 smithi049 bash[23528]: cluster 2024-09-21T04:16:49.797834+0000 mgr.a (mgr.14388) 15686 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:16:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:50 smithi049 bash[23528]: audit 2024-09-21T04:16:49.928773+0000 mgr.a (mgr.14388) 15687 : audit [DBG] from='client.339192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:52 smithi044 bash[22676]: cluster 2024-09-21T04:16:51.799376+0000 mgr.a (mgr.14388) 15688 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:16:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:52 smithi179 bash[23186]: cluster 2024-09-21T04:16:51.799376+0000 mgr.a (mgr.14388) 15688 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:16:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:52 smithi049 bash[23528]: cluster 2024-09-21T04:16:51.799376+0000 mgr.a (mgr.14388) 15688 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:16:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:54 smithi044 bash[22676]: cluster 2024-09-21T04:16:53.799903+0000 mgr.a (mgr.14388) 15689 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:16:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:54 smithi179 bash[23186]: cluster 2024-09-21T04:16:53.799903+0000 mgr.a (mgr.14388) 15689 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:16:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:54 smithi049 bash[23528]: cluster 2024-09-21T04:16:53.799903+0000 mgr.a (mgr.14388) 15689 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:16:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:16:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:16:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:16:56.170 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:16:56.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:16:56.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:16:56.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:16:56.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:16:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:56 smithi044 bash[22676]: audit 2024-09-21T04:16:55.717301+0000 mgr.a (mgr.14388) 15690 : audit [DBG] from='client.339267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:56 smithi044 bash[22676]: cluster 2024-09-21T04:16:55.801404+0000 mgr.a (mgr.14388) 15691 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:16:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:56 smithi179 bash[23186]: audit 2024-09-21T04:16:55.717301+0000 mgr.a (mgr.14388) 15690 : audit [DBG] from='client.339267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:56 smithi179 bash[23186]: cluster 2024-09-21T04:16:55.801404+0000 mgr.a (mgr.14388) 15691 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:16:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:56 smithi049 bash[23528]: audit 2024-09-21T04:16:55.717301+0000 mgr.a (mgr.14388) 15690 : audit [DBG] from='client.339267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:16:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:56 smithi049 bash[23528]: cluster 2024-09-21T04:16:55.801404+0000 mgr.a (mgr.14388) 15691 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:16:59.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:58 smithi044 bash[22676]: cluster 2024-09-21T04:16:57.801987+0000 mgr.a (mgr.14388) 15692 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:16:59.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:58 smithi044 bash[22676]: audit 2024-09-21T04:16:57.988701+0000 mon.a (mon.0) 12563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:58 smithi044 bash[22676]: audit 2024-09-21T04:16:57.997133+0000 mon.a (mon.0) 12564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:58 smithi044 bash[22676]: audit 2024-09-21T04:16:58.007663+0000 mon.a (mon.0) 12565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:58 smithi044 bash[22676]: audit 2024-09-21T04:16:58.483345+0000 mon.a (mon.0) 12566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:58 smithi044 bash[22676]: audit 2024-09-21T04:16:58.491554+0000 mon.a (mon.0) 12567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:16:58 smithi044 bash[22676]: audit 2024-09-21T04:16:58.501490+0000 mon.a (mon.0) 12568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:58 smithi179 bash[23186]: cluster 2024-09-21T04:16:57.801987+0000 mgr.a (mgr.14388) 15692 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:16:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:58 smithi179 bash[23186]: audit 2024-09-21T04:16:57.988701+0000 mon.a (mon.0) 12563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:58 smithi179 bash[23186]: audit 2024-09-21T04:16:57.997133+0000 mon.a (mon.0) 12564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:58 smithi179 bash[23186]: audit 2024-09-21T04:16:58.007663+0000 mon.a (mon.0) 12565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:58 smithi179 bash[23186]: audit 2024-09-21T04:16:58.483345+0000 mon.a (mon.0) 12566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:58 smithi179 bash[23186]: audit 2024-09-21T04:16:58.491554+0000 mon.a (mon.0) 12567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:16:58 smithi179 bash[23186]: audit 2024-09-21T04:16:58.501490+0000 mon.a (mon.0) 12568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:58 smithi049 bash[23528]: cluster 2024-09-21T04:16:57.801987+0000 mgr.a (mgr.14388) 15692 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:16:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:58 smithi049 bash[23528]: audit 2024-09-21T04:16:57.988701+0000 mon.a (mon.0) 12563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:58 smithi049 bash[23528]: audit 2024-09-21T04:16:57.997133+0000 mon.a (mon.0) 12564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:58 smithi049 bash[23528]: audit 2024-09-21T04:16:58.007663+0000 mon.a (mon.0) 12565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:58 smithi049 bash[23528]: audit 2024-09-21T04:16:58.483345+0000 mon.a (mon.0) 12566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:58 smithi049 bash[23528]: audit 2024-09-21T04:16:58.491554+0000 mon.a (mon.0) 12567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:16:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:16:58 smithi049 bash[23528]: audit 2024-09-21T04:16:58.501490+0000 mon.a (mon.0) 12568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:01.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:00 smithi179 bash[23186]: cluster 2024-09-21T04:16:59.802743+0000 mgr.a (mgr.14388) 15693 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:17:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:00 smithi049 bash[23528]: cluster 2024-09-21T04:16:59.802743+0000 mgr.a (mgr.14388) 15693 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:17:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:00 smithi044 bash[22676]: cluster 2024-09-21T04:16:59.802743+0000 mgr.a (mgr.14388) 15693 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:17:01.933 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:01.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:01.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:01.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:01.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:02 smithi179 bash[23186]: audit 2024-09-21T04:17:01.502511+0000 mgr.a (mgr.14388) 15694 : audit [DBG] from='client.339345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:02 smithi179 bash[23186]: cluster 2024-09-21T04:17:01.804406+0000 mgr.a (mgr.14388) 15695 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:17:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:02 smithi049 bash[23528]: audit 2024-09-21T04:17:01.502511+0000 mgr.a (mgr.14388) 15694 : audit [DBG] from='client.339345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:02 smithi049 bash[23528]: cluster 2024-09-21T04:17:01.804406+0000 mgr.a (mgr.14388) 15695 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:17:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:02 smithi044 bash[22676]: audit 2024-09-21T04:17:01.502511+0000 mgr.a (mgr.14388) 15694 : audit [DBG] from='client.339345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:02 smithi044 bash[22676]: cluster 2024-09-21T04:17:01.804406+0000 mgr.a (mgr.14388) 15695 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:17:04.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:04 smithi049 bash[23528]: cluster 2024-09-21T04:17:03.805325+0000 mgr.a (mgr.14388) 15696 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:04 smithi044 bash[22676]: cluster 2024-09-21T04:17:03.805325+0000 mgr.a (mgr.14388) 15696 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:04 smithi179 bash[23186]: cluster 2024-09-21T04:17:03.805325+0000 mgr.a (mgr.14388) 15696 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:06.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:06 smithi044 bash[22676]: cluster 2024-09-21T04:17:05.807528+0000 mgr.a (mgr.14388) 15697 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:06 smithi179 bash[23186]: cluster 2024-09-21T04:17:05.807528+0000 mgr.a (mgr.14388) 15697 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:06 smithi049 bash[23528]: cluster 2024-09-21T04:17:05.807528+0000 mgr.a (mgr.14388) 15697 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:07.741 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:07.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:07.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:07.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:07.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:08 smithi044 bash[22676]: audit 2024-09-21T04:17:07.275224+0000 mgr.a (mgr.14388) 15698 : audit [DBG] from='client.339423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:08 smithi044 bash[22676]: audit 2024-09-21T04:17:07.342287+0000 mon.a (mon.0) 12569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:08 smithi044 bash[22676]: audit 2024-09-21T04:17:07.347215+0000 mon.a (mon.0) 12570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:08 smithi044 bash[22676]: audit 2024-09-21T04:17:07.353236+0000 mon.a (mon.0) 12571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:08 smithi044 bash[22676]: cluster 2024-09-21T04:17:07.808523+0000 mgr.a (mgr.14388) 15699 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:08 smithi179 bash[23186]: audit 2024-09-21T04:17:07.275224+0000 mgr.a (mgr.14388) 15698 : audit [DBG] from='client.339423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:08 smithi179 bash[23186]: audit 2024-09-21T04:17:07.342287+0000 mon.a (mon.0) 12569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:08 smithi179 bash[23186]: audit 2024-09-21T04:17:07.347215+0000 mon.a (mon.0) 12570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:08 smithi179 bash[23186]: audit 2024-09-21T04:17:07.353236+0000 mon.a (mon.0) 12571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:08 smithi179 bash[23186]: cluster 2024-09-21T04:17:07.808523+0000 mgr.a (mgr.14388) 15699 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:08 smithi049 bash[23528]: audit 2024-09-21T04:17:07.275224+0000 mgr.a (mgr.14388) 15698 : audit [DBG] from='client.339423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:08 smithi049 bash[23528]: audit 2024-09-21T04:17:07.342287+0000 mon.a (mon.0) 12569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:08 smithi049 bash[23528]: audit 2024-09-21T04:17:07.347215+0000 mon.a (mon.0) 12570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:08 smithi049 bash[23528]: audit 2024-09-21T04:17:07.353236+0000 mon.a (mon.0) 12571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:08 smithi049 bash[23528]: cluster 2024-09-21T04:17:07.808523+0000 mgr.a (mgr.14388) 15699 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:10 smithi179 bash[23186]: cluster 2024-09-21T04:17:09.809336+0000 mgr.a (mgr.14388) 15700 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:10 smithi044 bash[22676]: cluster 2024-09-21T04:17:09.809336+0000 mgr.a (mgr.14388) 15700 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:10 smithi049 bash[23528]: cluster 2024-09-21T04:17:09.809336+0000 mgr.a (mgr.14388) 15700 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:12.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:12.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:12 smithi044 bash[22676]: cluster 2024-09-21T04:17:11.811591+0000 mgr.a (mgr.14388) 15701 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:12 smithi179 bash[23186]: cluster 2024-09-21T04:17:11.811591+0000 mgr.a (mgr.14388) 15701 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:12 smithi049 bash[23528]: cluster 2024-09-21T04:17:11.811591+0000 mgr.a (mgr.14388) 15701 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:13.511 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:14 smithi044 bash[22676]: audit 2024-09-21T04:17:13.082485+0000 mgr.a (mgr.14388) 15702 : audit [DBG] from='client.339495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:14 smithi044 bash[22676]: cluster 2024-09-21T04:17:13.812746+0000 mgr.a (mgr.14388) 15703 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:14 smithi179 bash[23186]: audit 2024-09-21T04:17:13.082485+0000 mgr.a (mgr.14388) 15702 : audit [DBG] from='client.339495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:14 smithi179 bash[23186]: cluster 2024-09-21T04:17:13.812746+0000 mgr.a (mgr.14388) 15703 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:14 smithi049 bash[23528]: audit 2024-09-21T04:17:13.082485+0000 mgr.a (mgr.14388) 15702 : audit [DBG] from='client.339495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:14 smithi049 bash[23528]: cluster 2024-09-21T04:17:13.812746+0000 mgr.a (mgr.14388) 15703 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:16 smithi044 bash[22676]: cluster 2024-09-21T04:17:15.815092+0000 mgr.a (mgr.14388) 15704 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:16 smithi179 bash[23186]: cluster 2024-09-21T04:17:15.815092+0000 mgr.a (mgr.14388) 15704 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:16 smithi049 bash[23528]: cluster 2024-09-21T04:17:15.815092+0000 mgr.a (mgr.14388) 15704 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:18.514 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:18 smithi179 bash[23186]: cluster 2024-09-21T04:17:17.815886+0000 mgr.a (mgr.14388) 15705 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:18 smithi179 bash[23186]: audit 2024-09-21T04:17:18.219234+0000 mon.a (mon.0) 12572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:18 smithi179 bash[23186]: audit 2024-09-21T04:17:18.228915+0000 mon.a (mon.0) 12573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:18 smithi179 bash[23186]: audit 2024-09-21T04:17:18.239478+0000 mon.a (mon.0) 12574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:18 smithi179 bash[23186]: audit 2024-09-21T04:17:18.703109+0000 mon.a (mon.0) 12575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:18 smithi179 bash[23186]: audit 2024-09-21T04:17:18.712072+0000 mon.a (mon.0) 12576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:18 smithi179 bash[23186]: audit 2024-09-21T04:17:18.721180+0000 mon.a (mon.0) 12577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:18 smithi049 bash[23528]: cluster 2024-09-21T04:17:17.815886+0000 mgr.a (mgr.14388) 15705 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:18 smithi049 bash[23528]: audit 2024-09-21T04:17:18.219234+0000 mon.a (mon.0) 12572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:18 smithi049 bash[23528]: audit 2024-09-21T04:17:18.228915+0000 mon.a (mon.0) 12573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:18 smithi049 bash[23528]: audit 2024-09-21T04:17:18.239478+0000 mon.a (mon.0) 12574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:18 smithi049 bash[23528]: audit 2024-09-21T04:17:18.703109+0000 mon.a (mon.0) 12575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:18 smithi049 bash[23528]: audit 2024-09-21T04:17:18.712072+0000 mon.a (mon.0) 12576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:18 smithi049 bash[23528]: audit 2024-09-21T04:17:18.721180+0000 mon.a (mon.0) 12577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:18 smithi044 bash[22676]: cluster 2024-09-21T04:17:17.815886+0000 mgr.a (mgr.14388) 15705 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:18 smithi044 bash[22676]: audit 2024-09-21T04:17:18.219234+0000 mon.a (mon.0) 12572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:18 smithi044 bash[22676]: audit 2024-09-21T04:17:18.228915+0000 mon.a (mon.0) 12573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:18 smithi044 bash[22676]: audit 2024-09-21T04:17:18.239478+0000 mon.a (mon.0) 12574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:18 smithi044 bash[22676]: audit 2024-09-21T04:17:18.703109+0000 mon.a (mon.0) 12575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:18 smithi044 bash[22676]: audit 2024-09-21T04:17:18.712072+0000 mon.a (mon.0) 12576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:18 smithi044 bash[22676]: audit 2024-09-21T04:17:18.721180+0000 mon.a (mon.0) 12577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:19.318 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:19.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:19.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:20.230 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:19 smithi049 bash[23528]: audit 2024-09-21T04:17:18.856343+0000 mgr.a (mgr.14388) 15706 : audit [DBG] from='client.339567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:19 smithi044 bash[22676]: audit 2024-09-21T04:17:18.856343+0000 mgr.a (mgr.14388) 15706 : audit [DBG] from='client.339567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:19 smithi179 bash[23186]: audit 2024-09-21T04:17:18.856343+0000 mgr.a (mgr.14388) 15706 : audit [DBG] from='client.339567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:20 smithi044 bash[22676]: cluster 2024-09-21T04:17:19.816902+0000 mgr.a (mgr.14388) 15707 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:20 smithi179 bash[23186]: cluster 2024-09-21T04:17:19.816902+0000 mgr.a (mgr.14388) 15707 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:20 smithi049 bash[23528]: cluster 2024-09-21T04:17:19.816902+0000 mgr.a (mgr.14388) 15707 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:22 smithi044 bash[22676]: cluster 2024-09-21T04:17:21.819230+0000 mgr.a (mgr.14388) 15708 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:22 smithi179 bash[23186]: cluster 2024-09-21T04:17:21.819230+0000 mgr.a (mgr.14388) 15708 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:22 smithi049 bash[23528]: cluster 2024-09-21T04:17:21.819230+0000 mgr.a (mgr.14388) 15708 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:24.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:24.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:24.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:25.101 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:25.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:24 smithi044 bash[22676]: cluster 2024-09-21T04:17:23.820006+0000 mgr.a (mgr.14388) 15709 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:24 smithi179 bash[23186]: cluster 2024-09-21T04:17:23.820006+0000 mgr.a (mgr.14388) 15709 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:25.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:24 smithi049 bash[23528]: cluster 2024-09-21T04:17:23.820006+0000 mgr.a (mgr.14388) 15709 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:25 smithi044 bash[22676]: audit 2024-09-21T04:17:24.658820+0000 mgr.a (mgr.14388) 15710 : audit [DBG] from='client.339642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:25 smithi179 bash[23186]: audit 2024-09-21T04:17:24.658820+0000 mgr.a (mgr.14388) 15710 : audit [DBG] from='client.339642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:26.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:25 smithi049 bash[23528]: audit 2024-09-21T04:17:24.658820+0000 mgr.a (mgr.14388) 15710 : audit [DBG] from='client.339642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:26 smithi044 bash[22676]: cluster 2024-09-21T04:17:25.822533+0000 mgr.a (mgr.14388) 15711 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:17:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:26 smithi179 bash[23186]: cluster 2024-09-21T04:17:25.822533+0000 mgr.a (mgr.14388) 15711 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:17:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:26 smithi049 bash[23528]: cluster 2024-09-21T04:17:25.822533+0000 mgr.a (mgr.14388) 15711 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:17:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:28 smithi044 bash[22676]: audit 2024-09-21T04:17:27.566028+0000 mon.a (mon.0) 12578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:28 smithi044 bash[22676]: audit 2024-09-21T04:17:27.574754+0000 mon.a (mon.0) 12579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:28 smithi044 bash[22676]: audit 2024-09-21T04:17:27.585194+0000 mon.a (mon.0) 12580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:28 smithi044 bash[22676]: cluster 2024-09-21T04:17:27.823320+0000 mgr.a (mgr.14388) 15712 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:17:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:28 smithi179 bash[23186]: audit 2024-09-21T04:17:27.566028+0000 mon.a (mon.0) 12578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:28 smithi179 bash[23186]: audit 2024-09-21T04:17:27.574754+0000 mon.a (mon.0) 12579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:28 smithi179 bash[23186]: audit 2024-09-21T04:17:27.585194+0000 mon.a (mon.0) 12580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:28 smithi179 bash[23186]: cluster 2024-09-21T04:17:27.823320+0000 mgr.a (mgr.14388) 15712 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:17:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:28 smithi049 bash[23528]: audit 2024-09-21T04:17:27.566028+0000 mon.a (mon.0) 12578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:28 smithi049 bash[23528]: audit 2024-09-21T04:17:27.574754+0000 mon.a (mon.0) 12579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:28 smithi049 bash[23528]: audit 2024-09-21T04:17:27.585194+0000 mon.a (mon.0) 12580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:28 smithi049 bash[23528]: cluster 2024-09-21T04:17:27.823320+0000 mgr.a (mgr.14388) 15712 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:17:30.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:30.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:30.104 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:30.881 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:30.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:30.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:30.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:30.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:31.154 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:30 smithi179 bash[23186]: cluster 2024-09-21T04:17:29.824104+0000 mgr.a (mgr.14388) 15713 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:17:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:30 smithi044 bash[22676]: cluster 2024-09-21T04:17:29.824104+0000 mgr.a (mgr.14388) 15713 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:17:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:30 smithi049 bash[23528]: cluster 2024-09-21T04:17:29.824104+0000 mgr.a (mgr.14388) 15713 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:17:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:31 smithi179 bash[23186]: audit 2024-09-21T04:17:30.438003+0000 mgr.a (mgr.14388) 15714 : audit [DBG] from='client.339720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:31 smithi044 bash[22676]: audit 2024-09-21T04:17:30.438003+0000 mgr.a (mgr.14388) 15714 : audit [DBG] from='client.339720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:32.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:31 smithi049 bash[23528]: audit 2024-09-21T04:17:30.438003+0000 mgr.a (mgr.14388) 15714 : audit [DBG] from='client.339720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:32 smithi044 bash[22676]: cluster 2024-09-21T04:17:31.827067+0000 mgr.a (mgr.14388) 15715 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:32 smithi179 bash[23186]: cluster 2024-09-21T04:17:31.827067+0000 mgr.a (mgr.14388) 15715 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:32 smithi049 bash[23528]: cluster 2024-09-21T04:17:31.827067+0000 mgr.a (mgr.14388) 15715 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:34 smithi044 bash[22676]: cluster 2024-09-21T04:17:33.827854+0000 mgr.a (mgr.14388) 15716 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:17:35.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:34 smithi179 bash[23186]: cluster 2024-09-21T04:17:33.827854+0000 mgr.a (mgr.14388) 15716 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:17:35.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:34 smithi049 bash[23528]: cluster 2024-09-21T04:17:33.827854+0000 mgr.a (mgr.14388) 15716 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:17:35.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:35.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:35.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:36.691 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:36 smithi044 bash[22676]: cluster 2024-09-21T04:17:35.829917+0000 mgr.a (mgr.14388) 15717 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:36 smithi179 bash[23186]: cluster 2024-09-21T04:17:35.829917+0000 mgr.a (mgr.14388) 15717 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:37.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:36 smithi049 bash[23528]: cluster 2024-09-21T04:17:35.829917+0000 mgr.a (mgr.14388) 15717 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:37 smithi044 bash[22676]: audit 2024-09-21T04:17:36.237873+0000 mgr.a (mgr.14388) 15718 : audit [DBG] from='client.339798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:37 smithi179 bash[23186]: audit 2024-09-21T04:17:36.237873+0000 mgr.a (mgr.14388) 15718 : audit [DBG] from='client.339798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:37 smithi049 bash[23528]: audit 2024-09-21T04:17:36.237873+0000 mgr.a (mgr.14388) 15718 : audit [DBG] from='client.339798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:38 smithi044 bash[22676]: cluster 2024-09-21T04:17:37.830926+0000 mgr.a (mgr.14388) 15719 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:17:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:38 smithi044 bash[22676]: audit 2024-09-21T04:17:38.442302+0000 mon.a (mon.0) 12581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:38 smithi044 bash[22676]: audit 2024-09-21T04:17:38.449928+0000 mon.a (mon.0) 12582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:38 smithi044 bash[22676]: audit 2024-09-21T04:17:38.458226+0000 mon.a (mon.0) 12583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:38 smithi044 bash[22676]: audit 2024-09-21T04:17:38.889055+0000 mon.a (mon.0) 12584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:38 smithi044 bash[22676]: audit 2024-09-21T04:17:38.897506+0000 mon.a (mon.0) 12585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:38 smithi044 bash[22676]: audit 2024-09-21T04:17:38.907340+0000 mon.a (mon.0) 12586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:38 smithi179 bash[23186]: cluster 2024-09-21T04:17:37.830926+0000 mgr.a (mgr.14388) 15719 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:17:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:38 smithi179 bash[23186]: audit 2024-09-21T04:17:38.442302+0000 mon.a (mon.0) 12581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:38 smithi179 bash[23186]: audit 2024-09-21T04:17:38.449928+0000 mon.a (mon.0) 12582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:38 smithi179 bash[23186]: audit 2024-09-21T04:17:38.458226+0000 mon.a (mon.0) 12583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:38 smithi179 bash[23186]: audit 2024-09-21T04:17:38.889055+0000 mon.a (mon.0) 12584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:38 smithi179 bash[23186]: audit 2024-09-21T04:17:38.897506+0000 mon.a (mon.0) 12585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:38 smithi179 bash[23186]: audit 2024-09-21T04:17:38.907340+0000 mon.a (mon.0) 12586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:38 smithi049 bash[23528]: cluster 2024-09-21T04:17:37.830926+0000 mgr.a (mgr.14388) 15719 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:17:39.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:38 smithi049 bash[23528]: audit 2024-09-21T04:17:38.442302+0000 mon.a (mon.0) 12581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:38 smithi049 bash[23528]: audit 2024-09-21T04:17:38.449928+0000 mon.a (mon.0) 12582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:38 smithi049 bash[23528]: audit 2024-09-21T04:17:38.458226+0000 mon.a (mon.0) 12583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:38 smithi049 bash[23528]: audit 2024-09-21T04:17:38.889055+0000 mon.a (mon.0) 12584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:38 smithi049 bash[23528]: audit 2024-09-21T04:17:38.897506+0000 mon.a (mon.0) 12585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:38 smithi049 bash[23528]: audit 2024-09-21T04:17:38.907340+0000 mon.a (mon.0) 12586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:41.053 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:40 smithi049 bash[23528]: cluster 2024-09-21T04:17:39.831741+0000 mgr.a (mgr.14388) 15720 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:17:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:40 smithi044 bash[22676]: cluster 2024-09-21T04:17:39.831741+0000 mgr.a (mgr.14388) 15720 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:17:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:40 smithi179 bash[23186]: cluster 2024-09-21T04:17:39.831741+0000 mgr.a (mgr.14388) 15720 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:17:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:41.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:41.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:42.489 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:42.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:42.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:42.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:42.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:42 smithi044 bash[22676]: cluster 2024-09-21T04:17:41.832823+0000 mgr.a (mgr.14388) 15721 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:17:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:42 smithi179 bash[23186]: cluster 2024-09-21T04:17:41.832823+0000 mgr.a (mgr.14388) 15721 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:17:43.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:42 smithi049 bash[23528]: cluster 2024-09-21T04:17:41.832823+0000 mgr.a (mgr.14388) 15721 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:17:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:43 smithi044 bash[22676]: audit 2024-09-21T04:17:42.030083+0000 mgr.a (mgr.14388) 15722 : audit [DBG] from='client.339876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:43 smithi179 bash[23186]: audit 2024-09-21T04:17:42.030083+0000 mgr.a (mgr.14388) 15722 : audit [DBG] from='client.339876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:44.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:43 smithi049 bash[23528]: audit 2024-09-21T04:17:42.030083+0000 mgr.a (mgr.14388) 15722 : audit [DBG] from='client.339876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:44 smithi044 bash[22676]: cluster 2024-09-21T04:17:43.833818+0000 mgr.a (mgr.14388) 15723 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:44 smithi179 bash[23186]: cluster 2024-09-21T04:17:43.833818+0000 mgr.a (mgr.14388) 15723 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:44 smithi049 bash[23528]: cluster 2024-09-21T04:17:43.833818+0000 mgr.a (mgr.14388) 15723 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:45 smithi044 bash[22676]: audit 2024-09-21T04:17:45.763964+0000 mon.a (mon.0) 12587 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:17:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:45 smithi044 bash[22676]: audit 2024-09-21T04:17:45.771231+0000 mon.a (mon.0) 12588 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:17:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:45 smithi044 bash[22676]: audit 2024-09-21T04:17:45.773082+0000 mon.a (mon.0) 12589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:17:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:45 smithi044 bash[22676]: audit 2024-09-21T04:17:45.784854+0000 mon.a (mon.0) 12590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:45 smithi044 bash[22676]: audit 2024-09-21T04:17:45.791406+0000 mon.a (mon.0) 12591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:17:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:45 smithi179 bash[23186]: audit 2024-09-21T04:17:45.763964+0000 mon.a (mon.0) 12587 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:17:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:45 smithi179 bash[23186]: audit 2024-09-21T04:17:45.771231+0000 mon.a (mon.0) 12588 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:17:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:45 smithi179 bash[23186]: audit 2024-09-21T04:17:45.773082+0000 mon.a (mon.0) 12589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:17:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:45 smithi179 bash[23186]: audit 2024-09-21T04:17:45.784854+0000 mon.a (mon.0) 12590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:45 smithi179 bash[23186]: audit 2024-09-21T04:17:45.791406+0000 mon.a (mon.0) 12591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:17:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:45 smithi049 bash[23528]: audit 2024-09-21T04:17:45.763964+0000 mon.a (mon.0) 12587 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:17:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:45 smithi049 bash[23528]: audit 2024-09-21T04:17:45.771231+0000 mon.a (mon.0) 12588 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:17:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:45 smithi049 bash[23528]: audit 2024-09-21T04:17:45.773082+0000 mon.a (mon.0) 12589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:17:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:45 smithi049 bash[23528]: audit 2024-09-21T04:17:45.784854+0000 mon.a (mon.0) 12590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:45 smithi049 bash[23528]: audit 2024-09-21T04:17:45.791406+0000 mon.a (mon.0) 12591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:17:46.938 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:17:46 smithi044 bash[22930]: debug 2024-09-21T04:17:46.577+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:17:46.938 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:17:46 smithi044 bash[22930]: debug 2024-09-21T04:17:46.581+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:17:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:46 smithi044 bash[22676]: audit 2024-09-21T04:17:45.793889+0000 mgr.a (mgr.14388) 15724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:17:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:46 smithi044 bash[22676]: cluster 2024-09-21T04:17:45.837215+0000 mgr.a (mgr.14388) 15725 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:46 smithi179 bash[23186]: audit 2024-09-21T04:17:45.793889+0000 mgr.a (mgr.14388) 15724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:17:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:46 smithi179 bash[23186]: cluster 2024-09-21T04:17:45.837215+0000 mgr.a (mgr.14388) 15725 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:46 smithi049 bash[23528]: audit 2024-09-21T04:17:45.793889+0000 mgr.a (mgr.14388) 15724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:17:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:46 smithi049 bash[23528]: cluster 2024-09-21T04:17:45.837215+0000 mgr.a (mgr.14388) 15725 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:17:47.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:47.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:47.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:47 smithi049 bash[23528]: audit 2024-09-21T04:17:46.585229+0000 mgr.a (mgr.14388) 15726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:17:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:47 smithi049 bash[23528]: cephadm 2024-09-21T04:17:46.586586+0000 mgr.a (mgr.14388) 15727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:17:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:47 smithi049 bash[23528]: audit 2024-09-21T04:17:47.762095+0000 mon.a (mon.0) 12592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:47 smithi049 bash[23528]: audit 2024-09-21T04:17:47.769565+0000 mon.a (mon.0) 12593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:47 smithi049 bash[23528]: audit 2024-09-21T04:17:47.779497+0000 mon.a (mon.0) 12594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:47 smithi044 bash[22676]: audit 2024-09-21T04:17:46.585229+0000 mgr.a (mgr.14388) 15726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:17:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:47 smithi044 bash[22676]: cephadm 2024-09-21T04:17:46.586586+0000 mgr.a (mgr.14388) 15727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:17:48.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:47 smithi044 bash[22676]: audit 2024-09-21T04:17:47.762095+0000 mon.a (mon.0) 12592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:47 smithi044 bash[22676]: audit 2024-09-21T04:17:47.769565+0000 mon.a (mon.0) 12593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:47 smithi044 bash[22676]: audit 2024-09-21T04:17:47.779497+0000 mon.a (mon.0) 12594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:47 smithi179 bash[23186]: audit 2024-09-21T04:17:46.585229+0000 mgr.a (mgr.14388) 15726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:17:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:47 smithi179 bash[23186]: cephadm 2024-09-21T04:17:46.586586+0000 mgr.a (mgr.14388) 15727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:17:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:47 smithi179 bash[23186]: audit 2024-09-21T04:17:47.762095+0000 mon.a (mon.0) 12592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:47 smithi179 bash[23186]: audit 2024-09-21T04:17:47.769565+0000 mon.a (mon.0) 12593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:47 smithi179 bash[23186]: audit 2024-09-21T04:17:47.779497+0000 mon.a (mon.0) 12594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:48.272 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:48.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:48.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:48.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:48.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:48 smithi044 bash[22676]: audit 2024-09-21T04:17:47.825963+0000 mgr.a (mgr.14388) 15728 : audit [DBG] from='client.340059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:48 smithi044 bash[22676]: cluster 2024-09-21T04:17:47.844856+0000 mgr.a (mgr.14388) 15729 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:48 smithi179 bash[23186]: audit 2024-09-21T04:17:47.825963+0000 mgr.a (mgr.14388) 15728 : audit [DBG] from='client.340059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:48 smithi179 bash[23186]: cluster 2024-09-21T04:17:47.844856+0000 mgr.a (mgr.14388) 15729 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:48 smithi049 bash[23528]: audit 2024-09-21T04:17:47.825963+0000 mgr.a (mgr.14388) 15728 : audit [DBG] from='client.340059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:49.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:48 smithi049 bash[23528]: cluster 2024-09-21T04:17:47.844856+0000 mgr.a (mgr.14388) 15729 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:50 smithi044 bash[22676]: cluster 2024-09-21T04:17:49.846148+0000 mgr.a (mgr.14388) 15730 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:50 smithi179 bash[23186]: cluster 2024-09-21T04:17:49.846148+0000 mgr.a (mgr.14388) 15730 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:51.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:50 smithi049 bash[23528]: cluster 2024-09-21T04:17:49.846148+0000 mgr.a (mgr.14388) 15730 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:17:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:52 smithi044 bash[22676]: cluster 2024-09-21T04:17:51.848631+0000 mgr.a (mgr.14388) 15731 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:17:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:52 smithi179 bash[23186]: cluster 2024-09-21T04:17:51.848631+0000 mgr.a (mgr.14388) 15731 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:17:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:53.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:53.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:52 smithi049 bash[23528]: cluster 2024-09-21T04:17:51.848631+0000 mgr.a (mgr.14388) 15731 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:17:54.063 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:54.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:54.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:54.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:54.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:17:55.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:54 smithi044 bash[22676]: audit 2024-09-21T04:17:53.617112+0000 mgr.a (mgr.14388) 15732 : audit [DBG] from='client.340137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:55.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:54 smithi044 bash[22676]: cluster 2024-09-21T04:17:53.851864+0000 mgr.a (mgr.14388) 15733 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:54 smithi179 bash[23186]: audit 2024-09-21T04:17:53.617112+0000 mgr.a (mgr.14388) 15732 : audit [DBG] from='client.340137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:54 smithi179 bash[23186]: cluster 2024-09-21T04:17:53.851864+0000 mgr.a (mgr.14388) 15733 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:54 smithi049 bash[23528]: audit 2024-09-21T04:17:53.617112+0000 mgr.a (mgr.14388) 15732 : audit [DBG] from='client.340137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:17:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:54 smithi049 bash[23528]: cluster 2024-09-21T04:17:53.851864+0000 mgr.a (mgr.14388) 15733 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:56 smithi044 bash[22676]: cluster 2024-09-21T04:17:55.854297+0000 mgr.a (mgr.14388) 15734 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:56 smithi179 bash[23186]: cluster 2024-09-21T04:17:55.854297+0000 mgr.a (mgr.14388) 15734 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:56 smithi049 bash[23528]: cluster 2024-09-21T04:17:55.854297+0000 mgr.a (mgr.14388) 15734 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:17:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:17:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:17:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:58 smithi044 bash[22676]: cluster 2024-09-21T04:17:57.855073+0000 mgr.a (mgr.14388) 15735 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:58 smithi044 bash[22676]: audit 2024-09-21T04:17:58.650405+0000 mon.a (mon.0) 12595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:58 smithi044 bash[22676]: audit 2024-09-21T04:17:58.658413+0000 mon.a (mon.0) 12596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:17:58 smithi044 bash[22676]: audit 2024-09-21T04:17:58.668701+0000 mon.a (mon.0) 12597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:58 smithi179 bash[23186]: cluster 2024-09-21T04:17:57.855073+0000 mgr.a (mgr.14388) 15735 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:58 smithi179 bash[23186]: audit 2024-09-21T04:17:58.650405+0000 mon.a (mon.0) 12595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:58 smithi179 bash[23186]: audit 2024-09-21T04:17:58.658413+0000 mon.a (mon.0) 12596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:17:58 smithi179 bash[23186]: audit 2024-09-21T04:17:58.668701+0000 mon.a (mon.0) 12597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:58 smithi049 bash[23528]: cluster 2024-09-21T04:17:57.855073+0000 mgr.a (mgr.14388) 15735 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T04:17:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:58 smithi049 bash[23528]: audit 2024-09-21T04:17:58.650405+0000 mon.a (mon.0) 12595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:58 smithi049 bash[23528]: audit 2024-09-21T04:17:58.658413+0000 mon.a (mon.0) 12596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:17:58 smithi049 bash[23528]: audit 2024-09-21T04:17:58.668701+0000 mon.a (mon.0) 12597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:17:59.835 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:17:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:17:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:17:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:17:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:00 smithi049 bash[23528]: audit 2024-09-21T04:17:59.108889+0000 mon.a (mon.0) 12598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:00 smithi049 bash[23528]: audit 2024-09-21T04:17:59.117858+0000 mon.a (mon.0) 12599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:00 smithi049 bash[23528]: audit 2024-09-21T04:17:59.129056+0000 mon.a (mon.0) 12600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:00 smithi049 bash[23528]: audit 2024-09-21T04:17:59.398814+0000 mgr.a (mgr.14388) 15736 : audit [DBG] from='client.340215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:00 smithi049 bash[23528]: cluster 2024-09-21T04:17:59.855757+0000 mgr.a (mgr.14388) 15737 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:00 smithi044 bash[22676]: audit 2024-09-21T04:17:59.108889+0000 mon.a (mon.0) 12598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:00 smithi044 bash[22676]: audit 2024-09-21T04:17:59.117858+0000 mon.a (mon.0) 12599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:00 smithi044 bash[22676]: audit 2024-09-21T04:17:59.129056+0000 mon.a (mon.0) 12600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:00 smithi044 bash[22676]: audit 2024-09-21T04:17:59.398814+0000 mgr.a (mgr.14388) 15736 : audit [DBG] from='client.340215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:00.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:00 smithi044 bash[22676]: cluster 2024-09-21T04:17:59.855757+0000 mgr.a (mgr.14388) 15737 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:00 smithi179 bash[23186]: audit 2024-09-21T04:17:59.108889+0000 mon.a (mon.0) 12598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:00 smithi179 bash[23186]: audit 2024-09-21T04:17:59.117858+0000 mon.a (mon.0) 12599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:00 smithi179 bash[23186]: audit 2024-09-21T04:17:59.129056+0000 mon.a (mon.0) 12600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:00 smithi179 bash[23186]: audit 2024-09-21T04:17:59.398814+0000 mgr.a (mgr.14388) 15736 : audit [DBG] from='client.340215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:00 smithi179 bash[23186]: cluster 2024-09-21T04:17:59.855757+0000 mgr.a (mgr.14388) 15737 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:03.186 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:02 smithi049 bash[23528]: cluster 2024-09-21T04:18:01.857992+0000 mgr.a (mgr.14388) 15738 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:02 smithi044 bash[22676]: cluster 2024-09-21T04:18:01.857992+0000 mgr.a (mgr.14388) 15738 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:02 smithi179 bash[23186]: cluster 2024-09-21T04:18:01.857992+0000 mgr.a (mgr.14388) 15738 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:04.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:04.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:04.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:04 smithi044 bash[22676]: cluster 2024-09-21T04:18:03.858787+0000 mgr.a (mgr.14388) 15739 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:04 smithi179 bash[23186]: cluster 2024-09-21T04:18:03.858787+0000 mgr.a (mgr.14388) 15739 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:04 smithi049 bash[23528]: cluster 2024-09-21T04:18:03.858787+0000 mgr.a (mgr.14388) 15739 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:05.599 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:06 smithi044 bash[22676]: audit 2024-09-21T04:18:05.176447+0000 mgr.a (mgr.14388) 15740 : audit [DBG] from='client.340293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:06 smithi044 bash[22676]: cluster 2024-09-21T04:18:05.861737+0000 mgr.a (mgr.14388) 15741 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:06 smithi179 bash[23186]: audit 2024-09-21T04:18:05.176447+0000 mgr.a (mgr.14388) 15740 : audit [DBG] from='client.340293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:06 smithi179 bash[23186]: cluster 2024-09-21T04:18:05.861737+0000 mgr.a (mgr.14388) 15741 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:07.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:06 smithi049 bash[23528]: audit 2024-09-21T04:18:05.176447+0000 mgr.a (mgr.14388) 15740 : audit [DBG] from='client.340293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:06 smithi049 bash[23528]: cluster 2024-09-21T04:18:05.861737+0000 mgr.a (mgr.14388) 15741 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:08 smithi179 bash[23186]: cluster 2024-09-21T04:18:07.862551+0000 mgr.a (mgr.14388) 15742 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:08 smithi179 bash[23186]: audit 2024-09-21T04:18:07.993817+0000 mon.a (mon.0) 12601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:08 smithi179 bash[23186]: audit 2024-09-21T04:18:08.002957+0000 mon.a (mon.0) 12602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:08 smithi179 bash[23186]: audit 2024-09-21T04:18:08.013470+0000 mon.a (mon.0) 12603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:08 smithi049 bash[23528]: cluster 2024-09-21T04:18:07.862551+0000 mgr.a (mgr.14388) 15742 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:08 smithi049 bash[23528]: audit 2024-09-21T04:18:07.993817+0000 mon.a (mon.0) 12601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:08 smithi049 bash[23528]: audit 2024-09-21T04:18:08.002957+0000 mon.a (mon.0) 12602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:08 smithi049 bash[23528]: audit 2024-09-21T04:18:08.013470+0000 mon.a (mon.0) 12603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:08 smithi044 bash[22676]: cluster 2024-09-21T04:18:07.862551+0000 mgr.a (mgr.14388) 15742 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:08 smithi044 bash[22676]: audit 2024-09-21T04:18:07.993817+0000 mon.a (mon.0) 12601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:08 smithi044 bash[22676]: audit 2024-09-21T04:18:08.002957+0000 mon.a (mon.0) 12602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:08 smithi044 bash[22676]: audit 2024-09-21T04:18:08.013470+0000 mon.a (mon.0) 12603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:10.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:10.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:10.601 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:10 smithi179 bash[23186]: cluster 2024-09-21T04:18:09.863333+0000 mgr.a (mgr.14388) 15743 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:18:11.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:10 smithi049 bash[23528]: cluster 2024-09-21T04:18:09.863333+0000 mgr.a (mgr.14388) 15743 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:18:11.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:10 smithi044 bash[22676]: cluster 2024-09-21T04:18:09.863333+0000 mgr.a (mgr.14388) 15743 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:18:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:11 smithi179 bash[23186]: audit 2024-09-21T04:18:10.930924+0000 mgr.a (mgr.14388) 15744 : audit [DBG] from='client.340368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:12.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:11 smithi049 bash[23528]: audit 2024-09-21T04:18:10.930924+0000 mgr.a (mgr.14388) 15744 : audit [DBG] from='client.340368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:11 smithi044 bash[22676]: audit 2024-09-21T04:18:10.930924+0000 mgr.a (mgr.14388) 15744 : audit [DBG] from='client.340368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:13 smithi179 bash[23186]: cluster 2024-09-21T04:18:11.866299+0000 mgr.a (mgr.14388) 15745 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:13.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:13 smithi049 bash[23528]: cluster 2024-09-21T04:18:11.866299+0000 mgr.a (mgr.14388) 15745 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:13.336 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:13 smithi044 bash[22676]: cluster 2024-09-21T04:18:11.866299+0000 mgr.a (mgr.14388) 15745 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:15 smithi044 bash[22676]: cluster 2024-09-21T04:18:13.867114+0000 mgr.a (mgr.14388) 15746 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:15 smithi049 bash[23528]: cluster 2024-09-21T04:18:13.867114+0000 mgr.a (mgr.14388) 15746 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:15 smithi179 bash[23186]: cluster 2024-09-21T04:18:13.867114+0000 mgr.a (mgr.14388) 15746 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:17.158 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:17.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:17 smithi049 bash[23528]: cluster 2024-09-21T04:18:15.869212+0000 mgr.a (mgr.14388) 15747 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:17.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:17 smithi044 bash[22676]: cluster 2024-09-21T04:18:15.869212+0000 mgr.a (mgr.14388) 15747 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:17 smithi179 bash[23186]: cluster 2024-09-21T04:18:15.869212+0000 mgr.a (mgr.14388) 15747 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:18.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:18 smithi049 bash[23528]: audit 2024-09-21T04:18:16.704344+0000 mgr.a (mgr.14388) 15748 : audit [DBG] from='client.340440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:18 smithi044 bash[22676]: audit 2024-09-21T04:18:16.704344+0000 mgr.a (mgr.14388) 15748 : audit [DBG] from='client.340440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:18 smithi179 bash[23186]: audit 2024-09-21T04:18:16.704344+0000 mgr.a (mgr.14388) 15748 : audit [DBG] from='client.340440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:19 smithi044 bash[22676]: cluster 2024-09-21T04:18:17.870254+0000 mgr.a (mgr.14388) 15749 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:19 smithi044 bash[22676]: audit 2024-09-21T04:18:18.877356+0000 mon.a (mon.0) 12604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:19 smithi044 bash[22676]: audit 2024-09-21T04:18:18.885833+0000 mon.a (mon.0) 12605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:19 smithi044 bash[22676]: audit 2024-09-21T04:18:18.896274+0000 mon.a (mon.0) 12606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:19 smithi049 bash[23528]: cluster 2024-09-21T04:18:17.870254+0000 mgr.a (mgr.14388) 15749 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:19 smithi049 bash[23528]: audit 2024-09-21T04:18:18.877356+0000 mon.a (mon.0) 12604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:19 smithi049 bash[23528]: audit 2024-09-21T04:18:18.885833+0000 mon.a (mon.0) 12605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:19 smithi049 bash[23528]: audit 2024-09-21T04:18:18.896274+0000 mon.a (mon.0) 12606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.322 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:19 smithi179 bash[23186]: cluster 2024-09-21T04:18:17.870254+0000 mgr.a (mgr.14388) 15749 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:19.322 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:19 smithi179 bash[23186]: audit 2024-09-21T04:18:18.877356+0000 mon.a (mon.0) 12604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.322 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:19 smithi179 bash[23186]: audit 2024-09-21T04:18:18.885833+0000 mon.a (mon.0) 12605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:19.322 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:19 smithi179 bash[23186]: audit 2024-09-21T04:18:18.896274+0000 mon.a (mon.0) 12606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:20 smithi049 bash[23528]: audit 2024-09-21T04:18:19.299086+0000 mon.a (mon.0) 12607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:20 smithi049 bash[23528]: audit 2024-09-21T04:18:19.307629+0000 mon.a (mon.0) 12608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:20 smithi049 bash[23528]: audit 2024-09-21T04:18:19.317934+0000 mon.a (mon.0) 12609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:20 smithi049 bash[23528]: cluster 2024-09-21T04:18:19.871073+0000 mgr.a (mgr.14388) 15750 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:20 smithi044 bash[22676]: audit 2024-09-21T04:18:19.299086+0000 mon.a (mon.0) 12607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:20 smithi044 bash[22676]: audit 2024-09-21T04:18:19.307629+0000 mon.a (mon.0) 12608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:20 smithi044 bash[22676]: audit 2024-09-21T04:18:19.317934+0000 mon.a (mon.0) 12609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:20 smithi044 bash[22676]: cluster 2024-09-21T04:18:19.871073+0000 mgr.a (mgr.14388) 15750 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:20 smithi179 bash[23186]: audit 2024-09-21T04:18:19.299086+0000 mon.a (mon.0) 12607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:20 smithi179 bash[23186]: audit 2024-09-21T04:18:19.307629+0000 mon.a (mon.0) 12608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:20 smithi179 bash[23186]: audit 2024-09-21T04:18:19.317934+0000 mon.a (mon.0) 12609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:20 smithi179 bash[23186]: cluster 2024-09-21T04:18:19.871073+0000 mgr.a (mgr.14388) 15750 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:22.909 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:22 smithi044 bash[22676]: cluster 2024-09-21T04:18:21.873602+0000 mgr.a (mgr.14388) 15751 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:22 smithi179 bash[23186]: cluster 2024-09-21T04:18:21.873602+0000 mgr.a (mgr.14388) 15751 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:22 smithi049 bash[23528]: cluster 2024-09-21T04:18:21.873602+0000 mgr.a (mgr.14388) 15751 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:24.219 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:23 smithi049 bash[23528]: audit 2024-09-21T04:18:22.489861+0000 mgr.a (mgr.14388) 15752 : audit [DBG] from='client.340518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:23 smithi044 bash[22676]: audit 2024-09-21T04:18:22.489861+0000 mgr.a (mgr.14388) 15752 : audit [DBG] from='client.340518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:23 smithi179 bash[23186]: audit 2024-09-21T04:18:22.489861+0000 mgr.a (mgr.14388) 15752 : audit [DBG] from='client.340518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:24 smithi044 bash[22676]: cluster 2024-09-21T04:18:23.874553+0000 mgr.a (mgr.14388) 15753 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:24 smithi179 bash[23186]: cluster 2024-09-21T04:18:23.874553+0000 mgr.a (mgr.14388) 15753 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:24 smithi049 bash[23528]: cluster 2024-09-21T04:18:23.874553+0000 mgr.a (mgr.14388) 15753 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:26 smithi044 bash[22676]: cluster 2024-09-21T04:18:25.876793+0000 mgr.a (mgr.14388) 15754 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:26 smithi179 bash[23186]: cluster 2024-09-21T04:18:25.876793+0000 mgr.a (mgr.14388) 15754 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:26 smithi049 bash[23528]: cluster 2024-09-21T04:18:25.876793+0000 mgr.a (mgr.14388) 15754 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:27.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:27.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:28.693 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:28 smithi044 bash[22676]: cluster 2024-09-21T04:18:27.877594+0000 mgr.a (mgr.14388) 15755 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:28 smithi044 bash[22676]: audit 2024-09-21T04:18:28.214367+0000 mon.a (mon.0) 12610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:28 smithi044 bash[22676]: audit 2024-09-21T04:18:28.222038+0000 mon.a (mon.0) 12611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:28 smithi044 bash[22676]: audit 2024-09-21T04:18:28.231726+0000 mon.a (mon.0) 12612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:28 smithi179 bash[23186]: cluster 2024-09-21T04:18:27.877594+0000 mgr.a (mgr.14388) 15755 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:28 smithi179 bash[23186]: audit 2024-09-21T04:18:28.214367+0000 mon.a (mon.0) 12610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:28 smithi179 bash[23186]: audit 2024-09-21T04:18:28.222038+0000 mon.a (mon.0) 12611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:28 smithi179 bash[23186]: audit 2024-09-21T04:18:28.231726+0000 mon.a (mon.0) 12612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:28 smithi049 bash[23528]: cluster 2024-09-21T04:18:27.877594+0000 mgr.a (mgr.14388) 15755 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:28 smithi049 bash[23528]: audit 2024-09-21T04:18:28.214367+0000 mon.a (mon.0) 12610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:28 smithi049 bash[23528]: audit 2024-09-21T04:18:28.222038+0000 mon.a (mon.0) 12611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:28 smithi049 bash[23528]: audit 2024-09-21T04:18:28.231726+0000 mon.a (mon.0) 12612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:29 smithi179 bash[23186]: audit 2024-09-21T04:18:28.257867+0000 mgr.a (mgr.14388) 15756 : audit [DBG] from='client.340596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:29 smithi044 bash[22676]: audit 2024-09-21T04:18:28.257867+0000 mgr.a (mgr.14388) 15756 : audit [DBG] from='client.340596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:30.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:29 smithi049 bash[23528]: audit 2024-09-21T04:18:28.257867+0000 mgr.a (mgr.14388) 15756 : audit [DBG] from='client.340596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:31.236 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:30 smithi179 bash[23186]: cluster 2024-09-21T04:18:29.878544+0000 mgr.a (mgr.14388) 15757 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:30 smithi044 bash[22676]: cluster 2024-09-21T04:18:29.878544+0000 mgr.a (mgr.14388) 15757 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:30 smithi049 bash[23528]: cluster 2024-09-21T04:18:29.878544+0000 mgr.a (mgr.14388) 15757 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:32 smithi044 bash[22676]: cluster 2024-09-21T04:18:31.880747+0000 mgr.a (mgr.14388) 15758 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:32 smithi179 bash[23186]: cluster 2024-09-21T04:18:31.880747+0000 mgr.a (mgr.14388) 15758 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:32 smithi049 bash[23528]: cluster 2024-09-21T04:18:31.880747+0000 mgr.a (mgr.14388) 15758 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:33.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:33.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:33.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:34.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:34.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:34.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:34 smithi044 bash[22676]: cluster 2024-09-21T04:18:33.881276+0000 mgr.a (mgr.14388) 15759 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:34 smithi044 bash[22676]: audit 2024-09-21T04:18:34.013581+0000 mgr.a (mgr.14388) 15760 : audit [DBG] from='client.340674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:34 smithi179 bash[23186]: cluster 2024-09-21T04:18:33.881276+0000 mgr.a (mgr.14388) 15759 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:34 smithi179 bash[23186]: audit 2024-09-21T04:18:34.013581+0000 mgr.a (mgr.14388) 15760 : audit [DBG] from='client.340674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:34 smithi049 bash[23528]: cluster 2024-09-21T04:18:33.881276+0000 mgr.a (mgr.14388) 15759 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:34 smithi049 bash[23528]: audit 2024-09-21T04:18:34.013581+0000 mgr.a (mgr.14388) 15760 : audit [DBG] from='client.340674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:36 smithi044 bash[22676]: cluster 2024-09-21T04:18:35.883367+0000 mgr.a (mgr.14388) 15761 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:36 smithi179 bash[23186]: cluster 2024-09-21T04:18:35.883367+0000 mgr.a (mgr.14388) 15761 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:36 smithi049 bash[23528]: cluster 2024-09-21T04:18:35.883367+0000 mgr.a (mgr.14388) 15761 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:18:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:38 smithi044 bash[22676]: cluster 2024-09-21T04:18:37.884153+0000 mgr.a (mgr.14388) 15762 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:38 smithi179 bash[23186]: cluster 2024-09-21T04:18:37.884153+0000 mgr.a (mgr.14388) 15762 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:38 smithi049 bash[23528]: cluster 2024-09-21T04:18:37.884153+0000 mgr.a (mgr.14388) 15762 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:39.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:39.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:39.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:40.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: audit 2024-09-21T04:18:39.106968+0000 mon.a (mon.0) 12613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: audit 2024-09-21T04:18:39.116178+0000 mon.a (mon.0) 12614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: audit 2024-09-21T04:18:39.126426+0000 mon.a (mon.0) 12615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: audit 2024-09-21T04:18:39.525338+0000 mon.a (mon.0) 12616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: audit 2024-09-21T04:18:39.533519+0000 mon.a (mon.0) 12617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: audit 2024-09-21T04:18:39.542225+0000 mon.a (mon.0) 12618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: audit 2024-09-21T04:18:39.781929+0000 mgr.a (mgr.14388) 15763 : audit [DBG] from='client.340749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:40 smithi044 bash[22676]: cluster 2024-09-21T04:18:39.884971+0000 mgr.a (mgr.14388) 15764 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: audit 2024-09-21T04:18:39.106968+0000 mon.a (mon.0) 12613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: audit 2024-09-21T04:18:39.116178+0000 mon.a (mon.0) 12614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: audit 2024-09-21T04:18:39.126426+0000 mon.a (mon.0) 12615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: audit 2024-09-21T04:18:39.525338+0000 mon.a (mon.0) 12616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: audit 2024-09-21T04:18:39.533519+0000 mon.a (mon.0) 12617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: audit 2024-09-21T04:18:39.542225+0000 mon.a (mon.0) 12618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: audit 2024-09-21T04:18:39.781929+0000 mgr.a (mgr.14388) 15763 : audit [DBG] from='client.340749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:40 smithi179 bash[23186]: cluster 2024-09-21T04:18:39.884971+0000 mgr.a (mgr.14388) 15764 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: audit 2024-09-21T04:18:39.106968+0000 mon.a (mon.0) 12613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: audit 2024-09-21T04:18:39.116178+0000 mon.a (mon.0) 12614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: audit 2024-09-21T04:18:39.126426+0000 mon.a (mon.0) 12615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: audit 2024-09-21T04:18:39.525338+0000 mon.a (mon.0) 12616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: audit 2024-09-21T04:18:39.533519+0000 mon.a (mon.0) 12617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: audit 2024-09-21T04:18:39.542225+0000 mon.a (mon.0) 12618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: audit 2024-09-21T04:18:39.781929+0000 mgr.a (mgr.14388) 15763 : audit [DBG] from='client.340749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:40 smithi049 bash[23528]: cluster 2024-09-21T04:18:39.884971+0000 mgr.a (mgr.14388) 15764 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:42 smithi044 bash[22676]: cluster 2024-09-21T04:18:41.887456+0000 mgr.a (mgr.14388) 15765 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:42 smithi179 bash[23186]: cluster 2024-09-21T04:18:41.887456+0000 mgr.a (mgr.14388) 15765 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:42 smithi049 bash[23528]: cluster 2024-09-21T04:18:41.887456+0000 mgr.a (mgr.14388) 15765 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:45.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:44 smithi044 bash[22676]: cluster 2024-09-21T04:18:43.888285+0000 mgr.a (mgr.14388) 15766 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:45.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:45.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:44 smithi179 bash[23186]: cluster 2024-09-21T04:18:43.888285+0000 mgr.a (mgr.14388) 15766 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:44 smithi049 bash[23528]: cluster 2024-09-21T04:18:43.888285+0000 mgr.a (mgr.14388) 15766 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:46.013 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:46.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:46.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:46.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:46.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:46 smithi044 bash[22676]: audit 2024-09-21T04:18:45.569586+0000 mgr.a (mgr.14388) 15767 : audit [DBG] from='client.340827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:46 smithi044 bash[22676]: cluster 2024-09-21T04:18:45.889929+0000 mgr.a (mgr.14388) 15768 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:46 smithi044 bash[22676]: audit 2024-09-21T04:18:46.652196+0000 mon.a (mon.0) 12619 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:18:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:46 smithi044 bash[22676]: audit 2024-09-21T04:18:46.659753+0000 mon.a (mon.0) 12620 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:18:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:46 smithi044 bash[22676]: audit 2024-09-21T04:18:46.661645+0000 mon.a (mon.0) 12621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:18:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:46 smithi044 bash[22676]: audit 2024-09-21T04:18:46.672902+0000 mon.a (mon.0) 12622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:46 smithi044 bash[22676]: audit 2024-09-21T04:18:46.679308+0000 mon.a (mon.0) 12623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:18:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:46 smithi179 bash[23186]: audit 2024-09-21T04:18:45.569586+0000 mgr.a (mgr.14388) 15767 : audit [DBG] from='client.340827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:46 smithi179 bash[23186]: cluster 2024-09-21T04:18:45.889929+0000 mgr.a (mgr.14388) 15768 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:46 smithi179 bash[23186]: audit 2024-09-21T04:18:46.652196+0000 mon.a (mon.0) 12619 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:18:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:46 smithi179 bash[23186]: audit 2024-09-21T04:18:46.659753+0000 mon.a (mon.0) 12620 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:18:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:46 smithi179 bash[23186]: audit 2024-09-21T04:18:46.661645+0000 mon.a (mon.0) 12621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:18:47.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:46 smithi179 bash[23186]: audit 2024-09-21T04:18:46.672902+0000 mon.a (mon.0) 12622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:47.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:46 smithi179 bash[23186]: audit 2024-09-21T04:18:46.679308+0000 mon.a (mon.0) 12623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:18:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:46 smithi049 bash[23528]: audit 2024-09-21T04:18:45.569586+0000 mgr.a (mgr.14388) 15767 : audit [DBG] from='client.340827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:46 smithi049 bash[23528]: cluster 2024-09-21T04:18:45.889929+0000 mgr.a (mgr.14388) 15768 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:18:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:46 smithi049 bash[23528]: audit 2024-09-21T04:18:46.652196+0000 mon.a (mon.0) 12619 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:18:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:46 smithi049 bash[23528]: audit 2024-09-21T04:18:46.659753+0000 mon.a (mon.0) 12620 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:18:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:46 smithi049 bash[23528]: audit 2024-09-21T04:18:46.661645+0000 mon.a (mon.0) 12621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:18:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:46 smithi049 bash[23528]: audit 2024-09-21T04:18:46.672902+0000 mon.a (mon.0) 12622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:46 smithi049 bash[23528]: audit 2024-09-21T04:18:46.679308+0000 mon.a (mon.0) 12623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:18:47.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:18:47 smithi044 bash[22930]: debug 2024-09-21T04:18:47.456+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:18:47.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:18:47 smithi044 bash[22930]: debug 2024-09-21T04:18:47.460+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:18:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:47 smithi044 bash[22676]: audit 2024-09-21T04:18:46.682208+0000 mgr.a (mgr.14388) 15769 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:18:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:47 smithi179 bash[23186]: audit 2024-09-21T04:18:46.682208+0000 mgr.a (mgr.14388) 15769 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:18:48.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:47 smithi049 bash[23528]: audit 2024-09-21T04:18:46.682208+0000 mgr.a (mgr.14388) 15769 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:18:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:48 smithi044 bash[22676]: audit 2024-09-21T04:18:47.459582+0000 mgr.a (mgr.14388) 15770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:18:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:48 smithi044 bash[22676]: cephadm 2024-09-21T04:18:47.461601+0000 mgr.a (mgr.14388) 15771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:18:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:48 smithi044 bash[22676]: cluster 2024-09-21T04:18:47.891003+0000 mgr.a (mgr.14388) 15772 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:48 smithi044 bash[22676]: audit 2024-09-21T04:18:48.445422+0000 mon.a (mon.0) 12624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:48 smithi044 bash[22676]: audit 2024-09-21T04:18:48.453907+0000 mon.a (mon.0) 12625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:48 smithi044 bash[22676]: audit 2024-09-21T04:18:48.465595+0000 mon.a (mon.0) 12626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:48 smithi179 bash[23186]: audit 2024-09-21T04:18:47.459582+0000 mgr.a (mgr.14388) 15770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:18:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:48 smithi179 bash[23186]: cephadm 2024-09-21T04:18:47.461601+0000 mgr.a (mgr.14388) 15771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:18:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:48 smithi179 bash[23186]: cluster 2024-09-21T04:18:47.891003+0000 mgr.a (mgr.14388) 15772 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:48 smithi179 bash[23186]: audit 2024-09-21T04:18:48.445422+0000 mon.a (mon.0) 12624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:48 smithi179 bash[23186]: audit 2024-09-21T04:18:48.453907+0000 mon.a (mon.0) 12625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:48 smithi179 bash[23186]: audit 2024-09-21T04:18:48.465595+0000 mon.a (mon.0) 12626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:48 smithi049 bash[23528]: audit 2024-09-21T04:18:47.459582+0000 mgr.a (mgr.14388) 15770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:18:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:48 smithi049 bash[23528]: cephadm 2024-09-21T04:18:47.461601+0000 mgr.a (mgr.14388) 15771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:18:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:48 smithi049 bash[23528]: cluster 2024-09-21T04:18:47.891003+0000 mgr.a (mgr.14388) 15772 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:18:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:48 smithi049 bash[23528]: audit 2024-09-21T04:18:48.445422+0000 mon.a (mon.0) 12624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:48 smithi049 bash[23528]: audit 2024-09-21T04:18:48.453907+0000 mon.a (mon.0) 12625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:48 smithi049 bash[23528]: audit 2024-09-21T04:18:48.465595+0000 mon.a (mon.0) 12626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:18:51.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:51.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:51.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:50 smithi179 bash[23186]: cluster 2024-09-21T04:18:49.892006+0000 mgr.a (mgr.14388) 15773 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:18:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:50 smithi044 bash[22676]: cluster 2024-09-21T04:18:49.892006+0000 mgr.a (mgr.14388) 15773 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:18:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:50 smithi049 bash[23528]: cluster 2024-09-21T04:18:49.892006+0000 mgr.a (mgr.14388) 15773 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:18:51.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:51.798 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:51.798 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:52 smithi044 bash[22676]: audit 2024-09-21T04:18:51.354642+0000 mgr.a (mgr.14388) 15774 : audit [DBG] from='client.341013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:52 smithi044 bash[22676]: cluster 2024-09-21T04:18:51.895039+0000 mgr.a (mgr.14388) 15775 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:52 smithi179 bash[23186]: audit 2024-09-21T04:18:51.354642+0000 mgr.a (mgr.14388) 15774 : audit [DBG] from='client.341013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:52 smithi179 bash[23186]: cluster 2024-09-21T04:18:51.895039+0000 mgr.a (mgr.14388) 15775 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:52 smithi049 bash[23528]: audit 2024-09-21T04:18:51.354642+0000 mgr.a (mgr.14388) 15774 : audit [DBG] from='client.341013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:52 smithi049 bash[23528]: cluster 2024-09-21T04:18:51.895039+0000 mgr.a (mgr.14388) 15775 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:54 smithi044 bash[22676]: cluster 2024-09-21T04:18:53.895699+0000 mgr.a (mgr.14388) 15776 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:54 smithi179 bash[23186]: cluster 2024-09-21T04:18:53.895699+0000 mgr.a (mgr.14388) 15776 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:55.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:54 smithi049 bash[23528]: cluster 2024-09-21T04:18:53.895699+0000 mgr.a (mgr.14388) 15776 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:18:56.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:18:56.800 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:18:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:56 smithi044 bash[22676]: cluster 2024-09-21T04:18:55.897000+0000 mgr.a (mgr.14388) 15777 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:56 smithi179 bash[23186]: cluster 2024-09-21T04:18:55.897000+0000 mgr.a (mgr.14388) 15777 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:57.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:56 smithi049 bash[23528]: cluster 2024-09-21T04:18:55.897000+0000 mgr.a (mgr.14388) 15777 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:57.566 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:18:57.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:18:57.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:18:57.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:18:57.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:18:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:58 smithi044 bash[22676]: audit 2024-09-21T04:18:57.134413+0000 mgr.a (mgr.14388) 15778 : audit [DBG] from='client.341091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:18:58 smithi044 bash[22676]: cluster 2024-09-21T04:18:57.897956+0000 mgr.a (mgr.14388) 15779 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:58 smithi179 bash[23186]: audit 2024-09-21T04:18:57.134413+0000 mgr.a (mgr.14388) 15778 : audit [DBG] from='client.341091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:18:58 smithi179 bash[23186]: cluster 2024-09-21T04:18:57.897956+0000 mgr.a (mgr.14388) 15779 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:18:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:58 smithi049 bash[23528]: audit 2024-09-21T04:18:57.134413+0000 mgr.a (mgr.14388) 15778 : audit [DBG] from='client.341091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:18:59.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:18:58 smithi049 bash[23528]: cluster 2024-09-21T04:18:57.897956+0000 mgr.a (mgr.14388) 15779 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:00 smithi049 bash[23528]: audit 2024-09-21T04:18:59.289831+0000 mon.a (mon.0) 12627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:00 smithi049 bash[23528]: audit 2024-09-21T04:18:59.295129+0000 mon.a (mon.0) 12628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:00 smithi049 bash[23528]: audit 2024-09-21T04:18:59.303157+0000 mon.a (mon.0) 12629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:00 smithi049 bash[23528]: audit 2024-09-21T04:18:59.753449+0000 mon.a (mon.0) 12630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:00 smithi049 bash[23528]: audit 2024-09-21T04:18:59.761914+0000 mon.a (mon.0) 12631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:00 smithi049 bash[23528]: audit 2024-09-21T04:18:59.772029+0000 mon.a (mon.0) 12632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:00 smithi049 bash[23528]: cluster 2024-09-21T04:18:59.898767+0000 mgr.a (mgr.14388) 15780 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:00.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:00 smithi044 bash[22676]: audit 2024-09-21T04:18:59.289831+0000 mon.a (mon.0) 12627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:00 smithi044 bash[22676]: audit 2024-09-21T04:18:59.295129+0000 mon.a (mon.0) 12628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:00 smithi044 bash[22676]: audit 2024-09-21T04:18:59.303157+0000 mon.a (mon.0) 12629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:00 smithi044 bash[22676]: audit 2024-09-21T04:18:59.753449+0000 mon.a (mon.0) 12630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:00 smithi044 bash[22676]: audit 2024-09-21T04:18:59.761914+0000 mon.a (mon.0) 12631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:00 smithi044 bash[22676]: audit 2024-09-21T04:18:59.772029+0000 mon.a (mon.0) 12632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:00 smithi044 bash[22676]: cluster 2024-09-21T04:18:59.898767+0000 mgr.a (mgr.14388) 15780 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:00 smithi179 bash[23186]: audit 2024-09-21T04:18:59.289831+0000 mon.a (mon.0) 12627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:00 smithi179 bash[23186]: audit 2024-09-21T04:18:59.295129+0000 mon.a (mon.0) 12628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:00 smithi179 bash[23186]: audit 2024-09-21T04:18:59.303157+0000 mon.a (mon.0) 12629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:00 smithi179 bash[23186]: audit 2024-09-21T04:18:59.753449+0000 mon.a (mon.0) 12630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:00 smithi179 bash[23186]: audit 2024-09-21T04:18:59.761914+0000 mon.a (mon.0) 12631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:00 smithi179 bash[23186]: audit 2024-09-21T04:18:59.772029+0000 mon.a (mon.0) 12632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:00 smithi179 bash[23186]: cluster 2024-09-21T04:18:59.898767+0000 mgr.a (mgr.14388) 15780 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:02.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:02.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:02.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:03.224 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:02 smithi049 bash[23528]: cluster 2024-09-21T04:19:01.900983+0000 mgr.a (mgr.14388) 15781 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:02 smithi044 bash[22676]: cluster 2024-09-21T04:19:01.900983+0000 mgr.a (mgr.14388) 15781 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:02 smithi179 bash[23186]: cluster 2024-09-21T04:19:01.900983+0000 mgr.a (mgr.14388) 15781 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:03.357 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:03.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:03.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:03.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:03.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:03 smithi044 bash[22676]: audit 2024-09-21T04:19:02.902326+0000 mgr.a (mgr.14388) 15782 : audit [DBG] from='client.341166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:03 smithi179 bash[23186]: audit 2024-09-21T04:19:02.902326+0000 mgr.a (mgr.14388) 15782 : audit [DBG] from='client.341166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:04.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:03 smithi049 bash[23528]: audit 2024-09-21T04:19:02.902326+0000 mgr.a (mgr.14388) 15782 : audit [DBG] from='client.341166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:05.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:04 smithi044 bash[22676]: cluster 2024-09-21T04:19:03.902160+0000 mgr.a (mgr.14388) 15783 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:04 smithi179 bash[23186]: cluster 2024-09-21T04:19:03.902160+0000 mgr.a (mgr.14388) 15783 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:05.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:04 smithi049 bash[23528]: cluster 2024-09-21T04:19:03.902160+0000 mgr.a (mgr.14388) 15783 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:06 smithi044 bash[22676]: cluster 2024-09-21T04:19:05.904549+0000 mgr.a (mgr.14388) 15784 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:06 smithi179 bash[23186]: cluster 2024-09-21T04:19:05.904549+0000 mgr.a (mgr.14388) 15784 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:06 smithi049 bash[23528]: cluster 2024-09-21T04:19:05.904549+0000 mgr.a (mgr.14388) 15784 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:08.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:09.171 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:09.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:09.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:09.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:09.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:08 smithi044 bash[22676]: cluster 2024-09-21T04:19:07.905541+0000 mgr.a (mgr.14388) 15785 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:08 smithi044 bash[22676]: audit 2024-09-21T04:19:08.643914+0000 mon.a (mon.0) 12633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:08 smithi044 bash[22676]: audit 2024-09-21T04:19:08.652231+0000 mon.a (mon.0) 12634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:08 smithi044 bash[22676]: audit 2024-09-21T04:19:08.661440+0000 mon.a (mon.0) 12635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:08 smithi179 bash[23186]: cluster 2024-09-21T04:19:07.905541+0000 mgr.a (mgr.14388) 15785 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:08 smithi179 bash[23186]: audit 2024-09-21T04:19:08.643914+0000 mon.a (mon.0) 12633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:08 smithi179 bash[23186]: audit 2024-09-21T04:19:08.652231+0000 mon.a (mon.0) 12634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:08 smithi179 bash[23186]: audit 2024-09-21T04:19:08.661440+0000 mon.a (mon.0) 12635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:08 smithi049 bash[23528]: cluster 2024-09-21T04:19:07.905541+0000 mgr.a (mgr.14388) 15785 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:08 smithi049 bash[23528]: audit 2024-09-21T04:19:08.643914+0000 mon.a (mon.0) 12633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:08 smithi049 bash[23528]: audit 2024-09-21T04:19:08.652231+0000 mon.a (mon.0) 12634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:08 smithi049 bash[23528]: audit 2024-09-21T04:19:08.661440+0000 mon.a (mon.0) 12635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:09 smithi044 bash[22676]: audit 2024-09-21T04:19:08.707566+0000 mgr.a (mgr.14388) 15786 : audit [DBG] from='client.341244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:09 smithi179 bash[23186]: audit 2024-09-21T04:19:08.707566+0000 mgr.a (mgr.14388) 15786 : audit [DBG] from='client.341244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:09 smithi049 bash[23528]: audit 2024-09-21T04:19:08.707566+0000 mgr.a (mgr.14388) 15786 : audit [DBG] from='client.341244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:10 smithi179 bash[23186]: cluster 2024-09-21T04:19:09.906567+0000 mgr.a (mgr.14388) 15787 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:10 smithi049 bash[23528]: cluster 2024-09-21T04:19:09.906567+0000 mgr.a (mgr.14388) 15787 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:10 smithi044 bash[22676]: cluster 2024-09-21T04:19:09.906567+0000 mgr.a (mgr.14388) 15787 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:12 smithi179 bash[23186]: cluster 2024-09-21T04:19:11.908815+0000 mgr.a (mgr.14388) 15788 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:12 smithi049 bash[23528]: cluster 2024-09-21T04:19:11.908815+0000 mgr.a (mgr.14388) 15788 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:12 smithi044 bash[22676]: cluster 2024-09-21T04:19:11.908815+0000 mgr.a (mgr.14388) 15788 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:14.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:14.929 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:14.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:15 smithi044 bash[22676]: cluster 2024-09-21T04:19:13.909616+0000 mgr.a (mgr.14388) 15789 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:15 smithi179 bash[23186]: cluster 2024-09-21T04:19:13.909616+0000 mgr.a (mgr.14388) 15789 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:15.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:15 smithi049 bash[23528]: cluster 2024-09-21T04:19:13.909616+0000 mgr.a (mgr.14388) 15789 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:16 smithi044 bash[22676]: audit 2024-09-21T04:19:14.489824+0000 mgr.a (mgr.14388) 15790 : audit [DBG] from='client.341319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:16.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:16 smithi049 bash[23528]: audit 2024-09-21T04:19:14.489824+0000 mgr.a (mgr.14388) 15790 : audit [DBG] from='client.341319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:16 smithi179 bash[23186]: audit 2024-09-21T04:19:14.489824+0000 mgr.a (mgr.14388) 15790 : audit [DBG] from='client.341319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:17 smithi049 bash[23528]: cluster 2024-09-21T04:19:15.910870+0000 mgr.a (mgr.14388) 15791 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:17.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:17 smithi044 bash[22676]: cluster 2024-09-21T04:19:15.910870+0000 mgr.a (mgr.14388) 15791 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:17 smithi179 bash[23186]: cluster 2024-09-21T04:19:15.910870+0000 mgr.a (mgr.14388) 15791 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:19 smithi049 bash[23528]: cluster 2024-09-21T04:19:17.911601+0000 mgr.a (mgr.14388) 15792 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:19.462 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:19 smithi044 bash[22676]: cluster 2024-09-21T04:19:17.911601+0000 mgr.a (mgr.14388) 15792 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:19 smithi179 bash[23186]: cluster 2024-09-21T04:19:17.911601+0000 mgr.a (mgr.14388) 15792 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:19.931 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:19.931 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:19.932 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:20.701 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:20.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:20.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:20.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:20.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:20 smithi044 bash[22676]: audit 2024-09-21T04:19:19.472009+0000 mon.a (mon.0) 12636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:20 smithi044 bash[22676]: audit 2024-09-21T04:19:19.477224+0000 mon.a (mon.0) 12637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:20 smithi044 bash[22676]: audit 2024-09-21T04:19:19.482645+0000 mon.a (mon.0) 12638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:20 smithi044 bash[22676]: cluster 2024-09-21T04:19:19.912380+0000 mgr.a (mgr.14388) 15793 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:20 smithi044 bash[22676]: audit 2024-09-21T04:19:19.975068+0000 mon.a (mon.0) 12639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:20 smithi044 bash[22676]: audit 2024-09-21T04:19:19.983670+0000 mon.a (mon.0) 12640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:20 smithi044 bash[22676]: audit 2024-09-21T04:19:19.994702+0000 mon.a (mon.0) 12641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:20 smithi179 bash[23186]: audit 2024-09-21T04:19:19.472009+0000 mon.a (mon.0) 12636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:20 smithi179 bash[23186]: audit 2024-09-21T04:19:19.477224+0000 mon.a (mon.0) 12637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:20 smithi179 bash[23186]: audit 2024-09-21T04:19:19.482645+0000 mon.a (mon.0) 12638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:20 smithi179 bash[23186]: cluster 2024-09-21T04:19:19.912380+0000 mgr.a (mgr.14388) 15793 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:20 smithi179 bash[23186]: audit 2024-09-21T04:19:19.975068+0000 mon.a (mon.0) 12639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:20 smithi179 bash[23186]: audit 2024-09-21T04:19:19.983670+0000 mon.a (mon.0) 12640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:20 smithi179 bash[23186]: audit 2024-09-21T04:19:19.994702+0000 mon.a (mon.0) 12641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:20 smithi049 bash[23528]: audit 2024-09-21T04:19:19.472009+0000 mon.a (mon.0) 12636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:20 smithi049 bash[23528]: audit 2024-09-21T04:19:19.477224+0000 mon.a (mon.0) 12637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:20 smithi049 bash[23528]: audit 2024-09-21T04:19:19.482645+0000 mon.a (mon.0) 12638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:20 smithi049 bash[23528]: cluster 2024-09-21T04:19:19.912380+0000 mgr.a (mgr.14388) 15793 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:20 smithi049 bash[23528]: audit 2024-09-21T04:19:19.975068+0000 mon.a (mon.0) 12639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:20 smithi049 bash[23528]: audit 2024-09-21T04:19:19.983670+0000 mon.a (mon.0) 12640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:20 smithi049 bash[23528]: audit 2024-09-21T04:19:19.994702+0000 mon.a (mon.0) 12641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:21 smithi044 bash[22676]: audit 2024-09-21T04:19:20.273040+0000 mgr.a (mgr.14388) 15794 : audit [DBG] from='client.341397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:21 smithi179 bash[23186]: audit 2024-09-21T04:19:20.273040+0000 mgr.a (mgr.14388) 15794 : audit [DBG] from='client.341397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:21.772 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:21 smithi049 bash[23528]: audit 2024-09-21T04:19:20.273040+0000 mgr.a (mgr.14388) 15794 : audit [DBG] from='client.341397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:22.746 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:22 smithi049 bash[23528]: cluster 2024-09-21T04:19:21.915304+0000 mgr.a (mgr.14388) 15795 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:22 smithi179 bash[23186]: cluster 2024-09-21T04:19:21.915304+0000 mgr.a (mgr.14388) 15795 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:22 smithi044 bash[22676]: cluster 2024-09-21T04:19:21.915304+0000 mgr.a (mgr.14388) 15795 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:24 smithi044 bash[22676]: cluster 2024-09-21T04:19:23.916078+0000 mgr.a (mgr.14388) 15796 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:19:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:24 smithi179 bash[23186]: cluster 2024-09-21T04:19:23.916078+0000 mgr.a (mgr.14388) 15796 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:19:25.266 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:24 smithi049 bash[23528]: cluster 2024-09-21T04:19:23.916078+0000 mgr.a (mgr.14388) 15796 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:19:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:26.490 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:26 smithi044 bash[22676]: cluster 2024-09-21T04:19:25.918065+0000 mgr.a (mgr.14388) 15797 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:26 smithi044 bash[22676]: audit 2024-09-21T04:19:26.036688+0000 mgr.a (mgr.14388) 15798 : audit [DBG] from='client.341475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:26 smithi179 bash[23186]: cluster 2024-09-21T04:19:25.918065+0000 mgr.a (mgr.14388) 15797 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:26 smithi179 bash[23186]: audit 2024-09-21T04:19:26.036688+0000 mgr.a (mgr.14388) 15798 : audit [DBG] from='client.341475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:27.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:26 smithi049 bash[23528]: cluster 2024-09-21T04:19:25.918065+0000 mgr.a (mgr.14388) 15797 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:26 smithi049 bash[23528]: audit 2024-09-21T04:19:26.036688+0000 mgr.a (mgr.14388) 15798 : audit [DBG] from='client.341475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:28 smithi044 bash[22676]: cluster 2024-09-21T04:19:27.918973+0000 mgr.a (mgr.14388) 15799 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:28 smithi044 bash[22676]: audit 2024-09-21T04:19:28.875128+0000 mon.a (mon.0) 12642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:28 smithi044 bash[22676]: audit 2024-09-21T04:19:28.884317+0000 mon.a (mon.0) 12643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:28 smithi044 bash[22676]: audit 2024-09-21T04:19:28.896071+0000 mon.a (mon.0) 12644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:28 smithi179 bash[23186]: cluster 2024-09-21T04:19:27.918973+0000 mgr.a (mgr.14388) 15799 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:19:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:28 smithi179 bash[23186]: audit 2024-09-21T04:19:28.875128+0000 mon.a (mon.0) 12642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:28 smithi179 bash[23186]: audit 2024-09-21T04:19:28.884317+0000 mon.a (mon.0) 12643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:28 smithi179 bash[23186]: audit 2024-09-21T04:19:28.896071+0000 mon.a (mon.0) 12644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:28 smithi049 bash[23528]: cluster 2024-09-21T04:19:27.918973+0000 mgr.a (mgr.14388) 15799 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:19:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:28 smithi049 bash[23528]: audit 2024-09-21T04:19:28.875128+0000 mon.a (mon.0) 12642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:28 smithi049 bash[23528]: audit 2024-09-21T04:19:28.884317+0000 mon.a (mon.0) 12643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:28 smithi049 bash[23528]: audit 2024-09-21T04:19:28.896071+0000 mon.a (mon.0) 12644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:30 smithi044 bash[22676]: cluster 2024-09-21T04:19:29.919711+0000 mgr.a (mgr.14388) 15800 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:19:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:30 smithi179 bash[23186]: cluster 2024-09-21T04:19:29.919711+0000 mgr.a (mgr.14388) 15800 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:19:31.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:30 smithi049 bash[23528]: cluster 2024-09-21T04:19:29.919711+0000 mgr.a (mgr.14388) 15800 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:19:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:31.492 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:32.277 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:32.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:32.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:32.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:32.278 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:32 smithi179 bash[23186]: audit 2024-09-21T04:19:31.824960+0000 mgr.a (mgr.14388) 15801 : audit [DBG] from='client.341547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:32 smithi179 bash[23186]: cluster 2024-09-21T04:19:31.921565+0000 mgr.a (mgr.14388) 15802 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:33.285 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:32 smithi044 bash[22676]: audit 2024-09-21T04:19:31.824960+0000 mgr.a (mgr.14388) 15801 : audit [DBG] from='client.341547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:33.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:32 smithi044 bash[22676]: cluster 2024-09-21T04:19:31.921565+0000 mgr.a (mgr.14388) 15802 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:32 smithi049 bash[23528]: audit 2024-09-21T04:19:31.824960+0000 mgr.a (mgr.14388) 15801 : audit [DBG] from='client.341547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:33.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:32 smithi049 bash[23528]: cluster 2024-09-21T04:19:31.921565+0000 mgr.a (mgr.14388) 15802 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:34 smithi179 bash[23186]: cluster 2024-09-21T04:19:33.922456+0000 mgr.a (mgr.14388) 15803 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:35.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:34 smithi049 bash[23528]: cluster 2024-09-21T04:19:33.922456+0000 mgr.a (mgr.14388) 15803 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:34 smithi044 bash[22676]: cluster 2024-09-21T04:19:33.922456+0000 mgr.a (mgr.14388) 15803 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:36 smithi044 bash[22676]: cluster 2024-09-21T04:19:35.924738+0000 mgr.a (mgr.14388) 15804 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:36 smithi179 bash[23186]: cluster 2024-09-21T04:19:35.924738+0000 mgr.a (mgr.14388) 15804 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:37.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:37.279 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:37.279 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:37.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:37 smithi049 bash[23528]: cluster 2024-09-21T04:19:35.924738+0000 mgr.a (mgr.14388) 15804 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:38.029 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:38.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:38.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:38.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:38.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:39 smithi049 bash[23528]: audit 2024-09-21T04:19:37.608371+0000 mgr.a (mgr.14388) 15805 : audit [DBG] from='client.341625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:39 smithi049 bash[23528]: cluster 2024-09-21T04:19:37.930942+0000 mgr.a (mgr.14388) 15806 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:39 smithi044 bash[22676]: audit 2024-09-21T04:19:37.608371+0000 mgr.a (mgr.14388) 15805 : audit [DBG] from='client.341625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:39 smithi044 bash[22676]: cluster 2024-09-21T04:19:37.930942+0000 mgr.a (mgr.14388) 15806 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:39 smithi179 bash[23186]: audit 2024-09-21T04:19:37.608371+0000 mgr.a (mgr.14388) 15805 : audit [DBG] from='client.341625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:39 smithi179 bash[23186]: cluster 2024-09-21T04:19:37.930942+0000 mgr.a (mgr.14388) 15806 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:40 smithi044 bash[22676]: audit 2024-09-21T04:19:39.672487+0000 mon.a (mon.0) 12645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:40 smithi044 bash[22676]: audit 2024-09-21T04:19:39.680090+0000 mon.a (mon.0) 12646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:40 smithi044 bash[22676]: audit 2024-09-21T04:19:39.690587+0000 mon.a (mon.0) 12647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:40 smithi044 bash[22676]: cluster 2024-09-21T04:19:39.931700+0000 mgr.a (mgr.14388) 15807 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:40 smithi044 bash[22676]: audit 2024-09-21T04:19:40.208803+0000 mon.a (mon.0) 12648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:40 smithi044 bash[22676]: audit 2024-09-21T04:19:40.217558+0000 mon.a (mon.0) 12649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:40 smithi044 bash[22676]: audit 2024-09-21T04:19:40.227779+0000 mon.a (mon.0) 12650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:40 smithi179 bash[23186]: audit 2024-09-21T04:19:39.672487+0000 mon.a (mon.0) 12645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:40 smithi179 bash[23186]: audit 2024-09-21T04:19:39.680090+0000 mon.a (mon.0) 12646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:40 smithi179 bash[23186]: audit 2024-09-21T04:19:39.690587+0000 mon.a (mon.0) 12647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:40 smithi179 bash[23186]: cluster 2024-09-21T04:19:39.931700+0000 mgr.a (mgr.14388) 15807 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:40 smithi179 bash[23186]: audit 2024-09-21T04:19:40.208803+0000 mon.a (mon.0) 12648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:40 smithi179 bash[23186]: audit 2024-09-21T04:19:40.217558+0000 mon.a (mon.0) 12649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:40 smithi179 bash[23186]: audit 2024-09-21T04:19:40.227779+0000 mon.a (mon.0) 12650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:40 smithi049 bash[23528]: audit 2024-09-21T04:19:39.672487+0000 mon.a (mon.0) 12645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:40 smithi049 bash[23528]: audit 2024-09-21T04:19:39.680090+0000 mon.a (mon.0) 12646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:40 smithi049 bash[23528]: audit 2024-09-21T04:19:39.690587+0000 mon.a (mon.0) 12647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:40 smithi049 bash[23528]: cluster 2024-09-21T04:19:39.931700+0000 mgr.a (mgr.14388) 15807 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:40 smithi049 bash[23528]: audit 2024-09-21T04:19:40.208803+0000 mon.a (mon.0) 12648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:40 smithi049 bash[23528]: audit 2024-09-21T04:19:40.217558+0000 mon.a (mon.0) 12649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:40 smithi049 bash[23528]: audit 2024-09-21T04:19:40.227779+0000 mon.a (mon.0) 12650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:42 smithi179 bash[23186]: cluster 2024-09-21T04:19:41.933945+0000 mgr.a (mgr.14388) 15808 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:43.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:42 smithi049 bash[23528]: cluster 2024-09-21T04:19:41.933945+0000 mgr.a (mgr.14388) 15808 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:42 smithi044 bash[22676]: cluster 2024-09-21T04:19:41.933945+0000 mgr.a (mgr.14388) 15808 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:43.771 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:43.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:43.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:43.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:43.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:44 smithi179 bash[23186]: audit 2024-09-21T04:19:43.358528+0000 mgr.a (mgr.14388) 15809 : audit [DBG] from='client.341703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:44 smithi179 bash[23186]: cluster 2024-09-21T04:19:43.934892+0000 mgr.a (mgr.14388) 15810 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:44 smithi049 bash[23528]: audit 2024-09-21T04:19:43.358528+0000 mgr.a (mgr.14388) 15809 : audit [DBG] from='client.341703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:45.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:44 smithi049 bash[23528]: cluster 2024-09-21T04:19:43.934892+0000 mgr.a (mgr.14388) 15810 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:44 smithi044 bash[22676]: audit 2024-09-21T04:19:43.358528+0000 mgr.a (mgr.14388) 15809 : audit [DBG] from='client.341703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:44 smithi044 bash[22676]: cluster 2024-09-21T04:19:43.934892+0000 mgr.a (mgr.14388) 15810 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:47 smithi179 bash[23186]: cluster 2024-09-21T04:19:45.937151+0000 mgr.a (mgr.14388) 15811 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:47 smithi049 bash[23528]: cluster 2024-09-21T04:19:45.937151+0000 mgr.a (mgr.14388) 15811 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:46 smithi044 bash[22676]: cluster 2024-09-21T04:19:45.937151+0000 mgr.a (mgr.14388) 15811 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:19:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:48 smithi179 bash[23186]: audit 2024-09-21T04:19:47.541484+0000 mon.a (mon.0) 12651 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:19:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:48 smithi179 bash[23186]: audit 2024-09-21T04:19:47.548178+0000 mon.a (mon.0) 12652 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:19:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:48 smithi179 bash[23186]: audit 2024-09-21T04:19:47.550159+0000 mon.a (mon.0) 12653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:19:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:48 smithi179 bash[23186]: audit 2024-09-21T04:19:47.561580+0000 mon.a (mon.0) 12654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:48 smithi179 bash[23186]: audit 2024-09-21T04:19:47.567970+0000 mon.a (mon.0) 12655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:19:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:48 smithi049 bash[23528]: audit 2024-09-21T04:19:47.541484+0000 mon.a (mon.0) 12651 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:19:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:48 smithi049 bash[23528]: audit 2024-09-21T04:19:47.548178+0000 mon.a (mon.0) 12652 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:19:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:48 smithi049 bash[23528]: audit 2024-09-21T04:19:47.550159+0000 mon.a (mon.0) 12653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:19:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:48 smithi049 bash[23528]: audit 2024-09-21T04:19:47.561580+0000 mon.a (mon.0) 12654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:48 smithi049 bash[23528]: audit 2024-09-21T04:19:47.567970+0000 mon.a (mon.0) 12655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:19:48.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:48 smithi044 bash[22676]: audit 2024-09-21T04:19:47.541484+0000 mon.a (mon.0) 12651 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:19:48.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:48 smithi044 bash[22676]: audit 2024-09-21T04:19:47.548178+0000 mon.a (mon.0) 12652 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:19:48.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:48 smithi044 bash[22676]: audit 2024-09-21T04:19:47.550159+0000 mon.a (mon.0) 12653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:19:48.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:48 smithi044 bash[22676]: audit 2024-09-21T04:19:47.561580+0000 mon.a (mon.0) 12654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:48.360 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:48 smithi044 bash[22676]: audit 2024-09-21T04:19:47.567970+0000 mon.a (mon.0) 12655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:19:48.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:19:48 smithi044 bash[22930]: debug 2024-09-21T04:19:48.355+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:19:48.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:19:48 smithi044 bash[22930]: debug 2024-09-21T04:19:48.355+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:19:48.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:48.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:48.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:49 smithi049 bash[23528]: audit 2024-09-21T04:19:47.570478+0000 mgr.a (mgr.14388) 15812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:19:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:49 smithi049 bash[23528]: cluster 2024-09-21T04:19:47.937778+0000 mgr.a (mgr.14388) 15813 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:49 smithi044 bash[22676]: audit 2024-09-21T04:19:47.570478+0000 mgr.a (mgr.14388) 15812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:19:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:49 smithi044 bash[22676]: cluster 2024-09-21T04:19:47.937778+0000 mgr.a (mgr.14388) 15813 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:49 smithi179 bash[23186]: audit 2024-09-21T04:19:47.570478+0000 mgr.a (mgr.14388) 15812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:19:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:49 smithi179 bash[23186]: cluster 2024-09-21T04:19:47.937778+0000 mgr.a (mgr.14388) 15813 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:49.556 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:49.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:49.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:50 smithi049 bash[23528]: audit 2024-09-21T04:19:48.357463+0000 mgr.a (mgr.14388) 15814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:19:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:50 smithi049 bash[23528]: cephadm 2024-09-21T04:19:48.359533+0000 mgr.a (mgr.14388) 15815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:19:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:50 smithi049 bash[23528]: audit 2024-09-21T04:19:49.108976+0000 mon.a (mon.0) 12656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:50 smithi049 bash[23528]: audit 2024-09-21T04:19:49.114101+0000 mon.a (mon.0) 12657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:50 smithi049 bash[23528]: audit 2024-09-21T04:19:49.140074+0000 mon.a (mon.0) 12658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:50 smithi044 bash[22676]: audit 2024-09-21T04:19:48.357463+0000 mgr.a (mgr.14388) 15814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:19:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:50 smithi044 bash[22676]: cephadm 2024-09-21T04:19:48.359533+0000 mgr.a (mgr.14388) 15815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:19:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:50 smithi044 bash[22676]: audit 2024-09-21T04:19:49.108976+0000 mon.a (mon.0) 12656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:50 smithi044 bash[22676]: audit 2024-09-21T04:19:49.114101+0000 mon.a (mon.0) 12657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:50 smithi044 bash[22676]: audit 2024-09-21T04:19:49.140074+0000 mon.a (mon.0) 12658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:50 smithi179 bash[23186]: audit 2024-09-21T04:19:48.357463+0000 mgr.a (mgr.14388) 15814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:19:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:50 smithi179 bash[23186]: cephadm 2024-09-21T04:19:48.359533+0000 mgr.a (mgr.14388) 15815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:19:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:50 smithi179 bash[23186]: audit 2024-09-21T04:19:49.108976+0000 mon.a (mon.0) 12656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:50 smithi179 bash[23186]: audit 2024-09-21T04:19:49.114101+0000 mon.a (mon.0) 12657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:50 smithi179 bash[23186]: audit 2024-09-21T04:19:49.140074+0000 mon.a (mon.0) 12658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:19:51.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:51 smithi049 bash[23528]: audit 2024-09-21T04:19:49.111554+0000 mgr.a (mgr.14388) 15816 : audit [DBG] from='client.341883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:51.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:51 smithi049 bash[23528]: cluster 2024-09-21T04:19:49.938834+0000 mgr.a (mgr.14388) 15817 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:51 smithi044 bash[22676]: audit 2024-09-21T04:19:49.111554+0000 mgr.a (mgr.14388) 15816 : audit [DBG] from='client.341883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:51 smithi044 bash[22676]: cluster 2024-09-21T04:19:49.938834+0000 mgr.a (mgr.14388) 15817 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:51.495 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:51 smithi179 bash[23186]: audit 2024-09-21T04:19:49.111554+0000 mgr.a (mgr.14388) 15816 : audit [DBG] from='client.341883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:51.495 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:51 smithi179 bash[23186]: cluster 2024-09-21T04:19:49.938834+0000 mgr.a (mgr.14388) 15817 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:19:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:53 smithi049 bash[23528]: cluster 2024-09-21T04:19:51.941133+0000 mgr.a (mgr.14388) 15818 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:53.474 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:53 smithi179 bash[23186]: cluster 2024-09-21T04:19:51.941133+0000 mgr.a (mgr.14388) 15818 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:53 smithi044 bash[22676]: cluster 2024-09-21T04:19:51.941133+0000 mgr.a (mgr.14388) 15818 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:54.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:19:54.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:19:54.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:19:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:55 smithi179 bash[23186]: cluster 2024-09-21T04:19:53.941946+0000 mgr.a (mgr.14388) 15819 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:55.280 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:55 smithi044 bash[22676]: cluster 2024-09-21T04:19:53.941946+0000 mgr.a (mgr.14388) 15819 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:55.292 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:19:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:19:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:19:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:19:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:19:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:55 smithi049 bash[23528]: cluster 2024-09-21T04:19:53.941946+0000 mgr.a (mgr.14388) 15819 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:56 smithi049 bash[23528]: audit 2024-09-21T04:19:54.873016+0000 mgr.a (mgr.14388) 15820 : audit [DBG] from='client.341958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:56 smithi044 bash[22676]: audit 2024-09-21T04:19:54.873016+0000 mgr.a (mgr.14388) 15820 : audit [DBG] from='client.341958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:56 smithi179 bash[23186]: audit 2024-09-21T04:19:54.873016+0000 mgr.a (mgr.14388) 15820 : audit [DBG] from='client.341958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:19:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:57 smithi044 bash[22676]: cluster 2024-09-21T04:19:55.944588+0000 mgr.a (mgr.14388) 15821 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:57 smithi049 bash[23528]: cluster 2024-09-21T04:19:55.944588+0000 mgr.a (mgr.14388) 15821 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:57 smithi179 bash[23186]: cluster 2024-09-21T04:19:55.944588+0000 mgr.a (mgr.14388) 15821 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:19:59.288 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:19:59 smithi179 bash[23186]: cluster 2024-09-21T04:19:57.945456+0000 mgr.a (mgr.14388) 15822 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:19:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:19:59 smithi049 bash[23528]: cluster 2024-09-21T04:19:57.945456+0000 mgr.a (mgr.14388) 15822 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:19:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:19:59 smithi044 bash[22676]: cluster 2024-09-21T04:19:57.945456+0000 mgr.a (mgr.14388) 15822 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:20:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:00.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: audit 2024-09-21T04:19:59.907595+0000 mon.a (mon.0) 12659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: audit 2024-09-21T04:19:59.917054+0000 mon.a (mon.0) 12660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: audit 2024-09-21T04:19:59.929119+0000 mon.a (mon.0) 12661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: cluster 2024-09-21T04:19:59.946348+0000 mgr.a (mgr.14388) 15823 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:20:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: cluster 2024-09-21T04:20:00.000153+0000 mon.a (mon.0) 12662 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:20:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: audit 2024-09-21T04:20:00.422451+0000 mon.a (mon.0) 12663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: audit 2024-09-21T04:20:00.429212+0000 mon.a (mon.0) 12664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:00 smithi044 bash[22676]: audit 2024-09-21T04:20:00.437899+0000 mon.a (mon.0) 12665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:01.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:01.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: audit 2024-09-21T04:19:59.907595+0000 mon.a (mon.0) 12659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: audit 2024-09-21T04:19:59.917054+0000 mon.a (mon.0) 12660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: audit 2024-09-21T04:19:59.929119+0000 mon.a (mon.0) 12661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: cluster 2024-09-21T04:19:59.946348+0000 mgr.a (mgr.14388) 15823 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:20:01.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: cluster 2024-09-21T04:20:00.000153+0000 mon.a (mon.0) 12662 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:20:01.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: audit 2024-09-21T04:20:00.422451+0000 mon.a (mon.0) 12663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: audit 2024-09-21T04:20:00.429212+0000 mon.a (mon.0) 12664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:00 smithi179 bash[23186]: audit 2024-09-21T04:20:00.437899+0000 mon.a (mon.0) 12665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: audit 2024-09-21T04:19:59.907595+0000 mon.a (mon.0) 12659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: audit 2024-09-21T04:19:59.917054+0000 mon.a (mon.0) 12660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: audit 2024-09-21T04:19:59.929119+0000 mon.a (mon.0) 12661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: cluster 2024-09-21T04:19:59.946348+0000 mgr.a (mgr.14388) 15823 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: cluster 2024-09-21T04:20:00.000153+0000 mon.a (mon.0) 12662 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: audit 2024-09-21T04:20:00.422451+0000 mon.a (mon.0) 12663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: audit 2024-09-21T04:20:00.429212+0000 mon.a (mon.0) 12664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:00 smithi049 bash[23528]: audit 2024-09-21T04:20:00.437899+0000 mon.a (mon.0) 12665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:01 smithi044 bash[22676]: audit 2024-09-21T04:20:00.631941+0000 mgr.a (mgr.14388) 15824 : audit [DBG] from='client.342036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:01 smithi179 bash[23186]: audit 2024-09-21T04:20:00.631941+0000 mgr.a (mgr.14388) 15824 : audit [DBG] from='client.342036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:01 smithi049 bash[23528]: audit 2024-09-21T04:20:00.631941+0000 mgr.a (mgr.14388) 15824 : audit [DBG] from='client.342036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:02 smithi044 bash[22676]: cluster 2024-09-21T04:20:01.949311+0000 mgr.a (mgr.14388) 15825 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:02 smithi179 bash[23186]: cluster 2024-09-21T04:20:01.949311+0000 mgr.a (mgr.14388) 15825 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:03.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:02 smithi049 bash[23528]: cluster 2024-09-21T04:20:01.949311+0000 mgr.a (mgr.14388) 15825 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:05 smithi049 bash[23528]: cluster 2024-09-21T04:20:03.950076+0000 mgr.a (mgr.14388) 15826 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:05 smithi044 bash[22676]: cluster 2024-09-21T04:20:03.950076+0000 mgr.a (mgr.14388) 15826 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:05 smithi179 bash[23186]: cluster 2024-09-21T04:20:03.950076+0000 mgr.a (mgr.14388) 15826 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:06 smithi049 bash[23528]: cluster 2024-09-21T04:20:05.952104+0000 mgr.a (mgr.14388) 15827 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:06 smithi044 bash[22676]: cluster 2024-09-21T04:20:05.952104+0000 mgr.a (mgr.14388) 15827 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:06 smithi179 bash[23186]: cluster 2024-09-21T04:20:05.952104+0000 mgr.a (mgr.14388) 15827 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:06.848 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:06.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:06.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:06.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:06.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:07 smithi044 bash[22676]: audit 2024-09-21T04:20:06.412289+0000 mgr.a (mgr.14388) 15828 : audit [DBG] from='client.342114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:07 smithi179 bash[23186]: audit 2024-09-21T04:20:06.412289+0000 mgr.a (mgr.14388) 15828 : audit [DBG] from='client.342114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:07.803 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:07 smithi049 bash[23528]: audit 2024-09-21T04:20:06.412289+0000 mgr.a (mgr.14388) 15828 : audit [DBG] from='client.342114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:08 smithi044 bash[22676]: cluster 2024-09-21T04:20:07.953016+0000 mgr.a (mgr.14388) 15829 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:08 smithi179 bash[23186]: cluster 2024-09-21T04:20:07.953016+0000 mgr.a (mgr.14388) 15829 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:08 smithi049 bash[23528]: cluster 2024-09-21T04:20:07.953016+0000 mgr.a (mgr.14388) 15829 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:10 smithi044 bash[22676]: audit 2024-09-21T04:20:09.356846+0000 mon.a (mon.0) 12666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:10 smithi044 bash[22676]: audit 2024-09-21T04:20:09.365629+0000 mon.a (mon.0) 12667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:10 smithi044 bash[22676]: audit 2024-09-21T04:20:09.376215+0000 mon.a (mon.0) 12668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:10 smithi044 bash[22676]: cluster 2024-09-21T04:20:09.953813+0000 mgr.a (mgr.14388) 15830 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:10 smithi179 bash[23186]: audit 2024-09-21T04:20:09.356846+0000 mon.a (mon.0) 12666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:10 smithi179 bash[23186]: audit 2024-09-21T04:20:09.365629+0000 mon.a (mon.0) 12667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:10 smithi179 bash[23186]: audit 2024-09-21T04:20:09.376215+0000 mon.a (mon.0) 12668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:10 smithi179 bash[23186]: cluster 2024-09-21T04:20:09.953813+0000 mgr.a (mgr.14388) 15830 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:10 smithi049 bash[23528]: audit 2024-09-21T04:20:09.356846+0000 mon.a (mon.0) 12666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:10 smithi049 bash[23528]: audit 2024-09-21T04:20:09.365629+0000 mon.a (mon.0) 12667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:10 smithi049 bash[23528]: audit 2024-09-21T04:20:09.376215+0000 mon.a (mon.0) 12668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:10 smithi049 bash[23528]: cluster 2024-09-21T04:20:09.953813+0000 mgr.a (mgr.14388) 15830 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:12.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:12.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:12.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:12.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:12.622 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:13.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:13 smithi179 bash[23186]: cluster 2024-09-21T04:20:11.954851+0000 mgr.a (mgr.14388) 15831 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:13 smithi049 bash[23528]: cluster 2024-09-21T04:20:11.954851+0000 mgr.a (mgr.14388) 15831 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:13 smithi044 bash[22676]: cluster 2024-09-21T04:20:11.954851+0000 mgr.a (mgr.14388) 15831 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:14 smithi179 bash[23186]: audit 2024-09-21T04:20:12.180891+0000 mgr.a (mgr.14388) 15832 : audit [DBG] from='client.342189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:14.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:14 smithi049 bash[23528]: audit 2024-09-21T04:20:12.180891+0000 mgr.a (mgr.14388) 15832 : audit [DBG] from='client.342189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:14 smithi044 bash[22676]: audit 2024-09-21T04:20:12.180891+0000 mgr.a (mgr.14388) 15832 : audit [DBG] from='client.342189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:15 smithi049 bash[23528]: cluster 2024-09-21T04:20:13.955714+0000 mgr.a (mgr.14388) 15833 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:15.391 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:15 smithi179 bash[23186]: cluster 2024-09-21T04:20:13.955714+0000 mgr.a (mgr.14388) 15833 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:15 smithi044 bash[22676]: cluster 2024-09-21T04:20:13.955714+0000 mgr.a (mgr.14388) 15833 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:17 smithi049 bash[23528]: cluster 2024-09-21T04:20:15.958175+0000 mgr.a (mgr.14388) 15834 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:17.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:17 smithi044 bash[22676]: cluster 2024-09-21T04:20:15.958175+0000 mgr.a (mgr.14388) 15834 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:17 smithi179 bash[23186]: cluster 2024-09-21T04:20:15.958175+0000 mgr.a (mgr.14388) 15834 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:17.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:17.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:17.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:18.377 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:18.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:18.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:18.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:18.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:19 smithi049 bash[23528]: audit 2024-09-21T04:20:17.953810+0000 mgr.a (mgr.14388) 15835 : audit [DBG] from='client.342267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:19 smithi049 bash[23528]: cluster 2024-09-21T04:20:17.972044+0000 mgr.a (mgr.14388) 15836 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:19 smithi044 bash[22676]: audit 2024-09-21T04:20:17.953810+0000 mgr.a (mgr.14388) 15835 : audit [DBG] from='client.342267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:19 smithi044 bash[22676]: cluster 2024-09-21T04:20:17.972044+0000 mgr.a (mgr.14388) 15836 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:19 smithi179 bash[23186]: audit 2024-09-21T04:20:17.953810+0000 mgr.a (mgr.14388) 15835 : audit [DBG] from='client.342267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:19 smithi179 bash[23186]: cluster 2024-09-21T04:20:17.972044+0000 mgr.a (mgr.14388) 15836 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:21 smithi049 bash[23528]: cluster 2024-09-21T04:20:19.973044+0000 mgr.a (mgr.14388) 15837 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:20:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:21 smithi049 bash[23528]: audit 2024-09-21T04:20:20.129733+0000 mon.a (mon.0) 12669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:21 smithi049 bash[23528]: audit 2024-09-21T04:20:20.138142+0000 mon.a (mon.0) 12670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:21 smithi049 bash[23528]: audit 2024-09-21T04:20:20.150018+0000 mon.a (mon.0) 12671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:21 smithi049 bash[23528]: audit 2024-09-21T04:20:20.644398+0000 mon.a (mon.0) 12672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:21 smithi049 bash[23528]: audit 2024-09-21T04:20:20.653869+0000 mon.a (mon.0) 12673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:21 smithi049 bash[23528]: audit 2024-09-21T04:20:20.664071+0000 mon.a (mon.0) 12674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:21 smithi044 bash[22676]: cluster 2024-09-21T04:20:19.973044+0000 mgr.a (mgr.14388) 15837 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:20:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:21 smithi044 bash[22676]: audit 2024-09-21T04:20:20.129733+0000 mon.a (mon.0) 12669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:21 smithi044 bash[22676]: audit 2024-09-21T04:20:20.138142+0000 mon.a (mon.0) 12670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:21 smithi044 bash[22676]: audit 2024-09-21T04:20:20.150018+0000 mon.a (mon.0) 12671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:21 smithi044 bash[22676]: audit 2024-09-21T04:20:20.644398+0000 mon.a (mon.0) 12672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:21 smithi044 bash[22676]: audit 2024-09-21T04:20:20.653869+0000 mon.a (mon.0) 12673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:21 smithi044 bash[22676]: audit 2024-09-21T04:20:20.664071+0000 mon.a (mon.0) 12674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:21 smithi179 bash[23186]: cluster 2024-09-21T04:20:19.973044+0000 mgr.a (mgr.14388) 15837 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:20:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:21 smithi179 bash[23186]: audit 2024-09-21T04:20:20.129733+0000 mon.a (mon.0) 12669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:21 smithi179 bash[23186]: audit 2024-09-21T04:20:20.138142+0000 mon.a (mon.0) 12670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:21 smithi179 bash[23186]: audit 2024-09-21T04:20:20.150018+0000 mon.a (mon.0) 12671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:21 smithi179 bash[23186]: audit 2024-09-21T04:20:20.644398+0000 mon.a (mon.0) 12672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:21 smithi179 bash[23186]: audit 2024-09-21T04:20:20.653869+0000 mon.a (mon.0) 12673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:21 smithi179 bash[23186]: audit 2024-09-21T04:20:20.664071+0000 mon.a (mon.0) 12674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:23 smithi049 bash[23528]: cluster 2024-09-21T04:20:21.974666+0000 mgr.a (mgr.14388) 15838 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:23.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:23.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:23 smithi044 bash[22676]: cluster 2024-09-21T04:20:21.974666+0000 mgr.a (mgr.14388) 15838 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:23 smithi179 bash[23186]: cluster 2024-09-21T04:20:21.974666+0000 mgr.a (mgr.14388) 15838 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:24.134 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:24.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:25 smithi049 bash[23528]: audit 2024-09-21T04:20:23.708882+0000 mgr.a (mgr.14388) 15839 : audit [DBG] from='client.342345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:25 smithi049 bash[23528]: cluster 2024-09-21T04:20:23.975199+0000 mgr.a (mgr.14388) 15840 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:25 smithi044 bash[22676]: audit 2024-09-21T04:20:23.708882+0000 mgr.a (mgr.14388) 15839 : audit [DBG] from='client.342345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:25 smithi044 bash[22676]: cluster 2024-09-21T04:20:23.975199+0000 mgr.a (mgr.14388) 15840 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:25 smithi179 bash[23186]: audit 2024-09-21T04:20:23.708882+0000 mgr.a (mgr.14388) 15839 : audit [DBG] from='client.342345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:25 smithi179 bash[23186]: cluster 2024-09-21T04:20:23.975199+0000 mgr.a (mgr.14388) 15840 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:27 smithi049 bash[23528]: cluster 2024-09-21T04:20:25.977456+0000 mgr.a (mgr.14388) 15841 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:27 smithi044 bash[22676]: cluster 2024-09-21T04:20:25.977456+0000 mgr.a (mgr.14388) 15841 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:27 smithi179 bash[23186]: cluster 2024-09-21T04:20:25.977456+0000 mgr.a (mgr.14388) 15841 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:29.135 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:29.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:29.136 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:29 smithi044 bash[22676]: cluster 2024-09-21T04:20:27.978239+0000 mgr.a (mgr.14388) 15842 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:29 smithi179 bash[23186]: cluster 2024-09-21T04:20:27.978239+0000 mgr.a (mgr.14388) 15842 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:29 smithi049 bash[23528]: cluster 2024-09-21T04:20:27.978239+0000 mgr.a (mgr.14388) 15842 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:29.921 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:30 smithi044 bash[22676]: audit 2024-09-21T04:20:29.473783+0000 mgr.a (mgr.14388) 15843 : audit [DBG] from='client.342423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:30 smithi044 bash[22676]: audit 2024-09-21T04:20:29.568482+0000 mon.a (mon.0) 12675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:30 smithi044 bash[22676]: audit 2024-09-21T04:20:29.574552+0000 mon.a (mon.0) 12676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:30 smithi044 bash[22676]: audit 2024-09-21T04:20:29.579703+0000 mon.a (mon.0) 12677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:30 smithi044 bash[22676]: cluster 2024-09-21T04:20:29.979763+0000 mgr.a (mgr.14388) 15844 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:20:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:30 smithi179 bash[23186]: audit 2024-09-21T04:20:29.473783+0000 mgr.a (mgr.14388) 15843 : audit [DBG] from='client.342423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:30 smithi179 bash[23186]: audit 2024-09-21T04:20:29.568482+0000 mon.a (mon.0) 12675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:30 smithi179 bash[23186]: audit 2024-09-21T04:20:29.574552+0000 mon.a (mon.0) 12676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:30 smithi179 bash[23186]: audit 2024-09-21T04:20:29.579703+0000 mon.a (mon.0) 12677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:30 smithi179 bash[23186]: cluster 2024-09-21T04:20:29.979763+0000 mgr.a (mgr.14388) 15844 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:20:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:30 smithi049 bash[23528]: audit 2024-09-21T04:20:29.473783+0000 mgr.a (mgr.14388) 15843 : audit [DBG] from='client.342423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:30 smithi049 bash[23528]: audit 2024-09-21T04:20:29.568482+0000 mon.a (mon.0) 12675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:30 smithi049 bash[23528]: audit 2024-09-21T04:20:29.574552+0000 mon.a (mon.0) 12676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:31.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:30 smithi049 bash[23528]: audit 2024-09-21T04:20:29.579703+0000 mon.a (mon.0) 12677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:31.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:30 smithi049 bash[23528]: cluster 2024-09-21T04:20:29.979763+0000 mgr.a (mgr.14388) 15844 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:20:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:33 smithi049 bash[23528]: cluster 2024-09-21T04:20:31.981479+0000 mgr.a (mgr.14388) 15845 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:33.347 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:33 smithi179 bash[23186]: cluster 2024-09-21T04:20:31.981479+0000 mgr.a (mgr.14388) 15845 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:33 smithi044 bash[22676]: cluster 2024-09-21T04:20:31.981479+0000 mgr.a (mgr.14388) 15845 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:20:34.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:34.923 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:35.163 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:35 smithi044 bash[22676]: cluster 2024-09-21T04:20:33.982276+0000 mgr.a (mgr.14388) 15846 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:35 smithi179 bash[23186]: cluster 2024-09-21T04:20:33.982276+0000 mgr.a (mgr.14388) 15846 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:35 smithi049 bash[23528]: cluster 2024-09-21T04:20:33.982276+0000 mgr.a (mgr.14388) 15846 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:35.649 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:35.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:35.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:35.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:35.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:37 smithi049 bash[23528]: audit 2024-09-21T04:20:35.240172+0000 mgr.a (mgr.14388) 15847 : audit [DBG] from='client.342501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:37 smithi049 bash[23528]: cluster 2024-09-21T04:20:35.985148+0000 mgr.a (mgr.14388) 15848 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:37.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:37 smithi044 bash[22676]: audit 2024-09-21T04:20:35.240172+0000 mgr.a (mgr.14388) 15847 : audit [DBG] from='client.342501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:37.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:37 smithi044 bash[22676]: cluster 2024-09-21T04:20:35.985148+0000 mgr.a (mgr.14388) 15848 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:37 smithi179 bash[23186]: audit 2024-09-21T04:20:35.240172+0000 mgr.a (mgr.14388) 15847 : audit [DBG] from='client.342501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:37 smithi179 bash[23186]: cluster 2024-09-21T04:20:35.985148+0000 mgr.a (mgr.14388) 15848 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:39 smithi049 bash[23528]: cluster 2024-09-21T04:20:37.986104+0000 mgr.a (mgr.14388) 15849 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:39 smithi044 bash[22676]: cluster 2024-09-21T04:20:37.986104+0000 mgr.a (mgr.14388) 15849 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:39 smithi179 bash[23186]: cluster 2024-09-21T04:20:37.986104+0000 mgr.a (mgr.14388) 15849 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:40.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:40.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:41 smithi179 bash[23186]: cluster 2024-09-21T04:20:39.987320+0000 mgr.a (mgr.14388) 15850 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:20:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:41 smithi179 bash[23186]: audit 2024-09-21T04:20:40.365492+0000 mon.a (mon.0) 12678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:41 smithi179 bash[23186]: audit 2024-09-21T04:20:40.373877+0000 mon.a (mon.0) 12679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:41 smithi179 bash[23186]: audit 2024-09-21T04:20:40.384251+0000 mon.a (mon.0) 12680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:41 smithi179 bash[23186]: audit 2024-09-21T04:20:40.873111+0000 mon.a (mon.0) 12681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:41 smithi179 bash[23186]: audit 2024-09-21T04:20:40.880820+0000 mon.a (mon.0) 12682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:41 smithi179 bash[23186]: audit 2024-09-21T04:20:40.890242+0000 mon.a (mon.0) 12683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.448 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:41.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:41.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:41.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:41.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:41 smithi044 bash[22676]: cluster 2024-09-21T04:20:39.987320+0000 mgr.a (mgr.14388) 15850 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:20:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:41 smithi044 bash[22676]: audit 2024-09-21T04:20:40.365492+0000 mon.a (mon.0) 12678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:41 smithi044 bash[22676]: audit 2024-09-21T04:20:40.373877+0000 mon.a (mon.0) 12679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:41 smithi044 bash[22676]: audit 2024-09-21T04:20:40.384251+0000 mon.a (mon.0) 12680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:41 smithi044 bash[22676]: audit 2024-09-21T04:20:40.873111+0000 mon.a (mon.0) 12681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:41 smithi044 bash[22676]: audit 2024-09-21T04:20:40.880820+0000 mon.a (mon.0) 12682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:41 smithi044 bash[22676]: audit 2024-09-21T04:20:40.890242+0000 mon.a (mon.0) 12683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:41 smithi049 bash[23528]: cluster 2024-09-21T04:20:39.987320+0000 mgr.a (mgr.14388) 15850 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:20:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:41 smithi049 bash[23528]: audit 2024-09-21T04:20:40.365492+0000 mon.a (mon.0) 12678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:41 smithi049 bash[23528]: audit 2024-09-21T04:20:40.373877+0000 mon.a (mon.0) 12679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:41 smithi049 bash[23528]: audit 2024-09-21T04:20:40.384251+0000 mon.a (mon.0) 12680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:41 smithi049 bash[23528]: audit 2024-09-21T04:20:40.873111+0000 mon.a (mon.0) 12681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:41 smithi049 bash[23528]: audit 2024-09-21T04:20:40.880820+0000 mon.a (mon.0) 12682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:41 smithi049 bash[23528]: audit 2024-09-21T04:20:40.890242+0000 mon.a (mon.0) 12683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:42 smithi044 bash[22676]: audit 2024-09-21T04:20:40.991891+0000 mgr.a (mgr.14388) 15851 : audit [DBG] from='client.342576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:42 smithi179 bash[23186]: audit 2024-09-21T04:20:40.991891+0000 mgr.a (mgr.14388) 15851 : audit [DBG] from='client.342576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:42 smithi049 bash[23528]: audit 2024-09-21T04:20:40.991891+0000 mgr.a (mgr.14388) 15851 : audit [DBG] from='client.342576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:43 smithi044 bash[22676]: cluster 2024-09-21T04:20:41.989705+0000 mgr.a (mgr.14388) 15852 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:20:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:43 smithi179 bash[23186]: cluster 2024-09-21T04:20:41.989705+0000 mgr.a (mgr.14388) 15852 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:20:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:43 smithi049 bash[23528]: cluster 2024-09-21T04:20:41.989705+0000 mgr.a (mgr.14388) 15852 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:20:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:45 smithi049 bash[23528]: cluster 2024-09-21T04:20:43.990515+0000 mgr.a (mgr.14388) 15853 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:45 smithi044 bash[22676]: cluster 2024-09-21T04:20:43.990515+0000 mgr.a (mgr.14388) 15853 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:45 smithi179 bash[23186]: cluster 2024-09-21T04:20:43.990515+0000 mgr.a (mgr.14388) 15853 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:20:46.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:46.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:46.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:46 smithi044 bash[22676]: cluster 2024-09-21T04:20:45.992511+0000 mgr.a (mgr.14388) 15854 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:46 smithi179 bash[23186]: cluster 2024-09-21T04:20:45.992511+0000 mgr.a (mgr.14388) 15854 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:46.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:46 smithi049 bash[23528]: cluster 2024-09-21T04:20:45.992511+0000 mgr.a (mgr.14388) 15854 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:47.240 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:47.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:47.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:47.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:47.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:47 smithi044 bash[22676]: audit 2024-09-21T04:20:46.785187+0000 mgr.a (mgr.14388) 15855 : audit [DBG] from='client.342654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:47 smithi179 bash[23186]: audit 2024-09-21T04:20:46.785187+0000 mgr.a (mgr.14388) 15855 : audit [DBG] from='client.342654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:47.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:47 smithi049 bash[23528]: audit 2024-09-21T04:20:46.785187+0000 mgr.a (mgr.14388) 15855 : audit [DBG] from='client.342654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:48 smithi044 bash[22676]: cluster 2024-09-21T04:20:47.993453+0000 mgr.a (mgr.14388) 15856 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:48 smithi179 bash[23186]: cluster 2024-09-21T04:20:47.993453+0000 mgr.a (mgr.14388) 15856 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:48 smithi049 bash[23528]: cluster 2024-09-21T04:20:47.993453+0000 mgr.a (mgr.14388) 15856 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:20:49.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22930]: debug 2024-09-21T04:20:49.258+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:20:49.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22930]: debug 2024-09-21T04:20:49.262+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:20:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22676]: audit 2024-09-21T04:20:48.424083+0000 mon.a (mon.0) 12684 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:20:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22676]: audit 2024-09-21T04:20:48.431057+0000 mon.a (mon.0) 12685 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:20:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22676]: audit 2024-09-21T04:20:48.432887+0000 mon.a (mon.0) 12686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:20:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22676]: audit 2024-09-21T04:20:48.443913+0000 mon.a (mon.0) 12687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22676]: audit 2024-09-21T04:20:48.450250+0000 mon.a (mon.0) 12688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:20:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:49 smithi044 bash[22676]: audit 2024-09-21T04:20:48.452846+0000 mgr.a (mgr.14388) 15857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:20:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:49 smithi179 bash[23186]: audit 2024-09-21T04:20:48.424083+0000 mon.a (mon.0) 12684 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:20:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:49 smithi179 bash[23186]: audit 2024-09-21T04:20:48.431057+0000 mon.a (mon.0) 12685 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:20:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:49 smithi179 bash[23186]: audit 2024-09-21T04:20:48.432887+0000 mon.a (mon.0) 12686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:20:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:49 smithi179 bash[23186]: audit 2024-09-21T04:20:48.443913+0000 mon.a (mon.0) 12687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:49 smithi179 bash[23186]: audit 2024-09-21T04:20:48.450250+0000 mon.a (mon.0) 12688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:20:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:49 smithi179 bash[23186]: audit 2024-09-21T04:20:48.452846+0000 mgr.a (mgr.14388) 15857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:20:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:49 smithi049 bash[23528]: audit 2024-09-21T04:20:48.424083+0000 mon.a (mon.0) 12684 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:20:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:49 smithi049 bash[23528]: audit 2024-09-21T04:20:48.431057+0000 mon.a (mon.0) 12685 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:20:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:49 smithi049 bash[23528]: audit 2024-09-21T04:20:48.432887+0000 mon.a (mon.0) 12686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:20:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:49 smithi049 bash[23528]: audit 2024-09-21T04:20:48.443913+0000 mon.a (mon.0) 12687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:49 smithi049 bash[23528]: audit 2024-09-21T04:20:48.450250+0000 mon.a (mon.0) 12688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:20:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:49 smithi049 bash[23528]: audit 2024-09-21T04:20:48.452846+0000 mgr.a (mgr.14388) 15857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:20:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:50 smithi049 bash[23528]: audit 2024-09-21T04:20:49.263847+0000 mgr.a (mgr.14388) 15858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:20:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:50 smithi049 bash[23528]: cephadm 2024-09-21T04:20:49.265508+0000 mgr.a (mgr.14388) 15859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:20:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:50 smithi049 bash[23528]: audit 2024-09-21T04:20:49.791335+0000 mon.a (mon.0) 12689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:50 smithi049 bash[23528]: audit 2024-09-21T04:20:49.800134+0000 mon.a (mon.0) 12690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:50 smithi049 bash[23528]: audit 2024-09-21T04:20:49.810486+0000 mon.a (mon.0) 12691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:50 smithi049 bash[23528]: cluster 2024-09-21T04:20:49.995304+0000 mgr.a (mgr.14388) 15860 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 5 op/s 2024-09-21T04:20:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:50 smithi044 bash[22676]: audit 2024-09-21T04:20:49.263847+0000 mgr.a (mgr.14388) 15858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:20:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:50 smithi044 bash[22676]: cephadm 2024-09-21T04:20:49.265508+0000 mgr.a (mgr.14388) 15859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:20:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:50 smithi044 bash[22676]: audit 2024-09-21T04:20:49.791335+0000 mon.a (mon.0) 12689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:50 smithi044 bash[22676]: audit 2024-09-21T04:20:49.800134+0000 mon.a (mon.0) 12690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:50 smithi044 bash[22676]: audit 2024-09-21T04:20:49.810486+0000 mon.a (mon.0) 12691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:50 smithi044 bash[22676]: cluster 2024-09-21T04:20:49.995304+0000 mgr.a (mgr.14388) 15860 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 5 op/s 2024-09-21T04:20:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:50 smithi179 bash[23186]: audit 2024-09-21T04:20:49.263847+0000 mgr.a (mgr.14388) 15858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:20:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:50 smithi179 bash[23186]: cephadm 2024-09-21T04:20:49.265508+0000 mgr.a (mgr.14388) 15859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:20:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:50 smithi179 bash[23186]: audit 2024-09-21T04:20:49.791335+0000 mon.a (mon.0) 12689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:50 smithi179 bash[23186]: audit 2024-09-21T04:20:49.800134+0000 mon.a (mon.0) 12690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:50 smithi179 bash[23186]: audit 2024-09-21T04:20:49.810486+0000 mon.a (mon.0) 12691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:20:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:50 smithi179 bash[23186]: cluster 2024-09-21T04:20:49.995304+0000 mgr.a (mgr.14388) 15860 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 5 op/s 2024-09-21T04:20:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:52.242 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:52.242 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:53.019 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:53.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:53.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:53.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:53.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:53 smithi044 bash[22676]: cluster 2024-09-21T04:20:51.996549+0000 mgr.a (mgr.14388) 15861 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:53 smithi179 bash[23186]: cluster 2024-09-21T04:20:51.996549+0000 mgr.a (mgr.14388) 15861 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:53 smithi049 bash[23528]: cluster 2024-09-21T04:20:51.996549+0000 mgr.a (mgr.14388) 15861 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:54 smithi179 bash[23186]: audit 2024-09-21T04:20:52.576327+0000 mgr.a (mgr.14388) 15862 : audit [DBG] from='client.342828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:54 smithi044 bash[22676]: audit 2024-09-21T04:20:52.576327+0000 mgr.a (mgr.14388) 15862 : audit [DBG] from='client.342828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:54 smithi049 bash[23528]: audit 2024-09-21T04:20:52.576327+0000 mgr.a (mgr.14388) 15862 : audit [DBG] from='client.342828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:20:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:55 smithi044 bash[22676]: cluster 2024-09-21T04:20:53.997128+0000 mgr.a (mgr.14388) 15863 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:55.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:55 smithi179 bash[23186]: cluster 2024-09-21T04:20:53.997128+0000 mgr.a (mgr.14388) 15863 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:55 smithi049 bash[23528]: cluster 2024-09-21T04:20:53.997128+0000 mgr.a (mgr.14388) 15863 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:57.409 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:57 smithi044 bash[22676]: cluster 2024-09-21T04:20:55.999305+0000 mgr.a (mgr.14388) 15864 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:57 smithi179 bash[23186]: cluster 2024-09-21T04:20:55.999305+0000 mgr.a (mgr.14388) 15864 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:57.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:57 smithi049 bash[23528]: cluster 2024-09-21T04:20:55.999305+0000 mgr.a (mgr.14388) 15864 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:58.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:20:58.022 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:20:58.022 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:20:58.778 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:20:58.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:20:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:20:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:20:58.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:20:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:20:59 smithi044 bash[22676]: cluster 2024-09-21T04:20:58.000079+0000 mgr.a (mgr.14388) 15865 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:20:59 smithi179 bash[23186]: cluster 2024-09-21T04:20:58.000079+0000 mgr.a (mgr.14388) 15865 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:20:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:20:59 smithi049 bash[23528]: cluster 2024-09-21T04:20:58.000079+0000 mgr.a (mgr.14388) 15865 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:21:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:00 smithi044 bash[22676]: audit 2024-09-21T04:20:58.347647+0000 mgr.a (mgr.14388) 15866 : audit [DBG] from='client.342903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:00 smithi179 bash[23186]: audit 2024-09-21T04:20:58.347647+0000 mgr.a (mgr.14388) 15866 : audit [DBG] from='client.342903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:00 smithi049 bash[23528]: audit 2024-09-21T04:20:58.347647+0000 mgr.a (mgr.14388) 15866 : audit [DBG] from='client.342903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:01 smithi044 bash[22676]: cluster 2024-09-21T04:21:00.002019+0000 mgr.a (mgr.14388) 15867 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:21:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:01 smithi044 bash[22676]: audit 2024-09-21T04:21:00.595901+0000 mon.a (mon.0) 12692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:01 smithi044 bash[22676]: audit 2024-09-21T04:21:00.604992+0000 mon.a (mon.0) 12693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:01 smithi044 bash[22676]: audit 2024-09-21T04:21:00.613747+0000 mon.a (mon.0) 12694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:01 smithi179 bash[23186]: cluster 2024-09-21T04:21:00.002019+0000 mgr.a (mgr.14388) 15867 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:21:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:01 smithi179 bash[23186]: audit 2024-09-21T04:21:00.595901+0000 mon.a (mon.0) 12692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:01 smithi179 bash[23186]: audit 2024-09-21T04:21:00.604992+0000 mon.a (mon.0) 12693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:01 smithi179 bash[23186]: audit 2024-09-21T04:21:00.613747+0000 mon.a (mon.0) 12694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:01 smithi049 bash[23528]: cluster 2024-09-21T04:21:00.002019+0000 mgr.a (mgr.14388) 15867 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:21:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:01 smithi049 bash[23528]: audit 2024-09-21T04:21:00.595901+0000 mon.a (mon.0) 12692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:01 smithi049 bash[23528]: audit 2024-09-21T04:21:00.604992+0000 mon.a (mon.0) 12693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:01 smithi049 bash[23528]: audit 2024-09-21T04:21:00.613747+0000 mon.a (mon.0) 12694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:02 smithi044 bash[22676]: audit 2024-09-21T04:21:01.100915+0000 mon.a (mon.0) 12695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:02 smithi044 bash[22676]: audit 2024-09-21T04:21:01.109202+0000 mon.a (mon.0) 12696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:02 smithi044 bash[22676]: audit 2024-09-21T04:21:01.119247+0000 mon.a (mon.0) 12697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:02 smithi044 bash[22676]: cluster 2024-09-21T04:21:02.003224+0000 mgr.a (mgr.14388) 15868 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:02 smithi179 bash[23186]: audit 2024-09-21T04:21:01.100915+0000 mon.a (mon.0) 12695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:02 smithi179 bash[23186]: audit 2024-09-21T04:21:01.109202+0000 mon.a (mon.0) 12696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:02 smithi179 bash[23186]: audit 2024-09-21T04:21:01.119247+0000 mon.a (mon.0) 12697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:02 smithi179 bash[23186]: cluster 2024-09-21T04:21:02.003224+0000 mgr.a (mgr.14388) 15868 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:02 smithi049 bash[23528]: audit 2024-09-21T04:21:01.100915+0000 mon.a (mon.0) 12695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:02 smithi049 bash[23528]: audit 2024-09-21T04:21:01.109202+0000 mon.a (mon.0) 12696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:02 smithi049 bash[23528]: audit 2024-09-21T04:21:01.119247+0000 mon.a (mon.0) 12697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:02 smithi049 bash[23528]: cluster 2024-09-21T04:21:02.003224+0000 mgr.a (mgr.14388) 15868 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:03.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:04.526 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:04.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:05.349 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:05 smithi049 bash[23528]: cluster 2024-09-21T04:21:04.003944+0000 mgr.a (mgr.14388) 15869 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:05 smithi044 bash[22676]: cluster 2024-09-21T04:21:04.003944+0000 mgr.a (mgr.14388) 15869 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:05 smithi179 bash[23186]: cluster 2024-09-21T04:21:04.003944+0000 mgr.a (mgr.14388) 15869 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:06.368 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:06 smithi049 bash[23528]: audit 2024-09-21T04:21:04.104118+0000 mgr.a (mgr.14388) 15870 : audit [DBG] from='client.342978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:06 smithi044 bash[22676]: audit 2024-09-21T04:21:04.104118+0000 mgr.a (mgr.14388) 15870 : audit [DBG] from='client.342978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:06 smithi179 bash[23186]: audit 2024-09-21T04:21:04.104118+0000 mgr.a (mgr.14388) 15870 : audit [DBG] from='client.342978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:07.438 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:07 smithi049 bash[23528]: cluster 2024-09-21T04:21:06.006384+0000 mgr.a (mgr.14388) 15871 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:07 smithi044 bash[22676]: cluster 2024-09-21T04:21:06.006384+0000 mgr.a (mgr.14388) 15871 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:07 smithi179 bash[23186]: cluster 2024-09-21T04:21:06.006384+0000 mgr.a (mgr.14388) 15871 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:09 smithi044 bash[22676]: cluster 2024-09-21T04:21:08.007170+0000 mgr.a (mgr.14388) 15872 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:09 smithi179 bash[23186]: cluster 2024-09-21T04:21:08.007170+0000 mgr.a (mgr.14388) 15872 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:09.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:09.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:09.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:09.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:09 smithi049 bash[23528]: cluster 2024-09-21T04:21:08.007170+0000 mgr.a (mgr.14388) 15872 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:10.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:10.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:10.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:10.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:10.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:11 smithi049 bash[23528]: audit 2024-09-21T04:21:09.868990+0000 mgr.a (mgr.14388) 15873 : audit [DBG] from='client.343053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:11 smithi049 bash[23528]: audit 2024-09-21T04:21:10.006423+0000 mon.a (mon.0) 12698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:11 smithi049 bash[23528]: cluster 2024-09-21T04:21:10.017621+0000 mgr.a (mgr.14388) 15874 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:11 smithi049 bash[23528]: audit 2024-09-21T04:21:10.021863+0000 mon.a (mon.0) 12699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:11 smithi049 bash[23528]: audit 2024-09-21T04:21:10.028150+0000 mon.a (mon.0) 12700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:11 smithi044 bash[22676]: audit 2024-09-21T04:21:09.868990+0000 mgr.a (mgr.14388) 15873 : audit [DBG] from='client.343053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:11 smithi044 bash[22676]: audit 2024-09-21T04:21:10.006423+0000 mon.a (mon.0) 12698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:11 smithi044 bash[22676]: cluster 2024-09-21T04:21:10.017621+0000 mgr.a (mgr.14388) 15874 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:11 smithi044 bash[22676]: audit 2024-09-21T04:21:10.021863+0000 mon.a (mon.0) 12699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:11 smithi044 bash[22676]: audit 2024-09-21T04:21:10.028150+0000 mon.a (mon.0) 12700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:11 smithi179 bash[23186]: audit 2024-09-21T04:21:09.868990+0000 mgr.a (mgr.14388) 15873 : audit [DBG] from='client.343053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:11 smithi179 bash[23186]: audit 2024-09-21T04:21:10.006423+0000 mon.a (mon.0) 12698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:11 smithi179 bash[23186]: cluster 2024-09-21T04:21:10.017621+0000 mgr.a (mgr.14388) 15874 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:11.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:11 smithi179 bash[23186]: audit 2024-09-21T04:21:10.021863+0000 mon.a (mon.0) 12699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:11.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:11 smithi179 bash[23186]: audit 2024-09-21T04:21:10.028150+0000 mon.a (mon.0) 12700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:13 smithi179 bash[23186]: cluster 2024-09-21T04:21:12.019341+0000 mgr.a (mgr.14388) 15875 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:21:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:13 smithi044 bash[22676]: cluster 2024-09-21T04:21:12.019341+0000 mgr.a (mgr.14388) 15875 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:21:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:13 smithi049 bash[23528]: cluster 2024-09-21T04:21:12.019341+0000 mgr.a (mgr.14388) 15875 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:21:14.379 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:14 smithi179 bash[23186]: cluster 2024-09-21T04:21:14.020153+0000 mgr.a (mgr.14388) 15876 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:21:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:14 smithi044 bash[22676]: cluster 2024-09-21T04:21:14.020153+0000 mgr.a (mgr.14388) 15876 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:21:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:14 smithi049 bash[23528]: cluster 2024-09-21T04:21:14.020153+0000 mgr.a (mgr.14388) 15876 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:21:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:16.123 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:17.467 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:17 smithi044 bash[22676]: audit 2024-09-21T04:21:15.660802+0000 mgr.a (mgr.14388) 15877 : audit [DBG] from='client.343128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:17.467 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:17 smithi044 bash[22676]: cluster 2024-09-21T04:21:16.021969+0000 mgr.a (mgr.14388) 15878 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:17 smithi179 bash[23186]: audit 2024-09-21T04:21:15.660802+0000 mgr.a (mgr.14388) 15877 : audit [DBG] from='client.343128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:17 smithi179 bash[23186]: cluster 2024-09-21T04:21:16.021969+0000 mgr.a (mgr.14388) 15878 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:17 smithi049 bash[23528]: audit 2024-09-21T04:21:15.660802+0000 mgr.a (mgr.14388) 15877 : audit [DBG] from='client.343128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:17 smithi049 bash[23528]: cluster 2024-09-21T04:21:16.021969+0000 mgr.a (mgr.14388) 15878 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:18 smithi044 bash[22676]: cluster 2024-09-21T04:21:18.022784+0000 mgr.a (mgr.14388) 15879 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:21:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:18 smithi179 bash[23186]: cluster 2024-09-21T04:21:18.022784+0000 mgr.a (mgr.14388) 15879 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:21:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:18 smithi049 bash[23528]: cluster 2024-09-21T04:21:18.022784+0000 mgr.a (mgr.14388) 15879 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:21:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:20 smithi044 bash[22676]: cluster 2024-09-21T04:21:20.024352+0000 mgr.a (mgr.14388) 15880 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:21:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:20 smithi179 bash[23186]: cluster 2024-09-21T04:21:20.024352+0000 mgr.a (mgr.14388) 15880 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:21:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:20 smithi049 bash[23528]: cluster 2024-09-21T04:21:20.024352+0000 mgr.a (mgr.14388) 15880 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:21:21.125 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:21.919 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:21.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:21.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:21.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:21.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:21 smithi179 bash[23186]: audit 2024-09-21T04:21:20.821035+0000 mon.a (mon.0) 12701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:21 smithi179 bash[23186]: audit 2024-09-21T04:21:20.828974+0000 mon.a (mon.0) 12702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:21 smithi179 bash[23186]: audit 2024-09-21T04:21:20.839385+0000 mon.a (mon.0) 12703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:21 smithi179 bash[23186]: audit 2024-09-21T04:21:21.266940+0000 mon.a (mon.0) 12704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:21 smithi179 bash[23186]: audit 2024-09-21T04:21:21.274779+0000 mon.a (mon.0) 12705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:21 smithi179 bash[23186]: audit 2024-09-21T04:21:21.284449+0000 mon.a (mon.0) 12706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:21 smithi044 bash[22676]: audit 2024-09-21T04:21:20.821035+0000 mon.a (mon.0) 12701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:21 smithi044 bash[22676]: audit 2024-09-21T04:21:20.828974+0000 mon.a (mon.0) 12702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:21 smithi044 bash[22676]: audit 2024-09-21T04:21:20.839385+0000 mon.a (mon.0) 12703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:21 smithi044 bash[22676]: audit 2024-09-21T04:21:21.266940+0000 mon.a (mon.0) 12704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:21 smithi044 bash[22676]: audit 2024-09-21T04:21:21.274779+0000 mon.a (mon.0) 12705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:21 smithi044 bash[22676]: audit 2024-09-21T04:21:21.284449+0000 mon.a (mon.0) 12706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:21 smithi049 bash[23528]: audit 2024-09-21T04:21:20.821035+0000 mon.a (mon.0) 12701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:21 smithi049 bash[23528]: audit 2024-09-21T04:21:20.828974+0000 mon.a (mon.0) 12702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:21 smithi049 bash[23528]: audit 2024-09-21T04:21:20.839385+0000 mon.a (mon.0) 12703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:21 smithi049 bash[23528]: audit 2024-09-21T04:21:21.266940+0000 mon.a (mon.0) 12704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:21 smithi049 bash[23528]: audit 2024-09-21T04:21:21.274779+0000 mon.a (mon.0) 12705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:21 smithi049 bash[23528]: audit 2024-09-21T04:21:21.284449+0000 mon.a (mon.0) 12706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:22 smithi044 bash[22676]: audit 2024-09-21T04:21:21.459552+0000 mgr.a (mgr.14388) 15881 : audit [DBG] from='client.343206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:22 smithi044 bash[22676]: cluster 2024-09-21T04:21:22.026216+0000 mgr.a (mgr.14388) 15882 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:22 smithi179 bash[23186]: audit 2024-09-21T04:21:21.459552+0000 mgr.a (mgr.14388) 15881 : audit [DBG] from='client.343206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:22 smithi179 bash[23186]: cluster 2024-09-21T04:21:22.026216+0000 mgr.a (mgr.14388) 15882 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:23.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:22 smithi049 bash[23528]: audit 2024-09-21T04:21:21.459552+0000 mgr.a (mgr.14388) 15881 : audit [DBG] from='client.343206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:22 smithi049 bash[23528]: cluster 2024-09-21T04:21:22.026216+0000 mgr.a (mgr.14388) 15882 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:24 smithi044 bash[22676]: cluster 2024-09-21T04:21:24.026997+0000 mgr.a (mgr.14388) 15883 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:24 smithi179 bash[23186]: cluster 2024-09-21T04:21:24.026997+0000 mgr.a (mgr.14388) 15883 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:24 smithi049 bash[23528]: cluster 2024-09-21T04:21:24.026997+0000 mgr.a (mgr.14388) 15883 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:26.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:26 smithi049 bash[23528]: cluster 2024-09-21T04:21:26.028974+0000 mgr.a (mgr.14388) 15884 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:26 smithi044 bash[22676]: cluster 2024-09-21T04:21:26.028974+0000 mgr.a (mgr.14388) 15884 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:26 smithi179 bash[23186]: cluster 2024-09-21T04:21:26.028974+0000 mgr.a (mgr.14388) 15884 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:26.920 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:27.711 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:27.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:28.477 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:28 smithi049 bash[23528]: audit 2024-09-21T04:21:27.256299+0000 mgr.a (mgr.14388) 15885 : audit [DBG] from='client.343284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:28.478 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:28 smithi049 bash[23528]: cluster 2024-09-21T04:21:28.030009+0000 mgr.a (mgr.14388) 15886 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:28 smithi044 bash[22676]: audit 2024-09-21T04:21:27.256299+0000 mgr.a (mgr.14388) 15885 : audit [DBG] from='client.343284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:28 smithi044 bash[22676]: cluster 2024-09-21T04:21:28.030009+0000 mgr.a (mgr.14388) 15886 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:28 smithi179 bash[23186]: audit 2024-09-21T04:21:27.256299+0000 mgr.a (mgr.14388) 15885 : audit [DBG] from='client.343284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:28 smithi179 bash[23186]: cluster 2024-09-21T04:21:28.030009+0000 mgr.a (mgr.14388) 15886 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:30 smithi044 bash[22676]: cluster 2024-09-21T04:21:30.031874+0000 mgr.a (mgr.14388) 15887 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:21:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:30 smithi179 bash[23186]: cluster 2024-09-21T04:21:30.031874+0000 mgr.a (mgr.14388) 15887 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:21:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:30 smithi049 bash[23528]: cluster 2024-09-21T04:21:30.031874+0000 mgr.a (mgr.14388) 15887 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:21:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:31 smithi179 bash[23186]: audit 2024-09-21T04:21:30.243853+0000 mon.a (mon.0) 12707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:31 smithi179 bash[23186]: audit 2024-09-21T04:21:30.252935+0000 mon.a (mon.0) 12708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:31 smithi179 bash[23186]: audit 2024-09-21T04:21:30.263685+0000 mon.a (mon.0) 12709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:31 smithi049 bash[23528]: audit 2024-09-21T04:21:30.243853+0000 mon.a (mon.0) 12707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:31 smithi049 bash[23528]: audit 2024-09-21T04:21:30.252935+0000 mon.a (mon.0) 12708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:31 smithi049 bash[23528]: audit 2024-09-21T04:21:30.263685+0000 mon.a (mon.0) 12709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:31 smithi044 bash[22676]: audit 2024-09-21T04:21:30.243853+0000 mon.a (mon.0) 12707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:31 smithi044 bash[22676]: audit 2024-09-21T04:21:30.252935+0000 mon.a (mon.0) 12708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:31 smithi044 bash[22676]: audit 2024-09-21T04:21:30.263685+0000 mon.a (mon.0) 12709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:32 smithi179 bash[23186]: cluster 2024-09-21T04:21:32.033154+0000 mgr.a (mgr.14388) 15888 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:21:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:32 smithi049 bash[23528]: cluster 2024-09-21T04:21:32.033154+0000 mgr.a (mgr.14388) 15888 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:21:32.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:32.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:32.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:32 smithi044 bash[22676]: cluster 2024-09-21T04:21:32.033154+0000 mgr.a (mgr.14388) 15888 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:21:33.472 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:33 smithi179 bash[23186]: audit 2024-09-21T04:21:33.042074+0000 mgr.a (mgr.14388) 15889 : audit [DBG] from='client.343362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:33.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:33 smithi049 bash[23528]: audit 2024-09-21T04:21:33.042074+0000 mgr.a (mgr.14388) 15889 : audit [DBG] from='client.343362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:33 smithi044 bash[22676]: audit 2024-09-21T04:21:33.042074+0000 mgr.a (mgr.14388) 15889 : audit [DBG] from='client.343362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:34 smithi049 bash[23528]: cluster 2024-09-21T04:21:34.034156+0000 mgr.a (mgr.14388) 15890 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:34.626 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:34 smithi179 bash[23186]: cluster 2024-09-21T04:21:34.034156+0000 mgr.a (mgr.14388) 15890 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:34 smithi044 bash[22676]: cluster 2024-09-21T04:21:34.034156+0000 mgr.a (mgr.14388) 15890 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:36 smithi049 bash[23528]: cluster 2024-09-21T04:21:36.036437+0000 mgr.a (mgr.14388) 15891 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:36 smithi044 bash[22676]: cluster 2024-09-21T04:21:36.036437+0000 mgr.a (mgr.14388) 15891 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:36 smithi179 bash[23186]: cluster 2024-09-21T04:21:36.036437+0000 mgr.a (mgr.14388) 15891 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:21:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:38 smithi044 bash[22676]: cluster 2024-09-21T04:21:38.037205+0000 mgr.a (mgr.14388) 15892 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:38.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:38.475 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:38.475 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:38 smithi179 bash[23186]: cluster 2024-09-21T04:21:38.037205+0000 mgr.a (mgr.14388) 15892 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:38 smithi049 bash[23528]: cluster 2024-09-21T04:21:38.037205+0000 mgr.a (mgr.14388) 15892 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:39.279 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:39.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:39.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:39.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:39.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:39 smithi044 bash[22676]: audit 2024-09-21T04:21:38.807423+0000 mgr.a (mgr.14388) 15893 : audit [DBG] from='client.343440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:39 smithi179 bash[23186]: audit 2024-09-21T04:21:38.807423+0000 mgr.a (mgr.14388) 15893 : audit [DBG] from='client.343440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:39.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:39 smithi049 bash[23528]: audit 2024-09-21T04:21:38.807423+0000 mgr.a (mgr.14388) 15893 : audit [DBG] from='client.343440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:40 smithi044 bash[22676]: cluster 2024-09-21T04:21:40.039279+0000 mgr.a (mgr.14388) 15894 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:21:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:40 smithi179 bash[23186]: cluster 2024-09-21T04:21:40.039279+0000 mgr.a (mgr.14388) 15894 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:21:40.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:40 smithi049 bash[23528]: cluster 2024-09-21T04:21:40.039279+0000 mgr.a (mgr.14388) 15894 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:21:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:42 smithi049 bash[23528]: audit 2024-09-21T04:21:41.049963+0000 mon.a (mon.0) 12710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:42 smithi049 bash[23528]: audit 2024-09-21T04:21:41.059075+0000 mon.a (mon.0) 12711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:42 smithi049 bash[23528]: audit 2024-09-21T04:21:41.070854+0000 mon.a (mon.0) 12712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:42 smithi049 bash[23528]: audit 2024-09-21T04:21:41.492708+0000 mon.a (mon.0) 12713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:42 smithi049 bash[23528]: audit 2024-09-21T04:21:41.502662+0000 mon.a (mon.0) 12714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:42 smithi049 bash[23528]: audit 2024-09-21T04:21:41.513365+0000 mon.a (mon.0) 12715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:42 smithi044 bash[22676]: audit 2024-09-21T04:21:41.049963+0000 mon.a (mon.0) 12710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:42 smithi044 bash[22676]: audit 2024-09-21T04:21:41.059075+0000 mon.a (mon.0) 12711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:42 smithi044 bash[22676]: audit 2024-09-21T04:21:41.070854+0000 mon.a (mon.0) 12712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:42 smithi044 bash[22676]: audit 2024-09-21T04:21:41.492708+0000 mon.a (mon.0) 12713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:42 smithi044 bash[22676]: audit 2024-09-21T04:21:41.502662+0000 mon.a (mon.0) 12714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:42 smithi044 bash[22676]: audit 2024-09-21T04:21:41.513365+0000 mon.a (mon.0) 12715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:42 smithi179 bash[23186]: audit 2024-09-21T04:21:41.049963+0000 mon.a (mon.0) 12710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:42 smithi179 bash[23186]: audit 2024-09-21T04:21:41.059075+0000 mon.a (mon.0) 12711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:42 smithi179 bash[23186]: audit 2024-09-21T04:21:41.070854+0000 mon.a (mon.0) 12712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:42 smithi179 bash[23186]: audit 2024-09-21T04:21:41.492708+0000 mon.a (mon.0) 12713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:42 smithi179 bash[23186]: audit 2024-09-21T04:21:41.502662+0000 mon.a (mon.0) 12714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:42 smithi179 bash[23186]: audit 2024-09-21T04:21:41.513365+0000 mon.a (mon.0) 12715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:43 smithi044 bash[22676]: cluster 2024-09-21T04:21:42.040561+0000 mgr.a (mgr.14388) 15895 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:21:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:43 smithi179 bash[23186]: cluster 2024-09-21T04:21:42.040561+0000 mgr.a (mgr.14388) 15895 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:21:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:43 smithi049 bash[23528]: cluster 2024-09-21T04:21:42.040561+0000 mgr.a (mgr.14388) 15895 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:21:44.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:44.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:44.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:45.068 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:45.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:45.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:45.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:45.068 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:45 smithi044 bash[22676]: cluster 2024-09-21T04:21:44.041411+0000 mgr.a (mgr.14388) 15896 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:45 smithi179 bash[23186]: cluster 2024-09-21T04:21:44.041411+0000 mgr.a (mgr.14388) 15896 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:45 smithi049 bash[23528]: cluster 2024-09-21T04:21:44.041411+0000 mgr.a (mgr.14388) 15896 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:21:46.339 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:46 smithi049 bash[23528]: audit 2024-09-21T04:21:44.616303+0000 mgr.a (mgr.14388) 15897 : audit [DBG] from='client.343515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:46 smithi044 bash[22676]: audit 2024-09-21T04:21:44.616303+0000 mgr.a (mgr.14388) 15897 : audit [DBG] from='client.343515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:46 smithi179 bash[23186]: audit 2024-09-21T04:21:44.616303+0000 mgr.a (mgr.14388) 15897 : audit [DBG] from='client.343515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:47.326 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:47 smithi049 bash[23528]: cluster 2024-09-21T04:21:46.043949+0000 mgr.a (mgr.14388) 15898 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:21:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:47 smithi044 bash[22676]: cluster 2024-09-21T04:21:46.043949+0000 mgr.a (mgr.14388) 15898 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:21:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:47 smithi179 bash[23186]: cluster 2024-09-21T04:21:46.043949+0000 mgr.a (mgr.14388) 15898 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:21:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:49 smithi049 bash[23528]: cluster 2024-09-21T04:21:48.044795+0000 mgr.a (mgr.14388) 15899 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:21:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:49 smithi044 bash[22676]: cluster 2024-09-21T04:21:48.044795+0000 mgr.a (mgr.14388) 15899 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:21:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:49 smithi179 bash[23186]: cluster 2024-09-21T04:21:48.044795+0000 mgr.a (mgr.14388) 15899 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:21:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:50.473 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:50 smithi049 bash[23528]: audit 2024-09-21T04:21:49.352869+0000 mon.a (mon.0) 12716 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:21:50.473 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:50 smithi049 bash[23528]: audit 2024-09-21T04:21:49.363924+0000 mon.a (mon.0) 12717 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:21:50.473 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:50 smithi049 bash[23528]: audit 2024-09-21T04:21:49.365854+0000 mon.a (mon.0) 12718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:21:50.474 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:50 smithi049 bash[23528]: audit 2024-09-21T04:21:49.377676+0000 mon.a (mon.0) 12719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:50.474 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:50 smithi049 bash[23528]: audit 2024-09-21T04:21:49.383948+0000 mon.a (mon.0) 12720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:21:50.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:21:50 smithi044 bash[22930]: debug 2024-09-21T04:21:50.177+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:21:50.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:21:50 smithi044 bash[22930]: debug 2024-09-21T04:21:50.177+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:21:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:50 smithi044 bash[22676]: audit 2024-09-21T04:21:49.352869+0000 mon.a (mon.0) 12716 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:21:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:50 smithi044 bash[22676]: audit 2024-09-21T04:21:49.363924+0000 mon.a (mon.0) 12717 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:21:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:50 smithi044 bash[22676]: audit 2024-09-21T04:21:49.365854+0000 mon.a (mon.0) 12718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:21:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:50 smithi044 bash[22676]: audit 2024-09-21T04:21:49.377676+0000 mon.a (mon.0) 12719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:50 smithi044 bash[22676]: audit 2024-09-21T04:21:49.383948+0000 mon.a (mon.0) 12720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:21:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:50 smithi179 bash[23186]: audit 2024-09-21T04:21:49.352869+0000 mon.a (mon.0) 12716 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:21:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:50 smithi179 bash[23186]: audit 2024-09-21T04:21:49.363924+0000 mon.a (mon.0) 12717 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:21:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:50 smithi179 bash[23186]: audit 2024-09-21T04:21:49.365854+0000 mon.a (mon.0) 12718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:21:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:50 smithi179 bash[23186]: audit 2024-09-21T04:21:49.377676+0000 mon.a (mon.0) 12719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:50 smithi179 bash[23186]: audit 2024-09-21T04:21:49.383948+0000 mon.a (mon.0) 12720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:21:50.801 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:50.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:51 smithi044 bash[22676]: audit 2024-09-21T04:21:49.386360+0000 mgr.a (mgr.14388) 15900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:21:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:51 smithi044 bash[22676]: cluster 2024-09-21T04:21:50.045838+0000 mgr.a (mgr.14388) 15901 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-21T04:21:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:51 smithi044 bash[22676]: audit 2024-09-21T04:21:50.443536+0000 mon.a (mon.0) 12721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:51 smithi044 bash[22676]: audit 2024-09-21T04:21:50.448430+0000 mon.a (mon.0) 12722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:51 smithi044 bash[22676]: audit 2024-09-21T04:21:50.453895+0000 mon.a (mon.0) 12723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:51 smithi179 bash[23186]: audit 2024-09-21T04:21:49.386360+0000 mgr.a (mgr.14388) 15900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:21:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:51 smithi179 bash[23186]: cluster 2024-09-21T04:21:50.045838+0000 mgr.a (mgr.14388) 15901 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-21T04:21:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:51 smithi179 bash[23186]: audit 2024-09-21T04:21:50.443536+0000 mon.a (mon.0) 12721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:51 smithi179 bash[23186]: audit 2024-09-21T04:21:50.448430+0000 mon.a (mon.0) 12722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:51 smithi179 bash[23186]: audit 2024-09-21T04:21:50.453895+0000 mon.a (mon.0) 12723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:51 smithi049 bash[23528]: audit 2024-09-21T04:21:49.386360+0000 mgr.a (mgr.14388) 15900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:21:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:51 smithi049 bash[23528]: cluster 2024-09-21T04:21:50.045838+0000 mgr.a (mgr.14388) 15901 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-21T04:21:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:51 smithi049 bash[23528]: audit 2024-09-21T04:21:50.443536+0000 mon.a (mon.0) 12721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:51 smithi049 bash[23528]: audit 2024-09-21T04:21:50.448430+0000 mon.a (mon.0) 12722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:51 smithi049 bash[23528]: audit 2024-09-21T04:21:50.453895+0000 mon.a (mon.0) 12723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:21:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:52 smithi044 bash[22676]: audit 2024-09-21T04:21:50.182947+0000 mgr.a (mgr.14388) 15902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:21:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:52 smithi044 bash[22676]: cephadm 2024-09-21T04:21:50.184080+0000 mgr.a (mgr.14388) 15903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:21:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:52 smithi044 bash[22676]: audit 2024-09-21T04:21:50.384182+0000 mgr.a (mgr.14388) 15904 : audit [DBG] from='client.343701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:52 smithi179 bash[23186]: audit 2024-09-21T04:21:50.182947+0000 mgr.a (mgr.14388) 15902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:21:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:52 smithi179 bash[23186]: cephadm 2024-09-21T04:21:50.184080+0000 mgr.a (mgr.14388) 15903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:21:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:52 smithi179 bash[23186]: audit 2024-09-21T04:21:50.384182+0000 mgr.a (mgr.14388) 15904 : audit [DBG] from='client.343701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:52 smithi049 bash[23528]: audit 2024-09-21T04:21:50.182947+0000 mgr.a (mgr.14388) 15902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:21:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:52 smithi049 bash[23528]: cephadm 2024-09-21T04:21:50.184080+0000 mgr.a (mgr.14388) 15903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:21:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:52 smithi049 bash[23528]: audit 2024-09-21T04:21:50.384182+0000 mgr.a (mgr.14388) 15904 : audit [DBG] from='client.343701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:53 smithi044 bash[22676]: cluster 2024-09-21T04:21:52.047614+0000 mgr.a (mgr.14388) 15905 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:53 smithi179 bash[23186]: cluster 2024-09-21T04:21:52.047614+0000 mgr.a (mgr.14388) 15905 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:53 smithi049 bash[23528]: cluster 2024-09-21T04:21:52.047614+0000 mgr.a (mgr.14388) 15905 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:54 smithi044 bash[22676]: cluster 2024-09-21T04:21:54.048408+0000 mgr.a (mgr.14388) 15906 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:54 smithi179 bash[23186]: cluster 2024-09-21T04:21:54.048408+0000 mgr.a (mgr.14388) 15906 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:54 smithi049 bash[23528]: cluster 2024-09-21T04:21:54.048408+0000 mgr.a (mgr.14388) 15906 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:21:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:21:55.803 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:21:55.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:21:56.409 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:56 smithi044 bash[22676]: cluster 2024-09-21T04:21:56.050384+0000 mgr.a (mgr.14388) 15907 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:21:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:56 smithi179 bash[23186]: cluster 2024-09-21T04:21:56.050384+0000 mgr.a (mgr.14388) 15907 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:21:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:56 smithi049 bash[23528]: cluster 2024-09-21T04:21:56.050384+0000 mgr.a (mgr.14388) 15907 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:21:56.557 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:21:56.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:21:56.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:21:56.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:21:56.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:21:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:57 smithi044 bash[22676]: audit 2024-09-21T04:21:56.132905+0000 mgr.a (mgr.14388) 15908 : audit [DBG] from='client.343776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:57 smithi179 bash[23186]: audit 2024-09-21T04:21:56.132905+0000 mgr.a (mgr.14388) 15908 : audit [DBG] from='client.343776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:57 smithi049 bash[23528]: audit 2024-09-21T04:21:56.132905+0000 mgr.a (mgr.14388) 15908 : audit [DBG] from='client.343776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:21:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:21:58 smithi044 bash[22676]: cluster 2024-09-21T04:21:58.050936+0000 mgr.a (mgr.14388) 15909 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:21:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:21:58 smithi179 bash[23186]: cluster 2024-09-21T04:21:58.050936+0000 mgr.a (mgr.14388) 15909 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:21:58.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:21:58 smithi049 bash[23528]: cluster 2024-09-21T04:21:58.050936+0000 mgr.a (mgr.14388) 15909 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:22:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:00 smithi044 bash[22676]: cluster 2024-09-21T04:22:00.052112+0000 mgr.a (mgr.14388) 15910 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:00 smithi179 bash[23186]: cluster 2024-09-21T04:22:00.052112+0000 mgr.a (mgr.14388) 15910 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:00 smithi049 bash[23528]: cluster 2024-09-21T04:22:00.052112+0000 mgr.a (mgr.14388) 15910 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:01.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:01.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:01.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:02.361 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:02.362 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: audit 2024-09-21T04:22:01.278024+0000 mon.a (mon.0) 12724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: audit 2024-09-21T04:22:01.285792+0000 mon.a (mon.0) 12725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: audit 2024-09-21T04:22:01.297847+0000 mon.a (mon.0) 12726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: audit 2024-09-21T04:22:01.705049+0000 mon.a (mon.0) 12727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: audit 2024-09-21T04:22:01.711018+0000 mon.a (mon.0) 12728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: audit 2024-09-21T04:22:01.716447+0000 mon.a (mon.0) 12729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: audit 2024-09-21T04:22:01.901712+0000 mgr.a (mgr.14388) 15911 : audit [DBG] from='client.343851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:02.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:02 smithi049 bash[23528]: cluster 2024-09-21T04:22:02.053122+0000 mgr.a (mgr.14388) 15912 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:22:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: audit 2024-09-21T04:22:01.278024+0000 mon.a (mon.0) 12724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: audit 2024-09-21T04:22:01.285792+0000 mon.a (mon.0) 12725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: audit 2024-09-21T04:22:01.297847+0000 mon.a (mon.0) 12726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: audit 2024-09-21T04:22:01.705049+0000 mon.a (mon.0) 12727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: audit 2024-09-21T04:22:01.711018+0000 mon.a (mon.0) 12728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: audit 2024-09-21T04:22:01.716447+0000 mon.a (mon.0) 12729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: audit 2024-09-21T04:22:01.901712+0000 mgr.a (mgr.14388) 15911 : audit [DBG] from='client.343851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:02 smithi044 bash[22676]: cluster 2024-09-21T04:22:02.053122+0000 mgr.a (mgr.14388) 15912 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:22:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: audit 2024-09-21T04:22:01.278024+0000 mon.a (mon.0) 12724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: audit 2024-09-21T04:22:01.285792+0000 mon.a (mon.0) 12725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: audit 2024-09-21T04:22:01.297847+0000 mon.a (mon.0) 12726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: audit 2024-09-21T04:22:01.705049+0000 mon.a (mon.0) 12727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: audit 2024-09-21T04:22:01.711018+0000 mon.a (mon.0) 12728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: audit 2024-09-21T04:22:01.716447+0000 mon.a (mon.0) 12729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:02.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: audit 2024-09-21T04:22:01.901712+0000 mgr.a (mgr.14388) 15911 : audit [DBG] from='client.343851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:02.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:02 smithi179 bash[23186]: cluster 2024-09-21T04:22:02.053122+0000 mgr.a (mgr.14388) 15912 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:22:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:04 smithi044 bash[22676]: cluster 2024-09-21T04:22:04.054004+0000 mgr.a (mgr.14388) 15913 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-09-21T04:22:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:04 smithi179 bash[23186]: cluster 2024-09-21T04:22:04.054004+0000 mgr.a (mgr.14388) 15913 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-09-21T04:22:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:04 smithi049 bash[23528]: cluster 2024-09-21T04:22:04.054004+0000 mgr.a (mgr.14388) 15913 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-09-21T04:22:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:06 smithi044 bash[22676]: cluster 2024-09-21T04:22:06.056180+0000 mgr.a (mgr.14388) 15914 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-21T04:22:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:06 smithi179 bash[23186]: cluster 2024-09-21T04:22:06.056180+0000 mgr.a (mgr.14388) 15914 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-21T04:22:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:06 smithi049 bash[23528]: cluster 2024-09-21T04:22:06.056180+0000 mgr.a (mgr.14388) 15914 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 4 op/s 2024-09-21T04:22:07.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:08.158 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:08.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:08.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:08.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:08.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:08 smithi044 bash[22676]: audit 2024-09-21T04:22:07.702127+0000 mgr.a (mgr.14388) 15915 : audit [DBG] from='client.343929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:08 smithi044 bash[22676]: cluster 2024-09-21T04:22:08.056756+0000 mgr.a (mgr.14388) 15916 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:08 smithi179 bash[23186]: audit 2024-09-21T04:22:07.702127+0000 mgr.a (mgr.14388) 15915 : audit [DBG] from='client.343929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:08 smithi179 bash[23186]: cluster 2024-09-21T04:22:08.056756+0000 mgr.a (mgr.14388) 15916 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:08 smithi049 bash[23528]: audit 2024-09-21T04:22:07.702127+0000 mgr.a (mgr.14388) 15915 : audit [DBG] from='client.343929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:08 smithi049 bash[23528]: cluster 2024-09-21T04:22:08.056756+0000 mgr.a (mgr.14388) 15916 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:10 smithi044 bash[22676]: cluster 2024-09-21T04:22:10.058526+0000 mgr.a (mgr.14388) 15917 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:10 smithi179 bash[23186]: cluster 2024-09-21T04:22:10.058526+0000 mgr.a (mgr.14388) 15917 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:10 smithi049 bash[23528]: cluster 2024-09-21T04:22:10.058526+0000 mgr.a (mgr.14388) 15917 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:11 smithi044 bash[22676]: audit 2024-09-21T04:22:10.660150+0000 mon.a (mon.0) 12730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:11 smithi044 bash[22676]: audit 2024-09-21T04:22:10.669854+0000 mon.a (mon.0) 12731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:11 smithi044 bash[22676]: audit 2024-09-21T04:22:10.680994+0000 mon.a (mon.0) 12732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:11 smithi179 bash[23186]: audit 2024-09-21T04:22:10.660150+0000 mon.a (mon.0) 12730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:11 smithi179 bash[23186]: audit 2024-09-21T04:22:10.669854+0000 mon.a (mon.0) 12731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:11 smithi179 bash[23186]: audit 2024-09-21T04:22:10.680994+0000 mon.a (mon.0) 12732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:11 smithi049 bash[23528]: audit 2024-09-21T04:22:10.660150+0000 mon.a (mon.0) 12730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:11 smithi049 bash[23528]: audit 2024-09-21T04:22:10.669854+0000 mon.a (mon.0) 12731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:11 smithi049 bash[23528]: audit 2024-09-21T04:22:10.680994+0000 mon.a (mon.0) 12732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:12 smithi044 bash[22676]: cluster 2024-09-21T04:22:12.059829+0000 mgr.a (mgr.14388) 15918 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:12 smithi179 bash[23186]: cluster 2024-09-21T04:22:12.059829+0000 mgr.a (mgr.14388) 15918 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:12 smithi049 bash[23528]: cluster 2024-09-21T04:22:12.059829+0000 mgr.a (mgr.14388) 15918 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:13.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:13.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:13.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:14 smithi044 bash[22676]: audit 2024-09-21T04:22:13.491099+0000 mgr.a (mgr.14388) 15919 : audit [DBG] from='client.344007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:14 smithi044 bash[22676]: cluster 2024-09-21T04:22:14.060889+0000 mgr.a (mgr.14388) 15920 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:14.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:14 smithi179 bash[23186]: audit 2024-09-21T04:22:13.491099+0000 mgr.a (mgr.14388) 15919 : audit [DBG] from='client.344007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:14.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:14 smithi179 bash[23186]: cluster 2024-09-21T04:22:14.060889+0000 mgr.a (mgr.14388) 15920 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:14 smithi049 bash[23528]: audit 2024-09-21T04:22:13.491099+0000 mgr.a (mgr.14388) 15919 : audit [DBG] from='client.344007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:14 smithi049 bash[23528]: cluster 2024-09-21T04:22:14.060889+0000 mgr.a (mgr.14388) 15920 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:16 smithi044 bash[22676]: cluster 2024-09-21T04:22:16.063350+0000 mgr.a (mgr.14388) 15921 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:22:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:16 smithi179 bash[23186]: cluster 2024-09-21T04:22:16.063350+0000 mgr.a (mgr.14388) 15921 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:22:16.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:16 smithi049 bash[23528]: cluster 2024-09-21T04:22:16.063350+0000 mgr.a (mgr.14388) 15921 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:22:18.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:18 smithi044 bash[22676]: cluster 2024-09-21T04:22:18.064046+0000 mgr.a (mgr.14388) 15922 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:18 smithi179 bash[23186]: cluster 2024-09-21T04:22:18.064046+0000 mgr.a (mgr.14388) 15922 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:18 smithi049 bash[23528]: cluster 2024-09-21T04:22:18.064046+0000 mgr.a (mgr.14388) 15922 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:19.740 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:20 smithi044 bash[22676]: audit 2024-09-21T04:22:19.285498+0000 mgr.a (mgr.14388) 15923 : audit [DBG] from='client.344082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:20 smithi044 bash[22676]: cluster 2024-09-21T04:22:20.066041+0000 mgr.a (mgr.14388) 15924 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:20 smithi179 bash[23186]: audit 2024-09-21T04:22:19.285498+0000 mgr.a (mgr.14388) 15923 : audit [DBG] from='client.344082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:20 smithi179 bash[23186]: cluster 2024-09-21T04:22:20.066041+0000 mgr.a (mgr.14388) 15924 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:20 smithi049 bash[23528]: audit 2024-09-21T04:22:19.285498+0000 mgr.a (mgr.14388) 15923 : audit [DBG] from='client.344082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:20 smithi049 bash[23528]: cluster 2024-09-21T04:22:20.066041+0000 mgr.a (mgr.14388) 15924 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:22 smithi179 bash[23186]: audit 2024-09-21T04:22:21.498938+0000 mon.a (mon.0) 12733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:22 smithi179 bash[23186]: audit 2024-09-21T04:22:21.507190+0000 mon.a (mon.0) 12734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:22 smithi179 bash[23186]: audit 2024-09-21T04:22:21.516436+0000 mon.a (mon.0) 12735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:22 smithi179 bash[23186]: audit 2024-09-21T04:22:21.924217+0000 mon.a (mon.0) 12736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:22 smithi179 bash[23186]: audit 2024-09-21T04:22:21.932672+0000 mon.a (mon.0) 12737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:22 smithi179 bash[23186]: audit 2024-09-21T04:22:21.942759+0000 mon.a (mon.0) 12738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:22 smithi179 bash[23186]: cluster 2024-09-21T04:22:22.067448+0000 mgr.a (mgr.14388) 15925 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:22 smithi049 bash[23528]: audit 2024-09-21T04:22:21.498938+0000 mon.a (mon.0) 12733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:22 smithi049 bash[23528]: audit 2024-09-21T04:22:21.507190+0000 mon.a (mon.0) 12734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:22 smithi049 bash[23528]: audit 2024-09-21T04:22:21.516436+0000 mon.a (mon.0) 12735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:22 smithi049 bash[23528]: audit 2024-09-21T04:22:21.924217+0000 mon.a (mon.0) 12736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:22 smithi049 bash[23528]: audit 2024-09-21T04:22:21.932672+0000 mon.a (mon.0) 12737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:22 smithi049 bash[23528]: audit 2024-09-21T04:22:21.942759+0000 mon.a (mon.0) 12738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:22 smithi049 bash[23528]: cluster 2024-09-21T04:22:22.067448+0000 mgr.a (mgr.14388) 15925 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:22 smithi044 bash[22676]: audit 2024-09-21T04:22:21.498938+0000 mon.a (mon.0) 12733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:22 smithi044 bash[22676]: audit 2024-09-21T04:22:21.507190+0000 mon.a (mon.0) 12734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:22 smithi044 bash[22676]: audit 2024-09-21T04:22:21.516436+0000 mon.a (mon.0) 12735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:22 smithi044 bash[22676]: audit 2024-09-21T04:22:21.924217+0000 mon.a (mon.0) 12736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:22 smithi044 bash[22676]: audit 2024-09-21T04:22:21.932672+0000 mon.a (mon.0) 12737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:22 smithi044 bash[22676]: audit 2024-09-21T04:22:21.942759+0000 mon.a (mon.0) 12738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:22 smithi044 bash[22676]: cluster 2024-09-21T04:22:22.067448+0000 mgr.a (mgr.14388) 15925 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:24 smithi044 bash[22676]: cluster 2024-09-21T04:22:24.068424+0000 mgr.a (mgr.14388) 15926 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:24 smithi179 bash[23186]: cluster 2024-09-21T04:22:24.068424+0000 mgr.a (mgr.14388) 15926 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:24 smithi049 bash[23528]: cluster 2024-09-21T04:22:24.068424+0000 mgr.a (mgr.14388) 15926 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:24.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:24.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:24.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:25 smithi044 bash[22676]: audit 2024-09-21T04:22:25.073435+0000 mgr.a (mgr.14388) 15927 : audit [DBG] from='client.344157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:25.490 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:25 smithi179 bash[23186]: audit 2024-09-21T04:22:25.073435+0000 mgr.a (mgr.14388) 15927 : audit [DBG] from='client.344157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:25 smithi049 bash[23528]: audit 2024-09-21T04:22:25.073435+0000 mgr.a (mgr.14388) 15927 : audit [DBG] from='client.344157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:26 smithi044 bash[22676]: cluster 2024-09-21T04:22:26.071442+0000 mgr.a (mgr.14388) 15928 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:26 smithi179 bash[23186]: cluster 2024-09-21T04:22:26.071442+0000 mgr.a (mgr.14388) 15928 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:26 smithi049 bash[23528]: cluster 2024-09-21T04:22:26.071442+0000 mgr.a (mgr.14388) 15928 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:28 smithi044 bash[22676]: cluster 2024-09-21T04:22:28.072244+0000 mgr.a (mgr.14388) 15929 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:22:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:28 smithi179 bash[23186]: cluster 2024-09-21T04:22:28.072244+0000 mgr.a (mgr.14388) 15929 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:22:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:28 smithi049 bash[23528]: cluster 2024-09-21T04:22:28.072244+0000 mgr.a (mgr.14388) 15929 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:22:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:30 smithi044 bash[22676]: cluster 2024-09-21T04:22:30.073867+0000 mgr.a (mgr.14388) 15930 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:22:30.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:30.492 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:30.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:30 smithi179 bash[23186]: cluster 2024-09-21T04:22:30.073867+0000 mgr.a (mgr.14388) 15930 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:22:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:30 smithi049 bash[23528]: cluster 2024-09-21T04:22:30.073867+0000 mgr.a (mgr.14388) 15930 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:22:31.290 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:31.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:31.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:31.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:31.290 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:31 smithi044 bash[22676]: audit 2024-09-21T04:22:30.830732+0000 mgr.a (mgr.14388) 15931 : audit [DBG] from='client.344235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:31 smithi044 bash[22676]: audit 2024-09-21T04:22:30.890817+0000 mon.a (mon.0) 12739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:31 smithi044 bash[22676]: audit 2024-09-21T04:22:30.899044+0000 mon.a (mon.0) 12740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:31 smithi044 bash[22676]: audit 2024-09-21T04:22:30.907576+0000 mon.a (mon.0) 12741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:31 smithi179 bash[23186]: audit 2024-09-21T04:22:30.830732+0000 mgr.a (mgr.14388) 15931 : audit [DBG] from='client.344235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:31 smithi179 bash[23186]: audit 2024-09-21T04:22:30.890817+0000 mon.a (mon.0) 12739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:31 smithi179 bash[23186]: audit 2024-09-21T04:22:30.899044+0000 mon.a (mon.0) 12740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:31 smithi179 bash[23186]: audit 2024-09-21T04:22:30.907576+0000 mon.a (mon.0) 12741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:31 smithi049 bash[23528]: audit 2024-09-21T04:22:30.830732+0000 mgr.a (mgr.14388) 15931 : audit [DBG] from='client.344235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:31 smithi049 bash[23528]: audit 2024-09-21T04:22:30.890817+0000 mon.a (mon.0) 12739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:31 smithi049 bash[23528]: audit 2024-09-21T04:22:30.899044+0000 mon.a (mon.0) 12740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:31 smithi049 bash[23528]: audit 2024-09-21T04:22:30.907576+0000 mon.a (mon.0) 12741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:32 smithi044 bash[22676]: cluster 2024-09-21T04:22:32.075655+0000 mgr.a (mgr.14388) 15932 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:22:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:32 smithi179 bash[23186]: cluster 2024-09-21T04:22:32.075655+0000 mgr.a (mgr.14388) 15932 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:22:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:32 smithi049 bash[23528]: cluster 2024-09-21T04:22:32.075655+0000 mgr.a (mgr.14388) 15932 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:22:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:34 smithi044 bash[22676]: cluster 2024-09-21T04:22:34.076507+0000 mgr.a (mgr.14388) 15933 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:22:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:34 smithi179 bash[23186]: cluster 2024-09-21T04:22:34.076507+0000 mgr.a (mgr.14388) 15933 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:22:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:34 smithi049 bash[23528]: cluster 2024-09-21T04:22:34.076507+0000 mgr.a (mgr.14388) 15933 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:22:36.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:36 smithi044 bash[22676]: cluster 2024-09-21T04:22:36.077683+0000 mgr.a (mgr.14388) 15934 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:36 smithi179 bash[23186]: cluster 2024-09-21T04:22:36.077683+0000 mgr.a (mgr.14388) 15934 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:36.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:36.292 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:36.292 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:36 smithi049 bash[23528]: cluster 2024-09-21T04:22:36.077683+0000 mgr.a (mgr.14388) 15934 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:37.095 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:37 smithi044 bash[22676]: audit 2024-09-21T04:22:36.626441+0000 mgr.a (mgr.14388) 15935 : audit [DBG] from='client.344307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:37 smithi179 bash[23186]: audit 2024-09-21T04:22:36.626441+0000 mgr.a (mgr.14388) 15935 : audit [DBG] from='client.344307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:37 smithi049 bash[23528]: audit 2024-09-21T04:22:36.626441+0000 mgr.a (mgr.14388) 15935 : audit [DBG] from='client.344307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:38.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:38 smithi044 bash[22676]: cluster 2024-09-21T04:22:38.078358+0000 mgr.a (mgr.14388) 15936 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:38.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:38 smithi179 bash[23186]: cluster 2024-09-21T04:22:38.078358+0000 mgr.a (mgr.14388) 15936 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:38 smithi049 bash[23528]: cluster 2024-09-21T04:22:38.078358+0000 mgr.a (mgr.14388) 15936 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:40 smithi044 bash[22676]: cluster 2024-09-21T04:22:40.080118+0000 mgr.a (mgr.14388) 15937 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:40 smithi179 bash[23186]: cluster 2024-09-21T04:22:40.080118+0000 mgr.a (mgr.14388) 15937 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:40 smithi049 bash[23528]: cluster 2024-09-21T04:22:40.080118+0000 mgr.a (mgr.14388) 15937 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:42.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:42.097 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:42.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:42.874 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:42.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:42.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:42.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:42.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:42 smithi044 bash[22676]: audit 2024-09-21T04:22:41.724437+0000 mon.a (mon.0) 12742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:42 smithi044 bash[22676]: audit 2024-09-21T04:22:41.732607+0000 mon.a (mon.0) 12743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:42 smithi044 bash[22676]: audit 2024-09-21T04:22:41.743551+0000 mon.a (mon.0) 12744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:42 smithi044 bash[22676]: cluster 2024-09-21T04:22:42.081405+0000 mgr.a (mgr.14388) 15938 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:42 smithi044 bash[22676]: audit 2024-09-21T04:22:42.146048+0000 mon.a (mon.0) 12745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:42 smithi044 bash[22676]: audit 2024-09-21T04:22:42.154115+0000 mon.a (mon.0) 12746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:42 smithi044 bash[22676]: audit 2024-09-21T04:22:42.163445+0000 mon.a (mon.0) 12747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:42 smithi179 bash[23186]: audit 2024-09-21T04:22:41.724437+0000 mon.a (mon.0) 12742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:42 smithi179 bash[23186]: audit 2024-09-21T04:22:41.732607+0000 mon.a (mon.0) 12743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:42 smithi179 bash[23186]: audit 2024-09-21T04:22:41.743551+0000 mon.a (mon.0) 12744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:42 smithi179 bash[23186]: cluster 2024-09-21T04:22:42.081405+0000 mgr.a (mgr.14388) 15938 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:42 smithi179 bash[23186]: audit 2024-09-21T04:22:42.146048+0000 mon.a (mon.0) 12745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:42 smithi179 bash[23186]: audit 2024-09-21T04:22:42.154115+0000 mon.a (mon.0) 12746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:42 smithi179 bash[23186]: audit 2024-09-21T04:22:42.163445+0000 mon.a (mon.0) 12747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:42 smithi049 bash[23528]: audit 2024-09-21T04:22:41.724437+0000 mon.a (mon.0) 12742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:42 smithi049 bash[23528]: audit 2024-09-21T04:22:41.732607+0000 mon.a (mon.0) 12743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:42 smithi049 bash[23528]: audit 2024-09-21T04:22:41.743551+0000 mon.a (mon.0) 12744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:42 smithi049 bash[23528]: cluster 2024-09-21T04:22:42.081405+0000 mgr.a (mgr.14388) 15938 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:42 smithi049 bash[23528]: audit 2024-09-21T04:22:42.146048+0000 mon.a (mon.0) 12745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:42 smithi049 bash[23528]: audit 2024-09-21T04:22:42.154115+0000 mon.a (mon.0) 12746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:42 smithi049 bash[23528]: audit 2024-09-21T04:22:42.163445+0000 mon.a (mon.0) 12747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:43 smithi179 bash[23186]: audit 2024-09-21T04:22:42.435655+0000 mgr.a (mgr.14388) 15939 : audit [DBG] from='client.344385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:43 smithi049 bash[23528]: audit 2024-09-21T04:22:42.435655+0000 mgr.a (mgr.14388) 15939 : audit [DBG] from='client.344385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:43 smithi044 bash[22676]: audit 2024-09-21T04:22:42.435655+0000 mgr.a (mgr.14388) 15939 : audit [DBG] from='client.344385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:44 smithi049 bash[23528]: cluster 2024-09-21T04:22:44.082351+0000 mgr.a (mgr.14388) 15940 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:44 smithi044 bash[22676]: cluster 2024-09-21T04:22:44.082351+0000 mgr.a (mgr.14388) 15940 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:44 smithi179 bash[23186]: cluster 2024-09-21T04:22:44.082351+0000 mgr.a (mgr.14388) 15940 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:46 smithi044 bash[22676]: cluster 2024-09-21T04:22:46.084631+0000 mgr.a (mgr.14388) 15941 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:22:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:46 smithi179 bash[23186]: cluster 2024-09-21T04:22:46.084631+0000 mgr.a (mgr.14388) 15941 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:22:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:46 smithi049 bash[23528]: cluster 2024-09-21T04:22:46.084631+0000 mgr.a (mgr.14388) 15941 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:22:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:47.876 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:47.876 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:48.249 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:48 smithi049 bash[23528]: cluster 2024-09-21T04:22:48.085408+0000 mgr.a (mgr.14388) 15942 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:48 smithi044 bash[22676]: cluster 2024-09-21T04:22:48.085408+0000 mgr.a (mgr.14388) 15942 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:48 smithi179 bash[23186]: cluster 2024-09-21T04:22:48.085408+0000 mgr.a (mgr.14388) 15942 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:48.668 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:48.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:49 smithi049 bash[23528]: audit 2024-09-21T04:22:48.209295+0000 mgr.a (mgr.14388) 15943 : audit [DBG] from='client.344457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:49 smithi044 bash[22676]: audit 2024-09-21T04:22:48.209295+0000 mgr.a (mgr.14388) 15943 : audit [DBG] from='client.344457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:49 smithi179 bash[23186]: audit 2024-09-21T04:22:48.209295+0000 mgr.a (mgr.14388) 15943 : audit [DBG] from='client.344457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:50 smithi044 bash[22676]: cluster 2024-09-21T04:22:50.087410+0000 mgr.a (mgr.14388) 15944 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:50.499 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:50 smithi049 bash[23528]: cluster 2024-09-21T04:22:50.087410+0000 mgr.a (mgr.14388) 15944 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:50 smithi179 bash[23186]: cluster 2024-09-21T04:22:50.087410+0000 mgr.a (mgr.14388) 15944 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:22:51.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22930]: debug 2024-09-21T04:22:51.056+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22930]: debug 2024-09-21T04:22:51.060+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:50.233201+0000 mon.a (mon.0) 12748 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:50.241139+0000 mon.a (mon.0) 12749 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:50.243477+0000 mon.a (mon.0) 12750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:50.255315+0000 mon.a (mon.0) 12751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:50.262493+0000 mon.a (mon.0) 12752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:50.264873+0000 mgr.a (mgr.14388) 15945 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:51.060629+0000 mgr.a (mgr.14388) 15946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: cephadm 2024-09-21T04:22:51.062157+0000 mgr.a (mgr.14388) 15947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:22:51.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:51.079659+0000 mon.a (mon.0) 12753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:51.085269+0000 mon.a (mon.0) 12754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:51 smithi044 bash[22676]: audit 2024-09-21T04:22:51.091129+0000 mon.a (mon.0) 12755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:50.233201+0000 mon.a (mon.0) 12748 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:50.241139+0000 mon.a (mon.0) 12749 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:50.243477+0000 mon.a (mon.0) 12750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:50.255315+0000 mon.a (mon.0) 12751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:50.262493+0000 mon.a (mon.0) 12752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:50.264873+0000 mgr.a (mgr.14388) 15945 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:51.060629+0000 mgr.a (mgr.14388) 15946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: cephadm 2024-09-21T04:22:51.062157+0000 mgr.a (mgr.14388) 15947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:51.079659+0000 mon.a (mon.0) 12753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:51.085269+0000 mon.a (mon.0) 12754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:51 smithi179 bash[23186]: audit 2024-09-21T04:22:51.091129+0000 mon.a (mon.0) 12755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:50.233201+0000 mon.a (mon.0) 12748 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:22:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:50.241139+0000 mon.a (mon.0) 12749 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:22:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:50.243477+0000 mon.a (mon.0) 12750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:22:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:50.255315+0000 mon.a (mon.0) 12751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:50.262493+0000 mon.a (mon.0) 12752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:22:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:50.264873+0000 mgr.a (mgr.14388) 15945 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:22:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:51.060629+0000 mgr.a (mgr.14388) 15946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:22:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: cephadm 2024-09-21T04:22:51.062157+0000 mgr.a (mgr.14388) 15947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:22:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:51.079659+0000 mon.a (mon.0) 12753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:51.085269+0000 mon.a (mon.0) 12754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:51 smithi049 bash[23528]: audit 2024-09-21T04:22:51.091129+0000 mon.a (mon.0) 12755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:22:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:52 smithi044 bash[22676]: cluster 2024-09-21T04:22:52.089368+0000 mgr.a (mgr.14388) 15948 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:52 smithi179 bash[23186]: cluster 2024-09-21T04:22:52.089368+0000 mgr.a (mgr.14388) 15948 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:52 smithi049 bash[23528]: cluster 2024-09-21T04:22:52.089368+0000 mgr.a (mgr.14388) 15948 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:22:53.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:53.671 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:53.671 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:22:54.430 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:22:54.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:22:54.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:22:54.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:22:54.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:22:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:54 smithi044 bash[22676]: audit 2024-09-21T04:22:53.997400+0000 mgr.a (mgr.14388) 15949 : audit [DBG] from='client.344640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:54 smithi044 bash[22676]: cluster 2024-09-21T04:22:54.089908+0000 mgr.a (mgr.14388) 15950 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:54 smithi179 bash[23186]: audit 2024-09-21T04:22:53.997400+0000 mgr.a (mgr.14388) 15949 : audit [DBG] from='client.344640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:54 smithi179 bash[23186]: cluster 2024-09-21T04:22:54.089908+0000 mgr.a (mgr.14388) 15950 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:54 smithi049 bash[23528]: audit 2024-09-21T04:22:53.997400+0000 mgr.a (mgr.14388) 15949 : audit [DBG] from='client.344640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:22:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:54 smithi049 bash[23528]: cluster 2024-09-21T04:22:54.089908+0000 mgr.a (mgr.14388) 15950 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:22:56.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:56 smithi044 bash[22676]: cluster 2024-09-21T04:22:56.092316+0000 mgr.a (mgr.14388) 15951 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:56.454 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:56 smithi179 bash[23186]: cluster 2024-09-21T04:22:56.092316+0000 mgr.a (mgr.14388) 15951 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:56 smithi049 bash[23528]: cluster 2024-09-21T04:22:56.092316+0000 mgr.a (mgr.14388) 15951 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:58.434 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:22:58 smithi049 bash[23528]: cluster 2024-09-21T04:22:58.093085+0000 mgr.a (mgr.14388) 15952 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:22:58 smithi044 bash[22676]: cluster 2024-09-21T04:22:58.093085+0000 mgr.a (mgr.14388) 15952 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:22:58 smithi179 bash[23186]: cluster 2024-09-21T04:22:58.093085+0000 mgr.a (mgr.14388) 15952 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:22:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:22:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:22:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:00.222 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:00.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:00.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:00 smithi044 bash[22676]: audit 2024-09-21T04:22:59.766254+0000 mgr.a (mgr.14388) 15953 : audit [DBG] from='client.344718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:00.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:00 smithi044 bash[22676]: cluster 2024-09-21T04:23:00.094437+0000 mgr.a (mgr.14388) 15954 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:00.509 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:00 smithi179 bash[23186]: audit 2024-09-21T04:22:59.766254+0000 mgr.a (mgr.14388) 15953 : audit [DBG] from='client.344718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:00.509 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:00 smithi179 bash[23186]: cluster 2024-09-21T04:23:00.094437+0000 mgr.a (mgr.14388) 15954 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:00 smithi049 bash[23528]: audit 2024-09-21T04:22:59.766254+0000 mgr.a (mgr.14388) 15953 : audit [DBG] from='client.344718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:00 smithi049 bash[23528]: cluster 2024-09-21T04:23:00.094437+0000 mgr.a (mgr.14388) 15954 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:02 smithi044 bash[22676]: audit 2024-09-21T04:23:01.956944+0000 mon.a (mon.0) 12756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:02 smithi044 bash[22676]: audit 2024-09-21T04:23:01.965226+0000 mon.a (mon.0) 12757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:02 smithi044 bash[22676]: audit 2024-09-21T04:23:01.975976+0000 mon.a (mon.0) 12758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:02 smithi044 bash[22676]: cluster 2024-09-21T04:23:02.095964+0000 mgr.a (mgr.14388) 15955 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:23:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:02 smithi044 bash[22676]: audit 2024-09-21T04:23:02.360465+0000 mon.a (mon.0) 12759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:02 smithi044 bash[22676]: audit 2024-09-21T04:23:02.369111+0000 mon.a (mon.0) 12760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:02 smithi044 bash[22676]: audit 2024-09-21T04:23:02.379319+0000 mon.a (mon.0) 12761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:02 smithi179 bash[23186]: audit 2024-09-21T04:23:01.956944+0000 mon.a (mon.0) 12756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:02 smithi179 bash[23186]: audit 2024-09-21T04:23:01.965226+0000 mon.a (mon.0) 12757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:02 smithi179 bash[23186]: audit 2024-09-21T04:23:01.975976+0000 mon.a (mon.0) 12758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:02 smithi179 bash[23186]: cluster 2024-09-21T04:23:02.095964+0000 mgr.a (mgr.14388) 15955 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:23:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:02 smithi179 bash[23186]: audit 2024-09-21T04:23:02.360465+0000 mon.a (mon.0) 12759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:02 smithi179 bash[23186]: audit 2024-09-21T04:23:02.369111+0000 mon.a (mon.0) 12760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:02 smithi179 bash[23186]: audit 2024-09-21T04:23:02.379319+0000 mon.a (mon.0) 12761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:02 smithi049 bash[23528]: audit 2024-09-21T04:23:01.956944+0000 mon.a (mon.0) 12756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:02 smithi049 bash[23528]: audit 2024-09-21T04:23:01.965226+0000 mon.a (mon.0) 12757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:02 smithi049 bash[23528]: audit 2024-09-21T04:23:01.975976+0000 mon.a (mon.0) 12758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:02 smithi049 bash[23528]: cluster 2024-09-21T04:23:02.095964+0000 mgr.a (mgr.14388) 15955 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:23:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:02 smithi049 bash[23528]: audit 2024-09-21T04:23:02.360465+0000 mon.a (mon.0) 12759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:02 smithi049 bash[23528]: audit 2024-09-21T04:23:02.369111+0000 mon.a (mon.0) 12760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:02 smithi049 bash[23528]: audit 2024-09-21T04:23:02.379319+0000 mon.a (mon.0) 12761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:04 smithi044 bash[22676]: cluster 2024-09-21T04:23:04.096754+0000 mgr.a (mgr.14388) 15956 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:23:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:04 smithi179 bash[23186]: cluster 2024-09-21T04:23:04.096754+0000 mgr.a (mgr.14388) 15956 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:23:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:04 smithi049 bash[23528]: cluster 2024-09-21T04:23:04.096754+0000 mgr.a (mgr.14388) 15956 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:23:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:05.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:05.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:05.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:05.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:05.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:05.973 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:06 smithi044 bash[22676]: audit 2024-09-21T04:23:05.548929+0000 mgr.a (mgr.14388) 15957 : audit [DBG] from='client.344796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:06 smithi179 bash[23186]: audit 2024-09-21T04:23:05.548929+0000 mgr.a (mgr.14388) 15957 : audit [DBG] from='client.344796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:06.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:06 smithi049 bash[23528]: audit 2024-09-21T04:23:05.548929+0000 mgr.a (mgr.14388) 15957 : audit [DBG] from='client.344796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:07 smithi044 bash[22676]: cluster 2024-09-21T04:23:06.098248+0000 mgr.a (mgr.14388) 15958 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:07 smithi179 bash[23186]: cluster 2024-09-21T04:23:06.098248+0000 mgr.a (mgr.14388) 15958 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:07 smithi049 bash[23528]: cluster 2024-09-21T04:23:06.098248+0000 mgr.a (mgr.14388) 15958 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:09 smithi044 bash[22676]: cluster 2024-09-21T04:23:08.098989+0000 mgr.a (mgr.14388) 15959 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:23:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:09 smithi179 bash[23186]: cluster 2024-09-21T04:23:08.098989+0000 mgr.a (mgr.14388) 15959 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:23:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:09 smithi049 bash[23528]: cluster 2024-09-21T04:23:08.098989+0000 mgr.a (mgr.14388) 15959 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:23:10.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:10.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:10.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:11 smithi044 bash[22676]: cluster 2024-09-21T04:23:10.100578+0000 mgr.a (mgr.14388) 15960 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:23:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:11 smithi179 bash[23186]: cluster 2024-09-21T04:23:10.100578+0000 mgr.a (mgr.14388) 15960 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:23:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:11 smithi049 bash[23528]: cluster 2024-09-21T04:23:10.100578+0000 mgr.a (mgr.14388) 15960 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:23:11.775 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:11.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:11.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:11.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:11.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:12 smithi044 bash[22676]: audit 2024-09-21T04:23:11.221970+0000 mon.a (mon.0) 12762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:12 smithi044 bash[22676]: audit 2024-09-21T04:23:11.231059+0000 mon.a (mon.0) 12763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:12 smithi044 bash[22676]: audit 2024-09-21T04:23:11.241504+0000 mon.a (mon.0) 12764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:12 smithi044 bash[22676]: audit 2024-09-21T04:23:11.314499+0000 mgr.a (mgr.14388) 15961 : audit [DBG] from='client.344874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:12 smithi179 bash[23186]: audit 2024-09-21T04:23:11.221970+0000 mon.a (mon.0) 12762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:12 smithi179 bash[23186]: audit 2024-09-21T04:23:11.231059+0000 mon.a (mon.0) 12763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:12 smithi179 bash[23186]: audit 2024-09-21T04:23:11.241504+0000 mon.a (mon.0) 12764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:12 smithi179 bash[23186]: audit 2024-09-21T04:23:11.314499+0000 mgr.a (mgr.14388) 15961 : audit [DBG] from='client.344874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:12 smithi049 bash[23528]: audit 2024-09-21T04:23:11.221970+0000 mon.a (mon.0) 12762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:12 smithi049 bash[23528]: audit 2024-09-21T04:23:11.231059+0000 mon.a (mon.0) 12763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:12 smithi049 bash[23528]: audit 2024-09-21T04:23:11.241504+0000 mon.a (mon.0) 12764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:12 smithi049 bash[23528]: audit 2024-09-21T04:23:11.314499+0000 mgr.a (mgr.14388) 15961 : audit [DBG] from='client.344874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:13 smithi179 bash[23186]: cluster 2024-09-21T04:23:12.102524+0000 mgr.a (mgr.14388) 15962 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:23:13.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:13 smithi049 bash[23528]: cluster 2024-09-21T04:23:12.102524+0000 mgr.a (mgr.14388) 15962 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:23:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:13 smithi044 bash[22676]: cluster 2024-09-21T04:23:12.102524+0000 mgr.a (mgr.14388) 15962 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:23:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:15 smithi179 bash[23186]: cluster 2024-09-21T04:23:14.103366+0000 mgr.a (mgr.14388) 15963 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:23:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:15 smithi049 bash[23528]: cluster 2024-09-21T04:23:14.103366+0000 mgr.a (mgr.14388) 15963 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:23:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:15 smithi044 bash[22676]: cluster 2024-09-21T04:23:14.103366+0000 mgr.a (mgr.14388) 15963 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:23:16.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:16.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:17 smithi179 bash[23186]: cluster 2024-09-21T04:23:16.104543+0000 mgr.a (mgr.14388) 15964 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:23:17.543 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:17.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:17.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:17.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:17.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:17 smithi049 bash[23528]: cluster 2024-09-21T04:23:16.104543+0000 mgr.a (mgr.14388) 15964 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:23:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:17 smithi044 bash[22676]: cluster 2024-09-21T04:23:16.104543+0000 mgr.a (mgr.14388) 15964 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:23:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:18 smithi049 bash[23528]: audit 2024-09-21T04:23:17.103867+0000 mgr.a (mgr.14388) 15965 : audit [DBG] from='client.344952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:18.567 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:18 smithi044 bash[22676]: audit 2024-09-21T04:23:17.103867+0000 mgr.a (mgr.14388) 15965 : audit [DBG] from='client.344952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:18 smithi179 bash[23186]: audit 2024-09-21T04:23:17.103867+0000 mgr.a (mgr.14388) 15965 : audit [DBG] from='client.344952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:19 smithi049 bash[23528]: cluster 2024-09-21T04:23:18.105455+0000 mgr.a (mgr.14388) 15966 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:19 smithi179 bash[23186]: cluster 2024-09-21T04:23:18.105455+0000 mgr.a (mgr.14388) 15966 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:19 smithi044 bash[22676]: cluster 2024-09-21T04:23:18.105455+0000 mgr.a (mgr.14388) 15966 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:21 smithi049 bash[23528]: cluster 2024-09-21T04:23:20.107396+0000 mgr.a (mgr.14388) 15967 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:23:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:21 smithi044 bash[22676]: cluster 2024-09-21T04:23:20.107396+0000 mgr.a (mgr.14388) 15967 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:23:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:21 smithi179 bash[23186]: cluster 2024-09-21T04:23:20.107396+0000 mgr.a (mgr.14388) 15967 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:23:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:23.342 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: cluster 2024-09-21T04:23:22.108399+0000 mgr.a (mgr.14388) 15968 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:23:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: audit 2024-09-21T04:23:22.163644+0000 mon.a (mon.0) 12765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: audit 2024-09-21T04:23:22.170600+0000 mon.a (mon.0) 12766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: audit 2024-09-21T04:23:22.179815+0000 mon.a (mon.0) 12767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: audit 2024-09-21T04:23:22.566647+0000 mon.a (mon.0) 12768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: audit 2024-09-21T04:23:22.572814+0000 mon.a (mon.0) 12769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: audit 2024-09-21T04:23:22.580928+0000 mon.a (mon.0) 12770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:23 smithi044 bash[22676]: audit 2024-09-21T04:23:22.885771+0000 mgr.a (mgr.14388) 15969 : audit [DBG] from='client.345030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: cluster 2024-09-21T04:23:22.108399+0000 mgr.a (mgr.14388) 15968 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:23:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: audit 2024-09-21T04:23:22.163644+0000 mon.a (mon.0) 12765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: audit 2024-09-21T04:23:22.170600+0000 mon.a (mon.0) 12766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: audit 2024-09-21T04:23:22.179815+0000 mon.a (mon.0) 12767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: audit 2024-09-21T04:23:22.566647+0000 mon.a (mon.0) 12768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: audit 2024-09-21T04:23:22.572814+0000 mon.a (mon.0) 12769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: audit 2024-09-21T04:23:22.580928+0000 mon.a (mon.0) 12770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:23 smithi179 bash[23186]: audit 2024-09-21T04:23:22.885771+0000 mgr.a (mgr.14388) 15969 : audit [DBG] from='client.345030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: cluster 2024-09-21T04:23:22.108399+0000 mgr.a (mgr.14388) 15968 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:23:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: audit 2024-09-21T04:23:22.163644+0000 mon.a (mon.0) 12765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: audit 2024-09-21T04:23:22.170600+0000 mon.a (mon.0) 12766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: audit 2024-09-21T04:23:22.179815+0000 mon.a (mon.0) 12767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: audit 2024-09-21T04:23:22.566647+0000 mon.a (mon.0) 12768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: audit 2024-09-21T04:23:22.572814+0000 mon.a (mon.0) 12769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: audit 2024-09-21T04:23:22.580928+0000 mon.a (mon.0) 12770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:23 smithi049 bash[23528]: audit 2024-09-21T04:23:22.885771+0000 mgr.a (mgr.14388) 15969 : audit [DBG] from='client.345030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:25 smithi044 bash[22676]: cluster 2024-09-21T04:23:24.108911+0000 mgr.a (mgr.14388) 15970 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:25 smithi179 bash[23186]: cluster 2024-09-21T04:23:24.108911+0000 mgr.a (mgr.14388) 15970 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:25 smithi049 bash[23528]: cluster 2024-09-21T04:23:24.108911+0000 mgr.a (mgr.14388) 15970 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:27 smithi044 bash[22676]: cluster 2024-09-21T04:23:26.111078+0000 mgr.a (mgr.14388) 15971 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:23:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:27 smithi179 bash[23186]: cluster 2024-09-21T04:23:26.111078+0000 mgr.a (mgr.14388) 15971 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:23:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:27 smithi049 bash[23528]: cluster 2024-09-21T04:23:26.111078+0000 mgr.a (mgr.14388) 15971 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:23:28.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:28.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:28.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:29.105 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:29 smithi044 bash[22676]: cluster 2024-09-21T04:23:28.111826+0000 mgr.a (mgr.14388) 15972 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:29 smithi044 bash[22676]: audit 2024-09-21T04:23:28.673762+0000 mgr.a (mgr.14388) 15973 : audit [DBG] from='client.345108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:29 smithi179 bash[23186]: cluster 2024-09-21T04:23:28.111826+0000 mgr.a (mgr.14388) 15972 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:29 smithi179 bash[23186]: audit 2024-09-21T04:23:28.673762+0000 mgr.a (mgr.14388) 15973 : audit [DBG] from='client.345108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:29 smithi049 bash[23528]: cluster 2024-09-21T04:23:28.111826+0000 mgr.a (mgr.14388) 15972 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:29 smithi049 bash[23528]: audit 2024-09-21T04:23:28.673762+0000 mgr.a (mgr.14388) 15973 : audit [DBG] from='client.345108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:31 smithi044 bash[22676]: cluster 2024-09-21T04:23:30.113733+0000 mgr.a (mgr.14388) 15974 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:23:31.493 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:31 smithi049 bash[23528]: cluster 2024-09-21T04:23:30.113733+0000 mgr.a (mgr.14388) 15974 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:23:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:31 smithi179 bash[23186]: cluster 2024-09-21T04:23:30.113733+0000 mgr.a (mgr.14388) 15974 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:23:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:32 smithi044 bash[22676]: audit 2024-09-21T04:23:31.397039+0000 mon.a (mon.0) 12771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:32 smithi044 bash[22676]: audit 2024-09-21T04:23:31.405828+0000 mon.a (mon.0) 12772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:32 smithi044 bash[22676]: audit 2024-09-21T04:23:31.416523+0000 mon.a (mon.0) 12773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:32 smithi179 bash[23186]: audit 2024-09-21T04:23:31.397039+0000 mon.a (mon.0) 12771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:32 smithi179 bash[23186]: audit 2024-09-21T04:23:31.405828+0000 mon.a (mon.0) 12772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:32 smithi179 bash[23186]: audit 2024-09-21T04:23:31.416523+0000 mon.a (mon.0) 12773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:32 smithi049 bash[23528]: audit 2024-09-21T04:23:31.397039+0000 mon.a (mon.0) 12771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:32 smithi049 bash[23528]: audit 2024-09-21T04:23:31.405828+0000 mon.a (mon.0) 12772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:32 smithi049 bash[23528]: audit 2024-09-21T04:23:31.416523+0000 mon.a (mon.0) 12773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:33 smithi044 bash[22676]: cluster 2024-09-21T04:23:32.115009+0000 mgr.a (mgr.14388) 15975 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:23:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:33 smithi179 bash[23186]: cluster 2024-09-21T04:23:32.115009+0000 mgr.a (mgr.14388) 15975 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:23:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:33 smithi049 bash[23528]: cluster 2024-09-21T04:23:32.115009+0000 mgr.a (mgr.14388) 15975 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:23:34.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:34.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:34.107 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:34.897 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:34.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:34.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:34.898 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:34.898 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:35 smithi044 bash[22676]: cluster 2024-09-21T04:23:34.115745+0000 mgr.a (mgr.14388) 15976 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:35 smithi044 bash[22676]: audit 2024-09-21T04:23:34.447467+0000 mgr.a (mgr.14388) 15977 : audit [DBG] from='client.345186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:35 smithi179 bash[23186]: cluster 2024-09-21T04:23:34.115745+0000 mgr.a (mgr.14388) 15976 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:35 smithi179 bash[23186]: audit 2024-09-21T04:23:34.447467+0000 mgr.a (mgr.14388) 15977 : audit [DBG] from='client.345186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:35 smithi049 bash[23528]: cluster 2024-09-21T04:23:34.115745+0000 mgr.a (mgr.14388) 15976 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:35 smithi049 bash[23528]: audit 2024-09-21T04:23:34.447467+0000 mgr.a (mgr.14388) 15977 : audit [DBG] from='client.345186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:37 smithi179 bash[23186]: cluster 2024-09-21T04:23:36.118129+0000 mgr.a (mgr.14388) 15978 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:23:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:37 smithi044 bash[22676]: cluster 2024-09-21T04:23:36.118129+0000 mgr.a (mgr.14388) 15978 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:23:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:37 smithi049 bash[23528]: cluster 2024-09-21T04:23:36.118129+0000 mgr.a (mgr.14388) 15978 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:23:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:39 smithi044 bash[22676]: cluster 2024-09-21T04:23:38.118641+0000 mgr.a (mgr.14388) 15979 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:39 smithi179 bash[23186]: cluster 2024-09-21T04:23:38.118641+0000 mgr.a (mgr.14388) 15979 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:39 smithi049 bash[23528]: cluster 2024-09-21T04:23:38.118641+0000 mgr.a (mgr.14388) 15979 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:39.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:39.899 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:39.900 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:40.698 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:41 smithi044 bash[22676]: cluster 2024-09-21T04:23:40.120181+0000 mgr.a (mgr.14388) 15980 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:41 smithi044 bash[22676]: audit 2024-09-21T04:23:40.237528+0000 mgr.a (mgr.14388) 15981 : audit [DBG] from='client.345261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:41 smithi179 bash[23186]: cluster 2024-09-21T04:23:40.120181+0000 mgr.a (mgr.14388) 15980 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:41 smithi179 bash[23186]: audit 2024-09-21T04:23:40.237528+0000 mgr.a (mgr.14388) 15981 : audit [DBG] from='client.345261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:41 smithi049 bash[23528]: cluster 2024-09-21T04:23:40.120181+0000 mgr.a (mgr.14388) 15980 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:41 smithi049 bash[23528]: audit 2024-09-21T04:23:40.237528+0000 mgr.a (mgr.14388) 15981 : audit [DBG] from='client.345261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:43 smithi044 bash[22676]: cluster 2024-09-21T04:23:42.121914+0000 mgr.a (mgr.14388) 15982 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:23:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:43 smithi044 bash[22676]: audit 2024-09-21T04:23:42.401516+0000 mon.a (mon.0) 12774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:43 smithi044 bash[22676]: audit 2024-09-21T04:23:42.410145+0000 mon.a (mon.0) 12775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:43 smithi044 bash[22676]: audit 2024-09-21T04:23:42.421072+0000 mon.a (mon.0) 12776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:43 smithi044 bash[22676]: audit 2024-09-21T04:23:42.789470+0000 mon.a (mon.0) 12777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:43 smithi044 bash[22676]: audit 2024-09-21T04:23:42.798270+0000 mon.a (mon.0) 12778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:43 smithi044 bash[22676]: audit 2024-09-21T04:23:42.808482+0000 mon.a (mon.0) 12779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:43 smithi179 bash[23186]: cluster 2024-09-21T04:23:42.121914+0000 mgr.a (mgr.14388) 15982 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:23:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:43 smithi179 bash[23186]: audit 2024-09-21T04:23:42.401516+0000 mon.a (mon.0) 12774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:43 smithi179 bash[23186]: audit 2024-09-21T04:23:42.410145+0000 mon.a (mon.0) 12775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:43 smithi179 bash[23186]: audit 2024-09-21T04:23:42.421072+0000 mon.a (mon.0) 12776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:43 smithi179 bash[23186]: audit 2024-09-21T04:23:42.789470+0000 mon.a (mon.0) 12777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:43 smithi179 bash[23186]: audit 2024-09-21T04:23:42.798270+0000 mon.a (mon.0) 12778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:43 smithi179 bash[23186]: audit 2024-09-21T04:23:42.808482+0000 mon.a (mon.0) 12779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:43 smithi049 bash[23528]: cluster 2024-09-21T04:23:42.121914+0000 mgr.a (mgr.14388) 15982 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:23:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:43 smithi049 bash[23528]: audit 2024-09-21T04:23:42.401516+0000 mon.a (mon.0) 12774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:43 smithi049 bash[23528]: audit 2024-09-21T04:23:42.410145+0000 mon.a (mon.0) 12775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:43 smithi049 bash[23528]: audit 2024-09-21T04:23:42.421072+0000 mon.a (mon.0) 12776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:43 smithi049 bash[23528]: audit 2024-09-21T04:23:42.789470+0000 mon.a (mon.0) 12777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:43 smithi049 bash[23528]: audit 2024-09-21T04:23:42.798270+0000 mon.a (mon.0) 12778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:43 smithi049 bash[23528]: audit 2024-09-21T04:23:42.808482+0000 mon.a (mon.0) 12779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:45.700 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:45.701 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:45.701 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:45 smithi044 bash[22676]: cluster 2024-09-21T04:23:44.122688+0000 mgr.a (mgr.14388) 15983 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:23:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:45 smithi179 bash[23186]: cluster 2024-09-21T04:23:44.122688+0000 mgr.a (mgr.14388) 15983 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:23:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:45 smithi049 bash[23528]: cluster 2024-09-21T04:23:44.122688+0000 mgr.a (mgr.14388) 15983 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:23:46.510 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:46.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:46 smithi044 bash[22676]: audit 2024-09-21T04:23:46.040733+0000 mgr.a (mgr.14388) 15984 : audit [DBG] from='client.345339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:46 smithi179 bash[23186]: audit 2024-09-21T04:23:46.040733+0000 mgr.a (mgr.14388) 15984 : audit [DBG] from='client.345339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:46 smithi049 bash[23528]: audit 2024-09-21T04:23:46.040733+0000 mgr.a (mgr.14388) 15984 : audit [DBG] from='client.345339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:47 smithi044 bash[22676]: cluster 2024-09-21T04:23:46.124704+0000 mgr.a (mgr.14388) 15985 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:47 smithi179 bash[23186]: cluster 2024-09-21T04:23:46.124704+0000 mgr.a (mgr.14388) 15985 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:47 smithi049 bash[23528]: cluster 2024-09-21T04:23:46.124704+0000 mgr.a (mgr.14388) 15985 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:49 smithi049 bash[23528]: cluster 2024-09-21T04:23:48.125709+0000 mgr.a (mgr.14388) 15986 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:23:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:49 smithi044 bash[22676]: cluster 2024-09-21T04:23:48.125709+0000 mgr.a (mgr.14388) 15986 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:23:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:49 smithi179 bash[23186]: cluster 2024-09-21T04:23:48.125709+0000 mgr.a (mgr.14388) 15986 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:23:51.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:51.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:51.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22676]: cluster 2024-09-21T04:23:50.127427+0000 mgr.a (mgr.14388) 15987 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:23:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22676]: audit 2024-09-21T04:23:51.132479+0000 mon.a (mon.0) 12780 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:23:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22676]: audit 2024-09-21T04:23:51.139720+0000 mon.a (mon.0) 12781 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:23:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22676]: audit 2024-09-21T04:23:51.141668+0000 mon.a (mon.0) 12782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:23:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22676]: audit 2024-09-21T04:23:51.152893+0000 mon.a (mon.0) 12783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22676]: audit 2024-09-21T04:23:51.159324+0000 mon.a (mon.0) 12784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:23:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:51 smithi179 bash[23186]: cluster 2024-09-21T04:23:50.127427+0000 mgr.a (mgr.14388) 15987 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:23:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:51 smithi179 bash[23186]: audit 2024-09-21T04:23:51.132479+0000 mon.a (mon.0) 12780 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:23:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:51 smithi179 bash[23186]: audit 2024-09-21T04:23:51.139720+0000 mon.a (mon.0) 12781 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:23:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:51 smithi179 bash[23186]: audit 2024-09-21T04:23:51.141668+0000 mon.a (mon.0) 12782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:23:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:51 smithi179 bash[23186]: audit 2024-09-21T04:23:51.152893+0000 mon.a (mon.0) 12783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:51 smithi179 bash[23186]: audit 2024-09-21T04:23:51.159324+0000 mon.a (mon.0) 12784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:23:51.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:51 smithi049 bash[23528]: cluster 2024-09-21T04:23:50.127427+0000 mgr.a (mgr.14388) 15987 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:23:51.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:51 smithi049 bash[23528]: audit 2024-09-21T04:23:51.132479+0000 mon.a (mon.0) 12780 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:23:51.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:51 smithi049 bash[23528]: audit 2024-09-21T04:23:51.139720+0000 mon.a (mon.0) 12781 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:23:51.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:51 smithi049 bash[23528]: audit 2024-09-21T04:23:51.141668+0000 mon.a (mon.0) 12782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:23:51.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:51 smithi049 bash[23528]: audit 2024-09-21T04:23:51.152893+0000 mon.a (mon.0) 12783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:51.766 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:51 smithi049 bash[23528]: audit 2024-09-21T04:23:51.159324+0000 mon.a (mon.0) 12784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:23:52.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22930]: debug 2024-09-21T04:23:51.935+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:23:52.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:23:51 smithi044 bash[22930]: debug 2024-09-21T04:23:51.947+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:23:52.352 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:52.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:52.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:52.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:52.352 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:52 smithi044 bash[22676]: audit 2024-09-21T04:23:51.161737+0000 mgr.a (mgr.14388) 15988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:23:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:52 smithi044 bash[22676]: audit 2024-09-21T04:23:51.579535+0000 mon.a (mon.0) 12785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:52 smithi044 bash[22676]: audit 2024-09-21T04:23:51.587371+0000 mon.a (mon.0) 12786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:52 smithi044 bash[22676]: audit 2024-09-21T04:23:51.594283+0000 mon.a (mon.0) 12787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:52 smithi044 bash[22676]: audit 2024-09-21T04:23:51.847560+0000 mgr.a (mgr.14388) 15989 : audit [DBG] from='client.345486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:52 smithi044 bash[22676]: audit 2024-09-21T04:23:51.940243+0000 mgr.a (mgr.14388) 15990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:23:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:52 smithi044 bash[22676]: cephadm 2024-09-21T04:23:51.951884+0000 mgr.a (mgr.14388) 15991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:23:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:52 smithi179 bash[23186]: audit 2024-09-21T04:23:51.161737+0000 mgr.a (mgr.14388) 15988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:23:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:52 smithi179 bash[23186]: audit 2024-09-21T04:23:51.579535+0000 mon.a (mon.0) 12785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:52 smithi179 bash[23186]: audit 2024-09-21T04:23:51.587371+0000 mon.a (mon.0) 12786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:52 smithi179 bash[23186]: audit 2024-09-21T04:23:51.594283+0000 mon.a (mon.0) 12787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:52 smithi179 bash[23186]: audit 2024-09-21T04:23:51.847560+0000 mgr.a (mgr.14388) 15989 : audit [DBG] from='client.345486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:52 smithi179 bash[23186]: audit 2024-09-21T04:23:51.940243+0000 mgr.a (mgr.14388) 15990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:23:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:52 smithi179 bash[23186]: cephadm 2024-09-21T04:23:51.951884+0000 mgr.a (mgr.14388) 15991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:23:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:52 smithi049 bash[23528]: audit 2024-09-21T04:23:51.161737+0000 mgr.a (mgr.14388) 15988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:23:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:52 smithi049 bash[23528]: audit 2024-09-21T04:23:51.579535+0000 mon.a (mon.0) 12785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:52 smithi049 bash[23528]: audit 2024-09-21T04:23:51.587371+0000 mon.a (mon.0) 12786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:52 smithi049 bash[23528]: audit 2024-09-21T04:23:51.594283+0000 mon.a (mon.0) 12787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:23:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:52 smithi049 bash[23528]: audit 2024-09-21T04:23:51.847560+0000 mgr.a (mgr.14388) 15989 : audit [DBG] from='client.345486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:52 smithi049 bash[23528]: audit 2024-09-21T04:23:51.940243+0000 mgr.a (mgr.14388) 15990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:23:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:52 smithi049 bash[23528]: cephadm 2024-09-21T04:23:51.951884+0000 mgr.a (mgr.14388) 15991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:23:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:53 smithi044 bash[22676]: cluster 2024-09-21T04:23:52.128654+0000 mgr.a (mgr.14388) 15992 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:53 smithi179 bash[23186]: cluster 2024-09-21T04:23:52.128654+0000 mgr.a (mgr.14388) 15992 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:53 smithi049 bash[23528]: cluster 2024-09-21T04:23:52.128654+0000 mgr.a (mgr.14388) 15992 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:55 smithi044 bash[22676]: cluster 2024-09-21T04:23:54.129653+0000 mgr.a (mgr.14388) 15993 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:55 smithi179 bash[23186]: cluster 2024-09-21T04:23:54.129653+0000 mgr.a (mgr.14388) 15993 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:55 smithi049 bash[23528]: cluster 2024-09-21T04:23:54.129653+0000 mgr.a (mgr.14388) 15993 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:23:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:23:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:23:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:23:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:57 smithi044 bash[22676]: cluster 2024-09-21T04:23:56.131544+0000 mgr.a (mgr.14388) 15994 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:57 smithi179 bash[23186]: cluster 2024-09-21T04:23:56.131544+0000 mgr.a (mgr.14388) 15994 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:57 smithi049 bash[23528]: cluster 2024-09-21T04:23:56.131544+0000 mgr.a (mgr.14388) 15994 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:58.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:23:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:23:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:23:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:23:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:23:58.965 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:58 smithi044 bash[22676]: audit 2024-09-21T04:23:57.688338+0000 mgr.a (mgr.14388) 15995 : audit [DBG] from='client.345603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:58 smithi179 bash[23186]: audit 2024-09-21T04:23:57.688338+0000 mgr.a (mgr.14388) 15995 : audit [DBG] from='client.345603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:58 smithi049 bash[23528]: audit 2024-09-21T04:23:57.688338+0000 mgr.a (mgr.14388) 15995 : audit [DBG] from='client.345603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:23:59.868 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:23:59 smithi179 bash[23186]: cluster 2024-09-21T04:23:58.132301+0000 mgr.a (mgr.14388) 15996 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:23:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:23:59 smithi044 bash[22676]: cluster 2024-09-21T04:23:58.132301+0000 mgr.a (mgr.14388) 15996 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:23:59 smithi049 bash[23528]: cluster 2024-09-21T04:23:58.132301+0000 mgr.a (mgr.14388) 15996 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:01 smithi044 bash[22676]: cluster 2024-09-21T04:24:00.134087+0000 mgr.a (mgr.14388) 15997 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:01 smithi179 bash[23186]: cluster 2024-09-21T04:24:00.134087+0000 mgr.a (mgr.14388) 15997 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:01 smithi049 bash[23528]: cluster 2024-09-21T04:24:00.134087+0000 mgr.a (mgr.14388) 15997 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:03.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:03.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:03.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:03.899 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:03.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:03.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:03.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:03 smithi044 bash[22676]: cluster 2024-09-21T04:24:02.135347+0000 mgr.a (mgr.14388) 15998 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:03 smithi044 bash[22676]: audit 2024-09-21T04:24:02.622078+0000 mon.a (mon.0) 12788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:03 smithi044 bash[22676]: audit 2024-09-21T04:24:02.632410+0000 mon.a (mon.0) 12789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:03 smithi044 bash[22676]: audit 2024-09-21T04:24:02.639362+0000 mon.a (mon.0) 12790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:03 smithi044 bash[22676]: audit 2024-09-21T04:24:03.016453+0000 mon.a (mon.0) 12791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:03 smithi044 bash[22676]: audit 2024-09-21T04:24:03.025041+0000 mon.a (mon.0) 12792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:03 smithi044 bash[22676]: audit 2024-09-21T04:24:03.035776+0000 mon.a (mon.0) 12793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:03 smithi179 bash[23186]: cluster 2024-09-21T04:24:02.135347+0000 mgr.a (mgr.14388) 15998 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:03 smithi179 bash[23186]: audit 2024-09-21T04:24:02.622078+0000 mon.a (mon.0) 12788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:03 smithi179 bash[23186]: audit 2024-09-21T04:24:02.632410+0000 mon.a (mon.0) 12789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:03 smithi179 bash[23186]: audit 2024-09-21T04:24:02.639362+0000 mon.a (mon.0) 12790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:03 smithi179 bash[23186]: audit 2024-09-21T04:24:03.016453+0000 mon.a (mon.0) 12791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:03 smithi179 bash[23186]: audit 2024-09-21T04:24:03.025041+0000 mon.a (mon.0) 12792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:03 smithi179 bash[23186]: audit 2024-09-21T04:24:03.035776+0000 mon.a (mon.0) 12793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:03 smithi049 bash[23528]: cluster 2024-09-21T04:24:02.135347+0000 mgr.a (mgr.14388) 15998 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:03 smithi049 bash[23528]: audit 2024-09-21T04:24:02.622078+0000 mon.a (mon.0) 12788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:03 smithi049 bash[23528]: audit 2024-09-21T04:24:02.632410+0000 mon.a (mon.0) 12789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:03 smithi049 bash[23528]: audit 2024-09-21T04:24:02.639362+0000 mon.a (mon.0) 12790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:03 smithi049 bash[23528]: audit 2024-09-21T04:24:03.016453+0000 mon.a (mon.0) 12791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:03 smithi049 bash[23528]: audit 2024-09-21T04:24:03.025041+0000 mon.a (mon.0) 12792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:03 smithi049 bash[23528]: audit 2024-09-21T04:24:03.035776+0000 mon.a (mon.0) 12793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:04 smithi044 bash[22676]: audit 2024-09-21T04:24:03.461697+0000 mgr.a (mgr.14388) 15999 : audit [DBG] from='client.345675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:04 smithi179 bash[23186]: audit 2024-09-21T04:24:03.461697+0000 mgr.a (mgr.14388) 15999 : audit [DBG] from='client.345675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:04 smithi049 bash[23528]: audit 2024-09-21T04:24:03.461697+0000 mgr.a (mgr.14388) 15999 : audit [DBG] from='client.345675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:05 smithi044 bash[22676]: cluster 2024-09-21T04:24:04.136271+0000 mgr.a (mgr.14388) 16000 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:05 smithi179 bash[23186]: cluster 2024-09-21T04:24:04.136271+0000 mgr.a (mgr.14388) 16000 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:05 smithi049 bash[23528]: cluster 2024-09-21T04:24:04.136271+0000 mgr.a (mgr.14388) 16000 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:07 smithi044 bash[22676]: cluster 2024-09-21T04:24:06.138597+0000 mgr.a (mgr.14388) 16001 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:07 smithi179 bash[23186]: cluster 2024-09-21T04:24:06.138597+0000 mgr.a (mgr.14388) 16001 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:07 smithi049 bash[23528]: cluster 2024-09-21T04:24:06.138597+0000 mgr.a (mgr.14388) 16001 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:08.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:08.901 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:08.901 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:09.691 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:09.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:09.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:09.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:09.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:09.886 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:09 smithi049 bash[23528]: cluster 2024-09-21T04:24:08.139396+0000 mgr.a (mgr.14388) 16002 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:09 smithi044 bash[22676]: cluster 2024-09-21T04:24:08.139396+0000 mgr.a (mgr.14388) 16002 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:09 smithi179 bash[23186]: cluster 2024-09-21T04:24:08.139396+0000 mgr.a (mgr.14388) 16002 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:10 smithi044 bash[22676]: audit 2024-09-21T04:24:09.236109+0000 mgr.a (mgr.14388) 16003 : audit [DBG] from='client.345753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:10 smithi179 bash[23186]: audit 2024-09-21T04:24:09.236109+0000 mgr.a (mgr.14388) 16003 : audit [DBG] from='client.345753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:10 smithi049 bash[23528]: audit 2024-09-21T04:24:09.236109+0000 mgr.a (mgr.14388) 16003 : audit [DBG] from='client.345753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:11 smithi044 bash[22676]: cluster 2024-09-21T04:24:10.141324+0000 mgr.a (mgr.14388) 16004 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:11 smithi179 bash[23186]: cluster 2024-09-21T04:24:10.141324+0000 mgr.a (mgr.14388) 16004 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:11 smithi049 bash[23528]: cluster 2024-09-21T04:24:10.141324+0000 mgr.a (mgr.14388) 16004 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:12 smithi044 bash[22676]: audit 2024-09-21T04:24:11.733329+0000 mon.a (mon.0) 12794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:12 smithi044 bash[22676]: audit 2024-09-21T04:24:11.742004+0000 mon.a (mon.0) 12795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:12 smithi044 bash[22676]: audit 2024-09-21T04:24:11.752415+0000 mon.a (mon.0) 12796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:12 smithi179 bash[23186]: audit 2024-09-21T04:24:11.733329+0000 mon.a (mon.0) 12794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:12 smithi179 bash[23186]: audit 2024-09-21T04:24:11.742004+0000 mon.a (mon.0) 12795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:12 smithi179 bash[23186]: audit 2024-09-21T04:24:11.752415+0000 mon.a (mon.0) 12796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:12 smithi049 bash[23528]: audit 2024-09-21T04:24:11.733329+0000 mon.a (mon.0) 12794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:12 smithi049 bash[23528]: audit 2024-09-21T04:24:11.742004+0000 mon.a (mon.0) 12795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:12 smithi049 bash[23528]: audit 2024-09-21T04:24:11.752415+0000 mon.a (mon.0) 12796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:13 smithi049 bash[23528]: cluster 2024-09-21T04:24:12.142592+0000 mgr.a (mgr.14388) 16005 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:13 smithi044 bash[22676]: cluster 2024-09-21T04:24:12.142592+0000 mgr.a (mgr.14388) 16005 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:13 smithi179 bash[23186]: cluster 2024-09-21T04:24:12.142592+0000 mgr.a (mgr.14388) 16005 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:15.486 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:15 smithi044 bash[22676]: cluster 2024-09-21T04:24:14.143354+0000 mgr.a (mgr.14388) 16006 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:15 smithi044 bash[22676]: audit 2024-09-21T04:24:15.033217+0000 mgr.a (mgr.14388) 16007 : audit [DBG] from='client.345831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:15 smithi049 bash[23528]: cluster 2024-09-21T04:24:14.143354+0000 mgr.a (mgr.14388) 16006 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:15 smithi049 bash[23528]: audit 2024-09-21T04:24:15.033217+0000 mgr.a (mgr.14388) 16007 : audit [DBG] from='client.345831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:15 smithi179 bash[23186]: cluster 2024-09-21T04:24:14.143354+0000 mgr.a (mgr.14388) 16006 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:15 smithi179 bash[23186]: audit 2024-09-21T04:24:15.033217+0000 mgr.a (mgr.14388) 16007 : audit [DBG] from='client.345831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:17.928 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:17 smithi179 bash[23186]: cluster 2024-09-21T04:24:16.146294+0000 mgr.a (mgr.14388) 16008 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:17 smithi044 bash[22676]: cluster 2024-09-21T04:24:16.146294+0000 mgr.a (mgr.14388) 16008 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:17 smithi049 bash[23528]: cluster 2024-09-21T04:24:16.146294+0000 mgr.a (mgr.14388) 16008 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:20.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:19 smithi179 bash[23186]: cluster 2024-09-21T04:24:18.147103+0000 mgr.a (mgr.14388) 16009 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:24:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:19 smithi049 bash[23528]: cluster 2024-09-21T04:24:18.147103+0000 mgr.a (mgr.14388) 16009 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:24:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:19 smithi044 bash[22676]: cluster 2024-09-21T04:24:18.147103+0000 mgr.a (mgr.14388) 16009 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:24:20.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:20.488 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:20.488 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:21.248 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:21.248 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:21 smithi049 bash[23528]: cluster 2024-09-21T04:24:20.148829+0000 mgr.a (mgr.14388) 16010 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:24:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:21 smithi049 bash[23528]: audit 2024-09-21T04:24:20.816750+0000 mgr.a (mgr.14388) 16011 : audit [DBG] from='client.345909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:21 smithi044 bash[22676]: cluster 2024-09-21T04:24:20.148829+0000 mgr.a (mgr.14388) 16010 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:24:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:21 smithi044 bash[22676]: audit 2024-09-21T04:24:20.816750+0000 mgr.a (mgr.14388) 16011 : audit [DBG] from='client.345909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:21 smithi179 bash[23186]: cluster 2024-09-21T04:24:20.148829+0000 mgr.a (mgr.14388) 16010 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:24:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:21 smithi179 bash[23186]: audit 2024-09-21T04:24:20.816750+0000 mgr.a (mgr.14388) 16011 : audit [DBG] from='client.345909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:23 smithi044 bash[22676]: cluster 2024-09-21T04:24:22.150649+0000 mgr.a (mgr.14388) 16012 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:24:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:23 smithi044 bash[22676]: audit 2024-09-21T04:24:22.862043+0000 mon.a (mon.0) 12797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:23 smithi044 bash[22676]: audit 2024-09-21T04:24:22.871417+0000 mon.a (mon.0) 12798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:23 smithi044 bash[22676]: audit 2024-09-21T04:24:22.882013+0000 mon.a (mon.0) 12799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:23 smithi044 bash[22676]: audit 2024-09-21T04:24:23.249394+0000 mon.a (mon.0) 12800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:23 smithi044 bash[22676]: audit 2024-09-21T04:24:23.257899+0000 mon.a (mon.0) 12801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:23 smithi044 bash[22676]: audit 2024-09-21T04:24:23.267963+0000 mon.a (mon.0) 12802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:23 smithi179 bash[23186]: cluster 2024-09-21T04:24:22.150649+0000 mgr.a (mgr.14388) 16012 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:24:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:23 smithi179 bash[23186]: audit 2024-09-21T04:24:22.862043+0000 mon.a (mon.0) 12797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:23 smithi179 bash[23186]: audit 2024-09-21T04:24:22.871417+0000 mon.a (mon.0) 12798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:23 smithi179 bash[23186]: audit 2024-09-21T04:24:22.882013+0000 mon.a (mon.0) 12799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:23 smithi179 bash[23186]: audit 2024-09-21T04:24:23.249394+0000 mon.a (mon.0) 12800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:23 smithi179 bash[23186]: audit 2024-09-21T04:24:23.257899+0000 mon.a (mon.0) 12801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:23 smithi179 bash[23186]: audit 2024-09-21T04:24:23.267963+0000 mon.a (mon.0) 12802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:23 smithi049 bash[23528]: cluster 2024-09-21T04:24:22.150649+0000 mgr.a (mgr.14388) 16012 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:23 smithi049 bash[23528]: audit 2024-09-21T04:24:22.862043+0000 mon.a (mon.0) 12797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:23 smithi049 bash[23528]: audit 2024-09-21T04:24:22.871417+0000 mon.a (mon.0) 12798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:23 smithi049 bash[23528]: audit 2024-09-21T04:24:22.882013+0000 mon.a (mon.0) 12799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:23 smithi049 bash[23528]: audit 2024-09-21T04:24:23.249394+0000 mon.a (mon.0) 12800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:23 smithi049 bash[23528]: audit 2024-09-21T04:24:23.257899+0000 mon.a (mon.0) 12801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:23 smithi049 bash[23528]: audit 2024-09-21T04:24:23.267963+0000 mon.a (mon.0) 12802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:25 smithi044 bash[22676]: cluster 2024-09-21T04:24:24.151422+0000 mgr.a (mgr.14388) 16013 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:24:26.249 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:26.250 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:26.250 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:25 smithi179 bash[23186]: cluster 2024-09-21T04:24:24.151422+0000 mgr.a (mgr.14388) 16013 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:24:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:25 smithi049 bash[23528]: cluster 2024-09-21T04:24:24.151422+0000 mgr.a (mgr.14388) 16013 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:24:27.035 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:27.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:27.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:27.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:27.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:27 smithi044 bash[22676]: cluster 2024-09-21T04:24:26.153505+0000 mgr.a (mgr.14388) 16014 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:27 smithi044 bash[22676]: audit 2024-09-21T04:24:26.583934+0000 mgr.a (mgr.14388) 16015 : audit [DBG] from='client.345981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:27 smithi179 bash[23186]: cluster 2024-09-21T04:24:26.153505+0000 mgr.a (mgr.14388) 16014 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:27 smithi179 bash[23186]: audit 2024-09-21T04:24:26.583934+0000 mgr.a (mgr.14388) 16015 : audit [DBG] from='client.345981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:27 smithi049 bash[23528]: cluster 2024-09-21T04:24:26.153505+0000 mgr.a (mgr.14388) 16014 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:27 smithi049 bash[23528]: audit 2024-09-21T04:24:26.583934+0000 mgr.a (mgr.14388) 16015 : audit [DBG] from='client.345981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:30.130 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:29 smithi049 bash[23528]: cluster 2024-09-21T04:24:28.154396+0000 mgr.a (mgr.14388) 16016 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:29 smithi044 bash[22676]: cluster 2024-09-21T04:24:28.154396+0000 mgr.a (mgr.14388) 16016 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:29 smithi179 bash[23186]: cluster 2024-09-21T04:24:28.154396+0000 mgr.a (mgr.14388) 16016 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:32.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:31 smithi044 bash[22676]: cluster 2024-09-21T04:24:30.156205+0000 mgr.a (mgr.14388) 16017 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:31 smithi179 bash[23186]: cluster 2024-09-21T04:24:30.156205+0000 mgr.a (mgr.14388) 16017 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:31 smithi049 bash[23528]: cluster 2024-09-21T04:24:30.156205+0000 mgr.a (mgr.14388) 16017 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:32.822 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:32 smithi044 bash[22676]: audit 2024-09-21T04:24:31.963072+0000 mon.a (mon.0) 12803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:32 smithi044 bash[22676]: audit 2024-09-21T04:24:31.973533+0000 mon.a (mon.0) 12804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:32 smithi044 bash[22676]: audit 2024-09-21T04:24:31.990549+0000 mon.a (mon.0) 12805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:32 smithi179 bash[23186]: audit 2024-09-21T04:24:31.963072+0000 mon.a (mon.0) 12803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:32 smithi179 bash[23186]: audit 2024-09-21T04:24:31.973533+0000 mon.a (mon.0) 12804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:32 smithi179 bash[23186]: audit 2024-09-21T04:24:31.990549+0000 mon.a (mon.0) 12805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:32 smithi049 bash[23528]: audit 2024-09-21T04:24:31.963072+0000 mon.a (mon.0) 12803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:32 smithi049 bash[23528]: audit 2024-09-21T04:24:31.973533+0000 mon.a (mon.0) 12804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:32 smithi049 bash[23528]: audit 2024-09-21T04:24:31.990549+0000 mon.a (mon.0) 12805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:33 smithi179 bash[23186]: cluster 2024-09-21T04:24:32.156891+0000 mgr.a (mgr.14388) 16018 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:33 smithi179 bash[23186]: audit 2024-09-21T04:24:32.370560+0000 mgr.a (mgr.14388) 16019 : audit [DBG] from='client.346056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:33 smithi049 bash[23528]: cluster 2024-09-21T04:24:32.156891+0000 mgr.a (mgr.14388) 16018 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:33 smithi049 bash[23528]: audit 2024-09-21T04:24:32.370560+0000 mgr.a (mgr.14388) 16019 : audit [DBG] from='client.346056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:33 smithi044 bash[22676]: cluster 2024-09-21T04:24:32.156891+0000 mgr.a (mgr.14388) 16018 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:33 smithi044 bash[22676]: audit 2024-09-21T04:24:32.370560+0000 mgr.a (mgr.14388) 16019 : audit [DBG] from='client.346056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:35 smithi179 bash[23186]: cluster 2024-09-21T04:24:34.157784+0000 mgr.a (mgr.14388) 16020 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:35 smithi049 bash[23528]: cluster 2024-09-21T04:24:34.157784+0000 mgr.a (mgr.14388) 16020 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:35 smithi044 bash[22676]: cluster 2024-09-21T04:24:34.157784+0000 mgr.a (mgr.14388) 16020 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:38.116 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:37 smithi179 bash[23186]: cluster 2024-09-21T04:24:36.160075+0000 mgr.a (mgr.14388) 16021 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:24:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:37 smithi044 bash[22676]: cluster 2024-09-21T04:24:36.160075+0000 mgr.a (mgr.14388) 16021 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:24:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:38 smithi049 bash[23528]: cluster 2024-09-21T04:24:36.160075+0000 mgr.a (mgr.14388) 16021 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:24:38.613 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:38.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:38.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:38.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:38.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:40.282 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:40 smithi179 bash[23186]: audit 2024-09-21T04:24:38.157801+0000 mgr.a (mgr.14388) 16022 : audit [DBG] from='client.346131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:40.282 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:40 smithi179 bash[23186]: cluster 2024-09-21T04:24:38.175453+0000 mgr.a (mgr.14388) 16023 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:40 smithi049 bash[23528]: audit 2024-09-21T04:24:38.157801+0000 mgr.a (mgr.14388) 16022 : audit [DBG] from='client.346131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:40 smithi049 bash[23528]: cluster 2024-09-21T04:24:38.175453+0000 mgr.a (mgr.14388) 16023 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:40 smithi044 bash[22676]: audit 2024-09-21T04:24:38.157801+0000 mgr.a (mgr.14388) 16022 : audit [DBG] from='client.346131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:40 smithi044 bash[22676]: cluster 2024-09-21T04:24:38.175453+0000 mgr.a (mgr.14388) 16023 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:42 smithi049 bash[23528]: cluster 2024-09-21T04:24:40.176940+0000 mgr.a (mgr.14388) 16024 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:42 smithi044 bash[22676]: cluster 2024-09-21T04:24:40.176940+0000 mgr.a (mgr.14388) 16024 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:42 smithi179 bash[23186]: cluster 2024-09-21T04:24:40.176940+0000 mgr.a (mgr.14388) 16024 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:24:43.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:43.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:43.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:44.384 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:44.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:44.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:44.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:44.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:44 smithi044 bash[22676]: cluster 2024-09-21T04:24:42.178186+0000 mgr.a (mgr.14388) 16025 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:44 smithi044 bash[22676]: audit 2024-09-21T04:24:43.100591+0000 mon.a (mon.0) 12806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:44 smithi044 bash[22676]: audit 2024-09-21T04:24:43.109180+0000 mon.a (mon.0) 12807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:44 smithi044 bash[22676]: audit 2024-09-21T04:24:43.119745+0000 mon.a (mon.0) 12808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:44 smithi044 bash[22676]: audit 2024-09-21T04:24:43.476988+0000 mon.a (mon.0) 12809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:44 smithi044 bash[22676]: audit 2024-09-21T04:24:43.485675+0000 mon.a (mon.0) 12810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:44 smithi044 bash[22676]: audit 2024-09-21T04:24:43.496164+0000 mon.a (mon.0) 12811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:44 smithi179 bash[23186]: cluster 2024-09-21T04:24:42.178186+0000 mgr.a (mgr.14388) 16025 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:44 smithi179 bash[23186]: audit 2024-09-21T04:24:43.100591+0000 mon.a (mon.0) 12806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:44 smithi179 bash[23186]: audit 2024-09-21T04:24:43.109180+0000 mon.a (mon.0) 12807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:44 smithi179 bash[23186]: audit 2024-09-21T04:24:43.119745+0000 mon.a (mon.0) 12808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:44 smithi179 bash[23186]: audit 2024-09-21T04:24:43.476988+0000 mon.a (mon.0) 12809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:44 smithi179 bash[23186]: audit 2024-09-21T04:24:43.485675+0000 mon.a (mon.0) 12810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:44 smithi179 bash[23186]: audit 2024-09-21T04:24:43.496164+0000 mon.a (mon.0) 12811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:44 smithi049 bash[23528]: cluster 2024-09-21T04:24:42.178186+0000 mgr.a (mgr.14388) 16025 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:24:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:44 smithi049 bash[23528]: audit 2024-09-21T04:24:43.100591+0000 mon.a (mon.0) 12806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:44 smithi049 bash[23528]: audit 2024-09-21T04:24:43.109180+0000 mon.a (mon.0) 12807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:44 smithi049 bash[23528]: audit 2024-09-21T04:24:43.119745+0000 mon.a (mon.0) 12808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:44 smithi049 bash[23528]: audit 2024-09-21T04:24:43.476988+0000 mon.a (mon.0) 12809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:44 smithi049 bash[23528]: audit 2024-09-21T04:24:43.485675+0000 mon.a (mon.0) 12810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:44 smithi049 bash[23528]: audit 2024-09-21T04:24:43.496164+0000 mon.a (mon.0) 12811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:45 smithi044 bash[22676]: audit 2024-09-21T04:24:43.942517+0000 mgr.a (mgr.14388) 16026 : audit [DBG] from='client.346206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:45 smithi179 bash[23186]: audit 2024-09-21T04:24:43.942517+0000 mgr.a (mgr.14388) 16026 : audit [DBG] from='client.346206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:45 smithi049 bash[23528]: audit 2024-09-21T04:24:43.942517+0000 mgr.a (mgr.14388) 16026 : audit [DBG] from='client.346206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:46 smithi044 bash[22676]: cluster 2024-09-21T04:24:44.187569+0000 mgr.a (mgr.14388) 16027 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:46 smithi179 bash[23186]: cluster 2024-09-21T04:24:44.187569+0000 mgr.a (mgr.14388) 16027 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:46 smithi049 bash[23528]: cluster 2024-09-21T04:24:44.187569+0000 mgr.a (mgr.14388) 16027 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:48 smithi044 bash[22676]: cluster 2024-09-21T04:24:46.189914+0000 mgr.a (mgr.14388) 16028 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:24:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:48 smithi179 bash[23186]: cluster 2024-09-21T04:24:46.189914+0000 mgr.a (mgr.14388) 16028 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:24:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:48 smithi049 bash[23528]: cluster 2024-09-21T04:24:46.189914+0000 mgr.a (mgr.14388) 16028 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:24:49.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:49.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:50.187 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:50.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:50.187 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:50.482 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:50 smithi049 bash[23528]: cluster 2024-09-21T04:24:48.190708+0000 mgr.a (mgr.14388) 16029 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:50 smithi044 bash[22676]: cluster 2024-09-21T04:24:48.190708+0000 mgr.a (mgr.14388) 16029 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:50 smithi179 bash[23186]: cluster 2024-09-21T04:24:48.190708+0000 mgr.a (mgr.14388) 16029 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:24:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:51 smithi044 bash[22676]: audit 2024-09-21T04:24:49.721530+0000 mgr.a (mgr.14388) 16030 : audit [DBG] from='client.346281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:51 smithi179 bash[23186]: audit 2024-09-21T04:24:49.721530+0000 mgr.a (mgr.14388) 16030 : audit [DBG] from='client.346281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:51 smithi049 bash[23528]: audit 2024-09-21T04:24:49.721530+0000 mgr.a (mgr.14388) 16030 : audit [DBG] from='client.346281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22676]: cluster 2024-09-21T04:24:50.191867+0000 mgr.a (mgr.14388) 16031 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:24:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22676]: audit 2024-09-21T04:24:52.010307+0000 mon.a (mon.0) 12812 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:24:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22676]: audit 2024-09-21T04:24:52.018034+0000 mon.a (mon.0) 12813 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:24:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22676]: audit 2024-09-21T04:24:52.020044+0000 mon.a (mon.0) 12814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:24:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22676]: audit 2024-09-21T04:24:52.031759+0000 mon.a (mon.0) 12815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22676]: audit 2024-09-21T04:24:52.038299+0000 mon.a (mon.0) 12816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:24:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22676]: audit 2024-09-21T04:24:52.040811+0000 mgr.a (mgr.14388) 16032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:24:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:52 smithi179 bash[23186]: cluster 2024-09-21T04:24:50.191867+0000 mgr.a (mgr.14388) 16031 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:24:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:52 smithi179 bash[23186]: audit 2024-09-21T04:24:52.010307+0000 mon.a (mon.0) 12812 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:24:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:52 smithi179 bash[23186]: audit 2024-09-21T04:24:52.018034+0000 mon.a (mon.0) 12813 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:24:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:52 smithi179 bash[23186]: audit 2024-09-21T04:24:52.020044+0000 mon.a (mon.0) 12814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:24:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:52 smithi179 bash[23186]: audit 2024-09-21T04:24:52.031759+0000 mon.a (mon.0) 12815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:52 smithi179 bash[23186]: audit 2024-09-21T04:24:52.038299+0000 mon.a (mon.0) 12816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:24:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:52 smithi179 bash[23186]: audit 2024-09-21T04:24:52.040811+0000 mgr.a (mgr.14388) 16032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:24:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:52 smithi049 bash[23528]: cluster 2024-09-21T04:24:50.191867+0000 mgr.a (mgr.14388) 16031 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:24:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:52 smithi049 bash[23528]: audit 2024-09-21T04:24:52.010307+0000 mon.a (mon.0) 12812 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:24:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:52 smithi049 bash[23528]: audit 2024-09-21T04:24:52.018034+0000 mon.a (mon.0) 12813 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:24:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:52 smithi049 bash[23528]: audit 2024-09-21T04:24:52.020044+0000 mon.a (mon.0) 12814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:24:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:52 smithi049 bash[23528]: audit 2024-09-21T04:24:52.031759+0000 mon.a (mon.0) 12815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:52 smithi049 bash[23528]: audit 2024-09-21T04:24:52.038299+0000 mon.a (mon.0) 12816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:24:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:52 smithi049 bash[23528]: audit 2024-09-21T04:24:52.040811+0000 mgr.a (mgr.14388) 16032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:24:53.139 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22930]: debug 2024-09-21T04:24:52.826+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:24:53.139 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:24:52 smithi044 bash[22930]: debug 2024-09-21T04:24:52.830+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:24:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:53 smithi049 bash[23528]: audit 2024-09-21T04:24:52.131140+0000 mon.a (mon.0) 12817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:53 smithi049 bash[23528]: audit 2024-09-21T04:24:52.144349+0000 mon.a (mon.0) 12818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:53 smithi049 bash[23528]: audit 2024-09-21T04:24:52.151636+0000 mon.a (mon.0) 12819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:53 smithi049 bash[23528]: cluster 2024-09-21T04:24:52.192915+0000 mgr.a (mgr.14388) 16033 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T04:24:53.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:53 smithi049 bash[23528]: audit 2024-09-21T04:24:52.832735+0000 mgr.a (mgr.14388) 16034 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:24:53.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:53 smithi049 bash[23528]: cephadm 2024-09-21T04:24:52.834200+0000 mgr.a (mgr.14388) 16035 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:24:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:53 smithi044 bash[22676]: audit 2024-09-21T04:24:52.131140+0000 mon.a (mon.0) 12817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:53 smithi044 bash[22676]: audit 2024-09-21T04:24:52.144349+0000 mon.a (mon.0) 12818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:53 smithi044 bash[22676]: audit 2024-09-21T04:24:52.151636+0000 mon.a (mon.0) 12819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:53 smithi044 bash[22676]: cluster 2024-09-21T04:24:52.192915+0000 mgr.a (mgr.14388) 16033 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T04:24:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:53 smithi044 bash[22676]: audit 2024-09-21T04:24:52.832735+0000 mgr.a (mgr.14388) 16034 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:24:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:53 smithi044 bash[22676]: cephadm 2024-09-21T04:24:52.834200+0000 mgr.a (mgr.14388) 16035 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:24:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:53 smithi179 bash[23186]: audit 2024-09-21T04:24:52.131140+0000 mon.a (mon.0) 12817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:53 smithi179 bash[23186]: audit 2024-09-21T04:24:52.144349+0000 mon.a (mon.0) 12818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:53 smithi179 bash[23186]: audit 2024-09-21T04:24:52.151636+0000 mon.a (mon.0) 12819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:24:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:53 smithi179 bash[23186]: cluster 2024-09-21T04:24:52.192915+0000 mgr.a (mgr.14388) 16033 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T04:24:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:53 smithi179 bash[23186]: audit 2024-09-21T04:24:52.832735+0000 mgr.a (mgr.14388) 16034 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:24:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:53 smithi179 bash[23186]: cephadm 2024-09-21T04:24:52.834200+0000 mgr.a (mgr.14388) 16035 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:24:55.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:24:55.189 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:24:55.190 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:24:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:55 smithi179 bash[23186]: cluster 2024-09-21T04:24:54.193837+0000 mgr.a (mgr.14388) 16036 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:24:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:55 smithi049 bash[23528]: cluster 2024-09-21T04:24:54.193837+0000 mgr.a (mgr.14388) 16036 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:24:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:55 smithi044 bash[22676]: cluster 2024-09-21T04:24:54.193837+0000 mgr.a (mgr.14388) 16036 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:24:55.941 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:24:55.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:24:55.941 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:24:55.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:24:55.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:24:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:56 smithi049 bash[23528]: audit 2024-09-21T04:24:55.523555+0000 mgr.a (mgr.14388) 16037 : audit [DBG] from='client.346464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:56 smithi044 bash[22676]: audit 2024-09-21T04:24:55.523555+0000 mgr.a (mgr.14388) 16037 : audit [DBG] from='client.346464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:56 smithi179 bash[23186]: audit 2024-09-21T04:24:55.523555+0000 mgr.a (mgr.14388) 16037 : audit [DBG] from='client.346464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:24:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:57 smithi179 bash[23186]: cluster 2024-09-21T04:24:56.195329+0000 mgr.a (mgr.14388) 16038 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:57.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:57 smithi044 bash[22676]: cluster 2024-09-21T04:24:56.195329+0000 mgr.a (mgr.14388) 16038 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:57 smithi049 bash[23528]: cluster 2024-09-21T04:24:56.195329+0000 mgr.a (mgr.14388) 16038 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:24:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:24:59 smithi044 bash[22676]: cluster 2024-09-21T04:24:58.196089+0000 mgr.a (mgr.14388) 16039 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:24:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:24:59 smithi179 bash[23186]: cluster 2024-09-21T04:24:58.196089+0000 mgr.a (mgr.14388) 16039 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:24:59.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:24:59 smithi049 bash[23528]: cluster 2024-09-21T04:24:58.196089+0000 mgr.a (mgr.14388) 16039 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:00.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:00.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:00.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:01 smithi049 bash[23528]: cluster 2024-09-21T04:25:00.197707+0000 mgr.a (mgr.14388) 16040 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:01 smithi044 bash[22676]: cluster 2024-09-21T04:25:00.197707+0000 mgr.a (mgr.14388) 16040 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:01 smithi179 bash[23186]: cluster 2024-09-21T04:25:00.197707+0000 mgr.a (mgr.14388) 16040 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:01.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:02 smithi049 bash[23528]: audit 2024-09-21T04:25:01.278396+0000 mgr.a (mgr.14388) 16041 : audit [DBG] from='client.346539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:02 smithi044 bash[22676]: audit 2024-09-21T04:25:01.278396+0000 mgr.a (mgr.14388) 16041 : audit [DBG] from='client.346539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:02 smithi179 bash[23186]: audit 2024-09-21T04:25:01.278396+0000 mgr.a (mgr.14388) 16041 : audit [DBG] from='client.346539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:03 smithi049 bash[23528]: cluster 2024-09-21T04:25:02.199545+0000 mgr.a (mgr.14388) 16042 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:03.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:03 smithi179 bash[23186]: cluster 2024-09-21T04:25:02.199545+0000 mgr.a (mgr.14388) 16042 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:03 smithi044 bash[22676]: cluster 2024-09-21T04:25:02.199545+0000 mgr.a (mgr.14388) 16042 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:04 smithi049 bash[23528]: audit 2024-09-21T04:25:03.289201+0000 mon.a (mon.0) 12820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:04 smithi049 bash[23528]: audit 2024-09-21T04:25:03.294499+0000 mon.a (mon.0) 12821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:04 smithi049 bash[23528]: audit 2024-09-21T04:25:03.302354+0000 mon.a (mon.0) 12822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:04 smithi049 bash[23528]: audit 2024-09-21T04:25:03.702036+0000 mon.a (mon.0) 12823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:04 smithi049 bash[23528]: audit 2024-09-21T04:25:03.711186+0000 mon.a (mon.0) 12824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:04 smithi049 bash[23528]: audit 2024-09-21T04:25:03.721862+0000 mon.a (mon.0) 12825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:04 smithi044 bash[22676]: audit 2024-09-21T04:25:03.289201+0000 mon.a (mon.0) 12820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:04 smithi044 bash[22676]: audit 2024-09-21T04:25:03.294499+0000 mon.a (mon.0) 12821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:04 smithi044 bash[22676]: audit 2024-09-21T04:25:03.302354+0000 mon.a (mon.0) 12822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:04 smithi044 bash[22676]: audit 2024-09-21T04:25:03.702036+0000 mon.a (mon.0) 12823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:04 smithi044 bash[22676]: audit 2024-09-21T04:25:03.711186+0000 mon.a (mon.0) 12824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:04 smithi044 bash[22676]: audit 2024-09-21T04:25:03.721862+0000 mon.a (mon.0) 12825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:04 smithi179 bash[23186]: audit 2024-09-21T04:25:03.289201+0000 mon.a (mon.0) 12820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:04 smithi179 bash[23186]: audit 2024-09-21T04:25:03.294499+0000 mon.a (mon.0) 12821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:04 smithi179 bash[23186]: audit 2024-09-21T04:25:03.302354+0000 mon.a (mon.0) 12822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:04 smithi179 bash[23186]: audit 2024-09-21T04:25:03.702036+0000 mon.a (mon.0) 12823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:04 smithi179 bash[23186]: audit 2024-09-21T04:25:03.711186+0000 mon.a (mon.0) 12824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:04 smithi179 bash[23186]: audit 2024-09-21T04:25:03.721862+0000 mon.a (mon.0) 12825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:05 smithi044 bash[22676]: cluster 2024-09-21T04:25:04.200317+0000 mgr.a (mgr.14388) 16043 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:05 smithi179 bash[23186]: cluster 2024-09-21T04:25:04.200317+0000 mgr.a (mgr.14388) 16043 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:05 smithi049 bash[23528]: cluster 2024-09-21T04:25:04.200317+0000 mgr.a (mgr.14388) 16043 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:25:06.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:06.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:06.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:07.453 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:07.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:07.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:07.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:07 smithi044 bash[22676]: cluster 2024-09-21T04:25:06.202388+0000 mgr.a (mgr.14388) 16044 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:25:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:07 smithi044 bash[22676]: audit 2024-09-21T04:25:07.031081+0000 mgr.a (mgr.14388) 16045 : audit [DBG] from='client.346617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:07 smithi179 bash[23186]: cluster 2024-09-21T04:25:06.202388+0000 mgr.a (mgr.14388) 16044 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:25:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:07 smithi179 bash[23186]: audit 2024-09-21T04:25:07.031081+0000 mgr.a (mgr.14388) 16045 : audit [DBG] from='client.346617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:07 smithi049 bash[23528]: cluster 2024-09-21T04:25:06.202388+0000 mgr.a (mgr.14388) 16044 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:25:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:07 smithi049 bash[23528]: audit 2024-09-21T04:25:07.031081+0000 mgr.a (mgr.14388) 16045 : audit [DBG] from='client.346617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:09 smithi044 bash[22676]: cluster 2024-09-21T04:25:08.203395+0000 mgr.a (mgr.14388) 16046 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:09 smithi179 bash[23186]: cluster 2024-09-21T04:25:08.203395+0000 mgr.a (mgr.14388) 16046 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:09 smithi049 bash[23528]: cluster 2024-09-21T04:25:08.203395+0000 mgr.a (mgr.14388) 16046 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:11 smithi179 bash[23186]: cluster 2024-09-21T04:25:10.205168+0000 mgr.a (mgr.14388) 16047 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:11 smithi049 bash[23528]: cluster 2024-09-21T04:25:10.205168+0000 mgr.a (mgr.14388) 16047 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:11 smithi044 bash[22676]: cluster 2024-09-21T04:25:10.205168+0000 mgr.a (mgr.14388) 16047 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:12.455 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:12.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:12.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:13.243 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:13.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:13 smithi049 bash[23528]: cluster 2024-09-21T04:25:12.206779+0000 mgr.a (mgr.14388) 16048 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:25:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:13 smithi049 bash[23528]: audit 2024-09-21T04:25:12.344347+0000 mon.a (mon.0) 12826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:13 smithi049 bash[23528]: audit 2024-09-21T04:25:12.352991+0000 mon.a (mon.0) 12827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:13 smithi049 bash[23528]: audit 2024-09-21T04:25:12.364122+0000 mon.a (mon.0) 12828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:13 smithi049 bash[23528]: audit 2024-09-21T04:25:12.788985+0000 mgr.a (mgr.14388) 16049 : audit [DBG] from='client.346695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:13 smithi044 bash[22676]: cluster 2024-09-21T04:25:12.206779+0000 mgr.a (mgr.14388) 16048 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:25:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:13 smithi044 bash[22676]: audit 2024-09-21T04:25:12.344347+0000 mon.a (mon.0) 12826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:13 smithi044 bash[22676]: audit 2024-09-21T04:25:12.352991+0000 mon.a (mon.0) 12827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:13 smithi044 bash[22676]: audit 2024-09-21T04:25:12.364122+0000 mon.a (mon.0) 12828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:13 smithi044 bash[22676]: audit 2024-09-21T04:25:12.788985+0000 mgr.a (mgr.14388) 16049 : audit [DBG] from='client.346695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:13 smithi179 bash[23186]: cluster 2024-09-21T04:25:12.206779+0000 mgr.a (mgr.14388) 16048 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:25:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:13 smithi179 bash[23186]: audit 2024-09-21T04:25:12.344347+0000 mon.a (mon.0) 12826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:13 smithi179 bash[23186]: audit 2024-09-21T04:25:12.352991+0000 mon.a (mon.0) 12827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:13 smithi179 bash[23186]: audit 2024-09-21T04:25:12.364122+0000 mon.a (mon.0) 12828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:13.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:13 smithi179 bash[23186]: audit 2024-09-21T04:25:12.788985+0000 mgr.a (mgr.14388) 16049 : audit [DBG] from='client.346695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:15 smithi044 bash[22676]: cluster 2024-09-21T04:25:14.207733+0000 mgr.a (mgr.14388) 16050 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:15 smithi179 bash[23186]: cluster 2024-09-21T04:25:14.207733+0000 mgr.a (mgr.14388) 16050 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:15 smithi049 bash[23528]: cluster 2024-09-21T04:25:14.207733+0000 mgr.a (mgr.14388) 16050 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:17.625 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:17 smithi044 bash[22676]: cluster 2024-09-21T04:25:16.210211+0000 mgr.a (mgr.14388) 16051 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:17 smithi179 bash[23186]: cluster 2024-09-21T04:25:16.210211+0000 mgr.a (mgr.14388) 16051 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:17 smithi049 bash[23528]: cluster 2024-09-21T04:25:16.210211+0000 mgr.a (mgr.14388) 16051 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:18.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:18.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:18.245 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:19.023 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:19.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:19.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:19 smithi044 bash[22676]: cluster 2024-09-21T04:25:18.211136+0000 mgr.a (mgr.14388) 16052 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:19.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:19 smithi044 bash[22676]: audit 2024-09-21T04:25:18.580574+0000 mgr.a (mgr.14388) 16053 : audit [DBG] from='client.346773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:19 smithi179 bash[23186]: cluster 2024-09-21T04:25:18.211136+0000 mgr.a (mgr.14388) 16052 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:19 smithi179 bash[23186]: audit 2024-09-21T04:25:18.580574+0000 mgr.a (mgr.14388) 16053 : audit [DBG] from='client.346773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:19 smithi049 bash[23528]: cluster 2024-09-21T04:25:18.211136+0000 mgr.a (mgr.14388) 16052 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:19 smithi049 bash[23528]: audit 2024-09-21T04:25:18.580574+0000 mgr.a (mgr.14388) 16053 : audit [DBG] from='client.346773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:21 smithi044 bash[22676]: cluster 2024-09-21T04:25:20.213314+0000 mgr.a (mgr.14388) 16054 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:21 smithi179 bash[23186]: cluster 2024-09-21T04:25:20.213314+0000 mgr.a (mgr.14388) 16054 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:21 smithi049 bash[23528]: cluster 2024-09-21T04:25:20.213314+0000 mgr.a (mgr.14388) 16054 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:23 smithi044 bash[22676]: cluster 2024-09-21T04:25:22.214632+0000 mgr.a (mgr.14388) 16055 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:25:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:23 smithi179 bash[23186]: cluster 2024-09-21T04:25:22.214632+0000 mgr.a (mgr.14388) 16055 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:25:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:23 smithi049 bash[23528]: cluster 2024-09-21T04:25:22.214632+0000 mgr.a (mgr.14388) 16055 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:25:24.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:24.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:24 smithi049 bash[23528]: audit 2024-09-21T04:25:23.516961+0000 mon.a (mon.0) 12829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:24 smithi049 bash[23528]: audit 2024-09-21T04:25:23.525491+0000 mon.a (mon.0) 12830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:24 smithi049 bash[23528]: audit 2024-09-21T04:25:23.535930+0000 mon.a (mon.0) 12831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:24 smithi049 bash[23528]: audit 2024-09-21T04:25:23.932869+0000 mon.a (mon.0) 12832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:24 smithi049 bash[23528]: audit 2024-09-21T04:25:23.942720+0000 mon.a (mon.0) 12833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:24 smithi049 bash[23528]: audit 2024-09-21T04:25:23.954127+0000 mon.a (mon.0) 12834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.816 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:24.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:24.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:24.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:24.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:24 smithi044 bash[22676]: audit 2024-09-21T04:25:23.516961+0000 mon.a (mon.0) 12829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:24 smithi044 bash[22676]: audit 2024-09-21T04:25:23.525491+0000 mon.a (mon.0) 12830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:24 smithi044 bash[22676]: audit 2024-09-21T04:25:23.535930+0000 mon.a (mon.0) 12831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:24 smithi044 bash[22676]: audit 2024-09-21T04:25:23.932869+0000 mon.a (mon.0) 12832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:24 smithi044 bash[22676]: audit 2024-09-21T04:25:23.942720+0000 mon.a (mon.0) 12833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:24 smithi044 bash[22676]: audit 2024-09-21T04:25:23.954127+0000 mon.a (mon.0) 12834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:24 smithi179 bash[23186]: audit 2024-09-21T04:25:23.516961+0000 mon.a (mon.0) 12829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:24 smithi179 bash[23186]: audit 2024-09-21T04:25:23.525491+0000 mon.a (mon.0) 12830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:24 smithi179 bash[23186]: audit 2024-09-21T04:25:23.535930+0000 mon.a (mon.0) 12831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:25.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:24 smithi179 bash[23186]: audit 2024-09-21T04:25:23.932869+0000 mon.a (mon.0) 12832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:25.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:24 smithi179 bash[23186]: audit 2024-09-21T04:25:23.942720+0000 mon.a (mon.0) 12833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:25.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:24 smithi179 bash[23186]: audit 2024-09-21T04:25:23.954127+0000 mon.a (mon.0) 12834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:25 smithi044 bash[22676]: cluster 2024-09-21T04:25:24.215104+0000 mgr.a (mgr.14388) 16056 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:25 smithi044 bash[22676]: audit 2024-09-21T04:25:24.363096+0000 mgr.a (mgr.14388) 16057 : audit [DBG] from='client.346851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:25 smithi179 bash[23186]: cluster 2024-09-21T04:25:24.215104+0000 mgr.a (mgr.14388) 16056 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:25 smithi179 bash[23186]: audit 2024-09-21T04:25:24.363096+0000 mgr.a (mgr.14388) 16057 : audit [DBG] from='client.346851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:25 smithi049 bash[23528]: cluster 2024-09-21T04:25:24.215104+0000 mgr.a (mgr.14388) 16056 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:25 smithi049 bash[23528]: audit 2024-09-21T04:25:24.363096+0000 mgr.a (mgr.14388) 16057 : audit [DBG] from='client.346851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:27 smithi044 bash[22676]: cluster 2024-09-21T04:25:26.217643+0000 mgr.a (mgr.14388) 16058 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:27 smithi179 bash[23186]: cluster 2024-09-21T04:25:26.217643+0000 mgr.a (mgr.14388) 16058 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:27 smithi049 bash[23528]: cluster 2024-09-21T04:25:26.217643+0000 mgr.a (mgr.14388) 16058 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:29.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:29.819 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:29.819 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:29 smithi044 bash[22676]: cluster 2024-09-21T04:25:28.218412+0000 mgr.a (mgr.14388) 16059 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:29 smithi179 bash[23186]: cluster 2024-09-21T04:25:28.218412+0000 mgr.a (mgr.14388) 16059 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:29 smithi049 bash[23528]: cluster 2024-09-21T04:25:28.218412+0000 mgr.a (mgr.14388) 16059 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:30.594 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:31 smithi044 bash[22676]: audit 2024-09-21T04:25:30.152494+0000 mgr.a (mgr.14388) 16060 : audit [DBG] from='client.346929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:31 smithi044 bash[22676]: cluster 2024-09-21T04:25:30.219658+0000 mgr.a (mgr.14388) 16061 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:31 smithi179 bash[23186]: audit 2024-09-21T04:25:30.152494+0000 mgr.a (mgr.14388) 16060 : audit [DBG] from='client.346929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:31 smithi179 bash[23186]: cluster 2024-09-21T04:25:30.219658+0000 mgr.a (mgr.14388) 16061 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:31 smithi049 bash[23528]: audit 2024-09-21T04:25:30.152494+0000 mgr.a (mgr.14388) 16060 : audit [DBG] from='client.346929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:31 smithi049 bash[23528]: cluster 2024-09-21T04:25:30.219658+0000 mgr.a (mgr.14388) 16061 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:33 smithi049 bash[23528]: cluster 2024-09-21T04:25:32.221411+0000 mgr.a (mgr.14388) 16062 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:25:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:33 smithi049 bash[23528]: audit 2024-09-21T04:25:32.542809+0000 mon.a (mon.0) 12835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:33 smithi049 bash[23528]: audit 2024-09-21T04:25:32.552125+0000 mon.a (mon.0) 12836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:33 smithi049 bash[23528]: audit 2024-09-21T04:25:32.571891+0000 mon.a (mon.0) 12837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:33 smithi044 bash[22676]: cluster 2024-09-21T04:25:32.221411+0000 mgr.a (mgr.14388) 16062 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:25:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:33 smithi044 bash[22676]: audit 2024-09-21T04:25:32.542809+0000 mon.a (mon.0) 12835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:33 smithi044 bash[22676]: audit 2024-09-21T04:25:32.552125+0000 mon.a (mon.0) 12836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:33 smithi044 bash[22676]: audit 2024-09-21T04:25:32.571891+0000 mon.a (mon.0) 12837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:33 smithi179 bash[23186]: cluster 2024-09-21T04:25:32.221411+0000 mgr.a (mgr.14388) 16062 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:25:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:33 smithi179 bash[23186]: audit 2024-09-21T04:25:32.542809+0000 mon.a (mon.0) 12835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:33 smithi179 bash[23186]: audit 2024-09-21T04:25:32.552125+0000 mon.a (mon.0) 12836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:33 smithi179 bash[23186]: audit 2024-09-21T04:25:32.571891+0000 mon.a (mon.0) 12837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:35.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:35.595 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:35.596 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:35 smithi049 bash[23528]: cluster 2024-09-21T04:25:34.222203+0000 mgr.a (mgr.14388) 16063 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:25:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:35 smithi044 bash[22676]: cluster 2024-09-21T04:25:34.222203+0000 mgr.a (mgr.14388) 16063 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:25:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:35 smithi179 bash[23186]: cluster 2024-09-21T04:25:34.222203+0000 mgr.a (mgr.14388) 16063 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:25:36.375 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:36 smithi044 bash[22676]: audit 2024-09-21T04:25:35.925508+0000 mgr.a (mgr.14388) 16064 : audit [DBG] from='client.347007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:36 smithi179 bash[23186]: audit 2024-09-21T04:25:35.925508+0000 mgr.a (mgr.14388) 16064 : audit [DBG] from='client.347007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:36 smithi049 bash[23528]: audit 2024-09-21T04:25:35.925508+0000 mgr.a (mgr.14388) 16064 : audit [DBG] from='client.347007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:37.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:37 smithi044 bash[22676]: cluster 2024-09-21T04:25:36.223615+0000 mgr.a (mgr.14388) 16065 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:37 smithi179 bash[23186]: cluster 2024-09-21T04:25:36.223615+0000 mgr.a (mgr.14388) 16065 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:37 smithi049 bash[23528]: cluster 2024-09-21T04:25:36.223615+0000 mgr.a (mgr.14388) 16065 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:39.833 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:39 smithi044 bash[22676]: cluster 2024-09-21T04:25:38.224537+0000 mgr.a (mgr.14388) 16066 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:25:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:39 smithi179 bash[23186]: cluster 2024-09-21T04:25:38.224537+0000 mgr.a (mgr.14388) 16066 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:25:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:39 smithi049 bash[23528]: cluster 2024-09-21T04:25:38.224537+0000 mgr.a (mgr.14388) 16066 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:25:41.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:41.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:41.377 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:41 smithi044 bash[22676]: cluster 2024-09-21T04:25:40.226391+0000 mgr.a (mgr.14388) 16067 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:25:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:41 smithi179 bash[23186]: cluster 2024-09-21T04:25:40.226391+0000 mgr.a (mgr.14388) 16067 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:25:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:41 smithi049 bash[23528]: cluster 2024-09-21T04:25:40.226391+0000 mgr.a (mgr.14388) 16067 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:25:42.175 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:42 smithi044 bash[22676]: audit 2024-09-21T04:25:41.716694+0000 mgr.a (mgr.14388) 16068 : audit [DBG] from='client.347085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:42 smithi179 bash[23186]: audit 2024-09-21T04:25:41.716694+0000 mgr.a (mgr.14388) 16068 : audit [DBG] from='client.347085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:42 smithi049 bash[23528]: audit 2024-09-21T04:25:41.716694+0000 mgr.a (mgr.14388) 16068 : audit [DBG] from='client.347085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:43 smithi044 bash[22676]: cluster 2024-09-21T04:25:42.228213+0000 mgr.a (mgr.14388) 16069 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:43 smithi179 bash[23186]: cluster 2024-09-21T04:25:42.228213+0000 mgr.a (mgr.14388) 16069 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:43 smithi049 bash[23528]: cluster 2024-09-21T04:25:42.228213+0000 mgr.a (mgr.14388) 16069 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:44 smithi044 bash[22676]: audit 2024-09-21T04:25:43.732627+0000 mon.a (mon.0) 12838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:44 smithi044 bash[22676]: audit 2024-09-21T04:25:43.738544+0000 mon.a (mon.0) 12839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:44 smithi044 bash[22676]: audit 2024-09-21T04:25:43.749175+0000 mon.a (mon.0) 12840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:44.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:44 smithi044 bash[22676]: audit 2024-09-21T04:25:44.166937+0000 mon.a (mon.0) 12841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:44.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:44 smithi044 bash[22676]: audit 2024-09-21T04:25:44.175930+0000 mon.a (mon.0) 12842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:44.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:44 smithi044 bash[22676]: audit 2024-09-21T04:25:44.188042+0000 mon.a (mon.0) 12843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:44 smithi179 bash[23186]: audit 2024-09-21T04:25:43.732627+0000 mon.a (mon.0) 12838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:44 smithi179 bash[23186]: audit 2024-09-21T04:25:43.738544+0000 mon.a (mon.0) 12839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:44 smithi179 bash[23186]: audit 2024-09-21T04:25:43.749175+0000 mon.a (mon.0) 12840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:44 smithi179 bash[23186]: audit 2024-09-21T04:25:44.166937+0000 mon.a (mon.0) 12841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:44 smithi179 bash[23186]: audit 2024-09-21T04:25:44.175930+0000 mon.a (mon.0) 12842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:44 smithi179 bash[23186]: audit 2024-09-21T04:25:44.188042+0000 mon.a (mon.0) 12843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:44 smithi049 bash[23528]: audit 2024-09-21T04:25:43.732627+0000 mon.a (mon.0) 12838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:44 smithi049 bash[23528]: audit 2024-09-21T04:25:43.738544+0000 mon.a (mon.0) 12839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:44 smithi049 bash[23528]: audit 2024-09-21T04:25:43.749175+0000 mon.a (mon.0) 12840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:44 smithi049 bash[23528]: audit 2024-09-21T04:25:44.166937+0000 mon.a (mon.0) 12841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:44 smithi049 bash[23528]: audit 2024-09-21T04:25:44.175930+0000 mon.a (mon.0) 12842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:44 smithi049 bash[23528]: audit 2024-09-21T04:25:44.188042+0000 mon.a (mon.0) 12843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:45 smithi044 bash[22676]: cluster 2024-09-21T04:25:44.229021+0000 mgr.a (mgr.14388) 16070 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:45 smithi179 bash[23186]: cluster 2024-09-21T04:25:44.229021+0000 mgr.a (mgr.14388) 16070 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:45 smithi049 bash[23528]: cluster 2024-09-21T04:25:44.229021+0000 mgr.a (mgr.14388) 16070 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:47.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:47.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:47.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:47.932 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:47.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:47.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:47.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:47.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:47 smithi179 bash[23186]: cluster 2024-09-21T04:25:46.231029+0000 mgr.a (mgr.14388) 16071 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:47 smithi049 bash[23528]: cluster 2024-09-21T04:25:46.231029+0000 mgr.a (mgr.14388) 16071 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:47 smithi044 bash[22676]: cluster 2024-09-21T04:25:46.231029+0000 mgr.a (mgr.14388) 16071 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:25:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:48 smithi179 bash[23186]: audit 2024-09-21T04:25:47.510989+0000 mgr.a (mgr.14388) 16072 : audit [DBG] from='client.347163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:48 smithi049 bash[23528]: audit 2024-09-21T04:25:47.510989+0000 mgr.a (mgr.14388) 16072 : audit [DBG] from='client.347163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:48 smithi044 bash[22676]: audit 2024-09-21T04:25:47.510989+0000 mgr.a (mgr.14388) 16072 : audit [DBG] from='client.347163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:49 smithi049 bash[23528]: cluster 2024-09-21T04:25:48.231977+0000 mgr.a (mgr.14388) 16073 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:49 smithi044 bash[22676]: cluster 2024-09-21T04:25:48.231977+0000 mgr.a (mgr.14388) 16073 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:49 smithi179 bash[23186]: cluster 2024-09-21T04:25:48.231977+0000 mgr.a (mgr.14388) 16073 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:25:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:51 smithi049 bash[23528]: cluster 2024-09-21T04:25:50.233903+0000 mgr.a (mgr.14388) 16074 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:51 smithi044 bash[22676]: cluster 2024-09-21T04:25:50.233903+0000 mgr.a (mgr.14388) 16074 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:51 smithi179 bash[23186]: cluster 2024-09-21T04:25:50.233903+0000 mgr.a (mgr.14388) 16074 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:25:52.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:52.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:52.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:53.716 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:25:53.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:53.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:53.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:53.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: cluster 2024-09-21T04:25:52.235318+0000 mgr.a (mgr.14388) 16075 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:52.780757+0000 mon.a (mon.0) 12844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:52.789506+0000 mon.a (mon.0) 12845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:52.800047+0000 mon.a (mon.0) 12846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:52.884151+0000 mon.a (mon.0) 12847 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.490918+0000 mon.a (mon.0) 12848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.495738+0000 mon.a (mon.0) 12849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.501390+0000 mon.a (mon.0) 12850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.517270+0000 mon.a (mon.0) 12851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.518515+0000 mon.a (mon.0) 12852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:25:54.043 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.519309+0000 mon.a (mon.0) 12853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:25:54.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.524643+0000 mon.a (mon.0) 12854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.044 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:53 smithi049 bash[23528]: audit 2024-09-21T04:25:53.527299+0000 mon.a (mon.0) 12855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:25:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: cluster 2024-09-21T04:25:52.235318+0000 mgr.a (mgr.14388) 16075 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T04:25:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:52.780757+0000 mon.a (mon.0) 12844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:52.789506+0000 mon.a (mon.0) 12845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:52.800047+0000 mon.a (mon.0) 12846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:52.884151+0000 mon.a (mon.0) 12847 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:25:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.490918+0000 mon.a (mon.0) 12848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.495738+0000 mon.a (mon.0) 12849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.501390+0000 mon.a (mon.0) 12850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.517270+0000 mon.a (mon.0) 12851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.518515+0000 mon.a (mon.0) 12852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:25:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.519309+0000 mon.a (mon.0) 12853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:25:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.524643+0000 mon.a (mon.0) 12854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:53 smithi044 bash[22676]: audit 2024-09-21T04:25:53.527299+0000 mon.a (mon.0) 12855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:25:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: cluster 2024-09-21T04:25:52.235318+0000 mgr.a (mgr.14388) 16075 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:52.780757+0000 mon.a (mon.0) 12844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:52.789506+0000 mon.a (mon.0) 12845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:52.800047+0000 mon.a (mon.0) 12846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:52.884151+0000 mon.a (mon.0) 12847 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.490918+0000 mon.a (mon.0) 12848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.495738+0000 mon.a (mon.0) 12849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.501390+0000 mon.a (mon.0) 12850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.517270+0000 mon.a (mon.0) 12851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.518515+0000 mon.a (mon.0) 12852 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.519309+0000 mon.a (mon.0) 12853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.524643+0000 mon.a (mon.0) 12854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:25:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:53 smithi179 bash[23186]: audit 2024-09-21T04:25:53.527299+0000 mon.a (mon.0) 12855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:25:54.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:25:54 smithi044 bash[22930]: debug 2024-09-21T04:25:54.405+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:25:54.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:25:54 smithi044 bash[22930]: debug 2024-09-21T04:25:54.409+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:25:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:54 smithi049 bash[23528]: audit 2024-09-21T04:25:53.272563+0000 mgr.a (mgr.14388) 16076 : audit [DBG] from='client.122039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:54 smithi049 bash[23528]: audit 2024-09-21T04:25:53.528489+0000 mgr.a (mgr.14388) 16077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:25:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:54 smithi044 bash[22676]: audit 2024-09-21T04:25:53.272563+0000 mgr.a (mgr.14388) 16076 : audit [DBG] from='client.122039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:54 smithi044 bash[22676]: audit 2024-09-21T04:25:53.528489+0000 mgr.a (mgr.14388) 16077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:25:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:54 smithi179 bash[23186]: audit 2024-09-21T04:25:53.272563+0000 mgr.a (mgr.14388) 16076 : audit [DBG] from='client.122039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:25:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:54 smithi179 bash[23186]: audit 2024-09-21T04:25:53.528489+0000 mgr.a (mgr.14388) 16077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:25:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:55 smithi049 bash[23528]: cluster 2024-09-21T04:25:54.235898+0000 mgr.a (mgr.14388) 16078 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T04:25:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:55 smithi049 bash[23528]: audit 2024-09-21T04:25:54.411413+0000 mgr.a (mgr.14388) 16079 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:25:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:55 smithi049 bash[23528]: cephadm 2024-09-21T04:25:54.413406+0000 mgr.a (mgr.14388) 16080 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:25:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:55 smithi044 bash[22676]: cluster 2024-09-21T04:25:54.235898+0000 mgr.a (mgr.14388) 16078 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T04:25:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:55 smithi044 bash[22676]: audit 2024-09-21T04:25:54.411413+0000 mgr.a (mgr.14388) 16079 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:25:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:55 smithi044 bash[22676]: cephadm 2024-09-21T04:25:54.413406+0000 mgr.a (mgr.14388) 16080 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:25:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:55 smithi179 bash[23186]: cluster 2024-09-21T04:25:54.235898+0000 mgr.a (mgr.14388) 16078 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T04:25:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:55 smithi179 bash[23186]: audit 2024-09-21T04:25:54.411413+0000 mgr.a (mgr.14388) 16079 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:25:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:55 smithi179 bash[23186]: cephadm 2024-09-21T04:25:54.413406+0000 mgr.a (mgr.14388) 16080 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:25:57.837 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:57 smithi044 bash[22676]: cluster 2024-09-21T04:25:56.238112+0000 mgr.a (mgr.14388) 16081 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T04:25:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:57 smithi049 bash[23528]: cluster 2024-09-21T04:25:56.238112+0000 mgr.a (mgr.14388) 16081 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T04:25:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:57 smithi179 bash[23186]: cluster 2024-09-21T04:25:56.238112+0000 mgr.a (mgr.14388) 16081 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T04:25:58.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:25:58.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:25:58.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:25:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:25:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:25:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:25:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:25:59.493 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:59 smithi049 bash[23528]: cluster 2024-09-21T04:25:58.238893+0000 mgr.a (mgr.14388) 16082 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:26:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:25:59 smithi049 bash[23528]: audit 2024-09-21T04:25:59.050142+0000 mgr.a (mgr.14388) 16083 : audit [DBG] from='client.347418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:59 smithi044 bash[22676]: cluster 2024-09-21T04:25:58.238893+0000 mgr.a (mgr.14388) 16082 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:26:00.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:25:59 smithi044 bash[22676]: audit 2024-09-21T04:25:59.050142+0000 mgr.a (mgr.14388) 16083 : audit [DBG] from='client.347418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:59 smithi179 bash[23186]: cluster 2024-09-21T04:25:58.238893+0000 mgr.a (mgr.14388) 16082 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:26:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:25:59 smithi179 bash[23186]: audit 2024-09-21T04:25:59.050142+0000 mgr.a (mgr.14388) 16083 : audit [DBG] from='client.347418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:01 smithi179 bash[23186]: cluster 2024-09-21T04:26:00.240964+0000 mgr.a (mgr.14388) 16084 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T04:26:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:01 smithi044 bash[22676]: cluster 2024-09-21T04:26:00.240964+0000 mgr.a (mgr.14388) 16084 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T04:26:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:01 smithi049 bash[23528]: cluster 2024-09-21T04:26:00.240964+0000 mgr.a (mgr.14388) 16084 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T04:26:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:03 smithi044 bash[22676]: cluster 2024-09-21T04:26:02.242328+0000 mgr.a (mgr.14388) 16085 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:26:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:03 smithi179 bash[23186]: cluster 2024-09-21T04:26:02.242328+0000 mgr.a (mgr.14388) 16085 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:26:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:03 smithi049 bash[23528]: cluster 2024-09-21T04:26:02.242328+0000 mgr.a (mgr.14388) 16085 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:26:04.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:04 smithi044 bash[22676]: audit 2024-09-21T04:26:03.929597+0000 mon.a (mon.0) 12856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:04 smithi044 bash[22676]: audit 2024-09-21T04:26:03.938117+0000 mon.a (mon.0) 12857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:04 smithi044 bash[22676]: audit 2024-09-21T04:26:03.948847+0000 mon.a (mon.0) 12858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:04 smithi044 bash[22676]: audit 2024-09-21T04:26:04.381442+0000 mon.a (mon.0) 12859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:04 smithi044 bash[22676]: audit 2024-09-21T04:26:04.389900+0000 mon.a (mon.0) 12860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:04 smithi044 bash[22676]: audit 2024-09-21T04:26:04.400107+0000 mon.a (mon.0) 12861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:04 smithi179 bash[23186]: audit 2024-09-21T04:26:03.929597+0000 mon.a (mon.0) 12856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:04 smithi179 bash[23186]: audit 2024-09-21T04:26:03.938117+0000 mon.a (mon.0) 12857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:04 smithi179 bash[23186]: audit 2024-09-21T04:26:03.948847+0000 mon.a (mon.0) 12858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:04 smithi179 bash[23186]: audit 2024-09-21T04:26:04.381442+0000 mon.a (mon.0) 12859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:04 smithi179 bash[23186]: audit 2024-09-21T04:26:04.389900+0000 mon.a (mon.0) 12860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:04 smithi179 bash[23186]: audit 2024-09-21T04:26:04.400107+0000 mon.a (mon.0) 12861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:05.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:05.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:05.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:05.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:04 smithi049 bash[23528]: audit 2024-09-21T04:26:03.929597+0000 mon.a (mon.0) 12856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:04 smithi049 bash[23528]: audit 2024-09-21T04:26:03.938117+0000 mon.a (mon.0) 12857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:04 smithi049 bash[23528]: audit 2024-09-21T04:26:03.948847+0000 mon.a (mon.0) 12858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:04 smithi049 bash[23528]: audit 2024-09-21T04:26:04.381442+0000 mon.a (mon.0) 12859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:04 smithi049 bash[23528]: audit 2024-09-21T04:26:04.389900+0000 mon.a (mon.0) 12860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:04 smithi049 bash[23528]: audit 2024-09-21T04:26:04.400107+0000 mon.a (mon.0) 12861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:05 smithi044 bash[22676]: cluster 2024-09-21T04:26:04.243105+0000 mgr.a (mgr.14388) 16086 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T04:26:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:05 smithi044 bash[22676]: audit 2024-09-21T04:26:04.824588+0000 mgr.a (mgr.14388) 16087 : audit [DBG] from='client.347490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:05 smithi179 bash[23186]: cluster 2024-09-21T04:26:04.243105+0000 mgr.a (mgr.14388) 16086 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T04:26:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:05 smithi179 bash[23186]: audit 2024-09-21T04:26:04.824588+0000 mgr.a (mgr.14388) 16087 : audit [DBG] from='client.347490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:05 smithi049 bash[23528]: cluster 2024-09-21T04:26:04.243105+0000 mgr.a (mgr.14388) 16086 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T04:26:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:05 smithi049 bash[23528]: audit 2024-09-21T04:26:04.824588+0000 mgr.a (mgr.14388) 16087 : audit [DBG] from='client.347490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:07 smithi044 bash[22676]: cluster 2024-09-21T04:26:06.245732+0000 mgr.a (mgr.14388) 16088 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T04:26:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:07 smithi179 bash[23186]: cluster 2024-09-21T04:26:06.245732+0000 mgr.a (mgr.14388) 16088 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T04:26:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:07 smithi049 bash[23528]: cluster 2024-09-21T04:26:06.245732+0000 mgr.a (mgr.14388) 16088 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T04:26:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:09 smithi044 bash[22676]: cluster 2024-09-21T04:26:08.246517+0000 mgr.a (mgr.14388) 16089 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:26:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:09 smithi179 bash[23186]: cluster 2024-09-21T04:26:08.246517+0000 mgr.a (mgr.14388) 16089 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:26:10.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:10.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:10.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:09 smithi049 bash[23528]: cluster 2024-09-21T04:26:08.246517+0000 mgr.a (mgr.14388) 16089 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:26:11.043 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:11.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:11.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:11.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:11.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:11 smithi044 bash[22676]: cluster 2024-09-21T04:26:10.248072+0000 mgr.a (mgr.14388) 16090 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:11 smithi044 bash[22676]: audit 2024-09-21T04:26:10.595619+0000 mgr.a (mgr.14388) 16091 : audit [DBG] from='client.347565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:11 smithi179 bash[23186]: cluster 2024-09-21T04:26:10.248072+0000 mgr.a (mgr.14388) 16090 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:11 smithi179 bash[23186]: audit 2024-09-21T04:26:10.595619+0000 mgr.a (mgr.14388) 16091 : audit [DBG] from='client.347565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:11 smithi049 bash[23528]: cluster 2024-09-21T04:26:10.248072+0000 mgr.a (mgr.14388) 16090 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:11 smithi049 bash[23528]: audit 2024-09-21T04:26:10.595619+0000 mgr.a (mgr.14388) 16091 : audit [DBG] from='client.347565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:13 smithi044 bash[22676]: cluster 2024-09-21T04:26:12.250008+0000 mgr.a (mgr.14388) 16092 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:26:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:13 smithi044 bash[22676]: audit 2024-09-21T04:26:12.943778+0000 mon.a (mon.0) 12862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:13 smithi044 bash[22676]: audit 2024-09-21T04:26:12.953608+0000 mon.a (mon.0) 12863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:13 smithi044 bash[22676]: audit 2024-09-21T04:26:12.966028+0000 mon.a (mon.0) 12864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:13 smithi179 bash[23186]: cluster 2024-09-21T04:26:12.250008+0000 mgr.a (mgr.14388) 16092 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:26:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:13 smithi179 bash[23186]: audit 2024-09-21T04:26:12.943778+0000 mon.a (mon.0) 12862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:13 smithi179 bash[23186]: audit 2024-09-21T04:26:12.953608+0000 mon.a (mon.0) 12863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:13 smithi179 bash[23186]: audit 2024-09-21T04:26:12.966028+0000 mon.a (mon.0) 12864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:13 smithi049 bash[23528]: cluster 2024-09-21T04:26:12.250008+0000 mgr.a (mgr.14388) 16092 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:26:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:13 smithi049 bash[23528]: audit 2024-09-21T04:26:12.943778+0000 mon.a (mon.0) 12862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:13 smithi049 bash[23528]: audit 2024-09-21T04:26:12.953608+0000 mon.a (mon.0) 12863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:13 smithi049 bash[23528]: audit 2024-09-21T04:26:12.966028+0000 mon.a (mon.0) 12864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:16.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:16.045 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:15 smithi044 bash[22676]: cluster 2024-09-21T04:26:14.250851+0000 mgr.a (mgr.14388) 16093 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:15 smithi179 bash[23186]: cluster 2024-09-21T04:26:14.250851+0000 mgr.a (mgr.14388) 16093 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:15 smithi049 bash[23528]: cluster 2024-09-21T04:26:14.250851+0000 mgr.a (mgr.14388) 16093 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:16.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:16.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:16.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:16.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:16.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:17.977 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:17 smithi044 bash[22676]: cluster 2024-09-21T04:26:16.252866+0000 mgr.a (mgr.14388) 16094 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:17.977 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:17 smithi044 bash[22676]: audit 2024-09-21T04:26:16.377316+0000 mgr.a (mgr.14388) 16095 : audit [DBG] from='client.347643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:17 smithi179 bash[23186]: cluster 2024-09-21T04:26:16.252866+0000 mgr.a (mgr.14388) 16094 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:17 smithi179 bash[23186]: audit 2024-09-21T04:26:16.377316+0000 mgr.a (mgr.14388) 16095 : audit [DBG] from='client.347643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:17 smithi049 bash[23528]: cluster 2024-09-21T04:26:16.252866+0000 mgr.a (mgr.14388) 16094 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:17 smithi049 bash[23528]: audit 2024-09-21T04:26:16.377316+0000 mgr.a (mgr.14388) 16095 : audit [DBG] from='client.347643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:19 smithi044 bash[22676]: cluster 2024-09-21T04:26:18.253811+0000 mgr.a (mgr.14388) 16096 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:19 smithi179 bash[23186]: cluster 2024-09-21T04:26:18.253811+0000 mgr.a (mgr.14388) 16096 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:19 smithi049 bash[23528]: cluster 2024-09-21T04:26:18.253811+0000 mgr.a (mgr.14388) 16096 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:21.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:21.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:21.823 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:22.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:21 smithi179 bash[23186]: cluster 2024-09-21T04:26:20.255727+0000 mgr.a (mgr.14388) 16097 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:21 smithi044 bash[22676]: cluster 2024-09-21T04:26:20.255727+0000 mgr.a (mgr.14388) 16097 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:21 smithi049 bash[23528]: cluster 2024-09-21T04:26:20.255727+0000 mgr.a (mgr.14388) 16097 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:22.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:22.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:22.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:22.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:22.578 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:23 smithi044 bash[22676]: audit 2024-09-21T04:26:22.150701+0000 mgr.a (mgr.14388) 16098 : audit [DBG] from='client.347721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:23 smithi044 bash[22676]: cluster 2024-09-21T04:26:22.256594+0000 mgr.a (mgr.14388) 16099 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:23 smithi179 bash[23186]: audit 2024-09-21T04:26:22.150701+0000 mgr.a (mgr.14388) 16098 : audit [DBG] from='client.347721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:23 smithi179 bash[23186]: cluster 2024-09-21T04:26:22.256594+0000 mgr.a (mgr.14388) 16099 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:23 smithi049 bash[23528]: audit 2024-09-21T04:26:22.150701+0000 mgr.a (mgr.14388) 16098 : audit [DBG] from='client.347721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:23 smithi049 bash[23528]: cluster 2024-09-21T04:26:22.256594+0000 mgr.a (mgr.14388) 16099 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:25 smithi044 bash[22676]: audit 2024-09-21T04:26:24.113270+0000 mon.a (mon.0) 12865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:25 smithi044 bash[22676]: audit 2024-09-21T04:26:24.120323+0000 mon.a (mon.0) 12866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:25 smithi044 bash[22676]: audit 2024-09-21T04:26:24.130595+0000 mon.a (mon.0) 12867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:25 smithi044 bash[22676]: audit 2024-09-21T04:26:24.605726+0000 mon.a (mon.0) 12868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:25 smithi044 bash[22676]: audit 2024-09-21T04:26:24.614603+0000 mon.a (mon.0) 12869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:25 smithi044 bash[22676]: audit 2024-09-21T04:26:24.624893+0000 mon.a (mon.0) 12870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:25 smithi179 bash[23186]: audit 2024-09-21T04:26:24.113270+0000 mon.a (mon.0) 12865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:25 smithi179 bash[23186]: audit 2024-09-21T04:26:24.120323+0000 mon.a (mon.0) 12866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:25 smithi179 bash[23186]: audit 2024-09-21T04:26:24.130595+0000 mon.a (mon.0) 12867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:25 smithi179 bash[23186]: audit 2024-09-21T04:26:24.605726+0000 mon.a (mon.0) 12868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:25 smithi179 bash[23186]: audit 2024-09-21T04:26:24.614603+0000 mon.a (mon.0) 12869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:25 smithi179 bash[23186]: audit 2024-09-21T04:26:24.624893+0000 mon.a (mon.0) 12870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:25 smithi049 bash[23528]: audit 2024-09-21T04:26:24.113270+0000 mon.a (mon.0) 12865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:25 smithi049 bash[23528]: audit 2024-09-21T04:26:24.120323+0000 mon.a (mon.0) 12866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:25 smithi049 bash[23528]: audit 2024-09-21T04:26:24.130595+0000 mon.a (mon.0) 12867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:25 smithi049 bash[23528]: audit 2024-09-21T04:26:24.605726+0000 mon.a (mon.0) 12868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:25 smithi049 bash[23528]: audit 2024-09-21T04:26:24.614603+0000 mon.a (mon.0) 12869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:25 smithi049 bash[23528]: audit 2024-09-21T04:26:24.624893+0000 mon.a (mon.0) 12870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:26 smithi044 bash[22676]: cluster 2024-09-21T04:26:24.257529+0000 mgr.a (mgr.14388) 16100 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:26 smithi179 bash[23186]: cluster 2024-09-21T04:26:24.257529+0000 mgr.a (mgr.14388) 16100 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:26 smithi049 bash[23528]: cluster 2024-09-21T04:26:24.257529+0000 mgr.a (mgr.14388) 16100 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:26:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:27.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:27.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:28.359 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:28.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:28.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:28.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:28.360 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:28 smithi044 bash[22676]: cluster 2024-09-21T04:26:26.259726+0000 mgr.a (mgr.14388) 16101 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:26:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:28 smithi179 bash[23186]: cluster 2024-09-21T04:26:26.259726+0000 mgr.a (mgr.14388) 16101 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:26:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:28 smithi049 bash[23528]: cluster 2024-09-21T04:26:26.259726+0000 mgr.a (mgr.14388) 16101 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:26:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:29 smithi044 bash[22676]: audit 2024-09-21T04:26:27.913311+0000 mgr.a (mgr.14388) 16102 : audit [DBG] from='client.347796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:29 smithi179 bash[23186]: audit 2024-09-21T04:26:27.913311+0000 mgr.a (mgr.14388) 16102 : audit [DBG] from='client.347796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:29 smithi049 bash[23528]: audit 2024-09-21T04:26:27.913311+0000 mgr.a (mgr.14388) 16102 : audit [DBG] from='client.347796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:30 smithi044 bash[22676]: cluster 2024-09-21T04:26:28.260314+0000 mgr.a (mgr.14388) 16103 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:30 smithi179 bash[23186]: cluster 2024-09-21T04:26:28.260314+0000 mgr.a (mgr.14388) 16103 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:30 smithi049 bash[23528]: cluster 2024-09-21T04:26:28.260314+0000 mgr.a (mgr.14388) 16103 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:31 smithi044 bash[22676]: cluster 2024-09-21T04:26:30.262096+0000 mgr.a (mgr.14388) 16104 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:26:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:31 smithi179 bash[23186]: cluster 2024-09-21T04:26:30.262096+0000 mgr.a (mgr.14388) 16104 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:26:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:31 smithi049 bash[23528]: cluster 2024-09-21T04:26:30.262096+0000 mgr.a (mgr.14388) 16104 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:26:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:33.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:33 smithi049 bash[23528]: cluster 2024-09-21T04:26:32.263422+0000 mgr.a (mgr.14388) 16105 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:33.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:33 smithi049 bash[23528]: audit 2024-09-21T04:26:33.175096+0000 mon.a (mon.0) 12871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.545 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:33 smithi049 bash[23528]: audit 2024-09-21T04:26:33.184326+0000 mon.a (mon.0) 12872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.546 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:33 smithi049 bash[23528]: audit 2024-09-21T04:26:33.194764+0000 mon.a (mon.0) 12873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:33 smithi044 bash[22676]: cluster 2024-09-21T04:26:32.263422+0000 mgr.a (mgr.14388) 16105 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:33 smithi044 bash[22676]: audit 2024-09-21T04:26:33.175096+0000 mon.a (mon.0) 12871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:33 smithi044 bash[22676]: audit 2024-09-21T04:26:33.184326+0000 mon.a (mon.0) 12872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:33 smithi044 bash[22676]: audit 2024-09-21T04:26:33.194764+0000 mon.a (mon.0) 12873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:33 smithi179 bash[23186]: cluster 2024-09-21T04:26:32.263422+0000 mgr.a (mgr.14388) 16105 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:33 smithi179 bash[23186]: audit 2024-09-21T04:26:33.175096+0000 mon.a (mon.0) 12871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:33 smithi179 bash[23186]: audit 2024-09-21T04:26:33.184326+0000 mon.a (mon.0) 12872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:33 smithi179 bash[23186]: audit 2024-09-21T04:26:33.194764+0000 mon.a (mon.0) 12873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:34.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:34 smithi049 bash[23528]: audit 2024-09-21T04:26:33.691326+0000 mgr.a (mgr.14388) 16106 : audit [DBG] from='client.347874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:34 smithi044 bash[22676]: audit 2024-09-21T04:26:33.691326+0000 mgr.a (mgr.14388) 16106 : audit [DBG] from='client.347874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:34 smithi179 bash[23186]: audit 2024-09-21T04:26:33.691326+0000 mgr.a (mgr.14388) 16106 : audit [DBG] from='client.347874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:35 smithi049 bash[23528]: cluster 2024-09-21T04:26:34.264384+0000 mgr.a (mgr.14388) 16107 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:35 smithi044 bash[22676]: cluster 2024-09-21T04:26:34.264384+0000 mgr.a (mgr.14388) 16107 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:35 smithi179 bash[23186]: cluster 2024-09-21T04:26:34.264384+0000 mgr.a (mgr.14388) 16107 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:37 smithi044 bash[22676]: cluster 2024-09-21T04:26:36.266650+0000 mgr.a (mgr.14388) 16108 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:26:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:37 smithi179 bash[23186]: cluster 2024-09-21T04:26:36.266650+0000 mgr.a (mgr.14388) 16108 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:26:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:37 smithi049 bash[23528]: cluster 2024-09-21T04:26:36.266650+0000 mgr.a (mgr.14388) 16108 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:26:39.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:39 smithi044 bash[22676]: cluster 2024-09-21T04:26:38.267437+0000 mgr.a (mgr.14388) 16109 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:39 smithi179 bash[23186]: cluster 2024-09-21T04:26:38.267437+0000 mgr.a (mgr.14388) 16109 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:39 smithi049 bash[23528]: cluster 2024-09-21T04:26:38.267437+0000 mgr.a (mgr.14388) 16109 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:39.914 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:40 smithi044 bash[22676]: audit 2024-09-21T04:26:39.476852+0000 mgr.a (mgr.14388) 16110 : audit [DBG] from='client.347952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:40 smithi179 bash[23186]: audit 2024-09-21T04:26:39.476852+0000 mgr.a (mgr.14388) 16110 : audit [DBG] from='client.347952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:40 smithi049 bash[23528]: audit 2024-09-21T04:26:39.476852+0000 mgr.a (mgr.14388) 16110 : audit [DBG] from='client.347952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:41 smithi044 bash[22676]: cluster 2024-09-21T04:26:40.268671+0000 mgr.a (mgr.14388) 16111 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:26:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:41 smithi179 bash[23186]: cluster 2024-09-21T04:26:40.268671+0000 mgr.a (mgr.14388) 16111 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:26:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:41 smithi049 bash[23528]: cluster 2024-09-21T04:26:40.268671+0000 mgr.a (mgr.14388) 16111 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:26:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:43 smithi044 bash[22676]: cluster 2024-09-21T04:26:42.270050+0000 mgr.a (mgr.14388) 16112 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:43 smithi179 bash[23186]: cluster 2024-09-21T04:26:42.270050+0000 mgr.a (mgr.14388) 16112 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:43 smithi049 bash[23528]: cluster 2024-09-21T04:26:42.270050+0000 mgr.a (mgr.14388) 16112 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:44.915 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:44.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:44.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:45 smithi049 bash[23528]: cluster 2024-09-21T04:26:44.270794+0000 mgr.a (mgr.14388) 16113 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:45 smithi049 bash[23528]: audit 2024-09-21T04:26:44.341189+0000 mon.a (mon.0) 12874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:45 smithi049 bash[23528]: audit 2024-09-21T04:26:44.350169+0000 mon.a (mon.0) 12875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:45 smithi049 bash[23528]: audit 2024-09-21T04:26:44.368215+0000 mon.a (mon.0) 12876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:45 smithi049 bash[23528]: audit 2024-09-21T04:26:44.833891+0000 mon.a (mon.0) 12877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:45 smithi049 bash[23528]: audit 2024-09-21T04:26:44.844195+0000 mon.a (mon.0) 12878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:45 smithi049 bash[23528]: audit 2024-09-21T04:26:44.855961+0000 mon.a (mon.0) 12879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:45.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:45.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:45.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:45.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:45 smithi044 bash[22676]: cluster 2024-09-21T04:26:44.270794+0000 mgr.a (mgr.14388) 16113 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:45 smithi044 bash[22676]: audit 2024-09-21T04:26:44.341189+0000 mon.a (mon.0) 12874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:45 smithi044 bash[22676]: audit 2024-09-21T04:26:44.350169+0000 mon.a (mon.0) 12875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:45 smithi044 bash[22676]: audit 2024-09-21T04:26:44.368215+0000 mon.a (mon.0) 12876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:45 smithi044 bash[22676]: audit 2024-09-21T04:26:44.833891+0000 mon.a (mon.0) 12877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:45 smithi044 bash[22676]: audit 2024-09-21T04:26:44.844195+0000 mon.a (mon.0) 12878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:45 smithi044 bash[22676]: audit 2024-09-21T04:26:44.855961+0000 mon.a (mon.0) 12879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:45 smithi179 bash[23186]: cluster 2024-09-21T04:26:44.270794+0000 mgr.a (mgr.14388) 16113 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:45 smithi179 bash[23186]: audit 2024-09-21T04:26:44.341189+0000 mon.a (mon.0) 12874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:45 smithi179 bash[23186]: audit 2024-09-21T04:26:44.350169+0000 mon.a (mon.0) 12875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:45 smithi179 bash[23186]: audit 2024-09-21T04:26:44.368215+0000 mon.a (mon.0) 12876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:45 smithi179 bash[23186]: audit 2024-09-21T04:26:44.833891+0000 mon.a (mon.0) 12877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:45 smithi179 bash[23186]: audit 2024-09-21T04:26:44.844195+0000 mon.a (mon.0) 12878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:45.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:45 smithi179 bash[23186]: audit 2024-09-21T04:26:44.855961+0000 mon.a (mon.0) 12879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:46 smithi044 bash[22676]: audit 2024-09-21T04:26:45.254601+0000 mgr.a (mgr.14388) 16114 : audit [DBG] from='client.348030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:46 smithi179 bash[23186]: audit 2024-09-21T04:26:45.254601+0000 mgr.a (mgr.14388) 16114 : audit [DBG] from='client.348030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:46 smithi049 bash[23528]: audit 2024-09-21T04:26:45.254601+0000 mgr.a (mgr.14388) 16114 : audit [DBG] from='client.348030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:47 smithi044 bash[22676]: cluster 2024-09-21T04:26:46.273735+0000 mgr.a (mgr.14388) 16115 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:47 smithi179 bash[23186]: cluster 2024-09-21T04:26:46.273735+0000 mgr.a (mgr.14388) 16115 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:47 smithi049 bash[23528]: cluster 2024-09-21T04:26:46.273735+0000 mgr.a (mgr.14388) 16115 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:26:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:49 smithi044 bash[22676]: cluster 2024-09-21T04:26:48.274515+0000 mgr.a (mgr.14388) 16116 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:49 smithi179 bash[23186]: cluster 2024-09-21T04:26:48.274515+0000 mgr.a (mgr.14388) 16116 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:49 smithi049 bash[23528]: cluster 2024-09-21T04:26:48.274515+0000 mgr.a (mgr.14388) 16116 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:50.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:51.470 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:51 smithi044 bash[22676]: cluster 2024-09-21T04:26:50.276167+0000 mgr.a (mgr.14388) 16117 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:26:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:51 smithi044 bash[22676]: audit 2024-09-21T04:26:51.031321+0000 mgr.a (mgr.14388) 16118 : audit [DBG] from='client.348108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:51 smithi179 bash[23186]: cluster 2024-09-21T04:26:50.276167+0000 mgr.a (mgr.14388) 16117 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:26:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:51 smithi179 bash[23186]: audit 2024-09-21T04:26:51.031321+0000 mgr.a (mgr.14388) 16118 : audit [DBG] from='client.348108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:51 smithi049 bash[23528]: cluster 2024-09-21T04:26:50.276167+0000 mgr.a (mgr.14388) 16117 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:26:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:51 smithi049 bash[23528]: audit 2024-09-21T04:26:51.031321+0000 mgr.a (mgr.14388) 16118 : audit [DBG] from='client.348108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:53.637 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:53 smithi049 bash[23528]: cluster 2024-09-21T04:26:52.278085+0000 mgr.a (mgr.14388) 16119 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:26:53.637 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:53 smithi049 bash[23528]: audit 2024-09-21T04:26:53.360835+0000 mon.a (mon.0) 12880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.637 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:53 smithi049 bash[23528]: audit 2024-09-21T04:26:53.369678+0000 mon.a (mon.0) 12881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.637 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:53 smithi049 bash[23528]: audit 2024-09-21T04:26:53.380372+0000 mon.a (mon.0) 12882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:53 smithi044 bash[22676]: cluster 2024-09-21T04:26:52.278085+0000 mgr.a (mgr.14388) 16119 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:26:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:53 smithi044 bash[22676]: audit 2024-09-21T04:26:53.360835+0000 mon.a (mon.0) 12880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:53 smithi044 bash[22676]: audit 2024-09-21T04:26:53.369678+0000 mon.a (mon.0) 12881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:53 smithi044 bash[22676]: audit 2024-09-21T04:26:53.380372+0000 mon.a (mon.0) 12882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:53 smithi179 bash[23186]: cluster 2024-09-21T04:26:52.278085+0000 mgr.a (mgr.14388) 16119 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:26:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:53 smithi179 bash[23186]: audit 2024-09-21T04:26:53.360835+0000 mon.a (mon.0) 12880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:53 smithi179 bash[23186]: audit 2024-09-21T04:26:53.369678+0000 mon.a (mon.0) 12881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:53 smithi179 bash[23186]: audit 2024-09-21T04:26:53.380372+0000 mon.a (mon.0) 12882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: cluster 2024-09-21T04:26:54.278920+0000 mgr.a (mgr.14388) 16120 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:54.497485+0000 mon.a (mon.0) 12883 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:26:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:55.061711+0000 mon.a (mon.0) 12884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:55.071660+0000 mon.a (mon.0) 12885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:55.074442+0000 mon.a (mon.0) 12886 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:26:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:55.076548+0000 mon.a (mon.0) 12887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:26:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:55.088999+0000 mon.a (mon.0) 12888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:55.095285+0000 mon.a (mon.0) 12889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:26:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22676]: audit 2024-09-21T04:26:55.097708+0000 mgr.a (mgr.14388) 16121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:26:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: cluster 2024-09-21T04:26:54.278920+0000 mgr.a (mgr.14388) 16120 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:54.497485+0000 mon.a (mon.0) 12883 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:26:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:55.061711+0000 mon.a (mon.0) 12884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:55.071660+0000 mon.a (mon.0) 12885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:55.074442+0000 mon.a (mon.0) 12886 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:26:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:55.076548+0000 mon.a (mon.0) 12887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:26:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:55.088999+0000 mon.a (mon.0) 12888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:55.095285+0000 mon.a (mon.0) 12889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:26:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:55 smithi179 bash[23186]: audit 2024-09-21T04:26:55.097708+0000 mgr.a (mgr.14388) 16121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: cluster 2024-09-21T04:26:54.278920+0000 mgr.a (mgr.14388) 16120 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:54.497485+0000 mon.a (mon.0) 12883 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:55.061711+0000 mon.a (mon.0) 12884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:55.071660+0000 mon.a (mon.0) 12885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:55.074442+0000 mon.a (mon.0) 12886 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:55.076548+0000 mon.a (mon.0) 12887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:55.088999+0000 mon.a (mon.0) 12888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:55.095285+0000 mon.a (mon.0) 12889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:26:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:55 smithi049 bash[23528]: audit 2024-09-21T04:26:55.097708+0000 mgr.a (mgr.14388) 16121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:26:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22930]: debug 2024-09-21T04:26:55.892+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:26:56.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:26:55 smithi044 bash[22930]: debug 2024-09-21T04:26:55.892+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:26:56.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:26:56.473 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:26:56.473 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:26:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:56 smithi049 bash[23528]: audit 2024-09-21T04:26:55.894838+0000 mgr.a (mgr.14388) 16122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:26:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:56 smithi049 bash[23528]: cephadm 2024-09-21T04:26:55.896090+0000 mgr.a (mgr.14388) 16123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:26:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:56 smithi044 bash[22676]: audit 2024-09-21T04:26:55.894838+0000 mgr.a (mgr.14388) 16122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:26:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:56 smithi044 bash[22676]: cephadm 2024-09-21T04:26:55.896090+0000 mgr.a (mgr.14388) 16123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:26:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:56 smithi179 bash[23186]: audit 2024-09-21T04:26:55.894838+0000 mgr.a (mgr.14388) 16122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:26:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:56 smithi179 bash[23186]: cephadm 2024-09-21T04:26:55.896090+0000 mgr.a (mgr.14388) 16123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:26:57.233 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:26:57.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:26:57.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:26:57.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:26:57.233 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:26:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:57 smithi044 bash[22676]: cluster 2024-09-21T04:26:56.282055+0000 mgr.a (mgr.14388) 16124 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:57 smithi044 bash[22676]: audit 2024-09-21T04:26:56.807734+0000 mgr.a (mgr.14388) 16125 : audit [DBG] from='client.348294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:57 smithi179 bash[23186]: cluster 2024-09-21T04:26:56.282055+0000 mgr.a (mgr.14388) 16124 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:57 smithi179 bash[23186]: audit 2024-09-21T04:26:56.807734+0000 mgr.a (mgr.14388) 16125 : audit [DBG] from='client.348294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:57 smithi049 bash[23528]: cluster 2024-09-21T04:26:56.282055+0000 mgr.a (mgr.14388) 16124 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:57 smithi049 bash[23528]: audit 2024-09-21T04:26:56.807734+0000 mgr.a (mgr.14388) 16125 : audit [DBG] from='client.348294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:26:59.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:26:59 smithi044 bash[22676]: cluster 2024-09-21T04:26:58.283043+0000 mgr.a (mgr.14388) 16126 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:26:59 smithi179 bash[23186]: cluster 2024-09-21T04:26:58.283043+0000 mgr.a (mgr.14388) 16126 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:26:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:26:59 smithi049 bash[23528]: cluster 2024-09-21T04:26:58.283043+0000 mgr.a (mgr.14388) 16126 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:27:01.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:01 smithi044 bash[22676]: cluster 2024-09-21T04:27:00.284962+0000 mgr.a (mgr.14388) 16127 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-21T04:27:01.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:01 smithi179 bash[23186]: cluster 2024-09-21T04:27:00.284962+0000 mgr.a (mgr.14388) 16127 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-21T04:27:01.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:01 smithi049 bash[23528]: cluster 2024-09-21T04:27:00.284962+0000 mgr.a (mgr.14388) 16127 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-09-21T04:27:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:02.992 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:02.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:02.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:02.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:02.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:03 smithi044 bash[22676]: cluster 2024-09-21T04:27:02.286214+0000 mgr.a (mgr.14388) 16128 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:03 smithi044 bash[22676]: audit 2024-09-21T04:27:02.568090+0000 mgr.a (mgr.14388) 16129 : audit [DBG] from='client.348372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:03 smithi179 bash[23186]: cluster 2024-09-21T04:27:02.286214+0000 mgr.a (mgr.14388) 16128 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:03 smithi179 bash[23186]: audit 2024-09-21T04:27:02.568090+0000 mgr.a (mgr.14388) 16129 : audit [DBG] from='client.348372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:03 smithi049 bash[23528]: cluster 2024-09-21T04:27:02.286214+0000 mgr.a (mgr.14388) 16128 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:03 smithi049 bash[23528]: audit 2024-09-21T04:27:02.568090+0000 mgr.a (mgr.14388) 16129 : audit [DBG] from='client.348372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:05 smithi044 bash[22676]: cluster 2024-09-21T04:27:04.287170+0000 mgr.a (mgr.14388) 16130 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:05 smithi044 bash[22676]: audit 2024-09-21T04:27:04.582486+0000 mon.a (mon.0) 12890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:05 smithi044 bash[22676]: audit 2024-09-21T04:27:04.591515+0000 mon.a (mon.0) 12891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:05 smithi044 bash[22676]: audit 2024-09-21T04:27:04.602085+0000 mon.a (mon.0) 12892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:05 smithi044 bash[22676]: audit 2024-09-21T04:27:05.065395+0000 mon.a (mon.0) 12893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:05 smithi044 bash[22676]: audit 2024-09-21T04:27:05.073678+0000 mon.a (mon.0) 12894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:05 smithi044 bash[22676]: audit 2024-09-21T04:27:05.083674+0000 mon.a (mon.0) 12895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:05 smithi179 bash[23186]: cluster 2024-09-21T04:27:04.287170+0000 mgr.a (mgr.14388) 16130 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:05 smithi179 bash[23186]: audit 2024-09-21T04:27:04.582486+0000 mon.a (mon.0) 12890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:05 smithi179 bash[23186]: audit 2024-09-21T04:27:04.591515+0000 mon.a (mon.0) 12891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:05 smithi179 bash[23186]: audit 2024-09-21T04:27:04.602085+0000 mon.a (mon.0) 12892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:05 smithi179 bash[23186]: audit 2024-09-21T04:27:05.065395+0000 mon.a (mon.0) 12893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:05 smithi179 bash[23186]: audit 2024-09-21T04:27:05.073678+0000 mon.a (mon.0) 12894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:05 smithi179 bash[23186]: audit 2024-09-21T04:27:05.083674+0000 mon.a (mon.0) 12895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:05 smithi049 bash[23528]: cluster 2024-09-21T04:27:04.287170+0000 mgr.a (mgr.14388) 16130 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:05 smithi049 bash[23528]: audit 2024-09-21T04:27:04.582486+0000 mon.a (mon.0) 12890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:05 smithi049 bash[23528]: audit 2024-09-21T04:27:04.591515+0000 mon.a (mon.0) 12891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:05 smithi049 bash[23528]: audit 2024-09-21T04:27:04.602085+0000 mon.a (mon.0) 12892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:05 smithi049 bash[23528]: audit 2024-09-21T04:27:05.065395+0000 mon.a (mon.0) 12893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:05 smithi049 bash[23528]: audit 2024-09-21T04:27:05.073678+0000 mon.a (mon.0) 12894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:05 smithi049 bash[23528]: audit 2024-09-21T04:27:05.083674+0000 mon.a (mon.0) 12895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:07 smithi044 bash[22676]: cluster 2024-09-21T04:27:06.289461+0000 mgr.a (mgr.14388) 16131 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:07.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:07.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:07.995 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:07 smithi179 bash[23186]: cluster 2024-09-21T04:27:06.289461+0000 mgr.a (mgr.14388) 16131 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:07 smithi049 bash[23528]: cluster 2024-09-21T04:27:06.289461+0000 mgr.a (mgr.14388) 16131 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:08.766 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:09 smithi044 bash[22676]: cluster 2024-09-21T04:27:08.290187+0000 mgr.a (mgr.14388) 16132 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:27:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:09 smithi044 bash[22676]: audit 2024-09-21T04:27:08.330175+0000 mgr.a (mgr.14388) 16133 : audit [DBG] from='client.348447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:09 smithi179 bash[23186]: cluster 2024-09-21T04:27:08.290187+0000 mgr.a (mgr.14388) 16132 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:27:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:09 smithi179 bash[23186]: audit 2024-09-21T04:27:08.330175+0000 mgr.a (mgr.14388) 16133 : audit [DBG] from='client.348447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:09 smithi049 bash[23528]: cluster 2024-09-21T04:27:08.290187+0000 mgr.a (mgr.14388) 16132 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:27:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:09 smithi049 bash[23528]: audit 2024-09-21T04:27:08.330175+0000 mgr.a (mgr.14388) 16133 : audit [DBG] from='client.348447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:11 smithi044 bash[22676]: cluster 2024-09-21T04:27:10.292088+0000 mgr.a (mgr.14388) 16134 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:11 smithi179 bash[23186]: cluster 2024-09-21T04:27:10.292088+0000 mgr.a (mgr.14388) 16134 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:11 smithi049 bash[23528]: cluster 2024-09-21T04:27:10.292088+0000 mgr.a (mgr.14388) 16134 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:27:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:13.768 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:13.769 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:13 smithi044 bash[22676]: cluster 2024-09-21T04:27:12.293399+0000 mgr.a (mgr.14388) 16135 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:27:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:13 smithi044 bash[22676]: audit 2024-09-21T04:27:13.592553+0000 mon.a (mon.0) 12896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:13 smithi179 bash[23186]: cluster 2024-09-21T04:27:12.293399+0000 mgr.a (mgr.14388) 16135 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:27:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:13 smithi179 bash[23186]: audit 2024-09-21T04:27:13.592553+0000 mon.a (mon.0) 12896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:13 smithi049 bash[23528]: cluster 2024-09-21T04:27:12.293399+0000 mgr.a (mgr.14388) 16135 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T04:27:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:13 smithi049 bash[23528]: audit 2024-09-21T04:27:13.592553+0000 mon.a (mon.0) 12896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:14.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:14 smithi049 bash[23528]: audit 2024-09-21T04:27:13.603077+0000 mon.a (mon.0) 12897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:14 smithi049 bash[23528]: audit 2024-09-21T04:27:13.619739+0000 mon.a (mon.0) 12898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:14 smithi049 bash[23528]: audit 2024-09-21T04:27:14.099826+0000 mgr.a (mgr.14388) 16136 : audit [DBG] from='client.348522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:14 smithi044 bash[22676]: audit 2024-09-21T04:27:13.603077+0000 mon.a (mon.0) 12897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:14 smithi044 bash[22676]: audit 2024-09-21T04:27:13.619739+0000 mon.a (mon.0) 12898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:14 smithi044 bash[22676]: audit 2024-09-21T04:27:14.099826+0000 mgr.a (mgr.14388) 16136 : audit [DBG] from='client.348522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:14 smithi179 bash[23186]: audit 2024-09-21T04:27:13.603077+0000 mon.a (mon.0) 12897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:14 smithi179 bash[23186]: audit 2024-09-21T04:27:13.619739+0000 mon.a (mon.0) 12898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:14 smithi179 bash[23186]: audit 2024-09-21T04:27:14.099826+0000 mgr.a (mgr.14388) 16136 : audit [DBG] from='client.348522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:15 smithi044 bash[22676]: cluster 2024-09-21T04:27:14.293953+0000 mgr.a (mgr.14388) 16137 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:15 smithi179 bash[23186]: cluster 2024-09-21T04:27:14.293953+0000 mgr.a (mgr.14388) 16137 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:15 smithi049 bash[23528]: cluster 2024-09-21T04:27:14.293953+0000 mgr.a (mgr.14388) 16137 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:17.899 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:17 smithi044 bash[22676]: cluster 2024-09-21T04:27:16.296293+0000 mgr.a (mgr.14388) 16138 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:17 smithi179 bash[23186]: cluster 2024-09-21T04:27:16.296293+0000 mgr.a (mgr.14388) 16138 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:17 smithi049 bash[23528]: cluster 2024-09-21T04:27:16.296293+0000 mgr.a (mgr.14388) 16138 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:19.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:19.896 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:19 smithi179 bash[23186]: cluster 2024-09-21T04:27:18.297089+0000 mgr.a (mgr.14388) 16139 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:19 smithi044 bash[22676]: cluster 2024-09-21T04:27:18.297089+0000 mgr.a (mgr.14388) 16139 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:19 smithi049 bash[23528]: cluster 2024-09-21T04:27:18.297089+0000 mgr.a (mgr.14388) 16139 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:20.320 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:20.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:20.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:20.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:20.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:20.912 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:20 smithi179 bash[23186]: audit 2024-09-21T04:27:19.886116+0000 mgr.a (mgr.14388) 16140 : audit [DBG] from='client.348591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:20 smithi044 bash[22676]: audit 2024-09-21T04:27:19.886116+0000 mgr.a (mgr.14388) 16140 : audit [DBG] from='client.348591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:20 smithi049 bash[23528]: audit 2024-09-21T04:27:19.886116+0000 mgr.a (mgr.14388) 16140 : audit [DBG] from='client.348591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:21 smithi044 bash[22676]: cluster 2024-09-21T04:27:20.298419+0000 mgr.a (mgr.14388) 16141 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:21 smithi179 bash[23186]: cluster 2024-09-21T04:27:20.298419+0000 mgr.a (mgr.14388) 16141 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:21 smithi049 bash[23528]: cluster 2024-09-21T04:27:20.298419+0000 mgr.a (mgr.14388) 16141 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:23 smithi044 bash[22676]: cluster 2024-09-21T04:27:22.299679+0000 mgr.a (mgr.14388) 16142 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T04:27:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:23 smithi179 bash[23186]: cluster 2024-09-21T04:27:22.299679+0000 mgr.a (mgr.14388) 16142 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T04:27:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:23 smithi049 bash[23528]: cluster 2024-09-21T04:27:22.299679+0000 mgr.a (mgr.14388) 16142 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-21T04:27:25.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:25.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:25.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:26.106 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:26.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:26.106 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:26.107 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:25 smithi044 bash[22676]: cluster 2024-09-21T04:27:24.300458+0000 mgr.a (mgr.14388) 16143 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:27:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:25 smithi044 bash[22676]: audit 2024-09-21T04:27:24.817502+0000 mon.a (mon.0) 12899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:25 smithi044 bash[22676]: audit 2024-09-21T04:27:24.826141+0000 mon.a (mon.0) 12900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:25 smithi044 bash[22676]: audit 2024-09-21T04:27:24.836643+0000 mon.a (mon.0) 12901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:25 smithi044 bash[22676]: audit 2024-09-21T04:27:25.292829+0000 mon.a (mon.0) 12902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:25 smithi044 bash[22676]: audit 2024-09-21T04:27:25.301428+0000 mon.a (mon.0) 12903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:25 smithi044 bash[22676]: audit 2024-09-21T04:27:25.312209+0000 mon.a (mon.0) 12904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:25 smithi179 bash[23186]: cluster 2024-09-21T04:27:24.300458+0000 mgr.a (mgr.14388) 16143 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:27:26.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:25 smithi179 bash[23186]: audit 2024-09-21T04:27:24.817502+0000 mon.a (mon.0) 12899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:25 smithi179 bash[23186]: audit 2024-09-21T04:27:24.826141+0000 mon.a (mon.0) 12900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:25 smithi179 bash[23186]: audit 2024-09-21T04:27:24.836643+0000 mon.a (mon.0) 12901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:25 smithi179 bash[23186]: audit 2024-09-21T04:27:25.292829+0000 mon.a (mon.0) 12902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:25 smithi179 bash[23186]: audit 2024-09-21T04:27:25.301428+0000 mon.a (mon.0) 12903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:25 smithi179 bash[23186]: audit 2024-09-21T04:27:25.312209+0000 mon.a (mon.0) 12904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:25 smithi049 bash[23528]: cluster 2024-09-21T04:27:24.300458+0000 mgr.a (mgr.14388) 16143 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:27:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:25 smithi049 bash[23528]: audit 2024-09-21T04:27:24.817502+0000 mon.a (mon.0) 12899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:25 smithi049 bash[23528]: audit 2024-09-21T04:27:24.826141+0000 mon.a (mon.0) 12900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:25 smithi049 bash[23528]: audit 2024-09-21T04:27:24.836643+0000 mon.a (mon.0) 12901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:25 smithi049 bash[23528]: audit 2024-09-21T04:27:25.292829+0000 mon.a (mon.0) 12902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:25 smithi049 bash[23528]: audit 2024-09-21T04:27:25.301428+0000 mon.a (mon.0) 12903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:25 smithi049 bash[23528]: audit 2024-09-21T04:27:25.312209+0000 mon.a (mon.0) 12904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:26 smithi044 bash[22676]: audit 2024-09-21T04:27:25.658549+0000 mgr.a (mgr.14388) 16144 : audit [DBG] from='client.348669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:26 smithi179 bash[23186]: audit 2024-09-21T04:27:25.658549+0000 mgr.a (mgr.14388) 16144 : audit [DBG] from='client.348669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:26 smithi049 bash[23528]: audit 2024-09-21T04:27:25.658549+0000 mgr.a (mgr.14388) 16144 : audit [DBG] from='client.348669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:27 smithi044 bash[22676]: cluster 2024-09-21T04:27:26.303395+0000 mgr.a (mgr.14388) 16145 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:27 smithi179 bash[23186]: cluster 2024-09-21T04:27:26.303395+0000 mgr.a (mgr.14388) 16145 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:27 smithi049 bash[23528]: cluster 2024-09-21T04:27:26.303395+0000 mgr.a (mgr.14388) 16145 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:29 smithi044 bash[22676]: cluster 2024-09-21T04:27:28.304182+0000 mgr.a (mgr.14388) 16146 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:27:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:29 smithi179 bash[23186]: cluster 2024-09-21T04:27:28.304182+0000 mgr.a (mgr.14388) 16146 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:27:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:29 smithi049 bash[23528]: cluster 2024-09-21T04:27:28.304182+0000 mgr.a (mgr.14388) 16146 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:27:31.108 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:31.108 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:31.109 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:31.863 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:31 smithi044 bash[22676]: cluster 2024-09-21T04:27:30.305786+0000 mgr.a (mgr.14388) 16147 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:27:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:31 smithi179 bash[23186]: cluster 2024-09-21T04:27:30.305786+0000 mgr.a (mgr.14388) 16147 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:27:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:31 smithi049 bash[23528]: cluster 2024-09-21T04:27:30.305786+0000 mgr.a (mgr.14388) 16147 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:27:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:32 smithi044 bash[22676]: audit 2024-09-21T04:27:31.441901+0000 mgr.a (mgr.14388) 16148 : audit [DBG] from='client.348744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:32 smithi179 bash[23186]: audit 2024-09-21T04:27:31.441901+0000 mgr.a (mgr.14388) 16148 : audit [DBG] from='client.348744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:32 smithi049 bash[23528]: audit 2024-09-21T04:27:31.441901+0000 mgr.a (mgr.14388) 16148 : audit [DBG] from='client.348744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:33 smithi049 bash[23528]: cluster 2024-09-21T04:27:32.306951+0000 mgr.a (mgr.14388) 16149 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:33 smithi049 bash[23528]: audit 2024-09-21T04:27:33.825066+0000 mon.a (mon.0) 12905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:33 smithi049 bash[23528]: audit 2024-09-21T04:27:33.832559+0000 mon.a (mon.0) 12906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:33 smithi049 bash[23528]: audit 2024-09-21T04:27:33.841176+0000 mon.a (mon.0) 12907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:33 smithi044 bash[22676]: cluster 2024-09-21T04:27:32.306951+0000 mgr.a (mgr.14388) 16149 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:33 smithi044 bash[22676]: audit 2024-09-21T04:27:33.825066+0000 mon.a (mon.0) 12905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:33 smithi044 bash[22676]: audit 2024-09-21T04:27:33.832559+0000 mon.a (mon.0) 12906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:33 smithi044 bash[22676]: audit 2024-09-21T04:27:33.841176+0000 mon.a (mon.0) 12907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:33 smithi179 bash[23186]: cluster 2024-09-21T04:27:32.306951+0000 mgr.a (mgr.14388) 16149 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:33 smithi179 bash[23186]: audit 2024-09-21T04:27:33.825066+0000 mon.a (mon.0) 12905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:33 smithi179 bash[23186]: audit 2024-09-21T04:27:33.832559+0000 mon.a (mon.0) 12906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:33 smithi179 bash[23186]: audit 2024-09-21T04:27:33.841176+0000 mon.a (mon.0) 12907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:35 smithi049 bash[23528]: cluster 2024-09-21T04:27:34.307755+0000 mgr.a (mgr.14388) 16150 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:27:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:35 smithi044 bash[22676]: cluster 2024-09-21T04:27:34.307755+0000 mgr.a (mgr.14388) 16150 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:27:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:35 smithi179 bash[23186]: cluster 2024-09-21T04:27:34.307755+0000 mgr.a (mgr.14388) 16150 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:27:36.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:36.865 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:36.865 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:37.653 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:37.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:37.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:37.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:37.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:37 smithi044 bash[22676]: cluster 2024-09-21T04:27:36.309894+0000 mgr.a (mgr.14388) 16151 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:27:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:37 smithi179 bash[23186]: cluster 2024-09-21T04:27:36.309894+0000 mgr.a (mgr.14388) 16151 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:27:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:37 smithi049 bash[23528]: cluster 2024-09-21T04:27:36.309894+0000 mgr.a (mgr.14388) 16151 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:27:39.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:38 smithi044 bash[22676]: audit 2024-09-21T04:27:37.196334+0000 mgr.a (mgr.14388) 16152 : audit [DBG] from='client.348822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:38 smithi179 bash[23186]: audit 2024-09-21T04:27:37.196334+0000 mgr.a (mgr.14388) 16152 : audit [DBG] from='client.348822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:38 smithi049 bash[23528]: audit 2024-09-21T04:27:37.196334+0000 mgr.a (mgr.14388) 16152 : audit [DBG] from='client.348822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:39 smithi044 bash[22676]: cluster 2024-09-21T04:27:38.310944+0000 mgr.a (mgr.14388) 16153 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:39 smithi179 bash[23186]: cluster 2024-09-21T04:27:38.310944+0000 mgr.a (mgr.14388) 16153 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:39 smithi049 bash[23528]: cluster 2024-09-21T04:27:38.310944+0000 mgr.a (mgr.14388) 16153 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:41 smithi179 bash[23186]: cluster 2024-09-21T04:27:40.312945+0000 mgr.a (mgr.14388) 16154 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:27:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:41 smithi044 bash[22676]: cluster 2024-09-21T04:27:40.312945+0000 mgr.a (mgr.14388) 16154 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:27:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:41 smithi049 bash[23528]: cluster 2024-09-21T04:27:40.312945+0000 mgr.a (mgr.14388) 16154 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:27:42.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:42.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:42.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:43.452 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:44.173 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:43 smithi179 bash[23186]: cluster 2024-09-21T04:27:42.314440+0000 mgr.a (mgr.14388) 16155 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:27:44.173 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:43 smithi179 bash[23186]: audit 2024-09-21T04:27:42.995529+0000 mgr.a (mgr.14388) 16156 : audit [DBG] from='client.348897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:43 smithi044 bash[22676]: cluster 2024-09-21T04:27:42.314440+0000 mgr.a (mgr.14388) 16155 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:43 smithi044 bash[22676]: audit 2024-09-21T04:27:42.995529+0000 mgr.a (mgr.14388) 16156 : audit [DBG] from='client.348897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:43 smithi049 bash[23528]: cluster 2024-09-21T04:27:42.314440+0000 mgr.a (mgr.14388) 16155 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:27:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:43 smithi049 bash[23528]: audit 2024-09-21T04:27:42.995529+0000 mgr.a (mgr.14388) 16156 : audit [DBG] from='client.348897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:46 smithi044 bash[22676]: cluster 2024-09-21T04:27:44.315535+0000 mgr.a (mgr.14388) 16157 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:46 smithi044 bash[22676]: audit 2024-09-21T04:27:45.060277+0000 mon.a (mon.0) 12908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:46 smithi044 bash[22676]: audit 2024-09-21T04:27:45.071182+0000 mon.a (mon.0) 12909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:46 smithi044 bash[22676]: audit 2024-09-21T04:27:45.081458+0000 mon.a (mon.0) 12910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:46 smithi044 bash[22676]: audit 2024-09-21T04:27:45.519897+0000 mon.a (mon.0) 12911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:46 smithi044 bash[22676]: audit 2024-09-21T04:27:45.529939+0000 mon.a (mon.0) 12912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:46 smithi044 bash[22676]: audit 2024-09-21T04:27:45.541199+0000 mon.a (mon.0) 12913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:46 smithi179 bash[23186]: cluster 2024-09-21T04:27:44.315535+0000 mgr.a (mgr.14388) 16157 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:46 smithi179 bash[23186]: audit 2024-09-21T04:27:45.060277+0000 mon.a (mon.0) 12908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:46 smithi179 bash[23186]: audit 2024-09-21T04:27:45.071182+0000 mon.a (mon.0) 12909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:46 smithi179 bash[23186]: audit 2024-09-21T04:27:45.081458+0000 mon.a (mon.0) 12910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:46 smithi179 bash[23186]: audit 2024-09-21T04:27:45.519897+0000 mon.a (mon.0) 12911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:46 smithi179 bash[23186]: audit 2024-09-21T04:27:45.529939+0000 mon.a (mon.0) 12912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:46 smithi179 bash[23186]: audit 2024-09-21T04:27:45.541199+0000 mon.a (mon.0) 12913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:46 smithi049 bash[23528]: cluster 2024-09-21T04:27:44.315535+0000 mgr.a (mgr.14388) 16157 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:46 smithi049 bash[23528]: audit 2024-09-21T04:27:45.060277+0000 mon.a (mon.0) 12908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:46 smithi049 bash[23528]: audit 2024-09-21T04:27:45.071182+0000 mon.a (mon.0) 12909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:46 smithi049 bash[23528]: audit 2024-09-21T04:27:45.081458+0000 mon.a (mon.0) 12910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:46 smithi049 bash[23528]: audit 2024-09-21T04:27:45.519897+0000 mon.a (mon.0) 12911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:46 smithi049 bash[23528]: audit 2024-09-21T04:27:45.529939+0000 mon.a (mon.0) 12912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:46 smithi049 bash[23528]: audit 2024-09-21T04:27:45.541199+0000 mon.a (mon.0) 12913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:48.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:48.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:48.456 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:48 smithi044 bash[22676]: cluster 2024-09-21T04:27:46.317905+0000 mgr.a (mgr.14388) 16158 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:48 smithi179 bash[23186]: cluster 2024-09-21T04:27:46.317905+0000 mgr.a (mgr.14388) 16158 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:48 smithi049 bash[23528]: cluster 2024-09-21T04:27:46.317905+0000 mgr.a (mgr.14388) 16158 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:49.225 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:49.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:49.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:49.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:49.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:50 smithi044 bash[22676]: cluster 2024-09-21T04:27:48.318834+0000 mgr.a (mgr.14388) 16159 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:50 smithi044 bash[22676]: audit 2024-09-21T04:27:48.782224+0000 mgr.a (mgr.14388) 16160 : audit [DBG] from='client.348975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:50 smithi179 bash[23186]: cluster 2024-09-21T04:27:48.318834+0000 mgr.a (mgr.14388) 16159 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:50 smithi179 bash[23186]: audit 2024-09-21T04:27:48.782224+0000 mgr.a (mgr.14388) 16160 : audit [DBG] from='client.348975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:50 smithi049 bash[23528]: cluster 2024-09-21T04:27:48.318834+0000 mgr.a (mgr.14388) 16159 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:50 smithi049 bash[23528]: audit 2024-09-21T04:27:48.782224+0000 mgr.a (mgr.14388) 16160 : audit [DBG] from='client.348975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:52 smithi044 bash[22676]: cluster 2024-09-21T04:27:50.321162+0000 mgr.a (mgr.14388) 16161 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:52 smithi179 bash[23186]: cluster 2024-09-21T04:27:50.321162+0000 mgr.a (mgr.14388) 16161 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:52 smithi049 bash[23528]: cluster 2024-09-21T04:27:50.321162+0000 mgr.a (mgr.14388) 16161 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:54.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:27:54.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:27:54.227 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:54 smithi049 bash[23528]: cluster 2024-09-21T04:27:52.322055+0000 mgr.a (mgr.14388) 16162 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:54 smithi049 bash[23528]: audit 2024-09-21T04:27:54.019724+0000 mon.a (mon.0) 12914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:54 smithi049 bash[23528]: audit 2024-09-21T04:27:54.028348+0000 mon.a (mon.0) 12915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:54 smithi049 bash[23528]: audit 2024-09-21T04:27:54.038832+0000 mon.a (mon.0) 12916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:54 smithi044 bash[22676]: cluster 2024-09-21T04:27:52.322055+0000 mgr.a (mgr.14388) 16162 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:27:54.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:54 smithi044 bash[22676]: audit 2024-09-21T04:27:54.019724+0000 mon.a (mon.0) 12914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:54 smithi044 bash[22676]: audit 2024-09-21T04:27:54.028348+0000 mon.a (mon.0) 12915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:54 smithi044 bash[22676]: audit 2024-09-21T04:27:54.038832+0000 mon.a (mon.0) 12916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:54 smithi179 bash[23186]: cluster 2024-09-21T04:27:52.322055+0000 mgr.a (mgr.14388) 16162 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:27:54.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:54 smithi179 bash[23186]: audit 2024-09-21T04:27:54.019724+0000 mon.a (mon.0) 12914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:54 smithi179 bash[23186]: audit 2024-09-21T04:27:54.028348+0000 mon.a (mon.0) 12915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:54.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:54 smithi179 bash[23186]: audit 2024-09-21T04:27:54.038832+0000 mon.a (mon.0) 12916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:55.022 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:27:55.022 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:27:55.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:27:55.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:27:55.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:27:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:56 smithi049 bash[23528]: cluster 2024-09-21T04:27:54.322648+0000 mgr.a (mgr.14388) 16163 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:56 smithi049 bash[23528]: audit 2024-09-21T04:27:54.567246+0000 mgr.a (mgr.14388) 16164 : audit [DBG] from='client.349050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:56 smithi049 bash[23528]: audit 2024-09-21T04:27:55.953036+0000 mon.a (mon.0) 12917 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:27:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:56 smithi049 bash[23528]: audit 2024-09-21T04:27:55.960913+0000 mon.a (mon.0) 12918 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:27:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:56 smithi049 bash[23528]: audit 2024-09-21T04:27:55.962967+0000 mon.a (mon.0) 12919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:27:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:56 smithi049 bash[23528]: audit 2024-09-21T04:27:55.974597+0000 mon.a (mon.0) 12920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:56 smithi049 bash[23528]: audit 2024-09-21T04:27:55.981066+0000 mon.a (mon.0) 12921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:27:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22676]: cluster 2024-09-21T04:27:54.322648+0000 mgr.a (mgr.14388) 16163 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22676]: audit 2024-09-21T04:27:54.567246+0000 mgr.a (mgr.14388) 16164 : audit [DBG] from='client.349050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22676]: audit 2024-09-21T04:27:55.953036+0000 mon.a (mon.0) 12917 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:27:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22676]: audit 2024-09-21T04:27:55.960913+0000 mon.a (mon.0) 12918 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:27:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22676]: audit 2024-09-21T04:27:55.962967+0000 mon.a (mon.0) 12919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:27:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22676]: audit 2024-09-21T04:27:55.974597+0000 mon.a (mon.0) 12920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22676]: audit 2024-09-21T04:27:55.981066+0000 mon.a (mon.0) 12921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:27:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:56 smithi179 bash[23186]: cluster 2024-09-21T04:27:54.322648+0000 mgr.a (mgr.14388) 16163 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:27:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:56 smithi179 bash[23186]: audit 2024-09-21T04:27:54.567246+0000 mgr.a (mgr.14388) 16164 : audit [DBG] from='client.349050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:27:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:56 smithi179 bash[23186]: audit 2024-09-21T04:27:55.953036+0000 mon.a (mon.0) 12917 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:27:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:56 smithi179 bash[23186]: audit 2024-09-21T04:27:55.960913+0000 mon.a (mon.0) 12918 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:27:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:56 smithi179 bash[23186]: audit 2024-09-21T04:27:55.962967+0000 mon.a (mon.0) 12919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:27:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:56 smithi179 bash[23186]: audit 2024-09-21T04:27:55.974597+0000 mon.a (mon.0) 12920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:27:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:56 smithi179 bash[23186]: audit 2024-09-21T04:27:55.981066+0000 mon.a (mon.0) 12921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:27:57.091 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22930]: debug 2024-09-21T04:27:56.783+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:27:57.091 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:27:56 smithi044 bash[22930]: debug 2024-09-21T04:27:56.787+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:27:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:57 smithi049 bash[23528]: audit 2024-09-21T04:27:55.983622+0000 mgr.a (mgr.14388) 16165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:27:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:57 smithi044 bash[22676]: audit 2024-09-21T04:27:55.983622+0000 mgr.a (mgr.14388) 16165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:27:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:57 smithi179 bash[23186]: audit 2024-09-21T04:27:55.983622+0000 mgr.a (mgr.14388) 16165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:27:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:58 smithi044 bash[22676]: cluster 2024-09-21T04:27:56.324352+0000 mgr.a (mgr.14388) 16166 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:58 smithi044 bash[22676]: audit 2024-09-21T04:27:56.787801+0000 mgr.a (mgr.14388) 16167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:27:58.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:27:58 smithi044 bash[22676]: cephadm 2024-09-21T04:27:56.789423+0000 mgr.a (mgr.14388) 16168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:27:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:58 smithi179 bash[23186]: cluster 2024-09-21T04:27:56.324352+0000 mgr.a (mgr.14388) 16166 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:58 smithi179 bash[23186]: audit 2024-09-21T04:27:56.787801+0000 mgr.a (mgr.14388) 16167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:27:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:27:58 smithi179 bash[23186]: cephadm 2024-09-21T04:27:56.789423+0000 mgr.a (mgr.14388) 16168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:27:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:58 smithi049 bash[23528]: cluster 2024-09-21T04:27:56.324352+0000 mgr.a (mgr.14388) 16166 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:27:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:58 smithi049 bash[23528]: audit 2024-09-21T04:27:56.787801+0000 mgr.a (mgr.14388) 16167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:27:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:27:58 smithi049 bash[23528]: cephadm 2024-09-21T04:27:56.789423+0000 mgr.a (mgr.14388) 16168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:28:00.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:00 smithi044 bash[22676]: cluster 2024-09-21T04:27:58.325423+0000 mgr.a (mgr.14388) 16169 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:00 smithi179 bash[23186]: cluster 2024-09-21T04:27:58.325423+0000 mgr.a (mgr.14388) 16169 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:00 smithi049 bash[23528]: cluster 2024-09-21T04:27:58.325423+0000 mgr.a (mgr.14388) 16169 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:00.794 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:00.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:00.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:00.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:00.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:02.145 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:02 smithi179 bash[23186]: cluster 2024-09-21T04:28:00.327675+0000 mgr.a (mgr.14388) 16170 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:02.145 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:02 smithi179 bash[23186]: audit 2024-09-21T04:28:00.355014+0000 mgr.a (mgr.14388) 16171 : audit [DBG] from='client.349224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:02 smithi044 bash[22676]: cluster 2024-09-21T04:28:00.327675+0000 mgr.a (mgr.14388) 16170 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:02 smithi044 bash[22676]: audit 2024-09-21T04:28:00.355014+0000 mgr.a (mgr.14388) 16171 : audit [DBG] from='client.349224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:02 smithi049 bash[23528]: cluster 2024-09-21T04:28:00.327675+0000 mgr.a (mgr.14388) 16170 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:02 smithi049 bash[23528]: audit 2024-09-21T04:28:00.355014+0000 mgr.a (mgr.14388) 16171 : audit [DBG] from='client.349224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:04.367 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:04 smithi179 bash[23186]: cluster 2024-09-21T04:28:02.328772+0000 mgr.a (mgr.14388) 16172 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:04 smithi044 bash[22676]: cluster 2024-09-21T04:28:02.328772+0000 mgr.a (mgr.14388) 16172 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:04 smithi049 bash[23528]: cluster 2024-09-21T04:28:02.328772+0000 mgr.a (mgr.14388) 16172 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:05.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:05.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:05.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:06 smithi044 bash[22676]: cluster 2024-09-21T04:28:04.329798+0000 mgr.a (mgr.14388) 16173 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:06 smithi044 bash[22676]: audit 2024-09-21T04:28:05.291465+0000 mon.a (mon.0) 12922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:06 smithi044 bash[22676]: audit 2024-09-21T04:28:05.299430+0000 mon.a (mon.0) 12923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:06 smithi044 bash[22676]: audit 2024-09-21T04:28:05.309665+0000 mon.a (mon.0) 12924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:06 smithi044 bash[22676]: audit 2024-09-21T04:28:05.752718+0000 mon.a (mon.0) 12925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:06 smithi044 bash[22676]: audit 2024-09-21T04:28:05.761157+0000 mon.a (mon.0) 12926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:06 smithi044 bash[22676]: audit 2024-09-21T04:28:05.771406+0000 mon.a (mon.0) 12927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:06 smithi179 bash[23186]: cluster 2024-09-21T04:28:04.329798+0000 mgr.a (mgr.14388) 16173 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:06 smithi179 bash[23186]: audit 2024-09-21T04:28:05.291465+0000 mon.a (mon.0) 12922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:06 smithi179 bash[23186]: audit 2024-09-21T04:28:05.299430+0000 mon.a (mon.0) 12923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:06 smithi179 bash[23186]: audit 2024-09-21T04:28:05.309665+0000 mon.a (mon.0) 12924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:06 smithi179 bash[23186]: audit 2024-09-21T04:28:05.752718+0000 mon.a (mon.0) 12925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:06 smithi179 bash[23186]: audit 2024-09-21T04:28:05.761157+0000 mon.a (mon.0) 12926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:06 smithi179 bash[23186]: audit 2024-09-21T04:28:05.771406+0000 mon.a (mon.0) 12927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:06 smithi049 bash[23528]: cluster 2024-09-21T04:28:04.329798+0000 mgr.a (mgr.14388) 16173 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:06 smithi049 bash[23528]: audit 2024-09-21T04:28:05.291465+0000 mon.a (mon.0) 12922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:06 smithi049 bash[23528]: audit 2024-09-21T04:28:05.299430+0000 mon.a (mon.0) 12923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:06 smithi049 bash[23528]: audit 2024-09-21T04:28:05.309665+0000 mon.a (mon.0) 12924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:06 smithi049 bash[23528]: audit 2024-09-21T04:28:05.752718+0000 mon.a (mon.0) 12925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:06 smithi049 bash[23528]: audit 2024-09-21T04:28:05.761157+0000 mon.a (mon.0) 12926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:06 smithi049 bash[23528]: audit 2024-09-21T04:28:05.771406+0000 mon.a (mon.0) 12927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:06.564 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:07 smithi044 bash[22676]: audit 2024-09-21T04:28:06.132264+0000 mgr.a (mgr.14388) 16174 : audit [DBG] from='client.349299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:07 smithi179 bash[23186]: audit 2024-09-21T04:28:06.132264+0000 mgr.a (mgr.14388) 16174 : audit [DBG] from='client.349299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:07 smithi049 bash[23528]: audit 2024-09-21T04:28:06.132264+0000 mgr.a (mgr.14388) 16174 : audit [DBG] from='client.349299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:08 smithi044 bash[22676]: cluster 2024-09-21T04:28:06.331267+0000 mgr.a (mgr.14388) 16175 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:08 smithi179 bash[23186]: cluster 2024-09-21T04:28:06.331267+0000 mgr.a (mgr.14388) 16175 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:08 smithi049 bash[23528]: cluster 2024-09-21T04:28:06.331267+0000 mgr.a (mgr.14388) 16175 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:10 smithi044 bash[22676]: cluster 2024-09-21T04:28:08.332153+0000 mgr.a (mgr.14388) 16176 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:10 smithi179 bash[23186]: cluster 2024-09-21T04:28:08.332153+0000 mgr.a (mgr.14388) 16176 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:10 smithi049 bash[23528]: cluster 2024-09-21T04:28:08.332153+0000 mgr.a (mgr.14388) 16176 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:28:11.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:11.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:11.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:12.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:12.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:12 smithi044 bash[22676]: cluster 2024-09-21T04:28:10.334339+0000 mgr.a (mgr.14388) 16177 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:12 smithi179 bash[23186]: cluster 2024-09-21T04:28:10.334339+0000 mgr.a (mgr.14388) 16177 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:12 smithi049 bash[23528]: cluster 2024-09-21T04:28:10.334339+0000 mgr.a (mgr.14388) 16177 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:28:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:13 smithi044 bash[22676]: audit 2024-09-21T04:28:11.895255+0000 mgr.a (mgr.14388) 16178 : audit [DBG] from='client.349377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:13 smithi179 bash[23186]: audit 2024-09-21T04:28:11.895255+0000 mgr.a (mgr.14388) 16178 : audit [DBG] from='client.349377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:13 smithi049 bash[23528]: audit 2024-09-21T04:28:11.895255+0000 mgr.a (mgr.14388) 16178 : audit [DBG] from='client.349377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:14 smithi044 bash[22676]: cluster 2024-09-21T04:28:12.334852+0000 mgr.a (mgr.14388) 16179 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:14 smithi179 bash[23186]: cluster 2024-09-21T04:28:12.334852+0000 mgr.a (mgr.14388) 16179 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:14 smithi049 bash[23528]: cluster 2024-09-21T04:28:12.334852+0000 mgr.a (mgr.14388) 16179 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:15 smithi044 bash[22676]: audit 2024-09-21T04:28:14.253182+0000 mon.a (mon.0) 12928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:15 smithi044 bash[22676]: audit 2024-09-21T04:28:14.263192+0000 mon.a (mon.0) 12929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:15 smithi044 bash[22676]: audit 2024-09-21T04:28:14.273739+0000 mon.a (mon.0) 12930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:15 smithi044 bash[22676]: cluster 2024-09-21T04:28:14.335609+0000 mgr.a (mgr.14388) 16180 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:15 smithi179 bash[23186]: audit 2024-09-21T04:28:14.253182+0000 mon.a (mon.0) 12928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:15 smithi179 bash[23186]: audit 2024-09-21T04:28:14.263192+0000 mon.a (mon.0) 12929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:15 smithi179 bash[23186]: audit 2024-09-21T04:28:14.273739+0000 mon.a (mon.0) 12930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:15 smithi179 bash[23186]: cluster 2024-09-21T04:28:14.335609+0000 mgr.a (mgr.14388) 16180 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:15 smithi049 bash[23528]: audit 2024-09-21T04:28:14.253182+0000 mon.a (mon.0) 12928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:15 smithi049 bash[23528]: audit 2024-09-21T04:28:14.263192+0000 mon.a (mon.0) 12929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:15 smithi049 bash[23528]: audit 2024-09-21T04:28:14.273739+0000 mon.a (mon.0) 12930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:15 smithi049 bash[23528]: cluster 2024-09-21T04:28:14.335609+0000 mgr.a (mgr.14388) 16180 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:17.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:17.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:17.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:17 smithi044 bash[22676]: cluster 2024-09-21T04:28:16.337892+0000 mgr.a (mgr.14388) 16181 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:17 smithi179 bash[23186]: cluster 2024-09-21T04:28:16.337892+0000 mgr.a (mgr.14388) 16181 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:17 smithi049 bash[23528]: cluster 2024-09-21T04:28:16.337892+0000 mgr.a (mgr.14388) 16181 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:18.093 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:18.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:18 smithi044 bash[22676]: audit 2024-09-21T04:28:17.658269+0000 mgr.a (mgr.14388) 16182 : audit [DBG] from='client.349452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:18 smithi179 bash[23186]: audit 2024-09-21T04:28:17.658269+0000 mgr.a (mgr.14388) 16182 : audit [DBG] from='client.349452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:18 smithi049 bash[23528]: audit 2024-09-21T04:28:17.658269+0000 mgr.a (mgr.14388) 16182 : audit [DBG] from='client.349452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:19.644 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:19 smithi044 bash[22676]: cluster 2024-09-21T04:28:18.338776+0000 mgr.a (mgr.14388) 16183 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:19 smithi179 bash[23186]: cluster 2024-09-21T04:28:18.338776+0000 mgr.a (mgr.14388) 16183 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:19 smithi049 bash[23528]: cluster 2024-09-21T04:28:18.338776+0000 mgr.a (mgr.14388) 16183 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:21 smithi044 bash[22676]: cluster 2024-09-21T04:28:20.341024+0000 mgr.a (mgr.14388) 16184 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:21 smithi179 bash[23186]: cluster 2024-09-21T04:28:20.341024+0000 mgr.a (mgr.14388) 16184 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:21 smithi049 bash[23528]: cluster 2024-09-21T04:28:20.341024+0000 mgr.a (mgr.14388) 16184 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:23.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:23 smithi179 bash[23186]: cluster 2024-09-21T04:28:22.341835+0000 mgr.a (mgr.14388) 16185 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:23 smithi044 bash[22676]: cluster 2024-09-21T04:28:22.341835+0000 mgr.a (mgr.14388) 16185 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:23 smithi049 bash[23528]: cluster 2024-09-21T04:28:22.341835+0000 mgr.a (mgr.14388) 16185 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:23.882 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:24 smithi044 bash[22676]: audit 2024-09-21T04:28:23.431591+0000 mgr.a (mgr.14388) 16186 : audit [DBG] from='client.349530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:24 smithi179 bash[23186]: audit 2024-09-21T04:28:23.431591+0000 mgr.a (mgr.14388) 16186 : audit [DBG] from='client.349530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:24 smithi049 bash[23528]: audit 2024-09-21T04:28:23.431591+0000 mgr.a (mgr.14388) 16186 : audit [DBG] from='client.349530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:25 smithi044 bash[22676]: cluster 2024-09-21T04:28:24.342734+0000 mgr.a (mgr.14388) 16187 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:25 smithi179 bash[23186]: cluster 2024-09-21T04:28:24.342734+0000 mgr.a (mgr.14388) 16187 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:25 smithi049 bash[23528]: cluster 2024-09-21T04:28:24.342734+0000 mgr.a (mgr.14388) 16187 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:26 smithi049 bash[23528]: audit 2024-09-21T04:28:25.511946+0000 mon.a (mon.0) 12931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:26 smithi049 bash[23528]: audit 2024-09-21T04:28:25.520402+0000 mon.a (mon.0) 12932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:26 smithi049 bash[23528]: audit 2024-09-21T04:28:25.530908+0000 mon.a (mon.0) 12933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:26 smithi049 bash[23528]: audit 2024-09-21T04:28:25.921070+0000 mon.a (mon.0) 12934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:26 smithi049 bash[23528]: audit 2024-09-21T04:28:25.929824+0000 mon.a (mon.0) 12935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:26 smithi049 bash[23528]: audit 2024-09-21T04:28:25.939997+0000 mon.a (mon.0) 12936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:26 smithi044 bash[22676]: audit 2024-09-21T04:28:25.511946+0000 mon.a (mon.0) 12931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:26 smithi044 bash[22676]: audit 2024-09-21T04:28:25.520402+0000 mon.a (mon.0) 12932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:26 smithi044 bash[22676]: audit 2024-09-21T04:28:25.530908+0000 mon.a (mon.0) 12933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:26 smithi044 bash[22676]: audit 2024-09-21T04:28:25.921070+0000 mon.a (mon.0) 12934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:26 smithi044 bash[22676]: audit 2024-09-21T04:28:25.929824+0000 mon.a (mon.0) 12935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:26.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:26 smithi044 bash[22676]: audit 2024-09-21T04:28:25.939997+0000 mon.a (mon.0) 12936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:26 smithi179 bash[23186]: audit 2024-09-21T04:28:25.511946+0000 mon.a (mon.0) 12931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:26 smithi179 bash[23186]: audit 2024-09-21T04:28:25.520402+0000 mon.a (mon.0) 12932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:26 smithi179 bash[23186]: audit 2024-09-21T04:28:25.530908+0000 mon.a (mon.0) 12933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:26 smithi179 bash[23186]: audit 2024-09-21T04:28:25.921070+0000 mon.a (mon.0) 12934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:26 smithi179 bash[23186]: audit 2024-09-21T04:28:25.929824+0000 mon.a (mon.0) 12935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:26 smithi179 bash[23186]: audit 2024-09-21T04:28:25.939997+0000 mon.a (mon.0) 12936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:28.214 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:27 smithi049 bash[23528]: cluster 2024-09-21T04:28:26.344972+0000 mgr.a (mgr.14388) 16188 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:27 smithi044 bash[22676]: cluster 2024-09-21T04:28:26.344972+0000 mgr.a (mgr.14388) 16188 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:27 smithi179 bash[23186]: cluster 2024-09-21T04:28:26.344972+0000 mgr.a (mgr.14388) 16188 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:29.665 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:29 smithi044 bash[22676]: cluster 2024-09-21T04:28:28.345784+0000 mgr.a (mgr.14388) 16189 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:29 smithi179 bash[23186]: cluster 2024-09-21T04:28:28.345784+0000 mgr.a (mgr.14388) 16189 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:29 smithi049 bash[23528]: cluster 2024-09-21T04:28:28.345784+0000 mgr.a (mgr.14388) 16189 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:30 smithi044 bash[22676]: audit 2024-09-21T04:28:29.216729+0000 mgr.a (mgr.14388) 16190 : audit [DBG] from='client.349605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:30 smithi179 bash[23186]: audit 2024-09-21T04:28:29.216729+0000 mgr.a (mgr.14388) 16190 : audit [DBG] from='client.349605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:30 smithi049 bash[23528]: audit 2024-09-21T04:28:29.216729+0000 mgr.a (mgr.14388) 16190 : audit [DBG] from='client.349605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:31 smithi044 bash[22676]: cluster 2024-09-21T04:28:30.348050+0000 mgr.a (mgr.14388) 16191 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:31 smithi179 bash[23186]: cluster 2024-09-21T04:28:30.348050+0000 mgr.a (mgr.14388) 16191 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:31 smithi049 bash[23528]: cluster 2024-09-21T04:28:30.348050+0000 mgr.a (mgr.14388) 16191 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:33 smithi044 bash[22676]: cluster 2024-09-21T04:28:32.348938+0000 mgr.a (mgr.14388) 16192 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:33 smithi179 bash[23186]: cluster 2024-09-21T04:28:32.348938+0000 mgr.a (mgr.14388) 16192 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:33 smithi049 bash[23528]: cluster 2024-09-21T04:28:32.348938+0000 mgr.a (mgr.14388) 16192 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:34.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:34.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:35.468 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:35.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:35.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:35.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:35.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:35 smithi044 bash[22676]: cluster 2024-09-21T04:28:34.349922+0000 mgr.a (mgr.14388) 16193 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:35 smithi044 bash[22676]: audit 2024-09-21T04:28:34.489180+0000 mon.a (mon.0) 12937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:35 smithi044 bash[22676]: audit 2024-09-21T04:28:34.498358+0000 mon.a (mon.0) 12938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:35 smithi044 bash[22676]: audit 2024-09-21T04:28:34.508860+0000 mon.a (mon.0) 12939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:35 smithi044 bash[22676]: audit 2024-09-21T04:28:35.005299+0000 mgr.a (mgr.14388) 16194 : audit [DBG] from='client.349680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:35 smithi179 bash[23186]: cluster 2024-09-21T04:28:34.349922+0000 mgr.a (mgr.14388) 16193 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:35 smithi179 bash[23186]: audit 2024-09-21T04:28:34.489180+0000 mon.a (mon.0) 12937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:35 smithi179 bash[23186]: audit 2024-09-21T04:28:34.498358+0000 mon.a (mon.0) 12938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:35 smithi179 bash[23186]: audit 2024-09-21T04:28:34.508860+0000 mon.a (mon.0) 12939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:35 smithi179 bash[23186]: audit 2024-09-21T04:28:35.005299+0000 mgr.a (mgr.14388) 16194 : audit [DBG] from='client.349680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:35 smithi049 bash[23528]: cluster 2024-09-21T04:28:34.349922+0000 mgr.a (mgr.14388) 16193 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:35 smithi049 bash[23528]: audit 2024-09-21T04:28:34.489180+0000 mon.a (mon.0) 12937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:35 smithi049 bash[23528]: audit 2024-09-21T04:28:34.498358+0000 mon.a (mon.0) 12938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:35 smithi049 bash[23528]: audit 2024-09-21T04:28:34.508860+0000 mon.a (mon.0) 12939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:35 smithi049 bash[23528]: audit 2024-09-21T04:28:35.005299+0000 mgr.a (mgr.14388) 16194 : audit [DBG] from='client.349680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:37 smithi179 bash[23186]: cluster 2024-09-21T04:28:36.352776+0000 mgr.a (mgr.14388) 16195 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:37.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:37 smithi049 bash[23528]: cluster 2024-09-21T04:28:36.352776+0000 mgr.a (mgr.14388) 16195 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:37 smithi044 bash[22676]: cluster 2024-09-21T04:28:36.352776+0000 mgr.a (mgr.14388) 16195 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:39 smithi179 bash[23186]: cluster 2024-09-21T04:28:38.353602+0000 mgr.a (mgr.14388) 16196 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:28:39.758 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:39 smithi044 bash[22676]: cluster 2024-09-21T04:28:38.353602+0000 mgr.a (mgr.14388) 16196 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:28:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:39 smithi049 bash[23528]: cluster 2024-09-21T04:28:38.353602+0000 mgr.a (mgr.14388) 16196 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:28:40.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:40.470 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:40.471 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:41.260 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:41.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:41.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:41.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:41.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:41 smithi044 bash[22676]: cluster 2024-09-21T04:28:40.354785+0000 mgr.a (mgr.14388) 16197 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:41 smithi044 bash[22676]: audit 2024-09-21T04:28:40.805752+0000 mgr.a (mgr.14388) 16198 : audit [DBG] from='client.349758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:41 smithi179 bash[23186]: cluster 2024-09-21T04:28:40.354785+0000 mgr.a (mgr.14388) 16197 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:41 smithi179 bash[23186]: audit 2024-09-21T04:28:40.805752+0000 mgr.a (mgr.14388) 16198 : audit [DBG] from='client.349758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:41 smithi049 bash[23528]: cluster 2024-09-21T04:28:40.354785+0000 mgr.a (mgr.14388) 16197 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:41 smithi049 bash[23528]: audit 2024-09-21T04:28:40.805752+0000 mgr.a (mgr.14388) 16198 : audit [DBG] from='client.349758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:43 smithi049 bash[23528]: cluster 2024-09-21T04:28:42.355756+0000 mgr.a (mgr.14388) 16199 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:28:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:43 smithi044 bash[22676]: cluster 2024-09-21T04:28:42.355756+0000 mgr.a (mgr.14388) 16199 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:28:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:43 smithi179 bash[23186]: cluster 2024-09-21T04:28:42.355756+0000 mgr.a (mgr.14388) 16199 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:28:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:45 smithi179 bash[23186]: cluster 2024-09-21T04:28:44.356560+0000 mgr.a (mgr.14388) 16200 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:28:45.773 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:45 smithi044 bash[22676]: cluster 2024-09-21T04:28:44.356560+0000 mgr.a (mgr.14388) 16200 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:28:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:45 smithi049 bash[23528]: cluster 2024-09-21T04:28:44.356560+0000 mgr.a (mgr.14388) 16200 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:28:46.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:46 smithi179 bash[23186]: audit 2024-09-21T04:28:45.749875+0000 mon.a (mon.0) 12940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:46 smithi179 bash[23186]: audit 2024-09-21T04:28:45.758868+0000 mon.a (mon.0) 12941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:46 smithi179 bash[23186]: audit 2024-09-21T04:28:45.768293+0000 mon.a (mon.0) 12942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:46 smithi179 bash[23186]: audit 2024-09-21T04:28:46.133416+0000 mon.a (mon.0) 12943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:46 smithi179 bash[23186]: audit 2024-09-21T04:28:46.141782+0000 mon.a (mon.0) 12944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:46 smithi179 bash[23186]: audit 2024-09-21T04:28:46.153239+0000 mon.a (mon.0) 12945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.028 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:47.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:47.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:47.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:47.028 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:46 smithi049 bash[23528]: audit 2024-09-21T04:28:45.749875+0000 mon.a (mon.0) 12940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:46 smithi049 bash[23528]: audit 2024-09-21T04:28:45.758868+0000 mon.a (mon.0) 12941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:46 smithi049 bash[23528]: audit 2024-09-21T04:28:45.768293+0000 mon.a (mon.0) 12942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:46 smithi049 bash[23528]: audit 2024-09-21T04:28:46.133416+0000 mon.a (mon.0) 12943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:46 smithi049 bash[23528]: audit 2024-09-21T04:28:46.141782+0000 mon.a (mon.0) 12944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:46 smithi049 bash[23528]: audit 2024-09-21T04:28:46.153239+0000 mon.a (mon.0) 12945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:46 smithi044 bash[22676]: audit 2024-09-21T04:28:45.749875+0000 mon.a (mon.0) 12940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:46 smithi044 bash[22676]: audit 2024-09-21T04:28:45.758868+0000 mon.a (mon.0) 12941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:46 smithi044 bash[22676]: audit 2024-09-21T04:28:45.768293+0000 mon.a (mon.0) 12942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:46 smithi044 bash[22676]: audit 2024-09-21T04:28:46.133416+0000 mon.a (mon.0) 12943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:46 smithi044 bash[22676]: audit 2024-09-21T04:28:46.141782+0000 mon.a (mon.0) 12944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:47.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:46 smithi044 bash[22676]: audit 2024-09-21T04:28:46.153239+0000 mon.a (mon.0) 12945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:48 smithi044 bash[22676]: cluster 2024-09-21T04:28:46.357627+0000 mgr.a (mgr.14388) 16201 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:48 smithi044 bash[22676]: audit 2024-09-21T04:28:46.598985+0000 mgr.a (mgr.14388) 16202 : audit [DBG] from='client.349836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:48 smithi179 bash[23186]: cluster 2024-09-21T04:28:46.357627+0000 mgr.a (mgr.14388) 16201 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:48 smithi179 bash[23186]: audit 2024-09-21T04:28:46.598985+0000 mgr.a (mgr.14388) 16202 : audit [DBG] from='client.349836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:48 smithi049 bash[23528]: cluster 2024-09-21T04:28:46.357627+0000 mgr.a (mgr.14388) 16201 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:48 smithi049 bash[23528]: audit 2024-09-21T04:28:46.598985+0000 mgr.a (mgr.14388) 16202 : audit [DBG] from='client.349836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:50 smithi044 bash[22676]: cluster 2024-09-21T04:28:48.358588+0000 mgr.a (mgr.14388) 16203 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:50 smithi179 bash[23186]: cluster 2024-09-21T04:28:48.358588+0000 mgr.a (mgr.14388) 16203 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:50 smithi049 bash[23528]: cluster 2024-09-21T04:28:48.358588+0000 mgr.a (mgr.14388) 16203 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:52.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:52.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:52 smithi044 bash[22676]: cluster 2024-09-21T04:28:50.360936+0000 mgr.a (mgr.14388) 16204 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:52 smithi179 bash[23186]: cluster 2024-09-21T04:28:50.360936+0000 mgr.a (mgr.14388) 16204 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:52 smithi049 bash[23528]: cluster 2024-09-21T04:28:50.360936+0000 mgr.a (mgr.14388) 16204 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:52.816 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:52.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:54 smithi044 bash[22676]: cluster 2024-09-21T04:28:52.361512+0000 mgr.a (mgr.14388) 16205 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:54.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:54 smithi044 bash[22676]: audit 2024-09-21T04:28:52.366407+0000 mgr.a (mgr.14388) 16206 : audit [DBG] from='client.349914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:54 smithi179 bash[23186]: cluster 2024-09-21T04:28:52.361512+0000 mgr.a (mgr.14388) 16205 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:54 smithi179 bash[23186]: audit 2024-09-21T04:28:52.366407+0000 mgr.a (mgr.14388) 16206 : audit [DBG] from='client.349914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:54 smithi049 bash[23528]: cluster 2024-09-21T04:28:52.361512+0000 mgr.a (mgr.14388) 16205 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:54 smithi049 bash[23528]: audit 2024-09-21T04:28:52.366407+0000 mgr.a (mgr.14388) 16206 : audit [DBG] from='client.349914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:55 smithi044 bash[22676]: cluster 2024-09-21T04:28:54.362478+0000 mgr.a (mgr.14388) 16207 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:55 smithi044 bash[22676]: audit 2024-09-21T04:28:54.721763+0000 mon.a (mon.0) 12946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:55 smithi044 bash[22676]: audit 2024-09-21T04:28:54.730211+0000 mon.a (mon.0) 12947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:55 smithi044 bash[22676]: audit 2024-09-21T04:28:54.740686+0000 mon.a (mon.0) 12948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:55 smithi179 bash[23186]: cluster 2024-09-21T04:28:54.362478+0000 mgr.a (mgr.14388) 16207 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:55 smithi179 bash[23186]: audit 2024-09-21T04:28:54.721763+0000 mon.a (mon.0) 12946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:55 smithi179 bash[23186]: audit 2024-09-21T04:28:54.730211+0000 mon.a (mon.0) 12947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:55 smithi179 bash[23186]: audit 2024-09-21T04:28:54.740686+0000 mon.a (mon.0) 12948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:55 smithi049 bash[23528]: cluster 2024-09-21T04:28:54.362478+0000 mgr.a (mgr.14388) 16207 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:28:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:55 smithi049 bash[23528]: audit 2024-09-21T04:28:54.721763+0000 mon.a (mon.0) 12946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:55 smithi049 bash[23528]: audit 2024-09-21T04:28:54.730211+0000 mon.a (mon.0) 12947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:55 smithi049 bash[23528]: audit 2024-09-21T04:28:54.740686+0000 mon.a (mon.0) 12948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:57.817 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:28:57.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:28:57.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:28:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22676]: cluster 2024-09-21T04:28:56.364837+0000 mgr.a (mgr.14388) 16208 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22676]: audit 2024-09-21T04:28:56.864539+0000 mon.a (mon.0) 12949 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:28:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22676]: audit 2024-09-21T04:28:56.870897+0000 mon.a (mon.0) 12950 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:28:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22676]: audit 2024-09-21T04:28:56.872843+0000 mon.a (mon.0) 12951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:28:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22676]: audit 2024-09-21T04:28:56.883811+0000 mon.a (mon.0) 12952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22676]: audit 2024-09-21T04:28:56.889996+0000 mon.a (mon.0) 12953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:28:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22676]: audit 2024-09-21T04:28:56.892470+0000 mgr.a (mgr.14388) 16209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:28:57.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22930]: debug 2024-09-21T04:28:57.674+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:28:57.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:28:57 smithi044 bash[22930]: debug 2024-09-21T04:28:57.678+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:28:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:57 smithi179 bash[23186]: cluster 2024-09-21T04:28:56.364837+0000 mgr.a (mgr.14388) 16208 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:57 smithi179 bash[23186]: audit 2024-09-21T04:28:56.864539+0000 mon.a (mon.0) 12949 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:28:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:57 smithi179 bash[23186]: audit 2024-09-21T04:28:56.870897+0000 mon.a (mon.0) 12950 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:28:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:57 smithi179 bash[23186]: audit 2024-09-21T04:28:56.872843+0000 mon.a (mon.0) 12951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:28:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:57 smithi179 bash[23186]: audit 2024-09-21T04:28:56.883811+0000 mon.a (mon.0) 12952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:57 smithi179 bash[23186]: audit 2024-09-21T04:28:56.889996+0000 mon.a (mon.0) 12953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:28:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:57 smithi179 bash[23186]: audit 2024-09-21T04:28:56.892470+0000 mgr.a (mgr.14388) 16209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:28:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:57 smithi049 bash[23528]: cluster 2024-09-21T04:28:56.364837+0000 mgr.a (mgr.14388) 16208 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:28:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:57 smithi049 bash[23528]: audit 2024-09-21T04:28:56.864539+0000 mon.a (mon.0) 12949 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:28:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:57 smithi049 bash[23528]: audit 2024-09-21T04:28:56.870897+0000 mon.a (mon.0) 12950 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:28:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:57 smithi049 bash[23528]: audit 2024-09-21T04:28:56.872843+0000 mon.a (mon.0) 12951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:28:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:57 smithi049 bash[23528]: audit 2024-09-21T04:28:56.883811+0000 mon.a (mon.0) 12952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:28:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:57 smithi049 bash[23528]: audit 2024-09-21T04:28:56.889996+0000 mon.a (mon.0) 12953 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:28:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:57 smithi049 bash[23528]: audit 2024-09-21T04:28:56.892470+0000 mgr.a (mgr.14388) 16209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:28:58.613 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:28:58.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:28:58.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:28:58.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:28:58.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:28:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:58 smithi044 bash[22676]: audit 2024-09-21T04:28:57.680923+0000 mgr.a (mgr.14388) 16210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:28:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:58 smithi044 bash[22676]: cephadm 2024-09-21T04:28:57.682249+0000 mgr.a (mgr.14388) 16211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:28:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:58 smithi044 bash[22676]: audit 2024-09-21T04:28:58.147272+0000 mgr.a (mgr.14388) 16212 : audit [DBG] from='client.350097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:58 smithi179 bash[23186]: audit 2024-09-21T04:28:57.680923+0000 mgr.a (mgr.14388) 16210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:28:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:58 smithi179 bash[23186]: cephadm 2024-09-21T04:28:57.682249+0000 mgr.a (mgr.14388) 16211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:28:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:58 smithi179 bash[23186]: audit 2024-09-21T04:28:58.147272+0000 mgr.a (mgr.14388) 16212 : audit [DBG] from='client.350097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:59.034 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:58 smithi049 bash[23528]: audit 2024-09-21T04:28:57.680923+0000 mgr.a (mgr.14388) 16210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:28:59.034 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:58 smithi049 bash[23528]: cephadm 2024-09-21T04:28:57.682249+0000 mgr.a (mgr.14388) 16211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:28:59.034 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:58 smithi049 bash[23528]: audit 2024-09-21T04:28:58.147272+0000 mgr.a (mgr.14388) 16212 : audit [DBG] from='client.350097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:28:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:28:59 smithi044 bash[22676]: cluster 2024-09-21T04:28:58.365388+0000 mgr.a (mgr.14388) 16213 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:28:59 smithi179 bash[23186]: cluster 2024-09-21T04:28:58.365388+0000 mgr.a (mgr.14388) 16213 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:28:59 smithi049 bash[23528]: cluster 2024-09-21T04:28:58.365388+0000 mgr.a (mgr.14388) 16213 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:01 smithi179 bash[23186]: cluster 2024-09-21T04:29:00.366661+0000 mgr.a (mgr.14388) 16214 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:01 smithi049 bash[23528]: cluster 2024-09-21T04:29:00.366661+0000 mgr.a (mgr.14388) 16214 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:02.124 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:01 smithi044 bash[22676]: cluster 2024-09-21T04:29:00.366661+0000 mgr.a (mgr.14388) 16214 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:03.616 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:03 smithi179 bash[23186]: cluster 2024-09-21T04:29:02.367454+0000 mgr.a (mgr.14388) 16215 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:03 smithi049 bash[23528]: cluster 2024-09-21T04:29:02.367454+0000 mgr.a (mgr.14388) 16215 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:03 smithi044 bash[22676]: cluster 2024-09-21T04:29:02.367454+0000 mgr.a (mgr.14388) 16215 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:04.383 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:04 smithi179 bash[23186]: audit 2024-09-21T04:29:03.950235+0000 mgr.a (mgr.14388) 16216 : audit [DBG] from='client.350172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:04 smithi049 bash[23528]: audit 2024-09-21T04:29:03.950235+0000 mgr.a (mgr.14388) 16216 : audit [DBG] from='client.350172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:04 smithi044 bash[22676]: audit 2024-09-21T04:29:03.950235+0000 mgr.a (mgr.14388) 16216 : audit [DBG] from='client.350172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:05 smithi179 bash[23186]: cluster 2024-09-21T04:29:04.367956+0000 mgr.a (mgr.14388) 16217 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:05 smithi044 bash[22676]: cluster 2024-09-21T04:29:04.367956+0000 mgr.a (mgr.14388) 16217 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:05 smithi049 bash[23528]: cluster 2024-09-21T04:29:04.367956+0000 mgr.a (mgr.14388) 16217 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:06 smithi179 bash[23186]: audit 2024-09-21T04:29:05.991257+0000 mon.a (mon.0) 12954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:06 smithi179 bash[23186]: audit 2024-09-21T04:29:06.000942+0000 mon.a (mon.0) 12955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:06 smithi179 bash[23186]: audit 2024-09-21T04:29:06.011324+0000 mon.a (mon.0) 12956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:06 smithi179 bash[23186]: audit 2024-09-21T04:29:06.360073+0000 mon.a (mon.0) 12957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:06 smithi179 bash[23186]: audit 2024-09-21T04:29:06.368519+0000 mon.a (mon.0) 12958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:06 smithi179 bash[23186]: audit 2024-09-21T04:29:06.378800+0000 mon.a (mon.0) 12959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:06 smithi049 bash[23528]: audit 2024-09-21T04:29:05.991257+0000 mon.a (mon.0) 12954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:06 smithi049 bash[23528]: audit 2024-09-21T04:29:06.000942+0000 mon.a (mon.0) 12955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:06 smithi049 bash[23528]: audit 2024-09-21T04:29:06.011324+0000 mon.a (mon.0) 12956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:06 smithi049 bash[23528]: audit 2024-09-21T04:29:06.360073+0000 mon.a (mon.0) 12957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:06 smithi049 bash[23528]: audit 2024-09-21T04:29:06.368519+0000 mon.a (mon.0) 12958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:06 smithi049 bash[23528]: audit 2024-09-21T04:29:06.378800+0000 mon.a (mon.0) 12959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:06 smithi044 bash[22676]: audit 2024-09-21T04:29:05.991257+0000 mon.a (mon.0) 12954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:06 smithi044 bash[22676]: audit 2024-09-21T04:29:06.000942+0000 mon.a (mon.0) 12955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:06 smithi044 bash[22676]: audit 2024-09-21T04:29:06.011324+0000 mon.a (mon.0) 12956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:06 smithi044 bash[22676]: audit 2024-09-21T04:29:06.360073+0000 mon.a (mon.0) 12957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:06 smithi044 bash[22676]: audit 2024-09-21T04:29:06.368519+0000 mon.a (mon.0) 12958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:06 smithi044 bash[22676]: audit 2024-09-21T04:29:06.378800+0000 mon.a (mon.0) 12959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:07 smithi179 bash[23186]: cluster 2024-09-21T04:29:06.370494+0000 mgr.a (mgr.14388) 16218 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:07 smithi049 bash[23528]: cluster 2024-09-21T04:29:06.370494+0000 mgr.a (mgr.14388) 16218 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:07 smithi044 bash[22676]: cluster 2024-09-21T04:29:06.370494+0000 mgr.a (mgr.14388) 16218 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:09.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:09.385 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:09.386 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:10.168 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:10.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:10.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:10.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:10.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:09 smithi179 bash[23186]: cluster 2024-09-21T04:29:08.371279+0000 mgr.a (mgr.14388) 16219 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:09 smithi049 bash[23528]: cluster 2024-09-21T04:29:08.371279+0000 mgr.a (mgr.14388) 16219 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:09 smithi044 bash[22676]: cluster 2024-09-21T04:29:08.371279+0000 mgr.a (mgr.14388) 16219 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:10 smithi179 bash[23186]: audit 2024-09-21T04:29:09.719621+0000 mgr.a (mgr.14388) 16220 : audit [DBG] from='client.350250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:10 smithi049 bash[23528]: audit 2024-09-21T04:29:09.719621+0000 mgr.a (mgr.14388) 16220 : audit [DBG] from='client.350250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:10 smithi044 bash[22676]: audit 2024-09-21T04:29:09.719621+0000 mgr.a (mgr.14388) 16220 : audit [DBG] from='client.350250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:12 smithi049 bash[23528]: cluster 2024-09-21T04:29:10.373656+0000 mgr.a (mgr.14388) 16221 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:12 smithi044 bash[22676]: cluster 2024-09-21T04:29:10.373656+0000 mgr.a (mgr.14388) 16221 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:12 smithi179 bash[23186]: cluster 2024-09-21T04:29:10.373656+0000 mgr.a (mgr.14388) 16221 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:29:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:14 smithi049 bash[23528]: cluster 2024-09-21T04:29:12.374414+0000 mgr.a (mgr.14388) 16222 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:29:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:14 smithi044 bash[22676]: cluster 2024-09-21T04:29:12.374414+0000 mgr.a (mgr.14388) 16222 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:29:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:14 smithi179 bash[23186]: cluster 2024-09-21T04:29:12.374414+0000 mgr.a (mgr.14388) 16222 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:29:15.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:15.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:15.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:15.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:15.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:15.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:15 smithi044 bash[22676]: cluster 2024-09-21T04:29:14.375236+0000 mgr.a (mgr.14388) 16223 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:29:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:15 smithi044 bash[22676]: audit 2024-09-21T04:29:14.954004+0000 mon.a (mon.0) 12960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:15 smithi044 bash[22676]: audit 2024-09-21T04:29:14.962836+0000 mon.a (mon.0) 12961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:15 smithi044 bash[22676]: audit 2024-09-21T04:29:14.973491+0000 mon.a (mon.0) 12962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:15 smithi179 bash[23186]: cluster 2024-09-21T04:29:14.375236+0000 mgr.a (mgr.14388) 16223 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:29:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:15 smithi179 bash[23186]: audit 2024-09-21T04:29:14.954004+0000 mon.a (mon.0) 12960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:15 smithi179 bash[23186]: audit 2024-09-21T04:29:14.962836+0000 mon.a (mon.0) 12961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:15 smithi179 bash[23186]: audit 2024-09-21T04:29:14.973491+0000 mon.a (mon.0) 12962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:15 smithi049 bash[23528]: cluster 2024-09-21T04:29:14.375236+0000 mgr.a (mgr.14388) 16223 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:29:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:15 smithi049 bash[23528]: audit 2024-09-21T04:29:14.954004+0000 mon.a (mon.0) 12960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:15 smithi049 bash[23528]: audit 2024-09-21T04:29:14.962836+0000 mon.a (mon.0) 12961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:15 smithi049 bash[23528]: audit 2024-09-21T04:29:14.973491+0000 mon.a (mon.0) 12962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:16 smithi044 bash[22676]: audit 2024-09-21T04:29:15.506580+0000 mgr.a (mgr.14388) 16224 : audit [DBG] from='client.350328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:16 smithi179 bash[23186]: audit 2024-09-21T04:29:15.506580+0000 mgr.a (mgr.14388) 16224 : audit [DBG] from='client.350328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:17.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:16 smithi049 bash[23528]: audit 2024-09-21T04:29:15.506580+0000 mgr.a (mgr.14388) 16224 : audit [DBG] from='client.350328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:17 smithi044 bash[22676]: cluster 2024-09-21T04:29:16.378232+0000 mgr.a (mgr.14388) 16225 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:17 smithi179 bash[23186]: cluster 2024-09-21T04:29:16.378232+0000 mgr.a (mgr.14388) 16225 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:17 smithi049 bash[23528]: cluster 2024-09-21T04:29:16.378232+0000 mgr.a (mgr.14388) 16225 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:20.228 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:19 smithi044 bash[22676]: cluster 2024-09-21T04:29:18.379233+0000 mgr.a (mgr.14388) 16226 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:29:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:19 smithi179 bash[23186]: cluster 2024-09-21T04:29:18.379233+0000 mgr.a (mgr.14388) 16226 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:29:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:19 smithi049 bash[23528]: cluster 2024-09-21T04:29:18.379233+0000 mgr.a (mgr.14388) 16226 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:29:20.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:20.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:20.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:21.769 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:21.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:21 smithi044 bash[22676]: cluster 2024-09-21T04:29:20.381385+0000 mgr.a (mgr.14388) 16227 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:21 smithi179 bash[23186]: cluster 2024-09-21T04:29:20.381385+0000 mgr.a (mgr.14388) 16227 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:21 smithi049 bash[23528]: cluster 2024-09-21T04:29:20.381385+0000 mgr.a (mgr.14388) 16227 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:22 smithi044 bash[22676]: audit 2024-09-21T04:29:21.293734+0000 mgr.a (mgr.14388) 16228 : audit [DBG] from='client.350403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:22 smithi179 bash[23186]: audit 2024-09-21T04:29:21.293734+0000 mgr.a (mgr.14388) 16228 : audit [DBG] from='client.350403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:22 smithi049 bash[23528]: audit 2024-09-21T04:29:21.293734+0000 mgr.a (mgr.14388) 16228 : audit [DBG] from='client.350403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:23 smithi044 bash[22676]: cluster 2024-09-21T04:29:22.382148+0000 mgr.a (mgr.14388) 16229 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:29:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:23 smithi179 bash[23186]: cluster 2024-09-21T04:29:22.382148+0000 mgr.a (mgr.14388) 16229 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:29:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:23 smithi049 bash[23528]: cluster 2024-09-21T04:29:22.382148+0000 mgr.a (mgr.14388) 16229 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:29:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:25 smithi044 bash[22676]: cluster 2024-09-21T04:29:24.383130+0000 mgr.a (mgr.14388) 16230 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:29:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:25 smithi179 bash[23186]: cluster 2024-09-21T04:29:24.383130+0000 mgr.a (mgr.14388) 16230 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:29:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:25 smithi049 bash[23528]: cluster 2024-09-21T04:29:24.383130+0000 mgr.a (mgr.14388) 16230 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:29:26.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: audit 2024-09-21T04:29:26.219382+0000 mon.a (mon.0) 12963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: audit 2024-09-21T04:29:26.226947+0000 mon.a (mon.0) 12964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: audit 2024-09-21T04:29:26.237203+0000 mon.a (mon.0) 12965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: cluster 2024-09-21T04:29:26.385465+0000 mgr.a (mgr.14388) 16231 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:29:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: audit 2024-09-21T04:29:26.563335+0000 mon.a (mon.0) 12966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: audit 2024-09-21T04:29:26.571704+0000 mon.a (mon.0) 12967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: audit 2024-09-21T04:29:26.581660+0000 mon.a (mon.0) 12968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:27 smithi044 bash[22676]: audit 2024-09-21T04:29:27.100153+0000 mgr.a (mgr.14388) 16232 : audit [DBG] from='client.350481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: audit 2024-09-21T04:29:26.219382+0000 mon.a (mon.0) 12963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: audit 2024-09-21T04:29:26.226947+0000 mon.a (mon.0) 12964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: audit 2024-09-21T04:29:26.237203+0000 mon.a (mon.0) 12965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: cluster 2024-09-21T04:29:26.385465+0000 mgr.a (mgr.14388) 16231 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:29:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: audit 2024-09-21T04:29:26.563335+0000 mon.a (mon.0) 12966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: audit 2024-09-21T04:29:26.571704+0000 mon.a (mon.0) 12967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: audit 2024-09-21T04:29:26.581660+0000 mon.a (mon.0) 12968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:27 smithi179 bash[23186]: audit 2024-09-21T04:29:27.100153+0000 mgr.a (mgr.14388) 16232 : audit [DBG] from='client.350481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: audit 2024-09-21T04:29:26.219382+0000 mon.a (mon.0) 12963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: audit 2024-09-21T04:29:26.226947+0000 mon.a (mon.0) 12964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: audit 2024-09-21T04:29:26.237203+0000 mon.a (mon.0) 12965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: cluster 2024-09-21T04:29:26.385465+0000 mgr.a (mgr.14388) 16231 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: audit 2024-09-21T04:29:26.563335+0000 mon.a (mon.0) 12966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: audit 2024-09-21T04:29:26.571704+0000 mon.a (mon.0) 12967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: audit 2024-09-21T04:29:26.581660+0000 mon.a (mon.0) 12968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:27 smithi049 bash[23528]: audit 2024-09-21T04:29:27.100153+0000 mgr.a (mgr.14388) 16232 : audit [DBG] from='client.350481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:27.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:27.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:27.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:27.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:29 smithi044 bash[22676]: cluster 2024-09-21T04:29:28.386468+0000 mgr.a (mgr.14388) 16233 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:29 smithi179 bash[23186]: cluster 2024-09-21T04:29:28.386468+0000 mgr.a (mgr.14388) 16233 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:29 smithi049 bash[23528]: cluster 2024-09-21T04:29:28.386468+0000 mgr.a (mgr.14388) 16233 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:31 smithi044 bash[22676]: cluster 2024-09-21T04:29:30.388669+0000 mgr.a (mgr.14388) 16234 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:31 smithi179 bash[23186]: cluster 2024-09-21T04:29:30.388669+0000 mgr.a (mgr.14388) 16234 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:31 smithi049 bash[23528]: cluster 2024-09-21T04:29:30.388669+0000 mgr.a (mgr.14388) 16234 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:32.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:32.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:32.565 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:33.345 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:33 smithi044 bash[22676]: cluster 2024-09-21T04:29:32.389467+0000 mgr.a (mgr.14388) 16235 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:33 smithi044 bash[22676]: audit 2024-09-21T04:29:32.898555+0000 mgr.a (mgr.14388) 16236 : audit [DBG] from='client.350559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:33 smithi179 bash[23186]: cluster 2024-09-21T04:29:32.389467+0000 mgr.a (mgr.14388) 16235 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:33 smithi179 bash[23186]: audit 2024-09-21T04:29:32.898555+0000 mgr.a (mgr.14388) 16236 : audit [DBG] from='client.350559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:33 smithi049 bash[23528]: cluster 2024-09-21T04:29:32.389467+0000 mgr.a (mgr.14388) 16235 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:33 smithi049 bash[23528]: audit 2024-09-21T04:29:32.898555+0000 mgr.a (mgr.14388) 16236 : audit [DBG] from='client.350559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:36 smithi044 bash[22676]: cluster 2024-09-21T04:29:34.390441+0000 mgr.a (mgr.14388) 16237 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:36 smithi044 bash[22676]: audit 2024-09-21T04:29:35.187865+0000 mon.a (mon.0) 12969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:36 smithi044 bash[22676]: audit 2024-09-21T04:29:35.197083+0000 mon.a (mon.0) 12970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:36 smithi044 bash[22676]: audit 2024-09-21T04:29:35.208733+0000 mon.a (mon.0) 12971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:36 smithi179 bash[23186]: cluster 2024-09-21T04:29:34.390441+0000 mgr.a (mgr.14388) 16237 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:36 smithi179 bash[23186]: audit 2024-09-21T04:29:35.187865+0000 mon.a (mon.0) 12969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:36 smithi179 bash[23186]: audit 2024-09-21T04:29:35.197083+0000 mon.a (mon.0) 12970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:36 smithi179 bash[23186]: audit 2024-09-21T04:29:35.208733+0000 mon.a (mon.0) 12971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:36 smithi049 bash[23528]: cluster 2024-09-21T04:29:34.390441+0000 mgr.a (mgr.14388) 16237 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:36 smithi049 bash[23528]: audit 2024-09-21T04:29:35.187865+0000 mon.a (mon.0) 12969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:36 smithi049 bash[23528]: audit 2024-09-21T04:29:35.197083+0000 mon.a (mon.0) 12970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:36 smithi049 bash[23528]: audit 2024-09-21T04:29:35.208733+0000 mon.a (mon.0) 12971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:37 smithi179 bash[23186]: cluster 2024-09-21T04:29:36.392816+0000 mgr.a (mgr.14388) 16238 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:37 smithi049 bash[23528]: cluster 2024-09-21T04:29:36.392816+0000 mgr.a (mgr.14388) 16238 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:37 smithi044 bash[22676]: cluster 2024-09-21T04:29:36.392816+0000 mgr.a (mgr.14388) 16238 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:38.347 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:38.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:38.348 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:39.120 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:39.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:39 smithi044 bash[22676]: cluster 2024-09-21T04:29:38.393630+0000 mgr.a (mgr.14388) 16239 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:39 smithi044 bash[22676]: audit 2024-09-21T04:29:38.677815+0000 mgr.a (mgr.14388) 16240 : audit [DBG] from='client.350637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:39 smithi179 bash[23186]: cluster 2024-09-21T04:29:38.393630+0000 mgr.a (mgr.14388) 16239 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:39 smithi179 bash[23186]: audit 2024-09-21T04:29:38.677815+0000 mgr.a (mgr.14388) 16240 : audit [DBG] from='client.350637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:39 smithi049 bash[23528]: cluster 2024-09-21T04:29:38.393630+0000 mgr.a (mgr.14388) 16239 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:39 smithi049 bash[23528]: audit 2024-09-21T04:29:38.677815+0000 mgr.a (mgr.14388) 16240 : audit [DBG] from='client.350637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:41 smithi044 bash[22676]: cluster 2024-09-21T04:29:40.395236+0000 mgr.a (mgr.14388) 16241 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:41 smithi179 bash[23186]: cluster 2024-09-21T04:29:40.395236+0000 mgr.a (mgr.14388) 16241 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:41 smithi049 bash[23528]: cluster 2024-09-21T04:29:40.395236+0000 mgr.a (mgr.14388) 16241 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:43 smithi044 bash[22676]: cluster 2024-09-21T04:29:42.396123+0000 mgr.a (mgr.14388) 16242 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:43 smithi179 bash[23186]: cluster 2024-09-21T04:29:42.396123+0000 mgr.a (mgr.14388) 16242 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:43 smithi049 bash[23528]: cluster 2024-09-21T04:29:42.396123+0000 mgr.a (mgr.14388) 16242 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:44.122 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:44.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:44.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:44.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:44.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:45 smithi044 bash[22676]: cluster 2024-09-21T04:29:44.396947+0000 mgr.a (mgr.14388) 16243 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:45 smithi044 bash[22676]: audit 2024-09-21T04:29:44.454472+0000 mgr.a (mgr.14388) 16244 : audit [DBG] from='client.350715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:45 smithi179 bash[23186]: cluster 2024-09-21T04:29:44.396947+0000 mgr.a (mgr.14388) 16243 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:45 smithi179 bash[23186]: audit 2024-09-21T04:29:44.454472+0000 mgr.a (mgr.14388) 16244 : audit [DBG] from='client.350715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:45 smithi049 bash[23528]: cluster 2024-09-21T04:29:44.396947+0000 mgr.a (mgr.14388) 16243 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:45 smithi049 bash[23528]: audit 2024-09-21T04:29:44.454472+0000 mgr.a (mgr.14388) 16244 : audit [DBG] from='client.350715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:47 smithi044 bash[22676]: cluster 2024-09-21T04:29:46.399325+0000 mgr.a (mgr.14388) 16245 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:47 smithi044 bash[22676]: audit 2024-09-21T04:29:46.442934+0000 mon.a (mon.0) 12972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:47 smithi044 bash[22676]: audit 2024-09-21T04:29:46.450865+0000 mon.a (mon.0) 12973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:47 smithi044 bash[22676]: audit 2024-09-21T04:29:46.461561+0000 mon.a (mon.0) 12974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:47 smithi044 bash[22676]: audit 2024-09-21T04:29:46.725280+0000 mon.a (mon.0) 12975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:47 smithi044 bash[22676]: audit 2024-09-21T04:29:46.733454+0000 mon.a (mon.0) 12976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:47 smithi044 bash[22676]: audit 2024-09-21T04:29:46.743319+0000 mon.a (mon.0) 12977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:47 smithi179 bash[23186]: cluster 2024-09-21T04:29:46.399325+0000 mgr.a (mgr.14388) 16245 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:47 smithi179 bash[23186]: audit 2024-09-21T04:29:46.442934+0000 mon.a (mon.0) 12972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:47 smithi179 bash[23186]: audit 2024-09-21T04:29:46.450865+0000 mon.a (mon.0) 12973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:47 smithi179 bash[23186]: audit 2024-09-21T04:29:46.461561+0000 mon.a (mon.0) 12974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:47 smithi179 bash[23186]: audit 2024-09-21T04:29:46.725280+0000 mon.a (mon.0) 12975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:47 smithi179 bash[23186]: audit 2024-09-21T04:29:46.733454+0000 mon.a (mon.0) 12976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:47 smithi179 bash[23186]: audit 2024-09-21T04:29:46.743319+0000 mon.a (mon.0) 12977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:47 smithi049 bash[23528]: cluster 2024-09-21T04:29:46.399325+0000 mgr.a (mgr.14388) 16245 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:29:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:47 smithi049 bash[23528]: audit 2024-09-21T04:29:46.442934+0000 mon.a (mon.0) 12972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:47 smithi049 bash[23528]: audit 2024-09-21T04:29:46.450865+0000 mon.a (mon.0) 12973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:47 smithi049 bash[23528]: audit 2024-09-21T04:29:46.461561+0000 mon.a (mon.0) 12974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:47 smithi049 bash[23528]: audit 2024-09-21T04:29:46.725280+0000 mon.a (mon.0) 12975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:47 smithi049 bash[23528]: audit 2024-09-21T04:29:46.733454+0000 mon.a (mon.0) 12976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:47.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:47 smithi049 bash[23528]: audit 2024-09-21T04:29:46.743319+0000 mon.a (mon.0) 12977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:49 smithi044 bash[22676]: cluster 2024-09-21T04:29:48.400216+0000 mgr.a (mgr.14388) 16246 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:49 smithi179 bash[23186]: cluster 2024-09-21T04:29:48.400216+0000 mgr.a (mgr.14388) 16246 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:49 smithi049 bash[23528]: cluster 2024-09-21T04:29:48.400216+0000 mgr.a (mgr.14388) 16246 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:49.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:49.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:49.917 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:50.686 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:51 smithi044 bash[22676]: audit 2024-09-21T04:29:50.249523+0000 mgr.a (mgr.14388) 16247 : audit [DBG] from='client.350793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:51 smithi044 bash[22676]: cluster 2024-09-21T04:29:50.401699+0000 mgr.a (mgr.14388) 16248 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:51 smithi179 bash[23186]: audit 2024-09-21T04:29:50.249523+0000 mgr.a (mgr.14388) 16247 : audit [DBG] from='client.350793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:51 smithi179 bash[23186]: cluster 2024-09-21T04:29:50.401699+0000 mgr.a (mgr.14388) 16248 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:51 smithi049 bash[23528]: audit 2024-09-21T04:29:50.249523+0000 mgr.a (mgr.14388) 16247 : audit [DBG] from='client.350793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:51 smithi049 bash[23528]: cluster 2024-09-21T04:29:50.401699+0000 mgr.a (mgr.14388) 16248 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:53 smithi044 bash[22676]: cluster 2024-09-21T04:29:52.402768+0000 mgr.a (mgr.14388) 16249 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:29:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:53 smithi179 bash[23186]: cluster 2024-09-21T04:29:52.402768+0000 mgr.a (mgr.14388) 16249 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:29:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:53 smithi049 bash[23528]: cluster 2024-09-21T04:29:52.402768+0000 mgr.a (mgr.14388) 16249 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:29:55.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:29:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:29:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:29:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:55 smithi044 bash[22676]: cluster 2024-09-21T04:29:54.403735+0000 mgr.a (mgr.14388) 16250 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:29:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:55 smithi044 bash[22676]: audit 2024-09-21T04:29:55.426787+0000 mon.a (mon.0) 12978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:55 smithi044 bash[22676]: audit 2024-09-21T04:29:55.435994+0000 mon.a (mon.0) 12979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:55 smithi044 bash[22676]: audit 2024-09-21T04:29:55.447040+0000 mon.a (mon.0) 12980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:55 smithi179 bash[23186]: cluster 2024-09-21T04:29:54.403735+0000 mgr.a (mgr.14388) 16250 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:29:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:55 smithi179 bash[23186]: audit 2024-09-21T04:29:55.426787+0000 mon.a (mon.0) 12978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:55 smithi179 bash[23186]: audit 2024-09-21T04:29:55.435994+0000 mon.a (mon.0) 12979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:55 smithi179 bash[23186]: audit 2024-09-21T04:29:55.447040+0000 mon.a (mon.0) 12980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:55 smithi049 bash[23528]: cluster 2024-09-21T04:29:54.403735+0000 mgr.a (mgr.14388) 16250 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:29:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:55 smithi049 bash[23528]: audit 2024-09-21T04:29:55.426787+0000 mon.a (mon.0) 12978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:55 smithi049 bash[23528]: audit 2024-09-21T04:29:55.435994+0000 mon.a (mon.0) 12979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:55 smithi049 bash[23528]: audit 2024-09-21T04:29:55.447040+0000 mon.a (mon.0) 12980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:29:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:29:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:29:56.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:29:56.468 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:29:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:56 smithi044 bash[22676]: audit 2024-09-21T04:29:56.019754+0000 mgr.a (mgr.14388) 16251 : audit [DBG] from='client.350871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:56 smithi179 bash[23186]: audit 2024-09-21T04:29:56.019754+0000 mgr.a (mgr.14388) 16251 : audit [DBG] from='client.350871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:56 smithi049 bash[23528]: audit 2024-09-21T04:29:56.019754+0000 mgr.a (mgr.14388) 16251 : audit [DBG] from='client.350871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:29:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:57 smithi044 bash[22676]: cluster 2024-09-21T04:29:56.405407+0000 mgr.a (mgr.14388) 16252 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:57 smithi179 bash[23186]: cluster 2024-09-21T04:29:56.405407+0000 mgr.a (mgr.14388) 16252 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:57 smithi049 bash[23528]: cluster 2024-09-21T04:29:56.405407+0000 mgr.a (mgr.14388) 16252 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:29:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:58 smithi049 bash[23528]: audit 2024-09-21T04:29:57.740821+0000 mon.a (mon.0) 12981 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:29:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:58 smithi049 bash[23528]: audit 2024-09-21T04:29:57.747618+0000 mon.a (mon.0) 12982 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:29:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:58 smithi049 bash[23528]: audit 2024-09-21T04:29:57.749485+0000 mon.a (mon.0) 12983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:29:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:58 smithi049 bash[23528]: audit 2024-09-21T04:29:57.760995+0000 mon.a (mon.0) 12984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:58 smithi049 bash[23528]: audit 2024-09-21T04:29:57.767602+0000 mon.a (mon.0) 12985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:29:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:58 smithi049 bash[23528]: audit 2024-09-21T04:29:57.770267+0000 mgr.a (mgr.14388) 16253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:29:58.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22930]: debug 2024-09-21T04:29:58.521+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:29:58.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22930]: debug 2024-09-21T04:29:58.521+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:29:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22676]: audit 2024-09-21T04:29:57.740821+0000 mon.a (mon.0) 12981 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:29:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22676]: audit 2024-09-21T04:29:57.747618+0000 mon.a (mon.0) 12982 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:29:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22676]: audit 2024-09-21T04:29:57.749485+0000 mon.a (mon.0) 12983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:29:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22676]: audit 2024-09-21T04:29:57.760995+0000 mon.a (mon.0) 12984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22676]: audit 2024-09-21T04:29:57.767602+0000 mon.a (mon.0) 12985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:29:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:58 smithi044 bash[22676]: audit 2024-09-21T04:29:57.770267+0000 mgr.a (mgr.14388) 16253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:29:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:58 smithi179 bash[23186]: audit 2024-09-21T04:29:57.740821+0000 mon.a (mon.0) 12981 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:29:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:58 smithi179 bash[23186]: audit 2024-09-21T04:29:57.747618+0000 mon.a (mon.0) 12982 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:29:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:58 smithi179 bash[23186]: audit 2024-09-21T04:29:57.749485+0000 mon.a (mon.0) 12983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:29:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:58 smithi179 bash[23186]: audit 2024-09-21T04:29:57.760995+0000 mon.a (mon.0) 12984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:29:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:58 smithi179 bash[23186]: audit 2024-09-21T04:29:57.767602+0000 mon.a (mon.0) 12985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:29:58.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:58 smithi179 bash[23186]: audit 2024-09-21T04:29:57.770267+0000 mgr.a (mgr.14388) 16253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:30:00.015 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:59 smithi049 bash[23528]: cluster 2024-09-21T04:29:58.405855+0000 mgr.a (mgr.14388) 16254 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:30:00.015 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:59 smithi049 bash[23528]: audit 2024-09-21T04:29:58.525441+0000 mgr.a (mgr.14388) 16255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:30:00.015 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:29:59 smithi049 bash[23528]: cephadm 2024-09-21T04:29:58.526556+0000 mgr.a (mgr.14388) 16256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:30:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:59 smithi044 bash[22676]: cluster 2024-09-21T04:29:58.405855+0000 mgr.a (mgr.14388) 16254 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:30:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:59 smithi044 bash[22676]: audit 2024-09-21T04:29:58.525441+0000 mgr.a (mgr.14388) 16255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:30:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:29:59 smithi044 bash[22676]: cephadm 2024-09-21T04:29:58.526556+0000 mgr.a (mgr.14388) 16256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:30:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:59 smithi179 bash[23186]: cluster 2024-09-21T04:29:58.405855+0000 mgr.a (mgr.14388) 16254 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:30:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:59 smithi179 bash[23186]: audit 2024-09-21T04:29:58.525441+0000 mgr.a (mgr.14388) 16255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:30:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:29:59 smithi179 bash[23186]: cephadm 2024-09-21T04:29:58.526556+0000 mgr.a (mgr.14388) 16256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:30:00.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:00 smithi044 bash[22676]: cluster 2024-09-21T04:30:00.000149+0000 mon.a (mon.0) 12986 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:30:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:00 smithi049 bash[23528]: cluster 2024-09-21T04:30:00.000149+0000 mon.a (mon.0) 12986 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:30:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:00 smithi179 bash[23186]: cluster 2024-09-21T04:30:00.000149+0000 mon.a (mon.0) 12986 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:30:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:01 smithi044 bash[22676]: cluster 2024-09-21T04:30:00.407988+0000 mgr.a (mgr.14388) 16257 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:01 smithi049 bash[23528]: cluster 2024-09-21T04:30:00.407988+0000 mgr.a (mgr.14388) 16257 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:02.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:02.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:01 smithi179 bash[23186]: cluster 2024-09-21T04:30:00.407988+0000 mgr.a (mgr.14388) 16257 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:02 smithi049 bash[23528]: audit 2024-09-21T04:30:01.796221+0000 mgr.a (mgr.14388) 16258 : audit [DBG] from='client.351057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:03.155 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:02 smithi044 bash[22676]: audit 2024-09-21T04:30:01.796221+0000 mgr.a (mgr.14388) 16258 : audit [DBG] from='client.351057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:02 smithi179 bash[23186]: audit 2024-09-21T04:30:01.796221+0000 mgr.a (mgr.14388) 16258 : audit [DBG] from='client.351057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:03 smithi049 bash[23528]: cluster 2024-09-21T04:30:02.408921+0000 mgr.a (mgr.14388) 16259 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:03 smithi044 bash[22676]: cluster 2024-09-21T04:30:02.408921+0000 mgr.a (mgr.14388) 16259 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:03 smithi179 bash[23186]: cluster 2024-09-21T04:30:02.408921+0000 mgr.a (mgr.14388) 16259 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:05 smithi179 bash[23186]: cluster 2024-09-21T04:30:04.409782+0000 mgr.a (mgr.14388) 16260 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:05 smithi049 bash[23528]: cluster 2024-09-21T04:30:04.409782+0000 mgr.a (mgr.14388) 16260 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:05 smithi044 bash[22676]: cluster 2024-09-21T04:30:04.409782+0000 mgr.a (mgr.14388) 16260 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:07 smithi044 bash[22676]: cluster 2024-09-21T04:30:06.412080+0000 mgr.a (mgr.14388) 16261 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:07 smithi044 bash[22676]: audit 2024-09-21T04:30:06.680129+0000 mon.a (mon.0) 12987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:07 smithi044 bash[22676]: audit 2024-09-21T04:30:06.688546+0000 mon.a (mon.0) 12988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:07 smithi044 bash[22676]: audit 2024-09-21T04:30:06.700296+0000 mon.a (mon.0) 12989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:07 smithi044 bash[22676]: audit 2024-09-21T04:30:06.906949+0000 mon.a (mon.0) 12990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:07 smithi044 bash[22676]: audit 2024-09-21T04:30:06.915586+0000 mon.a (mon.0) 12991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:07 smithi044 bash[22676]: audit 2024-09-21T04:30:06.927198+0000 mon.a (mon.0) 12992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:07 smithi179 bash[23186]: cluster 2024-09-21T04:30:06.412080+0000 mgr.a (mgr.14388) 16261 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:07 smithi179 bash[23186]: audit 2024-09-21T04:30:06.680129+0000 mon.a (mon.0) 12987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:07 smithi179 bash[23186]: audit 2024-09-21T04:30:06.688546+0000 mon.a (mon.0) 12988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:07 smithi179 bash[23186]: audit 2024-09-21T04:30:06.700296+0000 mon.a (mon.0) 12989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:07 smithi179 bash[23186]: audit 2024-09-21T04:30:06.906949+0000 mon.a (mon.0) 12990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:07 smithi179 bash[23186]: audit 2024-09-21T04:30:06.915586+0000 mon.a (mon.0) 12991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:07 smithi179 bash[23186]: audit 2024-09-21T04:30:06.927198+0000 mon.a (mon.0) 12992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.012 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:07 smithi049 bash[23528]: cluster 2024-09-21T04:30:06.412080+0000 mgr.a (mgr.14388) 16261 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:07 smithi049 bash[23528]: audit 2024-09-21T04:30:06.680129+0000 mon.a (mon.0) 12987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:07 smithi049 bash[23528]: audit 2024-09-21T04:30:06.688546+0000 mon.a (mon.0) 12988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:07 smithi049 bash[23528]: audit 2024-09-21T04:30:06.700296+0000 mon.a (mon.0) 12989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:07 smithi049 bash[23528]: audit 2024-09-21T04:30:06.906949+0000 mon.a (mon.0) 12990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:07 smithi049 bash[23528]: audit 2024-09-21T04:30:06.915586+0000 mon.a (mon.0) 12991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:07 smithi049 bash[23528]: audit 2024-09-21T04:30:06.927198+0000 mon.a (mon.0) 12992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:08 smithi044 bash[22676]: audit 2024-09-21T04:30:07.587480+0000 mgr.a (mgr.14388) 16262 : audit [DBG] from='client.351132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:08 smithi179 bash[23186]: audit 2024-09-21T04:30:07.587480+0000 mgr.a (mgr.14388) 16262 : audit [DBG] from='client.351132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:08 smithi049 bash[23528]: audit 2024-09-21T04:30:07.587480+0000 mgr.a (mgr.14388) 16262 : audit [DBG] from='client.351132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:09 smithi044 bash[22676]: cluster 2024-09-21T04:30:08.413090+0000 mgr.a (mgr.14388) 16263 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:09 smithi179 bash[23186]: cluster 2024-09-21T04:30:08.413090+0000 mgr.a (mgr.14388) 16263 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:09 smithi049 bash[23528]: cluster 2024-09-21T04:30:08.413090+0000 mgr.a (mgr.14388) 16263 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:11 smithi044 bash[22676]: cluster 2024-09-21T04:30:10.415269+0000 mgr.a (mgr.14388) 16264 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:11 smithi179 bash[23186]: cluster 2024-09-21T04:30:10.415269+0000 mgr.a (mgr.14388) 16264 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:11 smithi049 bash[23528]: cluster 2024-09-21T04:30:10.415269+0000 mgr.a (mgr.14388) 16264 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:30:13.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:13.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:13.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:13.805 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:13.805 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:13.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:13.806 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:13 smithi044 bash[22676]: cluster 2024-09-21T04:30:12.416043+0000 mgr.a (mgr.14388) 16265 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:13 smithi179 bash[23186]: cluster 2024-09-21T04:30:12.416043+0000 mgr.a (mgr.14388) 16265 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:13 smithi049 bash[23528]: cluster 2024-09-21T04:30:12.416043+0000 mgr.a (mgr.14388) 16265 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:14 smithi044 bash[22676]: audit 2024-09-21T04:30:13.349898+0000 mgr.a (mgr.14388) 16266 : audit [DBG] from='client.351204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:14 smithi179 bash[23186]: audit 2024-09-21T04:30:13.349898+0000 mgr.a (mgr.14388) 16266 : audit [DBG] from='client.351204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:14 smithi049 bash[23528]: audit 2024-09-21T04:30:13.349898+0000 mgr.a (mgr.14388) 16266 : audit [DBG] from='client.351204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:15 smithi044 bash[22676]: cluster 2024-09-21T04:30:14.417053+0000 mgr.a (mgr.14388) 16267 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:15 smithi044 bash[22676]: audit 2024-09-21T04:30:15.636796+0000 mon.a (mon.0) 12993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:15 smithi044 bash[22676]: audit 2024-09-21T04:30:15.647262+0000 mon.a (mon.0) 12994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:15 smithi044 bash[22676]: audit 2024-09-21T04:30:15.659696+0000 mon.a (mon.0) 12995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:15 smithi179 bash[23186]: cluster 2024-09-21T04:30:14.417053+0000 mgr.a (mgr.14388) 16267 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:15 smithi179 bash[23186]: audit 2024-09-21T04:30:15.636796+0000 mon.a (mon.0) 12993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:15 smithi179 bash[23186]: audit 2024-09-21T04:30:15.647262+0000 mon.a (mon.0) 12994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:15 smithi179 bash[23186]: audit 2024-09-21T04:30:15.659696+0000 mon.a (mon.0) 12995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:15 smithi049 bash[23528]: cluster 2024-09-21T04:30:14.417053+0000 mgr.a (mgr.14388) 16267 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:15 smithi049 bash[23528]: audit 2024-09-21T04:30:15.636796+0000 mon.a (mon.0) 12993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:15 smithi049 bash[23528]: audit 2024-09-21T04:30:15.647262+0000 mon.a (mon.0) 12994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:15 smithi049 bash[23528]: audit 2024-09-21T04:30:15.659696+0000 mon.a (mon.0) 12995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:17 smithi049 bash[23528]: cluster 2024-09-21T04:30:16.419331+0000 mgr.a (mgr.14388) 16268 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:17 smithi044 bash[22676]: cluster 2024-09-21T04:30:16.419331+0000 mgr.a (mgr.14388) 16268 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:17 smithi179 bash[23186]: cluster 2024-09-21T04:30:16.419331+0000 mgr.a (mgr.14388) 16268 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:18.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:18.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:18.808 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:19.557 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:19.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:19.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:19.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:19.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:19 smithi049 bash[23528]: cluster 2024-09-21T04:30:18.420116+0000 mgr.a (mgr.14388) 16269 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:19 smithi049 bash[23528]: audit 2024-09-21T04:30:19.139103+0000 mgr.a (mgr.14388) 16270 : audit [DBG] from='client.351282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:19 smithi044 bash[22676]: cluster 2024-09-21T04:30:18.420116+0000 mgr.a (mgr.14388) 16269 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:19 smithi044 bash[22676]: audit 2024-09-21T04:30:19.139103+0000 mgr.a (mgr.14388) 16270 : audit [DBG] from='client.351282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:19 smithi179 bash[23186]: cluster 2024-09-21T04:30:18.420116+0000 mgr.a (mgr.14388) 16269 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:19 smithi179 bash[23186]: audit 2024-09-21T04:30:19.139103+0000 mgr.a (mgr.14388) 16270 : audit [DBG] from='client.351282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:21 smithi044 bash[22676]: cluster 2024-09-21T04:30:20.422528+0000 mgr.a (mgr.14388) 16271 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:21 smithi179 bash[23186]: cluster 2024-09-21T04:30:20.422528+0000 mgr.a (mgr.14388) 16271 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:21 smithi049 bash[23528]: cluster 2024-09-21T04:30:20.422528+0000 mgr.a (mgr.14388) 16271 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:23 smithi044 bash[22676]: cluster 2024-09-21T04:30:22.423277+0000 mgr.a (mgr.14388) 16272 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:23 smithi179 bash[23186]: cluster 2024-09-21T04:30:22.423277+0000 mgr.a (mgr.14388) 16272 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:23 smithi049 bash[23528]: cluster 2024-09-21T04:30:22.423277+0000 mgr.a (mgr.14388) 16272 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:24.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:24.559 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:24.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:25.329 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:25.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:25.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:25.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:25.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:25 smithi044 bash[22676]: cluster 2024-09-21T04:30:24.424115+0000 mgr.a (mgr.14388) 16273 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:25 smithi044 bash[22676]: audit 2024-09-21T04:30:24.890965+0000 mgr.a (mgr.14388) 16274 : audit [DBG] from='client.351360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:25 smithi179 bash[23186]: cluster 2024-09-21T04:30:24.424115+0000 mgr.a (mgr.14388) 16273 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:25 smithi179 bash[23186]: audit 2024-09-21T04:30:24.890965+0000 mgr.a (mgr.14388) 16274 : audit [DBG] from='client.351360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:25 smithi049 bash[23528]: cluster 2024-09-21T04:30:24.424115+0000 mgr.a (mgr.14388) 16273 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:25 smithi049 bash[23528]: audit 2024-09-21T04:30:24.890965+0000 mgr.a (mgr.14388) 16274 : audit [DBG] from='client.351360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:27 smithi044 bash[22676]: cluster 2024-09-21T04:30:26.426956+0000 mgr.a (mgr.14388) 16275 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:30:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:27 smithi044 bash[22676]: audit 2024-09-21T04:30:26.914055+0000 mon.a (mon.0) 12996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:27 smithi044 bash[22676]: audit 2024-09-21T04:30:26.922186+0000 mon.a (mon.0) 12997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:27 smithi044 bash[22676]: audit 2024-09-21T04:30:26.933992+0000 mon.a (mon.0) 12998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:27 smithi044 bash[22676]: audit 2024-09-21T04:30:27.092686+0000 mon.a (mon.0) 12999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:27 smithi044 bash[22676]: audit 2024-09-21T04:30:27.101223+0000 mon.a (mon.0) 13000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:27 smithi044 bash[22676]: audit 2024-09-21T04:30:27.111430+0000 mon.a (mon.0) 13001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:27 smithi179 bash[23186]: cluster 2024-09-21T04:30:26.426956+0000 mgr.a (mgr.14388) 16275 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:30:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:27 smithi179 bash[23186]: audit 2024-09-21T04:30:26.914055+0000 mon.a (mon.0) 12996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:27 smithi179 bash[23186]: audit 2024-09-21T04:30:26.922186+0000 mon.a (mon.0) 12997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:27 smithi179 bash[23186]: audit 2024-09-21T04:30:26.933992+0000 mon.a (mon.0) 12998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:27 smithi179 bash[23186]: audit 2024-09-21T04:30:27.092686+0000 mon.a (mon.0) 12999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:27 smithi179 bash[23186]: audit 2024-09-21T04:30:27.101223+0000 mon.a (mon.0) 13000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:27 smithi179 bash[23186]: audit 2024-09-21T04:30:27.111430+0000 mon.a (mon.0) 13001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:27 smithi049 bash[23528]: cluster 2024-09-21T04:30:26.426956+0000 mgr.a (mgr.14388) 16275 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:27 smithi049 bash[23528]: audit 2024-09-21T04:30:26.914055+0000 mon.a (mon.0) 12996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:27 smithi049 bash[23528]: audit 2024-09-21T04:30:26.922186+0000 mon.a (mon.0) 12997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:27 smithi049 bash[23528]: audit 2024-09-21T04:30:26.933992+0000 mon.a (mon.0) 12998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:27 smithi049 bash[23528]: audit 2024-09-21T04:30:27.092686+0000 mon.a (mon.0) 12999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:27 smithi049 bash[23528]: audit 2024-09-21T04:30:27.101223+0000 mon.a (mon.0) 13000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:27 smithi049 bash[23528]: audit 2024-09-21T04:30:27.111430+0000 mon.a (mon.0) 13001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:29 smithi044 bash[22676]: cluster 2024-09-21T04:30:28.427764+0000 mgr.a (mgr.14388) 16276 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:30:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:29 smithi179 bash[23186]: cluster 2024-09-21T04:30:28.427764+0000 mgr.a (mgr.14388) 16276 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:30:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:29 smithi049 bash[23528]: cluster 2024-09-21T04:30:28.427764+0000 mgr.a (mgr.14388) 16276 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:30:30.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:30.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:30.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:31 smithi044 bash[22676]: cluster 2024-09-21T04:30:30.429081+0000 mgr.a (mgr.14388) 16277 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:31 smithi044 bash[22676]: audit 2024-09-21T04:30:30.663224+0000 mgr.a (mgr.14388) 16278 : audit [DBG] from='client.351432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:31 smithi179 bash[23186]: cluster 2024-09-21T04:30:30.429081+0000 mgr.a (mgr.14388) 16277 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:31 smithi179 bash[23186]: audit 2024-09-21T04:30:30.663224+0000 mgr.a (mgr.14388) 16278 : audit [DBG] from='client.351432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:31 smithi049 bash[23528]: cluster 2024-09-21T04:30:30.429081+0000 mgr.a (mgr.14388) 16277 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:31 smithi049 bash[23528]: audit 2024-09-21T04:30:30.663224+0000 mgr.a (mgr.14388) 16278 : audit [DBG] from='client.351432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:33 smithi044 bash[22676]: cluster 2024-09-21T04:30:32.429952+0000 mgr.a (mgr.14388) 16279 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:30:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:33 smithi179 bash[23186]: cluster 2024-09-21T04:30:32.429952+0000 mgr.a (mgr.14388) 16279 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:30:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:33 smithi049 bash[23528]: cluster 2024-09-21T04:30:32.429952+0000 mgr.a (mgr.14388) 16279 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:30:36.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:36.094 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:36.094 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:35 smithi044 bash[22676]: cluster 2024-09-21T04:30:34.430756+0000 mgr.a (mgr.14388) 16280 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:30:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:35 smithi044 bash[22676]: audit 2024-09-21T04:30:35.857386+0000 mon.a (mon.0) 13002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:35 smithi044 bash[22676]: audit 2024-09-21T04:30:35.866036+0000 mon.a (mon.0) 13003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:35 smithi044 bash[22676]: audit 2024-09-21T04:30:35.876770+0000 mon.a (mon.0) 13004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:35 smithi179 bash[23186]: cluster 2024-09-21T04:30:34.430756+0000 mgr.a (mgr.14388) 16280 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:30:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:35 smithi179 bash[23186]: audit 2024-09-21T04:30:35.857386+0000 mon.a (mon.0) 13002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:35 smithi179 bash[23186]: audit 2024-09-21T04:30:35.866036+0000 mon.a (mon.0) 13003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:35 smithi179 bash[23186]: audit 2024-09-21T04:30:35.876770+0000 mon.a (mon.0) 13004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:35 smithi049 bash[23528]: cluster 2024-09-21T04:30:34.430756+0000 mgr.a (mgr.14388) 16280 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:30:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:35 smithi049 bash[23528]: audit 2024-09-21T04:30:35.857386+0000 mon.a (mon.0) 13002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:35 smithi049 bash[23528]: audit 2024-09-21T04:30:35.866036+0000 mon.a (mon.0) 13003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:35 smithi049 bash[23528]: audit 2024-09-21T04:30:35.876770+0000 mon.a (mon.0) 13004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:36.839 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:37 smithi049 bash[23528]: audit 2024-09-21T04:30:36.423396+0000 mgr.a (mgr.14388) 16281 : audit [DBG] from='client.351510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:37 smithi049 bash[23528]: cluster 2024-09-21T04:30:36.436164+0000 mgr.a (mgr.14388) 16282 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:37 smithi044 bash[22676]: audit 2024-09-21T04:30:36.423396+0000 mgr.a (mgr.14388) 16281 : audit [DBG] from='client.351510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:38.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:37 smithi044 bash[22676]: cluster 2024-09-21T04:30:36.436164+0000 mgr.a (mgr.14388) 16282 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:37 smithi179 bash[23186]: audit 2024-09-21T04:30:36.423396+0000 mgr.a (mgr.14388) 16281 : audit [DBG] from='client.351510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:37 smithi179 bash[23186]: cluster 2024-09-21T04:30:36.436164+0000 mgr.a (mgr.14388) 16282 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:39 smithi049 bash[23528]: cluster 2024-09-21T04:30:38.437193+0000 mgr.a (mgr.14388) 16283 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:30:40.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:39 smithi044 bash[22676]: cluster 2024-09-21T04:30:38.437193+0000 mgr.a (mgr.14388) 16283 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:30:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:39 smithi179 bash[23186]: cluster 2024-09-21T04:30:38.437193+0000 mgr.a (mgr.14388) 16283 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:30:41.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:41.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:41.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:41 smithi044 bash[22676]: cluster 2024-09-21T04:30:40.439410+0000 mgr.a (mgr.14388) 16284 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:41 smithi179 bash[23186]: cluster 2024-09-21T04:30:40.439410+0000 mgr.a (mgr.14388) 16284 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:41 smithi049 bash[23528]: cluster 2024-09-21T04:30:40.439410+0000 mgr.a (mgr.14388) 16284 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:42.617 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:42.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:42.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:42.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:42.617 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:42 smithi044 bash[22676]: audit 2024-09-21T04:30:42.186341+0000 mgr.a (mgr.14388) 16285 : audit [DBG] from='client.351588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:42 smithi179 bash[23186]: audit 2024-09-21T04:30:42.186341+0000 mgr.a (mgr.14388) 16285 : audit [DBG] from='client.351588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:42 smithi049 bash[23528]: audit 2024-09-21T04:30:42.186341+0000 mgr.a (mgr.14388) 16285 : audit [DBG] from='client.351588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:43 smithi044 bash[22676]: cluster 2024-09-21T04:30:42.439970+0000 mgr.a (mgr.14388) 16286 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:43 smithi179 bash[23186]: cluster 2024-09-21T04:30:42.439970+0000 mgr.a (mgr.14388) 16286 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:43 smithi049 bash[23528]: cluster 2024-09-21T04:30:42.439970+0000 mgr.a (mgr.14388) 16286 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:45 smithi044 bash[22676]: cluster 2024-09-21T04:30:44.440574+0000 mgr.a (mgr.14388) 16287 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:45 smithi179 bash[23186]: cluster 2024-09-21T04:30:44.440574+0000 mgr.a (mgr.14388) 16287 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:45 smithi049 bash[23528]: cluster 2024-09-21T04:30:44.440574+0000 mgr.a (mgr.14388) 16287 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:47.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:47.619 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:47.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:48 smithi179 bash[23186]: cluster 2024-09-21T04:30:46.442838+0000 mgr.a (mgr.14388) 16288 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:48 smithi179 bash[23186]: audit 2024-09-21T04:30:47.143316+0000 mon.a (mon.0) 13005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:48 smithi179 bash[23186]: audit 2024-09-21T04:30:47.152154+0000 mon.a (mon.0) 13006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:48 smithi179 bash[23186]: audit 2024-09-21T04:30:47.163008+0000 mon.a (mon.0) 13007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:48 smithi179 bash[23186]: audit 2024-09-21T04:30:47.284162+0000 mon.a (mon.0) 13008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:48 smithi179 bash[23186]: audit 2024-09-21T04:30:47.292949+0000 mon.a (mon.0) 13009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:48 smithi179 bash[23186]: audit 2024-09-21T04:30:47.304711+0000 mon.a (mon.0) 13010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.398 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:48.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:48 smithi044 bash[22676]: cluster 2024-09-21T04:30:46.442838+0000 mgr.a (mgr.14388) 16288 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:48 smithi044 bash[22676]: audit 2024-09-21T04:30:47.143316+0000 mon.a (mon.0) 13005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:48 smithi044 bash[22676]: audit 2024-09-21T04:30:47.152154+0000 mon.a (mon.0) 13006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:48 smithi044 bash[22676]: audit 2024-09-21T04:30:47.163008+0000 mon.a (mon.0) 13007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:48 smithi044 bash[22676]: audit 2024-09-21T04:30:47.284162+0000 mon.a (mon.0) 13008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:48 smithi044 bash[22676]: audit 2024-09-21T04:30:47.292949+0000 mon.a (mon.0) 13009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:48 smithi044 bash[22676]: audit 2024-09-21T04:30:47.304711+0000 mon.a (mon.0) 13010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:48 smithi049 bash[23528]: cluster 2024-09-21T04:30:46.442838+0000 mgr.a (mgr.14388) 16288 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:48 smithi049 bash[23528]: audit 2024-09-21T04:30:47.143316+0000 mon.a (mon.0) 13005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:48 smithi049 bash[23528]: audit 2024-09-21T04:30:47.152154+0000 mon.a (mon.0) 13006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:48 smithi049 bash[23528]: audit 2024-09-21T04:30:47.163008+0000 mon.a (mon.0) 13007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:48 smithi049 bash[23528]: audit 2024-09-21T04:30:47.284162+0000 mon.a (mon.0) 13008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:48 smithi049 bash[23528]: audit 2024-09-21T04:30:47.292949+0000 mon.a (mon.0) 13009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:48.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:48 smithi049 bash[23528]: audit 2024-09-21T04:30:47.304711+0000 mon.a (mon.0) 13010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:49 smithi044 bash[22676]: audit 2024-09-21T04:30:47.950669+0000 mgr.a (mgr.14388) 16289 : audit [DBG] from='client.351666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:49 smithi179 bash[23186]: audit 2024-09-21T04:30:47.950669+0000 mgr.a (mgr.14388) 16289 : audit [DBG] from='client.351666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:49 smithi049 bash[23528]: audit 2024-09-21T04:30:47.950669+0000 mgr.a (mgr.14388) 16289 : audit [DBG] from='client.351666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:50 smithi044 bash[22676]: cluster 2024-09-21T04:30:48.443494+0000 mgr.a (mgr.14388) 16290 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:50 smithi179 bash[23186]: cluster 2024-09-21T04:30:48.443494+0000 mgr.a (mgr.14388) 16290 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:50 smithi049 bash[23528]: cluster 2024-09-21T04:30:48.443494+0000 mgr.a (mgr.14388) 16290 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:52 smithi044 bash[22676]: cluster 2024-09-21T04:30:50.445803+0000 mgr.a (mgr.14388) 16291 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:52 smithi179 bash[23186]: cluster 2024-09-21T04:30:50.445803+0000 mgr.a (mgr.14388) 16291 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:52.509 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:52 smithi049 bash[23528]: cluster 2024-09-21T04:30:50.445803+0000 mgr.a (mgr.14388) 16291 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:53.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:53.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:53.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:54.158 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:54.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:54.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:54.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:54.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:30:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:54 smithi044 bash[22676]: cluster 2024-09-21T04:30:52.446556+0000 mgr.a (mgr.14388) 16292 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:54 smithi179 bash[23186]: cluster 2024-09-21T04:30:52.446556+0000 mgr.a (mgr.14388) 16292 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:54 smithi049 bash[23528]: cluster 2024-09-21T04:30:52.446556+0000 mgr.a (mgr.14388) 16292 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:55 smithi044 bash[22676]: audit 2024-09-21T04:30:53.726743+0000 mgr.a (mgr.14388) 16293 : audit [DBG] from='client.351741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:55 smithi179 bash[23186]: audit 2024-09-21T04:30:53.726743+0000 mgr.a (mgr.14388) 16293 : audit [DBG] from='client.351741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:55 smithi049 bash[23528]: audit 2024-09-21T04:30:53.726743+0000 mgr.a (mgr.14388) 16293 : audit [DBG] from='client.351741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:30:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:56 smithi044 bash[22676]: cluster 2024-09-21T04:30:54.447531+0000 mgr.a (mgr.14388) 16294 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:56 smithi044 bash[22676]: audit 2024-09-21T04:30:56.093704+0000 mon.a (mon.0) 13011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:56 smithi044 bash[22676]: audit 2024-09-21T04:30:56.103762+0000 mon.a (mon.0) 13012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:56 smithi044 bash[22676]: audit 2024-09-21T04:30:56.115494+0000 mon.a (mon.0) 13013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:56 smithi179 bash[23186]: cluster 2024-09-21T04:30:54.447531+0000 mgr.a (mgr.14388) 16294 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:56 smithi179 bash[23186]: audit 2024-09-21T04:30:56.093704+0000 mon.a (mon.0) 13011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:56 smithi179 bash[23186]: audit 2024-09-21T04:30:56.103762+0000 mon.a (mon.0) 13012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:56 smithi179 bash[23186]: audit 2024-09-21T04:30:56.115494+0000 mon.a (mon.0) 13013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:56 smithi049 bash[23528]: cluster 2024-09-21T04:30:54.447531+0000 mgr.a (mgr.14388) 16294 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:30:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:56 smithi049 bash[23528]: audit 2024-09-21T04:30:56.093704+0000 mon.a (mon.0) 13011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:56 smithi049 bash[23528]: audit 2024-09-21T04:30:56.103762+0000 mon.a (mon.0) 13012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:56 smithi049 bash[23528]: audit 2024-09-21T04:30:56.115494+0000 mon.a (mon.0) 13013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:58 smithi044 bash[22676]: cluster 2024-09-21T04:30:56.449843+0000 mgr.a (mgr.14388) 16295 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:58 smithi179 bash[23186]: cluster 2024-09-21T04:30:56.449843+0000 mgr.a (mgr.14388) 16295 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:58 smithi049 bash[23528]: cluster 2024-09-21T04:30:56.449843+0000 mgr.a (mgr.14388) 16295 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:30:59.159 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:30:59.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:30:59.160 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:30:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:59 smithi044 bash[22676]: audit 2024-09-21T04:30:58.586345+0000 mon.a (mon.0) 13014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:30:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:59 smithi044 bash[22676]: audit 2024-09-21T04:30:58.592957+0000 mon.a (mon.0) 13015 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:30:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:59 smithi044 bash[22676]: audit 2024-09-21T04:30:58.594782+0000 mon.a (mon.0) 13016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:30:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:59 smithi044 bash[22676]: audit 2024-09-21T04:30:58.607270+0000 mon.a (mon.0) 13017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:30:59 smithi044 bash[22676]: audit 2024-09-21T04:30:58.613496+0000 mon.a (mon.0) 13018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:30:59.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:30:59 smithi044 bash[22930]: debug 2024-09-21T04:30:59.388+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:30:59.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:30:59 smithi044 bash[22930]: debug 2024-09-21T04:30:59.388+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:59 smithi179 bash[23186]: audit 2024-09-21T04:30:58.586345+0000 mon.a (mon.0) 13014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:59 smithi179 bash[23186]: audit 2024-09-21T04:30:58.592957+0000 mon.a (mon.0) 13015 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:59 smithi179 bash[23186]: audit 2024-09-21T04:30:58.594782+0000 mon.a (mon.0) 13016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:59 smithi179 bash[23186]: audit 2024-09-21T04:30:58.607270+0000 mon.a (mon.0) 13017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:59.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:30:59 smithi179 bash[23186]: audit 2024-09-21T04:30:58.613496+0000 mon.a (mon.0) 13018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:30:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:59 smithi049 bash[23528]: audit 2024-09-21T04:30:58.586345+0000 mon.a (mon.0) 13014 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:30:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:59 smithi049 bash[23528]: audit 2024-09-21T04:30:58.592957+0000 mon.a (mon.0) 13015 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:30:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:59 smithi049 bash[23528]: audit 2024-09-21T04:30:58.594782+0000 mon.a (mon.0) 13016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:30:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:59 smithi049 bash[23528]: audit 2024-09-21T04:30:58.607270+0000 mon.a (mon.0) 13017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:30:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:30:59 smithi049 bash[23528]: audit 2024-09-21T04:30:58.613496+0000 mon.a (mon.0) 13018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:30:59.942 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:30:59.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:30:59.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:30:59.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:30:59.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:00 smithi044 bash[22676]: cluster 2024-09-21T04:30:58.450612+0000 mgr.a (mgr.14388) 16296 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:00 smithi044 bash[22676]: audit 2024-09-21T04:30:58.615901+0000 mgr.a (mgr.14388) 16297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:31:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:00 smithi179 bash[23186]: cluster 2024-09-21T04:30:58.450612+0000 mgr.a (mgr.14388) 16296 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:00 smithi179 bash[23186]: audit 2024-09-21T04:30:58.615901+0000 mgr.a (mgr.14388) 16297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:31:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:00 smithi049 bash[23528]: cluster 2024-09-21T04:30:58.450612+0000 mgr.a (mgr.14388) 16296 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:00 smithi049 bash[23528]: audit 2024-09-21T04:30:58.615901+0000 mgr.a (mgr.14388) 16297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:31:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:01 smithi044 bash[22676]: audit 2024-09-21T04:30:59.391654+0000 mgr.a (mgr.14388) 16298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:31:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:01 smithi044 bash[22676]: cephadm 2024-09-21T04:30:59.392887+0000 mgr.a (mgr.14388) 16299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:31:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:01 smithi044 bash[22676]: audit 2024-09-21T04:30:59.502230+0000 mgr.a (mgr.14388) 16300 : audit [DBG] from='client.351903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:01 smithi179 bash[23186]: audit 2024-09-21T04:30:59.391654+0000 mgr.a (mgr.14388) 16298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:31:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:01 smithi179 bash[23186]: cephadm 2024-09-21T04:30:59.392887+0000 mgr.a (mgr.14388) 16299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:31:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:01 smithi179 bash[23186]: audit 2024-09-21T04:30:59.502230+0000 mgr.a (mgr.14388) 16300 : audit [DBG] from='client.351903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:01 smithi049 bash[23528]: audit 2024-09-21T04:30:59.391654+0000 mgr.a (mgr.14388) 16298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:31:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:01 smithi049 bash[23528]: cephadm 2024-09-21T04:30:59.392887+0000 mgr.a (mgr.14388) 16299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:31:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:01 smithi049 bash[23528]: audit 2024-09-21T04:30:59.502230+0000 mgr.a (mgr.14388) 16300 : audit [DBG] from='client.351903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:02 smithi049 bash[23528]: cluster 2024-09-21T04:31:00.452060+0000 mgr.a (mgr.14388) 16301 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:02 smithi044 bash[22676]: cluster 2024-09-21T04:31:00.452060+0000 mgr.a (mgr.14388) 16301 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:02 smithi179 bash[23186]: cluster 2024-09-21T04:31:00.452060+0000 mgr.a (mgr.14388) 16301 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:04 smithi044 bash[22676]: cluster 2024-09-21T04:31:02.452793+0000 mgr.a (mgr.14388) 16302 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:04 smithi179 bash[23186]: cluster 2024-09-21T04:31:02.452793+0000 mgr.a (mgr.14388) 16302 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:04 smithi049 bash[23528]: cluster 2024-09-21T04:31:02.452793+0000 mgr.a (mgr.14388) 16302 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:04.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:04.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:05 smithi049 bash[23528]: cluster 2024-09-21T04:31:04.453613+0000 mgr.a (mgr.14388) 16303 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:05.730 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:05.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:05.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:05.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:05.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:05 smithi044 bash[22676]: cluster 2024-09-21T04:31:04.453613+0000 mgr.a (mgr.14388) 16303 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:05 smithi179 bash[23186]: cluster 2024-09-21T04:31:04.453613+0000 mgr.a (mgr.14388) 16303 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:06 smithi049 bash[23528]: audit 2024-09-21T04:31:05.277175+0000 mgr.a (mgr.14388) 16304 : audit [DBG] from='client.351993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:06.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:06 smithi044 bash[22676]: audit 2024-09-21T04:31:05.277175+0000 mgr.a (mgr.14388) 16304 : audit [DBG] from='client.351993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:06 smithi179 bash[23186]: audit 2024-09-21T04:31:05.277175+0000 mgr.a (mgr.14388) 16304 : audit [DBG] from='client.351993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:07.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:07 smithi179 bash[23186]: cluster 2024-09-21T04:31:06.456695+0000 mgr.a (mgr.14388) 16305 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:07 smithi049 bash[23528]: cluster 2024-09-21T04:31:06.456695+0000 mgr.a (mgr.14388) 16305 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:07 smithi044 bash[22676]: cluster 2024-09-21T04:31:06.456695+0000 mgr.a (mgr.14388) 16305 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:08 smithi044 bash[22676]: audit 2024-09-21T04:31:07.388262+0000 mon.a (mon.0) 13019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:08 smithi044 bash[22676]: audit 2024-09-21T04:31:07.398518+0000 mon.a (mon.0) 13020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:08 smithi044 bash[22676]: audit 2024-09-21T04:31:07.410232+0000 mon.a (mon.0) 13021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:08 smithi044 bash[22676]: audit 2024-09-21T04:31:07.511797+0000 mon.a (mon.0) 13022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:08 smithi044 bash[22676]: audit 2024-09-21T04:31:07.522040+0000 mon.a (mon.0) 13023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:08 smithi044 bash[22676]: audit 2024-09-21T04:31:07.533867+0000 mon.a (mon.0) 13024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:08 smithi179 bash[23186]: audit 2024-09-21T04:31:07.388262+0000 mon.a (mon.0) 13019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:08 smithi179 bash[23186]: audit 2024-09-21T04:31:07.398518+0000 mon.a (mon.0) 13020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:08 smithi179 bash[23186]: audit 2024-09-21T04:31:07.410232+0000 mon.a (mon.0) 13021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:08 smithi179 bash[23186]: audit 2024-09-21T04:31:07.511797+0000 mon.a (mon.0) 13022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:08 smithi179 bash[23186]: audit 2024-09-21T04:31:07.522040+0000 mon.a (mon.0) 13023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:08 smithi179 bash[23186]: audit 2024-09-21T04:31:07.533867+0000 mon.a (mon.0) 13024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:08 smithi049 bash[23528]: audit 2024-09-21T04:31:07.388262+0000 mon.a (mon.0) 13019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:08 smithi049 bash[23528]: audit 2024-09-21T04:31:07.398518+0000 mon.a (mon.0) 13020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:08 smithi049 bash[23528]: audit 2024-09-21T04:31:07.410232+0000 mon.a (mon.0) 13021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:08 smithi049 bash[23528]: audit 2024-09-21T04:31:07.511797+0000 mon.a (mon.0) 13022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:08 smithi049 bash[23528]: audit 2024-09-21T04:31:07.522040+0000 mon.a (mon.0) 13023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:08 smithi049 bash[23528]: audit 2024-09-21T04:31:07.533867+0000 mon.a (mon.0) 13024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:09.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:09 smithi044 bash[22676]: cluster 2024-09-21T04:31:08.457701+0000 mgr.a (mgr.14388) 16306 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:31:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:09 smithi179 bash[23186]: cluster 2024-09-21T04:31:08.457701+0000 mgr.a (mgr.14388) 16306 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:31:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:09 smithi049 bash[23528]: cluster 2024-09-21T04:31:08.457701+0000 mgr.a (mgr.14388) 16306 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:31:10.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:10.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:10.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:11.518 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:11.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:11.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:11.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:11 smithi049 bash[23528]: cluster 2024-09-21T04:31:10.459664+0000 mgr.a (mgr.14388) 16307 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:11 smithi049 bash[23528]: audit 2024-09-21T04:31:11.071115+0000 mgr.a (mgr.14388) 16308 : audit [DBG] from='client.352065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:11 smithi044 bash[22676]: cluster 2024-09-21T04:31:10.459664+0000 mgr.a (mgr.14388) 16307 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:11 smithi044 bash[22676]: audit 2024-09-21T04:31:11.071115+0000 mgr.a (mgr.14388) 16308 : audit [DBG] from='client.352065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:11 smithi179 bash[23186]: cluster 2024-09-21T04:31:10.459664+0000 mgr.a (mgr.14388) 16307 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:31:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:11 smithi179 bash[23186]: audit 2024-09-21T04:31:11.071115+0000 mgr.a (mgr.14388) 16308 : audit [DBG] from='client.352065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:13 smithi049 bash[23528]: cluster 2024-09-21T04:31:12.460608+0000 mgr.a (mgr.14388) 16309 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:31:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:13 smithi044 bash[22676]: cluster 2024-09-21T04:31:12.460608+0000 mgr.a (mgr.14388) 16309 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:31:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:13 smithi179 bash[23186]: cluster 2024-09-21T04:31:12.460608+0000 mgr.a (mgr.14388) 16309 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:31:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:15 smithi049 bash[23528]: cluster 2024-09-21T04:31:14.461570+0000 mgr.a (mgr.14388) 16310 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:31:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:15 smithi044 bash[22676]: cluster 2024-09-21T04:31:14.461570+0000 mgr.a (mgr.14388) 16310 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:31:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:15 smithi179 bash[23186]: cluster 2024-09-21T04:31:14.461570+0000 mgr.a (mgr.14388) 16310 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:31:16.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:16.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:16.521 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:17.308 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:17.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:17.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:17.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:17.309 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:17 smithi044 bash[22676]: audit 2024-09-21T04:31:16.330287+0000 mon.a (mon.0) 13025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:17 smithi044 bash[22676]: audit 2024-09-21T04:31:16.338933+0000 mon.a (mon.0) 13026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:17 smithi044 bash[22676]: audit 2024-09-21T04:31:16.349332+0000 mon.a (mon.0) 13027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:17 smithi044 bash[22676]: cluster 2024-09-21T04:31:16.463809+0000 mgr.a (mgr.14388) 16311 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:17 smithi044 bash[22676]: audit 2024-09-21T04:31:16.858850+0000 mgr.a (mgr.14388) 16312 : audit [DBG] from='client.352140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:17 smithi179 bash[23186]: audit 2024-09-21T04:31:16.330287+0000 mon.a (mon.0) 13025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:17 smithi179 bash[23186]: audit 2024-09-21T04:31:16.338933+0000 mon.a (mon.0) 13026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:17 smithi179 bash[23186]: audit 2024-09-21T04:31:16.349332+0000 mon.a (mon.0) 13027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:17 smithi179 bash[23186]: cluster 2024-09-21T04:31:16.463809+0000 mgr.a (mgr.14388) 16311 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:17.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:17 smithi179 bash[23186]: audit 2024-09-21T04:31:16.858850+0000 mgr.a (mgr.14388) 16312 : audit [DBG] from='client.352140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:17 smithi049 bash[23528]: audit 2024-09-21T04:31:16.330287+0000 mon.a (mon.0) 13025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:17 smithi049 bash[23528]: audit 2024-09-21T04:31:16.338933+0000 mon.a (mon.0) 13026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:17 smithi049 bash[23528]: audit 2024-09-21T04:31:16.349332+0000 mon.a (mon.0) 13027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:17 smithi049 bash[23528]: cluster 2024-09-21T04:31:16.463809+0000 mgr.a (mgr.14388) 16311 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:17 smithi049 bash[23528]: audit 2024-09-21T04:31:16.858850+0000 mgr.a (mgr.14388) 16312 : audit [DBG] from='client.352140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:19.799 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:19 smithi049 bash[23528]: cluster 2024-09-21T04:31:18.464772+0000 mgr.a (mgr.14388) 16313 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:19 smithi044 bash[22676]: cluster 2024-09-21T04:31:18.464772+0000 mgr.a (mgr.14388) 16313 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:19 smithi179 bash[23186]: cluster 2024-09-21T04:31:18.464772+0000 mgr.a (mgr.14388) 16313 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:21 smithi049 bash[23528]: cluster 2024-09-21T04:31:20.466166+0000 mgr.a (mgr.14388) 16314 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:21.926 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:21 smithi044 bash[22676]: cluster 2024-09-21T04:31:20.466166+0000 mgr.a (mgr.14388) 16314 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:21 smithi179 bash[23186]: cluster 2024-09-21T04:31:20.466166+0000 mgr.a (mgr.14388) 16314 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:22.310 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:22.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:22.311 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:23.075 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:23 smithi049 bash[23528]: cluster 2024-09-21T04:31:22.466683+0000 mgr.a (mgr.14388) 16315 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:23 smithi049 bash[23528]: audit 2024-09-21T04:31:22.643949+0000 mgr.a (mgr.14388) 16316 : audit [DBG] from='client.352218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:23 smithi044 bash[22676]: cluster 2024-09-21T04:31:22.466683+0000 mgr.a (mgr.14388) 16315 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:23 smithi044 bash[22676]: audit 2024-09-21T04:31:22.643949+0000 mgr.a (mgr.14388) 16316 : audit [DBG] from='client.352218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:23 smithi179 bash[23186]: cluster 2024-09-21T04:31:22.466683+0000 mgr.a (mgr.14388) 16315 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:23 smithi179 bash[23186]: audit 2024-09-21T04:31:22.643949+0000 mgr.a (mgr.14388) 16316 : audit [DBG] from='client.352218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:25 smithi179 bash[23186]: cluster 2024-09-21T04:31:24.467491+0000 mgr.a (mgr.14388) 16317 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:25 smithi049 bash[23528]: cluster 2024-09-21T04:31:24.467491+0000 mgr.a (mgr.14388) 16317 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:25 smithi044 bash[22676]: cluster 2024-09-21T04:31:24.467491+0000 mgr.a (mgr.14388) 16317 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:27.718 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:27 smithi179 bash[23186]: cluster 2024-09-21T04:31:26.469813+0000 mgr.a (mgr.14388) 16318 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:27 smithi049 bash[23528]: cluster 2024-09-21T04:31:26.469813+0000 mgr.a (mgr.14388) 16318 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:27 smithi044 bash[22676]: cluster 2024-09-21T04:31:26.469813+0000 mgr.a (mgr.14388) 16318 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:28.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:28.077 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:28.077 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:28.881 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:28.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:28.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:28.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:28.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:28 smithi044 bash[22676]: audit 2024-09-21T04:31:27.634999+0000 mon.a (mon.0) 13028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:28 smithi044 bash[22676]: audit 2024-09-21T04:31:27.643661+0000 mon.a (mon.0) 13029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:28 smithi044 bash[22676]: audit 2024-09-21T04:31:27.654298+0000 mon.a (mon.0) 13030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:28 smithi044 bash[22676]: audit 2024-09-21T04:31:27.694893+0000 mon.a (mon.0) 13031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:28 smithi044 bash[22676]: audit 2024-09-21T04:31:27.703716+0000 mon.a (mon.0) 13032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:28 smithi044 bash[22676]: audit 2024-09-21T04:31:27.714209+0000 mon.a (mon.0) 13033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:28 smithi179 bash[23186]: audit 2024-09-21T04:31:27.634999+0000 mon.a (mon.0) 13028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:28 smithi179 bash[23186]: audit 2024-09-21T04:31:27.643661+0000 mon.a (mon.0) 13029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:28 smithi179 bash[23186]: audit 2024-09-21T04:31:27.654298+0000 mon.a (mon.0) 13030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:28 smithi179 bash[23186]: audit 2024-09-21T04:31:27.694893+0000 mon.a (mon.0) 13031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:28 smithi179 bash[23186]: audit 2024-09-21T04:31:27.703716+0000 mon.a (mon.0) 13032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:28 smithi179 bash[23186]: audit 2024-09-21T04:31:27.714209+0000 mon.a (mon.0) 13033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:28 smithi049 bash[23528]: audit 2024-09-21T04:31:27.634999+0000 mon.a (mon.0) 13028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:28 smithi049 bash[23528]: audit 2024-09-21T04:31:27.643661+0000 mon.a (mon.0) 13029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:28 smithi049 bash[23528]: audit 2024-09-21T04:31:27.654298+0000 mon.a (mon.0) 13030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:28 smithi049 bash[23528]: audit 2024-09-21T04:31:27.694893+0000 mon.a (mon.0) 13031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:28 smithi049 bash[23528]: audit 2024-09-21T04:31:27.703716+0000 mon.a (mon.0) 13032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:28 smithi049 bash[23528]: audit 2024-09-21T04:31:27.714209+0000 mon.a (mon.0) 13033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:29 smithi044 bash[22676]: audit 2024-09-21T04:31:28.416220+0000 mgr.a (mgr.14388) 16319 : audit [DBG] from='client.352296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:29 smithi044 bash[22676]: cluster 2024-09-21T04:31:28.471019+0000 mgr.a (mgr.14388) 16320 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:29 smithi179 bash[23186]: audit 2024-09-21T04:31:28.416220+0000 mgr.a (mgr.14388) 16319 : audit [DBG] from='client.352296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:29 smithi179 bash[23186]: cluster 2024-09-21T04:31:28.471019+0000 mgr.a (mgr.14388) 16320 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:29 smithi049 bash[23528]: audit 2024-09-21T04:31:28.416220+0000 mgr.a (mgr.14388) 16319 : audit [DBG] from='client.352296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:29 smithi049 bash[23528]: cluster 2024-09-21T04:31:28.471019+0000 mgr.a (mgr.14388) 16320 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:31 smithi044 bash[22676]: cluster 2024-09-21T04:31:30.473414+0000 mgr.a (mgr.14388) 16321 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:31 smithi179 bash[23186]: cluster 2024-09-21T04:31:30.473414+0000 mgr.a (mgr.14388) 16321 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:31 smithi049 bash[23528]: cluster 2024-09-21T04:31:30.473414+0000 mgr.a (mgr.14388) 16321 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:33 smithi044 bash[22676]: cluster 2024-09-21T04:31:32.474158+0000 mgr.a (mgr.14388) 16322 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:33 smithi179 bash[23186]: cluster 2024-09-21T04:31:32.474158+0000 mgr.a (mgr.14388) 16322 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:33 smithi049 bash[23528]: cluster 2024-09-21T04:31:32.474158+0000 mgr.a (mgr.14388) 16322 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:34.649 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:34.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:34.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:34.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:34.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:34 smithi044 bash[22676]: audit 2024-09-21T04:31:34.213571+0000 mgr.a (mgr.14388) 16323 : audit [DBG] from='client.352374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:34 smithi179 bash[23186]: audit 2024-09-21T04:31:34.213571+0000 mgr.a (mgr.14388) 16323 : audit [DBG] from='client.352374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:34 smithi049 bash[23528]: audit 2024-09-21T04:31:34.213571+0000 mgr.a (mgr.14388) 16323 : audit [DBG] from='client.352374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:35 smithi044 bash[22676]: cluster 2024-09-21T04:31:34.474720+0000 mgr.a (mgr.14388) 16324 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:35 smithi179 bash[23186]: cluster 2024-09-21T04:31:34.474720+0000 mgr.a (mgr.14388) 16324 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:35 smithi049 bash[23528]: cluster 2024-09-21T04:31:34.474720+0000 mgr.a (mgr.14388) 16324 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:37 smithi044 bash[22676]: cluster 2024-09-21T04:31:36.477338+0000 mgr.a (mgr.14388) 16325 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:37 smithi044 bash[22676]: audit 2024-09-21T04:31:36.554502+0000 mon.a (mon.0) 13034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:37 smithi044 bash[22676]: audit 2024-09-21T04:31:36.563201+0000 mon.a (mon.0) 13035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:37 smithi044 bash[22676]: audit 2024-09-21T04:31:36.573743+0000 mon.a (mon.0) 13036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:37 smithi179 bash[23186]: cluster 2024-09-21T04:31:36.477338+0000 mgr.a (mgr.14388) 16325 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:37 smithi179 bash[23186]: audit 2024-09-21T04:31:36.554502+0000 mon.a (mon.0) 13034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:37 smithi179 bash[23186]: audit 2024-09-21T04:31:36.563201+0000 mon.a (mon.0) 13035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:37 smithi179 bash[23186]: audit 2024-09-21T04:31:36.573743+0000 mon.a (mon.0) 13036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:37 smithi049 bash[23528]: cluster 2024-09-21T04:31:36.477338+0000 mgr.a (mgr.14388) 16325 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:37 smithi049 bash[23528]: audit 2024-09-21T04:31:36.554502+0000 mon.a (mon.0) 13034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:37 smithi049 bash[23528]: audit 2024-09-21T04:31:36.563201+0000 mon.a (mon.0) 13035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:37 smithi049 bash[23528]: audit 2024-09-21T04:31:36.573743+0000 mon.a (mon.0) 13036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:39.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:39.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:39.652 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:39 smithi179 bash[23186]: cluster 2024-09-21T04:31:38.477813+0000 mgr.a (mgr.14388) 16326 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:39 smithi044 bash[22676]: cluster 2024-09-21T04:31:38.477813+0000 mgr.a (mgr.14388) 16326 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:39.989 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:39 smithi049 bash[23528]: cluster 2024-09-21T04:31:38.477813+0000 mgr.a (mgr.14388) 16326 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:40.423 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:40 smithi049 bash[23528]: audit 2024-09-21T04:31:39.983522+0000 mgr.a (mgr.14388) 16327 : audit [DBG] from='client.352452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:40 smithi044 bash[22676]: audit 2024-09-21T04:31:39.983522+0000 mgr.a (mgr.14388) 16327 : audit [DBG] from='client.352452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:40 smithi179 bash[23186]: audit 2024-09-21T04:31:39.983522+0000 mgr.a (mgr.14388) 16327 : audit [DBG] from='client.352452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:41 smithi044 bash[22676]: cluster 2024-09-21T04:31:40.479126+0000 mgr.a (mgr.14388) 16328 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:41 smithi179 bash[23186]: cluster 2024-09-21T04:31:40.479126+0000 mgr.a (mgr.14388) 16328 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:41 smithi049 bash[23528]: cluster 2024-09-21T04:31:40.479126+0000 mgr.a (mgr.14388) 16328 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:43 smithi044 bash[22676]: cluster 2024-09-21T04:31:42.479864+0000 mgr.a (mgr.14388) 16329 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:43 smithi179 bash[23186]: cluster 2024-09-21T04:31:42.479864+0000 mgr.a (mgr.14388) 16329 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:43 smithi049 bash[23528]: cluster 2024-09-21T04:31:42.479864+0000 mgr.a (mgr.14388) 16329 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:45.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:45.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:45.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:45.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:45 smithi179 bash[23186]: cluster 2024-09-21T04:31:44.480438+0000 mgr.a (mgr.14388) 16330 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:45 smithi044 bash[22676]: cluster 2024-09-21T04:31:44.480438+0000 mgr.a (mgr.14388) 16330 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:45 smithi049 bash[23528]: cluster 2024-09-21T04:31:44.480438+0000 mgr.a (mgr.14388) 16330 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:46.211 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:46.910 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:46 smithi179 bash[23186]: audit 2024-09-21T04:31:45.757659+0000 mgr.a (mgr.14388) 16331 : audit [DBG] from='client.352530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:46 smithi044 bash[22676]: audit 2024-09-21T04:31:45.757659+0000 mgr.a (mgr.14388) 16331 : audit [DBG] from='client.352530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:46 smithi049 bash[23528]: audit 2024-09-21T04:31:45.757659+0000 mgr.a (mgr.14388) 16331 : audit [DBG] from='client.352530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:47.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:47 smithi044 bash[22676]: cluster 2024-09-21T04:31:46.483327+0000 mgr.a (mgr.14388) 16332 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:47.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:47 smithi179 bash[23186]: cluster 2024-09-21T04:31:46.483327+0000 mgr.a (mgr.14388) 16332 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:47 smithi049 bash[23528]: cluster 2024-09-21T04:31:46.483327+0000 mgr.a (mgr.14388) 16332 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:48 smithi044 bash[22676]: audit 2024-09-21T04:31:47.867460+0000 mon.a (mon.0) 13037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:48 smithi044 bash[22676]: audit 2024-09-21T04:31:47.875307+0000 mon.a (mon.0) 13038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:48 smithi044 bash[22676]: audit 2024-09-21T04:31:47.885611+0000 mon.a (mon.0) 13039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:48 smithi044 bash[22676]: audit 2024-09-21T04:31:47.932403+0000 mon.a (mon.0) 13040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:48 smithi044 bash[22676]: audit 2024-09-21T04:31:47.940857+0000 mon.a (mon.0) 13041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:48 smithi044 bash[22676]: audit 2024-09-21T04:31:47.950943+0000 mon.a (mon.0) 13042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:48 smithi179 bash[23186]: audit 2024-09-21T04:31:47.867460+0000 mon.a (mon.0) 13037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:48 smithi179 bash[23186]: audit 2024-09-21T04:31:47.875307+0000 mon.a (mon.0) 13038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:48 smithi179 bash[23186]: audit 2024-09-21T04:31:47.885611+0000 mon.a (mon.0) 13039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:48 smithi179 bash[23186]: audit 2024-09-21T04:31:47.932403+0000 mon.a (mon.0) 13040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:48 smithi179 bash[23186]: audit 2024-09-21T04:31:47.940857+0000 mon.a (mon.0) 13041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:48 smithi179 bash[23186]: audit 2024-09-21T04:31:47.950943+0000 mon.a (mon.0) 13042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:48 smithi049 bash[23528]: audit 2024-09-21T04:31:47.867460+0000 mon.a (mon.0) 13037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:48 smithi049 bash[23528]: audit 2024-09-21T04:31:47.875307+0000 mon.a (mon.0) 13038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:48 smithi049 bash[23528]: audit 2024-09-21T04:31:47.885611+0000 mon.a (mon.0) 13039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:48 smithi049 bash[23528]: audit 2024-09-21T04:31:47.932403+0000 mon.a (mon.0) 13040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:48 smithi049 bash[23528]: audit 2024-09-21T04:31:47.940857+0000 mon.a (mon.0) 13041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:48 smithi049 bash[23528]: audit 2024-09-21T04:31:47.950943+0000 mon.a (mon.0) 13042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:49 smithi044 bash[22676]: cluster 2024-09-21T04:31:48.484231+0000 mgr.a (mgr.14388) 16333 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:49 smithi179 bash[23186]: cluster 2024-09-21T04:31:48.484231+0000 mgr.a (mgr.14388) 16333 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:49 smithi049 bash[23528]: cluster 2024-09-21T04:31:48.484231+0000 mgr.a (mgr.14388) 16333 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:31:51.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:51.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:51.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:51.994 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:51 smithi044 bash[22676]: cluster 2024-09-21T04:31:50.486411+0000 mgr.a (mgr.14388) 16334 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:51 smithi179 bash[23186]: cluster 2024-09-21T04:31:50.486411+0000 mgr.a (mgr.14388) 16334 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:51 smithi049 bash[23528]: cluster 2024-09-21T04:31:50.486411+0000 mgr.a (mgr.14388) 16334 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:52 smithi044 bash[22676]: audit 2024-09-21T04:31:51.544952+0000 mgr.a (mgr.14388) 16335 : audit [DBG] from='client.352608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:52 smithi179 bash[23186]: audit 2024-09-21T04:31:51.544952+0000 mgr.a (mgr.14388) 16335 : audit [DBG] from='client.352608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:52 smithi049 bash[23528]: audit 2024-09-21T04:31:51.544952+0000 mgr.a (mgr.14388) 16335 : audit [DBG] from='client.352608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:53 smithi044 bash[22676]: cluster 2024-09-21T04:31:52.487374+0000 mgr.a (mgr.14388) 16336 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:53 smithi179 bash[23186]: cluster 2024-09-21T04:31:52.487374+0000 mgr.a (mgr.14388) 16336 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:53 smithi049 bash[23528]: cluster 2024-09-21T04:31:52.487374+0000 mgr.a (mgr.14388) 16336 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:55 smithi044 bash[22676]: cluster 2024-09-21T04:31:54.488166+0000 mgr.a (mgr.14388) 16337 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:55 smithi179 bash[23186]: cluster 2024-09-21T04:31:54.488166+0000 mgr.a (mgr.14388) 16337 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:55 smithi049 bash[23528]: cluster 2024-09-21T04:31:54.488166+0000 mgr.a (mgr.14388) 16337 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:31:56.995 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:31:56.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:31:56.996 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:31:57.777 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:31:57.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:31:57.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:31:57.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:31:57.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:31:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:57 smithi049 bash[23528]: cluster 2024-09-21T04:31:56.490414+0000 mgr.a (mgr.14388) 16338 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:57 smithi049 bash[23528]: audit 2024-09-21T04:31:56.787691+0000 mon.a (mon.0) 13043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:57 smithi049 bash[23528]: audit 2024-09-21T04:31:56.796535+0000 mon.a (mon.0) 13044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:57 smithi049 bash[23528]: audit 2024-09-21T04:31:56.807090+0000 mon.a (mon.0) 13045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:57 smithi044 bash[22676]: cluster 2024-09-21T04:31:56.490414+0000 mgr.a (mgr.14388) 16338 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:57 smithi044 bash[22676]: audit 2024-09-21T04:31:56.787691+0000 mon.a (mon.0) 13043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:57 smithi044 bash[22676]: audit 2024-09-21T04:31:56.796535+0000 mon.a (mon.0) 13044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:57 smithi044 bash[22676]: audit 2024-09-21T04:31:56.807090+0000 mon.a (mon.0) 13045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:57 smithi179 bash[23186]: cluster 2024-09-21T04:31:56.490414+0000 mgr.a (mgr.14388) 16338 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:31:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:57 smithi179 bash[23186]: audit 2024-09-21T04:31:56.787691+0000 mon.a (mon.0) 13043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:57 smithi179 bash[23186]: audit 2024-09-21T04:31:56.796535+0000 mon.a (mon.0) 13044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:57 smithi179 bash[23186]: audit 2024-09-21T04:31:56.807090+0000 mon.a (mon.0) 13045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:31:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:58 smithi049 bash[23528]: audit 2024-09-21T04:31:57.330371+0000 mgr.a (mgr.14388) 16339 : audit [DBG] from='client.352686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:58 smithi044 bash[22676]: audit 2024-09-21T04:31:57.330371+0000 mgr.a (mgr.14388) 16339 : audit [DBG] from='client.352686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:31:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:58 smithi179 bash[23186]: audit 2024-09-21T04:31:57.330371+0000 mgr.a (mgr.14388) 16339 : audit [DBG] from='client.352686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:00.052 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:59 smithi179 bash[23186]: cluster 2024-09-21T04:31:58.491321+0000 mgr.a (mgr.14388) 16340 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:00.052 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:59 smithi179 bash[23186]: audit 2024-09-21T04:31:59.453665+0000 mon.a (mon.0) 13046 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:32:00.052 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:59 smithi179 bash[23186]: audit 2024-09-21T04:31:59.465318+0000 mon.a (mon.0) 13047 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:32:00.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:59 smithi179 bash[23186]: audit 2024-09-21T04:31:59.467263+0000 mon.a (mon.0) 13048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:32:00.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:59 smithi179 bash[23186]: audit 2024-09-21T04:31:59.478731+0000 mon.a (mon.0) 13049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:00.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:31:59 smithi179 bash[23186]: audit 2024-09-21T04:31:59.485077+0000 mon.a (mon.0) 13050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:32:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:59 smithi049 bash[23528]: cluster 2024-09-21T04:31:58.491321+0000 mgr.a (mgr.14388) 16340 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:59 smithi049 bash[23528]: audit 2024-09-21T04:31:59.453665+0000 mon.a (mon.0) 13046 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:32:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:59 smithi049 bash[23528]: audit 2024-09-21T04:31:59.465318+0000 mon.a (mon.0) 13047 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:32:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:59 smithi049 bash[23528]: audit 2024-09-21T04:31:59.467263+0000 mon.a (mon.0) 13048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:32:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:59 smithi049 bash[23528]: audit 2024-09-21T04:31:59.478731+0000 mon.a (mon.0) 13049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:31:59 smithi049 bash[23528]: audit 2024-09-21T04:31:59.485077+0000 mon.a (mon.0) 13050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:32:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:59 smithi044 bash[22676]: cluster 2024-09-21T04:31:58.491321+0000 mgr.a (mgr.14388) 16340 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:59 smithi044 bash[22676]: audit 2024-09-21T04:31:59.453665+0000 mon.a (mon.0) 13046 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:32:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:59 smithi044 bash[22676]: audit 2024-09-21T04:31:59.465318+0000 mon.a (mon.0) 13047 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:32:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:59 smithi044 bash[22676]: audit 2024-09-21T04:31:59.467263+0000 mon.a (mon.0) 13048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:32:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:59 smithi044 bash[22676]: audit 2024-09-21T04:31:59.478731+0000 mon.a (mon.0) 13049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:31:59 smithi044 bash[22676]: audit 2024-09-21T04:31:59.485077+0000 mon.a (mon.0) 13050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:32:00.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:32:00 smithi044 bash[22930]: debug 2024-09-21T04:32:00.280+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:32:00.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:32:00 smithi044 bash[22930]: debug 2024-09-21T04:32:00.284+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:32:00.974 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:00 smithi049 bash[23528]: audit 2024-09-21T04:31:59.487635+0000 mgr.a (mgr.14388) 16341 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:32:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:00 smithi044 bash[22676]: audit 2024-09-21T04:31:59.487635+0000 mgr.a (mgr.14388) 16341 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:32:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:00 smithi179 bash[23186]: audit 2024-09-21T04:31:59.487635+0000 mgr.a (mgr.14388) 16341 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:32:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:01 smithi049 bash[23528]: audit 2024-09-21T04:32:00.284414+0000 mgr.a (mgr.14388) 16342 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:32:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:01 smithi049 bash[23528]: cephadm 2024-09-21T04:32:00.285679+0000 mgr.a (mgr.14388) 16343 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:32:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:01 smithi049 bash[23528]: cluster 2024-09-21T04:32:00.493912+0000 mgr.a (mgr.14388) 16344 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:32:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:01 smithi044 bash[22676]: audit 2024-09-21T04:32:00.284414+0000 mgr.a (mgr.14388) 16342 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:32:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:01 smithi044 bash[22676]: cephadm 2024-09-21T04:32:00.285679+0000 mgr.a (mgr.14388) 16343 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:32:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:01 smithi044 bash[22676]: cluster 2024-09-21T04:32:00.493912+0000 mgr.a (mgr.14388) 16344 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:32:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:01 smithi179 bash[23186]: audit 2024-09-21T04:32:00.284414+0000 mgr.a (mgr.14388) 16342 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:32:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:01 smithi179 bash[23186]: cephadm 2024-09-21T04:32:00.285679+0000 mgr.a (mgr.14388) 16343 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:32:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:01 smithi179 bash[23186]: cluster 2024-09-21T04:32:00.493912+0000 mgr.a (mgr.14388) 16344 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:32:02.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:03.530 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:03.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:03.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:03.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:03.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:03 smithi044 bash[22676]: cluster 2024-09-21T04:32:02.494714+0000 mgr.a (mgr.14388) 16345 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:32:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:03 smithi044 bash[22676]: audit 2024-09-21T04:32:03.101313+0000 mgr.a (mgr.14388) 16346 : audit [DBG] from='client.352863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:03 smithi179 bash[23186]: cluster 2024-09-21T04:32:02.494714+0000 mgr.a (mgr.14388) 16345 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:32:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:03 smithi179 bash[23186]: audit 2024-09-21T04:32:03.101313+0000 mgr.a (mgr.14388) 16346 : audit [DBG] from='client.352863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:03 smithi049 bash[23528]: cluster 2024-09-21T04:32:02.494714+0000 mgr.a (mgr.14388) 16345 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:32:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:03 smithi049 bash[23528]: audit 2024-09-21T04:32:03.101313+0000 mgr.a (mgr.14388) 16346 : audit [DBG] from='client.352863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:05 smithi044 bash[22676]: cluster 2024-09-21T04:32:04.495817+0000 mgr.a (mgr.14388) 16347 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:32:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:05 smithi179 bash[23186]: cluster 2024-09-21T04:32:04.495817+0000 mgr.a (mgr.14388) 16347 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:32:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:05 smithi049 bash[23528]: cluster 2024-09-21T04:32:04.495817+0000 mgr.a (mgr.14388) 16347 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T04:32:08.134 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:07 smithi044 bash[22676]: cluster 2024-09-21T04:32:06.498292+0000 mgr.a (mgr.14388) 16348 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:08.172 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:07 smithi179 bash[23186]: cluster 2024-09-21T04:32:06.498292+0000 mgr.a (mgr.14388) 16348 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:07 smithi049 bash[23528]: cluster 2024-09-21T04:32:06.498292+0000 mgr.a (mgr.14388) 16348 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:09.324 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:09.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:09 smithi044 bash[22676]: audit 2024-09-21T04:32:08.105900+0000 mon.a (mon.0) 13051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:09 smithi044 bash[22676]: audit 2024-09-21T04:32:08.117283+0000 mon.a (mon.0) 13052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:09 smithi044 bash[22676]: audit 2024-09-21T04:32:08.128912+0000 mon.a (mon.0) 13053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:09 smithi044 bash[22676]: audit 2024-09-21T04:32:08.146765+0000 mon.a (mon.0) 13054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:09 smithi044 bash[22676]: audit 2024-09-21T04:32:08.156462+0000 mon.a (mon.0) 13055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:09 smithi044 bash[22676]: audit 2024-09-21T04:32:08.167893+0000 mon.a (mon.0) 13056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:09 smithi179 bash[23186]: audit 2024-09-21T04:32:08.105900+0000 mon.a (mon.0) 13051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:09 smithi179 bash[23186]: audit 2024-09-21T04:32:08.117283+0000 mon.a (mon.0) 13052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:09 smithi179 bash[23186]: audit 2024-09-21T04:32:08.128912+0000 mon.a (mon.0) 13053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:09 smithi179 bash[23186]: audit 2024-09-21T04:32:08.146765+0000 mon.a (mon.0) 13054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:09 smithi179 bash[23186]: audit 2024-09-21T04:32:08.156462+0000 mon.a (mon.0) 13055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:09 smithi179 bash[23186]: audit 2024-09-21T04:32:08.167893+0000 mon.a (mon.0) 13056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:09 smithi049 bash[23528]: audit 2024-09-21T04:32:08.105900+0000 mon.a (mon.0) 13051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:09 smithi049 bash[23528]: audit 2024-09-21T04:32:08.117283+0000 mon.a (mon.0) 13052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:09 smithi049 bash[23528]: audit 2024-09-21T04:32:08.128912+0000 mon.a (mon.0) 13053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:09 smithi049 bash[23528]: audit 2024-09-21T04:32:08.146765+0000 mon.a (mon.0) 13054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:09 smithi049 bash[23528]: audit 2024-09-21T04:32:08.156462+0000 mon.a (mon.0) 13055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:09.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:09 smithi049 bash[23528]: audit 2024-09-21T04:32:08.167893+0000 mon.a (mon.0) 13056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:10 smithi044 bash[22676]: cluster 2024-09-21T04:32:08.499106+0000 mgr.a (mgr.14388) 16349 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:10 smithi044 bash[22676]: audit 2024-09-21T04:32:08.864038+0000 mgr.a (mgr.14388) 16350 : audit [DBG] from='client.352941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:10 smithi179 bash[23186]: cluster 2024-09-21T04:32:08.499106+0000 mgr.a (mgr.14388) 16349 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:10 smithi179 bash[23186]: audit 2024-09-21T04:32:08.864038+0000 mgr.a (mgr.14388) 16350 : audit [DBG] from='client.352941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:10 smithi049 bash[23528]: cluster 2024-09-21T04:32:08.499106+0000 mgr.a (mgr.14388) 16349 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:10 smithi049 bash[23528]: audit 2024-09-21T04:32:08.864038+0000 mgr.a (mgr.14388) 16350 : audit [DBG] from='client.352941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:12 smithi044 bash[22676]: cluster 2024-09-21T04:32:10.501570+0000 mgr.a (mgr.14388) 16351 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:12 smithi179 bash[23186]: cluster 2024-09-21T04:32:10.501570+0000 mgr.a (mgr.14388) 16351 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:12 smithi049 bash[23528]: cluster 2024-09-21T04:32:10.501570+0000 mgr.a (mgr.14388) 16351 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:32:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:14 smithi049 bash[23528]: cluster 2024-09-21T04:32:12.502405+0000 mgr.a (mgr.14388) 16352 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:32:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:14 smithi044 bash[22676]: cluster 2024-09-21T04:32:12.502405+0000 mgr.a (mgr.14388) 16352 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:32:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:14 smithi179 bash[23186]: cluster 2024-09-21T04:32:12.502405+0000 mgr.a (mgr.14388) 16352 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:32:15.108 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:16 smithi044 bash[22676]: cluster 2024-09-21T04:32:14.502948+0000 mgr.a (mgr.14388) 16353 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:32:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:16 smithi044 bash[22676]: audit 2024-09-21T04:32:14.660097+0000 mgr.a (mgr.14388) 16354 : audit [DBG] from='client.353019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:16 smithi179 bash[23186]: cluster 2024-09-21T04:32:14.502948+0000 mgr.a (mgr.14388) 16353 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:32:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:16 smithi179 bash[23186]: audit 2024-09-21T04:32:14.660097+0000 mgr.a (mgr.14388) 16354 : audit [DBG] from='client.353019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:16 smithi049 bash[23528]: cluster 2024-09-21T04:32:14.502948+0000 mgr.a (mgr.14388) 16353 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:32:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:16 smithi049 bash[23528]: audit 2024-09-21T04:32:14.660097+0000 mgr.a (mgr.14388) 16354 : audit [DBG] from='client.353019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:18 smithi049 bash[23528]: cluster 2024-09-21T04:32:16.505472+0000 mgr.a (mgr.14388) 16355 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:32:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:18 smithi049 bash[23528]: audit 2024-09-21T04:32:17.023956+0000 mon.a (mon.0) 13057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:18 smithi049 bash[23528]: audit 2024-09-21T04:32:17.032675+0000 mon.a (mon.0) 13058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:18 smithi049 bash[23528]: audit 2024-09-21T04:32:17.043081+0000 mon.a (mon.0) 13059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:18 smithi044 bash[22676]: cluster 2024-09-21T04:32:16.505472+0000 mgr.a (mgr.14388) 16355 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:32:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:18 smithi044 bash[22676]: audit 2024-09-21T04:32:17.023956+0000 mon.a (mon.0) 13057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:18 smithi044 bash[22676]: audit 2024-09-21T04:32:17.032675+0000 mon.a (mon.0) 13058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:18 smithi044 bash[22676]: audit 2024-09-21T04:32:17.043081+0000 mon.a (mon.0) 13059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:18 smithi179 bash[23186]: cluster 2024-09-21T04:32:16.505472+0000 mgr.a (mgr.14388) 16355 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:32:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:18 smithi179 bash[23186]: audit 2024-09-21T04:32:17.023956+0000 mon.a (mon.0) 13057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:18 smithi179 bash[23186]: audit 2024-09-21T04:32:17.032675+0000 mon.a (mon.0) 13058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:18 smithi179 bash[23186]: audit 2024-09-21T04:32:17.043081+0000 mon.a (mon.0) 13059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:20.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:20.111 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:20.111 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:20 smithi049 bash[23528]: cluster 2024-09-21T04:32:18.506203+0000 mgr.a (mgr.14388) 16356 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:32:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:20 smithi044 bash[22676]: cluster 2024-09-21T04:32:18.506203+0000 mgr.a (mgr.14388) 16356 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:32:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:20 smithi179 bash[23186]: cluster 2024-09-21T04:32:18.506203+0000 mgr.a (mgr.14388) 16356 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:32:20.862 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:22 smithi049 bash[23528]: audit 2024-09-21T04:32:20.438725+0000 mgr.a (mgr.14388) 16357 : audit [DBG] from='client.353094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:22 smithi049 bash[23528]: cluster 2024-09-21T04:32:20.507538+0000 mgr.a (mgr.14388) 16358 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:22 smithi044 bash[22676]: audit 2024-09-21T04:32:20.438725+0000 mgr.a (mgr.14388) 16357 : audit [DBG] from='client.353094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:22 smithi044 bash[22676]: cluster 2024-09-21T04:32:20.507538+0000 mgr.a (mgr.14388) 16358 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:22 smithi179 bash[23186]: audit 2024-09-21T04:32:20.438725+0000 mgr.a (mgr.14388) 16357 : audit [DBG] from='client.353094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:22 smithi179 bash[23186]: cluster 2024-09-21T04:32:20.507538+0000 mgr.a (mgr.14388) 16358 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:24 smithi044 bash[22676]: cluster 2024-09-21T04:32:22.508400+0000 mgr.a (mgr.14388) 16359 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:32:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:24 smithi049 bash[23528]: cluster 2024-09-21T04:32:22.508400+0000 mgr.a (mgr.14388) 16359 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:32:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:24 smithi179 bash[23186]: cluster 2024-09-21T04:32:22.508400+0000 mgr.a (mgr.14388) 16359 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:32:25.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:25.865 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:25.865 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:26.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:26 smithi049 bash[23528]: cluster 2024-09-21T04:32:24.509385+0000 mgr.a (mgr.14388) 16360 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:32:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:26 smithi044 bash[22676]: cluster 2024-09-21T04:32:24.509385+0000 mgr.a (mgr.14388) 16360 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:32:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:26 smithi179 bash[23186]: cluster 2024-09-21T04:32:24.509385+0000 mgr.a (mgr.14388) 16360 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:32:26.664 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:26.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:26.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:26.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:26.665 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:27 smithi049 bash[23528]: audit 2024-09-21T04:32:26.209874+0000 mgr.a (mgr.14388) 16361 : audit [DBG] from='client.353169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:27 smithi044 bash[22676]: audit 2024-09-21T04:32:26.209874+0000 mgr.a (mgr.14388) 16361 : audit [DBG] from='client.353169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:27 smithi179 bash[23186]: audit 2024-09-21T04:32:26.209874+0000 mgr.a (mgr.14388) 16361 : audit [DBG] from='client.353169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:28 smithi049 bash[23528]: cluster 2024-09-21T04:32:26.510802+0000 mgr.a (mgr.14388) 16362 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:28.313 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:28 smithi179 bash[23186]: cluster 2024-09-21T04:32:26.510802+0000 mgr.a (mgr.14388) 16362 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:28.374 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:28 smithi044 bash[22676]: cluster 2024-09-21T04:32:26.510802+0000 mgr.a (mgr.14388) 16362 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:29 smithi049 bash[23528]: audit 2024-09-21T04:32:28.292578+0000 mon.a (mon.0) 13060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:29 smithi049 bash[23528]: audit 2024-09-21T04:32:28.299885+0000 mon.a (mon.0) 13061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:29 smithi049 bash[23528]: audit 2024-09-21T04:32:28.309575+0000 mon.a (mon.0) 13062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:29 smithi049 bash[23528]: audit 2024-09-21T04:32:28.349129+0000 mon.a (mon.0) 13063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:29 smithi049 bash[23528]: audit 2024-09-21T04:32:28.358022+0000 mon.a (mon.0) 13064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:29 smithi049 bash[23528]: audit 2024-09-21T04:32:28.369230+0000 mon.a (mon.0) 13065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:29 smithi049 bash[23528]: cluster 2024-09-21T04:32:28.511689+0000 mgr.a (mgr.14388) 16363 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:32:29.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:29 smithi044 bash[22676]: audit 2024-09-21T04:32:28.292578+0000 mon.a (mon.0) 13060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:29 smithi044 bash[22676]: audit 2024-09-21T04:32:28.299885+0000 mon.a (mon.0) 13061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:29 smithi044 bash[22676]: audit 2024-09-21T04:32:28.309575+0000 mon.a (mon.0) 13062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:29 smithi044 bash[22676]: audit 2024-09-21T04:32:28.349129+0000 mon.a (mon.0) 13063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:29 smithi044 bash[22676]: audit 2024-09-21T04:32:28.358022+0000 mon.a (mon.0) 13064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:29 smithi044 bash[22676]: audit 2024-09-21T04:32:28.369230+0000 mon.a (mon.0) 13065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:29 smithi044 bash[22676]: cluster 2024-09-21T04:32:28.511689+0000 mgr.a (mgr.14388) 16363 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:32:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:29 smithi179 bash[23186]: audit 2024-09-21T04:32:28.292578+0000 mon.a (mon.0) 13060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:29 smithi179 bash[23186]: audit 2024-09-21T04:32:28.299885+0000 mon.a (mon.0) 13061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:29 smithi179 bash[23186]: audit 2024-09-21T04:32:28.309575+0000 mon.a (mon.0) 13062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:29 smithi179 bash[23186]: audit 2024-09-21T04:32:28.349129+0000 mon.a (mon.0) 13063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:29 smithi179 bash[23186]: audit 2024-09-21T04:32:28.358022+0000 mon.a (mon.0) 13064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:29 smithi179 bash[23186]: audit 2024-09-21T04:32:28.369230+0000 mon.a (mon.0) 13065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:29 smithi179 bash[23186]: cluster 2024-09-21T04:32:28.511689+0000 mgr.a (mgr.14388) 16363 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:32:31.666 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:31.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:31.667 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:31 smithi179 bash[23186]: cluster 2024-09-21T04:32:30.514074+0000 mgr.a (mgr.14388) 16364 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:32:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:31 smithi049 bash[23528]: cluster 2024-09-21T04:32:30.514074+0000 mgr.a (mgr.14388) 16364 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:32:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:31 smithi044 bash[22676]: cluster 2024-09-21T04:32:30.514074+0000 mgr.a (mgr.14388) 16364 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:32:32.452 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:32.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:32.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:32.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:32.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:32 smithi179 bash[23186]: audit 2024-09-21T04:32:32.000915+0000 mgr.a (mgr.14388) 16365 : audit [DBG] from='client.353247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:32 smithi049 bash[23528]: audit 2024-09-21T04:32:32.000915+0000 mgr.a (mgr.14388) 16365 : audit [DBG] from='client.353247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:32 smithi044 bash[22676]: audit 2024-09-21T04:32:32.000915+0000 mgr.a (mgr.14388) 16365 : audit [DBG] from='client.353247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:33 smithi049 bash[23528]: cluster 2024-09-21T04:32:32.515053+0000 mgr.a (mgr.14388) 16366 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:33 smithi044 bash[22676]: cluster 2024-09-21T04:32:32.515053+0000 mgr.a (mgr.14388) 16366 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:33 smithi179 bash[23186]: cluster 2024-09-21T04:32:32.515053+0000 mgr.a (mgr.14388) 16366 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:35 smithi044 bash[22676]: cluster 2024-09-21T04:32:34.515823+0000 mgr.a (mgr.14388) 16367 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:35 smithi179 bash[23186]: cluster 2024-09-21T04:32:34.515823+0000 mgr.a (mgr.14388) 16367 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:35 smithi049 bash[23528]: cluster 2024-09-21T04:32:34.515823+0000 mgr.a (mgr.14388) 16367 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:37.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:37.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:37 smithi044 bash[22676]: cluster 2024-09-21T04:32:36.518042+0000 mgr.a (mgr.14388) 16368 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:37 smithi044 bash[22676]: audit 2024-09-21T04:32:37.266305+0000 mon.a (mon.0) 13066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:37 smithi044 bash[22676]: audit 2024-09-21T04:32:37.276328+0000 mon.a (mon.0) 13067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:37 smithi044 bash[22676]: audit 2024-09-21T04:32:37.288108+0000 mon.a (mon.0) 13068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:37 smithi179 bash[23186]: cluster 2024-09-21T04:32:36.518042+0000 mgr.a (mgr.14388) 16368 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:37 smithi179 bash[23186]: audit 2024-09-21T04:32:37.266305+0000 mon.a (mon.0) 13066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:37 smithi179 bash[23186]: audit 2024-09-21T04:32:37.276328+0000 mon.a (mon.0) 13067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:37 smithi179 bash[23186]: audit 2024-09-21T04:32:37.288108+0000 mon.a (mon.0) 13068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:37 smithi049 bash[23528]: cluster 2024-09-21T04:32:36.518042+0000 mgr.a (mgr.14388) 16368 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:37 smithi049 bash[23528]: audit 2024-09-21T04:32:37.266305+0000 mon.a (mon.0) 13066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:37 smithi049 bash[23528]: audit 2024-09-21T04:32:37.276328+0000 mon.a (mon.0) 13067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:37 smithi049 bash[23528]: audit 2024-09-21T04:32:37.288108+0000 mon.a (mon.0) 13068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:38.222 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:38.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:38.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:38.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:38.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:38 smithi044 bash[22676]: audit 2024-09-21T04:32:37.783321+0000 mgr.a (mgr.14388) 16369 : audit [DBG] from='client.353322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:38 smithi179 bash[23186]: audit 2024-09-21T04:32:37.783321+0000 mgr.a (mgr.14388) 16369 : audit [DBG] from='client.353322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:38 smithi049 bash[23528]: audit 2024-09-21T04:32:37.783321+0000 mgr.a (mgr.14388) 16369 : audit [DBG] from='client.353322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:39 smithi044 bash[22676]: cluster 2024-09-21T04:32:38.519005+0000 mgr.a (mgr.14388) 16370 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:39 smithi179 bash[23186]: cluster 2024-09-21T04:32:38.519005+0000 mgr.a (mgr.14388) 16370 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:39 smithi049 bash[23528]: cluster 2024-09-21T04:32:38.519005+0000 mgr.a (mgr.14388) 16370 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:41.858 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:41 smithi049 bash[23528]: cluster 2024-09-21T04:32:40.521237+0000 mgr.a (mgr.14388) 16371 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:41 smithi044 bash[22676]: cluster 2024-09-21T04:32:40.521237+0000 mgr.a (mgr.14388) 16371 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:41 smithi179 bash[23186]: cluster 2024-09-21T04:32:40.521237+0000 mgr.a (mgr.14388) 16371 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:43.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:43.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:43 smithi044 bash[22676]: cluster 2024-09-21T04:32:42.522008+0000 mgr.a (mgr.14388) 16372 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:43.981 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:43.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:43.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:43.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:43.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:43 smithi179 bash[23186]: cluster 2024-09-21T04:32:42.522008+0000 mgr.a (mgr.14388) 16372 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:43 smithi049 bash[23528]: cluster 2024-09-21T04:32:42.522008+0000 mgr.a (mgr.14388) 16372 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:44 smithi044 bash[22676]: audit 2024-09-21T04:32:43.541050+0000 mgr.a (mgr.14388) 16373 : audit [DBG] from='client.353397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:44 smithi179 bash[23186]: audit 2024-09-21T04:32:43.541050+0000 mgr.a (mgr.14388) 16373 : audit [DBG] from='client.353397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:44 smithi049 bash[23528]: audit 2024-09-21T04:32:43.541050+0000 mgr.a (mgr.14388) 16373 : audit [DBG] from='client.353397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:45 smithi044 bash[22676]: cluster 2024-09-21T04:32:44.523156+0000 mgr.a (mgr.14388) 16374 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:45 smithi179 bash[23186]: cluster 2024-09-21T04:32:44.523156+0000 mgr.a (mgr.14388) 16374 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:45 smithi049 bash[23528]: cluster 2024-09-21T04:32:44.523156+0000 mgr.a (mgr.14388) 16374 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:47 smithi179 bash[23186]: cluster 2024-09-21T04:32:46.525550+0000 mgr.a (mgr.14388) 16375 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:47 smithi044 bash[22676]: cluster 2024-09-21T04:32:46.525550+0000 mgr.a (mgr.14388) 16375 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:47 smithi049 bash[23528]: cluster 2024-09-21T04:32:46.525550+0000 mgr.a (mgr.14388) 16375 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:48.983 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:48.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:48.984 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:49.740 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:49.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:49 smithi049 bash[23528]: audit 2024-09-21T04:32:48.507557+0000 mon.a (mon.0) 13069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:49 smithi049 bash[23528]: audit 2024-09-21T04:32:48.514421+0000 mon.a (mon.0) 13070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:49 smithi049 bash[23528]: audit 2024-09-21T04:32:48.525464+0000 mon.a (mon.0) 13071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:49 smithi049 bash[23528]: cluster 2024-09-21T04:32:48.526388+0000 mgr.a (mgr.14388) 16376 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:49 smithi049 bash[23528]: audit 2024-09-21T04:32:48.592918+0000 mon.a (mon.0) 13072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:49 smithi049 bash[23528]: audit 2024-09-21T04:32:48.602431+0000 mon.a (mon.0) 13073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:49 smithi049 bash[23528]: audit 2024-09-21T04:32:48.612543+0000 mon.a (mon.0) 13074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:49 smithi044 bash[22676]: audit 2024-09-21T04:32:48.507557+0000 mon.a (mon.0) 13069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:49 smithi044 bash[22676]: audit 2024-09-21T04:32:48.514421+0000 mon.a (mon.0) 13070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:49 smithi044 bash[22676]: audit 2024-09-21T04:32:48.525464+0000 mon.a (mon.0) 13071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:49 smithi044 bash[22676]: cluster 2024-09-21T04:32:48.526388+0000 mgr.a (mgr.14388) 16376 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:49 smithi044 bash[22676]: audit 2024-09-21T04:32:48.592918+0000 mon.a (mon.0) 13072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:49 smithi044 bash[22676]: audit 2024-09-21T04:32:48.602431+0000 mon.a (mon.0) 13073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:49 smithi044 bash[22676]: audit 2024-09-21T04:32:48.612543+0000 mon.a (mon.0) 13074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:49 smithi179 bash[23186]: audit 2024-09-21T04:32:48.507557+0000 mon.a (mon.0) 13069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:49 smithi179 bash[23186]: audit 2024-09-21T04:32:48.514421+0000 mon.a (mon.0) 13070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:49 smithi179 bash[23186]: audit 2024-09-21T04:32:48.525464+0000 mon.a (mon.0) 13071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:49 smithi179 bash[23186]: cluster 2024-09-21T04:32:48.526388+0000 mgr.a (mgr.14388) 16376 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:49 smithi179 bash[23186]: audit 2024-09-21T04:32:48.592918+0000 mon.a (mon.0) 13072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:49 smithi179 bash[23186]: audit 2024-09-21T04:32:48.602431+0000 mon.a (mon.0) 13073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:49 smithi179 bash[23186]: audit 2024-09-21T04:32:48.612543+0000 mon.a (mon.0) 13074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:50.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:50 smithi049 bash[23528]: audit 2024-09-21T04:32:49.316657+0000 mgr.a (mgr.14388) 16377 : audit [DBG] from='client.353472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:50 smithi044 bash[22676]: audit 2024-09-21T04:32:49.316657+0000 mgr.a (mgr.14388) 16377 : audit [DBG] from='client.353472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:50 smithi179 bash[23186]: audit 2024-09-21T04:32:49.316657+0000 mgr.a (mgr.14388) 16377 : audit [DBG] from='client.353472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:51 smithi049 bash[23528]: cluster 2024-09-21T04:32:50.528834+0000 mgr.a (mgr.14388) 16378 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:51 smithi044 bash[22676]: cluster 2024-09-21T04:32:50.528834+0000 mgr.a (mgr.14388) 16378 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:51 smithi179 bash[23186]: cluster 2024-09-21T04:32:50.528834+0000 mgr.a (mgr.14388) 16378 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:32:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:53 smithi049 bash[23528]: cluster 2024-09-21T04:32:52.529657+0000 mgr.a (mgr.14388) 16379 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:53 smithi044 bash[22676]: cluster 2024-09-21T04:32:52.529657+0000 mgr.a (mgr.14388) 16379 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:53 smithi179 bash[23186]: cluster 2024-09-21T04:32:52.529657+0000 mgr.a (mgr.14388) 16379 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:54.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:32:54.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:32:54.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:32:55.533 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:32:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:32:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:32:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:32:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:32:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:55 smithi049 bash[23528]: cluster 2024-09-21T04:32:54.530424+0000 mgr.a (mgr.14388) 16380 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:55 smithi049 bash[23528]: audit 2024-09-21T04:32:55.077715+0000 mgr.a (mgr.14388) 16381 : audit [DBG] from='client.353550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:55 smithi044 bash[22676]: cluster 2024-09-21T04:32:54.530424+0000 mgr.a (mgr.14388) 16380 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:55 smithi044 bash[22676]: audit 2024-09-21T04:32:55.077715+0000 mgr.a (mgr.14388) 16381 : audit [DBG] from='client.353550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:55 smithi179 bash[23186]: cluster 2024-09-21T04:32:54.530424+0000 mgr.a (mgr.14388) 16380 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:55 smithi179 bash[23186]: audit 2024-09-21T04:32:55.077715+0000 mgr.a (mgr.14388) 16381 : audit [DBG] from='client.353550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:32:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:57 smithi049 bash[23528]: cluster 2024-09-21T04:32:56.533438+0000 mgr.a (mgr.14388) 16382 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:57 smithi049 bash[23528]: audit 2024-09-21T04:32:57.501322+0000 mon.a (mon.0) 13075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:57 smithi049 bash[23528]: audit 2024-09-21T04:32:57.511503+0000 mon.a (mon.0) 13076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:57 smithi049 bash[23528]: audit 2024-09-21T04:32:57.523447+0000 mon.a (mon.0) 13077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:57 smithi044 bash[22676]: cluster 2024-09-21T04:32:56.533438+0000 mgr.a (mgr.14388) 16382 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:57 smithi044 bash[22676]: audit 2024-09-21T04:32:57.501322+0000 mon.a (mon.0) 13075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:57 smithi044 bash[22676]: audit 2024-09-21T04:32:57.511503+0000 mon.a (mon.0) 13076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:57 smithi044 bash[22676]: audit 2024-09-21T04:32:57.523447+0000 mon.a (mon.0) 13077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:57 smithi179 bash[23186]: cluster 2024-09-21T04:32:56.533438+0000 mgr.a (mgr.14388) 16382 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:32:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:57 smithi179 bash[23186]: audit 2024-09-21T04:32:57.501322+0000 mon.a (mon.0) 13075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:57 smithi179 bash[23186]: audit 2024-09-21T04:32:57.511503+0000 mon.a (mon.0) 13076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:57 smithi179 bash[23186]: audit 2024-09-21T04:32:57.523447+0000 mon.a (mon.0) 13077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:32:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:32:59 smithi044 bash[22676]: cluster 2024-09-21T04:32:58.534246+0000 mgr.a (mgr.14388) 16383 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:32:59 smithi179 bash[23186]: cluster 2024-09-21T04:32:58.534246+0000 mgr.a (mgr.14388) 16383 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:32:59 smithi049 bash[23528]: cluster 2024-09-21T04:32:58.534246+0000 mgr.a (mgr.14388) 16383 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:00.534 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:00.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:00.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:00 smithi044 bash[22676]: audit 2024-09-21T04:33:00.350467+0000 mon.a (mon.0) 13078 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:33:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:00 smithi044 bash[22676]: audit 2024-09-21T04:33:00.357046+0000 mon.a (mon.0) 13079 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:33:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:00 smithi044 bash[22676]: audit 2024-09-21T04:33:00.358999+0000 mon.a (mon.0) 13080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:33:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:00 smithi044 bash[22676]: audit 2024-09-21T04:33:00.370629+0000 mon.a (mon.0) 13081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:00 smithi044 bash[22676]: audit 2024-09-21T04:33:00.376835+0000 mon.a (mon.0) 13082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:33:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:00 smithi179 bash[23186]: audit 2024-09-21T04:33:00.350467+0000 mon.a (mon.0) 13078 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:33:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:00 smithi179 bash[23186]: audit 2024-09-21T04:33:00.357046+0000 mon.a (mon.0) 13079 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:33:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:00 smithi179 bash[23186]: audit 2024-09-21T04:33:00.358999+0000 mon.a (mon.0) 13080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:33:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:00 smithi179 bash[23186]: audit 2024-09-21T04:33:00.370629+0000 mon.a (mon.0) 13081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:00 smithi179 bash[23186]: audit 2024-09-21T04:33:00.376835+0000 mon.a (mon.0) 13082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:33:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:00 smithi049 bash[23528]: audit 2024-09-21T04:33:00.350467+0000 mon.a (mon.0) 13078 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:33:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:00 smithi049 bash[23528]: audit 2024-09-21T04:33:00.357046+0000 mon.a (mon.0) 13079 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:33:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:00 smithi049 bash[23528]: audit 2024-09-21T04:33:00.358999+0000 mon.a (mon.0) 13080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:33:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:00 smithi049 bash[23528]: audit 2024-09-21T04:33:00.370629+0000 mon.a (mon.0) 13081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:00 smithi049 bash[23528]: audit 2024-09-21T04:33:00.376835+0000 mon.a (mon.0) 13082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:33:01.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:33:01 smithi044 bash[22930]: debug 2024-09-21T04:33:01.155+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:33:01.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:33:01 smithi044 bash[22930]: debug 2024-09-21T04:33:01.167+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:33:01.573 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:01.830 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:01 smithi179 bash[23186]: audit 2024-09-21T04:33:00.379222+0000 mgr.a (mgr.14388) 16384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:33:01.830 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:01 smithi179 bash[23186]: cluster 2024-09-21T04:33:00.535665+0000 mgr.a (mgr.14388) 16385 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:01.830 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:01 smithi179 bash[23186]: audit 2024-09-21T04:33:00.869473+0000 mgr.a (mgr.14388) 16386 : audit [DBG] from='client.353661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:01.830 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:01 smithi179 bash[23186]: audit 2024-09-21T04:33:01.158455+0000 mgr.a (mgr.14388) 16387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:33:01.830 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:01 smithi179 bash[23186]: cephadm 2024-09-21T04:33:01.172261+0000 mgr.a (mgr.14388) 16388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:33:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:01 smithi044 bash[22676]: audit 2024-09-21T04:33:00.379222+0000 mgr.a (mgr.14388) 16384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:33:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:01 smithi044 bash[22676]: cluster 2024-09-21T04:33:00.535665+0000 mgr.a (mgr.14388) 16385 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:01 smithi044 bash[22676]: audit 2024-09-21T04:33:00.869473+0000 mgr.a (mgr.14388) 16386 : audit [DBG] from='client.353661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:01 smithi044 bash[22676]: audit 2024-09-21T04:33:01.158455+0000 mgr.a (mgr.14388) 16387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:33:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:01 smithi044 bash[22676]: cephadm 2024-09-21T04:33:01.172261+0000 mgr.a (mgr.14388) 16388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:33:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:01 smithi049 bash[23528]: audit 2024-09-21T04:33:00.379222+0000 mgr.a (mgr.14388) 16384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:33:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:01 smithi049 bash[23528]: cluster 2024-09-21T04:33:00.535665+0000 mgr.a (mgr.14388) 16385 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:01 smithi049 bash[23528]: audit 2024-09-21T04:33:00.869473+0000 mgr.a (mgr.14388) 16386 : audit [DBG] from='client.353661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:01 smithi049 bash[23528]: audit 2024-09-21T04:33:01.158455+0000 mgr.a (mgr.14388) 16387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:33:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:01 smithi049 bash[23528]: cephadm 2024-09-21T04:33:01.172261+0000 mgr.a (mgr.14388) 16388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:33:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:03 smithi044 bash[22676]: cluster 2024-09-21T04:33:02.536610+0000 mgr.a (mgr.14388) 16389 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:03 smithi179 bash[23186]: cluster 2024-09-21T04:33:02.536610+0000 mgr.a (mgr.14388) 16389 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:03 smithi049 bash[23528]: cluster 2024-09-21T04:33:02.536610+0000 mgr.a (mgr.14388) 16389 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:05.972 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:05 smithi044 bash[22676]: cluster 2024-09-21T04:33:04.537420+0000 mgr.a (mgr.14388) 16390 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:33:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:05 smithi179 bash[23186]: cluster 2024-09-21T04:33:04.537420+0000 mgr.a (mgr.14388) 16390 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:33:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:05 smithi049 bash[23528]: cluster 2024-09-21T04:33:04.537420+0000 mgr.a (mgr.14388) 16390 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:33:06.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:06.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:06.576 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:07.349 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:07 smithi044 bash[22676]: cluster 2024-09-21T04:33:06.539575+0000 mgr.a (mgr.14388) 16391 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:07 smithi044 bash[22676]: audit 2024-09-21T04:33:06.906242+0000 mgr.a (mgr.14388) 16392 : audit [DBG] from='client.353811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:07 smithi179 bash[23186]: cluster 2024-09-21T04:33:06.539575+0000 mgr.a (mgr.14388) 16391 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:07 smithi179 bash[23186]: audit 2024-09-21T04:33:06.906242+0000 mgr.a (mgr.14388) 16392 : audit [DBG] from='client.353811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:07 smithi049 bash[23528]: cluster 2024-09-21T04:33:06.539575+0000 mgr.a (mgr.14388) 16391 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:07 smithi049 bash[23528]: audit 2024-09-21T04:33:06.906242+0000 mgr.a (mgr.14388) 16392 : audit [DBG] from='client.353811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:09 smithi044 bash[22676]: cluster 2024-09-21T04:33:08.540710+0000 mgr.a (mgr.14388) 16393 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:09 smithi044 bash[22676]: audit 2024-09-21T04:33:08.734095+0000 mon.a (mon.0) 13083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:09 smithi044 bash[22676]: audit 2024-09-21T04:33:08.742153+0000 mon.a (mon.0) 13084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:09 smithi044 bash[22676]: audit 2024-09-21T04:33:08.751051+0000 mon.a (mon.0) 13085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:09 smithi044 bash[22676]: audit 2024-09-21T04:33:08.805369+0000 mon.a (mon.0) 13086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:09 smithi044 bash[22676]: audit 2024-09-21T04:33:08.811558+0000 mon.a (mon.0) 13087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:09 smithi044 bash[22676]: audit 2024-09-21T04:33:08.819528+0000 mon.a (mon.0) 13088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:09 smithi179 bash[23186]: cluster 2024-09-21T04:33:08.540710+0000 mgr.a (mgr.14388) 16393 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:09 smithi179 bash[23186]: audit 2024-09-21T04:33:08.734095+0000 mon.a (mon.0) 13083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:09 smithi179 bash[23186]: audit 2024-09-21T04:33:08.742153+0000 mon.a (mon.0) 13084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:09 smithi179 bash[23186]: audit 2024-09-21T04:33:08.751051+0000 mon.a (mon.0) 13085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:09 smithi179 bash[23186]: audit 2024-09-21T04:33:08.805369+0000 mon.a (mon.0) 13086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:09 smithi179 bash[23186]: audit 2024-09-21T04:33:08.811558+0000 mon.a (mon.0) 13087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:09 smithi179 bash[23186]: audit 2024-09-21T04:33:08.819528+0000 mon.a (mon.0) 13088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:09 smithi049 bash[23528]: cluster 2024-09-21T04:33:08.540710+0000 mgr.a (mgr.14388) 16393 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:09 smithi049 bash[23528]: audit 2024-09-21T04:33:08.734095+0000 mon.a (mon.0) 13083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:09 smithi049 bash[23528]: audit 2024-09-21T04:33:08.742153+0000 mon.a (mon.0) 13084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:09 smithi049 bash[23528]: audit 2024-09-21T04:33:08.751051+0000 mon.a (mon.0) 13085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:09 smithi049 bash[23528]: audit 2024-09-21T04:33:08.805369+0000 mon.a (mon.0) 13086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:09 smithi049 bash[23528]: audit 2024-09-21T04:33:08.811558+0000 mon.a (mon.0) 13087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:10.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:09 smithi049 bash[23528]: audit 2024-09-21T04:33:08.819528+0000 mon.a (mon.0) 13088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:11 smithi179 bash[23186]: cluster 2024-09-21T04:33:10.542945+0000 mgr.a (mgr.14388) 16394 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:11 smithi049 bash[23528]: cluster 2024-09-21T04:33:10.542945+0000 mgr.a (mgr.14388) 16394 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:11 smithi044 bash[22676]: cluster 2024-09-21T04:33:10.542945+0000 mgr.a (mgr.14388) 16394 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:13.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:13 smithi179 bash[23186]: cluster 2024-09-21T04:33:12.543648+0000 mgr.a (mgr.14388) 16395 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:13 smithi179 bash[23186]: audit 2024-09-21T04:33:12.688484+0000 mgr.a (mgr.14388) 16396 : audit [DBG] from='client.353889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:13 smithi049 bash[23528]: cluster 2024-09-21T04:33:12.543648+0000 mgr.a (mgr.14388) 16395 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:13 smithi049 bash[23528]: audit 2024-09-21T04:33:12.688484+0000 mgr.a (mgr.14388) 16396 : audit [DBG] from='client.353889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:13 smithi044 bash[22676]: cluster 2024-09-21T04:33:12.543648+0000 mgr.a (mgr.14388) 16395 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:13 smithi044 bash[22676]: audit 2024-09-21T04:33:12.688484+0000 mgr.a (mgr.14388) 16396 : audit [DBG] from='client.353889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:15 smithi179 bash[23186]: cluster 2024-09-21T04:33:14.544621+0000 mgr.a (mgr.14388) 16397 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:15 smithi049 bash[23528]: cluster 2024-09-21T04:33:14.544621+0000 mgr.a (mgr.14388) 16397 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:15 smithi044 bash[22676]: cluster 2024-09-21T04:33:14.544621+0000 mgr.a (mgr.14388) 16397 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:17 smithi049 bash[23528]: cluster 2024-09-21T04:33:16.546910+0000 mgr.a (mgr.14388) 16398 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:17 smithi049 bash[23528]: audit 2024-09-21T04:33:17.740871+0000 mon.a (mon.0) 13089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:18.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:17 smithi044 bash[22676]: cluster 2024-09-21T04:33:16.546910+0000 mgr.a (mgr.14388) 16398 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:17 smithi044 bash[22676]: audit 2024-09-21T04:33:17.740871+0000 mon.a (mon.0) 13089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:18.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:17 smithi179 bash[23186]: cluster 2024-09-21T04:33:16.546910+0000 mgr.a (mgr.14388) 16398 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:33:18.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:17 smithi179 bash[23186]: audit 2024-09-21T04:33:17.740871+0000 mon.a (mon.0) 13089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:18.892 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:18 smithi049 bash[23528]: audit 2024-09-21T04:33:17.749620+0000 mon.a (mon.0) 13090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:18 smithi049 bash[23528]: audit 2024-09-21T04:33:17.763687+0000 mon.a (mon.0) 13091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:18 smithi044 bash[22676]: audit 2024-09-21T04:33:17.749620+0000 mon.a (mon.0) 13090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:18 smithi044 bash[22676]: audit 2024-09-21T04:33:17.763687+0000 mon.a (mon.0) 13091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:18 smithi179 bash[23186]: audit 2024-09-21T04:33:17.749620+0000 mon.a (mon.0) 13090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:18 smithi179 bash[23186]: audit 2024-09-21T04:33:17.763687+0000 mon.a (mon.0) 13091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:19 smithi049 bash[23528]: audit 2024-09-21T04:33:18.455908+0000 mgr.a (mgr.14388) 16399 : audit [DBG] from='client.353967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:19 smithi049 bash[23528]: cluster 2024-09-21T04:33:18.547387+0000 mgr.a (mgr.14388) 16400 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:19 smithi044 bash[22676]: audit 2024-09-21T04:33:18.455908+0000 mgr.a (mgr.14388) 16399 : audit [DBG] from='client.353967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:20.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:19 smithi044 bash[22676]: cluster 2024-09-21T04:33:18.547387+0000 mgr.a (mgr.14388) 16400 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:19 smithi179 bash[23186]: audit 2024-09-21T04:33:18.455908+0000 mgr.a (mgr.14388) 16399 : audit [DBG] from='client.353967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:19 smithi179 bash[23186]: cluster 2024-09-21T04:33:18.547387+0000 mgr.a (mgr.14388) 16400 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:21 smithi049 bash[23528]: cluster 2024-09-21T04:33:20.549714+0000 mgr.a (mgr.14388) 16401 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:21 smithi044 bash[22676]: cluster 2024-09-21T04:33:20.549714+0000 mgr.a (mgr.14388) 16401 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:21 smithi179 bash[23186]: cluster 2024-09-21T04:33:20.549714+0000 mgr.a (mgr.14388) 16401 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:23 smithi049 bash[23528]: cluster 2024-09-21T04:33:22.550529+0000 mgr.a (mgr.14388) 16402 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:23 smithi044 bash[22676]: cluster 2024-09-21T04:33:22.550529+0000 mgr.a (mgr.14388) 16402 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:23 smithi179 bash[23186]: cluster 2024-09-21T04:33:22.550529+0000 mgr.a (mgr.14388) 16402 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:24.660 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:24.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:24.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:24.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:24.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:24 smithi049 bash[23528]: audit 2024-09-21T04:33:24.234645+0000 mgr.a (mgr.14388) 16403 : audit [DBG] from='client.354045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:24 smithi044 bash[22676]: audit 2024-09-21T04:33:24.234645+0000 mgr.a (mgr.14388) 16403 : audit [DBG] from='client.354045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:24 smithi179 bash[23186]: audit 2024-09-21T04:33:24.234645+0000 mgr.a (mgr.14388) 16403 : audit [DBG] from='client.354045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:25 smithi049 bash[23528]: cluster 2024-09-21T04:33:24.556622+0000 mgr.a (mgr.14388) 16404 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:25 smithi044 bash[22676]: cluster 2024-09-21T04:33:24.556622+0000 mgr.a (mgr.14388) 16404 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:25 smithi179 bash[23186]: cluster 2024-09-21T04:33:24.556622+0000 mgr.a (mgr.14388) 16404 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:27 smithi049 bash[23528]: cluster 2024-09-21T04:33:26.558955+0000 mgr.a (mgr.14388) 16405 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:27 smithi044 bash[22676]: cluster 2024-09-21T04:33:26.558955+0000 mgr.a (mgr.14388) 16405 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:27 smithi179 bash[23186]: cluster 2024-09-21T04:33:26.558955+0000 mgr.a (mgr.14388) 16405 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:29.662 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:29 smithi044 bash[22676]: cluster 2024-09-21T04:33:28.559785+0000 mgr.a (mgr.14388) 16406 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:29 smithi044 bash[22676]: audit 2024-09-21T04:33:28.943915+0000 mon.a (mon.0) 13092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:29 smithi044 bash[22676]: audit 2024-09-21T04:33:28.951053+0000 mon.a (mon.0) 13093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:29 smithi044 bash[22676]: audit 2024-09-21T04:33:28.958689+0000 mon.a (mon.0) 13094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:29 smithi044 bash[22676]: audit 2024-09-21T04:33:29.026077+0000 mon.a (mon.0) 13095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:29 smithi044 bash[22676]: audit 2024-09-21T04:33:29.033762+0000 mon.a (mon.0) 13096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:29 smithi044 bash[22676]: audit 2024-09-21T04:33:29.042194+0000 mon.a (mon.0) 13097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:29 smithi179 bash[23186]: cluster 2024-09-21T04:33:28.559785+0000 mgr.a (mgr.14388) 16406 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:30.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:29 smithi179 bash[23186]: audit 2024-09-21T04:33:28.943915+0000 mon.a (mon.0) 13092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:29 smithi179 bash[23186]: audit 2024-09-21T04:33:28.951053+0000 mon.a (mon.0) 13093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:29 smithi179 bash[23186]: audit 2024-09-21T04:33:28.958689+0000 mon.a (mon.0) 13094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:29 smithi179 bash[23186]: audit 2024-09-21T04:33:29.026077+0000 mon.a (mon.0) 13095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:29 smithi179 bash[23186]: audit 2024-09-21T04:33:29.033762+0000 mon.a (mon.0) 13096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:29 smithi179 bash[23186]: audit 2024-09-21T04:33:29.042194+0000 mon.a (mon.0) 13097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:29 smithi049 bash[23528]: cluster 2024-09-21T04:33:28.559785+0000 mgr.a (mgr.14388) 16406 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:29 smithi049 bash[23528]: audit 2024-09-21T04:33:28.943915+0000 mon.a (mon.0) 13092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:29 smithi049 bash[23528]: audit 2024-09-21T04:33:28.951053+0000 mon.a (mon.0) 13093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:29 smithi049 bash[23528]: audit 2024-09-21T04:33:28.958689+0000 mon.a (mon.0) 13094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:29 smithi049 bash[23528]: audit 2024-09-21T04:33:29.026077+0000 mon.a (mon.0) 13095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:29 smithi049 bash[23528]: audit 2024-09-21T04:33:29.033762+0000 mon.a (mon.0) 13096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:29 smithi049 bash[23528]: audit 2024-09-21T04:33:29.042194+0000 mon.a (mon.0) 13097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:30.439 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:30.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:30.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:30.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:30.440 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:30 smithi179 bash[23186]: audit 2024-09-21T04:33:29.996056+0000 mgr.a (mgr.14388) 16407 : audit [DBG] from='client.354123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:30 smithi044 bash[22676]: audit 2024-09-21T04:33:29.996056+0000 mgr.a (mgr.14388) 16407 : audit [DBG] from='client.354123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:30 smithi049 bash[23528]: audit 2024-09-21T04:33:29.996056+0000 mgr.a (mgr.14388) 16407 : audit [DBG] from='client.354123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:32.216 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:31 smithi179 bash[23186]: cluster 2024-09-21T04:33:30.562733+0000 mgr.a (mgr.14388) 16408 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:31 smithi044 bash[22676]: cluster 2024-09-21T04:33:30.562733+0000 mgr.a (mgr.14388) 16408 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:31 smithi049 bash[23528]: cluster 2024-09-21T04:33:30.562733+0000 mgr.a (mgr.14388) 16408 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:33 smithi044 bash[22676]: cluster 2024-09-21T04:33:32.563508+0000 mgr.a (mgr.14388) 16409 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:33 smithi179 bash[23186]: cluster 2024-09-21T04:33:32.563508+0000 mgr.a (mgr.14388) 16409 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:33 smithi049 bash[23528]: cluster 2024-09-21T04:33:32.563508+0000 mgr.a (mgr.14388) 16409 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:35.441 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:35.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:35.442 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:35 smithi044 bash[22676]: cluster 2024-09-21T04:33:34.564284+0000 mgr.a (mgr.14388) 16410 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:36.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:36.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:35 smithi179 bash[23186]: cluster 2024-09-21T04:33:34.564284+0000 mgr.a (mgr.14388) 16410 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:35 smithi049 bash[23528]: cluster 2024-09-21T04:33:34.564284+0000 mgr.a (mgr.14388) 16410 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:36 smithi044 bash[22676]: audit 2024-09-21T04:33:35.778754+0000 mgr.a (mgr.14388) 16411 : audit [DBG] from='client.354201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:36 smithi179 bash[23186]: audit 2024-09-21T04:33:35.778754+0000 mgr.a (mgr.14388) 16411 : audit [DBG] from='client.354201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:36 smithi049 bash[23528]: audit 2024-09-21T04:33:35.778754+0000 mgr.a (mgr.14388) 16411 : audit [DBG] from='client.354201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:37 smithi044 bash[22676]: cluster 2024-09-21T04:33:36.567300+0000 mgr.a (mgr.14388) 16412 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:37 smithi179 bash[23186]: cluster 2024-09-21T04:33:36.567300+0000 mgr.a (mgr.14388) 16412 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:37 smithi049 bash[23528]: cluster 2024-09-21T04:33:36.567300+0000 mgr.a (mgr.14388) 16412 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:38 smithi044 bash[22676]: audit 2024-09-21T04:33:37.984614+0000 mon.a (mon.0) 13098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:38 smithi044 bash[22676]: audit 2024-09-21T04:33:37.993225+0000 mon.a (mon.0) 13099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:38 smithi044 bash[22676]: audit 2024-09-21T04:33:38.003873+0000 mon.a (mon.0) 13100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:38 smithi179 bash[23186]: audit 2024-09-21T04:33:37.984614+0000 mon.a (mon.0) 13098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:38 smithi179 bash[23186]: audit 2024-09-21T04:33:37.993225+0000 mon.a (mon.0) 13099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:38 smithi179 bash[23186]: audit 2024-09-21T04:33:38.003873+0000 mon.a (mon.0) 13100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:38 smithi049 bash[23528]: audit 2024-09-21T04:33:37.984614+0000 mon.a (mon.0) 13098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:38 smithi049 bash[23528]: audit 2024-09-21T04:33:37.993225+0000 mon.a (mon.0) 13099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:38 smithi049 bash[23528]: audit 2024-09-21T04:33:38.003873+0000 mon.a (mon.0) 13100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:40 smithi049 bash[23528]: cluster 2024-09-21T04:33:38.568068+0000 mgr.a (mgr.14388) 16413 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:40 smithi044 bash[22676]: cluster 2024-09-21T04:33:38.568068+0000 mgr.a (mgr.14388) 16413 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:40 smithi179 bash[23186]: cluster 2024-09-21T04:33:38.568068+0000 mgr.a (mgr.14388) 16413 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:33:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:42.005 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:42 smithi049 bash[23528]: cluster 2024-09-21T04:33:40.570055+0000 mgr.a (mgr.14388) 16414 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:42 smithi044 bash[22676]: cluster 2024-09-21T04:33:40.570055+0000 mgr.a (mgr.14388) 16414 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:42 smithi179 bash[23186]: cluster 2024-09-21T04:33:40.570055+0000 mgr.a (mgr.14388) 16414 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:43 smithi049 bash[23528]: audit 2024-09-21T04:33:41.571406+0000 mgr.a (mgr.14388) 16415 : audit [DBG] from='client.354276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:43 smithi044 bash[22676]: audit 2024-09-21T04:33:41.571406+0000 mgr.a (mgr.14388) 16415 : audit [DBG] from='client.354276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:43 smithi179 bash[23186]: audit 2024-09-21T04:33:41.571406+0000 mgr.a (mgr.14388) 16415 : audit [DBG] from='client.354276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:44 smithi049 bash[23528]: cluster 2024-09-21T04:33:42.571183+0000 mgr.a (mgr.14388) 16416 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:44 smithi044 bash[22676]: cluster 2024-09-21T04:33:42.571183+0000 mgr.a (mgr.14388) 16416 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:44 smithi179 bash[23186]: cluster 2024-09-21T04:33:42.571183+0000 mgr.a (mgr.14388) 16416 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:46 smithi049 bash[23528]: cluster 2024-09-21T04:33:44.572202+0000 mgr.a (mgr.14388) 16417 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:46 smithi044 bash[22676]: cluster 2024-09-21T04:33:44.572202+0000 mgr.a (mgr.14388) 16417 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:46 smithi179 bash[23186]: cluster 2024-09-21T04:33:44.572202+0000 mgr.a (mgr.14388) 16417 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:47.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:47.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:47.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:47.799 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:48 smithi049 bash[23528]: cluster 2024-09-21T04:33:46.574480+0000 mgr.a (mgr.14388) 16418 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:48 smithi044 bash[22676]: cluster 2024-09-21T04:33:46.574480+0000 mgr.a (mgr.14388) 16418 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:48 smithi179 bash[23186]: cluster 2024-09-21T04:33:46.574480+0000 mgr.a (mgr.14388) 16418 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:49 smithi049 bash[23528]: audit 2024-09-21T04:33:47.336915+0000 mgr.a (mgr.14388) 16419 : audit [DBG] from='client.354354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:49 smithi044 bash[22676]: audit 2024-09-21T04:33:47.336915+0000 mgr.a (mgr.14388) 16419 : audit [DBG] from='client.354354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:49 smithi179 bash[23186]: audit 2024-09-21T04:33:47.336915+0000 mgr.a (mgr.14388) 16419 : audit [DBG] from='client.354354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:50.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:50 smithi179 bash[23186]: cluster 2024-09-21T04:33:48.575466+0000 mgr.a (mgr.14388) 16420 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:50.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:50 smithi179 bash[23186]: audit 2024-09-21T04:33:49.123515+0000 mon.a (mon.0) 13101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:50 smithi179 bash[23186]: audit 2024-09-21T04:33:49.132500+0000 mon.a (mon.0) 13102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:50 smithi179 bash[23186]: audit 2024-09-21T04:33:49.143720+0000 mon.a (mon.0) 13103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:50 smithi179 bash[23186]: audit 2024-09-21T04:33:49.264170+0000 mon.a (mon.0) 13104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:50 smithi179 bash[23186]: audit 2024-09-21T04:33:49.274096+0000 mon.a (mon.0) 13105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:50 smithi179 bash[23186]: audit 2024-09-21T04:33:49.285721+0000 mon.a (mon.0) 13106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:50 smithi044 bash[22676]: cluster 2024-09-21T04:33:48.575466+0000 mgr.a (mgr.14388) 16420 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:50 smithi044 bash[22676]: audit 2024-09-21T04:33:49.123515+0000 mon.a (mon.0) 13101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:50 smithi044 bash[22676]: audit 2024-09-21T04:33:49.132500+0000 mon.a (mon.0) 13102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:50 smithi044 bash[22676]: audit 2024-09-21T04:33:49.143720+0000 mon.a (mon.0) 13103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:50 smithi044 bash[22676]: audit 2024-09-21T04:33:49.264170+0000 mon.a (mon.0) 13104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:50 smithi044 bash[22676]: audit 2024-09-21T04:33:49.274096+0000 mon.a (mon.0) 13105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:50 smithi044 bash[22676]: audit 2024-09-21T04:33:49.285721+0000 mon.a (mon.0) 13106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:50 smithi049 bash[23528]: cluster 2024-09-21T04:33:48.575466+0000 mgr.a (mgr.14388) 16420 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:50 smithi049 bash[23528]: audit 2024-09-21T04:33:49.123515+0000 mon.a (mon.0) 13101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:50 smithi049 bash[23528]: audit 2024-09-21T04:33:49.132500+0000 mon.a (mon.0) 13102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:50 smithi049 bash[23528]: audit 2024-09-21T04:33:49.143720+0000 mon.a (mon.0) 13103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:50 smithi049 bash[23528]: audit 2024-09-21T04:33:49.264170+0000 mon.a (mon.0) 13104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:50 smithi049 bash[23528]: audit 2024-09-21T04:33:49.274096+0000 mon.a (mon.0) 13105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:50.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:50 smithi049 bash[23528]: audit 2024-09-21T04:33:49.285721+0000 mon.a (mon.0) 13106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:52 smithi044 bash[22676]: cluster 2024-09-21T04:33:50.577699+0000 mgr.a (mgr.14388) 16421 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:52 smithi179 bash[23186]: cluster 2024-09-21T04:33:50.577699+0000 mgr.a (mgr.14388) 16421 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:52 smithi049 bash[23528]: cluster 2024-09-21T04:33:50.577699+0000 mgr.a (mgr.14388) 16421 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:52.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:52.802 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:53.591 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:53.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:53.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:53.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:53.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:54 smithi044 bash[22676]: cluster 2024-09-21T04:33:52.578472+0000 mgr.a (mgr.14388) 16422 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:54.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:54 smithi044 bash[22676]: audit 2024-09-21T04:33:53.133863+0000 mgr.a (mgr.14388) 16423 : audit [DBG] from='client.354432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:54 smithi179 bash[23186]: cluster 2024-09-21T04:33:52.578472+0000 mgr.a (mgr.14388) 16422 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:54 smithi179 bash[23186]: audit 2024-09-21T04:33:53.133863+0000 mgr.a (mgr.14388) 16423 : audit [DBG] from='client.354432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:54 smithi049 bash[23528]: cluster 2024-09-21T04:33:52.578472+0000 mgr.a (mgr.14388) 16422 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:54 smithi049 bash[23528]: audit 2024-09-21T04:33:53.133863+0000 mgr.a (mgr.14388) 16423 : audit [DBG] from='client.354432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:33:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:56 smithi044 bash[22676]: cluster 2024-09-21T04:33:54.579466+0000 mgr.a (mgr.14388) 16424 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:56 smithi179 bash[23186]: cluster 2024-09-21T04:33:54.579466+0000 mgr.a (mgr.14388) 16424 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:56 smithi049 bash[23528]: cluster 2024-09-21T04:33:54.579466+0000 mgr.a (mgr.14388) 16424 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:33:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:58 smithi044 bash[22676]: cluster 2024-09-21T04:33:56.581789+0000 mgr.a (mgr.14388) 16425 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:58 smithi179 bash[23186]: cluster 2024-09-21T04:33:56.581789+0000 mgr.a (mgr.14388) 16425 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:58 smithi049 bash[23528]: cluster 2024-09-21T04:33:56.581789+0000 mgr.a (mgr.14388) 16425 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:33:58.592 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:33:58.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:33:58.593 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:33:59.386 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:33:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:33:59.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:33:59.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:33:59.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:33:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:59 smithi044 bash[22676]: audit 2024-09-21T04:33:58.195978+0000 mon.a (mon.0) 13107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:59 smithi044 bash[22676]: audit 2024-09-21T04:33:58.205647+0000 mon.a (mon.0) 13108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:33:59 smithi044 bash[22676]: audit 2024-09-21T04:33:58.217694+0000 mon.a (mon.0) 13109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:59 smithi179 bash[23186]: audit 2024-09-21T04:33:58.195978+0000 mon.a (mon.0) 13107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:59 smithi179 bash[23186]: audit 2024-09-21T04:33:58.205647+0000 mon.a (mon.0) 13108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:33:59 smithi179 bash[23186]: audit 2024-09-21T04:33:58.217694+0000 mon.a (mon.0) 13109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:59 smithi049 bash[23528]: audit 2024-09-21T04:33:58.195978+0000 mon.a (mon.0) 13107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:59 smithi049 bash[23528]: audit 2024-09-21T04:33:58.205647+0000 mon.a (mon.0) 13108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:33:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:33:59 smithi049 bash[23528]: audit 2024-09-21T04:33:58.217694+0000 mon.a (mon.0) 13109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:00 smithi044 bash[22676]: cluster 2024-09-21T04:33:58.582568+0000 mgr.a (mgr.14388) 16426 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:00 smithi044 bash[22676]: audit 2024-09-21T04:33:58.932957+0000 mgr.a (mgr.14388) 16427 : audit [DBG] from='client.354504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:00 smithi179 bash[23186]: cluster 2024-09-21T04:33:58.582568+0000 mgr.a (mgr.14388) 16426 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:00 smithi179 bash[23186]: audit 2024-09-21T04:33:58.932957+0000 mgr.a (mgr.14388) 16427 : audit [DBG] from='client.354504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:00 smithi049 bash[23528]: cluster 2024-09-21T04:33:58.582568+0000 mgr.a (mgr.14388) 16426 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:00 smithi049 bash[23528]: audit 2024-09-21T04:33:58.932957+0000 mgr.a (mgr.14388) 16427 : audit [DBG] from='client.354504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:02.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22930]: debug 2024-09-21T04:34:02.034+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:34:02.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22930]: debug 2024-09-21T04:34:02.038+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:34:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22676]: cluster 2024-09-21T04:34:00.584941+0000 mgr.a (mgr.14388) 16428 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22676]: audit 2024-09-21T04:34:01.235218+0000 mon.a (mon.0) 13110 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:34:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22676]: audit 2024-09-21T04:34:01.242178+0000 mon.a (mon.0) 13111 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:34:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22676]: audit 2024-09-21T04:34:01.244084+0000 mon.a (mon.0) 13112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:34:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22676]: audit 2024-09-21T04:34:01.256635+0000 mon.a (mon.0) 13113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:02 smithi044 bash[22676]: audit 2024-09-21T04:34:01.263014+0000 mon.a (mon.0) 13114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:34:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:02 smithi179 bash[23186]: cluster 2024-09-21T04:34:00.584941+0000 mgr.a (mgr.14388) 16428 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:02 smithi179 bash[23186]: audit 2024-09-21T04:34:01.235218+0000 mon.a (mon.0) 13110 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:34:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:02 smithi179 bash[23186]: audit 2024-09-21T04:34:01.242178+0000 mon.a (mon.0) 13111 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:34:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:02 smithi179 bash[23186]: audit 2024-09-21T04:34:01.244084+0000 mon.a (mon.0) 13112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:34:02.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:02 smithi179 bash[23186]: audit 2024-09-21T04:34:01.256635+0000 mon.a (mon.0) 13113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:02.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:02 smithi179 bash[23186]: audit 2024-09-21T04:34:01.263014+0000 mon.a (mon.0) 13114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:34:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:02 smithi049 bash[23528]: cluster 2024-09-21T04:34:00.584941+0000 mgr.a (mgr.14388) 16428 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:02 smithi049 bash[23528]: audit 2024-09-21T04:34:01.235218+0000 mon.a (mon.0) 13110 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:34:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:02 smithi049 bash[23528]: audit 2024-09-21T04:34:01.242178+0000 mon.a (mon.0) 13111 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:34:02.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:02 smithi049 bash[23528]: audit 2024-09-21T04:34:01.244084+0000 mon.a (mon.0) 13112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:34:02.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:02 smithi049 bash[23528]: audit 2024-09-21T04:34:01.256635+0000 mon.a (mon.0) 13113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:02.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:02 smithi049 bash[23528]: audit 2024-09-21T04:34:01.263014+0000 mon.a (mon.0) 13114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:34:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:03 smithi044 bash[22676]: audit 2024-09-21T04:34:01.265440+0000 mgr.a (mgr.14388) 16429 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:34:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:03 smithi044 bash[22676]: audit 2024-09-21T04:34:02.041045+0000 mgr.a (mgr.14388) 16430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:34:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:03 smithi044 bash[22676]: cephadm 2024-09-21T04:34:02.042948+0000 mgr.a (mgr.14388) 16431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:34:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:03 smithi179 bash[23186]: audit 2024-09-21T04:34:01.265440+0000 mgr.a (mgr.14388) 16429 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:34:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:03 smithi179 bash[23186]: audit 2024-09-21T04:34:02.041045+0000 mgr.a (mgr.14388) 16430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:34:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:03 smithi179 bash[23186]: cephadm 2024-09-21T04:34:02.042948+0000 mgr.a (mgr.14388) 16431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:34:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:03 smithi049 bash[23528]: audit 2024-09-21T04:34:01.265440+0000 mgr.a (mgr.14388) 16429 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:34:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:03 smithi049 bash[23528]: audit 2024-09-21T04:34:02.041045+0000 mgr.a (mgr.14388) 16430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:34:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:03 smithi049 bash[23528]: cephadm 2024-09-21T04:34:02.042948+0000 mgr.a (mgr.14388) 16431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:34:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:04 smithi049 bash[23528]: cluster 2024-09-21T04:34:02.585925+0000 mgr.a (mgr.14388) 16432 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:04.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:04 smithi044 bash[22676]: cluster 2024-09-21T04:34:02.585925+0000 mgr.a (mgr.14388) 16432 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:04 smithi179 bash[23186]: cluster 2024-09-21T04:34:02.585925+0000 mgr.a (mgr.14388) 16432 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:05.187 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:05.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:05.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:05.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:05.188 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:06 smithi179 bash[23186]: cluster 2024-09-21T04:34:04.586691+0000 mgr.a (mgr.14388) 16433 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:06 smithi179 bash[23186]: audit 2024-09-21T04:34:04.727390+0000 mgr.a (mgr.14388) 16434 : audit [DBG] from='client.354690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:06 smithi049 bash[23528]: cluster 2024-09-21T04:34:04.586691+0000 mgr.a (mgr.14388) 16433 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:06 smithi049 bash[23528]: audit 2024-09-21T04:34:04.727390+0000 mgr.a (mgr.14388) 16434 : audit [DBG] from='client.354690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:06.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:06 smithi044 bash[22676]: cluster 2024-09-21T04:34:04.586691+0000 mgr.a (mgr.14388) 16433 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:06.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:06 smithi044 bash[22676]: audit 2024-09-21T04:34:04.727390+0000 mgr.a (mgr.14388) 16434 : audit [DBG] from='client.354690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:08 smithi179 bash[23186]: cluster 2024-09-21T04:34:06.588349+0000 mgr.a (mgr.14388) 16435 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:08 smithi049 bash[23528]: cluster 2024-09-21T04:34:06.588349+0000 mgr.a (mgr.14388) 16435 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:08 smithi044 bash[22676]: cluster 2024-09-21T04:34:06.588349+0000 mgr.a (mgr.14388) 16435 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:10.189 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:10.190 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:10 smithi179 bash[23186]: cluster 2024-09-21T04:34:08.589312+0000 mgr.a (mgr.14388) 16436 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:10 smithi179 bash[23186]: audit 2024-09-21T04:34:09.335821+0000 mon.a (mon.0) 13115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:10 smithi179 bash[23186]: audit 2024-09-21T04:34:09.343772+0000 mon.a (mon.0) 13116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:10 smithi179 bash[23186]: audit 2024-09-21T04:34:09.352019+0000 mon.a (mon.0) 13117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:10 smithi179 bash[23186]: audit 2024-09-21T04:34:09.504464+0000 mon.a (mon.0) 13118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:10 smithi179 bash[23186]: audit 2024-09-21T04:34:09.513324+0000 mon.a (mon.0) 13119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:10 smithi179 bash[23186]: audit 2024-09-21T04:34:09.523397+0000 mon.a (mon.0) 13120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:10 smithi049 bash[23528]: cluster 2024-09-21T04:34:08.589312+0000 mgr.a (mgr.14388) 16436 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:10 smithi049 bash[23528]: audit 2024-09-21T04:34:09.335821+0000 mon.a (mon.0) 13115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:10 smithi049 bash[23528]: audit 2024-09-21T04:34:09.343772+0000 mon.a (mon.0) 13116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:10 smithi049 bash[23528]: audit 2024-09-21T04:34:09.352019+0000 mon.a (mon.0) 13117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:10 smithi049 bash[23528]: audit 2024-09-21T04:34:09.504464+0000 mon.a (mon.0) 13118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:10 smithi049 bash[23528]: audit 2024-09-21T04:34:09.513324+0000 mon.a (mon.0) 13119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:10 smithi049 bash[23528]: audit 2024-09-21T04:34:09.523397+0000 mon.a (mon.0) 13120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:10 smithi044 bash[22676]: cluster 2024-09-21T04:34:08.589312+0000 mgr.a (mgr.14388) 16436 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:10 smithi044 bash[22676]: audit 2024-09-21T04:34:09.335821+0000 mon.a (mon.0) 13115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:10 smithi044 bash[22676]: audit 2024-09-21T04:34:09.343772+0000 mon.a (mon.0) 13116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:10 smithi044 bash[22676]: audit 2024-09-21T04:34:09.352019+0000 mon.a (mon.0) 13117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:10 smithi044 bash[22676]: audit 2024-09-21T04:34:09.504464+0000 mon.a (mon.0) 13118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:10 smithi044 bash[22676]: audit 2024-09-21T04:34:09.513324+0000 mon.a (mon.0) 13119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:10 smithi044 bash[22676]: audit 2024-09-21T04:34:09.523397+0000 mon.a (mon.0) 13120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:10.982 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:10.982 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:12.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:12 smithi179 bash[23186]: audit 2024-09-21T04:34:10.524478+0000 mgr.a (mgr.14388) 16437 : audit [DBG] from='client.354762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:12.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:12 smithi179 bash[23186]: cluster 2024-09-21T04:34:10.590788+0000 mgr.a (mgr.14388) 16438 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:12 smithi049 bash[23528]: audit 2024-09-21T04:34:10.524478+0000 mgr.a (mgr.14388) 16437 : audit [DBG] from='client.354762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:12 smithi049 bash[23528]: cluster 2024-09-21T04:34:10.590788+0000 mgr.a (mgr.14388) 16438 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:12 smithi044 bash[22676]: audit 2024-09-21T04:34:10.524478+0000 mgr.a (mgr.14388) 16437 : audit [DBG] from='client.354762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:12.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:12 smithi044 bash[22676]: cluster 2024-09-21T04:34:10.590788+0000 mgr.a (mgr.14388) 16438 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:14 smithi049 bash[23528]: cluster 2024-09-21T04:34:12.591686+0000 mgr.a (mgr.14388) 16439 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:14 smithi044 bash[22676]: cluster 2024-09-21T04:34:12.591686+0000 mgr.a (mgr.14388) 16439 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:14 smithi179 bash[23186]: cluster 2024-09-21T04:34:12.591686+0000 mgr.a (mgr.14388) 16439 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:15.984 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:15.985 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:15.985 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:16 smithi049 bash[23528]: cluster 2024-09-21T04:34:14.592486+0000 mgr.a (mgr.14388) 16440 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:16 smithi044 bash[22676]: cluster 2024-09-21T04:34:14.592486+0000 mgr.a (mgr.14388) 16440 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:16.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:16.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:16.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:16.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:16.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:16 smithi179 bash[23186]: cluster 2024-09-21T04:34:14.592486+0000 mgr.a (mgr.14388) 16440 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:34:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:17 smithi049 bash[23528]: audit 2024-09-21T04:34:16.317121+0000 mgr.a (mgr.14388) 16441 : audit [DBG] from='client.354840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:17 smithi049 bash[23528]: cluster 2024-09-21T04:34:16.593911+0000 mgr.a (mgr.14388) 16442 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:17 smithi044 bash[22676]: audit 2024-09-21T04:34:16.317121+0000 mgr.a (mgr.14388) 16441 : audit [DBG] from='client.354840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:17 smithi044 bash[22676]: cluster 2024-09-21T04:34:16.593911+0000 mgr.a (mgr.14388) 16442 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:17 smithi179 bash[23186]: audit 2024-09-21T04:34:16.317121+0000 mgr.a (mgr.14388) 16441 : audit [DBG] from='client.354840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:17 smithi179 bash[23186]: cluster 2024-09-21T04:34:16.593911+0000 mgr.a (mgr.14388) 16442 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:34:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:19 smithi044 bash[22676]: audit 2024-09-21T04:34:18.404561+0000 mon.a (mon.0) 13121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:19 smithi044 bash[22676]: audit 2024-09-21T04:34:18.413369+0000 mon.a (mon.0) 13122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:19 smithi044 bash[22676]: audit 2024-09-21T04:34:18.424090+0000 mon.a (mon.0) 13123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:19 smithi044 bash[22676]: cluster 2024-09-21T04:34:18.594730+0000 mgr.a (mgr.14388) 16443 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:34:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:19 smithi179 bash[23186]: audit 2024-09-21T04:34:18.404561+0000 mon.a (mon.0) 13121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:19 smithi179 bash[23186]: audit 2024-09-21T04:34:18.413369+0000 mon.a (mon.0) 13122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:19 smithi179 bash[23186]: audit 2024-09-21T04:34:18.424090+0000 mon.a (mon.0) 13123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:19 smithi179 bash[23186]: cluster 2024-09-21T04:34:18.594730+0000 mgr.a (mgr.14388) 16443 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:34:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:19 smithi049 bash[23528]: audit 2024-09-21T04:34:18.404561+0000 mon.a (mon.0) 13121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:19 smithi049 bash[23528]: audit 2024-09-21T04:34:18.413369+0000 mon.a (mon.0) 13122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:19 smithi049 bash[23528]: audit 2024-09-21T04:34:18.424090+0000 mon.a (mon.0) 13123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:19 smithi049 bash[23528]: cluster 2024-09-21T04:34:18.594730+0000 mgr.a (mgr.14388) 16443 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:34:21.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:21.746 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:21.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:21 smithi044 bash[22676]: cluster 2024-09-21T04:34:20.596878+0000 mgr.a (mgr.14388) 16444 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:34:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:21 smithi179 bash[23186]: cluster 2024-09-21T04:34:20.596878+0000 mgr.a (mgr.14388) 16444 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:34:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:21 smithi049 bash[23528]: cluster 2024-09-21T04:34:20.596878+0000 mgr.a (mgr.14388) 16444 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:34:22.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:22.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:22.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:22.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:22.525 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:22 smithi044 bash[22676]: audit 2024-09-21T04:34:22.077585+0000 mgr.a (mgr.14388) 16445 : audit [DBG] from='client.354918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:22 smithi179 bash[23186]: audit 2024-09-21T04:34:22.077585+0000 mgr.a (mgr.14388) 16445 : audit [DBG] from='client.354918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:23.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:22 smithi049 bash[23528]: audit 2024-09-21T04:34:22.077585+0000 mgr.a (mgr.14388) 16445 : audit [DBG] from='client.354918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:23 smithi044 bash[22676]: cluster 2024-09-21T04:34:22.597552+0000 mgr.a (mgr.14388) 16446 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:23 smithi179 bash[23186]: cluster 2024-09-21T04:34:22.597552+0000 mgr.a (mgr.14388) 16446 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:23 smithi049 bash[23528]: cluster 2024-09-21T04:34:22.597552+0000 mgr.a (mgr.14388) 16446 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:25 smithi049 bash[23528]: cluster 2024-09-21T04:34:24.598308+0000 mgr.a (mgr.14388) 16447 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:25 smithi044 bash[22676]: cluster 2024-09-21T04:34:24.598308+0000 mgr.a (mgr.14388) 16447 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:25 smithi179 bash[23186]: cluster 2024-09-21T04:34:24.598308+0000 mgr.a (mgr.14388) 16447 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:27.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:27.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:27.526 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:27 smithi044 bash[22676]: cluster 2024-09-21T04:34:26.600569+0000 mgr.a (mgr.14388) 16448 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:27 smithi179 bash[23186]: cluster 2024-09-21T04:34:26.600569+0000 mgr.a (mgr.14388) 16448 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:27 smithi049 bash[23528]: cluster 2024-09-21T04:34:26.600569+0000 mgr.a (mgr.14388) 16448 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:28.279 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:28.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:28.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:28.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:28.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:28 smithi044 bash[22676]: audit 2024-09-21T04:34:27.843507+0000 mgr.a (mgr.14388) 16449 : audit [DBG] from='client.354996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:28 smithi179 bash[23186]: audit 2024-09-21T04:34:27.843507+0000 mgr.a (mgr.14388) 16449 : audit [DBG] from='client.354996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:28 smithi049 bash[23528]: audit 2024-09-21T04:34:27.843507+0000 mgr.a (mgr.14388) 16449 : audit [DBG] from='client.354996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:29 smithi044 bash[22676]: cluster 2024-09-21T04:34:28.601575+0000 mgr.a (mgr.14388) 16450 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:29 smithi044 bash[22676]: audit 2024-09-21T04:34:29.564522+0000 mon.a (mon.0) 13124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:29 smithi044 bash[22676]: audit 2024-09-21T04:34:29.571749+0000 mon.a (mon.0) 13125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:29 smithi044 bash[22676]: audit 2024-09-21T04:34:29.581990+0000 mon.a (mon.0) 13126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:29 smithi179 bash[23186]: cluster 2024-09-21T04:34:28.601575+0000 mgr.a (mgr.14388) 16450 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:29 smithi179 bash[23186]: audit 2024-09-21T04:34:29.564522+0000 mon.a (mon.0) 13124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:29 smithi179 bash[23186]: audit 2024-09-21T04:34:29.571749+0000 mon.a (mon.0) 13125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:29 smithi179 bash[23186]: audit 2024-09-21T04:34:29.581990+0000 mon.a (mon.0) 13126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:29 smithi049 bash[23528]: cluster 2024-09-21T04:34:28.601575+0000 mgr.a (mgr.14388) 16450 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:29 smithi049 bash[23528]: audit 2024-09-21T04:34:29.564522+0000 mon.a (mon.0) 13124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:29 smithi049 bash[23528]: audit 2024-09-21T04:34:29.571749+0000 mon.a (mon.0) 13125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:29 smithi049 bash[23528]: audit 2024-09-21T04:34:29.581990+0000 mon.a (mon.0) 13126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:30 smithi179 bash[23186]: audit 2024-09-21T04:34:29.748480+0000 mon.a (mon.0) 13127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:30 smithi179 bash[23186]: audit 2024-09-21T04:34:29.756217+0000 mon.a (mon.0) 13128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:30 smithi179 bash[23186]: audit 2024-09-21T04:34:29.767462+0000 mon.a (mon.0) 13129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:30 smithi049 bash[23528]: audit 2024-09-21T04:34:29.748480+0000 mon.a (mon.0) 13127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:30 smithi049 bash[23528]: audit 2024-09-21T04:34:29.756217+0000 mon.a (mon.0) 13128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:30 smithi049 bash[23528]: audit 2024-09-21T04:34:29.767462+0000 mon.a (mon.0) 13129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:30 smithi044 bash[22676]: audit 2024-09-21T04:34:29.748480+0000 mon.a (mon.0) 13127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:30 smithi044 bash[22676]: audit 2024-09-21T04:34:29.756217+0000 mon.a (mon.0) 13128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:30 smithi044 bash[22676]: audit 2024-09-21T04:34:29.767462+0000 mon.a (mon.0) 13129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:31 smithi049 bash[23528]: cluster 2024-09-21T04:34:30.603774+0000 mgr.a (mgr.14388) 16451 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:32.077 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:31 smithi179 bash[23186]: cluster 2024-09-21T04:34:30.603774+0000 mgr.a (mgr.14388) 16451 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:31 smithi044 bash[22676]: cluster 2024-09-21T04:34:30.603774+0000 mgr.a (mgr.14388) 16451 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:33.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:33.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:33.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:34.045 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:34.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:34.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:34.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:34.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:33 smithi049 bash[23528]: cluster 2024-09-21T04:34:32.604543+0000 mgr.a (mgr.14388) 16452 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:33 smithi044 bash[22676]: cluster 2024-09-21T04:34:32.604543+0000 mgr.a (mgr.14388) 16452 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:33 smithi179 bash[23186]: cluster 2024-09-21T04:34:32.604543+0000 mgr.a (mgr.14388) 16452 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:34 smithi049 bash[23528]: audit 2024-09-21T04:34:33.609626+0000 mgr.a (mgr.14388) 16453 : audit [DBG] from='client.355071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:34 smithi044 bash[22676]: audit 2024-09-21T04:34:33.609626+0000 mgr.a (mgr.14388) 16453 : audit [DBG] from='client.355071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:34 smithi179 bash[23186]: audit 2024-09-21T04:34:33.609626+0000 mgr.a (mgr.14388) 16453 : audit [DBG] from='client.355071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:35 smithi049 bash[23528]: cluster 2024-09-21T04:34:34.605562+0000 mgr.a (mgr.14388) 16454 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:35 smithi044 bash[22676]: cluster 2024-09-21T04:34:34.605562+0000 mgr.a (mgr.14388) 16454 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:35 smithi179 bash[23186]: cluster 2024-09-21T04:34:34.605562+0000 mgr.a (mgr.14388) 16454 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:37 smithi049 bash[23528]: cluster 2024-09-21T04:34:36.607777+0000 mgr.a (mgr.14388) 16455 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:37 smithi044 bash[22676]: cluster 2024-09-21T04:34:36.607777+0000 mgr.a (mgr.14388) 16455 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:37 smithi179 bash[23186]: cluster 2024-09-21T04:34:36.607777+0000 mgr.a (mgr.14388) 16455 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:39.047 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:39.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:39.048 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:39.830 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:39 smithi044 bash[22676]: cluster 2024-09-21T04:34:38.608682+0000 mgr.a (mgr.14388) 16456 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:39 smithi044 bash[22676]: audit 2024-09-21T04:34:38.639536+0000 mon.a (mon.0) 13130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:39 smithi044 bash[22676]: audit 2024-09-21T04:34:38.648630+0000 mon.a (mon.0) 13131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:39 smithi044 bash[22676]: audit 2024-09-21T04:34:38.659549+0000 mon.a (mon.0) 13132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:39 smithi179 bash[23186]: cluster 2024-09-21T04:34:38.608682+0000 mgr.a (mgr.14388) 16456 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:39 smithi179 bash[23186]: audit 2024-09-21T04:34:38.639536+0000 mon.a (mon.0) 13130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:39 smithi179 bash[23186]: audit 2024-09-21T04:34:38.648630+0000 mon.a (mon.0) 13131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:39 smithi179 bash[23186]: audit 2024-09-21T04:34:38.659549+0000 mon.a (mon.0) 13132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:39 smithi049 bash[23528]: cluster 2024-09-21T04:34:38.608682+0000 mgr.a (mgr.14388) 16456 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:39 smithi049 bash[23528]: audit 2024-09-21T04:34:38.639536+0000 mon.a (mon.0) 13130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:39 smithi049 bash[23528]: audit 2024-09-21T04:34:38.648630+0000 mon.a (mon.0) 13131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:39 smithi049 bash[23528]: audit 2024-09-21T04:34:38.659549+0000 mon.a (mon.0) 13132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:40 smithi044 bash[22676]: audit 2024-09-21T04:34:39.382454+0000 mgr.a (mgr.14388) 16457 : audit [DBG] from='client.355149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:40 smithi179 bash[23186]: audit 2024-09-21T04:34:39.382454+0000 mgr.a (mgr.14388) 16457 : audit [DBG] from='client.355149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:40 smithi049 bash[23528]: audit 2024-09-21T04:34:39.382454+0000 mgr.a (mgr.14388) 16457 : audit [DBG] from='client.355149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:41 smithi044 bash[22676]: cluster 2024-09-21T04:34:40.611070+0000 mgr.a (mgr.14388) 16458 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:41 smithi179 bash[23186]: cluster 2024-09-21T04:34:40.611070+0000 mgr.a (mgr.14388) 16458 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:41 smithi049 bash[23528]: cluster 2024-09-21T04:34:40.611070+0000 mgr.a (mgr.14388) 16458 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:34:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:43 smithi044 bash[22676]: cluster 2024-09-21T04:34:42.611860+0000 mgr.a (mgr.14388) 16459 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:43 smithi179 bash[23186]: cluster 2024-09-21T04:34:42.611860+0000 mgr.a (mgr.14388) 16459 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:43 smithi049 bash[23528]: cluster 2024-09-21T04:34:42.611860+0000 mgr.a (mgr.14388) 16459 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:44.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:44.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:44.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:45.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:45.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:45.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:45.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:45 smithi044 bash[22676]: cluster 2024-09-21T04:34:44.612640+0000 mgr.a (mgr.14388) 16460 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:45 smithi044 bash[22676]: audit 2024-09-21T04:34:45.167741+0000 mgr.a (mgr.14388) 16461 : audit [DBG] from='client.124574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:45 smithi179 bash[23186]: cluster 2024-09-21T04:34:44.612640+0000 mgr.a (mgr.14388) 16460 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:45 smithi179 bash[23186]: audit 2024-09-21T04:34:45.167741+0000 mgr.a (mgr.14388) 16461 : audit [DBG] from='client.124574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:45 smithi049 bash[23528]: cluster 2024-09-21T04:34:44.612640+0000 mgr.a (mgr.14388) 16460 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:45 smithi049 bash[23528]: audit 2024-09-21T04:34:45.167741+0000 mgr.a (mgr.14388) 16461 : audit [DBG] from='client.124574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:47.933 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:47 smithi044 bash[22676]: cluster 2024-09-21T04:34:46.615570+0000 mgr.a (mgr.14388) 16462 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:47 smithi179 bash[23186]: cluster 2024-09-21T04:34:46.615570+0000 mgr.a (mgr.14388) 16462 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:47 smithi049 bash[23528]: cluster 2024-09-21T04:34:46.615570+0000 mgr.a (mgr.14388) 16462 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:49.986 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:49 smithi044 bash[22676]: cluster 2024-09-21T04:34:48.616267+0000 mgr.a (mgr.14388) 16463 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:34:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:49 smithi179 bash[23186]: cluster 2024-09-21T04:34:48.616267+0000 mgr.a (mgr.14388) 16463 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:34:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:49 smithi049 bash[23528]: cluster 2024-09-21T04:34:48.616267+0000 mgr.a (mgr.14388) 16463 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:34:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:50.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:50 smithi179 bash[23186]: audit 2024-09-21T04:34:49.791049+0000 mon.a (mon.0) 13133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:50 smithi179 bash[23186]: audit 2024-09-21T04:34:49.799443+0000 mon.a (mon.0) 13134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:50 smithi179 bash[23186]: audit 2024-09-21T04:34:49.812214+0000 mon.a (mon.0) 13135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:50 smithi179 bash[23186]: audit 2024-09-21T04:34:49.963865+0000 mon.a (mon.0) 13136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:50 smithi179 bash[23186]: audit 2024-09-21T04:34:49.971433+0000 mon.a (mon.0) 13137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:50 smithi179 bash[23186]: audit 2024-09-21T04:34:49.981436+0000 mon.a (mon.0) 13138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:50 smithi049 bash[23528]: audit 2024-09-21T04:34:49.791049+0000 mon.a (mon.0) 13133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:50 smithi049 bash[23528]: audit 2024-09-21T04:34:49.799443+0000 mon.a (mon.0) 13134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:50 smithi049 bash[23528]: audit 2024-09-21T04:34:49.812214+0000 mon.a (mon.0) 13135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:50 smithi049 bash[23528]: audit 2024-09-21T04:34:49.963865+0000 mon.a (mon.0) 13136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:50 smithi049 bash[23528]: audit 2024-09-21T04:34:49.971433+0000 mon.a (mon.0) 13137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:50 smithi049 bash[23528]: audit 2024-09-21T04:34:49.981436+0000 mon.a (mon.0) 13138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:50 smithi044 bash[22676]: audit 2024-09-21T04:34:49.791049+0000 mon.a (mon.0) 13133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:50 smithi044 bash[22676]: audit 2024-09-21T04:34:49.799443+0000 mon.a (mon.0) 13134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:50 smithi044 bash[22676]: audit 2024-09-21T04:34:49.812214+0000 mon.a (mon.0) 13135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:50 smithi044 bash[22676]: audit 2024-09-21T04:34:49.963865+0000 mon.a (mon.0) 13136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:50 smithi044 bash[22676]: audit 2024-09-21T04:34:49.971433+0000 mon.a (mon.0) 13137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:50 smithi044 bash[22676]: audit 2024-09-21T04:34:49.981436+0000 mon.a (mon.0) 13138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:34:51.432 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:51.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:51.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:51.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:51.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:52.178 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:51 smithi179 bash[23186]: cluster 2024-09-21T04:34:50.618249+0000 mgr.a (mgr.14388) 16464 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:52.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:51 smithi179 bash[23186]: audit 2024-09-21T04:34:50.972505+0000 mgr.a (mgr.14388) 16465 : audit [DBG] from='client.355296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:51 smithi044 bash[22676]: cluster 2024-09-21T04:34:50.618249+0000 mgr.a (mgr.14388) 16464 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:51 smithi044 bash[22676]: audit 2024-09-21T04:34:50.972505+0000 mgr.a (mgr.14388) 16465 : audit [DBG] from='client.355296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:51 smithi049 bash[23528]: cluster 2024-09-21T04:34:50.618249+0000 mgr.a (mgr.14388) 16464 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:51 smithi049 bash[23528]: audit 2024-09-21T04:34:50.972505+0000 mgr.a (mgr.14388) 16465 : audit [DBG] from='client.355296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:53 smithi044 bash[22676]: cluster 2024-09-21T04:34:52.619153+0000 mgr.a (mgr.14388) 16466 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:34:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:53 smithi179 bash[23186]: cluster 2024-09-21T04:34:52.619153+0000 mgr.a (mgr.14388) 16466 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:34:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:53 smithi049 bash[23528]: cluster 2024-09-21T04:34:52.619153+0000 mgr.a (mgr.14388) 16466 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:34:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:55 smithi179 bash[23186]: cluster 2024-09-21T04:34:54.619950+0000 mgr.a (mgr.14388) 16467 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:34:56.303 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:55 smithi049 bash[23528]: cluster 2024-09-21T04:34:54.619950+0000 mgr.a (mgr.14388) 16467 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:34:56.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:34:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:34:56.435 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:34:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:55 smithi044 bash[22676]: cluster 2024-09-21T04:34:54.619950+0000 mgr.a (mgr.14388) 16467 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:34:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:34:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:34:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:34:57.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:34:57.227 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:34:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:57 smithi179 bash[23186]: cluster 2024-09-21T04:34:56.621366+0000 mgr.a (mgr.14388) 16468 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:57 smithi179 bash[23186]: audit 2024-09-21T04:34:56.774022+0000 mgr.a (mgr.14388) 16469 : audit [DBG] from='client.355371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:57 smithi049 bash[23528]: cluster 2024-09-21T04:34:56.621366+0000 mgr.a (mgr.14388) 16468 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:57 smithi049 bash[23528]: audit 2024-09-21T04:34:56.774022+0000 mgr.a (mgr.14388) 16469 : audit [DBG] from='client.355371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:34:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:57 smithi044 bash[22676]: cluster 2024-09-21T04:34:56.621366+0000 mgr.a (mgr.14388) 16468 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:34:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:57 smithi044 bash[22676]: audit 2024-09-21T04:34:56.774022+0000 mgr.a (mgr.14388) 16469 : audit [DBG] from='client.355371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:59 smithi044 bash[22676]: cluster 2024-09-21T04:34:58.622244+0000 mgr.a (mgr.14388) 16470 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:59 smithi044 bash[22676]: audit 2024-09-21T04:34:58.870141+0000 mon.a (mon.0) 13139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:59 smithi044 bash[22676]: audit 2024-09-21T04:34:58.878757+0000 mon.a (mon.0) 13140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:34:59 smithi044 bash[22676]: audit 2024-09-21T04:34:58.889326+0000 mon.a (mon.0) 13141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:59 smithi179 bash[23186]: cluster 2024-09-21T04:34:58.622244+0000 mgr.a (mgr.14388) 16470 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:59 smithi179 bash[23186]: audit 2024-09-21T04:34:58.870141+0000 mon.a (mon.0) 13139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:59 smithi179 bash[23186]: audit 2024-09-21T04:34:58.878757+0000 mon.a (mon.0) 13140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:34:59 smithi179 bash[23186]: audit 2024-09-21T04:34:58.889326+0000 mon.a (mon.0) 13141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:59 smithi049 bash[23528]: cluster 2024-09-21T04:34:58.622244+0000 mgr.a (mgr.14388) 16470 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:59 smithi049 bash[23528]: audit 2024-09-21T04:34:58.870141+0000 mon.a (mon.0) 13139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:59 smithi049 bash[23528]: audit 2024-09-21T04:34:58.878757+0000 mon.a (mon.0) 13140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:34:59 smithi049 bash[23528]: audit 2024-09-21T04:34:58.889326+0000 mon.a (mon.0) 13141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:01 smithi044 bash[22676]: cluster 2024-09-21T04:35:00.624412+0000 mgr.a (mgr.14388) 16471 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:01 smithi179 bash[23186]: cluster 2024-09-21T04:35:00.624412+0000 mgr.a (mgr.14388) 16471 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:01 smithi049 bash[23528]: cluster 2024-09-21T04:35:00.624412+0000 mgr.a (mgr.14388) 16471 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:03.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22930]: debug 2024-09-21T04:35:02.925+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:35:03.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22930]: debug 2024-09-21T04:35:02.937+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:35:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22676]: audit 2024-09-21T04:35:02.125756+0000 mon.a (mon.0) 13142 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:35:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22676]: audit 2024-09-21T04:35:02.132027+0000 mon.a (mon.0) 13143 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:35:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22676]: audit 2024-09-21T04:35:02.134062+0000 mon.a (mon.0) 13144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:35:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22676]: audit 2024-09-21T04:35:02.145091+0000 mon.a (mon.0) 13145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22676]: audit 2024-09-21T04:35:02.151311+0000 mon.a (mon.0) 13146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:35:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:02 smithi044 bash[22676]: audit 2024-09-21T04:35:02.153659+0000 mgr.a (mgr.14388) 16472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:35:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:02 smithi179 bash[23186]: audit 2024-09-21T04:35:02.125756+0000 mon.a (mon.0) 13142 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:35:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:02 smithi179 bash[23186]: audit 2024-09-21T04:35:02.132027+0000 mon.a (mon.0) 13143 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:35:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:02 smithi179 bash[23186]: audit 2024-09-21T04:35:02.134062+0000 mon.a (mon.0) 13144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:35:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:02 smithi179 bash[23186]: audit 2024-09-21T04:35:02.145091+0000 mon.a (mon.0) 13145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:02 smithi179 bash[23186]: audit 2024-09-21T04:35:02.151311+0000 mon.a (mon.0) 13146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:35:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:02 smithi179 bash[23186]: audit 2024-09-21T04:35:02.153659+0000 mgr.a (mgr.14388) 16472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:35:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:02 smithi049 bash[23528]: audit 2024-09-21T04:35:02.125756+0000 mon.a (mon.0) 13142 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:35:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:02 smithi049 bash[23528]: audit 2024-09-21T04:35:02.132027+0000 mon.a (mon.0) 13143 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:35:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:02 smithi049 bash[23528]: audit 2024-09-21T04:35:02.134062+0000 mon.a (mon.0) 13144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:35:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:02 smithi049 bash[23528]: audit 2024-09-21T04:35:02.145091+0000 mon.a (mon.0) 13145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:03.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:02 smithi049 bash[23528]: audit 2024-09-21T04:35:02.151311+0000 mon.a (mon.0) 13146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:35:03.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:02 smithi049 bash[23528]: audit 2024-09-21T04:35:02.153659+0000 mgr.a (mgr.14388) 16472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:35:03.333 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:04.411 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:04 smithi049 bash[23528]: audit 2024-09-21T04:35:02.564457+0000 mgr.a (mgr.14388) 16473 : audit [DBG] from='client.355467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:04.411 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:04 smithi049 bash[23528]: cluster 2024-09-21T04:35:02.625152+0000 mgr.a (mgr.14388) 16474 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:04.411 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:04 smithi049 bash[23528]: audit 2024-09-21T04:35:02.928389+0000 mgr.a (mgr.14388) 16475 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:35:04.411 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:04 smithi049 bash[23528]: cephadm 2024-09-21T04:35:02.940210+0000 mgr.a (mgr.14388) 16476 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:35:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:04 smithi044 bash[22676]: audit 2024-09-21T04:35:02.564457+0000 mgr.a (mgr.14388) 16473 : audit [DBG] from='client.355467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:04.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:04 smithi044 bash[22676]: cluster 2024-09-21T04:35:02.625152+0000 mgr.a (mgr.14388) 16474 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:04.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:04 smithi044 bash[22676]: audit 2024-09-21T04:35:02.928389+0000 mgr.a (mgr.14388) 16475 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:35:04.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:04 smithi044 bash[22676]: cephadm 2024-09-21T04:35:02.940210+0000 mgr.a (mgr.14388) 16476 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:35:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:04 smithi179 bash[23186]: audit 2024-09-21T04:35:02.564457+0000 mgr.a (mgr.14388) 16473 : audit [DBG] from='client.355467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:04 smithi179 bash[23186]: cluster 2024-09-21T04:35:02.625152+0000 mgr.a (mgr.14388) 16474 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:04 smithi179 bash[23186]: audit 2024-09-21T04:35:02.928389+0000 mgr.a (mgr.14388) 16475 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:35:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:04 smithi179 bash[23186]: cephadm 2024-09-21T04:35:02.940210+0000 mgr.a (mgr.14388) 16476 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:35:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:06 smithi044 bash[22676]: cluster 2024-09-21T04:35:04.625874+0000 mgr.a (mgr.14388) 16477 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:06 smithi179 bash[23186]: cluster 2024-09-21T04:35:04.625874+0000 mgr.a (mgr.14388) 16477 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:06 smithi049 bash[23528]: cluster 2024-09-21T04:35:04.625874+0000 mgr.a (mgr.14388) 16477 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:08.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:08.335 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:08.335 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:08.428 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:08 smithi044 bash[22676]: cluster 2024-09-21T04:35:06.628285+0000 mgr.a (mgr.14388) 16478 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:08 smithi179 bash[23186]: cluster 2024-09-21T04:35:06.628285+0000 mgr.a (mgr.14388) 16478 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:08 smithi049 bash[23528]: cluster 2024-09-21T04:35:06.628285+0000 mgr.a (mgr.14388) 16478 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:09.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:10 smithi044 bash[22676]: cluster 2024-09-21T04:35:08.629007+0000 mgr.a (mgr.14388) 16479 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:10 smithi044 bash[22676]: audit 2024-09-21T04:35:08.655528+0000 mgr.a (mgr.14388) 16480 : audit [DBG] from='client.355635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:10 smithi044 bash[22676]: audit 2024-09-21T04:35:10.023122+0000 mon.a (mon.0) 13147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:10 smithi044 bash[22676]: audit 2024-09-21T04:35:10.031098+0000 mon.a (mon.0) 13148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:10 smithi044 bash[22676]: audit 2024-09-21T04:35:10.040537+0000 mon.a (mon.0) 13149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:10 smithi179 bash[23186]: cluster 2024-09-21T04:35:08.629007+0000 mgr.a (mgr.14388) 16479 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:10 smithi179 bash[23186]: audit 2024-09-21T04:35:08.655528+0000 mgr.a (mgr.14388) 16480 : audit [DBG] from='client.355635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:10 smithi179 bash[23186]: audit 2024-09-21T04:35:10.023122+0000 mon.a (mon.0) 13147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:10 smithi179 bash[23186]: audit 2024-09-21T04:35:10.031098+0000 mon.a (mon.0) 13148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:10 smithi179 bash[23186]: audit 2024-09-21T04:35:10.040537+0000 mon.a (mon.0) 13149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:10 smithi049 bash[23528]: cluster 2024-09-21T04:35:08.629007+0000 mgr.a (mgr.14388) 16479 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:10 smithi049 bash[23528]: audit 2024-09-21T04:35:08.655528+0000 mgr.a (mgr.14388) 16480 : audit [DBG] from='client.355635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:10 smithi049 bash[23528]: audit 2024-09-21T04:35:10.023122+0000 mon.a (mon.0) 13147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:10 smithi049 bash[23528]: audit 2024-09-21T04:35:10.031098+0000 mon.a (mon.0) 13148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:10 smithi049 bash[23528]: audit 2024-09-21T04:35:10.040537+0000 mon.a (mon.0) 13149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:11 smithi044 bash[22676]: audit 2024-09-21T04:35:10.170177+0000 mon.a (mon.0) 13150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:11 smithi044 bash[22676]: audit 2024-09-21T04:35:10.178227+0000 mon.a (mon.0) 13151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:11 smithi044 bash[22676]: audit 2024-09-21T04:35:10.188530+0000 mon.a (mon.0) 13152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:11 smithi179 bash[23186]: audit 2024-09-21T04:35:10.170177+0000 mon.a (mon.0) 13150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:11 smithi179 bash[23186]: audit 2024-09-21T04:35:10.178227+0000 mon.a (mon.0) 13151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:11 smithi179 bash[23186]: audit 2024-09-21T04:35:10.188530+0000 mon.a (mon.0) 13152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:11 smithi049 bash[23528]: audit 2024-09-21T04:35:10.170177+0000 mon.a (mon.0) 13150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:11 smithi049 bash[23528]: audit 2024-09-21T04:35:10.178227+0000 mon.a (mon.0) 13151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:11 smithi049 bash[23528]: audit 2024-09-21T04:35:10.188530+0000 mon.a (mon.0) 13152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:12 smithi044 bash[22676]: cluster 2024-09-21T04:35:10.631349+0000 mgr.a (mgr.14388) 16481 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:12 smithi179 bash[23186]: cluster 2024-09-21T04:35:10.631349+0000 mgr.a (mgr.14388) 16481 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:12 smithi049 bash[23528]: cluster 2024-09-21T04:35:10.631349+0000 mgr.a (mgr.14388) 16481 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:14.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:14.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:14.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:14 smithi044 bash[22676]: cluster 2024-09-21T04:35:12.632340+0000 mgr.a (mgr.14388) 16482 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:14 smithi179 bash[23186]: cluster 2024-09-21T04:35:12.632340+0000 mgr.a (mgr.14388) 16482 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:14 smithi049 bash[23528]: cluster 2024-09-21T04:35:12.632340+0000 mgr.a (mgr.14388) 16482 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:14.839 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:14.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:14.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:14.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:14.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:16 smithi044 bash[22676]: audit 2024-09-21T04:35:14.404564+0000 mgr.a (mgr.14388) 16483 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:16 smithi044 bash[22676]: cluster 2024-09-21T04:35:14.634666+0000 mgr.a (mgr.14388) 16484 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:16 smithi179 bash[23186]: audit 2024-09-21T04:35:14.404564+0000 mgr.a (mgr.14388) 16483 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:16 smithi179 bash[23186]: cluster 2024-09-21T04:35:14.634666+0000 mgr.a (mgr.14388) 16484 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:16 smithi049 bash[23528]: audit 2024-09-21T04:35:14.404564+0000 mgr.a (mgr.14388) 16483 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:16 smithi049 bash[23528]: cluster 2024-09-21T04:35:14.634666+0000 mgr.a (mgr.14388) 16484 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:18 smithi044 bash[22676]: cluster 2024-09-21T04:35:16.637058+0000 mgr.a (mgr.14388) 16485 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:18 smithi179 bash[23186]: cluster 2024-09-21T04:35:16.637058+0000 mgr.a (mgr.14388) 16485 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:18 smithi049 bash[23528]: cluster 2024-09-21T04:35:16.637058+0000 mgr.a (mgr.14388) 16485 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:35:19.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:19.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:19.842 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:20 smithi044 bash[22676]: cluster 2024-09-21T04:35:18.637856+0000 mgr.a (mgr.14388) 16486 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:20 smithi044 bash[22676]: audit 2024-09-21T04:35:19.077331+0000 mon.a (mon.0) 13153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:20 smithi044 bash[22676]: audit 2024-09-21T04:35:19.087477+0000 mon.a (mon.0) 13154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:20 smithi044 bash[22676]: audit 2024-09-21T04:35:19.098213+0000 mon.a (mon.0) 13155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:20 smithi179 bash[23186]: cluster 2024-09-21T04:35:18.637856+0000 mgr.a (mgr.14388) 16486 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:20.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:20 smithi179 bash[23186]: audit 2024-09-21T04:35:19.077331+0000 mon.a (mon.0) 13153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:20 smithi179 bash[23186]: audit 2024-09-21T04:35:19.087477+0000 mon.a (mon.0) 13154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:20 smithi179 bash[23186]: audit 2024-09-21T04:35:19.098213+0000 mon.a (mon.0) 13155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:20 smithi049 bash[23528]: cluster 2024-09-21T04:35:18.637856+0000 mgr.a (mgr.14388) 16486 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:20 smithi049 bash[23528]: audit 2024-09-21T04:35:19.077331+0000 mon.a (mon.0) 13153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:20 smithi049 bash[23528]: audit 2024-09-21T04:35:19.087477+0000 mon.a (mon.0) 13154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:20 smithi049 bash[23528]: audit 2024-09-21T04:35:19.098213+0000 mon.a (mon.0) 13155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:20.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:21 smithi044 bash[22676]: audit 2024-09-21T04:35:20.174529+0000 mgr.a (mgr.14388) 16487 : audit [DBG] from='client.355791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:21 smithi179 bash[23186]: audit 2024-09-21T04:35:20.174529+0000 mgr.a (mgr.14388) 16487 : audit [DBG] from='client.355791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:21 smithi049 bash[23528]: audit 2024-09-21T04:35:20.174529+0000 mgr.a (mgr.14388) 16487 : audit [DBG] from='client.355791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:22 smithi044 bash[22676]: cluster 2024-09-21T04:35:20.639205+0000 mgr.a (mgr.14388) 16488 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:22 smithi179 bash[23186]: cluster 2024-09-21T04:35:20.639205+0000 mgr.a (mgr.14388) 16488 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:22 smithi049 bash[23528]: cluster 2024-09-21T04:35:20.639205+0000 mgr.a (mgr.14388) 16488 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:24 smithi044 bash[22676]: cluster 2024-09-21T04:35:22.640083+0000 mgr.a (mgr.14388) 16489 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:24 smithi179 bash[23186]: cluster 2024-09-21T04:35:22.640083+0000 mgr.a (mgr.14388) 16489 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:24 smithi049 bash[23528]: cluster 2024-09-21T04:35:22.640083+0000 mgr.a (mgr.14388) 16489 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:25.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:25.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:25.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:26 smithi179 bash[23186]: cluster 2024-09-21T04:35:24.641030+0000 mgr.a (mgr.14388) 16490 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:26.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:26 smithi049 bash[23528]: cluster 2024-09-21T04:35:24.641030+0000 mgr.a (mgr.14388) 16490 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:26.349 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:26.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:26.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:26.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:26.350 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:26.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:26 smithi044 bash[22676]: cluster 2024-09-21T04:35:24.641030+0000 mgr.a (mgr.14388) 16490 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:27 smithi049 bash[23528]: audit 2024-09-21T04:35:25.929209+0000 mgr.a (mgr.14388) 16491 : audit [DBG] from='client.355869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:27 smithi044 bash[22676]: audit 2024-09-21T04:35:25.929209+0000 mgr.a (mgr.14388) 16491 : audit [DBG] from='client.355869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:27 smithi179 bash[23186]: audit 2024-09-21T04:35:25.929209+0000 mgr.a (mgr.14388) 16491 : audit [DBG] from='client.355869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:28 smithi044 bash[22676]: cluster 2024-09-21T04:35:26.644061+0000 mgr.a (mgr.14388) 16492 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:28 smithi179 bash[23186]: cluster 2024-09-21T04:35:26.644061+0000 mgr.a (mgr.14388) 16492 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:28 smithi049 bash[23528]: cluster 2024-09-21T04:35:26.644061+0000 mgr.a (mgr.14388) 16492 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:30.399 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:30 smithi044 bash[22676]: cluster 2024-09-21T04:35:28.644854+0000 mgr.a (mgr.14388) 16493 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:30 smithi179 bash[23186]: cluster 2024-09-21T04:35:28.644854+0000 mgr.a (mgr.14388) 16493 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:30 smithi049 bash[23528]: cluster 2024-09-21T04:35:28.644854+0000 mgr.a (mgr.14388) 16493 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:35:31.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:31.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:31.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:31 smithi179 bash[23186]: audit 2024-09-21T04:35:30.246632+0000 mon.a (mon.0) 13156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:31 smithi179 bash[23186]: audit 2024-09-21T04:35:30.253654+0000 mon.a (mon.0) 13157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:31 smithi179 bash[23186]: audit 2024-09-21T04:35:30.260567+0000 mon.a (mon.0) 13158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:31 smithi179 bash[23186]: audit 2024-09-21T04:35:30.376663+0000 mon.a (mon.0) 13159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:31 smithi179 bash[23186]: audit 2024-09-21T04:35:30.384979+0000 mon.a (mon.0) 13160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:31 smithi179 bash[23186]: audit 2024-09-21T04:35:30.395084+0000 mon.a (mon.0) 13161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:31 smithi049 bash[23528]: audit 2024-09-21T04:35:30.246632+0000 mon.a (mon.0) 13156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:31 smithi049 bash[23528]: audit 2024-09-21T04:35:30.253654+0000 mon.a (mon.0) 13157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:31 smithi049 bash[23528]: audit 2024-09-21T04:35:30.260567+0000 mon.a (mon.0) 13158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:31 smithi049 bash[23528]: audit 2024-09-21T04:35:30.376663+0000 mon.a (mon.0) 13159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:31 smithi049 bash[23528]: audit 2024-09-21T04:35:30.384979+0000 mon.a (mon.0) 13160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:31 smithi049 bash[23528]: audit 2024-09-21T04:35:30.395084+0000 mon.a (mon.0) 13161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:31 smithi044 bash[22676]: audit 2024-09-21T04:35:30.246632+0000 mon.a (mon.0) 13156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:31 smithi044 bash[22676]: audit 2024-09-21T04:35:30.253654+0000 mon.a (mon.0) 13157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:31 smithi044 bash[22676]: audit 2024-09-21T04:35:30.260567+0000 mon.a (mon.0) 13158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:31 smithi044 bash[22676]: audit 2024-09-21T04:35:30.376663+0000 mon.a (mon.0) 13159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:31 smithi044 bash[22676]: audit 2024-09-21T04:35:30.384979+0000 mon.a (mon.0) 13160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:31.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:31 smithi044 bash[22676]: audit 2024-09-21T04:35:30.395084+0000 mon.a (mon.0) 13161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:32.138 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:32.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:32.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:32.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:32.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:32 smithi179 bash[23186]: cluster 2024-09-21T04:35:30.646921+0000 mgr.a (mgr.14388) 16494 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:32 smithi049 bash[23528]: cluster 2024-09-21T04:35:30.646921+0000 mgr.a (mgr.14388) 16494 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:32 smithi044 bash[22676]: cluster 2024-09-21T04:35:30.646921+0000 mgr.a (mgr.14388) 16494 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:33 smithi049 bash[23528]: audit 2024-09-21T04:35:31.692982+0000 mgr.a (mgr.14388) 16495 : audit [DBG] from='client.355941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:33.605 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:33 smithi179 bash[23186]: audit 2024-09-21T04:35:31.692982+0000 mgr.a (mgr.14388) 16495 : audit [DBG] from='client.355941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:33 smithi044 bash[22676]: audit 2024-09-21T04:35:31.692982+0000 mgr.a (mgr.14388) 16495 : audit [DBG] from='client.355941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:34.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:34 smithi179 bash[23186]: cluster 2024-09-21T04:35:32.647753+0000 mgr.a (mgr.14388) 16496 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:34 smithi049 bash[23528]: cluster 2024-09-21T04:35:32.647753+0000 mgr.a (mgr.14388) 16496 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:34 smithi044 bash[22676]: cluster 2024-09-21T04:35:32.647753+0000 mgr.a (mgr.14388) 16496 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:36 smithi049 bash[23528]: cluster 2024-09-21T04:35:34.648575+0000 mgr.a (mgr.14388) 16497 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:36 smithi044 bash[22676]: cluster 2024-09-21T04:35:34.648575+0000 mgr.a (mgr.14388) 16497 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:36 smithi179 bash[23186]: cluster 2024-09-21T04:35:34.648575+0000 mgr.a (mgr.14388) 16497 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:37.889 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:37.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:37.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:37.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:37.890 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:38 smithi049 bash[23528]: cluster 2024-09-21T04:35:36.650864+0000 mgr.a (mgr.14388) 16498 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:38 smithi044 bash[22676]: cluster 2024-09-21T04:35:36.650864+0000 mgr.a (mgr.14388) 16498 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:38 smithi179 bash[23186]: cluster 2024-09-21T04:35:36.650864+0000 mgr.a (mgr.14388) 16498 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:39.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:39 smithi049 bash[23528]: audit 2024-09-21T04:35:37.463675+0000 mgr.a (mgr.14388) 16499 : audit [DBG] from='client.356013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:39 smithi044 bash[22676]: audit 2024-09-21T04:35:37.463675+0000 mgr.a (mgr.14388) 16499 : audit [DBG] from='client.356013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:39 smithi179 bash[23186]: audit 2024-09-21T04:35:37.463675+0000 mgr.a (mgr.14388) 16499 : audit [DBG] from='client.356013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:40 smithi049 bash[23528]: cluster 2024-09-21T04:35:38.651763+0000 mgr.a (mgr.14388) 16500 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:40 smithi049 bash[23528]: audit 2024-09-21T04:35:39.320132+0000 mon.a (mon.0) 13162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:40 smithi049 bash[23528]: audit 2024-09-21T04:35:39.328998+0000 mon.a (mon.0) 13163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:40 smithi049 bash[23528]: audit 2024-09-21T04:35:39.339529+0000 mon.a (mon.0) 13164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:40 smithi044 bash[22676]: cluster 2024-09-21T04:35:38.651763+0000 mgr.a (mgr.14388) 16500 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:40 smithi044 bash[22676]: audit 2024-09-21T04:35:39.320132+0000 mon.a (mon.0) 13162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:40 smithi044 bash[22676]: audit 2024-09-21T04:35:39.328998+0000 mon.a (mon.0) 13163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:40 smithi044 bash[22676]: audit 2024-09-21T04:35:39.339529+0000 mon.a (mon.0) 13164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:40 smithi179 bash[23186]: cluster 2024-09-21T04:35:38.651763+0000 mgr.a (mgr.14388) 16500 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:40 smithi179 bash[23186]: audit 2024-09-21T04:35:39.320132+0000 mon.a (mon.0) 13162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:40 smithi179 bash[23186]: audit 2024-09-21T04:35:39.328998+0000 mon.a (mon.0) 13163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:40 smithi179 bash[23186]: audit 2024-09-21T04:35:39.339529+0000 mon.a (mon.0) 13164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:41 smithi049 bash[23528]: cluster 2024-09-21T04:35:40.654038+0000 mgr.a (mgr.14388) 16501 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:41 smithi044 bash[22676]: cluster 2024-09-21T04:35:40.654038+0000 mgr.a (mgr.14388) 16501 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:41 smithi179 bash[23186]: cluster 2024-09-21T04:35:40.654038+0000 mgr.a (mgr.14388) 16501 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:42.891 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:42.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:42.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:43.641 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:43.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:43.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:43.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:43.641 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:43 smithi044 bash[22676]: cluster 2024-09-21T04:35:42.654942+0000 mgr.a (mgr.14388) 16502 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:43 smithi044 bash[22676]: audit 2024-09-21T04:35:43.220235+0000 mgr.a (mgr.14388) 16503 : audit [DBG] from='client.356091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:43 smithi179 bash[23186]: cluster 2024-09-21T04:35:42.654942+0000 mgr.a (mgr.14388) 16502 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:43 smithi179 bash[23186]: audit 2024-09-21T04:35:43.220235+0000 mgr.a (mgr.14388) 16503 : audit [DBG] from='client.356091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:43 smithi049 bash[23528]: cluster 2024-09-21T04:35:42.654942+0000 mgr.a (mgr.14388) 16502 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:43 smithi049 bash[23528]: audit 2024-09-21T04:35:43.220235+0000 mgr.a (mgr.14388) 16503 : audit [DBG] from='client.356091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:45 smithi044 bash[22676]: cluster 2024-09-21T04:35:44.655876+0000 mgr.a (mgr.14388) 16504 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:45 smithi179 bash[23186]: cluster 2024-09-21T04:35:44.655876+0000 mgr.a (mgr.14388) 16504 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:45 smithi049 bash[23528]: cluster 2024-09-21T04:35:44.655876+0000 mgr.a (mgr.14388) 16504 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:47 smithi044 bash[22676]: cluster 2024-09-21T04:35:46.657160+0000 mgr.a (mgr.14388) 16505 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:47 smithi179 bash[23186]: cluster 2024-09-21T04:35:46.657160+0000 mgr.a (mgr.14388) 16505 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:47 smithi049 bash[23528]: cluster 2024-09-21T04:35:46.657160+0000 mgr.a (mgr.14388) 16505 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:48.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:48.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:48.643 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:49.389 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:49.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:49 smithi044 bash[22676]: cluster 2024-09-21T04:35:48.657573+0000 mgr.a (mgr.14388) 16506 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:49 smithi044 bash[22676]: audit 2024-09-21T04:35:48.964395+0000 mgr.a (mgr.14388) 16507 : audit [DBG] from='client.356163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:49 smithi179 bash[23186]: cluster 2024-09-21T04:35:48.657573+0000 mgr.a (mgr.14388) 16506 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:49 smithi179 bash[23186]: audit 2024-09-21T04:35:48.964395+0000 mgr.a (mgr.14388) 16507 : audit [DBG] from='client.356163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:49 smithi049 bash[23528]: cluster 2024-09-21T04:35:48.657573+0000 mgr.a (mgr.14388) 16506 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:49 smithi049 bash[23528]: audit 2024-09-21T04:35:48.964395+0000 mgr.a (mgr.14388) 16507 : audit [DBG] from='client.356163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:51 smithi044 bash[22676]: audit 2024-09-21T04:35:50.444427+0000 mon.a (mon.0) 13165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:51 smithi044 bash[22676]: audit 2024-09-21T04:35:50.449981+0000 mon.a (mon.0) 13166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:51 smithi044 bash[22676]: audit 2024-09-21T04:35:50.456369+0000 mon.a (mon.0) 13167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:51 smithi044 bash[22676]: audit 2024-09-21T04:35:50.608669+0000 mon.a (mon.0) 13168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:51 smithi044 bash[22676]: audit 2024-09-21T04:35:50.616646+0000 mon.a (mon.0) 13169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:51 smithi044 bash[22676]: audit 2024-09-21T04:35:50.626843+0000 mon.a (mon.0) 13170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:51 smithi044 bash[22676]: cluster 2024-09-21T04:35:50.659992+0000 mgr.a (mgr.14388) 16508 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:51 smithi179 bash[23186]: audit 2024-09-21T04:35:50.444427+0000 mon.a (mon.0) 13165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:51 smithi179 bash[23186]: audit 2024-09-21T04:35:50.449981+0000 mon.a (mon.0) 13166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:51 smithi179 bash[23186]: audit 2024-09-21T04:35:50.456369+0000 mon.a (mon.0) 13167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:51 smithi179 bash[23186]: audit 2024-09-21T04:35:50.608669+0000 mon.a (mon.0) 13168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:51 smithi179 bash[23186]: audit 2024-09-21T04:35:50.616646+0000 mon.a (mon.0) 13169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:51 smithi179 bash[23186]: audit 2024-09-21T04:35:50.626843+0000 mon.a (mon.0) 13170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:51 smithi179 bash[23186]: cluster 2024-09-21T04:35:50.659992+0000 mgr.a (mgr.14388) 16508 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:51 smithi049 bash[23528]: audit 2024-09-21T04:35:50.444427+0000 mon.a (mon.0) 13165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:51 smithi049 bash[23528]: audit 2024-09-21T04:35:50.449981+0000 mon.a (mon.0) 13166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:51 smithi049 bash[23528]: audit 2024-09-21T04:35:50.456369+0000 mon.a (mon.0) 13167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:51 smithi049 bash[23528]: audit 2024-09-21T04:35:50.608669+0000 mon.a (mon.0) 13168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:51 smithi049 bash[23528]: audit 2024-09-21T04:35:50.616646+0000 mon.a (mon.0) 13169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:51 smithi049 bash[23528]: audit 2024-09-21T04:35:50.626843+0000 mon.a (mon.0) 13170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:51.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:51 smithi049 bash[23528]: cluster 2024-09-21T04:35:50.659992+0000 mgr.a (mgr.14388) 16508 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:35:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:53 smithi044 bash[22676]: cluster 2024-09-21T04:35:52.660794+0000 mgr.a (mgr.14388) 16509 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:53 smithi179 bash[23186]: cluster 2024-09-21T04:35:52.660794+0000 mgr.a (mgr.14388) 16509 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:53 smithi049 bash[23528]: cluster 2024-09-21T04:35:52.660794+0000 mgr.a (mgr.14388) 16509 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:35:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:35:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:35:55.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:35:55.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:35:55.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:35:55.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:35:55.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:35:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:55 smithi044 bash[22676]: cluster 2024-09-21T04:35:54.661680+0000 mgr.a (mgr.14388) 16510 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:55 smithi044 bash[22676]: audit 2024-09-21T04:35:54.720683+0000 mgr.a (mgr.14388) 16511 : audit [DBG] from='client.356241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:55 smithi179 bash[23186]: cluster 2024-09-21T04:35:54.661680+0000 mgr.a (mgr.14388) 16510 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:55 smithi179 bash[23186]: audit 2024-09-21T04:35:54.720683+0000 mgr.a (mgr.14388) 16511 : audit [DBG] from='client.356241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:55 smithi049 bash[23528]: cluster 2024-09-21T04:35:54.661680+0000 mgr.a (mgr.14388) 16510 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:35:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:55 smithi049 bash[23528]: audit 2024-09-21T04:35:54.720683+0000 mgr.a (mgr.14388) 16511 : audit [DBG] from='client.356241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:35:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:57 smithi044 bash[22676]: cluster 2024-09-21T04:35:56.664165+0000 mgr.a (mgr.14388) 16512 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:35:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:57 smithi179 bash[23186]: cluster 2024-09-21T04:35:56.664165+0000 mgr.a (mgr.14388) 16512 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:35:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:57 smithi049 bash[23528]: cluster 2024-09-21T04:35:56.664165+0000 mgr.a (mgr.14388) 16512 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:35:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:59 smithi044 bash[22676]: cluster 2024-09-21T04:35:58.664940+0000 mgr.a (mgr.14388) 16513 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:35:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:59 smithi044 bash[22676]: audit 2024-09-21T04:35:59.550199+0000 mon.a (mon.0) 13171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:59 smithi044 bash[22676]: audit 2024-09-21T04:35:59.558962+0000 mon.a (mon.0) 13172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:35:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:35:59 smithi044 bash[22676]: audit 2024-09-21T04:35:59.569708+0000 mon.a (mon.0) 13173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:59 smithi179 bash[23186]: cluster 2024-09-21T04:35:58.664940+0000 mgr.a (mgr.14388) 16513 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:59 smithi179 bash[23186]: audit 2024-09-21T04:35:59.550199+0000 mon.a (mon.0) 13171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:59 smithi179 bash[23186]: audit 2024-09-21T04:35:59.558962+0000 mon.a (mon.0) 13172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:35:59 smithi179 bash[23186]: audit 2024-09-21T04:35:59.569708+0000 mon.a (mon.0) 13173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:59 smithi049 bash[23528]: cluster 2024-09-21T04:35:58.664940+0000 mgr.a (mgr.14388) 16513 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:59 smithi049 bash[23528]: audit 2024-09-21T04:35:59.550199+0000 mon.a (mon.0) 13171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:59 smithi049 bash[23528]: audit 2024-09-21T04:35:59.558962+0000 mon.a (mon.0) 13172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:35:59 smithi049 bash[23528]: audit 2024-09-21T04:35:59.569708+0000 mon.a (mon.0) 13173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:00.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:00.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:00.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:00.934 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:00.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:01 smithi044 bash[22676]: audit 2024-09-21T04:36:00.476719+0000 mgr.a (mgr.14388) 16514 : audit [DBG] from='client.356316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:01 smithi044 bash[22676]: cluster 2024-09-21T04:36:00.666358+0000 mgr.a (mgr.14388) 16515 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:36:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:01 smithi179 bash[23186]: audit 2024-09-21T04:36:00.476719+0000 mgr.a (mgr.14388) 16514 : audit [DBG] from='client.356316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:01 smithi179 bash[23186]: cluster 2024-09-21T04:36:00.666358+0000 mgr.a (mgr.14388) 16515 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:36:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:01 smithi049 bash[23528]: audit 2024-09-21T04:36:00.476719+0000 mgr.a (mgr.14388) 16514 : audit [DBG] from='client.356316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:01 smithi049 bash[23528]: cluster 2024-09-21T04:36:00.666358+0000 mgr.a (mgr.14388) 16515 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:36:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: cluster 2024-09-21T04:36:02.667200+0000 mgr.a (mgr.14388) 16516 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:02.999583+0000 mon.a (mon.0) 13174 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.600783+0000 mon.a (mon.0) 13175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.606301+0000 mon.a (mon.0) 13176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.611915+0000 mon.a (mon.0) 13177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.617204+0000 mon.a (mon.0) 13178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.618169+0000 mon.a (mon.0) 13179 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.619258+0000 mon.a (mon.0) 13180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.624186+0000 mon.a (mon.0) 13181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:03 smithi179 bash[23186]: audit 2024-09-21T04:36:03.627052+0000 mon.a (mon.0) 13182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:36:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: cluster 2024-09-21T04:36:02.667200+0000 mgr.a (mgr.14388) 16516 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:02.999583+0000 mon.a (mon.0) 13174 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.600783+0000 mon.a (mon.0) 13175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.606301+0000 mon.a (mon.0) 13176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.611915+0000 mon.a (mon.0) 13177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.617204+0000 mon.a (mon.0) 13178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.618169+0000 mon.a (mon.0) 13179 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.619258+0000 mon.a (mon.0) 13180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.624186+0000 mon.a (mon.0) 13181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:03 smithi049 bash[23528]: audit 2024-09-21T04:36:03.627052+0000 mon.a (mon.0) 13182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:36:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: cluster 2024-09-21T04:36:02.667200+0000 mgr.a (mgr.14388) 16516 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:02.999583+0000 mon.a (mon.0) 13174 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:36:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.600783+0000 mon.a (mon.0) 13175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.606301+0000 mon.a (mon.0) 13176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.611915+0000 mon.a (mon.0) 13177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.617204+0000 mon.a (mon.0) 13178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.618169+0000 mon.a (mon.0) 13179 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:36:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.619258+0000 mon.a (mon.0) 13180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:36:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.624186+0000 mon.a (mon.0) 13181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:03 smithi044 bash[22676]: audit 2024-09-21T04:36:03.627052+0000 mon.a (mon.0) 13182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:36:04.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:36:04 smithi044 bash[22930]: debug 2024-09-21T04:36:04.372+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:36:04.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:36:04 smithi044 bash[22930]: debug 2024-09-21T04:36:04.376+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:36:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:04 smithi179 bash[23186]: audit 2024-09-21T04:36:03.627973+0000 mgr.a (mgr.14388) 16517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:36:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:04 smithi049 bash[23528]: audit 2024-09-21T04:36:03.627973+0000 mgr.a (mgr.14388) 16517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:36:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:04 smithi044 bash[22676]: audit 2024-09-21T04:36:03.627973+0000 mgr.a (mgr.14388) 16517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:36:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:05.936 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:05.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:05 smithi179 bash[23186]: audit 2024-09-21T04:36:04.376373+0000 mgr.a (mgr.14388) 16518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:36:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:05 smithi179 bash[23186]: cephadm 2024-09-21T04:36:04.378256+0000 mgr.a (mgr.14388) 16519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:36:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:05 smithi179 bash[23186]: cluster 2024-09-21T04:36:04.668212+0000 mgr.a (mgr.14388) 16520 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:05 smithi049 bash[23528]: audit 2024-09-21T04:36:04.376373+0000 mgr.a (mgr.14388) 16518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:36:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:05 smithi049 bash[23528]: cephadm 2024-09-21T04:36:04.378256+0000 mgr.a (mgr.14388) 16519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:36:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:05 smithi049 bash[23528]: cluster 2024-09-21T04:36:04.668212+0000 mgr.a (mgr.14388) 16520 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:05 smithi044 bash[22676]: audit 2024-09-21T04:36:04.376373+0000 mgr.a (mgr.14388) 16518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:36:06.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:05 smithi044 bash[22676]: cephadm 2024-09-21T04:36:04.378256+0000 mgr.a (mgr.14388) 16519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:36:06.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:05 smithi044 bash[22676]: cluster 2024-09-21T04:36:04.668212+0000 mgr.a (mgr.14388) 16520 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 205 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:36:06.690 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:06.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:06.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:06.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:06.691 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:06 smithi049 bash[23528]: audit 2024-09-21T04:36:06.261523+0000 mgr.a (mgr.14388) 16521 : audit [DBG] from='client.356499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:07.092 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:06 smithi044 bash[22676]: audit 2024-09-21T04:36:06.261523+0000 mgr.a (mgr.14388) 16521 : audit [DBG] from='client.356499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:07.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:06 smithi179 bash[23186]: audit 2024-09-21T04:36:06.261523+0000 mgr.a (mgr.14388) 16521 : audit [DBG] from='client.356499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:07 smithi049 bash[23528]: cluster 2024-09-21T04:36:06.669839+0000 mgr.a (mgr.14388) 16522 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:36:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:07 smithi044 bash[22676]: cluster 2024-09-21T04:36:06.669839+0000 mgr.a (mgr.14388) 16522 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:36:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:07 smithi179 bash[23186]: cluster 2024-09-21T04:36:06.669839+0000 mgr.a (mgr.14388) 16522 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T04:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:09 smithi044 bash[22676]: cluster 2024-09-21T04:36:08.670513+0000 mgr.a (mgr.14388) 16523 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:36:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:09 smithi049 bash[23528]: cluster 2024-09-21T04:36:08.670513+0000 mgr.a (mgr.14388) 16523 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:36:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:09 smithi179 bash[23186]: cluster 2024-09-21T04:36:08.670513+0000 mgr.a (mgr.14388) 16523 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:36:11.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:11.693 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:11 smithi044 bash[22676]: cluster 2024-09-21T04:36:10.672079+0000 mgr.a (mgr.14388) 16524 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:11 smithi044 bash[22676]: audit 2024-09-21T04:36:10.673312+0000 mon.a (mon.0) 13183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:11 smithi044 bash[22676]: audit 2024-09-21T04:36:10.680352+0000 mon.a (mon.0) 13184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:11 smithi044 bash[22676]: audit 2024-09-21T04:36:10.687019+0000 mon.a (mon.0) 13185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:11 smithi044 bash[22676]: audit 2024-09-21T04:36:10.806193+0000 mon.a (mon.0) 13186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:11 smithi044 bash[22676]: audit 2024-09-21T04:36:10.814438+0000 mon.a (mon.0) 13187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:11 smithi044 bash[22676]: audit 2024-09-21T04:36:10.824714+0000 mon.a (mon.0) 13188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:11 smithi179 bash[23186]: cluster 2024-09-21T04:36:10.672079+0000 mgr.a (mgr.14388) 16524 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:11 smithi179 bash[23186]: audit 2024-09-21T04:36:10.673312+0000 mon.a (mon.0) 13183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:11 smithi179 bash[23186]: audit 2024-09-21T04:36:10.680352+0000 mon.a (mon.0) 13184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:11 smithi179 bash[23186]: audit 2024-09-21T04:36:10.687019+0000 mon.a (mon.0) 13185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:11 smithi179 bash[23186]: audit 2024-09-21T04:36:10.806193+0000 mon.a (mon.0) 13186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:11 smithi179 bash[23186]: audit 2024-09-21T04:36:10.814438+0000 mon.a (mon.0) 13187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:11 smithi179 bash[23186]: audit 2024-09-21T04:36:10.824714+0000 mon.a (mon.0) 13188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:11 smithi049 bash[23528]: cluster 2024-09-21T04:36:10.672079+0000 mgr.a (mgr.14388) 16524 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:11 smithi049 bash[23528]: audit 2024-09-21T04:36:10.673312+0000 mon.a (mon.0) 13183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:11 smithi049 bash[23528]: audit 2024-09-21T04:36:10.680352+0000 mon.a (mon.0) 13184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:11 smithi049 bash[23528]: audit 2024-09-21T04:36:10.687019+0000 mon.a (mon.0) 13185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:11 smithi049 bash[23528]: audit 2024-09-21T04:36:10.806193+0000 mon.a (mon.0) 13186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:11 smithi049 bash[23528]: audit 2024-09-21T04:36:10.814438+0000 mon.a (mon.0) 13187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:11 smithi049 bash[23528]: audit 2024-09-21T04:36:10.824714+0000 mon.a (mon.0) 13188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:12.488 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:12.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:12.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:12.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:12.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:12 smithi179 bash[23186]: audit 2024-09-21T04:36:12.029952+0000 mgr.a (mgr.14388) 16525 : audit [DBG] from='client.356571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:12 smithi044 bash[22676]: audit 2024-09-21T04:36:12.029952+0000 mgr.a (mgr.14388) 16525 : audit [DBG] from='client.356571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:12 smithi049 bash[23528]: audit 2024-09-21T04:36:12.029952+0000 mgr.a (mgr.14388) 16525 : audit [DBG] from='client.356571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:13.833 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:13 smithi179 bash[23186]: cluster 2024-09-21T04:36:12.672963+0000 mgr.a (mgr.14388) 16526 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:13 smithi044 bash[22676]: cluster 2024-09-21T04:36:12.672963+0000 mgr.a (mgr.14388) 16526 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:13 smithi049 bash[23528]: cluster 2024-09-21T04:36:12.672963+0000 mgr.a (mgr.14388) 16526 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:15 smithi044 bash[22676]: cluster 2024-09-21T04:36:14.673770+0000 mgr.a (mgr.14388) 16527 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:15 smithi179 bash[23186]: cluster 2024-09-21T04:36:14.673770+0000 mgr.a (mgr.14388) 16527 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:15 smithi049 bash[23528]: cluster 2024-09-21T04:36:14.673770+0000 mgr.a (mgr.14388) 16527 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:36:17.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:17 smithi044 bash[22676]: cluster 2024-09-21T04:36:16.675986+0000 mgr.a (mgr.14388) 16528 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T04:36:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:17 smithi179 bash[23186]: cluster 2024-09-21T04:36:16.675986+0000 mgr.a (mgr.14388) 16528 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T04:36:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:17 smithi049 bash[23528]: cluster 2024-09-21T04:36:16.675986+0000 mgr.a (mgr.14388) 16528 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T04:36:18.265 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:18.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:18.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:18.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:18.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:18 smithi044 bash[22676]: audit 2024-09-21T04:36:17.822623+0000 mgr.a (mgr.14388) 16529 : audit [DBG] from='client.356649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:18 smithi179 bash[23186]: audit 2024-09-21T04:36:17.822623+0000 mgr.a (mgr.14388) 16529 : audit [DBG] from='client.356649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:18 smithi049 bash[23528]: audit 2024-09-21T04:36:17.822623+0000 mgr.a (mgr.14388) 16529 : audit [DBG] from='client.356649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:19 smithi044 bash[22676]: cluster 2024-09-21T04:36:18.676942+0000 mgr.a (mgr.14388) 16530 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:19 smithi179 bash[23186]: cluster 2024-09-21T04:36:18.676942+0000 mgr.a (mgr.14388) 16530 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:19 smithi049 bash[23528]: cluster 2024-09-21T04:36:18.676942+0000 mgr.a (mgr.14388) 16530 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:20 smithi049 bash[23528]: audit 2024-09-21T04:36:19.769976+0000 mon.a (mon.0) 13189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:20 smithi049 bash[23528]: audit 2024-09-21T04:36:19.778998+0000 mon.a (mon.0) 13190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:20 smithi049 bash[23528]: audit 2024-09-21T04:36:19.789849+0000 mon.a (mon.0) 13191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:20 smithi044 bash[22676]: audit 2024-09-21T04:36:19.769976+0000 mon.a (mon.0) 13189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:20 smithi044 bash[22676]: audit 2024-09-21T04:36:19.778998+0000 mon.a (mon.0) 13190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:20 smithi044 bash[22676]: audit 2024-09-21T04:36:19.789849+0000 mon.a (mon.0) 13191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:20 smithi179 bash[23186]: audit 2024-09-21T04:36:19.769976+0000 mon.a (mon.0) 13189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:20 smithi179 bash[23186]: audit 2024-09-21T04:36:19.778998+0000 mon.a (mon.0) 13190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:20 smithi179 bash[23186]: audit 2024-09-21T04:36:19.789849+0000 mon.a (mon.0) 13191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:21 smithi049 bash[23528]: cluster 2024-09-21T04:36:20.679196+0000 mgr.a (mgr.14388) 16531 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:36:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:21 smithi044 bash[22676]: cluster 2024-09-21T04:36:20.679196+0000 mgr.a (mgr.14388) 16531 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:36:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:21 smithi179 bash[23186]: cluster 2024-09-21T04:36:20.679196+0000 mgr.a (mgr.14388) 16531 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:36:23.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:23.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:23.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:23 smithi049 bash[23528]: cluster 2024-09-21T04:36:22.680149+0000 mgr.a (mgr.14388) 16532 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:24.057 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:24.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:24.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:24.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:24.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:23 smithi044 bash[22676]: cluster 2024-09-21T04:36:22.680149+0000 mgr.a (mgr.14388) 16532 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:23 smithi179 bash[23186]: cluster 2024-09-21T04:36:22.680149+0000 mgr.a (mgr.14388) 16532 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:24 smithi044 bash[22676]: audit 2024-09-21T04:36:23.603083+0000 mgr.a (mgr.14388) 16533 : audit [DBG] from='client.356721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:24 smithi179 bash[23186]: audit 2024-09-21T04:36:23.603083+0000 mgr.a (mgr.14388) 16533 : audit [DBG] from='client.356721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:24 smithi049 bash[23528]: audit 2024-09-21T04:36:23.603083+0000 mgr.a (mgr.14388) 16533 : audit [DBG] from='client.356721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:25 smithi044 bash[22676]: cluster 2024-09-21T04:36:24.681342+0000 mgr.a (mgr.14388) 16534 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:25 smithi179 bash[23186]: cluster 2024-09-21T04:36:24.681342+0000 mgr.a (mgr.14388) 16534 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:25 smithi049 bash[23528]: cluster 2024-09-21T04:36:24.681342+0000 mgr.a (mgr.14388) 16534 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:36:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:27 smithi049 bash[23528]: cluster 2024-09-21T04:36:26.683677+0000 mgr.a (mgr.14388) 16535 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:36:28.153 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:27 smithi044 bash[22676]: cluster 2024-09-21T04:36:26.683677+0000 mgr.a (mgr.14388) 16535 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:36:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:27 smithi179 bash[23186]: cluster 2024-09-21T04:36:26.683677+0000 mgr.a (mgr.14388) 16535 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T04:36:29.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:29.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:29.060 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:29.864 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:29.864 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:29.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:29 smithi049 bash[23528]: cluster 2024-09-21T04:36:28.684337+0000 mgr.a (mgr.14388) 16536 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:29 smithi044 bash[22676]: cluster 2024-09-21T04:36:28.684337+0000 mgr.a (mgr.14388) 16536 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:29 smithi179 bash[23186]: cluster 2024-09-21T04:36:28.684337+0000 mgr.a (mgr.14388) 16536 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:30 smithi044 bash[22676]: audit 2024-09-21T04:36:29.397937+0000 mgr.a (mgr.14388) 16537 : audit [DBG] from='client.356799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:30 smithi179 bash[23186]: audit 2024-09-21T04:36:29.397937+0000 mgr.a (mgr.14388) 16537 : audit [DBG] from='client.356799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:30 smithi049 bash[23528]: audit 2024-09-21T04:36:29.397937+0000 mgr.a (mgr.14388) 16537 : audit [DBG] from='client.356799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:31 smithi044 bash[22676]: cluster 2024-09-21T04:36:30.686834+0000 mgr.a (mgr.14388) 16538 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:31 smithi044 bash[22676]: audit 2024-09-21T04:36:30.877059+0000 mon.a (mon.0) 13192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:31 smithi044 bash[22676]: audit 2024-09-21T04:36:30.884555+0000 mon.a (mon.0) 13193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:31 smithi044 bash[22676]: audit 2024-09-21T04:36:30.892421+0000 mon.a (mon.0) 13194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:31 smithi044 bash[22676]: audit 2024-09-21T04:36:30.988802+0000 mon.a (mon.0) 13195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:31 smithi044 bash[22676]: audit 2024-09-21T04:36:30.995490+0000 mon.a (mon.0) 13196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:31 smithi044 bash[22676]: audit 2024-09-21T04:36:31.001568+0000 mon.a (mon.0) 13197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:31 smithi179 bash[23186]: cluster 2024-09-21T04:36:30.686834+0000 mgr.a (mgr.14388) 16538 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:31 smithi179 bash[23186]: audit 2024-09-21T04:36:30.877059+0000 mon.a (mon.0) 13192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:31 smithi179 bash[23186]: audit 2024-09-21T04:36:30.884555+0000 mon.a (mon.0) 13193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:31 smithi179 bash[23186]: audit 2024-09-21T04:36:30.892421+0000 mon.a (mon.0) 13194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:31 smithi179 bash[23186]: audit 2024-09-21T04:36:30.988802+0000 mon.a (mon.0) 13195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:31 smithi179 bash[23186]: audit 2024-09-21T04:36:30.995490+0000 mon.a (mon.0) 13196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:31 smithi179 bash[23186]: audit 2024-09-21T04:36:31.001568+0000 mon.a (mon.0) 13197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:31 smithi049 bash[23528]: cluster 2024-09-21T04:36:30.686834+0000 mgr.a (mgr.14388) 16538 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:31 smithi049 bash[23528]: audit 2024-09-21T04:36:30.877059+0000 mon.a (mon.0) 13192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:31 smithi049 bash[23528]: audit 2024-09-21T04:36:30.884555+0000 mon.a (mon.0) 13193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:31 smithi049 bash[23528]: audit 2024-09-21T04:36:30.892421+0000 mon.a (mon.0) 13194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:31 smithi049 bash[23528]: audit 2024-09-21T04:36:30.988802+0000 mon.a (mon.0) 13195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:31 smithi049 bash[23528]: audit 2024-09-21T04:36:30.995490+0000 mon.a (mon.0) 13196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:31 smithi049 bash[23528]: audit 2024-09-21T04:36:31.001568+0000 mon.a (mon.0) 13197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:34.214 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:33 smithi179 bash[23186]: cluster 2024-09-21T04:36:32.687618+0000 mgr.a (mgr.14388) 16539 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:33 smithi044 bash[22676]: cluster 2024-09-21T04:36:32.687618+0000 mgr.a (mgr.14388) 16539 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:33 smithi049 bash[23528]: cluster 2024-09-21T04:36:32.687618+0000 mgr.a (mgr.14388) 16539 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:34.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:34.866 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:34.866 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:35.613 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:35.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:35.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:35.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:35.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:35 smithi179 bash[23186]: cluster 2024-09-21T04:36:34.688403+0000 mgr.a (mgr.14388) 16540 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:35 smithi179 bash[23186]: audit 2024-09-21T04:36:35.190913+0000 mgr.a (mgr.14388) 16541 : audit [DBG] from='client.356874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:35 smithi044 bash[22676]: cluster 2024-09-21T04:36:34.688403+0000 mgr.a (mgr.14388) 16540 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:35 smithi044 bash[22676]: audit 2024-09-21T04:36:35.190913+0000 mgr.a (mgr.14388) 16541 : audit [DBG] from='client.356874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:35 smithi049 bash[23528]: cluster 2024-09-21T04:36:34.688403+0000 mgr.a (mgr.14388) 16540 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:35 smithi049 bash[23528]: audit 2024-09-21T04:36:35.190913+0000 mgr.a (mgr.14388) 16541 : audit [DBG] from='client.356874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:37 smithi044 bash[22676]: cluster 2024-09-21T04:36:36.691348+0000 mgr.a (mgr.14388) 16542 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:37 smithi179 bash[23186]: cluster 2024-09-21T04:36:36.691348+0000 mgr.a (mgr.14388) 16542 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:37 smithi049 bash[23528]: cluster 2024-09-21T04:36:36.691348+0000 mgr.a (mgr.14388) 16542 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:39 smithi044 bash[22676]: cluster 2024-09-21T04:36:38.692301+0000 mgr.a (mgr.14388) 16543 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:36:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:39 smithi179 bash[23186]: cluster 2024-09-21T04:36:38.692301+0000 mgr.a (mgr.14388) 16543 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:36:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:39 smithi049 bash[23528]: cluster 2024-09-21T04:36:38.692301+0000 mgr.a (mgr.14388) 16543 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:36:40.614 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:40.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:40.615 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:41 smithi049 bash[23528]: audit 2024-09-21T04:36:40.009512+0000 mon.a (mon.0) 13198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:41 smithi049 bash[23528]: audit 2024-09-21T04:36:40.018334+0000 mon.a (mon.0) 13199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:41 smithi049 bash[23528]: audit 2024-09-21T04:36:40.029154+0000 mon.a (mon.0) 13200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.384 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:41 smithi044 bash[22676]: audit 2024-09-21T04:36:40.009512+0000 mon.a (mon.0) 13198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:41 smithi044 bash[22676]: audit 2024-09-21T04:36:40.018334+0000 mon.a (mon.0) 13199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:41 smithi044 bash[22676]: audit 2024-09-21T04:36:40.029154+0000 mon.a (mon.0) 13200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:41 smithi179 bash[23186]: audit 2024-09-21T04:36:40.009512+0000 mon.a (mon.0) 13198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:41 smithi179 bash[23186]: audit 2024-09-21T04:36:40.018334+0000 mon.a (mon.0) 13199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:41 smithi179 bash[23186]: audit 2024-09-21T04:36:40.029154+0000 mon.a (mon.0) 13200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:42 smithi049 bash[23528]: cluster 2024-09-21T04:36:40.694350+0000 mgr.a (mgr.14388) 16544 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:42 smithi049 bash[23528]: audit 2024-09-21T04:36:40.943724+0000 mgr.a (mgr.14388) 16545 : audit [DBG] from='client.356952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:42 smithi044 bash[22676]: cluster 2024-09-21T04:36:40.694350+0000 mgr.a (mgr.14388) 16544 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:42.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:42 smithi044 bash[22676]: audit 2024-09-21T04:36:40.943724+0000 mgr.a (mgr.14388) 16545 : audit [DBG] from='client.356952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:42 smithi179 bash[23186]: cluster 2024-09-21T04:36:40.694350+0000 mgr.a (mgr.14388) 16544 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:42 smithi179 bash[23186]: audit 2024-09-21T04:36:40.943724+0000 mgr.a (mgr.14388) 16545 : audit [DBG] from='client.356952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:44 smithi049 bash[23528]: cluster 2024-09-21T04:36:42.695342+0000 mgr.a (mgr.14388) 16546 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:36:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:44 smithi044 bash[22676]: cluster 2024-09-21T04:36:42.695342+0000 mgr.a (mgr.14388) 16546 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:36:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:44 smithi179 bash[23186]: cluster 2024-09-21T04:36:42.695342+0000 mgr.a (mgr.14388) 16546 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:36:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:46 smithi049 bash[23528]: cluster 2024-09-21T04:36:44.696137+0000 mgr.a (mgr.14388) 16547 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:36:46.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:46.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:46.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:46 smithi044 bash[22676]: cluster 2024-09-21T04:36:44.696137+0000 mgr.a (mgr.14388) 16547 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:36:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:46 smithi179 bash[23186]: cluster 2024-09-21T04:36:44.696137+0000 mgr.a (mgr.14388) 16547 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:36:47.171 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:47.172 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:48 smithi044 bash[22676]: cluster 2024-09-21T04:36:46.698316+0000 mgr.a (mgr.14388) 16548 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:48 smithi044 bash[22676]: audit 2024-09-21T04:36:46.722135+0000 mgr.a (mgr.14388) 16549 : audit [DBG] from='client.357024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:48 smithi049 bash[23528]: cluster 2024-09-21T04:36:46.698316+0000 mgr.a (mgr.14388) 16548 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:48 smithi049 bash[23528]: audit 2024-09-21T04:36:46.722135+0000 mgr.a (mgr.14388) 16549 : audit [DBG] from='client.357024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:48.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:48 smithi179 bash[23186]: cluster 2024-09-21T04:36:46.698316+0000 mgr.a (mgr.14388) 16548 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:48.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:48 smithi179 bash[23186]: audit 2024-09-21T04:36:46.722135+0000 mgr.a (mgr.14388) 16549 : audit [DBG] from='client.357024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:50 smithi049 bash[23528]: cluster 2024-09-21T04:36:48.699294+0000 mgr.a (mgr.14388) 16550 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:50 smithi044 bash[22676]: cluster 2024-09-21T04:36:48.699294+0000 mgr.a (mgr.14388) 16550 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:50 smithi179 bash[23186]: cluster 2024-09-21T04:36:48.699294+0000 mgr.a (mgr.14388) 16550 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:52.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:52.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:52.174 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:52 smithi044 bash[22676]: cluster 2024-09-21T04:36:50.701706+0000 mgr.a (mgr.14388) 16551 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:52 smithi044 bash[22676]: audit 2024-09-21T04:36:51.091217+0000 mon.a (mon.0) 13201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:52 smithi044 bash[22676]: audit 2024-09-21T04:36:51.096617+0000 mon.a (mon.0) 13202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:52 smithi044 bash[22676]: audit 2024-09-21T04:36:51.104364+0000 mon.a (mon.0) 13203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:52 smithi044 bash[22676]: audit 2024-09-21T04:36:51.155581+0000 mon.a (mon.0) 13204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:52 smithi044 bash[22676]: audit 2024-09-21T04:36:51.160368+0000 mon.a (mon.0) 13205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:52 smithi044 bash[22676]: audit 2024-09-21T04:36:51.166196+0000 mon.a (mon.0) 13206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:52 smithi179 bash[23186]: cluster 2024-09-21T04:36:50.701706+0000 mgr.a (mgr.14388) 16551 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:52 smithi179 bash[23186]: audit 2024-09-21T04:36:51.091217+0000 mon.a (mon.0) 13201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:52 smithi179 bash[23186]: audit 2024-09-21T04:36:51.096617+0000 mon.a (mon.0) 13202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:52 smithi179 bash[23186]: audit 2024-09-21T04:36:51.104364+0000 mon.a (mon.0) 13203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:52 smithi179 bash[23186]: audit 2024-09-21T04:36:51.155581+0000 mon.a (mon.0) 13204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:52 smithi179 bash[23186]: audit 2024-09-21T04:36:51.160368+0000 mon.a (mon.0) 13205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:52 smithi179 bash[23186]: audit 2024-09-21T04:36:51.166196+0000 mon.a (mon.0) 13206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:52 smithi049 bash[23528]: cluster 2024-09-21T04:36:50.701706+0000 mgr.a (mgr.14388) 16551 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:52 smithi049 bash[23528]: audit 2024-09-21T04:36:51.091217+0000 mon.a (mon.0) 13201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:52 smithi049 bash[23528]: audit 2024-09-21T04:36:51.096617+0000 mon.a (mon.0) 13202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:52 smithi049 bash[23528]: audit 2024-09-21T04:36:51.104364+0000 mon.a (mon.0) 13203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:52 smithi049 bash[23528]: audit 2024-09-21T04:36:51.155581+0000 mon.a (mon.0) 13204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:52 smithi049 bash[23528]: audit 2024-09-21T04:36:51.160368+0000 mon.a (mon.0) 13205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:52 smithi049 bash[23528]: audit 2024-09-21T04:36:51.166196+0000 mon.a (mon.0) 13206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:36:52.953 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:52.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:52.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:52.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:52.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:54.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:54 smithi179 bash[23186]: audit 2024-09-21T04:36:52.506546+0000 mgr.a (mgr.14388) 16552 : audit [DBG] from='client.357102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:54.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:54 smithi179 bash[23186]: cluster 2024-09-21T04:36:52.702302+0000 mgr.a (mgr.14388) 16553 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:54 smithi044 bash[22676]: audit 2024-09-21T04:36:52.506546+0000 mgr.a (mgr.14388) 16552 : audit [DBG] from='client.357102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:54 smithi044 bash[22676]: cluster 2024-09-21T04:36:52.702302+0000 mgr.a (mgr.14388) 16553 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:54 smithi049 bash[23528]: audit 2024-09-21T04:36:52.506546+0000 mgr.a (mgr.14388) 16552 : audit [DBG] from='client.357102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:54 smithi049 bash[23528]: cluster 2024-09-21T04:36:52.702302+0000 mgr.a (mgr.14388) 16553 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:56 smithi044 bash[22676]: cluster 2024-09-21T04:36:54.703204+0000 mgr.a (mgr.14388) 16554 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:56 smithi179 bash[23186]: cluster 2024-09-21T04:36:54.703204+0000 mgr.a (mgr.14388) 16554 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:56 smithi049 bash[23528]: cluster 2024-09-21T04:36:54.703204+0000 mgr.a (mgr.14388) 16554 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:36:57.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:36:57.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:36:57.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:36:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:58 smithi044 bash[22676]: cluster 2024-09-21T04:36:56.705487+0000 mgr.a (mgr.14388) 16555 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:58 smithi179 bash[23186]: cluster 2024-09-21T04:36:56.705487+0000 mgr.a (mgr.14388) 16555 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:58 smithi049 bash[23528]: cluster 2024-09-21T04:36:56.705487+0000 mgr.a (mgr.14388) 16555 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:36:58.702 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:36:58.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:36:58.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:36:58.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:36:58.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:36:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:36:59 smithi044 bash[22676]: audit 2024-09-21T04:36:58.286568+0000 mgr.a (mgr.14388) 16556 : audit [DBG] from='client.357180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:36:59 smithi179 bash[23186]: audit 2024-09-21T04:36:58.286568+0000 mgr.a (mgr.14388) 16556 : audit [DBG] from='client.357180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:36:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:36:59 smithi049 bash[23528]: audit 2024-09-21T04:36:58.286568+0000 mgr.a (mgr.14388) 16556 : audit [DBG] from='client.357180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:00 smithi044 bash[22676]: cluster 2024-09-21T04:36:58.705961+0000 mgr.a (mgr.14388) 16557 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:00 smithi179 bash[23186]: cluster 2024-09-21T04:36:58.705961+0000 mgr.a (mgr.14388) 16557 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:00 smithi049 bash[23528]: cluster 2024-09-21T04:36:58.705961+0000 mgr.a (mgr.14388) 16557 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:01 smithi044 bash[22676]: audit 2024-09-21T04:37:00.191690+0000 mon.a (mon.0) 13207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:01 smithi044 bash[22676]: audit 2024-09-21T04:37:00.200763+0000 mon.a (mon.0) 13208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:01 smithi044 bash[22676]: audit 2024-09-21T04:37:00.211520+0000 mon.a (mon.0) 13209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:01 smithi179 bash[23186]: audit 2024-09-21T04:37:00.191690+0000 mon.a (mon.0) 13207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:01 smithi179 bash[23186]: audit 2024-09-21T04:37:00.200763+0000 mon.a (mon.0) 13208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:01 smithi179 bash[23186]: audit 2024-09-21T04:37:00.211520+0000 mon.a (mon.0) 13209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:01 smithi049 bash[23528]: audit 2024-09-21T04:37:00.191690+0000 mon.a (mon.0) 13207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:01 smithi049 bash[23528]: audit 2024-09-21T04:37:00.200763+0000 mon.a (mon.0) 13208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:01 smithi049 bash[23528]: audit 2024-09-21T04:37:00.211520+0000 mon.a (mon.0) 13209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:02 smithi044 bash[22676]: cluster 2024-09-21T04:37:00.708169+0000 mgr.a (mgr.14388) 16558 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:02 smithi179 bash[23186]: cluster 2024-09-21T04:37:00.708169+0000 mgr.a (mgr.14388) 16558 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:02.521 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:02 smithi049 bash[23528]: cluster 2024-09-21T04:37:00.708169+0000 mgr.a (mgr.14388) 16558 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:03.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:03.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:03.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:04.465 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:04.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:04.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:04.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:04.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:04 smithi044 bash[22676]: cluster 2024-09-21T04:37:02.708937+0000 mgr.a (mgr.14388) 16559 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:04 smithi179 bash[23186]: cluster 2024-09-21T04:37:02.708937+0000 mgr.a (mgr.14388) 16559 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:04 smithi049 bash[23528]: cluster 2024-09-21T04:37:02.708937+0000 mgr.a (mgr.14388) 16559 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:04.031827+0000 mgr.a (mgr.14388) 16560 : audit [DBG] from='client.357258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:04.434120+0000 mon.a (mon.0) 13210 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:37:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:04.983367+0000 mon.a (mon.0) 13211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:04.993043+0000 mon.a (mon.0) 13212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:04.995400+0000 mon.a (mon.0) 13213 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:04.997422+0000 mon.a (mon.0) 13214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:05.009315+0000 mon.a (mon.0) 13215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22676]: audit 2024-09-21T04:37:05.016168+0000 mon.a (mon.0) 13216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:37:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:04.031827+0000 mgr.a (mgr.14388) 16560 : audit [DBG] from='client.357258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:04.434120+0000 mon.a (mon.0) 13210 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:37:05.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:04.983367+0000 mon.a (mon.0) 13211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:04.993043+0000 mon.a (mon.0) 13212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:04.995400+0000 mon.a (mon.0) 13213 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:37:05.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:04.997422+0000 mon.a (mon.0) 13214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:37:05.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:05.009315+0000 mon.a (mon.0) 13215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:05 smithi179 bash[23186]: audit 2024-09-21T04:37:05.016168+0000 mon.a (mon.0) 13216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:37:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:04.031827+0000 mgr.a (mgr.14388) 16560 : audit [DBG] from='client.357258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:04.434120+0000 mon.a (mon.0) 13210 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:37:05.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:04.983367+0000 mon.a (mon.0) 13211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:04.993043+0000 mon.a (mon.0) 13212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:04.995400+0000 mon.a (mon.0) 13213 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:37:05.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:04.997422+0000 mon.a (mon.0) 13214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:37:05.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:05.009315+0000 mon.a (mon.0) 13215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:05.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:05 smithi049 bash[23528]: audit 2024-09-21T04:37:05.016168+0000 mon.a (mon.0) 13216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:37:06.230 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22930]: debug 2024-09-21T04:37:05.787+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:37:06.231 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:37:05 smithi044 bash[22930]: debug 2024-09-21T04:37:05.791+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:37:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:06 smithi044 bash[22676]: cluster 2024-09-21T04:37:04.709905+0000 mgr.a (mgr.14388) 16561 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:06 smithi044 bash[22676]: audit 2024-09-21T04:37:05.018919+0000 mgr.a (mgr.14388) 16562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:37:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:06 smithi179 bash[23186]: cluster 2024-09-21T04:37:04.709905+0000 mgr.a (mgr.14388) 16561 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:06 smithi179 bash[23186]: audit 2024-09-21T04:37:05.018919+0000 mgr.a (mgr.14388) 16562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:37:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:06 smithi049 bash[23528]: cluster 2024-09-21T04:37:04.709905+0000 mgr.a (mgr.14388) 16561 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:06 smithi049 bash[23528]: audit 2024-09-21T04:37:05.018919+0000 mgr.a (mgr.14388) 16562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:37:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:07 smithi179 bash[23186]: audit 2024-09-21T04:37:05.792709+0000 mgr.a (mgr.14388) 16563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:37:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:07 smithi179 bash[23186]: cephadm 2024-09-21T04:37:05.794133+0000 mgr.a (mgr.14388) 16564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:37:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:07 smithi049 bash[23528]: audit 2024-09-21T04:37:05.792709+0000 mgr.a (mgr.14388) 16563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:37:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:07 smithi049 bash[23528]: cephadm 2024-09-21T04:37:05.794133+0000 mgr.a (mgr.14388) 16564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:37:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:07 smithi044 bash[22676]: audit 2024-09-21T04:37:05.792709+0000 mgr.a (mgr.14388) 16563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:37:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:07 smithi044 bash[22676]: cephadm 2024-09-21T04:37:05.794133+0000 mgr.a (mgr.14388) 16564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:37:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:08 smithi179 bash[23186]: cluster 2024-09-21T04:37:06.712960+0000 mgr.a (mgr.14388) 16565 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:08 smithi049 bash[23528]: cluster 2024-09-21T04:37:06.712960+0000 mgr.a (mgr.14388) 16565 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:08 smithi044 bash[22676]: cluster 2024-09-21T04:37:06.712960+0000 mgr.a (mgr.14388) 16565 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:09.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:09.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:09.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:10.272 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:10 smithi179 bash[23186]: cluster 2024-09-21T04:37:08.713842+0000 mgr.a (mgr.14388) 16566 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:10.548 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:10 smithi044 bash[22676]: cluster 2024-09-21T04:37:08.713842+0000 mgr.a (mgr.14388) 16566 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:10 smithi049 bash[23528]: cluster 2024-09-21T04:37:08.713842+0000 mgr.a (mgr.14388) 16566 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:11 smithi179 bash[23186]: audit 2024-09-21T04:37:09.805732+0000 mgr.a (mgr.14388) 16567 : audit [DBG] from='client.357444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:11 smithi049 bash[23528]: audit 2024-09-21T04:37:09.805732+0000 mgr.a (mgr.14388) 16567 : audit [DBG] from='client.357444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:11 smithi044 bash[22676]: audit 2024-09-21T04:37:09.805732+0000 mgr.a (mgr.14388) 16567 : audit [DBG] from='client.357444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:12 smithi049 bash[23528]: cluster 2024-09-21T04:37:10.716444+0000 mgr.a (mgr.14388) 16568 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:12 smithi049 bash[23528]: audit 2024-09-21T04:37:11.279290+0000 mon.a (mon.0) 13217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:12 smithi049 bash[23528]: audit 2024-09-21T04:37:11.285537+0000 mon.a (mon.0) 13218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:12 smithi049 bash[23528]: audit 2024-09-21T04:37:11.293626+0000 mon.a (mon.0) 13219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:12 smithi049 bash[23528]: audit 2024-09-21T04:37:11.355895+0000 mon.a (mon.0) 13220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:12 smithi049 bash[23528]: audit 2024-09-21T04:37:11.363905+0000 mon.a (mon.0) 13221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:12 smithi049 bash[23528]: audit 2024-09-21T04:37:11.371061+0000 mon.a (mon.0) 13222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:12 smithi044 bash[22676]: cluster 2024-09-21T04:37:10.716444+0000 mgr.a (mgr.14388) 16568 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:12 smithi044 bash[22676]: audit 2024-09-21T04:37:11.279290+0000 mon.a (mon.0) 13217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:12 smithi044 bash[22676]: audit 2024-09-21T04:37:11.285537+0000 mon.a (mon.0) 13218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:12 smithi044 bash[22676]: audit 2024-09-21T04:37:11.293626+0000 mon.a (mon.0) 13219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:12 smithi044 bash[22676]: audit 2024-09-21T04:37:11.355895+0000 mon.a (mon.0) 13220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:12 smithi044 bash[22676]: audit 2024-09-21T04:37:11.363905+0000 mon.a (mon.0) 13221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:12 smithi044 bash[22676]: audit 2024-09-21T04:37:11.371061+0000 mon.a (mon.0) 13222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:12 smithi179 bash[23186]: cluster 2024-09-21T04:37:10.716444+0000 mgr.a (mgr.14388) 16568 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:12 smithi179 bash[23186]: audit 2024-09-21T04:37:11.279290+0000 mon.a (mon.0) 13217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:12 smithi179 bash[23186]: audit 2024-09-21T04:37:11.285537+0000 mon.a (mon.0) 13218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:12 smithi179 bash[23186]: audit 2024-09-21T04:37:11.293626+0000 mon.a (mon.0) 13219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:12 smithi179 bash[23186]: audit 2024-09-21T04:37:11.355895+0000 mon.a (mon.0) 13220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:12 smithi179 bash[23186]: audit 2024-09-21T04:37:11.363905+0000 mon.a (mon.0) 13221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:12.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:12 smithi179 bash[23186]: audit 2024-09-21T04:37:11.371061+0000 mon.a (mon.0) 13222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:14 smithi049 bash[23528]: cluster 2024-09-21T04:37:12.717232+0000 mgr.a (mgr.14388) 16569 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:14.595 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:14 smithi179 bash[23186]: cluster 2024-09-21T04:37:12.717232+0000 mgr.a (mgr.14388) 16569 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:14 smithi044 bash[22676]: cluster 2024-09-21T04:37:12.717232+0000 mgr.a (mgr.14388) 16569 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:15.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:16.018 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:16.019 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:16 smithi049 bash[23528]: cluster 2024-09-21T04:37:14.718056+0000 mgr.a (mgr.14388) 16570 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:16 smithi044 bash[22676]: cluster 2024-09-21T04:37:14.718056+0000 mgr.a (mgr.14388) 16570 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:16 smithi179 bash[23186]: cluster 2024-09-21T04:37:14.718056+0000 mgr.a (mgr.14388) 16570 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:17 smithi049 bash[23528]: audit 2024-09-21T04:37:15.600349+0000 mgr.a (mgr.14388) 16571 : audit [DBG] from='client.357522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:17 smithi044 bash[22676]: audit 2024-09-21T04:37:15.600349+0000 mgr.a (mgr.14388) 16571 : audit [DBG] from='client.357522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:17 smithi179 bash[23186]: audit 2024-09-21T04:37:15.600349+0000 mgr.a (mgr.14388) 16571 : audit [DBG] from='client.357522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:18 smithi049 bash[23528]: cluster 2024-09-21T04:37:16.721080+0000 mgr.a (mgr.14388) 16572 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:18 smithi044 bash[22676]: cluster 2024-09-21T04:37:16.721080+0000 mgr.a (mgr.14388) 16572 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:18 smithi179 bash[23186]: cluster 2024-09-21T04:37:16.721080+0000 mgr.a (mgr.14388) 16572 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:20 smithi044 bash[22676]: cluster 2024-09-21T04:37:18.721883+0000 mgr.a (mgr.14388) 16573 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:20 smithi179 bash[23186]: cluster 2024-09-21T04:37:18.721883+0000 mgr.a (mgr.14388) 16573 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:20 smithi049 bash[23528]: cluster 2024-09-21T04:37:18.721883+0000 mgr.a (mgr.14388) 16573 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:37:21.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:21 smithi044 bash[22676]: audit 2024-09-21T04:37:20.425918+0000 mon.a (mon.0) 13223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:21 smithi044 bash[22676]: audit 2024-09-21T04:37:20.434875+0000 mon.a (mon.0) 13224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:21 smithi044 bash[22676]: audit 2024-09-21T04:37:20.445541+0000 mon.a (mon.0) 13225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:21 smithi044 bash[22676]: cluster 2024-09-21T04:37:20.723923+0000 mgr.a (mgr.14388) 16574 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:21 smithi179 bash[23186]: audit 2024-09-21T04:37:20.425918+0000 mon.a (mon.0) 13223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:21 smithi179 bash[23186]: audit 2024-09-21T04:37:20.434875+0000 mon.a (mon.0) 13224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:21 smithi179 bash[23186]: audit 2024-09-21T04:37:20.445541+0000 mon.a (mon.0) 13225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:21 smithi179 bash[23186]: cluster 2024-09-21T04:37:20.723923+0000 mgr.a (mgr.14388) 16574 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:21 smithi049 bash[23528]: audit 2024-09-21T04:37:20.425918+0000 mon.a (mon.0) 13223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:21 smithi049 bash[23528]: audit 2024-09-21T04:37:20.434875+0000 mon.a (mon.0) 13224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:21 smithi049 bash[23528]: audit 2024-09-21T04:37:20.445541+0000 mon.a (mon.0) 13225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:21 smithi049 bash[23528]: cluster 2024-09-21T04:37:20.723923+0000 mgr.a (mgr.14388) 16574 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:37:21.819 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:22 smithi044 bash[22676]: audit 2024-09-21T04:37:21.354872+0000 mgr.a (mgr.14388) 16575 : audit [DBG] from='client.357600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:22 smithi179 bash[23186]: audit 2024-09-21T04:37:21.354872+0000 mgr.a (mgr.14388) 16575 : audit [DBG] from='client.357600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:22 smithi049 bash[23528]: audit 2024-09-21T04:37:21.354872+0000 mgr.a (mgr.14388) 16575 : audit [DBG] from='client.357600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:23 smithi044 bash[22676]: cluster 2024-09-21T04:37:22.724910+0000 mgr.a (mgr.14388) 16576 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:37:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:23 smithi179 bash[23186]: cluster 2024-09-21T04:37:22.724910+0000 mgr.a (mgr.14388) 16576 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:37:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:23 smithi049 bash[23528]: cluster 2024-09-21T04:37:22.724910+0000 mgr.a (mgr.14388) 16576 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:37:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:25 smithi049 bash[23528]: cluster 2024-09-21T04:37:24.725721+0000 mgr.a (mgr.14388) 16577 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:37:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:25 smithi044 bash[22676]: cluster 2024-09-21T04:37:24.725721+0000 mgr.a (mgr.14388) 16577 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:37:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:25 smithi179 bash[23186]: cluster 2024-09-21T04:37:24.725721+0000 mgr.a (mgr.14388) 16577 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:37:26.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:26.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:26.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:27.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:27.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:27.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:27.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:27.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:27 smithi049 bash[23528]: cluster 2024-09-21T04:37:26.728010+0000 mgr.a (mgr.14388) 16578 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:27 smithi049 bash[23528]: audit 2024-09-21T04:37:27.153613+0000 mgr.a (mgr.14388) 16579 : audit [DBG] from='client.357678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:27 smithi044 bash[22676]: cluster 2024-09-21T04:37:26.728010+0000 mgr.a (mgr.14388) 16578 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:27 smithi044 bash[22676]: audit 2024-09-21T04:37:27.153613+0000 mgr.a (mgr.14388) 16579 : audit [DBG] from='client.357678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:27 smithi179 bash[23186]: cluster 2024-09-21T04:37:26.728010+0000 mgr.a (mgr.14388) 16578 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:27 smithi179 bash[23186]: audit 2024-09-21T04:37:27.153613+0000 mgr.a (mgr.14388) 16579 : audit [DBG] from='client.357678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:29 smithi179 bash[23186]: cluster 2024-09-21T04:37:28.729029+0000 mgr.a (mgr.14388) 16580 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:29 smithi049 bash[23528]: cluster 2024-09-21T04:37:28.729029+0000 mgr.a (mgr.14388) 16580 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:30.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:29 smithi044 bash[22676]: cluster 2024-09-21T04:37:28.729029+0000 mgr.a (mgr.14388) 16580 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:31 smithi044 bash[22676]: cluster 2024-09-21T04:37:30.730454+0000 mgr.a (mgr.14388) 16581 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:31 smithi044 bash[22676]: audit 2024-09-21T04:37:31.492336+0000 mon.a (mon.0) 13226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:31 smithi044 bash[22676]: audit 2024-09-21T04:37:31.498699+0000 mon.a (mon.0) 13227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:31 smithi044 bash[22676]: audit 2024-09-21T04:37:31.507188+0000 mon.a (mon.0) 13228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:31 smithi044 bash[22676]: audit 2024-09-21T04:37:31.584113+0000 mon.a (mon.0) 13229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:31 smithi044 bash[22676]: audit 2024-09-21T04:37:31.591880+0000 mon.a (mon.0) 13230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:31 smithi044 bash[22676]: audit 2024-09-21T04:37:31.600526+0000 mon.a (mon.0) 13231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:31 smithi049 bash[23528]: cluster 2024-09-21T04:37:30.730454+0000 mgr.a (mgr.14388) 16581 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:31 smithi049 bash[23528]: audit 2024-09-21T04:37:31.492336+0000 mon.a (mon.0) 13226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:31 smithi049 bash[23528]: audit 2024-09-21T04:37:31.498699+0000 mon.a (mon.0) 13227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:31 smithi049 bash[23528]: audit 2024-09-21T04:37:31.507188+0000 mon.a (mon.0) 13228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:31 smithi049 bash[23528]: audit 2024-09-21T04:37:31.584113+0000 mon.a (mon.0) 13229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:31 smithi049 bash[23528]: audit 2024-09-21T04:37:31.591880+0000 mon.a (mon.0) 13230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:31 smithi049 bash[23528]: audit 2024-09-21T04:37:31.600526+0000 mon.a (mon.0) 13231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:31 smithi179 bash[23186]: cluster 2024-09-21T04:37:30.730454+0000 mgr.a (mgr.14388) 16581 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:31 smithi179 bash[23186]: audit 2024-09-21T04:37:31.492336+0000 mon.a (mon.0) 13226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:31 smithi179 bash[23186]: audit 2024-09-21T04:37:31.498699+0000 mon.a (mon.0) 13227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:31 smithi179 bash[23186]: audit 2024-09-21T04:37:31.507188+0000 mon.a (mon.0) 13228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:31 smithi179 bash[23186]: audit 2024-09-21T04:37:31.584113+0000 mon.a (mon.0) 13229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:31 smithi179 bash[23186]: audit 2024-09-21T04:37:31.591880+0000 mon.a (mon.0) 13230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:31 smithi179 bash[23186]: audit 2024-09-21T04:37:31.600526+0000 mon.a (mon.0) 13231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:33.383 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:33.383 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:33 smithi049 bash[23528]: cluster 2024-09-21T04:37:32.730963+0000 mgr.a (mgr.14388) 16582 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:33 smithi049 bash[23528]: audit 2024-09-21T04:37:32.933557+0000 mgr.a (mgr.14388) 16583 : audit [DBG] from='client.357756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:33 smithi044 bash[22676]: cluster 2024-09-21T04:37:32.730963+0000 mgr.a (mgr.14388) 16582 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:33 smithi044 bash[22676]: audit 2024-09-21T04:37:32.933557+0000 mgr.a (mgr.14388) 16583 : audit [DBG] from='client.357756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:33 smithi179 bash[23186]: cluster 2024-09-21T04:37:32.730963+0000 mgr.a (mgr.14388) 16582 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:33 smithi179 bash[23186]: audit 2024-09-21T04:37:32.933557+0000 mgr.a (mgr.14388) 16583 : audit [DBG] from='client.357756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:35 smithi179 bash[23186]: cluster 2024-09-21T04:37:34.732001+0000 mgr.a (mgr.14388) 16584 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:35 smithi044 bash[22676]: cluster 2024-09-21T04:37:34.732001+0000 mgr.a (mgr.14388) 16584 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:35 smithi049 bash[23528]: cluster 2024-09-21T04:37:34.732001+0000 mgr.a (mgr.14388) 16584 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:37 smithi044 bash[22676]: cluster 2024-09-21T04:37:36.734427+0000 mgr.a (mgr.14388) 16585 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:37 smithi179 bash[23186]: cluster 2024-09-21T04:37:36.734427+0000 mgr.a (mgr.14388) 16585 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:37 smithi049 bash[23528]: cluster 2024-09-21T04:37:36.734427+0000 mgr.a (mgr.14388) 16585 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:38.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:38.385 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:38.385 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:39.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:39.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:39.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:39.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:39.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:39 smithi044 bash[22676]: audit 2024-09-21T04:37:38.721982+0000 mgr.a (mgr.14388) 16586 : audit [DBG] from='client.357834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:39 smithi044 bash[22676]: cluster 2024-09-21T04:37:38.742549+0000 mgr.a (mgr.14388) 16587 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:39 smithi179 bash[23186]: audit 2024-09-21T04:37:38.721982+0000 mgr.a (mgr.14388) 16586 : audit [DBG] from='client.357834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:39 smithi179 bash[23186]: cluster 2024-09-21T04:37:38.742549+0000 mgr.a (mgr.14388) 16587 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:39 smithi049 bash[23528]: audit 2024-09-21T04:37:38.721982+0000 mgr.a (mgr.14388) 16586 : audit [DBG] from='client.357834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:39 smithi049 bash[23528]: cluster 2024-09-21T04:37:38.742549+0000 mgr.a (mgr.14388) 16587 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:41 smithi044 bash[22676]: audit 2024-09-21T04:37:40.660135+0000 mon.a (mon.0) 13232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:41 smithi044 bash[22676]: audit 2024-09-21T04:37:40.668886+0000 mon.a (mon.0) 13233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:41 smithi044 bash[22676]: audit 2024-09-21T04:37:40.679494+0000 mon.a (mon.0) 13234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:41 smithi044 bash[22676]: cluster 2024-09-21T04:37:40.745142+0000 mgr.a (mgr.14388) 16588 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:41 smithi179 bash[23186]: audit 2024-09-21T04:37:40.660135+0000 mon.a (mon.0) 13232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:41 smithi179 bash[23186]: audit 2024-09-21T04:37:40.668886+0000 mon.a (mon.0) 13233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:41 smithi179 bash[23186]: audit 2024-09-21T04:37:40.679494+0000 mon.a (mon.0) 13234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:41 smithi179 bash[23186]: cluster 2024-09-21T04:37:40.745142+0000 mgr.a (mgr.14388) 16588 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:41 smithi049 bash[23528]: audit 2024-09-21T04:37:40.660135+0000 mon.a (mon.0) 13232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:41 smithi049 bash[23528]: audit 2024-09-21T04:37:40.668886+0000 mon.a (mon.0) 13233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:41 smithi049 bash[23528]: audit 2024-09-21T04:37:40.679494+0000 mon.a (mon.0) 13234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:41 smithi049 bash[23528]: cluster 2024-09-21T04:37:40.745142+0000 mgr.a (mgr.14388) 16588 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:43 smithi049 bash[23528]: cluster 2024-09-21T04:37:42.745930+0000 mgr.a (mgr.14388) 16589 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:44.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:44.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:44.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:43 smithi044 bash[22676]: cluster 2024-09-21T04:37:42.745930+0000 mgr.a (mgr.14388) 16589 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:43 smithi179 bash[23186]: cluster 2024-09-21T04:37:42.745930+0000 mgr.a (mgr.14388) 16589 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:44.975 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:44.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:44.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:44.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:44.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:45 smithi044 bash[22676]: audit 2024-09-21T04:37:44.522032+0000 mgr.a (mgr.14388) 16590 : audit [DBG] from='client.357912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:45 smithi044 bash[22676]: cluster 2024-09-21T04:37:44.746483+0000 mgr.a (mgr.14388) 16591 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:45 smithi179 bash[23186]: audit 2024-09-21T04:37:44.522032+0000 mgr.a (mgr.14388) 16590 : audit [DBG] from='client.357912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:45 smithi179 bash[23186]: cluster 2024-09-21T04:37:44.746483+0000 mgr.a (mgr.14388) 16591 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:45 smithi049 bash[23528]: audit 2024-09-21T04:37:44.522032+0000 mgr.a (mgr.14388) 16590 : audit [DBG] from='client.357912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:45 smithi049 bash[23528]: cluster 2024-09-21T04:37:44.746483+0000 mgr.a (mgr.14388) 16591 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:47 smithi044 bash[22676]: cluster 2024-09-21T04:37:46.748953+0000 mgr.a (mgr.14388) 16592 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:47 smithi179 bash[23186]: cluster 2024-09-21T04:37:46.748953+0000 mgr.a (mgr.14388) 16592 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:47 smithi049 bash[23528]: cluster 2024-09-21T04:37:46.748953+0000 mgr.a (mgr.14388) 16592 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:37:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:49 smithi049 bash[23528]: cluster 2024-09-21T04:37:48.749639+0000 mgr.a (mgr.14388) 16593 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:50.151 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:49 smithi179 bash[23186]: cluster 2024-09-21T04:37:48.749639+0000 mgr.a (mgr.14388) 16593 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:49 smithi044 bash[22676]: cluster 2024-09-21T04:37:48.749639+0000 mgr.a (mgr.14388) 16593 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:50.739 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:50.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:50.740 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:50 smithi044 bash[22676]: audit 2024-09-21T04:37:50.308897+0000 mgr.a (mgr.14388) 16594 : audit [DBG] from='client.357990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:50 smithi049 bash[23528]: audit 2024-09-21T04:37:50.308897+0000 mgr.a (mgr.14388) 16594 : audit [DBG] from='client.357990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:50 smithi179 bash[23186]: audit 2024-09-21T04:37:50.308897+0000 mgr.a (mgr.14388) 16594 : audit [DBG] from='client.357990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:51 smithi179 bash[23186]: cluster 2024-09-21T04:37:50.750936+0000 mgr.a (mgr.14388) 16595 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:51 smithi179 bash[23186]: audit 2024-09-21T04:37:51.710217+0000 mon.a (mon.0) 13235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:51 smithi179 bash[23186]: audit 2024-09-21T04:37:51.716026+0000 mon.a (mon.0) 13236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:51 smithi179 bash[23186]: audit 2024-09-21T04:37:51.723906+0000 mon.a (mon.0) 13237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:51 smithi179 bash[23186]: audit 2024-09-21T04:37:51.762981+0000 mon.a (mon.0) 13238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:51 smithi179 bash[23186]: audit 2024-09-21T04:37:51.768443+0000 mon.a (mon.0) 13239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:51 smithi179 bash[23186]: audit 2024-09-21T04:37:51.775634+0000 mon.a (mon.0) 13240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:51 smithi049 bash[23528]: cluster 2024-09-21T04:37:50.750936+0000 mgr.a (mgr.14388) 16595 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:51 smithi049 bash[23528]: audit 2024-09-21T04:37:51.710217+0000 mon.a (mon.0) 13235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:51 smithi049 bash[23528]: audit 2024-09-21T04:37:51.716026+0000 mon.a (mon.0) 13236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:51 smithi049 bash[23528]: audit 2024-09-21T04:37:51.723906+0000 mon.a (mon.0) 13237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:51 smithi049 bash[23528]: audit 2024-09-21T04:37:51.762981+0000 mon.a (mon.0) 13238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:51 smithi049 bash[23528]: audit 2024-09-21T04:37:51.768443+0000 mon.a (mon.0) 13239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:51 smithi049 bash[23528]: audit 2024-09-21T04:37:51.775634+0000 mon.a (mon.0) 13240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:51 smithi044 bash[22676]: cluster 2024-09-21T04:37:50.750936+0000 mgr.a (mgr.14388) 16595 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:51 smithi044 bash[22676]: audit 2024-09-21T04:37:51.710217+0000 mon.a (mon.0) 13235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:51 smithi044 bash[22676]: audit 2024-09-21T04:37:51.716026+0000 mon.a (mon.0) 13236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:51 smithi044 bash[22676]: audit 2024-09-21T04:37:51.723906+0000 mon.a (mon.0) 13237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:51 smithi044 bash[22676]: audit 2024-09-21T04:37:51.762981+0000 mon.a (mon.0) 13238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:51 smithi044 bash[22676]: audit 2024-09-21T04:37:51.768443+0000 mon.a (mon.0) 13239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:51 smithi044 bash[22676]: audit 2024-09-21T04:37:51.775634+0000 mon.a (mon.0) 13240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:37:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:53 smithi044 bash[22676]: cluster 2024-09-21T04:37:52.751711+0000 mgr.a (mgr.14388) 16596 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:37:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:53 smithi179 bash[23186]: cluster 2024-09-21T04:37:52.751711+0000 mgr.a (mgr.14388) 16596 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:37:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:53 smithi049 bash[23528]: cluster 2024-09-21T04:37:52.751711+0000 mgr.a (mgr.14388) 16596 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:37:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:37:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:37:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:37:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:55 smithi044 bash[22676]: cluster 2024-09-21T04:37:54.752504+0000 mgr.a (mgr.14388) 16597 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:37:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:55 smithi179 bash[23186]: cluster 2024-09-21T04:37:54.752504+0000 mgr.a (mgr.14388) 16597 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:37:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:55 smithi049 bash[23528]: cluster 2024-09-21T04:37:54.752504+0000 mgr.a (mgr.14388) 16597 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:37:56.493 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:37:56.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:37:56.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:37:56.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:37:56.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:37:57.107 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:56 smithi179 bash[23186]: audit 2024-09-21T04:37:56.072201+0000 mgr.a (mgr.14388) 16598 : audit [DBG] from='client.358068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:56 smithi044 bash[22676]: audit 2024-09-21T04:37:56.072201+0000 mgr.a (mgr.14388) 16598 : audit [DBG] from='client.358068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:56 smithi049 bash[23528]: audit 2024-09-21T04:37:56.072201+0000 mgr.a (mgr.14388) 16598 : audit [DBG] from='client.358068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:37:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:57 smithi179 bash[23186]: cluster 2024-09-21T04:37:56.755483+0000 mgr.a (mgr.14388) 16599 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:57 smithi044 bash[22676]: cluster 2024-09-21T04:37:56.755483+0000 mgr.a (mgr.14388) 16599 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:37:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:57 smithi049 bash[23528]: cluster 2024-09-21T04:37:56.755483+0000 mgr.a (mgr.14388) 16599 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:37:59 smithi044 bash[22676]: cluster 2024-09-21T04:37:58.756265+0000 mgr.a (mgr.14388) 16600 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:38:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:37:59 smithi179 bash[23186]: cluster 2024-09-21T04:37:58.756265+0000 mgr.a (mgr.14388) 16600 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:38:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:37:59 smithi049 bash[23528]: cluster 2024-09-21T04:37:58.756265+0000 mgr.a (mgr.14388) 16600 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:38:01.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:01.496 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:01 smithi044 bash[22676]: cluster 2024-09-21T04:38:00.758292+0000 mgr.a (mgr.14388) 16601 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:01 smithi044 bash[22676]: audit 2024-09-21T04:38:00.895608+0000 mon.a (mon.0) 13241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:01 smithi044 bash[22676]: audit 2024-09-21T04:38:00.904248+0000 mon.a (mon.0) 13242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:01 smithi044 bash[22676]: audit 2024-09-21T04:38:00.914835+0000 mon.a (mon.0) 13243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:01 smithi179 bash[23186]: cluster 2024-09-21T04:38:00.758292+0000 mgr.a (mgr.14388) 16601 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:01 smithi179 bash[23186]: audit 2024-09-21T04:38:00.895608+0000 mon.a (mon.0) 13241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:01 smithi179 bash[23186]: audit 2024-09-21T04:38:00.904248+0000 mon.a (mon.0) 13242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:01 smithi179 bash[23186]: audit 2024-09-21T04:38:00.914835+0000 mon.a (mon.0) 13243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.291 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:02.291 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:01 smithi049 bash[23528]: cluster 2024-09-21T04:38:00.758292+0000 mgr.a (mgr.14388) 16601 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:01 smithi049 bash[23528]: audit 2024-09-21T04:38:00.895608+0000 mon.a (mon.0) 13241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:01 smithi049 bash[23528]: audit 2024-09-21T04:38:00.904248+0000 mon.a (mon.0) 13242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:01 smithi049 bash[23528]: audit 2024-09-21T04:38:00.914835+0000 mon.a (mon.0) 13243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:02 smithi044 bash[22676]: audit 2024-09-21T04:38:01.828881+0000 mgr.a (mgr.14388) 16602 : audit [DBG] from='client.358143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:02 smithi179 bash[23186]: audit 2024-09-21T04:38:01.828881+0000 mgr.a (mgr.14388) 16602 : audit [DBG] from='client.358143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:02 smithi049 bash[23528]: audit 2024-09-21T04:38:01.828881+0000 mgr.a (mgr.14388) 16602 : audit [DBG] from='client.358143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:03 smithi044 bash[22676]: cluster 2024-09-21T04:38:02.759270+0000 mgr.a (mgr.14388) 16603 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:03 smithi179 bash[23186]: cluster 2024-09-21T04:38:02.759270+0000 mgr.a (mgr.14388) 16603 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:03 smithi049 bash[23528]: cluster 2024-09-21T04:38:02.759270+0000 mgr.a (mgr.14388) 16603 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:05 smithi044 bash[22676]: cluster 2024-09-21T04:38:04.760097+0000 mgr.a (mgr.14388) 16604 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:05 smithi044 bash[22676]: audit 2024-09-21T04:38:05.861021+0000 mon.a (mon.0) 13244 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:38:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:05 smithi044 bash[22676]: audit 2024-09-21T04:38:05.868308+0000 mon.a (mon.0) 13245 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:38:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:05 smithi044 bash[22676]: audit 2024-09-21T04:38:05.870416+0000 mon.a (mon.0) 13246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:38:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:05 smithi044 bash[22676]: audit 2024-09-21T04:38:05.882579+0000 mon.a (mon.0) 13247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:06.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:05 smithi044 bash[22676]: audit 2024-09-21T04:38:05.889670+0000 mon.a (mon.0) 13248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:38:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:05 smithi179 bash[23186]: cluster 2024-09-21T04:38:04.760097+0000 mgr.a (mgr.14388) 16604 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:05 smithi179 bash[23186]: audit 2024-09-21T04:38:05.861021+0000 mon.a (mon.0) 13244 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:38:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:05 smithi179 bash[23186]: audit 2024-09-21T04:38:05.868308+0000 mon.a (mon.0) 13245 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:38:06.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:05 smithi179 bash[23186]: audit 2024-09-21T04:38:05.870416+0000 mon.a (mon.0) 13246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:38:06.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:05 smithi179 bash[23186]: audit 2024-09-21T04:38:05.882579+0000 mon.a (mon.0) 13247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:06.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:05 smithi179 bash[23186]: audit 2024-09-21T04:38:05.889670+0000 mon.a (mon.0) 13248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:38:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:05 smithi049 bash[23528]: cluster 2024-09-21T04:38:04.760097+0000 mgr.a (mgr.14388) 16604 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:05 smithi049 bash[23528]: audit 2024-09-21T04:38:05.861021+0000 mon.a (mon.0) 13244 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:38:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:05 smithi049 bash[23528]: audit 2024-09-21T04:38:05.868308+0000 mon.a (mon.0) 13245 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:38:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:05 smithi049 bash[23528]: audit 2024-09-21T04:38:05.870416+0000 mon.a (mon.0) 13246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:38:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:05 smithi049 bash[23528]: audit 2024-09-21T04:38:05.882579+0000 mon.a (mon.0) 13247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:06.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:05 smithi049 bash[23528]: audit 2024-09-21T04:38:05.889670+0000 mon.a (mon.0) 13248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:38:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:06 smithi044 bash[22676]: audit 2024-09-21T04:38:05.892154+0000 mgr.a (mgr.14388) 16605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:38:06.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:38:06 smithi044 bash[22930]: debug 2024-09-21T04:38:06.670+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:38:06.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:38:06 smithi044 bash[22930]: debug 2024-09-21T04:38:06.670+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:38:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:06 smithi179 bash[23186]: audit 2024-09-21T04:38:05.892154+0000 mgr.a (mgr.14388) 16605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:38:07.292 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:07.293 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:07.293 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:06 smithi049 bash[23528]: audit 2024-09-21T04:38:05.892154+0000 mgr.a (mgr.14388) 16605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:38:08.073 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:07 smithi044 bash[22676]: audit 2024-09-21T04:38:06.675354+0000 mgr.a (mgr.14388) 16606 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:38:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:07 smithi044 bash[22676]: cephadm 2024-09-21T04:38:06.676724+0000 mgr.a (mgr.14388) 16607 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:38:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:07 smithi044 bash[22676]: cluster 2024-09-21T04:38:06.761691+0000 mgr.a (mgr.14388) 16608 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:07 smithi179 bash[23186]: audit 2024-09-21T04:38:06.675354+0000 mgr.a (mgr.14388) 16606 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:38:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:07 smithi179 bash[23186]: cephadm 2024-09-21T04:38:06.676724+0000 mgr.a (mgr.14388) 16607 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:38:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:07 smithi179 bash[23186]: cluster 2024-09-21T04:38:06.761691+0000 mgr.a (mgr.14388) 16608 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:07 smithi049 bash[23528]: audit 2024-09-21T04:38:06.675354+0000 mgr.a (mgr.14388) 16606 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:38:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:07 smithi049 bash[23528]: cephadm 2024-09-21T04:38:06.676724+0000 mgr.a (mgr.14388) 16607 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:38:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:07 smithi049 bash[23528]: cluster 2024-09-21T04:38:06.761691+0000 mgr.a (mgr.14388) 16608 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:08 smithi044 bash[22676]: audit 2024-09-21T04:38:07.623942+0000 mgr.a (mgr.14388) 16609 : audit [DBG] from='client.358323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:08 smithi179 bash[23186]: audit 2024-09-21T04:38:07.623942+0000 mgr.a (mgr.14388) 16609 : audit [DBG] from='client.358323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:09.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:08 smithi049 bash[23528]: audit 2024-09-21T04:38:07.623942+0000 mgr.a (mgr.14388) 16609 : audit [DBG] from='client.358323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:09 smithi044 bash[22676]: cluster 2024-09-21T04:38:08.762435+0000 mgr.a (mgr.14388) 16610 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:09 smithi179 bash[23186]: cluster 2024-09-21T04:38:08.762435+0000 mgr.a (mgr.14388) 16610 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:09 smithi049 bash[23528]: cluster 2024-09-21T04:38:08.762435+0000 mgr.a (mgr.14388) 16610 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:11 smithi044 bash[22676]: cluster 2024-09-21T04:38:10.763718+0000 mgr.a (mgr.14388) 16611 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:11 smithi044 bash[22676]: audit 2024-09-21T04:38:11.918595+0000 mon.a (mon.0) 13249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:11 smithi044 bash[22676]: audit 2024-09-21T04:38:11.928035+0000 mon.a (mon.0) 13250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:11 smithi179 bash[23186]: cluster 2024-09-21T04:38:10.763718+0000 mgr.a (mgr.14388) 16611 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:11 smithi179 bash[23186]: audit 2024-09-21T04:38:11.918595+0000 mon.a (mon.0) 13249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:11 smithi179 bash[23186]: audit 2024-09-21T04:38:11.928035+0000 mon.a (mon.0) 13250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:12.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:11 smithi049 bash[23528]: cluster 2024-09-21T04:38:10.763718+0000 mgr.a (mgr.14388) 16611 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:12.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:11 smithi049 bash[23528]: audit 2024-09-21T04:38:11.918595+0000 mon.a (mon.0) 13249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:12.267 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:11 smithi049 bash[23528]: audit 2024-09-21T04:38:11.928035+0000 mon.a (mon.0) 13250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:13.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:13.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:13.212 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:12 smithi049 bash[23528]: audit 2024-09-21T04:38:11.936194+0000 mon.a (mon.0) 13251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.212 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:12 smithi049 bash[23528]: audit 2024-09-21T04:38:11.951967+0000 mon.a (mon.0) 13252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.212 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:12 smithi049 bash[23528]: audit 2024-09-21T04:38:11.958025+0000 mon.a (mon.0) 13253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.212 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:12 smithi049 bash[23528]: audit 2024-09-21T04:38:11.967715+0000 mon.a (mon.0) 13254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:12 smithi044 bash[22676]: audit 2024-09-21T04:38:11.936194+0000 mon.a (mon.0) 13251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:12 smithi044 bash[22676]: audit 2024-09-21T04:38:11.951967+0000 mon.a (mon.0) 13252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:12 smithi044 bash[22676]: audit 2024-09-21T04:38:11.958025+0000 mon.a (mon.0) 13253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:12 smithi044 bash[22676]: audit 2024-09-21T04:38:11.967715+0000 mon.a (mon.0) 13254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:12 smithi179 bash[23186]: audit 2024-09-21T04:38:11.936194+0000 mon.a (mon.0) 13251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:12 smithi179 bash[23186]: audit 2024-09-21T04:38:11.951967+0000 mon.a (mon.0) 13252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:12 smithi179 bash[23186]: audit 2024-09-21T04:38:11.958025+0000 mon.a (mon.0) 13253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:12 smithi179 bash[23186]: audit 2024-09-21T04:38:11.967715+0000 mon.a (mon.0) 13254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:13.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:13 smithi044 bash[22676]: cluster 2024-09-21T04:38:12.764481+0000 mgr.a (mgr.14388) 16612 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:13 smithi179 bash[23186]: cluster 2024-09-21T04:38:12.764481+0000 mgr.a (mgr.14388) 16612 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:13 smithi049 bash[23528]: cluster 2024-09-21T04:38:12.764481+0000 mgr.a (mgr.14388) 16612 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:14 smithi044 bash[22676]: audit 2024-09-21T04:38:13.405324+0000 mgr.a (mgr.14388) 16613 : audit [DBG] from='client.358401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:14 smithi179 bash[23186]: audit 2024-09-21T04:38:13.405324+0000 mgr.a (mgr.14388) 16613 : audit [DBG] from='client.358401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:14 smithi049 bash[23528]: audit 2024-09-21T04:38:13.405324+0000 mgr.a (mgr.14388) 16613 : audit [DBG] from='client.358401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:15 smithi044 bash[22676]: cluster 2024-09-21T04:38:14.765433+0000 mgr.a (mgr.14388) 16614 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:15 smithi179 bash[23186]: cluster 2024-09-21T04:38:14.765433+0000 mgr.a (mgr.14388) 16614 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:15 smithi049 bash[23528]: cluster 2024-09-21T04:38:14.765433+0000 mgr.a (mgr.14388) 16614 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:17 smithi044 bash[22676]: cluster 2024-09-21T04:38:16.767768+0000 mgr.a (mgr.14388) 16615 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:17 smithi179 bash[23186]: cluster 2024-09-21T04:38:16.767768+0000 mgr.a (mgr.14388) 16615 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:17 smithi049 bash[23528]: cluster 2024-09-21T04:38:16.767768+0000 mgr.a (mgr.14388) 16615 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:19.606 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:19 smithi179 bash[23186]: cluster 2024-09-21T04:38:18.768564+0000 mgr.a (mgr.14388) 16616 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:19 smithi179 bash[23186]: audit 2024-09-21T04:38:19.168035+0000 mgr.a (mgr.14388) 16617 : audit [DBG] from='client.358476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:19 smithi049 bash[23528]: cluster 2024-09-21T04:38:18.768564+0000 mgr.a (mgr.14388) 16616 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:19 smithi049 bash[23528]: audit 2024-09-21T04:38:19.168035+0000 mgr.a (mgr.14388) 16617 : audit [DBG] from='client.358476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:19 smithi044 bash[22676]: cluster 2024-09-21T04:38:18.768564+0000 mgr.a (mgr.14388) 16616 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:19 smithi044 bash[22676]: audit 2024-09-21T04:38:19.168035+0000 mgr.a (mgr.14388) 16617 : audit [DBG] from='client.358476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:22 smithi044 bash[22676]: cluster 2024-09-21T04:38:20.771007+0000 mgr.a (mgr.14388) 16618 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:22 smithi044 bash[22676]: audit 2024-09-21T04:38:21.106374+0000 mon.a (mon.0) 13255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:22 smithi044 bash[22676]: audit 2024-09-21T04:38:21.114995+0000 mon.a (mon.0) 13256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:22 smithi044 bash[22676]: audit 2024-09-21T04:38:21.125771+0000 mon.a (mon.0) 13257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:22 smithi179 bash[23186]: cluster 2024-09-21T04:38:20.771007+0000 mgr.a (mgr.14388) 16618 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:22 smithi179 bash[23186]: audit 2024-09-21T04:38:21.106374+0000 mon.a (mon.0) 13255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:22 smithi179 bash[23186]: audit 2024-09-21T04:38:21.114995+0000 mon.a (mon.0) 13256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:22 smithi179 bash[23186]: audit 2024-09-21T04:38:21.125771+0000 mon.a (mon.0) 13257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:22 smithi049 bash[23528]: cluster 2024-09-21T04:38:20.771007+0000 mgr.a (mgr.14388) 16618 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:38:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:22 smithi049 bash[23528]: audit 2024-09-21T04:38:21.106374+0000 mon.a (mon.0) 13255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:22 smithi049 bash[23528]: audit 2024-09-21T04:38:21.114995+0000 mon.a (mon.0) 13256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:22 smithi049 bash[23528]: audit 2024-09-21T04:38:21.125771+0000 mon.a (mon.0) 13257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:24 smithi044 bash[22676]: cluster 2024-09-21T04:38:22.771920+0000 mgr.a (mgr.14388) 16619 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:24 smithi179 bash[23186]: cluster 2024-09-21T04:38:22.771920+0000 mgr.a (mgr.14388) 16619 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:24 smithi049 bash[23528]: cluster 2024-09-21T04:38:22.771920+0000 mgr.a (mgr.14388) 16619 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:24.607 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:24.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:24.608 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:25.377 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:26 smithi044 bash[22676]: cluster 2024-09-21T04:38:24.772471+0000 mgr.a (mgr.14388) 16620 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:26 smithi044 bash[22676]: audit 2024-09-21T04:38:24.942094+0000 mgr.a (mgr.14388) 16621 : audit [DBG] from='client.358554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:26 smithi179 bash[23186]: cluster 2024-09-21T04:38:24.772471+0000 mgr.a (mgr.14388) 16620 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:26 smithi179 bash[23186]: audit 2024-09-21T04:38:24.942094+0000 mgr.a (mgr.14388) 16621 : audit [DBG] from='client.358554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:26 smithi049 bash[23528]: cluster 2024-09-21T04:38:24.772471+0000 mgr.a (mgr.14388) 16620 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:26 smithi049 bash[23528]: audit 2024-09-21T04:38:24.942094+0000 mgr.a (mgr.14388) 16621 : audit [DBG] from='client.358554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:28.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:28 smithi044 bash[22676]: cluster 2024-09-21T04:38:26.775439+0000 mgr.a (mgr.14388) 16622 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:38:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:28 smithi179 bash[23186]: cluster 2024-09-21T04:38:26.775439+0000 mgr.a (mgr.14388) 16622 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:38:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:28 smithi049 bash[23528]: cluster 2024-09-21T04:38:26.775439+0000 mgr.a (mgr.14388) 16622 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:38:30.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:30.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:30.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:30 smithi044 bash[22676]: cluster 2024-09-21T04:38:28.776046+0000 mgr.a (mgr.14388) 16623 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:38:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:30 smithi179 bash[23186]: cluster 2024-09-21T04:38:28.776046+0000 mgr.a (mgr.14388) 16623 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:38:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:30 smithi049 bash[23528]: cluster 2024-09-21T04:38:28.776046+0000 mgr.a (mgr.14388) 16623 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:38:31.159 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:32 smithi049 bash[23528]: audit 2024-09-21T04:38:30.708704+0000 mgr.a (mgr.14388) 16624 : audit [DBG] from='client.358632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:32 smithi049 bash[23528]: cluster 2024-09-21T04:38:30.777379+0000 mgr.a (mgr.14388) 16625 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:32 smithi044 bash[22676]: audit 2024-09-21T04:38:30.708704+0000 mgr.a (mgr.14388) 16624 : audit [DBG] from='client.358632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:32 smithi044 bash[22676]: cluster 2024-09-21T04:38:30.777379+0000 mgr.a (mgr.14388) 16625 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:32 smithi179 bash[23186]: audit 2024-09-21T04:38:30.708704+0000 mgr.a (mgr.14388) 16624 : audit [DBG] from='client.358632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:32 smithi179 bash[23186]: cluster 2024-09-21T04:38:30.777379+0000 mgr.a (mgr.14388) 16625 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:33 smithi049 bash[23528]: audit 2024-09-21T04:38:32.140128+0000 mon.a (mon.0) 13258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:33 smithi049 bash[23528]: audit 2024-09-21T04:38:32.145282+0000 mon.a (mon.0) 13259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:33 smithi049 bash[23528]: audit 2024-09-21T04:38:32.151752+0000 mon.a (mon.0) 13260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:33 smithi049 bash[23528]: audit 2024-09-21T04:38:32.156047+0000 mon.a (mon.0) 13261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:33 smithi049 bash[23528]: audit 2024-09-21T04:38:32.160519+0000 mon.a (mon.0) 13262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:33 smithi049 bash[23528]: audit 2024-09-21T04:38:32.167505+0000 mon.a (mon.0) 13263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:33 smithi044 bash[22676]: audit 2024-09-21T04:38:32.140128+0000 mon.a (mon.0) 13258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:33 smithi044 bash[22676]: audit 2024-09-21T04:38:32.145282+0000 mon.a (mon.0) 13259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:33 smithi044 bash[22676]: audit 2024-09-21T04:38:32.151752+0000 mon.a (mon.0) 13260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:33 smithi044 bash[22676]: audit 2024-09-21T04:38:32.156047+0000 mon.a (mon.0) 13261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:33 smithi044 bash[22676]: audit 2024-09-21T04:38:32.160519+0000 mon.a (mon.0) 13262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:33 smithi044 bash[22676]: audit 2024-09-21T04:38:32.167505+0000 mon.a (mon.0) 13263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:33 smithi179 bash[23186]: audit 2024-09-21T04:38:32.140128+0000 mon.a (mon.0) 13258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:33 smithi179 bash[23186]: audit 2024-09-21T04:38:32.145282+0000 mon.a (mon.0) 13259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:33 smithi179 bash[23186]: audit 2024-09-21T04:38:32.151752+0000 mon.a (mon.0) 13260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:33 smithi179 bash[23186]: audit 2024-09-21T04:38:32.156047+0000 mon.a (mon.0) 13261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:33 smithi179 bash[23186]: audit 2024-09-21T04:38:32.160519+0000 mon.a (mon.0) 13262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:33 smithi179 bash[23186]: audit 2024-09-21T04:38:32.167505+0000 mon.a (mon.0) 13263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:34 smithi044 bash[22676]: cluster 2024-09-21T04:38:32.778162+0000 mgr.a (mgr.14388) 16626 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:38:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:34 smithi179 bash[23186]: cluster 2024-09-21T04:38:32.778162+0000 mgr.a (mgr.14388) 16626 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:38:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:34 smithi049 bash[23528]: cluster 2024-09-21T04:38:32.778162+0000 mgr.a (mgr.14388) 16626 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:38:36.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:36.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:36.162 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:36 smithi044 bash[22676]: cluster 2024-09-21T04:38:34.778953+0000 mgr.a (mgr.14388) 16627 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:38:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:36 smithi179 bash[23186]: cluster 2024-09-21T04:38:34.778953+0000 mgr.a (mgr.14388) 16627 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:38:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:36 smithi049 bash[23528]: cluster 2024-09-21T04:38:34.778953+0000 mgr.a (mgr.14388) 16627 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:38:36.953 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:36.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:36.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:36.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:36.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:38.443 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:38 smithi179 bash[23186]: audit 2024-09-21T04:38:36.496849+0000 mgr.a (mgr.14388) 16628 : audit [DBG] from='client.358707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:38.443 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:38 smithi179 bash[23186]: cluster 2024-09-21T04:38:36.780364+0000 mgr.a (mgr.14388) 16629 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:38 smithi044 bash[22676]: audit 2024-09-21T04:38:36.496849+0000 mgr.a (mgr.14388) 16628 : audit [DBG] from='client.358707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:38 smithi044 bash[22676]: cluster 2024-09-21T04:38:36.780364+0000 mgr.a (mgr.14388) 16629 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:38 smithi049 bash[23528]: audit 2024-09-21T04:38:36.496849+0000 mgr.a (mgr.14388) 16628 : audit [DBG] from='client.358707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:38 smithi049 bash[23528]: cluster 2024-09-21T04:38:36.780364+0000 mgr.a (mgr.14388) 16629 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:40 smithi044 bash[22676]: cluster 2024-09-21T04:38:38.781388+0000 mgr.a (mgr.14388) 16630 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:38:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:40 smithi179 bash[23186]: cluster 2024-09-21T04:38:38.781388+0000 mgr.a (mgr.14388) 16630 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:38:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:40 smithi049 bash[23528]: cluster 2024-09-21T04:38:38.781388+0000 mgr.a (mgr.14388) 16630 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:38:41.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:42 smithi044 bash[22676]: cluster 2024-09-21T04:38:40.783782+0000 mgr.a (mgr.14388) 16631 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:42 smithi044 bash[22676]: audit 2024-09-21T04:38:41.340345+0000 mon.a (mon.0) 13264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:42 smithi044 bash[22676]: audit 2024-09-21T04:38:41.349286+0000 mon.a (mon.0) 13265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:42 smithi044 bash[22676]: audit 2024-09-21T04:38:41.359763+0000 mon.a (mon.0) 13266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:42 smithi179 bash[23186]: cluster 2024-09-21T04:38:40.783782+0000 mgr.a (mgr.14388) 16631 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:42.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:42 smithi179 bash[23186]: audit 2024-09-21T04:38:41.340345+0000 mon.a (mon.0) 13264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:42 smithi179 bash[23186]: audit 2024-09-21T04:38:41.349286+0000 mon.a (mon.0) 13265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:42 smithi179 bash[23186]: audit 2024-09-21T04:38:41.359763+0000 mon.a (mon.0) 13266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:42 smithi049 bash[23528]: cluster 2024-09-21T04:38:40.783782+0000 mgr.a (mgr.14388) 16631 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:42 smithi049 bash[23528]: audit 2024-09-21T04:38:41.340345+0000 mon.a (mon.0) 13264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:42 smithi049 bash[23528]: audit 2024-09-21T04:38:41.349286+0000 mon.a (mon.0) 13265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:42 smithi049 bash[23528]: audit 2024-09-21T04:38:41.359763+0000 mon.a (mon.0) 13266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:42.737 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:42.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:42.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:42.738 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:43 smithi044 bash[22676]: audit 2024-09-21T04:38:42.289632+0000 mgr.a (mgr.14388) 16632 : audit [DBG] from='client.358785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:43 smithi179 bash[23186]: audit 2024-09-21T04:38:42.289632+0000 mgr.a (mgr.14388) 16632 : audit [DBG] from='client.358785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:43 smithi049 bash[23528]: audit 2024-09-21T04:38:42.289632+0000 mgr.a (mgr.14388) 16632 : audit [DBG] from='client.358785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:44 smithi044 bash[22676]: cluster 2024-09-21T04:38:42.784541+0000 mgr.a (mgr.14388) 16633 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:44 smithi179 bash[23186]: cluster 2024-09-21T04:38:42.784541+0000 mgr.a (mgr.14388) 16633 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:44 smithi049 bash[23528]: cluster 2024-09-21T04:38:42.784541+0000 mgr.a (mgr.14388) 16633 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:46 smithi044 bash[22676]: cluster 2024-09-21T04:38:44.785467+0000 mgr.a (mgr.14388) 16634 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:46 smithi179 bash[23186]: cluster 2024-09-21T04:38:44.785467+0000 mgr.a (mgr.14388) 16634 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:46 smithi049 bash[23528]: cluster 2024-09-21T04:38:44.785467+0000 mgr.a (mgr.14388) 16634 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:47.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:47.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:47.740 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:48 smithi044 bash[22676]: cluster 2024-09-21T04:38:46.787831+0000 mgr.a (mgr.14388) 16635 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:48 smithi179 bash[23186]: cluster 2024-09-21T04:38:46.787831+0000 mgr.a (mgr.14388) 16635 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:48.517 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:48.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:48.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:48 smithi049 bash[23528]: cluster 2024-09-21T04:38:46.787831+0000 mgr.a (mgr.14388) 16635 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:49.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:49 smithi044 bash[22676]: audit 2024-09-21T04:38:48.069098+0000 mgr.a (mgr.14388) 16636 : audit [DBG] from='client.358863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:49 smithi179 bash[23186]: audit 2024-09-21T04:38:48.069098+0000 mgr.a (mgr.14388) 16636 : audit [DBG] from='client.358863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:49 smithi049 bash[23528]: audit 2024-09-21T04:38:48.069098+0000 mgr.a (mgr.14388) 16636 : audit [DBG] from='client.358863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:50 smithi044 bash[22676]: cluster 2024-09-21T04:38:48.788852+0000 mgr.a (mgr.14388) 16637 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:50.495 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:50 smithi049 bash[23528]: cluster 2024-09-21T04:38:48.788852+0000 mgr.a (mgr.14388) 16637 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:50 smithi179 bash[23186]: cluster 2024-09-21T04:38:48.788852+0000 mgr.a (mgr.14388) 16637 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:52 smithi044 bash[22676]: cluster 2024-09-21T04:38:50.791148+0000 mgr.a (mgr.14388) 16638 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:52 smithi179 bash[23186]: cluster 2024-09-21T04:38:50.791148+0000 mgr.a (mgr.14388) 16638 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:52 smithi049 bash[23528]: cluster 2024-09-21T04:38:50.791148+0000 mgr.a (mgr.14388) 16638 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:53.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:53.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:53.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:38:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:53 smithi044 bash[22676]: audit 2024-09-21T04:38:52.367669+0000 mon.a (mon.0) 13267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:53 smithi044 bash[22676]: audit 2024-09-21T04:38:52.375550+0000 mon.a (mon.0) 13268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:53 smithi044 bash[22676]: audit 2024-09-21T04:38:52.386256+0000 mon.a (mon.0) 13269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:53 smithi044 bash[22676]: audit 2024-09-21T04:38:52.392486+0000 mon.a (mon.0) 13270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:53 smithi044 bash[22676]: audit 2024-09-21T04:38:52.400203+0000 mon.a (mon.0) 13271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:53 smithi044 bash[22676]: audit 2024-09-21T04:38:52.410847+0000 mon.a (mon.0) 13272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:53 smithi044 bash[22676]: cluster 2024-09-21T04:38:52.791947+0000 mgr.a (mgr.14388) 16639 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:53 smithi179 bash[23186]: audit 2024-09-21T04:38:52.367669+0000 mon.a (mon.0) 13267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:53 smithi179 bash[23186]: audit 2024-09-21T04:38:52.375550+0000 mon.a (mon.0) 13268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:53 smithi179 bash[23186]: audit 2024-09-21T04:38:52.386256+0000 mon.a (mon.0) 13269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:53 smithi179 bash[23186]: audit 2024-09-21T04:38:52.392486+0000 mon.a (mon.0) 13270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:53 smithi179 bash[23186]: audit 2024-09-21T04:38:52.400203+0000 mon.a (mon.0) 13271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:53 smithi179 bash[23186]: audit 2024-09-21T04:38:52.410847+0000 mon.a (mon.0) 13272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:53 smithi179 bash[23186]: cluster 2024-09-21T04:38:52.791947+0000 mgr.a (mgr.14388) 16639 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:53 smithi049 bash[23528]: audit 2024-09-21T04:38:52.367669+0000 mon.a (mon.0) 13267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:53 smithi049 bash[23528]: audit 2024-09-21T04:38:52.375550+0000 mon.a (mon.0) 13268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:53 smithi049 bash[23528]: audit 2024-09-21T04:38:52.386256+0000 mon.a (mon.0) 13269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:53 smithi049 bash[23528]: audit 2024-09-21T04:38:52.392486+0000 mon.a (mon.0) 13270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:53 smithi049 bash[23528]: audit 2024-09-21T04:38:52.400203+0000 mon.a (mon.0) 13271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:53 smithi049 bash[23528]: audit 2024-09-21T04:38:52.410847+0000 mon.a (mon.0) 13272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:38:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:53 smithi049 bash[23528]: cluster 2024-09-21T04:38:52.791947+0000 mgr.a (mgr.14388) 16639 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:54.282 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:38:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:38:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:38:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:38:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:38:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:54 smithi044 bash[22676]: audit 2024-09-21T04:38:53.854182+0000 mgr.a (mgr.14388) 16640 : audit [DBG] from='client.358938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:54 smithi179 bash[23186]: audit 2024-09-21T04:38:53.854182+0000 mgr.a (mgr.14388) 16640 : audit [DBG] from='client.358938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:54 smithi049 bash[23528]: audit 2024-09-21T04:38:53.854182+0000 mgr.a (mgr.14388) 16640 : audit [DBG] from='client.358938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:38:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:55 smithi179 bash[23186]: cluster 2024-09-21T04:38:54.792947+0000 mgr.a (mgr.14388) 16641 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:55 smithi044 bash[22676]: cluster 2024-09-21T04:38:54.792947+0000 mgr.a (mgr.14388) 16641 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:55 smithi049 bash[23528]: cluster 2024-09-21T04:38:54.792947+0000 mgr.a (mgr.14388) 16641 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:38:58.166 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:57 smithi179 bash[23186]: cluster 2024-09-21T04:38:56.795250+0000 mgr.a (mgr.14388) 16642 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:57 smithi044 bash[22676]: cluster 2024-09-21T04:38:56.795250+0000 mgr.a (mgr.14388) 16642 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:57 smithi049 bash[23528]: cluster 2024-09-21T04:38:56.795250+0000 mgr.a (mgr.14388) 16642 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:38:59.283 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:38:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:38:59.284 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:00.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:38:59 smithi044 bash[22676]: cluster 2024-09-21T04:38:58.796024+0000 mgr.a (mgr.14388) 16643 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:38:59 smithi179 bash[23186]: cluster 2024-09-21T04:38:58.796024+0000 mgr.a (mgr.14388) 16643 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:38:59 smithi049 bash[23528]: cluster 2024-09-21T04:38:58.796024+0000 mgr.a (mgr.14388) 16643 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:00 smithi044 bash[22676]: audit 2024-09-21T04:38:59.614639+0000 mgr.a (mgr.14388) 16644 : audit [DBG] from='client.359016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:00 smithi179 bash[23186]: audit 2024-09-21T04:38:59.614639+0000 mgr.a (mgr.14388) 16644 : audit [DBG] from='client.359016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:00 smithi049 bash[23528]: audit 2024-09-21T04:38:59.614639+0000 mgr.a (mgr.14388) 16644 : audit [DBG] from='client.359016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:01 smithi044 bash[22676]: cluster 2024-09-21T04:39:00.798375+0000 mgr.a (mgr.14388) 16645 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:39:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:01 smithi044 bash[22676]: audit 2024-09-21T04:39:01.577200+0000 mon.a (mon.0) 13273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:01 smithi044 bash[22676]: audit 2024-09-21T04:39:01.586909+0000 mon.a (mon.0) 13274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:01 smithi044 bash[22676]: audit 2024-09-21T04:39:01.598168+0000 mon.a (mon.0) 13275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:01 smithi179 bash[23186]: cluster 2024-09-21T04:39:00.798375+0000 mgr.a (mgr.14388) 16645 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:39:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:01 smithi179 bash[23186]: audit 2024-09-21T04:39:01.577200+0000 mon.a (mon.0) 13273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:01 smithi179 bash[23186]: audit 2024-09-21T04:39:01.586909+0000 mon.a (mon.0) 13274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:01 smithi179 bash[23186]: audit 2024-09-21T04:39:01.598168+0000 mon.a (mon.0) 13275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:01 smithi049 bash[23528]: cluster 2024-09-21T04:39:00.798375+0000 mgr.a (mgr.14388) 16645 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:39:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:01 smithi049 bash[23528]: audit 2024-09-21T04:39:01.577200+0000 mon.a (mon.0) 13273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:01 smithi049 bash[23528]: audit 2024-09-21T04:39:01.586909+0000 mon.a (mon.0) 13274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:01 smithi049 bash[23528]: audit 2024-09-21T04:39:01.598168+0000 mon.a (mon.0) 13275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:03 smithi044 bash[22676]: cluster 2024-09-21T04:39:02.799121+0000 mgr.a (mgr.14388) 16646 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:39:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:03 smithi179 bash[23186]: cluster 2024-09-21T04:39:02.799121+0000 mgr.a (mgr.14388) 16646 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:39:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:03 smithi049 bash[23528]: cluster 2024-09-21T04:39:02.799121+0000 mgr.a (mgr.14388) 16646 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:39:05.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:05.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:05.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:05.846 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:05.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:05.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:05.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:05.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:06.187 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:05 smithi049 bash[23528]: cluster 2024-09-21T04:39:04.799886+0000 mgr.a (mgr.14388) 16647 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:39:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:05 smithi044 bash[22676]: cluster 2024-09-21T04:39:04.799886+0000 mgr.a (mgr.14388) 16647 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:39:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:05 smithi179 bash[23186]: cluster 2024-09-21T04:39:04.799886+0000 mgr.a (mgr.14388) 16647 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:39:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:06 smithi044 bash[22676]: audit 2024-09-21T04:39:05.412397+0000 mgr.a (mgr.14388) 16648 : audit [DBG] from='client.359091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:06 smithi044 bash[22676]: audit 2024-09-21T04:39:06.738423+0000 mon.a (mon.0) 13276 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:39:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:06 smithi044 bash[22676]: audit 2024-09-21T04:39:06.746279+0000 mon.a (mon.0) 13277 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:39:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:06 smithi044 bash[22676]: audit 2024-09-21T04:39:06.748338+0000 mon.a (mon.0) 13278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:39:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:06 smithi044 bash[22676]: audit 2024-09-21T04:39:06.761206+0000 mon.a (mon.0) 13279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:06 smithi044 bash[22676]: audit 2024-09-21T04:39:06.767549+0000 mon.a (mon.0) 13280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:39:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:06 smithi179 bash[23186]: audit 2024-09-21T04:39:05.412397+0000 mgr.a (mgr.14388) 16648 : audit [DBG] from='client.359091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:06 smithi179 bash[23186]: audit 2024-09-21T04:39:06.738423+0000 mon.a (mon.0) 13276 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:39:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:06 smithi179 bash[23186]: audit 2024-09-21T04:39:06.746279+0000 mon.a (mon.0) 13277 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:39:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:06 smithi179 bash[23186]: audit 2024-09-21T04:39:06.748338+0000 mon.a (mon.0) 13278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:39:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:06 smithi179 bash[23186]: audit 2024-09-21T04:39:06.761206+0000 mon.a (mon.0) 13279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:06 smithi179 bash[23186]: audit 2024-09-21T04:39:06.767549+0000 mon.a (mon.0) 13280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:39:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:06 smithi049 bash[23528]: audit 2024-09-21T04:39:05.412397+0000 mgr.a (mgr.14388) 16648 : audit [DBG] from='client.359091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:06 smithi049 bash[23528]: audit 2024-09-21T04:39:06.738423+0000 mon.a (mon.0) 13276 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:39:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:06 smithi049 bash[23528]: audit 2024-09-21T04:39:06.746279+0000 mon.a (mon.0) 13277 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:39:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:06 smithi049 bash[23528]: audit 2024-09-21T04:39:06.748338+0000 mon.a (mon.0) 13278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:39:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:06 smithi049 bash[23528]: audit 2024-09-21T04:39:06.761206+0000 mon.a (mon.0) 13279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:07.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:06 smithi049 bash[23528]: audit 2024-09-21T04:39:06.767549+0000 mon.a (mon.0) 13280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:39:07.885 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:39:07 smithi044 bash[22930]: debug 2024-09-21T04:39:07.525+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:39:07.886 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:39:07 smithi044 bash[22930]: debug 2024-09-21T04:39:07.525+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:39:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:07 smithi044 bash[22676]: audit 2024-09-21T04:39:06.770137+0000 mgr.a (mgr.14388) 16649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:39:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:07 smithi044 bash[22676]: cluster 2024-09-21T04:39:06.803175+0000 mgr.a (mgr.14388) 16650 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:07 smithi179 bash[23186]: audit 2024-09-21T04:39:06.770137+0000 mgr.a (mgr.14388) 16649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:39:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:07 smithi179 bash[23186]: cluster 2024-09-21T04:39:06.803175+0000 mgr.a (mgr.14388) 16650 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:07 smithi049 bash[23528]: audit 2024-09-21T04:39:06.770137+0000 mgr.a (mgr.14388) 16649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:39:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:07 smithi049 bash[23528]: cluster 2024-09-21T04:39:06.803175+0000 mgr.a (mgr.14388) 16650 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:08 smithi044 bash[22676]: audit 2024-09-21T04:39:07.530083+0000 mgr.a (mgr.14388) 16651 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:39:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:08 smithi044 bash[22676]: cephadm 2024-09-21T04:39:07.531725+0000 mgr.a (mgr.14388) 16652 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:39:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:08 smithi179 bash[23186]: audit 2024-09-21T04:39:07.530083+0000 mgr.a (mgr.14388) 16651 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:39:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:08 smithi179 bash[23186]: cephadm 2024-09-21T04:39:07.531725+0000 mgr.a (mgr.14388) 16652 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:39:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:08 smithi049 bash[23528]: audit 2024-09-21T04:39:07.530083+0000 mgr.a (mgr.14388) 16651 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:39:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:08 smithi049 bash[23528]: cephadm 2024-09-21T04:39:07.531725+0000 mgr.a (mgr.14388) 16652 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:39:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:09 smithi044 bash[22676]: cluster 2024-09-21T04:39:08.804185+0000 mgr.a (mgr.14388) 16653 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:09 smithi179 bash[23186]: cluster 2024-09-21T04:39:08.804185+0000 mgr.a (mgr.14388) 16653 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:09 smithi049 bash[23528]: cluster 2024-09-21T04:39:08.804185+0000 mgr.a (mgr.14388) 16653 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:10.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:11.661 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:11.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:12.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:11 smithi044 bash[22676]: cluster 2024-09-21T04:39:10.806505+0000 mgr.a (mgr.14388) 16654 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:12.151 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:11 smithi044 bash[22676]: audit 2024-09-21T04:39:11.191045+0000 mgr.a (mgr.14388) 16655 : audit [DBG] from='client.359277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:12.193 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:11 smithi049 bash[23528]: cluster 2024-09-21T04:39:10.806505+0000 mgr.a (mgr.14388) 16654 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:12.193 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:11 smithi049 bash[23528]: audit 2024-09-21T04:39:11.191045+0000 mgr.a (mgr.14388) 16655 : audit [DBG] from='client.359277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:11 smithi179 bash[23186]: cluster 2024-09-21T04:39:10.806505+0000 mgr.a (mgr.14388) 16654 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:11 smithi179 bash[23186]: audit 2024-09-21T04:39:11.191045+0000 mgr.a (mgr.14388) 16655 : audit [DBG] from='client.359277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:13 smithi044 bash[22676]: audit 2024-09-21T04:39:12.572800+0000 mon.a (mon.0) 13281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:13 smithi044 bash[22676]: audit 2024-09-21T04:39:12.581236+0000 mon.a (mon.0) 13282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:13 smithi044 bash[22676]: audit 2024-09-21T04:39:12.590832+0000 mon.a (mon.0) 13283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:13 smithi044 bash[22676]: audit 2024-09-21T04:39:12.620109+0000 mon.a (mon.0) 13284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:13 smithi044 bash[22676]: audit 2024-09-21T04:39:12.625645+0000 mon.a (mon.0) 13285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:13 smithi044 bash[22676]: audit 2024-09-21T04:39:12.635099+0000 mon.a (mon.0) 13286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:13 smithi044 bash[22676]: cluster 2024-09-21T04:39:12.807538+0000 mgr.a (mgr.14388) 16656 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:39:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:13 smithi179 bash[23186]: audit 2024-09-21T04:39:12.572800+0000 mon.a (mon.0) 13281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:13 smithi179 bash[23186]: audit 2024-09-21T04:39:12.581236+0000 mon.a (mon.0) 13282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:13 smithi179 bash[23186]: audit 2024-09-21T04:39:12.590832+0000 mon.a (mon.0) 13283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:13 smithi179 bash[23186]: audit 2024-09-21T04:39:12.620109+0000 mon.a (mon.0) 13284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:13 smithi179 bash[23186]: audit 2024-09-21T04:39:12.625645+0000 mon.a (mon.0) 13285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:13 smithi179 bash[23186]: audit 2024-09-21T04:39:12.635099+0000 mon.a (mon.0) 13286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:13 smithi179 bash[23186]: cluster 2024-09-21T04:39:12.807538+0000 mgr.a (mgr.14388) 16656 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:39:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:13 smithi049 bash[23528]: audit 2024-09-21T04:39:12.572800+0000 mon.a (mon.0) 13281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:13 smithi049 bash[23528]: audit 2024-09-21T04:39:12.581236+0000 mon.a (mon.0) 13282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:13 smithi049 bash[23528]: audit 2024-09-21T04:39:12.590832+0000 mon.a (mon.0) 13283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:13 smithi049 bash[23528]: audit 2024-09-21T04:39:12.620109+0000 mon.a (mon.0) 13284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:13 smithi049 bash[23528]: audit 2024-09-21T04:39:12.625645+0000 mon.a (mon.0) 13285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:13 smithi049 bash[23528]: audit 2024-09-21T04:39:12.635099+0000 mon.a (mon.0) 13286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:13 smithi049 bash[23528]: cluster 2024-09-21T04:39:12.807538+0000 mgr.a (mgr.14388) 16656 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:39:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:15 smithi179 bash[23186]: cluster 2024-09-21T04:39:14.808386+0000 mgr.a (mgr.14388) 16657 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:39:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:15 smithi044 bash[22676]: cluster 2024-09-21T04:39:14.808386+0000 mgr.a (mgr.14388) 16657 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:39:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:15 smithi049 bash[23528]: cluster 2024-09-21T04:39:14.808386+0000 mgr.a (mgr.14388) 16657 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:39:16.662 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:16.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:16.663 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:17.429 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:17.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:17 smithi044 bash[22676]: cluster 2024-09-21T04:39:16.809836+0000 mgr.a (mgr.14388) 16658 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:18.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:17 smithi044 bash[22676]: audit 2024-09-21T04:39:16.994495+0000 mgr.a (mgr.14388) 16659 : audit [DBG] from='client.359352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:17 smithi179 bash[23186]: cluster 2024-09-21T04:39:16.809836+0000 mgr.a (mgr.14388) 16658 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:17 smithi179 bash[23186]: audit 2024-09-21T04:39:16.994495+0000 mgr.a (mgr.14388) 16659 : audit [DBG] from='client.359352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:17 smithi049 bash[23528]: cluster 2024-09-21T04:39:16.809836+0000 mgr.a (mgr.14388) 16658 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:17 smithi049 bash[23528]: audit 2024-09-21T04:39:16.994495+0000 mgr.a (mgr.14388) 16659 : audit [DBG] from='client.359352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:19 smithi044 bash[22676]: cluster 2024-09-21T04:39:18.810711+0000 mgr.a (mgr.14388) 16660 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:19 smithi179 bash[23186]: cluster 2024-09-21T04:39:18.810711+0000 mgr.a (mgr.14388) 16660 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:19 smithi049 bash[23528]: cluster 2024-09-21T04:39:18.810711+0000 mgr.a (mgr.14388) 16660 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:21 smithi044 bash[22676]: cluster 2024-09-21T04:39:20.812963+0000 mgr.a (mgr.14388) 16661 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:21 smithi044 bash[22676]: audit 2024-09-21T04:39:21.808485+0000 mon.a (mon.0) 13287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:21 smithi044 bash[22676]: audit 2024-09-21T04:39:21.817723+0000 mon.a (mon.0) 13288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:21 smithi044 bash[22676]: audit 2024-09-21T04:39:21.828777+0000 mon.a (mon.0) 13289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:21 smithi179 bash[23186]: cluster 2024-09-21T04:39:20.812963+0000 mgr.a (mgr.14388) 16661 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:21 smithi179 bash[23186]: audit 2024-09-21T04:39:21.808485+0000 mon.a (mon.0) 13287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:21 smithi179 bash[23186]: audit 2024-09-21T04:39:21.817723+0000 mon.a (mon.0) 13288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:21 smithi179 bash[23186]: audit 2024-09-21T04:39:21.828777+0000 mon.a (mon.0) 13289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:21 smithi049 bash[23528]: cluster 2024-09-21T04:39:20.812963+0000 mgr.a (mgr.14388) 16661 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:39:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:21 smithi049 bash[23528]: audit 2024-09-21T04:39:21.808485+0000 mon.a (mon.0) 13287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:21 smithi049 bash[23528]: audit 2024-09-21T04:39:21.817723+0000 mon.a (mon.0) 13288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:21 smithi049 bash[23528]: audit 2024-09-21T04:39:21.828777+0000 mon.a (mon.0) 13289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:22.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:22.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:22.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:23.218 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:23.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:23 smithi044 bash[22676]: audit 2024-09-21T04:39:22.765468+0000 mgr.a (mgr.14388) 16662 : audit [DBG] from='client.359430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:23 smithi044 bash[22676]: cluster 2024-09-21T04:39:22.814022+0000 mgr.a (mgr.14388) 16663 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:23 smithi179 bash[23186]: audit 2024-09-21T04:39:22.765468+0000 mgr.a (mgr.14388) 16662 : audit [DBG] from='client.359430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:23 smithi179 bash[23186]: cluster 2024-09-21T04:39:22.814022+0000 mgr.a (mgr.14388) 16663 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:23 smithi049 bash[23528]: audit 2024-09-21T04:39:22.765468+0000 mgr.a (mgr.14388) 16662 : audit [DBG] from='client.359430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:23 smithi049 bash[23528]: cluster 2024-09-21T04:39:22.814022+0000 mgr.a (mgr.14388) 16663 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:25 smithi044 bash[22676]: cluster 2024-09-21T04:39:24.814962+0000 mgr.a (mgr.14388) 16664 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:25 smithi179 bash[23186]: cluster 2024-09-21T04:39:24.814962+0000 mgr.a (mgr.14388) 16664 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:25 smithi049 bash[23528]: cluster 2024-09-21T04:39:24.814962+0000 mgr.a (mgr.14388) 16664 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:27 smithi044 bash[22676]: cluster 2024-09-21T04:39:26.817227+0000 mgr.a (mgr.14388) 16665 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:27 smithi179 bash[23186]: cluster 2024-09-21T04:39:26.817227+0000 mgr.a (mgr.14388) 16665 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:27 smithi049 bash[23528]: cluster 2024-09-21T04:39:26.817227+0000 mgr.a (mgr.14388) 16665 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:28.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:28.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:28.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:28.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:28.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:29 smithi044 bash[22676]: audit 2024-09-21T04:39:28.550599+0000 mgr.a (mgr.14388) 16666 : audit [DBG] from='client.359505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:29 smithi044 bash[22676]: cluster 2024-09-21T04:39:28.817730+0000 mgr.a (mgr.14388) 16667 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:29 smithi179 bash[23186]: audit 2024-09-21T04:39:28.550599+0000 mgr.a (mgr.14388) 16666 : audit [DBG] from='client.359505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:29 smithi179 bash[23186]: cluster 2024-09-21T04:39:28.817730+0000 mgr.a (mgr.14388) 16667 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:29 smithi049 bash[23528]: audit 2024-09-21T04:39:28.550599+0000 mgr.a (mgr.14388) 16666 : audit [DBG] from='client.359505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:29 smithi049 bash[23528]: cluster 2024-09-21T04:39:28.817730+0000 mgr.a (mgr.14388) 16667 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:32.196 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:31 smithi044 bash[22676]: cluster 2024-09-21T04:39:30.820089+0000 mgr.a (mgr.14388) 16668 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:31 smithi179 bash[23186]: cluster 2024-09-21T04:39:30.820089+0000 mgr.a (mgr.14388) 16668 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:31 smithi049 bash[23528]: cluster 2024-09-21T04:39:30.820089+0000 mgr.a (mgr.14388) 16668 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:33.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:33.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:33.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:34.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:33 smithi049 bash[23528]: audit 2024-09-21T04:39:32.804816+0000 mon.a (mon.0) 13290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:33 smithi049 bash[23528]: audit 2024-09-21T04:39:32.811464+0000 mon.a (mon.0) 13291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:33 smithi049 bash[23528]: cluster 2024-09-21T04:39:32.820822+0000 mgr.a (mgr.14388) 16669 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:34.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:33 smithi049 bash[23528]: audit 2024-09-21T04:39:32.822029+0000 mon.a (mon.0) 13292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:33 smithi049 bash[23528]: audit 2024-09-21T04:39:32.829752+0000 mon.a (mon.0) 13293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.236 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:33 smithi049 bash[23528]: audit 2024-09-21T04:39:32.836488+0000 mon.a (mon.0) 13294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:33 smithi049 bash[23528]: audit 2024-09-21T04:39:32.845280+0000 mon.a (mon.0) 13295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:33 smithi044 bash[22676]: audit 2024-09-21T04:39:32.804816+0000 mon.a (mon.0) 13290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:33 smithi044 bash[22676]: audit 2024-09-21T04:39:32.811464+0000 mon.a (mon.0) 13291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:33 smithi044 bash[22676]: cluster 2024-09-21T04:39:32.820822+0000 mgr.a (mgr.14388) 16669 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:33 smithi044 bash[22676]: audit 2024-09-21T04:39:32.822029+0000 mon.a (mon.0) 13292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:33 smithi044 bash[22676]: audit 2024-09-21T04:39:32.829752+0000 mon.a (mon.0) 13293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:33 smithi044 bash[22676]: audit 2024-09-21T04:39:32.836488+0000 mon.a (mon.0) 13294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:33 smithi044 bash[22676]: audit 2024-09-21T04:39:32.845280+0000 mon.a (mon.0) 13295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:33 smithi179 bash[23186]: audit 2024-09-21T04:39:32.804816+0000 mon.a (mon.0) 13290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:33 smithi179 bash[23186]: audit 2024-09-21T04:39:32.811464+0000 mon.a (mon.0) 13291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:33 smithi179 bash[23186]: cluster 2024-09-21T04:39:32.820822+0000 mgr.a (mgr.14388) 16669 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:33 smithi179 bash[23186]: audit 2024-09-21T04:39:32.822029+0000 mon.a (mon.0) 13292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:33 smithi179 bash[23186]: audit 2024-09-21T04:39:32.829752+0000 mon.a (mon.0) 13293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:33 smithi179 bash[23186]: audit 2024-09-21T04:39:32.836488+0000 mon.a (mon.0) 13294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:33 smithi179 bash[23186]: audit 2024-09-21T04:39:32.845280+0000 mon.a (mon.0) 13295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:34.742 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:34.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:34.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:34.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:34.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:35.164 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:34 smithi049 bash[23528]: audit 2024-09-21T04:39:34.298727+0000 mgr.a (mgr.14388) 16670 : audit [DBG] from='client.359583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:34 smithi044 bash[22676]: audit 2024-09-21T04:39:34.298727+0000 mgr.a (mgr.14388) 16670 : audit [DBG] from='client.359583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:34 smithi179 bash[23186]: audit 2024-09-21T04:39:34.298727+0000 mgr.a (mgr.14388) 16670 : audit [DBG] from='client.359583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:35 smithi044 bash[22676]: cluster 2024-09-21T04:39:34.821400+0000 mgr.a (mgr.14388) 16671 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:35 smithi179 bash[23186]: cluster 2024-09-21T04:39:34.821400+0000 mgr.a (mgr.14388) 16671 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:35 smithi049 bash[23528]: cluster 2024-09-21T04:39:34.821400+0000 mgr.a (mgr.14388) 16671 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:37 smithi044 bash[22676]: cluster 2024-09-21T04:39:36.823639+0000 mgr.a (mgr.14388) 16672 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:37 smithi179 bash[23186]: cluster 2024-09-21T04:39:36.823639+0000 mgr.a (mgr.14388) 16672 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:37 smithi049 bash[23528]: cluster 2024-09-21T04:39:36.823639+0000 mgr.a (mgr.14388) 16672 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:39.744 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:39.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:39.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:39 smithi179 bash[23186]: cluster 2024-09-21T04:39:38.824439+0000 mgr.a (mgr.14388) 16673 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:39 smithi044 bash[22676]: cluster 2024-09-21T04:39:38.824439+0000 mgr.a (mgr.14388) 16673 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:39 smithi049 bash[23528]: cluster 2024-09-21T04:39:38.824439+0000 mgr.a (mgr.14388) 16673 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:40.539 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:40 smithi044 bash[22676]: audit 2024-09-21T04:39:40.078036+0000 mgr.a (mgr.14388) 16674 : audit [DBG] from='client.359661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:40 smithi179 bash[23186]: audit 2024-09-21T04:39:40.078036+0000 mgr.a (mgr.14388) 16674 : audit [DBG] from='client.359661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:40 smithi049 bash[23528]: audit 2024-09-21T04:39:40.078036+0000 mgr.a (mgr.14388) 16674 : audit [DBG] from='client.359661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:41 smithi044 bash[22676]: cluster 2024-09-21T04:39:40.827418+0000 mgr.a (mgr.14388) 16675 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:41 smithi179 bash[23186]: cluster 2024-09-21T04:39:40.827418+0000 mgr.a (mgr.14388) 16675 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:41 smithi049 bash[23528]: cluster 2024-09-21T04:39:40.827418+0000 mgr.a (mgr.14388) 16675 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:43 smithi049 bash[23528]: audit 2024-09-21T04:39:42.043182+0000 mon.a (mon.0) 13296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:43 smithi049 bash[23528]: audit 2024-09-21T04:39:42.052233+0000 mon.a (mon.0) 13297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:43 smithi049 bash[23528]: audit 2024-09-21T04:39:42.063664+0000 mon.a (mon.0) 13298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:43 smithi044 bash[22676]: audit 2024-09-21T04:39:42.043182+0000 mon.a (mon.0) 13296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:43 smithi044 bash[22676]: audit 2024-09-21T04:39:42.052233+0000 mon.a (mon.0) 13297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:43 smithi044 bash[22676]: audit 2024-09-21T04:39:42.063664+0000 mon.a (mon.0) 13298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:43 smithi179 bash[23186]: audit 2024-09-21T04:39:42.043182+0000 mon.a (mon.0) 13296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:43 smithi179 bash[23186]: audit 2024-09-21T04:39:42.052233+0000 mon.a (mon.0) 13297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:43 smithi179 bash[23186]: audit 2024-09-21T04:39:42.063664+0000 mon.a (mon.0) 13298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:44 smithi044 bash[22676]: cluster 2024-09-21T04:39:42.828212+0000 mgr.a (mgr.14388) 16676 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:44 smithi179 bash[23186]: cluster 2024-09-21T04:39:42.828212+0000 mgr.a (mgr.14388) 16676 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:44 smithi049 bash[23528]: cluster 2024-09-21T04:39:42.828212+0000 mgr.a (mgr.14388) 16676 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:45.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:45.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:45.541 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:46.300 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:46.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:46.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:46.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:46.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:46 smithi044 bash[22676]: cluster 2024-09-21T04:39:44.828976+0000 mgr.a (mgr.14388) 16677 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:39:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:46 smithi179 bash[23186]: cluster 2024-09-21T04:39:44.828976+0000 mgr.a (mgr.14388) 16677 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:39:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:46 smithi049 bash[23528]: cluster 2024-09-21T04:39:44.828976+0000 mgr.a (mgr.14388) 16677 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:39:47.417 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:47 smithi049 bash[23528]: audit 2024-09-21T04:39:45.872719+0000 mgr.a (mgr.14388) 16678 : audit [DBG] from='client.359739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:47 smithi044 bash[22676]: audit 2024-09-21T04:39:45.872719+0000 mgr.a (mgr.14388) 16678 : audit [DBG] from='client.359739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:47 smithi179 bash[23186]: audit 2024-09-21T04:39:45.872719+0000 mgr.a (mgr.14388) 16678 : audit [DBG] from='client.359739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:48 smithi044 bash[22676]: cluster 2024-09-21T04:39:46.831888+0000 mgr.a (mgr.14388) 16679 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:48 smithi179 bash[23186]: cluster 2024-09-21T04:39:46.831888+0000 mgr.a (mgr.14388) 16679 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:48 smithi049 bash[23528]: cluster 2024-09-21T04:39:46.831888+0000 mgr.a (mgr.14388) 16679 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:50 smithi044 bash[22676]: cluster 2024-09-21T04:39:48.832661+0000 mgr.a (mgr.14388) 16680 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:50 smithi179 bash[23186]: cluster 2024-09-21T04:39:48.832661+0000 mgr.a (mgr.14388) 16680 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:50 smithi049 bash[23528]: cluster 2024-09-21T04:39:48.832661+0000 mgr.a (mgr.14388) 16680 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:39:51.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:52.096 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:52.096 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:52.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:52.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:52.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:52.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:52 smithi044 bash[22676]: cluster 2024-09-21T04:39:50.834784+0000 mgr.a (mgr.14388) 16681 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:52 smithi179 bash[23186]: cluster 2024-09-21T04:39:50.834784+0000 mgr.a (mgr.14388) 16681 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:52 smithi049 bash[23528]: cluster 2024-09-21T04:39:50.834784+0000 mgr.a (mgr.14388) 16681 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:53.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:53 smithi049 bash[23528]: audit 2024-09-21T04:39:51.638359+0000 mgr.a (mgr.14388) 16682 : audit [DBG] from='client.359817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:53.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:53 smithi049 bash[23528]: audit 2024-09-21T04:39:53.021016+0000 mon.a (mon.0) 13299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:53 smithi049 bash[23528]: audit 2024-09-21T04:39:53.028098+0000 mon.a (mon.0) 13300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:53 smithi049 bash[23528]: audit 2024-09-21T04:39:53.035882+0000 mon.a (mon.0) 13301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:53 smithi049 bash[23528]: audit 2024-09-21T04:39:53.047706+0000 mon.a (mon.0) 13302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:53 smithi049 bash[23528]: audit 2024-09-21T04:39:53.052736+0000 mon.a (mon.0) 13303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.237 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:53 smithi049 bash[23528]: audit 2024-09-21T04:39:53.058792+0000 mon.a (mon.0) 13304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:53 smithi044 bash[22676]: audit 2024-09-21T04:39:51.638359+0000 mgr.a (mgr.14388) 16682 : audit [DBG] from='client.359817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:53 smithi044 bash[22676]: audit 2024-09-21T04:39:53.021016+0000 mon.a (mon.0) 13299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:53 smithi044 bash[22676]: audit 2024-09-21T04:39:53.028098+0000 mon.a (mon.0) 13300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:53 smithi044 bash[22676]: audit 2024-09-21T04:39:53.035882+0000 mon.a (mon.0) 13301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:53 smithi044 bash[22676]: audit 2024-09-21T04:39:53.047706+0000 mon.a (mon.0) 13302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:53 smithi044 bash[22676]: audit 2024-09-21T04:39:53.052736+0000 mon.a (mon.0) 13303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:53 smithi044 bash[22676]: audit 2024-09-21T04:39:53.058792+0000 mon.a (mon.0) 13304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:53 smithi179 bash[23186]: audit 2024-09-21T04:39:51.638359+0000 mgr.a (mgr.14388) 16682 : audit [DBG] from='client.359817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:53 smithi179 bash[23186]: audit 2024-09-21T04:39:53.021016+0000 mon.a (mon.0) 13299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:53 smithi179 bash[23186]: audit 2024-09-21T04:39:53.028098+0000 mon.a (mon.0) 13300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:53 smithi179 bash[23186]: audit 2024-09-21T04:39:53.035882+0000 mon.a (mon.0) 13301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:53 smithi179 bash[23186]: audit 2024-09-21T04:39:53.047706+0000 mon.a (mon.0) 13302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:53 smithi179 bash[23186]: audit 2024-09-21T04:39:53.052736+0000 mon.a (mon.0) 13303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:53 smithi179 bash[23186]: audit 2024-09-21T04:39:53.058792+0000 mon.a (mon.0) 13304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:39:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:54 smithi049 bash[23528]: cluster 2024-09-21T04:39:52.835691+0000 mgr.a (mgr.14388) 16683 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:54 smithi044 bash[22676]: cluster 2024-09-21T04:39:52.835691+0000 mgr.a (mgr.14388) 16683 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:54 smithi179 bash[23186]: cluster 2024-09-21T04:39:52.835691+0000 mgr.a (mgr.14388) 16683 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:56 smithi044 bash[22676]: cluster 2024-09-21T04:39:54.836509+0000 mgr.a (mgr.14388) 16684 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:56 smithi179 bash[23186]: cluster 2024-09-21T04:39:54.836509+0000 mgr.a (mgr.14388) 16684 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:56 smithi049 bash[23528]: cluster 2024-09-21T04:39:54.836509+0000 mgr.a (mgr.14388) 16684 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:39:57.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:39:57.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:39:57.098 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:39:57.833 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:39:57.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:39:57.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:39:57.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:39:57.834 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:39:58.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:58 smithi179 bash[23186]: cluster 2024-09-21T04:39:56.838792+0000 mgr.a (mgr.14388) 16685 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:58 smithi044 bash[22676]: cluster 2024-09-21T04:39:56.838792+0000 mgr.a (mgr.14388) 16685 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:58 smithi049 bash[23528]: cluster 2024-09-21T04:39:56.838792+0000 mgr.a (mgr.14388) 16685 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:39:59.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:39:59 smithi179 bash[23186]: audit 2024-09-21T04:39:57.424476+0000 mgr.a (mgr.14388) 16686 : audit [DBG] from='client.359895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:39:59 smithi044 bash[22676]: audit 2024-09-21T04:39:57.424476+0000 mgr.a (mgr.14388) 16686 : audit [DBG] from='client.359895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:39:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:39:59 smithi049 bash[23528]: audit 2024-09-21T04:39:57.424476+0000 mgr.a (mgr.14388) 16686 : audit [DBG] from='client.359895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:00 smithi044 bash[22676]: cluster 2024-09-21T04:39:58.839716+0000 mgr.a (mgr.14388) 16687 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:00 smithi044 bash[22676]: cluster 2024-09-21T04:40:00.000146+0000 mon.a (mon.0) 13305 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:40:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:00 smithi179 bash[23186]: cluster 2024-09-21T04:39:58.839716+0000 mgr.a (mgr.14388) 16687 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:00 smithi179 bash[23186]: cluster 2024-09-21T04:40:00.000146+0000 mon.a (mon.0) 13305 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:40:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:00 smithi049 bash[23528]: cluster 2024-09-21T04:39:58.839716+0000 mgr.a (mgr.14388) 16687 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:00 smithi049 bash[23528]: cluster 2024-09-21T04:40:00.000146+0000 mon.a (mon.0) 13305 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:40:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:01 smithi044 bash[22676]: cluster 2024-09-21T04:40:00.842135+0000 mgr.a (mgr.14388) 16688 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:01 smithi179 bash[23186]: cluster 2024-09-21T04:40:00.842135+0000 mgr.a (mgr.14388) 16688 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:01 smithi049 bash[23528]: cluster 2024-09-21T04:40:00.842135+0000 mgr.a (mgr.14388) 16688 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:02.835 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:02.835 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:02.836 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:03 smithi049 bash[23528]: audit 2024-09-21T04:40:02.277452+0000 mon.a (mon.0) 13306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:03 smithi049 bash[23528]: audit 2024-09-21T04:40:02.286489+0000 mon.a (mon.0) 13307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:03 smithi049 bash[23528]: audit 2024-09-21T04:40:02.296989+0000 mon.a (mon.0) 13308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.630 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:03 smithi044 bash[22676]: audit 2024-09-21T04:40:02.277452+0000 mon.a (mon.0) 13306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:03 smithi044 bash[22676]: audit 2024-09-21T04:40:02.286489+0000 mon.a (mon.0) 13307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:03 smithi044 bash[22676]: audit 2024-09-21T04:40:02.296989+0000 mon.a (mon.0) 13308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:03 smithi179 bash[23186]: audit 2024-09-21T04:40:02.277452+0000 mon.a (mon.0) 13306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:03 smithi179 bash[23186]: audit 2024-09-21T04:40:02.286489+0000 mon.a (mon.0) 13307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:03 smithi179 bash[23186]: audit 2024-09-21T04:40:02.296989+0000 mon.a (mon.0) 13308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:04 smithi049 bash[23528]: cluster 2024-09-21T04:40:02.842862+0000 mgr.a (mgr.14388) 16689 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:04 smithi049 bash[23528]: audit 2024-09-21T04:40:03.167242+0000 mgr.a (mgr.14388) 16690 : audit [DBG] from='client.359973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:04 smithi044 bash[22676]: cluster 2024-09-21T04:40:02.842862+0000 mgr.a (mgr.14388) 16689 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:04.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:04 smithi044 bash[22676]: audit 2024-09-21T04:40:03.167242+0000 mgr.a (mgr.14388) 16690 : audit [DBG] from='client.359973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:04 smithi179 bash[23186]: cluster 2024-09-21T04:40:02.842862+0000 mgr.a (mgr.14388) 16689 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:04 smithi179 bash[23186]: audit 2024-09-21T04:40:03.167242+0000 mgr.a (mgr.14388) 16690 : audit [DBG] from='client.359973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:06 smithi044 bash[22676]: cluster 2024-09-21T04:40:04.843750+0000 mgr.a (mgr.14388) 16691 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:06 smithi179 bash[23186]: cluster 2024-09-21T04:40:04.843750+0000 mgr.a (mgr.14388) 16691 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:06 smithi049 bash[23528]: cluster 2024-09-21T04:40:04.843750+0000 mgr.a (mgr.14388) 16691 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:08.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:08.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:08.633 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:08.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22930]: debug 2024-09-21T04:40:08.428+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:40:08.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22930]: debug 2024-09-21T04:40:08.428+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:40:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22676]: cluster 2024-09-21T04:40:06.846039+0000 mgr.a (mgr.14388) 16692 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22676]: audit 2024-09-21T04:40:07.611134+0000 mon.a (mon.0) 13309 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:40:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22676]: audit 2024-09-21T04:40:07.618571+0000 mon.a (mon.0) 13310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:40:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22676]: audit 2024-09-21T04:40:07.620326+0000 mon.a (mon.0) 13311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:40:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22676]: audit 2024-09-21T04:40:07.631892+0000 mon.a (mon.0) 13312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:08 smithi044 bash[22676]: audit 2024-09-21T04:40:07.638297+0000 mon.a (mon.0) 13313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:40:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:08 smithi179 bash[23186]: cluster 2024-09-21T04:40:06.846039+0000 mgr.a (mgr.14388) 16692 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:08 smithi179 bash[23186]: audit 2024-09-21T04:40:07.611134+0000 mon.a (mon.0) 13309 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:40:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:08 smithi179 bash[23186]: audit 2024-09-21T04:40:07.618571+0000 mon.a (mon.0) 13310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:40:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:08 smithi179 bash[23186]: audit 2024-09-21T04:40:07.620326+0000 mon.a (mon.0) 13311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:40:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:08 smithi179 bash[23186]: audit 2024-09-21T04:40:07.631892+0000 mon.a (mon.0) 13312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:08 smithi179 bash[23186]: audit 2024-09-21T04:40:07.638297+0000 mon.a (mon.0) 13313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:40:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:08 smithi049 bash[23528]: cluster 2024-09-21T04:40:06.846039+0000 mgr.a (mgr.14388) 16692 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:08 smithi049 bash[23528]: audit 2024-09-21T04:40:07.611134+0000 mon.a (mon.0) 13309 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:40:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:08 smithi049 bash[23528]: audit 2024-09-21T04:40:07.618571+0000 mon.a (mon.0) 13310 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:40:08.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:08 smithi049 bash[23528]: audit 2024-09-21T04:40:07.620326+0000 mon.a (mon.0) 13311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:40:08.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:08 smithi049 bash[23528]: audit 2024-09-21T04:40:07.631892+0000 mon.a (mon.0) 13312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:08.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:08 smithi049 bash[23528]: audit 2024-09-21T04:40:07.638297+0000 mon.a (mon.0) 13313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:40:09.406 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:09.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:09.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:09.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:09.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:09 smithi044 bash[22676]: audit 2024-09-21T04:40:07.640736+0000 mgr.a (mgr.14388) 16693 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:40:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:09 smithi179 bash[23186]: audit 2024-09-21T04:40:07.640736+0000 mgr.a (mgr.14388) 16693 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:40:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:09 smithi049 bash[23528]: audit 2024-09-21T04:40:07.640736+0000 mgr.a (mgr.14388) 16693 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:40:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:10 smithi044 bash[22676]: audit 2024-09-21T04:40:08.431138+0000 mgr.a (mgr.14388) 16694 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:40:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:10 smithi044 bash[22676]: cephadm 2024-09-21T04:40:08.432463+0000 mgr.a (mgr.14388) 16695 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:40:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:10 smithi044 bash[22676]: cluster 2024-09-21T04:40:08.847070+0000 mgr.a (mgr.14388) 16696 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:10 smithi044 bash[22676]: audit 2024-09-21T04:40:08.962580+0000 mgr.a (mgr.14388) 16697 : audit [DBG] from='client.360153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:10 smithi179 bash[23186]: audit 2024-09-21T04:40:08.431138+0000 mgr.a (mgr.14388) 16694 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:40:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:10 smithi179 bash[23186]: cephadm 2024-09-21T04:40:08.432463+0000 mgr.a (mgr.14388) 16695 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:40:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:10 smithi179 bash[23186]: cluster 2024-09-21T04:40:08.847070+0000 mgr.a (mgr.14388) 16696 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:10 smithi179 bash[23186]: audit 2024-09-21T04:40:08.962580+0000 mgr.a (mgr.14388) 16697 : audit [DBG] from='client.360153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:10 smithi049 bash[23528]: audit 2024-09-21T04:40:08.431138+0000 mgr.a (mgr.14388) 16694 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:40:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:10 smithi049 bash[23528]: cephadm 2024-09-21T04:40:08.432463+0000 mgr.a (mgr.14388) 16695 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:40:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:10 smithi049 bash[23528]: cluster 2024-09-21T04:40:08.847070+0000 mgr.a (mgr.14388) 16696 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:10 smithi049 bash[23528]: audit 2024-09-21T04:40:08.962580+0000 mgr.a (mgr.14388) 16697 : audit [DBG] from='client.360153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:12 smithi049 bash[23528]: cluster 2024-09-21T04:40:10.849518+0000 mgr.a (mgr.14388) 16698 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:12.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:12 smithi044 bash[22676]: cluster 2024-09-21T04:40:10.849518+0000 mgr.a (mgr.14388) 16698 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:12 smithi179 bash[23186]: cluster 2024-09-21T04:40:10.849518+0000 mgr.a (mgr.14388) 16698 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:14.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:14.408 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:14 smithi044 bash[22676]: cluster 2024-09-21T04:40:12.850289+0000 mgr.a (mgr.14388) 16699 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:14 smithi044 bash[22676]: audit 2024-09-21T04:40:13.230876+0000 mon.a (mon.0) 13314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:14 smithi044 bash[22676]: audit 2024-09-21T04:40:13.239276+0000 mon.a (mon.0) 13315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:14 smithi044 bash[22676]: audit 2024-09-21T04:40:13.252539+0000 mon.a (mon.0) 13316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:14 smithi044 bash[22676]: audit 2024-09-21T04:40:13.258887+0000 mon.a (mon.0) 13317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:14 smithi044 bash[22676]: audit 2024-09-21T04:40:13.267055+0000 mon.a (mon.0) 13318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:14 smithi044 bash[22676]: audit 2024-09-21T04:40:13.276858+0000 mon.a (mon.0) 13319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:14 smithi179 bash[23186]: cluster 2024-09-21T04:40:12.850289+0000 mgr.a (mgr.14388) 16699 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:14 smithi179 bash[23186]: audit 2024-09-21T04:40:13.230876+0000 mon.a (mon.0) 13314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:14 smithi179 bash[23186]: audit 2024-09-21T04:40:13.239276+0000 mon.a (mon.0) 13315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:14 smithi179 bash[23186]: audit 2024-09-21T04:40:13.252539+0000 mon.a (mon.0) 13316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:14 smithi179 bash[23186]: audit 2024-09-21T04:40:13.258887+0000 mon.a (mon.0) 13317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:14 smithi179 bash[23186]: audit 2024-09-21T04:40:13.267055+0000 mon.a (mon.0) 13318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:14 smithi179 bash[23186]: audit 2024-09-21T04:40:13.276858+0000 mon.a (mon.0) 13319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:14 smithi049 bash[23528]: cluster 2024-09-21T04:40:12.850289+0000 mgr.a (mgr.14388) 16699 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:14 smithi049 bash[23528]: audit 2024-09-21T04:40:13.230876+0000 mon.a (mon.0) 13314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:14 smithi049 bash[23528]: audit 2024-09-21T04:40:13.239276+0000 mon.a (mon.0) 13315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:14 smithi049 bash[23528]: audit 2024-09-21T04:40:13.252539+0000 mon.a (mon.0) 13316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:14 smithi049 bash[23528]: audit 2024-09-21T04:40:13.258887+0000 mon.a (mon.0) 13317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:14 smithi049 bash[23528]: audit 2024-09-21T04:40:13.267055+0000 mon.a (mon.0) 13318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:14 smithi049 bash[23528]: audit 2024-09-21T04:40:13.276858+0000 mon.a (mon.0) 13319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:15.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:15.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:15.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:15.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:15.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:16 smithi044 bash[22676]: audit 2024-09-21T04:40:14.747683+0000 mgr.a (mgr.14388) 16700 : audit [DBG] from='client.360231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:16 smithi044 bash[22676]: cluster 2024-09-21T04:40:14.850805+0000 mgr.a (mgr.14388) 16701 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:16 smithi179 bash[23186]: audit 2024-09-21T04:40:14.747683+0000 mgr.a (mgr.14388) 16700 : audit [DBG] from='client.360231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:16 smithi179 bash[23186]: cluster 2024-09-21T04:40:14.850805+0000 mgr.a (mgr.14388) 16701 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:16 smithi049 bash[23528]: audit 2024-09-21T04:40:14.747683+0000 mgr.a (mgr.14388) 16700 : audit [DBG] from='client.360231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:16 smithi049 bash[23528]: cluster 2024-09-21T04:40:14.850805+0000 mgr.a (mgr.14388) 16701 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:18 smithi179 bash[23186]: cluster 2024-09-21T04:40:16.853403+0000 mgr.a (mgr.14388) 16702 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:18 smithi049 bash[23528]: cluster 2024-09-21T04:40:16.853403+0000 mgr.a (mgr.14388) 16702 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:18 smithi044 bash[22676]: cluster 2024-09-21T04:40:16.853403+0000 mgr.a (mgr.14388) 16702 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:20.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:20.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:20.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:20 smithi179 bash[23186]: cluster 2024-09-21T04:40:18.854381+0000 mgr.a (mgr.14388) 16703 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:40:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:20 smithi049 bash[23528]: cluster 2024-09-21T04:40:18.854381+0000 mgr.a (mgr.14388) 16703 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:40:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:20 smithi044 bash[22676]: cluster 2024-09-21T04:40:18.854381+0000 mgr.a (mgr.14388) 16703 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:40:21.014 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:21.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:22 smithi179 bash[23186]: audit 2024-09-21T04:40:20.550974+0000 mgr.a (mgr.14388) 16704 : audit [DBG] from='client.360309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:22 smithi179 bash[23186]: cluster 2024-09-21T04:40:20.855867+0000 mgr.a (mgr.14388) 16705 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:22.540 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:22 smithi049 bash[23528]: audit 2024-09-21T04:40:20.550974+0000 mgr.a (mgr.14388) 16704 : audit [DBG] from='client.360309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:22.540 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:22 smithi049 bash[23528]: cluster 2024-09-21T04:40:20.855867+0000 mgr.a (mgr.14388) 16705 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:22 smithi044 bash[22676]: audit 2024-09-21T04:40:20.550974+0000 mgr.a (mgr.14388) 16704 : audit [DBG] from='client.360309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:22 smithi044 bash[22676]: cluster 2024-09-21T04:40:20.855867+0000 mgr.a (mgr.14388) 16705 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:40:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:23 smithi049 bash[23528]: audit 2024-09-21T04:40:22.516660+0000 mon.a (mon.0) 13320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:23 smithi049 bash[23528]: audit 2024-09-21T04:40:22.525617+0000 mon.a (mon.0) 13321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:23 smithi049 bash[23528]: audit 2024-09-21T04:40:22.536118+0000 mon.a (mon.0) 13322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:23 smithi049 bash[23528]: cluster 2024-09-21T04:40:22.856754+0000 mgr.a (mgr.14388) 16706 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:40:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:23 smithi044 bash[22676]: audit 2024-09-21T04:40:22.516660+0000 mon.a (mon.0) 13320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:23 smithi044 bash[22676]: audit 2024-09-21T04:40:22.525617+0000 mon.a (mon.0) 13321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:23 smithi044 bash[22676]: audit 2024-09-21T04:40:22.536118+0000 mon.a (mon.0) 13322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:23 smithi044 bash[22676]: cluster 2024-09-21T04:40:22.856754+0000 mgr.a (mgr.14388) 16706 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:40:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:23 smithi179 bash[23186]: audit 2024-09-21T04:40:22.516660+0000 mon.a (mon.0) 13320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:23 smithi179 bash[23186]: audit 2024-09-21T04:40:22.525617+0000 mon.a (mon.0) 13321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:23 smithi179 bash[23186]: audit 2024-09-21T04:40:22.536118+0000 mon.a (mon.0) 13322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:23 smithi179 bash[23186]: cluster 2024-09-21T04:40:22.856754+0000 mgr.a (mgr.14388) 16706 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:40:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:26.017 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:26.017 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:25 smithi044 bash[22676]: cluster 2024-09-21T04:40:24.857596+0000 mgr.a (mgr.14388) 16707 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:40:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:25 smithi179 bash[23186]: cluster 2024-09-21T04:40:24.857596+0000 mgr.a (mgr.14388) 16707 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:40:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:25 smithi049 bash[23528]: cluster 2024-09-21T04:40:24.857596+0000 mgr.a (mgr.14388) 16707 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:40:26.770 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:26.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:26 smithi044 bash[22676]: audit 2024-09-21T04:40:26.345953+0000 mgr.a (mgr.14388) 16708 : audit [DBG] from='client.360381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:26 smithi179 bash[23186]: audit 2024-09-21T04:40:26.345953+0000 mgr.a (mgr.14388) 16708 : audit [DBG] from='client.360381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:26 smithi049 bash[23528]: audit 2024-09-21T04:40:26.345953+0000 mgr.a (mgr.14388) 16708 : audit [DBG] from='client.360381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:27 smithi044 bash[22676]: cluster 2024-09-21T04:40:26.860474+0000 mgr.a (mgr.14388) 16709 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:27 smithi179 bash[23186]: cluster 2024-09-21T04:40:26.860474+0000 mgr.a (mgr.14388) 16709 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:27 smithi049 bash[23528]: cluster 2024-09-21T04:40:26.860474+0000 mgr.a (mgr.14388) 16709 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:29 smithi044 bash[22676]: cluster 2024-09-21T04:40:28.861283+0000 mgr.a (mgr.14388) 16710 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:40:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:29 smithi179 bash[23186]: cluster 2024-09-21T04:40:28.861283+0000 mgr.a (mgr.14388) 16710 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:40:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:29 smithi049 bash[23528]: cluster 2024-09-21T04:40:28.861283+0000 mgr.a (mgr.14388) 16710 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:40:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:31 smithi044 bash[22676]: cluster 2024-09-21T04:40:30.863346+0000 mgr.a (mgr.14388) 16711 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:40:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:31 smithi179 bash[23186]: cluster 2024-09-21T04:40:30.863346+0000 mgr.a (mgr.14388) 16711 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:40:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:31 smithi049 bash[23528]: cluster 2024-09-21T04:40:30.863346+0000 mgr.a (mgr.14388) 16711 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:40:32.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:32.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:32.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:32.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:32 smithi044 bash[22676]: audit 2024-09-21T04:40:32.110539+0000 mgr.a (mgr.14388) 16712 : audit [DBG] from='client.360459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:32 smithi179 bash[23186]: audit 2024-09-21T04:40:32.110539+0000 mgr.a (mgr.14388) 16712 : audit [DBG] from='client.360459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:33.018 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:32 smithi049 bash[23528]: audit 2024-09-21T04:40:32.110539+0000 mgr.a (mgr.14388) 16712 : audit [DBG] from='client.360459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:33 smithi179 bash[23186]: cluster 2024-09-21T04:40:32.864100+0000 mgr.a (mgr.14388) 16713 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:33 smithi179 bash[23186]: audit 2024-09-21T04:40:33.417630+0000 mon.a (mon.0) 13323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:33 smithi179 bash[23186]: audit 2024-09-21T04:40:33.422970+0000 mon.a (mon.0) 13324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:33 smithi179 bash[23186]: audit 2024-09-21T04:40:33.428086+0000 mon.a (mon.0) 13325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:33 smithi179 bash[23186]: audit 2024-09-21T04:40:33.443400+0000 mon.a (mon.0) 13326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:33 smithi179 bash[23186]: audit 2024-09-21T04:40:33.449949+0000 mon.a (mon.0) 13327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:33 smithi179 bash[23186]: audit 2024-09-21T04:40:33.456298+0000 mon.a (mon.0) 13328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:33 smithi044 bash[22676]: cluster 2024-09-21T04:40:32.864100+0000 mgr.a (mgr.14388) 16713 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:33 smithi044 bash[22676]: audit 2024-09-21T04:40:33.417630+0000 mon.a (mon.0) 13323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:33 smithi044 bash[22676]: audit 2024-09-21T04:40:33.422970+0000 mon.a (mon.0) 13324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:33 smithi044 bash[22676]: audit 2024-09-21T04:40:33.428086+0000 mon.a (mon.0) 13325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:33 smithi044 bash[22676]: audit 2024-09-21T04:40:33.443400+0000 mon.a (mon.0) 13326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:33 smithi044 bash[22676]: audit 2024-09-21T04:40:33.449949+0000 mon.a (mon.0) 13327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:33 smithi044 bash[22676]: audit 2024-09-21T04:40:33.456298+0000 mon.a (mon.0) 13328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:34.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:33 smithi049 bash[23528]: cluster 2024-09-21T04:40:32.864100+0000 mgr.a (mgr.14388) 16713 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:34.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:33 smithi049 bash[23528]: audit 2024-09-21T04:40:33.417630+0000 mon.a (mon.0) 13323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:34.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:33 smithi049 bash[23528]: audit 2024-09-21T04:40:33.422970+0000 mon.a (mon.0) 13324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:34.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:33 smithi049 bash[23528]: audit 2024-09-21T04:40:33.428086+0000 mon.a (mon.0) 13325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:34.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:33 smithi049 bash[23528]: audit 2024-09-21T04:40:33.443400+0000 mon.a (mon.0) 13326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:34.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:33 smithi049 bash[23528]: audit 2024-09-21T04:40:33.449949+0000 mon.a (mon.0) 13327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:34.033 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:33 smithi049 bash[23528]: audit 2024-09-21T04:40:33.456298+0000 mon.a (mon.0) 13328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:35 smithi044 bash[22676]: cluster 2024-09-21T04:40:34.864895+0000 mgr.a (mgr.14388) 16714 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:35 smithi179 bash[23186]: cluster 2024-09-21T04:40:34.864895+0000 mgr.a (mgr.14388) 16714 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:36.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:35 smithi049 bash[23528]: cluster 2024-09-21T04:40:34.864895+0000 mgr.a (mgr.14388) 16714 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:37.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:37.561 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:37.562 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:37 smithi044 bash[22676]: cluster 2024-09-21T04:40:36.867194+0000 mgr.a (mgr.14388) 16715 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:37 smithi179 bash[23186]: cluster 2024-09-21T04:40:36.867194+0000 mgr.a (mgr.14388) 16715 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:37 smithi049 bash[23528]: cluster 2024-09-21T04:40:36.867194+0000 mgr.a (mgr.14388) 16715 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:38.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:38.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:38.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:38.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:38.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:38 smithi044 bash[22676]: audit 2024-09-21T04:40:37.896926+0000 mgr.a (mgr.14388) 16716 : audit [DBG] from='client.360537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:38 smithi179 bash[23186]: audit 2024-09-21T04:40:37.896926+0000 mgr.a (mgr.14388) 16716 : audit [DBG] from='client.360537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:38 smithi049 bash[23528]: audit 2024-09-21T04:40:37.896926+0000 mgr.a (mgr.14388) 16716 : audit [DBG] from='client.360537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:39 smithi044 bash[22676]: cluster 2024-09-21T04:40:38.868264+0000 mgr.a (mgr.14388) 16717 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:39 smithi179 bash[23186]: cluster 2024-09-21T04:40:38.868264+0000 mgr.a (mgr.14388) 16717 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:39 smithi049 bash[23528]: cluster 2024-09-21T04:40:38.868264+0000 mgr.a (mgr.14388) 16717 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:41 smithi044 bash[22676]: cluster 2024-09-21T04:40:40.870613+0000 mgr.a (mgr.14388) 16718 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:41 smithi179 bash[23186]: cluster 2024-09-21T04:40:40.870613+0000 mgr.a (mgr.14388) 16718 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:41 smithi049 bash[23528]: cluster 2024-09-21T04:40:40.870613+0000 mgr.a (mgr.14388) 16718 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:43.336 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:43.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:43.337 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:43 smithi179 bash[23186]: audit 2024-09-21T04:40:42.748970+0000 mon.a (mon.0) 13329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:43 smithi179 bash[23186]: audit 2024-09-21T04:40:42.758861+0000 mon.a (mon.0) 13330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:43 smithi179 bash[23186]: audit 2024-09-21T04:40:42.769778+0000 mon.a (mon.0) 13331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:43 smithi179 bash[23186]: cluster 2024-09-21T04:40:42.871561+0000 mgr.a (mgr.14388) 16719 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:43 smithi049 bash[23528]: audit 2024-09-21T04:40:42.748970+0000 mon.a (mon.0) 13329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:43 smithi049 bash[23528]: audit 2024-09-21T04:40:42.758861+0000 mon.a (mon.0) 13330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:43 smithi049 bash[23528]: audit 2024-09-21T04:40:42.769778+0000 mon.a (mon.0) 13331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:43 smithi049 bash[23528]: cluster 2024-09-21T04:40:42.871561+0000 mgr.a (mgr.14388) 16719 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:44.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:43 smithi044 bash[22676]: audit 2024-09-21T04:40:42.748970+0000 mon.a (mon.0) 13329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:43 smithi044 bash[22676]: audit 2024-09-21T04:40:42.758861+0000 mon.a (mon.0) 13330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:43 smithi044 bash[22676]: audit 2024-09-21T04:40:42.769778+0000 mon.a (mon.0) 13331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:43 smithi044 bash[22676]: cluster 2024-09-21T04:40:42.871561+0000 mgr.a (mgr.14388) 16719 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:44 smithi049 bash[23528]: audit 2024-09-21T04:40:43.676734+0000 mgr.a (mgr.14388) 16720 : audit [DBG] from='client.360615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:44 smithi044 bash[22676]: audit 2024-09-21T04:40:43.676734+0000 mgr.a (mgr.14388) 16720 : audit [DBG] from='client.360615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:44 smithi179 bash[23186]: audit 2024-09-21T04:40:43.676734+0000 mgr.a (mgr.14388) 16720 : audit [DBG] from='client.360615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:45 smithi049 bash[23528]: cluster 2024-09-21T04:40:44.872585+0000 mgr.a (mgr.14388) 16721 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:45 smithi044 bash[22676]: cluster 2024-09-21T04:40:44.872585+0000 mgr.a (mgr.14388) 16721 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:45 smithi179 bash[23186]: cluster 2024-09-21T04:40:44.872585+0000 mgr.a (mgr.14388) 16721 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:47 smithi044 bash[22676]: cluster 2024-09-21T04:40:46.874947+0000 mgr.a (mgr.14388) 16722 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:48.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:47 smithi179 bash[23186]: cluster 2024-09-21T04:40:46.874947+0000 mgr.a (mgr.14388) 16722 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:47 smithi049 bash[23528]: cluster 2024-09-21T04:40:46.874947+0000 mgr.a (mgr.14388) 16722 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:49.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:49.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:49.132 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:49.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:49 smithi044 bash[22676]: cluster 2024-09-21T04:40:48.875779+0000 mgr.a (mgr.14388) 16723 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:49 smithi179 bash[23186]: cluster 2024-09-21T04:40:48.875779+0000 mgr.a (mgr.14388) 16723 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:49 smithi049 bash[23528]: cluster 2024-09-21T04:40:48.875779+0000 mgr.a (mgr.14388) 16723 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:51.147 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:50 smithi044 bash[22676]: audit 2024-09-21T04:40:49.463545+0000 mgr.a (mgr.14388) 16724 : audit [DBG] from='client.360693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:50 smithi179 bash[23186]: audit 2024-09-21T04:40:49.463545+0000 mgr.a (mgr.14388) 16724 : audit [DBG] from='client.360693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:50 smithi049 bash[23528]: audit 2024-09-21T04:40:49.463545+0000 mgr.a (mgr.14388) 16724 : audit [DBG] from='client.360693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:51 smithi044 bash[22676]: cluster 2024-09-21T04:40:50.877392+0000 mgr.a (mgr.14388) 16725 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:51 smithi179 bash[23186]: cluster 2024-09-21T04:40:50.877392+0000 mgr.a (mgr.14388) 16725 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:51 smithi049 bash[23528]: cluster 2024-09-21T04:40:50.877392+0000 mgr.a (mgr.14388) 16725 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:40:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:53 smithi044 bash[22676]: cluster 2024-09-21T04:40:52.877860+0000 mgr.a (mgr.14388) 16726 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:53 smithi044 bash[22676]: audit 2024-09-21T04:40:53.566833+0000 mon.a (mon.0) 13332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:53 smithi044 bash[22676]: audit 2024-09-21T04:40:53.572473+0000 mon.a (mon.0) 13333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:53 smithi044 bash[22676]: audit 2024-09-21T04:40:53.578318+0000 mon.a (mon.0) 13334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:53 smithi044 bash[22676]: audit 2024-09-21T04:40:53.602051+0000 mon.a (mon.0) 13335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:53 smithi044 bash[22676]: audit 2024-09-21T04:40:53.609315+0000 mon.a (mon.0) 13336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:53 smithi044 bash[22676]: audit 2024-09-21T04:40:53.617930+0000 mon.a (mon.0) 13337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:53 smithi179 bash[23186]: cluster 2024-09-21T04:40:52.877860+0000 mgr.a (mgr.14388) 16726 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:53 smithi179 bash[23186]: audit 2024-09-21T04:40:53.566833+0000 mon.a (mon.0) 13332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:53 smithi179 bash[23186]: audit 2024-09-21T04:40:53.572473+0000 mon.a (mon.0) 13333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:53 smithi179 bash[23186]: audit 2024-09-21T04:40:53.578318+0000 mon.a (mon.0) 13334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:53 smithi179 bash[23186]: audit 2024-09-21T04:40:53.602051+0000 mon.a (mon.0) 13335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:53 smithi179 bash[23186]: audit 2024-09-21T04:40:53.609315+0000 mon.a (mon.0) 13336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:53 smithi179 bash[23186]: audit 2024-09-21T04:40:53.617930+0000 mon.a (mon.0) 13337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:53 smithi049 bash[23528]: cluster 2024-09-21T04:40:52.877860+0000 mgr.a (mgr.14388) 16726 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:53 smithi049 bash[23528]: audit 2024-09-21T04:40:53.566833+0000 mon.a (mon.0) 13332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:53 smithi049 bash[23528]: audit 2024-09-21T04:40:53.572473+0000 mon.a (mon.0) 13333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:53 smithi049 bash[23528]: audit 2024-09-21T04:40:53.578318+0000 mon.a (mon.0) 13334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:53 smithi049 bash[23528]: audit 2024-09-21T04:40:53.602051+0000 mon.a (mon.0) 13335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:53 smithi049 bash[23528]: audit 2024-09-21T04:40:53.609315+0000 mon.a (mon.0) 13336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:53 smithi049 bash[23528]: audit 2024-09-21T04:40:53.617930+0000 mon.a (mon.0) 13337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:40:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:40:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:40:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:40:55.704 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:40:55.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:40:55.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:40:55.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:40:55.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:40:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:55 smithi044 bash[22676]: cluster 2024-09-21T04:40:54.878626+0000 mgr.a (mgr.14388) 16727 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:55 smithi044 bash[22676]: audit 2024-09-21T04:40:55.253952+0000 mgr.a (mgr.14388) 16728 : audit [DBG] from='client.360771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:55 smithi179 bash[23186]: cluster 2024-09-21T04:40:54.878626+0000 mgr.a (mgr.14388) 16727 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:55 smithi179 bash[23186]: audit 2024-09-21T04:40:55.253952+0000 mgr.a (mgr.14388) 16728 : audit [DBG] from='client.360771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:55 smithi049 bash[23528]: cluster 2024-09-21T04:40:54.878626+0000 mgr.a (mgr.14388) 16727 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:55 smithi049 bash[23528]: audit 2024-09-21T04:40:55.253952+0000 mgr.a (mgr.14388) 16728 : audit [DBG] from='client.360771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:40:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:57 smithi044 bash[22676]: cluster 2024-09-21T04:40:56.881794+0000 mgr.a (mgr.14388) 16729 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:57 smithi179 bash[23186]: cluster 2024-09-21T04:40:56.881794+0000 mgr.a (mgr.14388) 16729 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:40:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:57 smithi049 bash[23528]: cluster 2024-09-21T04:40:56.881794+0000 mgr.a (mgr.14388) 16729 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:40:59 smithi044 bash[22676]: cluster 2024-09-21T04:40:58.882538+0000 mgr.a (mgr.14388) 16730 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:40:59 smithi179 bash[23186]: cluster 2024-09-21T04:40:58.882538+0000 mgr.a (mgr.14388) 16730 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:40:59 smithi049 bash[23528]: cluster 2024-09-21T04:40:58.882538+0000 mgr.a (mgr.14388) 16730 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:00.706 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:00.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:00.707 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:01.467 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:01 smithi044 bash[22676]: cluster 2024-09-21T04:41:00.884535+0000 mgr.a (mgr.14388) 16731 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:01 smithi044 bash[22676]: audit 2024-09-21T04:41:01.035989+0000 mgr.a (mgr.14388) 16732 : audit [DBG] from='client.360849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:01 smithi179 bash[23186]: cluster 2024-09-21T04:41:00.884535+0000 mgr.a (mgr.14388) 16731 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:01 smithi179 bash[23186]: audit 2024-09-21T04:41:01.035989+0000 mgr.a (mgr.14388) 16732 : audit [DBG] from='client.360849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:01 smithi049 bash[23528]: cluster 2024-09-21T04:41:00.884535+0000 mgr.a (mgr.14388) 16731 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:01 smithi049 bash[23528]: audit 2024-09-21T04:41:01.035989+0000 mgr.a (mgr.14388) 16732 : audit [DBG] from='client.360849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:04.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:03 smithi044 bash[22676]: cluster 2024-09-21T04:41:02.885570+0000 mgr.a (mgr.14388) 16733 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:04.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:03 smithi044 bash[22676]: audit 2024-09-21T04:41:02.984948+0000 mon.a (mon.0) 13338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:03 smithi044 bash[22676]: audit 2024-09-21T04:41:02.993473+0000 mon.a (mon.0) 13339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:03 smithi044 bash[22676]: audit 2024-09-21T04:41:03.003991+0000 mon.a (mon.0) 13340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:03 smithi179 bash[23186]: cluster 2024-09-21T04:41:02.885570+0000 mgr.a (mgr.14388) 16733 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:03 smithi179 bash[23186]: audit 2024-09-21T04:41:02.984948+0000 mon.a (mon.0) 13338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:03 smithi179 bash[23186]: audit 2024-09-21T04:41:02.993473+0000 mon.a (mon.0) 13339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:03 smithi179 bash[23186]: audit 2024-09-21T04:41:03.003991+0000 mon.a (mon.0) 13340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:03 smithi049 bash[23528]: cluster 2024-09-21T04:41:02.885570+0000 mgr.a (mgr.14388) 16733 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:03 smithi049 bash[23528]: audit 2024-09-21T04:41:02.984948+0000 mon.a (mon.0) 13338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:03 smithi049 bash[23528]: audit 2024-09-21T04:41:02.993473+0000 mon.a (mon.0) 13339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:03 smithi049 bash[23528]: audit 2024-09-21T04:41:03.003991+0000 mon.a (mon.0) 13340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:05 smithi179 bash[23186]: cluster 2024-09-21T04:41:04.886405+0000 mgr.a (mgr.14388) 16734 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:41:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:05 smithi049 bash[23528]: cluster 2024-09-21T04:41:04.886405+0000 mgr.a (mgr.14388) 16734 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:41:06.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:06.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:06.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:05 smithi044 bash[22676]: cluster 2024-09-21T04:41:04.886405+0000 mgr.a (mgr.14388) 16734 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:41:07.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:07.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:07.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:07.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:07.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:07 smithi179 bash[23186]: audit 2024-09-21T04:41:06.799664+0000 mgr.a (mgr.14388) 16735 : audit [DBG] from='client.360921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:07 smithi179 bash[23186]: cluster 2024-09-21T04:41:06.887827+0000 mgr.a (mgr.14388) 16736 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:07 smithi049 bash[23528]: audit 2024-09-21T04:41:06.799664+0000 mgr.a (mgr.14388) 16735 : audit [DBG] from='client.360921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:07 smithi049 bash[23528]: cluster 2024-09-21T04:41:06.887827+0000 mgr.a (mgr.14388) 16736 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:07 smithi044 bash[22676]: audit 2024-09-21T04:41:06.799664+0000 mgr.a (mgr.14388) 16735 : audit [DBG] from='client.360921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:07 smithi044 bash[22676]: cluster 2024-09-21T04:41:06.887827+0000 mgr.a (mgr.14388) 16736 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:08 smithi179 bash[23186]: audit 2024-09-21T04:41:08.484265+0000 mon.a (mon.0) 13341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:41:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:08 smithi179 bash[23186]: audit 2024-09-21T04:41:08.491427+0000 mon.a (mon.0) 13342 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:41:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:08 smithi179 bash[23186]: audit 2024-09-21T04:41:08.493320+0000 mon.a (mon.0) 13343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:41:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:08 smithi179 bash[23186]: audit 2024-09-21T04:41:08.504690+0000 mon.a (mon.0) 13344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:08 smithi179 bash[23186]: audit 2024-09-21T04:41:08.511895+0000 mon.a (mon.0) 13345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:41:09.299 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:08 smithi044 bash[22676]: audit 2024-09-21T04:41:08.484265+0000 mon.a (mon.0) 13341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:41:09.299 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:08 smithi044 bash[22676]: audit 2024-09-21T04:41:08.491427+0000 mon.a (mon.0) 13342 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:41:09.299 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:08 smithi044 bash[22676]: audit 2024-09-21T04:41:08.493320+0000 mon.a (mon.0) 13343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:41:09.299 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:08 smithi044 bash[22676]: audit 2024-09-21T04:41:08.504690+0000 mon.a (mon.0) 13344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:09.299 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:08 smithi044 bash[22676]: audit 2024-09-21T04:41:08.511895+0000 mon.a (mon.0) 13345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:41:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:08 smithi049 bash[23528]: audit 2024-09-21T04:41:08.484265+0000 mon.a (mon.0) 13341 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:41:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:08 smithi049 bash[23528]: audit 2024-09-21T04:41:08.491427+0000 mon.a (mon.0) 13342 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:41:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:08 smithi049 bash[23528]: audit 2024-09-21T04:41:08.493320+0000 mon.a (mon.0) 13343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:41:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:08 smithi049 bash[23528]: audit 2024-09-21T04:41:08.504690+0000 mon.a (mon.0) 13344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:08 smithi049 bash[23528]: audit 2024-09-21T04:41:08.511895+0000 mon.a (mon.0) 13345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:41:09.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:41:09 smithi044 bash[22930]: debug 2024-09-21T04:41:09.291+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:41:09.740 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:41:09 smithi044 bash[22930]: debug 2024-09-21T04:41:09.295+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:41:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:09 smithi179 bash[23186]: audit 2024-09-21T04:41:08.514502+0000 mgr.a (mgr.14388) 16737 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:41:10.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:09 smithi179 bash[23186]: cluster 2024-09-21T04:41:08.888471+0000 mgr.a (mgr.14388) 16738 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:10.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:09 smithi179 bash[23186]: audit 2024-09-21T04:41:09.297064+0000 mgr.a (mgr.14388) 16739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:41:10.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:09 smithi179 bash[23186]: cephadm 2024-09-21T04:41:09.298624+0000 mgr.a (mgr.14388) 16740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:41:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:09 smithi049 bash[23528]: audit 2024-09-21T04:41:08.514502+0000 mgr.a (mgr.14388) 16737 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:41:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:09 smithi049 bash[23528]: cluster 2024-09-21T04:41:08.888471+0000 mgr.a (mgr.14388) 16738 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:09 smithi049 bash[23528]: audit 2024-09-21T04:41:09.297064+0000 mgr.a (mgr.14388) 16739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:41:10.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:09 smithi049 bash[23528]: cephadm 2024-09-21T04:41:09.298624+0000 mgr.a (mgr.14388) 16740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:41:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:09 smithi044 bash[22676]: audit 2024-09-21T04:41:08.514502+0000 mgr.a (mgr.14388) 16737 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:41:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:09 smithi044 bash[22676]: cluster 2024-09-21T04:41:08.888471+0000 mgr.a (mgr.14388) 16738 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:09 smithi044 bash[22676]: audit 2024-09-21T04:41:09.297064+0000 mgr.a (mgr.14388) 16739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:41:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:09 smithi044 bash[22676]: cephadm 2024-09-21T04:41:09.298624+0000 mgr.a (mgr.14388) 16740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:41:12.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:12.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:12 smithi179 bash[23186]: cluster 2024-09-21T04:41:10.890848+0000 mgr.a (mgr.14388) 16741 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:12 smithi049 bash[23528]: cluster 2024-09-21T04:41:10.890848+0000 mgr.a (mgr.14388) 16741 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:12 smithi044 bash[22676]: cluster 2024-09-21T04:41:10.890848+0000 mgr.a (mgr.14388) 16741 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:13.022 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:13.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:13.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:13.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:13.023 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: audit 2024-09-21T04:41:12.578193+0000 mgr.a (mgr.14388) 16742 : audit [DBG] from='client.361101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: cluster 2024-09-21T04:41:12.891456+0000 mgr.a (mgr.14388) 16743 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: audit 2024-09-21T04:41:13.713198+0000 mon.a (mon.0) 13346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: audit 2024-09-21T04:41:13.718191+0000 mon.a (mon.0) 13347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: audit 2024-09-21T04:41:13.723134+0000 mon.a (mon.0) 13348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: audit 2024-09-21T04:41:13.822592+0000 mon.a (mon.0) 13349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: audit 2024-09-21T04:41:13.831200+0000 mon.a (mon.0) 13350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:14 smithi179 bash[23186]: audit 2024-09-21T04:41:13.841950+0000 mon.a (mon.0) 13351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: audit 2024-09-21T04:41:12.578193+0000 mgr.a (mgr.14388) 16742 : audit [DBG] from='client.361101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: cluster 2024-09-21T04:41:12.891456+0000 mgr.a (mgr.14388) 16743 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: audit 2024-09-21T04:41:13.713198+0000 mon.a (mon.0) 13346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: audit 2024-09-21T04:41:13.718191+0000 mon.a (mon.0) 13347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: audit 2024-09-21T04:41:13.723134+0000 mon.a (mon.0) 13348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: audit 2024-09-21T04:41:13.822592+0000 mon.a (mon.0) 13349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: audit 2024-09-21T04:41:13.831200+0000 mon.a (mon.0) 13350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:14 smithi049 bash[23528]: audit 2024-09-21T04:41:13.841950+0000 mon.a (mon.0) 13351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: audit 2024-09-21T04:41:12.578193+0000 mgr.a (mgr.14388) 16742 : audit [DBG] from='client.361101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: cluster 2024-09-21T04:41:12.891456+0000 mgr.a (mgr.14388) 16743 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: audit 2024-09-21T04:41:13.713198+0000 mon.a (mon.0) 13346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: audit 2024-09-21T04:41:13.718191+0000 mon.a (mon.0) 13347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: audit 2024-09-21T04:41:13.723134+0000 mon.a (mon.0) 13348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: audit 2024-09-21T04:41:13.822592+0000 mon.a (mon.0) 13349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: audit 2024-09-21T04:41:13.831200+0000 mon.a (mon.0) 13350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:14 smithi044 bash[22676]: audit 2024-09-21T04:41:13.841950+0000 mon.a (mon.0) 13351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:16.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:16 smithi049 bash[23528]: cluster 2024-09-21T04:41:14.892334+0000 mgr.a (mgr.14388) 16744 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:16 smithi044 bash[22676]: cluster 2024-09-21T04:41:14.892334+0000 mgr.a (mgr.14388) 16744 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:16 smithi179 bash[23186]: cluster 2024-09-21T04:41:14.892334+0000 mgr.a (mgr.14388) 16744 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:18.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:18.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:18.025 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:18 smithi179 bash[23186]: cluster 2024-09-21T04:41:16.894582+0000 mgr.a (mgr.14388) 16745 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:18 smithi049 bash[23528]: cluster 2024-09-21T04:41:16.894582+0000 mgr.a (mgr.14388) 16745 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:18 smithi044 bash[22676]: cluster 2024-09-21T04:41:16.894582+0000 mgr.a (mgr.14388) 16745 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:18.815 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:18.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:18.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:18.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:18.815 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:19.277 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:19 smithi179 bash[23186]: audit 2024-09-21T04:41:18.364276+0000 mgr.a (mgr.14388) 16746 : audit [DBG] from='client.361179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:19 smithi049 bash[23528]: audit 2024-09-21T04:41:18.364276+0000 mgr.a (mgr.14388) 16746 : audit [DBG] from='client.361179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:19 smithi044 bash[22676]: audit 2024-09-21T04:41:18.364276+0000 mgr.a (mgr.14388) 16746 : audit [DBG] from='client.361179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:20 smithi049 bash[23528]: cluster 2024-09-21T04:41:18.895107+0000 mgr.a (mgr.14388) 16747 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:20.305 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:20 smithi179 bash[23186]: cluster 2024-09-21T04:41:18.895107+0000 mgr.a (mgr.14388) 16747 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:20 smithi044 bash[22676]: cluster 2024-09-21T04:41:18.895107+0000 mgr.a (mgr.14388) 16747 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:22 smithi179 bash[23186]: cluster 2024-09-21T04:41:20.897333+0000 mgr.a (mgr.14388) 16748 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:22 smithi049 bash[23528]: cluster 2024-09-21T04:41:20.897333+0000 mgr.a (mgr.14388) 16748 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:22 smithi044 bash[22676]: cluster 2024-09-21T04:41:20.897333+0000 mgr.a (mgr.14388) 16748 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:41:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:23.817 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:24 smithi044 bash[22676]: cluster 2024-09-21T04:41:22.898086+0000 mgr.a (mgr.14388) 16749 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:24 smithi044 bash[22676]: audit 2024-09-21T04:41:23.218294+0000 mon.a (mon.0) 13352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:24 smithi044 bash[22676]: audit 2024-09-21T04:41:23.227402+0000 mon.a (mon.0) 13353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:24 smithi044 bash[22676]: audit 2024-09-21T04:41:23.238363+0000 mon.a (mon.0) 13354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:24 smithi179 bash[23186]: cluster 2024-09-21T04:41:22.898086+0000 mgr.a (mgr.14388) 16749 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:24 smithi179 bash[23186]: audit 2024-09-21T04:41:23.218294+0000 mon.a (mon.0) 13352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:24 smithi179 bash[23186]: audit 2024-09-21T04:41:23.227402+0000 mon.a (mon.0) 13353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:24 smithi179 bash[23186]: audit 2024-09-21T04:41:23.238363+0000 mon.a (mon.0) 13354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:24 smithi049 bash[23528]: cluster 2024-09-21T04:41:22.898086+0000 mgr.a (mgr.14388) 16749 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:24 smithi049 bash[23528]: audit 2024-09-21T04:41:23.218294+0000 mon.a (mon.0) 13352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:24 smithi049 bash[23528]: audit 2024-09-21T04:41:23.227402+0000 mon.a (mon.0) 13353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:24 smithi049 bash[23528]: audit 2024-09-21T04:41:23.238363+0000 mon.a (mon.0) 13354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:24.608 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:24.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:24.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:24.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:24.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:25 smithi044 bash[22676]: audit 2024-09-21T04:41:24.149395+0000 mgr.a (mgr.14388) 16750 : audit [DBG] from='client.361257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:25 smithi179 bash[23186]: audit 2024-09-21T04:41:24.149395+0000 mgr.a (mgr.14388) 16750 : audit [DBG] from='client.361257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:25 smithi049 bash[23528]: audit 2024-09-21T04:41:24.149395+0000 mgr.a (mgr.14388) 16750 : audit [DBG] from='client.361257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:26 smithi044 bash[22676]: cluster 2024-09-21T04:41:24.899101+0000 mgr.a (mgr.14388) 16751 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:26 smithi179 bash[23186]: cluster 2024-09-21T04:41:24.899101+0000 mgr.a (mgr.14388) 16751 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:26 smithi049 bash[23528]: cluster 2024-09-21T04:41:24.899101+0000 mgr.a (mgr.14388) 16751 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:28 smithi044 bash[22676]: cluster 2024-09-21T04:41:26.901387+0000 mgr.a (mgr.14388) 16752 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:28 smithi179 bash[23186]: cluster 2024-09-21T04:41:26.901387+0000 mgr.a (mgr.14388) 16752 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:28 smithi049 bash[23528]: cluster 2024-09-21T04:41:26.901387+0000 mgr.a (mgr.14388) 16752 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:29.610 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:29.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:29.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:30.379 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:30.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:30.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:30.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:30.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:30 smithi044 bash[22676]: cluster 2024-09-21T04:41:28.902148+0000 mgr.a (mgr.14388) 16753 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:30 smithi179 bash[23186]: cluster 2024-09-21T04:41:28.902148+0000 mgr.a (mgr.14388) 16753 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:30 smithi049 bash[23528]: cluster 2024-09-21T04:41:28.902148+0000 mgr.a (mgr.14388) 16753 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:31 smithi179 bash[23186]: audit 2024-09-21T04:41:29.939130+0000 mgr.a (mgr.14388) 16754 : audit [DBG] from='client.361335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:31.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:31 smithi044 bash[22676]: audit 2024-09-21T04:41:29.939130+0000 mgr.a (mgr.14388) 16754 : audit [DBG] from='client.361335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:31 smithi049 bash[23528]: audit 2024-09-21T04:41:29.939130+0000 mgr.a (mgr.14388) 16754 : audit [DBG] from='client.361335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:32 smithi179 bash[23186]: cluster 2024-09-21T04:41:30.904741+0000 mgr.a (mgr.14388) 16755 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:41:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:32 smithi049 bash[23528]: cluster 2024-09-21T04:41:30.904741+0000 mgr.a (mgr.14388) 16755 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:41:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:32 smithi044 bash[22676]: cluster 2024-09-21T04:41:30.904741+0000 mgr.a (mgr.14388) 16755 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:41:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:34 smithi044 bash[22676]: cluster 2024-09-21T04:41:32.905665+0000 mgr.a (mgr.14388) 16756 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:41:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:34 smithi044 bash[22676]: audit 2024-09-21T04:41:33.907802+0000 mon.a (mon.0) 13355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:34 smithi044 bash[22676]: audit 2024-09-21T04:41:33.913056+0000 mon.a (mon.0) 13356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:34 smithi044 bash[22676]: audit 2024-09-21T04:41:33.917926+0000 mon.a (mon.0) 13357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:34 smithi044 bash[22676]: audit 2024-09-21T04:41:34.038603+0000 mon.a (mon.0) 13358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:34 smithi044 bash[22676]: audit 2024-09-21T04:41:34.045985+0000 mon.a (mon.0) 13359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:34 smithi044 bash[22676]: audit 2024-09-21T04:41:34.052757+0000 mon.a (mon.0) 13360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:34 smithi179 bash[23186]: cluster 2024-09-21T04:41:32.905665+0000 mgr.a (mgr.14388) 16756 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:41:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:34 smithi179 bash[23186]: audit 2024-09-21T04:41:33.907802+0000 mon.a (mon.0) 13355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:34 smithi179 bash[23186]: audit 2024-09-21T04:41:33.913056+0000 mon.a (mon.0) 13356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:34 smithi179 bash[23186]: audit 2024-09-21T04:41:33.917926+0000 mon.a (mon.0) 13357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:34 smithi179 bash[23186]: audit 2024-09-21T04:41:34.038603+0000 mon.a (mon.0) 13358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:34 smithi179 bash[23186]: audit 2024-09-21T04:41:34.045985+0000 mon.a (mon.0) 13359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:34 smithi179 bash[23186]: audit 2024-09-21T04:41:34.052757+0000 mon.a (mon.0) 13360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:34 smithi049 bash[23528]: cluster 2024-09-21T04:41:32.905665+0000 mgr.a (mgr.14388) 16756 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:41:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:34 smithi049 bash[23528]: audit 2024-09-21T04:41:33.907802+0000 mon.a (mon.0) 13355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:34 smithi049 bash[23528]: audit 2024-09-21T04:41:33.913056+0000 mon.a (mon.0) 13356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:34 smithi049 bash[23528]: audit 2024-09-21T04:41:33.917926+0000 mon.a (mon.0) 13357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:34 smithi049 bash[23528]: audit 2024-09-21T04:41:34.038603+0000 mon.a (mon.0) 13358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:34 smithi049 bash[23528]: audit 2024-09-21T04:41:34.045985+0000 mon.a (mon.0) 13359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:34 smithi049 bash[23528]: audit 2024-09-21T04:41:34.052757+0000 mon.a (mon.0) 13360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:35.380 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:35.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:35.381 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:36.165 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:36 smithi049 bash[23528]: cluster 2024-09-21T04:41:34.906466+0000 mgr.a (mgr.14388) 16757 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:41:36.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:36 smithi179 bash[23186]: cluster 2024-09-21T04:41:34.906466+0000 mgr.a (mgr.14388) 16757 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:41:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:36 smithi044 bash[22676]: cluster 2024-09-21T04:41:34.906466+0000 mgr.a (mgr.14388) 16757 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:41:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:37 smithi049 bash[23528]: audit 2024-09-21T04:41:35.715354+0000 mgr.a (mgr.14388) 16758 : audit [DBG] from='client.361413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:37 smithi044 bash[22676]: audit 2024-09-21T04:41:35.715354+0000 mgr.a (mgr.14388) 16758 : audit [DBG] from='client.361413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:37 smithi179 bash[23186]: audit 2024-09-21T04:41:35.715354+0000 mgr.a (mgr.14388) 16758 : audit [DBG] from='client.361413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:38 smithi049 bash[23528]: cluster 2024-09-21T04:41:36.909452+0000 mgr.a (mgr.14388) 16759 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:38 smithi044 bash[22676]: cluster 2024-09-21T04:41:36.909452+0000 mgr.a (mgr.14388) 16759 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:38.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:38 smithi179 bash[23186]: cluster 2024-09-21T04:41:36.909452+0000 mgr.a (mgr.14388) 16759 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:40 smithi044 bash[22676]: cluster 2024-09-21T04:41:38.910246+0000 mgr.a (mgr.14388) 16760 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:40 smithi179 bash[23186]: cluster 2024-09-21T04:41:38.910246+0000 mgr.a (mgr.14388) 16760 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:40 smithi049 bash[23528]: cluster 2024-09-21T04:41:38.910246+0000 mgr.a (mgr.14388) 16760 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:41:41.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:41.957 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:42 smithi049 bash[23528]: cluster 2024-09-21T04:41:40.912277+0000 mgr.a (mgr.14388) 16761 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:42 smithi044 bash[22676]: cluster 2024-09-21T04:41:40.912277+0000 mgr.a (mgr.14388) 16761 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:42 smithi179 bash[23186]: cluster 2024-09-21T04:41:40.912277+0000 mgr.a (mgr.14388) 16761 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:43 smithi049 bash[23528]: audit 2024-09-21T04:41:41.507592+0000 mgr.a (mgr.14388) 16762 : audit [DBG] from='client.361488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:43 smithi044 bash[22676]: audit 2024-09-21T04:41:41.507592+0000 mgr.a (mgr.14388) 16762 : audit [DBG] from='client.361488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:43 smithi179 bash[23186]: audit 2024-09-21T04:41:41.507592+0000 mgr.a (mgr.14388) 16762 : audit [DBG] from='client.361488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:44 smithi049 bash[23528]: cluster 2024-09-21T04:41:42.913269+0000 mgr.a (mgr.14388) 16763 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:41:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:44 smithi049 bash[23528]: audit 2024-09-21T04:41:43.435353+0000 mon.a (mon.0) 13361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:44 smithi049 bash[23528]: audit 2024-09-21T04:41:43.444180+0000 mon.a (mon.0) 13362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:44 smithi049 bash[23528]: audit 2024-09-21T04:41:43.454615+0000 mon.a (mon.0) 13363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:44 smithi044 bash[22676]: cluster 2024-09-21T04:41:42.913269+0000 mgr.a (mgr.14388) 16763 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:41:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:44 smithi044 bash[22676]: audit 2024-09-21T04:41:43.435353+0000 mon.a (mon.0) 13361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:44 smithi044 bash[22676]: audit 2024-09-21T04:41:43.444180+0000 mon.a (mon.0) 13362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:44 smithi044 bash[22676]: audit 2024-09-21T04:41:43.454615+0000 mon.a (mon.0) 13363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:44 smithi179 bash[23186]: cluster 2024-09-21T04:41:42.913269+0000 mgr.a (mgr.14388) 16763 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:41:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:44 smithi179 bash[23186]: audit 2024-09-21T04:41:43.435353+0000 mon.a (mon.0) 13361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:44 smithi179 bash[23186]: audit 2024-09-21T04:41:43.444180+0000 mon.a (mon.0) 13362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:44 smithi179 bash[23186]: audit 2024-09-21T04:41:43.454615+0000 mon.a (mon.0) 13363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:46 smithi049 bash[23528]: cluster 2024-09-21T04:41:44.914066+0000 mgr.a (mgr.14388) 16764 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:41:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:46 smithi044 bash[22676]: cluster 2024-09-21T04:41:44.914066+0000 mgr.a (mgr.14388) 16764 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:41:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:46 smithi179 bash[23186]: cluster 2024-09-21T04:41:44.914066+0000 mgr.a (mgr.14388) 16764 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:41:46.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:46.959 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:46.960 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:47.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:47.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:47.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:47.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:47.717 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:48 smithi049 bash[23528]: cluster 2024-09-21T04:41:46.916314+0000 mgr.a (mgr.14388) 16765 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:48 smithi049 bash[23528]: audit 2024-09-21T04:41:47.286409+0000 mgr.a (mgr.14388) 16766 : audit [DBG] from='client.361563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:48 smithi044 bash[22676]: cluster 2024-09-21T04:41:46.916314+0000 mgr.a (mgr.14388) 16765 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:48 smithi044 bash[22676]: audit 2024-09-21T04:41:47.286409+0000 mgr.a (mgr.14388) 16766 : audit [DBG] from='client.361563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:48 smithi179 bash[23186]: cluster 2024-09-21T04:41:46.916314+0000 mgr.a (mgr.14388) 16765 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:48 smithi179 bash[23186]: audit 2024-09-21T04:41:47.286409+0000 mgr.a (mgr.14388) 16766 : audit [DBG] from='client.361563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:50 smithi044 bash[22676]: cluster 2024-09-21T04:41:48.917232+0000 mgr.a (mgr.14388) 16767 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:50 smithi179 bash[23186]: cluster 2024-09-21T04:41:48.917232+0000 mgr.a (mgr.14388) 16767 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:50.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:50 smithi049 bash[23528]: cluster 2024-09-21T04:41:48.917232+0000 mgr.a (mgr.14388) 16767 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:52.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:52 smithi044 bash[22676]: cluster 2024-09-21T04:41:50.919562+0000 mgr.a (mgr.14388) 16768 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:52 smithi179 bash[23186]: cluster 2024-09-21T04:41:50.919562+0000 mgr.a (mgr.14388) 16768 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:52.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:52 smithi049 bash[23528]: cluster 2024-09-21T04:41:50.919562+0000 mgr.a (mgr.14388) 16768 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:53.519 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:53.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:53.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:53.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:53.520 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:41:54.365 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: cluster 2024-09-21T04:41:52.920353+0000 mgr.a (mgr.14388) 16769 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:54.365 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: audit 2024-09-21T04:41:53.053137+0000 mgr.a (mgr.14388) 16770 : audit [DBG] from='client.361641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:54.365 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: audit 2024-09-21T04:41:54.090995+0000 mon.a (mon.0) 13364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: audit 2024-09-21T04:41:54.095967+0000 mon.a (mon.0) 13365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: audit 2024-09-21T04:41:54.102112+0000 mon.a (mon.0) 13366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: audit 2024-09-21T04:41:54.240072+0000 mon.a (mon.0) 13367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: audit 2024-09-21T04:41:54.246072+0000 mon.a (mon.0) 13368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:54 smithi044 bash[22676]: audit 2024-09-21T04:41:54.252701+0000 mon.a (mon.0) 13369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: cluster 2024-09-21T04:41:52.920353+0000 mgr.a (mgr.14388) 16769 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: audit 2024-09-21T04:41:53.053137+0000 mgr.a (mgr.14388) 16770 : audit [DBG] from='client.361641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: audit 2024-09-21T04:41:54.090995+0000 mon.a (mon.0) 13364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: audit 2024-09-21T04:41:54.095967+0000 mon.a (mon.0) 13365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: audit 2024-09-21T04:41:54.102112+0000 mon.a (mon.0) 13366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: audit 2024-09-21T04:41:54.240072+0000 mon.a (mon.0) 13367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: audit 2024-09-21T04:41:54.246072+0000 mon.a (mon.0) 13368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:54 smithi179 bash[23186]: audit 2024-09-21T04:41:54.252701+0000 mon.a (mon.0) 13369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: cluster 2024-09-21T04:41:52.920353+0000 mgr.a (mgr.14388) 16769 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: audit 2024-09-21T04:41:53.053137+0000 mgr.a (mgr.14388) 16770 : audit [DBG] from='client.361641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:41:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: audit 2024-09-21T04:41:54.090995+0000 mon.a (mon.0) 13364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: audit 2024-09-21T04:41:54.095967+0000 mon.a (mon.0) 13365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: audit 2024-09-21T04:41:54.102112+0000 mon.a (mon.0) 13366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: audit 2024-09-21T04:41:54.240072+0000 mon.a (mon.0) 13367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: audit 2024-09-21T04:41:54.246072+0000 mon.a (mon.0) 13368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:54 smithi049 bash[23528]: audit 2024-09-21T04:41:54.252701+0000 mon.a (mon.0) 13369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:41:56.614 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:56 smithi049 bash[23528]: cluster 2024-09-21T04:41:54.921096+0000 mgr.a (mgr.14388) 16771 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:56 smithi044 bash[22676]: cluster 2024-09-21T04:41:54.921096+0000 mgr.a (mgr.14388) 16771 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:56 smithi179 bash[23186]: cluster 2024-09-21T04:41:54.921096+0000 mgr.a (mgr.14388) 16771 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:41:58.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:41:58.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:41:58.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:41:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:41:58 smithi044 bash[22676]: cluster 2024-09-21T04:41:56.923364+0000 mgr.a (mgr.14388) 16772 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:41:58 smithi179 bash[23186]: cluster 2024-09-21T04:41:56.923364+0000 mgr.a (mgr.14388) 16772 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:41:58 smithi049 bash[23528]: cluster 2024-09-21T04:41:56.923364+0000 mgr.a (mgr.14388) 16772 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:41:59.317 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:41:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:41:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:41:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:41:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:00.491 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:00 smithi179 bash[23186]: audit 2024-09-21T04:41:58.855455+0000 mgr.a (mgr.14388) 16773 : audit [DBG] from='client.361719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:00.491 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:00 smithi179 bash[23186]: cluster 2024-09-21T04:41:58.923943+0000 mgr.a (mgr.14388) 16774 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:00.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:00 smithi044 bash[22676]: audit 2024-09-21T04:41:58.855455+0000 mgr.a (mgr.14388) 16773 : audit [DBG] from='client.361719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:00.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:00 smithi044 bash[22676]: cluster 2024-09-21T04:41:58.923943+0000 mgr.a (mgr.14388) 16774 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:00 smithi049 bash[23528]: audit 2024-09-21T04:41:58.855455+0000 mgr.a (mgr.14388) 16773 : audit [DBG] from='client.361719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:00 smithi049 bash[23528]: cluster 2024-09-21T04:41:58.923943+0000 mgr.a (mgr.14388) 16774 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:02.608 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:02 smithi179 bash[23186]: cluster 2024-09-21T04:42:00.926339+0000 mgr.a (mgr.14388) 16775 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:02 smithi044 bash[22676]: cluster 2024-09-21T04:42:00.926339+0000 mgr.a (mgr.14388) 16775 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:02.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:02 smithi049 bash[23528]: cluster 2024-09-21T04:42:00.926339+0000 mgr.a (mgr.14388) 16775 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:04.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:04.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:04 smithi044 bash[22676]: cluster 2024-09-21T04:42:02.927127+0000 mgr.a (mgr.14388) 16776 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:04 smithi044 bash[22676]: audit 2024-09-21T04:42:03.669121+0000 mon.a (mon.0) 13370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:04 smithi044 bash[22676]: audit 2024-09-21T04:42:03.678064+0000 mon.a (mon.0) 13371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:04 smithi044 bash[22676]: audit 2024-09-21T04:42:03.688901+0000 mon.a (mon.0) 13372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:04 smithi179 bash[23186]: cluster 2024-09-21T04:42:02.927127+0000 mgr.a (mgr.14388) 16776 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:04 smithi179 bash[23186]: audit 2024-09-21T04:42:03.669121+0000 mon.a (mon.0) 13370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:04 smithi179 bash[23186]: audit 2024-09-21T04:42:03.678064+0000 mon.a (mon.0) 13371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:04 smithi179 bash[23186]: audit 2024-09-21T04:42:03.688901+0000 mon.a (mon.0) 13372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:04 smithi049 bash[23528]: cluster 2024-09-21T04:42:02.927127+0000 mgr.a (mgr.14388) 16776 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:04.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:04 smithi049 bash[23528]: audit 2024-09-21T04:42:03.669121+0000 mon.a (mon.0) 13370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:04 smithi049 bash[23528]: audit 2024-09-21T04:42:03.678064+0000 mon.a (mon.0) 13371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:04.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:04 smithi049 bash[23528]: audit 2024-09-21T04:42:03.688901+0000 mon.a (mon.0) 13372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:05.084 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:05.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:05.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:05.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:05.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:06 smithi044 bash[22676]: audit 2024-09-21T04:42:04.649812+0000 mgr.a (mgr.14388) 16777 : audit [DBG] from='client.361794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:06 smithi044 bash[22676]: cluster 2024-09-21T04:42:04.927673+0000 mgr.a (mgr.14388) 16778 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:06 smithi179 bash[23186]: audit 2024-09-21T04:42:04.649812+0000 mgr.a (mgr.14388) 16777 : audit [DBG] from='client.361794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:06 smithi179 bash[23186]: cluster 2024-09-21T04:42:04.927673+0000 mgr.a (mgr.14388) 16778 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:06 smithi049 bash[23528]: audit 2024-09-21T04:42:04.649812+0000 mgr.a (mgr.14388) 16777 : audit [DBG] from='client.361794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:06.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:06 smithi049 bash[23528]: cluster 2024-09-21T04:42:04.927673+0000 mgr.a (mgr.14388) 16778 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:08 smithi044 bash[22676]: cluster 2024-09-21T04:42:06.930165+0000 mgr.a (mgr.14388) 16779 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:08 smithi179 bash[23186]: cluster 2024-09-21T04:42:06.930165+0000 mgr.a (mgr.14388) 16779 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:08 smithi049 bash[23528]: cluster 2024-09-21T04:42:06.930165+0000 mgr.a (mgr.14388) 16779 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:10.085 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:10.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:10.086 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:10.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22930]: debug 2024-09-21T04:42:10.186+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:42:10.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22930]: debug 2024-09-21T04:42:10.190+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:42:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22676]: cluster 2024-09-21T04:42:08.930994+0000 mgr.a (mgr.14388) 16780 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22676]: audit 2024-09-21T04:42:09.366914+0000 mon.a (mon.0) 13373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:42:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22676]: audit 2024-09-21T04:42:09.378589+0000 mon.a (mon.0) 13374 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:42:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22676]: audit 2024-09-21T04:42:09.380509+0000 mon.a (mon.0) 13375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:42:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22676]: audit 2024-09-21T04:42:09.392711+0000 mon.a (mon.0) 13376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:10.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:10 smithi044 bash[22676]: audit 2024-09-21T04:42:09.399324+0000 mon.a (mon.0) 13377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:42:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:10 smithi179 bash[23186]: cluster 2024-09-21T04:42:08.930994+0000 mgr.a (mgr.14388) 16780 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:10 smithi179 bash[23186]: audit 2024-09-21T04:42:09.366914+0000 mon.a (mon.0) 13373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:42:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:10 smithi179 bash[23186]: audit 2024-09-21T04:42:09.378589+0000 mon.a (mon.0) 13374 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:42:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:10 smithi179 bash[23186]: audit 2024-09-21T04:42:09.380509+0000 mon.a (mon.0) 13375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:42:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:10 smithi179 bash[23186]: audit 2024-09-21T04:42:09.392711+0000 mon.a (mon.0) 13376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:10 smithi179 bash[23186]: audit 2024-09-21T04:42:09.399324+0000 mon.a (mon.0) 13377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:42:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:10 smithi049 bash[23528]: cluster 2024-09-21T04:42:08.930994+0000 mgr.a (mgr.14388) 16780 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:10 smithi049 bash[23528]: audit 2024-09-21T04:42:09.366914+0000 mon.a (mon.0) 13373 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:42:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:10 smithi049 bash[23528]: audit 2024-09-21T04:42:09.378589+0000 mon.a (mon.0) 13374 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:42:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:10 smithi049 bash[23528]: audit 2024-09-21T04:42:09.380509+0000 mon.a (mon.0) 13375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:42:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:10 smithi049 bash[23528]: audit 2024-09-21T04:42:09.392711+0000 mon.a (mon.0) 13376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:10 smithi049 bash[23528]: audit 2024-09-21T04:42:09.399324+0000 mon.a (mon.0) 13377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:42:10.822 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:10.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:10.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:10.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:10.822 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:11.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:11 smithi049 bash[23528]: audit 2024-09-21T04:42:09.401769+0000 mgr.a (mgr.14388) 16781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:42:11.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:11 smithi049 bash[23528]: audit 2024-09-21T04:42:10.193006+0000 mgr.a (mgr.14388) 16782 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:42:11.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:11 smithi049 bash[23528]: cephadm 2024-09-21T04:42:10.194146+0000 mgr.a (mgr.14388) 16783 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:42:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:11 smithi044 bash[22676]: audit 2024-09-21T04:42:09.401769+0000 mgr.a (mgr.14388) 16781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:42:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:11 smithi044 bash[22676]: audit 2024-09-21T04:42:10.193006+0000 mgr.a (mgr.14388) 16782 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:42:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:11 smithi044 bash[22676]: cephadm 2024-09-21T04:42:10.194146+0000 mgr.a (mgr.14388) 16783 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:42:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:11 smithi179 bash[23186]: audit 2024-09-21T04:42:09.401769+0000 mgr.a (mgr.14388) 16781 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:42:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:11 smithi179 bash[23186]: audit 2024-09-21T04:42:10.193006+0000 mgr.a (mgr.14388) 16782 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:42:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:11 smithi179 bash[23186]: cephadm 2024-09-21T04:42:10.194146+0000 mgr.a (mgr.14388) 16783 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:42:12.544 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:12 smithi044 bash[22676]: audit 2024-09-21T04:42:10.393312+0000 mgr.a (mgr.14388) 16784 : audit [DBG] from='client.361980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:12.545 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:12 smithi044 bash[22676]: cluster 2024-09-21T04:42:10.933986+0000 mgr.a (mgr.14388) 16785 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:42:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:12 smithi179 bash[23186]: audit 2024-09-21T04:42:10.393312+0000 mgr.a (mgr.14388) 16784 : audit [DBG] from='client.361980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:12 smithi179 bash[23186]: cluster 2024-09-21T04:42:10.933986+0000 mgr.a (mgr.14388) 16785 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:42:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:12 smithi049 bash[23528]: audit 2024-09-21T04:42:10.393312+0000 mgr.a (mgr.14388) 16784 : audit [DBG] from='client.361980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:12 smithi049 bash[23528]: cluster 2024-09-21T04:42:10.933986+0000 mgr.a (mgr.14388) 16785 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T04:42:14.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:14 smithi044 bash[22676]: cluster 2024-09-21T04:42:12.934791+0000 mgr.a (mgr.14388) 16786 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:42:14.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:14 smithi044 bash[22676]: audit 2024-09-21T04:42:14.211135+0000 mon.a (mon.0) 13378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:14 smithi044 bash[22676]: audit 2024-09-21T04:42:14.216279+0000 mon.a (mon.0) 13379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:14 smithi044 bash[22676]: audit 2024-09-21T04:42:14.221423+0000 mon.a (mon.0) 13380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:14 smithi179 bash[23186]: cluster 2024-09-21T04:42:12.934791+0000 mgr.a (mgr.14388) 16786 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:42:14.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:14 smithi179 bash[23186]: audit 2024-09-21T04:42:14.211135+0000 mon.a (mon.0) 13378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:14 smithi179 bash[23186]: audit 2024-09-21T04:42:14.216279+0000 mon.a (mon.0) 13379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:14 smithi179 bash[23186]: audit 2024-09-21T04:42:14.221423+0000 mon.a (mon.0) 13380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:14 smithi049 bash[23528]: cluster 2024-09-21T04:42:12.934791+0000 mgr.a (mgr.14388) 16786 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:42:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:14 smithi049 bash[23528]: audit 2024-09-21T04:42:14.211135+0000 mon.a (mon.0) 13378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:14 smithi049 bash[23528]: audit 2024-09-21T04:42:14.216279+0000 mon.a (mon.0) 13379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:14 smithi049 bash[23528]: audit 2024-09-21T04:42:14.221423+0000 mon.a (mon.0) 13380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:15 smithi044 bash[22676]: audit 2024-09-21T04:42:14.447220+0000 mon.a (mon.0) 13381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:15 smithi044 bash[22676]: audit 2024-09-21T04:42:14.452857+0000 mon.a (mon.0) 13382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:15 smithi044 bash[22676]: audit 2024-09-21T04:42:14.459510+0000 mon.a (mon.0) 13383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:15 smithi044 bash[22676]: cluster 2024-09-21T04:42:14.935607+0000 mgr.a (mgr.14388) 16787 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:42:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:15 smithi179 bash[23186]: audit 2024-09-21T04:42:14.447220+0000 mon.a (mon.0) 13381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:15 smithi179 bash[23186]: audit 2024-09-21T04:42:14.452857+0000 mon.a (mon.0) 13382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:15 smithi179 bash[23186]: audit 2024-09-21T04:42:14.459510+0000 mon.a (mon.0) 13383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:15 smithi179 bash[23186]: cluster 2024-09-21T04:42:14.935607+0000 mgr.a (mgr.14388) 16787 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:42:15.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:15 smithi049 bash[23528]: audit 2024-09-21T04:42:14.447220+0000 mon.a (mon.0) 13381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:15 smithi049 bash[23528]: audit 2024-09-21T04:42:14.452857+0000 mon.a (mon.0) 13382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.784 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:15 smithi049 bash[23528]: audit 2024-09-21T04:42:14.459510+0000 mon.a (mon.0) 13383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:15.785 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:15 smithi049 bash[23528]: cluster 2024-09-21T04:42:14.935607+0000 mgr.a (mgr.14388) 16787 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-21T04:42:15.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:15.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:15.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:16.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:16 smithi044 bash[22676]: audit 2024-09-21T04:42:16.159755+0000 mgr.a (mgr.14388) 16788 : audit [DBG] from='client.362055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:16 smithi179 bash[23186]: audit 2024-09-21T04:42:16.159755+0000 mgr.a (mgr.14388) 16788 : audit [DBG] from='client.362055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:16.757 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:16 smithi049 bash[23528]: audit 2024-09-21T04:42:16.159755+0000 mgr.a (mgr.14388) 16788 : audit [DBG] from='client.362055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:17 smithi044 bash[22676]: cluster 2024-09-21T04:42:16.938770+0000 mgr.a (mgr.14388) 16789 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:42:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:17 smithi179 bash[23186]: cluster 2024-09-21T04:42:16.938770+0000 mgr.a (mgr.14388) 16789 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:42:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:17 smithi049 bash[23528]: cluster 2024-09-21T04:42:16.938770+0000 mgr.a (mgr.14388) 16789 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:42:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:19 smithi179 bash[23186]: cluster 2024-09-21T04:42:18.939778+0000 mgr.a (mgr.14388) 16790 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:42:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:19 smithi049 bash[23528]: cluster 2024-09-21T04:42:18.939778+0000 mgr.a (mgr.14388) 16790 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:42:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:19 smithi044 bash[22676]: cluster 2024-09-21T04:42:18.939778+0000 mgr.a (mgr.14388) 16790 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:42:21.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:21.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:22 smithi179 bash[23186]: cluster 2024-09-21T04:42:20.942002+0000 mgr.a (mgr.14388) 16791 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:42:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:22 smithi049 bash[23528]: cluster 2024-09-21T04:42:20.942002+0000 mgr.a (mgr.14388) 16791 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:42:22.408 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:22.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:22.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:22.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:22.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:22 smithi044 bash[22676]: cluster 2024-09-21T04:42:20.942002+0000 mgr.a (mgr.14388) 16791 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:42:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:23 smithi179 bash[23186]: audit 2024-09-21T04:42:21.952465+0000 mgr.a (mgr.14388) 16792 : audit [DBG] from='client.362130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:23 smithi049 bash[23528]: audit 2024-09-21T04:42:21.952465+0000 mgr.a (mgr.14388) 16792 : audit [DBG] from='client.362130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:23 smithi044 bash[22676]: audit 2024-09-21T04:42:21.952465+0000 mgr.a (mgr.14388) 16792 : audit [DBG] from='client.362130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:24 smithi049 bash[23528]: cluster 2024-09-21T04:42:22.943061+0000 mgr.a (mgr.14388) 16793 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:24 smithi049 bash[23528]: audit 2024-09-21T04:42:23.904597+0000 mon.a (mon.0) 13384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:24 smithi049 bash[23528]: audit 2024-09-21T04:42:23.913967+0000 mon.a (mon.0) 13385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:24 smithi049 bash[23528]: audit 2024-09-21T04:42:23.924993+0000 mon.a (mon.0) 13386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:24 smithi044 bash[22676]: cluster 2024-09-21T04:42:22.943061+0000 mgr.a (mgr.14388) 16793 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:24 smithi044 bash[22676]: audit 2024-09-21T04:42:23.904597+0000 mon.a (mon.0) 13384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:24 smithi044 bash[22676]: audit 2024-09-21T04:42:23.913967+0000 mon.a (mon.0) 13385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:24 smithi044 bash[22676]: audit 2024-09-21T04:42:23.924993+0000 mon.a (mon.0) 13386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:24 smithi179 bash[23186]: cluster 2024-09-21T04:42:22.943061+0000 mgr.a (mgr.14388) 16793 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:24 smithi179 bash[23186]: audit 2024-09-21T04:42:23.904597+0000 mon.a (mon.0) 13384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:24 smithi179 bash[23186]: audit 2024-09-21T04:42:23.913967+0000 mon.a (mon.0) 13385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:24 smithi179 bash[23186]: audit 2024-09-21T04:42:23.924993+0000 mon.a (mon.0) 13386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:26 smithi049 bash[23528]: cluster 2024-09-21T04:42:24.943930+0000 mgr.a (mgr.14388) 16794 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:26 smithi044 bash[22676]: cluster 2024-09-21T04:42:24.943930+0000 mgr.a (mgr.14388) 16794 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:26 smithi179 bash[23186]: cluster 2024-09-21T04:42:24.943930+0000 mgr.a (mgr.14388) 16794 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:27.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:27.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:27.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:28.177 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:28.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:28.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:28.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:28.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:28 smithi049 bash[23528]: cluster 2024-09-21T04:42:26.946207+0000 mgr.a (mgr.14388) 16795 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:28 smithi044 bash[22676]: cluster 2024-09-21T04:42:26.946207+0000 mgr.a (mgr.14388) 16795 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:28 smithi179 bash[23186]: cluster 2024-09-21T04:42:26.946207+0000 mgr.a (mgr.14388) 16795 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T04:42:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:29 smithi049 bash[23528]: audit 2024-09-21T04:42:27.741416+0000 mgr.a (mgr.14388) 16796 : audit [DBG] from='client.362205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:29 smithi044 bash[22676]: audit 2024-09-21T04:42:27.741416+0000 mgr.a (mgr.14388) 16796 : audit [DBG] from='client.362205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:29 smithi179 bash[23186]: audit 2024-09-21T04:42:27.741416+0000 mgr.a (mgr.14388) 16796 : audit [DBG] from='client.362205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:30 smithi049 bash[23528]: cluster 2024-09-21T04:42:28.947108+0000 mgr.a (mgr.14388) 16797 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:30 smithi044 bash[22676]: cluster 2024-09-21T04:42:28.947108+0000 mgr.a (mgr.14388) 16797 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:30 smithi179 bash[23186]: cluster 2024-09-21T04:42:28.947108+0000 mgr.a (mgr.14388) 16797 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:32 smithi049 bash[23528]: cluster 2024-09-21T04:42:30.949505+0000 mgr.a (mgr.14388) 16798 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:32.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:32 smithi044 bash[22676]: cluster 2024-09-21T04:42:30.949505+0000 mgr.a (mgr.14388) 16798 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:32 smithi179 bash[23186]: cluster 2024-09-21T04:42:30.949505+0000 mgr.a (mgr.14388) 16798 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:33.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:33.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:33.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:33.965 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:33.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:33.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:33.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:33.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:34 smithi049 bash[23528]: cluster 2024-09-21T04:42:32.950465+0000 mgr.a (mgr.14388) 16799 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:34.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:34 smithi044 bash[22676]: cluster 2024-09-21T04:42:32.950465+0000 mgr.a (mgr.14388) 16799 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:34 smithi179 bash[23186]: cluster 2024-09-21T04:42:32.950465+0000 mgr.a (mgr.14388) 16799 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:35 smithi044 bash[22676]: audit 2024-09-21T04:42:33.513013+0000 mgr.a (mgr.14388) 16800 : audit [DBG] from='client.362283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:35 smithi044 bash[22676]: audit 2024-09-21T04:42:34.344625+0000 mon.a (mon.0) 13387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:35 smithi044 bash[22676]: audit 2024-09-21T04:42:34.350202+0000 mon.a (mon.0) 13388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:35 smithi044 bash[22676]: audit 2024-09-21T04:42:34.355613+0000 mon.a (mon.0) 13389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:35 smithi044 bash[22676]: audit 2024-09-21T04:42:34.662507+0000 mon.a (mon.0) 13390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:35 smithi044 bash[22676]: audit 2024-09-21T04:42:34.670456+0000 mon.a (mon.0) 13391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:35 smithi044 bash[22676]: audit 2024-09-21T04:42:34.679505+0000 mon.a (mon.0) 13392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:35 smithi179 bash[23186]: audit 2024-09-21T04:42:33.513013+0000 mgr.a (mgr.14388) 16800 : audit [DBG] from='client.362283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:35.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:35 smithi179 bash[23186]: audit 2024-09-21T04:42:34.344625+0000 mon.a (mon.0) 13387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:35 smithi179 bash[23186]: audit 2024-09-21T04:42:34.350202+0000 mon.a (mon.0) 13388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:35 smithi179 bash[23186]: audit 2024-09-21T04:42:34.355613+0000 mon.a (mon.0) 13389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:35 smithi179 bash[23186]: audit 2024-09-21T04:42:34.662507+0000 mon.a (mon.0) 13390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:35 smithi179 bash[23186]: audit 2024-09-21T04:42:34.670456+0000 mon.a (mon.0) 13391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:35 smithi179 bash[23186]: audit 2024-09-21T04:42:34.679505+0000 mon.a (mon.0) 13392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:35 smithi049 bash[23528]: audit 2024-09-21T04:42:33.513013+0000 mgr.a (mgr.14388) 16800 : audit [DBG] from='client.362283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:35 smithi049 bash[23528]: audit 2024-09-21T04:42:34.344625+0000 mon.a (mon.0) 13387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:35 smithi049 bash[23528]: audit 2024-09-21T04:42:34.350202+0000 mon.a (mon.0) 13388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:35 smithi049 bash[23528]: audit 2024-09-21T04:42:34.355613+0000 mon.a (mon.0) 13389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:35 smithi049 bash[23528]: audit 2024-09-21T04:42:34.662507+0000 mon.a (mon.0) 13390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:35 smithi049 bash[23528]: audit 2024-09-21T04:42:34.670456+0000 mon.a (mon.0) 13391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:35.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:35 smithi049 bash[23528]: audit 2024-09-21T04:42:34.679505+0000 mon.a (mon.0) 13392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:36 smithi049 bash[23528]: cluster 2024-09-21T04:42:34.951405+0000 mgr.a (mgr.14388) 16801 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:36 smithi044 bash[22676]: cluster 2024-09-21T04:42:34.951405+0000 mgr.a (mgr.14388) 16801 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:36 smithi179 bash[23186]: cluster 2024-09-21T04:42:34.951405+0000 mgr.a (mgr.14388) 16801 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:38 smithi044 bash[22676]: cluster 2024-09-21T04:42:36.953812+0000 mgr.a (mgr.14388) 16802 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:38 smithi179 bash[23186]: cluster 2024-09-21T04:42:36.953812+0000 mgr.a (mgr.14388) 16802 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:38 smithi049 bash[23528]: cluster 2024-09-21T04:42:36.953812+0000 mgr.a (mgr.14388) 16802 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:38.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:38.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:39.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:40.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:40 smithi179 bash[23186]: cluster 2024-09-21T04:42:38.954786+0000 mgr.a (mgr.14388) 16803 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:40.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:40 smithi179 bash[23186]: audit 2024-09-21T04:42:39.294251+0000 mgr.a (mgr.14388) 16804 : audit [DBG] from='client.362358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:40 smithi044 bash[22676]: cluster 2024-09-21T04:42:38.954786+0000 mgr.a (mgr.14388) 16803 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:40 smithi044 bash[22676]: audit 2024-09-21T04:42:39.294251+0000 mgr.a (mgr.14388) 16804 : audit [DBG] from='client.362358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:40 smithi049 bash[23528]: cluster 2024-09-21T04:42:38.954786+0000 mgr.a (mgr.14388) 16803 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:40 smithi049 bash[23528]: audit 2024-09-21T04:42:39.294251+0000 mgr.a (mgr.14388) 16804 : audit [DBG] from='client.362358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:41.934 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:41 smithi044 bash[22676]: cluster 2024-09-21T04:42:40.957193+0000 mgr.a (mgr.14388) 16805 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:41 smithi179 bash[23186]: cluster 2024-09-21T04:42:40.957193+0000 mgr.a (mgr.14388) 16805 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:41 smithi049 bash[23528]: cluster 2024-09-21T04:42:40.957193+0000 mgr.a (mgr.14388) 16805 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:42:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:44 smithi049 bash[23528]: cluster 2024-09-21T04:42:42.958011+0000 mgr.a (mgr.14388) 16806 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:44 smithi044 bash[22676]: cluster 2024-09-21T04:42:42.958011+0000 mgr.a (mgr.14388) 16806 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:44 smithi179 bash[23186]: cluster 2024-09-21T04:42:42.958011+0000 mgr.a (mgr.14388) 16806 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:44.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:44.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:44.712 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:45.467 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:45 smithi044 bash[22676]: audit 2024-09-21T04:42:44.123056+0000 mon.a (mon.0) 13393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:45 smithi044 bash[22676]: audit 2024-09-21T04:42:44.131439+0000 mon.a (mon.0) 13394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:45 smithi044 bash[22676]: audit 2024-09-21T04:42:44.142129+0000 mon.a (mon.0) 13395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:45 smithi179 bash[23186]: audit 2024-09-21T04:42:44.123056+0000 mon.a (mon.0) 13393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:45 smithi179 bash[23186]: audit 2024-09-21T04:42:44.131439+0000 mon.a (mon.0) 13394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:45 smithi179 bash[23186]: audit 2024-09-21T04:42:44.142129+0000 mon.a (mon.0) 13395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:45 smithi049 bash[23528]: audit 2024-09-21T04:42:44.123056+0000 mon.a (mon.0) 13393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:45 smithi049 bash[23528]: audit 2024-09-21T04:42:44.131439+0000 mon.a (mon.0) 13394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:45 smithi049 bash[23528]: audit 2024-09-21T04:42:44.142129+0000 mon.a (mon.0) 13395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:46 smithi044 bash[22676]: cluster 2024-09-21T04:42:44.958744+0000 mgr.a (mgr.14388) 16807 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:46 smithi044 bash[22676]: audit 2024-09-21T04:42:45.038200+0000 mgr.a (mgr.14388) 16808 : audit [DBG] from='client.362436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:46 smithi179 bash[23186]: cluster 2024-09-21T04:42:44.958744+0000 mgr.a (mgr.14388) 16807 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:46 smithi179 bash[23186]: audit 2024-09-21T04:42:45.038200+0000 mgr.a (mgr.14388) 16808 : audit [DBG] from='client.362436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:46 smithi049 bash[23528]: cluster 2024-09-21T04:42:44.958744+0000 mgr.a (mgr.14388) 16807 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:46 smithi049 bash[23528]: audit 2024-09-21T04:42:45.038200+0000 mgr.a (mgr.14388) 16808 : audit [DBG] from='client.362436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:48 smithi044 bash[22676]: cluster 2024-09-21T04:42:46.961796+0000 mgr.a (mgr.14388) 16809 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:42:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:48 smithi179 bash[23186]: cluster 2024-09-21T04:42:46.961796+0000 mgr.a (mgr.14388) 16809 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:42:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:48 smithi049 bash[23528]: cluster 2024-09-21T04:42:46.961796+0000 mgr.a (mgr.14388) 16809 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:42:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:50 smithi044 bash[22676]: cluster 2024-09-21T04:42:48.962728+0000 mgr.a (mgr.14388) 16810 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:42:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:50 smithi179 bash[23186]: cluster 2024-09-21T04:42:48.962728+0000 mgr.a (mgr.14388) 16810 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:42:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:50 smithi049 bash[23528]: cluster 2024-09-21T04:42:48.962728+0000 mgr.a (mgr.14388) 16810 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T04:42:51.241 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:51.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:51.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:51.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:51.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:52.455 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:52 smithi044 bash[22676]: audit 2024-09-21T04:42:50.801096+0000 mgr.a (mgr.14388) 16811 : audit [DBG] from='client.362514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:52.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:52 smithi044 bash[22676]: cluster 2024-09-21T04:42:50.965526+0000 mgr.a (mgr.14388) 16812 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:52 smithi179 bash[23186]: audit 2024-09-21T04:42:50.801096+0000 mgr.a (mgr.14388) 16811 : audit [DBG] from='client.362514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:52 smithi179 bash[23186]: cluster 2024-09-21T04:42:50.965526+0000 mgr.a (mgr.14388) 16812 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:52 smithi049 bash[23528]: audit 2024-09-21T04:42:50.801096+0000 mgr.a (mgr.14388) 16811 : audit [DBG] from='client.362514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:52 smithi049 bash[23528]: cluster 2024-09-21T04:42:50.965526+0000 mgr.a (mgr.14388) 16812 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:54 smithi044 bash[22676]: cluster 2024-09-21T04:42:52.966405+0000 mgr.a (mgr.14388) 16813 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:42:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:54 smithi179 bash[23186]: cluster 2024-09-21T04:42:52.966405+0000 mgr.a (mgr.14388) 16813 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:42:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:54 smithi049 bash[23528]: cluster 2024-09-21T04:42:52.966405+0000 mgr.a (mgr.14388) 16813 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:42:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:55 smithi049 bash[23528]: audit 2024-09-21T04:42:54.513097+0000 mon.a (mon.0) 13396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:55 smithi049 bash[23528]: audit 2024-09-21T04:42:54.518255+0000 mon.a (mon.0) 13397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:55 smithi049 bash[23528]: audit 2024-09-21T04:42:54.524054+0000 mon.a (mon.0) 13398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:55 smithi049 bash[23528]: audit 2024-09-21T04:42:54.869815+0000 mon.a (mon.0) 13399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:55 smithi049 bash[23528]: audit 2024-09-21T04:42:54.874302+0000 mon.a (mon.0) 13400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:55 smithi049 bash[23528]: audit 2024-09-21T04:42:54.881927+0000 mon.a (mon.0) 13401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:55 smithi049 bash[23528]: cluster 2024-09-21T04:42:54.967191+0000 mgr.a (mgr.14388) 16814 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:42:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:55 smithi044 bash[22676]: audit 2024-09-21T04:42:54.513097+0000 mon.a (mon.0) 13396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:55 smithi044 bash[22676]: audit 2024-09-21T04:42:54.518255+0000 mon.a (mon.0) 13397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:55 smithi044 bash[22676]: audit 2024-09-21T04:42:54.524054+0000 mon.a (mon.0) 13398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:55 smithi044 bash[22676]: audit 2024-09-21T04:42:54.869815+0000 mon.a (mon.0) 13399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:55 smithi044 bash[22676]: audit 2024-09-21T04:42:54.874302+0000 mon.a (mon.0) 13400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:55 smithi044 bash[22676]: audit 2024-09-21T04:42:54.881927+0000 mon.a (mon.0) 13401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:55 smithi044 bash[22676]: cluster 2024-09-21T04:42:54.967191+0000 mgr.a (mgr.14388) 16814 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:42:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:55 smithi179 bash[23186]: audit 2024-09-21T04:42:54.513097+0000 mon.a (mon.0) 13396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:55 smithi179 bash[23186]: audit 2024-09-21T04:42:54.518255+0000 mon.a (mon.0) 13397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:55 smithi179 bash[23186]: audit 2024-09-21T04:42:54.524054+0000 mon.a (mon.0) 13398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:55 smithi179 bash[23186]: audit 2024-09-21T04:42:54.869815+0000 mon.a (mon.0) 13399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:55 smithi179 bash[23186]: audit 2024-09-21T04:42:54.874302+0000 mon.a (mon.0) 13400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:55 smithi179 bash[23186]: audit 2024-09-21T04:42:54.881927+0000 mon.a (mon.0) 13401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:42:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:55 smithi179 bash[23186]: cluster 2024-09-21T04:42:54.967191+0000 mgr.a (mgr.14388) 16814 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:42:56.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:42:56.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:42:56.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:42:57.031 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:42:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:42:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:42:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:42:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:42:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:58 smithi049 bash[23528]: audit 2024-09-21T04:42:56.581217+0000 mgr.a (mgr.14388) 16815 : audit [DBG] from='client.362592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:42:58 smithi049 bash[23528]: cluster 2024-09-21T04:42:56.968652+0000 mgr.a (mgr.14388) 16816 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:58 smithi044 bash[22676]: audit 2024-09-21T04:42:56.581217+0000 mgr.a (mgr.14388) 16815 : audit [DBG] from='client.362592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:58.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:42:58 smithi044 bash[22676]: cluster 2024-09-21T04:42:56.968652+0000 mgr.a (mgr.14388) 16816 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:42:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:58 smithi179 bash[23186]: audit 2024-09-21T04:42:56.581217+0000 mgr.a (mgr.14388) 16815 : audit [DBG] from='client.362592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:42:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:42:58 smithi179 bash[23186]: cluster 2024-09-21T04:42:56.968652+0000 mgr.a (mgr.14388) 16816 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:00.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:00 smithi049 bash[23528]: cluster 2024-09-21T04:42:58.969402+0000 mgr.a (mgr.14388) 16817 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:43:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:00 smithi044 bash[22676]: cluster 2024-09-21T04:42:58.969402+0000 mgr.a (mgr.14388) 16817 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:43:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:00 smithi179 bash[23186]: cluster 2024-09-21T04:42:58.969402+0000 mgr.a (mgr.14388) 16817 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:43:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:02.033 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:02.034 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:02 smithi049 bash[23528]: cluster 2024-09-21T04:43:00.971430+0000 mgr.a (mgr.14388) 16818 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:02 smithi044 bash[22676]: cluster 2024-09-21T04:43:00.971430+0000 mgr.a (mgr.14388) 16818 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:02 smithi179 bash[23186]: cluster 2024-09-21T04:43:00.971430+0000 mgr.a (mgr.14388) 16818 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:02.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:03 smithi049 bash[23528]: audit 2024-09-21T04:43:02.366198+0000 mgr.a (mgr.14388) 16819 : audit [DBG] from='client.362667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:03 smithi044 bash[22676]: audit 2024-09-21T04:43:02.366198+0000 mgr.a (mgr.14388) 16819 : audit [DBG] from='client.362667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:03 smithi179 bash[23186]: audit 2024-09-21T04:43:02.366198+0000 mgr.a (mgr.14388) 16819 : audit [DBG] from='client.362667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:04 smithi049 bash[23528]: cluster 2024-09-21T04:43:02.972422+0000 mgr.a (mgr.14388) 16820 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:04 smithi044 bash[22676]: cluster 2024-09-21T04:43:02.972422+0000 mgr.a (mgr.14388) 16820 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:04 smithi179 bash[23186]: cluster 2024-09-21T04:43:02.972422+0000 mgr.a (mgr.14388) 16820 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:05 smithi044 bash[22676]: audit 2024-09-21T04:43:04.362898+0000 mon.a (mon.0) 13402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:05 smithi044 bash[22676]: audit 2024-09-21T04:43:04.373044+0000 mon.a (mon.0) 13403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:05 smithi044 bash[22676]: audit 2024-09-21T04:43:04.384811+0000 mon.a (mon.0) 13404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:05 smithi179 bash[23186]: audit 2024-09-21T04:43:04.362898+0000 mon.a (mon.0) 13402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:05 smithi179 bash[23186]: audit 2024-09-21T04:43:04.373044+0000 mon.a (mon.0) 13403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:05 smithi179 bash[23186]: audit 2024-09-21T04:43:04.384811+0000 mon.a (mon.0) 13404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:05 smithi049 bash[23528]: audit 2024-09-21T04:43:04.362898+0000 mon.a (mon.0) 13402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:05 smithi049 bash[23528]: audit 2024-09-21T04:43:04.373044+0000 mon.a (mon.0) 13403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:05 smithi049 bash[23528]: audit 2024-09-21T04:43:04.384811+0000 mon.a (mon.0) 13404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:06 smithi044 bash[22676]: cluster 2024-09-21T04:43:04.973207+0000 mgr.a (mgr.14388) 16821 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:06 smithi179 bash[23186]: cluster 2024-09-21T04:43:04.973207+0000 mgr.a (mgr.14388) 16821 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:06 smithi049 bash[23528]: cluster 2024-09-21T04:43:04.973207+0000 mgr.a (mgr.14388) 16821 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:07.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:08.615 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:08.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:08.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:08.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:08.615 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:08 smithi044 bash[22676]: cluster 2024-09-21T04:43:06.975466+0000 mgr.a (mgr.14388) 16822 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:08 smithi179 bash[23186]: cluster 2024-09-21T04:43:06.975466+0000 mgr.a (mgr.14388) 16822 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:08 smithi049 bash[23528]: cluster 2024-09-21T04:43:06.975466+0000 mgr.a (mgr.14388) 16822 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:09 smithi044 bash[22676]: audit 2024-09-21T04:43:08.166700+0000 mgr.a (mgr.14388) 16823 : audit [DBG] from='client.362745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:09 smithi179 bash[23186]: audit 2024-09-21T04:43:08.166700+0000 mgr.a (mgr.14388) 16823 : audit [DBG] from='client.362745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:09 smithi049 bash[23528]: audit 2024-09-21T04:43:08.166700+0000 mgr.a (mgr.14388) 16823 : audit [DBG] from='client.362745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:10 smithi044 bash[22676]: cluster 2024-09-21T04:43:08.976344+0000 mgr.a (mgr.14388) 16824 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:10 smithi044 bash[22676]: audit 2024-09-21T04:43:10.243092+0000 mon.a (mon.0) 13405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:43:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:10 smithi044 bash[22676]: audit 2024-09-21T04:43:10.250717+0000 mon.a (mon.0) 13406 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:43:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:10 smithi044 bash[22676]: audit 2024-09-21T04:43:10.252682+0000 mon.a (mon.0) 13407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:43:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:10 smithi044 bash[22676]: audit 2024-09-21T04:43:10.264329+0000 mon.a (mon.0) 13408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:10 smithi044 bash[22676]: audit 2024-09-21T04:43:10.270826+0000 mon.a (mon.0) 13409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:43:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:10 smithi179 bash[23186]: cluster 2024-09-21T04:43:08.976344+0000 mgr.a (mgr.14388) 16824 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:10 smithi179 bash[23186]: audit 2024-09-21T04:43:10.243092+0000 mon.a (mon.0) 13405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:43:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:10 smithi179 bash[23186]: audit 2024-09-21T04:43:10.250717+0000 mon.a (mon.0) 13406 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:43:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:10 smithi179 bash[23186]: audit 2024-09-21T04:43:10.252682+0000 mon.a (mon.0) 13407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:43:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:10 smithi179 bash[23186]: audit 2024-09-21T04:43:10.264329+0000 mon.a (mon.0) 13408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:10 smithi179 bash[23186]: audit 2024-09-21T04:43:10.270826+0000 mon.a (mon.0) 13409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:43:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:10 smithi049 bash[23528]: cluster 2024-09-21T04:43:08.976344+0000 mgr.a (mgr.14388) 16824 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:43:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:10 smithi049 bash[23528]: audit 2024-09-21T04:43:10.243092+0000 mon.a (mon.0) 13405 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:43:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:10 smithi049 bash[23528]: audit 2024-09-21T04:43:10.250717+0000 mon.a (mon.0) 13406 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:43:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:10 smithi049 bash[23528]: audit 2024-09-21T04:43:10.252682+0000 mon.a (mon.0) 13407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:43:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:10 smithi049 bash[23528]: audit 2024-09-21T04:43:10.264329+0000 mon.a (mon.0) 13408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:10.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:10 smithi049 bash[23528]: audit 2024-09-21T04:43:10.270826+0000 mon.a (mon.0) 13409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:43:11.408 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:43:11 smithi044 bash[22930]: debug 2024-09-21T04:43:11.029+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:43:11.408 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:43:11 smithi044 bash[22930]: debug 2024-09-21T04:43:11.033+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:43:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:11 smithi044 bash[22676]: audit 2024-09-21T04:43:10.273358+0000 mgr.a (mgr.14388) 16825 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:43:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:11 smithi179 bash[23186]: audit 2024-09-21T04:43:10.273358+0000 mgr.a (mgr.14388) 16825 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:43:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:11 smithi049 bash[23528]: audit 2024-09-21T04:43:10.273358+0000 mgr.a (mgr.14388) 16825 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:43:12.669 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:12 smithi044 bash[22676]: cluster 2024-09-21T04:43:10.977679+0000 mgr.a (mgr.14388) 16826 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:12.669 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:12 smithi044 bash[22676]: audit 2024-09-21T04:43:11.036110+0000 mgr.a (mgr.14388) 16827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:43:12.669 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:12 smithi044 bash[22676]: cephadm 2024-09-21T04:43:11.037576+0000 mgr.a (mgr.14388) 16828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:43:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:12 smithi179 bash[23186]: cluster 2024-09-21T04:43:10.977679+0000 mgr.a (mgr.14388) 16826 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:12 smithi179 bash[23186]: audit 2024-09-21T04:43:11.036110+0000 mgr.a (mgr.14388) 16827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:43:12.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:12 smithi179 bash[23186]: cephadm 2024-09-21T04:43:11.037576+0000 mgr.a (mgr.14388) 16828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:43:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:12 smithi049 bash[23528]: cluster 2024-09-21T04:43:10.977679+0000 mgr.a (mgr.14388) 16826 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T04:43:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:12 smithi049 bash[23528]: audit 2024-09-21T04:43:11.036110+0000 mgr.a (mgr.14388) 16827 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:43:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:12 smithi049 bash[23528]: cephadm 2024-09-21T04:43:11.037576+0000 mgr.a (mgr.14388) 16828 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:43:13.616 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:13.617 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:13.617 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:13.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:13 smithi044 bash[22676]: cluster 2024-09-21T04:43:12.978440+0000 mgr.a (mgr.14388) 16829 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:13 smithi179 bash[23186]: cluster 2024-09-21T04:43:12.978440+0000 mgr.a (mgr.14388) 16829 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:13 smithi049 bash[23528]: cluster 2024-09-21T04:43:12.978440+0000 mgr.a (mgr.14388) 16829 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:14.404 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:14.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:14.677 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:14 smithi044 bash[22676]: audit 2024-09-21T04:43:13.954427+0000 mgr.a (mgr.14388) 16830 : audit [DBG] from='client.362928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:14 smithi179 bash[23186]: audit 2024-09-21T04:43:13.954427+0000 mgr.a (mgr.14388) 16830 : audit [DBG] from='client.362928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:14.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:14 smithi049 bash[23528]: audit 2024-09-21T04:43:13.954427+0000 mgr.a (mgr.14388) 16830 : audit [DBG] from='client.362928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:15 smithi044 bash[22676]: audit 2024-09-21T04:43:14.663431+0000 mon.a (mon.0) 13410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:15 smithi044 bash[22676]: audit 2024-09-21T04:43:14.668315+0000 mon.a (mon.0) 13411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:15 smithi044 bash[22676]: audit 2024-09-21T04:43:14.674272+0000 mon.a (mon.0) 13412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:15 smithi044 bash[22676]: cluster 2024-09-21T04:43:14.978972+0000 mgr.a (mgr.14388) 16831 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:15 smithi044 bash[22676]: audit 2024-09-21T04:43:15.072986+0000 mon.a (mon.0) 13413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:15 smithi044 bash[22676]: audit 2024-09-21T04:43:15.080644+0000 mon.a (mon.0) 13414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:15.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:15 smithi044 bash[22676]: audit 2024-09-21T04:43:15.090004+0000 mon.a (mon.0) 13415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:15 smithi179 bash[23186]: audit 2024-09-21T04:43:14.663431+0000 mon.a (mon.0) 13410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:15 smithi179 bash[23186]: audit 2024-09-21T04:43:14.668315+0000 mon.a (mon.0) 13411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:15 smithi179 bash[23186]: audit 2024-09-21T04:43:14.674272+0000 mon.a (mon.0) 13412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:15 smithi179 bash[23186]: cluster 2024-09-21T04:43:14.978972+0000 mgr.a (mgr.14388) 16831 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:15 smithi179 bash[23186]: audit 2024-09-21T04:43:15.072986+0000 mon.a (mon.0) 13413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:15 smithi179 bash[23186]: audit 2024-09-21T04:43:15.080644+0000 mon.a (mon.0) 13414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:15 smithi179 bash[23186]: audit 2024-09-21T04:43:15.090004+0000 mon.a (mon.0) 13415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:15 smithi049 bash[23528]: audit 2024-09-21T04:43:14.663431+0000 mon.a (mon.0) 13410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:15 smithi049 bash[23528]: audit 2024-09-21T04:43:14.668315+0000 mon.a (mon.0) 13411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:15 smithi049 bash[23528]: audit 2024-09-21T04:43:14.674272+0000 mon.a (mon.0) 13412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:15 smithi049 bash[23528]: cluster 2024-09-21T04:43:14.978972+0000 mgr.a (mgr.14388) 16831 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:15 smithi049 bash[23528]: audit 2024-09-21T04:43:15.072986+0000 mon.a (mon.0) 13413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:15 smithi049 bash[23528]: audit 2024-09-21T04:43:15.080644+0000 mon.a (mon.0) 13414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:15 smithi049 bash[23528]: audit 2024-09-21T04:43:15.090004+0000 mon.a (mon.0) 13415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:18 smithi049 bash[23528]: cluster 2024-09-21T04:43:16.981195+0000 mgr.a (mgr.14388) 16832 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:18 smithi044 bash[22676]: cluster 2024-09-21T04:43:16.981195+0000 mgr.a (mgr.14388) 16832 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:18 smithi179 bash[23186]: cluster 2024-09-21T04:43:16.981195+0000 mgr.a (mgr.14388) 16832 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:19.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:19.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:20 smithi049 bash[23528]: cluster 2024-09-21T04:43:18.981960+0000 mgr.a (mgr.14388) 16833 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:20 smithi044 bash[22676]: cluster 2024-09-21T04:43:18.981960+0000 mgr.a (mgr.14388) 16833 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:20 smithi179 bash[23186]: cluster 2024-09-21T04:43:18.981960+0000 mgr.a (mgr.14388) 16833 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:21 smithi049 bash[23528]: audit 2024-09-21T04:43:19.728828+0000 mgr.a (mgr.14388) 16834 : audit [DBG] from='client.363006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:21 smithi044 bash[22676]: audit 2024-09-21T04:43:19.728828+0000 mgr.a (mgr.14388) 16834 : audit [DBG] from='client.363006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:21 smithi179 bash[23186]: audit 2024-09-21T04:43:19.728828+0000 mgr.a (mgr.14388) 16834 : audit [DBG] from='client.363006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:22 smithi179 bash[23186]: cluster 2024-09-21T04:43:20.984341+0000 mgr.a (mgr.14388) 16835 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:22 smithi044 bash[22676]: cluster 2024-09-21T04:43:20.984341+0000 mgr.a (mgr.14388) 16835 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:22 smithi049 bash[23528]: cluster 2024-09-21T04:43:20.984341+0000 mgr.a (mgr.14388) 16835 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:24.316 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:24 smithi179 bash[23186]: cluster 2024-09-21T04:43:22.985123+0000 mgr.a (mgr.14388) 16836 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:43:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:24 smithi044 bash[22676]: cluster 2024-09-21T04:43:22.985123+0000 mgr.a (mgr.14388) 16836 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:43:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:24 smithi049 bash[23528]: cluster 2024-09-21T04:43:22.985123+0000 mgr.a (mgr.14388) 16836 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:43:25.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:25.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:25.155 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:25.902 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:25 smithi044 bash[22676]: audit 2024-09-21T04:43:24.597866+0000 mon.a (mon.0) 13416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:25 smithi044 bash[22676]: audit 2024-09-21T04:43:24.607649+0000 mon.a (mon.0) 13417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:25 smithi044 bash[22676]: audit 2024-09-21T04:43:24.617975+0000 mon.a (mon.0) 13418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:25 smithi044 bash[22676]: cluster 2024-09-21T04:43:24.985866+0000 mgr.a (mgr.14388) 16837 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:43:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:25 smithi179 bash[23186]: audit 2024-09-21T04:43:24.597866+0000 mon.a (mon.0) 13416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:25 smithi179 bash[23186]: audit 2024-09-21T04:43:24.607649+0000 mon.a (mon.0) 13417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:25 smithi179 bash[23186]: audit 2024-09-21T04:43:24.617975+0000 mon.a (mon.0) 13418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:25 smithi179 bash[23186]: cluster 2024-09-21T04:43:24.985866+0000 mgr.a (mgr.14388) 16837 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:43:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:25 smithi049 bash[23528]: audit 2024-09-21T04:43:24.597866+0000 mon.a (mon.0) 13416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:25 smithi049 bash[23528]: audit 2024-09-21T04:43:24.607649+0000 mon.a (mon.0) 13417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:26.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:25 smithi049 bash[23528]: audit 2024-09-21T04:43:24.617975+0000 mon.a (mon.0) 13418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:26.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:25 smithi049 bash[23528]: cluster 2024-09-21T04:43:24.985866+0000 mgr.a (mgr.14388) 16837 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:43:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:26 smithi044 bash[22676]: audit 2024-09-21T04:43:25.484958+0000 mgr.a (mgr.14388) 16838 : audit [DBG] from='client.363081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:26 smithi179 bash[23186]: audit 2024-09-21T04:43:25.484958+0000 mgr.a (mgr.14388) 16838 : audit [DBG] from='client.363081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:26 smithi049 bash[23528]: audit 2024-09-21T04:43:25.484958+0000 mgr.a (mgr.14388) 16838 : audit [DBG] from='client.363081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:27 smithi044 bash[22676]: cluster 2024-09-21T04:43:26.988778+0000 mgr.a (mgr.14388) 16839 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:27 smithi179 bash[23186]: cluster 2024-09-21T04:43:26.988778+0000 mgr.a (mgr.14388) 16839 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:27 smithi049 bash[23528]: cluster 2024-09-21T04:43:26.988778+0000 mgr.a (mgr.14388) 16839 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:43:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:30 smithi049 bash[23528]: cluster 2024-09-21T04:43:28.989619+0000 mgr.a (mgr.14388) 16840 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:43:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:30 smithi044 bash[22676]: cluster 2024-09-21T04:43:28.989619+0000 mgr.a (mgr.14388) 16840 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:43:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:30 smithi179 bash[23186]: cluster 2024-09-21T04:43:28.989619+0000 mgr.a (mgr.14388) 16840 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:43:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:30.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:31.702 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:31.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:31.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:31.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:31.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:32 smithi044 bash[22676]: cluster 2024-09-21T04:43:30.991580+0000 mgr.a (mgr.14388) 16841 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:32 smithi044 bash[22676]: audit 2024-09-21T04:43:31.244365+0000 mgr.a (mgr.14388) 16842 : audit [DBG] from='client.363156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:32 smithi179 bash[23186]: cluster 2024-09-21T04:43:30.991580+0000 mgr.a (mgr.14388) 16841 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:32 smithi179 bash[23186]: audit 2024-09-21T04:43:31.244365+0000 mgr.a (mgr.14388) 16842 : audit [DBG] from='client.363156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:32 smithi049 bash[23528]: cluster 2024-09-21T04:43:30.991580+0000 mgr.a (mgr.14388) 16841 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:32 smithi049 bash[23528]: audit 2024-09-21T04:43:31.244365+0000 mgr.a (mgr.14388) 16842 : audit [DBG] from='client.363156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:34 smithi044 bash[22676]: cluster 2024-09-21T04:43:32.992484+0000 mgr.a (mgr.14388) 16843 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:43:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:34 smithi179 bash[23186]: cluster 2024-09-21T04:43:32.992484+0000 mgr.a (mgr.14388) 16843 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:43:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:34 smithi049 bash[23528]: cluster 2024-09-21T04:43:32.992484+0000 mgr.a (mgr.14388) 16843 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:43:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:35 smithi044 bash[22676]: audit 2024-09-21T04:43:34.838694+0000 mon.a (mon.0) 13419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:35 smithi044 bash[22676]: audit 2024-09-21T04:43:34.845808+0000 mon.a (mon.0) 13420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:35 smithi044 bash[22676]: audit 2024-09-21T04:43:34.854022+0000 mon.a (mon.0) 13421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:35 smithi044 bash[22676]: cluster 2024-09-21T04:43:34.993271+0000 mgr.a (mgr.14388) 16844 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:43:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:35 smithi044 bash[22676]: audit 2024-09-21T04:43:35.288659+0000 mon.a (mon.0) 13422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:35 smithi044 bash[22676]: audit 2024-09-21T04:43:35.294422+0000 mon.a (mon.0) 13423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:35 smithi044 bash[22676]: audit 2024-09-21T04:43:35.302511+0000 mon.a (mon.0) 13424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:35 smithi179 bash[23186]: audit 2024-09-21T04:43:34.838694+0000 mon.a (mon.0) 13419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:35 smithi179 bash[23186]: audit 2024-09-21T04:43:34.845808+0000 mon.a (mon.0) 13420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:35 smithi179 bash[23186]: audit 2024-09-21T04:43:34.854022+0000 mon.a (mon.0) 13421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:35 smithi179 bash[23186]: cluster 2024-09-21T04:43:34.993271+0000 mgr.a (mgr.14388) 16844 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:43:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:35 smithi179 bash[23186]: audit 2024-09-21T04:43:35.288659+0000 mon.a (mon.0) 13422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:35 smithi179 bash[23186]: audit 2024-09-21T04:43:35.294422+0000 mon.a (mon.0) 13423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:35 smithi179 bash[23186]: audit 2024-09-21T04:43:35.302511+0000 mon.a (mon.0) 13424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:35 smithi049 bash[23528]: audit 2024-09-21T04:43:34.838694+0000 mon.a (mon.0) 13419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:35 smithi049 bash[23528]: audit 2024-09-21T04:43:34.845808+0000 mon.a (mon.0) 13420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:35 smithi049 bash[23528]: audit 2024-09-21T04:43:34.854022+0000 mon.a (mon.0) 13421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:35 smithi049 bash[23528]: cluster 2024-09-21T04:43:34.993271+0000 mgr.a (mgr.14388) 16844 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:43:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:35 smithi049 bash[23528]: audit 2024-09-21T04:43:35.288659+0000 mon.a (mon.0) 13422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:35 smithi049 bash[23528]: audit 2024-09-21T04:43:35.294422+0000 mon.a (mon.0) 13423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:35 smithi049 bash[23528]: audit 2024-09-21T04:43:35.302511+0000 mon.a (mon.0) 13424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:37.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:38 smithi044 bash[22676]: cluster 2024-09-21T04:43:36.995440+0000 mgr.a (mgr.14388) 16845 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:43:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:38 smithi044 bash[22676]: audit 2024-09-21T04:43:37.036051+0000 mgr.a (mgr.14388) 16846 : audit [DBG] from='client.363234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:38 smithi179 bash[23186]: cluster 2024-09-21T04:43:36.995440+0000 mgr.a (mgr.14388) 16845 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:43:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:38 smithi179 bash[23186]: audit 2024-09-21T04:43:37.036051+0000 mgr.a (mgr.14388) 16846 : audit [DBG] from='client.363234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:38 smithi049 bash[23528]: cluster 2024-09-21T04:43:36.995440+0000 mgr.a (mgr.14388) 16845 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:43:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:38 smithi049 bash[23528]: audit 2024-09-21T04:43:37.036051+0000 mgr.a (mgr.14388) 16846 : audit [DBG] from='client.363234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:40 smithi044 bash[22676]: cluster 2024-09-21T04:43:38.996493+0000 mgr.a (mgr.14388) 16847 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:40 smithi179 bash[23186]: cluster 2024-09-21T04:43:38.996493+0000 mgr.a (mgr.14388) 16847 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:40 smithi049 bash[23528]: cluster 2024-09-21T04:43:38.996493+0000 mgr.a (mgr.14388) 16847 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:42.384 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:42 smithi179 bash[23186]: cluster 2024-09-21T04:43:40.998776+0000 mgr.a (mgr.14388) 16848 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:42 smithi044 bash[22676]: cluster 2024-09-21T04:43:40.998776+0000 mgr.a (mgr.14388) 16848 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:42.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:42.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:42.500 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:42 smithi049 bash[23528]: cluster 2024-09-21T04:43:40.998776+0000 mgr.a (mgr.14388) 16848 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:43.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:43.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:43.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:43.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:43.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:44 smithi179 bash[23186]: audit 2024-09-21T04:43:42.825166+0000 mgr.a (mgr.14388) 16849 : audit [DBG] from='client.363309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:44 smithi179 bash[23186]: cluster 2024-09-21T04:43:42.999317+0000 mgr.a (mgr.14388) 16850 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:44 smithi044 bash[22676]: audit 2024-09-21T04:43:42.825166+0000 mgr.a (mgr.14388) 16849 : audit [DBG] from='client.363309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:44 smithi044 bash[22676]: cluster 2024-09-21T04:43:42.999317+0000 mgr.a (mgr.14388) 16850 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:44 smithi049 bash[23528]: audit 2024-09-21T04:43:42.825166+0000 mgr.a (mgr.14388) 16849 : audit [DBG] from='client.363309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:44 smithi049 bash[23528]: cluster 2024-09-21T04:43:42.999317+0000 mgr.a (mgr.14388) 16850 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:46.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:45 smithi044 bash[22676]: audit 2024-09-21T04:43:44.834366+0000 mon.a (mon.0) 13425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:45 smithi044 bash[22676]: audit 2024-09-21T04:43:44.843449+0000 mon.a (mon.0) 13426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:45 smithi044 bash[22676]: audit 2024-09-21T04:43:44.854614+0000 mon.a (mon.0) 13427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:45 smithi044 bash[22676]: cluster 2024-09-21T04:43:45.000133+0000 mgr.a (mgr.14388) 16851 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:45 smithi179 bash[23186]: audit 2024-09-21T04:43:44.834366+0000 mon.a (mon.0) 13425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:45 smithi179 bash[23186]: audit 2024-09-21T04:43:44.843449+0000 mon.a (mon.0) 13426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:45 smithi179 bash[23186]: audit 2024-09-21T04:43:44.854614+0000 mon.a (mon.0) 13427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:45 smithi179 bash[23186]: cluster 2024-09-21T04:43:45.000133+0000 mgr.a (mgr.14388) 16851 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:45 smithi049 bash[23528]: audit 2024-09-21T04:43:44.834366+0000 mon.a (mon.0) 13425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:45 smithi049 bash[23528]: audit 2024-09-21T04:43:44.843449+0000 mon.a (mon.0) 13426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:45 smithi049 bash[23528]: audit 2024-09-21T04:43:44.854614+0000 mon.a (mon.0) 13427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:45 smithi049 bash[23528]: cluster 2024-09-21T04:43:45.000133+0000 mgr.a (mgr.14388) 16851 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:48.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:48.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:48 smithi044 bash[22676]: cluster 2024-09-21T04:43:47.002377+0000 mgr.a (mgr.14388) 16852 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:48 smithi179 bash[23186]: cluster 2024-09-21T04:43:47.002377+0000 mgr.a (mgr.14388) 16852 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:48 smithi049 bash[23528]: cluster 2024-09-21T04:43:47.002377+0000 mgr.a (mgr.14388) 16852 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:49.035 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:50 smithi044 bash[22676]: audit 2024-09-21T04:43:48.581147+0000 mgr.a (mgr.14388) 16853 : audit [DBG] from='client.363381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:50.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:50 smithi044 bash[22676]: cluster 2024-09-21T04:43:49.002826+0000 mgr.a (mgr.14388) 16854 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:50 smithi179 bash[23186]: audit 2024-09-21T04:43:48.581147+0000 mgr.a (mgr.14388) 16853 : audit [DBG] from='client.363381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:50 smithi179 bash[23186]: cluster 2024-09-21T04:43:49.002826+0000 mgr.a (mgr.14388) 16854 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:50 smithi049 bash[23528]: audit 2024-09-21T04:43:48.581147+0000 mgr.a (mgr.14388) 16853 : audit [DBG] from='client.363381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:50 smithi049 bash[23528]: cluster 2024-09-21T04:43:49.002826+0000 mgr.a (mgr.14388) 16854 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:52 smithi044 bash[22676]: cluster 2024-09-21T04:43:51.004971+0000 mgr.a (mgr.14388) 16855 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:52 smithi179 bash[23186]: cluster 2024-09-21T04:43:51.004971+0000 mgr.a (mgr.14388) 16855 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:52 smithi049 bash[23528]: cluster 2024-09-21T04:43:51.004971+0000 mgr.a (mgr.14388) 16855 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:54.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:54.036 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:54.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:43:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:54 smithi044 bash[22676]: cluster 2024-09-21T04:43:53.005748+0000 mgr.a (mgr.14388) 16856 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:54 smithi179 bash[23186]: cluster 2024-09-21T04:43:53.005748+0000 mgr.a (mgr.14388) 16856 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:54 smithi049 bash[23528]: cluster 2024-09-21T04:43:53.005748+0000 mgr.a (mgr.14388) 16856 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:54.787 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:43:54.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:43:54.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:43:54.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:43:54.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:43:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:55 smithi044 bash[22676]: audit 2024-09-21T04:43:54.360612+0000 mgr.a (mgr.14388) 16857 : audit [DBG] from='client.363459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:55 smithi044 bash[22676]: audit 2024-09-21T04:43:55.015671+0000 mon.a (mon.0) 13428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:55 smithi044 bash[22676]: audit 2024-09-21T04:43:55.022119+0000 mon.a (mon.0) 13429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:55 smithi044 bash[22676]: audit 2024-09-21T04:43:55.030073+0000 mon.a (mon.0) 13430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:55 smithi179 bash[23186]: audit 2024-09-21T04:43:54.360612+0000 mgr.a (mgr.14388) 16857 : audit [DBG] from='client.363459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:55 smithi179 bash[23186]: audit 2024-09-21T04:43:55.015671+0000 mon.a (mon.0) 13428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:55 smithi179 bash[23186]: audit 2024-09-21T04:43:55.022119+0000 mon.a (mon.0) 13429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:55 smithi179 bash[23186]: audit 2024-09-21T04:43:55.030073+0000 mon.a (mon.0) 13430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:55 smithi049 bash[23528]: audit 2024-09-21T04:43:54.360612+0000 mgr.a (mgr.14388) 16857 : audit [DBG] from='client.363459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:43:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:55 smithi049 bash[23528]: audit 2024-09-21T04:43:55.015671+0000 mon.a (mon.0) 13428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:55 smithi049 bash[23528]: audit 2024-09-21T04:43:55.022119+0000 mon.a (mon.0) 13429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:55 smithi049 bash[23528]: audit 2024-09-21T04:43:55.030073+0000 mon.a (mon.0) 13430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:56 smithi044 bash[22676]: cluster 2024-09-21T04:43:55.006950+0000 mgr.a (mgr.14388) 16858 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:56 smithi044 bash[22676]: audit 2024-09-21T04:43:55.494574+0000 mon.a (mon.0) 13431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:56 smithi044 bash[22676]: audit 2024-09-21T04:43:55.503278+0000 mon.a (mon.0) 13432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:56 smithi044 bash[22676]: audit 2024-09-21T04:43:55.512808+0000 mon.a (mon.0) 13433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:56 smithi179 bash[23186]: cluster 2024-09-21T04:43:55.006950+0000 mgr.a (mgr.14388) 16858 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:56 smithi179 bash[23186]: audit 2024-09-21T04:43:55.494574+0000 mon.a (mon.0) 13431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:56 smithi179 bash[23186]: audit 2024-09-21T04:43:55.503278+0000 mon.a (mon.0) 13432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:56 smithi179 bash[23186]: audit 2024-09-21T04:43:55.512808+0000 mon.a (mon.0) 13433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:56 smithi049 bash[23528]: cluster 2024-09-21T04:43:55.006950+0000 mgr.a (mgr.14388) 16858 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:43:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:56 smithi049 bash[23528]: audit 2024-09-21T04:43:55.494574+0000 mon.a (mon.0) 13431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:56 smithi049 bash[23528]: audit 2024-09-21T04:43:55.503278+0000 mon.a (mon.0) 13432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:56 smithi049 bash[23528]: audit 2024-09-21T04:43:55.512808+0000 mon.a (mon.0) 13433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:43:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:43:58 smithi044 bash[22676]: cluster 2024-09-21T04:43:57.009290+0000 mgr.a (mgr.14388) 16859 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:43:58 smithi179 bash[23186]: cluster 2024-09-21T04:43:57.009290+0000 mgr.a (mgr.14388) 16859 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:43:58 smithi049 bash[23528]: cluster 2024-09-21T04:43:57.009290+0000 mgr.a (mgr.14388) 16859 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:43:59.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:43:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:43:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:00 smithi044 bash[22676]: cluster 2024-09-21T04:43:59.010100+0000 mgr.a (mgr.14388) 16860 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:00 smithi179 bash[23186]: cluster 2024-09-21T04:43:59.010100+0000 mgr.a (mgr.14388) 16860 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:00.548 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:00.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:00.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:00.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:00.549 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:00 smithi049 bash[23528]: cluster 2024-09-21T04:43:59.010100+0000 mgr.a (mgr.14388) 16860 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:01.467 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:01 smithi179 bash[23186]: audit 2024-09-21T04:44:00.124402+0000 mgr.a (mgr.14388) 16861 : audit [DBG] from='client.363534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:01 smithi044 bash[22676]: audit 2024-09-21T04:44:00.124402+0000 mgr.a (mgr.14388) 16861 : audit [DBG] from='client.363534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:01 smithi049 bash[23528]: audit 2024-09-21T04:44:00.124402+0000 mgr.a (mgr.14388) 16861 : audit [DBG] from='client.363534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:02 smithi044 bash[22676]: cluster 2024-09-21T04:44:01.013027+0000 mgr.a (mgr.14388) 16862 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:02.497 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:02 smithi179 bash[23186]: cluster 2024-09-21T04:44:01.013027+0000 mgr.a (mgr.14388) 16862 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:02 smithi049 bash[23528]: cluster 2024-09-21T04:44:01.013027+0000 mgr.a (mgr.14388) 16862 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:04.384 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:04 smithi179 bash[23186]: cluster 2024-09-21T04:44:03.013824+0000 mgr.a (mgr.14388) 16863 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:04 smithi044 bash[22676]: cluster 2024-09-21T04:44:03.013824+0000 mgr.a (mgr.14388) 16863 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:04 smithi049 bash[23528]: cluster 2024-09-21T04:44:03.013824+0000 mgr.a (mgr.14388) 16863 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:05.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:05.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:05.551 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:06.323 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:06 smithi044 bash[22676]: cluster 2024-09-21T04:44:05.014591+0000 mgr.a (mgr.14388) 16864 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:06 smithi044 bash[22676]: audit 2024-09-21T04:44:05.065652+0000 mon.a (mon.0) 13434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:06 smithi044 bash[22676]: audit 2024-09-21T04:44:05.074246+0000 mon.a (mon.0) 13435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:06 smithi044 bash[22676]: audit 2024-09-21T04:44:05.084734+0000 mon.a (mon.0) 13436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:06 smithi179 bash[23186]: cluster 2024-09-21T04:44:05.014591+0000 mgr.a (mgr.14388) 16864 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:06 smithi179 bash[23186]: audit 2024-09-21T04:44:05.065652+0000 mon.a (mon.0) 13434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:06 smithi179 bash[23186]: audit 2024-09-21T04:44:05.074246+0000 mon.a (mon.0) 13435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:06 smithi179 bash[23186]: audit 2024-09-21T04:44:05.084734+0000 mon.a (mon.0) 13436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:06 smithi049 bash[23528]: cluster 2024-09-21T04:44:05.014591+0000 mgr.a (mgr.14388) 16864 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:06 smithi049 bash[23528]: audit 2024-09-21T04:44:05.065652+0000 mon.a (mon.0) 13434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:06 smithi049 bash[23528]: audit 2024-09-21T04:44:05.074246+0000 mon.a (mon.0) 13435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:06 smithi049 bash[23528]: audit 2024-09-21T04:44:05.084734+0000 mon.a (mon.0) 13436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:07 smithi044 bash[22676]: audit 2024-09-21T04:44:05.879184+0000 mgr.a (mgr.14388) 16865 : audit [DBG] from='client.363612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:07.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:07 smithi179 bash[23186]: audit 2024-09-21T04:44:05.879184+0000 mgr.a (mgr.14388) 16865 : audit [DBG] from='client.363612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:07 smithi049 bash[23528]: audit 2024-09-21T04:44:05.879184+0000 mgr.a (mgr.14388) 16865 : audit [DBG] from='client.363612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:08 smithi044 bash[22676]: cluster 2024-09-21T04:44:07.017563+0000 mgr.a (mgr.14388) 16866 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:08 smithi179 bash[23186]: cluster 2024-09-21T04:44:07.017563+0000 mgr.a (mgr.14388) 16866 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:08 smithi049 bash[23528]: cluster 2024-09-21T04:44:07.017563+0000 mgr.a (mgr.14388) 16866 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:10 smithi044 bash[22676]: cluster 2024-09-21T04:44:09.018361+0000 mgr.a (mgr.14388) 16867 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:10 smithi179 bash[23186]: cluster 2024-09-21T04:44:09.018361+0000 mgr.a (mgr.14388) 16867 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:10 smithi049 bash[23528]: cluster 2024-09-21T04:44:09.018361+0000 mgr.a (mgr.14388) 16867 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:11.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:11.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:11.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:12.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:44:11 smithi044 bash[22930]: debug 2024-09-21T04:44:11.944+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:44:12.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:44:11 smithi044 bash[22930]: debug 2024-09-21T04:44:11.960+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:44:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:12 smithi044 bash[22676]: cluster 2024-09-21T04:44:11.020311+0000 mgr.a (mgr.14388) 16868 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:12 smithi044 bash[22676]: audit 2024-09-21T04:44:11.111848+0000 mon.a (mon.0) 13437 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:44:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:12 smithi044 bash[22676]: audit 2024-09-21T04:44:11.118480+0000 mon.a (mon.0) 13438 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:44:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:12 smithi044 bash[22676]: audit 2024-09-21T04:44:11.120401+0000 mon.a (mon.0) 13439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:44:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:12 smithi044 bash[22676]: audit 2024-09-21T04:44:11.132574+0000 mon.a (mon.0) 13440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:12 smithi044 bash[22676]: audit 2024-09-21T04:44:11.139753+0000 mon.a (mon.0) 13441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:44:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:12 smithi044 bash[22676]: audit 2024-09-21T04:44:11.142220+0000 mgr.a (mgr.14388) 16869 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:44:12.372 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:12 smithi179 bash[23186]: cluster 2024-09-21T04:44:11.020311+0000 mgr.a (mgr.14388) 16868 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:12 smithi179 bash[23186]: audit 2024-09-21T04:44:11.111848+0000 mon.a (mon.0) 13437 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:44:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:12 smithi179 bash[23186]: audit 2024-09-21T04:44:11.118480+0000 mon.a (mon.0) 13438 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:44:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:12 smithi179 bash[23186]: audit 2024-09-21T04:44:11.120401+0000 mon.a (mon.0) 13439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:44:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:12 smithi179 bash[23186]: audit 2024-09-21T04:44:11.132574+0000 mon.a (mon.0) 13440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:12 smithi179 bash[23186]: audit 2024-09-21T04:44:11.139753+0000 mon.a (mon.0) 13441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:44:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:12 smithi179 bash[23186]: audit 2024-09-21T04:44:11.142220+0000 mgr.a (mgr.14388) 16869 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:44:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:12 smithi049 bash[23528]: cluster 2024-09-21T04:44:11.020311+0000 mgr.a (mgr.14388) 16868 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:12 smithi049 bash[23528]: audit 2024-09-21T04:44:11.111848+0000 mon.a (mon.0) 13437 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:44:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:12 smithi049 bash[23528]: audit 2024-09-21T04:44:11.118480+0000 mon.a (mon.0) 13438 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:44:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:12 smithi049 bash[23528]: audit 2024-09-21T04:44:11.120401+0000 mon.a (mon.0) 13439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:44:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:12 smithi049 bash[23528]: audit 2024-09-21T04:44:11.132574+0000 mon.a (mon.0) 13440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:12 smithi049 bash[23528]: audit 2024-09-21T04:44:11.139753+0000 mon.a (mon.0) 13441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:44:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:12 smithi049 bash[23528]: audit 2024-09-21T04:44:11.142220+0000 mgr.a (mgr.14388) 16869 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:44:13.459 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:13 smithi044 bash[22676]: audit 2024-09-21T04:44:11.681090+0000 mgr.a (mgr.14388) 16870 : audit [DBG] from='client.363714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:13.459 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:13 smithi044 bash[22676]: audit 2024-09-21T04:44:11.948917+0000 mgr.a (mgr.14388) 16871 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:44:13.459 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:13 smithi044 bash[22676]: cephadm 2024-09-21T04:44:11.962454+0000 mgr.a (mgr.14388) 16872 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:44:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:13 smithi179 bash[23186]: audit 2024-09-21T04:44:11.681090+0000 mgr.a (mgr.14388) 16870 : audit [DBG] from='client.363714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:13.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:13 smithi179 bash[23186]: audit 2024-09-21T04:44:11.948917+0000 mgr.a (mgr.14388) 16871 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:44:13.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:13 smithi179 bash[23186]: cephadm 2024-09-21T04:44:11.962454+0000 mgr.a (mgr.14388) 16872 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:44:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:13 smithi049 bash[23528]: audit 2024-09-21T04:44:11.681090+0000 mgr.a (mgr.14388) 16870 : audit [DBG] from='client.363714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:13 smithi049 bash[23528]: audit 2024-09-21T04:44:11.948917+0000 mgr.a (mgr.14388) 16871 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:44:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:13 smithi049 bash[23528]: cephadm 2024-09-21T04:44:11.962454+0000 mgr.a (mgr.14388) 16872 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:44:14.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:14 smithi044 bash[22676]: cluster 2024-09-21T04:44:13.021341+0000 mgr.a (mgr.14388) 16873 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:14 smithi179 bash[23186]: cluster 2024-09-21T04:44:13.021341+0000 mgr.a (mgr.14388) 16873 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:14 smithi049 bash[23528]: cluster 2024-09-21T04:44:13.021341+0000 mgr.a (mgr.14388) 16873 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:16 smithi044 bash[22676]: cluster 2024-09-21T04:44:15.022096+0000 mgr.a (mgr.14388) 16874 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:16 smithi044 bash[22676]: audit 2024-09-21T04:44:15.231485+0000 mon.a (mon.0) 13442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:16 smithi044 bash[22676]: audit 2024-09-21T04:44:15.238018+0000 mon.a (mon.0) 13443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:16 smithi044 bash[22676]: audit 2024-09-21T04:44:15.252821+0000 mon.a (mon.0) 13444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:16 smithi044 bash[22676]: audit 2024-09-21T04:44:15.714310+0000 mon.a (mon.0) 13445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:16 smithi044 bash[22676]: audit 2024-09-21T04:44:15.719994+0000 mon.a (mon.0) 13446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:16 smithi044 bash[22676]: audit 2024-09-21T04:44:15.726758+0000 mon.a (mon.0) 13447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:16 smithi179 bash[23186]: cluster 2024-09-21T04:44:15.022096+0000 mgr.a (mgr.14388) 16874 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:16 smithi179 bash[23186]: audit 2024-09-21T04:44:15.231485+0000 mon.a (mon.0) 13442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:16 smithi179 bash[23186]: audit 2024-09-21T04:44:15.238018+0000 mon.a (mon.0) 13443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:16 smithi179 bash[23186]: audit 2024-09-21T04:44:15.252821+0000 mon.a (mon.0) 13444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:16 smithi179 bash[23186]: audit 2024-09-21T04:44:15.714310+0000 mon.a (mon.0) 13445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:16 smithi179 bash[23186]: audit 2024-09-21T04:44:15.719994+0000 mon.a (mon.0) 13446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:16 smithi179 bash[23186]: audit 2024-09-21T04:44:15.726758+0000 mon.a (mon.0) 13447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:16 smithi049 bash[23528]: cluster 2024-09-21T04:44:15.022096+0000 mgr.a (mgr.14388) 16874 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:16 smithi049 bash[23528]: audit 2024-09-21T04:44:15.231485+0000 mon.a (mon.0) 13442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:16 smithi049 bash[23528]: audit 2024-09-21T04:44:15.238018+0000 mon.a (mon.0) 13443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:16 smithi049 bash[23528]: audit 2024-09-21T04:44:15.252821+0000 mon.a (mon.0) 13444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:16 smithi049 bash[23528]: audit 2024-09-21T04:44:15.714310+0000 mon.a (mon.0) 13445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:16 smithi049 bash[23528]: audit 2024-09-21T04:44:15.719994+0000 mon.a (mon.0) 13446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:16 smithi049 bash[23528]: audit 2024-09-21T04:44:15.726758+0000 mon.a (mon.0) 13447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:17.374 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:17.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:17.375 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:18.145 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:18 smithi044 bash[22676]: cluster 2024-09-21T04:44:17.024334+0000 mgr.a (mgr.14388) 16875 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:18 smithi179 bash[23186]: cluster 2024-09-21T04:44:17.024334+0000 mgr.a (mgr.14388) 16875 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:18 smithi049 bash[23528]: cluster 2024-09-21T04:44:17.024334+0000 mgr.a (mgr.14388) 16875 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:19 smithi179 bash[23186]: audit 2024-09-21T04:44:17.704490+0000 mgr.a (mgr.14388) 16876 : audit [DBG] from='client.363864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:19.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:19 smithi049 bash[23528]: audit 2024-09-21T04:44:17.704490+0000 mgr.a (mgr.14388) 16876 : audit [DBG] from='client.363864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:19 smithi044 bash[22676]: audit 2024-09-21T04:44:17.704490+0000 mgr.a (mgr.14388) 16876 : audit [DBG] from='client.363864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:20 smithi179 bash[23186]: cluster 2024-09-21T04:44:19.025307+0000 mgr.a (mgr.14388) 16877 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:20 smithi049 bash[23528]: cluster 2024-09-21T04:44:19.025307+0000 mgr.a (mgr.14388) 16877 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:20 smithi044 bash[22676]: cluster 2024-09-21T04:44:19.025307+0000 mgr.a (mgr.14388) 16877 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:22 smithi179 bash[23186]: cluster 2024-09-21T04:44:21.027536+0000 mgr.a (mgr.14388) 16878 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:22.507 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:22 smithi049 bash[23528]: cluster 2024-09-21T04:44:21.027536+0000 mgr.a (mgr.14388) 16878 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:22 smithi044 bash[22676]: cluster 2024-09-21T04:44:21.027536+0000 mgr.a (mgr.14388) 16878 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:23.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:23.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:23.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:23.948 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:24 smithi049 bash[23528]: cluster 2024-09-21T04:44:23.028407+0000 mgr.a (mgr.14388) 16879 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:24.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:24 smithi179 bash[23186]: cluster 2024-09-21T04:44:23.028407+0000 mgr.a (mgr.14388) 16879 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:24 smithi044 bash[22676]: cluster 2024-09-21T04:44:23.028407+0000 mgr.a (mgr.14388) 16879 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:25.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:25 smithi179 bash[23186]: audit 2024-09-21T04:44:23.488129+0000 mgr.a (mgr.14388) 16880 : audit [DBG] from='client.363939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:25 smithi049 bash[23528]: audit 2024-09-21T04:44:23.488129+0000 mgr.a (mgr.14388) 16880 : audit [DBG] from='client.363939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:25 smithi044 bash[22676]: audit 2024-09-21T04:44:23.488129+0000 mgr.a (mgr.14388) 16880 : audit [DBG] from='client.363939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:26 smithi044 bash[22676]: cluster 2024-09-21T04:44:25.029433+0000 mgr.a (mgr.14388) 16881 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:26 smithi044 bash[22676]: audit 2024-09-21T04:44:25.308113+0000 mon.a (mon.0) 13448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:26 smithi044 bash[22676]: audit 2024-09-21T04:44:25.317199+0000 mon.a (mon.0) 13449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:26 smithi044 bash[22676]: audit 2024-09-21T04:44:25.327918+0000 mon.a (mon.0) 13450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:26 smithi179 bash[23186]: cluster 2024-09-21T04:44:25.029433+0000 mgr.a (mgr.14388) 16881 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:26 smithi179 bash[23186]: audit 2024-09-21T04:44:25.308113+0000 mon.a (mon.0) 13448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:26 smithi179 bash[23186]: audit 2024-09-21T04:44:25.317199+0000 mon.a (mon.0) 13449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:26 smithi179 bash[23186]: audit 2024-09-21T04:44:25.327918+0000 mon.a (mon.0) 13450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:26 smithi049 bash[23528]: cluster 2024-09-21T04:44:25.029433+0000 mgr.a (mgr.14388) 16881 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:26 smithi049 bash[23528]: audit 2024-09-21T04:44:25.308113+0000 mon.a (mon.0) 13448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:26 smithi049 bash[23528]: audit 2024-09-21T04:44:25.317199+0000 mon.a (mon.0) 13449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:26 smithi049 bash[23528]: audit 2024-09-21T04:44:25.327918+0000 mon.a (mon.0) 13450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:28 smithi044 bash[22676]: cluster 2024-09-21T04:44:27.031776+0000 mgr.a (mgr.14388) 16882 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:28 smithi179 bash[23186]: cluster 2024-09-21T04:44:27.031776+0000 mgr.a (mgr.14388) 16882 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:28 smithi049 bash[23528]: cluster 2024-09-21T04:44:27.031776+0000 mgr.a (mgr.14388) 16882 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:44:28.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:28.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:28.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:29.697 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:30 smithi044 bash[22676]: cluster 2024-09-21T04:44:29.032740+0000 mgr.a (mgr.14388) 16883 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:30 smithi044 bash[22676]: audit 2024-09-21T04:44:29.273282+0000 mgr.a (mgr.14388) 16884 : audit [DBG] from='client.364017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:30 smithi179 bash[23186]: cluster 2024-09-21T04:44:29.032740+0000 mgr.a (mgr.14388) 16883 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:30 smithi179 bash[23186]: audit 2024-09-21T04:44:29.273282+0000 mgr.a (mgr.14388) 16884 : audit [DBG] from='client.364017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:30 smithi049 bash[23528]: cluster 2024-09-21T04:44:29.032740+0000 mgr.a (mgr.14388) 16883 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:30 smithi049 bash[23528]: audit 2024-09-21T04:44:29.273282+0000 mgr.a (mgr.14388) 16884 : audit [DBG] from='client.364017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:31 smithi044 bash[22676]: cluster 2024-09-21T04:44:31.035250+0000 mgr.a (mgr.14388) 16885 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:31 smithi179 bash[23186]: cluster 2024-09-21T04:44:31.035250+0000 mgr.a (mgr.14388) 16885 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:31 smithi049 bash[23528]: cluster 2024-09-21T04:44:31.035250+0000 mgr.a (mgr.14388) 16885 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:34.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:34 smithi044 bash[22676]: cluster 2024-09-21T04:44:33.036039+0000 mgr.a (mgr.14388) 16886 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:34 smithi179 bash[23186]: cluster 2024-09-21T04:44:33.036039+0000 mgr.a (mgr.14388) 16886 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:34 smithi049 bash[23528]: cluster 2024-09-21T04:44:33.036039+0000 mgr.a (mgr.14388) 16886 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:34.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:35.493 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:35.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:35.493 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: audit 2024-09-21T04:44:35.029764+0000 mgr.a (mgr.14388) 16887 : audit [DBG] from='client.364095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: cluster 2024-09-21T04:44:35.050454+0000 mgr.a (mgr.14388) 16888 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: audit 2024-09-21T04:44:35.395920+0000 mon.a (mon.0) 13451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: audit 2024-09-21T04:44:35.401959+0000 mon.a (mon.0) 13452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: audit 2024-09-21T04:44:35.409034+0000 mon.a (mon.0) 13453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: audit 2024-09-21T04:44:35.930362+0000 mon.a (mon.0) 13454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: audit 2024-09-21T04:44:35.936377+0000 mon.a (mon.0) 13455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:36 smithi044 bash[22676]: audit 2024-09-21T04:44:35.942122+0000 mon.a (mon.0) 13456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: audit 2024-09-21T04:44:35.029764+0000 mgr.a (mgr.14388) 16887 : audit [DBG] from='client.364095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: cluster 2024-09-21T04:44:35.050454+0000 mgr.a (mgr.14388) 16888 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: audit 2024-09-21T04:44:35.395920+0000 mon.a (mon.0) 13451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: audit 2024-09-21T04:44:35.401959+0000 mon.a (mon.0) 13452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: audit 2024-09-21T04:44:35.409034+0000 mon.a (mon.0) 13453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: audit 2024-09-21T04:44:35.930362+0000 mon.a (mon.0) 13454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: audit 2024-09-21T04:44:35.936377+0000 mon.a (mon.0) 13455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:36 smithi179 bash[23186]: audit 2024-09-21T04:44:35.942122+0000 mon.a (mon.0) 13456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: audit 2024-09-21T04:44:35.029764+0000 mgr.a (mgr.14388) 16887 : audit [DBG] from='client.364095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: cluster 2024-09-21T04:44:35.050454+0000 mgr.a (mgr.14388) 16888 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: audit 2024-09-21T04:44:35.395920+0000 mon.a (mon.0) 13451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: audit 2024-09-21T04:44:35.401959+0000 mon.a (mon.0) 13452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: audit 2024-09-21T04:44:35.409034+0000 mon.a (mon.0) 13453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: audit 2024-09-21T04:44:35.930362+0000 mon.a (mon.0) 13454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: audit 2024-09-21T04:44:35.936377+0000 mon.a (mon.0) 13455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:36 smithi049 bash[23528]: audit 2024-09-21T04:44:35.942122+0000 mon.a (mon.0) 13456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:38 smithi044 bash[22676]: cluster 2024-09-21T04:44:37.053454+0000 mgr.a (mgr.14388) 16889 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:44:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:38 smithi179 bash[23186]: cluster 2024-09-21T04:44:37.053454+0000 mgr.a (mgr.14388) 16889 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:44:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:38 smithi049 bash[23528]: cluster 2024-09-21T04:44:37.053454+0000 mgr.a (mgr.14388) 16889 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T04:44:40.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:40.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:40.495 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:40.529 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:40 smithi049 bash[23528]: cluster 2024-09-21T04:44:39.054248+0000 mgr.a (mgr.14388) 16890 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1021 B/s rd, 0 op/s 2024-09-21T04:44:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:40 smithi044 bash[22676]: cluster 2024-09-21T04:44:39.054248+0000 mgr.a (mgr.14388) 16890 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1021 B/s rd, 0 op/s 2024-09-21T04:44:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:40 smithi179 bash[23186]: cluster 2024-09-21T04:44:39.054248+0000 mgr.a (mgr.14388) 16890 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1021 B/s rd, 0 op/s 2024-09-21T04:44:41.279 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:42.713 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:42 smithi049 bash[23528]: audit 2024-09-21T04:44:40.827710+0000 mgr.a (mgr.14388) 16891 : audit [DBG] from='client.364170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:42.714 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:42 smithi049 bash[23528]: cluster 2024-09-21T04:44:41.055608+0000 mgr.a (mgr.14388) 16892 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:42 smithi044 bash[22676]: audit 2024-09-21T04:44:40.827710+0000 mgr.a (mgr.14388) 16891 : audit [DBG] from='client.364170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:42.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:42 smithi044 bash[22676]: cluster 2024-09-21T04:44:41.055608+0000 mgr.a (mgr.14388) 16892 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:42 smithi179 bash[23186]: audit 2024-09-21T04:44:40.827710+0000 mgr.a (mgr.14388) 16891 : audit [DBG] from='client.364170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:42 smithi179 bash[23186]: cluster 2024-09-21T04:44:41.055608+0000 mgr.a (mgr.14388) 16892 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:44 smithi179 bash[23186]: cluster 2024-09-21T04:44:43.056521+0000 mgr.a (mgr.14388) 16893 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T04:44:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:44 smithi044 bash[22676]: cluster 2024-09-21T04:44:43.056521+0000 mgr.a (mgr.14388) 16893 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T04:44:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:44 smithi049 bash[23528]: cluster 2024-09-21T04:44:43.056521+0000 mgr.a (mgr.14388) 16893 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T04:44:46.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:46.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:46.282 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:46 smithi044 bash[22676]: cluster 2024-09-21T04:44:45.057340+0000 mgr.a (mgr.14388) 16894 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:46 smithi044 bash[22676]: audit 2024-09-21T04:44:45.526170+0000 mon.a (mon.0) 13457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:46 smithi044 bash[22676]: audit 2024-09-21T04:44:45.532601+0000 mon.a (mon.0) 13458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:46 smithi044 bash[22676]: audit 2024-09-21T04:44:45.540027+0000 mon.a (mon.0) 13459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:46 smithi179 bash[23186]: cluster 2024-09-21T04:44:45.057340+0000 mgr.a (mgr.14388) 16894 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:46 smithi179 bash[23186]: audit 2024-09-21T04:44:45.526170+0000 mon.a (mon.0) 13457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:46 smithi179 bash[23186]: audit 2024-09-21T04:44:45.532601+0000 mon.a (mon.0) 13458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:46 smithi179 bash[23186]: audit 2024-09-21T04:44:45.540027+0000 mon.a (mon.0) 13459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:46 smithi049 bash[23528]: cluster 2024-09-21T04:44:45.057340+0000 mgr.a (mgr.14388) 16894 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:44:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:46 smithi049 bash[23528]: audit 2024-09-21T04:44:45.526170+0000 mon.a (mon.0) 13457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:46 smithi049 bash[23528]: audit 2024-09-21T04:44:45.532601+0000 mon.a (mon.0) 13458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:46 smithi049 bash[23528]: audit 2024-09-21T04:44:45.540027+0000 mon.a (mon.0) 13459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:47.082 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:47.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:47.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:47.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:47.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:48 smithi044 bash[22676]: audit 2024-09-21T04:44:46.616335+0000 mgr.a (mgr.14388) 16895 : audit [DBG] from='client.364245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:48 smithi044 bash[22676]: cluster 2024-09-21T04:44:47.058989+0000 mgr.a (mgr.14388) 16896 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:48 smithi179 bash[23186]: audit 2024-09-21T04:44:46.616335+0000 mgr.a (mgr.14388) 16895 : audit [DBG] from='client.364245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:48 smithi179 bash[23186]: cluster 2024-09-21T04:44:47.058989+0000 mgr.a (mgr.14388) 16896 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:48 smithi049 bash[23528]: audit 2024-09-21T04:44:46.616335+0000 mgr.a (mgr.14388) 16895 : audit [DBG] from='client.364245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:48 smithi049 bash[23528]: cluster 2024-09-21T04:44:47.058989+0000 mgr.a (mgr.14388) 16896 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:49 smithi044 bash[22676]: cluster 2024-09-21T04:44:49.059773+0000 mgr.a (mgr.14388) 16897 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:44:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:49 smithi179 bash[23186]: cluster 2024-09-21T04:44:49.059773+0000 mgr.a (mgr.14388) 16897 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:44:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:49 smithi049 bash[23528]: cluster 2024-09-21T04:44:49.059773+0000 mgr.a (mgr.14388) 16897 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:44:52.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:52.084 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:52.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:52 smithi044 bash[22676]: cluster 2024-09-21T04:44:51.061759+0000 mgr.a (mgr.14388) 16898 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:52 smithi179 bash[23186]: cluster 2024-09-21T04:44:51.061759+0000 mgr.a (mgr.14388) 16898 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:52 smithi049 bash[23528]: cluster 2024-09-21T04:44:51.061759+0000 mgr.a (mgr.14388) 16898 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:52.884 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:52.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:52.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:52.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:52.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:54.348 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:54 smithi044 bash[22676]: audit 2024-09-21T04:44:52.426003+0000 mgr.a (mgr.14388) 16899 : audit [DBG] from='client.364323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:54.349 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:54 smithi044 bash[22676]: cluster 2024-09-21T04:44:53.062430+0000 mgr.a (mgr.14388) 16900 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:54 smithi179 bash[23186]: audit 2024-09-21T04:44:52.426003+0000 mgr.a (mgr.14388) 16899 : audit [DBG] from='client.364323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:54 smithi179 bash[23186]: cluster 2024-09-21T04:44:53.062430+0000 mgr.a (mgr.14388) 16900 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:54 smithi049 bash[23528]: audit 2024-09-21T04:44:52.426003+0000 mgr.a (mgr.14388) 16899 : audit [DBG] from='client.364323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:54 smithi049 bash[23528]: cluster 2024-09-21T04:44:53.062430+0000 mgr.a (mgr.14388) 16900 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:56 smithi044 bash[22676]: cluster 2024-09-21T04:44:55.063205+0000 mgr.a (mgr.14388) 16901 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:56 smithi044 bash[22676]: audit 2024-09-21T04:44:55.591847+0000 mon.a (mon.0) 13460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:56 smithi044 bash[22676]: audit 2024-09-21T04:44:55.599055+0000 mon.a (mon.0) 13461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:56 smithi044 bash[22676]: audit 2024-09-21T04:44:55.607211+0000 mon.a (mon.0) 13462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:56 smithi044 bash[22676]: audit 2024-09-21T04:44:56.119272+0000 mon.a (mon.0) 13463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:56 smithi179 bash[23186]: cluster 2024-09-21T04:44:55.063205+0000 mgr.a (mgr.14388) 16901 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:56 smithi179 bash[23186]: audit 2024-09-21T04:44:55.591847+0000 mon.a (mon.0) 13460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:56 smithi179 bash[23186]: audit 2024-09-21T04:44:55.599055+0000 mon.a (mon.0) 13461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:56 smithi179 bash[23186]: audit 2024-09-21T04:44:55.607211+0000 mon.a (mon.0) 13462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:56 smithi179 bash[23186]: audit 2024-09-21T04:44:56.119272+0000 mon.a (mon.0) 13463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:56 smithi049 bash[23528]: cluster 2024-09-21T04:44:55.063205+0000 mgr.a (mgr.14388) 16901 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:44:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:56 smithi049 bash[23528]: audit 2024-09-21T04:44:55.591847+0000 mon.a (mon.0) 13460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:56 smithi049 bash[23528]: audit 2024-09-21T04:44:55.599055+0000 mon.a (mon.0) 13461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:56 smithi049 bash[23528]: audit 2024-09-21T04:44:55.607211+0000 mon.a (mon.0) 13462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:56 smithi049 bash[23528]: audit 2024-09-21T04:44:56.119272+0000 mon.a (mon.0) 13463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:57 smithi044 bash[22676]: audit 2024-09-21T04:44:56.125016+0000 mon.a (mon.0) 13464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:57 smithi044 bash[22676]: audit 2024-09-21T04:44:56.135757+0000 mon.a (mon.0) 13465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:57 smithi179 bash[23186]: audit 2024-09-21T04:44:56.125016+0000 mon.a (mon.0) 13464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:57 smithi179 bash[23186]: audit 2024-09-21T04:44:56.135757+0000 mon.a (mon.0) 13465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:57 smithi049 bash[23528]: audit 2024-09-21T04:44:56.125016+0000 mon.a (mon.0) 13464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:57 smithi049 bash[23528]: audit 2024-09-21T04:44:56.135757+0000 mon.a (mon.0) 13465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:44:57.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:44:57.886 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:44:57.886 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:44:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:58 smithi044 bash[22676]: cluster 2024-09-21T04:44:57.065483+0000 mgr.a (mgr.14388) 16902 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:58.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:58 smithi049 bash[23528]: cluster 2024-09-21T04:44:57.065483+0000 mgr.a (mgr.14388) 16902 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:58.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:58 smithi179 bash[23186]: cluster 2024-09-21T04:44:57.065483+0000 mgr.a (mgr.14388) 16902 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:44:58.681 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:44:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:44:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:44:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:44:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:44:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:44:59 smithi044 bash[22676]: audit 2024-09-21T04:44:58.224195+0000 mgr.a (mgr.14388) 16903 : audit [DBG] from='client.364398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:44:59 smithi179 bash[23186]: audit 2024-09-21T04:44:58.224195+0000 mgr.a (mgr.14388) 16903 : audit [DBG] from='client.364398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:44:59.528 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:44:59 smithi049 bash[23528]: audit 2024-09-21T04:44:58.224195+0000 mgr.a (mgr.14388) 16903 : audit [DBG] from='client.364398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:00 smithi044 bash[22676]: cluster 2024-09-21T04:44:59.066489+0000 mgr.a (mgr.14388) 16904 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:00 smithi179 bash[23186]: cluster 2024-09-21T04:44:59.066489+0000 mgr.a (mgr.14388) 16904 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:00 smithi049 bash[23528]: cluster 2024-09-21T04:44:59.066489+0000 mgr.a (mgr.14388) 16904 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:02 smithi044 bash[22676]: cluster 2024-09-21T04:45:01.068877+0000 mgr.a (mgr.14388) 16905 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:02 smithi179 bash[23186]: cluster 2024-09-21T04:45:01.068877+0000 mgr.a (mgr.14388) 16905 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:02 smithi049 bash[23528]: cluster 2024-09-21T04:45:01.068877+0000 mgr.a (mgr.14388) 16905 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:03.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:03.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:04 smithi179 bash[23186]: cluster 2024-09-21T04:45:03.069860+0000 mgr.a (mgr.14388) 16906 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:04.475 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:04.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:04.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:04.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:04.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:04 smithi044 bash[22676]: cluster 2024-09-21T04:45:03.069860+0000 mgr.a (mgr.14388) 16906 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:04 smithi049 bash[23528]: cluster 2024-09-21T04:45:03.069860+0000 mgr.a (mgr.14388) 16906 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:05 smithi044 bash[22676]: audit 2024-09-21T04:45:04.013445+0000 mgr.a (mgr.14388) 16907 : audit [DBG] from='client.364476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:05 smithi179 bash[23186]: audit 2024-09-21T04:45:04.013445+0000 mgr.a (mgr.14388) 16907 : audit [DBG] from='client.364476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:05 smithi049 bash[23528]: audit 2024-09-21T04:45:04.013445+0000 mgr.a (mgr.14388) 16907 : audit [DBG] from='client.364476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:06 smithi044 bash[22676]: cluster 2024-09-21T04:45:05.070860+0000 mgr.a (mgr.14388) 16908 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:06 smithi044 bash[22676]: audit 2024-09-21T04:45:05.752752+0000 mon.a (mon.0) 13466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:06 smithi044 bash[22676]: audit 2024-09-21T04:45:05.761684+0000 mon.a (mon.0) 13467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:06 smithi044 bash[22676]: audit 2024-09-21T04:45:05.772123+0000 mon.a (mon.0) 13468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:06 smithi049 bash[23528]: cluster 2024-09-21T04:45:05.070860+0000 mgr.a (mgr.14388) 16908 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:06 smithi049 bash[23528]: audit 2024-09-21T04:45:05.752752+0000 mon.a (mon.0) 13466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:06 smithi049 bash[23528]: audit 2024-09-21T04:45:05.761684+0000 mon.a (mon.0) 13467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:06 smithi049 bash[23528]: audit 2024-09-21T04:45:05.772123+0000 mon.a (mon.0) 13468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.636 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:06 smithi179 bash[23186]: cluster 2024-09-21T04:45:05.070860+0000 mgr.a (mgr.14388) 16908 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:06.636 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:06 smithi179 bash[23186]: audit 2024-09-21T04:45:05.752752+0000 mon.a (mon.0) 13466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.636 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:06 smithi179 bash[23186]: audit 2024-09-21T04:45:05.761684+0000 mon.a (mon.0) 13467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:06.636 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:06 smithi179 bash[23186]: audit 2024-09-21T04:45:05.772123+0000 mon.a (mon.0) 13468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:08 smithi044 bash[22676]: cluster 2024-09-21T04:45:07.073125+0000 mgr.a (mgr.14388) 16909 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:08 smithi179 bash[23186]: cluster 2024-09-21T04:45:07.073125+0000 mgr.a (mgr.14388) 16909 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:08 smithi049 bash[23528]: cluster 2024-09-21T04:45:07.073125+0000 mgr.a (mgr.14388) 16909 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:09.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:09.477 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:09.477 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:10.273 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:10 smithi044 bash[22676]: cluster 2024-09-21T04:45:09.073882+0000 mgr.a (mgr.14388) 16910 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:10 smithi179 bash[23186]: cluster 2024-09-21T04:45:09.073882+0000 mgr.a (mgr.14388) 16910 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:10 smithi049 bash[23528]: cluster 2024-09-21T04:45:09.073882+0000 mgr.a (mgr.14388) 16910 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:11 smithi044 bash[22676]: audit 2024-09-21T04:45:09.809388+0000 mgr.a (mgr.14388) 16911 : audit [DBG] from='client.364554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:11 smithi179 bash[23186]: audit 2024-09-21T04:45:09.809388+0000 mgr.a (mgr.14388) 16911 : audit [DBG] from='client.364554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:11 smithi049 bash[23528]: audit 2024-09-21T04:45:09.809388+0000 mgr.a (mgr.14388) 16911 : audit [DBG] from='client.364554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22676]: cluster 2024-09-21T04:45:11.076309+0000 mgr.a (mgr.14388) 16912 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:45:12.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22676]: audit 2024-09-21T04:45:12.032827+0000 mon.a (mon.0) 13469 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:45:12.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22676]: audit 2024-09-21T04:45:12.040003+0000 mon.a (mon.0) 13470 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:45:12.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22676]: audit 2024-09-21T04:45:12.041906+0000 mon.a (mon.0) 13471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:45:12.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22676]: audit 2024-09-21T04:45:12.054616+0000 mon.a (mon.0) 13472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:12.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22676]: audit 2024-09-21T04:45:12.060985+0000 mon.a (mon.0) 13473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:45:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:12 smithi179 bash[23186]: cluster 2024-09-21T04:45:11.076309+0000 mgr.a (mgr.14388) 16912 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:45:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:12 smithi179 bash[23186]: audit 2024-09-21T04:45:12.032827+0000 mon.a (mon.0) 13469 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:45:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:12 smithi179 bash[23186]: audit 2024-09-21T04:45:12.040003+0000 mon.a (mon.0) 13470 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:45:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:12 smithi179 bash[23186]: audit 2024-09-21T04:45:12.041906+0000 mon.a (mon.0) 13471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:45:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:12 smithi179 bash[23186]: audit 2024-09-21T04:45:12.054616+0000 mon.a (mon.0) 13472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:12.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:12 smithi179 bash[23186]: audit 2024-09-21T04:45:12.060985+0000 mon.a (mon.0) 13473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:45:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:12 smithi049 bash[23528]: cluster 2024-09-21T04:45:11.076309+0000 mgr.a (mgr.14388) 16912 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:12 smithi049 bash[23528]: audit 2024-09-21T04:45:12.032827+0000 mon.a (mon.0) 13469 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:12 smithi049 bash[23528]: audit 2024-09-21T04:45:12.040003+0000 mon.a (mon.0) 13470 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:12 smithi049 bash[23528]: audit 2024-09-21T04:45:12.041906+0000 mon.a (mon.0) 13471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:12 smithi049 bash[23528]: audit 2024-09-21T04:45:12.054616+0000 mon.a (mon.0) 13472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:12 smithi049 bash[23528]: audit 2024-09-21T04:45:12.060985+0000 mon.a (mon.0) 13473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:45:13.210 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22930]: debug 2024-09-21T04:45:12.875+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:45:13.210 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:45:12 smithi044 bash[22930]: debug 2024-09-21T04:45:12.879+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:45:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:13 smithi044 bash[22676]: audit 2024-09-21T04:45:12.063467+0000 mgr.a (mgr.14388) 16913 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:45:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:13 smithi179 bash[23186]: audit 2024-09-21T04:45:12.063467+0000 mgr.a (mgr.14388) 16913 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:45:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:13 smithi049 bash[23528]: audit 2024-09-21T04:45:12.063467+0000 mgr.a (mgr.14388) 16913 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:45:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:14 smithi044 bash[22676]: audit 2024-09-21T04:45:12.880626+0000 mgr.a (mgr.14388) 16914 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:45:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:14 smithi044 bash[22676]: cephadm 2024-09-21T04:45:12.882535+0000 mgr.a (mgr.14388) 16915 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:45:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:14 smithi044 bash[22676]: cluster 2024-09-21T04:45:13.077340+0000 mgr.a (mgr.14388) 16916 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:45:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:14 smithi179 bash[23186]: audit 2024-09-21T04:45:12.880626+0000 mgr.a (mgr.14388) 16914 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:45:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:14 smithi179 bash[23186]: cephadm 2024-09-21T04:45:12.882535+0000 mgr.a (mgr.14388) 16915 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:45:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:14 smithi179 bash[23186]: cluster 2024-09-21T04:45:13.077340+0000 mgr.a (mgr.14388) 16916 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:45:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:14 smithi049 bash[23528]: audit 2024-09-21T04:45:12.880626+0000 mgr.a (mgr.14388) 16914 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:45:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:14 smithi049 bash[23528]: cephadm 2024-09-21T04:45:12.882535+0000 mgr.a (mgr.14388) 16915 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:45:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:14 smithi049 bash[23528]: cluster 2024-09-21T04:45:13.077340+0000 mgr.a (mgr.14388) 16916 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:45:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:15.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:15.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:16.053 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:16.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:16.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:16.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:16.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:16 smithi044 bash[22676]: cluster 2024-09-21T04:45:15.078170+0000 mgr.a (mgr.14388) 16917 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:45:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:16 smithi044 bash[22676]: audit 2024-09-21T04:45:15.760854+0000 mon.a (mon.0) 13474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:16 smithi044 bash[22676]: audit 2024-09-21T04:45:15.767099+0000 mon.a (mon.0) 13475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:16 smithi044 bash[22676]: audit 2024-09-21T04:45:15.772738+0000 mon.a (mon.0) 13476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:16 smithi179 bash[23186]: cluster 2024-09-21T04:45:15.078170+0000 mgr.a (mgr.14388) 16917 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:45:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:16 smithi179 bash[23186]: audit 2024-09-21T04:45:15.760854+0000 mon.a (mon.0) 13474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:16 smithi179 bash[23186]: audit 2024-09-21T04:45:15.767099+0000 mon.a (mon.0) 13475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:16 smithi179 bash[23186]: audit 2024-09-21T04:45:15.772738+0000 mon.a (mon.0) 13476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:16 smithi049 bash[23528]: cluster 2024-09-21T04:45:15.078170+0000 mgr.a (mgr.14388) 16917 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:45:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:16 smithi049 bash[23528]: audit 2024-09-21T04:45:15.760854+0000 mon.a (mon.0) 13474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:16 smithi049 bash[23528]: audit 2024-09-21T04:45:15.767099+0000 mon.a (mon.0) 13475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:16 smithi049 bash[23528]: audit 2024-09-21T04:45:15.772738+0000 mon.a (mon.0) 13476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:17 smithi049 bash[23528]: audit 2024-09-21T04:45:15.602762+0000 mgr.a (mgr.14388) 16918 : audit [DBG] from='client.364737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:17 smithi049 bash[23528]: audit 2024-09-21T04:45:16.335539+0000 mon.a (mon.0) 13477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:17 smithi049 bash[23528]: audit 2024-09-21T04:45:16.341477+0000 mon.a (mon.0) 13478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:17 smithi049 bash[23528]: audit 2024-09-21T04:45:16.348308+0000 mon.a (mon.0) 13479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:17 smithi044 bash[22676]: audit 2024-09-21T04:45:15.602762+0000 mgr.a (mgr.14388) 16918 : audit [DBG] from='client.364737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:17 smithi044 bash[22676]: audit 2024-09-21T04:45:16.335539+0000 mon.a (mon.0) 13477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:17 smithi044 bash[22676]: audit 2024-09-21T04:45:16.341477+0000 mon.a (mon.0) 13478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:17 smithi044 bash[22676]: audit 2024-09-21T04:45:16.348308+0000 mon.a (mon.0) 13479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:17 smithi179 bash[23186]: audit 2024-09-21T04:45:15.602762+0000 mgr.a (mgr.14388) 16918 : audit [DBG] from='client.364737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:17 smithi179 bash[23186]: audit 2024-09-21T04:45:16.335539+0000 mon.a (mon.0) 13477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:17 smithi179 bash[23186]: audit 2024-09-21T04:45:16.341477+0000 mon.a (mon.0) 13478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:17.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:17 smithi179 bash[23186]: audit 2024-09-21T04:45:16.348308+0000 mon.a (mon.0) 13479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:18 smithi044 bash[22676]: cluster 2024-09-21T04:45:17.080291+0000 mgr.a (mgr.14388) 16919 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:18 smithi179 bash[23186]: cluster 2024-09-21T04:45:17.080291+0000 mgr.a (mgr.14388) 16919 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:18 smithi049 bash[23528]: cluster 2024-09-21T04:45:17.080291+0000 mgr.a (mgr.14388) 16919 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:20 smithi049 bash[23528]: cluster 2024-09-21T04:45:19.081224+0000 mgr.a (mgr.14388) 16920 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:45:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:20 smithi044 bash[22676]: cluster 2024-09-21T04:45:19.081224+0000 mgr.a (mgr.14388) 16920 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:45:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:20 smithi179 bash[23186]: cluster 2024-09-21T04:45:19.081224+0000 mgr.a (mgr.14388) 16920 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:45:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:21.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:21.850 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:21.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:21.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:21.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:21.851 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:22 smithi044 bash[22676]: cluster 2024-09-21T04:45:21.082719+0000 mgr.a (mgr.14388) 16921 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:22.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:22 smithi044 bash[22676]: audit 2024-09-21T04:45:21.394709+0000 mgr.a (mgr.14388) 16922 : audit [DBG] from='client.364815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:22 smithi179 bash[23186]: cluster 2024-09-21T04:45:21.082719+0000 mgr.a (mgr.14388) 16921 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:22 smithi179 bash[23186]: audit 2024-09-21T04:45:21.394709+0000 mgr.a (mgr.14388) 16922 : audit [DBG] from='client.364815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:22 smithi049 bash[23528]: cluster 2024-09-21T04:45:21.082719+0000 mgr.a (mgr.14388) 16921 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:22 smithi049 bash[23528]: audit 2024-09-21T04:45:21.394709+0000 mgr.a (mgr.14388) 16922 : audit [DBG] from='client.364815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:24 smithi049 bash[23528]: cluster 2024-09-21T04:45:23.083608+0000 mgr.a (mgr.14388) 16923 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:45:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:24 smithi044 bash[22676]: cluster 2024-09-21T04:45:23.083608+0000 mgr.a (mgr.14388) 16923 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:45:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:24 smithi179 bash[23186]: cluster 2024-09-21T04:45:23.083608+0000 mgr.a (mgr.14388) 16923 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:45:26.680 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:26 smithi179 bash[23186]: cluster 2024-09-21T04:45:25.085835+0000 mgr.a (mgr.14388) 16924 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:26.680 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:26 smithi179 bash[23186]: audit 2024-09-21T04:45:25.992934+0000 mon.a (mon.0) 13480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.680 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:26 smithi179 bash[23186]: audit 2024-09-21T04:45:26.002197+0000 mon.a (mon.0) 13481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.681 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:26 smithi179 bash[23186]: audit 2024-09-21T04:45:26.012758+0000 mon.a (mon.0) 13482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:26 smithi044 bash[22676]: cluster 2024-09-21T04:45:25.085835+0000 mgr.a (mgr.14388) 16924 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:26 smithi044 bash[22676]: audit 2024-09-21T04:45:25.992934+0000 mon.a (mon.0) 13480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:26 smithi044 bash[22676]: audit 2024-09-21T04:45:26.002197+0000 mon.a (mon.0) 13481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:26 smithi044 bash[22676]: audit 2024-09-21T04:45:26.012758+0000 mon.a (mon.0) 13482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:26 smithi049 bash[23528]: cluster 2024-09-21T04:45:25.085835+0000 mgr.a (mgr.14388) 16924 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:26 smithi049 bash[23528]: audit 2024-09-21T04:45:25.992934+0000 mon.a (mon.0) 13480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:26 smithi049 bash[23528]: audit 2024-09-21T04:45:26.002197+0000 mon.a (mon.0) 13481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:26 smithi049 bash[23528]: audit 2024-09-21T04:45:26.012758+0000 mon.a (mon.0) 13482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:26.852 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:27.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:27.624 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:28 smithi044 bash[22676]: cluster 2024-09-21T04:45:27.086376+0000 mgr.a (mgr.14388) 16925 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:28 smithi044 bash[22676]: audit 2024-09-21T04:45:27.186801+0000 mgr.a (mgr.14388) 16926 : audit [DBG] from='client.364890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:28 smithi179 bash[23186]: cluster 2024-09-21T04:45:27.086376+0000 mgr.a (mgr.14388) 16925 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:28 smithi179 bash[23186]: audit 2024-09-21T04:45:27.186801+0000 mgr.a (mgr.14388) 16926 : audit [DBG] from='client.364890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:28 smithi049 bash[23528]: cluster 2024-09-21T04:45:27.086376+0000 mgr.a (mgr.14388) 16925 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:45:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:28 smithi049 bash[23528]: audit 2024-09-21T04:45:27.186801+0000 mgr.a (mgr.14388) 16926 : audit [DBG] from='client.364890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:30 smithi044 bash[22676]: cluster 2024-09-21T04:45:29.087249+0000 mgr.a (mgr.14388) 16927 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:30 smithi179 bash[23186]: cluster 2024-09-21T04:45:29.087249+0000 mgr.a (mgr.14388) 16927 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:30 smithi049 bash[23528]: cluster 2024-09-21T04:45:29.087249+0000 mgr.a (mgr.14388) 16927 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:32.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:32.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:32.626 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:32 smithi044 bash[22676]: cluster 2024-09-21T04:45:31.089550+0000 mgr.a (mgr.14388) 16928 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:32 smithi179 bash[23186]: cluster 2024-09-21T04:45:31.089550+0000 mgr.a (mgr.14388) 16928 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:32 smithi049 bash[23528]: cluster 2024-09-21T04:45:31.089550+0000 mgr.a (mgr.14388) 16928 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:33.422 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:33.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:33.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:33.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:33.423 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:34.707 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:34 smithi044 bash[22676]: audit 2024-09-21T04:45:32.958335+0000 mgr.a (mgr.14388) 16929 : audit [DBG] from='client.364965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:34.707 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:34 smithi044 bash[22676]: cluster 2024-09-21T04:45:33.090123+0000 mgr.a (mgr.14388) 16930 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:34 smithi179 bash[23186]: audit 2024-09-21T04:45:32.958335+0000 mgr.a (mgr.14388) 16929 : audit [DBG] from='client.364965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:34 smithi179 bash[23186]: cluster 2024-09-21T04:45:33.090123+0000 mgr.a (mgr.14388) 16930 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:34 smithi049 bash[23528]: audit 2024-09-21T04:45:32.958335+0000 mgr.a (mgr.14388) 16929 : audit [DBG] from='client.364965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:34 smithi049 bash[23528]: cluster 2024-09-21T04:45:33.090123+0000 mgr.a (mgr.14388) 16930 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:36 smithi044 bash[22676]: cluster 2024-09-21T04:45:35.092411+0000 mgr.a (mgr.14388) 16931 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:36 smithi044 bash[22676]: audit 2024-09-21T04:45:35.960570+0000 mon.a (mon.0) 13483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:36 smithi044 bash[22676]: audit 2024-09-21T04:45:35.966035+0000 mon.a (mon.0) 13484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:36 smithi044 bash[22676]: audit 2024-09-21T04:45:35.975178+0000 mon.a (mon.0) 13485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:36 smithi179 bash[23186]: cluster 2024-09-21T04:45:35.092411+0000 mgr.a (mgr.14388) 16931 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:36 smithi179 bash[23186]: audit 2024-09-21T04:45:35.960570+0000 mon.a (mon.0) 13483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:36 smithi179 bash[23186]: audit 2024-09-21T04:45:35.966035+0000 mon.a (mon.0) 13484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:36 smithi179 bash[23186]: audit 2024-09-21T04:45:35.975178+0000 mon.a (mon.0) 13485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:36 smithi049 bash[23528]: cluster 2024-09-21T04:45:35.092411+0000 mgr.a (mgr.14388) 16931 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:36 smithi049 bash[23528]: audit 2024-09-21T04:45:35.960570+0000 mon.a (mon.0) 13483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:36 smithi049 bash[23528]: audit 2024-09-21T04:45:35.966035+0000 mon.a (mon.0) 13484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:36 smithi049 bash[23528]: audit 2024-09-21T04:45:35.975178+0000 mon.a (mon.0) 13485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:37.775 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:37 smithi049 bash[23528]: audit 2024-09-21T04:45:36.520009+0000 mon.a (mon.0) 13486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:37.775 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:37 smithi049 bash[23528]: audit 2024-09-21T04:45:36.526412+0000 mon.a (mon.0) 13487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:37.775 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:37 smithi049 bash[23528]: audit 2024-09-21T04:45:36.532827+0000 mon.a (mon.0) 13488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:37.775 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:37 smithi049 bash[23528]: cluster 2024-09-21T04:45:37.093292+0000 mgr.a (mgr.14388) 16932 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:37 smithi044 bash[22676]: audit 2024-09-21T04:45:36.520009+0000 mon.a (mon.0) 13486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:37 smithi044 bash[22676]: audit 2024-09-21T04:45:36.526412+0000 mon.a (mon.0) 13487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:37 smithi044 bash[22676]: audit 2024-09-21T04:45:36.532827+0000 mon.a (mon.0) 13488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:37 smithi044 bash[22676]: cluster 2024-09-21T04:45:37.093292+0000 mgr.a (mgr.14388) 16932 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:37 smithi179 bash[23186]: audit 2024-09-21T04:45:36.520009+0000 mon.a (mon.0) 13486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:37 smithi179 bash[23186]: audit 2024-09-21T04:45:36.526412+0000 mon.a (mon.0) 13487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:37 smithi179 bash[23186]: audit 2024-09-21T04:45:36.532827+0000 mon.a (mon.0) 13488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:37 smithi179 bash[23186]: cluster 2024-09-21T04:45:37.093292+0000 mgr.a (mgr.14388) 16932 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:38.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:38.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:38.425 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:39.212 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:39.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:39.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:39.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:39.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:40 smithi044 bash[22676]: audit 2024-09-21T04:45:38.756575+0000 mgr.a (mgr.14388) 16933 : audit [DBG] from='client.365043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:40 smithi044 bash[22676]: cluster 2024-09-21T04:45:39.093829+0000 mgr.a (mgr.14388) 16934 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:40 smithi179 bash[23186]: audit 2024-09-21T04:45:38.756575+0000 mgr.a (mgr.14388) 16933 : audit [DBG] from='client.365043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:40 smithi179 bash[23186]: cluster 2024-09-21T04:45:39.093829+0000 mgr.a (mgr.14388) 16934 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:40 smithi049 bash[23528]: audit 2024-09-21T04:45:38.756575+0000 mgr.a (mgr.14388) 16933 : audit [DBG] from='client.365043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:40.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:40 smithi049 bash[23528]: cluster 2024-09-21T04:45:39.093829+0000 mgr.a (mgr.14388) 16934 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:42.227 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:42 smithi049 bash[23528]: cluster 2024-09-21T04:45:41.096155+0000 mgr.a (mgr.14388) 16935 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:42 smithi044 bash[22676]: cluster 2024-09-21T04:45:41.096155+0000 mgr.a (mgr.14388) 16935 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:42 smithi179 bash[23186]: cluster 2024-09-21T04:45:41.096155+0000 mgr.a (mgr.14388) 16935 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:45:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:44.439 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:44 smithi049 bash[23528]: cluster 2024-09-21T04:45:43.096989+0000 mgr.a (mgr.14388) 16936 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:44 smithi044 bash[22676]: cluster 2024-09-21T04:45:43.096989+0000 mgr.a (mgr.14388) 16936 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:44 smithi179 bash[23186]: cluster 2024-09-21T04:45:43.096989+0000 mgr.a (mgr.14388) 16936 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:44.986 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:44.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:44.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:44.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:44.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:46 smithi044 bash[22676]: audit 2024-09-21T04:45:44.543789+0000 mgr.a (mgr.14388) 16937 : audit [DBG] from='client.365118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:46 smithi044 bash[22676]: cluster 2024-09-21T04:45:45.099409+0000 mgr.a (mgr.14388) 16938 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:45:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:46 smithi179 bash[23186]: audit 2024-09-21T04:45:44.543789+0000 mgr.a (mgr.14388) 16937 : audit [DBG] from='client.365118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:46 smithi179 bash[23186]: cluster 2024-09-21T04:45:45.099409+0000 mgr.a (mgr.14388) 16938 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:45:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:46 smithi049 bash[23528]: audit 2024-09-21T04:45:44.543789+0000 mgr.a (mgr.14388) 16937 : audit [DBG] from='client.365118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:46 smithi049 bash[23528]: cluster 2024-09-21T04:45:45.099409+0000 mgr.a (mgr.14388) 16938 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:45:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:47 smithi044 bash[22676]: audit 2024-09-21T04:45:46.196823+0000 mon.a (mon.0) 13489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:47 smithi044 bash[22676]: audit 2024-09-21T04:45:46.205658+0000 mon.a (mon.0) 13490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:47 smithi044 bash[22676]: audit 2024-09-21T04:45:46.216167+0000 mon.a (mon.0) 13491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:47 smithi179 bash[23186]: audit 2024-09-21T04:45:46.196823+0000 mon.a (mon.0) 13489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:47 smithi179 bash[23186]: audit 2024-09-21T04:45:46.205658+0000 mon.a (mon.0) 13490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:47 smithi179 bash[23186]: audit 2024-09-21T04:45:46.216167+0000 mon.a (mon.0) 13491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:47 smithi049 bash[23528]: audit 2024-09-21T04:45:46.196823+0000 mon.a (mon.0) 13489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:47 smithi049 bash[23528]: audit 2024-09-21T04:45:46.205658+0000 mon.a (mon.0) 13490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:47 smithi049 bash[23528]: audit 2024-09-21T04:45:46.216167+0000 mon.a (mon.0) 13491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:48 smithi044 bash[22676]: cluster 2024-09-21T04:45:47.100235+0000 mgr.a (mgr.14388) 16939 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:45:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:48 smithi179 bash[23186]: cluster 2024-09-21T04:45:47.100235+0000 mgr.a (mgr.14388) 16939 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:45:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:48 smithi049 bash[23528]: cluster 2024-09-21T04:45:47.100235+0000 mgr.a (mgr.14388) 16939 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:45:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:49.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:49.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:50 smithi044 bash[22676]: cluster 2024-09-21T04:45:49.101021+0000 mgr.a (mgr.14388) 16940 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:45:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:50 smithi179 bash[23186]: cluster 2024-09-21T04:45:49.101021+0000 mgr.a (mgr.14388) 16940 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:45:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:50 smithi049 bash[23528]: cluster 2024-09-21T04:45:49.101021+0000 mgr.a (mgr.14388) 16940 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:45:50.769 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:50.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:50.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:51 smithi044 bash[22676]: audit 2024-09-21T04:45:50.321637+0000 mgr.a (mgr.14388) 16941 : audit [DBG] from='client.365193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:51 smithi179 bash[23186]: audit 2024-09-21T04:45:50.321637+0000 mgr.a (mgr.14388) 16941 : audit [DBG] from='client.365193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:51 smithi049 bash[23528]: audit 2024-09-21T04:45:50.321637+0000 mgr.a (mgr.14388) 16941 : audit [DBG] from='client.365193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:52 smithi044 bash[22676]: cluster 2024-09-21T04:45:51.103965+0000 mgr.a (mgr.14388) 16942 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:52 smithi179 bash[23186]: cluster 2024-09-21T04:45:51.103965+0000 mgr.a (mgr.14388) 16942 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:52 smithi049 bash[23528]: cluster 2024-09-21T04:45:51.103965+0000 mgr.a (mgr.14388) 16942 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:45:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:54 smithi044 bash[22676]: cluster 2024-09-21T04:45:53.104756+0000 mgr.a (mgr.14388) 16943 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:45:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:54 smithi179 bash[23186]: cluster 2024-09-21T04:45:53.104756+0000 mgr.a (mgr.14388) 16943 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:45:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:54 smithi049 bash[23528]: cluster 2024-09-21T04:45:53.104756+0000 mgr.a (mgr.14388) 16943 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:45:55.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:45:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:45:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:45:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:56 smithi179 bash[23186]: cluster 2024-09-21T04:45:55.105913+0000 mgr.a (mgr.14388) 16944 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:45:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:56 smithi179 bash[23186]: audit 2024-09-21T04:45:56.153576+0000 mon.a (mon.0) 13492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:56 smithi179 bash[23186]: audit 2024-09-21T04:45:56.159243+0000 mon.a (mon.0) 13493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:56 smithi179 bash[23186]: audit 2024-09-21T04:45:56.167897+0000 mon.a (mon.0) 13494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:56 smithi049 bash[23528]: cluster 2024-09-21T04:45:55.105913+0000 mgr.a (mgr.14388) 16944 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:45:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:56 smithi049 bash[23528]: audit 2024-09-21T04:45:56.153576+0000 mon.a (mon.0) 13492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:56 smithi049 bash[23528]: audit 2024-09-21T04:45:56.159243+0000 mon.a (mon.0) 13493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:56 smithi049 bash[23528]: audit 2024-09-21T04:45:56.167897+0000 mon.a (mon.0) 13494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.558 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:45:56.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:45:56.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:45:56.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:45:56.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:45:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:56 smithi044 bash[22676]: cluster 2024-09-21T04:45:55.105913+0000 mgr.a (mgr.14388) 16944 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:45:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:56 smithi044 bash[22676]: audit 2024-09-21T04:45:56.153576+0000 mon.a (mon.0) 13492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:56 smithi044 bash[22676]: audit 2024-09-21T04:45:56.159243+0000 mon.a (mon.0) 13493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:56 smithi044 bash[22676]: audit 2024-09-21T04:45:56.167897+0000 mon.a (mon.0) 13494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:57 smithi179 bash[23186]: audit 2024-09-21T04:45:56.109005+0000 mgr.a (mgr.14388) 16945 : audit [DBG] from='client.365265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:57 smithi179 bash[23186]: audit 2024-09-21T04:45:56.745359+0000 mon.a (mon.0) 13495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:57 smithi179 bash[23186]: audit 2024-09-21T04:45:56.754808+0000 mon.a (mon.0) 13496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:57 smithi179 bash[23186]: audit 2024-09-21T04:45:56.765548+0000 mon.a (mon.0) 13497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:57 smithi044 bash[22676]: audit 2024-09-21T04:45:56.109005+0000 mgr.a (mgr.14388) 16945 : audit [DBG] from='client.365265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:57.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:57 smithi044 bash[22676]: audit 2024-09-21T04:45:56.745359+0000 mon.a (mon.0) 13495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:57 smithi044 bash[22676]: audit 2024-09-21T04:45:56.754808+0000 mon.a (mon.0) 13496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:57 smithi044 bash[22676]: audit 2024-09-21T04:45:56.765548+0000 mon.a (mon.0) 13497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:57 smithi049 bash[23528]: audit 2024-09-21T04:45:56.109005+0000 mgr.a (mgr.14388) 16945 : audit [DBG] from='client.365265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:45:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:57 smithi049 bash[23528]: audit 2024-09-21T04:45:56.745359+0000 mon.a (mon.0) 13495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:57 smithi049 bash[23528]: audit 2024-09-21T04:45:56.754808+0000 mon.a (mon.0) 13496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:57 smithi049 bash[23528]: audit 2024-09-21T04:45:56.765548+0000 mon.a (mon.0) 13497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:45:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:45:58 smithi179 bash[23186]: cluster 2024-09-21T04:45:57.106554+0000 mgr.a (mgr.14388) 16946 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:45:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:45:58 smithi049 bash[23528]: cluster 2024-09-21T04:45:57.106554+0000 mgr.a (mgr.14388) 16946 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:45:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:45:58 smithi044 bash[22676]: cluster 2024-09-21T04:45:57.106554+0000 mgr.a (mgr.14388) 16946 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:46:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:00 smithi179 bash[23186]: cluster 2024-09-21T04:45:59.107488+0000 mgr.a (mgr.14388) 16947 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:46:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:00 smithi049 bash[23528]: cluster 2024-09-21T04:45:59.107488+0000 mgr.a (mgr.14388) 16947 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:46:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:00 smithi044 bash[22676]: cluster 2024-09-21T04:45:59.107488+0000 mgr.a (mgr.14388) 16947 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T04:46:01.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:01.561 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:01.561 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:02.358 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:02.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:02.541 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:02 smithi049 bash[23528]: cluster 2024-09-21T04:46:01.109792+0000 mgr.a (mgr.14388) 16948 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:46:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:02 smithi044 bash[22676]: cluster 2024-09-21T04:46:01.109792+0000 mgr.a (mgr.14388) 16948 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:46:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:02 smithi179 bash[23186]: cluster 2024-09-21T04:46:01.109792+0000 mgr.a (mgr.14388) 16948 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:46:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:03 smithi049 bash[23528]: audit 2024-09-21T04:46:01.897632+0000 mgr.a (mgr.14388) 16949 : audit [DBG] from='client.365343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:03 smithi044 bash[22676]: audit 2024-09-21T04:46:01.897632+0000 mgr.a (mgr.14388) 16949 : audit [DBG] from='client.365343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:03 smithi179 bash[23186]: audit 2024-09-21T04:46:01.897632+0000 mgr.a (mgr.14388) 16949 : audit [DBG] from='client.365343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:04 smithi179 bash[23186]: cluster 2024-09-21T04:46:03.110723+0000 mgr.a (mgr.14388) 16950 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:46:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:04 smithi049 bash[23528]: cluster 2024-09-21T04:46:03.110723+0000 mgr.a (mgr.14388) 16950 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:46:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:04 smithi044 bash[22676]: cluster 2024-09-21T04:46:03.110723+0000 mgr.a (mgr.14388) 16950 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:46:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:06 smithi179 bash[23186]: cluster 2024-09-21T04:46:05.112850+0000 mgr.a (mgr.14388) 16951 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:46:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:06 smithi049 bash[23528]: cluster 2024-09-21T04:46:05.112850+0000 mgr.a (mgr.14388) 16951 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:46:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:06 smithi044 bash[22676]: cluster 2024-09-21T04:46:05.112850+0000 mgr.a (mgr.14388) 16951 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:46:07.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:07.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:07.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:07.703 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:07 smithi179 bash[23186]: audit 2024-09-21T04:46:06.429079+0000 mon.a (mon.0) 13498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.703 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:07 smithi179 bash[23186]: audit 2024-09-21T04:46:06.435510+0000 mon.a (mon.0) 13499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.703 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:07 smithi179 bash[23186]: audit 2024-09-21T04:46:06.443123+0000 mon.a (mon.0) 13500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:07 smithi044 bash[22676]: audit 2024-09-21T04:46:06.429079+0000 mon.a (mon.0) 13498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:07 smithi044 bash[22676]: audit 2024-09-21T04:46:06.435510+0000 mon.a (mon.0) 13499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:07 smithi044 bash[22676]: audit 2024-09-21T04:46:06.443123+0000 mon.a (mon.0) 13500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:07 smithi049 bash[23528]: audit 2024-09-21T04:46:06.429079+0000 mon.a (mon.0) 13498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:07 smithi049 bash[23528]: audit 2024-09-21T04:46:06.435510+0000 mon.a (mon.0) 13499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:07 smithi049 bash[23528]: audit 2024-09-21T04:46:06.443123+0000 mon.a (mon.0) 13500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:08.147 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:08.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:08.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:08.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:08.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:08 smithi044 bash[22676]: cluster 2024-09-21T04:46:07.113683+0000 mgr.a (mgr.14388) 16952 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:08 smithi179 bash[23186]: cluster 2024-09-21T04:46:07.113683+0000 mgr.a (mgr.14388) 16952 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:08 smithi049 bash[23528]: cluster 2024-09-21T04:46:07.113683+0000 mgr.a (mgr.14388) 16952 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:09 smithi044 bash[22676]: audit 2024-09-21T04:46:07.692961+0000 mgr.a (mgr.14388) 16953 : audit [DBG] from='client.365421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:09 smithi179 bash[23186]: audit 2024-09-21T04:46:07.692961+0000 mgr.a (mgr.14388) 16953 : audit [DBG] from='client.365421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:09 smithi049 bash[23528]: audit 2024-09-21T04:46:07.692961+0000 mgr.a (mgr.14388) 16953 : audit [DBG] from='client.365421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:10 smithi044 bash[22676]: cluster 2024-09-21T04:46:09.114625+0000 mgr.a (mgr.14388) 16954 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:10 smithi179 bash[23186]: cluster 2024-09-21T04:46:09.114625+0000 mgr.a (mgr.14388) 16954 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:10 smithi049 bash[23528]: cluster 2024-09-21T04:46:09.114625+0000 mgr.a (mgr.14388) 16954 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:11 smithi044 bash[22676]: cluster 2024-09-21T04:46:11.116897+0000 mgr.a (mgr.14388) 16955 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:11 smithi179 bash[23186]: cluster 2024-09-21T04:46:11.116897+0000 mgr.a (mgr.14388) 16955 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:11 smithi049 bash[23528]: cluster 2024-09-21T04:46:11.116897+0000 mgr.a (mgr.14388) 16955 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:13.149 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:13.149 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:13.150 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:13 smithi049 bash[23528]: audit 2024-09-21T04:46:12.956483+0000 mon.a (mon.0) 13501 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:46:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:13 smithi044 bash[22676]: audit 2024-09-21T04:46:12.956483+0000 mon.a (mon.0) 13501 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:46:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:13 smithi179 bash[23186]: audit 2024-09-21T04:46:12.956483+0000 mon.a (mon.0) 13501 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:46:13.924 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:13.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:13.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:13.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:13.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:14.282 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: cluster 2024-09-21T04:46:13.117683+0000 mgr.a (mgr.14388) 16956 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:14.282 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.564344+0000 mon.a (mon.0) 13502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.282 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.569935+0000 mon.a (mon.0) 13503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.591582+0000 mon.a (mon.0) 13504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.597118+0000 mon.a (mon.0) 13505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.598355+0000 mon.a (mon.0) 13506 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:46:14.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.599073+0000 mon.a (mon.0) 13507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:46:14.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.603927+0000 mon.a (mon.0) 13508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22676]: audit 2024-09-21T04:46:13.606538+0000 mon.a (mon.0) 13509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: cluster 2024-09-21T04:46:13.117683+0000 mgr.a (mgr.14388) 16956 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.564344+0000 mon.a (mon.0) 13502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.569935+0000 mon.a (mon.0) 13503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.591582+0000 mon.a (mon.0) 13504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.597118+0000 mon.a (mon.0) 13505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.598355+0000 mon.a (mon.0) 13506 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.599073+0000 mon.a (mon.0) 13507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.603927+0000 mon.a (mon.0) 13508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:14 smithi049 bash[23528]: audit 2024-09-21T04:46:13.606538+0000 mon.a (mon.0) 13509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: cluster 2024-09-21T04:46:13.117683+0000 mgr.a (mgr.14388) 16956 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.564344+0000 mon.a (mon.0) 13502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.569935+0000 mon.a (mon.0) 13503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.591582+0000 mon.a (mon.0) 13504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.597118+0000 mon.a (mon.0) 13505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.598355+0000 mon.a (mon.0) 13506 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.599073+0000 mon.a (mon.0) 13507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.603927+0000 mon.a (mon.0) 13508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:14.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:14 smithi179 bash[23186]: audit 2024-09-21T04:46:13.606538+0000 mon.a (mon.0) 13509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:46:14.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22930]: debug 2024-09-21T04:46:14.670+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:46:14.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:46:14 smithi044 bash[22930]: debug 2024-09-21T04:46:14.670+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:46:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:15 smithi049 bash[23528]: audit 2024-09-21T04:46:13.500826+0000 mgr.a (mgr.14388) 16957 : audit [DBG] from='client.365499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:15 smithi049 bash[23528]: audit 2024-09-21T04:46:13.607629+0000 mgr.a (mgr.14388) 16958 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:46:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:15 smithi044 bash[22676]: audit 2024-09-21T04:46:13.500826+0000 mgr.a (mgr.14388) 16957 : audit [DBG] from='client.365499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:15 smithi044 bash[22676]: audit 2024-09-21T04:46:13.607629+0000 mgr.a (mgr.14388) 16958 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:46:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:15 smithi179 bash[23186]: audit 2024-09-21T04:46:13.500826+0000 mgr.a (mgr.14388) 16957 : audit [DBG] from='client.365499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:15 smithi179 bash[23186]: audit 2024-09-21T04:46:13.607629+0000 mgr.a (mgr.14388) 16958 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:46:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:16 smithi044 bash[22676]: audit 2024-09-21T04:46:14.675641+0000 mgr.a (mgr.14388) 16959 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:46:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:16 smithi044 bash[22676]: cephadm 2024-09-21T04:46:14.676909+0000 mgr.a (mgr.14388) 16960 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:46:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:16 smithi044 bash[22676]: cluster 2024-09-21T04:46:15.120174+0000 mgr.a (mgr.14388) 16961 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T04:46:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:16 smithi049 bash[23528]: audit 2024-09-21T04:46:14.675641+0000 mgr.a (mgr.14388) 16959 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:46:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:16 smithi049 bash[23528]: cephadm 2024-09-21T04:46:14.676909+0000 mgr.a (mgr.14388) 16960 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:46:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:16 smithi049 bash[23528]: cluster 2024-09-21T04:46:15.120174+0000 mgr.a (mgr.14388) 16961 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T04:46:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:16 smithi179 bash[23186]: audit 2024-09-21T04:46:14.675641+0000 mgr.a (mgr.14388) 16959 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:46:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:16 smithi179 bash[23186]: cephadm 2024-09-21T04:46:14.676909+0000 mgr.a (mgr.14388) 16960 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:46:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:16 smithi179 bash[23186]: cluster 2024-09-21T04:46:15.120174+0000 mgr.a (mgr.14388) 16961 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T04:46:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:17 smithi044 bash[22676]: audit 2024-09-21T04:46:16.362943+0000 mon.a (mon.0) 13510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:17 smithi044 bash[22676]: audit 2024-09-21T04:46:16.367779+0000 mon.a (mon.0) 13511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:17 smithi044 bash[22676]: audit 2024-09-21T04:46:16.373364+0000 mon.a (mon.0) 13512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:17 smithi044 bash[22676]: audit 2024-09-21T04:46:16.973279+0000 mon.a (mon.0) 13513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:17 smithi044 bash[22676]: audit 2024-09-21T04:46:16.981670+0000 mon.a (mon.0) 13514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:17 smithi044 bash[22676]: audit 2024-09-21T04:46:16.991571+0000 mon.a (mon.0) 13515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:17 smithi179 bash[23186]: audit 2024-09-21T04:46:16.362943+0000 mon.a (mon.0) 13510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:17 smithi179 bash[23186]: audit 2024-09-21T04:46:16.367779+0000 mon.a (mon.0) 13511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:17 smithi179 bash[23186]: audit 2024-09-21T04:46:16.373364+0000 mon.a (mon.0) 13512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:17 smithi179 bash[23186]: audit 2024-09-21T04:46:16.973279+0000 mon.a (mon.0) 13513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:17 smithi179 bash[23186]: audit 2024-09-21T04:46:16.981670+0000 mon.a (mon.0) 13514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:17 smithi179 bash[23186]: audit 2024-09-21T04:46:16.991571+0000 mon.a (mon.0) 13515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:17 smithi049 bash[23528]: audit 2024-09-21T04:46:16.362943+0000 mon.a (mon.0) 13510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:17 smithi049 bash[23528]: audit 2024-09-21T04:46:16.367779+0000 mon.a (mon.0) 13511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:17 smithi049 bash[23528]: audit 2024-09-21T04:46:16.373364+0000 mon.a (mon.0) 13512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:17 smithi049 bash[23528]: audit 2024-09-21T04:46:16.973279+0000 mon.a (mon.0) 13513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:17 smithi049 bash[23528]: audit 2024-09-21T04:46:16.981670+0000 mon.a (mon.0) 13514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:17 smithi049 bash[23528]: audit 2024-09-21T04:46:16.991571+0000 mon.a (mon.0) 13515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:18 smithi044 bash[22676]: cluster 2024-09-21T04:46:17.121007+0000 mgr.a (mgr.14388) 16962 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:18 smithi179 bash[23186]: cluster 2024-09-21T04:46:17.121007+0000 mgr.a (mgr.14388) 16962 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:18 smithi049 bash[23528]: cluster 2024-09-21T04:46:17.121007+0000 mgr.a (mgr.14388) 16962 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:18.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:18.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:18.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:19.712 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:19.712 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:20 smithi044 bash[22676]: cluster 2024-09-21T04:46:19.121771+0000 mgr.a (mgr.14388) 16963 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:20 smithi044 bash[22676]: audit 2024-09-21T04:46:19.257929+0000 mgr.a (mgr.14388) 16964 : audit [DBG] from='client.365685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:20 smithi179 bash[23186]: cluster 2024-09-21T04:46:19.121771+0000 mgr.a (mgr.14388) 16963 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:20 smithi179 bash[23186]: audit 2024-09-21T04:46:19.257929+0000 mgr.a (mgr.14388) 16964 : audit [DBG] from='client.365685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:20 smithi049 bash[23528]: cluster 2024-09-21T04:46:19.121771+0000 mgr.a (mgr.14388) 16963 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:20 smithi049 bash[23528]: audit 2024-09-21T04:46:19.257929+0000 mgr.a (mgr.14388) 16964 : audit [DBG] from='client.365685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:22.733 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:22 smithi049 bash[23528]: cluster 2024-09-21T04:46:21.124148+0000 mgr.a (mgr.14388) 16965 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T04:46:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:22 smithi044 bash[22676]: cluster 2024-09-21T04:46:21.124148+0000 mgr.a (mgr.14388) 16965 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T04:46:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:22 smithi179 bash[23186]: cluster 2024-09-21T04:46:21.124148+0000 mgr.a (mgr.14388) 16965 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-21T04:46:24.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:24 smithi049 bash[23528]: cluster 2024-09-21T04:46:23.124949+0000 mgr.a (mgr.14388) 16966 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:24.713 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:24.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:24.714 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:24 smithi044 bash[22676]: cluster 2024-09-21T04:46:23.124949+0000 mgr.a (mgr.14388) 16966 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:24 smithi179 bash[23186]: cluster 2024-09-21T04:46:23.124949+0000 mgr.a (mgr.14388) 16966 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:25.490 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:25.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:25.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:26.671 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:26 smithi049 bash[23528]: audit 2024-09-21T04:46:25.048395+0000 mgr.a (mgr.14388) 16967 : audit [DBG] from='client.365763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:26.671 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:26 smithi049 bash[23528]: cluster 2024-09-21T04:46:25.126471+0000 mgr.a (mgr.14388) 16968 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:26 smithi044 bash[22676]: audit 2024-09-21T04:46:25.048395+0000 mgr.a (mgr.14388) 16967 : audit [DBG] from='client.365763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:26 smithi044 bash[22676]: cluster 2024-09-21T04:46:25.126471+0000 mgr.a (mgr.14388) 16968 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:26 smithi179 bash[23186]: audit 2024-09-21T04:46:25.048395+0000 mgr.a (mgr.14388) 16967 : audit [DBG] from='client.365763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:26 smithi179 bash[23186]: cluster 2024-09-21T04:46:25.126471+0000 mgr.a (mgr.14388) 16968 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-21T04:46:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:27 smithi044 bash[22676]: audit 2024-09-21T04:46:26.643736+0000 mon.a (mon.0) 13516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:27 smithi044 bash[22676]: audit 2024-09-21T04:46:26.653761+0000 mon.a (mon.0) 13517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:27 smithi044 bash[22676]: audit 2024-09-21T04:46:26.665765+0000 mon.a (mon.0) 13518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:27 smithi044 bash[22676]: cluster 2024-09-21T04:46:27.127305+0000 mgr.a (mgr.14388) 16969 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:46:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:27 smithi179 bash[23186]: audit 2024-09-21T04:46:26.643736+0000 mon.a (mon.0) 13516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:27 smithi179 bash[23186]: audit 2024-09-21T04:46:26.653761+0000 mon.a (mon.0) 13517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:27 smithi179 bash[23186]: audit 2024-09-21T04:46:26.665765+0000 mon.a (mon.0) 13518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:27 smithi179 bash[23186]: cluster 2024-09-21T04:46:27.127305+0000 mgr.a (mgr.14388) 16969 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:46:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:27 smithi049 bash[23528]: audit 2024-09-21T04:46:26.643736+0000 mon.a (mon.0) 13516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:27 smithi049 bash[23528]: audit 2024-09-21T04:46:26.653761+0000 mon.a (mon.0) 13517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:27 smithi049 bash[23528]: audit 2024-09-21T04:46:26.665765+0000 mon.a (mon.0) 13518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:27 smithi049 bash[23528]: cluster 2024-09-21T04:46:27.127305+0000 mgr.a (mgr.14388) 16969 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:46:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:30 smithi044 bash[22676]: cluster 2024-09-21T04:46:29.128114+0000 mgr.a (mgr.14388) 16970 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:46:30.491 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:30.492 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:30.493 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:30 smithi179 bash[23186]: cluster 2024-09-21T04:46:29.128114+0000 mgr.a (mgr.14388) 16970 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:46:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:30 smithi049 bash[23528]: cluster 2024-09-21T04:46:29.128114+0000 mgr.a (mgr.14388) 16970 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:46:31.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:31.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:31.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:31.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:31.278 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:31 smithi044 bash[22676]: audit 2024-09-21T04:46:30.823246+0000 mgr.a (mgr.14388) 16971 : audit [DBG] from='client.365841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:31 smithi044 bash[22676]: cluster 2024-09-21T04:46:31.130093+0000 mgr.a (mgr.14388) 16972 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:31 smithi179 bash[23186]: audit 2024-09-21T04:46:30.823246+0000 mgr.a (mgr.14388) 16971 : audit [DBG] from='client.365841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:31 smithi179 bash[23186]: cluster 2024-09-21T04:46:31.130093+0000 mgr.a (mgr.14388) 16972 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:31 smithi049 bash[23528]: audit 2024-09-21T04:46:30.823246+0000 mgr.a (mgr.14388) 16971 : audit [DBG] from='client.365841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:31 smithi049 bash[23528]: cluster 2024-09-21T04:46:31.130093+0000 mgr.a (mgr.14388) 16972 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:34 smithi044 bash[22676]: cluster 2024-09-21T04:46:33.130982+0000 mgr.a (mgr.14388) 16973 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:46:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:34 smithi179 bash[23186]: cluster 2024-09-21T04:46:33.130982+0000 mgr.a (mgr.14388) 16973 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:46:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:34 smithi049 bash[23528]: cluster 2024-09-21T04:46:33.130982+0000 mgr.a (mgr.14388) 16973 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:46:36.277 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:36 smithi044 bash[22676]: cluster 2024-09-21T04:46:35.133293+0000 mgr.a (mgr.14388) 16974 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:36.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:36.280 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:36 smithi179 bash[23186]: cluster 2024-09-21T04:46:35.133293+0000 mgr.a (mgr.14388) 16974 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:36 smithi049 bash[23528]: cluster 2024-09-21T04:46:35.133293+0000 mgr.a (mgr.14388) 16974 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:37.093 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:37.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: audit 2024-09-21T04:46:36.524458+0000 mon.a (mon.0) 13519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: audit 2024-09-21T04:46:36.529173+0000 mon.a (mon.0) 13520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: audit 2024-09-21T04:46:36.535622+0000 mon.a (mon.0) 13521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: audit 2024-09-21T04:46:36.636629+0000 mgr.a (mgr.14388) 16975 : audit [DBG] from='client.365919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:37.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: cluster 2024-09-21T04:46:37.133818+0000 mgr.a (mgr.14388) 16976 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:37.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: audit 2024-09-21T04:46:37.206442+0000 mon.a (mon.0) 13522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: audit 2024-09-21T04:46:37.214756+0000 mon.a (mon.0) 13523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:37 smithi044 bash[22676]: audit 2024-09-21T04:46:37.224997+0000 mon.a (mon.0) 13524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: audit 2024-09-21T04:46:36.524458+0000 mon.a (mon.0) 13519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: audit 2024-09-21T04:46:36.529173+0000 mon.a (mon.0) 13520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: audit 2024-09-21T04:46:36.535622+0000 mon.a (mon.0) 13521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: audit 2024-09-21T04:46:36.636629+0000 mgr.a (mgr.14388) 16975 : audit [DBG] from='client.365919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: cluster 2024-09-21T04:46:37.133818+0000 mgr.a (mgr.14388) 16976 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: audit 2024-09-21T04:46:37.206442+0000 mon.a (mon.0) 13522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: audit 2024-09-21T04:46:37.214756+0000 mon.a (mon.0) 13523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:37 smithi049 bash[23528]: audit 2024-09-21T04:46:37.224997+0000 mon.a (mon.0) 13524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: audit 2024-09-21T04:46:36.524458+0000 mon.a (mon.0) 13519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: audit 2024-09-21T04:46:36.529173+0000 mon.a (mon.0) 13520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: audit 2024-09-21T04:46:36.535622+0000 mon.a (mon.0) 13521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: audit 2024-09-21T04:46:36.636629+0000 mgr.a (mgr.14388) 16975 : audit [DBG] from='client.365919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: cluster 2024-09-21T04:46:37.133818+0000 mgr.a (mgr.14388) 16976 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: audit 2024-09-21T04:46:37.206442+0000 mon.a (mon.0) 13522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: audit 2024-09-21T04:46:37.214756+0000 mon.a (mon.0) 13523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:37 smithi179 bash[23186]: audit 2024-09-21T04:46:37.224997+0000 mon.a (mon.0) 13524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:40 smithi044 bash[22676]: cluster 2024-09-21T04:46:39.134572+0000 mgr.a (mgr.14388) 16977 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:40 smithi179 bash[23186]: cluster 2024-09-21T04:46:39.134572+0000 mgr.a (mgr.14388) 16977 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:40 smithi049 bash[23528]: cluster 2024-09-21T04:46:39.134572+0000 mgr.a (mgr.14388) 16977 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:42.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:42.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:42.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:42 smithi044 bash[22676]: cluster 2024-09-21T04:46:41.136752+0000 mgr.a (mgr.14388) 16978 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:42 smithi179 bash[23186]: cluster 2024-09-21T04:46:41.136752+0000 mgr.a (mgr.14388) 16978 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:42 smithi049 bash[23528]: cluster 2024-09-21T04:46:41.136752+0000 mgr.a (mgr.14388) 16978 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:42.893 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:42.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:42.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:42.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:42.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:43.459 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:43 smithi049 bash[23528]: audit 2024-09-21T04:46:42.433186+0000 mgr.a (mgr.14388) 16979 : audit [DBG] from='client.365997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:43 smithi044 bash[22676]: audit 2024-09-21T04:46:42.433186+0000 mgr.a (mgr.14388) 16979 : audit [DBG] from='client.365997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:43 smithi179 bash[23186]: audit 2024-09-21T04:46:42.433186+0000 mgr.a (mgr.14388) 16979 : audit [DBG] from='client.365997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:44 smithi044 bash[22676]: cluster 2024-09-21T04:46:43.137802+0000 mgr.a (mgr.14388) 16980 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:44 smithi179 bash[23186]: cluster 2024-09-21T04:46:43.137802+0000 mgr.a (mgr.14388) 16980 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:44.509 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:44 smithi049 bash[23528]: cluster 2024-09-21T04:46:43.137802+0000 mgr.a (mgr.14388) 16980 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:46.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:46 smithi179 bash[23186]: cluster 2024-09-21T04:46:45.139959+0000 mgr.a (mgr.14388) 16981 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:46 smithi044 bash[22676]: cluster 2024-09-21T04:46:45.139959+0000 mgr.a (mgr.14388) 16981 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:46 smithi049 bash[23528]: cluster 2024-09-21T04:46:45.139959+0000 mgr.a (mgr.14388) 16981 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:47.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:47.895 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:47.895 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:47 smithi044 bash[22676]: audit 2024-09-21T04:46:46.858176+0000 mon.a (mon.0) 13525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:47 smithi044 bash[22676]: audit 2024-09-21T04:46:46.866894+0000 mon.a (mon.0) 13526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:47 smithi044 bash[22676]: audit 2024-09-21T04:46:46.878905+0000 mon.a (mon.0) 13527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:47 smithi044 bash[22676]: cluster 2024-09-21T04:46:47.140716+0000 mgr.a (mgr.14388) 16982 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:47 smithi179 bash[23186]: audit 2024-09-21T04:46:46.858176+0000 mon.a (mon.0) 13525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:47 smithi179 bash[23186]: audit 2024-09-21T04:46:46.866894+0000 mon.a (mon.0) 13526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:47 smithi179 bash[23186]: audit 2024-09-21T04:46:46.878905+0000 mon.a (mon.0) 13527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:47 smithi179 bash[23186]: cluster 2024-09-21T04:46:47.140716+0000 mgr.a (mgr.14388) 16982 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:47 smithi049 bash[23528]: audit 2024-09-21T04:46:46.858176+0000 mon.a (mon.0) 13525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:47 smithi049 bash[23528]: audit 2024-09-21T04:46:46.866894+0000 mon.a (mon.0) 13526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:47 smithi049 bash[23528]: audit 2024-09-21T04:46:46.878905+0000 mon.a (mon.0) 13527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:47 smithi049 bash[23528]: cluster 2024-09-21T04:46:47.140716+0000 mgr.a (mgr.14388) 16982 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:48.650 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:48.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:48.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:48.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:48.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:49.144 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:48 smithi044 bash[22676]: audit 2024-09-21T04:46:48.222734+0000 mgr.a (mgr.14388) 16983 : audit [DBG] from='client.366075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:48 smithi179 bash[23186]: audit 2024-09-21T04:46:48.222734+0000 mgr.a (mgr.14388) 16983 : audit [DBG] from='client.366075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:48 smithi049 bash[23528]: audit 2024-09-21T04:46:48.222734+0000 mgr.a (mgr.14388) 16983 : audit [DBG] from='client.366075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:49 smithi044 bash[22676]: cluster 2024-09-21T04:46:49.141332+0000 mgr.a (mgr.14388) 16984 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:49 smithi179 bash[23186]: cluster 2024-09-21T04:46:49.141332+0000 mgr.a (mgr.14388) 16984 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:49 smithi049 bash[23528]: cluster 2024-09-21T04:46:49.141332+0000 mgr.a (mgr.14388) 16984 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:52 smithi044 bash[22676]: cluster 2024-09-21T04:46:51.143519+0000 mgr.a (mgr.14388) 16985 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:52 smithi179 bash[23186]: cluster 2024-09-21T04:46:51.143519+0000 mgr.a (mgr.14388) 16985 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:52 smithi049 bash[23528]: cluster 2024-09-21T04:46:51.143519+0000 mgr.a (mgr.14388) 16985 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:53.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:53.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:53.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:46:54.447 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:46:54.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:46:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:46:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:46:54.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:46:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:54 smithi044 bash[22676]: cluster 2024-09-21T04:46:53.144294+0000 mgr.a (mgr.14388) 16986 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:54 smithi179 bash[23186]: cluster 2024-09-21T04:46:53.144294+0000 mgr.a (mgr.14388) 16986 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:54 smithi049 bash[23528]: cluster 2024-09-21T04:46:53.144294+0000 mgr.a (mgr.14388) 16986 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:55 smithi044 bash[22676]: audit 2024-09-21T04:46:53.989551+0000 mgr.a (mgr.14388) 16987 : audit [DBG] from='client.366153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:55 smithi179 bash[23186]: audit 2024-09-21T04:46:53.989551+0000 mgr.a (mgr.14388) 16987 : audit [DBG] from='client.366153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:55 smithi049 bash[23528]: audit 2024-09-21T04:46:53.989551+0000 mgr.a (mgr.14388) 16987 : audit [DBG] from='client.366153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:46:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:56 smithi044 bash[22676]: cluster 2024-09-21T04:46:55.146500+0000 mgr.a (mgr.14388) 16988 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:56 smithi179 bash[23186]: cluster 2024-09-21T04:46:55.146500+0000 mgr.a (mgr.14388) 16988 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:56 smithi049 bash[23528]: cluster 2024-09-21T04:46:55.146500+0000 mgr.a (mgr.14388) 16988 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:57 smithi179 bash[23186]: audit 2024-09-21T04:46:56.699779+0000 mon.a (mon.0) 13528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:57 smithi179 bash[23186]: audit 2024-09-21T04:46:56.709453+0000 mon.a (mon.0) 13529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:57 smithi179 bash[23186]: audit 2024-09-21T04:46:56.721895+0000 mon.a (mon.0) 13530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:57 smithi179 bash[23186]: cluster 2024-09-21T04:46:57.147319+0000 mgr.a (mgr.14388) 16989 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:57 smithi179 bash[23186]: audit 2024-09-21T04:46:57.432264+0000 mon.a (mon.0) 13531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:57 smithi179 bash[23186]: audit 2024-09-21T04:46:57.441216+0000 mon.a (mon.0) 13532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:46:57 smithi179 bash[23186]: audit 2024-09-21T04:46:57.451667+0000 mon.a (mon.0) 13533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:57 smithi044 bash[22676]: audit 2024-09-21T04:46:56.699779+0000 mon.a (mon.0) 13528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:57 smithi044 bash[22676]: audit 2024-09-21T04:46:56.709453+0000 mon.a (mon.0) 13529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:57 smithi044 bash[22676]: audit 2024-09-21T04:46:56.721895+0000 mon.a (mon.0) 13530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:57 smithi044 bash[22676]: cluster 2024-09-21T04:46:57.147319+0000 mgr.a (mgr.14388) 16989 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:57 smithi044 bash[22676]: audit 2024-09-21T04:46:57.432264+0000 mon.a (mon.0) 13531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:57 smithi044 bash[22676]: audit 2024-09-21T04:46:57.441216+0000 mon.a (mon.0) 13532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:46:57 smithi044 bash[22676]: audit 2024-09-21T04:46:57.451667+0000 mon.a (mon.0) 13533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:57 smithi049 bash[23528]: audit 2024-09-21T04:46:56.699779+0000 mon.a (mon.0) 13528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:57 smithi049 bash[23528]: audit 2024-09-21T04:46:56.709453+0000 mon.a (mon.0) 13529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:57 smithi049 bash[23528]: audit 2024-09-21T04:46:56.721895+0000 mon.a (mon.0) 13530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:57 smithi049 bash[23528]: cluster 2024-09-21T04:46:57.147319+0000 mgr.a (mgr.14388) 16989 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:46:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:57 smithi049 bash[23528]: audit 2024-09-21T04:46:57.432264+0000 mon.a (mon.0) 13531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:57 smithi049 bash[23528]: audit 2024-09-21T04:46:57.441216+0000 mon.a (mon.0) 13532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:46:57 smithi049 bash[23528]: audit 2024-09-21T04:46:57.451667+0000 mon.a (mon.0) 13533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:46:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:46:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:46:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:00.235 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:00.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:00 smithi044 bash[22676]: cluster 2024-09-21T04:46:59.148143+0000 mgr.a (mgr.14388) 16990 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:00 smithi179 bash[23186]: cluster 2024-09-21T04:46:59.148143+0000 mgr.a (mgr.14388) 16990 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:00 smithi049 bash[23528]: cluster 2024-09-21T04:46:59.148143+0000 mgr.a (mgr.14388) 16990 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:01 smithi044 bash[22676]: audit 2024-09-21T04:46:59.780438+0000 mgr.a (mgr.14388) 16991 : audit [DBG] from='client.366228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:01 smithi179 bash[23186]: audit 2024-09-21T04:46:59.780438+0000 mgr.a (mgr.14388) 16991 : audit [DBG] from='client.366228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:01 smithi049 bash[23528]: audit 2024-09-21T04:46:59.780438+0000 mgr.a (mgr.14388) 16991 : audit [DBG] from='client.366228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:02 smithi044 bash[22676]: cluster 2024-09-21T04:47:01.151128+0000 mgr.a (mgr.14388) 16992 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:02 smithi179 bash[23186]: cluster 2024-09-21T04:47:01.151128+0000 mgr.a (mgr.14388) 16992 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:02 smithi049 bash[23528]: cluster 2024-09-21T04:47:01.151128+0000 mgr.a (mgr.14388) 16992 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:04.381 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:04 smithi049 bash[23528]: cluster 2024-09-21T04:47:03.151888+0000 mgr.a (mgr.14388) 16993 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:04 smithi044 bash[22676]: cluster 2024-09-21T04:47:03.151888+0000 mgr.a (mgr.14388) 16993 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:04 smithi179 bash[23186]: cluster 2024-09-21T04:47:03.151888+0000 mgr.a (mgr.14388) 16993 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:05.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:05.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:05.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:06.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:06 smithi044 bash[22676]: cluster 2024-09-21T04:47:05.153857+0000 mgr.a (mgr.14388) 16994 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:06.494 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:06 smithi179 bash[23186]: cluster 2024-09-21T04:47:05.153857+0000 mgr.a (mgr.14388) 16994 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:06 smithi049 bash[23528]: cluster 2024-09-21T04:47:05.153857+0000 mgr.a (mgr.14388) 16994 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:07 smithi044 bash[22676]: audit 2024-09-21T04:47:05.571332+0000 mgr.a (mgr.14388) 16995 : audit [DBG] from='client.366306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:07 smithi044 bash[22676]: audit 2024-09-21T04:47:07.089915+0000 mon.a (mon.0) 13534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:07 smithi044 bash[22676]: audit 2024-09-21T04:47:07.098699+0000 mon.a (mon.0) 13535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:07 smithi044 bash[22676]: audit 2024-09-21T04:47:07.108896+0000 mon.a (mon.0) 13536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:07 smithi179 bash[23186]: audit 2024-09-21T04:47:05.571332+0000 mgr.a (mgr.14388) 16995 : audit [DBG] from='client.366306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:07 smithi179 bash[23186]: audit 2024-09-21T04:47:07.089915+0000 mon.a (mon.0) 13534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:07 smithi179 bash[23186]: audit 2024-09-21T04:47:07.098699+0000 mon.a (mon.0) 13535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:07 smithi179 bash[23186]: audit 2024-09-21T04:47:07.108896+0000 mon.a (mon.0) 13536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:07 smithi049 bash[23528]: audit 2024-09-21T04:47:05.571332+0000 mgr.a (mgr.14388) 16995 : audit [DBG] from='client.366306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:07 smithi049 bash[23528]: audit 2024-09-21T04:47:07.089915+0000 mon.a (mon.0) 13534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:07 smithi049 bash[23528]: audit 2024-09-21T04:47:07.098699+0000 mon.a (mon.0) 13535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:07.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:07 smithi049 bash[23528]: audit 2024-09-21T04:47:07.108896+0000 mon.a (mon.0) 13536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:08 smithi044 bash[22676]: cluster 2024-09-21T04:47:07.154737+0000 mgr.a (mgr.14388) 16996 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:08 smithi179 bash[23186]: cluster 2024-09-21T04:47:07.154737+0000 mgr.a (mgr.14388) 16996 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:08 smithi049 bash[23528]: cluster 2024-09-21T04:47:07.154737+0000 mgr.a (mgr.14388) 16996 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:10 smithi044 bash[22676]: cluster 2024-09-21T04:47:09.155533+0000 mgr.a (mgr.14388) 16997 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:47:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:10 smithi179 bash[23186]: cluster 2024-09-21T04:47:09.155533+0000 mgr.a (mgr.14388) 16997 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:47:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:10 smithi049 bash[23528]: cluster 2024-09-21T04:47:09.155533+0000 mgr.a (mgr.14388) 16997 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:47:11.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:11.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:11.012 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:11.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:11.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:11.771 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:12 smithi044 bash[22676]: cluster 2024-09-21T04:47:11.157041+0000 mgr.a (mgr.14388) 16998 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:12.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:12 smithi044 bash[22676]: audit 2024-09-21T04:47:11.341453+0000 mgr.a (mgr.14388) 16999 : audit [DBG] from='client.366384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:12 smithi179 bash[23186]: cluster 2024-09-21T04:47:11.157041+0000 mgr.a (mgr.14388) 16998 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:12 smithi179 bash[23186]: audit 2024-09-21T04:47:11.341453+0000 mgr.a (mgr.14388) 16999 : audit [DBG] from='client.366384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:12 smithi049 bash[23528]: cluster 2024-09-21T04:47:11.157041+0000 mgr.a (mgr.14388) 16998 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:12 smithi049 bash[23528]: audit 2024-09-21T04:47:11.341453+0000 mgr.a (mgr.14388) 16999 : audit [DBG] from='client.366384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:14 smithi179 bash[23186]: cluster 2024-09-21T04:47:13.157928+0000 mgr.a (mgr.14388) 17000 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:14 smithi049 bash[23528]: cluster 2024-09-21T04:47:13.157928+0000 mgr.a (mgr.14388) 17000 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:14 smithi044 bash[22676]: cluster 2024-09-21T04:47:13.157928+0000 mgr.a (mgr.14388) 17000 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:15 smithi179 bash[23186]: audit 2024-09-21T04:47:14.744082+0000 mon.a (mon.0) 13537 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:47:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:15 smithi049 bash[23528]: audit 2024-09-21T04:47:14.744082+0000 mon.a (mon.0) 13537 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:47:15.701 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:15 smithi044 bash[22676]: audit 2024-09-21T04:47:14.744082+0000 mon.a (mon.0) 13537 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22930]: debug 2024-09-21T04:47:16.165+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22930]: debug 2024-09-21T04:47:16.165+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: cluster 2024-09-21T04:47:15.160084+0000 mgr.a (mgr.14388) 17001 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: audit 2024-09-21T04:47:15.313922+0000 mon.a (mon.0) 13538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: audit 2024-09-21T04:47:15.323879+0000 mon.a (mon.0) 13539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: audit 2024-09-21T04:47:15.326208+0000 mon.a (mon.0) 13540 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: audit 2024-09-21T04:47:15.328112+0000 mon.a (mon.0) 13541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:47:16.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: audit 2024-09-21T04:47:15.339964+0000 mon.a (mon.0) 13542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: audit 2024-09-21T04:47:15.346319+0000 mon.a (mon.0) 13543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:47:16.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:16 smithi044 bash[22676]: audit 2024-09-21T04:47:15.349061+0000 mgr.a (mgr.14388) 17002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:47:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: cluster 2024-09-21T04:47:15.160084+0000 mgr.a (mgr.14388) 17001 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:16.785 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: audit 2024-09-21T04:47:15.313922+0000 mon.a (mon.0) 13538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.785 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: audit 2024-09-21T04:47:15.323879+0000 mon.a (mon.0) 13539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.785 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: audit 2024-09-21T04:47:15.326208+0000 mon.a (mon.0) 13540 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:47:16.785 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: audit 2024-09-21T04:47:15.328112+0000 mon.a (mon.0) 13541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:47:16.785 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: audit 2024-09-21T04:47:15.339964+0000 mon.a (mon.0) 13542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.785 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: audit 2024-09-21T04:47:15.346319+0000 mon.a (mon.0) 13543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:47:16.786 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:16 smithi179 bash[23186]: audit 2024-09-21T04:47:15.349061+0000 mgr.a (mgr.14388) 17002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:47:16.786 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:16.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:16.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: cluster 2024-09-21T04:47:15.160084+0000 mgr.a (mgr.14388) 17001 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: audit 2024-09-21T04:47:15.313922+0000 mon.a (mon.0) 13538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: audit 2024-09-21T04:47:15.323879+0000 mon.a (mon.0) 13539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: audit 2024-09-21T04:47:15.326208+0000 mon.a (mon.0) 13540 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: audit 2024-09-21T04:47:15.328112+0000 mon.a (mon.0) 13541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: audit 2024-09-21T04:47:15.339964+0000 mon.a (mon.0) 13542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: audit 2024-09-21T04:47:15.346319+0000 mon.a (mon.0) 13543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:16 smithi049 bash[23528]: audit 2024-09-21T04:47:15.349061+0000 mgr.a (mgr.14388) 17002 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:47:17.541 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:17.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:17 smithi044 bash[22676]: audit 2024-09-21T04:47:16.170324+0000 mgr.a (mgr.14388) 17003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:47:17.638 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:17 smithi044 bash[22676]: cephadm 2024-09-21T04:47:16.172440+0000 mgr.a (mgr.14388) 17004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:47:17.638 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:17 smithi044 bash[22676]: audit 2024-09-21T04:47:16.840327+0000 mon.a (mon.0) 13544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.638 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:17 smithi044 bash[22676]: audit 2024-09-21T04:47:16.845690+0000 mon.a (mon.0) 13545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.638 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:17 smithi044 bash[22676]: audit 2024-09-21T04:47:16.852346+0000 mon.a (mon.0) 13546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:17 smithi179 bash[23186]: audit 2024-09-21T04:47:16.170324+0000 mgr.a (mgr.14388) 17003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:47:17.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:17 smithi179 bash[23186]: cephadm 2024-09-21T04:47:16.172440+0000 mgr.a (mgr.14388) 17004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:47:17.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:17 smithi179 bash[23186]: audit 2024-09-21T04:47:16.840327+0000 mon.a (mon.0) 13544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.643 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:17 smithi179 bash[23186]: audit 2024-09-21T04:47:16.845690+0000 mon.a (mon.0) 13545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.643 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:17 smithi179 bash[23186]: audit 2024-09-21T04:47:16.852346+0000 mon.a (mon.0) 13546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:17 smithi049 bash[23528]: audit 2024-09-21T04:47:16.170324+0000 mgr.a (mgr.14388) 17003 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:47:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:17 smithi049 bash[23528]: cephadm 2024-09-21T04:47:16.172440+0000 mgr.a (mgr.14388) 17004 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:47:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:17 smithi049 bash[23528]: audit 2024-09-21T04:47:16.840327+0000 mon.a (mon.0) 13544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:17 smithi049 bash[23528]: audit 2024-09-21T04:47:16.845690+0000 mon.a (mon.0) 13545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:17 smithi049 bash[23528]: audit 2024-09-21T04:47:16.852346+0000 mon.a (mon.0) 13546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:18 smithi044 bash[22676]: audit 2024-09-21T04:47:17.103983+0000 mgr.a (mgr.14388) 17005 : audit [DBG] from='client.366561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:18.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:18 smithi044 bash[22676]: cluster 2024-09-21T04:47:17.161010+0000 mgr.a (mgr.14388) 17006 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:18.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:18 smithi044 bash[22676]: audit 2024-09-21T04:47:17.627900+0000 mon.a (mon.0) 13547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:18 smithi044 bash[22676]: audit 2024-09-21T04:47:17.634137+0000 mon.a (mon.0) 13548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:18 smithi044 bash[22676]: audit 2024-09-21T04:47:17.639148+0000 mon.a (mon.0) 13549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:18 smithi179 bash[23186]: audit 2024-09-21T04:47:17.103983+0000 mgr.a (mgr.14388) 17005 : audit [DBG] from='client.366561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:18 smithi179 bash[23186]: cluster 2024-09-21T04:47:17.161010+0000 mgr.a (mgr.14388) 17006 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:18 smithi179 bash[23186]: audit 2024-09-21T04:47:17.627900+0000 mon.a (mon.0) 13547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:18 smithi179 bash[23186]: audit 2024-09-21T04:47:17.634137+0000 mon.a (mon.0) 13548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:18 smithi179 bash[23186]: audit 2024-09-21T04:47:17.639148+0000 mon.a (mon.0) 13549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:18 smithi049 bash[23528]: audit 2024-09-21T04:47:17.103983+0000 mgr.a (mgr.14388) 17005 : audit [DBG] from='client.366561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:18 smithi049 bash[23528]: cluster 2024-09-21T04:47:17.161010+0000 mgr.a (mgr.14388) 17006 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:18 smithi049 bash[23528]: audit 2024-09-21T04:47:17.627900+0000 mon.a (mon.0) 13547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:18 smithi049 bash[23528]: audit 2024-09-21T04:47:17.634137+0000 mon.a (mon.0) 13548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:18 smithi049 bash[23528]: audit 2024-09-21T04:47:17.639148+0000 mon.a (mon.0) 13549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:20 smithi044 bash[22676]: cluster 2024-09-21T04:47:19.161588+0000 mgr.a (mgr.14388) 17007 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:20 smithi179 bash[23186]: cluster 2024-09-21T04:47:19.161588+0000 mgr.a (mgr.14388) 17007 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:20 smithi049 bash[23528]: cluster 2024-09-21T04:47:19.161588+0000 mgr.a (mgr.14388) 17007 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:22 smithi044 bash[22676]: cluster 2024-09-21T04:47:21.163714+0000 mgr.a (mgr.14388) 17008 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:22 smithi179 bash[23186]: cluster 2024-09-21T04:47:21.163714+0000 mgr.a (mgr.14388) 17008 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:22 smithi049 bash[23528]: cluster 2024-09-21T04:47:21.163714+0000 mgr.a (mgr.14388) 17008 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:23.313 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:23.313 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:24.622 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:24 smithi049 bash[23528]: audit 2024-09-21T04:47:22.873999+0000 mgr.a (mgr.14388) 17009 : audit [DBG] from='client.366639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:24.622 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:24 smithi049 bash[23528]: cluster 2024-09-21T04:47:23.164325+0000 mgr.a (mgr.14388) 17010 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:24 smithi044 bash[22676]: audit 2024-09-21T04:47:22.873999+0000 mgr.a (mgr.14388) 17009 : audit [DBG] from='client.366639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:24.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:24 smithi044 bash[22676]: cluster 2024-09-21T04:47:23.164325+0000 mgr.a (mgr.14388) 17010 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:24 smithi179 bash[23186]: audit 2024-09-21T04:47:22.873999+0000 mgr.a (mgr.14388) 17009 : audit [DBG] from='client.366639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:24 smithi179 bash[23186]: cluster 2024-09-21T04:47:23.164325+0000 mgr.a (mgr.14388) 17010 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:26 smithi044 bash[22676]: cluster 2024-09-21T04:47:25.166561+0000 mgr.a (mgr.14388) 17011 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:26 smithi179 bash[23186]: cluster 2024-09-21T04:47:25.166561+0000 mgr.a (mgr.14388) 17011 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:26 smithi049 bash[23528]: cluster 2024-09-21T04:47:25.166561+0000 mgr.a (mgr.14388) 17011 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:28 smithi049 bash[23528]: cluster 2024-09-21T04:47:27.167327+0000 mgr.a (mgr.14388) 17012 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:28.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:28 smithi049 bash[23528]: audit 2024-09-21T04:47:27.267079+0000 mon.a (mon.0) 13550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:28 smithi049 bash[23528]: audit 2024-09-21T04:47:27.277620+0000 mon.a (mon.0) 13551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:28 smithi049 bash[23528]: audit 2024-09-21T04:47:27.291897+0000 mon.a (mon.0) 13552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:28 smithi044 bash[22676]: cluster 2024-09-21T04:47:27.167327+0000 mgr.a (mgr.14388) 17012 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:28 smithi044 bash[22676]: audit 2024-09-21T04:47:27.267079+0000 mon.a (mon.0) 13550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:28 smithi044 bash[22676]: audit 2024-09-21T04:47:27.277620+0000 mon.a (mon.0) 13551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:28 smithi044 bash[22676]: audit 2024-09-21T04:47:27.291897+0000 mon.a (mon.0) 13552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:28 smithi179 bash[23186]: cluster 2024-09-21T04:47:27.167327+0000 mgr.a (mgr.14388) 17012 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:28 smithi179 bash[23186]: audit 2024-09-21T04:47:27.267079+0000 mon.a (mon.0) 13550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:28 smithi179 bash[23186]: audit 2024-09-21T04:47:27.277620+0000 mon.a (mon.0) 13551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:28 smithi179 bash[23186]: audit 2024-09-21T04:47:27.291897+0000 mon.a (mon.0) 13552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:29.074 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:29.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:29.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:29.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:29.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:30 smithi049 bash[23528]: audit 2024-09-21T04:47:28.645200+0000 mgr.a (mgr.14388) 17013 : audit [DBG] from='client.366714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:30 smithi049 bash[23528]: cluster 2024-09-21T04:47:29.168202+0000 mgr.a (mgr.14388) 17014 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:30 smithi044 bash[22676]: audit 2024-09-21T04:47:28.645200+0000 mgr.a (mgr.14388) 17013 : audit [DBG] from='client.366714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:30 smithi044 bash[22676]: cluster 2024-09-21T04:47:29.168202+0000 mgr.a (mgr.14388) 17014 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:30 smithi179 bash[23186]: audit 2024-09-21T04:47:28.645200+0000 mgr.a (mgr.14388) 17013 : audit [DBG] from='client.366714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:30.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:30 smithi179 bash[23186]: cluster 2024-09-21T04:47:29.168202+0000 mgr.a (mgr.14388) 17014 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:32 smithi049 bash[23528]: cluster 2024-09-21T04:47:31.170465+0000 mgr.a (mgr.14388) 17015 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:32 smithi044 bash[22676]: cluster 2024-09-21T04:47:31.170465+0000 mgr.a (mgr.14388) 17015 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:32 smithi179 bash[23186]: cluster 2024-09-21T04:47:31.170465+0000 mgr.a (mgr.14388) 17015 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:47:34.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:34.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:34.077 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:34 smithi049 bash[23528]: cluster 2024-09-21T04:47:33.171203+0000 mgr.a (mgr.14388) 17016 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:34 smithi044 bash[22676]: cluster 2024-09-21T04:47:33.171203+0000 mgr.a (mgr.14388) 17016 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:34 smithi179 bash[23186]: cluster 2024-09-21T04:47:33.171203+0000 mgr.a (mgr.14388) 17016 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:34.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:34.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:34.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:34.872 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:34.872 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:35 smithi049 bash[23528]: audit 2024-09-21T04:47:34.416145+0000 mgr.a (mgr.14388) 17017 : audit [DBG] from='client.366789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:35 smithi044 bash[22676]: audit 2024-09-21T04:47:34.416145+0000 mgr.a (mgr.14388) 17017 : audit [DBG] from='client.366789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:35 smithi179 bash[23186]: audit 2024-09-21T04:47:34.416145+0000 mgr.a (mgr.14388) 17017 : audit [DBG] from='client.366789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:36 smithi049 bash[23528]: cluster 2024-09-21T04:47:35.173515+0000 mgr.a (mgr.14388) 17018 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:36 smithi044 bash[22676]: cluster 2024-09-21T04:47:35.173515+0000 mgr.a (mgr.14388) 17018 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:36 smithi179 bash[23186]: cluster 2024-09-21T04:47:35.173515+0000 mgr.a (mgr.14388) 17018 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:38.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:38 smithi179 bash[23186]: audit 2024-09-21T04:47:37.040813+0000 mon.a (mon.0) 13553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:38 smithi179 bash[23186]: audit 2024-09-21T04:47:37.047329+0000 mon.a (mon.0) 13554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:38 smithi179 bash[23186]: audit 2024-09-21T04:47:37.054328+0000 mon.a (mon.0) 13555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:38 smithi179 bash[23186]: cluster 2024-09-21T04:47:37.174014+0000 mgr.a (mgr.14388) 17019 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:38.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:38 smithi179 bash[23186]: audit 2024-09-21T04:47:37.846521+0000 mon.a (mon.0) 13556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:38 smithi179 bash[23186]: audit 2024-09-21T04:47:37.855287+0000 mon.a (mon.0) 13557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:38 smithi179 bash[23186]: audit 2024-09-21T04:47:37.865826+0000 mon.a (mon.0) 13558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:38 smithi049 bash[23528]: audit 2024-09-21T04:47:37.040813+0000 mon.a (mon.0) 13553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:38 smithi049 bash[23528]: audit 2024-09-21T04:47:37.047329+0000 mon.a (mon.0) 13554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:38 smithi049 bash[23528]: audit 2024-09-21T04:47:37.054328+0000 mon.a (mon.0) 13555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:38 smithi049 bash[23528]: cluster 2024-09-21T04:47:37.174014+0000 mgr.a (mgr.14388) 17019 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:38.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:38 smithi049 bash[23528]: audit 2024-09-21T04:47:37.846521+0000 mon.a (mon.0) 13556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:38 smithi049 bash[23528]: audit 2024-09-21T04:47:37.855287+0000 mon.a (mon.0) 13557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:38 smithi049 bash[23528]: audit 2024-09-21T04:47:37.865826+0000 mon.a (mon.0) 13558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:38 smithi044 bash[22676]: audit 2024-09-21T04:47:37.040813+0000 mon.a (mon.0) 13553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:38 smithi044 bash[22676]: audit 2024-09-21T04:47:37.047329+0000 mon.a (mon.0) 13554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:38 smithi044 bash[22676]: audit 2024-09-21T04:47:37.054328+0000 mon.a (mon.0) 13555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:38 smithi044 bash[22676]: cluster 2024-09-21T04:47:37.174014+0000 mgr.a (mgr.14388) 17019 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:38 smithi044 bash[22676]: audit 2024-09-21T04:47:37.846521+0000 mon.a (mon.0) 13556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:38 smithi044 bash[22676]: audit 2024-09-21T04:47:37.855287+0000 mon.a (mon.0) 13557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:38 smithi044 bash[22676]: audit 2024-09-21T04:47:37.865826+0000 mon.a (mon.0) 13558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:39.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:39.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:39.874 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:40 smithi044 bash[22676]: cluster 2024-09-21T04:47:39.174386+0000 mgr.a (mgr.14388) 17020 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:40 smithi179 bash[23186]: cluster 2024-09-21T04:47:39.174386+0000 mgr.a (mgr.14388) 17020 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:40 smithi049 bash[23528]: cluster 2024-09-21T04:47:39.174386+0000 mgr.a (mgr.14388) 17020 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:40.669 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:40.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:40.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:40.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:40.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:41.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:41 smithi179 bash[23186]: audit 2024-09-21T04:47:40.210086+0000 mgr.a (mgr.14388) 17021 : audit [DBG] from='client.366861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:41 smithi049 bash[23528]: audit 2024-09-21T04:47:40.210086+0000 mgr.a (mgr.14388) 17021 : audit [DBG] from='client.366861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:41 smithi044 bash[22676]: audit 2024-09-21T04:47:40.210086+0000 mgr.a (mgr.14388) 17021 : audit [DBG] from='client.366861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:42 smithi179 bash[23186]: cluster 2024-09-21T04:47:41.177428+0000 mgr.a (mgr.14388) 17022 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:42 smithi049 bash[23528]: cluster 2024-09-21T04:47:41.177428+0000 mgr.a (mgr.14388) 17022 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:42 smithi044 bash[22676]: cluster 2024-09-21T04:47:41.177428+0000 mgr.a (mgr.14388) 17022 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:44 smithi049 bash[23528]: cluster 2024-09-21T04:47:43.178220+0000 mgr.a (mgr.14388) 17023 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:44 smithi179 bash[23186]: cluster 2024-09-21T04:47:43.178220+0000 mgr.a (mgr.14388) 17023 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:44 smithi044 bash[22676]: cluster 2024-09-21T04:47:43.178220+0000 mgr.a (mgr.14388) 17023 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:45.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:45.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:45.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:46.429 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:46.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:46.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:46.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:46.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:46 smithi179 bash[23186]: cluster 2024-09-21T04:47:45.180150+0000 mgr.a (mgr.14388) 17024 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:46 smithi049 bash[23528]: cluster 2024-09-21T04:47:45.180150+0000 mgr.a (mgr.14388) 17024 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:46 smithi044 bash[22676]: cluster 2024-09-21T04:47:45.180150+0000 mgr.a (mgr.14388) 17024 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:47 smithi179 bash[23186]: audit 2024-09-21T04:47:46.003604+0000 mgr.a (mgr.14388) 17025 : audit [DBG] from='client.366933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:47.536 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:47 smithi049 bash[23528]: audit 2024-09-21T04:47:46.003604+0000 mgr.a (mgr.14388) 17025 : audit [DBG] from='client.366933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:47 smithi044 bash[22676]: audit 2024-09-21T04:47:46.003604+0000 mgr.a (mgr.14388) 17025 : audit [DBG] from='client.366933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:48.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:48 smithi179 bash[23186]: cluster 2024-09-21T04:47:47.181059+0000 mgr.a (mgr.14388) 17026 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:48.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:48 smithi179 bash[23186]: audit 2024-09-21T04:47:47.486391+0000 mon.a (mon.0) 13559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:48 smithi179 bash[23186]: audit 2024-09-21T04:47:47.495548+0000 mon.a (mon.0) 13560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:48 smithi179 bash[23186]: audit 2024-09-21T04:47:47.506717+0000 mon.a (mon.0) 13561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:48 smithi049 bash[23528]: cluster 2024-09-21T04:47:47.181059+0000 mgr.a (mgr.14388) 17026 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:48 smithi049 bash[23528]: audit 2024-09-21T04:47:47.486391+0000 mon.a (mon.0) 13559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:48 smithi049 bash[23528]: audit 2024-09-21T04:47:47.495548+0000 mon.a (mon.0) 13560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:48 smithi049 bash[23528]: audit 2024-09-21T04:47:47.506717+0000 mon.a (mon.0) 13561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:48 smithi044 bash[22676]: cluster 2024-09-21T04:47:47.181059+0000 mgr.a (mgr.14388) 17026 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:47:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:48 smithi044 bash[22676]: audit 2024-09-21T04:47:47.486391+0000 mon.a (mon.0) 13559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:48 smithi044 bash[22676]: audit 2024-09-21T04:47:47.495548+0000 mon.a (mon.0) 13560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:48 smithi044 bash[22676]: audit 2024-09-21T04:47:47.506717+0000 mon.a (mon.0) 13561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:50 smithi049 bash[23528]: cluster 2024-09-21T04:47:49.181868+0000 mgr.a (mgr.14388) 17027 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:47:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:50 smithi044 bash[22676]: cluster 2024-09-21T04:47:49.181868+0000 mgr.a (mgr.14388) 17027 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:47:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:50 smithi179 bash[23186]: cluster 2024-09-21T04:47:49.181868+0000 mgr.a (mgr.14388) 17027 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:47:51.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:51.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:51.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:52.214 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:52.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:52.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:52.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:52.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:52 smithi049 bash[23528]: cluster 2024-09-21T04:47:51.184142+0000 mgr.a (mgr.14388) 17028 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:52.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:52 smithi044 bash[22676]: cluster 2024-09-21T04:47:51.184142+0000 mgr.a (mgr.14388) 17028 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:52 smithi179 bash[23186]: cluster 2024-09-21T04:47:51.184142+0000 mgr.a (mgr.14388) 17028 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:53 smithi049 bash[23528]: audit 2024-09-21T04:47:51.766782+0000 mgr.a (mgr.14388) 17029 : audit [DBG] from='client.367008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:53 smithi044 bash[22676]: audit 2024-09-21T04:47:51.766782+0000 mgr.a (mgr.14388) 17029 : audit [DBG] from='client.367008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:53 smithi179 bash[23186]: audit 2024-09-21T04:47:51.766782+0000 mgr.a (mgr.14388) 17029 : audit [DBG] from='client.367008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:54 smithi049 bash[23528]: cluster 2024-09-21T04:47:53.185128+0000 mgr.a (mgr.14388) 17030 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:54 smithi044 bash[22676]: cluster 2024-09-21T04:47:53.185128+0000 mgr.a (mgr.14388) 17030 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:54 smithi179 bash[23186]: cluster 2024-09-21T04:47:53.185128+0000 mgr.a (mgr.14388) 17030 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:56 smithi049 bash[23528]: cluster 2024-09-21T04:47:55.187262+0000 mgr.a (mgr.14388) 17031 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:56 smithi044 bash[22676]: cluster 2024-09-21T04:47:55.187262+0000 mgr.a (mgr.14388) 17031 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:56 smithi179 bash[23186]: cluster 2024-09-21T04:47:55.187262+0000 mgr.a (mgr.14388) 17031 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:47:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:47:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:47:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:47:58.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:47:58.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:47:58.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:47:58.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:47:58.007 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:47:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:58 smithi179 bash[23186]: cluster 2024-09-21T04:47:57.187864+0000 mgr.a (mgr.14388) 17032 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:58 smithi179 bash[23186]: audit 2024-09-21T04:47:57.265922+0000 mon.a (mon.0) 13562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:58 smithi179 bash[23186]: audit 2024-09-21T04:47:57.271697+0000 mon.a (mon.0) 13563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:58 smithi179 bash[23186]: audit 2024-09-21T04:47:57.280129+0000 mon.a (mon.0) 13564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:58 smithi179 bash[23186]: audit 2024-09-21T04:47:58.029494+0000 mon.a (mon.0) 13565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:58 smithi179 bash[23186]: audit 2024-09-21T04:47:58.035183+0000 mon.a (mon.0) 13566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:58 smithi179 bash[23186]: audit 2024-09-21T04:47:58.042131+0000 mon.a (mon.0) 13567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:58 smithi049 bash[23528]: cluster 2024-09-21T04:47:57.187864+0000 mgr.a (mgr.14388) 17032 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:58 smithi049 bash[23528]: audit 2024-09-21T04:47:57.265922+0000 mon.a (mon.0) 13562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:58 smithi049 bash[23528]: audit 2024-09-21T04:47:57.271697+0000 mon.a (mon.0) 13563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:58 smithi049 bash[23528]: audit 2024-09-21T04:47:57.280129+0000 mon.a (mon.0) 13564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:58 smithi049 bash[23528]: audit 2024-09-21T04:47:58.029494+0000 mon.a (mon.0) 13565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:58 smithi049 bash[23528]: audit 2024-09-21T04:47:58.035183+0000 mon.a (mon.0) 13566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:58 smithi049 bash[23528]: audit 2024-09-21T04:47:58.042131+0000 mon.a (mon.0) 13567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:58 smithi044 bash[22676]: cluster 2024-09-21T04:47:57.187864+0000 mgr.a (mgr.14388) 17032 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:47:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:58 smithi044 bash[22676]: audit 2024-09-21T04:47:57.265922+0000 mon.a (mon.0) 13562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:58 smithi044 bash[22676]: audit 2024-09-21T04:47:57.271697+0000 mon.a (mon.0) 13563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:58 smithi044 bash[22676]: audit 2024-09-21T04:47:57.280129+0000 mon.a (mon.0) 13564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:58 smithi044 bash[22676]: audit 2024-09-21T04:47:58.029494+0000 mon.a (mon.0) 13565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:58 smithi044 bash[22676]: audit 2024-09-21T04:47:58.035183+0000 mon.a (mon.0) 13566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:58 smithi044 bash[22676]: audit 2024-09-21T04:47:58.042131+0000 mon.a (mon.0) 13567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:47:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:47:59 smithi049 bash[23528]: audit 2024-09-21T04:47:57.561842+0000 mgr.a (mgr.14388) 17033 : audit [DBG] from='client.367083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:59.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:47:59 smithi044 bash[22676]: audit 2024-09-21T04:47:57.561842+0000 mgr.a (mgr.14388) 17033 : audit [DBG] from='client.367083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:47:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:47:59 smithi179 bash[23186]: audit 2024-09-21T04:47:57.561842+0000 mgr.a (mgr.14388) 17033 : audit [DBG] from='client.367083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:00 smithi049 bash[23528]: cluster 2024-09-21T04:47:59.188812+0000 mgr.a (mgr.14388) 17034 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:00 smithi044 bash[22676]: cluster 2024-09-21T04:47:59.188812+0000 mgr.a (mgr.14388) 17034 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:00 smithi179 bash[23186]: cluster 2024-09-21T04:47:59.188812+0000 mgr.a (mgr.14388) 17034 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:02 smithi049 bash[23528]: cluster 2024-09-21T04:48:01.191143+0000 mgr.a (mgr.14388) 17035 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:02 smithi044 bash[22676]: cluster 2024-09-21T04:48:01.191143+0000 mgr.a (mgr.14388) 17035 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:02 smithi179 bash[23186]: cluster 2024-09-21T04:48:01.191143+0000 mgr.a (mgr.14388) 17035 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:03.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:03.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:03.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:03.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:03.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:04 smithi049 bash[23528]: cluster 2024-09-21T04:48:03.191937+0000 mgr.a (mgr.14388) 17036 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:04 smithi049 bash[23528]: audit 2024-09-21T04:48:03.337721+0000 mgr.a (mgr.14388) 17037 : audit [DBG] from='client.367161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:04 smithi044 bash[22676]: cluster 2024-09-21T04:48:03.191937+0000 mgr.a (mgr.14388) 17036 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:04.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:04 smithi044 bash[22676]: audit 2024-09-21T04:48:03.337721+0000 mgr.a (mgr.14388) 17037 : audit [DBG] from='client.367161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:04 smithi179 bash[23186]: cluster 2024-09-21T04:48:03.191937+0000 mgr.a (mgr.14388) 17036 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:04 smithi179 bash[23186]: audit 2024-09-21T04:48:03.337721+0000 mgr.a (mgr.14388) 17037 : audit [DBG] from='client.367161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:06 smithi049 bash[23528]: cluster 2024-09-21T04:48:05.194319+0000 mgr.a (mgr.14388) 17038 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:06.608 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:06 smithi179 bash[23186]: cluster 2024-09-21T04:48:05.194319+0000 mgr.a (mgr.14388) 17038 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:06 smithi044 bash[22676]: cluster 2024-09-21T04:48:05.194319+0000 mgr.a (mgr.14388) 17038 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:08.550 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:08 smithi049 bash[23528]: cluster 2024-09-21T04:48:07.195107+0000 mgr.a (mgr.14388) 17039 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:08 smithi049 bash[23528]: audit 2024-09-21T04:48:07.691413+0000 mon.a (mon.0) 13568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:08 smithi049 bash[23528]: audit 2024-09-21T04:48:07.700305+0000 mon.a (mon.0) 13569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.551 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:08 smithi049 bash[23528]: audit 2024-09-21T04:48:07.711074+0000 mon.a (mon.0) 13570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:08 smithi044 bash[22676]: cluster 2024-09-21T04:48:07.195107+0000 mgr.a (mgr.14388) 17039 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:08 smithi044 bash[22676]: audit 2024-09-21T04:48:07.691413+0000 mon.a (mon.0) 13568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:08 smithi044 bash[22676]: audit 2024-09-21T04:48:07.700305+0000 mon.a (mon.0) 13569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:08 smithi044 bash[22676]: audit 2024-09-21T04:48:07.711074+0000 mon.a (mon.0) 13570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:08 smithi179 bash[23186]: cluster 2024-09-21T04:48:07.195107+0000 mgr.a (mgr.14388) 17039 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:08 smithi179 bash[23186]: audit 2024-09-21T04:48:07.691413+0000 mon.a (mon.0) 13568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:08 smithi179 bash[23186]: audit 2024-09-21T04:48:07.700305+0000 mon.a (mon.0) 13569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:08 smithi179 bash[23186]: audit 2024-09-21T04:48:07.711074+0000 mon.a (mon.0) 13570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:08.780 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:08.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:08.781 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:09.557 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:09.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:09.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:09.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:09.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:10 smithi179 bash[23186]: audit 2024-09-21T04:48:09.114125+0000 mgr.a (mgr.14388) 17040 : audit [DBG] from='client.367239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:10 smithi179 bash[23186]: cluster 2024-09-21T04:48:09.195654+0000 mgr.a (mgr.14388) 17041 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:10 smithi049 bash[23528]: audit 2024-09-21T04:48:09.114125+0000 mgr.a (mgr.14388) 17040 : audit [DBG] from='client.367239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:10 smithi049 bash[23528]: cluster 2024-09-21T04:48:09.195654+0000 mgr.a (mgr.14388) 17041 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:10 smithi044 bash[22676]: audit 2024-09-21T04:48:09.114125+0000 mgr.a (mgr.14388) 17040 : audit [DBG] from='client.367239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:10 smithi044 bash[22676]: cluster 2024-09-21T04:48:09.195654+0000 mgr.a (mgr.14388) 17041 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:12 smithi044 bash[22676]: cluster 2024-09-21T04:48:11.198042+0000 mgr.a (mgr.14388) 17042 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:12 smithi179 bash[23186]: cluster 2024-09-21T04:48:11.198042+0000 mgr.a (mgr.14388) 17042 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:12 smithi049 bash[23528]: cluster 2024-09-21T04:48:11.198042+0000 mgr.a (mgr.14388) 17042 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:14.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:14 smithi044 bash[22676]: cluster 2024-09-21T04:48:13.198833+0000 mgr.a (mgr.14388) 17043 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:14 smithi179 bash[23186]: cluster 2024-09-21T04:48:13.198833+0000 mgr.a (mgr.14388) 17043 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:14 smithi049 bash[23528]: cluster 2024-09-21T04:48:13.198833+0000 mgr.a (mgr.14388) 17043 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:15.319 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:16 smithi044 bash[22676]: audit 2024-09-21T04:48:14.886681+0000 mgr.a (mgr.14388) 17044 : audit [DBG] from='client.367317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:16 smithi044 bash[22676]: cluster 2024-09-21T04:48:15.200167+0000 mgr.a (mgr.14388) 17045 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:16 smithi044 bash[22676]: audit 2024-09-21T04:48:16.238813+0000 mon.a (mon.0) 13571 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:16 smithi044 bash[22676]: audit 2024-09-21T04:48:16.246044+0000 mon.a (mon.0) 13572 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:16 smithi044 bash[22676]: audit 2024-09-21T04:48:16.247966+0000 mon.a (mon.0) 13573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:16 smithi044 bash[22676]: audit 2024-09-21T04:48:16.259328+0000 mon.a (mon.0) 13574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:16 smithi044 bash[22676]: audit 2024-09-21T04:48:16.265715+0000 mon.a (mon.0) 13575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:48:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:16 smithi179 bash[23186]: audit 2024-09-21T04:48:14.886681+0000 mgr.a (mgr.14388) 17044 : audit [DBG] from='client.367317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:16 smithi179 bash[23186]: cluster 2024-09-21T04:48:15.200167+0000 mgr.a (mgr.14388) 17045 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:16 smithi179 bash[23186]: audit 2024-09-21T04:48:16.238813+0000 mon.a (mon.0) 13571 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:48:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:16 smithi179 bash[23186]: audit 2024-09-21T04:48:16.246044+0000 mon.a (mon.0) 13572 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:48:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:16 smithi179 bash[23186]: audit 2024-09-21T04:48:16.247966+0000 mon.a (mon.0) 13573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:48:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:16 smithi179 bash[23186]: audit 2024-09-21T04:48:16.259328+0000 mon.a (mon.0) 13574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:16 smithi179 bash[23186]: audit 2024-09-21T04:48:16.265715+0000 mon.a (mon.0) 13575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:48:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:16 smithi049 bash[23528]: audit 2024-09-21T04:48:14.886681+0000 mgr.a (mgr.14388) 17044 : audit [DBG] from='client.367317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:16 smithi049 bash[23528]: cluster 2024-09-21T04:48:15.200167+0000 mgr.a (mgr.14388) 17045 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:16 smithi049 bash[23528]: audit 2024-09-21T04:48:16.238813+0000 mon.a (mon.0) 13571 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:48:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:16 smithi049 bash[23528]: audit 2024-09-21T04:48:16.246044+0000 mon.a (mon.0) 13572 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:48:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:16 smithi049 bash[23528]: audit 2024-09-21T04:48:16.247966+0000 mon.a (mon.0) 13573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:48:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:16 smithi049 bash[23528]: audit 2024-09-21T04:48:16.259328+0000 mon.a (mon.0) 13574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:16 smithi049 bash[23528]: audit 2024-09-21T04:48:16.265715+0000 mon.a (mon.0) 13575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:48:17.315 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:48:17 smithi044 bash[22930]: debug 2024-09-21T04:48:17.048+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:48:17.315 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:48:17 smithi044 bash[22930]: debug 2024-09-21T04:48:17.052+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:48:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:17 smithi044 bash[22676]: audit 2024-09-21T04:48:16.268308+0000 mgr.a (mgr.14388) 17046 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:48:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:17 smithi179 bash[23186]: audit 2024-09-21T04:48:16.268308+0000 mgr.a (mgr.14388) 17046 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:48:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:17 smithi049 bash[23528]: audit 2024-09-21T04:48:16.268308+0000 mgr.a (mgr.14388) 17046 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: audit 2024-09-21T04:48:17.051729+0000 mgr.a (mgr.14388) 17047 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: cephadm 2024-09-21T04:48:17.053269+0000 mgr.a (mgr.14388) 17048 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: cluster 2024-09-21T04:48:17.201090+0000 mgr.a (mgr.14388) 17049 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: audit 2024-09-21T04:48:17.464201+0000 mon.a (mon.0) 13576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: audit 2024-09-21T04:48:17.473905+0000 mon.a (mon.0) 13577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: audit 2024-09-21T04:48:17.485955+0000 mon.a (mon.0) 13578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: audit 2024-09-21T04:48:18.252604+0000 mon.a (mon.0) 13579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: audit 2024-09-21T04:48:18.262347+0000 mon.a (mon.0) 13580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:18 smithi044 bash[22676]: audit 2024-09-21T04:48:18.273773+0000 mon.a (mon.0) 13581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: audit 2024-09-21T04:48:17.051729+0000 mgr.a (mgr.14388) 17047 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: cephadm 2024-09-21T04:48:17.053269+0000 mgr.a (mgr.14388) 17048 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: cluster 2024-09-21T04:48:17.201090+0000 mgr.a (mgr.14388) 17049 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: audit 2024-09-21T04:48:17.464201+0000 mon.a (mon.0) 13576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: audit 2024-09-21T04:48:17.473905+0000 mon.a (mon.0) 13577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: audit 2024-09-21T04:48:17.485955+0000 mon.a (mon.0) 13578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: audit 2024-09-21T04:48:18.252604+0000 mon.a (mon.0) 13579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: audit 2024-09-21T04:48:18.262347+0000 mon.a (mon.0) 13580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:18 smithi179 bash[23186]: audit 2024-09-21T04:48:18.273773+0000 mon.a (mon.0) 13581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: audit 2024-09-21T04:48:17.051729+0000 mgr.a (mgr.14388) 17047 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: cephadm 2024-09-21T04:48:17.053269+0000 mgr.a (mgr.14388) 17048 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: cluster 2024-09-21T04:48:17.201090+0000 mgr.a (mgr.14388) 17049 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: audit 2024-09-21T04:48:17.464201+0000 mon.a (mon.0) 13576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: audit 2024-09-21T04:48:17.473905+0000 mon.a (mon.0) 13577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: audit 2024-09-21T04:48:17.485955+0000 mon.a (mon.0) 13578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: audit 2024-09-21T04:48:18.252604+0000 mon.a (mon.0) 13579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: audit 2024-09-21T04:48:18.262347+0000 mon.a (mon.0) 13580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:18 smithi049 bash[23528]: audit 2024-09-21T04:48:18.273773+0000 mon.a (mon.0) 13581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:20.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:20.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:20.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:20 smithi044 bash[22676]: cluster 2024-09-21T04:48:19.201923+0000 mgr.a (mgr.14388) 17050 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:20 smithi179 bash[23186]: cluster 2024-09-21T04:48:19.201923+0000 mgr.a (mgr.14388) 17050 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:20 smithi049 bash[23528]: cluster 2024-09-21T04:48:19.201923+0000 mgr.a (mgr.14388) 17050 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:21.097 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:21.097 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:22 smithi044 bash[22676]: audit 2024-09-21T04:48:20.657687+0000 mgr.a (mgr.14388) 17051 : audit [DBG] from='client.367497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:22.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:22 smithi044 bash[22676]: cluster 2024-09-21T04:48:21.204948+0000 mgr.a (mgr.14388) 17052 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:22 smithi179 bash[23186]: audit 2024-09-21T04:48:20.657687+0000 mgr.a (mgr.14388) 17051 : audit [DBG] from='client.367497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:22 smithi179 bash[23186]: cluster 2024-09-21T04:48:21.204948+0000 mgr.a (mgr.14388) 17052 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:22 smithi049 bash[23528]: audit 2024-09-21T04:48:20.657687+0000 mgr.a (mgr.14388) 17051 : audit [DBG] from='client.367497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:22 smithi049 bash[23528]: cluster 2024-09-21T04:48:21.204948+0000 mgr.a (mgr.14388) 17052 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:24 smithi044 bash[22676]: cluster 2024-09-21T04:48:23.205914+0000 mgr.a (mgr.14388) 17053 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:48:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:24 smithi179 bash[23186]: cluster 2024-09-21T04:48:23.205914+0000 mgr.a (mgr.14388) 17053 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:48:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:24 smithi049 bash[23528]: cluster 2024-09-21T04:48:23.205914+0000 mgr.a (mgr.14388) 17053 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:48:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:25 smithi049 bash[23528]: cluster 2024-09-21T04:48:25.208036+0000 mgr.a (mgr.14388) 17054 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:25 smithi044 bash[22676]: cluster 2024-09-21T04:48:25.208036+0000 mgr.a (mgr.14388) 17054 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:25 smithi179 bash[23186]: cluster 2024-09-21T04:48:25.208036+0000 mgr.a (mgr.14388) 17054 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:26.099 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:26.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:26.099 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:26.676 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:26 smithi049 bash[23528]: audit 2024-09-21T04:48:26.432703+0000 mgr.a (mgr.14388) 17055 : audit [DBG] from='client.367572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:26.880 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:26.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:26 smithi044 bash[22676]: audit 2024-09-21T04:48:26.432703+0000 mgr.a (mgr.14388) 17055 : audit [DBG] from='client.367572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:26 smithi179 bash[23186]: audit 2024-09-21T04:48:26.432703+0000 mgr.a (mgr.14388) 17055 : audit [DBG] from='client.367572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:27 smithi049 bash[23528]: cluster 2024-09-21T04:48:27.209052+0000 mgr.a (mgr.14388) 17056 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:27.975 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:27 smithi179 bash[23186]: cluster 2024-09-21T04:48:27.209052+0000 mgr.a (mgr.14388) 17056 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:27 smithi044 bash[22676]: cluster 2024-09-21T04:48:27.209052+0000 mgr.a (mgr.14388) 17056 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:28 smithi044 bash[22676]: audit 2024-09-21T04:48:27.871988+0000 mon.a (mon.0) 13582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:28 smithi044 bash[22676]: audit 2024-09-21T04:48:27.881642+0000 mon.a (mon.0) 13583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:28 smithi044 bash[22676]: audit 2024-09-21T04:48:27.892159+0000 mon.a (mon.0) 13584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:28 smithi179 bash[23186]: audit 2024-09-21T04:48:27.871988+0000 mon.a (mon.0) 13582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:28 smithi179 bash[23186]: audit 2024-09-21T04:48:27.881642+0000 mon.a (mon.0) 13583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:28 smithi179 bash[23186]: audit 2024-09-21T04:48:27.892159+0000 mon.a (mon.0) 13584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:28 smithi049 bash[23528]: audit 2024-09-21T04:48:27.871988+0000 mon.a (mon.0) 13582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:28 smithi049 bash[23528]: audit 2024-09-21T04:48:27.881642+0000 mon.a (mon.0) 13583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:29.283 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:28 smithi049 bash[23528]: audit 2024-09-21T04:48:27.892159+0000 mon.a (mon.0) 13584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:29 smithi044 bash[22676]: cluster 2024-09-21T04:48:29.209999+0000 mgr.a (mgr.14388) 17057 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:29 smithi179 bash[23186]: cluster 2024-09-21T04:48:29.209999+0000 mgr.a (mgr.14388) 17057 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:29 smithi049 bash[23528]: cluster 2024-09-21T04:48:29.209999+0000 mgr.a (mgr.14388) 17057 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:31.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:31.883 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:31 smithi179 bash[23186]: cluster 2024-09-21T04:48:31.212269+0000 mgr.a (mgr.14388) 17058 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:31 smithi049 bash[23528]: cluster 2024-09-21T04:48:31.212269+0000 mgr.a (mgr.14388) 17058 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:32.147 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:31 smithi044 bash[22676]: cluster 2024-09-21T04:48:31.212269+0000 mgr.a (mgr.14388) 17058 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:48:32.672 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:32.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:32 smithi179 bash[23186]: audit 2024-09-21T04:48:32.215828+0000 mgr.a (mgr.14388) 17059 : audit [DBG] from='client.367650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:32 smithi049 bash[23528]: audit 2024-09-21T04:48:32.215828+0000 mgr.a (mgr.14388) 17059 : audit [DBG] from='client.367650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:32 smithi044 bash[22676]: audit 2024-09-21T04:48:32.215828+0000 mgr.a (mgr.14388) 17059 : audit [DBG] from='client.367650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:33 smithi179 bash[23186]: cluster 2024-09-21T04:48:33.213318+0000 mgr.a (mgr.14388) 17060 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:33 smithi049 bash[23528]: cluster 2024-09-21T04:48:33.213318+0000 mgr.a (mgr.14388) 17060 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:33 smithi044 bash[22676]: cluster 2024-09-21T04:48:33.213318+0000 mgr.a (mgr.14388) 17060 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:36 smithi049 bash[23528]: cluster 2024-09-21T04:48:35.215492+0000 mgr.a (mgr.14388) 17061 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:36 smithi044 bash[22676]: cluster 2024-09-21T04:48:35.215492+0000 mgr.a (mgr.14388) 17061 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:36 smithi179 bash[23186]: cluster 2024-09-21T04:48:35.215492+0000 mgr.a (mgr.14388) 17061 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:38.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:38.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:38.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:38.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:38.479 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:38 smithi049 bash[23528]: cluster 2024-09-21T04:48:37.216265+0000 mgr.a (mgr.14388) 17062 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:38 smithi049 bash[23528]: audit 2024-09-21T04:48:37.665943+0000 mon.a (mon.0) 13585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:38 smithi049 bash[23528]: audit 2024-09-21T04:48:37.675238+0000 mon.a (mon.0) 13586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:38 smithi049 bash[23528]: audit 2024-09-21T04:48:37.685805+0000 mon.a (mon.0) 13587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:38 smithi044 bash[22676]: cluster 2024-09-21T04:48:37.216265+0000 mgr.a (mgr.14388) 17062 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:38.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:38 smithi044 bash[22676]: audit 2024-09-21T04:48:37.665943+0000 mon.a (mon.0) 13585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:38 smithi044 bash[22676]: audit 2024-09-21T04:48:37.675238+0000 mon.a (mon.0) 13586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:38 smithi044 bash[22676]: audit 2024-09-21T04:48:37.685805+0000 mon.a (mon.0) 13587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:38 smithi179 bash[23186]: cluster 2024-09-21T04:48:37.216265+0000 mgr.a (mgr.14388) 17062 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:38.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:38 smithi179 bash[23186]: audit 2024-09-21T04:48:37.665943+0000 mon.a (mon.0) 13585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:38 smithi179 bash[23186]: audit 2024-09-21T04:48:37.675238+0000 mon.a (mon.0) 13586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:38.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:38 smithi179 bash[23186]: audit 2024-09-21T04:48:37.685805+0000 mon.a (mon.0) 13587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:39 smithi044 bash[22676]: audit 2024-09-21T04:48:38.010144+0000 mgr.a (mgr.14388) 17063 : audit [DBG] from='client.367725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:39.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:39 smithi044 bash[22676]: audit 2024-09-21T04:48:38.469107+0000 mon.a (mon.0) 13588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:39 smithi044 bash[22676]: audit 2024-09-21T04:48:38.475165+0000 mon.a (mon.0) 13589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:39 smithi044 bash[22676]: audit 2024-09-21T04:48:38.481287+0000 mon.a (mon.0) 13590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:39 smithi179 bash[23186]: audit 2024-09-21T04:48:38.010144+0000 mgr.a (mgr.14388) 17063 : audit [DBG] from='client.367725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:39 smithi179 bash[23186]: audit 2024-09-21T04:48:38.469107+0000 mon.a (mon.0) 13588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:39 smithi179 bash[23186]: audit 2024-09-21T04:48:38.475165+0000 mon.a (mon.0) 13589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:39 smithi179 bash[23186]: audit 2024-09-21T04:48:38.481287+0000 mon.a (mon.0) 13590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:39 smithi049 bash[23528]: audit 2024-09-21T04:48:38.010144+0000 mgr.a (mgr.14388) 17063 : audit [DBG] from='client.367725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:39 smithi049 bash[23528]: audit 2024-09-21T04:48:38.469107+0000 mon.a (mon.0) 13588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:39 smithi049 bash[23528]: audit 2024-09-21T04:48:38.475165+0000 mon.a (mon.0) 13589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:39.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:39 smithi049 bash[23528]: audit 2024-09-21T04:48:38.481287+0000 mon.a (mon.0) 13590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:40 smithi044 bash[22676]: cluster 2024-09-21T04:48:39.216972+0000 mgr.a (mgr.14388) 17064 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:40 smithi179 bash[23186]: cluster 2024-09-21T04:48:39.216972+0000 mgr.a (mgr.14388) 17064 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:40 smithi049 bash[23528]: cluster 2024-09-21T04:48:39.216972+0000 mgr.a (mgr.14388) 17064 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:42 smithi044 bash[22676]: cluster 2024-09-21T04:48:41.219324+0000 mgr.a (mgr.14388) 17065 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:42 smithi179 bash[23186]: cluster 2024-09-21T04:48:41.219324+0000 mgr.a (mgr.14388) 17065 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:42 smithi049 bash[23528]: cluster 2024-09-21T04:48:41.219324+0000 mgr.a (mgr.14388) 17065 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:43.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:43.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:43.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:44.236 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:44 smithi044 bash[22676]: cluster 2024-09-21T04:48:43.220044+0000 mgr.a (mgr.14388) 17066 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:44 smithi179 bash[23186]: cluster 2024-09-21T04:48:43.220044+0000 mgr.a (mgr.14388) 17066 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:44 smithi049 bash[23528]: cluster 2024-09-21T04:48:43.220044+0000 mgr.a (mgr.14388) 17066 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:45 smithi179 bash[23186]: audit 2024-09-21T04:48:43.806634+0000 mgr.a (mgr.14388) 17067 : audit [DBG] from='client.367797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:45 smithi049 bash[23528]: audit 2024-09-21T04:48:43.806634+0000 mgr.a (mgr.14388) 17067 : audit [DBG] from='client.367797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:45 smithi044 bash[22676]: audit 2024-09-21T04:48:43.806634+0000 mgr.a (mgr.14388) 17067 : audit [DBG] from='client.367797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:46 smithi179 bash[23186]: cluster 2024-09-21T04:48:45.222439+0000 mgr.a (mgr.14388) 17068 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:46 smithi049 bash[23528]: cluster 2024-09-21T04:48:45.222439+0000 mgr.a (mgr.14388) 17068 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:46 smithi044 bash[22676]: cluster 2024-09-21T04:48:45.222439+0000 mgr.a (mgr.14388) 17068 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:48:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:47 smithi049 bash[23528]: cluster 2024-09-21T04:48:47.223209+0000 mgr.a (mgr.14388) 17069 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:47 smithi179 bash[23186]: cluster 2024-09-21T04:48:47.223209+0000 mgr.a (mgr.14388) 17069 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:47 smithi044 bash[22676]: cluster 2024-09-21T04:48:47.223209+0000 mgr.a (mgr.14388) 17069 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:49.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:49.238 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:49.238 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:49 smithi049 bash[23528]: audit 2024-09-21T04:48:48.046266+0000 mon.a (mon.0) 13591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:49 smithi049 bash[23528]: audit 2024-09-21T04:48:48.056616+0000 mon.a (mon.0) 13592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:49 smithi049 bash[23528]: audit 2024-09-21T04:48:48.067266+0000 mon.a (mon.0) 13593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.326 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:49 smithi179 bash[23186]: audit 2024-09-21T04:48:48.046266+0000 mon.a (mon.0) 13591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.326 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:49 smithi179 bash[23186]: audit 2024-09-21T04:48:48.056616+0000 mon.a (mon.0) 13592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.326 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:49 smithi179 bash[23186]: audit 2024-09-21T04:48:48.067266+0000 mon.a (mon.0) 13593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:49 smithi044 bash[22676]: audit 2024-09-21T04:48:48.046266+0000 mon.a (mon.0) 13591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:49 smithi044 bash[22676]: audit 2024-09-21T04:48:48.056616+0000 mon.a (mon.0) 13592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:49 smithi044 bash[22676]: audit 2024-09-21T04:48:48.067266+0000 mon.a (mon.0) 13593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:50.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:50.007 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:50 smithi049 bash[23528]: cluster 2024-09-21T04:48:49.223985+0000 mgr.a (mgr.14388) 17070 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:50.463 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:50 smithi179 bash[23186]: cluster 2024-09-21T04:48:49.223985+0000 mgr.a (mgr.14388) 17070 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:50 smithi044 bash[22676]: cluster 2024-09-21T04:48:49.223985+0000 mgr.a (mgr.14388) 17070 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:51 smithi044 bash[22676]: audit 2024-09-21T04:48:49.568224+0000 mgr.a (mgr.14388) 17071 : audit [DBG] from='client.367875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:51 smithi179 bash[23186]: audit 2024-09-21T04:48:49.568224+0000 mgr.a (mgr.14388) 17071 : audit [DBG] from='client.367875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:51 smithi049 bash[23528]: audit 2024-09-21T04:48:49.568224+0000 mgr.a (mgr.14388) 17071 : audit [DBG] from='client.367875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:52 smithi044 bash[22676]: cluster 2024-09-21T04:48:51.226433+0000 mgr.a (mgr.14388) 17072 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:48:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:52 smithi179 bash[23186]: cluster 2024-09-21T04:48:51.226433+0000 mgr.a (mgr.14388) 17072 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:48:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:52 smithi049 bash[23528]: cluster 2024-09-21T04:48:51.226433+0000 mgr.a (mgr.14388) 17072 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:48:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:54 smithi049 bash[23528]: cluster 2024-09-21T04:48:53.227257+0000 mgr.a (mgr.14388) 17073 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:48:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:54 smithi044 bash[22676]: cluster 2024-09-21T04:48:53.227257+0000 mgr.a (mgr.14388) 17073 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:48:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:54 smithi179 bash[23186]: cluster 2024-09-21T04:48:53.227257+0000 mgr.a (mgr.14388) 17073 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:48:55.008 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:48:55.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:48:55.008 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:48:55.793 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:48:55.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:48:55.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:48:55.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:48:55.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:48:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:56 smithi049 bash[23528]: cluster 2024-09-21T04:48:55.228567+0000 mgr.a (mgr.14388) 17074 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:56 smithi049 bash[23528]: audit 2024-09-21T04:48:55.343257+0000 mgr.a (mgr.14388) 17075 : audit [DBG] from='client.367953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:56 smithi044 bash[22676]: cluster 2024-09-21T04:48:55.228567+0000 mgr.a (mgr.14388) 17074 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:56 smithi044 bash[22676]: audit 2024-09-21T04:48:55.343257+0000 mgr.a (mgr.14388) 17075 : audit [DBG] from='client.367953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:56 smithi179 bash[23186]: cluster 2024-09-21T04:48:55.228567+0000 mgr.a (mgr.14388) 17074 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:48:56.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:56 smithi179 bash[23186]: audit 2024-09-21T04:48:55.343257+0000 mgr.a (mgr.14388) 17075 : audit [DBG] from='client.367953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:48:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:58 smithi049 bash[23528]: cluster 2024-09-21T04:48:57.229472+0000 mgr.a (mgr.14388) 17076 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:58 smithi049 bash[23528]: audit 2024-09-21T04:48:57.900110+0000 mon.a (mon.0) 13594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:58 smithi049 bash[23528]: audit 2024-09-21T04:48:57.907908+0000 mon.a (mon.0) 13595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:58 smithi049 bash[23528]: audit 2024-09-21T04:48:57.918376+0000 mon.a (mon.0) 13596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:58 smithi179 bash[23186]: cluster 2024-09-21T04:48:57.229472+0000 mgr.a (mgr.14388) 17076 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:58.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:58 smithi179 bash[23186]: audit 2024-09-21T04:48:57.900110+0000 mon.a (mon.0) 13594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:58 smithi179 bash[23186]: audit 2024-09-21T04:48:57.907908+0000 mon.a (mon.0) 13595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:58 smithi179 bash[23186]: audit 2024-09-21T04:48:57.918376+0000 mon.a (mon.0) 13596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:58 smithi044 bash[22676]: cluster 2024-09-21T04:48:57.229472+0000 mgr.a (mgr.14388) 17076 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:48:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:58 smithi044 bash[22676]: audit 2024-09-21T04:48:57.900110+0000 mon.a (mon.0) 13594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:58 smithi044 bash[22676]: audit 2024-09-21T04:48:57.907908+0000 mon.a (mon.0) 13595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:58 smithi044 bash[22676]: audit 2024-09-21T04:48:57.918376+0000 mon.a (mon.0) 13596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:59 smithi044 bash[22676]: audit 2024-09-21T04:48:58.688999+0000 mon.a (mon.0) 13597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:59 smithi044 bash[22676]: audit 2024-09-21T04:48:58.697799+0000 mon.a (mon.0) 13598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:59 smithi044 bash[22676]: audit 2024-09-21T04:48:58.707873+0000 mon.a (mon.0) 13599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:48:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:48:59 smithi044 bash[22676]: cluster 2024-09-21T04:48:59.230291+0000 mgr.a (mgr.14388) 17077 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:49:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:59 smithi179 bash[23186]: audit 2024-09-21T04:48:58.688999+0000 mon.a (mon.0) 13597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:59 smithi179 bash[23186]: audit 2024-09-21T04:48:58.697799+0000 mon.a (mon.0) 13598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:59 smithi179 bash[23186]: audit 2024-09-21T04:48:58.707873+0000 mon.a (mon.0) 13599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:48:59 smithi179 bash[23186]: cluster 2024-09-21T04:48:59.230291+0000 mgr.a (mgr.14388) 17077 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:49:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:59 smithi049 bash[23528]: audit 2024-09-21T04:48:58.688999+0000 mon.a (mon.0) 13597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:59 smithi049 bash[23528]: audit 2024-09-21T04:48:58.697799+0000 mon.a (mon.0) 13598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:59 smithi049 bash[23528]: audit 2024-09-21T04:48:58.707873+0000 mon.a (mon.0) 13599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:48:59 smithi049 bash[23528]: cluster 2024-09-21T04:48:59.230291+0000 mgr.a (mgr.14388) 17077 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:49:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:00.792 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:00.793 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:01.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:01.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:02 smithi049 bash[23528]: audit 2024-09-21T04:49:01.114476+0000 mgr.a (mgr.14388) 17078 : audit [DBG] from='client.368028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:02 smithi049 bash[23528]: cluster 2024-09-21T04:49:01.231653+0000 mgr.a (mgr.14388) 17079 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:02 smithi044 bash[22676]: audit 2024-09-21T04:49:01.114476+0000 mgr.a (mgr.14388) 17078 : audit [DBG] from='client.368028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:02 smithi044 bash[22676]: cluster 2024-09-21T04:49:01.231653+0000 mgr.a (mgr.14388) 17079 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:02 smithi179 bash[23186]: audit 2024-09-21T04:49:01.114476+0000 mgr.a (mgr.14388) 17078 : audit [DBG] from='client.368028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:02 smithi179 bash[23186]: cluster 2024-09-21T04:49:01.231653+0000 mgr.a (mgr.14388) 17079 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:04 smithi049 bash[23528]: cluster 2024-09-21T04:49:03.232527+0000 mgr.a (mgr.14388) 17080 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:49:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:04 smithi044 bash[22676]: cluster 2024-09-21T04:49:03.232527+0000 mgr.a (mgr.14388) 17080 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:49:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:04 smithi179 bash[23186]: cluster 2024-09-21T04:49:03.232527+0000 mgr.a (mgr.14388) 17080 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:49:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:06 smithi049 bash[23528]: cluster 2024-09-21T04:49:05.234759+0000 mgr.a (mgr.14388) 17081 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:49:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:06 smithi044 bash[22676]: cluster 2024-09-21T04:49:05.234759+0000 mgr.a (mgr.14388) 17081 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:49:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:06 smithi179 bash[23186]: cluster 2024-09-21T04:49:05.234759+0000 mgr.a (mgr.14388) 17081 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:49:07.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:07.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:07.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:07.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:07.307 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:08 smithi049 bash[23528]: audit 2024-09-21T04:49:06.878398+0000 mgr.a (mgr.14388) 17082 : audit [DBG] from='client.368106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:08 smithi049 bash[23528]: cluster 2024-09-21T04:49:07.235364+0000 mgr.a (mgr.14388) 17083 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:08 smithi049 bash[23528]: audit 2024-09-21T04:49:08.258589+0000 mon.a (mon.0) 13600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:08 smithi049 bash[23528]: audit 2024-09-21T04:49:08.267490+0000 mon.a (mon.0) 13601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:08 smithi049 bash[23528]: audit 2024-09-21T04:49:08.277915+0000 mon.a (mon.0) 13602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:08 smithi044 bash[22676]: audit 2024-09-21T04:49:06.878398+0000 mgr.a (mgr.14388) 17082 : audit [DBG] from='client.368106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:08 smithi044 bash[22676]: cluster 2024-09-21T04:49:07.235364+0000 mgr.a (mgr.14388) 17083 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:08 smithi044 bash[22676]: audit 2024-09-21T04:49:08.258589+0000 mon.a (mon.0) 13600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:08 smithi044 bash[22676]: audit 2024-09-21T04:49:08.267490+0000 mon.a (mon.0) 13601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:08 smithi044 bash[22676]: audit 2024-09-21T04:49:08.277915+0000 mon.a (mon.0) 13602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:08 smithi179 bash[23186]: audit 2024-09-21T04:49:06.878398+0000 mgr.a (mgr.14388) 17082 : audit [DBG] from='client.368106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:08 smithi179 bash[23186]: cluster 2024-09-21T04:49:07.235364+0000 mgr.a (mgr.14388) 17083 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:08 smithi179 bash[23186]: audit 2024-09-21T04:49:08.258589+0000 mon.a (mon.0) 13600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:08 smithi179 bash[23186]: audit 2024-09-21T04:49:08.267490+0000 mon.a (mon.0) 13601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:08.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:08 smithi179 bash[23186]: audit 2024-09-21T04:49:08.277915+0000 mon.a (mon.0) 13602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:10.592 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:10 smithi049 bash[23528]: cluster 2024-09-21T04:49:09.236155+0000 mgr.a (mgr.14388) 17084 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:10.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:10 smithi179 bash[23186]: cluster 2024-09-21T04:49:09.236155+0000 mgr.a (mgr.14388) 17084 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:10 smithi044 bash[22676]: cluster 2024-09-21T04:49:09.236155+0000 mgr.a (mgr.14388) 17084 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:12.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:12.310 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:12 smithi044 bash[22676]: cluster 2024-09-21T04:49:11.238453+0000 mgr.a (mgr.14388) 17085 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:12 smithi179 bash[23186]: cluster 2024-09-21T04:49:11.238453+0000 mgr.a (mgr.14388) 17085 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:12 smithi049 bash[23528]: cluster 2024-09-21T04:49:11.238453+0000 mgr.a (mgr.14388) 17085 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:13.100 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:13.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:13.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:13.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:13.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:14 smithi044 bash[22676]: audit 2024-09-21T04:49:12.642649+0000 mgr.a (mgr.14388) 17086 : audit [DBG] from='client.368184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:14 smithi044 bash[22676]: cluster 2024-09-21T04:49:13.239434+0000 mgr.a (mgr.14388) 17087 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:14 smithi179 bash[23186]: audit 2024-09-21T04:49:12.642649+0000 mgr.a (mgr.14388) 17086 : audit [DBG] from='client.368184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:14 smithi179 bash[23186]: cluster 2024-09-21T04:49:13.239434+0000 mgr.a (mgr.14388) 17087 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:14 smithi049 bash[23528]: audit 2024-09-21T04:49:12.642649+0000 mgr.a (mgr.14388) 17086 : audit [DBG] from='client.368184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:14 smithi049 bash[23528]: cluster 2024-09-21T04:49:13.239434+0000 mgr.a (mgr.14388) 17087 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:16 smithi044 bash[22676]: cluster 2024-09-21T04:49:15.241628+0000 mgr.a (mgr.14388) 17088 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:16 smithi179 bash[23186]: cluster 2024-09-21T04:49:15.241628+0000 mgr.a (mgr.14388) 17088 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:16 smithi049 bash[23528]: cluster 2024-09-21T04:49:15.241628+0000 mgr.a (mgr.14388) 17088 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:17 smithi044 bash[22676]: audit 2024-09-21T04:49:17.116646+0000 mon.a (mon.0) 13603 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:49:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:17 smithi044 bash[22676]: audit 2024-09-21T04:49:17.123809+0000 mon.a (mon.0) 13604 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:49:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:17 smithi044 bash[22676]: audit 2024-09-21T04:49:17.125751+0000 mon.a (mon.0) 13605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:49:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:17 smithi044 bash[22676]: audit 2024-09-21T04:49:17.137125+0000 mon.a (mon.0) 13606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:17 smithi044 bash[22676]: audit 2024-09-21T04:49:17.143684+0000 mon.a (mon.0) 13607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:49:17.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:17 smithi179 bash[23186]: audit 2024-09-21T04:49:17.116646+0000 mon.a (mon.0) 13603 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:49:17.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:17 smithi179 bash[23186]: audit 2024-09-21T04:49:17.123809+0000 mon.a (mon.0) 13604 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:49:17.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:17 smithi179 bash[23186]: audit 2024-09-21T04:49:17.125751+0000 mon.a (mon.0) 13605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:49:17.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:17 smithi179 bash[23186]: audit 2024-09-21T04:49:17.137125+0000 mon.a (mon.0) 13606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:17.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:17 smithi179 bash[23186]: audit 2024-09-21T04:49:17.143684+0000 mon.a (mon.0) 13607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:49:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:17 smithi049 bash[23528]: audit 2024-09-21T04:49:17.116646+0000 mon.a (mon.0) 13603 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:49:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:17 smithi049 bash[23528]: audit 2024-09-21T04:49:17.123809+0000 mon.a (mon.0) 13604 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:49:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:17 smithi049 bash[23528]: audit 2024-09-21T04:49:17.125751+0000 mon.a (mon.0) 13605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:49:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:17 smithi049 bash[23528]: audit 2024-09-21T04:49:17.137125+0000 mon.a (mon.0) 13606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:17 smithi049 bash[23528]: audit 2024-09-21T04:49:17.143684+0000 mon.a (mon.0) 13607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:49:18.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:18.102 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:18.102 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:18.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:49:17 smithi044 bash[22930]: debug 2024-09-21T04:49:17.947+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:49:18.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:49:17 smithi044 bash[22930]: debug 2024-09-21T04:49:17.947+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:49:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:18 smithi044 bash[22676]: audit 2024-09-21T04:49:17.146096+0000 mgr.a (mgr.14388) 17089 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:49:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:18 smithi044 bash[22676]: cluster 2024-09-21T04:49:17.242251+0000 mgr.a (mgr.14388) 17090 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:18 smithi044 bash[22676]: audit 2024-09-21T04:49:18.047007+0000 mon.a (mon.0) 13608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:18 smithi044 bash[22676]: audit 2024-09-21T04:49:18.052451+0000 mon.a (mon.0) 13609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:18 smithi044 bash[22676]: audit 2024-09-21T04:49:18.057307+0000 mon.a (mon.0) 13610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:18 smithi179 bash[23186]: audit 2024-09-21T04:49:17.146096+0000 mgr.a (mgr.14388) 17089 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:49:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:18 smithi179 bash[23186]: cluster 2024-09-21T04:49:17.242251+0000 mgr.a (mgr.14388) 17090 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:18 smithi179 bash[23186]: audit 2024-09-21T04:49:18.047007+0000 mon.a (mon.0) 13608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:18 smithi179 bash[23186]: audit 2024-09-21T04:49:18.052451+0000 mon.a (mon.0) 13609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:18 smithi179 bash[23186]: audit 2024-09-21T04:49:18.057307+0000 mon.a (mon.0) 13610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:18 smithi049 bash[23528]: audit 2024-09-21T04:49:17.146096+0000 mgr.a (mgr.14388) 17089 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:49:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:18 smithi049 bash[23528]: cluster 2024-09-21T04:49:17.242251+0000 mgr.a (mgr.14388) 17090 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:18 smithi049 bash[23528]: audit 2024-09-21T04:49:18.047007+0000 mon.a (mon.0) 13608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:18 smithi049 bash[23528]: audit 2024-09-21T04:49:18.052451+0000 mon.a (mon.0) 13609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:18 smithi049 bash[23528]: audit 2024-09-21T04:49:18.057307+0000 mon.a (mon.0) 13610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:18.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:18.876 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:19.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:19 smithi044 bash[22676]: audit 2024-09-21T04:49:17.951831+0000 mgr.a (mgr.14388) 17091 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:49:19.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:19 smithi044 bash[22676]: cephadm 2024-09-21T04:49:17.953084+0000 mgr.a (mgr.14388) 17092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:49:19.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:19 smithi044 bash[22676]: audit 2024-09-21T04:49:18.423826+0000 mgr.a (mgr.14388) 17093 : audit [DBG] from='client.368367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:19.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:19 smithi044 bash[22676]: audit 2024-09-21T04:49:18.864697+0000 mon.a (mon.0) 13611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:19 smithi044 bash[22676]: audit 2024-09-21T04:49:18.870115+0000 mon.a (mon.0) 13612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:19 smithi044 bash[22676]: audit 2024-09-21T04:49:18.875286+0000 mon.a (mon.0) 13613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:19 smithi179 bash[23186]: audit 2024-09-21T04:49:17.951831+0000 mgr.a (mgr.14388) 17091 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:49:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:19 smithi179 bash[23186]: cephadm 2024-09-21T04:49:17.953084+0000 mgr.a (mgr.14388) 17092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:49:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:19 smithi179 bash[23186]: audit 2024-09-21T04:49:18.423826+0000 mgr.a (mgr.14388) 17093 : audit [DBG] from='client.368367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:19 smithi179 bash[23186]: audit 2024-09-21T04:49:18.864697+0000 mon.a (mon.0) 13611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:19 smithi179 bash[23186]: audit 2024-09-21T04:49:18.870115+0000 mon.a (mon.0) 13612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:19 smithi179 bash[23186]: audit 2024-09-21T04:49:18.875286+0000 mon.a (mon.0) 13613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:19 smithi049 bash[23528]: audit 2024-09-21T04:49:17.951831+0000 mgr.a (mgr.14388) 17091 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:49:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:19 smithi049 bash[23528]: cephadm 2024-09-21T04:49:17.953084+0000 mgr.a (mgr.14388) 17092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:49:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:19 smithi049 bash[23528]: audit 2024-09-21T04:49:18.423826+0000 mgr.a (mgr.14388) 17093 : audit [DBG] from='client.368367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:19 smithi049 bash[23528]: audit 2024-09-21T04:49:18.864697+0000 mon.a (mon.0) 13611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:19 smithi049 bash[23528]: audit 2024-09-21T04:49:18.870115+0000 mon.a (mon.0) 13612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:19 smithi049 bash[23528]: audit 2024-09-21T04:49:18.875286+0000 mon.a (mon.0) 13613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:20 smithi044 bash[22676]: cluster 2024-09-21T04:49:19.242807+0000 mgr.a (mgr.14388) 17094 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:20 smithi179 bash[23186]: cluster 2024-09-21T04:49:19.242807+0000 mgr.a (mgr.14388) 17094 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:20 smithi049 bash[23528]: cluster 2024-09-21T04:49:19.242807+0000 mgr.a (mgr.14388) 17094 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:22 smithi044 bash[22676]: cluster 2024-09-21T04:49:21.245006+0000 mgr.a (mgr.14388) 17095 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:22 smithi179 bash[23186]: cluster 2024-09-21T04:49:21.245006+0000 mgr.a (mgr.14388) 17095 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:22 smithi049 bash[23528]: cluster 2024-09-21T04:49:21.245006+0000 mgr.a (mgr.14388) 17095 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:24.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:24.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:24.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:24.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:24.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:24 smithi044 bash[22676]: cluster 2024-09-21T04:49:23.245811+0000 mgr.a (mgr.14388) 17096 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:24.825 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:24 smithi049 bash[23528]: cluster 2024-09-21T04:49:23.245811+0000 mgr.a (mgr.14388) 17096 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:24.826 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:24 smithi179 bash[23186]: cluster 2024-09-21T04:49:23.245811+0000 mgr.a (mgr.14388) 17096 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:25 smithi044 bash[22676]: audit 2024-09-21T04:49:24.206670+0000 mgr.a (mgr.14388) 17097 : audit [DBG] from='client.368442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:25 smithi179 bash[23186]: audit 2024-09-21T04:49:24.206670+0000 mgr.a (mgr.14388) 17097 : audit [DBG] from='client.368442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:25 smithi049 bash[23528]: audit 2024-09-21T04:49:24.206670+0000 mgr.a (mgr.14388) 17097 : audit [DBG] from='client.368442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:26 smithi044 bash[22676]: cluster 2024-09-21T04:49:25.248154+0000 mgr.a (mgr.14388) 17098 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:26 smithi179 bash[23186]: cluster 2024-09-21T04:49:25.248154+0000 mgr.a (mgr.14388) 17098 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:26 smithi049 bash[23528]: cluster 2024-09-21T04:49:25.248154+0000 mgr.a (mgr.14388) 17098 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:28 smithi179 bash[23186]: cluster 2024-09-21T04:49:27.248934+0000 mgr.a (mgr.14388) 17099 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:28 smithi049 bash[23528]: cluster 2024-09-21T04:49:27.248934+0000 mgr.a (mgr.14388) 17099 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:28 smithi044 bash[22676]: cluster 2024-09-21T04:49:27.248934+0000 mgr.a (mgr.14388) 17099 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:29.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:29 smithi179 bash[23186]: audit 2024-09-21T04:49:28.442405+0000 mon.a (mon.0) 13614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:29 smithi179 bash[23186]: audit 2024-09-21T04:49:28.451062+0000 mon.a (mon.0) 13615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:29 smithi179 bash[23186]: audit 2024-09-21T04:49:28.461479+0000 mon.a (mon.0) 13616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:29.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:29.647 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:29 smithi044 bash[22676]: audit 2024-09-21T04:49:28.442405+0000 mon.a (mon.0) 13614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:29 smithi044 bash[22676]: audit 2024-09-21T04:49:28.451062+0000 mon.a (mon.0) 13615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:29 smithi044 bash[22676]: audit 2024-09-21T04:49:28.461479+0000 mon.a (mon.0) 13616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:29 smithi049 bash[23528]: audit 2024-09-21T04:49:28.442405+0000 mon.a (mon.0) 13614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:29 smithi049 bash[23528]: audit 2024-09-21T04:49:28.451062+0000 mon.a (mon.0) 13615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:29 smithi049 bash[23528]: audit 2024-09-21T04:49:28.461479+0000 mon.a (mon.0) 13616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:30.394 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:30.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:30.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:30.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:30.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:30.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:30 smithi179 bash[23186]: cluster 2024-09-21T04:49:29.249745+0000 mgr.a (mgr.14388) 17100 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:30 smithi049 bash[23528]: cluster 2024-09-21T04:49:29.249745+0000 mgr.a (mgr.14388) 17100 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:30 smithi044 bash[22676]: cluster 2024-09-21T04:49:29.249745+0000 mgr.a (mgr.14388) 17100 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:31 smithi044 bash[22676]: audit 2024-09-21T04:49:29.975740+0000 mgr.a (mgr.14388) 17101 : audit [DBG] from='client.368520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:31 smithi179 bash[23186]: audit 2024-09-21T04:49:29.975740+0000 mgr.a (mgr.14388) 17101 : audit [DBG] from='client.368520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:31 smithi049 bash[23528]: audit 2024-09-21T04:49:29.975740+0000 mgr.a (mgr.14388) 17101 : audit [DBG] from='client.368520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:32 smithi044 bash[22676]: cluster 2024-09-21T04:49:31.252748+0000 mgr.a (mgr.14388) 17102 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:32 smithi179 bash[23186]: cluster 2024-09-21T04:49:31.252748+0000 mgr.a (mgr.14388) 17102 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:32 smithi049 bash[23528]: cluster 2024-09-21T04:49:31.252748+0000 mgr.a (mgr.14388) 17102 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:49:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:34 smithi044 bash[22676]: cluster 2024-09-21T04:49:33.253541+0000 mgr.a (mgr.14388) 17103 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:49:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:34 smithi179 bash[23186]: cluster 2024-09-21T04:49:33.253541+0000 mgr.a (mgr.14388) 17103 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:49:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:34 smithi049 bash[23528]: cluster 2024-09-21T04:49:33.253541+0000 mgr.a (mgr.14388) 17103 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:49:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:35.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:36.182 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:36.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:36.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:36.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:36.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:36 smithi044 bash[22676]: cluster 2024-09-21T04:49:35.255449+0000 mgr.a (mgr.14388) 17104 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:36 smithi179 bash[23186]: cluster 2024-09-21T04:49:35.255449+0000 mgr.a (mgr.14388) 17104 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:36 smithi049 bash[23528]: cluster 2024-09-21T04:49:35.255449+0000 mgr.a (mgr.14388) 17104 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:37 smithi179 bash[23186]: audit 2024-09-21T04:49:35.732229+0000 mgr.a (mgr.14388) 17105 : audit [DBG] from='client.368598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:37 smithi049 bash[23528]: audit 2024-09-21T04:49:35.732229+0000 mgr.a (mgr.14388) 17105 : audit [DBG] from='client.368598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:37 smithi044 bash[22676]: audit 2024-09-21T04:49:35.732229+0000 mgr.a (mgr.14388) 17105 : audit [DBG] from='client.368598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:38.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:38 smithi044 bash[22676]: cluster 2024-09-21T04:49:37.256317+0000 mgr.a (mgr.14388) 17106 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:49:38.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:38 smithi044 bash[22676]: audit 2024-09-21T04:49:38.248768+0000 mon.a (mon.0) 13617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.564 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:38 smithi044 bash[22676]: audit 2024-09-21T04:49:38.257403+0000 mon.a (mon.0) 13618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.564 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:38 smithi044 bash[22676]: audit 2024-09-21T04:49:38.267904+0000 mon.a (mon.0) 13619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:38 smithi179 bash[23186]: cluster 2024-09-21T04:49:37.256317+0000 mgr.a (mgr.14388) 17106 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:49:38.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:38 smithi179 bash[23186]: audit 2024-09-21T04:49:38.248768+0000 mon.a (mon.0) 13617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:38 smithi179 bash[23186]: audit 2024-09-21T04:49:38.257403+0000 mon.a (mon.0) 13618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:38 smithi179 bash[23186]: audit 2024-09-21T04:49:38.267904+0000 mon.a (mon.0) 13619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:38 smithi049 bash[23528]: cluster 2024-09-21T04:49:37.256317+0000 mgr.a (mgr.14388) 17106 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:49:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:38 smithi049 bash[23528]: audit 2024-09-21T04:49:38.248768+0000 mon.a (mon.0) 13617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:38 smithi049 bash[23528]: audit 2024-09-21T04:49:38.257403+0000 mon.a (mon.0) 13618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:38.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:38 smithi049 bash[23528]: audit 2024-09-21T04:49:38.267904+0000 mon.a (mon.0) 13619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:40 smithi044 bash[22676]: audit 2024-09-21T04:49:39.084489+0000 mon.a (mon.0) 13620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:40 smithi044 bash[22676]: audit 2024-09-21T04:49:39.093443+0000 mon.a (mon.0) 13621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:40 smithi044 bash[22676]: audit 2024-09-21T04:49:39.103914+0000 mon.a (mon.0) 13622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:40 smithi044 bash[22676]: cluster 2024-09-21T04:49:39.256995+0000 mgr.a (mgr.14388) 17107 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:49:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:40 smithi179 bash[23186]: audit 2024-09-21T04:49:39.084489+0000 mon.a (mon.0) 13620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:40 smithi179 bash[23186]: audit 2024-09-21T04:49:39.093443+0000 mon.a (mon.0) 13621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:40 smithi179 bash[23186]: audit 2024-09-21T04:49:39.103914+0000 mon.a (mon.0) 13622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:40 smithi179 bash[23186]: cluster 2024-09-21T04:49:39.256995+0000 mgr.a (mgr.14388) 17107 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:49:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:40 smithi049 bash[23528]: audit 2024-09-21T04:49:39.084489+0000 mon.a (mon.0) 13620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:40 smithi049 bash[23528]: audit 2024-09-21T04:49:39.093443+0000 mon.a (mon.0) 13621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:40 smithi049 bash[23528]: audit 2024-09-21T04:49:39.103914+0000 mon.a (mon.0) 13622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:40.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:40 smithi049 bash[23528]: cluster 2024-09-21T04:49:39.256995+0000 mgr.a (mgr.14388) 17107 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:49:41.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:41.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:41.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:41.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:41.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:41.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:41.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:41.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:42 smithi044 bash[22676]: cluster 2024-09-21T04:49:41.259075+0000 mgr.a (mgr.14388) 17108 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:42 smithi179 bash[23186]: cluster 2024-09-21T04:49:41.259075+0000 mgr.a (mgr.14388) 17108 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:42 smithi049 bash[23528]: cluster 2024-09-21T04:49:41.259075+0000 mgr.a (mgr.14388) 17108 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:43 smithi044 bash[22676]: audit 2024-09-21T04:49:41.525498+0000 mgr.a (mgr.14388) 17109 : audit [DBG] from='client.368676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:43 smithi179 bash[23186]: audit 2024-09-21T04:49:41.525498+0000 mgr.a (mgr.14388) 17109 : audit [DBG] from='client.368676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:43 smithi049 bash[23528]: audit 2024-09-21T04:49:41.525498+0000 mgr.a (mgr.14388) 17109 : audit [DBG] from='client.368676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:44 smithi044 bash[22676]: cluster 2024-09-21T04:49:43.260195+0000 mgr.a (mgr.14388) 17110 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:44 smithi179 bash[23186]: cluster 2024-09-21T04:49:43.260195+0000 mgr.a (mgr.14388) 17110 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:44 smithi049 bash[23528]: cluster 2024-09-21T04:49:43.260195+0000 mgr.a (mgr.14388) 17110 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:46.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:46 smithi044 bash[22676]: cluster 2024-09-21T04:49:45.262590+0000 mgr.a (mgr.14388) 17111 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:46 smithi179 bash[23186]: cluster 2024-09-21T04:49:45.262590+0000 mgr.a (mgr.14388) 17111 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:46 smithi049 bash[23528]: cluster 2024-09-21T04:49:45.262590+0000 mgr.a (mgr.14388) 17111 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:46.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:46.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:46.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:47.756 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:48.655 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:48 smithi049 bash[23528]: cluster 2024-09-21T04:49:47.263357+0000 mgr.a (mgr.14388) 17112 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:48.656 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:48 smithi049 bash[23528]: audit 2024-09-21T04:49:47.314346+0000 mgr.a (mgr.14388) 17113 : audit [DBG] from='client.368754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:48.669 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:48 smithi179 bash[23186]: cluster 2024-09-21T04:49:47.263357+0000 mgr.a (mgr.14388) 17112 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:48.669 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:48 smithi179 bash[23186]: audit 2024-09-21T04:49:47.314346+0000 mgr.a (mgr.14388) 17113 : audit [DBG] from='client.368754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:48 smithi044 bash[22676]: cluster 2024-09-21T04:49:47.263357+0000 mgr.a (mgr.14388) 17112 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:48 smithi044 bash[22676]: audit 2024-09-21T04:49:47.314346+0000 mgr.a (mgr.14388) 17113 : audit [DBG] from='client.368754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:49.932 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:49 smithi179 bash[23186]: audit 2024-09-21T04:49:48.668000+0000 mon.a (mon.0) 13623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:49.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:49 smithi179 bash[23186]: audit 2024-09-21T04:49:48.677000+0000 mon.a (mon.0) 13624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:49.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:49 smithi179 bash[23186]: audit 2024-09-21T04:49:48.687594+0000 mon.a (mon.0) 13625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:49.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:49 smithi179 bash[23186]: cluster 2024-09-21T04:49:49.264281+0000 mgr.a (mgr.14388) 17114 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:49 smithi044 bash[22676]: audit 2024-09-21T04:49:48.668000+0000 mon.a (mon.0) 13623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:49 smithi044 bash[22676]: audit 2024-09-21T04:49:48.677000+0000 mon.a (mon.0) 13624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:49 smithi044 bash[22676]: audit 2024-09-21T04:49:48.687594+0000 mon.a (mon.0) 13625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:49 smithi044 bash[22676]: cluster 2024-09-21T04:49:49.264281+0000 mgr.a (mgr.14388) 17114 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:49 smithi049 bash[23528]: audit 2024-09-21T04:49:48.668000+0000 mon.a (mon.0) 13623 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:49 smithi049 bash[23528]: audit 2024-09-21T04:49:48.677000+0000 mon.a (mon.0) 13624 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:49 smithi049 bash[23528]: audit 2024-09-21T04:49:48.687594+0000 mon.a (mon.0) 13625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:49 smithi049 bash[23528]: cluster 2024-09-21T04:49:49.264281+0000 mgr.a (mgr.14388) 17114 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:52 smithi179 bash[23186]: cluster 2024-09-21T04:49:51.266579+0000 mgr.a (mgr.14388) 17115 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:52.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:52 smithi044 bash[22676]: cluster 2024-09-21T04:49:51.266579+0000 mgr.a (mgr.14388) 17115 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:52.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:52.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:52.759 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:52.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:52 smithi049 bash[23528]: cluster 2024-09-21T04:49:51.266579+0000 mgr.a (mgr.14388) 17115 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:53.551 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:53.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:53.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:53.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:53.552 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:54 smithi044 bash[22676]: audit 2024-09-21T04:49:53.094333+0000 mgr.a (mgr.14388) 17116 : audit [DBG] from='client.368832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:54 smithi044 bash[22676]: cluster 2024-09-21T04:49:53.267152+0000 mgr.a (mgr.14388) 17117 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:54 smithi179 bash[23186]: audit 2024-09-21T04:49:53.094333+0000 mgr.a (mgr.14388) 17116 : audit [DBG] from='client.368832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:54 smithi179 bash[23186]: cluster 2024-09-21T04:49:53.267152+0000 mgr.a (mgr.14388) 17117 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:54 smithi049 bash[23528]: audit 2024-09-21T04:49:53.094333+0000 mgr.a (mgr.14388) 17116 : audit [DBG] from='client.368832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:49:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:54 smithi049 bash[23528]: cluster 2024-09-21T04:49:53.267152+0000 mgr.a (mgr.14388) 17117 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:56 smithi044 bash[22676]: cluster 2024-09-21T04:49:55.269467+0000 mgr.a (mgr.14388) 17118 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:56 smithi179 bash[23186]: cluster 2024-09-21T04:49:55.269467+0000 mgr.a (mgr.14388) 17118 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:56 smithi049 bash[23528]: cluster 2024-09-21T04:49:55.269467+0000 mgr.a (mgr.14388) 17118 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:49:58.553 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:49:58.554 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:49:58.554 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:49:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:58 smithi044 bash[22676]: cluster 2024-09-21T04:49:57.270243+0000 mgr.a (mgr.14388) 17119 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:58 smithi179 bash[23186]: cluster 2024-09-21T04:49:57.270243+0000 mgr.a (mgr.14388) 17119 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:58 smithi049 bash[23528]: cluster 2024-09-21T04:49:57.270243+0000 mgr.a (mgr.14388) 17119 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:49:59.354 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:49:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:49:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:49:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:49:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:49:59.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:59 smithi044 bash[22676]: audit 2024-09-21T04:49:58.483954+0000 mon.a (mon.0) 13626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:59 smithi044 bash[22676]: audit 2024-09-21T04:49:58.492420+0000 mon.a (mon.0) 13627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:59 smithi044 bash[22676]: audit 2024-09-21T04:49:58.503257+0000 mon.a (mon.0) 13628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:59 smithi044 bash[22676]: audit 2024-09-21T04:49:59.273740+0000 mon.a (mon.0) 13629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:59 smithi044 bash[22676]: audit 2024-09-21T04:49:59.281402+0000 mon.a (mon.0) 13630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:49:59 smithi044 bash[22676]: audit 2024-09-21T04:49:59.287902+0000 mon.a (mon.0) 13631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:59 smithi179 bash[23186]: audit 2024-09-21T04:49:58.483954+0000 mon.a (mon.0) 13626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:59 smithi179 bash[23186]: audit 2024-09-21T04:49:58.492420+0000 mon.a (mon.0) 13627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:59 smithi179 bash[23186]: audit 2024-09-21T04:49:58.503257+0000 mon.a (mon.0) 13628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:59 smithi179 bash[23186]: audit 2024-09-21T04:49:59.273740+0000 mon.a (mon.0) 13629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:59 smithi179 bash[23186]: audit 2024-09-21T04:49:59.281402+0000 mon.a (mon.0) 13630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:49:59 smithi179 bash[23186]: audit 2024-09-21T04:49:59.287902+0000 mon.a (mon.0) 13631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:59 smithi049 bash[23528]: audit 2024-09-21T04:49:58.483954+0000 mon.a (mon.0) 13626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:59 smithi049 bash[23528]: audit 2024-09-21T04:49:58.492420+0000 mon.a (mon.0) 13627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:59 smithi049 bash[23528]: audit 2024-09-21T04:49:58.503257+0000 mon.a (mon.0) 13628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:59 smithi049 bash[23528]: audit 2024-09-21T04:49:59.273740+0000 mon.a (mon.0) 13629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:59 smithi049 bash[23528]: audit 2024-09-21T04:49:59.281402+0000 mon.a (mon.0) 13630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:49:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:49:59 smithi049 bash[23528]: audit 2024-09-21T04:49:59.287902+0000 mon.a (mon.0) 13631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:00 smithi044 bash[22676]: audit 2024-09-21T04:49:58.889421+0000 mgr.a (mgr.14388) 17120 : audit [DBG] from='client.368910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:00 smithi044 bash[22676]: cluster 2024-09-21T04:49:59.271298+0000 mgr.a (mgr.14388) 17121 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:00 smithi044 bash[22676]: cluster 2024-09-21T04:50:00.000120+0000 mon.a (mon.0) 13632 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:50:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:00 smithi179 bash[23186]: audit 2024-09-21T04:49:58.889421+0000 mgr.a (mgr.14388) 17120 : audit [DBG] from='client.368910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:00 smithi179 bash[23186]: cluster 2024-09-21T04:49:59.271298+0000 mgr.a (mgr.14388) 17121 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:00.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:00 smithi179 bash[23186]: cluster 2024-09-21T04:50:00.000120+0000 mon.a (mon.0) 13632 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:50:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:00 smithi049 bash[23528]: audit 2024-09-21T04:49:58.889421+0000 mgr.a (mgr.14388) 17120 : audit [DBG] from='client.368910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:00 smithi049 bash[23528]: cluster 2024-09-21T04:49:59.271298+0000 mgr.a (mgr.14388) 17121 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:00 smithi049 bash[23528]: cluster 2024-09-21T04:50:00.000120+0000 mon.a (mon.0) 13632 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T04:50:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:02 smithi179 bash[23186]: cluster 2024-09-21T04:50:01.273560+0000 mgr.a (mgr.14388) 17122 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:02.784 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:02 smithi044 bash[22676]: cluster 2024-09-21T04:50:01.273560+0000 mgr.a (mgr.14388) 17122 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:02.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:02 smithi049 bash[23528]: cluster 2024-09-21T04:50:01.273560+0000 mgr.a (mgr.14388) 17122 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:04 smithi179 bash[23186]: cluster 2024-09-21T04:50:03.274132+0000 mgr.a (mgr.14388) 17123 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:04.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:04 smithi049 bash[23528]: cluster 2024-09-21T04:50:03.274132+0000 mgr.a (mgr.14388) 17123 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:04 smithi044 bash[22676]: cluster 2024-09-21T04:50:03.274132+0000 mgr.a (mgr.14388) 17123 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:05.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:06 smithi179 bash[23186]: audit 2024-09-21T04:50:04.688294+0000 mgr.a (mgr.14388) 17124 : audit [DBG] from='client.368985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:06 smithi179 bash[23186]: cluster 2024-09-21T04:50:05.277103+0000 mgr.a (mgr.14388) 17125 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:50:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:06 smithi049 bash[23528]: audit 2024-09-21T04:50:04.688294+0000 mgr.a (mgr.14388) 17124 : audit [DBG] from='client.368985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:06 smithi049 bash[23528]: cluster 2024-09-21T04:50:05.277103+0000 mgr.a (mgr.14388) 17125 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:50:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:06 smithi044 bash[22676]: audit 2024-09-21T04:50:04.688294+0000 mgr.a (mgr.14388) 17124 : audit [DBG] from='client.368985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:06.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:06 smithi044 bash[22676]: cluster 2024-09-21T04:50:05.277103+0000 mgr.a (mgr.14388) 17125 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T04:50:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:08 smithi179 bash[23186]: cluster 2024-09-21T04:50:07.277942+0000 mgr.a (mgr.14388) 17126 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:50:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:08 smithi049 bash[23528]: cluster 2024-09-21T04:50:07.277942+0000 mgr.a (mgr.14388) 17126 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:50:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:08 smithi044 bash[22676]: cluster 2024-09-21T04:50:07.277942+0000 mgr.a (mgr.14388) 17126 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:50:10.128 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:10.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:10.129 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:10.170 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:09 smithi179 bash[23186]: audit 2024-09-21T04:50:08.903272+0000 mon.a (mon.0) 13633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:09 smithi179 bash[23186]: audit 2024-09-21T04:50:08.912343+0000 mon.a (mon.0) 13634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:09 smithi179 bash[23186]: audit 2024-09-21T04:50:08.923371+0000 mon.a (mon.0) 13635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:09 smithi179 bash[23186]: cluster 2024-09-21T04:50:09.278723+0000 mgr.a (mgr.14388) 17127 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:50:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:09 smithi044 bash[22676]: audit 2024-09-21T04:50:08.903272+0000 mon.a (mon.0) 13633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:09 smithi044 bash[22676]: audit 2024-09-21T04:50:08.912343+0000 mon.a (mon.0) 13634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:09 smithi044 bash[22676]: audit 2024-09-21T04:50:08.923371+0000 mon.a (mon.0) 13635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:09 smithi044 bash[22676]: cluster 2024-09-21T04:50:09.278723+0000 mgr.a (mgr.14388) 17127 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:50:10.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:09 smithi049 bash[23528]: audit 2024-09-21T04:50:08.903272+0000 mon.a (mon.0) 13633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:09 smithi049 bash[23528]: audit 2024-09-21T04:50:08.912343+0000 mon.a (mon.0) 13634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:09 smithi049 bash[23528]: audit 2024-09-21T04:50:08.923371+0000 mon.a (mon.0) 13635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:10.292 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:09 smithi049 bash[23528]: cluster 2024-09-21T04:50:09.278723+0000 mgr.a (mgr.14388) 17127 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:50:10.912 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:10.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:10.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:10.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:10.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:10 smithi044 bash[22676]: audit 2024-09-21T04:50:10.463025+0000 mgr.a (mgr.14388) 17128 : audit [DBG] from='client.128525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:10 smithi179 bash[23186]: audit 2024-09-21T04:50:10.463025+0000 mgr.a (mgr.14388) 17128 : audit [DBG] from='client.128525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:10 smithi049 bash[23528]: audit 2024-09-21T04:50:10.463025+0000 mgr.a (mgr.14388) 17128 : audit [DBG] from='client.128525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:11 smithi179 bash[23186]: cluster 2024-09-21T04:50:11.281693+0000 mgr.a (mgr.14388) 17129 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:11 smithi044 bash[22676]: cluster 2024-09-21T04:50:11.281693+0000 mgr.a (mgr.14388) 17129 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:11 smithi049 bash[23528]: cluster 2024-09-21T04:50:11.281693+0000 mgr.a (mgr.14388) 17129 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:14 smithi044 bash[22676]: cluster 2024-09-21T04:50:13.282656+0000 mgr.a (mgr.14388) 17130 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:50:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:14 smithi179 bash[23186]: cluster 2024-09-21T04:50:13.282656+0000 mgr.a (mgr.14388) 17130 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:50:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:14 smithi049 bash[23528]: cluster 2024-09-21T04:50:13.282656+0000 mgr.a (mgr.14388) 17130 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:50:15.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:15.914 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:15.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:16.719 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:16.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:16.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:16.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:16.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:16 smithi044 bash[22676]: cluster 2024-09-21T04:50:15.284767+0000 mgr.a (mgr.14388) 17131 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:16 smithi179 bash[23186]: cluster 2024-09-21T04:50:15.284767+0000 mgr.a (mgr.14388) 17131 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:16 smithi049 bash[23528]: cluster 2024-09-21T04:50:15.284767+0000 mgr.a (mgr.14388) 17131 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:17 smithi044 bash[22676]: audit 2024-09-21T04:50:16.251615+0000 mgr.a (mgr.14388) 17132 : audit [DBG] from='client.369129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:17 smithi179 bash[23186]: audit 2024-09-21T04:50:16.251615+0000 mgr.a (mgr.14388) 17132 : audit [DBG] from='client.369129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:17 smithi049 bash[23528]: audit 2024-09-21T04:50:16.251615+0000 mgr.a (mgr.14388) 17132 : audit [DBG] from='client.369129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:18.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22676]: cluster 2024-09-21T04:50:17.285914+0000 mgr.a (mgr.14388) 17133 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:50:18.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22676]: audit 2024-09-21T04:50:18.008590+0000 mon.a (mon.0) 13636 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:18.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22676]: audit 2024-09-21T04:50:18.016266+0000 mon.a (mon.0) 13637 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:50:18.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22676]: audit 2024-09-21T04:50:18.018203+0000 mon.a (mon.0) 13638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:50:18.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22676]: audit 2024-09-21T04:50:18.029964+0000 mon.a (mon.0) 13639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:18.640 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22676]: audit 2024-09-21T04:50:18.036294+0000 mon.a (mon.0) 13640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:50:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:18 smithi179 bash[23186]: cluster 2024-09-21T04:50:17.285914+0000 mgr.a (mgr.14388) 17133 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:50:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:18 smithi179 bash[23186]: audit 2024-09-21T04:50:18.008590+0000 mon.a (mon.0) 13636 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:18 smithi179 bash[23186]: audit 2024-09-21T04:50:18.016266+0000 mon.a (mon.0) 13637 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:50:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:18 smithi179 bash[23186]: audit 2024-09-21T04:50:18.018203+0000 mon.a (mon.0) 13638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:50:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:18 smithi179 bash[23186]: audit 2024-09-21T04:50:18.029964+0000 mon.a (mon.0) 13639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:18 smithi179 bash[23186]: audit 2024-09-21T04:50:18.036294+0000 mon.a (mon.0) 13640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:50:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:18 smithi049 bash[23528]: cluster 2024-09-21T04:50:17.285914+0000 mgr.a (mgr.14388) 17133 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:50:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:18 smithi049 bash[23528]: audit 2024-09-21T04:50:18.008590+0000 mon.a (mon.0) 13636 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:18 smithi049 bash[23528]: audit 2024-09-21T04:50:18.016266+0000 mon.a (mon.0) 13637 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:50:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:18 smithi049 bash[23528]: audit 2024-09-21T04:50:18.018203+0000 mon.a (mon.0) 13638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:50:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:18 smithi049 bash[23528]: audit 2024-09-21T04:50:18.029964+0000 mon.a (mon.0) 13639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:18.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:18 smithi049 bash[23528]: audit 2024-09-21T04:50:18.036294+0000 mon.a (mon.0) 13640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:50:18.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22930]: debug 2024-09-21T04:50:18.822+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:50:18.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:50:18 smithi044 bash[22930]: debug 2024-09-21T04:50:18.822+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:50:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:19 smithi044 bash[22676]: audit 2024-09-21T04:50:18.038891+0000 mgr.a (mgr.14388) 17134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:50:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:19 smithi044 bash[22676]: audit 2024-09-21T04:50:18.626726+0000 mon.a (mon.0) 13641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:19 smithi044 bash[22676]: audit 2024-09-21T04:50:18.631770+0000 mon.a (mon.0) 13642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:19 smithi044 bash[22676]: audit 2024-09-21T04:50:18.636819+0000 mon.a (mon.0) 13643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:19 smithi179 bash[23186]: audit 2024-09-21T04:50:18.038891+0000 mgr.a (mgr.14388) 17134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:50:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:19 smithi179 bash[23186]: audit 2024-09-21T04:50:18.626726+0000 mon.a (mon.0) 13641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:19 smithi179 bash[23186]: audit 2024-09-21T04:50:18.631770+0000 mon.a (mon.0) 13642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:19 smithi179 bash[23186]: audit 2024-09-21T04:50:18.636819+0000 mon.a (mon.0) 13643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:19 smithi049 bash[23528]: audit 2024-09-21T04:50:18.038891+0000 mgr.a (mgr.14388) 17134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:50:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:19 smithi049 bash[23528]: audit 2024-09-21T04:50:18.626726+0000 mon.a (mon.0) 13641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:19 smithi049 bash[23528]: audit 2024-09-21T04:50:18.631770+0000 mon.a (mon.0) 13642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:19 smithi049 bash[23528]: audit 2024-09-21T04:50:18.636819+0000 mon.a (mon.0) 13643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:20 smithi044 bash[22676]: audit 2024-09-21T04:50:18.825713+0000 mgr.a (mgr.14388) 17135 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:50:20.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:20 smithi044 bash[22676]: cephadm 2024-09-21T04:50:18.826835+0000 mgr.a (mgr.14388) 17136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:50:20.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:20 smithi044 bash[22676]: cluster 2024-09-21T04:50:19.286601+0000 mgr.a (mgr.14388) 17137 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:50:20.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:20 smithi044 bash[22676]: audit 2024-09-21T04:50:19.495868+0000 mon.a (mon.0) 13644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:20 smithi044 bash[22676]: audit 2024-09-21T04:50:19.504489+0000 mon.a (mon.0) 13645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.632 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:20 smithi044 bash[22676]: audit 2024-09-21T04:50:19.514935+0000 mon.a (mon.0) 13646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:20 smithi179 bash[23186]: audit 2024-09-21T04:50:18.825713+0000 mgr.a (mgr.14388) 17135 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:50:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:20 smithi179 bash[23186]: cephadm 2024-09-21T04:50:18.826835+0000 mgr.a (mgr.14388) 17136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:50:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:20 smithi179 bash[23186]: cluster 2024-09-21T04:50:19.286601+0000 mgr.a (mgr.14388) 17137 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:50:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:20 smithi179 bash[23186]: audit 2024-09-21T04:50:19.495868+0000 mon.a (mon.0) 13644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:20 smithi179 bash[23186]: audit 2024-09-21T04:50:19.504489+0000 mon.a (mon.0) 13645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:20 smithi179 bash[23186]: audit 2024-09-21T04:50:19.514935+0000 mon.a (mon.0) 13646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:20 smithi049 bash[23528]: audit 2024-09-21T04:50:18.825713+0000 mgr.a (mgr.14388) 17135 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:50:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:20 smithi049 bash[23528]: cephadm 2024-09-21T04:50:18.826835+0000 mgr.a (mgr.14388) 17136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:50:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:20 smithi049 bash[23528]: cluster 2024-09-21T04:50:19.286601+0000 mgr.a (mgr.14388) 17137 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:50:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:20 smithi049 bash[23528]: audit 2024-09-21T04:50:19.495868+0000 mon.a (mon.0) 13644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:20 smithi049 bash[23528]: audit 2024-09-21T04:50:19.504489+0000 mon.a (mon.0) 13645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:20 smithi049 bash[23528]: audit 2024-09-21T04:50:19.514935+0000 mon.a (mon.0) 13646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:21.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:21.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:21.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:22.494 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:22.494 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:22.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:22.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:22.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:22 smithi179 bash[23186]: cluster 2024-09-21T04:50:21.288864+0000 mgr.a (mgr.14388) 17138 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:22 smithi049 bash[23528]: cluster 2024-09-21T04:50:21.288864+0000 mgr.a (mgr.14388) 17138 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:22.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:22 smithi044 bash[22676]: cluster 2024-09-21T04:50:21.288864+0000 mgr.a (mgr.14388) 17138 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:23 smithi179 bash[23186]: audit 2024-09-21T04:50:22.054501+0000 mgr.a (mgr.14388) 17139 : audit [DBG] from='client.369312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:23 smithi049 bash[23528]: audit 2024-09-21T04:50:22.054501+0000 mgr.a (mgr.14388) 17139 : audit [DBG] from='client.369312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:23 smithi044 bash[22676]: audit 2024-09-21T04:50:22.054501+0000 mgr.a (mgr.14388) 17139 : audit [DBG] from='client.369312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:24 smithi049 bash[23528]: cluster 2024-09-21T04:50:23.289847+0000 mgr.a (mgr.14388) 17140 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:24 smithi044 bash[22676]: cluster 2024-09-21T04:50:23.289847+0000 mgr.a (mgr.14388) 17140 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:25.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:24 smithi179 bash[23186]: cluster 2024-09-21T04:50:23.289847+0000 mgr.a (mgr.14388) 17140 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:26 smithi049 bash[23528]: cluster 2024-09-21T04:50:25.292073+0000 mgr.a (mgr.14388) 17141 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:26 smithi044 bash[22676]: cluster 2024-09-21T04:50:25.292073+0000 mgr.a (mgr.14388) 17141 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:26 smithi179 bash[23186]: cluster 2024-09-21T04:50:25.292073+0000 mgr.a (mgr.14388) 17141 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:27.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:27 smithi049 bash[23528]: cluster 2024-09-21T04:50:27.292819+0000 mgr.a (mgr.14388) 17142 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:27 smithi044 bash[22676]: cluster 2024-09-21T04:50:27.292819+0000 mgr.a (mgr.14388) 17142 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:27 smithi179 bash[23186]: cluster 2024-09-21T04:50:27.292819+0000 mgr.a (mgr.14388) 17142 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:28.260 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:28 smithi049 bash[23528]: audit 2024-09-21T04:50:27.830362+0000 mgr.a (mgr.14388) 17143 : audit [DBG] from='client.369387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:28 smithi044 bash[22676]: audit 2024-09-21T04:50:27.830362+0000 mgr.a (mgr.14388) 17143 : audit [DBG] from='client.369387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:28 smithi179 bash[23186]: audit 2024-09-21T04:50:27.830362+0000 mgr.a (mgr.14388) 17143 : audit [DBG] from='client.369387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:30 smithi049 bash[23528]: audit 2024-09-21T04:50:29.110425+0000 mon.a (mon.0) 13647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:30 smithi049 bash[23528]: audit 2024-09-21T04:50:29.119587+0000 mon.a (mon.0) 13648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:30 smithi049 bash[23528]: audit 2024-09-21T04:50:29.131708+0000 mon.a (mon.0) 13649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:30 smithi049 bash[23528]: cluster 2024-09-21T04:50:29.293745+0000 mgr.a (mgr.14388) 17144 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:30.402 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:30 smithi179 bash[23186]: audit 2024-09-21T04:50:29.110425+0000 mon.a (mon.0) 13647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.402 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:30 smithi179 bash[23186]: audit 2024-09-21T04:50:29.119587+0000 mon.a (mon.0) 13648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.402 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:30 smithi179 bash[23186]: audit 2024-09-21T04:50:29.131708+0000 mon.a (mon.0) 13649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.402 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:30 smithi179 bash[23186]: cluster 2024-09-21T04:50:29.293745+0000 mgr.a (mgr.14388) 17144 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:30 smithi044 bash[22676]: audit 2024-09-21T04:50:29.110425+0000 mon.a (mon.0) 13647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:30 smithi044 bash[22676]: audit 2024-09-21T04:50:29.119587+0000 mon.a (mon.0) 13648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:30 smithi044 bash[22676]: audit 2024-09-21T04:50:29.131708+0000 mon.a (mon.0) 13649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:30 smithi044 bash[22676]: cluster 2024-09-21T04:50:29.293745+0000 mgr.a (mgr.14388) 17144 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:32.632 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:32 smithi049 bash[23528]: cluster 2024-09-21T04:50:31.296816+0000 mgr.a (mgr.14388) 17145 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:32.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:32 smithi179 bash[23186]: cluster 2024-09-21T04:50:31.296816+0000 mgr.a (mgr.14388) 17145 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:32 smithi044 bash[22676]: cluster 2024-09-21T04:50:31.296816+0000 mgr.a (mgr.14388) 17145 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:50:33.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:33.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:33.262 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:34.059 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:34.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:34.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:34.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:34.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:34 smithi044 bash[22676]: cluster 2024-09-21T04:50:33.297641+0000 mgr.a (mgr.14388) 17146 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:34 smithi179 bash[23186]: cluster 2024-09-21T04:50:33.297641+0000 mgr.a (mgr.14388) 17146 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:34 smithi049 bash[23528]: cluster 2024-09-21T04:50:33.297641+0000 mgr.a (mgr.14388) 17146 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:35 smithi044 bash[22676]: audit 2024-09-21T04:50:33.601782+0000 mgr.a (mgr.14388) 17147 : audit [DBG] from='client.369465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:35 smithi179 bash[23186]: audit 2024-09-21T04:50:33.601782+0000 mgr.a (mgr.14388) 17147 : audit [DBG] from='client.369465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:35 smithi049 bash[23528]: audit 2024-09-21T04:50:33.601782+0000 mgr.a (mgr.14388) 17147 : audit [DBG] from='client.369465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:36 smithi044 bash[22676]: cluster 2024-09-21T04:50:35.299938+0000 mgr.a (mgr.14388) 17148 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:36 smithi179 bash[23186]: cluster 2024-09-21T04:50:35.299938+0000 mgr.a (mgr.14388) 17148 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:36 smithi049 bash[23528]: cluster 2024-09-21T04:50:35.299938+0000 mgr.a (mgr.14388) 17148 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:38 smithi044 bash[22676]: cluster 2024-09-21T04:50:37.300892+0000 mgr.a (mgr.14388) 17149 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:38 smithi179 bash[23186]: cluster 2024-09-21T04:50:37.300892+0000 mgr.a (mgr.14388) 17149 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:38 smithi049 bash[23528]: cluster 2024-09-21T04:50:37.300892+0000 mgr.a (mgr.14388) 17149 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:39.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:39.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:39.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:39.865 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: audit 2024-09-21T04:50:38.843826+0000 mon.a (mon.0) 13650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: audit 2024-09-21T04:50:38.851898+0000 mon.a (mon.0) 13651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: audit 2024-09-21T04:50:38.860959+0000 mon.a (mon.0) 13652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: cluster 2024-09-21T04:50:39.301679+0000 mgr.a (mgr.14388) 17150 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: audit 2024-09-21T04:50:39.398156+0000 mgr.a (mgr.14388) 17151 : audit [DBG] from='client.369543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: audit 2024-09-21T04:50:39.706118+0000 mon.a (mon.0) 13653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: audit 2024-09-21T04:50:39.711879+0000 mon.a (mon.0) 13654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:39 smithi044 bash[22676]: audit 2024-09-21T04:50:39.717193+0000 mon.a (mon.0) 13655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: audit 2024-09-21T04:50:38.843826+0000 mon.a (mon.0) 13650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: audit 2024-09-21T04:50:38.851898+0000 mon.a (mon.0) 13651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: audit 2024-09-21T04:50:38.860959+0000 mon.a (mon.0) 13652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: cluster 2024-09-21T04:50:39.301679+0000 mgr.a (mgr.14388) 17150 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: audit 2024-09-21T04:50:39.398156+0000 mgr.a (mgr.14388) 17151 : audit [DBG] from='client.369543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: audit 2024-09-21T04:50:39.706118+0000 mon.a (mon.0) 13653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: audit 2024-09-21T04:50:39.711879+0000 mon.a (mon.0) 13654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:39 smithi179 bash[23186]: audit 2024-09-21T04:50:39.717193+0000 mon.a (mon.0) 13655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: audit 2024-09-21T04:50:38.843826+0000 mon.a (mon.0) 13650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: audit 2024-09-21T04:50:38.851898+0000 mon.a (mon.0) 13651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: audit 2024-09-21T04:50:38.860959+0000 mon.a (mon.0) 13652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: cluster 2024-09-21T04:50:39.301679+0000 mgr.a (mgr.14388) 17150 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: audit 2024-09-21T04:50:39.398156+0000 mgr.a (mgr.14388) 17151 : audit [DBG] from='client.369543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: audit 2024-09-21T04:50:39.706118+0000 mon.a (mon.0) 13653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: audit 2024-09-21T04:50:39.711879+0000 mon.a (mon.0) 13654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:39 smithi049 bash[23528]: audit 2024-09-21T04:50:39.717193+0000 mon.a (mon.0) 13655 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:42 smithi044 bash[22676]: cluster 2024-09-21T04:50:41.304083+0000 mgr.a (mgr.14388) 17152 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:42 smithi179 bash[23186]: cluster 2024-09-21T04:50:41.304083+0000 mgr.a (mgr.14388) 17152 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:42 smithi049 bash[23528]: cluster 2024-09-21T04:50:41.304083+0000 mgr.a (mgr.14388) 17152 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:50:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:44 smithi044 bash[22676]: cluster 2024-09-21T04:50:43.304977+0000 mgr.a (mgr.14388) 17153 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:44 smithi179 bash[23186]: cluster 2024-09-21T04:50:43.304977+0000 mgr.a (mgr.14388) 17153 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:44 smithi049 bash[23528]: cluster 2024-09-21T04:50:43.304977+0000 mgr.a (mgr.14388) 17153 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:44.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:44.867 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:44.867 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:45.621 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:45.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:46 smithi044 bash[22676]: audit 2024-09-21T04:50:45.194226+0000 mgr.a (mgr.14388) 17154 : audit [DBG] from='client.369621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:46.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:46 smithi044 bash[22676]: cluster 2024-09-21T04:50:45.306258+0000 mgr.a (mgr.14388) 17155 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:46 smithi179 bash[23186]: audit 2024-09-21T04:50:45.194226+0000 mgr.a (mgr.14388) 17154 : audit [DBG] from='client.369621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:46 smithi179 bash[23186]: cluster 2024-09-21T04:50:45.306258+0000 mgr.a (mgr.14388) 17155 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:46 smithi049 bash[23528]: audit 2024-09-21T04:50:45.194226+0000 mgr.a (mgr.14388) 17154 : audit [DBG] from='client.369621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:46 smithi049 bash[23528]: cluster 2024-09-21T04:50:45.306258+0000 mgr.a (mgr.14388) 17155 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:48 smithi044 bash[22676]: cluster 2024-09-21T04:50:47.307104+0000 mgr.a (mgr.14388) 17156 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:50:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:48 smithi179 bash[23186]: cluster 2024-09-21T04:50:47.307104+0000 mgr.a (mgr.14388) 17156 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:50:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:48 smithi049 bash[23528]: cluster 2024-09-21T04:50:47.307104+0000 mgr.a (mgr.14388) 17156 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:50:50.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:50.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:50.623 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:50.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:50 smithi179 bash[23186]: cluster 2024-09-21T04:50:49.307875+0000 mgr.a (mgr.14388) 17157 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:50:50.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:50 smithi179 bash[23186]: audit 2024-09-21T04:50:49.344707+0000 mon.a (mon.0) 13656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:50 smithi179 bash[23186]: audit 2024-09-21T04:50:49.353559+0000 mon.a (mon.0) 13657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:50 smithi179 bash[23186]: audit 2024-09-21T04:50:49.363977+0000 mon.a (mon.0) 13658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.717 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:50 smithi049 bash[23528]: cluster 2024-09-21T04:50:49.307875+0000 mgr.a (mgr.14388) 17157 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:50:50.718 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:50 smithi049 bash[23528]: audit 2024-09-21T04:50:49.344707+0000 mon.a (mon.0) 13656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.718 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:50 smithi049 bash[23528]: audit 2024-09-21T04:50:49.353559+0000 mon.a (mon.0) 13657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.718 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:50 smithi049 bash[23528]: audit 2024-09-21T04:50:49.363977+0000 mon.a (mon.0) 13658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:50 smithi044 bash[22676]: cluster 2024-09-21T04:50:49.307875+0000 mgr.a (mgr.14388) 17157 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:50:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:50 smithi044 bash[22676]: audit 2024-09-21T04:50:49.344707+0000 mon.a (mon.0) 13656 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:50 smithi044 bash[22676]: audit 2024-09-21T04:50:49.353559+0000 mon.a (mon.0) 13657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:50 smithi044 bash[22676]: audit 2024-09-21T04:50:49.363977+0000 mon.a (mon.0) 13658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:50:51.405 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:51.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:51.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:51.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:51.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:52.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:52 smithi044 bash[22676]: audit 2024-09-21T04:50:50.953043+0000 mgr.a (mgr.14388) 17158 : audit [DBG] from='client.369696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:52.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:52 smithi044 bash[22676]: cluster 2024-09-21T04:50:51.309341+0000 mgr.a (mgr.14388) 17159 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:52 smithi179 bash[23186]: audit 2024-09-21T04:50:50.953043+0000 mgr.a (mgr.14388) 17158 : audit [DBG] from='client.369696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:52 smithi179 bash[23186]: cluster 2024-09-21T04:50:51.309341+0000 mgr.a (mgr.14388) 17159 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:52.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:52 smithi049 bash[23528]: audit 2024-09-21T04:50:50.953043+0000 mgr.a (mgr.14388) 17158 : audit [DBG] from='client.369696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:52.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:52 smithi049 bash[23528]: cluster 2024-09-21T04:50:51.309341+0000 mgr.a (mgr.14388) 17159 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:54 smithi044 bash[22676]: cluster 2024-09-21T04:50:53.310209+0000 mgr.a (mgr.14388) 17160 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:50:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:54 smithi179 bash[23186]: cluster 2024-09-21T04:50:53.310209+0000 mgr.a (mgr.14388) 17160 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:50:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:54 smithi049 bash[23528]: cluster 2024-09-21T04:50:53.310209+0000 mgr.a (mgr.14388) 17160 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:50:56.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:50:56.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:50:56.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:50:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:56 smithi044 bash[22676]: cluster 2024-09-21T04:50:55.312186+0000 mgr.a (mgr.14388) 17161 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:56 smithi179 bash[23186]: cluster 2024-09-21T04:50:55.312186+0000 mgr.a (mgr.14388) 17161 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:56 smithi049 bash[23528]: cluster 2024-09-21T04:50:55.312186+0000 mgr.a (mgr.14388) 17161 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:57.183 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:50:57.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:50:57.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:50:57.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:50:57.183 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:50:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:58 smithi044 bash[22676]: audit 2024-09-21T04:50:56.734202+0000 mgr.a (mgr.14388) 17162 : audit [DBG] from='client.369774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:58.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:50:58 smithi044 bash[22676]: cluster 2024-09-21T04:50:57.313400+0000 mgr.a (mgr.14388) 17163 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:58 smithi179 bash[23186]: audit 2024-09-21T04:50:56.734202+0000 mgr.a (mgr.14388) 17162 : audit [DBG] from='client.369774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:50:58 smithi179 bash[23186]: cluster 2024-09-21T04:50:57.313400+0000 mgr.a (mgr.14388) 17163 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:50:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:58 smithi049 bash[23528]: audit 2024-09-21T04:50:56.734202+0000 mgr.a (mgr.14388) 17162 : audit [DBG] from='client.369774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:58.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:50:58 smithi049 bash[23528]: cluster 2024-09-21T04:50:57.313400+0000 mgr.a (mgr.14388) 17163 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:00 smithi044 bash[22676]: audit 2024-09-21T04:50:59.069919+0000 mon.a (mon.0) 13659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:00 smithi044 bash[22676]: audit 2024-09-21T04:50:59.079031+0000 mon.a (mon.0) 13660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:00 smithi044 bash[22676]: audit 2024-09-21T04:50:59.089678+0000 mon.a (mon.0) 13661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:00 smithi044 bash[22676]: cluster 2024-09-21T04:50:59.314226+0000 mgr.a (mgr.14388) 17164 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:00 smithi044 bash[22676]: audit 2024-09-21T04:50:59.922909+0000 mon.a (mon.0) 13662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:00 smithi044 bash[22676]: audit 2024-09-21T04:50:59.933093+0000 mon.a (mon.0) 13663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:00 smithi044 bash[22676]: audit 2024-09-21T04:50:59.945050+0000 mon.a (mon.0) 13664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:00 smithi179 bash[23186]: audit 2024-09-21T04:50:59.069919+0000 mon.a (mon.0) 13659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:00 smithi179 bash[23186]: audit 2024-09-21T04:50:59.079031+0000 mon.a (mon.0) 13660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:00 smithi179 bash[23186]: audit 2024-09-21T04:50:59.089678+0000 mon.a (mon.0) 13661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:00 smithi179 bash[23186]: cluster 2024-09-21T04:50:59.314226+0000 mgr.a (mgr.14388) 17164 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:00 smithi179 bash[23186]: audit 2024-09-21T04:50:59.922909+0000 mon.a (mon.0) 13662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:00 smithi179 bash[23186]: audit 2024-09-21T04:50:59.933093+0000 mon.a (mon.0) 13663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:00 smithi179 bash[23186]: audit 2024-09-21T04:50:59.945050+0000 mon.a (mon.0) 13664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:00 smithi049 bash[23528]: audit 2024-09-21T04:50:59.069919+0000 mon.a (mon.0) 13659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:00 smithi049 bash[23528]: audit 2024-09-21T04:50:59.079031+0000 mon.a (mon.0) 13660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:00 smithi049 bash[23528]: audit 2024-09-21T04:50:59.089678+0000 mon.a (mon.0) 13661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:00 smithi049 bash[23528]: cluster 2024-09-21T04:50:59.314226+0000 mgr.a (mgr.14388) 17164 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:00 smithi049 bash[23528]: audit 2024-09-21T04:50:59.922909+0000 mon.a (mon.0) 13662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:00 smithi049 bash[23528]: audit 2024-09-21T04:50:59.933093+0000 mon.a (mon.0) 13663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:00 smithi049 bash[23528]: audit 2024-09-21T04:50:59.945050+0000 mon.a (mon.0) 13664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:01 smithi049 bash[23528]: cluster 2024-09-21T04:51:01.316424+0000 mgr.a (mgr.14388) 17165 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:02.069 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:01 smithi044 bash[22676]: cluster 2024-09-21T04:51:01.316424+0000 mgr.a (mgr.14388) 17165 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:02.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:02.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:02.185 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:01 smithi179 bash[23186]: cluster 2024-09-21T04:51:01.316424+0000 mgr.a (mgr.14388) 17165 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:02.977 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:02.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:02.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:02.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:02.977 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:02 smithi049 bash[23528]: audit 2024-09-21T04:51:02.517450+0000 mgr.a (mgr.14388) 17166 : audit [DBG] from='client.369849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:02 smithi044 bash[22676]: audit 2024-09-21T04:51:02.517450+0000 mgr.a (mgr.14388) 17166 : audit [DBG] from='client.369849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:02 smithi179 bash[23186]: audit 2024-09-21T04:51:02.517450+0000 mgr.a (mgr.14388) 17166 : audit [DBG] from='client.369849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:03 smithi044 bash[22676]: cluster 2024-09-21T04:51:03.317381+0000 mgr.a (mgr.14388) 17167 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:03 smithi049 bash[23528]: cluster 2024-09-21T04:51:03.317381+0000 mgr.a (mgr.14388) 17167 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:03 smithi179 bash[23186]: cluster 2024-09-21T04:51:03.317381+0000 mgr.a (mgr.14388) 17167 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:06 smithi044 bash[22676]: cluster 2024-09-21T04:51:05.319526+0000 mgr.a (mgr.14388) 17168 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:06 smithi179 bash[23186]: cluster 2024-09-21T04:51:05.319526+0000 mgr.a (mgr.14388) 17168 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:06 smithi049 bash[23528]: cluster 2024-09-21T04:51:05.319526+0000 mgr.a (mgr.14388) 17168 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:07.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:07.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:07.979 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:08.726 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:08.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:08.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:08.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:08.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:08 smithi044 bash[22676]: cluster 2024-09-21T04:51:07.320563+0000 mgr.a (mgr.14388) 17169 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:08 smithi179 bash[23186]: cluster 2024-09-21T04:51:07.320563+0000 mgr.a (mgr.14388) 17169 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:08 smithi049 bash[23528]: cluster 2024-09-21T04:51:07.320563+0000 mgr.a (mgr.14388) 17169 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:09 smithi044 bash[22676]: audit 2024-09-21T04:51:08.307973+0000 mgr.a (mgr.14388) 17170 : audit [DBG] from='client.369927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:09 smithi179 bash[23186]: audit 2024-09-21T04:51:08.307973+0000 mgr.a (mgr.14388) 17170 : audit [DBG] from='client.369927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:09 smithi049 bash[23528]: audit 2024-09-21T04:51:08.307973+0000 mgr.a (mgr.14388) 17170 : audit [DBG] from='client.369927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:10 smithi044 bash[22676]: cluster 2024-09-21T04:51:09.321471+0000 mgr.a (mgr.14388) 17171 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:10 smithi044 bash[22676]: audit 2024-09-21T04:51:09.552083+0000 mon.a (mon.0) 13665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:10 smithi044 bash[22676]: audit 2024-09-21T04:51:09.560791+0000 mon.a (mon.0) 13666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:10 smithi044 bash[22676]: audit 2024-09-21T04:51:09.571136+0000 mon.a (mon.0) 13667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:10 smithi179 bash[23186]: cluster 2024-09-21T04:51:09.321471+0000 mgr.a (mgr.14388) 17171 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:10.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:10 smithi179 bash[23186]: audit 2024-09-21T04:51:09.552083+0000 mon.a (mon.0) 13665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:10 smithi179 bash[23186]: audit 2024-09-21T04:51:09.560791+0000 mon.a (mon.0) 13666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:10 smithi179 bash[23186]: audit 2024-09-21T04:51:09.571136+0000 mon.a (mon.0) 13667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.775 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:10 smithi049 bash[23528]: cluster 2024-09-21T04:51:09.321471+0000 mgr.a (mgr.14388) 17171 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:10.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:10 smithi049 bash[23528]: audit 2024-09-21T04:51:09.552083+0000 mon.a (mon.0) 13665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:10 smithi049 bash[23528]: audit 2024-09-21T04:51:09.560791+0000 mon.a (mon.0) 13666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:10.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:10 smithi049 bash[23528]: audit 2024-09-21T04:51:09.571136+0000 mon.a (mon.0) 13667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:12 smithi179 bash[23186]: cluster 2024-09-21T04:51:11.323742+0000 mgr.a (mgr.14388) 17172 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:12 smithi044 bash[22676]: cluster 2024-09-21T04:51:11.323742+0000 mgr.a (mgr.14388) 17172 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:12 smithi049 bash[23528]: cluster 2024-09-21T04:51:11.323742+0000 mgr.a (mgr.14388) 17172 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:14.526 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:14 smithi044 bash[22676]: cluster 2024-09-21T04:51:13.324546+0000 mgr.a (mgr.14388) 17173 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:14 smithi179 bash[23186]: cluster 2024-09-21T04:51:13.324546+0000 mgr.a (mgr.14388) 17173 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:14 smithi049 bash[23528]: cluster 2024-09-21T04:51:13.324546+0000 mgr.a (mgr.14388) 17173 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:15 smithi044 bash[22676]: audit 2024-09-21T04:51:14.061802+0000 mgr.a (mgr.14388) 17174 : audit [DBG] from='client.370002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:15 smithi179 bash[23186]: audit 2024-09-21T04:51:14.061802+0000 mgr.a (mgr.14388) 17174 : audit [DBG] from='client.370002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:15 smithi049 bash[23528]: audit 2024-09-21T04:51:14.061802+0000 mgr.a (mgr.14388) 17174 : audit [DBG] from='client.370002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:16 smithi044 bash[22676]: cluster 2024-09-21T04:51:15.327524+0000 mgr.a (mgr.14388) 17175 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:16 smithi179 bash[23186]: cluster 2024-09-21T04:51:15.327524+0000 mgr.a (mgr.14388) 17175 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:16 smithi049 bash[23528]: cluster 2024-09-21T04:51:15.327524+0000 mgr.a (mgr.14388) 17175 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:18 smithi044 bash[22676]: cluster 2024-09-21T04:51:17.328378+0000 mgr.a (mgr.14388) 17176 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:18 smithi179 bash[23186]: cluster 2024-09-21T04:51:17.328378+0000 mgr.a (mgr.14388) 17176 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:18 smithi049 bash[23528]: cluster 2024-09-21T04:51:17.328378+0000 mgr.a (mgr.14388) 17176 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:19.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:19.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:19.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:19.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:18.877397+0000 mon.a (mon.0) 13668 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:19.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:18.884575+0000 mon.a (mon.0) 13669 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:19.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:18.886501+0000 mon.a (mon.0) 13670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:19.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:18.900420+0000 mon.a (mon.0) 13671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:18.907635+0000 mon.a (mon.0) 13672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:51:19.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:19.233699+0000 mon.a (mon.0) 13673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.707 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:19.238957+0000 mon.a (mon.0) 13674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.707 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22676]: audit 2024-09-21T04:51:19.245535+0000 mon.a (mon.0) 13675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:18.877397+0000 mon.a (mon.0) 13668 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:18.884575+0000 mon.a (mon.0) 13669 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:18.886501+0000 mon.a (mon.0) 13670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:18.900420+0000 mon.a (mon.0) 13671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:18.907635+0000 mon.a (mon.0) 13672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:51:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:19.233699+0000 mon.a (mon.0) 13673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:19.238957+0000 mon.a (mon.0) 13674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:19 smithi179 bash[23186]: audit 2024-09-21T04:51:19.245535+0000 mon.a (mon.0) 13675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:18.877397+0000 mon.a (mon.0) 13668 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:18.884575+0000 mon.a (mon.0) 13669 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:18.886501+0000 mon.a (mon.0) 13670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:18.900420+0000 mon.a (mon.0) 13671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:18.907635+0000 mon.a (mon.0) 13672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:19.233699+0000 mon.a (mon.0) 13673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:19.238957+0000 mon.a (mon.0) 13674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:19 smithi049 bash[23528]: audit 2024-09-21T04:51:19.245535+0000 mon.a (mon.0) 13675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:19.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22930]: debug 2024-09-21T04:51:19.697+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:51:19.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:51:19 smithi044 bash[22930]: debug 2024-09-21T04:51:19.697+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:51:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:20.273 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:20 smithi044 bash[22676]: audit 2024-09-21T04:51:18.910183+0000 mgr.a (mgr.14388) 17177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:51:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:20 smithi044 bash[22676]: cluster 2024-09-21T04:51:19.328864+0000 mgr.a (mgr.14388) 17178 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:20 smithi044 bash[22676]: audit 2024-09-21T04:51:20.137714+0000 mon.a (mon.0) 13676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:20 smithi044 bash[22676]: audit 2024-09-21T04:51:20.144344+0000 mon.a (mon.0) 13677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:20 smithi044 bash[22676]: audit 2024-09-21T04:51:20.149714+0000 mon.a (mon.0) 13678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:20 smithi179 bash[23186]: audit 2024-09-21T04:51:18.910183+0000 mgr.a (mgr.14388) 17177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:51:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:20 smithi179 bash[23186]: cluster 2024-09-21T04:51:19.328864+0000 mgr.a (mgr.14388) 17178 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:20 smithi179 bash[23186]: audit 2024-09-21T04:51:20.137714+0000 mon.a (mon.0) 13676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:20 smithi179 bash[23186]: audit 2024-09-21T04:51:20.144344+0000 mon.a (mon.0) 13677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:20 smithi179 bash[23186]: audit 2024-09-21T04:51:20.149714+0000 mon.a (mon.0) 13678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:20 smithi049 bash[23528]: audit 2024-09-21T04:51:18.910183+0000 mgr.a (mgr.14388) 17177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:51:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:20 smithi049 bash[23528]: cluster 2024-09-21T04:51:19.328864+0000 mgr.a (mgr.14388) 17178 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:20 smithi049 bash[23528]: audit 2024-09-21T04:51:20.137714+0000 mon.a (mon.0) 13676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:20 smithi049 bash[23528]: audit 2024-09-21T04:51:20.144344+0000 mon.a (mon.0) 13677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:20 smithi049 bash[23528]: audit 2024-09-21T04:51:20.149714+0000 mon.a (mon.0) 13678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:21.731 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:21 smithi044 bash[22676]: audit 2024-09-21T04:51:19.703611+0000 mgr.a (mgr.14388) 17179 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:51:21.731 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:21 smithi044 bash[22676]: cephadm 2024-09-21T04:51:19.704754+0000 mgr.a (mgr.14388) 17180 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:51:21.731 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:21 smithi044 bash[22676]: audit 2024-09-21T04:51:19.851215+0000 mgr.a (mgr.14388) 17181 : audit [DBG] from='client.370182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:21 smithi179 bash[23186]: audit 2024-09-21T04:51:19.703611+0000 mgr.a (mgr.14388) 17179 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:51:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:21 smithi179 bash[23186]: cephadm 2024-09-21T04:51:19.704754+0000 mgr.a (mgr.14388) 17180 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:51:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:21 smithi179 bash[23186]: audit 2024-09-21T04:51:19.851215+0000 mgr.a (mgr.14388) 17181 : audit [DBG] from='client.370182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:21 smithi049 bash[23528]: audit 2024-09-21T04:51:19.703611+0000 mgr.a (mgr.14388) 17179 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:51:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:21 smithi049 bash[23528]: cephadm 2024-09-21T04:51:19.704754+0000 mgr.a (mgr.14388) 17180 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:51:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:21 smithi049 bash[23528]: audit 2024-09-21T04:51:19.851215+0000 mgr.a (mgr.14388) 17181 : audit [DBG] from='client.370182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:22 smithi044 bash[22676]: cluster 2024-09-21T04:51:21.331758+0000 mgr.a (mgr.14388) 17182 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:22 smithi179 bash[23186]: cluster 2024-09-21T04:51:21.331758+0000 mgr.a (mgr.14388) 17182 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:22 smithi049 bash[23528]: cluster 2024-09-21T04:51:21.331758+0000 mgr.a (mgr.14388) 17182 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:24 smithi044 bash[22676]: cluster 2024-09-21T04:51:23.332516+0000 mgr.a (mgr.14388) 17183 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:24 smithi179 bash[23186]: cluster 2024-09-21T04:51:23.332516+0000 mgr.a (mgr.14388) 17183 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:24 smithi049 bash[23528]: cluster 2024-09-21T04:51:23.332516+0000 mgr.a (mgr.14388) 17183 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:25.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:25.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:25.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:26.058 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:26.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:26.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:26.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:26.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:26 smithi044 bash[22676]: cluster 2024-09-21T04:51:25.334555+0000 mgr.a (mgr.14388) 17184 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:26.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:26 smithi179 bash[23186]: cluster 2024-09-21T04:51:25.334555+0000 mgr.a (mgr.14388) 17184 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:26 smithi049 bash[23528]: cluster 2024-09-21T04:51:25.334555+0000 mgr.a (mgr.14388) 17184 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:27.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:27 smithi044 bash[22676]: audit 2024-09-21T04:51:25.607777+0000 mgr.a (mgr.14388) 17185 : audit [DBG] from='client.370260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:27 smithi179 bash[23186]: audit 2024-09-21T04:51:25.607777+0000 mgr.a (mgr.14388) 17185 : audit [DBG] from='client.370260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:27 smithi049 bash[23528]: audit 2024-09-21T04:51:25.607777+0000 mgr.a (mgr.14388) 17185 : audit [DBG] from='client.370260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:28 smithi044 bash[22676]: cluster 2024-09-21T04:51:27.335529+0000 mgr.a (mgr.14388) 17186 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:28 smithi179 bash[23186]: cluster 2024-09-21T04:51:27.335529+0000 mgr.a (mgr.14388) 17186 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:28.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:28 smithi049 bash[23528]: cluster 2024-09-21T04:51:27.335529+0000 mgr.a (mgr.14388) 17186 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:30 smithi044 bash[22676]: cluster 2024-09-21T04:51:29.336337+0000 mgr.a (mgr.14388) 17187 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:30 smithi044 bash[22676]: audit 2024-09-21T04:51:29.786553+0000 mon.a (mon.0) 13679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:30 smithi044 bash[22676]: audit 2024-09-21T04:51:29.795175+0000 mon.a (mon.0) 13680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:30 smithi044 bash[22676]: audit 2024-09-21T04:51:29.805789+0000 mon.a (mon.0) 13681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:30 smithi179 bash[23186]: cluster 2024-09-21T04:51:29.336337+0000 mgr.a (mgr.14388) 17187 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:30.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:30 smithi179 bash[23186]: audit 2024-09-21T04:51:29.786553+0000 mon.a (mon.0) 13679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:30 smithi179 bash[23186]: audit 2024-09-21T04:51:29.795175+0000 mon.a (mon.0) 13680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:30 smithi179 bash[23186]: audit 2024-09-21T04:51:29.805789+0000 mon.a (mon.0) 13681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:30 smithi049 bash[23528]: cluster 2024-09-21T04:51:29.336337+0000 mgr.a (mgr.14388) 17187 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:51:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:30 smithi049 bash[23528]: audit 2024-09-21T04:51:29.786553+0000 mon.a (mon.0) 13679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:30 smithi049 bash[23528]: audit 2024-09-21T04:51:29.795175+0000 mon.a (mon.0) 13680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:30 smithi049 bash[23528]: audit 2024-09-21T04:51:29.805789+0000 mon.a (mon.0) 13681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:31.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:31.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:31.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:31.824 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:32 smithi044 bash[22676]: cluster 2024-09-21T04:51:31.337630+0000 mgr.a (mgr.14388) 17188 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:32.776 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:32 smithi044 bash[22676]: audit 2024-09-21T04:51:31.389485+0000 mgr.a (mgr.14388) 17189 : audit [DBG] from='client.370335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:32.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:32 smithi179 bash[23186]: cluster 2024-09-21T04:51:31.337630+0000 mgr.a (mgr.14388) 17188 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:32.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:32 smithi179 bash[23186]: audit 2024-09-21T04:51:31.389485+0000 mgr.a (mgr.14388) 17189 : audit [DBG] from='client.370335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:32 smithi049 bash[23528]: cluster 2024-09-21T04:51:31.337630+0000 mgr.a (mgr.14388) 17188 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:51:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:32 smithi049 bash[23528]: audit 2024-09-21T04:51:31.389485+0000 mgr.a (mgr.14388) 17189 : audit [DBG] from='client.370335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:34.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:34 smithi044 bash[22676]: cluster 2024-09-21T04:51:33.338552+0000 mgr.a (mgr.14388) 17190 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:34 smithi179 bash[23186]: cluster 2024-09-21T04:51:33.338552+0000 mgr.a (mgr.14388) 17190 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:34 smithi049 bash[23528]: cluster 2024-09-21T04:51:33.338552+0000 mgr.a (mgr.14388) 17190 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:36 smithi044 bash[22676]: cluster 2024-09-21T04:51:35.340807+0000 mgr.a (mgr.14388) 17191 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:36 smithi179 bash[23186]: cluster 2024-09-21T04:51:35.340807+0000 mgr.a (mgr.14388) 17191 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:36 smithi049 bash[23528]: cluster 2024-09-21T04:51:35.340807+0000 mgr.a (mgr.14388) 17191 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:37.585 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:37.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:37.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:37.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:37.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:38 smithi044 bash[22676]: audit 2024-09-21T04:51:37.155563+0000 mgr.a (mgr.14388) 17192 : audit [DBG] from='client.370413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:38 smithi044 bash[22676]: cluster 2024-09-21T04:51:37.341388+0000 mgr.a (mgr.14388) 17193 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:38 smithi179 bash[23186]: audit 2024-09-21T04:51:37.155563+0000 mgr.a (mgr.14388) 17192 : audit [DBG] from='client.370413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:38 smithi179 bash[23186]: cluster 2024-09-21T04:51:37.341388+0000 mgr.a (mgr.14388) 17193 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:38 smithi049 bash[23528]: audit 2024-09-21T04:51:37.155563+0000 mgr.a (mgr.14388) 17192 : audit [DBG] from='client.370413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:38 smithi049 bash[23528]: cluster 2024-09-21T04:51:37.341388+0000 mgr.a (mgr.14388) 17193 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:40 smithi044 bash[22676]: cluster 2024-09-21T04:51:39.341992+0000 mgr.a (mgr.14388) 17194 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:40 smithi044 bash[22676]: audit 2024-09-21T04:51:39.449681+0000 mon.a (mon.0) 13682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:40 smithi044 bash[22676]: audit 2024-09-21T04:51:39.458681+0000 mon.a (mon.0) 13683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:40 smithi044 bash[22676]: audit 2024-09-21T04:51:39.468970+0000 mon.a (mon.0) 13684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:40 smithi044 bash[22676]: audit 2024-09-21T04:51:40.356471+0000 mon.a (mon.0) 13685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:40 smithi044 bash[22676]: audit 2024-09-21T04:51:40.365810+0000 mon.a (mon.0) 13686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:40 smithi044 bash[22676]: audit 2024-09-21T04:51:40.375654+0000 mon.a (mon.0) 13687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:40 smithi179 bash[23186]: cluster 2024-09-21T04:51:39.341992+0000 mgr.a (mgr.14388) 17194 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:40 smithi179 bash[23186]: audit 2024-09-21T04:51:39.449681+0000 mon.a (mon.0) 13682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:40 smithi179 bash[23186]: audit 2024-09-21T04:51:39.458681+0000 mon.a (mon.0) 13683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:40 smithi179 bash[23186]: audit 2024-09-21T04:51:39.468970+0000 mon.a (mon.0) 13684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:40 smithi179 bash[23186]: audit 2024-09-21T04:51:40.356471+0000 mon.a (mon.0) 13685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:40 smithi179 bash[23186]: audit 2024-09-21T04:51:40.365810+0000 mon.a (mon.0) 13686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:40 smithi179 bash[23186]: audit 2024-09-21T04:51:40.375654+0000 mon.a (mon.0) 13687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:40 smithi049 bash[23528]: cluster 2024-09-21T04:51:39.341992+0000 mgr.a (mgr.14388) 17194 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:40 smithi049 bash[23528]: audit 2024-09-21T04:51:39.449681+0000 mon.a (mon.0) 13682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:40 smithi049 bash[23528]: audit 2024-09-21T04:51:39.458681+0000 mon.a (mon.0) 13683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:40 smithi049 bash[23528]: audit 2024-09-21T04:51:39.468970+0000 mon.a (mon.0) 13684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:40 smithi049 bash[23528]: audit 2024-09-21T04:51:40.356471+0000 mon.a (mon.0) 13685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:40 smithi049 bash[23528]: audit 2024-09-21T04:51:40.365810+0000 mon.a (mon.0) 13686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:40 smithi049 bash[23528]: audit 2024-09-21T04:51:40.375654+0000 mon.a (mon.0) 13687 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:42.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:42.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:42.587 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:42 smithi044 bash[22676]: cluster 2024-09-21T04:51:41.344173+0000 mgr.a (mgr.14388) 17195 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:42 smithi179 bash[23186]: cluster 2024-09-21T04:51:41.344173+0000 mgr.a (mgr.14388) 17195 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:42 smithi049 bash[23528]: cluster 2024-09-21T04:51:41.344173+0000 mgr.a (mgr.14388) 17195 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:43.345 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:43.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:43.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:43.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:43.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:44 smithi044 bash[22676]: audit 2024-09-21T04:51:42.920162+0000 mgr.a (mgr.14388) 17196 : audit [DBG] from='client.370491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:44 smithi044 bash[22676]: cluster 2024-09-21T04:51:43.344996+0000 mgr.a (mgr.14388) 17197 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:44 smithi179 bash[23186]: audit 2024-09-21T04:51:42.920162+0000 mgr.a (mgr.14388) 17196 : audit [DBG] from='client.370491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:44 smithi179 bash[23186]: cluster 2024-09-21T04:51:43.344996+0000 mgr.a (mgr.14388) 17197 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:44 smithi049 bash[23528]: audit 2024-09-21T04:51:42.920162+0000 mgr.a (mgr.14388) 17196 : audit [DBG] from='client.370491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:44 smithi049 bash[23528]: cluster 2024-09-21T04:51:43.344996+0000 mgr.a (mgr.14388) 17197 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:46 smithi044 bash[22676]: cluster 2024-09-21T04:51:45.347405+0000 mgr.a (mgr.14388) 17198 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:46 smithi179 bash[23186]: cluster 2024-09-21T04:51:45.347405+0000 mgr.a (mgr.14388) 17198 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:46 smithi049 bash[23528]: cluster 2024-09-21T04:51:45.347405+0000 mgr.a (mgr.14388) 17198 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:48 smithi044 bash[22676]: cluster 2024-09-21T04:51:47.348377+0000 mgr.a (mgr.14388) 17199 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:48 smithi179 bash[23186]: cluster 2024-09-21T04:51:47.348377+0000 mgr.a (mgr.14388) 17199 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:48.773 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:48 smithi049 bash[23528]: cluster 2024-09-21T04:51:47.348377+0000 mgr.a (mgr.14388) 17199 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:49.132 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:49.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:49.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:49.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:49.133 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:50 smithi044 bash[22676]: audit 2024-09-21T04:51:48.680456+0000 mgr.a (mgr.14388) 17200 : audit [DBG] from='client.370569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:50 smithi044 bash[22676]: cluster 2024-09-21T04:51:49.349434+0000 mgr.a (mgr.14388) 17201 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:50 smithi044 bash[22676]: audit 2024-09-21T04:51:50.023727+0000 mon.a (mon.0) 13688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:50 smithi044 bash[22676]: audit 2024-09-21T04:51:50.033617+0000 mon.a (mon.0) 13689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:50 smithi044 bash[22676]: audit 2024-09-21T04:51:50.044543+0000 mon.a (mon.0) 13690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:50 smithi179 bash[23186]: audit 2024-09-21T04:51:48.680456+0000 mgr.a (mgr.14388) 17200 : audit [DBG] from='client.370569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:50 smithi179 bash[23186]: cluster 2024-09-21T04:51:49.349434+0000 mgr.a (mgr.14388) 17201 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:50 smithi179 bash[23186]: audit 2024-09-21T04:51:50.023727+0000 mon.a (mon.0) 13688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:50 smithi179 bash[23186]: audit 2024-09-21T04:51:50.033617+0000 mon.a (mon.0) 13689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:50 smithi179 bash[23186]: audit 2024-09-21T04:51:50.044543+0000 mon.a (mon.0) 13690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.763 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:50 smithi049 bash[23528]: audit 2024-09-21T04:51:48.680456+0000 mgr.a (mgr.14388) 17200 : audit [DBG] from='client.370569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:50.763 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:50 smithi049 bash[23528]: cluster 2024-09-21T04:51:49.349434+0000 mgr.a (mgr.14388) 17201 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:50.763 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:50 smithi049 bash[23528]: audit 2024-09-21T04:51:50.023727+0000 mon.a (mon.0) 13688 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.763 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:50 smithi049 bash[23528]: audit 2024-09-21T04:51:50.033617+0000 mon.a (mon.0) 13689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:50.763 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:50 smithi049 bash[23528]: audit 2024-09-21T04:51:50.044543+0000 mon.a (mon.0) 13690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:51:52.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:52 smithi044 bash[22676]: cluster 2024-09-21T04:51:51.351730+0000 mgr.a (mgr.14388) 17202 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:52 smithi179 bash[23186]: cluster 2024-09-21T04:51:51.351730+0000 mgr.a (mgr.14388) 17202 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:52.770 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:52 smithi049 bash[23528]: cluster 2024-09-21T04:51:51.351730+0000 mgr.a (mgr.14388) 17202 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:51:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:54 smithi179 bash[23186]: cluster 2024-09-21T04:51:53.352493+0000 mgr.a (mgr.14388) 17203 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:54 smithi049 bash[23528]: cluster 2024-09-21T04:51:53.352493+0000 mgr.a (mgr.14388) 17203 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:54.922 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:51:54.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:51:54.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:51:54.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:51:54.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:51:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:54 smithi044 bash[22676]: cluster 2024-09-21T04:51:53.352493+0000 mgr.a (mgr.14388) 17203 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:55 smithi179 bash[23186]: audit 2024-09-21T04:51:54.473113+0000 mgr.a (mgr.14388) 17204 : audit [DBG] from='client.370641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:55 smithi049 bash[23528]: audit 2024-09-21T04:51:54.473113+0000 mgr.a (mgr.14388) 17204 : audit [DBG] from='client.370641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:55 smithi044 bash[22676]: audit 2024-09-21T04:51:54.473113+0000 mgr.a (mgr.14388) 17204 : audit [DBG] from='client.370641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:56 smithi179 bash[23186]: cluster 2024-09-21T04:51:55.354952+0000 mgr.a (mgr.14388) 17205 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:56 smithi049 bash[23528]: cluster 2024-09-21T04:51:55.354952+0000 mgr.a (mgr.14388) 17205 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:56 smithi044 bash[22676]: cluster 2024-09-21T04:51:55.354952+0000 mgr.a (mgr.14388) 17205 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:51:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:51:58 smithi049 bash[23528]: cluster 2024-09-21T04:51:57.355771+0000 mgr.a (mgr.14388) 17206 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:51:58 smithi044 bash[22676]: cluster 2024-09-21T04:51:57.355771+0000 mgr.a (mgr.14388) 17206 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:51:58 smithi179 bash[23186]: cluster 2024-09-21T04:51:57.355771+0000 mgr.a (mgr.14388) 17206 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:51:59.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:51:59.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:51:59.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:00.725 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:00.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:00.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:00.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:00.725 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:00 smithi049 bash[23528]: cluster 2024-09-21T04:51:59.356556+0000 mgr.a (mgr.14388) 17207 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:00.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:00 smithi049 bash[23528]: audit 2024-09-21T04:51:59.692282+0000 mon.a (mon.0) 13691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:00.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:00 smithi049 bash[23528]: audit 2024-09-21T04:51:59.700638+0000 mon.a (mon.0) 13692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:00.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:00 smithi049 bash[23528]: audit 2024-09-21T04:51:59.712542+0000 mon.a (mon.0) 13693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:00 smithi044 bash[22676]: cluster 2024-09-21T04:51:59.356556+0000 mgr.a (mgr.14388) 17207 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:00 smithi044 bash[22676]: audit 2024-09-21T04:51:59.692282+0000 mon.a (mon.0) 13691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:00 smithi044 bash[22676]: audit 2024-09-21T04:51:59.700638+0000 mon.a (mon.0) 13692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:00 smithi044 bash[22676]: audit 2024-09-21T04:51:59.712542+0000 mon.a (mon.0) 13693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:00 smithi179 bash[23186]: cluster 2024-09-21T04:51:59.356556+0000 mgr.a (mgr.14388) 17207 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:01.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:00 smithi179 bash[23186]: audit 2024-09-21T04:51:59.692282+0000 mon.a (mon.0) 13691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:00 smithi179 bash[23186]: audit 2024-09-21T04:51:59.700638+0000 mon.a (mon.0) 13692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:00 smithi179 bash[23186]: audit 2024-09-21T04:51:59.712542+0000 mon.a (mon.0) 13693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:01 smithi044 bash[22676]: audit 2024-09-21T04:52:00.259427+0000 mgr.a (mgr.14388) 17208 : audit [DBG] from='client.370716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:01.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:01 smithi044 bash[22676]: audit 2024-09-21T04:52:00.536106+0000 mon.a (mon.0) 13694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:01 smithi044 bash[22676]: audit 2024-09-21T04:52:00.541039+0000 mon.a (mon.0) 13695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:01 smithi044 bash[22676]: audit 2024-09-21T04:52:00.546288+0000 mon.a (mon.0) 13696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:01 smithi049 bash[23528]: audit 2024-09-21T04:52:00.259427+0000 mgr.a (mgr.14388) 17208 : audit [DBG] from='client.370716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:01.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:01 smithi049 bash[23528]: audit 2024-09-21T04:52:00.536106+0000 mon.a (mon.0) 13694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:01 smithi049 bash[23528]: audit 2024-09-21T04:52:00.541039+0000 mon.a (mon.0) 13695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:01.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:01 smithi049 bash[23528]: audit 2024-09-21T04:52:00.546288+0000 mon.a (mon.0) 13696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:01 smithi179 bash[23186]: audit 2024-09-21T04:52:00.259427+0000 mgr.a (mgr.14388) 17208 : audit [DBG] from='client.370716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:01 smithi179 bash[23186]: audit 2024-09-21T04:52:00.536106+0000 mon.a (mon.0) 13694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:01 smithi179 bash[23186]: audit 2024-09-21T04:52:00.541039+0000 mon.a (mon.0) 13695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:01 smithi179 bash[23186]: audit 2024-09-21T04:52:00.546288+0000 mon.a (mon.0) 13696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:02.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:02 smithi049 bash[23528]: cluster 2024-09-21T04:52:01.359596+0000 mgr.a (mgr.14388) 17209 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:02.859 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:02 smithi044 bash[22676]: cluster 2024-09-21T04:52:01.359596+0000 mgr.a (mgr.14388) 17209 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:02 smithi179 bash[23186]: cluster 2024-09-21T04:52:01.359596+0000 mgr.a (mgr.14388) 17209 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:03 smithi044 bash[22676]: cluster 2024-09-21T04:52:03.360394+0000 mgr.a (mgr.14388) 17210 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:03 smithi179 bash[23186]: cluster 2024-09-21T04:52:03.360394+0000 mgr.a (mgr.14388) 17210 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:03 smithi049 bash[23528]: cluster 2024-09-21T04:52:03.360394+0000 mgr.a (mgr.14388) 17210 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:05.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:06.520 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:06 smithi044 bash[22676]: cluster 2024-09-21T04:52:05.362483+0000 mgr.a (mgr.14388) 17211 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:06 smithi179 bash[23186]: cluster 2024-09-21T04:52:05.362483+0000 mgr.a (mgr.14388) 17211 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:06 smithi049 bash[23528]: cluster 2024-09-21T04:52:05.362483+0000 mgr.a (mgr.14388) 17211 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:07 smithi044 bash[22676]: audit 2024-09-21T04:52:06.062066+0000 mgr.a (mgr.14388) 17212 : audit [DBG] from='client.370791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:07 smithi179 bash[23186]: audit 2024-09-21T04:52:06.062066+0000 mgr.a (mgr.14388) 17212 : audit [DBG] from='client.370791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:07 smithi049 bash[23528]: audit 2024-09-21T04:52:06.062066+0000 mgr.a (mgr.14388) 17212 : audit [DBG] from='client.370791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:08 smithi044 bash[22676]: cluster 2024-09-21T04:52:07.363472+0000 mgr.a (mgr.14388) 17213 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:08 smithi179 bash[23186]: cluster 2024-09-21T04:52:07.363472+0000 mgr.a (mgr.14388) 17213 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:08 smithi049 bash[23528]: cluster 2024-09-21T04:52:07.363472+0000 mgr.a (mgr.14388) 17213 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:10 smithi049 bash[23528]: cluster 2024-09-21T04:52:09.364338+0000 mgr.a (mgr.14388) 17214 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:10 smithi049 bash[23528]: audit 2024-09-21T04:52:10.261956+0000 mon.a (mon.0) 13697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:10 smithi049 bash[23528]: audit 2024-09-21T04:52:10.271053+0000 mon.a (mon.0) 13698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:10 smithi049 bash[23528]: audit 2024-09-21T04:52:10.281655+0000 mon.a (mon.0) 13699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:10 smithi044 bash[22676]: cluster 2024-09-21T04:52:09.364338+0000 mgr.a (mgr.14388) 17214 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:10 smithi044 bash[22676]: audit 2024-09-21T04:52:10.261956+0000 mon.a (mon.0) 13697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:10 smithi044 bash[22676]: audit 2024-09-21T04:52:10.271053+0000 mon.a (mon.0) 13698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:10 smithi044 bash[22676]: audit 2024-09-21T04:52:10.281655+0000 mon.a (mon.0) 13699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:10 smithi179 bash[23186]: cluster 2024-09-21T04:52:09.364338+0000 mgr.a (mgr.14388) 17214 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:10 smithi179 bash[23186]: audit 2024-09-21T04:52:10.261956+0000 mon.a (mon.0) 13697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:10 smithi179 bash[23186]: audit 2024-09-21T04:52:10.271053+0000 mon.a (mon.0) 13698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:10 smithi179 bash[23186]: audit 2024-09-21T04:52:10.281655+0000 mon.a (mon.0) 13699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:11.522 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:11.523 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:12.306 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:12.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:12.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:12.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:12.307 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:12.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:12 smithi044 bash[22676]: cluster 2024-09-21T04:52:11.366562+0000 mgr.a (mgr.14388) 17215 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:12 smithi179 bash[23186]: cluster 2024-09-21T04:52:11.366562+0000 mgr.a (mgr.14388) 17215 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:12 smithi049 bash[23528]: cluster 2024-09-21T04:52:11.366562+0000 mgr.a (mgr.14388) 17215 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:13 smithi044 bash[22676]: audit 2024-09-21T04:52:11.857736+0000 mgr.a (mgr.14388) 17216 : audit [DBG] from='client.370869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:13 smithi179 bash[23186]: audit 2024-09-21T04:52:11.857736+0000 mgr.a (mgr.14388) 17216 : audit [DBG] from='client.370869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:13 smithi049 bash[23528]: audit 2024-09-21T04:52:11.857736+0000 mgr.a (mgr.14388) 17216 : audit [DBG] from='client.370869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:14 smithi179 bash[23186]: cluster 2024-09-21T04:52:13.367585+0000 mgr.a (mgr.14388) 17217 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:14 smithi044 bash[22676]: cluster 2024-09-21T04:52:13.367585+0000 mgr.a (mgr.14388) 17217 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:14.796 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:14 smithi049 bash[23528]: cluster 2024-09-21T04:52:13.367585+0000 mgr.a (mgr.14388) 17217 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:16 smithi044 bash[22676]: cluster 2024-09-21T04:52:15.369831+0000 mgr.a (mgr.14388) 17218 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:16 smithi179 bash[23186]: cluster 2024-09-21T04:52:15.369831+0000 mgr.a (mgr.14388) 17218 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:16 smithi049 bash[23528]: cluster 2024-09-21T04:52:15.369831+0000 mgr.a (mgr.14388) 17218 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:17.308 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:17.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:17.309 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:18.072 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:18.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:18.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:18.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:18.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:18 smithi044 bash[22676]: cluster 2024-09-21T04:52:17.370596+0000 mgr.a (mgr.14388) 17219 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:18 smithi179 bash[23186]: cluster 2024-09-21T04:52:17.370596+0000 mgr.a (mgr.14388) 17219 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:18.818 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:18 smithi049 bash[23528]: cluster 2024-09-21T04:52:17.370596+0000 mgr.a (mgr.14388) 17219 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:19 smithi044 bash[22676]: audit 2024-09-21T04:52:17.641464+0000 mgr.a (mgr.14388) 17220 : audit [DBG] from='client.370944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:19 smithi179 bash[23186]: audit 2024-09-21T04:52:17.641464+0000 mgr.a (mgr.14388) 17220 : audit [DBG] from='client.370944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:19 smithi049 bash[23528]: audit 2024-09-21T04:52:17.641464+0000 mgr.a (mgr.14388) 17220 : audit [DBG] from='client.370944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:20.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: cluster 2024-09-21T04:52:19.371612+0000 mgr.a (mgr.14388) 17221 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:20.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.763666+0000 mon.a (mon.0) 13700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:20.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.771266+0000 mon.a (mon.0) 13701 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:20.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.772483+0000 mon.a (mon.0) 13702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:20.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.782085+0000 mon.a (mon.0) 13703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.786101+0000 mon.a (mon.0) 13704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:52:20.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.899907+0000 mon.a (mon.0) 13705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.906460+0000 mon.a (mon.0) 13706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:20 smithi179 bash[23186]: audit 2024-09-21T04:52:19.914580+0000 mon.a (mon.0) 13707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22930]: debug 2024-09-21T04:52:20.580+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22930]: debug 2024-09-21T04:52:20.584+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: cluster 2024-09-21T04:52:19.371612+0000 mgr.a (mgr.14388) 17221 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.763666+0000 mon.a (mon.0) 13700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.771266+0000 mon.a (mon.0) 13701 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.772483+0000 mon.a (mon.0) 13702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.782085+0000 mon.a (mon.0) 13703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.786101+0000 mon.a (mon.0) 13704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.899907+0000 mon.a (mon.0) 13705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.906460+0000 mon.a (mon.0) 13706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:20 smithi044 bash[22676]: audit 2024-09-21T04:52:19.914580+0000 mon.a (mon.0) 13707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: cluster 2024-09-21T04:52:19.371612+0000 mgr.a (mgr.14388) 17221 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.763666+0000 mon.a (mon.0) 13700 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.771266+0000 mon.a (mon.0) 13701 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.772483+0000 mon.a (mon.0) 13702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.782085+0000 mon.a (mon.0) 13703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.786101+0000 mon.a (mon.0) 13704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.899907+0000 mon.a (mon.0) 13705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.906460+0000 mon.a (mon.0) 13706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:20.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:20 smithi049 bash[23528]: audit 2024-09-21T04:52:19.914580+0000 mon.a (mon.0) 13707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:21 smithi044 bash[22676]: audit 2024-09-21T04:52:19.787750+0000 mgr.a (mgr.14388) 17222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:52:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:21 smithi044 bash[22676]: audit 2024-09-21T04:52:20.704896+0000 mon.a (mon.0) 13708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:21 smithi044 bash[22676]: audit 2024-09-21T04:52:20.712816+0000 mon.a (mon.0) 13709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:21 smithi044 bash[22676]: audit 2024-09-21T04:52:20.722590+0000 mon.a (mon.0) 13710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:21 smithi179 bash[23186]: audit 2024-09-21T04:52:19.787750+0000 mgr.a (mgr.14388) 17222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:52:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:21 smithi179 bash[23186]: audit 2024-09-21T04:52:20.704896+0000 mon.a (mon.0) 13708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:21 smithi179 bash[23186]: audit 2024-09-21T04:52:20.712816+0000 mon.a (mon.0) 13709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:21 smithi179 bash[23186]: audit 2024-09-21T04:52:20.722590+0000 mon.a (mon.0) 13710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:21 smithi049 bash[23528]: audit 2024-09-21T04:52:19.787750+0000 mgr.a (mgr.14388) 17222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:52:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:21 smithi049 bash[23528]: audit 2024-09-21T04:52:20.704896+0000 mon.a (mon.0) 13708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:21 smithi049 bash[23528]: audit 2024-09-21T04:52:20.712816+0000 mon.a (mon.0) 13709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:21 smithi049 bash[23528]: audit 2024-09-21T04:52:20.722590+0000 mon.a (mon.0) 13710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:22.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:22 smithi044 bash[22676]: audit 2024-09-21T04:52:20.584090+0000 mgr.a (mgr.14388) 17223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:52:22.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:22 smithi044 bash[22676]: cephadm 2024-09-21T04:52:20.585637+0000 mgr.a (mgr.14388) 17224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:52:22.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:22 smithi044 bash[22676]: cluster 2024-09-21T04:52:21.374581+0000 mgr.a (mgr.14388) 17225 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T04:52:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:22 smithi179 bash[23186]: audit 2024-09-21T04:52:20.584090+0000 mgr.a (mgr.14388) 17223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:52:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:22 smithi179 bash[23186]: cephadm 2024-09-21T04:52:20.585637+0000 mgr.a (mgr.14388) 17224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:52:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:22 smithi179 bash[23186]: cluster 2024-09-21T04:52:21.374581+0000 mgr.a (mgr.14388) 17225 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T04:52:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:22 smithi049 bash[23528]: audit 2024-09-21T04:52:20.584090+0000 mgr.a (mgr.14388) 17223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:52:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:22 smithi049 bash[23528]: cephadm 2024-09-21T04:52:20.585637+0000 mgr.a (mgr.14388) 17224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:52:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:22 smithi049 bash[23528]: cluster 2024-09-21T04:52:21.374581+0000 mgr.a (mgr.14388) 17225 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T04:52:23.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:23.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:24.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:24 smithi044 bash[22676]: cluster 2024-09-21T04:52:23.375031+0000 mgr.a (mgr.14388) 17226 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:52:24.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:24 smithi044 bash[22676]: audit 2024-09-21T04:52:23.412889+0000 mgr.a (mgr.14388) 17227 : audit [DBG] from='client.371127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:24 smithi179 bash[23186]: cluster 2024-09-21T04:52:23.375031+0000 mgr.a (mgr.14388) 17226 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:52:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:24 smithi179 bash[23186]: audit 2024-09-21T04:52:23.412889+0000 mgr.a (mgr.14388) 17227 : audit [DBG] from='client.371127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:24 smithi049 bash[23528]: cluster 2024-09-21T04:52:23.375031+0000 mgr.a (mgr.14388) 17226 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:52:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:24 smithi049 bash[23528]: audit 2024-09-21T04:52:23.412889+0000 mgr.a (mgr.14388) 17227 : audit [DBG] from='client.371127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:26 smithi044 bash[22676]: cluster 2024-09-21T04:52:25.377327+0000 mgr.a (mgr.14388) 17228 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:26 smithi179 bash[23186]: cluster 2024-09-21T04:52:25.377327+0000 mgr.a (mgr.14388) 17228 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:26 smithi049 bash[23528]: cluster 2024-09-21T04:52:25.377327+0000 mgr.a (mgr.14388) 17228 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:28 smithi044 bash[22676]: cluster 2024-09-21T04:52:27.378291+0000 mgr.a (mgr.14388) 17229 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:28 smithi179 bash[23186]: cluster 2024-09-21T04:52:27.378291+0000 mgr.a (mgr.14388) 17229 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:28 smithi049 bash[23528]: cluster 2024-09-21T04:52:27.378291+0000 mgr.a (mgr.14388) 17229 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:28.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:28.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:28.840 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:29.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:29.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:29.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:29.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:30 smithi179 bash[23186]: audit 2024-09-21T04:52:29.168627+0000 mgr.a (mgr.14388) 17230 : audit [DBG] from='client.371205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:30.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:30 smithi179 bash[23186]: cluster 2024-09-21T04:52:29.378864+0000 mgr.a (mgr.14388) 17231 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:30 smithi049 bash[23528]: audit 2024-09-21T04:52:29.168627+0000 mgr.a (mgr.14388) 17230 : audit [DBG] from='client.371205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:30 smithi049 bash[23528]: cluster 2024-09-21T04:52:29.378864+0000 mgr.a (mgr.14388) 17231 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:30 smithi044 bash[22676]: audit 2024-09-21T04:52:29.168627+0000 mgr.a (mgr.14388) 17230 : audit [DBG] from='client.371205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:30 smithi044 bash[22676]: cluster 2024-09-21T04:52:29.378864+0000 mgr.a (mgr.14388) 17231 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:31.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:31 smithi179 bash[23186]: audit 2024-09-21T04:52:30.500490+0000 mon.a (mon.0) 13711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:31 smithi179 bash[23186]: audit 2024-09-21T04:52:30.509680+0000 mon.a (mon.0) 13712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:31 smithi179 bash[23186]: audit 2024-09-21T04:52:30.520840+0000 mon.a (mon.0) 13713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:31 smithi049 bash[23528]: audit 2024-09-21T04:52:30.500490+0000 mon.a (mon.0) 13711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:31 smithi049 bash[23528]: audit 2024-09-21T04:52:30.509680+0000 mon.a (mon.0) 13712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:31 smithi049 bash[23528]: audit 2024-09-21T04:52:30.520840+0000 mon.a (mon.0) 13713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:31 smithi044 bash[22676]: audit 2024-09-21T04:52:30.500490+0000 mon.a (mon.0) 13711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:31 smithi044 bash[22676]: audit 2024-09-21T04:52:30.509680+0000 mon.a (mon.0) 13712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:31 smithi044 bash[22676]: audit 2024-09-21T04:52:30.520840+0000 mon.a (mon.0) 13713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:32 smithi179 bash[23186]: cluster 2024-09-21T04:52:31.381212+0000 mgr.a (mgr.14388) 17232 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:32 smithi049 bash[23528]: cluster 2024-09-21T04:52:31.381212+0000 mgr.a (mgr.14388) 17232 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:32 smithi044 bash[22676]: cluster 2024-09-21T04:52:31.381212+0000 mgr.a (mgr.14388) 17232 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:52:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:34.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:34.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:34 smithi049 bash[23528]: cluster 2024-09-21T04:52:33.382056+0000 mgr.a (mgr.14388) 17233 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:52:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:34 smithi044 bash[22676]: cluster 2024-09-21T04:52:33.382056+0000 mgr.a (mgr.14388) 17233 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:52:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:34 smithi179 bash[23186]: cluster 2024-09-21T04:52:33.382056+0000 mgr.a (mgr.14388) 17233 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:52:35.341 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:35.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:35.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:35.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:35.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:36 smithi049 bash[23528]: audit 2024-09-21T04:52:34.912972+0000 mgr.a (mgr.14388) 17234 : audit [DBG] from='client.371283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:36 smithi049 bash[23528]: cluster 2024-09-21T04:52:35.383462+0000 mgr.a (mgr.14388) 17235 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:52:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:36 smithi044 bash[22676]: audit 2024-09-21T04:52:34.912972+0000 mgr.a (mgr.14388) 17234 : audit [DBG] from='client.371283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:36 smithi044 bash[22676]: cluster 2024-09-21T04:52:35.383462+0000 mgr.a (mgr.14388) 17235 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:52:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:36 smithi179 bash[23186]: audit 2024-09-21T04:52:34.912972+0000 mgr.a (mgr.14388) 17234 : audit [DBG] from='client.371283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:36 smithi179 bash[23186]: cluster 2024-09-21T04:52:35.383462+0000 mgr.a (mgr.14388) 17235 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:52:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:38 smithi049 bash[23528]: cluster 2024-09-21T04:52:37.384379+0000 mgr.a (mgr.14388) 17236 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:52:38.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:38 smithi044 bash[22676]: cluster 2024-09-21T04:52:37.384379+0000 mgr.a (mgr.14388) 17236 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:52:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:38 smithi179 bash[23186]: cluster 2024-09-21T04:52:37.384379+0000 mgr.a (mgr.14388) 17236 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:52:40.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:40.343 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:40 smithi049 bash[23528]: cluster 2024-09-21T04:52:39.385019+0000 mgr.a (mgr.14388) 17237 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:52:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:40 smithi049 bash[23528]: audit 2024-09-21T04:52:40.139877+0000 mon.a (mon.0) 13714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:40 smithi049 bash[23528]: audit 2024-09-21T04:52:40.148431+0000 mon.a (mon.0) 13715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:40 smithi049 bash[23528]: audit 2024-09-21T04:52:40.158601+0000 mon.a (mon.0) 13716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.939 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:40 smithi179 bash[23186]: cluster 2024-09-21T04:52:39.385019+0000 mgr.a (mgr.14388) 17237 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:52:40.939 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:40 smithi179 bash[23186]: audit 2024-09-21T04:52:40.139877+0000 mon.a (mon.0) 13714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:40 smithi179 bash[23186]: audit 2024-09-21T04:52:40.148431+0000 mon.a (mon.0) 13715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:40 smithi179 bash[23186]: audit 2024-09-21T04:52:40.158601+0000 mon.a (mon.0) 13716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:40 smithi044 bash[22676]: cluster 2024-09-21T04:52:39.385019+0000 mgr.a (mgr.14388) 17237 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:52:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:40 smithi044 bash[22676]: audit 2024-09-21T04:52:40.139877+0000 mon.a (mon.0) 13714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:40 smithi044 bash[22676]: audit 2024-09-21T04:52:40.148431+0000 mon.a (mon.0) 13715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:40 smithi044 bash[22676]: audit 2024-09-21T04:52:40.158601+0000 mon.a (mon.0) 13716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:41.117 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:41 smithi044 bash[22676]: audit 2024-09-21T04:52:40.678040+0000 mgr.a (mgr.14388) 17238 : audit [DBG] from='client.371358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:41 smithi044 bash[22676]: audit 2024-09-21T04:52:40.923995+0000 mon.a (mon.0) 13717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:41 smithi044 bash[22676]: audit 2024-09-21T04:52:40.930374+0000 mon.a (mon.0) 13718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:41 smithi044 bash[22676]: audit 2024-09-21T04:52:40.935549+0000 mon.a (mon.0) 13719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:41 smithi044 bash[22676]: cluster 2024-09-21T04:52:41.388153+0000 mgr.a (mgr.14388) 17239 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:41 smithi179 bash[23186]: audit 2024-09-21T04:52:40.678040+0000 mgr.a (mgr.14388) 17238 : audit [DBG] from='client.371358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:41 smithi179 bash[23186]: audit 2024-09-21T04:52:40.923995+0000 mon.a (mon.0) 13717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:41 smithi179 bash[23186]: audit 2024-09-21T04:52:40.930374+0000 mon.a (mon.0) 13718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:41 smithi179 bash[23186]: audit 2024-09-21T04:52:40.935549+0000 mon.a (mon.0) 13719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:41 smithi179 bash[23186]: cluster 2024-09-21T04:52:41.388153+0000 mgr.a (mgr.14388) 17239 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:41 smithi049 bash[23528]: audit 2024-09-21T04:52:40.678040+0000 mgr.a (mgr.14388) 17238 : audit [DBG] from='client.371358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:42.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:41 smithi049 bash[23528]: audit 2024-09-21T04:52:40.923995+0000 mon.a (mon.0) 13717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:41 smithi049 bash[23528]: audit 2024-09-21T04:52:40.930374+0000 mon.a (mon.0) 13718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:41 smithi049 bash[23528]: audit 2024-09-21T04:52:40.935549+0000 mon.a (mon.0) 13719 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:42.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:41 smithi049 bash[23528]: cluster 2024-09-21T04:52:41.388153+0000 mgr.a (mgr.14388) 17239 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:44 smithi044 bash[22676]: cluster 2024-09-21T04:52:43.389213+0000 mgr.a (mgr.14388) 17240 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:44 smithi179 bash[23186]: cluster 2024-09-21T04:52:43.389213+0000 mgr.a (mgr.14388) 17240 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:44 smithi049 bash[23528]: cluster 2024-09-21T04:52:43.389213+0000 mgr.a (mgr.14388) 17240 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:52:46.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:46.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:46 smithi044 bash[22676]: cluster 2024-09-21T04:52:45.391244+0000 mgr.a (mgr.14388) 17241 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:46 smithi179 bash[23186]: cluster 2024-09-21T04:52:45.391244+0000 mgr.a (mgr.14388) 17241 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:46 smithi049 bash[23528]: cluster 2024-09-21T04:52:45.391244+0000 mgr.a (mgr.14388) 17241 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:46.907 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:46.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:46.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:46.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:46.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:47 smithi044 bash[22676]: audit 2024-09-21T04:52:46.454342+0000 mgr.a (mgr.14388) 17242 : audit [DBG] from='client.371436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:47 smithi179 bash[23186]: audit 2024-09-21T04:52:46.454342+0000 mgr.a (mgr.14388) 17242 : audit [DBG] from='client.371436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:47 smithi049 bash[23528]: audit 2024-09-21T04:52:46.454342+0000 mgr.a (mgr.14388) 17242 : audit [DBG] from='client.371436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:48 smithi044 bash[22676]: cluster 2024-09-21T04:52:47.392316+0000 mgr.a (mgr.14388) 17243 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:48 smithi179 bash[23186]: cluster 2024-09-21T04:52:47.392316+0000 mgr.a (mgr.14388) 17243 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:48 smithi049 bash[23528]: cluster 2024-09-21T04:52:47.392316+0000 mgr.a (mgr.14388) 17243 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:50 smithi044 bash[22676]: cluster 2024-09-21T04:52:49.393155+0000 mgr.a (mgr.14388) 17244 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:50.743 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:50 smithi049 bash[23528]: cluster 2024-09-21T04:52:49.393155+0000 mgr.a (mgr.14388) 17244 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:50 smithi179 bash[23186]: cluster 2024-09-21T04:52:49.393155+0000 mgr.a (mgr.14388) 17244 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:51 smithi044 bash[22676]: audit 2024-09-21T04:52:50.718627+0000 mon.a (mon.0) 13720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:51 smithi044 bash[22676]: audit 2024-09-21T04:52:50.727833+0000 mon.a (mon.0) 13721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:51 smithi044 bash[22676]: audit 2024-09-21T04:52:50.739014+0000 mon.a (mon.0) 13722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:51 smithi044 bash[22676]: cluster 2024-09-21T04:52:51.395376+0000 mgr.a (mgr.14388) 17245 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:51 smithi179 bash[23186]: audit 2024-09-21T04:52:50.718627+0000 mon.a (mon.0) 13720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:51 smithi179 bash[23186]: audit 2024-09-21T04:52:50.727833+0000 mon.a (mon.0) 13721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:51 smithi179 bash[23186]: audit 2024-09-21T04:52:50.739014+0000 mon.a (mon.0) 13722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:51 smithi179 bash[23186]: cluster 2024-09-21T04:52:51.395376+0000 mgr.a (mgr.14388) 17245 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:51 smithi049 bash[23528]: audit 2024-09-21T04:52:50.718627+0000 mon.a (mon.0) 13720 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:51 smithi049 bash[23528]: audit 2024-09-21T04:52:50.727833+0000 mon.a (mon.0) 13721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:51 smithi049 bash[23528]: audit 2024-09-21T04:52:50.739014+0000 mon.a (mon.0) 13722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:52:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:51 smithi049 bash[23528]: cluster 2024-09-21T04:52:51.395376+0000 mgr.a (mgr.14388) 17245 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:52 smithi179 bash[23186]: audit 2024-09-21T04:52:52.240094+0000 mgr.a (mgr.14388) 17246 : audit [DBG] from='client.371505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:52 smithi049 bash[23528]: audit 2024-09-21T04:52:52.240094+0000 mgr.a (mgr.14388) 17246 : audit [DBG] from='client.371505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:52 smithi044 bash[22676]: audit 2024-09-21T04:52:52.240094+0000 mgr.a (mgr.14388) 17246 : audit [DBG] from='client.371505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:53 smithi049 bash[23528]: cluster 2024-09-21T04:52:53.396374+0000 mgr.a (mgr.14388) 17247 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:53 smithi179 bash[23186]: cluster 2024-09-21T04:52:53.396374+0000 mgr.a (mgr.14388) 17247 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:53 smithi044 bash[22676]: cluster 2024-09-21T04:52:53.396374+0000 mgr.a (mgr.14388) 17247 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:56 smithi044 bash[22676]: cluster 2024-09-21T04:52:55.398594+0000 mgr.a (mgr.14388) 17248 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:56 smithi179 bash[23186]: cluster 2024-09-21T04:52:55.398594+0000 mgr.a (mgr.14388) 17248 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:56 smithi049 bash[23528]: cluster 2024-09-21T04:52:55.398594+0000 mgr.a (mgr.14388) 17248 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:52:57.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:52:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:52:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:52:58.451 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:52:58.451 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:52:58.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:52:58.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:52:58.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:52:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:58 smithi044 bash[22676]: cluster 2024-09-21T04:52:57.399225+0000 mgr.a (mgr.14388) 17249 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:58 smithi179 bash[23186]: cluster 2024-09-21T04:52:57.399225+0000 mgr.a (mgr.14388) 17249 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:58 smithi049 bash[23528]: cluster 2024-09-21T04:52:57.399225+0000 mgr.a (mgr.14388) 17249 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:52:59.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:52:59 smithi044 bash[22676]: audit 2024-09-21T04:52:58.023471+0000 mgr.a (mgr.14388) 17250 : audit [DBG] from='client.371580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:52:59 smithi179 bash[23186]: audit 2024-09-21T04:52:58.023471+0000 mgr.a (mgr.14388) 17250 : audit [DBG] from='client.371580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:52:59 smithi049 bash[23528]: audit 2024-09-21T04:52:58.023471+0000 mgr.a (mgr.14388) 17250 : audit [DBG] from='client.371580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:00.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:00 smithi044 bash[22676]: cluster 2024-09-21T04:52:59.400231+0000 mgr.a (mgr.14388) 17251 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:00.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:00 smithi044 bash[22676]: audit 2024-09-21T04:53:00.365327+0000 mon.a (mon.0) 13723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:00 smithi044 bash[22676]: audit 2024-09-21T04:53:00.374868+0000 mon.a (mon.0) 13724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:00 smithi044 bash[22676]: audit 2024-09-21T04:53:00.386658+0000 mon.a (mon.0) 13725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:00 smithi179 bash[23186]: cluster 2024-09-21T04:52:59.400231+0000 mgr.a (mgr.14388) 17251 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:00 smithi179 bash[23186]: audit 2024-09-21T04:53:00.365327+0000 mon.a (mon.0) 13723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:00 smithi179 bash[23186]: audit 2024-09-21T04:53:00.374868+0000 mon.a (mon.0) 13724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:00 smithi179 bash[23186]: audit 2024-09-21T04:53:00.386658+0000 mon.a (mon.0) 13725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:00 smithi049 bash[23528]: cluster 2024-09-21T04:52:59.400231+0000 mgr.a (mgr.14388) 17251 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:00.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:00 smithi049 bash[23528]: audit 2024-09-21T04:53:00.365327+0000 mon.a (mon.0) 13723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:00 smithi049 bash[23528]: audit 2024-09-21T04:53:00.374868+0000 mon.a (mon.0) 13724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:00.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:00 smithi049 bash[23528]: audit 2024-09-21T04:53:00.386658+0000 mon.a (mon.0) 13725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:02 smithi044 bash[22676]: audit 2024-09-21T04:53:01.101977+0000 mon.a (mon.0) 13726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:02 smithi044 bash[22676]: audit 2024-09-21T04:53:01.110605+0000 mon.a (mon.0) 13727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:02 smithi044 bash[22676]: audit 2024-09-21T04:53:01.122069+0000 mon.a (mon.0) 13728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:02 smithi044 bash[22676]: cluster 2024-09-21T04:53:01.402519+0000 mgr.a (mgr.14388) 17252 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:02 smithi179 bash[23186]: audit 2024-09-21T04:53:01.101977+0000 mon.a (mon.0) 13726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:02 smithi179 bash[23186]: audit 2024-09-21T04:53:01.110605+0000 mon.a (mon.0) 13727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:02 smithi179 bash[23186]: audit 2024-09-21T04:53:01.122069+0000 mon.a (mon.0) 13728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:02 smithi179 bash[23186]: cluster 2024-09-21T04:53:01.402519+0000 mgr.a (mgr.14388) 17252 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:02 smithi049 bash[23528]: audit 2024-09-21T04:53:01.101977+0000 mon.a (mon.0) 13726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:02 smithi049 bash[23528]: audit 2024-09-21T04:53:01.110605+0000 mon.a (mon.0) 13727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:02 smithi049 bash[23528]: audit 2024-09-21T04:53:01.122069+0000 mon.a (mon.0) 13728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:02.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:02 smithi049 bash[23528]: cluster 2024-09-21T04:53:01.402519+0000 mgr.a (mgr.14388) 17252 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:03.453 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:03.454 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:04.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:04 smithi044 bash[22676]: cluster 2024-09-21T04:53:03.403315+0000 mgr.a (mgr.14388) 17253 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:04 smithi179 bash[23186]: cluster 2024-09-21T04:53:03.403315+0000 mgr.a (mgr.14388) 17253 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:04.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:04 smithi049 bash[23528]: cluster 2024-09-21T04:53:03.403315+0000 mgr.a (mgr.14388) 17253 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:05 smithi044 bash[22676]: audit 2024-09-21T04:53:03.785213+0000 mgr.a (mgr.14388) 17254 : audit [DBG] from='client.371658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:05 smithi179 bash[23186]: audit 2024-09-21T04:53:03.785213+0000 mgr.a (mgr.14388) 17254 : audit [DBG] from='client.371658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:05 smithi049 bash[23528]: audit 2024-09-21T04:53:03.785213+0000 mgr.a (mgr.14388) 17254 : audit [DBG] from='client.371658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:06.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:06 smithi044 bash[22676]: cluster 2024-09-21T04:53:05.405627+0000 mgr.a (mgr.14388) 17255 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:06 smithi179 bash[23186]: cluster 2024-09-21T04:53:05.405627+0000 mgr.a (mgr.14388) 17255 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:06 smithi049 bash[23528]: cluster 2024-09-21T04:53:05.405627+0000 mgr.a (mgr.14388) 17255 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:08 smithi044 bash[22676]: cluster 2024-09-21T04:53:07.406443+0000 mgr.a (mgr.14388) 17256 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:08 smithi179 bash[23186]: cluster 2024-09-21T04:53:07.406443+0000 mgr.a (mgr.14388) 17256 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:08 smithi049 bash[23528]: cluster 2024-09-21T04:53:07.406443+0000 mgr.a (mgr.14388) 17256 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:09.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:09.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:09.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:09.996 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:10 smithi044 bash[22676]: cluster 2024-09-21T04:53:09.407192+0000 mgr.a (mgr.14388) 17257 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:10 smithi044 bash[22676]: audit 2024-09-21T04:53:09.551265+0000 mgr.a (mgr.14388) 17258 : audit [DBG] from='client.371736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:10 smithi179 bash[23186]: cluster 2024-09-21T04:53:09.407192+0000 mgr.a (mgr.14388) 17257 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:10 smithi179 bash[23186]: audit 2024-09-21T04:53:09.551265+0000 mgr.a (mgr.14388) 17258 : audit [DBG] from='client.371736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:10 smithi049 bash[23528]: cluster 2024-09-21T04:53:09.407192+0000 mgr.a (mgr.14388) 17257 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:10 smithi049 bash[23528]: audit 2024-09-21T04:53:09.551265+0000 mgr.a (mgr.14388) 17258 : audit [DBG] from='client.371736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:11 smithi044 bash[22676]: audit 2024-09-21T04:53:10.955689+0000 mon.a (mon.0) 13729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:11 smithi044 bash[22676]: audit 2024-09-21T04:53:10.964552+0000 mon.a (mon.0) 13730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:11 smithi044 bash[22676]: audit 2024-09-21T04:53:10.975357+0000 mon.a (mon.0) 13731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:11 smithi044 bash[22676]: cluster 2024-09-21T04:53:11.409689+0000 mgr.a (mgr.14388) 17259 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:11 smithi179 bash[23186]: audit 2024-09-21T04:53:10.955689+0000 mon.a (mon.0) 13729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:11 smithi179 bash[23186]: audit 2024-09-21T04:53:10.964552+0000 mon.a (mon.0) 13730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:11 smithi179 bash[23186]: audit 2024-09-21T04:53:10.975357+0000 mon.a (mon.0) 13731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:11 smithi179 bash[23186]: cluster 2024-09-21T04:53:11.409689+0000 mgr.a (mgr.14388) 17259 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:11 smithi049 bash[23528]: audit 2024-09-21T04:53:10.955689+0000 mon.a (mon.0) 13729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:11 smithi049 bash[23528]: audit 2024-09-21T04:53:10.964552+0000 mon.a (mon.0) 13730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:11 smithi049 bash[23528]: audit 2024-09-21T04:53:10.975357+0000 mon.a (mon.0) 13731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:12.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:11 smithi049 bash[23528]: cluster 2024-09-21T04:53:11.409689+0000 mgr.a (mgr.14388) 17259 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:14 smithi044 bash[22676]: cluster 2024-09-21T04:53:13.410694+0000 mgr.a (mgr.14388) 17260 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:14 smithi179 bash[23186]: cluster 2024-09-21T04:53:13.410694+0000 mgr.a (mgr.14388) 17260 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:14 smithi049 bash[23528]: cluster 2024-09-21T04:53:13.410694+0000 mgr.a (mgr.14388) 17260 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:15.754 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:15.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:15.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:16 smithi044 bash[22676]: audit 2024-09-21T04:53:15.324093+0000 mgr.a (mgr.14388) 17261 : audit [DBG] from='client.371814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:16 smithi044 bash[22676]: cluster 2024-09-21T04:53:15.412188+0000 mgr.a (mgr.14388) 17262 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:16 smithi179 bash[23186]: audit 2024-09-21T04:53:15.324093+0000 mgr.a (mgr.14388) 17261 : audit [DBG] from='client.371814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:16 smithi179 bash[23186]: cluster 2024-09-21T04:53:15.412188+0000 mgr.a (mgr.14388) 17262 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:16 smithi049 bash[23528]: audit 2024-09-21T04:53:15.324093+0000 mgr.a (mgr.14388) 17261 : audit [DBG] from='client.371814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:16 smithi049 bash[23528]: cluster 2024-09-21T04:53:15.412188+0000 mgr.a (mgr.14388) 17262 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:18 smithi044 bash[22676]: cluster 2024-09-21T04:53:17.413102+0000 mgr.a (mgr.14388) 17263 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:18 smithi179 bash[23186]: cluster 2024-09-21T04:53:17.413102+0000 mgr.a (mgr.14388) 17263 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:18 smithi049 bash[23528]: cluster 2024-09-21T04:53:17.413102+0000 mgr.a (mgr.14388) 17263 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:20 smithi044 bash[22676]: cluster 2024-09-21T04:53:19.413925+0000 mgr.a (mgr.14388) 17264 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:53:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:20 smithi179 bash[23186]: cluster 2024-09-21T04:53:19.413925+0000 mgr.a (mgr.14388) 17264 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:53:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:20.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:20 smithi049 bash[23528]: cluster 2024-09-21T04:53:19.413925+0000 mgr.a (mgr.14388) 17264 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:53:21.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22930]: debug 2024-09-21T04:53:21.475+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:53:21.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22930]: debug 2024-09-21T04:53:21.487+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.547718+0000 mon.a (mon.0) 13732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.552902+0000 mon.a (mon.0) 13733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.559085+0000 mon.a (mon.0) 13734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.651059+0000 mon.a (mon.0) 13735 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.655897+0000 mon.a (mon.0) 13736 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.657677+0000 mon.a (mon.0) 13737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.667400+0000 mon.a (mon.0) 13738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:20.673656+0000 mon.a (mon.0) 13739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:21.308778+0000 mon.a (mon.0) 13740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:21.314942+0000 mon.a (mon.0) 13741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:21 smithi044 bash[22676]: audit 2024-09-21T04:53:21.319878+0000 mon.a (mon.0) 13742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.547718+0000 mon.a (mon.0) 13732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.552902+0000 mon.a (mon.0) 13733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.559085+0000 mon.a (mon.0) 13734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.651059+0000 mon.a (mon.0) 13735 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.655897+0000 mon.a (mon.0) 13736 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.657677+0000 mon.a (mon.0) 13737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.667400+0000 mon.a (mon.0) 13738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:20.673656+0000 mon.a (mon.0) 13739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:21.308778+0000 mon.a (mon.0) 13740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:21.314942+0000 mon.a (mon.0) 13741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:21 smithi179 bash[23186]: audit 2024-09-21T04:53:21.319878+0000 mon.a (mon.0) 13742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.547718+0000 mon.a (mon.0) 13732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.552902+0000 mon.a (mon.0) 13733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.559085+0000 mon.a (mon.0) 13734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.651059+0000 mon.a (mon.0) 13735 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.655897+0000 mon.a (mon.0) 13736 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.657677+0000 mon.a (mon.0) 13737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.667400+0000 mon.a (mon.0) 13738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:20.673656+0000 mon.a (mon.0) 13739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:21.308778+0000 mon.a (mon.0) 13740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:21.314942+0000 mon.a (mon.0) 13741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:21 smithi049 bash[23528]: audit 2024-09-21T04:53:21.319878+0000 mon.a (mon.0) 13742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:21.913 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:22 smithi049 bash[23528]: audit 2024-09-21T04:53:20.675990+0000 mgr.a (mgr.14388) 17265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:53:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:22 smithi049 bash[23528]: audit 2024-09-21T04:53:21.112802+0000 mgr.a (mgr.14388) 17266 : audit [DBG] from='client.371910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:22 smithi049 bash[23528]: cluster 2024-09-21T04:53:21.415788+0000 mgr.a (mgr.14388) 17267 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:22 smithi049 bash[23528]: audit 2024-09-21T04:53:21.479121+0000 mgr.a (mgr.14388) 17268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:53:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:22 smithi049 bash[23528]: cephadm 2024-09-21T04:53:21.492807+0000 mgr.a (mgr.14388) 17269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:53:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:22 smithi044 bash[22676]: audit 2024-09-21T04:53:20.675990+0000 mgr.a (mgr.14388) 17265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:53:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:22 smithi044 bash[22676]: audit 2024-09-21T04:53:21.112802+0000 mgr.a (mgr.14388) 17266 : audit [DBG] from='client.371910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:22 smithi044 bash[22676]: cluster 2024-09-21T04:53:21.415788+0000 mgr.a (mgr.14388) 17267 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:22 smithi044 bash[22676]: audit 2024-09-21T04:53:21.479121+0000 mgr.a (mgr.14388) 17268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:53:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:22 smithi044 bash[22676]: cephadm 2024-09-21T04:53:21.492807+0000 mgr.a (mgr.14388) 17269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:53:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:22 smithi179 bash[23186]: audit 2024-09-21T04:53:20.675990+0000 mgr.a (mgr.14388) 17265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:53:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:22 smithi179 bash[23186]: audit 2024-09-21T04:53:21.112802+0000 mgr.a (mgr.14388) 17266 : audit [DBG] from='client.371910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:22 smithi179 bash[23186]: cluster 2024-09-21T04:53:21.415788+0000 mgr.a (mgr.14388) 17267 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:22 smithi179 bash[23186]: audit 2024-09-21T04:53:21.479121+0000 mgr.a (mgr.14388) 17268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:53:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:22 smithi179 bash[23186]: cephadm 2024-09-21T04:53:21.492807+0000 mgr.a (mgr.14388) 17269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:53:24.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:24 smithi044 bash[22676]: cluster 2024-09-21T04:53:23.416705+0000 mgr.a (mgr.14388) 17270 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:24 smithi179 bash[23186]: cluster 2024-09-21T04:53:23.416705+0000 mgr.a (mgr.14388) 17270 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:24 smithi049 bash[23528]: cluster 2024-09-21T04:53:23.416705+0000 mgr.a (mgr.14388) 17270 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:26 smithi044 bash[22676]: cluster 2024-09-21T04:53:25.418683+0000 mgr.a (mgr.14388) 17271 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:26 smithi179 bash[23186]: cluster 2024-09-21T04:53:25.418683+0000 mgr.a (mgr.14388) 17271 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:26 smithi049 bash[23528]: cluster 2024-09-21T04:53:25.418683+0000 mgr.a (mgr.14388) 17271 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:27.696 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:28 smithi044 bash[22676]: audit 2024-09-21T04:53:27.248241+0000 mgr.a (mgr.14388) 17272 : audit [DBG] from='client.372078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:28 smithi044 bash[22676]: cluster 2024-09-21T04:53:27.419275+0000 mgr.a (mgr.14388) 17273 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:28 smithi179 bash[23186]: audit 2024-09-21T04:53:27.248241+0000 mgr.a (mgr.14388) 17272 : audit [DBG] from='client.372078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:29.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:28 smithi179 bash[23186]: cluster 2024-09-21T04:53:27.419275+0000 mgr.a (mgr.14388) 17273 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:28 smithi049 bash[23528]: audit 2024-09-21T04:53:27.248241+0000 mgr.a (mgr.14388) 17272 : audit [DBG] from='client.372078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:28 smithi049 bash[23528]: cluster 2024-09-21T04:53:27.419275+0000 mgr.a (mgr.14388) 17273 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:30 smithi044 bash[22676]: cluster 2024-09-21T04:53:29.420203+0000 mgr.a (mgr.14388) 17274 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:30 smithi179 bash[23186]: cluster 2024-09-21T04:53:29.420203+0000 mgr.a (mgr.14388) 17274 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:30 smithi049 bash[23528]: cluster 2024-09-21T04:53:29.420203+0000 mgr.a (mgr.14388) 17274 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:32 smithi044 bash[22676]: audit 2024-09-21T04:53:31.189968+0000 mon.a (mon.0) 13743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:32 smithi044 bash[22676]: audit 2024-09-21T04:53:31.198642+0000 mon.a (mon.0) 13744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:32 smithi044 bash[22676]: audit 2024-09-21T04:53:31.209400+0000 mon.a (mon.0) 13745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:32 smithi044 bash[22676]: cluster 2024-09-21T04:53:31.422509+0000 mgr.a (mgr.14388) 17275 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:32 smithi179 bash[23186]: audit 2024-09-21T04:53:31.189968+0000 mon.a (mon.0) 13743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:32 smithi179 bash[23186]: audit 2024-09-21T04:53:31.198642+0000 mon.a (mon.0) 13744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:32 smithi179 bash[23186]: audit 2024-09-21T04:53:31.209400+0000 mon.a (mon.0) 13745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:32 smithi179 bash[23186]: cluster 2024-09-21T04:53:31.422509+0000 mgr.a (mgr.14388) 17275 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:32.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:32 smithi049 bash[23528]: audit 2024-09-21T04:53:31.189968+0000 mon.a (mon.0) 13743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:32 smithi049 bash[23528]: audit 2024-09-21T04:53:31.198642+0000 mon.a (mon.0) 13744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:32 smithi049 bash[23528]: audit 2024-09-21T04:53:31.209400+0000 mon.a (mon.0) 13745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:32.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:32 smithi049 bash[23528]: cluster 2024-09-21T04:53:31.422509+0000 mgr.a (mgr.14388) 17275 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:32.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:32.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:32.699 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:33.470 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:33.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:33.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:33.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:33.470 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:34.656 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:34 smithi049 bash[23528]: audit 2024-09-21T04:53:33.032809+0000 mgr.a (mgr.14388) 17276 : audit [DBG] from='client.372156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:34.657 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:34 smithi049 bash[23528]: cluster 2024-09-21T04:53:33.423212+0000 mgr.a (mgr.14388) 17277 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:34.682 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:34 smithi179 bash[23186]: audit 2024-09-21T04:53:33.032809+0000 mgr.a (mgr.14388) 17276 : audit [DBG] from='client.372156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:34.683 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:34 smithi179 bash[23186]: cluster 2024-09-21T04:53:33.423212+0000 mgr.a (mgr.14388) 17277 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:34 smithi044 bash[22676]: audit 2024-09-21T04:53:33.032809+0000 mgr.a (mgr.14388) 17276 : audit [DBG] from='client.372156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:34 smithi044 bash[22676]: cluster 2024-09-21T04:53:33.423212+0000 mgr.a (mgr.14388) 17277 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:36 smithi049 bash[23528]: cluster 2024-09-21T04:53:35.425405+0000 mgr.a (mgr.14388) 17278 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:36 smithi044 bash[22676]: cluster 2024-09-21T04:53:35.425405+0000 mgr.a (mgr.14388) 17278 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:36 smithi179 bash[23186]: cluster 2024-09-21T04:53:35.425405+0000 mgr.a (mgr.14388) 17278 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:53:38.471 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:38.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:38.472 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:38 smithi044 bash[22676]: cluster 2024-09-21T04:53:37.426331+0000 mgr.a (mgr.14388) 17279 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:38 smithi179 bash[23186]: cluster 2024-09-21T04:53:37.426331+0000 mgr.a (mgr.14388) 17279 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:38 smithi049 bash[23528]: cluster 2024-09-21T04:53:37.426331+0000 mgr.a (mgr.14388) 17279 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:39.260 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:40 smithi179 bash[23186]: audit 2024-09-21T04:53:38.807670+0000 mgr.a (mgr.14388) 17280 : audit [DBG] from='client.372234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:40 smithi179 bash[23186]: cluster 2024-09-21T04:53:39.427341+0000 mgr.a (mgr.14388) 17281 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:40.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:40 smithi044 bash[22676]: audit 2024-09-21T04:53:38.807670+0000 mgr.a (mgr.14388) 17280 : audit [DBG] from='client.372234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:40.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:40 smithi044 bash[22676]: cluster 2024-09-21T04:53:39.427341+0000 mgr.a (mgr.14388) 17281 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:40 smithi049 bash[23528]: audit 2024-09-21T04:53:38.807670+0000 mgr.a (mgr.14388) 17280 : audit [DBG] from='client.372234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:40 smithi049 bash[23528]: cluster 2024-09-21T04:53:39.427341+0000 mgr.a (mgr.14388) 17281 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:41 smithi049 bash[23528]: audit 2024-09-21T04:53:40.772948+0000 mon.a (mon.0) 13746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:41 smithi049 bash[23528]: audit 2024-09-21T04:53:40.780374+0000 mon.a (mon.0) 13747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:41 smithi049 bash[23528]: audit 2024-09-21T04:53:40.788678+0000 mon.a (mon.0) 13748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:41 smithi049 bash[23528]: cluster 2024-09-21T04:53:41.429675+0000 mgr.a (mgr.14388) 17282 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:41 smithi049 bash[23528]: audit 2024-09-21T04:53:41.499219+0000 mon.a (mon.0) 13749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:41 smithi049 bash[23528]: audit 2024-09-21T04:53:41.507647+0000 mon.a (mon.0) 13750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:41 smithi049 bash[23528]: audit 2024-09-21T04:53:41.517731+0000 mon.a (mon.0) 13751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:41 smithi044 bash[22676]: audit 2024-09-21T04:53:40.772948+0000 mon.a (mon.0) 13746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:41 smithi044 bash[22676]: audit 2024-09-21T04:53:40.780374+0000 mon.a (mon.0) 13747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:41 smithi044 bash[22676]: audit 2024-09-21T04:53:40.788678+0000 mon.a (mon.0) 13748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:41 smithi044 bash[22676]: cluster 2024-09-21T04:53:41.429675+0000 mgr.a (mgr.14388) 17282 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:41 smithi044 bash[22676]: audit 2024-09-21T04:53:41.499219+0000 mon.a (mon.0) 13749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:41 smithi044 bash[22676]: audit 2024-09-21T04:53:41.507647+0000 mon.a (mon.0) 13750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:41 smithi044 bash[22676]: audit 2024-09-21T04:53:41.517731+0000 mon.a (mon.0) 13751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:41 smithi179 bash[23186]: audit 2024-09-21T04:53:40.772948+0000 mon.a (mon.0) 13746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:41 smithi179 bash[23186]: audit 2024-09-21T04:53:40.780374+0000 mon.a (mon.0) 13747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:41 smithi179 bash[23186]: audit 2024-09-21T04:53:40.788678+0000 mon.a (mon.0) 13748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:41 smithi179 bash[23186]: cluster 2024-09-21T04:53:41.429675+0000 mgr.a (mgr.14388) 17282 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:41 smithi179 bash[23186]: audit 2024-09-21T04:53:41.499219+0000 mon.a (mon.0) 13749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:41 smithi179 bash[23186]: audit 2024-09-21T04:53:41.507647+0000 mon.a (mon.0) 13750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:41 smithi179 bash[23186]: audit 2024-09-21T04:53:41.517731+0000 mon.a (mon.0) 13751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:44.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:44 smithi044 bash[22676]: cluster 2024-09-21T04:53:43.430457+0000 mgr.a (mgr.14388) 17283 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:44 smithi179 bash[23186]: cluster 2024-09-21T04:53:43.430457+0000 mgr.a (mgr.14388) 17283 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:44 smithi049 bash[23528]: cluster 2024-09-21T04:53:43.430457+0000 mgr.a (mgr.14388) 17283 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:45.055 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:45.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:45.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:45.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:45.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:46 smithi179 bash[23186]: audit 2024-09-21T04:53:44.596324+0000 mgr.a (mgr.14388) 17284 : audit [DBG] from='client.372312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:46 smithi179 bash[23186]: cluster 2024-09-21T04:53:45.432905+0000 mgr.a (mgr.14388) 17285 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:46.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:46 smithi044 bash[22676]: audit 2024-09-21T04:53:44.596324+0000 mgr.a (mgr.14388) 17284 : audit [DBG] from='client.372312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:46.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:46 smithi044 bash[22676]: cluster 2024-09-21T04:53:45.432905+0000 mgr.a (mgr.14388) 17285 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:46 smithi049 bash[23528]: audit 2024-09-21T04:53:44.596324+0000 mgr.a (mgr.14388) 17284 : audit [DBG] from='client.372312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:46 smithi049 bash[23528]: cluster 2024-09-21T04:53:45.432905+0000 mgr.a (mgr.14388) 17285 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:53:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:48 smithi179 bash[23186]: cluster 2024-09-21T04:53:47.433627+0000 mgr.a (mgr.14388) 17286 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:48 smithi049 bash[23528]: cluster 2024-09-21T04:53:47.433627+0000 mgr.a (mgr.14388) 17286 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:48 smithi044 bash[22676]: cluster 2024-09-21T04:53:47.433627+0000 mgr.a (mgr.14388) 17286 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:50 smithi179 bash[23186]: cluster 2024-09-21T04:53:49.434394+0000 mgr.a (mgr.14388) 17287 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:50.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:50 smithi049 bash[23528]: cluster 2024-09-21T04:53:49.434394+0000 mgr.a (mgr.14388) 17287 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:50.821 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:50.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:50 smithi044 bash[22676]: cluster 2024-09-21T04:53:49.434394+0000 mgr.a (mgr.14388) 17287 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:51 smithi179 bash[23186]: audit 2024-09-21T04:53:50.382902+0000 mgr.a (mgr.14388) 17288 : audit [DBG] from='client.372390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:51 smithi179 bash[23186]: audit 2024-09-21T04:53:51.420425+0000 mon.a (mon.0) 13752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:51 smithi179 bash[23186]: audit 2024-09-21T04:53:51.429494+0000 mon.a (mon.0) 13753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:51 smithi179 bash[23186]: audit 2024-09-21T04:53:51.440511+0000 mon.a (mon.0) 13754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:51 smithi049 bash[23528]: audit 2024-09-21T04:53:50.382902+0000 mgr.a (mgr.14388) 17288 : audit [DBG] from='client.372390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:51 smithi049 bash[23528]: audit 2024-09-21T04:53:51.420425+0000 mon.a (mon.0) 13752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:51 smithi049 bash[23528]: audit 2024-09-21T04:53:51.429494+0000 mon.a (mon.0) 13753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:51 smithi049 bash[23528]: audit 2024-09-21T04:53:51.440511+0000 mon.a (mon.0) 13754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:51 smithi044 bash[22676]: audit 2024-09-21T04:53:50.382902+0000 mgr.a (mgr.14388) 17288 : audit [DBG] from='client.372390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:51 smithi044 bash[22676]: audit 2024-09-21T04:53:51.420425+0000 mon.a (mon.0) 13752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:51 smithi044 bash[22676]: audit 2024-09-21T04:53:51.429494+0000 mon.a (mon.0) 13753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:51 smithi044 bash[22676]: audit 2024-09-21T04:53:51.440511+0000 mon.a (mon.0) 13754 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:53:52.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:52 smithi049 bash[23528]: cluster 2024-09-21T04:53:51.437537+0000 mgr.a (mgr.14388) 17289 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:52 smithi044 bash[22676]: cluster 2024-09-21T04:53:51.437537+0000 mgr.a (mgr.14388) 17289 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:52 smithi179 bash[23186]: cluster 2024-09-21T04:53:51.437537+0000 mgr.a (mgr.14388) 17289 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:54 smithi049 bash[23528]: cluster 2024-09-21T04:53:53.438315+0000 mgr.a (mgr.14388) 17290 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:54.927 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:54 smithi179 bash[23186]: cluster 2024-09-21T04:53:53.438315+0000 mgr.a (mgr.14388) 17290 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:54 smithi044 bash[22676]: cluster 2024-09-21T04:53:53.438315+0000 mgr.a (mgr.14388) 17290 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:55.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:53:55.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:53:55.824 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:53:56.585 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:53:56.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:53:56.585 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:53:56.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:53:56.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:53:56.783 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:56 smithi049 bash[23528]: cluster 2024-09-21T04:53:55.440272+0000 mgr.a (mgr.14388) 17291 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:56 smithi044 bash[22676]: cluster 2024-09-21T04:53:55.440272+0000 mgr.a (mgr.14388) 17291 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:56 smithi179 bash[23186]: cluster 2024-09-21T04:53:55.440272+0000 mgr.a (mgr.14388) 17291 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:53:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:57 smithi179 bash[23186]: audit 2024-09-21T04:53:56.155027+0000 mgr.a (mgr.14388) 17292 : audit [DBG] from='client.372465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:57 smithi049 bash[23528]: audit 2024-09-21T04:53:56.155027+0000 mgr.a (mgr.14388) 17292 : audit [DBG] from='client.372465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:57 smithi044 bash[22676]: audit 2024-09-21T04:53:56.155027+0000 mgr.a (mgr.14388) 17292 : audit [DBG] from='client.372465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:53:58 smithi049 bash[23528]: cluster 2024-09-21T04:53:57.441178+0000 mgr.a (mgr.14388) 17293 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:53:58 smithi044 bash[22676]: cluster 2024-09-21T04:53:57.441178+0000 mgr.a (mgr.14388) 17293 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:53:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:53:58 smithi179 bash[23186]: cluster 2024-09-21T04:53:57.441178+0000 mgr.a (mgr.14388) 17293 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:54:00.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:00 smithi179 bash[23186]: cluster 2024-09-21T04:53:59.442042+0000 mgr.a (mgr.14388) 17294 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:54:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:00 smithi049 bash[23528]: cluster 2024-09-21T04:53:59.442042+0000 mgr.a (mgr.14388) 17294 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:54:00.974 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:00 smithi044 bash[22676]: cluster 2024-09-21T04:53:59.442042+0000 mgr.a (mgr.14388) 17294 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:54:01.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:01 smithi179 bash[23186]: audit 2024-09-21T04:54:00.955859+0000 mon.a (mon.0) 13755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:01 smithi179 bash[23186]: audit 2024-09-21T04:54:00.962402+0000 mon.a (mon.0) 13756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:01 smithi179 bash[23186]: audit 2024-09-21T04:54:00.970135+0000 mon.a (mon.0) 13757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:01 smithi179 bash[23186]: cluster 2024-09-21T04:54:01.444368+0000 mgr.a (mgr.14388) 17295 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:01 smithi179 bash[23186]: audit 2024-09-21T04:54:01.705535+0000 mon.a (mon.0) 13758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:01 smithi179 bash[23186]: audit 2024-09-21T04:54:01.710813+0000 mon.a (mon.0) 13759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:01 smithi179 bash[23186]: audit 2024-09-21T04:54:01.716686+0000 mon.a (mon.0) 13760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:01 smithi044 bash[22676]: audit 2024-09-21T04:54:00.955859+0000 mon.a (mon.0) 13755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:01 smithi044 bash[22676]: audit 2024-09-21T04:54:00.962402+0000 mon.a (mon.0) 13756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:01 smithi044 bash[22676]: audit 2024-09-21T04:54:00.970135+0000 mon.a (mon.0) 13757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:01 smithi044 bash[22676]: cluster 2024-09-21T04:54:01.444368+0000 mgr.a (mgr.14388) 17295 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:01 smithi044 bash[22676]: audit 2024-09-21T04:54:01.705535+0000 mon.a (mon.0) 13758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:01 smithi044 bash[22676]: audit 2024-09-21T04:54:01.710813+0000 mon.a (mon.0) 13759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:01 smithi044 bash[22676]: audit 2024-09-21T04:54:01.716686+0000 mon.a (mon.0) 13760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:01 smithi049 bash[23528]: audit 2024-09-21T04:54:00.955859+0000 mon.a (mon.0) 13755 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:01 smithi049 bash[23528]: audit 2024-09-21T04:54:00.962402+0000 mon.a (mon.0) 13756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:01 smithi049 bash[23528]: audit 2024-09-21T04:54:00.970135+0000 mon.a (mon.0) 13757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:01 smithi049 bash[23528]: cluster 2024-09-21T04:54:01.444368+0000 mgr.a (mgr.14388) 17295 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:01 smithi049 bash[23528]: audit 2024-09-21T04:54:01.705535+0000 mon.a (mon.0) 13758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:01 smithi049 bash[23528]: audit 2024-09-21T04:54:01.710813+0000 mon.a (mon.0) 13759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:01 smithi049 bash[23528]: audit 2024-09-21T04:54:01.716686+0000 mon.a (mon.0) 13760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:02.399 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:02.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:02.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:02.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:02.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:02 smithi044 bash[22676]: audit 2024-09-21T04:54:01.938882+0000 mgr.a (mgr.14388) 17296 : audit [DBG] from='client.372543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:02 smithi179 bash[23186]: audit 2024-09-21T04:54:01.938882+0000 mgr.a (mgr.14388) 17296 : audit [DBG] from='client.372543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:02 smithi049 bash[23528]: audit 2024-09-21T04:54:01.938882+0000 mgr.a (mgr.14388) 17296 : audit [DBG] from='client.372543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:03 smithi044 bash[22676]: cluster 2024-09-21T04:54:03.445343+0000 mgr.a (mgr.14388) 17297 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:03 smithi179 bash[23186]: cluster 2024-09-21T04:54:03.445343+0000 mgr.a (mgr.14388) 17297 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:03 smithi049 bash[23528]: cluster 2024-09-21T04:54:03.445343+0000 mgr.a (mgr.14388) 17297 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:06 smithi179 bash[23186]: cluster 2024-09-21T04:54:05.446706+0000 mgr.a (mgr.14388) 17298 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:06 smithi049 bash[23528]: cluster 2024-09-21T04:54:05.446706+0000 mgr.a (mgr.14388) 17298 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:06.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:06 smithi044 bash[22676]: cluster 2024-09-21T04:54:05.446706+0000 mgr.a (mgr.14388) 17298 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:07.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:07.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:07.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:08.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:08.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:08.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:08.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:08.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:08 smithi049 bash[23528]: cluster 2024-09-21T04:54:07.447234+0000 mgr.a (mgr.14388) 17299 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:08.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:08 smithi044 bash[22676]: cluster 2024-09-21T04:54:07.447234+0000 mgr.a (mgr.14388) 17299 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:08 smithi179 bash[23186]: cluster 2024-09-21T04:54:07.447234+0000 mgr.a (mgr.14388) 17299 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:09 smithi049 bash[23528]: audit 2024-09-21T04:54:07.725922+0000 mgr.a (mgr.14388) 17300 : audit [DBG] from='client.372618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:09 smithi044 bash[22676]: audit 2024-09-21T04:54:07.725922+0000 mgr.a (mgr.14388) 17300 : audit [DBG] from='client.372618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:09 smithi179 bash[23186]: audit 2024-09-21T04:54:07.725922+0000 mgr.a (mgr.14388) 17300 : audit [DBG] from='client.372618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:10 smithi049 bash[23528]: cluster 2024-09-21T04:54:09.448102+0000 mgr.a (mgr.14388) 17301 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:10.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:10 smithi044 bash[22676]: cluster 2024-09-21T04:54:09.448102+0000 mgr.a (mgr.14388) 17301 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:10 smithi179 bash[23186]: cluster 2024-09-21T04:54:09.448102+0000 mgr.a (mgr.14388) 17301 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:12 smithi049 bash[23528]: cluster 2024-09-21T04:54:11.450399+0000 mgr.a (mgr.14388) 17302 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:12.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:12 smithi049 bash[23528]: audit 2024-09-21T04:54:11.655601+0000 mon.a (mon.0) 13761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:12.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:12 smithi049 bash[23528]: audit 2024-09-21T04:54:11.665324+0000 mon.a (mon.0) 13762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:12.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:12 smithi049 bash[23528]: audit 2024-09-21T04:54:11.677557+0000 mon.a (mon.0) 13763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:12 smithi044 bash[22676]: cluster 2024-09-21T04:54:11.450399+0000 mgr.a (mgr.14388) 17302 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:12 smithi044 bash[22676]: audit 2024-09-21T04:54:11.655601+0000 mon.a (mon.0) 13761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:12 smithi044 bash[22676]: audit 2024-09-21T04:54:11.665324+0000 mon.a (mon.0) 13762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:12 smithi044 bash[22676]: audit 2024-09-21T04:54:11.677557+0000 mon.a (mon.0) 13763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:13.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:12 smithi179 bash[23186]: cluster 2024-09-21T04:54:11.450399+0000 mgr.a (mgr.14388) 17302 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:13.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:12 smithi179 bash[23186]: audit 2024-09-21T04:54:11.655601+0000 mon.a (mon.0) 13761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:13.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:12 smithi179 bash[23186]: audit 2024-09-21T04:54:11.665324+0000 mon.a (mon.0) 13762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:13.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:12 smithi179 bash[23186]: audit 2024-09-21T04:54:11.677557+0000 mon.a (mon.0) 13763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:13.141 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:13.900 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:14 smithi049 bash[23528]: cluster 2024-09-21T04:54:13.451140+0000 mgr.a (mgr.14388) 17303 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:14 smithi049 bash[23528]: audit 2024-09-21T04:54:13.468160+0000 mgr.a (mgr.14388) 17304 : audit [DBG] from='client.372696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:14.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:14 smithi044 bash[22676]: cluster 2024-09-21T04:54:13.451140+0000 mgr.a (mgr.14388) 17303 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:14.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:14 smithi044 bash[22676]: audit 2024-09-21T04:54:13.468160+0000 mgr.a (mgr.14388) 17304 : audit [DBG] from='client.372696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:14 smithi179 bash[23186]: cluster 2024-09-21T04:54:13.451140+0000 mgr.a (mgr.14388) 17303 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:14 smithi179 bash[23186]: audit 2024-09-21T04:54:13.468160+0000 mgr.a (mgr.14388) 17304 : audit [DBG] from='client.372696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:16 smithi179 bash[23186]: cluster 2024-09-21T04:54:15.453572+0000 mgr.a (mgr.14388) 17305 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:16 smithi049 bash[23528]: cluster 2024-09-21T04:54:15.453572+0000 mgr.a (mgr.14388) 17305 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:16 smithi044 bash[22676]: cluster 2024-09-21T04:54:15.453572+0000 mgr.a (mgr.14388) 17305 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:18 smithi049 bash[23528]: cluster 2024-09-21T04:54:17.454335+0000 mgr.a (mgr.14388) 17306 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:18.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:18.902 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:18.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:18 smithi044 bash[22676]: cluster 2024-09-21T04:54:17.454335+0000 mgr.a (mgr.14388) 17306 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:18 smithi179 bash[23186]: cluster 2024-09-21T04:54:17.454335+0000 mgr.a (mgr.14388) 17306 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:19.677 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:19.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:19.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:20 smithi049 bash[23528]: audit 2024-09-21T04:54:19.232461+0000 mgr.a (mgr.14388) 17307 : audit [DBG] from='client.372771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:20 smithi049 bash[23528]: cluster 2024-09-21T04:54:19.454871+0000 mgr.a (mgr.14388) 17308 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:20 smithi044 bash[22676]: audit 2024-09-21T04:54:19.232461+0000 mgr.a (mgr.14388) 17307 : audit [DBG] from='client.372771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:20.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:20 smithi044 bash[22676]: cluster 2024-09-21T04:54:19.454871+0000 mgr.a (mgr.14388) 17308 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:20 smithi179 bash[23186]: audit 2024-09-21T04:54:19.232461+0000 mgr.a (mgr.14388) 17307 : audit [DBG] from='client.372771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:20 smithi179 bash[23186]: cluster 2024-09-21T04:54:19.454871+0000 mgr.a (mgr.14388) 17308 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.166498+0000 mon.a (mon.0) 13764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.174955+0000 mon.a (mon.0) 13765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.185677+0000 mon.a (mon.0) 13766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: cluster 2024-09-21T04:54:21.457184+0000 mgr.a (mgr.14388) 17309 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.561721+0000 mon.a (mon.0) 13767 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:22.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.568299+0000 mon.a (mon.0) 13768 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:22.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.570347+0000 mon.a (mon.0) 13769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:22.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.581496+0000 mon.a (mon.0) 13770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.587670+0000 mon.a (mon.0) 13771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:54:22.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.907663+0000 mon.a (mon.0) 13772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.912765+0000 mon.a (mon.0) 13773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:22 smithi179 bash[23186]: audit 2024-09-21T04:54:21.918858+0000 mon.a (mon.0) 13774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22930]: debug 2024-09-21T04:54:22.386+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22930]: debug 2024-09-21T04:54:22.390+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.166498+0000 mon.a (mon.0) 13764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.174955+0000 mon.a (mon.0) 13765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.185677+0000 mon.a (mon.0) 13766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: cluster 2024-09-21T04:54:21.457184+0000 mgr.a (mgr.14388) 17309 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.561721+0000 mon.a (mon.0) 13767 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.568299+0000 mon.a (mon.0) 13768 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.570347+0000 mon.a (mon.0) 13769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.581496+0000 mon.a (mon.0) 13770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.587670+0000 mon.a (mon.0) 13771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:54:22.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.907663+0000 mon.a (mon.0) 13772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.912765+0000 mon.a (mon.0) 13773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:22 smithi044 bash[22676]: audit 2024-09-21T04:54:21.918858+0000 mon.a (mon.0) 13774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.166498+0000 mon.a (mon.0) 13764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.174955+0000 mon.a (mon.0) 13765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.185677+0000 mon.a (mon.0) 13766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: cluster 2024-09-21T04:54:21.457184+0000 mgr.a (mgr.14388) 17309 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.561721+0000 mon.a (mon.0) 13767 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.568299+0000 mon.a (mon.0) 13768 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.570347+0000 mon.a (mon.0) 13769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.581496+0000 mon.a (mon.0) 13770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.587670+0000 mon.a (mon.0) 13771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.907663+0000 mon.a (mon.0) 13772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.912765+0000 mon.a (mon.0) 13773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:22.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:22 smithi049 bash[23528]: audit 2024-09-21T04:54:21.918858+0000 mon.a (mon.0) 13774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:23 smithi044 bash[22676]: audit 2024-09-21T04:54:21.590032+0000 mgr.a (mgr.14388) 17310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:54:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:23 smithi044 bash[22676]: audit 2024-09-21T04:54:22.392090+0000 mgr.a (mgr.14388) 17311 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:54:23.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:23 smithi044 bash[22676]: cephadm 2024-09-21T04:54:22.393402+0000 mgr.a (mgr.14388) 17312 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:54:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:23 smithi179 bash[23186]: audit 2024-09-21T04:54:21.590032+0000 mgr.a (mgr.14388) 17310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:54:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:23 smithi179 bash[23186]: audit 2024-09-21T04:54:22.392090+0000 mgr.a (mgr.14388) 17311 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:54:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:23 smithi179 bash[23186]: cephadm 2024-09-21T04:54:22.393402+0000 mgr.a (mgr.14388) 17312 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:54:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:23 smithi049 bash[23528]: audit 2024-09-21T04:54:21.590032+0000 mgr.a (mgr.14388) 17310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:54:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:23 smithi049 bash[23528]: audit 2024-09-21T04:54:22.392090+0000 mgr.a (mgr.14388) 17311 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:54:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:23 smithi049 bash[23528]: cephadm 2024-09-21T04:54:22.393402+0000 mgr.a (mgr.14388) 17312 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:54:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:24 smithi044 bash[22676]: cluster 2024-09-21T04:54:23.458087+0000 mgr.a (mgr.14388) 17313 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:24 smithi179 bash[23186]: cluster 2024-09-21T04:54:23.458087+0000 mgr.a (mgr.14388) 17313 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:24 smithi049 bash[23528]: cluster 2024-09-21T04:54:23.458087+0000 mgr.a (mgr.14388) 17313 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:24.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:24.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:24.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:25.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:26 smithi049 bash[23528]: audit 2024-09-21T04:54:25.005575+0000 mgr.a (mgr.14388) 17314 : audit [DBG] from='client.372954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:26.841 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:26 smithi049 bash[23528]: cluster 2024-09-21T04:54:25.459604+0000 mgr.a (mgr.14388) 17315 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:26.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:26 smithi044 bash[22676]: audit 2024-09-21T04:54:25.005575+0000 mgr.a (mgr.14388) 17314 : audit [DBG] from='client.372954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:26.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:26 smithi044 bash[22676]: cluster 2024-09-21T04:54:25.459604+0000 mgr.a (mgr.14388) 17315 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:26 smithi179 bash[23186]: audit 2024-09-21T04:54:25.005575+0000 mgr.a (mgr.14388) 17314 : audit [DBG] from='client.372954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:27.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:26 smithi179 bash[23186]: cluster 2024-09-21T04:54:25.459604+0000 mgr.a (mgr.14388) 17315 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:28 smithi049 bash[23528]: cluster 2024-09-21T04:54:27.460311+0000 mgr.a (mgr.14388) 17316 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:28 smithi044 bash[22676]: cluster 2024-09-21T04:54:27.460311+0000 mgr.a (mgr.14388) 17316 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:28 smithi179 bash[23186]: cluster 2024-09-21T04:54:27.460311+0000 mgr.a (mgr.14388) 17316 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:30.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:30.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:30.438 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:30 smithi049 bash[23528]: cluster 2024-09-21T04:54:29.461077+0000 mgr.a (mgr.14388) 17317 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:30 smithi044 bash[22676]: cluster 2024-09-21T04:54:29.461077+0000 mgr.a (mgr.14388) 17317 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:30 smithi179 bash[23186]: cluster 2024-09-21T04:54:29.461077+0000 mgr.a (mgr.14388) 17317 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:31.202 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:32 smithi049 bash[23528]: audit 2024-09-21T04:54:30.765217+0000 mgr.a (mgr.14388) 17318 : audit [DBG] from='client.373032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:32 smithi049 bash[23528]: cluster 2024-09-21T04:54:31.463943+0000 mgr.a (mgr.14388) 17319 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:32 smithi049 bash[23528]: audit 2024-09-21T04:54:31.875067+0000 mon.a (mon.0) 13775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:32 smithi049 bash[23528]: audit 2024-09-21T04:54:31.884968+0000 mon.a (mon.0) 13776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:32 smithi049 bash[23528]: audit 2024-09-21T04:54:31.895645+0000 mon.a (mon.0) 13777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:32 smithi044 bash[22676]: audit 2024-09-21T04:54:30.765217+0000 mgr.a (mgr.14388) 17318 : audit [DBG] from='client.373032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:32 smithi044 bash[22676]: cluster 2024-09-21T04:54:31.463943+0000 mgr.a (mgr.14388) 17319 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:32 smithi044 bash[22676]: audit 2024-09-21T04:54:31.875067+0000 mon.a (mon.0) 13775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:32 smithi044 bash[22676]: audit 2024-09-21T04:54:31.884968+0000 mon.a (mon.0) 13776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:32 smithi044 bash[22676]: audit 2024-09-21T04:54:31.895645+0000 mon.a (mon.0) 13777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:32 smithi179 bash[23186]: audit 2024-09-21T04:54:30.765217+0000 mgr.a (mgr.14388) 17318 : audit [DBG] from='client.373032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:32 smithi179 bash[23186]: cluster 2024-09-21T04:54:31.463943+0000 mgr.a (mgr.14388) 17319 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:32 smithi179 bash[23186]: audit 2024-09-21T04:54:31.875067+0000 mon.a (mon.0) 13775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:32 smithi179 bash[23186]: audit 2024-09-21T04:54:31.884968+0000 mon.a (mon.0) 13776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:32 smithi179 bash[23186]: audit 2024-09-21T04:54:31.895645+0000 mon.a (mon.0) 13777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:34 smithi049 bash[23528]: cluster 2024-09-21T04:54:33.464758+0000 mgr.a (mgr.14388) 17320 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:34 smithi044 bash[22676]: cluster 2024-09-21T04:54:33.464758+0000 mgr.a (mgr.14388) 17320 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:34 smithi179 bash[23186]: cluster 2024-09-21T04:54:33.464758+0000 mgr.a (mgr.14388) 17320 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:54:36.204 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:36.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:36.205 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:36 smithi049 bash[23528]: cluster 2024-09-21T04:54:35.466785+0000 mgr.a (mgr.14388) 17321 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:36 smithi044 bash[22676]: cluster 2024-09-21T04:54:35.466785+0000 mgr.a (mgr.14388) 17321 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:37.005 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:37.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:36 smithi179 bash[23186]: cluster 2024-09-21T04:54:35.466785+0000 mgr.a (mgr.14388) 17321 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:54:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:37 smithi049 bash[23528]: audit 2024-09-21T04:54:36.541074+0000 mgr.a (mgr.14388) 17322 : audit [DBG] from='client.373110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:37 smithi044 bash[22676]: audit 2024-09-21T04:54:36.541074+0000 mgr.a (mgr.14388) 17322 : audit [DBG] from='client.373110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:37 smithi179 bash[23186]: audit 2024-09-21T04:54:36.541074+0000 mgr.a (mgr.14388) 17322 : audit [DBG] from='client.373110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:38 smithi179 bash[23186]: cluster 2024-09-21T04:54:37.467706+0000 mgr.a (mgr.14388) 17323 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:38 smithi049 bash[23528]: cluster 2024-09-21T04:54:37.467706+0000 mgr.a (mgr.14388) 17323 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:38 smithi044 bash[22676]: cluster 2024-09-21T04:54:37.467706+0000 mgr.a (mgr.14388) 17323 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:40 smithi044 bash[22676]: cluster 2024-09-21T04:54:39.468651+0000 mgr.a (mgr.14388) 17324 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:40 smithi179 bash[23186]: cluster 2024-09-21T04:54:39.468651+0000 mgr.a (mgr.14388) 17324 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:40 smithi049 bash[23528]: cluster 2024-09-21T04:54:39.468651+0000 mgr.a (mgr.14388) 17324 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:42.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:42.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:42.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:42 smithi044 bash[22676]: audit 2024-09-21T04:54:41.385701+0000 mon.a (mon.0) 13778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:42 smithi044 bash[22676]: audit 2024-09-21T04:54:41.397021+0000 mon.a (mon.0) 13779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:42 smithi044 bash[22676]: audit 2024-09-21T04:54:41.407322+0000 mon.a (mon.0) 13780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:42 smithi044 bash[22676]: cluster 2024-09-21T04:54:41.471104+0000 mgr.a (mgr.14388) 17325 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:42.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:42 smithi044 bash[22676]: audit 2024-09-21T04:54:42.109656+0000 mon.a (mon.0) 13781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:42 smithi044 bash[22676]: audit 2024-09-21T04:54:42.118311+0000 mon.a (mon.0) 13782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:42 smithi044 bash[22676]: audit 2024-09-21T04:54:42.123473+0000 mon.a (mon.0) 13783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:42 smithi179 bash[23186]: audit 2024-09-21T04:54:41.385701+0000 mon.a (mon.0) 13778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:42 smithi179 bash[23186]: audit 2024-09-21T04:54:41.397021+0000 mon.a (mon.0) 13779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:42 smithi179 bash[23186]: audit 2024-09-21T04:54:41.407322+0000 mon.a (mon.0) 13780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:42 smithi179 bash[23186]: cluster 2024-09-21T04:54:41.471104+0000 mgr.a (mgr.14388) 17325 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:42 smithi179 bash[23186]: audit 2024-09-21T04:54:42.109656+0000 mon.a (mon.0) 13781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:42 smithi179 bash[23186]: audit 2024-09-21T04:54:42.118311+0000 mon.a (mon.0) 13782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:42 smithi179 bash[23186]: audit 2024-09-21T04:54:42.123473+0000 mon.a (mon.0) 13783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.784 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:42.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:42.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:42 smithi049 bash[23528]: audit 2024-09-21T04:54:41.385701+0000 mon.a (mon.0) 13778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:42 smithi049 bash[23528]: audit 2024-09-21T04:54:41.397021+0000 mon.a (mon.0) 13779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:42 smithi049 bash[23528]: audit 2024-09-21T04:54:41.407322+0000 mon.a (mon.0) 13780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:42 smithi049 bash[23528]: cluster 2024-09-21T04:54:41.471104+0000 mgr.a (mgr.14388) 17325 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:42 smithi049 bash[23528]: audit 2024-09-21T04:54:42.109656+0000 mon.a (mon.0) 13781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:42 smithi049 bash[23528]: audit 2024-09-21T04:54:42.118311+0000 mon.a (mon.0) 13782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:42 smithi049 bash[23528]: audit 2024-09-21T04:54:42.123473+0000 mon.a (mon.0) 13783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:43 smithi044 bash[22676]: audit 2024-09-21T04:54:42.339281+0000 mgr.a (mgr.14388) 17326 : audit [DBG] from='client.373188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:43 smithi179 bash[23186]: audit 2024-09-21T04:54:42.339281+0000 mgr.a (mgr.14388) 17326 : audit [DBG] from='client.373188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:43.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:43 smithi049 bash[23528]: audit 2024-09-21T04:54:42.339281+0000 mgr.a (mgr.14388) 17326 : audit [DBG] from='client.373188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:44 smithi044 bash[22676]: cluster 2024-09-21T04:54:43.472204+0000 mgr.a (mgr.14388) 17327 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:44 smithi179 bash[23186]: cluster 2024-09-21T04:54:43.472204+0000 mgr.a (mgr.14388) 17327 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:44 smithi049 bash[23528]: cluster 2024-09-21T04:54:43.472204+0000 mgr.a (mgr.14388) 17327 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:46 smithi049 bash[23528]: cluster 2024-09-21T04:54:45.474534+0000 mgr.a (mgr.14388) 17328 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:46.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:46 smithi044 bash[22676]: cluster 2024-09-21T04:54:45.474534+0000 mgr.a (mgr.14388) 17328 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:46 smithi179 bash[23186]: cluster 2024-09-21T04:54:45.474534+0000 mgr.a (mgr.14388) 17328 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:47.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:48.556 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:48.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:48.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:48.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:48.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:48 smithi044 bash[22676]: cluster 2024-09-21T04:54:47.475340+0000 mgr.a (mgr.14388) 17329 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:48 smithi049 bash[23528]: cluster 2024-09-21T04:54:47.475340+0000 mgr.a (mgr.14388) 17329 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:48 smithi179 bash[23186]: cluster 2024-09-21T04:54:47.475340+0000 mgr.a (mgr.14388) 17329 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:49 smithi049 bash[23528]: audit 2024-09-21T04:54:48.106309+0000 mgr.a (mgr.14388) 17330 : audit [DBG] from='client.373266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:49 smithi044 bash[22676]: audit 2024-09-21T04:54:48.106309+0000 mgr.a (mgr.14388) 17330 : audit [DBG] from='client.373266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:49 smithi179 bash[23186]: audit 2024-09-21T04:54:48.106309+0000 mgr.a (mgr.14388) 17330 : audit [DBG] from='client.373266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:50.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:50 smithi049 bash[23528]: cluster 2024-09-21T04:54:49.476453+0000 mgr.a (mgr.14388) 17331 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:50 smithi044 bash[22676]: cluster 2024-09-21T04:54:49.476453+0000 mgr.a (mgr.14388) 17331 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:50 smithi179 bash[23186]: cluster 2024-09-21T04:54:49.476453+0000 mgr.a (mgr.14388) 17331 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:52.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:52 smithi049 bash[23528]: cluster 2024-09-21T04:54:51.478929+0000 mgr.a (mgr.14388) 17332 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:52.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:52 smithi049 bash[23528]: audit 2024-09-21T04:54:52.089676+0000 mon.a (mon.0) 13784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:52.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:52 smithi049 bash[23528]: audit 2024-09-21T04:54:52.099022+0000 mon.a (mon.0) 13785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:52.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:52 smithi049 bash[23528]: audit 2024-09-21T04:54:52.109929+0000 mon.a (mon.0) 13786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:52 smithi044 bash[22676]: cluster 2024-09-21T04:54:51.478929+0000 mgr.a (mgr.14388) 17332 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:52 smithi044 bash[22676]: audit 2024-09-21T04:54:52.089676+0000 mon.a (mon.0) 13784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:52 smithi044 bash[22676]: audit 2024-09-21T04:54:52.099022+0000 mon.a (mon.0) 13785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:52 smithi044 bash[22676]: audit 2024-09-21T04:54:52.109929+0000 mon.a (mon.0) 13786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:52 smithi179 bash[23186]: cluster 2024-09-21T04:54:51.478929+0000 mgr.a (mgr.14388) 17332 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:52 smithi179 bash[23186]: audit 2024-09-21T04:54:52.089676+0000 mon.a (mon.0) 13784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:52 smithi179 bash[23186]: audit 2024-09-21T04:54:52.099022+0000 mon.a (mon.0) 13785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:52 smithi179 bash[23186]: audit 2024-09-21T04:54:52.109929+0000 mon.a (mon.0) 13786 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:54:53.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:54:54.342 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:54:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:54:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:54:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:54:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:54:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:54 smithi044 bash[22676]: cluster 2024-09-21T04:54:53.479709+0000 mgr.a (mgr.14388) 17333 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:54 smithi179 bash[23186]: cluster 2024-09-21T04:54:53.479709+0000 mgr.a (mgr.14388) 17333 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:54 smithi049 bash[23528]: cluster 2024-09-21T04:54:53.479709+0000 mgr.a (mgr.14388) 17333 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:55 smithi049 bash[23528]: audit 2024-09-21T04:54:53.889490+0000 mgr.a (mgr.14388) 17334 : audit [DBG] from='client.373341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:55 smithi044 bash[22676]: audit 2024-09-21T04:54:53.889490+0000 mgr.a (mgr.14388) 17334 : audit [DBG] from='client.373341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:55 smithi179 bash[23186]: audit 2024-09-21T04:54:53.889490+0000 mgr.a (mgr.14388) 17334 : audit [DBG] from='client.373341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:56.710 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:56 smithi049 bash[23528]: cluster 2024-09-21T04:54:55.482061+0000 mgr.a (mgr.14388) 17335 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:56 smithi044 bash[22676]: cluster 2024-09-21T04:54:55.482061+0000 mgr.a (mgr.14388) 17335 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:56 smithi179 bash[23186]: cluster 2024-09-21T04:54:55.482061+0000 mgr.a (mgr.14388) 17335 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:54:58.827 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:54:58 smithi179 bash[23186]: cluster 2024-09-21T04:54:57.482844+0000 mgr.a (mgr.14388) 17336 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:58.926 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:54:58 smithi049 bash[23528]: cluster 2024-09-21T04:54:57.482844+0000 mgr.a (mgr.14388) 17336 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:54:58 smithi044 bash[22676]: cluster 2024-09-21T04:54:57.482844+0000 mgr.a (mgr.14388) 17336 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:54:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:54:59.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:54:59.345 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:00.101 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:00.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:00.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:00.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:00.102 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:00 smithi044 bash[22676]: cluster 2024-09-21T04:54:59.483398+0000 mgr.a (mgr.14388) 17337 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:00 smithi179 bash[23186]: cluster 2024-09-21T04:54:59.483398+0000 mgr.a (mgr.14388) 17337 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:00 smithi049 bash[23528]: cluster 2024-09-21T04:54:59.483398+0000 mgr.a (mgr.14388) 17337 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:01 smithi044 bash[22676]: audit 2024-09-21T04:54:59.676213+0000 mgr.a (mgr.14388) 17338 : audit [DBG] from='client.373413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:01 smithi179 bash[23186]: audit 2024-09-21T04:54:59.676213+0000 mgr.a (mgr.14388) 17338 : audit [DBG] from='client.373413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:01 smithi049 bash[23528]: audit 2024-09-21T04:54:59.676213+0000 mgr.a (mgr.14388) 17338 : audit [DBG] from='client.373413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:02.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:02 smithi044 bash[22676]: cluster 2024-09-21T04:55:01.485035+0000 mgr.a (mgr.14388) 17339 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:55:02.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:02 smithi044 bash[22676]: audit 2024-09-21T04:55:01.636766+0000 mon.a (mon.0) 13787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:02.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:02 smithi044 bash[22676]: audit 2024-09-21T04:55:01.646358+0000 mon.a (mon.0) 13788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:02.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:02 smithi044 bash[22676]: audit 2024-09-21T04:55:01.658194+0000 mon.a (mon.0) 13789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:02.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:02 smithi044 bash[22676]: audit 2024-09-21T04:55:02.289331+0000 mon.a (mon.0) 13790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:02.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:02 smithi044 bash[22676]: audit 2024-09-21T04:55:02.298246+0000 mon.a (mon.0) 13791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:02.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:02 smithi044 bash[22676]: audit 2024-09-21T04:55:02.309724+0000 mon.a (mon.0) 13792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:02 smithi179 bash[23186]: cluster 2024-09-21T04:55:01.485035+0000 mgr.a (mgr.14388) 17339 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:55:03.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:02 smithi179 bash[23186]: audit 2024-09-21T04:55:01.636766+0000 mon.a (mon.0) 13787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:02 smithi179 bash[23186]: audit 2024-09-21T04:55:01.646358+0000 mon.a (mon.0) 13788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:02 smithi179 bash[23186]: audit 2024-09-21T04:55:01.658194+0000 mon.a (mon.0) 13789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:02 smithi179 bash[23186]: audit 2024-09-21T04:55:02.289331+0000 mon.a (mon.0) 13790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:02 smithi179 bash[23186]: audit 2024-09-21T04:55:02.298246+0000 mon.a (mon.0) 13791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:02 smithi179 bash[23186]: audit 2024-09-21T04:55:02.309724+0000 mon.a (mon.0) 13792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:02 smithi049 bash[23528]: cluster 2024-09-21T04:55:01.485035+0000 mgr.a (mgr.14388) 17339 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T04:55:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:02 smithi049 bash[23528]: audit 2024-09-21T04:55:01.636766+0000 mon.a (mon.0) 13787 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:02 smithi049 bash[23528]: audit 2024-09-21T04:55:01.646358+0000 mon.a (mon.0) 13788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:02 smithi049 bash[23528]: audit 2024-09-21T04:55:01.658194+0000 mon.a (mon.0) 13789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:02 smithi049 bash[23528]: audit 2024-09-21T04:55:02.289331+0000 mon.a (mon.0) 13790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:02 smithi049 bash[23528]: audit 2024-09-21T04:55:02.298246+0000 mon.a (mon.0) 13791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:02 smithi049 bash[23528]: audit 2024-09-21T04:55:02.309724+0000 mon.a (mon.0) 13792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:03 smithi044 bash[22676]: cluster 2024-09-21T04:55:03.485811+0000 mgr.a (mgr.14388) 17340 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:55:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:03 smithi179 bash[23186]: cluster 2024-09-21T04:55:03.485811+0000 mgr.a (mgr.14388) 17340 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:55:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:03 smithi049 bash[23528]: cluster 2024-09-21T04:55:03.485811+0000 mgr.a (mgr.14388) 17340 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T04:55:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:05.103 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:05.878 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:05.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:05.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:06 smithi049 bash[23528]: audit 2024-09-21T04:55:05.430404+0000 mgr.a (mgr.14388) 17341 : audit [DBG] from='client.373491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:06.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:06 smithi049 bash[23528]: cluster 2024-09-21T04:55:05.488129+0000 mgr.a (mgr.14388) 17342 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:06 smithi044 bash[22676]: audit 2024-09-21T04:55:05.430404+0000 mgr.a (mgr.14388) 17341 : audit [DBG] from='client.373491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:06.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:06 smithi044 bash[22676]: cluster 2024-09-21T04:55:05.488129+0000 mgr.a (mgr.14388) 17342 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:06 smithi179 bash[23186]: audit 2024-09-21T04:55:05.430404+0000 mgr.a (mgr.14388) 17341 : audit [DBG] from='client.373491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:06 smithi179 bash[23186]: cluster 2024-09-21T04:55:05.488129+0000 mgr.a (mgr.14388) 17342 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:08 smithi049 bash[23528]: cluster 2024-09-21T04:55:07.489019+0000 mgr.a (mgr.14388) 17343 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:55:08.860 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:08 smithi044 bash[22676]: cluster 2024-09-21T04:55:07.489019+0000 mgr.a (mgr.14388) 17343 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:55:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:08 smithi179 bash[23186]: cluster 2024-09-21T04:55:07.489019+0000 mgr.a (mgr.14388) 17343 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:55:10.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:10.880 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:10.881 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:10 smithi044 bash[22676]: cluster 2024-09-21T04:55:09.489790+0000 mgr.a (mgr.14388) 17344 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:55:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:10 smithi179 bash[23186]: cluster 2024-09-21T04:55:09.489790+0000 mgr.a (mgr.14388) 17344 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:55:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:10 smithi049 bash[23528]: cluster 2024-09-21T04:55:09.489790+0000 mgr.a (mgr.14388) 17344 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:55:11.646 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:11.646 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:11.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:11.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:11.647 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:12 smithi044 bash[22676]: audit 2024-09-21T04:55:11.208157+0000 mgr.a (mgr.14388) 17345 : audit [DBG] from='client.373569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:12 smithi044 bash[22676]: cluster 2024-09-21T04:55:11.491617+0000 mgr.a (mgr.14388) 17346 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:12 smithi044 bash[22676]: audit 2024-09-21T04:55:12.274043+0000 mon.a (mon.0) 13793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:12 smithi044 bash[22676]: audit 2024-09-21T04:55:12.284003+0000 mon.a (mon.0) 13794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:12 smithi044 bash[22676]: audit 2024-09-21T04:55:12.294490+0000 mon.a (mon.0) 13795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:12 smithi179 bash[23186]: audit 2024-09-21T04:55:11.208157+0000 mgr.a (mgr.14388) 17345 : audit [DBG] from='client.373569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:12 smithi179 bash[23186]: cluster 2024-09-21T04:55:11.491617+0000 mgr.a (mgr.14388) 17346 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:13.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:12 smithi179 bash[23186]: audit 2024-09-21T04:55:12.274043+0000 mon.a (mon.0) 13793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:13.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:12 smithi179 bash[23186]: audit 2024-09-21T04:55:12.284003+0000 mon.a (mon.0) 13794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:13.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:12 smithi179 bash[23186]: audit 2024-09-21T04:55:12.294490+0000 mon.a (mon.0) 13795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:13.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:12 smithi049 bash[23528]: audit 2024-09-21T04:55:11.208157+0000 mgr.a (mgr.14388) 17345 : audit [DBG] from='client.373569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:13.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:12 smithi049 bash[23528]: cluster 2024-09-21T04:55:11.491617+0000 mgr.a (mgr.14388) 17346 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:13.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:12 smithi049 bash[23528]: audit 2024-09-21T04:55:12.274043+0000 mon.a (mon.0) 13793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:13.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:12 smithi049 bash[23528]: audit 2024-09-21T04:55:12.284003+0000 mon.a (mon.0) 13794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:13.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:12 smithi049 bash[23528]: audit 2024-09-21T04:55:12.294490+0000 mon.a (mon.0) 13795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:14.893 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:14 smithi049 bash[23528]: cluster 2024-09-21T04:55:13.492529+0000 mgr.a (mgr.14388) 17347 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:55:14.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:14 smithi044 bash[22676]: cluster 2024-09-21T04:55:13.492529+0000 mgr.a (mgr.14388) 17347 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:55:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:14 smithi179 bash[23186]: cluster 2024-09-21T04:55:13.492529+0000 mgr.a (mgr.14388) 17347 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T04:55:16.648 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:16.648 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:16.649 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:16.830 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:16 smithi049 bash[23528]: cluster 2024-09-21T04:55:15.494725+0000 mgr.a (mgr.14388) 17348 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:55:16.909 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:16 smithi179 bash[23186]: cluster 2024-09-21T04:55:15.494725+0000 mgr.a (mgr.14388) 17348 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:55:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:16 smithi044 bash[22676]: cluster 2024-09-21T04:55:15.494725+0000 mgr.a (mgr.14388) 17348 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T04:55:17.421 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:17.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:18 smithi179 bash[23186]: audit 2024-09-21T04:55:16.976906+0000 mgr.a (mgr.14388) 17349 : audit [DBG] from='client.373647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:18 smithi179 bash[23186]: cluster 2024-09-21T04:55:17.495733+0000 mgr.a (mgr.14388) 17350 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:18 smithi044 bash[22676]: audit 2024-09-21T04:55:16.976906+0000 mgr.a (mgr.14388) 17349 : audit [DBG] from='client.373647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:18 smithi044 bash[22676]: cluster 2024-09-21T04:55:17.495733+0000 mgr.a (mgr.14388) 17350 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:18 smithi049 bash[23528]: audit 2024-09-21T04:55:16.976906+0000 mgr.a (mgr.14388) 17349 : audit [DBG] from='client.373647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:18 smithi049 bash[23528]: cluster 2024-09-21T04:55:17.495733+0000 mgr.a (mgr.14388) 17350 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:20 smithi044 bash[22676]: cluster 2024-09-21T04:55:19.496561+0000 mgr.a (mgr.14388) 17351 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:20 smithi179 bash[23186]: cluster 2024-09-21T04:55:19.496561+0000 mgr.a (mgr.14388) 17351 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:20 smithi049 bash[23528]: cluster 2024-09-21T04:55:19.496561+0000 mgr.a (mgr.14388) 17351 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:22.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:22.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:22.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:22.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: cluster 2024-09-21T04:55:21.498883+0000 mgr.a (mgr.14388) 17352 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:55:22.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:21.853024+0000 mon.a (mon.0) 13796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:21.861241+0000 mon.a (mon.0) 13797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:21.871942+0000 mon.a (mon.0) 13798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.447291+0000 mon.a (mon.0) 13799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.451568+0000 mon.a (mon.0) 13800 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.452666+0000 mon.a (mon.0) 13801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.459922+0000 mon.a (mon.0) 13802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.464343+0000 mon.a (mon.0) 13803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.521661+0000 mon.a (mon.0) 13804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.527985+0000 mon.a (mon.0) 13805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:22 smithi179 bash[23186]: audit 2024-09-21T04:55:22.538630+0000 mon.a (mon.0) 13806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: cluster 2024-09-21T04:55:21.498883+0000 mgr.a (mgr.14388) 17352 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:55:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:21.853024+0000 mon.a (mon.0) 13796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:21.861241+0000 mon.a (mon.0) 13797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:21.871942+0000 mon.a (mon.0) 13798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.447291+0000 mon.a (mon.0) 13799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.451568+0000 mon.a (mon.0) 13800 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.452666+0000 mon.a (mon.0) 13801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.459922+0000 mon.a (mon.0) 13802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.464343+0000 mon.a (mon.0) 13803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.521661+0000 mon.a (mon.0) 13804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.527985+0000 mon.a (mon.0) 13805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:22 smithi044 bash[22676]: audit 2024-09-21T04:55:22.538630+0000 mon.a (mon.0) 13806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: cluster 2024-09-21T04:55:21.498883+0000 mgr.a (mgr.14388) 17352 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:21.853024+0000 mon.a (mon.0) 13796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:21.861241+0000 mon.a (mon.0) 13797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:21.871942+0000 mon.a (mon.0) 13798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.447291+0000 mon.a (mon.0) 13799 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.451568+0000 mon.a (mon.0) 13800 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.452666+0000 mon.a (mon.0) 13801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.459922+0000 mon.a (mon.0) 13802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.464343+0000 mon.a (mon.0) 13803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:55:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.521661+0000 mon.a (mon.0) 13804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.527985+0000 mon.a (mon.0) 13805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:22 smithi049 bash[23528]: audit 2024-09-21T04:55:22.538630+0000 mon.a (mon.0) 13806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:23.590 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:55:23 smithi044 bash[22930]: debug 2024-09-21T04:55:23.241+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:55:23.590 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:55:23 smithi044 bash[22930]: debug 2024-09-21T04:55:23.253+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:55:23.673 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:23.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:23 smithi044 bash[22676]: audit 2024-09-21T04:55:22.465761+0000 mgr.a (mgr.14388) 17353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:55:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:23 smithi179 bash[23186]: audit 2024-09-21T04:55:22.465761+0000 mgr.a (mgr.14388) 17353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:55:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:23 smithi049 bash[23528]: audit 2024-09-21T04:55:22.465761+0000 mgr.a (mgr.14388) 17353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:55:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:24 smithi044 bash[22676]: audit 2024-09-21T04:55:22.831910+0000 mgr.a (mgr.14388) 17354 : audit [DBG] from='client.373725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:24 smithi044 bash[22676]: audit 2024-09-21T04:55:23.248726+0000 mgr.a (mgr.14388) 17355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:55:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:24 smithi044 bash[22676]: cephadm 2024-09-21T04:55:23.260328+0000 mgr.a (mgr.14388) 17356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:55:24.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:24 smithi044 bash[22676]: cluster 2024-09-21T04:55:23.499471+0000 mgr.a (mgr.14388) 17357 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:24 smithi179 bash[23186]: audit 2024-09-21T04:55:22.831910+0000 mgr.a (mgr.14388) 17354 : audit [DBG] from='client.373725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:24 smithi179 bash[23186]: audit 2024-09-21T04:55:23.248726+0000 mgr.a (mgr.14388) 17355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:55:25.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:24 smithi179 bash[23186]: cephadm 2024-09-21T04:55:23.260328+0000 mgr.a (mgr.14388) 17356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:55:25.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:24 smithi179 bash[23186]: cluster 2024-09-21T04:55:23.499471+0000 mgr.a (mgr.14388) 17357 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:25.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:24 smithi049 bash[23528]: audit 2024-09-21T04:55:22.831910+0000 mgr.a (mgr.14388) 17354 : audit [DBG] from='client.373725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:25.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:24 smithi049 bash[23528]: audit 2024-09-21T04:55:23.248726+0000 mgr.a (mgr.14388) 17355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:55:25.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:24 smithi049 bash[23528]: cephadm 2024-09-21T04:55:23.260328+0000 mgr.a (mgr.14388) 17356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:55:25.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:24 smithi049 bash[23528]: cluster 2024-09-21T04:55:23.499471+0000 mgr.a (mgr.14388) 17357 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:26.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:26 smithi044 bash[22676]: cluster 2024-09-21T04:55:25.501817+0000 mgr.a (mgr.14388) 17358 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:26 smithi179 bash[23186]: cluster 2024-09-21T04:55:25.501817+0000 mgr.a (mgr.14388) 17358 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:26 smithi049 bash[23528]: cluster 2024-09-21T04:55:25.501817+0000 mgr.a (mgr.14388) 17358 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:28.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:28.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:28.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:28.967 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:28 smithi044 bash[22676]: cluster 2024-09-21T04:55:27.502542+0000 mgr.a (mgr.14388) 17359 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:28 smithi179 bash[23186]: cluster 2024-09-21T04:55:27.502542+0000 mgr.a (mgr.14388) 17359 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:28 smithi049 bash[23528]: cluster 2024-09-21T04:55:27.502542+0000 mgr.a (mgr.14388) 17359 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:29.420 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:29.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:30 smithi044 bash[22676]: audit 2024-09-21T04:55:29.000183+0000 mgr.a (mgr.14388) 17360 : audit [DBG] from='client.373908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:30 smithi044 bash[22676]: cluster 2024-09-21T04:55:29.503510+0000 mgr.a (mgr.14388) 17361 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:30 smithi179 bash[23186]: audit 2024-09-21T04:55:29.000183+0000 mgr.a (mgr.14388) 17360 : audit [DBG] from='client.373908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:31.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:30 smithi179 bash[23186]: cluster 2024-09-21T04:55:29.503510+0000 mgr.a (mgr.14388) 17361 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:30 smithi049 bash[23528]: audit 2024-09-21T04:55:29.000183+0000 mgr.a (mgr.14388) 17360 : audit [DBG] from='client.373908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:30 smithi049 bash[23528]: cluster 2024-09-21T04:55:29.503510+0000 mgr.a (mgr.14388) 17361 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:31 smithi044 bash[22676]: cluster 2024-09-21T04:55:31.505819+0000 mgr.a (mgr.14388) 17362 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:31 smithi179 bash[23186]: cluster 2024-09-21T04:55:31.505819+0000 mgr.a (mgr.14388) 17362 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:31 smithi049 bash[23528]: cluster 2024-09-21T04:55:31.505819+0000 mgr.a (mgr.14388) 17362 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:33.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:33 smithi044 bash[22676]: audit 2024-09-21T04:55:32.487665+0000 mon.a (mon.0) 13807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:33 smithi044 bash[22676]: audit 2024-09-21T04:55:32.496201+0000 mon.a (mon.0) 13808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:33 smithi044 bash[22676]: audit 2024-09-21T04:55:32.507143+0000 mon.a (mon.0) 13809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:33 smithi179 bash[23186]: audit 2024-09-21T04:55:32.487665+0000 mon.a (mon.0) 13807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:33 smithi179 bash[23186]: audit 2024-09-21T04:55:32.496201+0000 mon.a (mon.0) 13808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:33 smithi179 bash[23186]: audit 2024-09-21T04:55:32.507143+0000 mon.a (mon.0) 13809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:33 smithi049 bash[23528]: audit 2024-09-21T04:55:32.487665+0000 mon.a (mon.0) 13807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:33 smithi049 bash[23528]: audit 2024-09-21T04:55:32.496201+0000 mon.a (mon.0) 13808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:33.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:33 smithi049 bash[23528]: audit 2024-09-21T04:55:32.507143+0000 mon.a (mon.0) 13809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:34.422 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:34.423 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:34.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:34 smithi179 bash[23186]: cluster 2024-09-21T04:55:33.506623+0000 mgr.a (mgr.14388) 17363 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:34 smithi049 bash[23528]: cluster 2024-09-21T04:55:33.506623+0000 mgr.a (mgr.14388) 17363 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:34 smithi044 bash[22676]: cluster 2024-09-21T04:55:33.506623+0000 mgr.a (mgr.14388) 17363 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:35.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:36.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:36 smithi179 bash[23186]: audit 2024-09-21T04:55:34.756471+0000 mgr.a (mgr.14388) 17364 : audit [DBG] from='client.373986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:36.903 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:36 smithi179 bash[23186]: cluster 2024-09-21T04:55:35.509690+0000 mgr.a (mgr.14388) 17365 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:36 smithi044 bash[22676]: audit 2024-09-21T04:55:34.756471+0000 mgr.a (mgr.14388) 17364 : audit [DBG] from='client.373986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:36 smithi044 bash[22676]: cluster 2024-09-21T04:55:35.509690+0000 mgr.a (mgr.14388) 17365 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:36 smithi049 bash[23528]: audit 2024-09-21T04:55:34.756471+0000 mgr.a (mgr.14388) 17364 : audit [DBG] from='client.373986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:36 smithi049 bash[23528]: cluster 2024-09-21T04:55:35.509690+0000 mgr.a (mgr.14388) 17365 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:55:38.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:38 smithi044 bash[22676]: cluster 2024-09-21T04:55:37.510506+0000 mgr.a (mgr.14388) 17366 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:55:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:38 smithi179 bash[23186]: cluster 2024-09-21T04:55:37.510506+0000 mgr.a (mgr.14388) 17366 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:55:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:38 smithi049 bash[23528]: cluster 2024-09-21T04:55:37.510506+0000 mgr.a (mgr.14388) 17366 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:55:40.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:40.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:40.219 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:40 smithi044 bash[22676]: cluster 2024-09-21T04:55:39.511300+0000 mgr.a (mgr.14388) 17367 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:55:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:40.990 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:40 smithi179 bash[23186]: cluster 2024-09-21T04:55:39.511300+0000 mgr.a (mgr.14388) 17367 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:55:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:40 smithi049 bash[23528]: cluster 2024-09-21T04:55:39.511300+0000 mgr.a (mgr.14388) 17367 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:55:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:41 smithi044 bash[22676]: audit 2024-09-21T04:55:40.544901+0000 mgr.a (mgr.14388) 17368 : audit [DBG] from='client.374064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:41 smithi179 bash[23186]: audit 2024-09-21T04:55:40.544901+0000 mgr.a (mgr.14388) 17368 : audit [DBG] from='client.374064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:41 smithi049 bash[23528]: audit 2024-09-21T04:55:40.544901+0000 mgr.a (mgr.14388) 17368 : audit [DBG] from='client.374064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:42 smithi044 bash[22676]: cluster 2024-09-21T04:55:41.514398+0000 mgr.a (mgr.14388) 17369 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:42 smithi044 bash[22676]: audit 2024-09-21T04:55:42.064267+0000 mon.a (mon.0) 13810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:42 smithi044 bash[22676]: audit 2024-09-21T04:55:42.070924+0000 mon.a (mon.0) 13811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:42 smithi044 bash[22676]: audit 2024-09-21T04:55:42.079139+0000 mon.a (mon.0) 13812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:42 smithi179 bash[23186]: cluster 2024-09-21T04:55:41.514398+0000 mgr.a (mgr.14388) 17369 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:42 smithi179 bash[23186]: audit 2024-09-21T04:55:42.064267+0000 mon.a (mon.0) 13810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:42 smithi179 bash[23186]: audit 2024-09-21T04:55:42.070924+0000 mon.a (mon.0) 13811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:42 smithi179 bash[23186]: audit 2024-09-21T04:55:42.079139+0000 mon.a (mon.0) 13812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:42 smithi049 bash[23528]: cluster 2024-09-21T04:55:41.514398+0000 mgr.a (mgr.14388) 17369 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:42 smithi049 bash[23528]: audit 2024-09-21T04:55:42.064267+0000 mon.a (mon.0) 13810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:42 smithi049 bash[23528]: audit 2024-09-21T04:55:42.070924+0000 mon.a (mon.0) 13811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:42 smithi049 bash[23528]: audit 2024-09-21T04:55:42.079139+0000 mon.a (mon.0) 13812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:43 smithi179 bash[23186]: audit 2024-09-21T04:55:42.744550+0000 mon.a (mon.0) 13813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:43 smithi179 bash[23186]: audit 2024-09-21T04:55:42.753047+0000 mon.a (mon.0) 13814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:43 smithi179 bash[23186]: audit 2024-09-21T04:55:42.762975+0000 mon.a (mon.0) 13815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:43 smithi179 bash[23186]: cluster 2024-09-21T04:55:43.515281+0000 mgr.a (mgr.14388) 17370 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:55:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:43 smithi049 bash[23528]: audit 2024-09-21T04:55:42.744550+0000 mon.a (mon.0) 13813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:43 smithi049 bash[23528]: audit 2024-09-21T04:55:42.753047+0000 mon.a (mon.0) 13814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:43 smithi049 bash[23528]: audit 2024-09-21T04:55:42.762975+0000 mon.a (mon.0) 13815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:43 smithi049 bash[23528]: cluster 2024-09-21T04:55:43.515281+0000 mgr.a (mgr.14388) 17370 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:55:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:43 smithi044 bash[22676]: audit 2024-09-21T04:55:42.744550+0000 mon.a (mon.0) 13813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:43 smithi044 bash[22676]: audit 2024-09-21T04:55:42.753047+0000 mon.a (mon.0) 13814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:43 smithi044 bash[22676]: audit 2024-09-21T04:55:42.762975+0000 mon.a (mon.0) 13815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:43 smithi044 bash[22676]: cluster 2024-09-21T04:55:43.515281+0000 mgr.a (mgr.14388) 17370 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:55:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:46.769 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:46.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:46.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:46.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:46.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:46.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:46 smithi044 bash[22676]: cluster 2024-09-21T04:55:45.517288+0000 mgr.a (mgr.14388) 17371 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:46 smithi179 bash[23186]: cluster 2024-09-21T04:55:45.517288+0000 mgr.a (mgr.14388) 17371 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:46 smithi049 bash[23528]: cluster 2024-09-21T04:55:45.517288+0000 mgr.a (mgr.14388) 17371 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:47 smithi044 bash[22676]: audit 2024-09-21T04:55:46.322260+0000 mgr.a (mgr.14388) 17372 : audit [DBG] from='client.374142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:47 smithi179 bash[23186]: audit 2024-09-21T04:55:46.322260+0000 mgr.a (mgr.14388) 17372 : audit [DBG] from='client.374142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:47 smithi049 bash[23528]: audit 2024-09-21T04:55:46.322260+0000 mgr.a (mgr.14388) 17372 : audit [DBG] from='client.374142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:48 smithi044 bash[22676]: cluster 2024-09-21T04:55:47.518190+0000 mgr.a (mgr.14388) 17373 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:55:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:48 smithi179 bash[23186]: cluster 2024-09-21T04:55:47.518190+0000 mgr.a (mgr.14388) 17373 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:55:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:48 smithi049 bash[23528]: cluster 2024-09-21T04:55:47.518190+0000 mgr.a (mgr.14388) 17373 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:55:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:50 smithi044 bash[22676]: cluster 2024-09-21T04:55:49.519052+0000 mgr.a (mgr.14388) 17374 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:55:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:50 smithi179 bash[23186]: cluster 2024-09-21T04:55:49.519052+0000 mgr.a (mgr.14388) 17374 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:55:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:50 smithi049 bash[23528]: cluster 2024-09-21T04:55:49.519052+0000 mgr.a (mgr.14388) 17374 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T04:55:51.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:51.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:51.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:52.564 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:52.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:52.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:52.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:52.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:52 smithi044 bash[22676]: cluster 2024-09-21T04:55:51.521365+0000 mgr.a (mgr.14388) 17375 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:55:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:52 smithi179 bash[23186]: cluster 2024-09-21T04:55:51.521365+0000 mgr.a (mgr.14388) 17375 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:55:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:52 smithi049 bash[23528]: cluster 2024-09-21T04:55:51.521365+0000 mgr.a (mgr.14388) 17375 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T04:55:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:53 smithi044 bash[22676]: audit 2024-09-21T04:55:52.104263+0000 mgr.a (mgr.14388) 17376 : audit [DBG] from='client.374217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:53 smithi044 bash[22676]: audit 2024-09-21T04:55:52.705654+0000 mon.a (mon.0) 13816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:53 smithi044 bash[22676]: audit 2024-09-21T04:55:52.715153+0000 mon.a (mon.0) 13817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:53 smithi044 bash[22676]: audit 2024-09-21T04:55:52.725649+0000 mon.a (mon.0) 13818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:53 smithi179 bash[23186]: audit 2024-09-21T04:55:52.104263+0000 mgr.a (mgr.14388) 17376 : audit [DBG] from='client.374217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:53 smithi179 bash[23186]: audit 2024-09-21T04:55:52.705654+0000 mon.a (mon.0) 13816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:53 smithi179 bash[23186]: audit 2024-09-21T04:55:52.715153+0000 mon.a (mon.0) 13817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:53 smithi179 bash[23186]: audit 2024-09-21T04:55:52.725649+0000 mon.a (mon.0) 13818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:53 smithi049 bash[23528]: audit 2024-09-21T04:55:52.104263+0000 mgr.a (mgr.14388) 17376 : audit [DBG] from='client.374217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:53 smithi049 bash[23528]: audit 2024-09-21T04:55:52.705654+0000 mon.a (mon.0) 13816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:53 smithi049 bash[23528]: audit 2024-09-21T04:55:52.715153+0000 mon.a (mon.0) 13817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:53 smithi049 bash[23528]: audit 2024-09-21T04:55:52.725649+0000 mon.a (mon.0) 13818 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:55:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:54 smithi044 bash[22676]: cluster 2024-09-21T04:55:53.522269+0000 mgr.a (mgr.14388) 17377 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:54 smithi179 bash[23186]: cluster 2024-09-21T04:55:53.522269+0000 mgr.a (mgr.14388) 17377 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:54 smithi049 bash[23528]: cluster 2024-09-21T04:55:53.522269+0000 mgr.a (mgr.14388) 17377 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:55:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:56 smithi044 bash[22676]: cluster 2024-09-21T04:55:55.524428+0000 mgr.a (mgr.14388) 17378 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:55:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:56 smithi179 bash[23186]: cluster 2024-09-21T04:55:55.524428+0000 mgr.a (mgr.14388) 17378 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:55:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:56 smithi049 bash[23528]: cluster 2024-09-21T04:55:55.524428+0000 mgr.a (mgr.14388) 17378 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:55:57.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:55:57.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:55:57.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:55:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:55:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:55:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:55:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:55:58.323 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:55:58.969 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:58 smithi179 bash[23186]: cluster 2024-09-21T04:55:57.525211+0000 mgr.a (mgr.14388) 17379 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:55:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:58 smithi044 bash[22676]: cluster 2024-09-21T04:55:57.525211+0000 mgr.a (mgr.14388) 17379 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:55:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:58 smithi049 bash[23528]: cluster 2024-09-21T04:55:57.525211+0000 mgr.a (mgr.14388) 17379 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:55:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:55:59 smithi044 bash[22676]: audit 2024-09-21T04:55:57.895116+0000 mgr.a (mgr.14388) 17380 : audit [DBG] from='client.374289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:55:59 smithi179 bash[23186]: audit 2024-09-21T04:55:57.895116+0000 mgr.a (mgr.14388) 17380 : audit [DBG] from='client.374289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:55:59 smithi049 bash[23528]: audit 2024-09-21T04:55:57.895116+0000 mgr.a (mgr.14388) 17380 : audit [DBG] from='client.374289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:00 smithi049 bash[23528]: cluster 2024-09-21T04:55:59.526233+0000 mgr.a (mgr.14388) 17381 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:56:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:00 smithi044 bash[22676]: cluster 2024-09-21T04:55:59.526233+0000 mgr.a (mgr.14388) 17381 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:56:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:00 smithi179 bash[23186]: cluster 2024-09-21T04:55:59.526233+0000 mgr.a (mgr.14388) 17381 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:56:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:01 smithi044 bash[22676]: cluster 2024-09-21T04:56:01.528532+0000 mgr.a (mgr.14388) 17382 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:56:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:01 smithi179 bash[23186]: cluster 2024-09-21T04:56:01.528532+0000 mgr.a (mgr.14388) 17382 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:56:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:01 smithi049 bash[23528]: cluster 2024-09-21T04:56:01.528532+0000 mgr.a (mgr.14388) 17382 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:56:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:03 smithi049 bash[23528]: audit 2024-09-21T04:56:02.290327+0000 mon.a (mon.0) 13819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:03 smithi049 bash[23528]: audit 2024-09-21T04:56:02.298684+0000 mon.a (mon.0) 13820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:03 smithi049 bash[23528]: audit 2024-09-21T04:56:02.307795+0000 mon.a (mon.0) 13821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:03 smithi049 bash[23528]: audit 2024-09-21T04:56:02.957689+0000 mon.a (mon.0) 13822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:03 smithi049 bash[23528]: audit 2024-09-21T04:56:02.966027+0000 mon.a (mon.0) 13823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:03 smithi049 bash[23528]: audit 2024-09-21T04:56:02.976147+0000 mon.a (mon.0) 13824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:03 smithi044 bash[22676]: audit 2024-09-21T04:56:02.290327+0000 mon.a (mon.0) 13819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:03 smithi044 bash[22676]: audit 2024-09-21T04:56:02.298684+0000 mon.a (mon.0) 13820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:03 smithi044 bash[22676]: audit 2024-09-21T04:56:02.307795+0000 mon.a (mon.0) 13821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:03 smithi044 bash[22676]: audit 2024-09-21T04:56:02.957689+0000 mon.a (mon.0) 13822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:03 smithi044 bash[22676]: audit 2024-09-21T04:56:02.966027+0000 mon.a (mon.0) 13823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:03 smithi044 bash[22676]: audit 2024-09-21T04:56:02.976147+0000 mon.a (mon.0) 13824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:03 smithi179 bash[23186]: audit 2024-09-21T04:56:02.290327+0000 mon.a (mon.0) 13819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:03 smithi179 bash[23186]: audit 2024-09-21T04:56:02.298684+0000 mon.a (mon.0) 13820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:03 smithi179 bash[23186]: audit 2024-09-21T04:56:02.307795+0000 mon.a (mon.0) 13821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:03 smithi179 bash[23186]: audit 2024-09-21T04:56:02.957689+0000 mon.a (mon.0) 13822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:03 smithi179 bash[23186]: audit 2024-09-21T04:56:02.966027+0000 mon.a (mon.0) 13823 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:03 smithi179 bash[23186]: audit 2024-09-21T04:56:02.976147+0000 mon.a (mon.0) 13824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:04.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:04.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:04.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:04.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:04.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:04 smithi049 bash[23528]: cluster 2024-09-21T04:56:03.529338+0000 mgr.a (mgr.14388) 17383 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:56:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:04 smithi044 bash[22676]: cluster 2024-09-21T04:56:03.529338+0000 mgr.a (mgr.14388) 17383 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:56:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:04 smithi179 bash[23186]: cluster 2024-09-21T04:56:03.529338+0000 mgr.a (mgr.14388) 17383 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T04:56:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:05 smithi049 bash[23528]: audit 2024-09-21T04:56:03.657412+0000 mgr.a (mgr.14388) 17384 : audit [DBG] from='client.374367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:05 smithi044 bash[22676]: audit 2024-09-21T04:56:03.657412+0000 mgr.a (mgr.14388) 17384 : audit [DBG] from='client.374367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:05 smithi179 bash[23186]: audit 2024-09-21T04:56:03.657412+0000 mgr.a (mgr.14388) 17384 : audit [DBG] from='client.374367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:06 smithi044 bash[22676]: cluster 2024-09-21T04:56:05.531845+0000 mgr.a (mgr.14388) 17385 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:56:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:06 smithi179 bash[23186]: cluster 2024-09-21T04:56:05.531845+0000 mgr.a (mgr.14388) 17385 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:56:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:06 smithi049 bash[23528]: cluster 2024-09-21T04:56:05.531845+0000 mgr.a (mgr.14388) 17385 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T04:56:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:08 smithi044 bash[22676]: cluster 2024-09-21T04:56:07.532470+0000 mgr.a (mgr.14388) 17386 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:08 smithi179 bash[23186]: cluster 2024-09-21T04:56:07.532470+0000 mgr.a (mgr.14388) 17386 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:08 smithi049 bash[23528]: cluster 2024-09-21T04:56:07.532470+0000 mgr.a (mgr.14388) 17386 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:09.866 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:09.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:09.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:09.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:09.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:10 smithi044 bash[22676]: audit 2024-09-21T04:56:09.434787+0000 mgr.a (mgr.14388) 17387 : audit [DBG] from='client.374445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:10.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:10 smithi044 bash[22676]: cluster 2024-09-21T04:56:09.532957+0000 mgr.a (mgr.14388) 17388 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:10 smithi179 bash[23186]: audit 2024-09-21T04:56:09.434787+0000 mgr.a (mgr.14388) 17387 : audit [DBG] from='client.374445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:10 smithi179 bash[23186]: cluster 2024-09-21T04:56:09.532957+0000 mgr.a (mgr.14388) 17388 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:10 smithi049 bash[23528]: audit 2024-09-21T04:56:09.434787+0000 mgr.a (mgr.14388) 17387 : audit [DBG] from='client.374445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:10 smithi049 bash[23528]: cluster 2024-09-21T04:56:09.532957+0000 mgr.a (mgr.14388) 17388 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:12.945 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:12 smithi049 bash[23528]: cluster 2024-09-21T04:56:11.535335+0000 mgr.a (mgr.14388) 17389 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:12 smithi044 bash[22676]: cluster 2024-09-21T04:56:11.535335+0000 mgr.a (mgr.14388) 17389 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:12 smithi179 bash[23186]: cluster 2024-09-21T04:56:11.535335+0000 mgr.a (mgr.14388) 17389 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:13 smithi044 bash[22676]: audit 2024-09-21T04:56:12.920111+0000 mon.a (mon.0) 13825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:13 smithi044 bash[22676]: audit 2024-09-21T04:56:12.928695+0000 mon.a (mon.0) 13826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:13 smithi044 bash[22676]: audit 2024-09-21T04:56:12.940451+0000 mon.a (mon.0) 13827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:13 smithi044 bash[22676]: cluster 2024-09-21T04:56:13.536241+0000 mgr.a (mgr.14388) 17390 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:13 smithi179 bash[23186]: audit 2024-09-21T04:56:12.920111+0000 mon.a (mon.0) 13825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:13 smithi179 bash[23186]: audit 2024-09-21T04:56:12.928695+0000 mon.a (mon.0) 13826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:13 smithi179 bash[23186]: audit 2024-09-21T04:56:12.940451+0000 mon.a (mon.0) 13827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:13 smithi179 bash[23186]: cluster 2024-09-21T04:56:13.536241+0000 mgr.a (mgr.14388) 17390 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:13 smithi049 bash[23528]: audit 2024-09-21T04:56:12.920111+0000 mon.a (mon.0) 13825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:13 smithi049 bash[23528]: audit 2024-09-21T04:56:12.928695+0000 mon.a (mon.0) 13826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:13 smithi049 bash[23528]: audit 2024-09-21T04:56:12.940451+0000 mon.a (mon.0) 13827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:13 smithi049 bash[23528]: cluster 2024-09-21T04:56:13.536241+0000 mgr.a (mgr.14388) 17390 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:14.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:14.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:15.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:15.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:15.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:15.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:15.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:16 smithi044 bash[22676]: audit 2024-09-21T04:56:15.238726+0000 mgr.a (mgr.14388) 17391 : audit [DBG] from='client.374520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:16 smithi044 bash[22676]: cluster 2024-09-21T04:56:15.537785+0000 mgr.a (mgr.14388) 17392 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-21T04:56:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:16 smithi179 bash[23186]: audit 2024-09-21T04:56:15.238726+0000 mgr.a (mgr.14388) 17391 : audit [DBG] from='client.374520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:16 smithi179 bash[23186]: cluster 2024-09-21T04:56:15.537785+0000 mgr.a (mgr.14388) 17392 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-21T04:56:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:16 smithi049 bash[23528]: audit 2024-09-21T04:56:15.238726+0000 mgr.a (mgr.14388) 17391 : audit [DBG] from='client.374520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:16 smithi049 bash[23528]: cluster 2024-09-21T04:56:15.537785+0000 mgr.a (mgr.14388) 17392 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-21T04:56:18.713 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:18 smithi049 bash[23528]: cluster 2024-09-21T04:56:17.538730+0000 mgr.a (mgr.14388) 17393 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T04:56:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:18 smithi044 bash[22676]: cluster 2024-09-21T04:56:17.538730+0000 mgr.a (mgr.14388) 17393 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T04:56:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:18 smithi179 bash[23186]: cluster 2024-09-21T04:56:17.538730+0000 mgr.a (mgr.14388) 17393 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T04:56:20.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:20.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:20.705 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:20.927 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:20 smithi049 bash[23528]: cluster 2024-09-21T04:56:19.539552+0000 mgr.a (mgr.14388) 17394 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T04:56:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:20 smithi044 bash[22676]: cluster 2024-09-21T04:56:19.539552+0000 mgr.a (mgr.14388) 17394 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T04:56:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:20 smithi179 bash[23186]: cluster 2024-09-21T04:56:19.539552+0000 mgr.a (mgr.14388) 17394 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T04:56:21.455 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:22 smithi044 bash[22676]: audit 2024-09-21T04:56:21.037726+0000 mgr.a (mgr.14388) 17395 : audit [DBG] from='client.374598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:22 smithi044 bash[22676]: cluster 2024-09-21T04:56:21.542578+0000 mgr.a (mgr.14388) 17396 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:56:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:22 smithi044 bash[22676]: audit 2024-09-21T04:56:22.517553+0000 mon.a (mon.0) 13828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:22 smithi044 bash[22676]: audit 2024-09-21T04:56:22.525650+0000 mon.a (mon.0) 13829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:22 smithi044 bash[22676]: audit 2024-09-21T04:56:22.536642+0000 mon.a (mon.0) 13830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:22 smithi179 bash[23186]: audit 2024-09-21T04:56:21.037726+0000 mgr.a (mgr.14388) 17395 : audit [DBG] from='client.374598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:22 smithi179 bash[23186]: cluster 2024-09-21T04:56:21.542578+0000 mgr.a (mgr.14388) 17396 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:56:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:22 smithi179 bash[23186]: audit 2024-09-21T04:56:22.517553+0000 mon.a (mon.0) 13828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:22 smithi179 bash[23186]: audit 2024-09-21T04:56:22.525650+0000 mon.a (mon.0) 13829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:23.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:22 smithi179 bash[23186]: audit 2024-09-21T04:56:22.536642+0000 mon.a (mon.0) 13830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:22 smithi049 bash[23528]: audit 2024-09-21T04:56:21.037726+0000 mgr.a (mgr.14388) 17395 : audit [DBG] from='client.374598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:22 smithi049 bash[23528]: cluster 2024-09-21T04:56:21.542578+0000 mgr.a (mgr.14388) 17396 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T04:56:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:22 smithi049 bash[23528]: audit 2024-09-21T04:56:22.517553+0000 mon.a (mon.0) 13828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:22 smithi049 bash[23528]: audit 2024-09-21T04:56:22.525650+0000 mon.a (mon.0) 13829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:22 smithi049 bash[23528]: audit 2024-09-21T04:56:22.536642+0000 mon.a (mon.0) 13830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.179522+0000 mon.a (mon.0) 13831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.189406+0000 mon.a (mon.0) 13832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.199854+0000 mon.a (mon.0) 13833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.322821+0000 mon.a (mon.0) 13834 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: cluster 2024-09-21T04:56:23.543164+0000 mgr.a (mgr.14388) 17397 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.905353+0000 mon.a (mon.0) 13835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.910266+0000 mon.a (mon.0) 13836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.936220+0000 mon.a (mon.0) 13837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.941049+0000 mon.a (mon.0) 13838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.942362+0000 mon.a (mon.0) 13839 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.943408+0000 mon.a (mon.0) 13840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.948801+0000 mon.a (mon.0) 13841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22676]: audit 2024-09-21T04:56:23.954323+0000 mon.a (mon.0) 13842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.179522+0000 mon.a (mon.0) 13831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.189406+0000 mon.a (mon.0) 13832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.199854+0000 mon.a (mon.0) 13833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.322821+0000 mon.a (mon.0) 13834 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: cluster 2024-09-21T04:56:23.543164+0000 mgr.a (mgr.14388) 17397 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.905353+0000 mon.a (mon.0) 13835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.910266+0000 mon.a (mon.0) 13836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.936220+0000 mon.a (mon.0) 13837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.941049+0000 mon.a (mon.0) 13838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.942362+0000 mon.a (mon.0) 13839 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:24.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.943408+0000 mon.a (mon.0) 13840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:24.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.948801+0000 mon.a (mon.0) 13841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:24 smithi179 bash[23186]: audit 2024-09-21T04:56:23.954323+0000 mon.a (mon.0) 13842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.179522+0000 mon.a (mon.0) 13831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.189406+0000 mon.a (mon.0) 13832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.199854+0000 mon.a (mon.0) 13833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.322821+0000 mon.a (mon.0) 13834 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: cluster 2024-09-21T04:56:23.543164+0000 mgr.a (mgr.14388) 17397 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.905353+0000 mon.a (mon.0) 13835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.910266+0000 mon.a (mon.0) 13836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.936220+0000 mon.a (mon.0) 13837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.941049+0000 mon.a (mon.0) 13838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.942362+0000 mon.a (mon.0) 13839 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:24.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.943408+0000 mon.a (mon.0) 13840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:24.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.948801+0000 mon.a (mon.0) 13841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:24.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:24 smithi049 bash[23528]: audit 2024-09-21T04:56:23.954323+0000 mon.a (mon.0) 13842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:56:24.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22930]: debug 2024-09-21T04:56:24.676+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:56:24.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:56:24 smithi044 bash[22930]: debug 2024-09-21T04:56:24.676+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:56:25.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:25 smithi044 bash[22676]: audit 2024-09-21T04:56:23.955613+0000 mgr.a (mgr.14388) 17398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:56:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:25 smithi179 bash[23186]: audit 2024-09-21T04:56:23.955613+0000 mgr.a (mgr.14388) 17398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:56:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:25 smithi049 bash[23528]: audit 2024-09-21T04:56:23.955613+0000 mgr.a (mgr.14388) 17398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:56:26.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:26.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:26.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:26 smithi044 bash[22676]: audit 2024-09-21T04:56:24.679329+0000 mgr.a (mgr.14388) 17399 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:56:26.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:26 smithi044 bash[22676]: cephadm 2024-09-21T04:56:24.680539+0000 mgr.a (mgr.14388) 17400 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:56:26.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:26 smithi044 bash[22676]: cluster 2024-09-21T04:56:25.545602+0000 mgr.a (mgr.14388) 17401 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T04:56:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:26 smithi179 bash[23186]: audit 2024-09-21T04:56:24.679329+0000 mgr.a (mgr.14388) 17399 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:56:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:26 smithi179 bash[23186]: cephadm 2024-09-21T04:56:24.680539+0000 mgr.a (mgr.14388) 17400 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:56:26.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:26 smithi179 bash[23186]: cluster 2024-09-21T04:56:25.545602+0000 mgr.a (mgr.14388) 17401 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T04:56:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:26 smithi049 bash[23528]: audit 2024-09-21T04:56:24.679329+0000 mgr.a (mgr.14388) 17399 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:56:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:26 smithi049 bash[23528]: cephadm 2024-09-21T04:56:24.680539+0000 mgr.a (mgr.14388) 17400 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:56:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:26 smithi049 bash[23528]: cluster 2024-09-21T04:56:25.545602+0000 mgr.a (mgr.14388) 17401 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T04:56:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:27.197 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:28 smithi044 bash[22676]: audit 2024-09-21T04:56:26.777342+0000 mgr.a (mgr.14388) 17402 : audit [DBG] from='client.374781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:28 smithi044 bash[22676]: cluster 2024-09-21T04:56:27.546292+0000 mgr.a (mgr.14388) 17403 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 37 op/s 2024-09-21T04:56:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:28 smithi179 bash[23186]: audit 2024-09-21T04:56:26.777342+0000 mgr.a (mgr.14388) 17402 : audit [DBG] from='client.374781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:29.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:28 smithi179 bash[23186]: cluster 2024-09-21T04:56:27.546292+0000 mgr.a (mgr.14388) 17403 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 37 op/s 2024-09-21T04:56:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:28 smithi049 bash[23528]: audit 2024-09-21T04:56:26.777342+0000 mgr.a (mgr.14388) 17402 : audit [DBG] from='client.374781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:28 smithi049 bash[23528]: cluster 2024-09-21T04:56:27.546292+0000 mgr.a (mgr.14388) 17403 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 37 op/s 2024-09-21T04:56:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:30 smithi044 bash[22676]: cluster 2024-09-21T04:56:29.546902+0000 mgr.a (mgr.14388) 17404 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 37 op/s 2024-09-21T04:56:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:30 smithi179 bash[23186]: cluster 2024-09-21T04:56:29.546902+0000 mgr.a (mgr.14388) 17404 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 37 op/s 2024-09-21T04:56:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:30 smithi049 bash[23528]: cluster 2024-09-21T04:56:29.546902+0000 mgr.a (mgr.14388) 17404 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 37 op/s 2024-09-21T04:56:32.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:32.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:32.199 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:31 smithi044 bash[22676]: cluster 2024-09-21T04:56:31.549121+0000 mgr.a (mgr.14388) 17405 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 38 op/s 2024-09-21T04:56:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:31 smithi179 bash[23186]: cluster 2024-09-21T04:56:31.549121+0000 mgr.a (mgr.14388) 17405 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 38 op/s 2024-09-21T04:56:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:31 smithi049 bash[23528]: cluster 2024-09-21T04:56:31.549121+0000 mgr.a (mgr.14388) 17405 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 38 op/s 2024-09-21T04:56:32.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:32.991 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:33.180 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:32 smithi049 bash[23528]: audit 2024-09-21T04:56:32.532888+0000 mgr.a (mgr.14388) 17406 : audit [DBG] from='client.374859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:32 smithi044 bash[22676]: audit 2024-09-21T04:56:32.532888+0000 mgr.a (mgr.14388) 17406 : audit [DBG] from='client.374859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:32 smithi179 bash[23186]: audit 2024-09-21T04:56:32.532888+0000 mgr.a (mgr.14388) 17406 : audit [DBG] from='client.374859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:34 smithi044 bash[22676]: audit 2024-09-21T04:56:33.155478+0000 mon.a (mon.0) 13843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:34 smithi044 bash[22676]: audit 2024-09-21T04:56:33.164345+0000 mon.a (mon.0) 13844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:34 smithi044 bash[22676]: audit 2024-09-21T04:56:33.175123+0000 mon.a (mon.0) 13845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:34 smithi044 bash[22676]: cluster 2024-09-21T04:56:33.550060+0000 mgr.a (mgr.14388) 17407 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:56:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:34 smithi179 bash[23186]: audit 2024-09-21T04:56:33.155478+0000 mon.a (mon.0) 13843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:34 smithi179 bash[23186]: audit 2024-09-21T04:56:33.164345+0000 mon.a (mon.0) 13844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:34 smithi179 bash[23186]: audit 2024-09-21T04:56:33.175123+0000 mon.a (mon.0) 13845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:34 smithi179 bash[23186]: cluster 2024-09-21T04:56:33.550060+0000 mgr.a (mgr.14388) 17407 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:56:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:34 smithi049 bash[23528]: audit 2024-09-21T04:56:33.155478+0000 mon.a (mon.0) 13843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:34 smithi049 bash[23528]: audit 2024-09-21T04:56:33.164345+0000 mon.a (mon.0) 13844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:34 smithi049 bash[23528]: audit 2024-09-21T04:56:33.175123+0000 mon.a (mon.0) 13845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:34 smithi049 bash[23528]: cluster 2024-09-21T04:56:33.550060+0000 mgr.a (mgr.14388) 17407 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:56:36.874 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:36 smithi179 bash[23186]: cluster 2024-09-21T04:56:35.552249+0000 mgr.a (mgr.14388) 17408 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:56:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:36 smithi044 bash[22676]: cluster 2024-09-21T04:56:35.552249+0000 mgr.a (mgr.14388) 17408 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:56:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:36 smithi049 bash[23528]: cluster 2024-09-21T04:56:35.552249+0000 mgr.a (mgr.14388) 17408 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:56:37.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:37.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:37.993 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:38.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:38.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:38.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:38.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:38.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:38.882 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:38 smithi049 bash[23528]: cluster 2024-09-21T04:56:37.552985+0000 mgr.a (mgr.14388) 17409 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:38 smithi044 bash[22676]: cluster 2024-09-21T04:56:37.552985+0000 mgr.a (mgr.14388) 17409 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:38 smithi179 bash[23186]: cluster 2024-09-21T04:56:37.552985+0000 mgr.a (mgr.14388) 17409 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:39 smithi044 bash[22676]: audit 2024-09-21T04:56:38.318626+0000 mgr.a (mgr.14388) 17410 : audit [DBG] from='client.374937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:39 smithi179 bash[23186]: audit 2024-09-21T04:56:38.318626+0000 mgr.a (mgr.14388) 17410 : audit [DBG] from='client.374937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:39 smithi049 bash[23528]: audit 2024-09-21T04:56:38.318626+0000 mgr.a (mgr.14388) 17410 : audit [DBG] from='client.374937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:40.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:40 smithi179 bash[23186]: cluster 2024-09-21T04:56:39.554000+0000 mgr.a (mgr.14388) 17411 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:40 smithi044 bash[22676]: cluster 2024-09-21T04:56:39.554000+0000 mgr.a (mgr.14388) 17411 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:40 smithi049 bash[23528]: cluster 2024-09-21T04:56:39.554000+0000 mgr.a (mgr.14388) 17411 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:41 smithi049 bash[23528]: cluster 2024-09-21T04:56:41.556286+0000 mgr.a (mgr.14388) 17412 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:41 smithi044 bash[22676]: cluster 2024-09-21T04:56:41.556286+0000 mgr.a (mgr.14388) 17412 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:41 smithi179 bash[23186]: cluster 2024-09-21T04:56:41.556286+0000 mgr.a (mgr.14388) 17412 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:43.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:43.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:43.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:43 smithi049 bash[23528]: audit 2024-09-21T04:56:42.754811+0000 mon.a (mon.0) 13846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:43 smithi049 bash[23528]: audit 2024-09-21T04:56:42.760526+0000 mon.a (mon.0) 13847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:43 smithi049 bash[23528]: audit 2024-09-21T04:56:42.768760+0000 mon.a (mon.0) 13848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:43 smithi049 bash[23528]: audit 2024-09-21T04:56:43.395400+0000 mon.a (mon.0) 13849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:43 smithi049 bash[23528]: audit 2024-09-21T04:56:43.404049+0000 mon.a (mon.0) 13850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:43 smithi049 bash[23528]: audit 2024-09-21T04:56:43.414129+0000 mon.a (mon.0) 13851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:43 smithi049 bash[23528]: cluster 2024-09-21T04:56:43.557108+0000 mgr.a (mgr.14388) 17413 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:43 smithi044 bash[22676]: audit 2024-09-21T04:56:42.754811+0000 mon.a (mon.0) 13846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:43 smithi044 bash[22676]: audit 2024-09-21T04:56:42.760526+0000 mon.a (mon.0) 13847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:43 smithi044 bash[22676]: audit 2024-09-21T04:56:42.768760+0000 mon.a (mon.0) 13848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:43 smithi044 bash[22676]: audit 2024-09-21T04:56:43.395400+0000 mon.a (mon.0) 13849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:43 smithi044 bash[22676]: audit 2024-09-21T04:56:43.404049+0000 mon.a (mon.0) 13850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:43 smithi044 bash[22676]: audit 2024-09-21T04:56:43.414129+0000 mon.a (mon.0) 13851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:43 smithi044 bash[22676]: cluster 2024-09-21T04:56:43.557108+0000 mgr.a (mgr.14388) 17413 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:43 smithi179 bash[23186]: audit 2024-09-21T04:56:42.754811+0000 mon.a (mon.0) 13846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:43 smithi179 bash[23186]: audit 2024-09-21T04:56:42.760526+0000 mon.a (mon.0) 13847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:43 smithi179 bash[23186]: audit 2024-09-21T04:56:42.768760+0000 mon.a (mon.0) 13848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:43 smithi179 bash[23186]: audit 2024-09-21T04:56:43.395400+0000 mon.a (mon.0) 13849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:43 smithi179 bash[23186]: audit 2024-09-21T04:56:43.404049+0000 mon.a (mon.0) 13850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:43 smithi179 bash[23186]: audit 2024-09-21T04:56:43.414129+0000 mon.a (mon.0) 13851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:43 smithi179 bash[23186]: cluster 2024-09-21T04:56:43.557108+0000 mgr.a (mgr.14388) 17413 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:44.523 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:45 smithi044 bash[22676]: audit 2024-09-21T04:56:44.083288+0000 mgr.a (mgr.14388) 17414 : audit [DBG] from='client.375012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:45 smithi179 bash[23186]: audit 2024-09-21T04:56:44.083288+0000 mgr.a (mgr.14388) 17414 : audit [DBG] from='client.375012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:45 smithi049 bash[23528]: audit 2024-09-21T04:56:44.083288+0000 mgr.a (mgr.14388) 17414 : audit [DBG] from='client.375012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:46.730 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:46 smithi044 bash[22676]: cluster 2024-09-21T04:56:45.559495+0000 mgr.a (mgr.14388) 17415 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:46 smithi179 bash[23186]: cluster 2024-09-21T04:56:45.559495+0000 mgr.a (mgr.14388) 17415 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:46 smithi049 bash[23528]: cluster 2024-09-21T04:56:45.559495+0000 mgr.a (mgr.14388) 17415 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:56:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:48 smithi044 bash[22676]: cluster 2024-09-21T04:56:47.560365+0000 mgr.a (mgr.14388) 17416 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:48 smithi179 bash[23186]: cluster 2024-09-21T04:56:47.560365+0000 mgr.a (mgr.14388) 17416 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:48 smithi049 bash[23528]: cluster 2024-09-21T04:56:47.560365+0000 mgr.a (mgr.14388) 17416 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:49 smithi044 bash[22676]: cluster 2024-09-21T04:56:49.560890+0000 mgr.a (mgr.14388) 17417 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:49 smithi179 bash[23186]: cluster 2024-09-21T04:56:49.560890+0000 mgr.a (mgr.14388) 17417 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:49 smithi049 bash[23528]: cluster 2024-09-21T04:56:49.560890+0000 mgr.a (mgr.14388) 17417 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:50.298 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:50.301 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:50 smithi044 bash[22676]: audit 2024-09-21T04:56:49.851220+0000 mgr.a (mgr.14388) 17418 : audit [DBG] from='client.375090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:50 smithi179 bash[23186]: audit 2024-09-21T04:56:49.851220+0000 mgr.a (mgr.14388) 17418 : audit [DBG] from='client.375090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:50 smithi049 bash[23528]: audit 2024-09-21T04:56:49.851220+0000 mgr.a (mgr.14388) 17418 : audit [DBG] from='client.375090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:51 smithi044 bash[22676]: cluster 2024-09-21T04:56:51.563850+0000 mgr.a (mgr.14388) 17419 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:56:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:51 smithi179 bash[23186]: cluster 2024-09-21T04:56:51.563850+0000 mgr.a (mgr.14388) 17419 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:56:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:51 smithi049 bash[23528]: cluster 2024-09-21T04:56:51.563850+0000 mgr.a (mgr.14388) 17419 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:56:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:54 smithi044 bash[22676]: audit 2024-09-21T04:56:53.391686+0000 mon.a (mon.0) 13852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:54 smithi044 bash[22676]: audit 2024-09-21T04:56:53.400870+0000 mon.a (mon.0) 13853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:54 smithi044 bash[22676]: audit 2024-09-21T04:56:53.412947+0000 mon.a (mon.0) 13854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:54 smithi044 bash[22676]: cluster 2024-09-21T04:56:53.564634+0000 mgr.a (mgr.14388) 17420 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:56:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:54 smithi179 bash[23186]: audit 2024-09-21T04:56:53.391686+0000 mon.a (mon.0) 13852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:54 smithi179 bash[23186]: audit 2024-09-21T04:56:53.400870+0000 mon.a (mon.0) 13853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:54 smithi179 bash[23186]: audit 2024-09-21T04:56:53.412947+0000 mon.a (mon.0) 13854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:54 smithi179 bash[23186]: cluster 2024-09-21T04:56:53.564634+0000 mgr.a (mgr.14388) 17420 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:56:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:54 smithi049 bash[23528]: audit 2024-09-21T04:56:53.391686+0000 mon.a (mon.0) 13852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:54 smithi049 bash[23528]: audit 2024-09-21T04:56:53.400870+0000 mon.a (mon.0) 13853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:54 smithi049 bash[23528]: audit 2024-09-21T04:56:53.412947+0000 mon.a (mon.0) 13854 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:56:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:54 smithi049 bash[23528]: cluster 2024-09-21T04:56:53.564634+0000 mgr.a (mgr.14388) 17420 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:56:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:56:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:56:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:56:56.062 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:56:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:56:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:56:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:56:56.063 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:56:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:56 smithi044 bash[22676]: cluster 2024-09-21T04:56:55.566635+0000 mgr.a (mgr.14388) 17421 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:56 smithi179 bash[23186]: cluster 2024-09-21T04:56:55.566635+0000 mgr.a (mgr.14388) 17421 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:56 smithi049 bash[23528]: cluster 2024-09-21T04:56:55.566635+0000 mgr.a (mgr.14388) 17421 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:56:57.958 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:57 smithi049 bash[23528]: audit 2024-09-21T04:56:55.633690+0000 mgr.a (mgr.14388) 17422 : audit [DBG] from='client.375168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:57.958 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:57 smithi049 bash[23528]: cluster 2024-09-21T04:56:57.567581+0000 mgr.a (mgr.14388) 17423 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:56:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:57 smithi044 bash[22676]: audit 2024-09-21T04:56:55.633690+0000 mgr.a (mgr.14388) 17422 : audit [DBG] from='client.375168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:57 smithi044 bash[22676]: cluster 2024-09-21T04:56:57.567581+0000 mgr.a (mgr.14388) 17423 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:56:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:57 smithi179 bash[23186]: audit 2024-09-21T04:56:55.633690+0000 mgr.a (mgr.14388) 17422 : audit [DBG] from='client.375168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:57 smithi179 bash[23186]: cluster 2024-09-21T04:56:57.567581+0000 mgr.a (mgr.14388) 17423 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:56:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:56:59 smithi044 bash[22676]: cluster 2024-09-21T04:56:59.568430+0000 mgr.a (mgr.14388) 17424 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:57:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:56:59 smithi179 bash[23186]: cluster 2024-09-21T04:56:59.568430+0000 mgr.a (mgr.14388) 17424 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:57:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:56:59 smithi049 bash[23528]: cluster 2024-09-21T04:56:59.568430+0000 mgr.a (mgr.14388) 17424 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:57:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:01.857 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:01 smithi044 bash[22676]: audit 2024-09-21T04:57:01.402660+0000 mgr.a (mgr.14388) 17425 : audit [DBG] from='client.375246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:01 smithi044 bash[22676]: cluster 2024-09-21T04:57:01.569930+0000 mgr.a (mgr.14388) 17426 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:01 smithi179 bash[23186]: audit 2024-09-21T04:57:01.402660+0000 mgr.a (mgr.14388) 17425 : audit [DBG] from='client.375246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:01 smithi179 bash[23186]: cluster 2024-09-21T04:57:01.569930+0000 mgr.a (mgr.14388) 17426 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:01 smithi049 bash[23528]: audit 2024-09-21T04:57:01.402660+0000 mgr.a (mgr.14388) 17425 : audit [DBG] from='client.375246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:01 smithi049 bash[23528]: cluster 2024-09-21T04:57:01.569930+0000 mgr.a (mgr.14388) 17426 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:03 smithi044 bash[22676]: audit 2024-09-21T04:57:02.983259+0000 mon.a (mon.0) 13855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:03 smithi044 bash[22676]: audit 2024-09-21T04:57:02.990558+0000 mon.a (mon.0) 13856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:03 smithi044 bash[22676]: audit 2024-09-21T04:57:03.002366+0000 mon.a (mon.0) 13857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:03 smithi044 bash[22676]: cluster 2024-09-21T04:57:03.570789+0000 mgr.a (mgr.14388) 17427 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:57:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:03 smithi044 bash[22676]: audit 2024-09-21T04:57:03.623779+0000 mon.a (mon.0) 13858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:03 smithi044 bash[22676]: audit 2024-09-21T04:57:03.633244+0000 mon.a (mon.0) 13859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:03 smithi044 bash[22676]: audit 2024-09-21T04:57:03.643339+0000 mon.a (mon.0) 13860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:03 smithi179 bash[23186]: audit 2024-09-21T04:57:02.983259+0000 mon.a (mon.0) 13855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:03 smithi179 bash[23186]: audit 2024-09-21T04:57:02.990558+0000 mon.a (mon.0) 13856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:03 smithi179 bash[23186]: audit 2024-09-21T04:57:03.002366+0000 mon.a (mon.0) 13857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:03 smithi179 bash[23186]: cluster 2024-09-21T04:57:03.570789+0000 mgr.a (mgr.14388) 17427 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:57:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:03 smithi179 bash[23186]: audit 2024-09-21T04:57:03.623779+0000 mon.a (mon.0) 13858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:03 smithi179 bash[23186]: audit 2024-09-21T04:57:03.633244+0000 mon.a (mon.0) 13859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:03 smithi179 bash[23186]: audit 2024-09-21T04:57:03.643339+0000 mon.a (mon.0) 13860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:03 smithi049 bash[23528]: audit 2024-09-21T04:57:02.983259+0000 mon.a (mon.0) 13855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:03 smithi049 bash[23528]: audit 2024-09-21T04:57:02.990558+0000 mon.a (mon.0) 13856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:03 smithi049 bash[23528]: audit 2024-09-21T04:57:03.002366+0000 mon.a (mon.0) 13857 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:03 smithi049 bash[23528]: cluster 2024-09-21T04:57:03.570789+0000 mgr.a (mgr.14388) 17427 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:57:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:03 smithi049 bash[23528]: audit 2024-09-21T04:57:03.623779+0000 mon.a (mon.0) 13858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:03 smithi049 bash[23528]: audit 2024-09-21T04:57:03.633244+0000 mon.a (mon.0) 13859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:03 smithi049 bash[23528]: audit 2024-09-21T04:57:03.643339+0000 mon.a (mon.0) 13860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:05 smithi044 bash[22676]: cluster 2024-09-21T04:57:05.572986+0000 mgr.a (mgr.14388) 17428 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:57:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:05 smithi179 bash[23186]: cluster 2024-09-21T04:57:05.572986+0000 mgr.a (mgr.14388) 17428 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:57:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:05 smithi049 bash[23528]: cluster 2024-09-21T04:57:05.572986+0000 mgr.a (mgr.14388) 17428 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:57:06.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:06.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:06.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:07.608 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:07 smithi044 bash[22676]: audit 2024-09-21T04:57:07.186148+0000 mgr.a (mgr.14388) 17429 : audit [DBG] from='client.375321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:07 smithi044 bash[22676]: cluster 2024-09-21T04:57:07.573590+0000 mgr.a (mgr.14388) 17430 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:07 smithi179 bash[23186]: audit 2024-09-21T04:57:07.186148+0000 mgr.a (mgr.14388) 17429 : audit [DBG] from='client.375321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:07 smithi179 bash[23186]: cluster 2024-09-21T04:57:07.573590+0000 mgr.a (mgr.14388) 17430 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:07 smithi049 bash[23528]: audit 2024-09-21T04:57:07.186148+0000 mgr.a (mgr.14388) 17429 : audit [DBG] from='client.375321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:07 smithi049 bash[23528]: cluster 2024-09-21T04:57:07.573590+0000 mgr.a (mgr.14388) 17430 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:09 smithi044 bash[22676]: cluster 2024-09-21T04:57:09.574345+0000 mgr.a (mgr.14388) 17431 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:09 smithi179 bash[23186]: cluster 2024-09-21T04:57:09.574345+0000 mgr.a (mgr.14388) 17431 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:09 smithi049 bash[23528]: cluster 2024-09-21T04:57:09.574345+0000 mgr.a (mgr.14388) 17431 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:11 smithi044 bash[22676]: cluster 2024-09-21T04:57:11.576656+0000 mgr.a (mgr.14388) 17432 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:11 smithi179 bash[23186]: cluster 2024-09-21T04:57:11.576656+0000 mgr.a (mgr.14388) 17432 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:11 smithi049 bash[23528]: cluster 2024-09-21T04:57:11.576656+0000 mgr.a (mgr.14388) 17432 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:12.609 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:12.610 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:13.358 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:13.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:13.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:13.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:13.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:13 smithi044 bash[22676]: audit 2024-09-21T04:57:12.933708+0000 mgr.a (mgr.14388) 17433 : audit [DBG] from='client.375399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:13 smithi044 bash[22676]: cluster 2024-09-21T04:57:13.577635+0000 mgr.a (mgr.14388) 17434 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:13 smithi044 bash[22676]: audit 2024-09-21T04:57:13.634318+0000 mon.a (mon.0) 13861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:13 smithi044 bash[22676]: audit 2024-09-21T04:57:13.646386+0000 mon.a (mon.0) 13862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:13 smithi044 bash[22676]: audit 2024-09-21T04:57:13.656433+0000 mon.a (mon.0) 13863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:13 smithi179 bash[23186]: audit 2024-09-21T04:57:12.933708+0000 mgr.a (mgr.14388) 17433 : audit [DBG] from='client.375399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:13 smithi179 bash[23186]: cluster 2024-09-21T04:57:13.577635+0000 mgr.a (mgr.14388) 17434 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:13 smithi179 bash[23186]: audit 2024-09-21T04:57:13.634318+0000 mon.a (mon.0) 13861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:13 smithi179 bash[23186]: audit 2024-09-21T04:57:13.646386+0000 mon.a (mon.0) 13862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:13 smithi179 bash[23186]: audit 2024-09-21T04:57:13.656433+0000 mon.a (mon.0) 13863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:13 smithi049 bash[23528]: audit 2024-09-21T04:57:12.933708+0000 mgr.a (mgr.14388) 17433 : audit [DBG] from='client.375399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:13 smithi049 bash[23528]: cluster 2024-09-21T04:57:13.577635+0000 mgr.a (mgr.14388) 17434 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:13 smithi049 bash[23528]: audit 2024-09-21T04:57:13.634318+0000 mon.a (mon.0) 13861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:13 smithi049 bash[23528]: audit 2024-09-21T04:57:13.646386+0000 mon.a (mon.0) 13862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:13 smithi049 bash[23528]: audit 2024-09-21T04:57:13.656433+0000 mon.a (mon.0) 13863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:15 smithi044 bash[22676]: cluster 2024-09-21T04:57:15.579858+0000 mgr.a (mgr.14388) 17435 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:15 smithi179 bash[23186]: cluster 2024-09-21T04:57:15.579858+0000 mgr.a (mgr.14388) 17435 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:15 smithi049 bash[23528]: cluster 2024-09-21T04:57:15.579858+0000 mgr.a (mgr.14388) 17435 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:17.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:17 smithi044 bash[22676]: cluster 2024-09-21T04:57:17.580620+0000 mgr.a (mgr.14388) 17436 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:17 smithi179 bash[23186]: cluster 2024-09-21T04:57:17.580620+0000 mgr.a (mgr.14388) 17436 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:17 smithi049 bash[23528]: cluster 2024-09-21T04:57:17.580620+0000 mgr.a (mgr.14388) 17436 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:18.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:19.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:19.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:19.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:19.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:19.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:19 smithi044 bash[22676]: audit 2024-09-21T04:57:18.691834+0000 mgr.a (mgr.14388) 17437 : audit [DBG] from='client.375477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:19 smithi044 bash[22676]: cluster 2024-09-21T04:57:19.581631+0000 mgr.a (mgr.14388) 17438 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:20.005 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:19 smithi049 bash[23528]: audit 2024-09-21T04:57:18.691834+0000 mgr.a (mgr.14388) 17437 : audit [DBG] from='client.375477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:20.006 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:19 smithi049 bash[23528]: cluster 2024-09-21T04:57:19.581631+0000 mgr.a (mgr.14388) 17438 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:20.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:19 smithi179 bash[23186]: audit 2024-09-21T04:57:18.691834+0000 mgr.a (mgr.14388) 17437 : audit [DBG] from='client.375477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:20.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:19 smithi179 bash[23186]: cluster 2024-09-21T04:57:19.581631+0000 mgr.a (mgr.14388) 17438 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:21 smithi044 bash[22676]: cluster 2024-09-21T04:57:21.583900+0000 mgr.a (mgr.14388) 17439 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:21 smithi179 bash[23186]: cluster 2024-09-21T04:57:21.583900+0000 mgr.a (mgr.14388) 17439 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:21 smithi049 bash[23528]: cluster 2024-09-21T04:57:21.583900+0000 mgr.a (mgr.14388) 17439 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:24.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:24.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:24 smithi044 bash[22676]: audit 2024-09-21T04:57:23.213827+0000 mon.a (mon.0) 13864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:24 smithi044 bash[22676]: audit 2024-09-21T04:57:23.221793+0000 mon.a (mon.0) 13865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:24 smithi044 bash[22676]: audit 2024-09-21T04:57:23.232380+0000 mon.a (mon.0) 13866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:24 smithi044 bash[22676]: cluster 2024-09-21T04:57:23.584655+0000 mgr.a (mgr.14388) 17440 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:24 smithi044 bash[22676]: audit 2024-09-21T04:57:23.843695+0000 mon.a (mon.0) 13867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:24 smithi044 bash[22676]: audit 2024-09-21T04:57:23.852553+0000 mon.a (mon.0) 13868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:24 smithi044 bash[22676]: audit 2024-09-21T04:57:23.862925+0000 mon.a (mon.0) 13869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:24 smithi179 bash[23186]: audit 2024-09-21T04:57:23.213827+0000 mon.a (mon.0) 13864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:24 smithi179 bash[23186]: audit 2024-09-21T04:57:23.221793+0000 mon.a (mon.0) 13865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:24 smithi179 bash[23186]: audit 2024-09-21T04:57:23.232380+0000 mon.a (mon.0) 13866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:24 smithi179 bash[23186]: cluster 2024-09-21T04:57:23.584655+0000 mgr.a (mgr.14388) 17440 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:24 smithi179 bash[23186]: audit 2024-09-21T04:57:23.843695+0000 mon.a (mon.0) 13867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:24 smithi179 bash[23186]: audit 2024-09-21T04:57:23.852553+0000 mon.a (mon.0) 13868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:24 smithi179 bash[23186]: audit 2024-09-21T04:57:23.862925+0000 mon.a (mon.0) 13869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:24 smithi049 bash[23528]: audit 2024-09-21T04:57:23.213827+0000 mon.a (mon.0) 13864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:24 smithi049 bash[23528]: audit 2024-09-21T04:57:23.221793+0000 mon.a (mon.0) 13865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:24 smithi049 bash[23528]: audit 2024-09-21T04:57:23.232380+0000 mon.a (mon.0) 13866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:24 smithi049 bash[23528]: cluster 2024-09-21T04:57:23.584655+0000 mgr.a (mgr.14388) 17440 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:24 smithi049 bash[23528]: audit 2024-09-21T04:57:23.843695+0000 mon.a (mon.0) 13867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:24 smithi049 bash[23528]: audit 2024-09-21T04:57:23.852553+0000 mon.a (mon.0) 13868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:24 smithi049 bash[23528]: audit 2024-09-21T04:57:23.862925+0000 mon.a (mon.0) 13869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:24.922 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:25 smithi044 bash[22676]: audit 2024-09-21T04:57:24.478419+0000 mgr.a (mgr.14388) 17441 : audit [DBG] from='client.375555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:25 smithi044 bash[22676]: audit 2024-09-21T04:57:24.736367+0000 mon.a (mon.0) 13870 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:25 smithi179 bash[23186]: audit 2024-09-21T04:57:24.478419+0000 mgr.a (mgr.14388) 17441 : audit [DBG] from='client.375555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:25 smithi179 bash[23186]: audit 2024-09-21T04:57:24.736367+0000 mon.a (mon.0) 13870 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:25 smithi049 bash[23528]: audit 2024-09-21T04:57:24.478419+0000 mgr.a (mgr.14388) 17441 : audit [DBG] from='client.375555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:25 smithi049 bash[23528]: audit 2024-09-21T04:57:24.736367+0000 mon.a (mon.0) 13870 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:26.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22930]: debug 2024-09-21T04:57:26.135+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:57:26.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22930]: debug 2024-09-21T04:57:26.139+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:57:26.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: audit 2024-09-21T04:57:25.289723+0000 mon.a (mon.0) 13871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: audit 2024-09-21T04:57:25.298284+0000 mon.a (mon.0) 13872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: audit 2024-09-21T04:57:25.301269+0000 mon.a (mon.0) 13873 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:26.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: audit 2024-09-21T04:57:25.303449+0000 mon.a (mon.0) 13874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:26.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: audit 2024-09-21T04:57:25.314090+0000 mon.a (mon.0) 13875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: audit 2024-09-21T04:57:25.320601+0000 mon.a (mon.0) 13876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:57:26.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: audit 2024-09-21T04:57:25.323408+0000 mgr.a (mgr.14388) 17442 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:57:26.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:26 smithi044 bash[22676]: cluster 2024-09-21T04:57:25.586560+0000 mgr.a (mgr.14388) 17443 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: audit 2024-09-21T04:57:25.289723+0000 mon.a (mon.0) 13871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: audit 2024-09-21T04:57:25.298284+0000 mon.a (mon.0) 13872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: audit 2024-09-21T04:57:25.301269+0000 mon.a (mon.0) 13873 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: audit 2024-09-21T04:57:25.303449+0000 mon.a (mon.0) 13874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: audit 2024-09-21T04:57:25.314090+0000 mon.a (mon.0) 13875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: audit 2024-09-21T04:57:25.320601+0000 mon.a (mon.0) 13876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: audit 2024-09-21T04:57:25.323408+0000 mgr.a (mgr.14388) 17442 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:57:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:26 smithi049 bash[23528]: cluster 2024-09-21T04:57:25.586560+0000 mgr.a (mgr.14388) 17443 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: audit 2024-09-21T04:57:25.289723+0000 mon.a (mon.0) 13871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: audit 2024-09-21T04:57:25.298284+0000 mon.a (mon.0) 13872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: audit 2024-09-21T04:57:25.301269+0000 mon.a (mon.0) 13873 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: audit 2024-09-21T04:57:25.303449+0000 mon.a (mon.0) 13874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: audit 2024-09-21T04:57:25.314090+0000 mon.a (mon.0) 13875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: audit 2024-09-21T04:57:25.320601+0000 mon.a (mon.0) 13876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:57:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: audit 2024-09-21T04:57:25.323408+0000 mgr.a (mgr.14388) 17442 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:57:26.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:26 smithi179 bash[23186]: cluster 2024-09-21T04:57:25.586560+0000 mgr.a (mgr.14388) 17443 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:27.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:27 smithi044 bash[22676]: audit 2024-09-21T04:57:26.140278+0000 mgr.a (mgr.14388) 17444 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:57:27.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:27 smithi044 bash[22676]: cephadm 2024-09-21T04:57:26.141809+0000 mgr.a (mgr.14388) 17445 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:57:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:27 smithi179 bash[23186]: audit 2024-09-21T04:57:26.140278+0000 mgr.a (mgr.14388) 17444 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:57:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:27 smithi179 bash[23186]: cephadm 2024-09-21T04:57:26.141809+0000 mgr.a (mgr.14388) 17445 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:57:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:27 smithi049 bash[23528]: audit 2024-09-21T04:57:26.140278+0000 mgr.a (mgr.14388) 17444 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:57:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:27 smithi049 bash[23528]: cephadm 2024-09-21T04:57:26.141809+0000 mgr.a (mgr.14388) 17445 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:57:28.614 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:28 smithi044 bash[22676]: cluster 2024-09-21T04:57:27.587454+0000 mgr.a (mgr.14388) 17446 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:28 smithi179 bash[23186]: cluster 2024-09-21T04:57:27.587454+0000 mgr.a (mgr.14388) 17446 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:28 smithi049 bash[23528]: cluster 2024-09-21T04:57:27.587454+0000 mgr.a (mgr.14388) 17446 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:29.925 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:29 smithi044 bash[22676]: cluster 2024-09-21T04:57:29.588276+0000 mgr.a (mgr.14388) 17447 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:29 smithi179 bash[23186]: cluster 2024-09-21T04:57:29.588276+0000 mgr.a (mgr.14388) 17447 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:29 smithi049 bash[23528]: cluster 2024-09-21T04:57:29.588276+0000 mgr.a (mgr.14388) 17447 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:30.697 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:30 smithi044 bash[22676]: audit 2024-09-21T04:57:30.256944+0000 mgr.a (mgr.14388) 17448 : audit [DBG] from='client.375738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:31.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:30 smithi179 bash[23186]: audit 2024-09-21T04:57:30.256944+0000 mgr.a (mgr.14388) 17448 : audit [DBG] from='client.375738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:30 smithi049 bash[23528]: audit 2024-09-21T04:57:30.256944+0000 mgr.a (mgr.14388) 17448 : audit [DBG] from='client.375738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:31 smithi044 bash[22676]: cluster 2024-09-21T04:57:31.591310+0000 mgr.a (mgr.14388) 17449 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:31 smithi179 bash[23186]: cluster 2024-09-21T04:57:31.591310+0000 mgr.a (mgr.14388) 17449 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:31 smithi049 bash[23528]: cluster 2024-09-21T04:57:31.591310+0000 mgr.a (mgr.14388) 17449 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:33 smithi044 bash[22676]: cluster 2024-09-21T04:57:33.592292+0000 mgr.a (mgr.14388) 17450 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:33 smithi179 bash[23186]: cluster 2024-09-21T04:57:33.592292+0000 mgr.a (mgr.14388) 17450 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:33 smithi049 bash[23528]: cluster 2024-09-21T04:57:33.592292+0000 mgr.a (mgr.14388) 17450 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:34 smithi044 bash[22676]: audit 2024-09-21T04:57:33.863788+0000 mon.a (mon.0) 13877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:34 smithi044 bash[22676]: audit 2024-09-21T04:57:33.872809+0000 mon.a (mon.0) 13878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:34 smithi044 bash[22676]: audit 2024-09-21T04:57:33.883644+0000 mon.a (mon.0) 13879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:34 smithi179 bash[23186]: audit 2024-09-21T04:57:33.863788+0000 mon.a (mon.0) 13877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:34 smithi179 bash[23186]: audit 2024-09-21T04:57:33.872809+0000 mon.a (mon.0) 13878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:34 smithi179 bash[23186]: audit 2024-09-21T04:57:33.883644+0000 mon.a (mon.0) 13879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:34 smithi049 bash[23528]: audit 2024-09-21T04:57:33.863788+0000 mon.a (mon.0) 13877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:34 smithi049 bash[23528]: audit 2024-09-21T04:57:33.872809+0000 mon.a (mon.0) 13878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:34 smithi049 bash[23528]: audit 2024-09-21T04:57:33.883644+0000 mon.a (mon.0) 13879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:35.699 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:35.700 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:35.700 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:35 smithi044 bash[22676]: cluster 2024-09-21T04:57:35.594453+0000 mgr.a (mgr.14388) 17451 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:35 smithi179 bash[23186]: cluster 2024-09-21T04:57:35.594453+0000 mgr.a (mgr.14388) 17451 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:35 smithi049 bash[23528]: cluster 2024-09-21T04:57:35.594453+0000 mgr.a (mgr.14388) 17451 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:36.463 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:36.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:36.463 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:36.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:36.464 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:37.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:36 smithi044 bash[22676]: audit 2024-09-21T04:57:36.033325+0000 mgr.a (mgr.14388) 17452 : audit [DBG] from='client.375813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:36 smithi179 bash[23186]: audit 2024-09-21T04:57:36.033325+0000 mgr.a (mgr.14388) 17452 : audit [DBG] from='client.375813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:36 smithi049 bash[23528]: audit 2024-09-21T04:57:36.033325+0000 mgr.a (mgr.14388) 17452 : audit [DBG] from='client.375813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:37 smithi044 bash[22676]: cluster 2024-09-21T04:57:37.595341+0000 mgr.a (mgr.14388) 17453 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:37 smithi179 bash[23186]: cluster 2024-09-21T04:57:37.595341+0000 mgr.a (mgr.14388) 17453 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:37 smithi049 bash[23528]: cluster 2024-09-21T04:57:37.595341+0000 mgr.a (mgr.14388) 17453 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:39 smithi044 bash[22676]: cluster 2024-09-21T04:57:39.596206+0000 mgr.a (mgr.14388) 17454 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:39 smithi179 bash[23186]: cluster 2024-09-21T04:57:39.596206+0000 mgr.a (mgr.14388) 17454 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:39 smithi049 bash[23528]: cluster 2024-09-21T04:57:39.596206+0000 mgr.a (mgr.14388) 17454 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T04:57:41.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:41.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:41.466 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:41 smithi044 bash[22676]: cluster 2024-09-21T04:57:41.597421+0000 mgr.a (mgr.14388) 17455 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:41 smithi179 bash[23186]: cluster 2024-09-21T04:57:41.597421+0000 mgr.a (mgr.14388) 17455 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:41 smithi049 bash[23528]: cluster 2024-09-21T04:57:41.597421+0000 mgr.a (mgr.14388) 17455 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:57:42.219 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:42 smithi049 bash[23528]: audit 2024-09-21T04:57:41.799050+0000 mgr.a (mgr.14388) 17456 : audit [DBG] from='client.375891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:42 smithi044 bash[22676]: audit 2024-09-21T04:57:41.799050+0000 mgr.a (mgr.14388) 17456 : audit [DBG] from='client.375891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:42 smithi179 bash[23186]: audit 2024-09-21T04:57:41.799050+0000 mgr.a (mgr.14388) 17456 : audit [DBG] from='client.375891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:44 smithi044 bash[22676]: audit 2024-09-21T04:57:43.444486+0000 mon.a (mon.0) 13880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:44 smithi044 bash[22676]: audit 2024-09-21T04:57:43.453002+0000 mon.a (mon.0) 13881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:44 smithi044 bash[22676]: audit 2024-09-21T04:57:43.463413+0000 mon.a (mon.0) 13882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:44 smithi044 bash[22676]: cluster 2024-09-21T04:57:43.598214+0000 mgr.a (mgr.14388) 17457 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:44 smithi044 bash[22676]: audit 2024-09-21T04:57:44.076296+0000 mon.a (mon.0) 13883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:44 smithi044 bash[22676]: audit 2024-09-21T04:57:44.084753+0000 mon.a (mon.0) 13884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:44 smithi044 bash[22676]: audit 2024-09-21T04:57:44.094982+0000 mon.a (mon.0) 13885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:44 smithi179 bash[23186]: audit 2024-09-21T04:57:43.444486+0000 mon.a (mon.0) 13880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:44 smithi179 bash[23186]: audit 2024-09-21T04:57:43.453002+0000 mon.a (mon.0) 13881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:44 smithi179 bash[23186]: audit 2024-09-21T04:57:43.463413+0000 mon.a (mon.0) 13882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:44 smithi179 bash[23186]: cluster 2024-09-21T04:57:43.598214+0000 mgr.a (mgr.14388) 17457 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:44.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:44 smithi179 bash[23186]: audit 2024-09-21T04:57:44.076296+0000 mon.a (mon.0) 13883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:44 smithi179 bash[23186]: audit 2024-09-21T04:57:44.084753+0000 mon.a (mon.0) 13884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:44 smithi179 bash[23186]: audit 2024-09-21T04:57:44.094982+0000 mon.a (mon.0) 13885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:44 smithi049 bash[23528]: audit 2024-09-21T04:57:43.444486+0000 mon.a (mon.0) 13880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:44 smithi049 bash[23528]: audit 2024-09-21T04:57:43.453002+0000 mon.a (mon.0) 13881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:44 smithi049 bash[23528]: audit 2024-09-21T04:57:43.463413+0000 mon.a (mon.0) 13882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:44 smithi049 bash[23528]: cluster 2024-09-21T04:57:43.598214+0000 mgr.a (mgr.14388) 17457 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:44 smithi049 bash[23528]: audit 2024-09-21T04:57:44.076296+0000 mon.a (mon.0) 13883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:44 smithi049 bash[23528]: audit 2024-09-21T04:57:44.084753+0000 mon.a (mon.0) 13884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:44 smithi049 bash[23528]: audit 2024-09-21T04:57:44.094982+0000 mon.a (mon.0) 13885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:45 smithi044 bash[22676]: cluster 2024-09-21T04:57:45.600480+0000 mgr.a (mgr.14388) 17458 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:45 smithi179 bash[23186]: cluster 2024-09-21T04:57:45.600480+0000 mgr.a (mgr.14388) 17458 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:45 smithi049 bash[23528]: cluster 2024-09-21T04:57:45.600480+0000 mgr.a (mgr.14388) 17458 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:47.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:47.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:47.221 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:47.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:47 smithi044 bash[22676]: audit 2024-09-21T04:57:47.554218+0000 mgr.a (mgr.14388) 17459 : audit [DBG] from='client.375966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:47.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:47 smithi044 bash[22676]: cluster 2024-09-21T04:57:47.601384+0000 mgr.a (mgr.14388) 17460 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:47.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:47.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:47.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:47.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:47.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:47 smithi179 bash[23186]: audit 2024-09-21T04:57:47.554218+0000 mgr.a (mgr.14388) 17459 : audit [DBG] from='client.375966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:48.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:47 smithi179 bash[23186]: cluster 2024-09-21T04:57:47.601384+0000 mgr.a (mgr.14388) 17460 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:47 smithi049 bash[23528]: audit 2024-09-21T04:57:47.554218+0000 mgr.a (mgr.14388) 17459 : audit [DBG] from='client.375966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:47 smithi049 bash[23528]: cluster 2024-09-21T04:57:47.601384+0000 mgr.a (mgr.14388) 17460 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:49 smithi044 bash[22676]: cluster 2024-09-21T04:57:49.602367+0000 mgr.a (mgr.14388) 17461 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:49 smithi179 bash[23186]: cluster 2024-09-21T04:57:49.602367+0000 mgr.a (mgr.14388) 17461 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:49 smithi049 bash[23528]: cluster 2024-09-21T04:57:49.602367+0000 mgr.a (mgr.14388) 17461 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:51 smithi044 bash[22676]: cluster 2024-09-21T04:57:51.604460+0000 mgr.a (mgr.14388) 17462 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:52.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:51 smithi179 bash[23186]: cluster 2024-09-21T04:57:51.604460+0000 mgr.a (mgr.14388) 17462 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:51 smithi049 bash[23528]: cluster 2024-09-21T04:57:51.604460+0000 mgr.a (mgr.14388) 17462 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:52.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:52.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:52.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:53.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:53.756 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:53.756 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:53 smithi044 bash[22676]: audit 2024-09-21T04:57:53.310003+0000 mgr.a (mgr.14388) 17463 : audit [DBG] from='client.376044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:53 smithi044 bash[22676]: cluster 2024-09-21T04:57:53.605032+0000 mgr.a (mgr.14388) 17464 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:53 smithi179 bash[23186]: audit 2024-09-21T04:57:53.310003+0000 mgr.a (mgr.14388) 17463 : audit [DBG] from='client.376044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:53 smithi179 bash[23186]: cluster 2024-09-21T04:57:53.605032+0000 mgr.a (mgr.14388) 17464 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:53 smithi049 bash[23528]: audit 2024-09-21T04:57:53.310003+0000 mgr.a (mgr.14388) 17463 : audit [DBG] from='client.376044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:53 smithi049 bash[23528]: cluster 2024-09-21T04:57:53.605032+0000 mgr.a (mgr.14388) 17464 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:55 smithi044 bash[22676]: audit 2024-09-21T04:57:54.100436+0000 mon.a (mon.0) 13886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:55 smithi044 bash[22676]: audit 2024-09-21T04:57:54.109456+0000 mon.a (mon.0) 13887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:55 smithi044 bash[22676]: audit 2024-09-21T04:57:54.120212+0000 mon.a (mon.0) 13888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:55 smithi179 bash[23186]: audit 2024-09-21T04:57:54.100436+0000 mon.a (mon.0) 13886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:55 smithi179 bash[23186]: audit 2024-09-21T04:57:54.109456+0000 mon.a (mon.0) 13887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:55 smithi179 bash[23186]: audit 2024-09-21T04:57:54.120212+0000 mon.a (mon.0) 13888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:55 smithi049 bash[23528]: audit 2024-09-21T04:57:54.100436+0000 mon.a (mon.0) 13886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:55 smithi049 bash[23528]: audit 2024-09-21T04:57:54.109456+0000 mon.a (mon.0) 13887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:55 smithi049 bash[23528]: audit 2024-09-21T04:57:54.120212+0000 mon.a (mon.0) 13888 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:57:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:56 smithi044 bash[22676]: cluster 2024-09-21T04:57:55.607331+0000 mgr.a (mgr.14388) 17465 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:56 smithi179 bash[23186]: cluster 2024-09-21T04:57:55.607331+0000 mgr.a (mgr.14388) 17465 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:56 smithi049 bash[23528]: cluster 2024-09-21T04:57:55.607331+0000 mgr.a (mgr.14388) 17465 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:57:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:57 smithi044 bash[22676]: cluster 2024-09-21T04:57:57.608108+0000 mgr.a (mgr.14388) 17466 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:57 smithi179 bash[23186]: cluster 2024-09-21T04:57:57.608108+0000 mgr.a (mgr.14388) 17466 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:57 smithi049 bash[23528]: cluster 2024-09-21T04:57:57.608108+0000 mgr.a (mgr.14388) 17466 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:57:58.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:57:58.758 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:57:59.517 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:57:59.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:57:59.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:57:59.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:57:59.518 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:57:59.736 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:59 smithi179 bash[23186]: audit 2024-09-21T04:57:59.088898+0000 mgr.a (mgr.14388) 17467 : audit [DBG] from='client.376122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:59.736 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:57:59 smithi179 bash[23186]: cluster 2024-09-21T04:57:59.609093+0000 mgr.a (mgr.14388) 17468 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:57:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:59 smithi044 bash[22676]: audit 2024-09-21T04:57:59.088898+0000 mgr.a (mgr.14388) 17467 : audit [DBG] from='client.376122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:57:59 smithi044 bash[22676]: cluster 2024-09-21T04:57:59.609093+0000 mgr.a (mgr.14388) 17468 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:59 smithi049 bash[23528]: audit 2024-09-21T04:57:59.088898+0000 mgr.a (mgr.14388) 17467 : audit [DBG] from='client.376122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:57:59 smithi049 bash[23528]: cluster 2024-09-21T04:57:59.609093+0000 mgr.a (mgr.14388) 17468 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:01.947 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:01 smithi179 bash[23186]: cluster 2024-09-21T04:58:01.611349+0000 mgr.a (mgr.14388) 17469 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:58:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:01 smithi044 bash[22676]: cluster 2024-09-21T04:58:01.611349+0000 mgr.a (mgr.14388) 17469 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:58:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:01 smithi049 bash[23528]: cluster 2024-09-21T04:58:01.611349+0000 mgr.a (mgr.14388) 17469 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:58:03.987 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:03 smithi049 bash[23528]: cluster 2024-09-21T04:58:03.612004+0000 mgr.a (mgr.14388) 17470 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:03.987 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:03 smithi049 bash[23528]: audit 2024-09-21T04:58:03.667194+0000 mon.a (mon.0) 13889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:03.988 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:03 smithi049 bash[23528]: audit 2024-09-21T04:58:03.681466+0000 mon.a (mon.0) 13890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:03 smithi044 bash[22676]: cluster 2024-09-21T04:58:03.612004+0000 mgr.a (mgr.14388) 17470 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:03 smithi044 bash[22676]: audit 2024-09-21T04:58:03.667194+0000 mon.a (mon.0) 13889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:03 smithi044 bash[22676]: audit 2024-09-21T04:58:03.681466+0000 mon.a (mon.0) 13890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:03 smithi179 bash[23186]: cluster 2024-09-21T04:58:03.612004+0000 mgr.a (mgr.14388) 17470 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:03 smithi179 bash[23186]: audit 2024-09-21T04:58:03.667194+0000 mon.a (mon.0) 13889 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:03 smithi179 bash[23186]: audit 2024-09-21T04:58:03.681466+0000 mon.a (mon.0) 13890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:04.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:04.519 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:04 smithi044 bash[22676]: audit 2024-09-21T04:58:03.699737+0000 mon.a (mon.0) 13891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:04.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:04 smithi044 bash[22676]: audit 2024-09-21T04:58:04.303012+0000 mon.a (mon.0) 13892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:04.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:04 smithi044 bash[22676]: audit 2024-09-21T04:58:04.311490+0000 mon.a (mon.0) 13893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:04.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:04 smithi044 bash[22676]: audit 2024-09-21T04:58:04.322084+0000 mon.a (mon.0) 13894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:04 smithi179 bash[23186]: audit 2024-09-21T04:58:03.699737+0000 mon.a (mon.0) 13891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:04 smithi179 bash[23186]: audit 2024-09-21T04:58:04.303012+0000 mon.a (mon.0) 13892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:04 smithi179 bash[23186]: audit 2024-09-21T04:58:04.311490+0000 mon.a (mon.0) 13893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:04 smithi179 bash[23186]: audit 2024-09-21T04:58:04.322084+0000 mon.a (mon.0) 13894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:04 smithi049 bash[23528]: audit 2024-09-21T04:58:03.699737+0000 mon.a (mon.0) 13891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:04 smithi049 bash[23528]: audit 2024-09-21T04:58:04.303012+0000 mon.a (mon.0) 13892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:04 smithi049 bash[23528]: audit 2024-09-21T04:58:04.311490+0000 mon.a (mon.0) 13893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:04 smithi049 bash[23528]: audit 2024-09-21T04:58:04.322084+0000 mon.a (mon.0) 13894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:05.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:05 smithi044 bash[22676]: audit 2024-09-21T04:58:04.857848+0000 mgr.a (mgr.14388) 17471 : audit [DBG] from='client.376200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:05 smithi044 bash[22676]: cluster 2024-09-21T04:58:05.615105+0000 mgr.a (mgr.14388) 17472 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:58:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:05 smithi179 bash[23186]: audit 2024-09-21T04:58:04.857848+0000 mgr.a (mgr.14388) 17471 : audit [DBG] from='client.376200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:05 smithi179 bash[23186]: cluster 2024-09-21T04:58:05.615105+0000 mgr.a (mgr.14388) 17472 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:58:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:05 smithi049 bash[23528]: audit 2024-09-21T04:58:04.857848+0000 mgr.a (mgr.14388) 17471 : audit [DBG] from='client.376200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:05 smithi049 bash[23528]: cluster 2024-09-21T04:58:05.615105+0000 mgr.a (mgr.14388) 17472 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T04:58:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:07 smithi044 bash[22676]: cluster 2024-09-21T04:58:07.615928+0000 mgr.a (mgr.14388) 17473 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:58:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:07 smithi179 bash[23186]: cluster 2024-09-21T04:58:07.615928+0000 mgr.a (mgr.14388) 17473 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:58:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:07 smithi049 bash[23528]: cluster 2024-09-21T04:58:07.615928+0000 mgr.a (mgr.14388) 17473 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:58:09.813 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:09 smithi044 bash[22676]: cluster 2024-09-21T04:58:09.616505+0000 mgr.a (mgr.14388) 17474 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:58:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:09 smithi179 bash[23186]: cluster 2024-09-21T04:58:09.616505+0000 mgr.a (mgr.14388) 17474 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:58:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:09 smithi049 bash[23528]: cluster 2024-09-21T04:58:09.616505+0000 mgr.a (mgr.14388) 17474 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T04:58:10.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:10.322 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:10.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:11.094 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:11.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:11.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:11.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:11.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:11 smithi044 bash[22676]: audit 2024-09-21T04:58:10.651428+0000 mgr.a (mgr.14388) 17475 : audit [DBG] from='client.376278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:11 smithi044 bash[22676]: cluster 2024-09-21T04:58:11.619515+0000 mgr.a (mgr.14388) 17476 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:11 smithi179 bash[23186]: audit 2024-09-21T04:58:10.651428+0000 mgr.a (mgr.14388) 17475 : audit [DBG] from='client.376278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:11 smithi179 bash[23186]: cluster 2024-09-21T04:58:11.619515+0000 mgr.a (mgr.14388) 17476 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:11 smithi049 bash[23528]: audit 2024-09-21T04:58:10.651428+0000 mgr.a (mgr.14388) 17475 : audit [DBG] from='client.376278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:11 smithi049 bash[23528]: cluster 2024-09-21T04:58:11.619515+0000 mgr.a (mgr.14388) 17476 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:13 smithi044 bash[22676]: cluster 2024-09-21T04:58:13.620471+0000 mgr.a (mgr.14388) 17477 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:13 smithi179 bash[23186]: cluster 2024-09-21T04:58:13.620471+0000 mgr.a (mgr.14388) 17477 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:13 smithi049 bash[23528]: cluster 2024-09-21T04:58:13.620471+0000 mgr.a (mgr.14388) 17477 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:15 smithi044 bash[22676]: audit 2024-09-21T04:58:14.334461+0000 mon.a (mon.0) 13895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:15 smithi044 bash[22676]: audit 2024-09-21T04:58:14.343478+0000 mon.a (mon.0) 13896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:15 smithi044 bash[22676]: audit 2024-09-21T04:58:14.354674+0000 mon.a (mon.0) 13897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:15 smithi179 bash[23186]: audit 2024-09-21T04:58:14.334461+0000 mon.a (mon.0) 13895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:15 smithi179 bash[23186]: audit 2024-09-21T04:58:14.343478+0000 mon.a (mon.0) 13896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:15 smithi179 bash[23186]: audit 2024-09-21T04:58:14.354674+0000 mon.a (mon.0) 13897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:15 smithi049 bash[23528]: audit 2024-09-21T04:58:14.334461+0000 mon.a (mon.0) 13895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:15 smithi049 bash[23528]: audit 2024-09-21T04:58:14.343478+0000 mon.a (mon.0) 13896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:15 smithi049 bash[23528]: audit 2024-09-21T04:58:14.354674+0000 mon.a (mon.0) 13897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:16.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:16.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:16.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:16 smithi044 bash[22676]: cluster 2024-09-21T04:58:15.622689+0000 mgr.a (mgr.14388) 17478 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:16 smithi179 bash[23186]: cluster 2024-09-21T04:58:15.622689+0000 mgr.a (mgr.14388) 17478 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:16 smithi049 bash[23528]: cluster 2024-09-21T04:58:15.622689+0000 mgr.a (mgr.14388) 17478 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:16.858 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:17 smithi044 bash[22676]: audit 2024-09-21T04:58:16.424425+0000 mgr.a (mgr.14388) 17479 : audit [DBG] from='client.376356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:17 smithi179 bash[23186]: audit 2024-09-21T04:58:16.424425+0000 mgr.a (mgr.14388) 17479 : audit [DBG] from='client.376356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:17 smithi049 bash[23528]: audit 2024-09-21T04:58:16.424425+0000 mgr.a (mgr.14388) 17479 : audit [DBG] from='client.376356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:18.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:18 smithi179 bash[23186]: cluster 2024-09-21T04:58:17.623644+0000 mgr.a (mgr.14388) 17480 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:58:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:18 smithi044 bash[22676]: cluster 2024-09-21T04:58:17.623644+0000 mgr.a (mgr.14388) 17480 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:58:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:18 smithi049 bash[23528]: cluster 2024-09-21T04:58:17.623644+0000 mgr.a (mgr.14388) 17480 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:58:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:19 smithi044 bash[22676]: cluster 2024-09-21T04:58:19.624462+0000 mgr.a (mgr.14388) 17481 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:58:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:19 smithi179 bash[23186]: cluster 2024-09-21T04:58:19.624462+0000 mgr.a (mgr.14388) 17481 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:58:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:19 smithi049 bash[23528]: cluster 2024-09-21T04:58:19.624462+0000 mgr.a (mgr.14388) 17481 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T04:58:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:21.983 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:21 smithi049 bash[23528]: cluster 2024-09-21T04:58:21.626659+0000 mgr.a (mgr.14388) 17482 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:58:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:21 smithi044 bash[22676]: cluster 2024-09-21T04:58:21.626659+0000 mgr.a (mgr.14388) 17482 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:58:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:21 smithi179 bash[23186]: cluster 2024-09-21T04:58:21.626659+0000 mgr.a (mgr.14388) 17482 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T04:58:22.603 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:22.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:22.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:22.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:22.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:22.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:22 smithi044 bash[22676]: audit 2024-09-21T04:58:22.187903+0000 mgr.a (mgr.14388) 17483 : audit [DBG] from='client.376434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:22 smithi179 bash[23186]: audit 2024-09-21T04:58:22.187903+0000 mgr.a (mgr.14388) 17483 : audit [DBG] from='client.376434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:23.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:22 smithi049 bash[23528]: audit 2024-09-21T04:58:22.187903+0000 mgr.a (mgr.14388) 17483 : audit [DBG] from='client.376434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:23 smithi044 bash[22676]: cluster 2024-09-21T04:58:23.627554+0000 mgr.a (mgr.14388) 17484 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:23 smithi179 bash[23186]: cluster 2024-09-21T04:58:23.627554+0000 mgr.a (mgr.14388) 17484 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:23 smithi049 bash[23528]: cluster 2024-09-21T04:58:23.627554+0000 mgr.a (mgr.14388) 17484 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:24 smithi044 bash[22676]: audit 2024-09-21T04:58:23.922852+0000 mon.a (mon.0) 13898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:24 smithi044 bash[22676]: audit 2024-09-21T04:58:23.931223+0000 mon.a (mon.0) 13899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:24 smithi044 bash[22676]: audit 2024-09-21T04:58:23.941586+0000 mon.a (mon.0) 13900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:24 smithi044 bash[22676]: audit 2024-09-21T04:58:24.490358+0000 mon.a (mon.0) 13901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:24 smithi044 bash[22676]: audit 2024-09-21T04:58:24.498564+0000 mon.a (mon.0) 13902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:24 smithi044 bash[22676]: audit 2024-09-21T04:58:24.510165+0000 mon.a (mon.0) 13903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:24 smithi179 bash[23186]: audit 2024-09-21T04:58:23.922852+0000 mon.a (mon.0) 13898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:24 smithi179 bash[23186]: audit 2024-09-21T04:58:23.931223+0000 mon.a (mon.0) 13899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:24 smithi179 bash[23186]: audit 2024-09-21T04:58:23.941586+0000 mon.a (mon.0) 13900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:24 smithi179 bash[23186]: audit 2024-09-21T04:58:24.490358+0000 mon.a (mon.0) 13901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:24 smithi179 bash[23186]: audit 2024-09-21T04:58:24.498564+0000 mon.a (mon.0) 13902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:24 smithi179 bash[23186]: audit 2024-09-21T04:58:24.510165+0000 mon.a (mon.0) 13903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:24 smithi049 bash[23528]: audit 2024-09-21T04:58:23.922852+0000 mon.a (mon.0) 13898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:24 smithi049 bash[23528]: audit 2024-09-21T04:58:23.931223+0000 mon.a (mon.0) 13899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:24 smithi049 bash[23528]: audit 2024-09-21T04:58:23.941586+0000 mon.a (mon.0) 13900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:24 smithi049 bash[23528]: audit 2024-09-21T04:58:24.490358+0000 mon.a (mon.0) 13901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:24 smithi049 bash[23528]: audit 2024-09-21T04:58:24.498564+0000 mon.a (mon.0) 13902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:25.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:24 smithi049 bash[23528]: audit 2024-09-21T04:58:24.510165+0000 mon.a (mon.0) 13903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:25 smithi044 bash[22676]: cluster 2024-09-21T04:58:25.629752+0000 mgr.a (mgr.14388) 17485 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:58:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:25 smithi179 bash[23186]: cluster 2024-09-21T04:58:25.629752+0000 mgr.a (mgr.14388) 17485 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:58:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:25 smithi049 bash[23528]: cluster 2024-09-21T04:58:25.629752+0000 mgr.a (mgr.14388) 17485 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:58:27 smithi044 bash[22930]: debug 2024-09-21T04:58:27.015+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:58:27 smithi044 bash[22930]: debug 2024-09-21T04:58:27.015+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:26 smithi044 bash[22676]: audit 2024-09-21T04:58:26.201085+0000 mon.a (mon.0) 13904 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:26 smithi044 bash[22676]: audit 2024-09-21T04:58:26.207464+0000 mon.a (mon.0) 13905 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:26 smithi044 bash[22676]: audit 2024-09-21T04:58:26.209515+0000 mon.a (mon.0) 13906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:26 smithi044 bash[22676]: audit 2024-09-21T04:58:26.221888+0000 mon.a (mon.0) 13907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:26 smithi044 bash[22676]: audit 2024-09-21T04:58:26.228128+0000 mon.a (mon.0) 13908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:58:27.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:26 smithi044 bash[22676]: audit 2024-09-21T04:58:26.230489+0000 mgr.a (mgr.14388) 17486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:58:27.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:26 smithi179 bash[23186]: audit 2024-09-21T04:58:26.201085+0000 mon.a (mon.0) 13904 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:27.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:26 smithi179 bash[23186]: audit 2024-09-21T04:58:26.207464+0000 mon.a (mon.0) 13905 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:27.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:26 smithi179 bash[23186]: audit 2024-09-21T04:58:26.209515+0000 mon.a (mon.0) 13906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:27.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:26 smithi179 bash[23186]: audit 2024-09-21T04:58:26.221888+0000 mon.a (mon.0) 13907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:27.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:26 smithi179 bash[23186]: audit 2024-09-21T04:58:26.228128+0000 mon.a (mon.0) 13908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:58:27.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:26 smithi179 bash[23186]: audit 2024-09-21T04:58:26.230489+0000 mgr.a (mgr.14388) 17486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:58:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:26 smithi049 bash[23528]: audit 2024-09-21T04:58:26.201085+0000 mon.a (mon.0) 13904 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:26 smithi049 bash[23528]: audit 2024-09-21T04:58:26.207464+0000 mon.a (mon.0) 13905 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:26 smithi049 bash[23528]: audit 2024-09-21T04:58:26.209515+0000 mon.a (mon.0) 13906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:26 smithi049 bash[23528]: audit 2024-09-21T04:58:26.221888+0000 mon.a (mon.0) 13907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:26 smithi049 bash[23528]: audit 2024-09-21T04:58:26.228128+0000 mon.a (mon.0) 13908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:58:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:26 smithi049 bash[23528]: audit 2024-09-21T04:58:26.230489+0000 mgr.a (mgr.14388) 17486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:58:27.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:27.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:27.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:27 smithi044 bash[22676]: audit 2024-09-21T04:58:27.017784+0000 mgr.a (mgr.14388) 17487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:58:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:27 smithi044 bash[22676]: cephadm 2024-09-21T04:58:27.018860+0000 mgr.a (mgr.14388) 17488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:58:28.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:27 smithi044 bash[22676]: cluster 2024-09-21T04:58:27.630644+0000 mgr.a (mgr.14388) 17489 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:28.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:27 smithi179 bash[23186]: audit 2024-09-21T04:58:27.017784+0000 mgr.a (mgr.14388) 17487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:58:28.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:27 smithi179 bash[23186]: cephadm 2024-09-21T04:58:27.018860+0000 mgr.a (mgr.14388) 17488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:58:28.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:27 smithi179 bash[23186]: cluster 2024-09-21T04:58:27.630644+0000 mgr.a (mgr.14388) 17489 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:28.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:27 smithi049 bash[23528]: audit 2024-09-21T04:58:27.017784+0000 mgr.a (mgr.14388) 17487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:58:28.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:27 smithi049 bash[23528]: cephadm 2024-09-21T04:58:27.018860+0000 mgr.a (mgr.14388) 17488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:58:28.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:27 smithi049 bash[23528]: cluster 2024-09-21T04:58:27.630644+0000 mgr.a (mgr.14388) 17489 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:28.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:28.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:28.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:28.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:28.358 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:28 smithi044 bash[22676]: audit 2024-09-21T04:58:27.935811+0000 mgr.a (mgr.14388) 17490 : audit [DBG] from='client.376617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:28 smithi179 bash[23186]: audit 2024-09-21T04:58:27.935811+0000 mgr.a (mgr.14388) 17490 : audit [DBG] from='client.376617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:28 smithi049 bash[23528]: audit 2024-09-21T04:58:27.935811+0000 mgr.a (mgr.14388) 17490 : audit [DBG] from='client.376617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:29 smithi044 bash[22676]: cluster 2024-09-21T04:58:29.631582+0000 mgr.a (mgr.14388) 17491 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:29 smithi179 bash[23186]: cluster 2024-09-21T04:58:29.631582+0000 mgr.a (mgr.14388) 17491 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:29 smithi049 bash[23528]: cluster 2024-09-21T04:58:29.631582+0000 mgr.a (mgr.14388) 17491 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:31.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:31 smithi044 bash[22676]: cluster 2024-09-21T04:58:31.633930+0000 mgr.a (mgr.14388) 17492 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:31 smithi179 bash[23186]: cluster 2024-09-21T04:58:31.633930+0000 mgr.a (mgr.14388) 17492 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:31 smithi049 bash[23528]: cluster 2024-09-21T04:58:31.633930+0000 mgr.a (mgr.14388) 17492 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:33.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:33.362 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:33 smithi044 bash[22676]: cluster 2024-09-21T04:58:33.634672+0000 mgr.a (mgr.14388) 17493 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:33 smithi179 bash[23186]: cluster 2024-09-21T04:58:33.634672+0000 mgr.a (mgr.14388) 17493 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:33 smithi049 bash[23528]: cluster 2024-09-21T04:58:33.634672+0000 mgr.a (mgr.14388) 17493 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:34.153 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:34.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:34.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:34.154 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:35 smithi044 bash[22676]: audit 2024-09-21T04:58:33.690951+0000 mgr.a (mgr.14388) 17494 : audit [DBG] from='client.376695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:35 smithi044 bash[22676]: audit 2024-09-21T04:58:34.570599+0000 mon.a (mon.0) 13909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:35 smithi044 bash[22676]: audit 2024-09-21T04:58:34.581152+0000 mon.a (mon.0) 13910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:35 smithi044 bash[22676]: audit 2024-09-21T04:58:34.593459+0000 mon.a (mon.0) 13911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:35 smithi179 bash[23186]: audit 2024-09-21T04:58:33.690951+0000 mgr.a (mgr.14388) 17494 : audit [DBG] from='client.376695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:35 smithi179 bash[23186]: audit 2024-09-21T04:58:34.570599+0000 mon.a (mon.0) 13909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:35 smithi179 bash[23186]: audit 2024-09-21T04:58:34.581152+0000 mon.a (mon.0) 13910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:35 smithi179 bash[23186]: audit 2024-09-21T04:58:34.593459+0000 mon.a (mon.0) 13911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:35 smithi049 bash[23528]: audit 2024-09-21T04:58:33.690951+0000 mgr.a (mgr.14388) 17494 : audit [DBG] from='client.376695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:35 smithi049 bash[23528]: audit 2024-09-21T04:58:34.570599+0000 mon.a (mon.0) 13909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:35 smithi049 bash[23528]: audit 2024-09-21T04:58:34.581152+0000 mon.a (mon.0) 13910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:35 smithi049 bash[23528]: audit 2024-09-21T04:58:34.593459+0000 mon.a (mon.0) 13911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:36 smithi044 bash[22676]: cluster 2024-09-21T04:58:35.636999+0000 mgr.a (mgr.14388) 17495 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:37.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:36 smithi179 bash[23186]: cluster 2024-09-21T04:58:35.636999+0000 mgr.a (mgr.14388) 17495 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:36 smithi049 bash[23528]: cluster 2024-09-21T04:58:35.636999+0000 mgr.a (mgr.14388) 17495 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:37 smithi044 bash[22676]: cluster 2024-09-21T04:58:37.637782+0000 mgr.a (mgr.14388) 17496 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:37 smithi179 bash[23186]: cluster 2024-09-21T04:58:37.637782+0000 mgr.a (mgr.14388) 17496 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:37 smithi049 bash[23528]: cluster 2024-09-21T04:58:37.637782+0000 mgr.a (mgr.14388) 17496 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:39.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:39.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:39.156 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:39.946 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:39.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:39.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:39.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:39.946 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:39.979 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:39 smithi179 bash[23186]: audit 2024-09-21T04:58:39.493769+0000 mgr.a (mgr.14388) 17497 : audit [DBG] from='client.376770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:39.979 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:39 smithi179 bash[23186]: cluster 2024-09-21T04:58:39.638564+0000 mgr.a (mgr.14388) 17498 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:39 smithi044 bash[22676]: audit 2024-09-21T04:58:39.493769+0000 mgr.a (mgr.14388) 17497 : audit [DBG] from='client.376770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:39 smithi044 bash[22676]: cluster 2024-09-21T04:58:39.638564+0000 mgr.a (mgr.14388) 17498 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:39 smithi049 bash[23528]: audit 2024-09-21T04:58:39.493769+0000 mgr.a (mgr.14388) 17497 : audit [DBG] from='client.376770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:39 smithi049 bash[23528]: cluster 2024-09-21T04:58:39.638564+0000 mgr.a (mgr.14388) 17498 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:42 smithi044 bash[22676]: cluster 2024-09-21T04:58:41.640951+0000 mgr.a (mgr.14388) 17499 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:42 smithi179 bash[23186]: cluster 2024-09-21T04:58:41.640951+0000 mgr.a (mgr.14388) 17499 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:42 smithi049 bash[23528]: cluster 2024-09-21T04:58:41.640951+0000 mgr.a (mgr.14388) 17499 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:58:44.947 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:44.948 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:44.948 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:45 smithi049 bash[23528]: cluster 2024-09-21T04:58:43.641860+0000 mgr.a (mgr.14388) 17500 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:45 smithi049 bash[23528]: audit 2024-09-21T04:58:44.160898+0000 mon.a (mon.0) 13912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:45 smithi049 bash[23528]: audit 2024-09-21T04:58:44.169337+0000 mon.a (mon.0) 13913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:45 smithi049 bash[23528]: audit 2024-09-21T04:58:44.180631+0000 mon.a (mon.0) 13914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:45 smithi049 bash[23528]: audit 2024-09-21T04:58:44.721261+0000 mon.a (mon.0) 13915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:45 smithi049 bash[23528]: audit 2024-09-21T04:58:44.729918+0000 mon.a (mon.0) 13916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:45 smithi049 bash[23528]: audit 2024-09-21T04:58:44.741345+0000 mon.a (mon.0) 13917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:45 smithi044 bash[22676]: cluster 2024-09-21T04:58:43.641860+0000 mgr.a (mgr.14388) 17500 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:45.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:45 smithi044 bash[22676]: audit 2024-09-21T04:58:44.160898+0000 mon.a (mon.0) 13912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:45 smithi044 bash[22676]: audit 2024-09-21T04:58:44.169337+0000 mon.a (mon.0) 13913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:45 smithi044 bash[22676]: audit 2024-09-21T04:58:44.180631+0000 mon.a (mon.0) 13914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:45 smithi044 bash[22676]: audit 2024-09-21T04:58:44.721261+0000 mon.a (mon.0) 13915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:45 smithi044 bash[22676]: audit 2024-09-21T04:58:44.729918+0000 mon.a (mon.0) 13916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:45 smithi044 bash[22676]: audit 2024-09-21T04:58:44.741345+0000 mon.a (mon.0) 13917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:45 smithi179 bash[23186]: cluster 2024-09-21T04:58:43.641860+0000 mgr.a (mgr.14388) 17500 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:45 smithi179 bash[23186]: audit 2024-09-21T04:58:44.160898+0000 mon.a (mon.0) 13912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:45 smithi179 bash[23186]: audit 2024-09-21T04:58:44.169337+0000 mon.a (mon.0) 13913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:45 smithi179 bash[23186]: audit 2024-09-21T04:58:44.180631+0000 mon.a (mon.0) 13914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:45 smithi179 bash[23186]: audit 2024-09-21T04:58:44.721261+0000 mon.a (mon.0) 13915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:45 smithi179 bash[23186]: audit 2024-09-21T04:58:44.729918+0000 mon.a (mon.0) 13916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:45 smithi179 bash[23186]: audit 2024-09-21T04:58:44.741345+0000 mon.a (mon.0) 13917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:45.748 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:46 smithi044 bash[22676]: audit 2024-09-21T04:58:45.283262+0000 mgr.a (mgr.14388) 17501 : audit [DBG] from='client.376842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:46 smithi179 bash[23186]: audit 2024-09-21T04:58:45.283262+0000 mgr.a (mgr.14388) 17501 : audit [DBG] from='client.376842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:46 smithi049 bash[23528]: audit 2024-09-21T04:58:45.283262+0000 mgr.a (mgr.14388) 17501 : audit [DBG] from='client.376842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:47.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:47 smithi044 bash[22676]: cluster 2024-09-21T04:58:45.643991+0000 mgr.a (mgr.14388) 17502 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:47 smithi179 bash[23186]: cluster 2024-09-21T04:58:45.643991+0000 mgr.a (mgr.14388) 17502 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:47 smithi049 bash[23528]: cluster 2024-09-21T04:58:45.643991+0000 mgr.a (mgr.14388) 17502 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:49 smithi044 bash[22676]: cluster 2024-09-21T04:58:47.644764+0000 mgr.a (mgr.14388) 17503 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:49 smithi179 bash[23186]: cluster 2024-09-21T04:58:47.644764+0000 mgr.a (mgr.14388) 17503 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:49 smithi049 bash[23528]: cluster 2024-09-21T04:58:47.644764+0000 mgr.a (mgr.14388) 17503 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:51 smithi044 bash[22676]: cluster 2024-09-21T04:58:49.645613+0000 mgr.a (mgr.14388) 17504 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:58:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:51 smithi179 bash[23186]: cluster 2024-09-21T04:58:49.645613+0000 mgr.a (mgr.14388) 17504 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:58:51.530 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:51 smithi049 bash[23528]: cluster 2024-09-21T04:58:49.645613+0000 mgr.a (mgr.14388) 17504 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:58:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:52 smithi044 bash[22676]: audit 2024-09-21T04:58:51.089175+0000 mgr.a (mgr.14388) 17505 : audit [DBG] from='client.376920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:52 smithi179 bash[23186]: audit 2024-09-21T04:58:51.089175+0000 mgr.a (mgr.14388) 17505 : audit [DBG] from='client.376920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:52.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:52 smithi049 bash[23528]: audit 2024-09-21T04:58:51.089175+0000 mgr.a (mgr.14388) 17505 : audit [DBG] from='client.376920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:53 smithi044 bash[22676]: cluster 2024-09-21T04:58:51.648405+0000 mgr.a (mgr.14388) 17506 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:53 smithi179 bash[23186]: cluster 2024-09-21T04:58:51.648405+0000 mgr.a (mgr.14388) 17506 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:53 smithi049 bash[23528]: cluster 2024-09-21T04:58:51.648405+0000 mgr.a (mgr.14388) 17506 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:55 smithi044 bash[22676]: cluster 2024-09-21T04:58:53.649350+0000 mgr.a (mgr.14388) 17507 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:55 smithi044 bash[22676]: audit 2024-09-21T04:58:54.811252+0000 mon.a (mon.0) 13918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:55 smithi044 bash[22676]: audit 2024-09-21T04:58:54.821129+0000 mon.a (mon.0) 13919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:55 smithi044 bash[22676]: audit 2024-09-21T04:58:54.833168+0000 mon.a (mon.0) 13920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:55 smithi179 bash[23186]: cluster 2024-09-21T04:58:53.649350+0000 mgr.a (mgr.14388) 17507 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:55.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:55 smithi179 bash[23186]: audit 2024-09-21T04:58:54.811252+0000 mon.a (mon.0) 13918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:55 smithi179 bash[23186]: audit 2024-09-21T04:58:54.821129+0000 mon.a (mon.0) 13919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:55 smithi179 bash[23186]: audit 2024-09-21T04:58:54.833168+0000 mon.a (mon.0) 13920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:55 smithi049 bash[23528]: cluster 2024-09-21T04:58:53.649350+0000 mgr.a (mgr.14388) 17507 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:58:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:55 smithi049 bash[23528]: audit 2024-09-21T04:58:54.811252+0000 mon.a (mon.0) 13918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:55 smithi049 bash[23528]: audit 2024-09-21T04:58:54.821129+0000 mon.a (mon.0) 13919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:55 smithi049 bash[23528]: audit 2024-09-21T04:58:54.833168+0000 mon.a (mon.0) 13920 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:58:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:58:56.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:58:56.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:58:57.286 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:58:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:58:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:58:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:58:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:58:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:57 smithi044 bash[22676]: cluster 2024-09-21T04:58:55.651548+0000 mgr.a (mgr.14388) 17508 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:57 smithi179 bash[23186]: cluster 2024-09-21T04:58:55.651548+0000 mgr.a (mgr.14388) 17508 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:57 smithi049 bash[23528]: cluster 2024-09-21T04:58:55.651548+0000 mgr.a (mgr.14388) 17508 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:58.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:58 smithi044 bash[22676]: audit 2024-09-21T04:58:56.860531+0000 mgr.a (mgr.14388) 17509 : audit [DBG] from='client.376995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:58 smithi179 bash[23186]: audit 2024-09-21T04:58:56.860531+0000 mgr.a (mgr.14388) 17509 : audit [DBG] from='client.376995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:58 smithi049 bash[23528]: audit 2024-09-21T04:58:56.860531+0000 mgr.a (mgr.14388) 17509 : audit [DBG] from='client.376995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:58:59 smithi044 bash[22676]: cluster 2024-09-21T04:58:57.652465+0000 mgr.a (mgr.14388) 17510 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:58:59 smithi179 bash[23186]: cluster 2024-09-21T04:58:57.652465+0000 mgr.a (mgr.14388) 17510 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:58:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:58:59 smithi049 bash[23528]: cluster 2024-09-21T04:58:57.652465+0000 mgr.a (mgr.14388) 17510 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:01 smithi044 bash[22676]: cluster 2024-09-21T04:58:59.653318+0000 mgr.a (mgr.14388) 17511 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:01 smithi179 bash[23186]: cluster 2024-09-21T04:58:59.653318+0000 mgr.a (mgr.14388) 17511 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:01 smithi049 bash[23528]: cluster 2024-09-21T04:58:59.653318+0000 mgr.a (mgr.14388) 17511 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:02.288 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:02.289 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:03.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:03.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:03.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:03.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:03.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:03 smithi044 bash[22676]: cluster 2024-09-21T04:59:01.655600+0000 mgr.a (mgr.14388) 17512 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:03 smithi044 bash[22676]: audit 2024-09-21T04:59:02.627228+0000 mgr.a (mgr.14388) 17513 : audit [DBG] from='client.377073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:03 smithi179 bash[23186]: cluster 2024-09-21T04:59:01.655600+0000 mgr.a (mgr.14388) 17512 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:03 smithi179 bash[23186]: audit 2024-09-21T04:59:02.627228+0000 mgr.a (mgr.14388) 17513 : audit [DBG] from='client.377073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:03 smithi049 bash[23528]: cluster 2024-09-21T04:59:01.655600+0000 mgr.a (mgr.14388) 17512 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:03 smithi049 bash[23528]: audit 2024-09-21T04:59:02.627228+0000 mgr.a (mgr.14388) 17513 : audit [DBG] from='client.377073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:05 smithi044 bash[22676]: cluster 2024-09-21T04:59:03.656639+0000 mgr.a (mgr.14388) 17514 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:05 smithi044 bash[22676]: audit 2024-09-21T04:59:04.387889+0000 mon.a (mon.0) 13921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:05 smithi044 bash[22676]: audit 2024-09-21T04:59:04.396187+0000 mon.a (mon.0) 13922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:05 smithi044 bash[22676]: audit 2024-09-21T04:59:04.406826+0000 mon.a (mon.0) 13923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:05 smithi044 bash[22676]: audit 2024-09-21T04:59:04.947487+0000 mon.a (mon.0) 13924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:05 smithi044 bash[22676]: audit 2024-09-21T04:59:04.955965+0000 mon.a (mon.0) 13925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:05 smithi044 bash[22676]: audit 2024-09-21T04:59:04.966126+0000 mon.a (mon.0) 13926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:05 smithi179 bash[23186]: cluster 2024-09-21T04:59:03.656639+0000 mgr.a (mgr.14388) 17514 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:05 smithi179 bash[23186]: audit 2024-09-21T04:59:04.387889+0000 mon.a (mon.0) 13921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:05 smithi179 bash[23186]: audit 2024-09-21T04:59:04.396187+0000 mon.a (mon.0) 13922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:05 smithi179 bash[23186]: audit 2024-09-21T04:59:04.406826+0000 mon.a (mon.0) 13923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:05 smithi179 bash[23186]: audit 2024-09-21T04:59:04.947487+0000 mon.a (mon.0) 13924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:05 smithi179 bash[23186]: audit 2024-09-21T04:59:04.955965+0000 mon.a (mon.0) 13925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:05 smithi179 bash[23186]: audit 2024-09-21T04:59:04.966126+0000 mon.a (mon.0) 13926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:05 smithi049 bash[23528]: cluster 2024-09-21T04:59:03.656639+0000 mgr.a (mgr.14388) 17514 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:05 smithi049 bash[23528]: audit 2024-09-21T04:59:04.387889+0000 mon.a (mon.0) 13921 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:05 smithi049 bash[23528]: audit 2024-09-21T04:59:04.396187+0000 mon.a (mon.0) 13922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:05 smithi049 bash[23528]: audit 2024-09-21T04:59:04.406826+0000 mon.a (mon.0) 13923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:05 smithi049 bash[23528]: audit 2024-09-21T04:59:04.947487+0000 mon.a (mon.0) 13924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:05 smithi049 bash[23528]: audit 2024-09-21T04:59:04.955965+0000 mon.a (mon.0) 13925 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:05 smithi049 bash[23528]: audit 2024-09-21T04:59:04.966126+0000 mon.a (mon.0) 13926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:07.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:07 smithi044 bash[22676]: cluster 2024-09-21T04:59:05.658890+0000 mgr.a (mgr.14388) 17515 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:07 smithi179 bash[23186]: cluster 2024-09-21T04:59:05.658890+0000 mgr.a (mgr.14388) 17515 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:07 smithi049 bash[23528]: cluster 2024-09-21T04:59:05.658890+0000 mgr.a (mgr.14388) 17515 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:08.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:08.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:08.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:08.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:08.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:09.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:09 smithi044 bash[22676]: cluster 2024-09-21T04:59:07.659672+0000 mgr.a (mgr.14388) 17516 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:09.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:09 smithi044 bash[22676]: audit 2024-09-21T04:59:08.403681+0000 mgr.a (mgr.14388) 17517 : audit [DBG] from='client.377151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:09.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:09 smithi179 bash[23186]: cluster 2024-09-21T04:59:07.659672+0000 mgr.a (mgr.14388) 17516 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:09.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:09 smithi179 bash[23186]: audit 2024-09-21T04:59:08.403681+0000 mgr.a (mgr.14388) 17517 : audit [DBG] from='client.377151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:09 smithi049 bash[23528]: cluster 2024-09-21T04:59:07.659672+0000 mgr.a (mgr.14388) 17516 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:09 smithi049 bash[23528]: audit 2024-09-21T04:59:08.403681+0000 mgr.a (mgr.14388) 17517 : audit [DBG] from='client.377151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:11 smithi044 bash[22676]: cluster 2024-09-21T04:59:09.660828+0000 mgr.a (mgr.14388) 17518 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:11 smithi179 bash[23186]: cluster 2024-09-21T04:59:09.660828+0000 mgr.a (mgr.14388) 17518 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:11 smithi049 bash[23528]: cluster 2024-09-21T04:59:09.660828+0000 mgr.a (mgr.14388) 17518 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:13 smithi044 bash[22676]: cluster 2024-09-21T04:59:11.663187+0000 mgr.a (mgr.14388) 17519 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:13 smithi179 bash[23186]: cluster 2024-09-21T04:59:11.663187+0000 mgr.a (mgr.14388) 17519 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:13 smithi049 bash[23528]: cluster 2024-09-21T04:59:11.663187+0000 mgr.a (mgr.14388) 17519 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:13.833 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:13.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:13.834 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:14.603 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:14.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:14.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:14.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:14.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:15 smithi044 bash[22676]: cluster 2024-09-21T04:59:13.664125+0000 mgr.a (mgr.14388) 17520 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:15 smithi044 bash[22676]: audit 2024-09-21T04:59:14.164832+0000 mgr.a (mgr.14388) 17521 : audit [DBG] from='client.377229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:15 smithi044 bash[22676]: audit 2024-09-21T04:59:15.054542+0000 mon.a (mon.0) 13927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:15 smithi044 bash[22676]: audit 2024-09-21T04:59:15.064556+0000 mon.a (mon.0) 13928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:15 smithi044 bash[22676]: audit 2024-09-21T04:59:15.075340+0000 mon.a (mon.0) 13929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:15 smithi179 bash[23186]: cluster 2024-09-21T04:59:13.664125+0000 mgr.a (mgr.14388) 17520 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:15 smithi179 bash[23186]: audit 2024-09-21T04:59:14.164832+0000 mgr.a (mgr.14388) 17521 : audit [DBG] from='client.377229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:15 smithi179 bash[23186]: audit 2024-09-21T04:59:15.054542+0000 mon.a (mon.0) 13927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:15 smithi179 bash[23186]: audit 2024-09-21T04:59:15.064556+0000 mon.a (mon.0) 13928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:15 smithi179 bash[23186]: audit 2024-09-21T04:59:15.075340+0000 mon.a (mon.0) 13929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:15 smithi049 bash[23528]: cluster 2024-09-21T04:59:13.664125+0000 mgr.a (mgr.14388) 17520 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:15 smithi049 bash[23528]: audit 2024-09-21T04:59:14.164832+0000 mgr.a (mgr.14388) 17521 : audit [DBG] from='client.377229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:15 smithi049 bash[23528]: audit 2024-09-21T04:59:15.054542+0000 mon.a (mon.0) 13927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:15 smithi049 bash[23528]: audit 2024-09-21T04:59:15.064556+0000 mon.a (mon.0) 13928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:15 smithi049 bash[23528]: audit 2024-09-21T04:59:15.075340+0000 mon.a (mon.0) 13929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:17 smithi044 bash[22676]: cluster 2024-09-21T04:59:15.666580+0000 mgr.a (mgr.14388) 17522 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:17 smithi179 bash[23186]: cluster 2024-09-21T04:59:15.666580+0000 mgr.a (mgr.14388) 17522 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:17 smithi049 bash[23528]: cluster 2024-09-21T04:59:15.666580+0000 mgr.a (mgr.14388) 17522 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:19.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:19.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:19 smithi044 bash[22676]: cluster 2024-09-21T04:59:17.667507+0000 mgr.a (mgr.14388) 17523 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:19 smithi179 bash[23186]: cluster 2024-09-21T04:59:17.667507+0000 mgr.a (mgr.14388) 17523 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:19 smithi049 bash[23528]: cluster 2024-09-21T04:59:17.667507+0000 mgr.a (mgr.14388) 17523 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:20.376 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:20.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:20.376 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:20.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:20.377 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:21 smithi044 bash[22676]: cluster 2024-09-21T04:59:19.668443+0000 mgr.a (mgr.14388) 17524 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:21 smithi044 bash[22676]: audit 2024-09-21T04:59:19.935483+0000 mgr.a (mgr.14388) 17525 : audit [DBG] from='client.377307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:21 smithi179 bash[23186]: cluster 2024-09-21T04:59:19.668443+0000 mgr.a (mgr.14388) 17524 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:21 smithi179 bash[23186]: audit 2024-09-21T04:59:19.935483+0000 mgr.a (mgr.14388) 17525 : audit [DBG] from='client.377307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:21 smithi049 bash[23528]: cluster 2024-09-21T04:59:19.668443+0000 mgr.a (mgr.14388) 17524 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:21 smithi049 bash[23528]: audit 2024-09-21T04:59:19.935483+0000 mgr.a (mgr.14388) 17525 : audit [DBG] from='client.377307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:23 smithi049 bash[23528]: cluster 2024-09-21T04:59:21.671513+0000 mgr.a (mgr.14388) 17526 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:23.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:23 smithi044 bash[22676]: cluster 2024-09-21T04:59:21.671513+0000 mgr.a (mgr.14388) 17526 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:23 smithi179 bash[23186]: cluster 2024-09-21T04:59:21.671513+0000 mgr.a (mgr.14388) 17526 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:25.379 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:25.876 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:25 smithi049 bash[23528]: cluster 2024-09-21T04:59:23.672296+0000 mgr.a (mgr.14388) 17527 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:59:25.876 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:25 smithi049 bash[23528]: audit 2024-09-21T04:59:24.623807+0000 mon.a (mon.0) 13930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.876 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:25 smithi049 bash[23528]: audit 2024-09-21T04:59:24.631507+0000 mon.a (mon.0) 13931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.876 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:25 smithi049 bash[23528]: audit 2024-09-21T04:59:24.641930+0000 mon.a (mon.0) 13932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.876 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:25 smithi049 bash[23528]: audit 2024-09-21T04:59:25.182168+0000 mon.a (mon.0) 13933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.877 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:25 smithi049 bash[23528]: audit 2024-09-21T04:59:25.190528+0000 mon.a (mon.0) 13934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.877 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:25 smithi049 bash[23528]: audit 2024-09-21T04:59:25.200270+0000 mon.a (mon.0) 13935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:25 smithi044 bash[22676]: cluster 2024-09-21T04:59:23.672296+0000 mgr.a (mgr.14388) 17527 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:59:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:25 smithi044 bash[22676]: audit 2024-09-21T04:59:24.623807+0000 mon.a (mon.0) 13930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:25 smithi044 bash[22676]: audit 2024-09-21T04:59:24.631507+0000 mon.a (mon.0) 13931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:25 smithi044 bash[22676]: audit 2024-09-21T04:59:24.641930+0000 mon.a (mon.0) 13932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:25 smithi044 bash[22676]: audit 2024-09-21T04:59:25.182168+0000 mon.a (mon.0) 13933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:25 smithi044 bash[22676]: audit 2024-09-21T04:59:25.190528+0000 mon.a (mon.0) 13934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:25 smithi044 bash[22676]: audit 2024-09-21T04:59:25.200270+0000 mon.a (mon.0) 13935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:25 smithi179 bash[23186]: cluster 2024-09-21T04:59:23.672296+0000 mgr.a (mgr.14388) 17527 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:59:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:25 smithi179 bash[23186]: audit 2024-09-21T04:59:24.623807+0000 mon.a (mon.0) 13930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:25 smithi179 bash[23186]: audit 2024-09-21T04:59:24.631507+0000 mon.a (mon.0) 13931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:25 smithi179 bash[23186]: audit 2024-09-21T04:59:24.641930+0000 mon.a (mon.0) 13932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:25 smithi179 bash[23186]: audit 2024-09-21T04:59:25.182168+0000 mon.a (mon.0) 13933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:25 smithi179 bash[23186]: audit 2024-09-21T04:59:25.190528+0000 mon.a (mon.0) 13934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:25 smithi179 bash[23186]: audit 2024-09-21T04:59:25.200270+0000 mon.a (mon.0) 13935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:26.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:26.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:26.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:26.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:26.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:27.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22676]: cluster 2024-09-21T04:59:25.674249+0000 mgr.a (mgr.14388) 17528 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:27.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22676]: audit 2024-09-21T04:59:25.712936+0000 mgr.a (mgr.14388) 17529 : audit [DBG] from='client.377385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:27.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22676]: audit 2024-09-21T04:59:27.068478+0000 mon.a (mon.0) 13936 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:27.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22676]: audit 2024-09-21T04:59:27.076047+0000 mon.a (mon.0) 13937 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:27.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22676]: audit 2024-09-21T04:59:27.078024+0000 mon.a (mon.0) 13938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:27.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22676]: audit 2024-09-21T04:59:27.089648+0000 mon.a (mon.0) 13939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:27.896 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22676]: audit 2024-09-21T04:59:27.096240+0000 mon.a (mon.0) 13940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:59:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:27 smithi179 bash[23186]: cluster 2024-09-21T04:59:25.674249+0000 mgr.a (mgr.14388) 17528 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:27 smithi179 bash[23186]: audit 2024-09-21T04:59:25.712936+0000 mgr.a (mgr.14388) 17529 : audit [DBG] from='client.377385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:27 smithi179 bash[23186]: audit 2024-09-21T04:59:27.068478+0000 mon.a (mon.0) 13936 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:27 smithi179 bash[23186]: audit 2024-09-21T04:59:27.076047+0000 mon.a (mon.0) 13937 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:27 smithi179 bash[23186]: audit 2024-09-21T04:59:27.078024+0000 mon.a (mon.0) 13938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:27 smithi179 bash[23186]: audit 2024-09-21T04:59:27.089648+0000 mon.a (mon.0) 13939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:27 smithi179 bash[23186]: audit 2024-09-21T04:59:27.096240+0000 mon.a (mon.0) 13940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:59:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:27 smithi049 bash[23528]: cluster 2024-09-21T04:59:25.674249+0000 mgr.a (mgr.14388) 17528 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:27 smithi049 bash[23528]: audit 2024-09-21T04:59:25.712936+0000 mgr.a (mgr.14388) 17529 : audit [DBG] from='client.377385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:27 smithi049 bash[23528]: audit 2024-09-21T04:59:27.068478+0000 mon.a (mon.0) 13936 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:27 smithi049 bash[23528]: audit 2024-09-21T04:59:27.076047+0000 mon.a (mon.0) 13937 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:27 smithi049 bash[23528]: audit 2024-09-21T04:59:27.078024+0000 mon.a (mon.0) 13938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:27 smithi049 bash[23528]: audit 2024-09-21T04:59:27.089648+0000 mon.a (mon.0) 13939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:27 smithi049 bash[23528]: audit 2024-09-21T04:59:27.096240+0000 mon.a (mon.0) 13940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:59:28.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22930]: debug 2024-09-21T04:59:27.890+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:59:28.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 04:59:27 smithi044 bash[22930]: debug 2024-09-21T04:59:27.890+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:59:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:28 smithi044 bash[22676]: audit 2024-09-21T04:59:27.099107+0000 mgr.a (mgr.14388) 17530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:59:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:28 smithi179 bash[23186]: audit 2024-09-21T04:59:27.099107+0000 mgr.a (mgr.14388) 17530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:59:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:28 smithi049 bash[23528]: audit 2024-09-21T04:59:27.099107+0000 mgr.a (mgr.14388) 17530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T04:59:29.915 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:29 smithi179 bash[23186]: cluster 2024-09-21T04:59:27.674834+0000 mgr.a (mgr.14388) 17531 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:59:29.915 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:29 smithi179 bash[23186]: audit 2024-09-21T04:59:27.893268+0000 mgr.a (mgr.14388) 17532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:59:29.915 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:29 smithi179 bash[23186]: cephadm 2024-09-21T04:59:27.895209+0000 mgr.a (mgr.14388) 17533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:59:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:29 smithi044 bash[22676]: cluster 2024-09-21T04:59:27.674834+0000 mgr.a (mgr.14388) 17531 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:59:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:29 smithi044 bash[22676]: audit 2024-09-21T04:59:27.893268+0000 mgr.a (mgr.14388) 17532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:59:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:29 smithi044 bash[22676]: cephadm 2024-09-21T04:59:27.895209+0000 mgr.a (mgr.14388) 17533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:59:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:29 smithi049 bash[23528]: cluster 2024-09-21T04:59:27.674834+0000 mgr.a (mgr.14388) 17531 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T04:59:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:29 smithi049 bash[23528]: audit 2024-09-21T04:59:27.893268+0000 mgr.a (mgr.14388) 17532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T04:59:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:29 smithi049 bash[23528]: cephadm 2024-09-21T04:59:27.895209+0000 mgr.a (mgr.14388) 17533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T04:59:31.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:31.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:31.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:31.937 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:31.978 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:31 smithi044 bash[22676]: cluster 2024-09-21T04:59:29.675586+0000 mgr.a (mgr.14388) 17534 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:59:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:31 smithi179 bash[23186]: cluster 2024-09-21T04:59:29.675586+0000 mgr.a (mgr.14388) 17534 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:59:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:31 smithi049 bash[23528]: cluster 2024-09-21T04:59:29.675586+0000 mgr.a (mgr.14388) 17534 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T04:59:32.924 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:32 smithi044 bash[22676]: audit 2024-09-21T04:59:31.508621+0000 mgr.a (mgr.14388) 17535 : audit [DBG] from='client.377568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:32 smithi179 bash[23186]: audit 2024-09-21T04:59:31.508621+0000 mgr.a (mgr.14388) 17535 : audit [DBG] from='client.377568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:32 smithi049 bash[23528]: audit 2024-09-21T04:59:31.508621+0000 mgr.a (mgr.14388) 17535 : audit [DBG] from='client.377568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:33 smithi044 bash[22676]: cluster 2024-09-21T04:59:31.676966+0000 mgr.a (mgr.14388) 17536 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:33 smithi179 bash[23186]: cluster 2024-09-21T04:59:31.676966+0000 mgr.a (mgr.14388) 17536 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:33 smithi049 bash[23528]: cluster 2024-09-21T04:59:31.676966+0000 mgr.a (mgr.14388) 17536 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:34.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:34 smithi044 bash[22676]: cluster 2024-09-21T04:59:33.677558+0000 mgr.a (mgr.14388) 17537 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:34 smithi179 bash[23186]: cluster 2024-09-21T04:59:33.677558+0000 mgr.a (mgr.14388) 17537 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:34 smithi049 bash[23528]: cluster 2024-09-21T04:59:33.677558+0000 mgr.a (mgr.14388) 17537 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:36.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:36 smithi049 bash[23528]: audit 2024-09-21T04:59:35.263691+0000 mon.a (mon.0) 13941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:36 smithi049 bash[23528]: audit 2024-09-21T04:59:35.272420+0000 mon.a (mon.0) 13942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:36 smithi049 bash[23528]: audit 2024-09-21T04:59:35.282849+0000 mon.a (mon.0) 13943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:36 smithi044 bash[22676]: audit 2024-09-21T04:59:35.263691+0000 mon.a (mon.0) 13941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:36 smithi044 bash[22676]: audit 2024-09-21T04:59:35.272420+0000 mon.a (mon.0) 13942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:36 smithi044 bash[22676]: audit 2024-09-21T04:59:35.282849+0000 mon.a (mon.0) 13943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:36 smithi179 bash[23186]: audit 2024-09-21T04:59:35.263691+0000 mon.a (mon.0) 13941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:36 smithi179 bash[23186]: audit 2024-09-21T04:59:35.272420+0000 mon.a (mon.0) 13942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:36 smithi179 bash[23186]: audit 2024-09-21T04:59:35.282849+0000 mon.a (mon.0) 13943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:37 smithi049 bash[23528]: cluster 2024-09-21T04:59:35.679797+0000 mgr.a (mgr.14388) 17538 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:37.687 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:37.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:37.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:37.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:37.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:37 smithi044 bash[22676]: cluster 2024-09-21T04:59:35.679797+0000 mgr.a (mgr.14388) 17538 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:37 smithi179 bash[23186]: cluster 2024-09-21T04:59:35.679797+0000 mgr.a (mgr.14388) 17538 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:38 smithi049 bash[23528]: audit 2024-09-21T04:59:37.266030+0000 mgr.a (mgr.14388) 17539 : audit [DBG] from='client.377643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:38.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:38 smithi044 bash[22676]: audit 2024-09-21T04:59:37.266030+0000 mgr.a (mgr.14388) 17539 : audit [DBG] from='client.377643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:38 smithi179 bash[23186]: audit 2024-09-21T04:59:37.266030+0000 mgr.a (mgr.14388) 17539 : audit [DBG] from='client.377643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:39.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:39 smithi049 bash[23528]: cluster 2024-09-21T04:59:37.680285+0000 mgr.a (mgr.14388) 17540 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:39.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:39 smithi044 bash[22676]: cluster 2024-09-21T04:59:37.680285+0000 mgr.a (mgr.14388) 17540 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:39 smithi179 bash[23186]: cluster 2024-09-21T04:59:37.680285+0000 mgr.a (mgr.14388) 17540 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:41 smithi179 bash[23186]: cluster 2024-09-21T04:59:39.681029+0000 mgr.a (mgr.14388) 17541 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:41.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:41 smithi044 bash[22676]: cluster 2024-09-21T04:59:39.681029+0000 mgr.a (mgr.14388) 17541 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:41 smithi049 bash[23528]: cluster 2024-09-21T04:59:39.681029+0000 mgr.a (mgr.14388) 17541 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:42.689 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:42.689 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:42.689 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:43.446 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:43 smithi179 bash[23186]: cluster 2024-09-21T04:59:41.683303+0000 mgr.a (mgr.14388) 17542 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:43.690 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:43 smithi049 bash[23528]: cluster 2024-09-21T04:59:41.683303+0000 mgr.a (mgr.14388) 17542 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:43 smithi044 bash[22676]: cluster 2024-09-21T04:59:41.683303+0000 mgr.a (mgr.14388) 17542 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T04:59:44.618 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:44 smithi049 bash[23528]: audit 2024-09-21T04:59:43.018914+0000 mgr.a (mgr.14388) 17543 : audit [DBG] from='client.377715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:44 smithi044 bash[22676]: audit 2024-09-21T04:59:43.018914+0000 mgr.a (mgr.14388) 17543 : audit [DBG] from='client.377715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:44 smithi179 bash[23186]: audit 2024-09-21T04:59:43.018914+0000 mgr.a (mgr.14388) 17543 : audit [DBG] from='client.377715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:45.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:45 smithi049 bash[23528]: cluster 2024-09-21T04:59:43.684253+0000 mgr.a (mgr.14388) 17544 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:45.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:45 smithi049 bash[23528]: audit 2024-09-21T04:59:44.836216+0000 mon.a (mon.0) 13944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:45 smithi049 bash[23528]: audit 2024-09-21T04:59:44.846508+0000 mon.a (mon.0) 13945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.661 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:45 smithi049 bash[23528]: audit 2024-09-21T04:59:44.858567+0000 mon.a (mon.0) 13946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:45 smithi044 bash[22676]: cluster 2024-09-21T04:59:43.684253+0000 mgr.a (mgr.14388) 17544 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:45.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:45 smithi044 bash[22676]: audit 2024-09-21T04:59:44.836216+0000 mon.a (mon.0) 13944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:45 smithi044 bash[22676]: audit 2024-09-21T04:59:44.846508+0000 mon.a (mon.0) 13945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:45 smithi044 bash[22676]: audit 2024-09-21T04:59:44.858567+0000 mon.a (mon.0) 13946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:45 smithi179 bash[23186]: cluster 2024-09-21T04:59:43.684253+0000 mgr.a (mgr.14388) 17544 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:45.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:45 smithi179 bash[23186]: audit 2024-09-21T04:59:44.836216+0000 mon.a (mon.0) 13944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:45 smithi179 bash[23186]: audit 2024-09-21T04:59:44.846508+0000 mon.a (mon.0) 13945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:45.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:45 smithi179 bash[23186]: audit 2024-09-21T04:59:44.858567+0000 mon.a (mon.0) 13946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:46 smithi049 bash[23528]: audit 2024-09-21T04:59:45.403128+0000 mon.a (mon.0) 13947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:46 smithi049 bash[23528]: audit 2024-09-21T04:59:45.413784+0000 mon.a (mon.0) 13948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:46 smithi049 bash[23528]: audit 2024-09-21T04:59:45.426353+0000 mon.a (mon.0) 13949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:46 smithi044 bash[22676]: audit 2024-09-21T04:59:45.403128+0000 mon.a (mon.0) 13947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:46 smithi044 bash[22676]: audit 2024-09-21T04:59:45.413784+0000 mon.a (mon.0) 13948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:46 smithi044 bash[22676]: audit 2024-09-21T04:59:45.426353+0000 mon.a (mon.0) 13949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:46 smithi179 bash[23186]: audit 2024-09-21T04:59:45.403128+0000 mon.a (mon.0) 13947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:46 smithi179 bash[23186]: audit 2024-09-21T04:59:45.413784+0000 mon.a (mon.0) 13948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:46 smithi179 bash[23186]: audit 2024-09-21T04:59:45.426353+0000 mon.a (mon.0) 13949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:47 smithi044 bash[22676]: cluster 2024-09-21T04:59:45.686534+0000 mgr.a (mgr.14388) 17545 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:47 smithi179 bash[23186]: cluster 2024-09-21T04:59:45.686534+0000 mgr.a (mgr.14388) 17545 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:47 smithi049 bash[23528]: cluster 2024-09-21T04:59:45.686534+0000 mgr.a (mgr.14388) 17545 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:48.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:48.448 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:48.448 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:49.232 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:49.232 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:49 smithi044 bash[22676]: cluster 2024-09-21T04:59:47.687306+0000 mgr.a (mgr.14388) 17546 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:49 smithi179 bash[23186]: cluster 2024-09-21T04:59:47.687306+0000 mgr.a (mgr.14388) 17546 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:49 smithi049 bash[23528]: cluster 2024-09-21T04:59:47.687306+0000 mgr.a (mgr.14388) 17546 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:50 smithi044 bash[22676]: audit 2024-09-21T04:59:48.776896+0000 mgr.a (mgr.14388) 17547 : audit [DBG] from='client.377793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:50 smithi179 bash[23186]: audit 2024-09-21T04:59:48.776896+0000 mgr.a (mgr.14388) 17547 : audit [DBG] from='client.377793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:50.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:50 smithi049 bash[23528]: audit 2024-09-21T04:59:48.776896+0000 mgr.a (mgr.14388) 17547 : audit [DBG] from='client.377793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:51 smithi044 bash[22676]: cluster 2024-09-21T04:59:49.688286+0000 mgr.a (mgr.14388) 17548 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:51 smithi179 bash[23186]: cluster 2024-09-21T04:59:49.688286+0000 mgr.a (mgr.14388) 17548 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:51 smithi049 bash[23528]: cluster 2024-09-21T04:59:49.688286+0000 mgr.a (mgr.14388) 17548 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:53 smithi044 bash[22676]: cluster 2024-09-21T04:59:51.690601+0000 mgr.a (mgr.14388) 17549 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:53 smithi179 bash[23186]: cluster 2024-09-21T04:59:51.690601+0000 mgr.a (mgr.14388) 17549 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:53 smithi049 bash[23528]: cluster 2024-09-21T04:59:51.690601+0000 mgr.a (mgr.14388) 17549 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:54.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T04:59:54.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T04:59:54.234 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T04:59:55.029 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T04:59:55.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T04:59:55.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T04:59:55.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T04:59:55.029 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T04:59:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:55 smithi044 bash[22676]: cluster 2024-09-21T04:59:53.691218+0000 mgr.a (mgr.14388) 17550 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:55 smithi044 bash[22676]: audit 2024-09-21T04:59:54.573622+0000 mgr.a (mgr.14388) 17551 : audit [DBG] from='client.377868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:55 smithi179 bash[23186]: cluster 2024-09-21T04:59:53.691218+0000 mgr.a (mgr.14388) 17550 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:55 smithi179 bash[23186]: audit 2024-09-21T04:59:54.573622+0000 mgr.a (mgr.14388) 17551 : audit [DBG] from='client.377868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:55 smithi049 bash[23528]: cluster 2024-09-21T04:59:53.691218+0000 mgr.a (mgr.14388) 17550 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:55 smithi049 bash[23528]: audit 2024-09-21T04:59:54.573622+0000 mgr.a (mgr.14388) 17551 : audit [DBG] from='client.377868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:56 smithi044 bash[22676]: audit 2024-09-21T04:59:55.481990+0000 mon.a (mon.0) 13950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:56 smithi044 bash[22676]: audit 2024-09-21T04:59:55.490870+0000 mon.a (mon.0) 13951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:56 smithi044 bash[22676]: audit 2024-09-21T04:59:55.501468+0000 mon.a (mon.0) 13952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:56 smithi179 bash[23186]: audit 2024-09-21T04:59:55.481990+0000 mon.a (mon.0) 13950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:56 smithi179 bash[23186]: audit 2024-09-21T04:59:55.490870+0000 mon.a (mon.0) 13951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:56 smithi179 bash[23186]: audit 2024-09-21T04:59:55.501468+0000 mon.a (mon.0) 13952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:56 smithi049 bash[23528]: audit 2024-09-21T04:59:55.481990+0000 mon.a (mon.0) 13950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:56 smithi049 bash[23528]: audit 2024-09-21T04:59:55.490870+0000 mon.a (mon.0) 13951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:56 smithi049 bash[23528]: audit 2024-09-21T04:59:55.501468+0000 mon.a (mon.0) 13952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T04:59:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:57 smithi179 bash[23186]: cluster 2024-09-21T04:59:55.693542+0000 mgr.a (mgr.14388) 17552 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:57 smithi049 bash[23528]: cluster 2024-09-21T04:59:55.693542+0000 mgr.a (mgr.14388) 17552 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:57 smithi044 bash[22676]: cluster 2024-09-21T04:59:55.693542+0000 mgr.a (mgr.14388) 17552 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T04:59:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 04:59:59 smithi049 bash[23528]: cluster 2024-09-21T04:59:57.694338+0000 mgr.a (mgr.14388) 17553 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T04:59:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 04:59:59 smithi044 bash[22676]: cluster 2024-09-21T04:59:57.694338+0000 mgr.a (mgr.14388) 17553 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 04:59:59 smithi179 bash[23186]: cluster 2024-09-21T04:59:57.694338+0000 mgr.a (mgr.14388) 17553 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:00 smithi049 bash[23528]: cluster 2024-09-21T05:00:00.000150+0000 mon.a (mon.0) 13953 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:00:00.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:00.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:00.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:00.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:00.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:00 smithi044 bash[22676]: cluster 2024-09-21T05:00:00.000150+0000 mon.a (mon.0) 13953 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:00:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:00 smithi179 bash[23186]: cluster 2024-09-21T05:00:00.000150+0000 mon.a (mon.0) 13953 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:00:01.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:01 smithi049 bash[23528]: cluster 2024-09-21T04:59:59.695163+0000 mgr.a (mgr.14388) 17554 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:01.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:01 smithi049 bash[23528]: audit 2024-09-21T05:00:00.365941+0000 mgr.a (mgr.14388) 17555 : audit [DBG] from='client.377946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:01.818 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:01 smithi179 bash[23186]: cluster 2024-09-21T04:59:59.695163+0000 mgr.a (mgr.14388) 17554 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:01.818 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:01 smithi179 bash[23186]: audit 2024-09-21T05:00:00.365941+0000 mgr.a (mgr.14388) 17555 : audit [DBG] from='client.377946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:01 smithi044 bash[22676]: cluster 2024-09-21T04:59:59.695163+0000 mgr.a (mgr.14388) 17554 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:01 smithi044 bash[22676]: audit 2024-09-21T05:00:00.365941+0000 mgr.a (mgr.14388) 17555 : audit [DBG] from='client.377946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:03 smithi179 bash[23186]: cluster 2024-09-21T05:00:01.698329+0000 mgr.a (mgr.14388) 17556 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:03 smithi049 bash[23528]: cluster 2024-09-21T05:00:01.698329+0000 mgr.a (mgr.14388) 17556 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:03 smithi044 bash[22676]: cluster 2024-09-21T05:00:01.698329+0000 mgr.a (mgr.14388) 17556 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:05 smithi049 bash[23528]: cluster 2024-09-21T05:00:03.699305+0000 mgr.a (mgr.14388) 17557 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:05 smithi049 bash[23528]: audit 2024-09-21T05:00:05.084952+0000 mon.a (mon.0) 13954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:05 smithi049 bash[23528]: audit 2024-09-21T05:00:05.092515+0000 mon.a (mon.0) 13955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:05 smithi049 bash[23528]: audit 2024-09-21T05:00:05.103510+0000 mon.a (mon.0) 13956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:05 smithi044 bash[22676]: cluster 2024-09-21T05:00:03.699305+0000 mgr.a (mgr.14388) 17557 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:05 smithi044 bash[22676]: audit 2024-09-21T05:00:05.084952+0000 mon.a (mon.0) 13954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:05 smithi044 bash[22676]: audit 2024-09-21T05:00:05.092515+0000 mon.a (mon.0) 13955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:05 smithi044 bash[22676]: audit 2024-09-21T05:00:05.103510+0000 mon.a (mon.0) 13956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:05 smithi179 bash[23186]: cluster 2024-09-21T05:00:03.699305+0000 mgr.a (mgr.14388) 17557 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:05 smithi179 bash[23186]: audit 2024-09-21T05:00:05.084952+0000 mon.a (mon.0) 13954 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:05 smithi179 bash[23186]: audit 2024-09-21T05:00:05.092515+0000 mon.a (mon.0) 13955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:05 smithi179 bash[23186]: audit 2024-09-21T05:00:05.103510+0000 mon.a (mon.0) 13956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:06.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:06.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:06.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:06.572 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:06.985 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:06 smithi049 bash[23528]: audit 2024-09-21T05:00:05.639274+0000 mon.a (mon.0) 13957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.985 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:06 smithi049 bash[23528]: audit 2024-09-21T05:00:05.649072+0000 mon.a (mon.0) 13958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.986 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:06 smithi049 bash[23528]: audit 2024-09-21T05:00:05.660489+0000 mon.a (mon.0) 13959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:06 smithi044 bash[22676]: audit 2024-09-21T05:00:05.639274+0000 mon.a (mon.0) 13957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:06 smithi044 bash[22676]: audit 2024-09-21T05:00:05.649072+0000 mon.a (mon.0) 13958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:06.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:06 smithi044 bash[22676]: audit 2024-09-21T05:00:05.660489+0000 mon.a (mon.0) 13959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:06 smithi179 bash[23186]: audit 2024-09-21T05:00:05.639274+0000 mon.a (mon.0) 13957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:06 smithi179 bash[23186]: audit 2024-09-21T05:00:05.649072+0000 mon.a (mon.0) 13958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:07.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:06 smithi179 bash[23186]: audit 2024-09-21T05:00:05.660489+0000 mon.a (mon.0) 13959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:07 smithi044 bash[22676]: cluster 2024-09-21T05:00:05.701407+0000 mgr.a (mgr.14388) 17558 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:07 smithi044 bash[22676]: audit 2024-09-21T05:00:06.152097+0000 mgr.a (mgr.14388) 17559 : audit [DBG] from='client.378024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:07 smithi179 bash[23186]: cluster 2024-09-21T05:00:05.701407+0000 mgr.a (mgr.14388) 17558 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:07 smithi179 bash[23186]: audit 2024-09-21T05:00:06.152097+0000 mgr.a (mgr.14388) 17559 : audit [DBG] from='client.378024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:07 smithi049 bash[23528]: cluster 2024-09-21T05:00:05.701407+0000 mgr.a (mgr.14388) 17558 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:07 smithi049 bash[23528]: audit 2024-09-21T05:00:06.152097+0000 mgr.a (mgr.14388) 17559 : audit [DBG] from='client.378024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:09 smithi044 bash[22676]: cluster 2024-09-21T05:00:07.702377+0000 mgr.a (mgr.14388) 17560 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:09 smithi179 bash[23186]: cluster 2024-09-21T05:00:07.702377+0000 mgr.a (mgr.14388) 17560 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:09 smithi049 bash[23528]: cluster 2024-09-21T05:00:07.702377+0000 mgr.a (mgr.14388) 17560 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:11.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:11.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:11.574 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:11.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:11 smithi044 bash[22676]: cluster 2024-09-21T05:00:09.703184+0000 mgr.a (mgr.14388) 17561 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:11 smithi179 bash[23186]: cluster 2024-09-21T05:00:09.703184+0000 mgr.a (mgr.14388) 17561 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:11 smithi049 bash[23528]: cluster 2024-09-21T05:00:09.703184+0000 mgr.a (mgr.14388) 17561 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:12.352 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:13 smithi044 bash[22676]: cluster 2024-09-21T05:00:11.704299+0000 mgr.a (mgr.14388) 17562 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:13 smithi044 bash[22676]: audit 2024-09-21T05:00:11.917073+0000 mgr.a (mgr.14388) 17563 : audit [DBG] from='client.378102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:13 smithi179 bash[23186]: cluster 2024-09-21T05:00:11.704299+0000 mgr.a (mgr.14388) 17562 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:13 smithi179 bash[23186]: audit 2024-09-21T05:00:11.917073+0000 mgr.a (mgr.14388) 17563 : audit [DBG] from='client.378102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:13 smithi049 bash[23528]: cluster 2024-09-21T05:00:11.704299+0000 mgr.a (mgr.14388) 17562 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:13 smithi049 bash[23528]: audit 2024-09-21T05:00:11.917073+0000 mgr.a (mgr.14388) 17563 : audit [DBG] from='client.378102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:15 smithi044 bash[22676]: cluster 2024-09-21T05:00:13.704932+0000 mgr.a (mgr.14388) 17564 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:15 smithi179 bash[23186]: cluster 2024-09-21T05:00:13.704932+0000 mgr.a (mgr.14388) 17564 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:15 smithi049 bash[23528]: cluster 2024-09-21T05:00:13.704932+0000 mgr.a (mgr.14388) 17564 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:16 smithi044 bash[22676]: cluster 2024-09-21T05:00:15.707831+0000 mgr.a (mgr.14388) 17565 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:16 smithi044 bash[22676]: audit 2024-09-21T05:00:15.725981+0000 mon.a (mon.0) 13960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:16 smithi044 bash[22676]: audit 2024-09-21T05:00:15.734665+0000 mon.a (mon.0) 13961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:16.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:16 smithi044 bash[22676]: audit 2024-09-21T05:00:15.745215+0000 mon.a (mon.0) 13962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:16 smithi179 bash[23186]: cluster 2024-09-21T05:00:15.707831+0000 mgr.a (mgr.14388) 17565 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:16 smithi179 bash[23186]: audit 2024-09-21T05:00:15.725981+0000 mon.a (mon.0) 13960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:16 smithi179 bash[23186]: audit 2024-09-21T05:00:15.734665+0000 mon.a (mon.0) 13961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:16 smithi179 bash[23186]: audit 2024-09-21T05:00:15.745215+0000 mon.a (mon.0) 13962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:16 smithi049 bash[23528]: cluster 2024-09-21T05:00:15.707831+0000 mgr.a (mgr.14388) 17565 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:16 smithi049 bash[23528]: audit 2024-09-21T05:00:15.725981+0000 mon.a (mon.0) 13960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:16 smithi049 bash[23528]: audit 2024-09-21T05:00:15.734665+0000 mon.a (mon.0) 13961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:16 smithi049 bash[23528]: audit 2024-09-21T05:00:15.745215+0000 mon.a (mon.0) 13962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:17.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:17.358 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:17.358 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:18.144 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:18.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:18 smithi044 bash[22676]: audit 2024-09-21T05:00:17.686579+0000 mgr.a (mgr.14388) 17566 : audit [DBG] from='client.378180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:18 smithi044 bash[22676]: cluster 2024-09-21T05:00:17.708545+0000 mgr.a (mgr.14388) 17567 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:19.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:18 smithi179 bash[23186]: audit 2024-09-21T05:00:17.686579+0000 mgr.a (mgr.14388) 17566 : audit [DBG] from='client.378180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:19.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:18 smithi179 bash[23186]: cluster 2024-09-21T05:00:17.708545+0000 mgr.a (mgr.14388) 17567 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:18 smithi049 bash[23528]: audit 2024-09-21T05:00:17.686579+0000 mgr.a (mgr.14388) 17566 : audit [DBG] from='client.378180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:18 smithi049 bash[23528]: cluster 2024-09-21T05:00:17.708545+0000 mgr.a (mgr.14388) 17567 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:20.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:20 smithi044 bash[22676]: cluster 2024-09-21T05:00:19.709541+0000 mgr.a (mgr.14388) 17568 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:20 smithi179 bash[23186]: cluster 2024-09-21T05:00:19.709541+0000 mgr.a (mgr.14388) 17568 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:20 smithi049 bash[23528]: cluster 2024-09-21T05:00:19.709541+0000 mgr.a (mgr.14388) 17568 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:22 smithi179 bash[23186]: cluster 2024-09-21T05:00:21.711749+0000 mgr.a (mgr.14388) 17569 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:23.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:22 smithi049 bash[23528]: cluster 2024-09-21T05:00:21.711749+0000 mgr.a (mgr.14388) 17569 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:23.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:23.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:23.147 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:22 smithi044 bash[22676]: cluster 2024-09-21T05:00:21.711749+0000 mgr.a (mgr.14388) 17569 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:23.917 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:23 smithi179 bash[23186]: audit 2024-09-21T05:00:23.478925+0000 mgr.a (mgr.14388) 17570 : audit [DBG] from='client.378255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:23 smithi049 bash[23528]: audit 2024-09-21T05:00:23.478925+0000 mgr.a (mgr.14388) 17570 : audit [DBG] from='client.378255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:23 smithi044 bash[22676]: audit 2024-09-21T05:00:23.478925+0000 mgr.a (mgr.14388) 17570 : audit [DBG] from='client.378255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:24 smithi179 bash[23186]: cluster 2024-09-21T05:00:23.712266+0000 mgr.a (mgr.14388) 17571 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:24 smithi049 bash[23528]: cluster 2024-09-21T05:00:23.712266+0000 mgr.a (mgr.14388) 17571 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:24 smithi044 bash[22676]: cluster 2024-09-21T05:00:23.712266+0000 mgr.a (mgr.14388) 17571 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:26 smithi044 bash[22676]: audit 2024-09-21T05:00:25.324447+0000 mon.a (mon.0) 13963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:26 smithi044 bash[22676]: audit 2024-09-21T05:00:25.329959+0000 mon.a (mon.0) 13964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:26 smithi044 bash[22676]: audit 2024-09-21T05:00:25.339201+0000 mon.a (mon.0) 13965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:26 smithi044 bash[22676]: audit 2024-09-21T05:00:25.872228+0000 mon.a (mon.0) 13966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:26 smithi044 bash[22676]: audit 2024-09-21T05:00:25.880680+0000 mon.a (mon.0) 13967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:26 smithi044 bash[22676]: audit 2024-09-21T05:00:25.890831+0000 mon.a (mon.0) 13968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:26 smithi179 bash[23186]: audit 2024-09-21T05:00:25.324447+0000 mon.a (mon.0) 13963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:26 smithi179 bash[23186]: audit 2024-09-21T05:00:25.329959+0000 mon.a (mon.0) 13964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:26 smithi179 bash[23186]: audit 2024-09-21T05:00:25.339201+0000 mon.a (mon.0) 13965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:26 smithi179 bash[23186]: audit 2024-09-21T05:00:25.872228+0000 mon.a (mon.0) 13966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:26 smithi179 bash[23186]: audit 2024-09-21T05:00:25.880680+0000 mon.a (mon.0) 13967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:26 smithi179 bash[23186]: audit 2024-09-21T05:00:25.890831+0000 mon.a (mon.0) 13968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:26 smithi049 bash[23528]: audit 2024-09-21T05:00:25.324447+0000 mon.a (mon.0) 13963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:26 smithi049 bash[23528]: audit 2024-09-21T05:00:25.329959+0000 mon.a (mon.0) 13964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:26 smithi049 bash[23528]: audit 2024-09-21T05:00:25.339201+0000 mon.a (mon.0) 13965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:26 smithi049 bash[23528]: audit 2024-09-21T05:00:25.872228+0000 mon.a (mon.0) 13966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:26 smithi049 bash[23528]: audit 2024-09-21T05:00:25.880680+0000 mon.a (mon.0) 13967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:26.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:26 smithi049 bash[23528]: audit 2024-09-21T05:00:25.890831+0000 mon.a (mon.0) 13968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:27.620 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:27 smithi049 bash[23528]: cluster 2024-09-21T05:00:25.714578+0000 mgr.a (mgr.14388) 17572 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:27.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:27 smithi044 bash[22676]: cluster 2024-09-21T05:00:25.714578+0000 mgr.a (mgr.14388) 17572 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:27 smithi179 bash[23186]: cluster 2024-09-21T05:00:25.714578+0000 mgr.a (mgr.14388) 17572 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:28 smithi044 bash[22676]: audit 2024-09-21T05:00:27.962175+0000 mon.a (mon.0) 13969 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:28 smithi044 bash[22676]: audit 2024-09-21T05:00:27.969162+0000 mon.a (mon.0) 13970 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:28 smithi044 bash[22676]: audit 2024-09-21T05:00:27.971237+0000 mon.a (mon.0) 13971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:28 smithi044 bash[22676]: audit 2024-09-21T05:00:27.982702+0000 mon.a (mon.0) 13972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:28.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:28 smithi044 bash[22676]: audit 2024-09-21T05:00:27.988911+0000 mon.a (mon.0) 13973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:00:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:28 smithi179 bash[23186]: audit 2024-09-21T05:00:27.962175+0000 mon.a (mon.0) 13969 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:28 smithi179 bash[23186]: audit 2024-09-21T05:00:27.969162+0000 mon.a (mon.0) 13970 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:28 smithi179 bash[23186]: audit 2024-09-21T05:00:27.971237+0000 mon.a (mon.0) 13971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:28 smithi179 bash[23186]: audit 2024-09-21T05:00:27.982702+0000 mon.a (mon.0) 13972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:28.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:28 smithi179 bash[23186]: audit 2024-09-21T05:00:27.988911+0000 mon.a (mon.0) 13973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:00:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:28 smithi049 bash[23528]: audit 2024-09-21T05:00:27.962175+0000 mon.a (mon.0) 13969 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:28 smithi049 bash[23528]: audit 2024-09-21T05:00:27.969162+0000 mon.a (mon.0) 13970 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:28 smithi049 bash[23528]: audit 2024-09-21T05:00:27.971237+0000 mon.a (mon.0) 13971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:28 smithi049 bash[23528]: audit 2024-09-21T05:00:27.982702+0000 mon.a (mon.0) 13972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:28 smithi049 bash[23528]: audit 2024-09-21T05:00:27.988911+0000 mon.a (mon.0) 13973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:00:28.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:28.920 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:28.920 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:29.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:00:28 smithi044 bash[22930]: debug 2024-09-21T05:00:28.793+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:00:29.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:00:28 smithi044 bash[22930]: debug 2024-09-21T05:00:28.793+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:00:29.670 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:29.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:29 smithi044 bash[22676]: cluster 2024-09-21T05:00:27.715373+0000 mgr.a (mgr.14388) 17573 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:29 smithi044 bash[22676]: audit 2024-09-21T05:00:27.991210+0000 mgr.a (mgr.14388) 17574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:00:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:29 smithi179 bash[23186]: cluster 2024-09-21T05:00:27.715373+0000 mgr.a (mgr.14388) 17573 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:29 smithi179 bash[23186]: audit 2024-09-21T05:00:27.991210+0000 mgr.a (mgr.14388) 17574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:00:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:29 smithi049 bash[23528]: cluster 2024-09-21T05:00:27.715373+0000 mgr.a (mgr.14388) 17573 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:29.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:29 smithi049 bash[23528]: audit 2024-09-21T05:00:27.991210+0000 mgr.a (mgr.14388) 17574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:00:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:30 smithi044 bash[22676]: audit 2024-09-21T05:00:28.793350+0000 mgr.a (mgr.14388) 17575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:00:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:30 smithi044 bash[22676]: cephadm 2024-09-21T05:00:28.794738+0000 mgr.a (mgr.14388) 17576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:00:30.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:30 smithi044 bash[22676]: audit 2024-09-21T05:00:29.243452+0000 mgr.a (mgr.14388) 17577 : audit [DBG] from='client.378441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:30 smithi179 bash[23186]: audit 2024-09-21T05:00:28.793350+0000 mgr.a (mgr.14388) 17575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:00:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:30 smithi179 bash[23186]: cephadm 2024-09-21T05:00:28.794738+0000 mgr.a (mgr.14388) 17576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:00:30.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:30 smithi179 bash[23186]: audit 2024-09-21T05:00:29.243452+0000 mgr.a (mgr.14388) 17577 : audit [DBG] from='client.378441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:30 smithi049 bash[23528]: audit 2024-09-21T05:00:28.793350+0000 mgr.a (mgr.14388) 17575 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:00:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:30 smithi049 bash[23528]: cephadm 2024-09-21T05:00:28.794738+0000 mgr.a (mgr.14388) 17576 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:00:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:30 smithi049 bash[23528]: audit 2024-09-21T05:00:29.243452+0000 mgr.a (mgr.14388) 17577 : audit [DBG] from='client.378441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:31.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:31 smithi179 bash[23186]: cluster 2024-09-21T05:00:29.715932+0000 mgr.a (mgr.14388) 17578 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:31.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:31 smithi044 bash[22676]: cluster 2024-09-21T05:00:29.715932+0000 mgr.a (mgr.14388) 17578 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:31 smithi049 bash[23528]: cluster 2024-09-21T05:00:29.715932+0000 mgr.a (mgr.14388) 17578 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:33.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:33 smithi044 bash[22676]: cluster 2024-09-21T05:00:31.718221+0000 mgr.a (mgr.14388) 17579 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:33 smithi179 bash[23186]: cluster 2024-09-21T05:00:31.718221+0000 mgr.a (mgr.14388) 17579 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:33 smithi049 bash[23528]: cluster 2024-09-21T05:00:31.718221+0000 mgr.a (mgr.14388) 17579 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:34.672 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:34.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:34.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:35.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:35.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:35.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:35.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:35 smithi044 bash[22676]: cluster 2024-09-21T05:00:33.719029+0000 mgr.a (mgr.14388) 17580 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:35 smithi179 bash[23186]: cluster 2024-09-21T05:00:33.719029+0000 mgr.a (mgr.14388) 17580 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:35 smithi049 bash[23528]: cluster 2024-09-21T05:00:33.719029+0000 mgr.a (mgr.14388) 17580 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:36 smithi044 bash[22676]: audit 2024-09-21T05:00:34.991101+0000 mgr.a (mgr.14388) 17581 : audit [DBG] from='client.378519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:36 smithi044 bash[22676]: audit 2024-09-21T05:00:35.948162+0000 mon.a (mon.0) 13974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:36 smithi044 bash[22676]: audit 2024-09-21T05:00:35.956879+0000 mon.a (mon.0) 13975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:36 smithi044 bash[22676]: audit 2024-09-21T05:00:35.967454+0000 mon.a (mon.0) 13976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:36 smithi179 bash[23186]: audit 2024-09-21T05:00:34.991101+0000 mgr.a (mgr.14388) 17581 : audit [DBG] from='client.378519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:36 smithi179 bash[23186]: audit 2024-09-21T05:00:35.948162+0000 mon.a (mon.0) 13974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:36 smithi179 bash[23186]: audit 2024-09-21T05:00:35.956879+0000 mon.a (mon.0) 13975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:36 smithi179 bash[23186]: audit 2024-09-21T05:00:35.967454+0000 mon.a (mon.0) 13976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:36 smithi049 bash[23528]: audit 2024-09-21T05:00:34.991101+0000 mgr.a (mgr.14388) 17581 : audit [DBG] from='client.378519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:36 smithi049 bash[23528]: audit 2024-09-21T05:00:35.948162+0000 mon.a (mon.0) 13974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:36 smithi049 bash[23528]: audit 2024-09-21T05:00:35.956879+0000 mon.a (mon.0) 13975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:36 smithi049 bash[23528]: audit 2024-09-21T05:00:35.967454+0000 mon.a (mon.0) 13976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:37 smithi044 bash[22676]: cluster 2024-09-21T05:00:35.722053+0000 mgr.a (mgr.14388) 17582 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:37 smithi179 bash[23186]: cluster 2024-09-21T05:00:35.722053+0000 mgr.a (mgr.14388) 17582 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:37 smithi049 bash[23528]: cluster 2024-09-21T05:00:35.722053+0000 mgr.a (mgr.14388) 17582 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:39 smithi044 bash[22676]: cluster 2024-09-21T05:00:37.722833+0000 mgr.a (mgr.14388) 17583 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:00:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:39 smithi179 bash[23186]: cluster 2024-09-21T05:00:37.722833+0000 mgr.a (mgr.14388) 17583 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:00:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:39 smithi049 bash[23528]: cluster 2024-09-21T05:00:37.722833+0000 mgr.a (mgr.14388) 17583 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:00:40.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:40.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:40.437 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:41.209 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:41.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:41 smithi044 bash[22676]: cluster 2024-09-21T05:00:39.723602+0000 mgr.a (mgr.14388) 17584 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:00:41.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:41 smithi179 bash[23186]: cluster 2024-09-21T05:00:39.723602+0000 mgr.a (mgr.14388) 17584 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:00:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:41 smithi049 bash[23528]: cluster 2024-09-21T05:00:39.723602+0000 mgr.a (mgr.14388) 17584 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:00:42.437 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:42 smithi179 bash[23186]: audit 2024-09-21T05:00:40.768350+0000 mgr.a (mgr.14388) 17585 : audit [DBG] from='client.378597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:42 smithi044 bash[22676]: audit 2024-09-21T05:00:40.768350+0000 mgr.a (mgr.14388) 17585 : audit [DBG] from='client.378597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:42 smithi049 bash[23528]: audit 2024-09-21T05:00:40.768350+0000 mgr.a (mgr.14388) 17585 : audit [DBG] from='client.378597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:43 smithi044 bash[22676]: cluster 2024-09-21T05:00:41.726609+0000 mgr.a (mgr.14388) 17586 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:43 smithi179 bash[23186]: cluster 2024-09-21T05:00:41.726609+0000 mgr.a (mgr.14388) 17586 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:43 smithi049 bash[23528]: cluster 2024-09-21T05:00:41.726609+0000 mgr.a (mgr.14388) 17586 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:00:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:45 smithi044 bash[22676]: cluster 2024-09-21T05:00:43.727450+0000 mgr.a (mgr.14388) 17587 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:45 smithi179 bash[23186]: cluster 2024-09-21T05:00:43.727450+0000 mgr.a (mgr.14388) 17587 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:45.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:45 smithi049 bash[23528]: cluster 2024-09-21T05:00:43.727450+0000 mgr.a (mgr.14388) 17587 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:00:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:46 smithi049 bash[23528]: audit 2024-09-21T05:00:45.560749+0000 mon.a (mon.0) 13977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:46 smithi049 bash[23528]: audit 2024-09-21T05:00:45.570320+0000 mon.a (mon.0) 13978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:46 smithi049 bash[23528]: audit 2024-09-21T05:00:45.581506+0000 mon.a (mon.0) 13979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:46 smithi049 bash[23528]: audit 2024-09-21T05:00:46.094004+0000 mon.a (mon.0) 13980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:46 smithi049 bash[23528]: audit 2024-09-21T05:00:46.103782+0000 mon.a (mon.0) 13981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:46 smithi049 bash[23528]: audit 2024-09-21T05:00:46.115272+0000 mon.a (mon.0) 13982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:46 smithi044 bash[22676]: audit 2024-09-21T05:00:45.560749+0000 mon.a (mon.0) 13977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:46 smithi044 bash[22676]: audit 2024-09-21T05:00:45.570320+0000 mon.a (mon.0) 13978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:46 smithi044 bash[22676]: audit 2024-09-21T05:00:45.581506+0000 mon.a (mon.0) 13979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:46 smithi044 bash[22676]: audit 2024-09-21T05:00:46.094004+0000 mon.a (mon.0) 13980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:46 smithi044 bash[22676]: audit 2024-09-21T05:00:46.103782+0000 mon.a (mon.0) 13981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:46.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:46 smithi044 bash[22676]: audit 2024-09-21T05:00:46.115272+0000 mon.a (mon.0) 13982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:47.005 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:47.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:46 smithi179 bash[23186]: audit 2024-09-21T05:00:45.560749+0000 mon.a (mon.0) 13977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:46 smithi179 bash[23186]: audit 2024-09-21T05:00:45.570320+0000 mon.a (mon.0) 13978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:46 smithi179 bash[23186]: audit 2024-09-21T05:00:45.581506+0000 mon.a (mon.0) 13979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:46 smithi179 bash[23186]: audit 2024-09-21T05:00:46.094004+0000 mon.a (mon.0) 13980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:46 smithi179 bash[23186]: audit 2024-09-21T05:00:46.103782+0000 mon.a (mon.0) 13981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:47.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:46 smithi179 bash[23186]: audit 2024-09-21T05:00:46.115272+0000 mon.a (mon.0) 13982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:47.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:47 smithi049 bash[23528]: cluster 2024-09-21T05:00:45.729552+0000 mgr.a (mgr.14388) 17588 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:47.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:47 smithi049 bash[23528]: audit 2024-09-21T05:00:46.544981+0000 mgr.a (mgr.14388) 17589 : audit [DBG] from='client.378669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:47 smithi044 bash[22676]: cluster 2024-09-21T05:00:45.729552+0000 mgr.a (mgr.14388) 17588 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:47 smithi044 bash[22676]: audit 2024-09-21T05:00:46.544981+0000 mgr.a (mgr.14388) 17589 : audit [DBG] from='client.378669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:48.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:47 smithi179 bash[23186]: cluster 2024-09-21T05:00:45.729552+0000 mgr.a (mgr.14388) 17588 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:48.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:47 smithi179 bash[23186]: audit 2024-09-21T05:00:46.544981+0000 mgr.a (mgr.14388) 17589 : audit [DBG] from='client.378669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:49 smithi044 bash[22676]: cluster 2024-09-21T05:00:47.730741+0000 mgr.a (mgr.14388) 17590 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:49 smithi179 bash[23186]: cluster 2024-09-21T05:00:47.730741+0000 mgr.a (mgr.14388) 17590 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:49 smithi049 bash[23528]: cluster 2024-09-21T05:00:47.730741+0000 mgr.a (mgr.14388) 17590 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:51 smithi044 bash[22676]: cluster 2024-09-21T05:00:49.731736+0000 mgr.a (mgr.14388) 17591 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:51 smithi179 bash[23186]: cluster 2024-09-21T05:00:49.731736+0000 mgr.a (mgr.14388) 17591 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:52.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:52.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:52.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:51 smithi049 bash[23528]: cluster 2024-09-21T05:00:49.731736+0000 mgr.a (mgr.14388) 17591 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:52.781 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:52.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:52.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:52.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:52.781 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:53 smithi044 bash[22676]: cluster 2024-09-21T05:00:51.734076+0000 mgr.a (mgr.14388) 17592 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:53 smithi044 bash[22676]: audit 2024-09-21T05:00:52.337914+0000 mgr.a (mgr.14388) 17593 : audit [DBG] from='client.378744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:53 smithi179 bash[23186]: cluster 2024-09-21T05:00:51.734076+0000 mgr.a (mgr.14388) 17592 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:53 smithi179 bash[23186]: audit 2024-09-21T05:00:52.337914+0000 mgr.a (mgr.14388) 17593 : audit [DBG] from='client.378744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:53 smithi049 bash[23528]: cluster 2024-09-21T05:00:51.734076+0000 mgr.a (mgr.14388) 17592 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:53 smithi049 bash[23528]: audit 2024-09-21T05:00:52.337914+0000 mgr.a (mgr.14388) 17593 : audit [DBG] from='client.378744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:55.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:55 smithi044 bash[22676]: cluster 2024-09-21T05:00:53.735000+0000 mgr.a (mgr.14388) 17594 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:55 smithi179 bash[23186]: cluster 2024-09-21T05:00:53.735000+0000 mgr.a (mgr.14388) 17594 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:55 smithi049 bash[23528]: cluster 2024-09-21T05:00:53.735000+0000 mgr.a (mgr.14388) 17594 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:57 smithi044 bash[22676]: cluster 2024-09-21T05:00:55.737166+0000 mgr.a (mgr.14388) 17595 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:57 smithi044 bash[22676]: audit 2024-09-21T05:00:56.179884+0000 mon.a (mon.0) 13983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:57 smithi044 bash[22676]: audit 2024-09-21T05:00:56.188613+0000 mon.a (mon.0) 13984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:57 smithi044 bash[22676]: audit 2024-09-21T05:00:56.198946+0000 mon.a (mon.0) 13985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:57 smithi179 bash[23186]: cluster 2024-09-21T05:00:55.737166+0000 mgr.a (mgr.14388) 17595 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:57 smithi179 bash[23186]: audit 2024-09-21T05:00:56.179884+0000 mon.a (mon.0) 13983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:57 smithi179 bash[23186]: audit 2024-09-21T05:00:56.188613+0000 mon.a (mon.0) 13984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:57 smithi179 bash[23186]: audit 2024-09-21T05:00:56.198946+0000 mon.a (mon.0) 13985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:57 smithi049 bash[23528]: cluster 2024-09-21T05:00:55.737166+0000 mgr.a (mgr.14388) 17595 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:00:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:57 smithi049 bash[23528]: audit 2024-09-21T05:00:56.179884+0000 mon.a (mon.0) 13983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:57 smithi049 bash[23528]: audit 2024-09-21T05:00:56.188613+0000 mon.a (mon.0) 13984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:57 smithi049 bash[23528]: audit 2024-09-21T05:00:56.198946+0000 mon.a (mon.0) 13985 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:00:57.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:00:57.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:00:57.783 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:00:58.541 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:00:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:00:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:00:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:00:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:00:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:59 smithi044 bash[22676]: cluster 2024-09-21T05:00:57.738009+0000 mgr.a (mgr.14388) 17596 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:00:59 smithi044 bash[22676]: audit 2024-09-21T05:00:58.113781+0000 mgr.a (mgr.14388) 17597 : audit [DBG] from='client.378822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:59 smithi179 bash[23186]: cluster 2024-09-21T05:00:57.738009+0000 mgr.a (mgr.14388) 17596 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:00:59 smithi179 bash[23186]: audit 2024-09-21T05:00:58.113781+0000 mgr.a (mgr.14388) 17597 : audit [DBG] from='client.378822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:59 smithi049 bash[23528]: cluster 2024-09-21T05:00:57.738009+0000 mgr.a (mgr.14388) 17596 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:00:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:00:59 smithi049 bash[23528]: audit 2024-09-21T05:00:58.113781+0000 mgr.a (mgr.14388) 17597 : audit [DBG] from='client.378822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:01 smithi044 bash[22676]: cluster 2024-09-21T05:00:59.738992+0000 mgr.a (mgr.14388) 17598 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:01 smithi179 bash[23186]: cluster 2024-09-21T05:00:59.738992+0000 mgr.a (mgr.14388) 17598 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:01 smithi049 bash[23528]: cluster 2024-09-21T05:00:59.738992+0000 mgr.a (mgr.14388) 17598 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:03.483 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:03 smithi179 bash[23186]: cluster 2024-09-21T05:01:01.741278+0000 mgr.a (mgr.14388) 17599 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:03 smithi044 bash[22676]: cluster 2024-09-21T05:01:01.741278+0000 mgr.a (mgr.14388) 17599 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:03.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:03.544 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:03.544 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:03 smithi049 bash[23528]: cluster 2024-09-21T05:01:01.741278+0000 mgr.a (mgr.14388) 17599 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:04.295 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:04.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:04.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:04.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:04.296 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:05.295 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:05 smithi049 bash[23528]: cluster 2024-09-21T05:01:03.742015+0000 mgr.a (mgr.14388) 17600 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:05.296 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:05 smithi049 bash[23528]: audit 2024-09-21T05:01:03.865404+0000 mgr.a (mgr.14388) 17601 : audit [DBG] from='client.378900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:05 smithi044 bash[22676]: cluster 2024-09-21T05:01:03.742015+0000 mgr.a (mgr.14388) 17600 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:05 smithi044 bash[22676]: audit 2024-09-21T05:01:03.865404+0000 mgr.a (mgr.14388) 17601 : audit [DBG] from='client.378900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:05 smithi179 bash[23186]: cluster 2024-09-21T05:01:03.742015+0000 mgr.a (mgr.14388) 17600 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:05.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:05 smithi179 bash[23186]: audit 2024-09-21T05:01:03.865404+0000 mgr.a (mgr.14388) 17601 : audit [DBG] from='client.378900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:06 smithi049 bash[23528]: cluster 2024-09-21T05:01:05.744361+0000 mgr.a (mgr.14388) 17602 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:06 smithi049 bash[23528]: audit 2024-09-21T05:01:05.789198+0000 mon.a (mon.0) 13986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:06 smithi049 bash[23528]: audit 2024-09-21T05:01:05.797109+0000 mon.a (mon.0) 13987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:06 smithi049 bash[23528]: audit 2024-09-21T05:01:05.807397+0000 mon.a (mon.0) 13988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:06 smithi049 bash[23528]: audit 2024-09-21T05:01:06.302752+0000 mon.a (mon.0) 13989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:06 smithi049 bash[23528]: audit 2024-09-21T05:01:06.311224+0000 mon.a (mon.0) 13990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:06 smithi049 bash[23528]: audit 2024-09-21T05:01:06.321190+0000 mon.a (mon.0) 13991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:06 smithi044 bash[22676]: cluster 2024-09-21T05:01:05.744361+0000 mgr.a (mgr.14388) 17602 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:06 smithi044 bash[22676]: audit 2024-09-21T05:01:05.789198+0000 mon.a (mon.0) 13986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:06 smithi044 bash[22676]: audit 2024-09-21T05:01:05.797109+0000 mon.a (mon.0) 13987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:06 smithi044 bash[22676]: audit 2024-09-21T05:01:05.807397+0000 mon.a (mon.0) 13988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:06 smithi044 bash[22676]: audit 2024-09-21T05:01:06.302752+0000 mon.a (mon.0) 13989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:06 smithi044 bash[22676]: audit 2024-09-21T05:01:06.311224+0000 mon.a (mon.0) 13990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:06 smithi044 bash[22676]: audit 2024-09-21T05:01:06.321190+0000 mon.a (mon.0) 13991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:06 smithi179 bash[23186]: cluster 2024-09-21T05:01:05.744361+0000 mgr.a (mgr.14388) 17602 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:06 smithi179 bash[23186]: audit 2024-09-21T05:01:05.789198+0000 mon.a (mon.0) 13986 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:06 smithi179 bash[23186]: audit 2024-09-21T05:01:05.797109+0000 mon.a (mon.0) 13987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:06 smithi179 bash[23186]: audit 2024-09-21T05:01:05.807397+0000 mon.a (mon.0) 13988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:06 smithi179 bash[23186]: audit 2024-09-21T05:01:06.302752+0000 mon.a (mon.0) 13989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:06 smithi179 bash[23186]: audit 2024-09-21T05:01:06.311224+0000 mon.a (mon.0) 13990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:07.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:06 smithi179 bash[23186]: audit 2024-09-21T05:01:06.321190+0000 mon.a (mon.0) 13991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:08 smithi049 bash[23528]: cluster 2024-09-21T05:01:07.745146+0000 mgr.a (mgr.14388) 17603 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:08 smithi044 bash[22676]: cluster 2024-09-21T05:01:07.745146+0000 mgr.a (mgr.14388) 17603 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:08 smithi179 bash[23186]: cluster 2024-09-21T05:01:07.745146+0000 mgr.a (mgr.14388) 17603 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:09.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:09.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:09.298 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:09 smithi049 bash[23528]: audit 2024-09-21T05:01:09.629781+0000 mgr.a (mgr.14388) 17604 : audit [DBG] from='client.378978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:10.088 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:10.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:10.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:10.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:10.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:09 smithi044 bash[22676]: audit 2024-09-21T05:01:09.629781+0000 mgr.a (mgr.14388) 17604 : audit [DBG] from='client.378978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:09 smithi179 bash[23186]: audit 2024-09-21T05:01:09.629781+0000 mgr.a (mgr.14388) 17604 : audit [DBG] from='client.378978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:10 smithi044 bash[22676]: cluster 2024-09-21T05:01:09.745649+0000 mgr.a (mgr.14388) 17605 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:10 smithi179 bash[23186]: cluster 2024-09-21T05:01:09.745649+0000 mgr.a (mgr.14388) 17605 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:10 smithi049 bash[23528]: cluster 2024-09-21T05:01:09.745649+0000 mgr.a (mgr.14388) 17605 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:12 smithi044 bash[22676]: cluster 2024-09-21T05:01:11.748514+0000 mgr.a (mgr.14388) 17606 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:01:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:12 smithi179 bash[23186]: cluster 2024-09-21T05:01:11.748514+0000 mgr.a (mgr.14388) 17606 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:01:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:12 smithi049 bash[23528]: cluster 2024-09-21T05:01:11.748514+0000 mgr.a (mgr.14388) 17606 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:01:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:14 smithi044 bash[22676]: cluster 2024-09-21T05:01:13.749035+0000 mgr.a (mgr.14388) 17607 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:01:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:15.091 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:14 smithi179 bash[23186]: cluster 2024-09-21T05:01:13.749035+0000 mgr.a (mgr.14388) 17607 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:01:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:14 smithi049 bash[23528]: cluster 2024-09-21T05:01:13.749035+0000 mgr.a (mgr.14388) 17607 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:01:15.902 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:15.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:16.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:15 smithi044 bash[22676]: audit 2024-09-21T05:01:15.422483+0000 mgr.a (mgr.14388) 17608 : audit [DBG] from='client.379053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:15 smithi179 bash[23186]: audit 2024-09-21T05:01:15.422483+0000 mgr.a (mgr.14388) 17608 : audit [DBG] from='client.379053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:15 smithi049 bash[23528]: audit 2024-09-21T05:01:15.422483+0000 mgr.a (mgr.14388) 17608 : audit [DBG] from='client.379053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:17 smithi044 bash[22676]: cluster 2024-09-21T05:01:15.750505+0000 mgr.a (mgr.14388) 17609 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:17 smithi044 bash[22676]: audit 2024-09-21T05:01:16.416285+0000 mon.a (mon.0) 13992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:17 smithi044 bash[22676]: audit 2024-09-21T05:01:16.426329+0000 mon.a (mon.0) 13993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:17 smithi044 bash[22676]: audit 2024-09-21T05:01:16.437777+0000 mon.a (mon.0) 13994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:17 smithi179 bash[23186]: cluster 2024-09-21T05:01:15.750505+0000 mgr.a (mgr.14388) 17609 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:17 smithi179 bash[23186]: audit 2024-09-21T05:01:16.416285+0000 mon.a (mon.0) 13992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:17 smithi179 bash[23186]: audit 2024-09-21T05:01:16.426329+0000 mon.a (mon.0) 13993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:17 smithi179 bash[23186]: audit 2024-09-21T05:01:16.437777+0000 mon.a (mon.0) 13994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:17 smithi049 bash[23528]: cluster 2024-09-21T05:01:15.750505+0000 mgr.a (mgr.14388) 17609 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:17 smithi049 bash[23528]: audit 2024-09-21T05:01:16.416285+0000 mon.a (mon.0) 13992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:17 smithi049 bash[23528]: audit 2024-09-21T05:01:16.426329+0000 mon.a (mon.0) 13993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:17 smithi049 bash[23528]: audit 2024-09-21T05:01:16.437777+0000 mon.a (mon.0) 13994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:19 smithi044 bash[22676]: cluster 2024-09-21T05:01:17.751389+0000 mgr.a (mgr.14388) 17610 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:01:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:19 smithi179 bash[23186]: cluster 2024-09-21T05:01:17.751389+0000 mgr.a (mgr.14388) 17610 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:01:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:19 smithi049 bash[23528]: cluster 2024-09-21T05:01:17.751389+0000 mgr.a (mgr.14388) 17610 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:01:20.904 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:20.905 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:21.693 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:21.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:21.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:21.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:21.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:21 smithi044 bash[22676]: cluster 2024-09-21T05:01:19.752190+0000 mgr.a (mgr.14388) 17611 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:01:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:21 smithi179 bash[23186]: cluster 2024-09-21T05:01:19.752190+0000 mgr.a (mgr.14388) 17611 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:01:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:21 smithi049 bash[23528]: cluster 2024-09-21T05:01:19.752190+0000 mgr.a (mgr.14388) 17611 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:01:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:22 smithi044 bash[22676]: audit 2024-09-21T05:01:21.240497+0000 mgr.a (mgr.14388) 17612 : audit [DBG] from='client.379131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:22 smithi179 bash[23186]: audit 2024-09-21T05:01:21.240497+0000 mgr.a (mgr.14388) 17612 : audit [DBG] from='client.379131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:22 smithi049 bash[23528]: audit 2024-09-21T05:01:21.240497+0000 mgr.a (mgr.14388) 17612 : audit [DBG] from='client.379131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:23.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:23 smithi044 bash[22676]: cluster 2024-09-21T05:01:21.753670+0000 mgr.a (mgr.14388) 17613 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:23 smithi179 bash[23186]: cluster 2024-09-21T05:01:21.753670+0000 mgr.a (mgr.14388) 17613 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:23 smithi049 bash[23528]: cluster 2024-09-21T05:01:21.753670+0000 mgr.a (mgr.14388) 17613 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:25.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:25 smithi044 bash[22676]: cluster 2024-09-21T05:01:23.754409+0000 mgr.a (mgr.14388) 17614 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:01:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:25 smithi179 bash[23186]: cluster 2024-09-21T05:01:23.754409+0000 mgr.a (mgr.14388) 17614 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:01:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:25 smithi049 bash[23528]: cluster 2024-09-21T05:01:23.754409+0000 mgr.a (mgr.14388) 17614 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:01:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:26.695 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:27 smithi049 bash[23528]: cluster 2024-09-21T05:01:25.756554+0000 mgr.a (mgr.14388) 17615 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:01:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:27 smithi049 bash[23528]: audit 2024-09-21T05:01:26.039155+0000 mon.a (mon.0) 13995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:27 smithi049 bash[23528]: audit 2024-09-21T05:01:26.047616+0000 mon.a (mon.0) 13996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:27 smithi049 bash[23528]: audit 2024-09-21T05:01:26.058209+0000 mon.a (mon.0) 13997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:27 smithi049 bash[23528]: audit 2024-09-21T05:01:26.529304+0000 mon.a (mon.0) 13998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:27 smithi049 bash[23528]: audit 2024-09-21T05:01:26.537775+0000 mon.a (mon.0) 13999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:27 smithi049 bash[23528]: audit 2024-09-21T05:01:26.548391+0000 mon.a (mon.0) 14000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.477 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:27 smithi044 bash[22676]: cluster 2024-09-21T05:01:25.756554+0000 mgr.a (mgr.14388) 17615 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:01:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:27 smithi044 bash[22676]: audit 2024-09-21T05:01:26.039155+0000 mon.a (mon.0) 13995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:27 smithi044 bash[22676]: audit 2024-09-21T05:01:26.047616+0000 mon.a (mon.0) 13996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:27 smithi044 bash[22676]: audit 2024-09-21T05:01:26.058209+0000 mon.a (mon.0) 13997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:27 smithi044 bash[22676]: audit 2024-09-21T05:01:26.529304+0000 mon.a (mon.0) 13998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:27 smithi044 bash[22676]: audit 2024-09-21T05:01:26.537775+0000 mon.a (mon.0) 13999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:27 smithi044 bash[22676]: audit 2024-09-21T05:01:26.548391+0000 mon.a (mon.0) 14000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:27 smithi179 bash[23186]: cluster 2024-09-21T05:01:25.756554+0000 mgr.a (mgr.14388) 17615 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:01:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:27 smithi179 bash[23186]: audit 2024-09-21T05:01:26.039155+0000 mon.a (mon.0) 13995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:27 smithi179 bash[23186]: audit 2024-09-21T05:01:26.047616+0000 mon.a (mon.0) 13996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:27 smithi179 bash[23186]: audit 2024-09-21T05:01:26.058209+0000 mon.a (mon.0) 13997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:27 smithi179 bash[23186]: audit 2024-09-21T05:01:26.529304+0000 mon.a (mon.0) 13998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:27 smithi179 bash[23186]: audit 2024-09-21T05:01:26.537775+0000 mon.a (mon.0) 13999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:27.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:27 smithi179 bash[23186]: audit 2024-09-21T05:01:26.548391+0000 mon.a (mon.0) 14000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:28.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:28 smithi049 bash[23528]: audit 2024-09-21T05:01:27.030260+0000 mgr.a (mgr.14388) 17616 : audit [DBG] from='client.379209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:28 smithi044 bash[22676]: audit 2024-09-21T05:01:27.030260+0000 mgr.a (mgr.14388) 17616 : audit [DBG] from='client.379209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:28 smithi179 bash[23186]: audit 2024-09-21T05:01:27.030260+0000 mgr.a (mgr.14388) 17616 : audit [DBG] from='client.379209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:29 smithi049 bash[23528]: cluster 2024-09-21T05:01:27.757612+0000 mgr.a (mgr.14388) 17617 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:29 smithi049 bash[23528]: audit 2024-09-21T05:01:28.857632+0000 mon.a (mon.0) 14001 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:01:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:29 smithi049 bash[23528]: audit 2024-09-21T05:01:28.864636+0000 mon.a (mon.0) 14002 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:01:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:29 smithi049 bash[23528]: audit 2024-09-21T05:01:28.866635+0000 mon.a (mon.0) 14003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:01:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:29 smithi049 bash[23528]: audit 2024-09-21T05:01:28.878188+0000 mon.a (mon.0) 14004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:29 smithi049 bash[23528]: audit 2024-09-21T05:01:28.884573+0000 mon.a (mon.0) 14005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:01:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22676]: cluster 2024-09-21T05:01:27.757612+0000 mgr.a (mgr.14388) 17617 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22676]: audit 2024-09-21T05:01:28.857632+0000 mon.a (mon.0) 14001 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:01:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22676]: audit 2024-09-21T05:01:28.864636+0000 mon.a (mon.0) 14002 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:01:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22676]: audit 2024-09-21T05:01:28.866635+0000 mon.a (mon.0) 14003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:01:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22676]: audit 2024-09-21T05:01:28.878188+0000 mon.a (mon.0) 14004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22676]: audit 2024-09-21T05:01:28.884573+0000 mon.a (mon.0) 14005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:01:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:29 smithi179 bash[23186]: cluster 2024-09-21T05:01:27.757612+0000 mgr.a (mgr.14388) 17617 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:29 smithi179 bash[23186]: audit 2024-09-21T05:01:28.857632+0000 mon.a (mon.0) 14001 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:01:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:29 smithi179 bash[23186]: audit 2024-09-21T05:01:28.864636+0000 mon.a (mon.0) 14002 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:01:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:29 smithi179 bash[23186]: audit 2024-09-21T05:01:28.866635+0000 mon.a (mon.0) 14003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:01:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:29 smithi179 bash[23186]: audit 2024-09-21T05:01:28.878188+0000 mon.a (mon.0) 14004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:29 smithi179 bash[23186]: audit 2024-09-21T05:01:28.884573+0000 mon.a (mon.0) 14005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:01:29.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22930]: debug 2024-09-21T05:01:29.644+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:01:29.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:01:29 smithi044 bash[22930]: debug 2024-09-21T05:01:29.644+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:01:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:30 smithi044 bash[22676]: audit 2024-09-21T05:01:28.887537+0000 mgr.a (mgr.14388) 17618 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:01:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:30 smithi044 bash[22676]: audit 2024-09-21T05:01:29.645448+0000 mgr.a (mgr.14388) 17619 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:01:30.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:30 smithi044 bash[22676]: cephadm 2024-09-21T05:01:29.646641+0000 mgr.a (mgr.14388) 17620 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:01:30.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:30 smithi179 bash[23186]: audit 2024-09-21T05:01:28.887537+0000 mgr.a (mgr.14388) 17618 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:01:30.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:30 smithi179 bash[23186]: audit 2024-09-21T05:01:29.645448+0000 mgr.a (mgr.14388) 17619 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:01:30.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:30 smithi179 bash[23186]: cephadm 2024-09-21T05:01:29.646641+0000 mgr.a (mgr.14388) 17620 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:01:30.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:30 smithi049 bash[23528]: audit 2024-09-21T05:01:28.887537+0000 mgr.a (mgr.14388) 17618 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:01:30.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:30 smithi049 bash[23528]: audit 2024-09-21T05:01:29.645448+0000 mgr.a (mgr.14388) 17619 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:01:30.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:30 smithi049 bash[23528]: cephadm 2024-09-21T05:01:29.646641+0000 mgr.a (mgr.14388) 17620 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:01:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:31 smithi044 bash[22676]: cluster 2024-09-21T05:01:29.758556+0000 mgr.a (mgr.14388) 17621 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:31 smithi179 bash[23186]: cluster 2024-09-21T05:01:29.758556+0000 mgr.a (mgr.14388) 17621 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:31 smithi049 bash[23528]: cluster 2024-09-21T05:01:29.758556+0000 mgr.a (mgr.14388) 17621 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:32.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:32.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:32.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:33.265 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:33.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:33.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:33.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:33.266 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:33.467 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:33 smithi179 bash[23186]: cluster 2024-09-21T05:01:31.760916+0000 mgr.a (mgr.14388) 17622 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:33 smithi044 bash[22676]: cluster 2024-09-21T05:01:31.760916+0000 mgr.a (mgr.14388) 17622 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:33 smithi049 bash[23528]: cluster 2024-09-21T05:01:31.760916+0000 mgr.a (mgr.14388) 17622 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:34.393 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:34 smithi044 bash[22676]: audit 2024-09-21T05:01:32.810004+0000 mgr.a (mgr.14388) 17623 : audit [DBG] from='client.379383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:34 smithi179 bash[23186]: audit 2024-09-21T05:01:32.810004+0000 mgr.a (mgr.14388) 17623 : audit [DBG] from='client.379383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:34.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:34 smithi049 bash[23528]: audit 2024-09-21T05:01:32.810004+0000 mgr.a (mgr.14388) 17623 : audit [DBG] from='client.379383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:35 smithi044 bash[22676]: cluster 2024-09-21T05:01:33.761899+0000 mgr.a (mgr.14388) 17624 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:35 smithi179 bash[23186]: cluster 2024-09-21T05:01:33.761899+0000 mgr.a (mgr.14388) 17624 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:35 smithi049 bash[23528]: cluster 2024-09-21T05:01:33.761899+0000 mgr.a (mgr.14388) 17624 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:37 smithi044 bash[22676]: cluster 2024-09-21T05:01:35.764257+0000 mgr.a (mgr.14388) 17625 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:37 smithi044 bash[22676]: audit 2024-09-21T05:01:36.655377+0000 mon.a (mon.0) 14006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:37 smithi044 bash[22676]: audit 2024-09-21T05:01:36.662848+0000 mon.a (mon.0) 14007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:37 smithi044 bash[22676]: audit 2024-09-21T05:01:36.669032+0000 mon.a (mon.0) 14008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:37 smithi179 bash[23186]: cluster 2024-09-21T05:01:35.764257+0000 mgr.a (mgr.14388) 17625 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:37 smithi179 bash[23186]: audit 2024-09-21T05:01:36.655377+0000 mon.a (mon.0) 14006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:37 smithi179 bash[23186]: audit 2024-09-21T05:01:36.662848+0000 mon.a (mon.0) 14007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:37 smithi179 bash[23186]: audit 2024-09-21T05:01:36.669032+0000 mon.a (mon.0) 14008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:37 smithi049 bash[23528]: cluster 2024-09-21T05:01:35.764257+0000 mgr.a (mgr.14388) 17625 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:37 smithi049 bash[23528]: audit 2024-09-21T05:01:36.655377+0000 mon.a (mon.0) 14006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:37 smithi049 bash[23528]: audit 2024-09-21T05:01:36.662848+0000 mon.a (mon.0) 14007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:37 smithi049 bash[23528]: audit 2024-09-21T05:01:36.669032+0000 mon.a (mon.0) 14008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:39.042 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:39.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:39.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:39.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:39.042 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:39 smithi044 bash[22676]: cluster 2024-09-21T05:01:37.765069+0000 mgr.a (mgr.14388) 17626 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:39 smithi044 bash[22676]: audit 2024-09-21T05:01:38.599723+0000 mgr.a (mgr.14388) 17627 : audit [DBG] from='client.379461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:39 smithi179 bash[23186]: cluster 2024-09-21T05:01:37.765069+0000 mgr.a (mgr.14388) 17626 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:39 smithi179 bash[23186]: audit 2024-09-21T05:01:38.599723+0000 mgr.a (mgr.14388) 17627 : audit [DBG] from='client.379461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:39 smithi049 bash[23528]: cluster 2024-09-21T05:01:37.765069+0000 mgr.a (mgr.14388) 17626 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:39 smithi049 bash[23528]: audit 2024-09-21T05:01:38.599723+0000 mgr.a (mgr.14388) 17627 : audit [DBG] from='client.379461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:41 smithi044 bash[22676]: cluster 2024-09-21T05:01:39.765976+0000 mgr.a (mgr.14388) 17628 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:41 smithi179 bash[23186]: cluster 2024-09-21T05:01:39.765976+0000 mgr.a (mgr.14388) 17628 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:41 smithi049 bash[23528]: cluster 2024-09-21T05:01:39.765976+0000 mgr.a (mgr.14388) 17628 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:43.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:43 smithi044 bash[22676]: cluster 2024-09-21T05:01:41.768281+0000 mgr.a (mgr.14388) 17629 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:43 smithi179 bash[23186]: cluster 2024-09-21T05:01:41.768281+0000 mgr.a (mgr.14388) 17629 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:44.043 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:44.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:44.044 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:43 smithi049 bash[23528]: cluster 2024-09-21T05:01:41.768281+0000 mgr.a (mgr.14388) 17629 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:01:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:44.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:44.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:44.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:44.839 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:45 smithi044 bash[22676]: cluster 2024-09-21T05:01:43.769063+0000 mgr.a (mgr.14388) 17630 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:45 smithi044 bash[22676]: audit 2024-09-21T05:01:44.380618+0000 mgr.a (mgr.14388) 17631 : audit [DBG] from='client.379536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:45 smithi179 bash[23186]: cluster 2024-09-21T05:01:43.769063+0000 mgr.a (mgr.14388) 17630 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:45 smithi179 bash[23186]: audit 2024-09-21T05:01:44.380618+0000 mgr.a (mgr.14388) 17631 : audit [DBG] from='client.379536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:45 smithi049 bash[23528]: cluster 2024-09-21T05:01:43.769063+0000 mgr.a (mgr.14388) 17630 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:45 smithi049 bash[23528]: audit 2024-09-21T05:01:44.380618+0000 mgr.a (mgr.14388) 17631 : audit [DBG] from='client.379536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:47 smithi049 bash[23528]: cluster 2024-09-21T05:01:45.771439+0000 mgr.a (mgr.14388) 17632 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:47 smithi049 bash[23528]: audit 2024-09-21T05:01:46.271158+0000 mon.a (mon.0) 14009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:47 smithi049 bash[23528]: audit 2024-09-21T05:01:46.279903+0000 mon.a (mon.0) 14010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:47 smithi049 bash[23528]: audit 2024-09-21T05:01:46.290854+0000 mon.a (mon.0) 14011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:47 smithi049 bash[23528]: audit 2024-09-21T05:01:46.718622+0000 mon.a (mon.0) 14012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:47 smithi049 bash[23528]: audit 2024-09-21T05:01:46.726888+0000 mon.a (mon.0) 14013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:47 smithi049 bash[23528]: audit 2024-09-21T05:01:46.736860+0000 mon.a (mon.0) 14014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:47 smithi044 bash[22676]: cluster 2024-09-21T05:01:45.771439+0000 mgr.a (mgr.14388) 17632 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:47 smithi044 bash[22676]: audit 2024-09-21T05:01:46.271158+0000 mon.a (mon.0) 14009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:47 smithi044 bash[22676]: audit 2024-09-21T05:01:46.279903+0000 mon.a (mon.0) 14010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:47 smithi044 bash[22676]: audit 2024-09-21T05:01:46.290854+0000 mon.a (mon.0) 14011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:47 smithi044 bash[22676]: audit 2024-09-21T05:01:46.718622+0000 mon.a (mon.0) 14012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:47 smithi044 bash[22676]: audit 2024-09-21T05:01:46.726888+0000 mon.a (mon.0) 14013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:47 smithi044 bash[22676]: audit 2024-09-21T05:01:46.736860+0000 mon.a (mon.0) 14014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:47 smithi179 bash[23186]: cluster 2024-09-21T05:01:45.771439+0000 mgr.a (mgr.14388) 17632 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:01:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:47 smithi179 bash[23186]: audit 2024-09-21T05:01:46.271158+0000 mon.a (mon.0) 14009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:47 smithi179 bash[23186]: audit 2024-09-21T05:01:46.279903+0000 mon.a (mon.0) 14010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:47 smithi179 bash[23186]: audit 2024-09-21T05:01:46.290854+0000 mon.a (mon.0) 14011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:47 smithi179 bash[23186]: audit 2024-09-21T05:01:46.718622+0000 mon.a (mon.0) 14012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:47 smithi179 bash[23186]: audit 2024-09-21T05:01:46.726888+0000 mon.a (mon.0) 14013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:47 smithi179 bash[23186]: audit 2024-09-21T05:01:46.736860+0000 mon.a (mon.0) 14014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:49 smithi049 bash[23528]: cluster 2024-09-21T05:01:47.772199+0000 mgr.a (mgr.14388) 17633 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:49.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:49 smithi044 bash[22676]: cluster 2024-09-21T05:01:47.772199+0000 mgr.a (mgr.14388) 17633 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:49 smithi179 bash[23186]: cluster 2024-09-21T05:01:47.772199+0000 mgr.a (mgr.14388) 17633 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:49.841 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:49.841 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:50.594 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:50.595 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:51 smithi049 bash[23528]: cluster 2024-09-21T05:01:49.772968+0000 mgr.a (mgr.14388) 17634 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:51 smithi049 bash[23528]: audit 2024-09-21T05:01:50.170884+0000 mgr.a (mgr.14388) 17635 : audit [DBG] from='client.379614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:51 smithi044 bash[22676]: cluster 2024-09-21T05:01:49.772968+0000 mgr.a (mgr.14388) 17634 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:51.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:51 smithi044 bash[22676]: audit 2024-09-21T05:01:50.170884+0000 mgr.a (mgr.14388) 17635 : audit [DBG] from='client.379614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:51 smithi179 bash[23186]: cluster 2024-09-21T05:01:49.772968+0000 mgr.a (mgr.14388) 17634 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:51 smithi179 bash[23186]: audit 2024-09-21T05:01:50.170884+0000 mgr.a (mgr.14388) 17635 : audit [DBG] from='client.379614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:53 smithi049 bash[23528]: cluster 2024-09-21T05:01:51.775860+0000 mgr.a (mgr.14388) 17636 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:53 smithi044 bash[22676]: cluster 2024-09-21T05:01:51.775860+0000 mgr.a (mgr.14388) 17636 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:53 smithi179 bash[23186]: cluster 2024-09-21T05:01:51.775860+0000 mgr.a (mgr.14388) 17636 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:55 smithi049 bash[23528]: cluster 2024-09-21T05:01:53.776676+0000 mgr.a (mgr.14388) 17637 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:01:55.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:01:55.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:01:55.597 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:01:55.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:55 smithi044 bash[22676]: cluster 2024-09-21T05:01:53.776676+0000 mgr.a (mgr.14388) 17637 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:01:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:55 smithi179 bash[23186]: cluster 2024-09-21T05:01:53.776676+0000 mgr.a (mgr.14388) 17637 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:01:56.391 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:01:56.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:01:56.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:01:56.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:01:56.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:01:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:57 smithi049 bash[23528]: cluster 2024-09-21T05:01:55.778651+0000 mgr.a (mgr.14388) 17638 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:57 smithi049 bash[23528]: audit 2024-09-21T05:01:55.937577+0000 mgr.a (mgr.14388) 17639 : audit [DBG] from='client.379692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:57 smithi049 bash[23528]: audit 2024-09-21T05:01:56.866023+0000 mon.a (mon.0) 14015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:57 smithi049 bash[23528]: audit 2024-09-21T05:01:56.871781+0000 mon.a (mon.0) 14016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:57 smithi049 bash[23528]: audit 2024-09-21T05:01:56.880644+0000 mon.a (mon.0) 14017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:57 smithi044 bash[22676]: cluster 2024-09-21T05:01:55.778651+0000 mgr.a (mgr.14388) 17638 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:57.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:57 smithi044 bash[22676]: audit 2024-09-21T05:01:55.937577+0000 mgr.a (mgr.14388) 17639 : audit [DBG] from='client.379692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:57.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:57 smithi044 bash[22676]: audit 2024-09-21T05:01:56.866023+0000 mon.a (mon.0) 14015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:57 smithi044 bash[22676]: audit 2024-09-21T05:01:56.871781+0000 mon.a (mon.0) 14016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:57 smithi044 bash[22676]: audit 2024-09-21T05:01:56.880644+0000 mon.a (mon.0) 14017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:57 smithi179 bash[23186]: cluster 2024-09-21T05:01:55.778651+0000 mgr.a (mgr.14388) 17638 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:01:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:57 smithi179 bash[23186]: audit 2024-09-21T05:01:55.937577+0000 mgr.a (mgr.14388) 17639 : audit [DBG] from='client.379692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:01:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:57 smithi179 bash[23186]: audit 2024-09-21T05:01:56.866023+0000 mon.a (mon.0) 14015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:57 smithi179 bash[23186]: audit 2024-09-21T05:01:56.871781+0000 mon.a (mon.0) 14016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:57 smithi179 bash[23186]: audit 2024-09-21T05:01:56.880644+0000 mon.a (mon.0) 14017 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:01:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:01:59 smithi049 bash[23528]: cluster 2024-09-21T05:01:57.779700+0000 mgr.a (mgr.14388) 17640 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:01:59.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:01:59 smithi044 bash[22676]: cluster 2024-09-21T05:01:57.779700+0000 mgr.a (mgr.14388) 17640 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:01:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:01:59 smithi179 bash[23186]: cluster 2024-09-21T05:01:57.779700+0000 mgr.a (mgr.14388) 17640 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:02:01.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:01.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:01.394 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:01 smithi049 bash[23528]: cluster 2024-09-21T05:01:59.780611+0000 mgr.a (mgr.14388) 17641 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:02:01.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:01 smithi044 bash[22676]: cluster 2024-09-21T05:01:59.780611+0000 mgr.a (mgr.14388) 17641 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:02:01.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:01 smithi179 bash[23186]: cluster 2024-09-21T05:01:59.780611+0000 mgr.a (mgr.14388) 17641 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:02:02.184 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:02.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:02.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:02.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:02.184 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:03 smithi044 bash[22676]: audit 2024-09-21T05:02:01.725829+0000 mgr.a (mgr.14388) 17642 : audit [DBG] from='client.379761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:03 smithi044 bash[22676]: cluster 2024-09-21T05:02:01.782411+0000 mgr.a (mgr.14388) 17643 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:03 smithi179 bash[23186]: audit 2024-09-21T05:02:01.725829+0000 mgr.a (mgr.14388) 17642 : audit [DBG] from='client.379761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:03 smithi179 bash[23186]: cluster 2024-09-21T05:02:01.782411+0000 mgr.a (mgr.14388) 17643 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:03 smithi049 bash[23528]: audit 2024-09-21T05:02:01.725829+0000 mgr.a (mgr.14388) 17642 : audit [DBG] from='client.379761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:03 smithi049 bash[23528]: cluster 2024-09-21T05:02:01.782411+0000 mgr.a (mgr.14388) 17643 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:05.699 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:05 smithi179 bash[23186]: cluster 2024-09-21T05:02:03.783305+0000 mgr.a (mgr.14388) 17644 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:05 smithi044 bash[22676]: cluster 2024-09-21T05:02:03.783305+0000 mgr.a (mgr.14388) 17644 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:05 smithi049 bash[23528]: cluster 2024-09-21T05:02:03.783305+0000 mgr.a (mgr.14388) 17644 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:07.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:07.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:07.186 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:07 smithi044 bash[22676]: cluster 2024-09-21T05:02:05.785550+0000 mgr.a (mgr.14388) 17645 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:07.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:07 smithi044 bash[22676]: audit 2024-09-21T05:02:06.470836+0000 mon.a (mon.0) 14018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:07 smithi044 bash[22676]: audit 2024-09-21T05:02:06.476374+0000 mon.a (mon.0) 14019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:07 smithi044 bash[22676]: audit 2024-09-21T05:02:06.484186+0000 mon.a (mon.0) 14020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:07 smithi044 bash[22676]: audit 2024-09-21T05:02:06.944668+0000 mon.a (mon.0) 14021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:07 smithi044 bash[22676]: audit 2024-09-21T05:02:06.967034+0000 mon.a (mon.0) 14022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:07 smithi044 bash[22676]: audit 2024-09-21T05:02:06.980375+0000 mon.a (mon.0) 14023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:07 smithi179 bash[23186]: cluster 2024-09-21T05:02:05.785550+0000 mgr.a (mgr.14388) 17645 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:07.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:07 smithi179 bash[23186]: audit 2024-09-21T05:02:06.470836+0000 mon.a (mon.0) 14018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:07 smithi179 bash[23186]: audit 2024-09-21T05:02:06.476374+0000 mon.a (mon.0) 14019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:07 smithi179 bash[23186]: audit 2024-09-21T05:02:06.484186+0000 mon.a (mon.0) 14020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:07 smithi179 bash[23186]: audit 2024-09-21T05:02:06.944668+0000 mon.a (mon.0) 14021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:07 smithi179 bash[23186]: audit 2024-09-21T05:02:06.967034+0000 mon.a (mon.0) 14022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:07 smithi179 bash[23186]: audit 2024-09-21T05:02:06.980375+0000 mon.a (mon.0) 14023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:07 smithi049 bash[23528]: cluster 2024-09-21T05:02:05.785550+0000 mgr.a (mgr.14388) 17645 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:07 smithi049 bash[23528]: audit 2024-09-21T05:02:06.470836+0000 mon.a (mon.0) 14018 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:07 smithi049 bash[23528]: audit 2024-09-21T05:02:06.476374+0000 mon.a (mon.0) 14019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:07 smithi049 bash[23528]: audit 2024-09-21T05:02:06.484186+0000 mon.a (mon.0) 14020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:07 smithi049 bash[23528]: audit 2024-09-21T05:02:06.944668+0000 mon.a (mon.0) 14021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:07 smithi049 bash[23528]: audit 2024-09-21T05:02:06.967034+0000 mon.a (mon.0) 14022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:07 smithi049 bash[23528]: audit 2024-09-21T05:02:06.980375+0000 mon.a (mon.0) 14023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:07.949 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:08 smithi044 bash[22676]: audit 2024-09-21T05:02:07.520022+0000 mgr.a (mgr.14388) 17646 : audit [DBG] from='client.379839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:08 smithi179 bash[23186]: audit 2024-09-21T05:02:07.520022+0000 mgr.a (mgr.14388) 17646 : audit [DBG] from='client.379839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:08 smithi049 bash[23528]: audit 2024-09-21T05:02:07.520022+0000 mgr.a (mgr.14388) 17646 : audit [DBG] from='client.379839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:09.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:09 smithi044 bash[22676]: cluster 2024-09-21T05:02:07.786074+0000 mgr.a (mgr.14388) 17647 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:09 smithi179 bash[23186]: cluster 2024-09-21T05:02:07.786074+0000 mgr.a (mgr.14388) 17647 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:09 smithi049 bash[23528]: cluster 2024-09-21T05:02:07.786074+0000 mgr.a (mgr.14388) 17647 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:11 smithi044 bash[22676]: cluster 2024-09-21T05:02:09.786961+0000 mgr.a (mgr.14388) 17648 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:11 smithi179 bash[23186]: cluster 2024-09-21T05:02:09.786961+0000 mgr.a (mgr.14388) 17648 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:11 smithi049 bash[23528]: cluster 2024-09-21T05:02:09.786961+0000 mgr.a (mgr.14388) 17648 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:12.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:12.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:12.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:13.725 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:13.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:13.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:13.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:13.726 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:13 smithi179 bash[23186]: cluster 2024-09-21T05:02:11.789218+0000 mgr.a (mgr.14388) 17649 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:13.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:13 smithi049 bash[23528]: cluster 2024-09-21T05:02:11.789218+0000 mgr.a (mgr.14388) 17649 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:13 smithi044 bash[22676]: cluster 2024-09-21T05:02:11.789218+0000 mgr.a (mgr.14388) 17649 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:14 smithi179 bash[23186]: audit 2024-09-21T05:02:13.276995+0000 mgr.a (mgr.14388) 17650 : audit [DBG] from='client.379917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:14.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:14 smithi044 bash[22676]: audit 2024-09-21T05:02:13.276995+0000 mgr.a (mgr.14388) 17650 : audit [DBG] from='client.379917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:14 smithi049 bash[23528]: audit 2024-09-21T05:02:13.276995+0000 mgr.a (mgr.14388) 17650 : audit [DBG] from='client.379917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:15 smithi179 bash[23186]: cluster 2024-09-21T05:02:13.789858+0000 mgr.a (mgr.14388) 17651 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:15 smithi049 bash[23528]: cluster 2024-09-21T05:02:13.789858+0000 mgr.a (mgr.14388) 17651 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:15 smithi044 bash[22676]: cluster 2024-09-21T05:02:13.789858+0000 mgr.a (mgr.14388) 17651 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:17 smithi044 bash[22676]: cluster 2024-09-21T05:02:15.792146+0000 mgr.a (mgr.14388) 17652 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:17 smithi044 bash[22676]: audit 2024-09-21T05:02:17.075286+0000 mon.a (mon.0) 14024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:17 smithi044 bash[22676]: audit 2024-09-21T05:02:17.080768+0000 mon.a (mon.0) 14025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:17 smithi044 bash[22676]: audit 2024-09-21T05:02:17.089686+0000 mon.a (mon.0) 14026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:17 smithi049 bash[23528]: cluster 2024-09-21T05:02:15.792146+0000 mgr.a (mgr.14388) 17652 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:17 smithi049 bash[23528]: audit 2024-09-21T05:02:17.075286+0000 mon.a (mon.0) 14024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:17 smithi049 bash[23528]: audit 2024-09-21T05:02:17.080768+0000 mon.a (mon.0) 14025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:17 smithi049 bash[23528]: audit 2024-09-21T05:02:17.089686+0000 mon.a (mon.0) 14026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:17 smithi179 bash[23186]: cluster 2024-09-21T05:02:15.792146+0000 mgr.a (mgr.14388) 17652 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:17 smithi179 bash[23186]: audit 2024-09-21T05:02:17.075286+0000 mon.a (mon.0) 14024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:17 smithi179 bash[23186]: audit 2024-09-21T05:02:17.080768+0000 mon.a (mon.0) 14025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:17 smithi179 bash[23186]: audit 2024-09-21T05:02:17.089686+0000 mon.a (mon.0) 14026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:18.727 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:18.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:18.728 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:19.517 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:19.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:19.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:19.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:19.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:19 smithi049 bash[23528]: cluster 2024-09-21T05:02:17.792904+0000 mgr.a (mgr.14388) 17653 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:19 smithi044 bash[22676]: cluster 2024-09-21T05:02:17.792904+0000 mgr.a (mgr.14388) 17653 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:19 smithi179 bash[23186]: cluster 2024-09-21T05:02:17.792904+0000 mgr.a (mgr.14388) 17653 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:20 smithi049 bash[23528]: audit 2024-09-21T05:02:19.061567+0000 mgr.a (mgr.14388) 17654 : audit [DBG] from='client.379995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:20.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:20 smithi044 bash[22676]: audit 2024-09-21T05:02:19.061567+0000 mgr.a (mgr.14388) 17654 : audit [DBG] from='client.379995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:20 smithi179 bash[23186]: audit 2024-09-21T05:02:19.061567+0000 mgr.a (mgr.14388) 17654 : audit [DBG] from='client.379995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:21 smithi049 bash[23528]: cluster 2024-09-21T05:02:19.793828+0000 mgr.a (mgr.14388) 17655 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:21.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:21 smithi044 bash[22676]: cluster 2024-09-21T05:02:19.793828+0000 mgr.a (mgr.14388) 17655 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:21 smithi179 bash[23186]: cluster 2024-09-21T05:02:19.793828+0000 mgr.a (mgr.14388) 17655 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:23.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:23 smithi179 bash[23186]: cluster 2024-09-21T05:02:21.796057+0000 mgr.a (mgr.14388) 17656 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:23 smithi049 bash[23528]: cluster 2024-09-21T05:02:21.796057+0000 mgr.a (mgr.14388) 17656 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:23 smithi044 bash[22676]: cluster 2024-09-21T05:02:21.796057+0000 mgr.a (mgr.14388) 17656 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:24.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:24.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:24.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:25.303 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:25.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:25.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:25.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:25.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:25 smithi049 bash[23528]: cluster 2024-09-21T05:02:23.796828+0000 mgr.a (mgr.14388) 17657 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:25 smithi044 bash[22676]: cluster 2024-09-21T05:02:23.796828+0000 mgr.a (mgr.14388) 17657 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:25 smithi179 bash[23186]: cluster 2024-09-21T05:02:23.796828+0000 mgr.a (mgr.14388) 17657 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:26 smithi049 bash[23528]: audit 2024-09-21T05:02:24.850757+0000 mgr.a (mgr.14388) 17658 : audit [DBG] from='client.380073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:26.914 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:26 smithi179 bash[23186]: audit 2024-09-21T05:02:24.850757+0000 mgr.a (mgr.14388) 17658 : audit [DBG] from='client.380073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:26.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:26 smithi044 bash[22676]: audit 2024-09-21T05:02:24.850757+0000 mgr.a (mgr.14388) 17658 : audit [DBG] from='client.380073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:27 smithi049 bash[23528]: cluster 2024-09-21T05:02:25.799695+0000 mgr.a (mgr.14388) 17659 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:27 smithi049 bash[23528]: audit 2024-09-21T05:02:26.700716+0000 mon.a (mon.0) 14027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:27 smithi049 bash[23528]: audit 2024-09-21T05:02:26.708876+0000 mon.a (mon.0) 14028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:27 smithi049 bash[23528]: audit 2024-09-21T05:02:26.720773+0000 mon.a (mon.0) 14029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:27 smithi049 bash[23528]: audit 2024-09-21T05:02:27.193113+0000 mon.a (mon.0) 14030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:27 smithi049 bash[23528]: audit 2024-09-21T05:02:27.202774+0000 mon.a (mon.0) 14031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:27 smithi049 bash[23528]: audit 2024-09-21T05:02:27.214423+0000 mon.a (mon.0) 14032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:27 smithi044 bash[22676]: cluster 2024-09-21T05:02:25.799695+0000 mgr.a (mgr.14388) 17659 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:27 smithi044 bash[22676]: audit 2024-09-21T05:02:26.700716+0000 mon.a (mon.0) 14027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:27 smithi044 bash[22676]: audit 2024-09-21T05:02:26.708876+0000 mon.a (mon.0) 14028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:27 smithi044 bash[22676]: audit 2024-09-21T05:02:26.720773+0000 mon.a (mon.0) 14029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:27 smithi044 bash[22676]: audit 2024-09-21T05:02:27.193113+0000 mon.a (mon.0) 14030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:27 smithi044 bash[22676]: audit 2024-09-21T05:02:27.202774+0000 mon.a (mon.0) 14031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:27.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:27 smithi044 bash[22676]: audit 2024-09-21T05:02:27.214423+0000 mon.a (mon.0) 14032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:27 smithi179 bash[23186]: cluster 2024-09-21T05:02:25.799695+0000 mgr.a (mgr.14388) 17659 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:27 smithi179 bash[23186]: audit 2024-09-21T05:02:26.700716+0000 mon.a (mon.0) 14027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:27 smithi179 bash[23186]: audit 2024-09-21T05:02:26.708876+0000 mon.a (mon.0) 14028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:27 smithi179 bash[23186]: audit 2024-09-21T05:02:26.720773+0000 mon.a (mon.0) 14029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:27 smithi179 bash[23186]: audit 2024-09-21T05:02:27.193113+0000 mon.a (mon.0) 14030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:27 smithi179 bash[23186]: audit 2024-09-21T05:02:27.202774+0000 mon.a (mon.0) 14031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:27 smithi179 bash[23186]: audit 2024-09-21T05:02:27.214423+0000 mon.a (mon.0) 14032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:29 smithi049 bash[23528]: cluster 2024-09-21T05:02:27.800454+0000 mgr.a (mgr.14388) 17660 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:02:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:29 smithi044 bash[22676]: cluster 2024-09-21T05:02:27.800454+0000 mgr.a (mgr.14388) 17660 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:02:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:29 smithi179 bash[23186]: cluster 2024-09-21T05:02:27.800454+0000 mgr.a (mgr.14388) 17660 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:02:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:30.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:30 smithi049 bash[23528]: audit 2024-09-21T05:02:29.698858+0000 mon.a (mon.0) 14033 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:02:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:30 smithi049 bash[23528]: audit 2024-09-21T05:02:29.709886+0000 mon.a (mon.0) 14034 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:30 smithi049 bash[23528]: audit 2024-09-21T05:02:29.711822+0000 mon.a (mon.0) 14035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:30 smithi049 bash[23528]: audit 2024-09-21T05:02:29.724614+0000 mon.a (mon.0) 14036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:30 smithi049 bash[23528]: audit 2024-09-21T05:02:29.731549+0000 mon.a (mon.0) 14037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:02:30.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:02:30 smithi044 bash[22930]: debug 2024-09-21T05:02:30.523+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:02:30.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:02:30 smithi044 bash[22930]: debug 2024-09-21T05:02:30.523+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:02:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:30 smithi044 bash[22676]: audit 2024-09-21T05:02:29.698858+0000 mon.a (mon.0) 14033 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:02:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:30 smithi044 bash[22676]: audit 2024-09-21T05:02:29.709886+0000 mon.a (mon.0) 14034 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:30 smithi044 bash[22676]: audit 2024-09-21T05:02:29.711822+0000 mon.a (mon.0) 14035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:30 smithi044 bash[22676]: audit 2024-09-21T05:02:29.724614+0000 mon.a (mon.0) 14036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:30 smithi044 bash[22676]: audit 2024-09-21T05:02:29.731549+0000 mon.a (mon.0) 14037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:02:31.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:30 smithi179 bash[23186]: audit 2024-09-21T05:02:29.698858+0000 mon.a (mon.0) 14033 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:02:31.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:30 smithi179 bash[23186]: audit 2024-09-21T05:02:29.709886+0000 mon.a (mon.0) 14034 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:31.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:30 smithi179 bash[23186]: audit 2024-09-21T05:02:29.711822+0000 mon.a (mon.0) 14035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:31.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:30 smithi179 bash[23186]: audit 2024-09-21T05:02:29.724614+0000 mon.a (mon.0) 14036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:31.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:30 smithi179 bash[23186]: audit 2024-09-21T05:02:29.731549+0000 mon.a (mon.0) 14037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:02:31.034 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:31.034 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:31 smithi044 bash[22676]: audit 2024-09-21T05:02:29.733983+0000 mgr.a (mgr.14388) 17661 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:02:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:31 smithi044 bash[22676]: cluster 2024-09-21T05:02:29.801572+0000 mgr.a (mgr.14388) 17662 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:02:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:31 smithi044 bash[22676]: audit 2024-09-21T05:02:30.525470+0000 mgr.a (mgr.14388) 17663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:02:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:31 smithi044 bash[22676]: cephadm 2024-09-21T05:02:30.526674+0000 mgr.a (mgr.14388) 17664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:02:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:31 smithi044 bash[22676]: audit 2024-09-21T05:02:30.620216+0000 mgr.a (mgr.14388) 17665 : audit [DBG] from='client.380256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:31 smithi179 bash[23186]: audit 2024-09-21T05:02:29.733983+0000 mgr.a (mgr.14388) 17661 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:02:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:31 smithi179 bash[23186]: cluster 2024-09-21T05:02:29.801572+0000 mgr.a (mgr.14388) 17662 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:02:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:31 smithi179 bash[23186]: audit 2024-09-21T05:02:30.525470+0000 mgr.a (mgr.14388) 17663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:02:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:31 smithi179 bash[23186]: cephadm 2024-09-21T05:02:30.526674+0000 mgr.a (mgr.14388) 17664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:02:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:31 smithi179 bash[23186]: audit 2024-09-21T05:02:30.620216+0000 mgr.a (mgr.14388) 17665 : audit [DBG] from='client.380256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:31 smithi049 bash[23528]: audit 2024-09-21T05:02:29.733983+0000 mgr.a (mgr.14388) 17661 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:02:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:31 smithi049 bash[23528]: cluster 2024-09-21T05:02:29.801572+0000 mgr.a (mgr.14388) 17662 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:02:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:31 smithi049 bash[23528]: audit 2024-09-21T05:02:30.525470+0000 mgr.a (mgr.14388) 17663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:02:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:31 smithi049 bash[23528]: cephadm 2024-09-21T05:02:30.526674+0000 mgr.a (mgr.14388) 17664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:02:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:31 smithi049 bash[23528]: audit 2024-09-21T05:02:30.620216+0000 mgr.a (mgr.14388) 17665 : audit [DBG] from='client.380256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:33 smithi044 bash[22676]: cluster 2024-09-21T05:02:31.804465+0000 mgr.a (mgr.14388) 17666 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:02:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:33 smithi179 bash[23186]: cluster 2024-09-21T05:02:31.804465+0000 mgr.a (mgr.14388) 17666 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:02:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:33 smithi049 bash[23528]: cluster 2024-09-21T05:02:31.804465+0000 mgr.a (mgr.14388) 17666 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:02:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:35 smithi044 bash[22676]: cluster 2024-09-21T05:02:33.805238+0000 mgr.a (mgr.14388) 17667 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:02:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:35 smithi179 bash[23186]: cluster 2024-09-21T05:02:33.805238+0000 mgr.a (mgr.14388) 17667 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:02:36.035 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:36.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:36.035 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:35 smithi049 bash[23528]: cluster 2024-09-21T05:02:33.805238+0000 mgr.a (mgr.14388) 17667 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:02:36.819 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:36.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:36.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:36.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:36.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:37 smithi044 bash[22676]: cluster 2024-09-21T05:02:35.807271+0000 mgr.a (mgr.14388) 17668 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:37 smithi044 bash[22676]: audit 2024-09-21T05:02:36.363415+0000 mgr.a (mgr.14388) 17669 : audit [DBG] from='client.380337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:37 smithi044 bash[22676]: audit 2024-09-21T05:02:37.306332+0000 mon.a (mon.0) 14038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:37 smithi044 bash[22676]: audit 2024-09-21T05:02:37.313842+0000 mon.a (mon.0) 14039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:37 smithi044 bash[22676]: audit 2024-09-21T05:02:37.321736+0000 mon.a (mon.0) 14040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:37 smithi049 bash[23528]: cluster 2024-09-21T05:02:35.807271+0000 mgr.a (mgr.14388) 17668 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:37 smithi049 bash[23528]: audit 2024-09-21T05:02:36.363415+0000 mgr.a (mgr.14388) 17669 : audit [DBG] from='client.380337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:37 smithi049 bash[23528]: audit 2024-09-21T05:02:37.306332+0000 mon.a (mon.0) 14038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:37 smithi049 bash[23528]: audit 2024-09-21T05:02:37.313842+0000 mon.a (mon.0) 14039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:37 smithi049 bash[23528]: audit 2024-09-21T05:02:37.321736+0000 mon.a (mon.0) 14040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:37 smithi179 bash[23186]: cluster 2024-09-21T05:02:35.807271+0000 mgr.a (mgr.14388) 17668 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:37 smithi179 bash[23186]: audit 2024-09-21T05:02:36.363415+0000 mgr.a (mgr.14388) 17669 : audit [DBG] from='client.380337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:37 smithi179 bash[23186]: audit 2024-09-21T05:02:37.306332+0000 mon.a (mon.0) 14038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:37 smithi179 bash[23186]: audit 2024-09-21T05:02:37.313842+0000 mon.a (mon.0) 14039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:37 smithi179 bash[23186]: audit 2024-09-21T05:02:37.321736+0000 mon.a (mon.0) 14040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:39 smithi044 bash[22676]: cluster 2024-09-21T05:02:37.807894+0000 mgr.a (mgr.14388) 17670 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:39 smithi179 bash[23186]: cluster 2024-09-21T05:02:37.807894+0000 mgr.a (mgr.14388) 17670 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:39 smithi049 bash[23528]: cluster 2024-09-21T05:02:37.807894+0000 mgr.a (mgr.14388) 17670 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:41.821 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:41.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:41.822 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:41 smithi044 bash[22676]: cluster 2024-09-21T05:02:39.808675+0000 mgr.a (mgr.14388) 17671 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:41 smithi179 bash[23186]: cluster 2024-09-21T05:02:39.808675+0000 mgr.a (mgr.14388) 17671 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:41 smithi049 bash[23528]: cluster 2024-09-21T05:02:39.808675+0000 mgr.a (mgr.14388) 17671 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:42.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:42.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:42.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:43.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:43 smithi044 bash[22676]: cluster 2024-09-21T05:02:41.810893+0000 mgr.a (mgr.14388) 17672 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:43.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:43 smithi044 bash[22676]: audit 2024-09-21T05:02:42.156608+0000 mgr.a (mgr.14388) 17673 : audit [DBG] from='client.380415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:43 smithi179 bash[23186]: cluster 2024-09-21T05:02:41.810893+0000 mgr.a (mgr.14388) 17672 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:43 smithi179 bash[23186]: audit 2024-09-21T05:02:42.156608+0000 mgr.a (mgr.14388) 17673 : audit [DBG] from='client.380415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:43 smithi049 bash[23528]: cluster 2024-09-21T05:02:41.810893+0000 mgr.a (mgr.14388) 17672 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:43 smithi049 bash[23528]: audit 2024-09-21T05:02:42.156608+0000 mgr.a (mgr.14388) 17673 : audit [DBG] from='client.380415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:45 smithi044 bash[22676]: cluster 2024-09-21T05:02:43.811795+0000 mgr.a (mgr.14388) 17674 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:02:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:45 smithi179 bash[23186]: cluster 2024-09-21T05:02:43.811795+0000 mgr.a (mgr.14388) 17674 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:02:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:45 smithi049 bash[23528]: cluster 2024-09-21T05:02:43.811795+0000 mgr.a (mgr.14388) 17674 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:02:47.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:47.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:47 smithi179 bash[23186]: cluster 2024-09-21T05:02:45.814110+0000 mgr.a (mgr.14388) 17675 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:47 smithi179 bash[23186]: audit 2024-09-21T05:02:46.934890+0000 mon.a (mon.0) 14041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:47 smithi179 bash[23186]: audit 2024-09-21T05:02:46.939870+0000 mon.a (mon.0) 14042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:47 smithi179 bash[23186]: audit 2024-09-21T05:02:46.946982+0000 mon.a (mon.0) 14043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:47 smithi179 bash[23186]: audit 2024-09-21T05:02:47.395702+0000 mon.a (mon.0) 14044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:47 smithi179 bash[23186]: audit 2024-09-21T05:02:47.404406+0000 mon.a (mon.0) 14045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:47 smithi179 bash[23186]: audit 2024-09-21T05:02:47.414458+0000 mon.a (mon.0) 14046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:47 smithi044 bash[22676]: cluster 2024-09-21T05:02:45.814110+0000 mgr.a (mgr.14388) 17675 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:47 smithi044 bash[22676]: audit 2024-09-21T05:02:46.934890+0000 mon.a (mon.0) 14041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:47 smithi044 bash[22676]: audit 2024-09-21T05:02:46.939870+0000 mon.a (mon.0) 14042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:47 smithi044 bash[22676]: audit 2024-09-21T05:02:46.946982+0000 mon.a (mon.0) 14043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:47 smithi044 bash[22676]: audit 2024-09-21T05:02:47.395702+0000 mon.a (mon.0) 14044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:47 smithi044 bash[22676]: audit 2024-09-21T05:02:47.404406+0000 mon.a (mon.0) 14045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:47 smithi044 bash[22676]: audit 2024-09-21T05:02:47.414458+0000 mon.a (mon.0) 14046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:47 smithi049 bash[23528]: cluster 2024-09-21T05:02:45.814110+0000 mgr.a (mgr.14388) 17675 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:02:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:47 smithi049 bash[23528]: audit 2024-09-21T05:02:46.934890+0000 mon.a (mon.0) 14041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:47 smithi049 bash[23528]: audit 2024-09-21T05:02:46.939870+0000 mon.a (mon.0) 14042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:47 smithi049 bash[23528]: audit 2024-09-21T05:02:46.946982+0000 mon.a (mon.0) 14043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:47 smithi049 bash[23528]: audit 2024-09-21T05:02:47.395702+0000 mon.a (mon.0) 14044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:47 smithi049 bash[23528]: audit 2024-09-21T05:02:47.404406+0000 mon.a (mon.0) 14045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:47 smithi049 bash[23528]: audit 2024-09-21T05:02:47.414458+0000 mon.a (mon.0) 14046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:48.385 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:48.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:48.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:48.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:48.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:49 smithi049 bash[23528]: cluster 2024-09-21T05:02:47.814860+0000 mgr.a (mgr.14388) 17676 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:49 smithi049 bash[23528]: audit 2024-09-21T05:02:47.934435+0000 mgr.a (mgr.14388) 17677 : audit [DBG] from='client.380493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:49 smithi044 bash[22676]: cluster 2024-09-21T05:02:47.814860+0000 mgr.a (mgr.14388) 17676 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:49 smithi044 bash[22676]: audit 2024-09-21T05:02:47.934435+0000 mgr.a (mgr.14388) 17677 : audit [DBG] from='client.380493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:49 smithi179 bash[23186]: cluster 2024-09-21T05:02:47.814860+0000 mgr.a (mgr.14388) 17676 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:49 smithi179 bash[23186]: audit 2024-09-21T05:02:47.934435+0000 mgr.a (mgr.14388) 17677 : audit [DBG] from='client.380493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:51.861 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:51 smithi049 bash[23528]: cluster 2024-09-21T05:02:49.816009+0000 mgr.a (mgr.14388) 17678 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:51 smithi044 bash[22676]: cluster 2024-09-21T05:02:49.816009+0000 mgr.a (mgr.14388) 17678 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:51 smithi179 bash[23186]: cluster 2024-09-21T05:02:49.816009+0000 mgr.a (mgr.14388) 17678 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:53.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:53.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:53.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:53 smithi044 bash[22676]: cluster 2024-09-21T05:02:51.818389+0000 mgr.a (mgr.14388) 17679 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:53 smithi179 bash[23186]: cluster 2024-09-21T05:02:51.818389+0000 mgr.a (mgr.14388) 17679 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:53 smithi049 bash[23528]: cluster 2024-09-21T05:02:51.818389+0000 mgr.a (mgr.14388) 17679 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:54.141 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:55.851 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:55 smithi044 bash[22676]: audit 2024-09-21T05:02:53.722575+0000 mgr.a (mgr.14388) 17680 : audit [DBG] from='client.380568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:55.851 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:55 smithi044 bash[22676]: cluster 2024-09-21T05:02:53.818863+0000 mgr.a (mgr.14388) 17681 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:55 smithi179 bash[23186]: audit 2024-09-21T05:02:53.722575+0000 mgr.a (mgr.14388) 17680 : audit [DBG] from='client.380568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:55 smithi179 bash[23186]: cluster 2024-09-21T05:02:53.818863+0000 mgr.a (mgr.14388) 17681 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:55 smithi049 bash[23528]: audit 2024-09-21T05:02:53.722575+0000 mgr.a (mgr.14388) 17680 : audit [DBG] from='client.380568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:55 smithi049 bash[23528]: cluster 2024-09-21T05:02:53.818863+0000 mgr.a (mgr.14388) 17681 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:02:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:57 smithi049 bash[23528]: cluster 2024-09-21T05:02:55.820224+0000 mgr.a (mgr.14388) 17682 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:57 smithi049 bash[23528]: audit 2024-09-21T05:02:57.502632+0000 mon.a (mon.0) 14047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:57 smithi049 bash[23528]: audit 2024-09-21T05:02:57.509070+0000 mon.a (mon.0) 14048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:57 smithi049 bash[23528]: audit 2024-09-21T05:02:57.516251+0000 mon.a (mon.0) 14049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:57.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:57 smithi044 bash[22676]: cluster 2024-09-21T05:02:55.820224+0000 mgr.a (mgr.14388) 17682 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:57.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:57 smithi044 bash[22676]: audit 2024-09-21T05:02:57.502632+0000 mon.a (mon.0) 14047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:57.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:57 smithi044 bash[22676]: audit 2024-09-21T05:02:57.509070+0000 mon.a (mon.0) 14048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:57.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:57 smithi044 bash[22676]: audit 2024-09-21T05:02:57.516251+0000 mon.a (mon.0) 14049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:57 smithi179 bash[23186]: cluster 2024-09-21T05:02:55.820224+0000 mgr.a (mgr.14388) 17682 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:02:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:57 smithi179 bash[23186]: audit 2024-09-21T05:02:57.502632+0000 mon.a (mon.0) 14047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:57 smithi179 bash[23186]: audit 2024-09-21T05:02:57.509070+0000 mon.a (mon.0) 14048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:58.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:57 smithi179 bash[23186]: audit 2024-09-21T05:02:57.516251+0000 mon.a (mon.0) 14049 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:02:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:02:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:02:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:02:59.923 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:02:59.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:02:59.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:02:59.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:02:59.923 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:02:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:02:59 smithi044 bash[22676]: cluster 2024-09-21T05:02:57.821027+0000 mgr.a (mgr.14388) 17683 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:02:59 smithi179 bash[23186]: cluster 2024-09-21T05:02:57.821027+0000 mgr.a (mgr.14388) 17683 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:02:59 smithi049 bash[23528]: cluster 2024-09-21T05:02:57.821027+0000 mgr.a (mgr.14388) 17683 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:00 smithi044 bash[22676]: audit 2024-09-21T05:02:59.470334+0000 mgr.a (mgr.14388) 17684 : audit [DBG] from='client.380646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:00 smithi179 bash[23186]: audit 2024-09-21T05:02:59.470334+0000 mgr.a (mgr.14388) 17684 : audit [DBG] from='client.380646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:00 smithi049 bash[23528]: audit 2024-09-21T05:02:59.470334+0000 mgr.a (mgr.14388) 17684 : audit [DBG] from='client.380646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:01 smithi044 bash[22676]: cluster 2024-09-21T05:02:59.821686+0000 mgr.a (mgr.14388) 17685 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:01 smithi179 bash[23186]: cluster 2024-09-21T05:02:59.821686+0000 mgr.a (mgr.14388) 17685 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:01 smithi049 bash[23528]: cluster 2024-09-21T05:02:59.821686+0000 mgr.a (mgr.14388) 17685 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:03 smithi044 bash[22676]: cluster 2024-09-21T05:03:01.823972+0000 mgr.a (mgr.14388) 17686 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:03 smithi179 bash[23186]: cluster 2024-09-21T05:03:01.823972+0000 mgr.a (mgr.14388) 17686 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:03 smithi049 bash[23528]: cluster 2024-09-21T05:03:01.823972+0000 mgr.a (mgr.14388) 17686 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:04.924 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:04.925 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:04.926 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:05.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:05.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:05.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:05.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:05.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:05 smithi179 bash[23186]: cluster 2024-09-21T05:03:03.824736+0000 mgr.a (mgr.14388) 17687 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:05 smithi044 bash[22676]: cluster 2024-09-21T05:03:03.824736+0000 mgr.a (mgr.14388) 17687 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:05 smithi049 bash[23528]: cluster 2024-09-21T05:03:03.824736+0000 mgr.a (mgr.14388) 17687 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:06 smithi044 bash[22676]: audit 2024-09-21T05:03:05.257413+0000 mgr.a (mgr.14388) 17688 : audit [DBG] from='client.380724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:06 smithi179 bash[23186]: audit 2024-09-21T05:03:05.257413+0000 mgr.a (mgr.14388) 17688 : audit [DBG] from='client.380724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:06 smithi049 bash[23528]: audit 2024-09-21T05:03:05.257413+0000 mgr.a (mgr.14388) 17688 : audit [DBG] from='client.380724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:07 smithi044 bash[22676]: cluster 2024-09-21T05:03:05.827699+0000 mgr.a (mgr.14388) 17689 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:07 smithi044 bash[22676]: audit 2024-09-21T05:03:07.141163+0000 mon.a (mon.0) 14050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:07 smithi044 bash[22676]: audit 2024-09-21T05:03:07.149016+0000 mon.a (mon.0) 14051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:07 smithi044 bash[22676]: audit 2024-09-21T05:03:07.158888+0000 mon.a (mon.0) 14052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:07 smithi044 bash[22676]: audit 2024-09-21T05:03:07.569645+0000 mon.a (mon.0) 14053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:07 smithi044 bash[22676]: audit 2024-09-21T05:03:07.578589+0000 mon.a (mon.0) 14054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:07 smithi044 bash[22676]: audit 2024-09-21T05:03:07.588751+0000 mon.a (mon.0) 14055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:07 smithi179 bash[23186]: cluster 2024-09-21T05:03:05.827699+0000 mgr.a (mgr.14388) 17689 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:07 smithi179 bash[23186]: audit 2024-09-21T05:03:07.141163+0000 mon.a (mon.0) 14050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:07 smithi179 bash[23186]: audit 2024-09-21T05:03:07.149016+0000 mon.a (mon.0) 14051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:07 smithi179 bash[23186]: audit 2024-09-21T05:03:07.158888+0000 mon.a (mon.0) 14052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:07 smithi179 bash[23186]: audit 2024-09-21T05:03:07.569645+0000 mon.a (mon.0) 14053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:07 smithi179 bash[23186]: audit 2024-09-21T05:03:07.578589+0000 mon.a (mon.0) 14054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:07 smithi179 bash[23186]: audit 2024-09-21T05:03:07.588751+0000 mon.a (mon.0) 14055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:07 smithi049 bash[23528]: cluster 2024-09-21T05:03:05.827699+0000 mgr.a (mgr.14388) 17689 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:07 smithi049 bash[23528]: audit 2024-09-21T05:03:07.141163+0000 mon.a (mon.0) 14050 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:07 smithi049 bash[23528]: audit 2024-09-21T05:03:07.149016+0000 mon.a (mon.0) 14051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:07 smithi049 bash[23528]: audit 2024-09-21T05:03:07.158888+0000 mon.a (mon.0) 14052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:07 smithi049 bash[23528]: audit 2024-09-21T05:03:07.569645+0000 mon.a (mon.0) 14053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:07 smithi049 bash[23528]: audit 2024-09-21T05:03:07.578589+0000 mon.a (mon.0) 14054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:07 smithi049 bash[23528]: audit 2024-09-21T05:03:07.588751+0000 mon.a (mon.0) 14055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:09.989 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:09 smithi049 bash[23528]: cluster 2024-09-21T05:03:07.828469+0000 mgr.a (mgr.14388) 17690 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:09 smithi044 bash[22676]: cluster 2024-09-21T05:03:07.828469+0000 mgr.a (mgr.14388) 17690 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:09 smithi179 bash[23186]: cluster 2024-09-21T05:03:07.828469+0000 mgr.a (mgr.14388) 17690 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:10.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:10.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:10.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:11.509 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:11.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:11.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:11.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:11.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:11.940 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:11 smithi049 bash[23528]: cluster 2024-09-21T05:03:09.829273+0000 mgr.a (mgr.14388) 17691 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:03:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:11 smithi044 bash[22676]: cluster 2024-09-21T05:03:09.829273+0000 mgr.a (mgr.14388) 17691 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:03:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:11 smithi179 bash[23186]: cluster 2024-09-21T05:03:09.829273+0000 mgr.a (mgr.14388) 17691 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:03:12.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:12 smithi044 bash[22676]: audit 2024-09-21T05:03:11.042901+0000 mgr.a (mgr.14388) 17692 : audit [DBG] from='client.380802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:12 smithi179 bash[23186]: audit 2024-09-21T05:03:11.042901+0000 mgr.a (mgr.14388) 17692 : audit [DBG] from='client.380802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:13.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:12 smithi049 bash[23528]: audit 2024-09-21T05:03:11.042901+0000 mgr.a (mgr.14388) 17692 : audit [DBG] from='client.380802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:13 smithi044 bash[22676]: cluster 2024-09-21T05:03:11.832275+0000 mgr.a (mgr.14388) 17693 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:13 smithi179 bash[23186]: cluster 2024-09-21T05:03:11.832275+0000 mgr.a (mgr.14388) 17693 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:13 smithi049 bash[23528]: cluster 2024-09-21T05:03:11.832275+0000 mgr.a (mgr.14388) 17693 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:15.972 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:15 smithi044 bash[22676]: cluster 2024-09-21T05:03:13.833092+0000 mgr.a (mgr.14388) 17694 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:16.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:15 smithi179 bash[23186]: cluster 2024-09-21T05:03:13.833092+0000 mgr.a (mgr.14388) 17694 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:15 smithi049 bash[23528]: cluster 2024-09-21T05:03:13.833092+0000 mgr.a (mgr.14388) 17694 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:16.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:16.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:16.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:17.298 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:17.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:17.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:17.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:17.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:17 smithi044 bash[22676]: cluster 2024-09-21T05:03:15.834386+0000 mgr.a (mgr.14388) 17695 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:17 smithi179 bash[23186]: cluster 2024-09-21T05:03:15.834386+0000 mgr.a (mgr.14388) 17695 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:17 smithi049 bash[23528]: cluster 2024-09-21T05:03:15.834386+0000 mgr.a (mgr.14388) 17695 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:18 smithi044 bash[22676]: audit 2024-09-21T05:03:16.837115+0000 mgr.a (mgr.14388) 17696 : audit [DBG] from='client.380880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:18 smithi044 bash[22676]: audit 2024-09-21T05:03:17.713444+0000 mon.a (mon.0) 14056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:18 smithi044 bash[22676]: audit 2024-09-21T05:03:17.718410+0000 mon.a (mon.0) 14057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:18 smithi044 bash[22676]: audit 2024-09-21T05:03:17.723268+0000 mon.a (mon.0) 14058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:18 smithi179 bash[23186]: audit 2024-09-21T05:03:16.837115+0000 mgr.a (mgr.14388) 17696 : audit [DBG] from='client.380880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:18 smithi179 bash[23186]: audit 2024-09-21T05:03:17.713444+0000 mon.a (mon.0) 14056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:18 smithi179 bash[23186]: audit 2024-09-21T05:03:17.718410+0000 mon.a (mon.0) 14057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:18 smithi179 bash[23186]: audit 2024-09-21T05:03:17.723268+0000 mon.a (mon.0) 14058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:19.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:18 smithi049 bash[23528]: audit 2024-09-21T05:03:16.837115+0000 mgr.a (mgr.14388) 17696 : audit [DBG] from='client.380880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:19.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:18 smithi049 bash[23528]: audit 2024-09-21T05:03:17.713444+0000 mon.a (mon.0) 14056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:19.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:18 smithi049 bash[23528]: audit 2024-09-21T05:03:17.718410+0000 mon.a (mon.0) 14057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:19.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:18 smithi049 bash[23528]: audit 2024-09-21T05:03:17.723268+0000 mon.a (mon.0) 14058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:19.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:19 smithi044 bash[22676]: cluster 2024-09-21T05:03:17.835363+0000 mgr.a (mgr.14388) 17697 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:19 smithi179 bash[23186]: cluster 2024-09-21T05:03:17.835363+0000 mgr.a (mgr.14388) 17697 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:19 smithi049 bash[23528]: cluster 2024-09-21T05:03:17.835363+0000 mgr.a (mgr.14388) 17697 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:21 smithi044 bash[22676]: cluster 2024-09-21T05:03:19.836210+0000 mgr.a (mgr.14388) 17698 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:21 smithi179 bash[23186]: cluster 2024-09-21T05:03:19.836210+0000 mgr.a (mgr.14388) 17698 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:21 smithi049 bash[23528]: cluster 2024-09-21T05:03:19.836210+0000 mgr.a (mgr.14388) 17698 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:22.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:22.300 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:22.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:23.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:23.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:23.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:23.058 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:23.058 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:23 smithi044 bash[22676]: cluster 2024-09-21T05:03:21.838485+0000 mgr.a (mgr.14388) 17699 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:23 smithi044 bash[22676]: audit 2024-09-21T05:03:22.625896+0000 mgr.a (mgr.14388) 17700 : audit [DBG] from='client.380958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:23 smithi179 bash[23186]: cluster 2024-09-21T05:03:21.838485+0000 mgr.a (mgr.14388) 17699 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:24.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:23 smithi179 bash[23186]: audit 2024-09-21T05:03:22.625896+0000 mgr.a (mgr.14388) 17700 : audit [DBG] from='client.380958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:23 smithi049 bash[23528]: cluster 2024-09-21T05:03:21.838485+0000 mgr.a (mgr.14388) 17699 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:23 smithi049 bash[23528]: audit 2024-09-21T05:03:22.625896+0000 mgr.a (mgr.14388) 17700 : audit [DBG] from='client.380958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:25 smithi179 bash[23186]: cluster 2024-09-21T05:03:23.839470+0000 mgr.a (mgr.14388) 17701 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:25 smithi044 bash[22676]: cluster 2024-09-21T05:03:23.839470+0000 mgr.a (mgr.14388) 17701 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:26.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:25 smithi049 bash[23528]: cluster 2024-09-21T05:03:23.839470+0000 mgr.a (mgr.14388) 17701 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:27.971 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:27 smithi179 bash[23186]: cluster 2024-09-21T05:03:25.841743+0000 mgr.a (mgr.14388) 17702 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:27.971 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:27 smithi179 bash[23186]: audit 2024-09-21T05:03:27.384184+0000 mon.a (mon.0) 14059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:27.971 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:27 smithi179 bash[23186]: audit 2024-09-21T05:03:27.392544+0000 mon.a (mon.0) 14060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:27.971 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:27 smithi179 bash[23186]: audit 2024-09-21T05:03:27.402867+0000 mon.a (mon.0) 14061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:27 smithi044 bash[22676]: cluster 2024-09-21T05:03:25.841743+0000 mgr.a (mgr.14388) 17702 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:27 smithi044 bash[22676]: audit 2024-09-21T05:03:27.384184+0000 mon.a (mon.0) 14059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:27 smithi044 bash[22676]: audit 2024-09-21T05:03:27.392544+0000 mon.a (mon.0) 14060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:27 smithi044 bash[22676]: audit 2024-09-21T05:03:27.402867+0000 mon.a (mon.0) 14061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:27 smithi049 bash[23528]: cluster 2024-09-21T05:03:25.841743+0000 mgr.a (mgr.14388) 17702 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:27 smithi049 bash[23528]: audit 2024-09-21T05:03:27.384184+0000 mon.a (mon.0) 14059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:27 smithi049 bash[23528]: audit 2024-09-21T05:03:27.392544+0000 mon.a (mon.0) 14060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:27 smithi049 bash[23528]: audit 2024-09-21T05:03:27.402867+0000 mon.a (mon.0) 14061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:28.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:28.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:28.860 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:28 smithi049 bash[23528]: audit 2024-09-21T05:03:27.762020+0000 mon.a (mon.0) 14062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:28 smithi049 bash[23528]: audit 2024-09-21T05:03:27.770363+0000 mon.a (mon.0) 14063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:28 smithi049 bash[23528]: audit 2024-09-21T05:03:27.780264+0000 mon.a (mon.0) 14064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:28 smithi049 bash[23528]: cluster 2024-09-21T05:03:27.842625+0000 mgr.a (mgr.14388) 17703 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:29.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:28 smithi049 bash[23528]: audit 2024-09-21T05:03:28.400721+0000 mgr.a (mgr.14388) 17704 : audit [DBG] from='client.381036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:28 smithi044 bash[22676]: audit 2024-09-21T05:03:27.762020+0000 mon.a (mon.0) 14062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:28 smithi044 bash[22676]: audit 2024-09-21T05:03:27.770363+0000 mon.a (mon.0) 14063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:28 smithi044 bash[22676]: audit 2024-09-21T05:03:27.780264+0000 mon.a (mon.0) 14064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:28 smithi044 bash[22676]: cluster 2024-09-21T05:03:27.842625+0000 mgr.a (mgr.14388) 17703 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:29.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:28 smithi044 bash[22676]: audit 2024-09-21T05:03:28.400721+0000 mgr.a (mgr.14388) 17704 : audit [DBG] from='client.381036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:28 smithi179 bash[23186]: audit 2024-09-21T05:03:27.762020+0000 mon.a (mon.0) 14062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:28 smithi179 bash[23186]: audit 2024-09-21T05:03:27.770363+0000 mon.a (mon.0) 14063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:28 smithi179 bash[23186]: audit 2024-09-21T05:03:27.780264+0000 mon.a (mon.0) 14064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:28 smithi179 bash[23186]: cluster 2024-09-21T05:03:27.842625+0000 mgr.a (mgr.14388) 17703 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:29.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:28 smithi179 bash[23186]: audit 2024-09-21T05:03:28.400721+0000 mgr.a (mgr.14388) 17704 : audit [DBG] from='client.381036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:30 smithi044 bash[22676]: cluster 2024-09-21T05:03:29.843859+0000 mgr.a (mgr.14388) 17705 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:30 smithi044 bash[22676]: audit 2024-09-21T05:03:30.584878+0000 mon.a (mon.0) 14065 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:03:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:30 smithi044 bash[22676]: audit 2024-09-21T05:03:30.592197+0000 mon.a (mon.0) 14066 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:30 smithi044 bash[22676]: audit 2024-09-21T05:03:30.594162+0000 mon.a (mon.0) 14067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:30 smithi044 bash[22676]: audit 2024-09-21T05:03:30.605876+0000 mon.a (mon.0) 14068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:30 smithi044 bash[22676]: audit 2024-09-21T05:03:30.612289+0000 mon.a (mon.0) 14069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:03:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:30 smithi044 bash[22676]: audit 2024-09-21T05:03:30.614695+0000 mgr.a (mgr.14388) 17706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:03:31.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:30 smithi179 bash[23186]: cluster 2024-09-21T05:03:29.843859+0000 mgr.a (mgr.14388) 17705 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:31.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:30 smithi179 bash[23186]: audit 2024-09-21T05:03:30.584878+0000 mon.a (mon.0) 14065 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:03:31.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:30 smithi179 bash[23186]: audit 2024-09-21T05:03:30.592197+0000 mon.a (mon.0) 14066 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:31.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:30 smithi179 bash[23186]: audit 2024-09-21T05:03:30.594162+0000 mon.a (mon.0) 14067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:31.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:30 smithi179 bash[23186]: audit 2024-09-21T05:03:30.605876+0000 mon.a (mon.0) 14068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:31.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:30 smithi179 bash[23186]: audit 2024-09-21T05:03:30.612289+0000 mon.a (mon.0) 14069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:03:31.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:30 smithi179 bash[23186]: audit 2024-09-21T05:03:30.614695+0000 mgr.a (mgr.14388) 17706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:03:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:30 smithi049 bash[23528]: cluster 2024-09-21T05:03:29.843859+0000 mgr.a (mgr.14388) 17705 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:30 smithi049 bash[23528]: audit 2024-09-21T05:03:30.584878+0000 mon.a (mon.0) 14065 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:03:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:30 smithi049 bash[23528]: audit 2024-09-21T05:03:30.592197+0000 mon.a (mon.0) 14066 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:30 smithi049 bash[23528]: audit 2024-09-21T05:03:30.594162+0000 mon.a (mon.0) 14067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:30 smithi049 bash[23528]: audit 2024-09-21T05:03:30.605876+0000 mon.a (mon.0) 14068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:30 smithi049 bash[23528]: audit 2024-09-21T05:03:30.612289+0000 mon.a (mon.0) 14069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:03:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:30 smithi049 bash[23528]: audit 2024-09-21T05:03:30.614695+0000 mgr.a (mgr.14388) 17706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:03:31.740 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:03:31 smithi044 bash[22930]: debug 2024-09-21T05:03:31.394+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:03:31.740 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:03:31 smithi044 bash[22930]: debug 2024-09-21T05:03:31.394+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:03:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:31 smithi044 bash[22676]: audit 2024-09-21T05:03:31.398149+0000 mgr.a (mgr.14388) 17707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:03:32.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:31 smithi044 bash[22676]: cephadm 2024-09-21T05:03:31.399721+0000 mgr.a (mgr.14388) 17708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:03:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:31 smithi179 bash[23186]: audit 2024-09-21T05:03:31.398149+0000 mgr.a (mgr.14388) 17707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:03:32.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:31 smithi179 bash[23186]: cephadm 2024-09-21T05:03:31.399721+0000 mgr.a (mgr.14388) 17708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:03:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:31 smithi049 bash[23528]: audit 2024-09-21T05:03:31.398149+0000 mgr.a (mgr.14388) 17707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:03:32.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:31 smithi049 bash[23528]: cephadm 2024-09-21T05:03:31.399721+0000 mgr.a (mgr.14388) 17708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:03:33.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:32 smithi049 bash[23528]: cluster 2024-09-21T05:03:31.846876+0000 mgr.a (mgr.14388) 17709 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:32 smithi044 bash[22676]: cluster 2024-09-21T05:03:31.846876+0000 mgr.a (mgr.14388) 17709 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:32 smithi179 bash[23186]: cluster 2024-09-21T05:03:31.846876+0000 mgr.a (mgr.14388) 17709 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:33.861 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:33.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:33.862 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:34.617 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:34.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:34.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:34.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:34.618 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:34 smithi044 bash[22676]: cluster 2024-09-21T05:03:33.847660+0000 mgr.a (mgr.14388) 17710 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:34 smithi044 bash[22676]: audit 2024-09-21T05:03:34.188552+0000 mgr.a (mgr.14388) 17711 : audit [DBG] from='client.381219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:34 smithi179 bash[23186]: cluster 2024-09-21T05:03:33.847660+0000 mgr.a (mgr.14388) 17710 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:35.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:34 smithi179 bash[23186]: audit 2024-09-21T05:03:34.188552+0000 mgr.a (mgr.14388) 17711 : audit [DBG] from='client.381219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:34 smithi049 bash[23528]: cluster 2024-09-21T05:03:33.847660+0000 mgr.a (mgr.14388) 17710 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:34 smithi049 bash[23528]: audit 2024-09-21T05:03:34.188552+0000 mgr.a (mgr.14388) 17711 : audit [DBG] from='client.381219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:37.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:36 smithi044 bash[22676]: cluster 2024-09-21T05:03:35.849957+0000 mgr.a (mgr.14388) 17712 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:37.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:36 smithi179 bash[23186]: cluster 2024-09-21T05:03:35.849957+0000 mgr.a (mgr.14388) 17712 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:37.309 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:36 smithi049 bash[23528]: cluster 2024-09-21T05:03:35.849957+0000 mgr.a (mgr.14388) 17712 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:38 smithi044 bash[22676]: cluster 2024-09-21T05:03:37.850721+0000 mgr.a (mgr.14388) 17713 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:38 smithi044 bash[22676]: audit 2024-09-21T05:03:37.934840+0000 mon.a (mon.0) 14070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:38 smithi044 bash[22676]: audit 2024-09-21T05:03:37.941215+0000 mon.a (mon.0) 14071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:38 smithi044 bash[22676]: audit 2024-09-21T05:03:37.948141+0000 mon.a (mon.0) 14072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:38 smithi179 bash[23186]: cluster 2024-09-21T05:03:37.850721+0000 mgr.a (mgr.14388) 17713 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:38 smithi179 bash[23186]: audit 2024-09-21T05:03:37.934840+0000 mon.a (mon.0) 14070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:38 smithi179 bash[23186]: audit 2024-09-21T05:03:37.941215+0000 mon.a (mon.0) 14071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:38 smithi179 bash[23186]: audit 2024-09-21T05:03:37.948141+0000 mon.a (mon.0) 14072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:38 smithi049 bash[23528]: cluster 2024-09-21T05:03:37.850721+0000 mgr.a (mgr.14388) 17713 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:38 smithi049 bash[23528]: audit 2024-09-21T05:03:37.934840+0000 mon.a (mon.0) 14070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:38 smithi049 bash[23528]: audit 2024-09-21T05:03:37.941215+0000 mon.a (mon.0) 14071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:38 smithi049 bash[23528]: audit 2024-09-21T05:03:37.948141+0000 mon.a (mon.0) 14072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:39.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:40.419 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:40 smithi044 bash[22676]: cluster 2024-09-21T05:03:39.851456+0000 mgr.a (mgr.14388) 17714 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:41.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:40 smithi044 bash[22676]: audit 2024-09-21T05:03:39.955799+0000 mgr.a (mgr.14388) 17715 : audit [DBG] from='client.381294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:40 smithi179 bash[23186]: cluster 2024-09-21T05:03:39.851456+0000 mgr.a (mgr.14388) 17714 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:41.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:40 smithi179 bash[23186]: audit 2024-09-21T05:03:39.955799+0000 mgr.a (mgr.14388) 17715 : audit [DBG] from='client.381294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:40 smithi049 bash[23528]: cluster 2024-09-21T05:03:39.851456+0000 mgr.a (mgr.14388) 17714 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:40 smithi049 bash[23528]: audit 2024-09-21T05:03:39.955799+0000 mgr.a (mgr.14388) 17715 : audit [DBG] from='client.381294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:42 smithi044 bash[22676]: cluster 2024-09-21T05:03:41.854532+0000 mgr.a (mgr.14388) 17716 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:42 smithi179 bash[23186]: cluster 2024-09-21T05:03:41.854532+0000 mgr.a (mgr.14388) 17716 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:43.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:42 smithi049 bash[23528]: cluster 2024-09-21T05:03:41.854532+0000 mgr.a (mgr.14388) 17716 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:44 smithi044 bash[22676]: cluster 2024-09-21T05:03:43.855367+0000 mgr.a (mgr.14388) 17717 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:03:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:44 smithi179 bash[23186]: cluster 2024-09-21T05:03:43.855367+0000 mgr.a (mgr.14388) 17717 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:03:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:44 smithi049 bash[23528]: cluster 2024-09-21T05:03:43.855367+0000 mgr.a (mgr.14388) 17717 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:03:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:45.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:46.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:46.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:46.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:46.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:46.173 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:46 smithi044 bash[22676]: audit 2024-09-21T05:03:45.748774+0000 mgr.a (mgr.14388) 17718 : audit [DBG] from='client.381372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:47.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:46 smithi044 bash[22676]: cluster 2024-09-21T05:03:45.856674+0000 mgr.a (mgr.14388) 17719 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:46 smithi179 bash[23186]: audit 2024-09-21T05:03:45.748774+0000 mgr.a (mgr.14388) 17718 : audit [DBG] from='client.381372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:47.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:46 smithi179 bash[23186]: cluster 2024-09-21T05:03:45.856674+0000 mgr.a (mgr.14388) 17719 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:47.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:46 smithi049 bash[23528]: audit 2024-09-21T05:03:45.748774+0000 mgr.a (mgr.14388) 17718 : audit [DBG] from='client.381372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:47.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:46 smithi049 bash[23528]: cluster 2024-09-21T05:03:45.856674+0000 mgr.a (mgr.14388) 17719 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:03:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:48 smithi179 bash[23186]: audit 2024-09-21T05:03:47.618113+0000 mon.a (mon.0) 14073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:48 smithi179 bash[23186]: audit 2024-09-21T05:03:47.623514+0000 mon.a (mon.0) 14074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:48 smithi179 bash[23186]: audit 2024-09-21T05:03:47.629572+0000 mon.a (mon.0) 14075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:48 smithi179 bash[23186]: audit 2024-09-21T05:03:47.922264+0000 mon.a (mon.0) 14076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:48 smithi179 bash[23186]: audit 2024-09-21T05:03:47.930754+0000 mon.a (mon.0) 14077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:48 smithi179 bash[23186]: audit 2024-09-21T05:03:47.942173+0000 mon.a (mon.0) 14078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:48 smithi044 bash[22676]: audit 2024-09-21T05:03:47.618113+0000 mon.a (mon.0) 14073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:48 smithi044 bash[22676]: audit 2024-09-21T05:03:47.623514+0000 mon.a (mon.0) 14074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:48 smithi044 bash[22676]: audit 2024-09-21T05:03:47.629572+0000 mon.a (mon.0) 14075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:48 smithi044 bash[22676]: audit 2024-09-21T05:03:47.922264+0000 mon.a (mon.0) 14076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:48 smithi044 bash[22676]: audit 2024-09-21T05:03:47.930754+0000 mon.a (mon.0) 14077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:48 smithi044 bash[22676]: audit 2024-09-21T05:03:47.942173+0000 mon.a (mon.0) 14078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:48 smithi049 bash[23528]: audit 2024-09-21T05:03:47.618113+0000 mon.a (mon.0) 14073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:48 smithi049 bash[23528]: audit 2024-09-21T05:03:47.623514+0000 mon.a (mon.0) 14074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:48 smithi049 bash[23528]: audit 2024-09-21T05:03:47.629572+0000 mon.a (mon.0) 14075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:48 smithi049 bash[23528]: audit 2024-09-21T05:03:47.922264+0000 mon.a (mon.0) 14076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:48 smithi049 bash[23528]: audit 2024-09-21T05:03:47.930754+0000 mon.a (mon.0) 14077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:48 smithi049 bash[23528]: audit 2024-09-21T05:03:47.942173+0000 mon.a (mon.0) 14078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:49 smithi044 bash[22676]: cluster 2024-09-21T05:03:47.857529+0000 mgr.a (mgr.14388) 17720 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:49 smithi179 bash[23186]: cluster 2024-09-21T05:03:47.857529+0000 mgr.a (mgr.14388) 17720 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:49 smithi049 bash[23528]: cluster 2024-09-21T05:03:47.857529+0000 mgr.a (mgr.14388) 17720 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:03:51.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:51.175 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:51.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:51 smithi049 bash[23528]: cluster 2024-09-21T05:03:49.858354+0000 mgr.a (mgr.14388) 17721 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:03:51.967 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:51.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:51 smithi044 bash[22676]: cluster 2024-09-21T05:03:49.858354+0000 mgr.a (mgr.14388) 17721 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:03:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:51 smithi179 bash[23186]: cluster 2024-09-21T05:03:49.858354+0000 mgr.a (mgr.14388) 17721 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:03:52.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:52 smithi044 bash[22676]: audit 2024-09-21T05:03:51.509317+0000 mgr.a (mgr.14388) 17722 : audit [DBG] from='client.381444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:52 smithi179 bash[23186]: audit 2024-09-21T05:03:51.509317+0000 mgr.a (mgr.14388) 17722 : audit [DBG] from='client.381444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:53.050 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:52 smithi049 bash[23528]: audit 2024-09-21T05:03:51.509317+0000 mgr.a (mgr.14388) 17722 : audit [DBG] from='client.381444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:53.919 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:53 smithi049 bash[23528]: cluster 2024-09-21T05:03:51.861914+0000 mgr.a (mgr.14388) 17723 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:53 smithi044 bash[22676]: cluster 2024-09-21T05:03:51.861914+0000 mgr.a (mgr.14388) 17723 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:53 smithi179 bash[23186]: cluster 2024-09-21T05:03:51.861914+0000 mgr.a (mgr.14388) 17723 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:55 smithi044 bash[22676]: cluster 2024-09-21T05:03:53.862719+0000 mgr.a (mgr.14388) 17724 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:55 smithi179 bash[23186]: cluster 2024-09-21T05:03:53.862719+0000 mgr.a (mgr.14388) 17724 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:55 smithi049 bash[23528]: cluster 2024-09-21T05:03:53.862719+0000 mgr.a (mgr.14388) 17724 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:03:56.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:03:56.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:03:56.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:03:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:57 smithi044 bash[22676]: cluster 2024-09-21T05:03:55.864770+0000 mgr.a (mgr.14388) 17725 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:57.754 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:03:57.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:03:57.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:03:57.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:03:57.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:03:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:57 smithi179 bash[23186]: cluster 2024-09-21T05:03:55.864770+0000 mgr.a (mgr.14388) 17725 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:57 smithi049 bash[23528]: cluster 2024-09-21T05:03:55.864770+0000 mgr.a (mgr.14388) 17725 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:03:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:58 smithi044 bash[22676]: audit 2024-09-21T05:03:57.301200+0000 mgr.a (mgr.14388) 17726 : audit [DBG] from='client.381522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:58 smithi044 bash[22676]: audit 2024-09-21T05:03:58.163251+0000 mon.a (mon.0) 14079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:58 smithi044 bash[22676]: audit 2024-09-21T05:03:58.170334+0000 mon.a (mon.0) 14080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:58 smithi044 bash[22676]: audit 2024-09-21T05:03:58.178420+0000 mon.a (mon.0) 14081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:58 smithi179 bash[23186]: audit 2024-09-21T05:03:57.301200+0000 mgr.a (mgr.14388) 17726 : audit [DBG] from='client.381522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:58 smithi179 bash[23186]: audit 2024-09-21T05:03:58.163251+0000 mon.a (mon.0) 14079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:58 smithi179 bash[23186]: audit 2024-09-21T05:03:58.170334+0000 mon.a (mon.0) 14080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:58 smithi179 bash[23186]: audit 2024-09-21T05:03:58.178420+0000 mon.a (mon.0) 14081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:58 smithi049 bash[23528]: audit 2024-09-21T05:03:57.301200+0000 mgr.a (mgr.14388) 17726 : audit [DBG] from='client.381522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:58 smithi049 bash[23528]: audit 2024-09-21T05:03:58.163251+0000 mon.a (mon.0) 14079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:58 smithi049 bash[23528]: audit 2024-09-21T05:03:58.170334+0000 mon.a (mon.0) 14080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:58 smithi049 bash[23528]: audit 2024-09-21T05:03:58.178420+0000 mon.a (mon.0) 14081 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:03:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:03:59 smithi044 bash[22676]: cluster 2024-09-21T05:03:57.865777+0000 mgr.a (mgr.14388) 17727 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:03:59 smithi179 bash[23186]: cluster 2024-09-21T05:03:57.865777+0000 mgr.a (mgr.14388) 17727 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:03:59 smithi049 bash[23528]: cluster 2024-09-21T05:03:57.865777+0000 mgr.a (mgr.14388) 17727 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:01 smithi044 bash[22676]: cluster 2024-09-21T05:03:59.866554+0000 mgr.a (mgr.14388) 17728 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:01 smithi179 bash[23186]: cluster 2024-09-21T05:03:59.866554+0000 mgr.a (mgr.14388) 17728 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:01 smithi049 bash[23528]: cluster 2024-09-21T05:03:59.866554+0000 mgr.a (mgr.14388) 17728 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:02.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:02.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:02.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:03.530 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:03.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:03.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:03.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:03.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:03 smithi044 bash[22676]: cluster 2024-09-21T05:04:01.868797+0000 mgr.a (mgr.14388) 17729 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:03 smithi179 bash[23186]: cluster 2024-09-21T05:04:01.868797+0000 mgr.a (mgr.14388) 17729 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:03 smithi049 bash[23528]: cluster 2024-09-21T05:04:01.868797+0000 mgr.a (mgr.14388) 17729 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:04.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:04 smithi044 bash[22676]: audit 2024-09-21T05:04:03.085153+0000 mgr.a (mgr.14388) 17730 : audit [DBG] from='client.381597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:04 smithi179 bash[23186]: audit 2024-09-21T05:04:03.085153+0000 mgr.a (mgr.14388) 17730 : audit [DBG] from='client.381597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:05.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:04 smithi049 bash[23528]: audit 2024-09-21T05:04:03.085153+0000 mgr.a (mgr.14388) 17730 : audit [DBG] from='client.381597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:05 smithi044 bash[22676]: cluster 2024-09-21T05:04:03.869779+0000 mgr.a (mgr.14388) 17731 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:05 smithi179 bash[23186]: cluster 2024-09-21T05:04:03.869779+0000 mgr.a (mgr.14388) 17731 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:05 smithi049 bash[23528]: cluster 2024-09-21T05:04:03.869779+0000 mgr.a (mgr.14388) 17731 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:07 smithi044 bash[22676]: cluster 2024-09-21T05:04:05.871991+0000 mgr.a (mgr.14388) 17732 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:07 smithi179 bash[23186]: cluster 2024-09-21T05:04:05.871991+0000 mgr.a (mgr.14388) 17732 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:07 smithi049 bash[23528]: cluster 2024-09-21T05:04:05.871991+0000 mgr.a (mgr.14388) 17732 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:08 smithi044 bash[22676]: audit 2024-09-21T05:04:07.841605+0000 mon.a (mon.0) 14082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:08 smithi044 bash[22676]: audit 2024-09-21T05:04:07.851176+0000 mon.a (mon.0) 14083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:08 smithi044 bash[22676]: audit 2024-09-21T05:04:07.863185+0000 mon.a (mon.0) 14084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:08 smithi044 bash[22676]: cluster 2024-09-21T05:04:07.872733+0000 mgr.a (mgr.14388) 17733 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:08 smithi044 bash[22676]: audit 2024-09-21T05:04:08.150520+0000 mon.a (mon.0) 14085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:08 smithi044 bash[22676]: audit 2024-09-21T05:04:08.160505+0000 mon.a (mon.0) 14086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:08 smithi044 bash[22676]: audit 2024-09-21T05:04:08.170719+0000 mon.a (mon.0) 14087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:08 smithi179 bash[23186]: audit 2024-09-21T05:04:07.841605+0000 mon.a (mon.0) 14082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:08 smithi179 bash[23186]: audit 2024-09-21T05:04:07.851176+0000 mon.a (mon.0) 14083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:08 smithi179 bash[23186]: audit 2024-09-21T05:04:07.863185+0000 mon.a (mon.0) 14084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:08 smithi179 bash[23186]: cluster 2024-09-21T05:04:07.872733+0000 mgr.a (mgr.14388) 17733 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:08 smithi179 bash[23186]: audit 2024-09-21T05:04:08.150520+0000 mon.a (mon.0) 14085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:08 smithi179 bash[23186]: audit 2024-09-21T05:04:08.160505+0000 mon.a (mon.0) 14086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:08 smithi179 bash[23186]: audit 2024-09-21T05:04:08.170719+0000 mon.a (mon.0) 14087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:08 smithi049 bash[23528]: audit 2024-09-21T05:04:07.841605+0000 mon.a (mon.0) 14082 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:08 smithi049 bash[23528]: audit 2024-09-21T05:04:07.851176+0000 mon.a (mon.0) 14083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:08 smithi049 bash[23528]: audit 2024-09-21T05:04:07.863185+0000 mon.a (mon.0) 14084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:08 smithi049 bash[23528]: cluster 2024-09-21T05:04:07.872733+0000 mgr.a (mgr.14388) 17733 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:08 smithi049 bash[23528]: audit 2024-09-21T05:04:08.150520+0000 mon.a (mon.0) 14085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:08 smithi049 bash[23528]: audit 2024-09-21T05:04:08.160505+0000 mon.a (mon.0) 14086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:08 smithi049 bash[23528]: audit 2024-09-21T05:04:08.170719+0000 mon.a (mon.0) 14087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:09.318 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:09.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:10.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:09 smithi044 bash[22676]: audit 2024-09-21T05:04:08.873329+0000 mgr.a (mgr.14388) 17734 : audit [DBG] from='client.162355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:09 smithi179 bash[23186]: audit 2024-09-21T05:04:08.873329+0000 mgr.a (mgr.14388) 17734 : audit [DBG] from='client.162355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:10.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:09 smithi049 bash[23528]: audit 2024-09-21T05:04:08.873329+0000 mgr.a (mgr.14388) 17734 : audit [DBG] from='client.162355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:10 smithi049 bash[23528]: cluster 2024-09-21T05:04:09.873736+0000 mgr.a (mgr.14388) 17735 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:11.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:10 smithi044 bash[22676]: cluster 2024-09-21T05:04:09.873736+0000 mgr.a (mgr.14388) 17735 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:10 smithi179 bash[23186]: cluster 2024-09-21T05:04:09.873736+0000 mgr.a (mgr.14388) 17735 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:13.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:12 smithi044 bash[22676]: cluster 2024-09-21T05:04:11.876035+0000 mgr.a (mgr.14388) 17736 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:12 smithi179 bash[23186]: cluster 2024-09-21T05:04:11.876035+0000 mgr.a (mgr.14388) 17736 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:12 smithi049 bash[23528]: cluster 2024-09-21T05:04:11.876035+0000 mgr.a (mgr.14388) 17736 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:04:14.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:14.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:14.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:15.078 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:15.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:15.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:15.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:15.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:14 smithi044 bash[22676]: cluster 2024-09-21T05:04:13.876823+0000 mgr.a (mgr.14388) 17737 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:15.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:14 smithi044 bash[22676]: audit 2024-09-21T05:04:14.648007+0000 mgr.a (mgr.14388) 17738 : audit [DBG] from='client.381747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:14 smithi179 bash[23186]: cluster 2024-09-21T05:04:13.876823+0000 mgr.a (mgr.14388) 17737 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:14 smithi179 bash[23186]: audit 2024-09-21T05:04:14.648007+0000 mgr.a (mgr.14388) 17738 : audit [DBG] from='client.381747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:14 smithi049 bash[23528]: cluster 2024-09-21T05:04:13.876823+0000 mgr.a (mgr.14388) 17737 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:14 smithi049 bash[23528]: audit 2024-09-21T05:04:14.648007+0000 mgr.a (mgr.14388) 17738 : audit [DBG] from='client.381747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:16 smithi044 bash[22676]: cluster 2024-09-21T05:04:15.879381+0000 mgr.a (mgr.14388) 17739 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:04:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:16 smithi179 bash[23186]: cluster 2024-09-21T05:04:15.879381+0000 mgr.a (mgr.14388) 17739 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:04:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:16 smithi049 bash[23528]: cluster 2024-09-21T05:04:15.879381+0000 mgr.a (mgr.14388) 17739 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:04:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:19 smithi044 bash[22676]: cluster 2024-09-21T05:04:17.879995+0000 mgr.a (mgr.14388) 17740 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:19 smithi044 bash[22676]: audit 2024-09-21T05:04:18.395323+0000 mon.a (mon.0) 14088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:19 smithi044 bash[22676]: audit 2024-09-21T05:04:18.405435+0000 mon.a (mon.0) 14089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:19 smithi044 bash[22676]: audit 2024-09-21T05:04:18.417435+0000 mon.a (mon.0) 14090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:19 smithi179 bash[23186]: cluster 2024-09-21T05:04:17.879995+0000 mgr.a (mgr.14388) 17740 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:19 smithi179 bash[23186]: audit 2024-09-21T05:04:18.395323+0000 mon.a (mon.0) 14088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:19 smithi179 bash[23186]: audit 2024-09-21T05:04:18.405435+0000 mon.a (mon.0) 14089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:19 smithi179 bash[23186]: audit 2024-09-21T05:04:18.417435+0000 mon.a (mon.0) 14090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:19 smithi049 bash[23528]: cluster 2024-09-21T05:04:17.879995+0000 mgr.a (mgr.14388) 17740 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:19 smithi049 bash[23528]: audit 2024-09-21T05:04:18.395323+0000 mon.a (mon.0) 14088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:19 smithi049 bash[23528]: audit 2024-09-21T05:04:18.405435+0000 mon.a (mon.0) 14089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:19 smithi049 bash[23528]: audit 2024-09-21T05:04:18.417435+0000 mon.a (mon.0) 14090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:20.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:20.081 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:20.837 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:20.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:20.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:20.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:20.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:21 smithi044 bash[22676]: cluster 2024-09-21T05:04:19.880916+0000 mgr.a (mgr.14388) 17741 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:21 smithi044 bash[22676]: audit 2024-09-21T05:04:20.413645+0000 mgr.a (mgr.14388) 17742 : audit [DBG] from='client.381825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:21 smithi179 bash[23186]: cluster 2024-09-21T05:04:19.880916+0000 mgr.a (mgr.14388) 17741 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:21 smithi179 bash[23186]: audit 2024-09-21T05:04:20.413645+0000 mgr.a (mgr.14388) 17742 : audit [DBG] from='client.381825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:21 smithi049 bash[23528]: cluster 2024-09-21T05:04:19.880916+0000 mgr.a (mgr.14388) 17741 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:21 smithi049 bash[23528]: audit 2024-09-21T05:04:20.413645+0000 mgr.a (mgr.14388) 17742 : audit [DBG] from='client.381825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:23.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:23 smithi044 bash[22676]: cluster 2024-09-21T05:04:21.883907+0000 mgr.a (mgr.14388) 17743 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:23.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:23 smithi179 bash[23186]: cluster 2024-09-21T05:04:21.883907+0000 mgr.a (mgr.14388) 17743 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:23 smithi049 bash[23528]: cluster 2024-09-21T05:04:21.883907+0000 mgr.a (mgr.14388) 17743 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:25.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:25 smithi044 bash[22676]: cluster 2024-09-21T05:04:23.884743+0000 mgr.a (mgr.14388) 17744 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:04:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:25 smithi179 bash[23186]: cluster 2024-09-21T05:04:23.884743+0000 mgr.a (mgr.14388) 17744 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:04:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:25 smithi049 bash[23528]: cluster 2024-09-21T05:04:23.884743+0000 mgr.a (mgr.14388) 17744 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:04:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:26.632 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:26.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:26.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:26.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:26.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:27.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:27 smithi044 bash[22676]: cluster 2024-09-21T05:04:25.886195+0000 mgr.a (mgr.14388) 17745 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:27.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:27 smithi044 bash[22676]: audit 2024-09-21T05:04:26.170884+0000 mgr.a (mgr.14388) 17746 : audit [DBG] from='client.381897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:27 smithi179 bash[23186]: cluster 2024-09-21T05:04:25.886195+0000 mgr.a (mgr.14388) 17745 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:27 smithi179 bash[23186]: audit 2024-09-21T05:04:26.170884+0000 mgr.a (mgr.14388) 17746 : audit [DBG] from='client.381897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:27 smithi049 bash[23528]: cluster 2024-09-21T05:04:25.886195+0000 mgr.a (mgr.14388) 17745 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:27 smithi049 bash[23528]: audit 2024-09-21T05:04:26.170884+0000 mgr.a (mgr.14388) 17746 : audit [DBG] from='client.381897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:29.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:29 smithi179 bash[23186]: cluster 2024-09-21T05:04:27.887131+0000 mgr.a (mgr.14388) 17747 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:04:29.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:29 smithi179 bash[23186]: audit 2024-09-21T05:04:28.086554+0000 mon.a (mon.0) 14091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:29 smithi179 bash[23186]: audit 2024-09-21T05:04:28.095245+0000 mon.a (mon.0) 14092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:29 smithi179 bash[23186]: audit 2024-09-21T05:04:28.106081+0000 mon.a (mon.0) 14093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:29 smithi179 bash[23186]: audit 2024-09-21T05:04:28.380717+0000 mon.a (mon.0) 14094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:29 smithi179 bash[23186]: audit 2024-09-21T05:04:28.389033+0000 mon.a (mon.0) 14095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.464 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:29 smithi179 bash[23186]: audit 2024-09-21T05:04:28.398911+0000 mon.a (mon.0) 14096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:29 smithi044 bash[22676]: cluster 2024-09-21T05:04:27.887131+0000 mgr.a (mgr.14388) 17747 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:04:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:29 smithi044 bash[22676]: audit 2024-09-21T05:04:28.086554+0000 mon.a (mon.0) 14091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:29 smithi044 bash[22676]: audit 2024-09-21T05:04:28.095245+0000 mon.a (mon.0) 14092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:29 smithi044 bash[22676]: audit 2024-09-21T05:04:28.106081+0000 mon.a (mon.0) 14093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:29 smithi044 bash[22676]: audit 2024-09-21T05:04:28.380717+0000 mon.a (mon.0) 14094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:29 smithi044 bash[22676]: audit 2024-09-21T05:04:28.389033+0000 mon.a (mon.0) 14095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:29 smithi044 bash[22676]: audit 2024-09-21T05:04:28.398911+0000 mon.a (mon.0) 14096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:29 smithi049 bash[23528]: cluster 2024-09-21T05:04:27.887131+0000 mgr.a (mgr.14388) 17747 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:04:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:29 smithi049 bash[23528]: audit 2024-09-21T05:04:28.086554+0000 mon.a (mon.0) 14091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:29 smithi049 bash[23528]: audit 2024-09-21T05:04:28.095245+0000 mon.a (mon.0) 14092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:29 smithi049 bash[23528]: audit 2024-09-21T05:04:28.106081+0000 mon.a (mon.0) 14093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:29 smithi049 bash[23528]: audit 2024-09-21T05:04:28.380717+0000 mon.a (mon.0) 14094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:29 smithi049 bash[23528]: audit 2024-09-21T05:04:28.389033+0000 mon.a (mon.0) 14095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:29 smithi049 bash[23528]: audit 2024-09-21T05:04:28.398911+0000 mon.a (mon.0) 14096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:31 smithi049 bash[23528]: cluster 2024-09-21T05:04:29.887951+0000 mgr.a (mgr.14388) 17748 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:04:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:31 smithi044 bash[22676]: cluster 2024-09-21T05:04:29.887951+0000 mgr.a (mgr.14388) 17748 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:04:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:31 smithi179 bash[23186]: cluster 2024-09-21T05:04:29.887951+0000 mgr.a (mgr.14388) 17748 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:04:31.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:31.634 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:31.634 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:32.198 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:32 smithi049 bash[23528]: audit 2024-09-21T05:04:31.476213+0000 mon.a (mon.0) 14097 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:04:32.198 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:32 smithi049 bash[23528]: audit 2024-09-21T05:04:31.482962+0000 mon.a (mon.0) 14098 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:04:32.198 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:32 smithi049 bash[23528]: audit 2024-09-21T05:04:31.484799+0000 mon.a (mon.0) 14099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:04:32.198 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:32 smithi049 bash[23528]: audit 2024-09-21T05:04:31.496226+0000 mon.a (mon.0) 14100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:32.198 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:32 smithi049 bash[23528]: audit 2024-09-21T05:04:31.502484+0000 mon.a (mon.0) 14101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:04:32.198 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:32 smithi049 bash[23528]: audit 2024-09-21T05:04:31.504833+0000 mgr.a (mgr.14388) 17749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:04:32.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22930]: debug 2024-09-21T05:04:32.289+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:04:32.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22930]: debug 2024-09-21T05:04:32.309+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:04:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22676]: audit 2024-09-21T05:04:31.476213+0000 mon.a (mon.0) 14097 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:04:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22676]: audit 2024-09-21T05:04:31.482962+0000 mon.a (mon.0) 14098 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:04:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22676]: audit 2024-09-21T05:04:31.484799+0000 mon.a (mon.0) 14099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:04:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22676]: audit 2024-09-21T05:04:31.496226+0000 mon.a (mon.0) 14100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22676]: audit 2024-09-21T05:04:31.502484+0000 mon.a (mon.0) 14101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:04:32.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:32 smithi044 bash[22676]: audit 2024-09-21T05:04:31.504833+0000 mgr.a (mgr.14388) 17749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:04:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:32 smithi179 bash[23186]: audit 2024-09-21T05:04:31.476213+0000 mon.a (mon.0) 14097 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:04:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:32 smithi179 bash[23186]: audit 2024-09-21T05:04:31.482962+0000 mon.a (mon.0) 14098 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:04:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:32 smithi179 bash[23186]: audit 2024-09-21T05:04:31.484799+0000 mon.a (mon.0) 14099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:04:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:32 smithi179 bash[23186]: audit 2024-09-21T05:04:31.496226+0000 mon.a (mon.0) 14100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:32 smithi179 bash[23186]: audit 2024-09-21T05:04:31.502484+0000 mon.a (mon.0) 14101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:04:32.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:32 smithi179 bash[23186]: audit 2024-09-21T05:04:31.504833+0000 mgr.a (mgr.14388) 17749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:04:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:33 smithi179 bash[23186]: cluster 2024-09-21T05:04:31.889519+0000 mgr.a (mgr.14388) 17750 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:04:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:33 smithi179 bash[23186]: audit 2024-09-21T05:04:31.980215+0000 mgr.a (mgr.14388) 17751 : audit [DBG] from='client.382002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:33 smithi179 bash[23186]: audit 2024-09-21T05:04:32.296885+0000 mgr.a (mgr.14388) 17752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:04:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:33 smithi179 bash[23186]: cephadm 2024-09-21T05:04:32.314963+0000 mgr.a (mgr.14388) 17753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:04:33.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:33 smithi049 bash[23528]: cluster 2024-09-21T05:04:31.889519+0000 mgr.a (mgr.14388) 17750 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:04:33.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:33 smithi049 bash[23528]: audit 2024-09-21T05:04:31.980215+0000 mgr.a (mgr.14388) 17751 : audit [DBG] from='client.382002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:33.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:33 smithi049 bash[23528]: audit 2024-09-21T05:04:32.296885+0000 mgr.a (mgr.14388) 17752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:04:33.776 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:33 smithi049 bash[23528]: cephadm 2024-09-21T05:04:32.314963+0000 mgr.a (mgr.14388) 17753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:04:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:33 smithi044 bash[22676]: cluster 2024-09-21T05:04:31.889519+0000 mgr.a (mgr.14388) 17750 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:04:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:33 smithi044 bash[22676]: audit 2024-09-21T05:04:31.980215+0000 mgr.a (mgr.14388) 17751 : audit [DBG] from='client.382002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:33 smithi044 bash[22676]: audit 2024-09-21T05:04:32.296885+0000 mgr.a (mgr.14388) 17752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:04:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:33 smithi044 bash[22676]: cephadm 2024-09-21T05:04:32.314963+0000 mgr.a (mgr.14388) 17753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:04:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:35 smithi179 bash[23186]: cluster 2024-09-21T05:04:33.890397+0000 mgr.a (mgr.14388) 17754 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:35 smithi049 bash[23528]: cluster 2024-09-21T05:04:33.890397+0000 mgr.a (mgr.14388) 17754 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:35 smithi044 bash[22676]: cluster 2024-09-21T05:04:33.890397+0000 mgr.a (mgr.14388) 17754 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:37.595 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:37 smithi044 bash[22676]: cluster 2024-09-21T05:04:35.892641+0000 mgr.a (mgr.14388) 17755 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:37.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:37.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:37.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:37 smithi049 bash[23528]: cluster 2024-09-21T05:04:35.892641+0000 mgr.a (mgr.14388) 17755 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:37 smithi179 bash[23186]: cluster 2024-09-21T05:04:35.892641+0000 mgr.a (mgr.14388) 17755 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:38.477 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:38.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:38.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:38.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:38.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:39.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:39 smithi044 bash[22676]: cluster 2024-09-21T05:04:37.893410+0000 mgr.a (mgr.14388) 17756 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:39.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:39 smithi044 bash[22676]: audit 2024-09-21T05:04:38.047975+0000 mgr.a (mgr.14388) 17757 : audit [DBG] from='client.382152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:39.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:39 smithi044 bash[22676]: audit 2024-09-21T05:04:38.632333+0000 mon.a (mon.0) 14102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:39.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:39 smithi044 bash[22676]: audit 2024-09-21T05:04:38.641151+0000 mon.a (mon.0) 14103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:39.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:39 smithi044 bash[22676]: audit 2024-09-21T05:04:38.651588+0000 mon.a (mon.0) 14104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:39 smithi179 bash[23186]: cluster 2024-09-21T05:04:37.893410+0000 mgr.a (mgr.14388) 17756 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:39 smithi179 bash[23186]: audit 2024-09-21T05:04:38.047975+0000 mgr.a (mgr.14388) 17757 : audit [DBG] from='client.382152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:39 smithi179 bash[23186]: audit 2024-09-21T05:04:38.632333+0000 mon.a (mon.0) 14102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:39 smithi179 bash[23186]: audit 2024-09-21T05:04:38.641151+0000 mon.a (mon.0) 14103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:39 smithi179 bash[23186]: audit 2024-09-21T05:04:38.651588+0000 mon.a (mon.0) 14104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:39 smithi049 bash[23528]: cluster 2024-09-21T05:04:37.893410+0000 mgr.a (mgr.14388) 17756 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:39 smithi049 bash[23528]: audit 2024-09-21T05:04:38.047975+0000 mgr.a (mgr.14388) 17757 : audit [DBG] from='client.382152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:39 smithi049 bash[23528]: audit 2024-09-21T05:04:38.632333+0000 mon.a (mon.0) 14102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:39 smithi049 bash[23528]: audit 2024-09-21T05:04:38.641151+0000 mon.a (mon.0) 14103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:39 smithi049 bash[23528]: audit 2024-09-21T05:04:38.651588+0000 mon.a (mon.0) 14104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:41.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:41 smithi044 bash[22676]: cluster 2024-09-21T05:04:39.894292+0000 mgr.a (mgr.14388) 17758 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:41 smithi179 bash[23186]: cluster 2024-09-21T05:04:39.894292+0000 mgr.a (mgr.14388) 17758 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:41 smithi049 bash[23528]: cluster 2024-09-21T05:04:39.894292+0000 mgr.a (mgr.14388) 17758 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:43.479 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:43.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:43.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:43 smithi044 bash[22676]: cluster 2024-09-21T05:04:41.897322+0000 mgr.a (mgr.14388) 17759 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:43 smithi179 bash[23186]: cluster 2024-09-21T05:04:41.897322+0000 mgr.a (mgr.14388) 17759 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:43 smithi049 bash[23528]: cluster 2024-09-21T05:04:41.897322+0000 mgr.a (mgr.14388) 17759 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:44.276 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:44.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:44.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:44.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:44.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:45 smithi044 bash[22676]: audit 2024-09-21T05:04:43.815462+0000 mgr.a (mgr.14388) 17760 : audit [DBG] from='client.382230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:45 smithi044 bash[22676]: cluster 2024-09-21T05:04:43.897946+0000 mgr.a (mgr.14388) 17761 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:45 smithi179 bash[23186]: audit 2024-09-21T05:04:43.815462+0000 mgr.a (mgr.14388) 17760 : audit [DBG] from='client.382230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:45 smithi179 bash[23186]: cluster 2024-09-21T05:04:43.897946+0000 mgr.a (mgr.14388) 17761 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:45 smithi049 bash[23528]: audit 2024-09-21T05:04:43.815462+0000 mgr.a (mgr.14388) 17760 : audit [DBG] from='client.382230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:45 smithi049 bash[23528]: cluster 2024-09-21T05:04:43.897946+0000 mgr.a (mgr.14388) 17761 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:47 smithi179 bash[23186]: cluster 2024-09-21T05:04:45.900296+0000 mgr.a (mgr.14388) 17762 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:47 smithi044 bash[22676]: cluster 2024-09-21T05:04:45.900296+0000 mgr.a (mgr.14388) 17762 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:47 smithi049 bash[23528]: cluster 2024-09-21T05:04:45.900296+0000 mgr.a (mgr.14388) 17762 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:04:49.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:49.278 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:49.279 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:49.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:49 smithi179 bash[23186]: cluster 2024-09-21T05:04:47.901078+0000 mgr.a (mgr.14388) 17763 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:49.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:49 smithi179 bash[23186]: audit 2024-09-21T05:04:48.317056+0000 mon.a (mon.0) 14105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:49 smithi179 bash[23186]: audit 2024-09-21T05:04:48.323771+0000 mon.a (mon.0) 14106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:49 smithi179 bash[23186]: audit 2024-09-21T05:04:48.332573+0000 mon.a (mon.0) 14107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:49 smithi179 bash[23186]: audit 2024-09-21T05:04:48.608293+0000 mon.a (mon.0) 14108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:49 smithi179 bash[23186]: audit 2024-09-21T05:04:48.616937+0000 mon.a (mon.0) 14109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:49 smithi179 bash[23186]: audit 2024-09-21T05:04:48.627135+0000 mon.a (mon.0) 14110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:49 smithi044 bash[22676]: cluster 2024-09-21T05:04:47.901078+0000 mgr.a (mgr.14388) 17763 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:49.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:49 smithi044 bash[22676]: audit 2024-09-21T05:04:48.317056+0000 mon.a (mon.0) 14105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:49 smithi044 bash[22676]: audit 2024-09-21T05:04:48.323771+0000 mon.a (mon.0) 14106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:49 smithi044 bash[22676]: audit 2024-09-21T05:04:48.332573+0000 mon.a (mon.0) 14107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:49 smithi044 bash[22676]: audit 2024-09-21T05:04:48.608293+0000 mon.a (mon.0) 14108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:49 smithi044 bash[22676]: audit 2024-09-21T05:04:48.616937+0000 mon.a (mon.0) 14109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:49 smithi044 bash[22676]: audit 2024-09-21T05:04:48.627135+0000 mon.a (mon.0) 14110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:49 smithi049 bash[23528]: cluster 2024-09-21T05:04:47.901078+0000 mgr.a (mgr.14388) 17763 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:49 smithi049 bash[23528]: audit 2024-09-21T05:04:48.317056+0000 mon.a (mon.0) 14105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:49 smithi049 bash[23528]: audit 2024-09-21T05:04:48.323771+0000 mon.a (mon.0) 14106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:49 smithi049 bash[23528]: audit 2024-09-21T05:04:48.332573+0000 mon.a (mon.0) 14107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:49 smithi049 bash[23528]: audit 2024-09-21T05:04:48.608293+0000 mon.a (mon.0) 14108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:49 smithi049 bash[23528]: audit 2024-09-21T05:04:48.616937+0000 mon.a (mon.0) 14109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:49 smithi049 bash[23528]: audit 2024-09-21T05:04:48.627135+0000 mon.a (mon.0) 14110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:50.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:50 smithi044 bash[22676]: audit 2024-09-21T05:04:49.617734+0000 mgr.a (mgr.14388) 17764 : audit [DBG] from='client.382305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:50 smithi179 bash[23186]: audit 2024-09-21T05:04:49.617734+0000 mgr.a (mgr.14388) 17764 : audit [DBG] from='client.382305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:50.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:50 smithi049 bash[23528]: audit 2024-09-21T05:04:49.617734+0000 mgr.a (mgr.14388) 17764 : audit [DBG] from='client.382305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:51 smithi049 bash[23528]: cluster 2024-09-21T05:04:49.901629+0000 mgr.a (mgr.14388) 17765 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:51 smithi044 bash[22676]: cluster 2024-09-21T05:04:49.901629+0000 mgr.a (mgr.14388) 17765 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:51 smithi179 bash[23186]: cluster 2024-09-21T05:04:49.901629+0000 mgr.a (mgr.14388) 17765 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:53 smithi049 bash[23528]: cluster 2024-09-21T05:04:51.903989+0000 mgr.a (mgr.14388) 17766 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:04:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:53 smithi044 bash[22676]: cluster 2024-09-21T05:04:51.903989+0000 mgr.a (mgr.14388) 17766 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:04:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:53 smithi179 bash[23186]: cluster 2024-09-21T05:04:51.903989+0000 mgr.a (mgr.14388) 17766 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:04:55.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:04:55.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:04:55.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:04:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:55 smithi044 bash[22676]: cluster 2024-09-21T05:04:53.904770+0000 mgr.a (mgr.14388) 17767 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:55 smithi179 bash[23186]: cluster 2024-09-21T05:04:53.904770+0000 mgr.a (mgr.14388) 17767 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:55 smithi049 bash[23528]: cluster 2024-09-21T05:04:53.904770+0000 mgr.a (mgr.14388) 17767 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:04:55.846 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:04:55.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:04:55.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:04:55.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:04:55.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:04:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:56 smithi044 bash[22676]: audit 2024-09-21T05:04:55.415031+0000 mgr.a (mgr.14388) 17768 : audit [DBG] from='client.382377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:56.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:56 smithi179 bash[23186]: audit 2024-09-21T05:04:55.415031+0000 mgr.a (mgr.14388) 17768 : audit [DBG] from='client.382377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:56 smithi049 bash[23528]: audit 2024-09-21T05:04:55.415031+0000 mgr.a (mgr.14388) 17768 : audit [DBG] from='client.382377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:04:57.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:57 smithi044 bash[22676]: cluster 2024-09-21T05:04:55.906176+0000 mgr.a (mgr.14388) 17769 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:57 smithi179 bash[23186]: cluster 2024-09-21T05:04:55.906176+0000 mgr.a (mgr.14388) 17769 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:57 smithi049 bash[23528]: cluster 2024-09-21T05:04:55.906176+0000 mgr.a (mgr.14388) 17769 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:04:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:59 smithi044 bash[22676]: cluster 2024-09-21T05:04:57.906911+0000 mgr.a (mgr.14388) 17770 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:04:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:59 smithi044 bash[22676]: audit 2024-09-21T05:04:58.866918+0000 mon.a (mon.0) 14111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:59 smithi044 bash[22676]: audit 2024-09-21T05:04:58.876494+0000 mon.a (mon.0) 14112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:04:59 smithi044 bash[22676]: audit 2024-09-21T05:04:58.888321+0000 mon.a (mon.0) 14113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:59 smithi179 bash[23186]: cluster 2024-09-21T05:04:57.906911+0000 mgr.a (mgr.14388) 17770 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:04:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:59 smithi179 bash[23186]: audit 2024-09-21T05:04:58.866918+0000 mon.a (mon.0) 14111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:59 smithi179 bash[23186]: audit 2024-09-21T05:04:58.876494+0000 mon.a (mon.0) 14112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:04:59 smithi179 bash[23186]: audit 2024-09-21T05:04:58.888321+0000 mon.a (mon.0) 14113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:59 smithi049 bash[23528]: cluster 2024-09-21T05:04:57.906911+0000 mgr.a (mgr.14388) 17770 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:04:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:59 smithi049 bash[23528]: audit 2024-09-21T05:04:58.866918+0000 mon.a (mon.0) 14111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:59 smithi049 bash[23528]: audit 2024-09-21T05:04:58.876494+0000 mon.a (mon.0) 14112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:04:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:04:59 smithi049 bash[23528]: audit 2024-09-21T05:04:58.888321+0000 mon.a (mon.0) 14113 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:00.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:00.848 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:00.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:01 smithi044 bash[22676]: cluster 2024-09-21T05:04:59.907516+0000 mgr.a (mgr.14388) 17771 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:05:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:01 smithi179 bash[23186]: cluster 2024-09-21T05:04:59.907516+0000 mgr.a (mgr.14388) 17771 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:05:01.638 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:01.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:01.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:01.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:01.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:01.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:01 smithi049 bash[23528]: cluster 2024-09-21T05:04:59.907516+0000 mgr.a (mgr.14388) 17771 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:05:02.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:02 smithi044 bash[22676]: audit 2024-09-21T05:05:01.187591+0000 mgr.a (mgr.14388) 17772 : audit [DBG] from='client.382455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:02 smithi179 bash[23186]: audit 2024-09-21T05:05:01.187591+0000 mgr.a (mgr.14388) 17772 : audit [DBG] from='client.382455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:02.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:02 smithi049 bash[23528]: audit 2024-09-21T05:05:01.187591+0000 mgr.a (mgr.14388) 17772 : audit [DBG] from='client.382455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:03 smithi044 bash[22676]: cluster 2024-09-21T05:05:01.910533+0000 mgr.a (mgr.14388) 17773 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:03 smithi179 bash[23186]: cluster 2024-09-21T05:05:01.910533+0000 mgr.a (mgr.14388) 17773 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:03 smithi049 bash[23528]: cluster 2024-09-21T05:05:01.910533+0000 mgr.a (mgr.14388) 17773 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:05 smithi044 bash[22676]: cluster 2024-09-21T05:05:03.911309+0000 mgr.a (mgr.14388) 17774 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:05:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:05 smithi179 bash[23186]: cluster 2024-09-21T05:05:03.911309+0000 mgr.a (mgr.14388) 17774 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:05:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:05 smithi049 bash[23528]: cluster 2024-09-21T05:05:03.911309+0000 mgr.a (mgr.14388) 17774 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:05:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:06.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:06.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:07.424 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:07.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:07.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:07.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:07.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:07 smithi044 bash[22676]: cluster 2024-09-21T05:05:05.913372+0000 mgr.a (mgr.14388) 17775 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:05:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:07 smithi179 bash[23186]: cluster 2024-09-21T05:05:05.913372+0000 mgr.a (mgr.14388) 17775 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:05:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:07 smithi049 bash[23528]: cluster 2024-09-21T05:05:05.913372+0000 mgr.a (mgr.14388) 17775 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:05:08.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:08 smithi044 bash[22676]: audit 2024-09-21T05:05:06.974387+0000 mgr.a (mgr.14388) 17776 : audit [DBG] from='client.382533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:08 smithi179 bash[23186]: audit 2024-09-21T05:05:06.974387+0000 mgr.a (mgr.14388) 17776 : audit [DBG] from='client.382533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:08 smithi049 bash[23528]: audit 2024-09-21T05:05:06.974387+0000 mgr.a (mgr.14388) 17776 : audit [DBG] from='client.382533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:09 smithi049 bash[23528]: cluster 2024-09-21T05:05:07.914309+0000 mgr.a (mgr.14388) 17777 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:09 smithi049 bash[23528]: audit 2024-09-21T05:05:08.551221+0000 mon.a (mon.0) 14114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:09 smithi049 bash[23528]: audit 2024-09-21T05:05:08.559561+0000 mon.a (mon.0) 14115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:09 smithi049 bash[23528]: audit 2024-09-21T05:05:08.570114+0000 mon.a (mon.0) 14116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:09 smithi049 bash[23528]: audit 2024-09-21T05:05:08.796570+0000 mon.a (mon.0) 14117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:09 smithi049 bash[23528]: audit 2024-09-21T05:05:08.805008+0000 mon.a (mon.0) 14118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:09 smithi049 bash[23528]: audit 2024-09-21T05:05:08.815038+0000 mon.a (mon.0) 14119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.889 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:09 smithi179 bash[23186]: cluster 2024-09-21T05:05:07.914309+0000 mgr.a (mgr.14388) 17777 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:09.889 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:09 smithi179 bash[23186]: audit 2024-09-21T05:05:08.551221+0000 mon.a (mon.0) 14114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.889 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:09 smithi179 bash[23186]: audit 2024-09-21T05:05:08.559561+0000 mon.a (mon.0) 14115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.889 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:09 smithi179 bash[23186]: audit 2024-09-21T05:05:08.570114+0000 mon.a (mon.0) 14116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.890 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:09 smithi179 bash[23186]: audit 2024-09-21T05:05:08.796570+0000 mon.a (mon.0) 14117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.890 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:09 smithi179 bash[23186]: audit 2024-09-21T05:05:08.805008+0000 mon.a (mon.0) 14118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.890 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:09 smithi179 bash[23186]: audit 2024-09-21T05:05:08.815038+0000 mon.a (mon.0) 14119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:09 smithi044 bash[22676]: cluster 2024-09-21T05:05:07.914309+0000 mgr.a (mgr.14388) 17777 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:09 smithi044 bash[22676]: audit 2024-09-21T05:05:08.551221+0000 mon.a (mon.0) 14114 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:09 smithi044 bash[22676]: audit 2024-09-21T05:05:08.559561+0000 mon.a (mon.0) 14115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:09 smithi044 bash[22676]: audit 2024-09-21T05:05:08.570114+0000 mon.a (mon.0) 14116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:09 smithi044 bash[22676]: audit 2024-09-21T05:05:08.796570+0000 mon.a (mon.0) 14117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:09 smithi044 bash[22676]: audit 2024-09-21T05:05:08.805008+0000 mon.a (mon.0) 14118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:09 smithi044 bash[22676]: audit 2024-09-21T05:05:08.815038+0000 mon.a (mon.0) 14119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:11 smithi044 bash[22676]: cluster 2024-09-21T05:05:09.915090+0000 mgr.a (mgr.14388) 17778 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:11 smithi179 bash[23186]: cluster 2024-09-21T05:05:09.915090+0000 mgr.a (mgr.14388) 17778 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:11 smithi049 bash[23528]: cluster 2024-09-21T05:05:09.915090+0000 mgr.a (mgr.14388) 17778 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:12.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:12.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:12.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:13.197 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:13.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:13.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:13.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:13.198 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:13 smithi044 bash[22676]: cluster 2024-09-21T05:05:11.917332+0000 mgr.a (mgr.14388) 17779 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:13 smithi179 bash[23186]: cluster 2024-09-21T05:05:11.917332+0000 mgr.a (mgr.14388) 17779 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:13 smithi049 bash[23528]: cluster 2024-09-21T05:05:11.917332+0000 mgr.a (mgr.14388) 17779 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:14.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:14 smithi044 bash[22676]: audit 2024-09-21T05:05:12.762645+0000 mgr.a (mgr.14388) 17780 : audit [DBG] from='client.382611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:14 smithi179 bash[23186]: audit 2024-09-21T05:05:12.762645+0000 mgr.a (mgr.14388) 17780 : audit [DBG] from='client.382611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:15.056 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:14 smithi049 bash[23528]: audit 2024-09-21T05:05:12.762645+0000 mgr.a (mgr.14388) 17780 : audit [DBG] from='client.382611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:15.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:15 smithi044 bash[22676]: cluster 2024-09-21T05:05:13.918215+0000 mgr.a (mgr.14388) 17781 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:15 smithi179 bash[23186]: cluster 2024-09-21T05:05:13.918215+0000 mgr.a (mgr.14388) 17781 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:15 smithi049 bash[23528]: cluster 2024-09-21T05:05:13.918215+0000 mgr.a (mgr.14388) 17781 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:17.890 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:17 smithi044 bash[22676]: cluster 2024-09-21T05:05:15.920495+0000 mgr.a (mgr.14388) 17782 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:17 smithi179 bash[23186]: cluster 2024-09-21T05:05:15.920495+0000 mgr.a (mgr.14388) 17782 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:17 smithi049 bash[23528]: cluster 2024-09-21T05:05:15.920495+0000 mgr.a (mgr.14388) 17782 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:18.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:18.200 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:18.200 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:18.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:19 smithi044 bash[22676]: cluster 2024-09-21T05:05:17.921301+0000 mgr.a (mgr.14388) 17783 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:19 smithi044 bash[22676]: audit 2024-09-21T05:05:18.533048+0000 mgr.a (mgr.14388) 17784 : audit [DBG] from='client.382689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:19 smithi044 bash[22676]: audit 2024-09-21T05:05:19.106613+0000 mon.a (mon.0) 14120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:19 smithi044 bash[22676]: audit 2024-09-21T05:05:19.115226+0000 mon.a (mon.0) 14121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:19 smithi044 bash[22676]: audit 2024-09-21T05:05:19.125563+0000 mon.a (mon.0) 14122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:19 smithi179 bash[23186]: cluster 2024-09-21T05:05:17.921301+0000 mgr.a (mgr.14388) 17783 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:19 smithi179 bash[23186]: audit 2024-09-21T05:05:18.533048+0000 mgr.a (mgr.14388) 17784 : audit [DBG] from='client.382689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:20.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:19 smithi179 bash[23186]: audit 2024-09-21T05:05:19.106613+0000 mon.a (mon.0) 14120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:20.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:19 smithi179 bash[23186]: audit 2024-09-21T05:05:19.115226+0000 mon.a (mon.0) 14121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:20.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:19 smithi179 bash[23186]: audit 2024-09-21T05:05:19.125563+0000 mon.a (mon.0) 14122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:19 smithi049 bash[23528]: cluster 2024-09-21T05:05:17.921301+0000 mgr.a (mgr.14388) 17783 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:19 smithi049 bash[23528]: audit 2024-09-21T05:05:18.533048+0000 mgr.a (mgr.14388) 17784 : audit [DBG] from='client.382689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:19 smithi049 bash[23528]: audit 2024-09-21T05:05:19.106613+0000 mon.a (mon.0) 14120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:19 smithi049 bash[23528]: audit 2024-09-21T05:05:19.115226+0000 mon.a (mon.0) 14121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:19 smithi049 bash[23528]: audit 2024-09-21T05:05:19.125563+0000 mon.a (mon.0) 14122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:21 smithi044 bash[22676]: cluster 2024-09-21T05:05:19.921960+0000 mgr.a (mgr.14388) 17785 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:21 smithi179 bash[23186]: cluster 2024-09-21T05:05:19.921960+0000 mgr.a (mgr.14388) 17785 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:22.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:21 smithi049 bash[23528]: cluster 2024-09-21T05:05:19.921960+0000 mgr.a (mgr.14388) 17785 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:23.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:23.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:23.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:23 smithi044 bash[22676]: cluster 2024-09-21T05:05:21.924215+0000 mgr.a (mgr.14388) 17786 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:23 smithi179 bash[23186]: cluster 2024-09-21T05:05:21.924215+0000 mgr.a (mgr.14388) 17786 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:23 smithi049 bash[23528]: cluster 2024-09-21T05:05:21.924215+0000 mgr.a (mgr.14388) 17786 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:24.754 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:24.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:24.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:24.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:24.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:25 smithi044 bash[22676]: cluster 2024-09-21T05:05:23.924973+0000 mgr.a (mgr.14388) 17787 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:25 smithi044 bash[22676]: audit 2024-09-21T05:05:24.310645+0000 mgr.a (mgr.14388) 17788 : audit [DBG] from='client.382767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:25 smithi179 bash[23186]: cluster 2024-09-21T05:05:23.924973+0000 mgr.a (mgr.14388) 17787 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:25 smithi179 bash[23186]: audit 2024-09-21T05:05:24.310645+0000 mgr.a (mgr.14388) 17788 : audit [DBG] from='client.382767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:26.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:25 smithi049 bash[23528]: cluster 2024-09-21T05:05:23.924973+0000 mgr.a (mgr.14388) 17787 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:26.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:25 smithi049 bash[23528]: audit 2024-09-21T05:05:24.310645+0000 mgr.a (mgr.14388) 17788 : audit [DBG] from='client.382767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:27 smithi179 bash[23186]: cluster 2024-09-21T05:05:25.927364+0000 mgr.a (mgr.14388) 17789 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:27 smithi044 bash[22676]: cluster 2024-09-21T05:05:25.927364+0000 mgr.a (mgr.14388) 17789 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:27 smithi049 bash[23528]: cluster 2024-09-21T05:05:25.927364+0000 mgr.a (mgr.14388) 17789 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:29.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:29 smithi179 bash[23186]: cluster 2024-09-21T05:05:27.928160+0000 mgr.a (mgr.14388) 17790 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:29 smithi179 bash[23186]: audit 2024-09-21T05:05:28.790374+0000 mon.a (mon.0) 14123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:29 smithi179 bash[23186]: audit 2024-09-21T05:05:28.798839+0000 mon.a (mon.0) 14124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:29 smithi179 bash[23186]: audit 2024-09-21T05:05:28.809290+0000 mon.a (mon.0) 14125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:29 smithi179 bash[23186]: audit 2024-09-21T05:05:29.021989+0000 mon.a (mon.0) 14126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:29 smithi179 bash[23186]: audit 2024-09-21T05:05:29.031811+0000 mon.a (mon.0) 14127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:29 smithi179 bash[23186]: audit 2024-09-21T05:05:29.043259+0000 mon.a (mon.0) 14128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:29 smithi044 bash[22676]: cluster 2024-09-21T05:05:27.928160+0000 mgr.a (mgr.14388) 17790 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:29 smithi044 bash[22676]: audit 2024-09-21T05:05:28.790374+0000 mon.a (mon.0) 14123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:29 smithi044 bash[22676]: audit 2024-09-21T05:05:28.798839+0000 mon.a (mon.0) 14124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:29 smithi044 bash[22676]: audit 2024-09-21T05:05:28.809290+0000 mon.a (mon.0) 14125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:29 smithi044 bash[22676]: audit 2024-09-21T05:05:29.021989+0000 mon.a (mon.0) 14126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:29 smithi044 bash[22676]: audit 2024-09-21T05:05:29.031811+0000 mon.a (mon.0) 14127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:29.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:29 smithi044 bash[22676]: audit 2024-09-21T05:05:29.043259+0000 mon.a (mon.0) 14128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:29 smithi049 bash[23528]: cluster 2024-09-21T05:05:27.928160+0000 mgr.a (mgr.14388) 17790 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:29 smithi049 bash[23528]: audit 2024-09-21T05:05:28.790374+0000 mon.a (mon.0) 14123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:29 smithi049 bash[23528]: audit 2024-09-21T05:05:28.798839+0000 mon.a (mon.0) 14124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:29 smithi049 bash[23528]: audit 2024-09-21T05:05:28.809290+0000 mon.a (mon.0) 14125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:29 smithi049 bash[23528]: audit 2024-09-21T05:05:29.021989+0000 mon.a (mon.0) 14126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:29 smithi049 bash[23528]: audit 2024-09-21T05:05:29.031811+0000 mon.a (mon.0) 14127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:29 smithi049 bash[23528]: audit 2024-09-21T05:05:29.043259+0000 mon.a (mon.0) 14128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:30.540 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:31 smithi044 bash[22676]: cluster 2024-09-21T05:05:29.928617+0000 mgr.a (mgr.14388) 17791 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:31 smithi044 bash[22676]: audit 2024-09-21T05:05:30.095818+0000 mgr.a (mgr.14388) 17792 : audit [DBG] from='client.382845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:31 smithi179 bash[23186]: cluster 2024-09-21T05:05:29.928617+0000 mgr.a (mgr.14388) 17791 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:31 smithi179 bash[23186]: audit 2024-09-21T05:05:30.095818+0000 mgr.a (mgr.14388) 17792 : audit [DBG] from='client.382845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:31 smithi049 bash[23528]: cluster 2024-09-21T05:05:29.928617+0000 mgr.a (mgr.14388) 17791 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:31 smithi049 bash[23528]: audit 2024-09-21T05:05:30.095818+0000 mgr.a (mgr.14388) 17792 : audit [DBG] from='client.382845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:32 smithi044 bash[22676]: audit 2024-09-21T05:05:32.375515+0000 mon.a (mon.0) 14129 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:05:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:32 smithi044 bash[22676]: audit 2024-09-21T05:05:32.383053+0000 mon.a (mon.0) 14130 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:05:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:32 smithi044 bash[22676]: audit 2024-09-21T05:05:32.384959+0000 mon.a (mon.0) 14131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:05:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:32 smithi044 bash[22676]: audit 2024-09-21T05:05:32.398086+0000 mon.a (mon.0) 14132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:32.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:32 smithi044 bash[22676]: audit 2024-09-21T05:05:32.404477+0000 mon.a (mon.0) 14133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:05:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:32 smithi179 bash[23186]: audit 2024-09-21T05:05:32.375515+0000 mon.a (mon.0) 14129 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:05:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:32 smithi179 bash[23186]: audit 2024-09-21T05:05:32.383053+0000 mon.a (mon.0) 14130 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:05:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:32 smithi179 bash[23186]: audit 2024-09-21T05:05:32.384959+0000 mon.a (mon.0) 14131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:05:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:32 smithi179 bash[23186]: audit 2024-09-21T05:05:32.398086+0000 mon.a (mon.0) 14132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:33.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:32 smithi179 bash[23186]: audit 2024-09-21T05:05:32.404477+0000 mon.a (mon.0) 14133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:05:33.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:32 smithi049 bash[23528]: audit 2024-09-21T05:05:32.375515+0000 mon.a (mon.0) 14129 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:05:33.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:32 smithi049 bash[23528]: audit 2024-09-21T05:05:32.383053+0000 mon.a (mon.0) 14130 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:05:33.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:32 smithi049 bash[23528]: audit 2024-09-21T05:05:32.384959+0000 mon.a (mon.0) 14131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:05:33.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:32 smithi049 bash[23528]: audit 2024-09-21T05:05:32.398086+0000 mon.a (mon.0) 14132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:33.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:32 smithi049 bash[23528]: audit 2024-09-21T05:05:32.404477+0000 mon.a (mon.0) 14133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:05:33.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:05:33 smithi044 bash[22930]: debug 2024-09-21T05:05:33.160+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:05:33.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:05:33 smithi044 bash[22930]: debug 2024-09-21T05:05:33.160+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:05:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:33 smithi049 bash[23528]: cluster 2024-09-21T05:05:31.931522+0000 mgr.a (mgr.14388) 17793 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:33.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:33 smithi049 bash[23528]: audit 2024-09-21T05:05:32.406945+0000 mgr.a (mgr.14388) 17794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:05:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:33 smithi044 bash[22676]: cluster 2024-09-21T05:05:31.931522+0000 mgr.a (mgr.14388) 17793 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:33 smithi044 bash[22676]: audit 2024-09-21T05:05:32.406945+0000 mgr.a (mgr.14388) 17794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:05:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:33 smithi179 bash[23186]: cluster 2024-09-21T05:05:31.931522+0000 mgr.a (mgr.14388) 17793 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:34.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:33 smithi179 bash[23186]: audit 2024-09-21T05:05:32.406945+0000 mgr.a (mgr.14388) 17794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:05:34.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:34 smithi044 bash[22676]: audit 2024-09-21T05:05:33.162105+0000 mgr.a (mgr.14388) 17795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:05:34.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:34 smithi044 bash[22676]: cephadm 2024-09-21T05:05:33.163652+0000 mgr.a (mgr.14388) 17796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:05:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:34 smithi179 bash[23186]: audit 2024-09-21T05:05:33.162105+0000 mgr.a (mgr.14388) 17795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:05:35.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:34 smithi179 bash[23186]: cephadm 2024-09-21T05:05:33.163652+0000 mgr.a (mgr.14388) 17796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:05:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:34 smithi049 bash[23528]: audit 2024-09-21T05:05:33.162105+0000 mgr.a (mgr.14388) 17795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:05:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:34 smithi049 bash[23528]: cephadm 2024-09-21T05:05:33.163652+0000 mgr.a (mgr.14388) 17796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:05:35.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:35.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:35.543 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:35 smithi044 bash[22676]: cluster 2024-09-21T05:05:33.932412+0000 mgr.a (mgr.14388) 17797 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:05:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:35 smithi179 bash[23186]: cluster 2024-09-21T05:05:33.932412+0000 mgr.a (mgr.14388) 17797 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:05:36.018 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:35 smithi049 bash[23528]: cluster 2024-09-21T05:05:33.932412+0000 mgr.a (mgr.14388) 17797 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 282 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:05:36.321 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:36.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:36.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:36.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:36.321 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:37.928 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:37 smithi044 bash[22676]: audit 2024-09-21T05:05:35.873747+0000 mgr.a (mgr.14388) 17798 : audit [DBG] from='client.383031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:37.928 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:37 smithi044 bash[22676]: cluster 2024-09-21T05:05:35.935631+0000 mgr.a (mgr.14388) 17799 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:37 smithi179 bash[23186]: audit 2024-09-21T05:05:35.873747+0000 mgr.a (mgr.14388) 17798 : audit [DBG] from='client.383031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:37 smithi179 bash[23186]: cluster 2024-09-21T05:05:35.935631+0000 mgr.a (mgr.14388) 17799 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:37 smithi049 bash[23528]: audit 2024-09-21T05:05:35.873747+0000 mgr.a (mgr.14388) 17798 : audit [DBG] from='client.383031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:37 smithi049 bash[23528]: cluster 2024-09-21T05:05:35.935631+0000 mgr.a (mgr.14388) 17799 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:39 smithi044 bash[22676]: cluster 2024-09-21T05:05:37.936229+0000 mgr.a (mgr.14388) 17800 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:05:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:39 smithi044 bash[22676]: audit 2024-09-21T05:05:39.321926+0000 mon.a (mon.0) 14134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:39 smithi044 bash[22676]: audit 2024-09-21T05:05:39.328122+0000 mon.a (mon.0) 14135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:39 smithi044 bash[22676]: audit 2024-09-21T05:05:39.337364+0000 mon.a (mon.0) 14136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:39 smithi179 bash[23186]: cluster 2024-09-21T05:05:37.936229+0000 mgr.a (mgr.14388) 17800 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:05:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:39 smithi179 bash[23186]: audit 2024-09-21T05:05:39.321926+0000 mon.a (mon.0) 14134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:39 smithi179 bash[23186]: audit 2024-09-21T05:05:39.328122+0000 mon.a (mon.0) 14135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:39 smithi179 bash[23186]: audit 2024-09-21T05:05:39.337364+0000 mon.a (mon.0) 14136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:39 smithi049 bash[23528]: cluster 2024-09-21T05:05:37.936229+0000 mgr.a (mgr.14388) 17800 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:05:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:39 smithi049 bash[23528]: audit 2024-09-21T05:05:39.321926+0000 mon.a (mon.0) 14134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:39 smithi049 bash[23528]: audit 2024-09-21T05:05:39.328122+0000 mon.a (mon.0) 14135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:39 smithi049 bash[23528]: audit 2024-09-21T05:05:39.337364+0000 mon.a (mon.0) 14136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:41.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:41.323 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:41 smithi044 bash[22676]: cluster 2024-09-21T05:05:39.936989+0000 mgr.a (mgr.14388) 17801 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:05:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:41 smithi179 bash[23186]: cluster 2024-09-21T05:05:39.936989+0000 mgr.a (mgr.14388) 17801 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:05:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:41 smithi049 bash[23528]: cluster 2024-09-21T05:05:39.936989+0000 mgr.a (mgr.14388) 17801 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:05:42.074 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:42.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:42.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:42.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:42.074 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:42 smithi044 bash[22676]: audit 2024-09-21T05:05:41.654639+0000 mgr.a (mgr.14388) 17802 : audit [DBG] from='client.383109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:42 smithi179 bash[23186]: audit 2024-09-21T05:05:41.654639+0000 mgr.a (mgr.14388) 17802 : audit [DBG] from='client.383109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:42 smithi049 bash[23528]: audit 2024-09-21T05:05:41.654639+0000 mgr.a (mgr.14388) 17802 : audit [DBG] from='client.383109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:43 smithi044 bash[22676]: cluster 2024-09-21T05:05:41.938519+0000 mgr.a (mgr.14388) 17803 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:43 smithi179 bash[23186]: cluster 2024-09-21T05:05:41.938519+0000 mgr.a (mgr.14388) 17803 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:43 smithi049 bash[23528]: cluster 2024-09-21T05:05:41.938519+0000 mgr.a (mgr.14388) 17803 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:45 smithi044 bash[22676]: cluster 2024-09-21T05:05:43.939426+0000 mgr.a (mgr.14388) 17804 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:45 smithi179 bash[23186]: cluster 2024-09-21T05:05:43.939426+0000 mgr.a (mgr.14388) 17804 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:45 smithi049 bash[23528]: cluster 2024-09-21T05:05:43.939426+0000 mgr.a (mgr.14388) 17804 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:47.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:47.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:47.841 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:47.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:47.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:47.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:47.841 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:47 smithi044 bash[22676]: cluster 2024-09-21T05:05:45.941717+0000 mgr.a (mgr.14388) 17805 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:48.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:47 smithi179 bash[23186]: cluster 2024-09-21T05:05:45.941717+0000 mgr.a (mgr.14388) 17805 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:47 smithi049 bash[23528]: cluster 2024-09-21T05:05:45.941717+0000 mgr.a (mgr.14388) 17805 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:05:48.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:48 smithi179 bash[23186]: audit 2024-09-21T05:05:47.409112+0000 mgr.a (mgr.14388) 17806 : audit [DBG] from='client.383187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:48 smithi044 bash[22676]: audit 2024-09-21T05:05:47.409112+0000 mgr.a (mgr.14388) 17806 : audit [DBG] from='client.383187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:48 smithi049 bash[23528]: audit 2024-09-21T05:05:47.409112+0000 mgr.a (mgr.14388) 17806 : audit [DBG] from='client.383187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:49 smithi044 bash[22676]: cluster 2024-09-21T05:05:47.942661+0000 mgr.a (mgr.14388) 17807 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:49 smithi044 bash[22676]: audit 2024-09-21T05:05:49.039505+0000 mon.a (mon.0) 14137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:49 smithi044 bash[22676]: audit 2024-09-21T05:05:49.047868+0000 mon.a (mon.0) 14138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:49 smithi044 bash[22676]: audit 2024-09-21T05:05:49.058367+0000 mon.a (mon.0) 14139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:49 smithi044 bash[22676]: audit 2024-09-21T05:05:49.169369+0000 mon.a (mon.0) 14140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:49.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:49 smithi044 bash[22676]: audit 2024-09-21T05:05:49.179240+0000 mon.a (mon.0) 14141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:49.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:49 smithi044 bash[22676]: audit 2024-09-21T05:05:49.190685+0000 mon.a (mon.0) 14142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:49 smithi179 bash[23186]: cluster 2024-09-21T05:05:47.942661+0000 mgr.a (mgr.14388) 17807 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:49 smithi179 bash[23186]: audit 2024-09-21T05:05:49.039505+0000 mon.a (mon.0) 14137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:49 smithi179 bash[23186]: audit 2024-09-21T05:05:49.047868+0000 mon.a (mon.0) 14138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:49 smithi179 bash[23186]: audit 2024-09-21T05:05:49.058367+0000 mon.a (mon.0) 14139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:49 smithi179 bash[23186]: audit 2024-09-21T05:05:49.169369+0000 mon.a (mon.0) 14140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:49 smithi179 bash[23186]: audit 2024-09-21T05:05:49.179240+0000 mon.a (mon.0) 14141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:49 smithi179 bash[23186]: audit 2024-09-21T05:05:49.190685+0000 mon.a (mon.0) 14142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:49 smithi049 bash[23528]: cluster 2024-09-21T05:05:47.942661+0000 mgr.a (mgr.14388) 17807 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:49 smithi049 bash[23528]: audit 2024-09-21T05:05:49.039505+0000 mon.a (mon.0) 14137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:49 smithi049 bash[23528]: audit 2024-09-21T05:05:49.047868+0000 mon.a (mon.0) 14138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:49 smithi049 bash[23528]: audit 2024-09-21T05:05:49.058367+0000 mon.a (mon.0) 14139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:49 smithi049 bash[23528]: audit 2024-09-21T05:05:49.169369+0000 mon.a (mon.0) 14140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:49 smithi049 bash[23528]: audit 2024-09-21T05:05:49.179240+0000 mon.a (mon.0) 14141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:49 smithi049 bash[23528]: audit 2024-09-21T05:05:49.190685+0000 mon.a (mon.0) 14142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:51 smithi044 bash[22676]: cluster 2024-09-21T05:05:49.943467+0000 mgr.a (mgr.14388) 17808 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:51 smithi179 bash[23186]: cluster 2024-09-21T05:05:49.943467+0000 mgr.a (mgr.14388) 17808 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:51 smithi049 bash[23528]: cluster 2024-09-21T05:05:49.943467+0000 mgr.a (mgr.14388) 17808 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:52.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:52.843 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:52.843 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:53.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:53.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:53.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:53.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:53.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:53.933 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:53 smithi049 bash[23528]: cluster 2024-09-21T05:05:51.945770+0000 mgr.a (mgr.14388) 17809 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:53 smithi044 bash[22676]: cluster 2024-09-21T05:05:51.945770+0000 mgr.a (mgr.14388) 17809 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:53 smithi179 bash[23186]: cluster 2024-09-21T05:05:51.945770+0000 mgr.a (mgr.14388) 17809 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:05:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:54 smithi044 bash[22676]: audit 2024-09-21T05:05:53.171450+0000 mgr.a (mgr.14388) 17810 : audit [DBG] from='client.383262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:54 smithi179 bash[23186]: audit 2024-09-21T05:05:53.171450+0000 mgr.a (mgr.14388) 17810 : audit [DBG] from='client.383262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:54 smithi049 bash[23528]: audit 2024-09-21T05:05:53.171450+0000 mgr.a (mgr.14388) 17810 : audit [DBG] from='client.383262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:05:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:55 smithi044 bash[22676]: cluster 2024-09-21T05:05:53.946628+0000 mgr.a (mgr.14388) 17811 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:55 smithi179 bash[23186]: cluster 2024-09-21T05:05:53.946628+0000 mgr.a (mgr.14388) 17811 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:55 smithi049 bash[23528]: cluster 2024-09-21T05:05:53.946628+0000 mgr.a (mgr.14388) 17811 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 286 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:05:57.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:57 smithi044 bash[22676]: cluster 2024-09-21T05:05:55.948885+0000 mgr.a (mgr.14388) 17812 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:05:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:57 smithi179 bash[23186]: cluster 2024-09-21T05:05:55.948885+0000 mgr.a (mgr.14388) 17812 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:05:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:57 smithi049 bash[23528]: cluster 2024-09-21T05:05:55.948885+0000 mgr.a (mgr.14388) 17812 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:05:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:05:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:05:58.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:05:59.404 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:05:59.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:05:59.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:05:59.404 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:05:59.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:05:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:59 smithi049 bash[23528]: cluster 2024-09-21T05:05:57.949687+0000 mgr.a (mgr.14388) 17813 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:05:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:59 smithi049 bash[23528]: audit 2024-09-21T05:05:59.498328+0000 mon.a (mon.0) 14143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:59 smithi049 bash[23528]: audit 2024-09-21T05:05:59.507862+0000 mon.a (mon.0) 14144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:59.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:05:59 smithi049 bash[23528]: audit 2024-09-21T05:05:59.519690+0000 mon.a (mon.0) 14145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:59 smithi044 bash[22676]: cluster 2024-09-21T05:05:57.949687+0000 mgr.a (mgr.14388) 17813 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:05:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:59 smithi044 bash[22676]: audit 2024-09-21T05:05:59.498328+0000 mon.a (mon.0) 14143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:59 smithi044 bash[22676]: audit 2024-09-21T05:05:59.507862+0000 mon.a (mon.0) 14144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:05:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:05:59 smithi044 bash[22676]: audit 2024-09-21T05:05:59.519690+0000 mon.a (mon.0) 14145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:59 smithi179 bash[23186]: cluster 2024-09-21T05:05:57.949687+0000 mgr.a (mgr.14388) 17813 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:59 smithi179 bash[23186]: audit 2024-09-21T05:05:59.498328+0000 mon.a (mon.0) 14143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:59 smithi179 bash[23186]: audit 2024-09-21T05:05:59.507862+0000 mon.a (mon.0) 14144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:05:59 smithi179 bash[23186]: audit 2024-09-21T05:05:59.519690+0000 mon.a (mon.0) 14145 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:00.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:00 smithi044 bash[22676]: audit 2024-09-21T05:05:58.954141+0000 mgr.a (mgr.14388) 17814 : audit [DBG] from='client.383340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:01.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:00 smithi179 bash[23186]: audit 2024-09-21T05:05:58.954141+0000 mgr.a (mgr.14388) 17814 : audit [DBG] from='client.383340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:01.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:00 smithi049 bash[23528]: audit 2024-09-21T05:05:58.954141+0000 mgr.a (mgr.14388) 17814 : audit [DBG] from='client.383340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:01.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:01 smithi044 bash[22676]: cluster 2024-09-21T05:05:59.950195+0000 mgr.a (mgr.14388) 17815 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:01 smithi179 bash[23186]: cluster 2024-09-21T05:05:59.950195+0000 mgr.a (mgr.14388) 17815 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:01 smithi049 bash[23528]: cluster 2024-09-21T05:05:59.950195+0000 mgr.a (mgr.14388) 17815 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:03 smithi044 bash[22676]: cluster 2024-09-21T05:06:01.952435+0000 mgr.a (mgr.14388) 17816 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:06:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:03 smithi179 bash[23186]: cluster 2024-09-21T05:06:01.952435+0000 mgr.a (mgr.14388) 17816 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:06:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:03 smithi049 bash[23528]: cluster 2024-09-21T05:06:01.952435+0000 mgr.a (mgr.14388) 17816 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:06:04.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:04.406 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:05.165 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:05.165 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:05 smithi044 bash[22676]: cluster 2024-09-21T05:06:03.953219+0000 mgr.a (mgr.14388) 17817 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:05 smithi179 bash[23186]: cluster 2024-09-21T05:06:03.953219+0000 mgr.a (mgr.14388) 17817 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:05 smithi049 bash[23528]: cluster 2024-09-21T05:06:03.953219+0000 mgr.a (mgr.14388) 17817 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:06 smithi044 bash[22676]: audit 2024-09-21T05:06:04.737348+0000 mgr.a (mgr.14388) 17818 : audit [DBG] from='client.383418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:06 smithi179 bash[23186]: audit 2024-09-21T05:06:04.737348+0000 mgr.a (mgr.14388) 17818 : audit [DBG] from='client.383418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:07.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:06 smithi049 bash[23528]: audit 2024-09-21T05:06:04.737348+0000 mgr.a (mgr.14388) 17818 : audit [DBG] from='client.383418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:07.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:07 smithi044 bash[22676]: cluster 2024-09-21T05:06:05.956132+0000 mgr.a (mgr.14388) 17819 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:07 smithi179 bash[23186]: cluster 2024-09-21T05:06:05.956132+0000 mgr.a (mgr.14388) 17819 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:07 smithi049 bash[23528]: cluster 2024-09-21T05:06:05.956132+0000 mgr.a (mgr.14388) 17819 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:06:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:08 smithi049 bash[23528]: cluster 2024-09-21T05:06:07.956902+0000 mgr.a (mgr.14388) 17820 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:09.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:08 smithi044 bash[22676]: cluster 2024-09-21T05:06:07.956902+0000 mgr.a (mgr.14388) 17820 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:08 smithi179 bash[23186]: cluster 2024-09-21T05:06:07.956902+0000 mgr.a (mgr.14388) 17820 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:10.166 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:10.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:10.167 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:10 smithi049 bash[23528]: audit 2024-09-21T05:06:09.284424+0000 mon.a (mon.0) 14146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:10 smithi049 bash[23528]: audit 2024-09-21T05:06:09.293296+0000 mon.a (mon.0) 14147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:10 smithi049 bash[23528]: audit 2024-09-21T05:06:09.303592+0000 mon.a (mon.0) 14148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:10 smithi049 bash[23528]: audit 2024-09-21T05:06:09.357931+0000 mon.a (mon.0) 14149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:10 smithi049 bash[23528]: audit 2024-09-21T05:06:09.367059+0000 mon.a (mon.0) 14150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:10 smithi049 bash[23528]: audit 2024-09-21T05:06:09.378434+0000 mon.a (mon.0) 14151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:10 smithi044 bash[22676]: audit 2024-09-21T05:06:09.284424+0000 mon.a (mon.0) 14146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:10 smithi044 bash[22676]: audit 2024-09-21T05:06:09.293296+0000 mon.a (mon.0) 14147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:10 smithi044 bash[22676]: audit 2024-09-21T05:06:09.303592+0000 mon.a (mon.0) 14148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:10 smithi044 bash[22676]: audit 2024-09-21T05:06:09.357931+0000 mon.a (mon.0) 14149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:10 smithi044 bash[22676]: audit 2024-09-21T05:06:09.367059+0000 mon.a (mon.0) 14150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:10 smithi044 bash[22676]: audit 2024-09-21T05:06:09.378434+0000 mon.a (mon.0) 14151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:10 smithi179 bash[23186]: audit 2024-09-21T05:06:09.284424+0000 mon.a (mon.0) 14146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:10 smithi179 bash[23186]: audit 2024-09-21T05:06:09.293296+0000 mon.a (mon.0) 14147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:10 smithi179 bash[23186]: audit 2024-09-21T05:06:09.303592+0000 mon.a (mon.0) 14148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:10 smithi179 bash[23186]: audit 2024-09-21T05:06:09.357931+0000 mon.a (mon.0) 14149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:10 smithi179 bash[23186]: audit 2024-09-21T05:06:09.367059+0000 mon.a (mon.0) 14150 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:10 smithi179 bash[23186]: audit 2024-09-21T05:06:09.378434+0000 mon.a (mon.0) 14151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:10.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:10.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:10.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:10.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:10.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:11 smithi044 bash[22676]: cluster 2024-09-21T05:06:09.957821+0000 mgr.a (mgr.14388) 17821 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:11 smithi044 bash[22676]: audit 2024-09-21T05:06:10.498655+0000 mgr.a (mgr.14388) 17822 : audit [DBG] from='client.383493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:11 smithi179 bash[23186]: cluster 2024-09-21T05:06:09.957821+0000 mgr.a (mgr.14388) 17821 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:11 smithi179 bash[23186]: audit 2024-09-21T05:06:10.498655+0000 mgr.a (mgr.14388) 17822 : audit [DBG] from='client.383493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:11 smithi049 bash[23528]: cluster 2024-09-21T05:06:09.957821+0000 mgr.a (mgr.14388) 17821 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:11 smithi049 bash[23528]: audit 2024-09-21T05:06:10.498655+0000 mgr.a (mgr.14388) 17822 : audit [DBG] from='client.383493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:13 smithi044 bash[22676]: cluster 2024-09-21T05:06:11.960731+0000 mgr.a (mgr.14388) 17823 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:13 smithi179 bash[23186]: cluster 2024-09-21T05:06:11.960731+0000 mgr.a (mgr.14388) 17823 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:13.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:13 smithi049 bash[23528]: cluster 2024-09-21T05:06:11.960731+0000 mgr.a (mgr.14388) 17823 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:15 smithi044 bash[22676]: cluster 2024-09-21T05:06:13.961482+0000 mgr.a (mgr.14388) 17824 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:15 smithi179 bash[23186]: cluster 2024-09-21T05:06:13.961482+0000 mgr.a (mgr.14388) 17824 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:15 smithi049 bash[23528]: cluster 2024-09-21T05:06:13.961482+0000 mgr.a (mgr.14388) 17824 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:15.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:15.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:15.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:16.760 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:17 smithi049 bash[23528]: cluster 2024-09-21T05:06:15.962803+0000 mgr.a (mgr.14388) 17825 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:17 smithi049 bash[23528]: audit 2024-09-21T05:06:16.295651+0000 mgr.a (mgr.14388) 17826 : audit [DBG] from='client.383571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:17 smithi044 bash[22676]: cluster 2024-09-21T05:06:15.962803+0000 mgr.a (mgr.14388) 17825 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:17.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:17 smithi044 bash[22676]: audit 2024-09-21T05:06:16.295651+0000 mgr.a (mgr.14388) 17826 : audit [DBG] from='client.383571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:17 smithi179 bash[23186]: cluster 2024-09-21T05:06:15.962803+0000 mgr.a (mgr.14388) 17825 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:17 smithi179 bash[23186]: audit 2024-09-21T05:06:16.295651+0000 mgr.a (mgr.14388) 17826 : audit [DBG] from='client.383571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:19 smithi044 bash[22676]: cluster 2024-09-21T05:06:17.963685+0000 mgr.a (mgr.14388) 17827 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:06:19.751 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:19 smithi049 bash[23528]: cluster 2024-09-21T05:06:17.963685+0000 mgr.a (mgr.14388) 17827 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:06:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:19 smithi179 bash[23186]: cluster 2024-09-21T05:06:17.963685+0000 mgr.a (mgr.14388) 17827 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:06:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:20 smithi044 bash[22676]: audit 2024-09-21T05:06:19.724563+0000 mon.a (mon.0) 14152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:20.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:20 smithi044 bash[22676]: audit 2024-09-21T05:06:19.734560+0000 mon.a (mon.0) 14153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:20.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:20 smithi044 bash[22676]: audit 2024-09-21T05:06:19.746595+0000 mon.a (mon.0) 14154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:20 smithi179 bash[23186]: audit 2024-09-21T05:06:19.724563+0000 mon.a (mon.0) 14152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:21.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:20 smithi179 bash[23186]: audit 2024-09-21T05:06:19.734560+0000 mon.a (mon.0) 14153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:21.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:20 smithi179 bash[23186]: audit 2024-09-21T05:06:19.746595+0000 mon.a (mon.0) 14154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:20 smithi049 bash[23528]: audit 2024-09-21T05:06:19.724563+0000 mon.a (mon.0) 14152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:20 smithi049 bash[23528]: audit 2024-09-21T05:06:19.734560+0000 mon.a (mon.0) 14153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:20 smithi049 bash[23528]: audit 2024-09-21T05:06:19.746595+0000 mon.a (mon.0) 14154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:21.761 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:21.762 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:21.762 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:21 smithi044 bash[22676]: cluster 2024-09-21T05:06:19.964472+0000 mgr.a (mgr.14388) 17828 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:06:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:21 smithi179 bash[23186]: cluster 2024-09-21T05:06:19.964472+0000 mgr.a (mgr.14388) 17828 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:06:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:21 smithi049 bash[23528]: cluster 2024-09-21T05:06:19.964472+0000 mgr.a (mgr.14388) 17828 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 290 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:06:22.557 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:22.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:22.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:22.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:23 smithi044 bash[22676]: cluster 2024-09-21T05:06:21.966729+0000 mgr.a (mgr.14388) 17829 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:23 smithi044 bash[22676]: audit 2024-09-21T05:06:22.101895+0000 mgr.a (mgr.14388) 17830 : audit [DBG] from='client.383649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:23 smithi179 bash[23186]: cluster 2024-09-21T05:06:21.966729+0000 mgr.a (mgr.14388) 17829 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:24.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:23 smithi179 bash[23186]: audit 2024-09-21T05:06:22.101895+0000 mgr.a (mgr.14388) 17830 : audit [DBG] from='client.383649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:23 smithi049 bash[23528]: cluster 2024-09-21T05:06:21.966729+0000 mgr.a (mgr.14388) 17829 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:23 smithi049 bash[23528]: audit 2024-09-21T05:06:22.101895+0000 mgr.a (mgr.14388) 17830 : audit [DBG] from='client.383649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:25.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:25 smithi044 bash[22676]: cluster 2024-09-21T05:06:23.967642+0000 mgr.a (mgr.14388) 17831 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:25 smithi179 bash[23186]: cluster 2024-09-21T05:06:23.967642+0000 mgr.a (mgr.14388) 17831 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:26.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:25 smithi049 bash[23528]: cluster 2024-09-21T05:06:23.967642+0000 mgr.a (mgr.14388) 17831 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:27.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:27.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:27.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:27 smithi179 bash[23186]: cluster 2024-09-21T05:06:25.969932+0000 mgr.a (mgr.14388) 17832 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:27 smithi049 bash[23528]: cluster 2024-09-21T05:06:25.969932+0000 mgr.a (mgr.14388) 17832 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:27 smithi044 bash[22676]: cluster 2024-09-21T05:06:25.969932+0000 mgr.a (mgr.14388) 17832 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:28.318 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: audit 2024-09-21T05:06:27.891596+0000 mgr.a (mgr.14388) 17833 : audit [DBG] from='client.383727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: cluster 2024-09-21T05:06:27.970524+0000 mgr.a (mgr.14388) 17834 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: audit 2024-09-21T05:06:29.516792+0000 mon.a (mon.0) 14155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: audit 2024-09-21T05:06:29.526017+0000 mon.a (mon.0) 14156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: audit 2024-09-21T05:06:29.536251+0000 mon.a (mon.0) 14157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: audit 2024-09-21T05:06:29.587889+0000 mon.a (mon.0) 14158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: audit 2024-09-21T05:06:29.597875+0000 mon.a (mon.0) 14159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.871 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:29 smithi179 bash[23186]: audit 2024-09-21T05:06:29.607875+0000 mon.a (mon.0) 14160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: audit 2024-09-21T05:06:27.891596+0000 mgr.a (mgr.14388) 17833 : audit [DBG] from='client.383727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: cluster 2024-09-21T05:06:27.970524+0000 mgr.a (mgr.14388) 17834 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: audit 2024-09-21T05:06:29.516792+0000 mon.a (mon.0) 14155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: audit 2024-09-21T05:06:29.526017+0000 mon.a (mon.0) 14156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: audit 2024-09-21T05:06:29.536251+0000 mon.a (mon.0) 14157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: audit 2024-09-21T05:06:29.587889+0000 mon.a (mon.0) 14158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: audit 2024-09-21T05:06:29.597875+0000 mon.a (mon.0) 14159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:29.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:29 smithi044 bash[22676]: audit 2024-09-21T05:06:29.607875+0000 mon.a (mon.0) 14160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: audit 2024-09-21T05:06:27.891596+0000 mgr.a (mgr.14388) 17833 : audit [DBG] from='client.383727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: cluster 2024-09-21T05:06:27.970524+0000 mgr.a (mgr.14388) 17834 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: audit 2024-09-21T05:06:29.516792+0000 mon.a (mon.0) 14155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: audit 2024-09-21T05:06:29.526017+0000 mon.a (mon.0) 14156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: audit 2024-09-21T05:06:29.536251+0000 mon.a (mon.0) 14157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: audit 2024-09-21T05:06:29.587889+0000 mon.a (mon.0) 14158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: audit 2024-09-21T05:06:29.597875+0000 mon.a (mon.0) 14159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:29 smithi049 bash[23528]: audit 2024-09-21T05:06:29.607875+0000 mon.a (mon.0) 14160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:30 smithi179 bash[23186]: cluster 2024-09-21T05:06:29.971412+0000 mgr.a (mgr.14388) 17835 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:31.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:30 smithi049 bash[23528]: cluster 2024-09-21T05:06:29.971412+0000 mgr.a (mgr.14388) 17835 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:31.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:30 smithi044 bash[22676]: cluster 2024-09-21T05:06:29.971412+0000 mgr.a (mgr.14388) 17835 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:06:33.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:33 smithi049 bash[23528]: cluster 2024-09-21T05:06:31.973675+0000 mgr.a (mgr.14388) 17836 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:33.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:33.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:33.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:33 smithi044 bash[22676]: cluster 2024-09-21T05:06:31.973675+0000 mgr.a (mgr.14388) 17836 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:33 smithi179 bash[23186]: cluster 2024-09-21T05:06:31.973675+0000 mgr.a (mgr.14388) 17836 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:06:34.087 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:34.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.220902+0000 mon.a (mon.0) 14161 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:06:34.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.649950+0000 mgr.a (mgr.14388) 17837 : audit [DBG] from='client.383799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.832347+0000 mon.a (mon.0) 14162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.836271+0000 mon.a (mon.0) 14163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.842763+0000 mon.a (mon.0) 14164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.846512+0000 mon.a (mon.0) 14165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.847781+0000 mon.a (mon.0) 14166 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.848651+0000 mon.a (mon.0) 14167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.856766+0000 mon.a (mon.0) 14168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:34 smithi049 bash[23528]: audit 2024-09-21T05:06:33.859710+0000 mon.a (mon.0) 14169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:06:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.220902+0000 mon.a (mon.0) 14161 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.649950+0000 mgr.a (mgr.14388) 17837 : audit [DBG] from='client.383799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.832347+0000 mon.a (mon.0) 14162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.836271+0000 mon.a (mon.0) 14163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.842763+0000 mon.a (mon.0) 14164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.846512+0000 mon.a (mon.0) 14165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.847781+0000 mon.a (mon.0) 14166 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.848651+0000 mon.a (mon.0) 14167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.856766+0000 mon.a (mon.0) 14168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22676]: audit 2024-09-21T05:06:33.859710+0000 mon.a (mon.0) 14169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.220902+0000 mon.a (mon.0) 14161 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.649950+0000 mgr.a (mgr.14388) 17837 : audit [DBG] from='client.383799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.832347+0000 mon.a (mon.0) 14162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.836271+0000 mon.a (mon.0) 14163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.842763+0000 mon.a (mon.0) 14164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.846512+0000 mon.a (mon.0) 14165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.847781+0000 mon.a (mon.0) 14166 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.848651+0000 mon.a (mon.0) 14167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.856766+0000 mon.a (mon.0) 14168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:34.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:34 smithi179 bash[23186]: audit 2024-09-21T05:06:33.859710+0000 mon.a (mon.0) 14169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:06:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:35 smithi044 bash[22676]: audit 2024-09-21T05:06:33.861375+0000 mgr.a (mgr.14388) 17838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:06:35.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:35 smithi044 bash[22676]: cluster 2024-09-21T05:06:33.983559+0000 mgr.a (mgr.14388) 17839 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:35.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22930]: debug 2024-09-21T05:06:34.787+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:06:35.240 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:06:34 smithi044 bash[22930]: debug 2024-09-21T05:06:34.791+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:06:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:35 smithi049 bash[23528]: audit 2024-09-21T05:06:33.861375+0000 mgr.a (mgr.14388) 17838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:06:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:35 smithi049 bash[23528]: cluster 2024-09-21T05:06:33.983559+0000 mgr.a (mgr.14388) 17839 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:35.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:35 smithi179 bash[23186]: audit 2024-09-21T05:06:33.861375+0000 mgr.a (mgr.14388) 17838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:06:35.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:35 smithi179 bash[23186]: cluster 2024-09-21T05:06:33.983559+0000 mgr.a (mgr.14388) 17839 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:36.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:36 smithi049 bash[23528]: audit 2024-09-21T05:06:34.792937+0000 mgr.a (mgr.14388) 17840 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:06:36.307 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:36 smithi049 bash[23528]: cephadm 2024-09-21T05:06:34.794397+0000 mgr.a (mgr.14388) 17841 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:06:36.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:36 smithi044 bash[22676]: audit 2024-09-21T05:06:34.792937+0000 mgr.a (mgr.14388) 17840 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:06:36.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:36 smithi044 bash[22676]: cephadm 2024-09-21T05:06:34.794397+0000 mgr.a (mgr.14388) 17841 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:06:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:36 smithi179 bash[23186]: audit 2024-09-21T05:06:34.792937+0000 mgr.a (mgr.14388) 17840 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:06:36.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:36 smithi179 bash[23186]: cephadm 2024-09-21T05:06:34.794397+0000 mgr.a (mgr.14388) 17841 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:06:37.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:37 smithi049 bash[23528]: cluster 2024-09-21T05:06:35.986153+0000 mgr.a (mgr.14388) 17842 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:37.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:37 smithi044 bash[22676]: cluster 2024-09-21T05:06:35.986153+0000 mgr.a (mgr.14388) 17842 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:37 smithi179 bash[23186]: cluster 2024-09-21T05:06:35.986153+0000 mgr.a (mgr.14388) 17842 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:39.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:39.089 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:39 smithi049 bash[23528]: cluster 2024-09-21T05:06:37.986991+0000 mgr.a (mgr.14388) 17843 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:39 smithi044 bash[22676]: cluster 2024-09-21T05:06:37.986991+0000 mgr.a (mgr.14388) 17843 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:39 smithi179 bash[23186]: cluster 2024-09-21T05:06:37.986991+0000 mgr.a (mgr.14388) 17843 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:39.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:40 smithi049 bash[23528]: audit 2024-09-21T05:06:39.424683+0000 mgr.a (mgr.14388) 17844 : audit [DBG] from='client.383985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:40 smithi049 bash[23528]: audit 2024-09-21T05:06:39.966110+0000 mon.a (mon.0) 14170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:40 smithi049 bash[23528]: audit 2024-09-21T05:06:39.975777+0000 mon.a (mon.0) 14171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:40 smithi049 bash[23528]: audit 2024-09-21T05:06:39.987534+0000 mon.a (mon.0) 14172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:40 smithi044 bash[22676]: audit 2024-09-21T05:06:39.424683+0000 mgr.a (mgr.14388) 17844 : audit [DBG] from='client.383985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:40 smithi044 bash[22676]: audit 2024-09-21T05:06:39.966110+0000 mon.a (mon.0) 14170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:40 smithi044 bash[22676]: audit 2024-09-21T05:06:39.975777+0000 mon.a (mon.0) 14171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:40 smithi044 bash[22676]: audit 2024-09-21T05:06:39.987534+0000 mon.a (mon.0) 14172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:40 smithi179 bash[23186]: audit 2024-09-21T05:06:39.424683+0000 mgr.a (mgr.14388) 17844 : audit [DBG] from='client.383985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:40 smithi179 bash[23186]: audit 2024-09-21T05:06:39.966110+0000 mon.a (mon.0) 14170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:40 smithi179 bash[23186]: audit 2024-09-21T05:06:39.975777+0000 mon.a (mon.0) 14171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:40.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:40 smithi179 bash[23186]: audit 2024-09-21T05:06:39.987534+0000 mon.a (mon.0) 14172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:41 smithi049 bash[23528]: cluster 2024-09-21T05:06:39.988859+0000 mgr.a (mgr.14388) 17845 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:41.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:41 smithi044 bash[22676]: cluster 2024-09-21T05:06:39.988859+0000 mgr.a (mgr.14388) 17845 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:41 smithi179 bash[23186]: cluster 2024-09-21T05:06:39.988859+0000 mgr.a (mgr.14388) 17845 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:43.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:43 smithi049 bash[23528]: cluster 2024-09-21T05:06:41.990587+0000 mgr.a (mgr.14388) 17846 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:43.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:43 smithi044 bash[22676]: cluster 2024-09-21T05:06:41.990587+0000 mgr.a (mgr.14388) 17846 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:43 smithi179 bash[23186]: cluster 2024-09-21T05:06:41.990587+0000 mgr.a (mgr.14388) 17846 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:44.859 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:44.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:44.860 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:45 smithi049 bash[23528]: cluster 2024-09-21T05:06:43.991376+0000 mgr.a (mgr.14388) 17847 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T05:06:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:45 smithi044 bash[22676]: cluster 2024-09-21T05:06:43.991376+0000 mgr.a (mgr.14388) 17847 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T05:06:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:45 smithi179 bash[23186]: cluster 2024-09-21T05:06:43.991376+0000 mgr.a (mgr.14388) 17847 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-21T05:06:45.655 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:45.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:46 smithi049 bash[23528]: audit 2024-09-21T05:06:45.194489+0000 mgr.a (mgr.14388) 17848 : audit [DBG] from='client.384063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:46 smithi044 bash[22676]: audit 2024-09-21T05:06:45.194489+0000 mgr.a (mgr.14388) 17848 : audit [DBG] from='client.384063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:46 smithi179 bash[23186]: audit 2024-09-21T05:06:45.194489+0000 mgr.a (mgr.14388) 17848 : audit [DBG] from='client.384063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:47.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:47 smithi049 bash[23528]: cluster 2024-09-21T05:06:45.994398+0000 mgr.a (mgr.14388) 17849 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:47.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:47 smithi044 bash[22676]: cluster 2024-09-21T05:06:45.994398+0000 mgr.a (mgr.14388) 17849 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:47 smithi179 bash[23186]: cluster 2024-09-21T05:06:45.994398+0000 mgr.a (mgr.14388) 17849 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:06:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:49 smithi179 bash[23186]: cluster 2024-09-21T05:06:47.995177+0000 mgr.a (mgr.14388) 17850 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:49.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:49 smithi044 bash[22676]: cluster 2024-09-21T05:06:47.995177+0000 mgr.a (mgr.14388) 17850 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:49.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:49 smithi049 bash[23528]: cluster 2024-09-21T05:06:47.995177+0000 mgr.a (mgr.14388) 17850 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:50.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:50 smithi049 bash[23528]: audit 2024-09-21T05:06:49.756774+0000 mon.a (mon.0) 14173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:50 smithi049 bash[23528]: audit 2024-09-21T05:06:49.765431+0000 mon.a (mon.0) 14174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:50 smithi049 bash[23528]: audit 2024-09-21T05:06:49.776305+0000 mon.a (mon.0) 14175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:50 smithi049 bash[23528]: audit 2024-09-21T05:06:49.826325+0000 mon.a (mon.0) 14176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:50 smithi049 bash[23528]: audit 2024-09-21T05:06:49.834741+0000 mon.a (mon.0) 14177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:50 smithi049 bash[23528]: audit 2024-09-21T05:06:49.844866+0000 mon.a (mon.0) 14178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:50 smithi044 bash[22676]: audit 2024-09-21T05:06:49.756774+0000 mon.a (mon.0) 14173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:50 smithi044 bash[22676]: audit 2024-09-21T05:06:49.765431+0000 mon.a (mon.0) 14174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:50 smithi044 bash[22676]: audit 2024-09-21T05:06:49.776305+0000 mon.a (mon.0) 14175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:50 smithi044 bash[22676]: audit 2024-09-21T05:06:49.826325+0000 mon.a (mon.0) 14176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:50 smithi044 bash[22676]: audit 2024-09-21T05:06:49.834741+0000 mon.a (mon.0) 14177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:50 smithi044 bash[22676]: audit 2024-09-21T05:06:49.844866+0000 mon.a (mon.0) 14178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:50 smithi179 bash[23186]: audit 2024-09-21T05:06:49.756774+0000 mon.a (mon.0) 14173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:50 smithi179 bash[23186]: audit 2024-09-21T05:06:49.765431+0000 mon.a (mon.0) 14174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:50 smithi179 bash[23186]: audit 2024-09-21T05:06:49.776305+0000 mon.a (mon.0) 14175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:50 smithi179 bash[23186]: audit 2024-09-21T05:06:49.826325+0000 mon.a (mon.0) 14176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:50 smithi179 bash[23186]: audit 2024-09-21T05:06:49.834741+0000 mon.a (mon.0) 14177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:50 smithi179 bash[23186]: audit 2024-09-21T05:06:49.844866+0000 mon.a (mon.0) 14178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:06:51.452 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:51.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:51.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:51.453 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:51.453 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:51 smithi179 bash[23186]: cluster 2024-09-21T05:06:49.996367+0000 mgr.a (mgr.14388) 17851 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:06:52.058 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:51 smithi049 bash[23528]: cluster 2024-09-21T05:06:49.996367+0000 mgr.a (mgr.14388) 17851 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:06:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:51 smithi044 bash[22676]: cluster 2024-09-21T05:06:49.996367+0000 mgr.a (mgr.14388) 17851 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:06:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:52 smithi049 bash[23528]: audit 2024-09-21T05:06:50.991686+0000 mgr.a (mgr.14388) 17852 : audit [DBG] from='client.384141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:52 smithi049 bash[23528]: cluster 2024-09-21T05:06:51.998842+0000 mgr.a (mgr.14388) 17853 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:06:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:52 smithi044 bash[22676]: audit 2024-09-21T05:06:50.991686+0000 mgr.a (mgr.14388) 17852 : audit [DBG] from='client.384141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:52 smithi044 bash[22676]: cluster 2024-09-21T05:06:51.998842+0000 mgr.a (mgr.14388) 17853 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:06:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:52 smithi179 bash[23186]: audit 2024-09-21T05:06:50.991686+0000 mgr.a (mgr.14388) 17852 : audit [DBG] from='client.384141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:53.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:52 smithi179 bash[23186]: cluster 2024-09-21T05:06:51.998842+0000 mgr.a (mgr.14388) 17853 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:06:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:55 smithi044 bash[22676]: cluster 2024-09-21T05:06:53.999641+0000 mgr.a (mgr.14388) 17854 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:55 smithi179 bash[23186]: cluster 2024-09-21T05:06:53.999641+0000 mgr.a (mgr.14388) 17854 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:55.509 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:55 smithi049 bash[23528]: cluster 2024-09-21T05:06:53.999641+0000 mgr.a (mgr.14388) 17854 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:06:56.454 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:06:56.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:06:56.455 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:06:57.214 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:06:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:06:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:06:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:06:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:06:57.386 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:57 smithi049 bash[23528]: cluster 2024-09-21T05:06:56.001722+0000 mgr.a (mgr.14388) 17855 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:57 smithi044 bash[22676]: cluster 2024-09-21T05:06:56.001722+0000 mgr.a (mgr.14388) 17855 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:57 smithi179 bash[23186]: cluster 2024-09-21T05:06:56.001722+0000 mgr.a (mgr.14388) 17855 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:58.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:58 smithi044 bash[22676]: audit 2024-09-21T05:06:56.782840+0000 mgr.a (mgr.14388) 17856 : audit [DBG] from='client.384216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:58.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:58 smithi179 bash[23186]: audit 2024-09-21T05:06:56.782840+0000 mgr.a (mgr.14388) 17856 : audit [DBG] from='client.384216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:58 smithi049 bash[23528]: audit 2024-09-21T05:06:56.782840+0000 mgr.a (mgr.14388) 17856 : audit [DBG] from='client.384216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:59.340 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:06:59 smithi044 bash[22676]: cluster 2024-09-21T05:06:58.002715+0000 mgr.a (mgr.14388) 17857 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:59.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:06:59 smithi179 bash[23186]: cluster 2024-09-21T05:06:58.002715+0000 mgr.a (mgr.14388) 17857 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:06:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:06:59 smithi049 bash[23528]: cluster 2024-09-21T05:06:58.002715+0000 mgr.a (mgr.14388) 17857 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:01 smithi044 bash[22676]: cluster 2024-09-21T05:07:00.004128+0000 mgr.a (mgr.14388) 17858 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:07:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:01 smithi044 bash[22676]: audit 2024-09-21T05:07:00.196632+0000 mon.a (mon.0) 14179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:01 smithi044 bash[22676]: audit 2024-09-21T05:07:00.202229+0000 mon.a (mon.0) 14180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:01 smithi044 bash[22676]: audit 2024-09-21T05:07:00.208538+0000 mon.a (mon.0) 14181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:01 smithi179 bash[23186]: cluster 2024-09-21T05:07:00.004128+0000 mgr.a (mgr.14388) 17858 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:07:01.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:01 smithi179 bash[23186]: audit 2024-09-21T05:07:00.196632+0000 mon.a (mon.0) 14179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:01 smithi179 bash[23186]: audit 2024-09-21T05:07:00.202229+0000 mon.a (mon.0) 14180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:01 smithi179 bash[23186]: audit 2024-09-21T05:07:00.208538+0000 mon.a (mon.0) 14181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:01 smithi049 bash[23528]: cluster 2024-09-21T05:07:00.004128+0000 mgr.a (mgr.14388) 17858 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:07:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:01 smithi049 bash[23528]: audit 2024-09-21T05:07:00.196632+0000 mon.a (mon.0) 14179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:01 smithi049 bash[23528]: audit 2024-09-21T05:07:00.202229+0000 mon.a (mon.0) 14180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:01.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:01 smithi049 bash[23528]: audit 2024-09-21T05:07:00.208538+0000 mon.a (mon.0) 14181 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:02.216 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:02.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:03.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:03.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:03 smithi179 bash[23186]: cluster 2024-09-21T05:07:02.005611+0000 mgr.a (mgr.14388) 17859 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:03 smithi179 bash[23186]: audit 2024-09-21T05:07:02.551879+0000 mgr.a (mgr.14388) 17860 : audit [DBG] from='client.384294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:03 smithi044 bash[22676]: cluster 2024-09-21T05:07:02.005611+0000 mgr.a (mgr.14388) 17859 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:03.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:03 smithi044 bash[22676]: audit 2024-09-21T05:07:02.551879+0000 mgr.a (mgr.14388) 17860 : audit [DBG] from='client.384294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:03 smithi049 bash[23528]: cluster 2024-09-21T05:07:02.005611+0000 mgr.a (mgr.14388) 17859 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:03 smithi049 bash[23528]: audit 2024-09-21T05:07:02.551879+0000 mgr.a (mgr.14388) 17860 : audit [DBG] from='client.384294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:05 smithi044 bash[22676]: cluster 2024-09-21T05:07:04.006597+0000 mgr.a (mgr.14388) 17861 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:05 smithi179 bash[23186]: cluster 2024-09-21T05:07:04.006597+0000 mgr.a (mgr.14388) 17861 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:05.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:05 smithi049 bash[23528]: cluster 2024-09-21T05:07:04.006597+0000 mgr.a (mgr.14388) 17861 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:07.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:07 smithi044 bash[22676]: cluster 2024-09-21T05:07:06.008892+0000 mgr.a (mgr.14388) 17862 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:07 smithi179 bash[23186]: cluster 2024-09-21T05:07:06.008892+0000 mgr.a (mgr.14388) 17862 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:07.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:07 smithi049 bash[23528]: cluster 2024-09-21T05:07:06.008892+0000 mgr.a (mgr.14388) 17862 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:08.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:08.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:08.769 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:08.769 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:08.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:08.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:08.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:09.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:09 smithi044 bash[22676]: cluster 2024-09-21T05:07:08.009611+0000 mgr.a (mgr.14388) 17863 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:09.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:09 smithi044 bash[22676]: audit 2024-09-21T05:07:08.344604+0000 mgr.a (mgr.14388) 17864 : audit [DBG] from='client.384372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:09 smithi179 bash[23186]: cluster 2024-09-21T05:07:08.009611+0000 mgr.a (mgr.14388) 17863 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:09.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:09 smithi179 bash[23186]: audit 2024-09-21T05:07:08.344604+0000 mgr.a (mgr.14388) 17864 : audit [DBG] from='client.384372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:09.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:09 smithi049 bash[23528]: cluster 2024-09-21T05:07:08.009611+0000 mgr.a (mgr.14388) 17863 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:09.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:09 smithi049 bash[23528]: audit 2024-09-21T05:07:08.344604+0000 mgr.a (mgr.14388) 17864 : audit [DBG] from='client.384372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:10 smithi179 bash[23186]: audit 2024-09-21T05:07:09.995718+0000 mon.a (mon.0) 14182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:10 smithi179 bash[23186]: audit 2024-09-21T05:07:10.004151+0000 mon.a (mon.0) 14183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:10 smithi179 bash[23186]: cluster 2024-09-21T05:07:10.011241+0000 mgr.a (mgr.14388) 17865 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:07:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:10 smithi179 bash[23186]: audit 2024-09-21T05:07:10.016880+0000 mon.a (mon.0) 14184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:10 smithi179 bash[23186]: audit 2024-09-21T05:07:10.054383+0000 mon.a (mon.0) 14185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:10 smithi179 bash[23186]: audit 2024-09-21T05:07:10.064657+0000 mon.a (mon.0) 14186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:10 smithi179 bash[23186]: audit 2024-09-21T05:07:10.076154+0000 mon.a (mon.0) 14187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:10 smithi049 bash[23528]: audit 2024-09-21T05:07:09.995718+0000 mon.a (mon.0) 14182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:10 smithi049 bash[23528]: audit 2024-09-21T05:07:10.004151+0000 mon.a (mon.0) 14183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:10 smithi049 bash[23528]: cluster 2024-09-21T05:07:10.011241+0000 mgr.a (mgr.14388) 17865 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:07:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:10 smithi049 bash[23528]: audit 2024-09-21T05:07:10.016880+0000 mon.a (mon.0) 14184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:10 smithi049 bash[23528]: audit 2024-09-21T05:07:10.054383+0000 mon.a (mon.0) 14185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:10 smithi049 bash[23528]: audit 2024-09-21T05:07:10.064657+0000 mon.a (mon.0) 14186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:10 smithi049 bash[23528]: audit 2024-09-21T05:07:10.076154+0000 mon.a (mon.0) 14187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:10 smithi044 bash[22676]: audit 2024-09-21T05:07:09.995718+0000 mon.a (mon.0) 14182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:10 smithi044 bash[22676]: audit 2024-09-21T05:07:10.004151+0000 mon.a (mon.0) 14183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:10 smithi044 bash[22676]: cluster 2024-09-21T05:07:10.011241+0000 mgr.a (mgr.14388) 17865 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:07:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:10 smithi044 bash[22676]: audit 2024-09-21T05:07:10.016880+0000 mon.a (mon.0) 14184 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:10 smithi044 bash[22676]: audit 2024-09-21T05:07:10.054383+0000 mon.a (mon.0) 14185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:10 smithi044 bash[22676]: audit 2024-09-21T05:07:10.064657+0000 mon.a (mon.0) 14186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:10 smithi044 bash[22676]: audit 2024-09-21T05:07:10.076154+0000 mon.a (mon.0) 14187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:13.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:13 smithi044 bash[22676]: cluster 2024-09-21T05:07:12.012832+0000 mgr.a (mgr.14388) 17866 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:13 smithi179 bash[23186]: cluster 2024-09-21T05:07:12.012832+0000 mgr.a (mgr.14388) 17866 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:13.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:13 smithi049 bash[23528]: cluster 2024-09-21T05:07:12.012832+0000 mgr.a (mgr.14388) 17866 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:13.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:13.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:13.772 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:14.527 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:15 smithi049 bash[23528]: cluster 2024-09-21T05:07:14.013462+0000 mgr.a (mgr.14388) 17867 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:15 smithi049 bash[23528]: audit 2024-09-21T05:07:14.099483+0000 mgr.a (mgr.14388) 17868 : audit [DBG] from='client.384447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:15.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:15 smithi044 bash[22676]: cluster 2024-09-21T05:07:14.013462+0000 mgr.a (mgr.14388) 17867 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:15.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:15 smithi044 bash[22676]: audit 2024-09-21T05:07:14.099483+0000 mgr.a (mgr.14388) 17868 : audit [DBG] from='client.384447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:15.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:15 smithi179 bash[23186]: cluster 2024-09-21T05:07:14.013462+0000 mgr.a (mgr.14388) 17867 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:15.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:15 smithi179 bash[23186]: audit 2024-09-21T05:07:14.099483+0000 mgr.a (mgr.14388) 17868 : audit [DBG] from='client.384447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:17.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:17 smithi044 bash[22676]: cluster 2024-09-21T05:07:16.015753+0000 mgr.a (mgr.14388) 17869 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:17 smithi179 bash[23186]: cluster 2024-09-21T05:07:16.015753+0000 mgr.a (mgr.14388) 17869 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:17 smithi049 bash[23528]: cluster 2024-09-21T05:07:16.015753+0000 mgr.a (mgr.14388) 17869 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:19.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:19 smithi049 bash[23528]: cluster 2024-09-21T05:07:18.016514+0000 mgr.a (mgr.14388) 17870 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:19.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:19 smithi044 bash[22676]: cluster 2024-09-21T05:07:18.016514+0000 mgr.a (mgr.14388) 17870 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:19.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:19 smithi179 bash[23186]: cluster 2024-09-21T05:07:18.016514+0000 mgr.a (mgr.14388) 17870 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:19.528 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:19.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:19.529 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:20.338 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:20.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:20.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:20.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:20.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:21 smithi044 bash[22676]: audit 2024-09-21T05:07:19.875672+0000 mgr.a (mgr.14388) 17871 : audit [DBG] from='client.384525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:21 smithi044 bash[22676]: cluster 2024-09-21T05:07:20.018217+0000 mgr.a (mgr.14388) 17872 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:21 smithi044 bash[22676]: audit 2024-09-21T05:07:20.398115+0000 mon.a (mon.0) 14188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:21 smithi044 bash[22676]: audit 2024-09-21T05:07:20.404663+0000 mon.a (mon.0) 14189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:21 smithi044 bash[22676]: audit 2024-09-21T05:07:20.410311+0000 mon.a (mon.0) 14190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:21 smithi179 bash[23186]: audit 2024-09-21T05:07:19.875672+0000 mgr.a (mgr.14388) 17871 : audit [DBG] from='client.384525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:21 smithi179 bash[23186]: cluster 2024-09-21T05:07:20.018217+0000 mgr.a (mgr.14388) 17872 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:21 smithi179 bash[23186]: audit 2024-09-21T05:07:20.398115+0000 mon.a (mon.0) 14188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:21 smithi179 bash[23186]: audit 2024-09-21T05:07:20.404663+0000 mon.a (mon.0) 14189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:21 smithi179 bash[23186]: audit 2024-09-21T05:07:20.410311+0000 mon.a (mon.0) 14190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:21 smithi049 bash[23528]: audit 2024-09-21T05:07:19.875672+0000 mgr.a (mgr.14388) 17871 : audit [DBG] from='client.384525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:21 smithi049 bash[23528]: cluster 2024-09-21T05:07:20.018217+0000 mgr.a (mgr.14388) 17872 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:21 smithi049 bash[23528]: audit 2024-09-21T05:07:20.398115+0000 mon.a (mon.0) 14188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:21 smithi049 bash[23528]: audit 2024-09-21T05:07:20.404663+0000 mon.a (mon.0) 14189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:21 smithi049 bash[23528]: audit 2024-09-21T05:07:20.410311+0000 mon.a (mon.0) 14190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:23 smithi044 bash[22676]: cluster 2024-09-21T05:07:22.020623+0000 mgr.a (mgr.14388) 17873 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:07:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:23 smithi179 bash[23186]: cluster 2024-09-21T05:07:22.020623+0000 mgr.a (mgr.14388) 17873 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:07:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:23 smithi049 bash[23528]: cluster 2024-09-21T05:07:22.020623+0000 mgr.a (mgr.14388) 17873 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:07:25.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:25.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:25.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:25 smithi044 bash[22676]: cluster 2024-09-21T05:07:24.021477+0000 mgr.a (mgr.14388) 17874 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:07:25.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:25 smithi179 bash[23186]: cluster 2024-09-21T05:07:24.021477+0000 mgr.a (mgr.14388) 17874 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:07:25.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:25 smithi049 bash[23528]: cluster 2024-09-21T05:07:24.021477+0000 mgr.a (mgr.14388) 17874 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:07:26.135 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:26.136 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:26 smithi044 bash[22676]: audit 2024-09-21T05:07:25.674160+0000 mgr.a (mgr.14388) 17875 : audit [DBG] from='client.384603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:26.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:26 smithi179 bash[23186]: audit 2024-09-21T05:07:25.674160+0000 mgr.a (mgr.14388) 17875 : audit [DBG] from='client.384603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:26 smithi049 bash[23528]: audit 2024-09-21T05:07:25.674160+0000 mgr.a (mgr.14388) 17875 : audit [DBG] from='client.384603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:27.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:27 smithi044 bash[22676]: cluster 2024-09-21T05:07:26.027125+0000 mgr.a (mgr.14388) 17876 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:27 smithi179 bash[23186]: cluster 2024-09-21T05:07:26.027125+0000 mgr.a (mgr.14388) 17876 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:27 smithi049 bash[23528]: cluster 2024-09-21T05:07:26.027125+0000 mgr.a (mgr.14388) 17876 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:29 smithi044 bash[22676]: cluster 2024-09-21T05:07:28.027921+0000 mgr.a (mgr.14388) 17877 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:07:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:29 smithi179 bash[23186]: cluster 2024-09-21T05:07:28.027921+0000 mgr.a (mgr.14388) 17877 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:07:29.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:29 smithi049 bash[23528]: cluster 2024-09-21T05:07:28.027921+0000 mgr.a (mgr.14388) 17877 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:07:31.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:31 smithi044 bash[22676]: cluster 2024-09-21T05:07:30.028882+0000 mgr.a (mgr.14388) 17878 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-21T05:07:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:31 smithi044 bash[22676]: audit 2024-09-21T05:07:30.191038+0000 mon.a (mon.0) 14191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:31 smithi044 bash[22676]: audit 2024-09-21T05:07:30.197451+0000 mon.a (mon.0) 14192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:31 smithi044 bash[22676]: audit 2024-09-21T05:07:30.205638+0000 mon.a (mon.0) 14193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:31 smithi044 bash[22676]: audit 2024-09-21T05:07:30.241293+0000 mon.a (mon.0) 14194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:31 smithi044 bash[22676]: audit 2024-09-21T05:07:30.249041+0000 mon.a (mon.0) 14195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:31 smithi044 bash[22676]: audit 2024-09-21T05:07:30.258283+0000 mon.a (mon.0) 14196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:31 smithi179 bash[23186]: cluster 2024-09-21T05:07:30.028882+0000 mgr.a (mgr.14388) 17878 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-21T05:07:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:31 smithi179 bash[23186]: audit 2024-09-21T05:07:30.191038+0000 mon.a (mon.0) 14191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:31 smithi179 bash[23186]: audit 2024-09-21T05:07:30.197451+0000 mon.a (mon.0) 14192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:31 smithi179 bash[23186]: audit 2024-09-21T05:07:30.205638+0000 mon.a (mon.0) 14193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:31 smithi179 bash[23186]: audit 2024-09-21T05:07:30.241293+0000 mon.a (mon.0) 14194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:31 smithi179 bash[23186]: audit 2024-09-21T05:07:30.249041+0000 mon.a (mon.0) 14195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:31 smithi179 bash[23186]: audit 2024-09-21T05:07:30.258283+0000 mon.a (mon.0) 14196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:31 smithi049 bash[23528]: cluster 2024-09-21T05:07:30.028882+0000 mgr.a (mgr.14388) 17878 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-21T05:07:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:31 smithi049 bash[23528]: audit 2024-09-21T05:07:30.191038+0000 mon.a (mon.0) 14191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:31 smithi049 bash[23528]: audit 2024-09-21T05:07:30.197451+0000 mon.a (mon.0) 14192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:31 smithi049 bash[23528]: audit 2024-09-21T05:07:30.205638+0000 mon.a (mon.0) 14193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:31 smithi049 bash[23528]: audit 2024-09-21T05:07:30.241293+0000 mon.a (mon.0) 14194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:31 smithi049 bash[23528]: audit 2024-09-21T05:07:30.249041+0000 mon.a (mon.0) 14195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:31 smithi049 bash[23528]: audit 2024-09-21T05:07:30.258283+0000 mon.a (mon.0) 14196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:31.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:32 smithi179 bash[23186]: audit 2024-09-21T05:07:31.477017+0000 mgr.a (mgr.14388) 17879 : audit [DBG] from='client.384678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:32 smithi044 bash[22676]: audit 2024-09-21T05:07:31.477017+0000 mgr.a (mgr.14388) 17879 : audit [DBG] from='client.384678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:32.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:32 smithi049 bash[23528]: audit 2024-09-21T05:07:31.477017+0000 mgr.a (mgr.14388) 17879 : audit [DBG] from='client.384678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:33 smithi044 bash[22676]: cluster 2024-09-21T05:07:32.031479+0000 mgr.a (mgr.14388) 17880 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:33 smithi179 bash[23186]: cluster 2024-09-21T05:07:32.031479+0000 mgr.a (mgr.14388) 17880 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:33 smithi049 bash[23528]: cluster 2024-09-21T05:07:32.031479+0000 mgr.a (mgr.14388) 17880 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:35.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:35 smithi044 bash[22676]: cluster 2024-09-21T05:07:34.032264+0000 mgr.a (mgr.14388) 17881 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:35.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:35 smithi044 bash[22676]: audit 2024-09-21T05:07:34.871541+0000 mon.a (mon.0) 14197 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:07:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:35 smithi179 bash[23186]: cluster 2024-09-21T05:07:34.032264+0000 mgr.a (mgr.14388) 17881 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:35 smithi179 bash[23186]: audit 2024-09-21T05:07:34.871541+0000 mon.a (mon.0) 14197 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:07:35.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:35 smithi049 bash[23528]: cluster 2024-09-21T05:07:34.032264+0000 mgr.a (mgr.14388) 17881 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:35.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:35 smithi049 bash[23528]: audit 2024-09-21T05:07:34.871541+0000 mon.a (mon.0) 14197 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:07:36.719 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:36 smithi049 bash[23528]: audit 2024-09-21T05:07:35.457525+0000 mon.a (mon.0) 14198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.719 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:36 smithi049 bash[23528]: audit 2024-09-21T05:07:35.465908+0000 mon.a (mon.0) 14199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.719 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:36 smithi049 bash[23528]: audit 2024-09-21T05:07:35.468209+0000 mon.a (mon.0) 14200 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:36.719 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:36 smithi049 bash[23528]: audit 2024-09-21T05:07:35.470084+0000 mon.a (mon.0) 14201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:07:36.720 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:36 smithi049 bash[23528]: audit 2024-09-21T05:07:35.480529+0000 mon.a (mon.0) 14202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.720 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:36 smithi049 bash[23528]: audit 2024-09-21T05:07:35.486847+0000 mon.a (mon.0) 14203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:07:36.720 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:36 smithi049 bash[23528]: audit 2024-09-21T05:07:35.489268+0000 mgr.a (mgr.14388) 17882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22930]: debug 2024-09-21T05:07:36.298+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22930]: debug 2024-09-21T05:07:36.302+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22676]: audit 2024-09-21T05:07:35.457525+0000 mon.a (mon.0) 14198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22676]: audit 2024-09-21T05:07:35.465908+0000 mon.a (mon.0) 14199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22676]: audit 2024-09-21T05:07:35.468209+0000 mon.a (mon.0) 14200 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22676]: audit 2024-09-21T05:07:35.470084+0000 mon.a (mon.0) 14201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22676]: audit 2024-09-21T05:07:35.480529+0000 mon.a (mon.0) 14202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22676]: audit 2024-09-21T05:07:35.486847+0000 mon.a (mon.0) 14203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:07:36.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:36 smithi044 bash[22676]: audit 2024-09-21T05:07:35.489268+0000 mgr.a (mgr.14388) 17882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:07:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:36 smithi179 bash[23186]: audit 2024-09-21T05:07:35.457525+0000 mon.a (mon.0) 14198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:36 smithi179 bash[23186]: audit 2024-09-21T05:07:35.465908+0000 mon.a (mon.0) 14199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:36 smithi179 bash[23186]: audit 2024-09-21T05:07:35.468209+0000 mon.a (mon.0) 14200 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:36 smithi179 bash[23186]: audit 2024-09-21T05:07:35.470084+0000 mon.a (mon.0) 14201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:07:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:36 smithi179 bash[23186]: audit 2024-09-21T05:07:35.480529+0000 mon.a (mon.0) 14202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:36 smithi179 bash[23186]: audit 2024-09-21T05:07:35.486847+0000 mon.a (mon.0) 14203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:07:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:36 smithi179 bash[23186]: audit 2024-09-21T05:07:35.489268+0000 mgr.a (mgr.14388) 17882 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:07:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:37.713 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:37.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:37.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:37.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:37.714 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:37 smithi044 bash[22676]: cluster 2024-09-21T05:07:36.033936+0000 mgr.a (mgr.14388) 17883 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:37 smithi044 bash[22676]: audit 2024-09-21T05:07:36.304770+0000 mgr.a (mgr.14388) 17884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:07:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:37 smithi044 bash[22676]: cephadm 2024-09-21T05:07:36.306768+0000 mgr.a (mgr.14388) 17885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:07:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:37 smithi179 bash[23186]: cluster 2024-09-21T05:07:36.033936+0000 mgr.a (mgr.14388) 17883 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:37 smithi179 bash[23186]: audit 2024-09-21T05:07:36.304770+0000 mgr.a (mgr.14388) 17884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:07:37.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:37 smithi179 bash[23186]: cephadm 2024-09-21T05:07:36.306768+0000 mgr.a (mgr.14388) 17885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:07:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:37 smithi049 bash[23528]: cluster 2024-09-21T05:07:36.033936+0000 mgr.a (mgr.14388) 17883 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:37 smithi049 bash[23528]: audit 2024-09-21T05:07:36.304770+0000 mgr.a (mgr.14388) 17884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:07:37.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:37 smithi049 bash[23528]: cephadm 2024-09-21T05:07:36.306768+0000 mgr.a (mgr.14388) 17885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:07:38.755 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:38 smithi049 bash[23528]: audit 2024-09-21T05:07:37.268648+0000 mgr.a (mgr.14388) 17886 : audit [DBG] from='client.384864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:38 smithi179 bash[23186]: audit 2024-09-21T05:07:37.268648+0000 mgr.a (mgr.14388) 17886 : audit [DBG] from='client.384864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:38 smithi044 bash[22676]: audit 2024-09-21T05:07:37.268648+0000 mgr.a (mgr.14388) 17886 : audit [DBG] from='client.384864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:39 smithi179 bash[23186]: cluster 2024-09-21T05:07:38.034896+0000 mgr.a (mgr.14388) 17887 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:39.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:39 smithi049 bash[23528]: cluster 2024-09-21T05:07:38.034896+0000 mgr.a (mgr.14388) 17887 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:39.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:39 smithi044 bash[22676]: cluster 2024-09-21T05:07:38.034896+0000 mgr.a (mgr.14388) 17887 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:41 smithi044 bash[22676]: cluster 2024-09-21T05:07:40.036115+0000 mgr.a (mgr.14388) 17888 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:41 smithi044 bash[22676]: audit 2024-09-21T05:07:40.604813+0000 mon.a (mon.0) 14204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:41 smithi044 bash[22676]: audit 2024-09-21T05:07:40.613695+0000 mon.a (mon.0) 14205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:41 smithi044 bash[22676]: audit 2024-09-21T05:07:40.624520+0000 mon.a (mon.0) 14206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:41 smithi179 bash[23186]: cluster 2024-09-21T05:07:40.036115+0000 mgr.a (mgr.14388) 17888 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:41 smithi179 bash[23186]: audit 2024-09-21T05:07:40.604813+0000 mon.a (mon.0) 14204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:41 smithi179 bash[23186]: audit 2024-09-21T05:07:40.613695+0000 mon.a (mon.0) 14205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:41 smithi179 bash[23186]: audit 2024-09-21T05:07:40.624520+0000 mon.a (mon.0) 14206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:41 smithi049 bash[23528]: cluster 2024-09-21T05:07:40.036115+0000 mgr.a (mgr.14388) 17888 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:41 smithi049 bash[23528]: audit 2024-09-21T05:07:40.604813+0000 mon.a (mon.0) 14204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:41 smithi049 bash[23528]: audit 2024-09-21T05:07:40.613695+0000 mon.a (mon.0) 14205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:41 smithi049 bash[23528]: audit 2024-09-21T05:07:40.624520+0000 mon.a (mon.0) 14206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:42.715 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:42.716 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:42.716 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:43.472 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:43.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:43.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:43.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:43.472 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:43 smithi044 bash[22676]: cluster 2024-09-21T05:07:42.036917+0000 mgr.a (mgr.14388) 17889 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:43 smithi179 bash[23186]: cluster 2024-09-21T05:07:42.036917+0000 mgr.a (mgr.14388) 17889 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:43 smithi049 bash[23528]: cluster 2024-09-21T05:07:42.036917+0000 mgr.a (mgr.14388) 17889 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:44.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:44 smithi044 bash[22676]: audit 2024-09-21T05:07:43.036452+0000 mgr.a (mgr.14388) 17890 : audit [DBG] from='client.384942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:44 smithi179 bash[23186]: audit 2024-09-21T05:07:43.036452+0000 mgr.a (mgr.14388) 17890 : audit [DBG] from='client.384942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:45.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:44 smithi049 bash[23528]: audit 2024-09-21T05:07:43.036452+0000 mgr.a (mgr.14388) 17890 : audit [DBG] from='client.384942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:45 smithi044 bash[22676]: cluster 2024-09-21T05:07:44.037963+0000 mgr.a (mgr.14388) 17891 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:45 smithi179 bash[23186]: cluster 2024-09-21T05:07:44.037963+0000 mgr.a (mgr.14388) 17891 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:45 smithi049 bash[23528]: cluster 2024-09-21T05:07:44.037963+0000 mgr.a (mgr.14388) 17891 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:47 smithi044 bash[22676]: cluster 2024-09-21T05:07:46.040339+0000 mgr.a (mgr.14388) 17892 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:47 smithi179 bash[23186]: cluster 2024-09-21T05:07:46.040339+0000 mgr.a (mgr.14388) 17892 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:47 smithi049 bash[23528]: cluster 2024-09-21T05:07:46.040339+0000 mgr.a (mgr.14388) 17892 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:48.473 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:48.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:48.474 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:49.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:49.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:49.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:49.234 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:49.234 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:49.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:49 smithi044 bash[22676]: cluster 2024-09-21T05:07:48.041315+0000 mgr.a (mgr.14388) 17893 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:49 smithi179 bash[23186]: cluster 2024-09-21T05:07:48.041315+0000 mgr.a (mgr.14388) 17893 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:49 smithi049 bash[23528]: cluster 2024-09-21T05:07:48.041315+0000 mgr.a (mgr.14388) 17893 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:50 smithi044 bash[22676]: audit 2024-09-21T05:07:48.804956+0000 mgr.a (mgr.14388) 17894 : audit [DBG] from='client.385020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:50 smithi044 bash[22676]: audit 2024-09-21T05:07:50.425802+0000 mon.a (mon.0) 14207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:50 smithi044 bash[22676]: audit 2024-09-21T05:07:50.434312+0000 mon.a (mon.0) 14208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:50 smithi044 bash[22676]: audit 2024-09-21T05:07:50.445062+0000 mon.a (mon.0) 14209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:50 smithi044 bash[22676]: audit 2024-09-21T05:07:50.458963+0000 mon.a (mon.0) 14210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:50 smithi044 bash[22676]: audit 2024-09-21T05:07:50.467406+0000 mon.a (mon.0) 14211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:50 smithi044 bash[22676]: audit 2024-09-21T05:07:50.477629+0000 mon.a (mon.0) 14212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:50 smithi179 bash[23186]: audit 2024-09-21T05:07:48.804956+0000 mgr.a (mgr.14388) 17894 : audit [DBG] from='client.385020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:50 smithi179 bash[23186]: audit 2024-09-21T05:07:50.425802+0000 mon.a (mon.0) 14207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:50 smithi179 bash[23186]: audit 2024-09-21T05:07:50.434312+0000 mon.a (mon.0) 14208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:50 smithi179 bash[23186]: audit 2024-09-21T05:07:50.445062+0000 mon.a (mon.0) 14209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:50 smithi179 bash[23186]: audit 2024-09-21T05:07:50.458963+0000 mon.a (mon.0) 14210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:50 smithi179 bash[23186]: audit 2024-09-21T05:07:50.467406+0000 mon.a (mon.0) 14211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:50.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:50 smithi179 bash[23186]: audit 2024-09-21T05:07:50.477629+0000 mon.a (mon.0) 14212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:50 smithi049 bash[23528]: audit 2024-09-21T05:07:48.804956+0000 mgr.a (mgr.14388) 17894 : audit [DBG] from='client.385020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:50 smithi049 bash[23528]: audit 2024-09-21T05:07:50.425802+0000 mon.a (mon.0) 14207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:50 smithi049 bash[23528]: audit 2024-09-21T05:07:50.434312+0000 mon.a (mon.0) 14208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:50 smithi049 bash[23528]: audit 2024-09-21T05:07:50.445062+0000 mon.a (mon.0) 14209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:50 smithi049 bash[23528]: audit 2024-09-21T05:07:50.458963+0000 mon.a (mon.0) 14210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:50 smithi049 bash[23528]: audit 2024-09-21T05:07:50.467406+0000 mon.a (mon.0) 14211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:50 smithi049 bash[23528]: audit 2024-09-21T05:07:50.477629+0000 mon.a (mon.0) 14212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:07:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:51 smithi044 bash[22676]: cluster 2024-09-21T05:07:50.043643+0000 mgr.a (mgr.14388) 17895 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:51 smithi179 bash[23186]: cluster 2024-09-21T05:07:50.043643+0000 mgr.a (mgr.14388) 17895 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:51 smithi049 bash[23528]: cluster 2024-09-21T05:07:50.043643+0000 mgr.a (mgr.14388) 17895 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:07:53.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:53 smithi044 bash[22676]: cluster 2024-09-21T05:07:52.044446+0000 mgr.a (mgr.14388) 17896 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:53 smithi179 bash[23186]: cluster 2024-09-21T05:07:52.044446+0000 mgr.a (mgr.14388) 17896 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:53 smithi049 bash[23528]: cluster 2024-09-21T05:07:52.044446+0000 mgr.a (mgr.14388) 17896 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:54.235 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:07:54.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:07:54.236 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:07:55.017 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:07:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:07:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:07:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:07:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:07:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:55 smithi044 bash[22676]: cluster 2024-09-21T05:07:54.045237+0000 mgr.a (mgr.14388) 17897 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:55.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:55 smithi044 bash[22676]: audit 2024-09-21T05:07:54.571406+0000 mgr.a (mgr.14388) 17898 : audit [DBG] from='client.385098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:55 smithi179 bash[23186]: cluster 2024-09-21T05:07:54.045237+0000 mgr.a (mgr.14388) 17897 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:56.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:55 smithi179 bash[23186]: audit 2024-09-21T05:07:54.571406+0000 mgr.a (mgr.14388) 17898 : audit [DBG] from='client.385098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:55 smithi049 bash[23528]: cluster 2024-09-21T05:07:54.045237+0000 mgr.a (mgr.14388) 17897 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:55 smithi049 bash[23528]: audit 2024-09-21T05:07:54.571406+0000 mgr.a (mgr.14388) 17898 : audit [DBG] from='client.385098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:57 smithi049 bash[23528]: cluster 2024-09-21T05:07:56.047698+0000 mgr.a (mgr.14388) 17899 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:57 smithi044 bash[22676]: cluster 2024-09-21T05:07:56.047698+0000 mgr.a (mgr.14388) 17899 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:57 smithi179 bash[23186]: cluster 2024-09-21T05:07:56.047698+0000 mgr.a (mgr.14388) 17899 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:07:59.913 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:07:59 smithi049 bash[23528]: cluster 2024-09-21T05:07:58.048479+0000 mgr.a (mgr.14388) 17900 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:07:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:07:59 smithi044 bash[22676]: cluster 2024-09-21T05:07:58.048479+0000 mgr.a (mgr.14388) 17900 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:07:59 smithi179 bash[23186]: cluster 2024-09-21T05:07:58.048479+0000 mgr.a (mgr.14388) 17900 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:00.018 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:00.019 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:00.762 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:00.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:00.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:00.762 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:00.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:01.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:01 smithi044 bash[22676]: cluster 2024-09-21T05:08:00.050343+0000 mgr.a (mgr.14388) 17901 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:01.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:01 smithi044 bash[22676]: audit 2024-09-21T05:08:00.350899+0000 mgr.a (mgr.14388) 17902 : audit [DBG] from='client.385173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:01.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:01 smithi044 bash[22676]: audit 2024-09-21T05:08:00.779278+0000 mon.a (mon.0) 14213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:01.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:01 smithi044 bash[22676]: audit 2024-09-21T05:08:00.783985+0000 mon.a (mon.0) 14214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:01.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:01 smithi044 bash[22676]: audit 2024-09-21T05:08:00.788816+0000 mon.a (mon.0) 14215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:01 smithi179 bash[23186]: cluster 2024-09-21T05:08:00.050343+0000 mgr.a (mgr.14388) 17901 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:01 smithi179 bash[23186]: audit 2024-09-21T05:08:00.350899+0000 mgr.a (mgr.14388) 17902 : audit [DBG] from='client.385173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:01 smithi179 bash[23186]: audit 2024-09-21T05:08:00.779278+0000 mon.a (mon.0) 14213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:01 smithi179 bash[23186]: audit 2024-09-21T05:08:00.783985+0000 mon.a (mon.0) 14214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:02.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:01 smithi179 bash[23186]: audit 2024-09-21T05:08:00.788816+0000 mon.a (mon.0) 14215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:01 smithi049 bash[23528]: cluster 2024-09-21T05:08:00.050343+0000 mgr.a (mgr.14388) 17901 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:01 smithi049 bash[23528]: audit 2024-09-21T05:08:00.350899+0000 mgr.a (mgr.14388) 17902 : audit [DBG] from='client.385173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:01 smithi049 bash[23528]: audit 2024-09-21T05:08:00.779278+0000 mon.a (mon.0) 14213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:01 smithi049 bash[23528]: audit 2024-09-21T05:08:00.783985+0000 mon.a (mon.0) 14214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:01 smithi049 bash[23528]: audit 2024-09-21T05:08:00.788816+0000 mon.a (mon.0) 14215 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:03 smithi044 bash[22676]: cluster 2024-09-21T05:08:02.050846+0000 mgr.a (mgr.14388) 17903 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:08:04.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:03 smithi179 bash[23186]: cluster 2024-09-21T05:08:02.050846+0000 mgr.a (mgr.14388) 17903 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:08:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:03 smithi049 bash[23528]: cluster 2024-09-21T05:08:02.050846+0000 mgr.a (mgr.14388) 17903 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:08:05.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:05.764 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:05.764 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:05 smithi044 bash[22676]: cluster 2024-09-21T05:08:04.051607+0000 mgr.a (mgr.14388) 17904 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:08:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:05 smithi179 bash[23186]: cluster 2024-09-21T05:08:04.051607+0000 mgr.a (mgr.14388) 17904 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:08:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:05 smithi049 bash[23528]: cluster 2024-09-21T05:08:04.051607+0000 mgr.a (mgr.14388) 17904 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:08:06.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:06.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:06.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:06.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:06.556 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:07.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:07 smithi044 bash[22676]: cluster 2024-09-21T05:08:06.053765+0000 mgr.a (mgr.14388) 17905 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:07.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:07 smithi044 bash[22676]: audit 2024-09-21T05:08:06.096264+0000 mgr.a (mgr.14388) 17906 : audit [DBG] from='client.385251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:07 smithi179 bash[23186]: cluster 2024-09-21T05:08:06.053765+0000 mgr.a (mgr.14388) 17905 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:08.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:07 smithi179 bash[23186]: audit 2024-09-21T05:08:06.096264+0000 mgr.a (mgr.14388) 17906 : audit [DBG] from='client.385251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:07 smithi049 bash[23528]: cluster 2024-09-21T05:08:06.053765+0000 mgr.a (mgr.14388) 17905 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:07 smithi049 bash[23528]: audit 2024-09-21T05:08:06.096264+0000 mgr.a (mgr.14388) 17906 : audit [DBG] from='client.385251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:09.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:09 smithi179 bash[23186]: cluster 2024-09-21T05:08:08.054684+0000 mgr.a (mgr.14388) 17907 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:08:09.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:09 smithi044 bash[22676]: cluster 2024-09-21T05:08:08.054684+0000 mgr.a (mgr.14388) 17907 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:08:10.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:09 smithi049 bash[23528]: cluster 2024-09-21T05:08:08.054684+0000 mgr.a (mgr.14388) 17907 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:08:11.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:11.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:11.558 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:11 smithi044 bash[22676]: cluster 2024-09-21T05:08:10.056860+0000 mgr.a (mgr.14388) 17908 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:11 smithi044 bash[22676]: audit 2024-09-21T05:08:10.641053+0000 mon.a (mon.0) 14216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:11 smithi044 bash[22676]: audit 2024-09-21T05:08:10.648901+0000 mon.a (mon.0) 14217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:11 smithi044 bash[22676]: audit 2024-09-21T05:08:10.656347+0000 mon.a (mon.0) 14218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:11 smithi044 bash[22676]: audit 2024-09-21T05:08:10.662592+0000 mon.a (mon.0) 14219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:11 smithi044 bash[22676]: audit 2024-09-21T05:08:10.669648+0000 mon.a (mon.0) 14220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:11.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:11 smithi044 bash[22676]: audit 2024-09-21T05:08:10.678477+0000 mon.a (mon.0) 14221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:11 smithi179 bash[23186]: cluster 2024-09-21T05:08:10.056860+0000 mgr.a (mgr.14388) 17908 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:11 smithi179 bash[23186]: audit 2024-09-21T05:08:10.641053+0000 mon.a (mon.0) 14216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:11 smithi179 bash[23186]: audit 2024-09-21T05:08:10.648901+0000 mon.a (mon.0) 14217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:11 smithi179 bash[23186]: audit 2024-09-21T05:08:10.656347+0000 mon.a (mon.0) 14218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:11 smithi179 bash[23186]: audit 2024-09-21T05:08:10.662592+0000 mon.a (mon.0) 14219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:11 smithi179 bash[23186]: audit 2024-09-21T05:08:10.669648+0000 mon.a (mon.0) 14220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:11 smithi179 bash[23186]: audit 2024-09-21T05:08:10.678477+0000 mon.a (mon.0) 14221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:11 smithi049 bash[23528]: cluster 2024-09-21T05:08:10.056860+0000 mgr.a (mgr.14388) 17908 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:11 smithi049 bash[23528]: audit 2024-09-21T05:08:10.641053+0000 mon.a (mon.0) 14216 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:11 smithi049 bash[23528]: audit 2024-09-21T05:08:10.648901+0000 mon.a (mon.0) 14217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:11 smithi049 bash[23528]: audit 2024-09-21T05:08:10.656347+0000 mon.a (mon.0) 14218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:11 smithi049 bash[23528]: audit 2024-09-21T05:08:10.662592+0000 mon.a (mon.0) 14219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:11 smithi049 bash[23528]: audit 2024-09-21T05:08:10.669648+0000 mon.a (mon.0) 14220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:11 smithi049 bash[23528]: audit 2024-09-21T05:08:10.678477+0000 mon.a (mon.0) 14221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:12.322 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:12.322 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:13.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:13 smithi179 bash[23186]: audit 2024-09-21T05:08:11.881813+0000 mgr.a (mgr.14388) 17909 : audit [DBG] from='client.385326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:13.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:13 smithi179 bash[23186]: cluster 2024-09-21T05:08:12.057432+0000 mgr.a (mgr.14388) 17910 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:13 smithi044 bash[22676]: audit 2024-09-21T05:08:11.881813+0000 mgr.a (mgr.14388) 17909 : audit [DBG] from='client.385326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:13.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:13 smithi044 bash[22676]: cluster 2024-09-21T05:08:12.057432+0000 mgr.a (mgr.14388) 17910 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:13 smithi049 bash[23528]: audit 2024-09-21T05:08:11.881813+0000 mgr.a (mgr.14388) 17909 : audit [DBG] from='client.385326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:13 smithi049 bash[23528]: cluster 2024-09-21T05:08:12.057432+0000 mgr.a (mgr.14388) 17910 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:15 smithi044 bash[22676]: cluster 2024-09-21T05:08:14.058310+0000 mgr.a (mgr.14388) 17911 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:15 smithi179 bash[23186]: cluster 2024-09-21T05:08:14.058310+0000 mgr.a (mgr.14388) 17911 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:15 smithi049 bash[23528]: cluster 2024-09-21T05:08:14.058310+0000 mgr.a (mgr.14388) 17911 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:17.323 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:17.324 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:17.325 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:17 smithi044 bash[22676]: cluster 2024-09-21T05:08:16.060578+0000 mgr.a (mgr.14388) 17912 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:17 smithi179 bash[23186]: cluster 2024-09-21T05:08:16.060578+0000 mgr.a (mgr.14388) 17912 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:18.049 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:17 smithi049 bash[23528]: cluster 2024-09-21T05:08:16.060578+0000 mgr.a (mgr.14388) 17912 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:18.099 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:18.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:18.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:18.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:18.100 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:18.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:18 smithi044 bash[22676]: audit 2024-09-21T05:08:17.658989+0000 mgr.a (mgr.14388) 17913 : audit [DBG] from='client.385404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:19.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:18 smithi179 bash[23186]: audit 2024-09-21T05:08:17.658989+0000 mgr.a (mgr.14388) 17913 : audit [DBG] from='client.385404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:19.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:18 smithi049 bash[23528]: audit 2024-09-21T05:08:17.658989+0000 mgr.a (mgr.14388) 17913 : audit [DBG] from='client.385404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:19 smithi044 bash[22676]: cluster 2024-09-21T05:08:18.061184+0000 mgr.a (mgr.14388) 17914 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:20.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:19 smithi179 bash[23186]: cluster 2024-09-21T05:08:18.061184+0000 mgr.a (mgr.14388) 17914 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:19 smithi049 bash[23528]: cluster 2024-09-21T05:08:18.061184+0000 mgr.a (mgr.14388) 17914 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:21 smithi044 bash[22676]: cluster 2024-09-21T05:08:20.063315+0000 mgr.a (mgr.14388) 17915 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:21 smithi044 bash[22676]: audit 2024-09-21T05:08:20.981198+0000 mon.a (mon.0) 14222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:21 smithi044 bash[22676]: audit 2024-09-21T05:08:20.989911+0000 mon.a (mon.0) 14223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:21.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:21 smithi044 bash[22676]: audit 2024-09-21T05:08:21.000657+0000 mon.a (mon.0) 14224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:21 smithi179 bash[23186]: cluster 2024-09-21T05:08:20.063315+0000 mgr.a (mgr.14388) 17915 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:21 smithi179 bash[23186]: audit 2024-09-21T05:08:20.981198+0000 mon.a (mon.0) 14222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:21 smithi179 bash[23186]: audit 2024-09-21T05:08:20.989911+0000 mon.a (mon.0) 14223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:22.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:21 smithi179 bash[23186]: audit 2024-09-21T05:08:21.000657+0000 mon.a (mon.0) 14224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:22.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:21 smithi049 bash[23528]: cluster 2024-09-21T05:08:20.063315+0000 mgr.a (mgr.14388) 17915 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:22.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:21 smithi049 bash[23528]: audit 2024-09-21T05:08:20.981198+0000 mon.a (mon.0) 14222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:22.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:21 smithi049 bash[23528]: audit 2024-09-21T05:08:20.989911+0000 mon.a (mon.0) 14223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:22.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:21 smithi049 bash[23528]: audit 2024-09-21T05:08:21.000657+0000 mon.a (mon.0) 14224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:23.101 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:23.101 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:23.102 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:23.886 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:23.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:23 smithi044 bash[22676]: cluster 2024-09-21T05:08:22.064106+0000 mgr.a (mgr.14388) 17916 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:23 smithi179 bash[23186]: cluster 2024-09-21T05:08:22.064106+0000 mgr.a (mgr.14388) 17916 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:23 smithi049 bash[23528]: cluster 2024-09-21T05:08:22.064106+0000 mgr.a (mgr.14388) 17916 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:24 smithi044 bash[22676]: audit 2024-09-21T05:08:23.437741+0000 mgr.a (mgr.14388) 17917 : audit [DBG] from='client.385479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:24 smithi179 bash[23186]: audit 2024-09-21T05:08:23.437741+0000 mgr.a (mgr.14388) 17917 : audit [DBG] from='client.385479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:25.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:24 smithi049 bash[23528]: audit 2024-09-21T05:08:23.437741+0000 mgr.a (mgr.14388) 17917 : audit [DBG] from='client.385479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:25 smithi044 bash[22676]: cluster 2024-09-21T05:08:24.065125+0000 mgr.a (mgr.14388) 17918 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:25 smithi179 bash[23186]: cluster 2024-09-21T05:08:24.065125+0000 mgr.a (mgr.14388) 17918 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:25 smithi049 bash[23528]: cluster 2024-09-21T05:08:24.065125+0000 mgr.a (mgr.14388) 17918 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:27 smithi044 bash[22676]: cluster 2024-09-21T05:08:26.066348+0000 mgr.a (mgr.14388) 17919 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:27 smithi179 bash[23186]: cluster 2024-09-21T05:08:26.066348+0000 mgr.a (mgr.14388) 17919 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:27 smithi049 bash[23528]: cluster 2024-09-21T05:08:26.066348+0000 mgr.a (mgr.14388) 17919 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:29.686 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:29 smithi044 bash[22676]: cluster 2024-09-21T05:08:28.067086+0000 mgr.a (mgr.14388) 17920 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:30.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:29 smithi179 bash[23186]: cluster 2024-09-21T05:08:28.067086+0000 mgr.a (mgr.14388) 17920 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:29 smithi049 bash[23528]: cluster 2024-09-21T05:08:28.067086+0000 mgr.a (mgr.14388) 17920 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:30.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:30 smithi044 bash[22676]: audit 2024-09-21T05:08:29.225239+0000 mgr.a (mgr.14388) 17921 : audit [DBG] from='client.385557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:30 smithi179 bash[23186]: audit 2024-09-21T05:08:29.225239+0000 mgr.a (mgr.14388) 17921 : audit [DBG] from='client.385557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:31.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:30 smithi049 bash[23528]: audit 2024-09-21T05:08:29.225239+0000 mgr.a (mgr.14388) 17921 : audit [DBG] from='client.385557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:31 smithi044 bash[22676]: cluster 2024-09-21T05:08:30.069456+0000 mgr.a (mgr.14388) 17922 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:31 smithi044 bash[22676]: audit 2024-09-21T05:08:30.842956+0000 mon.a (mon.0) 14225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:31 smithi044 bash[22676]: audit 2024-09-21T05:08:30.850090+0000 mon.a (mon.0) 14226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:31 smithi044 bash[22676]: audit 2024-09-21T05:08:30.862525+0000 mon.a (mon.0) 14227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:31 smithi044 bash[22676]: audit 2024-09-21T05:08:30.869514+0000 mon.a (mon.0) 14228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:31 smithi044 bash[22676]: audit 2024-09-21T05:08:30.877574+0000 mon.a (mon.0) 14229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:31 smithi044 bash[22676]: audit 2024-09-21T05:08:30.887699+0000 mon.a (mon.0) 14230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:31 smithi179 bash[23186]: cluster 2024-09-21T05:08:30.069456+0000 mgr.a (mgr.14388) 17922 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:31 smithi179 bash[23186]: audit 2024-09-21T05:08:30.842956+0000 mon.a (mon.0) 14225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:31 smithi179 bash[23186]: audit 2024-09-21T05:08:30.850090+0000 mon.a (mon.0) 14226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:31 smithi179 bash[23186]: audit 2024-09-21T05:08:30.862525+0000 mon.a (mon.0) 14227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:31 smithi179 bash[23186]: audit 2024-09-21T05:08:30.869514+0000 mon.a (mon.0) 14228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:31 smithi179 bash[23186]: audit 2024-09-21T05:08:30.877574+0000 mon.a (mon.0) 14229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:31 smithi179 bash[23186]: audit 2024-09-21T05:08:30.887699+0000 mon.a (mon.0) 14230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:31 smithi049 bash[23528]: cluster 2024-09-21T05:08:30.069456+0000 mgr.a (mgr.14388) 17922 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:31 smithi049 bash[23528]: audit 2024-09-21T05:08:30.842956+0000 mon.a (mon.0) 14225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:31 smithi049 bash[23528]: audit 2024-09-21T05:08:30.850090+0000 mon.a (mon.0) 14226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:31 smithi049 bash[23528]: audit 2024-09-21T05:08:30.862525+0000 mon.a (mon.0) 14227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:31 smithi049 bash[23528]: audit 2024-09-21T05:08:30.869514+0000 mon.a (mon.0) 14228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:31 smithi049 bash[23528]: audit 2024-09-21T05:08:30.877574+0000 mon.a (mon.0) 14229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:31 smithi049 bash[23528]: audit 2024-09-21T05:08:30.887699+0000 mon.a (mon.0) 14230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:33 smithi044 bash[22676]: cluster 2024-09-21T05:08:32.070230+0000 mgr.a (mgr.14388) 17923 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:33 smithi179 bash[23186]: cluster 2024-09-21T05:08:32.070230+0000 mgr.a (mgr.14388) 17923 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:33 smithi049 bash[23528]: cluster 2024-09-21T05:08:32.070230+0000 mgr.a (mgr.14388) 17923 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:34.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:34.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:34.688 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:35.474 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:35.474 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:35.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:35.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:35.475 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:35 smithi044 bash[22676]: cluster 2024-09-21T05:08:34.071003+0000 mgr.a (mgr.14388) 17924 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:35 smithi179 bash[23186]: cluster 2024-09-21T05:08:34.071003+0000 mgr.a (mgr.14388) 17924 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:35 smithi049 bash[23528]: cluster 2024-09-21T05:08:34.071003+0000 mgr.a (mgr.14388) 17924 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:36 smithi044 bash[22676]: audit 2024-09-21T05:08:35.019489+0000 mgr.a (mgr.14388) 17925 : audit [DBG] from='client.385632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:36 smithi044 bash[22676]: audit 2024-09-21T05:08:36.381120+0000 mon.a (mon.0) 14231 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:08:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:36 smithi044 bash[22676]: audit 2024-09-21T05:08:36.388568+0000 mon.a (mon.0) 14232 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:08:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:36 smithi044 bash[22676]: audit 2024-09-21T05:08:36.390734+0000 mon.a (mon.0) 14233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:08:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:36 smithi044 bash[22676]: audit 2024-09-21T05:08:36.402542+0000 mon.a (mon.0) 14234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:36 smithi044 bash[22676]: audit 2024-09-21T05:08:36.409030+0000 mon.a (mon.0) 14235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:08:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:36 smithi179 bash[23186]: audit 2024-09-21T05:08:35.019489+0000 mgr.a (mgr.14388) 17925 : audit [DBG] from='client.385632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:36 smithi179 bash[23186]: audit 2024-09-21T05:08:36.381120+0000 mon.a (mon.0) 14231 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:08:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:36 smithi179 bash[23186]: audit 2024-09-21T05:08:36.388568+0000 mon.a (mon.0) 14232 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:08:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:36 smithi179 bash[23186]: audit 2024-09-21T05:08:36.390734+0000 mon.a (mon.0) 14233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:08:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:36 smithi179 bash[23186]: audit 2024-09-21T05:08:36.402542+0000 mon.a (mon.0) 14234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:37.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:36 smithi179 bash[23186]: audit 2024-09-21T05:08:36.409030+0000 mon.a (mon.0) 14235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:08:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:36 smithi049 bash[23528]: audit 2024-09-21T05:08:35.019489+0000 mgr.a (mgr.14388) 17925 : audit [DBG] from='client.385632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:36 smithi049 bash[23528]: audit 2024-09-21T05:08:36.381120+0000 mon.a (mon.0) 14231 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:08:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:36 smithi049 bash[23528]: audit 2024-09-21T05:08:36.388568+0000 mon.a (mon.0) 14232 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:08:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:36 smithi049 bash[23528]: audit 2024-09-21T05:08:36.390734+0000 mon.a (mon.0) 14233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:08:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:36 smithi049 bash[23528]: audit 2024-09-21T05:08:36.402542+0000 mon.a (mon.0) 14234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:36 smithi049 bash[23528]: audit 2024-09-21T05:08:36.409030+0000 mon.a (mon.0) 14235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:08:37.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:08:37 smithi044 bash[22930]: debug 2024-09-21T05:08:37.193+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:08:37.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:08:37 smithi044 bash[22930]: debug 2024-09-21T05:08:37.193+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:08:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:37 smithi044 bash[22676]: cluster 2024-09-21T05:08:36.074105+0000 mgr.a (mgr.14388) 17926 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:37 smithi044 bash[22676]: audit 2024-09-21T05:08:36.411842+0000 mgr.a (mgr.14388) 17927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:08:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:37 smithi179 bash[23186]: cluster 2024-09-21T05:08:36.074105+0000 mgr.a (mgr.14388) 17926 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:37 smithi179 bash[23186]: audit 2024-09-21T05:08:36.411842+0000 mgr.a (mgr.14388) 17927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:08:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:37 smithi049 bash[23528]: cluster 2024-09-21T05:08:36.074105+0000 mgr.a (mgr.14388) 17926 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:37 smithi049 bash[23528]: audit 2024-09-21T05:08:36.411842+0000 mgr.a (mgr.14388) 17927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:08:38.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:38 smithi049 bash[23528]: audit 2024-09-21T05:08:37.199003+0000 mgr.a (mgr.14388) 17928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:08:38.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:38 smithi049 bash[23528]: cephadm 2024-09-21T05:08:37.200346+0000 mgr.a (mgr.14388) 17929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:08:38.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:38 smithi044 bash[22676]: audit 2024-09-21T05:08:37.199003+0000 mgr.a (mgr.14388) 17928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:08:38.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:38 smithi044 bash[22676]: cephadm 2024-09-21T05:08:37.200346+0000 mgr.a (mgr.14388) 17929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:08:39.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:38 smithi179 bash[23186]: audit 2024-09-21T05:08:37.199003+0000 mgr.a (mgr.14388) 17928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:08:39.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:38 smithi179 bash[23186]: cephadm 2024-09-21T05:08:37.200346+0000 mgr.a (mgr.14388) 17929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:08:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:39 smithi044 bash[22676]: cluster 2024-09-21T05:08:38.075044+0000 mgr.a (mgr.14388) 17930 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:08:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:39 smithi179 bash[23186]: cluster 2024-09-21T05:08:38.075044+0000 mgr.a (mgr.14388) 17930 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:08:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:39 smithi049 bash[23528]: cluster 2024-09-21T05:08:38.075044+0000 mgr.a (mgr.14388) 17930 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:08:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:40.477 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:41.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:41.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:41.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:41.241 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:41.242 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:41 smithi179 bash[23186]: cluster 2024-09-21T05:08:40.077366+0000 mgr.a (mgr.14388) 17931 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:41 smithi179 bash[23186]: audit 2024-09-21T05:08:41.163354+0000 mon.a (mon.0) 14236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:41 smithi179 bash[23186]: audit 2024-09-21T05:08:41.167843+0000 mon.a (mon.0) 14237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:41 smithi179 bash[23186]: audit 2024-09-21T05:08:41.172699+0000 mon.a (mon.0) 14238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:41 smithi049 bash[23528]: cluster 2024-09-21T05:08:40.077366+0000 mgr.a (mgr.14388) 17931 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:41 smithi049 bash[23528]: audit 2024-09-21T05:08:41.163354+0000 mon.a (mon.0) 14236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:41 smithi049 bash[23528]: audit 2024-09-21T05:08:41.167843+0000 mon.a (mon.0) 14237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:41 smithi049 bash[23528]: audit 2024-09-21T05:08:41.172699+0000 mon.a (mon.0) 14238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:41 smithi044 bash[22676]: cluster 2024-09-21T05:08:40.077366+0000 mgr.a (mgr.14388) 17931 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:41 smithi044 bash[22676]: audit 2024-09-21T05:08:41.163354+0000 mon.a (mon.0) 14236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:41 smithi044 bash[22676]: audit 2024-09-21T05:08:41.167843+0000 mon.a (mon.0) 14237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:41 smithi044 bash[22676]: audit 2024-09-21T05:08:41.172699+0000 mon.a (mon.0) 14238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:42 smithi044 bash[22676]: audit 2024-09-21T05:08:40.810925+0000 mgr.a (mgr.14388) 17932 : audit [DBG] from='client.385815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:42 smithi179 bash[23186]: audit 2024-09-21T05:08:40.810925+0000 mgr.a (mgr.14388) 17932 : audit [DBG] from='client.385815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:42 smithi049 bash[23528]: audit 2024-09-21T05:08:40.810925+0000 mgr.a (mgr.14388) 17932 : audit [DBG] from='client.385815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:43 smithi179 bash[23186]: cluster 2024-09-21T05:08:42.078253+0000 mgr.a (mgr.14388) 17933 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:08:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:43 smithi049 bash[23528]: cluster 2024-09-21T05:08:42.078253+0000 mgr.a (mgr.14388) 17933 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:08:44.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:43 smithi044 bash[22676]: cluster 2024-09-21T05:08:42.078253+0000 mgr.a (mgr.14388) 17933 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:08:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:45 smithi049 bash[23528]: cluster 2024-09-21T05:08:44.079039+0000 mgr.a (mgr.14388) 17934 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:08:46.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:45 smithi044 bash[22676]: cluster 2024-09-21T05:08:44.079039+0000 mgr.a (mgr.14388) 17934 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:08:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:45 smithi179 bash[23186]: cluster 2024-09-21T05:08:44.079039+0000 mgr.a (mgr.14388) 17934 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:08:46.999 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:47 smithi049 bash[23528]: cluster 2024-09-21T05:08:46.081293+0000 mgr.a (mgr.14388) 17935 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:47 smithi049 bash[23528]: audit 2024-09-21T05:08:46.574663+0000 mgr.a (mgr.14388) 17936 : audit [DBG] from='client.385890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:47 smithi044 bash[22676]: cluster 2024-09-21T05:08:46.081293+0000 mgr.a (mgr.14388) 17935 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:48.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:47 smithi044 bash[22676]: audit 2024-09-21T05:08:46.574663+0000 mgr.a (mgr.14388) 17936 : audit [DBG] from='client.385890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:47 smithi179 bash[23186]: cluster 2024-09-21T05:08:46.081293+0000 mgr.a (mgr.14388) 17935 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:47 smithi179 bash[23186]: audit 2024-09-21T05:08:46.574663+0000 mgr.a (mgr.14388) 17936 : audit [DBG] from='client.385890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:49 smithi049 bash[23528]: cluster 2024-09-21T05:08:48.082212+0000 mgr.a (mgr.14388) 17937 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:50.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:49 smithi044 bash[22676]: cluster 2024-09-21T05:08:48.082212+0000 mgr.a (mgr.14388) 17937 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:49 smithi179 bash[23186]: cluster 2024-09-21T05:08:48.082212+0000 mgr.a (mgr.14388) 17937 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:52.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:52.001 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:52.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:51 smithi049 bash[23528]: cluster 2024-09-21T05:08:50.084369+0000 mgr.a (mgr.14388) 17938 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:51 smithi049 bash[23528]: audit 2024-09-21T05:08:51.078158+0000 mon.a (mon.0) 14239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:51 smithi049 bash[23528]: audit 2024-09-21T05:08:51.084570+0000 mon.a (mon.0) 14240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:51 smithi049 bash[23528]: audit 2024-09-21T05:08:51.091608+0000 mon.a (mon.0) 14241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:51 smithi049 bash[23528]: audit 2024-09-21T05:08:51.102554+0000 mon.a (mon.0) 14242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:51 smithi049 bash[23528]: audit 2024-09-21T05:08:51.107283+0000 mon.a (mon.0) 14243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:51 smithi049 bash[23528]: audit 2024-09-21T05:08:51.114781+0000 mon.a (mon.0) 14244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.142 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:51 smithi179 bash[23186]: cluster 2024-09-21T05:08:50.084369+0000 mgr.a (mgr.14388) 17938 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:52.142 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:51 smithi179 bash[23186]: audit 2024-09-21T05:08:51.078158+0000 mon.a (mon.0) 14239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.142 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:51 smithi179 bash[23186]: audit 2024-09-21T05:08:51.084570+0000 mon.a (mon.0) 14240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.142 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:51 smithi179 bash[23186]: audit 2024-09-21T05:08:51.091608+0000 mon.a (mon.0) 14241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.142 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:51 smithi179 bash[23186]: audit 2024-09-21T05:08:51.102554+0000 mon.a (mon.0) 14242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.142 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:51 smithi179 bash[23186]: audit 2024-09-21T05:08:51.107283+0000 mon.a (mon.0) 14243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:51 smithi179 bash[23186]: audit 2024-09-21T05:08:51.114781+0000 mon.a (mon.0) 14244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:51 smithi044 bash[22676]: cluster 2024-09-21T05:08:50.084369+0000 mgr.a (mgr.14388) 17938 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:08:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:51 smithi044 bash[22676]: audit 2024-09-21T05:08:51.078158+0000 mon.a (mon.0) 14239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:51 smithi044 bash[22676]: audit 2024-09-21T05:08:51.084570+0000 mon.a (mon.0) 14240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:51 smithi044 bash[22676]: audit 2024-09-21T05:08:51.091608+0000 mon.a (mon.0) 14241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:51 smithi044 bash[22676]: audit 2024-09-21T05:08:51.102554+0000 mon.a (mon.0) 14242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:51 smithi044 bash[22676]: audit 2024-09-21T05:08:51.107283+0000 mon.a (mon.0) 14243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:51 smithi044 bash[22676]: audit 2024-09-21T05:08:51.114781+0000 mon.a (mon.0) 14244 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:08:52.768 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:08:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:53 smithi179 bash[23186]: cluster 2024-09-21T05:08:52.085112+0000 mgr.a (mgr.14388) 17939 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:53 smithi179 bash[23186]: audit 2024-09-21T05:08:52.331963+0000 mgr.a (mgr.14388) 17940 : audit [DBG] from='client.385968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:53 smithi049 bash[23528]: cluster 2024-09-21T05:08:52.085112+0000 mgr.a (mgr.14388) 17939 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:53 smithi049 bash[23528]: audit 2024-09-21T05:08:52.331963+0000 mgr.a (mgr.14388) 17940 : audit [DBG] from='client.385968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:53 smithi044 bash[22676]: cluster 2024-09-21T05:08:52.085112+0000 mgr.a (mgr.14388) 17939 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:54.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:53 smithi044 bash[22676]: audit 2024-09-21T05:08:52.331963+0000 mgr.a (mgr.14388) 17940 : audit [DBG] from='client.385968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:08:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:55 smithi049 bash[23528]: cluster 2024-09-21T05:08:54.086036+0000 mgr.a (mgr.14388) 17941 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:55 smithi044 bash[22676]: cluster 2024-09-21T05:08:54.086036+0000 mgr.a (mgr.14388) 17941 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:55 smithi179 bash[23186]: cluster 2024-09-21T05:08:54.086036+0000 mgr.a (mgr.14388) 17941 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:08:57.770 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:08:57.770 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:08:57.771 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:08:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:57 smithi049 bash[23528]: cluster 2024-09-21T05:08:56.088345+0000 mgr.a (mgr.14388) 17942 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:57 smithi044 bash[22676]: cluster 2024-09-21T05:08:56.088345+0000 mgr.a (mgr.14388) 17942 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:57 smithi179 bash[23186]: cluster 2024-09-21T05:08:56.088345+0000 mgr.a (mgr.14388) 17942 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:08:58.565 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:08:58.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:08:58.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:08:58.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:08:58.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:59 smithi049 bash[23528]: cluster 2024-09-21T05:08:58.089056+0000 mgr.a (mgr.14388) 17943 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:08:59 smithi049 bash[23528]: audit 2024-09-21T05:08:58.102241+0000 mgr.a (mgr.14388) 17944 : audit [DBG] from='client.386046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:00.197 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:59 smithi044 bash[22676]: cluster 2024-09-21T05:08:58.089056+0000 mgr.a (mgr.14388) 17943 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:00.197 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:08:59 smithi044 bash[22676]: audit 2024-09-21T05:08:58.102241+0000 mgr.a (mgr.14388) 17944 : audit [DBG] from='client.386046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:59 smithi179 bash[23186]: cluster 2024-09-21T05:08:58.089056+0000 mgr.a (mgr.14388) 17943 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:08:59 smithi179 bash[23186]: audit 2024-09-21T05:08:58.102241+0000 mgr.a (mgr.14388) 17944 : audit [DBG] from='client.386046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:01.232 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:00 smithi044 bash[22676]: cluster 2024-09-21T05:09:00.091342+0000 mgr.a (mgr.14388) 17945 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:00 smithi179 bash[23186]: cluster 2024-09-21T05:09:00.091342+0000 mgr.a (mgr.14388) 17945 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:00 smithi049 bash[23528]: cluster 2024-09-21T05:09:00.091342+0000 mgr.a (mgr.14388) 17945 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:02 smithi044 bash[22676]: audit 2024-09-21T05:09:01.319395+0000 mon.a (mon.0) 14245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:02 smithi044 bash[22676]: audit 2024-09-21T05:09:01.325429+0000 mon.a (mon.0) 14246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:02 smithi044 bash[22676]: audit 2024-09-21T05:09:01.330775+0000 mon.a (mon.0) 14247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:02 smithi179 bash[23186]: audit 2024-09-21T05:09:01.319395+0000 mon.a (mon.0) 14245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:02 smithi179 bash[23186]: audit 2024-09-21T05:09:01.325429+0000 mon.a (mon.0) 14246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:02 smithi179 bash[23186]: audit 2024-09-21T05:09:01.330775+0000 mon.a (mon.0) 14247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:02 smithi049 bash[23528]: audit 2024-09-21T05:09:01.319395+0000 mon.a (mon.0) 14245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:02 smithi049 bash[23528]: audit 2024-09-21T05:09:01.325429+0000 mon.a (mon.0) 14246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:02.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:02 smithi049 bash[23528]: audit 2024-09-21T05:09:01.330775+0000 mon.a (mon.0) 14247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:03.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:03.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:03.567 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:03.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:03 smithi044 bash[22676]: cluster 2024-09-21T05:09:02.092101+0000 mgr.a (mgr.14388) 17946 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:03 smithi179 bash[23186]: cluster 2024-09-21T05:09:02.092101+0000 mgr.a (mgr.14388) 17946 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:03 smithi049 bash[23528]: cluster 2024-09-21T05:09:02.092101+0000 mgr.a (mgr.14388) 17946 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:04.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:04.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:04.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:05 smithi044 bash[22676]: audit 2024-09-21T05:09:03.895636+0000 mgr.a (mgr.14388) 17947 : audit [DBG] from='client.386124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:05.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:05 smithi044 bash[22676]: cluster 2024-09-21T05:09:04.092633+0000 mgr.a (mgr.14388) 17948 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:05 smithi179 bash[23186]: audit 2024-09-21T05:09:03.895636+0000 mgr.a (mgr.14388) 17947 : audit [DBG] from='client.386124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:05 smithi179 bash[23186]: cluster 2024-09-21T05:09:04.092633+0000 mgr.a (mgr.14388) 17948 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:05 smithi049 bash[23528]: audit 2024-09-21T05:09:03.895636+0000 mgr.a (mgr.14388) 17947 : audit [DBG] from='client.386124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:05.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:05 smithi049 bash[23528]: cluster 2024-09-21T05:09:04.092633+0000 mgr.a (mgr.14388) 17948 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:07 smithi044 bash[22676]: cluster 2024-09-21T05:09:06.094996+0000 mgr.a (mgr.14388) 17949 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:07 smithi179 bash[23186]: cluster 2024-09-21T05:09:06.094996+0000 mgr.a (mgr.14388) 17949 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:07 smithi049 bash[23528]: cluster 2024-09-21T05:09:06.094996+0000 mgr.a (mgr.14388) 17949 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:09.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:09.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:09.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:09 smithi044 bash[22676]: cluster 2024-09-21T05:09:08.095747+0000 mgr.a (mgr.14388) 17950 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:09 smithi179 bash[23186]: cluster 2024-09-21T05:09:08.095747+0000 mgr.a (mgr.14388) 17950 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:09 smithi049 bash[23528]: cluster 2024-09-21T05:09:08.095747+0000 mgr.a (mgr.14388) 17950 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:10.124 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:10.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:10.125 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:10.125 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:10.125 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:10 smithi044 bash[22676]: audit 2024-09-21T05:09:09.662904+0000 mgr.a (mgr.14388) 17951 : audit [DBG] from='client.386202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:10 smithi179 bash[23186]: audit 2024-09-21T05:09:09.662904+0000 mgr.a (mgr.14388) 17951 : audit [DBG] from='client.386202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:10 smithi049 bash[23528]: audit 2024-09-21T05:09:09.662904+0000 mgr.a (mgr.14388) 17951 : audit [DBG] from='client.386202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:11 smithi044 bash[22676]: cluster 2024-09-21T05:09:10.096862+0000 mgr.a (mgr.14388) 17952 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:09:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:11 smithi044 bash[22676]: audit 2024-09-21T05:09:11.285320+0000 mon.a (mon.0) 14248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:11 smithi044 bash[22676]: audit 2024-09-21T05:09:11.292843+0000 mon.a (mon.0) 14249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:11 smithi044 bash[22676]: audit 2024-09-21T05:09:11.302174+0000 mon.a (mon.0) 14250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:11 smithi044 bash[22676]: audit 2024-09-21T05:09:11.326118+0000 mon.a (mon.0) 14251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:11 smithi044 bash[22676]: audit 2024-09-21T05:09:11.333652+0000 mon.a (mon.0) 14252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:11 smithi044 bash[22676]: audit 2024-09-21T05:09:11.342182+0000 mon.a (mon.0) 14253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:11 smithi179 bash[23186]: cluster 2024-09-21T05:09:10.096862+0000 mgr.a (mgr.14388) 17952 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:09:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:11 smithi179 bash[23186]: audit 2024-09-21T05:09:11.285320+0000 mon.a (mon.0) 14248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:11 smithi179 bash[23186]: audit 2024-09-21T05:09:11.292843+0000 mon.a (mon.0) 14249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:11 smithi179 bash[23186]: audit 2024-09-21T05:09:11.302174+0000 mon.a (mon.0) 14250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:11 smithi179 bash[23186]: audit 2024-09-21T05:09:11.326118+0000 mon.a (mon.0) 14251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:11 smithi179 bash[23186]: audit 2024-09-21T05:09:11.333652+0000 mon.a (mon.0) 14252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:11 smithi179 bash[23186]: audit 2024-09-21T05:09:11.342182+0000 mon.a (mon.0) 14253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:11 smithi049 bash[23528]: cluster 2024-09-21T05:09:10.096862+0000 mgr.a (mgr.14388) 17952 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:09:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:11 smithi049 bash[23528]: audit 2024-09-21T05:09:11.285320+0000 mon.a (mon.0) 14248 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:11 smithi049 bash[23528]: audit 2024-09-21T05:09:11.292843+0000 mon.a (mon.0) 14249 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:11 smithi049 bash[23528]: audit 2024-09-21T05:09:11.302174+0000 mon.a (mon.0) 14250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:11 smithi049 bash[23528]: audit 2024-09-21T05:09:11.326118+0000 mon.a (mon.0) 14251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:11 smithi049 bash[23528]: audit 2024-09-21T05:09:11.333652+0000 mon.a (mon.0) 14252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:11 smithi049 bash[23528]: audit 2024-09-21T05:09:11.342182+0000 mon.a (mon.0) 14253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:13.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:13 smithi179 bash[23186]: cluster 2024-09-21T05:09:12.097619+0000 mgr.a (mgr.14388) 17953 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:09:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:13 smithi044 bash[22676]: cluster 2024-09-21T05:09:12.097619+0000 mgr.a (mgr.14388) 17953 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:09:13.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:13 smithi049 bash[23528]: cluster 2024-09-21T05:09:12.097619+0000 mgr.a (mgr.14388) 17953 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:09:15.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:15.127 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:15.127 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:15 smithi044 bash[22676]: cluster 2024-09-21T05:09:14.098430+0000 mgr.a (mgr.14388) 17954 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:09:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:15 smithi179 bash[23186]: cluster 2024-09-21T05:09:14.098430+0000 mgr.a (mgr.14388) 17954 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:09:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:15 smithi049 bash[23528]: cluster 2024-09-21T05:09:14.098430+0000 mgr.a (mgr.14388) 17954 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:09:15.882 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:16 smithi044 bash[22676]: audit 2024-09-21T05:09:15.454574+0000 mgr.a (mgr.14388) 17955 : audit [DBG] from='client.386280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:16 smithi179 bash[23186]: audit 2024-09-21T05:09:15.454574+0000 mgr.a (mgr.14388) 17955 : audit [DBG] from='client.386280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:16 smithi049 bash[23528]: audit 2024-09-21T05:09:15.454574+0000 mgr.a (mgr.14388) 17955 : audit [DBG] from='client.386280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:17 smithi044 bash[22676]: cluster 2024-09-21T05:09:16.101419+0000 mgr.a (mgr.14388) 17956 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:17 smithi179 bash[23186]: cluster 2024-09-21T05:09:16.101419+0000 mgr.a (mgr.14388) 17956 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:17 smithi049 bash[23528]: cluster 2024-09-21T05:09:16.101419+0000 mgr.a (mgr.14388) 17956 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:19.681 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:19 smithi049 bash[23528]: cluster 2024-09-21T05:09:18.102198+0000 mgr.a (mgr.14388) 17957 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:09:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:19 smithi044 bash[22676]: cluster 2024-09-21T05:09:18.102198+0000 mgr.a (mgr.14388) 17957 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:09:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:19 smithi179 bash[23186]: cluster 2024-09-21T05:09:18.102198+0000 mgr.a (mgr.14388) 17957 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:09:20.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:20.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:20.884 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:21.655 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:21.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:21.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:21.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:21.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:21.656 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:21 smithi044 bash[22676]: cluster 2024-09-21T05:09:20.104122+0000 mgr.a (mgr.14388) 17958 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:21 smithi179 bash[23186]: cluster 2024-09-21T05:09:20.104122+0000 mgr.a (mgr.14388) 17958 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:21 smithi049 bash[23528]: cluster 2024-09-21T05:09:20.104122+0000 mgr.a (mgr.14388) 17958 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:22.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:22 smithi044 bash[22676]: audit 2024-09-21T05:09:21.208564+0000 mgr.a (mgr.14388) 17959 : audit [DBG] from='client.386358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:22.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:22 smithi044 bash[22676]: audit 2024-09-21T05:09:21.479905+0000 mon.a (mon.0) 14254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:22 smithi044 bash[22676]: audit 2024-09-21T05:09:21.484840+0000 mon.a (mon.0) 14255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:22 smithi044 bash[22676]: audit 2024-09-21T05:09:21.492941+0000 mon.a (mon.0) 14256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:22 smithi179 bash[23186]: audit 2024-09-21T05:09:21.208564+0000 mgr.a (mgr.14388) 17959 : audit [DBG] from='client.386358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:22 smithi179 bash[23186]: audit 2024-09-21T05:09:21.479905+0000 mon.a (mon.0) 14254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:22 smithi179 bash[23186]: audit 2024-09-21T05:09:21.484840+0000 mon.a (mon.0) 14255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:22 smithi179 bash[23186]: audit 2024-09-21T05:09:21.492941+0000 mon.a (mon.0) 14256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:22 smithi049 bash[23528]: audit 2024-09-21T05:09:21.208564+0000 mgr.a (mgr.14388) 17959 : audit [DBG] from='client.386358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:22 smithi049 bash[23528]: audit 2024-09-21T05:09:21.479905+0000 mon.a (mon.0) 14254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:22 smithi049 bash[23528]: audit 2024-09-21T05:09:21.484840+0000 mon.a (mon.0) 14255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:22 smithi049 bash[23528]: audit 2024-09-21T05:09:21.492941+0000 mon.a (mon.0) 14256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:23 smithi044 bash[22676]: cluster 2024-09-21T05:09:22.105080+0000 mgr.a (mgr.14388) 17960 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:09:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:23 smithi179 bash[23186]: cluster 2024-09-21T05:09:22.105080+0000 mgr.a (mgr.14388) 17960 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:09:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:23 smithi049 bash[23528]: cluster 2024-09-21T05:09:22.105080+0000 mgr.a (mgr.14388) 17960 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:09:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:25 smithi179 bash[23186]: cluster 2024-09-21T05:09:24.105621+0000 mgr.a (mgr.14388) 17961 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:09:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:25 smithi049 bash[23528]: cluster 2024-09-21T05:09:24.105621+0000 mgr.a (mgr.14388) 17961 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:09:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:25 smithi044 bash[22676]: cluster 2024-09-21T05:09:24.105621+0000 mgr.a (mgr.14388) 17961 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:09:26.656 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:26.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:26.657 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:27.437 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:27.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:27 smithi049 bash[23528]: cluster 2024-09-21T05:09:26.107799+0000 mgr.a (mgr.14388) 17962 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:09:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:27 smithi044 bash[22676]: cluster 2024-09-21T05:09:26.107799+0000 mgr.a (mgr.14388) 17962 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:09:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:27 smithi179 bash[23186]: cluster 2024-09-21T05:09:26.107799+0000 mgr.a (mgr.14388) 17962 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:09:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:28 smithi049 bash[23528]: audit 2024-09-21T05:09:26.990556+0000 mgr.a (mgr.14388) 17963 : audit [DBG] from='client.386436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:28.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:28 smithi044 bash[22676]: audit 2024-09-21T05:09:26.990556+0000 mgr.a (mgr.14388) 17963 : audit [DBG] from='client.386436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:28 smithi179 bash[23186]: audit 2024-09-21T05:09:26.990556+0000 mgr.a (mgr.14388) 17963 : audit [DBG] from='client.386436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:29.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:29 smithi049 bash[23528]: cluster 2024-09-21T05:09:28.108717+0000 mgr.a (mgr.14388) 17964 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:29 smithi044 bash[22676]: cluster 2024-09-21T05:09:28.108717+0000 mgr.a (mgr.14388) 17964 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:29 smithi179 bash[23186]: cluster 2024-09-21T05:09:28.108717+0000 mgr.a (mgr.14388) 17964 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:31.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:31 smithi179 bash[23186]: cluster 2024-09-21T05:09:30.110922+0000 mgr.a (mgr.14388) 17965 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:31.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:31 smithi179 bash[23186]: audit 2024-09-21T05:09:31.480993+0000 mon.a (mon.0) 14257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:31 smithi179 bash[23186]: audit 2024-09-21T05:09:31.489106+0000 mon.a (mon.0) 14258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:31 smithi179 bash[23186]: audit 2024-09-21T05:09:31.497505+0000 mon.a (mon.0) 14259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:31 smithi049 bash[23528]: cluster 2024-09-21T05:09:30.110922+0000 mgr.a (mgr.14388) 17965 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:31.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:31 smithi049 bash[23528]: audit 2024-09-21T05:09:31.480993+0000 mon.a (mon.0) 14257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:31 smithi049 bash[23528]: audit 2024-09-21T05:09:31.489106+0000 mon.a (mon.0) 14258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:31 smithi049 bash[23528]: audit 2024-09-21T05:09:31.497505+0000 mon.a (mon.0) 14259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:31 smithi044 bash[22676]: cluster 2024-09-21T05:09:30.110922+0000 mgr.a (mgr.14388) 17965 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:31 smithi044 bash[22676]: audit 2024-09-21T05:09:31.480993+0000 mon.a (mon.0) 14257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:31 smithi044 bash[22676]: audit 2024-09-21T05:09:31.489106+0000 mon.a (mon.0) 14258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:31.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:31 smithi044 bash[22676]: audit 2024-09-21T05:09:31.497505+0000 mon.a (mon.0) 14259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.439 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:32.440 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:32.440 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:32.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:32 smithi179 bash[23186]: audit 2024-09-21T05:09:31.542866+0000 mon.a (mon.0) 14260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:32 smithi179 bash[23186]: audit 2024-09-21T05:09:31.547885+0000 mon.a (mon.0) 14261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:32 smithi179 bash[23186]: audit 2024-09-21T05:09:31.556136+0000 mon.a (mon.0) 14262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:32 smithi049 bash[23528]: audit 2024-09-21T05:09:31.542866+0000 mon.a (mon.0) 14260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:32 smithi049 bash[23528]: audit 2024-09-21T05:09:31.547885+0000 mon.a (mon.0) 14261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:32 smithi049 bash[23528]: audit 2024-09-21T05:09:31.556136+0000 mon.a (mon.0) 14262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:32 smithi044 bash[22676]: audit 2024-09-21T05:09:31.542866+0000 mon.a (mon.0) 14260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:32 smithi044 bash[22676]: audit 2024-09-21T05:09:31.547885+0000 mon.a (mon.0) 14261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:32 smithi044 bash[22676]: audit 2024-09-21T05:09:31.556136+0000 mon.a (mon.0) 14262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:33.213 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:33.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:33.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:33.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:33.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:33 smithi044 bash[22676]: cluster 2024-09-21T05:09:32.111723+0000 mgr.a (mgr.14388) 17966 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:33.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:33 smithi044 bash[22676]: audit 2024-09-21T05:09:32.771243+0000 mgr.a (mgr.14388) 17967 : audit [DBG] from='client.386511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:33 smithi179 bash[23186]: cluster 2024-09-21T05:09:32.111723+0000 mgr.a (mgr.14388) 17966 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:34.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:33 smithi179 bash[23186]: audit 2024-09-21T05:09:32.771243+0000 mgr.a (mgr.14388) 17967 : audit [DBG] from='client.386511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:33 smithi049 bash[23528]: cluster 2024-09-21T05:09:32.111723+0000 mgr.a (mgr.14388) 17966 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:33 smithi049 bash[23528]: audit 2024-09-21T05:09:32.771243+0000 mgr.a (mgr.14388) 17967 : audit [DBG] from='client.386511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:35 smithi044 bash[22676]: cluster 2024-09-21T05:09:34.112664+0000 mgr.a (mgr.14388) 17968 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:35 smithi179 bash[23186]: cluster 2024-09-21T05:09:34.112664+0000 mgr.a (mgr.14388) 17968 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:35 smithi049 bash[23528]: cluster 2024-09-21T05:09:34.112664+0000 mgr.a (mgr.14388) 17968 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:37 smithi044 bash[22676]: cluster 2024-09-21T05:09:36.114941+0000 mgr.a (mgr.14388) 17969 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:37 smithi044 bash[22676]: audit 2024-09-21T05:09:37.263341+0000 mon.a (mon.0) 14263 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:09:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:37 smithi044 bash[22676]: audit 2024-09-21T05:09:37.269917+0000 mon.a (mon.0) 14264 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:09:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:37 smithi044 bash[22676]: audit 2024-09-21T05:09:37.271717+0000 mon.a (mon.0) 14265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:09:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:37 smithi044 bash[22676]: audit 2024-09-21T05:09:37.283219+0000 mon.a (mon.0) 14266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:37 smithi044 bash[22676]: audit 2024-09-21T05:09:37.289589+0000 mon.a (mon.0) 14267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:09:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:37 smithi179 bash[23186]: cluster 2024-09-21T05:09:36.114941+0000 mgr.a (mgr.14388) 17969 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:37 smithi179 bash[23186]: audit 2024-09-21T05:09:37.263341+0000 mon.a (mon.0) 14263 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:09:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:37 smithi179 bash[23186]: audit 2024-09-21T05:09:37.269917+0000 mon.a (mon.0) 14264 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:09:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:37 smithi179 bash[23186]: audit 2024-09-21T05:09:37.271717+0000 mon.a (mon.0) 14265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:09:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:37 smithi179 bash[23186]: audit 2024-09-21T05:09:37.283219+0000 mon.a (mon.0) 14266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:37 smithi179 bash[23186]: audit 2024-09-21T05:09:37.289589+0000 mon.a (mon.0) 14267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:09:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:37 smithi049 bash[23528]: cluster 2024-09-21T05:09:36.114941+0000 mgr.a (mgr.14388) 17969 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:09:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:37 smithi049 bash[23528]: audit 2024-09-21T05:09:37.263341+0000 mon.a (mon.0) 14263 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:09:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:37 smithi049 bash[23528]: audit 2024-09-21T05:09:37.269917+0000 mon.a (mon.0) 14264 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:09:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:37 smithi049 bash[23528]: audit 2024-09-21T05:09:37.271717+0000 mon.a (mon.0) 14265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:09:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:37 smithi049 bash[23528]: audit 2024-09-21T05:09:37.283219+0000 mon.a (mon.0) 14266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:37 smithi049 bash[23528]: audit 2024-09-21T05:09:37.289589+0000 mon.a (mon.0) 14267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:09:38.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:38.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:09:38 smithi044 bash[22930]: debug 2024-09-21T05:09:38.064+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:09:38.490 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:09:38 smithi044 bash[22930]: debug 2024-09-21T05:09:38.064+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:09:38.869 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:38 smithi049 bash[23528]: audit 2024-09-21T05:09:37.292094+0000 mgr.a (mgr.14388) 17970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:09:38.938 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:38.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:38.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:38.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:38.938 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:38 smithi044 bash[22676]: audit 2024-09-21T05:09:37.292094+0000 mgr.a (mgr.14388) 17970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:09:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:38 smithi179 bash[23186]: audit 2024-09-21T05:09:37.292094+0000 mgr.a (mgr.14388) 17970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:09:39.899 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:39 smithi049 bash[23528]: audit 2024-09-21T05:09:38.066618+0000 mgr.a (mgr.14388) 17971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:09:39.899 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:39 smithi049 bash[23528]: cephadm 2024-09-21T05:09:38.068097+0000 mgr.a (mgr.14388) 17972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:09:39.899 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:39 smithi049 bash[23528]: cluster 2024-09-21T05:09:38.115437+0000 mgr.a (mgr.14388) 17973 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:39.900 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:39 smithi049 bash[23528]: audit 2024-09-21T05:09:38.527842+0000 mgr.a (mgr.14388) 17974 : audit [DBG] from='client.386691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:39 smithi044 bash[22676]: audit 2024-09-21T05:09:38.066618+0000 mgr.a (mgr.14388) 17971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:09:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:39 smithi044 bash[22676]: cephadm 2024-09-21T05:09:38.068097+0000 mgr.a (mgr.14388) 17972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:09:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:39 smithi044 bash[22676]: cluster 2024-09-21T05:09:38.115437+0000 mgr.a (mgr.14388) 17973 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:39 smithi044 bash[22676]: audit 2024-09-21T05:09:38.527842+0000 mgr.a (mgr.14388) 17974 : audit [DBG] from='client.386691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:39 smithi179 bash[23186]: audit 2024-09-21T05:09:38.066618+0000 mgr.a (mgr.14388) 17971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:09:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:39 smithi179 bash[23186]: cephadm 2024-09-21T05:09:38.068097+0000 mgr.a (mgr.14388) 17972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:09:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:39 smithi179 bash[23186]: cluster 2024-09-21T05:09:38.115437+0000 mgr.a (mgr.14388) 17973 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:39 smithi179 bash[23186]: audit 2024-09-21T05:09:38.527842+0000 mgr.a (mgr.14388) 17974 : audit [DBG] from='client.386691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:41.884 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:41 smithi044 bash[22676]: cluster 2024-09-21T05:09:40.117698+0000 mgr.a (mgr.14388) 17975 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:41.907 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:41 smithi049 bash[23528]: cluster 2024-09-21T05:09:40.117698+0000 mgr.a (mgr.14388) 17975 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:41 smithi179 bash[23186]: cluster 2024-09-21T05:09:40.117698+0000 mgr.a (mgr.14388) 17975 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:42 smithi044 bash[22676]: audit 2024-09-21T05:09:41.693084+0000 mon.a (mon.0) 14268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:42 smithi044 bash[22676]: audit 2024-09-21T05:09:41.702166+0000 mon.a (mon.0) 14269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:42 smithi044 bash[22676]: audit 2024-09-21T05:09:41.713175+0000 mon.a (mon.0) 14270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:42 smithi179 bash[23186]: audit 2024-09-21T05:09:41.693084+0000 mon.a (mon.0) 14268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:42 smithi179 bash[23186]: audit 2024-09-21T05:09:41.702166+0000 mon.a (mon.0) 14269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:42 smithi179 bash[23186]: audit 2024-09-21T05:09:41.713175+0000 mon.a (mon.0) 14270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:42 smithi049 bash[23528]: audit 2024-09-21T05:09:41.693084+0000 mon.a (mon.0) 14268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:42 smithi049 bash[23528]: audit 2024-09-21T05:09:41.702166+0000 mon.a (mon.0) 14269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:42 smithi049 bash[23528]: audit 2024-09-21T05:09:41.713175+0000 mon.a (mon.0) 14270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:43 smithi044 bash[22676]: cluster 2024-09-21T05:09:42.118452+0000 mgr.a (mgr.14388) 17976 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:43 smithi179 bash[23186]: cluster 2024-09-21T05:09:42.118452+0000 mgr.a (mgr.14388) 17976 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:43 smithi049 bash[23528]: cluster 2024-09-21T05:09:42.118452+0000 mgr.a (mgr.14388) 17976 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:44.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:44.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:44.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:44.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:44.679 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:45 smithi044 bash[22676]: cluster 2024-09-21T05:09:44.119099+0000 mgr.a (mgr.14388) 17977 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:45 smithi044 bash[22676]: audit 2024-09-21T05:09:44.268511+0000 mgr.a (mgr.14388) 17978 : audit [DBG] from='client.386763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:45 smithi179 bash[23186]: cluster 2024-09-21T05:09:44.119099+0000 mgr.a (mgr.14388) 17977 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:45 smithi179 bash[23186]: audit 2024-09-21T05:09:44.268511+0000 mgr.a (mgr.14388) 17978 : audit [DBG] from='client.386763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:45 smithi049 bash[23528]: cluster 2024-09-21T05:09:44.119099+0000 mgr.a (mgr.14388) 17977 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:45 smithi049 bash[23528]: audit 2024-09-21T05:09:44.268511+0000 mgr.a (mgr.14388) 17978 : audit [DBG] from='client.386763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:47.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:47 smithi044 bash[22676]: cluster 2024-09-21T05:09:46.121499+0000 mgr.a (mgr.14388) 17979 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:47 smithi179 bash[23186]: cluster 2024-09-21T05:09:46.121499+0000 mgr.a (mgr.14388) 17979 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:47 smithi049 bash[23528]: cluster 2024-09-21T05:09:46.121499+0000 mgr.a (mgr.14388) 17979 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:49.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:49 smithi044 bash[22676]: cluster 2024-09-21T05:09:48.122273+0000 mgr.a (mgr.14388) 17980 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:49 smithi179 bash[23186]: cluster 2024-09-21T05:09:48.122273+0000 mgr.a (mgr.14388) 17980 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:49 smithi049 bash[23528]: cluster 2024-09-21T05:09:48.122273+0000 mgr.a (mgr.14388) 17980 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:50.456 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:51.984 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:51 smithi179 bash[23186]: audit 2024-09-21T05:09:50.013158+0000 mgr.a (mgr.14388) 17981 : audit [DBG] from='client.386838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:51.984 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:51 smithi179 bash[23186]: cluster 2024-09-21T05:09:50.123401+0000 mgr.a (mgr.14388) 17982 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:51.984 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:51 smithi179 bash[23186]: audit 2024-09-21T05:09:51.694360+0000 mon.a (mon.0) 14271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:51.984 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:51 smithi179 bash[23186]: audit 2024-09-21T05:09:51.700375+0000 mon.a (mon.0) 14272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:51.984 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:51 smithi179 bash[23186]: audit 2024-09-21T05:09:51.706937+0000 mon.a (mon.0) 14273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:51 smithi044 bash[22676]: audit 2024-09-21T05:09:50.013158+0000 mgr.a (mgr.14388) 17981 : audit [DBG] from='client.386838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:51 smithi044 bash[22676]: cluster 2024-09-21T05:09:50.123401+0000 mgr.a (mgr.14388) 17982 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:51 smithi044 bash[22676]: audit 2024-09-21T05:09:51.694360+0000 mon.a (mon.0) 14271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:51 smithi044 bash[22676]: audit 2024-09-21T05:09:51.700375+0000 mon.a (mon.0) 14272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:51.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:51 smithi044 bash[22676]: audit 2024-09-21T05:09:51.706937+0000 mon.a (mon.0) 14273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:51 smithi049 bash[23528]: audit 2024-09-21T05:09:50.013158+0000 mgr.a (mgr.14388) 17981 : audit [DBG] from='client.386838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:51 smithi049 bash[23528]: cluster 2024-09-21T05:09:50.123401+0000 mgr.a (mgr.14388) 17982 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:09:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:51 smithi049 bash[23528]: audit 2024-09-21T05:09:51.694360+0000 mon.a (mon.0) 14271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:51 smithi049 bash[23528]: audit 2024-09-21T05:09:51.700375+0000 mon.a (mon.0) 14272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:51 smithi049 bash[23528]: audit 2024-09-21T05:09:51.706937+0000 mon.a (mon.0) 14273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:52 smithi049 bash[23528]: audit 2024-09-21T05:09:51.776877+0000 mon.a (mon.0) 14274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:52 smithi049 bash[23528]: audit 2024-09-21T05:09:51.784360+0000 mon.a (mon.0) 14275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:52 smithi049 bash[23528]: audit 2024-09-21T05:09:51.794464+0000 mon.a (mon.0) 14276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:52 smithi179 bash[23186]: audit 2024-09-21T05:09:51.776877+0000 mon.a (mon.0) 14274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:52 smithi179 bash[23186]: audit 2024-09-21T05:09:51.784360+0000 mon.a (mon.0) 14275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.064 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:52 smithi179 bash[23186]: audit 2024-09-21T05:09:51.794464+0000 mon.a (mon.0) 14276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:52 smithi044 bash[22676]: audit 2024-09-21T05:09:51.776877+0000 mon.a (mon.0) 14274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:52 smithi044 bash[22676]: audit 2024-09-21T05:09:51.784360+0000 mon.a (mon.0) 14275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:53.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:52 smithi044 bash[22676]: audit 2024-09-21T05:09:51.794464+0000 mon.a (mon.0) 14276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:09:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:53 smithi049 bash[23528]: cluster 2024-09-21T05:09:52.124242+0000 mgr.a (mgr.14388) 17983 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:09:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:53 smithi044 bash[22676]: cluster 2024-09-21T05:09:52.124242+0000 mgr.a (mgr.14388) 17983 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:09:54.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:53 smithi179 bash[23186]: cluster 2024-09-21T05:09:52.124242+0000 mgr.a (mgr.14388) 17983 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:09:55.457 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:09:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:09:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:09:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:55 smithi179 bash[23186]: cluster 2024-09-21T05:09:54.125001+0000 mgr.a (mgr.14388) 17984 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:09:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:55 smithi049 bash[23528]: cluster 2024-09-21T05:09:54.125001+0000 mgr.a (mgr.14388) 17984 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:09:56.235 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:09:56.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:09:56.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:09:56.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:09:56.236 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:09:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:55 smithi044 bash[22676]: cluster 2024-09-21T05:09:54.125001+0000 mgr.a (mgr.14388) 17984 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:09:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:56 smithi049 bash[23528]: audit 2024-09-21T05:09:55.793174+0000 mgr.a (mgr.14388) 17985 : audit [DBG] from='client.386916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:56 smithi044 bash[22676]: audit 2024-09-21T05:09:55.793174+0000 mgr.a (mgr.14388) 17985 : audit [DBG] from='client.386916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:56 smithi179 bash[23186]: audit 2024-09-21T05:09:55.793174+0000 mgr.a (mgr.14388) 17985 : audit [DBG] from='client.386916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:09:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:57 smithi049 bash[23528]: cluster 2024-09-21T05:09:56.135343+0000 mgr.a (mgr.14388) 17986 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:57 smithi044 bash[22676]: cluster 2024-09-21T05:09:56.135343+0000 mgr.a (mgr.14388) 17986 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:09:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:57 smithi179 bash[23186]: cluster 2024-09-21T05:09:56.135343+0000 mgr.a (mgr.14388) 17986 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:09:59 smithi049 bash[23528]: cluster 2024-09-21T05:09:58.136119+0000 mgr.a (mgr.14388) 17987 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:10:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:09:59 smithi044 bash[22676]: cluster 2024-09-21T05:09:58.136119+0000 mgr.a (mgr.14388) 17987 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:10:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:09:59 smithi179 bash[23186]: cluster 2024-09-21T05:09:58.136119+0000 mgr.a (mgr.14388) 17987 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:10:00.883 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:00 smithi049 bash[23528]: cluster 2024-09-21T05:10:00.000152+0000 mon.a (mon.0) 14277 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:10:01.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:00 smithi044 bash[22676]: cluster 2024-09-21T05:10:00.000152+0000 mon.a (mon.0) 14277 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:10:01.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:01.237 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:01.238 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:00 smithi179 bash[23186]: cluster 2024-09-21T05:10:00.000152+0000 mon.a (mon.0) 14277 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:10:01.906 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:01 smithi049 bash[23528]: cluster 2024-09-21T05:10:00.138072+0000 mgr.a (mgr.14388) 17988 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:02.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:02.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:02.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:02.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:02.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:02.105 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:01 smithi044 bash[22676]: cluster 2024-09-21T05:10:00.138072+0000 mgr.a (mgr.14388) 17988 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:01 smithi179 bash[23186]: cluster 2024-09-21T05:10:00.138072+0000 mgr.a (mgr.14388) 17988 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:02 smithi049 bash[23528]: audit 2024-09-21T05:10:01.572369+0000 mgr.a (mgr.14388) 17989 : audit [DBG] from='client.386991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:02 smithi049 bash[23528]: audit 2024-09-21T05:10:01.890544+0000 mon.a (mon.0) 14278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:02 smithi049 bash[23528]: audit 2024-09-21T05:10:01.896032+0000 mon.a (mon.0) 14279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:02 smithi049 bash[23528]: audit 2024-09-21T05:10:01.902362+0000 mon.a (mon.0) 14280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.134 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:02 smithi044 bash[22676]: audit 2024-09-21T05:10:01.572369+0000 mgr.a (mgr.14388) 17989 : audit [DBG] from='client.386991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:03.134 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:02 smithi044 bash[22676]: audit 2024-09-21T05:10:01.890544+0000 mon.a (mon.0) 14278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.134 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:02 smithi044 bash[22676]: audit 2024-09-21T05:10:01.896032+0000 mon.a (mon.0) 14279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.134 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:02 smithi044 bash[22676]: audit 2024-09-21T05:10:01.902362+0000 mon.a (mon.0) 14280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:02 smithi179 bash[23186]: audit 2024-09-21T05:10:01.572369+0000 mgr.a (mgr.14388) 17989 : audit [DBG] from='client.386991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:02 smithi179 bash[23186]: audit 2024-09-21T05:10:01.890544+0000 mon.a (mon.0) 14278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:02 smithi179 bash[23186]: audit 2024-09-21T05:10:01.896032+0000 mon.a (mon.0) 14279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:03.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:02 smithi179 bash[23186]: audit 2024-09-21T05:10:01.902362+0000 mon.a (mon.0) 14280 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:04.142 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:03 smithi044 bash[22676]: cluster 2024-09-21T05:10:02.138554+0000 mgr.a (mgr.14388) 17990 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:03 smithi179 bash[23186]: cluster 2024-09-21T05:10:02.138554+0000 mgr.a (mgr.14388) 17990 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:03 smithi049 bash[23528]: cluster 2024-09-21T05:10:02.138554+0000 mgr.a (mgr.14388) 17990 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:06.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:05 smithi044 bash[22676]: cluster 2024-09-21T05:10:04.139005+0000 mgr.a (mgr.14388) 17991 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:05 smithi179 bash[23186]: cluster 2024-09-21T05:10:04.139005+0000 mgr.a (mgr.14388) 17991 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:06.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:05 smithi049 bash[23528]: cluster 2024-09-21T05:10:04.139005+0000 mgr.a (mgr.14388) 17991 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:07.026 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:07.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:07.027 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:06 smithi044 bash[22676]: cluster 2024-09-21T05:10:06.141180+0000 mgr.a (mgr.14388) 17992 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:06 smithi179 bash[23186]: cluster 2024-09-21T05:10:06.141180+0000 mgr.a (mgr.14388) 17992 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:07.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:06 smithi049 bash[23528]: cluster 2024-09-21T05:10:06.141180+0000 mgr.a (mgr.14388) 17992 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:07.777 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:07.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:07.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:07.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:07.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:07 smithi044 bash[22676]: audit 2024-09-21T05:10:07.356659+0000 mgr.a (mgr.14388) 17993 : audit [DBG] from='client.387069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:07 smithi179 bash[23186]: audit 2024-09-21T05:10:07.356659+0000 mgr.a (mgr.14388) 17993 : audit [DBG] from='client.387069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:07 smithi049 bash[23528]: audit 2024-09-21T05:10:07.356659+0000 mgr.a (mgr.14388) 17993 : audit [DBG] from='client.387069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:08 smithi044 bash[22676]: cluster 2024-09-21T05:10:08.142010+0000 mgr.a (mgr.14388) 17994 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:08 smithi179 bash[23186]: cluster 2024-09-21T05:10:08.142010+0000 mgr.a (mgr.14388) 17994 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:09.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:08 smithi049 bash[23528]: cluster 2024-09-21T05:10:08.142010+0000 mgr.a (mgr.14388) 17994 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:11.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:11 smithi044 bash[22676]: cluster 2024-09-21T05:10:10.144162+0000 mgr.a (mgr.14388) 17995 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:11 smithi179 bash[23186]: cluster 2024-09-21T05:10:10.144162+0000 mgr.a (mgr.14388) 17995 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:11 smithi049 bash[23528]: cluster 2024-09-21T05:10:10.144162+0000 mgr.a (mgr.14388) 17995 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:12.779 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:12.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:12.780 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:12 smithi044 bash[22676]: audit 2024-09-21T05:10:11.923844+0000 mon.a (mon.0) 14281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:12 smithi044 bash[22676]: audit 2024-09-21T05:10:11.931688+0000 mon.a (mon.0) 14282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:12 smithi044 bash[22676]: audit 2024-09-21T05:10:11.940645+0000 mon.a (mon.0) 14283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:12 smithi044 bash[22676]: audit 2024-09-21T05:10:11.999527+0000 mon.a (mon.0) 14284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:12 smithi044 bash[22676]: audit 2024-09-21T05:10:12.006804+0000 mon.a (mon.0) 14285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:12 smithi044 bash[22676]: audit 2024-09-21T05:10:12.016127+0000 mon.a (mon.0) 14286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:12 smithi044 bash[22676]: cluster 2024-09-21T05:10:12.144910+0000 mgr.a (mgr.14388) 17996 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:12 smithi179 bash[23186]: audit 2024-09-21T05:10:11.923844+0000 mon.a (mon.0) 14281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:12 smithi179 bash[23186]: audit 2024-09-21T05:10:11.931688+0000 mon.a (mon.0) 14282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:12 smithi179 bash[23186]: audit 2024-09-21T05:10:11.940645+0000 mon.a (mon.0) 14283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:12 smithi179 bash[23186]: audit 2024-09-21T05:10:11.999527+0000 mon.a (mon.0) 14284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:12 smithi179 bash[23186]: audit 2024-09-21T05:10:12.006804+0000 mon.a (mon.0) 14285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:12 smithi179 bash[23186]: audit 2024-09-21T05:10:12.016127+0000 mon.a (mon.0) 14286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:12 smithi179 bash[23186]: cluster 2024-09-21T05:10:12.144910+0000 mgr.a (mgr.14388) 17996 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:12 smithi049 bash[23528]: audit 2024-09-21T05:10:11.923844+0000 mon.a (mon.0) 14281 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:12 smithi049 bash[23528]: audit 2024-09-21T05:10:11.931688+0000 mon.a (mon.0) 14282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:12 smithi049 bash[23528]: audit 2024-09-21T05:10:11.940645+0000 mon.a (mon.0) 14283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:12 smithi049 bash[23528]: audit 2024-09-21T05:10:11.999527+0000 mon.a (mon.0) 14284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:12 smithi049 bash[23528]: audit 2024-09-21T05:10:12.006804+0000 mon.a (mon.0) 14285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:12 smithi049 bash[23528]: audit 2024-09-21T05:10:12.016127+0000 mon.a (mon.0) 14286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:12 smithi049 bash[23528]: cluster 2024-09-21T05:10:12.144910+0000 mgr.a (mgr.14388) 17996 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:13.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:14 smithi049 bash[23528]: audit 2024-09-21T05:10:13.118481+0000 mgr.a (mgr.14388) 17997 : audit [DBG] from='client.387144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:14.394 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:14 smithi179 bash[23186]: audit 2024-09-21T05:10:13.118481+0000 mgr.a (mgr.14388) 17997 : audit [DBG] from='client.387144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:14 smithi044 bash[22676]: audit 2024-09-21T05:10:13.118481+0000 mgr.a (mgr.14388) 17997 : audit [DBG] from='client.387144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:15 smithi049 bash[23528]: cluster 2024-09-21T05:10:14.145834+0000 mgr.a (mgr.14388) 17998 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:15.345 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:15 smithi179 bash[23186]: cluster 2024-09-21T05:10:14.145834+0000 mgr.a (mgr.14388) 17998 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:15 smithi044 bash[22676]: cluster 2024-09-21T05:10:14.145834+0000 mgr.a (mgr.14388) 17998 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:17.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:17 smithi044 bash[22676]: cluster 2024-09-21T05:10:16.148052+0000 mgr.a (mgr.14388) 17999 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:17 smithi179 bash[23186]: cluster 2024-09-21T05:10:16.148052+0000 mgr.a (mgr.14388) 17999 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:17 smithi049 bash[23528]: cluster 2024-09-21T05:10:16.148052+0000 mgr.a (mgr.14388) 17999 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:18.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:18.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:18.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:19.353 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:19 smithi044 bash[22676]: cluster 2024-09-21T05:10:18.148786+0000 mgr.a (mgr.14388) 18000 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:19 smithi179 bash[23186]: cluster 2024-09-21T05:10:18.148786+0000 mgr.a (mgr.14388) 18000 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:19.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:19 smithi049 bash[23528]: cluster 2024-09-21T05:10:18.148786+0000 mgr.a (mgr.14388) 18000 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:20 smithi044 bash[22676]: audit 2024-09-21T05:10:18.910604+0000 mgr.a (mgr.14388) 18001 : audit [DBG] from='client.387222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:20 smithi179 bash[23186]: audit 2024-09-21T05:10:18.910604+0000 mgr.a (mgr.14388) 18001 : audit [DBG] from='client.387222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:20 smithi049 bash[23528]: audit 2024-09-21T05:10:18.910604+0000 mgr.a (mgr.14388) 18001 : audit [DBG] from='client.387222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:21.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:21 smithi044 bash[22676]: cluster 2024-09-21T05:10:20.151060+0000 mgr.a (mgr.14388) 18002 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:21.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:21 smithi179 bash[23186]: cluster 2024-09-21T05:10:20.151060+0000 mgr.a (mgr.14388) 18002 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:21.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:21 smithi049 bash[23528]: cluster 2024-09-21T05:10:20.151060+0000 mgr.a (mgr.14388) 18002 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:23.469 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:23 smithi044 bash[22676]: audit 2024-09-21T05:10:22.093150+0000 mon.a (mon.0) 14287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.470 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:23 smithi044 bash[22676]: audit 2024-09-21T05:10:22.102152+0000 mon.a (mon.0) 14288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.470 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:23 smithi044 bash[22676]: audit 2024-09-21T05:10:22.112512+0000 mon.a (mon.0) 14289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.470 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:23 smithi044 bash[22676]: cluster 2024-09-21T05:10:22.151825+0000 mgr.a (mgr.14388) 18003 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:23 smithi179 bash[23186]: audit 2024-09-21T05:10:22.093150+0000 mon.a (mon.0) 14287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:23 smithi179 bash[23186]: audit 2024-09-21T05:10:22.102152+0000 mon.a (mon.0) 14288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:23 smithi179 bash[23186]: audit 2024-09-21T05:10:22.112512+0000 mon.a (mon.0) 14289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:23 smithi179 bash[23186]: cluster 2024-09-21T05:10:22.151825+0000 mgr.a (mgr.14388) 18003 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:23 smithi049 bash[23528]: audit 2024-09-21T05:10:22.093150+0000 mon.a (mon.0) 14287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:23 smithi049 bash[23528]: audit 2024-09-21T05:10:22.102152+0000 mon.a (mon.0) 14288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:23 smithi049 bash[23528]: audit 2024-09-21T05:10:22.112512+0000 mon.a (mon.0) 14289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:23 smithi049 bash[23528]: cluster 2024-09-21T05:10:22.151825+0000 mgr.a (mgr.14388) 18003 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:24.354 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:24.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:24.355 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:25.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:25.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:25 smithi044 bash[22676]: cluster 2024-09-21T05:10:24.152780+0000 mgr.a (mgr.14388) 18004 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:25.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:25 smithi044 bash[22676]: audit 2024-09-21T05:10:24.679941+0000 mgr.a (mgr.14388) 18005 : audit [DBG] from='client.387300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:25.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:25 smithi179 bash[23186]: cluster 2024-09-21T05:10:24.152780+0000 mgr.a (mgr.14388) 18004 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:25.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:25 smithi179 bash[23186]: audit 2024-09-21T05:10:24.679941+0000 mgr.a (mgr.14388) 18005 : audit [DBG] from='client.387300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:25 smithi049 bash[23528]: cluster 2024-09-21T05:10:24.152780+0000 mgr.a (mgr.14388) 18004 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:25 smithi049 bash[23528]: audit 2024-09-21T05:10:24.679941+0000 mgr.a (mgr.14388) 18005 : audit [DBG] from='client.387300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:27 smithi044 bash[22676]: cluster 2024-09-21T05:10:26.155336+0000 mgr.a (mgr.14388) 18006 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:10:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:27 smithi179 bash[23186]: cluster 2024-09-21T05:10:26.155336+0000 mgr.a (mgr.14388) 18006 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:10:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:27 smithi049 bash[23528]: cluster 2024-09-21T05:10:26.155336+0000 mgr.a (mgr.14388) 18006 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:10:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:29 smithi044 bash[22676]: cluster 2024-09-21T05:10:28.156195+0000 mgr.a (mgr.14388) 18007 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:10:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:29 smithi179 bash[23186]: cluster 2024-09-21T05:10:28.156195+0000 mgr.a (mgr.14388) 18007 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:10:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:29 smithi049 bash[23528]: cluster 2024-09-21T05:10:28.156195+0000 mgr.a (mgr.14388) 18007 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:10:30.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:30.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:30.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:30.878 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:30.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:30.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:30.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:30.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:31 smithi044 bash[22676]: cluster 2024-09-21T05:10:30.158361+0000 mgr.a (mgr.14388) 18008 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:31.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:31 smithi044 bash[22676]: audit 2024-09-21T05:10:30.452831+0000 mgr.a (mgr.14388) 18009 : audit [DBG] from='client.387378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:31 smithi179 bash[23186]: cluster 2024-09-21T05:10:30.158361+0000 mgr.a (mgr.14388) 18008 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:31.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:31 smithi179 bash[23186]: audit 2024-09-21T05:10:30.452831+0000 mgr.a (mgr.14388) 18009 : audit [DBG] from='client.387378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:31 smithi049 bash[23528]: cluster 2024-09-21T05:10:30.158361+0000 mgr.a (mgr.14388) 18008 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:31 smithi049 bash[23528]: audit 2024-09-21T05:10:30.452831+0000 mgr.a (mgr.14388) 18009 : audit [DBG] from='client.387378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:33 smithi044 bash[22676]: audit 2024-09-21T05:10:32.140479+0000 mon.a (mon.0) 14290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:33 smithi044 bash[22676]: audit 2024-09-21T05:10:32.146681+0000 mon.a (mon.0) 14291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:33 smithi044 bash[22676]: audit 2024-09-21T05:10:32.152914+0000 mon.a (mon.0) 14292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:33 smithi044 bash[22676]: cluster 2024-09-21T05:10:32.158924+0000 mgr.a (mgr.14388) 18010 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:10:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:33 smithi044 bash[22676]: audit 2024-09-21T05:10:32.208689+0000 mon.a (mon.0) 14293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:33 smithi044 bash[22676]: audit 2024-09-21T05:10:32.213084+0000 mon.a (mon.0) 14294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:33 smithi044 bash[22676]: audit 2024-09-21T05:10:32.218346+0000 mon.a (mon.0) 14295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:33 smithi179 bash[23186]: audit 2024-09-21T05:10:32.140479+0000 mon.a (mon.0) 14290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:33 smithi179 bash[23186]: audit 2024-09-21T05:10:32.146681+0000 mon.a (mon.0) 14291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:33 smithi179 bash[23186]: audit 2024-09-21T05:10:32.152914+0000 mon.a (mon.0) 14292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:33 smithi179 bash[23186]: cluster 2024-09-21T05:10:32.158924+0000 mgr.a (mgr.14388) 18010 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:10:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:33 smithi179 bash[23186]: audit 2024-09-21T05:10:32.208689+0000 mon.a (mon.0) 14293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:33 smithi179 bash[23186]: audit 2024-09-21T05:10:32.213084+0000 mon.a (mon.0) 14294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:33 smithi179 bash[23186]: audit 2024-09-21T05:10:32.218346+0000 mon.a (mon.0) 14295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:33 smithi049 bash[23528]: audit 2024-09-21T05:10:32.140479+0000 mon.a (mon.0) 14290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:33 smithi049 bash[23528]: audit 2024-09-21T05:10:32.146681+0000 mon.a (mon.0) 14291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:33 smithi049 bash[23528]: audit 2024-09-21T05:10:32.152914+0000 mon.a (mon.0) 14292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:33 smithi049 bash[23528]: cluster 2024-09-21T05:10:32.158924+0000 mgr.a (mgr.14388) 18010 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:10:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:33 smithi049 bash[23528]: audit 2024-09-21T05:10:32.208689+0000 mon.a (mon.0) 14293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:33 smithi049 bash[23528]: audit 2024-09-21T05:10:32.213084+0000 mon.a (mon.0) 14294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:33 smithi049 bash[23528]: audit 2024-09-21T05:10:32.218346+0000 mon.a (mon.0) 14295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:35 smithi044 bash[22676]: cluster 2024-09-21T05:10:34.159678+0000 mgr.a (mgr.14388) 18011 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:10:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:35 smithi179 bash[23186]: cluster 2024-09-21T05:10:34.159678+0000 mgr.a (mgr.14388) 18011 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:10:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:35 smithi049 bash[23528]: cluster 2024-09-21T05:10:34.159678+0000 mgr.a (mgr.14388) 18011 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:10:35.879 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:35.880 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:35.880 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:36.673 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:36.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:36.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:36.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:36.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:37 smithi044 bash[22676]: cluster 2024-09-21T05:10:36.161944+0000 mgr.a (mgr.14388) 18012 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:37.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:37 smithi044 bash[22676]: audit 2024-09-21T05:10:36.215874+0000 mgr.a (mgr.14388) 18013 : audit [DBG] from='client.387456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:37 smithi179 bash[23186]: cluster 2024-09-21T05:10:36.161944+0000 mgr.a (mgr.14388) 18012 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:37.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:37 smithi179 bash[23186]: audit 2024-09-21T05:10:36.215874+0000 mgr.a (mgr.14388) 18013 : audit [DBG] from='client.387456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:37 smithi049 bash[23528]: cluster 2024-09-21T05:10:36.161944+0000 mgr.a (mgr.14388) 18012 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:37 smithi049 bash[23528]: audit 2024-09-21T05:10:36.215874+0000 mgr.a (mgr.14388) 18013 : audit [DBG] from='client.387456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:38 smithi044 bash[22676]: audit 2024-09-21T05:10:38.119236+0000 mon.a (mon.0) 14296 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:10:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:38 smithi044 bash[22676]: audit 2024-09-21T05:10:38.126207+0000 mon.a (mon.0) 14297 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:10:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:38 smithi044 bash[22676]: audit 2024-09-21T05:10:38.127973+0000 mon.a (mon.0) 14298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:10:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:38 smithi044 bash[22676]: audit 2024-09-21T05:10:38.139366+0000 mon.a (mon.0) 14299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:38.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:38 smithi044 bash[22676]: audit 2024-09-21T05:10:38.145642+0000 mon.a (mon.0) 14300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:10:38.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:38 smithi179 bash[23186]: audit 2024-09-21T05:10:38.119236+0000 mon.a (mon.0) 14296 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:10:38.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:38 smithi179 bash[23186]: audit 2024-09-21T05:10:38.126207+0000 mon.a (mon.0) 14297 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:10:38.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:38 smithi179 bash[23186]: audit 2024-09-21T05:10:38.127973+0000 mon.a (mon.0) 14298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:10:38.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:38 smithi179 bash[23186]: audit 2024-09-21T05:10:38.139366+0000 mon.a (mon.0) 14299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:38.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:38 smithi179 bash[23186]: audit 2024-09-21T05:10:38.145642+0000 mon.a (mon.0) 14300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:10:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:38 smithi049 bash[23528]: audit 2024-09-21T05:10:38.119236+0000 mon.a (mon.0) 14296 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:10:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:38 smithi049 bash[23528]: audit 2024-09-21T05:10:38.126207+0000 mon.a (mon.0) 14297 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:10:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:38 smithi049 bash[23528]: audit 2024-09-21T05:10:38.127973+0000 mon.a (mon.0) 14298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:10:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:38 smithi049 bash[23528]: audit 2024-09-21T05:10:38.139366+0000 mon.a (mon.0) 14299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:38 smithi049 bash[23528]: audit 2024-09-21T05:10:38.145642+0000 mon.a (mon.0) 14300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:10:39.227 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:10:38 smithi044 bash[22930]: debug 2024-09-21T05:10:38.939+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:10:39.227 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:10:38 smithi044 bash[22930]: debug 2024-09-21T05:10:38.943+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:10:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:39 smithi044 bash[22676]: audit 2024-09-21T05:10:38.148372+0000 mgr.a (mgr.14388) 18014 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:10:39.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:39 smithi044 bash[22676]: cluster 2024-09-21T05:10:38.171617+0000 mgr.a (mgr.14388) 18015 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:10:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:39 smithi179 bash[23186]: audit 2024-09-21T05:10:38.148372+0000 mgr.a (mgr.14388) 18014 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:10:39.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:39 smithi179 bash[23186]: cluster 2024-09-21T05:10:38.171617+0000 mgr.a (mgr.14388) 18015 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:10:39.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:39 smithi049 bash[23528]: audit 2024-09-21T05:10:38.148372+0000 mgr.a (mgr.14388) 18014 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:10:39.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:39 smithi049 bash[23528]: cluster 2024-09-21T05:10:38.171617+0000 mgr.a (mgr.14388) 18015 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:10:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:40 smithi044 bash[22676]: audit 2024-09-21T05:10:38.944857+0000 mgr.a (mgr.14388) 18016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:10:40.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:40 smithi044 bash[22676]: cephadm 2024-09-21T05:10:38.946388+0000 mgr.a (mgr.14388) 18017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:10:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:40 smithi179 bash[23186]: audit 2024-09-21T05:10:38.944857+0000 mgr.a (mgr.14388) 18016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:10:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:40 smithi179 bash[23186]: cephadm 2024-09-21T05:10:38.946388+0000 mgr.a (mgr.14388) 18017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:10:40.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:40 smithi049 bash[23528]: audit 2024-09-21T05:10:38.944857+0000 mgr.a (mgr.14388) 18016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:10:40.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:40 smithi049 bash[23528]: cephadm 2024-09-21T05:10:38.946388+0000 mgr.a (mgr.14388) 18017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:10:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:41 smithi044 bash[22676]: cluster 2024-09-21T05:10:40.174100+0000 mgr.a (mgr.14388) 18018 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:41 smithi179 bash[23186]: cluster 2024-09-21T05:10:40.174100+0000 mgr.a (mgr.14388) 18018 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:41 smithi049 bash[23528]: cluster 2024-09-21T05:10:40.174100+0000 mgr.a (mgr.14388) 18018 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:41.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:41.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:41.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:42.457 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:43.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:43 smithi049 bash[23528]: audit 2024-09-21T05:10:42.003573+0000 mgr.a (mgr.14388) 18019 : audit [DBG] from='client.387624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:43.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:43 smithi049 bash[23528]: cluster 2024-09-21T05:10:42.174678+0000 mgr.a (mgr.14388) 18020 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:43.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:43 smithi049 bash[23528]: audit 2024-09-21T05:10:42.295799+0000 mon.a (mon.0) 14301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:43 smithi049 bash[23528]: audit 2024-09-21T05:10:42.301840+0000 mon.a (mon.0) 14302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:43 smithi049 bash[23528]: audit 2024-09-21T05:10:42.307496+0000 mon.a (mon.0) 14303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:43 smithi044 bash[22676]: audit 2024-09-21T05:10:42.003573+0000 mgr.a (mgr.14388) 18019 : audit [DBG] from='client.387624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:43 smithi044 bash[22676]: cluster 2024-09-21T05:10:42.174678+0000 mgr.a (mgr.14388) 18020 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:43 smithi044 bash[22676]: audit 2024-09-21T05:10:42.295799+0000 mon.a (mon.0) 14301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:43 smithi044 bash[22676]: audit 2024-09-21T05:10:42.301840+0000 mon.a (mon.0) 14302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:43 smithi044 bash[22676]: audit 2024-09-21T05:10:42.307496+0000 mon.a (mon.0) 14303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:43 smithi179 bash[23186]: audit 2024-09-21T05:10:42.003573+0000 mgr.a (mgr.14388) 18019 : audit [DBG] from='client.387624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:43 smithi179 bash[23186]: cluster 2024-09-21T05:10:42.174678+0000 mgr.a (mgr.14388) 18020 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:43 smithi179 bash[23186]: audit 2024-09-21T05:10:42.295799+0000 mon.a (mon.0) 14301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:43 smithi179 bash[23186]: audit 2024-09-21T05:10:42.301840+0000 mon.a (mon.0) 14302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:43 smithi179 bash[23186]: audit 2024-09-21T05:10:42.307496+0000 mon.a (mon.0) 14303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:45 smithi044 bash[22676]: cluster 2024-09-21T05:10:44.175602+0000 mgr.a (mgr.14388) 18021 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:45 smithi049 bash[23528]: cluster 2024-09-21T05:10:44.175602+0000 mgr.a (mgr.14388) 18021 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:45 smithi179 bash[23186]: cluster 2024-09-21T05:10:44.175602+0000 mgr.a (mgr.14388) 18021 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:47.459 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:47.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:47.460 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:47 smithi044 bash[22676]: cluster 2024-09-21T05:10:46.177890+0000 mgr.a (mgr.14388) 18022 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:47 smithi179 bash[23186]: cluster 2024-09-21T05:10:46.177890+0000 mgr.a (mgr.14388) 18022 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:47.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:47 smithi049 bash[23528]: cluster 2024-09-21T05:10:46.177890+0000 mgr.a (mgr.14388) 18022 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:48.221 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:48 smithi044 bash[22676]: audit 2024-09-21T05:10:47.788034+0000 mgr.a (mgr.14388) 18023 : audit [DBG] from='client.387699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:48 smithi179 bash[23186]: audit 2024-09-21T05:10:47.788034+0000 mgr.a (mgr.14388) 18023 : audit [DBG] from='client.387699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:48 smithi049 bash[23528]: audit 2024-09-21T05:10:47.788034+0000 mgr.a (mgr.14388) 18023 : audit [DBG] from='client.387699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:49 smithi044 bash[22676]: cluster 2024-09-21T05:10:48.178502+0000 mgr.a (mgr.14388) 18024 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:49 smithi179 bash[23186]: cluster 2024-09-21T05:10:48.178502+0000 mgr.a (mgr.14388) 18024 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:49 smithi049 bash[23528]: cluster 2024-09-21T05:10:48.178502+0000 mgr.a (mgr.14388) 18024 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:51 smithi044 bash[22676]: cluster 2024-09-21T05:10:50.180604+0000 mgr.a (mgr.14388) 18025 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:51 smithi179 bash[23186]: cluster 2024-09-21T05:10:50.180604+0000 mgr.a (mgr.14388) 18025 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:51 smithi049 bash[23528]: cluster 2024-09-21T05:10:50.180604+0000 mgr.a (mgr.14388) 18025 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:10:53.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:53.223 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:53.224 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:53.654 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:53 smithi179 bash[23186]: cluster 2024-09-21T05:10:52.181402+0000 mgr.a (mgr.14388) 18026 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:53.654 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:53 smithi179 bash[23186]: audit 2024-09-21T05:10:52.348830+0000 mon.a (mon.0) 14304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.655 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:53 smithi179 bash[23186]: audit 2024-09-21T05:10:52.355674+0000 mon.a (mon.0) 14305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.655 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:53 smithi179 bash[23186]: audit 2024-09-21T05:10:52.362649+0000 mon.a (mon.0) 14306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.655 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:53 smithi179 bash[23186]: audit 2024-09-21T05:10:52.417816+0000 mon.a (mon.0) 14307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.655 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:53 smithi179 bash[23186]: audit 2024-09-21T05:10:52.424828+0000 mon.a (mon.0) 14308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.655 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:53 smithi179 bash[23186]: audit 2024-09-21T05:10:52.434397+0000 mon.a (mon.0) 14309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:53 smithi044 bash[22676]: cluster 2024-09-21T05:10:52.181402+0000 mgr.a (mgr.14388) 18026 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:53 smithi044 bash[22676]: audit 2024-09-21T05:10:52.348830+0000 mon.a (mon.0) 14304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:53 smithi044 bash[22676]: audit 2024-09-21T05:10:52.355674+0000 mon.a (mon.0) 14305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:53 smithi044 bash[22676]: audit 2024-09-21T05:10:52.362649+0000 mon.a (mon.0) 14306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:53 smithi044 bash[22676]: audit 2024-09-21T05:10:52.417816+0000 mon.a (mon.0) 14307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:53 smithi044 bash[22676]: audit 2024-09-21T05:10:52.424828+0000 mon.a (mon.0) 14308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:53 smithi044 bash[22676]: audit 2024-09-21T05:10:52.434397+0000 mon.a (mon.0) 14309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:53 smithi049 bash[23528]: cluster 2024-09-21T05:10:52.181402+0000 mgr.a (mgr.14388) 18026 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:53.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:53 smithi049 bash[23528]: audit 2024-09-21T05:10:52.348830+0000 mon.a (mon.0) 14304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:53 smithi049 bash[23528]: audit 2024-09-21T05:10:52.355674+0000 mon.a (mon.0) 14305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:53 smithi049 bash[23528]: audit 2024-09-21T05:10:52.362649+0000 mon.a (mon.0) 14306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:53 smithi049 bash[23528]: audit 2024-09-21T05:10:52.417816+0000 mon.a (mon.0) 14307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:53 smithi049 bash[23528]: audit 2024-09-21T05:10:52.424828+0000 mon.a (mon.0) 14308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:53.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:53 smithi049 bash[23528]: audit 2024-09-21T05:10:52.434397+0000 mon.a (mon.0) 14309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:10:54.001 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:54.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:54.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:54.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:54.002 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:54.638 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:54 smithi179 bash[23186]: audit 2024-09-21T05:10:53.563970+0000 mgr.a (mgr.14388) 18027 : audit [DBG] from='client.387777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:54 smithi044 bash[22676]: audit 2024-09-21T05:10:53.563970+0000 mgr.a (mgr.14388) 18027 : audit [DBG] from='client.387777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:54 smithi049 bash[23528]: audit 2024-09-21T05:10:53.563970+0000 mgr.a (mgr.14388) 18027 : audit [DBG] from='client.387777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:55.617 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:55 smithi179 bash[23186]: cluster 2024-09-21T05:10:54.182333+0000 mgr.a (mgr.14388) 18028 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:55 smithi044 bash[22676]: cluster 2024-09-21T05:10:54.182333+0000 mgr.a (mgr.14388) 18028 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:55 smithi049 bash[23528]: cluster 2024-09-21T05:10:54.182333+0000 mgr.a (mgr.14388) 18028 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:57 smithi179 bash[23186]: cluster 2024-09-21T05:10:56.184578+0000 mgr.a (mgr.14388) 18029 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:57 smithi044 bash[22676]: cluster 2024-09-21T05:10:56.184578+0000 mgr.a (mgr.14388) 18029 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:57 smithi049 bash[23528]: cluster 2024-09-21T05:10:56.184578+0000 mgr.a (mgr.14388) 18029 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:10:59.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:10:59.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:10:59.004 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:10:59.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:10:59 smithi044 bash[22676]: cluster 2024-09-21T05:10:58.185378+0000 mgr.a (mgr.14388) 18030 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:10:59 smithi179 bash[23186]: cluster 2024-09-21T05:10:58.185378+0000 mgr.a (mgr.14388) 18030 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:10:59.788 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:10:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:10:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:10:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:10:59.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:10:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:10:59 smithi049 bash[23528]: cluster 2024-09-21T05:10:58.185378+0000 mgr.a (mgr.14388) 18030 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:00 smithi044 bash[22676]: audit 2024-09-21T05:10:59.337950+0000 mgr.a (mgr.14388) 18031 : audit [DBG] from='client.387852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:00 smithi179 bash[23186]: audit 2024-09-21T05:10:59.337950+0000 mgr.a (mgr.14388) 18031 : audit [DBG] from='client.387852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:00 smithi049 bash[23528]: audit 2024-09-21T05:10:59.337950+0000 mgr.a (mgr.14388) 18031 : audit [DBG] from='client.387852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:01.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:01 smithi044 bash[22676]: cluster 2024-09-21T05:11:00.187673+0000 mgr.a (mgr.14388) 18032 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:01.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:01 smithi179 bash[23186]: cluster 2024-09-21T05:11:00.187673+0000 mgr.a (mgr.14388) 18032 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:01.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:01 smithi049 bash[23528]: cluster 2024-09-21T05:11:00.187673+0000 mgr.a (mgr.14388) 18032 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:03 smithi044 bash[22676]: cluster 2024-09-21T05:11:02.188452+0000 mgr.a (mgr.14388) 18033 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:03 smithi044 bash[22676]: audit 2024-09-21T05:11:02.459538+0000 mon.a (mon.0) 14310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:03 smithi044 bash[22676]: audit 2024-09-21T05:11:02.468386+0000 mon.a (mon.0) 14311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:03 smithi044 bash[22676]: audit 2024-09-21T05:11:02.478936+0000 mon.a (mon.0) 14312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:03 smithi179 bash[23186]: cluster 2024-09-21T05:11:02.188452+0000 mgr.a (mgr.14388) 18033 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:03 smithi179 bash[23186]: audit 2024-09-21T05:11:02.459538+0000 mon.a (mon.0) 14310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:03 smithi179 bash[23186]: audit 2024-09-21T05:11:02.468386+0000 mon.a (mon.0) 14311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:03 smithi179 bash[23186]: audit 2024-09-21T05:11:02.478936+0000 mon.a (mon.0) 14312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:03 smithi049 bash[23528]: cluster 2024-09-21T05:11:02.188452+0000 mgr.a (mgr.14388) 18033 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:03 smithi049 bash[23528]: audit 2024-09-21T05:11:02.459538+0000 mon.a (mon.0) 14310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:03 smithi049 bash[23528]: audit 2024-09-21T05:11:02.468386+0000 mon.a (mon.0) 14311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:03.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:03 smithi049 bash[23528]: audit 2024-09-21T05:11:02.478936+0000 mon.a (mon.0) 14312 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:04.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:04.790 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:04.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:05.558 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:05.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:05.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:05.558 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:05 smithi044 bash[22676]: cluster 2024-09-21T05:11:04.189392+0000 mgr.a (mgr.14388) 18034 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:05 smithi179 bash[23186]: cluster 2024-09-21T05:11:04.189392+0000 mgr.a (mgr.14388) 18034 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:05 smithi049 bash[23528]: cluster 2024-09-21T05:11:04.189392+0000 mgr.a (mgr.14388) 18034 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:06 smithi044 bash[22676]: audit 2024-09-21T05:11:05.122149+0000 mgr.a (mgr.14388) 18035 : audit [DBG] from='client.387930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:06 smithi179 bash[23186]: audit 2024-09-21T05:11:05.122149+0000 mgr.a (mgr.14388) 18035 : audit [DBG] from='client.387930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:06 smithi049 bash[23528]: audit 2024-09-21T05:11:05.122149+0000 mgr.a (mgr.14388) 18035 : audit [DBG] from='client.387930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:07 smithi044 bash[22676]: cluster 2024-09-21T05:11:06.192387+0000 mgr.a (mgr.14388) 18036 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:07 smithi179 bash[23186]: cluster 2024-09-21T05:11:06.192387+0000 mgr.a (mgr.14388) 18036 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:07 smithi049 bash[23528]: cluster 2024-09-21T05:11:06.192387+0000 mgr.a (mgr.14388) 18036 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:09 smithi044 bash[22676]: cluster 2024-09-21T05:11:08.193184+0000 mgr.a (mgr.14388) 18037 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:11:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:09 smithi179 bash[23186]: cluster 2024-09-21T05:11:08.193184+0000 mgr.a (mgr.14388) 18037 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:11:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:09 smithi049 bash[23528]: cluster 2024-09-21T05:11:08.193184+0000 mgr.a (mgr.14388) 18037 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:11:10.560 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:10.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:10.560 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:11 smithi044 bash[22676]: cluster 2024-09-21T05:11:10.195131+0000 mgr.a (mgr.14388) 18038 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:11 smithi179 bash[23186]: cluster 2024-09-21T05:11:10.195131+0000 mgr.a (mgr.14388) 18038 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:11 smithi049 bash[23528]: cluster 2024-09-21T05:11:10.195131+0000 mgr.a (mgr.14388) 18038 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:12 smithi179 bash[23186]: audit 2024-09-21T05:11:10.896433+0000 mgr.a (mgr.14388) 18039 : audit [DBG] from='client.388008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:12 smithi049 bash[23528]: audit 2024-09-21T05:11:10.896433+0000 mgr.a (mgr.14388) 18039 : audit [DBG] from='client.388008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:12 smithi044 bash[22676]: audit 2024-09-21T05:11:10.896433+0000 mgr.a (mgr.14388) 18039 : audit [DBG] from='client.388008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:13 smithi044 bash[22676]: cluster 2024-09-21T05:11:12.196088+0000 mgr.a (mgr.14388) 18040 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:11:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:13 smithi044 bash[22676]: audit 2024-09-21T05:11:12.555846+0000 mon.a (mon.0) 14313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:13 smithi044 bash[22676]: audit 2024-09-21T05:11:12.564223+0000 mon.a (mon.0) 14314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:13 smithi044 bash[22676]: audit 2024-09-21T05:11:12.573997+0000 mon.a (mon.0) 14315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:13.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:13 smithi044 bash[22676]: audit 2024-09-21T05:11:12.653314+0000 mon.a (mon.0) 14316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:13.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:13 smithi044 bash[22676]: audit 2024-09-21T05:11:12.661955+0000 mon.a (mon.0) 14317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:13.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:13 smithi044 bash[22676]: audit 2024-09-21T05:11:12.683819+0000 mon.a (mon.0) 14318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:13 smithi179 bash[23186]: cluster 2024-09-21T05:11:12.196088+0000 mgr.a (mgr.14388) 18040 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:11:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:13 smithi179 bash[23186]: audit 2024-09-21T05:11:12.555846+0000 mon.a (mon.0) 14313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:13 smithi179 bash[23186]: audit 2024-09-21T05:11:12.564223+0000 mon.a (mon.0) 14314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:13 smithi179 bash[23186]: audit 2024-09-21T05:11:12.573997+0000 mon.a (mon.0) 14315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:13 smithi179 bash[23186]: audit 2024-09-21T05:11:12.653314+0000 mon.a (mon.0) 14316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:13 smithi179 bash[23186]: audit 2024-09-21T05:11:12.661955+0000 mon.a (mon.0) 14317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:13 smithi179 bash[23186]: audit 2024-09-21T05:11:12.683819+0000 mon.a (mon.0) 14318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:13 smithi049 bash[23528]: cluster 2024-09-21T05:11:12.196088+0000 mgr.a (mgr.14388) 18040 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:13 smithi049 bash[23528]: audit 2024-09-21T05:11:12.555846+0000 mon.a (mon.0) 14313 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:13 smithi049 bash[23528]: audit 2024-09-21T05:11:12.564223+0000 mon.a (mon.0) 14314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:13 smithi049 bash[23528]: audit 2024-09-21T05:11:12.573997+0000 mon.a (mon.0) 14315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:13 smithi049 bash[23528]: audit 2024-09-21T05:11:12.653314+0000 mon.a (mon.0) 14316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:13 smithi049 bash[23528]: audit 2024-09-21T05:11:12.661955+0000 mon.a (mon.0) 14317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:13 smithi049 bash[23528]: audit 2024-09-21T05:11:12.683819+0000 mon.a (mon.0) 14318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:15 smithi179 bash[23186]: cluster 2024-09-21T05:11:14.196882+0000 mgr.a (mgr.14388) 18041 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:11:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:15 smithi044 bash[22676]: cluster 2024-09-21T05:11:14.196882+0000 mgr.a (mgr.14388) 18041 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:11:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:15 smithi049 bash[23528]: cluster 2024-09-21T05:11:14.196882+0000 mgr.a (mgr.14388) 18041 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:11:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:17.118 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:17.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:17 smithi179 bash[23186]: cluster 2024-09-21T05:11:16.199113+0000 mgr.a (mgr.14388) 18042 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:17.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:17 smithi179 bash[23186]: audit 2024-09-21T05:11:16.674672+0000 mgr.a (mgr.14388) 18043 : audit [DBG] from='client.388086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:17 smithi044 bash[22676]: cluster 2024-09-21T05:11:16.199113+0000 mgr.a (mgr.14388) 18042 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:17.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:17 smithi044 bash[22676]: audit 2024-09-21T05:11:16.674672+0000 mgr.a (mgr.14388) 18043 : audit [DBG] from='client.388086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:17 smithi049 bash[23528]: cluster 2024-09-21T05:11:16.199113+0000 mgr.a (mgr.14388) 18042 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:17 smithi049 bash[23528]: audit 2024-09-21T05:11:16.674672+0000 mgr.a (mgr.14388) 18043 : audit [DBG] from='client.388086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:19 smithi044 bash[22676]: cluster 2024-09-21T05:11:18.200107+0000 mgr.a (mgr.14388) 18044 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:19 smithi179 bash[23186]: cluster 2024-09-21T05:11:18.200107+0000 mgr.a (mgr.14388) 18044 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:19 smithi049 bash[23528]: cluster 2024-09-21T05:11:18.200107+0000 mgr.a (mgr.14388) 18044 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:21 smithi044 bash[22676]: cluster 2024-09-21T05:11:20.202314+0000 mgr.a (mgr.14388) 18045 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:21 smithi179 bash[23186]: cluster 2024-09-21T05:11:20.202314+0000 mgr.a (mgr.14388) 18045 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:21 smithi049 bash[23528]: cluster 2024-09-21T05:11:20.202314+0000 mgr.a (mgr.14388) 18045 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:22.119 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:22.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:22.120 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:22.878 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:22.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:22.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:22.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:22.878 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:23 smithi044 bash[22676]: cluster 2024-09-21T05:11:22.203014+0000 mgr.a (mgr.14388) 18046 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:23.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:23 smithi044 bash[22676]: audit 2024-09-21T05:11:22.446093+0000 mgr.a (mgr.14388) 18047 : audit [DBG] from='client.388164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:23.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:23 smithi044 bash[22676]: audit 2024-09-21T05:11:22.651186+0000 mon.a (mon.0) 14319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:23.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:23 smithi044 bash[22676]: audit 2024-09-21T05:11:22.657881+0000 mon.a (mon.0) 14320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:23.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:23 smithi044 bash[22676]: audit 2024-09-21T05:11:22.663546+0000 mon.a (mon.0) 14321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:23 smithi049 bash[23528]: cluster 2024-09-21T05:11:22.203014+0000 mgr.a (mgr.14388) 18046 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:23 smithi049 bash[23528]: audit 2024-09-21T05:11:22.446093+0000 mgr.a (mgr.14388) 18047 : audit [DBG] from='client.388164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:23 smithi049 bash[23528]: audit 2024-09-21T05:11:22.651186+0000 mon.a (mon.0) 14319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:23 smithi049 bash[23528]: audit 2024-09-21T05:11:22.657881+0000 mon.a (mon.0) 14320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:23 smithi049 bash[23528]: audit 2024-09-21T05:11:22.663546+0000 mon.a (mon.0) 14321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:23 smithi179 bash[23186]: cluster 2024-09-21T05:11:22.203014+0000 mgr.a (mgr.14388) 18046 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:24.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:23 smithi179 bash[23186]: audit 2024-09-21T05:11:22.446093+0000 mgr.a (mgr.14388) 18047 : audit [DBG] from='client.388164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:24.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:23 smithi179 bash[23186]: audit 2024-09-21T05:11:22.651186+0000 mon.a (mon.0) 14319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:24.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:23 smithi179 bash[23186]: audit 2024-09-21T05:11:22.657881+0000 mon.a (mon.0) 14320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:24.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:23 smithi179 bash[23186]: audit 2024-09-21T05:11:22.663546+0000 mon.a (mon.0) 14321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:25 smithi044 bash[22676]: cluster 2024-09-21T05:11:24.203941+0000 mgr.a (mgr.14388) 18048 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:25 smithi179 bash[23186]: cluster 2024-09-21T05:11:24.203941+0000 mgr.a (mgr.14388) 18048 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:25 smithi049 bash[23528]: cluster 2024-09-21T05:11:24.203941+0000 mgr.a (mgr.14388) 18048 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:27.880 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:27.880 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:27.880 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:27 smithi044 bash[22676]: cluster 2024-09-21T05:11:26.206214+0000 mgr.a (mgr.14388) 18049 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:27 smithi179 bash[23186]: cluster 2024-09-21T05:11:26.206214+0000 mgr.a (mgr.14388) 18049 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:27 smithi049 bash[23528]: cluster 2024-09-21T05:11:26.206214+0000 mgr.a (mgr.14388) 18049 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:28.638 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:28.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:28.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:28.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:28.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:29 smithi044 bash[22676]: cluster 2024-09-21T05:11:28.206933+0000 mgr.a (mgr.14388) 18050 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:29.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:29 smithi044 bash[22676]: audit 2024-09-21T05:11:28.210443+0000 mgr.a (mgr.14388) 18051 : audit [DBG] from='client.388239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:29 smithi179 bash[23186]: cluster 2024-09-21T05:11:28.206933+0000 mgr.a (mgr.14388) 18050 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:29 smithi179 bash[23186]: audit 2024-09-21T05:11:28.210443+0000 mgr.a (mgr.14388) 18051 : audit [DBG] from='client.388239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:29 smithi049 bash[23528]: cluster 2024-09-21T05:11:28.206933+0000 mgr.a (mgr.14388) 18050 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:29 smithi049 bash[23528]: audit 2024-09-21T05:11:28.210443+0000 mgr.a (mgr.14388) 18051 : audit [DBG] from='client.388239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:31 smithi044 bash[22676]: cluster 2024-09-21T05:11:30.209181+0000 mgr.a (mgr.14388) 18052 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:31 smithi179 bash[23186]: cluster 2024-09-21T05:11:30.209181+0000 mgr.a (mgr.14388) 18052 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:31 smithi049 bash[23528]: cluster 2024-09-21T05:11:30.209181+0000 mgr.a (mgr.14388) 18052 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:33.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:33.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:33.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:33 smithi049 bash[23528]: cluster 2024-09-21T05:11:32.210119+0000 mgr.a (mgr.14388) 18053 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:33 smithi049 bash[23528]: audit 2024-09-21T05:11:32.769834+0000 mon.a (mon.0) 14322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:33 smithi049 bash[23528]: audit 2024-09-21T05:11:32.776974+0000 mon.a (mon.0) 14323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:33 smithi049 bash[23528]: audit 2024-09-21T05:11:32.783873+0000 mon.a (mon.0) 14324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:33 smithi049 bash[23528]: audit 2024-09-21T05:11:32.904714+0000 mon.a (mon.0) 14325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:33 smithi049 bash[23528]: audit 2024-09-21T05:11:32.913102+0000 mon.a (mon.0) 14326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:33 smithi049 bash[23528]: audit 2024-09-21T05:11:32.923253+0000 mon.a (mon.0) 14327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:33 smithi044 bash[22676]: cluster 2024-09-21T05:11:32.210119+0000 mgr.a (mgr.14388) 18053 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:33 smithi044 bash[22676]: audit 2024-09-21T05:11:32.769834+0000 mon.a (mon.0) 14322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:33 smithi044 bash[22676]: audit 2024-09-21T05:11:32.776974+0000 mon.a (mon.0) 14323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:33 smithi044 bash[22676]: audit 2024-09-21T05:11:32.783873+0000 mon.a (mon.0) 14324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:33 smithi044 bash[22676]: audit 2024-09-21T05:11:32.904714+0000 mon.a (mon.0) 14325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:33 smithi044 bash[22676]: audit 2024-09-21T05:11:32.913102+0000 mon.a (mon.0) 14326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:33 smithi044 bash[22676]: audit 2024-09-21T05:11:32.923253+0000 mon.a (mon.0) 14327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:33 smithi179 bash[23186]: cluster 2024-09-21T05:11:32.210119+0000 mgr.a (mgr.14388) 18053 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:33 smithi179 bash[23186]: audit 2024-09-21T05:11:32.769834+0000 mon.a (mon.0) 14322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:33 smithi179 bash[23186]: audit 2024-09-21T05:11:32.776974+0000 mon.a (mon.0) 14323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:33 smithi179 bash[23186]: audit 2024-09-21T05:11:32.783873+0000 mon.a (mon.0) 14324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:33 smithi179 bash[23186]: audit 2024-09-21T05:11:32.904714+0000 mon.a (mon.0) 14325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:33 smithi179 bash[23186]: audit 2024-09-21T05:11:32.913102+0000 mon.a (mon.0) 14326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:33 smithi179 bash[23186]: audit 2024-09-21T05:11:32.923253+0000 mon.a (mon.0) 14327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:34.424 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:34.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:34.424 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:34.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:35.935 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:35 smithi179 bash[23186]: audit 2024-09-21T05:11:33.978739+0000 mgr.a (mgr.14388) 18054 : audit [DBG] from='client.388317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:35.935 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:35 smithi179 bash[23186]: cluster 2024-09-21T05:11:34.217310+0000 mgr.a (mgr.14388) 18055 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:35 smithi049 bash[23528]: audit 2024-09-21T05:11:33.978739+0000 mgr.a (mgr.14388) 18054 : audit [DBG] from='client.388317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:35 smithi049 bash[23528]: cluster 2024-09-21T05:11:34.217310+0000 mgr.a (mgr.14388) 18055 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:35 smithi044 bash[22676]: audit 2024-09-21T05:11:33.978739+0000 mgr.a (mgr.14388) 18054 : audit [DBG] from='client.388317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:35 smithi044 bash[22676]: cluster 2024-09-21T05:11:34.217310+0000 mgr.a (mgr.14388) 18055 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:37 smithi049 bash[23528]: cluster 2024-09-21T05:11:36.219646+0000 mgr.a (mgr.14388) 18056 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:38.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:37 smithi179 bash[23186]: cluster 2024-09-21T05:11:36.219646+0000 mgr.a (mgr.14388) 18056 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:37 smithi044 bash[22676]: cluster 2024-09-21T05:11:36.219646+0000 mgr.a (mgr.14388) 18056 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:11:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:39.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:39.426 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:39 smithi049 bash[23528]: cluster 2024-09-21T05:11:38.220442+0000 mgr.a (mgr.14388) 18057 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:39 smithi049 bash[23528]: audit 2024-09-21T05:11:39.009352+0000 mon.a (mon.0) 14328 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:11:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:39 smithi049 bash[23528]: audit 2024-09-21T05:11:39.015967+0000 mon.a (mon.0) 14329 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:39 smithi049 bash[23528]: audit 2024-09-21T05:11:39.017960+0000 mon.a (mon.0) 14330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:39 smithi049 bash[23528]: audit 2024-09-21T05:11:39.029156+0000 mon.a (mon.0) 14331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:39 smithi049 bash[23528]: audit 2024-09-21T05:11:39.035640+0000 mon.a (mon.0) 14332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:11:40.228 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:40.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:40.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:40.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:40.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:40.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22930]: debug 2024-09-21T05:11:39.810+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:11:40.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22930]: debug 2024-09-21T05:11:39.826+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:11:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22676]: cluster 2024-09-21T05:11:38.220442+0000 mgr.a (mgr.14388) 18057 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:40.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22676]: audit 2024-09-21T05:11:39.009352+0000 mon.a (mon.0) 14328 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:11:40.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22676]: audit 2024-09-21T05:11:39.015967+0000 mon.a (mon.0) 14329 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:40.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22676]: audit 2024-09-21T05:11:39.017960+0000 mon.a (mon.0) 14330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:40.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22676]: audit 2024-09-21T05:11:39.029156+0000 mon.a (mon.0) 14331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:40.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:39 smithi044 bash[22676]: audit 2024-09-21T05:11:39.035640+0000 mon.a (mon.0) 14332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:11:40.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:39 smithi179 bash[23186]: cluster 2024-09-21T05:11:38.220442+0000 mgr.a (mgr.14388) 18057 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:40.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:39 smithi179 bash[23186]: audit 2024-09-21T05:11:39.009352+0000 mon.a (mon.0) 14328 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:11:40.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:39 smithi179 bash[23186]: audit 2024-09-21T05:11:39.015967+0000 mon.a (mon.0) 14329 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:40.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:39 smithi179 bash[23186]: audit 2024-09-21T05:11:39.017960+0000 mon.a (mon.0) 14330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:40.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:39 smithi179 bash[23186]: audit 2024-09-21T05:11:39.029156+0000 mon.a (mon.0) 14331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:40.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:39 smithi179 bash[23186]: audit 2024-09-21T05:11:39.035640+0000 mon.a (mon.0) 14332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:11:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:40 smithi049 bash[23528]: audit 2024-09-21T05:11:39.038074+0000 mgr.a (mgr.14388) 18058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:11:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:40 smithi049 bash[23528]: audit 2024-09-21T05:11:39.762339+0000 mgr.a (mgr.14388) 18059 : audit [DBG] from='client.388464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:40 smithi049 bash[23528]: audit 2024-09-21T05:11:39.814181+0000 mgr.a (mgr.14388) 18060 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:11:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:40 smithi049 bash[23528]: cephadm 2024-09-21T05:11:39.831271+0000 mgr.a (mgr.14388) 18061 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:11:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:40 smithi044 bash[22676]: audit 2024-09-21T05:11:39.038074+0000 mgr.a (mgr.14388) 18058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:11:41.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:40 smithi044 bash[22676]: audit 2024-09-21T05:11:39.762339+0000 mgr.a (mgr.14388) 18059 : audit [DBG] from='client.388464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:41.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:40 smithi044 bash[22676]: audit 2024-09-21T05:11:39.814181+0000 mgr.a (mgr.14388) 18060 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:11:41.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:40 smithi044 bash[22676]: cephadm 2024-09-21T05:11:39.831271+0000 mgr.a (mgr.14388) 18061 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:11:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:40 smithi179 bash[23186]: audit 2024-09-21T05:11:39.038074+0000 mgr.a (mgr.14388) 18058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:11:41.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:40 smithi179 bash[23186]: audit 2024-09-21T05:11:39.762339+0000 mgr.a (mgr.14388) 18059 : audit [DBG] from='client.388464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:41.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:40 smithi179 bash[23186]: audit 2024-09-21T05:11:39.814181+0000 mgr.a (mgr.14388) 18060 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:11:41.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:40 smithi179 bash[23186]: cephadm 2024-09-21T05:11:39.831271+0000 mgr.a (mgr.14388) 18061 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:11:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:41 smithi049 bash[23528]: cluster 2024-09-21T05:11:40.221739+0000 mgr.a (mgr.14388) 18062 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:41 smithi044 bash[22676]: cluster 2024-09-21T05:11:40.221739+0000 mgr.a (mgr.14388) 18062 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:41 smithi179 bash[23186]: cluster 2024-09-21T05:11:40.221739+0000 mgr.a (mgr.14388) 18062 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:43 smithi044 bash[22676]: cluster 2024-09-21T05:11:42.222609+0000 mgr.a (mgr.14388) 18063 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:43.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:43 smithi044 bash[22676]: audit 2024-09-21T05:11:42.834168+0000 mon.a (mon.0) 14333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:43.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:43 smithi044 bash[22676]: audit 2024-09-21T05:11:42.841792+0000 mon.a (mon.0) 14334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:43.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:43 smithi044 bash[22676]: audit 2024-09-21T05:11:42.852539+0000 mon.a (mon.0) 14335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:43 smithi179 bash[23186]: cluster 2024-09-21T05:11:42.222609+0000 mgr.a (mgr.14388) 18063 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:43 smithi179 bash[23186]: audit 2024-09-21T05:11:42.834168+0000 mon.a (mon.0) 14333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:43 smithi179 bash[23186]: audit 2024-09-21T05:11:42.841792+0000 mon.a (mon.0) 14334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:44.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:43 smithi179 bash[23186]: audit 2024-09-21T05:11:42.852539+0000 mon.a (mon.0) 14335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:43 smithi049 bash[23528]: cluster 2024-09-21T05:11:42.222609+0000 mgr.a (mgr.14388) 18063 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:43 smithi049 bash[23528]: audit 2024-09-21T05:11:42.834168+0000 mon.a (mon.0) 14333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:43 smithi049 bash[23528]: audit 2024-09-21T05:11:42.841792+0000 mon.a (mon.0) 14334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:43 smithi049 bash[23528]: audit 2024-09-21T05:11:42.852539+0000 mon.a (mon.0) 14335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:45.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:45.230 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:45.230 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:46.000 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:46.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:46.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:46.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:46.000 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:46.097 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:45 smithi044 bash[22676]: cluster 2024-09-21T05:11:44.223533+0000 mgr.a (mgr.14388) 18064 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:45 smithi179 bash[23186]: cluster 2024-09-21T05:11:44.223533+0000 mgr.a (mgr.14388) 18064 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:45 smithi049 bash[23528]: cluster 2024-09-21T05:11:44.223533+0000 mgr.a (mgr.14388) 18064 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:46 smithi044 bash[22676]: audit 2024-09-21T05:11:45.566562+0000 mgr.a (mgr.14388) 18065 : audit [DBG] from='client.388578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:46 smithi179 bash[23186]: audit 2024-09-21T05:11:45.566562+0000 mgr.a (mgr.14388) 18065 : audit [DBG] from='client.388578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:46 smithi049 bash[23528]: audit 2024-09-21T05:11:45.566562+0000 mgr.a (mgr.14388) 18065 : audit [DBG] from='client.388578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:47 smithi044 bash[22676]: cluster 2024-09-21T05:11:46.226561+0000 mgr.a (mgr.14388) 18066 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:47 smithi179 bash[23186]: cluster 2024-09-21T05:11:46.226561+0000 mgr.a (mgr.14388) 18066 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:47 smithi049 bash[23528]: cluster 2024-09-21T05:11:46.226561+0000 mgr.a (mgr.14388) 18066 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:48 smithi044 bash[22676]: cluster 2024-09-21T05:11:48.227560+0000 mgr.a (mgr.14388) 18067 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:48 smithi179 bash[23186]: cluster 2024-09-21T05:11:48.227560+0000 mgr.a (mgr.14388) 18067 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:48 smithi049 bash[23528]: cluster 2024-09-21T05:11:48.227560+0000 mgr.a (mgr.14388) 18067 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:11:51.001 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:51.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:51.002 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:51 smithi049 bash[23528]: cluster 2024-09-21T05:11:50.229580+0000 mgr.a (mgr.14388) 18068 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:51 smithi044 bash[22676]: cluster 2024-09-21T05:11:50.229580+0000 mgr.a (mgr.14388) 18068 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:51 smithi179 bash[23186]: cluster 2024-09-21T05:11:50.229580+0000 mgr.a (mgr.14388) 18068 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:11:51.787 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:51.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:51.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:51.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:51.787 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:52 smithi049 bash[23528]: audit 2024-09-21T05:11:51.336962+0000 mgr.a (mgr.14388) 18069 : audit [DBG] from='client.388653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:52.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:52 smithi044 bash[22676]: audit 2024-09-21T05:11:51.336962+0000 mgr.a (mgr.14388) 18069 : audit [DBG] from='client.388653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:52 smithi179 bash[23186]: audit 2024-09-21T05:11:51.336962+0000 mgr.a (mgr.14388) 18069 : audit [DBG] from='client.388653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:53 smithi044 bash[22676]: cluster 2024-09-21T05:11:52.230753+0000 mgr.a (mgr.14388) 18070 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:11:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:53 smithi044 bash[22676]: audit 2024-09-21T05:11:52.987548+0000 mon.a (mon.0) 14336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:53 smithi044 bash[22676]: audit 2024-09-21T05:11:52.993632+0000 mon.a (mon.0) 14337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:53 smithi044 bash[22676]: audit 2024-09-21T05:11:53.003131+0000 mon.a (mon.0) 14338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:53 smithi044 bash[22676]: audit 2024-09-21T05:11:53.135951+0000 mon.a (mon.0) 14339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:53 smithi044 bash[22676]: audit 2024-09-21T05:11:53.141820+0000 mon.a (mon.0) 14340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:53 smithi044 bash[22676]: audit 2024-09-21T05:11:53.151292+0000 mon.a (mon.0) 14341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:53 smithi049 bash[23528]: cluster 2024-09-21T05:11:52.230753+0000 mgr.a (mgr.14388) 18070 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:11:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:53 smithi049 bash[23528]: audit 2024-09-21T05:11:52.987548+0000 mon.a (mon.0) 14336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:53 smithi049 bash[23528]: audit 2024-09-21T05:11:52.993632+0000 mon.a (mon.0) 14337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:53 smithi049 bash[23528]: audit 2024-09-21T05:11:53.003131+0000 mon.a (mon.0) 14338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:53 smithi049 bash[23528]: audit 2024-09-21T05:11:53.135951+0000 mon.a (mon.0) 14339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:53 smithi049 bash[23528]: audit 2024-09-21T05:11:53.141820+0000 mon.a (mon.0) 14340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:53 smithi049 bash[23528]: audit 2024-09-21T05:11:53.151292+0000 mon.a (mon.0) 14341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:53 smithi179 bash[23186]: cluster 2024-09-21T05:11:52.230753+0000 mgr.a (mgr.14388) 18070 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:11:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:53 smithi179 bash[23186]: audit 2024-09-21T05:11:52.987548+0000 mon.a (mon.0) 14336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:53 smithi179 bash[23186]: audit 2024-09-21T05:11:52.993632+0000 mon.a (mon.0) 14337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:53 smithi179 bash[23186]: audit 2024-09-21T05:11:53.003131+0000 mon.a (mon.0) 14338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:53 smithi179 bash[23186]: audit 2024-09-21T05:11:53.135951+0000 mon.a (mon.0) 14339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:53 smithi179 bash[23186]: audit 2024-09-21T05:11:53.141820+0000 mon.a (mon.0) 14340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:53.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:53 smithi179 bash[23186]: audit 2024-09-21T05:11:53.151292+0000 mon.a (mon.0) 14341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:11:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:55 smithi044 bash[22676]: cluster 2024-09-21T05:11:54.231600+0000 mgr.a (mgr.14388) 18071 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:11:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:55 smithi179 bash[23186]: cluster 2024-09-21T05:11:54.231600+0000 mgr.a (mgr.14388) 18071 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:11:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:55 smithi049 bash[23528]: cluster 2024-09-21T05:11:54.231600+0000 mgr.a (mgr.14388) 18071 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:11:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:11:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:11:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:11:57.542 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:11:57.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:11:57.542 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:11:57.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:11:57.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:11:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:57 smithi044 bash[22676]: cluster 2024-09-21T05:11:56.233898+0000 mgr.a (mgr.14388) 18072 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:11:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:57 smithi179 bash[23186]: cluster 2024-09-21T05:11:56.233898+0000 mgr.a (mgr.14388) 18072 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:11:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:57 smithi049 bash[23528]: cluster 2024-09-21T05:11:56.233898+0000 mgr.a (mgr.14388) 18072 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:11:58.623 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:58 smithi179 bash[23186]: audit 2024-09-21T05:11:57.123144+0000 mgr.a (mgr.14388) 18073 : audit [DBG] from='client.388728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:58 smithi044 bash[22676]: audit 2024-09-21T05:11:57.123144+0000 mgr.a (mgr.14388) 18073 : audit [DBG] from='client.388728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:58 smithi049 bash[23528]: audit 2024-09-21T05:11:57.123144+0000 mgr.a (mgr.14388) 18073 : audit [DBG] from='client.388728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:11:59.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:11:59 smithi044 bash[22676]: cluster 2024-09-21T05:11:58.234899+0000 mgr.a (mgr.14388) 18074 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:11:59 smithi179 bash[23186]: cluster 2024-09-21T05:11:58.234899+0000 mgr.a (mgr.14388) 18074 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:11:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:11:59 smithi049 bash[23528]: cluster 2024-09-21T05:11:58.234899+0000 mgr.a (mgr.14388) 18074 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:01.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:01 smithi044 bash[22676]: cluster 2024-09-21T05:12:00.237107+0000 mgr.a (mgr.14388) 18075 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:01.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:01 smithi179 bash[23186]: cluster 2024-09-21T05:12:00.237107+0000 mgr.a (mgr.14388) 18075 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:01.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:01 smithi049 bash[23528]: cluster 2024-09-21T05:12:00.237107+0000 mgr.a (mgr.14388) 18075 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:02.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:02.544 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:02.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:03.297 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:03.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:03.297 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:03.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:03.298 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:03.599 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:03 smithi049 bash[23528]: cluster 2024-09-21T05:12:02.237958+0000 mgr.a (mgr.14388) 18076 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:03.600 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:03 smithi049 bash[23528]: audit 2024-09-21T05:12:03.010209+0000 mon.a (mon.0) 14342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.600 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:03 smithi049 bash[23528]: audit 2024-09-21T05:12:03.015935+0000 mon.a (mon.0) 14343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.600 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:03 smithi049 bash[23528]: audit 2024-09-21T05:12:03.021182+0000 mon.a (mon.0) 14344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.689 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:03 smithi044 bash[22676]: cluster 2024-09-21T05:12:02.237958+0000 mgr.a (mgr.14388) 18076 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:03.689 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:03 smithi044 bash[22676]: audit 2024-09-21T05:12:03.010209+0000 mon.a (mon.0) 14342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.689 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:03 smithi044 bash[22676]: audit 2024-09-21T05:12:03.015935+0000 mon.a (mon.0) 14343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.689 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:03 smithi044 bash[22676]: audit 2024-09-21T05:12:03.021182+0000 mon.a (mon.0) 14344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:03 smithi179 bash[23186]: cluster 2024-09-21T05:12:02.237958+0000 mgr.a (mgr.14388) 18076 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:03 smithi179 bash[23186]: audit 2024-09-21T05:12:03.010209+0000 mon.a (mon.0) 14342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:03 smithi179 bash[23186]: audit 2024-09-21T05:12:03.015935+0000 mon.a (mon.0) 14343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:03.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:03 smithi179 bash[23186]: audit 2024-09-21T05:12:03.021182+0000 mon.a (mon.0) 14344 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:04 smithi044 bash[22676]: audit 2024-09-21T05:12:02.871991+0000 mgr.a (mgr.14388) 18077 : audit [DBG] from='client.388803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:04.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:04 smithi179 bash[23186]: audit 2024-09-21T05:12:02.871991+0000 mgr.a (mgr.14388) 18077 : audit [DBG] from='client.388803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:04.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:04 smithi049 bash[23528]: audit 2024-09-21T05:12:02.871991+0000 mgr.a (mgr.14388) 18077 : audit [DBG] from='client.388803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:05 smithi044 bash[22676]: cluster 2024-09-21T05:12:04.238926+0000 mgr.a (mgr.14388) 18078 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:05 smithi179 bash[23186]: cluster 2024-09-21T05:12:04.238926+0000 mgr.a (mgr.14388) 18078 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:05 smithi049 bash[23528]: cluster 2024-09-21T05:12:04.238926+0000 mgr.a (mgr.14388) 18078 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:07 smithi044 bash[22676]: cluster 2024-09-21T05:12:06.241241+0000 mgr.a (mgr.14388) 18079 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:07 smithi179 bash[23186]: cluster 2024-09-21T05:12:06.241241+0000 mgr.a (mgr.14388) 18079 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:07 smithi049 bash[23528]: cluster 2024-09-21T05:12:06.241241+0000 mgr.a (mgr.14388) 18079 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:08.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:08.299 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:08.299 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:09.043 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:09.044 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:09 smithi044 bash[22676]: cluster 2024-09-21T05:12:08.242071+0000 mgr.a (mgr.14388) 18080 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:09 smithi044 bash[22676]: audit 2024-09-21T05:12:08.623262+0000 mgr.a (mgr.14388) 18081 : audit [DBG] from='client.388881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:09 smithi179 bash[23186]: cluster 2024-09-21T05:12:08.242071+0000 mgr.a (mgr.14388) 18080 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:09 smithi179 bash[23186]: audit 2024-09-21T05:12:08.623262+0000 mgr.a (mgr.14388) 18081 : audit [DBG] from='client.388881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:09 smithi049 bash[23528]: cluster 2024-09-21T05:12:08.242071+0000 mgr.a (mgr.14388) 18080 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:09 smithi049 bash[23528]: audit 2024-09-21T05:12:08.623262+0000 mgr.a (mgr.14388) 18081 : audit [DBG] from='client.388881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:11 smithi044 bash[22676]: cluster 2024-09-21T05:12:10.244340+0000 mgr.a (mgr.14388) 18082 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:11 smithi179 bash[23186]: cluster 2024-09-21T05:12:10.244340+0000 mgr.a (mgr.14388) 18082 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:11 smithi049 bash[23528]: cluster 2024-09-21T05:12:10.244340+0000 mgr.a (mgr.14388) 18082 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:13 smithi179 bash[23186]: cluster 2024-09-21T05:12:12.245124+0000 mgr.a (mgr.14388) 18083 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:13.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:13 smithi179 bash[23186]: audit 2024-09-21T05:12:13.194589+0000 mon.a (mon.0) 14345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:13 smithi179 bash[23186]: audit 2024-09-21T05:12:13.201823+0000 mon.a (mon.0) 14346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:13 smithi179 bash[23186]: audit 2024-09-21T05:12:13.207913+0000 mon.a (mon.0) 14347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:13 smithi044 bash[22676]: cluster 2024-09-21T05:12:12.245124+0000 mgr.a (mgr.14388) 18083 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:13 smithi044 bash[22676]: audit 2024-09-21T05:12:13.194589+0000 mon.a (mon.0) 14345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:13 smithi044 bash[22676]: audit 2024-09-21T05:12:13.201823+0000 mon.a (mon.0) 14346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:13 smithi044 bash[22676]: audit 2024-09-21T05:12:13.207913+0000 mon.a (mon.0) 14347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:13 smithi049 bash[23528]: cluster 2024-09-21T05:12:12.245124+0000 mgr.a (mgr.14388) 18083 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:13.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:13 smithi049 bash[23528]: audit 2024-09-21T05:12:13.194589+0000 mon.a (mon.0) 14345 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:13 smithi049 bash[23528]: audit 2024-09-21T05:12:13.201823+0000 mon.a (mon.0) 14346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:13.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:13 smithi049 bash[23528]: audit 2024-09-21T05:12:13.207913+0000 mon.a (mon.0) 14347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:14.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:14.046 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:14 smithi044 bash[22676]: audit 2024-09-21T05:12:13.368432+0000 mon.a (mon.0) 14348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:14 smithi044 bash[22676]: audit 2024-09-21T05:12:13.377331+0000 mon.a (mon.0) 14349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:14 smithi044 bash[22676]: audit 2024-09-21T05:12:13.388169+0000 mon.a (mon.0) 14350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:14 smithi179 bash[23186]: audit 2024-09-21T05:12:13.368432+0000 mon.a (mon.0) 14348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:14 smithi179 bash[23186]: audit 2024-09-21T05:12:13.377331+0000 mon.a (mon.0) 14349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:14 smithi179 bash[23186]: audit 2024-09-21T05:12:13.388169+0000 mon.a (mon.0) 14350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:14 smithi049 bash[23528]: audit 2024-09-21T05:12:13.368432+0000 mon.a (mon.0) 14348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:14 smithi049 bash[23528]: audit 2024-09-21T05:12:13.377331+0000 mon.a (mon.0) 14349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:14 smithi049 bash[23528]: audit 2024-09-21T05:12:13.388169+0000 mon.a (mon.0) 14350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:14.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:15 smithi044 bash[22676]: cluster 2024-09-21T05:12:14.245851+0000 mgr.a (mgr.14388) 18084 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:15 smithi044 bash[22676]: audit 2024-09-21T05:12:14.375463+0000 mgr.a (mgr.14388) 18085 : audit [DBG] from='client.388956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:15 smithi179 bash[23186]: cluster 2024-09-21T05:12:14.245851+0000 mgr.a (mgr.14388) 18084 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:15 smithi179 bash[23186]: audit 2024-09-21T05:12:14.375463+0000 mgr.a (mgr.14388) 18085 : audit [DBG] from='client.388956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:15 smithi049 bash[23528]: cluster 2024-09-21T05:12:14.245851+0000 mgr.a (mgr.14388) 18084 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:15 smithi049 bash[23528]: audit 2024-09-21T05:12:14.375463+0000 mgr.a (mgr.14388) 18085 : audit [DBG] from='client.388956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:17 smithi044 bash[22676]: cluster 2024-09-21T05:12:16.248234+0000 mgr.a (mgr.14388) 18086 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:17 smithi179 bash[23186]: cluster 2024-09-21T05:12:16.248234+0000 mgr.a (mgr.14388) 18086 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:17 smithi049 bash[23528]: cluster 2024-09-21T05:12:16.248234+0000 mgr.a (mgr.14388) 18086 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:19 smithi044 bash[22676]: cluster 2024-09-21T05:12:18.249040+0000 mgr.a (mgr.14388) 18087 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:19 smithi179 bash[23186]: cluster 2024-09-21T05:12:18.249040+0000 mgr.a (mgr.14388) 18087 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:19.806 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:19 smithi049 bash[23528]: cluster 2024-09-21T05:12:18.249040+0000 mgr.a (mgr.14388) 18087 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:19.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:19.820 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:20.575 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:20.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:20.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:20.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:20.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:21 smithi044 bash[22676]: audit 2024-09-21T05:12:20.150367+0000 mgr.a (mgr.14388) 18088 : audit [DBG] from='client.389034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:21 smithi044 bash[22676]: cluster 2024-09-21T05:12:20.250480+0000 mgr.a (mgr.14388) 18089 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:21 smithi179 bash[23186]: audit 2024-09-21T05:12:20.150367+0000 mgr.a (mgr.14388) 18088 : audit [DBG] from='client.389034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:21 smithi179 bash[23186]: cluster 2024-09-21T05:12:20.250480+0000 mgr.a (mgr.14388) 18089 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:21 smithi049 bash[23528]: audit 2024-09-21T05:12:20.150367+0000 mgr.a (mgr.14388) 18088 : audit [DBG] from='client.389034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:21.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:21 smithi049 bash[23528]: cluster 2024-09-21T05:12:20.250480+0000 mgr.a (mgr.14388) 18089 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:23.697 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:23 smithi044 bash[22676]: cluster 2024-09-21T05:12:22.251365+0000 mgr.a (mgr.14388) 18090 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:23.697 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:23 smithi044 bash[22676]: audit 2024-09-21T05:12:23.228066+0000 mon.a (mon.0) 14351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.697 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:23 smithi044 bash[22676]: audit 2024-09-21T05:12:23.236998+0000 mon.a (mon.0) 14352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.697 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:23 smithi044 bash[22676]: audit 2024-09-21T05:12:23.247737+0000 mon.a (mon.0) 14353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:23 smithi179 bash[23186]: cluster 2024-09-21T05:12:22.251365+0000 mgr.a (mgr.14388) 18090 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:23 smithi179 bash[23186]: audit 2024-09-21T05:12:23.228066+0000 mon.a (mon.0) 14351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:23 smithi179 bash[23186]: audit 2024-09-21T05:12:23.236998+0000 mon.a (mon.0) 14352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:23 smithi179 bash[23186]: audit 2024-09-21T05:12:23.247737+0000 mon.a (mon.0) 14353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:23 smithi049 bash[23528]: cluster 2024-09-21T05:12:22.251365+0000 mgr.a (mgr.14388) 18090 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:23 smithi049 bash[23528]: audit 2024-09-21T05:12:23.228066+0000 mon.a (mon.0) 14351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:23 smithi049 bash[23528]: audit 2024-09-21T05:12:23.236998+0000 mon.a (mon.0) 14352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:23 smithi049 bash[23528]: audit 2024-09-21T05:12:23.247737+0000 mon.a (mon.0) 14353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:25.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:25.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:25.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:25 smithi044 bash[22676]: cluster 2024-09-21T05:12:24.252149+0000 mgr.a (mgr.14388) 18091 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:25 smithi179 bash[23186]: cluster 2024-09-21T05:12:24.252149+0000 mgr.a (mgr.14388) 18091 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:25 smithi049 bash[23528]: cluster 2024-09-21T05:12:24.252149+0000 mgr.a (mgr.14388) 18091 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:26.315 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:26.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:26.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:26.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:26.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:27.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:27 smithi044 bash[22676]: audit 2024-09-21T05:12:25.895613+0000 mgr.a (mgr.14388) 18092 : audit [DBG] from='client.389112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:27.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:27 smithi044 bash[22676]: cluster 2024-09-21T05:12:26.253494+0000 mgr.a (mgr.14388) 18093 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:27 smithi179 bash[23186]: audit 2024-09-21T05:12:25.895613+0000 mgr.a (mgr.14388) 18092 : audit [DBG] from='client.389112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:27 smithi179 bash[23186]: cluster 2024-09-21T05:12:26.253494+0000 mgr.a (mgr.14388) 18093 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:27 smithi049 bash[23528]: audit 2024-09-21T05:12:25.895613+0000 mgr.a (mgr.14388) 18092 : audit [DBG] from='client.389112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:27.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:27 smithi049 bash[23528]: cluster 2024-09-21T05:12:26.253494+0000 mgr.a (mgr.14388) 18093 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:29 smithi044 bash[22676]: cluster 2024-09-21T05:12:28.254195+0000 mgr.a (mgr.14388) 18094 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:29 smithi179 bash[23186]: cluster 2024-09-21T05:12:28.254195+0000 mgr.a (mgr.14388) 18094 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:29.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:29 smithi049 bash[23528]: cluster 2024-09-21T05:12:28.254195+0000 mgr.a (mgr.14388) 18094 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:12:31.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:31.317 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:31 smithi044 bash[22676]: cluster 2024-09-21T05:12:30.256090+0000 mgr.a (mgr.14388) 18095 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:31 smithi179 bash[23186]: cluster 2024-09-21T05:12:30.256090+0000 mgr.a (mgr.14388) 18095 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:31 smithi049 bash[23528]: cluster 2024-09-21T05:12:30.256090+0000 mgr.a (mgr.14388) 18095 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:32.119 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:32.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:32.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:32.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:32.120 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:32 smithi044 bash[22676]: audit 2024-09-21T05:12:31.659997+0000 mgr.a (mgr.14388) 18096 : audit [DBG] from='client.389184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:32 smithi179 bash[23186]: audit 2024-09-21T05:12:31.659997+0000 mgr.a (mgr.14388) 18096 : audit [DBG] from='client.389184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:32 smithi049 bash[23528]: audit 2024-09-21T05:12:31.659997+0000 mgr.a (mgr.14388) 18096 : audit [DBG] from='client.389184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:33.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:33 smithi044 bash[22676]: cluster 2024-09-21T05:12:32.257069+0000 mgr.a (mgr.14388) 18097 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:33.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:33 smithi044 bash[22676]: audit 2024-09-21T05:12:33.413559+0000 mon.a (mon.0) 14354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:33 smithi044 bash[22676]: audit 2024-09-21T05:12:33.418950+0000 mon.a (mon.0) 14355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:33 smithi044 bash[22676]: audit 2024-09-21T05:12:33.425568+0000 mon.a (mon.0) 14356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:33 smithi179 bash[23186]: cluster 2024-09-21T05:12:32.257069+0000 mgr.a (mgr.14388) 18097 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:33 smithi179 bash[23186]: audit 2024-09-21T05:12:33.413559+0000 mon.a (mon.0) 14354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:33 smithi179 bash[23186]: audit 2024-09-21T05:12:33.418950+0000 mon.a (mon.0) 14355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:33 smithi179 bash[23186]: audit 2024-09-21T05:12:33.425568+0000 mon.a (mon.0) 14356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:33 smithi049 bash[23528]: cluster 2024-09-21T05:12:32.257069+0000 mgr.a (mgr.14388) 18097 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:33.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:33 smithi049 bash[23528]: audit 2024-09-21T05:12:33.413559+0000 mon.a (mon.0) 14354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:33 smithi049 bash[23528]: audit 2024-09-21T05:12:33.418950+0000 mon.a (mon.0) 14355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:33.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:33 smithi049 bash[23528]: audit 2024-09-21T05:12:33.425568+0000 mon.a (mon.0) 14356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:34 smithi044 bash[22676]: audit 2024-09-21T05:12:33.557197+0000 mon.a (mon.0) 14357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:34.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:34 smithi044 bash[22676]: audit 2024-09-21T05:12:33.564949+0000 mon.a (mon.0) 14358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:34.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:34 smithi044 bash[22676]: audit 2024-09-21T05:12:33.574729+0000 mon.a (mon.0) 14359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:34 smithi179 bash[23186]: audit 2024-09-21T05:12:33.557197+0000 mon.a (mon.0) 14357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:34 smithi179 bash[23186]: audit 2024-09-21T05:12:33.564949+0000 mon.a (mon.0) 14358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:34 smithi179 bash[23186]: audit 2024-09-21T05:12:33.574729+0000 mon.a (mon.0) 14359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:34 smithi049 bash[23528]: audit 2024-09-21T05:12:33.557197+0000 mon.a (mon.0) 14357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:34 smithi049 bash[23528]: audit 2024-09-21T05:12:33.564949+0000 mon.a (mon.0) 14358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:34 smithi049 bash[23528]: audit 2024-09-21T05:12:33.574729+0000 mon.a (mon.0) 14359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:35 smithi044 bash[22676]: cluster 2024-09-21T05:12:34.257769+0000 mgr.a (mgr.14388) 18098 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:35 smithi179 bash[23186]: cluster 2024-09-21T05:12:34.257769+0000 mgr.a (mgr.14388) 18098 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:35 smithi049 bash[23528]: cluster 2024-09-21T05:12:34.257769+0000 mgr.a (mgr.14388) 18098 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:37.121 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:37.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:37.122 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:37.902 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:37.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:37.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:37.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:37.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:37 smithi044 bash[22676]: cluster 2024-09-21T05:12:36.259939+0000 mgr.a (mgr.14388) 18099 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:37 smithi179 bash[23186]: cluster 2024-09-21T05:12:36.259939+0000 mgr.a (mgr.14388) 18099 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:37 smithi049 bash[23528]: cluster 2024-09-21T05:12:36.259939+0000 mgr.a (mgr.14388) 18099 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:12:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:38 smithi179 bash[23186]: audit 2024-09-21T05:12:37.452005+0000 mgr.a (mgr.14388) 18100 : audit [DBG] from='client.389262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:38 smithi044 bash[22676]: audit 2024-09-21T05:12:37.452005+0000 mgr.a (mgr.14388) 18100 : audit [DBG] from='client.389262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:38 smithi049 bash[23528]: audit 2024-09-21T05:12:37.452005+0000 mgr.a (mgr.14388) 18100 : audit [DBG] from='client.389262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:39 smithi044 bash[22676]: cluster 2024-09-21T05:12:38.260974+0000 mgr.a (mgr.14388) 18101 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:39 smithi179 bash[23186]: cluster 2024-09-21T05:12:38.260974+0000 mgr.a (mgr.14388) 18101 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:39 smithi049 bash[23528]: cluster 2024-09-21T05:12:38.260974+0000 mgr.a (mgr.14388) 18101 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:12:40.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:12:40 smithi044 bash[22930]: debug 2024-09-21T05:12:40.729+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:12:40.990 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:12:40 smithi044 bash[22930]: debug 2024-09-21T05:12:40.729+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:12:40.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:40 smithi044 bash[22676]: audit 2024-09-21T05:12:39.894103+0000 mon.a (mon.0) 14360 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:12:40.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:40 smithi044 bash[22676]: audit 2024-09-21T05:12:39.906062+0000 mon.a (mon.0) 14361 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:12:40.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:40 smithi044 bash[22676]: audit 2024-09-21T05:12:39.908005+0000 mon.a (mon.0) 14362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:12:40.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:40 smithi044 bash[22676]: audit 2024-09-21T05:12:39.920924+0000 mon.a (mon.0) 14363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:40.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:40 smithi044 bash[22676]: audit 2024-09-21T05:12:39.927474+0000 mon.a (mon.0) 14364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:12:41.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:40 smithi179 bash[23186]: audit 2024-09-21T05:12:39.894103+0000 mon.a (mon.0) 14360 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:12:41.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:40 smithi179 bash[23186]: audit 2024-09-21T05:12:39.906062+0000 mon.a (mon.0) 14361 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:12:41.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:40 smithi179 bash[23186]: audit 2024-09-21T05:12:39.908005+0000 mon.a (mon.0) 14362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:12:41.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:40 smithi179 bash[23186]: audit 2024-09-21T05:12:39.920924+0000 mon.a (mon.0) 14363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:41.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:40 smithi179 bash[23186]: audit 2024-09-21T05:12:39.927474+0000 mon.a (mon.0) 14364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:12:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:40 smithi049 bash[23528]: audit 2024-09-21T05:12:39.894103+0000 mon.a (mon.0) 14360 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:12:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:40 smithi049 bash[23528]: audit 2024-09-21T05:12:39.906062+0000 mon.a (mon.0) 14361 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:12:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:40 smithi049 bash[23528]: audit 2024-09-21T05:12:39.908005+0000 mon.a (mon.0) 14362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:12:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:40 smithi049 bash[23528]: audit 2024-09-21T05:12:39.920924+0000 mon.a (mon.0) 14363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:40 smithi049 bash[23528]: audit 2024-09-21T05:12:39.927474+0000 mon.a (mon.0) 14364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:12:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:41 smithi044 bash[22676]: audit 2024-09-21T05:12:39.930126+0000 mgr.a (mgr.14388) 18102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:12:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:41 smithi044 bash[22676]: cluster 2024-09-21T05:12:40.262587+0000 mgr.a (mgr.14388) 18103 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:12:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:41 smithi044 bash[22676]: audit 2024-09-21T05:12:40.734420+0000 mgr.a (mgr.14388) 18104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:12:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:41 smithi044 bash[22676]: cephadm 2024-09-21T05:12:40.735881+0000 mgr.a (mgr.14388) 18105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:12:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:41 smithi179 bash[23186]: audit 2024-09-21T05:12:39.930126+0000 mgr.a (mgr.14388) 18102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:12:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:41 smithi179 bash[23186]: cluster 2024-09-21T05:12:40.262587+0000 mgr.a (mgr.14388) 18103 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:12:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:41 smithi179 bash[23186]: audit 2024-09-21T05:12:40.734420+0000 mgr.a (mgr.14388) 18104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:12:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:41 smithi179 bash[23186]: cephadm 2024-09-21T05:12:40.735881+0000 mgr.a (mgr.14388) 18105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:12:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:41 smithi049 bash[23528]: audit 2024-09-21T05:12:39.930126+0000 mgr.a (mgr.14388) 18102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:12:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:41 smithi049 bash[23528]: cluster 2024-09-21T05:12:40.262587+0000 mgr.a (mgr.14388) 18103 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:12:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:41 smithi049 bash[23528]: audit 2024-09-21T05:12:40.734420+0000 mgr.a (mgr.14388) 18104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:12:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:41 smithi049 bash[23528]: cephadm 2024-09-21T05:12:40.735881+0000 mgr.a (mgr.14388) 18105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:12:42.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:42.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:42.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:43.661 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:43.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:43.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:43.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:43.661 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:43 smithi049 bash[23528]: cluster 2024-09-21T05:12:42.263448+0000 mgr.a (mgr.14388) 18106 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:12:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:43 smithi049 bash[23528]: audit 2024-09-21T05:12:43.446087+0000 mon.a (mon.0) 14365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:43 smithi049 bash[23528]: audit 2024-09-21T05:12:43.450590+0000 mon.a (mon.0) 14366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:43 smithi049 bash[23528]: audit 2024-09-21T05:12:43.455581+0000 mon.a (mon.0) 14367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:43.928 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:43 smithi044 bash[22676]: cluster 2024-09-21T05:12:42.263448+0000 mgr.a (mgr.14388) 18106 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:12:43.928 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:43 smithi044 bash[22676]: audit 2024-09-21T05:12:43.446087+0000 mon.a (mon.0) 14365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:43.928 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:43 smithi044 bash[22676]: audit 2024-09-21T05:12:43.450590+0000 mon.a (mon.0) 14366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:43.928 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:43 smithi044 bash[22676]: audit 2024-09-21T05:12:43.455581+0000 mon.a (mon.0) 14367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:43 smithi179 bash[23186]: cluster 2024-09-21T05:12:42.263448+0000 mgr.a (mgr.14388) 18106 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:12:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:43 smithi179 bash[23186]: audit 2024-09-21T05:12:43.446087+0000 mon.a (mon.0) 14365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:43 smithi179 bash[23186]: audit 2024-09-21T05:12:43.450590+0000 mon.a (mon.0) 14366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:43 smithi179 bash[23186]: audit 2024-09-21T05:12:43.455581+0000 mon.a (mon.0) 14367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:44.862 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:44 smithi049 bash[23528]: audit 2024-09-21T05:12:43.225129+0000 mgr.a (mgr.14388) 18107 : audit [DBG] from='client.389448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:44.971 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:44 smithi044 bash[22676]: audit 2024-09-21T05:12:43.225129+0000 mgr.a (mgr.14388) 18107 : audit [DBG] from='client.389448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:44 smithi179 bash[23186]: audit 2024-09-21T05:12:43.225129+0000 mgr.a (mgr.14388) 18107 : audit [DBG] from='client.389448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:45.921 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:45 smithi044 bash[22676]: cluster 2024-09-21T05:12:44.264377+0000 mgr.a (mgr.14388) 18108 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:12:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:45 smithi179 bash[23186]: cluster 2024-09-21T05:12:44.264377+0000 mgr.a (mgr.14388) 18108 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:12:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:45 smithi049 bash[23528]: cluster 2024-09-21T05:12:44.264377+0000 mgr.a (mgr.14388) 18108 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:12:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:47 smithi049 bash[23528]: cluster 2024-09-21T05:12:46.266657+0000 mgr.a (mgr.14388) 18109 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:47 smithi044 bash[22676]: cluster 2024-09-21T05:12:46.266657+0000 mgr.a (mgr.14388) 18109 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:47 smithi179 bash[23186]: cluster 2024-09-21T05:12:46.266657+0000 mgr.a (mgr.14388) 18109 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:48.663 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:48.664 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:48.664 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:49.428 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:49.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:49 smithi044 bash[22676]: cluster 2024-09-21T05:12:48.267422+0000 mgr.a (mgr.14388) 18110 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:49 smithi179 bash[23186]: cluster 2024-09-21T05:12:48.267422+0000 mgr.a (mgr.14388) 18110 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:49 smithi049 bash[23528]: cluster 2024-09-21T05:12:48.267422+0000 mgr.a (mgr.14388) 18110 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:50 smithi044 bash[22676]: audit 2024-09-21T05:12:48.990974+0000 mgr.a (mgr.14388) 18111 : audit [DBG] from='client.389526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:50 smithi179 bash[23186]: audit 2024-09-21T05:12:48.990974+0000 mgr.a (mgr.14388) 18111 : audit [DBG] from='client.389526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:50 smithi049 bash[23528]: audit 2024-09-21T05:12:48.990974+0000 mgr.a (mgr.14388) 18111 : audit [DBG] from='client.389526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:51 smithi044 bash[22676]: cluster 2024-09-21T05:12:50.269748+0000 mgr.a (mgr.14388) 18112 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:51 smithi179 bash[23186]: cluster 2024-09-21T05:12:50.269748+0000 mgr.a (mgr.14388) 18112 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:51 smithi049 bash[23528]: cluster 2024-09-21T05:12:50.269748+0000 mgr.a (mgr.14388) 18112 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:53 smithi044 bash[22676]: cluster 2024-09-21T05:12:52.270557+0000 mgr.a (mgr.14388) 18113 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:12:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:53 smithi044 bash[22676]: audit 2024-09-21T05:12:53.624035+0000 mon.a (mon.0) 14368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:53 smithi044 bash[22676]: audit 2024-09-21T05:12:53.629229+0000 mon.a (mon.0) 14369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:53 smithi179 bash[23186]: cluster 2024-09-21T05:12:52.270557+0000 mgr.a (mgr.14388) 18113 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:12:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:53 smithi179 bash[23186]: audit 2024-09-21T05:12:53.624035+0000 mon.a (mon.0) 14368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:53 smithi179 bash[23186]: audit 2024-09-21T05:12:53.629229+0000 mon.a (mon.0) 14369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:53 smithi049 bash[23528]: cluster 2024-09-21T05:12:52.270557+0000 mgr.a (mgr.14388) 18113 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:12:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:53 smithi049 bash[23528]: audit 2024-09-21T05:12:53.624035+0000 mon.a (mon.0) 14368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:53 smithi049 bash[23528]: audit 2024-09-21T05:12:53.629229+0000 mon.a (mon.0) 14369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:12:54.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:12:54.431 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:12:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:54 smithi044 bash[22676]: audit 2024-09-21T05:12:53.640708+0000 mon.a (mon.0) 14370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:54 smithi044 bash[22676]: audit 2024-09-21T05:12:53.787754+0000 mon.a (mon.0) 14371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:54 smithi044 bash[22676]: audit 2024-09-21T05:12:53.796098+0000 mon.a (mon.0) 14372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:54.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:54 smithi044 bash[22676]: audit 2024-09-21T05:12:53.806619+0000 mon.a (mon.0) 14373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:54 smithi179 bash[23186]: audit 2024-09-21T05:12:53.640708+0000 mon.a (mon.0) 14370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:54 smithi179 bash[23186]: audit 2024-09-21T05:12:53.787754+0000 mon.a (mon.0) 14371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:54 smithi179 bash[23186]: audit 2024-09-21T05:12:53.796098+0000 mon.a (mon.0) 14372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:54 smithi179 bash[23186]: audit 2024-09-21T05:12:53.806619+0000 mon.a (mon.0) 14373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:54 smithi049 bash[23528]: audit 2024-09-21T05:12:53.640708+0000 mon.a (mon.0) 14370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:54 smithi049 bash[23528]: audit 2024-09-21T05:12:53.787754+0000 mon.a (mon.0) 14371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:54 smithi049 bash[23528]: audit 2024-09-21T05:12:53.796098+0000 mon.a (mon.0) 14372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:54 smithi049 bash[23528]: audit 2024-09-21T05:12:53.806619+0000 mon.a (mon.0) 14373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:12:55.190 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:12:55.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:12:55.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:12:55.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:12:55.191 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:12:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:55 smithi044 bash[22676]: cluster 2024-09-21T05:12:54.271337+0000 mgr.a (mgr.14388) 18114 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:12:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:55 smithi044 bash[22676]: audit 2024-09-21T05:12:54.763468+0000 mgr.a (mgr.14388) 18115 : audit [DBG] from='client.389604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:55 smithi179 bash[23186]: cluster 2024-09-21T05:12:54.271337+0000 mgr.a (mgr.14388) 18114 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:12:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:55 smithi179 bash[23186]: audit 2024-09-21T05:12:54.763468+0000 mgr.a (mgr.14388) 18115 : audit [DBG] from='client.389604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:55 smithi049 bash[23528]: cluster 2024-09-21T05:12:54.271337+0000 mgr.a (mgr.14388) 18114 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:12:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:55 smithi049 bash[23528]: audit 2024-09-21T05:12:54.763468+0000 mgr.a (mgr.14388) 18115 : audit [DBG] from='client.389604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:12:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:57 smithi044 bash[22676]: cluster 2024-09-21T05:12:56.273777+0000 mgr.a (mgr.14388) 18116 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:57 smithi179 bash[23186]: cluster 2024-09-21T05:12:56.273777+0000 mgr.a (mgr.14388) 18116 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:12:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:57 smithi049 bash[23528]: cluster 2024-09-21T05:12:56.273777+0000 mgr.a (mgr.14388) 18116 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:00.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:00.193 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:00.193 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:12:59 smithi044 bash[22676]: cluster 2024-09-21T05:12:58.274585+0000 mgr.a (mgr.14388) 18117 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:13:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:12:59 smithi179 bash[23186]: cluster 2024-09-21T05:12:58.274585+0000 mgr.a (mgr.14388) 18117 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:13:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:12:59 smithi049 bash[23528]: cluster 2024-09-21T05:12:58.274585+0000 mgr.a (mgr.14388) 18117 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:13:00.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:01 smithi044 bash[22676]: cluster 2024-09-21T05:13:00.276579+0000 mgr.a (mgr.14388) 18118 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:01 smithi044 bash[22676]: audit 2024-09-21T05:13:00.526856+0000 mgr.a (mgr.14388) 18119 : audit [DBG] from='client.389679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:01 smithi179 bash[23186]: cluster 2024-09-21T05:13:00.276579+0000 mgr.a (mgr.14388) 18118 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:01 smithi179 bash[23186]: audit 2024-09-21T05:13:00.526856+0000 mgr.a (mgr.14388) 18119 : audit [DBG] from='client.389679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:01 smithi049 bash[23528]: cluster 2024-09-21T05:13:00.276579+0000 mgr.a (mgr.14388) 18118 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:01 smithi049 bash[23528]: audit 2024-09-21T05:13:00.526856+0000 mgr.a (mgr.14388) 18119 : audit [DBG] from='client.389679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:03 smithi049 bash[23528]: cluster 2024-09-21T05:13:02.277546+0000 mgr.a (mgr.14388) 18120 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:03 smithi049 bash[23528]: audit 2024-09-21T05:13:03.678242+0000 mon.a (mon.0) 14374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:03 smithi049 bash[23528]: audit 2024-09-21T05:13:03.687097+0000 mon.a (mon.0) 14375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:03 smithi049 bash[23528]: audit 2024-09-21T05:13:03.697951+0000 mon.a (mon.0) 14376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:03 smithi044 bash[22676]: cluster 2024-09-21T05:13:02.277546+0000 mgr.a (mgr.14388) 18120 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:03 smithi044 bash[22676]: audit 2024-09-21T05:13:03.678242+0000 mon.a (mon.0) 14374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:03 smithi044 bash[22676]: audit 2024-09-21T05:13:03.687097+0000 mon.a (mon.0) 14375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:03 smithi044 bash[22676]: audit 2024-09-21T05:13:03.697951+0000 mon.a (mon.0) 14376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:03 smithi179 bash[23186]: cluster 2024-09-21T05:13:02.277546+0000 mgr.a (mgr.14388) 18120 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:03 smithi179 bash[23186]: audit 2024-09-21T05:13:03.678242+0000 mon.a (mon.0) 14374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:03 smithi179 bash[23186]: audit 2024-09-21T05:13:03.687097+0000 mon.a (mon.0) 14375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:04.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:03 smithi179 bash[23186]: audit 2024-09-21T05:13:03.697951+0000 mon.a (mon.0) 14376 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:05.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:05.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:05.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:05 smithi049 bash[23528]: cluster 2024-09-21T05:13:04.278108+0000 mgr.a (mgr.14388) 18121 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:13:06.234 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:05 smithi044 bash[22676]: cluster 2024-09-21T05:13:04.278108+0000 mgr.a (mgr.14388) 18121 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:13:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:05 smithi179 bash[23186]: cluster 2024-09-21T05:13:04.278108+0000 mgr.a (mgr.14388) 18121 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:13:06.753 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:06.753 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:08.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:07 smithi049 bash[23528]: cluster 2024-09-21T05:13:06.279159+0000 mgr.a (mgr.14388) 18122 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:08.151 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:07 smithi049 bash[23528]: audit 2024-09-21T05:13:06.332773+0000 mgr.a (mgr.14388) 18123 : audit [DBG] from='client.389757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:07 smithi044 bash[22676]: cluster 2024-09-21T05:13:06.279159+0000 mgr.a (mgr.14388) 18122 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:07 smithi044 bash[22676]: audit 2024-09-21T05:13:06.332773+0000 mgr.a (mgr.14388) 18123 : audit [DBG] from='client.389757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:07 smithi179 bash[23186]: cluster 2024-09-21T05:13:06.279159+0000 mgr.a (mgr.14388) 18122 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:07 smithi179 bash[23186]: audit 2024-09-21T05:13:06.332773+0000 mgr.a (mgr.14388) 18123 : audit [DBG] from='client.389757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:09 smithi044 bash[22676]: cluster 2024-09-21T05:13:08.279992+0000 mgr.a (mgr.14388) 18124 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:13:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:09 smithi179 bash[23186]: cluster 2024-09-21T05:13:08.279992+0000 mgr.a (mgr.14388) 18124 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:13:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:09 smithi049 bash[23528]: cluster 2024-09-21T05:13:08.279992+0000 mgr.a (mgr.14388) 18124 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:13:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:11.755 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:11.755 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:11 smithi044 bash[22676]: cluster 2024-09-21T05:13:10.282145+0000 mgr.a (mgr.14388) 18125 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:13:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:11 smithi179 bash[23186]: cluster 2024-09-21T05:13:10.282145+0000 mgr.a (mgr.14388) 18125 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:13:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:11 smithi049 bash[23528]: cluster 2024-09-21T05:13:10.282145+0000 mgr.a (mgr.14388) 18125 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:13:12.495 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:13 smithi179 bash[23186]: audit 2024-09-21T05:13:12.077417+0000 mgr.a (mgr.14388) 18126 : audit [DBG] from='client.389835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:13 smithi179 bash[23186]: cluster 2024-09-21T05:13:12.282629+0000 mgr.a (mgr.14388) 18127 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:13 smithi179 bash[23186]: audit 2024-09-21T05:13:13.809466+0000 mon.a (mon.0) 14377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:13 smithi179 bash[23186]: audit 2024-09-21T05:13:13.817752+0000 mon.a (mon.0) 14378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:13 smithi179 bash[23186]: audit 2024-09-21T05:13:13.836950+0000 mon.a (mon.0) 14379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:13 smithi044 bash[22676]: audit 2024-09-21T05:13:12.077417+0000 mgr.a (mgr.14388) 18126 : audit [DBG] from='client.389835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:13 smithi044 bash[22676]: cluster 2024-09-21T05:13:12.282629+0000 mgr.a (mgr.14388) 18127 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:13 smithi044 bash[22676]: audit 2024-09-21T05:13:13.809466+0000 mon.a (mon.0) 14377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:13 smithi044 bash[22676]: audit 2024-09-21T05:13:13.817752+0000 mon.a (mon.0) 14378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:13 smithi044 bash[22676]: audit 2024-09-21T05:13:13.836950+0000 mon.a (mon.0) 14379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:13 smithi049 bash[23528]: audit 2024-09-21T05:13:12.077417+0000 mgr.a (mgr.14388) 18126 : audit [DBG] from='client.389835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:13 smithi049 bash[23528]: cluster 2024-09-21T05:13:12.282629+0000 mgr.a (mgr.14388) 18127 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:13 smithi049 bash[23528]: audit 2024-09-21T05:13:13.809466+0000 mon.a (mon.0) 14377 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:13 smithi049 bash[23528]: audit 2024-09-21T05:13:13.817752+0000 mon.a (mon.0) 14378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:13 smithi049 bash[23528]: audit 2024-09-21T05:13:13.836950+0000 mon.a (mon.0) 14379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:14 smithi044 bash[22676]: audit 2024-09-21T05:13:13.982397+0000 mon.a (mon.0) 14380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:14 smithi044 bash[22676]: audit 2024-09-21T05:13:13.990224+0000 mon.a (mon.0) 14381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:14 smithi044 bash[22676]: audit 2024-09-21T05:13:14.000421+0000 mon.a (mon.0) 14382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:14 smithi044 bash[22676]: cluster 2024-09-21T05:13:14.283489+0000 mgr.a (mgr.14388) 18128 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:14 smithi179 bash[23186]: audit 2024-09-21T05:13:13.982397+0000 mon.a (mon.0) 14380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:14 smithi179 bash[23186]: audit 2024-09-21T05:13:13.990224+0000 mon.a (mon.0) 14381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:14 smithi179 bash[23186]: audit 2024-09-21T05:13:14.000421+0000 mon.a (mon.0) 14382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:14 smithi179 bash[23186]: cluster 2024-09-21T05:13:14.283489+0000 mgr.a (mgr.14388) 18128 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:14 smithi049 bash[23528]: audit 2024-09-21T05:13:13.982397+0000 mon.a (mon.0) 14380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:14 smithi049 bash[23528]: audit 2024-09-21T05:13:13.990224+0000 mon.a (mon.0) 14381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:14 smithi049 bash[23528]: audit 2024-09-21T05:13:14.000421+0000 mon.a (mon.0) 14382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:15.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:14 smithi049 bash[23528]: cluster 2024-09-21T05:13:14.283489+0000 mgr.a (mgr.14388) 18128 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:17 smithi044 bash[22676]: cluster 2024-09-21T05:13:16.285782+0000 mgr.a (mgr.14388) 18129 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:17.487 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:17 smithi179 bash[23186]: cluster 2024-09-21T05:13:16.285782+0000 mgr.a (mgr.14388) 18129 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:17.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:17.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:17 smithi049 bash[23528]: cluster 2024-09-21T05:13:16.285782+0000 mgr.a (mgr.14388) 18129 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:18.274 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:18.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:18.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:18.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:18.274 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:18 smithi044 bash[22676]: audit 2024-09-21T05:13:17.829361+0000 mgr.a (mgr.14388) 18130 : audit [DBG] from='client.389910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:18 smithi179 bash[23186]: audit 2024-09-21T05:13:17.829361+0000 mgr.a (mgr.14388) 18130 : audit [DBG] from='client.389910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:18 smithi049 bash[23528]: audit 2024-09-21T05:13:17.829361+0000 mgr.a (mgr.14388) 18130 : audit [DBG] from='client.389910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:19 smithi044 bash[22676]: cluster 2024-09-21T05:13:18.286323+0000 mgr.a (mgr.14388) 18131 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:19 smithi179 bash[23186]: cluster 2024-09-21T05:13:18.286323+0000 mgr.a (mgr.14388) 18131 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:19.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:19 smithi049 bash[23528]: cluster 2024-09-21T05:13:18.286323+0000 mgr.a (mgr.14388) 18131 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:21 smithi044 bash[22676]: cluster 2024-09-21T05:13:20.288410+0000 mgr.a (mgr.14388) 18132 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:21 smithi179 bash[23186]: cluster 2024-09-21T05:13:20.288410+0000 mgr.a (mgr.14388) 18132 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:21 smithi049 bash[23528]: cluster 2024-09-21T05:13:20.288410+0000 mgr.a (mgr.14388) 18132 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:23.277 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:23.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:23 smithi044 bash[22676]: cluster 2024-09-21T05:13:22.289167+0000 mgr.a (mgr.14388) 18133 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:23 smithi179 bash[23186]: cluster 2024-09-21T05:13:22.289167+0000 mgr.a (mgr.14388) 18133 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:23 smithi049 bash[23528]: cluster 2024-09-21T05:13:22.289167+0000 mgr.a (mgr.14388) 18133 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:24.051 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:24.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:24.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:24.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:24.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:24.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:24 smithi044 bash[22676]: audit 2024-09-21T05:13:23.609411+0000 mgr.a (mgr.14388) 18134 : audit [DBG] from='client.389985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:24.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:24 smithi044 bash[22676]: audit 2024-09-21T05:13:23.894964+0000 mon.a (mon.0) 14383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:24 smithi044 bash[22676]: audit 2024-09-21T05:13:23.901478+0000 mon.a (mon.0) 14384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:24 smithi044 bash[22676]: audit 2024-09-21T05:13:23.907298+0000 mon.a (mon.0) 14385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:24 smithi179 bash[23186]: audit 2024-09-21T05:13:23.609411+0000 mgr.a (mgr.14388) 18134 : audit [DBG] from='client.389985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:24.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:24 smithi179 bash[23186]: audit 2024-09-21T05:13:23.894964+0000 mon.a (mon.0) 14383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:24 smithi179 bash[23186]: audit 2024-09-21T05:13:23.901478+0000 mon.a (mon.0) 14384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:24 smithi179 bash[23186]: audit 2024-09-21T05:13:23.907298+0000 mon.a (mon.0) 14385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.782 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:24 smithi049 bash[23528]: audit 2024-09-21T05:13:23.609411+0000 mgr.a (mgr.14388) 18134 : audit [DBG] from='client.389985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:24.782 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:24 smithi049 bash[23528]: audit 2024-09-21T05:13:23.894964+0000 mon.a (mon.0) 14383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.782 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:24 smithi049 bash[23528]: audit 2024-09-21T05:13:23.901478+0000 mon.a (mon.0) 14384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:24.782 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:24 smithi049 bash[23528]: audit 2024-09-21T05:13:23.907298+0000 mon.a (mon.0) 14385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:25 smithi044 bash[22676]: cluster 2024-09-21T05:13:24.290132+0000 mgr.a (mgr.14388) 18135 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:25 smithi179 bash[23186]: cluster 2024-09-21T05:13:24.290132+0000 mgr.a (mgr.14388) 18135 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:25 smithi049 bash[23528]: cluster 2024-09-21T05:13:24.290132+0000 mgr.a (mgr.14388) 18135 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:27.653 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:27 smithi049 bash[23528]: cluster 2024-09-21T05:13:26.292323+0000 mgr.a (mgr.14388) 18136 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:27.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:27 smithi044 bash[22676]: cluster 2024-09-21T05:13:26.292323+0000 mgr.a (mgr.14388) 18136 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:27 smithi179 bash[23186]: cluster 2024-09-21T05:13:26.292323+0000 mgr.a (mgr.14388) 18136 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:29.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:29.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:29.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:29 smithi044 bash[22676]: cluster 2024-09-21T05:13:28.293093+0000 mgr.a (mgr.14388) 18137 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:29 smithi179 bash[23186]: cluster 2024-09-21T05:13:28.293093+0000 mgr.a (mgr.14388) 18137 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:29 smithi049 bash[23528]: cluster 2024-09-21T05:13:28.293093+0000 mgr.a (mgr.14388) 18137 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:29.843 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:30 smithi044 bash[22676]: audit 2024-09-21T05:13:29.388391+0000 mgr.a (mgr.14388) 18138 : audit [DBG] from='client.390063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:30 smithi179 bash[23186]: audit 2024-09-21T05:13:29.388391+0000 mgr.a (mgr.14388) 18138 : audit [DBG] from='client.390063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:30 smithi049 bash[23528]: audit 2024-09-21T05:13:29.388391+0000 mgr.a (mgr.14388) 18138 : audit [DBG] from='client.390063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:31 smithi044 bash[22676]: cluster 2024-09-21T05:13:30.295316+0000 mgr.a (mgr.14388) 18139 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:31 smithi179 bash[23186]: cluster 2024-09-21T05:13:30.295316+0000 mgr.a (mgr.14388) 18139 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:31 smithi049 bash[23528]: cluster 2024-09-21T05:13:30.295316+0000 mgr.a (mgr.14388) 18139 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:13:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:33 smithi044 bash[22676]: cluster 2024-09-21T05:13:32.296069+0000 mgr.a (mgr.14388) 18140 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:33 smithi179 bash[23186]: cluster 2024-09-21T05:13:32.296069+0000 mgr.a (mgr.14388) 18140 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:33 smithi049 bash[23528]: cluster 2024-09-21T05:13:32.296069+0000 mgr.a (mgr.14388) 18140 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:34.845 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:34.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:34.845 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:35 smithi049 bash[23528]: audit 2024-09-21T05:13:34.042797+0000 mon.a (mon.0) 14386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:35 smithi049 bash[23528]: audit 2024-09-21T05:13:34.049941+0000 mon.a (mon.0) 14387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:35 smithi049 bash[23528]: audit 2024-09-21T05:13:34.058318+0000 mon.a (mon.0) 14388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:35 smithi049 bash[23528]: audit 2024-09-21T05:13:34.185086+0000 mon.a (mon.0) 14389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:35 smithi049 bash[23528]: audit 2024-09-21T05:13:34.192720+0000 mon.a (mon.0) 14390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:35 smithi049 bash[23528]: audit 2024-09-21T05:13:34.202763+0000 mon.a (mon.0) 14391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:35 smithi049 bash[23528]: cluster 2024-09-21T05:13:34.296832+0000 mgr.a (mgr.14388) 18141 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:35 smithi044 bash[22676]: audit 2024-09-21T05:13:34.042797+0000 mon.a (mon.0) 14386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:35 smithi044 bash[22676]: audit 2024-09-21T05:13:34.049941+0000 mon.a (mon.0) 14387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:35 smithi044 bash[22676]: audit 2024-09-21T05:13:34.058318+0000 mon.a (mon.0) 14388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:35 smithi044 bash[22676]: audit 2024-09-21T05:13:34.185086+0000 mon.a (mon.0) 14389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:35 smithi044 bash[22676]: audit 2024-09-21T05:13:34.192720+0000 mon.a (mon.0) 14390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:35 smithi044 bash[22676]: audit 2024-09-21T05:13:34.202763+0000 mon.a (mon.0) 14391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:35 smithi044 bash[22676]: cluster 2024-09-21T05:13:34.296832+0000 mgr.a (mgr.14388) 18141 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:35 smithi179 bash[23186]: audit 2024-09-21T05:13:34.042797+0000 mon.a (mon.0) 14386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:35 smithi179 bash[23186]: audit 2024-09-21T05:13:34.049941+0000 mon.a (mon.0) 14387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:35 smithi179 bash[23186]: audit 2024-09-21T05:13:34.058318+0000 mon.a (mon.0) 14388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:35 smithi179 bash[23186]: audit 2024-09-21T05:13:34.185086+0000 mon.a (mon.0) 14389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:35 smithi179 bash[23186]: audit 2024-09-21T05:13:34.192720+0000 mon.a (mon.0) 14390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:35 smithi179 bash[23186]: audit 2024-09-21T05:13:34.202763+0000 mon.a (mon.0) 14391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:35.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:35 smithi179 bash[23186]: cluster 2024-09-21T05:13:34.296832+0000 mgr.a (mgr.14388) 18141 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:35.639 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:36 smithi044 bash[22676]: audit 2024-09-21T05:13:35.181711+0000 mgr.a (mgr.14388) 18142 : audit [DBG] from='client.390135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:36 smithi179 bash[23186]: audit 2024-09-21T05:13:35.181711+0000 mgr.a (mgr.14388) 18142 : audit [DBG] from='client.390135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:36 smithi049 bash[23528]: audit 2024-09-21T05:13:35.181711+0000 mgr.a (mgr.14388) 18142 : audit [DBG] from='client.390135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:37 smithi044 bash[22676]: cluster 2024-09-21T05:13:36.299714+0000 mgr.a (mgr.14388) 18143 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:37 smithi179 bash[23186]: cluster 2024-09-21T05:13:36.299714+0000 mgr.a (mgr.14388) 18143 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:37 smithi049 bash[23528]: cluster 2024-09-21T05:13:36.299714+0000 mgr.a (mgr.14388) 18143 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:39 smithi044 bash[22676]: cluster 2024-09-21T05:13:38.300495+0000 mgr.a (mgr.14388) 18144 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:39 smithi179 bash[23186]: cluster 2024-09-21T05:13:38.300495+0000 mgr.a (mgr.14388) 18144 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:39 smithi049 bash[23528]: cluster 2024-09-21T05:13:38.300495+0000 mgr.a (mgr.14388) 18144 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22930]: debug 2024-09-21T05:13:41.600+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22930]: debug 2024-09-21T05:13:41.616+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22676]: cluster 2024-09-21T05:13:40.302455+0000 mgr.a (mgr.14388) 18145 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22676]: audit 2024-09-21T05:13:40.805157+0000 mon.a (mon.0) 14392 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22676]: audit 2024-09-21T05:13:40.809012+0000 mon.a (mon.0) 14393 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22676]: audit 2024-09-21T05:13:40.810679+0000 mon.a (mon.0) 14394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22676]: audit 2024-09-21T05:13:40.822528+0000 mon.a (mon.0) 14395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:41.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22676]: audit 2024-09-21T05:13:40.828573+0000 mon.a (mon.0) 14396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:13:41.624 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:41 smithi044 bash[22676]: audit 2024-09-21T05:13:40.830125+0000 mgr.a (mgr.14388) 18146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:13:41.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:41 smithi179 bash[23186]: cluster 2024-09-21T05:13:40.302455+0000 mgr.a (mgr.14388) 18145 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:41.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:41 smithi179 bash[23186]: audit 2024-09-21T05:13:40.805157+0000 mon.a (mon.0) 14392 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:13:41.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:41 smithi179 bash[23186]: audit 2024-09-21T05:13:40.809012+0000 mon.a (mon.0) 14393 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:13:41.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:41 smithi179 bash[23186]: audit 2024-09-21T05:13:40.810679+0000 mon.a (mon.0) 14394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:13:41.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:41 smithi179 bash[23186]: audit 2024-09-21T05:13:40.822528+0000 mon.a (mon.0) 14395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:41.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:41 smithi179 bash[23186]: audit 2024-09-21T05:13:40.828573+0000 mon.a (mon.0) 14396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:13:41.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:41 smithi179 bash[23186]: audit 2024-09-21T05:13:40.830125+0000 mgr.a (mgr.14388) 18146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:13:41.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:41 smithi049 bash[23528]: cluster 2024-09-21T05:13:40.302455+0000 mgr.a (mgr.14388) 18145 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:41.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:41 smithi049 bash[23528]: audit 2024-09-21T05:13:40.805157+0000 mon.a (mon.0) 14392 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:13:41.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:41 smithi049 bash[23528]: audit 2024-09-21T05:13:40.809012+0000 mon.a (mon.0) 14393 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:13:41.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:41 smithi049 bash[23528]: audit 2024-09-21T05:13:40.810679+0000 mon.a (mon.0) 14394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:13:41.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:41 smithi049 bash[23528]: audit 2024-09-21T05:13:40.822528+0000 mon.a (mon.0) 14395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:41.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:41 smithi049 bash[23528]: audit 2024-09-21T05:13:40.828573+0000 mon.a (mon.0) 14396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:13:41.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:41 smithi049 bash[23528]: audit 2024-09-21T05:13:40.830125+0000 mgr.a (mgr.14388) 18146 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:13:42.039 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:42.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:42.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:42.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:42.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:42 smithi044 bash[22676]: audit 2024-09-21T05:13:40.983157+0000 mgr.a (mgr.14388) 18147 : audit [DBG] from='client.390210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:42 smithi044 bash[22676]: audit 2024-09-21T05:13:41.602830+0000 mgr.a (mgr.14388) 18148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:13:42.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:42 smithi044 bash[22676]: cephadm 2024-09-21T05:13:41.620333+0000 mgr.a (mgr.14388) 18149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:13:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:42 smithi179 bash[23186]: audit 2024-09-21T05:13:40.983157+0000 mgr.a (mgr.14388) 18147 : audit [DBG] from='client.390210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:42 smithi179 bash[23186]: audit 2024-09-21T05:13:41.602830+0000 mgr.a (mgr.14388) 18148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:13:42.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:42 smithi179 bash[23186]: cephadm 2024-09-21T05:13:41.620333+0000 mgr.a (mgr.14388) 18149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:13:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:42 smithi049 bash[23528]: audit 2024-09-21T05:13:40.983157+0000 mgr.a (mgr.14388) 18147 : audit [DBG] from='client.390210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:42 smithi049 bash[23528]: audit 2024-09-21T05:13:41.602830+0000 mgr.a (mgr.14388) 18148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:13:42.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:42 smithi049 bash[23528]: cephadm 2024-09-21T05:13:41.620333+0000 mgr.a (mgr.14388) 18149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:13:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:43 smithi044 bash[22676]: cluster 2024-09-21T05:13:42.303314+0000 mgr.a (mgr.14388) 18150 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:43 smithi179 bash[23186]: cluster 2024-09-21T05:13:42.303314+0000 mgr.a (mgr.14388) 18150 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:43 smithi049 bash[23528]: cluster 2024-09-21T05:13:42.303314+0000 mgr.a (mgr.14388) 18150 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:13:45.449 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:45 smithi044 bash[22676]: audit 2024-09-21T05:13:44.109782+0000 mon.a (mon.0) 14397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.449 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:45 smithi044 bash[22676]: audit 2024-09-21T05:13:44.117459+0000 mon.a (mon.0) 14398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.449 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:45 smithi044 bash[22676]: audit 2024-09-21T05:13:44.128887+0000 mon.a (mon.0) 14399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.449 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:45 smithi044 bash[22676]: cluster 2024-09-21T05:13:44.304105+0000 mgr.a (mgr.14388) 18151 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:13:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:45 smithi179 bash[23186]: audit 2024-09-21T05:13:44.109782+0000 mon.a (mon.0) 14397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:45 smithi179 bash[23186]: audit 2024-09-21T05:13:44.117459+0000 mon.a (mon.0) 14398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:45 smithi179 bash[23186]: audit 2024-09-21T05:13:44.128887+0000 mon.a (mon.0) 14399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:45 smithi179 bash[23186]: cluster 2024-09-21T05:13:44.304105+0000 mgr.a (mgr.14388) 18151 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:13:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:45 smithi049 bash[23528]: audit 2024-09-21T05:13:44.109782+0000 mon.a (mon.0) 14397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:45 smithi049 bash[23528]: audit 2024-09-21T05:13:44.117459+0000 mon.a (mon.0) 14398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:45 smithi049 bash[23528]: audit 2024-09-21T05:13:44.128887+0000 mon.a (mon.0) 14399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:45 smithi049 bash[23528]: cluster 2024-09-21T05:13:44.304105+0000 mgr.a (mgr.14388) 18151 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:13:47.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:47.041 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:47.628 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:47 smithi044 bash[22676]: cluster 2024-09-21T05:13:46.306321+0000 mgr.a (mgr.14388) 18152 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:47 smithi179 bash[23186]: cluster 2024-09-21T05:13:46.306321+0000 mgr.a (mgr.14388) 18152 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:47.790 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:47 smithi049 bash[23528]: cluster 2024-09-21T05:13:46.306321+0000 mgr.a (mgr.14388) 18152 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:48.629 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:48 smithi049 bash[23528]: audit 2024-09-21T05:13:47.365613+0000 mgr.a (mgr.14388) 18153 : audit [DBG] from='client.390393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:48 smithi044 bash[22676]: audit 2024-09-21T05:13:47.365613+0000 mgr.a (mgr.14388) 18153 : audit [DBG] from='client.390393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:48 smithi179 bash[23186]: audit 2024-09-21T05:13:47.365613+0000 mgr.a (mgr.14388) 18153 : audit [DBG] from='client.390393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:49 smithi044 bash[22676]: cluster 2024-09-21T05:13:48.307137+0000 mgr.a (mgr.14388) 18154 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:49 smithi179 bash[23186]: cluster 2024-09-21T05:13:48.307137+0000 mgr.a (mgr.14388) 18154 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:49 smithi049 bash[23528]: cluster 2024-09-21T05:13:48.307137+0000 mgr.a (mgr.14388) 18154 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:51 smithi044 bash[22676]: cluster 2024-09-21T05:13:50.309362+0000 mgr.a (mgr.14388) 18155 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:51 smithi179 bash[23186]: cluster 2024-09-21T05:13:50.309362+0000 mgr.a (mgr.14388) 18155 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:51.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:51 smithi049 bash[23528]: cluster 2024-09-21T05:13:50.309362+0000 mgr.a (mgr.14388) 18155 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:52.792 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:52.793 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:52.793 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:53.570 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:53.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:53.570 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:53.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:53.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:53 smithi044 bash[22676]: cluster 2024-09-21T05:13:52.310120+0000 mgr.a (mgr.14388) 18156 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:53 smithi179 bash[23186]: cluster 2024-09-21T05:13:52.310120+0000 mgr.a (mgr.14388) 18156 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:53 smithi049 bash[23528]: cluster 2024-09-21T05:13:52.310120+0000 mgr.a (mgr.14388) 18156 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:54 smithi044 bash[22676]: audit 2024-09-21T05:13:53.128278+0000 mgr.a (mgr.14388) 18157 : audit [DBG] from='client.390468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:54 smithi044 bash[22676]: audit 2024-09-21T05:13:54.266799+0000 mon.a (mon.0) 14400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:54 smithi044 bash[22676]: audit 2024-09-21T05:13:54.272662+0000 mon.a (mon.0) 14401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:54 smithi044 bash[22676]: audit 2024-09-21T05:13:54.282718+0000 mon.a (mon.0) 14402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:54 smithi179 bash[23186]: audit 2024-09-21T05:13:53.128278+0000 mgr.a (mgr.14388) 18157 : audit [DBG] from='client.390468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:54 smithi179 bash[23186]: audit 2024-09-21T05:13:54.266799+0000 mon.a (mon.0) 14400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:54 smithi179 bash[23186]: audit 2024-09-21T05:13:54.272662+0000 mon.a (mon.0) 14401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:54 smithi179 bash[23186]: audit 2024-09-21T05:13:54.282718+0000 mon.a (mon.0) 14402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:54 smithi049 bash[23528]: audit 2024-09-21T05:13:53.128278+0000 mgr.a (mgr.14388) 18157 : audit [DBG] from='client.390468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:13:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:54 smithi049 bash[23528]: audit 2024-09-21T05:13:54.266799+0000 mon.a (mon.0) 14400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:54 smithi049 bash[23528]: audit 2024-09-21T05:13:54.272662+0000 mon.a (mon.0) 14401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:54 smithi049 bash[23528]: audit 2024-09-21T05:13:54.282718+0000 mon.a (mon.0) 14402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:55 smithi044 bash[22676]: cluster 2024-09-21T05:13:54.310880+0000 mgr.a (mgr.14388) 18158 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:55 smithi044 bash[22676]: audit 2024-09-21T05:13:54.404004+0000 mon.a (mon.0) 14403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:55 smithi044 bash[22676]: audit 2024-09-21T05:13:54.411299+0000 mon.a (mon.0) 14404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:55 smithi044 bash[22676]: audit 2024-09-21T05:13:54.421135+0000 mon.a (mon.0) 14405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:55 smithi179 bash[23186]: cluster 2024-09-21T05:13:54.310880+0000 mgr.a (mgr.14388) 18158 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:55 smithi179 bash[23186]: audit 2024-09-21T05:13:54.404004+0000 mon.a (mon.0) 14403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:55 smithi179 bash[23186]: audit 2024-09-21T05:13:54.411299+0000 mon.a (mon.0) 14404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:55 smithi179 bash[23186]: audit 2024-09-21T05:13:54.421135+0000 mon.a (mon.0) 14405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:55 smithi049 bash[23528]: cluster 2024-09-21T05:13:54.310880+0000 mgr.a (mgr.14388) 18158 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:55 smithi049 bash[23528]: audit 2024-09-21T05:13:54.404004+0000 mon.a (mon.0) 14403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:55 smithi049 bash[23528]: audit 2024-09-21T05:13:54.411299+0000 mon.a (mon.0) 14404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:55.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:55 smithi049 bash[23528]: audit 2024-09-21T05:13:54.421135+0000 mon.a (mon.0) 14405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:13:57.686 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:57 smithi179 bash[23186]: cluster 2024-09-21T05:13:56.313103+0000 mgr.a (mgr.14388) 18159 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:57 smithi044 bash[22676]: cluster 2024-09-21T05:13:56.313103+0000 mgr.a (mgr.14388) 18159 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:57 smithi049 bash[23528]: cluster 2024-09-21T05:13:56.313103+0000 mgr.a (mgr.14388) 18159 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:13:58.571 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:13:58.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:13:58.572 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:13:59.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:13:59.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:13:59.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:13:59.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:13:59.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:13:59.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:13:59 smithi044 bash[22676]: cluster 2024-09-21T05:13:58.313857+0000 mgr.a (mgr.14388) 18160 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:13:59 smithi179 bash[23186]: cluster 2024-09-21T05:13:58.313857+0000 mgr.a (mgr.14388) 18160 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:13:59.807 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:13:59 smithi049 bash[23528]: cluster 2024-09-21T05:13:58.313857+0000 mgr.a (mgr.14388) 18160 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:00 smithi044 bash[22676]: audit 2024-09-21T05:13:58.904937+0000 mgr.a (mgr.14388) 18161 : audit [DBG] from='client.390546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:00.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:00 smithi179 bash[23186]: audit 2024-09-21T05:13:58.904937+0000 mgr.a (mgr.14388) 18161 : audit [DBG] from='client.390546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:00 smithi049 bash[23528]: audit 2024-09-21T05:13:58.904937+0000 mgr.a (mgr.14388) 18161 : audit [DBG] from='client.390546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:01.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:01 smithi044 bash[22676]: cluster 2024-09-21T05:14:00.316091+0000 mgr.a (mgr.14388) 18162 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:01.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:01 smithi179 bash[23186]: cluster 2024-09-21T05:14:00.316091+0000 mgr.a (mgr.14388) 18162 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:01.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:01 smithi049 bash[23528]: cluster 2024-09-21T05:14:00.316091+0000 mgr.a (mgr.14388) 18162 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:03 smithi044 bash[22676]: cluster 2024-09-21T05:14:02.316860+0000 mgr.a (mgr.14388) 18163 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:03 smithi179 bash[23186]: cluster 2024-09-21T05:14:02.316860+0000 mgr.a (mgr.14388) 18163 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:03 smithi049 bash[23528]: cluster 2024-09-21T05:14:02.316860+0000 mgr.a (mgr.14388) 18163 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:04.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:04.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:04.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:05.088 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:05.579 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:05 smithi044 bash[22676]: cluster 2024-09-21T05:14:04.317490+0000 mgr.a (mgr.14388) 18164 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:05.580 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:05 smithi044 bash[22676]: audit 2024-09-21T05:14:04.331895+0000 mon.a (mon.0) 14406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.580 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:05 smithi044 bash[22676]: audit 2024-09-21T05:14:04.340241+0000 mon.a (mon.0) 14407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.580 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:05 smithi044 bash[22676]: audit 2024-09-21T05:14:04.350177+0000 mon.a (mon.0) 14408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.580 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:05 smithi044 bash[22676]: audit 2024-09-21T05:14:04.655449+0000 mgr.a (mgr.14388) 18165 : audit [DBG] from='client.390621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:05 smithi179 bash[23186]: cluster 2024-09-21T05:14:04.317490+0000 mgr.a (mgr.14388) 18164 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:05.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:05 smithi179 bash[23186]: audit 2024-09-21T05:14:04.331895+0000 mon.a (mon.0) 14406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:05 smithi179 bash[23186]: audit 2024-09-21T05:14:04.340241+0000 mon.a (mon.0) 14407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:05 smithi179 bash[23186]: audit 2024-09-21T05:14:04.350177+0000 mon.a (mon.0) 14408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:05 smithi179 bash[23186]: audit 2024-09-21T05:14:04.655449+0000 mgr.a (mgr.14388) 18165 : audit [DBG] from='client.390621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:05 smithi049 bash[23528]: cluster 2024-09-21T05:14:04.317490+0000 mgr.a (mgr.14388) 18164 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:05 smithi049 bash[23528]: audit 2024-09-21T05:14:04.331895+0000 mon.a (mon.0) 14406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:05 smithi049 bash[23528]: audit 2024-09-21T05:14:04.340241+0000 mon.a (mon.0) 14407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:05 smithi049 bash[23528]: audit 2024-09-21T05:14:04.350177+0000 mon.a (mon.0) 14408 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:05 smithi049 bash[23528]: audit 2024-09-21T05:14:04.655449+0000 mgr.a (mgr.14388) 18165 : audit [DBG] from='client.390621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:07 smithi044 bash[22676]: cluster 2024-09-21T05:14:06.319946+0000 mgr.a (mgr.14388) 18166 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:07 smithi179 bash[23186]: cluster 2024-09-21T05:14:06.319946+0000 mgr.a (mgr.14388) 18166 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:07 smithi049 bash[23528]: cluster 2024-09-21T05:14:06.319946+0000 mgr.a (mgr.14388) 18166 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:09 smithi044 bash[22676]: cluster 2024-09-21T05:14:08.320786+0000 mgr.a (mgr.14388) 18167 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:09 smithi179 bash[23186]: cluster 2024-09-21T05:14:08.320786+0000 mgr.a (mgr.14388) 18167 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:09 smithi049 bash[23528]: cluster 2024-09-21T05:14:08.320786+0000 mgr.a (mgr.14388) 18167 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:10.089 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:10.090 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:10.091 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:10.883 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:10.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:10.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:10.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:10.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:11 smithi044 bash[22676]: cluster 2024-09-21T05:14:10.322729+0000 mgr.a (mgr.14388) 18168 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:11 smithi044 bash[22676]: audit 2024-09-21T05:14:10.425698+0000 mgr.a (mgr.14388) 18169 : audit [DBG] from='client.390699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:11 smithi179 bash[23186]: cluster 2024-09-21T05:14:10.322729+0000 mgr.a (mgr.14388) 18168 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:11 smithi179 bash[23186]: audit 2024-09-21T05:14:10.425698+0000 mgr.a (mgr.14388) 18169 : audit [DBG] from='client.390699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:11 smithi049 bash[23528]: cluster 2024-09-21T05:14:10.322729+0000 mgr.a (mgr.14388) 18168 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:11 smithi049 bash[23528]: audit 2024-09-21T05:14:10.425698+0000 mgr.a (mgr.14388) 18169 : audit [DBG] from='client.390699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:13 smithi044 bash[22676]: cluster 2024-09-21T05:14:12.323719+0000 mgr.a (mgr.14388) 18170 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:14:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:13 smithi179 bash[23186]: cluster 2024-09-21T05:14:12.323719+0000 mgr.a (mgr.14388) 18170 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:14:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:13 smithi049 bash[23528]: cluster 2024-09-21T05:14:12.323719+0000 mgr.a (mgr.14388) 18170 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:14:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:15 smithi044 bash[22676]: cluster 2024-09-21T05:14:14.324527+0000 mgr.a (mgr.14388) 18171 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:14:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:15 smithi044 bash[22676]: audit 2024-09-21T05:14:14.481116+0000 mon.a (mon.0) 14409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:15 smithi044 bash[22676]: audit 2024-09-21T05:14:14.487103+0000 mon.a (mon.0) 14410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:15 smithi044 bash[22676]: audit 2024-09-21T05:14:14.494802+0000 mon.a (mon.0) 14411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:15 smithi044 bash[22676]: audit 2024-09-21T05:14:14.634257+0000 mon.a (mon.0) 14412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:15 smithi044 bash[22676]: audit 2024-09-21T05:14:14.642303+0000 mon.a (mon.0) 14413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:15 smithi044 bash[22676]: audit 2024-09-21T05:14:14.652730+0000 mon.a (mon.0) 14414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:15 smithi179 bash[23186]: cluster 2024-09-21T05:14:14.324527+0000 mgr.a (mgr.14388) 18171 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:14:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:15 smithi179 bash[23186]: audit 2024-09-21T05:14:14.481116+0000 mon.a (mon.0) 14409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:15 smithi179 bash[23186]: audit 2024-09-21T05:14:14.487103+0000 mon.a (mon.0) 14410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:15 smithi179 bash[23186]: audit 2024-09-21T05:14:14.494802+0000 mon.a (mon.0) 14411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:15 smithi179 bash[23186]: audit 2024-09-21T05:14:14.634257+0000 mon.a (mon.0) 14412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:15 smithi179 bash[23186]: audit 2024-09-21T05:14:14.642303+0000 mon.a (mon.0) 14413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:15 smithi179 bash[23186]: audit 2024-09-21T05:14:14.652730+0000 mon.a (mon.0) 14414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:15 smithi049 bash[23528]: cluster 2024-09-21T05:14:14.324527+0000 mgr.a (mgr.14388) 18171 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:14:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:15 smithi049 bash[23528]: audit 2024-09-21T05:14:14.481116+0000 mon.a (mon.0) 14409 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:15 smithi049 bash[23528]: audit 2024-09-21T05:14:14.487103+0000 mon.a (mon.0) 14410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:15 smithi049 bash[23528]: audit 2024-09-21T05:14:14.494802+0000 mon.a (mon.0) 14411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:15 smithi049 bash[23528]: audit 2024-09-21T05:14:14.634257+0000 mon.a (mon.0) 14412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:15 smithi049 bash[23528]: audit 2024-09-21T05:14:14.642303+0000 mon.a (mon.0) 14413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:15 smithi049 bash[23528]: audit 2024-09-21T05:14:14.652730+0000 mon.a (mon.0) 14414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:15.886 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:16.625 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:16.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:16.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:16.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:16.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:17 smithi044 bash[22676]: audit 2024-09-21T05:14:16.211141+0000 mgr.a (mgr.14388) 18172 : audit [DBG] from='client.390777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:17 smithi044 bash[22676]: cluster 2024-09-21T05:14:16.336060+0000 mgr.a (mgr.14388) 18173 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:17 smithi179 bash[23186]: audit 2024-09-21T05:14:16.211141+0000 mgr.a (mgr.14388) 18172 : audit [DBG] from='client.390777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:17 smithi179 bash[23186]: cluster 2024-09-21T05:14:16.336060+0000 mgr.a (mgr.14388) 18173 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:17 smithi049 bash[23528]: audit 2024-09-21T05:14:16.211141+0000 mgr.a (mgr.14388) 18172 : audit [DBG] from='client.390777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:17.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:17 smithi049 bash[23528]: cluster 2024-09-21T05:14:16.336060+0000 mgr.a (mgr.14388) 18173 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:19 smithi179 bash[23186]: cluster 2024-09-21T05:14:18.337044+0000 mgr.a (mgr.14388) 18174 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:14:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:19 smithi049 bash[23528]: cluster 2024-09-21T05:14:18.337044+0000 mgr.a (mgr.14388) 18174 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:14:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:19 smithi044 bash[22676]: cluster 2024-09-21T05:14:18.337044+0000 mgr.a (mgr.14388) 18174 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:14:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:21.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:21 smithi179 bash[23186]: cluster 2024-09-21T05:14:20.339210+0000 mgr.a (mgr.14388) 18175 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:21 smithi049 bash[23528]: cluster 2024-09-21T05:14:20.339210+0000 mgr.a (mgr.14388) 18175 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:21 smithi044 bash[22676]: cluster 2024-09-21T05:14:20.339210+0000 mgr.a (mgr.14388) 18175 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:22.385 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:23 smithi179 bash[23186]: audit 2024-09-21T05:14:21.954950+0000 mgr.a (mgr.14388) 18176 : audit [DBG] from='client.390855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:23.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:23 smithi179 bash[23186]: cluster 2024-09-21T05:14:22.339739+0000 mgr.a (mgr.14388) 18177 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:23 smithi049 bash[23528]: audit 2024-09-21T05:14:21.954950+0000 mgr.a (mgr.14388) 18176 : audit [DBG] from='client.390855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:23.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:23 smithi049 bash[23528]: cluster 2024-09-21T05:14:22.339739+0000 mgr.a (mgr.14388) 18177 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:23 smithi044 bash[22676]: audit 2024-09-21T05:14:21.954950+0000 mgr.a (mgr.14388) 18176 : audit [DBG] from='client.390855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:23 smithi044 bash[22676]: cluster 2024-09-21T05:14:22.339739+0000 mgr.a (mgr.14388) 18177 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:25 smithi044 bash[22676]: cluster 2024-09-21T05:14:24.340507+0000 mgr.a (mgr.14388) 18178 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:25 smithi044 bash[22676]: audit 2024-09-21T05:14:24.533639+0000 mon.a (mon.0) 14415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:25 smithi044 bash[22676]: audit 2024-09-21T05:14:24.542409+0000 mon.a (mon.0) 14416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:25.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:25 smithi044 bash[22676]: audit 2024-09-21T05:14:24.552426+0000 mon.a (mon.0) 14417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:25.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:25 smithi049 bash[23528]: cluster 2024-09-21T05:14:24.340507+0000 mgr.a (mgr.14388) 18178 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:25.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:25 smithi049 bash[23528]: audit 2024-09-21T05:14:24.533639+0000 mon.a (mon.0) 14415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:25.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:25 smithi049 bash[23528]: audit 2024-09-21T05:14:24.542409+0000 mon.a (mon.0) 14416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:25.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:25 smithi049 bash[23528]: audit 2024-09-21T05:14:24.552426+0000 mon.a (mon.0) 14417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:25 smithi179 bash[23186]: cluster 2024-09-21T05:14:24.340507+0000 mgr.a (mgr.14388) 18178 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:25 smithi179 bash[23186]: audit 2024-09-21T05:14:24.533639+0000 mon.a (mon.0) 14415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:25 smithi179 bash[23186]: audit 2024-09-21T05:14:24.542409+0000 mon.a (mon.0) 14416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:26.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:25 smithi179 bash[23186]: audit 2024-09-21T05:14:24.552426+0000 mon.a (mon.0) 14417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:27.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:27.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:27.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:27 smithi049 bash[23528]: cluster 2024-09-21T05:14:26.342057+0000 mgr.a (mgr.14388) 18179 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:27.886 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:27 smithi044 bash[22676]: cluster 2024-09-21T05:14:26.342057+0000 mgr.a (mgr.14388) 18179 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:27 smithi179 bash[23186]: cluster 2024-09-21T05:14:26.342057+0000 mgr.a (mgr.14388) 18179 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:28.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:28.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:28.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:28.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:28.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:28 smithi049 bash[23528]: audit 2024-09-21T05:14:27.713991+0000 mgr.a (mgr.14388) 18180 : audit [DBG] from='client.390933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:28 smithi044 bash[22676]: audit 2024-09-21T05:14:27.713991+0000 mgr.a (mgr.14388) 18180 : audit [DBG] from='client.390933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:29.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:28 smithi179 bash[23186]: audit 2024-09-21T05:14:27.713991+0000 mgr.a (mgr.14388) 18180 : audit [DBG] from='client.390933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:29 smithi049 bash[23528]: cluster 2024-09-21T05:14:28.342980+0000 mgr.a (mgr.14388) 18181 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:29 smithi044 bash[22676]: cluster 2024-09-21T05:14:28.342980+0000 mgr.a (mgr.14388) 18181 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:29 smithi179 bash[23186]: cluster 2024-09-21T05:14:28.342980+0000 mgr.a (mgr.14388) 18181 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:31 smithi049 bash[23528]: cluster 2024-09-21T05:14:30.345198+0000 mgr.a (mgr.14388) 18182 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:31 smithi044 bash[22676]: cluster 2024-09-21T05:14:30.345198+0000 mgr.a (mgr.14388) 18182 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:31 smithi179 bash[23186]: cluster 2024-09-21T05:14:30.345198+0000 mgr.a (mgr.14388) 18182 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:33.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:33.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:33.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:33.951 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:33.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:33 smithi044 bash[22676]: cluster 2024-09-21T05:14:32.346035+0000 mgr.a (mgr.14388) 18183 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:33 smithi179 bash[23186]: cluster 2024-09-21T05:14:32.346035+0000 mgr.a (mgr.14388) 18183 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:33 smithi049 bash[23528]: cluster 2024-09-21T05:14:32.346035+0000 mgr.a (mgr.14388) 18183 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:34.899 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:34 smithi044 bash[22676]: audit 2024-09-21T05:14:33.509947+0000 mgr.a (mgr.14388) 18184 : audit [DBG] from='client.391008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:34 smithi179 bash[23186]: audit 2024-09-21T05:14:33.509947+0000 mgr.a (mgr.14388) 18184 : audit [DBG] from='client.391008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:34 smithi049 bash[23528]: audit 2024-09-21T05:14:33.509947+0000 mgr.a (mgr.14388) 18184 : audit [DBG] from='client.391008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:35 smithi044 bash[22676]: cluster 2024-09-21T05:14:34.346981+0000 mgr.a (mgr.14388) 18185 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:35 smithi044 bash[22676]: audit 2024-09-21T05:14:34.690391+0000 mon.a (mon.0) 14418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:35 smithi044 bash[22676]: audit 2024-09-21T05:14:34.701016+0000 mon.a (mon.0) 14419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:35 smithi044 bash[22676]: audit 2024-09-21T05:14:34.713037+0000 mon.a (mon.0) 14420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:35 smithi044 bash[22676]: audit 2024-09-21T05:14:34.876734+0000 mon.a (mon.0) 14421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:35 smithi044 bash[22676]: audit 2024-09-21T05:14:34.884946+0000 mon.a (mon.0) 14422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:35.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:35 smithi044 bash[22676]: audit 2024-09-21T05:14:34.895007+0000 mon.a (mon.0) 14423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:35 smithi179 bash[23186]: cluster 2024-09-21T05:14:34.346981+0000 mgr.a (mgr.14388) 18185 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:35 smithi179 bash[23186]: audit 2024-09-21T05:14:34.690391+0000 mon.a (mon.0) 14418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:35 smithi179 bash[23186]: audit 2024-09-21T05:14:34.701016+0000 mon.a (mon.0) 14419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:35 smithi179 bash[23186]: audit 2024-09-21T05:14:34.713037+0000 mon.a (mon.0) 14420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:35 smithi179 bash[23186]: audit 2024-09-21T05:14:34.876734+0000 mon.a (mon.0) 14421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:35 smithi179 bash[23186]: audit 2024-09-21T05:14:34.884946+0000 mon.a (mon.0) 14422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:35 smithi179 bash[23186]: audit 2024-09-21T05:14:34.895007+0000 mon.a (mon.0) 14423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:35 smithi049 bash[23528]: cluster 2024-09-21T05:14:34.346981+0000 mgr.a (mgr.14388) 18185 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:35 smithi049 bash[23528]: audit 2024-09-21T05:14:34.690391+0000 mon.a (mon.0) 14418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:35 smithi049 bash[23528]: audit 2024-09-21T05:14:34.701016+0000 mon.a (mon.0) 14419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:35 smithi049 bash[23528]: audit 2024-09-21T05:14:34.713037+0000 mon.a (mon.0) 14420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:35 smithi049 bash[23528]: audit 2024-09-21T05:14:34.876734+0000 mon.a (mon.0) 14421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:35 smithi049 bash[23528]: audit 2024-09-21T05:14:34.884946+0000 mon.a (mon.0) 14422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:35 smithi049 bash[23528]: audit 2024-09-21T05:14:34.895007+0000 mon.a (mon.0) 14423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:37 smithi044 bash[22676]: cluster 2024-09-21T05:14:36.349230+0000 mgr.a (mgr.14388) 18186 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:37 smithi179 bash[23186]: cluster 2024-09-21T05:14:36.349230+0000 mgr.a (mgr.14388) 18186 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:37 smithi049 bash[23528]: cluster 2024-09-21T05:14:36.349230+0000 mgr.a (mgr.14388) 18186 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:38.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:38.953 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:38.953 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:39.734 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:39.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:39.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:39.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:39.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:39 smithi044 bash[22676]: cluster 2024-09-21T05:14:38.350047+0000 mgr.a (mgr.14388) 18187 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:39 smithi179 bash[23186]: cluster 2024-09-21T05:14:38.350047+0000 mgr.a (mgr.14388) 18187 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:39 smithi049 bash[23528]: cluster 2024-09-21T05:14:38.350047+0000 mgr.a (mgr.14388) 18187 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:40 smithi044 bash[22676]: audit 2024-09-21T05:14:39.287536+0000 mgr.a (mgr.14388) 18188 : audit [DBG] from='client.391086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:40 smithi179 bash[23186]: audit 2024-09-21T05:14:39.287536+0000 mgr.a (mgr.14388) 18188 : audit [DBG] from='client.391086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:40 smithi049 bash[23528]: audit 2024-09-21T05:14:39.287536+0000 mgr.a (mgr.14388) 18188 : audit [DBG] from='client.391086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:41 smithi044 bash[22676]: cluster 2024-09-21T05:14:40.352387+0000 mgr.a (mgr.14388) 18189 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:41 smithi044 bash[22676]: audit 2024-09-21T05:14:41.690161+0000 mon.a (mon.0) 14424 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:14:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:41 smithi044 bash[22676]: audit 2024-09-21T05:14:41.697401+0000 mon.a (mon.0) 14425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:41 smithi044 bash[22676]: audit 2024-09-21T05:14:41.699205+0000 mon.a (mon.0) 14426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:14:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:41 smithi179 bash[23186]: cluster 2024-09-21T05:14:40.352387+0000 mgr.a (mgr.14388) 18189 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:41 smithi179 bash[23186]: audit 2024-09-21T05:14:41.690161+0000 mon.a (mon.0) 14424 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:14:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:41 smithi179 bash[23186]: audit 2024-09-21T05:14:41.697401+0000 mon.a (mon.0) 14425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:42.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:41 smithi179 bash[23186]: audit 2024-09-21T05:14:41.699205+0000 mon.a (mon.0) 14426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:14:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:41 smithi049 bash[23528]: cluster 2024-09-21T05:14:40.352387+0000 mgr.a (mgr.14388) 18189 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:14:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:41 smithi049 bash[23528]: audit 2024-09-21T05:14:41.690161+0000 mon.a (mon.0) 14424 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:14:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:41 smithi049 bash[23528]: audit 2024-09-21T05:14:41.697401+0000 mon.a (mon.0) 14425 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:41 smithi049 bash[23528]: audit 2024-09-21T05:14:41.699205+0000 mon.a (mon.0) 14426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:14:42.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:14:42 smithi044 bash[22930]: debug 2024-09-21T05:14:42.523+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:14:42.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:14:42 smithi044 bash[22930]: debug 2024-09-21T05:14:42.523+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:14:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:42 smithi044 bash[22676]: audit 2024-09-21T05:14:41.710548+0000 mon.a (mon.0) 14427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:42 smithi044 bash[22676]: audit 2024-09-21T05:14:41.719885+0000 mon.a (mon.0) 14428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:14:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:42 smithi044 bash[22676]: audit 2024-09-21T05:14:41.722309+0000 mgr.a (mgr.14388) 18190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:14:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:42 smithi179 bash[23186]: audit 2024-09-21T05:14:41.710548+0000 mon.a (mon.0) 14427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:42 smithi179 bash[23186]: audit 2024-09-21T05:14:41.719885+0000 mon.a (mon.0) 14428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:14:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:42 smithi179 bash[23186]: audit 2024-09-21T05:14:41.722309+0000 mgr.a (mgr.14388) 18190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:14:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:42 smithi049 bash[23528]: audit 2024-09-21T05:14:41.710548+0000 mon.a (mon.0) 14427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:42 smithi049 bash[23528]: audit 2024-09-21T05:14:41.719885+0000 mon.a (mon.0) 14428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:14:43.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:42 smithi049 bash[23528]: audit 2024-09-21T05:14:41.722309+0000 mgr.a (mgr.14388) 18190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:14:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:43 smithi044 bash[22676]: cluster 2024-09-21T05:14:42.353008+0000 mgr.a (mgr.14388) 18191 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:43 smithi044 bash[22676]: audit 2024-09-21T05:14:42.525611+0000 mgr.a (mgr.14388) 18192 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:14:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:43 smithi044 bash[22676]: cephadm 2024-09-21T05:14:42.526969+0000 mgr.a (mgr.14388) 18193 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:14:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:43 smithi179 bash[23186]: cluster 2024-09-21T05:14:42.353008+0000 mgr.a (mgr.14388) 18191 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:43 smithi179 bash[23186]: audit 2024-09-21T05:14:42.525611+0000 mgr.a (mgr.14388) 18192 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:14:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:43 smithi179 bash[23186]: cephadm 2024-09-21T05:14:42.526969+0000 mgr.a (mgr.14388) 18193 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:14:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:43 smithi049 bash[23528]: cluster 2024-09-21T05:14:42.353008+0000 mgr.a (mgr.14388) 18191 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:43 smithi049 bash[23528]: audit 2024-09-21T05:14:42.525611+0000 mgr.a (mgr.14388) 18192 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:14:44.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:43 smithi049 bash[23528]: cephadm 2024-09-21T05:14:42.526969+0000 mgr.a (mgr.14388) 18193 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:14:44.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:44.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:44.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:45.533 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:45.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:45.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:45.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:45.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:45 smithi044 bash[22676]: cluster 2024-09-21T05:14:44.353779+0000 mgr.a (mgr.14388) 18194 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:45 smithi044 bash[22676]: audit 2024-09-21T05:14:44.762915+0000 mon.a (mon.0) 14429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:45 smithi044 bash[22676]: audit 2024-09-21T05:14:44.771522+0000 mon.a (mon.0) 14430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:45 smithi044 bash[22676]: audit 2024-09-21T05:14:44.779390+0000 mon.a (mon.0) 14431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:45 smithi049 bash[23528]: cluster 2024-09-21T05:14:44.353779+0000 mgr.a (mgr.14388) 18194 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:45 smithi049 bash[23528]: audit 2024-09-21T05:14:44.762915+0000 mon.a (mon.0) 14429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:45 smithi049 bash[23528]: audit 2024-09-21T05:14:44.771522+0000 mon.a (mon.0) 14430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:45 smithi049 bash[23528]: audit 2024-09-21T05:14:44.779390+0000 mon.a (mon.0) 14431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:45 smithi179 bash[23186]: cluster 2024-09-21T05:14:44.353779+0000 mgr.a (mgr.14388) 18194 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:14:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:45 smithi179 bash[23186]: audit 2024-09-21T05:14:44.762915+0000 mon.a (mon.0) 14429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:45 smithi179 bash[23186]: audit 2024-09-21T05:14:44.771522+0000 mon.a (mon.0) 14430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:46.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:45 smithi179 bash[23186]: audit 2024-09-21T05:14:44.779390+0000 mon.a (mon.0) 14431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:46 smithi044 bash[22676]: audit 2024-09-21T05:14:45.070271+0000 mgr.a (mgr.14388) 18195 : audit [DBG] from='client.391266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:46 smithi049 bash[23528]: audit 2024-09-21T05:14:45.070271+0000 mgr.a (mgr.14388) 18195 : audit [DBG] from='client.391266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:46 smithi179 bash[23186]: audit 2024-09-21T05:14:45.070271+0000 mgr.a (mgr.14388) 18195 : audit [DBG] from='client.391266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:47 smithi044 bash[22676]: cluster 2024-09-21T05:14:46.356728+0000 mgr.a (mgr.14388) 18196 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:47 smithi049 bash[23528]: cluster 2024-09-21T05:14:46.356728+0000 mgr.a (mgr.14388) 18196 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:47 smithi179 bash[23186]: cluster 2024-09-21T05:14:46.356728+0000 mgr.a (mgr.14388) 18196 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:50.042 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:49 smithi049 bash[23528]: cluster 2024-09-21T05:14:48.357420+0000 mgr.a (mgr.14388) 18197 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:49 smithi044 bash[22676]: cluster 2024-09-21T05:14:48.357420+0000 mgr.a (mgr.14388) 18197 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:49 smithi179 bash[23186]: cluster 2024-09-21T05:14:48.357420+0000 mgr.a (mgr.14388) 18197 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:50.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:50.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:50.535 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:51.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:51.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:51.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:51.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:51.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:51 smithi049 bash[23528]: cluster 2024-09-21T05:14:50.359355+0000 mgr.a (mgr.14388) 18198 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:52.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:51 smithi049 bash[23528]: audit 2024-09-21T05:14:50.871653+0000 mgr.a (mgr.14388) 18199 : audit [DBG] from='client.391335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:51 smithi044 bash[22676]: cluster 2024-09-21T05:14:50.359355+0000 mgr.a (mgr.14388) 18198 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:51 smithi044 bash[22676]: audit 2024-09-21T05:14:50.871653+0000 mgr.a (mgr.14388) 18199 : audit [DBG] from='client.391335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:51 smithi179 bash[23186]: cluster 2024-09-21T05:14:50.359355+0000 mgr.a (mgr.14388) 18198 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:51 smithi179 bash[23186]: audit 2024-09-21T05:14:50.871653+0000 mgr.a (mgr.14388) 18199 : audit [DBG] from='client.391335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:53 smithi049 bash[23528]: cluster 2024-09-21T05:14:52.360341+0000 mgr.a (mgr.14388) 18200 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:53 smithi044 bash[22676]: cluster 2024-09-21T05:14:52.360341+0000 mgr.a (mgr.14388) 18200 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:53 smithi179 bash[23186]: cluster 2024-09-21T05:14:52.360341+0000 mgr.a (mgr.14388) 18200 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:55 smithi049 bash[23528]: cluster 2024-09-21T05:14:54.361141+0000 mgr.a (mgr.14388) 18201 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:55 smithi049 bash[23528]: audit 2024-09-21T05:14:54.919548+0000 mon.a (mon.0) 14432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:55 smithi049 bash[23528]: audit 2024-09-21T05:14:54.925500+0000 mon.a (mon.0) 14433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:55 smithi049 bash[23528]: audit 2024-09-21T05:14:54.936629+0000 mon.a (mon.0) 14434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:55 smithi049 bash[23528]: audit 2024-09-21T05:14:55.117411+0000 mon.a (mon.0) 14435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:55 smithi049 bash[23528]: audit 2024-09-21T05:14:55.125451+0000 mon.a (mon.0) 14436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:55 smithi049 bash[23528]: audit 2024-09-21T05:14:55.135710+0000 mon.a (mon.0) 14437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:55 smithi044 bash[22676]: cluster 2024-09-21T05:14:54.361141+0000 mgr.a (mgr.14388) 18201 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:55 smithi044 bash[22676]: audit 2024-09-21T05:14:54.919548+0000 mon.a (mon.0) 14432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:55 smithi044 bash[22676]: audit 2024-09-21T05:14:54.925500+0000 mon.a (mon.0) 14433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:55 smithi044 bash[22676]: audit 2024-09-21T05:14:54.936629+0000 mon.a (mon.0) 14434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:55 smithi044 bash[22676]: audit 2024-09-21T05:14:55.117411+0000 mon.a (mon.0) 14435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:55 smithi044 bash[22676]: audit 2024-09-21T05:14:55.125451+0000 mon.a (mon.0) 14436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:55 smithi044 bash[22676]: audit 2024-09-21T05:14:55.135710+0000 mon.a (mon.0) 14437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:55 smithi179 bash[23186]: cluster 2024-09-21T05:14:54.361141+0000 mgr.a (mgr.14388) 18201 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:14:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:55 smithi179 bash[23186]: audit 2024-09-21T05:14:54.919548+0000 mon.a (mon.0) 14432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:55 smithi179 bash[23186]: audit 2024-09-21T05:14:54.925500+0000 mon.a (mon.0) 14433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:55 smithi179 bash[23186]: audit 2024-09-21T05:14:54.936629+0000 mon.a (mon.0) 14434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:55 smithi179 bash[23186]: audit 2024-09-21T05:14:55.117411+0000 mon.a (mon.0) 14435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:55 smithi179 bash[23186]: audit 2024-09-21T05:14:55.125451+0000 mon.a (mon.0) 14436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:55 smithi179 bash[23186]: audit 2024-09-21T05:14:55.135710+0000 mon.a (mon.0) 14437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:14:56.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:14:56.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:14:56.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:14:57.094 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:14:57.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:14:57.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:14:57.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:14:57.094 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:14:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:57 smithi179 bash[23186]: cluster 2024-09-21T05:14:56.362656+0000 mgr.a (mgr.14388) 18202 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:57 smithi179 bash[23186]: audit 2024-09-21T05:14:56.660679+0000 mgr.a (mgr.14388) 18203 : audit [DBG] from='client.391410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:57 smithi049 bash[23528]: cluster 2024-09-21T05:14:56.362656+0000 mgr.a (mgr.14388) 18202 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:57 smithi049 bash[23528]: audit 2024-09-21T05:14:56.660679+0000 mgr.a (mgr.14388) 18203 : audit [DBG] from='client.391410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:57 smithi044 bash[22676]: cluster 2024-09-21T05:14:56.362656+0000 mgr.a (mgr.14388) 18202 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:14:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:57 smithi044 bash[22676]: audit 2024-09-21T05:14:56.660679+0000 mgr.a (mgr.14388) 18203 : audit [DBG] from='client.391410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:14:59 smithi049 bash[23528]: cluster 2024-09-21T05:14:58.363594+0000 mgr.a (mgr.14388) 18204 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:14:59 smithi044 bash[22676]: cluster 2024-09-21T05:14:58.363594+0000 mgr.a (mgr.14388) 18204 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:14:59 smithi179 bash[23186]: cluster 2024-09-21T05:14:58.363594+0000 mgr.a (mgr.14388) 18204 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:02.095 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:02.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:02.096 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:01 smithi044 bash[22676]: cluster 2024-09-21T05:15:00.365780+0000 mgr.a (mgr.14388) 18205 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:01 smithi179 bash[23186]: cluster 2024-09-21T05:15:00.365780+0000 mgr.a (mgr.14388) 18205 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:01 smithi049 bash[23528]: cluster 2024-09-21T05:15:00.365780+0000 mgr.a (mgr.14388) 18205 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:02.875 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:03 smithi044 bash[22676]: cluster 2024-09-21T05:15:02.366522+0000 mgr.a (mgr.14388) 18206 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:04.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:03 smithi044 bash[22676]: audit 2024-09-21T05:15:02.430048+0000 mgr.a (mgr.14388) 18207 : audit [DBG] from='client.391488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:03 smithi179 bash[23186]: cluster 2024-09-21T05:15:02.366522+0000 mgr.a (mgr.14388) 18206 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:03 smithi179 bash[23186]: audit 2024-09-21T05:15:02.430048+0000 mgr.a (mgr.14388) 18207 : audit [DBG] from='client.391488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:03 smithi049 bash[23528]: cluster 2024-09-21T05:15:02.366522+0000 mgr.a (mgr.14388) 18206 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:03 smithi049 bash[23528]: audit 2024-09-21T05:15:02.430048+0000 mgr.a (mgr.14388) 18207 : audit [DBG] from='client.391488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:06.136 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:05 smithi044 bash[22676]: cluster 2024-09-21T05:15:04.367458+0000 mgr.a (mgr.14388) 18208 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:06.136 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:05 smithi044 bash[22676]: audit 2024-09-21T05:15:04.959956+0000 mon.a (mon.0) 14438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.136 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:05 smithi044 bash[22676]: audit 2024-09-21T05:15:04.969019+0000 mon.a (mon.0) 14439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.136 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:05 smithi044 bash[22676]: audit 2024-09-21T05:15:04.980202+0000 mon.a (mon.0) 14440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:05 smithi179 bash[23186]: cluster 2024-09-21T05:15:04.367458+0000 mgr.a (mgr.14388) 18208 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:06.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:05 smithi179 bash[23186]: audit 2024-09-21T05:15:04.959956+0000 mon.a (mon.0) 14438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:05 smithi179 bash[23186]: audit 2024-09-21T05:15:04.969019+0000 mon.a (mon.0) 14439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:05 smithi179 bash[23186]: audit 2024-09-21T05:15:04.980202+0000 mon.a (mon.0) 14440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:05 smithi049 bash[23528]: cluster 2024-09-21T05:15:04.367458+0000 mgr.a (mgr.14388) 18208 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:05 smithi049 bash[23528]: audit 2024-09-21T05:15:04.959956+0000 mon.a (mon.0) 14438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:05 smithi049 bash[23528]: audit 2024-09-21T05:15:04.969019+0000 mon.a (mon.0) 14439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:06.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:05 smithi049 bash[23528]: audit 2024-09-21T05:15:04.980202+0000 mon.a (mon.0) 14440 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:07.876 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:07.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:07.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:07 smithi044 bash[22676]: cluster 2024-09-21T05:15:06.368688+0000 mgr.a (mgr.14388) 18209 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:07 smithi179 bash[23186]: cluster 2024-09-21T05:15:06.368688+0000 mgr.a (mgr.14388) 18209 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:07 smithi049 bash[23528]: cluster 2024-09-21T05:15:06.368688+0000 mgr.a (mgr.14388) 18209 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:08.644 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:08.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:10.132 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:09 smithi049 bash[23528]: audit 2024-09-21T05:15:08.212492+0000 mgr.a (mgr.14388) 18210 : audit [DBG] from='client.391566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:10.132 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:09 smithi049 bash[23528]: cluster 2024-09-21T05:15:08.369265+0000 mgr.a (mgr.14388) 18211 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:09 smithi044 bash[22676]: audit 2024-09-21T05:15:08.212492+0000 mgr.a (mgr.14388) 18210 : audit [DBG] from='client.391566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:09 smithi044 bash[22676]: cluster 2024-09-21T05:15:08.369265+0000 mgr.a (mgr.14388) 18211 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:09 smithi179 bash[23186]: audit 2024-09-21T05:15:08.212492+0000 mgr.a (mgr.14388) 18210 : audit [DBG] from='client.391566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:09 smithi179 bash[23186]: cluster 2024-09-21T05:15:08.369265+0000 mgr.a (mgr.14388) 18211 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:11 smithi044 bash[22676]: cluster 2024-09-21T05:15:10.371541+0000 mgr.a (mgr.14388) 18212 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:11 smithi179 bash[23186]: cluster 2024-09-21T05:15:10.371541+0000 mgr.a (mgr.14388) 18212 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:12.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:11 smithi049 bash[23528]: cluster 2024-09-21T05:15:10.371541+0000 mgr.a (mgr.14388) 18212 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:13.645 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:13.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:13.646 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:13 smithi044 bash[22676]: cluster 2024-09-21T05:15:12.372317+0000 mgr.a (mgr.14388) 18213 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:13 smithi179 bash[23186]: cluster 2024-09-21T05:15:12.372317+0000 mgr.a (mgr.14388) 18213 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:13 smithi049 bash[23528]: cluster 2024-09-21T05:15:12.372317+0000 mgr.a (mgr.14388) 18213 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:14.442 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:14.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:14.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: audit 2024-09-21T05:15:13.987447+0000 mgr.a (mgr.14388) 18214 : audit [DBG] from='client.391638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: cluster 2024-09-21T05:15:14.373374+0000 mgr.a (mgr.14388) 18215 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: audit 2024-09-21T05:15:15.145467+0000 mon.a (mon.0) 14441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: audit 2024-09-21T05:15:15.152861+0000 mon.a (mon.0) 14442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: audit 2024-09-21T05:15:15.160330+0000 mon.a (mon.0) 14443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: audit 2024-09-21T05:15:15.337543+0000 mon.a (mon.0) 14444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: audit 2024-09-21T05:15:15.344731+0000 mon.a (mon.0) 14445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:15 smithi044 bash[22676]: audit 2024-09-21T05:15:15.353471+0000 mon.a (mon.0) 14446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: audit 2024-09-21T05:15:13.987447+0000 mgr.a (mgr.14388) 18214 : audit [DBG] from='client.391638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: cluster 2024-09-21T05:15:14.373374+0000 mgr.a (mgr.14388) 18215 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:16.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: audit 2024-09-21T05:15:15.145467+0000 mon.a (mon.0) 14441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: audit 2024-09-21T05:15:15.152861+0000 mon.a (mon.0) 14442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: audit 2024-09-21T05:15:15.160330+0000 mon.a (mon.0) 14443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: audit 2024-09-21T05:15:15.337543+0000 mon.a (mon.0) 14444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: audit 2024-09-21T05:15:15.344731+0000 mon.a (mon.0) 14445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:15 smithi179 bash[23186]: audit 2024-09-21T05:15:15.353471+0000 mon.a (mon.0) 14446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: audit 2024-09-21T05:15:13.987447+0000 mgr.a (mgr.14388) 18214 : audit [DBG] from='client.391638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: cluster 2024-09-21T05:15:14.373374+0000 mgr.a (mgr.14388) 18215 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: audit 2024-09-21T05:15:15.145467+0000 mon.a (mon.0) 14441 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: audit 2024-09-21T05:15:15.152861+0000 mon.a (mon.0) 14442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: audit 2024-09-21T05:15:15.160330+0000 mon.a (mon.0) 14443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: audit 2024-09-21T05:15:15.337543+0000 mon.a (mon.0) 14444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: audit 2024-09-21T05:15:15.344731+0000 mon.a (mon.0) 14445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:15 smithi049 bash[23528]: audit 2024-09-21T05:15:15.353471+0000 mon.a (mon.0) 14446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:17 smithi044 bash[22676]: cluster 2024-09-21T05:15:16.375661+0000 mgr.a (mgr.14388) 18216 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:17 smithi179 bash[23186]: cluster 2024-09-21T05:15:16.375661+0000 mgr.a (mgr.14388) 18216 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:17 smithi049 bash[23528]: cluster 2024-09-21T05:15:16.375661+0000 mgr.a (mgr.14388) 18216 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:19.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:19.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:19.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:19 smithi179 bash[23186]: cluster 2024-09-21T05:15:18.376456+0000 mgr.a (mgr.14388) 18217 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:20.206 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:20.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:20.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:20.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:20.207 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:19 smithi044 bash[22676]: cluster 2024-09-21T05:15:18.376456+0000 mgr.a (mgr.14388) 18217 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:19 smithi049 bash[23528]: cluster 2024-09-21T05:15:18.376456+0000 mgr.a (mgr.14388) 18217 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:20 smithi044 bash[22676]: audit 2024-09-21T05:15:19.776990+0000 mgr.a (mgr.14388) 18218 : audit [DBG] from='client.391716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:20 smithi179 bash[23186]: audit 2024-09-21T05:15:19.776990+0000 mgr.a (mgr.14388) 18218 : audit [DBG] from='client.391716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:20 smithi049 bash[23528]: audit 2024-09-21T05:15:19.776990+0000 mgr.a (mgr.14388) 18218 : audit [DBG] from='client.391716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:22.210 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:21 smithi179 bash[23186]: cluster 2024-09-21T05:15:20.378845+0000 mgr.a (mgr.14388) 18219 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:15:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:21 smithi044 bash[22676]: cluster 2024-09-21T05:15:20.378845+0000 mgr.a (mgr.14388) 18219 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:15:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:21 smithi049 bash[23528]: cluster 2024-09-21T05:15:20.378845+0000 mgr.a (mgr.14388) 18219 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:15:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:23 smithi044 bash[22676]: cluster 2024-09-21T05:15:22.379651+0000 mgr.a (mgr.14388) 18220 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:15:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:23 smithi179 bash[23186]: cluster 2024-09-21T05:15:22.379651+0000 mgr.a (mgr.14388) 18220 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:15:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:23 smithi049 bash[23528]: cluster 2024-09-21T05:15:22.379651+0000 mgr.a (mgr.14388) 18220 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:15:25.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:25.209 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:26.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:26.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:26.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:26.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:26.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:25 smithi044 bash[22676]: cluster 2024-09-21T05:15:24.380418+0000 mgr.a (mgr.14388) 18221 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:15:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:25 smithi044 bash[22676]: audit 2024-09-21T05:15:25.197193+0000 mon.a (mon.0) 14447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:25 smithi044 bash[22676]: audit 2024-09-21T05:15:25.205765+0000 mon.a (mon.0) 14448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:25 smithi044 bash[22676]: audit 2024-09-21T05:15:25.215636+0000 mon.a (mon.0) 14449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:25 smithi179 bash[23186]: cluster 2024-09-21T05:15:24.380418+0000 mgr.a (mgr.14388) 18221 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:15:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:25 smithi179 bash[23186]: audit 2024-09-21T05:15:25.197193+0000 mon.a (mon.0) 14447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:25 smithi179 bash[23186]: audit 2024-09-21T05:15:25.205765+0000 mon.a (mon.0) 14448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:25 smithi179 bash[23186]: audit 2024-09-21T05:15:25.215636+0000 mon.a (mon.0) 14449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:25 smithi049 bash[23528]: cluster 2024-09-21T05:15:24.380418+0000 mgr.a (mgr.14388) 18221 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:15:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:25 smithi049 bash[23528]: audit 2024-09-21T05:15:25.197193+0000 mon.a (mon.0) 14447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:25 smithi049 bash[23528]: audit 2024-09-21T05:15:25.205765+0000 mon.a (mon.0) 14448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:25 smithi049 bash[23528]: audit 2024-09-21T05:15:25.215636+0000 mon.a (mon.0) 14449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:26 smithi044 bash[22676]: audit 2024-09-21T05:15:25.547029+0000 mgr.a (mgr.14388) 18222 : audit [DBG] from='client.391791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:26 smithi179 bash[23186]: audit 2024-09-21T05:15:25.547029+0000 mgr.a (mgr.14388) 18222 : audit [DBG] from='client.391791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:26 smithi049 bash[23528]: audit 2024-09-21T05:15:25.547029+0000 mgr.a (mgr.14388) 18222 : audit [DBG] from='client.391791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:28.142 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:27 smithi049 bash[23528]: cluster 2024-09-21T05:15:26.382096+0000 mgr.a (mgr.14388) 18223 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:28.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:27 smithi044 bash[22676]: cluster 2024-09-21T05:15:26.382096+0000 mgr.a (mgr.14388) 18223 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:27 smithi179 bash[23186]: cluster 2024-09-21T05:15:26.382096+0000 mgr.a (mgr.14388) 18223 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:29 smithi044 bash[22676]: cluster 2024-09-21T05:15:28.382851+0000 mgr.a (mgr.14388) 18224 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:15:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:29 smithi179 bash[23186]: cluster 2024-09-21T05:15:28.382851+0000 mgr.a (mgr.14388) 18224 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:15:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:29 smithi049 bash[23528]: cluster 2024-09-21T05:15:28.382851+0000 mgr.a (mgr.14388) 18224 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:15:31.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:31.775 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:31 smithi044 bash[22676]: cluster 2024-09-21T05:15:30.384821+0000 mgr.a (mgr.14388) 18225 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:31 smithi179 bash[23186]: cluster 2024-09-21T05:15:30.384821+0000 mgr.a (mgr.14388) 18225 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:31 smithi049 bash[23528]: cluster 2024-09-21T05:15:30.384821+0000 mgr.a (mgr.14388) 18225 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:32 smithi044 bash[22676]: audit 2024-09-21T05:15:31.342938+0000 mgr.a (mgr.14388) 18226 : audit [DBG] from='client.391869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:32 smithi179 bash[23186]: audit 2024-09-21T05:15:31.342938+0000 mgr.a (mgr.14388) 18226 : audit [DBG] from='client.391869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:32 smithi049 bash[23528]: audit 2024-09-21T05:15:31.342938+0000 mgr.a (mgr.14388) 18226 : audit [DBG] from='client.391869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:33 smithi044 bash[22676]: cluster 2024-09-21T05:15:32.385896+0000 mgr.a (mgr.14388) 18227 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:15:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:33 smithi179 bash[23186]: cluster 2024-09-21T05:15:32.385896+0000 mgr.a (mgr.14388) 18227 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:15:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:33 smithi049 bash[23528]: cluster 2024-09-21T05:15:32.385896+0000 mgr.a (mgr.14388) 18227 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:15:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:35 smithi044 bash[22676]: cluster 2024-09-21T05:15:34.386672+0000 mgr.a (mgr.14388) 18228 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:15:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:35 smithi044 bash[22676]: audit 2024-09-21T05:15:35.349665+0000 mon.a (mon.0) 14450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:35 smithi044 bash[22676]: audit 2024-09-21T05:15:35.359572+0000 mon.a (mon.0) 14451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:35 smithi044 bash[22676]: audit 2024-09-21T05:15:35.371572+0000 mon.a (mon.0) 14452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:35 smithi044 bash[22676]: audit 2024-09-21T05:15:35.524368+0000 mon.a (mon.0) 14453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:35 smithi044 bash[22676]: audit 2024-09-21T05:15:35.532276+0000 mon.a (mon.0) 14454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:35 smithi044 bash[22676]: audit 2024-09-21T05:15:35.540447+0000 mon.a (mon.0) 14455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:35 smithi179 bash[23186]: cluster 2024-09-21T05:15:34.386672+0000 mgr.a (mgr.14388) 18228 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:15:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:35 smithi179 bash[23186]: audit 2024-09-21T05:15:35.349665+0000 mon.a (mon.0) 14450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:35 smithi179 bash[23186]: audit 2024-09-21T05:15:35.359572+0000 mon.a (mon.0) 14451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:35 smithi179 bash[23186]: audit 2024-09-21T05:15:35.371572+0000 mon.a (mon.0) 14452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:35 smithi179 bash[23186]: audit 2024-09-21T05:15:35.524368+0000 mon.a (mon.0) 14453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:35 smithi179 bash[23186]: audit 2024-09-21T05:15:35.532276+0000 mon.a (mon.0) 14454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:35 smithi179 bash[23186]: audit 2024-09-21T05:15:35.540447+0000 mon.a (mon.0) 14455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:35 smithi049 bash[23528]: cluster 2024-09-21T05:15:34.386672+0000 mgr.a (mgr.14388) 18228 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:15:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:35 smithi049 bash[23528]: audit 2024-09-21T05:15:35.349665+0000 mon.a (mon.0) 14450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:35 smithi049 bash[23528]: audit 2024-09-21T05:15:35.359572+0000 mon.a (mon.0) 14451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:35 smithi049 bash[23528]: audit 2024-09-21T05:15:35.371572+0000 mon.a (mon.0) 14452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:35 smithi049 bash[23528]: audit 2024-09-21T05:15:35.524368+0000 mon.a (mon.0) 14453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:35 smithi049 bash[23528]: audit 2024-09-21T05:15:35.532276+0000 mon.a (mon.0) 14454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:35 smithi049 bash[23528]: audit 2024-09-21T05:15:35.540447+0000 mon.a (mon.0) 14455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:36.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:36.777 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:36.778 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:37.554 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:37.554 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:37.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:37.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:37.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:37 smithi044 bash[22676]: cluster 2024-09-21T05:15:36.389096+0000 mgr.a (mgr.14388) 18229 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:15:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:37 smithi179 bash[23186]: cluster 2024-09-21T05:15:36.389096+0000 mgr.a (mgr.14388) 18229 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:15:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:37 smithi049 bash[23528]: cluster 2024-09-21T05:15:36.389096+0000 mgr.a (mgr.14388) 18229 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:15:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:38 smithi044 bash[22676]: audit 2024-09-21T05:15:37.116179+0000 mgr.a (mgr.14388) 18230 : audit [DBG] from='client.391947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:38 smithi179 bash[23186]: audit 2024-09-21T05:15:37.116179+0000 mgr.a (mgr.14388) 18230 : audit [DBG] from='client.391947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:38 smithi049 bash[23528]: audit 2024-09-21T05:15:37.116179+0000 mgr.a (mgr.14388) 18230 : audit [DBG] from='client.391947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:40.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:39 smithi179 bash[23186]: cluster 2024-09-21T05:15:38.390100+0000 mgr.a (mgr.14388) 18231 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:39 smithi044 bash[22676]: cluster 2024-09-21T05:15:38.390100+0000 mgr.a (mgr.14388) 18231 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:39 smithi049 bash[23528]: cluster 2024-09-21T05:15:38.390100+0000 mgr.a (mgr.14388) 18231 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:41.202 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:40 smithi044 bash[22676]: cluster 2024-09-21T05:15:40.392316+0000 mgr.a (mgr.14388) 18232 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:40 smithi179 bash[23186]: cluster 2024-09-21T05:15:40.392316+0000 mgr.a (mgr.14388) 18232 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:40 smithi049 bash[23528]: cluster 2024-09-21T05:15:40.392316+0000 mgr.a (mgr.14388) 18232 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:15:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:42.556 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:43.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22930]: debug 2024-09-21T05:15:43.402+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:15:43.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22930]: debug 2024-09-21T05:15:43.418+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:15:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22676]: cluster 2024-09-21T05:15:42.393095+0000 mgr.a (mgr.14388) 18233 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22676]: audit 2024-09-21T05:15:42.590899+0000 mon.a (mon.0) 14456 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:15:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22676]: audit 2024-09-21T05:15:42.597800+0000 mon.a (mon.0) 14457 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:15:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22676]: audit 2024-09-21T05:15:42.599517+0000 mon.a (mon.0) 14458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:15:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22676]: audit 2024-09-21T05:15:42.610818+0000 mon.a (mon.0) 14459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22676]: audit 2024-09-21T05:15:42.617289+0000 mon.a (mon.0) 14460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:15:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:43 smithi044 bash[22676]: audit 2024-09-21T05:15:42.619629+0000 mgr.a (mgr.14388) 18234 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:15:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:43 smithi179 bash[23186]: cluster 2024-09-21T05:15:42.393095+0000 mgr.a (mgr.14388) 18233 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:43 smithi179 bash[23186]: audit 2024-09-21T05:15:42.590899+0000 mon.a (mon.0) 14456 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:15:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:43 smithi179 bash[23186]: audit 2024-09-21T05:15:42.597800+0000 mon.a (mon.0) 14457 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:15:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:43 smithi179 bash[23186]: audit 2024-09-21T05:15:42.599517+0000 mon.a (mon.0) 14458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:15:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:43 smithi179 bash[23186]: audit 2024-09-21T05:15:42.610818+0000 mon.a (mon.0) 14459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:43 smithi179 bash[23186]: audit 2024-09-21T05:15:42.617289+0000 mon.a (mon.0) 14460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:15:43.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:43 smithi179 bash[23186]: audit 2024-09-21T05:15:42.619629+0000 mgr.a (mgr.14388) 18234 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:15:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:43 smithi049 bash[23528]: cluster 2024-09-21T05:15:42.393095+0000 mgr.a (mgr.14388) 18233 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:43 smithi049 bash[23528]: audit 2024-09-21T05:15:42.590899+0000 mon.a (mon.0) 14456 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:15:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:43 smithi049 bash[23528]: audit 2024-09-21T05:15:42.597800+0000 mon.a (mon.0) 14457 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:15:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:43 smithi049 bash[23528]: audit 2024-09-21T05:15:42.599517+0000 mon.a (mon.0) 14458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:15:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:43 smithi049 bash[23528]: audit 2024-09-21T05:15:42.610818+0000 mon.a (mon.0) 14459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:43 smithi049 bash[23528]: audit 2024-09-21T05:15:42.617289+0000 mon.a (mon.0) 14460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:15:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:43 smithi049 bash[23528]: audit 2024-09-21T05:15:42.619629+0000 mgr.a (mgr.14388) 18234 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:15:43.823 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:44 smithi044 bash[22676]: audit 2024-09-21T05:15:42.924011+0000 mgr.a (mgr.14388) 18235 : audit [DBG] from='client.392025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:44 smithi044 bash[22676]: audit 2024-09-21T05:15:43.408479+0000 mgr.a (mgr.14388) 18236 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:15:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:44 smithi044 bash[22676]: cephadm 2024-09-21T05:15:43.422991+0000 mgr.a (mgr.14388) 18237 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:15:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:44 smithi179 bash[23186]: audit 2024-09-21T05:15:42.924011+0000 mgr.a (mgr.14388) 18235 : audit [DBG] from='client.392025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:44 smithi179 bash[23186]: audit 2024-09-21T05:15:43.408479+0000 mgr.a (mgr.14388) 18236 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:15:44.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:44 smithi179 bash[23186]: cephadm 2024-09-21T05:15:43.422991+0000 mgr.a (mgr.14388) 18237 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:15:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:44 smithi049 bash[23528]: audit 2024-09-21T05:15:42.924011+0000 mgr.a (mgr.14388) 18235 : audit [DBG] from='client.392025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:44 smithi049 bash[23528]: audit 2024-09-21T05:15:43.408479+0000 mgr.a (mgr.14388) 18236 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:15:44.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:44 smithi049 bash[23528]: cephadm 2024-09-21T05:15:43.422991+0000 mgr.a (mgr.14388) 18237 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:15:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:45 smithi044 bash[22676]: cluster 2024-09-21T05:15:44.394117+0000 mgr.a (mgr.14388) 18238 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:45 smithi044 bash[22676]: audit 2024-09-21T05:15:45.436506+0000 mon.a (mon.0) 14461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:45 smithi044 bash[22676]: audit 2024-09-21T05:15:45.445315+0000 mon.a (mon.0) 14462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:45 smithi044 bash[22676]: audit 2024-09-21T05:15:45.456030+0000 mon.a (mon.0) 14463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:45 smithi179 bash[23186]: cluster 2024-09-21T05:15:44.394117+0000 mgr.a (mgr.14388) 18238 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:45 smithi179 bash[23186]: audit 2024-09-21T05:15:45.436506+0000 mon.a (mon.0) 14461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:45 smithi179 bash[23186]: audit 2024-09-21T05:15:45.445315+0000 mon.a (mon.0) 14462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:45 smithi179 bash[23186]: audit 2024-09-21T05:15:45.456030+0000 mon.a (mon.0) 14463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:45 smithi049 bash[23528]: cluster 2024-09-21T05:15:44.394117+0000 mgr.a (mgr.14388) 18238 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:15:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:45 smithi049 bash[23528]: audit 2024-09-21T05:15:45.436506+0000 mon.a (mon.0) 14461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:45 smithi049 bash[23528]: audit 2024-09-21T05:15:45.445315+0000 mon.a (mon.0) 14462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:45.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:45 smithi049 bash[23528]: audit 2024-09-21T05:15:45.456030+0000 mon.a (mon.0) 14463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:47 smithi049 bash[23528]: cluster 2024-09-21T05:15:46.396418+0000 mgr.a (mgr.14388) 18239 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:15:47.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:47 smithi044 bash[22676]: cluster 2024-09-21T05:15:46.396418+0000 mgr.a (mgr.14388) 18239 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:15:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:47 smithi179 bash[23186]: cluster 2024-09-21T05:15:46.396418+0000 mgr.a (mgr.14388) 18239 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:15:48.824 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:48.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:48.825 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:49.619 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:49.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:49 smithi044 bash[22676]: cluster 2024-09-21T05:15:48.397210+0000 mgr.a (mgr.14388) 18240 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:15:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:49 smithi179 bash[23186]: cluster 2024-09-21T05:15:48.397210+0000 mgr.a (mgr.14388) 18240 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:15:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:49 smithi049 bash[23528]: cluster 2024-09-21T05:15:48.397210+0000 mgr.a (mgr.14388) 18240 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:15:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:50 smithi049 bash[23528]: audit 2024-09-21T05:15:49.158224+0000 mgr.a (mgr.14388) 18241 : audit [DBG] from='client.392205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:50.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:50 smithi044 bash[22676]: audit 2024-09-21T05:15:49.158224+0000 mgr.a (mgr.14388) 18241 : audit [DBG] from='client.392205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:50.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:50 smithi179 bash[23186]: audit 2024-09-21T05:15:49.158224+0000 mgr.a (mgr.14388) 18241 : audit [DBG] from='client.392205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:51 smithi044 bash[22676]: cluster 2024-09-21T05:15:50.399699+0000 mgr.a (mgr.14388) 18242 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 34 op/s 2024-09-21T05:15:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:51 smithi179 bash[23186]: cluster 2024-09-21T05:15:50.399699+0000 mgr.a (mgr.14388) 18242 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 34 op/s 2024-09-21T05:15:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:51 smithi049 bash[23528]: cluster 2024-09-21T05:15:50.399699+0000 mgr.a (mgr.14388) 18242 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 426 B/s wr, 34 op/s 2024-09-21T05:15:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:53 smithi179 bash[23186]: cluster 2024-09-21T05:15:52.400524+0000 mgr.a (mgr.14388) 18243 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T05:15:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:53 smithi049 bash[23528]: cluster 2024-09-21T05:15:52.400524+0000 mgr.a (mgr.14388) 18243 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T05:15:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:53 smithi044 bash[22676]: cluster 2024-09-21T05:15:52.400524+0000 mgr.a (mgr.14388) 18243 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T05:15:54.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:15:54.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:15:54.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:15:55.420 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:15:55.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:15:55.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:15:55.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:15:55.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:15:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:55 smithi179 bash[23186]: cluster 2024-09-21T05:15:54.401391+0000 mgr.a (mgr.14388) 18244 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T05:15:55.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:55 smithi044 bash[22676]: cluster 2024-09-21T05:15:54.401391+0000 mgr.a (mgr.14388) 18244 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T05:15:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:55 smithi049 bash[23528]: cluster 2024-09-21T05:15:54.401391+0000 mgr.a (mgr.14388) 18244 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 241 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-09-21T05:15:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:56 smithi049 bash[23528]: audit 2024-09-21T05:15:54.961655+0000 mgr.a (mgr.14388) 18245 : audit [DBG] from='client.392283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:56 smithi049 bash[23528]: audit 2024-09-21T05:15:55.547914+0000 mon.a (mon.0) 14464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:56 smithi049 bash[23528]: audit 2024-09-21T05:15:55.556132+0000 mon.a (mon.0) 14465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:56 smithi049 bash[23528]: audit 2024-09-21T05:15:55.564646+0000 mon.a (mon.0) 14466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:56 smithi049 bash[23528]: audit 2024-09-21T05:15:55.738754+0000 mon.a (mon.0) 14467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:56 smithi049 bash[23528]: audit 2024-09-21T05:15:55.747200+0000 mon.a (mon.0) 14468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:56 smithi049 bash[23528]: audit 2024-09-21T05:15:55.757404+0000 mon.a (mon.0) 14469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:56 smithi044 bash[22676]: audit 2024-09-21T05:15:54.961655+0000 mgr.a (mgr.14388) 18245 : audit [DBG] from='client.392283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:56 smithi044 bash[22676]: audit 2024-09-21T05:15:55.547914+0000 mon.a (mon.0) 14464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:56 smithi044 bash[22676]: audit 2024-09-21T05:15:55.556132+0000 mon.a (mon.0) 14465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:56 smithi044 bash[22676]: audit 2024-09-21T05:15:55.564646+0000 mon.a (mon.0) 14466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:56 smithi044 bash[22676]: audit 2024-09-21T05:15:55.738754+0000 mon.a (mon.0) 14467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:56 smithi044 bash[22676]: audit 2024-09-21T05:15:55.747200+0000 mon.a (mon.0) 14468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:56.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:56 smithi044 bash[22676]: audit 2024-09-21T05:15:55.757404+0000 mon.a (mon.0) 14469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:56 smithi179 bash[23186]: audit 2024-09-21T05:15:54.961655+0000 mgr.a (mgr.14388) 18245 : audit [DBG] from='client.392283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:15:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:56 smithi179 bash[23186]: audit 2024-09-21T05:15:55.547914+0000 mon.a (mon.0) 14464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:56 smithi179 bash[23186]: audit 2024-09-21T05:15:55.556132+0000 mon.a (mon.0) 14465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:56 smithi179 bash[23186]: audit 2024-09-21T05:15:55.564646+0000 mon.a (mon.0) 14466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:57.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:56 smithi179 bash[23186]: audit 2024-09-21T05:15:55.738754+0000 mon.a (mon.0) 14467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:57.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:56 smithi179 bash[23186]: audit 2024-09-21T05:15:55.747200+0000 mon.a (mon.0) 14468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:57.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:56 smithi179 bash[23186]: audit 2024-09-21T05:15:55.757404+0000 mon.a (mon.0) 14469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:15:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:57 smithi049 bash[23528]: cluster 2024-09-21T05:15:56.404334+0000 mgr.a (mgr.14388) 18246 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T05:15:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:57 smithi044 bash[22676]: cluster 2024-09-21T05:15:56.404334+0000 mgr.a (mgr.14388) 18246 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T05:15:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:57 smithi179 bash[23186]: cluster 2024-09-21T05:15:56.404334+0000 mgr.a (mgr.14388) 18246 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-21T05:16:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:15:59 smithi179 bash[23186]: cluster 2024-09-21T05:15:58.405144+0000 mgr.a (mgr.14388) 18247 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T05:16:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:15:59 smithi049 bash[23528]: cluster 2024-09-21T05:15:58.405144+0000 mgr.a (mgr.14388) 18247 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T05:16:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:15:59 smithi044 bash[22676]: cluster 2024-09-21T05:15:58.405144+0000 mgr.a (mgr.14388) 18247 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T05:16:00.421 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:00.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:00.422 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:01.195 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:01 smithi049 bash[23528]: cluster 2024-09-21T05:16:00.407167+0000 mgr.a (mgr.14388) 18248 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T05:16:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:01 smithi049 bash[23528]: audit 2024-09-21T05:16:00.756821+0000 mgr.a (mgr.14388) 18249 : audit [DBG] from='client.392361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:01 smithi044 bash[22676]: cluster 2024-09-21T05:16:00.407167+0000 mgr.a (mgr.14388) 18248 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T05:16:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:01 smithi044 bash[22676]: audit 2024-09-21T05:16:00.756821+0000 mgr.a (mgr.14388) 18249 : audit [DBG] from='client.392361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:01 smithi179 bash[23186]: cluster 2024-09-21T05:16:00.407167+0000 mgr.a (mgr.14388) 18248 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-21T05:16:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:01 smithi179 bash[23186]: audit 2024-09-21T05:16:00.756821+0000 mgr.a (mgr.14388) 18249 : audit [DBG] from='client.392361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:03 smithi049 bash[23528]: cluster 2024-09-21T05:16:02.408097+0000 mgr.a (mgr.14388) 18250 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:16:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:03 smithi044 bash[22676]: cluster 2024-09-21T05:16:02.408097+0000 mgr.a (mgr.14388) 18250 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:16:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:03 smithi179 bash[23186]: cluster 2024-09-21T05:16:02.408097+0000 mgr.a (mgr.14388) 18250 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:16:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:05 smithi049 bash[23528]: cluster 2024-09-21T05:16:04.408901+0000 mgr.a (mgr.14388) 18251 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:16:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:05 smithi049 bash[23528]: audit 2024-09-21T05:16:05.667621+0000 mon.a (mon.0) 14470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:05 smithi049 bash[23528]: audit 2024-09-21T05:16:05.676269+0000 mon.a (mon.0) 14471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:05 smithi049 bash[23528]: audit 2024-09-21T05:16:05.687087+0000 mon.a (mon.0) 14472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:05 smithi044 bash[22676]: cluster 2024-09-21T05:16:04.408901+0000 mgr.a (mgr.14388) 18251 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:16:06.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:05 smithi044 bash[22676]: audit 2024-09-21T05:16:05.667621+0000 mon.a (mon.0) 14470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:05 smithi044 bash[22676]: audit 2024-09-21T05:16:05.676269+0000 mon.a (mon.0) 14471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.160 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:05 smithi044 bash[22676]: audit 2024-09-21T05:16:05.687087+0000 mon.a (mon.0) 14472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.196 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:06.197 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:05 smithi179 bash[23186]: cluster 2024-09-21T05:16:04.408901+0000 mgr.a (mgr.14388) 18251 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:16:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:05 smithi179 bash[23186]: audit 2024-09-21T05:16:05.667621+0000 mon.a (mon.0) 14470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:05 smithi179 bash[23186]: audit 2024-09-21T05:16:05.676269+0000 mon.a (mon.0) 14471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:05 smithi179 bash[23186]: audit 2024-09-21T05:16:05.687087+0000 mon.a (mon.0) 14472 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:06.991 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:06.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:06.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:06.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:06.992 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:07 smithi049 bash[23528]: cluster 2024-09-21T05:16:06.411111+0000 mgr.a (mgr.14388) 18252 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:16:08.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:07 smithi049 bash[23528]: audit 2024-09-21T05:16:06.528986+0000 mgr.a (mgr.14388) 18253 : audit [DBG] from='client.392436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:07 smithi044 bash[22676]: cluster 2024-09-21T05:16:06.411111+0000 mgr.a (mgr.14388) 18252 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:16:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:07 smithi044 bash[22676]: audit 2024-09-21T05:16:06.528986+0000 mgr.a (mgr.14388) 18253 : audit [DBG] from='client.392436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:07 smithi179 bash[23186]: cluster 2024-09-21T05:16:06.411111+0000 mgr.a (mgr.14388) 18252 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:16:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:07 smithi179 bash[23186]: audit 2024-09-21T05:16:06.528986+0000 mgr.a (mgr.14388) 18253 : audit [DBG] from='client.392436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:09 smithi049 bash[23528]: cluster 2024-09-21T05:16:08.412065+0000 mgr.a (mgr.14388) 18254 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:09 smithi044 bash[22676]: cluster 2024-09-21T05:16:08.412065+0000 mgr.a (mgr.14388) 18254 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:09 smithi179 bash[23186]: cluster 2024-09-21T05:16:08.412065+0000 mgr.a (mgr.14388) 18254 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:11.993 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:11.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:11.994 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:11 smithi049 bash[23528]: cluster 2024-09-21T05:16:10.414503+0000 mgr.a (mgr.14388) 18255 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:16:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:11 smithi044 bash[22676]: cluster 2024-09-21T05:16:10.414503+0000 mgr.a (mgr.14388) 18255 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:16:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:11 smithi179 bash[23186]: cluster 2024-09-21T05:16:10.414503+0000 mgr.a (mgr.14388) 18255 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:16:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:12.776 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:13 smithi049 bash[23528]: audit 2024-09-21T05:16:12.326251+0000 mgr.a (mgr.14388) 18256 : audit [DBG] from='client.392514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:13 smithi049 bash[23528]: cluster 2024-09-21T05:16:12.415095+0000 mgr.a (mgr.14388) 18257 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:13 smithi044 bash[22676]: audit 2024-09-21T05:16:12.326251+0000 mgr.a (mgr.14388) 18256 : audit [DBG] from='client.392514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:13 smithi044 bash[22676]: cluster 2024-09-21T05:16:12.415095+0000 mgr.a (mgr.14388) 18257 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:13 smithi179 bash[23186]: audit 2024-09-21T05:16:12.326251+0000 mgr.a (mgr.14388) 18256 : audit [DBG] from='client.392514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:13 smithi179 bash[23186]: cluster 2024-09-21T05:16:12.415095+0000 mgr.a (mgr.14388) 18257 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:15 smithi049 bash[23528]: cluster 2024-09-21T05:16:14.416084+0000 mgr.a (mgr.14388) 18258 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:15 smithi049 bash[23528]: audit 2024-09-21T05:16:15.773089+0000 mon.a (mon.0) 14473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:15 smithi049 bash[23528]: audit 2024-09-21T05:16:15.782367+0000 mon.a (mon.0) 14474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:15 smithi049 bash[23528]: audit 2024-09-21T05:16:15.791406+0000 mon.a (mon.0) 14475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:15 smithi044 bash[22676]: cluster 2024-09-21T05:16:14.416084+0000 mgr.a (mgr.14388) 18258 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:15 smithi044 bash[22676]: audit 2024-09-21T05:16:15.773089+0000 mon.a (mon.0) 14473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:15 smithi044 bash[22676]: audit 2024-09-21T05:16:15.782367+0000 mon.a (mon.0) 14474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:15 smithi044 bash[22676]: audit 2024-09-21T05:16:15.791406+0000 mon.a (mon.0) 14475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:15 smithi179 bash[23186]: cluster 2024-09-21T05:16:14.416084+0000 mgr.a (mgr.14388) 18258 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:15 smithi179 bash[23186]: audit 2024-09-21T05:16:15.773089+0000 mon.a (mon.0) 14473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:15 smithi179 bash[23186]: audit 2024-09-21T05:16:15.782367+0000 mon.a (mon.0) 14474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:15 smithi179 bash[23186]: audit 2024-09-21T05:16:15.791406+0000 mon.a (mon.0) 14475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:16 smithi044 bash[22676]: audit 2024-09-21T05:16:15.984510+0000 mon.a (mon.0) 14476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:16 smithi044 bash[22676]: audit 2024-09-21T05:16:15.992936+0000 mon.a (mon.0) 14477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:16 smithi044 bash[22676]: audit 2024-09-21T05:16:16.004189+0000 mon.a (mon.0) 14478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:16 smithi044 bash[22676]: cluster 2024-09-21T05:16:16.418353+0000 mgr.a (mgr.14388) 18259 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:16:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:16 smithi179 bash[23186]: audit 2024-09-21T05:16:15.984510+0000 mon.a (mon.0) 14476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:16 smithi179 bash[23186]: audit 2024-09-21T05:16:15.992936+0000 mon.a (mon.0) 14477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:16 smithi179 bash[23186]: audit 2024-09-21T05:16:16.004189+0000 mon.a (mon.0) 14478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:16 smithi179 bash[23186]: cluster 2024-09-21T05:16:16.418353+0000 mgr.a (mgr.14388) 18259 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:16:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:16 smithi049 bash[23528]: audit 2024-09-21T05:16:15.984510+0000 mon.a (mon.0) 14476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:16 smithi049 bash[23528]: audit 2024-09-21T05:16:15.992936+0000 mon.a (mon.0) 14477 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:16 smithi049 bash[23528]: audit 2024-09-21T05:16:16.004189+0000 mon.a (mon.0) 14478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:16 smithi049 bash[23528]: cluster 2024-09-21T05:16:16.418353+0000 mgr.a (mgr.14388) 18259 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:16:17.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:17.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:18.565 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:18.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:18.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:18.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:18.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:19 smithi044 bash[22676]: audit 2024-09-21T05:16:18.110446+0000 mgr.a (mgr.14388) 18260 : audit [DBG] from='client.392592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:19 smithi044 bash[22676]: cluster 2024-09-21T05:16:18.419032+0000 mgr.a (mgr.14388) 18261 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:19 smithi179 bash[23186]: audit 2024-09-21T05:16:18.110446+0000 mgr.a (mgr.14388) 18260 : audit [DBG] from='client.392592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:19 smithi179 bash[23186]: cluster 2024-09-21T05:16:18.419032+0000 mgr.a (mgr.14388) 18261 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:19 smithi049 bash[23528]: audit 2024-09-21T05:16:18.110446+0000 mgr.a (mgr.14388) 18260 : audit [DBG] from='client.392592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:19 smithi049 bash[23528]: cluster 2024-09-21T05:16:18.419032+0000 mgr.a (mgr.14388) 18261 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:21 smithi044 bash[22676]: cluster 2024-09-21T05:16:20.421241+0000 mgr.a (mgr.14388) 18262 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:16:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:21 smithi179 bash[23186]: cluster 2024-09-21T05:16:20.421241+0000 mgr.a (mgr.14388) 18262 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:16:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:21 smithi049 bash[23528]: cluster 2024-09-21T05:16:20.421241+0000 mgr.a (mgr.14388) 18262 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:16:23.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:23 smithi044 bash[22676]: cluster 2024-09-21T05:16:22.421925+0000 mgr.a (mgr.14388) 18263 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:23 smithi179 bash[23186]: cluster 2024-09-21T05:16:22.421925+0000 mgr.a (mgr.14388) 18263 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:23 smithi049 bash[23528]: cluster 2024-09-21T05:16:22.421925+0000 mgr.a (mgr.14388) 18263 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:24.342 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:24.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:24.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:24.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:24.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:24 smithi179 bash[23186]: audit 2024-09-21T05:16:23.902221+0000 mgr.a (mgr.14388) 18264 : audit [DBG] from='client.392670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:24 smithi049 bash[23528]: audit 2024-09-21T05:16:23.902221+0000 mgr.a (mgr.14388) 18264 : audit [DBG] from='client.392670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:24 smithi044 bash[22676]: audit 2024-09-21T05:16:23.902221+0000 mgr.a (mgr.14388) 18264 : audit [DBG] from='client.392670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:25 smithi179 bash[23186]: cluster 2024-09-21T05:16:24.422853+0000 mgr.a (mgr.14388) 18265 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:25 smithi049 bash[23528]: cluster 2024-09-21T05:16:24.422853+0000 mgr.a (mgr.14388) 18265 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:25 smithi044 bash[22676]: cluster 2024-09-21T05:16:24.422853+0000 mgr.a (mgr.14388) 18265 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:27.149 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:26 smithi044 bash[22676]: audit 2024-09-21T05:16:25.899352+0000 mon.a (mon.0) 14479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.149 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:26 smithi044 bash[22676]: audit 2024-09-21T05:16:25.908288+0000 mon.a (mon.0) 14480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.149 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:26 smithi044 bash[22676]: audit 2024-09-21T05:16:25.918939+0000 mon.a (mon.0) 14481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:26 smithi179 bash[23186]: audit 2024-09-21T05:16:25.899352+0000 mon.a (mon.0) 14479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:26 smithi179 bash[23186]: audit 2024-09-21T05:16:25.908288+0000 mon.a (mon.0) 14480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:26 smithi179 bash[23186]: audit 2024-09-21T05:16:25.918939+0000 mon.a (mon.0) 14481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.375 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:26 smithi049 bash[23528]: audit 2024-09-21T05:16:25.899352+0000 mon.a (mon.0) 14479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.375 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:26 smithi049 bash[23528]: audit 2024-09-21T05:16:25.908288+0000 mon.a (mon.0) 14480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:27.375 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:26 smithi049 bash[23528]: audit 2024-09-21T05:16:25.918939+0000 mon.a (mon.0) 14481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:27 smithi044 bash[22676]: cluster 2024-09-21T05:16:26.425220+0000 mgr.a (mgr.14388) 18266 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:16:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:27 smithi179 bash[23186]: cluster 2024-09-21T05:16:26.425220+0000 mgr.a (mgr.14388) 18266 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:16:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:27 smithi049 bash[23528]: cluster 2024-09-21T05:16:26.425220+0000 mgr.a (mgr.14388) 18266 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:16:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:28 smithi044 bash[22676]: cluster 2024-09-21T05:16:28.425985+0000 mgr.a (mgr.14388) 18267 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:28 smithi179 bash[23186]: cluster 2024-09-21T05:16:28.425985+0000 mgr.a (mgr.14388) 18267 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:29.294 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:28 smithi049 bash[23528]: cluster 2024-09-21T05:16:28.425985+0000 mgr.a (mgr.14388) 18267 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:29.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:29.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:29.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:30.073 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:30.073 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:29 smithi044 bash[22676]: audit 2024-09-21T05:16:29.654614+0000 mgr.a (mgr.14388) 18268 : audit [DBG] from='client.392748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:29 smithi179 bash[23186]: audit 2024-09-21T05:16:29.654614+0000 mgr.a (mgr.14388) 18268 : audit [DBG] from='client.392748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:29 smithi049 bash[23528]: audit 2024-09-21T05:16:29.654614+0000 mgr.a (mgr.14388) 18268 : audit [DBG] from='client.392748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:30 smithi044 bash[22676]: cluster 2024-09-21T05:16:30.428935+0000 mgr.a (mgr.14388) 18269 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:30 smithi179 bash[23186]: cluster 2024-09-21T05:16:30.428935+0000 mgr.a (mgr.14388) 18269 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:30 smithi049 bash[23528]: cluster 2024-09-21T05:16:30.428935+0000 mgr.a (mgr.14388) 18269 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:16:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:33 smithi044 bash[22676]: cluster 2024-09-21T05:16:32.429745+0000 mgr.a (mgr.14388) 18270 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:33 smithi179 bash[23186]: cluster 2024-09-21T05:16:32.429745+0000 mgr.a (mgr.14388) 18270 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:33 smithi049 bash[23528]: cluster 2024-09-21T05:16:32.429745+0000 mgr.a (mgr.14388) 18270 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:35.075 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:35.075 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:35.076 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:35.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:35 smithi179 bash[23186]: cluster 2024-09-21T05:16:34.430519+0000 mgr.a (mgr.14388) 18271 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:35 smithi049 bash[23528]: cluster 2024-09-21T05:16:34.430519+0000 mgr.a (mgr.14388) 18271 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:35.856 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:35.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:35.857 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:35 smithi044 bash[22676]: cluster 2024-09-21T05:16:34.430519+0000 mgr.a (mgr.14388) 18271 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:36 smithi179 bash[23186]: audit 2024-09-21T05:16:35.409759+0000 mgr.a (mgr.14388) 18272 : audit [DBG] from='client.392823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:36 smithi179 bash[23186]: audit 2024-09-21T05:16:36.001365+0000 mon.a (mon.0) 14482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:36 smithi179 bash[23186]: audit 2024-09-21T05:16:36.009970+0000 mon.a (mon.0) 14483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:36 smithi179 bash[23186]: audit 2024-09-21T05:16:36.019077+0000 mon.a (mon.0) 14484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:36 smithi179 bash[23186]: audit 2024-09-21T05:16:36.215064+0000 mon.a (mon.0) 14485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:36 smithi179 bash[23186]: audit 2024-09-21T05:16:36.223315+0000 mon.a (mon.0) 14486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:36 smithi179 bash[23186]: audit 2024-09-21T05:16:36.233223+0000 mon.a (mon.0) 14487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:36 smithi049 bash[23528]: audit 2024-09-21T05:16:35.409759+0000 mgr.a (mgr.14388) 18272 : audit [DBG] from='client.392823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:36 smithi049 bash[23528]: audit 2024-09-21T05:16:36.001365+0000 mon.a (mon.0) 14482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:36 smithi049 bash[23528]: audit 2024-09-21T05:16:36.009970+0000 mon.a (mon.0) 14483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:36 smithi049 bash[23528]: audit 2024-09-21T05:16:36.019077+0000 mon.a (mon.0) 14484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:36 smithi049 bash[23528]: audit 2024-09-21T05:16:36.215064+0000 mon.a (mon.0) 14485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:36 smithi049 bash[23528]: audit 2024-09-21T05:16:36.223315+0000 mon.a (mon.0) 14486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:36 smithi049 bash[23528]: audit 2024-09-21T05:16:36.233223+0000 mon.a (mon.0) 14487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:36 smithi044 bash[22676]: audit 2024-09-21T05:16:35.409759+0000 mgr.a (mgr.14388) 18272 : audit [DBG] from='client.392823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:36 smithi044 bash[22676]: audit 2024-09-21T05:16:36.001365+0000 mon.a (mon.0) 14482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:36 smithi044 bash[22676]: audit 2024-09-21T05:16:36.009970+0000 mon.a (mon.0) 14483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:36 smithi044 bash[22676]: audit 2024-09-21T05:16:36.019077+0000 mon.a (mon.0) 14484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:36 smithi044 bash[22676]: audit 2024-09-21T05:16:36.215064+0000 mon.a (mon.0) 14485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:36 smithi044 bash[22676]: audit 2024-09-21T05:16:36.223315+0000 mon.a (mon.0) 14486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:36.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:36 smithi044 bash[22676]: audit 2024-09-21T05:16:36.233223+0000 mon.a (mon.0) 14487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:37 smithi179 bash[23186]: cluster 2024-09-21T05:16:36.433486+0000 mgr.a (mgr.14388) 18273 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:37 smithi049 bash[23528]: cluster 2024-09-21T05:16:36.433486+0000 mgr.a (mgr.14388) 18273 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:37 smithi044 bash[22676]: cluster 2024-09-21T05:16:36.433486+0000 mgr.a (mgr.14388) 18273 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:39 smithi179 bash[23186]: cluster 2024-09-21T05:16:38.434265+0000 mgr.a (mgr.14388) 18274 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:16:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:39 smithi049 bash[23528]: cluster 2024-09-21T05:16:38.434265+0000 mgr.a (mgr.14388) 18274 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:16:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:39 smithi044 bash[22676]: cluster 2024-09-21T05:16:38.434265+0000 mgr.a (mgr.14388) 18274 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:16:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:41.601 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:41 smithi049 bash[23528]: cluster 2024-09-21T05:16:40.435373+0000 mgr.a (mgr.14388) 18275 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:41.832 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:41 smithi179 bash[23186]: cluster 2024-09-21T05:16:40.435373+0000 mgr.a (mgr.14388) 18275 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:41 smithi044 bash[22676]: cluster 2024-09-21T05:16:40.435373+0000 mgr.a (mgr.14388) 18275 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:42 smithi049 bash[23528]: audit 2024-09-21T05:16:41.178365+0000 mgr.a (mgr.14388) 18276 : audit [DBG] from='client.392901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:42 smithi044 bash[22676]: audit 2024-09-21T05:16:41.178365+0000 mgr.a (mgr.14388) 18276 : audit [DBG] from='client.392901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:42 smithi179 bash[23186]: audit 2024-09-21T05:16:41.178365+0000 mgr.a (mgr.14388) 18276 : audit [DBG] from='client.392901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:43 smithi179 bash[23186]: cluster 2024-09-21T05:16:42.436247+0000 mgr.a (mgr.14388) 18277 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:16:43.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:43 smithi179 bash[23186]: audit 2024-09-21T05:16:43.497779+0000 mon.a (mon.0) 14488 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:16:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:43 smithi049 bash[23528]: cluster 2024-09-21T05:16:42.436247+0000 mgr.a (mgr.14388) 18277 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:16:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:43 smithi049 bash[23528]: audit 2024-09-21T05:16:43.497779+0000 mon.a (mon.0) 14488 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:16:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:43 smithi044 bash[22676]: cluster 2024-09-21T05:16:42.436247+0000 mgr.a (mgr.14388) 18277 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:16:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:43 smithi044 bash[22676]: audit 2024-09-21T05:16:43.497779+0000 mon.a (mon.0) 14488 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:16:45.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:16:44 smithi044 bash[22930]: debug 2024-09-21T05:16:44.885+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:16:45.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:16:44 smithi044 bash[22930]: debug 2024-09-21T05:16:44.889+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.107234+0000 mon.a (mon.0) 14489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.114813+0000 mon.a (mon.0) 14490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.120241+0000 mon.a (mon.0) 14491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.125389+0000 mon.a (mon.0) 14492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.126725+0000 mon.a (mon.0) 14493 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.127942+0000 mon.a (mon.0) 14494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.135072+0000 mon.a (mon.0) 14495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.140689+0000 mon.a (mon.0) 14496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.141664+0000 mgr.a (mgr.14388) 18278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: cluster 2024-09-21T05:16:44.436838+0000 mgr.a (mgr.14388) 18279 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: audit 2024-09-21T05:16:44.893064+0000 mgr.a (mgr.14388) 18280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:16:45.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:45 smithi044 bash[22676]: cephadm 2024-09-21T05:16:44.894415+0000 mgr.a (mgr.14388) 18281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.107234+0000 mon.a (mon.0) 14489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.114813+0000 mon.a (mon.0) 14490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.120241+0000 mon.a (mon.0) 14491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.125389+0000 mon.a (mon.0) 14492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.126725+0000 mon.a (mon.0) 14493 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.127942+0000 mon.a (mon.0) 14494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.135072+0000 mon.a (mon.0) 14495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.140689+0000 mon.a (mon.0) 14496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.141664+0000 mgr.a (mgr.14388) 18278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:16:45.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: cluster 2024-09-21T05:16:44.436838+0000 mgr.a (mgr.14388) 18279 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:16:45.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: audit 2024-09-21T05:16:44.893064+0000 mgr.a (mgr.14388) 18280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:16:45.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:45 smithi179 bash[23186]: cephadm 2024-09-21T05:16:44.894415+0000 mgr.a (mgr.14388) 18281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.107234+0000 mon.a (mon.0) 14489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.114813+0000 mon.a (mon.0) 14490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.120241+0000 mon.a (mon.0) 14491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.125389+0000 mon.a (mon.0) 14492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.126725+0000 mon.a (mon.0) 14493 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.127942+0000 mon.a (mon.0) 14494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.135072+0000 mon.a (mon.0) 14495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.140689+0000 mon.a (mon.0) 14496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.141664+0000 mgr.a (mgr.14388) 18278 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:16:45.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: cluster 2024-09-21T05:16:44.436838+0000 mgr.a (mgr.14388) 18279 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:16:45.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: audit 2024-09-21T05:16:44.893064+0000 mgr.a (mgr.14388) 18280 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:16:45.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:45 smithi049 bash[23528]: cephadm 2024-09-21T05:16:44.894415+0000 mgr.a (mgr.14388) 18281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:16:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:46.603 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:47.393 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:47.393 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:47.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:47 smithi044 bash[22676]: audit 2024-09-21T05:16:46.130859+0000 mon.a (mon.0) 14497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:47 smithi044 bash[22676]: audit 2024-09-21T05:16:46.139473+0000 mon.a (mon.0) 14498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:47 smithi044 bash[22676]: audit 2024-09-21T05:16:46.149808+0000 mon.a (mon.0) 14499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:47 smithi044 bash[22676]: cluster 2024-09-21T05:16:46.439198+0000 mgr.a (mgr.14388) 18282 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:47 smithi179 bash[23186]: audit 2024-09-21T05:16:46.130859+0000 mon.a (mon.0) 14497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:47 smithi179 bash[23186]: audit 2024-09-21T05:16:46.139473+0000 mon.a (mon.0) 14498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:47 smithi179 bash[23186]: audit 2024-09-21T05:16:46.149808+0000 mon.a (mon.0) 14499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:47 smithi179 bash[23186]: cluster 2024-09-21T05:16:46.439198+0000 mgr.a (mgr.14388) 18282 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:47 smithi049 bash[23528]: audit 2024-09-21T05:16:46.130859+0000 mon.a (mon.0) 14497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:47 smithi049 bash[23528]: audit 2024-09-21T05:16:46.139473+0000 mon.a (mon.0) 14498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:47 smithi049 bash[23528]: audit 2024-09-21T05:16:46.149808+0000 mon.a (mon.0) 14499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:47 smithi049 bash[23528]: cluster 2024-09-21T05:16:46.439198+0000 mgr.a (mgr.14388) 18282 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:48.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:48 smithi044 bash[22676]: audit 2024-09-21T05:16:46.932972+0000 mgr.a (mgr.14388) 18283 : audit [DBG] from='client.393084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:48 smithi179 bash[23186]: audit 2024-09-21T05:16:46.932972+0000 mgr.a (mgr.14388) 18283 : audit [DBG] from='client.393084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:48 smithi049 bash[23528]: audit 2024-09-21T05:16:46.932972+0000 mgr.a (mgr.14388) 18283 : audit [DBG] from='client.393084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:49.429 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:49 smithi044 bash[22676]: cluster 2024-09-21T05:16:48.440199+0000 mgr.a (mgr.14388) 18284 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:49 smithi179 bash[23186]: cluster 2024-09-21T05:16:48.440199+0000 mgr.a (mgr.14388) 18284 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:49 smithi049 bash[23528]: cluster 2024-09-21T05:16:48.440199+0000 mgr.a (mgr.14388) 18284 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:51 smithi179 bash[23186]: cluster 2024-09-21T05:16:50.442518+0000 mgr.a (mgr.14388) 18285 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:51 smithi049 bash[23528]: cluster 2024-09-21T05:16:50.442518+0000 mgr.a (mgr.14388) 18285 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:51 smithi044 bash[22676]: cluster 2024-09-21T05:16:50.442518+0000 mgr.a (mgr.14388) 18285 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:52.394 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:52.395 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:52.396 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:53.184 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:53.185 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:53 smithi049 bash[23528]: cluster 2024-09-21T05:16:52.443277+0000 mgr.a (mgr.14388) 18286 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:53 smithi049 bash[23528]: audit 2024-09-21T05:16:52.727025+0000 mgr.a (mgr.14388) 18287 : audit [DBG] from='client.393162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:53 smithi044 bash[22676]: cluster 2024-09-21T05:16:52.443277+0000 mgr.a (mgr.14388) 18286 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:53 smithi044 bash[22676]: audit 2024-09-21T05:16:52.727025+0000 mgr.a (mgr.14388) 18287 : audit [DBG] from='client.393162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:53 smithi179 bash[23186]: cluster 2024-09-21T05:16:52.443277+0000 mgr.a (mgr.14388) 18286 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:53 smithi179 bash[23186]: audit 2024-09-21T05:16:52.727025+0000 mgr.a (mgr.14388) 18287 : audit [DBG] from='client.393162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:55 smithi049 bash[23528]: cluster 2024-09-21T05:16:54.444203+0000 mgr.a (mgr.14388) 18288 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:55 smithi044 bash[22676]: cluster 2024-09-21T05:16:54.444203+0000 mgr.a (mgr.14388) 18288 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:55 smithi179 bash[23186]: cluster 2024-09-21T05:16:54.444203+0000 mgr.a (mgr.14388) 18288 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:57 smithi044 bash[22676]: audit 2024-09-21T05:16:56.233115+0000 mon.a (mon.0) 14500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:57 smithi044 bash[22676]: audit 2024-09-21T05:16:56.243599+0000 mon.a (mon.0) 14501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:57 smithi044 bash[22676]: audit 2024-09-21T05:16:56.256240+0000 mon.a (mon.0) 14502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:57 smithi044 bash[22676]: audit 2024-09-21T05:16:56.422939+0000 mon.a (mon.0) 14503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:57 smithi044 bash[22676]: audit 2024-09-21T05:16:56.432507+0000 mon.a (mon.0) 14504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:57 smithi044 bash[22676]: audit 2024-09-21T05:16:56.444024+0000 mon.a (mon.0) 14505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:57 smithi044 bash[22676]: cluster 2024-09-21T05:16:56.446565+0000 mgr.a (mgr.14388) 18289 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:57 smithi179 bash[23186]: audit 2024-09-21T05:16:56.233115+0000 mon.a (mon.0) 14500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:57 smithi179 bash[23186]: audit 2024-09-21T05:16:56.243599+0000 mon.a (mon.0) 14501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:57 smithi179 bash[23186]: audit 2024-09-21T05:16:56.256240+0000 mon.a (mon.0) 14502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:57 smithi179 bash[23186]: audit 2024-09-21T05:16:56.422939+0000 mon.a (mon.0) 14503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:57 smithi179 bash[23186]: audit 2024-09-21T05:16:56.432507+0000 mon.a (mon.0) 14504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:57 smithi179 bash[23186]: audit 2024-09-21T05:16:56.444024+0000 mon.a (mon.0) 14505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:57 smithi179 bash[23186]: cluster 2024-09-21T05:16:56.446565+0000 mgr.a (mgr.14388) 18289 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:57 smithi049 bash[23528]: audit 2024-09-21T05:16:56.233115+0000 mon.a (mon.0) 14500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:57 smithi049 bash[23528]: audit 2024-09-21T05:16:56.243599+0000 mon.a (mon.0) 14501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:57 smithi049 bash[23528]: audit 2024-09-21T05:16:56.256240+0000 mon.a (mon.0) 14502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:57 smithi049 bash[23528]: audit 2024-09-21T05:16:56.422939+0000 mon.a (mon.0) 14503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:57 smithi049 bash[23528]: audit 2024-09-21T05:16:56.432507+0000 mon.a (mon.0) 14504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:57 smithi049 bash[23528]: audit 2024-09-21T05:16:56.444024+0000 mon.a (mon.0) 14505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:16:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:57 smithi049 bash[23528]: cluster 2024-09-21T05:16:56.446565+0000 mgr.a (mgr.14388) 18289 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:16:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:16:58.187 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:16:58.187 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:16:58.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:16:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:16:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:16:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:16:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:16:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:59 smithi049 bash[23528]: cluster 2024-09-21T05:16:58.447338+0000 mgr.a (mgr.14388) 18290 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:16:59 smithi049 bash[23528]: audit 2024-09-21T05:16:58.519423+0000 mgr.a (mgr.14388) 18291 : audit [DBG] from='client.393234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:16:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:59 smithi044 bash[22676]: cluster 2024-09-21T05:16:58.447338+0000 mgr.a (mgr.14388) 18290 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:16:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:16:59 smithi044 bash[22676]: audit 2024-09-21T05:16:58.519423+0000 mgr.a (mgr.14388) 18291 : audit [DBG] from='client.393234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:59 smithi179 bash[23186]: cluster 2024-09-21T05:16:58.447338+0000 mgr.a (mgr.14388) 18290 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:16:59 smithi179 bash[23186]: audit 2024-09-21T05:16:58.519423+0000 mgr.a (mgr.14388) 18291 : audit [DBG] from='client.393234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:01.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:01 smithi049 bash[23528]: cluster 2024-09-21T05:17:00.449638+0000 mgr.a (mgr.14388) 18292 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:01 smithi044 bash[22676]: cluster 2024-09-21T05:17:00.449638+0000 mgr.a (mgr.14388) 18292 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:01 smithi179 bash[23186]: cluster 2024-09-21T05:17:00.449638+0000 mgr.a (mgr.14388) 18292 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:03 smithi179 bash[23186]: cluster 2024-09-21T05:17:02.450403+0000 mgr.a (mgr.14388) 18293 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:03 smithi049 bash[23528]: cluster 2024-09-21T05:17:02.450403+0000 mgr.a (mgr.14388) 18293 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:03.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:03.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:03.976 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:03 smithi044 bash[22676]: cluster 2024-09-21T05:17:02.450403+0000 mgr.a (mgr.14388) 18293 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:04.733 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:04.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:04.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:04.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:05 smithi049 bash[23528]: audit 2024-09-21T05:17:04.302781+0000 mgr.a (mgr.14388) 18294 : audit [DBG] from='client.393309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:05.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:05 smithi049 bash[23528]: cluster 2024-09-21T05:17:04.450972+0000 mgr.a (mgr.14388) 18295 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:05 smithi044 bash[22676]: audit 2024-09-21T05:17:04.302781+0000 mgr.a (mgr.14388) 18294 : audit [DBG] from='client.393309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:05 smithi044 bash[22676]: cluster 2024-09-21T05:17:04.450972+0000 mgr.a (mgr.14388) 18295 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:05 smithi179 bash[23186]: audit 2024-09-21T05:17:04.302781+0000 mgr.a (mgr.14388) 18294 : audit [DBG] from='client.393309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:05 smithi179 bash[23186]: cluster 2024-09-21T05:17:04.450972+0000 mgr.a (mgr.14388) 18295 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:07 smithi044 bash[22676]: audit 2024-09-21T05:17:06.366315+0000 mon.a (mon.0) 14506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:07 smithi044 bash[22676]: audit 2024-09-21T05:17:06.375231+0000 mon.a (mon.0) 14507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:07 smithi044 bash[22676]: audit 2024-09-21T05:17:06.386427+0000 mon.a (mon.0) 14508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:07 smithi044 bash[22676]: cluster 2024-09-21T05:17:06.453353+0000 mgr.a (mgr.14388) 18296 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:07 smithi179 bash[23186]: audit 2024-09-21T05:17:06.366315+0000 mon.a (mon.0) 14506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:07 smithi179 bash[23186]: audit 2024-09-21T05:17:06.375231+0000 mon.a (mon.0) 14507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:07 smithi179 bash[23186]: audit 2024-09-21T05:17:06.386427+0000 mon.a (mon.0) 14508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:07 smithi179 bash[23186]: cluster 2024-09-21T05:17:06.453353+0000 mgr.a (mgr.14388) 18296 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:07 smithi049 bash[23528]: audit 2024-09-21T05:17:06.366315+0000 mon.a (mon.0) 14506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:07 smithi049 bash[23528]: audit 2024-09-21T05:17:06.375231+0000 mon.a (mon.0) 14507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:07 smithi049 bash[23528]: audit 2024-09-21T05:17:06.386427+0000 mon.a (mon.0) 14508 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:07 smithi049 bash[23528]: cluster 2024-09-21T05:17:06.453353+0000 mgr.a (mgr.14388) 18296 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:09.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:09.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:09.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:09 smithi049 bash[23528]: cluster 2024-09-21T05:17:08.454133+0000 mgr.a (mgr.14388) 18297 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:09 smithi044 bash[22676]: cluster 2024-09-21T05:17:08.454133+0000 mgr.a (mgr.14388) 18297 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:09 smithi179 bash[23186]: cluster 2024-09-21T05:17:08.454133+0000 mgr.a (mgr.14388) 18297 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:10.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:10.516 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:11 smithi049 bash[23528]: audit 2024-09-21T05:17:10.063809+0000 mgr.a (mgr.14388) 18298 : audit [DBG] from='client.393384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:11 smithi049 bash[23528]: cluster 2024-09-21T05:17:10.455631+0000 mgr.a (mgr.14388) 18299 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:11 smithi044 bash[22676]: audit 2024-09-21T05:17:10.063809+0000 mgr.a (mgr.14388) 18298 : audit [DBG] from='client.393384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:11 smithi044 bash[22676]: cluster 2024-09-21T05:17:10.455631+0000 mgr.a (mgr.14388) 18299 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:11 smithi179 bash[23186]: audit 2024-09-21T05:17:10.063809+0000 mgr.a (mgr.14388) 18298 : audit [DBG] from='client.393384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:11 smithi179 bash[23186]: cluster 2024-09-21T05:17:10.455631+0000 mgr.a (mgr.14388) 18299 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:13 smithi049 bash[23528]: cluster 2024-09-21T05:17:12.456417+0000 mgr.a (mgr.14388) 18300 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:13 smithi044 bash[22676]: cluster 2024-09-21T05:17:12.456417+0000 mgr.a (mgr.14388) 18300 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:13 smithi179 bash[23186]: cluster 2024-09-21T05:17:12.456417+0000 mgr.a (mgr.14388) 18300 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:15.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:15.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:15.518 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:15 smithi049 bash[23528]: cluster 2024-09-21T05:17:14.457159+0000 mgr.a (mgr.14388) 18301 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:15 smithi044 bash[22676]: cluster 2024-09-21T05:17:14.457159+0000 mgr.a (mgr.14388) 18301 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:15 smithi179 bash[23186]: cluster 2024-09-21T05:17:14.457159+0000 mgr.a (mgr.14388) 18301 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:16.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:16 smithi179 bash[23186]: audit 2024-09-21T05:17:15.858297+0000 mgr.a (mgr.14388) 18302 : audit [DBG] from='client.393456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:16.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:16 smithi179 bash[23186]: audit 2024-09-21T05:17:16.452707+0000 mon.a (mon.0) 14509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:16 smithi179 bash[23186]: audit 2024-09-21T05:17:16.459249+0000 mon.a (mon.0) 14510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:16 smithi179 bash[23186]: audit 2024-09-21T05:17:16.465542+0000 mon.a (mon.0) 14511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:16 smithi049 bash[23528]: audit 2024-09-21T05:17:15.858297+0000 mgr.a (mgr.14388) 18302 : audit [DBG] from='client.393456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:16 smithi049 bash[23528]: audit 2024-09-21T05:17:16.452707+0000 mon.a (mon.0) 14509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:16 smithi049 bash[23528]: audit 2024-09-21T05:17:16.459249+0000 mon.a (mon.0) 14510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:16 smithi049 bash[23528]: audit 2024-09-21T05:17:16.465542+0000 mon.a (mon.0) 14511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:16 smithi044 bash[22676]: audit 2024-09-21T05:17:15.858297+0000 mgr.a (mgr.14388) 18302 : audit [DBG] from='client.393456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:16 smithi044 bash[22676]: audit 2024-09-21T05:17:16.452707+0000 mon.a (mon.0) 14509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:16 smithi044 bash[22676]: audit 2024-09-21T05:17:16.459249+0000 mon.a (mon.0) 14510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:16.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:16 smithi044 bash[22676]: audit 2024-09-21T05:17:16.465542+0000 mon.a (mon.0) 14511 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:17 smithi044 bash[22676]: cluster 2024-09-21T05:17:16.458930+0000 mgr.a (mgr.14388) 18303 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:17 smithi044 bash[22676]: audit 2024-09-21T05:17:16.612839+0000 mon.a (mon.0) 14512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:17 smithi044 bash[22676]: audit 2024-09-21T05:17:16.619328+0000 mon.a (mon.0) 14513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:17 smithi044 bash[22676]: audit 2024-09-21T05:17:16.626657+0000 mon.a (mon.0) 14514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:17 smithi179 bash[23186]: cluster 2024-09-21T05:17:16.458930+0000 mgr.a (mgr.14388) 18303 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:17 smithi179 bash[23186]: audit 2024-09-21T05:17:16.612839+0000 mon.a (mon.0) 14512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:17 smithi179 bash[23186]: audit 2024-09-21T05:17:16.619328+0000 mon.a (mon.0) 14513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:17 smithi179 bash[23186]: audit 2024-09-21T05:17:16.626657+0000 mon.a (mon.0) 14514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:17 smithi049 bash[23528]: cluster 2024-09-21T05:17:16.458930+0000 mgr.a (mgr.14388) 18303 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:17 smithi049 bash[23528]: audit 2024-09-21T05:17:16.612839+0000 mon.a (mon.0) 14512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:17 smithi049 bash[23528]: audit 2024-09-21T05:17:16.619328+0000 mon.a (mon.0) 14513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:17 smithi049 bash[23528]: audit 2024-09-21T05:17:16.626657+0000 mon.a (mon.0) 14514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:19 smithi044 bash[22676]: cluster 2024-09-21T05:17:18.459836+0000 mgr.a (mgr.14388) 18304 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:19 smithi179 bash[23186]: cluster 2024-09-21T05:17:18.459836+0000 mgr.a (mgr.14388) 18304 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:19 smithi049 bash[23528]: cluster 2024-09-21T05:17:18.459836+0000 mgr.a (mgr.14388) 18304 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:17:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:21.320 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:21.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:21 smithi044 bash[22676]: cluster 2024-09-21T05:17:20.462037+0000 mgr.a (mgr.14388) 18305 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:21 smithi179 bash[23186]: cluster 2024-09-21T05:17:20.462037+0000 mgr.a (mgr.14388) 18305 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:21 smithi049 bash[23528]: cluster 2024-09-21T05:17:20.462037+0000 mgr.a (mgr.14388) 18305 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:22.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:22.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:22.968 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:22 smithi179 bash[23186]: audit 2024-09-21T05:17:21.657213+0000 mgr.a (mgr.14388) 18306 : audit [DBG] from='client.393534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:22.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:22 smithi044 bash[22676]: audit 2024-09-21T05:17:21.657213+0000 mgr.a (mgr.14388) 18306 : audit [DBG] from='client.393534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:23.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:22 smithi049 bash[23528]: audit 2024-09-21T05:17:21.657213+0000 mgr.a (mgr.14388) 18306 : audit [DBG] from='client.393534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:23 smithi044 bash[22676]: cluster 2024-09-21T05:17:22.462941+0000 mgr.a (mgr.14388) 18307 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:24.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:23 smithi179 bash[23186]: cluster 2024-09-21T05:17:22.462941+0000 mgr.a (mgr.14388) 18307 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:23 smithi049 bash[23528]: cluster 2024-09-21T05:17:22.462941+0000 mgr.a (mgr.14388) 18307 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:25 smithi044 bash[22676]: cluster 2024-09-21T05:17:24.463948+0000 mgr.a (mgr.14388) 18308 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:25 smithi179 bash[23186]: cluster 2024-09-21T05:17:24.463948+0000 mgr.a (mgr.14388) 18308 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:25 smithi049 bash[23528]: cluster 2024-09-21T05:17:24.463948+0000 mgr.a (mgr.14388) 18308 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:27.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:27.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:27.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:27.848 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:27.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:27.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:27.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:27.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:27.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:27 smithi044 bash[22676]: cluster 2024-09-21T05:17:26.466353+0000 mgr.a (mgr.14388) 18309 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:27.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:27 smithi044 bash[22676]: audit 2024-09-21T05:17:26.609340+0000 mon.a (mon.0) 14515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:27.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:27 smithi044 bash[22676]: audit 2024-09-21T05:17:26.618451+0000 mon.a (mon.0) 14516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:27.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:27 smithi044 bash[22676]: audit 2024-09-21T05:17:26.629512+0000 mon.a (mon.0) 14517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:27 smithi179 bash[23186]: cluster 2024-09-21T05:17:26.466353+0000 mgr.a (mgr.14388) 18309 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:27 smithi179 bash[23186]: audit 2024-09-21T05:17:26.609340+0000 mon.a (mon.0) 14515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:27 smithi179 bash[23186]: audit 2024-09-21T05:17:26.618451+0000 mon.a (mon.0) 14516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:27 smithi179 bash[23186]: audit 2024-09-21T05:17:26.629512+0000 mon.a (mon.0) 14517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:27 smithi049 bash[23528]: cluster 2024-09-21T05:17:26.466353+0000 mgr.a (mgr.14388) 18309 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:27 smithi049 bash[23528]: audit 2024-09-21T05:17:26.609340+0000 mon.a (mon.0) 14515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:27 smithi049 bash[23528]: audit 2024-09-21T05:17:26.618451+0000 mon.a (mon.0) 14516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:27 smithi049 bash[23528]: audit 2024-09-21T05:17:26.629512+0000 mon.a (mon.0) 14517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:28.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:28 smithi044 bash[22676]: audit 2024-09-21T05:17:27.406043+0000 mgr.a (mgr.14388) 18310 : audit [DBG] from='client.393612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:28 smithi179 bash[23186]: audit 2024-09-21T05:17:27.406043+0000 mgr.a (mgr.14388) 18310 : audit [DBG] from='client.393612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:28 smithi049 bash[23528]: audit 2024-09-21T05:17:27.406043+0000 mgr.a (mgr.14388) 18310 : audit [DBG] from='client.393612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:29.884 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:29 smithi044 bash[22676]: cluster 2024-09-21T05:17:28.467356+0000 mgr.a (mgr.14388) 18311 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:29 smithi179 bash[23186]: cluster 2024-09-21T05:17:28.467356+0000 mgr.a (mgr.14388) 18311 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:29 smithi049 bash[23528]: cluster 2024-09-21T05:17:28.467356+0000 mgr.a (mgr.14388) 18311 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:31 smithi049 bash[23528]: cluster 2024-09-21T05:17:30.468669+0000 mgr.a (mgr.14388) 18312 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:31 smithi044 bash[22676]: cluster 2024-09-21T05:17:30.468669+0000 mgr.a (mgr.14388) 18312 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:31 smithi179 bash[23186]: cluster 2024-09-21T05:17:30.468669+0000 mgr.a (mgr.14388) 18312 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:32.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:32.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:32.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:33.603 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:33 smithi044 bash[22676]: cluster 2024-09-21T05:17:32.469575+0000 mgr.a (mgr.14388) 18313 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:33 smithi179 bash[23186]: cluster 2024-09-21T05:17:32.469575+0000 mgr.a (mgr.14388) 18313 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:33 smithi049 bash[23528]: cluster 2024-09-21T05:17:32.469575+0000 mgr.a (mgr.14388) 18313 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:34.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:34 smithi044 bash[22676]: audit 2024-09-21T05:17:33.179460+0000 mgr.a (mgr.14388) 18314 : audit [DBG] from='client.393690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:34 smithi179 bash[23186]: audit 2024-09-21T05:17:33.179460+0000 mgr.a (mgr.14388) 18314 : audit [DBG] from='client.393690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:34 smithi049 bash[23528]: audit 2024-09-21T05:17:33.179460+0000 mgr.a (mgr.14388) 18314 : audit [DBG] from='client.393690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:35 smithi044 bash[22676]: cluster 2024-09-21T05:17:34.470494+0000 mgr.a (mgr.14388) 18315 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:35 smithi179 bash[23186]: cluster 2024-09-21T05:17:34.470494+0000 mgr.a (mgr.14388) 18315 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:35 smithi049 bash[23528]: cluster 2024-09-21T05:17:34.470494+0000 mgr.a (mgr.14388) 18315 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:37 smithi044 bash[22676]: cluster 2024-09-21T05:17:36.472787+0000 mgr.a (mgr.14388) 18316 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:37 smithi044 bash[22676]: audit 2024-09-21T05:17:36.679772+0000 mon.a (mon.0) 14518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:37 smithi044 bash[22676]: audit 2024-09-21T05:17:36.687068+0000 mon.a (mon.0) 14519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:37 smithi044 bash[22676]: audit 2024-09-21T05:17:36.694973+0000 mon.a (mon.0) 14520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:37 smithi044 bash[22676]: audit 2024-09-21T05:17:36.800753+0000 mon.a (mon.0) 14521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:37 smithi044 bash[22676]: audit 2024-09-21T05:17:36.808105+0000 mon.a (mon.0) 14522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:37.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:37 smithi044 bash[22676]: audit 2024-09-21T05:17:36.816633+0000 mon.a (mon.0) 14523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:37 smithi179 bash[23186]: cluster 2024-09-21T05:17:36.472787+0000 mgr.a (mgr.14388) 18316 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:37 smithi179 bash[23186]: audit 2024-09-21T05:17:36.679772+0000 mon.a (mon.0) 14518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:37 smithi179 bash[23186]: audit 2024-09-21T05:17:36.687068+0000 mon.a (mon.0) 14519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:37 smithi179 bash[23186]: audit 2024-09-21T05:17:36.694973+0000 mon.a (mon.0) 14520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:37 smithi179 bash[23186]: audit 2024-09-21T05:17:36.800753+0000 mon.a (mon.0) 14521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:37 smithi179 bash[23186]: audit 2024-09-21T05:17:36.808105+0000 mon.a (mon.0) 14522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:37 smithi179 bash[23186]: audit 2024-09-21T05:17:36.816633+0000 mon.a (mon.0) 14523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:37 smithi049 bash[23528]: cluster 2024-09-21T05:17:36.472787+0000 mgr.a (mgr.14388) 18316 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:37 smithi049 bash[23528]: audit 2024-09-21T05:17:36.679772+0000 mon.a (mon.0) 14518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:37 smithi049 bash[23528]: audit 2024-09-21T05:17:36.687068+0000 mon.a (mon.0) 14519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:37 smithi049 bash[23528]: audit 2024-09-21T05:17:36.694973+0000 mon.a (mon.0) 14520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:37 smithi049 bash[23528]: audit 2024-09-21T05:17:36.800753+0000 mon.a (mon.0) 14521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:37 smithi049 bash[23528]: audit 2024-09-21T05:17:36.808105+0000 mon.a (mon.0) 14522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:37 smithi049 bash[23528]: audit 2024-09-21T05:17:36.816633+0000 mon.a (mon.0) 14523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:38.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:38.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:38.606 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:39.357 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:39.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:39.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:39.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:39.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:39 smithi044 bash[22676]: cluster 2024-09-21T05:17:38.473575+0000 mgr.a (mgr.14388) 18317 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:39 smithi179 bash[23186]: cluster 2024-09-21T05:17:38.473575+0000 mgr.a (mgr.14388) 18317 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:39 smithi049 bash[23528]: cluster 2024-09-21T05:17:38.473575+0000 mgr.a (mgr.14388) 18317 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:40 smithi044 bash[22676]: audit 2024-09-21T05:17:38.936249+0000 mgr.a (mgr.14388) 18318 : audit [DBG] from='client.393768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:40 smithi179 bash[23186]: audit 2024-09-21T05:17:38.936249+0000 mgr.a (mgr.14388) 18318 : audit [DBG] from='client.393768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:40 smithi049 bash[23528]: audit 2024-09-21T05:17:38.936249+0000 mgr.a (mgr.14388) 18318 : audit [DBG] from='client.393768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:41 smithi044 bash[22676]: cluster 2024-09-21T05:17:40.475908+0000 mgr.a (mgr.14388) 18319 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:41 smithi179 bash[23186]: cluster 2024-09-21T05:17:40.475908+0000 mgr.a (mgr.14388) 18319 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:41 smithi049 bash[23528]: cluster 2024-09-21T05:17:40.475908+0000 mgr.a (mgr.14388) 18319 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:17:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:43 smithi044 bash[22676]: cluster 2024-09-21T05:17:42.476711+0000 mgr.a (mgr.14388) 18320 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:43 smithi179 bash[23186]: cluster 2024-09-21T05:17:42.476711+0000 mgr.a (mgr.14388) 18320 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:43 smithi049 bash[23528]: cluster 2024-09-21T05:17:42.476711+0000 mgr.a (mgr.14388) 18320 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:44.358 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:44.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:44.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:45.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:45.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: cluster 2024-09-21T05:17:44.477281+0000 mgr.a (mgr.14388) 18321 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:44.683802+0000 mgr.a (mgr.14388) 18322 : audit [DBG] from='client.393846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:44.953724+0000 mon.a (mon.0) 14524 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:17:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:45.519256+0000 mon.a (mon.0) 14525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:45.527692+0000 mon.a (mon.0) 14526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:45.530738+0000 mon.a (mon.0) 14527 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:17:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:45.533072+0000 mon.a (mon.0) 14528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:17:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:45.544417+0000 mon.a (mon.0) 14529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:45.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:45 smithi044 bash[22676]: audit 2024-09-21T05:17:45.550875+0000 mon.a (mon.0) 14530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:17:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: cluster 2024-09-21T05:17:44.477281+0000 mgr.a (mgr.14388) 18321 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:44.683802+0000 mgr.a (mgr.14388) 18322 : audit [DBG] from='client.393846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:44.953724+0000 mon.a (mon.0) 14524 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:45.519256+0000 mon.a (mon.0) 14525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:45.527692+0000 mon.a (mon.0) 14526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:45.530738+0000 mon.a (mon.0) 14527 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:45.533072+0000 mon.a (mon.0) 14528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:45.544417+0000 mon.a (mon.0) 14529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:46.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:45 smithi179 bash[23186]: audit 2024-09-21T05:17:45.550875+0000 mon.a (mon.0) 14530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: cluster 2024-09-21T05:17:44.477281+0000 mgr.a (mgr.14388) 18321 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:44.683802+0000 mgr.a (mgr.14388) 18322 : audit [DBG] from='client.393846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:44.953724+0000 mon.a (mon.0) 14524 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:45.519256+0000 mon.a (mon.0) 14525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:45.527692+0000 mon.a (mon.0) 14526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:45.530738+0000 mon.a (mon.0) 14527 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:45.533072+0000 mon.a (mon.0) 14528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:45.544417+0000 mon.a (mon.0) 14529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:46.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:45 smithi049 bash[23528]: audit 2024-09-21T05:17:45.550875+0000 mon.a (mon.0) 14530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:17:46.721 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:17:46 smithi044 bash[22930]: debug 2024-09-21T05:17:46.316+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:17:46.721 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:17:46 smithi044 bash[22930]: debug 2024-09-21T05:17:46.316+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:17:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:46 smithi044 bash[22676]: audit 2024-09-21T05:17:45.553742+0000 mgr.a (mgr.14388) 18323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:17:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:46 smithi179 bash[23186]: audit 2024-09-21T05:17:45.553742+0000 mgr.a (mgr.14388) 18323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:17:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:46 smithi049 bash[23528]: audit 2024-09-21T05:17:45.553742+0000 mgr.a (mgr.14388) 18323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:17:48.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:47 smithi044 bash[22676]: audit 2024-09-21T05:17:46.319304+0000 mgr.a (mgr.14388) 18324 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:17:48.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:47 smithi044 bash[22676]: cephadm 2024-09-21T05:17:46.320553+0000 mgr.a (mgr.14388) 18325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:17:48.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:47 smithi044 bash[22676]: cluster 2024-09-21T05:17:46.480079+0000 mgr.a (mgr.14388) 18326 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:17:48.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:47 smithi044 bash[22676]: audit 2024-09-21T05:17:46.844154+0000 mon.a (mon.0) 14531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:47 smithi044 bash[22676]: audit 2024-09-21T05:17:46.852758+0000 mon.a (mon.0) 14532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.222 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:47 smithi044 bash[22676]: audit 2024-09-21T05:17:46.863287+0000 mon.a (mon.0) 14533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:47 smithi179 bash[23186]: audit 2024-09-21T05:17:46.319304+0000 mgr.a (mgr.14388) 18324 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:17:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:47 smithi179 bash[23186]: cephadm 2024-09-21T05:17:46.320553+0000 mgr.a (mgr.14388) 18325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:17:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:47 smithi179 bash[23186]: cluster 2024-09-21T05:17:46.480079+0000 mgr.a (mgr.14388) 18326 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:17:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:47 smithi179 bash[23186]: audit 2024-09-21T05:17:46.844154+0000 mon.a (mon.0) 14531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:47 smithi179 bash[23186]: audit 2024-09-21T05:17:46.852758+0000 mon.a (mon.0) 14532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:47 smithi179 bash[23186]: audit 2024-09-21T05:17:46.863287+0000 mon.a (mon.0) 14533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:47 smithi049 bash[23528]: audit 2024-09-21T05:17:46.319304+0000 mgr.a (mgr.14388) 18324 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:17:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:47 smithi049 bash[23528]: cephadm 2024-09-21T05:17:46.320553+0000 mgr.a (mgr.14388) 18325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:17:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:47 smithi049 bash[23528]: cluster 2024-09-21T05:17:46.480079+0000 mgr.a (mgr.14388) 18326 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:17:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:47 smithi049 bash[23528]: audit 2024-09-21T05:17:46.844154+0000 mon.a (mon.0) 14531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:47 smithi049 bash[23528]: audit 2024-09-21T05:17:46.852758+0000 mon.a (mon.0) 14532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:47 smithi049 bash[23528]: audit 2024-09-21T05:17:46.863287+0000 mon.a (mon.0) 14533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:49 smithi049 bash[23528]: cluster 2024-09-21T05:17:48.480637+0000 mgr.a (mgr.14388) 18327 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:50.117 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:49 smithi044 bash[22676]: cluster 2024-09-21T05:17:48.480637+0000 mgr.a (mgr.14388) 18327 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:49 smithi179 bash[23186]: cluster 2024-09-21T05:17:48.480637+0000 mgr.a (mgr.14388) 18327 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:50.892 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:51 smithi049 bash[23528]: audit 2024-09-21T05:17:50.441461+0000 mgr.a (mgr.14388) 18328 : audit [DBG] from='client.394029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:51 smithi049 bash[23528]: cluster 2024-09-21T05:17:50.482147+0000 mgr.a (mgr.14388) 18329 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:17:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:51 smithi044 bash[22676]: audit 2024-09-21T05:17:50.441461+0000 mgr.a (mgr.14388) 18328 : audit [DBG] from='client.394029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:51 smithi044 bash[22676]: cluster 2024-09-21T05:17:50.482147+0000 mgr.a (mgr.14388) 18329 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:17:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:51 smithi179 bash[23186]: audit 2024-09-21T05:17:50.441461+0000 mgr.a (mgr.14388) 18328 : audit [DBG] from='client.394029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:51 smithi179 bash[23186]: cluster 2024-09-21T05:17:50.482147+0000 mgr.a (mgr.14388) 18329 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:17:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:53 smithi044 bash[22676]: cluster 2024-09-21T05:17:52.483074+0000 mgr.a (mgr.14388) 18330 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:17:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:53 smithi179 bash[23186]: cluster 2024-09-21T05:17:52.483074+0000 mgr.a (mgr.14388) 18330 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:17:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:53 smithi049 bash[23528]: cluster 2024-09-21T05:17:52.483074+0000 mgr.a (mgr.14388) 18330 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:17:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:17:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:17:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:17:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:55 smithi044 bash[22676]: cluster 2024-09-21T05:17:54.483874+0000 mgr.a (mgr.14388) 18331 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:17:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:55 smithi179 bash[23186]: cluster 2024-09-21T05:17:54.483874+0000 mgr.a (mgr.14388) 18331 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:17:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:55 smithi049 bash[23528]: cluster 2024-09-21T05:17:54.483874+0000 mgr.a (mgr.14388) 18331 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:17:56.674 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:17:56.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:17:56.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:17:56.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:17:56.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:17:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: audit 2024-09-21T05:17:56.232795+0000 mgr.a (mgr.14388) 18332 : audit [DBG] from='client.394104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: cluster 2024-09-21T05:17:56.485380+0000 mgr.a (mgr.14388) 18333 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:17:58.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: audit 2024-09-21T05:17:56.902951+0000 mon.a (mon.0) 14534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: audit 2024-09-21T05:17:56.912303+0000 mon.a (mon.0) 14535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: audit 2024-09-21T05:17:56.921569+0000 mon.a (mon.0) 14536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: audit 2024-09-21T05:17:57.033265+0000 mon.a (mon.0) 14537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: audit 2024-09-21T05:17:57.041582+0000 mon.a (mon.0) 14538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:57 smithi044 bash[22676]: audit 2024-09-21T05:17:57.052206+0000 mon.a (mon.0) 14539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: audit 2024-09-21T05:17:56.232795+0000 mgr.a (mgr.14388) 18332 : audit [DBG] from='client.394104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: cluster 2024-09-21T05:17:56.485380+0000 mgr.a (mgr.14388) 18333 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:17:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: audit 2024-09-21T05:17:56.902951+0000 mon.a (mon.0) 14534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: audit 2024-09-21T05:17:56.912303+0000 mon.a (mon.0) 14535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: audit 2024-09-21T05:17:56.921569+0000 mon.a (mon.0) 14536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: audit 2024-09-21T05:17:57.033265+0000 mon.a (mon.0) 14537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: audit 2024-09-21T05:17:57.041582+0000 mon.a (mon.0) 14538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:57 smithi179 bash[23186]: audit 2024-09-21T05:17:57.052206+0000 mon.a (mon.0) 14539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: audit 2024-09-21T05:17:56.232795+0000 mgr.a (mgr.14388) 18332 : audit [DBG] from='client.394104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:58.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: cluster 2024-09-21T05:17:56.485380+0000 mgr.a (mgr.14388) 18333 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:17:58.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: audit 2024-09-21T05:17:56.902951+0000 mon.a (mon.0) 14534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: audit 2024-09-21T05:17:56.912303+0000 mon.a (mon.0) 14535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: audit 2024-09-21T05:17:56.921569+0000 mon.a (mon.0) 14536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: audit 2024-09-21T05:17:57.033265+0000 mon.a (mon.0) 14537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: audit 2024-09-21T05:17:57.041582+0000 mon.a (mon.0) 14538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:17:58.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:57 smithi049 bash[23528]: audit 2024-09-21T05:17:57.052206+0000 mon.a (mon.0) 14539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:17:59 smithi044 bash[22676]: cluster 2024-09-21T05:17:58.486362+0000 mgr.a (mgr.14388) 18334 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:18:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:17:59 smithi179 bash[23186]: cluster 2024-09-21T05:17:58.486362+0000 mgr.a (mgr.14388) 18334 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:18:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:17:59 smithi049 bash[23528]: cluster 2024-09-21T05:17:58.486362+0000 mgr.a (mgr.14388) 18334 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:18:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:01.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:01.676 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:01 smithi044 bash[22676]: cluster 2024-09-21T05:18:00.488600+0000 mgr.a (mgr.14388) 18335 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:01 smithi179 bash[23186]: cluster 2024-09-21T05:18:00.488600+0000 mgr.a (mgr.14388) 18335 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:01 smithi049 bash[23528]: cluster 2024-09-21T05:18:00.488600+0000 mgr.a (mgr.14388) 18335 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:02.448 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:02.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:02.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:02.449 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:02.449 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:03 smithi044 bash[22676]: audit 2024-09-21T05:18:02.008131+0000 mgr.a (mgr.14388) 18336 : audit [DBG] from='client.394176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:03 smithi044 bash[22676]: cluster 2024-09-21T05:18:02.489324+0000 mgr.a (mgr.14388) 18337 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:03 smithi179 bash[23186]: audit 2024-09-21T05:18:02.008131+0000 mgr.a (mgr.14388) 18336 : audit [DBG] from='client.394176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:03 smithi179 bash[23186]: cluster 2024-09-21T05:18:02.489324+0000 mgr.a (mgr.14388) 18337 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:03 smithi049 bash[23528]: audit 2024-09-21T05:18:02.008131+0000 mgr.a (mgr.14388) 18336 : audit [DBG] from='client.394176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:03 smithi049 bash[23528]: cluster 2024-09-21T05:18:02.489324+0000 mgr.a (mgr.14388) 18337 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:06.179 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:05 smithi179 bash[23186]: cluster 2024-09-21T05:18:04.490239+0000 mgr.a (mgr.14388) 18338 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:05 smithi044 bash[22676]: cluster 2024-09-21T05:18:04.490239+0000 mgr.a (mgr.14388) 18338 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:05 smithi049 bash[23528]: cluster 2024-09-21T05:18:04.490239+0000 mgr.a (mgr.14388) 18338 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:07.450 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:07.450 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:07.451 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:08.192 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:08.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:08.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:08.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:08.192 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:07 smithi044 bash[22676]: cluster 2024-09-21T05:18:06.492664+0000 mgr.a (mgr.14388) 18339 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:07 smithi044 bash[22676]: audit 2024-09-21T05:18:07.079605+0000 mon.a (mon.0) 14540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:07 smithi044 bash[22676]: audit 2024-09-21T05:18:07.088581+0000 mon.a (mon.0) 14541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:07 smithi044 bash[22676]: audit 2024-09-21T05:18:07.099793+0000 mon.a (mon.0) 14542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:07 smithi179 bash[23186]: cluster 2024-09-21T05:18:06.492664+0000 mgr.a (mgr.14388) 18339 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:07 smithi179 bash[23186]: audit 2024-09-21T05:18:07.079605+0000 mon.a (mon.0) 14540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:07 smithi179 bash[23186]: audit 2024-09-21T05:18:07.088581+0000 mon.a (mon.0) 14541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:07 smithi179 bash[23186]: audit 2024-09-21T05:18:07.099793+0000 mon.a (mon.0) 14542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:07 smithi049 bash[23528]: cluster 2024-09-21T05:18:06.492664+0000 mgr.a (mgr.14388) 18339 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:07 smithi049 bash[23528]: audit 2024-09-21T05:18:07.079605+0000 mon.a (mon.0) 14540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:07 smithi049 bash[23528]: audit 2024-09-21T05:18:07.088581+0000 mon.a (mon.0) 14541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:07 smithi049 bash[23528]: audit 2024-09-21T05:18:07.099793+0000 mon.a (mon.0) 14542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:08 smithi044 bash[22676]: audit 2024-09-21T05:18:07.774800+0000 mgr.a (mgr.14388) 18340 : audit [DBG] from='client.394251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:08 smithi179 bash[23186]: audit 2024-09-21T05:18:07.774800+0000 mgr.a (mgr.14388) 18340 : audit [DBG] from='client.394251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:08 smithi049 bash[23528]: audit 2024-09-21T05:18:07.774800+0000 mgr.a (mgr.14388) 18340 : audit [DBG] from='client.394251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:09 smithi044 bash[22676]: cluster 2024-09-21T05:18:08.493716+0000 mgr.a (mgr.14388) 18341 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:10.251 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:09 smithi049 bash[23528]: cluster 2024-09-21T05:18:08.493716+0000 mgr.a (mgr.14388) 18341 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:09 smithi179 bash[23186]: cluster 2024-09-21T05:18:08.493716+0000 mgr.a (mgr.14388) 18341 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:11 smithi044 bash[22676]: cluster 2024-09-21T05:18:10.495941+0000 mgr.a (mgr.14388) 18342 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:11 smithi179 bash[23186]: cluster 2024-09-21T05:18:10.495941+0000 mgr.a (mgr.14388) 18342 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:11 smithi049 bash[23528]: cluster 2024-09-21T05:18:10.495941+0000 mgr.a (mgr.14388) 18342 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:13.193 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:13.194 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:13.194 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:12 smithi179 bash[23186]: cluster 2024-09-21T05:18:12.496732+0000 mgr.a (mgr.14388) 18343 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:13.255 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:12 smithi049 bash[23528]: cluster 2024-09-21T05:18:12.496732+0000 mgr.a (mgr.14388) 18343 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:12 smithi044 bash[22676]: cluster 2024-09-21T05:18:12.496732+0000 mgr.a (mgr.14388) 18343 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:13.972 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:13.972 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:13.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:13.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:13.973 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:13 smithi179 bash[23186]: audit 2024-09-21T05:18:13.525392+0000 mgr.a (mgr.14388) 18344 : audit [DBG] from='client.394326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:13 smithi049 bash[23528]: audit 2024-09-21T05:18:13.525392+0000 mgr.a (mgr.14388) 18344 : audit [DBG] from='client.394326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:13 smithi044 bash[22676]: audit 2024-09-21T05:18:13.525392+0000 mgr.a (mgr.14388) 18344 : audit [DBG] from='client.394326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:15 smithi049 bash[23528]: cluster 2024-09-21T05:18:14.497743+0000 mgr.a (mgr.14388) 18345 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:15 smithi044 bash[22676]: cluster 2024-09-21T05:18:14.497743+0000 mgr.a (mgr.14388) 18345 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:15 smithi179 bash[23186]: cluster 2024-09-21T05:18:14.497743+0000 mgr.a (mgr.14388) 18345 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:17.843 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:17 smithi049 bash[23528]: cluster 2024-09-21T05:18:16.500011+0000 mgr.a (mgr.14388) 18346 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:17.843 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:17 smithi049 bash[23528]: audit 2024-09-21T05:18:17.115635+0000 mon.a (mon.0) 14543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.843 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:17 smithi049 bash[23528]: audit 2024-09-21T05:18:17.122053+0000 mon.a (mon.0) 14544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.843 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:17 smithi049 bash[23528]: audit 2024-09-21T05:18:17.130113+0000 mon.a (mon.0) 14545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.843 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:17 smithi049 bash[23528]: audit 2024-09-21T05:18:17.261336+0000 mon.a (mon.0) 14546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.843 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:17 smithi049 bash[23528]: audit 2024-09-21T05:18:17.269051+0000 mon.a (mon.0) 14547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.843 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:17 smithi049 bash[23528]: audit 2024-09-21T05:18:17.277688+0000 mon.a (mon.0) 14548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:17 smithi044 bash[22676]: cluster 2024-09-21T05:18:16.500011+0000 mgr.a (mgr.14388) 18346 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:17 smithi044 bash[22676]: audit 2024-09-21T05:18:17.115635+0000 mon.a (mon.0) 14543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:17 smithi044 bash[22676]: audit 2024-09-21T05:18:17.122053+0000 mon.a (mon.0) 14544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:17 smithi044 bash[22676]: audit 2024-09-21T05:18:17.130113+0000 mon.a (mon.0) 14545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:17 smithi044 bash[22676]: audit 2024-09-21T05:18:17.261336+0000 mon.a (mon.0) 14546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:17 smithi044 bash[22676]: audit 2024-09-21T05:18:17.269051+0000 mon.a (mon.0) 14547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:17.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:17 smithi044 bash[22676]: audit 2024-09-21T05:18:17.277688+0000 mon.a (mon.0) 14548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:17 smithi179 bash[23186]: cluster 2024-09-21T05:18:16.500011+0000 mgr.a (mgr.14388) 18346 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:17 smithi179 bash[23186]: audit 2024-09-21T05:18:17.115635+0000 mon.a (mon.0) 14543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:17 smithi179 bash[23186]: audit 2024-09-21T05:18:17.122053+0000 mon.a (mon.0) 14544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:17 smithi179 bash[23186]: audit 2024-09-21T05:18:17.130113+0000 mon.a (mon.0) 14545 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:17 smithi179 bash[23186]: audit 2024-09-21T05:18:17.261336+0000 mon.a (mon.0) 14546 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:17 smithi179 bash[23186]: audit 2024-09-21T05:18:17.269051+0000 mon.a (mon.0) 14547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:18.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:17 smithi179 bash[23186]: audit 2024-09-21T05:18:17.277688+0000 mon.a (mon.0) 14548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:19.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:19.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:19.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:19.763 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:19.764 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:19.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:19 smithi044 bash[22676]: cluster 2024-09-21T05:18:18.500757+0000 mgr.a (mgr.14388) 18347 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:19 smithi179 bash[23186]: cluster 2024-09-21T05:18:18.500757+0000 mgr.a (mgr.14388) 18347 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:19 smithi049 bash[23528]: cluster 2024-09-21T05:18:18.500757+0000 mgr.a (mgr.14388) 18347 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:20 smithi044 bash[22676]: audit 2024-09-21T05:18:19.306722+0000 mgr.a (mgr.14388) 18348 : audit [DBG] from='client.394404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:20 smithi179 bash[23186]: audit 2024-09-21T05:18:19.306722+0000 mgr.a (mgr.14388) 18348 : audit [DBG] from='client.394404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:20 smithi049 bash[23528]: audit 2024-09-21T05:18:19.306722+0000 mgr.a (mgr.14388) 18348 : audit [DBG] from='client.394404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:21 smithi044 bash[22676]: cluster 2024-09-21T05:18:20.503095+0000 mgr.a (mgr.14388) 18349 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:21 smithi179 bash[23186]: cluster 2024-09-21T05:18:20.503095+0000 mgr.a (mgr.14388) 18349 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:21 smithi049 bash[23528]: cluster 2024-09-21T05:18:20.503095+0000 mgr.a (mgr.14388) 18349 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:23.923 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:23 smithi179 bash[23186]: cluster 2024-09-21T05:18:22.503859+0000 mgr.a (mgr.14388) 18350 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:23 smithi044 bash[22676]: cluster 2024-09-21T05:18:22.503859+0000 mgr.a (mgr.14388) 18350 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:23 smithi049 bash[23528]: cluster 2024-09-21T05:18:22.503859+0000 mgr.a (mgr.14388) 18350 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:24.764 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:24.765 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:24.766 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:25.560 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:25.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:25.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:25.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:25.561 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:25 smithi044 bash[22676]: cluster 2024-09-21T05:18:24.504647+0000 mgr.a (mgr.14388) 18351 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:25 smithi179 bash[23186]: cluster 2024-09-21T05:18:24.504647+0000 mgr.a (mgr.14388) 18351 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:25 smithi049 bash[23528]: cluster 2024-09-21T05:18:24.504647+0000 mgr.a (mgr.14388) 18351 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:26 smithi179 bash[23186]: audit 2024-09-21T05:18:25.109819+0000 mgr.a (mgr.14388) 18352 : audit [DBG] from='client.394482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:26 smithi044 bash[22676]: audit 2024-09-21T05:18:25.109819+0000 mgr.a (mgr.14388) 18352 : audit [DBG] from='client.394482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:26 smithi049 bash[23528]: audit 2024-09-21T05:18:25.109819+0000 mgr.a (mgr.14388) 18352 : audit [DBG] from='client.394482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:27 smithi044 bash[22676]: cluster 2024-09-21T05:18:26.507658+0000 mgr.a (mgr.14388) 18353 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:27 smithi044 bash[22676]: audit 2024-09-21T05:18:27.310104+0000 mon.a (mon.0) 14549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:27 smithi044 bash[22676]: audit 2024-09-21T05:18:27.319411+0000 mon.a (mon.0) 14550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:27.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:27 smithi044 bash[22676]: audit 2024-09-21T05:18:27.330509+0000 mon.a (mon.0) 14551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:27 smithi179 bash[23186]: cluster 2024-09-21T05:18:26.507658+0000 mgr.a (mgr.14388) 18353 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:27 smithi179 bash[23186]: audit 2024-09-21T05:18:27.310104+0000 mon.a (mon.0) 14549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:27 smithi179 bash[23186]: audit 2024-09-21T05:18:27.319411+0000 mon.a (mon.0) 14550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:28.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:27 smithi179 bash[23186]: audit 2024-09-21T05:18:27.330509+0000 mon.a (mon.0) 14551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:27 smithi049 bash[23528]: cluster 2024-09-21T05:18:26.507658+0000 mgr.a (mgr.14388) 18353 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:27 smithi049 bash[23528]: audit 2024-09-21T05:18:27.310104+0000 mon.a (mon.0) 14549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:27 smithi049 bash[23528]: audit 2024-09-21T05:18:27.319411+0000 mon.a (mon.0) 14550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:27 smithi049 bash[23528]: audit 2024-09-21T05:18:27.330509+0000 mon.a (mon.0) 14551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:29.862 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:29 smithi044 bash[22676]: cluster 2024-09-21T05:18:28.508474+0000 mgr.a (mgr.14388) 18354 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:18:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:29 smithi179 bash[23186]: cluster 2024-09-21T05:18:28.508474+0000 mgr.a (mgr.14388) 18354 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:18:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:29 smithi049 bash[23528]: cluster 2024-09-21T05:18:28.508474+0000 mgr.a (mgr.14388) 18354 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:18:30.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:31.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:31.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:31.922 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:31 smithi049 bash[23528]: cluster 2024-09-21T05:18:30.510509+0000 mgr.a (mgr.14388) 18355 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:31.923 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:31 smithi049 bash[23528]: audit 2024-09-21T05:18:30.893573+0000 mgr.a (mgr.14388) 18356 : audit [DBG] from='client.394560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:31 smithi044 bash[22676]: cluster 2024-09-21T05:18:30.510509+0000 mgr.a (mgr.14388) 18355 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:31 smithi044 bash[22676]: audit 2024-09-21T05:18:30.893573+0000 mgr.a (mgr.14388) 18356 : audit [DBG] from='client.394560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:31 smithi179 bash[23186]: cluster 2024-09-21T05:18:30.510509+0000 mgr.a (mgr.14388) 18355 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:31 smithi179 bash[23186]: audit 2024-09-21T05:18:30.893573+0000 mgr.a (mgr.14388) 18356 : audit [DBG] from='client.394560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:33 smithi044 bash[22676]: cluster 2024-09-21T05:18:32.511498+0000 mgr.a (mgr.14388) 18357 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:18:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:33 smithi179 bash[23186]: cluster 2024-09-21T05:18:32.511498+0000 mgr.a (mgr.14388) 18357 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:18:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:33 smithi049 bash[23528]: cluster 2024-09-21T05:18:32.511498+0000 mgr.a (mgr.14388) 18357 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:18:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:35 smithi044 bash[22676]: cluster 2024-09-21T05:18:34.512299+0000 mgr.a (mgr.14388) 18358 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:18:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:35 smithi179 bash[23186]: cluster 2024-09-21T05:18:34.512299+0000 mgr.a (mgr.14388) 18358 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:18:36.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:35 smithi049 bash[23528]: cluster 2024-09-21T05:18:34.512299+0000 mgr.a (mgr.14388) 18358 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:18:36.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:36.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:36.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:37.076 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:37.076 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: cluster 2024-09-21T05:18:36.514499+0000 mgr.a (mgr.14388) 18359 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: audit 2024-09-21T05:18:36.655683+0000 mgr.a (mgr.14388) 18360 : audit [DBG] from='client.394635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: audit 2024-09-21T05:18:37.338434+0000 mon.a (mon.0) 14552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: audit 2024-09-21T05:18:37.345422+0000 mon.a (mon.0) 14553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: audit 2024-09-21T05:18:37.352939+0000 mon.a (mon.0) 14554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: audit 2024-09-21T05:18:37.465166+0000 mon.a (mon.0) 14555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: audit 2024-09-21T05:18:37.473051+0000 mon.a (mon.0) 14556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:37.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:37 smithi044 bash[22676]: audit 2024-09-21T05:18:37.482743+0000 mon.a (mon.0) 14557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: cluster 2024-09-21T05:18:36.514499+0000 mgr.a (mgr.14388) 18359 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: audit 2024-09-21T05:18:36.655683+0000 mgr.a (mgr.14388) 18360 : audit [DBG] from='client.394635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: audit 2024-09-21T05:18:37.338434+0000 mon.a (mon.0) 14552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: audit 2024-09-21T05:18:37.345422+0000 mon.a (mon.0) 14553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: audit 2024-09-21T05:18:37.352939+0000 mon.a (mon.0) 14554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: audit 2024-09-21T05:18:37.465166+0000 mon.a (mon.0) 14555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: audit 2024-09-21T05:18:37.473051+0000 mon.a (mon.0) 14556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:37 smithi179 bash[23186]: audit 2024-09-21T05:18:37.482743+0000 mon.a (mon.0) 14557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: cluster 2024-09-21T05:18:36.514499+0000 mgr.a (mgr.14388) 18359 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: audit 2024-09-21T05:18:36.655683+0000 mgr.a (mgr.14388) 18360 : audit [DBG] from='client.394635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: audit 2024-09-21T05:18:37.338434+0000 mon.a (mon.0) 14552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: audit 2024-09-21T05:18:37.345422+0000 mon.a (mon.0) 14553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: audit 2024-09-21T05:18:37.352939+0000 mon.a (mon.0) 14554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: audit 2024-09-21T05:18:37.465166+0000 mon.a (mon.0) 14555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: audit 2024-09-21T05:18:37.473051+0000 mon.a (mon.0) 14556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:38.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:37 smithi049 bash[23528]: audit 2024-09-21T05:18:37.482743+0000 mon.a (mon.0) 14557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:39 smithi044 bash[22676]: cluster 2024-09-21T05:18:38.515412+0000 mgr.a (mgr.14388) 18361 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:39 smithi179 bash[23186]: cluster 2024-09-21T05:18:38.515412+0000 mgr.a (mgr.14388) 18361 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:39 smithi049 bash[23528]: cluster 2024-09-21T05:18:38.515412+0000 mgr.a (mgr.14388) 18361 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:41 smithi044 bash[22676]: cluster 2024-09-21T05:18:40.517582+0000 mgr.a (mgr.14388) 18362 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:41 smithi179 bash[23186]: cluster 2024-09-21T05:18:40.517582+0000 mgr.a (mgr.14388) 18362 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:41 smithi049 bash[23528]: cluster 2024-09-21T05:18:40.517582+0000 mgr.a (mgr.14388) 18362 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:42.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:42.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:42.078 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:42.867 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:42.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:43 smithi044 bash[22676]: audit 2024-09-21T05:18:42.413841+0000 mgr.a (mgr.14388) 18363 : audit [DBG] from='client.394713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:43 smithi044 bash[22676]: cluster 2024-09-21T05:18:42.518127+0000 mgr.a (mgr.14388) 18364 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:43 smithi179 bash[23186]: audit 2024-09-21T05:18:42.413841+0000 mgr.a (mgr.14388) 18363 : audit [DBG] from='client.394713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:43 smithi179 bash[23186]: cluster 2024-09-21T05:18:42.518127+0000 mgr.a (mgr.14388) 18364 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:43 smithi049 bash[23528]: audit 2024-09-21T05:18:42.413841+0000 mgr.a (mgr.14388) 18363 : audit [DBG] from='client.394713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:43 smithi049 bash[23528]: cluster 2024-09-21T05:18:42.518127+0000 mgr.a (mgr.14388) 18364 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:45 smithi044 bash[22676]: cluster 2024-09-21T05:18:44.519024+0000 mgr.a (mgr.14388) 18365 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:45 smithi179 bash[23186]: cluster 2024-09-21T05:18:44.519024+0000 mgr.a (mgr.14388) 18365 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:45 smithi049 bash[23528]: cluster 2024-09-21T05:18:44.519024+0000 mgr.a (mgr.14388) 18365 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:46 smithi044 bash[22676]: audit 2024-09-21T05:18:46.373158+0000 mon.a (mon.0) 14558 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:18:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:46 smithi044 bash[22676]: audit 2024-09-21T05:18:46.380364+0000 mon.a (mon.0) 14559 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:46 smithi044 bash[22676]: audit 2024-09-21T05:18:46.382191+0000 mon.a (mon.0) 14560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:46 smithi044 bash[22676]: audit 2024-09-21T05:18:46.393573+0000 mon.a (mon.0) 14561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:46 smithi044 bash[22676]: audit 2024-09-21T05:18:46.399901+0000 mon.a (mon.0) 14562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:18:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:46 smithi179 bash[23186]: audit 2024-09-21T05:18:46.373158+0000 mon.a (mon.0) 14558 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:18:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:46 smithi179 bash[23186]: audit 2024-09-21T05:18:46.380364+0000 mon.a (mon.0) 14559 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:46 smithi179 bash[23186]: audit 2024-09-21T05:18:46.382191+0000 mon.a (mon.0) 14560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:46 smithi179 bash[23186]: audit 2024-09-21T05:18:46.393573+0000 mon.a (mon.0) 14561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:46 smithi179 bash[23186]: audit 2024-09-21T05:18:46.399901+0000 mon.a (mon.0) 14562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:18:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:46 smithi049 bash[23528]: audit 2024-09-21T05:18:46.373158+0000 mon.a (mon.0) 14558 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:18:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:46 smithi049 bash[23528]: audit 2024-09-21T05:18:46.380364+0000 mon.a (mon.0) 14559 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:47.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:46 smithi049 bash[23528]: audit 2024-09-21T05:18:46.382191+0000 mon.a (mon.0) 14560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:47.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:46 smithi049 bash[23528]: audit 2024-09-21T05:18:46.393573+0000 mon.a (mon.0) 14561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:47.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:46 smithi049 bash[23528]: audit 2024-09-21T05:18:46.399901+0000 mon.a (mon.0) 14562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:18:47.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:18:47 smithi044 bash[22930]: debug 2024-09-21T05:18:47.208+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:18:47.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:18:47 smithi044 bash[22930]: debug 2024-09-21T05:18:47.208+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:18:47.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:47.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:47.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:47 smithi044 bash[22676]: audit 2024-09-21T05:18:46.402364+0000 mgr.a (mgr.14388) 18366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:18:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:47 smithi044 bash[22676]: cluster 2024-09-21T05:18:46.520725+0000 mgr.a (mgr.14388) 18367 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:47 smithi044 bash[22676]: audit 2024-09-21T05:18:47.550707+0000 mon.a (mon.0) 14563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:47 smithi044 bash[22676]: audit 2024-09-21T05:18:47.559261+0000 mon.a (mon.0) 14564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:47 smithi044 bash[22676]: audit 2024-09-21T05:18:47.569551+0000 mon.a (mon.0) 14565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:47 smithi179 bash[23186]: audit 2024-09-21T05:18:46.402364+0000 mgr.a (mgr.14388) 18366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:18:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:47 smithi179 bash[23186]: cluster 2024-09-21T05:18:46.520725+0000 mgr.a (mgr.14388) 18367 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:47 smithi179 bash[23186]: audit 2024-09-21T05:18:47.550707+0000 mon.a (mon.0) 14563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:47 smithi179 bash[23186]: audit 2024-09-21T05:18:47.559261+0000 mon.a (mon.0) 14564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:47 smithi179 bash[23186]: audit 2024-09-21T05:18:47.569551+0000 mon.a (mon.0) 14565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:47 smithi049 bash[23528]: audit 2024-09-21T05:18:46.402364+0000 mgr.a (mgr.14388) 18366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:18:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:47 smithi049 bash[23528]: cluster 2024-09-21T05:18:46.520725+0000 mgr.a (mgr.14388) 18367 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:18:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:47 smithi049 bash[23528]: audit 2024-09-21T05:18:47.550707+0000 mon.a (mon.0) 14563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:47 smithi049 bash[23528]: audit 2024-09-21T05:18:47.559261+0000 mon.a (mon.0) 14564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:47 smithi049 bash[23528]: audit 2024-09-21T05:18:47.569551+0000 mon.a (mon.0) 14565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:48.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:48.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:48.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:48.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:48.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:48 smithi044 bash[22676]: audit 2024-09-21T05:18:47.209360+0000 mgr.a (mgr.14388) 18368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:18:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:48 smithi044 bash[22676]: cephadm 2024-09-21T05:18:47.210592+0000 mgr.a (mgr.14388) 18369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:18:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:48 smithi179 bash[23186]: audit 2024-09-21T05:18:47.209360+0000 mgr.a (mgr.14388) 18368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:18:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:48 smithi179 bash[23186]: cephadm 2024-09-21T05:18:47.210592+0000 mgr.a (mgr.14388) 18369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:18:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:48 smithi049 bash[23528]: audit 2024-09-21T05:18:47.209360+0000 mgr.a (mgr.14388) 18368 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:18:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:48 smithi049 bash[23528]: cephadm 2024-09-21T05:18:47.210592+0000 mgr.a (mgr.14388) 18369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:18:49.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:49 smithi044 bash[22676]: audit 2024-09-21T05:18:48.191512+0000 mgr.a (mgr.14388) 18370 : audit [DBG] from='client.394896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:49.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:49 smithi044 bash[22676]: cluster 2024-09-21T05:18:48.521497+0000 mgr.a (mgr.14388) 18371 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:49 smithi179 bash[23186]: audit 2024-09-21T05:18:48.191512+0000 mgr.a (mgr.14388) 18370 : audit [DBG] from='client.394896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:49 smithi179 bash[23186]: cluster 2024-09-21T05:18:48.521497+0000 mgr.a (mgr.14388) 18371 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:49 smithi049 bash[23528]: audit 2024-09-21T05:18:48.191512+0000 mgr.a (mgr.14388) 18370 : audit [DBG] from='client.394896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:49 smithi049 bash[23528]: cluster 2024-09-21T05:18:48.521497+0000 mgr.a (mgr.14388) 18371 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:18:51.932 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:51 smithi044 bash[22676]: cluster 2024-09-21T05:18:50.523780+0000 mgr.a (mgr.14388) 18372 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:51 smithi179 bash[23186]: cluster 2024-09-21T05:18:50.523780+0000 mgr.a (mgr.14388) 18372 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:51 smithi049 bash[23528]: cluster 2024-09-21T05:18:50.523780+0000 mgr.a (mgr.14388) 18372 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:53.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:53.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:53.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:53 smithi044 bash[22676]: cluster 2024-09-21T05:18:52.524578+0000 mgr.a (mgr.14388) 18373 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:53 smithi179 bash[23186]: cluster 2024-09-21T05:18:52.524578+0000 mgr.a (mgr.14388) 18373 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:53 smithi049 bash[23528]: cluster 2024-09-21T05:18:52.524578+0000 mgr.a (mgr.14388) 18373 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:54.405 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:18:54.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:18:54.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:18:54.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:18:54.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:18:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:55 smithi044 bash[22676]: audit 2024-09-21T05:18:53.948339+0000 mgr.a (mgr.14388) 18374 : audit [DBG] from='client.394971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:55 smithi044 bash[22676]: cluster 2024-09-21T05:18:54.525592+0000 mgr.a (mgr.14388) 18375 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:55 smithi179 bash[23186]: audit 2024-09-21T05:18:53.948339+0000 mgr.a (mgr.14388) 18374 : audit [DBG] from='client.394971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:55 smithi179 bash[23186]: cluster 2024-09-21T05:18:54.525592+0000 mgr.a (mgr.14388) 18375 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:55 smithi049 bash[23528]: audit 2024-09-21T05:18:53.948339+0000 mgr.a (mgr.14388) 18374 : audit [DBG] from='client.394971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:18:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:55 smithi049 bash[23528]: cluster 2024-09-21T05:18:54.525592+0000 mgr.a (mgr.14388) 18375 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:57 smithi044 bash[22676]: cluster 2024-09-21T05:18:56.527916+0000 mgr.a (mgr.14388) 18376 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:57 smithi044 bash[22676]: audit 2024-09-21T05:18:57.558346+0000 mon.a (mon.0) 14566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:57 smithi044 bash[22676]: audit 2024-09-21T05:18:57.564601+0000 mon.a (mon.0) 14567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:57 smithi044 bash[22676]: audit 2024-09-21T05:18:57.571192+0000 mon.a (mon.0) 14568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:57 smithi179 bash[23186]: cluster 2024-09-21T05:18:56.527916+0000 mgr.a (mgr.14388) 18376 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:57 smithi179 bash[23186]: audit 2024-09-21T05:18:57.558346+0000 mon.a (mon.0) 14566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:57 smithi179 bash[23186]: audit 2024-09-21T05:18:57.564601+0000 mon.a (mon.0) 14567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:57 smithi179 bash[23186]: audit 2024-09-21T05:18:57.571192+0000 mon.a (mon.0) 14568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:57 smithi049 bash[23528]: cluster 2024-09-21T05:18:56.527916+0000 mgr.a (mgr.14388) 18376 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:18:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:57 smithi049 bash[23528]: audit 2024-09-21T05:18:57.558346+0000 mon.a (mon.0) 14566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:57 smithi049 bash[23528]: audit 2024-09-21T05:18:57.564601+0000 mon.a (mon.0) 14567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:57 smithi049 bash[23528]: audit 2024-09-21T05:18:57.571192+0000 mon.a (mon.0) 14568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:58 smithi044 bash[22676]: audit 2024-09-21T05:18:57.695020+0000 mon.a (mon.0) 14569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:58 smithi044 bash[22676]: audit 2024-09-21T05:18:57.703204+0000 mon.a (mon.0) 14570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:58 smithi044 bash[22676]: audit 2024-09-21T05:18:57.713314+0000 mon.a (mon.0) 14571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:58 smithi179 bash[23186]: audit 2024-09-21T05:18:57.695020+0000 mon.a (mon.0) 14569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:58 smithi179 bash[23186]: audit 2024-09-21T05:18:57.703204+0000 mon.a (mon.0) 14570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:58 smithi179 bash[23186]: audit 2024-09-21T05:18:57.713314+0000 mon.a (mon.0) 14571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:58 smithi049 bash[23528]: audit 2024-09-21T05:18:57.695020+0000 mon.a (mon.0) 14569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:58 smithi049 bash[23528]: audit 2024-09-21T05:18:57.703204+0000 mon.a (mon.0) 14570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:58 smithi049 bash[23528]: audit 2024-09-21T05:18:57.713314+0000 mon.a (mon.0) 14571 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:18:59.407 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:18:59.408 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:18:59.408 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:18:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:18:59 smithi044 bash[22676]: cluster 2024-09-21T05:18:58.528686+0000 mgr.a (mgr.14388) 18377 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:18:59 smithi179 bash[23186]: cluster 2024-09-21T05:18:58.528686+0000 mgr.a (mgr.14388) 18377 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:18:59 smithi049 bash[23528]: cluster 2024-09-21T05:18:58.528686+0000 mgr.a (mgr.14388) 18377 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:00.212 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:00.212 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:00.213 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:00 smithi044 bash[22676]: audit 2024-09-21T05:18:59.749095+0000 mgr.a (mgr.14388) 18378 : audit [DBG] from='client.395043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:00 smithi179 bash[23186]: audit 2024-09-21T05:18:59.749095+0000 mgr.a (mgr.14388) 18378 : audit [DBG] from='client.395043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:00 smithi049 bash[23528]: audit 2024-09-21T05:18:59.749095+0000 mgr.a (mgr.14388) 18378 : audit [DBG] from='client.395043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:01 smithi044 bash[22676]: cluster 2024-09-21T05:19:00.531723+0000 mgr.a (mgr.14388) 18379 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:01 smithi179 bash[23186]: cluster 2024-09-21T05:19:00.531723+0000 mgr.a (mgr.14388) 18379 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:01 smithi049 bash[23528]: cluster 2024-09-21T05:19:00.531723+0000 mgr.a (mgr.14388) 18379 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:03 smithi044 bash[22676]: cluster 2024-09-21T05:19:02.532540+0000 mgr.a (mgr.14388) 18380 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:19:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:03 smithi179 bash[23186]: cluster 2024-09-21T05:19:02.532540+0000 mgr.a (mgr.14388) 18380 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:19:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:03 smithi049 bash[23528]: cluster 2024-09-21T05:19:02.532540+0000 mgr.a (mgr.14388) 18380 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:19:05.214 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:05.215 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:05.961 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:05.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:05 smithi044 bash[22676]: cluster 2024-09-21T05:19:04.533485+0000 mgr.a (mgr.14388) 18381 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:19:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:05 smithi179 bash[23186]: cluster 2024-09-21T05:19:04.533485+0000 mgr.a (mgr.14388) 18381 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:19:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:05 smithi049 bash[23528]: cluster 2024-09-21T05:19:04.533485+0000 mgr.a (mgr.14388) 18381 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:19:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:06 smithi044 bash[22676]: audit 2024-09-21T05:19:05.543816+0000 mgr.a (mgr.14388) 18382 : audit [DBG] from='client.395121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:06 smithi179 bash[23186]: audit 2024-09-21T05:19:05.543816+0000 mgr.a (mgr.14388) 18382 : audit [DBG] from='client.395121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:06 smithi049 bash[23528]: audit 2024-09-21T05:19:05.543816+0000 mgr.a (mgr.14388) 18382 : audit [DBG] from='client.395121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:07 smithi179 bash[23186]: cluster 2024-09-21T05:19:06.536538+0000 mgr.a (mgr.14388) 18383 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:07 smithi049 bash[23528]: cluster 2024-09-21T05:19:06.536538+0000 mgr.a (mgr.14388) 18383 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:07 smithi044 bash[22676]: cluster 2024-09-21T05:19:06.536538+0000 mgr.a (mgr.14388) 18383 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:08 smithi044 bash[22676]: audit 2024-09-21T05:19:07.784328+0000 mon.a (mon.0) 14572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:08 smithi044 bash[22676]: audit 2024-09-21T05:19:07.793689+0000 mon.a (mon.0) 14573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:08.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:08 smithi044 bash[22676]: audit 2024-09-21T05:19:07.804627+0000 mon.a (mon.0) 14574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:08 smithi049 bash[23528]: audit 2024-09-21T05:19:07.784328+0000 mon.a (mon.0) 14572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:08 smithi049 bash[23528]: audit 2024-09-21T05:19:07.793689+0000 mon.a (mon.0) 14573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:08 smithi049 bash[23528]: audit 2024-09-21T05:19:07.804627+0000 mon.a (mon.0) 14574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:08 smithi179 bash[23186]: audit 2024-09-21T05:19:07.784328+0000 mon.a (mon.0) 14572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:08 smithi179 bash[23186]: audit 2024-09-21T05:19:07.793689+0000 mon.a (mon.0) 14573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:08 smithi179 bash[23186]: audit 2024-09-21T05:19:07.804627+0000 mon.a (mon.0) 14574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:09 smithi044 bash[22676]: cluster 2024-09-21T05:19:08.537364+0000 mgr.a (mgr.14388) 18384 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:19:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:09 smithi179 bash[23186]: cluster 2024-09-21T05:19:08.537364+0000 mgr.a (mgr.14388) 18384 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:19:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:09 smithi049 bash[23528]: cluster 2024-09-21T05:19:08.537364+0000 mgr.a (mgr.14388) 18384 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:19:10.962 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:10.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:10.963 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:11.716 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:11.717 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:11 smithi049 bash[23528]: cluster 2024-09-21T05:19:10.539332+0000 mgr.a (mgr.14388) 18385 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:12.139 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:11 smithi044 bash[22676]: cluster 2024-09-21T05:19:10.539332+0000 mgr.a (mgr.14388) 18385 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:11 smithi179 bash[23186]: cluster 2024-09-21T05:19:10.539332+0000 mgr.a (mgr.14388) 18385 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:13.093 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:12 smithi049 bash[23528]: audit 2024-09-21T05:19:11.288786+0000 mgr.a (mgr.14388) 18386 : audit [DBG] from='client.395199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:12 smithi044 bash[22676]: audit 2024-09-21T05:19:11.288786+0000 mgr.a (mgr.14388) 18386 : audit [DBG] from='client.395199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:12 smithi179 bash[23186]: audit 2024-09-21T05:19:11.288786+0000 mgr.a (mgr.14388) 18386 : audit [DBG] from='client.395199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:13 smithi044 bash[22676]: cluster 2024-09-21T05:19:12.540329+0000 mgr.a (mgr.14388) 18387 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:19:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:13 smithi179 bash[23186]: cluster 2024-09-21T05:19:12.540329+0000 mgr.a (mgr.14388) 18387 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:19:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:13 smithi049 bash[23528]: cluster 2024-09-21T05:19:12.540329+0000 mgr.a (mgr.14388) 18387 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:19:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:15 smithi049 bash[23528]: cluster 2024-09-21T05:19:14.541128+0000 mgr.a (mgr.14388) 18388 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:19:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:15 smithi044 bash[22676]: cluster 2024-09-21T05:19:14.541128+0000 mgr.a (mgr.14388) 18388 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:19:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:15 smithi179 bash[23186]: cluster 2024-09-21T05:19:14.541128+0000 mgr.a (mgr.14388) 18388 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:19:16.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:16.718 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:16.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:17.496 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:17.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:17.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:17.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:17 smithi044 bash[22676]: cluster 2024-09-21T05:19:16.543368+0000 mgr.a (mgr.14388) 18389 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:19:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:17 smithi044 bash[22676]: audit 2024-09-21T05:19:17.762003+0000 mon.a (mon.0) 14575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:17 smithi044 bash[22676]: audit 2024-09-21T05:19:17.772531+0000 mon.a (mon.0) 14576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:17 smithi044 bash[22676]: audit 2024-09-21T05:19:17.784996+0000 mon.a (mon.0) 14577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:17 smithi179 bash[23186]: cluster 2024-09-21T05:19:16.543368+0000 mgr.a (mgr.14388) 18389 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:19:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:17 smithi179 bash[23186]: audit 2024-09-21T05:19:17.762003+0000 mon.a (mon.0) 14575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:17 smithi179 bash[23186]: audit 2024-09-21T05:19:17.772531+0000 mon.a (mon.0) 14576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:17 smithi179 bash[23186]: audit 2024-09-21T05:19:17.784996+0000 mon.a (mon.0) 14577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:17 smithi049 bash[23528]: cluster 2024-09-21T05:19:16.543368+0000 mgr.a (mgr.14388) 18389 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:19:18.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:17 smithi049 bash[23528]: audit 2024-09-21T05:19:17.762003+0000 mon.a (mon.0) 14575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:17 smithi049 bash[23528]: audit 2024-09-21T05:19:17.772531+0000 mon.a (mon.0) 14576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:18.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:17 smithi049 bash[23528]: audit 2024-09-21T05:19:17.784996+0000 mon.a (mon.0) 14577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:18 smithi044 bash[22676]: audit 2024-09-21T05:19:17.053009+0000 mgr.a (mgr.14388) 18390 : audit [DBG] from='client.395277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:18 smithi044 bash[22676]: audit 2024-09-21T05:19:17.902757+0000 mon.a (mon.0) 14578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:18 smithi044 bash[22676]: audit 2024-09-21T05:19:17.911800+0000 mon.a (mon.0) 14579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:18 smithi044 bash[22676]: audit 2024-09-21T05:19:17.923152+0000 mon.a (mon.0) 14580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:18 smithi179 bash[23186]: audit 2024-09-21T05:19:17.053009+0000 mgr.a (mgr.14388) 18390 : audit [DBG] from='client.395277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:18 smithi179 bash[23186]: audit 2024-09-21T05:19:17.902757+0000 mon.a (mon.0) 14578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:18 smithi179 bash[23186]: audit 2024-09-21T05:19:17.911800+0000 mon.a (mon.0) 14579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:18 smithi179 bash[23186]: audit 2024-09-21T05:19:17.923152+0000 mon.a (mon.0) 14580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:18 smithi049 bash[23528]: audit 2024-09-21T05:19:17.053009+0000 mgr.a (mgr.14388) 18390 : audit [DBG] from='client.395277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:18 smithi049 bash[23528]: audit 2024-09-21T05:19:17.902757+0000 mon.a (mon.0) 14578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:18 smithi049 bash[23528]: audit 2024-09-21T05:19:17.911800+0000 mon.a (mon.0) 14579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:19.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:18 smithi049 bash[23528]: audit 2024-09-21T05:19:17.923152+0000 mon.a (mon.0) 14580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:19 smithi044 bash[22676]: cluster 2024-09-21T05:19:18.544287+0000 mgr.a (mgr.14388) 18391 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:19 smithi179 bash[23186]: cluster 2024-09-21T05:19:18.544287+0000 mgr.a (mgr.14388) 18391 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:19 smithi049 bash[23528]: cluster 2024-09-21T05:19:18.544287+0000 mgr.a (mgr.14388) 18391 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:21 smithi044 bash[22676]: cluster 2024-09-21T05:19:20.546477+0000 mgr.a (mgr.14388) 18392 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:21 smithi179 bash[23186]: cluster 2024-09-21T05:19:20.546477+0000 mgr.a (mgr.14388) 18392 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:21 smithi049 bash[23528]: cluster 2024-09-21T05:19:20.546477+0000 mgr.a (mgr.14388) 18392 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:22.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:22.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:22.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:23.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:23 smithi044 bash[22676]: cluster 2024-09-21T05:19:22.547049+0000 mgr.a (mgr.14388) 18393 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:23 smithi044 bash[22676]: audit 2024-09-21T05:19:22.822301+0000 mgr.a (mgr.14388) 18394 : audit [DBG] from='client.395349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:23 smithi179 bash[23186]: cluster 2024-09-21T05:19:22.547049+0000 mgr.a (mgr.14388) 18393 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:23 smithi179 bash[23186]: audit 2024-09-21T05:19:22.822301+0000 mgr.a (mgr.14388) 18394 : audit [DBG] from='client.395349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:23 smithi049 bash[23528]: cluster 2024-09-21T05:19:22.547049+0000 mgr.a (mgr.14388) 18393 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:23 smithi049 bash[23528]: audit 2024-09-21T05:19:22.822301+0000 mgr.a (mgr.14388) 18394 : audit [DBG] from='client.395349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:25 smithi044 bash[22676]: cluster 2024-09-21T05:19:24.547936+0000 mgr.a (mgr.14388) 18395 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:25 smithi179 bash[23186]: cluster 2024-09-21T05:19:24.547936+0000 mgr.a (mgr.14388) 18395 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:25 smithi049 bash[23528]: cluster 2024-09-21T05:19:24.547936+0000 mgr.a (mgr.14388) 18395 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:27 smithi044 bash[22676]: cluster 2024-09-21T05:19:26.550211+0000 mgr.a (mgr.14388) 18396 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:27 smithi179 bash[23186]: cluster 2024-09-21T05:19:26.550211+0000 mgr.a (mgr.14388) 18396 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:27 smithi049 bash[23528]: cluster 2024-09-21T05:19:26.550211+0000 mgr.a (mgr.14388) 18396 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:29.064 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:29 smithi044 bash[22676]: audit 2024-09-21T05:19:28.022039+0000 mon.a (mon.0) 14581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:29 smithi044 bash[22676]: audit 2024-09-21T05:19:28.031298+0000 mon.a (mon.0) 14582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:29 smithi044 bash[22676]: audit 2024-09-21T05:19:28.042185+0000 mon.a (mon.0) 14583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:29 smithi044 bash[22676]: cluster 2024-09-21T05:19:28.550966+0000 mgr.a (mgr.14388) 18397 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:29 smithi044 bash[22676]: audit 2024-09-21T05:19:28.597082+0000 mgr.a (mgr.14388) 18398 : audit [DBG] from='client.395427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:29 smithi049 bash[23528]: audit 2024-09-21T05:19:28.022039+0000 mon.a (mon.0) 14581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:29 smithi049 bash[23528]: audit 2024-09-21T05:19:28.031298+0000 mon.a (mon.0) 14582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:29 smithi049 bash[23528]: audit 2024-09-21T05:19:28.042185+0000 mon.a (mon.0) 14583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:29 smithi049 bash[23528]: cluster 2024-09-21T05:19:28.550966+0000 mgr.a (mgr.14388) 18397 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:29.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:29 smithi049 bash[23528]: audit 2024-09-21T05:19:28.597082+0000 mgr.a (mgr.14388) 18398 : audit [DBG] from='client.395427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:29 smithi179 bash[23186]: audit 2024-09-21T05:19:28.022039+0000 mon.a (mon.0) 14581 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:29 smithi179 bash[23186]: audit 2024-09-21T05:19:28.031298+0000 mon.a (mon.0) 14582 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:29 smithi179 bash[23186]: audit 2024-09-21T05:19:28.042185+0000 mon.a (mon.0) 14583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:29 smithi179 bash[23186]: cluster 2024-09-21T05:19:28.550966+0000 mgr.a (mgr.14388) 18397 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:29.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:29 smithi179 bash[23186]: audit 2024-09-21T05:19:28.597082+0000 mgr.a (mgr.14388) 18398 : audit [DBG] from='client.395427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:31 smithi044 bash[22676]: cluster 2024-09-21T05:19:30.553344+0000 mgr.a (mgr.14388) 18399 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:31 smithi179 bash[23186]: cluster 2024-09-21T05:19:30.553344+0000 mgr.a (mgr.14388) 18399 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:31 smithi049 bash[23528]: cluster 2024-09-21T05:19:30.553344+0000 mgr.a (mgr.14388) 18399 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:33 smithi049 bash[23528]: cluster 2024-09-21T05:19:32.554166+0000 mgr.a (mgr.14388) 18400 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:33 smithi044 bash[22676]: cluster 2024-09-21T05:19:32.554166+0000 mgr.a (mgr.14388) 18400 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:33 smithi179 bash[23186]: cluster 2024-09-21T05:19:32.554166+0000 mgr.a (mgr.14388) 18400 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:34.066 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:34.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:34.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:34.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:34.816 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:34.817 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:35 smithi049 bash[23528]: audit 2024-09-21T05:19:34.399021+0000 mgr.a (mgr.14388) 18401 : audit [DBG] from='client.395505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:35 smithi049 bash[23528]: cluster 2024-09-21T05:19:34.554951+0000 mgr.a (mgr.14388) 18402 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:35 smithi044 bash[22676]: audit 2024-09-21T05:19:34.399021+0000 mgr.a (mgr.14388) 18401 : audit [DBG] from='client.395505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:35 smithi044 bash[22676]: cluster 2024-09-21T05:19:34.554951+0000 mgr.a (mgr.14388) 18402 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:35 smithi179 bash[23186]: audit 2024-09-21T05:19:34.399021+0000 mgr.a (mgr.14388) 18401 : audit [DBG] from='client.395505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:35 smithi179 bash[23186]: cluster 2024-09-21T05:19:34.554951+0000 mgr.a (mgr.14388) 18402 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:37.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:37 smithi044 bash[22676]: cluster 2024-09-21T05:19:36.557383+0000 mgr.a (mgr.14388) 18403 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:37 smithi179 bash[23186]: cluster 2024-09-21T05:19:36.557383+0000 mgr.a (mgr.14388) 18403 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:37 smithi049 bash[23528]: cluster 2024-09-21T05:19:36.557383+0000 mgr.a (mgr.14388) 18403 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:19:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:38 smithi044 bash[22676]: audit 2024-09-21T05:19:37.990130+0000 mon.a (mon.0) 14584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:38 smithi044 bash[22676]: audit 2024-09-21T05:19:37.997492+0000 mon.a (mon.0) 14585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:38 smithi044 bash[22676]: audit 2024-09-21T05:19:38.004377+0000 mon.a (mon.0) 14586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:38 smithi044 bash[22676]: audit 2024-09-21T05:19:38.132496+0000 mon.a (mon.0) 14587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:38 smithi044 bash[22676]: audit 2024-09-21T05:19:38.140776+0000 mon.a (mon.0) 14588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:38 smithi044 bash[22676]: audit 2024-09-21T05:19:38.150521+0000 mon.a (mon.0) 14589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:38 smithi044 bash[22676]: cluster 2024-09-21T05:19:38.558155+0000 mgr.a (mgr.14388) 18404 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:38 smithi179 bash[23186]: audit 2024-09-21T05:19:37.990130+0000 mon.a (mon.0) 14584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:38 smithi179 bash[23186]: audit 2024-09-21T05:19:37.997492+0000 mon.a (mon.0) 14585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:38 smithi179 bash[23186]: audit 2024-09-21T05:19:38.004377+0000 mon.a (mon.0) 14586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:38 smithi179 bash[23186]: audit 2024-09-21T05:19:38.132496+0000 mon.a (mon.0) 14587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:38 smithi179 bash[23186]: audit 2024-09-21T05:19:38.140776+0000 mon.a (mon.0) 14588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:38 smithi179 bash[23186]: audit 2024-09-21T05:19:38.150521+0000 mon.a (mon.0) 14589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:38 smithi179 bash[23186]: cluster 2024-09-21T05:19:38.558155+0000 mgr.a (mgr.14388) 18404 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:38 smithi049 bash[23528]: audit 2024-09-21T05:19:37.990130+0000 mon.a (mon.0) 14584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:38 smithi049 bash[23528]: audit 2024-09-21T05:19:37.997492+0000 mon.a (mon.0) 14585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:38 smithi049 bash[23528]: audit 2024-09-21T05:19:38.004377+0000 mon.a (mon.0) 14586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:38 smithi049 bash[23528]: audit 2024-09-21T05:19:38.132496+0000 mon.a (mon.0) 14587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:38 smithi049 bash[23528]: audit 2024-09-21T05:19:38.140776+0000 mon.a (mon.0) 14588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:38 smithi049 bash[23528]: audit 2024-09-21T05:19:38.150521+0000 mon.a (mon.0) 14589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:39.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:38 smithi049 bash[23528]: cluster 2024-09-21T05:19:38.558155+0000 mgr.a (mgr.14388) 18404 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:39.818 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:39.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:39.818 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:40.576 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:40.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:40.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:40.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:40.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:41 smithi044 bash[22676]: audit 2024-09-21T05:19:40.145406+0000 mgr.a (mgr.14388) 18405 : audit [DBG] from='client.395583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:41 smithi044 bash[22676]: cluster 2024-09-21T05:19:40.559435+0000 mgr.a (mgr.14388) 18406 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:41 smithi179 bash[23186]: audit 2024-09-21T05:19:40.145406+0000 mgr.a (mgr.14388) 18405 : audit [DBG] from='client.395583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:41 smithi179 bash[23186]: cluster 2024-09-21T05:19:40.559435+0000 mgr.a (mgr.14388) 18406 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:41 smithi049 bash[23528]: audit 2024-09-21T05:19:40.145406+0000 mgr.a (mgr.14388) 18405 : audit [DBG] from='client.395583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:41 smithi049 bash[23528]: cluster 2024-09-21T05:19:40.559435+0000 mgr.a (mgr.14388) 18406 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:43 smithi044 bash[22676]: cluster 2024-09-21T05:19:42.560157+0000 mgr.a (mgr.14388) 18407 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:19:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:43 smithi179 bash[23186]: cluster 2024-09-21T05:19:42.560157+0000 mgr.a (mgr.14388) 18407 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:19:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:43 smithi049 bash[23528]: cluster 2024-09-21T05:19:42.560157+0000 mgr.a (mgr.14388) 18407 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:19:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:45.578 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:45.578 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:45.831 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:45 smithi179 bash[23186]: cluster 2024-09-21T05:19:44.560940+0000 mgr.a (mgr.14388) 18408 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:19:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:45 smithi044 bash[22676]: cluster 2024-09-21T05:19:44.560940+0000 mgr.a (mgr.14388) 18408 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:19:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:45 smithi049 bash[23528]: cluster 2024-09-21T05:19:44.560940+0000 mgr.a (mgr.14388) 18408 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:19:46.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:46.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:46.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:46.344 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:46.344 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:46 smithi044 bash[22676]: audit 2024-09-21T05:19:45.909001+0000 mgr.a (mgr.14388) 18409 : audit [DBG] from='client.395658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:46 smithi179 bash[23186]: audit 2024-09-21T05:19:45.909001+0000 mgr.a (mgr.14388) 18409 : audit [DBG] from='client.395658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:46 smithi049 bash[23528]: audit 2024-09-21T05:19:45.909001+0000 mgr.a (mgr.14388) 18409 : audit [DBG] from='client.395658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:47 smithi179 bash[23186]: cluster 2024-09-21T05:19:46.563916+0000 mgr.a (mgr.14388) 18410 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:47 smithi179 bash[23186]: audit 2024-09-21T05:19:47.260536+0000 mon.a (mon.0) 14590 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:19:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:47 smithi179 bash[23186]: audit 2024-09-21T05:19:47.267677+0000 mon.a (mon.0) 14591 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:19:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:47 smithi179 bash[23186]: audit 2024-09-21T05:19:47.269597+0000 mon.a (mon.0) 14592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:19:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:47 smithi179 bash[23186]: audit 2024-09-21T05:19:47.280880+0000 mon.a (mon.0) 14593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:47 smithi179 bash[23186]: audit 2024-09-21T05:19:47.288122+0000 mon.a (mon.0) 14594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:19:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:47 smithi044 bash[22676]: cluster 2024-09-21T05:19:46.563916+0000 mgr.a (mgr.14388) 18410 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:47 smithi044 bash[22676]: audit 2024-09-21T05:19:47.260536+0000 mon.a (mon.0) 14590 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:19:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:47 smithi044 bash[22676]: audit 2024-09-21T05:19:47.267677+0000 mon.a (mon.0) 14591 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:19:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:47 smithi044 bash[22676]: audit 2024-09-21T05:19:47.269597+0000 mon.a (mon.0) 14592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:19:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:47 smithi044 bash[22676]: audit 2024-09-21T05:19:47.280880+0000 mon.a (mon.0) 14593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:47 smithi044 bash[22676]: audit 2024-09-21T05:19:47.288122+0000 mon.a (mon.0) 14594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:19:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:47 smithi049 bash[23528]: cluster 2024-09-21T05:19:46.563916+0000 mgr.a (mgr.14388) 18410 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:19:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:47 smithi049 bash[23528]: audit 2024-09-21T05:19:47.260536+0000 mon.a (mon.0) 14590 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:19:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:47 smithi049 bash[23528]: audit 2024-09-21T05:19:47.267677+0000 mon.a (mon.0) 14591 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:19:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:47 smithi049 bash[23528]: audit 2024-09-21T05:19:47.269597+0000 mon.a (mon.0) 14592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:19:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:47 smithi049 bash[23528]: audit 2024-09-21T05:19:47.280880+0000 mon.a (mon.0) 14593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:48.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:47 smithi049 bash[23528]: audit 2024-09-21T05:19:47.288122+0000 mon.a (mon.0) 14594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:19:48.400 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:19:48 smithi044 bash[22930]: debug 2024-09-21T05:19:48.059+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:19:48.400 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:19:48 smithi044 bash[22930]: debug 2024-09-21T05:19:48.059+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:19:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:48 smithi044 bash[22676]: audit 2024-09-21T05:19:47.290910+0000 mgr.a (mgr.14388) 18411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:19:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:48 smithi044 bash[22676]: audit 2024-09-21T05:19:48.253096+0000 mon.a (mon.0) 14595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:48 smithi044 bash[22676]: audit 2024-09-21T05:19:48.261760+0000 mon.a (mon.0) 14596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:48 smithi044 bash[22676]: audit 2024-09-21T05:19:48.272372+0000 mon.a (mon.0) 14597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:48 smithi179 bash[23186]: audit 2024-09-21T05:19:47.290910+0000 mgr.a (mgr.14388) 18411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:19:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:48 smithi179 bash[23186]: audit 2024-09-21T05:19:48.253096+0000 mon.a (mon.0) 14595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:48 smithi179 bash[23186]: audit 2024-09-21T05:19:48.261760+0000 mon.a (mon.0) 14596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:49.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:48 smithi179 bash[23186]: audit 2024-09-21T05:19:48.272372+0000 mon.a (mon.0) 14597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:48 smithi049 bash[23528]: audit 2024-09-21T05:19:47.290910+0000 mgr.a (mgr.14388) 18411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:19:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:48 smithi049 bash[23528]: audit 2024-09-21T05:19:48.253096+0000 mon.a (mon.0) 14595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:48 smithi049 bash[23528]: audit 2024-09-21T05:19:48.261760+0000 mon.a (mon.0) 14596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:48 smithi049 bash[23528]: audit 2024-09-21T05:19:48.272372+0000 mon.a (mon.0) 14597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:49.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:49 smithi044 bash[22676]: audit 2024-09-21T05:19:48.061613+0000 mgr.a (mgr.14388) 18412 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:19:49.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:49 smithi044 bash[22676]: cephadm 2024-09-21T05:19:48.063147+0000 mgr.a (mgr.14388) 18413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:19:49.981 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:49 smithi044 bash[22676]: cluster 2024-09-21T05:19:48.565071+0000 mgr.a (mgr.14388) 18414 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:19:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:49 smithi179 bash[23186]: audit 2024-09-21T05:19:48.061613+0000 mgr.a (mgr.14388) 18412 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:19:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:49 smithi179 bash[23186]: cephadm 2024-09-21T05:19:48.063147+0000 mgr.a (mgr.14388) 18413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:19:50.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:49 smithi179 bash[23186]: cluster 2024-09-21T05:19:48.565071+0000 mgr.a (mgr.14388) 18414 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:19:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:49 smithi049 bash[23528]: audit 2024-09-21T05:19:48.061613+0000 mgr.a (mgr.14388) 18412 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:19:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:49 smithi049 bash[23528]: cephadm 2024-09-21T05:19:48.063147+0000 mgr.a (mgr.14388) 18413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:19:50.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:49 smithi049 bash[23528]: cluster 2024-09-21T05:19:48.565071+0000 mgr.a (mgr.14388) 18414 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:19:51.345 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:51.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:51.346 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:51.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:51 smithi044 bash[22676]: cluster 2024-09-21T05:19:50.567407+0000 mgr.a (mgr.14388) 18415 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:52.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:51 smithi179 bash[23186]: cluster 2024-09-21T05:19:50.567407+0000 mgr.a (mgr.14388) 18415 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:52.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:51 smithi049 bash[23528]: cluster 2024-09-21T05:19:50.567407+0000 mgr.a (mgr.14388) 18415 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:52.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:52.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:52.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:52.137 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:52.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:52.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:52 smithi044 bash[22676]: audit 2024-09-21T05:19:51.681490+0000 mgr.a (mgr.14388) 18416 : audit [DBG] from='client.395838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:52.903 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:52 smithi049 bash[23528]: audit 2024-09-21T05:19:51.681490+0000 mgr.a (mgr.14388) 18416 : audit [DBG] from='client.395838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:52 smithi179 bash[23186]: audit 2024-09-21T05:19:51.681490+0000 mgr.a (mgr.14388) 18416 : audit [DBG] from='client.395838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:53 smithi044 bash[22676]: cluster 2024-09-21T05:19:52.568604+0000 mgr.a (mgr.14388) 18417 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:53 smithi179 bash[23186]: cluster 2024-09-21T05:19:52.568604+0000 mgr.a (mgr.14388) 18417 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:54.019 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:53 smithi049 bash[23528]: cluster 2024-09-21T05:19:52.568604+0000 mgr.a (mgr.14388) 18417 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:55.946 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:55 smithi049 bash[23528]: cluster 2024-09-21T05:19:54.569607+0000 mgr.a (mgr.14388) 18418 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:55 smithi044 bash[22676]: cluster 2024-09-21T05:19:54.569607+0000 mgr.a (mgr.14388) 18418 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:55 smithi179 bash[23186]: cluster 2024-09-21T05:19:54.569607+0000 mgr.a (mgr.14388) 18418 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:57.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:19:57.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:19:57.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:19:57.931 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:19:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:19:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:19:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:19:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:19:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:57 smithi044 bash[22676]: cluster 2024-09-21T05:19:56.571915+0000 mgr.a (mgr.14388) 18419 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:57 smithi179 bash[23186]: cluster 2024-09-21T05:19:56.571915+0000 mgr.a (mgr.14388) 18419 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:57 smithi049 bash[23528]: cluster 2024-09-21T05:19:56.571915+0000 mgr.a (mgr.14388) 18419 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:19:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:58 smithi044 bash[22676]: audit 2024-09-21T05:19:57.476472+0000 mgr.a (mgr.14388) 18420 : audit [DBG] from='client.395916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:58 smithi044 bash[22676]: audit 2024-09-21T05:19:58.209791+0000 mon.a (mon.0) 14598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:58 smithi044 bash[22676]: audit 2024-09-21T05:19:58.217493+0000 mon.a (mon.0) 14599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:58 smithi044 bash[22676]: audit 2024-09-21T05:19:58.229722+0000 mon.a (mon.0) 14600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:58 smithi044 bash[22676]: audit 2024-09-21T05:19:58.374381+0000 mon.a (mon.0) 14601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:58 smithi044 bash[22676]: audit 2024-09-21T05:19:58.382622+0000 mon.a (mon.0) 14602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:58.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:58 smithi044 bash[22676]: audit 2024-09-21T05:19:58.391367+0000 mon.a (mon.0) 14603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:58 smithi179 bash[23186]: audit 2024-09-21T05:19:57.476472+0000 mgr.a (mgr.14388) 18420 : audit [DBG] from='client.395916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:58 smithi179 bash[23186]: audit 2024-09-21T05:19:58.209791+0000 mon.a (mon.0) 14598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:58 smithi179 bash[23186]: audit 2024-09-21T05:19:58.217493+0000 mon.a (mon.0) 14599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:58 smithi179 bash[23186]: audit 2024-09-21T05:19:58.229722+0000 mon.a (mon.0) 14600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:58 smithi179 bash[23186]: audit 2024-09-21T05:19:58.374381+0000 mon.a (mon.0) 14601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:58 smithi179 bash[23186]: audit 2024-09-21T05:19:58.382622+0000 mon.a (mon.0) 14602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:58 smithi179 bash[23186]: audit 2024-09-21T05:19:58.391367+0000 mon.a (mon.0) 14603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:58 smithi049 bash[23528]: audit 2024-09-21T05:19:57.476472+0000 mgr.a (mgr.14388) 18420 : audit [DBG] from='client.395916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:19:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:58 smithi049 bash[23528]: audit 2024-09-21T05:19:58.209791+0000 mon.a (mon.0) 14598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:58 smithi049 bash[23528]: audit 2024-09-21T05:19:58.217493+0000 mon.a (mon.0) 14599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:58 smithi049 bash[23528]: audit 2024-09-21T05:19:58.229722+0000 mon.a (mon.0) 14600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:58 smithi049 bash[23528]: audit 2024-09-21T05:19:58.374381+0000 mon.a (mon.0) 14601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:58 smithi049 bash[23528]: audit 2024-09-21T05:19:58.382622+0000 mon.a (mon.0) 14602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:58 smithi049 bash[23528]: audit 2024-09-21T05:19:58.391367+0000 mon.a (mon.0) 14603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:19:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:19:59 smithi044 bash[22676]: cluster 2024-09-21T05:19:58.572842+0000 mgr.a (mgr.14388) 18421 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:19:59 smithi179 bash[23186]: cluster 2024-09-21T05:19:58.572842+0000 mgr.a (mgr.14388) 18421 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:19:59 smithi049 bash[23528]: cluster 2024-09-21T05:19:58.572842+0000 mgr.a (mgr.14388) 18421 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:00 smithi044 bash[22676]: cluster 2024-09-21T05:20:00.000152+0000 mon.a (mon.0) 14604 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:20:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:00 smithi179 bash[23186]: cluster 2024-09-21T05:20:00.000152+0000 mon.a (mon.0) 14604 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:20:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:00 smithi049 bash[23528]: cluster 2024-09-21T05:20:00.000152+0000 mon.a (mon.0) 14604 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:20:01.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:01 smithi044 bash[22676]: cluster 2024-09-21T05:20:00.575083+0000 mgr.a (mgr.14388) 18422 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:01 smithi179 bash[23186]: cluster 2024-09-21T05:20:00.575083+0000 mgr.a (mgr.14388) 18422 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:01 smithi049 bash[23528]: cluster 2024-09-21T05:20:00.575083+0000 mgr.a (mgr.14388) 18422 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:02.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:02.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:02.934 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:03.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:03.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:03.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:03.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:03 smithi044 bash[22676]: cluster 2024-09-21T05:20:02.575862+0000 mgr.a (mgr.14388) 18423 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:03 smithi179 bash[23186]: cluster 2024-09-21T05:20:02.575862+0000 mgr.a (mgr.14388) 18423 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:03 smithi049 bash[23528]: cluster 2024-09-21T05:20:02.575862+0000 mgr.a (mgr.14388) 18423 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:04.965 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:04 smithi179 bash[23186]: audit 2024-09-21T05:20:03.270367+0000 mgr.a (mgr.14388) 18424 : audit [DBG] from='client.395991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:04 smithi044 bash[22676]: audit 2024-09-21T05:20:03.270367+0000 mgr.a (mgr.14388) 18424 : audit [DBG] from='client.395991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:04 smithi049 bash[23528]: audit 2024-09-21T05:20:03.270367+0000 mgr.a (mgr.14388) 18424 : audit [DBG] from='client.395991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:05.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:05 smithi179 bash[23186]: cluster 2024-09-21T05:20:04.576785+0000 mgr.a (mgr.14388) 18425 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:05 smithi044 bash[22676]: cluster 2024-09-21T05:20:04.576785+0000 mgr.a (mgr.14388) 18425 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:05 smithi049 bash[23528]: cluster 2024-09-21T05:20:04.576785+0000 mgr.a (mgr.14388) 18425 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:07 smithi044 bash[22676]: cluster 2024-09-21T05:20:06.579123+0000 mgr.a (mgr.14388) 18426 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:07.991 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:07 smithi179 bash[23186]: cluster 2024-09-21T05:20:06.579123+0000 mgr.a (mgr.14388) 18426 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:07 smithi049 bash[23528]: cluster 2024-09-21T05:20:06.579123+0000 mgr.a (mgr.14388) 18426 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:08.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:09.536 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:09.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:09.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:09.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:09.537 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:09 smithi044 bash[22676]: audit 2024-09-21T05:20:08.487698+0000 mon.a (mon.0) 14605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:09 smithi044 bash[22676]: audit 2024-09-21T05:20:08.497158+0000 mon.a (mon.0) 14606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:09 smithi044 bash[22676]: audit 2024-09-21T05:20:08.509280+0000 mon.a (mon.0) 14607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:09 smithi044 bash[22676]: cluster 2024-09-21T05:20:08.579924+0000 mgr.a (mgr.14388) 18427 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:09 smithi179 bash[23186]: audit 2024-09-21T05:20:08.487698+0000 mon.a (mon.0) 14605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:09 smithi179 bash[23186]: audit 2024-09-21T05:20:08.497158+0000 mon.a (mon.0) 14606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:09 smithi179 bash[23186]: audit 2024-09-21T05:20:08.509280+0000 mon.a (mon.0) 14607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:09 smithi179 bash[23186]: cluster 2024-09-21T05:20:08.579924+0000 mgr.a (mgr.14388) 18427 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:09 smithi049 bash[23528]: audit 2024-09-21T05:20:08.487698+0000 mon.a (mon.0) 14605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:09 smithi049 bash[23528]: audit 2024-09-21T05:20:08.497158+0000 mon.a (mon.0) 14606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:09 smithi049 bash[23528]: audit 2024-09-21T05:20:08.509280+0000 mon.a (mon.0) 14607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:09 smithi049 bash[23528]: cluster 2024-09-21T05:20:08.579924+0000 mgr.a (mgr.14388) 18427 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:10.615 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:10 smithi044 bash[22676]: audit 2024-09-21T05:20:09.074021+0000 mgr.a (mgr.14388) 18428 : audit [DBG] from='client.396063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:10 smithi049 bash[23528]: audit 2024-09-21T05:20:09.074021+0000 mgr.a (mgr.14388) 18428 : audit [DBG] from='client.396063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:10 smithi179 bash[23186]: audit 2024-09-21T05:20:09.074021+0000 mgr.a (mgr.14388) 18428 : audit [DBG] from='client.396063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:11 smithi049 bash[23528]: cluster 2024-09-21T05:20:10.582398+0000 mgr.a (mgr.14388) 18429 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:11 smithi044 bash[22676]: cluster 2024-09-21T05:20:10.582398+0000 mgr.a (mgr.14388) 18429 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:11 smithi179 bash[23186]: cluster 2024-09-21T05:20:10.582398+0000 mgr.a (mgr.14388) 18429 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:13 smithi049 bash[23528]: cluster 2024-09-21T05:20:12.582990+0000 mgr.a (mgr.14388) 18430 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:13 smithi044 bash[22676]: cluster 2024-09-21T05:20:12.582990+0000 mgr.a (mgr.14388) 18430 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:14.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:13 smithi179 bash[23186]: cluster 2024-09-21T05:20:12.582990+0000 mgr.a (mgr.14388) 18430 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:15.334 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:15.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:15.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:15.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:15.334 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:15 smithi049 bash[23528]: cluster 2024-09-21T05:20:14.583563+0000 mgr.a (mgr.14388) 18431 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:15 smithi049 bash[23528]: audit 2024-09-21T05:20:14.877455+0000 mgr.a (mgr.14388) 18432 : audit [DBG] from='client.396141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:15 smithi044 bash[22676]: cluster 2024-09-21T05:20:14.583563+0000 mgr.a (mgr.14388) 18431 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:15 smithi044 bash[22676]: audit 2024-09-21T05:20:14.877455+0000 mgr.a (mgr.14388) 18432 : audit [DBG] from='client.396141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:15 smithi179 bash[23186]: cluster 2024-09-21T05:20:14.583563+0000 mgr.a (mgr.14388) 18431 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:15 smithi179 bash[23186]: audit 2024-09-21T05:20:14.877455+0000 mgr.a (mgr.14388) 18432 : audit [DBG] from='client.396141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:17.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:17 smithi044 bash[22676]: cluster 2024-09-21T05:20:16.586485+0000 mgr.a (mgr.14388) 18433 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:17 smithi179 bash[23186]: cluster 2024-09-21T05:20:16.586485+0000 mgr.a (mgr.14388) 18433 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:17 smithi049 bash[23528]: cluster 2024-09-21T05:20:16.586485+0000 mgr.a (mgr.14388) 18433 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:19 smithi044 bash[22676]: audit 2024-09-21T05:20:18.434061+0000 mon.a (mon.0) 14608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:19 smithi044 bash[22676]: audit 2024-09-21T05:20:18.440244+0000 mon.a (mon.0) 14609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:19 smithi044 bash[22676]: audit 2024-09-21T05:20:18.446932+0000 mon.a (mon.0) 14610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:19 smithi044 bash[22676]: cluster 2024-09-21T05:20:18.587010+0000 mgr.a (mgr.14388) 18434 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:20:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:19 smithi044 bash[22676]: audit 2024-09-21T05:20:18.589235+0000 mon.a (mon.0) 14611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:19 smithi044 bash[22676]: audit 2024-09-21T05:20:18.597673+0000 mon.a (mon.0) 14612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:19 smithi044 bash[22676]: audit 2024-09-21T05:20:18.607841+0000 mon.a (mon.0) 14613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:19 smithi179 bash[23186]: audit 2024-09-21T05:20:18.434061+0000 mon.a (mon.0) 14608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:19 smithi179 bash[23186]: audit 2024-09-21T05:20:18.440244+0000 mon.a (mon.0) 14609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:19 smithi179 bash[23186]: audit 2024-09-21T05:20:18.446932+0000 mon.a (mon.0) 14610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:19 smithi179 bash[23186]: cluster 2024-09-21T05:20:18.587010+0000 mgr.a (mgr.14388) 18434 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:20:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:19 smithi179 bash[23186]: audit 2024-09-21T05:20:18.589235+0000 mon.a (mon.0) 14611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:19 smithi179 bash[23186]: audit 2024-09-21T05:20:18.597673+0000 mon.a (mon.0) 14612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:19 smithi179 bash[23186]: audit 2024-09-21T05:20:18.607841+0000 mon.a (mon.0) 14613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:19 smithi049 bash[23528]: audit 2024-09-21T05:20:18.434061+0000 mon.a (mon.0) 14608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:19 smithi049 bash[23528]: audit 2024-09-21T05:20:18.440244+0000 mon.a (mon.0) 14609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:19 smithi049 bash[23528]: audit 2024-09-21T05:20:18.446932+0000 mon.a (mon.0) 14610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:19 smithi049 bash[23528]: cluster 2024-09-21T05:20:18.587010+0000 mgr.a (mgr.14388) 18434 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:20:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:19 smithi049 bash[23528]: audit 2024-09-21T05:20:18.589235+0000 mon.a (mon.0) 14611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:19 smithi049 bash[23528]: audit 2024-09-21T05:20:18.597673+0000 mon.a (mon.0) 14612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:19 smithi049 bash[23528]: audit 2024-09-21T05:20:18.607841+0000 mon.a (mon.0) 14613 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:20.335 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:20.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:20.336 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:21.125 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:21.126 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:21 smithi049 bash[23528]: cluster 2024-09-21T05:20:20.588930+0000 mgr.a (mgr.14388) 18435 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:21 smithi049 bash[23528]: audit 2024-09-21T05:20:20.674433+0000 mgr.a (mgr.14388) 18436 : audit [DBG] from='client.396213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:21.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:21 smithi044 bash[22676]: cluster 2024-09-21T05:20:20.588930+0000 mgr.a (mgr.14388) 18435 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:21.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:21 smithi044 bash[22676]: audit 2024-09-21T05:20:20.674433+0000 mgr.a (mgr.14388) 18436 : audit [DBG] from='client.396213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:21 smithi179 bash[23186]: cluster 2024-09-21T05:20:20.588930+0000 mgr.a (mgr.14388) 18435 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:22.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:21 smithi179 bash[23186]: audit 2024-09-21T05:20:20.674433+0000 mgr.a (mgr.14388) 18436 : audit [DBG] from='client.396213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:23 smithi044 bash[22676]: cluster 2024-09-21T05:20:22.590026+0000 mgr.a (mgr.14388) 18437 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:20:24.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:23 smithi179 bash[23186]: cluster 2024-09-21T05:20:22.590026+0000 mgr.a (mgr.14388) 18437 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:20:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:23 smithi049 bash[23528]: cluster 2024-09-21T05:20:22.590026+0000 mgr.a (mgr.14388) 18437 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:20:25.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:25 smithi044 bash[22676]: cluster 2024-09-21T05:20:24.591013+0000 mgr.a (mgr.14388) 18438 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:20:26.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:25 smithi179 bash[23186]: cluster 2024-09-21T05:20:24.591013+0000 mgr.a (mgr.14388) 18438 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:20:26.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:25 smithi049 bash[23528]: cluster 2024-09-21T05:20:24.591013+0000 mgr.a (mgr.14388) 18438 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:20:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:26.128 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:26.896 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:27 smithi044 bash[22676]: audit 2024-09-21T05:20:26.459026+0000 mgr.a (mgr.14388) 18439 : audit [DBG] from='client.396291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:27 smithi044 bash[22676]: cluster 2024-09-21T05:20:26.598939+0000 mgr.a (mgr.14388) 18440 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:27 smithi179 bash[23186]: audit 2024-09-21T05:20:26.459026+0000 mgr.a (mgr.14388) 18439 : audit [DBG] from='client.396291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:27 smithi179 bash[23186]: cluster 2024-09-21T05:20:26.598939+0000 mgr.a (mgr.14388) 18440 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:27 smithi049 bash[23528]: audit 2024-09-21T05:20:26.459026+0000 mgr.a (mgr.14388) 18439 : audit [DBG] from='client.396291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:27 smithi049 bash[23528]: cluster 2024-09-21T05:20:26.598939+0000 mgr.a (mgr.14388) 18440 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:29 smithi044 bash[22676]: cluster 2024-09-21T05:20:28.599991+0000 mgr.a (mgr.14388) 18441 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:29 smithi044 bash[22676]: audit 2024-09-21T05:20:28.726877+0000 mon.a (mon.0) 14614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:29 smithi044 bash[22676]: audit 2024-09-21T05:20:28.735655+0000 mon.a (mon.0) 14615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:29.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:29 smithi044 bash[22676]: audit 2024-09-21T05:20:28.746343+0000 mon.a (mon.0) 14616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:29 smithi179 bash[23186]: cluster 2024-09-21T05:20:28.599991+0000 mgr.a (mgr.14388) 18441 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:29 smithi179 bash[23186]: audit 2024-09-21T05:20:28.726877+0000 mon.a (mon.0) 14614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:29 smithi179 bash[23186]: audit 2024-09-21T05:20:28.735655+0000 mon.a (mon.0) 14615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:30.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:29 smithi179 bash[23186]: audit 2024-09-21T05:20:28.746343+0000 mon.a (mon.0) 14616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:29 smithi049 bash[23528]: cluster 2024-09-21T05:20:28.599991+0000 mgr.a (mgr.14388) 18441 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:29 smithi049 bash[23528]: audit 2024-09-21T05:20:28.726877+0000 mon.a (mon.0) 14614 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:29 smithi049 bash[23528]: audit 2024-09-21T05:20:28.735655+0000 mon.a (mon.0) 14615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:29 smithi049 bash[23528]: audit 2024-09-21T05:20:28.746343+0000 mon.a (mon.0) 14616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:31.897 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:31.898 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:31.898 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:31 smithi044 bash[22676]: cluster 2024-09-21T05:20:30.602364+0000 mgr.a (mgr.14388) 18442 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:32.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:31 smithi179 bash[23186]: cluster 2024-09-21T05:20:30.602364+0000 mgr.a (mgr.14388) 18442 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:31 smithi049 bash[23528]: cluster 2024-09-21T05:20:30.602364+0000 mgr.a (mgr.14388) 18442 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:32.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:32.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:32.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:32.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:33 smithi044 bash[22676]: audit 2024-09-21T05:20:32.227753+0000 mgr.a (mgr.14388) 18443 : audit [DBG] from='client.396369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:33 smithi044 bash[22676]: cluster 2024-09-21T05:20:32.602936+0000 mgr.a (mgr.14388) 18444 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:33 smithi179 bash[23186]: audit 2024-09-21T05:20:32.227753+0000 mgr.a (mgr.14388) 18443 : audit [DBG] from='client.396369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:33 smithi179 bash[23186]: cluster 2024-09-21T05:20:32.602936+0000 mgr.a (mgr.14388) 18444 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:33 smithi049 bash[23528]: audit 2024-09-21T05:20:32.227753+0000 mgr.a (mgr.14388) 18443 : audit [DBG] from='client.396369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:33 smithi049 bash[23528]: cluster 2024-09-21T05:20:32.602936+0000 mgr.a (mgr.14388) 18444 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:36.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:35 smithi179 bash[23186]: cluster 2024-09-21T05:20:34.603690+0000 mgr.a (mgr.14388) 18445 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:35 smithi049 bash[23528]: cluster 2024-09-21T05:20:34.603690+0000 mgr.a (mgr.14388) 18445 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:35 smithi044 bash[22676]: cluster 2024-09-21T05:20:34.603690+0000 mgr.a (mgr.14388) 18445 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:37.671 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:38.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:37 smithi179 bash[23186]: cluster 2024-09-21T05:20:36.605957+0000 mgr.a (mgr.14388) 18446 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:37 smithi049 bash[23528]: cluster 2024-09-21T05:20:36.605957+0000 mgr.a (mgr.14388) 18446 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:37 smithi044 bash[22676]: cluster 2024-09-21T05:20:36.605957+0000 mgr.a (mgr.14388) 18446 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:38.443 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: audit 2024-09-21T05:20:38.003610+0000 mgr.a (mgr.14388) 18447 : audit [DBG] from='client.396447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: cluster 2024-09-21T05:20:38.606908+0000 mgr.a (mgr.14388) 18448 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: audit 2024-09-21T05:20:38.640137+0000 mon.a (mon.0) 14617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: audit 2024-09-21T05:20:38.648074+0000 mon.a (mon.0) 14618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: audit 2024-09-21T05:20:38.657895+0000 mon.a (mon.0) 14619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: audit 2024-09-21T05:20:38.783467+0000 mon.a (mon.0) 14620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: audit 2024-09-21T05:20:38.791482+0000 mon.a (mon.0) 14621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:39.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:39 smithi044 bash[22676]: audit 2024-09-21T05:20:38.802896+0000 mon.a (mon.0) 14622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: audit 2024-09-21T05:20:38.003610+0000 mgr.a (mgr.14388) 18447 : audit [DBG] from='client.396447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: cluster 2024-09-21T05:20:38.606908+0000 mgr.a (mgr.14388) 18448 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:40.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: audit 2024-09-21T05:20:38.640137+0000 mon.a (mon.0) 14617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: audit 2024-09-21T05:20:38.648074+0000 mon.a (mon.0) 14618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: audit 2024-09-21T05:20:38.657895+0000 mon.a (mon.0) 14619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: audit 2024-09-21T05:20:38.783467+0000 mon.a (mon.0) 14620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: audit 2024-09-21T05:20:38.791482+0000 mon.a (mon.0) 14621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:39 smithi179 bash[23186]: audit 2024-09-21T05:20:38.802896+0000 mon.a (mon.0) 14622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: audit 2024-09-21T05:20:38.003610+0000 mgr.a (mgr.14388) 18447 : audit [DBG] from='client.396447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: cluster 2024-09-21T05:20:38.606908+0000 mgr.a (mgr.14388) 18448 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: audit 2024-09-21T05:20:38.640137+0000 mon.a (mon.0) 14617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: audit 2024-09-21T05:20:38.648074+0000 mon.a (mon.0) 14618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: audit 2024-09-21T05:20:38.657895+0000 mon.a (mon.0) 14619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: audit 2024-09-21T05:20:38.783467+0000 mon.a (mon.0) 14620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: audit 2024-09-21T05:20:38.791482+0000 mon.a (mon.0) 14621 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:40.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:39 smithi049 bash[23528]: audit 2024-09-21T05:20:38.802896+0000 mon.a (mon.0) 14622 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:41 smithi044 bash[22676]: cluster 2024-09-21T05:20:40.609135+0000 mgr.a (mgr.14388) 18449 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:41 smithi179 bash[23186]: cluster 2024-09-21T05:20:40.609135+0000 mgr.a (mgr.14388) 18449 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:41 smithi049 bash[23528]: cluster 2024-09-21T05:20:40.609135+0000 mgr.a (mgr.14388) 18449 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:43.445 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:43 smithi044 bash[22676]: cluster 2024-09-21T05:20:42.609874+0000 mgr.a (mgr.14388) 18450 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:43 smithi179 bash[23186]: cluster 2024-09-21T05:20:42.609874+0000 mgr.a (mgr.14388) 18450 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:43 smithi049 bash[23528]: cluster 2024-09-21T05:20:42.609874+0000 mgr.a (mgr.14388) 18450 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:44.226 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:44 smithi044 bash[22676]: audit 2024-09-21T05:20:43.780916+0000 mgr.a (mgr.14388) 18451 : audit [DBG] from='client.396522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:44 smithi179 bash[23186]: audit 2024-09-21T05:20:43.780916+0000 mgr.a (mgr.14388) 18451 : audit [DBG] from='client.396522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:44 smithi049 bash[23528]: audit 2024-09-21T05:20:43.780916+0000 mgr.a (mgr.14388) 18451 : audit [DBG] from='client.396522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:45.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:45 smithi044 bash[22676]: cluster 2024-09-21T05:20:44.610818+0000 mgr.a (mgr.14388) 18452 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:46.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:45 smithi179 bash[23186]: cluster 2024-09-21T05:20:44.610818+0000 mgr.a (mgr.14388) 18452 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:45 smithi049 bash[23528]: cluster 2024-09-21T05:20:44.610818+0000 mgr.a (mgr.14388) 18452 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:47 smithi044 bash[22676]: cluster 2024-09-21T05:20:46.613074+0000 mgr.a (mgr.14388) 18453 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:47 smithi179 bash[23186]: cluster 2024-09-21T05:20:46.613074+0000 mgr.a (mgr.14388) 18453 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:47 smithi049 bash[23528]: cluster 2024-09-21T05:20:46.613074+0000 mgr.a (mgr.14388) 18453 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:20:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:48 smithi179 bash[23186]: audit 2024-09-21T05:20:48.125461+0000 mon.a (mon.0) 14623 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:20:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:48 smithi179 bash[23186]: audit 2024-09-21T05:20:48.132749+0000 mon.a (mon.0) 14624 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:20:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:48 smithi179 bash[23186]: audit 2024-09-21T05:20:48.134644+0000 mon.a (mon.0) 14625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:20:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:48 smithi179 bash[23186]: audit 2024-09-21T05:20:48.146149+0000 mon.a (mon.0) 14626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:48.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:48 smithi179 bash[23186]: audit 2024-09-21T05:20:48.152460+0000 mon.a (mon.0) 14627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:20:48.918 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:48 smithi049 bash[23528]: audit 2024-09-21T05:20:48.125461+0000 mon.a (mon.0) 14623 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:20:48.918 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:48 smithi049 bash[23528]: audit 2024-09-21T05:20:48.132749+0000 mon.a (mon.0) 14624 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:20:48.918 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:48 smithi049 bash[23528]: audit 2024-09-21T05:20:48.134644+0000 mon.a (mon.0) 14625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:20:48.918 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:48 smithi049 bash[23528]: audit 2024-09-21T05:20:48.146149+0000 mon.a (mon.0) 14626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:48.918 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:48 smithi049 bash[23528]: audit 2024-09-21T05:20:48.152460+0000 mon.a (mon.0) 14627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:20:48.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:20:48 smithi044 bash[22930]: debug 2024-09-21T05:20:48.898+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:20:48.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:20:48 smithi044 bash[22930]: debug 2024-09-21T05:20:48.902+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:20:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:48 smithi044 bash[22676]: audit 2024-09-21T05:20:48.125461+0000 mon.a (mon.0) 14623 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:20:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:48 smithi044 bash[22676]: audit 2024-09-21T05:20:48.132749+0000 mon.a (mon.0) 14624 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:20:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:48 smithi044 bash[22676]: audit 2024-09-21T05:20:48.134644+0000 mon.a (mon.0) 14625 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:20:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:48 smithi044 bash[22676]: audit 2024-09-21T05:20:48.146149+0000 mon.a (mon.0) 14626 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:48 smithi044 bash[22676]: audit 2024-09-21T05:20:48.152460+0000 mon.a (mon.0) 14627 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:20:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:49.228 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:49.980 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:50.174 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:49 smithi044 bash[22676]: audit 2024-09-21T05:20:48.154919+0000 mgr.a (mgr.14388) 18454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:20:50.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:49 smithi044 bash[22676]: cluster 2024-09-21T05:20:48.615255+0000 mgr.a (mgr.14388) 18455 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:50.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:49 smithi044 bash[22676]: audit 2024-09-21T05:20:48.904266+0000 mgr.a (mgr.14388) 18456 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:20:50.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:49 smithi044 bash[22676]: audit 2024-09-21T05:20:48.905002+0000 mon.a (mon.0) 14628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:49 smithi044 bash[22676]: cephadm 2024-09-21T05:20:48.905900+0000 mgr.a (mgr.14388) 18457 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:20:50.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:49 smithi044 bash[22676]: audit 2024-09-21T05:20:48.909653+0000 mon.a (mon.0) 14629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:49 smithi044 bash[22676]: audit 2024-09-21T05:20:48.914680+0000 mon.a (mon.0) 14630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:49 smithi179 bash[23186]: audit 2024-09-21T05:20:48.154919+0000 mgr.a (mgr.14388) 18454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:20:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:49 smithi179 bash[23186]: cluster 2024-09-21T05:20:48.615255+0000 mgr.a (mgr.14388) 18455 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:49 smithi179 bash[23186]: audit 2024-09-21T05:20:48.904266+0000 mgr.a (mgr.14388) 18456 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:20:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:49 smithi179 bash[23186]: audit 2024-09-21T05:20:48.905002+0000 mon.a (mon.0) 14628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:49 smithi179 bash[23186]: cephadm 2024-09-21T05:20:48.905900+0000 mgr.a (mgr.14388) 18457 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:20:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:49 smithi179 bash[23186]: audit 2024-09-21T05:20:48.909653+0000 mon.a (mon.0) 14629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:49 smithi179 bash[23186]: audit 2024-09-21T05:20:48.914680+0000 mon.a (mon.0) 14630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:49 smithi049 bash[23528]: audit 2024-09-21T05:20:48.154919+0000 mgr.a (mgr.14388) 18454 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:20:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:49 smithi049 bash[23528]: cluster 2024-09-21T05:20:48.615255+0000 mgr.a (mgr.14388) 18455 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:20:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:49 smithi049 bash[23528]: audit 2024-09-21T05:20:48.904266+0000 mgr.a (mgr.14388) 18456 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:20:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:49 smithi049 bash[23528]: audit 2024-09-21T05:20:48.905002+0000 mon.a (mon.0) 14628 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:49 smithi049 bash[23528]: cephadm 2024-09-21T05:20:48.905900+0000 mgr.a (mgr.14388) 18457 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:20:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:49 smithi049 bash[23528]: audit 2024-09-21T05:20:48.909653+0000 mon.a (mon.0) 14629 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:49 smithi049 bash[23528]: audit 2024-09-21T05:20:48.914680+0000 mon.a (mon.0) 14630 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:20:51.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:50 smithi044 bash[22676]: audit 2024-09-21T05:20:49.557266+0000 mgr.a (mgr.14388) 18458 : audit [DBG] from='client.396708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:50 smithi179 bash[23186]: audit 2024-09-21T05:20:49.557266+0000 mgr.a (mgr.14388) 18458 : audit [DBG] from='client.396708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:50 smithi049 bash[23528]: audit 2024-09-21T05:20:49.557266+0000 mgr.a (mgr.14388) 18458 : audit [DBG] from='client.396708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:51 smithi044 bash[22676]: cluster 2024-09-21T05:20:50.617798+0000 mgr.a (mgr.14388) 18459 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:51 smithi179 bash[23186]: cluster 2024-09-21T05:20:50.617798+0000 mgr.a (mgr.14388) 18459 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:51 smithi049 bash[23528]: cluster 2024-09-21T05:20:50.617798+0000 mgr.a (mgr.14388) 18459 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:53 smithi044 bash[22676]: cluster 2024-09-21T05:20:52.618626+0000 mgr.a (mgr.14388) 18460 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:53 smithi179 bash[23186]: cluster 2024-09-21T05:20:52.618626+0000 mgr.a (mgr.14388) 18460 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:53 smithi049 bash[23528]: cluster 2024-09-21T05:20:52.618626+0000 mgr.a (mgr.14388) 18460 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:54.981 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:20:54.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:20:54.982 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:20:55.772 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:20:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:20:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:20:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:20:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:20:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:55 smithi044 bash[22676]: cluster 2024-09-21T05:20:54.619426+0000 mgr.a (mgr.14388) 18461 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:55 smithi179 bash[23186]: cluster 2024-09-21T05:20:54.619426+0000 mgr.a (mgr.14388) 18461 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:55 smithi049 bash[23528]: cluster 2024-09-21T05:20:54.619426+0000 mgr.a (mgr.14388) 18461 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:57.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:56 smithi044 bash[22676]: audit 2024-09-21T05:20:55.320027+0000 mgr.a (mgr.14388) 18462 : audit [DBG] from='client.396786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:56 smithi179 bash[23186]: audit 2024-09-21T05:20:55.320027+0000 mgr.a (mgr.14388) 18462 : audit [DBG] from='client.396786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:56 smithi049 bash[23528]: audit 2024-09-21T05:20:55.320027+0000 mgr.a (mgr.14388) 18462 : audit [DBG] from='client.396786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:20:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:57 smithi044 bash[22676]: cluster 2024-09-21T05:20:56.622387+0000 mgr.a (mgr.14388) 18463 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:57 smithi179 bash[23186]: cluster 2024-09-21T05:20:56.622387+0000 mgr.a (mgr.14388) 18463 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:20:58.262 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:57 smithi049 bash[23528]: cluster 2024-09-21T05:20:56.622387+0000 mgr.a (mgr.14388) 18463 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:59 smithi044 bash[22676]: cluster 2024-09-21T05:20:58.623171+0000 mgr.a (mgr.14388) 18464 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:21:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:59 smithi044 bash[22676]: audit 2024-09-21T05:20:58.856693+0000 mon.a (mon.0) 14631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:59 smithi044 bash[22676]: audit 2024-09-21T05:20:58.862648+0000 mon.a (mon.0) 14632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:59 smithi044 bash[22676]: audit 2024-09-21T05:20:58.870365+0000 mon.a (mon.0) 14633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:59 smithi044 bash[22676]: audit 2024-09-21T05:20:59.026111+0000 mon.a (mon.0) 14634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:59 smithi044 bash[22676]: audit 2024-09-21T05:20:59.034497+0000 mon.a (mon.0) 14635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:20:59 smithi044 bash[22676]: audit 2024-09-21T05:20:59.045621+0000 mon.a (mon.0) 14636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:59 smithi179 bash[23186]: cluster 2024-09-21T05:20:58.623171+0000 mgr.a (mgr.14388) 18464 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:21:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:59 smithi179 bash[23186]: audit 2024-09-21T05:20:58.856693+0000 mon.a (mon.0) 14631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:59 smithi179 bash[23186]: audit 2024-09-21T05:20:58.862648+0000 mon.a (mon.0) 14632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:59 smithi179 bash[23186]: audit 2024-09-21T05:20:58.870365+0000 mon.a (mon.0) 14633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:59 smithi179 bash[23186]: audit 2024-09-21T05:20:59.026111+0000 mon.a (mon.0) 14634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:59 smithi179 bash[23186]: audit 2024-09-21T05:20:59.034497+0000 mon.a (mon.0) 14635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:20:59 smithi179 bash[23186]: audit 2024-09-21T05:20:59.045621+0000 mon.a (mon.0) 14636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:59 smithi049 bash[23528]: cluster 2024-09-21T05:20:58.623171+0000 mgr.a (mgr.14388) 18464 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:21:00.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:59 smithi049 bash[23528]: audit 2024-09-21T05:20:58.856693+0000 mon.a (mon.0) 14631 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:59 smithi049 bash[23528]: audit 2024-09-21T05:20:58.862648+0000 mon.a (mon.0) 14632 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:59 smithi049 bash[23528]: audit 2024-09-21T05:20:58.870365+0000 mon.a (mon.0) 14633 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:59 smithi049 bash[23528]: audit 2024-09-21T05:20:59.026111+0000 mon.a (mon.0) 14634 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:59 smithi049 bash[23528]: audit 2024-09-21T05:20:59.034497+0000 mon.a (mon.0) 14635 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:20:59 smithi049 bash[23528]: audit 2024-09-21T05:20:59.045621+0000 mon.a (mon.0) 14636 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:00.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:00.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:01.555 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:01.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:01.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:01.555 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:01.556 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:01 smithi044 bash[22676]: cluster 2024-09-21T05:21:00.625123+0000 mgr.a (mgr.14388) 18465 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:01 smithi179 bash[23186]: cluster 2024-09-21T05:21:00.625123+0000 mgr.a (mgr.14388) 18465 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:01 smithi049 bash[23528]: cluster 2024-09-21T05:21:00.625123+0000 mgr.a (mgr.14388) 18465 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:02 smithi049 bash[23528]: audit 2024-09-21T05:21:01.108068+0000 mgr.a (mgr.14388) 18466 : audit [DBG] from='client.396861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:02 smithi044 bash[22676]: audit 2024-09-21T05:21:01.108068+0000 mgr.a (mgr.14388) 18466 : audit [DBG] from='client.396861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:02 smithi179 bash[23186]: audit 2024-09-21T05:21:01.108068+0000 mgr.a (mgr.14388) 18466 : audit [DBG] from='client.396861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:03 smithi044 bash[22676]: cluster 2024-09-21T05:21:02.626016+0000 mgr.a (mgr.14388) 18467 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:03 smithi179 bash[23186]: cluster 2024-09-21T05:21:02.626016+0000 mgr.a (mgr.14388) 18467 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:03 smithi049 bash[23528]: cluster 2024-09-21T05:21:02.626016+0000 mgr.a (mgr.14388) 18467 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:05 smithi044 bash[22676]: cluster 2024-09-21T05:21:04.626787+0000 mgr.a (mgr.14388) 18468 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:21:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:05 smithi179 bash[23186]: cluster 2024-09-21T05:21:04.626787+0000 mgr.a (mgr.14388) 18468 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:21:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:05 smithi049 bash[23528]: cluster 2024-09-21T05:21:04.626787+0000 mgr.a (mgr.14388) 18468 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:21:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:07.324 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:07.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:07.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:07.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:07.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:07 smithi044 bash[22676]: cluster 2024-09-21T05:21:06.628933+0000 mgr.a (mgr.14388) 18469 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:07 smithi044 bash[22676]: audit 2024-09-21T05:21:06.889169+0000 mgr.a (mgr.14388) 18470 : audit [DBG] from='client.396936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:07 smithi179 bash[23186]: cluster 2024-09-21T05:21:06.628933+0000 mgr.a (mgr.14388) 18469 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:07 smithi179 bash[23186]: audit 2024-09-21T05:21:06.889169+0000 mgr.a (mgr.14388) 18470 : audit [DBG] from='client.396936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:07 smithi049 bash[23528]: cluster 2024-09-21T05:21:06.628933+0000 mgr.a (mgr.14388) 18469 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:07 smithi049 bash[23528]: audit 2024-09-21T05:21:06.889169+0000 mgr.a (mgr.14388) 18470 : audit [DBG] from='client.396936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:09 smithi044 bash[22676]: cluster 2024-09-21T05:21:08.629846+0000 mgr.a (mgr.14388) 18471 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:09 smithi044 bash[22676]: audit 2024-09-21T05:21:09.110743+0000 mon.a (mon.0) 14637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:09 smithi044 bash[22676]: audit 2024-09-21T05:21:09.119676+0000 mon.a (mon.0) 14638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:09 smithi044 bash[22676]: audit 2024-09-21T05:21:09.130168+0000 mon.a (mon.0) 14639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:09 smithi179 bash[23186]: cluster 2024-09-21T05:21:08.629846+0000 mgr.a (mgr.14388) 18471 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:09 smithi179 bash[23186]: audit 2024-09-21T05:21:09.110743+0000 mon.a (mon.0) 14637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:09 smithi179 bash[23186]: audit 2024-09-21T05:21:09.119676+0000 mon.a (mon.0) 14638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:09 smithi179 bash[23186]: audit 2024-09-21T05:21:09.130168+0000 mon.a (mon.0) 14639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:09 smithi049 bash[23528]: cluster 2024-09-21T05:21:08.629846+0000 mgr.a (mgr.14388) 18471 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:10.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:09 smithi049 bash[23528]: audit 2024-09-21T05:21:09.110743+0000 mon.a (mon.0) 14637 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:09 smithi049 bash[23528]: audit 2024-09-21T05:21:09.119676+0000 mon.a (mon.0) 14638 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:10.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:09 smithi049 bash[23528]: audit 2024-09-21T05:21:09.130168+0000 mon.a (mon.0) 14639 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:12.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:11 smithi044 bash[22676]: cluster 2024-09-21T05:21:10.632119+0000 mgr.a (mgr.14388) 18472 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:11 smithi179 bash[23186]: cluster 2024-09-21T05:21:10.632119+0000 mgr.a (mgr.14388) 18472 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:11 smithi049 bash[23528]: cluster 2024-09-21T05:21:10.632119+0000 mgr.a (mgr.14388) 18472 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:12.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:12.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:12.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:13.111 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:13.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:13.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:13.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:13.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:13 smithi044 bash[22676]: cluster 2024-09-21T05:21:12.632851+0000 mgr.a (mgr.14388) 18473 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:13 smithi044 bash[22676]: audit 2024-09-21T05:21:12.661312+0000 mgr.a (mgr.14388) 18474 : audit [DBG] from='client.397014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:13 smithi179 bash[23186]: cluster 2024-09-21T05:21:12.632851+0000 mgr.a (mgr.14388) 18473 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:13 smithi179 bash[23186]: audit 2024-09-21T05:21:12.661312+0000 mgr.a (mgr.14388) 18474 : audit [DBG] from='client.397014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:13 smithi049 bash[23528]: cluster 2024-09-21T05:21:12.632851+0000 mgr.a (mgr.14388) 18473 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:14.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:13 smithi049 bash[23528]: audit 2024-09-21T05:21:12.661312+0000 mgr.a (mgr.14388) 18474 : audit [DBG] from='client.397014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:16.228 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:15 smithi049 bash[23528]: cluster 2024-09-21T05:21:14.633798+0000 mgr.a (mgr.14388) 18475 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:15 smithi044 bash[22676]: cluster 2024-09-21T05:21:14.633798+0000 mgr.a (mgr.14388) 18475 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:15 smithi179 bash[23186]: cluster 2024-09-21T05:21:14.633798+0000 mgr.a (mgr.14388) 18475 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:17 smithi049 bash[23528]: cluster 2024-09-21T05:21:16.636059+0000 mgr.a (mgr.14388) 18476 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:18.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:18.114 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:18.114 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:17 smithi044 bash[22676]: cluster 2024-09-21T05:21:16.636059+0000 mgr.a (mgr.14388) 18476 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:17 smithi179 bash[23186]: cluster 2024-09-21T05:21:16.636059+0000 mgr.a (mgr.14388) 18476 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:18.894 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:18.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: audit 2024-09-21T05:21:18.449729+0000 mgr.a (mgr.14388) 18477 : audit [DBG] from='client.397092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: cluster 2024-09-21T05:21:18.636653+0000 mgr.a (mgr.14388) 18478 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: audit 2024-09-21T05:21:19.086642+0000 mon.a (mon.0) 14640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: audit 2024-09-21T05:21:19.093539+0000 mon.a (mon.0) 14641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: audit 2024-09-21T05:21:19.104153+0000 mon.a (mon.0) 14642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: audit 2024-09-21T05:21:19.233850+0000 mon.a (mon.0) 14643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: audit 2024-09-21T05:21:19.242422+0000 mon.a (mon.0) 14644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:19 smithi044 bash[22676]: audit 2024-09-21T05:21:19.252577+0000 mon.a (mon.0) 14645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: audit 2024-09-21T05:21:18.449729+0000 mgr.a (mgr.14388) 18477 : audit [DBG] from='client.397092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: cluster 2024-09-21T05:21:18.636653+0000 mgr.a (mgr.14388) 18478 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: audit 2024-09-21T05:21:19.086642+0000 mon.a (mon.0) 14640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: audit 2024-09-21T05:21:19.093539+0000 mon.a (mon.0) 14641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: audit 2024-09-21T05:21:19.104153+0000 mon.a (mon.0) 14642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: audit 2024-09-21T05:21:19.233850+0000 mon.a (mon.0) 14643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: audit 2024-09-21T05:21:19.242422+0000 mon.a (mon.0) 14644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:19 smithi179 bash[23186]: audit 2024-09-21T05:21:19.252577+0000 mon.a (mon.0) 14645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: audit 2024-09-21T05:21:18.449729+0000 mgr.a (mgr.14388) 18477 : audit [DBG] from='client.397092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: cluster 2024-09-21T05:21:18.636653+0000 mgr.a (mgr.14388) 18478 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: audit 2024-09-21T05:21:19.086642+0000 mon.a (mon.0) 14640 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: audit 2024-09-21T05:21:19.093539+0000 mon.a (mon.0) 14641 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: audit 2024-09-21T05:21:19.104153+0000 mon.a (mon.0) 14642 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: audit 2024-09-21T05:21:19.233850+0000 mon.a (mon.0) 14643 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: audit 2024-09-21T05:21:19.242422+0000 mon.a (mon.0) 14644 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:20.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:19 smithi049 bash[23528]: audit 2024-09-21T05:21:19.252577+0000 mon.a (mon.0) 14645 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:21 smithi044 bash[22676]: cluster 2024-09-21T05:21:20.638924+0000 mgr.a (mgr.14388) 18479 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:21 smithi179 bash[23186]: cluster 2024-09-21T05:21:20.638924+0000 mgr.a (mgr.14388) 18479 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:21 smithi049 bash[23528]: cluster 2024-09-21T05:21:20.638924+0000 mgr.a (mgr.14388) 18479 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:23 smithi044 bash[22676]: cluster 2024-09-21T05:21:22.639698+0000 mgr.a (mgr.14388) 18480 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:23 smithi179 bash[23186]: cluster 2024-09-21T05:21:22.639698+0000 mgr.a (mgr.14388) 18480 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:23 smithi049 bash[23528]: cluster 2024-09-21T05:21:22.639698+0000 mgr.a (mgr.14388) 18480 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:24.681 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:24.681 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:24.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:24.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:24.682 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:25 smithi044 bash[22676]: audit 2024-09-21T05:21:24.232421+0000 mgr.a (mgr.14388) 18481 : audit [DBG] from='client.397170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:25 smithi044 bash[22676]: cluster 2024-09-21T05:21:24.640351+0000 mgr.a (mgr.14388) 18482 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:25 smithi179 bash[23186]: audit 2024-09-21T05:21:24.232421+0000 mgr.a (mgr.14388) 18481 : audit [DBG] from='client.397170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:25 smithi179 bash[23186]: cluster 2024-09-21T05:21:24.640351+0000 mgr.a (mgr.14388) 18482 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:25 smithi049 bash[23528]: audit 2024-09-21T05:21:24.232421+0000 mgr.a (mgr.14388) 18481 : audit [DBG] from='client.397170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:25 smithi049 bash[23528]: cluster 2024-09-21T05:21:24.640351+0000 mgr.a (mgr.14388) 18482 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:28.228 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:27 smithi179 bash[23186]: cluster 2024-09-21T05:21:26.642591+0000 mgr.a (mgr.14388) 18483 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:27 smithi044 bash[22676]: cluster 2024-09-21T05:21:26.642591+0000 mgr.a (mgr.14388) 18483 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:27 smithi049 bash[23528]: cluster 2024-09-21T05:21:26.642591+0000 mgr.a (mgr.14388) 18483 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:29 smithi044 bash[22676]: cluster 2024-09-21T05:21:28.643360+0000 mgr.a (mgr.14388) 18484 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:29 smithi044 bash[22676]: audit 2024-09-21T05:21:29.346828+0000 mon.a (mon.0) 14646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:29 smithi044 bash[22676]: audit 2024-09-21T05:21:29.355633+0000 mon.a (mon.0) 14647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:29 smithi044 bash[22676]: audit 2024-09-21T05:21:29.366531+0000 mon.a (mon.0) 14648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:29 smithi179 bash[23186]: cluster 2024-09-21T05:21:28.643360+0000 mgr.a (mgr.14388) 18484 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:29 smithi179 bash[23186]: audit 2024-09-21T05:21:29.346828+0000 mon.a (mon.0) 14646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:29 smithi179 bash[23186]: audit 2024-09-21T05:21:29.355633+0000 mon.a (mon.0) 14647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:29 smithi179 bash[23186]: audit 2024-09-21T05:21:29.366531+0000 mon.a (mon.0) 14648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:29 smithi049 bash[23528]: cluster 2024-09-21T05:21:28.643360+0000 mgr.a (mgr.14388) 18484 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:30.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:29 smithi049 bash[23528]: audit 2024-09-21T05:21:29.346828+0000 mon.a (mon.0) 14646 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:29 smithi049 bash[23528]: audit 2024-09-21T05:21:29.355633+0000 mon.a (mon.0) 14647 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:29 smithi049 bash[23528]: audit 2024-09-21T05:21:29.366531+0000 mon.a (mon.0) 14648 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:30.446 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:31 smithi044 bash[22676]: audit 2024-09-21T05:21:30.016992+0000 mgr.a (mgr.14388) 18485 : audit [DBG] from='client.397248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:31 smithi044 bash[22676]: cluster 2024-09-21T05:21:30.646186+0000 mgr.a (mgr.14388) 18486 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:31 smithi179 bash[23186]: audit 2024-09-21T05:21:30.016992+0000 mgr.a (mgr.14388) 18485 : audit [DBG] from='client.397248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:31 smithi179 bash[23186]: cluster 2024-09-21T05:21:30.646186+0000 mgr.a (mgr.14388) 18486 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:31 smithi049 bash[23528]: audit 2024-09-21T05:21:30.016992+0000 mgr.a (mgr.14388) 18485 : audit [DBG] from='client.397248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:31 smithi049 bash[23528]: cluster 2024-09-21T05:21:30.646186+0000 mgr.a (mgr.14388) 18486 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:33 smithi044 bash[22676]: cluster 2024-09-21T05:21:32.646951+0000 mgr.a (mgr.14388) 18487 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:33 smithi179 bash[23186]: cluster 2024-09-21T05:21:32.646951+0000 mgr.a (mgr.14388) 18487 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:33 smithi049 bash[23528]: cluster 2024-09-21T05:21:32.646951+0000 mgr.a (mgr.14388) 18487 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:35.447 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:35.448 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:35.448 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:36.199 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:35 smithi049 bash[23528]: cluster 2024-09-21T05:21:34.647853+0000 mgr.a (mgr.14388) 18488 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:21:36.208 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:36.208 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:36.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:35 smithi044 bash[22676]: cluster 2024-09-21T05:21:34.647853+0000 mgr.a (mgr.14388) 18488 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:21:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:35 smithi179 bash[23186]: cluster 2024-09-21T05:21:34.647853+0000 mgr.a (mgr.14388) 18488 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:21:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:36 smithi044 bash[22676]: audit 2024-09-21T05:21:35.775132+0000 mgr.a (mgr.14388) 18489 : audit [DBG] from='client.397323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:36 smithi179 bash[23186]: audit 2024-09-21T05:21:35.775132+0000 mgr.a (mgr.14388) 18489 : audit [DBG] from='client.397323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:36 smithi049 bash[23528]: audit 2024-09-21T05:21:35.775132+0000 mgr.a (mgr.14388) 18489 : audit [DBG] from='client.397323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:37 smithi044 bash[22676]: cluster 2024-09-21T05:21:36.650837+0000 mgr.a (mgr.14388) 18490 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:37 smithi179 bash[23186]: cluster 2024-09-21T05:21:36.650837+0000 mgr.a (mgr.14388) 18490 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:37 smithi049 bash[23528]: cluster 2024-09-21T05:21:36.650837+0000 mgr.a (mgr.14388) 18490 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:39 smithi044 bash[22676]: cluster 2024-09-21T05:21:38.651602+0000 mgr.a (mgr.14388) 18491 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:39 smithi044 bash[22676]: audit 2024-09-21T05:21:39.309749+0000 mon.a (mon.0) 14649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:39 smithi044 bash[22676]: audit 2024-09-21T05:21:39.316669+0000 mon.a (mon.0) 14650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:39 smithi044 bash[22676]: audit 2024-09-21T05:21:39.325161+0000 mon.a (mon.0) 14651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:39 smithi044 bash[22676]: audit 2024-09-21T05:21:39.426717+0000 mon.a (mon.0) 14652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:39 smithi044 bash[22676]: audit 2024-09-21T05:21:39.435700+0000 mon.a (mon.0) 14653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:39 smithi044 bash[22676]: audit 2024-09-21T05:21:39.447140+0000 mon.a (mon.0) 14654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:39 smithi179 bash[23186]: cluster 2024-09-21T05:21:38.651602+0000 mgr.a (mgr.14388) 18491 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:39 smithi179 bash[23186]: audit 2024-09-21T05:21:39.309749+0000 mon.a (mon.0) 14649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:39 smithi179 bash[23186]: audit 2024-09-21T05:21:39.316669+0000 mon.a (mon.0) 14650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:39 smithi179 bash[23186]: audit 2024-09-21T05:21:39.325161+0000 mon.a (mon.0) 14651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:39 smithi179 bash[23186]: audit 2024-09-21T05:21:39.426717+0000 mon.a (mon.0) 14652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:39 smithi179 bash[23186]: audit 2024-09-21T05:21:39.435700+0000 mon.a (mon.0) 14653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:39 smithi179 bash[23186]: audit 2024-09-21T05:21:39.447140+0000 mon.a (mon.0) 14654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:39 smithi049 bash[23528]: cluster 2024-09-21T05:21:38.651602+0000 mgr.a (mgr.14388) 18491 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:21:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:39 smithi049 bash[23528]: audit 2024-09-21T05:21:39.309749+0000 mon.a (mon.0) 14649 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:39 smithi049 bash[23528]: audit 2024-09-21T05:21:39.316669+0000 mon.a (mon.0) 14650 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:39 smithi049 bash[23528]: audit 2024-09-21T05:21:39.325161+0000 mon.a (mon.0) 14651 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:39 smithi049 bash[23528]: audit 2024-09-21T05:21:39.426717+0000 mon.a (mon.0) 14652 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:39 smithi049 bash[23528]: audit 2024-09-21T05:21:39.435700+0000 mon.a (mon.0) 14653 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:40.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:39 smithi049 bash[23528]: audit 2024-09-21T05:21:39.447140+0000 mon.a (mon.0) 14654 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:41.209 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:41.210 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:42.012 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:42.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:41 smithi044 bash[22676]: cluster 2024-09-21T05:21:40.653581+0000 mgr.a (mgr.14388) 18492 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:41 smithi179 bash[23186]: cluster 2024-09-21T05:21:40.653581+0000 mgr.a (mgr.14388) 18492 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:41 smithi049 bash[23528]: cluster 2024-09-21T05:21:40.653581+0000 mgr.a (mgr.14388) 18492 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:42 smithi044 bash[22676]: audit 2024-09-21T05:21:41.550425+0000 mgr.a (mgr.14388) 18493 : audit [DBG] from='client.397401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:42 smithi179 bash[23186]: audit 2024-09-21T05:21:41.550425+0000 mgr.a (mgr.14388) 18493 : audit [DBG] from='client.397401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:42 smithi049 bash[23528]: audit 2024-09-21T05:21:41.550425+0000 mgr.a (mgr.14388) 18493 : audit [DBG] from='client.397401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:43 smithi044 bash[22676]: cluster 2024-09-21T05:21:42.654545+0000 mgr.a (mgr.14388) 18494 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:43 smithi179 bash[23186]: cluster 2024-09-21T05:21:42.654545+0000 mgr.a (mgr.14388) 18494 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:43 smithi049 bash[23528]: cluster 2024-09-21T05:21:42.654545+0000 mgr.a (mgr.14388) 18494 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:45 smithi044 bash[22676]: cluster 2024-09-21T05:21:44.655354+0000 mgr.a (mgr.14388) 18495 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:45 smithi179 bash[23186]: cluster 2024-09-21T05:21:44.655354+0000 mgr.a (mgr.14388) 18495 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:45 smithi049 bash[23528]: cluster 2024-09-21T05:21:44.655354+0000 mgr.a (mgr.14388) 18495 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:47.759 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:47 smithi044 bash[22676]: cluster 2024-09-21T05:21:46.657637+0000 mgr.a (mgr.14388) 18496 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:47 smithi179 bash[23186]: cluster 2024-09-21T05:21:46.657637+0000 mgr.a (mgr.14388) 18496 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:47 smithi049 bash[23528]: cluster 2024-09-21T05:21:46.657637+0000 mgr.a (mgr.14388) 18496 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:21:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:48 smithi179 bash[23186]: audit 2024-09-21T05:21:47.344752+0000 mgr.a (mgr.14388) 18497 : audit [DBG] from='client.397479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:48 smithi179 bash[23186]: audit 2024-09-21T05:21:48.958798+0000 mon.a (mon.0) 14655 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:21:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:48 smithi179 bash[23186]: audit 2024-09-21T05:21:48.965869+0000 mon.a (mon.0) 14656 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:21:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:48 smithi179 bash[23186]: audit 2024-09-21T05:21:48.967791+0000 mon.a (mon.0) 14657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:21:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:48 smithi179 bash[23186]: audit 2024-09-21T05:21:48.979256+0000 mon.a (mon.0) 14658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:48 smithi049 bash[23528]: audit 2024-09-21T05:21:47.344752+0000 mgr.a (mgr.14388) 18497 : audit [DBG] from='client.397479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:48 smithi049 bash[23528]: audit 2024-09-21T05:21:48.958798+0000 mon.a (mon.0) 14655 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:21:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:48 smithi049 bash[23528]: audit 2024-09-21T05:21:48.965869+0000 mon.a (mon.0) 14656 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:21:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:48 smithi049 bash[23528]: audit 2024-09-21T05:21:48.967791+0000 mon.a (mon.0) 14657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:21:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:48 smithi049 bash[23528]: audit 2024-09-21T05:21:48.979256+0000 mon.a (mon.0) 14658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:48 smithi044 bash[22676]: audit 2024-09-21T05:21:47.344752+0000 mgr.a (mgr.14388) 18497 : audit [DBG] from='client.397479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:48 smithi044 bash[22676]: audit 2024-09-21T05:21:48.958798+0000 mon.a (mon.0) 14655 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:21:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:48 smithi044 bash[22676]: audit 2024-09-21T05:21:48.965869+0000 mon.a (mon.0) 14656 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:21:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:48 smithi044 bash[22676]: audit 2024-09-21T05:21:48.967791+0000 mon.a (mon.0) 14657 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:21:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:48 smithi044 bash[22676]: audit 2024-09-21T05:21:48.979256+0000 mon.a (mon.0) 14658 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22930]: debug 2024-09-21T05:21:49.769+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:21:50.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22930]: debug 2024-09-21T05:21:49.769+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:21:50.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: cluster 2024-09-21T05:21:48.658672+0000 mgr.a (mgr.14388) 18498 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:50.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: audit 2024-09-21T05:21:48.988880+0000 mon.a (mon.0) 14659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:21:50.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: audit 2024-09-21T05:21:48.992536+0000 mgr.a (mgr.14388) 18499 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:21:50.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: audit 2024-09-21T05:21:49.568744+0000 mon.a (mon.0) 14660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: audit 2024-09-21T05:21:49.574701+0000 mon.a (mon.0) 14661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: audit 2024-09-21T05:21:49.582099+0000 mon.a (mon.0) 14662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: audit 2024-09-21T05:21:49.769272+0000 mgr.a (mgr.14388) 18500 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:21:50.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:49 smithi044 bash[22676]: cephadm 2024-09-21T05:21:49.770397+0000 mgr.a (mgr.14388) 18501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:21:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: cluster 2024-09-21T05:21:48.658672+0000 mgr.a (mgr.14388) 18498 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: audit 2024-09-21T05:21:48.988880+0000 mon.a (mon.0) 14659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:21:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: audit 2024-09-21T05:21:48.992536+0000 mgr.a (mgr.14388) 18499 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:21:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: audit 2024-09-21T05:21:49.568744+0000 mon.a (mon.0) 14660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: audit 2024-09-21T05:21:49.574701+0000 mon.a (mon.0) 14661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: audit 2024-09-21T05:21:49.582099+0000 mon.a (mon.0) 14662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: audit 2024-09-21T05:21:49.769272+0000 mgr.a (mgr.14388) 18500 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:21:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:49 smithi179 bash[23186]: cephadm 2024-09-21T05:21:49.770397+0000 mgr.a (mgr.14388) 18501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: cluster 2024-09-21T05:21:48.658672+0000 mgr.a (mgr.14388) 18498 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: audit 2024-09-21T05:21:48.988880+0000 mon.a (mon.0) 14659 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: audit 2024-09-21T05:21:48.992536+0000 mgr.a (mgr.14388) 18499 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: audit 2024-09-21T05:21:49.568744+0000 mon.a (mon.0) 14660 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: audit 2024-09-21T05:21:49.574701+0000 mon.a (mon.0) 14661 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: audit 2024-09-21T05:21:49.582099+0000 mon.a (mon.0) 14662 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: audit 2024-09-21T05:21:49.769272+0000 mgr.a (mgr.14388) 18500 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:21:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:49 smithi049 bash[23528]: cephadm 2024-09-21T05:21:49.770397+0000 mgr.a (mgr.14388) 18501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:21:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:51 smithi044 bash[22676]: cluster 2024-09-21T05:21:50.661123+0000 mgr.a (mgr.14388) 18502 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:51 smithi179 bash[23186]: cluster 2024-09-21T05:21:50.661123+0000 mgr.a (mgr.14388) 18502 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:51 smithi049 bash[23528]: cluster 2024-09-21T05:21:50.661123+0000 mgr.a (mgr.14388) 18502 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:52.760 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:52.761 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:52.761 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:53.513 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:53.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:53.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:53.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:53.514 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:53 smithi044 bash[22676]: cluster 2024-09-21T05:21:52.661898+0000 mgr.a (mgr.14388) 18503 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:53 smithi179 bash[23186]: cluster 2024-09-21T05:21:52.661898+0000 mgr.a (mgr.14388) 18503 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:53 smithi049 bash[23528]: cluster 2024-09-21T05:21:52.661898+0000 mgr.a (mgr.14388) 18503 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:54 smithi044 bash[22676]: audit 2024-09-21T05:21:53.087287+0000 mgr.a (mgr.14388) 18504 : audit [DBG] from='client.397665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:54 smithi179 bash[23186]: audit 2024-09-21T05:21:53.087287+0000 mgr.a (mgr.14388) 18504 : audit [DBG] from='client.397665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:54 smithi049 bash[23528]: audit 2024-09-21T05:21:53.087287+0000 mgr.a (mgr.14388) 18504 : audit [DBG] from='client.397665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:55 smithi044 bash[22676]: cluster 2024-09-21T05:21:54.663089+0000 mgr.a (mgr.14388) 18505 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:55 smithi179 bash[23186]: cluster 2024-09-21T05:21:54.663089+0000 mgr.a (mgr.14388) 18505 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:55 smithi049 bash[23528]: cluster 2024-09-21T05:21:54.663089+0000 mgr.a (mgr.14388) 18505 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:57 smithi044 bash[22676]: cluster 2024-09-21T05:21:56.665563+0000 mgr.a (mgr.14388) 18506 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:57 smithi179 bash[23186]: cluster 2024-09-21T05:21:56.665563+0000 mgr.a (mgr.14388) 18506 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:57 smithi049 bash[23528]: cluster 2024-09-21T05:21:56.665563+0000 mgr.a (mgr.14388) 18506 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:58.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:21:58.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:21:58.516 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:21:59.272 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:21:59.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:21:59.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:21:59.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:21:59.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:21:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: cluster 2024-09-21T05:21:58.666309+0000 mgr.a (mgr.14388) 18507 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:21:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: audit 2024-09-21T05:21:58.846018+0000 mgr.a (mgr.14388) 18508 : audit [DBG] from='client.397740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: audit 2024-09-21T05:21:59.517501+0000 mon.a (mon.0) 14663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: audit 2024-09-21T05:21:59.523744+0000 mon.a (mon.0) 14664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: audit 2024-09-21T05:21:59.530036+0000 mon.a (mon.0) 14665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: audit 2024-09-21T05:21:59.659737+0000 mon.a (mon.0) 14666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: audit 2024-09-21T05:21:59.668122+0000 mon.a (mon.0) 14667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:21:59.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:21:59 smithi044 bash[22676]: audit 2024-09-21T05:21:59.679541+0000 mon.a (mon.0) 14668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: cluster 2024-09-21T05:21:58.666309+0000 mgr.a (mgr.14388) 18507 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:22:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: audit 2024-09-21T05:21:58.846018+0000 mgr.a (mgr.14388) 18508 : audit [DBG] from='client.397740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: audit 2024-09-21T05:21:59.517501+0000 mon.a (mon.0) 14663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: audit 2024-09-21T05:21:59.523744+0000 mon.a (mon.0) 14664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: audit 2024-09-21T05:21:59.530036+0000 mon.a (mon.0) 14665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: audit 2024-09-21T05:21:59.659737+0000 mon.a (mon.0) 14666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: audit 2024-09-21T05:21:59.668122+0000 mon.a (mon.0) 14667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:21:59 smithi179 bash[23186]: audit 2024-09-21T05:21:59.679541+0000 mon.a (mon.0) 14668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: cluster 2024-09-21T05:21:58.666309+0000 mgr.a (mgr.14388) 18507 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:22:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: audit 2024-09-21T05:21:58.846018+0000 mgr.a (mgr.14388) 18508 : audit [DBG] from='client.397740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: audit 2024-09-21T05:21:59.517501+0000 mon.a (mon.0) 14663 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: audit 2024-09-21T05:21:59.523744+0000 mon.a (mon.0) 14664 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: audit 2024-09-21T05:21:59.530036+0000 mon.a (mon.0) 14665 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: audit 2024-09-21T05:21:59.659737+0000 mon.a (mon.0) 14666 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: audit 2024-09-21T05:21:59.668122+0000 mon.a (mon.0) 14667 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:00.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:21:59 smithi049 bash[23528]: audit 2024-09-21T05:21:59.679541+0000 mon.a (mon.0) 14668 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:02.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:01 smithi179 bash[23186]: cluster 2024-09-21T05:22:00.668625+0000 mgr.a (mgr.14388) 18509 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:22:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:01 smithi049 bash[23528]: cluster 2024-09-21T05:22:00.668625+0000 mgr.a (mgr.14388) 18509 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:22:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:01 smithi044 bash[22676]: cluster 2024-09-21T05:22:00.668625+0000 mgr.a (mgr.14388) 18509 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:22:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:03 smithi179 bash[23186]: cluster 2024-09-21T05:22:02.669451+0000 mgr.a (mgr.14388) 18510 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:03 smithi049 bash[23528]: cluster 2024-09-21T05:22:02.669451+0000 mgr.a (mgr.14388) 18510 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:03 smithi044 bash[22676]: cluster 2024-09-21T05:22:02.669451+0000 mgr.a (mgr.14388) 18510 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:04.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:04.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:04.275 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:05.051 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:05.051 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:05 smithi179 bash[23186]: audit 2024-09-21T05:22:04.606592+0000 mgr.a (mgr.14388) 18511 : audit [DBG] from='client.397818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:05 smithi179 bash[23186]: cluster 2024-09-21T05:22:04.670021+0000 mgr.a (mgr.14388) 18512 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:05 smithi049 bash[23528]: audit 2024-09-21T05:22:04.606592+0000 mgr.a (mgr.14388) 18511 : audit [DBG] from='client.397818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:05 smithi049 bash[23528]: cluster 2024-09-21T05:22:04.670021+0000 mgr.a (mgr.14388) 18512 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:05 smithi044 bash[22676]: audit 2024-09-21T05:22:04.606592+0000 mgr.a (mgr.14388) 18511 : audit [DBG] from='client.397818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:05 smithi044 bash[22676]: cluster 2024-09-21T05:22:04.670021+0000 mgr.a (mgr.14388) 18512 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:07 smithi049 bash[23528]: cluster 2024-09-21T05:22:06.672381+0000 mgr.a (mgr.14388) 18513 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:07 smithi044 bash[22676]: cluster 2024-09-21T05:22:06.672381+0000 mgr.a (mgr.14388) 18513 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:07 smithi179 bash[23186]: cluster 2024-09-21T05:22:06.672381+0000 mgr.a (mgr.14388) 18513 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:09 smithi179 bash[23186]: cluster 2024-09-21T05:22:08.673208+0000 mgr.a (mgr.14388) 18514 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:10.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:10.052 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:10.053 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:09 smithi049 bash[23528]: cluster 2024-09-21T05:22:08.673208+0000 mgr.a (mgr.14388) 18514 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:09 smithi044 bash[22676]: cluster 2024-09-21T05:22:08.673208+0000 mgr.a (mgr.14388) 18514 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:10.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:10.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:10.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:10.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:10.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:10 smithi049 bash[23528]: audit 2024-09-21T05:22:09.800968+0000 mon.a (mon.0) 14669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:10 smithi049 bash[23528]: audit 2024-09-21T05:22:09.809693+0000 mon.a (mon.0) 14670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:10 smithi049 bash[23528]: audit 2024-09-21T05:22:09.820256+0000 mon.a (mon.0) 14671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:10 smithi179 bash[23186]: audit 2024-09-21T05:22:09.800968+0000 mon.a (mon.0) 14669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:10 smithi179 bash[23186]: audit 2024-09-21T05:22:09.809693+0000 mon.a (mon.0) 14670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:10 smithi179 bash[23186]: audit 2024-09-21T05:22:09.820256+0000 mon.a (mon.0) 14671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:10 smithi044 bash[22676]: audit 2024-09-21T05:22:09.800968+0000 mon.a (mon.0) 14669 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:10 smithi044 bash[22676]: audit 2024-09-21T05:22:09.809693+0000 mon.a (mon.0) 14670 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:10 smithi044 bash[22676]: audit 2024-09-21T05:22:09.820256+0000 mon.a (mon.0) 14671 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:12.088 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:11 smithi044 bash[22676]: audit 2024-09-21T05:22:10.374476+0000 mgr.a (mgr.14388) 18515 : audit [DBG] from='client.397896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:12.088 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:11 smithi044 bash[22676]: cluster 2024-09-21T05:22:10.674666+0000 mgr.a (mgr.14388) 18516 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:11 smithi179 bash[23186]: audit 2024-09-21T05:22:10.374476+0000 mgr.a (mgr.14388) 18515 : audit [DBG] from='client.397896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:11 smithi179 bash[23186]: cluster 2024-09-21T05:22:10.674666+0000 mgr.a (mgr.14388) 18516 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:11 smithi049 bash[23528]: audit 2024-09-21T05:22:10.374476+0000 mgr.a (mgr.14388) 18515 : audit [DBG] from='client.397896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:11 smithi049 bash[23528]: cluster 2024-09-21T05:22:10.674666+0000 mgr.a (mgr.14388) 18516 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:13 smithi044 bash[22676]: cluster 2024-09-21T05:22:12.675260+0000 mgr.a (mgr.14388) 18517 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:22:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:13 smithi179 bash[23186]: cluster 2024-09-21T05:22:12.675260+0000 mgr.a (mgr.14388) 18517 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:22:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:13 smithi049 bash[23528]: cluster 2024-09-21T05:22:12.675260+0000 mgr.a (mgr.14388) 18517 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:22:15.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:15.804 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:16.174 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:15 smithi049 bash[23528]: cluster 2024-09-21T05:22:14.675842+0000 mgr.a (mgr.14388) 18518 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:22:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:15 smithi044 bash[22676]: cluster 2024-09-21T05:22:14.675842+0000 mgr.a (mgr.14388) 18518 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:22:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:15 smithi179 bash[23186]: cluster 2024-09-21T05:22:14.675842+0000 mgr.a (mgr.14388) 18518 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:22:16.572 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:16.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:16.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:16.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:16.573 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:17 smithi044 bash[22676]: audit 2024-09-21T05:22:16.136338+0000 mgr.a (mgr.14388) 18519 : audit [DBG] from='client.397974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:17 smithi044 bash[22676]: cluster 2024-09-21T05:22:16.678850+0000 mgr.a (mgr.14388) 18520 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:17 smithi179 bash[23186]: audit 2024-09-21T05:22:16.136338+0000 mgr.a (mgr.14388) 18519 : audit [DBG] from='client.397974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:17 smithi179 bash[23186]: cluster 2024-09-21T05:22:16.678850+0000 mgr.a (mgr.14388) 18520 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:17 smithi049 bash[23528]: audit 2024-09-21T05:22:16.136338+0000 mgr.a (mgr.14388) 18519 : audit [DBG] from='client.397974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:17 smithi049 bash[23528]: cluster 2024-09-21T05:22:16.678850+0000 mgr.a (mgr.14388) 18520 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:19 smithi179 bash[23186]: cluster 2024-09-21T05:22:18.679640+0000 mgr.a (mgr.14388) 18521 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:22:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:19 smithi179 bash[23186]: audit 2024-09-21T05:22:19.725267+0000 mon.a (mon.0) 14672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:19 smithi179 bash[23186]: audit 2024-09-21T05:22:19.732034+0000 mon.a (mon.0) 14673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:19 smithi179 bash[23186]: audit 2024-09-21T05:22:19.740279+0000 mon.a (mon.0) 14674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:19 smithi049 bash[23528]: cluster 2024-09-21T05:22:18.679640+0000 mgr.a (mgr.14388) 18521 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:22:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:19 smithi049 bash[23528]: audit 2024-09-21T05:22:19.725267+0000 mon.a (mon.0) 14672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:19 smithi049 bash[23528]: audit 2024-09-21T05:22:19.732034+0000 mon.a (mon.0) 14673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:19 smithi049 bash[23528]: audit 2024-09-21T05:22:19.740279+0000 mon.a (mon.0) 14674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:19 smithi044 bash[22676]: cluster 2024-09-21T05:22:18.679640+0000 mgr.a (mgr.14388) 18521 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:22:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:19 smithi044 bash[22676]: audit 2024-09-21T05:22:19.725267+0000 mon.a (mon.0) 14672 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:19 smithi044 bash[22676]: audit 2024-09-21T05:22:19.732034+0000 mon.a (mon.0) 14673 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:19 smithi044 bash[22676]: audit 2024-09-21T05:22:19.740279+0000 mon.a (mon.0) 14674 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:20 smithi044 bash[22676]: audit 2024-09-21T05:22:19.899603+0000 mon.a (mon.0) 14675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:20 smithi044 bash[22676]: audit 2024-09-21T05:22:19.907654+0000 mon.a (mon.0) 14676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:20 smithi044 bash[22676]: audit 2024-09-21T05:22:19.917891+0000 mon.a (mon.0) 14677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:20 smithi179 bash[23186]: audit 2024-09-21T05:22:19.899603+0000 mon.a (mon.0) 14675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:20 smithi179 bash[23186]: audit 2024-09-21T05:22:19.907654+0000 mon.a (mon.0) 14676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:20 smithi179 bash[23186]: audit 2024-09-21T05:22:19.917891+0000 mon.a (mon.0) 14677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:20 smithi049 bash[23528]: audit 2024-09-21T05:22:19.899603+0000 mon.a (mon.0) 14675 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:20 smithi049 bash[23528]: audit 2024-09-21T05:22:19.907654+0000 mon.a (mon.0) 14676 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:20 smithi049 bash[23528]: audit 2024-09-21T05:22:19.917891+0000 mon.a (mon.0) 14677 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:21.574 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:21.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:21.575 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:21 smithi044 bash[22676]: cluster 2024-09-21T05:22:20.681604+0000 mgr.a (mgr.14388) 18522 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:21 smithi179 bash[23186]: cluster 2024-09-21T05:22:20.681604+0000 mgr.a (mgr.14388) 18522 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:21 smithi049 bash[23528]: cluster 2024-09-21T05:22:20.681604+0000 mgr.a (mgr.14388) 18522 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:22.355 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:22.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:22.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:22.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:22.355 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:22 smithi044 bash[22676]: audit 2024-09-21T05:22:21.904500+0000 mgr.a (mgr.14388) 18523 : audit [DBG] from='client.398052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:22 smithi179 bash[23186]: audit 2024-09-21T05:22:21.904500+0000 mgr.a (mgr.14388) 18523 : audit [DBG] from='client.398052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:22 smithi049 bash[23528]: audit 2024-09-21T05:22:21.904500+0000 mgr.a (mgr.14388) 18523 : audit [DBG] from='client.398052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:23 smithi044 bash[22676]: cluster 2024-09-21T05:22:22.682611+0000 mgr.a (mgr.14388) 18524 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:23 smithi179 bash[23186]: cluster 2024-09-21T05:22:22.682611+0000 mgr.a (mgr.14388) 18524 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:23 smithi049 bash[23528]: cluster 2024-09-21T05:22:22.682611+0000 mgr.a (mgr.14388) 18524 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:25 smithi044 bash[22676]: cluster 2024-09-21T05:22:24.683454+0000 mgr.a (mgr.14388) 18525 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:25 smithi179 bash[23186]: cluster 2024-09-21T05:22:24.683454+0000 mgr.a (mgr.14388) 18525 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:25 smithi049 bash[23528]: cluster 2024-09-21T05:22:24.683454+0000 mgr.a (mgr.14388) 18525 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:27.356 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:27.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:27.357 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:28.130 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:28.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:28.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:28.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:28.131 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:27 smithi044 bash[22676]: cluster 2024-09-21T05:22:26.685757+0000 mgr.a (mgr.14388) 18526 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:27 smithi179 bash[23186]: cluster 2024-09-21T05:22:26.685757+0000 mgr.a (mgr.14388) 18526 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:27 smithi049 bash[23528]: cluster 2024-09-21T05:22:26.685757+0000 mgr.a (mgr.14388) 18526 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:29.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:28 smithi179 bash[23186]: audit 2024-09-21T05:22:27.689813+0000 mgr.a (mgr.14388) 18527 : audit [DBG] from='client.398130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:28 smithi044 bash[22676]: audit 2024-09-21T05:22:27.689813+0000 mgr.a (mgr.14388) 18527 : audit [DBG] from='client.398130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:28 smithi049 bash[23528]: audit 2024-09-21T05:22:27.689813+0000 mgr.a (mgr.14388) 18527 : audit [DBG] from='client.398130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:29 smithi044 bash[22676]: cluster 2024-09-21T05:22:28.686902+0000 mgr.a (mgr.14388) 18528 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:29 smithi179 bash[23186]: cluster 2024-09-21T05:22:28.686902+0000 mgr.a (mgr.14388) 18528 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:29 smithi049 bash[23528]: cluster 2024-09-21T05:22:28.686902+0000 mgr.a (mgr.14388) 18528 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:31 smithi049 bash[23528]: audit 2024-09-21T05:22:30.043361+0000 mon.a (mon.0) 14678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:31 smithi049 bash[23528]: audit 2024-09-21T05:22:30.052189+0000 mon.a (mon.0) 14679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:31 smithi049 bash[23528]: audit 2024-09-21T05:22:30.062709+0000 mon.a (mon.0) 14680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:31 smithi049 bash[23528]: cluster 2024-09-21T05:22:30.689238+0000 mgr.a (mgr.14388) 18529 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:31.397 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:31 smithi179 bash[23186]: audit 2024-09-21T05:22:30.043361+0000 mon.a (mon.0) 14678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.397 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:31 smithi179 bash[23186]: audit 2024-09-21T05:22:30.052189+0000 mon.a (mon.0) 14679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.397 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:31 smithi179 bash[23186]: audit 2024-09-21T05:22:30.062709+0000 mon.a (mon.0) 14680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.397 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:31 smithi179 bash[23186]: cluster 2024-09-21T05:22:30.689238+0000 mgr.a (mgr.14388) 18529 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:31 smithi044 bash[22676]: audit 2024-09-21T05:22:30.043361+0000 mon.a (mon.0) 14678 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:31 smithi044 bash[22676]: audit 2024-09-21T05:22:30.052189+0000 mon.a (mon.0) 14679 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:31 smithi044 bash[22676]: audit 2024-09-21T05:22:30.062709+0000 mon.a (mon.0) 14680 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:31 smithi044 bash[22676]: cluster 2024-09-21T05:22:30.689238+0000 mgr.a (mgr.14388) 18529 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:33.132 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:33.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:33.133 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:33.910 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:33.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:33.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:33.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:33.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:33 smithi044 bash[22676]: cluster 2024-09-21T05:22:32.689818+0000 mgr.a (mgr.14388) 18530 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:33 smithi179 bash[23186]: cluster 2024-09-21T05:22:32.689818+0000 mgr.a (mgr.14388) 18530 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:33 smithi049 bash[23528]: cluster 2024-09-21T05:22:32.689818+0000 mgr.a (mgr.14388) 18530 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:34 smithi179 bash[23186]: audit 2024-09-21T05:22:33.461637+0000 mgr.a (mgr.14388) 18531 : audit [DBG] from='client.398208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:35.046 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:34 smithi044 bash[22676]: audit 2024-09-21T05:22:33.461637+0000 mgr.a (mgr.14388) 18531 : audit [DBG] from='client.398208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:34 smithi049 bash[23528]: audit 2024-09-21T05:22:33.461637+0000 mgr.a (mgr.14388) 18531 : audit [DBG] from='client.398208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:35 smithi049 bash[23528]: cluster 2024-09-21T05:22:34.690556+0000 mgr.a (mgr.14388) 18532 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:35 smithi044 bash[22676]: cluster 2024-09-21T05:22:34.690556+0000 mgr.a (mgr.14388) 18532 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:35 smithi179 bash[23186]: cluster 2024-09-21T05:22:34.690556+0000 mgr.a (mgr.14388) 18532 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:37 smithi049 bash[23528]: cluster 2024-09-21T05:22:36.692810+0000 mgr.a (mgr.14388) 18533 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:37 smithi044 bash[22676]: cluster 2024-09-21T05:22:36.692810+0000 mgr.a (mgr.14388) 18533 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:37 smithi179 bash[23186]: cluster 2024-09-21T05:22:36.692810+0000 mgr.a (mgr.14388) 18533 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:38.912 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:38.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:38.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:39.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:39.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:39.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:39.667 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:40.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:39 smithi049 bash[23528]: cluster 2024-09-21T05:22:38.693629+0000 mgr.a (mgr.14388) 18534 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:40.148 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:39 smithi044 bash[22676]: cluster 2024-09-21T05:22:38.693629+0000 mgr.a (mgr.14388) 18534 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:39 smithi179 bash[23186]: cluster 2024-09-21T05:22:38.693629+0000 mgr.a (mgr.14388) 18534 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:40 smithi044 bash[22676]: audit 2024-09-21T05:22:39.239759+0000 mgr.a (mgr.14388) 18535 : audit [DBG] from='client.398283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:40 smithi044 bash[22676]: audit 2024-09-21T05:22:39.952281+0000 mon.a (mon.0) 14681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:40 smithi044 bash[22676]: audit 2024-09-21T05:22:39.960348+0000 mon.a (mon.0) 14682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:40 smithi044 bash[22676]: audit 2024-09-21T05:22:39.968622+0000 mon.a (mon.0) 14683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:40 smithi044 bash[22676]: audit 2024-09-21T05:22:40.122128+0000 mon.a (mon.0) 14684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:40 smithi044 bash[22676]: audit 2024-09-21T05:22:40.132263+0000 mon.a (mon.0) 14685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:40 smithi044 bash[22676]: audit 2024-09-21T05:22:40.144026+0000 mon.a (mon.0) 14686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:40 smithi179 bash[23186]: audit 2024-09-21T05:22:39.239759+0000 mgr.a (mgr.14388) 18535 : audit [DBG] from='client.398283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:40 smithi179 bash[23186]: audit 2024-09-21T05:22:39.952281+0000 mon.a (mon.0) 14681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:40 smithi179 bash[23186]: audit 2024-09-21T05:22:39.960348+0000 mon.a (mon.0) 14682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:40 smithi179 bash[23186]: audit 2024-09-21T05:22:39.968622+0000 mon.a (mon.0) 14683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:40 smithi179 bash[23186]: audit 2024-09-21T05:22:40.122128+0000 mon.a (mon.0) 14684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:40 smithi179 bash[23186]: audit 2024-09-21T05:22:40.132263+0000 mon.a (mon.0) 14685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:40 smithi179 bash[23186]: audit 2024-09-21T05:22:40.144026+0000 mon.a (mon.0) 14686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:40 smithi049 bash[23528]: audit 2024-09-21T05:22:39.239759+0000 mgr.a (mgr.14388) 18535 : audit [DBG] from='client.398283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:40 smithi049 bash[23528]: audit 2024-09-21T05:22:39.952281+0000 mon.a (mon.0) 14681 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:40 smithi049 bash[23528]: audit 2024-09-21T05:22:39.960348+0000 mon.a (mon.0) 14682 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:40 smithi049 bash[23528]: audit 2024-09-21T05:22:39.968622+0000 mon.a (mon.0) 14683 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:40 smithi049 bash[23528]: audit 2024-09-21T05:22:40.122128+0000 mon.a (mon.0) 14684 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:40 smithi049 bash[23528]: audit 2024-09-21T05:22:40.132263+0000 mon.a (mon.0) 14685 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:40 smithi049 bash[23528]: audit 2024-09-21T05:22:40.144026+0000 mon.a (mon.0) 14686 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:41 smithi044 bash[22676]: cluster 2024-09-21T05:22:40.696157+0000 mgr.a (mgr.14388) 18536 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:41 smithi179 bash[23186]: cluster 2024-09-21T05:22:40.696157+0000 mgr.a (mgr.14388) 18536 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:41 smithi049 bash[23528]: cluster 2024-09-21T05:22:40.696157+0000 mgr.a (mgr.14388) 18536 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:22:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:43 smithi044 bash[22676]: cluster 2024-09-21T05:22:42.696963+0000 mgr.a (mgr.14388) 18537 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:43 smithi179 bash[23186]: cluster 2024-09-21T05:22:42.696963+0000 mgr.a (mgr.14388) 18537 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:43 smithi049 bash[23528]: cluster 2024-09-21T05:22:42.696963+0000 mgr.a (mgr.14388) 18537 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:44.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:44.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:44.669 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:45.467 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:45.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:45 smithi049 bash[23528]: cluster 2024-09-21T05:22:44.697661+0000 mgr.a (mgr.14388) 18538 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:45 smithi044 bash[22676]: cluster 2024-09-21T05:22:44.697661+0000 mgr.a (mgr.14388) 18538 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:45 smithi179 bash[23186]: cluster 2024-09-21T05:22:44.697661+0000 mgr.a (mgr.14388) 18538 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:46 smithi044 bash[22676]: audit 2024-09-21T05:22:45.008867+0000 mgr.a (mgr.14388) 18539 : audit [DBG] from='client.398358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:46 smithi179 bash[23186]: audit 2024-09-21T05:22:45.008867+0000 mgr.a (mgr.14388) 18539 : audit [DBG] from='client.398358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:46 smithi049 bash[23528]: audit 2024-09-21T05:22:45.008867+0000 mgr.a (mgr.14388) 18539 : audit [DBG] from='client.398358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:47 smithi044 bash[22676]: cluster 2024-09-21T05:22:46.700670+0000 mgr.a (mgr.14388) 18540 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:47 smithi179 bash[23186]: cluster 2024-09-21T05:22:46.700670+0000 mgr.a (mgr.14388) 18540 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:47 smithi049 bash[23528]: cluster 2024-09-21T05:22:46.700670+0000 mgr.a (mgr.14388) 18540 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:22:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:49 smithi044 bash[22676]: cluster 2024-09-21T05:22:48.701521+0000 mgr.a (mgr.14388) 18541 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:22:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:49 smithi044 bash[22676]: audit 2024-09-21T05:22:49.827123+0000 mon.a (mon.0) 14687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:22:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:49 smithi044 bash[22676]: audit 2024-09-21T05:22:49.838183+0000 mon.a (mon.0) 14688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:49 smithi044 bash[22676]: audit 2024-09-21T05:22:49.840252+0000 mon.a (mon.0) 14689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:49 smithi044 bash[22676]: audit 2024-09-21T05:22:49.851838+0000 mon.a (mon.0) 14690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:49 smithi044 bash[22676]: audit 2024-09-21T05:22:49.858957+0000 mon.a (mon.0) 14691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:22:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:49 smithi179 bash[23186]: cluster 2024-09-21T05:22:48.701521+0000 mgr.a (mgr.14388) 18541 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:22:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:49 smithi179 bash[23186]: audit 2024-09-21T05:22:49.827123+0000 mon.a (mon.0) 14687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:22:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:49 smithi179 bash[23186]: audit 2024-09-21T05:22:49.838183+0000 mon.a (mon.0) 14688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:49 smithi179 bash[23186]: audit 2024-09-21T05:22:49.840252+0000 mon.a (mon.0) 14689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:49 smithi179 bash[23186]: audit 2024-09-21T05:22:49.851838+0000 mon.a (mon.0) 14690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:50.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:49 smithi179 bash[23186]: audit 2024-09-21T05:22:49.858957+0000 mon.a (mon.0) 14691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:22:50.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:49 smithi049 bash[23528]: cluster 2024-09-21T05:22:48.701521+0000 mgr.a (mgr.14388) 18541 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:22:50.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:49 smithi049 bash[23528]: audit 2024-09-21T05:22:49.827123+0000 mon.a (mon.0) 14687 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:22:50.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:49 smithi049 bash[23528]: audit 2024-09-21T05:22:49.838183+0000 mon.a (mon.0) 14688 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:50.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:49 smithi049 bash[23528]: audit 2024-09-21T05:22:49.840252+0000 mon.a (mon.0) 14689 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:50.257 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:49 smithi049 bash[23528]: audit 2024-09-21T05:22:49.851838+0000 mon.a (mon.0) 14690 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:50.258 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:49 smithi049 bash[23528]: audit 2024-09-21T05:22:49.858957+0000 mon.a (mon.0) 14691 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:22:50.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:50.980 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:22:50 smithi044 bash[22930]: debug 2024-09-21T05:22:50.640+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:22:50.980 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:22:50 smithi044 bash[22930]: debug 2024-09-21T05:22:50.640+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:22:51.215 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:51.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:51.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:51.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:51.215 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:50 smithi044 bash[22676]: audit 2024-09-21T05:22:49.861545+0000 mgr.a (mgr.14388) 18542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:22:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:50 smithi044 bash[22676]: audit 2024-09-21T05:22:50.242532+0000 mon.a (mon.0) 14692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:50 smithi044 bash[22676]: audit 2024-09-21T05:22:50.248414+0000 mon.a (mon.0) 14693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:50 smithi044 bash[22676]: audit 2024-09-21T05:22:50.253668+0000 mon.a (mon.0) 14694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:50 smithi179 bash[23186]: audit 2024-09-21T05:22:49.861545+0000 mgr.a (mgr.14388) 18542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:22:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:50 smithi179 bash[23186]: audit 2024-09-21T05:22:50.242532+0000 mon.a (mon.0) 14692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:50 smithi179 bash[23186]: audit 2024-09-21T05:22:50.248414+0000 mon.a (mon.0) 14693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:50 smithi179 bash[23186]: audit 2024-09-21T05:22:50.253668+0000 mon.a (mon.0) 14694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:50 smithi049 bash[23528]: audit 2024-09-21T05:22:49.861545+0000 mgr.a (mgr.14388) 18542 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:22:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:50 smithi049 bash[23528]: audit 2024-09-21T05:22:50.242532+0000 mon.a (mon.0) 14692 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:50 smithi049 bash[23528]: audit 2024-09-21T05:22:50.248414+0000 mon.a (mon.0) 14693 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:50 smithi049 bash[23528]: audit 2024-09-21T05:22:50.253668+0000 mon.a (mon.0) 14694 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:22:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:51 smithi044 bash[22676]: audit 2024-09-21T05:22:50.643015+0000 mgr.a (mgr.14388) 18543 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:22:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:51 smithi044 bash[22676]: cephadm 2024-09-21T05:22:50.644515+0000 mgr.a (mgr.14388) 18544 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:22:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:51 smithi044 bash[22676]: cluster 2024-09-21T05:22:50.703732+0000 mgr.a (mgr.14388) 18545 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:22:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:51 smithi044 bash[22676]: audit 2024-09-21T05:22:50.798248+0000 mgr.a (mgr.14388) 18546 : audit [DBG] from='client.398541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:51 smithi179 bash[23186]: audit 2024-09-21T05:22:50.643015+0000 mgr.a (mgr.14388) 18543 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:22:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:51 smithi179 bash[23186]: cephadm 2024-09-21T05:22:50.644515+0000 mgr.a (mgr.14388) 18544 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:22:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:51 smithi179 bash[23186]: cluster 2024-09-21T05:22:50.703732+0000 mgr.a (mgr.14388) 18545 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:22:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:51 smithi179 bash[23186]: audit 2024-09-21T05:22:50.798248+0000 mgr.a (mgr.14388) 18546 : audit [DBG] from='client.398541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:51 smithi049 bash[23528]: audit 2024-09-21T05:22:50.643015+0000 mgr.a (mgr.14388) 18543 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:22:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:51 smithi049 bash[23528]: cephadm 2024-09-21T05:22:50.644515+0000 mgr.a (mgr.14388) 18544 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:22:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:51 smithi049 bash[23528]: cluster 2024-09-21T05:22:50.703732+0000 mgr.a (mgr.14388) 18545 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:22:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:51 smithi049 bash[23528]: audit 2024-09-21T05:22:50.798248+0000 mgr.a (mgr.14388) 18546 : audit [DBG] from='client.398541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:53 smithi044 bash[22676]: cluster 2024-09-21T05:22:52.704647+0000 mgr.a (mgr.14388) 18547 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:22:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:53 smithi179 bash[23186]: cluster 2024-09-21T05:22:52.704647+0000 mgr.a (mgr.14388) 18547 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:22:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:53 smithi049 bash[23528]: cluster 2024-09-21T05:22:52.704647+0000 mgr.a (mgr.14388) 18547 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:22:56.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:22:56.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:22:56.217 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:22:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:55 smithi179 bash[23186]: cluster 2024-09-21T05:22:54.705370+0000 mgr.a (mgr.14388) 18548 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:22:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:55 smithi049 bash[23528]: cluster 2024-09-21T05:22:54.705370+0000 mgr.a (mgr.14388) 18548 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:22:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:55 smithi044 bash[22676]: cluster 2024-09-21T05:22:54.705370+0000 mgr.a (mgr.14388) 18548 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:22:57.011 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:22:57.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:22:57.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:22:57.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:22:57.011 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:22:58.160 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:58 smithi049 bash[23528]: audit 2024-09-21T05:22:56.553119+0000 mgr.a (mgr.14388) 18549 : audit [DBG] from='client.398619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:58.161 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:22:58 smithi049 bash[23528]: cluster 2024-09-21T05:22:56.707123+0000 mgr.a (mgr.14388) 18550 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:22:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:58 smithi179 bash[23186]: audit 2024-09-21T05:22:56.553119+0000 mgr.a (mgr.14388) 18549 : audit [DBG] from='client.398619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:22:58 smithi179 bash[23186]: cluster 2024-09-21T05:22:56.707123+0000 mgr.a (mgr.14388) 18550 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:22:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:58 smithi044 bash[22676]: audit 2024-09-21T05:22:56.553119+0000 mgr.a (mgr.14388) 18549 : audit [DBG] from='client.398619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:22:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:22:58 smithi044 bash[22676]: cluster 2024-09-21T05:22:56.707123+0000 mgr.a (mgr.14388) 18550 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:00 smithi049 bash[23528]: cluster 2024-09-21T05:22:58.708048+0000 mgr.a (mgr.14388) 18551 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:00.346 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:00 smithi044 bash[22676]: cluster 2024-09-21T05:22:58.708048+0000 mgr.a (mgr.14388) 18551 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:00 smithi179 bash[23186]: cluster 2024-09-21T05:22:58.708048+0000 mgr.a (mgr.14388) 18551 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:01 smithi044 bash[22676]: audit 2024-09-21T05:23:00.180549+0000 mon.a (mon.0) 14695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:01 smithi044 bash[22676]: audit 2024-09-21T05:23:00.186824+0000 mon.a (mon.0) 14696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:01 smithi044 bash[22676]: audit 2024-09-21T05:23:00.194998+0000 mon.a (mon.0) 14697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:01 smithi044 bash[22676]: audit 2024-09-21T05:23:00.324267+0000 mon.a (mon.0) 14698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:01 smithi044 bash[22676]: audit 2024-09-21T05:23:00.333541+0000 mon.a (mon.0) 14699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:01 smithi044 bash[22676]: audit 2024-09-21T05:23:00.342587+0000 mon.a (mon.0) 14700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:01 smithi044 bash[22676]: cluster 2024-09-21T05:23:00.710363+0000 mgr.a (mgr.14388) 18552 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:01 smithi179 bash[23186]: audit 2024-09-21T05:23:00.180549+0000 mon.a (mon.0) 14695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:01 smithi179 bash[23186]: audit 2024-09-21T05:23:00.186824+0000 mon.a (mon.0) 14696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:01 smithi179 bash[23186]: audit 2024-09-21T05:23:00.194998+0000 mon.a (mon.0) 14697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:01 smithi179 bash[23186]: audit 2024-09-21T05:23:00.324267+0000 mon.a (mon.0) 14698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:01 smithi179 bash[23186]: audit 2024-09-21T05:23:00.333541+0000 mon.a (mon.0) 14699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:01 smithi179 bash[23186]: audit 2024-09-21T05:23:00.342587+0000 mon.a (mon.0) 14700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:01 smithi179 bash[23186]: cluster 2024-09-21T05:23:00.710363+0000 mgr.a (mgr.14388) 18552 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:01 smithi049 bash[23528]: audit 2024-09-21T05:23:00.180549+0000 mon.a (mon.0) 14695 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:01 smithi049 bash[23528]: audit 2024-09-21T05:23:00.186824+0000 mon.a (mon.0) 14696 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:01 smithi049 bash[23528]: audit 2024-09-21T05:23:00.194998+0000 mon.a (mon.0) 14697 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:01 smithi049 bash[23528]: audit 2024-09-21T05:23:00.324267+0000 mon.a (mon.0) 14698 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:01 smithi049 bash[23528]: audit 2024-09-21T05:23:00.333541+0000 mon.a (mon.0) 14699 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:01 smithi049 bash[23528]: audit 2024-09-21T05:23:00.342587+0000 mon.a (mon.0) 14700 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:01.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:01 smithi049 bash[23528]: cluster 2024-09-21T05:23:00.710363+0000 mgr.a (mgr.14388) 18552 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:02.012 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:02.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:02.013 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:02.802 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:02.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:02.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:02.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:02.803 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:03 smithi049 bash[23528]: audit 2024-09-21T05:23:02.346116+0000 mgr.a (mgr.14388) 18553 : audit [DBG] from='client.398691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:03 smithi049 bash[23528]: cluster 2024-09-21T05:23:02.710942+0000 mgr.a (mgr.14388) 18554 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:23:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:03 smithi044 bash[22676]: audit 2024-09-21T05:23:02.346116+0000 mgr.a (mgr.14388) 18553 : audit [DBG] from='client.398691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:03 smithi044 bash[22676]: cluster 2024-09-21T05:23:02.710942+0000 mgr.a (mgr.14388) 18554 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:23:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:03 smithi179 bash[23186]: audit 2024-09-21T05:23:02.346116+0000 mgr.a (mgr.14388) 18553 : audit [DBG] from='client.398691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:03 smithi179 bash[23186]: cluster 2024-09-21T05:23:02.710942+0000 mgr.a (mgr.14388) 18554 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:23:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:05 smithi049 bash[23528]: cluster 2024-09-21T05:23:04.711727+0000 mgr.a (mgr.14388) 18555 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:23:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:05 smithi044 bash[22676]: cluster 2024-09-21T05:23:04.711727+0000 mgr.a (mgr.14388) 18555 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:23:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:05 smithi179 bash[23186]: cluster 2024-09-21T05:23:04.711727+0000 mgr.a (mgr.14388) 18555 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:23:07.804 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:07.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:08.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:07 smithi049 bash[23528]: cluster 2024-09-21T05:23:06.713994+0000 mgr.a (mgr.14388) 18556 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:07 smithi044 bash[22676]: cluster 2024-09-21T05:23:06.713994+0000 mgr.a (mgr.14388) 18556 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:07 smithi179 bash[23186]: cluster 2024-09-21T05:23:06.713994+0000 mgr.a (mgr.14388) 18556 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:08.550 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:09 smithi049 bash[23528]: audit 2024-09-21T05:23:08.128237+0000 mgr.a (mgr.14388) 18557 : audit [DBG] from='client.398769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:10.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:09 smithi049 bash[23528]: cluster 2024-09-21T05:23:08.714965+0000 mgr.a (mgr.14388) 18558 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:09 smithi044 bash[22676]: audit 2024-09-21T05:23:08.128237+0000 mgr.a (mgr.14388) 18557 : audit [DBG] from='client.398769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:09 smithi044 bash[22676]: cluster 2024-09-21T05:23:08.714965+0000 mgr.a (mgr.14388) 18558 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:09 smithi179 bash[23186]: audit 2024-09-21T05:23:08.128237+0000 mgr.a (mgr.14388) 18557 : audit [DBG] from='client.398769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:09 smithi179 bash[23186]: cluster 2024-09-21T05:23:08.714965+0000 mgr.a (mgr.14388) 18558 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:11 smithi179 bash[23186]: audit 2024-09-21T05:23:10.466916+0000 mon.a (mon.0) 14701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:11 smithi179 bash[23186]: audit 2024-09-21T05:23:10.475981+0000 mon.a (mon.0) 14702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:11 smithi179 bash[23186]: audit 2024-09-21T05:23:10.486919+0000 mon.a (mon.0) 14703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:11 smithi179 bash[23186]: cluster 2024-09-21T05:23:10.717301+0000 mgr.a (mgr.14388) 18559 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:11 smithi044 bash[22676]: audit 2024-09-21T05:23:10.466916+0000 mon.a (mon.0) 14701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:11 smithi044 bash[22676]: audit 2024-09-21T05:23:10.475981+0000 mon.a (mon.0) 14702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:11 smithi044 bash[22676]: audit 2024-09-21T05:23:10.486919+0000 mon.a (mon.0) 14703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:11 smithi044 bash[22676]: cluster 2024-09-21T05:23:10.717301+0000 mgr.a (mgr.14388) 18559 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:11 smithi049 bash[23528]: audit 2024-09-21T05:23:10.466916+0000 mon.a (mon.0) 14701 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:11 smithi049 bash[23528]: audit 2024-09-21T05:23:10.475981+0000 mon.a (mon.0) 14702 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:11 smithi049 bash[23528]: audit 2024-09-21T05:23:10.486919+0000 mon.a (mon.0) 14703 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:11.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:11 smithi049 bash[23528]: cluster 2024-09-21T05:23:10.717301+0000 mgr.a (mgr.14388) 18559 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:13.551 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:13.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:13.552 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:14.028 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:13 smithi044 bash[22676]: cluster 2024-09-21T05:23:12.718181+0000 mgr.a (mgr.14388) 18560 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:13 smithi049 bash[23528]: cluster 2024-09-21T05:23:12.718181+0000 mgr.a (mgr.14388) 18560 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:13 smithi179 bash[23186]: cluster 2024-09-21T05:23:12.718181+0000 mgr.a (mgr.14388) 18560 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:14.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:14.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:14.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:14.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:15.039 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:14 smithi044 bash[22676]: audit 2024-09-21T05:23:13.885114+0000 mgr.a (mgr.14388) 18561 : audit [DBG] from='client.398847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:14 smithi049 bash[23528]: audit 2024-09-21T05:23:13.885114+0000 mgr.a (mgr.14388) 18561 : audit [DBG] from='client.398847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:14 smithi179 bash[23186]: audit 2024-09-21T05:23:13.885114+0000 mgr.a (mgr.14388) 18561 : audit [DBG] from='client.398847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:15 smithi049 bash[23528]: cluster 2024-09-21T05:23:14.719247+0000 mgr.a (mgr.14388) 18562 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:15 smithi044 bash[22676]: cluster 2024-09-21T05:23:14.719247+0000 mgr.a (mgr.14388) 18562 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:15 smithi179 bash[23186]: cluster 2024-09-21T05:23:14.719247+0000 mgr.a (mgr.14388) 18562 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:17 smithi049 bash[23528]: cluster 2024-09-21T05:23:16.721688+0000 mgr.a (mgr.14388) 18563 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:17 smithi044 bash[22676]: cluster 2024-09-21T05:23:16.721688+0000 mgr.a (mgr.14388) 18563 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:17 smithi179 bash[23186]: cluster 2024-09-21T05:23:16.721688+0000 mgr.a (mgr.14388) 18563 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:19.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:19.331 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:19 smithi049 bash[23528]: cluster 2024-09-21T05:23:18.722652+0000 mgr.a (mgr.14388) 18564 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:20.110 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:20.110 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:20.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:20.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:20.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:19 smithi044 bash[22676]: cluster 2024-09-21T05:23:18.722652+0000 mgr.a (mgr.14388) 18564 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:19 smithi179 bash[23186]: cluster 2024-09-21T05:23:18.722652+0000 mgr.a (mgr.14388) 18564 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:20 smithi049 bash[23528]: audit 2024-09-21T05:23:19.666015+0000 mgr.a (mgr.14388) 18565 : audit [DBG] from='client.398925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:20 smithi049 bash[23528]: audit 2024-09-21T05:23:20.392217+0000 mon.a (mon.0) 14704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:20 smithi049 bash[23528]: audit 2024-09-21T05:23:20.398768+0000 mon.a (mon.0) 14705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:20 smithi049 bash[23528]: audit 2024-09-21T05:23:20.405209+0000 mon.a (mon.0) 14706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:20 smithi049 bash[23528]: audit 2024-09-21T05:23:20.512090+0000 mon.a (mon.0) 14707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:20 smithi049 bash[23528]: audit 2024-09-21T05:23:20.518128+0000 mon.a (mon.0) 14708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:20 smithi049 bash[23528]: audit 2024-09-21T05:23:20.527362+0000 mon.a (mon.0) 14709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:20 smithi044 bash[22676]: audit 2024-09-21T05:23:19.666015+0000 mgr.a (mgr.14388) 18565 : audit [DBG] from='client.398925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:20 smithi044 bash[22676]: audit 2024-09-21T05:23:20.392217+0000 mon.a (mon.0) 14704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:20 smithi044 bash[22676]: audit 2024-09-21T05:23:20.398768+0000 mon.a (mon.0) 14705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:20 smithi044 bash[22676]: audit 2024-09-21T05:23:20.405209+0000 mon.a (mon.0) 14706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:20 smithi044 bash[22676]: audit 2024-09-21T05:23:20.512090+0000 mon.a (mon.0) 14707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:20 smithi044 bash[22676]: audit 2024-09-21T05:23:20.518128+0000 mon.a (mon.0) 14708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:20 smithi044 bash[22676]: audit 2024-09-21T05:23:20.527362+0000 mon.a (mon.0) 14709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:20 smithi179 bash[23186]: audit 2024-09-21T05:23:19.666015+0000 mgr.a (mgr.14388) 18565 : audit [DBG] from='client.398925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:20 smithi179 bash[23186]: audit 2024-09-21T05:23:20.392217+0000 mon.a (mon.0) 14704 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:20 smithi179 bash[23186]: audit 2024-09-21T05:23:20.398768+0000 mon.a (mon.0) 14705 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:20 smithi179 bash[23186]: audit 2024-09-21T05:23:20.405209+0000 mon.a (mon.0) 14706 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:20 smithi179 bash[23186]: audit 2024-09-21T05:23:20.512090+0000 mon.a (mon.0) 14707 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:20 smithi179 bash[23186]: audit 2024-09-21T05:23:20.518128+0000 mon.a (mon.0) 14708 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:20 smithi179 bash[23186]: audit 2024-09-21T05:23:20.527362+0000 mon.a (mon.0) 14709 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:22.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:21 smithi049 bash[23528]: cluster 2024-09-21T05:23:20.725059+0000 mgr.a (mgr.14388) 18566 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:23:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:21 smithi044 bash[22676]: cluster 2024-09-21T05:23:20.725059+0000 mgr.a (mgr.14388) 18566 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:23:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:21 smithi179 bash[23186]: cluster 2024-09-21T05:23:20.725059+0000 mgr.a (mgr.14388) 18566 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:23:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:23 smithi044 bash[22676]: cluster 2024-09-21T05:23:22.725844+0000 mgr.a (mgr.14388) 18567 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:23:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:23 smithi179 bash[23186]: cluster 2024-09-21T05:23:22.725844+0000 mgr.a (mgr.14388) 18567 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:23:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:23 smithi049 bash[23528]: cluster 2024-09-21T05:23:22.725844+0000 mgr.a (mgr.14388) 18567 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:23:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:25.894 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:25 smithi044 bash[22676]: cluster 2024-09-21T05:23:24.726626+0000 mgr.a (mgr.14388) 18568 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:23:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:25 smithi179 bash[23186]: cluster 2024-09-21T05:23:24.726626+0000 mgr.a (mgr.14388) 18568 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:23:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:25 smithi049 bash[23528]: cluster 2024-09-21T05:23:24.726626+0000 mgr.a (mgr.14388) 18568 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:23:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:26 smithi044 bash[22676]: audit 2024-09-21T05:23:25.446560+0000 mgr.a (mgr.14388) 18569 : audit [DBG] from='client.399003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:26 smithi179 bash[23186]: audit 2024-09-21T05:23:25.446560+0000 mgr.a (mgr.14388) 18569 : audit [DBG] from='client.399003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:26 smithi049 bash[23528]: audit 2024-09-21T05:23:25.446560+0000 mgr.a (mgr.14388) 18569 : audit [DBG] from='client.399003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:27 smithi044 bash[22676]: cluster 2024-09-21T05:23:26.729750+0000 mgr.a (mgr.14388) 18570 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:27 smithi179 bash[23186]: cluster 2024-09-21T05:23:26.729750+0000 mgr.a (mgr.14388) 18570 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:27 smithi049 bash[23528]: cluster 2024-09-21T05:23:26.729750+0000 mgr.a (mgr.14388) 18570 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:29.939 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:29 smithi179 bash[23186]: cluster 2024-09-21T05:23:28.730740+0000 mgr.a (mgr.14388) 18571 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:23:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:29 smithi044 bash[22676]: cluster 2024-09-21T05:23:28.730740+0000 mgr.a (mgr.14388) 18571 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:23:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:29 smithi049 bash[23528]: cluster 2024-09-21T05:23:28.730740+0000 mgr.a (mgr.14388) 18571 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:23:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:30.896 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:31.658 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:31.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:31.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:31.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:31.659 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:31 smithi044 bash[22676]: audit 2024-09-21T05:23:30.700134+0000 mon.a (mon.0) 14710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:31 smithi044 bash[22676]: audit 2024-09-21T05:23:30.709312+0000 mon.a (mon.0) 14711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:31 smithi044 bash[22676]: audit 2024-09-21T05:23:30.720242+0000 mon.a (mon.0) 14712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:31 smithi044 bash[22676]: cluster 2024-09-21T05:23:30.732819+0000 mgr.a (mgr.14388) 18572 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:31.991 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:31 smithi179 bash[23186]: audit 2024-09-21T05:23:30.700134+0000 mon.a (mon.0) 14710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:31.991 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:31 smithi179 bash[23186]: audit 2024-09-21T05:23:30.709312+0000 mon.a (mon.0) 14711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:31.991 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:31 smithi179 bash[23186]: audit 2024-09-21T05:23:30.720242+0000 mon.a (mon.0) 14712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:31.991 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:31 smithi179 bash[23186]: cluster 2024-09-21T05:23:30.732819+0000 mgr.a (mgr.14388) 18572 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:31 smithi049 bash[23528]: audit 2024-09-21T05:23:30.700134+0000 mon.a (mon.0) 14710 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:31 smithi049 bash[23528]: audit 2024-09-21T05:23:30.709312+0000 mon.a (mon.0) 14711 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:31 smithi049 bash[23528]: audit 2024-09-21T05:23:30.720242+0000 mon.a (mon.0) 14712 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:31 smithi049 bash[23528]: cluster 2024-09-21T05:23:30.732819+0000 mgr.a (mgr.14388) 18572 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:32 smithi044 bash[22676]: audit 2024-09-21T05:23:31.225734+0000 mgr.a (mgr.14388) 18573 : audit [DBG] from='client.399081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:32 smithi179 bash[23186]: audit 2024-09-21T05:23:31.225734+0000 mgr.a (mgr.14388) 18573 : audit [DBG] from='client.399081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:32 smithi049 bash[23528]: audit 2024-09-21T05:23:31.225734+0000 mgr.a (mgr.14388) 18573 : audit [DBG] from='client.399081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:33.864 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:33 smithi044 bash[22676]: cluster 2024-09-21T05:23:32.733773+0000 mgr.a (mgr.14388) 18574 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:23:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:33 smithi179 bash[23186]: cluster 2024-09-21T05:23:32.733773+0000 mgr.a (mgr.14388) 18574 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:23:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:33 smithi049 bash[23528]: cluster 2024-09-21T05:23:32.733773+0000 mgr.a (mgr.14388) 18574 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:23:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:35 smithi049 bash[23528]: cluster 2024-09-21T05:23:34.734595+0000 mgr.a (mgr.14388) 18575 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:23:36.141 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:35 smithi044 bash[22676]: cluster 2024-09-21T05:23:34.734595+0000 mgr.a (mgr.14388) 18575 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:23:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:35 smithi179 bash[23186]: cluster 2024-09-21T05:23:34.734595+0000 mgr.a (mgr.14388) 18575 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:23:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:37.444 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:37 smithi049 bash[23528]: cluster 2024-09-21T05:23:36.736787+0000 mgr.a (mgr.14388) 18576 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:23:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:37 smithi049 bash[23528]: audit 2024-09-21T05:23:36.995504+0000 mgr.a (mgr.14388) 18577 : audit [DBG] from='client.399159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:37 smithi044 bash[22676]: cluster 2024-09-21T05:23:36.736787+0000 mgr.a (mgr.14388) 18576 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:23:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:37 smithi044 bash[22676]: audit 2024-09-21T05:23:36.995504+0000 mgr.a (mgr.14388) 18577 : audit [DBG] from='client.399159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:37 smithi179 bash[23186]: cluster 2024-09-21T05:23:36.736787+0000 mgr.a (mgr.14388) 18576 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:23:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:37 smithi179 bash[23186]: audit 2024-09-21T05:23:36.995504+0000 mgr.a (mgr.14388) 18577 : audit [DBG] from='client.399159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:39 smithi049 bash[23528]: cluster 2024-09-21T05:23:38.737833+0000 mgr.a (mgr.14388) 18578 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:39 smithi044 bash[22676]: cluster 2024-09-21T05:23:38.737833+0000 mgr.a (mgr.14388) 18578 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:39 smithi179 bash[23186]: cluster 2024-09-21T05:23:38.737833+0000 mgr.a (mgr.14388) 18578 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:41 smithi044 bash[22676]: audit 2024-09-21T05:23:40.600436+0000 mon.a (mon.0) 14713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:41 smithi044 bash[22676]: audit 2024-09-21T05:23:40.605627+0000 mon.a (mon.0) 14714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:41 smithi044 bash[22676]: audit 2024-09-21T05:23:40.611493+0000 mon.a (mon.0) 14715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:41.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:41 smithi044 bash[22676]: cluster 2024-09-21T05:23:40.740213+0000 mgr.a (mgr.14388) 18579 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:41 smithi044 bash[22676]: audit 2024-09-21T05:23:40.741685+0000 mon.a (mon.0) 14716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:41 smithi044 bash[22676]: audit 2024-09-21T05:23:40.749239+0000 mon.a (mon.0) 14717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:41.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:41 smithi044 bash[22676]: audit 2024-09-21T05:23:40.759237+0000 mon.a (mon.0) 14718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:41 smithi179 bash[23186]: audit 2024-09-21T05:23:40.600436+0000 mon.a (mon.0) 14713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:41 smithi179 bash[23186]: audit 2024-09-21T05:23:40.605627+0000 mon.a (mon.0) 14714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:41 smithi179 bash[23186]: audit 2024-09-21T05:23:40.611493+0000 mon.a (mon.0) 14715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:41 smithi179 bash[23186]: cluster 2024-09-21T05:23:40.740213+0000 mgr.a (mgr.14388) 18579 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:41 smithi179 bash[23186]: audit 2024-09-21T05:23:40.741685+0000 mon.a (mon.0) 14716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:41 smithi179 bash[23186]: audit 2024-09-21T05:23:40.749239+0000 mon.a (mon.0) 14717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:41 smithi179 bash[23186]: audit 2024-09-21T05:23:40.759237+0000 mon.a (mon.0) 14718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:41 smithi049 bash[23528]: audit 2024-09-21T05:23:40.600436+0000 mon.a (mon.0) 14713 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:41 smithi049 bash[23528]: audit 2024-09-21T05:23:40.605627+0000 mon.a (mon.0) 14714 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:41 smithi049 bash[23528]: audit 2024-09-21T05:23:40.611493+0000 mon.a (mon.0) 14715 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:41 smithi049 bash[23528]: cluster 2024-09-21T05:23:40.740213+0000 mgr.a (mgr.14388) 18579 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:41 smithi049 bash[23528]: audit 2024-09-21T05:23:40.741685+0000 mon.a (mon.0) 14716 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:41 smithi049 bash[23528]: audit 2024-09-21T05:23:40.749239+0000 mon.a (mon.0) 14717 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:41 smithi049 bash[23528]: audit 2024-09-21T05:23:40.759237+0000 mon.a (mon.0) 14718 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:43.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:43.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:43 smithi049 bash[23528]: cluster 2024-09-21T05:23:42.741130+0000 mgr.a (mgr.14388) 18580 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:43 smithi049 bash[23528]: audit 2024-09-21T05:23:42.781073+0000 mgr.a (mgr.14388) 18581 : audit [DBG] from='client.399237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:43 smithi044 bash[22676]: cluster 2024-09-21T05:23:42.741130+0000 mgr.a (mgr.14388) 18580 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:43 smithi044 bash[22676]: audit 2024-09-21T05:23:42.781073+0000 mgr.a (mgr.14388) 18581 : audit [DBG] from='client.399237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:43 smithi179 bash[23186]: cluster 2024-09-21T05:23:42.741130+0000 mgr.a (mgr.14388) 18580 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:43 smithi179 bash[23186]: audit 2024-09-21T05:23:42.781073+0000 mgr.a (mgr.14388) 18581 : audit [DBG] from='client.399237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:45 smithi044 bash[22676]: cluster 2024-09-21T05:23:44.742090+0000 mgr.a (mgr.14388) 18582 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:45 smithi179 bash[23186]: cluster 2024-09-21T05:23:44.742090+0000 mgr.a (mgr.14388) 18582 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:45 smithi049 bash[23528]: cluster 2024-09-21T05:23:44.742090+0000 mgr.a (mgr.14388) 18582 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:48.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:47 smithi049 bash[23528]: cluster 2024-09-21T05:23:46.744396+0000 mgr.a (mgr.14388) 18583 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:48.239 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:47 smithi044 bash[22676]: cluster 2024-09-21T05:23:46.744396+0000 mgr.a (mgr.14388) 18583 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:48.240 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:47 smithi179 bash[23186]: cluster 2024-09-21T05:23:46.744396+0000 mgr.a (mgr.14388) 18583 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:49.035 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:50.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:49 smithi179 bash[23186]: audit 2024-09-21T05:23:48.573059+0000 mgr.a (mgr.14388) 18584 : audit [DBG] from='client.399312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:50.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:49 smithi179 bash[23186]: cluster 2024-09-21T05:23:48.745314+0000 mgr.a (mgr.14388) 18585 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:49 smithi044 bash[22676]: audit 2024-09-21T05:23:48.573059+0000 mgr.a (mgr.14388) 18584 : audit [DBG] from='client.399312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:49 smithi044 bash[22676]: cluster 2024-09-21T05:23:48.745314+0000 mgr.a (mgr.14388) 18585 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:49 smithi049 bash[23528]: audit 2024-09-21T05:23:48.573059+0000 mgr.a (mgr.14388) 18584 : audit [DBG] from='client.399312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:49 smithi049 bash[23528]: cluster 2024-09-21T05:23:48.745314+0000 mgr.a (mgr.14388) 18585 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:50 smithi044 bash[22676]: audit 2024-09-21T05:23:50.694919+0000 mon.a (mon.0) 14719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:23:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:50 smithi044 bash[22676]: audit 2024-09-21T05:23:50.702226+0000 mon.a (mon.0) 14720 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:23:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:50 smithi044 bash[22676]: audit 2024-09-21T05:23:50.704019+0000 mon.a (mon.0) 14721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:23:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:50 smithi044 bash[22676]: audit 2024-09-21T05:23:50.715288+0000 mon.a (mon.0) 14722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:50 smithi044 bash[22676]: audit 2024-09-21T05:23:50.721830+0000 mon.a (mon.0) 14723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:23:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:50 smithi179 bash[23186]: audit 2024-09-21T05:23:50.694919+0000 mon.a (mon.0) 14719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:23:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:50 smithi179 bash[23186]: audit 2024-09-21T05:23:50.702226+0000 mon.a (mon.0) 14720 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:23:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:50 smithi179 bash[23186]: audit 2024-09-21T05:23:50.704019+0000 mon.a (mon.0) 14721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:23:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:50 smithi179 bash[23186]: audit 2024-09-21T05:23:50.715288+0000 mon.a (mon.0) 14722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:50 smithi179 bash[23186]: audit 2024-09-21T05:23:50.721830+0000 mon.a (mon.0) 14723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:23:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:50 smithi049 bash[23528]: audit 2024-09-21T05:23:50.694919+0000 mon.a (mon.0) 14719 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:23:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:50 smithi049 bash[23528]: audit 2024-09-21T05:23:50.702226+0000 mon.a (mon.0) 14720 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:23:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:50 smithi049 bash[23528]: audit 2024-09-21T05:23:50.704019+0000 mon.a (mon.0) 14721 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:23:51.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:50 smithi049 bash[23528]: audit 2024-09-21T05:23:50.715288+0000 mon.a (mon.0) 14722 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:51.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:50 smithi049 bash[23528]: audit 2024-09-21T05:23:50.721830+0000 mon.a (mon.0) 14723 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:23:51.921 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:23:51 smithi044 bash[22930]: debug 2024-09-21T05:23:51.547+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:23:51.921 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:23:51 smithi044 bash[22930]: debug 2024-09-21T05:23:51.551+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:23:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:51 smithi044 bash[22676]: audit 2024-09-21T05:23:50.724303+0000 mgr.a (mgr.14388) 18586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:23:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:51 smithi044 bash[22676]: cluster 2024-09-21T05:23:50.750140+0000 mgr.a (mgr.14388) 18587 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:51 smithi044 bash[22676]: audit 2024-09-21T05:23:50.918500+0000 mon.a (mon.0) 14724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:51 smithi044 bash[22676]: audit 2024-09-21T05:23:50.925128+0000 mon.a (mon.0) 14725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:51 smithi044 bash[22676]: audit 2024-09-21T05:23:50.931218+0000 mon.a (mon.0) 14726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:51 smithi179 bash[23186]: audit 2024-09-21T05:23:50.724303+0000 mgr.a (mgr.14388) 18586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:23:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:51 smithi179 bash[23186]: cluster 2024-09-21T05:23:50.750140+0000 mgr.a (mgr.14388) 18587 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:51 smithi179 bash[23186]: audit 2024-09-21T05:23:50.918500+0000 mon.a (mon.0) 14724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:51 smithi179 bash[23186]: audit 2024-09-21T05:23:50.925128+0000 mon.a (mon.0) 14725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:51 smithi179 bash[23186]: audit 2024-09-21T05:23:50.931218+0000 mon.a (mon.0) 14726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:51 smithi049 bash[23528]: audit 2024-09-21T05:23:50.724303+0000 mgr.a (mgr.14388) 18586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:23:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:51 smithi049 bash[23528]: cluster 2024-09-21T05:23:50.750140+0000 mgr.a (mgr.14388) 18587 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:23:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:51 smithi049 bash[23528]: audit 2024-09-21T05:23:50.918500+0000 mon.a (mon.0) 14724 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:51 smithi049 bash[23528]: audit 2024-09-21T05:23:50.925128+0000 mon.a (mon.0) 14725 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:51 smithi049 bash[23528]: audit 2024-09-21T05:23:50.931218+0000 mon.a (mon.0) 14726 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:23:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:52 smithi044 bash[22676]: audit 2024-09-21T05:23:51.551780+0000 mgr.a (mgr.14388) 18588 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:23:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:52 smithi044 bash[22676]: cephadm 2024-09-21T05:23:51.553453+0000 mgr.a (mgr.14388) 18589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:23:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:52 smithi179 bash[23186]: audit 2024-09-21T05:23:51.551780+0000 mgr.a (mgr.14388) 18588 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:23:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:52 smithi179 bash[23186]: cephadm 2024-09-21T05:23:51.553453+0000 mgr.a (mgr.14388) 18589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:23:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:52 smithi049 bash[23528]: audit 2024-09-21T05:23:51.551780+0000 mgr.a (mgr.14388) 18588 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:23:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:52 smithi049 bash[23528]: cephadm 2024-09-21T05:23:51.553453+0000 mgr.a (mgr.14388) 18589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:23:54.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:54.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:54.037 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:23:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:53 smithi044 bash[22676]: cluster 2024-09-21T05:23:52.751165+0000 mgr.a (mgr.14388) 18590 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:53 smithi179 bash[23186]: cluster 2024-09-21T05:23:52.751165+0000 mgr.a (mgr.14388) 18590 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:53 smithi049 bash[23528]: cluster 2024-09-21T05:23:52.751165+0000 mgr.a (mgr.14388) 18590 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:23:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:23:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:23:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:23:54.803 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:23:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:55 smithi044 bash[22676]: audit 2024-09-21T05:23:54.361946+0000 mgr.a (mgr.14388) 18591 : audit [DBG] from='client.399492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:55 smithi044 bash[22676]: cluster 2024-09-21T05:23:54.751869+0000 mgr.a (mgr.14388) 18592 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:55 smithi179 bash[23186]: audit 2024-09-21T05:23:54.361946+0000 mgr.a (mgr.14388) 18591 : audit [DBG] from='client.399492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:55 smithi179 bash[23186]: cluster 2024-09-21T05:23:54.751869+0000 mgr.a (mgr.14388) 18592 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:55 smithi049 bash[23528]: audit 2024-09-21T05:23:54.361946+0000 mgr.a (mgr.14388) 18591 : audit [DBG] from='client.399492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:23:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:55 smithi049 bash[23528]: cluster 2024-09-21T05:23:54.751869+0000 mgr.a (mgr.14388) 18592 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:23:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:57 smithi049 bash[23528]: cluster 2024-09-21T05:23:56.754203+0000 mgr.a (mgr.14388) 18593 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:57 smithi044 bash[22676]: cluster 2024-09-21T05:23:56.754203+0000 mgr.a (mgr.14388) 18593 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:57 smithi179 bash[23186]: cluster 2024-09-21T05:23:56.754203+0000 mgr.a (mgr.14388) 18593 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:23:59.804 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:23:59.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:23:59.805 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:23:59 smithi044 bash[22676]: cluster 2024-09-21T05:23:58.754993+0000 mgr.a (mgr.14388) 18594 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:23:59 smithi179 bash[23186]: cluster 2024-09-21T05:23:58.754993+0000 mgr.a (mgr.14388) 18594 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:23:59 smithi049 bash[23528]: cluster 2024-09-21T05:23:58.754993+0000 mgr.a (mgr.14388) 18594 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:00.597 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:02.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: audit 2024-09-21T05:24:00.142473+0000 mgr.a (mgr.14388) 18595 : audit [DBG] from='client.399567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: cluster 2024-09-21T05:24:00.758199+0000 mgr.a (mgr.14388) 18596 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: audit 2024-09-21T05:24:00.792307+0000 mon.a (mon.0) 14727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: audit 2024-09-21T05:24:00.798667+0000 mon.a (mon.0) 14728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: audit 2024-09-21T05:24:00.805601+0000 mon.a (mon.0) 14729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: audit 2024-09-21T05:24:00.961027+0000 mon.a (mon.0) 14730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: audit 2024-09-21T05:24:00.969452+0000 mon.a (mon.0) 14731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:01 smithi049 bash[23528]: audit 2024-09-21T05:24:00.979869+0000 mon.a (mon.0) 14732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: audit 2024-09-21T05:24:00.142473+0000 mgr.a (mgr.14388) 18595 : audit [DBG] from='client.399567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: cluster 2024-09-21T05:24:00.758199+0000 mgr.a (mgr.14388) 18596 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: audit 2024-09-21T05:24:00.792307+0000 mon.a (mon.0) 14727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: audit 2024-09-21T05:24:00.798667+0000 mon.a (mon.0) 14728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: audit 2024-09-21T05:24:00.805601+0000 mon.a (mon.0) 14729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: audit 2024-09-21T05:24:00.961027+0000 mon.a (mon.0) 14730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: audit 2024-09-21T05:24:00.969452+0000 mon.a (mon.0) 14731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:01 smithi044 bash[22676]: audit 2024-09-21T05:24:00.979869+0000 mon.a (mon.0) 14732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: audit 2024-09-21T05:24:00.142473+0000 mgr.a (mgr.14388) 18595 : audit [DBG] from='client.399567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: cluster 2024-09-21T05:24:00.758199+0000 mgr.a (mgr.14388) 18596 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: audit 2024-09-21T05:24:00.792307+0000 mon.a (mon.0) 14727 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: audit 2024-09-21T05:24:00.798667+0000 mon.a (mon.0) 14728 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: audit 2024-09-21T05:24:00.805601+0000 mon.a (mon.0) 14729 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: audit 2024-09-21T05:24:00.961027+0000 mon.a (mon.0) 14730 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: audit 2024-09-21T05:24:00.969452+0000 mon.a (mon.0) 14731 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:02.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:01 smithi179 bash[23186]: audit 2024-09-21T05:24:00.979869+0000 mon.a (mon.0) 14732 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:03 smithi049 bash[23528]: cluster 2024-09-21T05:24:02.759043+0000 mgr.a (mgr.14388) 18597 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:24:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:03 smithi044 bash[22676]: cluster 2024-09-21T05:24:02.759043+0000 mgr.a (mgr.14388) 18597 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:24:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:03 smithi179 bash[23186]: cluster 2024-09-21T05:24:02.759043+0000 mgr.a (mgr.14388) 18597 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:24:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:05.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:05 smithi049 bash[23528]: cluster 2024-09-21T05:24:04.759860+0000 mgr.a (mgr.14388) 18598 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:24:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:05 smithi044 bash[22676]: cluster 2024-09-21T05:24:04.759860+0000 mgr.a (mgr.14388) 18598 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:24:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:05 smithi179 bash[23186]: cluster 2024-09-21T05:24:04.759860+0000 mgr.a (mgr.14388) 18598 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:24:06.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:06.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:06.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:06.391 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:06.391 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:06 smithi044 bash[22676]: audit 2024-09-21T05:24:05.932209+0000 mgr.a (mgr.14388) 18599 : audit [DBG] from='client.399645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:06 smithi179 bash[23186]: audit 2024-09-21T05:24:05.932209+0000 mgr.a (mgr.14388) 18599 : audit [DBG] from='client.399645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:06 smithi049 bash[23528]: audit 2024-09-21T05:24:05.932209+0000 mgr.a (mgr.14388) 18599 : audit [DBG] from='client.399645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:08.228 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:07 smithi049 bash[23528]: cluster 2024-09-21T05:24:06.762885+0000 mgr.a (mgr.14388) 18600 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:07 smithi044 bash[22676]: cluster 2024-09-21T05:24:06.762885+0000 mgr.a (mgr.14388) 18600 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:07 smithi179 bash[23186]: cluster 2024-09-21T05:24:06.762885+0000 mgr.a (mgr.14388) 18600 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:10.222 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:09 smithi179 bash[23186]: cluster 2024-09-21T05:24:08.763686+0000 mgr.a (mgr.14388) 18601 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:24:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:09 smithi044 bash[22676]: cluster 2024-09-21T05:24:08.763686+0000 mgr.a (mgr.14388) 18601 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:24:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:09 smithi049 bash[23528]: cluster 2024-09-21T05:24:08.763686+0000 mgr.a (mgr.14388) 18601 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:24:11.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:11.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:11 smithi044 bash[22676]: cluster 2024-09-21T05:24:10.765632+0000 mgr.a (mgr.14388) 18602 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:11 smithi044 bash[22676]: audit 2024-09-21T05:24:11.151122+0000 mon.a (mon.0) 14733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:11 smithi044 bash[22676]: audit 2024-09-21T05:24:11.160353+0000 mon.a (mon.0) 14734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:11 smithi044 bash[22676]: audit 2024-09-21T05:24:11.171379+0000 mon.a (mon.0) 14735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:11 smithi179 bash[23186]: cluster 2024-09-21T05:24:10.765632+0000 mgr.a (mgr.14388) 18602 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:11 smithi179 bash[23186]: audit 2024-09-21T05:24:11.151122+0000 mon.a (mon.0) 14733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:11 smithi179 bash[23186]: audit 2024-09-21T05:24:11.160353+0000 mon.a (mon.0) 14734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:11 smithi179 bash[23186]: audit 2024-09-21T05:24:11.171379+0000 mon.a (mon.0) 14735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:11 smithi049 bash[23528]: cluster 2024-09-21T05:24:10.765632+0000 mgr.a (mgr.14388) 18602 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:11 smithi049 bash[23528]: audit 2024-09-21T05:24:11.151122+0000 mon.a (mon.0) 14733 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:11 smithi049 bash[23528]: audit 2024-09-21T05:24:11.160353+0000 mon.a (mon.0) 14734 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:12.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:11 smithi049 bash[23528]: audit 2024-09-21T05:24:11.171379+0000 mon.a (mon.0) 14735 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:12 smithi179 bash[23186]: audit 2024-09-21T05:24:11.726193+0000 mgr.a (mgr.14388) 18603 : audit [DBG] from='client.399723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:12 smithi044 bash[22676]: audit 2024-09-21T05:24:11.726193+0000 mgr.a (mgr.14388) 18603 : audit [DBG] from='client.399723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:12 smithi049 bash[23528]: audit 2024-09-21T05:24:11.726193+0000 mgr.a (mgr.14388) 18603 : audit [DBG] from='client.399723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:14.111 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:13 smithi044 bash[22676]: cluster 2024-09-21T05:24:12.766527+0000 mgr.a (mgr.14388) 18604 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:13 smithi179 bash[23186]: cluster 2024-09-21T05:24:12.766527+0000 mgr.a (mgr.14388) 18604 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:13 smithi049 bash[23528]: cluster 2024-09-21T05:24:12.766527+0000 mgr.a (mgr.14388) 18604 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:15 smithi044 bash[22676]: cluster 2024-09-21T05:24:14.767351+0000 mgr.a (mgr.14388) 18605 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:15 smithi179 bash[23186]: cluster 2024-09-21T05:24:14.767351+0000 mgr.a (mgr.14388) 18605 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:15 smithi049 bash[23528]: cluster 2024-09-21T05:24:14.767351+0000 mgr.a (mgr.14388) 18605 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:17.948 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:17.948 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:17.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:17.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:17.949 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:17 smithi044 bash[22676]: cluster 2024-09-21T05:24:16.769639+0000 mgr.a (mgr.14388) 18606 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:17 smithi179 bash[23186]: cluster 2024-09-21T05:24:16.769639+0000 mgr.a (mgr.14388) 18606 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:18.299 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:17 smithi049 bash[23528]: cluster 2024-09-21T05:24:16.769639+0000 mgr.a (mgr.14388) 18606 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:18 smithi044 bash[22676]: audit 2024-09-21T05:24:17.499850+0000 mgr.a (mgr.14388) 18607 : audit [DBG] from='client.399801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:18 smithi179 bash[23186]: audit 2024-09-21T05:24:17.499850+0000 mgr.a (mgr.14388) 18607 : audit [DBG] from='client.399801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:19.300 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:18 smithi049 bash[23528]: audit 2024-09-21T05:24:17.499850+0000 mgr.a (mgr.14388) 18607 : audit [DBG] from='client.399801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:19 smithi049 bash[23528]: cluster 2024-09-21T05:24:18.770554+0000 mgr.a (mgr.14388) 18608 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:19 smithi044 bash[22676]: cluster 2024-09-21T05:24:18.770554+0000 mgr.a (mgr.14388) 18608 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:19 smithi179 bash[23186]: cluster 2024-09-21T05:24:18.770554+0000 mgr.a (mgr.14388) 18608 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:22 smithi049 bash[23528]: cluster 2024-09-21T05:24:20.772702+0000 mgr.a (mgr.14388) 18609 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:22 smithi049 bash[23528]: audit 2024-09-21T05:24:21.013887+0000 mon.a (mon.0) 14736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:22 smithi049 bash[23528]: audit 2024-09-21T05:24:21.022045+0000 mon.a (mon.0) 14737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:22 smithi049 bash[23528]: audit 2024-09-21T05:24:21.029488+0000 mon.a (mon.0) 14738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:22 smithi049 bash[23528]: audit 2024-09-21T05:24:21.163592+0000 mon.a (mon.0) 14739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:22 smithi049 bash[23528]: audit 2024-09-21T05:24:21.172503+0000 mon.a (mon.0) 14740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:22 smithi049 bash[23528]: audit 2024-09-21T05:24:21.183060+0000 mon.a (mon.0) 14741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:22 smithi044 bash[22676]: cluster 2024-09-21T05:24:20.772702+0000 mgr.a (mgr.14388) 18609 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:22 smithi044 bash[22676]: audit 2024-09-21T05:24:21.013887+0000 mon.a (mon.0) 14736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:22 smithi044 bash[22676]: audit 2024-09-21T05:24:21.022045+0000 mon.a (mon.0) 14737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:22 smithi044 bash[22676]: audit 2024-09-21T05:24:21.029488+0000 mon.a (mon.0) 14738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:22 smithi044 bash[22676]: audit 2024-09-21T05:24:21.163592+0000 mon.a (mon.0) 14739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:22 smithi044 bash[22676]: audit 2024-09-21T05:24:21.172503+0000 mon.a (mon.0) 14740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:22 smithi044 bash[22676]: audit 2024-09-21T05:24:21.183060+0000 mon.a (mon.0) 14741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:22 smithi179 bash[23186]: cluster 2024-09-21T05:24:20.772702+0000 mgr.a (mgr.14388) 18609 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:22 smithi179 bash[23186]: audit 2024-09-21T05:24:21.013887+0000 mon.a (mon.0) 14736 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:22 smithi179 bash[23186]: audit 2024-09-21T05:24:21.022045+0000 mon.a (mon.0) 14737 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:22 smithi179 bash[23186]: audit 2024-09-21T05:24:21.029488+0000 mon.a (mon.0) 14738 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:22 smithi179 bash[23186]: audit 2024-09-21T05:24:21.163592+0000 mon.a (mon.0) 14739 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:22 smithi179 bash[23186]: audit 2024-09-21T05:24:21.172503+0000 mon.a (mon.0) 14740 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:22 smithi179 bash[23186]: audit 2024-09-21T05:24:21.183060+0000 mon.a (mon.0) 14741 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:23.717 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:23.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:23.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:23.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:23.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:24 smithi049 bash[23528]: cluster 2024-09-21T05:24:22.773457+0000 mgr.a (mgr.14388) 18610 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:24 smithi044 bash[22676]: cluster 2024-09-21T05:24:22.773457+0000 mgr.a (mgr.14388) 18610 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:24 smithi179 bash[23186]: cluster 2024-09-21T05:24:22.773457+0000 mgr.a (mgr.14388) 18610 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:25 smithi049 bash[23528]: audit 2024-09-21T05:24:23.280476+0000 mgr.a (mgr.14388) 18611 : audit [DBG] from='client.399879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:25 smithi044 bash[22676]: audit 2024-09-21T05:24:23.280476+0000 mgr.a (mgr.14388) 18611 : audit [DBG] from='client.399879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:25 smithi179 bash[23186]: audit 2024-09-21T05:24:23.280476+0000 mgr.a (mgr.14388) 18611 : audit [DBG] from='client.399879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:26 smithi049 bash[23528]: cluster 2024-09-21T05:24:24.774373+0000 mgr.a (mgr.14388) 18612 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:26 smithi044 bash[22676]: cluster 2024-09-21T05:24:24.774373+0000 mgr.a (mgr.14388) 18612 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:26 smithi179 bash[23186]: cluster 2024-09-21T05:24:24.774373+0000 mgr.a (mgr.14388) 18612 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:28 smithi049 bash[23528]: cluster 2024-09-21T05:24:26.776566+0000 mgr.a (mgr.14388) 18613 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:28 smithi044 bash[22676]: cluster 2024-09-21T05:24:26.776566+0000 mgr.a (mgr.14388) 18613 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:28 smithi179 bash[23186]: cluster 2024-09-21T05:24:26.776566+0000 mgr.a (mgr.14388) 18613 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:28.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:29 smithi049 bash[23528]: cluster 2024-09-21T05:24:28.777155+0000 mgr.a (mgr.14388) 18614 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:29 smithi044 bash[22676]: cluster 2024-09-21T05:24:28.777155+0000 mgr.a (mgr.14388) 18614 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:29.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:29.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:29.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:29.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:29.497 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:29 smithi179 bash[23186]: cluster 2024-09-21T05:24:28.777155+0000 mgr.a (mgr.14388) 18614 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:30 smithi044 bash[22676]: audit 2024-09-21T05:24:29.057882+0000 mgr.a (mgr.14388) 18615 : audit [DBG] from='client.399954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:30 smithi179 bash[23186]: audit 2024-09-21T05:24:29.057882+0000 mgr.a (mgr.14388) 18615 : audit [DBG] from='client.399954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:30 smithi049 bash[23528]: audit 2024-09-21T05:24:29.057882+0000 mgr.a (mgr.14388) 18615 : audit [DBG] from='client.399954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:31.409 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:31 smithi049 bash[23528]: cluster 2024-09-21T05:24:30.779473+0000 mgr.a (mgr.14388) 18616 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:31 smithi044 bash[22676]: cluster 2024-09-21T05:24:30.779473+0000 mgr.a (mgr.14388) 18616 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:31 smithi179 bash[23186]: cluster 2024-09-21T05:24:30.779473+0000 mgr.a (mgr.14388) 18616 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:24:32.663 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:32 smithi179 bash[23186]: audit 2024-09-21T05:24:31.385471+0000 mon.a (mon.0) 14742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.663 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:32 smithi179 bash[23186]: audit 2024-09-21T05:24:31.394168+0000 mon.a (mon.0) 14743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.663 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:32 smithi179 bash[23186]: audit 2024-09-21T05:24:31.404731+0000 mon.a (mon.0) 14744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:32 smithi044 bash[22676]: audit 2024-09-21T05:24:31.385471+0000 mon.a (mon.0) 14742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:32 smithi044 bash[22676]: audit 2024-09-21T05:24:31.394168+0000 mon.a (mon.0) 14743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:32 smithi044 bash[22676]: audit 2024-09-21T05:24:31.404731+0000 mon.a (mon.0) 14744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:32 smithi049 bash[23528]: audit 2024-09-21T05:24:31.385471+0000 mon.a (mon.0) 14742 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:32 smithi049 bash[23528]: audit 2024-09-21T05:24:31.394168+0000 mon.a (mon.0) 14743 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:32 smithi049 bash[23528]: audit 2024-09-21T05:24:31.404731+0000 mon.a (mon.0) 14744 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:33.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:33 smithi044 bash[22676]: cluster 2024-09-21T05:24:32.780242+0000 mgr.a (mgr.14388) 18617 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:33.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:33 smithi179 bash[23186]: cluster 2024-09-21T05:24:32.780242+0000 mgr.a (mgr.14388) 18617 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:33.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:33 smithi049 bash[23528]: cluster 2024-09-21T05:24:32.780242+0000 mgr.a (mgr.14388) 18617 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:34.498 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:34.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:34.499 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:35.269 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:35.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:35.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:35.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:35.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:35 smithi044 bash[22676]: cluster 2024-09-21T05:24:34.780775+0000 mgr.a (mgr.14388) 18618 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:35 smithi044 bash[22676]: audit 2024-09-21T05:24:34.828147+0000 mgr.a (mgr.14388) 18619 : audit [DBG] from='client.400026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:35 smithi179 bash[23186]: cluster 2024-09-21T05:24:34.780775+0000 mgr.a (mgr.14388) 18618 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:35 smithi179 bash[23186]: audit 2024-09-21T05:24:34.828147+0000 mgr.a (mgr.14388) 18619 : audit [DBG] from='client.400026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:35 smithi049 bash[23528]: cluster 2024-09-21T05:24:34.780775+0000 mgr.a (mgr.14388) 18618 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:35 smithi049 bash[23528]: audit 2024-09-21T05:24:34.828147+0000 mgr.a (mgr.14388) 18619 : audit [DBG] from='client.400026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:37 smithi044 bash[22676]: cluster 2024-09-21T05:24:36.782309+0000 mgr.a (mgr.14388) 18620 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:24:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:37 smithi179 bash[23186]: cluster 2024-09-21T05:24:36.782309+0000 mgr.a (mgr.14388) 18620 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:24:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:37 smithi049 bash[23528]: cluster 2024-09-21T05:24:36.782309+0000 mgr.a (mgr.14388) 18620 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:24:40.052 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:39 smithi049 bash[23528]: cluster 2024-09-21T05:24:38.783068+0000 mgr.a (mgr.14388) 18621 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:24:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:39 smithi044 bash[22676]: cluster 2024-09-21T05:24:38.783068+0000 mgr.a (mgr.14388) 18621 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:24:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:39 smithi179 bash[23186]: cluster 2024-09-21T05:24:38.783068+0000 mgr.a (mgr.14388) 18621 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:24:40.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:40.271 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:40.271 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:41.065 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:41.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:41.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:41.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:41.065 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:42.239 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: audit 2024-09-21T05:24:40.612050+0000 mgr.a (mgr.14388) 18622 : audit [DBG] from='client.400104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:42.239 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: cluster 2024-09-21T05:24:40.785861+0000 mgr.a (mgr.14388) 18623 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:42.239 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: audit 2024-09-21T05:24:41.238307+0000 mon.a (mon.0) 14745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: audit 2024-09-21T05:24:41.243760+0000 mon.a (mon.0) 14746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: audit 2024-09-21T05:24:41.249689+0000 mon.a (mon.0) 14747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: audit 2024-09-21T05:24:41.347567+0000 mon.a (mon.0) 14748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: audit 2024-09-21T05:24:41.355589+0000 mon.a (mon.0) 14749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:41 smithi049 bash[23528]: audit 2024-09-21T05:24:41.364306+0000 mon.a (mon.0) 14750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: audit 2024-09-21T05:24:40.612050+0000 mgr.a (mgr.14388) 18622 : audit [DBG] from='client.400104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: cluster 2024-09-21T05:24:40.785861+0000 mgr.a (mgr.14388) 18623 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: audit 2024-09-21T05:24:41.238307+0000 mon.a (mon.0) 14745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: audit 2024-09-21T05:24:41.243760+0000 mon.a (mon.0) 14746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: audit 2024-09-21T05:24:41.249689+0000 mon.a (mon.0) 14747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: audit 2024-09-21T05:24:41.347567+0000 mon.a (mon.0) 14748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: audit 2024-09-21T05:24:41.355589+0000 mon.a (mon.0) 14749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:41 smithi044 bash[22676]: audit 2024-09-21T05:24:41.364306+0000 mon.a (mon.0) 14750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: audit 2024-09-21T05:24:40.612050+0000 mgr.a (mgr.14388) 18622 : audit [DBG] from='client.400104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: cluster 2024-09-21T05:24:40.785861+0000 mgr.a (mgr.14388) 18623 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: audit 2024-09-21T05:24:41.238307+0000 mon.a (mon.0) 14745 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: audit 2024-09-21T05:24:41.243760+0000 mon.a (mon.0) 14746 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: audit 2024-09-21T05:24:41.249689+0000 mon.a (mon.0) 14747 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: audit 2024-09-21T05:24:41.347567+0000 mon.a (mon.0) 14748 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: audit 2024-09-21T05:24:41.355589+0000 mon.a (mon.0) 14749 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:42.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:41 smithi179 bash[23186]: audit 2024-09-21T05:24:41.364306+0000 mon.a (mon.0) 14750 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:43 smithi044 bash[22676]: cluster 2024-09-21T05:24:42.786715+0000 mgr.a (mgr.14388) 18624 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:24:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:43 smithi179 bash[23186]: cluster 2024-09-21T05:24:42.786715+0000 mgr.a (mgr.14388) 18624 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:24:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:43 smithi049 bash[23528]: cluster 2024-09-21T05:24:42.786715+0000 mgr.a (mgr.14388) 18624 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:24:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:46.068 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:45 smithi044 bash[22676]: cluster 2024-09-21T05:24:44.787486+0000 mgr.a (mgr.14388) 18625 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:24:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:45 smithi179 bash[23186]: cluster 2024-09-21T05:24:44.787486+0000 mgr.a (mgr.14388) 18625 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:24:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:45 smithi049 bash[23528]: cluster 2024-09-21T05:24:44.787486+0000 mgr.a (mgr.14388) 18625 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:24:46.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:46.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:46.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:46.846 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:46.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:47 smithi044 bash[22676]: audit 2024-09-21T05:24:46.400087+0000 mgr.a (mgr.14388) 18626 : audit [DBG] from='client.400182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:47 smithi044 bash[22676]: cluster 2024-09-21T05:24:46.789410+0000 mgr.a (mgr.14388) 18627 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:47 smithi179 bash[23186]: audit 2024-09-21T05:24:46.400087+0000 mgr.a (mgr.14388) 18626 : audit [DBG] from='client.400182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:47 smithi179 bash[23186]: cluster 2024-09-21T05:24:46.789410+0000 mgr.a (mgr.14388) 18627 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:47 smithi049 bash[23528]: audit 2024-09-21T05:24:46.400087+0000 mgr.a (mgr.14388) 18626 : audit [DBG] from='client.400182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:47 smithi049 bash[23528]: cluster 2024-09-21T05:24:46.789410+0000 mgr.a (mgr.14388) 18627 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:50.128 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:49 smithi179 bash[23186]: cluster 2024-09-21T05:24:48.790171+0000 mgr.a (mgr.14388) 18628 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:24:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:49 smithi044 bash[22676]: cluster 2024-09-21T05:24:48.790171+0000 mgr.a (mgr.14388) 18628 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:24:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:49 smithi049 bash[23528]: cluster 2024-09-21T05:24:48.790171+0000 mgr.a (mgr.14388) 18628 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:24:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: cluster 2024-09-21T05:24:50.792161+0000 mgr.a (mgr.14388) 18629 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.567268+0000 mon.a (mon.0) 14751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.577174+0000 mon.a (mon.0) 14752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.589071+0000 mon.a (mon.0) 14753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.622817+0000 mon.a (mon.0) 14754 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.628957+0000 mon.a (mon.0) 14755 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.631047+0000 mon.a (mon.0) 14756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.641995+0000 mon.a (mon.0) 14757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:51 smithi044 bash[22676]: audit 2024-09-21T05:24:51.648288+0000 mon.a (mon.0) 14758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:24:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: cluster 2024-09-21T05:24:50.792161+0000 mgr.a (mgr.14388) 18629 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:24:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.567268+0000 mon.a (mon.0) 14751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.577174+0000 mon.a (mon.0) 14752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.589071+0000 mon.a (mon.0) 14753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.622817+0000 mon.a (mon.0) 14754 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:24:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.628957+0000 mon.a (mon.0) 14755 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:24:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.631047+0000 mon.a (mon.0) 14756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:24:52.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.641995+0000 mon.a (mon.0) 14757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:51 smithi179 bash[23186]: audit 2024-09-21T05:24:51.648288+0000 mon.a (mon.0) 14758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:24:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: cluster 2024-09-21T05:24:50.792161+0000 mgr.a (mgr.14388) 18629 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:24:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.567268+0000 mon.a (mon.0) 14751 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.577174+0000 mon.a (mon.0) 14752 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.589071+0000 mon.a (mon.0) 14753 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.622817+0000 mon.a (mon.0) 14754 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:24:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.628957+0000 mon.a (mon.0) 14755 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:24:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.631047+0000 mon.a (mon.0) 14756 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:24:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.641995+0000 mon.a (mon.0) 14757 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:24:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:51 smithi049 bash[23528]: audit 2024-09-21T05:24:51.648288+0000 mon.a (mon.0) 14758 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:24:52.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:24:52 smithi044 bash[22930]: debug 2024-09-21T05:24:52.434+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:24:52.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:24:52 smithi044 bash[22930]: debug 2024-09-21T05:24:52.446+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:24:52.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:52.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:52.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:52.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:52.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:24:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:52 smithi044 bash[22676]: audit 2024-09-21T05:24:51.650690+0000 mgr.a (mgr.14388) 18630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:24:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:52 smithi179 bash[23186]: audit 2024-09-21T05:24:51.650690+0000 mgr.a (mgr.14388) 18630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:24:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:52 smithi049 bash[23528]: audit 2024-09-21T05:24:51.650690+0000 mgr.a (mgr.14388) 18630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:24:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:53 smithi179 bash[23186]: audit 2024-09-21T05:24:52.192396+0000 mgr.a (mgr.14388) 18631 : audit [DBG] from='client.400296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:53 smithi179 bash[23186]: audit 2024-09-21T05:24:52.440880+0000 mgr.a (mgr.14388) 18632 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:24:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:53 smithi179 bash[23186]: cephadm 2024-09-21T05:24:52.452867+0000 mgr.a (mgr.14388) 18633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:24:54.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:53 smithi179 bash[23186]: cluster 2024-09-21T05:24:52.792727+0000 mgr.a (mgr.14388) 18634 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:53 smithi044 bash[22676]: audit 2024-09-21T05:24:52.192396+0000 mgr.a (mgr.14388) 18631 : audit [DBG] from='client.400296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:53 smithi044 bash[22676]: audit 2024-09-21T05:24:52.440880+0000 mgr.a (mgr.14388) 18632 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:24:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:53 smithi044 bash[22676]: cephadm 2024-09-21T05:24:52.452867+0000 mgr.a (mgr.14388) 18633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:24:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:53 smithi044 bash[22676]: cluster 2024-09-21T05:24:52.792727+0000 mgr.a (mgr.14388) 18634 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:53 smithi049 bash[23528]: audit 2024-09-21T05:24:52.192396+0000 mgr.a (mgr.14388) 18631 : audit [DBG] from='client.400296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:24:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:53 smithi049 bash[23528]: audit 2024-09-21T05:24:52.440880+0000 mgr.a (mgr.14388) 18632 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:24:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:53 smithi049 bash[23528]: cephadm 2024-09-21T05:24:52.452867+0000 mgr.a (mgr.14388) 18633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:24:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:53 smithi049 bash[23528]: cluster 2024-09-21T05:24:52.792727+0000 mgr.a (mgr.14388) 18634 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:56.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:55 smithi044 bash[22676]: cluster 2024-09-21T05:24:54.793436+0000 mgr.a (mgr.14388) 18635 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:55 smithi179 bash[23186]: cluster 2024-09-21T05:24:54.793436+0000 mgr.a (mgr.14388) 18635 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:55 smithi049 bash[23528]: cluster 2024-09-21T05:24:54.793436+0000 mgr.a (mgr.14388) 18635 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:24:57.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:24:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:24:57.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:24:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:57 smithi044 bash[22676]: cluster 2024-09-21T05:24:56.794719+0000 mgr.a (mgr.14388) 18636 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:57 smithi179 bash[23186]: cluster 2024-09-21T05:24:56.794719+0000 mgr.a (mgr.14388) 18636 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:57 smithi049 bash[23528]: cluster 2024-09-21T05:24:56.794719+0000 mgr.a (mgr.14388) 18636 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:24:58.648 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:24:58.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:24:58.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:24:58.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:24:58.649 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:59 smithi044 bash[22676]: audit 2024-09-21T05:24:58.190094+0000 mgr.a (mgr.14388) 18637 : audit [DBG] from='client.400440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:24:59 smithi044 bash[22676]: cluster 2024-09-21T05:24:58.795621+0000 mgr.a (mgr.14388) 18638 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:59 smithi179 bash[23186]: audit 2024-09-21T05:24:58.190094+0000 mgr.a (mgr.14388) 18637 : audit [DBG] from='client.400440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:24:59 smithi179 bash[23186]: cluster 2024-09-21T05:24:58.795621+0000 mgr.a (mgr.14388) 18638 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:00.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:59 smithi049 bash[23528]: audit 2024-09-21T05:24:58.190094+0000 mgr.a (mgr.14388) 18637 : audit [DBG] from='client.400440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:00.273 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:24:59 smithi049 bash[23528]: cluster 2024-09-21T05:24:58.795621+0000 mgr.a (mgr.14388) 18638 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:01 smithi044 bash[22676]: cluster 2024-09-21T05:25:00.797826+0000 mgr.a (mgr.14388) 18639 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:01 smithi044 bash[22676]: audit 2024-09-21T05:25:01.455284+0000 mon.a (mon.0) 14759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:01 smithi044 bash[22676]: audit 2024-09-21T05:25:01.463333+0000 mon.a (mon.0) 14760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:01 smithi044 bash[22676]: audit 2024-09-21T05:25:01.474862+0000 mon.a (mon.0) 14761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:01 smithi044 bash[22676]: audit 2024-09-21T05:25:01.591075+0000 mon.a (mon.0) 14762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:01 smithi044 bash[22676]: audit 2024-09-21T05:25:01.599030+0000 mon.a (mon.0) 14763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:01 smithi044 bash[22676]: audit 2024-09-21T05:25:01.607845+0000 mon.a (mon.0) 14764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:01 smithi179 bash[23186]: cluster 2024-09-21T05:25:00.797826+0000 mgr.a (mgr.14388) 18639 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:01 smithi179 bash[23186]: audit 2024-09-21T05:25:01.455284+0000 mon.a (mon.0) 14759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:01 smithi179 bash[23186]: audit 2024-09-21T05:25:01.463333+0000 mon.a (mon.0) 14760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:01 smithi179 bash[23186]: audit 2024-09-21T05:25:01.474862+0000 mon.a (mon.0) 14761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:01 smithi179 bash[23186]: audit 2024-09-21T05:25:01.591075+0000 mon.a (mon.0) 14762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:01 smithi179 bash[23186]: audit 2024-09-21T05:25:01.599030+0000 mon.a (mon.0) 14763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:01 smithi179 bash[23186]: audit 2024-09-21T05:25:01.607845+0000 mon.a (mon.0) 14764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:01 smithi049 bash[23528]: cluster 2024-09-21T05:25:00.797826+0000 mgr.a (mgr.14388) 18639 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:01 smithi049 bash[23528]: audit 2024-09-21T05:25:01.455284+0000 mon.a (mon.0) 14759 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:01 smithi049 bash[23528]: audit 2024-09-21T05:25:01.463333+0000 mon.a (mon.0) 14760 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:01 smithi049 bash[23528]: audit 2024-09-21T05:25:01.474862+0000 mon.a (mon.0) 14761 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:01 smithi049 bash[23528]: audit 2024-09-21T05:25:01.591075+0000 mon.a (mon.0) 14762 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:01 smithi049 bash[23528]: audit 2024-09-21T05:25:01.599030+0000 mon.a (mon.0) 14763 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:02.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:01 smithi049 bash[23528]: audit 2024-09-21T05:25:01.607845+0000 mon.a (mon.0) 14764 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:03.650 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:03.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:03.651 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:04.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:03 smithi044 bash[22676]: cluster 2024-09-21T05:25:02.798606+0000 mgr.a (mgr.14388) 18640 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:03 smithi179 bash[23186]: cluster 2024-09-21T05:25:02.798606+0000 mgr.a (mgr.14388) 18640 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:03 smithi049 bash[23528]: cluster 2024-09-21T05:25:02.798606+0000 mgr.a (mgr.14388) 18640 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:04.429 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:04.429 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:04.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:04.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:04.430 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:04 smithi044 bash[22676]: audit 2024-09-21T05:25:03.986378+0000 mgr.a (mgr.14388) 18641 : audit [DBG] from='client.400518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:04 smithi179 bash[23186]: audit 2024-09-21T05:25:03.986378+0000 mgr.a (mgr.14388) 18641 : audit [DBG] from='client.400518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:04 smithi049 bash[23528]: audit 2024-09-21T05:25:03.986378+0000 mgr.a (mgr.14388) 18641 : audit [DBG] from='client.400518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:05 smithi044 bash[22676]: cluster 2024-09-21T05:25:04.799473+0000 mgr.a (mgr.14388) 18642 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:05 smithi179 bash[23186]: cluster 2024-09-21T05:25:04.799473+0000 mgr.a (mgr.14388) 18642 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:05 smithi049 bash[23528]: cluster 2024-09-21T05:25:04.799473+0000 mgr.a (mgr.14388) 18642 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:07 smithi044 bash[22676]: cluster 2024-09-21T05:25:06.801888+0000 mgr.a (mgr.14388) 18643 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:07 smithi179 bash[23186]: cluster 2024-09-21T05:25:06.801888+0000 mgr.a (mgr.14388) 18643 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:07 smithi049 bash[23528]: cluster 2024-09-21T05:25:06.801888+0000 mgr.a (mgr.14388) 18643 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:25:09.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:10.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:10.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:10.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:10.220 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:09 smithi044 bash[22676]: cluster 2024-09-21T05:25:08.802689+0000 mgr.a (mgr.14388) 18644 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:09 smithi179 bash[23186]: cluster 2024-09-21T05:25:08.802689+0000 mgr.a (mgr.14388) 18644 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:09 smithi049 bash[23528]: cluster 2024-09-21T05:25:08.802689+0000 mgr.a (mgr.14388) 18644 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:10 smithi044 bash[22676]: audit 2024-09-21T05:25:09.766597+0000 mgr.a (mgr.14388) 18645 : audit [DBG] from='client.400596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:10 smithi179 bash[23186]: audit 2024-09-21T05:25:09.766597+0000 mgr.a (mgr.14388) 18645 : audit [DBG] from='client.400596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:10 smithi049 bash[23528]: audit 2024-09-21T05:25:09.766597+0000 mgr.a (mgr.14388) 18645 : audit [DBG] from='client.400596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:11 smithi044 bash[22676]: cluster 2024-09-21T05:25:10.805758+0000 mgr.a (mgr.14388) 18646 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:25:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:11 smithi044 bash[22676]: audit 2024-09-21T05:25:11.806481+0000 mon.a (mon.0) 14765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:11 smithi044 bash[22676]: audit 2024-09-21T05:25:11.816445+0000 mon.a (mon.0) 14766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:11 smithi044 bash[22676]: audit 2024-09-21T05:25:11.828320+0000 mon.a (mon.0) 14767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:11 smithi179 bash[23186]: cluster 2024-09-21T05:25:10.805758+0000 mgr.a (mgr.14388) 18646 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:25:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:11 smithi179 bash[23186]: audit 2024-09-21T05:25:11.806481+0000 mon.a (mon.0) 14765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:11 smithi179 bash[23186]: audit 2024-09-21T05:25:11.816445+0000 mon.a (mon.0) 14766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:11 smithi179 bash[23186]: audit 2024-09-21T05:25:11.828320+0000 mon.a (mon.0) 14767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:11 smithi049 bash[23528]: cluster 2024-09-21T05:25:10.805758+0000 mgr.a (mgr.14388) 18646 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:25:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:11 smithi049 bash[23528]: audit 2024-09-21T05:25:11.806481+0000 mon.a (mon.0) 14765 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:11 smithi049 bash[23528]: audit 2024-09-21T05:25:11.816445+0000 mon.a (mon.0) 14766 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:12.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:11 smithi049 bash[23528]: audit 2024-09-21T05:25:11.828320+0000 mon.a (mon.0) 14767 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:13 smithi044 bash[22676]: cluster 2024-09-21T05:25:12.806597+0000 mgr.a (mgr.14388) 18647 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:14.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:13 smithi179 bash[23186]: cluster 2024-09-21T05:25:12.806597+0000 mgr.a (mgr.14388) 18647 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:13 smithi049 bash[23528]: cluster 2024-09-21T05:25:12.806597+0000 mgr.a (mgr.14388) 18647 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:15.221 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:15.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:15.222 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:15.987 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:15.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:15.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:15.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:15.987 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:15 smithi044 bash[22676]: cluster 2024-09-21T05:25:14.807094+0000 mgr.a (mgr.14388) 18648 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:15 smithi179 bash[23186]: cluster 2024-09-21T05:25:14.807094+0000 mgr.a (mgr.14388) 18648 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:15 smithi049 bash[23528]: cluster 2024-09-21T05:25:14.807094+0000 mgr.a (mgr.14388) 18648 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:17.207 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:16 smithi044 bash[22676]: audit 2024-09-21T05:25:15.561111+0000 mgr.a (mgr.14388) 18649 : audit [DBG] from='client.400674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:16 smithi179 bash[23186]: audit 2024-09-21T05:25:15.561111+0000 mgr.a (mgr.14388) 18649 : audit [DBG] from='client.400674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:16 smithi049 bash[23528]: audit 2024-09-21T05:25:15.561111+0000 mgr.a (mgr.14388) 18649 : audit [DBG] from='client.400674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:17 smithi044 bash[22676]: cluster 2024-09-21T05:25:16.808740+0000 mgr.a (mgr.14388) 18650 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:17 smithi179 bash[23186]: cluster 2024-09-21T05:25:16.808740+0000 mgr.a (mgr.14388) 18650 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:17 smithi049 bash[23528]: cluster 2024-09-21T05:25:16.808740+0000 mgr.a (mgr.14388) 18650 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:19 smithi044 bash[22676]: cluster 2024-09-21T05:25:18.809514+0000 mgr.a (mgr.14388) 18651 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:25:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:19 smithi179 bash[23186]: cluster 2024-09-21T05:25:18.809514+0000 mgr.a (mgr.14388) 18651 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:25:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:19 smithi049 bash[23528]: cluster 2024-09-21T05:25:18.809514+0000 mgr.a (mgr.14388) 18651 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:25:20.988 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:20.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:20.989 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:21.782 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:21.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:21.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:21.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:21.782 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:21 smithi044 bash[22676]: cluster 2024-09-21T05:25:20.811457+0000 mgr.a (mgr.14388) 18652 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:21 smithi044 bash[22676]: audit 2024-09-21T05:25:21.666226+0000 mon.a (mon.0) 14768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:21 smithi044 bash[22676]: audit 2024-09-21T05:25:21.679697+0000 mon.a (mon.0) 14769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:21 smithi044 bash[22676]: audit 2024-09-21T05:25:21.687214+0000 mon.a (mon.0) 14770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:21 smithi044 bash[22676]: audit 2024-09-21T05:25:21.744015+0000 mon.a (mon.0) 14771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:21 smithi044 bash[22676]: audit 2024-09-21T05:25:21.750530+0000 mon.a (mon.0) 14772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:21 smithi044 bash[22676]: audit 2024-09-21T05:25:21.757059+0000 mon.a (mon.0) 14773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:21 smithi179 bash[23186]: cluster 2024-09-21T05:25:20.811457+0000 mgr.a (mgr.14388) 18652 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:21 smithi179 bash[23186]: audit 2024-09-21T05:25:21.666226+0000 mon.a (mon.0) 14768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:21 smithi179 bash[23186]: audit 2024-09-21T05:25:21.679697+0000 mon.a (mon.0) 14769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:21 smithi179 bash[23186]: audit 2024-09-21T05:25:21.687214+0000 mon.a (mon.0) 14770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:21 smithi179 bash[23186]: audit 2024-09-21T05:25:21.744015+0000 mon.a (mon.0) 14771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:21 smithi179 bash[23186]: audit 2024-09-21T05:25:21.750530+0000 mon.a (mon.0) 14772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:21 smithi179 bash[23186]: audit 2024-09-21T05:25:21.757059+0000 mon.a (mon.0) 14773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:21 smithi049 bash[23528]: cluster 2024-09-21T05:25:20.811457+0000 mgr.a (mgr.14388) 18652 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:21 smithi049 bash[23528]: audit 2024-09-21T05:25:21.666226+0000 mon.a (mon.0) 14768 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:21 smithi049 bash[23528]: audit 2024-09-21T05:25:21.679697+0000 mon.a (mon.0) 14769 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:21 smithi049 bash[23528]: audit 2024-09-21T05:25:21.687214+0000 mon.a (mon.0) 14770 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:21 smithi049 bash[23528]: audit 2024-09-21T05:25:21.744015+0000 mon.a (mon.0) 14771 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:21 smithi049 bash[23528]: audit 2024-09-21T05:25:21.750530+0000 mon.a (mon.0) 14772 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:22.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:21 smithi049 bash[23528]: audit 2024-09-21T05:25:21.757059+0000 mon.a (mon.0) 14773 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:22 smithi044 bash[22676]: audit 2024-09-21T05:25:21.324743+0000 mgr.a (mgr.14388) 18653 : audit [DBG] from='client.400752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:23.252 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:22 smithi049 bash[23528]: audit 2024-09-21T05:25:21.324743+0000 mgr.a (mgr.14388) 18653 : audit [DBG] from='client.400752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:22 smithi179 bash[23186]: audit 2024-09-21T05:25:21.324743+0000 mgr.a (mgr.14388) 18653 : audit [DBG] from='client.400752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:23 smithi044 bash[22676]: cluster 2024-09-21T05:25:22.812523+0000 mgr.a (mgr.14388) 18654 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:25:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:23 smithi179 bash[23186]: cluster 2024-09-21T05:25:22.812523+0000 mgr.a (mgr.14388) 18654 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:25:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:23 smithi049 bash[23528]: cluster 2024-09-21T05:25:22.812523+0000 mgr.a (mgr.14388) 18654 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:25:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:25 smithi044 bash[22676]: cluster 2024-09-21T05:25:24.813349+0000 mgr.a (mgr.14388) 18655 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:25:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:25 smithi179 bash[23186]: cluster 2024-09-21T05:25:24.813349+0000 mgr.a (mgr.14388) 18655 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:25:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:25 smithi049 bash[23528]: cluster 2024-09-21T05:25:24.813349+0000 mgr.a (mgr.14388) 18655 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:25:26.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:26.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:26.784 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:27.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:27.582 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:27.582 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:27 smithi044 bash[22676]: cluster 2024-09-21T05:25:26.814995+0000 mgr.a (mgr.14388) 18656 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:25:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:27 smithi179 bash[23186]: cluster 2024-09-21T05:25:26.814995+0000 mgr.a (mgr.14388) 18656 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:25:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:27 smithi049 bash[23528]: cluster 2024-09-21T05:25:26.814995+0000 mgr.a (mgr.14388) 18656 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:25:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:28 smithi179 bash[23186]: audit 2024-09-21T05:25:27.119848+0000 mgr.a (mgr.14388) 18657 : audit [DBG] from='client.400830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:28 smithi049 bash[23528]: audit 2024-09-21T05:25:27.119848+0000 mgr.a (mgr.14388) 18657 : audit [DBG] from='client.400830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:28 smithi044 bash[22676]: audit 2024-09-21T05:25:27.119848+0000 mgr.a (mgr.14388) 18657 : audit [DBG] from='client.400830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:29 smithi179 bash[23186]: cluster 2024-09-21T05:25:28.815979+0000 mgr.a (mgr.14388) 18658 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:29 smithi049 bash[23528]: cluster 2024-09-21T05:25:28.815979+0000 mgr.a (mgr.14388) 18658 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:29 smithi044 bash[22676]: cluster 2024-09-21T05:25:28.815979+0000 mgr.a (mgr.14388) 18658 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:32 smithi179 bash[23186]: cluster 2024-09-21T05:25:30.818211+0000 mgr.a (mgr.14388) 18659 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:32 smithi049 bash[23528]: cluster 2024-09-21T05:25:30.818211+0000 mgr.a (mgr.14388) 18659 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:32 smithi044 bash[22676]: cluster 2024-09-21T05:25:30.818211+0000 mgr.a (mgr.14388) 18659 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:32.583 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:32.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:32.584 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:33 smithi179 bash[23186]: audit 2024-09-21T05:25:32.044120+0000 mon.a (mon.0) 14774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:33 smithi179 bash[23186]: audit 2024-09-21T05:25:32.055632+0000 mon.a (mon.0) 14775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:33 smithi179 bash[23186]: audit 2024-09-21T05:25:32.068126+0000 mon.a (mon.0) 14776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:33 smithi049 bash[23528]: audit 2024-09-21T05:25:32.044120+0000 mon.a (mon.0) 14774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:33 smithi049 bash[23528]: audit 2024-09-21T05:25:32.055632+0000 mon.a (mon.0) 14775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:33 smithi049 bash[23528]: audit 2024-09-21T05:25:32.068126+0000 mon.a (mon.0) 14776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:33.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:33.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:33.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:33.364 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:33 smithi044 bash[22676]: audit 2024-09-21T05:25:32.044120+0000 mon.a (mon.0) 14774 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:33 smithi044 bash[22676]: audit 2024-09-21T05:25:32.055632+0000 mon.a (mon.0) 14775 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:33 smithi044 bash[22676]: audit 2024-09-21T05:25:32.068126+0000 mon.a (mon.0) 14776 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:34 smithi044 bash[22676]: cluster 2024-09-21T05:25:32.819068+0000 mgr.a (mgr.14388) 18660 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:34 smithi044 bash[22676]: audit 2024-09-21T05:25:32.918462+0000 mgr.a (mgr.14388) 18661 : audit [DBG] from='client.400908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:34 smithi179 bash[23186]: cluster 2024-09-21T05:25:32.819068+0000 mgr.a (mgr.14388) 18660 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:34 smithi179 bash[23186]: audit 2024-09-21T05:25:32.918462+0000 mgr.a (mgr.14388) 18661 : audit [DBG] from='client.400908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:34 smithi049 bash[23528]: cluster 2024-09-21T05:25:32.819068+0000 mgr.a (mgr.14388) 18660 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:34 smithi049 bash[23528]: audit 2024-09-21T05:25:32.918462+0000 mgr.a (mgr.14388) 18661 : audit [DBG] from='client.400908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:36 smithi049 bash[23528]: cluster 2024-09-21T05:25:34.820080+0000 mgr.a (mgr.14388) 18662 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:36 smithi044 bash[22676]: cluster 2024-09-21T05:25:34.820080+0000 mgr.a (mgr.14388) 18662 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:36 smithi179 bash[23186]: cluster 2024-09-21T05:25:34.820080+0000 mgr.a (mgr.14388) 18662 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:37.376 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:37 smithi044 bash[22676]: cluster 2024-09-21T05:25:36.822061+0000 mgr.a (mgr.14388) 18663 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:37 smithi179 bash[23186]: cluster 2024-09-21T05:25:36.822061+0000 mgr.a (mgr.14388) 18663 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:37 smithi049 bash[23528]: cluster 2024-09-21T05:25:36.822061+0000 mgr.a (mgr.14388) 18663 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:38.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:38.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:38.367 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:39.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:39.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:39.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:39.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:39.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:39 smithi044 bash[22676]: audit 2024-09-21T05:25:38.703444+0000 mgr.a (mgr.14388) 18664 : audit [DBG] from='client.400983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:39 smithi044 bash[22676]: cluster 2024-09-21T05:25:38.822590+0000 mgr.a (mgr.14388) 18665 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:39 smithi179 bash[23186]: audit 2024-09-21T05:25:38.703444+0000 mgr.a (mgr.14388) 18664 : audit [DBG] from='client.400983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:39 smithi179 bash[23186]: cluster 2024-09-21T05:25:38.822590+0000 mgr.a (mgr.14388) 18665 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:39 smithi049 bash[23528]: audit 2024-09-21T05:25:38.703444+0000 mgr.a (mgr.14388) 18664 : audit [DBG] from='client.400983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:39 smithi049 bash[23528]: cluster 2024-09-21T05:25:38.822590+0000 mgr.a (mgr.14388) 18665 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:41 smithi044 bash[22676]: cluster 2024-09-21T05:25:40.825056+0000 mgr.a (mgr.14388) 18666 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:41 smithi179 bash[23186]: cluster 2024-09-21T05:25:40.825056+0000 mgr.a (mgr.14388) 18666 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:41 smithi049 bash[23528]: cluster 2024-09-21T05:25:40.825056+0000 mgr.a (mgr.14388) 18666 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:42 smithi044 bash[22676]: audit 2024-09-21T05:25:41.894336+0000 mon.a (mon.0) 14777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:42 smithi044 bash[22676]: audit 2024-09-21T05:25:41.902051+0000 mon.a (mon.0) 14778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:42 smithi044 bash[22676]: audit 2024-09-21T05:25:41.912775+0000 mon.a (mon.0) 14779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:42 smithi044 bash[22676]: audit 2024-09-21T05:25:41.952248+0000 mon.a (mon.0) 14780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:42 smithi044 bash[22676]: audit 2024-09-21T05:25:41.959648+0000 mon.a (mon.0) 14781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:42 smithi044 bash[22676]: audit 2024-09-21T05:25:41.968763+0000 mon.a (mon.0) 14782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:42 smithi179 bash[23186]: audit 2024-09-21T05:25:41.894336+0000 mon.a (mon.0) 14777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:42 smithi179 bash[23186]: audit 2024-09-21T05:25:41.902051+0000 mon.a (mon.0) 14778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:42 smithi179 bash[23186]: audit 2024-09-21T05:25:41.912775+0000 mon.a (mon.0) 14779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:42 smithi179 bash[23186]: audit 2024-09-21T05:25:41.952248+0000 mon.a (mon.0) 14780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:42 smithi179 bash[23186]: audit 2024-09-21T05:25:41.959648+0000 mon.a (mon.0) 14781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:42 smithi179 bash[23186]: audit 2024-09-21T05:25:41.968763+0000 mon.a (mon.0) 14782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:42 smithi049 bash[23528]: audit 2024-09-21T05:25:41.894336+0000 mon.a (mon.0) 14777 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:42 smithi049 bash[23528]: audit 2024-09-21T05:25:41.902051+0000 mon.a (mon.0) 14778 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:42 smithi049 bash[23528]: audit 2024-09-21T05:25:41.912775+0000 mon.a (mon.0) 14779 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:42 smithi049 bash[23528]: audit 2024-09-21T05:25:41.952248+0000 mon.a (mon.0) 14780 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:42 smithi049 bash[23528]: audit 2024-09-21T05:25:41.959648+0000 mon.a (mon.0) 14781 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:43.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:42 smithi049 bash[23528]: audit 2024-09-21T05:25:41.968763+0000 mon.a (mon.0) 14782 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:44.171 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:44.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:44.172 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:43 smithi044 bash[22676]: cluster 2024-09-21T05:25:42.825890+0000 mgr.a (mgr.14388) 18667 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:43 smithi179 bash[23186]: cluster 2024-09-21T05:25:42.825890+0000 mgr.a (mgr.14388) 18667 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:43 smithi049 bash[23528]: cluster 2024-09-21T05:25:42.825890+0000 mgr.a (mgr.14388) 18667 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:44.959 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:44.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:44.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:44.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:44.960 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:45 smithi044 bash[22676]: audit 2024-09-21T05:25:44.509647+0000 mgr.a (mgr.14388) 18668 : audit [DBG] from='client.401061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:45 smithi044 bash[22676]: cluster 2024-09-21T05:25:44.826412+0000 mgr.a (mgr.14388) 18669 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:45 smithi179 bash[23186]: audit 2024-09-21T05:25:44.509647+0000 mgr.a (mgr.14388) 18668 : audit [DBG] from='client.401061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:45 smithi179 bash[23186]: cluster 2024-09-21T05:25:44.826412+0000 mgr.a (mgr.14388) 18669 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:45 smithi049 bash[23528]: audit 2024-09-21T05:25:44.509647+0000 mgr.a (mgr.14388) 18668 : audit [DBG] from='client.401061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:45 smithi049 bash[23528]: cluster 2024-09-21T05:25:44.826412+0000 mgr.a (mgr.14388) 18669 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:47 smithi044 bash[22676]: cluster 2024-09-21T05:25:46.828767+0000 mgr.a (mgr.14388) 18670 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:47 smithi179 bash[23186]: cluster 2024-09-21T05:25:46.828767+0000 mgr.a (mgr.14388) 18670 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:47 smithi049 bash[23528]: cluster 2024-09-21T05:25:46.828767+0000 mgr.a (mgr.14388) 18670 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:25:49.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:49.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:49 smithi044 bash[22676]: cluster 2024-09-21T05:25:48.829608+0000 mgr.a (mgr.14388) 18671 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:49 smithi179 bash[23186]: cluster 2024-09-21T05:25:48.829608+0000 mgr.a (mgr.14388) 18671 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:49 smithi049 bash[23528]: cluster 2024-09-21T05:25:48.829608+0000 mgr.a (mgr.14388) 18671 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:50.739 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:51 smithi044 bash[22676]: audit 2024-09-21T05:25:50.296246+0000 mgr.a (mgr.14388) 18672 : audit [DBG] from='client.401139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:51 smithi044 bash[22676]: cluster 2024-09-21T05:25:50.832637+0000 mgr.a (mgr.14388) 18673 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:52.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:51 smithi179 bash[23186]: audit 2024-09-21T05:25:50.296246+0000 mgr.a (mgr.14388) 18672 : audit [DBG] from='client.401139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:51 smithi179 bash[23186]: cluster 2024-09-21T05:25:50.832637+0000 mgr.a (mgr.14388) 18673 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:51 smithi049 bash[23528]: audit 2024-09-21T05:25:50.296246+0000 mgr.a (mgr.14388) 18672 : audit [DBG] from='client.401139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:51 smithi049 bash[23528]: cluster 2024-09-21T05:25:50.832637+0000 mgr.a (mgr.14388) 18673 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:25:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.280471+0000 mon.a (mon.0) 14783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.289033+0000 mon.a (mon.0) 14784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.299565+0000 mon.a (mon.0) 14785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.517929+0000 mon.a (mon.0) 14786 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.524306+0000 mon.a (mon.0) 14787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.526051+0000 mon.a (mon.0) 14788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.537272+0000 mon.a (mon.0) 14789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.544132+0000 mon.a (mon.0) 14790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:25:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: audit 2024-09-21T05:25:52.546624+0000 mgr.a (mgr.14388) 18674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:25:53.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:53 smithi179 bash[23186]: cluster 2024-09-21T05:25:52.833383+0000 mgr.a (mgr.14388) 18675 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:25:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.280471+0000 mon.a (mon.0) 14783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.289033+0000 mon.a (mon.0) 14784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.299565+0000 mon.a (mon.0) 14785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.517929+0000 mon.a (mon.0) 14786 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.524306+0000 mon.a (mon.0) 14787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.526051+0000 mon.a (mon.0) 14788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.537272+0000 mon.a (mon.0) 14789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.544132+0000 mon.a (mon.0) 14790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: audit 2024-09-21T05:25:52.546624+0000 mgr.a (mgr.14388) 18674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:53 smithi049 bash[23528]: cluster 2024-09-21T05:25:52.833383+0000 mgr.a (mgr.14388) 18675 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:25:53.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22930]: debug 2024-09-21T05:25:53.337+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:25:53.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22930]: debug 2024-09-21T05:25:53.337+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:25:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.280471+0000 mon.a (mon.0) 14783 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.289033+0000 mon.a (mon.0) 14784 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.299565+0000 mon.a (mon.0) 14785 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.517929+0000 mon.a (mon.0) 14786 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:53.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.524306+0000 mon.a (mon.0) 14787 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.526051+0000 mon.a (mon.0) 14788 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.537272+0000 mon.a (mon.0) 14789 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:25:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.544132+0000 mon.a (mon.0) 14790 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:25:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: audit 2024-09-21T05:25:52.546624+0000 mgr.a (mgr.14388) 18674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:25:53.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:53 smithi044 bash[22676]: cluster 2024-09-21T05:25:52.833383+0000 mgr.a (mgr.14388) 18675 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:25:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:54 smithi049 bash[23528]: audit 2024-09-21T05:25:53.343287+0000 mgr.a (mgr.14388) 18676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:25:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:54 smithi049 bash[23528]: cephadm 2024-09-21T05:25:53.344600+0000 mgr.a (mgr.14388) 18677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:25:54.811 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:54 smithi179 bash[23186]: audit 2024-09-21T05:25:53.343287+0000 mgr.a (mgr.14388) 18676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:25:54.811 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:54 smithi179 bash[23186]: cephadm 2024-09-21T05:25:53.344600+0000 mgr.a (mgr.14388) 18677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:25:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:54 smithi044 bash[22676]: audit 2024-09-21T05:25:53.343287+0000 mgr.a (mgr.14388) 18676 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:25:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:54 smithi044 bash[22676]: cephadm 2024-09-21T05:25:53.344600+0000 mgr.a (mgr.14388) 18677 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:25:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:25:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:25:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:25:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:55 smithi049 bash[23528]: cluster 2024-09-21T05:25:54.834277+0000 mgr.a (mgr.14388) 18678 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:25:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:55 smithi044 bash[22676]: cluster 2024-09-21T05:25:54.834277+0000 mgr.a (mgr.14388) 18678 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:25:56.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:55 smithi179 bash[23186]: cluster 2024-09-21T05:25:54.834277+0000 mgr.a (mgr.14388) 18678 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:25:56.526 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:25:56.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:25:56.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:25:56.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:25:56.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:25:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:57 smithi044 bash[22676]: audit 2024-09-21T05:25:56.077553+0000 mgr.a (mgr.14388) 18679 : audit [DBG] from='client.401325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:57 smithi044 bash[22676]: cluster 2024-09-21T05:25:56.836654+0000 mgr.a (mgr.14388) 18680 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:25:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:57 smithi179 bash[23186]: audit 2024-09-21T05:25:56.077553+0000 mgr.a (mgr.14388) 18679 : audit [DBG] from='client.401325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:57 smithi179 bash[23186]: cluster 2024-09-21T05:25:56.836654+0000 mgr.a (mgr.14388) 18680 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:25:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:57 smithi049 bash[23528]: audit 2024-09-21T05:25:56.077553+0000 mgr.a (mgr.14388) 18679 : audit [DBG] from='client.401325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:57 smithi049 bash[23528]: cluster 2024-09-21T05:25:56.836654+0000 mgr.a (mgr.14388) 18680 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:25:59 smithi044 bash[22676]: cluster 2024-09-21T05:25:58.837490+0000 mgr.a (mgr.14388) 18681 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T05:26:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:25:59 smithi179 bash[23186]: cluster 2024-09-21T05:25:58.837490+0000 mgr.a (mgr.14388) 18681 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T05:26:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:25:59 smithi049 bash[23528]: cluster 2024-09-21T05:25:58.837490+0000 mgr.a (mgr.14388) 18681 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-21T05:26:01.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:01.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:01.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:01 smithi044 bash[22676]: cluster 2024-09-21T05:26:00.839496+0000 mgr.a (mgr.14388) 18682 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:01 smithi179 bash[23186]: cluster 2024-09-21T05:26:00.839496+0000 mgr.a (mgr.14388) 18682 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:01 smithi049 bash[23528]: cluster 2024-09-21T05:26:00.839496+0000 mgr.a (mgr.14388) 18682 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:02.315 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:02.315 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:02.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:02.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:02.316 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:02 smithi044 bash[22676]: audit 2024-09-21T05:26:01.864060+0000 mgr.a (mgr.14388) 18683 : audit [DBG] from='client.401400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:02 smithi044 bash[22676]: audit 2024-09-21T05:26:02.115740+0000 mon.a (mon.0) 14791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:02 smithi044 bash[22676]: audit 2024-09-21T05:26:02.121719+0000 mon.a (mon.0) 14792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:02 smithi044 bash[22676]: audit 2024-09-21T05:26:02.127050+0000 mon.a (mon.0) 14793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:02 smithi044 bash[22676]: audit 2024-09-21T05:26:02.134261+0000 mon.a (mon.0) 14794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:02 smithi044 bash[22676]: audit 2024-09-21T05:26:02.139286+0000 mon.a (mon.0) 14795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:02 smithi044 bash[22676]: audit 2024-09-21T05:26:02.144688+0000 mon.a (mon.0) 14796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:02 smithi179 bash[23186]: audit 2024-09-21T05:26:01.864060+0000 mgr.a (mgr.14388) 18683 : audit [DBG] from='client.401400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:03.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:02 smithi179 bash[23186]: audit 2024-09-21T05:26:02.115740+0000 mon.a (mon.0) 14791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:02 smithi179 bash[23186]: audit 2024-09-21T05:26:02.121719+0000 mon.a (mon.0) 14792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:02 smithi179 bash[23186]: audit 2024-09-21T05:26:02.127050+0000 mon.a (mon.0) 14793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:02 smithi179 bash[23186]: audit 2024-09-21T05:26:02.134261+0000 mon.a (mon.0) 14794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:02 smithi179 bash[23186]: audit 2024-09-21T05:26:02.139286+0000 mon.a (mon.0) 14795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:02 smithi179 bash[23186]: audit 2024-09-21T05:26:02.144688+0000 mon.a (mon.0) 14796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:02 smithi049 bash[23528]: audit 2024-09-21T05:26:01.864060+0000 mgr.a (mgr.14388) 18683 : audit [DBG] from='client.401400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:02 smithi049 bash[23528]: audit 2024-09-21T05:26:02.115740+0000 mon.a (mon.0) 14791 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:02 smithi049 bash[23528]: audit 2024-09-21T05:26:02.121719+0000 mon.a (mon.0) 14792 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:02 smithi049 bash[23528]: audit 2024-09-21T05:26:02.127050+0000 mon.a (mon.0) 14793 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:02 smithi049 bash[23528]: audit 2024-09-21T05:26:02.134261+0000 mon.a (mon.0) 14794 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:02 smithi049 bash[23528]: audit 2024-09-21T05:26:02.139286+0000 mon.a (mon.0) 14795 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:03.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:02 smithi049 bash[23528]: audit 2024-09-21T05:26:02.144688+0000 mon.a (mon.0) 14796 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:03 smithi044 bash[22676]: cluster 2024-09-21T05:26:02.840509+0000 mgr.a (mgr.14388) 18684 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:03 smithi179 bash[23186]: cluster 2024-09-21T05:26:02.840509+0000 mgr.a (mgr.14388) 18684 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:03 smithi049 bash[23528]: cluster 2024-09-21T05:26:02.840509+0000 mgr.a (mgr.14388) 18684 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:05 smithi044 bash[22676]: cluster 2024-09-21T05:26:04.841348+0000 mgr.a (mgr.14388) 18685 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:05 smithi179 bash[23186]: cluster 2024-09-21T05:26:04.841348+0000 mgr.a (mgr.14388) 18685 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:05 smithi049 bash[23528]: cluster 2024-09-21T05:26:04.841348+0000 mgr.a (mgr.14388) 18685 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-21T05:26:07.317 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:07.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:07.318 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:08.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:08.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:08.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:08.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:08.077 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:07 smithi044 bash[22676]: cluster 2024-09-21T05:26:06.843613+0000 mgr.a (mgr.14388) 18686 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T05:26:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:07 smithi179 bash[23186]: cluster 2024-09-21T05:26:06.843613+0000 mgr.a (mgr.14388) 18686 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T05:26:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:07 smithi049 bash[23528]: cluster 2024-09-21T05:26:06.843613+0000 mgr.a (mgr.14388) 18686 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T05:26:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:08 smithi044 bash[22676]: audit 2024-09-21T05:26:07.643342+0000 mgr.a (mgr.14388) 18687 : audit [DBG] from='client.401478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:08 smithi179 bash[23186]: audit 2024-09-21T05:26:07.643342+0000 mgr.a (mgr.14388) 18687 : audit [DBG] from='client.401478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:08 smithi049 bash[23528]: audit 2024-09-21T05:26:07.643342+0000 mgr.a (mgr.14388) 18687 : audit [DBG] from='client.401478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:09 smithi044 bash[22676]: cluster 2024-09-21T05:26:08.844613+0000 mgr.a (mgr.14388) 18688 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:09 smithi179 bash[23186]: cluster 2024-09-21T05:26:08.844613+0000 mgr.a (mgr.14388) 18688 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:09 smithi049 bash[23528]: cluster 2024-09-21T05:26:08.844613+0000 mgr.a (mgr.14388) 18688 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:11 smithi044 bash[22676]: cluster 2024-09-21T05:26:10.846851+0000 mgr.a (mgr.14388) 18689 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:11 smithi179 bash[23186]: cluster 2024-09-21T05:26:10.846851+0000 mgr.a (mgr.14388) 18689 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:11 smithi049 bash[23528]: cluster 2024-09-21T05:26:10.846851+0000 mgr.a (mgr.14388) 18689 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:13.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:13.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:13.079 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:13 smithi179 bash[23186]: audit 2024-09-21T05:26:12.518359+0000 mon.a (mon.0) 14797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:13 smithi179 bash[23186]: audit 2024-09-21T05:26:12.527203+0000 mon.a (mon.0) 14798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:13 smithi179 bash[23186]: audit 2024-09-21T05:26:12.537799+0000 mon.a (mon.0) 14799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:13 smithi179 bash[23186]: cluster 2024-09-21T05:26:12.847611+0000 mgr.a (mgr.14388) 18690 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:13 smithi049 bash[23528]: audit 2024-09-21T05:26:12.518359+0000 mon.a (mon.0) 14797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:13 smithi049 bash[23528]: audit 2024-09-21T05:26:12.527203+0000 mon.a (mon.0) 14798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:13 smithi049 bash[23528]: audit 2024-09-21T05:26:12.537799+0000 mon.a (mon.0) 14799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:13 smithi049 bash[23528]: cluster 2024-09-21T05:26:12.847611+0000 mgr.a (mgr.14388) 18690 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:13.867 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:13.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:13.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:13.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:13.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:13 smithi044 bash[22676]: audit 2024-09-21T05:26:12.518359+0000 mon.a (mon.0) 14797 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:13 smithi044 bash[22676]: audit 2024-09-21T05:26:12.527203+0000 mon.a (mon.0) 14798 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:13 smithi044 bash[22676]: audit 2024-09-21T05:26:12.537799+0000 mon.a (mon.0) 14799 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:13 smithi044 bash[22676]: cluster 2024-09-21T05:26:12.847611+0000 mgr.a (mgr.14388) 18690 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:14.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:14 smithi179 bash[23186]: audit 2024-09-21T05:26:13.415959+0000 mgr.a (mgr.14388) 18691 : audit [DBG] from='client.401556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:14 smithi049 bash[23528]: audit 2024-09-21T05:26:13.415959+0000 mgr.a (mgr.14388) 18691 : audit [DBG] from='client.401556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:14 smithi044 bash[22676]: audit 2024-09-21T05:26:13.415959+0000 mgr.a (mgr.14388) 18691 : audit [DBG] from='client.401556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:15.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:15 smithi044 bash[22676]: cluster 2024-09-21T05:26:14.848597+0000 mgr.a (mgr.14388) 18692 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:15 smithi049 bash[23528]: cluster 2024-09-21T05:26:14.848597+0000 mgr.a (mgr.14388) 18692 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:15 smithi179 bash[23186]: cluster 2024-09-21T05:26:14.848597+0000 mgr.a (mgr.14388) 18692 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:18.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:17 smithi179 bash[23186]: cluster 2024-09-21T05:26:16.850956+0000 mgr.a (mgr.14388) 18693 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:17 smithi044 bash[22676]: cluster 2024-09-21T05:26:16.850956+0000 mgr.a (mgr.14388) 18693 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:17 smithi049 bash[23528]: cluster 2024-09-21T05:26:16.850956+0000 mgr.a (mgr.14388) 18693 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:19.636 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:19.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:19.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:19.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:19.637 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:20.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:19 smithi044 bash[22676]: cluster 2024-09-21T05:26:18.851783+0000 mgr.a (mgr.14388) 18694 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:19 smithi179 bash[23186]: cluster 2024-09-21T05:26:18.851783+0000 mgr.a (mgr.14388) 18694 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:19 smithi049 bash[23528]: cluster 2024-09-21T05:26:18.851783+0000 mgr.a (mgr.14388) 18694 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:21.213 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:20 smithi049 bash[23528]: audit 2024-09-21T05:26:19.198262+0000 mgr.a (mgr.14388) 18695 : audit [DBG] from='client.401634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:21.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:20 smithi179 bash[23186]: audit 2024-09-21T05:26:19.198262+0000 mgr.a (mgr.14388) 18695 : audit [DBG] from='client.401634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:21.284 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:20 smithi044 bash[22676]: audit 2024-09-21T05:26:19.198262+0000 mgr.a (mgr.14388) 18695 : audit [DBG] from='client.401634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:22.204 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:21 smithi049 bash[23528]: cluster 2024-09-21T05:26:20.854279+0000 mgr.a (mgr.14388) 18696 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:26:22.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:21 smithi044 bash[22676]: cluster 2024-09-21T05:26:20.854279+0000 mgr.a (mgr.14388) 18696 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:26:22.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:21 smithi179 bash[23186]: cluster 2024-09-21T05:26:20.854279+0000 mgr.a (mgr.14388) 18696 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:26:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:23 smithi049 bash[23528]: audit 2024-09-21T05:26:22.348470+0000 mon.a (mon.0) 14800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:23 smithi049 bash[23528]: audit 2024-09-21T05:26:22.356550+0000 mon.a (mon.0) 14801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:23 smithi049 bash[23528]: audit 2024-09-21T05:26:22.368347+0000 mon.a (mon.0) 14802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:23 smithi049 bash[23528]: audit 2024-09-21T05:26:22.381606+0000 mon.a (mon.0) 14803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:23 smithi049 bash[23528]: audit 2024-09-21T05:26:22.390226+0000 mon.a (mon.0) 14804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:23 smithi049 bash[23528]: audit 2024-09-21T05:26:22.400405+0000 mon.a (mon.0) 14805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:23 smithi049 bash[23528]: cluster 2024-09-21T05:26:22.855065+0000 mgr.a (mgr.14388) 18697 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:23 smithi044 bash[22676]: audit 2024-09-21T05:26:22.348470+0000 mon.a (mon.0) 14800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:23 smithi044 bash[22676]: audit 2024-09-21T05:26:22.356550+0000 mon.a (mon.0) 14801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:23 smithi044 bash[22676]: audit 2024-09-21T05:26:22.368347+0000 mon.a (mon.0) 14802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:23 smithi044 bash[22676]: audit 2024-09-21T05:26:22.381606+0000 mon.a (mon.0) 14803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:23 smithi044 bash[22676]: audit 2024-09-21T05:26:22.390226+0000 mon.a (mon.0) 14804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:23 smithi044 bash[22676]: audit 2024-09-21T05:26:22.400405+0000 mon.a (mon.0) 14805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:23 smithi044 bash[22676]: cluster 2024-09-21T05:26:22.855065+0000 mgr.a (mgr.14388) 18697 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:23 smithi179 bash[23186]: audit 2024-09-21T05:26:22.348470+0000 mon.a (mon.0) 14800 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:23 smithi179 bash[23186]: audit 2024-09-21T05:26:22.356550+0000 mon.a (mon.0) 14801 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:23 smithi179 bash[23186]: audit 2024-09-21T05:26:22.368347+0000 mon.a (mon.0) 14802 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:23 smithi179 bash[23186]: audit 2024-09-21T05:26:22.381606+0000 mon.a (mon.0) 14803 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:23 smithi179 bash[23186]: audit 2024-09-21T05:26:22.390226+0000 mon.a (mon.0) 14804 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:23 smithi179 bash[23186]: audit 2024-09-21T05:26:22.400405+0000 mon.a (mon.0) 14805 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:23 smithi179 bash[23186]: cluster 2024-09-21T05:26:22.855065+0000 mgr.a (mgr.14388) 18697 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:24.638 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:24.638 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:24.639 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:25.419 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:25.419 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:25 smithi044 bash[22676]: cluster 2024-09-21T05:26:24.855826+0000 mgr.a (mgr.14388) 18698 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:25 smithi044 bash[22676]: audit 2024-09-21T05:26:24.971078+0000 mgr.a (mgr.14388) 18699 : audit [DBG] from='client.401712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:25 smithi179 bash[23186]: cluster 2024-09-21T05:26:24.855826+0000 mgr.a (mgr.14388) 18698 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:25 smithi179 bash[23186]: audit 2024-09-21T05:26:24.971078+0000 mgr.a (mgr.14388) 18699 : audit [DBG] from='client.401712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:25 smithi049 bash[23528]: cluster 2024-09-21T05:26:24.855826+0000 mgr.a (mgr.14388) 18698 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:25 smithi049 bash[23528]: audit 2024-09-21T05:26:24.971078+0000 mgr.a (mgr.14388) 18699 : audit [DBG] from='client.401712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:27 smithi044 bash[22676]: cluster 2024-09-21T05:26:26.858761+0000 mgr.a (mgr.14388) 18700 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:27 smithi179 bash[23186]: cluster 2024-09-21T05:26:26.858761+0000 mgr.a (mgr.14388) 18700 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:27 smithi049 bash[23528]: cluster 2024-09-21T05:26:26.858761+0000 mgr.a (mgr.14388) 18700 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:29 smithi044 bash[22676]: cluster 2024-09-21T05:26:28.859549+0000 mgr.a (mgr.14388) 18701 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:29 smithi179 bash[23186]: cluster 2024-09-21T05:26:28.859549+0000 mgr.a (mgr.14388) 18701 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:29 smithi049 bash[23528]: cluster 2024-09-21T05:26:28.859549+0000 mgr.a (mgr.14388) 18701 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:30.420 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:31.199 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:31 smithi044 bash[22676]: audit 2024-09-21T05:26:30.753064+0000 mgr.a (mgr.14388) 18702 : audit [DBG] from='client.401787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:31 smithi044 bash[22676]: cluster 2024-09-21T05:26:30.861031+0000 mgr.a (mgr.14388) 18703 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:31 smithi179 bash[23186]: audit 2024-09-21T05:26:30.753064+0000 mgr.a (mgr.14388) 18702 : audit [DBG] from='client.401787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:31 smithi179 bash[23186]: cluster 2024-09-21T05:26:30.861031+0000 mgr.a (mgr.14388) 18703 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:31 smithi049 bash[23528]: audit 2024-09-21T05:26:30.753064+0000 mgr.a (mgr.14388) 18702 : audit [DBG] from='client.401787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:31 smithi049 bash[23528]: cluster 2024-09-21T05:26:30.861031+0000 mgr.a (mgr.14388) 18703 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:26:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:33 smithi044 bash[22676]: audit 2024-09-21T05:26:32.685336+0000 mon.a (mon.0) 14806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:33 smithi044 bash[22676]: audit 2024-09-21T05:26:32.695759+0000 mon.a (mon.0) 14807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:33 smithi044 bash[22676]: audit 2024-09-21T05:26:32.706933+0000 mon.a (mon.0) 14808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:33 smithi044 bash[22676]: cluster 2024-09-21T05:26:32.861916+0000 mgr.a (mgr.14388) 18704 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:26:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:33 smithi179 bash[23186]: audit 2024-09-21T05:26:32.685336+0000 mon.a (mon.0) 14806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:33 smithi179 bash[23186]: audit 2024-09-21T05:26:32.695759+0000 mon.a (mon.0) 14807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:33 smithi179 bash[23186]: audit 2024-09-21T05:26:32.706933+0000 mon.a (mon.0) 14808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:33 smithi179 bash[23186]: cluster 2024-09-21T05:26:32.861916+0000 mgr.a (mgr.14388) 18704 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:26:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:33 smithi049 bash[23528]: audit 2024-09-21T05:26:32.685336+0000 mon.a (mon.0) 14806 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:33 smithi049 bash[23528]: audit 2024-09-21T05:26:32.695759+0000 mon.a (mon.0) 14807 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:33 smithi049 bash[23528]: audit 2024-09-21T05:26:32.706933+0000 mon.a (mon.0) 14808 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:33 smithi049 bash[23528]: cluster 2024-09-21T05:26:32.861916+0000 mgr.a (mgr.14388) 18704 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:26:35.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:35 smithi044 bash[22676]: cluster 2024-09-21T05:26:34.862743+0000 mgr.a (mgr.14388) 18705 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:26:36.200 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:36.201 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:36.201 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:35 smithi179 bash[23186]: cluster 2024-09-21T05:26:34.862743+0000 mgr.a (mgr.14388) 18705 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:26:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:35 smithi049 bash[23528]: cluster 2024-09-21T05:26:34.862743+0000 mgr.a (mgr.14388) 18705 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:26:36.967 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:36.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:38.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:37 smithi044 bash[22676]: audit 2024-09-21T05:26:36.530846+0000 mgr.a (mgr.14388) 18706 : audit [DBG] from='client.401865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:37 smithi044 bash[22676]: cluster 2024-09-21T05:26:36.864542+0000 mgr.a (mgr.14388) 18707 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:37 smithi179 bash[23186]: audit 2024-09-21T05:26:36.530846+0000 mgr.a (mgr.14388) 18706 : audit [DBG] from='client.401865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:37 smithi179 bash[23186]: cluster 2024-09-21T05:26:36.864542+0000 mgr.a (mgr.14388) 18707 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:37 smithi049 bash[23528]: audit 2024-09-21T05:26:36.530846+0000 mgr.a (mgr.14388) 18706 : audit [DBG] from='client.401865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:37 smithi049 bash[23528]: cluster 2024-09-21T05:26:36.864542+0000 mgr.a (mgr.14388) 18707 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:39 smithi044 bash[22676]: cluster 2024-09-21T05:26:38.865369+0000 mgr.a (mgr.14388) 18708 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:39 smithi179 bash[23186]: cluster 2024-09-21T05:26:38.865369+0000 mgr.a (mgr.14388) 18708 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:39 smithi049 bash[23528]: cluster 2024-09-21T05:26:38.865369+0000 mgr.a (mgr.14388) 18708 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:41.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:41.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:41.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:42.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:41 smithi044 bash[22676]: cluster 2024-09-21T05:26:40.866745+0000 mgr.a (mgr.14388) 18709 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:41 smithi179 bash[23186]: cluster 2024-09-21T05:26:40.866745+0000 mgr.a (mgr.14388) 18709 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:41 smithi049 bash[23528]: cluster 2024-09-21T05:26:40.866745+0000 mgr.a (mgr.14388) 18709 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:42.728 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:42.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:42.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:42.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:42.728 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: audit 2024-09-21T05:26:42.300217+0000 mgr.a (mgr.14388) 18710 : audit [DBG] from='client.401940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: audit 2024-09-21T05:26:42.505156+0000 mon.a (mon.0) 14809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: audit 2024-09-21T05:26:42.511712+0000 mon.a (mon.0) 14810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: audit 2024-09-21T05:26:42.516803+0000 mon.a (mon.0) 14811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: audit 2024-09-21T05:26:42.548096+0000 mon.a (mon.0) 14812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: audit 2024-09-21T05:26:42.553603+0000 mon.a (mon.0) 14813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: audit 2024-09-21T05:26:42.560085+0000 mon.a (mon.0) 14814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:43 smithi049 bash[23528]: cluster 2024-09-21T05:26:42.867701+0000 mgr.a (mgr.14388) 18711 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: audit 2024-09-21T05:26:42.300217+0000 mgr.a (mgr.14388) 18710 : audit [DBG] from='client.401940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: audit 2024-09-21T05:26:42.505156+0000 mon.a (mon.0) 14809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: audit 2024-09-21T05:26:42.511712+0000 mon.a (mon.0) 14810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: audit 2024-09-21T05:26:42.516803+0000 mon.a (mon.0) 14811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: audit 2024-09-21T05:26:42.548096+0000 mon.a (mon.0) 14812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: audit 2024-09-21T05:26:42.553603+0000 mon.a (mon.0) 14813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: audit 2024-09-21T05:26:42.560085+0000 mon.a (mon.0) 14814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:43 smithi044 bash[22676]: cluster 2024-09-21T05:26:42.867701+0000 mgr.a (mgr.14388) 18711 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: audit 2024-09-21T05:26:42.300217+0000 mgr.a (mgr.14388) 18710 : audit [DBG] from='client.401940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: audit 2024-09-21T05:26:42.505156+0000 mon.a (mon.0) 14809 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: audit 2024-09-21T05:26:42.511712+0000 mon.a (mon.0) 14810 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: audit 2024-09-21T05:26:42.516803+0000 mon.a (mon.0) 14811 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: audit 2024-09-21T05:26:42.548096+0000 mon.a (mon.0) 14812 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: audit 2024-09-21T05:26:42.553603+0000 mon.a (mon.0) 14813 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: audit 2024-09-21T05:26:42.560085+0000 mon.a (mon.0) 14814 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:44.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:43 smithi179 bash[23186]: cluster 2024-09-21T05:26:42.867701+0000 mgr.a (mgr.14388) 18711 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:46.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:45 smithi044 bash[22676]: cluster 2024-09-21T05:26:44.868565+0000 mgr.a (mgr.14388) 18712 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:45 smithi179 bash[23186]: cluster 2024-09-21T05:26:44.868565+0000 mgr.a (mgr.14388) 18712 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:45 smithi049 bash[23528]: cluster 2024-09-21T05:26:44.868565+0000 mgr.a (mgr.14388) 18712 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:47.729 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:47.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:47.730 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:47 smithi044 bash[22676]: cluster 2024-09-21T05:26:46.870839+0000 mgr.a (mgr.14388) 18713 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:47 smithi179 bash[23186]: cluster 2024-09-21T05:26:46.870839+0000 mgr.a (mgr.14388) 18713 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:47 smithi049 bash[23528]: cluster 2024-09-21T05:26:46.870839+0000 mgr.a (mgr.14388) 18713 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:48.488 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:48.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:48.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:48.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:48.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:49.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:48 smithi044 bash[22676]: audit 2024-09-21T05:26:48.059382+0000 mgr.a (mgr.14388) 18714 : audit [DBG] from='client.402015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:48 smithi179 bash[23186]: audit 2024-09-21T05:26:48.059382+0000 mgr.a (mgr.14388) 18714 : audit [DBG] from='client.402015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:48 smithi049 bash[23528]: audit 2024-09-21T05:26:48.059382+0000 mgr.a (mgr.14388) 18714 : audit [DBG] from='client.402015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:49 smithi044 bash[22676]: cluster 2024-09-21T05:26:48.871839+0000 mgr.a (mgr.14388) 18715 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:49 smithi179 bash[23186]: cluster 2024-09-21T05:26:48.871839+0000 mgr.a (mgr.14388) 18715 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:49 smithi049 bash[23528]: cluster 2024-09-21T05:26:48.871839+0000 mgr.a (mgr.14388) 18715 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:52.215 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:51 smithi179 bash[23186]: cluster 2024-09-21T05:26:50.874121+0000 mgr.a (mgr.14388) 18716 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:51 smithi044 bash[22676]: cluster 2024-09-21T05:26:50.874121+0000 mgr.a (mgr.14388) 18716 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:51 smithi049 bash[23528]: cluster 2024-09-21T05:26:50.874121+0000 mgr.a (mgr.14388) 18716 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:26:53.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:53.490 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:26:54.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:53 smithi044 bash[22676]: cluster 2024-09-21T05:26:52.874899+0000 mgr.a (mgr.14388) 18717 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:53 smithi044 bash[22676]: audit 2024-09-21T05:26:52.925878+0000 mon.a (mon.0) 14815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:53 smithi044 bash[22676]: audit 2024-09-21T05:26:52.935179+0000 mon.a (mon.0) 14816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:53 smithi044 bash[22676]: audit 2024-09-21T05:26:52.946167+0000 mon.a (mon.0) 14817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:53 smithi044 bash[22676]: audit 2024-09-21T05:26:53.395066+0000 mon.a (mon.0) 14818 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:53 smithi179 bash[23186]: cluster 2024-09-21T05:26:52.874899+0000 mgr.a (mgr.14388) 18717 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:53 smithi179 bash[23186]: audit 2024-09-21T05:26:52.925878+0000 mon.a (mon.0) 14815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:53 smithi179 bash[23186]: audit 2024-09-21T05:26:52.935179+0000 mon.a (mon.0) 14816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:53 smithi179 bash[23186]: audit 2024-09-21T05:26:52.946167+0000 mon.a (mon.0) 14817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:53 smithi179 bash[23186]: audit 2024-09-21T05:26:53.395066+0000 mon.a (mon.0) 14818 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:54.271 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:26:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:26:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:26:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:26:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:26:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:53 smithi049 bash[23528]: cluster 2024-09-21T05:26:52.874899+0000 mgr.a (mgr.14388) 18717 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:53 smithi049 bash[23528]: audit 2024-09-21T05:26:52.925878+0000 mon.a (mon.0) 14815 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:53 smithi049 bash[23528]: audit 2024-09-21T05:26:52.935179+0000 mon.a (mon.0) 14816 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:53 smithi049 bash[23528]: audit 2024-09-21T05:26:52.946167+0000 mon.a (mon.0) 14817 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:53 smithi049 bash[23528]: audit 2024-09-21T05:26:53.395066+0000 mon.a (mon.0) 14818 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:54.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:26:54 smithi044 bash[22930]: debug 2024-09-21T05:26:54.980+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:26:54.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:26:54 smithi044 bash[22930]: debug 2024-09-21T05:26:54.980+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:26:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:53.824475+0000 mgr.a (mgr.14388) 18718 : audit [DBG] from='client.402093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.006150+0000 mon.a (mon.0) 14819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.012062+0000 mon.a (mon.0) 14820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.018202+0000 mon.a (mon.0) 14821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.027769+0000 mon.a (mon.0) 14822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.029192+0000 mon.a (mon.0) 14823 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.031589+0000 mon.a (mon.0) 14824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.037385+0000 mon.a (mon.0) 14825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.040421+0000 mon.a (mon.0) 14826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:26:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:55 smithi049 bash[23528]: audit 2024-09-21T05:26:54.042068+0000 mgr.a (mgr.14388) 18719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:26:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:53.824475+0000 mgr.a (mgr.14388) 18718 : audit [DBG] from='client.402093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.006150+0000 mon.a (mon.0) 14819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.012062+0000 mon.a (mon.0) 14820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.018202+0000 mon.a (mon.0) 14821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.027769+0000 mon.a (mon.0) 14822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.029192+0000 mon.a (mon.0) 14823 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.031589+0000 mon.a (mon.0) 14824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.037385+0000 mon.a (mon.0) 14825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.040421+0000 mon.a (mon.0) 14826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:26:55.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:55 smithi044 bash[22676]: audit 2024-09-21T05:26:54.042068+0000 mgr.a (mgr.14388) 18719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:53.824475+0000 mgr.a (mgr.14388) 18718 : audit [DBG] from='client.402093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.006150+0000 mon.a (mon.0) 14819 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.012062+0000 mon.a (mon.0) 14820 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.018202+0000 mon.a (mon.0) 14821 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.027769+0000 mon.a (mon.0) 14822 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.029192+0000 mon.a (mon.0) 14823 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.031589+0000 mon.a (mon.0) 14824 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.037385+0000 mon.a (mon.0) 14825 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:26:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.040421+0000 mon.a (mon.0) 14826 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:26:55.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:55 smithi179 bash[23186]: audit 2024-09-21T05:26:54.042068+0000 mgr.a (mgr.14388) 18719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:26:56.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:56 smithi044 bash[22676]: cluster 2024-09-21T05:26:54.875390+0000 mgr.a (mgr.14388) 18720 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:56.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:56 smithi044 bash[22676]: audit 2024-09-21T05:26:54.981551+0000 mgr.a (mgr.14388) 18721 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:26:56.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:56 smithi044 bash[22676]: cephadm 2024-09-21T05:26:54.982700+0000 mgr.a (mgr.14388) 18722 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:26:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:56 smithi179 bash[23186]: cluster 2024-09-21T05:26:54.875390+0000 mgr.a (mgr.14388) 18720 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:56 smithi179 bash[23186]: audit 2024-09-21T05:26:54.981551+0000 mgr.a (mgr.14388) 18721 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:26:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:56 smithi179 bash[23186]: cephadm 2024-09-21T05:26:54.982700+0000 mgr.a (mgr.14388) 18722 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:26:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:56 smithi049 bash[23528]: cluster 2024-09-21T05:26:54.875390+0000 mgr.a (mgr.14388) 18720 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:26:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:56 smithi049 bash[23528]: audit 2024-09-21T05:26:54.981551+0000 mgr.a (mgr.14388) 18721 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:26:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:56 smithi049 bash[23528]: cephadm 2024-09-21T05:26:54.982700+0000 mgr.a (mgr.14388) 18722 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:26:58.298 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:26:58 smithi044 bash[22676]: cluster 2024-09-21T05:26:56.877660+0000 mgr.a (mgr.14388) 18723 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:26:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:26:58 smithi049 bash[23528]: cluster 2024-09-21T05:26:56.877660+0000 mgr.a (mgr.14388) 18723 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:26:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:26:58 smithi179 bash[23186]: cluster 2024-09-21T05:26:56.877660+0000 mgr.a (mgr.14388) 18723 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:26:59.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:26:59.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:26:59.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:00.061 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:00.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:00.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:00.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:00.061 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:00 smithi049 bash[23528]: cluster 2024-09-21T05:26:58.878381+0000 mgr.a (mgr.14388) 18724 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:00 smithi044 bash[22676]: cluster 2024-09-21T05:26:58.878381+0000 mgr.a (mgr.14388) 18724 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:00 smithi179 bash[23186]: cluster 2024-09-21T05:26:58.878381+0000 mgr.a (mgr.14388) 18724 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:01 smithi049 bash[23528]: audit 2024-09-21T05:26:59.606935+0000 mgr.a (mgr.14388) 18725 : audit [DBG] from='client.402276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:01.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:01 smithi044 bash[22676]: audit 2024-09-21T05:26:59.606935+0000 mgr.a (mgr.14388) 18725 : audit [DBG] from='client.402276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:01 smithi179 bash[23186]: audit 2024-09-21T05:26:59.606935+0000 mgr.a (mgr.14388) 18725 : audit [DBG] from='client.402276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:02 smithi049 bash[23528]: cluster 2024-09-21T05:27:00.880800+0000 mgr.a (mgr.14388) 18726 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:02 smithi044 bash[22676]: cluster 2024-09-21T05:27:00.880800+0000 mgr.a (mgr.14388) 18726 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:02 smithi179 bash[23186]: cluster 2024-09-21T05:27:00.880800+0000 mgr.a (mgr.14388) 18726 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:03 smithi044 bash[22676]: audit 2024-09-21T05:27:02.724513+0000 mon.a (mon.0) 14827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:03 smithi044 bash[22676]: audit 2024-09-21T05:27:02.733149+0000 mon.a (mon.0) 14828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:03 smithi044 bash[22676]: audit 2024-09-21T05:27:02.741401+0000 mon.a (mon.0) 14829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:03 smithi044 bash[22676]: audit 2024-09-21T05:27:02.748032+0000 mon.a (mon.0) 14830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:03 smithi044 bash[22676]: audit 2024-09-21T05:27:02.754333+0000 mon.a (mon.0) 14831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:03 smithi044 bash[22676]: audit 2024-09-21T05:27:02.764467+0000 mon.a (mon.0) 14832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:03.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:03 smithi044 bash[22676]: cluster 2024-09-21T05:27:02.881647+0000 mgr.a (mgr.14388) 18727 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:03 smithi179 bash[23186]: audit 2024-09-21T05:27:02.724513+0000 mon.a (mon.0) 14827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:03 smithi179 bash[23186]: audit 2024-09-21T05:27:02.733149+0000 mon.a (mon.0) 14828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:03 smithi179 bash[23186]: audit 2024-09-21T05:27:02.741401+0000 mon.a (mon.0) 14829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:03 smithi179 bash[23186]: audit 2024-09-21T05:27:02.748032+0000 mon.a (mon.0) 14830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:03 smithi179 bash[23186]: audit 2024-09-21T05:27:02.754333+0000 mon.a (mon.0) 14831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:03 smithi179 bash[23186]: audit 2024-09-21T05:27:02.764467+0000 mon.a (mon.0) 14832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:03 smithi179 bash[23186]: cluster 2024-09-21T05:27:02.881647+0000 mgr.a (mgr.14388) 18727 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:03 smithi049 bash[23528]: audit 2024-09-21T05:27:02.724513+0000 mon.a (mon.0) 14827 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:03 smithi049 bash[23528]: audit 2024-09-21T05:27:02.733149+0000 mon.a (mon.0) 14828 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:03 smithi049 bash[23528]: audit 2024-09-21T05:27:02.741401+0000 mon.a (mon.0) 14829 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:03 smithi049 bash[23528]: audit 2024-09-21T05:27:02.748032+0000 mon.a (mon.0) 14830 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:03 smithi049 bash[23528]: audit 2024-09-21T05:27:02.754333+0000 mon.a (mon.0) 14831 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:03 smithi049 bash[23528]: audit 2024-09-21T05:27:02.764467+0000 mon.a (mon.0) 14832 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:04.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:03 smithi049 bash[23528]: cluster 2024-09-21T05:27:02.881647+0000 mgr.a (mgr.14388) 18727 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:05.062 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:05.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:05.063 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:05.849 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:05.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:05.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:05.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:05.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:05 smithi044 bash[22676]: cluster 2024-09-21T05:27:04.882403+0000 mgr.a (mgr.14388) 18728 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:05 smithi179 bash[23186]: cluster 2024-09-21T05:27:04.882403+0000 mgr.a (mgr.14388) 18728 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:05 smithi049 bash[23528]: cluster 2024-09-21T05:27:04.882403+0000 mgr.a (mgr.14388) 18728 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:06 smithi044 bash[22676]: audit 2024-09-21T05:27:05.399102+0000 mgr.a (mgr.14388) 18729 : audit [DBG] from='client.402351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:06 smithi179 bash[23186]: audit 2024-09-21T05:27:05.399102+0000 mgr.a (mgr.14388) 18729 : audit [DBG] from='client.402351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:06 smithi049 bash[23528]: audit 2024-09-21T05:27:05.399102+0000 mgr.a (mgr.14388) 18729 : audit [DBG] from='client.402351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:07 smithi044 bash[22676]: cluster 2024-09-21T05:27:06.885363+0000 mgr.a (mgr.14388) 18730 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:08.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:07 smithi179 bash[23186]: cluster 2024-09-21T05:27:06.885363+0000 mgr.a (mgr.14388) 18730 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:07 smithi049 bash[23528]: cluster 2024-09-21T05:27:06.885363+0000 mgr.a (mgr.14388) 18730 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:27:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:09 smithi044 bash[22676]: cluster 2024-09-21T05:27:08.886146+0000 mgr.a (mgr.14388) 18731 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:09 smithi179 bash[23186]: cluster 2024-09-21T05:27:08.886146+0000 mgr.a (mgr.14388) 18731 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:09 smithi049 bash[23528]: cluster 2024-09-21T05:27:08.886146+0000 mgr.a (mgr.14388) 18731 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:10.850 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:10.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:10.851 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:11.618 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:11.619 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:11 smithi044 bash[22676]: cluster 2024-09-21T05:27:10.888204+0000 mgr.a (mgr.14388) 18732 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:11 smithi179 bash[23186]: cluster 2024-09-21T05:27:10.888204+0000 mgr.a (mgr.14388) 18732 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:11 smithi049 bash[23528]: cluster 2024-09-21T05:27:10.888204+0000 mgr.a (mgr.14388) 18732 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:12 smithi044 bash[22676]: audit 2024-09-21T05:27:11.180813+0000 mgr.a (mgr.14388) 18733 : audit [DBG] from='client.402423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:12 smithi179 bash[23186]: audit 2024-09-21T05:27:11.180813+0000 mgr.a (mgr.14388) 18733 : audit [DBG] from='client.402423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:12 smithi049 bash[23528]: audit 2024-09-21T05:27:11.180813+0000 mgr.a (mgr.14388) 18733 : audit [DBG] from='client.402423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:13 smithi049 bash[23528]: cluster 2024-09-21T05:27:12.889130+0000 mgr.a (mgr.14388) 18734 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:13 smithi049 bash[23528]: audit 2024-09-21T05:27:13.135788+0000 mon.a (mon.0) 14833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:13 smithi049 bash[23528]: audit 2024-09-21T05:27:13.145842+0000 mon.a (mon.0) 14834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:13 smithi049 bash[23528]: audit 2024-09-21T05:27:13.157630+0000 mon.a (mon.0) 14835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:13 smithi179 bash[23186]: cluster 2024-09-21T05:27:12.889130+0000 mgr.a (mgr.14388) 18734 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:14.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:13 smithi179 bash[23186]: audit 2024-09-21T05:27:13.135788+0000 mon.a (mon.0) 14833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:13 smithi179 bash[23186]: audit 2024-09-21T05:27:13.145842+0000 mon.a (mon.0) 14834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.199 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:13 smithi179 bash[23186]: audit 2024-09-21T05:27:13.157630+0000 mon.a (mon.0) 14835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:13 smithi044 bash[22676]: cluster 2024-09-21T05:27:12.889130+0000 mgr.a (mgr.14388) 18734 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:13 smithi044 bash[22676]: audit 2024-09-21T05:27:13.135788+0000 mon.a (mon.0) 14833 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:13 smithi044 bash[22676]: audit 2024-09-21T05:27:13.145842+0000 mon.a (mon.0) 14834 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:13 smithi044 bash[22676]: audit 2024-09-21T05:27:13.157630+0000 mon.a (mon.0) 14835 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:15 smithi044 bash[22676]: cluster 2024-09-21T05:27:14.889913+0000 mgr.a (mgr.14388) 18735 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:27:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:15 smithi179 bash[23186]: cluster 2024-09-21T05:27:14.889913+0000 mgr.a (mgr.14388) 18735 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:27:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:15 smithi049 bash[23528]: cluster 2024-09-21T05:27:14.889913+0000 mgr.a (mgr.14388) 18735 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:27:16.620 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:17.378 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:17.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:17.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:17.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:17.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:17 smithi044 bash[22676]: cluster 2024-09-21T05:27:16.891000+0000 mgr.a (mgr.14388) 18736 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:17 smithi044 bash[22676]: audit 2024-09-21T05:27:16.952126+0000 mgr.a (mgr.14388) 18737 : audit [DBG] from='client.402498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:17 smithi179 bash[23186]: cluster 2024-09-21T05:27:16.891000+0000 mgr.a (mgr.14388) 18736 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:17 smithi179 bash[23186]: audit 2024-09-21T05:27:16.952126+0000 mgr.a (mgr.14388) 18737 : audit [DBG] from='client.402498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:17 smithi049 bash[23528]: cluster 2024-09-21T05:27:16.891000+0000 mgr.a (mgr.14388) 18736 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:17 smithi049 bash[23528]: audit 2024-09-21T05:27:16.952126+0000 mgr.a (mgr.14388) 18737 : audit [DBG] from='client.402498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:19 smithi044 bash[22676]: cluster 2024-09-21T05:27:18.891930+0000 mgr.a (mgr.14388) 18738 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:20.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:19 smithi179 bash[23186]: cluster 2024-09-21T05:27:18.891930+0000 mgr.a (mgr.14388) 18738 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:19 smithi049 bash[23528]: cluster 2024-09-21T05:27:18.891930+0000 mgr.a (mgr.14388) 18738 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:21 smithi044 bash[22676]: cluster 2024-09-21T05:27:20.894264+0000 mgr.a (mgr.14388) 18739 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:21 smithi179 bash[23186]: cluster 2024-09-21T05:27:20.894264+0000 mgr.a (mgr.14388) 18739 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:21 smithi049 bash[23528]: cluster 2024-09-21T05:27:20.894264+0000 mgr.a (mgr.14388) 18739 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:22.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:22.380 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:22.380 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:23.180 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:23.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:23.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:23.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:23.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:24.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: audit 2024-09-21T05:27:22.711942+0000 mgr.a (mgr.14388) 18740 : audit [DBG] from='client.402570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: audit 2024-09-21T05:27:22.887828+0000 mon.a (mon.0) 14836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: audit 2024-09-21T05:27:22.893593+0000 mon.a (mon.0) 14837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: cluster 2024-09-21T05:27:22.894791+0000 mgr.a (mgr.14388) 18741 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: audit 2024-09-21T05:27:22.898489+0000 mon.a (mon.0) 14838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: audit 2024-09-21T05:27:22.955833+0000 mon.a (mon.0) 14839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: audit 2024-09-21T05:27:22.968895+0000 mon.a (mon.0) 14840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:23 smithi049 bash[23528]: audit 2024-09-21T05:27:22.975195+0000 mon.a (mon.0) 14841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: audit 2024-09-21T05:27:22.711942+0000 mgr.a (mgr.14388) 18740 : audit [DBG] from='client.402570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: audit 2024-09-21T05:27:22.887828+0000 mon.a (mon.0) 14836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: audit 2024-09-21T05:27:22.893593+0000 mon.a (mon.0) 14837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: cluster 2024-09-21T05:27:22.894791+0000 mgr.a (mgr.14388) 18741 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: audit 2024-09-21T05:27:22.898489+0000 mon.a (mon.0) 14838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: audit 2024-09-21T05:27:22.955833+0000 mon.a (mon.0) 14839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: audit 2024-09-21T05:27:22.968895+0000 mon.a (mon.0) 14840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:23 smithi044 bash[22676]: audit 2024-09-21T05:27:22.975195+0000 mon.a (mon.0) 14841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: audit 2024-09-21T05:27:22.711942+0000 mgr.a (mgr.14388) 18740 : audit [DBG] from='client.402570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: audit 2024-09-21T05:27:22.887828+0000 mon.a (mon.0) 14836 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: audit 2024-09-21T05:27:22.893593+0000 mon.a (mon.0) 14837 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: cluster 2024-09-21T05:27:22.894791+0000 mgr.a (mgr.14388) 18741 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: audit 2024-09-21T05:27:22.898489+0000 mon.a (mon.0) 14838 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: audit 2024-09-21T05:27:22.955833+0000 mon.a (mon.0) 14839 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: audit 2024-09-21T05:27:22.968895+0000 mon.a (mon.0) 14840 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:23 smithi179 bash[23186]: audit 2024-09-21T05:27:22.975195+0000 mon.a (mon.0) 14841 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:25 smithi044 bash[22676]: cluster 2024-09-21T05:27:24.895681+0000 mgr.a (mgr.14388) 18742 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:26.249 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:25 smithi049 bash[23528]: cluster 2024-09-21T05:27:24.895681+0000 mgr.a (mgr.14388) 18742 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:25 smithi179 bash[23186]: cluster 2024-09-21T05:27:24.895681+0000 mgr.a (mgr.14388) 18742 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:28.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:28.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:27 smithi044 bash[22676]: cluster 2024-09-21T05:27:26.897936+0000 mgr.a (mgr.14388) 18743 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:27 smithi179 bash[23186]: cluster 2024-09-21T05:27:26.897936+0000 mgr.a (mgr.14388) 18743 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:27 smithi049 bash[23528]: cluster 2024-09-21T05:27:26.897936+0000 mgr.a (mgr.14388) 18743 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:28.978 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:28.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:28.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:28.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:28.978 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:29 smithi044 bash[22676]: audit 2024-09-21T05:27:28.517511+0000 mgr.a (mgr.14388) 18744 : audit [DBG] from='client.402648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:29 smithi044 bash[22676]: cluster 2024-09-21T05:27:28.898485+0000 mgr.a (mgr.14388) 18745 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:29 smithi179 bash[23186]: audit 2024-09-21T05:27:28.517511+0000 mgr.a (mgr.14388) 18744 : audit [DBG] from='client.402648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:30.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:29 smithi179 bash[23186]: cluster 2024-09-21T05:27:28.898485+0000 mgr.a (mgr.14388) 18745 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:29 smithi049 bash[23528]: audit 2024-09-21T05:27:28.517511+0000 mgr.a (mgr.14388) 18744 : audit [DBG] from='client.402648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:29 smithi049 bash[23528]: cluster 2024-09-21T05:27:28.898485+0000 mgr.a (mgr.14388) 18745 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:31 smithi044 bash[22676]: cluster 2024-09-21T05:27:30.900632+0000 mgr.a (mgr.14388) 18746 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:31 smithi179 bash[23186]: cluster 2024-09-21T05:27:30.900632+0000 mgr.a (mgr.14388) 18746 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:32.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:31 smithi049 bash[23528]: cluster 2024-09-21T05:27:30.900632+0000 mgr.a (mgr.14388) 18746 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:33.979 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:33.980 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:33.981 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:33 smithi044 bash[22676]: cluster 2024-09-21T05:27:32.901416+0000 mgr.a (mgr.14388) 18747 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:33 smithi044 bash[22676]: audit 2024-09-21T05:27:33.353100+0000 mon.a (mon.0) 14842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:33 smithi044 bash[22676]: audit 2024-09-21T05:27:33.361780+0000 mon.a (mon.0) 14843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:33 smithi044 bash[22676]: audit 2024-09-21T05:27:33.373876+0000 mon.a (mon.0) 14844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:33 smithi179 bash[23186]: cluster 2024-09-21T05:27:32.901416+0000 mgr.a (mgr.14388) 18747 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:33 smithi179 bash[23186]: audit 2024-09-21T05:27:33.353100+0000 mon.a (mon.0) 14842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:33 smithi179 bash[23186]: audit 2024-09-21T05:27:33.361780+0000 mon.a (mon.0) 14843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:33 smithi179 bash[23186]: audit 2024-09-21T05:27:33.373876+0000 mon.a (mon.0) 14844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:33 smithi049 bash[23528]: cluster 2024-09-21T05:27:32.901416+0000 mgr.a (mgr.14388) 18747 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:33 smithi049 bash[23528]: audit 2024-09-21T05:27:33.353100+0000 mon.a (mon.0) 14842 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:33 smithi049 bash[23528]: audit 2024-09-21T05:27:33.361780+0000 mon.a (mon.0) 14843 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:33 smithi049 bash[23528]: audit 2024-09-21T05:27:33.373876+0000 mon.a (mon.0) 14844 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:34.731 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:36.179 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:35 smithi044 bash[22676]: audit 2024-09-21T05:27:34.310294+0000 mgr.a (mgr.14388) 18748 : audit [DBG] from='client.402726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:36.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:35 smithi044 bash[22676]: cluster 2024-09-21T05:27:34.902371+0000 mgr.a (mgr.14388) 18749 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:36.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:35 smithi179 bash[23186]: audit 2024-09-21T05:27:34.310294+0000 mgr.a (mgr.14388) 18748 : audit [DBG] from='client.402726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:36.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:35 smithi179 bash[23186]: cluster 2024-09-21T05:27:34.902371+0000 mgr.a (mgr.14388) 18749 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:35 smithi049 bash[23528]: audit 2024-09-21T05:27:34.310294+0000 mgr.a (mgr.14388) 18748 : audit [DBG] from='client.402726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:35 smithi049 bash[23528]: cluster 2024-09-21T05:27:34.902371+0000 mgr.a (mgr.14388) 18749 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:37 smithi044 bash[22676]: cluster 2024-09-21T05:27:36.904855+0000 mgr.a (mgr.14388) 18750 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:37 smithi179 bash[23186]: cluster 2024-09-21T05:27:36.904855+0000 mgr.a (mgr.14388) 18750 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:37 smithi049 bash[23528]: cluster 2024-09-21T05:27:36.904855+0000 mgr.a (mgr.14388) 18750 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:39.733 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:39.733 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:39.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:40.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:39 smithi044 bash[22676]: cluster 2024-09-21T05:27:38.905857+0000 mgr.a (mgr.14388) 18751 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:39 smithi179 bash[23186]: cluster 2024-09-21T05:27:38.905857+0000 mgr.a (mgr.14388) 18751 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:39 smithi049 bash[23528]: cluster 2024-09-21T05:27:38.905857+0000 mgr.a (mgr.14388) 18751 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:40.496 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:40.496 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:40 smithi044 bash[22676]: audit 2024-09-21T05:27:40.070373+0000 mgr.a (mgr.14388) 18752 : audit [DBG] from='client.402804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:40 smithi179 bash[23186]: audit 2024-09-21T05:27:40.070373+0000 mgr.a (mgr.14388) 18752 : audit [DBG] from='client.402804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:40 smithi049 bash[23528]: audit 2024-09-21T05:27:40.070373+0000 mgr.a (mgr.14388) 18752 : audit [DBG] from='client.402804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:42.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:41 smithi044 bash[22676]: cluster 2024-09-21T05:27:40.909045+0000 mgr.a (mgr.14388) 18753 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:42.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:41 smithi179 bash[23186]: cluster 2024-09-21T05:27:40.909045+0000 mgr.a (mgr.14388) 18753 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:41 smithi049 bash[23528]: cluster 2024-09-21T05:27:40.909045+0000 mgr.a (mgr.14388) 18753 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:44.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:43 smithi049 bash[23528]: cluster 2024-09-21T05:27:42.909759+0000 mgr.a (mgr.14388) 18754 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:44.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:43 smithi049 bash[23528]: audit 2024-09-21T05:27:43.101903+0000 mon.a (mon.0) 14845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:43 smithi049 bash[23528]: audit 2024-09-21T05:27:43.110185+0000 mon.a (mon.0) 14846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:43 smithi049 bash[23528]: audit 2024-09-21T05:27:43.119289+0000 mon.a (mon.0) 14847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:43 smithi049 bash[23528]: audit 2024-09-21T05:27:43.162352+0000 mon.a (mon.0) 14848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:43 smithi049 bash[23528]: audit 2024-09-21T05:27:43.171011+0000 mon.a (mon.0) 14849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.197 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:43 smithi049 bash[23528]: audit 2024-09-21T05:27:43.182708+0000 mon.a (mon.0) 14850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:43 smithi044 bash[22676]: cluster 2024-09-21T05:27:42.909759+0000 mgr.a (mgr.14388) 18754 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:43 smithi044 bash[22676]: audit 2024-09-21T05:27:43.101903+0000 mon.a (mon.0) 14845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:43 smithi044 bash[22676]: audit 2024-09-21T05:27:43.110185+0000 mon.a (mon.0) 14846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:43 smithi044 bash[22676]: audit 2024-09-21T05:27:43.119289+0000 mon.a (mon.0) 14847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:43 smithi044 bash[22676]: audit 2024-09-21T05:27:43.162352+0000 mon.a (mon.0) 14848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:43 smithi044 bash[22676]: audit 2024-09-21T05:27:43.171011+0000 mon.a (mon.0) 14849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:43 smithi044 bash[22676]: audit 2024-09-21T05:27:43.182708+0000 mon.a (mon.0) 14850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:43 smithi179 bash[23186]: cluster 2024-09-21T05:27:42.909759+0000 mgr.a (mgr.14388) 18754 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:43 smithi179 bash[23186]: audit 2024-09-21T05:27:43.101903+0000 mon.a (mon.0) 14845 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:43 smithi179 bash[23186]: audit 2024-09-21T05:27:43.110185+0000 mon.a (mon.0) 14846 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:43 smithi179 bash[23186]: audit 2024-09-21T05:27:43.119289+0000 mon.a (mon.0) 14847 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:43 smithi179 bash[23186]: audit 2024-09-21T05:27:43.162352+0000 mon.a (mon.0) 14848 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:43 smithi179 bash[23186]: audit 2024-09-21T05:27:43.171011+0000 mon.a (mon.0) 14849 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:43 smithi179 bash[23186]: audit 2024-09-21T05:27:43.182708+0000 mon.a (mon.0) 14850 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:45.497 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:45.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:45.498 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:46.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:45 smithi049 bash[23528]: cluster 2024-09-21T05:27:44.910535+0000 mgr.a (mgr.14388) 18755 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:46.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:45 smithi044 bash[22676]: cluster 2024-09-21T05:27:44.910535+0000 mgr.a (mgr.14388) 18755 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:46.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:45 smithi179 bash[23186]: cluster 2024-09-21T05:27:44.910535+0000 mgr.a (mgr.14388) 18755 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:46.280 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:46.280 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:46.281 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:46 smithi044 bash[22676]: audit 2024-09-21T05:27:45.832822+0000 mgr.a (mgr.14388) 18756 : audit [DBG] from='client.402882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:46 smithi179 bash[23186]: audit 2024-09-21T05:27:45.832822+0000 mgr.a (mgr.14388) 18756 : audit [DBG] from='client.402882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:46 smithi049 bash[23528]: audit 2024-09-21T05:27:45.832822+0000 mgr.a (mgr.14388) 18756 : audit [DBG] from='client.402882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:47 smithi044 bash[22676]: cluster 2024-09-21T05:27:46.913525+0000 mgr.a (mgr.14388) 18757 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:47 smithi179 bash[23186]: cluster 2024-09-21T05:27:46.913525+0000 mgr.a (mgr.14388) 18757 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:47 smithi049 bash[23528]: cluster 2024-09-21T05:27:46.913525+0000 mgr.a (mgr.14388) 18757 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:49 smithi044 bash[22676]: cluster 2024-09-21T05:27:48.914310+0000 mgr.a (mgr.14388) 18758 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:49 smithi179 bash[23186]: cluster 2024-09-21T05:27:48.914310+0000 mgr.a (mgr.14388) 18758 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:49 smithi049 bash[23528]: cluster 2024-09-21T05:27:48.914310+0000 mgr.a (mgr.14388) 18758 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:27:51.282 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:51.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:51.283 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:52.059 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:52.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:52.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:52.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:52.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:52.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:51 smithi044 bash[22676]: cluster 2024-09-21T05:27:50.916287+0000 mgr.a (mgr.14388) 18759 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:52.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:51 smithi179 bash[23186]: cluster 2024-09-21T05:27:50.916287+0000 mgr.a (mgr.14388) 18759 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:51 smithi049 bash[23528]: cluster 2024-09-21T05:27:50.916287+0000 mgr.a (mgr.14388) 18759 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:52 smithi044 bash[22676]: audit 2024-09-21T05:27:51.617759+0000 mgr.a (mgr.14388) 18760 : audit [DBG] from='client.402960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:52 smithi179 bash[23186]: audit 2024-09-21T05:27:51.617759+0000 mgr.a (mgr.14388) 18760 : audit [DBG] from='client.402960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:52 smithi049 bash[23528]: audit 2024-09-21T05:27:51.617759+0000 mgr.a (mgr.14388) 18760 : audit [DBG] from='client.402960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:53 smithi179 bash[23186]: cluster 2024-09-21T05:27:52.917218+0000 mgr.a (mgr.14388) 18761 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:53 smithi179 bash[23186]: audit 2024-09-21T05:27:53.603001+0000 mon.a (mon.0) 14851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:53 smithi179 bash[23186]: audit 2024-09-21T05:27:53.611827+0000 mon.a (mon.0) 14852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:53 smithi179 bash[23186]: audit 2024-09-21T05:27:53.622376+0000 mon.a (mon.0) 14853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:53 smithi044 bash[22676]: cluster 2024-09-21T05:27:52.917218+0000 mgr.a (mgr.14388) 18761 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:53 smithi044 bash[22676]: audit 2024-09-21T05:27:53.603001+0000 mon.a (mon.0) 14851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:53 smithi044 bash[22676]: audit 2024-09-21T05:27:53.611827+0000 mon.a (mon.0) 14852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:53 smithi044 bash[22676]: audit 2024-09-21T05:27:53.622376+0000 mon.a (mon.0) 14853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:53 smithi049 bash[23528]: cluster 2024-09-21T05:27:52.917218+0000 mgr.a (mgr.14388) 18761 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:53 smithi049 bash[23528]: audit 2024-09-21T05:27:53.603001+0000 mon.a (mon.0) 14851 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:53 smithi049 bash[23528]: audit 2024-09-21T05:27:53.611827+0000 mon.a (mon.0) 14852 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:53 smithi049 bash[23528]: audit 2024-09-21T05:27:53.622376+0000 mon.a (mon.0) 14853 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: cluster 2024-09-21T05:27:54.918031+0000 mgr.a (mgr.14388) 18762 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: audit 2024-09-21T05:27:55.034673+0000 mon.a (mon.0) 14854 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: audit 2024-09-21T05:27:55.576079+0000 mon.a (mon.0) 14855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: audit 2024-09-21T05:27:55.585773+0000 mon.a (mon.0) 14856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: audit 2024-09-21T05:27:55.588041+0000 mon.a (mon.0) 14857 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: audit 2024-09-21T05:27:55.590066+0000 mon.a (mon.0) 14858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:56.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: audit 2024-09-21T05:27:55.600443+0000 mon.a (mon.0) 14859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:55 smithi179 bash[23186]: audit 2024-09-21T05:27:55.606695+0000 mon.a (mon.0) 14860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:27:56.280 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: cluster 2024-09-21T05:27:54.918031+0000 mgr.a (mgr.14388) 18762 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:56.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: audit 2024-09-21T05:27:55.034673+0000 mon.a (mon.0) 14854 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:56.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: audit 2024-09-21T05:27:55.576079+0000 mon.a (mon.0) 14855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: audit 2024-09-21T05:27:55.585773+0000 mon.a (mon.0) 14856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: audit 2024-09-21T05:27:55.588041+0000 mon.a (mon.0) 14857 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:56.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: audit 2024-09-21T05:27:55.590066+0000 mon.a (mon.0) 14858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:56.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: audit 2024-09-21T05:27:55.600443+0000 mon.a (mon.0) 14859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.281 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:55 smithi044 bash[22676]: audit 2024-09-21T05:27:55.606695+0000 mon.a (mon.0) 14860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:27:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: cluster 2024-09-21T05:27:54.918031+0000 mgr.a (mgr.14388) 18762 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: audit 2024-09-21T05:27:55.034673+0000 mon.a (mon.0) 14854 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: audit 2024-09-21T05:27:55.576079+0000 mon.a (mon.0) 14855 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: audit 2024-09-21T05:27:55.585773+0000 mon.a (mon.0) 14856 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: audit 2024-09-21T05:27:55.588041+0000 mon.a (mon.0) 14857 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: audit 2024-09-21T05:27:55.590066+0000 mon.a (mon.0) 14858 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: audit 2024-09-21T05:27:55.600443+0000 mon.a (mon.0) 14859 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:27:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:55 smithi049 bash[23528]: audit 2024-09-21T05:27:55.606695+0000 mon.a (mon.0) 14860 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:27:56.596 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:27:56 smithi044 bash[22930]: debug 2024-09-21T05:27:56.395+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:27:56.596 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:27:56 smithi044 bash[22930]: debug 2024-09-21T05:27:56.395+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:27:57.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:27:57.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:27:57.062 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:27:57.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:57 smithi179 bash[23186]: audit 2024-09-21T05:27:55.609159+0000 mgr.a (mgr.14388) 18763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:27:57.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:57 smithi044 bash[22676]: audit 2024-09-21T05:27:55.609159+0000 mgr.a (mgr.14388) 18763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:27:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:57 smithi049 bash[23528]: audit 2024-09-21T05:27:55.609159+0000 mgr.a (mgr.14388) 18763 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:27:57.836 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:27:57.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:27:57.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:27:57.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:27:57.836 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:27:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:58 smithi179 bash[23186]: audit 2024-09-21T05:27:56.398517+0000 mgr.a (mgr.14388) 18764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:27:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:58 smithi179 bash[23186]: cephadm 2024-09-21T05:27:56.399581+0000 mgr.a (mgr.14388) 18765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:27:58.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:58 smithi179 bash[23186]: cluster 2024-09-21T05:27:56.920991+0000 mgr.a (mgr.14388) 18766 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:58.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:58 smithi044 bash[22676]: audit 2024-09-21T05:27:56.398517+0000 mgr.a (mgr.14388) 18764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:27:58.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:58 smithi044 bash[22676]: cephadm 2024-09-21T05:27:56.399581+0000 mgr.a (mgr.14388) 18765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:27:58.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:58 smithi044 bash[22676]: cluster 2024-09-21T05:27:56.920991+0000 mgr.a (mgr.14388) 18766 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:58 smithi049 bash[23528]: audit 2024-09-21T05:27:56.398517+0000 mgr.a (mgr.14388) 18764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:27:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:58 smithi049 bash[23528]: cephadm 2024-09-21T05:27:56.399581+0000 mgr.a (mgr.14388) 18765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:27:58.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:58 smithi049 bash[23528]: cluster 2024-09-21T05:27:56.920991+0000 mgr.a (mgr.14388) 18766 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:27:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:27:59 smithi044 bash[22676]: audit 2024-09-21T05:27:57.390491+0000 mgr.a (mgr.14388) 18767 : audit [DBG] from='client.403146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:27:59 smithi049 bash[23528]: audit 2024-09-21T05:27:57.390491+0000 mgr.a (mgr.14388) 18767 : audit [DBG] from='client.403146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:27:59 smithi179 bash[23186]: audit 2024-09-21T05:27:57.390491+0000 mgr.a (mgr.14388) 18767 : audit [DBG] from='client.403146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:00.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:00 smithi049 bash[23528]: cluster 2024-09-21T05:27:58.921610+0000 mgr.a (mgr.14388) 18768 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:00 smithi044 bash[22676]: cluster 2024-09-21T05:27:58.921610+0000 mgr.a (mgr.14388) 18768 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:00 smithi179 bash[23186]: cluster 2024-09-21T05:27:58.921610+0000 mgr.a (mgr.14388) 18768 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:02 smithi049 bash[23528]: cluster 2024-09-21T05:28:00.923990+0000 mgr.a (mgr.14388) 18769 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:02 smithi044 bash[22676]: cluster 2024-09-21T05:28:00.923990+0000 mgr.a (mgr.14388) 18769 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:02 smithi179 bash[23186]: cluster 2024-09-21T05:28:00.923990+0000 mgr.a (mgr.14388) 18769 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:02.837 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:03.622 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:03.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:03.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:03.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:03.622 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:04 smithi049 bash[23528]: cluster 2024-09-21T05:28:02.924620+0000 mgr.a (mgr.14388) 18770 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:04 smithi049 bash[23528]: audit 2024-09-21T05:28:03.297902+0000 mon.a (mon.0) 14861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:04 smithi049 bash[23528]: audit 2024-09-21T05:28:03.303636+0000 mon.a (mon.0) 14862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:04 smithi049 bash[23528]: audit 2024-09-21T05:28:03.310112+0000 mon.a (mon.0) 14863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:04 smithi049 bash[23528]: audit 2024-09-21T05:28:03.373598+0000 mon.a (mon.0) 14864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:04 smithi049 bash[23528]: audit 2024-09-21T05:28:03.380999+0000 mon.a (mon.0) 14865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:04 smithi049 bash[23528]: audit 2024-09-21T05:28:03.388379+0000 mon.a (mon.0) 14866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:04 smithi044 bash[22676]: cluster 2024-09-21T05:28:02.924620+0000 mgr.a (mgr.14388) 18770 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:04 smithi044 bash[22676]: audit 2024-09-21T05:28:03.297902+0000 mon.a (mon.0) 14861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:04 smithi044 bash[22676]: audit 2024-09-21T05:28:03.303636+0000 mon.a (mon.0) 14862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:04 smithi044 bash[22676]: audit 2024-09-21T05:28:03.310112+0000 mon.a (mon.0) 14863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:04 smithi044 bash[22676]: audit 2024-09-21T05:28:03.373598+0000 mon.a (mon.0) 14864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:04 smithi044 bash[22676]: audit 2024-09-21T05:28:03.380999+0000 mon.a (mon.0) 14865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:04 smithi044 bash[22676]: audit 2024-09-21T05:28:03.388379+0000 mon.a (mon.0) 14866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:04 smithi179 bash[23186]: cluster 2024-09-21T05:28:02.924620+0000 mgr.a (mgr.14388) 18770 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:04 smithi179 bash[23186]: audit 2024-09-21T05:28:03.297902+0000 mon.a (mon.0) 14861 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:04 smithi179 bash[23186]: audit 2024-09-21T05:28:03.303636+0000 mon.a (mon.0) 14862 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:04 smithi179 bash[23186]: audit 2024-09-21T05:28:03.310112+0000 mon.a (mon.0) 14863 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:04 smithi179 bash[23186]: audit 2024-09-21T05:28:03.373598+0000 mon.a (mon.0) 14864 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:04 smithi179 bash[23186]: audit 2024-09-21T05:28:03.380999+0000 mon.a (mon.0) 14865 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:04 smithi179 bash[23186]: audit 2024-09-21T05:28:03.388379+0000 mon.a (mon.0) 14866 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:05 smithi049 bash[23528]: audit 2024-09-21T05:28:03.168885+0000 mgr.a (mgr.14388) 18771 : audit [DBG] from='client.403218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:05 smithi044 bash[22676]: audit 2024-09-21T05:28:03.168885+0000 mgr.a (mgr.14388) 18771 : audit [DBG] from='client.403218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:05 smithi179 bash[23186]: audit 2024-09-21T05:28:03.168885+0000 mgr.a (mgr.14388) 18771 : audit [DBG] from='client.403218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:06 smithi049 bash[23528]: cluster 2024-09-21T05:28:04.925695+0000 mgr.a (mgr.14388) 18772 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:06 smithi044 bash[22676]: cluster 2024-09-21T05:28:04.925695+0000 mgr.a (mgr.14388) 18772 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:06 smithi179 bash[23186]: cluster 2024-09-21T05:28:04.925695+0000 mgr.a (mgr.14388) 18772 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:08 smithi049 bash[23528]: cluster 2024-09-21T05:28:06.928149+0000 mgr.a (mgr.14388) 18773 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:08 smithi044 bash[22676]: cluster 2024-09-21T05:28:06.928149+0000 mgr.a (mgr.14388) 18773 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:08 smithi179 bash[23186]: cluster 2024-09-21T05:28:06.928149+0000 mgr.a (mgr.14388) 18773 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:08.623 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:08.624 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:09.388 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:09.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:09.388 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:09.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:09.389 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:10 smithi049 bash[23528]: cluster 2024-09-21T05:28:08.929059+0000 mgr.a (mgr.14388) 18774 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:10 smithi049 bash[23528]: audit 2024-09-21T05:28:08.954441+0000 mgr.a (mgr.14388) 18775 : audit [DBG] from='client.403296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:10 smithi044 bash[22676]: cluster 2024-09-21T05:28:08.929059+0000 mgr.a (mgr.14388) 18774 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:10 smithi044 bash[22676]: audit 2024-09-21T05:28:08.954441+0000 mgr.a (mgr.14388) 18775 : audit [DBG] from='client.403296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:10 smithi179 bash[23186]: cluster 2024-09-21T05:28:08.929059+0000 mgr.a (mgr.14388) 18774 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:10 smithi179 bash[23186]: audit 2024-09-21T05:28:08.954441+0000 mgr.a (mgr.14388) 18775 : audit [DBG] from='client.403296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:12 smithi049 bash[23528]: cluster 2024-09-21T05:28:10.931426+0000 mgr.a (mgr.14388) 18776 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:12 smithi044 bash[22676]: cluster 2024-09-21T05:28:10.931426+0000 mgr.a (mgr.14388) 18776 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:12 smithi179 bash[23186]: cluster 2024-09-21T05:28:10.931426+0000 mgr.a (mgr.14388) 18776 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:28:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:14 smithi179 bash[23186]: cluster 2024-09-21T05:28:12.932189+0000 mgr.a (mgr.14388) 18777 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:14 smithi179 bash[23186]: audit 2024-09-21T05:28:13.839186+0000 mon.a (mon.0) 14867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:14 smithi179 bash[23186]: audit 2024-09-21T05:28:13.848308+0000 mon.a (mon.0) 14868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:14 smithi179 bash[23186]: audit 2024-09-21T05:28:13.859070+0000 mon.a (mon.0) 14869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:14 smithi049 bash[23528]: cluster 2024-09-21T05:28:12.932189+0000 mgr.a (mgr.14388) 18777 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:14 smithi049 bash[23528]: audit 2024-09-21T05:28:13.839186+0000 mon.a (mon.0) 14867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:14 smithi049 bash[23528]: audit 2024-09-21T05:28:13.848308+0000 mon.a (mon.0) 14868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:14 smithi049 bash[23528]: audit 2024-09-21T05:28:13.859070+0000 mon.a (mon.0) 14869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:14.391 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:14.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:14 smithi044 bash[22676]: cluster 2024-09-21T05:28:12.932189+0000 mgr.a (mgr.14388) 18777 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:14 smithi044 bash[22676]: audit 2024-09-21T05:28:13.839186+0000 mon.a (mon.0) 14867 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:14 smithi044 bash[22676]: audit 2024-09-21T05:28:13.848308+0000 mon.a (mon.0) 14868 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:14 smithi044 bash[22676]: audit 2024-09-21T05:28:13.859070+0000 mon.a (mon.0) 14869 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:15.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:15.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:15.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:15.161 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:16 smithi179 bash[23186]: audit 2024-09-21T05:28:14.718836+0000 mgr.a (mgr.14388) 18778 : audit [DBG] from='client.403374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:16 smithi179 bash[23186]: cluster 2024-09-21T05:28:14.932674+0000 mgr.a (mgr.14388) 18779 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:16 smithi044 bash[22676]: audit 2024-09-21T05:28:14.718836+0000 mgr.a (mgr.14388) 18778 : audit [DBG] from='client.403374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:16 smithi044 bash[22676]: cluster 2024-09-21T05:28:14.932674+0000 mgr.a (mgr.14388) 18779 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:16 smithi049 bash[23528]: audit 2024-09-21T05:28:14.718836+0000 mgr.a (mgr.14388) 18778 : audit [DBG] from='client.403374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:16 smithi049 bash[23528]: cluster 2024-09-21T05:28:14.932674+0000 mgr.a (mgr.14388) 18779 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:18.340 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:18 smithi044 bash[22676]: cluster 2024-09-21T05:28:16.935071+0000 mgr.a (mgr.14388) 18780 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:28:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:18 smithi179 bash[23186]: cluster 2024-09-21T05:28:16.935071+0000 mgr.a (mgr.14388) 18780 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:28:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:18 smithi049 bash[23528]: cluster 2024-09-21T05:28:16.935071+0000 mgr.a (mgr.14388) 18780 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:28:20.162 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:20.163 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:20.163 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:20 smithi044 bash[22676]: cluster 2024-09-21T05:28:18.935619+0000 mgr.a (mgr.14388) 18781 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:28:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:20 smithi179 bash[23186]: cluster 2024-09-21T05:28:18.935619+0000 mgr.a (mgr.14388) 18781 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:28:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:20 smithi049 bash[23528]: cluster 2024-09-21T05:28:18.935619+0000 mgr.a (mgr.14388) 18781 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:28:20.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:20.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:20.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:20.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:20.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:22 smithi044 bash[22676]: audit 2024-09-21T05:28:20.501615+0000 mgr.a (mgr.14388) 18782 : audit [DBG] from='client.403452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:22 smithi044 bash[22676]: cluster 2024-09-21T05:28:20.936864+0000 mgr.a (mgr.14388) 18783 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:22 smithi179 bash[23186]: audit 2024-09-21T05:28:20.501615+0000 mgr.a (mgr.14388) 18782 : audit [DBG] from='client.403452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:22 smithi179 bash[23186]: cluster 2024-09-21T05:28:20.936864+0000 mgr.a (mgr.14388) 18783 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:22 smithi049 bash[23528]: audit 2024-09-21T05:28:20.501615+0000 mgr.a (mgr.14388) 18782 : audit [DBG] from='client.403452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:22 smithi049 bash[23528]: cluster 2024-09-21T05:28:20.936864+0000 mgr.a (mgr.14388) 18783 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:24 smithi044 bash[22676]: cluster 2024-09-21T05:28:22.937605+0000 mgr.a (mgr.14388) 18784 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:24 smithi044 bash[22676]: audit 2024-09-21T05:28:23.517796+0000 mon.a (mon.0) 14870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:24 smithi044 bash[22676]: audit 2024-09-21T05:28:23.526135+0000 mon.a (mon.0) 14871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:24 smithi044 bash[22676]: audit 2024-09-21T05:28:23.536544+0000 mon.a (mon.0) 14872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:24 smithi044 bash[22676]: audit 2024-09-21T05:28:23.599340+0000 mon.a (mon.0) 14873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:24 smithi044 bash[22676]: audit 2024-09-21T05:28:23.608317+0000 mon.a (mon.0) 14874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:24 smithi044 bash[22676]: audit 2024-09-21T05:28:23.619073+0000 mon.a (mon.0) 14875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:24 smithi179 bash[23186]: cluster 2024-09-21T05:28:22.937605+0000 mgr.a (mgr.14388) 18784 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:24 smithi179 bash[23186]: audit 2024-09-21T05:28:23.517796+0000 mon.a (mon.0) 14870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:24 smithi179 bash[23186]: audit 2024-09-21T05:28:23.526135+0000 mon.a (mon.0) 14871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:24 smithi179 bash[23186]: audit 2024-09-21T05:28:23.536544+0000 mon.a (mon.0) 14872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:24 smithi179 bash[23186]: audit 2024-09-21T05:28:23.599340+0000 mon.a (mon.0) 14873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:24 smithi179 bash[23186]: audit 2024-09-21T05:28:23.608317+0000 mon.a (mon.0) 14874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:24 smithi179 bash[23186]: audit 2024-09-21T05:28:23.619073+0000 mon.a (mon.0) 14875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:24 smithi049 bash[23528]: cluster 2024-09-21T05:28:22.937605+0000 mgr.a (mgr.14388) 18784 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:24 smithi049 bash[23528]: audit 2024-09-21T05:28:23.517796+0000 mon.a (mon.0) 14870 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:24 smithi049 bash[23528]: audit 2024-09-21T05:28:23.526135+0000 mon.a (mon.0) 14871 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:24 smithi049 bash[23528]: audit 2024-09-21T05:28:23.536544+0000 mon.a (mon.0) 14872 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:24 smithi049 bash[23528]: audit 2024-09-21T05:28:23.599340+0000 mon.a (mon.0) 14873 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:24 smithi049 bash[23528]: audit 2024-09-21T05:28:23.608317+0000 mon.a (mon.0) 14874 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:24.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:24 smithi049 bash[23528]: audit 2024-09-21T05:28:23.619073+0000 mon.a (mon.0) 14875 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:26 smithi049 bash[23528]: cluster 2024-09-21T05:28:24.938507+0000 mgr.a (mgr.14388) 18785 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:26 smithi044 bash[22676]: cluster 2024-09-21T05:28:24.938507+0000 mgr.a (mgr.14388) 18785 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:26 smithi179 bash[23186]: cluster 2024-09-21T05:28:24.938507+0000 mgr.a (mgr.14388) 18785 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:26.740 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:26.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:26.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:26.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:26.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:28 smithi044 bash[22676]: audit 2024-09-21T05:28:26.288907+0000 mgr.a (mgr.14388) 18786 : audit [DBG] from='client.403530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:28 smithi044 bash[22676]: cluster 2024-09-21T05:28:26.941454+0000 mgr.a (mgr.14388) 18787 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:28 smithi179 bash[23186]: audit 2024-09-21T05:28:26.288907+0000 mgr.a (mgr.14388) 18786 : audit [DBG] from='client.403530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:28 smithi179 bash[23186]: cluster 2024-09-21T05:28:26.941454+0000 mgr.a (mgr.14388) 18787 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:28 smithi049 bash[23528]: audit 2024-09-21T05:28:26.288907+0000 mgr.a (mgr.14388) 18786 : audit [DBG] from='client.403530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:28 smithi049 bash[23528]: cluster 2024-09-21T05:28:26.941454+0000 mgr.a (mgr.14388) 18787 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:30 smithi044 bash[22676]: cluster 2024-09-21T05:28:28.942392+0000 mgr.a (mgr.14388) 18788 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:28:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:30 smithi179 bash[23186]: cluster 2024-09-21T05:28:28.942392+0000 mgr.a (mgr.14388) 18788 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:28:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:30 smithi049 bash[23528]: cluster 2024-09-21T05:28:28.942392+0000 mgr.a (mgr.14388) 18788 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:28:31.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:32.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:32 smithi044 bash[22676]: cluster 2024-09-21T05:28:30.944583+0000 mgr.a (mgr.14388) 18789 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:28:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:32 smithi179 bash[23186]: cluster 2024-09-21T05:28:30.944583+0000 mgr.a (mgr.14388) 18789 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:28:32.533 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:32.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:32.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:32.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:32.533 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:32 smithi049 bash[23528]: cluster 2024-09-21T05:28:30.944583+0000 mgr.a (mgr.14388) 18789 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:28:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:33 smithi044 bash[22676]: audit 2024-09-21T05:28:32.079511+0000 mgr.a (mgr.14388) 18790 : audit [DBG] from='client.403608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:33 smithi179 bash[23186]: audit 2024-09-21T05:28:32.079511+0000 mgr.a (mgr.14388) 18790 : audit [DBG] from='client.403608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:33 smithi049 bash[23528]: audit 2024-09-21T05:28:32.079511+0000 mgr.a (mgr.14388) 18790 : audit [DBG] from='client.403608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:34 smithi044 bash[22676]: cluster 2024-09-21T05:28:32.945567+0000 mgr.a (mgr.14388) 18791 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:34 smithi044 bash[22676]: audit 2024-09-21T05:28:34.075192+0000 mon.a (mon.0) 14876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:34 smithi044 bash[22676]: audit 2024-09-21T05:28:34.084352+0000 mon.a (mon.0) 14877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:34 smithi044 bash[22676]: audit 2024-09-21T05:28:34.095075+0000 mon.a (mon.0) 14878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:34 smithi179 bash[23186]: cluster 2024-09-21T05:28:32.945567+0000 mgr.a (mgr.14388) 18791 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:34 smithi179 bash[23186]: audit 2024-09-21T05:28:34.075192+0000 mon.a (mon.0) 14876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:34 smithi179 bash[23186]: audit 2024-09-21T05:28:34.084352+0000 mon.a (mon.0) 14877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:34 smithi179 bash[23186]: audit 2024-09-21T05:28:34.095075+0000 mon.a (mon.0) 14878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:34 smithi049 bash[23528]: cluster 2024-09-21T05:28:32.945567+0000 mgr.a (mgr.14388) 18791 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:34 smithi049 bash[23528]: audit 2024-09-21T05:28:34.075192+0000 mon.a (mon.0) 14876 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:34 smithi049 bash[23528]: audit 2024-09-21T05:28:34.084352+0000 mon.a (mon.0) 14877 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:34 smithi049 bash[23528]: audit 2024-09-21T05:28:34.095075+0000 mon.a (mon.0) 14878 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:35.454 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:35 smithi179 bash[23186]: cluster 2024-09-21T05:28:34.946330+0000 mgr.a (mgr.14388) 18792 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:35 smithi044 bash[22676]: cluster 2024-09-21T05:28:34.946330+0000 mgr.a (mgr.14388) 18792 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:35 smithi049 bash[23528]: cluster 2024-09-21T05:28:34.946330+0000 mgr.a (mgr.14388) 18792 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:38 smithi049 bash[23528]: cluster 2024-09-21T05:28:36.947665+0000 mgr.a (mgr.14388) 18793 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:38.318 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:38.318 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:38.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:38.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:38.319 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:38.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:38 smithi044 bash[22676]: cluster 2024-09-21T05:28:36.947665+0000 mgr.a (mgr.14388) 18793 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:38 smithi179 bash[23186]: cluster 2024-09-21T05:28:36.947665+0000 mgr.a (mgr.14388) 18793 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:39 smithi049 bash[23528]: audit 2024-09-21T05:28:37.874979+0000 mgr.a (mgr.14388) 18794 : audit [DBG] from='client.403686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:39.320 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:39 smithi044 bash[22676]: audit 2024-09-21T05:28:37.874979+0000 mgr.a (mgr.14388) 18794 : audit [DBG] from='client.403686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:39.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:39 smithi179 bash[23186]: audit 2024-09-21T05:28:37.874979+0000 mgr.a (mgr.14388) 18794 : audit [DBG] from='client.403686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:40 smithi049 bash[23528]: cluster 2024-09-21T05:28:38.948807+0000 mgr.a (mgr.14388) 18795 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:40.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:40 smithi044 bash[22676]: cluster 2024-09-21T05:28:38.948807+0000 mgr.a (mgr.14388) 18795 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:40 smithi179 bash[23186]: cluster 2024-09-21T05:28:38.948807+0000 mgr.a (mgr.14388) 18795 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:42 smithi049 bash[23528]: cluster 2024-09-21T05:28:40.951094+0000 mgr.a (mgr.14388) 18796 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:42.351 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:42 smithi179 bash[23186]: cluster 2024-09-21T05:28:40.951094+0000 mgr.a (mgr.14388) 18796 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:42 smithi044 bash[22676]: cluster 2024-09-21T05:28:40.951094+0000 mgr.a (mgr.14388) 18796 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:44.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:44.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:44.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:44.103 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:44.104 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:44 smithi179 bash[23186]: cluster 2024-09-21T05:28:42.951933+0000 mgr.a (mgr.14388) 18797 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:44 smithi179 bash[23186]: audit 2024-09-21T05:28:43.731506+0000 mon.a (mon.0) 14879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:44 smithi179 bash[23186]: audit 2024-09-21T05:28:43.737522+0000 mon.a (mon.0) 14880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:44 smithi179 bash[23186]: audit 2024-09-21T05:28:43.743481+0000 mon.a (mon.0) 14881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:44 smithi179 bash[23186]: audit 2024-09-21T05:28:43.817515+0000 mon.a (mon.0) 14882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:44 smithi179 bash[23186]: audit 2024-09-21T05:28:43.823653+0000 mon.a (mon.0) 14883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:44 smithi179 bash[23186]: audit 2024-09-21T05:28:43.829428+0000 mon.a (mon.0) 14884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:44 smithi049 bash[23528]: cluster 2024-09-21T05:28:42.951933+0000 mgr.a (mgr.14388) 18797 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:44 smithi049 bash[23528]: audit 2024-09-21T05:28:43.731506+0000 mon.a (mon.0) 14879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:44 smithi049 bash[23528]: audit 2024-09-21T05:28:43.737522+0000 mon.a (mon.0) 14880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:44 smithi049 bash[23528]: audit 2024-09-21T05:28:43.743481+0000 mon.a (mon.0) 14881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:44 smithi049 bash[23528]: audit 2024-09-21T05:28:43.817515+0000 mon.a (mon.0) 14882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:44 smithi049 bash[23528]: audit 2024-09-21T05:28:43.823653+0000 mon.a (mon.0) 14883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:44 smithi049 bash[23528]: audit 2024-09-21T05:28:43.829428+0000 mon.a (mon.0) 14884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:44 smithi044 bash[22676]: cluster 2024-09-21T05:28:42.951933+0000 mgr.a (mgr.14388) 18797 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:44.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:44 smithi044 bash[22676]: audit 2024-09-21T05:28:43.731506+0000 mon.a (mon.0) 14879 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:44 smithi044 bash[22676]: audit 2024-09-21T05:28:43.737522+0000 mon.a (mon.0) 14880 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:44 smithi044 bash[22676]: audit 2024-09-21T05:28:43.743481+0000 mon.a (mon.0) 14881 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:44 smithi044 bash[22676]: audit 2024-09-21T05:28:43.817515+0000 mon.a (mon.0) 14882 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:44 smithi044 bash[22676]: audit 2024-09-21T05:28:43.823653+0000 mon.a (mon.0) 14883 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:44.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:44 smithi044 bash[22676]: audit 2024-09-21T05:28:43.829428+0000 mon.a (mon.0) 14884 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:45 smithi049 bash[23528]: audit 2024-09-21T05:28:43.654079+0000 mgr.a (mgr.14388) 18798 : audit [DBG] from='client.403764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:45 smithi044 bash[22676]: audit 2024-09-21T05:28:43.654079+0000 mgr.a (mgr.14388) 18798 : audit [DBG] from='client.403764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:45 smithi179 bash[23186]: audit 2024-09-21T05:28:43.654079+0000 mgr.a (mgr.14388) 18798 : audit [DBG] from='client.403764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:46 smithi049 bash[23528]: cluster 2024-09-21T05:28:44.952874+0000 mgr.a (mgr.14388) 18799 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:46 smithi044 bash[22676]: cluster 2024-09-21T05:28:44.952874+0000 mgr.a (mgr.14388) 18799 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:46 smithi179 bash[23186]: cluster 2024-09-21T05:28:44.952874+0000 mgr.a (mgr.14388) 18799 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:48 smithi049 bash[23528]: cluster 2024-09-21T05:28:46.955149+0000 mgr.a (mgr.14388) 18800 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:48 smithi044 bash[22676]: cluster 2024-09-21T05:28:46.955149+0000 mgr.a (mgr.14388) 18800 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:48 smithi179 bash[23186]: cluster 2024-09-21T05:28:46.955149+0000 mgr.a (mgr.14388) 18800 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:49.105 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:49.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:50 smithi049 bash[23528]: cluster 2024-09-21T05:28:48.955910+0000 mgr.a (mgr.14388) 18801 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:50 smithi044 bash[22676]: cluster 2024-09-21T05:28:48.955910+0000 mgr.a (mgr.14388) 18801 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:50 smithi179 bash[23186]: cluster 2024-09-21T05:28:48.955910+0000 mgr.a (mgr.14388) 18801 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:51 smithi049 bash[23528]: audit 2024-09-21T05:28:49.444047+0000 mgr.a (mgr.14388) 18802 : audit [DBG] from='client.403839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:51 smithi044 bash[22676]: audit 2024-09-21T05:28:49.444047+0000 mgr.a (mgr.14388) 18802 : audit [DBG] from='client.403839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:51 smithi179 bash[23186]: audit 2024-09-21T05:28:49.444047+0000 mgr.a (mgr.14388) 18802 : audit [DBG] from='client.403839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:52 smithi044 bash[22676]: cluster 2024-09-21T05:28:50.958267+0000 mgr.a (mgr.14388) 18803 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:52 smithi179 bash[23186]: cluster 2024-09-21T05:28:50.958267+0000 mgr.a (mgr.14388) 18803 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:52 smithi049 bash[23528]: cluster 2024-09-21T05:28:50.958267+0000 mgr.a (mgr.14388) 18803 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:28:54.322 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:54 smithi049 bash[23528]: cluster 2024-09-21T05:28:52.959050+0000 mgr.a (mgr.14388) 18804 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:54.352 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:54 smithi179 bash[23186]: cluster 2024-09-21T05:28:52.959050+0000 mgr.a (mgr.14388) 18804 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:54 smithi044 bash[22676]: cluster 2024-09-21T05:28:52.959050+0000 mgr.a (mgr.14388) 18804 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:54.903 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:28:54.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:28:54.904 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:28:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:55 smithi179 bash[23186]: audit 2024-09-21T05:28:54.299227+0000 mon.a (mon.0) 14885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:55 smithi179 bash[23186]: audit 2024-09-21T05:28:54.307795+0000 mon.a (mon.0) 14886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:55 smithi179 bash[23186]: audit 2024-09-21T05:28:54.318557+0000 mon.a (mon.0) 14887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:55 smithi179 bash[23186]: cluster 2024-09-21T05:28:54.959620+0000 mgr.a (mgr.14388) 18805 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:55 smithi049 bash[23528]: audit 2024-09-21T05:28:54.299227+0000 mon.a (mon.0) 14885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:55 smithi049 bash[23528]: audit 2024-09-21T05:28:54.307795+0000 mon.a (mon.0) 14886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:55 smithi049 bash[23528]: audit 2024-09-21T05:28:54.318557+0000 mon.a (mon.0) 14887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:55 smithi049 bash[23528]: cluster 2024-09-21T05:28:54.959620+0000 mgr.a (mgr.14388) 18805 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:55.687 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:28:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:28:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:28:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:28:55.687 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:28:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:55 smithi044 bash[22676]: audit 2024-09-21T05:28:54.299227+0000 mon.a (mon.0) 14885 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:55 smithi044 bash[22676]: audit 2024-09-21T05:28:54.307795+0000 mon.a (mon.0) 14886 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:55 smithi044 bash[22676]: audit 2024-09-21T05:28:54.318557+0000 mon.a (mon.0) 14887 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:55 smithi044 bash[22676]: cluster 2024-09-21T05:28:54.959620+0000 mgr.a (mgr.14388) 18805 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:56 smithi044 bash[22676]: audit 2024-09-21T05:28:55.239365+0000 mgr.a (mgr.14388) 18806 : audit [DBG] from='client.403917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:56 smithi179 bash[23186]: audit 2024-09-21T05:28:55.239365+0000 mgr.a (mgr.14388) 18806 : audit [DBG] from='client.403917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:56 smithi049 bash[23528]: audit 2024-09-21T05:28:55.239365+0000 mgr.a (mgr.14388) 18806 : audit [DBG] from='client.403917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:57.470 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22930]: debug 2024-09-21T05:28:57.226+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:28:57.470 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22930]: debug 2024-09-21T05:28:57.226+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:28:57.470 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22676]: audit 2024-09-21T05:28:56.449912+0000 mon.a (mon.0) 14888 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:28:57.470 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22676]: audit 2024-09-21T05:28:56.457469+0000 mon.a (mon.0) 14889 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:57.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22676]: audit 2024-09-21T05:28:56.459268+0000 mon.a (mon.0) 14890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:57.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22676]: audit 2024-09-21T05:28:56.470699+0000 mon.a (mon.0) 14891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:57.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22676]: audit 2024-09-21T05:28:56.477267+0000 mon.a (mon.0) 14892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:28:57.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22676]: audit 2024-09-21T05:28:56.480200+0000 mgr.a (mgr.14388) 18807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:28:57.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:57 smithi044 bash[22676]: cluster 2024-09-21T05:28:56.960926+0000 mgr.a (mgr.14388) 18808 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:57 smithi179 bash[23186]: audit 2024-09-21T05:28:56.449912+0000 mon.a (mon.0) 14888 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:28:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:57 smithi179 bash[23186]: audit 2024-09-21T05:28:56.457469+0000 mon.a (mon.0) 14889 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:57 smithi179 bash[23186]: audit 2024-09-21T05:28:56.459268+0000 mon.a (mon.0) 14890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:57 smithi179 bash[23186]: audit 2024-09-21T05:28:56.470699+0000 mon.a (mon.0) 14891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:57 smithi179 bash[23186]: audit 2024-09-21T05:28:56.477267+0000 mon.a (mon.0) 14892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:28:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:57 smithi179 bash[23186]: audit 2024-09-21T05:28:56.480200+0000 mgr.a (mgr.14388) 18807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:28:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:57 smithi179 bash[23186]: cluster 2024-09-21T05:28:56.960926+0000 mgr.a (mgr.14388) 18808 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:57 smithi049 bash[23528]: audit 2024-09-21T05:28:56.449912+0000 mon.a (mon.0) 14888 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:28:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:57 smithi049 bash[23528]: audit 2024-09-21T05:28:56.457469+0000 mon.a (mon.0) 14889 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:57 smithi049 bash[23528]: audit 2024-09-21T05:28:56.459268+0000 mon.a (mon.0) 14890 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:57 smithi049 bash[23528]: audit 2024-09-21T05:28:56.470699+0000 mon.a (mon.0) 14891 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:28:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:57 smithi049 bash[23528]: audit 2024-09-21T05:28:56.477267+0000 mon.a (mon.0) 14892 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:28:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:57 smithi049 bash[23528]: audit 2024-09-21T05:28:56.480200+0000 mgr.a (mgr.14388) 18807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:28:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:57 smithi049 bash[23528]: cluster 2024-09-21T05:28:56.960926+0000 mgr.a (mgr.14388) 18808 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:28:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:58 smithi044 bash[22676]: audit 2024-09-21T05:28:57.230813+0000 mgr.a (mgr.14388) 18809 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:28:58.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:58 smithi044 bash[22676]: cephadm 2024-09-21T05:28:57.231957+0000 mgr.a (mgr.14388) 18810 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:28:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:58 smithi179 bash[23186]: audit 2024-09-21T05:28:57.230813+0000 mgr.a (mgr.14388) 18809 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:28:58.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:58 smithi179 bash[23186]: cephadm 2024-09-21T05:28:57.231957+0000 mgr.a (mgr.14388) 18810 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:28:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:58 smithi049 bash[23528]: audit 2024-09-21T05:28:57.230813+0000 mgr.a (mgr.14388) 18809 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:28:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:58 smithi049 bash[23528]: cephadm 2024-09-21T05:28:57.231957+0000 mgr.a (mgr.14388) 18810 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:28:59.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:28:59 smithi044 bash[22676]: cluster 2024-09-21T05:28:58.961890+0000 mgr.a (mgr.14388) 18811 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:28:59 smithi179 bash[23186]: cluster 2024-09-21T05:28:58.961890+0000 mgr.a (mgr.14388) 18811 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:28:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:28:59 smithi049 bash[23528]: cluster 2024-09-21T05:28:58.961890+0000 mgr.a (mgr.14388) 18811 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:29:00.688 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:00.689 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:00.689 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:01.467 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:02 smithi049 bash[23528]: cluster 2024-09-21T05:29:00.964113+0000 mgr.a (mgr.14388) 18812 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:02 smithi049 bash[23528]: audit 2024-09-21T05:29:01.022421+0000 mgr.a (mgr.14388) 18813 : audit [DBG] from='client.404100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:02.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:02 smithi044 bash[22676]: cluster 2024-09-21T05:29:00.964113+0000 mgr.a (mgr.14388) 18812 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:02 smithi044 bash[22676]: audit 2024-09-21T05:29:01.022421+0000 mgr.a (mgr.14388) 18813 : audit [DBG] from='client.404100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:02 smithi179 bash[23186]: cluster 2024-09-21T05:29:00.964113+0000 mgr.a (mgr.14388) 18812 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:02 smithi179 bash[23186]: audit 2024-09-21T05:29:01.022421+0000 mgr.a (mgr.14388) 18813 : audit [DBG] from='client.404100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:04 smithi044 bash[22676]: cluster 2024-09-21T05:29:02.965094+0000 mgr.a (mgr.14388) 18814 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:29:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:04 smithi044 bash[22676]: audit 2024-09-21T05:29:03.937651+0000 mon.a (mon.0) 14893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:04 smithi044 bash[22676]: audit 2024-09-21T05:29:03.946101+0000 mon.a (mon.0) 14894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:04 smithi044 bash[22676]: audit 2024-09-21T05:29:03.956940+0000 mon.a (mon.0) 14895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:04 smithi049 bash[23528]: cluster 2024-09-21T05:29:02.965094+0000 mgr.a (mgr.14388) 18814 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:29:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:04 smithi049 bash[23528]: audit 2024-09-21T05:29:03.937651+0000 mon.a (mon.0) 14893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:04 smithi049 bash[23528]: audit 2024-09-21T05:29:03.946101+0000 mon.a (mon.0) 14894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:04 smithi049 bash[23528]: audit 2024-09-21T05:29:03.956940+0000 mon.a (mon.0) 14895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:04 smithi179 bash[23186]: cluster 2024-09-21T05:29:02.965094+0000 mgr.a (mgr.14388) 18814 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:29:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:04 smithi179 bash[23186]: audit 2024-09-21T05:29:03.937651+0000 mon.a (mon.0) 14893 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:04 smithi179 bash[23186]: audit 2024-09-21T05:29:03.946101+0000 mon.a (mon.0) 14894 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:04 smithi179 bash[23186]: audit 2024-09-21T05:29:03.956940+0000 mon.a (mon.0) 14895 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:05 smithi049 bash[23528]: audit 2024-09-21T05:29:04.039371+0000 mon.a (mon.0) 14896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:05 smithi049 bash[23528]: audit 2024-09-21T05:29:04.047626+0000 mon.a (mon.0) 14897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:05 smithi049 bash[23528]: audit 2024-09-21T05:29:04.058980+0000 mon.a (mon.0) 14898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:05 smithi044 bash[22676]: audit 2024-09-21T05:29:04.039371+0000 mon.a (mon.0) 14896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:05 smithi044 bash[22676]: audit 2024-09-21T05:29:04.047626+0000 mon.a (mon.0) 14897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:05 smithi044 bash[22676]: audit 2024-09-21T05:29:04.058980+0000 mon.a (mon.0) 14898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:05 smithi179 bash[23186]: audit 2024-09-21T05:29:04.039371+0000 mon.a (mon.0) 14896 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:05 smithi179 bash[23186]: audit 2024-09-21T05:29:04.047626+0000 mon.a (mon.0) 14897 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:05 smithi179 bash[23186]: audit 2024-09-21T05:29:04.058980+0000 mon.a (mon.0) 14898 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:06.207 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:06 smithi049 bash[23528]: cluster 2024-09-21T05:29:04.965923+0000 mgr.a (mgr.14388) 18815 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:29:06.469 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:06.470 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:06.470 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:06.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:06 smithi044 bash[22676]: cluster 2024-09-21T05:29:04.965923+0000 mgr.a (mgr.14388) 18815 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:29:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:06 smithi179 bash[23186]: cluster 2024-09-21T05:29:04.965923+0000 mgr.a (mgr.14388) 18815 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:29:07.257 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:07.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:07.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:07.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:07.257 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:08 smithi044 bash[22676]: audit 2024-09-21T05:29:06.802373+0000 mgr.a (mgr.14388) 18816 : audit [DBG] from='client.404178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:08 smithi044 bash[22676]: cluster 2024-09-21T05:29:06.967402+0000 mgr.a (mgr.14388) 18817 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:08 smithi179 bash[23186]: audit 2024-09-21T05:29:06.802373+0000 mgr.a (mgr.14388) 18816 : audit [DBG] from='client.404178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:08 smithi179 bash[23186]: cluster 2024-09-21T05:29:06.967402+0000 mgr.a (mgr.14388) 18817 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:08.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:08 smithi049 bash[23528]: audit 2024-09-21T05:29:06.802373+0000 mgr.a (mgr.14388) 18816 : audit [DBG] from='client.404178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:08.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:08 smithi049 bash[23528]: cluster 2024-09-21T05:29:06.967402+0000 mgr.a (mgr.14388) 18817 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:10 smithi044 bash[22676]: cluster 2024-09-21T05:29:08.968360+0000 mgr.a (mgr.14388) 18818 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:10 smithi179 bash[23186]: cluster 2024-09-21T05:29:08.968360+0000 mgr.a (mgr.14388) 18818 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:10 smithi049 bash[23528]: cluster 2024-09-21T05:29:08.968360+0000 mgr.a (mgr.14388) 18818 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:12.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:12.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:12.259 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:12 smithi044 bash[22676]: cluster 2024-09-21T05:29:10.970647+0000 mgr.a (mgr.14388) 18819 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:12 smithi179 bash[23186]: cluster 2024-09-21T05:29:10.970647+0000 mgr.a (mgr.14388) 18819 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:12 smithi049 bash[23528]: cluster 2024-09-21T05:29:10.970647+0000 mgr.a (mgr.14388) 18819 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:29:13.038 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:13.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:13.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:14 smithi044 bash[22676]: audit 2024-09-21T05:29:12.594283+0000 mgr.a (mgr.14388) 18820 : audit [DBG] from='client.404256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:14 smithi044 bash[22676]: cluster 2024-09-21T05:29:12.971228+0000 mgr.a (mgr.14388) 18821 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:14 smithi179 bash[23186]: audit 2024-09-21T05:29:12.594283+0000 mgr.a (mgr.14388) 18820 : audit [DBG] from='client.404256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:14 smithi179 bash[23186]: cluster 2024-09-21T05:29:12.971228+0000 mgr.a (mgr.14388) 18821 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:14 smithi049 bash[23528]: audit 2024-09-21T05:29:12.594283+0000 mgr.a (mgr.14388) 18820 : audit [DBG] from='client.404256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:14.553 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:14 smithi049 bash[23528]: cluster 2024-09-21T05:29:12.971228+0000 mgr.a (mgr.14388) 18821 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:15 smithi049 bash[23528]: audit 2024-09-21T05:29:14.528270+0000 mon.a (mon.0) 14899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:15 smithi049 bash[23528]: audit 2024-09-21T05:29:14.538282+0000 mon.a (mon.0) 14900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:15 smithi049 bash[23528]: audit 2024-09-21T05:29:14.548921+0000 mon.a (mon.0) 14901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:15 smithi049 bash[23528]: cluster 2024-09-21T05:29:14.971970+0000 mgr.a (mgr.14388) 18822 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:15.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:15 smithi179 bash[23186]: audit 2024-09-21T05:29:14.528270+0000 mon.a (mon.0) 14899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:15 smithi179 bash[23186]: audit 2024-09-21T05:29:14.538282+0000 mon.a (mon.0) 14900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:15 smithi179 bash[23186]: audit 2024-09-21T05:29:14.548921+0000 mon.a (mon.0) 14901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:15 smithi179 bash[23186]: cluster 2024-09-21T05:29:14.971970+0000 mgr.a (mgr.14388) 18822 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:15 smithi044 bash[22676]: audit 2024-09-21T05:29:14.528270+0000 mon.a (mon.0) 14899 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:15 smithi044 bash[22676]: audit 2024-09-21T05:29:14.538282+0000 mon.a (mon.0) 14900 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:15 smithi044 bash[22676]: audit 2024-09-21T05:29:14.548921+0000 mon.a (mon.0) 14901 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:15.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:15 smithi044 bash[22676]: cluster 2024-09-21T05:29:14.971970+0000 mgr.a (mgr.14388) 18822 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:18.040 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:18.040 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:18.041 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:18 smithi049 bash[23528]: cluster 2024-09-21T05:29:16.974396+0000 mgr.a (mgr.14388) 18823 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:18.306 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:18 smithi179 bash[23186]: cluster 2024-09-21T05:29:16.974396+0000 mgr.a (mgr.14388) 18823 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:18.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:18 smithi044 bash[22676]: cluster 2024-09-21T05:29:16.974396+0000 mgr.a (mgr.14388) 18823 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:18.810 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:18.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:18.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:18.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:18.811 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:20 smithi044 bash[22676]: audit 2024-09-21T05:29:18.378156+0000 mgr.a (mgr.14388) 18824 : audit [DBG] from='client.404334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:20 smithi044 bash[22676]: cluster 2024-09-21T05:29:18.975429+0000 mgr.a (mgr.14388) 18825 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:20 smithi049 bash[23528]: audit 2024-09-21T05:29:18.378156+0000 mgr.a (mgr.14388) 18824 : audit [DBG] from='client.404334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:20 smithi049 bash[23528]: cluster 2024-09-21T05:29:18.975429+0000 mgr.a (mgr.14388) 18825 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:20 smithi179 bash[23186]: audit 2024-09-21T05:29:18.378156+0000 mgr.a (mgr.14388) 18824 : audit [DBG] from='client.404334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:20 smithi179 bash[23186]: cluster 2024-09-21T05:29:18.975429+0000 mgr.a (mgr.14388) 18825 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:22 smithi049 bash[23528]: cluster 2024-09-21T05:29:20.977753+0000 mgr.a (mgr.14388) 18826 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:22 smithi044 bash[22676]: cluster 2024-09-21T05:29:20.977753+0000 mgr.a (mgr.14388) 18826 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:22 smithi179 bash[23186]: cluster 2024-09-21T05:29:20.977753+0000 mgr.a (mgr.14388) 18826 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:23.812 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:23.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:23.813 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:24 smithi049 bash[23528]: cluster 2024-09-21T05:29:22.978516+0000 mgr.a (mgr.14388) 18827 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:24 smithi044 bash[22676]: cluster 2024-09-21T05:29:22.978516+0000 mgr.a (mgr.14388) 18827 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:24 smithi179 bash[23186]: cluster 2024-09-21T05:29:22.978516+0000 mgr.a (mgr.14388) 18827 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:24.586 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:24.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:24.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:24.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:24.587 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: audit 2024-09-21T05:29:24.146134+0000 mgr.a (mgr.14388) 18828 : audit [DBG] from='client.404409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: audit 2024-09-21T05:29:24.149678+0000 mon.a (mon.0) 14902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: audit 2024-09-21T05:29:24.165284+0000 mon.a (mon.0) 14903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: audit 2024-09-21T05:29:24.177093+0000 mon.a (mon.0) 14904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: audit 2024-09-21T05:29:24.252294+0000 mon.a (mon.0) 14905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: audit 2024-09-21T05:29:24.258931+0000 mon.a (mon.0) 14906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: audit 2024-09-21T05:29:24.264317+0000 mon.a (mon.0) 14907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:25 smithi044 bash[22676]: cluster 2024-09-21T05:29:24.979555+0000 mgr.a (mgr.14388) 18829 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: audit 2024-09-21T05:29:24.146134+0000 mgr.a (mgr.14388) 18828 : audit [DBG] from='client.404409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: audit 2024-09-21T05:29:24.149678+0000 mon.a (mon.0) 14902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: audit 2024-09-21T05:29:24.165284+0000 mon.a (mon.0) 14903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: audit 2024-09-21T05:29:24.177093+0000 mon.a (mon.0) 14904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: audit 2024-09-21T05:29:24.252294+0000 mon.a (mon.0) 14905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: audit 2024-09-21T05:29:24.258931+0000 mon.a (mon.0) 14906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: audit 2024-09-21T05:29:24.264317+0000 mon.a (mon.0) 14907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:25 smithi179 bash[23186]: cluster 2024-09-21T05:29:24.979555+0000 mgr.a (mgr.14388) 18829 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: audit 2024-09-21T05:29:24.146134+0000 mgr.a (mgr.14388) 18828 : audit [DBG] from='client.404409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: audit 2024-09-21T05:29:24.149678+0000 mon.a (mon.0) 14902 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: audit 2024-09-21T05:29:24.165284+0000 mon.a (mon.0) 14903 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: audit 2024-09-21T05:29:24.177093+0000 mon.a (mon.0) 14904 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: audit 2024-09-21T05:29:24.252294+0000 mon.a (mon.0) 14905 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: audit 2024-09-21T05:29:24.258931+0000 mon.a (mon.0) 14906 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: audit 2024-09-21T05:29:24.264317+0000 mon.a (mon.0) 14907 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:25.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:25 smithi049 bash[23528]: cluster 2024-09-21T05:29:24.979555+0000 mgr.a (mgr.14388) 18829 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:28 smithi049 bash[23528]: cluster 2024-09-21T05:29:26.981876+0000 mgr.a (mgr.14388) 18830 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:28 smithi044 bash[22676]: cluster 2024-09-21T05:29:26.981876+0000 mgr.a (mgr.14388) 18830 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:28 smithi179 bash[23186]: cluster 2024-09-21T05:29:26.981876+0000 mgr.a (mgr.14388) 18830 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:29.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:30.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:30 smithi049 bash[23528]: cluster 2024-09-21T05:29:28.982656+0000 mgr.a (mgr.14388) 18831 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:30.386 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:30 smithi044 bash[22676]: cluster 2024-09-21T05:29:28.982656+0000 mgr.a (mgr.14388) 18831 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:30 smithi179 bash[23186]: cluster 2024-09-21T05:29:28.982656+0000 mgr.a (mgr.14388) 18831 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:31 smithi049 bash[23528]: audit 2024-09-21T05:29:29.924894+0000 mgr.a (mgr.14388) 18832 : audit [DBG] from='client.404487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:31 smithi044 bash[22676]: audit 2024-09-21T05:29:29.924894+0000 mgr.a (mgr.14388) 18832 : audit [DBG] from='client.404487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:31 smithi179 bash[23186]: audit 2024-09-21T05:29:29.924894+0000 mgr.a (mgr.14388) 18832 : audit [DBG] from='client.404487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:32 smithi044 bash[22676]: cluster 2024-09-21T05:29:30.985750+0000 mgr.a (mgr.14388) 18833 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:32 smithi179 bash[23186]: cluster 2024-09-21T05:29:30.985750+0000 mgr.a (mgr.14388) 18833 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:32 smithi049 bash[23528]: cluster 2024-09-21T05:29:30.985750+0000 mgr.a (mgr.14388) 18833 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:34 smithi044 bash[22676]: cluster 2024-09-21T05:29:32.986574+0000 mgr.a (mgr.14388) 18834 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:34 smithi179 bash[23186]: cluster 2024-09-21T05:29:32.986574+0000 mgr.a (mgr.14388) 18834 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:34 smithi049 bash[23528]: cluster 2024-09-21T05:29:32.986574+0000 mgr.a (mgr.14388) 18834 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:35.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:35.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:35.390 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:36.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:35 smithi179 bash[23186]: audit 2024-09-21T05:29:34.762977+0000 mon.a (mon.0) 14908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:35 smithi179 bash[23186]: audit 2024-09-21T05:29:34.773325+0000 mon.a (mon.0) 14909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:35 smithi179 bash[23186]: audit 2024-09-21T05:29:34.784189+0000 mon.a (mon.0) 14910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:35 smithi179 bash[23186]: cluster 2024-09-21T05:29:34.987339+0000 mgr.a (mgr.14388) 18835 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:35 smithi049 bash[23528]: audit 2024-09-21T05:29:34.762977+0000 mon.a (mon.0) 14908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:35 smithi049 bash[23528]: audit 2024-09-21T05:29:34.773325+0000 mon.a (mon.0) 14909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:35 smithi049 bash[23528]: audit 2024-09-21T05:29:34.784189+0000 mon.a (mon.0) 14910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:35 smithi049 bash[23528]: cluster 2024-09-21T05:29:34.987339+0000 mgr.a (mgr.14388) 18835 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:36.167 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:36.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:35 smithi044 bash[22676]: audit 2024-09-21T05:29:34.762977+0000 mon.a (mon.0) 14908 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:35 smithi044 bash[22676]: audit 2024-09-21T05:29:34.773325+0000 mon.a (mon.0) 14909 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:35 smithi044 bash[22676]: audit 2024-09-21T05:29:34.784189+0000 mon.a (mon.0) 14910 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:36.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:35 smithi044 bash[22676]: cluster 2024-09-21T05:29:34.987339+0000 mgr.a (mgr.14388) 18835 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:36 smithi044 bash[22676]: audit 2024-09-21T05:29:35.721171+0000 mgr.a (mgr.14388) 18836 : audit [DBG] from='client.404565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:37.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:36 smithi049 bash[23528]: audit 2024-09-21T05:29:35.721171+0000 mgr.a (mgr.14388) 18836 : audit [DBG] from='client.404565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:36 smithi179 bash[23186]: audit 2024-09-21T05:29:35.721171+0000 mgr.a (mgr.14388) 18836 : audit [DBG] from='client.404565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:37 smithi049 bash[23528]: cluster 2024-09-21T05:29:36.990343+0000 mgr.a (mgr.14388) 18837 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:37 smithi044 bash[22676]: cluster 2024-09-21T05:29:36.990343+0000 mgr.a (mgr.14388) 18837 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:38.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:37 smithi179 bash[23186]: cluster 2024-09-21T05:29:36.990343+0000 mgr.a (mgr.14388) 18837 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:40.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:40 smithi044 bash[22676]: cluster 2024-09-21T05:29:38.991170+0000 mgr.a (mgr.14388) 18838 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:40.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:40 smithi049 bash[23528]: cluster 2024-09-21T05:29:38.991170+0000 mgr.a (mgr.14388) 18838 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:40 smithi179 bash[23186]: cluster 2024-09-21T05:29:38.991170+0000 mgr.a (mgr.14388) 18838 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:29:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:41.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:41.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:41.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:42 smithi044 bash[22676]: cluster 2024-09-21T05:29:40.993231+0000 mgr.a (mgr.14388) 18839 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:42.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:42 smithi179 bash[23186]: cluster 2024-09-21T05:29:40.993231+0000 mgr.a (mgr.14388) 18839 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:42 smithi049 bash[23528]: cluster 2024-09-21T05:29:40.993231+0000 mgr.a (mgr.14388) 18839 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:43 smithi044 bash[22676]: audit 2024-09-21T05:29:41.502399+0000 mgr.a (mgr.14388) 18840 : audit [DBG] from='client.404643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:43 smithi179 bash[23186]: audit 2024-09-21T05:29:41.502399+0000 mgr.a (mgr.14388) 18840 : audit [DBG] from='client.404643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:43 smithi049 bash[23528]: audit 2024-09-21T05:29:41.502399+0000 mgr.a (mgr.14388) 18840 : audit [DBG] from='client.404643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:44.407 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:44 smithi044 bash[22676]: cluster 2024-09-21T05:29:42.994231+0000 mgr.a (mgr.14388) 18841 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:44.494 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:44 smithi179 bash[23186]: cluster 2024-09-21T05:29:42.994231+0000 mgr.a (mgr.14388) 18841 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:44 smithi049 bash[23528]: cluster 2024-09-21T05:29:42.994231+0000 mgr.a (mgr.14388) 18841 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:45 smithi044 bash[22676]: audit 2024-09-21T05:29:44.384053+0000 mon.a (mon.0) 14911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:45 smithi044 bash[22676]: audit 2024-09-21T05:29:44.392486+0000 mon.a (mon.0) 14912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:45 smithi044 bash[22676]: audit 2024-09-21T05:29:44.403153+0000 mon.a (mon.0) 14913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:45 smithi044 bash[22676]: audit 2024-09-21T05:29:44.470933+0000 mon.a (mon.0) 14914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:45 smithi044 bash[22676]: audit 2024-09-21T05:29:44.479749+0000 mon.a (mon.0) 14915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:45 smithi044 bash[22676]: audit 2024-09-21T05:29:44.490311+0000 mon.a (mon.0) 14916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:45 smithi044 bash[22676]: cluster 2024-09-21T05:29:44.995084+0000 mgr.a (mgr.14388) 18842 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:45 smithi179 bash[23186]: audit 2024-09-21T05:29:44.384053+0000 mon.a (mon.0) 14911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:45 smithi179 bash[23186]: audit 2024-09-21T05:29:44.392486+0000 mon.a (mon.0) 14912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:45 smithi179 bash[23186]: audit 2024-09-21T05:29:44.403153+0000 mon.a (mon.0) 14913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:45 smithi179 bash[23186]: audit 2024-09-21T05:29:44.470933+0000 mon.a (mon.0) 14914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:45 smithi179 bash[23186]: audit 2024-09-21T05:29:44.479749+0000 mon.a (mon.0) 14915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:45 smithi179 bash[23186]: audit 2024-09-21T05:29:44.490311+0000 mon.a (mon.0) 14916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:45 smithi179 bash[23186]: cluster 2024-09-21T05:29:44.995084+0000 mgr.a (mgr.14388) 18842 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:45.794 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:45 smithi049 bash[23528]: audit 2024-09-21T05:29:44.384053+0000 mon.a (mon.0) 14911 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:45 smithi049 bash[23528]: audit 2024-09-21T05:29:44.392486+0000 mon.a (mon.0) 14912 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:45 smithi049 bash[23528]: audit 2024-09-21T05:29:44.403153+0000 mon.a (mon.0) 14913 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:45 smithi049 bash[23528]: audit 2024-09-21T05:29:44.470933+0000 mon.a (mon.0) 14914 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:45 smithi049 bash[23528]: audit 2024-09-21T05:29:44.479749+0000 mon.a (mon.0) 14915 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:45 smithi049 bash[23528]: audit 2024-09-21T05:29:44.490311+0000 mon.a (mon.0) 14916 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:45.795 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:45 smithi049 bash[23528]: cluster 2024-09-21T05:29:44.995084+0000 mgr.a (mgr.14388) 18842 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:46.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:46.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:46.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:47.749 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:47.749 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:48 smithi044 bash[22676]: cluster 2024-09-21T05:29:46.996627+0000 mgr.a (mgr.14388) 18843 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:48 smithi179 bash[23186]: cluster 2024-09-21T05:29:46.996627+0000 mgr.a (mgr.14388) 18843 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:48 smithi049 bash[23528]: cluster 2024-09-21T05:29:46.996627+0000 mgr.a (mgr.14388) 18843 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:49.319 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:49 smithi049 bash[23528]: audit 2024-09-21T05:29:47.290584+0000 mgr.a (mgr.14388) 18844 : audit [DBG] from='client.404718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:49 smithi044 bash[22676]: audit 2024-09-21T05:29:47.290584+0000 mgr.a (mgr.14388) 18844 : audit [DBG] from='client.404718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:49 smithi179 bash[23186]: audit 2024-09-21T05:29:47.290584+0000 mgr.a (mgr.14388) 18844 : audit [DBG] from='client.404718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:50 smithi044 bash[22676]: cluster 2024-09-21T05:29:48.997615+0000 mgr.a (mgr.14388) 18845 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:50 smithi179 bash[23186]: cluster 2024-09-21T05:29:48.997615+0000 mgr.a (mgr.14388) 18845 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:50 smithi049 bash[23528]: cluster 2024-09-21T05:29:48.997615+0000 mgr.a (mgr.14388) 18845 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:52 smithi044 bash[22676]: cluster 2024-09-21T05:29:50.999953+0000 mgr.a (mgr.14388) 18846 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:52 smithi179 bash[23186]: cluster 2024-09-21T05:29:50.999953+0000 mgr.a (mgr.14388) 18846 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:52 smithi049 bash[23528]: cluster 2024-09-21T05:29:50.999953+0000 mgr.a (mgr.14388) 18846 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:52.750 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:52.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:52.751 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:53.515 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:53.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:53.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:53.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:53.515 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:54 smithi044 bash[22676]: cluster 2024-09-21T05:29:53.000694+0000 mgr.a (mgr.14388) 18847 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:54 smithi044 bash[22676]: audit 2024-09-21T05:29:53.083585+0000 mgr.a (mgr.14388) 18848 : audit [DBG] from='client.404796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:54 smithi179 bash[23186]: cluster 2024-09-21T05:29:53.000694+0000 mgr.a (mgr.14388) 18847 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:54 smithi179 bash[23186]: audit 2024-09-21T05:29:53.083585+0000 mgr.a (mgr.14388) 18848 : audit [DBG] from='client.404796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:54 smithi049 bash[23528]: cluster 2024-09-21T05:29:53.000694+0000 mgr.a (mgr.14388) 18847 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:54 smithi049 bash[23528]: audit 2024-09-21T05:29:53.083585+0000 mgr.a (mgr.14388) 18848 : audit [DBG] from='client.404796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:56 smithi049 bash[23528]: audit 2024-09-21T05:29:54.999501+0000 mon.a (mon.0) 14917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:56 smithi049 bash[23528]: cluster 2024-09-21T05:29:55.002124+0000 mgr.a (mgr.14388) 18849 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:56 smithi049 bash[23528]: audit 2024-09-21T05:29:55.008856+0000 mon.a (mon.0) 14918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:56 smithi049 bash[23528]: audit 2024-09-21T05:29:55.019669+0000 mon.a (mon.0) 14919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:56 smithi179 bash[23186]: audit 2024-09-21T05:29:54.999501+0000 mon.a (mon.0) 14917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:56 smithi179 bash[23186]: cluster 2024-09-21T05:29:55.002124+0000 mgr.a (mgr.14388) 18849 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:56.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:56 smithi179 bash[23186]: audit 2024-09-21T05:29:55.008856+0000 mon.a (mon.0) 14918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:56 smithi179 bash[23186]: audit 2024-09-21T05:29:55.019669+0000 mon.a (mon.0) 14919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:56 smithi044 bash[22676]: audit 2024-09-21T05:29:54.999501+0000 mon.a (mon.0) 14917 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:56 smithi044 bash[22676]: cluster 2024-09-21T05:29:55.002124+0000 mgr.a (mgr.14388) 18849 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:29:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:56 smithi044 bash[22676]: audit 2024-09-21T05:29:55.008856+0000 mon.a (mon.0) 14918 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:56 smithi044 bash[22676]: audit 2024-09-21T05:29:55.019669+0000 mon.a (mon.0) 14919 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22930]: debug 2024-09-21T05:29:58.101+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22930]: debug 2024-09-21T05:29:58.101+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22676]: cluster 2024-09-21T05:29:57.004473+0000 mgr.a (mgr.14388) 18850 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22676]: audit 2024-09-21T05:29:57.280041+0000 mon.a (mon.0) 14920 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22676]: audit 2024-09-21T05:29:57.286782+0000 mon.a (mon.0) 14921 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22676]: audit 2024-09-21T05:29:57.288738+0000 mon.a (mon.0) 14922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22676]: audit 2024-09-21T05:29:57.300088+0000 mon.a (mon.0) 14923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:58.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:58 smithi044 bash[22676]: audit 2024-09-21T05:29:57.306852+0000 mon.a (mon.0) 14924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:29:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:58 smithi179 bash[23186]: cluster 2024-09-21T05:29:57.004473+0000 mgr.a (mgr.14388) 18850 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:58 smithi179 bash[23186]: audit 2024-09-21T05:29:57.280041+0000 mon.a (mon.0) 14920 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:29:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:58 smithi179 bash[23186]: audit 2024-09-21T05:29:57.286782+0000 mon.a (mon.0) 14921 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:58 smithi179 bash[23186]: audit 2024-09-21T05:29:57.288738+0000 mon.a (mon.0) 14922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:58 smithi179 bash[23186]: audit 2024-09-21T05:29:57.300088+0000 mon.a (mon.0) 14923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:58 smithi179 bash[23186]: audit 2024-09-21T05:29:57.306852+0000 mon.a (mon.0) 14924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:29:58.516 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:29:58.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:29:58.517 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:29:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:58 smithi049 bash[23528]: cluster 2024-09-21T05:29:57.004473+0000 mgr.a (mgr.14388) 18850 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:29:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:58 smithi049 bash[23528]: audit 2024-09-21T05:29:57.280041+0000 mon.a (mon.0) 14920 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:29:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:58 smithi049 bash[23528]: audit 2024-09-21T05:29:57.286782+0000 mon.a (mon.0) 14921 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:58 smithi049 bash[23528]: audit 2024-09-21T05:29:57.288738+0000 mon.a (mon.0) 14922 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:58 smithi049 bash[23528]: audit 2024-09-21T05:29:57.300088+0000 mon.a (mon.0) 14923 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:29:58.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:58 smithi049 bash[23528]: audit 2024-09-21T05:29:57.306852+0000 mon.a (mon.0) 14924 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:29:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:59 smithi179 bash[23186]: audit 2024-09-21T05:29:57.309289+0000 mgr.a (mgr.14388) 18851 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:29:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:59 smithi179 bash[23186]: audit 2024-09-21T05:29:58.107298+0000 mgr.a (mgr.14388) 18852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:29:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:29:59 smithi179 bash[23186]: cephadm 2024-09-21T05:29:58.108733+0000 mgr.a (mgr.14388) 18853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:29:59.268 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:29:59.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:29:59.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:29:59.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:29:59.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:29:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:59 smithi044 bash[22676]: audit 2024-09-21T05:29:57.309289+0000 mgr.a (mgr.14388) 18851 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:29:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:59 smithi044 bash[22676]: audit 2024-09-21T05:29:58.107298+0000 mgr.a (mgr.14388) 18852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:29:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:29:59 smithi044 bash[22676]: cephadm 2024-09-21T05:29:58.108733+0000 mgr.a (mgr.14388) 18853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:29:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:59 smithi049 bash[23528]: audit 2024-09-21T05:29:57.309289+0000 mgr.a (mgr.14388) 18851 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:29:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:59 smithi049 bash[23528]: audit 2024-09-21T05:29:58.107298+0000 mgr.a (mgr.14388) 18852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:29:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:29:59 smithi049 bash[23528]: cephadm 2024-09-21T05:29:58.108733+0000 mgr.a (mgr.14388) 18853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:00 smithi044 bash[22676]: audit 2024-09-21T05:29:58.833542+0000 mgr.a (mgr.14388) 18854 : audit [DBG] from='client.404979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:00 smithi044 bash[22676]: cluster 2024-09-21T05:29:59.005369+0000 mgr.a (mgr.14388) 18855 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:00 smithi044 bash[22676]: cluster 2024-09-21T05:30:00.000163+0000 mon.a (mon.0) 14925 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:30:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:00 smithi179 bash[23186]: audit 2024-09-21T05:29:58.833542+0000 mgr.a (mgr.14388) 18854 : audit [DBG] from='client.404979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:00 smithi179 bash[23186]: cluster 2024-09-21T05:29:59.005369+0000 mgr.a (mgr.14388) 18855 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:00 smithi179 bash[23186]: cluster 2024-09-21T05:30:00.000163+0000 mon.a (mon.0) 14925 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:30:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:00 smithi049 bash[23528]: audit 2024-09-21T05:29:58.833542+0000 mgr.a (mgr.14388) 18854 : audit [DBG] from='client.404979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:00 smithi049 bash[23528]: cluster 2024-09-21T05:29:59.005369+0000 mgr.a (mgr.14388) 18855 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:00 smithi049 bash[23528]: cluster 2024-09-21T05:30:00.000163+0000 mon.a (mon.0) 14925 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:30:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:02 smithi044 bash[22676]: cluster 2024-09-21T05:30:01.007891+0000 mgr.a (mgr.14388) 18856 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:02 smithi179 bash[23186]: cluster 2024-09-21T05:30:01.007891+0000 mgr.a (mgr.14388) 18856 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:02 smithi049 bash[23528]: cluster 2024-09-21T05:30:01.007891+0000 mgr.a (mgr.14388) 18856 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:04.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:04.270 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:04.270 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:04 smithi044 bash[22676]: cluster 2024-09-21T05:30:03.008864+0000 mgr.a (mgr.14388) 18857 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:04 smithi179 bash[23186]: cluster 2024-09-21T05:30:03.008864+0000 mgr.a (mgr.14388) 18857 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:04 smithi049 bash[23528]: cluster 2024-09-21T05:30:03.008864+0000 mgr.a (mgr.14388) 18857 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:05.059 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:05.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:05.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:05.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:05.059 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: audit 2024-09-21T05:30:04.598514+0000 mon.a (mon.0) 14926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: audit 2024-09-21T05:30:04.604471+0000 mon.a (mon.0) 14927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: audit 2024-09-21T05:30:04.610857+0000 mon.a (mon.0) 14928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: audit 2024-09-21T05:30:04.612281+0000 mgr.a (mgr.14388) 18858 : audit [DBG] from='client.405054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: audit 2024-09-21T05:30:04.690806+0000 mon.a (mon.0) 14929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: audit 2024-09-21T05:30:04.696812+0000 mon.a (mon.0) 14930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: audit 2024-09-21T05:30:04.703051+0000 mon.a (mon.0) 14931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:05.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:05 smithi044 bash[22676]: cluster 2024-09-21T05:30:05.009469+0000 mgr.a (mgr.14388) 18859 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: audit 2024-09-21T05:30:04.598514+0000 mon.a (mon.0) 14926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: audit 2024-09-21T05:30:04.604471+0000 mon.a (mon.0) 14927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: audit 2024-09-21T05:30:04.610857+0000 mon.a (mon.0) 14928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: audit 2024-09-21T05:30:04.612281+0000 mgr.a (mgr.14388) 18858 : audit [DBG] from='client.405054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: audit 2024-09-21T05:30:04.690806+0000 mon.a (mon.0) 14929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: audit 2024-09-21T05:30:04.696812+0000 mon.a (mon.0) 14930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: audit 2024-09-21T05:30:04.703051+0000 mon.a (mon.0) 14931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:05 smithi179 bash[23186]: cluster 2024-09-21T05:30:05.009469+0000 mgr.a (mgr.14388) 18859 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: audit 2024-09-21T05:30:04.598514+0000 mon.a (mon.0) 14926 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: audit 2024-09-21T05:30:04.604471+0000 mon.a (mon.0) 14927 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: audit 2024-09-21T05:30:04.610857+0000 mon.a (mon.0) 14928 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: audit 2024-09-21T05:30:04.612281+0000 mgr.a (mgr.14388) 18858 : audit [DBG] from='client.405054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: audit 2024-09-21T05:30:04.690806+0000 mon.a (mon.0) 14929 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: audit 2024-09-21T05:30:04.696812+0000 mon.a (mon.0) 14930 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: audit 2024-09-21T05:30:04.703051+0000 mon.a (mon.0) 14931 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:05 smithi049 bash[23528]: cluster 2024-09-21T05:30:05.009469+0000 mgr.a (mgr.14388) 18859 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:08 smithi044 bash[22676]: cluster 2024-09-21T05:30:07.011764+0000 mgr.a (mgr.14388) 18860 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:08 smithi179 bash[23186]: cluster 2024-09-21T05:30:07.011764+0000 mgr.a (mgr.14388) 18860 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:08 smithi049 bash[23528]: cluster 2024-09-21T05:30:07.011764+0000 mgr.a (mgr.14388) 18860 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:10.060 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:10.061 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:10 smithi044 bash[22676]: cluster 2024-09-21T05:30:09.012722+0000 mgr.a (mgr.14388) 18861 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:10 smithi179 bash[23186]: cluster 2024-09-21T05:30:09.012722+0000 mgr.a (mgr.14388) 18861 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:10 smithi049 bash[23528]: cluster 2024-09-21T05:30:09.012722+0000 mgr.a (mgr.14388) 18861 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:10.818 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:10.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:12 smithi044 bash[22676]: audit 2024-09-21T05:30:10.388513+0000 mgr.a (mgr.14388) 18862 : audit [DBG] from='client.405132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:12 smithi044 bash[22676]: cluster 2024-09-21T05:30:11.015773+0000 mgr.a (mgr.14388) 18863 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:12 smithi179 bash[23186]: audit 2024-09-21T05:30:10.388513+0000 mgr.a (mgr.14388) 18862 : audit [DBG] from='client.405132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:12 smithi179 bash[23186]: cluster 2024-09-21T05:30:11.015773+0000 mgr.a (mgr.14388) 18863 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:12 smithi049 bash[23528]: audit 2024-09-21T05:30:10.388513+0000 mgr.a (mgr.14388) 18862 : audit [DBG] from='client.405132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:12 smithi049 bash[23528]: cluster 2024-09-21T05:30:11.015773+0000 mgr.a (mgr.14388) 18863 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:30:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:14 smithi044 bash[22676]: cluster 2024-09-21T05:30:13.016574+0000 mgr.a (mgr.14388) 18864 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:14 smithi179 bash[23186]: cluster 2024-09-21T05:30:13.016574+0000 mgr.a (mgr.14388) 18864 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:14 smithi049 bash[23528]: cluster 2024-09-21T05:30:13.016574+0000 mgr.a (mgr.14388) 18864 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:15.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:15.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:15.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:16 smithi044 bash[22676]: cluster 2024-09-21T05:30:15.017426+0000 mgr.a (mgr.14388) 18865 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:16 smithi044 bash[22676]: audit 2024-09-21T05:30:15.237229+0000 mon.a (mon.0) 14932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:16 smithi044 bash[22676]: audit 2024-09-21T05:30:15.245935+0000 mon.a (mon.0) 14933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:16 smithi044 bash[22676]: audit 2024-09-21T05:30:15.256749+0000 mon.a (mon.0) 14934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:16 smithi179 bash[23186]: cluster 2024-09-21T05:30:15.017426+0000 mgr.a (mgr.14388) 18865 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:16 smithi179 bash[23186]: audit 2024-09-21T05:30:15.237229+0000 mon.a (mon.0) 14932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:16 smithi179 bash[23186]: audit 2024-09-21T05:30:15.245935+0000 mon.a (mon.0) 14933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:16 smithi179 bash[23186]: audit 2024-09-21T05:30:15.256749+0000 mon.a (mon.0) 14934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:16 smithi049 bash[23528]: cluster 2024-09-21T05:30:15.017426+0000 mgr.a (mgr.14388) 18865 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:16 smithi049 bash[23528]: audit 2024-09-21T05:30:15.237229+0000 mon.a (mon.0) 14932 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:16 smithi049 bash[23528]: audit 2024-09-21T05:30:15.245935+0000 mon.a (mon.0) 14933 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:16 smithi049 bash[23528]: audit 2024-09-21T05:30:15.256749+0000 mon.a (mon.0) 14934 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:16.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:16.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:16.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:16.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:16.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:18.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:18 smithi044 bash[22676]: audit 2024-09-21T05:30:16.153422+0000 mgr.a (mgr.14388) 18866 : audit [DBG] from='client.405207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:18.453 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:18 smithi044 bash[22676]: cluster 2024-09-21T05:30:17.020491+0000 mgr.a (mgr.14388) 18867 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:18 smithi179 bash[23186]: audit 2024-09-21T05:30:16.153422+0000 mgr.a (mgr.14388) 18866 : audit [DBG] from='client.405207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:18 smithi179 bash[23186]: cluster 2024-09-21T05:30:17.020491+0000 mgr.a (mgr.14388) 18867 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:18 smithi049 bash[23528]: audit 2024-09-21T05:30:16.153422+0000 mgr.a (mgr.14388) 18866 : audit [DBG] from='client.405207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:18 smithi049 bash[23528]: cluster 2024-09-21T05:30:17.020491+0000 mgr.a (mgr.14388) 18867 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:20 smithi044 bash[22676]: cluster 2024-09-21T05:30:19.021095+0000 mgr.a (mgr.14388) 18868 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:20.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:20 smithi179 bash[23186]: cluster 2024-09-21T05:30:19.021095+0000 mgr.a (mgr.14388) 18868 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:20 smithi049 bash[23528]: cluster 2024-09-21T05:30:19.021095+0000 mgr.a (mgr.14388) 18868 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:30:21.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:21.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:22.405 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:22.405 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:22.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:22 smithi044 bash[22676]: cluster 2024-09-21T05:30:21.023281+0000 mgr.a (mgr.14388) 18869 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:22 smithi179 bash[23186]: cluster 2024-09-21T05:30:21.023281+0000 mgr.a (mgr.14388) 18869 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:22 smithi049 bash[23528]: cluster 2024-09-21T05:30:21.023281+0000 mgr.a (mgr.14388) 18869 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:23 smithi044 bash[22676]: audit 2024-09-21T05:30:21.940460+0000 mgr.a (mgr.14388) 18870 : audit [DBG] from='client.405279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:23 smithi179 bash[23186]: audit 2024-09-21T05:30:21.940460+0000 mgr.a (mgr.14388) 18870 : audit [DBG] from='client.405279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:23 smithi049 bash[23528]: audit 2024-09-21T05:30:21.940460+0000 mgr.a (mgr.14388) 18870 : audit [DBG] from='client.405279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:24 smithi044 bash[22676]: cluster 2024-09-21T05:30:23.024350+0000 mgr.a (mgr.14388) 18871 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:24.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:24 smithi179 bash[23186]: cluster 2024-09-21T05:30:23.024350+0000 mgr.a (mgr.14388) 18871 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:24 smithi049 bash[23528]: cluster 2024-09-21T05:30:23.024350+0000 mgr.a (mgr.14388) 18871 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:25 smithi044 bash[22676]: audit 2024-09-21T05:30:24.831712+0000 mon.a (mon.0) 14935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:25 smithi044 bash[22676]: audit 2024-09-21T05:30:24.840428+0000 mon.a (mon.0) 14936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:25 smithi044 bash[22676]: audit 2024-09-21T05:30:24.851539+0000 mon.a (mon.0) 14937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:25 smithi044 bash[22676]: audit 2024-09-21T05:30:24.899574+0000 mon.a (mon.0) 14938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:25 smithi044 bash[22676]: audit 2024-09-21T05:30:24.904798+0000 mon.a (mon.0) 14939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:25 smithi044 bash[22676]: audit 2024-09-21T05:30:24.910297+0000 mon.a (mon.0) 14940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:25 smithi044 bash[22676]: cluster 2024-09-21T05:30:25.026547+0000 mgr.a (mgr.14388) 18872 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:25 smithi179 bash[23186]: audit 2024-09-21T05:30:24.831712+0000 mon.a (mon.0) 14935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:25 smithi179 bash[23186]: audit 2024-09-21T05:30:24.840428+0000 mon.a (mon.0) 14936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:25 smithi179 bash[23186]: audit 2024-09-21T05:30:24.851539+0000 mon.a (mon.0) 14937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:25 smithi179 bash[23186]: audit 2024-09-21T05:30:24.899574+0000 mon.a (mon.0) 14938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:25 smithi179 bash[23186]: audit 2024-09-21T05:30:24.904798+0000 mon.a (mon.0) 14939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:25 smithi179 bash[23186]: audit 2024-09-21T05:30:24.910297+0000 mon.a (mon.0) 14940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:25 smithi179 bash[23186]: cluster 2024-09-21T05:30:25.026547+0000 mgr.a (mgr.14388) 18872 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:25 smithi049 bash[23528]: audit 2024-09-21T05:30:24.831712+0000 mon.a (mon.0) 14935 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:25 smithi049 bash[23528]: audit 2024-09-21T05:30:24.840428+0000 mon.a (mon.0) 14936 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:25 smithi049 bash[23528]: audit 2024-09-21T05:30:24.851539+0000 mon.a (mon.0) 14937 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:25 smithi049 bash[23528]: audit 2024-09-21T05:30:24.899574+0000 mon.a (mon.0) 14938 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:25 smithi049 bash[23528]: audit 2024-09-21T05:30:24.904798+0000 mon.a (mon.0) 14939 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:25 smithi049 bash[23528]: audit 2024-09-21T05:30:24.910297+0000 mon.a (mon.0) 14940 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:26.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:25 smithi049 bash[23528]: cluster 2024-09-21T05:30:25.026547+0000 mgr.a (mgr.14388) 18872 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:27.406 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:27.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:27.407 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:28.176 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:28.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:28.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:28.176 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:28.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:28 smithi049 bash[23528]: cluster 2024-09-21T05:30:27.027323+0000 mgr.a (mgr.14388) 18873 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:28 smithi044 bash[22676]: cluster 2024-09-21T05:30:27.027323+0000 mgr.a (mgr.14388) 18873 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:28 smithi179 bash[23186]: cluster 2024-09-21T05:30:27.027323+0000 mgr.a (mgr.14388) 18873 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:29.442 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:29 smithi049 bash[23528]: audit 2024-09-21T05:30:27.740728+0000 mgr.a (mgr.14388) 18874 : audit [DBG] from='client.405357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:29 smithi044 bash[22676]: audit 2024-09-21T05:30:27.740728+0000 mgr.a (mgr.14388) 18874 : audit [DBG] from='client.405357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:29 smithi179 bash[23186]: audit 2024-09-21T05:30:27.740728+0000 mgr.a (mgr.14388) 18874 : audit [DBG] from='client.405357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:30 smithi044 bash[22676]: cluster 2024-09-21T05:30:29.028323+0000 mgr.a (mgr.14388) 18875 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:30 smithi179 bash[23186]: cluster 2024-09-21T05:30:29.028323+0000 mgr.a (mgr.14388) 18875 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:30 smithi049 bash[23528]: cluster 2024-09-21T05:30:29.028323+0000 mgr.a (mgr.14388) 18875 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:32 smithi044 bash[22676]: cluster 2024-09-21T05:30:31.030776+0000 mgr.a (mgr.14388) 18876 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:32 smithi179 bash[23186]: cluster 2024-09-21T05:30:31.030776+0000 mgr.a (mgr.14388) 18876 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:32 smithi049 bash[23528]: cluster 2024-09-21T05:30:31.030776+0000 mgr.a (mgr.14388) 18876 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:33.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:33.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:33.178 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:33.966 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:33.966 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:33.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:33.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:33.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:34 smithi044 bash[22676]: cluster 2024-09-21T05:30:33.031595+0000 mgr.a (mgr.14388) 18877 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:34 smithi179 bash[23186]: cluster 2024-09-21T05:30:33.031595+0000 mgr.a (mgr.14388) 18877 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:34 smithi049 bash[23528]: cluster 2024-09-21T05:30:33.031595+0000 mgr.a (mgr.14388) 18877 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:35 smithi044 bash[22676]: audit 2024-09-21T05:30:33.514578+0000 mgr.a (mgr.14388) 18878 : audit [DBG] from='client.405432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:35.501 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:35 smithi049 bash[23528]: audit 2024-09-21T05:30:33.514578+0000 mgr.a (mgr.14388) 18878 : audit [DBG] from='client.405432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:35 smithi179 bash[23186]: audit 2024-09-21T05:30:33.514578+0000 mgr.a (mgr.14388) 18878 : audit [DBG] from='client.405432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:36 smithi044 bash[22676]: cluster 2024-09-21T05:30:35.033929+0000 mgr.a (mgr.14388) 18879 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:36 smithi044 bash[22676]: audit 2024-09-21T05:30:35.475633+0000 mon.a (mon.0) 14941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:36 smithi044 bash[22676]: audit 2024-09-21T05:30:35.484964+0000 mon.a (mon.0) 14942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:36 smithi044 bash[22676]: audit 2024-09-21T05:30:35.497540+0000 mon.a (mon.0) 14943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:36 smithi179 bash[23186]: cluster 2024-09-21T05:30:35.033929+0000 mgr.a (mgr.14388) 18879 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:36 smithi179 bash[23186]: audit 2024-09-21T05:30:35.475633+0000 mon.a (mon.0) 14941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:36 smithi179 bash[23186]: audit 2024-09-21T05:30:35.484964+0000 mon.a (mon.0) 14942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:36 smithi179 bash[23186]: audit 2024-09-21T05:30:35.497540+0000 mon.a (mon.0) 14943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:36 smithi049 bash[23528]: cluster 2024-09-21T05:30:35.033929+0000 mgr.a (mgr.14388) 18879 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:36.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:36 smithi049 bash[23528]: audit 2024-09-21T05:30:35.475633+0000 mon.a (mon.0) 14941 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:36 smithi049 bash[23528]: audit 2024-09-21T05:30:35.484964+0000 mon.a (mon.0) 14942 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:36.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:36 smithi049 bash[23528]: audit 2024-09-21T05:30:35.497540+0000 mon.a (mon.0) 14943 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:38.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:38 smithi044 bash[22676]: cluster 2024-09-21T05:30:37.034727+0000 mgr.a (mgr.14388) 18880 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:38.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:38 smithi179 bash[23186]: cluster 2024-09-21T05:30:37.034727+0000 mgr.a (mgr.14388) 18880 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:38 smithi049 bash[23528]: cluster 2024-09-21T05:30:37.034727+0000 mgr.a (mgr.14388) 18880 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:38.968 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:38.969 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:40.378 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:40 smithi044 bash[22676]: cluster 2024-09-21T05:30:39.035412+0000 mgr.a (mgr.14388) 18881 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:40 smithi179 bash[23186]: cluster 2024-09-21T05:30:39.035412+0000 mgr.a (mgr.14388) 18881 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:40 smithi049 bash[23528]: cluster 2024-09-21T05:30:39.035412+0000 mgr.a (mgr.14388) 18881 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:41 smithi044 bash[22676]: audit 2024-09-21T05:30:39.297146+0000 mgr.a (mgr.14388) 18882 : audit [DBG] from='client.405507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:41 smithi179 bash[23186]: audit 2024-09-21T05:30:39.297146+0000 mgr.a (mgr.14388) 18882 : audit [DBG] from='client.405507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:41 smithi049 bash[23528]: audit 2024-09-21T05:30:39.297146+0000 mgr.a (mgr.14388) 18882 : audit [DBG] from='client.405507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:42 smithi044 bash[22676]: cluster 2024-09-21T05:30:41.036904+0000 mgr.a (mgr.14388) 18883 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:42 smithi179 bash[23186]: cluster 2024-09-21T05:30:41.036904+0000 mgr.a (mgr.14388) 18883 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:42 smithi049 bash[23528]: cluster 2024-09-21T05:30:41.036904+0000 mgr.a (mgr.14388) 18883 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:30:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:43 smithi044 bash[22676]: cluster 2024-09-21T05:30:43.037677+0000 mgr.a (mgr.14388) 18884 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:43 smithi179 bash[23186]: cluster 2024-09-21T05:30:43.037677+0000 mgr.a (mgr.14388) 18884 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:43 smithi049 bash[23528]: cluster 2024-09-21T05:30:43.037677+0000 mgr.a (mgr.14388) 18884 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:44.702 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:44.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:44.703 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:45.507 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:45.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:45.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:45.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:45.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: audit 2024-09-21T05:30:45.027044+0000 mon.a (mon.0) 14944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: audit 2024-09-21T05:30:45.033869+0000 mon.a (mon.0) 14945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: cluster 2024-09-21T05:30:45.039665+0000 mgr.a (mgr.14388) 18885 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: audit 2024-09-21T05:30:45.044700+0000 mon.a (mon.0) 14946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: audit 2024-09-21T05:30:45.044885+0000 mgr.a (mgr.14388) 18886 : audit [DBG] from='client.405585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: audit 2024-09-21T05:30:45.111114+0000 mon.a (mon.0) 14947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: audit 2024-09-21T05:30:45.116692+0000 mon.a (mon.0) 14948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:46 smithi179 bash[23186]: audit 2024-09-21T05:30:45.122689+0000 mon.a (mon.0) 14949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: audit 2024-09-21T05:30:45.027044+0000 mon.a (mon.0) 14944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: audit 2024-09-21T05:30:45.033869+0000 mon.a (mon.0) 14945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: cluster 2024-09-21T05:30:45.039665+0000 mgr.a (mgr.14388) 18885 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: audit 2024-09-21T05:30:45.044700+0000 mon.a (mon.0) 14946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: audit 2024-09-21T05:30:45.044885+0000 mgr.a (mgr.14388) 18886 : audit [DBG] from='client.405585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: audit 2024-09-21T05:30:45.111114+0000 mon.a (mon.0) 14947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: audit 2024-09-21T05:30:45.116692+0000 mon.a (mon.0) 14948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:46 smithi049 bash[23528]: audit 2024-09-21T05:30:45.122689+0000 mon.a (mon.0) 14949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: audit 2024-09-21T05:30:45.027044+0000 mon.a (mon.0) 14944 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: audit 2024-09-21T05:30:45.033869+0000 mon.a (mon.0) 14945 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: cluster 2024-09-21T05:30:45.039665+0000 mgr.a (mgr.14388) 18885 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: audit 2024-09-21T05:30:45.044700+0000 mon.a (mon.0) 14946 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: audit 2024-09-21T05:30:45.044885+0000 mgr.a (mgr.14388) 18886 : audit [DBG] from='client.405585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: audit 2024-09-21T05:30:45.111114+0000 mon.a (mon.0) 14947 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: audit 2024-09-21T05:30:45.116692+0000 mon.a (mon.0) 14948 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:46.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:46 smithi044 bash[22676]: audit 2024-09-21T05:30:45.122689+0000 mon.a (mon.0) 14949 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:48.190 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:48 smithi049 bash[23528]: cluster 2024-09-21T05:30:47.040598+0000 mgr.a (mgr.14388) 18887 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:48 smithi044 bash[22676]: cluster 2024-09-21T05:30:47.040598+0000 mgr.a (mgr.14388) 18887 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:48 smithi179 bash[23186]: cluster 2024-09-21T05:30:47.040598+0000 mgr.a (mgr.14388) 18887 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:50.454 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:50 smithi049 bash[23528]: cluster 2024-09-21T05:30:49.041543+0000 mgr.a (mgr.14388) 18888 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:50 smithi044 bash[22676]: cluster 2024-09-21T05:30:49.041543+0000 mgr.a (mgr.14388) 18888 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:50 smithi179 bash[23186]: cluster 2024-09-21T05:30:49.041543+0000 mgr.a (mgr.14388) 18888 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:50.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:50.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:50.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:51.303 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:52 smithi044 bash[22676]: audit 2024-09-21T05:30:50.844788+0000 mgr.a (mgr.14388) 18889 : audit [DBG] from='client.405660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:52 smithi044 bash[22676]: cluster 2024-09-21T05:30:51.043624+0000 mgr.a (mgr.14388) 18890 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:52 smithi179 bash[23186]: audit 2024-09-21T05:30:50.844788+0000 mgr.a (mgr.14388) 18889 : audit [DBG] from='client.405660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:52 smithi179 bash[23186]: cluster 2024-09-21T05:30:51.043624+0000 mgr.a (mgr.14388) 18890 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:52 smithi049 bash[23528]: audit 2024-09-21T05:30:50.844788+0000 mgr.a (mgr.14388) 18889 : audit [DBG] from='client.405660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:52 smithi049 bash[23528]: cluster 2024-09-21T05:30:51.043624+0000 mgr.a (mgr.14388) 18890 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:54.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:54 smithi044 bash[22676]: cluster 2024-09-21T05:30:53.044551+0000 mgr.a (mgr.14388) 18891 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:54.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:54 smithi179 bash[23186]: cluster 2024-09-21T05:30:53.044551+0000 mgr.a (mgr.14388) 18891 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:54.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:54 smithi049 bash[23528]: cluster 2024-09-21T05:30:53.044551+0000 mgr.a (mgr.14388) 18891 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:30:56.304 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:30:56.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:30:56.305 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:30:56.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:56 smithi179 bash[23186]: cluster 2024-09-21T05:30:55.046761+0000 mgr.a (mgr.14388) 18892 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:56.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:56 smithi179 bash[23186]: audit 2024-09-21T05:30:55.713592+0000 mon.a (mon.0) 14950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:56 smithi179 bash[23186]: audit 2024-09-21T05:30:55.722405+0000 mon.a (mon.0) 14951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:56 smithi179 bash[23186]: audit 2024-09-21T05:30:55.733032+0000 mon.a (mon.0) 14952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:56 smithi044 bash[22676]: cluster 2024-09-21T05:30:55.046761+0000 mgr.a (mgr.14388) 18892 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:56 smithi044 bash[22676]: audit 2024-09-21T05:30:55.713592+0000 mon.a (mon.0) 14950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:56 smithi044 bash[22676]: audit 2024-09-21T05:30:55.722405+0000 mon.a (mon.0) 14951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:56 smithi044 bash[22676]: audit 2024-09-21T05:30:55.733032+0000 mon.a (mon.0) 14952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:56 smithi049 bash[23528]: cluster 2024-09-21T05:30:55.046761+0000 mgr.a (mgr.14388) 18892 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:56 smithi049 bash[23528]: audit 2024-09-21T05:30:55.713592+0000 mon.a (mon.0) 14950 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:56 smithi049 bash[23528]: audit 2024-09-21T05:30:55.722405+0000 mon.a (mon.0) 14951 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:56.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:56 smithi049 bash[23528]: audit 2024-09-21T05:30:55.733032+0000 mon.a (mon.0) 14952 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:57.082 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:30:57.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:30:57.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:30:57.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:30:57.083 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:30:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:58 smithi044 bash[22676]: audit 2024-09-21T05:30:56.639554+0000 mgr.a (mgr.14388) 18893 : audit [DBG] from='client.405735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:58 smithi044 bash[22676]: cluster 2024-09-21T05:30:57.047247+0000 mgr.a (mgr.14388) 18894 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:58 smithi179 bash[23186]: audit 2024-09-21T05:30:56.639554+0000 mgr.a (mgr.14388) 18893 : audit [DBG] from='client.405735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:58 smithi179 bash[23186]: cluster 2024-09-21T05:30:57.047247+0000 mgr.a (mgr.14388) 18894 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:58 smithi049 bash[23528]: audit 2024-09-21T05:30:56.639554+0000 mgr.a (mgr.14388) 18893 : audit [DBG] from='client.405735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:58 smithi049 bash[23528]: cluster 2024-09-21T05:30:57.047247+0000 mgr.a (mgr.14388) 18894 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:30:59.155 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:30:58 smithi044 bash[22930]: debug 2024-09-21T05:30:58.972+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:30:59.156 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:30:58 smithi044 bash[22930]: debug 2024-09-21T05:30:58.972+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:30:59.156 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:59 smithi044 bash[22676]: audit 2024-09-21T05:30:58.173350+0000 mon.a (mon.0) 14953 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:30:59.156 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:59 smithi044 bash[22676]: audit 2024-09-21T05:30:58.180761+0000 mon.a (mon.0) 14954 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:59.156 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:59 smithi044 bash[22676]: audit 2024-09-21T05:30:58.182849+0000 mon.a (mon.0) 14955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:59.156 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:59 smithi044 bash[22676]: audit 2024-09-21T05:30:58.194468+0000 mon.a (mon.0) 14956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:59.156 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:30:59 smithi044 bash[22676]: audit 2024-09-21T05:30:58.200811+0000 mon.a (mon.0) 14957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:59 smithi179 bash[23186]: audit 2024-09-21T05:30:58.173350+0000 mon.a (mon.0) 14953 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:59 smithi179 bash[23186]: audit 2024-09-21T05:30:58.180761+0000 mon.a (mon.0) 14954 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:59 smithi179 bash[23186]: audit 2024-09-21T05:30:58.182849+0000 mon.a (mon.0) 14955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:59 smithi179 bash[23186]: audit 2024-09-21T05:30:58.194468+0000 mon.a (mon.0) 14956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:30:59 smithi179 bash[23186]: audit 2024-09-21T05:30:58.200811+0000 mon.a (mon.0) 14957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:30:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:59 smithi049 bash[23528]: audit 2024-09-21T05:30:58.173350+0000 mon.a (mon.0) 14953 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:30:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:59 smithi049 bash[23528]: audit 2024-09-21T05:30:58.180761+0000 mon.a (mon.0) 14954 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:59 smithi049 bash[23528]: audit 2024-09-21T05:30:58.182849+0000 mon.a (mon.0) 14955 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:59 smithi049 bash[23528]: audit 2024-09-21T05:30:58.194468+0000 mon.a (mon.0) 14956 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:30:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:30:59 smithi049 bash[23528]: audit 2024-09-21T05:30:58.200811+0000 mon.a (mon.0) 14957 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:31:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:00 smithi179 bash[23186]: audit 2024-09-21T05:30:58.203589+0000 mgr.a (mgr.14388) 18895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:31:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:00 smithi179 bash[23186]: audit 2024-09-21T05:30:58.974240+0000 mgr.a (mgr.14388) 18896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:31:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:00 smithi179 bash[23186]: cephadm 2024-09-21T05:30:58.975384+0000 mgr.a (mgr.14388) 18897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:31:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:00 smithi179 bash[23186]: cluster 2024-09-21T05:30:59.047797+0000 mgr.a (mgr.14388) 18898 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:00.464 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:00 smithi049 bash[23528]: audit 2024-09-21T05:30:58.203589+0000 mgr.a (mgr.14388) 18895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:31:00.464 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:00 smithi049 bash[23528]: audit 2024-09-21T05:30:58.974240+0000 mgr.a (mgr.14388) 18896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:31:00.464 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:00 smithi049 bash[23528]: cephadm 2024-09-21T05:30:58.975384+0000 mgr.a (mgr.14388) 18897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:31:00.464 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:00 smithi049 bash[23528]: cluster 2024-09-21T05:30:59.047797+0000 mgr.a (mgr.14388) 18898 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:00 smithi044 bash[22676]: audit 2024-09-21T05:30:58.203589+0000 mgr.a (mgr.14388) 18895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:31:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:00 smithi044 bash[22676]: audit 2024-09-21T05:30:58.974240+0000 mgr.a (mgr.14388) 18896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:31:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:00 smithi044 bash[22676]: cephadm 2024-09-21T05:30:58.975384+0000 mgr.a (mgr.14388) 18897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:31:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:00 smithi044 bash[22676]: cluster 2024-09-21T05:30:59.047797+0000 mgr.a (mgr.14388) 18898 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:02.084 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:02.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:02.085 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:02.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:02 smithi044 bash[22676]: cluster 2024-09-21T05:31:01.049895+0000 mgr.a (mgr.14388) 18899 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:02 smithi179 bash[23186]: cluster 2024-09-21T05:31:01.049895+0000 mgr.a (mgr.14388) 18899 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:02 smithi049 bash[23528]: cluster 2024-09-21T05:31:01.049895+0000 mgr.a (mgr.14388) 18899 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:02.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:02.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:02.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:02.866 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:02.866 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:04 smithi044 bash[22676]: audit 2024-09-21T05:31:02.418757+0000 mgr.a (mgr.14388) 18900 : audit [DBG] from='client.405915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:04 smithi044 bash[22676]: cluster 2024-09-21T05:31:03.050883+0000 mgr.a (mgr.14388) 18901 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:04 smithi179 bash[23186]: audit 2024-09-21T05:31:02.418757+0000 mgr.a (mgr.14388) 18900 : audit [DBG] from='client.405915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:04 smithi179 bash[23186]: cluster 2024-09-21T05:31:03.050883+0000 mgr.a (mgr.14388) 18901 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:04 smithi049 bash[23528]: audit 2024-09-21T05:31:02.418757+0000 mgr.a (mgr.14388) 18900 : audit [DBG] from='client.405915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:04 smithi049 bash[23528]: cluster 2024-09-21T05:31:03.050883+0000 mgr.a (mgr.14388) 18901 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:06 smithi044 bash[22676]: cluster 2024-09-21T05:31:05.052857+0000 mgr.a (mgr.14388) 18902 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:06 smithi044 bash[22676]: audit 2024-09-21T05:31:05.251611+0000 mon.a (mon.0) 14958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:06 smithi044 bash[22676]: audit 2024-09-21T05:31:05.259417+0000 mon.a (mon.0) 14959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:06 smithi044 bash[22676]: audit 2024-09-21T05:31:05.270029+0000 mon.a (mon.0) 14960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:06 smithi044 bash[22676]: audit 2024-09-21T05:31:05.329242+0000 mon.a (mon.0) 14961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:06 smithi044 bash[22676]: audit 2024-09-21T05:31:05.337954+0000 mon.a (mon.0) 14962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:06 smithi044 bash[22676]: audit 2024-09-21T05:31:05.348346+0000 mon.a (mon.0) 14963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:06 smithi179 bash[23186]: cluster 2024-09-21T05:31:05.052857+0000 mgr.a (mgr.14388) 18902 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:06 smithi179 bash[23186]: audit 2024-09-21T05:31:05.251611+0000 mon.a (mon.0) 14958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:06 smithi179 bash[23186]: audit 2024-09-21T05:31:05.259417+0000 mon.a (mon.0) 14959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:06 smithi179 bash[23186]: audit 2024-09-21T05:31:05.270029+0000 mon.a (mon.0) 14960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:06 smithi179 bash[23186]: audit 2024-09-21T05:31:05.329242+0000 mon.a (mon.0) 14961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:06 smithi179 bash[23186]: audit 2024-09-21T05:31:05.337954+0000 mon.a (mon.0) 14962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:06 smithi179 bash[23186]: audit 2024-09-21T05:31:05.348346+0000 mon.a (mon.0) 14963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:06 smithi049 bash[23528]: cluster 2024-09-21T05:31:05.052857+0000 mgr.a (mgr.14388) 18902 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:06 smithi049 bash[23528]: audit 2024-09-21T05:31:05.251611+0000 mon.a (mon.0) 14958 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:06 smithi049 bash[23528]: audit 2024-09-21T05:31:05.259417+0000 mon.a (mon.0) 14959 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:06 smithi049 bash[23528]: audit 2024-09-21T05:31:05.270029+0000 mon.a (mon.0) 14960 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:06 smithi049 bash[23528]: audit 2024-09-21T05:31:05.329242+0000 mon.a (mon.0) 14961 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:06 smithi049 bash[23528]: audit 2024-09-21T05:31:05.337954+0000 mon.a (mon.0) 14962 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:06 smithi049 bash[23528]: audit 2024-09-21T05:31:05.348346+0000 mon.a (mon.0) 14963 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:07 smithi049 bash[23528]: cluster 2024-09-21T05:31:07.053697+0000 mgr.a (mgr.14388) 18903 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:07 smithi044 bash[22676]: cluster 2024-09-21T05:31:07.053697+0000 mgr.a (mgr.14388) 18903 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:07 smithi179 bash[23186]: cluster 2024-09-21T05:31:07.053697+0000 mgr.a (mgr.14388) 18903 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:07.870 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:07.870 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:08.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:08.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:08.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:08.670 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:08.670 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:10 smithi044 bash[22676]: audit 2024-09-21T05:31:08.205164+0000 mgr.a (mgr.14388) 18904 : audit [DBG] from='client.405993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:10 smithi044 bash[22676]: cluster 2024-09-21T05:31:09.054729+0000 mgr.a (mgr.14388) 18905 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:10 smithi179 bash[23186]: audit 2024-09-21T05:31:08.205164+0000 mgr.a (mgr.14388) 18904 : audit [DBG] from='client.405993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:10 smithi179 bash[23186]: cluster 2024-09-21T05:31:09.054729+0000 mgr.a (mgr.14388) 18905 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:10 smithi049 bash[23528]: audit 2024-09-21T05:31:08.205164+0000 mgr.a (mgr.14388) 18904 : audit [DBG] from='client.405993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:10 smithi049 bash[23528]: cluster 2024-09-21T05:31:09.054729+0000 mgr.a (mgr.14388) 18905 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:12 smithi044 bash[22676]: cluster 2024-09-21T05:31:11.057040+0000 mgr.a (mgr.14388) 18906 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:12 smithi179 bash[23186]: cluster 2024-09-21T05:31:11.057040+0000 mgr.a (mgr.14388) 18906 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:12 smithi049 bash[23528]: cluster 2024-09-21T05:31:11.057040+0000 mgr.a (mgr.14388) 18906 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:31:13.671 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:13.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:13.672 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:14.466 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:14 smithi044 bash[22676]: cluster 2024-09-21T05:31:13.057906+0000 mgr.a (mgr.14388) 18907 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:14 smithi179 bash[23186]: cluster 2024-09-21T05:31:13.057906+0000 mgr.a (mgr.14388) 18907 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:14 smithi049 bash[23528]: cluster 2024-09-21T05:31:13.057906+0000 mgr.a (mgr.14388) 18907 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:15 smithi044 bash[22676]: audit 2024-09-21T05:31:14.010914+0000 mgr.a (mgr.14388) 18908 : audit [DBG] from='client.406071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:15 smithi179 bash[23186]: audit 2024-09-21T05:31:14.010914+0000 mgr.a (mgr.14388) 18908 : audit [DBG] from='client.406071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:15 smithi049 bash[23528]: audit 2024-09-21T05:31:14.010914+0000 mgr.a (mgr.14388) 18908 : audit [DBG] from='client.406071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:16 smithi049 bash[23528]: cluster 2024-09-21T05:31:15.060311+0000 mgr.a (mgr.14388) 18909 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:16 smithi049 bash[23528]: audit 2024-09-21T05:31:15.951265+0000 mon.a (mon.0) 14964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:16 smithi049 bash[23528]: audit 2024-09-21T05:31:15.959791+0000 mon.a (mon.0) 14965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:16 smithi049 bash[23528]: audit 2024-09-21T05:31:15.971641+0000 mon.a (mon.0) 14966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:16 smithi044 bash[22676]: cluster 2024-09-21T05:31:15.060311+0000 mgr.a (mgr.14388) 18909 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:16 smithi044 bash[22676]: audit 2024-09-21T05:31:15.951265+0000 mon.a (mon.0) 14964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:16 smithi044 bash[22676]: audit 2024-09-21T05:31:15.959791+0000 mon.a (mon.0) 14965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:16 smithi044 bash[22676]: audit 2024-09-21T05:31:15.971641+0000 mon.a (mon.0) 14966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:16 smithi179 bash[23186]: cluster 2024-09-21T05:31:15.060311+0000 mgr.a (mgr.14388) 18909 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:16 smithi179 bash[23186]: audit 2024-09-21T05:31:15.951265+0000 mon.a (mon.0) 14964 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:16 smithi179 bash[23186]: audit 2024-09-21T05:31:15.959791+0000 mon.a (mon.0) 14965 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:16 smithi179 bash[23186]: audit 2024-09-21T05:31:15.971641+0000 mon.a (mon.0) 14966 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:18 smithi044 bash[22676]: cluster 2024-09-21T05:31:17.061113+0000 mgr.a (mgr.14388) 18910 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:18 smithi179 bash[23186]: cluster 2024-09-21T05:31:17.061113+0000 mgr.a (mgr.14388) 18910 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:18 smithi049 bash[23528]: cluster 2024-09-21T05:31:17.061113+0000 mgr.a (mgr.14388) 18910 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:20.258 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:20.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:20.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:20.259 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:20.259 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:20.406 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:20 smithi179 bash[23186]: cluster 2024-09-21T05:31:19.061914+0000 mgr.a (mgr.14388) 18911 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:20 smithi044 bash[22676]: cluster 2024-09-21T05:31:19.061914+0000 mgr.a (mgr.14388) 18911 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:20 smithi049 bash[23528]: cluster 2024-09-21T05:31:19.061914+0000 mgr.a (mgr.14388) 18911 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:21 smithi044 bash[22676]: audit 2024-09-21T05:31:19.800513+0000 mgr.a (mgr.14388) 18912 : audit [DBG] from='client.406146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:21 smithi179 bash[23186]: audit 2024-09-21T05:31:19.800513+0000 mgr.a (mgr.14388) 18912 : audit [DBG] from='client.406146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:21 smithi049 bash[23528]: audit 2024-09-21T05:31:19.800513+0000 mgr.a (mgr.14388) 18912 : audit [DBG] from='client.406146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:22.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:22 smithi044 bash[22676]: cluster 2024-09-21T05:31:21.065032+0000 mgr.a (mgr.14388) 18913 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:22.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:22 smithi179 bash[23186]: cluster 2024-09-21T05:31:21.065032+0000 mgr.a (mgr.14388) 18913 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:22.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:22 smithi049 bash[23528]: cluster 2024-09-21T05:31:21.065032+0000 mgr.a (mgr.14388) 18913 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:23 smithi044 bash[22676]: cluster 2024-09-21T05:31:23.065873+0000 mgr.a (mgr.14388) 18914 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:23 smithi179 bash[23186]: cluster 2024-09-21T05:31:23.065873+0000 mgr.a (mgr.14388) 18914 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:23 smithi049 bash[23528]: cluster 2024-09-21T05:31:23.065873+0000 mgr.a (mgr.14388) 18914 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:25.260 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:25.261 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:26.024 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:26.024 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:26 smithi044 bash[22676]: cluster 2024-09-21T05:31:25.068131+0000 mgr.a (mgr.14388) 18915 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:26 smithi044 bash[22676]: audit 2024-09-21T05:31:25.432770+0000 mon.a (mon.0) 14967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:26 smithi044 bash[22676]: audit 2024-09-21T05:31:25.437209+0000 mon.a (mon.0) 14968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:26 smithi044 bash[22676]: audit 2024-09-21T05:31:25.443538+0000 mon.a (mon.0) 14969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:26 smithi044 bash[22676]: audit 2024-09-21T05:31:25.542372+0000 mon.a (mon.0) 14970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:26 smithi044 bash[22676]: audit 2024-09-21T05:31:25.550227+0000 mon.a (mon.0) 14971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:26 smithi044 bash[22676]: audit 2024-09-21T05:31:25.559721+0000 mon.a (mon.0) 14972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:26 smithi179 bash[23186]: cluster 2024-09-21T05:31:25.068131+0000 mgr.a (mgr.14388) 18915 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:26 smithi179 bash[23186]: audit 2024-09-21T05:31:25.432770+0000 mon.a (mon.0) 14967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:26 smithi179 bash[23186]: audit 2024-09-21T05:31:25.437209+0000 mon.a (mon.0) 14968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:26 smithi179 bash[23186]: audit 2024-09-21T05:31:25.443538+0000 mon.a (mon.0) 14969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:26 smithi179 bash[23186]: audit 2024-09-21T05:31:25.542372+0000 mon.a (mon.0) 14970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:26 smithi179 bash[23186]: audit 2024-09-21T05:31:25.550227+0000 mon.a (mon.0) 14971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:26 smithi179 bash[23186]: audit 2024-09-21T05:31:25.559721+0000 mon.a (mon.0) 14972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:26 smithi049 bash[23528]: cluster 2024-09-21T05:31:25.068131+0000 mgr.a (mgr.14388) 18915 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:26 smithi049 bash[23528]: audit 2024-09-21T05:31:25.432770+0000 mon.a (mon.0) 14967 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:26 smithi049 bash[23528]: audit 2024-09-21T05:31:25.437209+0000 mon.a (mon.0) 14968 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:26 smithi049 bash[23528]: audit 2024-09-21T05:31:25.443538+0000 mon.a (mon.0) 14969 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:26 smithi049 bash[23528]: audit 2024-09-21T05:31:25.542372+0000 mon.a (mon.0) 14970 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:26 smithi049 bash[23528]: audit 2024-09-21T05:31:25.550227+0000 mon.a (mon.0) 14971 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:26.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:26 smithi049 bash[23528]: audit 2024-09-21T05:31:25.559721+0000 mon.a (mon.0) 14972 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:27 smithi044 bash[22676]: audit 2024-09-21T05:31:25.593059+0000 mgr.a (mgr.14388) 18916 : audit [DBG] from='client.406224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:27.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:27 smithi179 bash[23186]: audit 2024-09-21T05:31:25.593059+0000 mgr.a (mgr.14388) 18916 : audit [DBG] from='client.406224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:27 smithi049 bash[23528]: audit 2024-09-21T05:31:25.593059+0000 mgr.a (mgr.14388) 18916 : audit [DBG] from='client.406224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:28 smithi044 bash[22676]: cluster 2024-09-21T05:31:27.069061+0000 mgr.a (mgr.14388) 18917 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:28.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:28 smithi179 bash[23186]: cluster 2024-09-21T05:31:27.069061+0000 mgr.a (mgr.14388) 18917 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:28 smithi049 bash[23528]: cluster 2024-09-21T05:31:27.069061+0000 mgr.a (mgr.14388) 18917 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:30 smithi044 bash[22676]: cluster 2024-09-21T05:31:29.069865+0000 mgr.a (mgr.14388) 18918 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:30.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:30 smithi179 bash[23186]: cluster 2024-09-21T05:31:29.069865+0000 mgr.a (mgr.14388) 18918 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:30 smithi049 bash[23528]: cluster 2024-09-21T05:31:29.069865+0000 mgr.a (mgr.14388) 18918 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:31:31.025 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:31.026 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:31.795 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:31.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:31.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:31.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:31.796 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:32.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:32 smithi044 bash[22676]: cluster 2024-09-21T05:31:31.071268+0000 mgr.a (mgr.14388) 18919 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:32.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:32 smithi179 bash[23186]: cluster 2024-09-21T05:31:31.071268+0000 mgr.a (mgr.14388) 18919 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:32.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:32 smithi049 bash[23528]: cluster 2024-09-21T05:31:31.071268+0000 mgr.a (mgr.14388) 18919 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:33 smithi044 bash[22676]: audit 2024-09-21T05:31:31.357074+0000 mgr.a (mgr.14388) 18920 : audit [DBG] from='client.406299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:33 smithi179 bash[23186]: audit 2024-09-21T05:31:31.357074+0000 mgr.a (mgr.14388) 18920 : audit [DBG] from='client.406299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:33 smithi049 bash[23528]: audit 2024-09-21T05:31:31.357074+0000 mgr.a (mgr.14388) 18920 : audit [DBG] from='client.406299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:34.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:34 smithi044 bash[22676]: cluster 2024-09-21T05:31:33.072133+0000 mgr.a (mgr.14388) 18921 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:34.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:34 smithi179 bash[23186]: cluster 2024-09-21T05:31:33.072133+0000 mgr.a (mgr.14388) 18921 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:34 smithi049 bash[23528]: cluster 2024-09-21T05:31:33.072133+0000 mgr.a (mgr.14388) 18921 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:35 smithi044 bash[22676]: cluster 2024-09-21T05:31:35.074389+0000 mgr.a (mgr.14388) 18922 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:35 smithi179 bash[23186]: cluster 2024-09-21T05:31:35.074389+0000 mgr.a (mgr.14388) 18922 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:35 smithi049 bash[23528]: cluster 2024-09-21T05:31:35.074389+0000 mgr.a (mgr.14388) 18922 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:36.797 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:36.798 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:36.798 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:37 smithi044 bash[22676]: audit 2024-09-21T05:31:36.185967+0000 mon.a (mon.0) 14973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:37 smithi044 bash[22676]: audit 2024-09-21T05:31:36.194534+0000 mon.a (mon.0) 14974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:37 smithi044 bash[22676]: audit 2024-09-21T05:31:36.204846+0000 mon.a (mon.0) 14975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:37 smithi044 bash[22676]: cluster 2024-09-21T05:31:37.075154+0000 mgr.a (mgr.14388) 18923 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:37 smithi044 bash[22676]: audit 2024-09-21T05:31:37.136227+0000 mgr.a (mgr.14388) 18924 : audit [DBG] from='client.406374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:37 smithi179 bash[23186]: audit 2024-09-21T05:31:36.185967+0000 mon.a (mon.0) 14973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:37 smithi179 bash[23186]: audit 2024-09-21T05:31:36.194534+0000 mon.a (mon.0) 14974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:37 smithi179 bash[23186]: audit 2024-09-21T05:31:36.204846+0000 mon.a (mon.0) 14975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:37 smithi179 bash[23186]: cluster 2024-09-21T05:31:37.075154+0000 mgr.a (mgr.14388) 18923 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:37 smithi179 bash[23186]: audit 2024-09-21T05:31:37.136227+0000 mgr.a (mgr.14388) 18924 : audit [DBG] from='client.406374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:37 smithi049 bash[23528]: audit 2024-09-21T05:31:36.185967+0000 mon.a (mon.0) 14973 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:37 smithi049 bash[23528]: audit 2024-09-21T05:31:36.194534+0000 mon.a (mon.0) 14974 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:37 smithi049 bash[23528]: audit 2024-09-21T05:31:36.204846+0000 mon.a (mon.0) 14975 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:37 smithi049 bash[23528]: cluster 2024-09-21T05:31:37.075154+0000 mgr.a (mgr.14388) 18923 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:37 smithi049 bash[23528]: audit 2024-09-21T05:31:37.136227+0000 mgr.a (mgr.14388) 18924 : audit [DBG] from='client.406374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:37.597 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:37.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:37.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:37.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:37.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:40.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:40 smithi179 bash[23186]: cluster 2024-09-21T05:31:39.076042+0000 mgr.a (mgr.14388) 18925 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:40.424 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:40 smithi044 bash[22676]: cluster 2024-09-21T05:31:39.076042+0000 mgr.a (mgr.14388) 18925 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:40 smithi049 bash[23528]: cluster 2024-09-21T05:31:39.076042+0000 mgr.a (mgr.14388) 18925 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:42 smithi044 bash[22676]: cluster 2024-09-21T05:31:41.078362+0000 mgr.a (mgr.14388) 18926 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:42.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:42 smithi179 bash[23186]: cluster 2024-09-21T05:31:41.078362+0000 mgr.a (mgr.14388) 18926 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:42.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:42 smithi049 bash[23528]: cluster 2024-09-21T05:31:41.078362+0000 mgr.a (mgr.14388) 18926 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:42.599 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:42.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:42.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:43.394 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:43.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:43.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:43.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:43.395 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:44 smithi044 bash[22676]: audit 2024-09-21T05:31:42.932011+0000 mgr.a (mgr.14388) 18927 : audit [DBG] from='client.406452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:44 smithi044 bash[22676]: cluster 2024-09-21T05:31:43.082307+0000 mgr.a (mgr.14388) 18928 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:44 smithi179 bash[23186]: audit 2024-09-21T05:31:42.932011+0000 mgr.a (mgr.14388) 18927 : audit [DBG] from='client.406452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:44 smithi179 bash[23186]: cluster 2024-09-21T05:31:43.082307+0000 mgr.a (mgr.14388) 18928 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:44 smithi049 bash[23528]: audit 2024-09-21T05:31:42.932011+0000 mgr.a (mgr.14388) 18927 : audit [DBG] from='client.406452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:44 smithi049 bash[23528]: cluster 2024-09-21T05:31:43.082307+0000 mgr.a (mgr.14388) 18928 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:46 smithi044 bash[22676]: cluster 2024-09-21T05:31:45.084607+0000 mgr.a (mgr.14388) 18929 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:46 smithi044 bash[22676]: audit 2024-09-21T05:31:45.656712+0000 mon.a (mon.0) 14976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:46 smithi044 bash[22676]: audit 2024-09-21T05:31:45.664573+0000 mon.a (mon.0) 14977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:46 smithi044 bash[22676]: audit 2024-09-21T05:31:45.673302+0000 mon.a (mon.0) 14978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:46 smithi044 bash[22676]: audit 2024-09-21T05:31:45.774800+0000 mon.a (mon.0) 14979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:46 smithi044 bash[22676]: audit 2024-09-21T05:31:45.784397+0000 mon.a (mon.0) 14980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:46 smithi044 bash[22676]: audit 2024-09-21T05:31:45.795798+0000 mon.a (mon.0) 14981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:46 smithi179 bash[23186]: cluster 2024-09-21T05:31:45.084607+0000 mgr.a (mgr.14388) 18929 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:46 smithi179 bash[23186]: audit 2024-09-21T05:31:45.656712+0000 mon.a (mon.0) 14976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:46 smithi179 bash[23186]: audit 2024-09-21T05:31:45.664573+0000 mon.a (mon.0) 14977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:46 smithi179 bash[23186]: audit 2024-09-21T05:31:45.673302+0000 mon.a (mon.0) 14978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:46 smithi179 bash[23186]: audit 2024-09-21T05:31:45.774800+0000 mon.a (mon.0) 14979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:46 smithi179 bash[23186]: audit 2024-09-21T05:31:45.784397+0000 mon.a (mon.0) 14980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:46 smithi179 bash[23186]: audit 2024-09-21T05:31:45.795798+0000 mon.a (mon.0) 14981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:46 smithi049 bash[23528]: cluster 2024-09-21T05:31:45.084607+0000 mgr.a (mgr.14388) 18929 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:46 smithi049 bash[23528]: audit 2024-09-21T05:31:45.656712+0000 mon.a (mon.0) 14976 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:46 smithi049 bash[23528]: audit 2024-09-21T05:31:45.664573+0000 mon.a (mon.0) 14977 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:46 smithi049 bash[23528]: audit 2024-09-21T05:31:45.673302+0000 mon.a (mon.0) 14978 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:46 smithi049 bash[23528]: audit 2024-09-21T05:31:45.774800+0000 mon.a (mon.0) 14979 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:46 smithi049 bash[23528]: audit 2024-09-21T05:31:45.784397+0000 mon.a (mon.0) 14980 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:46.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:46 smithi049 bash[23528]: audit 2024-09-21T05:31:45.795798+0000 mon.a (mon.0) 14981 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:48.396 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:48.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:48.397 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:48.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:48 smithi044 bash[22676]: cluster 2024-09-21T05:31:47.085401+0000 mgr.a (mgr.14388) 18930 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:48.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:48 smithi179 bash[23186]: cluster 2024-09-21T05:31:47.085401+0000 mgr.a (mgr.14388) 18930 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:48 smithi049 bash[23528]: cluster 2024-09-21T05:31:47.085401+0000 mgr.a (mgr.14388) 18930 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:49.181 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:49.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:49.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:49.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:49.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:50 smithi049 bash[23528]: audit 2024-09-21T05:31:48.730193+0000 mgr.a (mgr.14388) 18931 : audit [DBG] from='client.406527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:50 smithi049 bash[23528]: cluster 2024-09-21T05:31:49.086002+0000 mgr.a (mgr.14388) 18932 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:50 smithi044 bash[22676]: audit 2024-09-21T05:31:48.730193+0000 mgr.a (mgr.14388) 18931 : audit [DBG] from='client.406527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:50 smithi044 bash[22676]: cluster 2024-09-21T05:31:49.086002+0000 mgr.a (mgr.14388) 18932 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:50 smithi179 bash[23186]: audit 2024-09-21T05:31:48.730193+0000 mgr.a (mgr.14388) 18931 : audit [DBG] from='client.406527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:50.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:50 smithi179 bash[23186]: cluster 2024-09-21T05:31:49.086002+0000 mgr.a (mgr.14388) 18932 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:52 smithi044 bash[22676]: cluster 2024-09-21T05:31:51.088261+0000 mgr.a (mgr.14388) 18933 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:52 smithi179 bash[23186]: cluster 2024-09-21T05:31:51.088261+0000 mgr.a (mgr.14388) 18933 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:52 smithi049 bash[23528]: cluster 2024-09-21T05:31:51.088261+0000 mgr.a (mgr.14388) 18933 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:53 smithi044 bash[22676]: cluster 2024-09-21T05:31:53.089170+0000 mgr.a (mgr.14388) 18934 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:53 smithi179 bash[23186]: cluster 2024-09-21T05:31:53.089170+0000 mgr.a (mgr.14388) 18934 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:53 smithi049 bash[23528]: cluster 2024-09-21T05:31:53.089170+0000 mgr.a (mgr.14388) 18934 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:54.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:54.184 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:31:54.933 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:31:54.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:31:54.933 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:31:54.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:31:54.934 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:31:56.406 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:56 smithi049 bash[23528]: audit 2024-09-21T05:31:54.502051+0000 mgr.a (mgr.14388) 18935 : audit [DBG] from='client.406605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:56.406 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:56 smithi049 bash[23528]: cluster 2024-09-21T05:31:55.091549+0000 mgr.a (mgr.14388) 18936 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:56 smithi044 bash[22676]: audit 2024-09-21T05:31:54.502051+0000 mgr.a (mgr.14388) 18935 : audit [DBG] from='client.406605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:56 smithi044 bash[22676]: cluster 2024-09-21T05:31:55.091549+0000 mgr.a (mgr.14388) 18936 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:56 smithi179 bash[23186]: audit 2024-09-21T05:31:54.502051+0000 mgr.a (mgr.14388) 18935 : audit [DBG] from='client.406605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:56 smithi179 bash[23186]: cluster 2024-09-21T05:31:55.091549+0000 mgr.a (mgr.14388) 18936 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:31:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:57 smithi044 bash[22676]: audit 2024-09-21T05:31:56.382611+0000 mon.a (mon.0) 14982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:57 smithi044 bash[22676]: audit 2024-09-21T05:31:56.391390+0000 mon.a (mon.0) 14983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:57 smithi044 bash[22676]: audit 2024-09-21T05:31:56.401873+0000 mon.a (mon.0) 14984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:57 smithi044 bash[22676]: cluster 2024-09-21T05:31:57.092324+0000 mgr.a (mgr.14388) 18937 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:57 smithi179 bash[23186]: audit 2024-09-21T05:31:56.382611+0000 mon.a (mon.0) 14982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:57 smithi179 bash[23186]: audit 2024-09-21T05:31:56.391390+0000 mon.a (mon.0) 14983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:57 smithi179 bash[23186]: audit 2024-09-21T05:31:56.401873+0000 mon.a (mon.0) 14984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:57 smithi179 bash[23186]: cluster 2024-09-21T05:31:57.092324+0000 mgr.a (mgr.14388) 18937 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:57 smithi049 bash[23528]: audit 2024-09-21T05:31:56.382611+0000 mon.a (mon.0) 14982 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:57 smithi049 bash[23528]: audit 2024-09-21T05:31:56.391390+0000 mon.a (mon.0) 14983 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:57 smithi049 bash[23528]: audit 2024-09-21T05:31:56.401873+0000 mon.a (mon.0) 14984 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:57 smithi049 bash[23528]: cluster 2024-09-21T05:31:57.092324+0000 mgr.a (mgr.14388) 18937 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:31:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:59 smithi044 bash[22676]: audit 2024-09-21T05:31:59.026944+0000 mon.a (mon.0) 14985 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:31:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:59 smithi044 bash[22676]: audit 2024-09-21T05:31:59.033444+0000 mon.a (mon.0) 14986 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:59 smithi044 bash[22676]: audit 2024-09-21T05:31:59.035516+0000 mon.a (mon.0) 14987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:31:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:59 smithi044 bash[22676]: audit 2024-09-21T05:31:59.047039+0000 mon.a (mon.0) 14988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:31:59 smithi044 bash[22676]: audit 2024-09-21T05:31:59.053443+0000 mon.a (mon.0) 14989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:31:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:59 smithi179 bash[23186]: audit 2024-09-21T05:31:59.026944+0000 mon.a (mon.0) 14985 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:31:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:59 smithi179 bash[23186]: audit 2024-09-21T05:31:59.033444+0000 mon.a (mon.0) 14986 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:59 smithi179 bash[23186]: audit 2024-09-21T05:31:59.035516+0000 mon.a (mon.0) 14987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:31:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:59 smithi179 bash[23186]: audit 2024-09-21T05:31:59.047039+0000 mon.a (mon.0) 14988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:31:59 smithi179 bash[23186]: audit 2024-09-21T05:31:59.053443+0000 mon.a (mon.0) 14989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:31:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:59 smithi049 bash[23528]: audit 2024-09-21T05:31:59.026944+0000 mon.a (mon.0) 14985 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:31:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:59 smithi049 bash[23528]: audit 2024-09-21T05:31:59.033444+0000 mon.a (mon.0) 14986 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:59 smithi049 bash[23528]: audit 2024-09-21T05:31:59.035516+0000 mon.a (mon.0) 14987 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:31:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:59 smithi049 bash[23528]: audit 2024-09-21T05:31:59.047039+0000 mon.a (mon.0) 14988 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:31:59.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:31:59 smithi049 bash[23528]: audit 2024-09-21T05:31:59.053443+0000 mon.a (mon.0) 14989 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:31:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:31:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:31:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:00.128 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:31:59 smithi044 bash[22930]: debug 2024-09-21T05:31:59.851+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:32:00.129 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:31:59 smithi044 bash[22930]: debug 2024-09-21T05:31:59.851+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:32:00.129 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:00 smithi044 bash[22676]: audit 2024-09-21T05:31:59.055872+0000 mgr.a (mgr.14388) 18938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:32:00.129 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:00 smithi044 bash[22676]: cluster 2024-09-21T05:31:59.093353+0000 mgr.a (mgr.14388) 18939 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:00 smithi179 bash[23186]: audit 2024-09-21T05:31:59.055872+0000 mgr.a (mgr.14388) 18938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:32:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:00 smithi179 bash[23186]: cluster 2024-09-21T05:31:59.093353+0000 mgr.a (mgr.14388) 18939 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:00 smithi049 bash[23528]: audit 2024-09-21T05:31:59.055872+0000 mgr.a (mgr.14388) 18938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:32:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:00 smithi049 bash[23528]: cluster 2024-09-21T05:31:59.093353+0000 mgr.a (mgr.14388) 18939 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:00.709 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:00.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:00.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:00.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:00.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:01 smithi179 bash[23186]: audit 2024-09-21T05:31:59.853729+0000 mgr.a (mgr.14388) 18940 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:32:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:01 smithi179 bash[23186]: cephadm 2024-09-21T05:31:59.855730+0000 mgr.a (mgr.14388) 18941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:32:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:01 smithi044 bash[22676]: audit 2024-09-21T05:31:59.853729+0000 mgr.a (mgr.14388) 18940 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:32:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:01 smithi044 bash[22676]: cephadm 2024-09-21T05:31:59.855730+0000 mgr.a (mgr.14388) 18941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:32:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:01 smithi049 bash[23528]: audit 2024-09-21T05:31:59.853729+0000 mgr.a (mgr.14388) 18940 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:32:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:01 smithi049 bash[23528]: cephadm 2024-09-21T05:31:59.855730+0000 mgr.a (mgr.14388) 18941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:32:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:02 smithi044 bash[22676]: audit 2024-09-21T05:32:00.268206+0000 mgr.a (mgr.14388) 18942 : audit [DBG] from='client.406788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:02.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:02 smithi044 bash[22676]: cluster 2024-09-21T05:32:01.096433+0000 mgr.a (mgr.14388) 18943 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:02 smithi179 bash[23186]: audit 2024-09-21T05:32:00.268206+0000 mgr.a (mgr.14388) 18942 : audit [DBG] from='client.406788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:02.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:02 smithi179 bash[23186]: cluster 2024-09-21T05:32:01.096433+0000 mgr.a (mgr.14388) 18943 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:02 smithi049 bash[23528]: audit 2024-09-21T05:32:00.268206+0000 mgr.a (mgr.14388) 18942 : audit [DBG] from='client.406788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:02 smithi049 bash[23528]: cluster 2024-09-21T05:32:01.096433+0000 mgr.a (mgr.14388) 18943 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:04 smithi044 bash[22676]: cluster 2024-09-21T05:32:03.097227+0000 mgr.a (mgr.14388) 18944 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:04.527 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:04 smithi179 bash[23186]: cluster 2024-09-21T05:32:03.097227+0000 mgr.a (mgr.14388) 18944 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:04 smithi049 bash[23528]: cluster 2024-09-21T05:32:03.097227+0000 mgr.a (mgr.14388) 18944 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:05.710 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:05.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:05.711 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:06 smithi044 bash[22676]: cluster 2024-09-21T05:32:05.099203+0000 mgr.a (mgr.14388) 18945 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:06 smithi044 bash[22676]: audit 2024-09-21T05:32:05.847774+0000 mon.a (mon.0) 14990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:06 smithi044 bash[22676]: audit 2024-09-21T05:32:05.853150+0000 mon.a (mon.0) 14991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:06 smithi044 bash[22676]: audit 2024-09-21T05:32:05.858322+0000 mon.a (mon.0) 14992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:06 smithi044 bash[22676]: audit 2024-09-21T05:32:05.995827+0000 mon.a (mon.0) 14993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:06 smithi044 bash[22676]: audit 2024-09-21T05:32:06.003931+0000 mon.a (mon.0) 14994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:06 smithi044 bash[22676]: audit 2024-09-21T05:32:06.013632+0000 mon.a (mon.0) 14995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.480 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:06.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:06.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:06.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:06.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:06 smithi179 bash[23186]: cluster 2024-09-21T05:32:05.099203+0000 mgr.a (mgr.14388) 18945 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:06 smithi179 bash[23186]: audit 2024-09-21T05:32:05.847774+0000 mon.a (mon.0) 14990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:06 smithi179 bash[23186]: audit 2024-09-21T05:32:05.853150+0000 mon.a (mon.0) 14991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:06 smithi179 bash[23186]: audit 2024-09-21T05:32:05.858322+0000 mon.a (mon.0) 14992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:06 smithi179 bash[23186]: audit 2024-09-21T05:32:05.995827+0000 mon.a (mon.0) 14993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:06 smithi179 bash[23186]: audit 2024-09-21T05:32:06.003931+0000 mon.a (mon.0) 14994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:06 smithi179 bash[23186]: audit 2024-09-21T05:32:06.013632+0000 mon.a (mon.0) 14995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:06 smithi049 bash[23528]: cluster 2024-09-21T05:32:05.099203+0000 mgr.a (mgr.14388) 18945 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:06 smithi049 bash[23528]: audit 2024-09-21T05:32:05.847774+0000 mon.a (mon.0) 14990 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:06 smithi049 bash[23528]: audit 2024-09-21T05:32:05.853150+0000 mon.a (mon.0) 14991 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:06 smithi049 bash[23528]: audit 2024-09-21T05:32:05.858322+0000 mon.a (mon.0) 14992 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:06 smithi049 bash[23528]: audit 2024-09-21T05:32:05.995827+0000 mon.a (mon.0) 14993 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:06 smithi049 bash[23528]: audit 2024-09-21T05:32:06.003931+0000 mon.a (mon.0) 14994 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:06.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:06 smithi049 bash[23528]: audit 2024-09-21T05:32:06.013632+0000 mon.a (mon.0) 14995 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:07 smithi044 bash[22676]: audit 2024-09-21T05:32:06.049485+0000 mgr.a (mgr.14388) 18946 : audit [DBG] from='client.406866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:07 smithi179 bash[23186]: audit 2024-09-21T05:32:06.049485+0000 mgr.a (mgr.14388) 18946 : audit [DBG] from='client.406866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:07 smithi049 bash[23528]: audit 2024-09-21T05:32:06.049485+0000 mgr.a (mgr.14388) 18946 : audit [DBG] from='client.406866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:08.474 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:08 smithi049 bash[23528]: cluster 2024-09-21T05:32:07.100143+0000 mgr.a (mgr.14388) 18947 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:08 smithi044 bash[22676]: cluster 2024-09-21T05:32:07.100143+0000 mgr.a (mgr.14388) 18947 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:08 smithi179 bash[23186]: cluster 2024-09-21T05:32:07.100143+0000 mgr.a (mgr.14388) 18947 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:10.414 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:10 smithi049 bash[23528]: cluster 2024-09-21T05:32:09.100943+0000 mgr.a (mgr.14388) 18948 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:10.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:10 smithi044 bash[22676]: cluster 2024-09-21T05:32:09.100943+0000 mgr.a (mgr.14388) 18948 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:10 smithi179 bash[23186]: cluster 2024-09-21T05:32:09.100943+0000 mgr.a (mgr.14388) 18948 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:32:11.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:11.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:11.482 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:12.240 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:12.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:12 smithi044 bash[22676]: cluster 2024-09-21T05:32:11.103199+0000 mgr.a (mgr.14388) 18949 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:12 smithi179 bash[23186]: cluster 2024-09-21T05:32:11.103199+0000 mgr.a (mgr.14388) 18949 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:12 smithi049 bash[23528]: cluster 2024-09-21T05:32:11.103199+0000 mgr.a (mgr.14388) 18949 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:32:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:13 smithi044 bash[22676]: audit 2024-09-21T05:32:11.807438+0000 mgr.a (mgr.14388) 18950 : audit [DBG] from='client.406938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:13 smithi179 bash[23186]: audit 2024-09-21T05:32:11.807438+0000 mgr.a (mgr.14388) 18950 : audit [DBG] from='client.406938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:13 smithi049 bash[23528]: audit 2024-09-21T05:32:11.807438+0000 mgr.a (mgr.14388) 18950 : audit [DBG] from='client.406938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:14 smithi044 bash[22676]: cluster 2024-09-21T05:32:13.104092+0000 mgr.a (mgr.14388) 18951 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:14 smithi179 bash[23186]: cluster 2024-09-21T05:32:13.104092+0000 mgr.a (mgr.14388) 18951 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:14 smithi049 bash[23528]: cluster 2024-09-21T05:32:13.104092+0000 mgr.a (mgr.14388) 18951 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:16 smithi044 bash[22676]: cluster 2024-09-21T05:32:15.106275+0000 mgr.a (mgr.14388) 18952 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:16 smithi179 bash[23186]: cluster 2024-09-21T05:32:15.106275+0000 mgr.a (mgr.14388) 18952 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:16 smithi049 bash[23528]: cluster 2024-09-21T05:32:15.106275+0000 mgr.a (mgr.14388) 18952 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:17 smithi044 bash[22676]: audit 2024-09-21T05:32:16.619958+0000 mon.a (mon.0) 14996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:17 smithi044 bash[22676]: audit 2024-09-21T05:32:16.628727+0000 mon.a (mon.0) 14997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:17 smithi044 bash[22676]: audit 2024-09-21T05:32:16.640081+0000 mon.a (mon.0) 14998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:17 smithi044 bash[22676]: cluster 2024-09-21T05:32:17.107022+0000 mgr.a (mgr.14388) 18953 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:17 smithi179 bash[23186]: audit 2024-09-21T05:32:16.619958+0000 mon.a (mon.0) 14996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:17 smithi179 bash[23186]: audit 2024-09-21T05:32:16.628727+0000 mon.a (mon.0) 14997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:17 smithi179 bash[23186]: audit 2024-09-21T05:32:16.640081+0000 mon.a (mon.0) 14998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:18.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:17 smithi179 bash[23186]: cluster 2024-09-21T05:32:17.107022+0000 mgr.a (mgr.14388) 18953 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:18.009 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:18.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:18.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:18.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:18.009 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:17 smithi049 bash[23528]: audit 2024-09-21T05:32:16.619958+0000 mon.a (mon.0) 14996 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:17 smithi049 bash[23528]: audit 2024-09-21T05:32:16.628727+0000 mon.a (mon.0) 14997 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:17 smithi049 bash[23528]: audit 2024-09-21T05:32:16.640081+0000 mon.a (mon.0) 14998 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:17 smithi049 bash[23528]: cluster 2024-09-21T05:32:17.107022+0000 mgr.a (mgr.14388) 18953 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:18.897 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:18 smithi179 bash[23186]: audit 2024-09-21T05:32:17.574528+0000 mgr.a (mgr.14388) 18954 : audit [DBG] from='client.407016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:18 smithi044 bash[22676]: audit 2024-09-21T05:32:17.574528+0000 mgr.a (mgr.14388) 18954 : audit [DBG] from='client.407016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:18 smithi049 bash[23528]: audit 2024-09-21T05:32:17.574528+0000 mgr.a (mgr.14388) 18954 : audit [DBG] from='client.407016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:19 smithi044 bash[22676]: cluster 2024-09-21T05:32:19.107908+0000 mgr.a (mgr.14388) 18955 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:20.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:19 smithi179 bash[23186]: cluster 2024-09-21T05:32:19.107908+0000 mgr.a (mgr.14388) 18955 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:20.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:19 smithi049 bash[23528]: cluster 2024-09-21T05:32:19.107908+0000 mgr.a (mgr.14388) 18955 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:21 smithi044 bash[22676]: cluster 2024-09-21T05:32:21.110207+0000 mgr.a (mgr.14388) 18956 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:21 smithi179 bash[23186]: cluster 2024-09-21T05:32:21.110207+0000 mgr.a (mgr.14388) 18956 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:21 smithi049 bash[23528]: cluster 2024-09-21T05:32:21.110207+0000 mgr.a (mgr.14388) 18956 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:23.010 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:23.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:23.011 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:23 smithi044 bash[22676]: cluster 2024-09-21T05:32:23.110637+0000 mgr.a (mgr.14388) 18957 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:23 smithi179 bash[23186]: cluster 2024-09-21T05:32:23.110637+0000 mgr.a (mgr.14388) 18957 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:23 smithi049 bash[23528]: cluster 2024-09-21T05:32:23.110637+0000 mgr.a (mgr.14388) 18957 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:23.783 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:24.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:24 smithi044 bash[22676]: audit 2024-09-21T05:32:23.343230+0000 mgr.a (mgr.14388) 18958 : audit [DBG] from='client.407094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:24.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:24 smithi179 bash[23186]: audit 2024-09-21T05:32:23.343230+0000 mgr.a (mgr.14388) 18958 : audit [DBG] from='client.407094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:24.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:24 smithi049 bash[23528]: audit 2024-09-21T05:32:23.343230+0000 mgr.a (mgr.14388) 18958 : audit [DBG] from='client.407094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:25 smithi044 bash[22676]: cluster 2024-09-21T05:32:25.112833+0000 mgr.a (mgr.14388) 18959 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:25 smithi179 bash[23186]: cluster 2024-09-21T05:32:25.112833+0000 mgr.a (mgr.14388) 18959 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:25 smithi049 bash[23528]: cluster 2024-09-21T05:32:25.112833+0000 mgr.a (mgr.14388) 18959 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:27 smithi044 bash[22676]: audit 2024-09-21T05:32:26.076634+0000 mon.a (mon.0) 14999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:27 smithi044 bash[22676]: audit 2024-09-21T05:32:26.084772+0000 mon.a (mon.0) 15000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:27 smithi044 bash[22676]: audit 2024-09-21T05:32:26.095459+0000 mon.a (mon.0) 15001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:27 smithi044 bash[22676]: audit 2024-09-21T05:32:26.227650+0000 mon.a (mon.0) 15002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:27 smithi044 bash[22676]: audit 2024-09-21T05:32:26.236079+0000 mon.a (mon.0) 15003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:27 smithi044 bash[22676]: audit 2024-09-21T05:32:26.246150+0000 mon.a (mon.0) 15004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:27 smithi179 bash[23186]: audit 2024-09-21T05:32:26.076634+0000 mon.a (mon.0) 14999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:27 smithi179 bash[23186]: audit 2024-09-21T05:32:26.084772+0000 mon.a (mon.0) 15000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:27 smithi179 bash[23186]: audit 2024-09-21T05:32:26.095459+0000 mon.a (mon.0) 15001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:27 smithi179 bash[23186]: audit 2024-09-21T05:32:26.227650+0000 mon.a (mon.0) 15002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:27 smithi179 bash[23186]: audit 2024-09-21T05:32:26.236079+0000 mon.a (mon.0) 15003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:27 smithi179 bash[23186]: audit 2024-09-21T05:32:26.246150+0000 mon.a (mon.0) 15004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:27 smithi049 bash[23528]: audit 2024-09-21T05:32:26.076634+0000 mon.a (mon.0) 14999 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:27 smithi049 bash[23528]: audit 2024-09-21T05:32:26.084772+0000 mon.a (mon.0) 15000 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:27 smithi049 bash[23528]: audit 2024-09-21T05:32:26.095459+0000 mon.a (mon.0) 15001 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:27 smithi049 bash[23528]: audit 2024-09-21T05:32:26.227650+0000 mon.a (mon.0) 15002 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:27 smithi049 bash[23528]: audit 2024-09-21T05:32:26.236079+0000 mon.a (mon.0) 15003 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:27.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:27 smithi049 bash[23528]: audit 2024-09-21T05:32:26.246150+0000 mon.a (mon.0) 15004 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:28 smithi044 bash[22676]: cluster 2024-09-21T05:32:27.113627+0000 mgr.a (mgr.14388) 18960 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:28.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:28 smithi179 bash[23186]: cluster 2024-09-21T05:32:27.113627+0000 mgr.a (mgr.14388) 18960 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:28.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:28 smithi049 bash[23528]: cluster 2024-09-21T05:32:27.113627+0000 mgr.a (mgr.14388) 18960 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:28.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:28.786 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:29.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:29 smithi044 bash[22676]: cluster 2024-09-21T05:32:29.114160+0000 mgr.a (mgr.14388) 18961 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:29 smithi044 bash[22676]: audit 2024-09-21T05:32:29.125407+0000 mgr.a (mgr.14388) 18962 : audit [DBG] from='client.407169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:29 smithi179 bash[23186]: cluster 2024-09-21T05:32:29.114160+0000 mgr.a (mgr.14388) 18961 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:29 smithi179 bash[23186]: audit 2024-09-21T05:32:29.125407+0000 mgr.a (mgr.14388) 18962 : audit [DBG] from='client.407169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:29 smithi049 bash[23528]: cluster 2024-09-21T05:32:29.114160+0000 mgr.a (mgr.14388) 18961 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:29 smithi049 bash[23528]: audit 2024-09-21T05:32:29.125407+0000 mgr.a (mgr.14388) 18962 : audit [DBG] from='client.407169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:29.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:29.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:29.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:29.586 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:29.587 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:31 smithi044 bash[22676]: cluster 2024-09-21T05:32:31.115657+0000 mgr.a (mgr.14388) 18963 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:31 smithi179 bash[23186]: cluster 2024-09-21T05:32:31.115657+0000 mgr.a (mgr.14388) 18963 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:31 smithi049 bash[23528]: cluster 2024-09-21T05:32:31.115657+0000 mgr.a (mgr.14388) 18963 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:33 smithi044 bash[22676]: cluster 2024-09-21T05:32:33.116367+0000 mgr.a (mgr.14388) 18964 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:33 smithi179 bash[23186]: cluster 2024-09-21T05:32:33.116367+0000 mgr.a (mgr.14388) 18964 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:33 smithi049 bash[23528]: cluster 2024-09-21T05:32:33.116367+0000 mgr.a (mgr.14388) 18964 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:34.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:34.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:34.589 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:35.357 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:35.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:35.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:35.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:35.357 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:35 smithi044 bash[22676]: audit 2024-09-21T05:32:34.921350+0000 mgr.a (mgr.14388) 18965 : audit [DBG] from='client.407244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:35 smithi044 bash[22676]: cluster 2024-09-21T05:32:35.117901+0000 mgr.a (mgr.14388) 18966 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:35 smithi179 bash[23186]: audit 2024-09-21T05:32:34.921350+0000 mgr.a (mgr.14388) 18965 : audit [DBG] from='client.407244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:35 smithi179 bash[23186]: cluster 2024-09-21T05:32:35.117901+0000 mgr.a (mgr.14388) 18966 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:35 smithi049 bash[23528]: audit 2024-09-21T05:32:34.921350+0000 mgr.a (mgr.14388) 18965 : audit [DBG] from='client.407244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:35 smithi049 bash[23528]: cluster 2024-09-21T05:32:35.117901+0000 mgr.a (mgr.14388) 18966 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:38.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:37 smithi179 bash[23186]: audit 2024-09-21T05:32:36.854695+0000 mon.a (mon.0) 15005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:37 smithi179 bash[23186]: audit 2024-09-21T05:32:36.863549+0000 mon.a (mon.0) 15006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:37 smithi179 bash[23186]: audit 2024-09-21T05:32:36.874242+0000 mon.a (mon.0) 15007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.219 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:37 smithi179 bash[23186]: cluster 2024-09-21T05:32:37.118766+0000 mgr.a (mgr.14388) 18967 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:37 smithi044 bash[22676]: audit 2024-09-21T05:32:36.854695+0000 mon.a (mon.0) 15005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:37 smithi044 bash[22676]: audit 2024-09-21T05:32:36.863549+0000 mon.a (mon.0) 15006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:37 smithi044 bash[22676]: audit 2024-09-21T05:32:36.874242+0000 mon.a (mon.0) 15007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:37 smithi044 bash[22676]: cluster 2024-09-21T05:32:37.118766+0000 mgr.a (mgr.14388) 18967 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:37 smithi049 bash[23528]: audit 2024-09-21T05:32:36.854695+0000 mon.a (mon.0) 15005 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:37 smithi049 bash[23528]: audit 2024-09-21T05:32:36.863549+0000 mon.a (mon.0) 15006 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:37 smithi049 bash[23528]: audit 2024-09-21T05:32:36.874242+0000 mon.a (mon.0) 15007 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:38.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:37 smithi049 bash[23528]: cluster 2024-09-21T05:32:37.118766+0000 mgr.a (mgr.14388) 18967 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:39 smithi044 bash[22676]: cluster 2024-09-21T05:32:39.119532+0000 mgr.a (mgr.14388) 18968 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:39 smithi179 bash[23186]: cluster 2024-09-21T05:32:39.119532+0000 mgr.a (mgr.14388) 18968 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:39.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:39 smithi049 bash[23528]: cluster 2024-09-21T05:32:39.119532+0000 mgr.a (mgr.14388) 18968 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:40.359 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:40.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:40.360 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:41.157 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:41.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:41.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:41.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:41.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:41 smithi179 bash[23186]: audit 2024-09-21T05:32:40.696759+0000 mgr.a (mgr.14388) 18969 : audit [DBG] from='client.407319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:41 smithi179 bash[23186]: cluster 2024-09-21T05:32:41.120976+0000 mgr.a (mgr.14388) 18970 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:41 smithi044 bash[22676]: audit 2024-09-21T05:32:40.696759+0000 mgr.a (mgr.14388) 18969 : audit [DBG] from='client.407319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:41 smithi044 bash[22676]: cluster 2024-09-21T05:32:41.120976+0000 mgr.a (mgr.14388) 18970 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:41 smithi049 bash[23528]: audit 2024-09-21T05:32:40.696759+0000 mgr.a (mgr.14388) 18969 : audit [DBG] from='client.407319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:41 smithi049 bash[23528]: cluster 2024-09-21T05:32:41.120976+0000 mgr.a (mgr.14388) 18970 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:43 smithi044 bash[22676]: cluster 2024-09-21T05:32:43.121467+0000 mgr.a (mgr.14388) 18971 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:43 smithi179 bash[23186]: cluster 2024-09-21T05:32:43.121467+0000 mgr.a (mgr.14388) 18971 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:43.509 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:43 smithi049 bash[23528]: cluster 2024-09-21T05:32:43.121467+0000 mgr.a (mgr.14388) 18971 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:32:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:45 smithi044 bash[22676]: cluster 2024-09-21T05:32:45.123322+0000 mgr.a (mgr.14388) 18972 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:45.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:45 smithi179 bash[23186]: cluster 2024-09-21T05:32:45.123322+0000 mgr.a (mgr.14388) 18972 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:45 smithi049 bash[23528]: cluster 2024-09-21T05:32:45.123322+0000 mgr.a (mgr.14388) 18972 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:46.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:46.927 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:46.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:46.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:46.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:46.927 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: audit 2024-09-21T05:32:46.292795+0000 mon.a (mon.0) 15008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: audit 2024-09-21T05:32:46.298512+0000 mon.a (mon.0) 15009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: audit 2024-09-21T05:32:46.305799+0000 mon.a (mon.0) 15010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: audit 2024-09-21T05:32:46.455203+0000 mon.a (mon.0) 15011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: audit 2024-09-21T05:32:46.463178+0000 mon.a (mon.0) 15012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: audit 2024-09-21T05:32:46.472979+0000 mon.a (mon.0) 15013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: audit 2024-09-21T05:32:46.492633+0000 mgr.a (mgr.14388) 18973 : audit [DBG] from='client.407397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:47 smithi049 bash[23528]: cluster 2024-09-21T05:32:47.124195+0000 mgr.a (mgr.14388) 18974 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: audit 2024-09-21T05:32:46.292795+0000 mon.a (mon.0) 15008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: audit 2024-09-21T05:32:46.298512+0000 mon.a (mon.0) 15009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: audit 2024-09-21T05:32:46.305799+0000 mon.a (mon.0) 15010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: audit 2024-09-21T05:32:46.455203+0000 mon.a (mon.0) 15011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: audit 2024-09-21T05:32:46.463178+0000 mon.a (mon.0) 15012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: audit 2024-09-21T05:32:46.472979+0000 mon.a (mon.0) 15013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: audit 2024-09-21T05:32:46.492633+0000 mgr.a (mgr.14388) 18973 : audit [DBG] from='client.407397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:47 smithi044 bash[22676]: cluster 2024-09-21T05:32:47.124195+0000 mgr.a (mgr.14388) 18974 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: audit 2024-09-21T05:32:46.292795+0000 mon.a (mon.0) 15008 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: audit 2024-09-21T05:32:46.298512+0000 mon.a (mon.0) 15009 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: audit 2024-09-21T05:32:46.305799+0000 mon.a (mon.0) 15010 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: audit 2024-09-21T05:32:46.455203+0000 mon.a (mon.0) 15011 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: audit 2024-09-21T05:32:46.463178+0000 mon.a (mon.0) 15012 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: audit 2024-09-21T05:32:46.472979+0000 mon.a (mon.0) 15013 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: audit 2024-09-21T05:32:46.492633+0000 mgr.a (mgr.14388) 18973 : audit [DBG] from='client.407397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:47 smithi179 bash[23186]: cluster 2024-09-21T05:32:47.124195+0000 mgr.a (mgr.14388) 18974 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:49 smithi044 bash[22676]: cluster 2024-09-21T05:32:49.124849+0000 mgr.a (mgr.14388) 18975 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:49 smithi179 bash[23186]: cluster 2024-09-21T05:32:49.124849+0000 mgr.a (mgr.14388) 18975 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:49 smithi049 bash[23528]: cluster 2024-09-21T05:32:49.124849+0000 mgr.a (mgr.14388) 18975 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:51 smithi044 bash[22676]: cluster 2024-09-21T05:32:51.126780+0000 mgr.a (mgr.14388) 18976 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:51 smithi179 bash[23186]: cluster 2024-09-21T05:32:51.126780+0000 mgr.a (mgr.14388) 18976 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:51 smithi049 bash[23528]: cluster 2024-09-21T05:32:51.126780+0000 mgr.a (mgr.14388) 18976 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:51.928 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:52.722 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:53 smithi044 bash[22676]: audit 2024-09-21T05:32:52.266067+0000 mgr.a (mgr.14388) 18977 : audit [DBG] from='client.407475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:53 smithi044 bash[22676]: cluster 2024-09-21T05:32:53.127808+0000 mgr.a (mgr.14388) 18978 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:53 smithi179 bash[23186]: audit 2024-09-21T05:32:52.266067+0000 mgr.a (mgr.14388) 18977 : audit [DBG] from='client.407475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:53 smithi179 bash[23186]: cluster 2024-09-21T05:32:53.127808+0000 mgr.a (mgr.14388) 18978 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:53 smithi049 bash[23528]: audit 2024-09-21T05:32:52.266067+0000 mgr.a (mgr.14388) 18977 : audit [DBG] from='client.407475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:53 smithi049 bash[23528]: cluster 2024-09-21T05:32:53.127808+0000 mgr.a (mgr.14388) 18978 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:55 smithi044 bash[22676]: cluster 2024-09-21T05:32:55.130021+0000 mgr.a (mgr.14388) 18979 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:55 smithi179 bash[23186]: cluster 2024-09-21T05:32:55.130021+0000 mgr.a (mgr.14388) 18979 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:55 smithi049 bash[23528]: cluster 2024-09-21T05:32:55.130021+0000 mgr.a (mgr.14388) 18979 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:32:57.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:32:57.723 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:32:57.723 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:32:58.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:58 smithi044 bash[22676]: audit 2024-09-21T05:32:57.086157+0000 mon.a (mon.0) 15014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:58 smithi044 bash[22676]: audit 2024-09-21T05:32:57.096067+0000 mon.a (mon.0) 15015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:58 smithi044 bash[22676]: audit 2024-09-21T05:32:57.107863+0000 mon.a (mon.0) 15016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:58 smithi044 bash[22676]: cluster 2024-09-21T05:32:57.130781+0000 mgr.a (mgr.14388) 18980 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:58 smithi179 bash[23186]: audit 2024-09-21T05:32:57.086157+0000 mon.a (mon.0) 15014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:58 smithi179 bash[23186]: audit 2024-09-21T05:32:57.096067+0000 mon.a (mon.0) 15015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:58 smithi179 bash[23186]: audit 2024-09-21T05:32:57.107863+0000 mon.a (mon.0) 15016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:58 smithi179 bash[23186]: cluster 2024-09-21T05:32:57.130781+0000 mgr.a (mgr.14388) 18980 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:58.508 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:32:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:32:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:32:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:32:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:32:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:58 smithi049 bash[23528]: audit 2024-09-21T05:32:57.086157+0000 mon.a (mon.0) 15014 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:58 smithi049 bash[23528]: audit 2024-09-21T05:32:57.096067+0000 mon.a (mon.0) 15015 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:58 smithi049 bash[23528]: audit 2024-09-21T05:32:57.107863+0000 mon.a (mon.0) 15016 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:32:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:58 smithi049 bash[23528]: cluster 2024-09-21T05:32:57.130781+0000 mgr.a (mgr.14388) 18980 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:32:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:32:59 smithi044 bash[22676]: audit 2024-09-21T05:32:58.054294+0000 mgr.a (mgr.14388) 18981 : audit [DBG] from='client.407553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:32:59 smithi179 bash[23186]: audit 2024-09-21T05:32:58.054294+0000 mgr.a (mgr.14388) 18981 : audit [DBG] from='client.407553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:32:59 smithi049 bash[23528]: audit 2024-09-21T05:32:58.054294+0000 mgr.a (mgr.14388) 18981 : audit [DBG] from='client.407553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22676]: cluster 2024-09-21T05:32:59.131949+0000 mgr.a (mgr.14388) 18982 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22676]: audit 2024-09-21T05:32:59.934701+0000 mon.a (mon.0) 15017 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:33:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22676]: audit 2024-09-21T05:32:59.946329+0000 mon.a (mon.0) 15018 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:33:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22676]: audit 2024-09-21T05:32:59.948152+0000 mon.a (mon.0) 15019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:33:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22676]: audit 2024-09-21T05:32:59.959602+0000 mon.a (mon.0) 15020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22676]: audit 2024-09-21T05:32:59.966055+0000 mon.a (mon.0) 15021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:33:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:00 smithi179 bash[23186]: cluster 2024-09-21T05:32:59.131949+0000 mgr.a (mgr.14388) 18982 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:00 smithi179 bash[23186]: audit 2024-09-21T05:32:59.934701+0000 mon.a (mon.0) 15017 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:33:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:00 smithi179 bash[23186]: audit 2024-09-21T05:32:59.946329+0000 mon.a (mon.0) 15018 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:33:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:00 smithi179 bash[23186]: audit 2024-09-21T05:32:59.948152+0000 mon.a (mon.0) 15019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:33:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:00 smithi179 bash[23186]: audit 2024-09-21T05:32:59.959602+0000 mon.a (mon.0) 15020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:00 smithi179 bash[23186]: audit 2024-09-21T05:32:59.966055+0000 mon.a (mon.0) 15021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:33:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:00 smithi049 bash[23528]: cluster 2024-09-21T05:32:59.131949+0000 mgr.a (mgr.14388) 18982 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:00 smithi049 bash[23528]: audit 2024-09-21T05:32:59.934701+0000 mon.a (mon.0) 15017 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:33:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:00 smithi049 bash[23528]: audit 2024-09-21T05:32:59.946329+0000 mon.a (mon.0) 15018 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:33:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:00 smithi049 bash[23528]: audit 2024-09-21T05:32:59.948152+0000 mon.a (mon.0) 15019 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:33:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:00 smithi049 bash[23528]: audit 2024-09-21T05:32:59.959602+0000 mon.a (mon.0) 15020 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:00 smithi049 bash[23528]: audit 2024-09-21T05:32:59.966055+0000 mon.a (mon.0) 15021 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:33:01.123 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22930]: debug 2024-09-21T05:33:00.754+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:33:01.124 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:33:00 smithi044 bash[22930]: debug 2024-09-21T05:33:00.754+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:33:01.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:01 smithi044 bash[22676]: audit 2024-09-21T05:32:59.969021+0000 mgr.a (mgr.14388) 18983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:33:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:01 smithi179 bash[23186]: audit 2024-09-21T05:32:59.969021+0000 mgr.a (mgr.14388) 18983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:33:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:01 smithi049 bash[23528]: audit 2024-09-21T05:32:59.969021+0000 mgr.a (mgr.14388) 18983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:33:02.393 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:02 smithi179 bash[23186]: audit 2024-09-21T05:33:00.757400+0000 mgr.a (mgr.14388) 18984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:33:02.394 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:02 smithi179 bash[23186]: cephadm 2024-09-21T05:33:00.759007+0000 mgr.a (mgr.14388) 18985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:33:02.394 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:02 smithi179 bash[23186]: cluster 2024-09-21T05:33:01.135028+0000 mgr.a (mgr.14388) 18986 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:02 smithi044 bash[22676]: audit 2024-09-21T05:33:00.757400+0000 mgr.a (mgr.14388) 18984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:33:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:02 smithi044 bash[22676]: cephadm 2024-09-21T05:33:00.759007+0000 mgr.a (mgr.14388) 18985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:33:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:02 smithi044 bash[22676]: cluster 2024-09-21T05:33:01.135028+0000 mgr.a (mgr.14388) 18986 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:02 smithi049 bash[23528]: audit 2024-09-21T05:33:00.757400+0000 mgr.a (mgr.14388) 18984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:33:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:02 smithi049 bash[23528]: cephadm 2024-09-21T05:33:00.759007+0000 mgr.a (mgr.14388) 18985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:33:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:02 smithi049 bash[23528]: cluster 2024-09-21T05:33:01.135028+0000 mgr.a (mgr.14388) 18986 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:03 smithi044 bash[22676]: cluster 2024-09-21T05:33:03.135551+0000 mgr.a (mgr.14388) 18987 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:03.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:03 smithi179 bash[23186]: cluster 2024-09-21T05:33:03.135551+0000 mgr.a (mgr.14388) 18987 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:03.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:03.510 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:03.511 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:03 smithi049 bash[23528]: cluster 2024-09-21T05:33:03.135551+0000 mgr.a (mgr.14388) 18987 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:04.254 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:04.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:04.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:04.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:04.254 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:04.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:04 smithi044 bash[22676]: audit 2024-09-21T05:33:03.837241+0000 mgr.a (mgr.14388) 18988 : audit [DBG] from='client.407736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:04 smithi179 bash[23186]: audit 2024-09-21T05:33:03.837241+0000 mgr.a (mgr.14388) 18988 : audit [DBG] from='client.407736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:04 smithi049 bash[23528]: audit 2024-09-21T05:33:03.837241+0000 mgr.a (mgr.14388) 18988 : audit [DBG] from='client.407736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:05 smithi044 bash[22676]: cluster 2024-09-21T05:33:05.137921+0000 mgr.a (mgr.14388) 18989 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:05 smithi179 bash[23186]: cluster 2024-09-21T05:33:05.137921+0000 mgr.a (mgr.14388) 18989 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:05 smithi049 bash[23528]: cluster 2024-09-21T05:33:05.137921+0000 mgr.a (mgr.14388) 18989 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:07 smithi049 bash[23528]: audit 2024-09-21T05:33:06.513873+0000 mon.a (mon.0) 15022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:07 smithi049 bash[23528]: audit 2024-09-21T05:33:06.522628+0000 mon.a (mon.0) 15023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:07 smithi049 bash[23528]: audit 2024-09-21T05:33:06.534457+0000 mon.a (mon.0) 15024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:07 smithi049 bash[23528]: audit 2024-09-21T05:33:06.678564+0000 mon.a (mon.0) 15025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:07 smithi049 bash[23528]: audit 2024-09-21T05:33:06.686894+0000 mon.a (mon.0) 15026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:07 smithi049 bash[23528]: audit 2024-09-21T05:33:06.697023+0000 mon.a (mon.0) 15027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:07 smithi049 bash[23528]: cluster 2024-09-21T05:33:07.138692+0000 mgr.a (mgr.14388) 18990 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:07 smithi044 bash[22676]: audit 2024-09-21T05:33:06.513873+0000 mon.a (mon.0) 15022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:07 smithi044 bash[22676]: audit 2024-09-21T05:33:06.522628+0000 mon.a (mon.0) 15023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:07 smithi044 bash[22676]: audit 2024-09-21T05:33:06.534457+0000 mon.a (mon.0) 15024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:07 smithi044 bash[22676]: audit 2024-09-21T05:33:06.678564+0000 mon.a (mon.0) 15025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:07 smithi044 bash[22676]: audit 2024-09-21T05:33:06.686894+0000 mon.a (mon.0) 15026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:07 smithi044 bash[22676]: audit 2024-09-21T05:33:06.697023+0000 mon.a (mon.0) 15027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:07.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:07 smithi044 bash[22676]: cluster 2024-09-21T05:33:07.138692+0000 mgr.a (mgr.14388) 18990 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:07 smithi179 bash[23186]: audit 2024-09-21T05:33:06.513873+0000 mon.a (mon.0) 15022 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:07 smithi179 bash[23186]: audit 2024-09-21T05:33:06.522628+0000 mon.a (mon.0) 15023 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:07 smithi179 bash[23186]: audit 2024-09-21T05:33:06.534457+0000 mon.a (mon.0) 15024 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:07 smithi179 bash[23186]: audit 2024-09-21T05:33:06.678564+0000 mon.a (mon.0) 15025 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:07 smithi179 bash[23186]: audit 2024-09-21T05:33:06.686894+0000 mon.a (mon.0) 15026 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:07 smithi179 bash[23186]: audit 2024-09-21T05:33:06.697023+0000 mon.a (mon.0) 15027 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:08.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:07 smithi179 bash[23186]: cluster 2024-09-21T05:33:07.138692+0000 mgr.a (mgr.14388) 18990 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:09.255 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:09.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:09.256 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:09 smithi044 bash[22676]: cluster 2024-09-21T05:33:09.139469+0000 mgr.a (mgr.14388) 18991 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:09 smithi179 bash[23186]: cluster 2024-09-21T05:33:09.139469+0000 mgr.a (mgr.14388) 18991 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:09 smithi049 bash[23528]: cluster 2024-09-21T05:33:09.139469+0000 mgr.a (mgr.14388) 18991 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:10.030 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:10.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:10.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:10.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:10.030 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:10 smithi044 bash[22676]: audit 2024-09-21T05:33:09.589071+0000 mgr.a (mgr.14388) 18992 : audit [DBG] from='client.407811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:10 smithi179 bash[23186]: audit 2024-09-21T05:33:09.589071+0000 mgr.a (mgr.14388) 18992 : audit [DBG] from='client.407811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:10 smithi049 bash[23528]: audit 2024-09-21T05:33:09.589071+0000 mgr.a (mgr.14388) 18992 : audit [DBG] from='client.407811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:11 smithi049 bash[23528]: cluster 2024-09-21T05:33:11.141975+0000 mgr.a (mgr.14388) 18993 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:11 smithi044 bash[22676]: cluster 2024-09-21T05:33:11.141975+0000 mgr.a (mgr.14388) 18993 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:11 smithi179 bash[23186]: cluster 2024-09-21T05:33:11.141975+0000 mgr.a (mgr.14388) 18993 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:13 smithi044 bash[22676]: cluster 2024-09-21T05:33:13.142788+0000 mgr.a (mgr.14388) 18994 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:33:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:13 smithi179 bash[23186]: cluster 2024-09-21T05:33:13.142788+0000 mgr.a (mgr.14388) 18994 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:33:13.507 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:13 smithi049 bash[23528]: cluster 2024-09-21T05:33:13.142788+0000 mgr.a (mgr.14388) 18994 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:33:15.031 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:15.032 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:15.032 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:15.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:15 smithi044 bash[22676]: cluster 2024-09-21T05:33:15.143767+0000 mgr.a (mgr.14388) 18995 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:15 smithi179 bash[23186]: cluster 2024-09-21T05:33:15.143767+0000 mgr.a (mgr.14388) 18995 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:15 smithi049 bash[23528]: cluster 2024-09-21T05:33:15.143767+0000 mgr.a (mgr.14388) 18995 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:33:15.819 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:15.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:15.819 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:15.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:15.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:16.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:16 smithi044 bash[22676]: audit 2024-09-21T05:33:15.367667+0000 mgr.a (mgr.14388) 18996 : audit [DBG] from='client.407889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:16 smithi179 bash[23186]: audit 2024-09-21T05:33:15.367667+0000 mgr.a (mgr.14388) 18996 : audit [DBG] from='client.407889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:16 smithi049 bash[23528]: audit 2024-09-21T05:33:15.367667+0000 mgr.a (mgr.14388) 18996 : audit [DBG] from='client.407889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:17.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:17 smithi179 bash[23186]: cluster 2024-09-21T05:33:17.144716+0000 mgr.a (mgr.14388) 18997 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:33:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:17 smithi049 bash[23528]: cluster 2024-09-21T05:33:17.144716+0000 mgr.a (mgr.14388) 18997 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:33:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:17 smithi044 bash[22676]: cluster 2024-09-21T05:33:17.144716+0000 mgr.a (mgr.14388) 18997 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:33:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:18 smithi044 bash[22676]: audit 2024-09-21T05:33:17.313184+0000 mon.a (mon.0) 15028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:18 smithi044 bash[22676]: audit 2024-09-21T05:33:17.321842+0000 mon.a (mon.0) 15029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:18 smithi044 bash[22676]: audit 2024-09-21T05:33:17.332373+0000 mon.a (mon.0) 15030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:18 smithi179 bash[23186]: audit 2024-09-21T05:33:17.313184+0000 mon.a (mon.0) 15028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:18 smithi179 bash[23186]: audit 2024-09-21T05:33:17.321842+0000 mon.a (mon.0) 15029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:18 smithi179 bash[23186]: audit 2024-09-21T05:33:17.332373+0000 mon.a (mon.0) 15030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:18 smithi049 bash[23528]: audit 2024-09-21T05:33:17.313184+0000 mon.a (mon.0) 15028 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:18 smithi049 bash[23528]: audit 2024-09-21T05:33:17.321842+0000 mon.a (mon.0) 15029 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:18 smithi049 bash[23528]: audit 2024-09-21T05:33:17.332373+0000 mon.a (mon.0) 15030 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:19 smithi179 bash[23186]: cluster 2024-09-21T05:33:19.145649+0000 mgr.a (mgr.14388) 18998 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:33:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:19 smithi044 bash[22676]: cluster 2024-09-21T05:33:19.145649+0000 mgr.a (mgr.14388) 18998 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:33:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:19 smithi049 bash[23528]: cluster 2024-09-21T05:33:19.145649+0000 mgr.a (mgr.14388) 18998 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:33:20.820 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:20.821 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:21.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:21 smithi044 bash[22676]: cluster 2024-09-21T05:33:21.147992+0000 mgr.a (mgr.14388) 18999 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:21 smithi044 bash[22676]: audit 2024-09-21T05:33:21.153999+0000 mgr.a (mgr.14388) 19000 : audit [DBG] from='client.407964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:21 smithi179 bash[23186]: cluster 2024-09-21T05:33:21.147992+0000 mgr.a (mgr.14388) 18999 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:21 smithi179 bash[23186]: audit 2024-09-21T05:33:21.153999+0000 mgr.a (mgr.14388) 19000 : audit [DBG] from='client.407964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:21 smithi049 bash[23528]: cluster 2024-09-21T05:33:21.147992+0000 mgr.a (mgr.14388) 18999 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:21 smithi049 bash[23528]: audit 2024-09-21T05:33:21.153999+0000 mgr.a (mgr.14388) 19000 : audit [DBG] from='client.407964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:23 smithi044 bash[22676]: cluster 2024-09-21T05:33:23.149040+0000 mgr.a (mgr.14388) 19001 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:33:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:23 smithi179 bash[23186]: cluster 2024-09-21T05:33:23.149040+0000 mgr.a (mgr.14388) 19001 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:33:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:23 smithi049 bash[23528]: cluster 2024-09-21T05:33:23.149040+0000 mgr.a (mgr.14388) 19001 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:33:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:25 smithi044 bash[22676]: cluster 2024-09-21T05:33:25.151239+0000 mgr.a (mgr.14388) 19002 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:33:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:25 smithi179 bash[23186]: cluster 2024-09-21T05:33:25.151239+0000 mgr.a (mgr.14388) 19002 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:33:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:25 smithi049 bash[23528]: cluster 2024-09-21T05:33:25.151239+0000 mgr.a (mgr.14388) 19002 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:33:26.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:26.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:26.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:27.416 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:27.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:27.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:27.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:27.417 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: audit 2024-09-21T05:33:26.739589+0000 mon.a (mon.0) 15031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: audit 2024-09-21T05:33:26.748354+0000 mon.a (mon.0) 15032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: audit 2024-09-21T05:33:26.757622+0000 mon.a (mon.0) 15033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: audit 2024-09-21T05:33:26.897667+0000 mon.a (mon.0) 15034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: audit 2024-09-21T05:33:26.905193+0000 mon.a (mon.0) 15035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: audit 2024-09-21T05:33:26.914505+0000 mon.a (mon.0) 15036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: audit 2024-09-21T05:33:26.974742+0000 mgr.a (mgr.14388) 19003 : audit [DBG] from='client.408039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:27 smithi179 bash[23186]: cluster 2024-09-21T05:33:27.151819+0000 mgr.a (mgr.14388) 19004 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: audit 2024-09-21T05:33:26.739589+0000 mon.a (mon.0) 15031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: audit 2024-09-21T05:33:26.748354+0000 mon.a (mon.0) 15032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: audit 2024-09-21T05:33:26.757622+0000 mon.a (mon.0) 15033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: audit 2024-09-21T05:33:26.897667+0000 mon.a (mon.0) 15034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: audit 2024-09-21T05:33:26.905193+0000 mon.a (mon.0) 15035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: audit 2024-09-21T05:33:26.914505+0000 mon.a (mon.0) 15036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: audit 2024-09-21T05:33:26.974742+0000 mgr.a (mgr.14388) 19003 : audit [DBG] from='client.408039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:28.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:27 smithi049 bash[23528]: cluster 2024-09-21T05:33:27.151819+0000 mgr.a (mgr.14388) 19004 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: audit 2024-09-21T05:33:26.739589+0000 mon.a (mon.0) 15031 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: audit 2024-09-21T05:33:26.748354+0000 mon.a (mon.0) 15032 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: audit 2024-09-21T05:33:26.757622+0000 mon.a (mon.0) 15033 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: audit 2024-09-21T05:33:26.897667+0000 mon.a (mon.0) 15034 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: audit 2024-09-21T05:33:26.905193+0000 mon.a (mon.0) 15035 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: audit 2024-09-21T05:33:26.914505+0000 mon.a (mon.0) 15036 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: audit 2024-09-21T05:33:26.974742+0000 mgr.a (mgr.14388) 19003 : audit [DBG] from='client.408039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:28.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:27 smithi044 bash[22676]: cluster 2024-09-21T05:33:27.151819+0000 mgr.a (mgr.14388) 19004 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:29 smithi044 bash[22676]: cluster 2024-09-21T05:33:29.152723+0000 mgr.a (mgr.14388) 19005 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:29.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:29 smithi179 bash[23186]: cluster 2024-09-21T05:33:29.152723+0000 mgr.a (mgr.14388) 19005 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:29 smithi049 bash[23528]: cluster 2024-09-21T05:33:29.152723+0000 mgr.a (mgr.14388) 19005 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:31.405 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:31 smithi049 bash[23528]: cluster 2024-09-21T05:33:31.155020+0000 mgr.a (mgr.14388) 19006 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:31 smithi044 bash[22676]: cluster 2024-09-21T05:33:31.155020+0000 mgr.a (mgr.14388) 19006 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:31 smithi179 bash[23186]: cluster 2024-09-21T05:33:31.155020+0000 mgr.a (mgr.14388) 19006 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:32.418 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:32.419 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:32.419 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:33.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:33.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:33.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:33.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:33.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:33 smithi044 bash[22676]: audit 2024-09-21T05:33:32.743709+0000 mgr.a (mgr.14388) 19007 : audit [DBG] from='client.408117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:33 smithi044 bash[22676]: cluster 2024-09-21T05:33:33.155665+0000 mgr.a (mgr.14388) 19008 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:33 smithi179 bash[23186]: audit 2024-09-21T05:33:32.743709+0000 mgr.a (mgr.14388) 19007 : audit [DBG] from='client.408117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:33 smithi179 bash[23186]: cluster 2024-09-21T05:33:33.155665+0000 mgr.a (mgr.14388) 19008 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:33 smithi049 bash[23528]: audit 2024-09-21T05:33:32.743709+0000 mgr.a (mgr.14388) 19007 : audit [DBG] from='client.408117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:33 smithi049 bash[23528]: cluster 2024-09-21T05:33:33.155665+0000 mgr.a (mgr.14388) 19008 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:35 smithi044 bash[22676]: cluster 2024-09-21T05:33:35.157758+0000 mgr.a (mgr.14388) 19009 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:35 smithi179 bash[23186]: cluster 2024-09-21T05:33:35.157758+0000 mgr.a (mgr.14388) 19009 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:35 smithi049 bash[23528]: cluster 2024-09-21T05:33:35.157758+0000 mgr.a (mgr.14388) 19009 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:37 smithi044 bash[22676]: cluster 2024-09-21T05:33:37.158529+0000 mgr.a (mgr.14388) 19010 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:37 smithi179 bash[23186]: cluster 2024-09-21T05:33:37.158529+0000 mgr.a (mgr.14388) 19010 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:37 smithi049 bash[23528]: cluster 2024-09-21T05:33:37.158529+0000 mgr.a (mgr.14388) 19010 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:38.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:38.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:38.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:38 smithi049 bash[23528]: audit 2024-09-21T05:33:37.531594+0000 mon.a (mon.0) 15037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:38 smithi049 bash[23528]: audit 2024-09-21T05:33:37.541365+0000 mon.a (mon.0) 15038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:38 smithi049 bash[23528]: audit 2024-09-21T05:33:37.553230+0000 mon.a (mon.0) 15039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:38.956 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:38.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:38.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:38.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:38.957 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:38 smithi044 bash[22676]: audit 2024-09-21T05:33:37.531594+0000 mon.a (mon.0) 15037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:38 smithi044 bash[22676]: audit 2024-09-21T05:33:37.541365+0000 mon.a (mon.0) 15038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:38 smithi044 bash[22676]: audit 2024-09-21T05:33:37.553230+0000 mon.a (mon.0) 15039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:38 smithi179 bash[23186]: audit 2024-09-21T05:33:37.531594+0000 mon.a (mon.0) 15037 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:38 smithi179 bash[23186]: audit 2024-09-21T05:33:37.541365+0000 mon.a (mon.0) 15038 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:38 smithi179 bash[23186]: audit 2024-09-21T05:33:37.553230+0000 mon.a (mon.0) 15039 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:39 smithi179 bash[23186]: audit 2024-09-21T05:33:38.512738+0000 mgr.a (mgr.14388) 19011 : audit [DBG] from='client.408192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:39.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:39 smithi179 bash[23186]: cluster 2024-09-21T05:33:39.159524+0000 mgr.a (mgr.14388) 19012 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:39 smithi049 bash[23528]: audit 2024-09-21T05:33:38.512738+0000 mgr.a (mgr.14388) 19011 : audit [DBG] from='client.408192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:39 smithi049 bash[23528]: cluster 2024-09-21T05:33:39.159524+0000 mgr.a (mgr.14388) 19012 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:39 smithi044 bash[22676]: audit 2024-09-21T05:33:38.512738+0000 mgr.a (mgr.14388) 19011 : audit [DBG] from='client.408192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:39.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:39 smithi044 bash[22676]: cluster 2024-09-21T05:33:39.159524+0000 mgr.a (mgr.14388) 19012 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:41 smithi179 bash[23186]: cluster 2024-09-21T05:33:41.161902+0000 mgr.a (mgr.14388) 19013 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:41 smithi044 bash[22676]: cluster 2024-09-21T05:33:41.161902+0000 mgr.a (mgr.14388) 19013 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:41 smithi049 bash[23528]: cluster 2024-09-21T05:33:41.161902+0000 mgr.a (mgr.14388) 19013 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:43 smithi044 bash[22676]: cluster 2024-09-21T05:33:43.162735+0000 mgr.a (mgr.14388) 19014 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:43 smithi179 bash[23186]: cluster 2024-09-21T05:33:43.162735+0000 mgr.a (mgr.14388) 19014 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:43 smithi049 bash[23528]: cluster 2024-09-21T05:33:43.162735+0000 mgr.a (mgr.14388) 19014 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:43.958 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:43.958 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:43.959 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:44.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:44.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:44.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:44.704 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:44.704 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:45 smithi044 bash[22676]: audit 2024-09-21T05:33:44.281916+0000 mgr.a (mgr.14388) 19015 : audit [DBG] from='client.408270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:45 smithi044 bash[22676]: cluster 2024-09-21T05:33:45.165109+0000 mgr.a (mgr.14388) 19016 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:45 smithi179 bash[23186]: audit 2024-09-21T05:33:44.281916+0000 mgr.a (mgr.14388) 19015 : audit [DBG] from='client.408270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:45 smithi179 bash[23186]: cluster 2024-09-21T05:33:45.165109+0000 mgr.a (mgr.14388) 19016 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:45 smithi049 bash[23528]: audit 2024-09-21T05:33:44.281916+0000 mgr.a (mgr.14388) 19015 : audit [DBG] from='client.408270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:45 smithi049 bash[23528]: cluster 2024-09-21T05:33:45.165109+0000 mgr.a (mgr.14388) 19016 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:33:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:47 smithi044 bash[22676]: audit 2024-09-21T05:33:46.975508+0000 mon.a (mon.0) 15040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:47 smithi044 bash[22676]: audit 2024-09-21T05:33:46.983301+0000 mon.a (mon.0) 15041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:47 smithi044 bash[22676]: audit 2024-09-21T05:33:46.993852+0000 mon.a (mon.0) 15042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:47 smithi044 bash[22676]: audit 2024-09-21T05:33:47.124851+0000 mon.a (mon.0) 15043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:47 smithi044 bash[22676]: audit 2024-09-21T05:33:47.133278+0000 mon.a (mon.0) 15044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:47 smithi044 bash[22676]: audit 2024-09-21T05:33:47.143308+0000 mon.a (mon.0) 15045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:47 smithi044 bash[22676]: cluster 2024-09-21T05:33:47.165855+0000 mgr.a (mgr.14388) 19017 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:47 smithi179 bash[23186]: audit 2024-09-21T05:33:46.975508+0000 mon.a (mon.0) 15040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:47 smithi179 bash[23186]: audit 2024-09-21T05:33:46.983301+0000 mon.a (mon.0) 15041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:47 smithi179 bash[23186]: audit 2024-09-21T05:33:46.993852+0000 mon.a (mon.0) 15042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:47 smithi179 bash[23186]: audit 2024-09-21T05:33:47.124851+0000 mon.a (mon.0) 15043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:47 smithi179 bash[23186]: audit 2024-09-21T05:33:47.133278+0000 mon.a (mon.0) 15044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:47 smithi179 bash[23186]: audit 2024-09-21T05:33:47.143308+0000 mon.a (mon.0) 15045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:47 smithi179 bash[23186]: cluster 2024-09-21T05:33:47.165855+0000 mgr.a (mgr.14388) 19017 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:47 smithi049 bash[23528]: audit 2024-09-21T05:33:46.975508+0000 mon.a (mon.0) 15040 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:47 smithi049 bash[23528]: audit 2024-09-21T05:33:46.983301+0000 mon.a (mon.0) 15041 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:47 smithi049 bash[23528]: audit 2024-09-21T05:33:46.993852+0000 mon.a (mon.0) 15042 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:47 smithi049 bash[23528]: audit 2024-09-21T05:33:47.124851+0000 mon.a (mon.0) 15043 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:47 smithi049 bash[23528]: audit 2024-09-21T05:33:47.133278+0000 mon.a (mon.0) 15044 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:47 smithi049 bash[23528]: audit 2024-09-21T05:33:47.143308+0000 mon.a (mon.0) 15045 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:48.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:47 smithi049 bash[23528]: cluster 2024-09-21T05:33:47.165855+0000 mgr.a (mgr.14388) 19017 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:49 smithi044 bash[22676]: cluster 2024-09-21T05:33:49.166602+0000 mgr.a (mgr.14388) 19018 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:49 smithi179 bash[23186]: cluster 2024-09-21T05:33:49.166602+0000 mgr.a (mgr.14388) 19018 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:49 smithi049 bash[23528]: cluster 2024-09-21T05:33:49.166602+0000 mgr.a (mgr.14388) 19018 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:49.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:49.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:50.478 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:50.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:50 smithi044 bash[22676]: audit 2024-09-21T05:33:50.041654+0000 mgr.a (mgr.14388) 19019 : audit [DBG] from='client.408348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:50.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:50 smithi179 bash[23186]: audit 2024-09-21T05:33:50.041654+0000 mgr.a (mgr.14388) 19019 : audit [DBG] from='client.408348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:50.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:50 smithi049 bash[23528]: audit 2024-09-21T05:33:50.041654+0000 mgr.a (mgr.14388) 19019 : audit [DBG] from='client.408348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:51 smithi179 bash[23186]: cluster 2024-09-21T05:33:51.169741+0000 mgr.a (mgr.14388) 19020 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:51.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:51 smithi049 bash[23528]: cluster 2024-09-21T05:33:51.169741+0000 mgr.a (mgr.14388) 19020 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:51 smithi044 bash[22676]: cluster 2024-09-21T05:33:51.169741+0000 mgr.a (mgr.14388) 19020 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:53 smithi044 bash[22676]: cluster 2024-09-21T05:33:53.170577+0000 mgr.a (mgr.14388) 19021 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:33:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:53 smithi179 bash[23186]: cluster 2024-09-21T05:33:53.170577+0000 mgr.a (mgr.14388) 19021 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:33:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:53 smithi049 bash[23528]: cluster 2024-09-21T05:33:53.170577+0000 mgr.a (mgr.14388) 19021 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:33:55.480 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:33:55.480 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:33:55.481 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:33:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:55 smithi044 bash[22676]: cluster 2024-09-21T05:33:55.172625+0000 mgr.a (mgr.14388) 19022 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:55 smithi179 bash[23186]: cluster 2024-09-21T05:33:55.172625+0000 mgr.a (mgr.14388) 19022 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:55 smithi049 bash[23528]: cluster 2024-09-21T05:33:55.172625+0000 mgr.a (mgr.14388) 19022 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:33:56.252 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:33:56.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:33:56.252 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:33:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:33:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:33:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:56 smithi044 bash[22676]: audit 2024-09-21T05:33:55.810246+0000 mgr.a (mgr.14388) 19023 : audit [DBG] from='client.408426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:56.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:56 smithi179 bash[23186]: audit 2024-09-21T05:33:55.810246+0000 mgr.a (mgr.14388) 19023 : audit [DBG] from='client.408426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:56 smithi049 bash[23528]: audit 2024-09-21T05:33:55.810246+0000 mgr.a (mgr.14388) 19023 : audit [DBG] from='client.408426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:57 smithi044 bash[22676]: cluster 2024-09-21T05:33:57.173663+0000 mgr.a (mgr.14388) 19024 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:33:57.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:57 smithi179 bash[23186]: cluster 2024-09-21T05:33:57.173663+0000 mgr.a (mgr.14388) 19024 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:33:57.793 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:57 smithi049 bash[23528]: cluster 2024-09-21T05:33:57.173663+0000 mgr.a (mgr.14388) 19024 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:33:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:58 smithi049 bash[23528]: audit 2024-09-21T05:33:57.767887+0000 mon.a (mon.0) 15046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:58 smithi049 bash[23528]: audit 2024-09-21T05:33:57.778051+0000 mon.a (mon.0) 15047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:58 smithi049 bash[23528]: audit 2024-09-21T05:33:57.789152+0000 mon.a (mon.0) 15048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:58 smithi044 bash[22676]: audit 2024-09-21T05:33:57.767887+0000 mon.a (mon.0) 15046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:58 smithi044 bash[22676]: audit 2024-09-21T05:33:57.778051+0000 mon.a (mon.0) 15047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:58 smithi044 bash[22676]: audit 2024-09-21T05:33:57.789152+0000 mon.a (mon.0) 15048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:58 smithi179 bash[23186]: audit 2024-09-21T05:33:57.767887+0000 mon.a (mon.0) 15046 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:58 smithi179 bash[23186]: audit 2024-09-21T05:33:57.778051+0000 mon.a (mon.0) 15047 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:33:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:58 smithi179 bash[23186]: audit 2024-09-21T05:33:57.789152+0000 mon.a (mon.0) 15048 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:33:59 smithi049 bash[23528]: cluster 2024-09-21T05:33:59.174474+0000 mgr.a (mgr.14388) 19025 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:34:00.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:33:59 smithi179 bash[23186]: cluster 2024-09-21T05:33:59.174474+0000 mgr.a (mgr.14388) 19025 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:34:00.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:33:59 smithi044 bash[22676]: cluster 2024-09-21T05:33:59.174474+0000 mgr.a (mgr.14388) 19025 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:34:01.206 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:00 smithi179 bash[23186]: audit 2024-09-21T05:34:00.831761+0000 mon.a (mon.0) 15049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:34:01.206 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:00 smithi179 bash[23186]: audit 2024-09-21T05:34:00.837760+0000 mon.a (mon.0) 15050 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:34:01.206 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:00 smithi179 bash[23186]: audit 2024-09-21T05:34:00.839534+0000 mon.a (mon.0) 15051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:34:01.206 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:00 smithi179 bash[23186]: audit 2024-09-21T05:34:00.850599+0000 mon.a (mon.0) 15052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:01.206 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:00 smithi179 bash[23186]: audit 2024-09-21T05:34:00.856866+0000 mon.a (mon.0) 15053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:34:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:00 smithi044 bash[22676]: audit 2024-09-21T05:34:00.831761+0000 mon.a (mon.0) 15049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:34:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:00 smithi044 bash[22676]: audit 2024-09-21T05:34:00.837760+0000 mon.a (mon.0) 15050 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:34:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:00 smithi044 bash[22676]: audit 2024-09-21T05:34:00.839534+0000 mon.a (mon.0) 15051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:34:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:00 smithi044 bash[22676]: audit 2024-09-21T05:34:00.850599+0000 mon.a (mon.0) 15052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:00 smithi044 bash[22676]: audit 2024-09-21T05:34:00.856866+0000 mon.a (mon.0) 15053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:34:01.253 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:01.253 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:01.254 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:00 smithi049 bash[23528]: audit 2024-09-21T05:34:00.831761+0000 mon.a (mon.0) 15049 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:34:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:00 smithi049 bash[23528]: audit 2024-09-21T05:34:00.837760+0000 mon.a (mon.0) 15050 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:34:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:00 smithi049 bash[23528]: audit 2024-09-21T05:34:00.839534+0000 mon.a (mon.0) 15051 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:34:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:00 smithi049 bash[23528]: audit 2024-09-21T05:34:00.850599+0000 mon.a (mon.0) 15052 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:01.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:00 smithi049 bash[23528]: audit 2024-09-21T05:34:00.856866+0000 mon.a (mon.0) 15053 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:34:01.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:01 smithi044 bash[22676]: audit 2024-09-21T05:34:00.859227+0000 mgr.a (mgr.14388) 19026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:34:01.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:01 smithi044 bash[22676]: cluster 2024-09-21T05:34:01.176079+0000 mgr.a (mgr.14388) 19027 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:01.931 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:34:01 smithi044 bash[22930]: debug 2024-09-21T05:34:01.653+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:34:01.931 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:34:01 smithi044 bash[22930]: debug 2024-09-21T05:34:01.665+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:34:02.085 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:02.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:02.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:02.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:02.086 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:01 smithi179 bash[23186]: audit 2024-09-21T05:34:00.859227+0000 mgr.a (mgr.14388) 19026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:34:02.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:01 smithi179 bash[23186]: cluster 2024-09-21T05:34:01.176079+0000 mgr.a (mgr.14388) 19027 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:01 smithi049 bash[23528]: audit 2024-09-21T05:34:00.859227+0000 mgr.a (mgr.14388) 19026 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:34:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:01 smithi049 bash[23528]: cluster 2024-09-21T05:34:01.176079+0000 mgr.a (mgr.14388) 19027 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:02 smithi044 bash[22676]: audit 2024-09-21T05:34:01.620009+0000 mgr.a (mgr.14388) 19028 : audit [DBG] from='client.408573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:02 smithi044 bash[22676]: audit 2024-09-21T05:34:01.660247+0000 mgr.a (mgr.14388) 19029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:34:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:02 smithi044 bash[22676]: cephadm 2024-09-21T05:34:01.672500+0000 mgr.a (mgr.14388) 19030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:34:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:02 smithi179 bash[23186]: audit 2024-09-21T05:34:01.620009+0000 mgr.a (mgr.14388) 19028 : audit [DBG] from='client.408573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:02 smithi179 bash[23186]: audit 2024-09-21T05:34:01.660247+0000 mgr.a (mgr.14388) 19029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:34:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:02 smithi179 bash[23186]: cephadm 2024-09-21T05:34:01.672500+0000 mgr.a (mgr.14388) 19030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:34:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:02 smithi049 bash[23528]: audit 2024-09-21T05:34:01.620009+0000 mgr.a (mgr.14388) 19028 : audit [DBG] from='client.408573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:02 smithi049 bash[23528]: audit 2024-09-21T05:34:01.660247+0000 mgr.a (mgr.14388) 19029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:34:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:02 smithi049 bash[23528]: cephadm 2024-09-21T05:34:01.672500+0000 mgr.a (mgr.14388) 19030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:34:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:03 smithi044 bash[22676]: cluster 2024-09-21T05:34:03.177063+0000 mgr.a (mgr.14388) 19031 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:03 smithi179 bash[23186]: cluster 2024-09-21T05:34:03.177063+0000 mgr.a (mgr.14388) 19031 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:03 smithi049 bash[23528]: cluster 2024-09-21T05:34:03.177063+0000 mgr.a (mgr.14388) 19031 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:05 smithi179 bash[23186]: cluster 2024-09-21T05:34:05.179232+0000 mgr.a (mgr.14388) 19032 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:05 smithi049 bash[23528]: cluster 2024-09-21T05:34:05.179232+0000 mgr.a (mgr.14388) 19032 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:05 smithi044 bash[22676]: cluster 2024-09-21T05:34:05.179232+0000 mgr.a (mgr.14388) 19032 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:07.087 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:07.087 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:07.088 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:07 smithi044 bash[22676]: cluster 2024-09-21T05:34:07.179744+0000 mgr.a (mgr.14388) 19033 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:07 smithi044 bash[22676]: audit 2024-09-21T05:34:07.193013+0000 mon.a (mon.0) 15054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:07 smithi044 bash[22676]: audit 2024-09-21T05:34:07.201571+0000 mon.a (mon.0) 15055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:07 smithi044 bash[22676]: audit 2024-09-21T05:34:07.209082+0000 mon.a (mon.0) 15056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:07 smithi179 bash[23186]: cluster 2024-09-21T05:34:07.179744+0000 mgr.a (mgr.14388) 19033 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:07 smithi179 bash[23186]: audit 2024-09-21T05:34:07.193013+0000 mon.a (mon.0) 15054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:07 smithi179 bash[23186]: audit 2024-09-21T05:34:07.201571+0000 mon.a (mon.0) 15055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:07 smithi179 bash[23186]: audit 2024-09-21T05:34:07.209082+0000 mon.a (mon.0) 15056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:07 smithi049 bash[23528]: cluster 2024-09-21T05:34:07.179744+0000 mgr.a (mgr.14388) 19033 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:07 smithi049 bash[23528]: audit 2024-09-21T05:34:07.193013+0000 mon.a (mon.0) 15054 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:07 smithi049 bash[23528]: audit 2024-09-21T05:34:07.201571+0000 mon.a (mon.0) 15055 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:07 smithi049 bash[23528]: audit 2024-09-21T05:34:07.209082+0000 mon.a (mon.0) 15056 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:07.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:07.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:07.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:07.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:07.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:08 smithi044 bash[22676]: audit 2024-09-21T05:34:07.358627+0000 mon.a (mon.0) 15057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:08 smithi044 bash[22676]: audit 2024-09-21T05:34:07.367171+0000 mon.a (mon.0) 15058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:08 smithi044 bash[22676]: audit 2024-09-21T05:34:07.377009+0000 mon.a (mon.0) 15059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:08 smithi044 bash[22676]: audit 2024-09-21T05:34:07.424725+0000 mgr.a (mgr.14388) 19034 : audit [DBG] from='client.408687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:08 smithi179 bash[23186]: audit 2024-09-21T05:34:07.358627+0000 mon.a (mon.0) 15057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:08 smithi179 bash[23186]: audit 2024-09-21T05:34:07.367171+0000 mon.a (mon.0) 15058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:08 smithi179 bash[23186]: audit 2024-09-21T05:34:07.377009+0000 mon.a (mon.0) 15059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:08 smithi179 bash[23186]: audit 2024-09-21T05:34:07.424725+0000 mgr.a (mgr.14388) 19034 : audit [DBG] from='client.408687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:08 smithi049 bash[23528]: audit 2024-09-21T05:34:07.358627+0000 mon.a (mon.0) 15057 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:08 smithi049 bash[23528]: audit 2024-09-21T05:34:07.367171+0000 mon.a (mon.0) 15058 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:08 smithi049 bash[23528]: audit 2024-09-21T05:34:07.377009+0000 mon.a (mon.0) 15059 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:08 smithi049 bash[23528]: audit 2024-09-21T05:34:07.424725+0000 mgr.a (mgr.14388) 19034 : audit [DBG] from='client.408687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:09 smithi044 bash[22676]: cluster 2024-09-21T05:34:09.180646+0000 mgr.a (mgr.14388) 19035 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:09 smithi179 bash[23186]: cluster 2024-09-21T05:34:09.180646+0000 mgr.a (mgr.14388) 19035 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:09 smithi049 bash[23528]: cluster 2024-09-21T05:34:09.180646+0000 mgr.a (mgr.14388) 19035 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:11 smithi179 bash[23186]: cluster 2024-09-21T05:34:11.182892+0000 mgr.a (mgr.14388) 19036 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:11 smithi049 bash[23528]: cluster 2024-09-21T05:34:11.182892+0000 mgr.a (mgr.14388) 19036 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:11 smithi044 bash[22676]: cluster 2024-09-21T05:34:11.182892+0000 mgr.a (mgr.14388) 19036 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:12.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:13.503 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:13 smithi049 bash[23528]: cluster 2024-09-21T05:34:13.183348+0000 mgr.a (mgr.14388) 19037 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:13.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:13 smithi179 bash[23186]: cluster 2024-09-21T05:34:13.183348+0000 mgr.a (mgr.14388) 19037 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:13.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:13.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:13.632 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:13.633 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:13.633 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:13.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:13 smithi044 bash[22676]: cluster 2024-09-21T05:34:13.183348+0000 mgr.a (mgr.14388) 19037 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:14 smithi044 bash[22676]: audit 2024-09-21T05:34:13.185521+0000 mgr.a (mgr.14388) 19038 : audit [DBG] from='client.408762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:14.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:14 smithi179 bash[23186]: audit 2024-09-21T05:34:13.185521+0000 mgr.a (mgr.14388) 19038 : audit [DBG] from='client.408762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:14 smithi049 bash[23528]: audit 2024-09-21T05:34:13.185521+0000 mgr.a (mgr.14388) 19038 : audit [DBG] from='client.408762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:16.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:16 smithi179 bash[23186]: cluster 2024-09-21T05:34:15.185683+0000 mgr.a (mgr.14388) 19039 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:16 smithi049 bash[23528]: cluster 2024-09-21T05:34:15.185683+0000 mgr.a (mgr.14388) 19039 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:16 smithi044 bash[22676]: cluster 2024-09-21T05:34:15.185683+0000 mgr.a (mgr.14388) 19039 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:34:18.634 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:18.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:18.635 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:19 smithi049 bash[23528]: cluster 2024-09-21T05:34:17.186414+0000 mgr.a (mgr.14388) 19040 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:19 smithi049 bash[23528]: audit 2024-09-21T05:34:18.006788+0000 mon.a (mon.0) 15060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:19 smithi049 bash[23528]: audit 2024-09-21T05:34:18.016154+0000 mon.a (mon.0) 15061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:19 smithi049 bash[23528]: audit 2024-09-21T05:34:18.027674+0000 mon.a (mon.0) 15062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.415 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:19.415 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:19.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:19.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:19.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:19 smithi044 bash[22676]: cluster 2024-09-21T05:34:17.186414+0000 mgr.a (mgr.14388) 19040 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:19 smithi044 bash[22676]: audit 2024-09-21T05:34:18.006788+0000 mon.a (mon.0) 15060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:19 smithi044 bash[22676]: audit 2024-09-21T05:34:18.016154+0000 mon.a (mon.0) 15061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:19 smithi044 bash[22676]: audit 2024-09-21T05:34:18.027674+0000 mon.a (mon.0) 15062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:19 smithi179 bash[23186]: cluster 2024-09-21T05:34:17.186414+0000 mgr.a (mgr.14388) 19040 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:19 smithi179 bash[23186]: audit 2024-09-21T05:34:18.006788+0000 mon.a (mon.0) 15060 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:19 smithi179 bash[23186]: audit 2024-09-21T05:34:18.016154+0000 mon.a (mon.0) 15061 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:19 smithi179 bash[23186]: audit 2024-09-21T05:34:18.027674+0000 mon.a (mon.0) 15062 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:20.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:20 smithi049 bash[23528]: audit 2024-09-21T05:34:18.970983+0000 mgr.a (mgr.14388) 19041 : audit [DBG] from='client.408837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:20.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:20 smithi044 bash[22676]: audit 2024-09-21T05:34:18.970983+0000 mgr.a (mgr.14388) 19041 : audit [DBG] from='client.408837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:20.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:20 smithi179 bash[23186]: audit 2024-09-21T05:34:18.970983+0000 mgr.a (mgr.14388) 19041 : audit [DBG] from='client.408837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:21 smithi049 bash[23528]: cluster 2024-09-21T05:34:19.187051+0000 mgr.a (mgr.14388) 19042 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:21 smithi044 bash[22676]: cluster 2024-09-21T05:34:19.187051+0000 mgr.a (mgr.14388) 19042 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:21.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:21 smithi179 bash[23186]: cluster 2024-09-21T05:34:19.187051+0000 mgr.a (mgr.14388) 19042 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:23 smithi044 bash[22676]: cluster 2024-09-21T05:34:21.189435+0000 mgr.a (mgr.14388) 19043 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:23 smithi049 bash[23528]: cluster 2024-09-21T05:34:21.189435+0000 mgr.a (mgr.14388) 19043 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:23.360 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:23 smithi179 bash[23186]: cluster 2024-09-21T05:34:21.189435+0000 mgr.a (mgr.14388) 19043 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:24.416 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:24.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:24.417 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:25.169 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:25.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:25.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:25.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:25.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:25 smithi049 bash[23528]: cluster 2024-09-21T05:34:23.190215+0000 mgr.a (mgr.14388) 19044 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:25.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:25 smithi044 bash[22676]: cluster 2024-09-21T05:34:23.190215+0000 mgr.a (mgr.14388) 19044 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:25 smithi179 bash[23186]: cluster 2024-09-21T05:34:23.190215+0000 mgr.a (mgr.14388) 19044 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:26 smithi049 bash[23528]: audit 2024-09-21T05:34:24.742023+0000 mgr.a (mgr.14388) 19045 : audit [DBG] from='client.408915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:26.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:26 smithi044 bash[22676]: audit 2024-09-21T05:34:24.742023+0000 mgr.a (mgr.14388) 19045 : audit [DBG] from='client.408915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:26.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:26 smithi179 bash[23186]: audit 2024-09-21T05:34:24.742023+0000 mgr.a (mgr.14388) 19045 : audit [DBG] from='client.408915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:27 smithi049 bash[23528]: cluster 2024-09-21T05:34:25.191629+0000 mgr.a (mgr.14388) 19046 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:34:27.462 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:27 smithi044 bash[22676]: cluster 2024-09-21T05:34:25.191629+0000 mgr.a (mgr.14388) 19046 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:34:27.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:27 smithi179 bash[23186]: cluster 2024-09-21T05:34:25.191629+0000 mgr.a (mgr.14388) 19046 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:34:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:28 smithi044 bash[22676]: cluster 2024-09-21T05:34:27.192364+0000 mgr.a (mgr.14388) 19047 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:28 smithi044 bash[22676]: audit 2024-09-21T05:34:27.436524+0000 mon.a (mon.0) 15063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:28 smithi044 bash[22676]: audit 2024-09-21T05:34:27.446241+0000 mon.a (mon.0) 15064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:28 smithi044 bash[22676]: audit 2024-09-21T05:34:27.458037+0000 mon.a (mon.0) 15065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:28 smithi044 bash[22676]: audit 2024-09-21T05:34:27.586142+0000 mon.a (mon.0) 15066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:28 smithi044 bash[22676]: audit 2024-09-21T05:34:27.595824+0000 mon.a (mon.0) 15067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:28 smithi044 bash[22676]: audit 2024-09-21T05:34:27.607335+0000 mon.a (mon.0) 15068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:28 smithi179 bash[23186]: cluster 2024-09-21T05:34:27.192364+0000 mgr.a (mgr.14388) 19047 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:28 smithi179 bash[23186]: audit 2024-09-21T05:34:27.436524+0000 mon.a (mon.0) 15063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:28 smithi179 bash[23186]: audit 2024-09-21T05:34:27.446241+0000 mon.a (mon.0) 15064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:28 smithi179 bash[23186]: audit 2024-09-21T05:34:27.458037+0000 mon.a (mon.0) 15065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:28 smithi179 bash[23186]: audit 2024-09-21T05:34:27.586142+0000 mon.a (mon.0) 15066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:28 smithi179 bash[23186]: audit 2024-09-21T05:34:27.595824+0000 mon.a (mon.0) 15067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:28 smithi179 bash[23186]: audit 2024-09-21T05:34:27.607335+0000 mon.a (mon.0) 15068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:28 smithi049 bash[23528]: cluster 2024-09-21T05:34:27.192364+0000 mgr.a (mgr.14388) 19047 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:28 smithi049 bash[23528]: audit 2024-09-21T05:34:27.436524+0000 mon.a (mon.0) 15063 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:28 smithi049 bash[23528]: audit 2024-09-21T05:34:27.446241+0000 mon.a (mon.0) 15064 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:28 smithi049 bash[23528]: audit 2024-09-21T05:34:27.458037+0000 mon.a (mon.0) 15065 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:28 smithi049 bash[23528]: audit 2024-09-21T05:34:27.586142+0000 mon.a (mon.0) 15066 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:28 smithi049 bash[23528]: audit 2024-09-21T05:34:27.595824+0000 mon.a (mon.0) 15067 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:28 smithi049 bash[23528]: audit 2024-09-21T05:34:27.607335+0000 mon.a (mon.0) 15068 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:30.170 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:30.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:30.171 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:30 smithi044 bash[22676]: cluster 2024-09-21T05:34:29.193116+0000 mgr.a (mgr.14388) 19048 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:30 smithi179 bash[23186]: cluster 2024-09-21T05:34:29.193116+0000 mgr.a (mgr.14388) 19048 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:30 smithi049 bash[23528]: cluster 2024-09-21T05:34:29.193116+0000 mgr.a (mgr.14388) 19048 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:30.941 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:31 smithi044 bash[22676]: audit 2024-09-21T05:34:30.501532+0000 mgr.a (mgr.14388) 19049 : audit [DBG] from='client.408990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:31.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:31 smithi179 bash[23186]: audit 2024-09-21T05:34:30.501532+0000 mgr.a (mgr.14388) 19049 : audit [DBG] from='client.408990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:31 smithi049 bash[23528]: audit 2024-09-21T05:34:30.501532+0000 mgr.a (mgr.14388) 19049 : audit [DBG] from='client.408990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:32 smithi044 bash[22676]: cluster 2024-09-21T05:34:31.196099+0000 mgr.a (mgr.14388) 19050 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:32 smithi179 bash[23186]: cluster 2024-09-21T05:34:31.196099+0000 mgr.a (mgr.14388) 19050 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:32 smithi049 bash[23528]: cluster 2024-09-21T05:34:31.196099+0000 mgr.a (mgr.14388) 19050 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:34.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:34 smithi044 bash[22676]: cluster 2024-09-21T05:34:33.196885+0000 mgr.a (mgr.14388) 19051 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:34:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:34 smithi179 bash[23186]: cluster 2024-09-21T05:34:33.196885+0000 mgr.a (mgr.14388) 19051 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:34:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:34 smithi049 bash[23528]: cluster 2024-09-21T05:34:33.196885+0000 mgr.a (mgr.14388) 19051 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:34:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:36.703 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:36 smithi044 bash[22676]: cluster 2024-09-21T05:34:35.198829+0000 mgr.a (mgr.14388) 19052 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:36.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:36 smithi179 bash[23186]: cluster 2024-09-21T05:34:35.198829+0000 mgr.a (mgr.14388) 19052 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:36 smithi049 bash[23528]: cluster 2024-09-21T05:34:35.198829+0000 mgr.a (mgr.14388) 19052 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:37.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:37 smithi044 bash[22676]: audit 2024-09-21T05:34:36.274095+0000 mgr.a (mgr.14388) 19053 : audit [DBG] from='client.409065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:37.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:37 smithi179 bash[23186]: audit 2024-09-21T05:34:36.274095+0000 mgr.a (mgr.14388) 19053 : audit [DBG] from='client.409065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:37 smithi049 bash[23528]: audit 2024-09-21T05:34:36.274095+0000 mgr.a (mgr.14388) 19053 : audit [DBG] from='client.409065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:38 smithi049 bash[23528]: cluster 2024-09-21T05:34:37.199772+0000 mgr.a (mgr.14388) 19054 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:34:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:38 smithi049 bash[23528]: audit 2024-09-21T05:34:38.246839+0000 mon.a (mon.0) 15069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:38 smithi049 bash[23528]: audit 2024-09-21T05:34:38.255518+0000 mon.a (mon.0) 15070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:38 smithi049 bash[23528]: audit 2024-09-21T05:34:38.266170+0000 mon.a (mon.0) 15071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:38 smithi044 bash[22676]: cluster 2024-09-21T05:34:37.199772+0000 mgr.a (mgr.14388) 19054 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:34:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:38 smithi044 bash[22676]: audit 2024-09-21T05:34:38.246839+0000 mon.a (mon.0) 15069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:38 smithi044 bash[22676]: audit 2024-09-21T05:34:38.255518+0000 mon.a (mon.0) 15070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:38 smithi044 bash[22676]: audit 2024-09-21T05:34:38.266170+0000 mon.a (mon.0) 15071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:38 smithi179 bash[23186]: cluster 2024-09-21T05:34:37.199772+0000 mgr.a (mgr.14388) 19054 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:34:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:38 smithi179 bash[23186]: audit 2024-09-21T05:34:38.246839+0000 mon.a (mon.0) 15069 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:38 smithi179 bash[23186]: audit 2024-09-21T05:34:38.255518+0000 mon.a (mon.0) 15070 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:38 smithi179 bash[23186]: audit 2024-09-21T05:34:38.266170+0000 mon.a (mon.0) 15071 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:40 smithi044 bash[22676]: cluster 2024-09-21T05:34:39.200579+0000 mgr.a (mgr.14388) 19055 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:34:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:40 smithi179 bash[23186]: cluster 2024-09-21T05:34:39.200579+0000 mgr.a (mgr.14388) 19055 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:34:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:40 smithi049 bash[23528]: cluster 2024-09-21T05:34:39.200579+0000 mgr.a (mgr.14388) 19055 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:34:41.705 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:41.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:41.706 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:42.506 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:42.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:42.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:42.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:42.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:42 smithi044 bash[22676]: cluster 2024-09-21T05:34:41.202826+0000 mgr.a (mgr.14388) 19056 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:34:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:42 smithi044 bash[22676]: audit 2024-09-21T05:34:42.039535+0000 mgr.a (mgr.14388) 19057 : audit [DBG] from='client.409143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:42 smithi179 bash[23186]: cluster 2024-09-21T05:34:41.202826+0000 mgr.a (mgr.14388) 19056 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:34:42.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:42 smithi179 bash[23186]: audit 2024-09-21T05:34:42.039535+0000 mgr.a (mgr.14388) 19057 : audit [DBG] from='client.409143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:42 smithi049 bash[23528]: cluster 2024-09-21T05:34:41.202826+0000 mgr.a (mgr.14388) 19056 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:34:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:42 smithi049 bash[23528]: audit 2024-09-21T05:34:42.039535+0000 mgr.a (mgr.14388) 19057 : audit [DBG] from='client.409143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:44 smithi044 bash[22676]: cluster 2024-09-21T05:34:43.203838+0000 mgr.a (mgr.14388) 19058 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:44.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:44 smithi179 bash[23186]: cluster 2024-09-21T05:34:43.203838+0000 mgr.a (mgr.14388) 19058 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:44 smithi049 bash[23528]: cluster 2024-09-21T05:34:43.203838+0000 mgr.a (mgr.14388) 19058 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:46 smithi179 bash[23186]: cluster 2024-09-21T05:34:45.206036+0000 mgr.a (mgr.14388) 19059 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:46 smithi049 bash[23528]: cluster 2024-09-21T05:34:45.206036+0000 mgr.a (mgr.14388) 19059 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:46 smithi044 bash[22676]: cluster 2024-09-21T05:34:45.206036+0000 mgr.a (mgr.14388) 19059 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:48.283 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: cluster 2024-09-21T05:34:47.206836+0000 mgr.a (mgr.14388) 19060 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: audit 2024-09-21T05:34:47.621011+0000 mon.a (mon.0) 15072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: audit 2024-09-21T05:34:47.628161+0000 mon.a (mon.0) 15073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: audit 2024-09-21T05:34:47.636464+0000 mon.a (mon.0) 15074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: audit 2024-09-21T05:34:47.813083+0000 mon.a (mon.0) 15075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: audit 2024-09-21T05:34:47.821161+0000 mon.a (mon.0) 15076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: audit 2024-09-21T05:34:47.829363+0000 mon.a (mon.0) 15077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:48.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:48 smithi044 bash[22676]: audit 2024-09-21T05:34:47.856194+0000 mgr.a (mgr.14388) 19061 : audit [DBG] from='client.409221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: cluster 2024-09-21T05:34:47.206836+0000 mgr.a (mgr.14388) 19060 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: audit 2024-09-21T05:34:47.621011+0000 mon.a (mon.0) 15072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: audit 2024-09-21T05:34:47.628161+0000 mon.a (mon.0) 15073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: audit 2024-09-21T05:34:47.636464+0000 mon.a (mon.0) 15074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: audit 2024-09-21T05:34:47.813083+0000 mon.a (mon.0) 15075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: audit 2024-09-21T05:34:47.821161+0000 mon.a (mon.0) 15076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: audit 2024-09-21T05:34:47.829363+0000 mon.a (mon.0) 15077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:48 smithi179 bash[23186]: audit 2024-09-21T05:34:47.856194+0000 mgr.a (mgr.14388) 19061 : audit [DBG] from='client.409221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: cluster 2024-09-21T05:34:47.206836+0000 mgr.a (mgr.14388) 19060 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: audit 2024-09-21T05:34:47.621011+0000 mon.a (mon.0) 15072 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: audit 2024-09-21T05:34:47.628161+0000 mon.a (mon.0) 15073 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: audit 2024-09-21T05:34:47.636464+0000 mon.a (mon.0) 15074 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: audit 2024-09-21T05:34:47.813083+0000 mon.a (mon.0) 15075 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: audit 2024-09-21T05:34:47.821161+0000 mon.a (mon.0) 15076 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: audit 2024-09-21T05:34:47.829363+0000 mon.a (mon.0) 15077 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:48 smithi049 bash[23528]: audit 2024-09-21T05:34:47.856194+0000 mgr.a (mgr.14388) 19061 : audit [DBG] from='client.409221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:50 smithi044 bash[22676]: cluster 2024-09-21T05:34:49.207710+0000 mgr.a (mgr.14388) 19062 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:50 smithi179 bash[23186]: cluster 2024-09-21T05:34:49.207710+0000 mgr.a (mgr.14388) 19062 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:50 smithi049 bash[23528]: cluster 2024-09-21T05:34:49.207710+0000 mgr.a (mgr.14388) 19062 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:52.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:52 smithi049 bash[23528]: cluster 2024-09-21T05:34:51.210005+0000 mgr.a (mgr.14388) 19063 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:52 smithi044 bash[22676]: cluster 2024-09-21T05:34:51.210005+0000 mgr.a (mgr.14388) 19063 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:52 smithi179 bash[23186]: cluster 2024-09-21T05:34:51.210005+0000 mgr.a (mgr.14388) 19063 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:53.285 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:53.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:53.286 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:54.070 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:54.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:54.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:54.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:54.070 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:34:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:54 smithi049 bash[23528]: cluster 2024-09-21T05:34:53.210813+0000 mgr.a (mgr.14388) 19064 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:54 smithi049 bash[23528]: audit 2024-09-21T05:34:53.618330+0000 mgr.a (mgr.14388) 19065 : audit [DBG] from='client.409296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:54 smithi044 bash[22676]: cluster 2024-09-21T05:34:53.210813+0000 mgr.a (mgr.14388) 19064 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:54.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:54 smithi044 bash[22676]: audit 2024-09-21T05:34:53.618330+0000 mgr.a (mgr.14388) 19065 : audit [DBG] from='client.409296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:54 smithi179 bash[23186]: cluster 2024-09-21T05:34:53.210813+0000 mgr.a (mgr.14388) 19064 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:54 smithi179 bash[23186]: audit 2024-09-21T05:34:53.618330+0000 mgr.a (mgr.14388) 19065 : audit [DBG] from='client.409296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:56 smithi044 bash[22676]: cluster 2024-09-21T05:34:55.213179+0000 mgr.a (mgr.14388) 19066 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:57.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:56 smithi179 bash[23186]: cluster 2024-09-21T05:34:55.213179+0000 mgr.a (mgr.14388) 19066 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:56 smithi049 bash[23528]: cluster 2024-09-21T05:34:55.213179+0000 mgr.a (mgr.14388) 19066 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:34:58.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:58 smithi049 bash[23528]: cluster 2024-09-21T05:34:57.214222+0000 mgr.a (mgr.14388) 19067 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:58.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:58 smithi049 bash[23528]: audit 2024-09-21T05:34:58.482612+0000 mon.a (mon.0) 15078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:58.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:58 smithi049 bash[23528]: audit 2024-09-21T05:34:58.491604+0000 mon.a (mon.0) 15079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:58.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:34:58 smithi049 bash[23528]: audit 2024-09-21T05:34:58.502220+0000 mon.a (mon.0) 15080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:58 smithi044 bash[22676]: cluster 2024-09-21T05:34:57.214222+0000 mgr.a (mgr.14388) 19067 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:58 smithi044 bash[22676]: audit 2024-09-21T05:34:58.482612+0000 mon.a (mon.0) 15078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:58 smithi044 bash[22676]: audit 2024-09-21T05:34:58.491604+0000 mon.a (mon.0) 15079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:34:58 smithi044 bash[22676]: audit 2024-09-21T05:34:58.502220+0000 mon.a (mon.0) 15080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:58 smithi179 bash[23186]: cluster 2024-09-21T05:34:57.214222+0000 mgr.a (mgr.14388) 19067 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:34:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:58 smithi179 bash[23186]: audit 2024-09-21T05:34:58.482612+0000 mon.a (mon.0) 15078 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:58 smithi179 bash[23186]: audit 2024-09-21T05:34:58.491604+0000 mon.a (mon.0) 15079 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:34:58 smithi179 bash[23186]: audit 2024-09-21T05:34:58.502220+0000 mon.a (mon.0) 15080 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:34:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:34:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:34:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:34:59.828 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:34:59.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:34:59.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:34:59.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:34:59.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:00 smithi044 bash[22676]: cluster 2024-09-21T05:34:59.214698+0000 mgr.a (mgr.14388) 19068 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:00 smithi044 bash[22676]: audit 2024-09-21T05:34:59.396100+0000 mgr.a (mgr.14388) 19069 : audit [DBG] from='client.409374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:01.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:00 smithi179 bash[23186]: cluster 2024-09-21T05:34:59.214698+0000 mgr.a (mgr.14388) 19068 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:00 smithi179 bash[23186]: audit 2024-09-21T05:34:59.396100+0000 mgr.a (mgr.14388) 19069 : audit [DBG] from='client.409374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:00 smithi049 bash[23528]: cluster 2024-09-21T05:34:59.214698+0000 mgr.a (mgr.14388) 19068 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:00 smithi049 bash[23528]: audit 2024-09-21T05:34:59.396100+0000 mgr.a (mgr.14388) 19069 : audit [DBG] from='client.409374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22676]: cluster 2024-09-21T05:35:01.217165+0000 mgr.a (mgr.14388) 19070 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22676]: audit 2024-09-21T05:35:01.731826+0000 mon.a (mon.0) 15081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22676]: audit 2024-09-21T05:35:01.739242+0000 mon.a (mon.0) 15082 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22676]: audit 2024-09-21T05:35:01.741134+0000 mon.a (mon.0) 15083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22676]: audit 2024-09-21T05:35:01.752557+0000 mon.a (mon.0) 15084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22676]: audit 2024-09-21T05:35:01.759100+0000 mon.a (mon.0) 15085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22676]: audit 2024-09-21T05:35:01.761570+0000 mgr.a (mgr.14388) 19071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:35:02.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22930]: debug 2024-09-21T05:35:02.520+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:35:02.740 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:35:02 smithi044 bash[22930]: debug 2024-09-21T05:35:02.520+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:35:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:02 smithi179 bash[23186]: cluster 2024-09-21T05:35:01.217165+0000 mgr.a (mgr.14388) 19070 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:02 smithi179 bash[23186]: audit 2024-09-21T05:35:01.731826+0000 mon.a (mon.0) 15081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:35:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:02 smithi179 bash[23186]: audit 2024-09-21T05:35:01.739242+0000 mon.a (mon.0) 15082 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:35:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:02 smithi179 bash[23186]: audit 2024-09-21T05:35:01.741134+0000 mon.a (mon.0) 15083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:35:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:02 smithi179 bash[23186]: audit 2024-09-21T05:35:01.752557+0000 mon.a (mon.0) 15084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:02 smithi179 bash[23186]: audit 2024-09-21T05:35:01.759100+0000 mon.a (mon.0) 15085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:35:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:02 smithi179 bash[23186]: audit 2024-09-21T05:35:01.761570+0000 mgr.a (mgr.14388) 19071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:35:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:02 smithi049 bash[23528]: cluster 2024-09-21T05:35:01.217165+0000 mgr.a (mgr.14388) 19070 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:02 smithi049 bash[23528]: audit 2024-09-21T05:35:01.731826+0000 mon.a (mon.0) 15081 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:35:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:02 smithi049 bash[23528]: audit 2024-09-21T05:35:01.739242+0000 mon.a (mon.0) 15082 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:35:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:02 smithi049 bash[23528]: audit 2024-09-21T05:35:01.741134+0000 mon.a (mon.0) 15083 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:35:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:02 smithi049 bash[23528]: audit 2024-09-21T05:35:01.752557+0000 mon.a (mon.0) 15084 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:02 smithi049 bash[23528]: audit 2024-09-21T05:35:01.759100+0000 mon.a (mon.0) 15085 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:35:03.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:02 smithi049 bash[23528]: audit 2024-09-21T05:35:01.761570+0000 mgr.a (mgr.14388) 19071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:35:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:03 smithi044 bash[22676]: audit 2024-09-21T05:35:02.522879+0000 mgr.a (mgr.14388) 19072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:35:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:03 smithi044 bash[22676]: cephadm 2024-09-21T05:35:02.524001+0000 mgr.a (mgr.14388) 19073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:35:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:03 smithi179 bash[23186]: audit 2024-09-21T05:35:02.522879+0000 mgr.a (mgr.14388) 19072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:35:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:03 smithi179 bash[23186]: cephadm 2024-09-21T05:35:02.524001+0000 mgr.a (mgr.14388) 19073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:35:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:03 smithi049 bash[23528]: audit 2024-09-21T05:35:02.522879+0000 mgr.a (mgr.14388) 19072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:35:04.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:03 smithi049 bash[23528]: cephadm 2024-09-21T05:35:02.524001+0000 mgr.a (mgr.14388) 19073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:35:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:04.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:04.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:04 smithi179 bash[23186]: cluster 2024-09-21T05:35:03.218084+0000 mgr.a (mgr.14388) 19074 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:04 smithi044 bash[22676]: cluster 2024-09-21T05:35:03.218084+0000 mgr.a (mgr.14388) 19074 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:04 smithi049 bash[23528]: cluster 2024-09-21T05:35:03.218084+0000 mgr.a (mgr.14388) 19074 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:05.598 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:05 smithi044 bash[22676]: audit 2024-09-21T05:35:05.164860+0000 mgr.a (mgr.14388) 19075 : audit [DBG] from='client.409554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:06.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:05 smithi179 bash[23186]: audit 2024-09-21T05:35:05.164860+0000 mgr.a (mgr.14388) 19075 : audit [DBG] from='client.409554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:05 smithi049 bash[23528]: audit 2024-09-21T05:35:05.164860+0000 mgr.a (mgr.14388) 19075 : audit [DBG] from='client.409554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:06 smithi044 bash[22676]: cluster 2024-09-21T05:35:05.221202+0000 mgr.a (mgr.14388) 19076 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:06 smithi179 bash[23186]: cluster 2024-09-21T05:35:05.221202+0000 mgr.a (mgr.14388) 19076 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:06 smithi049 bash[23528]: cluster 2024-09-21T05:35:05.221202+0000 mgr.a (mgr.14388) 19076 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:08 smithi044 bash[22676]: cluster 2024-09-21T05:35:07.222200+0000 mgr.a (mgr.14388) 19077 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:08 smithi044 bash[22676]: audit 2024-09-21T05:35:07.855517+0000 mon.a (mon.0) 15086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:08 smithi044 bash[22676]: audit 2024-09-21T05:35:07.863668+0000 mon.a (mon.0) 15087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:08 smithi044 bash[22676]: audit 2024-09-21T05:35:07.874083+0000 mon.a (mon.0) 15088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:08 smithi044 bash[22676]: audit 2024-09-21T05:35:08.034265+0000 mon.a (mon.0) 15089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:08 smithi044 bash[22676]: audit 2024-09-21T05:35:08.042760+0000 mon.a (mon.0) 15090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:08 smithi044 bash[22676]: audit 2024-09-21T05:35:08.052923+0000 mon.a (mon.0) 15091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:08 smithi179 bash[23186]: cluster 2024-09-21T05:35:07.222200+0000 mgr.a (mgr.14388) 19077 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:08 smithi179 bash[23186]: audit 2024-09-21T05:35:07.855517+0000 mon.a (mon.0) 15086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:08 smithi179 bash[23186]: audit 2024-09-21T05:35:07.863668+0000 mon.a (mon.0) 15087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:08 smithi179 bash[23186]: audit 2024-09-21T05:35:07.874083+0000 mon.a (mon.0) 15088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:08 smithi179 bash[23186]: audit 2024-09-21T05:35:08.034265+0000 mon.a (mon.0) 15089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:08 smithi179 bash[23186]: audit 2024-09-21T05:35:08.042760+0000 mon.a (mon.0) 15090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:08 smithi179 bash[23186]: audit 2024-09-21T05:35:08.052923+0000 mon.a (mon.0) 15091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:08 smithi049 bash[23528]: cluster 2024-09-21T05:35:07.222200+0000 mgr.a (mgr.14388) 19077 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:08 smithi049 bash[23528]: audit 2024-09-21T05:35:07.855517+0000 mon.a (mon.0) 15086 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:08 smithi049 bash[23528]: audit 2024-09-21T05:35:07.863668+0000 mon.a (mon.0) 15087 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:08 smithi049 bash[23528]: audit 2024-09-21T05:35:07.874083+0000 mon.a (mon.0) 15088 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:08 smithi049 bash[23528]: audit 2024-09-21T05:35:08.034265+0000 mon.a (mon.0) 15089 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:08 smithi049 bash[23528]: audit 2024-09-21T05:35:08.042760+0000 mon.a (mon.0) 15090 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:08 smithi049 bash[23528]: audit 2024-09-21T05:35:08.052923+0000 mon.a (mon.0) 15091 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:10.600 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:10.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:10.600 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:10 smithi044 bash[22676]: cluster 2024-09-21T05:35:09.222983+0000 mgr.a (mgr.14388) 19078 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:10 smithi179 bash[23186]: cluster 2024-09-21T05:35:09.222983+0000 mgr.a (mgr.14388) 19078 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:10 smithi049 bash[23528]: cluster 2024-09-21T05:35:09.222983+0000 mgr.a (mgr.14388) 19078 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:11.378 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:11.378 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:11 smithi044 bash[22676]: audit 2024-09-21T05:35:10.936248+0000 mgr.a (mgr.14388) 19079 : audit [DBG] from='client.409629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:11 smithi179 bash[23186]: audit 2024-09-21T05:35:10.936248+0000 mgr.a (mgr.14388) 19079 : audit [DBG] from='client.409629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:11 smithi049 bash[23528]: audit 2024-09-21T05:35:10.936248+0000 mgr.a (mgr.14388) 19079 : audit [DBG] from='client.409629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:13.138 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:12 smithi049 bash[23528]: cluster 2024-09-21T05:35:11.224357+0000 mgr.a (mgr.14388) 19080 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:12 smithi044 bash[22676]: cluster 2024-09-21T05:35:11.224357+0000 mgr.a (mgr.14388) 19080 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:12 smithi179 bash[23186]: cluster 2024-09-21T05:35:11.224357+0000 mgr.a (mgr.14388) 19080 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:14 smithi044 bash[22676]: cluster 2024-09-21T05:35:13.225234+0000 mgr.a (mgr.14388) 19081 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:14 smithi179 bash[23186]: cluster 2024-09-21T05:35:13.225234+0000 mgr.a (mgr.14388) 19081 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:14 smithi049 bash[23528]: cluster 2024-09-21T05:35:13.225234+0000 mgr.a (mgr.14388) 19081 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:35:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:17.146 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:17.146 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:16 smithi044 bash[22676]: cluster 2024-09-21T05:35:15.227430+0000 mgr.a (mgr.14388) 19082 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:16 smithi179 bash[23186]: cluster 2024-09-21T05:35:15.227430+0000 mgr.a (mgr.14388) 19082 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:16 smithi049 bash[23528]: cluster 2024-09-21T05:35:15.227430+0000 mgr.a (mgr.14388) 19082 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:35:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:17 smithi044 bash[22676]: audit 2024-09-21T05:35:16.716430+0000 mgr.a (mgr.14388) 19083 : audit [DBG] from='client.409704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:18.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:17 smithi179 bash[23186]: audit 2024-09-21T05:35:16.716430+0000 mgr.a (mgr.14388) 19083 : audit [DBG] from='client.409704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:17 smithi049 bash[23528]: audit 2024-09-21T05:35:16.716430+0000 mgr.a (mgr.14388) 19083 : audit [DBG] from='client.409704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:18 smithi049 bash[23528]: cluster 2024-09-21T05:35:17.228301+0000 mgr.a (mgr.14388) 19084 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:18 smithi049 bash[23528]: audit 2024-09-21T05:35:18.718723+0000 mon.a (mon.0) 15092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:18 smithi049 bash[23528]: audit 2024-09-21T05:35:18.727396+0000 mon.a (mon.0) 15093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:18 smithi049 bash[23528]: audit 2024-09-21T05:35:18.737840+0000 mon.a (mon.0) 15094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:18 smithi044 bash[22676]: cluster 2024-09-21T05:35:17.228301+0000 mgr.a (mgr.14388) 19084 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:18 smithi044 bash[22676]: audit 2024-09-21T05:35:18.718723+0000 mon.a (mon.0) 15092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:18 smithi044 bash[22676]: audit 2024-09-21T05:35:18.727396+0000 mon.a (mon.0) 15093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:18 smithi044 bash[22676]: audit 2024-09-21T05:35:18.737840+0000 mon.a (mon.0) 15094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:18 smithi179 bash[23186]: cluster 2024-09-21T05:35:17.228301+0000 mgr.a (mgr.14388) 19084 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:18 smithi179 bash[23186]: audit 2024-09-21T05:35:18.718723+0000 mon.a (mon.0) 15092 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:18 smithi179 bash[23186]: audit 2024-09-21T05:35:18.727396+0000 mon.a (mon.0) 15093 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:18 smithi179 bash[23186]: audit 2024-09-21T05:35:18.737840+0000 mon.a (mon.0) 15094 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:20 smithi044 bash[22676]: cluster 2024-09-21T05:35:19.229099+0000 mgr.a (mgr.14388) 19085 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:21.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:20 smithi179 bash[23186]: cluster 2024-09-21T05:35:19.229099+0000 mgr.a (mgr.14388) 19085 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:20 smithi049 bash[23528]: cluster 2024-09-21T05:35:19.229099+0000 mgr.a (mgr.14388) 19085 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:22.955 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:23.063 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:22 smithi044 bash[22676]: cluster 2024-09-21T05:35:21.231368+0000 mgr.a (mgr.14388) 19086 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:22 smithi179 bash[23186]: cluster 2024-09-21T05:35:21.231368+0000 mgr.a (mgr.14388) 19086 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:22 smithi049 bash[23528]: cluster 2024-09-21T05:35:21.231368+0000 mgr.a (mgr.14388) 19086 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:23.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:23 smithi044 bash[22676]: audit 2024-09-21T05:35:22.484302+0000 mgr.a (mgr.14388) 19087 : audit [DBG] from='client.409782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:24.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:23 smithi179 bash[23186]: audit 2024-09-21T05:35:22.484302+0000 mgr.a (mgr.14388) 19087 : audit [DBG] from='client.409782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:23 smithi049 bash[23528]: audit 2024-09-21T05:35:22.484302+0000 mgr.a (mgr.14388) 19087 : audit [DBG] from='client.409782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:24 smithi044 bash[22676]: cluster 2024-09-21T05:35:23.232401+0000 mgr.a (mgr.14388) 19088 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:25.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:24 smithi179 bash[23186]: cluster 2024-09-21T05:35:23.232401+0000 mgr.a (mgr.14388) 19088 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:24 smithi049 bash[23528]: cluster 2024-09-21T05:35:23.232401+0000 mgr.a (mgr.14388) 19088 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:27.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:26 smithi044 bash[22676]: cluster 2024-09-21T05:35:25.235866+0000 mgr.a (mgr.14388) 19089 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:26 smithi179 bash[23186]: cluster 2024-09-21T05:35:25.235866+0000 mgr.a (mgr.14388) 19089 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:26 smithi049 bash[23528]: cluster 2024-09-21T05:35:25.235866+0000 mgr.a (mgr.14388) 19089 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:27.956 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:27.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:27.957 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:28.741 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:28.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:28.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:28.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:28.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:29 smithi044 bash[22676]: cluster 2024-09-21T05:35:27.236690+0000 mgr.a (mgr.14388) 19090 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:29 smithi044 bash[22676]: audit 2024-09-21T05:35:28.052902+0000 mon.a (mon.0) 15095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:29 smithi044 bash[22676]: audit 2024-09-21T05:35:28.057777+0000 mon.a (mon.0) 15096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:29 smithi044 bash[22676]: audit 2024-09-21T05:35:28.067673+0000 mon.a (mon.0) 15097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:29 smithi044 bash[22676]: audit 2024-09-21T05:35:28.261139+0000 mon.a (mon.0) 15098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:29 smithi044 bash[22676]: audit 2024-09-21T05:35:28.268961+0000 mon.a (mon.0) 15099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:29 smithi044 bash[22676]: audit 2024-09-21T05:35:28.280017+0000 mon.a (mon.0) 15100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:29 smithi179 bash[23186]: cluster 2024-09-21T05:35:27.236690+0000 mgr.a (mgr.14388) 19090 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:29 smithi179 bash[23186]: audit 2024-09-21T05:35:28.052902+0000 mon.a (mon.0) 15095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:29 smithi179 bash[23186]: audit 2024-09-21T05:35:28.057777+0000 mon.a (mon.0) 15096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:29 smithi179 bash[23186]: audit 2024-09-21T05:35:28.067673+0000 mon.a (mon.0) 15097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:29 smithi179 bash[23186]: audit 2024-09-21T05:35:28.261139+0000 mon.a (mon.0) 15098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:29 smithi179 bash[23186]: audit 2024-09-21T05:35:28.268961+0000 mon.a (mon.0) 15099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:29 smithi179 bash[23186]: audit 2024-09-21T05:35:28.280017+0000 mon.a (mon.0) 15100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:29 smithi049 bash[23528]: cluster 2024-09-21T05:35:27.236690+0000 mgr.a (mgr.14388) 19090 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:29 smithi049 bash[23528]: audit 2024-09-21T05:35:28.052902+0000 mon.a (mon.0) 15095 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:29 smithi049 bash[23528]: audit 2024-09-21T05:35:28.057777+0000 mon.a (mon.0) 15096 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:29 smithi049 bash[23528]: audit 2024-09-21T05:35:28.067673+0000 mon.a (mon.0) 15097 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:29 smithi049 bash[23528]: audit 2024-09-21T05:35:28.261139+0000 mon.a (mon.0) 15098 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:29 smithi049 bash[23528]: audit 2024-09-21T05:35:28.268961+0000 mon.a (mon.0) 15099 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:29.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:29 smithi049 bash[23528]: audit 2024-09-21T05:35:28.280017+0000 mon.a (mon.0) 15100 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:30 smithi044 bash[22676]: audit 2024-09-21T05:35:28.296223+0000 mgr.a (mgr.14388) 19091 : audit [DBG] from='client.409860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:30.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:30 smithi179 bash[23186]: audit 2024-09-21T05:35:28.296223+0000 mgr.a (mgr.14388) 19091 : audit [DBG] from='client.409860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:30 smithi049 bash[23528]: audit 2024-09-21T05:35:28.296223+0000 mgr.a (mgr.14388) 19091 : audit [DBG] from='client.409860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:31 smithi044 bash[22676]: cluster 2024-09-21T05:35:29.237790+0000 mgr.a (mgr.14388) 19092 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:31 smithi179 bash[23186]: cluster 2024-09-21T05:35:29.237790+0000 mgr.a (mgr.14388) 19092 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:31 smithi049 bash[23528]: cluster 2024-09-21T05:35:29.237790+0000 mgr.a (mgr.14388) 19092 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:33.358 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:33 smithi049 bash[23528]: cluster 2024-09-21T05:35:31.240106+0000 mgr.a (mgr.14388) 19093 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:33 smithi044 bash[22676]: cluster 2024-09-21T05:35:31.240106+0000 mgr.a (mgr.14388) 19093 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:33 smithi179 bash[23186]: cluster 2024-09-21T05:35:31.240106+0000 mgr.a (mgr.14388) 19093 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:33.743 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:33.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:33.744 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:34.511 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:34.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:34.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:34.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:34.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:35 smithi044 bash[22676]: cluster 2024-09-21T05:35:33.240874+0000 mgr.a (mgr.14388) 19094 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:35 smithi044 bash[22676]: audit 2024-09-21T05:35:34.078371+0000 mgr.a (mgr.14388) 19095 : audit [DBG] from='client.409938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:35 smithi179 bash[23186]: cluster 2024-09-21T05:35:33.240874+0000 mgr.a (mgr.14388) 19094 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:35 smithi179 bash[23186]: audit 2024-09-21T05:35:34.078371+0000 mgr.a (mgr.14388) 19095 : audit [DBG] from='client.409938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:35 smithi049 bash[23528]: cluster 2024-09-21T05:35:33.240874+0000 mgr.a (mgr.14388) 19094 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:35 smithi049 bash[23528]: audit 2024-09-21T05:35:34.078371+0000 mgr.a (mgr.14388) 19095 : audit [DBG] from='client.409938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:37 smithi044 bash[22676]: cluster 2024-09-21T05:35:35.243347+0000 mgr.a (mgr.14388) 19096 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:37 smithi179 bash[23186]: cluster 2024-09-21T05:35:35.243347+0000 mgr.a (mgr.14388) 19096 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:37 smithi049 bash[23528]: cluster 2024-09-21T05:35:35.243347+0000 mgr.a (mgr.14388) 19096 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:35:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:39 smithi049 bash[23528]: cluster 2024-09-21T05:35:37.244320+0000 mgr.a (mgr.14388) 19097 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:39 smithi049 bash[23528]: audit 2024-09-21T05:35:38.946942+0000 mon.a (mon.0) 15101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:39 smithi049 bash[23528]: audit 2024-09-21T05:35:38.955566+0000 mon.a (mon.0) 15102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:39 smithi049 bash[23528]: audit 2024-09-21T05:35:38.966352+0000 mon.a (mon.0) 15103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:39 smithi044 bash[22676]: cluster 2024-09-21T05:35:37.244320+0000 mgr.a (mgr.14388) 19097 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:39 smithi044 bash[22676]: audit 2024-09-21T05:35:38.946942+0000 mon.a (mon.0) 15101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:39 smithi044 bash[22676]: audit 2024-09-21T05:35:38.955566+0000 mon.a (mon.0) 15102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:39 smithi044 bash[22676]: audit 2024-09-21T05:35:38.966352+0000 mon.a (mon.0) 15103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:39 smithi179 bash[23186]: cluster 2024-09-21T05:35:37.244320+0000 mgr.a (mgr.14388) 19097 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:39 smithi179 bash[23186]: audit 2024-09-21T05:35:38.946942+0000 mon.a (mon.0) 15101 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:39 smithi179 bash[23186]: audit 2024-09-21T05:35:38.955566+0000 mon.a (mon.0) 15102 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:39 smithi179 bash[23186]: audit 2024-09-21T05:35:38.966352+0000 mon.a (mon.0) 15103 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:39.513 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:39.514 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:39.514 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:40.292 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:40.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:40.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:40.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:40.293 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:41 smithi044 bash[22676]: cluster 2024-09-21T05:35:39.245122+0000 mgr.a (mgr.14388) 19098 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:41 smithi044 bash[22676]: audit 2024-09-21T05:35:39.840817+0000 mgr.a (mgr.14388) 19099 : audit [DBG] from='client.410010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:41 smithi179 bash[23186]: cluster 2024-09-21T05:35:39.245122+0000 mgr.a (mgr.14388) 19098 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:41 smithi179 bash[23186]: audit 2024-09-21T05:35:39.840817+0000 mgr.a (mgr.14388) 19099 : audit [DBG] from='client.410010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:41 smithi049 bash[23528]: cluster 2024-09-21T05:35:39.245122+0000 mgr.a (mgr.14388) 19098 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:41 smithi049 bash[23528]: audit 2024-09-21T05:35:39.840817+0000 mgr.a (mgr.14388) 19099 : audit [DBG] from='client.410010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:43.302 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:43 smithi044 bash[22676]: cluster 2024-09-21T05:35:41.248076+0000 mgr.a (mgr.14388) 19100 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:43.326 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:43 smithi179 bash[23186]: cluster 2024-09-21T05:35:41.248076+0000 mgr.a (mgr.14388) 19100 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:43 smithi049 bash[23528]: cluster 2024-09-21T05:35:41.248076+0000 mgr.a (mgr.14388) 19100 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:45.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:45 smithi044 bash[22676]: cluster 2024-09-21T05:35:43.248816+0000 mgr.a (mgr.14388) 19101 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:35:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:45 smithi179 bash[23186]: cluster 2024-09-21T05:35:43.248816+0000 mgr.a (mgr.14388) 19101 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:35:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:45 smithi049 bash[23528]: cluster 2024-09-21T05:35:43.248816+0000 mgr.a (mgr.14388) 19101 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:35:46.077 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:47 smithi044 bash[22676]: cluster 2024-09-21T05:35:45.249920+0000 mgr.a (mgr.14388) 19102 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:47 smithi044 bash[22676]: audit 2024-09-21T05:35:45.635188+0000 mgr.a (mgr.14388) 19103 : audit [DBG] from='client.410088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:47 smithi179 bash[23186]: cluster 2024-09-21T05:35:45.249920+0000 mgr.a (mgr.14388) 19102 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:47 smithi179 bash[23186]: audit 2024-09-21T05:35:45.635188+0000 mgr.a (mgr.14388) 19103 : audit [DBG] from='client.410088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:47 smithi049 bash[23528]: cluster 2024-09-21T05:35:45.249920+0000 mgr.a (mgr.14388) 19102 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:47 smithi049 bash[23528]: audit 2024-09-21T05:35:45.635188+0000 mgr.a (mgr.14388) 19103 : audit [DBG] from='client.410088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:49 smithi049 bash[23528]: cluster 2024-09-21T05:35:47.250778+0000 mgr.a (mgr.14388) 19104 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:35:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:49 smithi049 bash[23528]: audit 2024-09-21T05:35:48.283803+0000 mon.a (mon.0) 15104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:49 smithi049 bash[23528]: audit 2024-09-21T05:35:48.291786+0000 mon.a (mon.0) 15105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:49 smithi049 bash[23528]: audit 2024-09-21T05:35:48.301837+0000 mon.a (mon.0) 15106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:49 smithi049 bash[23528]: audit 2024-09-21T05:35:48.488874+0000 mon.a (mon.0) 15107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:49 smithi049 bash[23528]: audit 2024-09-21T05:35:48.497737+0000 mon.a (mon.0) 15108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:49 smithi049 bash[23528]: audit 2024-09-21T05:35:48.508291+0000 mon.a (mon.0) 15109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:49 smithi044 bash[22676]: cluster 2024-09-21T05:35:47.250778+0000 mgr.a (mgr.14388) 19104 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:35:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:49 smithi044 bash[22676]: audit 2024-09-21T05:35:48.283803+0000 mon.a (mon.0) 15104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:49 smithi044 bash[22676]: audit 2024-09-21T05:35:48.291786+0000 mon.a (mon.0) 15105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:49 smithi044 bash[22676]: audit 2024-09-21T05:35:48.301837+0000 mon.a (mon.0) 15106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:49 smithi044 bash[22676]: audit 2024-09-21T05:35:48.488874+0000 mon.a (mon.0) 15107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:49 smithi044 bash[22676]: audit 2024-09-21T05:35:48.497737+0000 mon.a (mon.0) 15108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:49 smithi044 bash[22676]: audit 2024-09-21T05:35:48.508291+0000 mon.a (mon.0) 15109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:49 smithi179 bash[23186]: cluster 2024-09-21T05:35:47.250778+0000 mgr.a (mgr.14388) 19104 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:35:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:49 smithi179 bash[23186]: audit 2024-09-21T05:35:48.283803+0000 mon.a (mon.0) 15104 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:49 smithi179 bash[23186]: audit 2024-09-21T05:35:48.291786+0000 mon.a (mon.0) 15105 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:49 smithi179 bash[23186]: audit 2024-09-21T05:35:48.301837+0000 mon.a (mon.0) 15106 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:49 smithi179 bash[23186]: audit 2024-09-21T05:35:48.488874+0000 mon.a (mon.0) 15107 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:49 smithi179 bash[23186]: audit 2024-09-21T05:35:48.497737+0000 mon.a (mon.0) 15108 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:49.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:49 smithi179 bash[23186]: audit 2024-09-21T05:35:48.508291+0000 mon.a (mon.0) 15109 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:35:51.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:51.080 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:51 smithi044 bash[22676]: cluster 2024-09-21T05:35:49.251583+0000 mgr.a (mgr.14388) 19105 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:35:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:51 smithi179 bash[23186]: cluster 2024-09-21T05:35:49.251583+0000 mgr.a (mgr.14388) 19105 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:35:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:51 smithi049 bash[23528]: cluster 2024-09-21T05:35:49.251583+0000 mgr.a (mgr.14388) 19105 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:51.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:51.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:51.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:51.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:53 smithi044 bash[22676]: cluster 2024-09-21T05:35:51.253768+0000 mgr.a (mgr.14388) 19106 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:53 smithi044 bash[22676]: audit 2024-09-21T05:35:51.413692+0000 mgr.a (mgr.14388) 19107 : audit [DBG] from='client.410163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:53 smithi179 bash[23186]: cluster 2024-09-21T05:35:51.253768+0000 mgr.a (mgr.14388) 19106 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:53.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:53 smithi179 bash[23186]: audit 2024-09-21T05:35:51.413692+0000 mgr.a (mgr.14388) 19107 : audit [DBG] from='client.410163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:53 smithi049 bash[23528]: cluster 2024-09-21T05:35:51.253768+0000 mgr.a (mgr.14388) 19106 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:53 smithi049 bash[23528]: audit 2024-09-21T05:35:51.413692+0000 mgr.a (mgr.14388) 19107 : audit [DBG] from='client.410163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:55.476 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:55 smithi049 bash[23528]: cluster 2024-09-21T05:35:53.254679+0000 mgr.a (mgr.14388) 19108 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:55 smithi044 bash[22676]: cluster 2024-09-21T05:35:53.254679+0000 mgr.a (mgr.14388) 19108 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:55.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:55 smithi179 bash[23186]: cluster 2024-09-21T05:35:53.254679+0000 mgr.a (mgr.14388) 19108 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:35:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:35:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:35:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:35:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:57 smithi044 bash[22676]: cluster 2024-09-21T05:35:55.256910+0000 mgr.a (mgr.14388) 19109 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:35:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:57 smithi179 bash[23186]: cluster 2024-09-21T05:35:55.256910+0000 mgr.a (mgr.14388) 19109 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:35:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:57 smithi049 bash[23528]: cluster 2024-09-21T05:35:55.256910+0000 mgr.a (mgr.14388) 19109 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:35:57.624 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:35:57.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:35:57.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:35:57.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:35:57.625 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:35:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:58 smithi044 bash[22676]: audit 2024-09-21T05:35:57.200848+0000 mgr.a (mgr.14388) 19110 : audit [DBG] from='client.410238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:58.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:58 smithi179 bash[23186]: audit 2024-09-21T05:35:57.200848+0000 mgr.a (mgr.14388) 19110 : audit [DBG] from='client.410238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:58 smithi049 bash[23528]: audit 2024-09-21T05:35:57.200848+0000 mgr.a (mgr.14388) 19110 : audit [DBG] from='client.410238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:35:59 smithi044 bash[22676]: cluster 2024-09-21T05:35:57.257516+0000 mgr.a (mgr.14388) 19111 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:35:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:35:59 smithi179 bash[23186]: cluster 2024-09-21T05:35:57.257516+0000 mgr.a (mgr.14388) 19111 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:35:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:35:59 smithi049 bash[23528]: cluster 2024-09-21T05:35:57.257516+0000 mgr.a (mgr.14388) 19111 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:36:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:00 smithi044 bash[22676]: audit 2024-09-21T05:35:59.182641+0000 mon.a (mon.0) 15110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:00 smithi044 bash[22676]: audit 2024-09-21T05:35:59.202623+0000 mon.a (mon.0) 15111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:00 smithi044 bash[22676]: audit 2024-09-21T05:35:59.214562+0000 mon.a (mon.0) 15112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:00 smithi179 bash[23186]: audit 2024-09-21T05:35:59.182641+0000 mon.a (mon.0) 15110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:00 smithi179 bash[23186]: audit 2024-09-21T05:35:59.202623+0000 mon.a (mon.0) 15111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:00 smithi179 bash[23186]: audit 2024-09-21T05:35:59.214562+0000 mon.a (mon.0) 15112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:00 smithi049 bash[23528]: audit 2024-09-21T05:35:59.182641+0000 mon.a (mon.0) 15110 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:00 smithi049 bash[23528]: audit 2024-09-21T05:35:59.202623+0000 mon.a (mon.0) 15111 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:00.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:00 smithi049 bash[23528]: audit 2024-09-21T05:35:59.214562+0000 mon.a (mon.0) 15112 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:01 smithi044 bash[22676]: cluster 2024-09-21T05:35:59.258514+0000 mgr.a (mgr.14388) 19112 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:36:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:01 smithi179 bash[23186]: cluster 2024-09-21T05:35:59.258514+0000 mgr.a (mgr.14388) 19112 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:36:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:01 smithi049 bash[23528]: cluster 2024-09-21T05:35:59.258514+0000 mgr.a (mgr.14388) 19112 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:36:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:02 smithi044 bash[22676]: cluster 2024-09-21T05:36:01.260845+0000 mgr.a (mgr.14388) 19113 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:36:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:02 smithi179 bash[23186]: cluster 2024-09-21T05:36:01.260845+0000 mgr.a (mgr.14388) 19113 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:36:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:02 smithi049 bash[23528]: cluster 2024-09-21T05:36:01.260845+0000 mgr.a (mgr.14388) 19113 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:36:02.626 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:02.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:02.627 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:03.456 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22930]: debug 2024-09-21T05:36:03.371+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22930]: debug 2024-09-21T05:36:03.383+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22676]: audit 2024-09-21T05:36:02.572274+0000 mon.a (mon.0) 15113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22676]: audit 2024-09-21T05:36:02.578994+0000 mon.a (mon.0) 15114 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22676]: audit 2024-09-21T05:36:02.580848+0000 mon.a (mon.0) 15115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22676]: audit 2024-09-21T05:36:02.592444+0000 mon.a (mon.0) 15116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22676]: audit 2024-09-21T05:36:02.598813+0000 mon.a (mon.0) 15117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22676]: audit 2024-09-21T05:36:02.601201+0000 mgr.a (mgr.14388) 19114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:36:03.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:03 smithi044 bash[22676]: audit 2024-09-21T05:36:02.994310+0000 mgr.a (mgr.14388) 19115 : audit [DBG] from='client.410334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:03 smithi179 bash[23186]: audit 2024-09-21T05:36:02.572274+0000 mon.a (mon.0) 15113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:36:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:03 smithi179 bash[23186]: audit 2024-09-21T05:36:02.578994+0000 mon.a (mon.0) 15114 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:36:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:03 smithi179 bash[23186]: audit 2024-09-21T05:36:02.580848+0000 mon.a (mon.0) 15115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:36:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:03 smithi179 bash[23186]: audit 2024-09-21T05:36:02.592444+0000 mon.a (mon.0) 15116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:03 smithi179 bash[23186]: audit 2024-09-21T05:36:02.598813+0000 mon.a (mon.0) 15117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:36:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:03 smithi179 bash[23186]: audit 2024-09-21T05:36:02.601201+0000 mgr.a (mgr.14388) 19114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:36:03.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:03 smithi179 bash[23186]: audit 2024-09-21T05:36:02.994310+0000 mgr.a (mgr.14388) 19115 : audit [DBG] from='client.410334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:03 smithi049 bash[23528]: audit 2024-09-21T05:36:02.572274+0000 mon.a (mon.0) 15113 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:36:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:03 smithi049 bash[23528]: audit 2024-09-21T05:36:02.578994+0000 mon.a (mon.0) 15114 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:36:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:03 smithi049 bash[23528]: audit 2024-09-21T05:36:02.580848+0000 mon.a (mon.0) 15115 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:36:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:03 smithi049 bash[23528]: audit 2024-09-21T05:36:02.592444+0000 mon.a (mon.0) 15116 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:03 smithi049 bash[23528]: audit 2024-09-21T05:36:02.598813+0000 mon.a (mon.0) 15117 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:36:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:03 smithi049 bash[23528]: audit 2024-09-21T05:36:02.601201+0000 mgr.a (mgr.14388) 19114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:36:03.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:03 smithi049 bash[23528]: audit 2024-09-21T05:36:02.994310+0000 mgr.a (mgr.14388) 19115 : audit [DBG] from='client.410334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:04.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:04 smithi044 bash[22676]: cluster 2024-09-21T05:36:03.261314+0000 mgr.a (mgr.14388) 19116 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:36:04.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:04 smithi044 bash[22676]: audit 2024-09-21T05:36:03.375531+0000 mgr.a (mgr.14388) 19117 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:36:04.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:04 smithi044 bash[22676]: cephadm 2024-09-21T05:36:03.386712+0000 mgr.a (mgr.14388) 19118 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:36:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:04 smithi179 bash[23186]: cluster 2024-09-21T05:36:03.261314+0000 mgr.a (mgr.14388) 19116 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:36:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:04 smithi179 bash[23186]: audit 2024-09-21T05:36:03.375531+0000 mgr.a (mgr.14388) 19117 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:36:04.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:04 smithi179 bash[23186]: cephadm 2024-09-21T05:36:03.386712+0000 mgr.a (mgr.14388) 19118 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:36:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:04 smithi049 bash[23528]: cluster 2024-09-21T05:36:03.261314+0000 mgr.a (mgr.14388) 19116 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:36:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:04 smithi049 bash[23528]: audit 2024-09-21T05:36:03.375531+0000 mgr.a (mgr.14388) 19117 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:36:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:04 smithi049 bash[23528]: cephadm 2024-09-21T05:36:03.386712+0000 mgr.a (mgr.14388) 19118 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:36:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:06 smithi044 bash[22676]: cluster 2024-09-21T05:36:05.262527+0000 mgr.a (mgr.14388) 19119 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T05:36:06.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:06 smithi179 bash[23186]: cluster 2024-09-21T05:36:05.262527+0000 mgr.a (mgr.14388) 19119 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T05:36:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:06 smithi049 bash[23528]: cluster 2024-09-21T05:36:05.262527+0000 mgr.a (mgr.14388) 19119 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-21T05:36:08.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:08 smithi179 bash[23186]: cluster 2024-09-21T05:36:07.263290+0000 mgr.a (mgr.14388) 19120 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:08 smithi044 bash[22676]: cluster 2024-09-21T05:36:07.263290+0000 mgr.a (mgr.14388) 19120 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:08.774 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:08.774 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:08.775 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:08 smithi049 bash[23528]: cluster 2024-09-21T05:36:07.263290+0000 mgr.a (mgr.14388) 19120 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:09.561 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:09.562 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:09.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:09 smithi049 bash[23528]: audit 2024-09-21T05:36:08.514133+0000 mon.a (mon.0) 15118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:09 smithi049 bash[23528]: audit 2024-09-21T05:36:08.522876+0000 mon.a (mon.0) 15119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:09 smithi049 bash[23528]: audit 2024-09-21T05:36:08.533075+0000 mon.a (mon.0) 15120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:09 smithi049 bash[23528]: audit 2024-09-21T05:36:08.712826+0000 mon.a (mon.0) 15121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:09 smithi049 bash[23528]: audit 2024-09-21T05:36:08.721357+0000 mon.a (mon.0) 15122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:09 smithi049 bash[23528]: audit 2024-09-21T05:36:08.731145+0000 mon.a (mon.0) 15123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:09 smithi049 bash[23528]: audit 2024-09-21T05:36:09.104750+0000 mgr.a (mgr.14388) 19121 : audit [DBG] from='client.410496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:09 smithi044 bash[22676]: audit 2024-09-21T05:36:08.514133+0000 mon.a (mon.0) 15118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:09 smithi044 bash[22676]: audit 2024-09-21T05:36:08.522876+0000 mon.a (mon.0) 15119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:09 smithi044 bash[22676]: audit 2024-09-21T05:36:08.533075+0000 mon.a (mon.0) 15120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:09 smithi044 bash[22676]: audit 2024-09-21T05:36:08.712826+0000 mon.a (mon.0) 15121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:09 smithi044 bash[22676]: audit 2024-09-21T05:36:08.721357+0000 mon.a (mon.0) 15122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:09 smithi044 bash[22676]: audit 2024-09-21T05:36:08.731145+0000 mon.a (mon.0) 15123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:09 smithi044 bash[22676]: audit 2024-09-21T05:36:09.104750+0000 mgr.a (mgr.14388) 19121 : audit [DBG] from='client.410496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:09 smithi179 bash[23186]: audit 2024-09-21T05:36:08.514133+0000 mon.a (mon.0) 15118 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:09 smithi179 bash[23186]: audit 2024-09-21T05:36:08.522876+0000 mon.a (mon.0) 15119 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:09 smithi179 bash[23186]: audit 2024-09-21T05:36:08.533075+0000 mon.a (mon.0) 15120 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:09 smithi179 bash[23186]: audit 2024-09-21T05:36:08.712826+0000 mon.a (mon.0) 15121 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:09 smithi179 bash[23186]: audit 2024-09-21T05:36:08.721357+0000 mon.a (mon.0) 15122 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:09 smithi179 bash[23186]: audit 2024-09-21T05:36:08.731145+0000 mon.a (mon.0) 15123 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:09 smithi179 bash[23186]: audit 2024-09-21T05:36:09.104750+0000 mgr.a (mgr.14388) 19121 : audit [DBG] from='client.410496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:10.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:10 smithi044 bash[22676]: cluster 2024-09-21T05:36:09.263929+0000 mgr.a (mgr.14388) 19122 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:11.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:10 smithi179 bash[23186]: cluster 2024-09-21T05:36:09.263929+0000 mgr.a (mgr.14388) 19122 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:10 smithi049 bash[23528]: cluster 2024-09-21T05:36:09.263929+0000 mgr.a (mgr.14388) 19122 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:12 smithi179 bash[23186]: cluster 2024-09-21T05:36:11.266323+0000 mgr.a (mgr.14388) 19123 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:12 smithi049 bash[23528]: cluster 2024-09-21T05:36:11.266323+0000 mgr.a (mgr.14388) 19123 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:12 smithi044 bash[22676]: cluster 2024-09-21T05:36:11.266323+0000 mgr.a (mgr.14388) 19123 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:14.563 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:14 smithi179 bash[23186]: cluster 2024-09-21T05:36:13.267079+0000 mgr.a (mgr.14388) 19124 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:14 smithi049 bash[23528]: cluster 2024-09-21T05:36:13.267079+0000 mgr.a (mgr.14388) 19124 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:14 smithi044 bash[22676]: cluster 2024-09-21T05:36:13.267079+0000 mgr.a (mgr.14388) 19124 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:15.349 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:15.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:15.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:15.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:15.349 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:16.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:15 smithi179 bash[23186]: audit 2024-09-21T05:36:14.896704+0000 mgr.a (mgr.14388) 19125 : audit [DBG] from='client.410571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:15 smithi049 bash[23528]: audit 2024-09-21T05:36:14.896704+0000 mgr.a (mgr.14388) 19125 : audit [DBG] from='client.410571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:15 smithi044 bash[22676]: audit 2024-09-21T05:36:14.896704+0000 mgr.a (mgr.14388) 19125 : audit [DBG] from='client.410571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:16 smithi049 bash[23528]: cluster 2024-09-21T05:36:15.268524+0000 mgr.a (mgr.14388) 19126 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:16 smithi044 bash[22676]: cluster 2024-09-21T05:36:15.268524+0000 mgr.a (mgr.14388) 19126 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:16 smithi179 bash[23186]: cluster 2024-09-21T05:36:15.268524+0000 mgr.a (mgr.14388) 19126 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:36:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:18 smithi049 bash[23528]: cluster 2024-09-21T05:36:17.269320+0000 mgr.a (mgr.14388) 19127 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:36:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:18 smithi044 bash[22676]: cluster 2024-09-21T05:36:17.269320+0000 mgr.a (mgr.14388) 19127 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:36:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:18 smithi179 bash[23186]: cluster 2024-09-21T05:36:17.269320+0000 mgr.a (mgr.14388) 19127 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:36:20.351 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:20.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:20.351 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:20 smithi044 bash[22676]: cluster 2024-09-21T05:36:19.270041+0000 mgr.a (mgr.14388) 19128 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:36:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:20 smithi044 bash[22676]: audit 2024-09-21T05:36:19.425797+0000 mon.a (mon.0) 15124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:20 smithi044 bash[22676]: audit 2024-09-21T05:36:19.434233+0000 mon.a (mon.0) 15125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:20 smithi044 bash[22676]: audit 2024-09-21T05:36:19.445034+0000 mon.a (mon.0) 15126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:20 smithi179 bash[23186]: cluster 2024-09-21T05:36:19.270041+0000 mgr.a (mgr.14388) 19128 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:36:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:20 smithi179 bash[23186]: audit 2024-09-21T05:36:19.425797+0000 mon.a (mon.0) 15124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:20 smithi179 bash[23186]: audit 2024-09-21T05:36:19.434233+0000 mon.a (mon.0) 15125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:20 smithi179 bash[23186]: audit 2024-09-21T05:36:19.445034+0000 mon.a (mon.0) 15126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:20 smithi049 bash[23528]: cluster 2024-09-21T05:36:19.270041+0000 mgr.a (mgr.14388) 19128 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:36:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:20 smithi049 bash[23528]: audit 2024-09-21T05:36:19.425797+0000 mon.a (mon.0) 15124 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:20 smithi049 bash[23528]: audit 2024-09-21T05:36:19.434233+0000 mon.a (mon.0) 15125 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:20 smithi049 bash[23528]: audit 2024-09-21T05:36:19.445034+0000 mon.a (mon.0) 15126 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:21.139 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:21.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:21.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:21.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:21.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:21 smithi044 bash[22676]: audit 2024-09-21T05:36:20.689776+0000 mgr.a (mgr.14388) 19129 : audit [DBG] from='client.410649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:21 smithi179 bash[23186]: audit 2024-09-21T05:36:20.689776+0000 mgr.a (mgr.14388) 19129 : audit [DBG] from='client.410649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:21 smithi049 bash[23528]: audit 2024-09-21T05:36:20.689776+0000 mgr.a (mgr.14388) 19129 : audit [DBG] from='client.410649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:22 smithi044 bash[22676]: cluster 2024-09-21T05:36:21.272929+0000 mgr.a (mgr.14388) 19130 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:22 smithi179 bash[23186]: cluster 2024-09-21T05:36:21.272929+0000 mgr.a (mgr.14388) 19130 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:22 smithi049 bash[23528]: cluster 2024-09-21T05:36:21.272929+0000 mgr.a (mgr.14388) 19130 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:24 smithi044 bash[22676]: cluster 2024-09-21T05:36:23.273735+0000 mgr.a (mgr.14388) 19131 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:24 smithi179 bash[23186]: cluster 2024-09-21T05:36:23.273735+0000 mgr.a (mgr.14388) 19131 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:24 smithi049 bash[23528]: cluster 2024-09-21T05:36:23.273735+0000 mgr.a (mgr.14388) 19131 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:26.140 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:26.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:26.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:26 smithi044 bash[22676]: cluster 2024-09-21T05:36:25.275765+0000 mgr.a (mgr.14388) 19132 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:26 smithi179 bash[23186]: cluster 2024-09-21T05:36:25.275765+0000 mgr.a (mgr.14388) 19132 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:26 smithi049 bash[23528]: cluster 2024-09-21T05:36:25.275765+0000 mgr.a (mgr.14388) 19132 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:26.884 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:27 smithi044 bash[22676]: audit 2024-09-21T05:36:26.454133+0000 mgr.a (mgr.14388) 19133 : audit [DBG] from='client.410727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:27 smithi179 bash[23186]: audit 2024-09-21T05:36:26.454133+0000 mgr.a (mgr.14388) 19133 : audit [DBG] from='client.410727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:27 smithi049 bash[23528]: audit 2024-09-21T05:36:26.454133+0000 mgr.a (mgr.14388) 19133 : audit [DBG] from='client.410727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:28 smithi044 bash[22676]: cluster 2024-09-21T05:36:27.276666+0000 mgr.a (mgr.14388) 19134 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:28.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:28 smithi179 bash[23186]: cluster 2024-09-21T05:36:27.276666+0000 mgr.a (mgr.14388) 19134 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:28 smithi049 bash[23528]: cluster 2024-09-21T05:36:27.276666+0000 mgr.a (mgr.14388) 19134 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:29 smithi179 bash[23186]: audit 2024-09-21T05:36:28.741428+0000 mon.a (mon.0) 15127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:29 smithi179 bash[23186]: audit 2024-09-21T05:36:28.750530+0000 mon.a (mon.0) 15128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:29 smithi179 bash[23186]: audit 2024-09-21T05:36:28.761877+0000 mon.a (mon.0) 15129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:29 smithi179 bash[23186]: audit 2024-09-21T05:36:28.942696+0000 mon.a (mon.0) 15130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:29 smithi179 bash[23186]: audit 2024-09-21T05:36:28.953014+0000 mon.a (mon.0) 15131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:29 smithi179 bash[23186]: audit 2024-09-21T05:36:28.965059+0000 mon.a (mon.0) 15132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:29 smithi049 bash[23528]: audit 2024-09-21T05:36:28.741428+0000 mon.a (mon.0) 15127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:29 smithi049 bash[23528]: audit 2024-09-21T05:36:28.750530+0000 mon.a (mon.0) 15128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:29 smithi049 bash[23528]: audit 2024-09-21T05:36:28.761877+0000 mon.a (mon.0) 15129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:29 smithi049 bash[23528]: audit 2024-09-21T05:36:28.942696+0000 mon.a (mon.0) 15130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:29 smithi049 bash[23528]: audit 2024-09-21T05:36:28.953014+0000 mon.a (mon.0) 15131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:29 smithi049 bash[23528]: audit 2024-09-21T05:36:28.965059+0000 mon.a (mon.0) 15132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:29 smithi044 bash[22676]: audit 2024-09-21T05:36:28.741428+0000 mon.a (mon.0) 15127 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:29 smithi044 bash[22676]: audit 2024-09-21T05:36:28.750530+0000 mon.a (mon.0) 15128 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:29 smithi044 bash[22676]: audit 2024-09-21T05:36:28.761877+0000 mon.a (mon.0) 15129 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:29 smithi044 bash[22676]: audit 2024-09-21T05:36:28.942696+0000 mon.a (mon.0) 15130 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:29 smithi044 bash[22676]: audit 2024-09-21T05:36:28.953014+0000 mon.a (mon.0) 15131 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:30.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:29 smithi044 bash[22676]: audit 2024-09-21T05:36:28.965059+0000 mon.a (mon.0) 15132 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:30 smithi044 bash[22676]: cluster 2024-09-21T05:36:29.277477+0000 mgr.a (mgr.14388) 19135 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:30 smithi179 bash[23186]: cluster 2024-09-21T05:36:29.277477+0000 mgr.a (mgr.14388) 19135 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:30 smithi049 bash[23528]: cluster 2024-09-21T05:36:29.277477+0000 mgr.a (mgr.14388) 19135 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:36:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:31.887 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:32.667 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:32.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:32.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:32.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:32.668 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:32 smithi044 bash[22676]: cluster 2024-09-21T05:36:31.279768+0000 mgr.a (mgr.14388) 19136 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:36:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:32 smithi179 bash[23186]: cluster 2024-09-21T05:36:31.279768+0000 mgr.a (mgr.14388) 19136 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:36:33.290 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:32 smithi049 bash[23528]: cluster 2024-09-21T05:36:31.279768+0000 mgr.a (mgr.14388) 19136 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:36:34.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:33 smithi044 bash[22676]: audit 2024-09-21T05:36:32.219303+0000 mgr.a (mgr.14388) 19137 : audit [DBG] from='client.410805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:34.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:33 smithi179 bash[23186]: audit 2024-09-21T05:36:32.219303+0000 mgr.a (mgr.14388) 19137 : audit [DBG] from='client.410805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:34.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:33 smithi049 bash[23528]: audit 2024-09-21T05:36:32.219303+0000 mgr.a (mgr.14388) 19137 : audit [DBG] from='client.410805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:34 smithi044 bash[22676]: cluster 2024-09-21T05:36:33.280645+0000 mgr.a (mgr.14388) 19138 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:34 smithi179 bash[23186]: cluster 2024-09-21T05:36:33.280645+0000 mgr.a (mgr.14388) 19138 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:34 smithi049 bash[23528]: cluster 2024-09-21T05:36:33.280645+0000 mgr.a (mgr.14388) 19138 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:36 smithi044 bash[22676]: cluster 2024-09-21T05:36:35.282813+0000 mgr.a (mgr.14388) 19139 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:36 smithi179 bash[23186]: cluster 2024-09-21T05:36:35.282813+0000 mgr.a (mgr.14388) 19139 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:36 smithi049 bash[23528]: cluster 2024-09-21T05:36:35.282813+0000 mgr.a (mgr.14388) 19139 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:37.669 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:38.465 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:38.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:38.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:38.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:38.465 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:38 smithi179 bash[23186]: cluster 2024-09-21T05:36:37.283575+0000 mgr.a (mgr.14388) 19140 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:38 smithi179 bash[23186]: audit 2024-09-21T05:36:38.008960+0000 mgr.a (mgr.14388) 19141 : audit [DBG] from='client.410883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:38 smithi049 bash[23528]: cluster 2024-09-21T05:36:37.283575+0000 mgr.a (mgr.14388) 19140 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:38 smithi049 bash[23528]: audit 2024-09-21T05:36:38.008960+0000 mgr.a (mgr.14388) 19141 : audit [DBG] from='client.410883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:38 smithi044 bash[22676]: cluster 2024-09-21T05:36:37.283575+0000 mgr.a (mgr.14388) 19140 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:38 smithi044 bash[22676]: audit 2024-09-21T05:36:38.008960+0000 mgr.a (mgr.14388) 19141 : audit [DBG] from='client.410883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:40 smithi044 bash[22676]: cluster 2024-09-21T05:36:39.284573+0000 mgr.a (mgr.14388) 19142 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:40 smithi044 bash[22676]: audit 2024-09-21T05:36:39.637661+0000 mon.a (mon.0) 15133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:40 smithi044 bash[22676]: audit 2024-09-21T05:36:39.646363+0000 mon.a (mon.0) 15134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:40 smithi044 bash[22676]: audit 2024-09-21T05:36:39.656770+0000 mon.a (mon.0) 15135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:40 smithi179 bash[23186]: cluster 2024-09-21T05:36:39.284573+0000 mgr.a (mgr.14388) 19142 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:40 smithi179 bash[23186]: audit 2024-09-21T05:36:39.637661+0000 mon.a (mon.0) 15133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:40 smithi179 bash[23186]: audit 2024-09-21T05:36:39.646363+0000 mon.a (mon.0) 15134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:40 smithi179 bash[23186]: audit 2024-09-21T05:36:39.656770+0000 mon.a (mon.0) 15135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:40 smithi049 bash[23528]: cluster 2024-09-21T05:36:39.284573+0000 mgr.a (mgr.14388) 19142 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:40 smithi049 bash[23528]: audit 2024-09-21T05:36:39.637661+0000 mon.a (mon.0) 15133 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:40 smithi049 bash[23528]: audit 2024-09-21T05:36:39.646363+0000 mon.a (mon.0) 15134 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:41.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:40 smithi049 bash[23528]: audit 2024-09-21T05:36:39.656770+0000 mon.a (mon.0) 15135 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:42 smithi044 bash[22676]: cluster 2024-09-21T05:36:41.286954+0000 mgr.a (mgr.14388) 19143 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:42 smithi179 bash[23186]: cluster 2024-09-21T05:36:41.286954+0000 mgr.a (mgr.14388) 19143 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:42 smithi049 bash[23528]: cluster 2024-09-21T05:36:41.286954+0000 mgr.a (mgr.14388) 19143 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:43.466 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:44.244 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:44.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:44.244 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:44.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:44.245 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:44 smithi044 bash[22676]: cluster 2024-09-21T05:36:43.287749+0000 mgr.a (mgr.14388) 19144 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:44 smithi044 bash[22676]: audit 2024-09-21T05:36:43.822476+0000 mgr.a (mgr.14388) 19145 : audit [DBG] from='client.410958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:44.993 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:44 smithi179 bash[23186]: cluster 2024-09-21T05:36:43.287749+0000 mgr.a (mgr.14388) 19144 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:44.993 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:44 smithi179 bash[23186]: audit 2024-09-21T05:36:43.822476+0000 mgr.a (mgr.14388) 19145 : audit [DBG] from='client.410958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:44 smithi049 bash[23528]: cluster 2024-09-21T05:36:43.287749+0000 mgr.a (mgr.14388) 19144 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:44 smithi049 bash[23528]: audit 2024-09-21T05:36:43.822476+0000 mgr.a (mgr.14388) 19145 : audit [DBG] from='client.410958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:46 smithi044 bash[22676]: cluster 2024-09-21T05:36:45.290154+0000 mgr.a (mgr.14388) 19146 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:46 smithi179 bash[23186]: cluster 2024-09-21T05:36:45.290154+0000 mgr.a (mgr.14388) 19146 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:46 smithi049 bash[23528]: cluster 2024-09-21T05:36:45.290154+0000 mgr.a (mgr.14388) 19146 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:48 smithi044 bash[22676]: cluster 2024-09-21T05:36:47.290961+0000 mgr.a (mgr.14388) 19147 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:48 smithi179 bash[23186]: cluster 2024-09-21T05:36:47.290961+0000 mgr.a (mgr.14388) 19147 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:48 smithi049 bash[23528]: cluster 2024-09-21T05:36:47.290961+0000 mgr.a (mgr.14388) 19147 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:50.053 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:49 smithi044 bash[22676]: audit 2024-09-21T05:36:48.978651+0000 mon.a (mon.0) 15136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:49 smithi044 bash[22676]: audit 2024-09-21T05:36:48.987349+0000 mon.a (mon.0) 15137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:49 smithi044 bash[22676]: audit 2024-09-21T05:36:48.999190+0000 mon.a (mon.0) 15138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:49 smithi044 bash[22676]: audit 2024-09-21T05:36:49.157179+0000 mon.a (mon.0) 15139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:49 smithi044 bash[22676]: audit 2024-09-21T05:36:49.166956+0000 mon.a (mon.0) 15140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:49 smithi044 bash[22676]: audit 2024-09-21T05:36:49.178672+0000 mon.a (mon.0) 15141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:49 smithi179 bash[23186]: audit 2024-09-21T05:36:48.978651+0000 mon.a (mon.0) 15136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:49 smithi179 bash[23186]: audit 2024-09-21T05:36:48.987349+0000 mon.a (mon.0) 15137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:49 smithi179 bash[23186]: audit 2024-09-21T05:36:48.999190+0000 mon.a (mon.0) 15138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:49 smithi179 bash[23186]: audit 2024-09-21T05:36:49.157179+0000 mon.a (mon.0) 15139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:49 smithi179 bash[23186]: audit 2024-09-21T05:36:49.166956+0000 mon.a (mon.0) 15140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:49 smithi179 bash[23186]: audit 2024-09-21T05:36:49.178672+0000 mon.a (mon.0) 15141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:49 smithi049 bash[23528]: audit 2024-09-21T05:36:48.978651+0000 mon.a (mon.0) 15136 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:49 smithi049 bash[23528]: audit 2024-09-21T05:36:48.987349+0000 mon.a (mon.0) 15137 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:49 smithi049 bash[23528]: audit 2024-09-21T05:36:48.999190+0000 mon.a (mon.0) 15138 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:49 smithi049 bash[23528]: audit 2024-09-21T05:36:49.157179+0000 mon.a (mon.0) 15139 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:49 smithi049 bash[23528]: audit 2024-09-21T05:36:49.166956+0000 mon.a (mon.0) 15140 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:50.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:49 smithi049 bash[23528]: audit 2024-09-21T05:36:49.178672+0000 mon.a (mon.0) 15141 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:36:51.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:51 smithi044 bash[22676]: cluster 2024-09-21T05:36:49.291723+0000 mgr.a (mgr.14388) 19148 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:51.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:51 smithi044 bash[22676]: audit 2024-09-21T05:36:49.594323+0000 mgr.a (mgr.14388) 19149 : audit [DBG] from='client.411036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:51 smithi179 bash[23186]: cluster 2024-09-21T05:36:49.291723+0000 mgr.a (mgr.14388) 19148 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:51 smithi179 bash[23186]: audit 2024-09-21T05:36:49.594323+0000 mgr.a (mgr.14388) 19149 : audit [DBG] from='client.411036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:51 smithi049 bash[23528]: cluster 2024-09-21T05:36:49.291723+0000 mgr.a (mgr.14388) 19148 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:51.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:51 smithi049 bash[23528]: audit 2024-09-21T05:36:49.594323+0000 mgr.a (mgr.14388) 19149 : audit [DBG] from='client.411036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:53 smithi044 bash[22676]: cluster 2024-09-21T05:36:51.294173+0000 mgr.a (mgr.14388) 19150 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:53 smithi179 bash[23186]: cluster 2024-09-21T05:36:51.294173+0000 mgr.a (mgr.14388) 19150 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:53 smithi049 bash[23528]: cluster 2024-09-21T05:36:51.294173+0000 mgr.a (mgr.14388) 19150 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:36:55.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:36:55.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:36:55.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:36:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:55 smithi044 bash[22676]: cluster 2024-09-21T05:36:53.294965+0000 mgr.a (mgr.14388) 19151 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:55.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:55 smithi179 bash[23186]: cluster 2024-09-21T05:36:53.294965+0000 mgr.a (mgr.14388) 19151 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:55 smithi049 bash[23528]: cluster 2024-09-21T05:36:53.294965+0000 mgr.a (mgr.14388) 19151 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:55.831 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:36:55.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:36:55.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:36:55.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:36:55.831 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:36:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:57 smithi044 bash[22676]: cluster 2024-09-21T05:36:55.296948+0000 mgr.a (mgr.14388) 19152 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:57 smithi044 bash[22676]: audit 2024-09-21T05:36:55.392470+0000 mgr.a (mgr.14388) 19153 : audit [DBG] from='client.411111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:57 smithi179 bash[23186]: cluster 2024-09-21T05:36:55.296948+0000 mgr.a (mgr.14388) 19152 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:57 smithi179 bash[23186]: audit 2024-09-21T05:36:55.392470+0000 mgr.a (mgr.14388) 19153 : audit [DBG] from='client.411111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:57 smithi049 bash[23528]: cluster 2024-09-21T05:36:55.296948+0000 mgr.a (mgr.14388) 19152 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:36:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:57 smithi049 bash[23528]: audit 2024-09-21T05:36:55.392470+0000 mgr.a (mgr.14388) 19153 : audit [DBG] from='client.411111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:36:59 smithi044 bash[22676]: cluster 2024-09-21T05:36:57.298088+0000 mgr.a (mgr.14388) 19154 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:36:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:36:59 smithi179 bash[23186]: cluster 2024-09-21T05:36:57.298088+0000 mgr.a (mgr.14388) 19154 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:36:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:36:59 smithi049 bash[23528]: cluster 2024-09-21T05:36:57.298088+0000 mgr.a (mgr.14388) 19154 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:37:00.832 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:00.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:00.833 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:00 smithi044 bash[22676]: cluster 2024-09-21T05:36:59.298919+0000 mgr.a (mgr.14388) 19155 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:00 smithi044 bash[22676]: audit 2024-09-21T05:36:59.874901+0000 mon.a (mon.0) 15142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:00 smithi044 bash[22676]: audit 2024-09-21T05:36:59.883748+0000 mon.a (mon.0) 15143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:00 smithi044 bash[22676]: audit 2024-09-21T05:36:59.894331+0000 mon.a (mon.0) 15144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:00 smithi179 bash[23186]: cluster 2024-09-21T05:36:59.298919+0000 mgr.a (mgr.14388) 19155 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:00 smithi179 bash[23186]: audit 2024-09-21T05:36:59.874901+0000 mon.a (mon.0) 15142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:00 smithi179 bash[23186]: audit 2024-09-21T05:36:59.883748+0000 mon.a (mon.0) 15143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:00 smithi179 bash[23186]: audit 2024-09-21T05:36:59.894331+0000 mon.a (mon.0) 15144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:00 smithi049 bash[23528]: cluster 2024-09-21T05:36:59.298919+0000 mgr.a (mgr.14388) 19155 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:00 smithi049 bash[23528]: audit 2024-09-21T05:36:59.874901+0000 mon.a (mon.0) 15142 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:00 smithi049 bash[23528]: audit 2024-09-21T05:36:59.883748+0000 mon.a (mon.0) 15143 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:00 smithi049 bash[23528]: audit 2024-09-21T05:36:59.894331+0000 mon.a (mon.0) 15144 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:01.626 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:01.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:01.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:01.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:01.627 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:02.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:01 smithi044 bash[22676]: audit 2024-09-21T05:37:01.167241+0000 mgr.a (mgr.14388) 19156 : audit [DBG] from='client.411186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:02.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:01 smithi179 bash[23186]: audit 2024-09-21T05:37:01.167241+0000 mgr.a (mgr.14388) 19156 : audit [DBG] from='client.411186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:01 smithi049 bash[23528]: audit 2024-09-21T05:37:01.167241+0000 mgr.a (mgr.14388) 19156 : audit [DBG] from='client.411186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:02 smithi044 bash[22676]: cluster 2024-09-21T05:37:01.300298+0000 mgr.a (mgr.14388) 19157 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:03.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:02 smithi179 bash[23186]: cluster 2024-09-21T05:37:01.300298+0000 mgr.a (mgr.14388) 19157 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:02 smithi049 bash[23528]: cluster 2024-09-21T05:37:01.300298+0000 mgr.a (mgr.14388) 19157 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:04.190 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:03 smithi044 bash[22676]: audit 2024-09-21T05:37:03.435968+0000 mon.a (mon.0) 15145 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:37:04.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:03 smithi179 bash[23186]: audit 2024-09-21T05:37:03.435968+0000 mon.a (mon.0) 15145 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:37:04.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:03 smithi049 bash[23528]: audit 2024-09-21T05:37:03.435968+0000 mon.a (mon.0) 15145 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:37:05.024 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:37:04 smithi044 bash[22930]: debug 2024-09-21T05:37:04.742+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:37:05.024 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:37:04 smithi044 bash[22930]: debug 2024-09-21T05:37:04.746+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:37:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: cluster 2024-09-21T05:37:03.301191+0000 mgr.a (mgr.14388) 19158 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.021288+0000 mon.a (mon.0) 15146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.025995+0000 mon.a (mon.0) 15147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.030687+0000 mon.a (mon.0) 15148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.035906+0000 mon.a (mon.0) 15149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.036970+0000 mon.a (mon.0) 15150 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:37:05.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.037775+0000 mon.a (mon.0) 15151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:37:05.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.043196+0000 mon.a (mon.0) 15152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.045668+0000 mon.a (mon.0) 15153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:37:05.256 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:05 smithi179 bash[23186]: audit 2024-09-21T05:37:04.046606+0000 mgr.a (mgr.14388) 19159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:37:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: cluster 2024-09-21T05:37:03.301191+0000 mgr.a (mgr.14388) 19158 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.021288+0000 mon.a (mon.0) 15146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.025995+0000 mon.a (mon.0) 15147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.030687+0000 mon.a (mon.0) 15148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.035906+0000 mon.a (mon.0) 15149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.036970+0000 mon.a (mon.0) 15150 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.037775+0000 mon.a (mon.0) 15151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.043196+0000 mon.a (mon.0) 15152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.045668+0000 mon.a (mon.0) 15153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:37:05.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:05 smithi049 bash[23528]: audit 2024-09-21T05:37:04.046606+0000 mgr.a (mgr.14388) 19159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:37:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: cluster 2024-09-21T05:37:03.301191+0000 mgr.a (mgr.14388) 19158 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.021288+0000 mon.a (mon.0) 15146 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.025995+0000 mon.a (mon.0) 15147 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.030687+0000 mon.a (mon.0) 15148 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.035906+0000 mon.a (mon.0) 15149 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.036970+0000 mon.a (mon.0) 15150 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.037775+0000 mon.a (mon.0) 15151 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.043196+0000 mon.a (mon.0) 15152 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.045668+0000 mon.a (mon.0) 15153 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:37:05.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:05 smithi044 bash[22676]: audit 2024-09-21T05:37:04.046606+0000 mgr.a (mgr.14388) 19159 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:37:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:06 smithi044 bash[22676]: audit 2024-09-21T05:37:04.748282+0000 mgr.a (mgr.14388) 19160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:37:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:06 smithi044 bash[22676]: cephadm 2024-09-21T05:37:04.749395+0000 mgr.a (mgr.14388) 19161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:37:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:06 smithi049 bash[23528]: audit 2024-09-21T05:37:04.748282+0000 mgr.a (mgr.14388) 19160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:37:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:06 smithi049 bash[23528]: cephadm 2024-09-21T05:37:04.749395+0000 mgr.a (mgr.14388) 19161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:37:06.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:06 smithi179 bash[23186]: audit 2024-09-21T05:37:04.748282+0000 mgr.a (mgr.14388) 19160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:37:06.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:06 smithi179 bash[23186]: cephadm 2024-09-21T05:37:04.749395+0000 mgr.a (mgr.14388) 19161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:37:06.628 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:06.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:06.628 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:07 smithi049 bash[23528]: cluster 2024-09-21T05:37:05.303695+0000 mgr.a (mgr.14388) 19162 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:07.355 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:07 smithi179 bash[23186]: cluster 2024-09-21T05:37:05.303695+0000 mgr.a (mgr.14388) 19162 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:07.369 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:07.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:07 smithi044 bash[22676]: cluster 2024-09-21T05:37:05.303695+0000 mgr.a (mgr.14388) 19162 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:08 smithi049 bash[23528]: audit 2024-09-21T05:37:06.947146+0000 mgr.a (mgr.14388) 19163 : audit [DBG] from='client.411369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:08 smithi044 bash[22676]: audit 2024-09-21T05:37:06.947146+0000 mgr.a (mgr.14388) 19163 : audit [DBG] from='client.411369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:08 smithi179 bash[23186]: audit 2024-09-21T05:37:06.947146+0000 mgr.a (mgr.14388) 19163 : audit [DBG] from='client.411369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:09 smithi049 bash[23528]: cluster 2024-09-21T05:37:07.304685+0000 mgr.a (mgr.14388) 19164 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:09.409 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:09 smithi179 bash[23186]: cluster 2024-09-21T05:37:07.304685+0000 mgr.a (mgr.14388) 19164 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:09 smithi044 bash[22676]: cluster 2024-09-21T05:37:07.304685+0000 mgr.a (mgr.14388) 19164 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:10 smithi044 bash[22676]: audit 2024-09-21T05:37:09.214919+0000 mon.a (mon.0) 15154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:10 smithi044 bash[22676]: audit 2024-09-21T05:37:09.223323+0000 mon.a (mon.0) 15155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:10 smithi044 bash[22676]: audit 2024-09-21T05:37:09.234224+0000 mon.a (mon.0) 15156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:10 smithi044 bash[22676]: audit 2024-09-21T05:37:09.387556+0000 mon.a (mon.0) 15157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:10 smithi044 bash[22676]: audit 2024-09-21T05:37:09.395923+0000 mon.a (mon.0) 15158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:10 smithi044 bash[22676]: audit 2024-09-21T05:37:09.405920+0000 mon.a (mon.0) 15159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:10 smithi179 bash[23186]: audit 2024-09-21T05:37:09.214919+0000 mon.a (mon.0) 15154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:10 smithi179 bash[23186]: audit 2024-09-21T05:37:09.223323+0000 mon.a (mon.0) 15155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:10 smithi179 bash[23186]: audit 2024-09-21T05:37:09.234224+0000 mon.a (mon.0) 15156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:10 smithi179 bash[23186]: audit 2024-09-21T05:37:09.387556+0000 mon.a (mon.0) 15157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:10 smithi179 bash[23186]: audit 2024-09-21T05:37:09.395923+0000 mon.a (mon.0) 15158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:10 smithi179 bash[23186]: audit 2024-09-21T05:37:09.405920+0000 mon.a (mon.0) 15159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:10 smithi049 bash[23528]: audit 2024-09-21T05:37:09.214919+0000 mon.a (mon.0) 15154 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:10 smithi049 bash[23528]: audit 2024-09-21T05:37:09.223323+0000 mon.a (mon.0) 15155 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:10 smithi049 bash[23528]: audit 2024-09-21T05:37:09.234224+0000 mon.a (mon.0) 15156 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:10 smithi049 bash[23528]: audit 2024-09-21T05:37:09.387556+0000 mon.a (mon.0) 15157 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:10 smithi049 bash[23528]: audit 2024-09-21T05:37:09.395923+0000 mon.a (mon.0) 15158 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:10.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:10 smithi049 bash[23528]: audit 2024-09-21T05:37:09.405920+0000 mon.a (mon.0) 15159 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:11 smithi044 bash[22676]: cluster 2024-09-21T05:37:09.305535+0000 mgr.a (mgr.14388) 19165 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:11 smithi179 bash[23186]: cluster 2024-09-21T05:37:09.305535+0000 mgr.a (mgr.14388) 19165 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:11 smithi049 bash[23528]: cluster 2024-09-21T05:37:09.305535+0000 mgr.a (mgr.14388) 19165 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:12.371 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:12.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:12.371 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:13.128 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:13.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:13 smithi044 bash[22676]: cluster 2024-09-21T05:37:11.307787+0000 mgr.a (mgr.14388) 19166 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:13 smithi179 bash[23186]: cluster 2024-09-21T05:37:11.307787+0000 mgr.a (mgr.14388) 19166 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:13 smithi049 bash[23528]: cluster 2024-09-21T05:37:11.307787+0000 mgr.a (mgr.14388) 19166 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:14 smithi044 bash[22676]: audit 2024-09-21T05:37:12.706700+0000 mgr.a (mgr.14388) 19167 : audit [DBG] from='client.411447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:14.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:14 smithi179 bash[23186]: audit 2024-09-21T05:37:12.706700+0000 mgr.a (mgr.14388) 19167 : audit [DBG] from='client.411447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:14 smithi049 bash[23528]: audit 2024-09-21T05:37:12.706700+0000 mgr.a (mgr.14388) 19167 : audit [DBG] from='client.411447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:15 smithi044 bash[22676]: cluster 2024-09-21T05:37:13.308751+0000 mgr.a (mgr.14388) 19168 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:15.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:15 smithi179 bash[23186]: cluster 2024-09-21T05:37:13.308751+0000 mgr.a (mgr.14388) 19168 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:15 smithi049 bash[23528]: cluster 2024-09-21T05:37:13.308751+0000 mgr.a (mgr.14388) 19168 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:16.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:16 smithi179 bash[23186]: cluster 2024-09-21T05:37:15.311110+0000 mgr.a (mgr.14388) 19169 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:16.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:16 smithi049 bash[23528]: cluster 2024-09-21T05:37:15.311110+0000 mgr.a (mgr.14388) 19169 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:16 smithi044 bash[22676]: cluster 2024-09-21T05:37:15.311110+0000 mgr.a (mgr.14388) 19169 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:37:18.130 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:18.131 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:18 smithi044 bash[22676]: cluster 2024-09-21T05:37:17.311945+0000 mgr.a (mgr.14388) 19170 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:18 smithi179 bash[23186]: cluster 2024-09-21T05:37:17.311945+0000 mgr.a (mgr.14388) 19170 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:18.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:18 smithi049 bash[23528]: cluster 2024-09-21T05:37:17.311945+0000 mgr.a (mgr.14388) 19170 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:18.916 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:18.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:18.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:18.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:18.916 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:19 smithi044 bash[22676]: audit 2024-09-21T05:37:18.467843+0000 mgr.a (mgr.14388) 19171 : audit [DBG] from='client.411525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:19 smithi179 bash[23186]: audit 2024-09-21T05:37:18.467843+0000 mgr.a (mgr.14388) 19171 : audit [DBG] from='client.411525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:19 smithi049 bash[23528]: audit 2024-09-21T05:37:18.467843+0000 mgr.a (mgr.14388) 19171 : audit [DBG] from='client.411525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:21 smithi044 bash[22676]: cluster 2024-09-21T05:37:19.312941+0000 mgr.a (mgr.14388) 19172 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:21 smithi044 bash[22676]: audit 2024-09-21T05:37:20.082064+0000 mon.a (mon.0) 15160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:21 smithi044 bash[22676]: audit 2024-09-21T05:37:20.090842+0000 mon.a (mon.0) 15161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:21 smithi044 bash[22676]: audit 2024-09-21T05:37:20.101481+0000 mon.a (mon.0) 15162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:21 smithi179 bash[23186]: cluster 2024-09-21T05:37:19.312941+0000 mgr.a (mgr.14388) 19172 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:21 smithi179 bash[23186]: audit 2024-09-21T05:37:20.082064+0000 mon.a (mon.0) 15160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:21 smithi179 bash[23186]: audit 2024-09-21T05:37:20.090842+0000 mon.a (mon.0) 15161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:21 smithi179 bash[23186]: audit 2024-09-21T05:37:20.101481+0000 mon.a (mon.0) 15162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:21 smithi049 bash[23528]: cluster 2024-09-21T05:37:19.312941+0000 mgr.a (mgr.14388) 19172 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:21 smithi049 bash[23528]: audit 2024-09-21T05:37:20.082064+0000 mon.a (mon.0) 15160 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:21 smithi049 bash[23528]: audit 2024-09-21T05:37:20.090842+0000 mon.a (mon.0) 15161 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:21 smithi049 bash[23528]: audit 2024-09-21T05:37:20.101481+0000 mon.a (mon.0) 15162 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:23.443 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:23 smithi044 bash[22676]: cluster 2024-09-21T05:37:21.315362+0000 mgr.a (mgr.14388) 19173 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:23.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:23 smithi179 bash[23186]: cluster 2024-09-21T05:37:21.315362+0000 mgr.a (mgr.14388) 19173 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:23 smithi049 bash[23528]: cluster 2024-09-21T05:37:21.315362+0000 mgr.a (mgr.14388) 19173 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:24.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:24.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:24.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:24.717 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:24.718 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:25.218 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:25 smithi179 bash[23186]: cluster 2024-09-21T05:37:23.316294+0000 mgr.a (mgr.14388) 19174 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:25.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:25 smithi044 bash[22676]: cluster 2024-09-21T05:37:23.316294+0000 mgr.a (mgr.14388) 19174 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:25 smithi049 bash[23528]: cluster 2024-09-21T05:37:23.316294+0000 mgr.a (mgr.14388) 19174 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:26.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:26 smithi179 bash[23186]: audit 2024-09-21T05:37:24.257380+0000 mgr.a (mgr.14388) 19175 : audit [DBG] from='client.411603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:26.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:26 smithi044 bash[22676]: audit 2024-09-21T05:37:24.257380+0000 mgr.a (mgr.14388) 19175 : audit [DBG] from='client.411603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:26.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:26 smithi049 bash[23528]: audit 2024-09-21T05:37:24.257380+0000 mgr.a (mgr.14388) 19175 : audit [DBG] from='client.411603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:27.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:27 smithi044 bash[22676]: cluster 2024-09-21T05:37:25.318816+0000 mgr.a (mgr.14388) 19176 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:27.435 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:27 smithi179 bash[23186]: cluster 2024-09-21T05:37:25.318816+0000 mgr.a (mgr.14388) 19176 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:27.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:27 smithi049 bash[23528]: cluster 2024-09-21T05:37:25.318816+0000 mgr.a (mgr.14388) 19176 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:29.467 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:29 smithi044 bash[22676]: cluster 2024-09-21T05:37:27.319645+0000 mgr.a (mgr.14388) 19177 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:29.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:29 smithi179 bash[23186]: cluster 2024-09-21T05:37:27.319645+0000 mgr.a (mgr.14388) 19177 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:29 smithi049 bash[23528]: cluster 2024-09-21T05:37:27.319645+0000 mgr.a (mgr.14388) 19177 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:29.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:29.720 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:30.510 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: cluster 2024-09-21T05:37:29.320429+0000 mgr.a (mgr.14388) 19178 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: audit 2024-09-21T05:37:29.447158+0000 mon.a (mon.0) 15163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: audit 2024-09-21T05:37:29.453166+0000 mon.a (mon.0) 15164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: audit 2024-09-21T05:37:29.463027+0000 mon.a (mon.0) 15165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: audit 2024-09-21T05:37:29.623074+0000 mon.a (mon.0) 15166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: audit 2024-09-21T05:37:29.632588+0000 mon.a (mon.0) 15167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: audit 2024-09-21T05:37:29.644271+0000 mon.a (mon.0) 15168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:30 smithi044 bash[22676]: audit 2024-09-21T05:37:30.049358+0000 mgr.a (mgr.14388) 19179 : audit [DBG] from='client.411681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: cluster 2024-09-21T05:37:29.320429+0000 mgr.a (mgr.14388) 19178 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: audit 2024-09-21T05:37:29.447158+0000 mon.a (mon.0) 15163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: audit 2024-09-21T05:37:29.453166+0000 mon.a (mon.0) 15164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: audit 2024-09-21T05:37:29.463027+0000 mon.a (mon.0) 15165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: audit 2024-09-21T05:37:29.623074+0000 mon.a (mon.0) 15166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: audit 2024-09-21T05:37:29.632588+0000 mon.a (mon.0) 15167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: audit 2024-09-21T05:37:29.644271+0000 mon.a (mon.0) 15168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:30 smithi179 bash[23186]: audit 2024-09-21T05:37:30.049358+0000 mgr.a (mgr.14388) 19179 : audit [DBG] from='client.411681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: cluster 2024-09-21T05:37:29.320429+0000 mgr.a (mgr.14388) 19178 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: audit 2024-09-21T05:37:29.447158+0000 mon.a (mon.0) 15163 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: audit 2024-09-21T05:37:29.453166+0000 mon.a (mon.0) 15164 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: audit 2024-09-21T05:37:29.463027+0000 mon.a (mon.0) 15165 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: audit 2024-09-21T05:37:29.623074+0000 mon.a (mon.0) 15166 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: audit 2024-09-21T05:37:29.632588+0000 mon.a (mon.0) 15167 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: audit 2024-09-21T05:37:29.644271+0000 mon.a (mon.0) 15168 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:30 smithi049 bash[23528]: audit 2024-09-21T05:37:30.049358+0000 mgr.a (mgr.14388) 19179 : audit [DBG] from='client.411681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:32 smithi044 bash[22676]: cluster 2024-09-21T05:37:31.323499+0000 mgr.a (mgr.14388) 19180 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:32 smithi179 bash[23186]: cluster 2024-09-21T05:37:31.323499+0000 mgr.a (mgr.14388) 19180 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:32 smithi049 bash[23528]: cluster 2024-09-21T05:37:31.323499+0000 mgr.a (mgr.14388) 19180 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:34 smithi044 bash[22676]: cluster 2024-09-21T05:37:33.324297+0000 mgr.a (mgr.14388) 19181 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:37:34.751 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:34 smithi049 bash[23528]: cluster 2024-09-21T05:37:33.324297+0000 mgr.a (mgr.14388) 19181 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:37:34.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:34 smithi179 bash[23186]: cluster 2024-09-21T05:37:33.324297+0000 mgr.a (mgr.14388) 19181 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:37:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:36.264 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:36.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:36.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:36.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:36.264 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:36 smithi044 bash[22676]: cluster 2024-09-21T05:37:35.326264+0000 mgr.a (mgr.14388) 19182 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:36 smithi044 bash[22676]: audit 2024-09-21T05:37:35.844025+0000 mgr.a (mgr.14388) 19183 : audit [DBG] from='client.411756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:36 smithi179 bash[23186]: cluster 2024-09-21T05:37:35.326264+0000 mgr.a (mgr.14388) 19182 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:36 smithi179 bash[23186]: audit 2024-09-21T05:37:35.844025+0000 mgr.a (mgr.14388) 19183 : audit [DBG] from='client.411756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:36 smithi049 bash[23528]: cluster 2024-09-21T05:37:35.326264+0000 mgr.a (mgr.14388) 19182 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:36 smithi049 bash[23528]: audit 2024-09-21T05:37:35.844025+0000 mgr.a (mgr.14388) 19183 : audit [DBG] from='client.411756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:38.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:38 smithi049 bash[23528]: cluster 2024-09-21T05:37:37.327289+0000 mgr.a (mgr.14388) 19184 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:37:38.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:38 smithi044 bash[22676]: cluster 2024-09-21T05:37:37.327289+0000 mgr.a (mgr.14388) 19184 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:37:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:38 smithi179 bash[23186]: cluster 2024-09-21T05:37:37.327289+0000 mgr.a (mgr.14388) 19184 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:37:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:40 smithi044 bash[22676]: cluster 2024-09-21T05:37:39.328107+0000 mgr.a (mgr.14388) 19185 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:40 smithi044 bash[22676]: audit 2024-09-21T05:37:40.313986+0000 mon.a (mon.0) 15169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:40 smithi044 bash[22676]: audit 2024-09-21T05:37:40.322668+0000 mon.a (mon.0) 15170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:40 smithi044 bash[22676]: audit 2024-09-21T05:37:40.333071+0000 mon.a (mon.0) 15171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:40 smithi179 bash[23186]: cluster 2024-09-21T05:37:39.328107+0000 mgr.a (mgr.14388) 19185 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:40 smithi179 bash[23186]: audit 2024-09-21T05:37:40.313986+0000 mon.a (mon.0) 15169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:40 smithi179 bash[23186]: audit 2024-09-21T05:37:40.322668+0000 mon.a (mon.0) 15170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:40 smithi179 bash[23186]: audit 2024-09-21T05:37:40.333071+0000 mon.a (mon.0) 15171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:40 smithi049 bash[23528]: cluster 2024-09-21T05:37:39.328107+0000 mgr.a (mgr.14388) 19185 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:40 smithi049 bash[23528]: audit 2024-09-21T05:37:40.313986+0000 mon.a (mon.0) 15169 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:40 smithi049 bash[23528]: audit 2024-09-21T05:37:40.322668+0000 mon.a (mon.0) 15170 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:40 smithi049 bash[23528]: audit 2024-09-21T05:37:40.333071+0000 mon.a (mon.0) 15171 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:41.265 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:41.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:41.266 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:42.036 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:42.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:42.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:42.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:42.036 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:42.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:42 smithi044 bash[22676]: cluster 2024-09-21T05:37:41.330357+0000 mgr.a (mgr.14388) 19186 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:42.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:42 smithi044 bash[22676]: audit 2024-09-21T05:37:41.600371+0000 mgr.a (mgr.14388) 19187 : audit [DBG] from='client.411831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:42 smithi179 bash[23186]: cluster 2024-09-21T05:37:41.330357+0000 mgr.a (mgr.14388) 19186 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:42.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:42 smithi179 bash[23186]: audit 2024-09-21T05:37:41.600371+0000 mgr.a (mgr.14388) 19187 : audit [DBG] from='client.411831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:42 smithi049 bash[23528]: cluster 2024-09-21T05:37:41.330357+0000 mgr.a (mgr.14388) 19186 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:42.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:42 smithi049 bash[23528]: audit 2024-09-21T05:37:41.600371+0000 mgr.a (mgr.14388) 19187 : audit [DBG] from='client.411831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:44.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:44 smithi179 bash[23186]: cluster 2024-09-21T05:37:43.331295+0000 mgr.a (mgr.14388) 19188 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:44.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:44 smithi044 bash[22676]: cluster 2024-09-21T05:37:43.331295+0000 mgr.a (mgr.14388) 19188 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:44 smithi049 bash[23528]: cluster 2024-09-21T05:37:43.331295+0000 mgr.a (mgr.14388) 19188 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:46.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:46 smithi044 bash[22676]: cluster 2024-09-21T05:37:45.333548+0000 mgr.a (mgr.14388) 19189 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:46 smithi179 bash[23186]: cluster 2024-09-21T05:37:45.333548+0000 mgr.a (mgr.14388) 19189 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:46 smithi049 bash[23528]: cluster 2024-09-21T05:37:45.333548+0000 mgr.a (mgr.14388) 19189 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:47.037 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:47.038 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:47.794 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:48 smithi044 bash[22676]: cluster 2024-09-21T05:37:47.333976+0000 mgr.a (mgr.14388) 19190 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:48 smithi044 bash[22676]: audit 2024-09-21T05:37:47.375632+0000 mgr.a (mgr.14388) 19191 : audit [DBG] from='client.411906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:48.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:48 smithi179 bash[23186]: cluster 2024-09-21T05:37:47.333976+0000 mgr.a (mgr.14388) 19190 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:48.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:48 smithi179 bash[23186]: audit 2024-09-21T05:37:47.375632+0000 mgr.a (mgr.14388) 19191 : audit [DBG] from='client.411906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:48 smithi049 bash[23528]: cluster 2024-09-21T05:37:47.333976+0000 mgr.a (mgr.14388) 19190 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:48.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:48 smithi049 bash[23528]: audit 2024-09-21T05:37:47.375632+0000 mgr.a (mgr.14388) 19191 : audit [DBG] from='client.411906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:50 smithi044 bash[22676]: cluster 2024-09-21T05:37:49.334853+0000 mgr.a (mgr.14388) 19192 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:50 smithi044 bash[22676]: audit 2024-09-21T05:37:49.672221+0000 mon.a (mon.0) 15172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:50 smithi044 bash[22676]: audit 2024-09-21T05:37:49.682212+0000 mon.a (mon.0) 15173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:50 smithi044 bash[22676]: audit 2024-09-21T05:37:49.694606+0000 mon.a (mon.0) 15174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:50 smithi044 bash[22676]: audit 2024-09-21T05:37:49.851803+0000 mon.a (mon.0) 15175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:50 smithi044 bash[22676]: audit 2024-09-21T05:37:49.862229+0000 mon.a (mon.0) 15176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:50 smithi044 bash[22676]: audit 2024-09-21T05:37:49.874155+0000 mon.a (mon.0) 15177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:50 smithi179 bash[23186]: cluster 2024-09-21T05:37:49.334853+0000 mgr.a (mgr.14388) 19192 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:50 smithi179 bash[23186]: audit 2024-09-21T05:37:49.672221+0000 mon.a (mon.0) 15172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:50 smithi179 bash[23186]: audit 2024-09-21T05:37:49.682212+0000 mon.a (mon.0) 15173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:50 smithi179 bash[23186]: audit 2024-09-21T05:37:49.694606+0000 mon.a (mon.0) 15174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:50 smithi179 bash[23186]: audit 2024-09-21T05:37:49.851803+0000 mon.a (mon.0) 15175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:50 smithi179 bash[23186]: audit 2024-09-21T05:37:49.862229+0000 mon.a (mon.0) 15176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:50 smithi179 bash[23186]: audit 2024-09-21T05:37:49.874155+0000 mon.a (mon.0) 15177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:50 smithi049 bash[23528]: cluster 2024-09-21T05:37:49.334853+0000 mgr.a (mgr.14388) 19192 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:50 smithi049 bash[23528]: audit 2024-09-21T05:37:49.672221+0000 mon.a (mon.0) 15172 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:50 smithi049 bash[23528]: audit 2024-09-21T05:37:49.682212+0000 mon.a (mon.0) 15173 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:50 smithi049 bash[23528]: audit 2024-09-21T05:37:49.694606+0000 mon.a (mon.0) 15174 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:50 smithi049 bash[23528]: audit 2024-09-21T05:37:49.851803+0000 mon.a (mon.0) 15175 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:50 smithi049 bash[23528]: audit 2024-09-21T05:37:49.862229+0000 mon.a (mon.0) 15176 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:51.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:50 smithi049 bash[23528]: audit 2024-09-21T05:37:49.874155+0000 mon.a (mon.0) 15177 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:37:52.795 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:52.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:52.796 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:52.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:52 smithi044 bash[22676]: cluster 2024-09-21T05:37:51.337315+0000 mgr.a (mgr.14388) 19193 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:53.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:52 smithi179 bash[23186]: cluster 2024-09-21T05:37:51.337315+0000 mgr.a (mgr.14388) 19193 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:52 smithi049 bash[23528]: cluster 2024-09-21T05:37:51.337315+0000 mgr.a (mgr.14388) 19193 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:53.578 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:53.578 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:53.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:53 smithi044 bash[22676]: audit 2024-09-21T05:37:53.128662+0000 mgr.a (mgr.14388) 19194 : audit [DBG] from='client.411981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:53 smithi179 bash[23186]: audit 2024-09-21T05:37:53.128662+0000 mgr.a (mgr.14388) 19194 : audit [DBG] from='client.411981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:53 smithi049 bash[23528]: audit 2024-09-21T05:37:53.128662+0000 mgr.a (mgr.14388) 19194 : audit [DBG] from='client.411981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:54 smithi044 bash[22676]: cluster 2024-09-21T05:37:53.337882+0000 mgr.a (mgr.14388) 19195 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:55.003 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:54 smithi049 bash[23528]: cluster 2024-09-21T05:37:53.337882+0000 mgr.a (mgr.14388) 19195 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:55.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:54 smithi179 bash[23186]: cluster 2024-09-21T05:37:53.337882+0000 mgr.a (mgr.14388) 19195 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:56 smithi044 bash[22676]: cluster 2024-09-21T05:37:55.340126+0000 mgr.a (mgr.14388) 19196 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:56 smithi179 bash[23186]: cluster 2024-09-21T05:37:55.340126+0000 mgr.a (mgr.14388) 19196 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:56 smithi049 bash[23528]: cluster 2024-09-21T05:37:55.340126+0000 mgr.a (mgr.14388) 19196 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:37:58.579 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:37:58.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:37:58.580 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:37:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:58 smithi044 bash[22676]: cluster 2024-09-21T05:37:57.340905+0000 mgr.a (mgr.14388) 19197 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:58 smithi179 bash[23186]: cluster 2024-09-21T05:37:57.340905+0000 mgr.a (mgr.14388) 19197 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:58 smithi049 bash[23528]: cluster 2024-09-21T05:37:57.340905+0000 mgr.a (mgr.14388) 19197 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:37:59.330 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:37:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:37:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:37:59.331 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:37:59.331 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:37:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:37:59 smithi044 bash[22676]: audit 2024-09-21T05:37:58.905579+0000 mgr.a (mgr.14388) 19198 : audit [DBG] from='client.140933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:00.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:37:59 smithi179 bash[23186]: audit 2024-09-21T05:37:58.905579+0000 mgr.a (mgr.14388) 19198 : audit [DBG] from='client.140933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:37:59 smithi049 bash[23528]: audit 2024-09-21T05:37:58.905579+0000 mgr.a (mgr.14388) 19198 : audit [DBG] from='client.140933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:00 smithi044 bash[22676]: cluster 2024-09-21T05:37:59.341737+0000 mgr.a (mgr.14388) 19199 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:00 smithi044 bash[22676]: audit 2024-09-21T05:38:00.553615+0000 mon.a (mon.0) 15178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:00 smithi044 bash[22676]: audit 2024-09-21T05:38:00.562361+0000 mon.a (mon.0) 15179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:00.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:00 smithi044 bash[22676]: audit 2024-09-21T05:38:00.573315+0000 mon.a (mon.0) 15180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:00 smithi179 bash[23186]: cluster 2024-09-21T05:37:59.341737+0000 mgr.a (mgr.14388) 19199 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:00 smithi179 bash[23186]: audit 2024-09-21T05:38:00.553615+0000 mon.a (mon.0) 15178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:00 smithi179 bash[23186]: audit 2024-09-21T05:38:00.562361+0000 mon.a (mon.0) 15179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:00 smithi179 bash[23186]: audit 2024-09-21T05:38:00.573315+0000 mon.a (mon.0) 15180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:00 smithi049 bash[23528]: cluster 2024-09-21T05:37:59.341737+0000 mgr.a (mgr.14388) 19199 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:01.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:00 smithi049 bash[23528]: audit 2024-09-21T05:38:00.553615+0000 mon.a (mon.0) 15178 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:01.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:00 smithi049 bash[23528]: audit 2024-09-21T05:38:00.562361+0000 mon.a (mon.0) 15179 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:01.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:00 smithi049 bash[23528]: audit 2024-09-21T05:38:00.573315+0000 mon.a (mon.0) 15180 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:02.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:02 smithi044 bash[22676]: cluster 2024-09-21T05:38:01.343968+0000 mgr.a (mgr.14388) 19200 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:02 smithi179 bash[23186]: cluster 2024-09-21T05:38:01.343968+0000 mgr.a (mgr.14388) 19200 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:02 smithi049 bash[23528]: cluster 2024-09-21T05:38:01.343968+0000 mgr.a (mgr.14388) 19200 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:04.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:04.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:04.333 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:04.967 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:04 smithi044 bash[22676]: cluster 2024-09-21T05:38:03.344740+0000 mgr.a (mgr.14388) 19201 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:05.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:04 smithi179 bash[23186]: cluster 2024-09-21T05:38:03.344740+0000 mgr.a (mgr.14388) 19201 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:04 smithi049 bash[23528]: cluster 2024-09-21T05:38:03.344740+0000 mgr.a (mgr.14388) 19201 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:05.090 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:04.661565+0000 mgr.a (mgr.14388) 19202 : audit [DBG] from='client.412131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:04.801916+0000 mon.a (mon.0) 15181 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:05.347863+0000 mon.a (mon.0) 15182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:05.357009+0000 mon.a (mon.0) 15183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:05.359885+0000 mon.a (mon.0) 15184 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:05.361897+0000 mon.a (mon.0) 15185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:05.372541+0000 mon.a (mon.0) 15186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:05.905 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:05 smithi179 bash[23186]: audit 2024-09-21T05:38:05.379677+0000 mon.a (mon.0) 15187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:38:05.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:04.661565+0000 mgr.a (mgr.14388) 19202 : audit [DBG] from='client.412131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:04.801916+0000 mon.a (mon.0) 15181 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:38:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:05.347863+0000 mon.a (mon.0) 15182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:05.357009+0000 mon.a (mon.0) 15183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:05.359885+0000 mon.a (mon.0) 15184 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:38:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:05.361897+0000 mon.a (mon.0) 15185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:38:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:05.372541+0000 mon.a (mon.0) 15186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:05.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:05 smithi044 bash[22676]: audit 2024-09-21T05:38:05.379677+0000 mon.a (mon.0) 15187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:38:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:04.661565+0000 mgr.a (mgr.14388) 19202 : audit [DBG] from='client.412131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:04.801916+0000 mon.a (mon.0) 15181 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:38:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:05.347863+0000 mon.a (mon.0) 15182 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:05.357009+0000 mon.a (mon.0) 15183 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:05.359885+0000 mon.a (mon.0) 15184 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:38:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:05.361897+0000 mon.a (mon.0) 15185 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:38:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:05.372541+0000 mon.a (mon.0) 15186 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:06.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:05 smithi049 bash[23528]: audit 2024-09-21T05:38:05.379677+0000 mon.a (mon.0) 15187 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:38:06.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:38:06 smithi044 bash[22930]: debug 2024-09-21T05:38:06.153+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:38:06.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:38:06 smithi044 bash[22930]: debug 2024-09-21T05:38:06.157+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:38:06.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:06 smithi044 bash[22676]: cluster 2024-09-21T05:38:05.347142+0000 mgr.a (mgr.14388) 19203 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:06.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:06 smithi044 bash[22676]: audit 2024-09-21T05:38:05.382389+0000 mgr.a (mgr.14388) 19204 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:38:06.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:06 smithi044 bash[22676]: audit 2024-09-21T05:38:06.160453+0000 mgr.a (mgr.14388) 19205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:38:06.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:06 smithi044 bash[22676]: cephadm 2024-09-21T05:38:06.161957+0000 mgr.a (mgr.14388) 19206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:38:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:06 smithi179 bash[23186]: cluster 2024-09-21T05:38:05.347142+0000 mgr.a (mgr.14388) 19203 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:06 smithi179 bash[23186]: audit 2024-09-21T05:38:05.382389+0000 mgr.a (mgr.14388) 19204 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:38:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:06 smithi179 bash[23186]: audit 2024-09-21T05:38:06.160453+0000 mgr.a (mgr.14388) 19205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:38:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:06 smithi179 bash[23186]: cephadm 2024-09-21T05:38:06.161957+0000 mgr.a (mgr.14388) 19206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:38:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:06 smithi049 bash[23528]: cluster 2024-09-21T05:38:05.347142+0000 mgr.a (mgr.14388) 19203 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:06 smithi049 bash[23528]: audit 2024-09-21T05:38:05.382389+0000 mgr.a (mgr.14388) 19204 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:38:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:06 smithi049 bash[23528]: audit 2024-09-21T05:38:06.160453+0000 mgr.a (mgr.14388) 19205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:38:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:06 smithi049 bash[23528]: cephadm 2024-09-21T05:38:06.161957+0000 mgr.a (mgr.14388) 19206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:38:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:08 smithi044 bash[22676]: cluster 2024-09-21T05:38:07.347891+0000 mgr.a (mgr.14388) 19207 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:38:09.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:08 smithi179 bash[23186]: cluster 2024-09-21T05:38:07.347891+0000 mgr.a (mgr.14388) 19207 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:38:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:08 smithi049 bash[23528]: cluster 2024-09-21T05:38:07.347891+0000 mgr.a (mgr.14388) 19207 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:38:10.092 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:10.092 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:10.093 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:10.874 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:10 smithi044 bash[22676]: cluster 2024-09-21T05:38:09.348673+0000 mgr.a (mgr.14388) 19208 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:38:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:10 smithi044 bash[22676]: audit 2024-09-21T05:38:09.916119+0000 mon.a (mon.0) 15188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:10 smithi044 bash[22676]: audit 2024-09-21T05:38:09.925827+0000 mon.a (mon.0) 15189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:10 smithi044 bash[22676]: audit 2024-09-21T05:38:09.937420+0000 mon.a (mon.0) 15190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:10 smithi044 bash[22676]: audit 2024-09-21T05:38:10.063268+0000 mon.a (mon.0) 15191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:10 smithi044 bash[22676]: audit 2024-09-21T05:38:10.073080+0000 mon.a (mon.0) 15192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:10 smithi044 bash[22676]: audit 2024-09-21T05:38:10.083373+0000 mon.a (mon.0) 15193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:10 smithi179 bash[23186]: cluster 2024-09-21T05:38:09.348673+0000 mgr.a (mgr.14388) 19208 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:38:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:10 smithi179 bash[23186]: audit 2024-09-21T05:38:09.916119+0000 mon.a (mon.0) 15188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:10 smithi179 bash[23186]: audit 2024-09-21T05:38:09.925827+0000 mon.a (mon.0) 15189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:10 smithi179 bash[23186]: audit 2024-09-21T05:38:09.937420+0000 mon.a (mon.0) 15190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:10 smithi179 bash[23186]: audit 2024-09-21T05:38:10.063268+0000 mon.a (mon.0) 15191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:10 smithi179 bash[23186]: audit 2024-09-21T05:38:10.073080+0000 mon.a (mon.0) 15192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:10 smithi179 bash[23186]: audit 2024-09-21T05:38:10.083373+0000 mon.a (mon.0) 15193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:10 smithi049 bash[23528]: cluster 2024-09-21T05:38:09.348673+0000 mgr.a (mgr.14388) 19208 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:38:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:10 smithi049 bash[23528]: audit 2024-09-21T05:38:09.916119+0000 mon.a (mon.0) 15188 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:10 smithi049 bash[23528]: audit 2024-09-21T05:38:09.925827+0000 mon.a (mon.0) 15189 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:10 smithi049 bash[23528]: audit 2024-09-21T05:38:09.937420+0000 mon.a (mon.0) 15190 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:10 smithi049 bash[23528]: audit 2024-09-21T05:38:10.063268+0000 mon.a (mon.0) 15191 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:10 smithi049 bash[23528]: audit 2024-09-21T05:38:10.073080+0000 mon.a (mon.0) 15192 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:11.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:10 smithi049 bash[23528]: audit 2024-09-21T05:38:10.083373+0000 mon.a (mon.0) 15193 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:12.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:11 smithi044 bash[22676]: audit 2024-09-21T05:38:10.425054+0000 mgr.a (mgr.14388) 19209 : audit [DBG] from='client.412311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:12.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:11 smithi179 bash[23186]: audit 2024-09-21T05:38:10.425054+0000 mgr.a (mgr.14388) 19209 : audit [DBG] from='client.412311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:11 smithi049 bash[23528]: audit 2024-09-21T05:38:10.425054+0000 mgr.a (mgr.14388) 19209 : audit [DBG] from='client.412311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:12 smithi044 bash[22676]: cluster 2024-09-21T05:38:11.351777+0000 mgr.a (mgr.14388) 19210 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:12 smithi179 bash[23186]: cluster 2024-09-21T05:38:11.351777+0000 mgr.a (mgr.14388) 19210 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:13.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:12 smithi049 bash[23528]: cluster 2024-09-21T05:38:11.351777+0000 mgr.a (mgr.14388) 19210 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:14 smithi044 bash[22676]: cluster 2024-09-21T05:38:13.352726+0000 mgr.a (mgr.14388) 19211 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:14 smithi179 bash[23186]: cluster 2024-09-21T05:38:13.352726+0000 mgr.a (mgr.14388) 19211 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:14 smithi049 bash[23528]: cluster 2024-09-21T05:38:13.352726+0000 mgr.a (mgr.14388) 19211 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:15.875 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:15.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:15.877 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:16.629 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:16.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:16 smithi044 bash[22676]: cluster 2024-09-21T05:38:15.354686+0000 mgr.a (mgr.14388) 19212 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:16 smithi044 bash[22676]: audit 2024-09-21T05:38:16.203357+0000 mgr.a (mgr.14388) 19213 : audit [DBG] from='client.412389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:16 smithi179 bash[23186]: cluster 2024-09-21T05:38:15.354686+0000 mgr.a (mgr.14388) 19212 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:17.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:16 smithi179 bash[23186]: audit 2024-09-21T05:38:16.203357+0000 mgr.a (mgr.14388) 19213 : audit [DBG] from='client.412389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:16 smithi049 bash[23528]: cluster 2024-09-21T05:38:15.354686+0000 mgr.a (mgr.14388) 19212 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:16 smithi049 bash[23528]: audit 2024-09-21T05:38:16.203357+0000 mgr.a (mgr.14388) 19213 : audit [DBG] from='client.412389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:18 smithi044 bash[22676]: cluster 2024-09-21T05:38:17.355654+0000 mgr.a (mgr.14388) 19214 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:18 smithi179 bash[23186]: cluster 2024-09-21T05:38:17.355654+0000 mgr.a (mgr.14388) 19214 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:19.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:18 smithi049 bash[23528]: cluster 2024-09-21T05:38:17.355654+0000 mgr.a (mgr.14388) 19214 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:20 smithi044 bash[22676]: cluster 2024-09-21T05:38:19.356450+0000 mgr.a (mgr.14388) 19215 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:20 smithi044 bash[22676]: audit 2024-09-21T05:38:20.790057+0000 mon.a (mon.0) 15194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:20 smithi044 bash[22676]: audit 2024-09-21T05:38:20.798613+0000 mon.a (mon.0) 15195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:20 smithi044 bash[22676]: audit 2024-09-21T05:38:20.809423+0000 mon.a (mon.0) 15196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:20 smithi179 bash[23186]: cluster 2024-09-21T05:38:19.356450+0000 mgr.a (mgr.14388) 19215 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:20 smithi179 bash[23186]: audit 2024-09-21T05:38:20.790057+0000 mon.a (mon.0) 15194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:20 smithi179 bash[23186]: audit 2024-09-21T05:38:20.798613+0000 mon.a (mon.0) 15195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:20 smithi179 bash[23186]: audit 2024-09-21T05:38:20.809423+0000 mon.a (mon.0) 15196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:20 smithi049 bash[23528]: cluster 2024-09-21T05:38:19.356450+0000 mgr.a (mgr.14388) 19215 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:38:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:20 smithi049 bash[23528]: audit 2024-09-21T05:38:20.790057+0000 mon.a (mon.0) 15194 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:20 smithi049 bash[23528]: audit 2024-09-21T05:38:20.798613+0000 mon.a (mon.0) 15195 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:20 smithi049 bash[23528]: audit 2024-09-21T05:38:20.809423+0000 mon.a (mon.0) 15196 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:21.630 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:22.427 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:22.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:22.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:22.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:22.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:22 smithi044 bash[22676]: cluster 2024-09-21T05:38:21.357984+0000 mgr.a (mgr.14388) 19216 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:22 smithi044 bash[22676]: audit 2024-09-21T05:38:21.965424+0000 mgr.a (mgr.14388) 19217 : audit [DBG] from='client.412464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:22 smithi179 bash[23186]: cluster 2024-09-21T05:38:21.357984+0000 mgr.a (mgr.14388) 19216 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:22 smithi179 bash[23186]: audit 2024-09-21T05:38:21.965424+0000 mgr.a (mgr.14388) 19217 : audit [DBG] from='client.412464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:22 smithi049 bash[23528]: cluster 2024-09-21T05:38:21.357984+0000 mgr.a (mgr.14388) 19216 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:38:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:22 smithi049 bash[23528]: audit 2024-09-21T05:38:21.965424+0000 mgr.a (mgr.14388) 19217 : audit [DBG] from='client.412464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:24 smithi044 bash[22676]: cluster 2024-09-21T05:38:23.358862+0000 mgr.a (mgr.14388) 19218 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:24 smithi179 bash[23186]: cluster 2024-09-21T05:38:23.358862+0000 mgr.a (mgr.14388) 19218 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:24 smithi049 bash[23528]: cluster 2024-09-21T05:38:23.358862+0000 mgr.a (mgr.14388) 19218 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:27.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:26 smithi044 bash[22676]: cluster 2024-09-21T05:38:25.360046+0000 mgr.a (mgr.14388) 19219 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:38:27.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:26 smithi179 bash[23186]: cluster 2024-09-21T05:38:25.360046+0000 mgr.a (mgr.14388) 19219 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:38:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:26 smithi049 bash[23528]: cluster 2024-09-21T05:38:25.360046+0000 mgr.a (mgr.14388) 19219 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:38:27.428 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:27.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:27.429 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:28.237 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:28.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:28.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:28.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:28.237 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:28 smithi044 bash[22676]: cluster 2024-09-21T05:38:27.360793+0000 mgr.a (mgr.14388) 19220 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:28 smithi044 bash[22676]: audit 2024-09-21T05:38:27.785732+0000 mgr.a (mgr.14388) 19221 : audit [DBG] from='client.412542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:28 smithi179 bash[23186]: cluster 2024-09-21T05:38:27.360793+0000 mgr.a (mgr.14388) 19220 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:28 smithi179 bash[23186]: audit 2024-09-21T05:38:27.785732+0000 mgr.a (mgr.14388) 19221 : audit [DBG] from='client.412542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:28 smithi049 bash[23528]: cluster 2024-09-21T05:38:27.360793+0000 mgr.a (mgr.14388) 19220 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:28 smithi049 bash[23528]: audit 2024-09-21T05:38:27.785732+0000 mgr.a (mgr.14388) 19221 : audit [DBG] from='client.412542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:31 smithi044 bash[22676]: cluster 2024-09-21T05:38:29.361722+0000 mgr.a (mgr.14388) 19222 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:31 smithi044 bash[22676]: audit 2024-09-21T05:38:30.124064+0000 mon.a (mon.0) 15197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:31 smithi044 bash[22676]: audit 2024-09-21T05:38:30.128756+0000 mon.a (mon.0) 15198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:31 smithi044 bash[22676]: audit 2024-09-21T05:38:30.134950+0000 mon.a (mon.0) 15199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:31 smithi044 bash[22676]: audit 2024-09-21T05:38:30.257495+0000 mon.a (mon.0) 15200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:31 smithi044 bash[22676]: audit 2024-09-21T05:38:30.265930+0000 mon.a (mon.0) 15201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:31 smithi044 bash[22676]: audit 2024-09-21T05:38:30.276017+0000 mon.a (mon.0) 15202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:31 smithi179 bash[23186]: cluster 2024-09-21T05:38:29.361722+0000 mgr.a (mgr.14388) 19222 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:31 smithi179 bash[23186]: audit 2024-09-21T05:38:30.124064+0000 mon.a (mon.0) 15197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:31 smithi179 bash[23186]: audit 2024-09-21T05:38:30.128756+0000 mon.a (mon.0) 15198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:31 smithi179 bash[23186]: audit 2024-09-21T05:38:30.134950+0000 mon.a (mon.0) 15199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:31 smithi179 bash[23186]: audit 2024-09-21T05:38:30.257495+0000 mon.a (mon.0) 15200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:31 smithi179 bash[23186]: audit 2024-09-21T05:38:30.265930+0000 mon.a (mon.0) 15201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:31 smithi179 bash[23186]: audit 2024-09-21T05:38:30.276017+0000 mon.a (mon.0) 15202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:31 smithi049 bash[23528]: cluster 2024-09-21T05:38:29.361722+0000 mgr.a (mgr.14388) 19222 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:38:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:31 smithi049 bash[23528]: audit 2024-09-21T05:38:30.124064+0000 mon.a (mon.0) 15197 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:31 smithi049 bash[23528]: audit 2024-09-21T05:38:30.128756+0000 mon.a (mon.0) 15198 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:31 smithi049 bash[23528]: audit 2024-09-21T05:38:30.134950+0000 mon.a (mon.0) 15199 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:31 smithi049 bash[23528]: audit 2024-09-21T05:38:30.257495+0000 mon.a (mon.0) 15200 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:31 smithi049 bash[23528]: audit 2024-09-21T05:38:30.265930+0000 mon.a (mon.0) 15201 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:31.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:31 smithi049 bash[23528]: audit 2024-09-21T05:38:30.276017+0000 mon.a (mon.0) 15202 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:33.238 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:33.239 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:33 smithi044 bash[22676]: cluster 2024-09-21T05:38:31.364002+0000 mgr.a (mgr.14388) 19223 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:38:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:33 smithi179 bash[23186]: cluster 2024-09-21T05:38:31.364002+0000 mgr.a (mgr.14388) 19223 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:38:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:33 smithi049 bash[23528]: cluster 2024-09-21T05:38:31.364002+0000 mgr.a (mgr.14388) 19223 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-21T05:38:34.003 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:34.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:34.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:35 smithi044 bash[22676]: cluster 2024-09-21T05:38:33.364461+0000 mgr.a (mgr.14388) 19224 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:35 smithi044 bash[22676]: audit 2024-09-21T05:38:33.570167+0000 mgr.a (mgr.14388) 19225 : audit [DBG] from='client.412620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:35 smithi179 bash[23186]: cluster 2024-09-21T05:38:33.364461+0000 mgr.a (mgr.14388) 19224 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:35 smithi179 bash[23186]: audit 2024-09-21T05:38:33.570167+0000 mgr.a (mgr.14388) 19225 : audit [DBG] from='client.412620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:35 smithi049 bash[23528]: cluster 2024-09-21T05:38:33.364461+0000 mgr.a (mgr.14388) 19224 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:35 smithi049 bash[23528]: audit 2024-09-21T05:38:33.570167+0000 mgr.a (mgr.14388) 19225 : audit [DBG] from='client.412620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:37.261 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:37 smithi049 bash[23528]: cluster 2024-09-21T05:38:35.366810+0000 mgr.a (mgr.14388) 19226 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:37 smithi044 bash[22676]: cluster 2024-09-21T05:38:35.366810+0000 mgr.a (mgr.14388) 19226 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:37.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:37 smithi179 bash[23186]: cluster 2024-09-21T05:38:35.366810+0000 mgr.a (mgr.14388) 19226 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:39.006 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:39 smithi044 bash[22676]: cluster 2024-09-21T05:38:37.367602+0000 mgr.a (mgr.14388) 19227 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:39 smithi179 bash[23186]: cluster 2024-09-21T05:38:37.367602+0000 mgr.a (mgr.14388) 19227 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:39.538 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:39 smithi049 bash[23528]: cluster 2024-09-21T05:38:37.367602+0000 mgr.a (mgr.14388) 19227 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:39.754 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:39.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:39.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:39.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:39.754 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:41 smithi049 bash[23528]: audit 2024-09-21T05:38:39.335192+0000 mgr.a (mgr.14388) 19228 : audit [DBG] from='client.412695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:41 smithi049 bash[23528]: cluster 2024-09-21T05:38:39.368500+0000 mgr.a (mgr.14388) 19229 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:41 smithi049 bash[23528]: audit 2024-09-21T05:38:41.024408+0000 mon.a (mon.0) 15203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:41 smithi049 bash[23528]: audit 2024-09-21T05:38:41.033120+0000 mon.a (mon.0) 15204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:41 smithi049 bash[23528]: audit 2024-09-21T05:38:41.043813+0000 mon.a (mon.0) 15205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:41 smithi044 bash[22676]: audit 2024-09-21T05:38:39.335192+0000 mgr.a (mgr.14388) 19228 : audit [DBG] from='client.412695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:41 smithi044 bash[22676]: cluster 2024-09-21T05:38:39.368500+0000 mgr.a (mgr.14388) 19229 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:41 smithi044 bash[22676]: audit 2024-09-21T05:38:41.024408+0000 mon.a (mon.0) 15203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:41 smithi044 bash[22676]: audit 2024-09-21T05:38:41.033120+0000 mon.a (mon.0) 15204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:41 smithi044 bash[22676]: audit 2024-09-21T05:38:41.043813+0000 mon.a (mon.0) 15205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:41 smithi179 bash[23186]: audit 2024-09-21T05:38:39.335192+0000 mgr.a (mgr.14388) 19228 : audit [DBG] from='client.412695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:41 smithi179 bash[23186]: cluster 2024-09-21T05:38:39.368500+0000 mgr.a (mgr.14388) 19229 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:41 smithi179 bash[23186]: audit 2024-09-21T05:38:41.024408+0000 mon.a (mon.0) 15203 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:41 smithi179 bash[23186]: audit 2024-09-21T05:38:41.033120+0000 mon.a (mon.0) 15204 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:41.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:41 smithi179 bash[23186]: audit 2024-09-21T05:38:41.043813+0000 mon.a (mon.0) 15205 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:43 smithi044 bash[22676]: cluster 2024-09-21T05:38:41.370946+0000 mgr.a (mgr.14388) 19230 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:43 smithi179 bash[23186]: cluster 2024-09-21T05:38:41.370946+0000 mgr.a (mgr.14388) 19230 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:43 smithi049 bash[23528]: cluster 2024-09-21T05:38:41.370946+0000 mgr.a (mgr.14388) 19230 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:38:44.755 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:44.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:44.756 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:45.443 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:45 smithi044 bash[22676]: cluster 2024-09-21T05:38:43.371742+0000 mgr.a (mgr.14388) 19231 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:45.489 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:45 smithi179 bash[23186]: cluster 2024-09-21T05:38:43.371742+0000 mgr.a (mgr.14388) 19231 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:45.525 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:45.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:45.525 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:45.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:45.526 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:45 smithi049 bash[23528]: cluster 2024-09-21T05:38:43.371742+0000 mgr.a (mgr.14388) 19231 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:46.437 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:46 smithi179 bash[23186]: audit 2024-09-21T05:38:45.086194+0000 mgr.a (mgr.14388) 19232 : audit [DBG] from='client.412773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:46.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:46 smithi044 bash[22676]: audit 2024-09-21T05:38:45.086194+0000 mgr.a (mgr.14388) 19232 : audit [DBG] from='client.412773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:46 smithi049 bash[23528]: audit 2024-09-21T05:38:45.086194+0000 mgr.a (mgr.14388) 19232 : audit [DBG] from='client.412773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:47.438 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:47 smithi179 bash[23186]: cluster 2024-09-21T05:38:45.373338+0000 mgr.a (mgr.14388) 19233 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:47 smithi044 bash[22676]: cluster 2024-09-21T05:38:45.373338+0000 mgr.a (mgr.14388) 19233 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:47 smithi049 bash[23528]: cluster 2024-09-21T05:38:45.373338+0000 mgr.a (mgr.14388) 19233 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:49 smithi044 bash[22676]: cluster 2024-09-21T05:38:47.373860+0000 mgr.a (mgr.14388) 19234 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:38:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:49 smithi179 bash[23186]: cluster 2024-09-21T05:38:47.373860+0000 mgr.a (mgr.14388) 19234 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:38:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:49 smithi049 bash[23528]: cluster 2024-09-21T05:38:47.373860+0000 mgr.a (mgr.14388) 19234 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:38:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:51.326 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:51.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:51.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:51.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:51.327 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:51 smithi044 bash[22676]: cluster 2024-09-21T05:38:49.374601+0000 mgr.a (mgr.14388) 19235 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:38:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:51 smithi044 bash[22676]: audit 2024-09-21T05:38:50.338921+0000 mon.a (mon.0) 15206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:51 smithi044 bash[22676]: audit 2024-09-21T05:38:50.348589+0000 mon.a (mon.0) 15207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:51 smithi044 bash[22676]: audit 2024-09-21T05:38:50.360516+0000 mon.a (mon.0) 15208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:51 smithi044 bash[22676]: audit 2024-09-21T05:38:50.486916+0000 mon.a (mon.0) 15209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:51 smithi044 bash[22676]: audit 2024-09-21T05:38:50.495386+0000 mon.a (mon.0) 15210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:51 smithi044 bash[22676]: audit 2024-09-21T05:38:50.505233+0000 mon.a (mon.0) 15211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:51 smithi179 bash[23186]: cluster 2024-09-21T05:38:49.374601+0000 mgr.a (mgr.14388) 19235 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:38:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:51 smithi179 bash[23186]: audit 2024-09-21T05:38:50.338921+0000 mon.a (mon.0) 15206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:51 smithi179 bash[23186]: audit 2024-09-21T05:38:50.348589+0000 mon.a (mon.0) 15207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:51 smithi179 bash[23186]: audit 2024-09-21T05:38:50.360516+0000 mon.a (mon.0) 15208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:51 smithi179 bash[23186]: audit 2024-09-21T05:38:50.486916+0000 mon.a (mon.0) 15209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:51 smithi179 bash[23186]: audit 2024-09-21T05:38:50.495386+0000 mon.a (mon.0) 15210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:51 smithi179 bash[23186]: audit 2024-09-21T05:38:50.505233+0000 mon.a (mon.0) 15211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:51 smithi049 bash[23528]: cluster 2024-09-21T05:38:49.374601+0000 mgr.a (mgr.14388) 19235 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:51 smithi049 bash[23528]: audit 2024-09-21T05:38:50.338921+0000 mon.a (mon.0) 15206 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:51 smithi049 bash[23528]: audit 2024-09-21T05:38:50.348589+0000 mon.a (mon.0) 15207 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:51 smithi049 bash[23528]: audit 2024-09-21T05:38:50.360516+0000 mon.a (mon.0) 15208 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:51 smithi049 bash[23528]: audit 2024-09-21T05:38:50.486916+0000 mon.a (mon.0) 15209 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:51 smithi049 bash[23528]: audit 2024-09-21T05:38:50.495386+0000 mon.a (mon.0) 15210 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:51.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:51 smithi049 bash[23528]: audit 2024-09-21T05:38:50.505233+0000 mon.a (mon.0) 15211 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:38:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:52 smithi044 bash[22676]: audit 2024-09-21T05:38:50.862321+0000 mgr.a (mgr.14388) 19236 : audit [DBG] from='client.412851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:52.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:52 smithi179 bash[23186]: audit 2024-09-21T05:38:50.862321+0000 mgr.a (mgr.14388) 19236 : audit [DBG] from='client.412851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:52 smithi049 bash[23528]: audit 2024-09-21T05:38:50.862321+0000 mgr.a (mgr.14388) 19236 : audit [DBG] from='client.412851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:53 smithi044 bash[22676]: cluster 2024-09-21T05:38:51.376233+0000 mgr.a (mgr.14388) 19237 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:53 smithi179 bash[23186]: cluster 2024-09-21T05:38:51.376233+0000 mgr.a (mgr.14388) 19237 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:53 smithi049 bash[23528]: cluster 2024-09-21T05:38:51.376233+0000 mgr.a (mgr.14388) 19237 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:55 smithi044 bash[22676]: cluster 2024-09-21T05:38:53.376978+0000 mgr.a (mgr.14388) 19238 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:38:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:55 smithi179 bash[23186]: cluster 2024-09-21T05:38:53.376978+0000 mgr.a (mgr.14388) 19238 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:38:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:55 smithi049 bash[23528]: cluster 2024-09-21T05:38:53.376978+0000 mgr.a (mgr.14388) 19238 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:38:56.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:38:56.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:38:56.328 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:38:57.115 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:38:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:38:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:38:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:38:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:38:57.466 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:57 smithi049 bash[23528]: cluster 2024-09-21T05:38:55.378991+0000 mgr.a (mgr.14388) 19239 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:57 smithi044 bash[22676]: cluster 2024-09-21T05:38:55.378991+0000 mgr.a (mgr.14388) 19239 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:57 smithi179 bash[23186]: cluster 2024-09-21T05:38:55.378991+0000 mgr.a (mgr.14388) 19239 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:58.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:58 smithi044 bash[22676]: audit 2024-09-21T05:38:56.666326+0000 mgr.a (mgr.14388) 19240 : audit [DBG] from='client.412929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:58.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:58 smithi179 bash[23186]: audit 2024-09-21T05:38:56.666326+0000 mgr.a (mgr.14388) 19240 : audit [DBG] from='client.412929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:58 smithi049 bash[23528]: audit 2024-09-21T05:38:56.666326+0000 mgr.a (mgr.14388) 19240 : audit [DBG] from='client.412929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:38:59 smithi044 bash[22676]: cluster 2024-09-21T05:38:57.379953+0000 mgr.a (mgr.14388) 19241 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:38:59 smithi179 bash[23186]: cluster 2024-09-21T05:38:57.379953+0000 mgr.a (mgr.14388) 19241 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:38:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:38:59 smithi049 bash[23528]: cluster 2024-09-21T05:38:57.379953+0000 mgr.a (mgr.14388) 19241 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:01 smithi044 bash[22676]: cluster 2024-09-21T05:38:59.380751+0000 mgr.a (mgr.14388) 19242 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:01 smithi179 bash[23186]: cluster 2024-09-21T05:38:59.380751+0000 mgr.a (mgr.14388) 19242 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:01 smithi049 bash[23528]: cluster 2024-09-21T05:38:59.380751+0000 mgr.a (mgr.14388) 19242 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:02.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:02.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:02.117 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:02 smithi049 bash[23528]: audit 2024-09-21T05:39:01.265881+0000 mon.a (mon.0) 15212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:02 smithi049 bash[23528]: audit 2024-09-21T05:39:01.275996+0000 mon.a (mon.0) 15213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:02 smithi049 bash[23528]: audit 2024-09-21T05:39:01.287712+0000 mon.a (mon.0) 15214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:02 smithi049 bash[23528]: cluster 2024-09-21T05:39:01.383054+0000 mgr.a (mgr.14388) 19243 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:02.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:02 smithi044 bash[22676]: audit 2024-09-21T05:39:01.265881+0000 mon.a (mon.0) 15212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:02 smithi044 bash[22676]: audit 2024-09-21T05:39:01.275996+0000 mon.a (mon.0) 15213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:02 smithi044 bash[22676]: audit 2024-09-21T05:39:01.287712+0000 mon.a (mon.0) 15214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:02 smithi044 bash[22676]: cluster 2024-09-21T05:39:01.383054+0000 mgr.a (mgr.14388) 19243 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:02.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:02 smithi179 bash[23186]: audit 2024-09-21T05:39:01.265881+0000 mon.a (mon.0) 15212 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:02 smithi179 bash[23186]: audit 2024-09-21T05:39:01.275996+0000 mon.a (mon.0) 15213 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:02 smithi179 bash[23186]: audit 2024-09-21T05:39:01.287712+0000 mon.a (mon.0) 15214 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:02.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:02 smithi179 bash[23186]: cluster 2024-09-21T05:39:01.383054+0000 mgr.a (mgr.14388) 19243 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:02.883 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:02.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:02.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:02.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:03 smithi049 bash[23528]: audit 2024-09-21T05:39:02.452080+0000 mgr.a (mgr.14388) 19244 : audit [DBG] from='client.413001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:03 smithi044 bash[22676]: audit 2024-09-21T05:39:02.452080+0000 mgr.a (mgr.14388) 19244 : audit [DBG] from='client.413001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:03.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:03 smithi179 bash[23186]: audit 2024-09-21T05:39:02.452080+0000 mgr.a (mgr.14388) 19244 : audit [DBG] from='client.413001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:04.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:04 smithi049 bash[23528]: cluster 2024-09-21T05:39:03.384078+0000 mgr.a (mgr.14388) 19245 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:04.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:04 smithi044 bash[22676]: cluster 2024-09-21T05:39:03.384078+0000 mgr.a (mgr.14388) 19245 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:04.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:04 smithi179 bash[23186]: cluster 2024-09-21T05:39:03.384078+0000 mgr.a (mgr.14388) 19245 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:06.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:06 smithi044 bash[22676]: cluster 2024-09-21T05:39:05.386337+0000 mgr.a (mgr.14388) 19246 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:06 smithi044 bash[22676]: audit 2024-09-21T05:39:06.221645+0000 mon.a (mon.0) 15215 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:39:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:06 smithi044 bash[22676]: audit 2024-09-21T05:39:06.229280+0000 mon.a (mon.0) 15216 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:39:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:06 smithi044 bash[22676]: audit 2024-09-21T05:39:06.231511+0000 mon.a (mon.0) 15217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:39:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:06 smithi044 bash[22676]: audit 2024-09-21T05:39:06.243579+0000 mon.a (mon.0) 15218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:06 smithi044 bash[22676]: audit 2024-09-21T05:39:06.249974+0000 mon.a (mon.0) 15219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:39:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:06 smithi179 bash[23186]: cluster 2024-09-21T05:39:05.386337+0000 mgr.a (mgr.14388) 19246 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:06 smithi179 bash[23186]: audit 2024-09-21T05:39:06.221645+0000 mon.a (mon.0) 15215 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:39:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:06 smithi179 bash[23186]: audit 2024-09-21T05:39:06.229280+0000 mon.a (mon.0) 15216 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:39:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:06 smithi179 bash[23186]: audit 2024-09-21T05:39:06.231511+0000 mon.a (mon.0) 15217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:39:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:06 smithi179 bash[23186]: audit 2024-09-21T05:39:06.243579+0000 mon.a (mon.0) 15218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:06 smithi179 bash[23186]: audit 2024-09-21T05:39:06.249974+0000 mon.a (mon.0) 15219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:06 smithi049 bash[23528]: cluster 2024-09-21T05:39:05.386337+0000 mgr.a (mgr.14388) 19246 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:06 smithi049 bash[23528]: audit 2024-09-21T05:39:06.221645+0000 mon.a (mon.0) 15215 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:06 smithi049 bash[23528]: audit 2024-09-21T05:39:06.229280+0000 mon.a (mon.0) 15216 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:06 smithi049 bash[23528]: audit 2024-09-21T05:39:06.231511+0000 mon.a (mon.0) 15217 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:06 smithi049 bash[23528]: audit 2024-09-21T05:39:06.243579+0000 mon.a (mon.0) 15218 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:06 smithi049 bash[23528]: audit 2024-09-21T05:39:06.249974+0000 mon.a (mon.0) 15219 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:39:07.452 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:39:07 smithi044 bash[22930]: debug 2024-09-21T05:39:07.040+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:39:07.452 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:39:07 smithi044 bash[22930]: debug 2024-09-21T05:39:07.040+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:39:07.711 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:07 smithi044 bash[22676]: audit 2024-09-21T05:39:06.252542+0000 mgr.a (mgr.14388) 19247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:39:07.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:07 smithi044 bash[22676]: audit 2024-09-21T05:39:07.043637+0000 mgr.a (mgr.14388) 19248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:39:07.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:07 smithi044 bash[22676]: cephadm 2024-09-21T05:39:07.044889+0000 mgr.a (mgr.14388) 19249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:39:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:07 smithi179 bash[23186]: audit 2024-09-21T05:39:06.252542+0000 mgr.a (mgr.14388) 19247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:39:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:07 smithi179 bash[23186]: audit 2024-09-21T05:39:07.043637+0000 mgr.a (mgr.14388) 19248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:39:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:07 smithi179 bash[23186]: cephadm 2024-09-21T05:39:07.044889+0000 mgr.a (mgr.14388) 19249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:39:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:07 smithi049 bash[23528]: audit 2024-09-21T05:39:06.252542+0000 mgr.a (mgr.14388) 19247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:39:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:07 smithi049 bash[23528]: audit 2024-09-21T05:39:07.043637+0000 mgr.a (mgr.14388) 19248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:39:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:07 smithi049 bash[23528]: cephadm 2024-09-21T05:39:07.044889+0000 mgr.a (mgr.14388) 19249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:39:07.884 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:07.885 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:08.635 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:08.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:08.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:08.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:08.635 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:08.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:08 smithi044 bash[22676]: cluster 2024-09-21T05:39:07.387461+0000 mgr.a (mgr.14388) 19250 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:08 smithi044 bash[22676]: audit 2024-09-21T05:39:08.211853+0000 mgr.a (mgr.14388) 19251 : audit [DBG] from='client.413187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:08.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:08 smithi179 bash[23186]: cluster 2024-09-21T05:39:07.387461+0000 mgr.a (mgr.14388) 19250 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:08 smithi179 bash[23186]: audit 2024-09-21T05:39:08.211853+0000 mgr.a (mgr.14388) 19251 : audit [DBG] from='client.413187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:08 smithi049 bash[23528]: cluster 2024-09-21T05:39:07.387461+0000 mgr.a (mgr.14388) 19250 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:08.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:08 smithi049 bash[23528]: audit 2024-09-21T05:39:08.211853+0000 mgr.a (mgr.14388) 19251 : audit [DBG] from='client.413187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:10.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:10 smithi179 bash[23186]: cluster 2024-09-21T05:39:09.388454+0000 mgr.a (mgr.14388) 19252 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:10 smithi044 bash[22676]: cluster 2024-09-21T05:39:09.388454+0000 mgr.a (mgr.14388) 19252 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:10 smithi049 bash[23528]: cluster 2024-09-21T05:39:09.388454+0000 mgr.a (mgr.14388) 19252 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:11 smithi044 bash[22676]: audit 2024-09-21T05:39:10.568959+0000 mon.a (mon.0) 15220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:11 smithi044 bash[22676]: audit 2024-09-21T05:39:10.577294+0000 mon.a (mon.0) 15221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:11 smithi044 bash[22676]: audit 2024-09-21T05:39:10.588020+0000 mon.a (mon.0) 15222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:11 smithi044 bash[22676]: audit 2024-09-21T05:39:10.712241+0000 mon.a (mon.0) 15223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:11 smithi044 bash[22676]: audit 2024-09-21T05:39:10.720887+0000 mon.a (mon.0) 15224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:11 smithi044 bash[22676]: audit 2024-09-21T05:39:10.731274+0000 mon.a (mon.0) 15225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:11 smithi179 bash[23186]: audit 2024-09-21T05:39:10.568959+0000 mon.a (mon.0) 15220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:11 smithi179 bash[23186]: audit 2024-09-21T05:39:10.577294+0000 mon.a (mon.0) 15221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:11 smithi179 bash[23186]: audit 2024-09-21T05:39:10.588020+0000 mon.a (mon.0) 15222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:11 smithi179 bash[23186]: audit 2024-09-21T05:39:10.712241+0000 mon.a (mon.0) 15223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:11 smithi179 bash[23186]: audit 2024-09-21T05:39:10.720887+0000 mon.a (mon.0) 15224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:11 smithi179 bash[23186]: audit 2024-09-21T05:39:10.731274+0000 mon.a (mon.0) 15225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:11 smithi049 bash[23528]: audit 2024-09-21T05:39:10.568959+0000 mon.a (mon.0) 15220 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:11 smithi049 bash[23528]: audit 2024-09-21T05:39:10.577294+0000 mon.a (mon.0) 15221 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:11 smithi049 bash[23528]: audit 2024-09-21T05:39:10.588020+0000 mon.a (mon.0) 15222 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:11 smithi049 bash[23528]: audit 2024-09-21T05:39:10.712241+0000 mon.a (mon.0) 15223 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:11 smithi049 bash[23528]: audit 2024-09-21T05:39:10.720887+0000 mon.a (mon.0) 15224 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:11 smithi049 bash[23528]: audit 2024-09-21T05:39:10.731274+0000 mon.a (mon.0) 15225 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:12 smithi044 bash[22676]: cluster 2024-09-21T05:39:11.390807+0000 mgr.a (mgr.14388) 19253 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:12 smithi179 bash[23186]: cluster 2024-09-21T05:39:11.390807+0000 mgr.a (mgr.14388) 19253 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:12 smithi049 bash[23528]: cluster 2024-09-21T05:39:11.390807+0000 mgr.a (mgr.14388) 19253 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:13.636 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:13.637 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:13.637 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:14 smithi044 bash[22676]: cluster 2024-09-21T05:39:13.391552+0000 mgr.a (mgr.14388) 19254 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:14 smithi044 bash[22676]: audit 2024-09-21T05:39:13.969528+0000 mgr.a (mgr.14388) 19255 : audit [DBG] from='client.413265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:15.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:14 smithi179 bash[23186]: cluster 2024-09-21T05:39:13.391552+0000 mgr.a (mgr.14388) 19254 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:14 smithi179 bash[23186]: audit 2024-09-21T05:39:13.969528+0000 mgr.a (mgr.14388) 19255 : audit [DBG] from='client.413265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:14 smithi049 bash[23528]: cluster 2024-09-21T05:39:13.391552+0000 mgr.a (mgr.14388) 19254 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:14 smithi049 bash[23528]: audit 2024-09-21T05:39:13.969528+0000 mgr.a (mgr.14388) 19255 : audit [DBG] from='client.413265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:17.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:16 smithi179 bash[23186]: cluster 2024-09-21T05:39:15.393851+0000 mgr.a (mgr.14388) 19256 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:16 smithi049 bash[23528]: cluster 2024-09-21T05:39:15.393851+0000 mgr.a (mgr.14388) 19256 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:16 smithi044 bash[22676]: cluster 2024-09-21T05:39:15.393851+0000 mgr.a (mgr.14388) 19256 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:18 smithi179 bash[23186]: cluster 2024-09-21T05:39:17.394617+0000 mgr.a (mgr.14388) 19257 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:18 smithi049 bash[23528]: cluster 2024-09-21T05:39:17.394617+0000 mgr.a (mgr.14388) 19257 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:18 smithi044 bash[22676]: cluster 2024-09-21T05:39:17.394617+0000 mgr.a (mgr.14388) 19257 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:19.410 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:19.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:19.411 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:20.173 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:20.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:20.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:20.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:20.174 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:21.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:20 smithi179 bash[23186]: cluster 2024-09-21T05:39:19.395532+0000 mgr.a (mgr.14388) 19258 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:20 smithi179 bash[23186]: audit 2024-09-21T05:39:19.745522+0000 mgr.a (mgr.14388) 19259 : audit [DBG] from='client.413343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:20 smithi049 bash[23528]: cluster 2024-09-21T05:39:19.395532+0000 mgr.a (mgr.14388) 19258 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:20 smithi049 bash[23528]: audit 2024-09-21T05:39:19.745522+0000 mgr.a (mgr.14388) 19259 : audit [DBG] from='client.413343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:20 smithi044 bash[22676]: cluster 2024-09-21T05:39:19.395532+0000 mgr.a (mgr.14388) 19258 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:20 smithi044 bash[22676]: audit 2024-09-21T05:39:19.745522+0000 mgr.a (mgr.14388) 19259 : audit [DBG] from='client.413343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:22 smithi044 bash[22676]: cluster 2024-09-21T05:39:21.398523+0000 mgr.a (mgr.14388) 19260 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:22 smithi044 bash[22676]: audit 2024-09-21T05:39:21.444365+0000 mon.a (mon.0) 15226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:22 smithi044 bash[22676]: audit 2024-09-21T05:39:21.454392+0000 mon.a (mon.0) 15227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:22 smithi044 bash[22676]: audit 2024-09-21T05:39:21.464891+0000 mon.a (mon.0) 15228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:22 smithi179 bash[23186]: cluster 2024-09-21T05:39:21.398523+0000 mgr.a (mgr.14388) 19260 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:22 smithi179 bash[23186]: audit 2024-09-21T05:39:21.444365+0000 mon.a (mon.0) 15226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:22 smithi179 bash[23186]: audit 2024-09-21T05:39:21.454392+0000 mon.a (mon.0) 15227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:22 smithi179 bash[23186]: audit 2024-09-21T05:39:21.464891+0000 mon.a (mon.0) 15228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:22 smithi049 bash[23528]: cluster 2024-09-21T05:39:21.398523+0000 mgr.a (mgr.14388) 19260 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:39:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:22 smithi049 bash[23528]: audit 2024-09-21T05:39:21.444365+0000 mon.a (mon.0) 15226 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:22 smithi049 bash[23528]: audit 2024-09-21T05:39:21.454392+0000 mon.a (mon.0) 15227 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:22.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:22 smithi049 bash[23528]: audit 2024-09-21T05:39:21.464891+0000 mon.a (mon.0) 15228 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:24 smithi044 bash[22676]: cluster 2024-09-21T05:39:23.399330+0000 mgr.a (mgr.14388) 19261 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:39:24.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:24 smithi179 bash[23186]: cluster 2024-09-21T05:39:23.399330+0000 mgr.a (mgr.14388) 19261 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:39:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:24 smithi049 bash[23528]: cluster 2024-09-21T05:39:23.399330+0000 mgr.a (mgr.14388) 19261 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:39:25.175 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:25.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:25.176 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:25.953 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:25.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:25.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:25.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:25.954 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:26 smithi044 bash[22676]: cluster 2024-09-21T05:39:25.401303+0000 mgr.a (mgr.14388) 19262 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:26 smithi044 bash[22676]: audit 2024-09-21T05:39:25.513540+0000 mgr.a (mgr.14388) 19263 : audit [DBG] from='client.413421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:26 smithi179 bash[23186]: cluster 2024-09-21T05:39:25.401303+0000 mgr.a (mgr.14388) 19262 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:26 smithi179 bash[23186]: audit 2024-09-21T05:39:25.513540+0000 mgr.a (mgr.14388) 19263 : audit [DBG] from='client.413421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:26 smithi049 bash[23528]: cluster 2024-09-21T05:39:25.401303+0000 mgr.a (mgr.14388) 19262 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:26 smithi049 bash[23528]: audit 2024-09-21T05:39:25.513540+0000 mgr.a (mgr.14388) 19263 : audit [DBG] from='client.413421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:28 smithi044 bash[22676]: cluster 2024-09-21T05:39:27.402166+0000 mgr.a (mgr.14388) 19264 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:39:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:28 smithi179 bash[23186]: cluster 2024-09-21T05:39:27.402166+0000 mgr.a (mgr.14388) 19264 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:39:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:28 smithi049 bash[23528]: cluster 2024-09-21T05:39:27.402166+0000 mgr.a (mgr.14388) 19264 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:39:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:30 smithi044 bash[22676]: cluster 2024-09-21T05:39:29.402950+0000 mgr.a (mgr.14388) 19265 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:39:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:30 smithi179 bash[23186]: cluster 2024-09-21T05:39:29.402950+0000 mgr.a (mgr.14388) 19265 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:39:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:30 smithi049 bash[23528]: cluster 2024-09-21T05:39:29.402950+0000 mgr.a (mgr.14388) 19265 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:31.729 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:31.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:31.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:31.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:31.730 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:31 smithi049 bash[23528]: audit 2024-09-21T05:39:30.798916+0000 mon.a (mon.0) 15229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:31 smithi049 bash[23528]: audit 2024-09-21T05:39:30.806936+0000 mon.a (mon.0) 15230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:31 smithi049 bash[23528]: audit 2024-09-21T05:39:30.817481+0000 mon.a (mon.0) 15231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:31 smithi049 bash[23528]: audit 2024-09-21T05:39:30.940014+0000 mon.a (mon.0) 15232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:31 smithi049 bash[23528]: audit 2024-09-21T05:39:30.948919+0000 mon.a (mon.0) 15233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:31 smithi049 bash[23528]: audit 2024-09-21T05:39:30.958723+0000 mon.a (mon.0) 15234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:31 smithi044 bash[22676]: audit 2024-09-21T05:39:30.798916+0000 mon.a (mon.0) 15229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:31 smithi044 bash[22676]: audit 2024-09-21T05:39:30.806936+0000 mon.a (mon.0) 15230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:31 smithi044 bash[22676]: audit 2024-09-21T05:39:30.817481+0000 mon.a (mon.0) 15231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:31 smithi044 bash[22676]: audit 2024-09-21T05:39:30.940014+0000 mon.a (mon.0) 15232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:31 smithi044 bash[22676]: audit 2024-09-21T05:39:30.948919+0000 mon.a (mon.0) 15233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:31 smithi044 bash[22676]: audit 2024-09-21T05:39:30.958723+0000 mon.a (mon.0) 15234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:31 smithi179 bash[23186]: audit 2024-09-21T05:39:30.798916+0000 mon.a (mon.0) 15229 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:31 smithi179 bash[23186]: audit 2024-09-21T05:39:30.806936+0000 mon.a (mon.0) 15230 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:31 smithi179 bash[23186]: audit 2024-09-21T05:39:30.817481+0000 mon.a (mon.0) 15231 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:31 smithi179 bash[23186]: audit 2024-09-21T05:39:30.940014+0000 mon.a (mon.0) 15232 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:31 smithi179 bash[23186]: audit 2024-09-21T05:39:30.948919+0000 mon.a (mon.0) 15233 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:31 smithi179 bash[23186]: audit 2024-09-21T05:39:30.958723+0000 mon.a (mon.0) 15234 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:32 smithi044 bash[22676]: audit 2024-09-21T05:39:31.286638+0000 mgr.a (mgr.14388) 19266 : audit [DBG] from='client.413496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:33.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:32 smithi044 bash[22676]: cluster 2024-09-21T05:39:31.404466+0000 mgr.a (mgr.14388) 19267 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:33.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:32 smithi179 bash[23186]: audit 2024-09-21T05:39:31.286638+0000 mgr.a (mgr.14388) 19266 : audit [DBG] from='client.413496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:32 smithi179 bash[23186]: cluster 2024-09-21T05:39:31.404466+0000 mgr.a (mgr.14388) 19267 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:32 smithi049 bash[23528]: audit 2024-09-21T05:39:31.286638+0000 mgr.a (mgr.14388) 19266 : audit [DBG] from='client.413496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:32 smithi049 bash[23528]: cluster 2024-09-21T05:39:31.404466+0000 mgr.a (mgr.14388) 19267 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:35.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:34 smithi044 bash[22676]: cluster 2024-09-21T05:39:33.405357+0000 mgr.a (mgr.14388) 19268 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:39:35.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:34 smithi179 bash[23186]: cluster 2024-09-21T05:39:33.405357+0000 mgr.a (mgr.14388) 19268 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:39:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:34 smithi049 bash[23528]: cluster 2024-09-21T05:39:33.405357+0000 mgr.a (mgr.14388) 19268 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:39:36.731 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:36.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:36.732 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:36 smithi044 bash[22676]: cluster 2024-09-21T05:39:35.407547+0000 mgr.a (mgr.14388) 19269 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.249 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:36 smithi049 bash[23528]: cluster 2024-09-21T05:39:35.407547+0000 mgr.a (mgr.14388) 19269 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:36 smithi179 bash[23186]: cluster 2024-09-21T05:39:35.407547+0000 mgr.a (mgr.14388) 19269 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.505 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:37.505 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:37.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:37.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:37.506 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:38.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:37 smithi044 bash[22676]: audit 2024-09-21T05:39:37.066339+0000 mgr.a (mgr.14388) 19270 : audit [DBG] from='client.413574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:38.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:37 smithi179 bash[23186]: audit 2024-09-21T05:39:37.066339+0000 mgr.a (mgr.14388) 19270 : audit [DBG] from='client.413574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:38.262 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:37 smithi049 bash[23528]: audit 2024-09-21T05:39:37.066339+0000 mgr.a (mgr.14388) 19270 : audit [DBG] from='client.413574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:38 smithi044 bash[22676]: cluster 2024-09-21T05:39:37.408332+0000 mgr.a (mgr.14388) 19271 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:39.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:38 smithi179 bash[23186]: cluster 2024-09-21T05:39:37.408332+0000 mgr.a (mgr.14388) 19271 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:38 smithi049 bash[23528]: cluster 2024-09-21T05:39:37.408332+0000 mgr.a (mgr.14388) 19271 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:40 smithi044 bash[22676]: cluster 2024-09-21T05:39:39.409103+0000 mgr.a (mgr.14388) 19272 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:40 smithi179 bash[23186]: cluster 2024-09-21T05:39:39.409103+0000 mgr.a (mgr.14388) 19272 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:40 smithi049 bash[23528]: cluster 2024-09-21T05:39:39.409103+0000 mgr.a (mgr.14388) 19272 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:42.507 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:42 smithi044 bash[22676]: cluster 2024-09-21T05:39:41.411400+0000 mgr.a (mgr.14388) 19273 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:42.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:42 smithi044 bash[22676]: audit 2024-09-21T05:39:41.667578+0000 mon.a (mon.0) 15235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:42 smithi044 bash[22676]: audit 2024-09-21T05:39:41.677909+0000 mon.a (mon.0) 15236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:42.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:42 smithi044 bash[22676]: audit 2024-09-21T05:39:41.688207+0000 mon.a (mon.0) 15237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:42 smithi179 bash[23186]: cluster 2024-09-21T05:39:41.411400+0000 mgr.a (mgr.14388) 19273 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:42 smithi179 bash[23186]: audit 2024-09-21T05:39:41.667578+0000 mon.a (mon.0) 15235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:42 smithi179 bash[23186]: audit 2024-09-21T05:39:41.677909+0000 mon.a (mon.0) 15236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:43.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:42 smithi179 bash[23186]: audit 2024-09-21T05:39:41.688207+0000 mon.a (mon.0) 15237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:42 smithi049 bash[23528]: cluster 2024-09-21T05:39:41.411400+0000 mgr.a (mgr.14388) 19273 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:42 smithi049 bash[23528]: audit 2024-09-21T05:39:41.667578+0000 mon.a (mon.0) 15235 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:42 smithi049 bash[23528]: audit 2024-09-21T05:39:41.677909+0000 mon.a (mon.0) 15236 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:42 smithi049 bash[23528]: audit 2024-09-21T05:39:41.688207+0000 mon.a (mon.0) 15237 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:43.262 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:43.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:43.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:43.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:43.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:43.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:43 smithi044 bash[22676]: audit 2024-09-21T05:39:42.835599+0000 mgr.a (mgr.14388) 19274 : audit [DBG] from='client.413652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:44.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:43 smithi179 bash[23186]: audit 2024-09-21T05:39:42.835599+0000 mgr.a (mgr.14388) 19274 : audit [DBG] from='client.413652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:44.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:43 smithi049 bash[23528]: audit 2024-09-21T05:39:42.835599+0000 mgr.a (mgr.14388) 19274 : audit [DBG] from='client.413652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:44 smithi044 bash[22676]: cluster 2024-09-21T05:39:43.412347+0000 mgr.a (mgr.14388) 19275 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:44 smithi179 bash[23186]: cluster 2024-09-21T05:39:43.412347+0000 mgr.a (mgr.14388) 19275 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:44 smithi049 bash[23528]: cluster 2024-09-21T05:39:43.412347+0000 mgr.a (mgr.14388) 19275 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:46.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:46 smithi044 bash[22676]: cluster 2024-09-21T05:39:45.414807+0000 mgr.a (mgr.14388) 19276 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:46 smithi179 bash[23186]: cluster 2024-09-21T05:39:45.414807+0000 mgr.a (mgr.14388) 19276 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:46 smithi049 bash[23528]: cluster 2024-09-21T05:39:45.414807+0000 mgr.a (mgr.14388) 19276 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:48.263 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:48.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:48.264 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:48.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:48 smithi044 bash[22676]: cluster 2024-09-21T05:39:47.415653+0000 mgr.a (mgr.14388) 19277 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:48 smithi179 bash[23186]: cluster 2024-09-21T05:39:47.415653+0000 mgr.a (mgr.14388) 19277 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:49.012 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:48 smithi049 bash[23528]: cluster 2024-09-21T05:39:47.415653+0000 mgr.a (mgr.14388) 19277 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:49.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:49 smithi044 bash[22676]: audit 2024-09-21T05:39:48.581892+0000 mgr.a (mgr.14388) 19278 : audit [DBG] from='client.413730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:50.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:49 smithi179 bash[23186]: audit 2024-09-21T05:39:48.581892+0000 mgr.a (mgr.14388) 19278 : audit [DBG] from='client.413730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:50.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:49 smithi049 bash[23528]: audit 2024-09-21T05:39:48.581892+0000 mgr.a (mgr.14388) 19278 : audit [DBG] from='client.413730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:50 smithi044 bash[22676]: cluster 2024-09-21T05:39:49.416555+0000 mgr.a (mgr.14388) 19279 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:50 smithi179 bash[23186]: cluster 2024-09-21T05:39:49.416555+0000 mgr.a (mgr.14388) 19279 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:50 smithi049 bash[23528]: cluster 2024-09-21T05:39:49.416555+0000 mgr.a (mgr.14388) 19279 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:52 smithi049 bash[23528]: audit 2024-09-21T05:39:51.032901+0000 mon.a (mon.0) 15238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:52 smithi049 bash[23528]: audit 2024-09-21T05:39:51.040230+0000 mon.a (mon.0) 15239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:52 smithi049 bash[23528]: audit 2024-09-21T05:39:51.052044+0000 mon.a (mon.0) 15240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:52 smithi049 bash[23528]: audit 2024-09-21T05:39:51.173360+0000 mon.a (mon.0) 15241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:52 smithi049 bash[23528]: audit 2024-09-21T05:39:51.183556+0000 mon.a (mon.0) 15242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:52 smithi049 bash[23528]: audit 2024-09-21T05:39:51.193804+0000 mon.a (mon.0) 15243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:52 smithi044 bash[22676]: audit 2024-09-21T05:39:51.032901+0000 mon.a (mon.0) 15238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:52 smithi044 bash[22676]: audit 2024-09-21T05:39:51.040230+0000 mon.a (mon.0) 15239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:52 smithi044 bash[22676]: audit 2024-09-21T05:39:51.052044+0000 mon.a (mon.0) 15240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:52 smithi044 bash[22676]: audit 2024-09-21T05:39:51.173360+0000 mon.a (mon.0) 15241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:52 smithi044 bash[22676]: audit 2024-09-21T05:39:51.183556+0000 mon.a (mon.0) 15242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:52 smithi044 bash[22676]: audit 2024-09-21T05:39:51.193804+0000 mon.a (mon.0) 15243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:52 smithi179 bash[23186]: audit 2024-09-21T05:39:51.032901+0000 mon.a (mon.0) 15238 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:52 smithi179 bash[23186]: audit 2024-09-21T05:39:51.040230+0000 mon.a (mon.0) 15239 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:52 smithi179 bash[23186]: audit 2024-09-21T05:39:51.052044+0000 mon.a (mon.0) 15240 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:52 smithi179 bash[23186]: audit 2024-09-21T05:39:51.173360+0000 mon.a (mon.0) 15241 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:52 smithi179 bash[23186]: audit 2024-09-21T05:39:51.183556+0000 mon.a (mon.0) 15242 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:52.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:52 smithi179 bash[23186]: audit 2024-09-21T05:39:51.193804+0000 mon.a (mon.0) 15243 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:39:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:53 smithi044 bash[22676]: cluster 2024-09-21T05:39:51.418844+0000 mgr.a (mgr.14388) 19280 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:53.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:53 smithi179 bash[23186]: cluster 2024-09-21T05:39:51.418844+0000 mgr.a (mgr.14388) 19280 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:53 smithi049 bash[23528]: cluster 2024-09-21T05:39:51.418844+0000 mgr.a (mgr.14388) 19280 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:54.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:54.015 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:54.018 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:39:54.783 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:39:54.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:39:54.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:39:54.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:39:54.783 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:39:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:55 smithi044 bash[22676]: cluster 2024-09-21T05:39:53.419542+0000 mgr.a (mgr.14388) 19281 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:55.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:55 smithi179 bash[23186]: cluster 2024-09-21T05:39:53.419542+0000 mgr.a (mgr.14388) 19281 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:55 smithi049 bash[23528]: cluster 2024-09-21T05:39:53.419542+0000 mgr.a (mgr.14388) 19281 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:56.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:56 smithi044 bash[22676]: audit 2024-09-21T05:39:54.350182+0000 mgr.a (mgr.14388) 19282 : audit [DBG] from='client.413808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:56.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:56 smithi179 bash[23186]: audit 2024-09-21T05:39:54.350182+0000 mgr.a (mgr.14388) 19282 : audit [DBG] from='client.413808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:56.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:56 smithi049 bash[23528]: audit 2024-09-21T05:39:54.350182+0000 mgr.a (mgr.14388) 19282 : audit [DBG] from='client.413808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:57 smithi044 bash[22676]: cluster 2024-09-21T05:39:55.421932+0000 mgr.a (mgr.14388) 19283 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:57 smithi179 bash[23186]: cluster 2024-09-21T05:39:55.421932+0000 mgr.a (mgr.14388) 19283 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:57 smithi049 bash[23528]: cluster 2024-09-21T05:39:55.421932+0000 mgr.a (mgr.14388) 19283 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:39:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:39:59 smithi049 bash[23528]: cluster 2024-09-21T05:39:57.422698+0000 mgr.a (mgr.14388) 19284 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:39:59 smithi044 bash[22676]: cluster 2024-09-21T05:39:57.422698+0000 mgr.a (mgr.14388) 19284 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:39:59 smithi179 bash[23186]: cluster 2024-09-21T05:39:57.422698+0000 mgr.a (mgr.14388) 19284 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:39:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:39:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:39:59.785 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:00 smithi044 bash[22676]: cluster 2024-09-21T05:40:00.000156+0000 mon.a (mon.0) 15244 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:40:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:00 smithi179 bash[23186]: cluster 2024-09-21T05:40:00.000156+0000 mon.a (mon.0) 15244 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:40:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:00 smithi049 bash[23528]: cluster 2024-09-21T05:40:00.000156+0000 mon.a (mon.0) 15244 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:40:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:00.564 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:00.565 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:01 smithi044 bash[22676]: cluster 2024-09-21T05:39:59.423471+0000 mgr.a (mgr.14388) 19285 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:01.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:01 smithi044 bash[22676]: audit 2024-09-21T05:40:00.118281+0000 mgr.a (mgr.14388) 19286 : audit [DBG] from='client.413886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:01 smithi179 bash[23186]: cluster 2024-09-21T05:39:59.423471+0000 mgr.a (mgr.14388) 19285 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:01 smithi179 bash[23186]: audit 2024-09-21T05:40:00.118281+0000 mgr.a (mgr.14388) 19286 : audit [DBG] from='client.413886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:01 smithi049 bash[23528]: cluster 2024-09-21T05:39:59.423471+0000 mgr.a (mgr.14388) 19285 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:01 smithi049 bash[23528]: audit 2024-09-21T05:40:00.118281+0000 mgr.a (mgr.14388) 19286 : audit [DBG] from='client.413886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:02 smithi044 bash[22676]: cluster 2024-09-21T05:40:01.426447+0000 mgr.a (mgr.14388) 19287 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:02 smithi044 bash[22676]: audit 2024-09-21T05:40:01.881794+0000 mon.a (mon.0) 15245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:02 smithi044 bash[22676]: audit 2024-09-21T05:40:01.890813+0000 mon.a (mon.0) 15246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:02 smithi044 bash[22676]: audit 2024-09-21T05:40:01.901728+0000 mon.a (mon.0) 15247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:02 smithi179 bash[23186]: cluster 2024-09-21T05:40:01.426447+0000 mgr.a (mgr.14388) 19287 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:02 smithi179 bash[23186]: audit 2024-09-21T05:40:01.881794+0000 mon.a (mon.0) 15245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:02 smithi179 bash[23186]: audit 2024-09-21T05:40:01.890813+0000 mon.a (mon.0) 15246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:02 smithi179 bash[23186]: audit 2024-09-21T05:40:01.901728+0000 mon.a (mon.0) 15247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:02 smithi049 bash[23528]: cluster 2024-09-21T05:40:01.426447+0000 mgr.a (mgr.14388) 19287 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:02 smithi049 bash[23528]: audit 2024-09-21T05:40:01.881794+0000 mon.a (mon.0) 15245 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:02 smithi049 bash[23528]: audit 2024-09-21T05:40:01.890813+0000 mon.a (mon.0) 15246 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:02 smithi049 bash[23528]: audit 2024-09-21T05:40:01.901728+0000 mon.a (mon.0) 15247 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:04 smithi044 bash[22676]: cluster 2024-09-21T05:40:03.427226+0000 mgr.a (mgr.14388) 19288 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:04 smithi179 bash[23186]: cluster 2024-09-21T05:40:03.427226+0000 mgr.a (mgr.14388) 19288 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:04 smithi049 bash[23528]: cluster 2024-09-21T05:40:03.427226+0000 mgr.a (mgr.14388) 19288 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:06.325 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:06.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:06.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:06.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:06.325 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:06 smithi044 bash[22676]: cluster 2024-09-21T05:40:05.429139+0000 mgr.a (mgr.14388) 19289 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:06 smithi044 bash[22676]: audit 2024-09-21T05:40:05.887442+0000 mgr.a (mgr.14388) 19290 : audit [DBG] from='client.413964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:06 smithi179 bash[23186]: cluster 2024-09-21T05:40:05.429139+0000 mgr.a (mgr.14388) 19289 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:06 smithi179 bash[23186]: audit 2024-09-21T05:40:05.887442+0000 mgr.a (mgr.14388) 19290 : audit [DBG] from='client.413964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:06 smithi049 bash[23528]: cluster 2024-09-21T05:40:05.429139+0000 mgr.a (mgr.14388) 19289 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:06 smithi049 bash[23528]: audit 2024-09-21T05:40:05.887442+0000 mgr.a (mgr.14388) 19290 : audit [DBG] from='client.413964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:08.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:07 smithi179 bash[23186]: audit 2024-09-21T05:40:07.105626+0000 mon.a (mon.0) 15248 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:40:08.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:07 smithi179 bash[23186]: audit 2024-09-21T05:40:07.113200+0000 mon.a (mon.0) 15249 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:40:08.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:07 smithi179 bash[23186]: audit 2024-09-21T05:40:07.115230+0000 mon.a (mon.0) 15250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:40:08.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:07 smithi179 bash[23186]: audit 2024-09-21T05:40:07.126625+0000 mon.a (mon.0) 15251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:08.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:07 smithi179 bash[23186]: audit 2024-09-21T05:40:07.133114+0000 mon.a (mon.0) 15252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:40:08.143 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:07 smithi179 bash[23186]: audit 2024-09-21T05:40:07.135940+0000 mgr.a (mgr.14388) 19291 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22930]: debug 2024-09-21T05:40:07.899+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22930]: debug 2024-09-21T05:40:07.903+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22676]: audit 2024-09-21T05:40:07.105626+0000 mon.a (mon.0) 15248 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22676]: audit 2024-09-21T05:40:07.113200+0000 mon.a (mon.0) 15249 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22676]: audit 2024-09-21T05:40:07.115230+0000 mon.a (mon.0) 15250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22676]: audit 2024-09-21T05:40:07.126625+0000 mon.a (mon.0) 15251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22676]: audit 2024-09-21T05:40:07.133114+0000 mon.a (mon.0) 15252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:40:08.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:07 smithi044 bash[22676]: audit 2024-09-21T05:40:07.135940+0000 mgr.a (mgr.14388) 19291 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:40:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:07 smithi049 bash[23528]: audit 2024-09-21T05:40:07.105626+0000 mon.a (mon.0) 15248 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:40:08.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:07 smithi049 bash[23528]: audit 2024-09-21T05:40:07.113200+0000 mon.a (mon.0) 15249 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:40:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:07 smithi049 bash[23528]: audit 2024-09-21T05:40:07.115230+0000 mon.a (mon.0) 15250 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:40:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:07 smithi049 bash[23528]: audit 2024-09-21T05:40:07.126625+0000 mon.a (mon.0) 15251 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:07 smithi049 bash[23528]: audit 2024-09-21T05:40:07.133114+0000 mon.a (mon.0) 15252 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:40:08.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:07 smithi049 bash[23528]: audit 2024-09-21T05:40:07.135940+0000 mgr.a (mgr.14388) 19291 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:40:09.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:09 smithi044 bash[22676]: cluster 2024-09-21T05:40:07.429639+0000 mgr.a (mgr.14388) 19292 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:09.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:09 smithi044 bash[22676]: audit 2024-09-21T05:40:07.904159+0000 mgr.a (mgr.14388) 19293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:40:09.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:09 smithi044 bash[22676]: cephadm 2024-09-21T05:40:07.905424+0000 mgr.a (mgr.14388) 19294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:40:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:09 smithi179 bash[23186]: cluster 2024-09-21T05:40:07.429639+0000 mgr.a (mgr.14388) 19292 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:09 smithi179 bash[23186]: audit 2024-09-21T05:40:07.904159+0000 mgr.a (mgr.14388) 19293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:40:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:09 smithi179 bash[23186]: cephadm 2024-09-21T05:40:07.905424+0000 mgr.a (mgr.14388) 19294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:40:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:09 smithi049 bash[23528]: cluster 2024-09-21T05:40:07.429639+0000 mgr.a (mgr.14388) 19292 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:09 smithi049 bash[23528]: audit 2024-09-21T05:40:07.904159+0000 mgr.a (mgr.14388) 19293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:40:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:09 smithi049 bash[23528]: cephadm 2024-09-21T05:40:07.905424+0000 mgr.a (mgr.14388) 19294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:40:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:11 smithi179 bash[23186]: cluster 2024-09-21T05:40:09.430667+0000 mgr.a (mgr.14388) 19295 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:40:11.326 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:11.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:11.327 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:11.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:11 smithi044 bash[22676]: cluster 2024-09-21T05:40:09.430667+0000 mgr.a (mgr.14388) 19295 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:40:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:11 smithi049 bash[23528]: cluster 2024-09-21T05:40:09.430667+0000 mgr.a (mgr.14388) 19295 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:40:12.116 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:12.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:12.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:12.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:12.116 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:12 smithi049 bash[23528]: audit 2024-09-21T05:40:11.262651+0000 mon.a (mon.0) 15253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:12 smithi049 bash[23528]: audit 2024-09-21T05:40:11.270756+0000 mon.a (mon.0) 15254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:12 smithi049 bash[23528]: audit 2024-09-21T05:40:11.281061+0000 mon.a (mon.0) 15255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:12 smithi049 bash[23528]: audit 2024-09-21T05:40:11.370339+0000 mon.a (mon.0) 15256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:12 smithi049 bash[23528]: audit 2024-09-21T05:40:11.376845+0000 mon.a (mon.0) 15257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:12 smithi049 bash[23528]: audit 2024-09-21T05:40:11.387338+0000 mon.a (mon.0) 15258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:12 smithi044 bash[22676]: audit 2024-09-21T05:40:11.262651+0000 mon.a (mon.0) 15253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:12 smithi044 bash[22676]: audit 2024-09-21T05:40:11.270756+0000 mon.a (mon.0) 15254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:12 smithi044 bash[22676]: audit 2024-09-21T05:40:11.281061+0000 mon.a (mon.0) 15255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:12 smithi044 bash[22676]: audit 2024-09-21T05:40:11.370339+0000 mon.a (mon.0) 15256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:12 smithi044 bash[22676]: audit 2024-09-21T05:40:11.376845+0000 mon.a (mon.0) 15257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:12 smithi044 bash[22676]: audit 2024-09-21T05:40:11.387338+0000 mon.a (mon.0) 15258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:12 smithi179 bash[23186]: audit 2024-09-21T05:40:11.262651+0000 mon.a (mon.0) 15253 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:12 smithi179 bash[23186]: audit 2024-09-21T05:40:11.270756+0000 mon.a (mon.0) 15254 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:12 smithi179 bash[23186]: audit 2024-09-21T05:40:11.281061+0000 mon.a (mon.0) 15255 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:12 smithi179 bash[23186]: audit 2024-09-21T05:40:11.370339+0000 mon.a (mon.0) 15256 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:12 smithi179 bash[23186]: audit 2024-09-21T05:40:11.376845+0000 mon.a (mon.0) 15257 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:12 smithi179 bash[23186]: audit 2024-09-21T05:40:11.387338+0000 mon.a (mon.0) 15258 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:13 smithi049 bash[23528]: cluster 2024-09-21T05:40:11.431772+0000 mgr.a (mgr.14388) 19296 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:13 smithi049 bash[23528]: audit 2024-09-21T05:40:11.665002+0000 mgr.a (mgr.14388) 19297 : audit [DBG] from='client.414141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:13 smithi044 bash[22676]: cluster 2024-09-21T05:40:11.431772+0000 mgr.a (mgr.14388) 19296 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:13 smithi044 bash[22676]: audit 2024-09-21T05:40:11.665002+0000 mgr.a (mgr.14388) 19297 : audit [DBG] from='client.414141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:13.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:13 smithi179 bash[23186]: cluster 2024-09-21T05:40:11.431772+0000 mgr.a (mgr.14388) 19296 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:13 smithi179 bash[23186]: audit 2024-09-21T05:40:11.665002+0000 mgr.a (mgr.14388) 19297 : audit [DBG] from='client.414141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:15 smithi049 bash[23528]: cluster 2024-09-21T05:40:13.432649+0000 mgr.a (mgr.14388) 19298 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:15 smithi044 bash[22676]: cluster 2024-09-21T05:40:13.432649+0000 mgr.a (mgr.14388) 19298 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:15 smithi179 bash[23186]: cluster 2024-09-21T05:40:13.432649+0000 mgr.a (mgr.14388) 19298 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:17 smithi049 bash[23528]: cluster 2024-09-21T05:40:15.434897+0000 mgr.a (mgr.14388) 19299 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:17.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:17 smithi044 bash[22676]: cluster 2024-09-21T05:40:15.434897+0000 mgr.a (mgr.14388) 19299 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:17 smithi179 bash[23186]: cluster 2024-09-21T05:40:15.434897+0000 mgr.a (mgr.14388) 19299 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:17.909 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:17.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:17.909 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:17.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:17.910 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:18 smithi049 bash[23528]: cluster 2024-09-21T05:40:17.435627+0000 mgr.a (mgr.14388) 19300 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:18 smithi049 bash[23528]: audit 2024-09-21T05:40:17.458956+0000 mgr.a (mgr.14388) 19301 : audit [DBG] from='client.414219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:18 smithi044 bash[22676]: cluster 2024-09-21T05:40:17.435627+0000 mgr.a (mgr.14388) 19300 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:18 smithi044 bash[22676]: audit 2024-09-21T05:40:17.458956+0000 mgr.a (mgr.14388) 19301 : audit [DBG] from='client.414219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:18 smithi179 bash[23186]: cluster 2024-09-21T05:40:17.435627+0000 mgr.a (mgr.14388) 19300 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:18.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:18 smithi179 bash[23186]: audit 2024-09-21T05:40:17.458956+0000 mgr.a (mgr.14388) 19301 : audit [DBG] from='client.414219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:20 smithi049 bash[23528]: cluster 2024-09-21T05:40:19.436514+0000 mgr.a (mgr.14388) 19302 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:20 smithi179 bash[23186]: cluster 2024-09-21T05:40:19.436514+0000 mgr.a (mgr.14388) 19302 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:20 smithi044 bash[22676]: cluster 2024-09-21T05:40:19.436514+0000 mgr.a (mgr.14388) 19302 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:23 smithi049 bash[23528]: cluster 2024-09-21T05:40:21.438810+0000 mgr.a (mgr.14388) 19303 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:23 smithi049 bash[23528]: audit 2024-09-21T05:40:22.030878+0000 mon.a (mon.0) 15259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:23 smithi049 bash[23528]: audit 2024-09-21T05:40:22.040524+0000 mon.a (mon.0) 15260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:23 smithi049 bash[23528]: audit 2024-09-21T05:40:22.050933+0000 mon.a (mon.0) 15261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:23 smithi044 bash[22676]: cluster 2024-09-21T05:40:21.438810+0000 mgr.a (mgr.14388) 19303 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:23.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:23 smithi044 bash[22676]: audit 2024-09-21T05:40:22.030878+0000 mon.a (mon.0) 15259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:23 smithi044 bash[22676]: audit 2024-09-21T05:40:22.040524+0000 mon.a (mon.0) 15260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:23 smithi044 bash[22676]: audit 2024-09-21T05:40:22.050933+0000 mon.a (mon.0) 15261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:23 smithi179 bash[23186]: cluster 2024-09-21T05:40:21.438810+0000 mgr.a (mgr.14388) 19303 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:40:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:23 smithi179 bash[23186]: audit 2024-09-21T05:40:22.030878+0000 mon.a (mon.0) 15259 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:23 smithi179 bash[23186]: audit 2024-09-21T05:40:22.040524+0000 mon.a (mon.0) 15260 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:23 smithi179 bash[23186]: audit 2024-09-21T05:40:22.050933+0000 mon.a (mon.0) 15261 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:23.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:24 smithi049 bash[23528]: audit 2024-09-21T05:40:23.250207+0000 mgr.a (mgr.14388) 19304 : audit [DBG] from='client.414297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:24.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:24 smithi044 bash[22676]: audit 2024-09-21T05:40:23.250207+0000 mgr.a (mgr.14388) 19304 : audit [DBG] from='client.414297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:24.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:24 smithi179 bash[23186]: audit 2024-09-21T05:40:23.250207+0000 mgr.a (mgr.14388) 19304 : audit [DBG] from='client.414297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:25 smithi044 bash[22676]: cluster 2024-09-21T05:40:23.439269+0000 mgr.a (mgr.14388) 19305 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:25 smithi049 bash[23528]: cluster 2024-09-21T05:40:23.439269+0000 mgr.a (mgr.14388) 19305 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:25.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:25 smithi179 bash[23186]: cluster 2024-09-21T05:40:23.439269+0000 mgr.a (mgr.14388) 19305 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:27 smithi049 bash[23528]: cluster 2024-09-21T05:40:25.441542+0000 mgr.a (mgr.14388) 19306 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:27.324 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:27 smithi044 bash[22676]: cluster 2024-09-21T05:40:25.441542+0000 mgr.a (mgr.14388) 19306 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:27 smithi179 bash[23186]: cluster 2024-09-21T05:40:25.441542+0000 mgr.a (mgr.14388) 19306 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:28.709 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:29 smithi179 bash[23186]: cluster 2024-09-21T05:40:27.442341+0000 mgr.a (mgr.14388) 19307 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:29 smithi049 bash[23528]: cluster 2024-09-21T05:40:27.442341+0000 mgr.a (mgr.14388) 19307 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:29.340 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:29 smithi044 bash[22676]: cluster 2024-09-21T05:40:27.442341+0000 mgr.a (mgr.14388) 19307 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:29.488 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:29.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:29.488 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:29.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:29.489 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:30.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:30 smithi044 bash[22676]: audit 2024-09-21T05:40:29.045892+0000 mgr.a (mgr.14388) 19308 : audit [DBG] from='client.414369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:30 smithi179 bash[23186]: audit 2024-09-21T05:40:29.045892+0000 mgr.a (mgr.14388) 19308 : audit [DBG] from='client.414369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:30 smithi049 bash[23528]: audit 2024-09-21T05:40:29.045892+0000 mgr.a (mgr.14388) 19308 : audit [DBG] from='client.414369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.424 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:31 smithi179 bash[23186]: cluster 2024-09-21T05:40:29.443036+0000 mgr.a (mgr.14388) 19309 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:31 smithi044 bash[22676]: cluster 2024-09-21T05:40:29.443036+0000 mgr.a (mgr.14388) 19309 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:31 smithi049 bash[23528]: cluster 2024-09-21T05:40:29.443036+0000 mgr.a (mgr.14388) 19309 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:32 smithi179 bash[23186]: cluster 2024-09-21T05:40:31.445326+0000 mgr.a (mgr.14388) 19310 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:32 smithi179 bash[23186]: audit 2024-09-21T05:40:31.499508+0000 mon.a (mon.0) 15262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:32 smithi179 bash[23186]: audit 2024-09-21T05:40:31.525462+0000 mon.a (mon.0) 15263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:32 smithi179 bash[23186]: audit 2024-09-21T05:40:31.537182+0000 mon.a (mon.0) 15264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:32 smithi179 bash[23186]: audit 2024-09-21T05:40:31.609299+0000 mon.a (mon.0) 15265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:32 smithi179 bash[23186]: audit 2024-09-21T05:40:31.617993+0000 mon.a (mon.0) 15266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:32 smithi179 bash[23186]: audit 2024-09-21T05:40:31.629403+0000 mon.a (mon.0) 15267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:32 smithi049 bash[23528]: cluster 2024-09-21T05:40:31.445326+0000 mgr.a (mgr.14388) 19310 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:32 smithi049 bash[23528]: audit 2024-09-21T05:40:31.499508+0000 mon.a (mon.0) 15262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:32 smithi049 bash[23528]: audit 2024-09-21T05:40:31.525462+0000 mon.a (mon.0) 15263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:32 smithi049 bash[23528]: audit 2024-09-21T05:40:31.537182+0000 mon.a (mon.0) 15264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:32 smithi049 bash[23528]: audit 2024-09-21T05:40:31.609299+0000 mon.a (mon.0) 15265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:32 smithi049 bash[23528]: audit 2024-09-21T05:40:31.617993+0000 mon.a (mon.0) 15266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:32 smithi049 bash[23528]: audit 2024-09-21T05:40:31.629403+0000 mon.a (mon.0) 15267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:32 smithi044 bash[22676]: cluster 2024-09-21T05:40:31.445326+0000 mgr.a (mgr.14388) 19310 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:32 smithi044 bash[22676]: audit 2024-09-21T05:40:31.499508+0000 mon.a (mon.0) 15262 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:32 smithi044 bash[22676]: audit 2024-09-21T05:40:31.525462+0000 mon.a (mon.0) 15263 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:32 smithi044 bash[22676]: audit 2024-09-21T05:40:31.537182+0000 mon.a (mon.0) 15264 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:32 smithi044 bash[22676]: audit 2024-09-21T05:40:31.609299+0000 mon.a (mon.0) 15265 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:32 smithi044 bash[22676]: audit 2024-09-21T05:40:31.617993+0000 mon.a (mon.0) 15266 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:32 smithi044 bash[22676]: audit 2024-09-21T05:40:31.629403+0000 mon.a (mon.0) 15267 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:34.490 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:34.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:34.491 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:34 smithi049 bash[23528]: cluster 2024-09-21T05:40:33.446089+0000 mgr.a (mgr.14388) 19311 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:34.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:34 smithi044 bash[22676]: cluster 2024-09-21T05:40:33.446089+0000 mgr.a (mgr.14388) 19311 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:35.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:34 smithi179 bash[23186]: cluster 2024-09-21T05:40:33.446089+0000 mgr.a (mgr.14388) 19311 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:35.270 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:35.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:35.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:35.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:35.271 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:35 smithi049 bash[23528]: audit 2024-09-21T05:40:34.825355+0000 mgr.a (mgr.14388) 19312 : audit [DBG] from='client.414444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:35.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:35 smithi044 bash[22676]: audit 2024-09-21T05:40:34.825355+0000 mgr.a (mgr.14388) 19312 : audit [DBG] from='client.414444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:36.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:35 smithi179 bash[23186]: audit 2024-09-21T05:40:34.825355+0000 mgr.a (mgr.14388) 19312 : audit [DBG] from='client.414444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:36 smithi049 bash[23528]: cluster 2024-09-21T05:40:35.449073+0000 mgr.a (mgr.14388) 19313 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:40:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:36 smithi044 bash[22676]: cluster 2024-09-21T05:40:35.449073+0000 mgr.a (mgr.14388) 19313 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:40:37.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:36 smithi179 bash[23186]: cluster 2024-09-21T05:40:35.449073+0000 mgr.a (mgr.14388) 19313 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:40:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:38 smithi049 bash[23528]: cluster 2024-09-21T05:40:37.449875+0000 mgr.a (mgr.14388) 19314 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:40:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:38 smithi044 bash[22676]: cluster 2024-09-21T05:40:37.449875+0000 mgr.a (mgr.14388) 19314 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:40:39.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:38 smithi179 bash[23186]: cluster 2024-09-21T05:40:37.449875+0000 mgr.a (mgr.14388) 19314 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:40:40.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:40.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:40 smithi049 bash[23528]: cluster 2024-09-21T05:40:39.450680+0000 mgr.a (mgr.14388) 19315 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:40:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:40 smithi044 bash[22676]: cluster 2024-09-21T05:40:39.450680+0000 mgr.a (mgr.14388) 19315 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:40:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:40 smithi179 bash[23186]: cluster 2024-09-21T05:40:39.450680+0000 mgr.a (mgr.14388) 19315 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:40:41.052 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:41 smithi049 bash[23528]: audit 2024-09-21T05:40:40.604852+0000 mgr.a (mgr.14388) 19316 : audit [DBG] from='client.414522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:41 smithi044 bash[22676]: audit 2024-09-21T05:40:40.604852+0000 mgr.a (mgr.14388) 19316 : audit [DBG] from='client.414522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:41 smithi179 bash[23186]: audit 2024-09-21T05:40:40.604852+0000 mgr.a (mgr.14388) 19316 : audit [DBG] from='client.414522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:43 smithi179 bash[23186]: cluster 2024-09-21T05:40:41.453774+0000 mgr.a (mgr.14388) 19317 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:43 smithi179 bash[23186]: audit 2024-09-21T05:40:42.255098+0000 mon.a (mon.0) 15268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:43 smithi179 bash[23186]: audit 2024-09-21T05:40:42.264018+0000 mon.a (mon.0) 15269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:43 smithi179 bash[23186]: audit 2024-09-21T05:40:42.274926+0000 mon.a (mon.0) 15270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:43 smithi049 bash[23528]: cluster 2024-09-21T05:40:41.453774+0000 mgr.a (mgr.14388) 19317 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:43 smithi049 bash[23528]: audit 2024-09-21T05:40:42.255098+0000 mon.a (mon.0) 15268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:43 smithi049 bash[23528]: audit 2024-09-21T05:40:42.264018+0000 mon.a (mon.0) 15269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:43 smithi049 bash[23528]: audit 2024-09-21T05:40:42.274926+0000 mon.a (mon.0) 15270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:43 smithi044 bash[22676]: cluster 2024-09-21T05:40:41.453774+0000 mgr.a (mgr.14388) 19317 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:43 smithi044 bash[22676]: audit 2024-09-21T05:40:42.255098+0000 mon.a (mon.0) 15268 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:43 smithi044 bash[22676]: audit 2024-09-21T05:40:42.264018+0000 mon.a (mon.0) 15269 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:43 smithi044 bash[22676]: audit 2024-09-21T05:40:42.274926+0000 mon.a (mon.0) 15270 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:45 smithi049 bash[23528]: cluster 2024-09-21T05:40:43.454583+0000 mgr.a (mgr.14388) 19318 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:45.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:45 smithi044 bash[22676]: cluster 2024-09-21T05:40:43.454583+0000 mgr.a (mgr.14388) 19318 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:45.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:45 smithi179 bash[23186]: cluster 2024-09-21T05:40:43.454583+0000 mgr.a (mgr.14388) 19318 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:40:46.053 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:46.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:46.055 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:46.848 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:46.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:46.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:46.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:46.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:47 smithi049 bash[23528]: cluster 2024-09-21T05:40:45.455914+0000 mgr.a (mgr.14388) 19319 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:47 smithi044 bash[22676]: cluster 2024-09-21T05:40:45.455914+0000 mgr.a (mgr.14388) 19319 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:47 smithi179 bash[23186]: cluster 2024-09-21T05:40:45.455914+0000 mgr.a (mgr.14388) 19319 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:48.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:48 smithi179 bash[23186]: audit 2024-09-21T05:40:46.385819+0000 mgr.a (mgr.14388) 19320 : audit [DBG] from='client.414600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:48.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:48 smithi049 bash[23528]: audit 2024-09-21T05:40:46.385819+0000 mgr.a (mgr.14388) 19320 : audit [DBG] from='client.414600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:48 smithi044 bash[22676]: audit 2024-09-21T05:40:46.385819+0000 mgr.a (mgr.14388) 19320 : audit [DBG] from='client.414600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:49.481 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:49 smithi179 bash[23186]: cluster 2024-09-21T05:40:47.456882+0000 mgr.a (mgr.14388) 19321 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:40:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:49 smithi049 bash[23528]: cluster 2024-09-21T05:40:47.456882+0000 mgr.a (mgr.14388) 19321 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:40:49.607 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:49 smithi044 bash[22676]: cluster 2024-09-21T05:40:47.456882+0000 mgr.a (mgr.14388) 19321 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:40:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:51 smithi049 bash[23528]: cluster 2024-09-21T05:40:49.457748+0000 mgr.a (mgr.14388) 19322 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:40:51.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:51 smithi179 bash[23186]: cluster 2024-09-21T05:40:49.457748+0000 mgr.a (mgr.14388) 19322 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:40:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:51 smithi044 bash[22676]: cluster 2024-09-21T05:40:49.457748+0000 mgr.a (mgr.14388) 19322 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:40:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:52.603 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:52.603 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: cluster 2024-09-21T05:40:51.459992+0000 mgr.a (mgr.14388) 19323 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:40:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: audit 2024-09-21T05:40:51.751311+0000 mon.a (mon.0) 15271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: audit 2024-09-21T05:40:51.759534+0000 mon.a (mon.0) 15272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: audit 2024-09-21T05:40:51.770143+0000 mon.a (mon.0) 15273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: audit 2024-09-21T05:40:51.784881+0000 mon.a (mon.0) 15274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: audit 2024-09-21T05:40:51.793173+0000 mon.a (mon.0) 15275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: audit 2024-09-21T05:40:51.803075+0000 mon.a (mon.0) 15276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:52 smithi179 bash[23186]: audit 2024-09-21T05:40:52.175045+0000 mgr.a (mgr.14388) 19324 : audit [DBG] from='client.414678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: cluster 2024-09-21T05:40:51.459992+0000 mgr.a (mgr.14388) 19323 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:40:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: audit 2024-09-21T05:40:51.751311+0000 mon.a (mon.0) 15271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: audit 2024-09-21T05:40:51.759534+0000 mon.a (mon.0) 15272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: audit 2024-09-21T05:40:51.770143+0000 mon.a (mon.0) 15273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: audit 2024-09-21T05:40:51.784881+0000 mon.a (mon.0) 15274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: audit 2024-09-21T05:40:51.793173+0000 mon.a (mon.0) 15275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: audit 2024-09-21T05:40:51.803075+0000 mon.a (mon.0) 15276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:52 smithi049 bash[23528]: audit 2024-09-21T05:40:52.175045+0000 mgr.a (mgr.14388) 19324 : audit [DBG] from='client.414678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: cluster 2024-09-21T05:40:51.459992+0000 mgr.a (mgr.14388) 19323 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: audit 2024-09-21T05:40:51.751311+0000 mon.a (mon.0) 15271 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: audit 2024-09-21T05:40:51.759534+0000 mon.a (mon.0) 15272 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: audit 2024-09-21T05:40:51.770143+0000 mon.a (mon.0) 15273 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: audit 2024-09-21T05:40:51.784881+0000 mon.a (mon.0) 15274 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: audit 2024-09-21T05:40:51.793173+0000 mon.a (mon.0) 15275 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: audit 2024-09-21T05:40:51.803075+0000 mon.a (mon.0) 15276 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:40:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:52 smithi044 bash[22676]: audit 2024-09-21T05:40:52.175045+0000 mgr.a (mgr.14388) 19324 : audit [DBG] from='client.414678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:55.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:54 smithi179 bash[23186]: cluster 2024-09-21T05:40:53.460995+0000 mgr.a (mgr.14388) 19325 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:54 smithi049 bash[23528]: cluster 2024-09-21T05:40:53.460995+0000 mgr.a (mgr.14388) 19325 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:55.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:54 smithi044 bash[22676]: cluster 2024-09-21T05:40:53.460995+0000 mgr.a (mgr.14388) 19325 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:56 smithi049 bash[23528]: cluster 2024-09-21T05:40:55.463175+0000 mgr.a (mgr.14388) 19326 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:57.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:56 smithi044 bash[22676]: cluster 2024-09-21T05:40:55.463175+0000 mgr.a (mgr.14388) 19326 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:57.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:56 smithi179 bash[23186]: cluster 2024-09-21T05:40:55.463175+0000 mgr.a (mgr.14388) 19326 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:40:57.604 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:40:57.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:40:57.605 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:40:58.381 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:40:58.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:40:58.381 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:40:58.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:40:58.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:40:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:58 smithi049 bash[23528]: cluster 2024-09-21T05:40:57.463949+0000 mgr.a (mgr.14388) 19327 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:40:58 smithi049 bash[23528]: audit 2024-09-21T05:40:57.938148+0000 mgr.a (mgr.14388) 19328 : audit [DBG] from='client.414750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:59.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:58 smithi044 bash[22676]: cluster 2024-09-21T05:40:57.463949+0000 mgr.a (mgr.14388) 19327 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:40:58 smithi044 bash[22676]: audit 2024-09-21T05:40:57.938148+0000 mgr.a (mgr.14388) 19328 : audit [DBG] from='client.414750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:58 smithi179 bash[23186]: cluster 2024-09-21T05:40:57.463949+0000 mgr.a (mgr.14388) 19327 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:40:59.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:40:58 smithi179 bash[23186]: audit 2024-09-21T05:40:57.938148+0000 mgr.a (mgr.14388) 19328 : audit [DBG] from='client.414750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:00 smithi049 bash[23528]: cluster 2024-09-21T05:40:59.464945+0000 mgr.a (mgr.14388) 19329 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:01.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:00 smithi044 bash[22676]: cluster 2024-09-21T05:40:59.464945+0000 mgr.a (mgr.14388) 19329 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:00 smithi179 bash[23186]: cluster 2024-09-21T05:40:59.464945+0000 mgr.a (mgr.14388) 19329 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:03.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:02 smithi049 bash[23528]: cluster 2024-09-21T05:41:01.467224+0000 mgr.a (mgr.14388) 19330 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:03.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:02 smithi049 bash[23528]: audit 2024-09-21T05:41:02.469941+0000 mon.a (mon.0) 15277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:02 smithi049 bash[23528]: audit 2024-09-21T05:41:02.479636+0000 mon.a (mon.0) 15278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.028 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:02 smithi049 bash[23528]: audit 2024-09-21T05:41:02.489934+0000 mon.a (mon.0) 15279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:02 smithi044 bash[22676]: cluster 2024-09-21T05:41:01.467224+0000 mgr.a (mgr.14388) 19330 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:02 smithi044 bash[22676]: audit 2024-09-21T05:41:02.469941+0000 mon.a (mon.0) 15277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:02 smithi044 bash[22676]: audit 2024-09-21T05:41:02.479636+0000 mon.a (mon.0) 15278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:02 smithi044 bash[22676]: audit 2024-09-21T05:41:02.489934+0000 mon.a (mon.0) 15279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:02 smithi179 bash[23186]: cluster 2024-09-21T05:41:01.467224+0000 mgr.a (mgr.14388) 19330 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:02 smithi179 bash[23186]: audit 2024-09-21T05:41:02.469941+0000 mon.a (mon.0) 15277 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:02 smithi179 bash[23186]: audit 2024-09-21T05:41:02.479636+0000 mon.a (mon.0) 15278 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:02 smithi179 bash[23186]: audit 2024-09-21T05:41:02.489934+0000 mon.a (mon.0) 15279 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:03.382 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:03.384 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:04.157 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:04.157 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:04.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:04.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:04.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:04 smithi049 bash[23528]: cluster 2024-09-21T05:41:03.467863+0000 mgr.a (mgr.14388) 19331 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:04 smithi049 bash[23528]: audit 2024-09-21T05:41:03.720631+0000 mgr.a (mgr.14388) 19332 : audit [DBG] from='client.414825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:04 smithi044 bash[22676]: cluster 2024-09-21T05:41:03.467863+0000 mgr.a (mgr.14388) 19331 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:04 smithi044 bash[22676]: audit 2024-09-21T05:41:03.720631+0000 mgr.a (mgr.14388) 19332 : audit [DBG] from='client.414825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:04 smithi179 bash[23186]: cluster 2024-09-21T05:41:03.467863+0000 mgr.a (mgr.14388) 19331 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:04 smithi179 bash[23186]: audit 2024-09-21T05:41:03.720631+0000 mgr.a (mgr.14388) 19332 : audit [DBG] from='client.414825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:06 smithi049 bash[23528]: cluster 2024-09-21T05:41:05.470235+0000 mgr.a (mgr.14388) 19333 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:07.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:06 smithi044 bash[22676]: cluster 2024-09-21T05:41:05.470235+0000 mgr.a (mgr.14388) 19333 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:06 smithi179 bash[23186]: cluster 2024-09-21T05:41:05.470235+0000 mgr.a (mgr.14388) 19333 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:08 smithi049 bash[23528]: cluster 2024-09-21T05:41:07.470981+0000 mgr.a (mgr.14388) 19334 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:08 smithi049 bash[23528]: audit 2024-09-21T05:41:07.960744+0000 mon.a (mon.0) 15280 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:41:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:08 smithi049 bash[23528]: audit 2024-09-21T05:41:07.968061+0000 mon.a (mon.0) 15281 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:41:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:08 smithi049 bash[23528]: audit 2024-09-21T05:41:07.970003+0000 mon.a (mon.0) 15282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:41:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:08 smithi049 bash[23528]: audit 2024-09-21T05:41:07.981838+0000 mon.a (mon.0) 15283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:08 smithi049 bash[23528]: audit 2024-09-21T05:41:07.988336+0000 mon.a (mon.0) 15284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:41:09.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:08 smithi049 bash[23528]: audit 2024-09-21T05:41:07.990775+0000 mgr.a (mgr.14388) 19335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:41:09.124 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22930]: debug 2024-09-21T05:41:08.803+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:41:09.124 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22930]: debug 2024-09-21T05:41:08.803+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:41:09.125 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22676]: cluster 2024-09-21T05:41:07.470981+0000 mgr.a (mgr.14388) 19334 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:09.125 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22676]: audit 2024-09-21T05:41:07.960744+0000 mon.a (mon.0) 15280 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:41:09.125 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22676]: audit 2024-09-21T05:41:07.968061+0000 mon.a (mon.0) 15281 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:41:09.125 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22676]: audit 2024-09-21T05:41:07.970003+0000 mon.a (mon.0) 15282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:41:09.125 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22676]: audit 2024-09-21T05:41:07.981838+0000 mon.a (mon.0) 15283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:09.125 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22676]: audit 2024-09-21T05:41:07.988336+0000 mon.a (mon.0) 15284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:41:09.125 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:08 smithi044 bash[22676]: audit 2024-09-21T05:41:07.990775+0000 mgr.a (mgr.14388) 19335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:41:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:08 smithi179 bash[23186]: cluster 2024-09-21T05:41:07.470981+0000 mgr.a (mgr.14388) 19334 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:08 smithi179 bash[23186]: audit 2024-09-21T05:41:07.960744+0000 mon.a (mon.0) 15280 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:08 smithi179 bash[23186]: audit 2024-09-21T05:41:07.968061+0000 mon.a (mon.0) 15281 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:08 smithi179 bash[23186]: audit 2024-09-21T05:41:07.970003+0000 mon.a (mon.0) 15282 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:08 smithi179 bash[23186]: audit 2024-09-21T05:41:07.981838+0000 mon.a (mon.0) 15283 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:08 smithi179 bash[23186]: audit 2024-09-21T05:41:07.988336+0000 mon.a (mon.0) 15284 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:41:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:08 smithi179 bash[23186]: audit 2024-09-21T05:41:07.990775+0000 mgr.a (mgr.14388) 19335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:41:09.891 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:09.892 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:09 smithi179 bash[23186]: audit 2024-09-21T05:41:08.805783+0000 mgr.a (mgr.14388) 19336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:41:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:09 smithi179 bash[23186]: cephadm 2024-09-21T05:41:08.807430+0000 mgr.a (mgr.14388) 19337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:41:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:09 smithi044 bash[22676]: audit 2024-09-21T05:41:08.805783+0000 mgr.a (mgr.14388) 19336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:41:10.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:09 smithi044 bash[22676]: cephadm 2024-09-21T05:41:08.807430+0000 mgr.a (mgr.14388) 19337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:41:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:09 smithi049 bash[23528]: audit 2024-09-21T05:41:08.805783+0000 mgr.a (mgr.14388) 19336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:41:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:09 smithi049 bash[23528]: cephadm 2024-09-21T05:41:08.807430+0000 mgr.a (mgr.14388) 19337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:41:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:10 smithi044 bash[22676]: cluster 2024-09-21T05:41:09.471552+0000 mgr.a (mgr.14388) 19338 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:10 smithi044 bash[22676]: audit 2024-09-21T05:41:09.477897+0000 mgr.a (mgr.14388) 19339 : audit [DBG] from='client.415005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:10 smithi179 bash[23186]: cluster 2024-09-21T05:41:09.471552+0000 mgr.a (mgr.14388) 19338 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:10 smithi179 bash[23186]: audit 2024-09-21T05:41:09.477897+0000 mgr.a (mgr.14388) 19339 : audit [DBG] from='client.415005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:10 smithi049 bash[23528]: cluster 2024-09-21T05:41:09.471552+0000 mgr.a (mgr.14388) 19338 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:10 smithi049 bash[23528]: audit 2024-09-21T05:41:09.477897+0000 mgr.a (mgr.14388) 19339 : audit [DBG] from='client.415005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:12 smithi044 bash[22676]: cluster 2024-09-21T05:41:11.473986+0000 mgr.a (mgr.14388) 19340 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:12 smithi044 bash[22676]: audit 2024-09-21T05:41:11.942925+0000 mon.a (mon.0) 15285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:12 smithi044 bash[22676]: audit 2024-09-21T05:41:11.950552+0000 mon.a (mon.0) 15286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:12 smithi044 bash[22676]: audit 2024-09-21T05:41:11.961665+0000 mon.a (mon.0) 15287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:12 smithi044 bash[22676]: audit 2024-09-21T05:41:11.992767+0000 mon.a (mon.0) 15288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:12 smithi044 bash[22676]: audit 2024-09-21T05:41:12.001950+0000 mon.a (mon.0) 15289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:12 smithi044 bash[22676]: audit 2024-09-21T05:41:12.013395+0000 mon.a (mon.0) 15290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:12 smithi179 bash[23186]: cluster 2024-09-21T05:41:11.473986+0000 mgr.a (mgr.14388) 19340 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:12 smithi179 bash[23186]: audit 2024-09-21T05:41:11.942925+0000 mon.a (mon.0) 15285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:12 smithi179 bash[23186]: audit 2024-09-21T05:41:11.950552+0000 mon.a (mon.0) 15286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:12 smithi179 bash[23186]: audit 2024-09-21T05:41:11.961665+0000 mon.a (mon.0) 15287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:12 smithi179 bash[23186]: audit 2024-09-21T05:41:11.992767+0000 mon.a (mon.0) 15288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:12 smithi179 bash[23186]: audit 2024-09-21T05:41:12.001950+0000 mon.a (mon.0) 15289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:12 smithi179 bash[23186]: audit 2024-09-21T05:41:12.013395+0000 mon.a (mon.0) 15290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:12 smithi049 bash[23528]: cluster 2024-09-21T05:41:11.473986+0000 mgr.a (mgr.14388) 19340 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:12 smithi049 bash[23528]: audit 2024-09-21T05:41:11.942925+0000 mon.a (mon.0) 15285 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:12 smithi049 bash[23528]: audit 2024-09-21T05:41:11.950552+0000 mon.a (mon.0) 15286 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:12 smithi049 bash[23528]: audit 2024-09-21T05:41:11.961665+0000 mon.a (mon.0) 15287 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:12 smithi049 bash[23528]: audit 2024-09-21T05:41:11.992767+0000 mon.a (mon.0) 15288 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:12 smithi049 bash[23528]: audit 2024-09-21T05:41:12.001950+0000 mon.a (mon.0) 15289 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:12 smithi049 bash[23528]: audit 2024-09-21T05:41:12.013395+0000 mon.a (mon.0) 15290 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:14.893 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:14.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:14.894 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:14 smithi044 bash[22676]: cluster 2024-09-21T05:41:13.474803+0000 mgr.a (mgr.14388) 19341 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:15.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:14 smithi179 bash[23186]: cluster 2024-09-21T05:41:13.474803+0000 mgr.a (mgr.14388) 19341 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:14 smithi049 bash[23528]: cluster 2024-09-21T05:41:13.474803+0000 mgr.a (mgr.14388) 19341 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:15.653 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:15.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:15.653 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:15.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:15.654 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:15 smithi044 bash[22676]: audit 2024-09-21T05:41:15.226915+0000 mgr.a (mgr.14388) 19342 : audit [DBG] from='client.415083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:16.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:15 smithi179 bash[23186]: audit 2024-09-21T05:41:15.226915+0000 mgr.a (mgr.14388) 19342 : audit [DBG] from='client.415083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:15 smithi049 bash[23528]: audit 2024-09-21T05:41:15.226915+0000 mgr.a (mgr.14388) 19342 : audit [DBG] from='client.415083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:16 smithi044 bash[22676]: cluster 2024-09-21T05:41:15.476192+0000 mgr.a (mgr.14388) 19343 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:16 smithi179 bash[23186]: cluster 2024-09-21T05:41:15.476192+0000 mgr.a (mgr.14388) 19343 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:16 smithi049 bash[23528]: cluster 2024-09-21T05:41:15.476192+0000 mgr.a (mgr.14388) 19343 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:18 smithi049 bash[23528]: cluster 2024-09-21T05:41:17.477098+0000 mgr.a (mgr.14388) 19344 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:41:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:18 smithi044 bash[22676]: cluster 2024-09-21T05:41:17.477098+0000 mgr.a (mgr.14388) 19344 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:41:19.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:18 smithi179 bash[23186]: cluster 2024-09-21T05:41:17.477098+0000 mgr.a (mgr.14388) 19344 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:41:20.655 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:20.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:20.656 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:20 smithi044 bash[22676]: cluster 2024-09-21T05:41:19.478055+0000 mgr.a (mgr.14388) 19345 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:41:21.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:20 smithi179 bash[23186]: cluster 2024-09-21T05:41:19.478055+0000 mgr.a (mgr.14388) 19345 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:41:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:20 smithi049 bash[23528]: cluster 2024-09-21T05:41:19.478055+0000 mgr.a (mgr.14388) 19345 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:41:21.436 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:21.436 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:21.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:21.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:21.437 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:21 smithi044 bash[22676]: audit 2024-09-21T05:41:20.992018+0000 mgr.a (mgr.14388) 19346 : audit [DBG] from='client.415161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:22.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:21 smithi179 bash[23186]: audit 2024-09-21T05:41:20.992018+0000 mgr.a (mgr.14388) 19346 : audit [DBG] from='client.415161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:21 smithi049 bash[23528]: audit 2024-09-21T05:41:20.992018+0000 mgr.a (mgr.14388) 19346 : audit [DBG] from='client.415161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:22 smithi044 bash[22676]: cluster 2024-09-21T05:41:21.479666+0000 mgr.a (mgr.14388) 19347 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:22 smithi044 bash[22676]: audit 2024-09-21T05:41:22.694550+0000 mon.a (mon.0) 15291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:22 smithi044 bash[22676]: audit 2024-09-21T05:41:22.704532+0000 mon.a (mon.0) 15292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:22 smithi044 bash[22676]: audit 2024-09-21T05:41:22.716409+0000 mon.a (mon.0) 15293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:22 smithi179 bash[23186]: cluster 2024-09-21T05:41:21.479666+0000 mgr.a (mgr.14388) 19347 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:22 smithi179 bash[23186]: audit 2024-09-21T05:41:22.694550+0000 mon.a (mon.0) 15291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:22 smithi179 bash[23186]: audit 2024-09-21T05:41:22.704532+0000 mon.a (mon.0) 15292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:22 smithi179 bash[23186]: audit 2024-09-21T05:41:22.716409+0000 mon.a (mon.0) 15293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:22 smithi049 bash[23528]: cluster 2024-09-21T05:41:21.479666+0000 mgr.a (mgr.14388) 19347 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:41:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:22 smithi049 bash[23528]: audit 2024-09-21T05:41:22.694550+0000 mon.a (mon.0) 15291 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:22 smithi049 bash[23528]: audit 2024-09-21T05:41:22.704532+0000 mon.a (mon.0) 15292 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:23.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:22 smithi049 bash[23528]: audit 2024-09-21T05:41:22.716409+0000 mon.a (mon.0) 15293 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:24 smithi044 bash[22676]: cluster 2024-09-21T05:41:23.480418+0000 mgr.a (mgr.14388) 19348 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:41:25.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:24 smithi179 bash[23186]: cluster 2024-09-21T05:41:23.480418+0000 mgr.a (mgr.14388) 19348 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:41:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:24 smithi049 bash[23528]: cluster 2024-09-21T05:41:23.480418+0000 mgr.a (mgr.14388) 19348 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:41:26.438 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:26.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:26.439 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:27.216 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:27.216 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:27.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:27.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:27.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:26 smithi179 bash[23186]: cluster 2024-09-21T05:41:25.482485+0000 mgr.a (mgr.14388) 19349 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:26 smithi049 bash[23528]: cluster 2024-09-21T05:41:25.482485+0000 mgr.a (mgr.14388) 19349 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:27.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:26 smithi044 bash[22676]: cluster 2024-09-21T05:41:25.482485+0000 mgr.a (mgr.14388) 19349 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:28.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:27 smithi179 bash[23186]: audit 2024-09-21T05:41:26.773272+0000 mgr.a (mgr.14388) 19350 : audit [DBG] from='client.415233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:27 smithi049 bash[23528]: audit 2024-09-21T05:41:26.773272+0000 mgr.a (mgr.14388) 19350 : audit [DBG] from='client.415233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:28.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:27 smithi044 bash[22676]: audit 2024-09-21T05:41:26.773272+0000 mgr.a (mgr.14388) 19350 : audit [DBG] from='client.415233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:29.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:29 smithi179 bash[23186]: cluster 2024-09-21T05:41:27.483415+0000 mgr.a (mgr.14388) 19351 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:29 smithi049 bash[23528]: cluster 2024-09-21T05:41:27.483415+0000 mgr.a (mgr.14388) 19351 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:29 smithi044 bash[22676]: cluster 2024-09-21T05:41:27.483415+0000 mgr.a (mgr.14388) 19351 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:31 smithi179 bash[23186]: cluster 2024-09-21T05:41:29.484244+0000 mgr.a (mgr.14388) 19352 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:31 smithi049 bash[23528]: cluster 2024-09-21T05:41:29.484244+0000 mgr.a (mgr.14388) 19352 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:31.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:31 smithi044 bash[22676]: cluster 2024-09-21T05:41:29.484244+0000 mgr.a (mgr.14388) 19352 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:32.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:32.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:32.218 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:33.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:33.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:33.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:33.014 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:33.014 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:33 smithi044 bash[22676]: cluster 2024-09-21T05:41:31.486523+0000 mgr.a (mgr.14388) 19353 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:33 smithi044 bash[22676]: audit 2024-09-21T05:41:32.149662+0000 mon.a (mon.0) 15294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:33 smithi044 bash[22676]: audit 2024-09-21T05:41:32.159176+0000 mon.a (mon.0) 15295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:33 smithi044 bash[22676]: audit 2024-09-21T05:41:32.171098+0000 mon.a (mon.0) 15296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:33 smithi044 bash[22676]: audit 2024-09-21T05:41:32.215837+0000 mon.a (mon.0) 15297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:33 smithi044 bash[22676]: audit 2024-09-21T05:41:32.223366+0000 mon.a (mon.0) 15298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:33 smithi044 bash[22676]: audit 2024-09-21T05:41:32.231281+0000 mon.a (mon.0) 15299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:33 smithi179 bash[23186]: cluster 2024-09-21T05:41:31.486523+0000 mgr.a (mgr.14388) 19353 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:33 smithi179 bash[23186]: audit 2024-09-21T05:41:32.149662+0000 mon.a (mon.0) 15294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:33 smithi179 bash[23186]: audit 2024-09-21T05:41:32.159176+0000 mon.a (mon.0) 15295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:33 smithi179 bash[23186]: audit 2024-09-21T05:41:32.171098+0000 mon.a (mon.0) 15296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:33 smithi179 bash[23186]: audit 2024-09-21T05:41:32.215837+0000 mon.a (mon.0) 15297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:33 smithi179 bash[23186]: audit 2024-09-21T05:41:32.223366+0000 mon.a (mon.0) 15298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:33 smithi179 bash[23186]: audit 2024-09-21T05:41:32.231281+0000 mon.a (mon.0) 15299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:33 smithi049 bash[23528]: cluster 2024-09-21T05:41:31.486523+0000 mgr.a (mgr.14388) 19353 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:33 smithi049 bash[23528]: audit 2024-09-21T05:41:32.149662+0000 mon.a (mon.0) 15294 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:33 smithi049 bash[23528]: audit 2024-09-21T05:41:32.159176+0000 mon.a (mon.0) 15295 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:33 smithi049 bash[23528]: audit 2024-09-21T05:41:32.171098+0000 mon.a (mon.0) 15296 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:33 smithi049 bash[23528]: audit 2024-09-21T05:41:32.215837+0000 mon.a (mon.0) 15297 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:33 smithi049 bash[23528]: audit 2024-09-21T05:41:32.223366+0000 mon.a (mon.0) 15298 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:33.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:33 smithi049 bash[23528]: audit 2024-09-21T05:41:32.231281+0000 mon.a (mon.0) 15299 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:34 smithi044 bash[22676]: audit 2024-09-21T05:41:32.554189+0000 mgr.a (mgr.14388) 19354 : audit [DBG] from='client.415308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:34.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:34 smithi179 bash[23186]: audit 2024-09-21T05:41:32.554189+0000 mgr.a (mgr.14388) 19354 : audit [DBG] from='client.415308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:34 smithi049 bash[23528]: audit 2024-09-21T05:41:32.554189+0000 mgr.a (mgr.14388) 19354 : audit [DBG] from='client.415308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:35 smithi044 bash[22676]: cluster 2024-09-21T05:41:33.487559+0000 mgr.a (mgr.14388) 19355 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:35.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:35 smithi179 bash[23186]: cluster 2024-09-21T05:41:33.487559+0000 mgr.a (mgr.14388) 19355 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:35 smithi049 bash[23528]: cluster 2024-09-21T05:41:33.487559+0000 mgr.a (mgr.14388) 19355 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:37 smithi044 bash[22676]: cluster 2024-09-21T05:41:35.489788+0000 mgr.a (mgr.14388) 19356 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:37 smithi179 bash[23186]: cluster 2024-09-21T05:41:35.489788+0000 mgr.a (mgr.14388) 19356 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:37 smithi049 bash[23528]: cluster 2024-09-21T05:41:35.489788+0000 mgr.a (mgr.14388) 19356 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:38.015 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:38.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:38.016 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:38.776 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:38.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:38.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:38.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:38.777 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:39 smithi044 bash[22676]: cluster 2024-09-21T05:41:37.490565+0000 mgr.a (mgr.14388) 19357 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:39 smithi179 bash[23186]: cluster 2024-09-21T05:41:37.490565+0000 mgr.a (mgr.14388) 19357 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:39.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:39 smithi049 bash[23528]: cluster 2024-09-21T05:41:37.490565+0000 mgr.a (mgr.14388) 19357 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:40 smithi044 bash[22676]: audit 2024-09-21T05:41:38.346886+0000 mgr.a (mgr.14388) 19358 : audit [DBG] from='client.415380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:40.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:40 smithi179 bash[23186]: audit 2024-09-21T05:41:38.346886+0000 mgr.a (mgr.14388) 19358 : audit [DBG] from='client.415380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:40 smithi049 bash[23528]: audit 2024-09-21T05:41:38.346886+0000 mgr.a (mgr.14388) 19358 : audit [DBG] from='client.415380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:41 smithi044 bash[22676]: cluster 2024-09-21T05:41:39.491542+0000 mgr.a (mgr.14388) 19359 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:41 smithi179 bash[23186]: cluster 2024-09-21T05:41:39.491542+0000 mgr.a (mgr.14388) 19359 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:41.531 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:41 smithi049 bash[23528]: cluster 2024-09-21T05:41:39.491542+0000 mgr.a (mgr.14388) 19359 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:43 smithi044 bash[22676]: cluster 2024-09-21T05:41:41.494286+0000 mgr.a (mgr.14388) 19360 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:43 smithi044 bash[22676]: audit 2024-09-21T05:41:42.896591+0000 mon.a (mon.0) 15300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:43 smithi044 bash[22676]: audit 2024-09-21T05:41:42.906886+0000 mon.a (mon.0) 15301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:43 smithi044 bash[22676]: audit 2024-09-21T05:41:42.919905+0000 mon.a (mon.0) 15302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:43 smithi179 bash[23186]: cluster 2024-09-21T05:41:41.494286+0000 mgr.a (mgr.14388) 19360 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:43 smithi179 bash[23186]: audit 2024-09-21T05:41:42.896591+0000 mon.a (mon.0) 15300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:43 smithi179 bash[23186]: audit 2024-09-21T05:41:42.906886+0000 mon.a (mon.0) 15301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:43 smithi179 bash[23186]: audit 2024-09-21T05:41:42.919905+0000 mon.a (mon.0) 15302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:43 smithi049 bash[23528]: cluster 2024-09-21T05:41:41.494286+0000 mgr.a (mgr.14388) 19360 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:43 smithi049 bash[23528]: audit 2024-09-21T05:41:42.896591+0000 mon.a (mon.0) 15300 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:43 smithi049 bash[23528]: audit 2024-09-21T05:41:42.906886+0000 mon.a (mon.0) 15301 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:43 smithi049 bash[23528]: audit 2024-09-21T05:41:42.919905+0000 mon.a (mon.0) 15302 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:43.778 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:43.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:43.779 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:44.542 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:45.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:45 smithi044 bash[22676]: cluster 2024-09-21T05:41:43.495118+0000 mgr.a (mgr.14388) 19361 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:45 smithi044 bash[22676]: audit 2024-09-21T05:41:44.110451+0000 mgr.a (mgr.14388) 19362 : audit [DBG] from='client.415458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:45.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:45 smithi179 bash[23186]: cluster 2024-09-21T05:41:43.495118+0000 mgr.a (mgr.14388) 19361 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:45 smithi179 bash[23186]: audit 2024-09-21T05:41:44.110451+0000 mgr.a (mgr.14388) 19362 : audit [DBG] from='client.415458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:45 smithi049 bash[23528]: cluster 2024-09-21T05:41:43.495118+0000 mgr.a (mgr.14388) 19361 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:45 smithi049 bash[23528]: audit 2024-09-21T05:41:44.110451+0000 mgr.a (mgr.14388) 19362 : audit [DBG] from='client.415458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:47 smithi044 bash[22676]: cluster 2024-09-21T05:41:45.497979+0000 mgr.a (mgr.14388) 19363 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:47.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:47 smithi179 bash[23186]: cluster 2024-09-21T05:41:45.497979+0000 mgr.a (mgr.14388) 19363 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:47 smithi049 bash[23528]: cluster 2024-09-21T05:41:45.497979+0000 mgr.a (mgr.14388) 19363 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:41:49.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:49 smithi044 bash[22676]: cluster 2024-09-21T05:41:47.498833+0000 mgr.a (mgr.14388) 19364 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:49 smithi179 bash[23186]: cluster 2024-09-21T05:41:47.498833+0000 mgr.a (mgr.14388) 19364 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:49.544 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:49.545 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:49 smithi049 bash[23528]: cluster 2024-09-21T05:41:47.498833+0000 mgr.a (mgr.14388) 19364 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:50.342 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:50.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:50.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:50.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:50.342 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:51 smithi044 bash[22676]: cluster 2024-09-21T05:41:49.499593+0000 mgr.a (mgr.14388) 19365 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:51 smithi044 bash[22676]: audit 2024-09-21T05:41:49.878484+0000 mgr.a (mgr.14388) 19366 : audit [DBG] from='client.415536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:51 smithi179 bash[23186]: cluster 2024-09-21T05:41:49.499593+0000 mgr.a (mgr.14388) 19365 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:51.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:51 smithi179 bash[23186]: audit 2024-09-21T05:41:49.878484+0000 mgr.a (mgr.14388) 19366 : audit [DBG] from='client.415536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:51 smithi049 bash[23528]: cluster 2024-09-21T05:41:49.499593+0000 mgr.a (mgr.14388) 19365 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:51 smithi049 bash[23528]: audit 2024-09-21T05:41:49.878484+0000 mgr.a (mgr.14388) 19366 : audit [DBG] from='client.415536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:53 smithi179 bash[23186]: cluster 2024-09-21T05:41:51.502713+0000 mgr.a (mgr.14388) 19367 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:53 smithi179 bash[23186]: audit 2024-09-21T05:41:52.343080+0000 mon.a (mon.0) 15303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:53 smithi179 bash[23186]: audit 2024-09-21T05:41:52.349864+0000 mon.a (mon.0) 15304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:53 smithi179 bash[23186]: audit 2024-09-21T05:41:52.358229+0000 mon.a (mon.0) 15305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:53 smithi179 bash[23186]: audit 2024-09-21T05:41:52.420640+0000 mon.a (mon.0) 15306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:53 smithi179 bash[23186]: audit 2024-09-21T05:41:52.428496+0000 mon.a (mon.0) 15307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:53 smithi179 bash[23186]: audit 2024-09-21T05:41:52.439777+0000 mon.a (mon.0) 15308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:53 smithi044 bash[22676]: cluster 2024-09-21T05:41:51.502713+0000 mgr.a (mgr.14388) 19367 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:53 smithi044 bash[22676]: audit 2024-09-21T05:41:52.343080+0000 mon.a (mon.0) 15303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:53 smithi044 bash[22676]: audit 2024-09-21T05:41:52.349864+0000 mon.a (mon.0) 15304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:53 smithi044 bash[22676]: audit 2024-09-21T05:41:52.358229+0000 mon.a (mon.0) 15305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:53 smithi044 bash[22676]: audit 2024-09-21T05:41:52.420640+0000 mon.a (mon.0) 15306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:53 smithi044 bash[22676]: audit 2024-09-21T05:41:52.428496+0000 mon.a (mon.0) 15307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:53 smithi044 bash[22676]: audit 2024-09-21T05:41:52.439777+0000 mon.a (mon.0) 15308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:53 smithi049 bash[23528]: cluster 2024-09-21T05:41:51.502713+0000 mgr.a (mgr.14388) 19367 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:53 smithi049 bash[23528]: audit 2024-09-21T05:41:52.343080+0000 mon.a (mon.0) 15303 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:53 smithi049 bash[23528]: audit 2024-09-21T05:41:52.349864+0000 mon.a (mon.0) 15304 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:53 smithi049 bash[23528]: audit 2024-09-21T05:41:52.358229+0000 mon.a (mon.0) 15305 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:53 smithi049 bash[23528]: audit 2024-09-21T05:41:52.420640+0000 mon.a (mon.0) 15306 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:53 smithi049 bash[23528]: audit 2024-09-21T05:41:52.428496+0000 mon.a (mon.0) 15307 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:53.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:53 smithi049 bash[23528]: audit 2024-09-21T05:41:52.439777+0000 mon.a (mon.0) 15308 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:41:55.343 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:41:55.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:41:55.344 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:41:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:55 smithi044 bash[22676]: cluster 2024-09-21T05:41:53.503450+0000 mgr.a (mgr.14388) 19368 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:41:55.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:55 smithi179 bash[23186]: cluster 2024-09-21T05:41:53.503450+0000 mgr.a (mgr.14388) 19368 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:41:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:55 smithi049 bash[23528]: cluster 2024-09-21T05:41:53.503450+0000 mgr.a (mgr.14388) 19368 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:41:56.111 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:41:56.111 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:41:56.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:41:56.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:41:56.112 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:41:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:57 smithi044 bash[22676]: cluster 2024-09-21T05:41:55.505567+0000 mgr.a (mgr.14388) 19369 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:57 smithi044 bash[22676]: audit 2024-09-21T05:41:55.681170+0000 mgr.a (mgr.14388) 19370 : audit [DBG] from='client.415614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:57 smithi179 bash[23186]: cluster 2024-09-21T05:41:55.505567+0000 mgr.a (mgr.14388) 19369 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:57 smithi179 bash[23186]: audit 2024-09-21T05:41:55.681170+0000 mgr.a (mgr.14388) 19370 : audit [DBG] from='client.415614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:57 smithi049 bash[23528]: cluster 2024-09-21T05:41:55.505567+0000 mgr.a (mgr.14388) 19369 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:41:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:57 smithi049 bash[23528]: audit 2024-09-21T05:41:55.681170+0000 mgr.a (mgr.14388) 19370 : audit [DBG] from='client.415614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:41:59 smithi044 bash[22676]: cluster 2024-09-21T05:41:57.506507+0000 mgr.a (mgr.14388) 19371 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:41:59.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:41:59 smithi179 bash[23186]: cluster 2024-09-21T05:41:57.506507+0000 mgr.a (mgr.14388) 19371 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:41:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:41:59 smithi049 bash[23528]: cluster 2024-09-21T05:41:57.506507+0000 mgr.a (mgr.14388) 19371 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:01.113 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:01 smithi044 bash[22676]: cluster 2024-09-21T05:41:59.507316+0000 mgr.a (mgr.14388) 19372 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:01 smithi179 bash[23186]: cluster 2024-09-21T05:41:59.507316+0000 mgr.a (mgr.14388) 19372 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:01 smithi049 bash[23528]: cluster 2024-09-21T05:41:59.507316+0000 mgr.a (mgr.14388) 19372 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:01.901 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:01.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:01.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:01.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:01.901 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:03.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:03 smithi049 bash[23528]: audit 2024-09-21T05:42:01.449703+0000 mgr.a (mgr.14388) 19373 : audit [DBG] from='client.415689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:03.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:03 smithi049 bash[23528]: cluster 2024-09-21T05:42:01.510490+0000 mgr.a (mgr.14388) 19374 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:03.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:03 smithi049 bash[23528]: audit 2024-09-21T05:42:03.112216+0000 mon.a (mon.0) 15309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:03 smithi049 bash[23528]: audit 2024-09-21T05:42:03.122325+0000 mon.a (mon.0) 15310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.440 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:03 smithi049 bash[23528]: audit 2024-09-21T05:42:03.134469+0000 mon.a (mon.0) 15311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:03 smithi044 bash[22676]: audit 2024-09-21T05:42:01.449703+0000 mgr.a (mgr.14388) 19373 : audit [DBG] from='client.415689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:03 smithi044 bash[22676]: cluster 2024-09-21T05:42:01.510490+0000 mgr.a (mgr.14388) 19374 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:03 smithi044 bash[22676]: audit 2024-09-21T05:42:03.112216+0000 mon.a (mon.0) 15309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:03 smithi044 bash[22676]: audit 2024-09-21T05:42:03.122325+0000 mon.a (mon.0) 15310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:03 smithi044 bash[22676]: audit 2024-09-21T05:42:03.134469+0000 mon.a (mon.0) 15311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:03 smithi179 bash[23186]: audit 2024-09-21T05:42:01.449703+0000 mgr.a (mgr.14388) 19373 : audit [DBG] from='client.415689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:03 smithi179 bash[23186]: cluster 2024-09-21T05:42:01.510490+0000 mgr.a (mgr.14388) 19374 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:03 smithi179 bash[23186]: audit 2024-09-21T05:42:03.112216+0000 mon.a (mon.0) 15309 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:03 smithi179 bash[23186]: audit 2024-09-21T05:42:03.122325+0000 mon.a (mon.0) 15310 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:03 smithi179 bash[23186]: audit 2024-09-21T05:42:03.134469+0000 mon.a (mon.0) 15311 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:05.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:05 smithi044 bash[22676]: cluster 2024-09-21T05:42:03.511627+0000 mgr.a (mgr.14388) 19375 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:05.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:05 smithi179 bash[23186]: cluster 2024-09-21T05:42:03.511627+0000 mgr.a (mgr.14388) 19375 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:05 smithi049 bash[23528]: cluster 2024-09-21T05:42:03.511627+0000 mgr.a (mgr.14388) 19375 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:06.902 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:06.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:06.903 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:07 smithi044 bash[22676]: cluster 2024-09-21T05:42:05.513935+0000 mgr.a (mgr.14388) 19376 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:07 smithi179 bash[23186]: cluster 2024-09-21T05:42:05.513935+0000 mgr.a (mgr.14388) 19376 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:07 smithi049 bash[23528]: cluster 2024-09-21T05:42:05.513935+0000 mgr.a (mgr.14388) 19376 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:07.692 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:07.692 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:07.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:07.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:07.693 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:08 smithi179 bash[23186]: audit 2024-09-21T05:42:07.233781+0000 mgr.a (mgr.14388) 19377 : audit [DBG] from='client.415764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:08.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:08 smithi044 bash[22676]: audit 2024-09-21T05:42:07.233781+0000 mgr.a (mgr.14388) 19377 : audit [DBG] from='client.415764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:08 smithi049 bash[23528]: audit 2024-09-21T05:42:07.233781+0000 mgr.a (mgr.14388) 19377 : audit [DBG] from='client.415764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:09 smithi179 bash[23186]: cluster 2024-09-21T05:42:07.515129+0000 mgr.a (mgr.14388) 19378 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:09 smithi179 bash[23186]: audit 2024-09-21T05:42:08.884855+0000 mon.a (mon.0) 15312 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:42:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:09 smithi179 bash[23186]: audit 2024-09-21T05:42:08.892041+0000 mon.a (mon.0) 15313 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:42:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:09 smithi179 bash[23186]: audit 2024-09-21T05:42:08.893793+0000 mon.a (mon.0) 15314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:42:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:09 smithi179 bash[23186]: audit 2024-09-21T05:42:08.905451+0000 mon.a (mon.0) 15315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:09 smithi179 bash[23186]: audit 2024-09-21T05:42:08.911775+0000 mon.a (mon.0) 15316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:42:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:09 smithi049 bash[23528]: cluster 2024-09-21T05:42:07.515129+0000 mgr.a (mgr.14388) 19378 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:09 smithi049 bash[23528]: audit 2024-09-21T05:42:08.884855+0000 mon.a (mon.0) 15312 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:42:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:09 smithi049 bash[23528]: audit 2024-09-21T05:42:08.892041+0000 mon.a (mon.0) 15313 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:42:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:09 smithi049 bash[23528]: audit 2024-09-21T05:42:08.893793+0000 mon.a (mon.0) 15314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:42:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:09 smithi049 bash[23528]: audit 2024-09-21T05:42:08.905451+0000 mon.a (mon.0) 15315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:09.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:09 smithi049 bash[23528]: audit 2024-09-21T05:42:08.911775+0000 mon.a (mon.0) 15316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:42:09.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22676]: cluster 2024-09-21T05:42:07.515129+0000 mgr.a (mgr.14388) 19378 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:09.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22676]: audit 2024-09-21T05:42:08.884855+0000 mon.a (mon.0) 15312 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:42:09.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22676]: audit 2024-09-21T05:42:08.892041+0000 mon.a (mon.0) 15313 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:42:09.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22676]: audit 2024-09-21T05:42:08.893793+0000 mon.a (mon.0) 15314 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:42:09.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22676]: audit 2024-09-21T05:42:08.905451+0000 mon.a (mon.0) 15315 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:09.721 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22676]: audit 2024-09-21T05:42:08.911775+0000 mon.a (mon.0) 15316 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:42:09.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22930]: debug 2024-09-21T05:42:09.714+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:42:09.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:42:09 smithi044 bash[22930]: debug 2024-09-21T05:42:09.714+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:42:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:10 smithi049 bash[23528]: audit 2024-09-21T05:42:08.914503+0000 mgr.a (mgr.14388) 19379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:42:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:10 smithi044 bash[22676]: audit 2024-09-21T05:42:08.914503+0000 mgr.a (mgr.14388) 19379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:42:10.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:10 smithi179 bash[23186]: audit 2024-09-21T05:42:08.914503+0000 mgr.a (mgr.14388) 19379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:42:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:11 smithi044 bash[22676]: cluster 2024-09-21T05:42:09.515880+0000 mgr.a (mgr.14388) 19380 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:11 smithi044 bash[22676]: audit 2024-09-21T05:42:09.719645+0000 mgr.a (mgr.14388) 19381 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:42:11.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:11 smithi044 bash[22676]: cephadm 2024-09-21T05:42:09.720961+0000 mgr.a (mgr.14388) 19382 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:42:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:11 smithi179 bash[23186]: cluster 2024-09-21T05:42:09.515880+0000 mgr.a (mgr.14388) 19380 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:11 smithi179 bash[23186]: audit 2024-09-21T05:42:09.719645+0000 mgr.a (mgr.14388) 19381 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:42:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:11 smithi179 bash[23186]: cephadm 2024-09-21T05:42:09.720961+0000 mgr.a (mgr.14388) 19382 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:42:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:11 smithi049 bash[23528]: cluster 2024-09-21T05:42:09.515880+0000 mgr.a (mgr.14388) 19380 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:11 smithi049 bash[23528]: audit 2024-09-21T05:42:09.719645+0000 mgr.a (mgr.14388) 19381 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:42:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:11 smithi049 bash[23528]: cephadm 2024-09-21T05:42:09.720961+0000 mgr.a (mgr.14388) 19382 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:42:12.694 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:12.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:12.694 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:13.481 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:13.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:13.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:13.482 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:13.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:13 smithi179 bash[23186]: cluster 2024-09-21T05:42:11.518144+0000 mgr.a (mgr.14388) 19383 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:13.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:13 smithi179 bash[23186]: audit 2024-09-21T05:42:12.519037+0000 mon.a (mon.0) 15317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:13 smithi179 bash[23186]: audit 2024-09-21T05:42:12.524680+0000 mon.a (mon.0) 15318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:13 smithi179 bash[23186]: audit 2024-09-21T05:42:12.534459+0000 mon.a (mon.0) 15319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:13 smithi179 bash[23186]: audit 2024-09-21T05:42:12.665213+0000 mon.a (mon.0) 15320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:13 smithi179 bash[23186]: audit 2024-09-21T05:42:12.673190+0000 mon.a (mon.0) 15321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:13 smithi179 bash[23186]: audit 2024-09-21T05:42:12.684843+0000 mon.a (mon.0) 15322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:13 smithi049 bash[23528]: cluster 2024-09-21T05:42:11.518144+0000 mgr.a (mgr.14388) 19383 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:13 smithi049 bash[23528]: audit 2024-09-21T05:42:12.519037+0000 mon.a (mon.0) 15317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:13 smithi049 bash[23528]: audit 2024-09-21T05:42:12.524680+0000 mon.a (mon.0) 15318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:13 smithi049 bash[23528]: audit 2024-09-21T05:42:12.534459+0000 mon.a (mon.0) 15319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:13 smithi049 bash[23528]: audit 2024-09-21T05:42:12.665213+0000 mon.a (mon.0) 15320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:13 smithi049 bash[23528]: audit 2024-09-21T05:42:12.673190+0000 mon.a (mon.0) 15321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:13 smithi049 bash[23528]: audit 2024-09-21T05:42:12.684843+0000 mon.a (mon.0) 15322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:13 smithi044 bash[22676]: cluster 2024-09-21T05:42:11.518144+0000 mgr.a (mgr.14388) 19383 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:13 smithi044 bash[22676]: audit 2024-09-21T05:42:12.519037+0000 mon.a (mon.0) 15317 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:13 smithi044 bash[22676]: audit 2024-09-21T05:42:12.524680+0000 mon.a (mon.0) 15318 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:13 smithi044 bash[22676]: audit 2024-09-21T05:42:12.534459+0000 mon.a (mon.0) 15319 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:13 smithi044 bash[22676]: audit 2024-09-21T05:42:12.665213+0000 mon.a (mon.0) 15320 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:13 smithi044 bash[22676]: audit 2024-09-21T05:42:12.673190+0000 mon.a (mon.0) 15321 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:13 smithi044 bash[22676]: audit 2024-09-21T05:42:12.684843+0000 mon.a (mon.0) 15322 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:14 smithi049 bash[23528]: audit 2024-09-21T05:42:13.030296+0000 mgr.a (mgr.14388) 19384 : audit [DBG] from='client.415944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:14 smithi044 bash[22676]: audit 2024-09-21T05:42:13.030296+0000 mgr.a (mgr.14388) 19384 : audit [DBG] from='client.415944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:14.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:14 smithi179 bash[23186]: audit 2024-09-21T05:42:13.030296+0000 mgr.a (mgr.14388) 19384 : audit [DBG] from='client.415944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:15 smithi049 bash[23528]: cluster 2024-09-21T05:42:13.519198+0000 mgr.a (mgr.14388) 19385 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:15 smithi044 bash[22676]: cluster 2024-09-21T05:42:13.519198+0000 mgr.a (mgr.14388) 19385 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:15.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:15 smithi179 bash[23186]: cluster 2024-09-21T05:42:13.519198+0000 mgr.a (mgr.14388) 19385 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:17 smithi049 bash[23528]: cluster 2024-09-21T05:42:15.521513+0000 mgr.a (mgr.14388) 19386 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:17 smithi044 bash[22676]: cluster 2024-09-21T05:42:15.521513+0000 mgr.a (mgr.14388) 19386 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:17 smithi179 bash[23186]: cluster 2024-09-21T05:42:15.521513+0000 mgr.a (mgr.14388) 19386 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:18.483 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:18.483 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:18.484 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:19.276 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:19.276 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:19.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:19 smithi049 bash[23528]: cluster 2024-09-21T05:42:17.522298+0000 mgr.a (mgr.14388) 19387 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:19 smithi044 bash[22676]: cluster 2024-09-21T05:42:17.522298+0000 mgr.a (mgr.14388) 19387 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:19 smithi179 bash[23186]: cluster 2024-09-21T05:42:17.522298+0000 mgr.a (mgr.14388) 19387 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:20.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:20 smithi049 bash[23528]: audit 2024-09-21T05:42:18.820202+0000 mgr.a (mgr.14388) 19388 : audit [DBG] from='client.416019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:20 smithi044 bash[22676]: audit 2024-09-21T05:42:18.820202+0000 mgr.a (mgr.14388) 19388 : audit [DBG] from='client.416019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:20.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:20 smithi179 bash[23186]: audit 2024-09-21T05:42:18.820202+0000 mgr.a (mgr.14388) 19388 : audit [DBG] from='client.416019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:21 smithi049 bash[23528]: cluster 2024-09-21T05:42:19.523264+0000 mgr.a (mgr.14388) 19389 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:21 smithi044 bash[22676]: cluster 2024-09-21T05:42:19.523264+0000 mgr.a (mgr.14388) 19389 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:21 smithi179 bash[23186]: cluster 2024-09-21T05:42:19.523264+0000 mgr.a (mgr.14388) 19389 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:23 smithi049 bash[23528]: cluster 2024-09-21T05:42:21.525589+0000 mgr.a (mgr.14388) 19390 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:23 smithi044 bash[22676]: cluster 2024-09-21T05:42:21.525589+0000 mgr.a (mgr.14388) 19390 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:23 smithi179 bash[23186]: cluster 2024-09-21T05:42:21.525589+0000 mgr.a (mgr.14388) 19390 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:42:24.277 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:24.278 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:24.278 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:24.715 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:24 smithi049 bash[23528]: audit 2024-09-21T05:42:23.351870+0000 mon.a (mon.0) 15323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.715 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:24 smithi049 bash[23528]: audit 2024-09-21T05:42:23.361817+0000 mon.a (mon.0) 15324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.715 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:24 smithi049 bash[23528]: audit 2024-09-21T05:42:23.373677+0000 mon.a (mon.0) 15325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.715 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:24 smithi049 bash[23528]: cluster 2024-09-21T05:42:23.526364+0000 mgr.a (mgr.14388) 19391 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:24 smithi044 bash[22676]: audit 2024-09-21T05:42:23.351870+0000 mon.a (mon.0) 15323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:24 smithi044 bash[22676]: audit 2024-09-21T05:42:23.361817+0000 mon.a (mon.0) 15324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:24 smithi044 bash[22676]: audit 2024-09-21T05:42:23.373677+0000 mon.a (mon.0) 15325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:24 smithi044 bash[22676]: cluster 2024-09-21T05:42:23.526364+0000 mgr.a (mgr.14388) 19391 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:24 smithi179 bash[23186]: audit 2024-09-21T05:42:23.351870+0000 mon.a (mon.0) 15323 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:24 smithi179 bash[23186]: audit 2024-09-21T05:42:23.361817+0000 mon.a (mon.0) 15324 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:24 smithi179 bash[23186]: audit 2024-09-21T05:42:23.373677+0000 mon.a (mon.0) 15325 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:24 smithi179 bash[23186]: cluster 2024-09-21T05:42:23.526364+0000 mgr.a (mgr.14388) 19391 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:25.055 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:25.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:25 smithi044 bash[22676]: audit 2024-09-21T05:42:24.608337+0000 mgr.a (mgr.14388) 19392 : audit [DBG] from='client.416094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:25 smithi179 bash[23186]: audit 2024-09-21T05:42:24.608337+0000 mgr.a (mgr.14388) 19392 : audit [DBG] from='client.416094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:25 smithi049 bash[23528]: audit 2024-09-21T05:42:24.608337+0000 mgr.a (mgr.14388) 19392 : audit [DBG] from='client.416094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:26 smithi044 bash[22676]: cluster 2024-09-21T05:42:25.528911+0000 mgr.a (mgr.14388) 19393 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:26.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:26 smithi179 bash[23186]: cluster 2024-09-21T05:42:25.528911+0000 mgr.a (mgr.14388) 19393 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:26 smithi049 bash[23528]: cluster 2024-09-21T05:42:25.528911+0000 mgr.a (mgr.14388) 19393 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:28 smithi044 bash[22676]: cluster 2024-09-21T05:42:27.529762+0000 mgr.a (mgr.14388) 19394 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:29.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:28 smithi179 bash[23186]: cluster 2024-09-21T05:42:27.529762+0000 mgr.a (mgr.14388) 19394 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:28 smithi049 bash[23528]: cluster 2024-09-21T05:42:27.529762+0000 mgr.a (mgr.14388) 19394 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:30.057 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:30.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:30.058 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:30.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:30 smithi179 bash[23186]: cluster 2024-09-21T05:42:29.530550+0000 mgr.a (mgr.14388) 19395 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:30.828 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:30.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:30.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:30 smithi044 bash[22676]: cluster 2024-09-21T05:42:29.530550+0000 mgr.a (mgr.14388) 19395 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:30 smithi049 bash[23528]: cluster 2024-09-21T05:42:29.530550+0000 mgr.a (mgr.14388) 19395 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:31 smithi179 bash[23186]: audit 2024-09-21T05:42:30.386329+0000 mgr.a (mgr.14388) 19396 : audit [DBG] from='client.416169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:31 smithi044 bash[22676]: audit 2024-09-21T05:42:30.386329+0000 mgr.a (mgr.14388) 19396 : audit [DBG] from='client.416169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:31 smithi049 bash[23528]: audit 2024-09-21T05:42:30.386329+0000 mgr.a (mgr.14388) 19396 : audit [DBG] from='client.416169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:32.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:32 smithi179 bash[23186]: cluster 2024-09-21T05:42:31.533658+0000 mgr.a (mgr.14388) 19397 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:32.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:32 smithi044 bash[22676]: cluster 2024-09-21T05:42:31.533658+0000 mgr.a (mgr.14388) 19397 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:32 smithi049 bash[23528]: cluster 2024-09-21T05:42:31.533658+0000 mgr.a (mgr.14388) 19397 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:33 smithi044 bash[22676]: audit 2024-09-21T05:42:32.729760+0000 mon.a (mon.0) 15326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:33 smithi044 bash[22676]: audit 2024-09-21T05:42:32.737189+0000 mon.a (mon.0) 15327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:33 smithi044 bash[22676]: audit 2024-09-21T05:42:32.746864+0000 mon.a (mon.0) 15328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:33 smithi044 bash[22676]: audit 2024-09-21T05:42:32.856179+0000 mon.a (mon.0) 15329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:33 smithi044 bash[22676]: audit 2024-09-21T05:42:32.863136+0000 mon.a (mon.0) 15330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:33.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:33 smithi044 bash[22676]: audit 2024-09-21T05:42:32.873177+0000 mon.a (mon.0) 15331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:33 smithi179 bash[23186]: audit 2024-09-21T05:42:32.729760+0000 mon.a (mon.0) 15326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:33 smithi179 bash[23186]: audit 2024-09-21T05:42:32.737189+0000 mon.a (mon.0) 15327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:33 smithi179 bash[23186]: audit 2024-09-21T05:42:32.746864+0000 mon.a (mon.0) 15328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:33 smithi179 bash[23186]: audit 2024-09-21T05:42:32.856179+0000 mon.a (mon.0) 15329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:33 smithi179 bash[23186]: audit 2024-09-21T05:42:32.863136+0000 mon.a (mon.0) 15330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:33 smithi179 bash[23186]: audit 2024-09-21T05:42:32.873177+0000 mon.a (mon.0) 15331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:33 smithi049 bash[23528]: audit 2024-09-21T05:42:32.729760+0000 mon.a (mon.0) 15326 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:33 smithi049 bash[23528]: audit 2024-09-21T05:42:32.737189+0000 mon.a (mon.0) 15327 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:33 smithi049 bash[23528]: audit 2024-09-21T05:42:32.746864+0000 mon.a (mon.0) 15328 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:33 smithi049 bash[23528]: audit 2024-09-21T05:42:32.856179+0000 mon.a (mon.0) 15329 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:33 smithi049 bash[23528]: audit 2024-09-21T05:42:32.863136+0000 mon.a (mon.0) 15330 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:34.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:33 smithi049 bash[23528]: audit 2024-09-21T05:42:32.873177+0000 mon.a (mon.0) 15331 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:34 smithi044 bash[22676]: cluster 2024-09-21T05:42:33.534451+0000 mgr.a (mgr.14388) 19398 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:35.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:34 smithi179 bash[23186]: cluster 2024-09-21T05:42:33.534451+0000 mgr.a (mgr.14388) 19398 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:34 smithi049 bash[23528]: cluster 2024-09-21T05:42:33.534451+0000 mgr.a (mgr.14388) 19398 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:35.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:35.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:35.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:36.588 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:36.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:36.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:36.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:36.588 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:36 smithi044 bash[22676]: cluster 2024-09-21T05:42:35.536376+0000 mgr.a (mgr.14388) 19399 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:36 smithi044 bash[22676]: audit 2024-09-21T05:42:36.160390+0000 mgr.a (mgr.14388) 19400 : audit [DBG] from='client.416247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:36 smithi179 bash[23186]: cluster 2024-09-21T05:42:35.536376+0000 mgr.a (mgr.14388) 19399 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:36 smithi179 bash[23186]: audit 2024-09-21T05:42:36.160390+0000 mgr.a (mgr.14388) 19400 : audit [DBG] from='client.416247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:36 smithi049 bash[23528]: cluster 2024-09-21T05:42:35.536376+0000 mgr.a (mgr.14388) 19399 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:36 smithi049 bash[23528]: audit 2024-09-21T05:42:36.160390+0000 mgr.a (mgr.14388) 19400 : audit [DBG] from='client.416247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:39.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:38 smithi044 bash[22676]: cluster 2024-09-21T05:42:37.537466+0000 mgr.a (mgr.14388) 19401 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:39.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:38 smithi179 bash[23186]: cluster 2024-09-21T05:42:37.537466+0000 mgr.a (mgr.14388) 19401 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:38 smithi049 bash[23528]: cluster 2024-09-21T05:42:37.537466+0000 mgr.a (mgr.14388) 19401 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:41.206 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:40 smithi049 bash[23528]: cluster 2024-09-21T05:42:39.538292+0000 mgr.a (mgr.14388) 19402 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:41.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:40 smithi044 bash[22676]: cluster 2024-09-21T05:42:39.538292+0000 mgr.a (mgr.14388) 19402 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:40 smithi179 bash[23186]: cluster 2024-09-21T05:42:39.538292+0000 mgr.a (mgr.14388) 19402 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:42:41.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:41.590 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:42.384 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:42.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:42.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:42.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:42.384 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:42 smithi049 bash[23528]: cluster 2024-09-21T05:42:41.540543+0000 mgr.a (mgr.14388) 19403 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:42 smithi049 bash[23528]: audit 2024-09-21T05:42:41.928811+0000 mgr.a (mgr.14388) 19404 : audit [DBG] from='client.416322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:42 smithi044 bash[22676]: cluster 2024-09-21T05:42:41.540543+0000 mgr.a (mgr.14388) 19403 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:42 smithi044 bash[22676]: audit 2024-09-21T05:42:41.928811+0000 mgr.a (mgr.14388) 19404 : audit [DBG] from='client.416322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:42 smithi179 bash[23186]: cluster 2024-09-21T05:42:41.540543+0000 mgr.a (mgr.14388) 19403 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:42 smithi179 bash[23186]: audit 2024-09-21T05:42:41.928811+0000 mgr.a (mgr.14388) 19404 : audit [DBG] from='client.416322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:44 smithi049 bash[23528]: cluster 2024-09-21T05:42:43.541464+0000 mgr.a (mgr.14388) 19405 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:44 smithi049 bash[23528]: audit 2024-09-21T05:42:43.562070+0000 mon.a (mon.0) 15332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:44 smithi049 bash[23528]: audit 2024-09-21T05:42:43.571995+0000 mon.a (mon.0) 15333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:44.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:44 smithi049 bash[23528]: audit 2024-09-21T05:42:43.584087+0000 mon.a (mon.0) 15334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:44.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:44 smithi044 bash[22676]: cluster 2024-09-21T05:42:43.541464+0000 mgr.a (mgr.14388) 19405 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:44 smithi044 bash[22676]: audit 2024-09-21T05:42:43.562070+0000 mon.a (mon.0) 15332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:44 smithi044 bash[22676]: audit 2024-09-21T05:42:43.571995+0000 mon.a (mon.0) 15333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:44.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:44 smithi044 bash[22676]: audit 2024-09-21T05:42:43.584087+0000 mon.a (mon.0) 15334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:45.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:44 smithi179 bash[23186]: cluster 2024-09-21T05:42:43.541464+0000 mgr.a (mgr.14388) 19405 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:44 smithi179 bash[23186]: audit 2024-09-21T05:42:43.562070+0000 mon.a (mon.0) 15332 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:44 smithi179 bash[23186]: audit 2024-09-21T05:42:43.571995+0000 mon.a (mon.0) 15333 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:44 smithi179 bash[23186]: audit 2024-09-21T05:42:43.584087+0000 mon.a (mon.0) 15334 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:46 smithi044 bash[22676]: cluster 2024-09-21T05:42:45.543587+0000 mgr.a (mgr.14388) 19406 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:47.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:46 smithi179 bash[23186]: cluster 2024-09-21T05:42:45.543587+0000 mgr.a (mgr.14388) 19406 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:47.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:46 smithi049 bash[23528]: cluster 2024-09-21T05:42:45.543587+0000 mgr.a (mgr.14388) 19406 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:47.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:47.386 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:48.137 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:48.927 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:48 smithi044 bash[22676]: cluster 2024-09-21T05:42:47.544044+0000 mgr.a (mgr.14388) 19407 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:48.927 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:48 smithi044 bash[22676]: audit 2024-09-21T05:42:47.717574+0000 mgr.a (mgr.14388) 19408 : audit [DBG] from='client.416400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:48 smithi179 bash[23186]: cluster 2024-09-21T05:42:47.544044+0000 mgr.a (mgr.14388) 19407 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:48 smithi179 bash[23186]: audit 2024-09-21T05:42:47.717574+0000 mgr.a (mgr.14388) 19408 : audit [DBG] from='client.416400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:48 smithi049 bash[23528]: cluster 2024-09-21T05:42:47.544044+0000 mgr.a (mgr.14388) 19407 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:48 smithi049 bash[23528]: audit 2024-09-21T05:42:47.717574+0000 mgr.a (mgr.14388) 19408 : audit [DBG] from='client.416400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:50 smithi044 bash[22676]: cluster 2024-09-21T05:42:49.544916+0000 mgr.a (mgr.14388) 19409 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:51.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:50 smithi179 bash[23186]: cluster 2024-09-21T05:42:49.544916+0000 mgr.a (mgr.14388) 19409 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:50 smithi049 bash[23528]: cluster 2024-09-21T05:42:49.544916+0000 mgr.a (mgr.14388) 19409 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:52.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:52 smithi179 bash[23186]: cluster 2024-09-21T05:42:51.546493+0000 mgr.a (mgr.14388) 19410 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:52 smithi044 bash[22676]: cluster 2024-09-21T05:42:51.546493+0000 mgr.a (mgr.14388) 19410 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:52 smithi049 bash[23528]: cluster 2024-09-21T05:42:51.546493+0000 mgr.a (mgr.14388) 19410 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:53.139 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:53.139 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:53.140 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:53.928 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:42:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:53 smithi044 bash[22676]: audit 2024-09-21T05:42:52.922987+0000 mon.a (mon.0) 15335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:53 smithi044 bash[22676]: audit 2024-09-21T05:42:52.930114+0000 mon.a (mon.0) 15336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:53 smithi044 bash[22676]: audit 2024-09-21T05:42:52.939102+0000 mon.a (mon.0) 15337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:53 smithi044 bash[22676]: audit 2024-09-21T05:42:53.066931+0000 mon.a (mon.0) 15338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:53 smithi044 bash[22676]: audit 2024-09-21T05:42:53.075725+0000 mon.a (mon.0) 15339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:53 smithi044 bash[22676]: audit 2024-09-21T05:42:53.085604+0000 mon.a (mon.0) 15340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:53 smithi179 bash[23186]: audit 2024-09-21T05:42:52.922987+0000 mon.a (mon.0) 15335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:53 smithi179 bash[23186]: audit 2024-09-21T05:42:52.930114+0000 mon.a (mon.0) 15336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:53 smithi179 bash[23186]: audit 2024-09-21T05:42:52.939102+0000 mon.a (mon.0) 15337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:53 smithi179 bash[23186]: audit 2024-09-21T05:42:53.066931+0000 mon.a (mon.0) 15338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:53 smithi179 bash[23186]: audit 2024-09-21T05:42:53.075725+0000 mon.a (mon.0) 15339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:53 smithi179 bash[23186]: audit 2024-09-21T05:42:53.085604+0000 mon.a (mon.0) 15340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:53 smithi049 bash[23528]: audit 2024-09-21T05:42:52.922987+0000 mon.a (mon.0) 15335 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:53 smithi049 bash[23528]: audit 2024-09-21T05:42:52.930114+0000 mon.a (mon.0) 15336 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:53 smithi049 bash[23528]: audit 2024-09-21T05:42:52.939102+0000 mon.a (mon.0) 15337 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:53 smithi049 bash[23528]: audit 2024-09-21T05:42:53.066931+0000 mon.a (mon.0) 15338 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:53 smithi049 bash[23528]: audit 2024-09-21T05:42:53.075725+0000 mon.a (mon.0) 15339 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:54.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:53 smithi049 bash[23528]: audit 2024-09-21T05:42:53.085604+0000 mon.a (mon.0) 15340 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:42:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:55 smithi044 bash[22676]: audit 2024-09-21T05:42:53.472942+0000 mgr.a (mgr.14388) 19411 : audit [DBG] from='client.416478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:55 smithi044 bash[22676]: cluster 2024-09-21T05:42:53.547100+0000 mgr.a (mgr.14388) 19412 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:55 smithi179 bash[23186]: audit 2024-09-21T05:42:53.472942+0000 mgr.a (mgr.14388) 19411 : audit [DBG] from='client.416478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:55.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:55 smithi179 bash[23186]: cluster 2024-09-21T05:42:53.547100+0000 mgr.a (mgr.14388) 19412 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:55 smithi049 bash[23528]: audit 2024-09-21T05:42:53.472942+0000 mgr.a (mgr.14388) 19411 : audit [DBG] from='client.416478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:55 smithi049 bash[23528]: cluster 2024-09-21T05:42:53.547100+0000 mgr.a (mgr.14388) 19412 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:57 smithi044 bash[22676]: cluster 2024-09-21T05:42:55.549595+0000 mgr.a (mgr.14388) 19413 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:57 smithi179 bash[23186]: cluster 2024-09-21T05:42:55.549595+0000 mgr.a (mgr.14388) 19413 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:57 smithi049 bash[23528]: cluster 2024-09-21T05:42:55.549595+0000 mgr.a (mgr.14388) 19413 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:42:58.930 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:42:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:42:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:42:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:42:59 smithi044 bash[22676]: cluster 2024-09-21T05:42:57.550417+0000 mgr.a (mgr.14388) 19414 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:42:59 smithi179 bash[23186]: cluster 2024-09-21T05:42:57.550417+0000 mgr.a (mgr.14388) 19414 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:42:59 smithi049 bash[23528]: cluster 2024-09-21T05:42:57.550417+0000 mgr.a (mgr.14388) 19414 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:42:59.718 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:42:59.718 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:42:59.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:42:59.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:42:59.719 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:00.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:00 smithi044 bash[22676]: audit 2024-09-21T05:42:59.265728+0000 mgr.a (mgr.14388) 19415 : audit [DBG] from='client.416556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:00 smithi179 bash[23186]: audit 2024-09-21T05:42:59.265728+0000 mgr.a (mgr.14388) 19415 : audit [DBG] from='client.416556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:00.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:00 smithi049 bash[23528]: audit 2024-09-21T05:42:59.265728+0000 mgr.a (mgr.14388) 19415 : audit [DBG] from='client.416556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:01 smithi044 bash[22676]: cluster 2024-09-21T05:42:59.551254+0000 mgr.a (mgr.14388) 19416 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:01 smithi179 bash[23186]: cluster 2024-09-21T05:42:59.551254+0000 mgr.a (mgr.14388) 19416 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:01 smithi049 bash[23528]: cluster 2024-09-21T05:42:59.551254+0000 mgr.a (mgr.14388) 19416 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:03.241 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:03 smithi049 bash[23528]: cluster 2024-09-21T05:43:01.553675+0000 mgr.a (mgr.14388) 19417 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:03.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:03 smithi044 bash[22676]: cluster 2024-09-21T05:43:01.553675+0000 mgr.a (mgr.14388) 19417 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:03.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:03 smithi179 bash[23186]: cluster 2024-09-21T05:43:01.553675+0000 mgr.a (mgr.14388) 19417 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:04.720 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:04.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:04.721 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:04 smithi049 bash[23528]: cluster 2024-09-21T05:43:03.554438+0000 mgr.a (mgr.14388) 19418 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:04 smithi049 bash[23528]: audit 2024-09-21T05:43:03.802785+0000 mon.a (mon.0) 15341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:04 smithi049 bash[23528]: audit 2024-09-21T05:43:03.811423+0000 mon.a (mon.0) 15342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:04 smithi049 bash[23528]: audit 2024-09-21T05:43:03.822201+0000 mon.a (mon.0) 15343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:04 smithi044 bash[22676]: cluster 2024-09-21T05:43:03.554438+0000 mgr.a (mgr.14388) 19418 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:04 smithi044 bash[22676]: audit 2024-09-21T05:43:03.802785+0000 mon.a (mon.0) 15341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:04 smithi044 bash[22676]: audit 2024-09-21T05:43:03.811423+0000 mon.a (mon.0) 15342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:04 smithi044 bash[22676]: audit 2024-09-21T05:43:03.822201+0000 mon.a (mon.0) 15343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:04 smithi179 bash[23186]: cluster 2024-09-21T05:43:03.554438+0000 mgr.a (mgr.14388) 19418 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:04 smithi179 bash[23186]: audit 2024-09-21T05:43:03.802785+0000 mon.a (mon.0) 15341 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:04 smithi179 bash[23186]: audit 2024-09-21T05:43:03.811423+0000 mon.a (mon.0) 15342 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:04 smithi179 bash[23186]: audit 2024-09-21T05:43:03.822201+0000 mon.a (mon.0) 15343 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:05.511 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:05.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:05 smithi049 bash[23528]: audit 2024-09-21T05:43:05.053959+0000 mgr.a (mgr.14388) 19419 : audit [DBG] from='client.416634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:05 smithi044 bash[22676]: audit 2024-09-21T05:43:05.053959+0000 mgr.a (mgr.14388) 19419 : audit [DBG] from='client.416634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:06.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:05 smithi179 bash[23186]: audit 2024-09-21T05:43:05.053959+0000 mgr.a (mgr.14388) 19419 : audit [DBG] from='client.416634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:06 smithi044 bash[22676]: cluster 2024-09-21T05:43:05.557470+0000 mgr.a (mgr.14388) 19420 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:07.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:06 smithi179 bash[23186]: cluster 2024-09-21T05:43:05.557470+0000 mgr.a (mgr.14388) 19420 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:06 smithi049 bash[23528]: cluster 2024-09-21T05:43:05.557470+0000 mgr.a (mgr.14388) 19420 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:08 smithi044 bash[22676]: cluster 2024-09-21T05:43:07.558293+0000 mgr.a (mgr.14388) 19421 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:08 smithi179 bash[23186]: cluster 2024-09-21T05:43:07.558293+0000 mgr.a (mgr.14388) 19421 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:08 smithi049 bash[23528]: cluster 2024-09-21T05:43:07.558293+0000 mgr.a (mgr.14388) 19421 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:10.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:09 smithi044 bash[22676]: audit 2024-09-21T05:43:09.782390+0000 mon.a (mon.0) 15344 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:43:10.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:09 smithi044 bash[22676]: audit 2024-09-21T05:43:09.793623+0000 mon.a (mon.0) 15345 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:43:10.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:09 smithi044 bash[22676]: audit 2024-09-21T05:43:09.795474+0000 mon.a (mon.0) 15346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:43:10.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:09 smithi044 bash[22676]: audit 2024-09-21T05:43:09.806710+0000 mon.a (mon.0) 15347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:10.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:09 smithi044 bash[22676]: audit 2024-09-21T05:43:09.813177+0000 mon.a (mon.0) 15348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:43:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:09 smithi179 bash[23186]: audit 2024-09-21T05:43:09.782390+0000 mon.a (mon.0) 15344 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:43:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:09 smithi179 bash[23186]: audit 2024-09-21T05:43:09.793623+0000 mon.a (mon.0) 15345 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:43:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:09 smithi179 bash[23186]: audit 2024-09-21T05:43:09.795474+0000 mon.a (mon.0) 15346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:43:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:09 smithi179 bash[23186]: audit 2024-09-21T05:43:09.806710+0000 mon.a (mon.0) 15347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:09 smithi179 bash[23186]: audit 2024-09-21T05:43:09.813177+0000 mon.a (mon.0) 15348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:43:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:09 smithi049 bash[23528]: audit 2024-09-21T05:43:09.782390+0000 mon.a (mon.0) 15344 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:43:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:09 smithi049 bash[23528]: audit 2024-09-21T05:43:09.793623+0000 mon.a (mon.0) 15345 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:43:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:09 smithi049 bash[23528]: audit 2024-09-21T05:43:09.795474+0000 mon.a (mon.0) 15346 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:43:10.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:09 smithi049 bash[23528]: audit 2024-09-21T05:43:09.806710+0000 mon.a (mon.0) 15347 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:10.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:09 smithi049 bash[23528]: audit 2024-09-21T05:43:09.813177+0000 mon.a (mon.0) 15348 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:43:10.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:10.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:10.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:10.988 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:43:10 smithi044 bash[22930]: debug 2024-09-21T05:43:10.609+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:43:10.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:43:10 smithi044 bash[22930]: debug 2024-09-21T05:43:10.613+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:43:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:10 smithi044 bash[22676]: cluster 2024-09-21T05:43:09.559095+0000 mgr.a (mgr.14388) 19422 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:10 smithi044 bash[22676]: audit 2024-09-21T05:43:09.815708+0000 mgr.a (mgr.14388) 19423 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:43:11.245 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:10 smithi179 bash[23186]: cluster 2024-09-21T05:43:09.559095+0000 mgr.a (mgr.14388) 19422 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:10 smithi179 bash[23186]: audit 2024-09-21T05:43:09.815708+0000 mgr.a (mgr.14388) 19423 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:43:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:10 smithi049 bash[23528]: cluster 2024-09-21T05:43:09.559095+0000 mgr.a (mgr.14388) 19422 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:11.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:10 smithi049 bash[23528]: audit 2024-09-21T05:43:09.815708+0000 mgr.a (mgr.14388) 19423 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:43:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:11 smithi044 bash[22676]: audit 2024-09-21T05:43:10.612814+0000 mgr.a (mgr.14388) 19424 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:43:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:11 smithi044 bash[22676]: cephadm 2024-09-21T05:43:10.613995+0000 mgr.a (mgr.14388) 19425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:43:12.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:11 smithi044 bash[22676]: audit 2024-09-21T05:43:10.822108+0000 mgr.a (mgr.14388) 19426 : audit [DBG] from='client.416814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:11 smithi179 bash[23186]: audit 2024-09-21T05:43:10.612814+0000 mgr.a (mgr.14388) 19424 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:43:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:11 smithi179 bash[23186]: cephadm 2024-09-21T05:43:10.613995+0000 mgr.a (mgr.14388) 19425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:43:12.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:11 smithi179 bash[23186]: audit 2024-09-21T05:43:10.822108+0000 mgr.a (mgr.14388) 19426 : audit [DBG] from='client.416814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:11 smithi049 bash[23528]: audit 2024-09-21T05:43:10.612814+0000 mgr.a (mgr.14388) 19424 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:43:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:11 smithi049 bash[23528]: cephadm 2024-09-21T05:43:10.613995+0000 mgr.a (mgr.14388) 19425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:43:12.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:11 smithi049 bash[23528]: audit 2024-09-21T05:43:10.822108+0000 mgr.a (mgr.14388) 19426 : audit [DBG] from='client.416814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:12.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:12 smithi179 bash[23186]: cluster 2024-09-21T05:43:11.560672+0000 mgr.a (mgr.14388) 19427 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:43:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:12 smithi044 bash[22676]: cluster 2024-09-21T05:43:11.560672+0000 mgr.a (mgr.14388) 19427 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:43:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:12 smithi049 bash[23528]: cluster 2024-09-21T05:43:11.560672+0000 mgr.a (mgr.14388) 19427 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:43:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:14 smithi044 bash[22676]: audit 2024-09-21T05:43:13.118174+0000 mon.a (mon.0) 15349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:14 smithi044 bash[22676]: audit 2024-09-21T05:43:13.126059+0000 mon.a (mon.0) 15350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:14 smithi044 bash[22676]: audit 2024-09-21T05:43:13.134793+0000 mon.a (mon.0) 15351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:14 smithi044 bash[22676]: audit 2024-09-21T05:43:13.251450+0000 mon.a (mon.0) 15352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:14 smithi044 bash[22676]: audit 2024-09-21T05:43:13.259891+0000 mon.a (mon.0) 15353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.490 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:14 smithi044 bash[22676]: audit 2024-09-21T05:43:13.269746+0000 mon.a (mon.0) 15354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:14 smithi179 bash[23186]: audit 2024-09-21T05:43:13.118174+0000 mon.a (mon.0) 15349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:14 smithi179 bash[23186]: audit 2024-09-21T05:43:13.126059+0000 mon.a (mon.0) 15350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:14 smithi179 bash[23186]: audit 2024-09-21T05:43:13.134793+0000 mon.a (mon.0) 15351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:14 smithi179 bash[23186]: audit 2024-09-21T05:43:13.251450+0000 mon.a (mon.0) 15352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:14 smithi179 bash[23186]: audit 2024-09-21T05:43:13.259891+0000 mon.a (mon.0) 15353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:14 smithi179 bash[23186]: audit 2024-09-21T05:43:13.269746+0000 mon.a (mon.0) 15354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:14 smithi049 bash[23528]: audit 2024-09-21T05:43:13.118174+0000 mon.a (mon.0) 15349 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:14 smithi049 bash[23528]: audit 2024-09-21T05:43:13.126059+0000 mon.a (mon.0) 15350 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:14 smithi049 bash[23528]: audit 2024-09-21T05:43:13.134793+0000 mon.a (mon.0) 15351 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:14 smithi049 bash[23528]: audit 2024-09-21T05:43:13.251450+0000 mon.a (mon.0) 15352 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:14 smithi049 bash[23528]: audit 2024-09-21T05:43:13.259891+0000 mon.a (mon.0) 15353 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:14.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:14 smithi049 bash[23528]: audit 2024-09-21T05:43:13.269746+0000 mon.a (mon.0) 15354 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:15 smithi179 bash[23186]: cluster 2024-09-21T05:43:13.561460+0000 mgr.a (mgr.14388) 19428 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:43:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:15 smithi049 bash[23528]: cluster 2024-09-21T05:43:13.561460+0000 mgr.a (mgr.14388) 19428 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:43:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:15 smithi044 bash[22676]: cluster 2024-09-21T05:43:13.561460+0000 mgr.a (mgr.14388) 19428 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:43:16.247 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:16.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:16.248 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:17.037 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:17.038 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:17 smithi049 bash[23528]: cluster 2024-09-21T05:43:15.563476+0000 mgr.a (mgr.14388) 19429 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:17 smithi044 bash[22676]: cluster 2024-09-21T05:43:15.563476+0000 mgr.a (mgr.14388) 19429 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:17 smithi179 bash[23186]: cluster 2024-09-21T05:43:15.563476+0000 mgr.a (mgr.14388) 19429 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:18 smithi049 bash[23528]: audit 2024-09-21T05:43:16.582352+0000 mgr.a (mgr.14388) 19430 : audit [DBG] from='client.416892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:18 smithi044 bash[22676]: audit 2024-09-21T05:43:16.582352+0000 mgr.a (mgr.14388) 19430 : audit [DBG] from='client.416892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:18 smithi179 bash[23186]: audit 2024-09-21T05:43:16.582352+0000 mgr.a (mgr.14388) 19430 : audit [DBG] from='client.416892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:19.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:19 smithi049 bash[23528]: cluster 2024-09-21T05:43:17.564420+0000 mgr.a (mgr.14388) 19431 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:19 smithi044 bash[22676]: cluster 2024-09-21T05:43:17.564420+0000 mgr.a (mgr.14388) 19431 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:19 smithi179 bash[23186]: cluster 2024-09-21T05:43:17.564420+0000 mgr.a (mgr.14388) 19431 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:21 smithi049 bash[23528]: cluster 2024-09-21T05:43:19.565289+0000 mgr.a (mgr.14388) 19432 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:21 smithi044 bash[22676]: cluster 2024-09-21T05:43:19.565289+0000 mgr.a (mgr.14388) 19432 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:21 smithi179 bash[23186]: cluster 2024-09-21T05:43:19.565289+0000 mgr.a (mgr.14388) 19432 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:22.040 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:22.789 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:22.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:22.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:22.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:22.789 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:23 smithi049 bash[23528]: cluster 2024-09-21T05:43:21.567545+0000 mgr.a (mgr.14388) 19433 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:23 smithi044 bash[22676]: cluster 2024-09-21T05:43:21.567545+0000 mgr.a (mgr.14388) 19433 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:23.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:23 smithi179 bash[23186]: cluster 2024-09-21T05:43:21.567545+0000 mgr.a (mgr.14388) 19433 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:24 smithi044 bash[22676]: audit 2024-09-21T05:43:22.369610+0000 mgr.a (mgr.14388) 19434 : audit [DBG] from='client.416970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:24 smithi044 bash[22676]: audit 2024-09-21T05:43:24.017817+0000 mon.a (mon.0) 15355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:24 smithi044 bash[22676]: audit 2024-09-21T05:43:24.026528+0000 mon.a (mon.0) 15356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:24 smithi044 bash[22676]: audit 2024-09-21T05:43:24.037121+0000 mon.a (mon.0) 15357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:24 smithi179 bash[23186]: audit 2024-09-21T05:43:22.369610+0000 mgr.a (mgr.14388) 19434 : audit [DBG] from='client.416970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:24 smithi179 bash[23186]: audit 2024-09-21T05:43:24.017817+0000 mon.a (mon.0) 15355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:24 smithi179 bash[23186]: audit 2024-09-21T05:43:24.026528+0000 mon.a (mon.0) 15356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:24 smithi179 bash[23186]: audit 2024-09-21T05:43:24.037121+0000 mon.a (mon.0) 15357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:24 smithi049 bash[23528]: audit 2024-09-21T05:43:22.369610+0000 mgr.a (mgr.14388) 19434 : audit [DBG] from='client.416970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:24.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:24 smithi049 bash[23528]: audit 2024-09-21T05:43:24.017817+0000 mon.a (mon.0) 15355 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:24 smithi049 bash[23528]: audit 2024-09-21T05:43:24.026528+0000 mon.a (mon.0) 15356 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:24.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:24 smithi049 bash[23528]: audit 2024-09-21T05:43:24.037121+0000 mon.a (mon.0) 15357 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:25 smithi044 bash[22676]: cluster 2024-09-21T05:43:23.568483+0000 mgr.a (mgr.14388) 19435 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:43:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:25 smithi179 bash[23186]: cluster 2024-09-21T05:43:23.568483+0000 mgr.a (mgr.14388) 19435 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:43:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:25 smithi049 bash[23528]: cluster 2024-09-21T05:43:23.568483+0000 mgr.a (mgr.14388) 19435 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:43:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:27 smithi044 bash[22676]: cluster 2024-09-21T05:43:25.570763+0000 mgr.a (mgr.14388) 19436 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:27 smithi179 bash[23186]: cluster 2024-09-21T05:43:25.570763+0000 mgr.a (mgr.14388) 19436 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:27.790 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:27.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:27.791 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:27 smithi049 bash[23528]: cluster 2024-09-21T05:43:25.570763+0000 mgr.a (mgr.14388) 19436 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:43:28.589 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:28.589 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:28.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:28.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:28.590 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:29.588 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:29 smithi044 bash[22676]: cluster 2024-09-21T05:43:27.571526+0000 mgr.a (mgr.14388) 19437 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:29.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:29 smithi044 bash[22676]: audit 2024-09-21T05:43:28.123516+0000 mgr.a (mgr.14388) 19438 : audit [DBG] from='client.417048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:29 smithi179 bash[23186]: cluster 2024-09-21T05:43:27.571526+0000 mgr.a (mgr.14388) 19437 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:29 smithi179 bash[23186]: audit 2024-09-21T05:43:28.123516+0000 mgr.a (mgr.14388) 19438 : audit [DBG] from='client.417048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:29 smithi049 bash[23528]: cluster 2024-09-21T05:43:27.571526+0000 mgr.a (mgr.14388) 19437 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:29 smithi049 bash[23528]: audit 2024-09-21T05:43:28.123516+0000 mgr.a (mgr.14388) 19438 : audit [DBG] from='client.417048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:30 smithi044 bash[22676]: cluster 2024-09-21T05:43:29.572618+0000 mgr.a (mgr.14388) 19439 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:30 smithi179 bash[23186]: cluster 2024-09-21T05:43:29.572618+0000 mgr.a (mgr.14388) 19439 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:30 smithi049 bash[23528]: cluster 2024-09-21T05:43:29.572618+0000 mgr.a (mgr.14388) 19439 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:32 smithi044 bash[22676]: cluster 2024-09-21T05:43:31.574948+0000 mgr.a (mgr.14388) 19440 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:32.904 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:32 smithi179 bash[23186]: cluster 2024-09-21T05:43:31.574948+0000 mgr.a (mgr.14388) 19440 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:32 smithi049 bash[23528]: cluster 2024-09-21T05:43:31.574948+0000 mgr.a (mgr.14388) 19440 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:33.591 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:33.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:33.592 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:34.386 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:34.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:34.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:34.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:34.386 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:34.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:34 smithi179 bash[23186]: audit 2024-09-21T05:43:33.308046+0000 mon.a (mon.0) 15358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:34 smithi179 bash[23186]: audit 2024-09-21T05:43:33.313367+0000 mon.a (mon.0) 15359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:34 smithi179 bash[23186]: audit 2024-09-21T05:43:33.319832+0000 mon.a (mon.0) 15360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:34 smithi179 bash[23186]: audit 2024-09-21T05:43:33.451907+0000 mon.a (mon.0) 15361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:34 smithi179 bash[23186]: audit 2024-09-21T05:43:33.460383+0000 mon.a (mon.0) 15362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:34 smithi179 bash[23186]: audit 2024-09-21T05:43:33.470217+0000 mon.a (mon.0) 15363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:34 smithi044 bash[22676]: audit 2024-09-21T05:43:33.308046+0000 mon.a (mon.0) 15358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:34 smithi044 bash[22676]: audit 2024-09-21T05:43:33.313367+0000 mon.a (mon.0) 15359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:34 smithi044 bash[22676]: audit 2024-09-21T05:43:33.319832+0000 mon.a (mon.0) 15360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:34 smithi044 bash[22676]: audit 2024-09-21T05:43:33.451907+0000 mon.a (mon.0) 15361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:34 smithi044 bash[22676]: audit 2024-09-21T05:43:33.460383+0000 mon.a (mon.0) 15362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:34 smithi044 bash[22676]: audit 2024-09-21T05:43:33.470217+0000 mon.a (mon.0) 15363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:34 smithi049 bash[23528]: audit 2024-09-21T05:43:33.308046+0000 mon.a (mon.0) 15358 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:34 smithi049 bash[23528]: audit 2024-09-21T05:43:33.313367+0000 mon.a (mon.0) 15359 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:34 smithi049 bash[23528]: audit 2024-09-21T05:43:33.319832+0000 mon.a (mon.0) 15360 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:34 smithi049 bash[23528]: audit 2024-09-21T05:43:33.451907+0000 mon.a (mon.0) 15361 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:34 smithi049 bash[23528]: audit 2024-09-21T05:43:33.460383+0000 mon.a (mon.0) 15362 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:34.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:34 smithi049 bash[23528]: audit 2024-09-21T05:43:33.470217+0000 mon.a (mon.0) 15363 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:35.648 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:35 smithi179 bash[23186]: cluster 2024-09-21T05:43:33.575768+0000 mgr.a (mgr.14388) 19441 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:35.648 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:35 smithi179 bash[23186]: audit 2024-09-21T05:43:33.932331+0000 mgr.a (mgr.14388) 19442 : audit [DBG] from='client.417126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:35 smithi044 bash[22676]: cluster 2024-09-21T05:43:33.575768+0000 mgr.a (mgr.14388) 19441 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:35.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:35 smithi044 bash[22676]: audit 2024-09-21T05:43:33.932331+0000 mgr.a (mgr.14388) 19442 : audit [DBG] from='client.417126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:35 smithi049 bash[23528]: cluster 2024-09-21T05:43:33.575768+0000 mgr.a (mgr.14388) 19441 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:35.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:35 smithi049 bash[23528]: audit 2024-09-21T05:43:33.932331+0000 mgr.a (mgr.14388) 19442 : audit [DBG] from='client.417126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:37.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:37 smithi044 bash[22676]: cluster 2024-09-21T05:43:35.578177+0000 mgr.a (mgr.14388) 19443 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:37.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:37 smithi179 bash[23186]: cluster 2024-09-21T05:43:35.578177+0000 mgr.a (mgr.14388) 19443 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:37.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:37 smithi049 bash[23528]: cluster 2024-09-21T05:43:35.578177+0000 mgr.a (mgr.14388) 19443 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:43:38.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:38 smithi044 bash[22676]: cluster 2024-09-21T05:43:37.578949+0000 mgr.a (mgr.14388) 19444 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:38 smithi179 bash[23186]: cluster 2024-09-21T05:43:37.578949+0000 mgr.a (mgr.14388) 19444 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:38 smithi049 bash[23528]: cluster 2024-09-21T05:43:37.578949+0000 mgr.a (mgr.14388) 19444 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:39.387 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:39.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:39.388 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:40.167 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:40 smithi044 bash[22676]: cluster 2024-09-21T05:43:39.579704+0000 mgr.a (mgr.14388) 19445 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:40.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:40 smithi044 bash[22676]: audit 2024-09-21T05:43:39.727393+0000 mgr.a (mgr.14388) 19446 : audit [DBG] from='client.417201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:40 smithi179 bash[23186]: cluster 2024-09-21T05:43:39.579704+0000 mgr.a (mgr.14388) 19445 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:41.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:40 smithi179 bash[23186]: audit 2024-09-21T05:43:39.727393+0000 mgr.a (mgr.14388) 19446 : audit [DBG] from='client.417201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:40 smithi049 bash[23528]: cluster 2024-09-21T05:43:39.579704+0000 mgr.a (mgr.14388) 19445 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:40 smithi049 bash[23528]: audit 2024-09-21T05:43:39.727393+0000 mgr.a (mgr.14388) 19446 : audit [DBG] from='client.417201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:42.990 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:42 smithi044 bash[22676]: cluster 2024-09-21T05:43:41.582119+0000 mgr.a (mgr.14388) 19447 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:43:43.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:42 smithi179 bash[23186]: cluster 2024-09-21T05:43:41.582119+0000 mgr.a (mgr.14388) 19447 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:43:43.031 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:42 smithi049 bash[23528]: cluster 2024-09-21T05:43:41.582119+0000 mgr.a (mgr.14388) 19447 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-21T05:43:45.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:45 smithi049 bash[23528]: cluster 2024-09-21T05:43:43.582926+0000 mgr.a (mgr.14388) 19448 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:43:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:45 smithi049 bash[23528]: audit 2024-09-21T05:43:44.174451+0000 mon.a (mon.0) 15364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:45 smithi049 bash[23528]: audit 2024-09-21T05:43:44.183546+0000 mon.a (mon.0) 15365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:45 smithi049 bash[23528]: audit 2024-09-21T05:43:44.193980+0000 mon.a (mon.0) 15366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:45 smithi044 bash[22676]: cluster 2024-09-21T05:43:43.582926+0000 mgr.a (mgr.14388) 19448 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:43:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:45 smithi044 bash[22676]: audit 2024-09-21T05:43:44.174451+0000 mon.a (mon.0) 15364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:45 smithi044 bash[22676]: audit 2024-09-21T05:43:44.183546+0000 mon.a (mon.0) 15365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:45 smithi044 bash[22676]: audit 2024-09-21T05:43:44.193980+0000 mon.a (mon.0) 15366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:45 smithi179 bash[23186]: cluster 2024-09-21T05:43:43.582926+0000 mgr.a (mgr.14388) 19448 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-21T05:43:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:45 smithi179 bash[23186]: audit 2024-09-21T05:43:44.174451+0000 mon.a (mon.0) 15364 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:45 smithi179 bash[23186]: audit 2024-09-21T05:43:44.183546+0000 mon.a (mon.0) 15365 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:45 smithi179 bash[23186]: audit 2024-09-21T05:43:44.193980+0000 mon.a (mon.0) 15366 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:45.962 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:45.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:45.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:45.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:45.963 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:47 smithi044 bash[22676]: audit 2024-09-21T05:43:45.507390+0000 mgr.a (mgr.14388) 19449 : audit [DBG] from='client.417276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:47 smithi044 bash[22676]: cluster 2024-09-21T05:43:45.584428+0000 mgr.a (mgr.14388) 19450 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:47 smithi179 bash[23186]: audit 2024-09-21T05:43:45.507390+0000 mgr.a (mgr.14388) 19449 : audit [DBG] from='client.417276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:47 smithi179 bash[23186]: cluster 2024-09-21T05:43:45.584428+0000 mgr.a (mgr.14388) 19450 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:47 smithi049 bash[23528]: audit 2024-09-21T05:43:45.507390+0000 mgr.a (mgr.14388) 19449 : audit [DBG] from='client.417276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:47 smithi049 bash[23528]: cluster 2024-09-21T05:43:45.584428+0000 mgr.a (mgr.14388) 19450 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:49.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:49 smithi044 bash[22676]: cluster 2024-09-21T05:43:47.585356+0000 mgr.a (mgr.14388) 19451 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:49.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:49 smithi179 bash[23186]: cluster 2024-09-21T05:43:47.585356+0000 mgr.a (mgr.14388) 19451 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:49 smithi049 bash[23528]: cluster 2024-09-21T05:43:47.585356+0000 mgr.a (mgr.14388) 19451 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:43:50.964 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:50.964 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:50.964 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:51.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:51 smithi044 bash[22676]: cluster 2024-09-21T05:43:49.586121+0000 mgr.a (mgr.14388) 19452 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:43:51.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:51 smithi179 bash[23186]: cluster 2024-09-21T05:43:49.586121+0000 mgr.a (mgr.14388) 19452 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:43:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:51 smithi049 bash[23528]: cluster 2024-09-21T05:43:49.586121+0000 mgr.a (mgr.14388) 19452 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:43:51.733 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:51.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:52.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:52 smithi044 bash[22676]: audit 2024-09-21T05:43:51.291860+0000 mgr.a (mgr.14388) 19453 : audit [DBG] from='client.417348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:52.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:52 smithi179 bash[23186]: audit 2024-09-21T05:43:51.291860+0000 mgr.a (mgr.14388) 19453 : audit [DBG] from='client.417348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:52 smithi049 bash[23528]: audit 2024-09-21T05:43:51.291860+0000 mgr.a (mgr.14388) 19453 : audit [DBG] from='client.417348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:53.445 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:53 smithi179 bash[23186]: cluster 2024-09-21T05:43:51.587951+0000 mgr.a (mgr.14388) 19454 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:53.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:53 smithi044 bash[22676]: cluster 2024-09-21T05:43:51.587951+0000 mgr.a (mgr.14388) 19454 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:53 smithi049 bash[23528]: cluster 2024-09-21T05:43:51.587951+0000 mgr.a (mgr.14388) 19454 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:54 smithi044 bash[22676]: audit 2024-09-21T05:43:53.465363+0000 mon.a (mon.0) 15367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:54 smithi044 bash[22676]: audit 2024-09-21T05:43:53.474283+0000 mon.a (mon.0) 15368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:54 smithi044 bash[22676]: audit 2024-09-21T05:43:53.483762+0000 mon.a (mon.0) 15369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:54 smithi044 bash[22676]: cluster 2024-09-21T05:43:53.588486+0000 mgr.a (mgr.14388) 19455 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:43:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:54 smithi044 bash[22676]: audit 2024-09-21T05:43:53.629645+0000 mon.a (mon.0) 15370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:54 smithi044 bash[22676]: audit 2024-09-21T05:43:53.637200+0000 mon.a (mon.0) 15371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:54 smithi044 bash[22676]: audit 2024-09-21T05:43:53.647086+0000 mon.a (mon.0) 15372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:54 smithi179 bash[23186]: audit 2024-09-21T05:43:53.465363+0000 mon.a (mon.0) 15367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:54 smithi179 bash[23186]: audit 2024-09-21T05:43:53.474283+0000 mon.a (mon.0) 15368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:54 smithi179 bash[23186]: audit 2024-09-21T05:43:53.483762+0000 mon.a (mon.0) 15369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:54 smithi179 bash[23186]: cluster 2024-09-21T05:43:53.588486+0000 mgr.a (mgr.14388) 19455 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:43:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:54 smithi179 bash[23186]: audit 2024-09-21T05:43:53.629645+0000 mon.a (mon.0) 15370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:54 smithi179 bash[23186]: audit 2024-09-21T05:43:53.637200+0000 mon.a (mon.0) 15371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:54 smithi179 bash[23186]: audit 2024-09-21T05:43:53.647086+0000 mon.a (mon.0) 15372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:54 smithi049 bash[23528]: audit 2024-09-21T05:43:53.465363+0000 mon.a (mon.0) 15367 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:54 smithi049 bash[23528]: audit 2024-09-21T05:43:53.474283+0000 mon.a (mon.0) 15368 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:54 smithi049 bash[23528]: audit 2024-09-21T05:43:53.483762+0000 mon.a (mon.0) 15369 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:54 smithi049 bash[23528]: cluster 2024-09-21T05:43:53.588486+0000 mgr.a (mgr.14388) 19455 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:43:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:54 smithi049 bash[23528]: audit 2024-09-21T05:43:53.629645+0000 mon.a (mon.0) 15370 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:54 smithi049 bash[23528]: audit 2024-09-21T05:43:53.637200+0000 mon.a (mon.0) 15371 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:54.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:54 smithi049 bash[23528]: audit 2024-09-21T05:43:53.647086+0000 mon.a (mon.0) 15372 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:43:56.735 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:43:56.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:43:56.736 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:43:56.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:56 smithi044 bash[22676]: cluster 2024-09-21T05:43:55.590640+0000 mgr.a (mgr.14388) 19456 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:43:57.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:56 smithi179 bash[23186]: cluster 2024-09-21T05:43:55.590640+0000 mgr.a (mgr.14388) 19456 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:43:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:56 smithi049 bash[23528]: cluster 2024-09-21T05:43:55.590640+0000 mgr.a (mgr.14388) 19456 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:43:57.529 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:43:57.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:43:57.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:43:57.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:43:57.530 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:43:57.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:57 smithi044 bash[22676]: audit 2024-09-21T05:43:57.067928+0000 mgr.a (mgr.14388) 19457 : audit [DBG] from='client.417426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:58.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:57 smithi179 bash[23186]: audit 2024-09-21T05:43:57.067928+0000 mgr.a (mgr.14388) 19457 : audit [DBG] from='client.417426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:58.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:57 smithi049 bash[23528]: audit 2024-09-21T05:43:57.067928+0000 mgr.a (mgr.14388) 19457 : audit [DBG] from='client.417426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:58.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:43:58 smithi044 bash[22676]: cluster 2024-09-21T05:43:57.591157+0000 mgr.a (mgr.14388) 19458 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:43:58 smithi179 bash[23186]: cluster 2024-09-21T05:43:57.591157+0000 mgr.a (mgr.14388) 19458 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:43:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:43:58 smithi049 bash[23528]: cluster 2024-09-21T05:43:57.591157+0000 mgr.a (mgr.14388) 19458 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:00.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:00 smithi044 bash[22676]: cluster 2024-09-21T05:43:59.592045+0000 mgr.a (mgr.14388) 19459 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:00 smithi179 bash[23186]: cluster 2024-09-21T05:43:59.592045+0000 mgr.a (mgr.14388) 19459 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:00 smithi049 bash[23528]: cluster 2024-09-21T05:43:59.592045+0000 mgr.a (mgr.14388) 19459 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:02.531 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:02.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:02.532 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:02.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:02 smithi044 bash[22676]: cluster 2024-09-21T05:44:01.594339+0000 mgr.a (mgr.14388) 19460 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:03.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:02 smithi179 bash[23186]: cluster 2024-09-21T05:44:01.594339+0000 mgr.a (mgr.14388) 19460 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:02 smithi049 bash[23528]: cluster 2024-09-21T05:44:01.594339+0000 mgr.a (mgr.14388) 19460 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:03.328 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:03 smithi049 bash[23528]: audit 2024-09-21T05:44:02.866398+0000 mgr.a (mgr.14388) 19461 : audit [DBG] from='client.417501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:03.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:03 smithi044 bash[22676]: audit 2024-09-21T05:44:02.866398+0000 mgr.a (mgr.14388) 19461 : audit [DBG] from='client.417501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:04.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:03 smithi179 bash[23186]: audit 2024-09-21T05:44:02.866398+0000 mgr.a (mgr.14388) 19461 : audit [DBG] from='client.417501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:04.710 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:04 smithi049 bash[23528]: cluster 2024-09-21T05:44:03.595256+0000 mgr.a (mgr.14388) 19462 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:04.710 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:04 smithi049 bash[23528]: audit 2024-09-21T05:44:04.408009+0000 mon.a (mon.0) 15373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:04.710 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:04 smithi049 bash[23528]: audit 2024-09-21T05:44:04.416753+0000 mon.a (mon.0) 15374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:04.710 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:04 smithi049 bash[23528]: audit 2024-09-21T05:44:04.428572+0000 mon.a (mon.0) 15375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:04 smithi044 bash[22676]: cluster 2024-09-21T05:44:03.595256+0000 mgr.a (mgr.14388) 19462 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:04 smithi044 bash[22676]: audit 2024-09-21T05:44:04.408009+0000 mon.a (mon.0) 15373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:04 smithi044 bash[22676]: audit 2024-09-21T05:44:04.416753+0000 mon.a (mon.0) 15374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:04.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:04 smithi044 bash[22676]: audit 2024-09-21T05:44:04.428572+0000 mon.a (mon.0) 15375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:04 smithi179 bash[23186]: cluster 2024-09-21T05:44:03.595256+0000 mgr.a (mgr.14388) 19462 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:04 smithi179 bash[23186]: audit 2024-09-21T05:44:04.408009+0000 mon.a (mon.0) 15373 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:04 smithi179 bash[23186]: audit 2024-09-21T05:44:04.416753+0000 mon.a (mon.0) 15374 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:04 smithi179 bash[23186]: audit 2024-09-21T05:44:04.428572+0000 mon.a (mon.0) 15375 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:06.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:06 smithi044 bash[22676]: cluster 2024-09-21T05:44:05.597457+0000 mgr.a (mgr.14388) 19463 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:07.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:06 smithi179 bash[23186]: cluster 2024-09-21T05:44:05.597457+0000 mgr.a (mgr.14388) 19463 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:06 smithi049 bash[23528]: cluster 2024-09-21T05:44:05.597457+0000 mgr.a (mgr.14388) 19463 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:08.329 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:08.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:08.330 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:08.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:08 smithi044 bash[22676]: cluster 2024-09-21T05:44:07.598260+0000 mgr.a (mgr.14388) 19464 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:09.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:08 smithi179 bash[23186]: cluster 2024-09-21T05:44:07.598260+0000 mgr.a (mgr.14388) 19464 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:08 smithi049 bash[23528]: cluster 2024-09-21T05:44:07.598260+0000 mgr.a (mgr.14388) 19464 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:09.078 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:09.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:09.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:09.078 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:09.079 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:09 smithi044 bash[22676]: audit 2024-09-21T05:44:08.659990+0000 mgr.a (mgr.14388) 19465 : audit [DBG] from='client.417576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:09 smithi179 bash[23186]: audit 2024-09-21T05:44:08.659990+0000 mgr.a (mgr.14388) 19465 : audit [DBG] from='client.417576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:09 smithi049 bash[23528]: audit 2024-09-21T05:44:08.659990+0000 mgr.a (mgr.14388) 19465 : audit [DBG] from='client.417576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:10.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:10 smithi044 bash[22676]: cluster 2024-09-21T05:44:09.598844+0000 mgr.a (mgr.14388) 19466 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:10.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:10 smithi044 bash[22676]: audit 2024-09-21T05:44:10.664045+0000 mon.a (mon.0) 15376 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:44:10.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:10 smithi044 bash[22676]: audit 2024-09-21T05:44:10.671493+0000 mon.a (mon.0) 15377 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:44:10.976 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:10 smithi044 bash[22676]: audit 2024-09-21T05:44:10.673400+0000 mon.a (mon.0) 15378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:44:10.977 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:10 smithi044 bash[22676]: audit 2024-09-21T05:44:10.685039+0000 mon.a (mon.0) 15379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:10.977 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:10 smithi044 bash[22676]: audit 2024-09-21T05:44:10.688918+0000 mon.a (mon.0) 15380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:44:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:10 smithi179 bash[23186]: cluster 2024-09-21T05:44:09.598844+0000 mgr.a (mgr.14388) 19466 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:10 smithi179 bash[23186]: audit 2024-09-21T05:44:10.664045+0000 mon.a (mon.0) 15376 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:44:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:10 smithi179 bash[23186]: audit 2024-09-21T05:44:10.671493+0000 mon.a (mon.0) 15377 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:44:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:10 smithi179 bash[23186]: audit 2024-09-21T05:44:10.673400+0000 mon.a (mon.0) 15378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:44:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:10 smithi179 bash[23186]: audit 2024-09-21T05:44:10.685039+0000 mon.a (mon.0) 15379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:10 smithi179 bash[23186]: audit 2024-09-21T05:44:10.688918+0000 mon.a (mon.0) 15380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:44:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:10 smithi049 bash[23528]: cluster 2024-09-21T05:44:09.598844+0000 mgr.a (mgr.14388) 19466 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:11.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:10 smithi049 bash[23528]: audit 2024-09-21T05:44:10.664045+0000 mon.a (mon.0) 15376 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:44:11.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:10 smithi049 bash[23528]: audit 2024-09-21T05:44:10.671493+0000 mon.a (mon.0) 15377 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:44:11.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:10 smithi049 bash[23528]: audit 2024-09-21T05:44:10.673400+0000 mon.a (mon.0) 15378 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:44:11.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:10 smithi049 bash[23528]: audit 2024-09-21T05:44:10.685039+0000 mon.a (mon.0) 15379 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:11.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:10 smithi049 bash[23528]: audit 2024-09-21T05:44:10.688918+0000 mon.a (mon.0) 15380 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:44:11.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:11 smithi044 bash[22676]: audit 2024-09-21T05:44:10.690367+0000 mgr.a (mgr.14388) 19467 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:44:11.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:44:11 smithi044 bash[22930]: debug 2024-09-21T05:44:11.492+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:44:11.989 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:44:11 smithi044 bash[22930]: debug 2024-09-21T05:44:11.492+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:44:12.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:11 smithi179 bash[23186]: audit 2024-09-21T05:44:10.690367+0000 mgr.a (mgr.14388) 19467 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:44:12.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:11 smithi049 bash[23528]: audit 2024-09-21T05:44:10.690367+0000 mgr.a (mgr.14388) 19467 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:44:12.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:12 smithi044 bash[22676]: audit 2024-09-21T05:44:11.494718+0000 mgr.a (mgr.14388) 19468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:44:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:12 smithi044 bash[22676]: cephadm 2024-09-21T05:44:11.496144+0000 mgr.a (mgr.14388) 19469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:44:12.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:12 smithi044 bash[22676]: cluster 2024-09-21T05:44:11.601078+0000 mgr.a (mgr.14388) 19470 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:13.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:12 smithi179 bash[23186]: audit 2024-09-21T05:44:11.494718+0000 mgr.a (mgr.14388) 19468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:44:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:12 smithi179 bash[23186]: cephadm 2024-09-21T05:44:11.496144+0000 mgr.a (mgr.14388) 19469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:44:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:12 smithi179 bash[23186]: cluster 2024-09-21T05:44:11.601078+0000 mgr.a (mgr.14388) 19470 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:12 smithi049 bash[23528]: audit 2024-09-21T05:44:11.494718+0000 mgr.a (mgr.14388) 19468 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:44:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:12 smithi049 bash[23528]: cephadm 2024-09-21T05:44:11.496144+0000 mgr.a (mgr.14388) 19469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:44:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:12 smithi049 bash[23528]: cluster 2024-09-21T05:44:11.601078+0000 mgr.a (mgr.14388) 19470 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:14.080 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:14.081 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:14.081 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:14.866 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:14.867 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:14 smithi044 bash[22676]: cluster 2024-09-21T05:44:13.601664+0000 mgr.a (mgr.14388) 19471 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:14 smithi044 bash[22676]: audit 2024-09-21T05:44:13.675396+0000 mon.a (mon.0) 15381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:14 smithi044 bash[22676]: audit 2024-09-21T05:44:13.681150+0000 mon.a (mon.0) 15382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:14 smithi044 bash[22676]: audit 2024-09-21T05:44:13.688285+0000 mon.a (mon.0) 15383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:14 smithi044 bash[22676]: audit 2024-09-21T05:44:13.772571+0000 mon.a (mon.0) 15384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:14 smithi044 bash[22676]: audit 2024-09-21T05:44:13.777744+0000 mon.a (mon.0) 15385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:14.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:14 smithi044 bash[22676]: audit 2024-09-21T05:44:13.783004+0000 mon.a (mon.0) 15386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:14 smithi179 bash[23186]: cluster 2024-09-21T05:44:13.601664+0000 mgr.a (mgr.14388) 19471 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:14 smithi179 bash[23186]: audit 2024-09-21T05:44:13.675396+0000 mon.a (mon.0) 15381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:14 smithi179 bash[23186]: audit 2024-09-21T05:44:13.681150+0000 mon.a (mon.0) 15382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:14 smithi179 bash[23186]: audit 2024-09-21T05:44:13.688285+0000 mon.a (mon.0) 15383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:14 smithi179 bash[23186]: audit 2024-09-21T05:44:13.772571+0000 mon.a (mon.0) 15384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:14 smithi179 bash[23186]: audit 2024-09-21T05:44:13.777744+0000 mon.a (mon.0) 15385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:14 smithi179 bash[23186]: audit 2024-09-21T05:44:13.783004+0000 mon.a (mon.0) 15386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:14 smithi049 bash[23528]: cluster 2024-09-21T05:44:13.601664+0000 mgr.a (mgr.14388) 19471 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:15.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:14 smithi049 bash[23528]: audit 2024-09-21T05:44:13.675396+0000 mon.a (mon.0) 15381 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:14 smithi049 bash[23528]: audit 2024-09-21T05:44:13.681150+0000 mon.a (mon.0) 15382 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:14 smithi049 bash[23528]: audit 2024-09-21T05:44:13.688285+0000 mon.a (mon.0) 15383 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:14 smithi049 bash[23528]: audit 2024-09-21T05:44:13.772571+0000 mon.a (mon.0) 15384 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:14 smithi049 bash[23528]: audit 2024-09-21T05:44:13.777744+0000 mon.a (mon.0) 15385 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:14 smithi049 bash[23528]: audit 2024-09-21T05:44:13.783004+0000 mon.a (mon.0) 15386 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:15.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:15 smithi044 bash[22676]: audit 2024-09-21T05:44:14.411764+0000 mgr.a (mgr.14388) 19472 : audit [DBG] from='client.417762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:16.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:15 smithi179 bash[23186]: audit 2024-09-21T05:44:14.411764+0000 mgr.a (mgr.14388) 19472 : audit [DBG] from='client.417762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:16.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:15 smithi049 bash[23528]: audit 2024-09-21T05:44:14.411764+0000 mgr.a (mgr.14388) 19472 : audit [DBG] from='client.417762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:16.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:16 smithi044 bash[22676]: cluster 2024-09-21T05:44:15.604025+0000 mgr.a (mgr.14388) 19473 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:16 smithi179 bash[23186]: cluster 2024-09-21T05:44:15.604025+0000 mgr.a (mgr.14388) 19473 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:16 smithi049 bash[23528]: cluster 2024-09-21T05:44:15.604025+0000 mgr.a (mgr.14388) 19473 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:18 smithi044 bash[22676]: cluster 2024-09-21T05:44:17.604817+0000 mgr.a (mgr.14388) 19474 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:18 smithi179 bash[23186]: cluster 2024-09-21T05:44:17.604817+0000 mgr.a (mgr.14388) 19474 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:18 smithi049 bash[23528]: cluster 2024-09-21T05:44:17.604817+0000 mgr.a (mgr.14388) 19474 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:19.868 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:19.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:19.869 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:20.651 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:20.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:20.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:20.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:20.651 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:20.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:20 smithi044 bash[22676]: cluster 2024-09-21T05:44:19.605624+0000 mgr.a (mgr.14388) 19475 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:20.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:20 smithi044 bash[22676]: audit 2024-09-21T05:44:20.202551+0000 mgr.a (mgr.14388) 19476 : audit [DBG] from='client.417840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:20 smithi179 bash[23186]: cluster 2024-09-21T05:44:19.605624+0000 mgr.a (mgr.14388) 19475 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:21.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:20 smithi179 bash[23186]: audit 2024-09-21T05:44:20.202551+0000 mgr.a (mgr.14388) 19476 : audit [DBG] from='client.417840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:20 smithi049 bash[23528]: cluster 2024-09-21T05:44:19.605624+0000 mgr.a (mgr.14388) 19475 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:21.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:20 smithi049 bash[23528]: audit 2024-09-21T05:44:20.202551+0000 mgr.a (mgr.14388) 19476 : audit [DBG] from='client.417840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:22.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:22 smithi044 bash[22676]: cluster 2024-09-21T05:44:21.608673+0000 mgr.a (mgr.14388) 19477 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:23.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:22 smithi179 bash[23186]: cluster 2024-09-21T05:44:21.608673+0000 mgr.a (mgr.14388) 19477 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:23.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:22 smithi049 bash[23528]: cluster 2024-09-21T05:44:21.608673+0000 mgr.a (mgr.14388) 19477 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:24 smithi044 bash[22676]: cluster 2024-09-21T05:44:23.609514+0000 mgr.a (mgr.14388) 19478 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:44:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:24 smithi044 bash[22676]: audit 2024-09-21T05:44:24.627885+0000 mon.a (mon.0) 15387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:24 smithi044 bash[22676]: audit 2024-09-21T05:44:24.638070+0000 mon.a (mon.0) 15388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:24.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:24 smithi044 bash[22676]: audit 2024-09-21T05:44:24.650138+0000 mon.a (mon.0) 15389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:24 smithi179 bash[23186]: cluster 2024-09-21T05:44:23.609514+0000 mgr.a (mgr.14388) 19478 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:44:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:24 smithi179 bash[23186]: audit 2024-09-21T05:44:24.627885+0000 mon.a (mon.0) 15387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:24 smithi179 bash[23186]: audit 2024-09-21T05:44:24.638070+0000 mon.a (mon.0) 15388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:25.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:24 smithi179 bash[23186]: audit 2024-09-21T05:44:24.650138+0000 mon.a (mon.0) 15389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:24 smithi049 bash[23528]: cluster 2024-09-21T05:44:23.609514+0000 mgr.a (mgr.14388) 19478 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:44:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:24 smithi049 bash[23528]: audit 2024-09-21T05:44:24.627885+0000 mon.a (mon.0) 15387 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:24 smithi049 bash[23528]: audit 2024-09-21T05:44:24.638070+0000 mon.a (mon.0) 15388 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:25.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:24 smithi049 bash[23528]: audit 2024-09-21T05:44:24.650138+0000 mon.a (mon.0) 15389 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:25.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:25.653 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:26.431 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:26.431 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:26.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:26.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:26.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:26 smithi044 bash[22676]: cluster 2024-09-21T05:44:25.611484+0000 mgr.a (mgr.14388) 19479 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:26.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:26 smithi044 bash[22676]: audit 2024-09-21T05:44:25.983845+0000 mgr.a (mgr.14388) 19480 : audit [DBG] from='client.417918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:27.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:26 smithi179 bash[23186]: cluster 2024-09-21T05:44:25.611484+0000 mgr.a (mgr.14388) 19479 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:27.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:26 smithi179 bash[23186]: audit 2024-09-21T05:44:25.983845+0000 mgr.a (mgr.14388) 19480 : audit [DBG] from='client.417918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:26 smithi049 bash[23528]: cluster 2024-09-21T05:44:25.611484+0000 mgr.a (mgr.14388) 19479 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:44:27.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:26 smithi049 bash[23528]: audit 2024-09-21T05:44:25.983845+0000 mgr.a (mgr.14388) 19480 : audit [DBG] from='client.417918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:28 smithi044 bash[22676]: cluster 2024-09-21T05:44:27.612473+0000 mgr.a (mgr.14388) 19481 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:44:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:28 smithi179 bash[23186]: cluster 2024-09-21T05:44:27.612473+0000 mgr.a (mgr.14388) 19481 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:44:29.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:28 smithi049 bash[23528]: cluster 2024-09-21T05:44:27.612473+0000 mgr.a (mgr.14388) 19481 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:44:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:30 smithi044 bash[22676]: cluster 2024-09-21T05:44:29.613290+0000 mgr.a (mgr.14388) 19482 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:44:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:30 smithi179 bash[23186]: cluster 2024-09-21T05:44:29.613290+0000 mgr.a (mgr.14388) 19482 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:44:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:30 smithi049 bash[23528]: cluster 2024-09-21T05:44:29.613290+0000 mgr.a (mgr.14388) 19482 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:44:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:32.217 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:32.217 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:32.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:32.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:32.218 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:32 smithi044 bash[22676]: cluster 2024-09-21T05:44:31.614369+0000 mgr.a (mgr.14388) 19483 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:32.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:32 smithi044 bash[22676]: audit 2024-09-21T05:44:31.762556+0000 mgr.a (mgr.14388) 19484 : audit [DBG] from='client.417990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:32.992 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:32 smithi179 bash[23186]: cluster 2024-09-21T05:44:31.614369+0000 mgr.a (mgr.14388) 19483 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:32.992 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:32 smithi179 bash[23186]: audit 2024-09-21T05:44:31.762556+0000 mgr.a (mgr.14388) 19484 : audit [DBG] from='client.417990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:32 smithi049 bash[23528]: cluster 2024-09-21T05:44:31.614369+0000 mgr.a (mgr.14388) 19483 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:32 smithi049 bash[23528]: audit 2024-09-21T05:44:31.762556+0000 mgr.a (mgr.14388) 19484 : audit [DBG] from='client.417990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:34 smithi044 bash[22676]: cluster 2024-09-21T05:44:33.615100+0000 mgr.a (mgr.14388) 19485 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:34 smithi044 bash[22676]: audit 2024-09-21T05:44:33.835462+0000 mon.a (mon.0) 15390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:34 smithi044 bash[22676]: audit 2024-09-21T05:44:33.839961+0000 mon.a (mon.0) 15391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:34 smithi044 bash[22676]: audit 2024-09-21T05:44:33.845395+0000 mon.a (mon.0) 15392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:34 smithi044 bash[22676]: audit 2024-09-21T05:44:33.921397+0000 mon.a (mon.0) 15393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:34 smithi044 bash[22676]: audit 2024-09-21T05:44:33.926487+0000 mon.a (mon.0) 15394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:34 smithi044 bash[22676]: audit 2024-09-21T05:44:33.932191+0000 mon.a (mon.0) 15395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:34 smithi179 bash[23186]: cluster 2024-09-21T05:44:33.615100+0000 mgr.a (mgr.14388) 19485 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:34 smithi179 bash[23186]: audit 2024-09-21T05:44:33.835462+0000 mon.a (mon.0) 15390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:34 smithi179 bash[23186]: audit 2024-09-21T05:44:33.839961+0000 mon.a (mon.0) 15391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:34 smithi179 bash[23186]: audit 2024-09-21T05:44:33.845395+0000 mon.a (mon.0) 15392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:34 smithi179 bash[23186]: audit 2024-09-21T05:44:33.921397+0000 mon.a (mon.0) 15393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:34 smithi179 bash[23186]: audit 2024-09-21T05:44:33.926487+0000 mon.a (mon.0) 15394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:34 smithi179 bash[23186]: audit 2024-09-21T05:44:33.932191+0000 mon.a (mon.0) 15395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:34 smithi049 bash[23528]: cluster 2024-09-21T05:44:33.615100+0000 mgr.a (mgr.14388) 19485 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:34 smithi049 bash[23528]: audit 2024-09-21T05:44:33.835462+0000 mon.a (mon.0) 15390 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:34 smithi049 bash[23528]: audit 2024-09-21T05:44:33.839961+0000 mon.a (mon.0) 15391 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:34 smithi049 bash[23528]: audit 2024-09-21T05:44:33.845395+0000 mon.a (mon.0) 15392 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:34 smithi049 bash[23528]: audit 2024-09-21T05:44:33.921397+0000 mon.a (mon.0) 15393 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:34 smithi049 bash[23528]: audit 2024-09-21T05:44:33.926487+0000 mon.a (mon.0) 15394 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:35.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:34 smithi049 bash[23528]: audit 2024-09-21T05:44:33.932191+0000 mon.a (mon.0) 15395 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:37.219 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:37.220 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:37.220 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:36 smithi044 bash[22676]: cluster 2024-09-21T05:44:35.617216+0000 mgr.a (mgr.14388) 19486 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:37.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:36 smithi179 bash[23186]: cluster 2024-09-21T05:44:35.617216+0000 mgr.a (mgr.14388) 19486 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:36 smithi049 bash[23528]: cluster 2024-09-21T05:44:35.617216+0000 mgr.a (mgr.14388) 19486 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:37.968 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:37.968 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:38 smithi044 bash[22676]: audit 2024-09-21T05:44:37.547991+0000 mgr.a (mgr.14388) 19487 : audit [DBG] from='client.418065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:39.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:38 smithi044 bash[22676]: cluster 2024-09-21T05:44:37.617763+0000 mgr.a (mgr.14388) 19488 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:38 smithi179 bash[23186]: audit 2024-09-21T05:44:37.547991+0000 mgr.a (mgr.14388) 19487 : audit [DBG] from='client.418065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:39.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:38 smithi179 bash[23186]: cluster 2024-09-21T05:44:37.617763+0000 mgr.a (mgr.14388) 19488 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:38 smithi049 bash[23528]: audit 2024-09-21T05:44:37.547991+0000 mgr.a (mgr.14388) 19487 : audit [DBG] from='client.418065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:38 smithi049 bash[23528]: cluster 2024-09-21T05:44:37.617763+0000 mgr.a (mgr.14388) 19488 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:40 smithi044 bash[22676]: cluster 2024-09-21T05:44:39.618599+0000 mgr.a (mgr.14388) 19489 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:40 smithi179 bash[23186]: cluster 2024-09-21T05:44:39.618599+0000 mgr.a (mgr.14388) 19489 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:40 smithi049 bash[23528]: cluster 2024-09-21T05:44:39.618599+0000 mgr.a (mgr.14388) 19489 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:42.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:42.970 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:42.971 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:42 smithi044 bash[22676]: cluster 2024-09-21T05:44:41.620871+0000 mgr.a (mgr.14388) 19490 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:43.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:42 smithi179 bash[23186]: cluster 2024-09-21T05:44:41.620871+0000 mgr.a (mgr.14388) 19490 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:42 smithi049 bash[23528]: cluster 2024-09-21T05:44:41.620871+0000 mgr.a (mgr.14388) 19490 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:43.744 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:43.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:43.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:43.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:43.745 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:43 smithi044 bash[22676]: audit 2024-09-21T05:44:43.299401+0000 mgr.a (mgr.14388) 19491 : audit [DBG] from='client.418143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:43 smithi179 bash[23186]: audit 2024-09-21T05:44:43.299401+0000 mgr.a (mgr.14388) 19491 : audit [DBG] from='client.418143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:43 smithi049 bash[23528]: audit 2024-09-21T05:44:43.299401+0000 mgr.a (mgr.14388) 19491 : audit [DBG] from='client.418143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:44 smithi049 bash[23528]: cluster 2024-09-21T05:44:43.621513+0000 mgr.a (mgr.14388) 19492 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:44 smithi049 bash[23528]: audit 2024-09-21T05:44:44.828543+0000 mon.a (mon.0) 15396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:44 smithi049 bash[23528]: audit 2024-09-21T05:44:44.838966+0000 mon.a (mon.0) 15397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:44 smithi049 bash[23528]: audit 2024-09-21T05:44:44.851024+0000 mon.a (mon.0) 15398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:44 smithi044 bash[22676]: cluster 2024-09-21T05:44:43.621513+0000 mgr.a (mgr.14388) 19492 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:44 smithi044 bash[22676]: audit 2024-09-21T05:44:44.828543+0000 mon.a (mon.0) 15396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:44 smithi044 bash[22676]: audit 2024-09-21T05:44:44.838966+0000 mon.a (mon.0) 15397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:44 smithi044 bash[22676]: audit 2024-09-21T05:44:44.851024+0000 mon.a (mon.0) 15398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:44 smithi179 bash[23186]: cluster 2024-09-21T05:44:43.621513+0000 mgr.a (mgr.14388) 19492 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:44 smithi179 bash[23186]: audit 2024-09-21T05:44:44.828543+0000 mon.a (mon.0) 15396 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:44 smithi179 bash[23186]: audit 2024-09-21T05:44:44.838966+0000 mon.a (mon.0) 15397 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:44 smithi179 bash[23186]: audit 2024-09-21T05:44:44.851024+0000 mon.a (mon.0) 15398 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:46 smithi044 bash[22676]: cluster 2024-09-21T05:44:45.623790+0000 mgr.a (mgr.14388) 19493 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:47.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:46 smithi179 bash[23186]: cluster 2024-09-21T05:44:45.623790+0000 mgr.a (mgr.14388) 19493 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:46 smithi049 bash[23528]: cluster 2024-09-21T05:44:45.623790+0000 mgr.a (mgr.14388) 19493 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:48.746 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:48.747 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:48 smithi044 bash[22676]: cluster 2024-09-21T05:44:47.624568+0000 mgr.a (mgr.14388) 19494 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:49.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:48 smithi179 bash[23186]: cluster 2024-09-21T05:44:47.624568+0000 mgr.a (mgr.14388) 19494 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:49.306 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:48 smithi049 bash[23528]: cluster 2024-09-21T05:44:47.624568+0000 mgr.a (mgr.14388) 19494 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:49.510 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:49.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:49.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:50.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:49 smithi044 bash[22676]: audit 2024-09-21T05:44:49.082737+0000 mgr.a (mgr.14388) 19495 : audit [DBG] from='client.418221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:50.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:49 smithi179 bash[23186]: audit 2024-09-21T05:44:49.082737+0000 mgr.a (mgr.14388) 19495 : audit [DBG] from='client.418221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:49 smithi049 bash[23528]: audit 2024-09-21T05:44:49.082737+0000 mgr.a (mgr.14388) 19495 : audit [DBG] from='client.418221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:50.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:50 smithi044 bash[22676]: cluster 2024-09-21T05:44:49.625560+0000 mgr.a (mgr.14388) 19496 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:50 smithi179 bash[23186]: cluster 2024-09-21T05:44:49.625560+0000 mgr.a (mgr.14388) 19496 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:50 smithi049 bash[23528]: cluster 2024-09-21T05:44:49.625560+0000 mgr.a (mgr.14388) 19496 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:52.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:52 smithi044 bash[22676]: cluster 2024-09-21T05:44:51.627783+0000 mgr.a (mgr.14388) 19497 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:52 smithi179 bash[23186]: cluster 2024-09-21T05:44:51.627783+0000 mgr.a (mgr.14388) 19497 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:52 smithi049 bash[23528]: cluster 2024-09-21T05:44:51.627783+0000 mgr.a (mgr.14388) 19497 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:44:54.512 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:44:54.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:44:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:44:55.298 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:44:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:44:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:44:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:44:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:44:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:55 smithi049 bash[23528]: cluster 2024-09-21T05:44:53.628238+0000 mgr.a (mgr.14388) 19498 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:55 smithi049 bash[23528]: audit 2024-09-21T05:44:54.025783+0000 mon.a (mon.0) 15399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:55 smithi049 bash[23528]: audit 2024-09-21T05:44:54.030794+0000 mon.a (mon.0) 15400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:55 smithi049 bash[23528]: audit 2024-09-21T05:44:54.037673+0000 mon.a (mon.0) 15401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:55 smithi049 bash[23528]: audit 2024-09-21T05:44:54.088982+0000 mon.a (mon.0) 15402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:55 smithi049 bash[23528]: audit 2024-09-21T05:44:54.096463+0000 mon.a (mon.0) 15403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:55 smithi049 bash[23528]: audit 2024-09-21T05:44:54.103835+0000 mon.a (mon.0) 15404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:55 smithi179 bash[23186]: cluster 2024-09-21T05:44:53.628238+0000 mgr.a (mgr.14388) 19498 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:55.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:55 smithi179 bash[23186]: audit 2024-09-21T05:44:54.025783+0000 mon.a (mon.0) 15399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:55 smithi179 bash[23186]: audit 2024-09-21T05:44:54.030794+0000 mon.a (mon.0) 15400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:55 smithi179 bash[23186]: audit 2024-09-21T05:44:54.037673+0000 mon.a (mon.0) 15401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:55 smithi179 bash[23186]: audit 2024-09-21T05:44:54.088982+0000 mon.a (mon.0) 15402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:55 smithi179 bash[23186]: audit 2024-09-21T05:44:54.096463+0000 mon.a (mon.0) 15403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:55 smithi179 bash[23186]: audit 2024-09-21T05:44:54.103835+0000 mon.a (mon.0) 15404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:55 smithi044 bash[22676]: cluster 2024-09-21T05:44:53.628238+0000 mgr.a (mgr.14388) 19498 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:44:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:55 smithi044 bash[22676]: audit 2024-09-21T05:44:54.025783+0000 mon.a (mon.0) 15399 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:55 smithi044 bash[22676]: audit 2024-09-21T05:44:54.030794+0000 mon.a (mon.0) 15400 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:55 smithi044 bash[22676]: audit 2024-09-21T05:44:54.037673+0000 mon.a (mon.0) 15401 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:55 smithi044 bash[22676]: audit 2024-09-21T05:44:54.088982+0000 mon.a (mon.0) 15402 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:55 smithi044 bash[22676]: audit 2024-09-21T05:44:54.096463+0000 mon.a (mon.0) 15403 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:55 smithi044 bash[22676]: audit 2024-09-21T05:44:54.103835+0000 mon.a (mon.0) 15404 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:44:56.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:56 smithi179 bash[23186]: audit 2024-09-21T05:44:54.845466+0000 mgr.a (mgr.14388) 19499 : audit [DBG] from='client.418296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:56.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:56 smithi049 bash[23528]: audit 2024-09-21T05:44:54.845466+0000 mgr.a (mgr.14388) 19499 : audit [DBG] from='client.418296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:56.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:56 smithi044 bash[22676]: audit 2024-09-21T05:44:54.845466+0000 mgr.a (mgr.14388) 19499 : audit [DBG] from='client.418296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:57.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:57 smithi049 bash[23528]: cluster 2024-09-21T05:44:55.631269+0000 mgr.a (mgr.14388) 19500 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:44:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:57 smithi044 bash[22676]: cluster 2024-09-21T05:44:55.631269+0000 mgr.a (mgr.14388) 19500 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:44:57.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:57 smithi179 bash[23186]: cluster 2024-09-21T05:44:55.631269+0000 mgr.a (mgr.14388) 19500 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:44:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:44:59 smithi049 bash[23528]: cluster 2024-09-21T05:44:57.632082+0000 mgr.a (mgr.14388) 19501 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:44:59.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:44:59 smithi044 bash[22676]: cluster 2024-09-21T05:44:57.632082+0000 mgr.a (mgr.14388) 19501 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:44:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:44:59 smithi179 bash[23186]: cluster 2024-09-21T05:44:57.632082+0000 mgr.a (mgr.14388) 19501 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:45:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:00.301 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:01.082 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:01 smithi049 bash[23528]: cluster 2024-09-21T05:44:59.632872+0000 mgr.a (mgr.14388) 19502 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:45:01.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:01 smithi044 bash[22676]: cluster 2024-09-21T05:44:59.632872+0000 mgr.a (mgr.14388) 19502 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:45:01.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:01 smithi179 bash[23186]: cluster 2024-09-21T05:44:59.632872+0000 mgr.a (mgr.14388) 19502 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:45:02.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:02 smithi049 bash[23528]: audit 2024-09-21T05:45:00.632934+0000 mgr.a (mgr.14388) 19503 : audit [DBG] from='client.418371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:02.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:02 smithi044 bash[22676]: audit 2024-09-21T05:45:00.632934+0000 mgr.a (mgr.14388) 19503 : audit [DBG] from='client.418371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:02.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:02 smithi179 bash[23186]: audit 2024-09-21T05:45:00.632934+0000 mgr.a (mgr.14388) 19503 : audit [DBG] from='client.418371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:03.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:03 smithi044 bash[22676]: cluster 2024-09-21T05:45:01.635977+0000 mgr.a (mgr.14388) 19504 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:03.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:03 smithi179 bash[23186]: cluster 2024-09-21T05:45:01.635977+0000 mgr.a (mgr.14388) 19504 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:03 smithi049 bash[23528]: cluster 2024-09-21T05:45:01.635977+0000 mgr.a (mgr.14388) 19504 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:05.374 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:05 smithi049 bash[23528]: cluster 2024-09-21T05:45:03.636774+0000 mgr.a (mgr.14388) 19505 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:45:05.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:05 smithi044 bash[22676]: cluster 2024-09-21T05:45:03.636774+0000 mgr.a (mgr.14388) 19505 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:45:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:05 smithi179 bash[23186]: cluster 2024-09-21T05:45:03.636774+0000 mgr.a (mgr.14388) 19505 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:45:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:06.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:06.083 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:06.449 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:06 smithi049 bash[23528]: audit 2024-09-21T05:45:05.072359+0000 mon.a (mon.0) 15405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.450 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:06 smithi049 bash[23528]: audit 2024-09-21T05:45:05.081062+0000 mon.a (mon.0) 15406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.450 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:06 smithi049 bash[23528]: audit 2024-09-21T05:45:05.092660+0000 mon.a (mon.0) 15407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:06 smithi044 bash[22676]: audit 2024-09-21T05:45:05.072359+0000 mon.a (mon.0) 15405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:06 smithi044 bash[22676]: audit 2024-09-21T05:45:05.081062+0000 mon.a (mon.0) 15406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:06 smithi044 bash[22676]: audit 2024-09-21T05:45:05.092660+0000 mon.a (mon.0) 15407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:06 smithi179 bash[23186]: audit 2024-09-21T05:45:05.072359+0000 mon.a (mon.0) 15405 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:06 smithi179 bash[23186]: audit 2024-09-21T05:45:05.081062+0000 mon.a (mon.0) 15406 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:06 smithi179 bash[23186]: audit 2024-09-21T05:45:05.092660+0000 mon.a (mon.0) 15407 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:06.859 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:06.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:06.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:06.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:06.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:07.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:07 smithi044 bash[22676]: cluster 2024-09-21T05:45:05.638760+0000 mgr.a (mgr.14388) 19506 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:07.496 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:07 smithi049 bash[23528]: cluster 2024-09-21T05:45:05.638760+0000 mgr.a (mgr.14388) 19506 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:07.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:07 smithi179 bash[23186]: cluster 2024-09-21T05:45:05.638760+0000 mgr.a (mgr.14388) 19506 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:08.409 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:08 smithi049 bash[23528]: audit 2024-09-21T05:45:06.419334+0000 mgr.a (mgr.14388) 19507 : audit [DBG] from='client.418449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:08.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:08 smithi044 bash[22676]: audit 2024-09-21T05:45:06.419334+0000 mgr.a (mgr.14388) 19507 : audit [DBG] from='client.418449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:08.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:08 smithi179 bash[23186]: audit 2024-09-21T05:45:06.419334+0000 mgr.a (mgr.14388) 19507 : audit [DBG] from='client.418449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:09 smithi049 bash[23528]: cluster 2024-09-21T05:45:07.639750+0000 mgr.a (mgr.14388) 19508 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:45:09.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:09 smithi044 bash[22676]: cluster 2024-09-21T05:45:07.639750+0000 mgr.a (mgr.14388) 19508 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:45:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:09 smithi179 bash[23186]: cluster 2024-09-21T05:45:07.639750+0000 mgr.a (mgr.14388) 19508 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:45:11.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:11 smithi044 bash[22676]: cluster 2024-09-21T05:45:09.640555+0000 mgr.a (mgr.14388) 19509 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:45:11.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:11 smithi179 bash[23186]: cluster 2024-09-21T05:45:09.640555+0000 mgr.a (mgr.14388) 19509 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:45:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:11 smithi049 bash[23528]: cluster 2024-09-21T05:45:09.640555+0000 mgr.a (mgr.14388) 19509 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:45:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:12.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:12 smithi044 bash[22676]: audit 2024-09-21T05:45:11.556727+0000 mon.a (mon.0) 15408 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:45:12.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:12 smithi044 bash[22676]: audit 2024-09-21T05:45:11.563808+0000 mon.a (mon.0) 15409 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:45:12.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:12 smithi044 bash[22676]: audit 2024-09-21T05:45:11.565622+0000 mon.a (mon.0) 15410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:45:12.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:12 smithi044 bash[22676]: audit 2024-09-21T05:45:11.577201+0000 mon.a (mon.0) 15411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:12.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:12 smithi044 bash[22676]: audit 2024-09-21T05:45:11.584411+0000 mon.a (mon.0) 15412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:45:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:12 smithi179 bash[23186]: audit 2024-09-21T05:45:11.556727+0000 mon.a (mon.0) 15408 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:45:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:12 smithi179 bash[23186]: audit 2024-09-21T05:45:11.563808+0000 mon.a (mon.0) 15409 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:45:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:12 smithi179 bash[23186]: audit 2024-09-21T05:45:11.565622+0000 mon.a (mon.0) 15410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:45:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:12 smithi179 bash[23186]: audit 2024-09-21T05:45:11.577201+0000 mon.a (mon.0) 15411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:12.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:12 smithi179 bash[23186]: audit 2024-09-21T05:45:11.584411+0000 mon.a (mon.0) 15412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:45:12.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:12 smithi049 bash[23528]: audit 2024-09-21T05:45:11.556727+0000 mon.a (mon.0) 15408 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:12 smithi049 bash[23528]: audit 2024-09-21T05:45:11.563808+0000 mon.a (mon.0) 15409 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:12 smithi049 bash[23528]: audit 2024-09-21T05:45:11.565622+0000 mon.a (mon.0) 15410 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:12 smithi049 bash[23528]: audit 2024-09-21T05:45:11.577201+0000 mon.a (mon.0) 15411 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:12.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:12 smithi049 bash[23528]: audit 2024-09-21T05:45:11.584411+0000 mon.a (mon.0) 15412 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:45:12.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:45:12 smithi044 bash[22930]: debug 2024-09-21T05:45:12.403+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:45:12.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:45:12 smithi044 bash[22930]: debug 2024-09-21T05:45:12.415+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:45:12.813 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:13 smithi044 bash[22676]: audit 2024-09-21T05:45:11.586969+0000 mgr.a (mgr.14388) 19510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:45:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:13 smithi044 bash[22676]: cluster 2024-09-21T05:45:11.643832+0000 mgr.a (mgr.14388) 19511 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:45:13.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:13 smithi044 bash[22676]: audit 2024-09-21T05:45:12.238710+0000 mgr.a (mgr.14388) 19512 : audit [DBG] from='client.418575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:13.427 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:13 smithi179 bash[23186]: audit 2024-09-21T05:45:11.586969+0000 mgr.a (mgr.14388) 19510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:45:13.427 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:13 smithi179 bash[23186]: cluster 2024-09-21T05:45:11.643832+0000 mgr.a (mgr.14388) 19511 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:45:13.427 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:13 smithi179 bash[23186]: audit 2024-09-21T05:45:12.238710+0000 mgr.a (mgr.14388) 19512 : audit [DBG] from='client.418575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:13 smithi049 bash[23528]: audit 2024-09-21T05:45:11.586969+0000 mgr.a (mgr.14388) 19510 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:45:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:13 smithi049 bash[23528]: cluster 2024-09-21T05:45:11.643832+0000 mgr.a (mgr.14388) 19511 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:45:13.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:13 smithi049 bash[23528]: audit 2024-09-21T05:45:12.238710+0000 mgr.a (mgr.14388) 19512 : audit [DBG] from='client.418575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:14 smithi044 bash[22676]: audit 2024-09-21T05:45:12.406672+0000 mgr.a (mgr.14388) 19513 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:45:14.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:14 smithi044 bash[22676]: cephadm 2024-09-21T05:45:12.417944+0000 mgr.a (mgr.14388) 19514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:45:14.374 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:14 smithi179 bash[23186]: audit 2024-09-21T05:45:12.406672+0000 mgr.a (mgr.14388) 19513 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:45:14.374 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:14 smithi179 bash[23186]: cephadm 2024-09-21T05:45:12.417944+0000 mgr.a (mgr.14388) 19514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:45:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:14 smithi049 bash[23528]: audit 2024-09-21T05:45:12.406672+0000 mgr.a (mgr.14388) 19513 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:45:14.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:14 smithi049 bash[23528]: cephadm 2024-09-21T05:45:12.417944+0000 mgr.a (mgr.14388) 19514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:45:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:15 smithi044 bash[22676]: cluster 2024-09-21T05:45:13.644906+0000 mgr.a (mgr.14388) 19515 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:15 smithi044 bash[22676]: audit 2024-09-21T05:45:14.227713+0000 mon.a (mon.0) 15413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:15 smithi044 bash[22676]: audit 2024-09-21T05:45:14.233982+0000 mon.a (mon.0) 15414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:15 smithi044 bash[22676]: audit 2024-09-21T05:45:14.239460+0000 mon.a (mon.0) 15415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:15 smithi044 bash[22676]: audit 2024-09-21T05:45:14.244576+0000 mon.a (mon.0) 15416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:15 smithi044 bash[22676]: audit 2024-09-21T05:45:14.249468+0000 mon.a (mon.0) 15417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:15 smithi044 bash[22676]: audit 2024-09-21T05:45:14.256328+0000 mon.a (mon.0) 15418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:15 smithi179 bash[23186]: cluster 2024-09-21T05:45:13.644906+0000 mgr.a (mgr.14388) 19515 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:15 smithi179 bash[23186]: audit 2024-09-21T05:45:14.227713+0000 mon.a (mon.0) 15413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:15 smithi179 bash[23186]: audit 2024-09-21T05:45:14.233982+0000 mon.a (mon.0) 15414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:15 smithi179 bash[23186]: audit 2024-09-21T05:45:14.239460+0000 mon.a (mon.0) 15415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:15 smithi179 bash[23186]: audit 2024-09-21T05:45:14.244576+0000 mon.a (mon.0) 15416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:15 smithi179 bash[23186]: audit 2024-09-21T05:45:14.249468+0000 mon.a (mon.0) 15417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:15 smithi179 bash[23186]: audit 2024-09-21T05:45:14.256328+0000 mon.a (mon.0) 15418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:15 smithi049 bash[23528]: cluster 2024-09-21T05:45:13.644906+0000 mgr.a (mgr.14388) 19515 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:15 smithi049 bash[23528]: audit 2024-09-21T05:45:14.227713+0000 mon.a (mon.0) 15413 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:15 smithi049 bash[23528]: audit 2024-09-21T05:45:14.233982+0000 mon.a (mon.0) 15414 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:15 smithi049 bash[23528]: audit 2024-09-21T05:45:14.239460+0000 mon.a (mon.0) 15415 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:15 smithi049 bash[23528]: audit 2024-09-21T05:45:14.244576+0000 mon.a (mon.0) 15416 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:15 smithi049 bash[23528]: audit 2024-09-21T05:45:14.249468+0000 mon.a (mon.0) 15417 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:15.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:15 smithi049 bash[23528]: audit 2024-09-21T05:45:14.256328+0000 mon.a (mon.0) 15418 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:17.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:17 smithi044 bash[22676]: cluster 2024-09-21T05:45:15.646709+0000 mgr.a (mgr.14388) 19516 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:17.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:17 smithi179 bash[23186]: cluster 2024-09-21T05:45:15.646709+0000 mgr.a (mgr.14388) 19516 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:17.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:17 smithi049 bash[23528]: cluster 2024-09-21T05:45:15.646709+0000 mgr.a (mgr.14388) 19516 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:17.816 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:18.574 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:19.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:19 smithi044 bash[22676]: cluster 2024-09-21T05:45:17.647503+0000 mgr.a (mgr.14388) 19517 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:19.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:19 smithi044 bash[22676]: audit 2024-09-21T05:45:18.145418+0000 mgr.a (mgr.14388) 19518 : audit [DBG] from='client.418707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:19 smithi179 bash[23186]: cluster 2024-09-21T05:45:17.647503+0000 mgr.a (mgr.14388) 19517 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:19 smithi179 bash[23186]: audit 2024-09-21T05:45:18.145418+0000 mgr.a (mgr.14388) 19518 : audit [DBG] from='client.418707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:19.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:19 smithi049 bash[23528]: cluster 2024-09-21T05:45:17.647503+0000 mgr.a (mgr.14388) 19517 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:19.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:19 smithi049 bash[23528]: audit 2024-09-21T05:45:18.145418+0000 mgr.a (mgr.14388) 19518 : audit [DBG] from='client.418707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:21.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:21 smithi179 bash[23186]: cluster 2024-09-21T05:45:19.648649+0000 mgr.a (mgr.14388) 19519 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:21.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:21 smithi049 bash[23528]: cluster 2024-09-21T05:45:19.648649+0000 mgr.a (mgr.14388) 19519 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:21 smithi044 bash[22676]: cluster 2024-09-21T05:45:19.648649+0000 mgr.a (mgr.14388) 19519 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:23.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:23 smithi179 bash[23186]: cluster 2024-09-21T05:45:21.651002+0000 mgr.a (mgr.14388) 19520 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:23.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:23 smithi049 bash[23528]: cluster 2024-09-21T05:45:21.651002+0000 mgr.a (mgr.14388) 19520 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:23 smithi044 bash[22676]: cluster 2024-09-21T05:45:21.651002+0000 mgr.a (mgr.14388) 19520 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:24.363 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:24.363 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:24.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:24.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:24.364 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:25 smithi179 bash[23186]: cluster 2024-09-21T05:45:23.651775+0000 mgr.a (mgr.14388) 19521 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:25.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:25 smithi179 bash[23186]: audit 2024-09-21T05:45:23.911847+0000 mgr.a (mgr.14388) 19522 : audit [DBG] from='client.418785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:25 smithi049 bash[23528]: cluster 2024-09-21T05:45:23.651775+0000 mgr.a (mgr.14388) 19521 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:25.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:25 smithi049 bash[23528]: audit 2024-09-21T05:45:23.911847+0000 mgr.a (mgr.14388) 19522 : audit [DBG] from='client.418785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:25 smithi044 bash[22676]: cluster 2024-09-21T05:45:23.651775+0000 mgr.a (mgr.14388) 19521 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:25.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:25 smithi044 bash[22676]: audit 2024-09-21T05:45:23.911847+0000 mgr.a (mgr.14388) 19522 : audit [DBG] from='client.418785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:26 smithi044 bash[22676]: audit 2024-09-21T05:45:25.308282+0000 mon.a (mon.0) 15419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:26 smithi044 bash[22676]: audit 2024-09-21T05:45:25.317270+0000 mon.a (mon.0) 15420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:26 smithi044 bash[22676]: audit 2024-09-21T05:45:25.328212+0000 mon.a (mon.0) 15421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:26 smithi179 bash[23186]: audit 2024-09-21T05:45:25.308282+0000 mon.a (mon.0) 15419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:26 smithi179 bash[23186]: audit 2024-09-21T05:45:25.317270+0000 mon.a (mon.0) 15420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:26 smithi179 bash[23186]: audit 2024-09-21T05:45:25.328212+0000 mon.a (mon.0) 15421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:26 smithi049 bash[23528]: audit 2024-09-21T05:45:25.308282+0000 mon.a (mon.0) 15419 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:26 smithi049 bash[23528]: audit 2024-09-21T05:45:25.317270+0000 mon.a (mon.0) 15420 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:26.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:26 smithi049 bash[23528]: audit 2024-09-21T05:45:25.328212+0000 mon.a (mon.0) 15421 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:27 smithi044 bash[22676]: cluster 2024-09-21T05:45:25.654095+0000 mgr.a (mgr.14388) 19523 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:27.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:27 smithi179 bash[23186]: cluster 2024-09-21T05:45:25.654095+0000 mgr.a (mgr.14388) 19523 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:27 smithi049 bash[23528]: cluster 2024-09-21T05:45:25.654095+0000 mgr.a (mgr.14388) 19523 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:45:29.365 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:29.365 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:29.366 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:29.607 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:29 smithi049 bash[23528]: cluster 2024-09-21T05:45:27.654879+0000 mgr.a (mgr.14388) 19524 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:29.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:29 smithi044 bash[22676]: cluster 2024-09-21T05:45:27.654879+0000 mgr.a (mgr.14388) 19524 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:29.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:29 smithi179 bash[23186]: cluster 2024-09-21T05:45:27.654879+0000 mgr.a (mgr.14388) 19524 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:30.168 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:31.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:31 smithi044 bash[22676]: cluster 2024-09-21T05:45:29.655612+0000 mgr.a (mgr.14388) 19525 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:31.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:31 smithi044 bash[22676]: audit 2024-09-21T05:45:29.703127+0000 mgr.a (mgr.14388) 19526 : audit [DBG] from='client.418863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:31 smithi179 bash[23186]: cluster 2024-09-21T05:45:29.655612+0000 mgr.a (mgr.14388) 19525 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:31.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:31 smithi179 bash[23186]: audit 2024-09-21T05:45:29.703127+0000 mgr.a (mgr.14388) 19526 : audit [DBG] from='client.418863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:31 smithi049 bash[23528]: cluster 2024-09-21T05:45:29.655612+0000 mgr.a (mgr.14388) 19525 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:31.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:31 smithi049 bash[23528]: audit 2024-09-21T05:45:29.703127+0000 mgr.a (mgr.14388) 19526 : audit [DBG] from='client.418863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:32.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:32 smithi044 bash[22676]: cluster 2024-09-21T05:45:31.658596+0000 mgr.a (mgr.14388) 19527 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:45:32.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:32 smithi179 bash[23186]: cluster 2024-09-21T05:45:31.658596+0000 mgr.a (mgr.14388) 19527 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:45:32.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:32 smithi049 bash[23528]: cluster 2024-09-21T05:45:31.658596+0000 mgr.a (mgr.14388) 19527 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-21T05:45:34.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:34 smithi044 bash[22676]: cluster 2024-09-21T05:45:33.659401+0000 mgr.a (mgr.14388) 19528 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:45:34.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:34 smithi044 bash[22676]: audit 2024-09-21T05:45:34.382330+0000 mon.a (mon.0) 15422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:34.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:34 smithi044 bash[22676]: audit 2024-09-21T05:45:34.388410+0000 mon.a (mon.0) 15423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:34.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:34 smithi044 bash[22676]: audit 2024-09-21T05:45:34.395593+0000 mon.a (mon.0) 15424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:34.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:34 smithi044 bash[22676]: audit 2024-09-21T05:45:34.437538+0000 mon.a (mon.0) 15425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:34.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:34 smithi044 bash[22676]: audit 2024-09-21T05:45:34.443188+0000 mon.a (mon.0) 15426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:34.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:34 smithi044 bash[22676]: audit 2024-09-21T05:45:34.448313+0000 mon.a (mon.0) 15427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:34 smithi179 bash[23186]: cluster 2024-09-21T05:45:33.659401+0000 mgr.a (mgr.14388) 19528 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:45:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:34 smithi179 bash[23186]: audit 2024-09-21T05:45:34.382330+0000 mon.a (mon.0) 15422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:34 smithi179 bash[23186]: audit 2024-09-21T05:45:34.388410+0000 mon.a (mon.0) 15423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:34 smithi179 bash[23186]: audit 2024-09-21T05:45:34.395593+0000 mon.a (mon.0) 15424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:34 smithi179 bash[23186]: audit 2024-09-21T05:45:34.437538+0000 mon.a (mon.0) 15425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:34 smithi179 bash[23186]: audit 2024-09-21T05:45:34.443188+0000 mon.a (mon.0) 15426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:34 smithi179 bash[23186]: audit 2024-09-21T05:45:34.448313+0000 mon.a (mon.0) 15427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:34 smithi049 bash[23528]: cluster 2024-09-21T05:45:33.659401+0000 mgr.a (mgr.14388) 19528 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-21T05:45:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:34 smithi049 bash[23528]: audit 2024-09-21T05:45:34.382330+0000 mon.a (mon.0) 15422 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:34 smithi049 bash[23528]: audit 2024-09-21T05:45:34.388410+0000 mon.a (mon.0) 15423 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:34 smithi049 bash[23528]: audit 2024-09-21T05:45:34.395593+0000 mon.a (mon.0) 15424 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:34 smithi049 bash[23528]: audit 2024-09-21T05:45:34.437538+0000 mon.a (mon.0) 15425 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:34 smithi049 bash[23528]: audit 2024-09-21T05:45:34.443188+0000 mon.a (mon.0) 15426 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:34 smithi049 bash[23528]: audit 2024-09-21T05:45:34.448313+0000 mon.a (mon.0) 15427 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:35.169 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:35.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:35.170 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:35.959 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:36 smithi179 bash[23186]: audit 2024-09-21T05:45:35.509154+0000 mgr.a (mgr.14388) 19529 : audit [DBG] from='client.418941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:36.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:36 smithi179 bash[23186]: cluster 2024-09-21T05:45:35.660893+0000 mgr.a (mgr.14388) 19530 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:36 smithi044 bash[22676]: audit 2024-09-21T05:45:35.509154+0000 mgr.a (mgr.14388) 19529 : audit [DBG] from='client.418941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:36.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:36 smithi044 bash[22676]: cluster 2024-09-21T05:45:35.660893+0000 mgr.a (mgr.14388) 19530 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:36 smithi049 bash[23528]: audit 2024-09-21T05:45:35.509154+0000 mgr.a (mgr.14388) 19529 : audit [DBG] from='client.418941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:37.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:36 smithi049 bash[23528]: cluster 2024-09-21T05:45:35.660893+0000 mgr.a (mgr.14388) 19530 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:38.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:38 smithi044 bash[22676]: cluster 2024-09-21T05:45:37.661823+0000 mgr.a (mgr.14388) 19531 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:45:39.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:38 smithi179 bash[23186]: cluster 2024-09-21T05:45:37.661823+0000 mgr.a (mgr.14388) 19531 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:45:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:38 smithi049 bash[23528]: cluster 2024-09-21T05:45:37.661823+0000 mgr.a (mgr.14388) 19531 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:45:40.961 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:40.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:40.962 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:40.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:40 smithi044 bash[22676]: cluster 2024-09-21T05:45:39.662616+0000 mgr.a (mgr.14388) 19532 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:45:41.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:40 smithi179 bash[23186]: cluster 2024-09-21T05:45:39.662616+0000 mgr.a (mgr.14388) 19532 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:45:41.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:40 smithi049 bash[23528]: cluster 2024-09-21T05:45:39.662616+0000 mgr.a (mgr.14388) 19532 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:45:41.732 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:41.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:41.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:41.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:41.732 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:41.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:41 smithi044 bash[22676]: audit 2024-09-21T05:45:41.288575+0000 mgr.a (mgr.14388) 19533 : audit [DBG] from='client.419019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:42.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:41 smithi179 bash[23186]: audit 2024-09-21T05:45:41.288575+0000 mgr.a (mgr.14388) 19533 : audit [DBG] from='client.419019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:42.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:41 smithi049 bash[23528]: audit 2024-09-21T05:45:41.288575+0000 mgr.a (mgr.14388) 19533 : audit [DBG] from='client.419019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:43.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:42 smithi179 bash[23186]: cluster 2024-09-21T05:45:41.664059+0000 mgr.a (mgr.14388) 19534 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:43.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:42 smithi049 bash[23528]: cluster 2024-09-21T05:45:41.664059+0000 mgr.a (mgr.14388) 19534 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:42 smithi044 bash[22676]: cluster 2024-09-21T05:45:41.664059+0000 mgr.a (mgr.14388) 19534 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:45.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:44 smithi179 bash[23186]: cluster 2024-09-21T05:45:43.664986+0000 mgr.a (mgr.14388) 19535 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:45:45.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:44 smithi049 bash[23528]: cluster 2024-09-21T05:45:43.664986+0000 mgr.a (mgr.14388) 19535 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:45:45.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:44 smithi044 bash[22676]: cluster 2024-09-21T05:45:43.664986+0000 mgr.a (mgr.14388) 19535 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:45:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:46.734 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:46.735 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:46 smithi049 bash[23528]: audit 2024-09-21T05:45:45.544209+0000 mon.a (mon.0) 15428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:46 smithi049 bash[23528]: audit 2024-09-21T05:45:45.554174+0000 mon.a (mon.0) 15429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:46.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:46 smithi049 bash[23528]: audit 2024-09-21T05:45:45.564976+0000 mon.a (mon.0) 15430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:46.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:46 smithi049 bash[23528]: cluster 2024-09-21T05:45:45.667162+0000 mgr.a (mgr.14388) 19536 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:45:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:46 smithi044 bash[22676]: audit 2024-09-21T05:45:45.544209+0000 mon.a (mon.0) 15428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:46 smithi044 bash[22676]: audit 2024-09-21T05:45:45.554174+0000 mon.a (mon.0) 15429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:46 smithi044 bash[22676]: audit 2024-09-21T05:45:45.564976+0000 mon.a (mon.0) 15430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:46.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:46 smithi044 bash[22676]: cluster 2024-09-21T05:45:45.667162+0000 mgr.a (mgr.14388) 19536 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:45:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:46 smithi179 bash[23186]: audit 2024-09-21T05:45:45.544209+0000 mon.a (mon.0) 15428 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:46 smithi179 bash[23186]: audit 2024-09-21T05:45:45.554174+0000 mon.a (mon.0) 15429 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:46 smithi179 bash[23186]: audit 2024-09-21T05:45:45.564976+0000 mon.a (mon.0) 15430 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:47.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:46 smithi179 bash[23186]: cluster 2024-09-21T05:45:45.667162+0000 mgr.a (mgr.14388) 19536 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-21T05:45:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:47.517 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:47.881 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:47 smithi049 bash[23528]: audit 2024-09-21T05:45:47.067794+0000 mgr.a (mgr.14388) 19537 : audit [DBG] from='client.419094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:47.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:47 smithi044 bash[22676]: audit 2024-09-21T05:45:47.067794+0000 mgr.a (mgr.14388) 19537 : audit [DBG] from='client.419094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:48.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:47 smithi179 bash[23186]: audit 2024-09-21T05:45:47.067794+0000 mgr.a (mgr.14388) 19537 : audit [DBG] from='client.419094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:48 smithi044 bash[22676]: cluster 2024-09-21T05:45:47.668182+0000 mgr.a (mgr.14388) 19538 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:49.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:48 smithi179 bash[23186]: cluster 2024-09-21T05:45:47.668182+0000 mgr.a (mgr.14388) 19538 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:48 smithi049 bash[23528]: cluster 2024-09-21T05:45:47.668182+0000 mgr.a (mgr.14388) 19538 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:50.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:50 smithi044 bash[22676]: cluster 2024-09-21T05:45:49.668981+0000 mgr.a (mgr.14388) 19539 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:51.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:50 smithi179 bash[23186]: cluster 2024-09-21T05:45:49.668981+0000 mgr.a (mgr.14388) 19539 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:50 smithi049 bash[23528]: cluster 2024-09-21T05:45:49.668981+0000 mgr.a (mgr.14388) 19539 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:52.519 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:52.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:52.520 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:52.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:52 smithi044 bash[22676]: cluster 2024-09-21T05:45:51.671409+0000 mgr.a (mgr.14388) 19540 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:45:53.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:52 smithi179 bash[23186]: cluster 2024-09-21T05:45:51.671409+0000 mgr.a (mgr.14388) 19540 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:45:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:52 smithi049 bash[23528]: cluster 2024-09-21T05:45:51.671409+0000 mgr.a (mgr.14388) 19540 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:45:53.286 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:53.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:53.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:53.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:53.286 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:45:53.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:53 smithi044 bash[22676]: audit 2024-09-21T05:45:52.860520+0000 mgr.a (mgr.14388) 19541 : audit [DBG] from='client.419172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:54.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:53 smithi179 bash[23186]: audit 2024-09-21T05:45:52.860520+0000 mgr.a (mgr.14388) 19541 : audit [DBG] from='client.419172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:54.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:53 smithi049 bash[23528]: audit 2024-09-21T05:45:52.860520+0000 mgr.a (mgr.14388) 19541 : audit [DBG] from='client.419172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:54 smithi044 bash[22676]: cluster 2024-09-21T05:45:53.672425+0000 mgr.a (mgr.14388) 19542 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:54 smithi044 bash[22676]: audit 2024-09-21T05:45:54.557918+0000 mon.a (mon.0) 15431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:54 smithi044 bash[22676]: audit 2024-09-21T05:45:54.563098+0000 mon.a (mon.0) 15432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:54.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:54 smithi044 bash[22676]: audit 2024-09-21T05:45:54.568070+0000 mon.a (mon.0) 15433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:54.950 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:54 smithi179 bash[23186]: cluster 2024-09-21T05:45:53.672425+0000 mgr.a (mgr.14388) 19542 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:54.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:54 smithi179 bash[23186]: audit 2024-09-21T05:45:54.557918+0000 mon.a (mon.0) 15431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:54.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:54 smithi179 bash[23186]: audit 2024-09-21T05:45:54.563098+0000 mon.a (mon.0) 15432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:54.951 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:54 smithi179 bash[23186]: audit 2024-09-21T05:45:54.568070+0000 mon.a (mon.0) 15433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:54 smithi049 bash[23528]: cluster 2024-09-21T05:45:53.672425+0000 mgr.a (mgr.14388) 19542 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:45:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:54 smithi049 bash[23528]: audit 2024-09-21T05:45:54.557918+0000 mon.a (mon.0) 15431 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:54 smithi049 bash[23528]: audit 2024-09-21T05:45:54.563098+0000 mon.a (mon.0) 15432 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:54 smithi049 bash[23528]: audit 2024-09-21T05:45:54.568070+0000 mon.a (mon.0) 15433 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.969 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:55 smithi179 bash[23186]: audit 2024-09-21T05:45:54.643330+0000 mon.a (mon.0) 15434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.969 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:55 smithi179 bash[23186]: audit 2024-09-21T05:45:54.648999+0000 mon.a (mon.0) 15435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.969 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:55 smithi179 bash[23186]: audit 2024-09-21T05:45:54.656611+0000 mon.a (mon.0) 15436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:55 smithi044 bash[22676]: audit 2024-09-21T05:45:54.643330+0000 mon.a (mon.0) 15434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:55 smithi044 bash[22676]: audit 2024-09-21T05:45:54.648999+0000 mon.a (mon.0) 15435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:55.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:55 smithi044 bash[22676]: audit 2024-09-21T05:45:54.656611+0000 mon.a (mon.0) 15436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:55 smithi049 bash[23528]: audit 2024-09-21T05:45:54.643330+0000 mon.a (mon.0) 15434 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:55 smithi049 bash[23528]: audit 2024-09-21T05:45:54.648999+0000 mon.a (mon.0) 15435 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:56.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:55 smithi049 bash[23528]: audit 2024-09-21T05:45:54.656611+0000 mon.a (mon.0) 15436 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:45:56.918 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:56 smithi179 bash[23186]: cluster 2024-09-21T05:45:55.674736+0000 mgr.a (mgr.14388) 19543 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:45:56.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:56 smithi044 bash[22676]: cluster 2024-09-21T05:45:55.674736+0000 mgr.a (mgr.14388) 19543 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:45:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:56 smithi049 bash[23528]: cluster 2024-09-21T05:45:55.674736+0000 mgr.a (mgr.14388) 19543 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:45:58.287 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:45:58.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:45:58.288 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:45:58.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:58 smithi044 bash[22676]: cluster 2024-09-21T05:45:57.675560+0000 mgr.a (mgr.14388) 19544 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:45:59.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:58 smithi179 bash[23186]: cluster 2024-09-21T05:45:57.675560+0000 mgr.a (mgr.14388) 19544 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:45:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:58 smithi049 bash[23528]: cluster 2024-09-21T05:45:57.675560+0000 mgr.a (mgr.14388) 19544 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:45:59.054 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:45:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:45:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:45:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:45:59.055 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:00.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:45:59 smithi179 bash[23186]: audit 2024-09-21T05:45:58.616905+0000 mgr.a (mgr.14388) 19545 : audit [DBG] from='client.419247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:45:59 smithi049 bash[23528]: audit 2024-09-21T05:45:58.616905+0000 mgr.a (mgr.14388) 19545 : audit [DBG] from='client.419247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:00.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:45:59 smithi044 bash[22676]: audit 2024-09-21T05:45:58.616905+0000 mgr.a (mgr.14388) 19545 : audit [DBG] from='client.419247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:01.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:00 smithi179 bash[23186]: cluster 2024-09-21T05:45:59.676568+0000 mgr.a (mgr.14388) 19546 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:46:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:00 smithi049 bash[23528]: cluster 2024-09-21T05:45:59.676568+0000 mgr.a (mgr.14388) 19546 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:46:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:00 smithi044 bash[22676]: cluster 2024-09-21T05:45:59.676568+0000 mgr.a (mgr.14388) 19546 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:46:03.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:02 smithi179 bash[23186]: cluster 2024-09-21T05:46:01.678897+0000 mgr.a (mgr.14388) 19547 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:46:03.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:02 smithi049 bash[23528]: cluster 2024-09-21T05:46:01.678897+0000 mgr.a (mgr.14388) 19547 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:46:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:02 smithi044 bash[22676]: cluster 2024-09-21T05:46:01.678897+0000 mgr.a (mgr.14388) 19547 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:46:04.056 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:04.057 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:04.057 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:04.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:04.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:04.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:04.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:04.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:05.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:04 smithi179 bash[23186]: cluster 2024-09-21T05:46:03.679694+0000 mgr.a (mgr.14388) 19548 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:46:05.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:04 smithi049 bash[23528]: cluster 2024-09-21T05:46:03.679694+0000 mgr.a (mgr.14388) 19548 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:46:05.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:04 smithi044 bash[22676]: cluster 2024-09-21T05:46:03.679694+0000 mgr.a (mgr.14388) 19548 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:46:06.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:05 smithi049 bash[23528]: audit 2024-09-21T05:46:04.389356+0000 mgr.a (mgr.14388) 19549 : audit [DBG] from='client.419325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:06.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:05 smithi044 bash[22676]: audit 2024-09-21T05:46:04.389356+0000 mgr.a (mgr.14388) 19549 : audit [DBG] from='client.419325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:06.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:05 smithi179 bash[23186]: audit 2024-09-21T05:46:04.389356+0000 mgr.a (mgr.14388) 19549 : audit [DBG] from='client.419325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:06 smithi049 bash[23528]: cluster 2024-09-21T05:46:05.682017+0000 mgr.a (mgr.14388) 19550 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:46:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:06 smithi049 bash[23528]: audit 2024-09-21T05:46:05.792101+0000 mon.a (mon.0) 15437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:06 smithi049 bash[23528]: audit 2024-09-21T05:46:05.801317+0000 mon.a (mon.0) 15438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:06 smithi049 bash[23528]: audit 2024-09-21T05:46:05.812318+0000 mon.a (mon.0) 15439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:06 smithi044 bash[22676]: cluster 2024-09-21T05:46:05.682017+0000 mgr.a (mgr.14388) 19550 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:46:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:06 smithi044 bash[22676]: audit 2024-09-21T05:46:05.792101+0000 mon.a (mon.0) 15437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:06 smithi044 bash[22676]: audit 2024-09-21T05:46:05.801317+0000 mon.a (mon.0) 15438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:06 smithi044 bash[22676]: audit 2024-09-21T05:46:05.812318+0000 mon.a (mon.0) 15439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:06 smithi179 bash[23186]: cluster 2024-09-21T05:46:05.682017+0000 mgr.a (mgr.14388) 19550 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:46:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:06 smithi179 bash[23186]: audit 2024-09-21T05:46:05.792101+0000 mon.a (mon.0) 15437 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:06 smithi179 bash[23186]: audit 2024-09-21T05:46:05.801317+0000 mon.a (mon.0) 15438 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:06 smithi179 bash[23186]: audit 2024-09-21T05:46:05.812318+0000 mon.a (mon.0) 15439 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:09.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:08 smithi049 bash[23528]: cluster 2024-09-21T05:46:07.682797+0000 mgr.a (mgr.14388) 19551 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:08 smithi044 bash[22676]: cluster 2024-09-21T05:46:07.682797+0000 mgr.a (mgr.14388) 19551 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:08 smithi179 bash[23186]: cluster 2024-09-21T05:46:07.682797+0000 mgr.a (mgr.14388) 19551 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:09.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:09.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:09.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:10.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:10.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:10.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:10.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:10 smithi049 bash[23528]: cluster 2024-09-21T05:46:09.683598+0000 mgr.a (mgr.14388) 19552 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:10 smithi049 bash[23528]: audit 2024-09-21T05:46:10.188146+0000 mgr.a (mgr.14388) 19553 : audit [DBG] from='client.419403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:10 smithi044 bash[22676]: cluster 2024-09-21T05:46:09.683598+0000 mgr.a (mgr.14388) 19552 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:10 smithi044 bash[22676]: audit 2024-09-21T05:46:10.188146+0000 mgr.a (mgr.14388) 19553 : audit [DBG] from='client.419403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:10 smithi179 bash[23186]: cluster 2024-09-21T05:46:09.683598+0000 mgr.a (mgr.14388) 19552 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:11.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:10 smithi179 bash[23186]: audit 2024-09-21T05:46:10.188146+0000 mgr.a (mgr.14388) 19553 : audit [DBG] from='client.419403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:12 smithi179 bash[23186]: cluster 2024-09-21T05:46:11.686572+0000 mgr.a (mgr.14388) 19554 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:12 smithi179 bash[23186]: audit 2024-09-21T05:46:12.473111+0000 mon.a (mon.0) 15440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:46:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:12 smithi179 bash[23186]: audit 2024-09-21T05:46:12.480714+0000 mon.a (mon.0) 15441 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:46:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:12 smithi179 bash[23186]: audit 2024-09-21T05:46:12.482742+0000 mon.a (mon.0) 15442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:46:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:12 smithi179 bash[23186]: audit 2024-09-21T05:46:12.494402+0000 mon.a (mon.0) 15443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:13.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:12 smithi179 bash[23186]: audit 2024-09-21T05:46:12.501445+0000 mon.a (mon.0) 15444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:46:13.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:12 smithi044 bash[22676]: cluster 2024-09-21T05:46:11.686572+0000 mgr.a (mgr.14388) 19554 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:13.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:12 smithi044 bash[22676]: audit 2024-09-21T05:46:12.473111+0000 mon.a (mon.0) 15440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:46:13.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:12 smithi044 bash[22676]: audit 2024-09-21T05:46:12.480714+0000 mon.a (mon.0) 15441 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:46:13.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:12 smithi044 bash[22676]: audit 2024-09-21T05:46:12.482742+0000 mon.a (mon.0) 15442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:46:13.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:12 smithi044 bash[22676]: audit 2024-09-21T05:46:12.494402+0000 mon.a (mon.0) 15443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:13.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:12 smithi044 bash[22676]: audit 2024-09-21T05:46:12.501445+0000 mon.a (mon.0) 15444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:46:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:12 smithi049 bash[23528]: cluster 2024-09-21T05:46:11.686572+0000 mgr.a (mgr.14388) 19554 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:12 smithi049 bash[23528]: audit 2024-09-21T05:46:12.473111+0000 mon.a (mon.0) 15440 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:46:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:12 smithi049 bash[23528]: audit 2024-09-21T05:46:12.480714+0000 mon.a (mon.0) 15441 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:46:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:12 smithi049 bash[23528]: audit 2024-09-21T05:46:12.482742+0000 mon.a (mon.0) 15442 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:46:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:12 smithi049 bash[23528]: audit 2024-09-21T05:46:12.494402+0000 mon.a (mon.0) 15443 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:13.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:12 smithi049 bash[23528]: audit 2024-09-21T05:46:12.501445+0000 mon.a (mon.0) 15444 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:46:13.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:46:13 smithi044 bash[22930]: debug 2024-09-21T05:46:13.294+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:46:13.489 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:46:13 smithi044 bash[22930]: debug 2024-09-21T05:46:13.294+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:46:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:13 smithi044 bash[22676]: audit 2024-09-21T05:46:12.503980+0000 mgr.a (mgr.14388) 19555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:46:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:13 smithi044 bash[22676]: audit 2024-09-21T05:46:13.298733+0000 mgr.a (mgr.14388) 19556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:46:13.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:13 smithi044 bash[22676]: cephadm 2024-09-21T05:46:13.299994+0000 mgr.a (mgr.14388) 19557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:46:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:13 smithi179 bash[23186]: audit 2024-09-21T05:46:12.503980+0000 mgr.a (mgr.14388) 19555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:46:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:13 smithi179 bash[23186]: audit 2024-09-21T05:46:13.298733+0000 mgr.a (mgr.14388) 19556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:46:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:13 smithi179 bash[23186]: cephadm 2024-09-21T05:46:13.299994+0000 mgr.a (mgr.14388) 19557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:46:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:13 smithi049 bash[23528]: audit 2024-09-21T05:46:12.503980+0000 mgr.a (mgr.14388) 19555 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:46:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:13 smithi049 bash[23528]: audit 2024-09-21T05:46:13.298733+0000 mgr.a (mgr.14388) 19556 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:46:14.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:13 smithi049 bash[23528]: cephadm 2024-09-21T05:46:13.299994+0000 mgr.a (mgr.14388) 19557 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:46:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:14 smithi044 bash[22676]: cluster 2024-09-21T05:46:13.687759+0000 mgr.a (mgr.14388) 19558 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:14 smithi044 bash[22676]: audit 2024-09-21T05:46:14.737329+0000 mon.a (mon.0) 15445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:14 smithi044 bash[22676]: audit 2024-09-21T05:46:14.745690+0000 mon.a (mon.0) 15446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:14 smithi044 bash[22676]: audit 2024-09-21T05:46:14.756344+0000 mon.a (mon.0) 15447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:14 smithi179 bash[23186]: cluster 2024-09-21T05:46:13.687759+0000 mgr.a (mgr.14388) 19558 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:14 smithi179 bash[23186]: audit 2024-09-21T05:46:14.737329+0000 mon.a (mon.0) 15445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:14 smithi179 bash[23186]: audit 2024-09-21T05:46:14.745690+0000 mon.a (mon.0) 15446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:14 smithi179 bash[23186]: audit 2024-09-21T05:46:14.756344+0000 mon.a (mon.0) 15447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:14 smithi049 bash[23528]: cluster 2024-09-21T05:46:13.687759+0000 mgr.a (mgr.14388) 19558 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:14 smithi049 bash[23528]: audit 2024-09-21T05:46:14.737329+0000 mon.a (mon.0) 15445 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:14 smithi049 bash[23528]: audit 2024-09-21T05:46:14.745690+0000 mon.a (mon.0) 15446 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:14 smithi049 bash[23528]: audit 2024-09-21T05:46:14.756344+0000 mon.a (mon.0) 15447 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:15.644 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:15.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:15.645 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:16.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:15 smithi044 bash[22676]: audit 2024-09-21T05:46:14.845682+0000 mon.a (mon.0) 15448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:15 smithi044 bash[22676]: audit 2024-09-21T05:46:14.854443+0000 mon.a (mon.0) 15449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:15 smithi044 bash[22676]: audit 2024-09-21T05:46:14.862948+0000 mon.a (mon.0) 15450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:15 smithi179 bash[23186]: audit 2024-09-21T05:46:14.845682+0000 mon.a (mon.0) 15448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:15 smithi179 bash[23186]: audit 2024-09-21T05:46:14.854443+0000 mon.a (mon.0) 15449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:15 smithi179 bash[23186]: audit 2024-09-21T05:46:14.862948+0000 mon.a (mon.0) 15450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:15 smithi049 bash[23528]: audit 2024-09-21T05:46:14.845682+0000 mon.a (mon.0) 15448 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:15 smithi049 bash[23528]: audit 2024-09-21T05:46:14.854443+0000 mon.a (mon.0) 15449 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:15 smithi049 bash[23528]: audit 2024-09-21T05:46:14.862948+0000 mon.a (mon.0) 15450 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:16.431 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:16.432 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:16 smithi179 bash[23186]: cluster 2024-09-21T05:46:15.690009+0000 mgr.a (mgr.14388) 19559 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:46:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:16 smithi179 bash[23186]: audit 2024-09-21T05:46:15.977512+0000 mgr.a (mgr.14388) 19560 : audit [DBG] from='client.419583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:17.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:16 smithi044 bash[22676]: cluster 2024-09-21T05:46:15.690009+0000 mgr.a (mgr.14388) 19559 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:46:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:16 smithi044 bash[22676]: audit 2024-09-21T05:46:15.977512+0000 mgr.a (mgr.14388) 19560 : audit [DBG] from='client.419583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:16 smithi049 bash[23528]: cluster 2024-09-21T05:46:15.690009+0000 mgr.a (mgr.14388) 19559 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:46:17.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:16 smithi049 bash[23528]: audit 2024-09-21T05:46:15.977512+0000 mgr.a (mgr.14388) 19560 : audit [DBG] from='client.419583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:19.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:18 smithi044 bash[22676]: cluster 2024-09-21T05:46:17.690966+0000 mgr.a (mgr.14388) 19561 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:46:19.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:18 smithi179 bash[23186]: cluster 2024-09-21T05:46:17.690966+0000 mgr.a (mgr.14388) 19561 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:46:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:18 smithi049 bash[23528]: cluster 2024-09-21T05:46:17.690966+0000 mgr.a (mgr.14388) 19561 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:46:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:20 smithi044 bash[22676]: cluster 2024-09-21T05:46:19.691767+0000 mgr.a (mgr.14388) 19562 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:46:21.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:20 smithi179 bash[23186]: cluster 2024-09-21T05:46:19.691767+0000 mgr.a (mgr.14388) 19562 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:46:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:20 smithi049 bash[23528]: cluster 2024-09-21T05:46:19.691767+0000 mgr.a (mgr.14388) 19562 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:46:21.433 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:21.434 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:21.434 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:22.224 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:22 smithi044 bash[22676]: cluster 2024-09-21T05:46:21.693965+0000 mgr.a (mgr.14388) 19563 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T05:46:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:22 smithi044 bash[22676]: audit 2024-09-21T05:46:21.771416+0000 mgr.a (mgr.14388) 19564 : audit [DBG] from='client.419658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:22 smithi179 bash[23186]: cluster 2024-09-21T05:46:21.693965+0000 mgr.a (mgr.14388) 19563 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T05:46:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:22 smithi179 bash[23186]: audit 2024-09-21T05:46:21.771416+0000 mgr.a (mgr.14388) 19564 : audit [DBG] from='client.419658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:22 smithi049 bash[23528]: cluster 2024-09-21T05:46:21.693965+0000 mgr.a (mgr.14388) 19563 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T05:46:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:22 smithi049 bash[23528]: audit 2024-09-21T05:46:21.771416+0000 mgr.a (mgr.14388) 19564 : audit [DBG] from='client.419658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:24 smithi044 bash[22676]: cluster 2024-09-21T05:46:23.694890+0000 mgr.a (mgr.14388) 19565 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T05:46:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:24 smithi179 bash[23186]: cluster 2024-09-21T05:46:23.694890+0000 mgr.a (mgr.14388) 19565 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T05:46:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:24 smithi049 bash[23528]: cluster 2024-09-21T05:46:23.694890+0000 mgr.a (mgr.14388) 19565 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-21T05:46:27.225 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:27.226 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:27.226 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:27 smithi049 bash[23528]: cluster 2024-09-21T05:46:25.697189+0000 mgr.a (mgr.14388) 19566 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T05:46:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:27 smithi049 bash[23528]: audit 2024-09-21T05:46:26.029565+0000 mon.a (mon.0) 15451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:27 smithi049 bash[23528]: audit 2024-09-21T05:46:26.039710+0000 mon.a (mon.0) 15452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:27 smithi049 bash[23528]: audit 2024-09-21T05:46:26.051528+0000 mon.a (mon.0) 15453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:27 smithi044 bash[22676]: cluster 2024-09-21T05:46:25.697189+0000 mgr.a (mgr.14388) 19566 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T05:46:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:27 smithi044 bash[22676]: audit 2024-09-21T05:46:26.029565+0000 mon.a (mon.0) 15451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:27 smithi044 bash[22676]: audit 2024-09-21T05:46:26.039710+0000 mon.a (mon.0) 15452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:27 smithi044 bash[22676]: audit 2024-09-21T05:46:26.051528+0000 mon.a (mon.0) 15453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:27 smithi179 bash[23186]: cluster 2024-09-21T05:46:25.697189+0000 mgr.a (mgr.14388) 19566 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-21T05:46:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:27 smithi179 bash[23186]: audit 2024-09-21T05:46:26.029565+0000 mon.a (mon.0) 15451 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:27 smithi179 bash[23186]: audit 2024-09-21T05:46:26.039710+0000 mon.a (mon.0) 15452 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:27.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:27 smithi179 bash[23186]: audit 2024-09-21T05:46:26.051528+0000 mon.a (mon.0) 15453 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:28.020 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:28.020 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:28.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:28.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:28.021 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:29 smithi049 bash[23528]: audit 2024-09-21T05:46:27.560772+0000 mgr.a (mgr.14388) 19567 : audit [DBG] from='client.419736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:29 smithi049 bash[23528]: cluster 2024-09-21T05:46:27.697738+0000 mgr.a (mgr.14388) 19568 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:46:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:29 smithi044 bash[22676]: audit 2024-09-21T05:46:27.560772+0000 mgr.a (mgr.14388) 19567 : audit [DBG] from='client.419736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:29 smithi044 bash[22676]: cluster 2024-09-21T05:46:27.697738+0000 mgr.a (mgr.14388) 19568 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:46:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:29 smithi179 bash[23186]: audit 2024-09-21T05:46:27.560772+0000 mgr.a (mgr.14388) 19567 : audit [DBG] from='client.419736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:29 smithi179 bash[23186]: cluster 2024-09-21T05:46:27.697738+0000 mgr.a (mgr.14388) 19568 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:46:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:31 smithi049 bash[23528]: cluster 2024-09-21T05:46:29.698616+0000 mgr.a (mgr.14388) 19569 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:46:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:31 smithi044 bash[22676]: cluster 2024-09-21T05:46:29.698616+0000 mgr.a (mgr.14388) 19569 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:46:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:31 smithi179 bash[23186]: cluster 2024-09-21T05:46:29.698616+0000 mgr.a (mgr.14388) 19569 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-21T05:46:33.022 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:33.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:33.023 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:33 smithi049 bash[23528]: cluster 2024-09-21T05:46:31.700935+0000 mgr.a (mgr.14388) 19570 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:46:33.409 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:33 smithi044 bash[22676]: cluster 2024-09-21T05:46:31.700935+0000 mgr.a (mgr.14388) 19570 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:46:33.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:33 smithi179 bash[23186]: cluster 2024-09-21T05:46:31.700935+0000 mgr.a (mgr.14388) 19570 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-21T05:46:33.829 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:33.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:35 smithi044 bash[22676]: audit 2024-09-21T05:46:33.367210+0000 mgr.a (mgr.14388) 19571 : audit [DBG] from='client.419811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:35 smithi044 bash[22676]: cluster 2024-09-21T05:46:33.701570+0000 mgr.a (mgr.14388) 19572 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:35 smithi044 bash[22676]: audit 2024-09-21T05:46:34.919196+0000 mon.a (mon.0) 15454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:35 smithi044 bash[22676]: audit 2024-09-21T05:46:34.925218+0000 mon.a (mon.0) 15455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:35 smithi044 bash[22676]: audit 2024-09-21T05:46:34.932072+0000 mon.a (mon.0) 15456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:35 smithi179 bash[23186]: audit 2024-09-21T05:46:33.367210+0000 mgr.a (mgr.14388) 19571 : audit [DBG] from='client.419811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:35 smithi179 bash[23186]: cluster 2024-09-21T05:46:33.701570+0000 mgr.a (mgr.14388) 19572 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:35 smithi179 bash[23186]: audit 2024-09-21T05:46:34.919196+0000 mon.a (mon.0) 15454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:35 smithi179 bash[23186]: audit 2024-09-21T05:46:34.925218+0000 mon.a (mon.0) 15455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:35 smithi179 bash[23186]: audit 2024-09-21T05:46:34.932072+0000 mon.a (mon.0) 15456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:35 smithi049 bash[23528]: audit 2024-09-21T05:46:33.367210+0000 mgr.a (mgr.14388) 19571 : audit [DBG] from='client.419811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:35 smithi049 bash[23528]: cluster 2024-09-21T05:46:33.701570+0000 mgr.a (mgr.14388) 19572 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:35.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:35 smithi049 bash[23528]: audit 2024-09-21T05:46:34.919196+0000 mon.a (mon.0) 15454 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:35 smithi049 bash[23528]: audit 2024-09-21T05:46:34.925218+0000 mon.a (mon.0) 15455 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:35.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:35 smithi049 bash[23528]: audit 2024-09-21T05:46:34.932072+0000 mon.a (mon.0) 15456 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.390 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:36 smithi179 bash[23186]: audit 2024-09-21T05:46:35.049700+0000 mon.a (mon.0) 15457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.390 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:36 smithi179 bash[23186]: audit 2024-09-21T05:46:35.061844+0000 mon.a (mon.0) 15458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.390 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:36 smithi179 bash[23186]: audit 2024-09-21T05:46:35.068133+0000 mon.a (mon.0) 15459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:36 smithi044 bash[22676]: audit 2024-09-21T05:46:35.049700+0000 mon.a (mon.0) 15457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:36 smithi044 bash[22676]: audit 2024-09-21T05:46:35.061844+0000 mon.a (mon.0) 15458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:36 smithi044 bash[22676]: audit 2024-09-21T05:46:35.068133+0000 mon.a (mon.0) 15459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:36 smithi049 bash[23528]: audit 2024-09-21T05:46:35.049700+0000 mon.a (mon.0) 15457 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:36 smithi049 bash[23528]: audit 2024-09-21T05:46:35.061844+0000 mon.a (mon.0) 15458 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:36.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:36 smithi049 bash[23528]: audit 2024-09-21T05:46:35.068133+0000 mon.a (mon.0) 15459 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:37.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:37 smithi044 bash[22676]: cluster 2024-09-21T05:46:35.703842+0000 mgr.a (mgr.14388) 19573 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:46:37.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:37 smithi179 bash[23186]: cluster 2024-09-21T05:46:35.703842+0000 mgr.a (mgr.14388) 19573 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:46:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:37 smithi049 bash[23528]: cluster 2024-09-21T05:46:35.703842+0000 mgr.a (mgr.14388) 19573 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:46:38.830 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:38.831 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:38.832 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:39 smithi044 bash[22676]: cluster 2024-09-21T05:46:37.704639+0000 mgr.a (mgr.14388) 19574 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:39.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:39 smithi179 bash[23186]: cluster 2024-09-21T05:46:37.704639+0000 mgr.a (mgr.14388) 19574 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:39.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:39 smithi049 bash[23528]: cluster 2024-09-21T05:46:37.704639+0000 mgr.a (mgr.14388) 19574 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:40.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:40 smithi044 bash[22676]: audit 2024-09-21T05:46:39.161698+0000 mgr.a (mgr.14388) 19575 : audit [DBG] from='client.419883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:40.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:40 smithi179 bash[23186]: audit 2024-09-21T05:46:39.161698+0000 mgr.a (mgr.14388) 19575 : audit [DBG] from='client.419883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:40.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:40 smithi049 bash[23528]: audit 2024-09-21T05:46:39.161698+0000 mgr.a (mgr.14388) 19575 : audit [DBG] from='client.419883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:41 smithi044 bash[22676]: cluster 2024-09-21T05:46:39.705627+0000 mgr.a (mgr.14388) 19576 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:41 smithi179 bash[23186]: cluster 2024-09-21T05:46:39.705627+0000 mgr.a (mgr.14388) 19576 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:41 smithi049 bash[23528]: cluster 2024-09-21T05:46:39.705627+0000 mgr.a (mgr.14388) 19576 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:43 smithi044 bash[22676]: cluster 2024-09-21T05:46:41.707923+0000 mgr.a (mgr.14388) 19577 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:46:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:43 smithi179 bash[23186]: cluster 2024-09-21T05:46:41.707923+0000 mgr.a (mgr.14388) 19577 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:46:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:43 smithi049 bash[23528]: cluster 2024-09-21T05:46:41.707923+0000 mgr.a (mgr.14388) 19577 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:46:44.598 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:44.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:44.599 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:45.390 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:45.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:45.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:45.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:45.390 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:45.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:45 smithi044 bash[22676]: cluster 2024-09-21T05:46:43.708703+0000 mgr.a (mgr.14388) 19578 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:45 smithi179 bash[23186]: cluster 2024-09-21T05:46:43.708703+0000 mgr.a (mgr.14388) 19578 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:45 smithi049 bash[23528]: cluster 2024-09-21T05:46:43.708703+0000 mgr.a (mgr.14388) 19578 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:46.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:46 smithi044 bash[22676]: audit 2024-09-21T05:46:44.937486+0000 mgr.a (mgr.14388) 19579 : audit [DBG] from='client.419958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:46.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:46 smithi179 bash[23186]: audit 2024-09-21T05:46:44.937486+0000 mgr.a (mgr.14388) 19579 : audit [DBG] from='client.419958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:46.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:46 smithi049 bash[23528]: audit 2024-09-21T05:46:44.937486+0000 mgr.a (mgr.14388) 19579 : audit [DBG] from='client.419958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:47 smithi049 bash[23528]: cluster 2024-09-21T05:46:45.711695+0000 mgr.a (mgr.14388) 19580 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:47 smithi049 bash[23528]: audit 2024-09-21T05:46:46.266857+0000 mon.a (mon.0) 15460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:47 smithi049 bash[23528]: audit 2024-09-21T05:46:46.275486+0000 mon.a (mon.0) 15461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:47 smithi049 bash[23528]: audit 2024-09-21T05:46:46.285932+0000 mon.a (mon.0) 15462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:47 smithi044 bash[22676]: cluster 2024-09-21T05:46:45.711695+0000 mgr.a (mgr.14388) 19580 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:47 smithi044 bash[22676]: audit 2024-09-21T05:46:46.266857+0000 mon.a (mon.0) 15460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:47 smithi044 bash[22676]: audit 2024-09-21T05:46:46.275486+0000 mon.a (mon.0) 15461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:47 smithi044 bash[22676]: audit 2024-09-21T05:46:46.285932+0000 mon.a (mon.0) 15462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:47 smithi179 bash[23186]: cluster 2024-09-21T05:46:45.711695+0000 mgr.a (mgr.14388) 19580 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:47 smithi179 bash[23186]: audit 2024-09-21T05:46:46.266857+0000 mon.a (mon.0) 15460 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:47 smithi179 bash[23186]: audit 2024-09-21T05:46:46.275486+0000 mon.a (mon.0) 15461 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:47.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:47 smithi179 bash[23186]: audit 2024-09-21T05:46:46.285932+0000 mon.a (mon.0) 15462 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:49.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:49 smithi049 bash[23528]: cluster 2024-09-21T05:46:47.712512+0000 mgr.a (mgr.14388) 19581 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:49 smithi044 bash[22676]: cluster 2024-09-21T05:46:47.712512+0000 mgr.a (mgr.14388) 19581 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:49.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:49 smithi179 bash[23186]: cluster 2024-09-21T05:46:47.712512+0000 mgr.a (mgr.14388) 19581 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:50.392 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:51.181 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:51.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:51 smithi049 bash[23528]: cluster 2024-09-21T05:46:49.713316+0000 mgr.a (mgr.14388) 19582 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:51 smithi044 bash[22676]: cluster 2024-09-21T05:46:49.713316+0000 mgr.a (mgr.14388) 19582 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:51 smithi179 bash[23186]: cluster 2024-09-21T05:46:49.713316+0000 mgr.a (mgr.14388) 19582 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:52.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:52 smithi049 bash[23528]: audit 2024-09-21T05:46:50.729855+0000 mgr.a (mgr.14388) 19583 : audit [DBG] from='client.420033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:52.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:52 smithi044 bash[22676]: audit 2024-09-21T05:46:50.729855+0000 mgr.a (mgr.14388) 19583 : audit [DBG] from='client.420033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:52.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:52 smithi179 bash[23186]: audit 2024-09-21T05:46:50.729855+0000 mgr.a (mgr.14388) 19583 : audit [DBG] from='client.420033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:53.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:53 smithi049 bash[23528]: cluster 2024-09-21T05:46:51.716297+0000 mgr.a (mgr.14388) 19584 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:53.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:53 smithi044 bash[22676]: cluster 2024-09-21T05:46:51.716297+0000 mgr.a (mgr.14388) 19584 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:53 smithi179 bash[23186]: cluster 2024-09-21T05:46:51.716297+0000 mgr.a (mgr.14388) 19584 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:55.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:55 smithi049 bash[23528]: cluster 2024-09-21T05:46:53.717101+0000 mgr.a (mgr.14388) 19585 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:55 smithi049 bash[23528]: audit 2024-09-21T05:46:55.099543+0000 mon.a (mon.0) 15463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:55 smithi049 bash[23528]: audit 2024-09-21T05:46:55.105021+0000 mon.a (mon.0) 15464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:55 smithi049 bash[23528]: audit 2024-09-21T05:46:55.111390+0000 mon.a (mon.0) 15465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:55 smithi049 bash[23528]: audit 2024-09-21T05:46:55.248613+0000 mon.a (mon.0) 15466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:55 smithi049 bash[23528]: audit 2024-09-21T05:46:55.255444+0000 mon.a (mon.0) 15467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:55 smithi049 bash[23528]: audit 2024-09-21T05:46:55.262794+0000 mon.a (mon.0) 15468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:55 smithi044 bash[22676]: cluster 2024-09-21T05:46:53.717101+0000 mgr.a (mgr.14388) 19585 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:55 smithi044 bash[22676]: audit 2024-09-21T05:46:55.099543+0000 mon.a (mon.0) 15463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:55 smithi044 bash[22676]: audit 2024-09-21T05:46:55.105021+0000 mon.a (mon.0) 15464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:55 smithi044 bash[22676]: audit 2024-09-21T05:46:55.111390+0000 mon.a (mon.0) 15465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:55 smithi044 bash[22676]: audit 2024-09-21T05:46:55.248613+0000 mon.a (mon.0) 15466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:55 smithi044 bash[22676]: audit 2024-09-21T05:46:55.255444+0000 mon.a (mon.0) 15467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:55 smithi044 bash[22676]: audit 2024-09-21T05:46:55.262794+0000 mon.a (mon.0) 15468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:55 smithi179 bash[23186]: cluster 2024-09-21T05:46:53.717101+0000 mgr.a (mgr.14388) 19585 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:46:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:55 smithi179 bash[23186]: audit 2024-09-21T05:46:55.099543+0000 mon.a (mon.0) 15463 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:55 smithi179 bash[23186]: audit 2024-09-21T05:46:55.105021+0000 mon.a (mon.0) 15464 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:55 smithi179 bash[23186]: audit 2024-09-21T05:46:55.111390+0000 mon.a (mon.0) 15465 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:55 smithi179 bash[23186]: audit 2024-09-21T05:46:55.248613+0000 mon.a (mon.0) 15466 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:55 smithi179 bash[23186]: audit 2024-09-21T05:46:55.255444+0000 mon.a (mon.0) 15467 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:55 smithi179 bash[23186]: audit 2024-09-21T05:46:55.262794+0000 mon.a (mon.0) 15468 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:46:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:46:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:46:56.183 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:46:56.974 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:46:56.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:46:56.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:46:56.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:46:56.975 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:46:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:57 smithi049 bash[23528]: cluster 2024-09-21T05:46:55.718421+0000 mgr.a (mgr.14388) 19586 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:57 smithi044 bash[22676]: cluster 2024-09-21T05:46:55.718421+0000 mgr.a (mgr.14388) 19586 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:57.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:57 smithi179 bash[23186]: cluster 2024-09-21T05:46:55.718421+0000 mgr.a (mgr.14388) 19586 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:58.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:58 smithi049 bash[23528]: audit 2024-09-21T05:46:56.518206+0000 mgr.a (mgr.14388) 19587 : audit [DBG] from='client.420111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:58.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:58 smithi044 bash[22676]: audit 2024-09-21T05:46:56.518206+0000 mgr.a (mgr.14388) 19587 : audit [DBG] from='client.420111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:58.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:58 smithi179 bash[23186]: audit 2024-09-21T05:46:56.518206+0000 mgr.a (mgr.14388) 19587 : audit [DBG] from='client.420111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:46:59 smithi044 bash[22676]: cluster 2024-09-21T05:46:57.719345+0000 mgr.a (mgr.14388) 19588 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:59.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:46:59 smithi179 bash[23186]: cluster 2024-09-21T05:46:57.719345+0000 mgr.a (mgr.14388) 19588 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:46:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:46:59 smithi049 bash[23528]: cluster 2024-09-21T05:46:57.719345+0000 mgr.a (mgr.14388) 19588 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:01.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:01 smithi044 bash[22676]: cluster 2024-09-21T05:46:59.720155+0000 mgr.a (mgr.14388) 19589 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:01.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:01 smithi179 bash[23186]: cluster 2024-09-21T05:46:59.720155+0000 mgr.a (mgr.14388) 19589 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:01.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:01 smithi049 bash[23528]: cluster 2024-09-21T05:46:59.720155+0000 mgr.a (mgr.14388) 19589 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:02.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:02.721 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:02.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:02.722 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:02.722 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:03 smithi044 bash[22676]: cluster 2024-09-21T05:47:01.722469+0000 mgr.a (mgr.14388) 19590 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:03 smithi044 bash[22676]: audit 2024-09-21T05:47:02.305436+0000 mgr.a (mgr.14388) 19591 : audit [DBG] from='client.420189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:03 smithi179 bash[23186]: cluster 2024-09-21T05:47:01.722469+0000 mgr.a (mgr.14388) 19590 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:03 smithi179 bash[23186]: audit 2024-09-21T05:47:02.305436+0000 mgr.a (mgr.14388) 19591 : audit [DBG] from='client.420189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:03 smithi049 bash[23528]: cluster 2024-09-21T05:47:01.722469+0000 mgr.a (mgr.14388) 19590 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:03 smithi049 bash[23528]: audit 2024-09-21T05:47:02.305436+0000 mgr.a (mgr.14388) 19591 : audit [DBG] from='client.420189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:05.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:05 smithi044 bash[22676]: cluster 2024-09-21T05:47:03.723386+0000 mgr.a (mgr.14388) 19592 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:05 smithi179 bash[23186]: cluster 2024-09-21T05:47:03.723386+0000 mgr.a (mgr.14388) 19592 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:05 smithi049 bash[23528]: cluster 2024-09-21T05:47:03.723386+0000 mgr.a (mgr.14388) 19592 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:07.723 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:07.724 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:07.724 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:07 smithi044 bash[22676]: cluster 2024-09-21T05:47:05.725669+0000 mgr.a (mgr.14388) 19593 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:07 smithi044 bash[22676]: audit 2024-09-21T05:47:06.470978+0000 mon.a (mon.0) 15469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:07 smithi044 bash[22676]: audit 2024-09-21T05:47:06.481128+0000 mon.a (mon.0) 15470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:07 smithi044 bash[22676]: audit 2024-09-21T05:47:06.493131+0000 mon.a (mon.0) 15471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:07 smithi179 bash[23186]: cluster 2024-09-21T05:47:05.725669+0000 mgr.a (mgr.14388) 19593 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:07 smithi179 bash[23186]: audit 2024-09-21T05:47:06.470978+0000 mon.a (mon.0) 15469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:07 smithi179 bash[23186]: audit 2024-09-21T05:47:06.481128+0000 mon.a (mon.0) 15470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:07 smithi179 bash[23186]: audit 2024-09-21T05:47:06.493131+0000 mon.a (mon.0) 15471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:07 smithi049 bash[23528]: cluster 2024-09-21T05:47:05.725669+0000 mgr.a (mgr.14388) 19593 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:07 smithi049 bash[23528]: audit 2024-09-21T05:47:06.470978+0000 mon.a (mon.0) 15469 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:07 smithi049 bash[23528]: audit 2024-09-21T05:47:06.481128+0000 mon.a (mon.0) 15470 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:07 smithi049 bash[23528]: audit 2024-09-21T05:47:06.493131+0000 mon.a (mon.0) 15471 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:08.510 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:09 smithi049 bash[23528]: cluster 2024-09-21T05:47:07.726204+0000 mgr.a (mgr.14388) 19594 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:09 smithi049 bash[23528]: audit 2024-09-21T05:47:08.051944+0000 mgr.a (mgr.14388) 19595 : audit [DBG] from='client.420267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:09 smithi044 bash[22676]: cluster 2024-09-21T05:47:07.726204+0000 mgr.a (mgr.14388) 19594 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:09.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:09 smithi044 bash[22676]: audit 2024-09-21T05:47:08.051944+0000 mgr.a (mgr.14388) 19595 : audit [DBG] from='client.420267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:09 smithi179 bash[23186]: cluster 2024-09-21T05:47:07.726204+0000 mgr.a (mgr.14388) 19594 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:09.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:09 smithi179 bash[23186]: audit 2024-09-21T05:47:08.051944+0000 mgr.a (mgr.14388) 19595 : audit [DBG] from='client.420267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:11.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:11 smithi044 bash[22676]: cluster 2024-09-21T05:47:09.727072+0000 mgr.a (mgr.14388) 19596 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:11 smithi179 bash[23186]: cluster 2024-09-21T05:47:09.727072+0000 mgr.a (mgr.14388) 19596 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:11 smithi049 bash[23528]: cluster 2024-09-21T05:47:09.727072+0000 mgr.a (mgr.14388) 19596 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:13.511 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:13.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:13.512 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:13.586 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:13 smithi044 bash[22676]: cluster 2024-09-21T05:47:11.729371+0000 mgr.a (mgr.14388) 19597 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:13 smithi179 bash[23186]: cluster 2024-09-21T05:47:11.729371+0000 mgr.a (mgr.14388) 19597 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:13 smithi049 bash[23528]: cluster 2024-09-21T05:47:11.729371+0000 mgr.a (mgr.14388) 19597 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:14.261 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:14.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:14.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:14.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:14.261 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:14.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.375377+0000 mon.a (mon.0) 15472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.965410+0000 mon.a (mon.0) 15473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.979103+0000 mon.a (mon.0) 15474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.984143+0000 mon.a (mon.0) 15475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.989193+0000 mon.a (mon.0) 15476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.990253+0000 mon.a (mon.0) 15477 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.991026+0000 mon.a (mon.0) 15478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.996037+0000 mon.a (mon.0) 15479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22676]: audit 2024-09-21T05:47:13.998606+0000 mon.a (mon.0) 15480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:47:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.375377+0000 mon.a (mon.0) 15472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:47:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.965410+0000 mon.a (mon.0) 15473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.979103+0000 mon.a (mon.0) 15474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.984143+0000 mon.a (mon.0) 15475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.989193+0000 mon.a (mon.0) 15476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.990253+0000 mon.a (mon.0) 15477 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:47:14.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.991026+0000 mon.a (mon.0) 15478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:47:14.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.996037+0000 mon.a (mon.0) 15479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:14 smithi179 bash[23186]: audit 2024-09-21T05:47:13.998606+0000 mon.a (mon.0) 15480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:47:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.375377+0000 mon.a (mon.0) 15472 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:47:14.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.965410+0000 mon.a (mon.0) 15473 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.979103+0000 mon.a (mon.0) 15474 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.984143+0000 mon.a (mon.0) 15475 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.989193+0000 mon.a (mon.0) 15476 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.990253+0000 mon.a (mon.0) 15477 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:47:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.991026+0000 mon.a (mon.0) 15478 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:47:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.996037+0000 mon.a (mon.0) 15479 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:14.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:14 smithi049 bash[23528]: audit 2024-09-21T05:47:13.998606+0000 mon.a (mon.0) 15480 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:47:15.238 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22930]: debug 2024-09-21T05:47:14.965+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:47:15.239 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:47:14 smithi044 bash[22930]: debug 2024-09-21T05:47:14.965+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:47:15.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:15 smithi179 bash[23186]: cluster 2024-09-21T05:47:13.729911+0000 mgr.a (mgr.14388) 19598 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:15.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:15 smithi179 bash[23186]: audit 2024-09-21T05:47:13.828929+0000 mgr.a (mgr.14388) 19599 : audit [DBG] from='client.420345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:15.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:15 smithi179 bash[23186]: audit 2024-09-21T05:47:13.999770+0000 mgr.a (mgr.14388) 19600 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:47:15.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:15 smithi179 bash[23186]: audit 2024-09-21T05:47:15.301864+0000 mon.a (mon.0) 15481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:15 smithi179 bash[23186]: audit 2024-09-21T05:47:15.308271+0000 mon.a (mon.0) 15482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:15 smithi179 bash[23186]: audit 2024-09-21T05:47:15.313883+0000 mon.a (mon.0) 15483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:15 smithi044 bash[22676]: cluster 2024-09-21T05:47:13.729911+0000 mgr.a (mgr.14388) 19598 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:15 smithi044 bash[22676]: audit 2024-09-21T05:47:13.828929+0000 mgr.a (mgr.14388) 19599 : audit [DBG] from='client.420345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:15.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:15 smithi044 bash[22676]: audit 2024-09-21T05:47:13.999770+0000 mgr.a (mgr.14388) 19600 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:47:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:15 smithi044 bash[22676]: audit 2024-09-21T05:47:15.301864+0000 mon.a (mon.0) 15481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:15 smithi044 bash[22676]: audit 2024-09-21T05:47:15.308271+0000 mon.a (mon.0) 15482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:15 smithi044 bash[22676]: audit 2024-09-21T05:47:15.313883+0000 mon.a (mon.0) 15483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:15 smithi049 bash[23528]: cluster 2024-09-21T05:47:13.729911+0000 mgr.a (mgr.14388) 19598 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:15 smithi049 bash[23528]: audit 2024-09-21T05:47:13.828929+0000 mgr.a (mgr.14388) 19599 : audit [DBG] from='client.420345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:15 smithi049 bash[23528]: audit 2024-09-21T05:47:13.999770+0000 mgr.a (mgr.14388) 19600 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:47:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:15 smithi049 bash[23528]: audit 2024-09-21T05:47:15.301864+0000 mon.a (mon.0) 15481 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:15 smithi049 bash[23528]: audit 2024-09-21T05:47:15.308271+0000 mon.a (mon.0) 15482 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:15.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:15 smithi049 bash[23528]: audit 2024-09-21T05:47:15.313883+0000 mon.a (mon.0) 15483 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:16 smithi179 bash[23186]: audit 2024-09-21T05:47:14.971172+0000 mgr.a (mgr.14388) 19601 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:47:16.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:16 smithi179 bash[23186]: cephadm 2024-09-21T05:47:14.972468+0000 mgr.a (mgr.14388) 19602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:47:16.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:16 smithi179 bash[23186]: audit 2024-09-21T05:47:15.469713+0000 mon.a (mon.0) 15484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:16 smithi179 bash[23186]: audit 2024-09-21T05:47:15.476558+0000 mon.a (mon.0) 15485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:16 smithi179 bash[23186]: audit 2024-09-21T05:47:15.483537+0000 mon.a (mon.0) 15486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:16 smithi044 bash[22676]: audit 2024-09-21T05:47:14.971172+0000 mgr.a (mgr.14388) 19601 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:16 smithi044 bash[22676]: cephadm 2024-09-21T05:47:14.972468+0000 mgr.a (mgr.14388) 19602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:16 smithi044 bash[22676]: audit 2024-09-21T05:47:15.469713+0000 mon.a (mon.0) 15484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:16 smithi044 bash[22676]: audit 2024-09-21T05:47:15.476558+0000 mon.a (mon.0) 15485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:16 smithi044 bash[22676]: audit 2024-09-21T05:47:15.483537+0000 mon.a (mon.0) 15486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:16 smithi049 bash[23528]: audit 2024-09-21T05:47:14.971172+0000 mgr.a (mgr.14388) 19601 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:47:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:16 smithi049 bash[23528]: cephadm 2024-09-21T05:47:14.972468+0000 mgr.a (mgr.14388) 19602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:47:16.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:16 smithi049 bash[23528]: audit 2024-09-21T05:47:15.469713+0000 mon.a (mon.0) 15484 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:16 smithi049 bash[23528]: audit 2024-09-21T05:47:15.476558+0000 mon.a (mon.0) 15485 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:16.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:16 smithi049 bash[23528]: audit 2024-09-21T05:47:15.483537+0000 mon.a (mon.0) 15486 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:17.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:17 smithi044 bash[22676]: cluster 2024-09-21T05:47:15.731269+0000 mgr.a (mgr.14388) 19603 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:17.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:17 smithi179 bash[23186]: cluster 2024-09-21T05:47:15.731269+0000 mgr.a (mgr.14388) 19603 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:17.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:17 smithi049 bash[23528]: cluster 2024-09-21T05:47:15.731269+0000 mgr.a (mgr.14388) 19603 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:19.262 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:19.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:19 smithi179 bash[23186]: cluster 2024-09-21T05:47:17.732015+0000 mgr.a (mgr.14388) 19604 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:19.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:19 smithi044 bash[22676]: cluster 2024-09-21T05:47:17.732015+0000 mgr.a (mgr.14388) 19604 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:19 smithi049 bash[23528]: cluster 2024-09-21T05:47:17.732015+0000 mgr.a (mgr.14388) 19604 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:20.048 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:20.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:20.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:20.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:20.049 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:21 smithi044 bash[22676]: audit 2024-09-21T05:47:19.603277+0000 mgr.a (mgr.14388) 19605 : audit [DBG] from='client.420531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:21 smithi044 bash[22676]: cluster 2024-09-21T05:47:19.732537+0000 mgr.a (mgr.14388) 19606 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:21 smithi179 bash[23186]: audit 2024-09-21T05:47:19.603277+0000 mgr.a (mgr.14388) 19605 : audit [DBG] from='client.420531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:21 smithi179 bash[23186]: cluster 2024-09-21T05:47:19.732537+0000 mgr.a (mgr.14388) 19606 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:21 smithi049 bash[23528]: audit 2024-09-21T05:47:19.603277+0000 mgr.a (mgr.14388) 19605 : audit [DBG] from='client.420531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:21 smithi049 bash[23528]: cluster 2024-09-21T05:47:19.732537+0000 mgr.a (mgr.14388) 19606 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:23 smithi044 bash[22676]: cluster 2024-09-21T05:47:21.734974+0000 mgr.a (mgr.14388) 19607 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:23.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:23 smithi179 bash[23186]: cluster 2024-09-21T05:47:21.734974+0000 mgr.a (mgr.14388) 19607 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:23 smithi049 bash[23528]: cluster 2024-09-21T05:47:21.734974+0000 mgr.a (mgr.14388) 19607 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:25.051 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:25 smithi044 bash[22676]: cluster 2024-09-21T05:47:23.735794+0000 mgr.a (mgr.14388) 19608 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:25.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:25 smithi179 bash[23186]: cluster 2024-09-21T05:47:23.735794+0000 mgr.a (mgr.14388) 19608 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:25 smithi049 bash[23528]: cluster 2024-09-21T05:47:23.735794+0000 mgr.a (mgr.14388) 19608 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:47:25.847 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:25.847 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:25.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:26.736 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:26 smithi049 bash[23528]: audit 2024-09-21T05:47:25.389011+0000 mgr.a (mgr.14388) 19609 : audit [DBG] from='client.420609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:26.737 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:26 smithi049 bash[23528]: cluster 2024-09-21T05:47:25.738451+0000 mgr.a (mgr.14388) 19610 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:26 smithi044 bash[22676]: audit 2024-09-21T05:47:25.389011+0000 mgr.a (mgr.14388) 19609 : audit [DBG] from='client.420609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:26.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:26 smithi044 bash[22676]: cluster 2024-09-21T05:47:25.738451+0000 mgr.a (mgr.14388) 19610 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:26 smithi179 bash[23186]: audit 2024-09-21T05:47:25.389011+0000 mgr.a (mgr.14388) 19609 : audit [DBG] from='client.420609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:26.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:26 smithi179 bash[23186]: cluster 2024-09-21T05:47:25.738451+0000 mgr.a (mgr.14388) 19610 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:47:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:27 smithi044 bash[22676]: audit 2024-09-21T05:47:26.710160+0000 mon.a (mon.0) 15487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:27 smithi044 bash[22676]: audit 2024-09-21T05:47:26.720546+0000 mon.a (mon.0) 15488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:27.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:27 smithi044 bash[22676]: audit 2024-09-21T05:47:26.732612+0000 mon.a (mon.0) 15489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:27 smithi179 bash[23186]: audit 2024-09-21T05:47:26.710160+0000 mon.a (mon.0) 15487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:27 smithi179 bash[23186]: audit 2024-09-21T05:47:26.720546+0000 mon.a (mon.0) 15488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:28.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:27 smithi179 bash[23186]: audit 2024-09-21T05:47:26.732612+0000 mon.a (mon.0) 15489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:27 smithi049 bash[23528]: audit 2024-09-21T05:47:26.710160+0000 mon.a (mon.0) 15487 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:27 smithi049 bash[23528]: audit 2024-09-21T05:47:26.720546+0000 mon.a (mon.0) 15488 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:28.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:27 smithi049 bash[23528]: audit 2024-09-21T05:47:26.732612+0000 mon.a (mon.0) 15489 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:28.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:28 smithi044 bash[22676]: cluster 2024-09-21T05:47:27.739196+0000 mgr.a (mgr.14388) 19611 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:47:29.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:28 smithi179 bash[23186]: cluster 2024-09-21T05:47:27.739196+0000 mgr.a (mgr.14388) 19611 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:47:29.042 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:28 smithi049 bash[23528]: cluster 2024-09-21T05:47:27.739196+0000 mgr.a (mgr.14388) 19611 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:47:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:31.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:30 smithi049 bash[23528]: cluster 2024-09-21T05:47:29.739960+0000 mgr.a (mgr.14388) 19612 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:47:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:30 smithi044 bash[22676]: cluster 2024-09-21T05:47:29.739960+0000 mgr.a (mgr.14388) 19612 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:47:31.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:30 smithi179 bash[23186]: cluster 2024-09-21T05:47:29.739960+0000 mgr.a (mgr.14388) 19612 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:47:31.611 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:31.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:31.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:31.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:31.611 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:32.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:31 smithi049 bash[23528]: audit 2024-09-21T05:47:31.179605+0000 mgr.a (mgr.14388) 19613 : audit [DBG] from='client.420681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:32.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:31 smithi044 bash[22676]: audit 2024-09-21T05:47:31.179605+0000 mgr.a (mgr.14388) 19613 : audit [DBG] from='client.420681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:32.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:31 smithi179 bash[23186]: audit 2024-09-21T05:47:31.179605+0000 mgr.a (mgr.14388) 19613 : audit [DBG] from='client.420681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:32 smithi044 bash[22676]: cluster 2024-09-21T05:47:31.742918+0000 mgr.a (mgr.14388) 19614 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:47:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:32 smithi049 bash[23528]: cluster 2024-09-21T05:47:31.742918+0000 mgr.a (mgr.14388) 19614 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:47:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:32 smithi179 bash[23186]: cluster 2024-09-21T05:47:31.742918+0000 mgr.a (mgr.14388) 19614 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:47:35.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:34 smithi044 bash[22676]: cluster 2024-09-21T05:47:33.743884+0000 mgr.a (mgr.14388) 19615 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:47:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:34 smithi179 bash[23186]: cluster 2024-09-21T05:47:33.743884+0000 mgr.a (mgr.14388) 19615 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:47:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:34 smithi049 bash[23528]: cluster 2024-09-21T05:47:33.743884+0000 mgr.a (mgr.14388) 19615 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:47:36.613 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:36.613 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:36.614 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:36.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:36 smithi044 bash[22676]: audit 2024-09-21T05:47:35.512918+0000 mon.a (mon.0) 15490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:36 smithi044 bash[22676]: audit 2024-09-21T05:47:35.520656+0000 mon.a (mon.0) 15491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:36 smithi044 bash[22676]: audit 2024-09-21T05:47:35.531506+0000 mon.a (mon.0) 15492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:36 smithi044 bash[22676]: audit 2024-09-21T05:47:35.637118+0000 mon.a (mon.0) 15493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:36 smithi044 bash[22676]: audit 2024-09-21T05:47:35.642074+0000 mon.a (mon.0) 15494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:36 smithi044 bash[22676]: audit 2024-09-21T05:47:35.648711+0000 mon.a (mon.0) 15495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:36 smithi044 bash[22676]: cluster 2024-09-21T05:47:35.745256+0000 mgr.a (mgr.14388) 19616 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:47:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:36 smithi049 bash[23528]: audit 2024-09-21T05:47:35.512918+0000 mon.a (mon.0) 15490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:36 smithi049 bash[23528]: audit 2024-09-21T05:47:35.520656+0000 mon.a (mon.0) 15491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:36 smithi049 bash[23528]: audit 2024-09-21T05:47:35.531506+0000 mon.a (mon.0) 15492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:36 smithi049 bash[23528]: audit 2024-09-21T05:47:35.637118+0000 mon.a (mon.0) 15493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:36 smithi049 bash[23528]: audit 2024-09-21T05:47:35.642074+0000 mon.a (mon.0) 15494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:36 smithi049 bash[23528]: audit 2024-09-21T05:47:35.648711+0000 mon.a (mon.0) 15495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:36 smithi049 bash[23528]: cluster 2024-09-21T05:47:35.745256+0000 mgr.a (mgr.14388) 19616 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:47:36.977 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:36 smithi179 bash[23186]: audit 2024-09-21T05:47:35.512918+0000 mon.a (mon.0) 15490 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:36 smithi179 bash[23186]: audit 2024-09-21T05:47:35.520656+0000 mon.a (mon.0) 15491 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:36 smithi179 bash[23186]: audit 2024-09-21T05:47:35.531506+0000 mon.a (mon.0) 15492 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:36 smithi179 bash[23186]: audit 2024-09-21T05:47:35.637118+0000 mon.a (mon.0) 15493 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:36 smithi179 bash[23186]: audit 2024-09-21T05:47:35.642074+0000 mon.a (mon.0) 15494 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:36 smithi179 bash[23186]: audit 2024-09-21T05:47:35.648711+0000 mon.a (mon.0) 15495 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:36.978 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:36 smithi179 bash[23186]: cluster 2024-09-21T05:47:35.745256+0000 mgr.a (mgr.14388) 19616 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-21T05:47:37.366 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:37.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:37.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:37.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:37.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:37.971 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:37 smithi179 bash[23186]: audit 2024-09-21T05:47:36.941103+0000 mgr.a (mgr.14388) 19617 : audit [DBG] from='client.420753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:37.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:37 smithi044 bash[22676]: audit 2024-09-21T05:47:36.941103+0000 mgr.a (mgr.14388) 19617 : audit [DBG] from='client.420753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:38.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:37 smithi049 bash[23528]: audit 2024-09-21T05:47:36.941103+0000 mgr.a (mgr.14388) 19617 : audit [DBG] from='client.420753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:38.938 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:38 smithi179 bash[23186]: cluster 2024-09-21T05:47:37.746100+0000 mgr.a (mgr.14388) 19618 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:38.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:38 smithi044 bash[22676]: cluster 2024-09-21T05:47:37.746100+0000 mgr.a (mgr.14388) 19618 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:39.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:38 smithi049 bash[23528]: cluster 2024-09-21T05:47:37.746100+0000 mgr.a (mgr.14388) 19618 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:41.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:40 smithi044 bash[22676]: cluster 2024-09-21T05:47:39.746895+0000 mgr.a (mgr.14388) 19619 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:41.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:40 smithi179 bash[23186]: cluster 2024-09-21T05:47:39.746895+0000 mgr.a (mgr.14388) 19619 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:40 smithi049 bash[23528]: cluster 2024-09-21T05:47:39.746895+0000 mgr.a (mgr.14388) 19619 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:42.367 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:42.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:43.123 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:43.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:43.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:43.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:43.123 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:43.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:42 smithi044 bash[22676]: cluster 2024-09-21T05:47:41.749114+0000 mgr.a (mgr.14388) 19620 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:43.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:42 smithi179 bash[23186]: cluster 2024-09-21T05:47:41.749114+0000 mgr.a (mgr.14388) 19620 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:42 smithi049 bash[23528]: cluster 2024-09-21T05:47:41.749114+0000 mgr.a (mgr.14388) 19620 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:44.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:43 smithi044 bash[22676]: audit 2024-09-21T05:47:42.698963+0000 mgr.a (mgr.14388) 19621 : audit [DBG] from='client.420831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:44.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:43 smithi179 bash[23186]: audit 2024-09-21T05:47:42.698963+0000 mgr.a (mgr.14388) 19621 : audit [DBG] from='client.420831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:44.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:43 smithi049 bash[23528]: audit 2024-09-21T05:47:42.698963+0000 mgr.a (mgr.14388) 19621 : audit [DBG] from='client.420831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:45.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:44 smithi044 bash[22676]: cluster 2024-09-21T05:47:43.750023+0000 mgr.a (mgr.14388) 19622 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:45.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:44 smithi179 bash[23186]: cluster 2024-09-21T05:47:43.750023+0000 mgr.a (mgr.14388) 19622 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:44 smithi049 bash[23528]: cluster 2024-09-21T05:47:43.750023+0000 mgr.a (mgr.14388) 19622 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:47.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:46 smithi044 bash[22676]: cluster 2024-09-21T05:47:45.752231+0000 mgr.a (mgr.14388) 19623 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:47.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:46 smithi179 bash[23186]: cluster 2024-09-21T05:47:45.752231+0000 mgr.a (mgr.14388) 19623 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:46 smithi049 bash[23528]: cluster 2024-09-21T05:47:45.752231+0000 mgr.a (mgr.14388) 19623 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:48.124 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:48.125 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:47 smithi044 bash[22676]: audit 2024-09-21T05:47:46.957083+0000 mon.a (mon.0) 15496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:47 smithi044 bash[22676]: audit 2024-09-21T05:47:46.966942+0000 mon.a (mon.0) 15497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:47 smithi044 bash[22676]: audit 2024-09-21T05:47:46.978923+0000 mon.a (mon.0) 15498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:47 smithi179 bash[23186]: audit 2024-09-21T05:47:46.957083+0000 mon.a (mon.0) 15496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:47 smithi179 bash[23186]: audit 2024-09-21T05:47:46.966942+0000 mon.a (mon.0) 15497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:47 smithi179 bash[23186]: audit 2024-09-21T05:47:46.978923+0000 mon.a (mon.0) 15498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:47 smithi049 bash[23528]: audit 2024-09-21T05:47:46.957083+0000 mon.a (mon.0) 15496 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:47 smithi049 bash[23528]: audit 2024-09-21T05:47:46.966942+0000 mon.a (mon.0) 15497 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:47 smithi049 bash[23528]: audit 2024-09-21T05:47:46.978923+0000 mon.a (mon.0) 15498 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:48.918 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:48.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:48.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:48.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:48.918 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:49.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:48 smithi044 bash[22676]: cluster 2024-09-21T05:47:47.752986+0000 mgr.a (mgr.14388) 19624 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:49.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:48 smithi179 bash[23186]: cluster 2024-09-21T05:47:47.752986+0000 mgr.a (mgr.14388) 19624 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:49.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:48 smithi049 bash[23528]: cluster 2024-09-21T05:47:47.752986+0000 mgr.a (mgr.14388) 19624 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:50.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:49 smithi179 bash[23186]: audit 2024-09-21T05:47:48.457424+0000 mgr.a (mgr.14388) 19625 : audit [DBG] from='client.420909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:50.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:49 smithi049 bash[23528]: audit 2024-09-21T05:47:48.457424+0000 mgr.a (mgr.14388) 19625 : audit [DBG] from='client.420909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:50.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:49 smithi044 bash[22676]: audit 2024-09-21T05:47:48.457424+0000 mgr.a (mgr.14388) 19625 : audit [DBG] from='client.420909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:50 smithi179 bash[23186]: cluster 2024-09-21T05:47:49.753960+0000 mgr.a (mgr.14388) 19626 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:51.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:50 smithi049 bash[23528]: cluster 2024-09-21T05:47:49.753960+0000 mgr.a (mgr.14388) 19626 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:51.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:50 smithi044 bash[22676]: cluster 2024-09-21T05:47:49.753960+0000 mgr.a (mgr.14388) 19626 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:52 smithi179 bash[23186]: cluster 2024-09-21T05:47:51.756217+0000 mgr.a (mgr.14388) 19627 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:53.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:52 smithi049 bash[23528]: cluster 2024-09-21T05:47:51.756217+0000 mgr.a (mgr.14388) 19627 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:53.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:52 smithi044 bash[22676]: cluster 2024-09-21T05:47:51.756217+0000 mgr.a (mgr.14388) 19627 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:53.919 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:53.920 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:53.920 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:47:54.672 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:47:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:47:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:47:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:47:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:47:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:55 smithi179 bash[23186]: cluster 2024-09-21T05:47:53.757099+0000 mgr.a (mgr.14388) 19628 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:55 smithi179 bash[23186]: audit 2024-09-21T05:47:54.258151+0000 mgr.a (mgr.14388) 19629 : audit [DBG] from='client.420987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:55 smithi049 bash[23528]: cluster 2024-09-21T05:47:53.757099+0000 mgr.a (mgr.14388) 19628 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:55 smithi049 bash[23528]: audit 2024-09-21T05:47:54.258151+0000 mgr.a (mgr.14388) 19629 : audit [DBG] from='client.420987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:54 smithi044 bash[22676]: cluster 2024-09-21T05:47:53.757099+0000 mgr.a (mgr.14388) 19628 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:55.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:54 smithi044 bash[22676]: audit 2024-09-21T05:47:54.258151+0000 mgr.a (mgr.14388) 19629 : audit [DBG] from='client.420987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:56 smithi179 bash[23186]: audit 2024-09-21T05:47:55.681427+0000 mon.a (mon.0) 15499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:56 smithi179 bash[23186]: audit 2024-09-21T05:47:55.686618+0000 mon.a (mon.0) 15500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:56 smithi179 bash[23186]: audit 2024-09-21T05:47:55.692471+0000 mon.a (mon.0) 15501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:56 smithi179 bash[23186]: cluster 2024-09-21T05:47:55.759535+0000 mgr.a (mgr.14388) 19630 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:56 smithi179 bash[23186]: audit 2024-09-21T05:47:55.819704+0000 mon.a (mon.0) 15502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:56 smithi179 bash[23186]: audit 2024-09-21T05:47:55.828263+0000 mon.a (mon.0) 15503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:56 smithi179 bash[23186]: audit 2024-09-21T05:47:55.838252+0000 mon.a (mon.0) 15504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:56 smithi044 bash[22676]: audit 2024-09-21T05:47:55.681427+0000 mon.a (mon.0) 15499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:56 smithi044 bash[22676]: audit 2024-09-21T05:47:55.686618+0000 mon.a (mon.0) 15500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:56 smithi044 bash[22676]: audit 2024-09-21T05:47:55.692471+0000 mon.a (mon.0) 15501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:56 smithi044 bash[22676]: cluster 2024-09-21T05:47:55.759535+0000 mgr.a (mgr.14388) 19630 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:56.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:56 smithi044 bash[22676]: audit 2024-09-21T05:47:55.819704+0000 mon.a (mon.0) 15502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:56 smithi044 bash[22676]: audit 2024-09-21T05:47:55.828263+0000 mon.a (mon.0) 15503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:56.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:56 smithi044 bash[22676]: audit 2024-09-21T05:47:55.838252+0000 mon.a (mon.0) 15504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:56 smithi049 bash[23528]: audit 2024-09-21T05:47:55.681427+0000 mon.a (mon.0) 15499 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:57.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:56 smithi049 bash[23528]: audit 2024-09-21T05:47:55.686618+0000 mon.a (mon.0) 15500 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:57.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:56 smithi049 bash[23528]: audit 2024-09-21T05:47:55.692471+0000 mon.a (mon.0) 15501 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:57.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:56 smithi049 bash[23528]: cluster 2024-09-21T05:47:55.759535+0000 mgr.a (mgr.14388) 19630 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:47:57.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:56 smithi049 bash[23528]: audit 2024-09-21T05:47:55.819704+0000 mon.a (mon.0) 15502 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:57.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:56 smithi049 bash[23528]: audit 2024-09-21T05:47:55.828263+0000 mon.a (mon.0) 15503 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:57.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:56 smithi049 bash[23528]: audit 2024-09-21T05:47:55.838252+0000 mon.a (mon.0) 15504 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:47:59.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:47:58 smithi044 bash[22676]: cluster 2024-09-21T05:47:57.760346+0000 mgr.a (mgr.14388) 19631 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:59.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:47:58 smithi179 bash[23186]: cluster 2024-09-21T05:47:57.760346+0000 mgr.a (mgr.14388) 19631 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:59.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:47:58 smithi049 bash[23528]: cluster 2024-09-21T05:47:57.760346+0000 mgr.a (mgr.14388) 19631 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:47:59.674 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:47:59.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:47:59.675 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:00.426 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:00.426 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:00 smithi044 bash[22676]: cluster 2024-09-21T05:47:59.761243+0000 mgr.a (mgr.14388) 19632 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:00 smithi044 bash[22676]: audit 2024-09-21T05:48:00.005802+0000 mgr.a (mgr.14388) 19633 : audit [DBG] from='client.421062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:00 smithi179 bash[23186]: cluster 2024-09-21T05:47:59.761243+0000 mgr.a (mgr.14388) 19632 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:01.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:00 smithi179 bash[23186]: audit 2024-09-21T05:48:00.005802+0000 mgr.a (mgr.14388) 19633 : audit [DBG] from='client.421062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:00 smithi049 bash[23528]: cluster 2024-09-21T05:47:59.761243+0000 mgr.a (mgr.14388) 19632 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:01.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:00 smithi049 bash[23528]: audit 2024-09-21T05:48:00.005802+0000 mgr.a (mgr.14388) 19633 : audit [DBG] from='client.421062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:02 smithi044 bash[22676]: cluster 2024-09-21T05:48:01.764325+0000 mgr.a (mgr.14388) 19634 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:02 smithi179 bash[23186]: cluster 2024-09-21T05:48:01.764325+0000 mgr.a (mgr.14388) 19634 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:02 smithi049 bash[23528]: cluster 2024-09-21T05:48:01.764325+0000 mgr.a (mgr.14388) 19634 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:04 smithi044 bash[22676]: cluster 2024-09-21T05:48:03.765135+0000 mgr.a (mgr.14388) 19635 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:48:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:04 smithi179 bash[23186]: cluster 2024-09-21T05:48:03.765135+0000 mgr.a (mgr.14388) 19635 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:48:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:04 smithi049 bash[23528]: cluster 2024-09-21T05:48:03.765135+0000 mgr.a (mgr.14388) 19635 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:48:05.427 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:05.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:05.428 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:06.228 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:06.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:06.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:06.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:06.228 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:07.211 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:06 smithi049 bash[23528]: audit 2024-09-21T05:48:05.764083+0000 mgr.a (mgr.14388) 19636 : audit [DBG] from='client.421137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:07.211 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:06 smithi049 bash[23528]: cluster 2024-09-21T05:48:05.782904+0000 mgr.a (mgr.14388) 19637 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:06 smithi044 bash[22676]: audit 2024-09-21T05:48:05.764083+0000 mgr.a (mgr.14388) 19636 : audit [DBG] from='client.421137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:06 smithi044 bash[22676]: cluster 2024-09-21T05:48:05.782904+0000 mgr.a (mgr.14388) 19637 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:06 smithi179 bash[23186]: audit 2024-09-21T05:48:05.764083+0000 mgr.a (mgr.14388) 19636 : audit [DBG] from='client.421137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:06 smithi179 bash[23186]: cluster 2024-09-21T05:48:05.782904+0000 mgr.a (mgr.14388) 19637 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:08 smithi044 bash[22676]: audit 2024-09-21T05:48:07.185271+0000 mon.a (mon.0) 15505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:08 smithi044 bash[22676]: audit 2024-09-21T05:48:07.195236+0000 mon.a (mon.0) 15506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:08 smithi044 bash[22676]: audit 2024-09-21T05:48:07.206996+0000 mon.a (mon.0) 15507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:08 smithi179 bash[23186]: audit 2024-09-21T05:48:07.185271+0000 mon.a (mon.0) 15505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:08 smithi179 bash[23186]: audit 2024-09-21T05:48:07.195236+0000 mon.a (mon.0) 15506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:08 smithi179 bash[23186]: audit 2024-09-21T05:48:07.206996+0000 mon.a (mon.0) 15507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:08 smithi049 bash[23528]: audit 2024-09-21T05:48:07.185271+0000 mon.a (mon.0) 15505 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:08 smithi049 bash[23528]: audit 2024-09-21T05:48:07.195236+0000 mon.a (mon.0) 15506 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:08.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:08 smithi049 bash[23528]: audit 2024-09-21T05:48:07.206996+0000 mon.a (mon.0) 15507 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:09.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:09 smithi044 bash[22676]: cluster 2024-09-21T05:48:07.783849+0000 mgr.a (mgr.14388) 19638 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T05:48:09.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:09 smithi179 bash[23186]: cluster 2024-09-21T05:48:07.783849+0000 mgr.a (mgr.14388) 19638 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T05:48:09.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:09 smithi049 bash[23528]: cluster 2024-09-21T05:48:07.783849+0000 mgr.a (mgr.14388) 19638 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T05:48:11.229 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:11.231 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:11.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:11 smithi044 bash[22676]: cluster 2024-09-21T05:48:09.784673+0000 mgr.a (mgr.14388) 19639 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T05:48:11.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:11 smithi179 bash[23186]: cluster 2024-09-21T05:48:09.784673+0000 mgr.a (mgr.14388) 19639 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T05:48:11.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:11 smithi049 bash[23528]: cluster 2024-09-21T05:48:09.784673+0000 mgr.a (mgr.14388) 19639 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-21T05:48:12.026 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:12.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:12.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:12.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:12.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:13.474 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:13 smithi049 bash[23528]: audit 2024-09-21T05:48:11.567431+0000 mgr.a (mgr.14388) 19640 : audit [DBG] from='client.421212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:13.474 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:13 smithi049 bash[23528]: cluster 2024-09-21T05:48:11.786396+0000 mgr.a (mgr.14388) 19641 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:13.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:13 smithi044 bash[22676]: audit 2024-09-21T05:48:11.567431+0000 mgr.a (mgr.14388) 19640 : audit [DBG] from='client.421212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:13.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:13 smithi044 bash[22676]: cluster 2024-09-21T05:48:11.786396+0000 mgr.a (mgr.14388) 19641 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:13 smithi179 bash[23186]: audit 2024-09-21T05:48:11.567431+0000 mgr.a (mgr.14388) 19640 : audit [DBG] from='client.421212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:13.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:13 smithi179 bash[23186]: cluster 2024-09-21T05:48:11.786396+0000 mgr.a (mgr.14388) 19641 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:15 smithi044 bash[22676]: cluster 2024-09-21T05:48:13.787392+0000 mgr.a (mgr.14388) 19642 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:15 smithi044 bash[22676]: audit 2024-09-21T05:48:15.032491+0000 mon.a (mon.0) 15508 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:48:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:15 smithi179 bash[23186]: cluster 2024-09-21T05:48:13.787392+0000 mgr.a (mgr.14388) 19642 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:15.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:15 smithi179 bash[23186]: audit 2024-09-21T05:48:15.032491+0000 mon.a (mon.0) 15508 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:48:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:15 smithi049 bash[23528]: cluster 2024-09-21T05:48:13.787392+0000 mgr.a (mgr.14388) 19642 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:15.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:15 smithi049 bash[23528]: audit 2024-09-21T05:48:15.032491+0000 mon.a (mon.0) 15508 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:48:16.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22930]: debug 2024-09-21T05:48:16.432+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22930]: debug 2024-09-21T05:48:16.432+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.607753+0000 mon.a (mon.0) 15509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.615835+0000 mon.a (mon.0) 15510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.618310+0000 mon.a (mon.0) 15511 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.620078+0000 mon.a (mon.0) 15512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.630729+0000 mon.a (mon.0) 15513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.637121+0000 mon.a (mon.0) 15514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.639552+0000 mgr.a (mgr.14388) 19643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: cluster 2024-09-21T05:48:15.788939+0000 mgr.a (mgr.14388) 19644 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.832811+0000 mon.a (mon.0) 15515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.839082+0000 mon.a (mon.0) 15516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:15.846732+0000 mon.a (mon.0) 15517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:16.028141+0000 mon.a (mon.0) 15518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:16.034466+0000 mon.a (mon.0) 15519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:16 smithi044 bash[22676]: audit 2024-09-21T05:48:16.039903+0000 mon.a (mon.0) 15520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.607753+0000 mon.a (mon.0) 15509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.615835+0000 mon.a (mon.0) 15510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.618310+0000 mon.a (mon.0) 15511 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.620078+0000 mon.a (mon.0) 15512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.630729+0000 mon.a (mon.0) 15513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.637121+0000 mon.a (mon.0) 15514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.639552+0000 mgr.a (mgr.14388) 19643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: cluster 2024-09-21T05:48:15.788939+0000 mgr.a (mgr.14388) 19644 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.832811+0000 mon.a (mon.0) 15515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.839082+0000 mon.a (mon.0) 15516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:15.846732+0000 mon.a (mon.0) 15517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:16.028141+0000 mon.a (mon.0) 15518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.927 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:16.034466+0000 mon.a (mon.0) 15519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:16.927 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:16 smithi179 bash[23186]: audit 2024-09-21T05:48:16.039903+0000 mon.a (mon.0) 15520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.027 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:17.028 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:17.028 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.607753+0000 mon.a (mon.0) 15509 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.615835+0000 mon.a (mon.0) 15510 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.618310+0000 mon.a (mon.0) 15511 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.620078+0000 mon.a (mon.0) 15512 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.630729+0000 mon.a (mon.0) 15513 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.637121+0000 mon.a (mon.0) 15514 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.639552+0000 mgr.a (mgr.14388) 19643 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: cluster 2024-09-21T05:48:15.788939+0000 mgr.a (mgr.14388) 19644 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.832811+0000 mon.a (mon.0) 15515 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.839082+0000 mon.a (mon.0) 15516 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:15.846732+0000 mon.a (mon.0) 15517 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:16.028141+0000 mon.a (mon.0) 15518 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:16.034466+0000 mon.a (mon.0) 15519 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:16 smithi049 bash[23528]: audit 2024-09-21T05:48:16.039903+0000 mon.a (mon.0) 15520 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:17.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:17.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:17.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:17.785 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:17.785 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:17.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:17 smithi179 bash[23186]: audit 2024-09-21T05:48:16.435760+0000 mgr.a (mgr.14388) 19645 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:48:17.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:17 smithi179 bash[23186]: cephadm 2024-09-21T05:48:16.437105+0000 mgr.a (mgr.14388) 19646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:48:17.898 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:17 smithi179 bash[23186]: audit 2024-09-21T05:48:17.349693+0000 mgr.a (mgr.14388) 19647 : audit [DBG] from='client.421398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:17.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:17 smithi044 bash[22676]: audit 2024-09-21T05:48:16.435760+0000 mgr.a (mgr.14388) 19645 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:48:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:17 smithi044 bash[22676]: cephadm 2024-09-21T05:48:16.437105+0000 mgr.a (mgr.14388) 19646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:48:17.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:17 smithi044 bash[22676]: audit 2024-09-21T05:48:17.349693+0000 mgr.a (mgr.14388) 19647 : audit [DBG] from='client.421398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:17 smithi049 bash[23528]: audit 2024-09-21T05:48:16.435760+0000 mgr.a (mgr.14388) 19645 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:48:18.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:17 smithi049 bash[23528]: cephadm 2024-09-21T05:48:16.437105+0000 mgr.a (mgr.14388) 19646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:48:18.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:17 smithi049 bash[23528]: audit 2024-09-21T05:48:17.349693+0000 mgr.a (mgr.14388) 19647 : audit [DBG] from='client.421398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:18.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:18 smithi044 bash[22676]: cluster 2024-09-21T05:48:17.789605+0000 mgr.a (mgr.14388) 19648 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:19.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:18 smithi179 bash[23186]: cluster 2024-09-21T05:48:17.789605+0000 mgr.a (mgr.14388) 19648 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:19.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:18 smithi049 bash[23528]: cluster 2024-09-21T05:48:17.789605+0000 mgr.a (mgr.14388) 19648 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:21.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:20 smithi044 bash[22676]: cluster 2024-09-21T05:48:19.790356+0000 mgr.a (mgr.14388) 19649 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:20 smithi179 bash[23186]: cluster 2024-09-21T05:48:19.790356+0000 mgr.a (mgr.14388) 19649 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:20 smithi049 bash[23528]: cluster 2024-09-21T05:48:19.790356+0000 mgr.a (mgr.14388) 19649 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:22.786 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:22.787 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:22.787 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:23.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:22 smithi044 bash[22676]: cluster 2024-09-21T05:48:21.792630+0000 mgr.a (mgr.14388) 19650 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:22 smithi179 bash[23186]: cluster 2024-09-21T05:48:21.792630+0000 mgr.a (mgr.14388) 19650 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:22 smithi049 bash[23528]: cluster 2024-09-21T05:48:21.792630+0000 mgr.a (mgr.14388) 19650 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:23.565 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:24.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:23 smithi044 bash[22676]: audit 2024-09-21T05:48:23.118763+0000 mgr.a (mgr.14388) 19651 : audit [DBG] from='client.421473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:24.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:23 smithi179 bash[23186]: audit 2024-09-21T05:48:23.118763+0000 mgr.a (mgr.14388) 19651 : audit [DBG] from='client.421473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:24.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:23 smithi049 bash[23528]: audit 2024-09-21T05:48:23.118763+0000 mgr.a (mgr.14388) 19651 : audit [DBG] from='client.421473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:25.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:24 smithi044 bash[22676]: cluster 2024-09-21T05:48:23.793626+0000 mgr.a (mgr.14388) 19652 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:24 smithi179 bash[23186]: cluster 2024-09-21T05:48:23.793626+0000 mgr.a (mgr.14388) 19652 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:24 smithi049 bash[23528]: cluster 2024-09-21T05:48:23.793626+0000 mgr.a (mgr.14388) 19652 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:27.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:26 smithi044 bash[22676]: cluster 2024-09-21T05:48:25.795812+0000 mgr.a (mgr.14388) 19653 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:26 smithi179 bash[23186]: cluster 2024-09-21T05:48:25.795812+0000 mgr.a (mgr.14388) 19653 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:26 smithi049 bash[23528]: cluster 2024-09-21T05:48:25.795812+0000 mgr.a (mgr.14388) 19653 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:28.567 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:28.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:28.568 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:28 smithi044 bash[22676]: audit 2024-09-21T05:48:27.425501+0000 mon.a (mon.0) 15521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:28 smithi044 bash[22676]: audit 2024-09-21T05:48:27.434625+0000 mon.a (mon.0) 15522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:28 smithi044 bash[22676]: audit 2024-09-21T05:48:27.445215+0000 mon.a (mon.0) 15523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:28 smithi044 bash[22676]: cluster 2024-09-21T05:48:27.796581+0000 mgr.a (mgr.14388) 19654 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:28 smithi179 bash[23186]: audit 2024-09-21T05:48:27.425501+0000 mon.a (mon.0) 15521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:28 smithi179 bash[23186]: audit 2024-09-21T05:48:27.434625+0000 mon.a (mon.0) 15522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:28 smithi179 bash[23186]: audit 2024-09-21T05:48:27.445215+0000 mon.a (mon.0) 15523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:28 smithi179 bash[23186]: cluster 2024-09-21T05:48:27.796581+0000 mgr.a (mgr.14388) 19654 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:28 smithi049 bash[23528]: audit 2024-09-21T05:48:27.425501+0000 mon.a (mon.0) 15521 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:28 smithi049 bash[23528]: audit 2024-09-21T05:48:27.434625+0000 mon.a (mon.0) 15522 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:28 smithi049 bash[23528]: audit 2024-09-21T05:48:27.445215+0000 mon.a (mon.0) 15523 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:28.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:28 smithi049 bash[23528]: cluster 2024-09-21T05:48:27.796581+0000 mgr.a (mgr.14388) 19654 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:29.346 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:29.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:29.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:29.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:29.346 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:29 smithi044 bash[22676]: audit 2024-09-21T05:48:28.903738+0000 mgr.a (mgr.14388) 19655 : audit [DBG] from='client.421548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:29 smithi179 bash[23186]: audit 2024-09-21T05:48:28.903738+0000 mgr.a (mgr.14388) 19655 : audit [DBG] from='client.421548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:29 smithi049 bash[23528]: audit 2024-09-21T05:48:28.903738+0000 mgr.a (mgr.14388) 19655 : audit [DBG] from='client.421548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:30.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:30 smithi044 bash[22676]: cluster 2024-09-21T05:48:29.797614+0000 mgr.a (mgr.14388) 19656 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:30.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:30 smithi179 bash[23186]: cluster 2024-09-21T05:48:29.797614+0000 mgr.a (mgr.14388) 19656 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:30 smithi049 bash[23528]: cluster 2024-09-21T05:48:29.797614+0000 mgr.a (mgr.14388) 19656 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:32 smithi044 bash[22676]: cluster 2024-09-21T05:48:31.799895+0000 mgr.a (mgr.14388) 19657 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:32 smithi179 bash[23186]: cluster 2024-09-21T05:48:31.799895+0000 mgr.a (mgr.14388) 19657 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:32 smithi049 bash[23528]: cluster 2024-09-21T05:48:31.799895+0000 mgr.a (mgr.14388) 19657 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:48:34.347 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:34.348 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:34.348 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:35.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:35.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:35.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:35.127 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:35.127 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:35.226 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:34 smithi044 bash[22676]: cluster 2024-09-21T05:48:33.800681+0000 mgr.a (mgr.14388) 19658 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:34 smithi179 bash[23186]: cluster 2024-09-21T05:48:33.800681+0000 mgr.a (mgr.14388) 19658 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:34 smithi049 bash[23528]: cluster 2024-09-21T05:48:33.800681+0000 mgr.a (mgr.14388) 19658 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:36.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:35 smithi044 bash[22676]: audit 2024-09-21T05:48:34.677727+0000 mgr.a (mgr.14388) 19659 : audit [DBG] from='client.421626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:36.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:35 smithi179 bash[23186]: audit 2024-09-21T05:48:34.677727+0000 mgr.a (mgr.14388) 19659 : audit [DBG] from='client.421626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:36.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:35 smithi049 bash[23528]: audit 2024-09-21T05:48:34.677727+0000 mgr.a (mgr.14388) 19659 : audit [DBG] from='client.421626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:37.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:37 smithi179 bash[23186]: cluster 2024-09-21T05:48:35.802416+0000 mgr.a (mgr.14388) 19660 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:48:37.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:37 smithi179 bash[23186]: audit 2024-09-21T05:48:36.009507+0000 mon.a (mon.0) 15524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:37 smithi179 bash[23186]: audit 2024-09-21T05:48:36.017319+0000 mon.a (mon.0) 15525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:37 smithi179 bash[23186]: audit 2024-09-21T05:48:36.027432+0000 mon.a (mon.0) 15526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:37 smithi179 bash[23186]: audit 2024-09-21T05:48:36.245003+0000 mon.a (mon.0) 15527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:37 smithi179 bash[23186]: audit 2024-09-21T05:48:36.253736+0000 mon.a (mon.0) 15528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.247 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:37 smithi179 bash[23186]: audit 2024-09-21T05:48:36.264189+0000 mon.a (mon.0) 15529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:37 smithi049 bash[23528]: cluster 2024-09-21T05:48:35.802416+0000 mgr.a (mgr.14388) 19660 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:48:37.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:37 smithi049 bash[23528]: audit 2024-09-21T05:48:36.009507+0000 mon.a (mon.0) 15524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:37 smithi049 bash[23528]: audit 2024-09-21T05:48:36.017319+0000 mon.a (mon.0) 15525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:37 smithi049 bash[23528]: audit 2024-09-21T05:48:36.027432+0000 mon.a (mon.0) 15526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:37 smithi049 bash[23528]: audit 2024-09-21T05:48:36.245003+0000 mon.a (mon.0) 15527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:37 smithi049 bash[23528]: audit 2024-09-21T05:48:36.253736+0000 mon.a (mon.0) 15528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:37 smithi049 bash[23528]: audit 2024-09-21T05:48:36.264189+0000 mon.a (mon.0) 15529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:37 smithi044 bash[22676]: cluster 2024-09-21T05:48:35.802416+0000 mgr.a (mgr.14388) 19660 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-21T05:48:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:37 smithi044 bash[22676]: audit 2024-09-21T05:48:36.009507+0000 mon.a (mon.0) 15524 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:37 smithi044 bash[22676]: audit 2024-09-21T05:48:36.017319+0000 mon.a (mon.0) 15525 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:37 smithi044 bash[22676]: audit 2024-09-21T05:48:36.027432+0000 mon.a (mon.0) 15526 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:37 smithi044 bash[22676]: audit 2024-09-21T05:48:36.245003+0000 mon.a (mon.0) 15527 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:37 smithi044 bash[22676]: audit 2024-09-21T05:48:36.253736+0000 mon.a (mon.0) 15528 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:37.484 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:37 smithi044 bash[22676]: audit 2024-09-21T05:48:36.264189+0000 mon.a (mon.0) 15529 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:39.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:39 smithi049 bash[23528]: cluster 2024-09-21T05:48:37.803174+0000 mgr.a (mgr.14388) 19661 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:48:39.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:39 smithi044 bash[22676]: cluster 2024-09-21T05:48:37.803174+0000 mgr.a (mgr.14388) 19661 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:48:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:39 smithi179 bash[23186]: cluster 2024-09-21T05:48:37.803174+0000 mgr.a (mgr.14388) 19661 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:48:40.129 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:40.905 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:40.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:40.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:40.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:40.906 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:41.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:41 smithi179 bash[23186]: cluster 2024-09-21T05:48:39.803973+0000 mgr.a (mgr.14388) 19662 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:48:41.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:41 smithi049 bash[23528]: cluster 2024-09-21T05:48:39.803973+0000 mgr.a (mgr.14388) 19662 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:48:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:41 smithi044 bash[22676]: cluster 2024-09-21T05:48:39.803973+0000 mgr.a (mgr.14388) 19662 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:48:42.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:42 smithi049 bash[23528]: audit 2024-09-21T05:48:40.461630+0000 mgr.a (mgr.14388) 19663 : audit [DBG] from='client.421704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:42.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:42 smithi044 bash[22676]: audit 2024-09-21T05:48:40.461630+0000 mgr.a (mgr.14388) 19663 : audit [DBG] from='client.421704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:42.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:42 smithi179 bash[23186]: audit 2024-09-21T05:48:40.461630+0000 mgr.a (mgr.14388) 19663 : audit [DBG] from='client.421704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:43.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:43 smithi049 bash[23528]: cluster 2024-09-21T05:48:41.807067+0000 mgr.a (mgr.14388) 19664 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:43 smithi044 bash[22676]: cluster 2024-09-21T05:48:41.807067+0000 mgr.a (mgr.14388) 19664 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:43 smithi179 bash[23186]: cluster 2024-09-21T05:48:41.807067+0000 mgr.a (mgr.14388) 19664 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:45.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:45 smithi049 bash[23528]: cluster 2024-09-21T05:48:43.807855+0000 mgr.a (mgr.14388) 19665 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:48:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:45 smithi044 bash[22676]: cluster 2024-09-21T05:48:43.807855+0000 mgr.a (mgr.14388) 19665 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:48:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:45 smithi179 bash[23186]: cluster 2024-09-21T05:48:43.807855+0000 mgr.a (mgr.14388) 19665 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:48:45.907 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:45.908 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:46.678 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:47 smithi049 bash[23528]: cluster 2024-09-21T05:48:45.809880+0000 mgr.a (mgr.14388) 19666 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:47.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:47 smithi049 bash[23528]: audit 2024-09-21T05:48:46.244363+0000 mgr.a (mgr.14388) 19667 : audit [DBG] from='client.421782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:47.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:47 smithi044 bash[22676]: cluster 2024-09-21T05:48:45.809880+0000 mgr.a (mgr.14388) 19666 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:47 smithi044 bash[22676]: audit 2024-09-21T05:48:46.244363+0000 mgr.a (mgr.14388) 19667 : audit [DBG] from='client.421782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:47 smithi179 bash[23186]: cluster 2024-09-21T05:48:45.809880+0000 mgr.a (mgr.14388) 19666 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:47 smithi179 bash[23186]: audit 2024-09-21T05:48:46.244363+0000 mgr.a (mgr.14388) 19667 : audit [DBG] from='client.421782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:48 smithi044 bash[22676]: audit 2024-09-21T05:48:47.668959+0000 mon.a (mon.0) 15530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:48 smithi044 bash[22676]: audit 2024-09-21T05:48:47.678212+0000 mon.a (mon.0) 15531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:48 smithi044 bash[22676]: audit 2024-09-21T05:48:47.699927+0000 mon.a (mon.0) 15532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:48.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:48 smithi044 bash[22676]: cluster 2024-09-21T05:48:47.811032+0000 mgr.a (mgr.14388) 19668 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:48:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:48 smithi179 bash[23186]: audit 2024-09-21T05:48:47.668959+0000 mon.a (mon.0) 15530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:48 smithi179 bash[23186]: audit 2024-09-21T05:48:47.678212+0000 mon.a (mon.0) 15531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:48 smithi179 bash[23186]: audit 2024-09-21T05:48:47.699927+0000 mon.a (mon.0) 15532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:49.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:48 smithi179 bash[23186]: cluster 2024-09-21T05:48:47.811032+0000 mgr.a (mgr.14388) 19668 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:48:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:48 smithi049 bash[23528]: audit 2024-09-21T05:48:47.668959+0000 mon.a (mon.0) 15530 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:48 smithi049 bash[23528]: audit 2024-09-21T05:48:47.678212+0000 mon.a (mon.0) 15531 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:49.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:48 smithi049 bash[23528]: audit 2024-09-21T05:48:47.699927+0000 mon.a (mon.0) 15532 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:49.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:48 smithi049 bash[23528]: cluster 2024-09-21T05:48:47.811032+0000 mgr.a (mgr.14388) 19668 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:48:51.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:50 smithi049 bash[23528]: cluster 2024-09-21T05:48:49.811882+0000 mgr.a (mgr.14388) 19669 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:48:51.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:50 smithi044 bash[22676]: cluster 2024-09-21T05:48:49.811882+0000 mgr.a (mgr.14388) 19669 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:48:51.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:50 smithi179 bash[23186]: cluster 2024-09-21T05:48:49.811882+0000 mgr.a (mgr.14388) 19669 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-21T05:48:51.680 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:51.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:51.680 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:52.434 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:52.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:52.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:52.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:52.434 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:53.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:52 smithi049 bash[23528]: cluster 2024-09-21T05:48:51.812945+0000 mgr.a (mgr.14388) 19670 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:48:53.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:52 smithi049 bash[23528]: audit 2024-09-21T05:48:52.009146+0000 mgr.a (mgr.14388) 19671 : audit [DBG] from='client.421860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:52 smithi044 bash[22676]: cluster 2024-09-21T05:48:51.812945+0000 mgr.a (mgr.14388) 19670 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:48:53.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:52 smithi044 bash[22676]: audit 2024-09-21T05:48:52.009146+0000 mgr.a (mgr.14388) 19671 : audit [DBG] from='client.421860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:52 smithi179 bash[23186]: cluster 2024-09-21T05:48:51.812945+0000 mgr.a (mgr.14388) 19670 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:48:53.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:52 smithi179 bash[23186]: audit 2024-09-21T05:48:52.009146+0000 mgr.a (mgr.14388) 19671 : audit [DBG] from='client.421860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:55.143 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:54 smithi044 bash[22676]: cluster 2024-09-21T05:48:53.813845+0000 mgr.a (mgr.14388) 19672 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:55.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:54 smithi179 bash[23186]: cluster 2024-09-21T05:48:53.813845+0000 mgr.a (mgr.14388) 19672 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:55.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:54 smithi049 bash[23528]: cluster 2024-09-21T05:48:53.813845+0000 mgr.a (mgr.14388) 19672 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:57.435 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:48:57.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:48:57.436 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:48:57.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:57 smithi044 bash[22676]: cluster 2024-09-21T05:48:55.816115+0000 mgr.a (mgr.14388) 19673 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:48:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:57 smithi044 bash[22676]: audit 2024-09-21T05:48:56.233394+0000 mon.a (mon.0) 15533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:57 smithi044 bash[22676]: audit 2024-09-21T05:48:56.241387+0000 mon.a (mon.0) 15534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:57 smithi044 bash[22676]: audit 2024-09-21T05:48:56.251410+0000 mon.a (mon.0) 15535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:57 smithi044 bash[22676]: audit 2024-09-21T05:48:56.468665+0000 mon.a (mon.0) 15536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:57 smithi044 bash[22676]: audit 2024-09-21T05:48:56.477058+0000 mon.a (mon.0) 15537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:57 smithi044 bash[22676]: audit 2024-09-21T05:48:56.487201+0000 mon.a (mon.0) 15538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:57 smithi179 bash[23186]: cluster 2024-09-21T05:48:55.816115+0000 mgr.a (mgr.14388) 19673 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:48:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:57 smithi179 bash[23186]: audit 2024-09-21T05:48:56.233394+0000 mon.a (mon.0) 15533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:57 smithi179 bash[23186]: audit 2024-09-21T05:48:56.241387+0000 mon.a (mon.0) 15534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:57 smithi179 bash[23186]: audit 2024-09-21T05:48:56.251410+0000 mon.a (mon.0) 15535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:57 smithi179 bash[23186]: audit 2024-09-21T05:48:56.468665+0000 mon.a (mon.0) 15536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:57 smithi179 bash[23186]: audit 2024-09-21T05:48:56.477058+0000 mon.a (mon.0) 15537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:57 smithi179 bash[23186]: audit 2024-09-21T05:48:56.487201+0000 mon.a (mon.0) 15538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:57 smithi049 bash[23528]: cluster 2024-09-21T05:48:55.816115+0000 mgr.a (mgr.14388) 19673 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:48:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:57 smithi049 bash[23528]: audit 2024-09-21T05:48:56.233394+0000 mon.a (mon.0) 15533 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:57 smithi049 bash[23528]: audit 2024-09-21T05:48:56.241387+0000 mon.a (mon.0) 15534 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:57 smithi049 bash[23528]: audit 2024-09-21T05:48:56.251410+0000 mon.a (mon.0) 15535 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:57 smithi049 bash[23528]: audit 2024-09-21T05:48:56.468665+0000 mon.a (mon.0) 15536 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:57 smithi049 bash[23528]: audit 2024-09-21T05:48:56.477058+0000 mon.a (mon.0) 15537 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:57.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:57 smithi049 bash[23528]: audit 2024-09-21T05:48:56.487201+0000 mon.a (mon.0) 15538 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:48:58.223 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:48:58.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:48:58.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:48:58.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:48:58.223 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:48:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:59 smithi044 bash[22676]: audit 2024-09-21T05:48:57.782112+0000 mgr.a (mgr.14388) 19674 : audit [DBG] from='client.421935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:59.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:48:59 smithi044 bash[22676]: cluster 2024-09-21T05:48:57.816824+0000 mgr.a (mgr.14388) 19675 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:59 smithi179 bash[23186]: audit 2024-09-21T05:48:57.782112+0000 mgr.a (mgr.14388) 19674 : audit [DBG] from='client.421935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:59.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:48:59 smithi179 bash[23186]: cluster 2024-09-21T05:48:57.816824+0000 mgr.a (mgr.14388) 19675 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:48:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:59 smithi049 bash[23528]: audit 2024-09-21T05:48:57.782112+0000 mgr.a (mgr.14388) 19674 : audit [DBG] from='client.421935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:59.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:48:59 smithi049 bash[23528]: cluster 2024-09-21T05:48:57.816824+0000 mgr.a (mgr.14388) 19675 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:01.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:01 smithi179 bash[23186]: cluster 2024-09-21T05:48:59.817737+0000 mgr.a (mgr.14388) 19676 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:01.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:01 smithi049 bash[23528]: cluster 2024-09-21T05:48:59.817737+0000 mgr.a (mgr.14388) 19676 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:01.600 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:01 smithi044 bash[22676]: cluster 2024-09-21T05:48:59.817737+0000 mgr.a (mgr.14388) 19676 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:03.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:03.225 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:03.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:03 smithi179 bash[23186]: cluster 2024-09-21T05:49:01.820088+0000 mgr.a (mgr.14388) 19677 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:03.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:03 smithi049 bash[23528]: cluster 2024-09-21T05:49:01.820088+0000 mgr.a (mgr.14388) 19677 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:03.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:03 smithi044 bash[22676]: cluster 2024-09-21T05:49:01.820088+0000 mgr.a (mgr.14388) 19677 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:04.004 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:05 smithi179 bash[23186]: audit 2024-09-21T05:49:03.562262+0000 mgr.a (mgr.14388) 19678 : audit [DBG] from='client.422007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:05.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:05 smithi179 bash[23186]: cluster 2024-09-21T05:49:03.820763+0000 mgr.a (mgr.14388) 19679 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:05 smithi049 bash[23528]: audit 2024-09-21T05:49:03.562262+0000 mgr.a (mgr.14388) 19678 : audit [DBG] from='client.422007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:05.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:05 smithi049 bash[23528]: cluster 2024-09-21T05:49:03.820763+0000 mgr.a (mgr.14388) 19679 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:05 smithi044 bash[22676]: audit 2024-09-21T05:49:03.562262+0000 mgr.a (mgr.14388) 19678 : audit [DBG] from='client.422007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:05 smithi044 bash[22676]: cluster 2024-09-21T05:49:03.820763+0000 mgr.a (mgr.14388) 19679 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:07.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:07 smithi049 bash[23528]: cluster 2024-09-21T05:49:05.823274+0000 mgr.a (mgr.14388) 19680 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:07.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:07 smithi044 bash[22676]: cluster 2024-09-21T05:49:05.823274+0000 mgr.a (mgr.14388) 19680 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:07.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:07 smithi179 bash[23186]: cluster 2024-09-21T05:49:05.823274+0000 mgr.a (mgr.14388) 19680 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:09.006 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:09.006 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:09.007 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:09.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:08 smithi044 bash[22676]: cluster 2024-09-21T05:49:07.824105+0000 mgr.a (mgr.14388) 19681 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:08 smithi044 bash[22676]: audit 2024-09-21T05:49:07.918077+0000 mon.a (mon.0) 15539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:08 smithi044 bash[22676]: audit 2024-09-21T05:49:07.927234+0000 mon.a (mon.0) 15540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:08 smithi044 bash[22676]: audit 2024-09-21T05:49:07.938338+0000 mon.a (mon.0) 15541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:08 smithi179 bash[23186]: cluster 2024-09-21T05:49:07.824105+0000 mgr.a (mgr.14388) 19681 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:08 smithi179 bash[23186]: audit 2024-09-21T05:49:07.918077+0000 mon.a (mon.0) 15539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:08 smithi179 bash[23186]: audit 2024-09-21T05:49:07.927234+0000 mon.a (mon.0) 15540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:08 smithi179 bash[23186]: audit 2024-09-21T05:49:07.938338+0000 mon.a (mon.0) 15541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:08 smithi049 bash[23528]: cluster 2024-09-21T05:49:07.824105+0000 mgr.a (mgr.14388) 19681 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:08 smithi049 bash[23528]: audit 2024-09-21T05:49:07.918077+0000 mon.a (mon.0) 15539 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:08 smithi049 bash[23528]: audit 2024-09-21T05:49:07.927234+0000 mon.a (mon.0) 15540 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:08 smithi049 bash[23528]: audit 2024-09-21T05:49:07.938338+0000 mon.a (mon.0) 15541 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:09.771 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:09.774 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:10.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:09 smithi044 bash[22676]: audit 2024-09-21T05:49:09.335416+0000 mgr.a (mgr.14388) 19682 : audit [DBG] from='client.422082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:10.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:09 smithi179 bash[23186]: audit 2024-09-21T05:49:09.335416+0000 mgr.a (mgr.14388) 19682 : audit [DBG] from='client.422082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:10.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:09 smithi049 bash[23528]: audit 2024-09-21T05:49:09.335416+0000 mgr.a (mgr.14388) 19682 : audit [DBG] from='client.422082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:11.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:10 smithi044 bash[22676]: cluster 2024-09-21T05:49:09.825096+0000 mgr.a (mgr.14388) 19683 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:11.245 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:10 smithi049 bash[23528]: cluster 2024-09-21T05:49:09.825096+0000 mgr.a (mgr.14388) 19683 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:11.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:10 smithi179 bash[23186]: cluster 2024-09-21T05:49:09.825096+0000 mgr.a (mgr.14388) 19683 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:13.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:12 smithi049 bash[23528]: cluster 2024-09-21T05:49:11.827518+0000 mgr.a (mgr.14388) 19684 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:12 smithi044 bash[22676]: cluster 2024-09-21T05:49:11.827518+0000 mgr.a (mgr.14388) 19684 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:13.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:12 smithi179 bash[23186]: cluster 2024-09-21T05:49:11.827518+0000 mgr.a (mgr.14388) 19684 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:15.212 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:14 smithi049 bash[23528]: cluster 2024-09-21T05:49:13.828475+0000 mgr.a (mgr.14388) 19685 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:15.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:14 smithi044 bash[22676]: cluster 2024-09-21T05:49:13.828475+0000 mgr.a (mgr.14388) 19685 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:14 smithi179 bash[23186]: cluster 2024-09-21T05:49:13.828475+0000 mgr.a (mgr.14388) 19685 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:15.580 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:15.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:15.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:15.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:15.580 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:16.213 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:15 smithi044 bash[22676]: audit 2024-09-21T05:49:15.111248+0000 mgr.a (mgr.14388) 19686 : audit [DBG] from='client.422157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:16.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:15 smithi179 bash[23186]: audit 2024-09-21T05:49:15.111248+0000 mgr.a (mgr.14388) 19686 : audit [DBG] from='client.422157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:16.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:15 smithi049 bash[23528]: audit 2024-09-21T05:49:15.111248+0000 mgr.a (mgr.14388) 19686 : audit [DBG] from='client.422157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:17.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: cluster 2024-09-21T05:49:15.831631+0000 mgr.a (mgr.14388) 19687 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.445820+0000 mon.a (mon.0) 15542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.455030+0000 mon.a (mon.0) 15543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.465540+0000 mon.a (mon.0) 15544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.488637+0000 mon.a (mon.0) 15545 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:49:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.495240+0000 mon.a (mon.0) 15546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:49:17.006 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.497061+0000 mon.a (mon.0) 15547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:49:17.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.509374+0000 mon.a (mon.0) 15548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.516242+0000 mon.a (mon.0) 15549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:49:17.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.681019+0000 mon.a (mon.0) 15550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.687356+0000 mon.a (mon.0) 15551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:16 smithi179 bash[23186]: audit 2024-09-21T05:49:16.697084+0000 mon.a (mon.0) 15552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: cluster 2024-09-21T05:49:15.831631+0000 mgr.a (mgr.14388) 19687 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.445820+0000 mon.a (mon.0) 15542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.455030+0000 mon.a (mon.0) 15543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.465540+0000 mon.a (mon.0) 15544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.488637+0000 mon.a (mon.0) 15545 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:49:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.495240+0000 mon.a (mon.0) 15546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:49:17.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.497061+0000 mon.a (mon.0) 15547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:49:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.509374+0000 mon.a (mon.0) 15548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.516242+0000 mon.a (mon.0) 15549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:49:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.681019+0000 mon.a (mon.0) 15550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.687356+0000 mon.a (mon.0) 15551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.240 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:16 smithi044 bash[22676]: audit 2024-09-21T05:49:16.697084+0000 mon.a (mon.0) 15552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: cluster 2024-09-21T05:49:15.831631+0000 mgr.a (mgr.14388) 19687 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.445820+0000 mon.a (mon.0) 15542 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.455030+0000 mon.a (mon.0) 15543 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.465540+0000 mon.a (mon.0) 15544 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.488637+0000 mon.a (mon.0) 15545 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.495240+0000 mon.a (mon.0) 15546 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.497061+0000 mon.a (mon.0) 15547 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.509374+0000 mon.a (mon.0) 15548 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.516242+0000 mon.a (mon.0) 15549 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.681019+0000 mon.a (mon.0) 15550 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.687356+0000 mon.a (mon.0) 15551 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.305 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:16 smithi049 bash[23528]: audit 2024-09-21T05:49:16.697084+0000 mon.a (mon.0) 15552 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:17.738 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:49:17 smithi044 bash[22930]: debug 2024-09-21T05:49:17.319+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:49:17.739 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:49:17 smithi044 bash[22930]: debug 2024-09-21T05:49:17.323+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:49:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:17 smithi044 bash[22676]: audit 2024-09-21T05:49:16.519013+0000 mgr.a (mgr.14388) 19688 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:49:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:17 smithi044 bash[22676]: audit 2024-09-21T05:49:17.324509+0000 mgr.a (mgr.14388) 19689 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:49:18.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:17 smithi044 bash[22676]: cephadm 2024-09-21T05:49:17.325699+0000 mgr.a (mgr.14388) 19690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:49:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:17 smithi179 bash[23186]: audit 2024-09-21T05:49:16.519013+0000 mgr.a (mgr.14388) 19688 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:49:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:17 smithi179 bash[23186]: audit 2024-09-21T05:49:17.324509+0000 mgr.a (mgr.14388) 19689 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:49:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:17 smithi179 bash[23186]: cephadm 2024-09-21T05:49:17.325699+0000 mgr.a (mgr.14388) 19690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:49:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:17 smithi049 bash[23528]: audit 2024-09-21T05:49:16.519013+0000 mgr.a (mgr.14388) 19688 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:49:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:17 smithi049 bash[23528]: audit 2024-09-21T05:49:17.324509+0000 mgr.a (mgr.14388) 19689 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:49:18.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:17 smithi049 bash[23528]: cephadm 2024-09-21T05:49:17.325699+0000 mgr.a (mgr.14388) 19690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:49:19.237 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:18 smithi179 bash[23186]: cluster 2024-09-21T05:49:17.832762+0000 mgr.a (mgr.14388) 19691 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:19.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:18 smithi044 bash[22676]: cluster 2024-09-21T05:49:17.832762+0000 mgr.a (mgr.14388) 19691 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:19.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:18 smithi049 bash[23528]: cluster 2024-09-21T05:49:17.832762+0000 mgr.a (mgr.14388) 19691 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:21.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:20 smithi044 bash[22676]: cluster 2024-09-21T05:49:19.833643+0000 mgr.a (mgr.14388) 19692 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:21.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:20 smithi179 bash[23186]: cluster 2024-09-21T05:49:19.833643+0000 mgr.a (mgr.14388) 19692 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:21.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:20 smithi049 bash[23528]: cluster 2024-09-21T05:49:19.833643+0000 mgr.a (mgr.14388) 19692 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:21.366 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:21.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:21.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:21.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:21.366 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:22.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:21 smithi044 bash[22676]: audit 2024-09-21T05:49:20.913802+0000 mgr.a (mgr.14388) 19693 : audit [DBG] from='client.422340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:22.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:21 smithi179 bash[23186]: audit 2024-09-21T05:49:20.913802+0000 mgr.a (mgr.14388) 19693 : audit [DBG] from='client.422340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:22.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:21 smithi049 bash[23528]: audit 2024-09-21T05:49:20.913802+0000 mgr.a (mgr.14388) 19693 : audit [DBG] from='client.422340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:23.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:22 smithi044 bash[22676]: cluster 2024-09-21T05:49:21.836678+0000 mgr.a (mgr.14388) 19694 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:23.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:22 smithi179 bash[23186]: cluster 2024-09-21T05:49:21.836678+0000 mgr.a (mgr.14388) 19694 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:23.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:22 smithi049 bash[23528]: cluster 2024-09-21T05:49:21.836678+0000 mgr.a (mgr.14388) 19694 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:24 smithi044 bash[22676]: cluster 2024-09-21T05:49:23.837513+0000 mgr.a (mgr.14388) 19695 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:49:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:24 smithi179 bash[23186]: cluster 2024-09-21T05:49:23.837513+0000 mgr.a (mgr.14388) 19695 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:49:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:24 smithi049 bash[23528]: cluster 2024-09-21T05:49:23.837513+0000 mgr.a (mgr.14388) 19695 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T05:49:26.368 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:26.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:26.368 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:27.154 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:27.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:26 smithi044 bash[22676]: cluster 2024-09-21T05:49:25.839500+0000 mgr.a (mgr.14388) 19696 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:26 smithi179 bash[23186]: cluster 2024-09-21T05:49:25.839500+0000 mgr.a (mgr.14388) 19696 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:26 smithi049 bash[23528]: cluster 2024-09-21T05:49:25.839500+0000 mgr.a (mgr.14388) 19696 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:28.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:27 smithi179 bash[23186]: audit 2024-09-21T05:49:26.700058+0000 mgr.a (mgr.14388) 19697 : audit [DBG] from='client.422418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:28.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:27 smithi049 bash[23528]: audit 2024-09-21T05:49:26.700058+0000 mgr.a (mgr.14388) 19697 : audit [DBG] from='client.422418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:28.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:27 smithi044 bash[22676]: audit 2024-09-21T05:49:26.700058+0000 mgr.a (mgr.14388) 19697 : audit [DBG] from='client.422418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:29 smithi044 bash[22676]: cluster 2024-09-21T05:49:27.840639+0000 mgr.a (mgr.14388) 19698 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:29 smithi044 bash[22676]: audit 2024-09-21T05:49:28.155197+0000 mon.a (mon.0) 15553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:29 smithi044 bash[22676]: audit 2024-09-21T05:49:28.163845+0000 mon.a (mon.0) 15554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:29 smithi044 bash[22676]: audit 2024-09-21T05:49:28.174772+0000 mon.a (mon.0) 15555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:29 smithi179 bash[23186]: cluster 2024-09-21T05:49:27.840639+0000 mgr.a (mgr.14388) 19698 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:29 smithi179 bash[23186]: audit 2024-09-21T05:49:28.155197+0000 mon.a (mon.0) 15553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:29 smithi179 bash[23186]: audit 2024-09-21T05:49:28.163845+0000 mon.a (mon.0) 15554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:29 smithi179 bash[23186]: audit 2024-09-21T05:49:28.174772+0000 mon.a (mon.0) 15555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:29 smithi049 bash[23528]: cluster 2024-09-21T05:49:27.840639+0000 mgr.a (mgr.14388) 19698 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:29.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:29 smithi049 bash[23528]: audit 2024-09-21T05:49:28.155197+0000 mon.a (mon.0) 15553 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:29 smithi049 bash[23528]: audit 2024-09-21T05:49:28.163845+0000 mon.a (mon.0) 15554 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:29.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:29 smithi049 bash[23528]: audit 2024-09-21T05:49:28.174772+0000 mon.a (mon.0) 15555 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:31.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:31 smithi044 bash[22676]: cluster 2024-09-21T05:49:29.841522+0000 mgr.a (mgr.14388) 19699 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:31.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:31 smithi179 bash[23186]: cluster 2024-09-21T05:49:29.841522+0000 mgr.a (mgr.14388) 19699 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:31.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:31 smithi049 bash[23528]: cluster 2024-09-21T05:49:29.841522+0000 mgr.a (mgr.14388) 19699 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:32.952 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:33.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:33 smithi044 bash[22676]: cluster 2024-09-21T05:49:31.843766+0000 mgr.a (mgr.14388) 19700 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:33.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:33 smithi179 bash[23186]: cluster 2024-09-21T05:49:31.843766+0000 mgr.a (mgr.14388) 19700 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:33.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:33 smithi049 bash[23528]: cluster 2024-09-21T05:49:31.843766+0000 mgr.a (mgr.14388) 19700 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:49:34.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:34 smithi044 bash[22676]: audit 2024-09-21T05:49:32.491520+0000 mgr.a (mgr.14388) 19701 : audit [DBG] from='client.422496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:34.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:34 smithi179 bash[23186]: audit 2024-09-21T05:49:32.491520+0000 mgr.a (mgr.14388) 19701 : audit [DBG] from='client.422496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:34.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:34 smithi049 bash[23528]: audit 2024-09-21T05:49:32.491520+0000 mgr.a (mgr.14388) 19701 : audit [DBG] from='client.422496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:35 smithi049 bash[23528]: cluster 2024-09-21T05:49:33.844761+0000 mgr.a (mgr.14388) 19702 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:35 smithi044 bash[22676]: cluster 2024-09-21T05:49:33.844761+0000 mgr.a (mgr.14388) 19702 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:35.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:35 smithi179 bash[23186]: cluster 2024-09-21T05:49:33.844761+0000 mgr.a (mgr.14388) 19702 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:37 smithi179 bash[23186]: cluster 2024-09-21T05:49:35.845982+0000 mgr.a (mgr.14388) 19703 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:37 smithi179 bash[23186]: audit 2024-09-21T05:49:36.688621+0000 mon.a (mon.0) 15556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:37 smithi179 bash[23186]: audit 2024-09-21T05:49:36.693972+0000 mon.a (mon.0) 15557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:37 smithi179 bash[23186]: audit 2024-09-21T05:49:36.700627+0000 mon.a (mon.0) 15558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:37 smithi179 bash[23186]: audit 2024-09-21T05:49:36.906861+0000 mon.a (mon.0) 15559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:37 smithi179 bash[23186]: audit 2024-09-21T05:49:36.916016+0000 mon.a (mon.0) 15560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:37 smithi179 bash[23186]: audit 2024-09-21T05:49:36.926131+0000 mon.a (mon.0) 15561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:37 smithi044 bash[22676]: cluster 2024-09-21T05:49:35.845982+0000 mgr.a (mgr.14388) 19703 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:37 smithi044 bash[22676]: audit 2024-09-21T05:49:36.688621+0000 mon.a (mon.0) 15556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:37 smithi044 bash[22676]: audit 2024-09-21T05:49:36.693972+0000 mon.a (mon.0) 15557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:37 smithi044 bash[22676]: audit 2024-09-21T05:49:36.700627+0000 mon.a (mon.0) 15558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:37 smithi044 bash[22676]: audit 2024-09-21T05:49:36.906861+0000 mon.a (mon.0) 15559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:37 smithi044 bash[22676]: audit 2024-09-21T05:49:36.916016+0000 mon.a (mon.0) 15560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:37 smithi044 bash[22676]: audit 2024-09-21T05:49:36.926131+0000 mon.a (mon.0) 15561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:37 smithi049 bash[23528]: cluster 2024-09-21T05:49:35.845982+0000 mgr.a (mgr.14388) 19703 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:37 smithi049 bash[23528]: audit 2024-09-21T05:49:36.688621+0000 mon.a (mon.0) 15556 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:37 smithi049 bash[23528]: audit 2024-09-21T05:49:36.693972+0000 mon.a (mon.0) 15557 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:37 smithi049 bash[23528]: audit 2024-09-21T05:49:36.700627+0000 mon.a (mon.0) 15558 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:37 smithi049 bash[23528]: audit 2024-09-21T05:49:36.906861+0000 mon.a (mon.0) 15559 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:37 smithi049 bash[23528]: audit 2024-09-21T05:49:36.916016+0000 mon.a (mon.0) 15560 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:37 smithi049 bash[23528]: audit 2024-09-21T05:49:36.926131+0000 mon.a (mon.0) 15561 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:37.953 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:37.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:37.954 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:38.707 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:38.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:38.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:38.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:38.707 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:39 smithi044 bash[22676]: cluster 2024-09-21T05:49:37.846711+0000 mgr.a (mgr.14388) 19704 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:39.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:39 smithi044 bash[22676]: audit 2024-09-21T05:49:38.282124+0000 mgr.a (mgr.14388) 19705 : audit [DBG] from='client.422574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:39 smithi179 bash[23186]: cluster 2024-09-21T05:49:37.846711+0000 mgr.a (mgr.14388) 19704 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:39.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:39 smithi179 bash[23186]: audit 2024-09-21T05:49:38.282124+0000 mgr.a (mgr.14388) 19705 : audit [DBG] from='client.422574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:39.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:39 smithi049 bash[23528]: cluster 2024-09-21T05:49:37.846711+0000 mgr.a (mgr.14388) 19704 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:39.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:39 smithi049 bash[23528]: audit 2024-09-21T05:49:38.282124+0000 mgr.a (mgr.14388) 19705 : audit [DBG] from='client.422574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:41.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:41 smithi044 bash[22676]: cluster 2024-09-21T05:49:39.847641+0000 mgr.a (mgr.14388) 19706 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:41.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:41 smithi179 bash[23186]: cluster 2024-09-21T05:49:39.847641+0000 mgr.a (mgr.14388) 19706 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:41.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:41 smithi049 bash[23528]: cluster 2024-09-21T05:49:39.847641+0000 mgr.a (mgr.14388) 19706 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:43.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:43 smithi044 bash[22676]: cluster 2024-09-21T05:49:41.849934+0000 mgr.a (mgr.14388) 19707 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:43.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:43 smithi179 bash[23186]: cluster 2024-09-21T05:49:41.849934+0000 mgr.a (mgr.14388) 19707 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:43.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:43 smithi049 bash[23528]: cluster 2024-09-21T05:49:41.849934+0000 mgr.a (mgr.14388) 19707 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:43.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:43.709 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:44.483 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:44.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:44.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:44.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:44.484 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:45 smithi044 bash[22676]: cluster 2024-09-21T05:49:43.850553+0000 mgr.a (mgr.14388) 19708 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:45.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:45 smithi044 bash[22676]: audit 2024-09-21T05:49:44.041382+0000 mgr.a (mgr.14388) 19709 : audit [DBG] from='client.422652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:45 smithi179 bash[23186]: cluster 2024-09-21T05:49:43.850553+0000 mgr.a (mgr.14388) 19708 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:45.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:45 smithi179 bash[23186]: audit 2024-09-21T05:49:44.041382+0000 mgr.a (mgr.14388) 19709 : audit [DBG] from='client.422652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:45 smithi049 bash[23528]: cluster 2024-09-21T05:49:43.850553+0000 mgr.a (mgr.14388) 19708 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:45.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:45 smithi049 bash[23528]: audit 2024-09-21T05:49:44.041382+0000 mgr.a (mgr.14388) 19709 : audit [DBG] from='client.422652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:47.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:47 smithi044 bash[22676]: cluster 2024-09-21T05:49:45.852921+0000 mgr.a (mgr.14388) 19710 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:47.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:47 smithi179 bash[23186]: cluster 2024-09-21T05:49:45.852921+0000 mgr.a (mgr.14388) 19710 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:47.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:47 smithi049 bash[23528]: cluster 2024-09-21T05:49:45.852921+0000 mgr.a (mgr.14388) 19710 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:49:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:49 smithi044 bash[22676]: cluster 2024-09-21T05:49:47.853761+0000 mgr.a (mgr.14388) 19711 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:49 smithi044 bash[22676]: audit 2024-09-21T05:49:48.359817+0000 mon.a (mon.0) 15562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:49 smithi044 bash[22676]: audit 2024-09-21T05:49:48.369647+0000 mon.a (mon.0) 15563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:49 smithi044 bash[22676]: audit 2024-09-21T05:49:48.381224+0000 mon.a (mon.0) 15564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:49 smithi179 bash[23186]: cluster 2024-09-21T05:49:47.853761+0000 mgr.a (mgr.14388) 19711 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:49 smithi179 bash[23186]: audit 2024-09-21T05:49:48.359817+0000 mon.a (mon.0) 15562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:49 smithi179 bash[23186]: audit 2024-09-21T05:49:48.369647+0000 mon.a (mon.0) 15563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:49 smithi179 bash[23186]: audit 2024-09-21T05:49:48.381224+0000 mon.a (mon.0) 15564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:49 smithi049 bash[23528]: cluster 2024-09-21T05:49:47.853761+0000 mgr.a (mgr.14388) 19711 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:49 smithi049 bash[23528]: audit 2024-09-21T05:49:48.359817+0000 mon.a (mon.0) 15562 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:49 smithi049 bash[23528]: audit 2024-09-21T05:49:48.369647+0000 mon.a (mon.0) 15563 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:49 smithi049 bash[23528]: audit 2024-09-21T05:49:48.381224+0000 mon.a (mon.0) 15564 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:50.268 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:50.268 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:50.269 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:51 smithi044 bash[22676]: audit 2024-09-21T05:49:49.821972+0000 mgr.a (mgr.14388) 19712 : audit [DBG] from='client.422727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:51.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:51 smithi044 bash[22676]: cluster 2024-09-21T05:49:49.854397+0000 mgr.a (mgr.14388) 19713 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:51 smithi179 bash[23186]: audit 2024-09-21T05:49:49.821972+0000 mgr.a (mgr.14388) 19712 : audit [DBG] from='client.422727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:51.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:51 smithi179 bash[23186]: cluster 2024-09-21T05:49:49.854397+0000 mgr.a (mgr.14388) 19713 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:51 smithi049 bash[23528]: audit 2024-09-21T05:49:49.821972+0000 mgr.a (mgr.14388) 19712 : audit [DBG] from='client.422727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:51 smithi049 bash[23528]: cluster 2024-09-21T05:49:49.854397+0000 mgr.a (mgr.14388) 19713 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:53.690 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:53 smithi049 bash[23528]: cluster 2024-09-21T05:49:51.857442+0000 mgr.a (mgr.14388) 19714 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:53 smithi044 bash[22676]: cluster 2024-09-21T05:49:51.857442+0000 mgr.a (mgr.14388) 19714 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:53 smithi179 bash[23186]: cluster 2024-09-21T05:49:51.857442+0000 mgr.a (mgr.14388) 19714 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:49:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:49:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:49:55.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:55 smithi044 bash[22676]: cluster 2024-09-21T05:49:53.858417+0000 mgr.a (mgr.14388) 19715 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:55 smithi179 bash[23186]: cluster 2024-09-21T05:49:53.858417+0000 mgr.a (mgr.14388) 19715 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:55 smithi049 bash[23528]: cluster 2024-09-21T05:49:53.858417+0000 mgr.a (mgr.14388) 19715 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:56.071 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:49:56.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:49:56.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:49:56.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:49:56.071 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:49:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: audit 2024-09-21T05:49:55.613624+0000 mgr.a (mgr.14388) 19716 : audit [DBG] from='client.422805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: cluster 2024-09-21T05:49:55.860558+0000 mgr.a (mgr.14388) 19717 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:57.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: audit 2024-09-21T05:49:56.904158+0000 mon.a (mon.0) 15565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: audit 2024-09-21T05:49:56.910642+0000 mon.a (mon.0) 15566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: audit 2024-09-21T05:49:56.921776+0000 mon.a (mon.0) 15567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: audit 2024-09-21T05:49:57.113114+0000 mon.a (mon.0) 15568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: audit 2024-09-21T05:49:57.118708+0000 mon.a (mon.0) 15569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:57 smithi179 bash[23186]: audit 2024-09-21T05:49:57.126390+0000 mon.a (mon.0) 15570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: audit 2024-09-21T05:49:55.613624+0000 mgr.a (mgr.14388) 19716 : audit [DBG] from='client.422805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: cluster 2024-09-21T05:49:55.860558+0000 mgr.a (mgr.14388) 19717 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: audit 2024-09-21T05:49:56.904158+0000 mon.a (mon.0) 15565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: audit 2024-09-21T05:49:56.910642+0000 mon.a (mon.0) 15566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: audit 2024-09-21T05:49:56.921776+0000 mon.a (mon.0) 15567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: audit 2024-09-21T05:49:57.113114+0000 mon.a (mon.0) 15568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: audit 2024-09-21T05:49:57.118708+0000 mon.a (mon.0) 15569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:57 smithi044 bash[22676]: audit 2024-09-21T05:49:57.126390+0000 mon.a (mon.0) 15570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: audit 2024-09-21T05:49:55.613624+0000 mgr.a (mgr.14388) 19716 : audit [DBG] from='client.422805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: cluster 2024-09-21T05:49:55.860558+0000 mgr.a (mgr.14388) 19717 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:49:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: audit 2024-09-21T05:49:56.904158+0000 mon.a (mon.0) 15565 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: audit 2024-09-21T05:49:56.910642+0000 mon.a (mon.0) 15566 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: audit 2024-09-21T05:49:56.921776+0000 mon.a (mon.0) 15567 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: audit 2024-09-21T05:49:57.113114+0000 mon.a (mon.0) 15568 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: audit 2024-09-21T05:49:57.118708+0000 mon.a (mon.0) 15569 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:57.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:57 smithi049 bash[23528]: audit 2024-09-21T05:49:57.126390+0000 mon.a (mon.0) 15570 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:49:59.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:49:59 smithi044 bash[22676]: cluster 2024-09-21T05:49:57.861480+0000 mgr.a (mgr.14388) 19718 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:59.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:49:59 smithi179 bash[23186]: cluster 2024-09-21T05:49:57.861480+0000 mgr.a (mgr.14388) 19718 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:49:59.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:49:59 smithi049 bash[23528]: cluster 2024-09-21T05:49:57.861480+0000 mgr.a (mgr.14388) 19718 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:00.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:00 smithi044 bash[22676]: cluster 2024-09-21T05:50:00.000133+0000 mon.a (mon.0) 15571 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:50:00.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:00 smithi179 bash[23186]: cluster 2024-09-21T05:50:00.000133+0000 mon.a (mon.0) 15571 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:50:00.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:00 smithi049 bash[23528]: cluster 2024-09-21T05:50:00.000133+0000 mon.a (mon.0) 15571 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-21T05:50:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:01.073 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:01.074 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:01.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:01 smithi044 bash[22676]: cluster 2024-09-21T05:49:59.862277+0000 mgr.a (mgr.14388) 19719 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:01.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:01 smithi179 bash[23186]: cluster 2024-09-21T05:49:59.862277+0000 mgr.a (mgr.14388) 19719 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:01.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:01 smithi049 bash[23528]: cluster 2024-09-21T05:49:59.862277+0000 mgr.a (mgr.14388) 19719 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:01.848 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:01.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:01.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:01.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:01.848 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:03 smithi044 bash[22676]: audit 2024-09-21T05:50:01.403061+0000 mgr.a (mgr.14388) 19720 : audit [DBG] from='client.422880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:03.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:03 smithi044 bash[22676]: cluster 2024-09-21T05:50:01.863582+0000 mgr.a (mgr.14388) 19721 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:03 smithi179 bash[23186]: audit 2024-09-21T05:50:01.403061+0000 mgr.a (mgr.14388) 19720 : audit [DBG] from='client.422880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:03.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:03 smithi179 bash[23186]: cluster 2024-09-21T05:50:01.863582+0000 mgr.a (mgr.14388) 19721 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:03 smithi049 bash[23528]: audit 2024-09-21T05:50:01.403061+0000 mgr.a (mgr.14388) 19720 : audit [DBG] from='client.422880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:03.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:03 smithi049 bash[23528]: cluster 2024-09-21T05:50:01.863582+0000 mgr.a (mgr.14388) 19721 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:05.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:05 smithi044 bash[22676]: cluster 2024-09-21T05:50:03.864320+0000 mgr.a (mgr.14388) 19722 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:05.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:05 smithi179 bash[23186]: cluster 2024-09-21T05:50:03.864320+0000 mgr.a (mgr.14388) 19722 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:05.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:05 smithi049 bash[23528]: cluster 2024-09-21T05:50:03.864320+0000 mgr.a (mgr.14388) 19722 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:06.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:06 smithi044 bash[22676]: cluster 2024-09-21T05:50:05.866381+0000 mgr.a (mgr.14388) 19723 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:06.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:06 smithi179 bash[23186]: cluster 2024-09-21T05:50:05.866381+0000 mgr.a (mgr.14388) 19723 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:06.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:06 smithi049 bash[23528]: cluster 2024-09-21T05:50:05.866381+0000 mgr.a (mgr.14388) 19723 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:06.849 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:06.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:06.850 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:07.642 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:07.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:07.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:07.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:07.642 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:07.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:07 smithi044 bash[22676]: audit 2024-09-21T05:50:07.182123+0000 mgr.a (mgr.14388) 19724 : audit [DBG] from='client.422958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:07.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:07 smithi179 bash[23186]: audit 2024-09-21T05:50:07.182123+0000 mgr.a (mgr.14388) 19724 : audit [DBG] from='client.422958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:07.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:07 smithi049 bash[23528]: audit 2024-09-21T05:50:07.182123+0000 mgr.a (mgr.14388) 19724 : audit [DBG] from='client.422958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:08.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:08 smithi044 bash[22676]: cluster 2024-09-21T05:50:07.867374+0000 mgr.a (mgr.14388) 19725 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:08.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:08 smithi179 bash[23186]: cluster 2024-09-21T05:50:07.867374+0000 mgr.a (mgr.14388) 19725 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:08.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:08 smithi049 bash[23528]: cluster 2024-09-21T05:50:07.867374+0000 mgr.a (mgr.14388) 19725 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:09 smithi044 bash[22676]: audit 2024-09-21T05:50:08.577408+0000 mon.a (mon.0) 15572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:09 smithi044 bash[22676]: audit 2024-09-21T05:50:08.586466+0000 mon.a (mon.0) 15573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:09.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:09 smithi044 bash[22676]: audit 2024-09-21T05:50:08.597374+0000 mon.a (mon.0) 15574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:10.004 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:09 smithi179 bash[23186]: audit 2024-09-21T05:50:08.577408+0000 mon.a (mon.0) 15572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:09 smithi179 bash[23186]: audit 2024-09-21T05:50:08.586466+0000 mon.a (mon.0) 15573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:10.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:09 smithi179 bash[23186]: audit 2024-09-21T05:50:08.597374+0000 mon.a (mon.0) 15574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:09 smithi049 bash[23528]: audit 2024-09-21T05:50:08.577408+0000 mon.a (mon.0) 15572 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:09 smithi049 bash[23528]: audit 2024-09-21T05:50:08.586466+0000 mon.a (mon.0) 15573 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:10.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:09 smithi049 bash[23528]: audit 2024-09-21T05:50:08.597374+0000 mon.a (mon.0) 15574 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:10.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:10 smithi044 bash[22676]: cluster 2024-09-21T05:50:09.868179+0000 mgr.a (mgr.14388) 19726 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:11.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:10 smithi179 bash[23186]: cluster 2024-09-21T05:50:09.868179+0000 mgr.a (mgr.14388) 19726 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:11.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:10 smithi049 bash[23528]: cluster 2024-09-21T05:50:09.868179+0000 mgr.a (mgr.14388) 19726 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:12.643 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:13.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:12 smithi044 bash[22676]: cluster 2024-09-21T05:50:11.870526+0000 mgr.a (mgr.14388) 19727 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:13.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:12 smithi179 bash[23186]: cluster 2024-09-21T05:50:11.870526+0000 mgr.a (mgr.14388) 19727 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:13.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:12 smithi049 bash[23528]: cluster 2024-09-21T05:50:11.870526+0000 mgr.a (mgr.14388) 19727 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:13.399 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:13.399 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:14.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:13 smithi044 bash[22676]: audit 2024-09-21T05:50:12.971831+0000 mgr.a (mgr.14388) 19728 : audit [DBG] from='client.423036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:14.253 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:13 smithi049 bash[23528]: audit 2024-09-21T05:50:12.971831+0000 mgr.a (mgr.14388) 19728 : audit [DBG] from='client.423036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:14.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:13 smithi179 bash[23186]: audit 2024-09-21T05:50:12.971831+0000 mgr.a (mgr.14388) 19728 : audit [DBG] from='client.423036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:15.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:14 smithi044 bash[22676]: cluster 2024-09-21T05:50:13.871677+0000 mgr.a (mgr.14388) 19729 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:15.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:14 smithi179 bash[23186]: cluster 2024-09-21T05:50:13.871677+0000 mgr.a (mgr.14388) 19729 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:15.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:14 smithi049 bash[23528]: cluster 2024-09-21T05:50:13.871677+0000 mgr.a (mgr.14388) 19729 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:17.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:16 smithi049 bash[23528]: cluster 2024-09-21T05:50:15.874591+0000 mgr.a (mgr.14388) 19730 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:17.173 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:16 smithi044 bash[22676]: cluster 2024-09-21T05:50:15.874591+0000 mgr.a (mgr.14388) 19730 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:17.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:16 smithi179 bash[23186]: cluster 2024-09-21T05:50:15.874591+0000 mgr.a (mgr.14388) 19730 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:18.400 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:18.400 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:18.401 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:18.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22930]: debug 2024-09-21T05:50:18.206+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:50:18.488 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22930]: debug 2024-09-21T05:50:18.206+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.147376+0000 mon.a (mon.0) 15575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.156863+0000 mon.a (mon.0) 15576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.168907+0000 mon.a (mon.0) 15577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.291732+0000 mon.a (mon.0) 15578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.298024+0000 mon.a (mon.0) 15579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.303678+0000 mon.a (mon.0) 15580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.374300+0000 mon.a (mon.0) 15581 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.380676+0000 mon.a (mon.0) 15582 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.382639+0000 mon.a (mon.0) 15583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.393735+0000 mon.a (mon.0) 15584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:18 smithi044 bash[22676]: audit 2024-09-21T05:50:17.399834+0000 mon.a (mon.0) 15585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:50:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.147376+0000 mon.a (mon.0) 15575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.156863+0000 mon.a (mon.0) 15576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.168907+0000 mon.a (mon.0) 15577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.291732+0000 mon.a (mon.0) 15578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.298024+0000 mon.a (mon.0) 15579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.303678+0000 mon.a (mon.0) 15580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.505 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.374300+0000 mon.a (mon.0) 15581 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:50:18.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.380676+0000 mon.a (mon.0) 15582 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:50:18.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.382639+0000 mon.a (mon.0) 15583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:50:18.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.393735+0000 mon.a (mon.0) 15584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.506 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:18 smithi179 bash[23186]: audit 2024-09-21T05:50:17.399834+0000 mon.a (mon.0) 15585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:50:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.147376+0000 mon.a (mon.0) 15575 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.156863+0000 mon.a (mon.0) 15576 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.168907+0000 mon.a (mon.0) 15577 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.291732+0000 mon.a (mon.0) 15578 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.298024+0000 mon.a (mon.0) 15579 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.303678+0000 mon.a (mon.0) 15580 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.374300+0000 mon.a (mon.0) 15581 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.380676+0000 mon.a (mon.0) 15582 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.382639+0000 mon.a (mon.0) 15583 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.393735+0000 mon.a (mon.0) 15584 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:18 smithi049 bash[23528]: audit 2024-09-21T05:50:17.399834+0000 mon.a (mon.0) 15585 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:50:19.144 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:19.144 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:19 smithi044 bash[22676]: audit 2024-09-21T05:50:17.402284+0000 mgr.a (mgr.14388) 19731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:50:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:19 smithi044 bash[22676]: cluster 2024-09-21T05:50:17.875166+0000 mgr.a (mgr.14388) 19732 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:19 smithi044 bash[22676]: audit 2024-09-21T05:50:18.209679+0000 mgr.a (mgr.14388) 19733 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:50:19.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:19 smithi044 bash[22676]: cephadm 2024-09-21T05:50:18.211187+0000 mgr.a (mgr.14388) 19734 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:50:19.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:19 smithi179 bash[23186]: audit 2024-09-21T05:50:17.402284+0000 mgr.a (mgr.14388) 19731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:50:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:19 smithi179 bash[23186]: cluster 2024-09-21T05:50:17.875166+0000 mgr.a (mgr.14388) 19732 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:19 smithi179 bash[23186]: audit 2024-09-21T05:50:18.209679+0000 mgr.a (mgr.14388) 19733 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:50:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:19 smithi179 bash[23186]: cephadm 2024-09-21T05:50:18.211187+0000 mgr.a (mgr.14388) 19734 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:50:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:19 smithi049 bash[23528]: audit 2024-09-21T05:50:17.402284+0000 mgr.a (mgr.14388) 19731 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:50:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:19 smithi049 bash[23528]: cluster 2024-09-21T05:50:17.875166+0000 mgr.a (mgr.14388) 19732 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:19 smithi049 bash[23528]: audit 2024-09-21T05:50:18.209679+0000 mgr.a (mgr.14388) 19733 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:50:19.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:19 smithi049 bash[23528]: cephadm 2024-09-21T05:50:18.211187+0000 mgr.a (mgr.14388) 19734 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:50:20.675 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:20 smithi179 bash[23186]: audit 2024-09-21T05:50:18.716432+0000 mgr.a (mgr.14388) 19735 : audit [DBG] from='client.423219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:20.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:20 smithi044 bash[22676]: audit 2024-09-21T05:50:18.716432+0000 mgr.a (mgr.14388) 19735 : audit [DBG] from='client.423219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:20 smithi049 bash[23528]: audit 2024-09-21T05:50:18.716432+0000 mgr.a (mgr.14388) 19735 : audit [DBG] from='client.423219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:21.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:21 smithi044 bash[22676]: cluster 2024-09-21T05:50:19.876237+0000 mgr.a (mgr.14388) 19736 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:21.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:21 smithi179 bash[23186]: cluster 2024-09-21T05:50:19.876237+0000 mgr.a (mgr.14388) 19736 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:21 smithi049 bash[23528]: cluster 2024-09-21T05:50:19.876237+0000 mgr.a (mgr.14388) 19736 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:22.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:22 smithi044 bash[22676]: cluster 2024-09-21T05:50:21.878701+0000 mgr.a (mgr.14388) 19737 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:22.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:22 smithi179 bash[23186]: cluster 2024-09-21T05:50:21.878701+0000 mgr.a (mgr.14388) 19737 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:22.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:22 smithi049 bash[23528]: cluster 2024-09-21T05:50:21.878701+0000 mgr.a (mgr.14388) 19737 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:24.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:24.146 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:24.942 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:24.943 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:25.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:24 smithi044 bash[22676]: cluster 2024-09-21T05:50:23.879682+0000 mgr.a (mgr.14388) 19738 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:25.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:24 smithi179 bash[23186]: cluster 2024-09-21T05:50:23.879682+0000 mgr.a (mgr.14388) 19738 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:25.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:24 smithi049 bash[23528]: cluster 2024-09-21T05:50:23.879682+0000 mgr.a (mgr.14388) 19738 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:26.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:25 smithi044 bash[22676]: audit 2024-09-21T05:50:24.480939+0000 mgr.a (mgr.14388) 19739 : audit [DBG] from='client.423294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:26.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:25 smithi179 bash[23186]: audit 2024-09-21T05:50:24.480939+0000 mgr.a (mgr.14388) 19739 : audit [DBG] from='client.423294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:26.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:25 smithi049 bash[23528]: audit 2024-09-21T05:50:24.480939+0000 mgr.a (mgr.14388) 19739 : audit [DBG] from='client.423294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:27.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:26 smithi044 bash[22676]: cluster 2024-09-21T05:50:25.882093+0000 mgr.a (mgr.14388) 19740 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:27.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:26 smithi179 bash[23186]: cluster 2024-09-21T05:50:25.882093+0000 mgr.a (mgr.14388) 19740 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:27.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:26 smithi049 bash[23528]: cluster 2024-09-21T05:50:25.882093+0000 mgr.a (mgr.14388) 19740 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:28 smithi044 bash[22676]: cluster 2024-09-21T05:50:27.882858+0000 mgr.a (mgr.14388) 19741 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:28 smithi044 bash[22676]: audit 2024-09-21T05:50:28.811094+0000 mon.a (mon.0) 15586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:28 smithi044 bash[22676]: audit 2024-09-21T05:50:28.819854+0000 mon.a (mon.0) 15587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:28 smithi044 bash[22676]: audit 2024-09-21T05:50:28.830299+0000 mon.a (mon.0) 15588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:28 smithi179 bash[23186]: cluster 2024-09-21T05:50:27.882858+0000 mgr.a (mgr.14388) 19741 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:28 smithi179 bash[23186]: audit 2024-09-21T05:50:28.811094+0000 mon.a (mon.0) 15586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:28 smithi179 bash[23186]: audit 2024-09-21T05:50:28.819854+0000 mon.a (mon.0) 15587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:28 smithi179 bash[23186]: audit 2024-09-21T05:50:28.830299+0000 mon.a (mon.0) 15588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:28 smithi049 bash[23528]: cluster 2024-09-21T05:50:27.882858+0000 mgr.a (mgr.14388) 19741 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:28 smithi049 bash[23528]: audit 2024-09-21T05:50:28.811094+0000 mon.a (mon.0) 15586 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:28 smithi049 bash[23528]: audit 2024-09-21T05:50:28.819854+0000 mon.a (mon.0) 15587 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:28 smithi049 bash[23528]: audit 2024-09-21T05:50:28.830299+0000 mon.a (mon.0) 15588 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:29.944 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:30 smithi044 bash[22676]: cluster 2024-09-21T05:50:29.883609+0000 mgr.a (mgr.14388) 19742 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:31.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:30 smithi044 bash[22676]: audit 2024-09-21T05:50:30.282095+0000 mgr.a (mgr.14388) 19743 : audit [DBG] from='client.423372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:30 smithi179 bash[23186]: cluster 2024-09-21T05:50:29.883609+0000 mgr.a (mgr.14388) 19742 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:31.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:30 smithi179 bash[23186]: audit 2024-09-21T05:50:30.282095+0000 mgr.a (mgr.14388) 19743 : audit [DBG] from='client.423372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:30 smithi049 bash[23528]: cluster 2024-09-21T05:50:29.883609+0000 mgr.a (mgr.14388) 19742 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:31.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:30 smithi049 bash[23528]: audit 2024-09-21T05:50:30.282095+0000 mgr.a (mgr.14388) 19743 : audit [DBG] from='client.423372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:32.988 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:32 smithi044 bash[22676]: cluster 2024-09-21T05:50:31.886573+0000 mgr.a (mgr.14388) 19744 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:33.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:32 smithi179 bash[23186]: cluster 2024-09-21T05:50:31.886573+0000 mgr.a (mgr.14388) 19744 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:33.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:32 smithi049 bash[23528]: cluster 2024-09-21T05:50:31.886573+0000 mgr.a (mgr.14388) 19744 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:50:35.192 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:34 smithi049 bash[23528]: cluster 2024-09-21T05:50:33.887354+0000 mgr.a (mgr.14388) 19745 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:35.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:34 smithi044 bash[22676]: cluster 2024-09-21T05:50:33.887354+0000 mgr.a (mgr.14388) 19745 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:34 smithi179 bash[23186]: cluster 2024-09-21T05:50:33.887354+0000 mgr.a (mgr.14388) 19745 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:35.737 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:36.486 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:37.210 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:36 smithi049 bash[23528]: cluster 2024-09-21T05:50:35.889354+0000 mgr.a (mgr.14388) 19746 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:37.210 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:36 smithi049 bash[23528]: audit 2024-09-21T05:50:36.065720+0000 mgr.a (mgr.14388) 19747 : audit [DBG] from='client.423450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:36 smithi044 bash[22676]: cluster 2024-09-21T05:50:35.889354+0000 mgr.a (mgr.14388) 19746 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:37.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:36 smithi044 bash[22676]: audit 2024-09-21T05:50:36.065720+0000 mgr.a (mgr.14388) 19747 : audit [DBG] from='client.423450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:36 smithi179 bash[23186]: cluster 2024-09-21T05:50:35.889354+0000 mgr.a (mgr.14388) 19746 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:37.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:36 smithi179 bash[23186]: audit 2024-09-21T05:50:36.065720+0000 mgr.a (mgr.14388) 19747 : audit [DBG] from='client.423450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:38.628 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:38 smithi044 bash[22676]: audit 2024-09-21T05:50:37.366587+0000 mon.a (mon.0) 15589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.628 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:38 smithi044 bash[22676]: audit 2024-09-21T05:50:37.373750+0000 mon.a (mon.0) 15590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:38 smithi044 bash[22676]: audit 2024-09-21T05:50:37.385441+0000 mon.a (mon.0) 15591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:38 smithi044 bash[22676]: audit 2024-09-21T05:50:37.510411+0000 mon.a (mon.0) 15592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:38 smithi044 bash[22676]: audit 2024-09-21T05:50:37.520046+0000 mon.a (mon.0) 15593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:38 smithi044 bash[22676]: audit 2024-09-21T05:50:37.530900+0000 mon.a (mon.0) 15594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:38 smithi179 bash[23186]: audit 2024-09-21T05:50:37.366587+0000 mon.a (mon.0) 15589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:38 smithi179 bash[23186]: audit 2024-09-21T05:50:37.373750+0000 mon.a (mon.0) 15590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:38 smithi179 bash[23186]: audit 2024-09-21T05:50:37.385441+0000 mon.a (mon.0) 15591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:38 smithi179 bash[23186]: audit 2024-09-21T05:50:37.510411+0000 mon.a (mon.0) 15592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:38 smithi179 bash[23186]: audit 2024-09-21T05:50:37.520046+0000 mon.a (mon.0) 15593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:38 smithi179 bash[23186]: audit 2024-09-21T05:50:37.530900+0000 mon.a (mon.0) 15594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:38 smithi049 bash[23528]: audit 2024-09-21T05:50:37.366587+0000 mon.a (mon.0) 15589 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:38 smithi049 bash[23528]: audit 2024-09-21T05:50:37.373750+0000 mon.a (mon.0) 15590 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:38 smithi049 bash[23528]: audit 2024-09-21T05:50:37.385441+0000 mon.a (mon.0) 15591 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:38 smithi049 bash[23528]: audit 2024-09-21T05:50:37.510411+0000 mon.a (mon.0) 15592 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:38 smithi049 bash[23528]: audit 2024-09-21T05:50:37.520046+0000 mon.a (mon.0) 15593 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:38.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:38 smithi049 bash[23528]: audit 2024-09-21T05:50:37.530900+0000 mon.a (mon.0) 15594 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:39.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:39 smithi044 bash[22676]: cluster 2024-09-21T05:50:37.890243+0000 mgr.a (mgr.14388) 19748 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:39.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:39 smithi179 bash[23186]: cluster 2024-09-21T05:50:37.890243+0000 mgr.a (mgr.14388) 19748 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:39.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:39 smithi049 bash[23528]: cluster 2024-09-21T05:50:37.890243+0000 mgr.a (mgr.14388) 19748 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:50:41.470 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:41 smithi179 bash[23186]: cluster 2024-09-21T05:50:39.891051+0000 mgr.a (mgr.14388) 19749 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:50:41.487 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:41.489 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:41.489 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:41.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:41 smithi044 bash[22676]: cluster 2024-09-21T05:50:39.891051+0000 mgr.a (mgr.14388) 19749 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:50:41.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:41 smithi049 bash[23528]: cluster 2024-09-21T05:50:39.891051+0000 mgr.a (mgr.14388) 19749 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:50:42.272 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:42.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:42.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:42.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:42.272 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:43.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:43 smithi179 bash[23186]: audit 2024-09-21T05:50:41.824815+0000 mgr.a (mgr.14388) 19750 : audit [DBG] from='client.423525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:43.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:43 smithi179 bash[23186]: cluster 2024-09-21T05:50:41.892516+0000 mgr.a (mgr.14388) 19751 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:43 smithi044 bash[22676]: audit 2024-09-21T05:50:41.824815+0000 mgr.a (mgr.14388) 19750 : audit [DBG] from='client.423525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:43.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:43 smithi044 bash[22676]: cluster 2024-09-21T05:50:41.892516+0000 mgr.a (mgr.14388) 19751 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:43 smithi049 bash[23528]: audit 2024-09-21T05:50:41.824815+0000 mgr.a (mgr.14388) 19750 : audit [DBG] from='client.423525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:43.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:43 smithi049 bash[23528]: cluster 2024-09-21T05:50:41.892516+0000 mgr.a (mgr.14388) 19751 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:45.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:45 smithi044 bash[22676]: cluster 2024-09-21T05:50:43.893423+0000 mgr.a (mgr.14388) 19752 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:45.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:45 smithi179 bash[23186]: cluster 2024-09-21T05:50:43.893423+0000 mgr.a (mgr.14388) 19752 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:45.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:45 smithi049 bash[23528]: cluster 2024-09-21T05:50:43.893423+0000 mgr.a (mgr.14388) 19752 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:47.273 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:47.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:47.274 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:47.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:47 smithi044 bash[22676]: cluster 2024-09-21T05:50:45.895672+0000 mgr.a (mgr.14388) 19753 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:47.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:47 smithi179 bash[23186]: cluster 2024-09-21T05:50:45.895672+0000 mgr.a (mgr.14388) 19753 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:47.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:47 smithi049 bash[23528]: cluster 2024-09-21T05:50:45.895672+0000 mgr.a (mgr.14388) 19753 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:48.045 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:48.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:48.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:48.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:48.045 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:49 smithi044 bash[22676]: audit 2024-09-21T05:50:47.610312+0000 mgr.a (mgr.14388) 19754 : audit [DBG] from='client.423597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:49 smithi044 bash[22676]: cluster 2024-09-21T05:50:47.896218+0000 mgr.a (mgr.14388) 19755 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:49 smithi044 bash[22676]: audit 2024-09-21T05:50:49.050390+0000 mon.a (mon.0) 15595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:49 smithi044 bash[22676]: audit 2024-09-21T05:50:49.059186+0000 mon.a (mon.0) 15596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:49 smithi044 bash[22676]: audit 2024-09-21T05:50:49.069948+0000 mon.a (mon.0) 15597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:49 smithi179 bash[23186]: audit 2024-09-21T05:50:47.610312+0000 mgr.a (mgr.14388) 19754 : audit [DBG] from='client.423597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:49 smithi179 bash[23186]: cluster 2024-09-21T05:50:47.896218+0000 mgr.a (mgr.14388) 19755 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:49 smithi179 bash[23186]: audit 2024-09-21T05:50:49.050390+0000 mon.a (mon.0) 15595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:49 smithi179 bash[23186]: audit 2024-09-21T05:50:49.059186+0000 mon.a (mon.0) 15596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:49 smithi179 bash[23186]: audit 2024-09-21T05:50:49.069948+0000 mon.a (mon.0) 15597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:49 smithi049 bash[23528]: audit 2024-09-21T05:50:47.610312+0000 mgr.a (mgr.14388) 19754 : audit [DBG] from='client.423597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:49.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:49 smithi049 bash[23528]: cluster 2024-09-21T05:50:47.896218+0000 mgr.a (mgr.14388) 19755 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:49 smithi049 bash[23528]: audit 2024-09-21T05:50:49.050390+0000 mon.a (mon.0) 15595 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:49 smithi049 bash[23528]: audit 2024-09-21T05:50:49.059186+0000 mon.a (mon.0) 15596 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:49.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:49 smithi049 bash[23528]: audit 2024-09-21T05:50:49.069948+0000 mon.a (mon.0) 15597 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:51.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:51 smithi044 bash[22676]: cluster 2024-09-21T05:50:49.897068+0000 mgr.a (mgr.14388) 19756 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:51.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:51 smithi179 bash[23186]: cluster 2024-09-21T05:50:49.897068+0000 mgr.a (mgr.14388) 19756 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:51.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:51 smithi049 bash[23528]: cluster 2024-09-21T05:50:49.897068+0000 mgr.a (mgr.14388) 19756 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:53.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:53 smithi044 bash[22676]: cluster 2024-09-21T05:50:51.899475+0000 mgr.a (mgr.14388) 19757 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:53.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:53 smithi179 bash[23186]: cluster 2024-09-21T05:50:51.899475+0000 mgr.a (mgr.14388) 19757 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:53.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:53 smithi049 bash[23528]: cluster 2024-09-21T05:50:51.899475+0000 mgr.a (mgr.14388) 19757 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:53.806 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:54.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:54 smithi044 bash[22676]: audit 2024-09-21T05:50:53.377989+0000 mgr.a (mgr.14388) 19758 : audit [DBG] from='client.423675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:54.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:54 smithi179 bash[23186]: audit 2024-09-21T05:50:53.377989+0000 mgr.a (mgr.14388) 19758 : audit [DBG] from='client.423675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:54.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:54 smithi049 bash[23528]: audit 2024-09-21T05:50:53.377989+0000 mgr.a (mgr.14388) 19758 : audit [DBG] from='client.423675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:55.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:55 smithi044 bash[22676]: cluster 2024-09-21T05:50:53.900495+0000 mgr.a (mgr.14388) 19759 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:55.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:55 smithi179 bash[23186]: cluster 2024-09-21T05:50:53.900495+0000 mgr.a (mgr.14388) 19759 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:55.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:55 smithi049 bash[23528]: cluster 2024-09-21T05:50:53.900495+0000 mgr.a (mgr.14388) 19759 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:56 smithi044 bash[22676]: cluster 2024-09-21T05:50:55.902765+0000 mgr.a (mgr.14388) 19760 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:56.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:56 smithi179 bash[23186]: cluster 2024-09-21T05:50:55.902765+0000 mgr.a (mgr.14388) 19760 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:56.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:56 smithi049 bash[23528]: cluster 2024-09-21T05:50:55.902765+0000 mgr.a (mgr.14388) 19760 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:50:58.808 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:50:58.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:50:58.809 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:50:58.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:58 smithi044 bash[22676]: audit 2024-09-21T05:50:57.581816+0000 mon.a (mon.0) 15598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:58.913 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:58 smithi044 bash[22676]: audit 2024-09-21T05:50:57.591274+0000 mon.a (mon.0) 15599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:58.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:58 smithi044 bash[22676]: audit 2024-09-21T05:50:57.603188+0000 mon.a (mon.0) 15600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:58.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:58 smithi044 bash[22676]: audit 2024-09-21T05:50:57.736813+0000 mon.a (mon.0) 15601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:58.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:58 smithi044 bash[22676]: audit 2024-09-21T05:50:57.746600+0000 mon.a (mon.0) 15602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:58.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:58 smithi044 bash[22676]: audit 2024-09-21T05:50:57.756755+0000 mon.a (mon.0) 15603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:58.914 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:58 smithi044 bash[22676]: cluster 2024-09-21T05:50:57.903681+0000 mgr.a (mgr.14388) 19761 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:58 smithi179 bash[23186]: audit 2024-09-21T05:50:57.581816+0000 mon.a (mon.0) 15598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:58 smithi179 bash[23186]: audit 2024-09-21T05:50:57.591274+0000 mon.a (mon.0) 15599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:58 smithi179 bash[23186]: audit 2024-09-21T05:50:57.603188+0000 mon.a (mon.0) 15600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:58 smithi179 bash[23186]: audit 2024-09-21T05:50:57.736813+0000 mon.a (mon.0) 15601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:58 smithi179 bash[23186]: audit 2024-09-21T05:50:57.746600+0000 mon.a (mon.0) 15602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:58 smithi179 bash[23186]: audit 2024-09-21T05:50:57.756755+0000 mon.a (mon.0) 15603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:58 smithi179 bash[23186]: cluster 2024-09-21T05:50:57.903681+0000 mgr.a (mgr.14388) 19761 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:59.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:58 smithi049 bash[23528]: audit 2024-09-21T05:50:57.581816+0000 mon.a (mon.0) 15598 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:58 smithi049 bash[23528]: audit 2024-09-21T05:50:57.591274+0000 mon.a (mon.0) 15599 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:58 smithi049 bash[23528]: audit 2024-09-21T05:50:57.603188+0000 mon.a (mon.0) 15600 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:58 smithi049 bash[23528]: audit 2024-09-21T05:50:57.736813+0000 mon.a (mon.0) 15601 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:58 smithi049 bash[23528]: audit 2024-09-21T05:50:57.746600+0000 mon.a (mon.0) 15602 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:58 smithi049 bash[23528]: audit 2024-09-21T05:50:57.756755+0000 mon.a (mon.0) 15603 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:50:59.055 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:58 smithi049 bash[23528]: cluster 2024-09-21T05:50:57.903681+0000 mgr.a (mgr.14388) 19761 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:50:59.604 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:50:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:50:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:50:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:50:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:50:59.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:50:59 smithi044 bash[22676]: audit 2024-09-21T05:50:59.149560+0000 mgr.a (mgr.14388) 19762 : audit [DBG] from='client.423753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:00.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:50:59 smithi049 bash[23528]: audit 2024-09-21T05:50:59.149560+0000 mgr.a (mgr.14388) 19762 : audit [DBG] from='client.423753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:00.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:50:59 smithi179 bash[23186]: audit 2024-09-21T05:50:59.149560+0000 mgr.a (mgr.14388) 19762 : audit [DBG] from='client.423753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:01.054 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:00 smithi049 bash[23528]: cluster 2024-09-21T05:50:59.904641+0000 mgr.a (mgr.14388) 19763 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:01.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:00 smithi044 bash[22676]: cluster 2024-09-21T05:50:59.904641+0000 mgr.a (mgr.14388) 19763 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:01.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:00 smithi179 bash[23186]: cluster 2024-09-21T05:50:59.904641+0000 mgr.a (mgr.14388) 19763 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:03.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:02 smithi044 bash[22676]: cluster 2024-09-21T05:51:01.907006+0000 mgr.a (mgr.14388) 19764 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:51:03.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:02 smithi179 bash[23186]: cluster 2024-09-21T05:51:01.907006+0000 mgr.a (mgr.14388) 19764 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:51:03.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:02 smithi049 bash[23528]: cluster 2024-09-21T05:51:01.907006+0000 mgr.a (mgr.14388) 19764 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:51:04.606 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:51:04.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:51:04.607 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:51:05.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:04 smithi044 bash[22676]: cluster 2024-09-21T05:51:03.907780+0000 mgr.a (mgr.14388) 19765 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:05.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:04 smithi179 bash[23186]: cluster 2024-09-21T05:51:03.907780+0000 mgr.a (mgr.14388) 19765 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:05.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:04 smithi049 bash[23528]: cluster 2024-09-21T05:51:03.907780+0000 mgr.a (mgr.14388) 19765 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:05.397 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:51:05.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:51:05.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:51:05.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:51:05.397 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:51:06.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:05 smithi044 bash[22676]: audit 2024-09-21T05:51:04.944511+0000 mgr.a (mgr.14388) 19766 : audit [DBG] from='client.423825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:06.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:05 smithi179 bash[23186]: audit 2024-09-21T05:51:04.944511+0000 mgr.a (mgr.14388) 19766 : audit [DBG] from='client.423825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:06.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:05 smithi049 bash[23528]: audit 2024-09-21T05:51:04.944511+0000 mgr.a (mgr.14388) 19766 : audit [DBG] from='client.423825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:07.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:06 smithi044 bash[22676]: cluster 2024-09-21T05:51:05.910883+0000 mgr.a (mgr.14388) 19767 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:07.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:06 smithi179 bash[23186]: cluster 2024-09-21T05:51:05.910883+0000 mgr.a (mgr.14388) 19767 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:07.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:06 smithi049 bash[23528]: cluster 2024-09-21T05:51:05.910883+0000 mgr.a (mgr.14388) 19767 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:09.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:08 smithi044 bash[22676]: cluster 2024-09-21T05:51:07.911872+0000 mgr.a (mgr.14388) 19768 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:09.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:08 smithi179 bash[23186]: cluster 2024-09-21T05:51:07.911872+0000 mgr.a (mgr.14388) 19768 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:09.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:08 smithi049 bash[23528]: cluster 2024-09-21T05:51:07.911872+0000 mgr.a (mgr.14388) 19768 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:10.398 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:51:10.399 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:51:10.399 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:51:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:10 smithi049 bash[23528]: audit 2024-09-21T05:51:09.286992+0000 mon.a (mon.0) 15604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:10 smithi049 bash[23528]: audit 2024-09-21T05:51:09.295751+0000 mon.a (mon.0) 15605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.554 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:10 smithi049 bash[23528]: audit 2024-09-21T05:51:09.306380+0000 mon.a (mon.0) 15606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:10 smithi044 bash[22676]: audit 2024-09-21T05:51:09.286992+0000 mon.a (mon.0) 15604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:10 smithi044 bash[22676]: audit 2024-09-21T05:51:09.295751+0000 mon.a (mon.0) 15605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:10 smithi044 bash[22676]: audit 2024-09-21T05:51:09.306380+0000 mon.a (mon.0) 15606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:10 smithi179 bash[23186]: audit 2024-09-21T05:51:09.286992+0000 mon.a (mon.0) 15604 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:10 smithi179 bash[23186]: audit 2024-09-21T05:51:09.295751+0000 mon.a (mon.0) 15605 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:10.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:10 smithi179 bash[23186]: audit 2024-09-21T05:51:09.306380+0000 mon.a (mon.0) 15606 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:11.177 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:51:11.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:51:11.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:51:11.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:51:11.177 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:51:11.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:11 smithi044 bash[22676]: cluster 2024-09-21T05:51:09.912808+0000 mgr.a (mgr.14388) 19769 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:11.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:11 smithi179 bash[23186]: cluster 2024-09-21T05:51:09.912808+0000 mgr.a (mgr.14388) 19769 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:11.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:11 smithi049 bash[23528]: cluster 2024-09-21T05:51:09.912808+0000 mgr.a (mgr.14388) 19769 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:12.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:12 smithi044 bash[22676]: audit 2024-09-21T05:51:10.732612+0000 mgr.a (mgr.14388) 19770 : audit [DBG] from='client.423903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:12.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:12 smithi179 bash[23186]: audit 2024-09-21T05:51:10.732612+0000 mgr.a (mgr.14388) 19770 : audit [DBG] from='client.423903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:12.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:12 smithi049 bash[23528]: audit 2024-09-21T05:51:10.732612+0000 mgr.a (mgr.14388) 19770 : audit [DBG] from='client.423903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:13.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:13 smithi044 bash[22676]: cluster 2024-09-21T05:51:11.915755+0000 mgr.a (mgr.14388) 19771 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:13.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:13 smithi179 bash[23186]: cluster 2024-09-21T05:51:11.915755+0000 mgr.a (mgr.14388) 19771 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:13.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:13 smithi049 bash[23528]: cluster 2024-09-21T05:51:11.915755+0000 mgr.a (mgr.14388) 19771 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:15.646 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:15 smithi049 bash[23528]: cluster 2024-09-21T05:51:13.916557+0000 mgr.a (mgr.14388) 19772 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:15.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:15 smithi044 bash[22676]: cluster 2024-09-21T05:51:13.916557+0000 mgr.a (mgr.14388) 19772 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:15.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:15 smithi179 bash[23186]: cluster 2024-09-21T05:51:13.916557+0000 mgr.a (mgr.14388) 19772 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-21T05:51:16.178 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:51:16.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:51:16.179 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:51:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:51:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:51:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:51:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:51:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:51:17.572 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:17 smithi044 bash[22676]: cluster 2024-09-21T05:51:15.918598+0000 mgr.a (mgr.14388) 19773 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:17.605 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:17 smithi049 bash[23528]: cluster 2024-09-21T05:51:15.918598+0000 mgr.a (mgr.14388) 19773 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:17.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:17 smithi179 bash[23186]: cluster 2024-09-21T05:51:15.918598+0000 mgr.a (mgr.14388) 19773 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:16.517769+0000 mgr.a (mgr.14388) 19774 : audit [DBG] from='client.423981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:17.814172+0000 mon.a (mon.0) 15607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:17.823428+0000 mon.a (mon.0) 15608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:17.833437+0000 mon.a (mon.0) 15609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:17.977535+0000 mon.a (mon.0) 15610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:17.985896+0000 mon.a (mon.0) 15611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:17.996079+0000 mon.a (mon.0) 15612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:18.269667+0000 mon.a (mon.0) 15613 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:18.277697+0000 mon.a (mon.0) 15614 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:51:18.555 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:18.279693+0000 mon.a (mon.0) 15615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:51:18.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:18.290836+0000 mon.a (mon.0) 15616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.556 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:18 smithi049 bash[23528]: audit 2024-09-21T05:51:18.297377+0000 mon.a (mon.0) 15617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:51:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:16.517769+0000 mgr.a (mgr.14388) 19774 : audit [DBG] from='client.423981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:17.814172+0000 mon.a (mon.0) 15607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:17.823428+0000 mon.a (mon.0) 15608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:17.833437+0000 mon.a (mon.0) 15609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:17.977535+0000 mon.a (mon.0) 15610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:17.985896+0000 mon.a (mon.0) 15611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:17.996079+0000 mon.a (mon.0) 15612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:18.269667+0000 mon.a (mon.0) 15613 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:18.277697+0000 mon.a (mon.0) 15614 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:18.279693+0000 mon.a (mon.0) 15615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:18.290836+0000 mon.a (mon.0) 15616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:18 smithi044 bash[22676]: audit 2024-09-21T05:51:18.297377+0000 mon.a (mon.0) 15617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:16.517769+0000 mgr.a (mgr.14388) 19774 : audit [DBG] from='client.423981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:17.814172+0000 mon.a (mon.0) 15607 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:17.823428+0000 mon.a (mon.0) 15608 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:17.833437+0000 mon.a (mon.0) 15609 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:17.977535+0000 mon.a (mon.0) 15610 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:17.985896+0000 mon.a (mon.0) 15611 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:17.996079+0000 mon.a (mon.0) 15612 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:18.269667+0000 mon.a (mon.0) 15613 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:51:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:18.277697+0000 mon.a (mon.0) 15614 : audit [DBG] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:51:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:18.279693+0000 mon.a (mon.0) 15615 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:51:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:18.290836+0000 mon.a (mon.0) 15616 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:18.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:18 smithi179 bash[23186]: audit 2024-09-21T05:51:18.297377+0000 mon.a (mon.0) 15617 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:51:19.368 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:51:19 smithi044 bash[22930]: debug 2024-09-21T05:51:19.089+0000 7f4bede1a640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:51:19.368 INFO:journalctl@ceph.mgr.a.smithi044.stdout:Sep 21 05:51:19 smithi044 bash[22930]: debug 2024-09-21T05:51:19.093+0000 7f4c05789640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:51:19.368 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:19 smithi044 bash[22676]: cluster 2024-09-21T05:51:17.919097+0000 mgr.a (mgr.14388) 19775 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:19.368 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:19 smithi044 bash[22676]: audit 2024-09-21T05:51:18.299961+0000 mgr.a (mgr.14388) 19776 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:19 smithi179 bash[23186]: cluster 2024-09-21T05:51:17.919097+0000 mgr.a (mgr.14388) 19775 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:19.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:19 smithi179 bash[23186]: audit 2024-09-21T05:51:18.299961+0000 mgr.a (mgr.14388) 19776 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:51:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:19 smithi049 bash[23528]: cluster 2024-09-21T05:51:17.919097+0000 mgr.a (mgr.14388) 19775 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:19.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:19 smithi049 bash[23528]: audit 2024-09-21T05:51:18.299961+0000 mgr.a (mgr.14388) 19776 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: dispatch 2024-09-21T05:51:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:20 smithi044 bash[22676]: audit 2024-09-21T05:51:19.097206+0000 mgr.a (mgr.14388) 19777 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:51:20.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:20 smithi044 bash[22676]: cephadm 2024-09-21T05:51:19.098870+0000 mgr.a (mgr.14388) 19778 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:51:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:20 smithi179 bash[23186]: audit 2024-09-21T05:51:19.097206+0000 mgr.a (mgr.14388) 19777 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:51:20.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:20 smithi179 bash[23186]: cephadm 2024-09-21T05:51:19.098870+0000 mgr.a (mgr.14388) 19778 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:51:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:20 smithi049 bash[23528]: audit 2024-09-21T05:51:19.097206+0000 mgr.a (mgr.14388) 19777 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjE1N2Y1MzVhLWYwZGItNGU1Zi1hOGY3LWIwNzE1YjEwZTUzZCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiWldEUU00WjM1TVIzTzlOVkE3TDciLAogICAgInNlY3JldCI6ICJ5ZUdDVlhOaHl0QUE3WnU5NndSTllUSmoyaG53aXdjRmtEY2tXOE5XIgp9", "zone_endpoints": ["http://smithi049:5500", "http://smithi179:5500"]}]: access denied 2024-09-21T05:51:20.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:20 smithi049 bash[23528]: cephadm 2024-09-21T05:51:19.098870+0000 mgr.a (mgr.14388) 19778 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-21T05:51:21.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:21 smithi044 bash[22676]: cluster 2024-09-21T05:51:19.920193+0000 mgr.a (mgr.14388) 19779 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:21.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:21 smithi179 bash[23186]: cluster 2024-09-21T05:51:19.920193+0000 mgr.a (mgr.14388) 19779 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:21.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:21 smithi049 bash[23528]: cluster 2024-09-21T05:51:19.920193+0000 mgr.a (mgr.14388) 19779 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:21.971 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:51:21.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:51:21.972 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:51:22.741 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:51:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:51:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:51:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:51:22.741 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:51:23.622 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:23 smithi179 bash[23186]: cluster 2024-09-21T05:51:21.922534+0000 mgr.a (mgr.14388) 19780 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:23.623 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:23 smithi179 bash[23186]: audit 2024-09-21T05:51:22.303441+0000 mgr.a (mgr.14388) 19781 : audit [DBG] from='client.424164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:23.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:23 smithi044 bash[22676]: cluster 2024-09-21T05:51:21.922534+0000 mgr.a (mgr.14388) 19780 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:23.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:23 smithi044 bash[22676]: audit 2024-09-21T05:51:22.303441+0000 mgr.a (mgr.14388) 19781 : audit [DBG] from='client.424164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:23 smithi049 bash[23528]: cluster 2024-09-21T05:51:21.922534+0000 mgr.a (mgr.14388) 19780 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:23.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:23 smithi049 bash[23528]: audit 2024-09-21T05:51:22.303441+0000 mgr.a (mgr.14388) 19781 : audit [DBG] from='client.424164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:25.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:25 smithi044 bash[22676]: cluster 2024-09-21T05:51:23.923437+0000 mgr.a (mgr.14388) 19782 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:25.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:25 smithi179 bash[23186]: cluster 2024-09-21T05:51:23.923437+0000 mgr.a (mgr.14388) 19782 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:25.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:25 smithi049 bash[23528]: cluster 2024-09-21T05:51:23.923437+0000 mgr.a (mgr.14388) 19782 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:27.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:27 smithi044 bash[22676]: cluster 2024-09-21T05:51:25.925915+0000 mgr.a (mgr.14388) 19783 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:51:27.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:51:27.743 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:51:27.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:27 smithi179 bash[23186]: cluster 2024-09-21T05:51:25.925915+0000 mgr.a (mgr.14388) 19783 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:27.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:27 smithi049 bash[23528]: cluster 2024-09-21T05:51:25.925915+0000 mgr.a (mgr.14388) 19783 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:28.546 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:51:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:51:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:51:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:51:28.547 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:51:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:29 smithi044 bash[22676]: cluster 2024-09-21T05:51:27.926700+0000 mgr.a (mgr.14388) 19784 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:29.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:29 smithi044 bash[22676]: audit 2024-09-21T05:51:28.084527+0000 mgr.a (mgr.14388) 19785 : audit [DBG] from='client.424239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:29 smithi179 bash[23186]: cluster 2024-09-21T05:51:27.926700+0000 mgr.a (mgr.14388) 19784 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:29.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:29 smithi179 bash[23186]: audit 2024-09-21T05:51:28.084527+0000 mgr.a (mgr.14388) 19785 : audit [DBG] from='client.424239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:29 smithi049 bash[23528]: cluster 2024-09-21T05:51:27.926700+0000 mgr.a (mgr.14388) 19784 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:29.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:29 smithi049 bash[23528]: audit 2024-09-21T05:51:28.084527+0000 mgr.a (mgr.14388) 19785 : audit [DBG] from='client.424239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:30 smithi049 bash[23528]: audit 2024-09-21T05:51:29.524148+0000 mon.a (mon.0) 15618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:30 smithi049 bash[23528]: audit 2024-09-21T05:51:29.534148+0000 mon.a (mon.0) 15619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:30.804 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:30 smithi049 bash[23528]: audit 2024-09-21T05:51:29.545450+0000 mon.a (mon.0) 15620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:30.805 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:30 smithi049 bash[23528]: cluster 2024-09-21T05:51:29.927726+0000 mgr.a (mgr.14388) 19786 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:30 smithi044 bash[22676]: audit 2024-09-21T05:51:29.524148+0000 mon.a (mon.0) 15618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:30 smithi044 bash[22676]: audit 2024-09-21T05:51:29.534148+0000 mon.a (mon.0) 15619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:30 smithi044 bash[22676]: audit 2024-09-21T05:51:29.545450+0000 mon.a (mon.0) 15620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:30.989 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:30 smithi044 bash[22676]: cluster 2024-09-21T05:51:29.927726+0000 mgr.a (mgr.14388) 19786 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:30 smithi179 bash[23186]: audit 2024-09-21T05:51:29.524148+0000 mon.a (mon.0) 15618 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:30 smithi179 bash[23186]: audit 2024-09-21T05:51:29.534148+0000 mon.a (mon.0) 15619 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:30 smithi179 bash[23186]: audit 2024-09-21T05:51:29.545450+0000 mon.a (mon.0) 15620 : audit [INF] from='mgr.14388 172.21.15.44:0/2535024337' entity='mgr.a' 2024-09-21T05:51:31.005 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:30 smithi179 bash[23186]: cluster 2024-09-21T05:51:29.927726+0000 mgr.a (mgr.14388) 19786 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:33.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:32 smithi179 bash[23186]: cluster 2024-09-21T05:51:31.930013+0000 mgr.a (mgr.14388) 19787 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:33.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:32 smithi049 bash[23528]: cluster 2024-09-21T05:51:31.930013+0000 mgr.a (mgr.14388) 19787 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:33.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:32 smithi044 bash[22676]: cluster 2024-09-21T05:51:31.930013+0000 mgr.a (mgr.14388) 19787 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T05:51:33.548 INFO:teuthology.orchestra.run.smithi044.stderr:+ true 2024-09-21T05:51:33.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ ceph rgw realm tokens 2024-09-21T05:51:33.549 INFO:teuthology.orchestra.run.smithi044.stderr:++ jq -r '.[0].token' 2024-09-21T05:51:34.332 INFO:teuthology.orchestra.run.smithi044.stdout:master zone has no endpoint 2024-09-21T05:51:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ TOKEN='master zone has no endpoint' 2024-09-21T05:51:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ echo master zone has no endpoint 2024-09-21T05:51:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-21T05:51:34.332 INFO:teuthology.orchestra.run.smithi044.stderr:+ sleep 5 2024-09-21T05:51:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:34 smithi179 bash[23186]: audit 2024-09-21T05:51:33.879727+0000 mgr.a (mgr.14388) 19788 : audit [DBG] from='client.424317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:35.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:34 smithi179 bash[23186]: cluster 2024-09-21T05:51:33.930708+0000 mgr.a (mgr.14388) 19789 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:34 smithi049 bash[23528]: audit 2024-09-21T05:51:33.879727+0000 mgr.a (mgr.14388) 19788 : audit [DBG] from='client.424317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:35.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:34 smithi049 bash[23528]: cluster 2024-09-21T05:51:33.930708+0000 mgr.a (mgr.14388) 19789 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:35.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:34 smithi044 bash[22676]: audit 2024-09-21T05:51:33.879727+0000 mgr.a (mgr.14388) 19788 : audit [DBG] from='client.424317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:35.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:34 smithi044 bash[22676]: cluster 2024-09-21T05:51:33.930708+0000 mgr.a (mgr.14388) 19789 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-21T05:51:37.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:Sep 21 05:51:36 smithi044 bash[22676]: cluster 2024-09-21T05:51:35.933067+0000 mgr.a (mgr.14388) 19790 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:51:37.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 21 05:51:36 smithi179 bash[23186]: cluster 2024-09-21T05:51:35.933067+0000 mgr.a (mgr.14388) 19790 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:51:37.304 INFO:journalctl@ceph.mon.b.smithi049.stdout:Sep 21 05:51:36 smithi049 bash[23528]: cluster 2024-09-21T05:51:35.933067+0000 mgr.a (mgr.14388) 19790 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-21T05:51:38.386 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-09-21T05:51:38.387 DEBUG:teuthology.task.console_log:Killing console logger for smithi044 2024-09-21T05:51:38.388 DEBUG:teuthology.task.console_log:Killing console logger for smithi049 2024-09-21T05:51:38.388 DEBUG:teuthology.task.console_log:Killing console logger for smithi179 2024-09-21T05:51:38.388 DEBUG:teuthology.exit:Finished running handlers